2023-10-03T18:56:51.714 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-03T18:56:51.714 DEBUG:teuthology.run:Teuthology command: teuthology --description fs:multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cephfs_misc_tests} --archive /home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409792 --name choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi --verbose --owner scheduled_choffman@teuthology -- /home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409792/orig.config.yaml 2023-10-03T18:56:51.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T18:56:51.841 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409792 branch: wip-choffman-62793 description: fs:multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cephfs_misc_tests} email: choffman@redhat.com first_in_suite: false job_id: '7409792' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-choffman-62793 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - evicting unresponsive client - POOL_APP_NOT_ENABLED - has not responded to cap revoke by MDS for over - MDS_CLIENT_LATE_RELEASE - responding to mclientcaps - RECENT_CRASH sha1: 05a43c8fb3988914c879a50970f9054a098e0612 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 05a43c8fb3988914c879a50970f9054a098e0612 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-choffman-62793 sha1: 05a43c8fb3988914c879a50970f9054a098e0612 owner: scheduled_choffman@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 - - client.1 seed: 3306 sha1: 05a43c8fb3988914c879a50970f9054a098e0612 sleep_before_teardown: 0 suite: fs:multiclient suite_branch: wip-choffman-62793 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_05a43c8fb3988914c879a50970f9054a098e0612/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 05a43c8fb3988914c879a50970f9054a098e0612 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi045.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBJfsaj1djbOti81Dmn5qO0pfO5rYcvniGIAtp+MIUvkVmtGd9VXAp06DIE/qyqJOyjh5SZa6UesWBZxgky+s4U= smithi079.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKgpdiDVkYYXQbbURBwT9Rp8YDcnmAh2JRm/q5erIc+gDdvR4Mxzhp1KpKacw1JRbdCOH6jNalhbDy1hqwVjlcg= smithi146.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBMtZSn5l68ULSewvnabptb3DKz9uudJEq10NeUGv4Rt65sNrEqRevCUYjra9dz+LkBRhymwHaIunBYfmm5hk4c= smithi172.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBARCcmEfPgLbLeMB5pthXEkrZT5nqdfdF5Ubx6PDhdBG6RidO06YCSAxrRhSCHTNcaw7nUa1ndiM3aIPmuwM5og= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_misc teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-03_18:32:29 tube: smithi user: choffman verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-03T18:56:51.842 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_05a43c8fb3988914c879a50970f9054a098e0612/qa; will attempt to use it 2023-10-03T18:56:51.843 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_05a43c8fb3988914c879a50970f9054a098e0612/qa/tasks 2023-10-03T18:56:51.843 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-03T18:56:51.844 INFO:teuthology.task.internal:Checking packages... 2023-10-03T18:56:51.867 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '05a43c8fb3988914c879a50970f9054a098e0612' 2023-10-03T18:56:51.867 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T18:56:51.868 INFO:teuthology.packaging:ref: None 2023-10-03T18:56:51.868 INFO:teuthology.packaging:tag: None 2023-10-03T18:56:51.868 INFO:teuthology.packaging:branch: wip-choffman-62793 2023-10-03T18:56:51.868 INFO:teuthology.packaging:sha1: 05a43c8fb3988914c879a50970f9054a098e0612 2023-10-03T18:56:51.868 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-choffman-62793 2023-10-03T18:56:52.091 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-3908-g05a43c8f-1jammy 2023-10-03T18:56:52.091 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-03T18:56:52.098 INFO:teuthology.task.internal:no buildpackages task found 2023-10-03T18:56:52.098 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-03T18:56:52.115 INFO:teuthology.task.internal:Saving configuration 2023-10-03T18:56:52.130 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-03T18:56:52.137 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-03T18:56:52.163 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409792', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 18:51:06.337130', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIE+eSs1nEeilnwbD4hN9HJuY2wxnNDUPJxQwDBkUpNm2'} 2023-10-03T18:56:52.185 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409792', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 18:51:06.338221', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILAbAV+EufszErD6AUJxKGINLE6V/dgLSfGFJHOCgFBo'} 2023-10-03T18:56:52.203 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409792', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 18:51:06.334219', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMI2dNBUcBNxvVSbSAxzCdVWlzW0L9idmlehAm7337dM'} 2023-10-03T18:56:52.224 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409792', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 18:51:06.336036', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAu6/THDMb/zmX/c+nIm2EjNEkWINrGKmdum3wNdusmh'} 2023-10-03T18:56:52.224 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-03T18:56:52.231 INFO:teuthology.task.internal:roles: ubuntu@smithi045.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-10-03T18:56:52.231 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-10-03T18:56:52.231 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['client.0'] 2023-10-03T18:56:52.231 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['client.1'] 2023-10-03T18:56:52.231 INFO:teuthology.run_tasks:Running task console_log... 2023-10-03T18:56:52.372 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8936088040>, signals=[15]) 2023-10-03T18:56:52.373 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-03T18:56:52.379 INFO:teuthology.task.internal:Opening connections... 2023-10-03T18:56:52.379 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi045.front.sepia.ceph.com 2023-10-03T18:56:52.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:56:52.461 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi079.front.sepia.ceph.com 2023-10-03T18:56:52.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:56:52.537 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi146.front.sepia.ceph.com 2023-10-03T18:56:52.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:56:52.612 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2023-10-03T18:56:52.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:56:52.691 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-03T18:56:52.698 DEBUG:teuthology.orchestra.run.smithi045:> uname -m 2023-10-03T18:56:52.704 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2023-10-03T18:56:52.704 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2023-10-03T18:56:52.751 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-03T18:56:52.751 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="Ubuntu" 2023-10-03T18:56:52.751 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="22.04" 2023-10-03T18:56:52.751 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-03T18:56:52.751 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_CODENAME=jammy 2023-10-03T18:56:52.752 INFO:teuthology.orchestra.run.smithi045.stdout:ID=ubuntu 2023-10-03T18:56:52.752 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE=debian 2023-10-03T18:56:52.752 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-03T18:56:52.752 INFO:teuthology.orchestra.run.smithi045.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-03T18:56:52.752 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-03T18:56:52.752 INFO:teuthology.orchestra.run.smithi045.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-03T18:56:52.752 INFO:teuthology.orchestra.run.smithi045.stdout:UBUNTU_CODENAME=jammy 2023-10-03T18:56:52.753 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2023-10-03T18:56:52.791 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2023-10-03T18:56:52.797 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2023-10-03T18:56:52.798 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2023-10-03T18:56:52.844 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-03T18:56:52.844 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Ubuntu" 2023-10-03T18:56:52.844 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="22.04" 2023-10-03T18:56:52.844 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-03T18:56:52.844 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_CODENAME=jammy 2023-10-03T18:56:52.844 INFO:teuthology.orchestra.run.smithi079.stdout:ID=ubuntu 2023-10-03T18:56:52.844 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE=debian 2023-10-03T18:56:52.844 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-03T18:56:52.845 INFO:teuthology.orchestra.run.smithi079.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-03T18:56:52.845 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-03T18:56:52.845 INFO:teuthology.orchestra.run.smithi079.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-03T18:56:52.845 INFO:teuthology.orchestra.run.smithi079.stdout:UBUNTU_CODENAME=jammy 2023-10-03T18:56:52.845 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-10-03T18:56:52.866 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2023-10-03T18:56:52.872 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2023-10-03T18:56:52.872 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2023-10-03T18:56:52.918 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-03T18:56:52.918 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="Ubuntu" 2023-10-03T18:56:52.918 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="22.04" 2023-10-03T18:56:52.918 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-03T18:56:52.919 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_CODENAME=jammy 2023-10-03T18:56:52.919 INFO:teuthology.orchestra.run.smithi146.stdout:ID=ubuntu 2023-10-03T18:56:52.919 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE=debian 2023-10-03T18:56:52.919 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-03T18:56:52.919 INFO:teuthology.orchestra.run.smithi146.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-03T18:56:52.919 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-03T18:56:52.919 INFO:teuthology.orchestra.run.smithi146.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-03T18:56:52.919 INFO:teuthology.orchestra.run.smithi146.stdout:UBUNTU_CODENAME=jammy 2023-10-03T18:56:52.919 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2023-10-03T18:56:52.941 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2023-10-03T18:56:52.947 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2023-10-03T18:56:52.947 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2023-10-03T18:56:52.996 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-03T18:56:52.997 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Ubuntu" 2023-10-03T18:56:52.997 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="22.04" 2023-10-03T18:56:52.997 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-03T18:56:52.997 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_CODENAME=jammy 2023-10-03T18:56:52.997 INFO:teuthology.orchestra.run.smithi172.stdout:ID=ubuntu 2023-10-03T18:56:52.997 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE=debian 2023-10-03T18:56:52.997 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-03T18:56:52.997 INFO:teuthology.orchestra.run.smithi172.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-03T18:56:52.997 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-03T18:56:52.997 INFO:teuthology.orchestra.run.smithi172.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-03T18:56:52.998 INFO:teuthology.orchestra.run.smithi172.stdout:UBUNTU_CODENAME=jammy 2023-10-03T18:56:52.998 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-10-03T18:56:53.024 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-03T18:56:53.033 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-03T18:56:53.039 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-03T18:56:53.040 DEBUG:teuthology.orchestra.run.smithi045:> test '!' -e /home/ubuntu/cephtest 2023-10-03T18:56:53.042 DEBUG:teuthology.orchestra.run.smithi079:> test '!' -e /home/ubuntu/cephtest 2023-10-03T18:56:53.045 DEBUG:teuthology.orchestra.run.smithi146:> test '!' -e /home/ubuntu/cephtest 2023-10-03T18:56:53.047 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2023-10-03T18:56:53.052 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-03T18:56:53.058 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-03T18:56:53.058 DEBUG:teuthology.orchestra.run.smithi045:> test -z $(ls -A /var/lib/ceph) 2023-10-03T18:56:53.088 DEBUG:teuthology.orchestra.run.smithi079:> test -z $(ls -A /var/lib/ceph) 2023-10-03T18:56:53.092 DEBUG:teuthology.orchestra.run.smithi146:> test -z $(ls -A /var/lib/ceph) 2023-10-03T18:56:53.095 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2023-10-03T18:56:53.117 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-03T18:56:53.217 INFO:teuthology.run_tasks:Running task kernel... 2023-10-03T18:56:53.256 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-03T18:56:53.256 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-03T18:56:53.257 DEBUG:teuthology.orchestra.run.smithi045:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-03T18:56:53.257 DEBUG:teuthology.orchestra.run.smithi079:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-03T18:56:53.258 DEBUG:teuthology.orchestra.run.smithi146:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-03T18:56:53.258 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-03T18:56:53.262 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T18:56:53.263 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2023-10-03T18:56:53.264 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T18:56:53.264 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T18:56:53.264 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T18:56:53.265 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2023-10-03T18:56:53.266 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2023-10-03T18:56:53.266 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2023-10-03T18:56:53.310 INFO:teuthology.orchestra.run.smithi146.stdout:5.15.0-56-generic 2023-10-03T18:56:53.310 INFO:teuthology.task.kernel:Running kernel on smithi146: 5.15.0-56-generic 2023-10-03T18:56:53.311 DEBUG:teuthology.orchestra.run.smithi146:> sudo apt-get clean 2023-10-03T18:56:53.312 INFO:teuthology.orchestra.run.smithi045.stdout:5.15.0-56-generic 2023-10-03T18:56:53.312 INFO:teuthology.task.kernel:Running kernel on smithi045: 5.15.0-56-generic 2023-10-03T18:56:53.312 DEBUG:teuthology.orchestra.run.smithi045:> sudo apt-get clean 2023-10-03T18:56:53.313 INFO:teuthology.orchestra.run.smithi172.stdout:5.15.0-56-generic 2023-10-03T18:56:53.314 INFO:teuthology.task.kernel:Running kernel on smithi172: 5.15.0-56-generic 2023-10-03T18:56:53.314 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-get clean 2023-10-03T18:56:53.315 INFO:teuthology.orchestra.run.smithi079.stdout:5.15.0-56-generic 2023-10-03T18:56:53.316 INFO:teuthology.task.kernel:Running kernel on smithi079: 5.15.0-56-generic 2023-10-03T18:56:53.316 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get clean 2023-10-03T18:56:53.435 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get update 2023-10-03T18:56:53.438 DEBUG:teuthology.orchestra.run.smithi045:> sudo apt-get update 2023-10-03T18:56:53.439 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-get update 2023-10-03T18:56:53.444 DEBUG:teuthology.orchestra.run.smithi146:> sudo apt-get update 2023-10-03T18:56:53.580 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-03T18:56:53.580 INFO:teuthology.orchestra.run.smithi146.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-10-03T18:56:53.581 INFO:teuthology.orchestra.run.smithi146.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-10-03T18:56:53.584 INFO:teuthology.orchestra.run.smithi045.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-10-03T18:56:53.650 INFO:teuthology.orchestra.run.smithi146.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2023-10-03T18:56:53.710 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-03T18:56:53.712 INFO:teuthology.orchestra.run.smithi079.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-10-03T18:56:53.715 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-03T18:56:53.717 INFO:teuthology.orchestra.run.smithi172.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-10-03T18:56:53.762 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-10-03T18:56:53.762 INFO:teuthology.orchestra.run.smithi172.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-10-03T18:56:53.795 INFO:teuthology.orchestra.run.smithi045.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [812 kB] 2023-10-03T18:56:53.809 INFO:teuthology.orchestra.run.smithi146.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [812 kB] 2023-10-03T18:56:53.875 INFO:teuthology.orchestra.run.smithi146.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,022 kB] 2023-10-03T18:56:53.879 INFO:teuthology.orchestra.run.smithi045.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [331 kB] 2023-10-03T18:56:53.885 INFO:teuthology.orchestra.run.smithi045.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [170 kB] 2023-10-03T18:56:53.890 INFO:teuthology.orchestra.run.smithi045.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.3 kB] 2023-10-03T18:56:53.890 INFO:teuthology.orchestra.run.smithi045.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [899 kB] 2023-10-03T18:56:53.891 INFO:teuthology.orchestra.run.smithi146.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [331 kB] 2023-10-03T18:56:53.896 INFO:teuthology.orchestra.run.smithi146.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [170 kB] 2023-10-03T18:56:53.899 INFO:teuthology.orchestra.run.smithi146.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.3 kB] 2023-10-03T18:56:53.906 INFO:teuthology.orchestra.run.smithi045.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [32.0 kB] 2023-10-03T18:56:53.907 INFO:teuthology.orchestra.run.smithi045.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [145 kB] 2023-10-03T18:56:53.911 INFO:teuthology.orchestra.run.smithi045.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [532 B] 2023-10-03T18:56:53.911 INFO:teuthology.orchestra.run.smithi045.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [785 kB] 2023-10-03T18:56:53.916 INFO:teuthology.orchestra.run.smithi146.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [899 kB] 2023-10-03T18:56:53.924 INFO:teuthology.orchestra.run.smithi045.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [559 kB] 2023-10-03T18:56:53.926 INFO:teuthology.orchestra.run.smithi146.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [32.0 kB] 2023-10-03T18:56:53.929 INFO:teuthology.orchestra.run.smithi146.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [145 kB] 2023-10-03T18:56:53.930 INFO:teuthology.orchestra.run.smithi146.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [532 B] 2023-10-03T18:56:53.930 INFO:teuthology.orchestra.run.smithi146.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [559 kB] 2023-10-03T18:56:53.932 INFO:teuthology.orchestra.run.smithi045.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [144 kB] 2023-10-03T18:56:53.934 INFO:teuthology.orchestra.run.smithi045.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.7 kB] 2023-10-03T18:56:53.935 INFO:teuthology.orchestra.run.smithi045.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,032 B] 2023-10-03T18:56:53.935 INFO:teuthology.orchestra.run.smithi045.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [36.5 kB] 2023-10-03T18:56:53.936 INFO:teuthology.orchestra.run.smithi146.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [785 kB] 2023-10-03T18:56:53.942 INFO:teuthology.orchestra.run.smithi045.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,060 B] 2023-10-03T18:56:53.944 INFO:teuthology.orchestra.run.smithi146.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [144 kB] 2023-10-03T18:56:53.945 INFO:teuthology.orchestra.run.smithi146.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.7 kB] 2023-10-03T18:56:53.946 INFO:teuthology.orchestra.run.smithi146.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [36.5 kB] 2023-10-03T18:56:53.947 INFO:teuthology.orchestra.run.smithi146.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [497 kB] 2023-10-03T18:56:53.952 INFO:teuthology.orchestra.run.smithi146.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [229 kB] 2023-10-03T18:56:53.952 INFO:teuthology.orchestra.run.smithi146.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,032 B] 2023-10-03T18:56:53.953 INFO:teuthology.orchestra.run.smithi146.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,060 B] 2023-10-03T18:56:53.953 INFO:teuthology.orchestra.run.smithi146.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2023-10-03T18:56:53.954 INFO:teuthology.orchestra.run.smithi146.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [15.6 kB] 2023-10-03T18:56:53.954 INFO:teuthology.orchestra.run.smithi146.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [915 kB] 2023-10-03T18:56:53.968 INFO:teuthology.orchestra.run.smithi146.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [32.3 kB] 2023-10-03T18:56:53.969 INFO:teuthology.orchestra.run.smithi146.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [147 kB] 2023-10-03T18:56:53.971 INFO:teuthology.orchestra.run.smithi045.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2023-10-03T18:56:53.971 INFO:teuthology.orchestra.run.smithi146.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [532 B] 2023-10-03T18:56:53.971 INFO:teuthology.orchestra.run.smithi146.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [987 kB] 2023-10-03T18:56:53.979 INFO:teuthology.orchestra.run.smithi146.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [657 kB] 2023-10-03T18:56:53.984 INFO:teuthology.orchestra.run.smithi146.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [216 kB] 2023-10-03T18:56:53.985 INFO:teuthology.orchestra.run.smithi146.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [21.9 kB] 2023-10-03T18:56:53.988 INFO:teuthology.orchestra.run.smithi146.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,888 B] 2023-10-03T18:56:53.988 INFO:teuthology.orchestra.run.smithi146.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [41.6 kB] 2023-10-03T18:56:53.988 INFO:teuthology.orchestra.run.smithi146.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [9,768 B] 2023-10-03T18:56:53.988 INFO:teuthology.orchestra.run.smithi146.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2023-10-03T18:56:54.002 INFO:teuthology.orchestra.run.smithi146.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2023-10-03T18:56:54.003 INFO:teuthology.orchestra.run.smithi146.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2023-10-03T18:56:54.003 INFO:teuthology.orchestra.run.smithi146.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2023-10-03T18:56:54.003 INFO:teuthology.orchestra.run.smithi146.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-10-03T18:56:54.004 INFO:teuthology.orchestra.run.smithi146.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2023-10-03T18:56:54.005 INFO:teuthology.orchestra.run.smithi146.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2023-10-03T18:56:54.021 INFO:teuthology.orchestra.run.smithi146.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.4 kB] 2023-10-03T18:56:54.021 INFO:teuthology.orchestra.run.smithi146.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [640 B] 2023-10-03T18:56:54.114 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2023-10-03T18:56:54.118 INFO:teuthology.orchestra.run.smithi172.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2023-10-03T18:56:54.121 INFO:teuthology.orchestra.run.smithi172.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [331 kB] 2023-10-03T18:56:54.124 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [331 kB] 2023-10-03T18:56:54.254 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,022 kB] 2023-10-03T18:56:54.255 INFO:teuthology.orchestra.run.smithi172.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,022 kB] 2023-10-03T18:56:54.388 INFO:teuthology.orchestra.run.smithi172.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [812 kB] 2023-10-03T18:56:54.389 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [812 kB] 2023-10-03T18:56:54.515 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [497 kB] 2023-10-03T18:56:54.517 INFO:teuthology.orchestra.run.smithi172.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [497 kB] 2023-10-03T18:56:54.529 INFO:teuthology.orchestra.run.smithi172.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [170 kB] 2023-10-03T18:56:54.532 INFO:teuthology.orchestra.run.smithi079.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [170 kB] 2023-10-03T18:56:54.550 INFO:teuthology.orchestra.run.smithi172.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.3 kB] 2023-10-03T18:56:54.552 INFO:teuthology.orchestra.run.smithi172.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [899 kB] 2023-10-03T18:56:54.553 INFO:teuthology.orchestra.run.smithi079.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.3 kB] 2023-10-03T18:56:54.554 INFO:teuthology.orchestra.run.smithi079.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [899 kB] 2023-10-03T18:56:54.556 INFO:teuthology.orchestra.run.smithi079.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [229 kB] 2023-10-03T18:56:54.559 INFO:teuthology.orchestra.run.smithi172.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [229 kB] 2023-10-03T18:56:54.571 INFO:teuthology.orchestra.run.smithi079.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [15.6 kB] 2023-10-03T18:56:54.572 INFO:teuthology.orchestra.run.smithi079.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [915 kB] 2023-10-03T18:56:54.574 INFO:teuthology.orchestra.run.smithi172.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [15.6 kB] 2023-10-03T18:56:54.587 INFO:teuthology.orchestra.run.smithi172.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [915 kB] 2023-10-03T18:56:54.614 INFO:teuthology.orchestra.run.smithi172.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [32.0 kB] 2023-10-03T18:56:54.616 INFO:teuthology.orchestra.run.smithi172.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [145 kB] 2023-10-03T18:56:54.625 INFO:teuthology.orchestra.run.smithi172.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [532 B] 2023-10-03T18:56:54.626 INFO:teuthology.orchestra.run.smithi172.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [559 kB] 2023-10-03T18:56:54.627 INFO:teuthology.orchestra.run.smithi172.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [32.3 kB] 2023-10-03T18:56:54.628 INFO:teuthology.orchestra.run.smithi172.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [147 kB] 2023-10-03T18:56:54.634 INFO:teuthology.orchestra.run.smithi172.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [532 B] 2023-10-03T18:56:54.635 INFO:teuthology.orchestra.run.smithi079.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [32.0 kB] 2023-10-03T18:56:54.635 INFO:teuthology.orchestra.run.smithi079.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [32.3 kB] 2023-10-03T18:56:54.635 INFO:teuthology.orchestra.run.smithi079.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [145 kB] 2023-10-03T18:56:54.636 INFO:teuthology.orchestra.run.smithi079.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [147 kB] 2023-10-03T18:56:54.638 INFO:teuthology.orchestra.run.smithi079.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [532 B] 2023-10-03T18:56:54.639 INFO:teuthology.orchestra.run.smithi079.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [532 B] 2023-10-03T18:56:54.639 INFO:teuthology.orchestra.run.smithi079.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [559 kB] 2023-10-03T18:56:54.653 INFO:teuthology.orchestra.run.smithi172.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [785 kB] 2023-10-03T18:56:54.655 INFO:teuthology.orchestra.run.smithi079.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [785 kB] 2023-10-03T18:56:54.799 INFO:teuthology.orchestra.run.smithi172.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [657 kB] 2023-10-03T18:56:54.802 INFO:teuthology.orchestra.run.smithi079.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [987 kB] 2023-10-03T18:56:54.844 INFO:teuthology.orchestra.run.smithi172.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [144 kB] 2023-10-03T18:56:54.847 INFO:teuthology.orchestra.run.smithi079.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [144 kB] 2023-10-03T18:56:55.226 INFO:teuthology.orchestra.run.smithi172.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.7 kB] 2023-10-03T18:56:55.226 INFO:teuthology.orchestra.run.smithi079.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.7 kB] 2023-10-03T18:56:55.233 INFO:teuthology.orchestra.run.smithi172.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [36.5 kB] 2023-10-03T18:56:55.234 INFO:teuthology.orchestra.run.smithi079.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [36.5 kB] 2023-10-03T18:56:55.249 INFO:teuthology.orchestra.run.smithi172.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,032 B] 2023-10-03T18:56:55.249 INFO:teuthology.orchestra.run.smithi172.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,060 B] 2023-10-03T18:56:55.249 INFO:teuthology.orchestra.run.smithi079.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,032 B] 2023-10-03T18:56:55.250 INFO:teuthology.orchestra.run.smithi079.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,060 B] 2023-10-03T18:56:55.252 INFO:teuthology.orchestra.run.smithi172.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2023-10-03T18:56:55.253 INFO:teuthology.orchestra.run.smithi079.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2023-10-03T18:56:55.369 INFO:teuthology.orchestra.run.smithi172.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [987 kB] 2023-10-03T18:56:55.421 INFO:teuthology.orchestra.run.smithi079.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [657 kB] 2023-10-03T18:56:55.460 INFO:teuthology.orchestra.run.smithi079.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [216 kB] 2023-10-03T18:56:55.472 INFO:teuthology.orchestra.run.smithi079.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [21.9 kB] 2023-10-03T18:56:55.473 INFO:teuthology.orchestra.run.smithi079.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [41.6 kB] 2023-10-03T18:56:55.475 INFO:teuthology.orchestra.run.smithi079.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,888 B] 2023-10-03T18:56:55.476 INFO:teuthology.orchestra.run.smithi079.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [9,768 B] 2023-10-03T18:56:55.477 INFO:teuthology.orchestra.run.smithi079.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2023-10-03T18:56:55.478 INFO:teuthology.orchestra.run.smithi079.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2023-10-03T18:56:55.479 INFO:teuthology.orchestra.run.smithi172.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [216 kB] 2023-10-03T18:56:55.498 INFO:teuthology.orchestra.run.smithi172.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [21.9 kB] 2023-10-03T18:56:55.500 INFO:teuthology.orchestra.run.smithi172.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,888 B] 2023-10-03T18:56:55.501 INFO:teuthology.orchestra.run.smithi172.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [41.6 kB] 2023-10-03T18:56:55.503 INFO:teuthology.orchestra.run.smithi079.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2023-10-03T18:56:55.504 INFO:teuthology.orchestra.run.smithi172.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [9,768 B] 2023-10-03T18:56:55.504 INFO:teuthology.orchestra.run.smithi079.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2023-10-03T18:56:55.505 INFO:teuthology.orchestra.run.smithi172.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2023-10-03T18:56:55.505 INFO:teuthology.orchestra.run.smithi172.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2023-10-03T18:56:55.508 INFO:teuthology.orchestra.run.smithi172.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2023-10-03T18:56:55.511 INFO:teuthology.orchestra.run.smithi172.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2023-10-03T18:56:55.669 INFO:teuthology.orchestra.run.smithi079.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-10-03T18:56:55.675 INFO:teuthology.orchestra.run.smithi172.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-10-03T18:56:55.751 INFO:teuthology.orchestra.run.smithi079.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2023-10-03T18:56:55.757 INFO:teuthology.orchestra.run.smithi172.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2023-10-03T18:56:55.847 INFO:teuthology.orchestra.run.smithi079.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2023-10-03T18:56:55.853 INFO:teuthology.orchestra.run.smithi172.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2023-10-03T18:56:55.875 INFO:teuthology.orchestra.run.smithi079.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.4 kB] 2023-10-03T18:56:55.882 INFO:teuthology.orchestra.run.smithi172.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.4 kB] 2023-10-03T18:56:55.926 INFO:teuthology.orchestra.run.smithi079.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [640 B] 2023-10-03T18:56:55.933 INFO:teuthology.orchestra.run.smithi172.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [640 B] 2023-10-03T18:56:59.144 INFO:teuthology.orchestra.run.smithi146.stdout:Fetched 9,225 kB in 1s (6,796 kB/s) 2023-10-03T18:57:00.116 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:18 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-03T18:57:00.136 INFO:teuthology.orchestra.run.smithi045.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-10-03T18:57:00.221 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 9,225 kB in 2s (3,797 kB/s) 2023-10-03T18:57:00.222 INFO:teuthology.orchestra.run.smithi045.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2023-10-03T18:57:00.309 INFO:teuthology.orchestra.run.smithi045.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,022 kB] 2023-10-03T18:57:00.399 INFO:teuthology.orchestra.run.smithi045.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [497 kB] 2023-10-03T18:57:00.406 INFO:teuthology.orchestra.run.smithi045.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [229 kB] 2023-10-03T18:57:00.407 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-10-03T18:57:00.409 INFO:teuthology.orchestra.run.smithi045.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [15.6 kB] 2023-10-03T18:57:00.409 INFO:teuthology.orchestra.run.smithi045.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [32.3 kB] 2023-10-03T18:57:00.410 INFO:teuthology.orchestra.run.smithi045.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [915 kB] 2023-10-03T18:57:00.424 DEBUG:teuthology.orchestra.run.smithi146:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-03T18:57:00.427 INFO:teuthology.orchestra.run.smithi045.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [147 kB] 2023-10-03T18:57:00.428 INFO:teuthology.orchestra.run.smithi045.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [532 B] 2023-10-03T18:57:00.429 INFO:teuthology.orchestra.run.smithi045.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [657 kB] 2023-10-03T18:57:00.437 INFO:teuthology.orchestra.run.smithi045.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [987 kB] 2023-10-03T18:57:00.447 INFO:teuthology.orchestra.run.smithi045.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [216 kB] 2023-10-03T18:57:00.448 INFO:teuthology.orchestra.run.smithi045.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [21.9 kB] 2023-10-03T18:57:00.449 INFO:teuthology.orchestra.run.smithi045.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,888 B] 2023-10-03T18:57:00.449 INFO:teuthology.orchestra.run.smithi045.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [41.6 kB] 2023-10-03T18:57:00.449 INFO:teuthology.orchestra.run.smithi045.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [9,768 B] 2023-10-03T18:57:00.450 INFO:teuthology.orchestra.run.smithi045.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2023-10-03T18:57:00.468 INFO:teuthology.orchestra.run.smithi045.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2023-10-03T18:57:00.468 INFO:teuthology.orchestra.run.smithi045.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2023-10-03T18:57:00.469 INFO:teuthology.orchestra.run.smithi045.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2023-10-03T18:57:00.483 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-10-03T18:57:00.484 INFO:teuthology.orchestra.run.smithi172.stdout:Fetched 9,225 kB in 2s (3,785 kB/s) 2023-10-03T18:57:00.487 INFO:teuthology.orchestra.run.smithi045.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-10-03T18:57:00.488 INFO:teuthology.orchestra.run.smithi045.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2023-10-03T18:57:00.488 INFO:teuthology.orchestra.run.smithi045.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2023-10-03T18:57:00.488 INFO:teuthology.orchestra.run.smithi045.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.4 kB] 2023-10-03T18:57:00.489 INFO:teuthology.orchestra.run.smithi045.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [640 B] 2023-10-03T18:57:00.665 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-10-03T18:57:00.666 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-10-03T18:57:00.817 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2023-10-03T18:57:00.818 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-03T18:57:00.818 INFO:teuthology.orchestra.run.smithi146.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-03T18:57:00.818 INFO:teuthology.orchestra.run.smithi146.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-03T18:57:00.819 INFO:teuthology.orchestra.run.smithi146.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-10-03T18:57:00.819 INFO:teuthology.orchestra.run.smithi146.stdout: python2.7-minimal 2023-10-03T18:57:00.819 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-03T18:57:00.819 INFO:teuthology.orchestra.run.smithi146.stdout:The following additional packages will be installed: 2023-10-03T18:57:00.819 INFO:teuthology.orchestra.run.smithi146.stdout: linux-generic linux-headers-5.15.0-84 linux-headers-5.15.0-84-generic 2023-10-03T18:57:00.819 INFO:teuthology.orchestra.run.smithi146.stdout: linux-headers-generic linux-image-5.15.0-84-generic 2023-10-03T18:57:00.820 INFO:teuthology.orchestra.run.smithi146.stdout: linux-modules-5.15.0-84-generic linux-modules-extra-5.15.0-84-generic 2023-10-03T18:57:00.821 INFO:teuthology.orchestra.run.smithi146.stdout:Suggested packages: 2023-10-03T18:57:00.821 INFO:teuthology.orchestra.run.smithi146.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-10-03T18:57:00.821 INFO:teuthology.orchestra.run.smithi146.stdout:Recommended packages: 2023-10-03T18:57:00.821 INFO:teuthology.orchestra.run.smithi146.stdout: thermald 2023-10-03T18:57:00.872 INFO:teuthology.orchestra.run.smithi146.stdout:The following NEW packages will be installed: 2023-10-03T18:57:00.872 INFO:teuthology.orchestra.run.smithi146.stdout: linux-headers-5.15.0-84 linux-headers-5.15.0-84-generic 2023-10-03T18:57:00.872 INFO:teuthology.orchestra.run.smithi146.stdout: linux-image-5.15.0-84-generic linux-modules-5.15.0-84-generic 2023-10-03T18:57:00.872 INFO:teuthology.orchestra.run.smithi146.stdout: linux-modules-extra-5.15.0-84-generic 2023-10-03T18:57:00.873 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages will be upgraded: 2023-10-03T18:57:00.873 INFO:teuthology.orchestra.run.smithi146.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-03T18:57:01.052 INFO:teuthology.orchestra.run.smithi146.stdout:3 upgraded, 5 newly installed, 0 to remove and 266 not upgraded. 2023-10-03T18:57:01.052 INFO:teuthology.orchestra.run.smithi146.stdout:Need to get 113 MB of archives. 2023-10-03T18:57:01.052 INFO:teuthology.orchestra.run.smithi146.stdout:After this operation, 582 MB of additional disk space will be used. 2023-10-03T18:57:01.052 INFO:teuthology.orchestra.run.smithi146.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-84-generic amd64 5.15.0-84.93 [22.5 MB] 2023-10-03T18:57:01.517 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2023-10-03T18:57:01.533 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-03T18:57:01.584 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2023-10-03T18:57:01.668 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2023-10-03T18:57:01.685 DEBUG:teuthology.orchestra.run.smithi172:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-03T18:57:01.737 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2023-10-03T18:57:01.745 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2023-10-03T18:57:01.745 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2023-10-03T18:57:01.885 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages were automatically installed and are no longer required: 2023-10-03T18:57:01.885 INFO:teuthology.orchestra.run.smithi079.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-03T18:57:01.885 INFO:teuthology.orchestra.run.smithi079.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-03T18:57:01.886 INFO:teuthology.orchestra.run.smithi079.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-03T18:57:01.886 INFO:teuthology.orchestra.run.smithi079.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-10-03T18:57:01.886 INFO:teuthology.orchestra.run.smithi079.stdout: python2.7-minimal 2023-10-03T18:57:01.886 INFO:teuthology.orchestra.run.smithi079.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-03T18:57:01.886 INFO:teuthology.orchestra.run.smithi079.stdout:The following additional packages will be installed: 2023-10-03T18:57:01.887 INFO:teuthology.orchestra.run.smithi079.stdout: linux-generic linux-headers-5.15.0-84 linux-headers-5.15.0-84-generic 2023-10-03T18:57:01.887 INFO:teuthology.orchestra.run.smithi079.stdout: linux-headers-generic linux-image-5.15.0-84-generic 2023-10-03T18:57:01.887 INFO:teuthology.orchestra.run.smithi079.stdout: linux-modules-5.15.0-84-generic linux-modules-extra-5.15.0-84-generic 2023-10-03T18:57:01.888 INFO:teuthology.orchestra.run.smithi079.stdout:Suggested packages: 2023-10-03T18:57:01.888 INFO:teuthology.orchestra.run.smithi079.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-10-03T18:57:01.888 INFO:teuthology.orchestra.run.smithi079.stdout:Recommended packages: 2023-10-03T18:57:01.888 INFO:teuthology.orchestra.run.smithi079.stdout: thermald 2023-10-03T18:57:01.900 INFO:teuthology.orchestra.run.smithi172.stdout:Building dependency tree... 2023-10-03T18:57:01.900 INFO:teuthology.orchestra.run.smithi172.stdout:Reading state information... 2023-10-03T18:57:01.941 INFO:teuthology.orchestra.run.smithi079.stdout:The following NEW packages will be installed: 2023-10-03T18:57:01.941 INFO:teuthology.orchestra.run.smithi079.stdout: linux-headers-5.15.0-84 linux-headers-5.15.0-84-generic 2023-10-03T18:57:01.942 INFO:teuthology.orchestra.run.smithi079.stdout: linux-image-5.15.0-84-generic linux-modules-5.15.0-84-generic 2023-10-03T18:57:01.942 INFO:teuthology.orchestra.run.smithi079.stdout: linux-modules-extra-5.15.0-84-generic 2023-10-03T18:57:01.942 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages will be upgraded: 2023-10-03T18:57:01.943 INFO:teuthology.orchestra.run.smithi079.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-03T18:57:01.998 INFO:teuthology.orchestra.run.smithi079.stdout:3 upgraded, 5 newly installed, 0 to remove and 266 not upgraded. 2023-10-03T18:57:01.998 INFO:teuthology.orchestra.run.smithi079.stdout:Need to get 113 MB of archives. 2023-10-03T18:57:01.998 INFO:teuthology.orchestra.run.smithi079.stdout:After this operation, 582 MB of additional disk space will be used. 2023-10-03T18:57:01.998 INFO:teuthology.orchestra.run.smithi079.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-84-generic amd64 5.15.0-84.93 [22.5 MB] 2023-10-03T18:57:02.039 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages were automatically installed and are no longer required: 2023-10-03T18:57:02.039 INFO:teuthology.orchestra.run.smithi172.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-03T18:57:02.039 INFO:teuthology.orchestra.run.smithi172.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-03T18:57:02.039 INFO:teuthology.orchestra.run.smithi172.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-03T18:57:02.040 INFO:teuthology.orchestra.run.smithi172.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-10-03T18:57:02.040 INFO:teuthology.orchestra.run.smithi172.stdout: python2.7-minimal 2023-10-03T18:57:02.040 INFO:teuthology.orchestra.run.smithi172.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-03T18:57:02.040 INFO:teuthology.orchestra.run.smithi172.stdout:The following additional packages will be installed: 2023-10-03T18:57:02.040 INFO:teuthology.orchestra.run.smithi172.stdout: linux-generic linux-headers-5.15.0-84 linux-headers-5.15.0-84-generic 2023-10-03T18:57:02.040 INFO:teuthology.orchestra.run.smithi172.stdout: linux-headers-generic linux-image-5.15.0-84-generic 2023-10-03T18:57:02.041 INFO:teuthology.orchestra.run.smithi172.stdout: linux-modules-5.15.0-84-generic linux-modules-extra-5.15.0-84-generic 2023-10-03T18:57:02.041 INFO:teuthology.orchestra.run.smithi172.stdout:Suggested packages: 2023-10-03T18:57:02.042 INFO:teuthology.orchestra.run.smithi172.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-10-03T18:57:02.042 INFO:teuthology.orchestra.run.smithi172.stdout:Recommended packages: 2023-10-03T18:57:02.042 INFO:teuthology.orchestra.run.smithi172.stdout: thermald 2023-10-03T18:57:02.089 INFO:teuthology.orchestra.run.smithi172.stdout:The following NEW packages will be installed: 2023-10-03T18:57:02.089 INFO:teuthology.orchestra.run.smithi172.stdout: linux-headers-5.15.0-84 linux-headers-5.15.0-84-generic 2023-10-03T18:57:02.089 INFO:teuthology.orchestra.run.smithi172.stdout: linux-image-5.15.0-84-generic linux-modules-5.15.0-84-generic 2023-10-03T18:57:02.089 INFO:teuthology.orchestra.run.smithi172.stdout: linux-modules-extra-5.15.0-84-generic 2023-10-03T18:57:02.090 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages will be upgraded: 2023-10-03T18:57:02.090 INFO:teuthology.orchestra.run.smithi172.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-03T18:57:02.144 INFO:teuthology.orchestra.run.smithi172.stdout:3 upgraded, 5 newly installed, 0 to remove and 266 not upgraded. 2023-10-03T18:57:02.144 INFO:teuthology.orchestra.run.smithi172.stdout:Need to get 113 MB of archives. 2023-10-03T18:57:02.144 INFO:teuthology.orchestra.run.smithi172.stdout:After this operation, 582 MB of additional disk space will be used. 2023-10-03T18:57:02.144 INFO:teuthology.orchestra.run.smithi172.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-84-generic amd64 5.15.0-84.93 [22.5 MB] 2023-10-03T18:57:02.440 INFO:teuthology.orchestra.run.smithi146.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-84-generic amd64 5.15.0-84.93 [11.5 MB] 2023-10-03T18:57:02.698 INFO:teuthology.orchestra.run.smithi079.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-84-generic amd64 5.15.0-84.93 [11.5 MB] 2023-10-03T18:57:02.706 INFO:teuthology.orchestra.run.smithi172.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-84-generic amd64 5.15.0-84.93 [11.5 MB] 2023-10-03T18:57:02.786 INFO:teuthology.orchestra.run.smithi146.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-84-generic amd64 5.15.0-84.93 [63.9 MB] 2023-10-03T18:57:02.873 INFO:teuthology.orchestra.run.smithi172.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-84-generic amd64 5.15.0-84.93 [63.9 MB] 2023-10-03T18:57:03.056 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-84-generic amd64 5.15.0-84.93 [63.9 MB] 2023-10-03T18:57:04.959 INFO:teuthology.orchestra.run.smithi146.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.84.81 [1,698 B] 2023-10-03T18:57:04.959 INFO:teuthology.orchestra.run.smithi146.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.84.81 [2,476 B] 2023-10-03T18:57:04.959 INFO:teuthology.orchestra.run.smithi146.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-84 all 5.15.0-84.93 [12.3 MB] 2023-10-03T18:57:04.999 INFO:teuthology.orchestra.run.smithi172.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.84.81 [1,698 B] 2023-10-03T18:57:05.000 INFO:teuthology.orchestra.run.smithi172.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.84.81 [2,476 B] 2023-10-03T18:57:05.000 INFO:teuthology.orchestra.run.smithi172.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-84 all 5.15.0-84.93 [12.3 MB] 2023-10-03T18:57:05.234 INFO:teuthology.orchestra.run.smithi172.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-84-generic amd64 5.15.0-84.93 [2,853 kB] 2023-10-03T18:57:05.272 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.84.81 [1,698 B] 2023-10-03T18:57:05.291 INFO:teuthology.orchestra.run.smithi172.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.84.81 [2,330 B] 2023-10-03T18:57:05.384 INFO:teuthology.orchestra.run.smithi045.stdout:Fetched 9,225 kB in 7s (1,240 kB/s) 2023-10-03T18:57:05.463 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.84.81 [2,476 B] 2023-10-03T18:57:05.463 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-84 all 5.15.0-84.93 [12.3 MB] 2023-10-03T18:57:05.663 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-84-generic amd64 5.15.0-84.93 [2,853 kB] 2023-10-03T18:57:05.671 INFO:teuthology.orchestra.run.smithi146.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-84-generic amd64 5.15.0-84.93 [2,853 kB] 2023-10-03T18:57:05.676 INFO:teuthology.orchestra.run.smithi172.stdout:Fetched 113 MB in 3s (35.4 MB/s) 2023-10-03T18:57:05.689 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.84.81 [2,330 B] 2023-10-03T18:57:05.794 INFO:teuthology.orchestra.run.smithi146.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.84.81 [2,330 B] 2023-10-03T18:57:05.843 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package linux-modules-5.15.0-84-generic. 2023-10-03T18:57:06.163 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 113 MB in 4s (29.7 MB/s) 2023-10-03T18:57:06.193 INFO:teuthology.orchestra.run.smithi146.stdout:Fetched 113 MB in 5s (23.0 MB/s) 2023-10-03T18:57:06.363 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package linux-modules-5.15.0-84-generic. 2023-10-03T18:57:06.377 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-modules-5.15.0-84-generic. 2023-10-03T18:57:06.636 INFO:teuthology.orchestra.run.smithi045.stdout:Reading package lists... 2023-10-03T18:57:06.653 DEBUG:teuthology.orchestra.run.smithi045:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-03T18:57:06.717 INFO:teuthology.orchestra.run.smithi045.stdout:Reading package lists... 2023-10-03T18:57:06.888 INFO:teuthology.orchestra.run.smithi045.stdout:Building dependency tree... 2023-10-03T18:57:06.888 INFO:teuthology.orchestra.run.smithi045.stdout:Reading state information... 2023-10-03T18:57:07.032 INFO:teuthology.orchestra.run.smithi045.stdout:The following packages were automatically installed and are no longer required: 2023-10-03T18:57:07.032 INFO:teuthology.orchestra.run.smithi045.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-03T18:57:07.032 INFO:teuthology.orchestra.run.smithi045.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-03T18:57:07.033 INFO:teuthology.orchestra.run.smithi045.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-03T18:57:07.033 INFO:teuthology.orchestra.run.smithi045.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-10-03T18:57:07.033 INFO:teuthology.orchestra.run.smithi045.stdout: python2.7-minimal 2023-10-03T18:57:07.033 INFO:teuthology.orchestra.run.smithi045.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-03T18:57:07.034 INFO:teuthology.orchestra.run.smithi045.stdout:The following additional packages will be installed: 2023-10-03T18:57:07.034 INFO:teuthology.orchestra.run.smithi045.stdout: linux-generic linux-headers-5.15.0-84 linux-headers-5.15.0-84-generic 2023-10-03T18:57:07.034 INFO:teuthology.orchestra.run.smithi045.stdout: linux-headers-generic linux-image-5.15.0-84-generic 2023-10-03T18:57:07.034 INFO:teuthology.orchestra.run.smithi045.stdout: linux-modules-5.15.0-84-generic linux-modules-extra-5.15.0-84-generic 2023-10-03T18:57:07.035 INFO:teuthology.orchestra.run.smithi045.stdout:Suggested packages: 2023-10-03T18:57:07.035 INFO:teuthology.orchestra.run.smithi045.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-10-03T18:57:07.035 INFO:teuthology.orchestra.run.smithi045.stdout:Recommended packages: 2023-10-03T18:57:07.035 INFO:teuthology.orchestra.run.smithi045.stdout: thermald 2023-10-03T18:57:07.090 INFO:teuthology.orchestra.run.smithi045.stdout:The following NEW packages will be installed: 2023-10-03T18:57:07.090 INFO:teuthology.orchestra.run.smithi045.stdout: linux-headers-5.15.0-84 linux-headers-5.15.0-84-generic 2023-10-03T18:57:07.090 INFO:teuthology.orchestra.run.smithi045.stdout: linux-image-5.15.0-84-generic linux-modules-5.15.0-84-generic 2023-10-03T18:57:07.090 INFO:teuthology.orchestra.run.smithi045.stdout: linux-modules-extra-5.15.0-84-generic 2023-10-03T18:57:07.091 INFO:teuthology.orchestra.run.smithi045.stdout:The following packages will be upgraded: 2023-10-03T18:57:07.091 INFO:teuthology.orchestra.run.smithi045.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-03T18:57:07.158 INFO:teuthology.orchestra.run.smithi045.stdout:3 upgraded, 5 newly installed, 0 to remove and 266 not upgraded. 2023-10-03T18:57:07.158 INFO:teuthology.orchestra.run.smithi045.stdout:Need to get 113 MB of archives. 2023-10-03T18:57:07.159 INFO:teuthology.orchestra.run.smithi045.stdout:After this operation, 582 MB of additional disk space will be used. 2023-10-03T18:57:07.159 INFO:teuthology.orchestra.run.smithi045.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-84-generic amd64 5.15.0-84.93 [22.5 MB] 2023-10-03T18:57:07.573 INFO:teuthology.orchestra.run.smithi045.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-84-generic amd64 5.15.0-84.93 [11.5 MB] 2023-10-03T18:57:07.671 INFO:teuthology.orchestra.run.smithi045.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-84-generic amd64 5.15.0-84.93 [63.9 MB] 2023-10-03T18:57:07.839 INFO:teuthology.orchestra.run.smithi172.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-10-03T18:57:07.843 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../0-linux-modules-5.15.0-84-generic_5.15.0-84.93_amd64.deb ... 2023-10-03T18:57:07.932 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-modules-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:08.405 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-10-03T18:57:08.410 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../0-linux-modules-5.15.0-84-generic_5.15.0-84.93_amd64.deb ... 2023-10-03T18:57:08.521 INFO:teuthology.orchestra.run.smithi045.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.84.81 [1,698 B] 2023-10-03T18:57:08.522 INFO:teuthology.orchestra.run.smithi045.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.84.81 [2,476 B] 2023-10-03T18:57:08.522 INFO:teuthology.orchestra.run.smithi045.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-84 all 5.15.0-84.93 [12.3 MB] 2023-10-03T18:57:08.535 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-modules-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:08.574 INFO:teuthology.orchestra.run.smithi079.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-10-03T18:57:08.578 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../0-linux-modules-5.15.0-84-generic_5.15.0-84.93_amd64.deb ... 2023-10-03T18:57:08.652 INFO:teuthology.orchestra.run.smithi045.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-84-generic amd64 5.15.0-84.93 [2,853 kB] 2023-10-03T18:57:08.675 INFO:teuthology.orchestra.run.smithi045.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.84.81 [2,330 B] 2023-10-03T18:57:08.923 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-modules-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:09.085 INFO:teuthology.orchestra.run.smithi045.stdout:Fetched 113 MB in 2s (71.7 MB/s) 2023-10-03T18:57:09.246 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package linux-modules-5.15.0-84-generic. 2023-10-03T18:57:10.049 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package linux-image-5.15.0-84-generic. 2023-10-03T18:57:10.071 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../1-linux-image-5.15.0-84-generic_5.15.0-84.93_amd64.deb ... 2023-10-03T18:57:10.156 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-image-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:10.619 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-84-generic. 2023-10-03T18:57:10.639 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-84-generic_5.15.0-84.93_amd64.deb ... 2023-10-03T18:57:10.677 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-modules-extra-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:10.787 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package linux-image-5.15.0-84-generic. 2023-10-03T18:57:10.808 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../1-linux-image-5.15.0-84-generic_5.15.0-84.93_amd64.deb ... 2023-10-03T18:57:10.910 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-image-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:11.083 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-image-5.15.0-84-generic. 2023-10-03T18:57:11.105 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../1-linux-image-5.15.0-84-generic_5.15.0-84.93_amd64.deb ... 2023-10-03T18:57:11.181 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-image-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:11.205 INFO:teuthology.orchestra.run.smithi045.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-10-03T18:57:11.209 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../0-linux-modules-5.15.0-84-generic_5.15.0-84.93_amd64.deb ... 2023-10-03T18:57:11.394 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-84-generic. 2023-10-03T18:57:11.414 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-84-generic_5.15.0-84.93_amd64.deb ... 2023-10-03T18:57:11.436 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking linux-modules-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:11.457 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-modules-extra-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:11.628 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-84-generic. 2023-10-03T18:57:11.648 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-84-generic_5.15.0-84.93_amd64.deb ... 2023-10-03T18:57:11.686 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-modules-extra-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:13.513 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package linux-image-5.15.0-84-generic. 2023-10-03T18:57:13.535 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../1-linux-image-5.15.0-84-generic_5.15.0-84.93_amd64.deb ... 2023-10-03T18:57:13.616 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking linux-image-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:14.075 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-84-generic. 2023-10-03T18:57:14.096 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-84-generic_5.15.0-84.93_amd64.deb ... 2023-10-03T18:57:14.133 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking linux-modules-extra-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:17.134 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../3-linux-generic_5.15.0.84.81_amd64.deb ... 2023-10-03T18:57:17.259 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-generic (5.15.0.84.81) over (5.15.0.56.54) ... 2023-10-03T18:57:17.578 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../3-linux-generic_5.15.0.84.81_amd64.deb ... 2023-10-03T18:57:17.591 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.84.81_amd64.deb ... 2023-10-03T18:57:17.698 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-generic (5.15.0.84.81) over (5.15.0.56.54) ... 2023-10-03T18:57:17.704 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-image-generic (5.15.0.84.81) over (5.15.0.56.54) ... 2023-10-03T18:57:17.993 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package linux-headers-5.15.0-84. 2023-10-03T18:57:18.015 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../5-linux-headers-5.15.0-84_5.15.0-84.93_all.deb ... 2023-10-03T18:57:18.038 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.84.81_amd64.deb ... 2023-10-03T18:57:18.059 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-headers-5.15.0-84 (5.15.0-84.93) ... 2023-10-03T18:57:18.159 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-image-generic (5.15.0.84.81) over (5.15.0.56.54) ... 2023-10-03T18:57:18.454 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package linux-headers-5.15.0-84. 2023-10-03T18:57:18.465 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../5-linux-headers-5.15.0-84_5.15.0-84.93_all.deb ... 2023-10-03T18:57:18.504 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-headers-5.15.0-84 (5.15.0-84.93) ... 2023-10-03T18:57:18.754 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../3-linux-generic_5.15.0.84.81_amd64.deb ... 2023-10-03T18:57:18.904 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-generic (5.15.0.84.81) over (5.15.0.56.54) ... 2023-10-03T18:57:19.270 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.84.81_amd64.deb ... 2023-10-03T18:57:19.399 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-image-generic (5.15.0.84.81) over (5.15.0.56.54) ... 2023-10-03T18:57:19.711 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-headers-5.15.0-84. 2023-10-03T18:57:19.733 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../5-linux-headers-5.15.0-84_5.15.0-84.93_all.deb ... 2023-10-03T18:57:19.777 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-headers-5.15.0-84 (5.15.0-84.93) ... 2023-10-03T18:57:21.106 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../3-linux-generic_5.15.0.84.81_amd64.deb ... 2023-10-03T18:57:21.222 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking linux-generic (5.15.0.84.81) over (5.15.0.56.54) ... 2023-10-03T18:57:21.547 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.84.81_amd64.deb ... 2023-10-03T18:57:21.659 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking linux-image-generic (5.15.0.84.81) over (5.15.0.56.54) ... 2023-10-03T18:57:21.971 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package linux-headers-5.15.0-84. 2023-10-03T18:57:21.993 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../5-linux-headers-5.15.0-84_5.15.0-84.93_all.deb ... 2023-10-03T18:57:22.037 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking linux-headers-5.15.0-84 (5.15.0-84.93) ... 2023-10-03T18:57:23.459 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package linux-headers-5.15.0-84-generic. 2023-10-03T18:57:23.497 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../6-linux-headers-5.15.0-84-generic_5.15.0-84.93_amd64.deb ... 2023-10-03T18:57:23.534 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-headers-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:24.281 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package linux-headers-5.15.0-84-generic. 2023-10-03T18:57:24.318 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../6-linux-headers-5.15.0-84-generic_5.15.0-84.93_amd64.deb ... 2023-10-03T18:57:24.356 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-headers-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:25.630 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-headers-5.15.0-84-generic. 2023-10-03T18:57:25.664 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../6-linux-headers-5.15.0-84-generic_5.15.0-84.93_amd64.deb ... 2023-10-03T18:57:25.702 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-headers-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:26.601 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.84.81_amd64.deb ... 2023-10-03T18:57:26.726 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-headers-generic (5.15.0.84.81) over (5.15.0.56.54) ... 2023-10-03T18:57:27.019 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.84.81_amd64.deb ... 2023-10-03T18:57:27.042 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-headers-5.15.0-84 (5.15.0-84.93) ... 2023-10-03T18:57:27.141 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-headers-generic (5.15.0.84.81) over (5.15.0.56.54) ... 2023-10-03T18:57:27.165 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-headers-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:27.291 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-headers-generic (5.15.0.84.81) ... 2023-10-03T18:57:27.301 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package linux-headers-5.15.0-84-generic. 2023-10-03T18:57:27.337 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../6-linux-headers-5.15.0-84-generic_5.15.0-84.93_amd64.deb ... 2023-10-03T18:57:27.419 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-image-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:27.474 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-headers-5.15.0-84 (5.15.0-84.93) ... 2023-10-03T18:57:27.595 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-headers-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:27.721 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-headers-generic (5.15.0.84.81) ... 2023-10-03T18:57:27.802 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking linux-headers-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:27.866 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-image-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:28.432 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.84.81_amd64.deb ... 2023-10-03T18:57:28.580 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-headers-generic (5.15.0.84.81) over (5.15.0.56.54) ... 2023-10-03T18:57:28.744 INFO:teuthology.orchestra.run.smithi172.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-10-03T18:57:28.744 INFO:teuthology.orchestra.run.smithi172.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-10-03T18:57:28.745 INFO:teuthology.orchestra.run.smithi172.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-84-generic 2023-10-03T18:57:28.745 INFO:teuthology.orchestra.run.smithi172.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-84-generic 2023-10-03T18:57:28.904 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-modules-extra-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:28.921 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-headers-5.15.0-84 (5.15.0-84.93) ... 2023-10-03T18:57:29.285 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-headers-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:29.327 INFO:teuthology.orchestra.run.smithi146.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-10-03T18:57:29.327 INFO:teuthology.orchestra.run.smithi146.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-10-03T18:57:29.327 INFO:teuthology.orchestra.run.smithi146.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-84-generic 2023-10-03T18:57:29.327 INFO:teuthology.orchestra.run.smithi146.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-84-generic 2023-10-03T18:57:29.651 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-modules-extra-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:29.703 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-headers-generic (5.15.0.84.81) ... 2023-10-03T18:57:29.865 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-image-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:30.306 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-modules-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:30.814 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.84.81_amd64.deb ... 2023-10-03T18:57:30.939 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking linux-headers-generic (5.15.0.84.81) over (5.15.0.56.54) ... 2023-10-03T18:57:31.086 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-modules-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:31.197 INFO:teuthology.orchestra.run.smithi079.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-10-03T18:57:31.197 INFO:teuthology.orchestra.run.smithi079.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-10-03T18:57:31.197 INFO:teuthology.orchestra.run.smithi079.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-84-generic 2023-10-03T18:57:31.197 INFO:teuthology.orchestra.run.smithi079.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-84-generic 2023-10-03T18:57:31.264 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up linux-headers-5.15.0-84 (5.15.0-84.93) ... 2023-10-03T18:57:31.383 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-modules-extra-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:31.394 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up linux-headers-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:31.520 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up linux-headers-generic (5.15.0.84.81) ... 2023-10-03T18:57:31.640 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up linux-image-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:31.715 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-image-generic (5.15.0.84.81) ... 2023-10-03T18:57:31.849 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-generic (5.15.0.84.81) ... 2023-10-03T18:57:31.984 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for linux-image-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:32.040 INFO:teuthology.orchestra.run.smithi172.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-03T18:57:32.040 INFO:teuthology.orchestra.run.smithi172.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-84-generic 2023-10-03T18:57:32.454 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-image-generic (5.15.0.84.81) ... 2023-10-03T18:57:32.580 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-generic (5.15.0.84.81) ... 2023-10-03T18:57:32.706 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for linux-image-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:32.759 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-modules-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:32.776 INFO:teuthology.orchestra.run.smithi146.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-03T18:57:32.776 INFO:teuthology.orchestra.run.smithi146.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-84-generic 2023-10-03T18:57:32.964 INFO:teuthology.orchestra.run.smithi045.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-10-03T18:57:32.964 INFO:teuthology.orchestra.run.smithi045.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-10-03T18:57:32.964 INFO:teuthology.orchestra.run.smithi045.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-84-generic 2023-10-03T18:57:32.964 INFO:teuthology.orchestra.run.smithi045.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-84-generic 2023-10-03T18:57:33.134 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up linux-modules-extra-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:34.169 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-image-generic (5.15.0.84.81) ... 2023-10-03T18:57:34.295 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-generic (5.15.0.84.81) ... 2023-10-03T18:57:34.446 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for linux-image-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:34.508 INFO:teuthology.orchestra.run.smithi079.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-03T18:57:34.508 INFO:teuthology.orchestra.run.smithi079.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-84-generic 2023-10-03T18:57:34.612 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up linux-modules-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:36.046 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up linux-image-generic (5.15.0.84.81) ... 2023-10-03T18:57:36.146 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up linux-generic (5.15.0.84.81) ... 2023-10-03T18:57:36.248 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for linux-image-5.15.0-84-generic (5.15.0-84.93) ... 2023-10-03T18:57:36.302 INFO:teuthology.orchestra.run.smithi045.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-03T18:57:36.302 INFO:teuthology.orchestra.run.smithi045.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-84-generic 2023-10-03T18:57:45.717 INFO:teuthology.orchestra.run.smithi172.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-03T18:57:45.717 INFO:teuthology.orchestra.run.smithi172.stdout:Sourcing file `/etc/default/grub' 2023-10-03T18:57:45.735 INFO:teuthology.orchestra.run.smithi172.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-03T18:57:45.760 INFO:teuthology.orchestra.run.smithi172.stdout:Generating grub configuration file ... 2023-10-03T18:57:46.053 INFO:teuthology.orchestra.run.smithi172.stdout:Found linux image: /boot/vmlinuz-5.15.0-84-generic 2023-10-03T18:57:46.080 INFO:teuthology.orchestra.run.smithi172.stdout:Found initrd image: /boot/initrd.img-5.15.0-84-generic 2023-10-03T18:57:46.373 INFO:teuthology.orchestra.run.smithi172.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-03T18:57:46.379 INFO:teuthology.orchestra.run.smithi172.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-03T18:57:46.453 INFO:teuthology.orchestra.run.smithi172.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-03T18:57:46.459 INFO:teuthology.orchestra.run.smithi172.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-03T18:57:46.628 INFO:teuthology.orchestra.run.smithi172.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-03T18:57:46.628 INFO:teuthology.orchestra.run.smithi172.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-10-03T18:57:46.628 INFO:teuthology.orchestra.run.smithi172.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-03T18:57:46.665 INFO:teuthology.orchestra.run.smithi172.stdout:done 2023-10-03T18:57:46.693 INFO:teuthology.orchestra.run.smithi146.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-03T18:57:46.694 INFO:teuthology.orchestra.run.smithi146.stdout:Sourcing file `/etc/default/grub' 2023-10-03T18:57:46.700 INFO:teuthology.orchestra.run.smithi146.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-03T18:57:46.731 INFO:teuthology.orchestra.run.smithi146.stdout:Generating grub configuration file ... 2023-10-03T18:57:46.990 INFO:teuthology.orchestra.run.smithi146.stdout:Found linux image: /boot/vmlinuz-5.15.0-84-generic 2023-10-03T18:57:47.002 INFO:teuthology.orchestra.run.smithi146.stdout:Found initrd image: /boot/initrd.img-5.15.0-84-generic 2023-10-03T18:57:47.115 DEBUG:teuthology.orchestra.run.smithi172:> dpkg -s linux-image-generic 2023-10-03T18:57:47.142 INFO:teuthology.orchestra.run.smithi172.stdout:Package: linux-image-generic 2023-10-03T18:57:47.143 INFO:teuthology.orchestra.run.smithi172.stdout:Status: install ok installed 2023-10-03T18:57:47.143 INFO:teuthology.orchestra.run.smithi172.stdout:Priority: optional 2023-10-03T18:57:47.143 INFO:teuthology.orchestra.run.smithi172.stdout:Section: kernel 2023-10-03T18:57:47.143 INFO:teuthology.orchestra.run.smithi172.stdout:Installed-Size: 20 2023-10-03T18:57:47.143 INFO:teuthology.orchestra.run.smithi172.stdout:Maintainer: Ubuntu Kernel Team 2023-10-03T18:57:47.143 INFO:teuthology.orchestra.run.smithi172.stdout:Architecture: amd64 2023-10-03T18:57:47.143 INFO:teuthology.orchestra.run.smithi172.stdout:Source: linux-meta 2023-10-03T18:57:47.143 INFO:teuthology.orchestra.run.smithi172.stdout:Version: 5.15.0.84.81 2023-10-03T18:57:47.143 INFO:teuthology.orchestra.run.smithi172.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-84), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-10-03T18:57:47.144 INFO:teuthology.orchestra.run.smithi172.stdout:Depends: linux-image-5.15.0-84-generic, linux-modules-extra-5.15.0-84-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-03T18:57:47.144 INFO:teuthology.orchestra.run.smithi172.stdout:Recommends: thermald 2023-10-03T18:57:47.144 INFO:teuthology.orchestra.run.smithi172.stdout:Description: Generic Linux kernel image 2023-10-03T18:57:47.144 INFO:teuthology.orchestra.run.smithi172.stdout: This package will always depend on the latest generic kernel image 2023-10-03T18:57:47.144 INFO:teuthology.orchestra.run.smithi172.stdout: available. 2023-10-03T18:57:47.144 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-84-generic 2023-10-03T18:57:47.145 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-03T18:57:47.145 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-03T18:57:47.145 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-10-03T18:57:47.145 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi172.front.sepia.ceph.com, path=None, version=distro) 2023-10-03T18:57:47.145 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-get clean 2023-10-03T18:57:47.282 INFO:teuthology.orchestra.run.smithi146.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-03T18:57:47.287 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-get update 2023-10-03T18:57:47.287 INFO:teuthology.orchestra.run.smithi146.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-03T18:57:47.359 INFO:teuthology.orchestra.run.smithi146.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-03T18:57:47.364 INFO:teuthology.orchestra.run.smithi146.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-03T18:57:47.403 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-03T18:57:47.413 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-10-03T18:57:47.417 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-10-03T18:57:47.430 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-03T18:57:47.557 INFO:teuthology.orchestra.run.smithi146.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-03T18:57:47.557 INFO:teuthology.orchestra.run.smithi146.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-10-03T18:57:47.558 INFO:teuthology.orchestra.run.smithi146.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-03T18:57:47.612 INFO:teuthology.orchestra.run.smithi146.stdout:done 2023-10-03T18:57:48.088 DEBUG:teuthology.orchestra.run.smithi146:> dpkg -s linux-image-generic 2023-10-03T18:57:48.116 INFO:teuthology.orchestra.run.smithi146.stdout:Package: linux-image-generic 2023-10-03T18:57:48.116 INFO:teuthology.orchestra.run.smithi146.stdout:Status: install ok installed 2023-10-03T18:57:48.116 INFO:teuthology.orchestra.run.smithi146.stdout:Priority: optional 2023-10-03T18:57:48.116 INFO:teuthology.orchestra.run.smithi146.stdout:Section: kernel 2023-10-03T18:57:48.116 INFO:teuthology.orchestra.run.smithi146.stdout:Installed-Size: 20 2023-10-03T18:57:48.116 INFO:teuthology.orchestra.run.smithi146.stdout:Maintainer: Ubuntu Kernel Team 2023-10-03T18:57:48.116 INFO:teuthology.orchestra.run.smithi146.stdout:Architecture: amd64 2023-10-03T18:57:48.116 INFO:teuthology.orchestra.run.smithi146.stdout:Source: linux-meta 2023-10-03T18:57:48.116 INFO:teuthology.orchestra.run.smithi146.stdout:Version: 5.15.0.84.81 2023-10-03T18:57:48.117 INFO:teuthology.orchestra.run.smithi146.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-84), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-10-03T18:57:48.117 INFO:teuthology.orchestra.run.smithi146.stdout:Depends: linux-image-5.15.0-84-generic, linux-modules-extra-5.15.0-84-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-03T18:57:48.117 INFO:teuthology.orchestra.run.smithi146.stdout:Recommends: thermald 2023-10-03T18:57:48.117 INFO:teuthology.orchestra.run.smithi146.stdout:Description: Generic Linux kernel image 2023-10-03T18:57:48.117 INFO:teuthology.orchestra.run.smithi146.stdout: This package will always depend on the latest generic kernel image 2023-10-03T18:57:48.117 INFO:teuthology.orchestra.run.smithi146.stdout: available. 2023-10-03T18:57:48.117 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-84-generic 2023-10-03T18:57:48.117 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-03T18:57:48.117 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-03T18:57:48.117 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-03T18:57:48.118 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi146.front.sepia.ceph.com, path=None, version=distro) 2023-10-03T18:57:48.118 DEBUG:teuthology.orchestra.run.smithi146:> sudo apt-get clean 2023-10-03T18:57:48.316 DEBUG:teuthology.orchestra.run.smithi146:> sudo apt-get update 2023-10-03T18:57:48.388 INFO:teuthology.orchestra.run.smithi079.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-03T18:57:48.389 INFO:teuthology.orchestra.run.smithi079.stdout:Sourcing file `/etc/default/grub' 2023-10-03T18:57:48.413 INFO:teuthology.orchestra.run.smithi079.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-03T18:57:48.435 INFO:teuthology.orchestra.run.smithi079.stdout:Generating grub configuration file ... 2023-10-03T18:57:48.436 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-03T18:57:48.436 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-10-03T18:57:48.443 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-10-03T18:57:48.460 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-03T18:57:48.643 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2023-10-03T18:57:48.661 DEBUG:teuthology.orchestra.run.smithi172:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-03T18:57:48.721 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2023-10-03T18:57:48.724 INFO:teuthology.orchestra.run.smithi079.stdout:Found linux image: /boot/vmlinuz-5.15.0-84-generic 2023-10-03T18:57:48.752 INFO:teuthology.orchestra.run.smithi079.stdout:Found initrd image: /boot/initrd.img-5.15.0-84-generic 2023-10-03T18:57:48.907 INFO:teuthology.orchestra.run.smithi172.stdout:Building dependency tree... 2023-10-03T18:57:48.907 INFO:teuthology.orchestra.run.smithi172.stdout:Reading state information... 2023-10-03T18:57:49.060 INFO:teuthology.orchestra.run.smithi079.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-03T18:57:49.066 INFO:teuthology.orchestra.run.smithi079.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-03T18:57:49.068 INFO:teuthology.orchestra.run.smithi172.stdout:linux-image-generic is already the newest version (5.15.0.84.81). 2023-10-03T18:57:49.068 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages were automatically installed and are no longer required: 2023-10-03T18:57:49.068 INFO:teuthology.orchestra.run.smithi172.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-03T18:57:49.068 INFO:teuthology.orchestra.run.smithi172.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-03T18:57:49.068 INFO:teuthology.orchestra.run.smithi172.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-03T18:57:49.069 INFO:teuthology.orchestra.run.smithi172.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-03T18:57:49.069 INFO:teuthology.orchestra.run.smithi172.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-03T18:57:49.069 INFO:teuthology.orchestra.run.smithi172.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-03T18:57:49.106 INFO:teuthology.orchestra.run.smithi172.stdout:0 upgraded, 0 newly installed, 0 to remove and 266 not upgraded. 2023-10-03T18:57:49.108 DEBUG:teuthology.orchestra.run.smithi172:> dpkg -s linux-image-generic 2023-10-03T18:57:49.123 INFO:teuthology.orchestra.run.smithi172.stdout:Package: linux-image-generic 2023-10-03T18:57:49.124 INFO:teuthology.orchestra.run.smithi172.stdout:Status: install ok installed 2023-10-03T18:57:49.124 INFO:teuthology.orchestra.run.smithi172.stdout:Priority: optional 2023-10-03T18:57:49.124 INFO:teuthology.orchestra.run.smithi172.stdout:Section: kernel 2023-10-03T18:57:49.124 INFO:teuthology.orchestra.run.smithi172.stdout:Installed-Size: 20 2023-10-03T18:57:49.124 INFO:teuthology.orchestra.run.smithi172.stdout:Maintainer: Ubuntu Kernel Team 2023-10-03T18:57:49.124 INFO:teuthology.orchestra.run.smithi172.stdout:Architecture: amd64 2023-10-03T18:57:49.124 INFO:teuthology.orchestra.run.smithi172.stdout:Source: linux-meta 2023-10-03T18:57:49.124 INFO:teuthology.orchestra.run.smithi172.stdout:Version: 5.15.0.84.81 2023-10-03T18:57:49.124 INFO:teuthology.orchestra.run.smithi172.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-84), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-10-03T18:57:49.124 INFO:teuthology.orchestra.run.smithi172.stdout:Depends: linux-image-5.15.0-84-generic, linux-modules-extra-5.15.0-84-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-03T18:57:49.125 INFO:teuthology.orchestra.run.smithi172.stdout:Recommends: thermald 2023-10-03T18:57:49.125 INFO:teuthology.orchestra.run.smithi172.stdout:Description: Generic Linux kernel image 2023-10-03T18:57:49.125 INFO:teuthology.orchestra.run.smithi172.stdout: This package will always depend on the latest generic kernel image 2023-10-03T18:57:49.125 INFO:teuthology.orchestra.run.smithi172.stdout: available. 2023-10-03T18:57:49.125 DEBUG:teuthology.orchestra.run.smithi172:> mktemp 2023-10-03T18:57:49.131 INFO:teuthology.orchestra.run.smithi079.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-03T18:57:49.137 INFO:teuthology.orchestra.run.smithi079.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-03T18:57:49.170 INFO:teuthology.orchestra.run.smithi172.stdout:/tmp/tmp.LleBBlOwT4 2023-10-03T18:57:49.171 DEBUG:teuthology.orchestra.run.smithi172:> sudo cp /boot/grub/grub.cfg /tmp/tmp.LleBBlOwT4 2023-10-03T18:57:49.238 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0666 /tmp/tmp.LleBBlOwT4 2023-10-03T18:57:49.293 INFO:teuthology.orchestra.run.smithi079.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-03T18:57:49.294 INFO:teuthology.orchestra.run.smithi079.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-10-03T18:57:49.294 INFO:teuthology.orchestra.run.smithi079.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-03T18:57:49.348 INFO:teuthology.orchestra.run.smithi079.stdout:done 2023-10-03T18:57:49.359 DEBUG:teuthology.orchestra.remote:smithi172:/tmp/tmp.LleBBlOwT4 is 10KB 2023-10-03T18:57:49.373 DEBUG:teuthology.orchestra.run.smithi172:> rm -fr /tmp/tmp.LleBBlOwT4 2023-10-03T18:57:49.378 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-03T18:57:49.430 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-03T18:57:49.431 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-03T18:57:49.431 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-03T18:57:49.497 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-84-generic 2023-10-03T18:57:49.497 DEBUG:teuthology.orchestra.run.smithi172:> sudo update-grub 2023-10-03T18:57:49.692 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-10-03T18:57:49.709 DEBUG:teuthology.orchestra.run.smithi146:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-03T18:57:49.761 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-10-03T18:57:49.832 DEBUG:teuthology.orchestra.run.smithi079:> dpkg -s linux-image-generic 2023-10-03T18:57:49.852 INFO:teuthology.orchestra.run.smithi079.stdout:Package: linux-image-generic 2023-10-03T18:57:49.852 INFO:teuthology.orchestra.run.smithi079.stdout:Status: install ok installed 2023-10-03T18:57:49.852 INFO:teuthology.orchestra.run.smithi079.stdout:Priority: optional 2023-10-03T18:57:49.852 INFO:teuthology.orchestra.run.smithi079.stdout:Section: kernel 2023-10-03T18:57:49.852 INFO:teuthology.orchestra.run.smithi079.stdout:Installed-Size: 20 2023-10-03T18:57:49.852 INFO:teuthology.orchestra.run.smithi079.stdout:Maintainer: Ubuntu Kernel Team 2023-10-03T18:57:49.852 INFO:teuthology.orchestra.run.smithi079.stdout:Architecture: amd64 2023-10-03T18:57:49.852 INFO:teuthology.orchestra.run.smithi079.stdout:Source: linux-meta 2023-10-03T18:57:49.852 INFO:teuthology.orchestra.run.smithi079.stdout:Version: 5.15.0.84.81 2023-10-03T18:57:49.852 INFO:teuthology.orchestra.run.smithi079.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-84), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-10-03T18:57:49.853 INFO:teuthology.orchestra.run.smithi079.stdout:Depends: linux-image-5.15.0-84-generic, linux-modules-extra-5.15.0-84-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-03T18:57:49.853 INFO:teuthology.orchestra.run.smithi079.stdout:Recommends: thermald 2023-10-03T18:57:49.853 INFO:teuthology.orchestra.run.smithi079.stdout:Description: Generic Linux kernel image 2023-10-03T18:57:49.853 INFO:teuthology.orchestra.run.smithi079.stdout: This package will always depend on the latest generic kernel image 2023-10-03T18:57:49.853 INFO:teuthology.orchestra.run.smithi079.stdout: available. 2023-10-03T18:57:49.853 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-84-generic 2023-10-03T18:57:49.853 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-03T18:57:49.853 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-03T18:57:49.853 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-10-03T18:57:49.853 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi079.front.sepia.ceph.com, path=None, version=distro) 2023-10-03T18:57:49.854 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get clean 2023-10-03T18:57:49.924 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-10-03T18:57:49.924 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-10-03T18:57:50.013 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get update 2023-10-03T18:57:50.062 INFO:teuthology.orchestra.run.smithi146.stdout:linux-image-generic is already the newest version (5.15.0.84.81). 2023-10-03T18:57:50.062 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2023-10-03T18:57:50.062 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-03T18:57:50.062 INFO:teuthology.orchestra.run.smithi146.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-03T18:57:50.062 INFO:teuthology.orchestra.run.smithi146.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-03T18:57:50.062 INFO:teuthology.orchestra.run.smithi146.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-03T18:57:50.062 INFO:teuthology.orchestra.run.smithi146.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-03T18:57:50.062 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-03T18:57:50.098 INFO:teuthology.orchestra.run.smithi146.stdout:0 upgraded, 0 newly installed, 0 to remove and 266 not upgraded. 2023-10-03T18:57:50.100 DEBUG:teuthology.orchestra.run.smithi146:> dpkg -s linux-image-generic 2023-10-03T18:57:50.136 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-03T18:57:50.140 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-10-03T18:57:50.157 INFO:teuthology.orchestra.run.smithi146.stdout:Package: linux-image-generic 2023-10-03T18:57:50.157 INFO:teuthology.orchestra.run.smithi146.stdout:Status: install ok installed 2023-10-03T18:57:50.157 INFO:teuthology.orchestra.run.smithi146.stdout:Priority: optional 2023-10-03T18:57:50.157 INFO:teuthology.orchestra.run.smithi146.stdout:Section: kernel 2023-10-03T18:57:50.157 INFO:teuthology.orchestra.run.smithi146.stdout:Installed-Size: 20 2023-10-03T18:57:50.157 INFO:teuthology.orchestra.run.smithi146.stdout:Maintainer: Ubuntu Kernel Team 2023-10-03T18:57:50.157 INFO:teuthology.orchestra.run.smithi146.stdout:Architecture: amd64 2023-10-03T18:57:50.157 INFO:teuthology.orchestra.run.smithi146.stdout:Source: linux-meta 2023-10-03T18:57:50.157 INFO:teuthology.orchestra.run.smithi146.stdout:Version: 5.15.0.84.81 2023-10-03T18:57:50.157 INFO:teuthology.orchestra.run.smithi146.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-84), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-10-03T18:57:50.158 INFO:teuthology.orchestra.run.smithi146.stdout:Depends: linux-image-5.15.0-84-generic, linux-modules-extra-5.15.0-84-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-03T18:57:50.158 INFO:teuthology.orchestra.run.smithi146.stdout:Recommends: thermald 2023-10-03T18:57:50.158 INFO:teuthology.orchestra.run.smithi146.stdout:Description: Generic Linux kernel image 2023-10-03T18:57:50.158 INFO:teuthology.orchestra.run.smithi146.stdout: This package will always depend on the latest generic kernel image 2023-10-03T18:57:50.158 INFO:teuthology.orchestra.run.smithi146.stdout: available. 2023-10-03T18:57:50.158 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2023-10-03T18:57:50.159 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-03T18:57:50.201 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.r8fhNzpMw2 2023-10-03T18:57:50.202 DEBUG:teuthology.orchestra.run.smithi146:> sudo cp /boot/grub/grub.cfg /tmp/tmp.r8fhNzpMw2 2023-10-03T18:57:50.251 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-10-03T18:57:50.258 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.r8fhNzpMw2 2023-10-03T18:57:50.380 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.r8fhNzpMw2 is 10KB 2023-10-03T18:57:50.392 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.r8fhNzpMw2 2023-10-03T18:57:50.398 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-03T18:57:50.453 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T18:57:50.453 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-03T18:57:50.453 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-03T18:57:50.520 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-84-generic 2023-10-03T18:57:50.520 DEBUG:teuthology.orchestra.run.smithi146:> sudo update-grub 2023-10-03T18:57:50.582 INFO:teuthology.orchestra.run.smithi172.stderr:Sourcing file `/etc/default/grub' 2023-10-03T18:57:50.583 INFO:teuthology.orchestra.run.smithi172.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-03T18:57:50.584 INFO:teuthology.orchestra.run.smithi172.stderr:Generating grub configuration file ... 2023-10-03T18:57:50.739 INFO:teuthology.orchestra.run.smithi172.stderr:Found linux image: /boot/vmlinuz-5.15.0-84-generic 2023-10-03T18:57:50.745 INFO:teuthology.orchestra.run.smithi172.stderr:Found initrd image: /boot/initrd.img-5.15.0-84-generic 2023-10-03T18:57:50.978 INFO:teuthology.orchestra.run.smithi172.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-03T18:57:50.984 INFO:teuthology.orchestra.run.smithi172.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-03T18:57:51.026 INFO:teuthology.orchestra.run.smithi172.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-03T18:57:51.032 INFO:teuthology.orchestra.run.smithi172.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-03T18:57:51.167 INFO:teuthology.orchestra.run.smithi045.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-03T18:57:51.168 INFO:teuthology.orchestra.run.smithi045.stdout:Sourcing file `/etc/default/grub' 2023-10-03T18:57:51.177 INFO:teuthology.orchestra.run.smithi172.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-03T18:57:51.177 INFO:teuthology.orchestra.run.smithi172.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-10-03T18:57:51.177 INFO:teuthology.orchestra.run.smithi172.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-03T18:57:51.188 INFO:teuthology.orchestra.run.smithi172.stderr:done 2023-10-03T18:57:51.192 INFO:teuthology.orchestra.run.smithi045.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-03T18:57:51.206 DEBUG:teuthology.orchestra.run.smithi172:> sudo shutdown -r now 2023-10-03T18:57:51.207 INFO:teuthology.orchestra.run.smithi045.stdout:Generating grub configuration file ... 2023-10-03T18:57:51.372 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2023-10-03T18:57:51.389 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-03T18:57:51.438 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2023-10-03T18:57:51.454 INFO:teuthology.orchestra.run.smithi045.stdout:Found linux image: /boot/vmlinuz-5.15.0-84-generic 2023-10-03T18:57:51.479 INFO:teuthology.orchestra.run.smithi045.stdout:Found initrd image: /boot/initrd.img-5.15.0-84-generic 2023-10-03T18:57:51.603 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2023-10-03T18:57:51.603 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2023-10-03T18:57:51.674 INFO:teuthology.orchestra.run.smithi146.stderr:Sourcing file `/etc/default/grub' 2023-10-03T18:57:51.675 INFO:teuthology.orchestra.run.smithi146.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-03T18:57:51.678 INFO:teuthology.orchestra.run.smithi146.stderr:Generating grub configuration file ... 2023-10-03T18:57:51.743 INFO:teuthology.orchestra.run.smithi079.stdout:linux-image-generic is already the newest version (5.15.0.84.81). 2023-10-03T18:57:51.744 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages were automatically installed and are no longer required: 2023-10-03T18:57:51.744 INFO:teuthology.orchestra.run.smithi079.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-03T18:57:51.744 INFO:teuthology.orchestra.run.smithi079.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-03T18:57:51.744 INFO:teuthology.orchestra.run.smithi079.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-03T18:57:51.744 INFO:teuthology.orchestra.run.smithi079.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-03T18:57:51.745 INFO:teuthology.orchestra.run.smithi079.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-03T18:57:51.745 INFO:teuthology.orchestra.run.smithi079.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-03T18:57:51.764 INFO:teuthology.orchestra.run.smithi045.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-03T18:57:51.770 INFO:teuthology.orchestra.run.smithi045.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-03T18:57:51.778 INFO:teuthology.orchestra.run.smithi079.stdout:0 upgraded, 0 newly installed, 0 to remove and 266 not upgraded. 2023-10-03T18:57:51.780 DEBUG:teuthology.orchestra.run.smithi079:> dpkg -s linux-image-generic 2023-10-03T18:57:51.838 INFO:teuthology.orchestra.run.smithi079.stdout:Package: linux-image-generic 2023-10-03T18:57:51.838 INFO:teuthology.orchestra.run.smithi079.stdout:Status: install ok installed 2023-10-03T18:57:51.838 INFO:teuthology.orchestra.run.smithi079.stdout:Priority: optional 2023-10-03T18:57:51.838 INFO:teuthology.orchestra.run.smithi079.stdout:Section: kernel 2023-10-03T18:57:51.838 INFO:teuthology.orchestra.run.smithi079.stdout:Installed-Size: 20 2023-10-03T18:57:51.838 INFO:teuthology.orchestra.run.smithi079.stdout:Maintainer: Ubuntu Kernel Team 2023-10-03T18:57:51.838 INFO:teuthology.orchestra.run.smithi079.stdout:Architecture: amd64 2023-10-03T18:57:51.838 INFO:teuthology.orchestra.run.smithi079.stdout:Source: linux-meta 2023-10-03T18:57:51.839 INFO:teuthology.orchestra.run.smithi079.stdout:Version: 5.15.0.84.81 2023-10-03T18:57:51.839 INFO:teuthology.orchestra.run.smithi079.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-84), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-10-03T18:57:51.839 INFO:teuthology.orchestra.run.smithi079.stdout:Depends: linux-image-5.15.0-84-generic, linux-modules-extra-5.15.0-84-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-03T18:57:51.839 INFO:teuthology.orchestra.run.smithi079.stdout:Recommends: thermald 2023-10-03T18:57:51.839 INFO:teuthology.orchestra.run.smithi079.stdout:Description: Generic Linux kernel image 2023-10-03T18:57:51.839 INFO:teuthology.orchestra.run.smithi079.stdout: This package will always depend on the latest generic kernel image 2023-10-03T18:57:51.839 INFO:teuthology.orchestra.run.smithi079.stdout: available. 2023-10-03T18:57:51.839 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2023-10-03T18:57:51.849 INFO:teuthology.orchestra.run.smithi045.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-03T18:57:51.851 INFO:teuthology.orchestra.run.smithi146.stderr:Found linux image: /boot/vmlinuz-5.15.0-84-generic 2023-10-03T18:57:51.855 INFO:teuthology.orchestra.run.smithi045.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-03T18:57:51.857 INFO:teuthology.orchestra.run.smithi146.stderr:Found initrd image: /boot/initrd.img-5.15.0-84-generic 2023-10-03T18:57:51.884 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.SavibaNfpP 2023-10-03T18:57:51.884 DEBUG:teuthology.orchestra.run.smithi079:> sudo cp /boot/grub/grub.cfg /tmp/tmp.SavibaNfpP 2023-10-03T18:57:51.939 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.SavibaNfpP 2023-10-03T18:57:52.013 INFO:teuthology.orchestra.run.smithi045.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-03T18:57:52.014 INFO:teuthology.orchestra.run.smithi045.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-10-03T18:57:52.014 INFO:teuthology.orchestra.run.smithi045.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-03T18:57:52.053 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.SavibaNfpP is 10KB 2023-10-03T18:57:52.061 INFO:teuthology.orchestra.run.smithi045.stdout:done 2023-10-03T18:57:52.066 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.SavibaNfpP 2023-10-03T18:57:52.071 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-03T18:57:52.091 INFO:teuthology.orchestra.run.smithi146.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-03T18:57:52.096 INFO:teuthology.orchestra.run.smithi146.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-03T18:57:52.127 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-03T18:57:52.127 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-03T18:57:52.127 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-03T18:57:52.137 INFO:teuthology.orchestra.run.smithi146.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-03T18:57:52.142 INFO:teuthology.orchestra.run.smithi146.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-03T18:57:52.194 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-84-generic 2023-10-03T18:57:52.194 DEBUG:teuthology.orchestra.run.smithi079:> sudo update-grub 2023-10-03T18:57:52.295 INFO:teuthology.orchestra.run.smithi146.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-03T18:57:52.296 INFO:teuthology.orchestra.run.smithi146.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-10-03T18:57:52.296 INFO:teuthology.orchestra.run.smithi146.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-03T18:57:52.309 INFO:teuthology.orchestra.run.smithi146.stderr:done 2023-10-03T18:57:52.327 DEBUG:teuthology.orchestra.run.smithi146:> sudo shutdown -r now 2023-10-03T18:57:52.491 DEBUG:teuthology.orchestra.run.smithi045:> dpkg -s linux-image-generic 2023-10-03T18:57:52.516 INFO:teuthology.orchestra.run.smithi045.stdout:Package: linux-image-generic 2023-10-03T18:57:52.516 INFO:teuthology.orchestra.run.smithi045.stdout:Status: install ok installed 2023-10-03T18:57:52.516 INFO:teuthology.orchestra.run.smithi045.stdout:Priority: optional 2023-10-03T18:57:52.517 INFO:teuthology.orchestra.run.smithi045.stdout:Section: kernel 2023-10-03T18:57:52.517 INFO:teuthology.orchestra.run.smithi045.stdout:Installed-Size: 20 2023-10-03T18:57:52.517 INFO:teuthology.orchestra.run.smithi045.stdout:Maintainer: Ubuntu Kernel Team 2023-10-03T18:57:52.517 INFO:teuthology.orchestra.run.smithi045.stdout:Architecture: amd64 2023-10-03T18:57:52.517 INFO:teuthology.orchestra.run.smithi045.stdout:Source: linux-meta 2023-10-03T18:57:52.517 INFO:teuthology.orchestra.run.smithi045.stdout:Version: 5.15.0.84.81 2023-10-03T18:57:52.517 INFO:teuthology.orchestra.run.smithi045.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-84), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-10-03T18:57:52.517 INFO:teuthology.orchestra.run.smithi045.stdout:Depends: linux-image-5.15.0-84-generic, linux-modules-extra-5.15.0-84-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-03T18:57:52.517 INFO:teuthology.orchestra.run.smithi045.stdout:Recommends: thermald 2023-10-03T18:57:52.517 INFO:teuthology.orchestra.run.smithi045.stdout:Description: Generic Linux kernel image 2023-10-03T18:57:52.518 INFO:teuthology.orchestra.run.smithi045.stdout: This package will always depend on the latest generic kernel image 2023-10-03T18:57:52.518 INFO:teuthology.orchestra.run.smithi045.stdout: available. 2023-10-03T18:57:52.518 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-84-generic 2023-10-03T18:57:52.518 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-03T18:57:52.518 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-03T18:57:52.518 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-03T18:57:52.518 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi045.front.sepia.ceph.com, path=None, version=distro) 2023-10-03T18:57:52.519 DEBUG:teuthology.orchestra.run.smithi045:> sudo apt-get clean 2023-10-03T18:57:52.687 DEBUG:teuthology.orchestra.run.smithi045:> sudo apt-get update 2023-10-03T18:57:52.795 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-10-03T18:57:52.796 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-03T18:57:52.814 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-10-03T18:57:52.833 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-03T18:57:53.579 INFO:teuthology.orchestra.run.smithi079.stderr:Sourcing file `/etc/default/grub' 2023-10-03T18:57:53.586 INFO:teuthology.orchestra.run.smithi079.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-03T18:57:53.590 INFO:teuthology.orchestra.run.smithi079.stderr:Generating grub configuration file ... 2023-10-03T18:57:53.773 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-5.15.0-84-generic 2023-10-03T18:57:53.778 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initrd.img-5.15.0-84-generic 2023-10-03T18:57:54.049 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-03T18:57:54.054 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-03T18:57:54.096 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-03T18:57:54.101 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-03T18:57:54.130 INFO:teuthology.orchestra.run.smithi045.stdout:Reading package lists... 2023-10-03T18:57:54.149 DEBUG:teuthology.orchestra.run.smithi045:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-03T18:57:54.210 INFO:teuthology.orchestra.run.smithi045.stdout:Reading package lists... 2023-10-03T18:57:54.220 INFO:teuthology.orchestra.run.smithi079.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-03T18:57:54.220 INFO:teuthology.orchestra.run.smithi079.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-10-03T18:57:54.220 INFO:teuthology.orchestra.run.smithi079.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-03T18:57:54.240 INFO:teuthology.orchestra.run.smithi079.stderr:done 2023-10-03T18:57:54.242 DEBUG:teuthology.orchestra.run.smithi079:> sudo shutdown -r now 2023-10-03T18:57:54.396 INFO:teuthology.orchestra.run.smithi045.stdout:Building dependency tree... 2023-10-03T18:57:54.396 INFO:teuthology.orchestra.run.smithi045.stdout:Reading state information... 2023-10-03T18:57:54.563 INFO:teuthology.orchestra.run.smithi045.stdout:linux-image-generic is already the newest version (5.15.0.84.81). 2023-10-03T18:57:54.563 INFO:teuthology.orchestra.run.smithi045.stdout:The following packages were automatically installed and are no longer required: 2023-10-03T18:57:54.563 INFO:teuthology.orchestra.run.smithi045.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-03T18:57:54.563 INFO:teuthology.orchestra.run.smithi045.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-03T18:57:54.563 INFO:teuthology.orchestra.run.smithi045.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-03T18:57:54.563 INFO:teuthology.orchestra.run.smithi045.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-03T18:57:54.564 INFO:teuthology.orchestra.run.smithi045.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-03T18:57:54.564 INFO:teuthology.orchestra.run.smithi045.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-03T18:57:54.600 INFO:teuthology.orchestra.run.smithi045.stdout:0 upgraded, 0 newly installed, 0 to remove and 266 not upgraded. 2023-10-03T18:57:54.602 DEBUG:teuthology.orchestra.run.smithi045:> dpkg -s linux-image-generic 2023-10-03T18:57:54.619 INFO:teuthology.orchestra.run.smithi045.stdout:Package: linux-image-generic 2023-10-03T18:57:54.619 INFO:teuthology.orchestra.run.smithi045.stdout:Status: install ok installed 2023-10-03T18:57:54.619 INFO:teuthology.orchestra.run.smithi045.stdout:Priority: optional 2023-10-03T18:57:54.619 INFO:teuthology.orchestra.run.smithi045.stdout:Section: kernel 2023-10-03T18:57:54.619 INFO:teuthology.orchestra.run.smithi045.stdout:Installed-Size: 20 2023-10-03T18:57:54.619 INFO:teuthology.orchestra.run.smithi045.stdout:Maintainer: Ubuntu Kernel Team 2023-10-03T18:57:54.619 INFO:teuthology.orchestra.run.smithi045.stdout:Architecture: amd64 2023-10-03T18:57:54.619 INFO:teuthology.orchestra.run.smithi045.stdout:Source: linux-meta 2023-10-03T18:57:54.620 INFO:teuthology.orchestra.run.smithi045.stdout:Version: 5.15.0.84.81 2023-10-03T18:57:54.620 INFO:teuthology.orchestra.run.smithi045.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-84), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-10-03T18:57:54.620 INFO:teuthology.orchestra.run.smithi045.stdout:Depends: linux-image-5.15.0-84-generic, linux-modules-extra-5.15.0-84-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-03T18:57:54.620 INFO:teuthology.orchestra.run.smithi045.stdout:Recommends: thermald 2023-10-03T18:57:54.620 INFO:teuthology.orchestra.run.smithi045.stdout:Description: Generic Linux kernel image 2023-10-03T18:57:54.620 INFO:teuthology.orchestra.run.smithi045.stdout: This package will always depend on the latest generic kernel image 2023-10-03T18:57:54.620 INFO:teuthology.orchestra.run.smithi045.stdout: available. 2023-10-03T18:57:54.620 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2023-10-03T18:57:54.667 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.cVLa7AD2bb 2023-10-03T18:57:54.668 DEBUG:teuthology.orchestra.run.smithi045:> sudo cp /boot/grub/grub.cfg /tmp/tmp.cVLa7AD2bb 2023-10-03T18:57:54.725 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0666 /tmp/tmp.cVLa7AD2bb 2023-10-03T18:57:54.840 DEBUG:teuthology.orchestra.remote:smithi045:/tmp/tmp.cVLa7AD2bb is 10KB 2023-10-03T18:57:54.854 DEBUG:teuthology.orchestra.run.smithi045:> rm -fr /tmp/tmp.cVLa7AD2bb 2023-10-03T18:57:54.860 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-03T18:57:54.920 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-03T18:57:54.920 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-03T18:57:54.920 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-03T18:57:55.001 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-84-generic 2023-10-03T18:57:55.001 DEBUG:teuthology.orchestra.run.smithi045:> sudo update-grub 2023-10-03T18:57:56.104 INFO:teuthology.orchestra.run.smithi045.stderr:Sourcing file `/etc/default/grub' 2023-10-03T18:57:56.105 INFO:teuthology.orchestra.run.smithi045.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-03T18:57:56.107 INFO:teuthology.orchestra.run.smithi045.stderr:Generating grub configuration file ... 2023-10-03T18:57:56.263 INFO:teuthology.orchestra.run.smithi045.stderr:Found linux image: /boot/vmlinuz-5.15.0-84-generic 2023-10-03T18:57:56.270 INFO:teuthology.orchestra.run.smithi045.stderr:Found initrd image: /boot/initrd.img-5.15.0-84-generic 2023-10-03T18:57:56.489 INFO:teuthology.orchestra.run.smithi045.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-03T18:57:56.495 INFO:teuthology.orchestra.run.smithi045.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-03T18:57:56.540 INFO:teuthology.orchestra.run.smithi045.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-03T18:57:56.546 INFO:teuthology.orchestra.run.smithi045.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-03T18:57:56.670 INFO:teuthology.orchestra.run.smithi045.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-03T18:57:56.670 INFO:teuthology.orchestra.run.smithi045.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-10-03T18:57:56.670 INFO:teuthology.orchestra.run.smithi045.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-03T18:57:56.684 INFO:teuthology.orchestra.run.smithi045.stderr:done 2023-10-03T18:57:56.693 DEBUG:teuthology.orchestra.run.smithi045:> sudo shutdown -r now 2023-10-03T18:58:21.276 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-03T18:58:21.277 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-10-03T18:58:21.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:58:22.330 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-03T18:58:22.330 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-10-03T18:58:22.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:58:24.246 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-10-03T18:58:24.246 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-03T18:58:24.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:58:26.698 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-03T18:58:26.698 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-10-03T18:58:26.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:58:39.614 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-10-03T18:58:40.894 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-10-03T18:58:42.682 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-03T18:58:45.242 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-10-03T18:58:48.618 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-10-03T18:58:48.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:58:49.897 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-10-03T18:58:49.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:58:51.675 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-10-03T18:58:51.683 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-03T18:58:51.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:58:52.958 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-10-03T18:58:54.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-10-03T18:58:54.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:58:54.746 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-03T18:59:03.682 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-10-03T18:59:03.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:59:04.960 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-10-03T18:59:04.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:59:06.751 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-03T18:59:06.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:59:22.106 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-10-03T18:59:25.178 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-03T18:59:37.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-10-03T18:59:37.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:59:37.773 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-10-03T18:59:39.125 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-10-03T18:59:39.125 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.15.0-84-generic"... 2023-10-03T18:59:39.126 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2023-10-03T18:59:39.180 INFO:teuthology.orchestra.run.smithi172.stdout:5.15.0-84-generic 2023-10-03T18:59:39.180 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-84-generic vs 5.15.0-84-generic 2023-10-03T18:59:39.181 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-03T18:59:39.181 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-03T18:59:40.180 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-03T18:59:40.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:59:40.183 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2023-10-03T18:59:40.183 DEBUG:teuthology.orchestra.run.smithi172:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-03T18:59:40.342 INFO:teuthology.orchestra.run.smithi172.stdout:ttyS1 2023-10-03T18:59:40.389 DEBUG:teuthology.parallel:result is None 2023-10-03T18:59:40.488 DEBUG:teuthology.orchestra.run.smithi079:> true 2023-10-03T18:59:41.101 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-03T18:59:41.101 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-84-generic"... 2023-10-03T18:59:41.102 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2023-10-03T18:59:41.146 INFO:teuthology.orchestra.run.smithi079.stdout:5.15.0-84-generic 2023-10-03T18:59:41.147 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-84-generic vs 5.15.0-84-generic 2023-10-03T18:59:41.147 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-03T18:59:41.147 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-03T18:59:42.148 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-03T18:59:42.148 DEBUG:teuthology.orchestra.run.smithi079:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-03T18:59:42.220 INFO:teuthology.orchestra.run.smithi079.stdout:ttyS1 2023-10-03T18:59:42.248 DEBUG:teuthology.parallel:result is None 2023-10-03T18:59:54.247 DEBUG:teuthology.orchestra.remote:timed out 2023-10-03T19:00:04.963 DEBUG:teuthology.orchestra.remote:timed out 2023-10-03T19:00:06.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-10-03T19:00:06.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T19:00:06.473 DEBUG:teuthology.orchestra.run.smithi045:> true 2023-10-03T19:00:07.101 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-10-03T19:00:07.101 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-84-generic"... 2023-10-03T19:00:07.101 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2023-10-03T19:00:07.147 INFO:teuthology.orchestra.run.smithi045.stdout:5.15.0-84-generic 2023-10-03T19:00:07.147 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-84-generic vs 5.15.0-84-generic 2023-10-03T19:00:07.147 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-03T19:00:07.147 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-03T19:00:08.148 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-03T19:00:08.148 DEBUG:teuthology.orchestra.run.smithi045:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-03T19:00:08.224 INFO:teuthology.orchestra.run.smithi045.stdout:ttyS1 2023-10-03T19:00:08.248 DEBUG:teuthology.parallel:result is None 2023-10-03T19:00:19.964 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-10-03T19:00:19.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T19:00:20.269 DEBUG:teuthology.orchestra.run.smithi146:> true 2023-10-03T19:00:20.879 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-10-03T19:00:20.879 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.15.0-84-generic"... 2023-10-03T19:00:20.879 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2023-10-03T19:00:20.925 INFO:teuthology.orchestra.run.smithi146.stdout:5.15.0-84-generic 2023-10-03T19:00:20.925 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-84-generic vs 5.15.0-84-generic 2023-10-03T19:00:20.926 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-03T19:00:20.926 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-03T19:00:21.926 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2023-10-03T19:00:21.927 DEBUG:teuthology.orchestra.run.smithi146:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-03T19:00:21.992 INFO:teuthology.orchestra.run.smithi146.stdout:ttyS1 2023-10-03T19:00:22.023 DEBUG:teuthology.parallel:result is None 2023-10-03T19:00:22.023 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-03T19:00:22.032 INFO:teuthology.task.internal:Creating test directory... 2023-10-03T19:00:22.033 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-03T19:00:22.036 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-03T19:00:22.038 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-03T19:00:22.043 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-03T19:00:22.050 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-03T19:00:22.061 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-03T19:00:22.070 INFO:teuthology.task.internal:Creating archive directory... 2023-10-03T19:00:22.070 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-03T19:00:22.084 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-03T19:00:22.091 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-03T19:00:22.093 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-03T19:00:22.417 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-03T19:00:22.424 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-03T19:00:22.424 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-03T19:00:22.427 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-03T19:00:22.429 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-03T19:00:22.431 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-03T19:00:22.445 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-03T19:00:22.448 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-03T19:00:22.454 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-03T19:00:22.456 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-03T19:00:22.462 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-03T19:00:22.462 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-03T19:00:22.469 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-03T19:00:22.470 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-03T19:00:22.472 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-03T19:00:22.480 INFO:teuthology.task.internal:Configuring sudo... 2023-10-03T19:00:22.481 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-03T19:00:22.500 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-03T19:00:22.503 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-03T19:00:22.514 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-03T19:00:22.539 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-03T19:00:22.547 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-03T19:00:22.548 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-03T19:00:22.556 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-03T19:00:22.559 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-03T19:00:22.570 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-03T19:00:22.590 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-03T19:00:22.607 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-03T19:00:22.655 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-03T19:00:22.655 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-03T19:00:22.713 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-03T19:00:22.719 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-03T19:00:22.766 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-03T19:00:22.766 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-03T19:00:22.838 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-03T19:00:22.844 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-03T19:00:22.890 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:00:22.890 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-03T19:00:22.955 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-03T19:00:22.960 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-03T19:00:23.006 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-03T19:00:23.006 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-03T19:00:23.075 DEBUG:teuthology.orchestra.run.smithi045:> sudo service rsyslog restart 2023-10-03T19:00:23.077 DEBUG:teuthology.orchestra.run.smithi079:> sudo service rsyslog restart 2023-10-03T19:00:23.079 DEBUG:teuthology.orchestra.run.smithi146:> sudo service rsyslog restart 2023-10-03T19:00:23.082 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2023-10-03T19:00:23.192 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-03T19:00:23.200 INFO:teuthology.task.internal:Starting timer... 2023-10-03T19:00:23.200 INFO:teuthology.run_tasks:Running task pcp... 2023-10-03T19:00:23.221 INFO:teuthology.run_tasks:Running task selinux... 2023-10-03T19:00:23.229 DEBUG:teuthology.task.selinux:Excluding smithi045: OS 'ubuntu' does not support SELinux 2023-10-03T19:00:23.229 DEBUG:teuthology.task.selinux:Excluding smithi079: OS 'ubuntu' does not support SELinux 2023-10-03T19:00:23.229 DEBUG:teuthology.task.selinux:Excluding smithi146: OS 'ubuntu' does not support SELinux 2023-10-03T19:00:23.229 DEBUG:teuthology.task.selinux:Excluding smithi172: OS 'ubuntu' does not support SELinux 2023-10-03T19:00:23.230 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-03T19:00:23.230 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-10-03T19:00:23.230 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-03T19:00:23.230 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-03T19:00:23.238 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-03T19:00:23.243 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-03T19:00:23.412 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-03T19:00:23.428 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-03T19:00:23.429 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi045.front.sepia.ceph.com,smithi079.front.sepia.ceph.com,smithi146.front.sepia.ceph.com,smithi172.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-03T19:08:29.184 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi045.front.sepia.ceph.com'), Remote(name='ubuntu@smithi079.front.sepia.ceph.com'), Remote(name='ubuntu@smithi146.front.sepia.ceph.com'), Remote(name='ubuntu@smithi172.front.sepia.ceph.com')] 2023-10-03T19:08:29.185 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-10-03T19:08:29.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T19:08:29.272 DEBUG:teuthology.orchestra.run.smithi045:> true 2023-10-03T19:08:29.395 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-10-03T19:08:29.395 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-03T19:08:29.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T19:08:29.516 DEBUG:teuthology.orchestra.run.smithi079:> true 2023-10-03T19:08:29.626 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-03T19:08:29.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-10-03T19:08:29.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T19:08:29.703 DEBUG:teuthology.orchestra.run.smithi146:> true 2023-10-03T19:08:29.802 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-10-03T19:08:29.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-10-03T19:08:29.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T19:08:29.882 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-10-03T19:08:29.994 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-10-03T19:08:29.995 INFO:teuthology.run_tasks:Running task clock... 2023-10-03T19:08:30.006 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-03T19:08:30.006 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-03T19:08:30.006 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-03T19:08:30.009 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-03T19:08:30.009 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-03T19:08:30.011 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-03T19:08:30.011 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-03T19:08:30.013 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-03T19:08:30.014 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-03T19:08:30.036 INFO:teuthology.orchestra.run.smithi079.stdout: 3 Oct 19:08:30 ntpd[27841]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-10-03T19:08:30.036 INFO:teuthology.orchestra.run.smithi079.stdout: 3 Oct 19:08:30 ntpd[27841]: Command line: ntpd -gq 2023-10-03T19:08:30.036 INFO:teuthology.orchestra.run.smithi079.stdout: 3 Oct 19:08:30 ntpd[27841]: ---------------------------------------------------- 2023-10-03T19:08:30.036 INFO:teuthology.orchestra.run.smithi079.stdout: 3 Oct 19:08:30 ntpd[27841]: ntp-4 is maintained by Network Time Foundation, 2023-10-03T19:08:30.036 INFO:teuthology.orchestra.run.smithi079.stdout: 3 Oct 19:08:30 ntpd[27841]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-10-03T19:08:30.036 INFO:teuthology.orchestra.run.smithi079.stdout: 3 Oct 19:08:30 ntpd[27841]: corporation. Support and training for ntp-4 are 2023-10-03T19:08:30.037 INFO:teuthology.orchestra.run.smithi079.stdout: 3 Oct 19:08:30 ntpd[27841]: available at https://www.nwtime.org/support 2023-10-03T19:08:30.037 INFO:teuthology.orchestra.run.smithi079.stdout: 3 Oct 19:08:30 ntpd[27841]: ---------------------------------------------------- 2023-10-03T19:08:30.037 INFO:teuthology.orchestra.run.smithi079.stdout: 3 Oct 19:08:30 ntpd[27841]: proto: precision = 0.061 usec (-24) 2023-10-03T19:08:30.037 INFO:teuthology.orchestra.run.smithi079.stdout: 3 Oct 19:08:30 ntpd[27841]: basedate set to 2022-02-04 2023-10-03T19:08:30.037 INFO:teuthology.orchestra.run.smithi079.stdout: 3 Oct 19:08:30 ntpd[27841]: gps base set to 2022-02-06 (week 2196) 2023-10-03T19:08:30.038 INFO:teuthology.orchestra.run.smithi079.stdout: 3 Oct 19:08:30 ntpd[27841]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-03T19:08:30.038 INFO:teuthology.orchestra.run.smithi079.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-03T19:08:30.038 INFO:teuthology.orchestra.run.smithi079.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-03T19:08:30.039 INFO:teuthology.orchestra.run.smithi079.stdout: 3 Oct 19:08:30 ntpd[27841]: restrict ::: KOD does nothing without LIMITED. 2023-10-03T19:08:30.039 INFO:teuthology.orchestra.run.smithi079.stdout: 3 Oct 19:08:30 ntpd[27841]: Listen and drop on 0 v6wildcard [::]:123 2023-10-03T19:08:30.040 INFO:teuthology.orchestra.run.smithi079.stdout: 3 Oct 19:08:30 ntpd[27841]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-03T19:08:30.040 INFO:teuthology.orchestra.run.smithi079.stdout: 3 Oct 19:08:30 ntpd[27841]: Listen normally on 2 lo 127.0.0.1:123 2023-10-03T19:08:30.040 INFO:teuthology.orchestra.run.smithi079.stdout: 3 Oct 19:08:30 ntpd[27841]: Listen normally on 3 enp3s0f1 172.21.15.79:123 2023-10-03T19:08:30.040 INFO:teuthology.orchestra.run.smithi079.stdout: 3 Oct 19:08:30 ntpd[27841]: Listen normally on 4 lo [::1]:123 2023-10-03T19:08:30.040 INFO:teuthology.orchestra.run.smithi079.stdout: 3 Oct 19:08:30 ntpd[27841]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce87%5]:123 2023-10-03T19:08:30.040 INFO:teuthology.orchestra.run.smithi079.stdout: 3 Oct 19:08:30 ntpd[27841]: Listening on routing socket on fd #22 for interface updates 2023-10-03T19:08:30.041 INFO:teuthology.orchestra.run.smithi045.stdout: 3 Oct 19:08:30 ntpd[27760]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-10-03T19:08:30.041 INFO:teuthology.orchestra.run.smithi045.stdout: 3 Oct 19:08:30 ntpd[27760]: Command line: ntpd -gq 2023-10-03T19:08:30.042 INFO:teuthology.orchestra.run.smithi045.stdout: 3 Oct 19:08:30 ntpd[27760]: ---------------------------------------------------- 2023-10-03T19:08:30.042 INFO:teuthology.orchestra.run.smithi045.stdout: 3 Oct 19:08:30 ntpd[27760]: ntp-4 is maintained by Network Time Foundation, 2023-10-03T19:08:30.042 INFO:teuthology.orchestra.run.smithi045.stdout: 3 Oct 19:08:30 ntpd[27760]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-10-03T19:08:30.042 INFO:teuthology.orchestra.run.smithi045.stdout: 3 Oct 19:08:30 ntpd[27760]: corporation. Support and training for ntp-4 are 2023-10-03T19:08:30.042 INFO:teuthology.orchestra.run.smithi045.stdout: 3 Oct 19:08:30 ntpd[27760]: available at https://www.nwtime.org/support 2023-10-03T19:08:30.042 INFO:teuthology.orchestra.run.smithi045.stdout: 3 Oct 19:08:30 ntpd[27760]: ---------------------------------------------------- 2023-10-03T19:08:30.042 INFO:teuthology.orchestra.run.smithi045.stdout: 3 Oct 19:08:30 ntpd[27760]: proto: precision = 0.074 usec (-24) 2023-10-03T19:08:30.043 INFO:teuthology.orchestra.run.smithi045.stdout: 3 Oct 19:08:30 ntpd[27760]: basedate set to 2022-02-04 2023-10-03T19:08:30.043 INFO:teuthology.orchestra.run.smithi045.stdout: 3 Oct 19:08:30 ntpd[27760]: gps base set to 2022-02-06 (week 2196) 2023-10-03T19:08:30.043 INFO:teuthology.orchestra.run.smithi045.stdout: 3 Oct 19:08:30 ntpd[27760]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-03T19:08:30.043 INFO:teuthology.orchestra.run.smithi045.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-03T19:08:30.043 INFO:teuthology.orchestra.run.smithi045.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-03T19:08:30.044 INFO:teuthology.orchestra.run.smithi045.stdout: 3 Oct 19:08:30 ntpd[27760]: restrict ::: KOD does nothing without LIMITED. 2023-10-03T19:08:30.044 INFO:teuthology.orchestra.run.smithi045.stdout: 3 Oct 19:08:30 ntpd[27760]: Listen and drop on 0 v6wildcard [::]:123 2023-10-03T19:08:30.045 INFO:teuthology.orchestra.run.smithi045.stdout: 3 Oct 19:08:30 ntpd[27760]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-03T19:08:30.045 INFO:teuthology.orchestra.run.smithi045.stdout: 3 Oct 19:08:30 ntpd[27760]: Listen normally on 2 lo 127.0.0.1:123 2023-10-03T19:08:30.045 INFO:teuthology.orchestra.run.smithi045.stdout: 3 Oct 19:08:30 ntpd[27760]: Listen normally on 3 ens1f0 172.21.15.45:123 2023-10-03T19:08:30.045 INFO:teuthology.orchestra.run.smithi045.stdout: 3 Oct 19:08:30 ntpd[27760]: Listen normally on 4 lo [::1]:123 2023-10-03T19:08:30.045 INFO:teuthology.orchestra.run.smithi045.stdout: 3 Oct 19:08:30 ntpd[27760]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:12be%4]:123 2023-10-03T19:08:30.045 INFO:teuthology.orchestra.run.smithi045.stdout: 3 Oct 19:08:30 ntpd[27760]: Listening on routing socket on fd #22 for interface updates 2023-10-03T19:08:30.046 INFO:teuthology.orchestra.run.smithi146.stdout: 3 Oct 19:08:30 ntpd[27864]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-10-03T19:08:30.046 INFO:teuthology.orchestra.run.smithi146.stdout: 3 Oct 19:08:30 ntpd[27864]: Command line: ntpd -gq 2023-10-03T19:08:30.047 INFO:teuthology.orchestra.run.smithi146.stdout: 3 Oct 19:08:30 ntpd[27864]: ---------------------------------------------------- 2023-10-03T19:08:30.047 INFO:teuthology.orchestra.run.smithi146.stdout: 3 Oct 19:08:30 ntpd[27864]: ntp-4 is maintained by Network Time Foundation, 2023-10-03T19:08:30.047 INFO:teuthology.orchestra.run.smithi146.stdout: 3 Oct 19:08:30 ntpd[27864]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-10-03T19:08:30.047 INFO:teuthology.orchestra.run.smithi146.stdout: 3 Oct 19:08:30 ntpd[27864]: corporation. Support and training for ntp-4 are 2023-10-03T19:08:30.047 INFO:teuthology.orchestra.run.smithi146.stdout: 3 Oct 19:08:30 ntpd[27864]: available at https://www.nwtime.org/support 2023-10-03T19:08:30.047 INFO:teuthology.orchestra.run.smithi146.stdout: 3 Oct 19:08:30 ntpd[27864]: ---------------------------------------------------- 2023-10-03T19:08:30.047 INFO:teuthology.orchestra.run.smithi146.stdout: 3 Oct 19:08:30 ntpd[27864]: proto: precision = 0.045 usec (-24) 2023-10-03T19:08:30.047 INFO:teuthology.orchestra.run.smithi146.stdout: 3 Oct 19:08:30 ntpd[27864]: basedate set to 2022-02-04 2023-10-03T19:08:30.047 INFO:teuthology.orchestra.run.smithi146.stdout: 3 Oct 19:08:30 ntpd[27864]: gps base set to 2022-02-06 (week 2196) 2023-10-03T19:08:30.047 INFO:teuthology.orchestra.run.smithi146.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-03T19:08:30.048 INFO:teuthology.orchestra.run.smithi146.stdout: 3 Oct 19:08:30 ntpd[27864]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-03T19:08:30.048 INFO:teuthology.orchestra.run.smithi146.stdout: 3 Oct 19:08:30 ntpd[27864]: restrict ::: KOD does nothing without LIMITED. 2023-10-03T19:08:30.048 INFO:teuthology.orchestra.run.smithi146.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-03T19:08:30.049 INFO:teuthology.orchestra.run.smithi146.stdout: 3 Oct 19:08:30 ntpd[27864]: Listen and drop on 0 v6wildcard [::]:123 2023-10-03T19:08:30.049 INFO:teuthology.orchestra.run.smithi146.stdout: 3 Oct 19:08:30 ntpd[27864]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-03T19:08:30.049 INFO:teuthology.orchestra.run.smithi146.stdout: 3 Oct 19:08:30 ntpd[27864]: Listen normally on 2 lo 127.0.0.1:123 2023-10-03T19:08:30.049 INFO:teuthology.orchestra.run.smithi146.stdout: 3 Oct 19:08:30 ntpd[27864]: Listen normally on 3 enp3s0f1 172.21.15.146:123 2023-10-03T19:08:30.049 INFO:teuthology.orchestra.run.smithi146.stdout: 3 Oct 19:08:30 ntpd[27864]: Listen normally on 4 lo [::1]:123 2023-10-03T19:08:30.049 INFO:teuthology.orchestra.run.smithi146.stdout: 3 Oct 19:08:30 ntpd[27864]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:76fd%5]:123 2023-10-03T19:08:30.049 INFO:teuthology.orchestra.run.smithi146.stdout: 3 Oct 19:08:30 ntpd[27864]: Listening on routing socket on fd #22 for interface updates 2023-10-03T19:08:30.067 INFO:teuthology.orchestra.run.smithi172.stdout: 3 Oct 19:08:30 ntpd[27827]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-10-03T19:08:30.067 INFO:teuthology.orchestra.run.smithi172.stdout: 3 Oct 19:08:30 ntpd[27827]: Command line: ntpd -gq 2023-10-03T19:08:30.067 INFO:teuthology.orchestra.run.smithi172.stdout: 3 Oct 19:08:30 ntpd[27827]: ---------------------------------------------------- 2023-10-03T19:08:30.067 INFO:teuthology.orchestra.run.smithi172.stdout: 3 Oct 19:08:30 ntpd[27827]: ntp-4 is maintained by Network Time Foundation, 2023-10-03T19:08:30.068 INFO:teuthology.orchestra.run.smithi172.stdout: 3 Oct 19:08:30 ntpd[27827]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-10-03T19:08:30.068 INFO:teuthology.orchestra.run.smithi172.stdout: 3 Oct 19:08:30 ntpd[27827]: corporation. Support and training for ntp-4 are 2023-10-03T19:08:30.068 INFO:teuthology.orchestra.run.smithi172.stdout: 3 Oct 19:08:30 ntpd[27827]: available at https://www.nwtime.org/support 2023-10-03T19:08:30.068 INFO:teuthology.orchestra.run.smithi172.stdout: 3 Oct 19:08:30 ntpd[27827]: ---------------------------------------------------- 2023-10-03T19:08:30.069 INFO:teuthology.orchestra.run.smithi172.stdout: 3 Oct 19:08:30 ntpd[27827]: proto: precision = 0.059 usec (-24) 2023-10-03T19:08:30.069 INFO:teuthology.orchestra.run.smithi172.stdout: 3 Oct 19:08:30 ntpd[27827]: basedate set to 2022-02-04 2023-10-03T19:08:30.069 INFO:teuthology.orchestra.run.smithi172.stdout: 3 Oct 19:08:30 ntpd[27827]: gps base set to 2022-02-06 (week 2196) 2023-10-03T19:08:30.069 INFO:teuthology.orchestra.run.smithi172.stdout: 3 Oct 19:08:30 ntpd[27827]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-03T19:08:30.069 INFO:teuthology.orchestra.run.smithi172.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-03T19:08:30.069 INFO:teuthology.orchestra.run.smithi172.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-03T19:08:30.070 INFO:teuthology.orchestra.run.smithi172.stdout: 3 Oct 19:08:30 ntpd[27827]: restrict ::: KOD does nothing without LIMITED. 2023-10-03T19:08:30.070 INFO:teuthology.orchestra.run.smithi172.stdout: 3 Oct 19:08:30 ntpd[27827]: Listen and drop on 0 v6wildcard [::]:123 2023-10-03T19:08:30.071 INFO:teuthology.orchestra.run.smithi172.stdout: 3 Oct 19:08:30 ntpd[27827]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-03T19:08:30.071 INFO:teuthology.orchestra.run.smithi172.stdout: 3 Oct 19:08:30 ntpd[27827]: Listen normally on 2 lo 127.0.0.1:123 2023-10-03T19:08:30.071 INFO:teuthology.orchestra.run.smithi172.stdout: 3 Oct 19:08:30 ntpd[27827]: Listen normally on 3 enp3s0f1 172.21.15.172:123 2023-10-03T19:08:30.071 INFO:teuthology.orchestra.run.smithi172.stdout: 3 Oct 19:08:30 ntpd[27827]: Listen normally on 4 lo [::1]:123 2023-10-03T19:08:30.071 INFO:teuthology.orchestra.run.smithi172.stdout: 3 Oct 19:08:30 ntpd[27827]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f91%5]:123 2023-10-03T19:08:30.071 INFO:teuthology.orchestra.run.smithi172.stdout: 3 Oct 19:08:30 ntpd[27827]: Listening on routing socket on fd #22 for interface updates 2023-10-03T19:08:31.036 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:31 ntpd[27841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:31.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:31 ntpd[27841]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:31.039 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:31 ntpd[27760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:31.039 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:31 ntpd[27760]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:31.040 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:31 ntpd[27760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:31.040 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:31 ntpd[27760]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:31.040 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:31 ntpd[27760]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:31.040 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:31 ntpd[27760]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:32.042 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:32 ntpd[27864]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:32.080 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:32 ntpd[27864]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:32.080 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:32 ntpd[27864]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:32.080 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:32 ntpd[27864]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:32.080 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:32 ntpd[27864]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:32.081 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:32 ntpd[27864]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:32.082 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:32 ntpd[27827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:32.082 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:32 ntpd[27827]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:32.082 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:32 ntpd[27827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:32.082 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:32 ntpd[27827]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:32.082 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:32 ntpd[27827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:32.082 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:32 ntpd[27827]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:32.082 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:32 ntpd[27827]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:32.082 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:32 ntpd[27827]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:32.083 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:32 ntpd[27827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:32.083 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:32 ntpd[27827]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:32.083 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:32 ntpd[27827]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:32.083 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:32 ntpd[27827]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:33.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:33 ntpd[27841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:33.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:33 ntpd[27841]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:33.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:33 ntpd[27841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:33.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:33 ntpd[27841]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:33.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:33 ntpd[27841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:33.038 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:33 ntpd[27841]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:33.038 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:33 ntpd[27841]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:33.038 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:33 ntpd[27841]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:33.038 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:33 ntpd[27841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:33.038 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:33 ntpd[27841]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:33.038 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:33 ntpd[27841]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:33.038 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:33 ntpd[27841]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:33.039 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:33 ntpd[27760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:33.039 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:33 ntpd[27760]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:33.040 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:33 ntpd[27760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:33.040 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:33 ntpd[27760]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:33.040 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:33 ntpd[27760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:33.040 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:33 ntpd[27760]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:33.040 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:33 ntpd[27760]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:33.040 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:33 ntpd[27760]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:34.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:34 ntpd[27841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:34.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:34 ntpd[27841]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:34.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:34 ntpd[27841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:34.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:34 ntpd[27841]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:34.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:34 ntpd[27841]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:34.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:34 ntpd[27841]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:34.038 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:34 ntpd[27760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:34.039 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:34 ntpd[27760]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:34.039 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:34 ntpd[27760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:34.039 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:34 ntpd[27760]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:34.039 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:34 ntpd[27760]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:34.039 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:34 ntpd[27760]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:34.042 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:34 ntpd[27864]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:34.042 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:34 ntpd[27864]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:34.042 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:34 ntpd[27864]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:34.042 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:34 ntpd[27864]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:34.042 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:34 ntpd[27864]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:34.043 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:34 ntpd[27864]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:34.043 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:34 ntpd[27864]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:34.043 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:34 ntpd[27864]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:34.043 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:34 ntpd[27864]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:34.043 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:34 ntpd[27864]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:34.043 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:34 ntpd[27864]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:34.043 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:34 ntpd[27864]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:34.068 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:34 ntpd[27827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:34.068 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:34 ntpd[27827]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:34.069 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:34 ntpd[27827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:34.069 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:34 ntpd[27827]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:34.069 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:34 ntpd[27827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:34.069 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:34 ntpd[27827]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:34.069 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:34 ntpd[27827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:34.069 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:34 ntpd[27827]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:34.069 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:34 ntpd[27827]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:34.069 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:34 ntpd[27827]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:34.069 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:34 ntpd[27827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:34.069 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:34 ntpd[27827]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:34.069 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:34 ntpd[27827]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:34.069 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:34 ntpd[27827]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:35.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:35 ntpd[27841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:35.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:35 ntpd[27841]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:35.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:35 ntpd[27841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:35.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:35 ntpd[27841]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:35.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:35 ntpd[27841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:35.038 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:35 ntpd[27841]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:35.038 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:35 ntpd[27841]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:35.038 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:35 ntpd[27841]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:35.038 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:35 ntpd[27841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:35.038 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:35 ntpd[27841]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:35.038 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:35 ntpd[27841]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:35.038 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:35 ntpd[27841]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:35.039 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:35 ntpd[27760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:35.040 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:35 ntpd[27760]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:35.040 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:35 ntpd[27760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:35.040 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:35 ntpd[27760]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:35.040 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:35 ntpd[27760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:35.040 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:35 ntpd[27760]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:35.040 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:35 ntpd[27760]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:35.040 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:35 ntpd[27760]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:35.040 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:35 ntpd[27760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:35.040 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:35 ntpd[27760]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:35.040 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:35 ntpd[27760]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:35.040 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:35 ntpd[27760]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:35.042 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:35 ntpd[27864]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:35.042 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:35 ntpd[27864]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:35.042 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:35 ntpd[27864]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:35.042 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:35 ntpd[27864]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:35.042 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:35 ntpd[27864]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:35.042 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:35 ntpd[27864]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:35.042 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:35 ntpd[27864]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:35.043 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:35 ntpd[27864]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:35.068 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:35 ntpd[27827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:35.068 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:35 ntpd[27827]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:35.068 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:35 ntpd[27827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:35.068 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:35 ntpd[27827]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:35.068 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:35 ntpd[27827]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:35.068 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:35 ntpd[27827]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:36.036 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:36 ntpd[27841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:36.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:36 ntpd[27841]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:36.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:36 ntpd[27841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:36.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:36 ntpd[27841]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:36.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:36 ntpd[27841]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:36.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:36 ntpd[27841]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:36.039 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:36 ntpd[27760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:36.039 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:36 ntpd[27760]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:36.039 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:36 ntpd[27760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:36.039 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:36 ntpd[27760]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:36.039 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:36 ntpd[27760]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:36.039 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:36 ntpd[27760]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:36.042 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:36 ntpd[27864]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:36.042 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:36 ntpd[27864]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:36.042 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:36 ntpd[27864]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:36.042 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:36 ntpd[27864]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:36.043 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:36 ntpd[27864]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:36.043 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:36 ntpd[27864]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:36.043 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:36 ntpd[27864]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:36.043 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:36 ntpd[27864]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:36.043 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:36 ntpd[27864]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:36.043 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:36 ntpd[27864]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:36.043 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:36 ntpd[27864]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:36.043 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:36 ntpd[27864]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:36.068 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:36 ntpd[27827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:36.068 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:36 ntpd[27827]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:36.068 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:36 ntpd[27827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:36.069 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:36 ntpd[27827]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:36.069 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:36 ntpd[27827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:36.069 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:36 ntpd[27827]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:36.069 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:36 ntpd[27827]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:36.069 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:36 ntpd[27827]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:36.069 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:36 ntpd[27827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:36.069 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:36 ntpd[27827]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:36.069 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:36 ntpd[27827]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:36.069 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:36 ntpd[27827]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:37.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:37 ntpd[27841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:37.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:37 ntpd[27841]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:37.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:37 ntpd[27841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:37.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:37 ntpd[27841]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:37.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:37 ntpd[27841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:37.038 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:37 ntpd[27841]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:37.038 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:37 ntpd[27841]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:37.038 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:37 ntpd[27841]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:37.038 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:37 ntpd[27841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:37.038 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:37 ntpd[27841]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:37.038 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:37 ntpd[27841]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:37.038 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:37 ntpd[27841]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:37.039 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:37 ntpd[27760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:37.039 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:37 ntpd[27760]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:37.039 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:37 ntpd[27760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:37.039 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:37 ntpd[27760]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:37.040 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:37 ntpd[27760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:37.040 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:37 ntpd[27760]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:37.040 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:37 ntpd[27760]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:37.040 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:37 ntpd[27760]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:37.040 INFO:teuthology.orchestra.run.smithi045.stdout: 3 Oct 19:08:37 ntpd[27760]: ntpd: time slew -0.000243 s 2023-10-03T19:08:37.041 INFO:teuthology.orchestra.run.smithi045.stdout:ntpd: time slew -0.000243s 2023-10-03T19:08:37.041 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:37 ntpd[27760]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-03T19:08:37.041 INFO:teuthology.orchestra.run.smithi045.stderr: 3 Oct 19:08:37 ntpd[27760]: can't open /var/log/ntpstats/loopstats.20231003: Permission denied 2023-10-03T19:08:37.042 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:37 ntpd[27864]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:37.042 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:37 ntpd[27864]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:37.042 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:37 ntpd[27864]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:37.042 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:37 ntpd[27864]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:37.042 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:37 ntpd[27864]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:37.042 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:37 ntpd[27864]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:37.068 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:37 ntpd[27827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:37.068 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:37 ntpd[27827]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:37.068 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:37 ntpd[27827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:37.068 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:37 ntpd[27827]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:37.068 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:37 ntpd[27827]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:37.068 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:37 ntpd[27827]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:37.116 INFO:teuthology.orchestra.run.smithi045.stdout: remote refid st t when poll reach delay offset jitter 2023-10-03T19:08:37.116 INFO:teuthology.orchestra.run.smithi045.stdout:============================================================================== 2023-10-03T19:08:37.116 INFO:teuthology.orchestra.run.smithi045.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-03T19:08:37.116 INFO:teuthology.orchestra.run.smithi045.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-03T19:08:37.117 INFO:teuthology.orchestra.run.smithi045.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-03T19:08:37.117 INFO:teuthology.orchestra.run.smithi045.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-03T19:08:38.036 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:38 ntpd[27841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:38.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:38 ntpd[27841]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:38.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:38 ntpd[27841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:38.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:38 ntpd[27841]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:38.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:38 ntpd[27841]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:38.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:38 ntpd[27841]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:38.042 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:38 ntpd[27864]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:38.042 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:38 ntpd[27864]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:38.042 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:38 ntpd[27864]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:38.042 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:38 ntpd[27864]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:38.042 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:38 ntpd[27864]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:38.043 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:38 ntpd[27864]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:38.043 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:38 ntpd[27864]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:38.043 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:38 ntpd[27864]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:38.043 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:38 ntpd[27864]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:38.043 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:38 ntpd[27864]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:38.043 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:38 ntpd[27864]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:38.043 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:38 ntpd[27864]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:38.043 INFO:teuthology.orchestra.run.smithi146.stdout: 3 Oct 19:08:38 ntpd[27864]: ntpd: time slew -0.003601 s 2023-10-03T19:08:38.043 INFO:teuthology.orchestra.run.smithi146.stdout:ntpd: time slew -0.003601s 2023-10-03T19:08:38.044 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:38 ntpd[27864]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-03T19:08:38.044 INFO:teuthology.orchestra.run.smithi146.stderr: 3 Oct 19:08:38 ntpd[27864]: can't open /var/log/ntpstats/loopstats.20231003: Permission denied 2023-10-03T19:08:38.068 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:38 ntpd[27827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:38.068 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:38 ntpd[27827]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:38.068 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:38 ntpd[27827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:38.068 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:38 ntpd[27827]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:38.068 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:38 ntpd[27827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:38.068 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:38 ntpd[27827]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:38.069 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:38 ntpd[27827]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:38.069 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:38 ntpd[27827]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:38.069 INFO:teuthology.orchestra.run.smithi172.stdout: 3 Oct 19:08:38 ntpd[27827]: ntpd: time slew -0.002172 s 2023-10-03T19:08:38.069 INFO:teuthology.orchestra.run.smithi172.stdout:ntpd: time slew -0.002172s 2023-10-03T19:08:38.069 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:38 ntpd[27827]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-03T19:08:38.069 INFO:teuthology.orchestra.run.smithi172.stderr: 3 Oct 19:08:38 ntpd[27827]: can't open /var/log/ntpstats/loopstats.20231003: Permission denied 2023-10-03T19:08:38.135 INFO:teuthology.orchestra.run.smithi146.stdout: remote refid st t when poll reach delay offset jitter 2023-10-03T19:08:38.136 INFO:teuthology.orchestra.run.smithi146.stdout:============================================================================== 2023-10-03T19:08:38.136 INFO:teuthology.orchestra.run.smithi146.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-03T19:08:38.136 INFO:teuthology.orchestra.run.smithi146.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-03T19:08:38.136 INFO:teuthology.orchestra.run.smithi146.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-03T19:08:38.136 INFO:teuthology.orchestra.run.smithi146.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-03T19:08:38.162 INFO:teuthology.orchestra.run.smithi172.stdout: remote refid st t when poll reach delay offset jitter 2023-10-03T19:08:38.163 INFO:teuthology.orchestra.run.smithi172.stdout:============================================================================== 2023-10-03T19:08:38.163 INFO:teuthology.orchestra.run.smithi172.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-03T19:08:38.163 INFO:teuthology.orchestra.run.smithi172.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-03T19:08:38.163 INFO:teuthology.orchestra.run.smithi172.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-03T19:08:38.163 INFO:teuthology.orchestra.run.smithi172.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-03T19:08:39.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:39 ntpd[27841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:39.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:39 ntpd[27841]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:39.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:39 ntpd[27841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:39.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:39 ntpd[27841]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:39.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:39 ntpd[27841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-03T19:08:39.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:39 ntpd[27841]: can't open /var/log/ntpstats/rawstats.20231003: Permission denied 2023-10-03T19:08:39.037 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:39 ntpd[27841]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-03T19:08:39.038 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:39 ntpd[27841]: can't open /var/log/ntpstats/peerstats.20231003: Permission denied 2023-10-03T19:08:39.038 INFO:teuthology.orchestra.run.smithi079.stdout: 3 Oct 19:08:39 ntpd[27841]: ntpd: time slew -0.005020 s 2023-10-03T19:08:39.038 INFO:teuthology.orchestra.run.smithi079.stdout:ntpd: time slew -0.005020s 2023-10-03T19:08:39.039 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:39 ntpd[27841]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-03T19:08:39.039 INFO:teuthology.orchestra.run.smithi079.stderr: 3 Oct 19:08:39 ntpd[27841]: can't open /var/log/ntpstats/loopstats.20231003: Permission denied 2023-10-03T19:08:39.139 INFO:teuthology.orchestra.run.smithi079.stdout: remote refid st t when poll reach delay offset jitter 2023-10-03T19:08:39.139 INFO:teuthology.orchestra.run.smithi079.stdout:============================================================================== 2023-10-03T19:08:39.140 INFO:teuthology.orchestra.run.smithi079.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-03T19:08:39.140 INFO:teuthology.orchestra.run.smithi079.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-03T19:08:39.140 INFO:teuthology.orchestra.run.smithi079.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-03T19:08:39.140 INFO:teuthology.orchestra.run.smithi079.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-03T19:08:39.141 INFO:teuthology.run_tasks:Running task install... 2023-10-03T19:08:39.151 DEBUG:teuthology.task.install:project ceph 2023-10-03T19:08:39.151 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '05a43c8fb3988914c879a50970f9054a098e0612'}} 2023-10-03T19:08:39.151 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '05a43c8fb3988914c879a50970f9054a098e0612'} 2023-10-03T19:08:39.152 INFO:teuthology.task.install:Using flavor: default 2023-10-03T19:08:39.157 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-03T19:08:39.157 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-03T19:08:39.158 DEBUG:teuthology.orchestra.run.smithi045:> sudo apt-key list | grep Ceph 2023-10-03T19:08:39.159 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-key list | grep Ceph 2023-10-03T19:08:39.159 DEBUG:teuthology.orchestra.run.smithi146:> sudo apt-key list | grep Ceph 2023-10-03T19:08:39.159 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-key list | grep Ceph 2023-10-03T19:08:39.219 INFO:teuthology.orchestra.run.smithi146.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-10-03T19:08:39.222 INFO:teuthology.orchestra.run.smithi172.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-10-03T19:08:39.225 INFO:teuthology.orchestra.run.smithi045.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-10-03T19:08:39.240 INFO:teuthology.orchestra.run.smithi079.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-10-03T19:08:39.246 INFO:teuthology.orchestra.run.smithi146.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-03T19:08:39.246 INFO:teuthology.orchestra.run.smithi146.stdout:uid [ unknown] Ceph.com (release key) 2023-10-03T19:08:39.247 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-03T19:08:39.247 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-10-03T19:08:39.247 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=05a43c8fb3988914c879a50970f9054a098e0612 2023-10-03T19:08:39.270 INFO:teuthology.orchestra.run.smithi079.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-03T19:08:39.270 INFO:teuthology.orchestra.run.smithi079.stdout:uid [ unknown] Ceph.com (release key) 2023-10-03T19:08:39.270 INFO:teuthology.orchestra.run.smithi045.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-03T19:08:39.270 INFO:teuthology.orchestra.run.smithi045.stdout:uid [ unknown] Ceph.com (release key) 2023-10-03T19:08:39.270 INFO:teuthology.orchestra.run.smithi172.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-03T19:08:39.270 INFO:teuthology.orchestra.run.smithi172.stdout:uid [ unknown] Ceph.com (release key) 2023-10-03T19:08:39.271 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-03T19:08:39.271 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-10-03T19:08:39.271 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=05a43c8fb3988914c879a50970f9054a098e0612 2023-10-03T19:08:39.272 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-03T19:08:39.272 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-10-03T19:08:39.273 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=05a43c8fb3988914c879a50970f9054a098e0612 2023-10-03T19:08:39.274 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-03T19:08:39.274 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-10-03T19:08:39.274 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=05a43c8fb3988914c879a50970f9054a098e0612 2023-10-03T19:08:39.410 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default/ 2023-10-03T19:08:39.410 INFO:teuthology.task.install.deb:Package version is 18.0.0-3908-g05a43c8f-1jammy 2023-10-03T19:08:39.424 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default/ 2023-10-03T19:08:39.425 INFO:teuthology.task.install.deb:Package version is 18.0.0-3908-g05a43c8f-1jammy 2023-10-03T19:08:39.490 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default/ 2023-10-03T19:08:39.490 INFO:teuthology.task.install.deb:Package version is 18.0.0-3908-g05a43c8f-1jammy 2023-10-03T19:08:39.503 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default/ 2023-10-03T19:08:39.503 INFO:teuthology.task.install.deb:Package version is 18.0.0-3908-g05a43c8f-1jammy 2023-10-03T19:08:39.713 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:08:39.713 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-03T19:08:39.729 DEBUG:teuthology.orchestra.run.smithi146:> sudo apt-get update 2023-10-03T19:08:39.729 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-03T19:08:39.730 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-03T19:08:39.743 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-get update 2023-10-03T19:08:39.819 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-03T19:08:39.819 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-03T19:08:39.832 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get update 2023-10-03T19:08:39.872 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-03T19:08:39.872 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-03T19:08:39.886 DEBUG:teuthology.orchestra.run.smithi045:> sudo apt-get update 2023-10-03T19:08:39.907 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-03T19:08:39.908 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-10-03T19:08:39.917 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-10-03T19:08:39.934 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-03T19:08:40.028 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-03T19:08:40.028 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-10-03T19:08:40.057 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-10-03T19:08:40.100 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-10-03T19:08:40.126 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-03T19:08:40.126 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-10-03T19:08:40.126 INFO:teuthology.orchestra.run.smithi079.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy InRelease 2023-10-03T19:08:40.132 INFO:teuthology.orchestra.run.smithi146.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy InRelease 2023-10-03T19:08:40.156 INFO:teuthology.orchestra.run.smithi172.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy InRelease 2023-10-03T19:08:40.177 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-03T19:08:40.182 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-03T19:08:40.182 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-10-03T19:08:40.199 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-10-03T19:08:40.203 INFO:teuthology.orchestra.run.smithi146.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-10-03T19:08:40.226 INFO:teuthology.orchestra.run.smithi172.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-10-03T19:08:40.239 INFO:teuthology.orchestra.run.smithi079.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy Release.gpg 2023-10-03T19:08:40.259 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-10-03T19:08:40.275 INFO:teuthology.orchestra.run.smithi146.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy Release.gpg 2023-10-03T19:08:40.280 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-03T19:08:40.295 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,405 B] 2023-10-03T19:08:40.299 INFO:teuthology.orchestra.run.smithi172.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy Release.gpg 2023-10-03T19:08:40.303 INFO:teuthology.orchestra.run.smithi045.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy InRelease 2023-10-03T19:08:40.340 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-03T19:08:40.346 INFO:teuthology.orchestra.run.smithi146.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,405 B] 2023-10-03T19:08:40.358 INFO:teuthology.orchestra.run.smithi079.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-10-03T19:08:40.370 INFO:teuthology.orchestra.run.smithi172.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-10-03T19:08:40.375 INFO:teuthology.orchestra.run.smithi045.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-10-03T19:08:40.424 INFO:teuthology.orchestra.run.smithi146.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-10-03T19:08:40.449 INFO:teuthology.orchestra.run.smithi045.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy Release.gpg 2023-10-03T19:08:40.452 INFO:teuthology.orchestra.run.smithi172.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,405 B] 2023-10-03T19:08:40.496 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 28.5 kB in 0s (58.5 kB/s) 2023-10-03T19:08:40.517 INFO:teuthology.orchestra.run.smithi146.stdout:Fetched 28.5 kB in 1s (48.2 kB/s) 2023-10-03T19:08:40.520 INFO:teuthology.orchestra.run.smithi045.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,405 B] 2023-10-03T19:08:40.535 INFO:teuthology.orchestra.run.smithi172.stdout:Fetched 28.5 kB in 1s (47.2 kB/s) 2023-10-03T19:08:40.603 INFO:teuthology.orchestra.run.smithi045.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-10-03T19:08:40.704 INFO:teuthology.orchestra.run.smithi045.stdout:Fetched 28.5 kB in 1s (46.6 kB/s) 2023-10-03T19:08:41.354 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2023-10-03T19:08:41.371 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-3908-g05a43c8f-1jammy cephadm=18.0.0-3908-g05a43c8f-1jammy ceph-mds=18.0.0-3908-g05a43c8f-1jammy ceph-mgr=18.0.0-3908-g05a43c8f-1jammy ceph-common=18.0.0-3908-g05a43c8f-1jammy ceph-fuse=18.0.0-3908-g05a43c8f-1jammy ceph-test=18.0.0-3908-g05a43c8f-1jammy ceph-volume=18.0.0-3908-g05a43c8f-1jammy radosgw=18.0.0-3908-g05a43c8f-1jammy python3-rados=18.0.0-3908-g05a43c8f-1jammy python3-rgw=18.0.0-3908-g05a43c8f-1jammy python3-cephfs=18.0.0-3908-g05a43c8f-1jammy python3-rbd=18.0.0-3908-g05a43c8f-1jammy libcephfs2=18.0.0-3908-g05a43c8f-1jammy libcephfs-dev=18.0.0-3908-g05a43c8f-1jammy librados2=18.0.0-3908-g05a43c8f-1jammy librbd1=18.0.0-3908-g05a43c8f-1jammy rbd-fuse=18.0.0-3908-g05a43c8f-1jammy python3-cephfs=18.0.0-3908-g05a43c8f-1jammy cephfs-shell=18.0.0-3908-g05a43c8f-1jammy cephfs-top=18.0.0-3908-g05a43c8f-1jammy cephfs-mirror=18.0.0-3908-g05a43c8f-1jammy 2023-10-03T19:08:41.395 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2023-10-03T19:08:41.404 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-10-03T19:08:41.411 DEBUG:teuthology.orchestra.run.smithi172:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-3908-g05a43c8f-1jammy cephadm=18.0.0-3908-g05a43c8f-1jammy ceph-mds=18.0.0-3908-g05a43c8f-1jammy ceph-mgr=18.0.0-3908-g05a43c8f-1jammy ceph-common=18.0.0-3908-g05a43c8f-1jammy ceph-fuse=18.0.0-3908-g05a43c8f-1jammy ceph-test=18.0.0-3908-g05a43c8f-1jammy ceph-volume=18.0.0-3908-g05a43c8f-1jammy radosgw=18.0.0-3908-g05a43c8f-1jammy python3-rados=18.0.0-3908-g05a43c8f-1jammy python3-rgw=18.0.0-3908-g05a43c8f-1jammy python3-cephfs=18.0.0-3908-g05a43c8f-1jammy python3-rbd=18.0.0-3908-g05a43c8f-1jammy libcephfs2=18.0.0-3908-g05a43c8f-1jammy libcephfs-dev=18.0.0-3908-g05a43c8f-1jammy librados2=18.0.0-3908-g05a43c8f-1jammy librbd1=18.0.0-3908-g05a43c8f-1jammy rbd-fuse=18.0.0-3908-g05a43c8f-1jammy python3-cephfs=18.0.0-3908-g05a43c8f-1jammy cephfs-shell=18.0.0-3908-g05a43c8f-1jammy cephfs-top=18.0.0-3908-g05a43c8f-1jammy cephfs-mirror=18.0.0-3908-g05a43c8f-1jammy 2023-10-03T19:08:41.419 DEBUG:teuthology.orchestra.run.smithi146:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-3908-g05a43c8f-1jammy cephadm=18.0.0-3908-g05a43c8f-1jammy ceph-mds=18.0.0-3908-g05a43c8f-1jammy ceph-mgr=18.0.0-3908-g05a43c8f-1jammy ceph-common=18.0.0-3908-g05a43c8f-1jammy ceph-fuse=18.0.0-3908-g05a43c8f-1jammy ceph-test=18.0.0-3908-g05a43c8f-1jammy ceph-volume=18.0.0-3908-g05a43c8f-1jammy radosgw=18.0.0-3908-g05a43c8f-1jammy python3-rados=18.0.0-3908-g05a43c8f-1jammy python3-rgw=18.0.0-3908-g05a43c8f-1jammy python3-cephfs=18.0.0-3908-g05a43c8f-1jammy python3-rbd=18.0.0-3908-g05a43c8f-1jammy libcephfs2=18.0.0-3908-g05a43c8f-1jammy libcephfs-dev=18.0.0-3908-g05a43c8f-1jammy librados2=18.0.0-3908-g05a43c8f-1jammy librbd1=18.0.0-3908-g05a43c8f-1jammy rbd-fuse=18.0.0-3908-g05a43c8f-1jammy python3-cephfs=18.0.0-3908-g05a43c8f-1jammy cephfs-shell=18.0.0-3908-g05a43c8f-1jammy cephfs-top=18.0.0-3908-g05a43c8f-1jammy cephfs-mirror=18.0.0-3908-g05a43c8f-1jammy 2023-10-03T19:08:41.422 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2023-10-03T19:08:41.469 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2023-10-03T19:08:41.470 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-10-03T19:08:41.584 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2023-10-03T19:08:41.584 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2023-10-03T19:08:41.619 INFO:teuthology.orchestra.run.smithi045.stdout:Reading package lists... 2023-10-03T19:08:41.633 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-10-03T19:08:41.633 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-10-03T19:08:41.635 DEBUG:teuthology.orchestra.run.smithi045:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-3908-g05a43c8f-1jammy cephadm=18.0.0-3908-g05a43c8f-1jammy ceph-mds=18.0.0-3908-g05a43c8f-1jammy ceph-mgr=18.0.0-3908-g05a43c8f-1jammy ceph-common=18.0.0-3908-g05a43c8f-1jammy ceph-fuse=18.0.0-3908-g05a43c8f-1jammy ceph-test=18.0.0-3908-g05a43c8f-1jammy ceph-volume=18.0.0-3908-g05a43c8f-1jammy radosgw=18.0.0-3908-g05a43c8f-1jammy python3-rados=18.0.0-3908-g05a43c8f-1jammy python3-rgw=18.0.0-3908-g05a43c8f-1jammy python3-cephfs=18.0.0-3908-g05a43c8f-1jammy python3-rbd=18.0.0-3908-g05a43c8f-1jammy libcephfs2=18.0.0-3908-g05a43c8f-1jammy libcephfs-dev=18.0.0-3908-g05a43c8f-1jammy librados2=18.0.0-3908-g05a43c8f-1jammy librbd1=18.0.0-3908-g05a43c8f-1jammy rbd-fuse=18.0.0-3908-g05a43c8f-1jammy python3-cephfs=18.0.0-3908-g05a43c8f-1jammy cephfs-shell=18.0.0-3908-g05a43c8f-1jammy cephfs-top=18.0.0-3908-g05a43c8f-1jammy cephfs-mirror=18.0.0-3908-g05a43c8f-1jammy 2023-10-03T19:08:41.652 INFO:teuthology.orchestra.run.smithi172.stdout:Building dependency tree... 2023-10-03T19:08:41.653 INFO:teuthology.orchestra.run.smithi172.stdout:Reading state information... 2023-10-03T19:08:41.686 INFO:teuthology.orchestra.run.smithi045.stdout:Reading package lists... 2023-10-03T19:08:41.730 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages were automatically installed and are no longer required: 2023-10-03T19:08:41.730 INFO:teuthology.orchestra.run.smithi079.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-03T19:08:41.731 INFO:teuthology.orchestra.run.smithi079.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-03T19:08:41.731 INFO:teuthology.orchestra.run.smithi079.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-03T19:08:41.731 INFO:teuthology.orchestra.run.smithi079.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-03T19:08:41.731 INFO:teuthology.orchestra.run.smithi079.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-03T19:08:41.731 INFO:teuthology.orchestra.run.smithi079.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-03T19:08:41.732 INFO:teuthology.orchestra.run.smithi079.stdout:The following additional packages will be installed: 2023-10-03T19:08:41.732 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-03T19:08:41.732 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-10-03T19:08:41.732 INFO:teuthology.orchestra.run.smithi079.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-03T19:08:41.732 INFO:teuthology.orchestra.run.smithi079.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-10-03T19:08:41.732 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-10-03T19:08:41.732 INFO:teuthology.orchestra.run.smithi079.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-10-03T19:08:41.733 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-10-03T19:08:41.733 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-10-03T19:08:41.733 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-10-03T19:08:41.733 INFO:teuthology.orchestra.run.smithi079.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-10-03T19:08:41.733 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-10-03T19:08:41.733 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-10-03T19:08:41.733 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-10-03T19:08:41.733 INFO:teuthology.orchestra.run.smithi079.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-10-03T19:08:41.733 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-10-03T19:08:41.733 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-10-03T19:08:41.733 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-10-03T19:08:41.733 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-10-03T19:08:41.733 INFO:teuthology.orchestra.run.smithi079.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-10-03T19:08:41.734 INFO:teuthology.orchestra.run.smithi079.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-10-03T19:08:41.734 INFO:teuthology.orchestra.run.smithi079.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-10-03T19:08:41.734 INFO:teuthology.orchestra.run.smithi079.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-10-03T19:08:41.734 INFO:teuthology.orchestra.run.smithi079.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-03T19:08:41.734 INFO:teuthology.orchestra.run.smithi079.stdout:Suggested packages: 2023-10-03T19:08:41.734 INFO:teuthology.orchestra.run.smithi079.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-10-03T19:08:41.734 INFO:teuthology.orchestra.run.smithi079.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-10-03T19:08:41.735 INFO:teuthology.orchestra.run.smithi079.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-10-03T19:08:41.735 INFO:teuthology.orchestra.run.smithi079.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-10-03T19:08:41.735 INFO:teuthology.orchestra.run.smithi079.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-10-03T19:08:41.735 INFO:teuthology.orchestra.run.smithi079.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-10-03T19:08:41.735 INFO:teuthology.orchestra.run.smithi079.stdout: python3-watchdog 2023-10-03T19:08:41.735 INFO:teuthology.orchestra.run.smithi079.stdout:Recommended packages: 2023-10-03T19:08:41.735 INFO:teuthology.orchestra.run.smithi079.stdout: btrfs-tools 2023-10-03T19:08:41.780 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2023-10-03T19:08:41.780 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-03T19:08:41.780 INFO:teuthology.orchestra.run.smithi146.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-03T19:08:41.780 INFO:teuthology.orchestra.run.smithi146.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-03T19:08:41.780 INFO:teuthology.orchestra.run.smithi146.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-03T19:08:41.781 INFO:teuthology.orchestra.run.smithi146.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-03T19:08:41.781 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-03T19:08:41.781 INFO:teuthology.orchestra.run.smithi146.stdout:The following additional packages will be installed: 2023-10-03T19:08:41.781 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-03T19:08:41.782 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-10-03T19:08:41.782 INFO:teuthology.orchestra.run.smithi146.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-03T19:08:41.782 INFO:teuthology.orchestra.run.smithi146.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-10-03T19:08:41.783 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-10-03T19:08:41.783 INFO:teuthology.orchestra.run.smithi146.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-10-03T19:08:41.783 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-10-03T19:08:41.783 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-10-03T19:08:41.783 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-10-03T19:08:41.783 INFO:teuthology.orchestra.run.smithi146.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-10-03T19:08:41.783 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-10-03T19:08:41.783 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-10-03T19:08:41.783 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-10-03T19:08:41.783 INFO:teuthology.orchestra.run.smithi146.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-10-03T19:08:41.784 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-10-03T19:08:41.784 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-10-03T19:08:41.784 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-10-03T19:08:41.784 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-10-03T19:08:41.784 INFO:teuthology.orchestra.run.smithi146.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-10-03T19:08:41.784 INFO:teuthology.orchestra.run.smithi146.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-10-03T19:08:41.784 INFO:teuthology.orchestra.run.smithi146.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-10-03T19:08:41.784 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-10-03T19:08:41.784 INFO:teuthology.orchestra.run.smithi146.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-03T19:08:41.785 INFO:teuthology.orchestra.run.smithi146.stdout:Suggested packages: 2023-10-03T19:08:41.785 INFO:teuthology.orchestra.run.smithi146.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-10-03T19:08:41.785 INFO:teuthology.orchestra.run.smithi146.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-10-03T19:08:41.785 INFO:teuthology.orchestra.run.smithi146.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-10-03T19:08:41.785 INFO:teuthology.orchestra.run.smithi146.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-10-03T19:08:41.785 INFO:teuthology.orchestra.run.smithi146.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-10-03T19:08:41.785 INFO:teuthology.orchestra.run.smithi146.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-10-03T19:08:41.785 INFO:teuthology.orchestra.run.smithi146.stdout: python3-watchdog 2023-10-03T19:08:41.785 INFO:teuthology.orchestra.run.smithi146.stdout:Recommended packages: 2023-10-03T19:08:41.785 INFO:teuthology.orchestra.run.smithi146.stdout: btrfs-tools 2023-10-03T19:08:41.819 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages were automatically installed and are no longer required: 2023-10-03T19:08:41.819 INFO:teuthology.orchestra.run.smithi172.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-03T19:08:41.819 INFO:teuthology.orchestra.run.smithi172.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-03T19:08:41.819 INFO:teuthology.orchestra.run.smithi172.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-03T19:08:41.819 INFO:teuthology.orchestra.run.smithi172.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-03T19:08:41.820 INFO:teuthology.orchestra.run.smithi172.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-03T19:08:41.820 INFO:teuthology.orchestra.run.smithi172.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-03T19:08:41.820 INFO:teuthology.orchestra.run.smithi172.stdout:The following additional packages will be installed: 2023-10-03T19:08:41.820 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-03T19:08:41.820 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-10-03T19:08:41.821 INFO:teuthology.orchestra.run.smithi172.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-03T19:08:41.821 INFO:teuthology.orchestra.run.smithi172.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-10-03T19:08:41.821 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-10-03T19:08:41.822 INFO:teuthology.orchestra.run.smithi172.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-10-03T19:08:41.822 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-10-03T19:08:41.822 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-10-03T19:08:41.822 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-10-03T19:08:41.822 INFO:teuthology.orchestra.run.smithi172.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-10-03T19:08:41.822 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-10-03T19:08:41.822 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-10-03T19:08:41.822 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-10-03T19:08:41.822 INFO:teuthology.orchestra.run.smithi172.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-10-03T19:08:41.822 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-10-03T19:08:41.822 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-10-03T19:08:41.822 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-10-03T19:08:41.823 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-10-03T19:08:41.823 INFO:teuthology.orchestra.run.smithi172.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-10-03T19:08:41.823 INFO:teuthology.orchestra.run.smithi172.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-10-03T19:08:41.823 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-10-03T19:08:41.823 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-10-03T19:08:41.823 INFO:teuthology.orchestra.run.smithi172.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-03T19:08:41.823 INFO:teuthology.orchestra.run.smithi172.stdout:Suggested packages: 2023-10-03T19:08:41.823 INFO:teuthology.orchestra.run.smithi172.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-10-03T19:08:41.824 INFO:teuthology.orchestra.run.smithi172.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-10-03T19:08:41.824 INFO:teuthology.orchestra.run.smithi172.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-10-03T19:08:41.824 INFO:teuthology.orchestra.run.smithi172.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-10-03T19:08:41.824 INFO:teuthology.orchestra.run.smithi172.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-10-03T19:08:41.824 INFO:teuthology.orchestra.run.smithi172.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-10-03T19:08:41.824 INFO:teuthology.orchestra.run.smithi172.stdout: python3-watchdog 2023-10-03T19:08:41.824 INFO:teuthology.orchestra.run.smithi172.stdout:Recommended packages: 2023-10-03T19:08:41.824 INFO:teuthology.orchestra.run.smithi172.stdout: btrfs-tools 2023-10-03T19:08:41.832 INFO:teuthology.orchestra.run.smithi079.stdout:The following NEW packages will be installed: 2023-10-03T19:08:41.832 INFO:teuthology.orchestra.run.smithi079.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-03T19:08:41.832 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-03T19:08:41.832 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-03T19:08:41.833 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-10-03T19:08:41.833 INFO:teuthology.orchestra.run.smithi079.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-03T19:08:41.833 INFO:teuthology.orchestra.run.smithi079.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-10-03T19:08:41.834 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-10-03T19:08:41.834 INFO:teuthology.orchestra.run.smithi079.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-10-03T19:08:41.834 INFO:teuthology.orchestra.run.smithi079.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-10-03T19:08:41.834 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-10-03T19:08:41.834 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-10-03T19:08:41.834 INFO:teuthology.orchestra.run.smithi079.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-10-03T19:08:41.834 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-10-03T19:08:41.834 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-10-03T19:08:41.834 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-10-03T19:08:41.834 INFO:teuthology.orchestra.run.smithi079.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-10-03T19:08:41.834 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-10-03T19:08:41.835 INFO:teuthology.orchestra.run.smithi079.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-10-03T19:08:41.835 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-10-03T19:08:41.835 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-10-03T19:08:41.835 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-03T19:08:41.835 INFO:teuthology.orchestra.run.smithi079.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-10-03T19:08:41.835 INFO:teuthology.orchestra.run.smithi079.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-10-03T19:08:41.835 INFO:teuthology.orchestra.run.smithi079.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-10-03T19:08:41.835 INFO:teuthology.orchestra.run.smithi079.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-10-03T19:08:41.835 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-10-03T19:08:41.835 INFO:teuthology.orchestra.run.smithi079.stdout: socat xmlstarlet 2023-10-03T19:08:41.854 INFO:teuthology.orchestra.run.smithi045.stdout:Building dependency tree... 2023-10-03T19:08:41.855 INFO:teuthology.orchestra.run.smithi045.stdout:Reading state information... 2023-10-03T19:08:41.881 INFO:teuthology.orchestra.run.smithi146.stdout:The following NEW packages will be installed: 2023-10-03T19:08:41.881 INFO:teuthology.orchestra.run.smithi146.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-03T19:08:41.881 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-03T19:08:41.881 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-03T19:08:41.881 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-10-03T19:08:41.881 INFO:teuthology.orchestra.run.smithi146.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-03T19:08:41.881 INFO:teuthology.orchestra.run.smithi146.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-10-03T19:08:41.881 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-10-03T19:08:41.882 INFO:teuthology.orchestra.run.smithi146.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-10-03T19:08:41.882 INFO:teuthology.orchestra.run.smithi146.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-10-03T19:08:41.883 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-10-03T19:08:41.883 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-10-03T19:08:41.883 INFO:teuthology.orchestra.run.smithi146.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-10-03T19:08:41.883 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-10-03T19:08:41.883 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-10-03T19:08:41.883 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-10-03T19:08:41.883 INFO:teuthology.orchestra.run.smithi146.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-10-03T19:08:41.883 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-10-03T19:08:41.883 INFO:teuthology.orchestra.run.smithi146.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-10-03T19:08:41.883 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-10-03T19:08:41.884 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-10-03T19:08:41.884 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-03T19:08:41.884 INFO:teuthology.orchestra.run.smithi146.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-10-03T19:08:41.884 INFO:teuthology.orchestra.run.smithi146.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-10-03T19:08:41.884 INFO:teuthology.orchestra.run.smithi146.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-10-03T19:08:41.884 INFO:teuthology.orchestra.run.smithi146.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-10-03T19:08:41.884 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-10-03T19:08:41.884 INFO:teuthology.orchestra.run.smithi146.stdout: socat xmlstarlet 2023-10-03T19:08:41.891 INFO:teuthology.orchestra.run.smithi079.stdout:0 upgraded, 115 newly installed, 0 to remove and 254 not upgraded. 2023-10-03T19:08:41.892 INFO:teuthology.orchestra.run.smithi079.stdout:Need to get 175 MB of archives. 2023-10-03T19:08:41.892 INFO:teuthology.orchestra.run.smithi079.stdout:After this operation, 792 MB of additional disk space will be used. 2023-10-03T19:08:41.892 INFO:teuthology.orchestra.run.smithi079.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-10-03T19:08:41.908 INFO:teuthology.orchestra.run.smithi079.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-10-03T19:08:41.918 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-10-03T19:08:41.927 INFO:teuthology.orchestra.run.smithi172.stdout:The following NEW packages will be installed: 2023-10-03T19:08:41.927 INFO:teuthology.orchestra.run.smithi172.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-03T19:08:41.927 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-03T19:08:41.927 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-03T19:08:41.928 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-10-03T19:08:41.928 INFO:teuthology.orchestra.run.smithi172.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-03T19:08:41.928 INFO:teuthology.orchestra.run.smithi172.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-10-03T19:08:41.928 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-10-03T19:08:41.928 INFO:teuthology.orchestra.run.smithi172.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-10-03T19:08:41.928 INFO:teuthology.orchestra.run.smithi172.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-10-03T19:08:41.929 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-10-03T19:08:41.929 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-10-03T19:08:41.929 INFO:teuthology.orchestra.run.smithi172.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-10-03T19:08:41.929 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-10-03T19:08:41.929 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-10-03T19:08:41.930 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-10-03T19:08:41.930 INFO:teuthology.orchestra.run.smithi172.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-10-03T19:08:41.930 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-10-03T19:08:41.930 INFO:teuthology.orchestra.run.smithi172.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-10-03T19:08:41.930 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-10-03T19:08:41.930 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-10-03T19:08:41.930 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-03T19:08:41.931 INFO:teuthology.orchestra.run.smithi172.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-10-03T19:08:41.931 INFO:teuthology.orchestra.run.smithi172.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-10-03T19:08:41.931 INFO:teuthology.orchestra.run.smithi172.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-10-03T19:08:41.931 INFO:teuthology.orchestra.run.smithi172.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-10-03T19:08:41.931 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-10-03T19:08:41.931 INFO:teuthology.orchestra.run.smithi172.stdout: socat xmlstarlet 2023-10-03T19:08:41.958 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-10-03T19:08:41.966 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-10-03T19:08:41.983 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-10-03T19:08:41.985 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-10-03T19:08:41.986 INFO:teuthology.orchestra.run.smithi172.stdout:0 upgraded, 115 newly installed, 0 to remove and 254 not upgraded. 2023-10-03T19:08:41.986 INFO:teuthology.orchestra.run.smithi172.stdout:Need to get 175 MB of archives. 2023-10-03T19:08:41.986 INFO:teuthology.orchestra.run.smithi172.stdout:After this operation, 792 MB of additional disk space will be used. 2023-10-03T19:08:41.987 INFO:teuthology.orchestra.run.smithi172.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-10-03T19:08:41.994 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-10-03T19:08:42.004 INFO:teuthology.orchestra.run.smithi172.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-10-03T19:08:42.007 INFO:teuthology.orchestra.run.smithi045.stdout:The following packages were automatically installed and are no longer required: 2023-10-03T19:08:42.007 INFO:teuthology.orchestra.run.smithi045.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-03T19:08:42.007 INFO:teuthology.orchestra.run.smithi045.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-03T19:08:42.007 INFO:teuthology.orchestra.run.smithi045.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-03T19:08:42.008 INFO:teuthology.orchestra.run.smithi045.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-03T19:08:42.008 INFO:teuthology.orchestra.run.smithi045.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-03T19:08:42.008 INFO:teuthology.orchestra.run.smithi045.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-03T19:08:42.009 INFO:teuthology.orchestra.run.smithi045.stdout:The following additional packages will be installed: 2023-10-03T19:08:42.009 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-03T19:08:42.009 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-10-03T19:08:42.009 INFO:teuthology.orchestra.run.smithi045.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-03T19:08:42.009 INFO:teuthology.orchestra.run.smithi045.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-10-03T19:08:42.010 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-10-03T19:08:42.010 INFO:teuthology.orchestra.run.smithi045.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-10-03T19:08:42.010 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-10-03T19:08:42.010 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-10-03T19:08:42.010 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-10-03T19:08:42.010 INFO:teuthology.orchestra.run.smithi045.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-10-03T19:08:42.011 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-10-03T19:08:42.011 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-10-03T19:08:42.011 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-10-03T19:08:42.011 INFO:teuthology.orchestra.run.smithi045.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-10-03T19:08:42.011 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-10-03T19:08:42.011 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-10-03T19:08:42.011 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-10-03T19:08:42.011 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-10-03T19:08:42.011 INFO:teuthology.orchestra.run.smithi045.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-10-03T19:08:42.011 INFO:teuthology.orchestra.run.smithi045.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-10-03T19:08:42.012 INFO:teuthology.orchestra.run.smithi045.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-10-03T19:08:42.012 INFO:teuthology.orchestra.run.smithi045.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-10-03T19:08:42.012 INFO:teuthology.orchestra.run.smithi045.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-03T19:08:42.012 INFO:teuthology.orchestra.run.smithi045.stdout:Suggested packages: 2023-10-03T19:08:42.012 INFO:teuthology.orchestra.run.smithi045.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-10-03T19:08:42.012 INFO:teuthology.orchestra.run.smithi045.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-10-03T19:08:42.012 INFO:teuthology.orchestra.run.smithi045.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-10-03T19:08:42.012 INFO:teuthology.orchestra.run.smithi045.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-10-03T19:08:42.013 INFO:teuthology.orchestra.run.smithi045.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-10-03T19:08:42.013 INFO:teuthology.orchestra.run.smithi045.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-10-03T19:08:42.013 INFO:teuthology.orchestra.run.smithi045.stdout: python3-watchdog 2023-10-03T19:08:42.013 INFO:teuthology.orchestra.run.smithi045.stdout:Recommended packages: 2023-10-03T19:08:42.013 INFO:teuthology.orchestra.run.smithi045.stdout: btrfs-tools 2023-10-03T19:08:42.014 INFO:teuthology.orchestra.run.smithi172.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-10-03T19:08:42.022 INFO:teuthology.orchestra.run.smithi146.stdout:0 upgraded, 115 newly installed, 0 to remove and 254 not upgraded. 2023-10-03T19:08:42.023 INFO:teuthology.orchestra.run.smithi146.stdout:Need to get 175 MB of archives. 2023-10-03T19:08:42.023 INFO:teuthology.orchestra.run.smithi146.stdout:After this operation, 792 MB of additional disk space will be used. 2023-10-03T19:08:42.023 INFO:teuthology.orchestra.run.smithi146.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-3908-g05a43c8f-1jammy [3,403 kB] 2023-10-03T19:08:42.042 INFO:teuthology.orchestra.run.smithi079.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-10-03T19:08:42.046 INFO:teuthology.orchestra.run.smithi079.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-10-03T19:08:42.055 INFO:teuthology.orchestra.run.smithi172.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-10-03T19:08:42.056 INFO:teuthology.orchestra.run.smithi079.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-10-03T19:08:42.060 INFO:teuthology.orchestra.run.smithi079.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-10-03T19:08:42.060 INFO:teuthology.orchestra.run.smithi079.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-10-03T19:08:42.061 INFO:teuthology.orchestra.run.smithi079.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-3908-g05a43c8f-1jammy [3,403 kB] 2023-10-03T19:08:42.064 INFO:teuthology.orchestra.run.smithi172.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-10-03T19:08:42.068 INFO:teuthology.orchestra.run.smithi079.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-10-03T19:08:42.068 INFO:teuthology.orchestra.run.smithi079.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-10-03T19:08:42.069 INFO:teuthology.orchestra.run.smithi079.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-10-03T19:08:42.069 INFO:teuthology.orchestra.run.smithi146.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-10-03T19:08:42.070 INFO:teuthology.orchestra.run.smithi079.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-10-03T19:08:42.070 INFO:teuthology.orchestra.run.smithi079.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-10-03T19:08:42.079 INFO:teuthology.orchestra.run.smithi079.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-10-03T19:08:42.079 INFO:teuthology.orchestra.run.smithi079.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-10-03T19:08:42.080 INFO:teuthology.orchestra.run.smithi172.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-10-03T19:08:42.082 INFO:teuthology.orchestra.run.smithi172.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-10-03T19:08:42.092 INFO:teuthology.orchestra.run.smithi172.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-10-03T19:08:42.096 INFO:teuthology.orchestra.run.smithi079.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-10-03T19:08:42.096 INFO:teuthology.orchestra.run.smithi079.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-10-03T19:08:42.096 INFO:teuthology.orchestra.run.smithi079.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-10-03T19:08:42.099 INFO:teuthology.orchestra.run.smithi079.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-10-03T19:08:42.099 INFO:teuthology.orchestra.run.smithi079.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-10-03T19:08:42.100 INFO:teuthology.orchestra.run.smithi079.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-10-03T19:08:42.100 INFO:teuthology.orchestra.run.smithi079.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-10-03T19:08:42.101 INFO:teuthology.orchestra.run.smithi079.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-03T19:08:42.112 INFO:teuthology.orchestra.run.smithi079.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-10-03T19:08:42.112 INFO:teuthology.orchestra.run.smithi079.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-10-03T19:08:42.115 INFO:teuthology.orchestra.run.smithi045.stdout:The following NEW packages will be installed: 2023-10-03T19:08:42.118 INFO:teuthology.orchestra.run.smithi045.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-03T19:08:42.118 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-03T19:08:42.118 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-03T19:08:42.120 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-10-03T19:08:42.121 INFO:teuthology.orchestra.run.smithi045.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-03T19:08:42.121 INFO:teuthology.orchestra.run.smithi045.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-10-03T19:08:42.121 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-10-03T19:08:42.121 INFO:teuthology.orchestra.run.smithi045.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-10-03T19:08:42.121 INFO:teuthology.orchestra.run.smithi045.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-10-03T19:08:42.121 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-10-03T19:08:42.121 INFO:teuthology.orchestra.run.smithi045.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-10-03T19:08:42.121 INFO:teuthology.orchestra.run.smithi045.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-10-03T19:08:42.121 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-10-03T19:08:42.121 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-10-03T19:08:42.121 INFO:teuthology.orchestra.run.smithi045.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-10-03T19:08:42.121 INFO:teuthology.orchestra.run.smithi045.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-10-03T19:08:42.122 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-10-03T19:08:42.122 INFO:teuthology.orchestra.run.smithi045.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-10-03T19:08:42.122 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-10-03T19:08:42.122 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-10-03T19:08:42.122 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-03T19:08:42.122 INFO:teuthology.orchestra.run.smithi045.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-10-03T19:08:42.122 INFO:teuthology.orchestra.run.smithi045.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-10-03T19:08:42.122 INFO:teuthology.orchestra.run.smithi045.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-10-03T19:08:42.122 INFO:teuthology.orchestra.run.smithi045.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-10-03T19:08:42.122 INFO:teuthology.orchestra.run.smithi045.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-10-03T19:08:42.122 INFO:teuthology.orchestra.run.smithi045.stdout: socat xmlstarlet 2023-10-03T19:08:42.129 INFO:teuthology.orchestra.run.smithi079.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-10-03T19:08:42.129 INFO:teuthology.orchestra.run.smithi079.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-10-03T19:08:42.130 INFO:teuthology.orchestra.run.smithi079.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-10-03T19:08:42.136 INFO:teuthology.orchestra.run.smithi079.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-10-03T19:08:42.136 INFO:teuthology.orchestra.run.smithi079.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-10-03T19:08:42.136 INFO:teuthology.orchestra.run.smithi079.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-10-03T19:08:42.136 INFO:teuthology.orchestra.run.smithi079.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-10-03T19:08:42.138 INFO:teuthology.orchestra.run.smithi079.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-10-03T19:08:42.138 INFO:teuthology.orchestra.run.smithi172.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-10-03T19:08:42.141 INFO:teuthology.orchestra.run.smithi172.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-10-03T19:08:42.146 INFO:teuthology.orchestra.run.smithi079.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-10-03T19:08:42.146 INFO:teuthology.orchestra.run.smithi079.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-10-03T19:08:42.151 INFO:teuthology.orchestra.run.smithi146.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-10-03T19:08:42.152 INFO:teuthology.orchestra.run.smithi172.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-10-03T19:08:42.156 INFO:teuthology.orchestra.run.smithi172.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-10-03T19:08:42.156 INFO:teuthology.orchestra.run.smithi079.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-10-03T19:08:42.157 INFO:teuthology.orchestra.run.smithi172.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-10-03T19:08:42.157 INFO:teuthology.orchestra.run.smithi079.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-10-03T19:08:42.159 INFO:teuthology.orchestra.run.smithi172.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-3908-g05a43c8f-1jammy [3,403 kB] 2023-10-03T19:08:42.159 INFO:teuthology.orchestra.run.smithi079.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-10-03T19:08:42.160 INFO:teuthology.orchestra.run.smithi079.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-10-03T19:08:42.163 INFO:teuthology.orchestra.run.smithi079.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-10-03T19:08:42.164 INFO:teuthology.orchestra.run.smithi172.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-10-03T19:08:42.165 INFO:teuthology.orchestra.run.smithi172.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-10-03T19:08:42.165 INFO:teuthology.orchestra.run.smithi172.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-10-03T19:08:42.166 INFO:teuthology.orchestra.run.smithi172.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-10-03T19:08:42.167 INFO:teuthology.orchestra.run.smithi172.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-10-03T19:08:42.175 INFO:teuthology.orchestra.run.smithi172.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-10-03T19:08:42.176 INFO:teuthology.orchestra.run.smithi045.stdout:0 upgraded, 115 newly installed, 0 to remove and 254 not upgraded. 2023-10-03T19:08:42.176 INFO:teuthology.orchestra.run.smithi045.stdout:Need to get 175 MB of archives. 2023-10-03T19:08:42.176 INFO:teuthology.orchestra.run.smithi045.stdout:After this operation, 792 MB of additional disk space will be used. 2023-10-03T19:08:42.176 INFO:teuthology.orchestra.run.smithi045.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-10-03T19:08:42.176 INFO:teuthology.orchestra.run.smithi172.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-10-03T19:08:42.192 INFO:teuthology.orchestra.run.smithi172.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-10-03T19:08:42.193 INFO:teuthology.orchestra.run.smithi045.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-10-03T19:08:42.193 INFO:teuthology.orchestra.run.smithi172.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-10-03T19:08:42.193 INFO:teuthology.orchestra.run.smithi172.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-10-03T19:08:42.195 INFO:teuthology.orchestra.run.smithi172.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-10-03T19:08:42.196 INFO:teuthology.orchestra.run.smithi172.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-10-03T19:08:42.196 INFO:teuthology.orchestra.run.smithi172.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-10-03T19:08:42.197 INFO:teuthology.orchestra.run.smithi146.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-10-03T19:08:42.197 INFO:teuthology.orchestra.run.smithi172.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-10-03T19:08:42.198 INFO:teuthology.orchestra.run.smithi172.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-03T19:08:42.202 INFO:teuthology.orchestra.run.smithi045.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-10-03T19:08:42.209 INFO:teuthology.orchestra.run.smithi172.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-10-03T19:08:42.210 INFO:teuthology.orchestra.run.smithi172.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-10-03T19:08:42.214 INFO:teuthology.orchestra.run.smithi079.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-10-03T19:08:42.215 INFO:teuthology.orchestra.run.smithi079.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-10-03T19:08:42.217 INFO:teuthology.orchestra.run.smithi079.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-10-03T19:08:42.217 INFO:teuthology.orchestra.run.smithi079.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-03T19:08:42.217 INFO:teuthology.orchestra.run.smithi079.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-10-03T19:08:42.227 INFO:teuthology.orchestra.run.smithi172.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-10-03T19:08:42.227 INFO:teuthology.orchestra.run.smithi079.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-10-03T19:08:42.228 INFO:teuthology.orchestra.run.smithi172.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-10-03T19:08:42.228 INFO:teuthology.orchestra.run.smithi172.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-10-03T19:08:42.230 INFO:teuthology.orchestra.run.smithi146.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-3908-g05a43c8f-1jammy [3,095 kB] 2023-10-03T19:08:42.233 INFO:teuthology.orchestra.run.smithi172.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-10-03T19:08:42.233 INFO:teuthology.orchestra.run.smithi172.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-10-03T19:08:42.234 INFO:teuthology.orchestra.run.smithi172.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-10-03T19:08:42.234 INFO:teuthology.orchestra.run.smithi172.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-10-03T19:08:42.235 INFO:teuthology.orchestra.run.smithi172.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-10-03T19:08:42.243 INFO:teuthology.orchestra.run.smithi045.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-10-03T19:08:42.243 INFO:teuthology.orchestra.run.smithi172.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-10-03T19:08:42.244 INFO:teuthology.orchestra.run.smithi172.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-10-03T19:08:42.244 INFO:teuthology.orchestra.run.smithi079.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-10-03T19:08:42.247 INFO:teuthology.orchestra.run.smithi079.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-10-03T19:08:42.247 INFO:teuthology.orchestra.run.smithi079.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-10-03T19:08:42.252 INFO:teuthology.orchestra.run.smithi045.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-10-03T19:08:42.255 INFO:teuthology.orchestra.run.smithi172.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-10-03T19:08:42.256 INFO:teuthology.orchestra.run.smithi172.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-10-03T19:08:42.258 INFO:teuthology.orchestra.run.smithi172.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-10-03T19:08:42.259 INFO:teuthology.orchestra.run.smithi172.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-10-03T19:08:42.261 INFO:teuthology.orchestra.run.smithi172.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-10-03T19:08:42.262 INFO:teuthology.orchestra.run.smithi079.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-10-03T19:08:42.262 INFO:teuthology.orchestra.run.smithi079.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-10-03T19:08:42.262 INFO:teuthology.orchestra.run.smithi079.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-10-03T19:08:42.263 INFO:teuthology.orchestra.run.smithi079.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-10-03T19:08:42.263 INFO:teuthology.orchestra.run.smithi079.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-10-03T19:08:42.264 INFO:teuthology.orchestra.run.smithi079.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-10-03T19:08:42.266 INFO:teuthology.orchestra.run.smithi079.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-10-03T19:08:42.267 INFO:teuthology.orchestra.run.smithi079.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-10-03T19:08:42.267 INFO:teuthology.orchestra.run.smithi045.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-10-03T19:08:42.270 INFO:teuthology.orchestra.run.smithi079.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-10-03T19:08:42.270 INFO:teuthology.orchestra.run.smithi045.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-10-03T19:08:42.280 INFO:teuthology.orchestra.run.smithi045.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-10-03T19:08:42.283 INFO:teuthology.orchestra.run.smithi079.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-10-03T19:08:42.284 INFO:teuthology.orchestra.run.smithi079.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-10-03T19:08:42.285 INFO:teuthology.orchestra.run.smithi079.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-10-03T19:08:42.288 INFO:teuthology.orchestra.run.smithi079.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-10-03T19:08:42.290 INFO:teuthology.orchestra.run.smithi079.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-10-03T19:08:42.291 INFO:teuthology.orchestra.run.smithi079.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-10-03T19:08:42.295 INFO:teuthology.orchestra.run.smithi079.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-10-03T19:08:42.299 INFO:teuthology.orchestra.run.smithi079.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-10-03T19:08:42.300 INFO:teuthology.orchestra.run.smithi079.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-03T19:08:42.300 INFO:teuthology.orchestra.run.smithi079.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-10-03T19:08:42.311 INFO:teuthology.orchestra.run.smithi172.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-10-03T19:08:42.312 INFO:teuthology.orchestra.run.smithi172.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-10-03T19:08:42.314 INFO:teuthology.orchestra.run.smithi172.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-10-03T19:08:42.314 INFO:teuthology.orchestra.run.smithi172.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-03T19:08:42.314 INFO:teuthology.orchestra.run.smithi172.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-10-03T19:08:42.315 INFO:teuthology.orchestra.run.smithi172.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-10-03T19:08:42.316 INFO:teuthology.orchestra.run.smithi079.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-10-03T19:08:42.317 INFO:teuthology.orchestra.run.smithi079.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-10-03T19:08:42.318 INFO:teuthology.orchestra.run.smithi079.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-10-03T19:08:42.325 INFO:teuthology.orchestra.run.smithi079.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-10-03T19:08:42.325 INFO:teuthology.orchestra.run.smithi079.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-10-03T19:08:42.325 INFO:teuthology.orchestra.run.smithi079.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-10-03T19:08:42.326 INFO:teuthology.orchestra.run.smithi045.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-10-03T19:08:42.327 INFO:teuthology.orchestra.run.smithi079.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-10-03T19:08:42.330 INFO:teuthology.orchestra.run.smithi045.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-10-03T19:08:42.332 INFO:teuthology.orchestra.run.smithi172.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-10-03T19:08:42.333 INFO:teuthology.orchestra.run.smithi079.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-10-03T19:08:42.333 INFO:teuthology.orchestra.run.smithi172.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-10-03T19:08:42.334 INFO:teuthology.orchestra.run.smithi172.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-10-03T19:08:42.342 INFO:teuthology.orchestra.run.smithi045.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-10-03T19:08:42.343 INFO:teuthology.orchestra.run.smithi146.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-3908-g05a43c8f-1jammy [658 kB] 2023-10-03T19:08:42.346 INFO:teuthology.orchestra.run.smithi045.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-10-03T19:08:42.346 INFO:teuthology.orchestra.run.smithi045.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-10-03T19:08:42.347 INFO:teuthology.orchestra.run.smithi172.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-10-03T19:08:42.347 INFO:teuthology.orchestra.run.smithi172.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-10-03T19:08:42.348 INFO:teuthology.orchestra.run.smithi172.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-10-03T19:08:42.348 INFO:teuthology.orchestra.run.smithi172.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-10-03T19:08:42.349 INFO:teuthology.orchestra.run.smithi172.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-10-03T19:08:42.349 INFO:teuthology.orchestra.run.smithi172.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-10-03T19:08:42.354 INFO:teuthology.orchestra.run.smithi045.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-10-03T19:08:42.355 INFO:teuthology.orchestra.run.smithi045.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-10-03T19:08:42.355 INFO:teuthology.orchestra.run.smithi045.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-10-03T19:08:42.357 INFO:teuthology.orchestra.run.smithi045.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-10-03T19:08:42.357 INFO:teuthology.orchestra.run.smithi045.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-10-03T19:08:42.363 INFO:teuthology.orchestra.run.smithi045.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-10-03T19:08:42.364 INFO:teuthology.orchestra.run.smithi045.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-10-03T19:08:42.364 INFO:teuthology.orchestra.run.smithi172.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-10-03T19:08:42.365 INFO:teuthology.orchestra.run.smithi172.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-10-03T19:08:42.368 INFO:teuthology.orchestra.run.smithi172.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-10-03T19:08:42.371 INFO:teuthology.orchestra.run.smithi146.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-3908-g05a43c8f-1jammy [344 kB] 2023-10-03T19:08:42.380 INFO:teuthology.orchestra.run.smithi045.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-10-03T19:08:42.381 INFO:teuthology.orchestra.run.smithi045.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-10-03T19:08:42.381 INFO:teuthology.orchestra.run.smithi172.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-10-03T19:08:42.381 INFO:teuthology.orchestra.run.smithi045.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-10-03T19:08:42.382 INFO:teuthology.orchestra.run.smithi146.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-3908-g05a43c8f-1jammy [23.0 kB] 2023-10-03T19:08:42.383 INFO:teuthology.orchestra.run.smithi172.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-10-03T19:08:42.383 INFO:teuthology.orchestra.run.smithi172.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-10-03T19:08:42.383 INFO:teuthology.orchestra.run.smithi146.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-3908-g05a43c8f-1jammy [170 kB] 2023-10-03T19:08:42.385 INFO:teuthology.orchestra.run.smithi045.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-10-03T19:08:42.386 INFO:teuthology.orchestra.run.smithi172.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-10-03T19:08:42.386 INFO:teuthology.orchestra.run.smithi045.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-10-03T19:08:42.386 INFO:teuthology.orchestra.run.smithi045.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-10-03T19:08:42.387 INFO:teuthology.orchestra.run.smithi045.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-10-03T19:08:42.388 INFO:teuthology.orchestra.run.smithi172.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-10-03T19:08:42.388 INFO:teuthology.orchestra.run.smithi045.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-03T19:08:42.389 INFO:teuthology.orchestra.run.smithi172.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-10-03T19:08:42.389 INFO:teuthology.orchestra.run.smithi146.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-3908-g05a43c8f-1jammy [49.0 kB] 2023-10-03T19:08:42.390 INFO:teuthology.orchestra.run.smithi146.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-3908-g05a43c8f-1jammy [319 kB] 2023-10-03T19:08:42.391 INFO:teuthology.orchestra.run.smithi146.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-10-03T19:08:42.392 INFO:teuthology.orchestra.run.smithi172.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-10-03T19:08:42.397 INFO:teuthology.orchestra.run.smithi045.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-10-03T19:08:42.397 INFO:teuthology.orchestra.run.smithi045.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-10-03T19:08:42.398 INFO:teuthology.orchestra.run.smithi172.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-10-03T19:08:42.398 INFO:teuthology.orchestra.run.smithi172.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-03T19:08:42.398 INFO:teuthology.orchestra.run.smithi172.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-10-03T19:08:42.400 INFO:teuthology.orchestra.run.smithi146.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-3908-g05a43c8f-1jammy [5,845 kB] 2023-10-03T19:08:42.414 INFO:teuthology.orchestra.run.smithi045.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-10-03T19:08:42.415 INFO:teuthology.orchestra.run.smithi172.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-10-03T19:08:42.415 INFO:teuthology.orchestra.run.smithi045.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-10-03T19:08:42.415 INFO:teuthology.orchestra.run.smithi045.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-10-03T19:08:42.416 INFO:teuthology.orchestra.run.smithi172.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-10-03T19:08:42.417 INFO:teuthology.orchestra.run.smithi172.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-10-03T19:08:42.423 INFO:teuthology.orchestra.run.smithi172.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-10-03T19:08:42.423 INFO:teuthology.orchestra.run.smithi172.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-10-03T19:08:42.423 INFO:teuthology.orchestra.run.smithi172.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-10-03T19:08:42.424 INFO:teuthology.orchestra.run.smithi045.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-10-03T19:08:42.424 INFO:teuthology.orchestra.run.smithi045.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-10-03T19:08:42.424 INFO:teuthology.orchestra.run.smithi045.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-10-03T19:08:42.425 INFO:teuthology.orchestra.run.smithi172.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-10-03T19:08:42.425 INFO:teuthology.orchestra.run.smithi045.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-10-03T19:08:42.427 INFO:teuthology.orchestra.run.smithi045.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-10-03T19:08:42.430 INFO:teuthology.orchestra.run.smithi045.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-10-03T19:08:42.432 INFO:teuthology.orchestra.run.smithi172.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-10-03T19:08:42.432 INFO:teuthology.orchestra.run.smithi045.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-10-03T19:08:42.435 INFO:teuthology.orchestra.run.smithi146.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-10-03T19:08:42.447 INFO:teuthology.orchestra.run.smithi045.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-10-03T19:08:42.448 INFO:teuthology.orchestra.run.smithi045.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-10-03T19:08:42.451 INFO:teuthology.orchestra.run.smithi045.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-10-03T19:08:42.452 INFO:teuthology.orchestra.run.smithi045.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-10-03T19:08:42.456 INFO:teuthology.orchestra.run.smithi045.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-10-03T19:08:42.510 INFO:teuthology.orchestra.run.smithi146.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-10-03T19:08:42.513 INFO:teuthology.orchestra.run.smithi045.stdout:Get:46 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-3908-g05a43c8f-1jammy [3,403 kB] 2023-10-03T19:08:42.520 INFO:teuthology.orchestra.run.smithi045.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-10-03T19:08:42.521 INFO:teuthology.orchestra.run.smithi146.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-10-03T19:08:42.521 INFO:teuthology.orchestra.run.smithi045.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-10-03T19:08:42.522 INFO:teuthology.orchestra.run.smithi045.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-10-03T19:08:42.522 INFO:teuthology.orchestra.run.smithi045.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-03T19:08:42.525 INFO:teuthology.orchestra.run.smithi045.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-10-03T19:08:42.525 INFO:teuthology.orchestra.run.smithi045.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-10-03T19:08:42.541 INFO:teuthology.orchestra.run.smithi045.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-10-03T19:08:42.543 INFO:teuthology.orchestra.run.smithi045.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-10-03T19:08:42.544 INFO:teuthology.orchestra.run.smithi045.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-10-03T19:08:42.558 INFO:teuthology.orchestra.run.smithi045.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-10-03T19:08:42.558 INFO:teuthology.orchestra.run.smithi045.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-10-03T19:08:42.559 INFO:teuthology.orchestra.run.smithi045.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-10-03T19:08:42.559 INFO:teuthology.orchestra.run.smithi045.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-10-03T19:08:42.559 INFO:teuthology.orchestra.run.smithi045.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-10-03T19:08:42.560 INFO:teuthology.orchestra.run.smithi045.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-10-03T19:08:42.566 INFO:teuthology.orchestra.run.smithi146.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-10-03T19:08:42.572 INFO:teuthology.orchestra.run.smithi045.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-10-03T19:08:42.572 INFO:teuthology.orchestra.run.smithi045.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-10-03T19:08:42.576 INFO:teuthology.orchestra.run.smithi045.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-10-03T19:08:42.589 INFO:teuthology.orchestra.run.smithi045.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-10-03T19:08:42.590 INFO:teuthology.orchestra.run.smithi045.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-10-03T19:08:42.590 INFO:teuthology.orchestra.run.smithi045.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-10-03T19:08:42.594 INFO:teuthology.orchestra.run.smithi045.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-10-03T19:08:42.596 INFO:teuthology.orchestra.run.smithi045.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-10-03T19:08:42.596 INFO:teuthology.orchestra.run.smithi045.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-10-03T19:08:42.600 INFO:teuthology.orchestra.run.smithi045.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-10-03T19:08:42.605 INFO:teuthology.orchestra.run.smithi045.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-10-03T19:08:42.606 INFO:teuthology.orchestra.run.smithi045.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-03T19:08:42.606 INFO:teuthology.orchestra.run.smithi045.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-10-03T19:08:42.622 INFO:teuthology.orchestra.run.smithi045.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-10-03T19:08:42.624 INFO:teuthology.orchestra.run.smithi045.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-10-03T19:08:42.624 INFO:teuthology.orchestra.run.smithi045.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-10-03T19:08:42.630 INFO:teuthology.orchestra.run.smithi045.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-10-03T19:08:42.631 INFO:teuthology.orchestra.run.smithi045.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-10-03T19:08:42.631 INFO:teuthology.orchestra.run.smithi045.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-10-03T19:08:42.633 INFO:teuthology.orchestra.run.smithi045.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-10-03T19:08:42.637 INFO:teuthology.orchestra.run.smithi146.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-3908-g05a43c8f-1jammy [102 kB] 2023-10-03T19:08:42.639 INFO:teuthology.orchestra.run.smithi045.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-10-03T19:08:42.640 INFO:teuthology.orchestra.run.smithi146.stdout:Get:19 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-3908-g05a43c8f-1jammy [429 kB] 2023-10-03T19:08:42.656 INFO:teuthology.orchestra.run.smithi146.stdout:Get:20 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-3908-g05a43c8f-1jammy [21.9 MB] 2023-10-03T19:08:42.731 INFO:teuthology.orchestra.run.smithi146.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-10-03T19:08:42.740 INFO:teuthology.orchestra.run.smithi146.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-10-03T19:08:42.767 INFO:teuthology.orchestra.run.smithi146.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-10-03T19:08:42.938 INFO:teuthology.orchestra.run.smithi146.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-10-03T19:08:43.035 INFO:teuthology.orchestra.run.smithi079.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-3908-g05a43c8f-1jammy [3,095 kB] 2023-10-03T19:08:43.133 INFO:teuthology.orchestra.run.smithi146.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-10-03T19:08:43.496 INFO:teuthology.orchestra.run.smithi146.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-10-03T19:08:43.503 INFO:teuthology.orchestra.run.smithi146.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-10-03T19:08:43.505 INFO:teuthology.orchestra.run.smithi146.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-10-03T19:08:43.517 INFO:teuthology.orchestra.run.smithi146.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-10-03T19:08:43.517 INFO:teuthology.orchestra.run.smithi146.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-10-03T19:08:43.519 INFO:teuthology.orchestra.run.smithi146.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-10-03T19:08:43.521 INFO:teuthology.orchestra.run.smithi146.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-10-03T19:08:43.523 INFO:teuthology.orchestra.run.smithi146.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-10-03T19:08:43.524 INFO:teuthology.orchestra.run.smithi146.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-10-03T19:08:43.655 INFO:teuthology.orchestra.run.smithi146.stdout:Get:35 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-3908-g05a43c8f-1jammy [6,825 kB] 2023-10-03T19:08:43.689 INFO:teuthology.orchestra.run.smithi146.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-10-03T19:08:43.870 INFO:teuthology.orchestra.run.smithi079.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-3908-g05a43c8f-1jammy [658 kB] 2023-10-03T19:08:43.893 INFO:teuthology.orchestra.run.smithi146.stdout:Get:37 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-3908-g05a43c8f-1jammy [226 kB] 2023-10-03T19:08:43.902 INFO:teuthology.orchestra.run.smithi146.stdout:Get:38 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-3908-g05a43c8f-1jammy [114 kB] 2023-10-03T19:08:43.908 INFO:teuthology.orchestra.run.smithi146.stdout:Get:39 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-3908-g05a43c8f-1jammy [1,469 kB] 2023-10-03T19:08:43.973 INFO:teuthology.orchestra.run.smithi146.stdout:Get:40 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-3908-g05a43c8f-1jammy [9,851 kB] 2023-10-03T19:08:44.043 INFO:teuthology.orchestra.run.smithi079.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-3908-g05a43c8f-1jammy [344 kB] 2023-10-03T19:08:44.092 INFO:teuthology.orchestra.run.smithi172.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-3908-g05a43c8f-1jammy [3,095 kB] 2023-10-03T19:08:44.120 INFO:teuthology.orchestra.run.smithi146.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-10-03T19:08:44.129 INFO:teuthology.orchestra.run.smithi146.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-10-03T19:08:44.135 INFO:teuthology.orchestra.run.smithi146.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-10-03T19:08:44.139 INFO:teuthology.orchestra.run.smithi146.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-10-03T19:08:44.139 INFO:teuthology.orchestra.run.smithi079.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-3908-g05a43c8f-1jammy [23.0 kB] 2023-10-03T19:08:44.142 INFO:teuthology.orchestra.run.smithi079.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-3908-g05a43c8f-1jammy [170 kB] 2023-10-03T19:08:44.157 INFO:teuthology.orchestra.run.smithi146.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-03T19:08:44.160 INFO:teuthology.orchestra.run.smithi146.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-10-03T19:08:44.162 INFO:teuthology.orchestra.run.smithi146.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-10-03T19:08:44.169 INFO:teuthology.orchestra.run.smithi079.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-3908-g05a43c8f-1jammy [49.0 kB] 2023-10-03T19:08:44.204 INFO:teuthology.orchestra.run.smithi146.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-10-03T19:08:44.218 INFO:teuthology.orchestra.run.smithi079.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-3908-g05a43c8f-1jammy [319 kB] 2023-10-03T19:08:44.218 INFO:teuthology.orchestra.run.smithi146.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-10-03T19:08:44.223 INFO:teuthology.orchestra.run.smithi146.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-10-03T19:08:44.309 INFO:teuthology.orchestra.run.smithi079.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-3908-g05a43c8f-1jammy [5,845 kB] 2023-10-03T19:08:44.426 INFO:teuthology.orchestra.run.smithi146.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-3908-g05a43c8f-1jammy [31.5 MB] 2023-10-03T19:08:44.495 INFO:teuthology.orchestra.run.smithi146.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-10-03T19:08:44.569 INFO:teuthology.orchestra.run.smithi045.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-3908-g05a43c8f-1jammy [3,095 kB] 2023-10-03T19:08:44.578 INFO:teuthology.orchestra.run.smithi146.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-10-03T19:08:44.670 INFO:teuthology.orchestra.run.smithi146.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-10-03T19:08:44.734 INFO:teuthology.orchestra.run.smithi146.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-10-03T19:08:44.845 INFO:teuthology.orchestra.run.smithi146.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-10-03T19:08:44.929 INFO:teuthology.orchestra.run.smithi146.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-10-03T19:08:44.948 INFO:teuthology.orchestra.run.smithi146.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-10-03T19:08:44.977 INFO:teuthology.orchestra.run.smithi146.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-10-03T19:08:44.988 INFO:teuthology.orchestra.run.smithi146.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-10-03T19:08:45.003 INFO:teuthology.orchestra.run.smithi172.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-3908-g05a43c8f-1jammy [658 kB] 2023-10-03T19:08:45.025 INFO:teuthology.orchestra.run.smithi146.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-10-03T19:08:45.033 INFO:teuthology.orchestra.run.smithi146.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-10-03T19:08:45.164 INFO:teuthology.orchestra.run.smithi172.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-3908-g05a43c8f-1jammy [344 kB] 2023-10-03T19:08:45.224 INFO:teuthology.orchestra.run.smithi146.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-10-03T19:08:45.299 INFO:teuthology.orchestra.run.smithi172.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-3908-g05a43c8f-1jammy [23.0 kB] 2023-10-03T19:08:45.300 INFO:teuthology.orchestra.run.smithi172.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-3908-g05a43c8f-1jammy [170 kB] 2023-10-03T19:08:45.316 INFO:teuthology.orchestra.run.smithi172.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-3908-g05a43c8f-1jammy [49.0 kB] 2023-10-03T19:08:45.372 INFO:teuthology.orchestra.run.smithi172.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-3908-g05a43c8f-1jammy [319 kB] 2023-10-03T19:08:45.454 INFO:teuthology.orchestra.run.smithi172.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-3908-g05a43c8f-1jammy [5,845 kB] 2023-10-03T19:08:45.655 INFO:teuthology.orchestra.run.smithi079.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-3908-g05a43c8f-1jammy [102 kB] 2023-10-03T19:08:45.666 INFO:teuthology.orchestra.run.smithi079.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-3908-g05a43c8f-1jammy [429 kB] 2023-10-03T19:08:45.718 INFO:teuthology.orchestra.run.smithi045.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-3908-g05a43c8f-1jammy [658 kB] 2023-10-03T19:08:45.750 INFO:teuthology.orchestra.run.smithi079.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-3908-g05a43c8f-1jammy [21.9 MB] 2023-10-03T19:08:45.956 INFO:teuthology.orchestra.run.smithi045.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-3908-g05a43c8f-1jammy [344 kB] 2023-10-03T19:08:46.036 INFO:teuthology.orchestra.run.smithi146.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-10-03T19:08:46.056 INFO:teuthology.orchestra.run.smithi146.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-10-03T19:08:46.094 INFO:teuthology.orchestra.run.smithi045.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-3908-g05a43c8f-1jammy [23.0 kB] 2023-10-03T19:08:46.095 INFO:teuthology.orchestra.run.smithi045.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-3908-g05a43c8f-1jammy [170 kB] 2023-10-03T19:08:46.126 INFO:teuthology.orchestra.run.smithi146.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-10-03T19:08:46.127 INFO:teuthology.orchestra.run.smithi146.stdout:Get:67 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-3908-g05a43c8f-1jammy [3,596 B] 2023-10-03T19:08:46.128 INFO:teuthology.orchestra.run.smithi146.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-03T19:08:46.128 INFO:teuthology.orchestra.run.smithi146.stdout:Get:69 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-3908-g05a43c8f-1jammy [810 kB] 2023-10-03T19:08:46.128 INFO:teuthology.orchestra.run.smithi146.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-10-03T19:08:46.130 INFO:teuthology.orchestra.run.smithi146.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-10-03T19:08:46.144 INFO:teuthology.orchestra.run.smithi146.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-3908-g05a43c8f-1jammy [2,159 kB] 2023-10-03T19:08:46.162 INFO:teuthology.orchestra.run.smithi045.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-3908-g05a43c8f-1jammy [49.0 kB] 2023-10-03T19:08:46.163 INFO:teuthology.orchestra.run.smithi045.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-3908-g05a43c8f-1jammy [319 kB] 2023-10-03T19:08:46.176 INFO:teuthology.orchestra.run.smithi146.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-10-03T19:08:46.180 INFO:teuthology.orchestra.run.smithi146.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-10-03T19:08:46.180 INFO:teuthology.orchestra.run.smithi146.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-10-03T19:08:46.231 INFO:teuthology.orchestra.run.smithi146.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-3908-g05a43c8f-1jammy [96.5 kB] 2023-10-03T19:08:46.231 INFO:teuthology.orchestra.run.smithi146.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-10-03T19:08:46.231 INFO:teuthology.orchestra.run.smithi146.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-3908-g05a43c8f-1jammy [124 kB] 2023-10-03T19:08:46.232 INFO:teuthology.orchestra.run.smithi146.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-3908-g05a43c8f-1jammy [1,839 kB] 2023-10-03T19:08:46.253 INFO:teuthology.orchestra.run.smithi045.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-3908-g05a43c8f-1jammy [5,845 kB] 2023-10-03T19:08:46.283 INFO:teuthology.orchestra.run.smithi146.stdout:Get:80 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-3908-g05a43c8f-1jammy [8,615 kB] 2023-10-03T19:08:46.392 INFO:teuthology.orchestra.run.smithi146.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-10-03T19:08:46.651 INFO:teuthology.orchestra.run.smithi146.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-10-03T19:08:46.683 INFO:teuthology.orchestra.run.smithi146.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-10-03T19:08:46.709 INFO:teuthology.orchestra.run.smithi146.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-10-03T19:08:46.725 INFO:teuthology.orchestra.run.smithi146.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-3908-g05a43c8f-1jammy [3,722 B] 2023-10-03T19:08:46.725 INFO:teuthology.orchestra.run.smithi146.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-3908-g05a43c8f-1jammy [40.9 MB] 2023-10-03T19:08:46.762 INFO:teuthology.orchestra.run.smithi146.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-10-03T19:08:46.781 INFO:teuthology.orchestra.run.smithi146.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-10-03T19:08:46.809 INFO:teuthology.orchestra.run.smithi146.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-10-03T19:08:46.937 INFO:teuthology.orchestra.run.smithi146.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-10-03T19:08:46.969 INFO:teuthology.orchestra.run.smithi146.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-10-03T19:08:46.988 INFO:teuthology.orchestra.run.smithi146.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-10-03T19:08:46.991 INFO:teuthology.orchestra.run.smithi172.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-3908-g05a43c8f-1jammy [102 kB] 2023-10-03T19:08:46.997 INFO:teuthology.orchestra.run.smithi146.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-10-03T19:08:47.054 INFO:teuthology.orchestra.run.smithi172.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-3908-g05a43c8f-1jammy [429 kB] 2023-10-03T19:08:47.149 INFO:teuthology.orchestra.run.smithi172.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-3908-g05a43c8f-1jammy [21.9 MB] 2023-10-03T19:08:47.200 INFO:teuthology.orchestra.run.smithi146.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-10-03T19:08:47.662 INFO:teuthology.orchestra.run.smithi146.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-10-03T19:08:47.667 INFO:teuthology.orchestra.run.smithi146.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-10-03T19:08:47.793 INFO:teuthology.orchestra.run.smithi146.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-10-03T19:08:47.840 INFO:teuthology.orchestra.run.smithi146.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-10-03T19:08:47.841 INFO:teuthology.orchestra.run.smithi146.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-03T19:08:47.846 INFO:teuthology.orchestra.run.smithi146.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-10-03T19:08:47.848 INFO:teuthology.orchestra.run.smithi146.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-10-03T19:08:47.864 INFO:teuthology.orchestra.run.smithi146.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-10-03T19:08:47.871 INFO:teuthology.orchestra.run.smithi146.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-10-03T19:08:47.932 INFO:teuthology.orchestra.run.smithi146.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-10-03T19:08:48.097 INFO:teuthology.orchestra.run.smithi146.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-10-03T19:08:48.263 INFO:teuthology.orchestra.run.smithi146.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-10-03T19:08:48.297 INFO:teuthology.orchestra.run.smithi045.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-3908-g05a43c8f-1jammy [102 kB] 2023-10-03T19:08:48.336 INFO:teuthology.orchestra.run.smithi045.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-3908-g05a43c8f-1jammy [429 kB] 2023-10-03T19:08:48.466 INFO:teuthology.orchestra.run.smithi045.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-3908-g05a43c8f-1jammy [21.9 MB] 2023-10-03T19:08:48.538 INFO:teuthology.orchestra.run.smithi146.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-10-03T19:08:48.563 INFO:teuthology.orchestra.run.smithi146.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-10-03T19:08:49.011 INFO:teuthology.orchestra.run.smithi146.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-3908-g05a43c8f-1jammy [238 kB] 2023-10-03T19:08:49.016 INFO:teuthology.orchestra.run.smithi146.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-3908-g05a43c8f-1jammy [214 kB] 2023-10-03T19:08:49.020 INFO:teuthology.orchestra.run.smithi146.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-3908-g05a43c8f-1jammy [23.8 kB] 2023-10-03T19:08:49.021 INFO:teuthology.orchestra.run.smithi146.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-3908-g05a43c8f-1jammy [13.2 kB] 2023-10-03T19:08:49.073 INFO:teuthology.orchestra.run.smithi146.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-3908-g05a43c8f-1jammy [28.3 kB] 2023-10-03T19:08:49.073 INFO:teuthology.orchestra.run.smithi146.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-3908-g05a43c8f-1jammy [11.5 MB] 2023-10-03T19:08:49.506 INFO:teuthology.orchestra.run.smithi146.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-3908-g05a43c8f-1jammy [82.1 kB] 2023-10-03T19:08:50.061 INFO:teuthology.orchestra.run.smithi146.stdout:Fetched 175 MB in 8s (22.9 MB/s) 2023-10-03T19:08:50.181 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-03T19:08:50.277 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 166009 files and directories currently installed.) 2023-10-03T19:08:50.278 INFO:teuthology.orchestra.run.smithi079.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-3908-g05a43c8f-1jammy [6,825 kB] 2023-10-03T19:08:50.283 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-10-03T19:08:50.312 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-10-03T19:08:50.623 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-03T19:08:50.650 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-10-03T19:08:50.690 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-03T19:08:50.904 INFO:teuthology.orchestra.run.smithi079.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-3908-g05a43c8f-1jammy [226 kB] 2023-10-03T19:08:50.911 INFO:teuthology.orchestra.run.smithi079.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-3908-g05a43c8f-1jammy [114 kB] 2023-10-03T19:08:50.916 INFO:teuthology.orchestra.run.smithi079.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-3908-g05a43c8f-1jammy [1,469 kB] 2023-10-03T19:08:50.976 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-cmd2. 2023-10-03T19:08:50.991 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-10-03T19:08:51.026 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-10-03T19:08:51.027 INFO:teuthology.orchestra.run.smithi172.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-3908-g05a43c8f-1jammy [6,825 kB] 2023-10-03T19:08:51.057 INFO:teuthology.orchestra.run.smithi079.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-3908-g05a43c8f-1jammy [9,851 kB] 2023-10-03T19:08:51.304 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libfmt8:amd64. 2023-10-03T19:08:51.319 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-10-03T19:08:51.404 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-03T19:08:51.671 INFO:teuthology.orchestra.run.smithi172.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-3908-g05a43c8f-1jammy [226 kB] 2023-10-03T19:08:51.702 INFO:teuthology.orchestra.run.smithi172.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-3908-g05a43c8f-1jammy [114 kB] 2023-10-03T19:08:51.705 INFO:teuthology.orchestra.run.smithi172.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-3908-g05a43c8f-1jammy [1,469 kB] 2023-10-03T19:08:51.748 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-10-03T19:08:51.775 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-10-03T19:08:51.815 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-03T19:08:51.896 INFO:teuthology.orchestra.run.smithi172.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-3908-g05a43c8f-1jammy [9,851 kB] 2023-10-03T19:08:52.066 INFO:teuthology.orchestra.run.smithi079.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-3908-g05a43c8f-1jammy [31.5 MB] 2023-10-03T19:08:52.143 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-03T19:08:52.169 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-10-03T19:08:52.210 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-03T19:08:52.331 INFO:teuthology.orchestra.run.smithi045.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-3908-g05a43c8f-1jammy [6,825 kB] 2023-10-03T19:08:52.521 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-03T19:08:52.570 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-10-03T19:08:52.588 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-03T19:08:53.010 INFO:teuthology.orchestra.run.smithi172.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-3908-g05a43c8f-1jammy [31.5 MB] 2023-10-03T19:08:53.041 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-03T19:08:53.067 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-03T19:08:53.116 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-03T19:08:53.179 INFO:teuthology.orchestra.run.smithi045.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-3908-g05a43c8f-1jammy [226 kB] 2023-10-03T19:08:53.206 INFO:teuthology.orchestra.run.smithi045.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-3908-g05a43c8f-1jammy [114 kB] 2023-10-03T19:08:53.217 INFO:teuthology.orchestra.run.smithi045.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-3908-g05a43c8f-1jammy [1,469 kB] 2023-10-03T19:08:53.395 INFO:teuthology.orchestra.run.smithi045.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-3908-g05a43c8f-1jammy [9,851 kB] 2023-10-03T19:08:53.494 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-03T19:08:53.509 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-03T19:08:53.544 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-03T19:08:53.872 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-03T19:08:53.898 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-03T19:08:53.939 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-03T19:08:54.350 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-10-03T19:08:54.376 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-10-03T19:08:54.416 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-03T19:08:54.628 INFO:teuthology.orchestra.run.smithi045.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-3908-g05a43c8f-1jammy [31.5 MB] 2023-10-03T19:08:54.736 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package librados2. 2023-10-03T19:08:54.762 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../011-librados2_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:08:54.803 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking librados2 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:08:54.925 INFO:teuthology.orchestra.run.smithi079.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-3908-g05a43c8f-1jammy [3,596 B] 2023-10-03T19:08:54.926 INFO:teuthology.orchestra.run.smithi079.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-3908-g05a43c8f-1jammy [810 kB] 2023-10-03T19:08:54.941 INFO:teuthology.orchestra.run.smithi079.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-3908-g05a43c8f-1jammy [2,159 kB] 2023-10-03T19:08:55.121 INFO:teuthology.orchestra.run.smithi079.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-3908-g05a43c8f-1jammy [96.5 kB] 2023-10-03T19:08:55.169 INFO:teuthology.orchestra.run.smithi079.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-3908-g05a43c8f-1jammy [124 kB] 2023-10-03T19:08:55.172 INFO:teuthology.orchestra.run.smithi079.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-3908-g05a43c8f-1jammy [1,839 kB] 2023-10-03T19:08:55.188 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package librbd1. 2023-10-03T19:08:55.204 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../012-librbd1_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:08:55.238 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking librbd1 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:08:55.398 INFO:teuthology.orchestra.run.smithi079.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-3908-g05a43c8f-1jammy [8,615 kB] 2023-10-03T19:08:55.641 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libcephfs2. 2023-10-03T19:08:55.669 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:08:55.708 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libcephfs2 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:08:55.994 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-rados. 2023-10-03T19:08:56.009 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../014-python3-rados_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:08:56.052 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-rados (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:08:56.346 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-03T19:08:56.372 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:08:56.413 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-ceph-argparse (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:08:56.528 INFO:teuthology.orchestra.run.smithi079.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-3908-g05a43c8f-1jammy [3,722 B] 2023-10-03T19:08:56.528 INFO:teuthology.orchestra.run.smithi079.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-3908-g05a43c8f-1jammy [40.9 MB] 2023-10-03T19:08:56.665 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-cephfs. 2023-10-03T19:08:56.681 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:08:56.724 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-cephfs (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:08:56.998 INFO:teuthology.orchestra.run.smithi172.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-3908-g05a43c8f-1jammy [3,596 B] 2023-10-03T19:08:56.998 INFO:teuthology.orchestra.run.smithi172.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-3908-g05a43c8f-1jammy [810 kB] 2023-10-03T19:08:57.033 INFO:teuthology.orchestra.run.smithi172.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-3908-g05a43c8f-1jammy [2,159 kB] 2023-10-03T19:08:57.043 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-03T19:08:57.069 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:08:57.110 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-ceph-common (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:08:57.323 INFO:teuthology.orchestra.run.smithi172.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-3908-g05a43c8f-1jammy [96.5 kB] 2023-10-03T19:08:57.326 INFO:teuthology.orchestra.run.smithi172.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-3908-g05a43c8f-1jammy [124 kB] 2023-10-03T19:08:57.354 INFO:teuthology.orchestra.run.smithi172.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-3908-g05a43c8f-1jammy [1,839 kB] 2023-10-03T19:08:57.421 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-prettytable. 2023-10-03T19:08:57.447 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-10-03T19:08:57.496 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-10-03T19:08:57.546 INFO:teuthology.orchestra.run.smithi172.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-3908-g05a43c8f-1jammy [8,615 kB] 2023-10-03T19:08:57.723 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-rbd. 2023-10-03T19:08:57.739 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:08:57.877 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-rbd (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:08:58.393 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-03T19:08:58.419 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-10-03T19:08:58.459 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-03T19:08:58.476 INFO:teuthology.orchestra.run.smithi172.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-3908-g05a43c8f-1jammy [3,722 B] 2023-10-03T19:08:58.476 INFO:teuthology.orchestra.run.smithi172.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-3908-g05a43c8f-1jammy [40.9 MB] 2023-10-03T19:08:58.787 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package librgw2. 2023-10-03T19:08:58.814 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../021-librgw2_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:08:58.854 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking librgw2 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:08:59.209 INFO:teuthology.orchestra.run.smithi045.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-3908-g05a43c8f-1jammy [3,596 B] 2023-10-03T19:08:59.286 INFO:teuthology.orchestra.run.smithi045.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-3908-g05a43c8f-1jammy [810 kB] 2023-10-03T19:08:59.301 INFO:teuthology.orchestra.run.smithi045.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-3908-g05a43c8f-1jammy [2,159 kB] 2023-10-03T19:08:59.381 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-rgw. 2023-10-03T19:08:59.396 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:08:59.431 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-rgw (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:08:59.440 INFO:teuthology.orchestra.run.smithi045.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-3908-g05a43c8f-1jammy [96.5 kB] 2023-10-03T19:08:59.443 INFO:teuthology.orchestra.run.smithi045.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-3908-g05a43c8f-1jammy [124 kB] 2023-10-03T19:08:59.501 INFO:teuthology.orchestra.run.smithi045.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-3908-g05a43c8f-1jammy [1,839 kB] 2023-10-03T19:08:59.679 INFO:teuthology.orchestra.run.smithi045.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-3908-g05a43c8f-1jammy [8,615 kB] 2023-10-03T19:08:59.776 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package liboath0:amd64. 2023-10-03T19:08:59.802 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-10-03T19:08:59.842 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-10-03T19:09:00.162 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libradosstriper1. 2023-10-03T19:09:00.188 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:00.204 INFO:teuthology.orchestra.run.smithi079.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-3908-g05a43c8f-1jammy [238 kB] 2023-10-03T19:09:00.209 INFO:teuthology.orchestra.run.smithi079.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-3908-g05a43c8f-1jammy [214 kB] 2023-10-03T19:09:00.213 INFO:teuthology.orchestra.run.smithi079.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-3908-g05a43c8f-1jammy [23.8 kB] 2023-10-03T19:09:00.214 INFO:teuthology.orchestra.run.smithi079.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-3908-g05a43c8f-1jammy [13.2 kB] 2023-10-03T19:09:00.214 INFO:teuthology.orchestra.run.smithi079.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-3908-g05a43c8f-1jammy [28.3 kB] 2023-10-03T19:09:00.215 INFO:teuthology.orchestra.run.smithi079.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-3908-g05a43c8f-1jammy [11.5 MB] 2023-10-03T19:09:00.228 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libradosstriper1 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:00.623 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-common. 2023-10-03T19:09:00.631 INFO:teuthology.orchestra.run.smithi045.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-3908-g05a43c8f-1jammy [3,722 B] 2023-10-03T19:09:00.632 INFO:teuthology.orchestra.run.smithi045.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-3908-g05a43c8f-1jammy [40.9 MB] 2023-10-03T19:09:00.649 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../025-ceph-common_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:00.681 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-common (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:01.062 INFO:teuthology.orchestra.run.smithi079.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-3908-g05a43c8f-1jammy [82.1 kB] 2023-10-03T19:09:01.612 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 175 MB in 19s (9,092 kB/s) 2023-10-03T19:09:01.754 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-03T19:09:01.843 INFO:teuthology.orchestra.run.smithi079.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 166009 files and directories currently installed.) 2023-10-03T19:09:01.848 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-10-03T19:09:01.894 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-10-03T19:09:01.920 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-base. 2023-10-03T19:09:01.947 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../026-ceph-base_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:01.996 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-base (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:02.148 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-03T19:09:02.173 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-10-03T19:09:02.206 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-03T19:09:02.326 INFO:teuthology.orchestra.run.smithi172.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-3908-g05a43c8f-1jammy [238 kB] 2023-10-03T19:09:02.331 INFO:teuthology.orchestra.run.smithi172.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-3908-g05a43c8f-1jammy [214 kB] 2023-10-03T19:09:02.335 INFO:teuthology.orchestra.run.smithi172.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-3908-g05a43c8f-1jammy [23.8 kB] 2023-10-03T19:09:02.336 INFO:teuthology.orchestra.run.smithi172.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-3908-g05a43c8f-1jammy [13.2 kB] 2023-10-03T19:09:02.336 INFO:teuthology.orchestra.run.smithi172.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-3908-g05a43c8f-1jammy [28.3 kB] 2023-10-03T19:09:02.337 INFO:teuthology.orchestra.run.smithi172.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-3908-g05a43c8f-1jammy [11.5 MB] 2023-10-03T19:09:02.525 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cmd2. 2023-10-03T19:09:02.551 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-10-03T19:09:02.600 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-10-03T19:09:02.920 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libfmt8:amd64. 2023-10-03T19:09:02.946 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-10-03T19:09:02.949 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-10-03T19:09:02.976 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-10-03T19:09:03.016 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-10-03T19:09:03.028 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-03T19:09:03.066 INFO:teuthology.orchestra.run.smithi172.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-3908-g05a43c8f-1jammy [82.1 kB] 2023-10-03T19:09:03.277 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-cheroot. 2023-10-03T19:09:03.303 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-10-03T19:09:03.344 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-03T19:09:03.365 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-10-03T19:09:03.391 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-10-03T19:09:03.431 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-03T19:09:03.466 INFO:teuthology.orchestra.run.smithi045.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-3908-g05a43c8f-1jammy [238 kB] 2023-10-03T19:09:03.471 INFO:teuthology.orchestra.run.smithi045.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-3908-g05a43c8f-1jammy [214 kB] 2023-10-03T19:09:03.475 INFO:teuthology.orchestra.run.smithi045.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-3908-g05a43c8f-1jammy [23.8 kB] 2023-10-03T19:09:03.476 INFO:teuthology.orchestra.run.smithi045.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-3908-g05a43c8f-1jammy [13.2 kB] 2023-10-03T19:09:03.477 INFO:teuthology.orchestra.run.smithi045.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-3908-g05a43c8f-1jammy [28.3 kB] 2023-10-03T19:09:03.478 INFO:teuthology.orchestra.run.smithi045.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-3908-g05a43c8f-1jammy [11.5 MB] 2023-10-03T19:09:03.621 INFO:teuthology.orchestra.run.smithi172.stdout:Fetched 175 MB in 21s (8,267 kB/s) 2023-10-03T19:09:03.646 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-10-03T19:09:03.673 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-10-03T19:09:03.713 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-10-03T19:09:03.743 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-03T19:09:03.761 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-03T19:09:03.769 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-10-03T19:09:03.801 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-03T19:09:03.858 INFO:teuthology.orchestra.run.smithi172.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 166009 files and directories currently installed.) 2023-10-03T19:09:03.863 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-10-03T19:09:03.902 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-10-03T19:09:03.967 INFO:teuthology.orchestra.run.smithi045.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-choffman-62793/05a43c8fb3988914c879a50970f9054a098e0612/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-3908-g05a43c8f-1jammy [82.1 kB] 2023-10-03T19:09:03.999 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-jaraco.text. 2023-10-03T19:09:04.025 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-10-03T19:09:04.065 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-10-03T19:09:04.120 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-03T19:09:04.147 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-10-03T19:09:04.187 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-03T19:09:04.196 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-03T19:09:04.222 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-10-03T19:09:04.263 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-03T19:09:04.368 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-10-03T19:09:04.394 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-10-03T19:09:04.435 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-10-03T19:09:04.546 INFO:teuthology.orchestra.run.smithi045.stdout:Fetched 175 MB in 22s (7,998 kB/s) 2023-10-03T19:09:04.616 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-cmd2. 2023-10-03T19:09:04.624 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-03T19:09:04.642 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-10-03T19:09:04.650 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-03T19:09:04.674 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-03T19:09:04.682 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-10-03T19:09:04.688 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-tempora. 2023-10-03T19:09:04.699 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-03T19:09:04.703 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-10-03T19:09:04.737 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-10-03T19:09:04.772 INFO:teuthology.orchestra.run.smithi045.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 166009 files and directories currently installed.) 2023-10-03T19:09:04.778 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-10-03T19:09:04.814 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-10-03T19:09:04.994 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libfmt8:amd64. 2023-10-03T19:09:05.020 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-10-03T19:09:05.065 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-portend. 2023-10-03T19:09:05.069 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-03T19:09:05.092 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-10-03T19:09:05.093 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-03T19:09:05.095 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-03T19:09:05.108 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-03T19:09:05.127 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-03T19:09:05.132 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-10-03T19:09:05.136 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-10-03T19:09:05.175 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-03T19:09:05.388 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-10-03T19:09:05.414 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-10-03T19:09:05.434 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-10-03T19:09:05.455 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-03T19:09:05.461 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-10-03T19:09:05.464 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-03T19:09:05.490 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-03T19:09:05.501 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-10-03T19:09:05.511 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-cmd2. 2023-10-03T19:09:05.530 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-03T19:09:05.538 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-10-03T19:09:05.577 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-10-03T19:09:05.800 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-03T19:09:05.804 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-03T19:09:05.826 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-10-03T19:09:05.831 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-10-03T19:09:05.867 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-03T19:09:05.871 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-10-03T19:09:05.917 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-10-03T19:09:05.922 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libfmt8:amd64. 2023-10-03T19:09:05.943 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-10-03T19:09:05.949 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-10-03T19:09:05.983 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-03T19:09:06.030 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-03T19:09:06.203 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-03T19:09:06.207 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-natsort. 2023-10-03T19:09:06.229 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-10-03T19:09:06.234 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-10-03T19:09:06.270 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-03T19:09:06.274 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-10-03T19:09:06.278 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librados2. 2023-10-03T19:09:06.293 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../011-librados2_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:06.308 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-10-03T19:09:06.325 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-10-03T19:09:06.327 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librados2 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:06.358 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-03T19:09:06.585 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-logutils. 2023-10-03T19:09:06.612 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-10-03T19:09:06.657 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-03T19:09:06.660 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-10-03T19:09:06.669 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-03T19:09:06.683 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-03T19:09:06.697 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-10-03T19:09:06.732 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-03T19:09:06.736 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-03T19:09:06.772 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librbd1. 2023-10-03T19:09:06.798 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../012-librbd1_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:06.838 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librbd1 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:06.963 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-03T19:09:06.989 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-10-03T19:09:07.029 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-10-03T19:09:07.072 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-03T19:09:07.100 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-10-03T19:09:07.139 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-03T19:09:07.250 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libcephfs2. 2023-10-03T19:09:07.266 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:07.307 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-mako. 2023-10-03T19:09:07.308 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libcephfs2 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:07.310 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-03T19:09:07.334 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-10-03T19:09:07.336 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-03T19:09:07.374 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-03T19:09:07.393 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-03T19:09:07.550 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-03T19:09:07.569 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rados. 2023-10-03T19:09:07.578 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-03T19:09:07.583 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../014-python3-rados_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:07.625 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-03T19:09:07.627 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rados (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:07.694 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-03T19:09:07.720 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-03T19:09:07.746 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-03T19:09:07.760 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-03T19:09:07.772 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-03T19:09:07.812 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-03T19:09:07.963 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-03T19:09:07.990 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:08.023 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-03T19:09:08.030 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-ceph-argparse (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:08.049 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-10-03T19:09:08.090 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-10-03T19:09:08.132 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-10-03T19:09:08.145 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-03T19:09:08.159 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-10-03T19:09:08.173 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-03T19:09:08.199 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-03T19:09:08.211 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-03T19:09:08.282 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cephfs. 2023-10-03T19:09:08.309 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:08.349 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cephfs (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:08.384 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-webob. 2023-10-03T19:09:08.410 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-10-03T19:09:08.451 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-10-03T19:09:08.485 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package librados2. 2023-10-03T19:09:08.511 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../011-librados2_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:08.543 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking librados2 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:08.590 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-03T19:09:08.617 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-03T19:09:08.656 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-03T19:09:08.660 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-03T19:09:08.686 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:08.751 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-ceph-common (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:08.820 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-waitress. 2023-10-03T19:09:08.847 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-10-03T19:09:08.889 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-03T19:09:08.988 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package librbd1. 2023-10-03T19:09:09.014 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../012-librbd1_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:09.017 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-10-03T19:09:09.045 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-10-03T19:09:09.054 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking librbd1 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:09.063 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-prettytable. 2023-10-03T19:09:09.084 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-03T19:09:09.089 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-10-03T19:09:09.129 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-10-03T19:09:09.173 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-tempita. 2023-10-03T19:09:09.200 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-10-03T19:09:09.240 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-10-03T19:09:09.382 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rbd. 2023-10-03T19:09:09.397 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:09.432 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rbd (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:09.491 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libcephfs2. 2023-10-03T19:09:09.517 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:09.517 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-paste. 2023-10-03T19:09:09.543 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-10-03T19:09:09.545 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package librados2. 2023-10-03T19:09:09.557 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libcephfs2 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:09.573 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../011-librados2_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:09.584 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-10-03T19:09:09.603 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking librados2 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:09.777 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-03T19:09:09.803 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-10-03T19:09:09.827 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-rados. 2023-10-03T19:09:09.843 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-03T19:09:09.853 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../014-python3-rados_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:09.885 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-rados (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:09.912 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-03T19:09:09.927 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-10-03T19:09:09.962 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-10-03T19:09:10.056 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package librbd1. 2023-10-03T19:09:10.083 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../012-librbd1_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:10.122 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking librbd1 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:10.171 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librgw2. 2023-10-03T19:09:10.188 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-03T19:09:10.197 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../021-librgw2_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:10.214 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:10.237 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librgw2 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:10.240 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-03T19:09:10.254 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-ceph-argparse (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:10.266 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-10-03T19:09:10.306 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-10-03T19:09:10.507 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-cephfs. 2023-10-03T19:09:10.522 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:10.565 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-cephfs (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:10.575 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libcephfs2. 2023-10-03T19:09:10.602 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:10.609 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-webtest. 2023-10-03T19:09:10.635 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-10-03T19:09:10.642 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libcephfs2 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:10.675 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-10-03T19:09:10.732 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rgw. 2023-10-03T19:09:10.747 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:10.781 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rgw (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:10.884 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-03T19:09:10.911 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:10.919 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-rados. 2023-10-03T19:09:10.935 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../014-python3-rados_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:10.951 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-ceph-common (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:10.977 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-rados (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:11.003 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pecan. 2023-10-03T19:09:11.030 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-10-03T19:09:11.084 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package liboath0:amd64. 2023-10-03T19:09:11.087 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-10-03T19:09:11.110 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-10-03T19:09:11.151 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-10-03T19:09:11.262 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-prettytable. 2023-10-03T19:09:11.280 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-03T19:09:11.289 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-10-03T19:09:11.307 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:11.320 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-10-03T19:09:11.346 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-ceph-argparse (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:11.437 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libradosstriper1. 2023-10-03T19:09:11.450 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-certifi. 2023-10-03T19:09:11.463 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:11.476 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-10-03T19:09:11.524 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-10-03T19:09:11.533 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libradosstriper1 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:11.599 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-rbd. 2023-10-03T19:09:11.625 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:11.665 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-rbd (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:11.665 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-cephfs. 2023-10-03T19:09:11.693 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:11.741 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-cephfs (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:11.827 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-idna. 2023-10-03T19:09:11.842 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-10-03T19:09:11.877 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-idna (3.3-1) ... 2023-10-03T19:09:12.010 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-03T19:09:12.036 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-10-03T19:09:12.068 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-03T19:09:12.076 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-03T19:09:12.095 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:12.134 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-ceph-common (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:12.182 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-common. 2023-10-03T19:09:12.197 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-urllib3. 2023-10-03T19:09:12.208 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../025-ceph-common_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:12.223 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-10-03T19:09:12.248 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-common (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:12.263 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-10-03T19:09:12.413 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package librgw2. 2023-10-03T19:09:12.439 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../021-librgw2_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:12.446 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-prettytable. 2023-10-03T19:09:12.473 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-10-03T19:09:12.482 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking librgw2 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:12.512 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-10-03T19:09:12.558 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-requests. 2023-10-03T19:09:12.584 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-10-03T19:09:12.624 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-03T19:09:12.782 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-rbd. 2023-10-03T19:09:12.809 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:12.848 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-rbd (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:12.936 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-03T19:09:12.948 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-rgw. 2023-10-03T19:09:12.962 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-10-03T19:09:12.964 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:13.002 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-03T19:09:13.006 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-rgw (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:13.272 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-03T19:09:13.287 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:13.330 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-modules-core (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:13.343 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package liboath0:amd64. 2023-10-03T19:09:13.369 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-10-03T19:09:13.409 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-10-03T19:09:13.512 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-base. 2023-10-03T19:09:13.538 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../026-ceph-base_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:13.589 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-base (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:13.693 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-03T19:09:13.720 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:13.720 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libradosstriper1. 2023-10-03T19:09:13.747 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:13.759 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:13.785 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-03T19:09:13.787 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libradosstriper1 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:13.813 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-10-03T19:09:13.851 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-03T19:09:14.071 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-openssl. 2023-10-03T19:09:14.097 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-10-03T19:09:14.179 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package librgw2. 2023-10-03T19:09:14.206 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../021-librgw2_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:14.245 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking librgw2 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:14.300 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-10-03T19:09:14.326 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-10-03T19:09:14.366 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-10-03T19:09:14.387 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-10-03T19:09:14.669 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cheroot. 2023-10-03T19:09:14.695 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-10-03T19:09:14.736 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-03T19:09:14.764 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-rgw. 2023-10-03T19:09:14.780 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:14.822 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-rgw (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:14.824 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-common. 2023-10-03T19:09:14.851 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../025-ceph-common_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:14.891 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-common (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:15.150 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr. 2023-10-03T19:09:15.157 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package liboath0:amd64. 2023-10-03T19:09:15.176 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-10-03T19:09:15.176 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:15.184 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-10-03T19:09:15.203 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-10-03T19:09:15.215 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:15.217 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-10-03T19:09:15.528 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libradosstriper1. 2023-10-03T19:09:15.555 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:15.594 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libradosstriper1 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:15.627 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mon. 2023-10-03T19:09:15.653 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:15.710 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mon (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:15.714 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-10-03T19:09:16.023 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-common. 2023-10-03T19:09:16.050 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../025-ceph-common_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:16.059 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.text. 2023-10-03T19:09:16.085 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-10-03T19:09:16.089 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-common (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:16.125 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-10-03T19:09:16.138 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-base. 2023-10-03T19:09:16.165 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../026-ceph-base_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:16.214 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-base (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:16.428 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-10-03T19:09:16.454 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-10-03T19:09:16.494 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-10-03T19:09:16.630 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-osd. 2023-10-03T19:09:16.658 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:16.696 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-osd (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:16.798 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-tempora. 2023-10-03T19:09:16.824 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-10-03T19:09:16.864 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-10-03T19:09:16.943 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-10-03T19:09:16.969 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-10-03T19:09:17.009 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-10-03T19:09:17.142 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-portend. 2023-10-03T19:09:17.169 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-10-03T19:09:17.208 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-10-03T19:09:17.271 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-cheroot. 2023-10-03T19:09:17.297 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-10-03T19:09:17.328 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-03T19:09:17.461 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-10-03T19:09:17.488 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-10-03T19:09:17.511 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-base. 2023-10-03T19:09:17.528 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-10-03T19:09:17.538 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../026-ceph-base_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:17.596 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-base (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:17.759 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-10-03T19:09:17.785 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-10-03T19:09:17.839 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-03T19:09:17.840 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-10-03T19:09:17.865 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-10-03T19:09:17.926 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-10-03T19:09:18.143 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-jaraco.text. 2023-10-03T19:09:18.169 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-10-03T19:09:18.210 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-10-03T19:09:18.226 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-natsort. 2023-10-03T19:09:18.241 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-10-03T19:09:18.276 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-10-03T19:09:18.323 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-10-03T19:09:18.340 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-10-03T19:09:18.373 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-10-03T19:09:18.512 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-10-03T19:09:18.538 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-10-03T19:09:18.579 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-10-03T19:09:18.604 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-logutils. 2023-10-03T19:09:18.631 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-10-03T19:09:18.659 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-cheroot. 2023-10-03T19:09:18.666 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph. 2023-10-03T19:09:18.670 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-10-03T19:09:18.682 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../061-ceph_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:18.686 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-10-03T19:09:18.724 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:18.750 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-03T19:09:18.857 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-tempora. 2023-10-03T19:09:18.872 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-10-03T19:09:18.907 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-10-03T19:09:18.973 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-03T19:09:19.000 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-10-03T19:09:19.041 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-10-03T19:09:19.044 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-fuse. 2023-10-03T19:09:19.070 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-10-03T19:09:19.071 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:19.097 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-10-03T19:09:19.110 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-fuse (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:19.136 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-10-03T19:09:19.210 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-portend. 2023-10-03T19:09:19.236 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-10-03T19:09:19.276 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-10-03T19:09:19.343 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-mako. 2023-10-03T19:09:19.358 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-10-03T19:09:19.401 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-03T19:09:19.439 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-jaraco.text. 2023-10-03T19:09:19.467 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-10-03T19:09:19.489 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mds. 2023-10-03T19:09:19.506 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-10-03T19:09:19.515 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:19.555 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mds (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:19.579 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-10-03T19:09:19.606 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-10-03T19:09:19.646 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-10-03T19:09:19.729 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-03T19:09:19.755 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-03T19:09:19.804 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-03T19:09:19.900 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package cephadm. 2023-10-03T19:09:19.927 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../064-cephadm_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:19.932 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-03T19:09:19.959 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-10-03T19:09:19.966 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking cephadm (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:19.990 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-10-03T19:09:20.034 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-10-03T19:09:20.062 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-10-03T19:09:20.074 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-03T19:09:20.089 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-10-03T19:09:20.100 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-10-03T19:09:20.123 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-10-03T19:09:20.294 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-asyncssh. 2023-10-03T19:09:20.321 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-10-03T19:09:20.360 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-10-03T19:09:20.361 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-natsort. 2023-10-03T19:09:20.387 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-10-03T19:09:20.403 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-tempora. 2023-10-03T19:09:20.409 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-webob. 2023-10-03T19:09:20.430 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-10-03T19:09:20.435 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-10-03T19:09:20.436 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-10-03T19:09:20.469 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-10-03T19:09:20.476 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-10-03T19:09:20.672 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python-babel-localedata. 2023-10-03T19:09:20.687 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-10-03T19:09:20.705 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-logutils. 2023-10-03T19:09:20.722 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-03T19:09:20.731 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-10-03T19:09:20.772 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-10-03T19:09:20.814 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-portend. 2023-10-03T19:09:20.821 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-waitress. 2023-10-03T19:09:20.841 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-10-03T19:09:20.847 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-10-03T19:09:20.890 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-10-03T19:09:20.890 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-03T19:09:21.041 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-03T19:09:21.068 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-10-03T19:09:21.108 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-10-03T19:09:21.217 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-10-03T19:09:21.240 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-tempita. 2023-10-03T19:09:21.244 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-10-03T19:09:21.267 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-10-03T19:09:21.283 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-10-03T19:09:21.307 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-10-03T19:09:21.410 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-mako. 2023-10-03T19:09:21.437 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-10-03T19:09:21.477 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-03T19:09:21.576 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-paste. 2023-10-03T19:09:21.586 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-03T19:09:21.603 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-10-03T19:09:21.613 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-10-03T19:09:21.634 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-10-03T19:09:21.652 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-10-03T19:09:21.785 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-babel. 2023-10-03T19:09:21.805 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-03T19:09:21.812 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-10-03T19:09:21.832 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-03T19:09:21.851 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-10-03T19:09:21.872 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-03T19:09:22.039 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-natsort. 2023-10-03T19:09:22.066 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-10-03T19:09:22.114 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-10-03T19:09:22.154 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-jinja2. 2023-10-03T19:09:22.158 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-03T19:09:22.180 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-03T19:09:22.182 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-10-03T19:09:22.185 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-10-03T19:09:22.206 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-10-03T19:09:22.229 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-10-03T19:09:22.241 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-10-03T19:09:22.246 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-10-03T19:09:22.511 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-webob. 2023-10-03T19:09:22.515 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-03T19:09:22.517 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-logutils. 2023-10-03T19:09:22.531 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-10-03T19:09:22.538 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-10-03T19:09:22.544 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-10-03T19:09:22.565 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-10-03T19:09:22.577 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-10-03T19:09:22.583 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-03T19:09:22.583 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-10-03T19:09:22.610 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:22.649 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-cephadm (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:22.835 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-webtest. 2023-10-03T19:09:22.850 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-10-03T19:09:22.885 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-10-03T19:09:22.886 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-03T19:09:22.902 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-10-03T19:09:22.922 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-waitress. 2023-10-03T19:09:22.944 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-10-03T19:09:22.949 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-10-03T19:09:23.002 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-03T19:09:23.030 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-10-03T19:09:23.069 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-10-03T19:09:23.092 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-03T19:09:23.163 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pecan. 2023-10-03T19:09:23.178 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-10-03T19:09:23.221 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-10-03T19:09:23.263 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-mako. 2023-10-03T19:09:23.274 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-10-03T19:09:23.322 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-03T19:09:23.380 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-03T19:09:23.408 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-10-03T19:09:23.425 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-tempita. 2023-10-03T19:09:23.447 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-03T19:09:23.452 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-10-03T19:09:23.492 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-10-03T19:09:23.559 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-certifi. 2023-10-03T19:09:23.586 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-10-03T19:09:23.609 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-03T19:09:23.626 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-10-03T19:09:23.636 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-03T19:09:23.666 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-03T19:09:23.708 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-routes. 2023-10-03T19:09:23.735 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-10-03T19:09:23.766 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-10-03T19:09:23.778 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-paste. 2023-10-03T19:09:23.805 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-10-03T19:09:23.844 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-10-03T19:09:23.944 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-03T19:09:23.945 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-idna. 2023-10-03T19:09:23.971 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-10-03T19:09:23.972 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-10-03T19:09:24.011 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-10-03T19:09:24.011 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-idna (3.3-1) ... 2023-10-03T19:09:24.069 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-03T19:09:24.096 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:24.136 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-dashboard (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:24.147 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-03T19:09:24.163 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-10-03T19:09:24.205 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-10-03T19:09:24.297 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-webob. 2023-10-03T19:09:24.324 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-10-03T19:09:24.348 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-urllib3. 2023-10-03T19:09:24.363 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-10-03T19:09:24.375 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-10-03T19:09:24.415 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-10-03T19:09:24.517 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-03T19:09:24.544 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-10-03T19:09:24.583 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-10-03T19:09:24.589 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-10-03T19:09:24.605 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-10-03T19:09:24.648 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-03T19:09:24.716 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-waitress. 2023-10-03T19:09:24.744 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-10-03T19:09:24.744 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-requests. 2023-10-03T19:09:24.769 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-10-03T19:09:24.786 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-03T19:09:24.809 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-03T19:09:24.861 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-webtest. 2023-10-03T19:09:24.877 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-10-03T19:09:24.911 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-10-03T19:09:25.077 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-tempita. 2023-10-03T19:09:25.104 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-03T19:09:25.104 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-10-03T19:09:25.119 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-10-03T19:09:25.143 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-10-03T19:09:25.153 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-03T19:09:25.172 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pecan. 2023-10-03T19:09:25.184 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-joblib. 2023-10-03T19:09:25.199 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-10-03T19:09:25.211 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-10-03T19:09:25.230 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-10-03T19:09:25.250 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-10-03T19:09:25.379 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-paste. 2023-10-03T19:09:25.396 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-10-03T19:09:25.429 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-10-03T19:09:25.440 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-03T19:09:25.467 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:25.507 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-modules-core (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:25.597 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-10-03T19:09:25.602 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-certifi. 2023-10-03T19:09:25.623 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-10-03T19:09:25.629 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-10-03T19:09:25.662 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-10-03T19:09:25.669 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-10-03T19:09:25.749 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-03T19:09:25.765 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-10-03T19:09:25.799 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-10-03T19:09:25.895 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-03T19:09:25.921 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:25.961 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:25.973 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-sklearn. 2023-10-03T19:09:25.997 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-idna. 2023-10-03T19:09:26.000 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-10-03T19:09:26.024 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-10-03T19:09:26.040 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-03T19:09:26.063 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-idna (3.3-1) ... 2023-10-03T19:09:26.077 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-03T19:09:26.104 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-10-03T19:09:26.135 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-10-03T19:09:26.306 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-openssl. 2023-10-03T19:09:26.332 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-10-03T19:09:26.333 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-urllib3. 2023-10-03T19:09:26.360 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-10-03T19:09:26.372 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-10-03T19:09:26.400 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-10-03T19:09:26.438 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-webtest. 2023-10-03T19:09:26.465 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-10-03T19:09:26.504 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-10-03T19:09:26.653 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-requests. 2023-10-03T19:09:26.667 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr. 2023-10-03T19:09:26.679 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-10-03T19:09:26.682 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:26.717 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:26.719 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-03T19:09:26.782 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-03T19:09:26.810 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:26.824 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pecan. 2023-10-03T19:09:26.848 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:26.851 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-10-03T19:09:26.890 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-10-03T19:09:27.030 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-03T19:09:27.058 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-10-03T19:09:27.087 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mon. 2023-10-03T19:09:27.097 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-03T19:09:27.113 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:27.178 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mon (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:27.261 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-certifi. 2023-10-03T19:09:27.289 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-10-03T19:09:27.327 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-10-03T19:09:27.402 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-03T19:09:27.429 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:27.468 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr-modules-core (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:27.655 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-idna. 2023-10-03T19:09:27.683 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-10-03T19:09:27.722 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-idna (3.3-1) ... 2023-10-03T19:09:27.801 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-cachetools. 2023-10-03T19:09:27.828 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-10-03T19:09:27.840 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-03T19:09:27.867 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:27.868 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-10-03T19:09:27.907 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:27.975 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-urllib3. 2023-10-03T19:09:28.002 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-10-03T19:09:28.033 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-10-03T19:09:28.124 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-osd. 2023-10-03T19:09:28.137 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-03T19:09:28.150 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:28.164 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-10-03T19:09:28.190 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-osd (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:28.195 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-10-03T19:09:28.302 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-requests. 2023-10-03T19:09:28.318 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-10-03T19:09:28.352 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-03T19:09:28.360 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-openssl. 2023-10-03T19:09:28.387 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-10-03T19:09:28.426 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-10-03T19:09:28.482 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-03T19:09:28.509 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-10-03T19:09:28.548 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-10-03T19:09:28.630 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-03T19:09:28.657 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-10-03T19:09:28.697 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-03T19:09:28.763 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr. 2023-10-03T19:09:28.790 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:28.834 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-rsa. 2023-10-03T19:09:28.838 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:28.862 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-10-03T19:09:28.900 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-rsa (4.8-1) ... 2023-10-03T19:09:28.966 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-03T19:09:28.983 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:29.016 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr-modules-core (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:29.183 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mon. 2023-10-03T19:09:29.209 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:29.241 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mon (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:29.306 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-google-auth. 2023-10-03T19:09:29.333 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-10-03T19:09:29.372 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-10-03T19:09:29.387 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-03T19:09:29.415 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:29.454 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:29.692 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-03T19:09:29.719 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-10-03T19:09:29.740 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-openssl. 2023-10-03T19:09:29.759 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-03T19:09:29.768 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-10-03T19:09:29.798 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-10-03T19:09:29.986 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph. 2023-10-03T19:09:30.012 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../061-ceph_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:30.052 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:30.062 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-websocket. 2023-10-03T19:09:30.089 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-10-03T19:09:30.120 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-10-03T19:09:30.170 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-osd. 2023-10-03T19:09:30.197 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:30.236 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-osd (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:30.285 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr. 2023-10-03T19:09:30.314 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:30.397 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-fuse. 2023-10-03T19:09:30.401 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:30.423 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:30.463 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-fuse (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:30.465 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-03T19:09:30.492 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-10-03T19:09:30.531 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-03T19:09:30.804 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mon. 2023-10-03T19:09:30.825 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mds. 2023-10-03T19:09:30.832 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:30.852 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:30.871 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mon (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:30.883 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mds (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:31.211 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-03T19:09:31.227 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:31.261 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package cephadm. 2023-10-03T19:09:31.270 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:31.287 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../064-cephadm_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:31.327 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking cephadm (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:31.655 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-asyncssh. 2023-10-03T19:09:31.682 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-10-03T19:09:31.722 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-10-03T19:09:31.748 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-03T19:09:31.749 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-osd. 2023-10-03T19:09:31.775 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-10-03T19:09:31.777 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:31.807 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-osd (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:31.814 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-03T19:09:32.006 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph. 2023-10-03T19:09:32.033 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-babel-localedata. 2023-10-03T19:09:32.033 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../061-ceph_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:32.048 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-10-03T19:09:32.072 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:32.091 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-03T19:09:32.125 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-03T19:09:32.153 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-10-03T19:09:32.192 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-03T19:09:32.350 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-fuse. 2023-10-03T19:09:32.377 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:32.408 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-fuse (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:32.428 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package jq. 2023-10-03T19:09:32.455 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-10-03T19:09:32.494 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-10-03T19:09:32.747 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package socat. 2023-10-03T19:09:32.774 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-10-03T19:09:32.822 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-10-03T19:09:32.879 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mds. 2023-10-03T19:09:32.906 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:32.945 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mds (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:33.133 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package xmlstarlet. 2023-10-03T19:09:33.161 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-10-03T19:09:33.200 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-10-03T19:09:33.230 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-babel. 2023-10-03T19:09:33.245 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-10-03T19:09:33.304 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-10-03T19:09:33.332 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package cephadm. 2023-10-03T19:09:33.358 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../064-cephadm_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:33.399 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking cephadm (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:33.554 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-test. 2023-10-03T19:09:33.570 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../093-ceph-test_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:33.600 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jinja2. 2023-10-03T19:09:33.626 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-10-03T19:09:33.629 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-test (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:33.657 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-10-03T19:09:33.710 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-asyncssh. 2023-10-03T19:09:33.737 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-10-03T19:09:33.776 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-10-03T19:09:33.902 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph. 2023-10-03T19:09:33.918 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../061-ceph_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:33.960 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:33.969 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-03T19:09:33.996 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:34.027 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-cephadm (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:34.079 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python-babel-localedata. 2023-10-03T19:09:34.094 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-10-03T19:09:34.137 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-03T19:09:34.279 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-fuse. 2023-10-03T19:09:34.307 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:34.339 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-03T19:09:34.346 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-fuse (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:34.366 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-10-03T19:09:34.397 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-10-03T19:09:34.667 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-03T19:09:34.676 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mds. 2023-10-03T19:09:34.693 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-10-03T19:09:34.704 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:34.733 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-03T19:09:34.742 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mds (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:35.020 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-routes. 2023-10-03T19:09:35.046 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-10-03T19:09:35.086 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-10-03T19:09:35.101 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-babel. 2023-10-03T19:09:35.112 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package cephadm. 2023-10-03T19:09:35.129 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-10-03T19:09:35.140 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../064-cephadm_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:35.159 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-10-03T19:09:35.178 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking cephadm (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:35.423 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-03T19:09:35.445 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-jinja2. 2023-10-03T19:09:35.449 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:35.473 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-10-03T19:09:35.489 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-dashboard (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:35.498 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-asyncssh. 2023-10-03T19:09:35.512 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-10-03T19:09:35.526 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-10-03T19:09:35.564 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-10-03T19:09:35.590 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-volume. 2023-10-03T19:09:35.607 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:35.649 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-volume (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:35.857 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-03T19:09:35.884 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:35.885 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-10-03T19:09:35.892 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python-babel-localedata. 2023-10-03T19:09:35.908 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-10-03T19:09:35.909 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-10-03T19:09:35.923 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr-cephadm (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:35.950 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-03T19:09:35.951 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-03T19:09:35.995 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-03T19:09:36.011 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:36.053 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking cephfs-mirror (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:36.269 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-03T19:09:36.296 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-10-03T19:09:36.335 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-10-03T19:09:36.356 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-colorama. 2023-10-03T19:09:36.384 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-10-03T19:09:36.422 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-10-03T19:09:36.463 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-joblib. 2023-10-03T19:09:36.490 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-10-03T19:09:36.546 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-10-03T19:09:36.646 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-03T19:09:36.673 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-10-03T19:09:36.684 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package cephfs-shell. 2023-10-03T19:09:36.711 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:36.713 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-03T19:09:36.750 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking cephfs-shell (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:36.908 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-10-03T19:09:36.935 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-10-03T19:09:36.974 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-10-03T19:09:37.011 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package cephfs-top. 2023-10-03T19:09:37.014 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-babel. 2023-10-03T19:09:37.016 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-routes. 2023-10-03T19:09:37.027 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:37.042 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-10-03T19:09:37.043 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-10-03T19:09:37.069 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking cephfs-top (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:37.071 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-10-03T19:09:37.082 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-10-03T19:09:37.277 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-sklearn. 2023-10-03T19:09:37.304 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-10-03T19:09:37.344 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-03T19:09:37.346 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-03T19:09:37.358 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-jinja2. 2023-10-03T19:09:37.374 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:37.386 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-10-03T19:09:37.413 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libcephfs-dev (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:37.419 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-03T19:09:37.424 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-10-03T19:09:37.446 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:37.486 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr-dashboard (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:37.744 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-03T19:09:37.758 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package nvme-cli. 2023-10-03T19:09:37.772 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:37.786 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-10-03T19:09:37.811 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr-cephadm (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:37.824 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-10-03T19:09:37.939 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-10-03T19:09:37.955 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-10-03T19:09:37.997 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-03T19:09:38.019 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-03T19:09:38.047 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:38.085 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:38.131 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-03T19:09:38.159 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-10-03T19:09:38.197 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-10-03T19:09:38.204 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-10-03T19:09:38.232 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-10-03T19:09:38.279 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-10-03T19:09:38.508 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-03T19:09:38.536 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-10-03T19:09:38.575 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-03T19:09:38.651 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-joblib. 2023-10-03T19:09:38.678 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-10-03T19:09:38.709 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-10-03T19:09:38.749 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-iniconfig. 2023-10-03T19:09:38.777 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-10-03T19:09:38.824 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-10-03T19:09:38.878 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-routes. 2023-10-03T19:09:38.906 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-10-03T19:09:38.944 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-10-03T19:09:39.022 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cachetools. 2023-10-03T19:09:39.050 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-10-03T19:09:39.071 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-10-03T19:09:39.088 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-10-03T19:09:39.098 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-10-03T19:09:39.138 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-10-03T19:09:39.297 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-03T19:09:39.325 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:39.363 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr-dashboard (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:39.391 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-03T19:09:39.419 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-10-03T19:09:39.426 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pastescript. 2023-10-03T19:09:39.441 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-sklearn. 2023-10-03T19:09:39.454 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-10-03T19:09:39.466 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-10-03T19:09:39.468 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-10-03T19:09:39.493 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-03T19:09:39.507 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-03T19:09:39.775 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-10-03T19:09:39.792 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-10-03T19:09:39.794 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-03T19:09:39.821 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-10-03T19:09:39.822 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pluggy. 2023-10-03T19:09:39.833 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-03T19:09:39.849 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-10-03T19:09:39.861 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-10-03T19:09:39.887 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-10-03T19:09:40.174 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rsa. 2023-10-03T19:09:40.199 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-psutil. 2023-10-03T19:09:40.201 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-10-03T19:09:40.227 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-10-03T19:09:40.241 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rsa (4.8-1) ... 2023-10-03T19:09:40.258 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-03T19:09:40.265 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-10-03T19:09:40.286 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:40.324 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:40.329 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-joblib. 2023-10-03T19:09:40.357 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-10-03T19:09:40.395 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-10-03T19:09:40.627 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-py. 2023-10-03T19:09:40.646 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-google-auth. 2023-10-03T19:09:40.655 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-10-03T19:09:40.673 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-10-03T19:09:40.701 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-py (1.10.0-1) ... 2023-10-03T19:09:40.713 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-10-03T19:09:40.715 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-10-03T19:09:40.743 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-10-03T19:09:40.781 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-10-03T19:09:40.992 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-03T19:09:41.019 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-10-03T19:09:41.038 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pygments. 2023-10-03T19:09:41.050 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-03T19:09:41.066 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-10-03T19:09:41.084 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-sklearn. 2023-10-03T19:09:41.104 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-10-03T19:09:41.112 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-10-03T19:09:41.151 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-03T19:09:41.286 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-cachetools. 2023-10-03T19:09:41.313 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-10-03T19:09:41.352 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-10-03T19:09:41.353 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-websocket. 2023-10-03T19:09:41.381 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-10-03T19:09:41.419 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-10-03T19:09:41.508 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-03T19:09:41.525 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-10-03T19:09:41.558 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-10-03T19:09:41.630 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-03T19:09:41.657 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-10-03T19:09:41.696 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-10-03T19:09:41.740 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-03T19:09:41.767 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-10-03T19:09:41.806 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-03T19:09:41.851 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-03T19:09:41.869 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-toml. 2023-10-03T19:09:41.879 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:41.897 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-10-03T19:09:41.917 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:41.935 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-10-03T19:09:42.041 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-03T19:09:42.068 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-10-03T19:09:42.108 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-10-03T19:09:42.238 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pytest. 2023-10-03T19:09:42.266 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-10-03T19:09:42.305 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-10-03T19:09:42.419 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-rsa. 2023-10-03T19:09:42.447 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-10-03T19:09:42.485 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-rsa (4.8-1) ... 2023-10-03T19:09:42.521 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-03T19:09:42.549 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:42.587 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:42.642 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-simplejson. 2023-10-03T19:09:42.670 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-10-03T19:09:42.708 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-10-03T19:09:42.882 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-google-auth. 2023-10-03T19:09:42.886 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-cachetools. 2023-10-03T19:09:42.899 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-03T19:09:42.909 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-10-03T19:09:42.914 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-10-03T19:09:42.926 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-10-03T19:09:42.949 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-10-03T19:09:42.953 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-10-03T19:09:42.965 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-03T19:09:42.977 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-03T19:09:43.005 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-10-03T19:09:43.044 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-10-03T19:09:43.264 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-03T19:09:43.269 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-03T19:09:43.269 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-03T19:09:43.292 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-10-03T19:09:43.296 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-10-03T19:09:43.296 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-10-03T19:09:43.330 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-10-03T19:09:43.335 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-03T19:09:43.335 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-03T19:09:43.596 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package jq. 2023-10-03T19:09:43.612 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-10-03T19:09:43.648 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-websocket. 2023-10-03T19:09:43.654 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-10-03T19:09:43.674 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-10-03T19:09:43.675 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-03T19:09:43.758 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-10-03T19:09:43.759 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-10-03T19:09:43.759 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-10-03T19:09:43.790 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package radosgw. 2023-10-03T19:09:43.818 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../113-radosgw_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:43.856 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking radosgw (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:43.907 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package socat. 2023-10-03T19:09:43.935 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-10-03T19:09:43.974 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-10-03T19:09:44.050 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-03T19:09:44.053 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-rsa. 2023-10-03T19:09:44.069 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-10-03T19:09:44.077 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-10-03T19:09:44.111 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-rsa (4.8-1) ... 2023-10-03T19:09:44.116 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-03T19:09:44.278 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package xmlstarlet. 2023-10-03T19:09:44.293 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-10-03T19:09:44.336 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-10-03T19:09:44.482 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-google-auth. 2023-10-03T19:09:44.510 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-10-03T19:09:44.549 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-10-03T19:09:44.634 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package rbd-fuse. 2023-10-03T19:09:44.650 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:44.692 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking rbd-fuse (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:44.699 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-test. 2023-10-03T19:09:44.726 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../093-ceph-test_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:44.765 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-test (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:44.772 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-03T19:09:44.788 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:44.822 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:44.877 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-03T19:09:44.906 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-10-03T19:09:44.944 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-03T19:09:44.996 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-10-03T19:09:45.108 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-03T19:09:45.135 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-10-03T19:09:45.175 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-03T19:09:45.238 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-03T19:09:45.255 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-websocket. 2023-10-03T19:09:45.283 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-10-03T19:09:45.321 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-10-03T19:09:45.373 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-10-03T19:09:45.520 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-03T19:09:45.547 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-10-03T19:09:45.586 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-03T19:09:45.636 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-10-03T19:09:45.834 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-03T19:09:45.855 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package jq. 2023-10-03T19:09:45.862 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-10-03T19:09:45.883 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-10-03T19:09:45.899 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-03T19:09:45.922 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-10-03T19:09:46.004 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-10-03T19:09:46.150 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package socat. 2023-10-03T19:09:46.166 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-10-03T19:09:46.200 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-10-03T19:09:46.479 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package xmlstarlet. 2023-10-03T19:09:46.489 INFO:teuthology.orchestra.run.smithi146.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-10-03T19:09:46.506 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-10-03T19:09:46.544 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-10-03T19:09:46.563 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-03T19:09:46.583 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up cephadm (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:46.592 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:46.629 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:46.694 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-volume. 2023-10-03T19:09:46.710 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:46.752 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-volume (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:46.882 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-test. 2023-10-03T19:09:46.909 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../093-ceph-test_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:46.940 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-test (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:46.949 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-03T19:09:46.977 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-10-03T19:09:47.007 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-03T19:09:47.058 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-03T19:09:47.074 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:47.108 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking cephfs-mirror (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:47.143 INFO:teuthology.orchestra.run.smithi146.stdout:Adding system user cephadm....done 2023-10-03T19:09:47.289 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-03T19:09:47.352 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-03T19:09:47.380 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-10-03T19:09:47.394 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-colorama. 2023-10-03T19:09:47.422 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-10-03T19:09:47.434 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-03T19:09:47.460 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-10-03T19:09:47.590 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-10-03T19:09:47.679 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package jq. 2023-10-03T19:09:47.696 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-10-03T19:09:47.722 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package cephfs-shell. 2023-10-03T19:09:47.737 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-10-03T19:09:47.749 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:47.788 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking cephfs-shell (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:47.841 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-10-03T19:09:47.981 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package socat. 2023-10-03T19:09:47.992 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-10-03T19:09:47.998 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-10-03T19:09:48.039 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-10-03T19:09:48.050 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package cephfs-top. 2023-10-03T19:09:48.066 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:48.108 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking cephfs-top (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:48.244 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-03T19:09:48.309 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package xmlstarlet. 2023-10-03T19:09:48.326 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-10-03T19:09:48.336 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-03T19:09:48.352 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:48.359 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-10-03T19:09:48.486 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-10-03T19:09:48.575 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libcephfs-dev (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:48.587 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-py (1.10.0-1) ... 2023-10-03T19:09:48.679 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-test. 2023-10-03T19:09:48.693 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../093-ceph-test_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:48.737 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-test (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:48.752 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-volume. 2023-10-03T19:09:48.768 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:48.810 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-volume (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:48.899 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-10-03T19:09:49.031 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package nvme-cli. 2023-10-03T19:09:49.059 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-10-03T19:09:49.106 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-10-03T19:09:49.259 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-10-03T19:09:49.332 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-03T19:09:49.360 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:49.398 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking cephfs-mirror (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:49.436 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-10-03T19:09:49.453 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-10-03T19:09:49.495 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-10-03T19:09:49.668 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-colorama. 2023-10-03T19:09:49.696 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-10-03T19:09:49.719 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-10-03T19:09:49.735 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-10-03T19:09:49.898 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-iniconfig. 2023-10-03T19:09:49.926 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-10-03T19:09:49.953 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-10-03T19:09:49.964 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-10-03T19:09:49.996 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package cephfs-shell. 2023-10-03T19:09:50.023 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:50.062 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking cephfs-shell (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:50.221 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-10-03T19:09:50.276 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pastescript. 2023-10-03T19:09:50.304 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-10-03T19:09:50.306 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package cephfs-top. 2023-10-03T19:09:50.322 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:50.342 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-03T19:09:50.365 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking cephfs-top (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:50.472 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-10-03T19:09:50.618 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-03T19:09:50.645 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:50.663 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pluggy. 2023-10-03T19:09:50.676 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libcephfs-dev (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:50.690 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-10-03T19:09:50.691 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-volume. 2023-10-03T19:09:50.708 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:50.729 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-10-03T19:09:50.738 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-10-03T19:09:50.749 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-volume (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:51.016 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-ceph-argparse (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:51.038 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package nvme-cli. 2023-10-03T19:09:51.041 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-psutil. 2023-10-03T19:09:51.065 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-10-03T19:09:51.068 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-10-03T19:09:51.099 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-10-03T19:09:51.104 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-10-03T19:09:51.112 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-03T19:09:51.141 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:51.170 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking cephfs-mirror (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:51.284 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-03T19:09:51.410 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-10-03T19:09:51.436 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-py. 2023-10-03T19:09:51.448 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-colorama. 2023-10-03T19:09:51.463 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-10-03T19:09:51.476 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-10-03T19:09:51.484 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-10-03T19:09:51.502 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-py (1.10.0-1) ... 2023-10-03T19:09:51.511 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-10-03T19:09:51.514 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-10-03T19:09:51.567 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-10-03T19:09:51.686 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-10-03T19:09:51.784 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package cephfs-shell. 2023-10-03T19:09:51.800 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:51.806 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pygments. 2023-10-03T19:09:51.833 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-10-03T19:09:51.842 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking cephfs-shell (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:51.872 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-10-03T19:09:51.920 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-03T19:09:52.021 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-10-03T19:09:52.054 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-iniconfig. 2023-10-03T19:09:52.081 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-10-03T19:09:52.103 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package cephfs-top. 2023-10-03T19:09:52.128 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-10-03T19:09:52.131 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-3908-g05a43c8f-1jammy_all.deb ... 2023-10-03T19:09:52.169 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking cephfs-top (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:52.327 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-03T19:09:52.343 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-10-03T19:09:52.364 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-03T19:09:52.385 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-10-03T19:09:52.413 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-03T19:09:52.430 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:52.448 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pastescript. 2023-10-03T19:09:52.463 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libcephfs-dev (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:52.475 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-10-03T19:09:52.490 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-10-03T19:09:52.514 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-03T19:09:52.671 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-toml. 2023-10-03T19:09:52.687 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-10-03T19:09:52.729 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-10-03T19:09:52.758 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-10-03T19:09:52.783 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package nvme-cli. 2023-10-03T19:09:52.811 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-10-03T19:09:52.835 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pluggy. 2023-10-03T19:09:52.849 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-10-03T19:09:52.862 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-10-03T19:09:52.901 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-10-03T19:09:53.025 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-10-03T19:09:53.033 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pytest. 2023-10-03T19:09:53.060 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-10-03T19:09:53.099 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-10-03T19:09:53.179 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-10-03T19:09:53.208 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-10-03T19:09:53.213 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-psutil. 2023-10-03T19:09:53.240 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-10-03T19:09:53.245 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-10-03T19:09:53.279 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-10-03T19:09:53.326 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-10-03T19:09:53.412 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-simplejson. 2023-10-03T19:09:53.439 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-10-03T19:09:53.478 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-10-03T19:09:53.615 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-iniconfig. 2023-10-03T19:09:53.616 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-py. 2023-10-03T19:09:53.643 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-10-03T19:09:53.644 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-10-03T19:09:53.681 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-10-03T19:09:53.682 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-py (1.10.0-1) ... 2023-10-03T19:09:53.739 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-03T19:09:53.755 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-10-03T19:09:53.814 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-10-03T19:09:53.968 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pastescript. 2023-10-03T19:09:53.996 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-10-03T19:09:54.002 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pygments. 2023-10-03T19:09:54.029 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-10-03T19:09:54.030 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-10-03T19:09:54.034 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-03T19:09:54.069 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-10-03T19:09:54.279 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-10-03T19:09:54.337 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pluggy. 2023-10-03T19:09:54.366 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-10-03T19:09:54.380 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-10-03T19:09:54.403 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-10-03T19:09:54.490 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-03T19:09:54.531 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-03T19:09:54.559 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-10-03T19:09:54.577 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package radosgw. 2023-10-03T19:09:54.597 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-10-03T19:09:54.605 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../113-radosgw_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:54.643 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking radosgw (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:54.731 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-psutil. 2023-10-03T19:09:54.760 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-10-03T19:09:54.791 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-10-03T19:09:54.798 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-10-03T19:09:54.917 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-toml. 2023-10-03T19:09:54.944 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-10-03T19:09:54.983 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-10-03T19:09:55.160 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-py. 2023-10-03T19:09:55.175 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-10-03T19:09:55.188 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-10-03T19:09:55.234 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-py (1.10.0-1) ... 2023-10-03T19:09:55.245 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pytest. 2023-10-03T19:09:55.260 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-10-03T19:09:55.294 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-10-03T19:09:55.396 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package rbd-fuse. 2023-10-03T19:09:55.412 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:55.426 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-10-03T19:09:55.454 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking rbd-fuse (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:55.562 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pygments. 2023-10-03T19:09:55.591 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-10-03T19:09:55.628 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-10-03T19:09:55.640 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-simplejson. 2023-10-03T19:09:55.667 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-10-03T19:09:55.706 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-10-03T19:09:55.751 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-10-03T19:09:55.794 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-03T19:09:55.977 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-03T19:09:55.984 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-03T19:09:56.000 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-10-03T19:09:56.034 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-10-03T19:09:56.041 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-03T19:09:56.070 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-10-03T19:09:56.078 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-10-03T19:09:56.096 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-10-03T19:09:56.099 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-10-03T19:09:56.341 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-10-03T19:09:56.397 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-03T19:09:56.418 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-toml. 2023-10-03T19:09:56.447 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-10-03T19:09:56.485 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-10-03T19:09:56.680 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-10-03T19:09:56.721 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package radosgw. 2023-10-03T19:09:56.739 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-10-03T19:09:56.749 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../113-radosgw_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:56.779 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking radosgw (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:56.796 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pytest. 2023-10-03T19:09:56.824 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-10-03T19:09:56.862 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-10-03T19:09:57.000 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-10-03T19:09:57.125 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-ceph-common (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:57.129 INFO:teuthology.orchestra.run.smithi079.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-10-03T19:09:57.205 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up cephadm (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:57.207 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-simplejson. 2023-10-03T19:09:57.236 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-10-03T19:09:57.273 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-10-03T19:09:57.410 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-idna (3.3-1) ... 2023-10-03T19:09:57.490 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package rbd-fuse. 2023-10-03T19:09:57.518 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:57.526 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-03T19:09:57.543 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-10-03T19:09:57.557 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking rbd-fuse (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:57.584 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-10-03T19:09:57.719 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-03T19:09:57.740 INFO:teuthology.orchestra.run.smithi079.stdout:Adding system user cephadm....done 2023-10-03T19:09:57.841 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-10-03T19:09:57.862 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-03T19:09:58.104 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-03T19:09:58.130 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-10-03T19:09:58.230 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-10-03T19:09:58.371 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package radosgw. 2023-10-03T19:09:58.400 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../113-radosgw_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:58.407 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-10-03T19:09:58.437 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking radosgw (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:58.492 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-10-03T19:09:58.525 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-10-03T19:09:58.759 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-03T19:09:58.863 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-10-03T19:09:58.883 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-03T19:09:58.994 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-10-03T19:09:59.018 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-toml (0.10.2-1) ... 2023-10-03T19:09:59.120 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-py (1.10.0-1) ... 2023-10-03T19:09:59.174 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package rbd-fuse. 2023-10-03T19:09:59.191 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-3908-g05a43c8f-1jammy_amd64.deb ... 2023-10-03T19:09:59.232 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking rbd-fuse (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:59.285 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-03T19:09:59.327 INFO:teuthology.orchestra.run.smithi172.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-10-03T19:09:59.390 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up cephadm (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:09:59.411 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-10-03T19:09:59.422 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-10-03T19:09:59.512 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-10-03T19:09:59.520 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-10-03T19:09:59.822 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-10-03T19:09:59.832 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-10-03T19:09:59.845 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-03T19:09:59.950 INFO:teuthology.orchestra.run.smithi172.stdout:Adding system user cephadm....done 2023-10-03T19:09:59.971 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-10-03T19:10:00.067 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-10-03T19:10:00.073 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-10-03T19:10:00.096 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-03T19:10:00.237 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-10-03T19:10:00.310 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-10-03T19:10:00.324 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-03T19:10:00.381 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-10-03T19:10:00.450 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-03T19:10:00.569 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-10-03T19:10:00.576 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-10-03T19:10:00.632 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-10-03T19:10:00.636 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-10-03T19:10:00.742 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-10-03T19:10:00.821 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-10-03T19:10:00.877 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-10-03T19:10:00.985 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-03T19:10:01.080 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-10-03T19:10:01.120 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-10-03T19:10:01.122 INFO:teuthology.orchestra.run.smithi045.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-10-03T19:10:01.227 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-10-03T19:10:01.235 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up cephadm (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:01.348 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-ceph-argparse (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:01.354 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-py (1.10.0-1) ... 2023-10-03T19:10:01.354 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-10-03T19:10:01.597 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-03T19:10:01.650 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-03T19:10:01.689 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-10-03T19:10:01.751 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-10-03T19:10:01.848 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-10-03T19:10:01.985 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-10-03T19:10:02.041 INFO:teuthology.orchestra.run.smithi045.stdout:Adding system user cephadm....done 2023-10-03T19:10:02.057 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-10-03T19:10:02.116 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-03T19:10:02.187 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-03T19:10:02.236 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-03T19:10:02.264 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-10-03T19:10:02.308 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-10-03T19:10:02.363 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-10-03T19:10:02.446 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-10-03T19:10:02.560 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-03T19:10:02.568 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-10-03T19:10:02.669 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-03T19:10:02.714 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-10-03T19:10:02.764 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-03T19:10:02.840 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-10-03T19:10:02.853 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-10-03T19:10:02.882 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-10-03T19:10:02.953 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-10-03T19:10:03.091 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-03T19:10:03.112 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-10-03T19:10:03.125 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-10-03T19:10:03.230 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-10-03T19:10:03.367 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-10-03T19:10:03.368 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-10-03T19:10:03.371 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-10-03T19:10:03.464 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-10-03T19:10:03.493 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-py (1.10.0-1) ... 2023-10-03T19:10:03.622 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-ceph-argparse (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:03.644 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-10-03T19:10:03.795 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-10-03T19:10:03.858 INFO:teuthology.orchestra.run.smithi146.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-10-03T19:10:03.931 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-03T19:10:04.058 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-10-03T19:10:04.100 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-03T19:10:04.163 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-10-03T19:10:04.226 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-10-03T19:10:04.309 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-10-03T19:10:04.329 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-10-03T19:10:04.406 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-10-03T19:10:04.589 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-10-03T19:10:04.619 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-10-03T19:10:04.657 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-10-03T19:10:04.715 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-10-03T19:10:04.769 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-03T19:10:04.816 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-03T19:10:04.870 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-portend (3.0.0-1) ... 2023-10-03T19:10:04.878 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-10-03T19:10:04.933 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-10-03T19:10:05.092 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-10-03T19:10:05.113 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-03T19:10:05.201 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-10-03T19:10:05.222 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-10-03T19:10:05.262 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-03T19:10:05.388 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-10-03T19:10:05.461 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-10-03T19:10:05.461 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-10-03T19:10:05.532 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-10-03T19:10:05.656 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-10-03T19:10:05.703 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-ceph-argparse (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:05.711 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-10-03T19:10:05.849 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-03T19:10:05.915 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-10-03T19:10:05.954 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-03T19:10:06.080 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-10-03T19:10:06.105 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-03T19:10:06.117 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-10-03T19:10:06.225 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-10-03T19:10:06.243 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-rsa (4.8-1) ... 2023-10-03T19:10:06.331 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-10-03T19:10:06.398 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-10-03T19:10:06.494 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-10-03T19:10:06.565 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-03T19:10:06.691 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-03T19:10:06.692 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-10-03T19:10:06.737 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-03T19:10:06.960 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-10-03T19:10:06.980 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-10-03T19:10:07.018 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-10-03T19:10:07.059 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-03T19:10:07.185 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-10-03T19:10:07.220 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-10-03T19:10:07.261 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-10-03T19:10:07.331 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-03T19:10:07.346 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-10-03T19:10:07.387 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-ceph-common (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:07.445 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-10-03T19:10:07.472 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-03T19:10:07.624 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-10-03T19:10:07.695 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-10-03T19:10:07.696 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-idna (3.3-1) ... 2023-10-03T19:10:07.773 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-10-03T19:10:07.951 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-03T19:10:07.997 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-10-03T19:10:08.031 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-03T19:10:08.061 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up librados2 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:08.149 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-10-03T19:10:08.178 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up librgw2 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:08.390 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libsqlite3-mod-ceph (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:08.400 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-10-03T19:10:08.524 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libcephfs2 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:08.650 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libradosstriper1 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:08.665 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-10-03T19:10:08.776 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-10-03T19:10:08.777 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-03T19:10:08.941 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-10-03T19:10:09.053 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up librbd1 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:09.067 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-10-03T19:10:09.086 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-10-03T19:10:09.154 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-modules-core (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:09.171 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-03T19:10:09.193 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-03T19:10:09.255 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-fuse (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:09.314 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-toml (0.10.2-1) ... 2023-10-03T19:10:09.387 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-03T19:10:09.466 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-03T19:10:09.466 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-03T19:10:09.486 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-10-03T19:10:09.573 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-03T19:10:09.674 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-10-03T19:10:09.722 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-10-03T19:10:09.775 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-10-03T19:10:09.904 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-10-03T19:10:09.965 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-10-03T19:10:10.048 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libcephfs-dev (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:10.066 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-ceph-common (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:10.068 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-10-03T19:10:10.155 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-10-03T19:10:10.174 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-rados (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:10.300 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up cephfs-top (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:10.320 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-10-03T19:10:10.334 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-idna (3.3-1) ... 2023-10-03T19:10:10.426 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-03T19:10:10.515 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-03T19:10:10.579 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-03T19:10:10.635 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-03T19:10:10.722 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-03T19:10:10.808 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-10-03T19:10:10.840 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-10-03T19:10:11.142 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-03T19:10:11.142 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-10-03T19:10:11.385 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-10-03T19:10:11.493 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-10-03T19:10:11.644 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-10-03T19:10:11.647 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-rbd (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:11.744 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-10-03T19:10:11.773 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up rbd-fuse (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:11.845 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-ceph-common (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:11.849 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-03T19:10:11.904 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-03T19:10:11.907 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-rgw (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:11.983 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-toml (0.10.2-1) ... 2023-10-03T19:10:12.033 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-cephfs (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:12.154 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-10-03T19:10:12.159 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up cephfs-shell (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:12.171 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-idna (3.3-1) ... 2023-10-03T19:10:12.245 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-03T19:10:12.285 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-common (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:12.371 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-10-03T19:10:12.431 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-03T19:10:12.514 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-03T19:10:12.522 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-10-03T19:10:12.532 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-10-03T19:10:12.770 INFO:teuthology.orchestra.run.smithi146.stdout:Adding group ceph....done 2023-10-03T19:10:12.800 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-03T19:10:12.814 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-10-03T19:10:12.926 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-03T19:10:13.066 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-10-03T19:10:13.164 INFO:teuthology.orchestra.run.smithi146.stdout:Adding system user ceph....done 2023-10-03T19:10:13.219 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-10-03T19:10:13.300 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-03T19:10:13.331 INFO:teuthology.orchestra.run.smithi146.stdout:Setting system user ceph properties....done 2023-10-03T19:10:13.347 INFO:teuthology.orchestra.run.smithi146.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-03T19:10:13.410 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-03T19:10:13.480 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-03T19:10:13.512 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-10-03T19:10:13.527 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-10-03T19:10:13.720 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-03T19:10:13.780 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-10-03T19:10:13.822 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-03T19:10:13.829 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-10-03T19:10:13.854 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-toml (0.10.2-1) ... 2023-10-03T19:10:14.088 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-10-03T19:10:14.122 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-03T19:10:14.166 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-10-03T19:10:14.247 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-10-03T19:10:14.356 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-10-03T19:10:14.373 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-10-03T19:10:14.400 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-03T19:10:14.403 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up cephfs-mirror (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:14.504 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-test (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:14.518 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-10-03T19:10:14.590 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-03T19:10:14.691 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-10-03T19:10:14.805 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up radosgw (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:14.841 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-10-03T19:10:14.920 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-10-03T19:10:14.951 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-10-03T19:10:15.065 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-03T19:10:15.065 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-03T19:10:15.100 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-03T19:10:15.196 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-portend (3.0.0-1) ... 2023-10-03T19:10:15.210 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-10-03T19:10:15.219 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-03T19:10:15.320 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-03T19:10:15.437 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-10-03T19:10:15.455 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-03T19:10:15.486 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-03T19:10:15.565 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-10-03T19:10:15.612 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-03T19:10:15.755 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-10-03T19:10:15.832 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-base (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:15.858 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-10-03T19:10:15.913 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-10-03T19:10:15.989 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-10-03T19:10:16.134 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-03T19:10:16.173 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-03T19:10:16.248 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-10-03T19:10:16.257 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-10-03T19:10:16.402 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-10-03T19:10:16.499 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-10-03T19:10:16.525 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-03T19:10:16.528 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rsa (4.8-1) ... 2023-10-03T19:10:16.701 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mds (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:16.776 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-10-03T19:10:16.821 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-10-03T19:10:16.913 INFO:teuthology.orchestra.run.smithi172.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-10-03T19:10:16.925 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-03T19:10:16.925 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-03T19:10:17.114 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-03T19:10:17.160 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-03T19:10:17.210 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-03T19:10:17.294 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-10-03T19:10:17.336 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-10-03T19:10:17.357 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-10-03T19:10:17.453 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:17.629 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-03T19:10:17.649 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-03T19:10:17.650 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-03T19:10:17.729 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-10-03T19:10:17.738 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-03T19:10:17.750 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-03T19:10:17.988 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-portend (3.0.0-1) ... 2023-10-03T19:10:18.014 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-10-03T19:10:18.043 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-10-03T19:10:18.195 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-osd (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:18.239 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-03T19:10:18.298 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-10-03T19:10:18.366 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-10-03T19:10:18.396 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-03T19:10:18.503 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-03T19:10:18.503 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-03T19:10:18.522 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librados2 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:18.549 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-10-03T19:10:18.623 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librgw2 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:18.675 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-10-03T19:10:18.827 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libsqlite3-mod-ceph (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:18.916 INFO:teuthology.orchestra.run.smithi045.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-10-03T19:10:18.953 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libcephfs2 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:18.976 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-03T19:10:19.038 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-k8sevents (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:19.079 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libradosstriper1 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:19.161 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-03T19:10:19.164 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:19.205 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-10-03T19:10:19.261 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-10-03T19:10:19.287 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-10-03T19:10:19.316 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mon (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:19.386 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-rsa (4.8-1) ... 2023-10-03T19:10:19.526 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-03T19:10:19.527 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-03T19:10:19.574 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librbd1 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:19.654 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-10-03T19:10:19.675 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-modules-core (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:19.705 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-10-03T19:10:19.801 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-fuse (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:19.948 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-portend (3.0.0-1) ... 2023-10-03T19:10:20.040 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-03T19:10:20.040 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-03T19:10:20.042 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-cephadm (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:20.055 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-03T19:10:20.182 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-03T19:10:20.307 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-10-03T19:10:20.314 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:20.315 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-10-03T19:10:20.569 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libcephfs-dev (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:20.594 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-dashboard (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:20.652 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-10-03T19:10:20.691 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-03T19:10:20.695 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rados (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:20.728 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-volume (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:20.830 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up cephfs-top (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:20.872 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-03T19:10:20.947 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-03T19:10:20.962 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-03T19:10:20.984 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-10-03T19:10:21.238 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-10-03T19:10:21.320 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-03T19:10:21.339 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-rsa (4.8-1) ... 2023-10-03T19:10:21.446 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up librados2 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:21.572 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up librgw2 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:21.598 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-10-03T19:10:21.775 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libsqlite3-mod-ceph (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:21.874 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-03T19:10:21.901 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libcephfs2 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:22.015 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-03T19:10:22.027 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libradosstriper1 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:22.142 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-10-03T19:10:22.152 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rbd (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:22.153 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-10-03T19:10:22.278 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up rbd-fuse (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:22.405 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rgw (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:22.438 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up librbd1 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:22.475 INFO:teuthology.orchestra.run.smithi146.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-03T19:10:22.478 DEBUG:teuthology.orchestra.run.smithi146:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-10-03T19:10:22.514 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cephfs (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:22.552 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-03T19:10:22.564 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr-modules-core (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:22.572 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2023-10-03T19:10:22.615 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up cephfs-shell (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:22.690 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-fuse (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:22.717 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-common (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:22.755 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2023-10-03T19:10:22.756 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2023-10-03T19:10:22.845 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-10-03T19:10:22.901 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-03T19:10:22.902 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-03T19:10:22.915 INFO:teuthology.orchestra.run.smithi146.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-10-03T19:10:22.915 INFO:teuthology.orchestra.run.smithi146.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-10-03T19:10:22.916 INFO:teuthology.orchestra.run.smithi146.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-10-03T19:10:22.916 INFO:teuthology.orchestra.run.smithi146.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-10-03T19:10:22.916 INFO:teuthology.orchestra.run.smithi146.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-10-03T19:10:22.916 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2023-10-03T19:10:22.916 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-03T19:10:22.916 INFO:teuthology.orchestra.run.smithi146.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-03T19:10:22.916 INFO:teuthology.orchestra.run.smithi146.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-03T19:10:22.916 INFO:teuthology.orchestra.run.smithi146.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-03T19:10:22.917 INFO:teuthology.orchestra.run.smithi146.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-03T19:10:22.917 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-03T19:10:22.918 INFO:teuthology.orchestra.run.smithi146.stdout:The following additional packages will be installed: 2023-10-03T19:10:22.918 INFO:teuthology.orchestra.run.smithi146.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-10-03T19:10:22.918 INFO:teuthology.orchestra.run.smithi146.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-10-03T19:10:22.918 INFO:teuthology.orchestra.run.smithi146.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-10-03T19:10:22.918 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-10-03T19:10:22.919 INFO:teuthology.orchestra.run.smithi146.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-03T19:10:22.919 INFO:teuthology.orchestra.run.smithi146.stdout:Suggested packages: 2023-10-03T19:10:22.919 INFO:teuthology.orchestra.run.smithi146.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-10-03T19:10:22.919 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-10-03T19:10:22.919 INFO:teuthology.orchestra.run.smithi146.stdout: libengine-pkcs11-openssl 2023-10-03T19:10:22.954 INFO:teuthology.orchestra.run.smithi146.stdout:The following NEW packages will be installed: 2023-10-03T19:10:22.954 INFO:teuthology.orchestra.run.smithi146.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-10-03T19:10:22.954 INFO:teuthology.orchestra.run.smithi146.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-10-03T19:10:22.955 INFO:teuthology.orchestra.run.smithi146.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-10-03T19:10:22.955 INFO:teuthology.orchestra.run.smithi146.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-10-03T19:10:22.955 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-10-03T19:10:22.955 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-10-03T19:10:22.955 INFO:teuthology.orchestra.run.smithi146.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-03T19:10:22.956 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages will be upgraded: 2023-10-03T19:10:22.956 INFO:teuthology.orchestra.run.smithi146.stdout: libssl3 2023-10-03T19:10:23.009 INFO:teuthology.orchestra.run.smithi146.stdout:1 upgraded, 39 newly installed, 0 to remove and 253 not upgraded. 2023-10-03T19:10:23.010 INFO:teuthology.orchestra.run.smithi146.stdout:Need to get 54.6 MB of archives. 2023-10-03T19:10:23.010 INFO:teuthology.orchestra.run.smithi146.stdout:After this operation, 202 MB of additional disk space will be used. 2023-10-03T19:10:23.010 INFO:teuthology.orchestra.run.smithi146.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-10-03T19:10:23.111 INFO:teuthology.orchestra.run.smithi146.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-10-03T19:10:23.173 INFO:teuthology.orchestra.run.smithi146.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-10-03T19:10:23.187 INFO:teuthology.orchestra.run.smithi146.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-10-03T19:10:23.189 INFO:teuthology.orchestra.run.smithi146.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-10-03T19:10:23.191 INFO:teuthology.orchestra.run.smithi146.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-10-03T19:10:23.193 INFO:teuthology.orchestra.run.smithi146.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-10-03T19:10:23.193 INFO:teuthology.orchestra.run.smithi146.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-10-03T19:10:23.195 INFO:teuthology.orchestra.run.smithi146.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-10-03T19:10:23.196 INFO:teuthology.orchestra.run.smithi146.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-10-03T19:10:23.197 INFO:teuthology.orchestra.run.smithi146.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-10-03T19:10:23.197 INFO:teuthology.orchestra.run.smithi146.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-10-03T19:10:23.205 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-03T19:10:23.212 INFO:teuthology.orchestra.run.smithi146.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-10-03T19:10:23.269 INFO:teuthology.orchestra.run.smithi079.stdout:Adding group ceph....done 2023-10-03T19:10:23.331 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up librados2 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:23.383 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libcephfs-dev (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:23.449 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up librgw2 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:23.492 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-rados (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:23.509 INFO:teuthology.orchestra.run.smithi146.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-10-03T19:10:23.511 INFO:teuthology.orchestra.run.smithi146.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-10-03T19:10:23.511 INFO:teuthology.orchestra.run.smithi146.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-10-03T19:10:23.513 INFO:teuthology.orchestra.run.smithi146.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-10-03T19:10:23.559 INFO:teuthology.orchestra.run.smithi146.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-10-03T19:10:23.563 INFO:teuthology.orchestra.run.smithi146.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-10-03T19:10:23.564 INFO:teuthology.orchestra.run.smithi146.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-10-03T19:10:23.571 INFO:teuthology.orchestra.run.smithi146.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-10-03T19:10:23.571 INFO:teuthology.orchestra.run.smithi146.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-10-03T19:10:23.592 INFO:teuthology.orchestra.run.smithi146.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-10-03T19:10:23.592 INFO:teuthology.orchestra.run.smithi146.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-10-03T19:10:23.603 INFO:teuthology.orchestra.run.smithi146.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-10-03T19:10:23.610 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up cephfs-top (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:23.620 INFO:teuthology.orchestra.run.smithi079.stdout:Adding system user ceph....done 2023-10-03T19:10:23.622 INFO:teuthology.orchestra.run.smithi146.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-10-03T19:10:23.625 INFO:teuthology.orchestra.run.smithi146.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-10-03T19:10:23.626 INFO:teuthology.orchestra.run.smithi146.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-10-03T19:10:23.626 INFO:teuthology.orchestra.run.smithi146.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-10-03T19:10:23.627 INFO:teuthology.orchestra.run.smithi146.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-10-03T19:10:23.637 INFO:teuthology.orchestra.run.smithi146.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-10-03T19:10:23.639 INFO:teuthology.orchestra.run.smithi146.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-10-03T19:10:23.661 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libsqlite3-mod-ceph (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:23.737 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-03T19:10:23.787 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libcephfs2 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:23.797 INFO:teuthology.orchestra.run.smithi079.stdout:Setting system user ceph properties....done 2023-10-03T19:10:23.813 INFO:teuthology.orchestra.run.smithi079.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-03T19:10:23.847 INFO:teuthology.orchestra.run.smithi146.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-10-03T19:10:23.847 INFO:teuthology.orchestra.run.smithi146.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-10-03T19:10:23.847 INFO:teuthology.orchestra.run.smithi146.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-10-03T19:10:23.847 INFO:teuthology.orchestra.run.smithi146.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-10-03T19:10:23.847 INFO:teuthology.orchestra.run.smithi146.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-10-03T19:10:23.848 INFO:teuthology.orchestra.run.smithi146.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-10-03T19:10:23.859 INFO:teuthology.orchestra.run.smithi146.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-10-03T19:10:23.859 INFO:teuthology.orchestra.run.smithi146.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-10-03T19:10:23.913 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libradosstriper1 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:23.950 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-03T19:10:24.014 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-10-03T19:10:24.256 INFO:teuthology.orchestra.run.smithi146.stdout:Preconfiguring packages ... 2023-10-03T19:10:24.282 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up librbd1 (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:24.332 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-03T19:10:24.399 INFO:teuthology.orchestra.run.smithi146.stdout:Fetched 54.6 MB in 1s (60.9 MB/s) 2023-10-03T19:10:24.408 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr-modules-core (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:24.522 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package flex. 2023-10-03T19:10:24.534 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-fuse (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:24.623 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172975 files and directories currently installed.) 2023-10-03T19:10:24.628 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-10-03T19:10:24.670 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking flex (2.6.4-8build2) ... 2023-10-03T19:10:24.752 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-03T19:10:24.752 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-03T19:10:24.844 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up cephfs-mirror (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:24.882 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-rbd (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:24.970 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-test (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:25.009 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up rbd-fuse (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:25.097 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up radosgw (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:25.135 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-rgw (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:25.253 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-03T19:10:25.261 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-cephfs (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:25.302 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libcephfs-dev (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:25.336 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-03T19:10:25.337 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-03T19:10:25.387 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up cephfs-shell (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:25.429 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-rados (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:25.434 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-10-03T19:10:25.513 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-common (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:25.538 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up cephfs-top (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:25.639 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-03T19:10:25.877 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-03T19:10:26.047 INFO:teuthology.orchestra.run.smithi172.stdout:Adding group ceph....done 2023-10-03T19:10:26.074 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-base (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:26.415 INFO:teuthology.orchestra.run.smithi172.stdout:Adding system user ceph....done 2023-10-03T19:10:26.416 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-03T19:10:26.477 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package bison. 2023-10-03T19:10:26.583 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173048 files and directories currently installed.) 2023-10-03T19:10:26.589 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-10-03T19:10:26.592 INFO:teuthology.orchestra.run.smithi172.stdout:Setting system user ceph properties....done 2023-10-03T19:10:26.605 INFO:teuthology.orchestra.run.smithi172.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-03T19:10:26.680 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-10-03T19:10:26.740 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-03T19:10:26.926 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mds (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:26.927 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-rbd (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:27.061 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up rbd-fuse (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:27.105 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-03T19:10:27.139 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-03T19:10:27.158 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-03T19:10:27.158 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-03T19:10:27.168 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-10-03T19:10:27.187 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-rgw (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:27.213 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-10-03T19:10:27.313 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-cephfs (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:27.414 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up cephfs-shell (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:27.515 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-common (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:27.584 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package dump. 2023-10-03T19:10:27.611 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-10-03T19:10:27.614 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up cephfs-mirror (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:27.650 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking dump (0.4b47-3) ... 2023-10-03T19:10:27.677 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:27.740 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-test (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:27.866 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up radosgw (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:27.893 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-03T19:10:27.894 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-03T19:10:27.945 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package indent. 2023-10-03T19:10:27.973 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-10-03T19:10:28.020 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-03T19:10:28.075 INFO:teuthology.orchestra.run.smithi045.stdout:Adding group ceph....done 2023-10-03T19:10:28.123 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-03T19:10:28.123 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-03T19:10:28.322 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-03T19:10:28.350 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-10-03T19:10:28.384 INFO:teuthology.orchestra.run.smithi045.stdout:Adding system user ceph....done 2023-10-03T19:10:28.397 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-03T19:10:28.398 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-osd (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:28.545 INFO:teuthology.orchestra.run.smithi045.stdout:Setting system user ceph properties....done 2023-10-03T19:10:28.564 INFO:teuthology.orchestra.run.smithi045.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-03T19:10:28.702 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-03T19:10:28.703 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-03T19:10:28.704 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-03T19:10:28.734 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-03T19:10:28.762 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-10-03T19:10:28.801 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-03T19:10:28.867 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-base (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:29.055 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-03T19:10:29.070 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-03T19:10:29.086 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-10-03T19:10:29.128 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-10-03T19:10:29.216 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-03T19:10:29.233 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-k8sevents (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:29.359 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:29.510 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mon (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:29.532 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libfl2:amd64. 2023-10-03T19:10:29.560 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-10-03T19:10:29.607 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-10-03T19:10:29.633 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up cephfs-mirror (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:29.694 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mds (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:29.739 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-03T19:10:29.739 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-03T19:10:29.759 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-test (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:29.907 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-03T19:10:29.907 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-03T19:10:29.909 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-10-03T19:10:29.937 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-10-03T19:10:29.952 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up radosgw (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:29.984 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-03T19:10:30.236 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libjson-perl. 2023-10-03T19:10:30.253 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-cephadm (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:30.261 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-10-03T19:10:30.303 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-10-03T19:10:30.306 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-03T19:10:30.306 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-03T19:10:30.396 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:30.404 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:30.505 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-dashboard (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:30.581 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libllvm14:amd64. 2023-10-03T19:10:30.597 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-10-03T19:10:30.598 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-03T19:10:30.598 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-03T19:10:30.631 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-03T19:10:30.648 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-volume (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:30.776 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-03T19:10:31.097 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-osd (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:31.120 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-base (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:31.405 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-03T19:10:31.405 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-03T19:10:31.617 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-03T19:10:31.894 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-03T19:10:31.941 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr-k8sevents (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:32.050 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:32.199 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mds (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:32.210 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mon (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:32.293 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-03T19:10:32.321 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-03T19:10:32.349 INFO:teuthology.orchestra.run.smithi079.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-03T19:10:32.351 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-10-03T19:10:32.360 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-03T19:10:32.420 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-03T19:10:32.420 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-03T19:10:32.437 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-03T19:10:32.437 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-03T19:10:32.447 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2023-10-03T19:10:32.631 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2023-10-03T19:10:32.632 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2023-10-03T19:10:32.646 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-03T19:10:32.673 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-03T19:10:32.712 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-03T19:10:32.794 INFO:teuthology.orchestra.run.smithi079.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-10-03T19:10:32.795 INFO:teuthology.orchestra.run.smithi079.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-10-03T19:10:32.795 INFO:teuthology.orchestra.run.smithi079.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-10-03T19:10:32.795 INFO:teuthology.orchestra.run.smithi079.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-10-03T19:10:32.795 INFO:teuthology.orchestra.run.smithi079.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-10-03T19:10:32.795 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages were automatically installed and are no longer required: 2023-10-03T19:10:32.795 INFO:teuthology.orchestra.run.smithi079.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-03T19:10:32.795 INFO:teuthology.orchestra.run.smithi079.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-03T19:10:32.795 INFO:teuthology.orchestra.run.smithi079.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-03T19:10:32.795 INFO:teuthology.orchestra.run.smithi079.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-03T19:10:32.796 INFO:teuthology.orchestra.run.smithi079.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-03T19:10:32.797 INFO:teuthology.orchestra.run.smithi079.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-03T19:10:32.797 INFO:teuthology.orchestra.run.smithi079.stdout:The following additional packages will be installed: 2023-10-03T19:10:32.797 INFO:teuthology.orchestra.run.smithi079.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-10-03T19:10:32.797 INFO:teuthology.orchestra.run.smithi079.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-10-03T19:10:32.797 INFO:teuthology.orchestra.run.smithi079.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-10-03T19:10:32.797 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-10-03T19:10:32.797 INFO:teuthology.orchestra.run.smithi079.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-03T19:10:32.798 INFO:teuthology.orchestra.run.smithi079.stdout:Suggested packages: 2023-10-03T19:10:32.798 INFO:teuthology.orchestra.run.smithi079.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-10-03T19:10:32.798 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-10-03T19:10:32.798 INFO:teuthology.orchestra.run.smithi079.stdout: libengine-pkcs11-openssl 2023-10-03T19:10:32.836 INFO:teuthology.orchestra.run.smithi079.stdout:The following NEW packages will be installed: 2023-10-03T19:10:32.837 INFO:teuthology.orchestra.run.smithi079.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-10-03T19:10:32.837 INFO:teuthology.orchestra.run.smithi079.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-10-03T19:10:32.837 INFO:teuthology.orchestra.run.smithi079.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-10-03T19:10:32.837 INFO:teuthology.orchestra.run.smithi079.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-10-03T19:10:32.838 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-10-03T19:10:32.838 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-10-03T19:10:32.838 INFO:teuthology.orchestra.run.smithi079.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-03T19:10:32.839 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages will be upgraded: 2023-10-03T19:10:32.840 INFO:teuthology.orchestra.run.smithi079.stdout: libssl3 2023-10-03T19:10:32.992 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:32.994 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr-cephadm (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:33.006 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-03T19:10:33.019 INFO:teuthology.orchestra.run.smithi079.stdout:1 upgraded, 39 newly installed, 0 to remove and 253 not upgraded. 2023-10-03T19:10:33.019 INFO:teuthology.orchestra.run.smithi079.stdout:Need to get 54.6 MB of archives. 2023-10-03T19:10:33.019 INFO:teuthology.orchestra.run.smithi079.stdout:After this operation, 202 MB of additional disk space will be used. 2023-10-03T19:10:33.020 INFO:teuthology.orchestra.run.smithi079.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-10-03T19:10:33.034 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-03T19:10:33.065 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-03T19:10:33.217 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-03T19:10:33.217 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-03T19:10:33.250 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:33.401 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-03T19:10:33.429 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-10-03T19:10:33.467 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-03T19:10:33.498 INFO:teuthology.orchestra.run.smithi079.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-10-03T19:10:33.611 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr-dashboard (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:33.756 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-10-03T19:10:33.768 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-osd (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:33.787 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-03T19:10:33.790 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-10-03T19:10:33.792 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-10-03T19:10:33.797 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-10-03T19:10:33.800 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-10-03T19:10:33.801 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-10-03T19:10:33.805 INFO:teuthology.orchestra.run.smithi079.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-10-03T19:10:33.807 INFO:teuthology.orchestra.run.smithi079.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-10-03T19:10:33.807 INFO:teuthology.orchestra.run.smithi079.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-10-03T19:10:33.814 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-10-03T19:10:33.853 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-03T19:10:33.892 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-volume (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:33.972 INFO:teuthology.orchestra.run.smithi079.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-10-03T19:10:34.050 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-03T19:10:34.105 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-03T19:10:34.105 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-03T19:10:34.206 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libpq5:amd64. 2023-10-03T19:10:34.233 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-03T19:10:34.272 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-03T19:10:34.284 INFO:teuthology.orchestra.run.smithi079.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-10-03T19:10:34.617 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-03T19:10:34.645 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-03T19:10:34.670 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr-k8sevents (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:34.683 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-03T19:10:34.771 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:34.817 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-03T19:10:34.897 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mon (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:34.986 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-03T19:10:35.013 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-03T19:10:35.052 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-03T19:10:35.116 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-03T19:10:35.116 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-03T19:10:35.269 INFO:teuthology.orchestra.run.smithi172.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-03T19:10:35.272 DEBUG:teuthology.orchestra.run.smithi172:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-10-03T19:10:35.296 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-03T19:10:35.324 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-03T19:10:35.324 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2023-10-03T19:10:35.363 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-03T19:10:35.486 INFO:teuthology.orchestra.run.smithi079.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-10-03T19:10:35.491 INFO:teuthology.orchestra.run.smithi079.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-10-03T19:10:35.491 INFO:teuthology.orchestra.run.smithi079.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-10-03T19:10:35.498 INFO:teuthology.orchestra.run.smithi079.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-10-03T19:10:35.498 INFO:teuthology.orchestra.run.smithi079.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-10-03T19:10:35.503 INFO:teuthology.orchestra.run.smithi172.stdout:Building dependency tree... 2023-10-03T19:10:35.504 INFO:teuthology.orchestra.run.smithi172.stdout:Reading state information... 2023-10-03T19:10:35.509 INFO:teuthology.orchestra.run.smithi079.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-10-03T19:10:35.512 INFO:teuthology.orchestra.run.smithi079.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-10-03T19:10:35.530 INFO:teuthology.orchestra.run.smithi079.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-10-03T19:10:35.530 INFO:teuthology.orchestra.run.smithi079.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-10-03T19:10:35.647 INFO:teuthology.orchestra.run.smithi172.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-10-03T19:10:35.647 INFO:teuthology.orchestra.run.smithi172.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-10-03T19:10:35.647 INFO:teuthology.orchestra.run.smithi172.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-10-03T19:10:35.647 INFO:teuthology.orchestra.run.smithi172.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-10-03T19:10:35.647 INFO:teuthology.orchestra.run.smithi172.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-10-03T19:10:35.648 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages were automatically installed and are no longer required: 2023-10-03T19:10:35.648 INFO:teuthology.orchestra.run.smithi172.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-03T19:10:35.648 INFO:teuthology.orchestra.run.smithi172.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-03T19:10:35.648 INFO:teuthology.orchestra.run.smithi172.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-03T19:10:35.648 INFO:teuthology.orchestra.run.smithi172.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-03T19:10:35.649 INFO:teuthology.orchestra.run.smithi172.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-03T19:10:35.649 INFO:teuthology.orchestra.run.smithi172.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-03T19:10:35.649 INFO:teuthology.orchestra.run.smithi172.stdout:The following additional packages will be installed: 2023-10-03T19:10:35.649 INFO:teuthology.orchestra.run.smithi172.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-10-03T19:10:35.649 INFO:teuthology.orchestra.run.smithi172.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-10-03T19:10:35.649 INFO:teuthology.orchestra.run.smithi172.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-10-03T19:10:35.649 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-10-03T19:10:35.649 INFO:teuthology.orchestra.run.smithi172.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-03T19:10:35.650 INFO:teuthology.orchestra.run.smithi172.stdout:Suggested packages: 2023-10-03T19:10:35.650 INFO:teuthology.orchestra.run.smithi172.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-10-03T19:10:35.650 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-10-03T19:10:35.650 INFO:teuthology.orchestra.run.smithi172.stdout: libengine-pkcs11-openssl 2023-10-03T19:10:35.685 INFO:teuthology.orchestra.run.smithi172.stdout:The following NEW packages will be installed: 2023-10-03T19:10:35.686 INFO:teuthology.orchestra.run.smithi172.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-10-03T19:10:35.686 INFO:teuthology.orchestra.run.smithi172.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-10-03T19:10:35.687 INFO:teuthology.orchestra.run.smithi172.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-10-03T19:10:35.687 INFO:teuthology.orchestra.run.smithi172.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-10-03T19:10:35.687 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-10-03T19:10:35.687 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-10-03T19:10:35.687 INFO:teuthology.orchestra.run.smithi172.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-03T19:10:35.688 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages will be upgraded: 2023-10-03T19:10:35.688 INFO:teuthology.orchestra.run.smithi172.stdout: libssl3 2023-10-03T19:10:35.690 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr-cephadm (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:35.751 INFO:teuthology.orchestra.run.smithi079.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-10-03T19:10:35.834 INFO:teuthology.orchestra.run.smithi079.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-10-03T19:10:35.841 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:35.842 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-03T19:10:35.868 INFO:teuthology.orchestra.run.smithi172.stdout:1 upgraded, 39 newly installed, 0 to remove and 253 not upgraded. 2023-10-03T19:10:35.868 INFO:teuthology.orchestra.run.smithi172.stdout:Need to get 54.6 MB of archives. 2023-10-03T19:10:35.868 INFO:teuthology.orchestra.run.smithi172.stdout:After this operation, 202 MB of additional disk space will be used. 2023-10-03T19:10:35.868 INFO:teuthology.orchestra.run.smithi172.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-10-03T19:10:35.869 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-10-03T19:10:35.908 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-10-03T19:10:35.967 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr-dashboard (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:36.127 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-volume (18.0.0-3908-g05a43c8f-1jammy) ... 2023-10-03T19:10:36.253 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package modemmanager. 2023-10-03T19:10:36.262 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-03T19:10:36.280 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-03T19:10:36.309 INFO:teuthology.orchestra.run.smithi079.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-10-03T19:10:36.319 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-03T19:10:36.345 INFO:teuthology.orchestra.run.smithi172.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-10-03T19:10:36.439 INFO:teuthology.orchestra.run.smithi079.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-10-03T19:10:36.450 INFO:teuthology.orchestra.run.smithi079.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-10-03T19:10:36.452 INFO:teuthology.orchestra.run.smithi079.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-10-03T19:10:36.453 INFO:teuthology.orchestra.run.smithi079.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-10-03T19:10:36.454 INFO:teuthology.orchestra.run.smithi079.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-10-03T19:10:36.487 INFO:teuthology.orchestra.run.smithi079.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-10-03T19:10:36.491 INFO:teuthology.orchestra.run.smithi079.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-10-03T19:10:36.602 INFO:teuthology.orchestra.run.smithi172.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-10-03T19:10:36.637 INFO:teuthology.orchestra.run.smithi172.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-10-03T19:10:36.639 INFO:teuthology.orchestra.run.smithi172.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-10-03T19:10:36.644 INFO:teuthology.orchestra.run.smithi172.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-10-03T19:10:36.647 INFO:teuthology.orchestra.run.smithi172.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-10-03T19:10:36.648 INFO:teuthology.orchestra.run.smithi172.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-10-03T19:10:36.651 INFO:teuthology.orchestra.run.smithi172.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-10-03T19:10:36.654 INFO:teuthology.orchestra.run.smithi172.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-10-03T19:10:36.819 INFO:teuthology.orchestra.run.smithi172.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-10-03T19:10:36.820 INFO:teuthology.orchestra.run.smithi172.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-10-03T19:10:36.959 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package network-manager. 2023-10-03T19:10:36.987 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-10-03T19:10:37.012 INFO:teuthology.orchestra.run.smithi079.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-10-03T19:10:37.032 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-10-03T19:10:37.054 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-03T19:10:37.064 INFO:teuthology.orchestra.run.smithi172.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-10-03T19:10:37.176 INFO:teuthology.orchestra.run.smithi079.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-10-03T19:10:37.258 INFO:teuthology.orchestra.run.smithi079.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-10-03T19:10:37.259 INFO:teuthology.orchestra.run.smithi079.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-10-03T19:10:37.340 INFO:teuthology.orchestra.run.smithi079.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-10-03T19:10:37.348 INFO:teuthology.orchestra.run.smithi079.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-10-03T19:10:37.505 INFO:teuthology.orchestra.run.smithi045.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-03T19:10:37.508 DEBUG:teuthology.orchestra.run.smithi045:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-10-03T19:10:37.615 INFO:teuthology.orchestra.run.smithi045.stdout:Reading package lists... 2023-10-03T19:10:37.684 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ppp. 2023-10-03T19:10:37.712 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-10-03T19:10:37.805 INFO:teuthology.orchestra.run.smithi045.stdout:Building dependency tree... 2023-10-03T19:10:37.806 INFO:teuthology.orchestra.run.smithi045.stdout:Reading state information... 2023-10-03T19:10:37.809 INFO:teuthology.orchestra.run.smithi079.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-10-03T19:10:37.811 INFO:teuthology.orchestra.run.smithi079.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-10-03T19:10:37.974 INFO:teuthology.orchestra.run.smithi045.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-10-03T19:10:37.974 INFO:teuthology.orchestra.run.smithi045.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-10-03T19:10:37.974 INFO:teuthology.orchestra.run.smithi045.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-10-03T19:10:37.974 INFO:teuthology.orchestra.run.smithi045.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-10-03T19:10:37.974 INFO:teuthology.orchestra.run.smithi045.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-10-03T19:10:37.974 INFO:teuthology.orchestra.run.smithi045.stdout:The following packages were automatically installed and are no longer required: 2023-10-03T19:10:37.974 INFO:teuthology.orchestra.run.smithi045.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-03T19:10:37.974 INFO:teuthology.orchestra.run.smithi045.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-03T19:10:37.975 INFO:teuthology.orchestra.run.smithi045.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-03T19:10:37.975 INFO:teuthology.orchestra.run.smithi045.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-03T19:10:37.976 INFO:teuthology.orchestra.run.smithi045.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-03T19:10:37.976 INFO:teuthology.orchestra.run.smithi045.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-03T19:10:37.976 INFO:teuthology.orchestra.run.smithi045.stdout:The following additional packages will be installed: 2023-10-03T19:10:37.976 INFO:teuthology.orchestra.run.smithi045.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-10-03T19:10:37.976 INFO:teuthology.orchestra.run.smithi045.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-10-03T19:10:37.976 INFO:teuthology.orchestra.run.smithi045.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-10-03T19:10:37.976 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-10-03T19:10:37.976 INFO:teuthology.orchestra.run.smithi045.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-03T19:10:37.977 INFO:teuthology.orchestra.run.smithi045.stdout:Suggested packages: 2023-10-03T19:10:37.977 INFO:teuthology.orchestra.run.smithi045.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-10-03T19:10:37.977 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-10-03T19:10:37.977 INFO:teuthology.orchestra.run.smithi045.stdout: libengine-pkcs11-openssl 2023-10-03T19:10:38.014 INFO:teuthology.orchestra.run.smithi045.stdout:The following NEW packages will be installed: 2023-10-03T19:10:38.014 INFO:teuthology.orchestra.run.smithi045.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-10-03T19:10:38.015 INFO:teuthology.orchestra.run.smithi045.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-10-03T19:10:38.015 INFO:teuthology.orchestra.run.smithi045.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-10-03T19:10:38.016 INFO:teuthology.orchestra.run.smithi045.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-10-03T19:10:38.016 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-10-03T19:10:38.016 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-10-03T19:10:38.016 INFO:teuthology.orchestra.run.smithi045.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-03T19:10:38.016 INFO:teuthology.orchestra.run.smithi045.stdout:The following packages will be upgraded: 2023-10-03T19:10:38.017 INFO:teuthology.orchestra.run.smithi045.stdout: libssl3 2023-10-03T19:10:38.030 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-10-03T19:10:38.203 INFO:teuthology.orchestra.run.smithi172.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-10-03T19:10:38.207 INFO:teuthology.orchestra.run.smithi172.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-10-03T19:10:38.208 INFO:teuthology.orchestra.run.smithi172.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-10-03T19:10:38.214 INFO:teuthology.orchestra.run.smithi172.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-10-03T19:10:38.215 INFO:teuthology.orchestra.run.smithi172.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-10-03T19:10:38.219 INFO:teuthology.orchestra.run.smithi079.stdout:Preconfiguring packages ... 2023-10-03T19:10:38.226 INFO:teuthology.orchestra.run.smithi172.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-10-03T19:10:38.229 INFO:teuthology.orchestra.run.smithi172.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-10-03T19:10:38.247 INFO:teuthology.orchestra.run.smithi172.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-10-03T19:10:38.381 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package pptp-linux. 2023-10-03T19:10:38.388 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 54.6 MB in 5s (11.0 MB/s) 2023-10-03T19:10:38.408 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-10-03T19:10:38.410 INFO:teuthology.orchestra.run.smithi172.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-10-03T19:10:38.447 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-10-03T19:10:38.494 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package flex. 2023-10-03T19:10:38.593 INFO:teuthology.orchestra.run.smithi079.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172975 files and directories currently installed.) 2023-10-03T19:10:38.598 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-10-03T19:10:38.634 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking flex (2.6.4-8build2) ... 2023-10-03T19:10:38.683 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-03T19:10:38.699 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-10-03T19:10:38.741 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-10-03T19:10:39.053 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package postgresql-client-common. 2023-10-03T19:10:39.080 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-10-03T19:10:39.119 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking postgresql-client-common (238) ... 2023-10-03T19:10:39.130 INFO:teuthology.orchestra.run.smithi172.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-10-03T19:10:39.131 INFO:teuthology.orchestra.run.smithi172.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-10-03T19:10:39.159 INFO:teuthology.orchestra.run.smithi172.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-10-03T19:10:39.168 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-03T19:10:39.234 INFO:teuthology.orchestra.run.smithi172.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-10-03T19:10:39.243 INFO:teuthology.orchestra.run.smithi172.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-10-03T19:10:39.244 INFO:teuthology.orchestra.run.smithi172.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-10-03T19:10:39.245 INFO:teuthology.orchestra.run.smithi172.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-10-03T19:10:39.247 INFO:teuthology.orchestra.run.smithi172.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-10-03T19:10:39.273 INFO:teuthology.orchestra.run.smithi172.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-10-03T19:10:39.276 INFO:teuthology.orchestra.run.smithi172.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-10-03T19:10:39.316 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-10-03T19:10:39.372 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package postgresql-client-14. 2023-10-03T19:10:39.389 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-03T19:10:39.422 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-03T19:10:39.725 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-03T19:10:39.985 INFO:teuthology.orchestra.run.smithi172.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-10-03T19:10:40.002 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package postgresql-common. 2023-10-03T19:10:40.030 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-10-03T19:10:40.067 INFO:teuthology.orchestra.run.smithi172.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-10-03T19:10:40.069 INFO:teuthology.orchestra.run.smithi172.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-10-03T19:10:40.069 INFO:teuthology.orchestra.run.smithi172.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-10-03T19:10:40.087 INFO:teuthology.orchestra.run.smithi146.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-10-03T19:10:40.117 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking postgresql-common (238) ... 2023-10-03T19:10:40.157 INFO:teuthology.orchestra.run.smithi172.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-10-03T19:10:40.163 INFO:teuthology.orchestra.run.smithi172.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-10-03T19:10:40.277 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package bison. 2023-10-03T19:10:40.381 INFO:teuthology.orchestra.run.smithi079.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173048 files and directories currently installed.) 2023-10-03T19:10:40.386 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-10-03T19:10:40.438 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-10-03T19:10:40.584 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package postgresql-14. 2023-10-03T19:10:40.612 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-03T19:10:40.620 INFO:teuthology.orchestra.run.smithi172.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-10-03T19:10:40.623 INFO:teuthology.orchestra.run.smithi172.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-10-03T19:10:40.654 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-03T19:10:40.856 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-03T19:10:40.883 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-10-03T19:10:40.922 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-10-03T19:10:41.018 INFO:teuthology.orchestra.run.smithi172.stdout:Preconfiguring packages ... 2023-10-03T19:10:41.194 INFO:teuthology.orchestra.run.smithi172.stdout:Fetched 54.6 MB in 5s (11.1 MB/s) 2023-10-03T19:10:41.201 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package dump. 2023-10-03T19:10:41.228 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-10-03T19:10:41.267 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking dump (0.4b47-3) ... 2023-10-03T19:10:41.333 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package flex. 2023-10-03T19:10:41.426 INFO:teuthology.orchestra.run.smithi172.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172975 files and directories currently installed.) 2023-10-03T19:10:41.431 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-10-03T19:10:41.474 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking flex (2.6.4-8build2) ... 2023-10-03T19:10:41.571 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package indent. 2023-10-03T19:10:41.587 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-10-03T19:10:41.629 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-03T19:10:41.890 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-03T19:10:41.906 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-10-03T19:10:41.949 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-03T19:10:42.006 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-03T19:10:42.028 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package postgresql. 2023-10-03T19:10:42.045 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-10-03T19:10:42.087 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking postgresql (14+238) ... 2023-10-03T19:10:42.154 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-10-03T19:10:42.228 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-03T19:10:42.255 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-10-03T19:10:42.294 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-03T19:10:42.491 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package postgresql-client. 2023-10-03T19:10:42.519 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-10-03T19:10:42.555 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-03T19:10:42.557 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking postgresql-client (14+238) ... 2023-10-03T19:10:42.563 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-03T19:10:42.583 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-10-03T19:10:42.622 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-10-03T19:10:42.759 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package postgresql-contrib. 2023-10-03T19:10:42.776 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-10-03T19:10:42.810 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking postgresql-contrib (14+238) ... 2023-10-03T19:10:42.901 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libfl2:amd64. 2023-10-03T19:10:42.928 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-10-03T19:10:42.967 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-10-03T19:10:43.088 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package bison. 2023-10-03T19:10:43.112 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package tcl8.6. 2023-10-03T19:10:43.140 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-10-03T19:10:43.178 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-03T19:10:43.179 INFO:teuthology.orchestra.run.smithi172.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173048 files and directories currently installed.) 2023-10-03T19:10:43.184 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-10-03T19:10:43.219 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-10-03T19:10:43.232 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-10-03T19:10:43.236 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-10-03T19:10:43.278 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-03T19:10:43.465 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package tcl. 2023-10-03T19:10:43.493 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-10-03T19:10:43.536 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-10-03T19:10:43.556 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libjson-perl. 2023-10-03T19:10:43.566 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-03T19:10:43.582 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-10-03T19:10:43.584 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-10-03T19:10:43.623 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-10-03T19:10:43.625 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-10-03T19:10:43.884 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package wpasupplicant. 2023-10-03T19:10:43.892 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libllvm14:amd64. 2023-10-03T19:10:43.908 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-10-03T19:10:43.912 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-10-03T19:10:43.942 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-03T19:10:43.950 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-03T19:10:43.978 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package dump. 2023-10-03T19:10:44.005 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-10-03T19:10:44.045 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking dump (0.4b47-3) ... 2023-10-03T19:10:44.313 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-03T19:10:44.329 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-10-03T19:10:44.371 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-10-03T19:10:44.448 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package indent. 2023-10-03T19:10:44.464 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-10-03T19:10:44.506 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-03T19:10:44.733 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-03T19:10:44.761 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-10-03T19:10:44.784 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-03T19:10:44.800 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-10-03T19:10:44.808 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-03T19:10:44.833 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-03T19:10:45.110 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up postgresql-client-common (238) ... 2023-10-03T19:10:45.154 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-03T19:10:45.182 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-10-03T19:10:45.220 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-03T19:10:45.347 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up flex (2.6.4-8build2) ... 2023-10-03T19:10:45.473 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-03T19:10:45.554 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-03T19:10:45.558 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-03T19:10:45.574 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-03T19:10:45.574 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-10-03T19:10:45.582 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-03T19:10:45.616 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-10-03T19:10:45.621 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-03T19:10:45.675 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-10-03T19:10:45.833 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-03T19:10:45.890 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-03T19:10:45.918 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-03T19:10:45.944 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libfl2:amd64. 2023-10-03T19:10:45.957 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-03T19:10:45.972 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-10-03T19:10:46.002 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-10-03T19:10:46.102 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-03T19:10:46.230 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-10-03T19:10:46.258 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-10-03T19:10:46.268 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-03T19:10:46.295 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-03T19:10:46.296 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-03T19:10:46.326 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-03T19:10:46.566 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libjson-perl. 2023-10-03T19:10:46.593 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-10-03T19:10:46.597 INFO:teuthology.orchestra.run.smithi146.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-10-03T19:10:46.632 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-10-03T19:10:46.663 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-03T19:10:46.678 INFO:teuthology.orchestra.run.smithi045.stdout:1 upgraded, 39 newly installed, 0 to remove and 253 not upgraded. 2023-10-03T19:10:46.679 INFO:teuthology.orchestra.run.smithi045.stdout:Need to get 54.6 MB of archives. 2023-10-03T19:10:46.679 INFO:teuthology.orchestra.run.smithi045.stdout:After this operation, 202 MB of additional disk space will be used. 2023-10-03T19:10:46.679 INFO:teuthology.orchestra.run.smithi045.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-10-03T19:10:46.690 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-10-03T19:10:46.691 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-03T19:10:46.729 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-03T19:10:46.778 INFO:teuthology.orchestra.run.smithi045.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-10-03T19:10:46.838 INFO:teuthology.orchestra.run.smithi045.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-10-03T19:10:46.853 INFO:teuthology.orchestra.run.smithi045.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-10-03T19:10:46.854 INFO:teuthology.orchestra.run.smithi045.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-10-03T19:10:46.857 INFO:teuthology.orchestra.run.smithi045.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-10-03T19:10:46.859 INFO:teuthology.orchestra.run.smithi045.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-10-03T19:10:46.859 INFO:teuthology.orchestra.run.smithi045.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-10-03T19:10:46.861 INFO:teuthology.orchestra.run.smithi045.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-10-03T19:10:46.862 INFO:teuthology.orchestra.run.smithi045.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-10-03T19:10:46.863 INFO:teuthology.orchestra.run.smithi045.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-10-03T19:10:46.864 INFO:teuthology.orchestra.run.smithi045.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-10-03T19:10:46.876 INFO:teuthology.orchestra.run.smithi045.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-10-03T19:10:46.952 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libllvm14:amd64. 2023-10-03T19:10:46.979 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-10-03T19:10:47.019 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-03T19:10:47.057 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-03T19:10:47.062 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-03T19:10:47.062 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-03T19:10:47.085 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-10-03T19:10:47.124 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-03T19:10:47.183 INFO:teuthology.orchestra.run.smithi045.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-10-03T19:10:47.185 INFO:teuthology.orchestra.run.smithi045.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-10-03T19:10:47.185 INFO:teuthology.orchestra.run.smithi045.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-10-03T19:10:47.187 INFO:teuthology.orchestra.run.smithi045.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-10-03T19:10:47.188 INFO:teuthology.orchestra.run.smithi045.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-10-03T19:10:47.192 INFO:teuthology.orchestra.run.smithi045.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-10-03T19:10:47.193 INFO:teuthology.orchestra.run.smithi045.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-10-03T19:10:47.199 INFO:teuthology.orchestra.run.smithi045.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-10-03T19:10:47.231 INFO:teuthology.orchestra.run.smithi045.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-10-03T19:10:47.252 INFO:teuthology.orchestra.run.smithi045.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-10-03T19:10:47.252 INFO:teuthology.orchestra.run.smithi045.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-10-03T19:10:47.263 INFO:teuthology.orchestra.run.smithi045.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-10-03T19:10:47.282 INFO:teuthology.orchestra.run.smithi045.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-10-03T19:10:47.286 INFO:teuthology.orchestra.run.smithi045.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-10-03T19:10:47.286 INFO:teuthology.orchestra.run.smithi045.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-10-03T19:10:47.287 INFO:teuthology.orchestra.run.smithi045.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-10-03T19:10:47.287 INFO:teuthology.orchestra.run.smithi045.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-10-03T19:10:47.298 INFO:teuthology.orchestra.run.smithi045.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-10-03T19:10:47.299 INFO:teuthology.orchestra.run.smithi045.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-10-03T19:10:47.436 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libpq5:amd64. 2023-10-03T19:10:47.463 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-03T19:10:47.493 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-03T19:10:47.507 INFO:teuthology.orchestra.run.smithi045.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-10-03T19:10:47.507 INFO:teuthology.orchestra.run.smithi045.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-10-03T19:10:47.507 INFO:teuthology.orchestra.run.smithi045.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-10-03T19:10:47.507 INFO:teuthology.orchestra.run.smithi045.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-10-03T19:10:47.508 INFO:teuthology.orchestra.run.smithi045.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-10-03T19:10:47.508 INFO:teuthology.orchestra.run.smithi045.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-10-03T19:10:47.519 INFO:teuthology.orchestra.run.smithi045.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-10-03T19:10:47.520 INFO:teuthology.orchestra.run.smithi045.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-10-03T19:10:47.636 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-10-03T19:10:47.762 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-03T19:10:47.838 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-03T19:10:47.866 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-03T19:10:47.887 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-10-03T19:10:47.905 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-03T19:10:47.960 INFO:teuthology.orchestra.run.smithi045.stdout:Preconfiguring packages ... 2023-10-03T19:10:48.013 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-10-03T19:10:48.139 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-10-03T19:10:48.216 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-03T19:10:48.240 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-03T19:10:48.244 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-03T19:10:48.270 INFO:teuthology.orchestra.run.smithi045.stdout:Fetched 54.6 MB in 9s (5,748 kB/s) 2023-10-03T19:10:48.282 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-03T19:10:48.341 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-10-03T19:10:48.397 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package flex. 2023-10-03T19:10:48.463 INFO:teuthology.orchestra.run.smithi045.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172975 files and directories currently installed.) 2023-10-03T19:10:48.469 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-10-03T19:10:48.504 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking flex (2.6.4-8build2) ... 2023-10-03T19:10:48.518 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-03T19:10:48.534 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-03T19:10:48.568 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-03T19:10:48.605 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-03T19:10:48.632 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-03T19:10:48.663 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-03T19:10:48.924 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-03T19:10:48.939 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-03T19:10:48.971 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-03T19:10:48.982 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-03T19:10:49.046 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-03T19:10:49.072 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-03T19:10:49.098 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up dump (0.4b47-3) ... 2023-10-03T19:10:49.100 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-10-03T19:10:49.139 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-10-03T19:10:49.191 INFO:teuthology.orchestra.run.smithi146.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-03T19:10:49.227 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-10-03T19:10:49.249 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-03T19:10:49.301 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-03T19:10:49.328 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-03T19:10:49.375 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-03T19:10:49.376 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-03T19:10:49.476 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up tcl (8.6.11+1build2) ... 2023-10-03T19:10:49.500 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package modemmanager. 2023-10-03T19:10:49.528 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-03T19:10:49.567 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-03T19:10:49.585 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libjson-perl (4.04000-1) ... 2023-10-03T19:10:49.646 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-03T19:10:49.696 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-03T19:10:49.703 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-10-03T19:10:49.723 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-10-03T19:10:49.754 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-03T19:10:49.793 INFO:teuthology.orchestra.run.smithi146.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-10-03T19:10:49.863 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-03T19:10:49.989 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-03T19:10:50.056 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-03T19:10:50.084 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-10-03T19:10:50.123 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-03T19:10:50.170 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package bison. 2023-10-03T19:10:50.173 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-03T19:10:50.274 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-03T19:10:50.276 INFO:teuthology.orchestra.run.smithi045.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173048 files and directories currently installed.) 2023-10-03T19:10:50.282 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-10-03T19:10:50.330 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-10-03T19:10:50.375 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-10-03T19:10:50.476 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libpq5:amd64. 2023-10-03T19:10:50.503 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-03T19:10:50.527 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up postgresql-client (14+238) ... 2023-10-03T19:10:50.635 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-03T19:10:50.653 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-10-03T19:10:50.683 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package network-manager. 2023-10-03T19:10:50.689 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-03T19:10:50.711 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-10-03T19:10:50.718 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-10-03T19:10:50.756 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-10-03T19:10:50.758 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-10-03T19:10:51.100 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package dump. 2023-10-03T19:10:51.117 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-10-03T19:10:51.158 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking dump (0.4b47-3) ... 2023-10-03T19:10:51.170 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:10:51.170 INFO:teuthology.orchestra.run.smithi146.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-03T19:10:51.170 INFO:teuthology.orchestra.run.smithi146.stdout:which means they are currently configured by ifupdown: 2023-10-03T19:10:51.170 INFO:teuthology.orchestra.run.smithi146.stdout:- enp3s0f1 2023-10-03T19:10:51.170 INFO:teuthology.orchestra.run.smithi146.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-03T19:10:51.170 INFO:teuthology.orchestra.run.smithi146.stdout:remove their configuration from /etc/network/interfaces. 2023-10-03T19:10:51.170 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:10:51.284 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-03T19:10:51.313 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-03T19:10:51.341 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-03T19:10:51.349 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ppp. 2023-10-03T19:10:51.371 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-03T19:10:51.377 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-10-03T19:10:51.428 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package indent. 2023-10-03T19:10:51.445 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-10-03T19:10:51.487 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-03T19:10:51.631 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-03T19:10:51.657 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-03T19:10:51.666 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-10-03T19:10:51.685 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-03T19:10:51.722 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-03T19:10:51.724 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-03T19:10:51.740 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-10-03T19:10:51.772 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-03T19:10:51.975 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-03T19:10:51.979 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package pptp-linux. 2023-10-03T19:10:51.984 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-03T19:10:52.001 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-03T19:10:52.006 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-10-03T19:10:52.042 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-03T19:10:52.045 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-10-03T19:10:52.135 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-03T19:10:52.163 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-10-03T19:10:52.201 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-03T19:10:52.282 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-03T19:10:52.297 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-10-03T19:10:52.331 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-10-03T19:10:52.470 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-03T19:10:52.487 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-10-03T19:10:52.528 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-10-03T19:10:52.546 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-03T19:10:52.574 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-03T19:10:52.574 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-10-03T19:10:52.610 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package postgresql-client-common. 2023-10-03T19:10:52.612 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-10-03T19:10:52.637 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-10-03T19:10:52.676 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking postgresql-client-common (238) ... 2023-10-03T19:10:52.698 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-03T19:10:52.807 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-10-03T19:10:52.823 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libfl2:amd64. 2023-10-03T19:10:52.841 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-10-03T19:10:52.873 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-10-03T19:10:52.891 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package modemmanager. 2023-10-03T19:10:52.919 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-03T19:10:52.933 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up postgresql-common (238) ... 2023-10-03T19:10:52.949 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-03T19:10:52.989 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package postgresql-client-14. 2023-10-03T19:10:53.016 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-03T19:10:53.055 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-03T19:10:53.134 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-10-03T19:10:53.151 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-10-03T19:10:53.294 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-03T19:10:53.555 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libjson-perl. 2023-10-03T19:10:53.555 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package network-manager. 2023-10-03T19:10:53.572 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-10-03T19:10:53.583 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-10-03T19:10:53.586 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package postgresql-common. 2023-10-03T19:10:53.613 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-10-03T19:10:53.614 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-10-03T19:10:53.630 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-10-03T19:10:53.662 INFO:teuthology.orchestra.run.smithi079.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-10-03T19:10:53.693 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking postgresql-common (238) ... 2023-10-03T19:10:53.883 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libllvm14:amd64. 2023-10-03T19:10:53.912 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-10-03T19:10:53.941 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-03T19:10:54.121 INFO:teuthology.orchestra.run.smithi146.stdout:Adding user postgres to group ssl-cert 2023-10-03T19:10:54.202 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package postgresql-14. 2023-10-03T19:10:54.230 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-03T19:10:54.262 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ppp. 2023-10-03T19:10:54.271 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-03T19:10:54.290 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-10-03T19:10:54.321 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:10:54.322 INFO:teuthology.orchestra.run.smithi146.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-10-03T19:10:54.518 INFO:teuthology.orchestra.run.smithi146.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-10-03T19:10:54.519 INFO:teuthology.orchestra.run.smithi146.stdout:Removing obsolete dictionary files: 2023-10-03T19:10:54.576 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-10-03T19:10:54.883 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package pptp-linux. 2023-10-03T19:10:54.911 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-10-03T19:10:54.949 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-10-03T19:10:55.136 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-10-03T19:10:55.202 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-03T19:10:55.218 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-10-03T19:10:55.260 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-10-03T19:10:55.552 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-03T19:10:55.563 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package postgresql-client-common. 2023-10-03T19:10:55.565 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package postgresql. 2023-10-03T19:10:55.582 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-10-03T19:10:55.588 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-10-03T19:10:55.623 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking postgresql (14+238) ... 2023-10-03T19:10:55.629 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking postgresql-client-common (238) ... 2023-10-03T19:10:55.644 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-03T19:10:55.673 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-03T19:10:55.710 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-03T19:10:55.872 INFO:teuthology.orchestra.run.smithi146.stdout:Creating new PostgreSQL cluster 14/main ... 2023-10-03T19:10:55.889 INFO:teuthology.orchestra.run.smithi146.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-10-03T19:10:55.925 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package postgresql-client-14. 2023-10-03T19:10:55.937 INFO:teuthology.orchestra.run.smithi146.stdout:The files belonging to this database system will be owned by user "postgres". 2023-10-03T19:10:55.938 INFO:teuthology.orchestra.run.smithi146.stdout:This user must also own the server process. 2023-10-03T19:10:55.938 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:10:55.938 INFO:teuthology.orchestra.run.smithi146.stdout:The database cluster will be initialized with locale "en_US". 2023-10-03T19:10:55.938 INFO:teuthology.orchestra.run.smithi146.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-10-03T19:10:55.938 INFO:teuthology.orchestra.run.smithi146.stdout:The default text search configuration will be set to "english". 2023-10-03T19:10:55.938 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:10:55.938 INFO:teuthology.orchestra.run.smithi146.stdout:Data page checksums are disabled. 2023-10-03T19:10:55.938 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:10:55.938 INFO:teuthology.orchestra.run.smithi146.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-10-03T19:10:55.939 INFO:teuthology.orchestra.run.smithi146.stdout:creating subdirectories ... ok 2023-10-03T19:10:55.939 INFO:teuthology.orchestra.run.smithi146.stdout:selecting dynamic shared memory implementation ... posix 2023-10-03T19:10:55.953 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-03T19:10:55.953 INFO:teuthology.orchestra.run.smithi146.stdout:selecting default max_connections ... 100 2023-10-03T19:10:55.971 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-03T19:10:55.972 INFO:teuthology.orchestra.run.smithi146.stdout:selecting default shared_buffers ... 128MB 2023-10-03T19:10:55.982 INFO:teuthology.orchestra.run.smithi146.stdout:selecting default time zone ... Etc/UTC 2023-10-03T19:10:55.982 INFO:teuthology.orchestra.run.smithi146.stdout:creating configuration files ... ok 2023-10-03T19:10:55.991 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-03T19:10:56.000 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-03T19:10:56.038 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-03T19:10:56.097 INFO:teuthology.orchestra.run.smithi146.stdout:running bootstrap script ... ok 2023-10-03T19:10:56.111 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package postgresql-client. 2023-10-03T19:10:56.139 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-10-03T19:10:56.178 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking postgresql-client (14+238) ... 2023-10-03T19:10:56.357 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-03T19:10:56.386 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-03T19:10:56.397 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package postgresql-contrib. 2023-10-03T19:10:56.424 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-03T19:10:56.425 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-10-03T19:10:56.472 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking postgresql-contrib (14+238) ... 2023-10-03T19:10:56.616 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package postgresql-common. 2023-10-03T19:10:56.644 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-10-03T19:10:56.700 INFO:teuthology.orchestra.run.smithi172.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-10-03T19:10:56.729 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking postgresql-common (238) ... 2023-10-03T19:10:56.743 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-03T19:10:56.765 INFO:teuthology.orchestra.run.smithi146.stdout:performing post-bootstrap initialization ... ok 2023-10-03T19:10:56.772 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-10-03T19:10:56.791 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package tcl8.6. 2023-10-03T19:10:56.810 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-03T19:10:56.819 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-10-03T19:10:56.858 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-03T19:10:57.138 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-03T19:10:57.152 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package tcl. 2023-10-03T19:10:57.166 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-10-03T19:10:57.180 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-10-03T19:10:57.190 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package postgresql-14. 2023-10-03T19:10:57.204 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-03T19:10:57.217 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-03T19:10:57.224 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-10-03T19:10:57.259 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-03T19:10:57.379 INFO:teuthology.orchestra.run.smithi146.stdout:syncing data to disk ... ok 2023-10-03T19:10:57.513 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package wpasupplicant. 2023-10-03T19:10:57.530 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-10-03T19:10:57.549 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libpq5:amd64. 2023-10-03T19:10:57.577 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-03T19:10:57.580 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-03T19:10:57.615 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-03T19:10:57.795 INFO:teuthology.orchestra.run.smithi146.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-10-03T19:10:57.918 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-03T19:10:57.927 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-03T19:10:57.947 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-03T19:10:57.955 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-10-03T19:10:57.976 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-03T19:10:57.993 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-10-03T19:10:58.389 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-03T19:10:58.416 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-10-03T19:10:58.437 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-03T19:10:58.463 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-03T19:10:58.466 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-03T19:10:58.506 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-03T19:10:58.592 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package postgresql. 2023-10-03T19:10:58.609 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-10-03T19:10:58.650 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking postgresql (14+238) ... 2023-10-03T19:10:58.742 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up postgresql-client-common (238) ... 2023-10-03T19:10:58.750 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-03T19:10:58.778 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-03T19:10:58.817 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-03T19:10:58.879 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package postgresql-client. 2023-10-03T19:10:58.896 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-10-03T19:10:58.929 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking postgresql-client (14+238) ... 2023-10-03T19:10:58.954 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up flex (2.6.4-8build2) ... 2023-10-03T19:10:59.080 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-03T19:10:59.198 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package postgresql-contrib. 2023-10-03T19:10:59.206 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-03T19:10:59.226 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-10-03T19:10:59.265 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking postgresql-contrib (14+238) ... 2023-10-03T19:10:59.278 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-03T19:10:59.295 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-10-03T19:10:59.332 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-10-03T19:10:59.336 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-10-03T19:10:59.433 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-03T19:10:59.559 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-03T19:10:59.584 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package tcl8.6. 2023-10-03T19:10:59.612 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-10-03T19:10:59.651 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-03T19:10:59.698 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package modemmanager. 2023-10-03T19:10:59.726 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-03T19:10:59.764 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-03T19:10:59.928 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package tcl. 2023-10-03T19:10:59.956 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-10-03T19:10:59.999 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-10-03T19:11:00.060 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-10-03T19:11:00.141 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-03T19:11:00.298 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package wpasupplicant. 2023-10-03T19:11:00.326 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-10-03T19:11:00.364 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-03T19:11:00.370 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package network-manager. 2023-10-03T19:11:00.399 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-10-03T19:11:00.446 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-10-03T19:11:00.524 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-03T19:11:00.524 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-03T19:11:00.616 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-03T19:11:00.735 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-03T19:11:00.751 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up postgresql-contrib (14+238) ... 2023-10-03T19:11:00.763 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-10-03T19:11:00.801 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-10-03T19:11:00.877 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up postgresql (14+238) ... 2023-10-03T19:11:01.002 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-03T19:11:01.011 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ppp. 2023-10-03T19:11:01.035 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-10-03T19:11:01.040 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-10-03T19:11:01.129 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-03T19:11:01.162 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-03T19:11:01.196 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-03T19:11:01.225 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-10-03T19:11:01.271 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-03T19:11:01.271 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-10-03T19:11:01.337 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-10-03T19:11:01.390 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-03T19:11:01.390 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-03T19:11:01.398 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-10-03T19:11:01.524 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-10-03T19:11:01.540 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up postgresql-client-common (238) ... 2023-10-03T19:11:01.649 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package pptp-linux. 2023-10-03T19:11:01.650 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-03T19:11:01.677 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-10-03T19:11:01.715 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-10-03T19:11:01.735 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up flex (2.6.4-8build2) ... 2023-10-03T19:11:01.776 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-10-03T19:11:01.861 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-03T19:11:01.968 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-03T19:11:01.981 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-03T19:11:01.984 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-10-03T19:11:01.987 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-03T19:11:02.042 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-10-03T19:11:02.113 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-10-03T19:11:02.239 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-03T19:11:02.258 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-03T19:11:02.346 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package postgresql-client-common. 2023-10-03T19:11:02.365 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-03T19:11:02.375 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-10-03T19:11:02.407 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-03T19:11:02.412 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking postgresql-client-common (238) ... 2023-10-03T19:11:02.426 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-03T19:11:02.533 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up dump (0.4b47-3) ... 2023-10-03T19:11:02.644 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-03T19:11:02.691 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package postgresql-client-14. 2023-10-03T19:11:02.710 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-03T19:11:02.720 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-03T19:11:02.749 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-03T19:11:02.836 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-03T19:11:02.844 INFO:teuthology.orchestra.run.smithi172.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-10-03T19:11:02.937 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-03T19:11:02.962 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up tcl (8.6.11+1build2) ... 2023-10-03T19:11:03.072 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libjson-perl (4.04000-1) ... 2023-10-03T19:11:03.223 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-10-03T19:11:03.313 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-10-03T19:11:03.325 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-03T19:11:03.325 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-03T19:11:03.329 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package postgresql-common. 2023-10-03T19:11:03.358 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-10-03T19:11:03.383 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-03T19:11:03.414 INFO:teuthology.orchestra.run.smithi045.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-10-03T19:11:03.436 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking postgresql-common (238) ... 2023-10-03T19:11:03.509 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-03T19:11:03.686 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-03T19:11:03.729 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-10-03T19:11:03.812 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-03T19:11:03.820 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-10-03T19:11:03.881 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-10-03T19:11:03.903 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package postgresql-14. 2023-10-03T19:11:03.922 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-10-03T19:11:03.932 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-03T19:11:03.973 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-03T19:11:03.999 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-03T19:11:04.082 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up postgresql-client (14+238) ... 2023-10-03T19:11:04.100 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-10-03T19:11:04.201 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-10-03T19:11:04.208 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-10-03T19:11:04.319 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-10-03T19:11:04.444 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-03T19:11:04.446 INFO:teuthology.orchestra.run.smithi146.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-03T19:11:04.449 DEBUG:teuthology.parallel:result is None 2023-10-03T19:11:04.570 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-10-03T19:11:04.923 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:04.923 INFO:teuthology.orchestra.run.smithi079.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-03T19:11:04.923 INFO:teuthology.orchestra.run.smithi079.stdout:which means they are currently configured by ifupdown: 2023-10-03T19:11:04.923 INFO:teuthology.orchestra.run.smithi079.stdout:- enp3s0f1 2023-10-03T19:11:04.923 INFO:teuthology.orchestra.run.smithi079.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-03T19:11:04.923 INFO:teuthology.orchestra.run.smithi079.stdout:remove their configuration from /etc/network/interfaces. 2023-10-03T19:11:04.924 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:05.040 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-03T19:11:05.209 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-03T19:11:05.310 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up dump (0.4b47-3) ... 2023-10-03T19:11:05.323 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package postgresql. 2023-10-03T19:11:05.353 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-10-03T19:11:05.374 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-03T19:11:05.389 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking postgresql (14+238) ... 2023-10-03T19:11:05.396 INFO:teuthology.orchestra.run.smithi172.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-03T19:11:05.461 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-03T19:11:05.596 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-03T19:11:05.600 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package postgresql-client. 2023-10-03T19:11:05.617 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-10-03T19:11:05.650 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking postgresql-client (14+238) ... 2023-10-03T19:11:05.693 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-03T19:11:05.814 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up tcl (8.6.11+1build2) ... 2023-10-03T19:11:05.877 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package postgresql-contrib. 2023-10-03T19:11:05.906 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-10-03T19:11:05.939 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libjson-perl (4.04000-1) ... 2023-10-03T19:11:05.952 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking postgresql-contrib (14+238) ... 2023-10-03T19:11:06.065 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-10-03T19:11:06.181 INFO:teuthology.orchestra.run.smithi172.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-10-03T19:11:06.250 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-03T19:11:06.296 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package tcl8.6. 2023-10-03T19:11:06.303 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-03T19:11:06.325 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-10-03T19:11:06.359 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-03T19:11:06.363 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-03T19:11:06.437 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-03T19:11:06.564 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-10-03T19:11:06.641 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package tcl. 2023-10-03T19:11:06.669 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-10-03T19:11:06.673 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up postgresql-common (238) ... 2023-10-03T19:11:06.712 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-10-03T19:11:06.836 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-03T19:11:06.962 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-03T19:11:06.985 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package wpasupplicant. 2023-10-03T19:11:07.014 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-10-03T19:11:07.043 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-03T19:11:07.088 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-10-03T19:11:07.256 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up postgresql-client (14+238) ... 2023-10-03T19:11:07.382 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-10-03T19:11:07.406 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-03T19:11:07.423 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-10-03T19:11:07.464 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-10-03T19:11:07.529 INFO:teuthology.orchestra.run.smithi079.stdout:Adding user postgres to group ssl-cert 2023-10-03T19:11:07.765 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:07.765 INFO:teuthology.orchestra.run.smithi079.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-10-03T19:11:07.842 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-03T19:11:07.860 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:07.860 INFO:teuthology.orchestra.run.smithi172.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-03T19:11:07.860 INFO:teuthology.orchestra.run.smithi172.stdout:which means they are currently configured by ifupdown: 2023-10-03T19:11:07.860 INFO:teuthology.orchestra.run.smithi172.stdout:- enp3s0f1 2023-10-03T19:11:07.860 INFO:teuthology.orchestra.run.smithi172.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-03T19:11:07.860 INFO:teuthology.orchestra.run.smithi172.stdout:remove their configuration from /etc/network/interfaces. 2023-10-03T19:11:07.860 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:07.871 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-10-03T19:11:07.918 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-03T19:11:07.939 INFO:teuthology.orchestra.run.smithi079.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-10-03T19:11:07.940 INFO:teuthology.orchestra.run.smithi079.stdout:Removing obsolete dictionary files: 2023-10-03T19:11:07.979 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-03T19:11:08.213 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up postgresql-client-common (238) ... 2023-10-03T19:11:08.328 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-03T19:11:08.541 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-10-03T19:11:08.693 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-03T19:11:08.798 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up flex (2.6.4-8build2) ... 2023-10-03T19:11:08.924 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-03T19:11:08.926 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-03T19:11:09.050 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-03T19:11:09.151 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-10-03T19:11:09.239 INFO:teuthology.orchestra.run.smithi079.stdout:Creating new PostgreSQL cluster 14/main ... 2023-10-03T19:11:09.252 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-10-03T19:11:09.252 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-03T19:11:09.267 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-03T19:11:09.291 INFO:teuthology.orchestra.run.smithi079.stdout:The files belonging to this database system will be owned by user "postgres". 2023-10-03T19:11:09.291 INFO:teuthology.orchestra.run.smithi079.stdout:This user must also own the server process. 2023-10-03T19:11:09.291 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:09.291 INFO:teuthology.orchestra.run.smithi079.stdout:The database cluster will be initialized with locale "en_US". 2023-10-03T19:11:09.291 INFO:teuthology.orchestra.run.smithi079.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-10-03T19:11:09.291 INFO:teuthology.orchestra.run.smithi079.stdout:The default text search configuration will be set to "english". 2023-10-03T19:11:09.291 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:09.292 INFO:teuthology.orchestra.run.smithi079.stdout:Data page checksums are disabled. 2023-10-03T19:11:09.292 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:09.292 INFO:teuthology.orchestra.run.smithi079.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-10-03T19:11:09.292 INFO:teuthology.orchestra.run.smithi079.stdout:creating subdirectories ... ok 2023-10-03T19:11:09.292 INFO:teuthology.orchestra.run.smithi079.stdout:selecting dynamic shared memory implementation ... posix 2023-10-03T19:11:09.304 INFO:teuthology.orchestra.run.smithi079.stdout:selecting default max_connections ... 100 2023-10-03T19:11:09.324 INFO:teuthology.orchestra.run.smithi079.stdout:selecting default shared_buffers ... 128MB 2023-10-03T19:11:09.334 INFO:teuthology.orchestra.run.smithi079.stdout:selecting default time zone ... Etc/UTC 2023-10-03T19:11:09.334 INFO:teuthology.orchestra.run.smithi079.stdout:creating configuration files ... ok 2023-10-03T19:11:09.378 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-03T19:11:09.393 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-03T19:11:09.448 INFO:teuthology.orchestra.run.smithi079.stdout:running bootstrap script ... ok 2023-10-03T19:11:09.519 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-10-03T19:11:09.646 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up postgresql-common (238) ... 2023-10-03T19:11:09.911 INFO:teuthology.orchestra.run.smithi045.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-10-03T19:11:09.992 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-03T19:11:10.046 INFO:teuthology.orchestra.run.smithi079.stdout:performing post-bootstrap initialization ... ok 2023-10-03T19:11:10.381 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-03T19:11:10.381 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-03T19:11:10.582 INFO:teuthology.orchestra.run.smithi172.stdout:Adding user postgres to group ssl-cert 2023-10-03T19:11:10.779 INFO:teuthology.orchestra.run.smithi079.stdout:syncing data to disk ... ok 2023-10-03T19:11:10.824 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:10.824 INFO:teuthology.orchestra.run.smithi172.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-10-03T19:11:10.981 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-10-03T19:11:11.010 INFO:teuthology.orchestra.run.smithi172.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-10-03T19:11:11.010 INFO:teuthology.orchestra.run.smithi172.stdout:Removing obsolete dictionary files: 2023-10-03T19:11:11.082 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-03T19:11:11.153 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-10-03T19:11:11.183 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-10-03T19:11:11.300 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-10-03T19:11:11.426 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-10-03T19:11:11.553 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-03T19:11:11.579 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-10-03T19:11:11.679 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-10-03T19:11:11.980 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-03T19:11:12.316 INFO:teuthology.orchestra.run.smithi172.stdout:Creating new PostgreSQL cluster 14/main ... 2023-10-03T19:11:12.337 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-10-03T19:11:12.351 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-03T19:11:12.389 INFO:teuthology.orchestra.run.smithi172.stdout:The files belonging to this database system will be owned by user "postgres". 2023-10-03T19:11:12.389 INFO:teuthology.orchestra.run.smithi172.stdout:This user must also own the server process. 2023-10-03T19:11:12.389 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:12.390 INFO:teuthology.orchestra.run.smithi172.stdout:The database cluster will be initialized with locale "en_US". 2023-10-03T19:11:12.390 INFO:teuthology.orchestra.run.smithi172.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-10-03T19:11:12.390 INFO:teuthology.orchestra.run.smithi172.stdout:The default text search configuration will be set to "english". 2023-10-03T19:11:12.390 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:12.390 INFO:teuthology.orchestra.run.smithi172.stdout:Data page checksums are disabled. 2023-10-03T19:11:12.390 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:12.391 INFO:teuthology.orchestra.run.smithi172.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-10-03T19:11:12.391 INFO:teuthology.orchestra.run.smithi172.stdout:creating subdirectories ... ok 2023-10-03T19:11:12.391 INFO:teuthology.orchestra.run.smithi172.stdout:selecting dynamic shared memory implementation ... posix 2023-10-03T19:11:12.406 INFO:teuthology.orchestra.run.smithi172.stdout:selecting default max_connections ... 100 2023-10-03T19:11:12.425 INFO:teuthology.orchestra.run.smithi172.stdout:selecting default shared_buffers ... 128MB 2023-10-03T19:11:12.435 INFO:teuthology.orchestra.run.smithi172.stdout:selecting default time zone ... Etc/UTC 2023-10-03T19:11:12.436 INFO:teuthology.orchestra.run.smithi172.stdout:creating configuration files ... ok 2023-10-03T19:11:12.460 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up dump (0.4b47-3) ... 2023-10-03T19:11:12.549 INFO:teuthology.orchestra.run.smithi172.stdout:running bootstrap script ... ok 2023-10-03T19:11:12.563 INFO:teuthology.orchestra.run.smithi045.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-03T19:11:12.628 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-03T19:11:12.763 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-03T19:11:12.889 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up tcl (8.6.11+1build2) ... 2023-10-03T19:11:13.015 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libjson-perl (4.04000-1) ... 2023-10-03T19:11:13.141 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-10-03T19:11:13.231 INFO:teuthology.orchestra.run.smithi172.stdout:performing post-bootstrap initialization ... ok 2023-10-03T19:11:13.232 INFO:teuthology.orchestra.run.smithi045.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-10-03T19:11:13.293 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-03T19:11:13.394 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-03T19:11:13.570 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-03T19:11:13.705 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-03T19:11:13.831 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-10-03T19:11:13.891 INFO:teuthology.orchestra.run.smithi172.stdout:syncing data to disk ... ok 2023-10-03T19:11:13.933 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-03T19:11:13.999 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up postgresql-client (14+238) ... 2023-10-03T19:11:14.059 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up postgresql-contrib (14+238) ... 2023-10-03T19:11:14.125 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-10-03T19:11:14.185 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up postgresql (14+238) ... 2023-10-03T19:11:14.301 INFO:teuthology.orchestra.run.smithi172.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-10-03T19:11:14.311 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-03T19:11:14.437 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-03T19:11:14.668 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:14.669 INFO:teuthology.orchestra.run.smithi045.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-03T19:11:14.669 INFO:teuthology.orchestra.run.smithi045.stdout:which means they are currently configured by ifupdown: 2023-10-03T19:11:14.669 INFO:teuthology.orchestra.run.smithi045.stdout:- ens1f0 2023-10-03T19:11:14.669 INFO:teuthology.orchestra.run.smithi045.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-03T19:11:14.669 INFO:teuthology.orchestra.run.smithi045.stdout:remove their configuration from /etc/network/interfaces. 2023-10-03T19:11:14.669 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:14.688 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-03T19:11:14.688 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-03T19:11:14.800 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-03T19:11:15.162 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-03T19:11:15.206 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-03T19:11:15.531 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-03T19:11:15.534 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-03T19:11:15.669 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-03T19:11:16.102 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-03T19:11:16.254 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-03T19:11:16.389 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-10-03T19:11:16.515 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up postgresql-common (238) ... 2023-10-03T19:11:16.974 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-10-03T19:11:17.083 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-10-03T19:11:17.094 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-03T19:11:17.220 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up postgresql-contrib (14+238) ... 2023-10-03T19:11:17.346 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up postgresql (14+238) ... 2023-10-03T19:11:17.472 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-03T19:11:17.542 INFO:teuthology.orchestra.run.smithi045.stdout:Adding user postgres to group ssl-cert 2023-10-03T19:11:17.598 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-03T19:11:17.697 INFO:teuthology.orchestra.run.smithi079.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-03T19:11:17.700 DEBUG:teuthology.parallel:result is None 2023-10-03T19:11:17.781 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:17.781 INFO:teuthology.orchestra.run.smithi045.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-10-03T19:11:17.854 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-03T19:11:17.854 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-03T19:11:17.967 INFO:teuthology.orchestra.run.smithi045.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-10-03T19:11:17.967 INFO:teuthology.orchestra.run.smithi045.stdout:Removing obsolete dictionary files: 2023-10-03T19:11:18.475 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-03T19:11:18.618 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-10-03T19:11:18.819 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-03T19:11:18.971 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-03T19:11:19.042 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-03T19:11:19.371 INFO:teuthology.orchestra.run.smithi045.stdout:Creating new PostgreSQL cluster 14/main ... 2023-10-03T19:11:19.387 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-10-03T19:11:19.436 INFO:teuthology.orchestra.run.smithi045.stdout:The files belonging to this database system will be owned by user "postgres". 2023-10-03T19:11:19.436 INFO:teuthology.orchestra.run.smithi045.stdout:This user must also own the server process. 2023-10-03T19:11:19.436 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:19.436 INFO:teuthology.orchestra.run.smithi045.stdout:The database cluster will be initialized with locale "en_US". 2023-10-03T19:11:19.436 INFO:teuthology.orchestra.run.smithi045.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-10-03T19:11:19.436 INFO:teuthology.orchestra.run.smithi045.stdout:The default text search configuration will be set to "english". 2023-10-03T19:11:19.436 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:19.436 INFO:teuthology.orchestra.run.smithi045.stdout:Data page checksums are disabled. 2023-10-03T19:11:19.436 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:19.436 INFO:teuthology.orchestra.run.smithi045.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-10-03T19:11:19.437 INFO:teuthology.orchestra.run.smithi045.stdout:creating subdirectories ... ok 2023-10-03T19:11:19.437 INFO:teuthology.orchestra.run.smithi045.stdout:selecting dynamic shared memory implementation ... posix 2023-10-03T19:11:19.449 INFO:teuthology.orchestra.run.smithi045.stdout:selecting default max_connections ... 100 2023-10-03T19:11:19.467 INFO:teuthology.orchestra.run.smithi045.stdout:selecting default shared_buffers ... 128MB 2023-10-03T19:11:19.478 INFO:teuthology.orchestra.run.smithi045.stdout:selecting default time zone ... Etc/UTC 2023-10-03T19:11:19.479 INFO:teuthology.orchestra.run.smithi045.stdout:creating configuration files ... ok 2023-10-03T19:11:19.591 INFO:teuthology.orchestra.run.smithi045.stdout:running bootstrap script ... ok 2023-10-03T19:11:20.254 INFO:teuthology.orchestra.run.smithi045.stdout:performing post-bootstrap initialization ... ok 2023-10-03T19:11:20.315 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-10-03T19:11:20.415 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-10-03T19:11:20.937 INFO:teuthology.orchestra.run.smithi045.stdout:syncing data to disk ... ok 2023-10-03T19:11:21.082 INFO:teuthology.orchestra.run.smithi172.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-03T19:11:21.085 DEBUG:teuthology.parallel:result is None 2023-10-03T19:11:21.388 INFO:teuthology.orchestra.run.smithi045.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-10-03T19:11:24.274 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-03T19:11:24.400 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up postgresql-contrib (14+238) ... 2023-10-03T19:11:24.517 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up postgresql (14+238) ... 2023-10-03T19:11:24.627 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-03T19:11:24.736 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-03T19:11:24.996 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-03T19:11:24.996 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-03T19:11:25.606 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-03T19:11:25.908 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-03T19:11:26.059 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-03T19:11:27.564 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-10-03T19:11:27.664 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-10-03T19:11:28.343 INFO:teuthology.orchestra.run.smithi045.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-03T19:11:28.346 DEBUG:teuthology.parallel:result is None 2023-10-03T19:11:28.347 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=05a43c8fb3988914c879a50970f9054a098e0612 2023-10-03T19:11:28.568 DEBUG:teuthology.orchestra.run.smithi045:> dpkg-query -W -f '${Version}' ceph 2023-10-03T19:11:28.725 INFO:teuthology.orchestra.run.smithi045.stdout:18.0.0-3908-g05a43c8f-1jammy 2023-10-03T19:11:28.726 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3908-g05a43c8f-1jammy 2023-10-03T19:11:28.726 INFO:teuthology.task.install:The correct ceph version 18.0.0-3908-g05a43c8f-1jammy is installed. 2023-10-03T19:11:28.726 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=05a43c8fb3988914c879a50970f9054a098e0612 2023-10-03T19:11:28.945 DEBUG:teuthology.orchestra.run.smithi079:> dpkg-query -W -f '${Version}' ceph 2023-10-03T19:11:28.965 INFO:teuthology.orchestra.run.smithi079.stdout:18.0.0-3908-g05a43c8f-1jammy 2023-10-03T19:11:28.965 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3908-g05a43c8f-1jammy 2023-10-03T19:11:28.965 INFO:teuthology.task.install:The correct ceph version 18.0.0-3908-g05a43c8f-1jammy is installed. 2023-10-03T19:11:28.965 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=05a43c8fb3988914c879a50970f9054a098e0612 2023-10-03T19:11:29.181 DEBUG:teuthology.orchestra.run.smithi146:> dpkg-query -W -f '${Version}' ceph 2023-10-03T19:11:29.201 INFO:teuthology.orchestra.run.smithi146.stdout:18.0.0-3908-g05a43c8f-1jammy 2023-10-03T19:11:29.201 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3908-g05a43c8f-1jammy 2023-10-03T19:11:29.201 INFO:teuthology.task.install:The correct ceph version 18.0.0-3908-g05a43c8f-1jammy is installed. 2023-10-03T19:11:29.201 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=05a43c8fb3988914c879a50970f9054a098e0612 2023-10-03T19:11:29.413 DEBUG:teuthology.orchestra.run.smithi172:> dpkg-query -W -f '${Version}' ceph 2023-10-03T19:11:29.434 INFO:teuthology.orchestra.run.smithi172.stdout:18.0.0-3908-g05a43c8f-1jammy 2023-10-03T19:11:29.434 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3908-g05a43c8f-1jammy 2023-10-03T19:11:29.434 INFO:teuthology.task.install:The correct ceph version 18.0.0-3908-g05a43c8f-1jammy is installed. 2023-10-03T19:11:29.435 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-03T19:11:29.435 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-03T19:11:29.435 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-03T19:11:29.450 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-03T19:11:29.450 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-03T19:11:29.465 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:11:29.465 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-03T19:11:29.480 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-03T19:11:29.480 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-03T19:11:29.495 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-03T19:11:29.495 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-03T19:11:29.495 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/daemon-helper 2023-10-03T19:11:29.508 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-03T19:11:29.565 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-03T19:11:29.565 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/daemon-helper 2023-10-03T19:11:29.578 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-03T19:11:29.633 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:11:29.633 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/daemon-helper 2023-10-03T19:11:29.647 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-03T19:11:29.703 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-03T19:11:29.703 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/daemon-helper 2023-10-03T19:11:29.718 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-03T19:11:29.773 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-03T19:11:29.773 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-03T19:11:29.773 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-03T19:11:29.787 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-03T19:11:29.841 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-03T19:11:29.842 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-03T19:11:29.857 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-03T19:11:29.912 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:11:29.912 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-03T19:11:29.926 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-03T19:11:29.979 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-03T19:11:29.979 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-03T19:11:29.993 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-03T19:11:30.050 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-03T19:11:30.050 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-03T19:11:30.050 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/stdin-killer 2023-10-03T19:11:30.064 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-03T19:11:30.118 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-03T19:11:30.118 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/stdin-killer 2023-10-03T19:11:30.131 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-03T19:11:30.184 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:11:30.185 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/stdin-killer 2023-10-03T19:11:30.199 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-03T19:11:30.254 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-03T19:11:30.254 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/stdin-killer 2023-10-03T19:11:30.270 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-03T19:11:30.325 INFO:teuthology.run_tasks:Running task ceph... 2023-10-03T19:11:30.386 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-03T19:11:30.386 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 777 /var/log/ceph 2023-10-03T19:11:30.389 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 777 /var/log/ceph 2023-10-03T19:11:30.391 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 777 /var/log/ceph 2023-10-03T19:11:30.393 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /var/log/ceph 2023-10-03T19:11:30.406 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-03T19:11:30.406 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-03T19:11:30.443 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-03T19:11:30.447 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-03T19:11:30.449 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-03T19:11:30.462 INFO:tasks.ceph:Creating extra log directories... 2023-10-03T19:11:30.462 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-03T19:11:30.503 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-03T19:11:30.505 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-03T19:11:30.508 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-03T19:11:30.546 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-03T19:11:30.546 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-03T19:11:30.546 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-03T19:11:30.546 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-03T19:11:30.547 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-03T19:11:30.566 DEBUG:teuthology.orchestra.run.smithi045:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-03T19:11:30.643 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-03T19:11:30.643 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-03T19:11:30.648 DEBUG:teuthology.orchestra.run.smithi079:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-03T19:11:30.722 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:11:30.722 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-03T19:11:30.727 DEBUG:teuthology.orchestra.run.smithi146:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-03T19:11:30.803 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-03T19:11:30.803 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-03T19:11:30.809 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-03T19:11:30.889 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-03T19:11:30.890 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'POOL_APP_NOT_ENABLED', 'has not responded to cap revoke by MDS for over', 'MDS_CLIENT_LATE_RELEASE', 'responding to mclientcaps', 'RECENT_CRASH'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-03T19:11:30.890 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409792', 'branch': 'wip-choffman-62793', 'description': 'fs:multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cephfs_misc_tests}', 'email': 'choffman@redhat.com', 'first_in_suite': False, 'job_id': '7409792', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-choffman-62793'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'POOL_APP_NOT_ENABLED', 'has not responded to cap revoke by MDS for over', 'MDS_CLIENT_LATE_RELEASE', 'responding to mclientcaps', 'RECENT_CRASH'], 'sha1': '05a43c8fb3988914c879a50970f9054a098e0612'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '05a43c8fb3988914c879a50970f9054a098e0612'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-choffman-62793', 'sha1': '05a43c8fb3988914c879a50970f9054a098e0612'}}, 'owner': 'scheduled_choffman@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0'], ['client.1']], 'seed': 3306, 'sha1': '05a43c8fb3988914c879a50970f9054a098e0612', 'sleep_before_teardown': 0, 'suite': 'fs:multiclient', 'suite_branch': 'wip-choffman-62793', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_05a43c8fb3988914c879a50970f9054a098e0612/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '05a43c8fb3988914c879a50970f9054a098e0612', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi045.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBJfsaj1djbOti81Dmn5qO0pfO5rYcvniGIAtp+MIUvkVmtGd9VXAp06DIE/qyqJOyjh5SZa6UesWBZxgky+s4U=', 'smithi079.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKgpdiDVkYYXQbbURBwT9Rp8YDcnmAh2JRm/q5erIc+gDdvR4Mxzhp1KpKacw1JRbdCOH6jNalhbDy1hqwVjlcg=', 'smithi146.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBMtZSn5l68ULSewvnabptb3DKz9uudJEq10NeUGv4Rt65sNrEqRevCUYjra9dz+LkBRhymwHaIunBYfmm5hk4c=', 'smithi172.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBARCcmEfPgLbLeMB5pthXEkrZT5nqdfdF5Ubx6PDhdBG6RidO06YCSAxrRhSCHTNcaw7nUa1ndiM3aIPmuwM5og='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '05a43c8fb3988914c879a50970f9054a098e0612'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_misc']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-03_18:32:29', 'tube': 'smithi', 'user': 'choffman', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-03T19:11:30.890 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-03T19:11:30.893 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-03T19:11:30.896 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-03T19:11:30.899 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-03T19:11:30.930 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m0777 -- /var/run/ceph 2023-10-03T19:11:30.943 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/run/ceph 2023-10-03T19:11:30.945 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/run/ceph 2023-10-03T19:11:30.947 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/run/ceph 2023-10-03T19:11:30.986 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-03T19:11:30.986 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/scratch_devs of=/dev/stdout 2023-10-03T19:11:31.002 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-03T19:11:31.002 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_1 2023-10-03T19:11:31.054 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-03T19:11:31.054 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-03T19:11:31.054 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 882 Links: 1 2023-10-03T19:11:31.054 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-03T19:11:31.054 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-10-03 19:05:06.455113635 +0000 2023-10-03T19:11:31.055 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-10-03 19:05:06.451113671 +0000 2023-10-03T19:11:31.055 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-10-03 19:05:06.451113671 +0000 2023-10-03T19:11:31.055 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2023-10-03T19:11:31.055 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-03T19:11:31.109 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-10-03T19:11:31.109 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-10-03T19:11:31.109 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000319355 s, 1.6 MB/s 2023-10-03T19:11:31.110 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-03T19:11:31.160 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_2 2023-10-03T19:11:31.206 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-03T19:11:31.206 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-03T19:11:31.206 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 900 Links: 1 2023-10-03T19:11:31.207 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-03T19:11:31.207 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-10-03 19:05:07.495104344 +0000 2023-10-03T19:11:31.207 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-10-03 19:05:07.095107917 +0000 2023-10-03T19:11:31.207 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-10-03 19:05:07.095107917 +0000 2023-10-03T19:11:31.207 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2023-10-03T19:11:31.207 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-03T19:11:31.260 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-10-03T19:11:31.260 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-10-03T19:11:31.260 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000209318 s, 2.4 MB/s 2023-10-03T19:11:31.262 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-03T19:11:31.311 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_3 2023-10-03T19:11:31.358 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-03T19:11:31.359 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-03T19:11:31.359 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 915 Links: 1 2023-10-03T19:11:31.359 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-03T19:11:31.359 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-10-03 19:05:08.103098913 +0000 2023-10-03T19:11:31.359 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-10-03 19:05:07.695102559 +0000 2023-10-03T19:11:31.359 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-10-03 19:05:07.695102559 +0000 2023-10-03T19:11:31.359 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2023-10-03T19:11:31.359 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-03T19:11:31.412 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-10-03T19:11:31.412 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-10-03T19:11:31.412 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000299568 s, 1.7 MB/s 2023-10-03T19:11:31.413 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-03T19:11:31.463 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_4 2023-10-03T19:11:31.510 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-03T19:11:31.510 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-03T19:11:31.511 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 938 Links: 1 2023-10-03T19:11:31.511 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-03T19:11:31.511 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-10-03 19:05:08.331096878 +0000 2023-10-03T19:11:31.511 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-10-03 19:05:08.327096914 +0000 2023-10-03T19:11:31.511 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-10-03 19:05:08.327096914 +0000 2023-10-03T19:11:31.511 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2023-10-03T19:11:31.511 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-03T19:11:31.565 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-10-03T19:11:31.565 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-10-03T19:11:31.565 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000270208 s, 1.9 MB/s 2023-10-03T19:11:31.566 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-03T19:11:31.615 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-03T19:11:31.616 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-03T19:11:31.616 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/scratch_devs of=/dev/stdout 2023-10-03T19:11:31.622 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-03T19:11:31.622 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_1 2023-10-03T19:11:31.670 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-03T19:11:31.670 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-03T19:11:31.671 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 877 Links: 1 2023-10-03T19:11:31.671 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-03T19:11:31.671 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2023-10-03 19:05:05.022643369 +0000 2023-10-03T19:11:31.672 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2023-10-03 19:05:04.570647406 +0000 2023-10-03T19:11:31.672 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2023-10-03 19:05:04.570647406 +0000 2023-10-03T19:11:31.672 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2023-10-03T19:11:31.672 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-03T19:11:31.724 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2023-10-03T19:11:31.724 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2023-10-03T19:11:31.725 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000451113 s, 1.1 MB/s 2023-10-03T19:11:31.726 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-03T19:11:31.775 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_2 2023-10-03T19:11:31.826 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-03T19:11:31.826 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-03T19:11:31.826 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 888 Links: 1 2023-10-03T19:11:31.826 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-03T19:11:31.826 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2023-10-03 19:05:05.238641440 +0000 2023-10-03T19:11:31.826 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2023-10-03 19:05:05.234641476 +0000 2023-10-03T19:11:31.826 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2023-10-03 19:05:05.234641476 +0000 2023-10-03T19:11:31.827 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2023-10-03T19:11:31.827 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-03T19:11:31.880 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2023-10-03T19:11:31.880 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2023-10-03T19:11:31.880 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.00041882 s, 1.2 MB/s 2023-10-03T19:11:31.881 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-03T19:11:31.931 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_3 2023-10-03T19:11:31.978 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-03T19:11:31.979 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-03T19:11:31.979 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 911 Links: 1 2023-10-03T19:11:31.979 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-03T19:11:31.979 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2023-10-03 19:05:06.238632507 +0000 2023-10-03T19:11:31.979 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2023-10-03 19:05:05.870635795 +0000 2023-10-03T19:11:31.979 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2023-10-03 19:05:05.870635795 +0000 2023-10-03T19:11:31.980 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2023-10-03T19:11:31.980 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-03T19:11:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2023-10-03T19:11:32.032 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2023-10-03T19:11:32.032 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000325126 s, 1.6 MB/s 2023-10-03T19:11:32.033 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-03T19:11:32.083 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_4 2023-10-03T19:11:32.131 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-03T19:11:32.131 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-03T19:11:32.131 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 927 Links: 1 2023-10-03T19:11:32.131 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-03T19:11:32.131 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2023-10-03 19:05:06.862626934 +0000 2023-10-03T19:11:32.131 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2023-10-03 19:05:06.474630399 +0000 2023-10-03T19:11:32.131 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2023-10-03 19:05:06.474630399 +0000 2023-10-03T19:11:32.131 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2023-10-03T19:11:32.132 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-03T19:11:32.183 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2023-10-03T19:11:32.184 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2023-10-03T19:11:32.184 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000277645 s, 1.8 MB/s 2023-10-03T19:11:32.185 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-03T19:11:32.235 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-03T19:11:32.235 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi045.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-03T19:11:32.236 INFO:tasks.ceph:Generating config... 2023-10-03T19:11:32.237 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-03T19:11:32.237 INFO:tasks.ceph:[client] debug client = 20 2023-10-03T19:11:32.237 INFO:tasks.ceph:[client] debug ms = 1 2023-10-03T19:11:32.237 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-03T19:11:32.237 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-03T19:11:32.237 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-03T19:11:32.237 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-10-03T19:11:32.237 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-03T19:11:32.237 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-03T19:11:32.238 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-03T19:11:32.238 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-03T19:11:32.238 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-03T19:11:32.238 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-03T19:11:32.238 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-03T19:11:32.238 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-03T19:11:32.238 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-03T19:11:32.238 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-03T19:11:32.238 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-03T19:11:32.238 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-03T19:11:32.238 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-03T19:11:32.238 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-03T19:11:32.239 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-03T19:11:32.239 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-10-03T19:11:32.239 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-03T19:11:32.239 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-10-03T19:11:32.239 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-10-03T19:11:32.239 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-03T19:11:32.239 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-03T19:11:32.239 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-03T19:11:32.239 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-03T19:11:32.239 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-03T19:11:32.239 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-03T19:11:32.239 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-03T19:11:32.239 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-03T19:11:32.240 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-03T19:11:32.240 INFO:tasks.ceph:Setting up mon.a... 2023-10-03T19:11:32.240 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-03T19:11:32.276 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.keyring 2023-10-03T19:11:32.284 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-03T19:11:32.362 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-03T19:11:32.418 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.45'), ('mon.b', '172.21.15.79'), ('mon.c', '[v2:172.21.15.79:3301,v1:172.21.15.79:6790]')] 2023-10-03T19:11:32.419 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.45,172.21.15.79,[v2:172.21.15.79:3301,v1:172.21.15.79:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-03T19:11:32.420 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-03T19:11:32.420 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-03T19:11:32.466 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.45 --add b 172.21.15.79 --addv c '[v2:172.21.15.79:3301,v1:172.21.15.79:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-03T19:11:32.552 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-03T19:11:32.552 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: generated fsid 58400977-12ba-4c73-bb3e-1589b2492669 2023-10-03T19:11:32.552 INFO:teuthology.orchestra.run.smithi045.stdout:setting min_mon_release = pacific 2023-10-03T19:11:32.552 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 0 2023-10-03T19:11:32.552 INFO:teuthology.orchestra.run.smithi045.stdout:fsid 58400977-12ba-4c73-bb3e-1589b2492669 2023-10-03T19:11:32.553 INFO:teuthology.orchestra.run.smithi045.stdout:last_changed 2023-10-03T19:11:32.553177+0000 2023-10-03T19:11:32.553 INFO:teuthology.orchestra.run.smithi045.stdout:created 2023-10-03T19:11:32.553177+0000 2023-10-03T19:11:32.553 INFO:teuthology.orchestra.run.smithi045.stdout:min_mon_release 16 (pacific) 2023-10-03T19:11:32.553 INFO:teuthology.orchestra.run.smithi045.stdout:election_strategy: 1 2023-10-03T19:11:32.553 INFO:teuthology.orchestra.run.smithi045.stdout:0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2023-10-03T19:11:32.553 INFO:teuthology.orchestra.run.smithi045.stdout:1: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.b 2023-10-03T19:11:32.553 INFO:teuthology.orchestra.run.smithi045.stdout:2: [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] mon.c 2023-10-03T19:11:32.553 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-03T19:11:32.554 DEBUG:teuthology.orchestra.run.smithi045:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-03T19:11:32.602 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 58400977-12ba-4c73-bb3e-1589b2492669... 2023-10-03T19:11:32.603 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-03T19:11:32.646 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-03T19:11:32.649 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-03T19:11:32.651 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-03T19:11:32.675 INFO:teuthology.orchestra.run.smithi045.stdout:[global] 2023-10-03T19:11:32.675 INFO:teuthology.orchestra.run.smithi045.stdout: chdir = "" 2023-10-03T19:11:32.675 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-03T19:11:32.675 INFO:teuthology.orchestra.run.smithi045.stdout: auth supported = cephx 2023-10-03T19:11:32.675 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:32.675 INFO:teuthology.orchestra.run.smithi045.stdout: filestore xattr use omap = true 2023-10-03T19:11:32.676 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:32.676 INFO:teuthology.orchestra.run.smithi045.stdout: mon clock drift allowed = 1.000 2023-10-03T19:11:32.676 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:32.676 INFO:teuthology.orchestra.run.smithi045.stdout: osd crush chooseleaf type = 0 2023-10-03T19:11:32.676 INFO:teuthology.orchestra.run.smithi045.stdout: auth debug = true 2023-10-03T19:11:32.676 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:32.676 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on old message = true 2023-10-03T19:11:32.676 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on bug = true 2023-10-03T19:11:32.677 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:32.677 INFO:teuthology.orchestra.run.smithi045.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-03T19:11:32.677 INFO:teuthology.orchestra.run.smithi045.stdout: mon pg warn max object skew = 0 2023-10-03T19:11:32.677 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:32.677 INFO:teuthology.orchestra.run.smithi045.stdout: # disable pg_autoscaler by default for new pools 2023-10-03T19:11:32.677 INFO:teuthology.orchestra.run.smithi045.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-03T19:11:32.677 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:32.677 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default size = 2 2023-10-03T19:11:32.678 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:32.678 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow primary affinity = true 2023-10-03T19:11:32.678 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow pg remap = true 2023-10-03T19:11:32.678 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on legacy crush tunables = false 2023-10-03T19:11:32.678 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on crush straw calc version zero = false 2023-10-03T19:11:32.678 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on no sortbitwise = false 2023-10-03T19:11:32.678 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on osd down out interval zero = false 2023-10-03T19:11:32.678 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on too few osds = false 2023-10-03T19:11:32.679 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-03T19:11:32.679 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-03T19:11:32.679 INFO:teuthology.orchestra.run.smithi045.stdout: mon_allow_pool_size_one = true 2023-10-03T19:11:32.679 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:32.679 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-03T19:11:32.679 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:32.679 INFO:teuthology.orchestra.run.smithi045.stdout: osd default data pool replay window = 5 2023-10-03T19:11:32.679 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:32.680 INFO:teuthology.orchestra.run.smithi045.stdout: mon allow pool delete = true 2023-10-03T19:11:32.680 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:32.680 INFO:teuthology.orchestra.run.smithi045.stdout: mon cluster log file level = debug 2023-10-03T19:11:32.680 INFO:teuthology.orchestra.run.smithi045.stdout: debug asserts on shutdown = true 2023-10-03T19:11:32.680 INFO:teuthology.orchestra.run.smithi045.stdout: mon health detail to clog = false 2023-10-03T19:11:32.680 INFO:teuthology.orchestra.run.smithi045.stdout: mon host = "172.21.15.45,172.21.15.79,[v2:172.21.15.79:3301,v1:172.21.15.79:6790]" 2023-10-03T19:11:32.680 INFO:teuthology.orchestra.run.smithi045.stdout: fsid = 58400977-12ba-4c73-bb3e-1589b2492669 2023-10-03T19:11:32.680 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:32.681 INFO:teuthology.orchestra.run.smithi045.stdout:[osd] 2023-10-03T19:11:32.681 INFO:teuthology.orchestra.run.smithi045.stdout: osd journal size = 100 2023-10-03T19:11:32.681 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:32.681 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub load threshold = 5.0 2023-10-03T19:11:32.681 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub max interval = 600 2023-10-03T19:11:32.681 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:32.681 INFO:teuthology.orchestra.run.smithi045.stdout: osd recover clone overlap = true 2023-10-03T19:11:32.681 INFO:teuthology.orchestra.run.smithi045.stdout: osd recovery max chunk = 1048576 2023-10-03T19:11:32.682 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:32.682 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug shutdown = true 2023-10-03T19:11:32.682 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug op order = true 2023-10-03T19:11:32.682 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug verify stray on activate = true 2023-10-03T19:11:32.682 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:32.682 INFO:teuthology.orchestra.run.smithi045.stdout: osd open classes on start = true 2023-10-03T19:11:32.682 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug pg log writeout = true 2023-10-03T19:11:32.683 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:32.683 INFO:teuthology.orchestra.run.smithi045.stdout: osd deep scrub update digest min age = 30 2023-10-03T19:11:32.683 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:32.683 INFO:teuthology.orchestra.run.smithi045.stdout: osd map max advance = 10 2023-10-03T19:11:32.683 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:32.684 INFO:teuthology.orchestra.run.smithi045.stdout: journal zero on create = true 2023-10-03T19:11:32.684 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:32.684 INFO:teuthology.orchestra.run.smithi045.stdout: filestore ondisk finisher threads = 3 2023-10-03T19:11:32.684 INFO:teuthology.orchestra.run.smithi045.stdout: filestore apply finisher threads = 3 2023-10-03T19:11:32.684 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:32.684 INFO:teuthology.orchestra.run.smithi045.stdout: bdev debug aio = true 2023-10-03T19:11:32.685 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug misdirected ops = true 2023-10-03T19:11:32.685 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore block size = 96636764160 2023-10-03T19:11:32.685 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore compression mode = aggressive 2023-10-03T19:11:32.685 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore fsck on mount = True 2023-10-03T19:11:32.685 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluefs = 20 2023-10-03T19:11:32.685 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluestore = 20 2023-10-03T19:11:32.686 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-10-03T19:11:32.686 INFO:teuthology.orchestra.run.smithi045.stdout: debug osd = 20 2023-10-03T19:11:32.686 INFO:teuthology.orchestra.run.smithi045.stdout: debug rocksdb = 10 2023-10-03T19:11:32.686 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd backfillfull_ratio = 0.85 2023-10-03T19:11:32.686 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd full ratio = 0.9 2023-10-03T19:11:32.687 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd nearfull ratio = 0.8 2023-10-03T19:11:32.687 INFO:teuthology.orchestra.run.smithi045.stdout: osd failsafe full ratio = 0.95 2023-10-03T19:11:32.687 INFO:teuthology.orchestra.run.smithi045.stdout: osd objectstore = bluestore 2023-10-03T19:11:32.687 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-10-03T19:11:32.687 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:32.687 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr] 2023-10-03T19:11:32.688 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-10-03T19:11:32.688 INFO:teuthology.orchestra.run.smithi045.stdout: debug mgr = 20 2023-10-03T19:11:32.688 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-10-03T19:11:32.688 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-10-03T19:11:32.688 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-10-03T19:11:32.689 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-10-03T19:11:32.689 INFO:teuthology.orchestra.run.smithi045.stdout: mgr/telemetry/nag = false 2023-10-03T19:11:32.689 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:32.689 INFO:teuthology.orchestra.run.smithi045.stdout:[mon] 2023-10-03T19:11:32.689 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-10-03T19:11:32.689 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-10-03T19:11:32.690 INFO:teuthology.orchestra.run.smithi045.stdout: debug paxos = 20 2023-10-03T19:11:32.690 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-10-03T19:11:32.690 INFO:teuthology.orchestra.run.smithi045.stdout: mon data avail warn = 5 2023-10-03T19:11:32.690 INFO:teuthology.orchestra.run.smithi045.stdout: mon mgr mkfs grace = 240 2023-10-03T19:11:32.690 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-10-03T19:11:32.691 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd reporter subtree level = osd 2023-10-03T19:11:32.691 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd prime pg temp = true 2023-10-03T19:11:32.691 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-10-03T19:11:32.691 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:32.691 INFO:teuthology.orchestra.run.smithi045.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-03T19:11:32.692 INFO:teuthology.orchestra.run.smithi045.stdout: auth mon ticket ttl = 660 # 11m 2023-10-03T19:11:32.692 INFO:teuthology.orchestra.run.smithi045.stdout: auth service ticket ttl = 240 # 4m 2023-10-03T19:11:32.692 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:32.692 INFO:teuthology.orchestra.run.smithi045.stdout: # don't complain about insecure global_id in the test suite 2023-10-03T19:11:32.692 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-03T19:11:32.693 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-03T19:11:32.693 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:32.693 INFO:teuthology.orchestra.run.smithi045.stdout: # 1m isn't quite enough 2023-10-03T19:11:32.693 INFO:teuthology.orchestra.run.smithi045.stdout: mon_down_mkfs_grace = 2m 2023-10-03T19:11:32.693 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:32.693 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_filestore_osds = false 2023-10-03T19:11:32.694 INFO:teuthology.orchestra.run.smithi045.stdout: mon op complaint time = 120 2023-10-03T19:11:32.694 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:11:32.694 INFO:teuthology.orchestra.run.smithi045.stdout:[client] 2023-10-03T19:11:32.694 INFO:teuthology.orchestra.run.smithi045.stdout: rgw cache enabled = true 2023-10-03T19:11:32.694 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable ops log = true 2023-10-03T19:11:32.694 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable usage log = true 2023-10-03T19:11:32.695 INFO:teuthology.orchestra.run.smithi045.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-03T19:11:32.695 INFO:teuthology.orchestra.run.smithi045.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-03T19:11:32.695 INFO:teuthology.orchestra.run.smithi045.stdout: client mount timeout = 600 2023-10-03T19:11:32.695 INFO:teuthology.orchestra.run.smithi045.stdout: debug client = 20 2023-10-03T19:11:32.695 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-10-03T19:11:32.695 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-10-03T19:11:32.696 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-10-03T19:11:32.696 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.a] 2023-10-03T19:11:32.696 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.b] 2023-10-03T19:11:32.696 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.c] 2023-10-03T19:11:32.696 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-10-03T19:11:32.697 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-10-03T19:11:32.697 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-10-03T19:11:32.697 INFO:teuthology.orchestra.run.smithi045.stdout:[mds] 2023-10-03T19:11:32.697 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds = 20 2023-10-03T19:11:32.697 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds balancer = 20 2023-10-03T19:11:32.697 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-10-03T19:11:32.698 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug frag = True 2023-10-03T19:11:32.698 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug scatterstat = True 2023-10-03T19:11:32.698 INFO:teuthology.orchestra.run.smithi045.stdout: mds op complaint time = 180 2023-10-03T19:11:32.698 INFO:teuthology.orchestra.run.smithi045.stdout: mds verify scatter = True 2023-10-03T19:11:32.698 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-10-03T19:11:32.698 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-10-03T19:11:32.699 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-10-03T19:11:32.703 INFO:teuthology.orchestra.run.smithi172.stdout:[global] 2023-10-03T19:11:32.703 INFO:teuthology.orchestra.run.smithi172.stdout: chdir = "" 2023-10-03T19:11:32.704 INFO:teuthology.orchestra.run.smithi172.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-03T19:11:32.704 INFO:teuthology.orchestra.run.smithi172.stdout: auth supported = cephx 2023-10-03T19:11:32.704 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:32.704 INFO:teuthology.orchestra.run.smithi172.stdout: filestore xattr use omap = true 2023-10-03T19:11:32.704 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:32.704 INFO:teuthology.orchestra.run.smithi172.stdout: mon clock drift allowed = 1.000 2023-10-03T19:11:32.704 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:32.704 INFO:teuthology.orchestra.run.smithi172.stdout: osd crush chooseleaf type = 0 2023-10-03T19:11:32.704 INFO:teuthology.orchestra.run.smithi172.stdout: auth debug = true 2023-10-03T19:11:32.704 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:32.705 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on old message = true 2023-10-03T19:11:32.705 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on bug = true 2023-10-03T19:11:32.705 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:32.705 INFO:teuthology.orchestra.run.smithi172.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-03T19:11:32.705 INFO:teuthology.orchestra.run.smithi172.stdout: mon pg warn max object skew = 0 2023-10-03T19:11:32.705 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:32.705 INFO:teuthology.orchestra.run.smithi172.stdout: # disable pg_autoscaler by default for new pools 2023-10-03T19:11:32.705 INFO:teuthology.orchestra.run.smithi172.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-03T19:11:32.705 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:32.705 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default size = 2 2023-10-03T19:11:32.705 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:32.706 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow primary affinity = true 2023-10-03T19:11:32.706 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow pg remap = true 2023-10-03T19:11:32.706 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on legacy crush tunables = false 2023-10-03T19:11:32.706 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on crush straw calc version zero = false 2023-10-03T19:11:32.706 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on no sortbitwise = false 2023-10-03T19:11:32.706 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on osd down out interval zero = false 2023-10-03T19:11:32.706 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on too few osds = false 2023-10-03T19:11:32.706 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-03T19:11:32.706 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-03T19:11:32.706 INFO:teuthology.orchestra.run.smithi172.stdout: mon_allow_pool_size_one = true 2023-10-03T19:11:32.706 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:32.707 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-03T19:11:32.707 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:32.707 INFO:teuthology.orchestra.run.smithi172.stdout: osd default data pool replay window = 5 2023-10-03T19:11:32.707 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:32.707 INFO:teuthology.orchestra.run.smithi172.stdout: mon allow pool delete = true 2023-10-03T19:11:32.707 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:32.707 INFO:teuthology.orchestra.run.smithi172.stdout: mon cluster log file level = debug 2023-10-03T19:11:32.707 INFO:teuthology.orchestra.run.smithi172.stdout: debug asserts on shutdown = true 2023-10-03T19:11:32.707 INFO:teuthology.orchestra.run.smithi172.stdout: mon health detail to clog = false 2023-10-03T19:11:32.707 INFO:teuthology.orchestra.run.smithi172.stdout: mon host = "172.21.15.45,172.21.15.79,[v2:172.21.15.79:3301,v1:172.21.15.79:6790]" 2023-10-03T19:11:32.707 INFO:teuthology.orchestra.run.smithi172.stdout: fsid = 58400977-12ba-4c73-bb3e-1589b2492669 2023-10-03T19:11:32.707 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:32.708 INFO:teuthology.orchestra.run.smithi172.stdout:[osd] 2023-10-03T19:11:32.708 INFO:teuthology.orchestra.run.smithi172.stdout: osd journal size = 100 2023-10-03T19:11:32.708 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:32.708 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub load threshold = 5.0 2023-10-03T19:11:32.708 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub max interval = 600 2023-10-03T19:11:32.708 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:32.708 INFO:teuthology.orchestra.run.smithi172.stdout: osd recover clone overlap = true 2023-10-03T19:11:32.708 INFO:teuthology.orchestra.run.smithi172.stdout: osd recovery max chunk = 1048576 2023-10-03T19:11:32.708 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:32.708 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug shutdown = true 2023-10-03T19:11:32.708 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug op order = true 2023-10-03T19:11:32.708 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug verify stray on activate = true 2023-10-03T19:11:32.709 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:32.709 INFO:teuthology.orchestra.run.smithi172.stdout: osd open classes on start = true 2023-10-03T19:11:32.709 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug pg log writeout = true 2023-10-03T19:11:32.709 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:32.709 INFO:teuthology.orchestra.run.smithi172.stdout: osd deep scrub update digest min age = 30 2023-10-03T19:11:32.709 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:32.709 INFO:teuthology.orchestra.run.smithi172.stdout: osd map max advance = 10 2023-10-03T19:11:32.709 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:32.709 INFO:teuthology.orchestra.run.smithi172.stdout: journal zero on create = true 2023-10-03T19:11:32.710 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:32.710 INFO:teuthology.orchestra.run.smithi172.stdout: filestore ondisk finisher threads = 3 2023-10-03T19:11:32.710 INFO:teuthology.orchestra.run.smithi172.stdout: filestore apply finisher threads = 3 2023-10-03T19:11:32.710 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:32.710 INFO:teuthology.orchestra.run.smithi172.stdout: bdev debug aio = true 2023-10-03T19:11:32.711 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug misdirected ops = true 2023-10-03T19:11:32.711 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore block size = 96636764160 2023-10-03T19:11:32.711 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore compression mode = aggressive 2023-10-03T19:11:32.711 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore fsck on mount = True 2023-10-03T19:11:32.711 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluefs = 20 2023-10-03T19:11:32.711 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluestore = 20 2023-10-03T19:11:32.711 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2023-10-03T19:11:32.712 INFO:teuthology.orchestra.run.smithi172.stdout: debug osd = 20 2023-10-03T19:11:32.712 INFO:teuthology.orchestra.run.smithi172.stdout: debug rocksdb = 10 2023-10-03T19:11:32.712 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd backfillfull_ratio = 0.85 2023-10-03T19:11:32.712 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd full ratio = 0.9 2023-10-03T19:11:32.712 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd nearfull ratio = 0.8 2023-10-03T19:11:32.712 INFO:teuthology.orchestra.run.smithi172.stdout: osd failsafe full ratio = 0.95 2023-10-03T19:11:32.713 INFO:teuthology.orchestra.run.smithi172.stdout: osd objectstore = bluestore 2023-10-03T19:11:32.713 INFO:teuthology.orchestra.run.smithi172.stdout: osd op complaint time = 180 2023-10-03T19:11:32.713 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:32.713 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr] 2023-10-03T19:11:32.713 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2023-10-03T19:11:32.713 INFO:teuthology.orchestra.run.smithi172.stdout: debug mgr = 20 2023-10-03T19:11:32.714 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2023-10-03T19:11:32.714 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2023-10-03T19:11:32.714 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2023-10-03T19:11:32.714 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2023-10-03T19:11:32.714 INFO:teuthology.orchestra.run.smithi172.stdout: mgr/telemetry/nag = false 2023-10-03T19:11:32.714 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:32.715 INFO:teuthology.orchestra.run.smithi172.stdout:[mon] 2023-10-03T19:11:32.715 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2023-10-03T19:11:32.715 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2023-10-03T19:11:32.715 INFO:teuthology.orchestra.run.smithi172.stdout: debug paxos = 20 2023-10-03T19:11:32.715 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2023-10-03T19:11:32.715 INFO:teuthology.orchestra.run.smithi172.stdout: mon data avail warn = 5 2023-10-03T19:11:32.715 INFO:teuthology.orchestra.run.smithi172.stdout: mon mgr mkfs grace = 240 2023-10-03T19:11:32.716 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2023-10-03T19:11:32.716 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd reporter subtree level = osd 2023-10-03T19:11:32.716 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd prime pg temp = true 2023-10-03T19:11:32.716 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2023-10-03T19:11:32.716 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:32.716 INFO:teuthology.orchestra.run.smithi172.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-03T19:11:32.716 INFO:teuthology.orchestra.run.smithi172.stdout: auth mon ticket ttl = 660 # 11m 2023-10-03T19:11:32.717 INFO:teuthology.orchestra.run.smithi172.stdout: auth service ticket ttl = 240 # 4m 2023-10-03T19:11:32.717 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:32.717 INFO:teuthology.orchestra.run.smithi172.stdout: # don't complain about insecure global_id in the test suite 2023-10-03T19:11:32.717 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-03T19:11:32.717 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-03T19:11:32.718 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:32.718 INFO:teuthology.orchestra.run.smithi172.stdout: # 1m isn't quite enough 2023-10-03T19:11:32.718 INFO:teuthology.orchestra.run.smithi172.stdout: mon_down_mkfs_grace = 2m 2023-10-03T19:11:32.718 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:32.718 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_filestore_osds = false 2023-10-03T19:11:32.718 INFO:teuthology.orchestra.run.smithi172.stdout: mon op complaint time = 120 2023-10-03T19:11:32.719 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-03T19:11:32.719 INFO:teuthology.orchestra.run.smithi172.stdout:[client] 2023-10-03T19:11:32.719 INFO:teuthology.orchestra.run.smithi172.stdout: rgw cache enabled = true 2023-10-03T19:11:32.719 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable ops log = true 2023-10-03T19:11:32.719 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable usage log = true 2023-10-03T19:11:32.719 INFO:teuthology.orchestra.run.smithi172.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-03T19:11:32.719 INFO:teuthology.orchestra.run.smithi172.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-03T19:11:32.719 INFO:teuthology.orchestra.run.smithi172.stdout: client mount timeout = 600 2023-10-03T19:11:32.720 INFO:teuthology.orchestra.run.smithi172.stdout: debug client = 20 2023-10-03T19:11:32.720 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2023-10-03T19:11:32.720 INFO:teuthology.orchestra.run.smithi172.stdout: rados mon op timeout = 900 2023-10-03T19:11:32.720 INFO:teuthology.orchestra.run.smithi172.stdout: rados osd op timeout = 900 2023-10-03T19:11:32.720 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.a] 2023-10-03T19:11:32.720 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.b] 2023-10-03T19:11:32.720 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.c] 2023-10-03T19:11:32.720 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.a] 2023-10-03T19:11:32.720 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.c] 2023-10-03T19:11:32.720 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.b] 2023-10-03T19:11:32.721 INFO:teuthology.orchestra.run.smithi172.stdout:[mds] 2023-10-03T19:11:32.721 INFO:teuthology.orchestra.run.smithi172.stdout: debug mds = 20 2023-10-03T19:11:32.721 INFO:teuthology.orchestra.run.smithi172.stdout: debug mds balancer = 20 2023-10-03T19:11:32.721 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2023-10-03T19:11:32.721 INFO:teuthology.orchestra.run.smithi172.stdout: mds debug frag = True 2023-10-03T19:11:32.721 INFO:teuthology.orchestra.run.smithi172.stdout: mds debug scatterstat = True 2023-10-03T19:11:32.721 INFO:teuthology.orchestra.run.smithi172.stdout: mds op complaint time = 180 2023-10-03T19:11:32.721 INFO:teuthology.orchestra.run.smithi172.stdout: mds verify scatter = True 2023-10-03T19:11:32.721 INFO:teuthology.orchestra.run.smithi172.stdout: osd op complaint time = 180 2023-10-03T19:11:32.722 INFO:teuthology.orchestra.run.smithi172.stdout: rados mon op timeout = 900 2023-10-03T19:11:32.722 INFO:teuthology.orchestra.run.smithi172.stdout: rados osd op timeout = 900 2023-10-03T19:11:32.722 INFO:teuthology.orchestra.run.smithi079.stdout:[global] 2023-10-03T19:11:32.722 INFO:teuthology.orchestra.run.smithi079.stdout: chdir = "" 2023-10-03T19:11:32.722 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-03T19:11:32.722 INFO:teuthology.orchestra.run.smithi079.stdout: auth supported = cephx 2023-10-03T19:11:32.722 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:32.722 INFO:teuthology.orchestra.run.smithi079.stdout: filestore xattr use omap = true 2023-10-03T19:11:32.722 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:32.723 INFO:teuthology.orchestra.run.smithi079.stdout: mon clock drift allowed = 1.000 2023-10-03T19:11:32.723 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:32.723 INFO:teuthology.orchestra.run.smithi079.stdout: osd crush chooseleaf type = 0 2023-10-03T19:11:32.723 INFO:teuthology.orchestra.run.smithi079.stdout: auth debug = true 2023-10-03T19:11:32.723 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:32.723 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on old message = true 2023-10-03T19:11:32.723 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on bug = true 2023-10-03T19:11:32.723 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:32.723 INFO:teuthology.orchestra.run.smithi079.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-03T19:11:32.723 INFO:teuthology.orchestra.run.smithi079.stdout: mon pg warn max object skew = 0 2023-10-03T19:11:32.723 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:32.724 INFO:teuthology.orchestra.run.smithi079.stdout: # disable pg_autoscaler by default for new pools 2023-10-03T19:11:32.724 INFO:teuthology.orchestra.run.smithi079.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-03T19:11:32.724 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:32.724 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default size = 2 2023-10-03T19:11:32.724 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:32.724 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow primary affinity = true 2023-10-03T19:11:32.724 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow pg remap = true 2023-10-03T19:11:32.724 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on legacy crush tunables = false 2023-10-03T19:11:32.724 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on crush straw calc version zero = false 2023-10-03T19:11:32.724 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on no sortbitwise = false 2023-10-03T19:11:32.724 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on osd down out interval zero = false 2023-10-03T19:11:32.724 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on too few osds = false 2023-10-03T19:11:32.725 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-03T19:11:32.725 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-03T19:11:32.725 INFO:teuthology.orchestra.run.smithi079.stdout: mon_allow_pool_size_one = true 2023-10-03T19:11:32.725 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:32.725 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-03T19:11:32.725 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:32.725 INFO:teuthology.orchestra.run.smithi079.stdout: osd default data pool replay window = 5 2023-10-03T19:11:32.725 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:32.725 INFO:teuthology.orchestra.run.smithi079.stdout: mon allow pool delete = true 2023-10-03T19:11:32.725 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:32.725 INFO:teuthology.orchestra.run.smithi079.stdout: mon cluster log file level = debug 2023-10-03T19:11:32.725 INFO:teuthology.orchestra.run.smithi079.stdout: debug asserts on shutdown = true 2023-10-03T19:11:32.726 INFO:teuthology.orchestra.run.smithi079.stdout: mon health detail to clog = false 2023-10-03T19:11:32.726 INFO:teuthology.orchestra.run.smithi079.stdout: mon host = "172.21.15.45,172.21.15.79,[v2:172.21.15.79:3301,v1:172.21.15.79:6790]" 2023-10-03T19:11:32.726 INFO:teuthology.orchestra.run.smithi079.stdout: fsid = 58400977-12ba-4c73-bb3e-1589b2492669 2023-10-03T19:11:32.726 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:32.726 INFO:teuthology.orchestra.run.smithi079.stdout:[osd] 2023-10-03T19:11:32.726 INFO:teuthology.orchestra.run.smithi079.stdout: osd journal size = 100 2023-10-03T19:11:32.726 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:32.726 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub load threshold = 5.0 2023-10-03T19:11:32.726 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub max interval = 600 2023-10-03T19:11:32.726 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:32.727 INFO:teuthology.orchestra.run.smithi079.stdout: osd recover clone overlap = true 2023-10-03T19:11:32.727 INFO:teuthology.orchestra.run.smithi079.stdout: osd recovery max chunk = 1048576 2023-10-03T19:11:32.727 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:32.727 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug shutdown = true 2023-10-03T19:11:32.727 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug op order = true 2023-10-03T19:11:32.727 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug verify stray on activate = true 2023-10-03T19:11:32.727 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:32.727 INFO:teuthology.orchestra.run.smithi079.stdout: osd open classes on start = true 2023-10-03T19:11:32.727 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug pg log writeout = true 2023-10-03T19:11:32.727 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:32.727 INFO:teuthology.orchestra.run.smithi079.stdout: osd deep scrub update digest min age = 30 2023-10-03T19:11:32.727 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:32.728 INFO:teuthology.orchestra.run.smithi079.stdout: osd map max advance = 10 2023-10-03T19:11:32.728 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:32.728 INFO:teuthology.orchestra.run.smithi079.stdout: journal zero on create = true 2023-10-03T19:11:32.728 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:32.728 INFO:teuthology.orchestra.run.smithi079.stdout: filestore ondisk finisher threads = 3 2023-10-03T19:11:32.728 INFO:teuthology.orchestra.run.smithi079.stdout: filestore apply finisher threads = 3 2023-10-03T19:11:32.728 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:32.728 INFO:teuthology.orchestra.run.smithi079.stdout: bdev debug aio = true 2023-10-03T19:11:32.728 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug misdirected ops = true 2023-10-03T19:11:32.728 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore block size = 96636764160 2023-10-03T19:11:32.728 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore compression mode = aggressive 2023-10-03T19:11:32.728 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore fsck on mount = True 2023-10-03T19:11:32.729 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluefs = 20 2023-10-03T19:11:32.729 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluestore = 20 2023-10-03T19:11:32.729 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2023-10-03T19:11:32.729 INFO:teuthology.orchestra.run.smithi079.stdout: debug osd = 20 2023-10-03T19:11:32.729 INFO:teuthology.orchestra.run.smithi079.stdout: debug rocksdb = 10 2023-10-03T19:11:32.729 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd backfillfull_ratio = 0.85 2023-10-03T19:11:32.729 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd full ratio = 0.9 2023-10-03T19:11:32.729 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd nearfull ratio = 0.8 2023-10-03T19:11:32.729 INFO:teuthology.orchestra.run.smithi079.stdout: osd failsafe full ratio = 0.95 2023-10-03T19:11:32.729 INFO:teuthology.orchestra.run.smithi079.stdout: osd objectstore = bluestore 2023-10-03T19:11:32.729 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2023-10-03T19:11:32.729 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:32.729 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr] 2023-10-03T19:11:32.730 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2023-10-03T19:11:32.730 INFO:teuthology.orchestra.run.smithi079.stdout: debug mgr = 20 2023-10-03T19:11:32.730 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2023-10-03T19:11:32.730 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2023-10-03T19:11:32.730 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2023-10-03T19:11:32.730 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2023-10-03T19:11:32.730 INFO:teuthology.orchestra.run.smithi079.stdout: mgr/telemetry/nag = false 2023-10-03T19:11:32.730 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:32.730 INFO:teuthology.orchestra.run.smithi079.stdout:[mon] 2023-10-03T19:11:32.730 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2023-10-03T19:11:32.730 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2023-10-03T19:11:32.731 INFO:teuthology.orchestra.run.smithi079.stdout: debug paxos = 20 2023-10-03T19:11:32.731 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2023-10-03T19:11:32.731 INFO:teuthology.orchestra.run.smithi079.stdout: mon data avail warn = 5 2023-10-03T19:11:32.731 INFO:teuthology.orchestra.run.smithi079.stdout: mon mgr mkfs grace = 240 2023-10-03T19:11:32.731 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2023-10-03T19:11:32.731 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd reporter subtree level = osd 2023-10-03T19:11:32.731 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd prime pg temp = true 2023-10-03T19:11:32.731 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2023-10-03T19:11:32.731 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:32.731 INFO:teuthology.orchestra.run.smithi079.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-03T19:11:32.731 INFO:teuthology.orchestra.run.smithi079.stdout: auth mon ticket ttl = 660 # 11m 2023-10-03T19:11:32.731 INFO:teuthology.orchestra.run.smithi079.stdout: auth service ticket ttl = 240 # 4m 2023-10-03T19:11:32.732 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:32.732 INFO:teuthology.orchestra.run.smithi079.stdout: # don't complain about insecure global_id in the test suite 2023-10-03T19:11:32.732 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-03T19:11:32.732 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-03T19:11:32.732 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:32.732 INFO:teuthology.orchestra.run.smithi079.stdout: # 1m isn't quite enough 2023-10-03T19:11:32.732 INFO:teuthology.orchestra.run.smithi079.stdout: mon_down_mkfs_grace = 2m 2023-10-03T19:11:32.732 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:32.732 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_filestore_osds = false 2023-10-03T19:11:32.732 INFO:teuthology.orchestra.run.smithi079.stdout: mon op complaint time = 120 2023-10-03T19:11:32.732 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-03T19:11:32.732 INFO:teuthology.orchestra.run.smithi079.stdout:[client] 2023-10-03T19:11:32.733 INFO:teuthology.orchestra.run.smithi079.stdout: rgw cache enabled = true 2023-10-03T19:11:32.733 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable ops log = true 2023-10-03T19:11:32.733 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable usage log = true 2023-10-03T19:11:32.733 INFO:teuthology.orchestra.run.smithi079.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-03T19:11:32.733 INFO:teuthology.orchestra.run.smithi079.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-03T19:11:32.733 INFO:teuthology.orchestra.run.smithi079.stdout: client mount timeout = 600 2023-10-03T19:11:32.733 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2023-10-03T19:11:32.733 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2023-10-03T19:11:32.733 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2023-10-03T19:11:32.733 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2023-10-03T19:11:32.734 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.a] 2023-10-03T19:11:32.734 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.b] 2023-10-03T19:11:32.734 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.c] 2023-10-03T19:11:32.734 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2023-10-03T19:11:32.734 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.c] 2023-10-03T19:11:32.734 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b] 2023-10-03T19:11:32.734 INFO:teuthology.orchestra.run.smithi079.stdout:[mds] 2023-10-03T19:11:32.735 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds = 20 2023-10-03T19:11:32.735 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds balancer = 20 2023-10-03T19:11:32.735 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2023-10-03T19:11:32.735 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug frag = True 2023-10-03T19:11:32.735 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug scatterstat = True 2023-10-03T19:11:32.735 INFO:teuthology.orchestra.run.smithi079.stdout: mds op complaint time = 180 2023-10-03T19:11:32.736 INFO:teuthology.orchestra.run.smithi079.stdout: mds verify scatter = True 2023-10-03T19:11:32.736 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2023-10-03T19:11:32.736 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2023-10-03T19:11:32.736 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2023-10-03T19:11:32.736 INFO:teuthology.orchestra.run.smithi146.stdout:[global] 2023-10-03T19:11:32.737 INFO:teuthology.orchestra.run.smithi146.stdout: chdir = "" 2023-10-03T19:11:32.737 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-03T19:11:32.737 INFO:teuthology.orchestra.run.smithi146.stdout: auth supported = cephx 2023-10-03T19:11:32.737 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:11:32.737 INFO:teuthology.orchestra.run.smithi146.stdout: filestore xattr use omap = true 2023-10-03T19:11:32.737 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:11:32.737 INFO:teuthology.orchestra.run.smithi146.stdout: mon clock drift allowed = 1.000 2023-10-03T19:11:32.738 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:11:32.738 INFO:teuthology.orchestra.run.smithi146.stdout: osd crush chooseleaf type = 0 2023-10-03T19:11:32.738 INFO:teuthology.orchestra.run.smithi146.stdout: auth debug = true 2023-10-03T19:11:32.738 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:11:32.738 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on old message = true 2023-10-03T19:11:32.738 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on bug = true 2023-10-03T19:11:32.738 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:11:32.739 INFO:teuthology.orchestra.run.smithi146.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-03T19:11:32.739 INFO:teuthology.orchestra.run.smithi146.stdout: mon pg warn max object skew = 0 2023-10-03T19:11:32.739 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:11:32.739 INFO:teuthology.orchestra.run.smithi146.stdout: # disable pg_autoscaler by default for new pools 2023-10-03T19:11:32.739 INFO:teuthology.orchestra.run.smithi146.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-03T19:11:32.739 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:11:32.740 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default size = 2 2023-10-03T19:11:32.740 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:11:32.740 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow primary affinity = true 2023-10-03T19:11:32.740 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow pg remap = true 2023-10-03T19:11:32.740 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on legacy crush tunables = false 2023-10-03T19:11:32.740 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on crush straw calc version zero = false 2023-10-03T19:11:32.740 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on no sortbitwise = false 2023-10-03T19:11:32.740 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on osd down out interval zero = false 2023-10-03T19:11:32.740 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on too few osds = false 2023-10-03T19:11:32.740 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-03T19:11:32.740 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-03T19:11:32.741 INFO:teuthology.orchestra.run.smithi146.stdout: mon_allow_pool_size_one = true 2023-10-03T19:11:32.741 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:11:32.741 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-03T19:11:32.741 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:11:32.741 INFO:teuthology.orchestra.run.smithi146.stdout: osd default data pool replay window = 5 2023-10-03T19:11:32.741 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:11:32.741 INFO:teuthology.orchestra.run.smithi146.stdout: mon allow pool delete = true 2023-10-03T19:11:32.741 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:11:32.741 INFO:teuthology.orchestra.run.smithi146.stdout: mon cluster log file level = debug 2023-10-03T19:11:32.741 INFO:teuthology.orchestra.run.smithi146.stdout: debug asserts on shutdown = true 2023-10-03T19:11:32.741 INFO:teuthology.orchestra.run.smithi146.stdout: mon health detail to clog = false 2023-10-03T19:11:32.741 INFO:teuthology.orchestra.run.smithi146.stdout: mon host = "172.21.15.45,172.21.15.79,[v2:172.21.15.79:3301,v1:172.21.15.79:6790]" 2023-10-03T19:11:32.742 INFO:teuthology.orchestra.run.smithi146.stdout: fsid = 58400977-12ba-4c73-bb3e-1589b2492669 2023-10-03T19:11:32.742 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:11:32.742 INFO:teuthology.orchestra.run.smithi146.stdout:[osd] 2023-10-03T19:11:32.742 INFO:teuthology.orchestra.run.smithi146.stdout: osd journal size = 100 2023-10-03T19:11:32.742 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:11:32.742 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub load threshold = 5.0 2023-10-03T19:11:32.742 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub max interval = 600 2023-10-03T19:11:32.742 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:11:32.742 INFO:teuthology.orchestra.run.smithi146.stdout: osd recover clone overlap = true 2023-10-03T19:11:32.742 INFO:teuthology.orchestra.run.smithi146.stdout: osd recovery max chunk = 1048576 2023-10-03T19:11:32.742 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:11:32.743 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug shutdown = true 2023-10-03T19:11:32.743 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug op order = true 2023-10-03T19:11:32.743 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug verify stray on activate = true 2023-10-03T19:11:32.743 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:11:32.743 INFO:teuthology.orchestra.run.smithi146.stdout: osd open classes on start = true 2023-10-03T19:11:32.743 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug pg log writeout = true 2023-10-03T19:11:32.743 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:11:32.743 INFO:teuthology.orchestra.run.smithi146.stdout: osd deep scrub update digest min age = 30 2023-10-03T19:11:32.743 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:11:32.743 INFO:teuthology.orchestra.run.smithi146.stdout: osd map max advance = 10 2023-10-03T19:11:32.743 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:11:32.743 INFO:teuthology.orchestra.run.smithi146.stdout: journal zero on create = true 2023-10-03T19:11:32.744 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:11:32.744 INFO:teuthology.orchestra.run.smithi146.stdout: filestore ondisk finisher threads = 3 2023-10-03T19:11:32.744 INFO:teuthology.orchestra.run.smithi146.stdout: filestore apply finisher threads = 3 2023-10-03T19:11:32.744 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:11:32.744 INFO:teuthology.orchestra.run.smithi146.stdout: bdev debug aio = true 2023-10-03T19:11:32.744 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug misdirected ops = true 2023-10-03T19:11:32.744 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore block size = 96636764160 2023-10-03T19:11:32.744 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore compression mode = aggressive 2023-10-03T19:11:32.744 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore fsck on mount = True 2023-10-03T19:11:32.745 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluefs = 20 2023-10-03T19:11:32.745 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluestore = 20 2023-10-03T19:11:32.745 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-03T19:11:32.745 INFO:teuthology.orchestra.run.smithi146.stdout: debug osd = 20 2023-10-03T19:11:32.745 INFO:teuthology.orchestra.run.smithi146.stdout: debug rocksdb = 10 2023-10-03T19:11:32.745 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd backfillfull_ratio = 0.85 2023-10-03T19:11:32.745 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd full ratio = 0.9 2023-10-03T19:11:32.745 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd nearfull ratio = 0.8 2023-10-03T19:11:32.745 INFO:teuthology.orchestra.run.smithi146.stdout: osd failsafe full ratio = 0.95 2023-10-03T19:11:32.745 INFO:teuthology.orchestra.run.smithi146.stdout: osd objectstore = bluestore 2023-10-03T19:11:32.746 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2023-10-03T19:11:32.746 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:11:32.746 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr] 2023-10-03T19:11:32.746 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-03T19:11:32.746 INFO:teuthology.orchestra.run.smithi146.stdout: debug mgr = 20 2023-10-03T19:11:32.746 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2023-10-03T19:11:32.746 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2023-10-03T19:11:32.746 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2023-10-03T19:11:32.746 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2023-10-03T19:11:32.746 INFO:teuthology.orchestra.run.smithi146.stdout: mgr/telemetry/nag = false 2023-10-03T19:11:32.746 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:11:32.747 INFO:teuthology.orchestra.run.smithi146.stdout:[mon] 2023-10-03T19:11:32.747 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-03T19:11:32.747 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2023-10-03T19:11:32.747 INFO:teuthology.orchestra.run.smithi146.stdout: debug paxos = 20 2023-10-03T19:11:32.747 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2023-10-03T19:11:32.747 INFO:teuthology.orchestra.run.smithi146.stdout: mon data avail warn = 5 2023-10-03T19:11:32.747 INFO:teuthology.orchestra.run.smithi146.stdout: mon mgr mkfs grace = 240 2023-10-03T19:11:32.747 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2023-10-03T19:11:32.747 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd reporter subtree level = osd 2023-10-03T19:11:32.747 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd prime pg temp = true 2023-10-03T19:11:32.747 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2023-10-03T19:11:32.747 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:11:32.748 INFO:teuthology.orchestra.run.smithi146.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-03T19:11:32.748 INFO:teuthology.orchestra.run.smithi146.stdout: auth mon ticket ttl = 660 # 11m 2023-10-03T19:11:32.748 INFO:teuthology.orchestra.run.smithi146.stdout: auth service ticket ttl = 240 # 4m 2023-10-03T19:11:32.748 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:11:32.748 INFO:teuthology.orchestra.run.smithi146.stdout: # don't complain about insecure global_id in the test suite 2023-10-03T19:11:32.748 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-03T19:11:32.748 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-03T19:11:32.748 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:11:32.748 INFO:teuthology.orchestra.run.smithi146.stdout: # 1m isn't quite enough 2023-10-03T19:11:32.749 INFO:teuthology.orchestra.run.smithi146.stdout: mon_down_mkfs_grace = 2m 2023-10-03T19:11:32.749 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:11:32.749 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_filestore_osds = false 2023-10-03T19:11:32.749 INFO:teuthology.orchestra.run.smithi146.stdout: mon op complaint time = 120 2023-10-03T19:11:32.749 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T19:11:32.749 INFO:teuthology.orchestra.run.smithi146.stdout:[client] 2023-10-03T19:11:32.749 INFO:teuthology.orchestra.run.smithi146.stdout: rgw cache enabled = true 2023-10-03T19:11:32.749 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable ops log = true 2023-10-03T19:11:32.749 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable usage log = true 2023-10-03T19:11:32.749 INFO:teuthology.orchestra.run.smithi146.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-03T19:11:32.750 INFO:teuthology.orchestra.run.smithi146.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-03T19:11:32.750 INFO:teuthology.orchestra.run.smithi146.stdout: client mount timeout = 600 2023-10-03T19:11:32.750 INFO:teuthology.orchestra.run.smithi146.stdout: debug client = 20 2023-10-03T19:11:32.750 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-03T19:11:32.750 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 900 2023-10-03T19:11:32.750 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 900 2023-10-03T19:11:32.750 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.a] 2023-10-03T19:11:32.750 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.b] 2023-10-03T19:11:32.750 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.c] 2023-10-03T19:11:32.751 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2023-10-03T19:11:32.751 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2023-10-03T19:11:32.751 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2023-10-03T19:11:32.751 INFO:teuthology.orchestra.run.smithi146.stdout:[mds] 2023-10-03T19:11:32.751 INFO:teuthology.orchestra.run.smithi146.stdout: debug mds = 20 2023-10-03T19:11:32.751 INFO:teuthology.orchestra.run.smithi146.stdout: debug mds balancer = 20 2023-10-03T19:11:32.751 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-03T19:11:32.752 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug frag = True 2023-10-03T19:11:32.752 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug scatterstat = True 2023-10-03T19:11:32.752 INFO:teuthology.orchestra.run.smithi146.stdout: mds op complaint time = 180 2023-10-03T19:11:32.752 INFO:teuthology.orchestra.run.smithi146.stdout: mds verify scatter = True 2023-10-03T19:11:32.752 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2023-10-03T19:11:32.752 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 900 2023-10-03T19:11:32.752 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 900 2023-10-03T19:11:32.753 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-03T19:11:32.753 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-03T19:11:32.807 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-03T19:11:32.807 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-03T19:11:32.807 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-03T19:11:32.813 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-03T19:11:32.813 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-03T19:11:32.858 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi045.front.sepia.ceph.com 2023-10-03T19:11:32.858 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-03T19:11:32.858 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-03T19:11:32.858 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-03T19:11:32.923 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-03T19:11:32.923 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-03T19:11:32.971 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi079.front.sepia.ceph.com 2023-10-03T19:11:32.971 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-03T19:11:32.971 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-03T19:11:32.971 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-03T19:11:32.994 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-03T19:11:32.994 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-03T19:11:33.042 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi146.front.sepia.ceph.com 2023-10-03T19:11:33.042 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:11:33.042 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-03T19:11:33.043 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-03T19:11:33.066 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:11:33.066 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-03T19:11:33.112 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi172.front.sepia.ceph.com 2023-10-03T19:11:33.112 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-03T19:11:33.112 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-03T19:11:33.113 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-03T19:11:33.136 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-03T19:11:33.136 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-03T19:11:33.183 INFO:tasks.ceph:Setting up mon nodes... 2023-10-03T19:11:33.183 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-03T19:11:33.183 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-03T19:11:33.227 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-03T19:11:33.230 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-03T19:11:33.274 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-03T19:11:33.289 INFO:tasks.ceph:Setting up mds nodes... 2023-10-03T19:11:33.289 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-03T19:11:33.332 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-03T19:11:33.337 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-03T19:11:33.390 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-03T19:11:33.478 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-03T19:11:33.481 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-03T19:11:33.495 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-03T19:11:33.540 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-03T19:11:33.546 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-03T19:11:33.602 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-03T19:11:33.602 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-03T19:11:33.637 INFO:teuthology.orchestra.run.smithi146.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-03T19:11:33.662 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-03T19:11:33.698 INFO:teuthology.orchestra.run.smithi172.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-03T19:11:33.721 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-03T19:11:33.721 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi045.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-03T19:11:33.721 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-03T19:11:33.735 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-03T19:11:33.735 INFO:tasks.ceph:role: osd.0 2023-10-03T19:11:33.735 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi045.front.sepia.ceph.com 2023-10-03T19:11:33.736 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-03T19:11:33.789 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-03T19:11:33.789 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-03T19:11:33.790 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-03T19:11:33.790 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-03T19:11:33.790 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-03T19:11:33.790 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-10-03T19:11:33.790 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-03T19:11:33.790 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-03T19:11:33.790 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-03T19:11:33.790 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-03T19:11:33.813 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-10-03T19:11:33.815 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-10-03T19:11:33.815 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-03T19:11:33.879 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-03T19:11:33.930 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T19:11:33.930 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: /sbin/restorecon: command not found 2023-10-03T19:11:33.931 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-03T19:11:33.984 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-03T19:11:33.984 INFO:tasks.ceph:role: osd.1 2023-10-03T19:11:33.985 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi045.front.sepia.ceph.com 2023-10-03T19:11:33.985 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-03T19:11:34.037 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-03T19:11:34.038 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-03T19:11:34.038 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-03T19:11:34.038 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-03T19:11:34.038 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-03T19:11:34.038 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-10-03T19:11:34.039 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-03T19:11:34.039 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-03T19:11:34.039 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-03T19:11:34.039 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-03T19:11:34.062 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-10-03T19:11:34.063 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-10-03T19:11:34.063 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-03T19:11:34.121 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-03T19:11:34.174 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T19:11:34.174 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: /sbin/restorecon: command not found 2023-10-03T19:11:34.175 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-03T19:11:34.227 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-03T19:11:34.228 INFO:tasks.ceph:role: osd.2 2023-10-03T19:11:34.228 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi045.front.sepia.ceph.com 2023-10-03T19:11:34.228 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-03T19:11:34.281 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-03T19:11:34.281 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-03T19:11:34.281 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-03T19:11:34.281 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-03T19:11:34.282 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-03T19:11:34.282 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-10-03T19:11:34.282 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-03T19:11:34.282 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-03T19:11:34.282 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-03T19:11:34.282 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-03T19:11:34.305 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-10-03T19:11:34.307 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-10-03T19:11:34.307 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-03T19:11:34.364 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-03T19:11:34.416 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T19:11:34.416 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: /sbin/restorecon: command not found 2023-10-03T19:11:34.417 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-03T19:11:34.470 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-03T19:11:34.471 INFO:tasks.ceph:role: osd.3 2023-10-03T19:11:34.471 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi045.front.sepia.ceph.com 2023-10-03T19:11:34.471 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-03T19:11:34.525 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-03T19:11:34.525 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-03T19:11:34.525 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-03T19:11:34.525 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-03T19:11:34.525 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-03T19:11:34.525 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-10-03T19:11:34.525 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-03T19:11:34.526 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-03T19:11:34.526 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-03T19:11:34.526 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-03T19:11:34.550 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-10-03T19:11:34.552 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-10-03T19:11:34.552 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-03T19:11:34.615 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-03T19:11:34.666 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T19:11:34.666 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: /sbin/restorecon: command not found 2023-10-03T19:11:34.667 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-03T19:11:34.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:11:34.764+0000 7ff56d696640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-03T19:11:34.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:11:34.764+0000 7ff56d696640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-03T19:11:34.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:11:34.764+0000 7ff56d696640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-03T19:11:34.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:11:34.764+0000 7ff56d696640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-03T19:11:34.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:11:34.764+0000 7ff56d696640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-03T19:11:34.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:11:34.764+0000 7ff56d696640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-03T19:11:37.794 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-03T19:11:37.808 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-03T19:11:37.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:11:37.892+0000 7fb2218d1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-03T19:11:37.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:11:37.892+0000 7fb2218d1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-03T19:11:37.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:11:37.892+0000 7fb2218d1640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-03T19:11:37.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:11:37.892+0000 7fb2218d1640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-03T19:11:37.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:11:37.892+0000 7fb2218d1640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-03T19:11:37.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:11:37.892+0000 7fb2218d1640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-03T19:11:40.927 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-03T19:11:40.983 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-03T19:11:41.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:11:41.064+0000 7f3823581640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-03T19:11:41.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:11:41.064+0000 7f3823581640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-03T19:11:41.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:11:41.064+0000 7f3823581640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-03T19:11:41.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:11:41.064+0000 7f3823581640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-03T19:11:41.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:11:41.064+0000 7f3823581640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-03T19:11:41.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:11:41.064+0000 7f3823581640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-03T19:11:44.073 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-03T19:11:44.131 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-03T19:11:44.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:11:44.212+0000 7f0e4bd64640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-03T19:11:44.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:11:44.212+0000 7f0e4bd64640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-03T19:11:44.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:11:44.212+0000 7f0e4bd64640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-03T19:11:44.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:11:44.212+0000 7f0e4bd64640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-03T19:11:44.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:11:44.212+0000 7f0e4bd64640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-03T19:11:44.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:11:44.212+0000 7f0e4bd64640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-03T19:11:47.214 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-03T19:11:47.270 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-03T19:11:47.285 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-03T19:11:47.285 INFO:tasks.ceph:role: osd.4 2023-10-03T19:11:47.285 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com 2023-10-03T19:11:47.285 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-03T19:11:47.349 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-03T19:11:47.350 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-03T19:11:47.350 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-03T19:11:47.350 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-03T19:11:47.350 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-03T19:11:47.350 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2023-10-03T19:11:47.350 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-03T19:11:47.350 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-03T19:11:47.350 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-03T19:11:47.350 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-03T19:11:47.797 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2023-10-03T19:11:47.799 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2023-10-03T19:11:47.799 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-03T19:11:47.895 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-03T19:11:47.904 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T19:11:47.905 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: /sbin/restorecon: command not found 2023-10-03T19:11:47.905 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-03T19:11:47.960 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-03T19:11:47.960 INFO:tasks.ceph:role: osd.5 2023-10-03T19:11:47.960 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi079.front.sepia.ceph.com 2023-10-03T19:11:47.960 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-03T19:11:48.021 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-03T19:11:48.021 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-03T19:11:48.021 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-03T19:11:48.021 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-03T19:11:48.021 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-03T19:11:48.021 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2023-10-03T19:11:48.022 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-03T19:11:48.022 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-03T19:11:48.022 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-03T19:11:48.022 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-03T19:11:48.490 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2023-10-03T19:11:48.492 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2023-10-03T19:11:48.492 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-03T19:11:48.614 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-03T19:11:48.625 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: /sbin/restorecon: command not found 2023-10-03T19:11:48.625 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T19:11:48.626 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-03T19:11:48.681 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-03T19:11:49.171 INFO:tasks.ceph:role: osd.6 2023-10-03T19:11:49.172 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi079.front.sepia.ceph.com 2023-10-03T19:11:49.172 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-03T19:11:49.196 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-03T19:11:49.309 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-03T19:11:49.309 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-03T19:11:49.309 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-03T19:11:49.309 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-03T19:11:49.309 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2023-10-03T19:11:49.309 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-03T19:11:49.310 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-03T19:11:49.310 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-03T19:11:49.310 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-03T19:11:49.628 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2023-10-03T19:11:49.630 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2023-10-03T19:11:49.630 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-03T19:11:49.729 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-03T19:11:49.740 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: /sbin/restorecon: command not found 2023-10-03T19:11:49.740 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T19:11:49.741 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-03T19:11:49.796 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-03T19:11:49.796 INFO:tasks.ceph:role: osd.7 2023-10-03T19:11:49.796 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi079.front.sepia.ceph.com 2023-10-03T19:11:49.796 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-03T19:11:49.858 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-03T19:11:49.858 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-03T19:11:49.858 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-03T19:11:49.858 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-03T19:11:49.858 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-03T19:11:49.858 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2023-10-03T19:11:49.859 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-03T19:11:49.859 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-03T19:11:49.859 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-03T19:11:49.859 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-03T19:11:50.331 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2023-10-03T19:11:50.333 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2023-10-03T19:11:50.334 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-03T19:11:50.425 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-03T19:11:50.479 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T19:11:50.480 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: /sbin/restorecon: command not found 2023-10-03T19:11:50.480 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-03T19:11:50.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:11:50.574+0000 7fc65a584640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-03T19:11:50.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:11:50.582+0000 7fc65a584640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-03T19:11:50.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:11:50.582+0000 7fc65a584640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-03T19:11:50.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:11:50.582+0000 7fc65a584640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-03T19:11:50.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:11:50.582+0000 7fc65a584640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-03T19:11:50.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:11:50.590+0000 7fc65a584640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-03T19:11:53.613 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-03T19:11:53.627 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-03T19:11:53.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:11:53.706+0000 7fe039a9f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-03T19:11:53.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:11:53.706+0000 7fe039a9f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-03T19:11:53.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:11:53.706+0000 7fe039a9f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-03T19:11:53.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:11:53.706+0000 7fe039a9f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-03T19:11:53.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:11:53.706+0000 7fe039a9f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-03T19:11:53.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:11:53.710+0000 7fe039a9f640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-03T19:11:56.724 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-03T19:11:56.782 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-03T19:11:56.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:11:56.862+0000 7fd0103b9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-03T19:11:56.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:11:56.862+0000 7fd0103b9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-03T19:11:56.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:11:56.862+0000 7fd0103b9640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-03T19:11:56.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:11:56.862+0000 7fd0103b9640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-03T19:11:56.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:11:56.862+0000 7fd0103b9640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-03T19:11:56.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:11:56.862+0000 7fd0103b9640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-03T19:11:59.879 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-03T19:11:59.934 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-03T19:12:00.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:00.014+0000 7f0894d74640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-03T19:12:00.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:00.014+0000 7f0894d74640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-03T19:12:00.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:00.014+0000 7f0894d74640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-03T19:12:00.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:00.014+0000 7f0894d74640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-03T19:12:00.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:00.014+0000 7f0894d74640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-03T19:12:00.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:00.014+0000 7f0894d74640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-03T19:12:00.892 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:12:00.894 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:12:00.897 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:12:00.900 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:12:03.025 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-03T19:12:03.039 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-03T19:12:03.039 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-03T19:12:03.039 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-03T19:12:03.053 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-03T19:12:03.054 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-03T19:12:03.109 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-03T19:12:03.110 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-03T19:12:03.166 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-03T19:12:03.166 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-03T19:12:03.221 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-03T19:12:03.221 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-03T19:12:03.278 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-03T19:12:03.279 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-03T19:12:03.334 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-03T19:12:03.334 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-03T19:12:03.390 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-03T19:12:03.390 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-03T19:12:03.404 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-03T19:12:03.404 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-03T19:12:03.456 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-03T19:12:03.456 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-03T19:12:03.512 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-03T19:12:03.513 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-03T19:12:03.568 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-03T19:12:03.568 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-03T19:12:03.620 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-03T19:12:03.621 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-03T19:12:03.677 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:12:03.677 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-03T19:12:03.683 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-03T19:12:03.683 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-03T19:12:03.689 INFO:tasks.ceph:Adding keys to all mons... 2023-10-03T19:12:03.689 DEBUG:teuthology.orchestra.run.smithi045:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-03T19:12:03.691 DEBUG:teuthology.orchestra.run.smithi079:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-03T19:12:03.723 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr.y] 2023-10-03T19:12:03.723 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBlZxxlUmKhDRAA7UKlGP9q9aKsk+J+nTxrUA== 2023-10-03T19:12:03.724 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-10-03T19:12:03.724 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBlZxxlfyzhExAABLhtkQEZuiLwovBSO0kuAA== 2023-10-03T19:12:03.724 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-10-03T19:12:03.724 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBlZxxlAsGOHBAAIHprnd9orKMQjzkNQZz94A== 2023-10-03T19:12:03.724 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.0] 2023-10-03T19:12:03.724 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBmZxxlb0zQLRAA3z+f4/jsLTLUmFg/WOD/Xg== 2023-10-03T19:12:03.724 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.1] 2023-10-03T19:12:03.724 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBpZxxlTjtZNRAA3HFqXjGLO7JoX+GBegGfqw== 2023-10-03T19:12:03.724 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.2] 2023-10-03T19:12:03.724 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBtZxxld6kUBBAATcGPrxBbPLswrUHihB7AgQ== 2023-10-03T19:12:03.725 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.3] 2023-10-03T19:12:03.725 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBwZxxlWUL3DBAAk4TW6N5mpjjyP7QgQAIuDw== 2023-10-03T19:12:03.725 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr.x] 2023-10-03T19:12:03.725 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBlZxxl4txNEBAAonNqY2PmtF0vZGFmvzxIKw== 2023-10-03T19:12:03.725 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-10-03T19:12:03.725 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBlZxxlzM8pIBAAMie9jpxS/xt2cymMpyJmiQ== 2023-10-03T19:12:03.725 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.4] 2023-10-03T19:12:03.725 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQB2ZxxlK3KNIhAAjhvxAU0shg+5PbJfq1LEog== 2023-10-03T19:12:03.725 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.5] 2023-10-03T19:12:03.725 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQB5ZxxlRAxuKhAA5ma3eAt3kkukdhgZN4wwEg== 2023-10-03T19:12:03.725 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.6] 2023-10-03T19:12:03.725 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQB8ZxxlkQqOMxAAuKGy7vJQLUDsqgjPVtWMWg== 2023-10-03T19:12:03.726 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.7] 2023-10-03T19:12:03.726 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCAZxxl65r/ABAAeWtP7nMLVm5NBU4vWQ6ceg== 2023-10-03T19:12:03.726 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2023-10-03T19:12:03.726 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBlZxxlg5PgJRAAvvN5Xrw/ZW4rSdJ1/adnzA== 2023-10-03T19:12:03.726 INFO:teuthology.orchestra.run.smithi045.stdout:[client.1] 2023-10-03T19:12:03.726 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBlZxxlKkW+KRAALzVyQ+iTWuD5FMLDKXNVTg== 2023-10-03T19:12:03.731 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr.y] 2023-10-03T19:12:03.731 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBlZxxlUmKhDRAA7UKlGP9q9aKsk+J+nTxrUA== 2023-10-03T19:12:03.731 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2023-10-03T19:12:03.731 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBlZxxlfyzhExAABLhtkQEZuiLwovBSO0kuAA== 2023-10-03T19:12:03.731 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.c] 2023-10-03T19:12:03.732 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBlZxxlAsGOHBAAIHprnd9orKMQjzkNQZz94A== 2023-10-03T19:12:03.732 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.0] 2023-10-03T19:12:03.732 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBmZxxlb0zQLRAA3z+f4/jsLTLUmFg/WOD/Xg== 2023-10-03T19:12:03.732 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.1] 2023-10-03T19:12:03.732 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBpZxxlTjtZNRAA3HFqXjGLO7JoX+GBegGfqw== 2023-10-03T19:12:03.732 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.2] 2023-10-03T19:12:03.732 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBtZxxld6kUBBAATcGPrxBbPLswrUHihB7AgQ== 2023-10-03T19:12:03.732 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.3] 2023-10-03T19:12:03.732 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBwZxxlWUL3DBAAk4TW6N5mpjjyP7QgQAIuDw== 2023-10-03T19:12:03.732 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr.x] 2023-10-03T19:12:03.732 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBlZxxl4txNEBAAonNqY2PmtF0vZGFmvzxIKw== 2023-10-03T19:12:03.733 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b] 2023-10-03T19:12:03.733 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBlZxxlzM8pIBAAMie9jpxS/xt2cymMpyJmiQ== 2023-10-03T19:12:03.733 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.4] 2023-10-03T19:12:03.733 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQB2ZxxlK3KNIhAAjhvxAU0shg+5PbJfq1LEog== 2023-10-03T19:12:03.733 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.5] 2023-10-03T19:12:03.733 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQB5ZxxlRAxuKhAA5ma3eAt3kkukdhgZN4wwEg== 2023-10-03T19:12:03.733 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.6] 2023-10-03T19:12:03.733 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQB8ZxxlkQqOMxAAuKGy7vJQLUDsqgjPVtWMWg== 2023-10-03T19:12:03.733 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.7] 2023-10-03T19:12:03.733 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCAZxxl65r/ABAAeWtP7nMLVm5NBU4vWQ6ceg== 2023-10-03T19:12:03.733 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2023-10-03T19:12:03.733 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBlZxxlg5PgJRAAvvN5Xrw/ZW4rSdJ1/adnzA== 2023-10-03T19:12:03.733 INFO:teuthology.orchestra.run.smithi079.stdout:[client.1] 2023-10-03T19:12:03.734 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBlZxxlKkW+KRAALzVyQ+iTWuD5FMLDKXNVTg== 2023-10-03T19:12:03.734 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-03T19:12:03.771 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-03T19:12:03.820 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-03T19:12:03.823 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-03T19:12:03.910 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-03T19:12:03.913 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-03T19:12:03.960 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T19:12:03.963 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T19:12:04.033 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T19:12:04.047 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T19:12:04.117 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T19:12:04.131 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T19:12:04.205 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T19:12:04.207 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T19:12:04.288 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-03T19:12:04.291 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-03T19:12:04.369 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-03T19:12:04.375 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-03T19:12:04.462 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T19:12:04.464 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T19:12:04.507 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T19:12:04.551 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T19:12:04.593 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T19:12:04.643 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T19:12:04.688 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T19:12:04.690 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T19:12:04.767 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-03T19:12:04.776 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-03T19:12:04.850 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-03T19:12:04.852 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-03T19:12:04.936 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-03T19:12:04.936 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-03T19:12:04.949 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-03T19:12:05.045 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-03T19:12:05.056 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-03T19:12:05.070 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-03T19:12:05.174 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-03T19:12:05.185 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-03T19:12:05.242 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-03T19:12:05.339 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-03T19:12:05.350 DEBUG:teuthology.orchestra.run.smithi045:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-03T19:12:05.352 DEBUG:teuthology.orchestra.run.smithi079:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-03T19:12:05.396 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-03T19:12:05.396 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-03T19:12:05.397 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-03T19:12:05.399 INFO:tasks.ceph.mon.a:Started 2023-10-03T19:12:05.399 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-03T19:12:05.399 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-03T19:12:05.438 INFO:tasks.ceph.mon.b:Started 2023-10-03T19:12:05.438 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-03T19:12:05.438 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-03T19:12:05.440 INFO:tasks.ceph.mon.c:Started 2023-10-03T19:12:05.440 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-03T19:12:05.441 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-03T19:12:05.441 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-03T19:12:05.443 INFO:tasks.ceph.mgr.y:Started 2023-10-03T19:12:05.443 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-03T19:12:05.444 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-03T19:12:05.445 INFO:tasks.ceph.mgr.x:Started 2023-10-03T19:12:05.446 INFO:tasks.ceph:Setting crush tunables to default 2023-10-03T19:12:05.446 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd crush tunables default 2023-10-03T19:12:05.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.559+0000 7f30c88ec640 1 Processor -- start 2023-10-03T19:12:05.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.559+0000 7f30c88ec640 1 -- start start 2023-10-03T19:12:05.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.559+0000 7f30c88ec640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f30c4070140 0x7f30c406aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:05.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.559+0000 7f30c88ec640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c40a11d0 con 0x7f30c4070df0 2023-10-03T19:12:05.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.559+0000 7f30c88ec640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c406a460 con 0x7f30c41500f0 2023-10-03T19:12:05.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.559+0000 7f30c88ec640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c4069f70 con 0x7f30c4070140 2023-10-03T19:12:05.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.559+0000 7f30c1d9b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f30c4070df0 0x7f30c414c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43060/0 (socket says 172.21.15.45:43060) 2023-10-03T19:12:05.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.559+0000 7f30c1d9b640 1 -- 172.21.15.45:0/1631410125 learned_addr learned my addr 172.21.15.45:0/1631410125 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:05.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.559+0000 7f30c2d9d640 1 --2- 172.21.15.45:0/1631410125 >> v2:172.21.15.79:3300/0 conn(0x7f30c4070140 0x7f30c406aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:05.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.559+0000 7f30c2d9d640 1 -- 172.21.15.45:0/1631410125 >> v2:172.21.15.79:3300/0 conn(0x7f30c4070140 msgr2=0x7f30c406aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-03T19:12:05.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.559+0000 7f30c2d9d640 1 -- 172.21.15.45:0/1631410125 >> v2:172.21.15.79:3300/0 conn(0x7f30c4070140 msgr2=0x7f30c406aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T19:12:05.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.559+0000 7f30c2d9d640 1 --2- 172.21.15.45:0/1631410125 >> v2:172.21.15.79:3300/0 conn(0x7f30c4070140 0x7f30c406aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T19:12:05.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.559+0000 7f30c2d9d640 1 --2- 172.21.15.45:0/1631410125 >> v2:172.21.15.79:3300/0 conn(0x7f30c4070140 0x7f30c406aa80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-03T19:12:05.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.763+0000 7f30c2d9d640 1 --2- 172.21.15.45:0/1631410125 >> v2:172.21.15.79:3300/0 conn(0x7f30c4070140 0x7f30c406aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:05.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.763+0000 7f30c2d9d640 1 -- 172.21.15.45:0/1631410125 >> v2:172.21.15.79:3300/0 conn(0x7f30c4070140 msgr2=0x7f30c406aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-03T19:12:05.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.763+0000 7f30c2d9d640 1 -- 172.21.15.45:0/1631410125 >> v2:172.21.15.79:3300/0 conn(0x7f30c4070140 msgr2=0x7f30c406aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T19:12:05.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.763+0000 7f30c2d9d640 1 --2- 172.21.15.45:0/1631410125 >> v2:172.21.15.79:3300/0 conn(0x7f30c4070140 0x7f30c406aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T19:12:05.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.763+0000 7f30c2d9d640 1 --2- 172.21.15.45:0/1631410125 >> v2:172.21.15.79:3300/0 conn(0x7f30c4070140 0x7f30c406aa80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-03T19:12:05.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.815+0000 7f30c159a640 1 -- 172.21.15.45:0/1631410125 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3469710653 0 0) 0x7f30c40a11d0 con 0x7f30c4070df0 2023-10-03T19:12:05.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.815+0000 7f30c159a640 1 -- 172.21.15.45:0/1631410125 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30ac003530 con 0x7f30c4070df0 2023-10-03T19:12:05.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.815+0000 7f30c159a640 1 -- 172.21.15.45:0/1631410125 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1160137516 0 0) 0x7f30c406a460 con 0x7f30c41500f0 2023-10-03T19:12:05.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.815+0000 7f30c159a640 1 -- 172.21.15.45:0/1631410125 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30c40a11d0 con 0x7f30c41500f0 2023-10-03T19:12:05.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.815+0000 7f30c159a640 1 -- 172.21.15.45:0/1631410125 <== mon.1 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3719553712 0 0) 0x7f30c40a11d0 con 0x7f30c41500f0 2023-10-03T19:12:05.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.815+0000 7f30c159a640 1 -- 172.21.15.45:0/1631410125 >> v2:172.21.15.79:3300/0 conn(0x7f30c4070140 msgr2=0x7f30c406aa80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T19:12:05.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.815+0000 7f30c159a640 1 --2- 172.21.15.45:0/1631410125 >> v2:172.21.15.79:3300/0 conn(0x7f30c4070140 0x7f30c406aa80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:05.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.815+0000 7f30c159a640 1 -- 172.21.15.45:0/1631410125 >> v1:172.21.15.45:6789/0 conn(0x7f30c4070df0 legacy=0x7f30c414c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:05.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.815+0000 7f30c159a640 1 -- 172.21.15.45:0/1631410125 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c41504c0 con 0x7f30c41500f0 2023-10-03T19:12:05.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.815+0000 7f30c159a640 1 -- 172.21.15.45:0/1631410125 <== mon.1 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f30b4001680 con 0x7f30c41500f0 2023-10-03T19:12:05.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.815+0000 7f30c159a640 1 -- 172.21.15.45:0/1631410125 >> v1:172.21.15.79:6789/0 conn(0x7f30c41500f0 legacy=0x7f30c40a3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:05.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.815+0000 7f30c159a640 1 --2- 172.21.15.45:0/1631410125 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30ac003b10 0x7f30ac003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:05.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.815+0000 7f30c159a640 1 --2- 172.21.15.45:0/1631410125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30ac0047d0 0x7f30ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:05.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.815+0000 7f30c159a640 1 --2- 172.21.15.45:0/1631410125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30ac005180 0x7f30ac00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:05.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.815+0000 7f30c159a640 1 -- 172.21.15.45:0/1631410125 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c4069f70 con 0x7f30ac0047d0 2023-10-03T19:12:05.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.815+0000 7f30c159a640 1 -- 172.21.15.45:0/1631410125 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac00bfe0 con 0x7f30ac005180 2023-10-03T19:12:05.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.815+0000 7f30c159a640 1 -- 172.21.15.45:0/1631410125 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac00c1a0 con 0x7f30ac003b10 2023-10-03T19:12:05.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.819+0000 7f30c1d9b640 1 --2- 172.21.15.45:0/1631410125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30ac0047d0 0x7f30ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:05.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.819+0000 7f30c2d9d640 1 --2- 172.21.15.45:0/1631410125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30ac005180 0x7f30ac00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:05.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.819+0000 7f30c259c640 1 --2- 172.21.15.45:0/1631410125 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30ac003b10 0x7f30ac003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:05.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.819+0000 7f30c2d9d640 1 -- 172.21.15.45:0/1631410125 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30ac003b10 msgr2=0x7f30ac003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:05.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.819+0000 7f30c2d9d640 1 --2- 172.21.15.45:0/1631410125 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30ac003b10 0x7f30ac003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:05.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.819+0000 7f30c2d9d640 1 -- 172.21.15.45:0/1631410125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30ac0047d0 msgr2=0x7f30ac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:05.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.819+0000 7f30c2d9d640 1 --2- 172.21.15.45:0/1631410125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30ac0047d0 0x7f30ac004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:05.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.819+0000 7f30c2d9d640 1 -- 172.21.15.45:0/1631410125 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c40a11d0 con 0x7f30ac005180 2023-10-03T19:12:05.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.823+0000 7f30c2d9d640 1 -- 172.21.15.45:0/1631410125 reap_dead start 2023-10-03T19:12:05.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.823+0000 7f30c2d9d640 1 --2- 172.21.15.45:0/1631410125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30ac005180 0x7f30ac00b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f30bc009a40 tx=0x7f30bc01cf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29e42d5adf2b5b93 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:05.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.823+0000 7f30c159a640 1 -- 172.21.15.45:0/1631410125 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc0a5e00 con 0x7f30ac005180 2023-10-03T19:12:05.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.823+0000 7f30c159a640 1 -- 172.21.15.45:0/1631410125 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30bc0ad440 con 0x7f30ac005180 2023-10-03T19:12:05.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.823+0000 7f30c159a640 1 -- 172.21.15.45:0/1631410125 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc0ad7f0 con 0x7f30ac005180 2023-10-03T19:12:05.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.827+0000 7f30c88ec640 1 -- 172.21.15.45:0/1631410125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30ac005180 msgr2=0x7f30ac00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:05.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.827+0000 7f30c88ec640 1 --2- 172.21.15.45:0/1631410125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30ac005180 0x7f30ac00b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f30bc009a40 tx=0x7f30bc01cf30 comp rx=0 tx=0).stop 2023-10-03T19:12:05.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.827+0000 7f30c88ec640 1 -- 172.21.15.45:0/1631410125 shutdown_connections 2023-10-03T19:12:05.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.827+0000 7f30c88ec640 1 --2- 172.21.15.45:0/1631410125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30ac005180 0x7f30ac00b990 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:05.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.827+0000 7f30c88ec640 1 -- 172.21.15.45:0/1631410125 >> 172.21.15.45:0/1631410125 conn(0x7f30c40be190 msgr2=0x7f30c40be590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:05.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.827+0000 7f30c88ec640 1 -- 172.21.15.45:0/1631410125 shutdown_connections 2023-10-03T19:12:05.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.827+0000 7f30c88ec640 1 -- 172.21.15.45:0/1631410125 wait complete. 2023-10-03T19:12:05.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.827+0000 7f30c88ec640 1 Processor -- start 2023-10-03T19:12:05.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.827+0000 7f30c88ec640 1 -- start start 2023-10-03T19:12:05.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.831+0000 7f30c88ec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30ac005180 0x7f30c40a4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:05.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.831+0000 7f30c88ec640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30c40a18b0 0x7f30c40658f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:05.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.831+0000 7f30c88ec640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30c40a2490 0x7f30c4141ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:05.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.831+0000 7f30c88ec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c40a20d0 con 0x7f30ac005180 2023-10-03T19:12:05.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.831+0000 7f30c88ec640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c40a4b00 con 0x7f30c40a2490 2023-10-03T19:12:05.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.831+0000 7f30c88ec640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c4065e30 con 0x7f30c40a18b0 2023-10-03T19:12:05.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.831+0000 7f30c259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30ac005180 0x7f30c40a4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:05.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.831+0000 7f30c259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30ac005180 0x7f30c40a4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56264/0 (socket says 172.21.15.45:56264) 2023-10-03T19:12:05.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.831+0000 7f30c259c640 1 -- 172.21.15.45:0/3482475004 learned_addr learned my addr 172.21.15.45:0/3482475004 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:05.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.831+0000 7f30c2d9d640 1 --2- 172.21.15.45:0/3482475004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30c40a2490 0x7f30c4141ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:05.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.831+0000 7f30c1d9b640 1 --2- 172.21.15.45:0/3482475004 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30c40a18b0 0x7f30c40658f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:05.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.831+0000 7f30c259c640 1 -- 172.21.15.45:0/3482475004 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30c40a18b0 msgr2=0x7f30c40658f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:05.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.831+0000 7f30c259c640 1 --2- 172.21.15.45:0/3482475004 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30c40a18b0 0x7f30c40658f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:05.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.831+0000 7f30c259c640 1 -- 172.21.15.45:0/3482475004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30c40a2490 msgr2=0x7f30c4141ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:05.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.831+0000 7f30c259c640 1 --2- 172.21.15.45:0/3482475004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30c40a2490 0x7f30c4141ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:05.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.831+0000 7f30c259c640 1 -- 172.21.15.45:0/3482475004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c4150780 con 0x7f30ac005180 2023-10-03T19:12:05.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.831+0000 7f30c259c640 1 --2- 172.21.15.45:0/3482475004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30ac005180 0x7f30c40a4f90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f30b400f960 tx=0x7f30b400fd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:05.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.831+0000 7f30b2ffd640 1 -- 172.21.15.45:0/3482475004 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b40052e0 con 0x7f30ac005180 2023-10-03T19:12:05.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.831+0000 7f30b2ffd640 1 -- 172.21.15.45:0/3482475004 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b4005460 con 0x7f30ac005180 2023-10-03T19:12:05.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.831+0000 7f30c88ec640 1 -- 172.21.15.45:0/3482475004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c406a180 con 0x7f30ac005180 2023-10-03T19:12:05.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.831+0000 7f30b2ffd640 1 -- 172.21.15.45:0/3482475004 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b400d970 con 0x7f30ac005180 2023-10-03T19:12:05.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.831+0000 7f30c88ec640 1 -- 172.21.15.45:0/3482475004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c4150a60 con 0x7f30ac005180 2023-10-03T19:12:05.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.831+0000 7f30b2ffd640 1 -- 172.21.15.45:0/3482475004 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f30b4003600 con 0x7f30ac005180 2023-10-03T19:12:05.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.835+0000 7f30b2ffd640 1 -- 172.21.15.45:0/3482475004 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f30b401d4b0 con 0x7f30ac005180 2023-10-03T19:12:05.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.835+0000 7f30c88ec640 1 -- 172.21.15.45:0/3482475004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c404de80 con 0x7f30ac005180 2023-10-03T19:12:05.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.839+0000 7f30b2ffd640 1 -- 172.21.15.45:0/3482475004 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f30b4003a90 con 0x7f30ac005180 2023-10-03T19:12:05.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.911+0000 7f30c88ec640 1 -- 172.21.15.45:0/3482475004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f30c4066d30 con 0x7f30ac005180 2023-10-03T19:12:05.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.915+0000 7f30b2ffd640 1 -- 172.21.15.45:0/3482475004 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f30b4003c30 con 0x7f30ac005180 2023-10-03T19:12:05.920 INFO:teuthology.orchestra.run.smithi045.stderr:adjusted tunables profile to default 2023-10-03T19:12:05.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.919+0000 7f30c88ec640 1 -- 172.21.15.45:0/3482475004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30ac005180 msgr2=0x7f30c40a4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:05.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.919+0000 7f30c88ec640 1 --2- 172.21.15.45:0/3482475004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30ac005180 0x7f30c40a4f90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f30b400f960 tx=0x7f30b400fd60 comp rx=0 tx=0).stop 2023-10-03T19:12:05.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.919+0000 7f30c88ec640 1 -- 172.21.15.45:0/3482475004 shutdown_connections 2023-10-03T19:12:05.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.919+0000 7f30c88ec640 1 --2- 172.21.15.45:0/3482475004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30c40a2490 0x7f30c4141ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:05.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.919+0000 7f30c88ec640 1 --2- 172.21.15.45:0/3482475004 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30c40a18b0 0x7f30c40658f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:05.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.919+0000 7f30c88ec640 1 --2- 172.21.15.45:0/3482475004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30ac005180 0x7f30c40a4f90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:05.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.919+0000 7f30c88ec640 1 -- 172.21.15.45:0/3482475004 >> 172.21.15.45:0/3482475004 conn(0x7f30c40be190 msgr2=0x7f30c40b65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:05.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.919+0000 7f30c88ec640 1 -- 172.21.15.45:0/3482475004 shutdown_connections 2023-10-03T19:12:05.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:05.919+0000 7f30c88ec640 1 -- 172.21.15.45:0/3482475004 wait complete. 2023-10-03T19:12:05.941 INFO:tasks.ceph:check_enable_crimson: False 2023-10-03T19:12:05.941 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-03T19:12:05.941 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-03T19:12:05.941 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-03T19:12:05.951 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-03T19:12:05.952 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-03T19:12:06.003 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-03T19:12:06.003 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-03T19:12:06.043 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-03T19:12:06.039+0000 7f67de088180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-03T19:12:06.053 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-10-03T19:12:06.053 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-03T19:12:06.061 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-10-03T19:12:06.058+0000 7f0f4fc3f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-03T19:12:06.114 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-03T19:12:06.114 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-03T19:12:06.127 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-03T19:12:06.127 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-03T19:12:06.180 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-03T19:12:06.180 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-03T19:12:06.232 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-03T19:12:06.233 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-03T19:12:06.288 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new 251cca13-96ba-4a59-826d-4ebae88f1c0e 0 2023-10-03T19:12:06.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.446+0000 7fcace198640 1 Processor -- start 2023-10-03T19:12:06.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.446+0000 7fcace198640 1 -- start start 2023-10-03T19:12:06.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.446+0000 7fcace198640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcac814c270 0x7fcac814fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:06.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.446+0000 7fcace198640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcac80a82f0 0x7fcac8150360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:06.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.446+0000 7fcace198640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac80a4c20 con 0x7fcac81498b0 2023-10-03T19:12:06.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.446+0000 7fcace198640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac80a8080 con 0x7fcac814c270 2023-10-03T19:12:06.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.446+0000 7fcace198640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac8149c80 con 0x7fcac80a82f0 2023-10-03T19:12:06.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.446+0000 7fcac7fff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcac80a82f0 0x7fcac8150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:06.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.446+0000 7fcac7fff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcac80a82f0 0x7fcac8150360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:36946/0 (socket says 172.21.15.79:36946) 2023-10-03T19:12:06.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.446+0000 7fcac7fff640 1 -- 172.21.15.79:0/3928384991 learned_addr learned my addr 172.21.15.79:0/3928384991 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-03T19:12:06.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.450+0000 7fcac6ffd640 1 --2- 172.21.15.79:0/3928384991 >> v2:172.21.15.45:3300/0 conn(0x7fcac814c270 0x7fcac814fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:06.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.450+0000 7fcac7fff640 1 -- 172.21.15.79:0/3928384991 >> v2:172.21.15.45:3300/0 conn(0x7fcac814c270 msgr2=0x7fcac814fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:06.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.450+0000 7fcac7fff640 1 --2- 172.21.15.79:0/3928384991 >> v2:172.21.15.45:3300/0 conn(0x7fcac814c270 0x7fcac814fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:06.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.450+0000 7fcac7fff640 1 -- 172.21.15.79:0/3928384991 >> v1:172.21.15.45:6789/0 conn(0x7fcac81498b0 legacy=0x7fcac8071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:06.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.450+0000 7fcac7fff640 1 -- 172.21.15.79:0/3928384991 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac80b7500 con 0x7fcac80a82f0 2023-10-03T19:12:06.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.450+0000 7fcac7fff640 1 --2- 172.21.15.79:0/3928384991 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcac80a82f0 0x7fcac8150360 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcac0009e50 tx=0x7fcac001c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3940654c0073e9fe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:06.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.450+0000 7fcac67fc640 1 -- 172.21.15.79:0/3928384991 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac00a58a0 con 0x7fcac80a82f0 2023-10-03T19:12:06.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.450+0000 7fcac67fc640 1 -- 172.21.15.79:0/3928384991 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac00a5a00 con 0x7fcac80a82f0 2023-10-03T19:12:06.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.450+0000 7fcac67fc640 1 -- 172.21.15.79:0/3928384991 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac00a5d90 con 0x7fcac80a82f0 2023-10-03T19:12:06.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.450+0000 7fcace198640 1 -- 172.21.15.79:0/3928384991 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcac80a82f0 msgr2=0x7fcac8150360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:06.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.450+0000 7fcace198640 1 --2- 172.21.15.79:0/3928384991 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcac80a82f0 0x7fcac8150360 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcac0009e50 tx=0x7fcac001c9e0 comp rx=0 tx=0).stop 2023-10-03T19:12:06.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.450+0000 7fcace198640 1 -- 172.21.15.79:0/3928384991 shutdown_connections 2023-10-03T19:12:06.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.450+0000 7fcace198640 1 --2- 172.21.15.79:0/3928384991 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcac80a82f0 0x7fcac8150360 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:06.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.450+0000 7fcace198640 1 --2- 172.21.15.79:0/3928384991 >> v2:172.21.15.45:3300/0 conn(0x7fcac814c270 0x7fcac814fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:06.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.450+0000 7fcace198640 1 -- 172.21.15.79:0/3928384991 >> 172.21.15.79:0/3928384991 conn(0x7fcac80c25f0 msgr2=0x7fcac80c29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:06.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.450+0000 7fcace198640 1 -- 172.21.15.79:0/3928384991 shutdown_connections 2023-10-03T19:12:06.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.450+0000 7fcace198640 1 -- 172.21.15.79:0/3928384991 wait complete. 2023-10-03T19:12:06.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.454+0000 7fcace198640 1 Processor -- start 2023-10-03T19:12:06.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.454+0000 7fcace198640 1 -- start start 2023-10-03T19:12:06.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.454+0000 7fcace198640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcac80a82f0 0x7fcac80bce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:06.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.454+0000 7fcace198640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcac81498b0 0x7fcac80c1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:06.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.454+0000 7fcace198640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcac814c270 0x7fcac80a71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:06.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.454+0000 7fcace198640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac80a5640 con 0x7fcac81498b0 2023-10-03T19:12:06.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.454+0000 7fcace198640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac80a6830 con 0x7fcac814c270 2023-10-03T19:12:06.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.454+0000 7fcace198640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac80c07c0 con 0x7fcac80a82f0 2023-10-03T19:12:06.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.454+0000 7fcac7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcac814c270 0x7fcac80a71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:06.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.454+0000 7fcac77fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcac80a82f0 0x7fcac80bce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:06.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.454+0000 7fcac7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcac814c270 0x7fcac80a71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53064/0 (socket says 172.21.15.79:53064) 2023-10-03T19:12:06.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.454+0000 7fcac77fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcac80a82f0 0x7fcac80bce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:36956/0 (socket says 172.21.15.79:36956) 2023-10-03T19:12:06.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.454+0000 7fcac7fff640 1 -- 172.21.15.79:0/3310239648 learned_addr learned my addr 172.21.15.79:0/3310239648 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-03T19:12:06.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.454+0000 7fcac6ffd640 1 --2- 172.21.15.79:0/3310239648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcac81498b0 0x7fcac80c1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:06.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.454+0000 7fcac7fff640 1 -- 172.21.15.79:0/3310239648 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcac80a82f0 msgr2=0x7fcac80bce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:06.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.454+0000 7fcac7fff640 1 --2- 172.21.15.79:0/3310239648 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcac80a82f0 0x7fcac80bce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:06.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.454+0000 7fcac7fff640 1 -- 172.21.15.79:0/3310239648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcac81498b0 msgr2=0x7fcac80c1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:06.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.454+0000 7fcac7fff640 1 --2- 172.21.15.79:0/3310239648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcac81498b0 0x7fcac80c1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:06.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.454+0000 7fcac7fff640 1 -- 172.21.15.79:0/3310239648 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac0009b30 con 0x7fcac814c270 2023-10-03T19:12:06.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.454+0000 7fcac77fe640 1 --2- 172.21.15.79:0/3310239648 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcac80a82f0 0x7fcac80bce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:12:06.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.454+0000 7fcac7fff640 1 --2- 172.21.15.79:0/3310239648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcac814c270 0x7fcac80a71e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcac001a610 tx=0x7fcac0019780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:06.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.454+0000 7fcaaffff640 1 -- 172.21.15.79:0/3310239648 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac00b8670 con 0x7fcac814c270 2023-10-03T19:12:06.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.454+0000 7fcaaffff640 1 -- 172.21.15.79:0/3310239648 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac00b87d0 con 0x7fcac814c270 2023-10-03T19:12:06.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.454+0000 7fcace198640 1 -- 172.21.15.79:0/3310239648 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac8071730 con 0x7fcac814c270 2023-10-03T19:12:06.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.454+0000 7fcaaffff640 1 -- 172.21.15.79:0/3310239648 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac00b8b80 con 0x7fcac814c270 2023-10-03T19:12:06.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.454+0000 7fcace198640 1 -- 172.21.15.79:0/3310239648 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac814f900 con 0x7fcac814c270 2023-10-03T19:12:06.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.454+0000 7fcaaffff640 1 -- 172.21.15.79:0/3310239648 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcac00c3460 con 0x7fcac814c270 2023-10-03T19:12:06.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.454+0000 7fcaaffff640 1 -- 172.21.15.79:0/3310239648 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fcac00b6440 con 0x7fcac814c270 2023-10-03T19:12:06.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.454+0000 7fcace198640 1 -- 172.21.15.79:0/3310239648 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac8071fe0 con 0x7fcac814c270 2023-10-03T19:12:06.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.470+0000 7fcaaffff640 1 -- 172.21.15.79:0/3310239648 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fcac00c3860 con 0x7fcac814c270 2023-10-03T19:12:06.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.538+0000 7fcace198640 1 -- 172.21.15.79:0/3310239648 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd new", "uuid": "251cca13-96ba-4a59-826d-4ebae88f1c0e", "id": 0} v 0) v1 -- 0x7fcac80c1990 con 0x7fcac814c270 2023-10-03T19:12:06.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.546+0000 7fcaaffff640 1 -- 172.21.15.79:0/3310239648 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "251cca13-96ba-4a59-826d-4ebae88f1c0e", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcac00c3b30 con 0x7fcac814c270 2023-10-03T19:12:06.552 INFO:teuthology.orchestra.run.smithi079.stdout:0 2023-10-03T19:12:06.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.550+0000 7fcace198640 1 -- 172.21.15.79:0/3310239648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcac814c270 msgr2=0x7fcac80a71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:06.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.550+0000 7fcace198640 1 --2- 172.21.15.79:0/3310239648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcac814c270 0x7fcac80a71e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcac001a610 tx=0x7fcac0019780 comp rx=0 tx=0).stop 2023-10-03T19:12:06.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.550+0000 7fcace198640 1 -- 172.21.15.79:0/3310239648 shutdown_connections 2023-10-03T19:12:06.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.550+0000 7fcace198640 1 --2- 172.21.15.79:0/3310239648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcac814c270 0x7fcac80a71e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:06.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.550+0000 7fcace198640 1 --2- 172.21.15.79:0/3310239648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcac81498b0 0x7fcac80c1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:06.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.550+0000 7fcace198640 1 --2- 172.21.15.79:0/3310239648 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcac80a82f0 0x7fcac80bce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:06.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.550+0000 7fcace198640 1 -- 172.21.15.79:0/3310239648 >> 172.21.15.79:0/3310239648 conn(0x7fcac80c25f0 msgr2=0x7fcac814e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:06.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.550+0000 7fcace198640 1 -- 172.21.15.79:0/3310239648 shutdown_connections 2023-10-03T19:12:06.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.550+0000 7fcace198640 1 -- 172.21.15.79:0/3310239648 wait complete. 2023-10-03T19:12:06.566 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-03T19:12:06.563+0000 7f67de088180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-03T19:12:06.570 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new 7deff3ba-4fe0-4822-8c0e-d827ce3833a8 1 2023-10-03T19:12:06.590 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-10-03T19:12:06.586+0000 7f0f4fc3f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-03T19:12:06.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.678+0000 7f9b1486a640 1 Processor -- start 2023-10-03T19:12:06.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.678+0000 7f9b1486a640 1 -- start start 2023-10-03T19:12:06.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.678+0000 7f9b1486a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9b1006a440 0x7f9b1014f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:06.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.678+0000 7f9b1486a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9b100baec0 0x7f9b10148810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:06.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.678+0000 7f9b1486a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b1014f8d0 con 0x7f9b10148d50 2023-10-03T19:12:06.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.678+0000 7f9b1486a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1014b560 con 0x7f9b100baec0 2023-10-03T19:12:06.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.678+0000 7f9b1486a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b10070d30 con 0x7f9b1006a440 2023-10-03T19:12:06.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.682+0000 7f9b0e59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9b1006a440 0x7f9b1014f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:06.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.682+0000 7f9b0e59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9b1006a440 0x7f9b1014f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53068/0 (socket says 172.21.15.79:53068) 2023-10-03T19:12:06.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.682+0000 7f9b0ed9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9b10148d50 0x7f9b1014b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:37572/0 (socket says 172.21.15.79:37572) 2023-10-03T19:12:06.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.682+0000 7f9b0e59c640 1 -- 172.21.15.79:0/1252920931 learned_addr learned my addr 172.21.15.79:0/1252920931 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-03T19:12:06.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.682+0000 7f9b0dd9b640 1 --2- 172.21.15.79:0/1252920931 >> v2:172.21.15.45:3300/0 conn(0x7f9b100baec0 0x7f9b10148810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:06.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.682+0000 7f9b0d59a640 1 -- 172.21.15.79:0/1252920931 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376625779 0 0) 0x7f9b1014f8d0 con 0x7f9b10148d50 2023-10-03T19:12:06.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.682+0000 7f9b0d59a640 1 -- 172.21.15.79:0/1252920931 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9af8003530 con 0x7f9b10148d50 2023-10-03T19:12:06.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.682+0000 7f9b0e59c640 1 -- 172.21.15.79:0/1252920931 >> v2:172.21.15.45:3300/0 conn(0x7f9b100baec0 msgr2=0x7f9b10148810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:06.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.682+0000 7f9b0e59c640 1 --2- 172.21.15.79:0/1252920931 >> v2:172.21.15.45:3300/0 conn(0x7f9b100baec0 0x7f9b10148810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:06.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.682+0000 7f9b0e59c640 1 -- 172.21.15.79:0/1252920931 >> v1:172.21.15.79:6789/0 conn(0x7f9b10148d50 legacy=0x7f9b1014b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:06.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.682+0000 7f9b0e59c640 1 -- 172.21.15.79:0/1252920931 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b10071010 con 0x7f9b1006a440 2023-10-03T19:12:06.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.682+0000 7f9b0e59c640 1 --2- 172.21.15.79:0/1252920931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b1006a440 0x7f9b1014f390 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9b1006f300 tx=0x7f9b0001c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56ad03e39703321 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:06.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.682+0000 7f9b0d59a640 1 -- 172.21.15.79:0/1252920931 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b000aa680 con 0x7f9b1006a440 2023-10-03T19:12:06.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.682+0000 7f9b0d59a640 1 -- 172.21.15.79:0/1252920931 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b000aa7e0 con 0x7f9b1006a440 2023-10-03T19:12:06.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.682+0000 7f9b0d59a640 1 -- 172.21.15.79:0/1252920931 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b000aab70 con 0x7f9b1006a440 2023-10-03T19:12:06.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b1486a640 1 -- 172.21.15.79:0/1252920931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b1006a440 msgr2=0x7f9b1014f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:06.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b1486a640 1 --2- 172.21.15.79:0/1252920931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b1006a440 0x7f9b1014f390 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9b1006f300 tx=0x7f9b0001c500 comp rx=0 tx=0).stop 2023-10-03T19:12:06.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b1486a640 1 -- 172.21.15.79:0/1252920931 shutdown_connections 2023-10-03T19:12:06.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b1486a640 1 --2- 172.21.15.79:0/1252920931 >> v2:172.21.15.45:3300/0 conn(0x7f9b100baec0 0x7f9b10148810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:06.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b1486a640 1 --2- 172.21.15.79:0/1252920931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b1006a440 0x7f9b1014f390 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:06.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b1486a640 1 -- 172.21.15.79:0/1252920931 >> 172.21.15.79:0/1252920931 conn(0x7f9b100be590 msgr2=0x7f9b10069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:06.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b1486a640 1 -- 172.21.15.79:0/1252920931 shutdown_connections 2023-10-03T19:12:06.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b1486a640 1 -- 172.21.15.79:0/1252920931 wait complete. 2023-10-03T19:12:06.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b1486a640 1 Processor -- start 2023-10-03T19:12:06.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b1486a640 1 -- start start 2023-10-03T19:12:06.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b1486a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b1006a440 0x7f9b101e9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:06.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b1486a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9b100baec0 0x7f9b101e73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:06.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b1486a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b10148d50 0x7f9b1006c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:06.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b1486a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1014c980 con 0x7f9b10148d50 2023-10-03T19:12:06.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b1486a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b101ea470 con 0x7f9b1006a440 2023-10-03T19:12:06.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b1486a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b100bd740 con 0x7f9b100baec0 2023-10-03T19:12:06.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b0e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b1006a440 0x7f9b101e9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:06.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b0dd9b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9b100baec0 0x7f9b101e73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:06.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b0e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b1006a440 0x7f9b101e9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53076/0 (socket says 172.21.15.79:53076) 2023-10-03T19:12:06.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b0e59c640 1 -- 172.21.15.79:0/3235079704 learned_addr learned my addr 172.21.15.79:0/3235079704 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-03T19:12:06.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b0ed9d640 1 --2- 172.21.15.79:0/3235079704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b10148d50 0x7f9b1006c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:06.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b0dd9b640 1 -- 172.21.15.79:0/3235079704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b1006a440 msgr2=0x7f9b101e9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:06.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b0dd9b640 1 --2- 172.21.15.79:0/3235079704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b1006a440 0x7f9b101e9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:06.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b0dd9b640 1 -- 172.21.15.79:0/3235079704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b10148d50 msgr2=0x7f9b1006c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:06.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b0dd9b640 1 --2- 172.21.15.79:0/3235079704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b10148d50 0x7f9b1006c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:06.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b0dd9b640 1 -- 172.21.15.79:0/3235079704 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b000094d0 con 0x7f9b100baec0 2023-10-03T19:12:06.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b0e59c640 1 --2- 172.21.15.79:0/3235079704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b1006a440 0x7f9b101e9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:12:06.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b0ed9d640 1 --2- 172.21.15.79:0/3235079704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b10148d50 0x7f9b1006c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:06.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b0dd9b640 1 --2- 172.21.15.79:0/3235079704 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9b100baec0 0x7f9b101e73e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9b0400d5f0 tx=0x7f9b0400dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:06.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9afeffd640 1 -- 172.21.15.79:0/3235079704 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b040125f0 con 0x7f9b100baec0 2023-10-03T19:12:06.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9afeffd640 1 -- 172.21.15.79:0/3235079704 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b04012750 con 0x7f9b100baec0 2023-10-03T19:12:06.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b1486a640 1 -- 172.21.15.79:0/3235079704 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b1006a9a0 con 0x7f9b100baec0 2023-10-03T19:12:06.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9afeffd640 1 -- 172.21.15.79:0/3235079704 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b04012ae0 con 0x7f9b100baec0 2023-10-03T19:12:06.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9b1486a640 1 -- 172.21.15.79:0/3235079704 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b1006a810 con 0x7f9b100baec0 2023-10-03T19:12:06.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9afeffd640 1 -- 172.21.15.79:0/3235079704 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9b0401e460 con 0x7f9b100baec0 2023-10-03T19:12:06.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.686+0000 7f9afeffd640 1 -- 172.21.15.79:0/3235079704 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f9b04014950 con 0x7f9b100baec0 2023-10-03T19:12:06.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.690+0000 7f9b1486a640 1 -- 172.21.15.79:0/3235079704 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b10158560 con 0x7f9b100baec0 2023-10-03T19:12:06.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.690+0000 7f9afeffd640 1 -- 172.21.15.79:0/3235079704 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f9b04014b10 con 0x7f9b100baec0 2023-10-03T19:12:06.747 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-03T19:12:06.743+0000 7f67de088180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-03T19:12:06.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.758+0000 7f9b1486a640 1 -- 172.21.15.79:0/3235079704 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7deff3ba-4fe0-4822-8c0e-d827ce3833a8", "id": 1} v 0) v1 -- 0x7f9b1004de80 con 0x7f9b100baec0 2023-10-03T19:12:06.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.766+0000 7f9afeffd640 1 -- 172.21.15.79:0/3235079704 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7deff3ba-4fe0-4822-8c0e-d827ce3833a8", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9b04014d80 con 0x7f9b100baec0 2023-10-03T19:12:06.772 INFO:teuthology.orchestra.run.smithi079.stdout:1 2023-10-03T19:12:06.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.770+0000 7f9b1486a640 1 -- 172.21.15.79:0/3235079704 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9b100baec0 msgr2=0x7f9b101e73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:06.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.770+0000 7f9b1486a640 1 --2- 172.21.15.79:0/3235079704 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9b100baec0 0x7f9b101e73e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9b0400d5f0 tx=0x7f9b0400dab0 comp rx=0 tx=0).stop 2023-10-03T19:12:06.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.770+0000 7f9b1486a640 1 -- 172.21.15.79:0/3235079704 shutdown_connections 2023-10-03T19:12:06.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.770+0000 7f9b1486a640 1 --2- 172.21.15.79:0/3235079704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b10148d50 0x7f9b1006c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:06.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.770+0000 7f9b1486a640 1 --2- 172.21.15.79:0/3235079704 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9b100baec0 0x7f9b101e73e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:06.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.770+0000 7f9b1486a640 1 --2- 172.21.15.79:0/3235079704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b1006a440 0x7f9b101e9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:06.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.770+0000 7f9b1486a640 1 -- 172.21.15.79:0/3235079704 >> 172.21.15.79:0/3235079704 conn(0x7f9b100be590 msgr2=0x7f9b10069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:06.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.770+0000 7f9b1486a640 1 -- 172.21.15.79:0/3235079704 shutdown_connections 2023-10-03T19:12:06.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.770+0000 7f9b1486a640 1 -- 172.21.15.79:0/3235079704 wait complete. 2023-10-03T19:12:06.777 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-10-03T19:12:06.770+0000 7f0f4fc3f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-03T19:12:06.789 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new 64b35ec1-08ee-4b28-b46a-31fb941e9675 2 2023-10-03T19:12:06.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.938+0000 7f04c2bf1640 1 Processor -- start 2023-10-03T19:12:06.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.938+0000 7f04c2bf1640 1 -- start start 2023-10-03T19:12:06.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.938+0000 7f04c2bf1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f04bc150530 0x7f04bc157c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:06.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.938+0000 7f04c2bf1640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04bc0a4c20 con 0x7f04bc14c270 2023-10-03T19:12:06.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.938+0000 7f04c2bf1640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04bc0a8080 con 0x7f04bc1498b0 2023-10-03T19:12:06.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.938+0000 7f04c2bf1640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04bc149c80 con 0x7f04bc150530 2023-10-03T19:12:06.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.938+0000 7f04c118e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f04bc150530 0x7f04bc157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:06.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.938+0000 7f04c118e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f04bc150530 0x7f04bc157c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53088/0 (socket says 172.21.15.79:53088) 2023-10-03T19:12:06.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.938+0000 7f04c118e640 1 -- 172.21.15.79:0/1782255399 learned_addr learned my addr 172.21.15.79:0/1782255399 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-03T19:12:06.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.938+0000 7f04c098d640 1 --1- 172.21.15.79:0/1782255399 >> v1:172.21.15.79:6789/0 conn(0x7f04bc1498b0 0x7f04bc071020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:37588/0 (socket says 172.21.15.79:37588) 2023-10-03T19:12:06.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.942+0000 7f04c118e640 1 -- 172.21.15.79:0/1782255399 >> v1:172.21.15.79:6789/0 conn(0x7f04bc1498b0 legacy=0x7f04bc071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:06.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.942+0000 7f04c118e640 1 -- 172.21.15.79:0/1782255399 >> v1:172.21.15.45:6789/0 conn(0x7f04bc14c270 legacy=0x7f04bc14fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:06.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.942+0000 7f04c118e640 1 -- 172.21.15.79:0/1782255399 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04bc0b7500 con 0x7f04bc150530 2023-10-03T19:12:06.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.942+0000 7f04c118e640 1 --2- 172.21.15.79:0/1782255399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04bc150530 0x7f04bc157c00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f04b4009e80 tx=0x7f04b401f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc8e84cbaf2a39b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:06.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.942+0000 7f04bb7fe640 1 -- 172.21.15.79:0/1782255399 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b40af400 con 0x7f04bc150530 2023-10-03T19:12:06.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.942+0000 7f04bb7fe640 1 -- 172.21.15.79:0/1782255399 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b40ab050 con 0x7f04bc150530 2023-10-03T19:12:06.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.942+0000 7f04bb7fe640 1 -- 172.21.15.79:0/1782255399 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b40af780 con 0x7f04bc150530 2023-10-03T19:12:06.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.942+0000 7f04c2bf1640 1 -- 172.21.15.79:0/1782255399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04bc150530 msgr2=0x7f04bc157c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:06.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.942+0000 7f04c2bf1640 1 --2- 172.21.15.79:0/1782255399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04bc150530 0x7f04bc157c00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f04b4009e80 tx=0x7f04b401f1e0 comp rx=0 tx=0).stop 2023-10-03T19:12:06.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.942+0000 7f04c2bf1640 1 -- 172.21.15.79:0/1782255399 shutdown_connections 2023-10-03T19:12:06.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.942+0000 7f04c2bf1640 1 --2- 172.21.15.79:0/1782255399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04bc150530 0x7f04bc157c00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:06.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.942+0000 7f04c2bf1640 1 -- 172.21.15.79:0/1782255399 >> 172.21.15.79:0/1782255399 conn(0x7f04bc0c25f0 msgr2=0x7f04bc0c29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:06.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.942+0000 7f04c2bf1640 1 -- 172.21.15.79:0/1782255399 shutdown_connections 2023-10-03T19:12:06.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.942+0000 7f04c2bf1640 1 -- 172.21.15.79:0/1782255399 wait complete. 2023-10-03T19:12:06.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.946+0000 7f04c2bf1640 1 Processor -- start 2023-10-03T19:12:06.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.946+0000 7f04c2bf1640 1 -- start start 2023-10-03T19:12:06.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.946+0000 7f04c2bf1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04bc1498b0 0x7f04bc14b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:06.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.946+0000 7f04c2bf1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04bc14c270 0x7f04bc0bd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:06.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.946+0000 7f04c2bf1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04bc150530 0x7f04bc1e72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:06.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.946+0000 7f04c2bf1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc0bd010 con 0x7f04bc1498b0 2023-10-03T19:12:06.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.946+0000 7f04c2bf1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc14bf00 con 0x7f04bc14c270 2023-10-03T19:12:06.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.946+0000 7f04c2bf1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc0bd970 con 0x7f04bc150530 2023-10-03T19:12:06.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.946+0000 7f04bbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04bc14c270 0x7f04bc0bd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:06.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.946+0000 7f04c118e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04bc150530 0x7f04bc1e72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:06.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.946+0000 7f04bbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04bc14c270 0x7f04bc0bd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53102/0 (socket says 172.21.15.79:53102) 2023-10-03T19:12:06.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.946+0000 7f04bbfff640 1 -- 172.21.15.79:0/1564262609 learned_addr learned my addr 172.21.15.79:0/1564262609 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-03T19:12:06.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.946+0000 7f04c098d640 1 --2- 172.21.15.79:0/1564262609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04bc1498b0 0x7f04bc14b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:06.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.946+0000 7f04bbfff640 1 -- 172.21.15.79:0/1564262609 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04bc150530 msgr2=0x7f04bc1e72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:06.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.946+0000 7f04bbfff640 1 --2- 172.21.15.79:0/1564262609 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04bc150530 0x7f04bc1e72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:06.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.946+0000 7f04bbfff640 1 -- 172.21.15.79:0/1564262609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04bc1498b0 msgr2=0x7f04bc14b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:06.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.946+0000 7f04bbfff640 1 --2- 172.21.15.79:0/1564262609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04bc1498b0 0x7f04bc14b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:06.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.946+0000 7f04bbfff640 1 -- 172.21.15.79:0/1564262609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b4009b30 con 0x7f04bc14c270 2023-10-03T19:12:06.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.946+0000 7f04c118e640 1 --2- 172.21.15.79:0/1564262609 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04bc150530 0x7f04bc1e72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:12:06.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.946+0000 7f04bbfff640 1 --2- 172.21.15.79:0/1564262609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04bc14c270 0x7f04bc0bd430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f04a800c530 tx=0x7f04a800c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:06.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.946+0000 7f04b97fa640 1 -- 172.21.15.79:0/1564262609 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8005220 con 0x7f04bc14c270 2023-10-03T19:12:06.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.946+0000 7f04b97fa640 1 -- 172.21.15.79:0/1564262609 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a8005380 con 0x7f04bc14c270 2023-10-03T19:12:06.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.946+0000 7f04b97fa640 1 -- 172.21.15.79:0/1564262609 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8007270 con 0x7f04bc14c270 2023-10-03T19:12:06.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.946+0000 7f04c2bf1640 1 -- 172.21.15.79:0/1564262609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04bc0a7da0 con 0x7f04bc14c270 2023-10-03T19:12:06.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.946+0000 7f04c2bf1640 1 -- 172.21.15.79:0/1564262609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04bc0a4e70 con 0x7f04bc14c270 2023-10-03T19:12:06.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.946+0000 7f04b97fa640 1 -- 172.21.15.79:0/1564262609 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f04a80067e0 con 0x7f04bc14c270 2023-10-03T19:12:06.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.946+0000 7f04b97fa640 1 -- 172.21.15.79:0/1564262609 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f04a8012dc0 con 0x7f04bc14c270 2023-10-03T19:12:06.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.946+0000 7f04c2bf1640 1 -- 172.21.15.79:0/1564262609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04bc14f900 con 0x7f04bc14c270 2023-10-03T19:12:06.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:06.950+0000 7f04b97fa640 1 -- 172.21.15.79:0/1564262609 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f04a8016020 con 0x7f04bc14c270 2023-10-03T19:12:07.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.014+0000 7f04c2bf1640 1 -- 172.21.15.79:0/1564262609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd new", "uuid": "64b35ec1-08ee-4b28-b46a-31fb941e9675", "id": 2} v 0) v1 -- 0x7f04bc0bd150 con 0x7f04bc14c270 2023-10-03T19:12:07.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.022+0000 7f04b97fa640 1 -- 172.21.15.79:0/1564262609 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "64b35ec1-08ee-4b28-b46a-31fb941e9675", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f04bc0bd150 con 0x7f04bc14c270 2023-10-03T19:12:07.028 INFO:teuthology.orchestra.run.smithi079.stdout:2 2023-10-03T19:12:07.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.022+0000 7f04c2bf1640 1 -- 172.21.15.79:0/1564262609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04bc14c270 msgr2=0x7f04bc0bd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:07.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.022+0000 7f04c2bf1640 1 --2- 172.21.15.79:0/1564262609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04bc14c270 0x7f04bc0bd430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f04a800c530 tx=0x7f04a800c9f0 comp rx=0 tx=0).stop 2023-10-03T19:12:07.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.026+0000 7f04c2bf1640 1 -- 172.21.15.79:0/1564262609 shutdown_connections 2023-10-03T19:12:07.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.026+0000 7f04c2bf1640 1 --2- 172.21.15.79:0/1564262609 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04bc150530 0x7f04bc1e72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:07.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.026+0000 7f04c2bf1640 1 --2- 172.21.15.79:0/1564262609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04bc14c270 0x7f04bc0bd430 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:07.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.026+0000 7f04c2bf1640 1 --2- 172.21.15.79:0/1564262609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04bc1498b0 0x7f04bc14b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:07.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.026+0000 7f04c2bf1640 1 -- 172.21.15.79:0/1564262609 >> 172.21.15.79:0/1564262609 conn(0x7f04bc0c25f0 msgr2=0x7f04bc14eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:07.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.026+0000 7f04c2bf1640 1 -- 172.21.15.79:0/1564262609 shutdown_connections 2023-10-03T19:12:07.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.026+0000 7f04c2bf1640 1 -- 172.21.15.79:0/1564262609 wait complete. 2023-10-03T19:12:07.043 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new b885244f-5cb0-4665-8e0b-16b3736435d7 3 2023-10-03T19:12:07.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.142+0000 7fb68ba58640 1 Processor -- start 2023-10-03T19:12:07.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.142+0000 7fb68ba58640 1 -- start start 2023-10-03T19:12:07.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.142+0000 7fb68ba58640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb68414eb90 0x7fb684159e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:07.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.142+0000 7fb68ba58640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb68406b1c0 con 0x7fb68414bb80 2023-10-03T19:12:07.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.142+0000 7fb68ba58640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb684069b40 con 0x7fb684071ec0 2023-10-03T19:12:07.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.142+0000 7fb68ba58640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68414bf50 con 0x7fb68414eb90 2023-10-03T19:12:07.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.142+0000 7fb689ff5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb68414eb90 0x7fb684159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:07.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.142+0000 7fb689ff5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb68414eb90 0x7fb684159e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:57448/0 (socket says 172.21.15.79:57448) 2023-10-03T19:12:07.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.142+0000 7fb689ff5640 1 -- 172.21.15.79:0/8460354 learned_addr learned my addr 172.21.15.79:0/8460354 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-03T19:12:07.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.146+0000 7fb689ff5640 1 -- 172.21.15.79:0/8460354 >> v1:172.21.15.79:6789/0 conn(0x7fb684071ec0 legacy=0x7fb68414e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:07.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.146+0000 7fb689ff5640 1 -- 172.21.15.79:0/8460354 >> v1:172.21.15.45:6789/0 conn(0x7fb68414bb80 legacy=0x7fb684071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:07.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.146+0000 7fb689ff5640 1 -- 172.21.15.79:0/8460354 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6841527d0 con 0x7fb68414eb90 2023-10-03T19:12:07.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.146+0000 7fb689ff5640 1 --2- 172.21.15.79:0/8460354 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb68414eb90 0x7fb684159e10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb67c0098a0 tx=0x7fb67c01c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a241c776903ba49 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:07.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.146+0000 7fb677fff640 1 -- 172.21.15.79:0/8460354 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c0aa650 con 0x7fb68414eb90 2023-10-03T19:12:07.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.146+0000 7fb677fff640 1 -- 172.21.15.79:0/8460354 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67c0aa7b0 con 0x7fb68414eb90 2023-10-03T19:12:07.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.146+0000 7fb677fff640 1 -- 172.21.15.79:0/8460354 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c0aab40 con 0x7fb68414eb90 2023-10-03T19:12:07.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.146+0000 7fb68ba58640 1 -- 172.21.15.79:0/8460354 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb68414eb90 msgr2=0x7fb684159e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:07.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.146+0000 7fb68ba58640 1 --2- 172.21.15.79:0/8460354 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb68414eb90 0x7fb684159e10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb67c0098a0 tx=0x7fb67c01c4f0 comp rx=0 tx=0).stop 2023-10-03T19:12:07.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.146+0000 7fb68ba58640 1 -- 172.21.15.79:0/8460354 shutdown_connections 2023-10-03T19:12:07.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.146+0000 7fb68ba58640 1 --2- 172.21.15.79:0/8460354 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb68414eb90 0x7fb684159e10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:07.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.146+0000 7fb68ba58640 1 -- 172.21.15.79:0/8460354 >> 172.21.15.79:0/8460354 conn(0x7fb6840c25f0 msgr2=0x7fb6840c29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:07.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.146+0000 7fb68ba58640 1 -- 172.21.15.79:0/8460354 shutdown_connections 2023-10-03T19:12:07.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.146+0000 7fb68ba58640 1 -- 172.21.15.79:0/8460354 wait complete. 2023-10-03T19:12:07.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.150+0000 7fb68ba58640 1 Processor -- start 2023-10-03T19:12:07.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.150+0000 7fb68ba58640 1 -- start start 2023-10-03T19:12:07.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.150+0000 7fb68ba58640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb684071ec0 0x7fb684146860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:07.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.150+0000 7fb68ba58640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb68414bb80 0x7fb6840c01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:07.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.150+0000 7fb68ba58640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb68414eb90 0x7fb6840c0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:07.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.150+0000 7fb68ba58640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6841484c0 con 0x7fb684071ec0 2023-10-03T19:12:07.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.150+0000 7fb68ba58640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb684145830 con 0x7fb68414eb90 2023-10-03T19:12:07.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.150+0000 7fb68ba58640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6840c0c40 con 0x7fb68414bb80 2023-10-03T19:12:07.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.150+0000 7fb688ff3640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb68414bb80 0x7fb6840c01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:07.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.150+0000 7fb689ff5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb68414eb90 0x7fb6840c0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:07.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.150+0000 7fb688ff3640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb68414bb80 0x7fb6840c01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:57462/0 (socket says 172.21.15.79:57462) 2023-10-03T19:12:07.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.150+0000 7fb689ff5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb68414eb90 0x7fb6840c0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39986/0 (socket says 172.21.15.79:39986) 2023-10-03T19:12:07.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.150+0000 7fb688ff3640 1 -- 172.21.15.79:0/497154431 learned_addr learned my addr 172.21.15.79:0/497154431 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-03T19:12:07.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.150+0000 7fb6897f4640 1 --2- 172.21.15.79:0/497154431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb684071ec0 0x7fb684146860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:07.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.150+0000 7fb688ff3640 1 -- 172.21.15.79:0/497154431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb68414eb90 msgr2=0x7fb6840c0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:07.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.150+0000 7fb688ff3640 1 --2- 172.21.15.79:0/497154431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb68414eb90 0x7fb6840c0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:07.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.150+0000 7fb688ff3640 1 -- 172.21.15.79:0/497154431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb684071ec0 msgr2=0x7fb684146860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:07.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.150+0000 7fb688ff3640 1 --2- 172.21.15.79:0/497154431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb684071ec0 0x7fb684146860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:07.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.150+0000 7fb688ff3640 1 -- 172.21.15.79:0/497154431 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67c0094d0 con 0x7fb68414bb80 2023-10-03T19:12:07.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.150+0000 7fb688ff3640 1 --2- 172.21.15.79:0/497154431 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb68414bb80 0x7fb6840c01c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb68000c390 tx=0x7fb68000c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:07.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.150+0000 7fb675ffb640 1 -- 172.21.15.79:0/497154431 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6800052d0 con 0x7fb68414bb80 2023-10-03T19:12:07.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.150+0000 7fb675ffb640 1 -- 172.21.15.79:0/497154431 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb680005430 con 0x7fb68414bb80 2023-10-03T19:12:07.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.150+0000 7fb68ba58640 1 -- 172.21.15.79:0/497154431 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb684152480 con 0x7fb68414bb80 2023-10-03T19:12:07.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.150+0000 7fb675ffb640 1 -- 172.21.15.79:0/497154431 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb680003820 con 0x7fb68414bb80 2023-10-03T19:12:07.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.150+0000 7fb68ba58640 1 -- 172.21.15.79:0/497154431 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb684071730 con 0x7fb68414bb80 2023-10-03T19:12:07.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.150+0000 7fb675ffb640 1 -- 172.21.15.79:0/497154431 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb680003c80 con 0x7fb68414bb80 2023-10-03T19:12:07.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.150+0000 7fb675ffb640 1 -- 172.21.15.79:0/497154431 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fb6800128b0 con 0x7fb68414bb80 2023-10-03T19:12:07.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.150+0000 7fb68ba58640 1 -- 172.21.15.79:0/497154431 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6840bc900 con 0x7fb68414bb80 2023-10-03T19:12:07.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.154+0000 7fb675ffb640 1 -- 172.21.15.79:0/497154431 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fb680017070 con 0x7fb68414bb80 2023-10-03T19:12:07.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.214+0000 7fb68ba58640 1 -- 172.21.15.79:0/497154431 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b885244f-5cb0-4665-8e0b-16b3736435d7", "id": 3} v 0) v1 -- 0x7fb684148600 con 0x7fb68414bb80 2023-10-03T19:12:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.222+0000 7fb675ffb640 1 -- 172.21.15.79:0/497154431 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b885244f-5cb0-4665-8e0b-16b3736435d7", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb684148600 con 0x7fb68414bb80 2023-10-03T19:12:07.227 INFO:teuthology.orchestra.run.smithi079.stdout:3 2023-10-03T19:12:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.222+0000 7fb68ba58640 1 -- 172.21.15.79:0/497154431 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb68414bb80 msgr2=0x7fb6840c01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.222+0000 7fb68ba58640 1 --2- 172.21.15.79:0/497154431 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb68414bb80 0x7fb6840c01c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb68000c390 tx=0x7fb68000c850 comp rx=0 tx=0).stop 2023-10-03T19:12:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.222+0000 7fb68ba58640 1 -- 172.21.15.79:0/497154431 shutdown_connections 2023-10-03T19:12:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.222+0000 7fb68ba58640 1 --2- 172.21.15.79:0/497154431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb68414eb90 0x7fb6840c0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.222+0000 7fb68ba58640 1 --2- 172.21.15.79:0/497154431 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb68414bb80 0x7fb6840c01c0 secure :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb68000c390 tx=0x7fb68000c850 comp rx=0 tx=0).stop 2023-10-03T19:12:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.222+0000 7fb68ba58640 1 --2- 172.21.15.79:0/497154431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb684071ec0 0x7fb684146860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.222+0000 7fb68ba58640 1 -- 172.21.15.79:0/497154431 >> 172.21.15.79:0/497154431 conn(0x7fb6840c25f0 msgr2=0x7fb6840b8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.222+0000 7fb68ba58640 1 -- 172.21.15.79:0/497154431 shutdown_connections 2023-10-03T19:12:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.222+0000 7fb68ba58640 1 -- 172.21.15.79:0/497154431 wait complete. 2023-10-03T19:12:07.248 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new ddc7c37f-e0a7-4090-ae54-fd4f3e56639d 4 2023-10-03T19:12:07.329 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-03T19:12:07.323+0000 7f67de088180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-03T19:12:07.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.354+0000 7f746064b640 1 Processor -- start 2023-10-03T19:12:08.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.354+0000 7f746064b640 1 -- start start 2023-10-03T19:12:08.277 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-03T19:12:07.379+0000 7f67de088180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-03T19:12:08.277 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-03T19:12:07.435+0000 7f67de088180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-03T19:12:08.277 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-03T19:12:07.515+0000 7f67de088180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-03T19:12:08.277 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-03T19:12:07.571+0000 7f67de088180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-03T19:12:08.277 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-03T19:12:07.651+0000 7f67de088180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-03T19:12:08.278 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-03T19:12:07.703+0000 7f67de088180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-03T19:12:08.278 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-03T19:12:07.847+0000 7f67de088180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-03T19:12:08.278 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-03T19:12:07.911+0000 7f67de088180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-03T19:12:08.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.354+0000 7f746064b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74580b7ef0 0x7f74580708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:08.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.354+0000 7f746064b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f74580b82c0 0x7f745814ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:08.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.354+0000 7f746064b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f745814f7a0 con 0x7f745814f230 2023-10-03T19:12:08.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.354+0000 7f746064b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f745814fc30 con 0x7f74580b82c0 2023-10-03T19:12:08.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.354+0000 7f746064b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f745806a8b0 con 0x7f74580b7ef0 2023-10-03T19:12:08.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.354+0000 7f745e3e7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74580b7ef0 0x7f74580708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:08.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.354+0000 7f745dbe6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f74580b82c0 0x7f745814ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:08.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.354+0000 7f745e3e7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74580b7ef0 0x7f74580708f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:57472/0 (socket says 172.21.15.79:57472) 2023-10-03T19:12:08.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.354+0000 7f745dbe6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f74580b82c0 0x7f745814ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39990/0 (socket says 172.21.15.79:39990) 2023-10-03T19:12:08.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.354+0000 7f745e3e7640 1 -- 172.21.15.79:0/798602316 learned_addr learned my addr 172.21.15.79:0/798602316 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-03T19:12:08.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.358+0000 7f745e3e7640 1 -- 172.21.15.79:0/798602316 >> v2:172.21.15.79:3300/0 conn(0x7f74580b82c0 msgr2=0x7f745814ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:08.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.358+0000 7f745e3e7640 1 --2- 172.21.15.79:0/798602316 >> v2:172.21.15.79:3300/0 conn(0x7f74580b82c0 0x7f745814ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:08.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.358+0000 7f745e3e7640 1 -- 172.21.15.79:0/798602316 >> v1:172.21.15.45:6789/0 conn(0x7f745814f230 legacy=0x7f745814b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:08.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.358+0000 7f745e3e7640 1 -- 172.21.15.79:0/798602316 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74580718d0 con 0x7f74580b7ef0 2023-10-03T19:12:08.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.358+0000 7f745dbe6640 1 --2- 172.21.15.79:0/798602316 >> v2:172.21.15.79:3300/0 conn(0x7f74580b82c0 0x7f745814ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:12:08.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.358+0000 7f745e3e7640 1 --2- 172.21.15.79:0/798602316 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74580b7ef0 0x7f74580708f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f745400bb10 tx=0x7f7454021400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72dea1b4211b981a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:08.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.358+0000 7f745d3e5640 1 -- 172.21.15.79:0/798602316 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74540b1600 con 0x7f74580b7ef0 2023-10-03T19:12:08.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.358+0000 7f745d3e5640 1 -- 172.21.15.79:0/798602316 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74540ad050 con 0x7f74580b7ef0 2023-10-03T19:12:08.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.358+0000 7f745d3e5640 1 -- 172.21.15.79:0/798602316 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74540b1980 con 0x7f74580b7ef0 2023-10-03T19:12:08.282 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-10-03T19:12:07.358+0000 7f0f4fc3f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-03T19:12:08.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.358+0000 7f746064b640 1 -- 172.21.15.79:0/798602316 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74580b7ef0 msgr2=0x7f74580708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:08.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.358+0000 7f746064b640 1 --2- 172.21.15.79:0/798602316 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74580b7ef0 0x7f74580708f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f745400bb10 tx=0x7f7454021400 comp rx=0 tx=0).stop 2023-10-03T19:12:08.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.358+0000 7f746064b640 1 -- 172.21.15.79:0/798602316 shutdown_connections 2023-10-03T19:12:08.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.358+0000 7f746064b640 1 --2- 172.21.15.79:0/798602316 >> v2:172.21.15.79:3300/0 conn(0x7f74580b82c0 0x7f745814ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:08.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.358+0000 7f746064b640 1 --2- 172.21.15.79:0/798602316 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74580b7ef0 0x7f74580708f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:08.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.358+0000 7f746064b640 1 -- 172.21.15.79:0/798602316 >> 172.21.15.79:0/798602316 conn(0x7f74580be190 msgr2=0x7f74580be590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:08.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.358+0000 7f746064b640 1 -- 172.21.15.79:0/798602316 shutdown_connections 2023-10-03T19:12:08.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.358+0000 7f746064b640 1 -- 172.21.15.79:0/798602316 wait complete. 2023-10-03T19:12:08.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.362+0000 7f746064b640 1 Processor -- start 2023-10-03T19:12:08.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.362+0000 7f746064b640 1 -- start start 2023-10-03T19:12:08.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.362+0000 7f746064b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74580b7ef0 0x7f74580a7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:08.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.362+0000 7f746064b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74580b82c0 0x7f7458145510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:08.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.362+0000 7f746064b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f745814f230 0x7f7458145a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:08.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.362+0000 7f746064b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74581e38e0 con 0x7f745814f230 2023-10-03T19:12:08.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.362+0000 7f746064b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74580bb0a0 con 0x7f74580b82c0 2023-10-03T19:12:08.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.362+0000 7f746064b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74580a7570 con 0x7f74580b7ef0 2023-10-03T19:12:08.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.362+0000 7f745e3e7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74580b7ef0 0x7f74580a7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:08.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.362+0000 7f745dbe6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74580b82c0 0x7f7458145510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:08.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.362+0000 7f745e3e7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74580b7ef0 0x7f74580a7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:57482/0 (socket says 172.21.15.79:57482) 2023-10-03T19:12:08.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.362+0000 7f745e3e7640 1 -- 172.21.15.79:0/1521288645 learned_addr learned my addr 172.21.15.79:0/1521288645 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-03T19:12:08.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.362+0000 7f745ebe8640 1 --2- 172.21.15.79:0/1521288645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f745814f230 0x7f7458145a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:08.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.362+0000 7f745dbe6640 1 -- 172.21.15.79:0/1521288645 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74580b7ef0 msgr2=0x7f74580a7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:08.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.362+0000 7f745dbe6640 1 --2- 172.21.15.79:0/1521288645 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74580b7ef0 0x7f74580a7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:08.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.362+0000 7f745dbe6640 1 -- 172.21.15.79:0/1521288645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f745814f230 msgr2=0x7f7458145a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:08.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.362+0000 7f745dbe6640 1 --2- 172.21.15.79:0/1521288645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f745814f230 0x7f7458145a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:08.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.362+0000 7f745dbe6640 1 -- 172.21.15.79:0/1521288645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7448009420 con 0x7f74580b82c0 2023-10-03T19:12:08.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.362+0000 7f745e3e7640 1 --2- 172.21.15.79:0/1521288645 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74580b7ef0 0x7f74580a7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:12:08.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.362+0000 7f745ebe8640 1 --2- 172.21.15.79:0/1521288645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f745814f230 0x7f7458145a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:08.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.362+0000 7f745dbe6640 1 --2- 172.21.15.79:0/1521288645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74580b82c0 0x7f7458145510 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f744800e9e0 tx=0x7f744800eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:08.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.362+0000 7f744effd640 1 -- 172.21.15.79:0/1521288645 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744800c9d0 con 0x7f74580b82c0 2023-10-03T19:12:08.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.362+0000 7f744effd640 1 -- 172.21.15.79:0/1521288645 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744800cb30 con 0x7f74580b82c0 2023-10-03T19:12:08.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.362+0000 7f746064b640 1 -- 172.21.15.79:0/1521288645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f745400b770 con 0x7f74580b82c0 2023-10-03T19:12:08.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.362+0000 7f744effd640 1 -- 172.21.15.79:0/1521288645 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744800cee0 con 0x7f74580b82c0 2023-10-03T19:12:08.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.362+0000 7f746064b640 1 -- 172.21.15.79:0/1521288645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74580bce60 con 0x7f74580b82c0 2023-10-03T19:12:08.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.362+0000 7f744effd640 1 -- 172.21.15.79:0/1521288645 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7448005ca0 con 0x7f74580b82c0 2023-10-03T19:12:08.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.362+0000 7f744effd640 1 -- 172.21.15.79:0/1521288645 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f7448013980 con 0x7f74580b82c0 2023-10-03T19:12:08.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.362+0000 7f746064b640 1 -- 172.21.15.79:0/1521288645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7458071bb0 con 0x7f74580b82c0 2023-10-03T19:12:08.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.366+0000 7f744effd640 1 -- 172.21.15.79:0/1521288645 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f7448021060 con 0x7f74580b82c0 2023-10-03T19:12:08.935 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-10-03T19:12:07.414+0000 7f0f4fc3f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-03T19:12:08.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.430+0000 7f746064b640 1 -- 172.21.15.79:0/1521288645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ddc7c37f-e0a7-4090-ae54-fd4f3e56639d", "id": 4} v 0) v1 -- 0x7f7458070e30 con 0x7f74580b82c0 2023-10-03T19:12:08.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.438+0000 7f744effd640 1 -- 172.21.15.79:0/1521288645 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ddc7c37f-e0a7-4090-ae54-fd4f3e56639d", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7448017070 con 0x7f74580b82c0 2023-10-03T19:12:08.938 INFO:teuthology.orchestra.run.smithi079.stdout:4 2023-10-03T19:12:08.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.438+0000 7f746064b640 1 -- 172.21.15.79:0/1521288645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74580b82c0 msgr2=0x7f7458145510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:08.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.438+0000 7f746064b640 1 --2- 172.21.15.79:0/1521288645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74580b82c0 0x7f7458145510 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f744800e9e0 tx=0x7f744800eea0 comp rx=0 tx=0).stop 2023-10-03T19:12:08.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.438+0000 7f746064b640 1 -- 172.21.15.79:0/1521288645 shutdown_connections 2023-10-03T19:12:08.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.438+0000 7f746064b640 1 --2- 172.21.15.79:0/1521288645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f745814f230 0x7f7458145a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:08.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.438+0000 7f746064b640 1 --2- 172.21.15.79:0/1521288645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74580b82c0 0x7f7458145510 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:08.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.438+0000 7f746064b640 1 --2- 172.21.15.79:0/1521288645 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74580b7ef0 0x7f74580a7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:08.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.438+0000 7f746064b640 1 -- 172.21.15.79:0/1521288645 >> 172.21.15.79:0/1521288645 conn(0x7f74580be190 msgr2=0x7f745806a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:08.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.438+0000 7f746064b640 1 -- 172.21.15.79:0/1521288645 shutdown_connections 2023-10-03T19:12:08.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:07.438+0000 7f746064b640 1 -- 172.21.15.79:0/1521288645 wait complete. 2023-10-03T19:12:08.942 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new 3c142493-107c-4e0d-a4a9-1e3ded1a0a60 5 2023-10-03T19:12:08.944 INFO:tasks.ceph.mgr.y.smithi045.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-10-03T19:12:08.944 INFO:tasks.ceph.mgr.y.smithi045.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-10-03T19:12:08.944 INFO:tasks.ceph.mgr.y.smithi045.stderr: from numpy import show_config as show_numpy_config 2023-10-03T19:12:08.945 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-03T19:12:08.731+0000 7f67de088180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-03T19:12:08.945 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-03T19:12:08.911+0000 7f67de088180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-03T19:12:08.945 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-10-03T19:12:07.470+0000 7f0f4fc3f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-03T19:12:08.946 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-10-03T19:12:07.546+0000 7f0f4fc3f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-03T19:12:08.946 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-10-03T19:12:07.598+0000 7f0f4fc3f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-03T19:12:08.946 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-10-03T19:12:07.670+0000 7f0f4fc3f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-03T19:12:08.946 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-10-03T19:12:07.722+0000 7f0f4fc3f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-03T19:12:08.946 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-10-03T19:12:07.858+0000 7f0f4fc3f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-03T19:12:08.946 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-10-03T19:12:07.918+0000 7f0f4fc3f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-03T19:12:08.946 INFO:tasks.ceph.mgr.x.smithi079.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-10-03T19:12:08.946 INFO:tasks.ceph.mgr.x.smithi079.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-10-03T19:12:08.946 INFO:tasks.ceph.mgr.x.smithi079.stderr: from numpy import show_config as show_numpy_config 2023-10-03T19:12:08.946 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-10-03T19:12:08.710+0000 7f0f4fc3f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-03T19:12:08.946 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-10-03T19:12:08.838+0000 7f0f4fc3f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-03T19:12:09.011 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-10-03T19:12:09.006+0000 7f0f4fc3f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-03T19:12:09.512 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-03T19:12:09.087+0000 7f67de088180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-03T19:12:09.512 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-03T19:12:09.159+0000 7f67de088180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-03T19:12:09.512 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-03T19:12:09.295+0000 7f67de088180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-03T19:12:09.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.058+0000 7fa0e153d640 1 Processor -- start 2023-10-03T19:12:09.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.058+0000 7fa0e153d640 1 -- start start 2023-10-03T19:12:09.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.058+0000 7fa0e153d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa0dc148a40 0x7fa0dc0bd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:09.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.058+0000 7fa0e153d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa0dc0c0520 0x7fa0dc0c09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:09.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.058+0000 7fa0e153d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0dc14bf10 con 0x7fa0dc0bbe70 2023-10-03T19:12:09.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.058+0000 7fa0e153d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0dc06cba0 con 0x7fa0dc148a40 2023-10-03T19:12:09.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.058+0000 7fa0e153d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc14bd20 con 0x7fa0dc0c0520 2023-10-03T19:12:09.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.058+0000 7fa0daffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa0dc148a40 0x7fa0dc0bd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:09.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.058+0000 7fa0db7fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa0dc0c0520 0x7fa0dc0c09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:09.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.058+0000 7fa0daffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa0dc148a40 0x7fa0dc0bd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40008/0 (socket says 172.21.15.79:40008) 2023-10-03T19:12:09.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.058+0000 7fa0daffd640 1 -- 172.21.15.79:0/1316048680 learned_addr learned my addr 172.21.15.79:0/1316048680 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-03T19:12:09.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.058+0000 7fa0daffd640 1 -- 172.21.15.79:0/1316048680 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa0dc0c0520 msgr2=0x7fa0dc0c09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:09.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.062+0000 7fa0daffd640 1 --2- 172.21.15.79:0/1316048680 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa0dc0c0520 0x7fa0dc0c09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:09.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.062+0000 7fa0daffd640 1 -- 172.21.15.79:0/1316048680 >> v1:172.21.15.79:6789/0 conn(0x7fa0dc0bbe70 legacy=0x7fa0dc06dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:09.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.062+0000 7fa0daffd640 1 -- 172.21.15.79:0/1316048680 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0dc06e380 con 0x7fa0dc148a40 2023-10-03T19:12:09.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.062+0000 7fa0db7fe640 1 --2- 172.21.15.79:0/1316048680 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa0dc0c0520 0x7fa0dc0c09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:12:09.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.062+0000 7fa0daffd640 1 --2- 172.21.15.79:0/1316048680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0dc148a40 0x7fa0dc0bd410 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009870 tx=0x7fa0d401c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b28b7e20fde01cdf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:09.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.062+0000 7fa0d9ffb640 1 -- 172.21.15.79:0/1316048680 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d40ab600 con 0x7fa0dc148a40 2023-10-03T19:12:09.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.062+0000 7fa0d9ffb640 1 -- 172.21.15.79:0/1316048680 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d40a7050 con 0x7fa0dc148a40 2023-10-03T19:12:09.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.062+0000 7fa0d9ffb640 1 -- 172.21.15.79:0/1316048680 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d40ab980 con 0x7fa0dc148a40 2023-10-03T19:12:09.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.062+0000 7fa0e153d640 1 -- 172.21.15.79:0/1316048680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0dc148a40 msgr2=0x7fa0dc0bd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:09.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.062+0000 7fa0e153d640 1 --2- 172.21.15.79:0/1316048680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0dc148a40 0x7fa0dc0bd410 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009870 tx=0x7fa0d401c540 comp rx=0 tx=0).stop 2023-10-03T19:12:09.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.062+0000 7fa0e153d640 1 -- 172.21.15.79:0/1316048680 shutdown_connections 2023-10-03T19:12:09.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.062+0000 7fa0e153d640 1 --2- 172.21.15.79:0/1316048680 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa0dc0c0520 0x7fa0dc0c09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:09.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.062+0000 7fa0e153d640 1 --2- 172.21.15.79:0/1316048680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0dc148a40 0x7fa0dc0bd410 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:09.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.062+0000 7fa0e153d640 1 -- 172.21.15.79:0/1316048680 >> 172.21.15.79:0/1316048680 conn(0x7fa0dc0c14f0 msgr2=0x7fa0dc0c18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:09.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.062+0000 7fa0e153d640 1 -- 172.21.15.79:0/1316048680 shutdown_connections 2023-10-03T19:12:09.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.062+0000 7fa0e153d640 1 -- 172.21.15.79:0/1316048680 wait complete. 2023-10-03T19:12:09.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.066+0000 7fa0e153d640 1 Processor -- start 2023-10-03T19:12:09.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.066+0000 7fa0e153d640 1 -- start start 2023-10-03T19:12:09.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.066+0000 7fa0e153d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0dc0bbe70 0x7fa0dc14f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:09.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.066+0000 7fa0e153d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa0dc0c0520 0x7fa0dc143e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:09.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.066+0000 7fa0e153d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0dc148a40 0x7fa0dc1e7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:09.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.066+0000 7fa0e153d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc14a360 con 0x7fa0dc0bbe70 2023-10-03T19:12:09.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.066+0000 7fa0e153d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc1443b0 con 0x7fa0dc148a40 2023-10-03T19:12:09.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.066+0000 7fa0e153d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc0a4a60 con 0x7fa0dc0c0520 2023-10-03T19:12:09.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.066+0000 7fa0da7fc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa0dc0c0520 0x7fa0dc143e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:09.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.066+0000 7fa0db7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0dc148a40 0x7fa0dc1e7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:09.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.066+0000 7fa0db7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0dc148a40 0x7fa0dc1e7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40022/0 (socket says 172.21.15.79:40022) 2023-10-03T19:12:09.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.066+0000 7fa0db7fe640 1 -- 172.21.15.79:0/3358856920 learned_addr learned my addr 172.21.15.79:0/3358856920 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-03T19:12:09.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.066+0000 7fa0db7fe640 1 -- 172.21.15.79:0/3358856920 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa0dc0c0520 msgr2=0x7fa0dc143e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:09.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.066+0000 7fa0db7fe640 1 --2- 172.21.15.79:0/3358856920 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa0dc0c0520 0x7fa0dc143e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:09.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.066+0000 7fa0db7fe640 1 -- 172.21.15.79:0/3358856920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0dc0bbe70 msgr2=0x7fa0dc14f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:09.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.066+0000 7fa0db7fe640 1 --2- 172.21.15.79:0/3358856920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0dc0bbe70 0x7fa0dc14f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:09.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.066+0000 7fa0db7fe640 1 -- 172.21.15.79:0/3358856920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0cc009a70 con 0x7fa0dc148a40 2023-10-03T19:12:09.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.066+0000 7fa0db7fe640 1 --2- 172.21.15.79:0/3358856920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0dc148a40 0x7fa0dc1e7e40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc00efc0 tx=0x7fa0cc009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:09.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.066+0000 7fa0d37fe640 1 -- 172.21.15.79:0/3358856920 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc009d70 con 0x7fa0dc148a40 2023-10-03T19:12:09.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.066+0000 7fa0d37fe640 1 -- 172.21.15.79:0/3358856920 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0cc00f040 con 0x7fa0dc148a40 2023-10-03T19:12:09.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.066+0000 7fa0d37fe640 1 -- 172.21.15.79:0/3358856920 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc0039a0 con 0x7fa0dc148a40 2023-10-03T19:12:09.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.066+0000 7fa0e153d640 1 -- 172.21.15.79:0/3358856920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d40094d0 con 0x7fa0dc148a40 2023-10-03T19:12:09.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.066+0000 7fa0e153d640 1 -- 172.21.15.79:0/3358856920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0dc158490 con 0x7fa0dc148a40 2023-10-03T19:12:09.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.066+0000 7fa0d37fe640 1 -- 172.21.15.79:0/3358856920 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa0cc0147a0 con 0x7fa0dc148a40 2023-10-03T19:12:09.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.066+0000 7fa0d37fe640 1 -- 172.21.15.79:0/3358856920 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fa0cc01d410 con 0x7fa0dc148a40 2023-10-03T19:12:09.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.066+0000 7fa0e153d640 1 -- 172.21.15.79:0/3358856920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0dc06d450 con 0x7fa0dc148a40 2023-10-03T19:12:09.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.070+0000 7fa0d37fe640 1 -- 172.21.15.79:0/3358856920 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fa0cc018030 con 0x7fa0dc148a40 2023-10-03T19:12:09.973 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-10-03T19:12:09.074+0000 7f0f4fc3f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-03T19:12:09.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.138+0000 7fa0e153d640 1 -- 172.21.15.79:0/3358856920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3c142493-107c-4e0d-a4a9-1e3ded1a0a60", "id": 5} v 0) v1 -- 0x7fa0dc158620 con 0x7fa0dc148a40 2023-10-03T19:12:09.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.146+0000 7fa0d37fe640 1 -- 172.21.15.79:0/3358856920 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3c142493-107c-4e0d-a4a9-1e3ded1a0a60", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa0cc014a50 con 0x7fa0dc148a40 2023-10-03T19:12:09.974 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-03T19:12:09.907+0000 7f67de088180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-03T19:12:09.975 INFO:teuthology.orchestra.run.smithi079.stdout:5 2023-10-03T19:12:09.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.146+0000 7fa0e153d640 1 -- 172.21.15.79:0/3358856920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0dc148a40 msgr2=0x7fa0dc1e7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:09.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.146+0000 7fa0e153d640 1 --2- 172.21.15.79:0/3358856920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0dc148a40 0x7fa0dc1e7e40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc00efc0 tx=0x7fa0cc009f90 comp rx=0 tx=0).stop 2023-10-03T19:12:09.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.146+0000 7fa0e153d640 1 -- 172.21.15.79:0/3358856920 shutdown_connections 2023-10-03T19:12:09.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.146+0000 7fa0e153d640 1 --2- 172.21.15.79:0/3358856920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0dc148a40 0x7fa0dc1e7e40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:09.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.146+0000 7fa0e153d640 1 --2- 172.21.15.79:0/3358856920 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa0dc0c0520 0x7fa0dc143e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:09.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.146+0000 7fa0e153d640 1 --2- 172.21.15.79:0/3358856920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0dc0bbe70 0x7fa0dc14f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:09.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.146+0000 7fa0e153d640 1 -- 172.21.15.79:0/3358856920 >> 172.21.15.79:0/3358856920 conn(0x7fa0dc0c14f0 msgr2=0x7fa0dc06dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:09.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.146+0000 7fa0e153d640 1 -- 172.21.15.79:0/3358856920 shutdown_connections 2023-10-03T19:12:09.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:09.146+0000 7fa0e153d640 1 -- 172.21.15.79:0/3358856920 wait complete. 2023-10-03T19:12:09.979 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new 53f89851-266d-4aeb-ac6b-69138ee8d9e6 6 2023-10-03T19:12:09.979 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-10-03T19:12:09.198+0000 7f0f4fc3f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-03T19:12:09.979 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-10-03T19:12:09.778+0000 7f0f4fc3f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-03T19:12:09.979 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-10-03T19:12:09.850+0000 7f0f4fc3f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-03T19:12:09.992 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-03T19:12:09.987+0000 7f67de088180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-03T19:12:10.319 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-10-03T19:12:10.018+0000 7f0f4fc3f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-03T19:12:10.319 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-10-03T19:12:10.094+0000 7f0f4fc3f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-03T19:12:10.319 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-03T19:12:10.163+0000 7f67de088180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-03T19:12:10.320 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-03T19:12:10.243+0000 7f67de088180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-03T19:12:10.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.094+0000 7f36ffc40640 1 Processor -- start 2023-10-03T19:12:10.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.094+0000 7f36ffc40640 1 -- start start 2023-10-03T19:12:10.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.094+0000 7f36ffc40640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36f814bbf0 0x7f36f80bcf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:10.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.094+0000 7f36ffc40640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f36f8071ea0 0x7f36f814f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:10.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.094+0000 7f36ffc40640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f814bfc0 con 0x7f36f8151b20 2023-10-03T19:12:10.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.094+0000 7f36ffc40640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f814f550 con 0x7f36f8071ea0 2023-10-03T19:12:10.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.094+0000 7f36ffc40640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f814e550 con 0x7f36f814bbf0 2023-10-03T19:12:10.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.094+0000 7f36fd1db640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f36f8071ea0 0x7f36f814f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:10.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.094+0000 7f36fd9dc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36f814bbf0 0x7f36f80bcf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:10.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.094+0000 7f36fd1db640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f36f8071ea0 0x7f36f814f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40026/0 (socket says 172.21.15.79:40026) 2023-10-03T19:12:10.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.094+0000 7f36fd9dc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36f814bbf0 0x7f36f80bcf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:57496/0 (socket says 172.21.15.79:57496) 2023-10-03T19:12:10.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.094+0000 7f36fd1db640 1 -- 172.21.15.79:0/567251643 learned_addr learned my addr 172.21.15.79:0/567251643 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-03T19:12:10.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.094+0000 7f36fe1dd640 1 --1- 172.21.15.79:0/567251643 >> v1:172.21.15.79:6789/0 conn(0x7f36f8151b20 0x7f36f8071020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38420/0 (socket says 172.21.15.79:38420) 2023-10-03T19:12:10.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.098+0000 7f36fd1db640 1 -- 172.21.15.79:0/567251643 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36f814bbf0 msgr2=0x7f36f80bcf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:10.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.098+0000 7f36fd1db640 1 --2- 172.21.15.79:0/567251643 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36f814bbf0 0x7f36f80bcf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:10.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.098+0000 7f36fd1db640 1 -- 172.21.15.79:0/567251643 >> v1:172.21.15.79:6789/0 conn(0x7f36f8151b20 legacy=0x7f36f8071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:10.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.098+0000 7f36fd1db640 1 -- 172.21.15.79:0/567251643 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f80bd570 con 0x7f36f8071ea0 2023-10-03T19:12:10.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.098+0000 7f36fd9dc640 1 --2- 172.21.15.79:0/567251643 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36f814bbf0 0x7f36f80bcf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:12:10.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.098+0000 7f36fd1db640 1 --2- 172.21.15.79:0/567251643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36f8071ea0 0x7f36f814f010 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f36f4009870 tx=0x7f36f401c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ded652a81655451 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:10.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.098+0000 7f36fc9da640 1 -- 172.21.15.79:0/567251643 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f40aa670 con 0x7f36f8071ea0 2023-10-03T19:12:10.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.098+0000 7f36fc9da640 1 -- 172.21.15.79:0/567251643 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f40aa7d0 con 0x7f36f8071ea0 2023-10-03T19:12:10.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.098+0000 7f36fc9da640 1 -- 172.21.15.79:0/567251643 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f40aab60 con 0x7f36f8071ea0 2023-10-03T19:12:10.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.098+0000 7f36ffc40640 1 -- 172.21.15.79:0/567251643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36f8071ea0 msgr2=0x7f36f814f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:10.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.098+0000 7f36ffc40640 1 --2- 172.21.15.79:0/567251643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36f8071ea0 0x7f36f814f010 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f36f4009870 tx=0x7f36f401c510 comp rx=0 tx=0).stop 2023-10-03T19:12:10.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.098+0000 7f36ffc40640 1 -- 172.21.15.79:0/567251643 shutdown_connections 2023-10-03T19:12:10.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.098+0000 7f36ffc40640 1 --2- 172.21.15.79:0/567251643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36f8071ea0 0x7f36f814f010 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:10.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.098+0000 7f36ffc40640 1 --2- 172.21.15.79:0/567251643 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36f814bbf0 0x7f36f80bcf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:10.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.098+0000 7f36ffc40640 1 -- 172.21.15.79:0/567251643 >> 172.21.15.79:0/567251643 conn(0x7f36f80c25f0 msgr2=0x7f36f80c29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:10.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.098+0000 7f36ffc40640 1 -- 172.21.15.79:0/567251643 shutdown_connections 2023-10-03T19:12:10.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.098+0000 7f36ffc40640 1 -- 172.21.15.79:0/567251643 wait complete. 2023-10-03T19:12:10.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.102+0000 7f36ffc40640 1 Processor -- start 2023-10-03T19:12:10.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.102+0000 7f36ffc40640 1 -- start start 2023-10-03T19:12:10.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.102+0000 7f36ffc40640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36f8071ea0 0x7f36f80beb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:10.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.102+0000 7f36ffc40640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36f814bbf0 0x7f36f81e67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:10.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.102+0000 7f36ffc40640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36f8151b20 0x7f36f81e6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:10.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.102+0000 7f36ffc40640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f81ea6c0 con 0x7f36f8071ea0 2023-10-03T19:12:10.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.102+0000 7f36ffc40640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f80bf090 con 0x7f36f814bbf0 2023-10-03T19:12:10.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.102+0000 7f36ffc40640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f81e9dd0 con 0x7f36f8151b20 2023-10-03T19:12:10.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.102+0000 7f36fe1dd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36f8151b20 0x7f36f81e6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:10.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.102+0000 7f36fd1db640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36f814bbf0 0x7f36f81e67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:10.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.102+0000 7f36fe1dd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36f8151b20 0x7f36f81e6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:57506/0 (socket says 172.21.15.79:57506) 2023-10-03T19:12:10.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.102+0000 7f36fe1dd640 1 -- 172.21.15.79:0/4120213123 learned_addr learned my addr 172.21.15.79:0/4120213123 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-03T19:12:10.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.102+0000 7f36fd1db640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36f814bbf0 0x7f36f81e67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40030/0 (socket says 172.21.15.79:40030) 2023-10-03T19:12:10.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.102+0000 7f36fe1dd640 1 -- 172.21.15.79:0/4120213123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36f814bbf0 msgr2=0x7f36f81e67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:10.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.102+0000 7f36fe1dd640 1 --2- 172.21.15.79:0/4120213123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36f814bbf0 0x7f36f81e67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:10.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.102+0000 7f36fe1dd640 1 -- 172.21.15.79:0/4120213123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36f8071ea0 msgr2=0x7f36f80beb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:10.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.102+0000 7f36fe1dd640 1 --2- 172.21.15.79:0/4120213123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36f8071ea0 0x7f36f80beb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:10.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.102+0000 7f36fe1dd640 1 -- 172.21.15.79:0/4120213123 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e8009420 con 0x7f36f8151b20 2023-10-03T19:12:10.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.102+0000 7f36fe1dd640 1 --2- 172.21.15.79:0/4120213123 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36f8151b20 0x7f36f81e6d00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f36f000c730 tx=0x7f36f000cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:10.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.102+0000 7f36ee7fc640 1 -- 172.21.15.79:0/4120213123 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f000ce40 con 0x7f36f8151b20 2023-10-03T19:12:10.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.102+0000 7f36ee7fc640 1 -- 172.21.15.79:0/4120213123 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f000a640 con 0x7f36f8151b20 2023-10-03T19:12:10.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.102+0000 7f36ee7fc640 1 -- 172.21.15.79:0/4120213123 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f000a9b0 con 0x7f36f8151b20 2023-10-03T19:12:10.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.102+0000 7f36ffc40640 1 -- 172.21.15.79:0/4120213123 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f40094d0 con 0x7f36f8151b20 2023-10-03T19:12:10.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.102+0000 7f36ffc40640 1 -- 172.21.15.79:0/4120213123 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f8071730 con 0x7f36f8151b20 2023-10-03T19:12:10.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.102+0000 7f36ee7fc640 1 -- 172.21.15.79:0/4120213123 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f36f0007070 con 0x7f36f8151b20 2023-10-03T19:12:10.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.102+0000 7f36ee7fc640 1 -- 172.21.15.79:0/4120213123 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f36f001ca30 con 0x7f36f8151b20 2023-10-03T19:12:10.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.102+0000 7f36ffc40640 1 -- 172.21.15.79:0/4120213123 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f8151f20 con 0x7f36f8151b20 2023-10-03T19:12:10.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.106+0000 7f36ee7fc640 1 -- 172.21.15.79:0/4120213123 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f36f0021060 con 0x7f36f8151b20 2023-10-03T19:12:10.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.170+0000 7f36ffc40640 1 -- 172.21.15.79:0/4120213123 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd new", "uuid": "53f89851-266d-4aeb-ac6b-69138ee8d9e6", "id": 6} v 0) v1 -- 0x7f36f804de80 con 0x7f36f8151b20 2023-10-03T19:12:10.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.178+0000 7f36ee7fc640 1 -- 172.21.15.79:0/4120213123 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "53f89851-266d-4aeb-ac6b-69138ee8d9e6", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f36f0017070 con 0x7f36f8151b20 2023-10-03T19:12:10.903 INFO:teuthology.orchestra.run.smithi079.stdout:6 2023-10-03T19:12:10.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.182+0000 7f36ffc40640 1 -- 172.21.15.79:0/4120213123 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36f8151b20 msgr2=0x7f36f81e6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:10.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.182+0000 7f36ffc40640 1 --2- 172.21.15.79:0/4120213123 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36f8151b20 0x7f36f81e6d00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f36f000c730 tx=0x7f36f000cbf0 comp rx=0 tx=0).stop 2023-10-03T19:12:10.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.182+0000 7f36ffc40640 1 -- 172.21.15.79:0/4120213123 shutdown_connections 2023-10-03T19:12:10.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.182+0000 7f36ffc40640 1 --2- 172.21.15.79:0/4120213123 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36f8151b20 0x7f36f81e6d00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:10.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.182+0000 7f36ffc40640 1 --2- 172.21.15.79:0/4120213123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36f814bbf0 0x7f36f81e67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:10.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.182+0000 7f36ffc40640 1 --2- 172.21.15.79:0/4120213123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36f8071ea0 0x7f36f80beb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:10.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.182+0000 7f36ffc40640 1 -- 172.21.15.79:0/4120213123 >> 172.21.15.79:0/4120213123 conn(0x7f36f80c25f0 msgr2=0x7f36f80c2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:12.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.182+0000 7f36ffc40640 1 -- 172.21.15.79:0/4120213123 shutdown_connections 2023-10-03T19:12:12.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:10.182+0000 7f36ffc40640 1 -- 172.21.15.79:0/4120213123 wait complete. 2023-10-03T19:12:12.018 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new 844de236-0d5c-4260-8ba9-09e341aca232 7 2023-10-03T19:12:12.020 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-10-03T19:12:10.342+0000 7f0f4fc3f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-03T19:12:12.020 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-10-03T19:12:10.398+0000 7f0f4fc3f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-03T19:12:12.020 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-10-03T19:12:11.458+0000 7f0ef77fa640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-03T19:12:12.020 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-10-03T19:12:11.458+0000 7f0ef77fa640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-03T19:12:12.021 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-03T19:12:10.503+0000 7f67de088180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-03T19:12:12.022 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-10-03T19:12:10.567+0000 7f67de088180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-03T19:12:12.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.142+0000 7f89e35c2640 1 Processor -- start 2023-10-03T19:12:12.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.142+0000 7f89e35c2640 1 -- start start 2023-10-03T19:12:12.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.142+0000 7f89e35c2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f89dc06f880 0x7f89dc0a5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:12.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.142+0000 7f89e35c2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89dc14ba30 0x7f89dc155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:12.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.142+0000 7f89e35c2640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89dc14f080 con 0x7f89dc14f510 2023-10-03T19:12:12.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.142+0000 7f89e35c2640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89dc06f3e0 con 0x7f89dc06f880 2023-10-03T19:12:12.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.142+0000 7f89e35c2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc070e90 con 0x7f89dc14ba30 2023-10-03T19:12:12.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.142+0000 7f89e1b5f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89dc14ba30 0x7f89dc155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:12.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.142+0000 7f89e135e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f89dc06f880 0x7f89dc0a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:12.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.142+0000 7f89e1b5f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89dc14ba30 0x7f89dc155bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:57568/0 (socket says 172.21.15.79:57568) 2023-10-03T19:12:12.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.142+0000 7f89e1b5f640 1 -- 172.21.15.79:0/1061003478 learned_addr learned my addr 172.21.15.79:0/1061003478 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-03T19:12:12.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.142+0000 7f89e1b5f640 1 -- 172.21.15.79:0/1061003478 >> v2:172.21.15.79:3300/0 conn(0x7f89dc06f880 msgr2=0x7f89dc0a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:12.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.142+0000 7f89e1b5f640 1 --2- 172.21.15.79:0/1061003478 >> v2:172.21.15.79:3300/0 conn(0x7f89dc06f880 0x7f89dc0a5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:12.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.142+0000 7f89e1b5f640 1 -- 172.21.15.79:0/1061003478 >> v1:172.21.15.45:6789/0 conn(0x7f89dc14f510 legacy=0x7f89dc14b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:12.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.142+0000 7f89e1b5f640 1 -- 172.21.15.79:0/1061003478 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc14ea30 con 0x7f89dc14ba30 2023-10-03T19:12:12.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.146+0000 7f89e1b5f640 1 --2- 172.21.15.79:0/1061003478 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89dc14ba30 0x7f89dc155bc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009e50 tx=0x7f89d401c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=982ee843fe6c574d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:12.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.146+0000 7f89d3fff640 1 -- 172.21.15.79:0/1061003478 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d40a5780 con 0x7f89dc14ba30 2023-10-03T19:12:12.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.146+0000 7f89d3fff640 1 -- 172.21.15.79:0/1061003478 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d40a58e0 con 0x7f89dc14ba30 2023-10-03T19:12:12.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.146+0000 7f89d3fff640 1 -- 172.21.15.79:0/1061003478 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d40a5c70 con 0x7f89dc14ba30 2023-10-03T19:12:12.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.146+0000 7f89e35c2640 1 -- 172.21.15.79:0/1061003478 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89dc14ba30 msgr2=0x7f89dc155bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:12.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.146+0000 7f89e35c2640 1 --2- 172.21.15.79:0/1061003478 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89dc14ba30 0x7f89dc155bc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009e50 tx=0x7f89d401c9a0 comp rx=0 tx=0).stop 2023-10-03T19:12:12.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.146+0000 7f89e35c2640 1 -- 172.21.15.79:0/1061003478 shutdown_connections 2023-10-03T19:12:12.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.146+0000 7f89e35c2640 1 --2- 172.21.15.79:0/1061003478 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89dc14ba30 0x7f89dc155bc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:12.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.146+0000 7f89e35c2640 1 --2- 172.21.15.79:0/1061003478 >> v2:172.21.15.79:3300/0 conn(0x7f89dc06f880 0x7f89dc0a5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:12.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.146+0000 7f89e35c2640 1 -- 172.21.15.79:0/1061003478 >> 172.21.15.79:0/1061003478 conn(0x7f89dc0a20d0 msgr2=0x7f89dc0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:12.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.146+0000 7f89e35c2640 1 -- 172.21.15.79:0/1061003478 shutdown_connections 2023-10-03T19:12:12.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.146+0000 7f89e35c2640 1 -- 172.21.15.79:0/1061003478 wait complete. 2023-10-03T19:12:12.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.150+0000 7f89e35c2640 1 Processor -- start 2023-10-03T19:12:12.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.150+0000 7f89e35c2640 1 -- start start 2023-10-03T19:12:12.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.150+0000 7f89e35c2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89dc06f880 0x7f89dc144410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:12.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.150+0000 7f89e35c2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89dc14ba30 0x7f89dc0be1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:12.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.150+0000 7f89e35c2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89dc14f510 0x7f89dc142b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:12.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.150+0000 7f89e35c2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc141210 con 0x7f89dc14f510 2023-10-03T19:12:12.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.150+0000 7f89e35c2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc143840 con 0x7f89dc14ba30 2023-10-03T19:12:12.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.150+0000 7f89e35c2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc144950 con 0x7f89dc06f880 2023-10-03T19:12:12.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.150+0000 7f89e0b5d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89dc14ba30 0x7f89dc0be1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:12.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.150+0000 7f89e135e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89dc06f880 0x7f89dc144410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:12.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.150+0000 7f89e0b5d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89dc14ba30 0x7f89dc0be1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40092/0 (socket says 172.21.15.79:40092) 2023-10-03T19:12:12.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.150+0000 7f89e0b5d640 1 -- 172.21.15.79:0/190343357 learned_addr learned my addr 172.21.15.79:0/190343357 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-03T19:12:12.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.150+0000 7f89e135e640 1 -- 172.21.15.79:0/190343357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89dc14ba30 msgr2=0x7f89dc0be1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:12.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.150+0000 7f89e135e640 1 --2- 172.21.15.79:0/190343357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89dc14ba30 0x7f89dc0be1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:12.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.150+0000 7f89e135e640 1 -- 172.21.15.79:0/190343357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89dc14f510 msgr2=0x7f89dc142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:12.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.150+0000 7f89e135e640 1 --2- 172.21.15.79:0/190343357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89dc14f510 0x7f89dc142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:12.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.150+0000 7f89e135e640 1 -- 172.21.15.79:0/190343357 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d4009b30 con 0x7f89dc06f880 2023-10-03T19:12:12.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.150+0000 7f89e0b5d640 1 --2- 172.21.15.79:0/190343357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89dc14ba30 0x7f89dc0be1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:12:12.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.150+0000 7f89e135e640 1 --2- 172.21.15.79:0/190343357 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89dc06f880 0x7f89dc144410 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f89d800e870 tx=0x7f89d800ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:12.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.150+0000 7f89d1ffb640 1 -- 172.21.15.79:0/190343357 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d800eec0 con 0x7f89dc06f880 2023-10-03T19:12:12.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.150+0000 7f89d1ffb640 1 -- 172.21.15.79:0/190343357 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d800c940 con 0x7f89dc06f880 2023-10-03T19:12:12.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.150+0000 7f89e35c2640 1 -- 172.21.15.79:0/190343357 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89dc070a40 con 0x7f89dc06f880 2023-10-03T19:12:12.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.150+0000 7f89d1ffb640 1 -- 172.21.15.79:0/190343357 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d800ccb0 con 0x7f89dc06f880 2023-10-03T19:12:12.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.150+0000 7f89e35c2640 1 -- 172.21.15.79:0/190343357 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89dc06fc50 con 0x7f89dc06f880 2023-10-03T19:12:12.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.150+0000 7f89e35c2640 1 -- 172.21.15.79:0/190343357 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89dc070bd0 con 0x7f89dc06f880 2023-10-03T19:12:12.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.150+0000 7f89d1ffb640 1 -- 172.21.15.79:0/190343357 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 3) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f89d8013470 con 0x7f89dc06f880 2023-10-03T19:12:12.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.150+0000 7f89d1ffb640 1 --2- 172.21.15.79:0/190343357 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f89c00660d0 0x7f89c0068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:12.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.150+0000 7f89d1ffb640 1 -- 172.21.15.79:0/190343357 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f89d8082c60 con 0x7f89dc06f880 2023-10-03T19:12:12.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.150+0000 7f89e0b5d640 1 --2- 172.21.15.79:0/190343357 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f89c00660d0 0x7f89c0068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:12.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.150+0000 7f89e0b5d640 1 --2- 172.21.15.79:0/190343357 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f89c00660d0 0x7f89c0068580 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f89dc144e10 tx=0x7f89cc009110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:12.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.154+0000 7f89d1ffb640 1 -- 172.21.15.79:0/190343357 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f89d8055060 con 0x7f89dc06f880 2023-10-03T19:12:12.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.306+0000 7f89e35c2640 1 -- 172.21.15.79:0/190343357 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd new", "uuid": "844de236-0d5c-4260-8ba9-09e341aca232", "id": 7} v 0) v1 -- 0x7f89dc04de80 con 0x7f89dc06f880 2023-10-03T19:12:12.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.314+0000 7f89d1ffb640 1 -- 172.21.15.79:0/190343357 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "844de236-0d5c-4260-8ba9-09e341aca232", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f89d80170b0 con 0x7f89dc06f880 2023-10-03T19:12:12.791 INFO:teuthology.orchestra.run.smithi079.stdout:7 2023-10-03T19:12:12.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.318+0000 7f89e35c2640 1 -- 172.21.15.79:0/190343357 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f89c00660d0 msgr2=0x7f89c0068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:12.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.318+0000 7f89e35c2640 1 --2- 172.21.15.79:0/190343357 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f89c00660d0 0x7f89c0068580 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f89dc144e10 tx=0x7f89cc009110 comp rx=0 tx=0).stop 2023-10-03T19:12:12.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.318+0000 7f89e35c2640 1 -- 172.21.15.79:0/190343357 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89dc06f880 msgr2=0x7f89dc144410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:12.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.318+0000 7f89e35c2640 1 --2- 172.21.15.79:0/190343357 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89dc06f880 0x7f89dc144410 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f89d800e870 tx=0x7f89d800ec70 comp rx=0 tx=0).stop 2023-10-03T19:12:12.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.318+0000 7f89e35c2640 1 -- 172.21.15.79:0/190343357 shutdown_connections 2023-10-03T19:12:12.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.318+0000 7f89e35c2640 1 --2- 172.21.15.79:0/190343357 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f89c00660d0 0x7f89c0068580 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:12.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.318+0000 7f89e35c2640 1 --2- 172.21.15.79:0/190343357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89dc14f510 0x7f89dc142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:12.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.318+0000 7f89e35c2640 1 --2- 172.21.15.79:0/190343357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89dc14ba30 0x7f89dc0be1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:12.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.318+0000 7f89e35c2640 1 --2- 172.21.15.79:0/190343357 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89dc06f880 0x7f89dc144410 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:12.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.318+0000 7f89e35c2640 1 -- 172.21.15.79:0/190343357 >> 172.21.15.79:0/190343357 conn(0x7f89dc0a20d0 msgr2=0x7f89dc0bc330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:12.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.318+0000 7f89e35c2640 1 -- 172.21.15.79:0/190343357 shutdown_connections 2023-10-03T19:12:12.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-03T19:12:12.318+0000 7f89e35c2640 1 -- 172.21.15.79:0/190343357 wait complete. 2023-10-03T19:12:12.795 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-03T19:12:12.795 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-03T19:12:12.797 INFO:tasks.ceph.osd.0:Started 2023-10-03T19:12:12.797 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-03T19:12:12.798 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-03T19:12:12.800 INFO:tasks.ceph.osd.1:Started 2023-10-03T19:12:12.916 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-03T19:12:12.916 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-03T19:12:12.918 INFO:tasks.ceph.osd.2:Started 2023-10-03T19:12:12.918 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-03T19:12:12.918 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-03T19:12:12.921 INFO:tasks.ceph.osd.3:Started 2023-10-03T19:12:12.921 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-03T19:12:12.921 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-03T19:12:12.924 INFO:tasks.ceph.osd.4:Started 2023-10-03T19:12:12.924 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-03T19:12:12.924 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-03T19:12:12.927 INFO:tasks.ceph.osd.5:Started 2023-10-03T19:12:12.927 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-03T19:12:12.930 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-03T19:12:12.933 INFO:tasks.ceph.osd.6:Started 2023-10-03T19:12:12.933 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-03T19:12:12.933 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-03T19:12:12.935 INFO:tasks.ceph.osd.7:Started 2023-10-03T19:12:12.936 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:12:13.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.042+0000 7fd4ee78d640 1 Processor -- start 2023-10-03T19:12:13.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.042+0000 7fd4ee78d640 1 -- start start 2023-10-03T19:12:13.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.046+0000 7fd4ee78d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4e806d5b0 0x7fd4e814b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:13.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.046+0000 7fd4ee78d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd4e806a6e0 0x7fd4e8148980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:13.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.046+0000 7fd4ee78d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e80bde50 con 0x7fd4e80a3ec0 2023-10-03T19:12:13.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.046+0000 7fd4ee78d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e806a570 con 0x7fd4e806d5b0 2023-10-03T19:12:13.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.046+0000 7fd4ee78d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e80bc690 con 0x7fd4e806a6e0 2023-10-03T19:12:13.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.046+0000 7fd4e7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4e806d5b0 0x7fd4e814b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:13.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.046+0000 7fd4e7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4e806d5b0 0x7fd4e814b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56308/0 (socket says 172.21.15.45:56308) 2023-10-03T19:12:13.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.046+0000 7fd4e7fff640 1 -- 172.21.15.45:0/2980587238 learned_addr learned my addr 172.21.15.45:0/2980587238 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:13.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.046+0000 7fd4ecd2a640 1 --2- 172.21.15.45:0/2980587238 >> v2:172.21.15.79:3300/0 conn(0x7fd4e806a6e0 0x7fd4e8148980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:13.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.046+0000 7fd4e6ffd640 1 -- 172.21.15.45:0/2980587238 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2999459009 0 0) 0x7fd4e80bde50 con 0x7fd4e80a3ec0 2023-10-03T19:12:13.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.046+0000 7fd4e7fff640 1 -- 172.21.15.45:0/2980587238 >> v2:172.21.15.79:3300/0 conn(0x7fd4e806a6e0 msgr2=0x7fd4e8148980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:13.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.046+0000 7fd4e7fff640 1 --2- 172.21.15.45:0/2980587238 >> v2:172.21.15.79:3300/0 conn(0x7fd4e806a6e0 0x7fd4e8148980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:13.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.046+0000 7fd4e7fff640 1 -- 172.21.15.45:0/2980587238 >> v1:172.21.15.79:6789/0 conn(0x7fd4e80a3ec0 legacy=0x7fd4e80bbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:13.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.046+0000 7fd4e7fff640 1 -- 172.21.15.45:0/2980587238 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e806ac30 con 0x7fd4e806d5b0 2023-10-03T19:12:13.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.046+0000 7fd4ecd2a640 1 --2- 172.21.15.45:0/2980587238 >> v2:172.21.15.79:3300/0 conn(0x7fd4e806a6e0 0x7fd4e8148980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:12:13.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.046+0000 7fd4e7fff640 1 --2- 172.21.15.45:0/2980587238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4e806d5b0 0x7fd4e814b770 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd4e806dd60 tx=0x7fd4d801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e8b406d3639198c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:13.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.046+0000 7fd4e6ffd640 1 -- 172.21.15.45:0/2980587238 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d80a89f0 con 0x7fd4e806d5b0 2023-10-03T19:12:13.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.046+0000 7fd4e6ffd640 1 -- 172.21.15.45:0/2980587238 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d80a8b50 con 0x7fd4e806d5b0 2023-10-03T19:12:13.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.046+0000 7fd4e6ffd640 1 -- 172.21.15.45:0/2980587238 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d80b0440 con 0x7fd4e806d5b0 2023-10-03T19:12:13.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4ee78d640 1 -- 172.21.15.45:0/2980587238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4e806d5b0 msgr2=0x7fd4e814b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:13.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4ee78d640 1 --2- 172.21.15.45:0/2980587238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4e806d5b0 0x7fd4e814b770 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd4e806dd60 tx=0x7fd4d801ecf0 comp rx=0 tx=0).stop 2023-10-03T19:12:13.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4ee78d640 1 -- 172.21.15.45:0/2980587238 shutdown_connections 2023-10-03T19:12:13.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4ee78d640 1 --2- 172.21.15.45:0/2980587238 >> v2:172.21.15.79:3300/0 conn(0x7fd4e806a6e0 0x7fd4e8148980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:13.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4ee78d640 1 --2- 172.21.15.45:0/2980587238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4e806d5b0 0x7fd4e814b770 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:13.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4ee78d640 1 -- 172.21.15.45:0/2980587238 >> 172.21.15.45:0/2980587238 conn(0x7fd4e80c1600 msgr2=0x7fd4e80c1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:13.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4ee78d640 1 -- 172.21.15.45:0/2980587238 shutdown_connections 2023-10-03T19:12:13.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4ee78d640 1 -- 172.21.15.45:0/2980587238 wait complete. 2023-10-03T19:12:13.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4ee78d640 1 Processor -- start 2023-10-03T19:12:13.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4ee78d640 1 -- start start 2023-10-03T19:12:13.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4ee78d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd4e806a6e0 0x7fd4e80a3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:13.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4ee78d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4e806d5b0 0x7fd4e814b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:13.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4ee78d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4e80a3ec0 0x7fd4e81d5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:13.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4ee78d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e80a30c0 con 0x7fd4e80a3ec0 2023-10-03T19:12:13.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4ee78d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e814aa10 con 0x7fd4e806d5b0 2023-10-03T19:12:13.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4ee78d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e80bb500 con 0x7fd4e806a6e0 2023-10-03T19:12:13.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4ecd2a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4e80a3ec0 0x7fd4e81d5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:13.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4ecd2a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4e80a3ec0 0x7fd4e81d5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56310/0 (socket says 172.21.15.45:56310) 2023-10-03T19:12:13.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4ecd2a640 1 -- 172.21.15.45:0/2850903422 learned_addr learned my addr 172.21.15.45:0/2850903422 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:13.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4e7fff640 1 --2- 172.21.15.45:0/2850903422 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd4e806a6e0 0x7fd4e80a3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:13.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4e77fe640 1 --2- 172.21.15.45:0/2850903422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4e806d5b0 0x7fd4e814b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:13.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4ecd2a640 1 -- 172.21.15.45:0/2850903422 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd4e806a6e0 msgr2=0x7fd4e80a3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:13.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4ecd2a640 1 --2- 172.21.15.45:0/2850903422 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd4e806a6e0 0x7fd4e80a3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:13.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4ecd2a640 1 -- 172.21.15.45:0/2850903422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4e806d5b0 msgr2=0x7fd4e814b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:13.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4ecd2a640 1 --2- 172.21.15.45:0/2850903422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4e806d5b0 0x7fd4e814b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:13.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4ecd2a640 1 -- 172.21.15.45:0/2850903422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e0009a70 con 0x7fd4e80a3ec0 2023-10-03T19:12:13.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4ecd2a640 1 --2- 172.21.15.45:0/2850903422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4e80a3ec0 0x7fd4e81d5460 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd4e000efc0 tx=0x7fd4e000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:13.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4e4ff9640 1 -- 172.21.15.45:0/2850903422 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e0009cd0 con 0x7fd4e80a3ec0 2023-10-03T19:12:13.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4e4ff9640 1 -- 172.21.15.45:0/2850903422 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e000f040 con 0x7fd4e80a3ec0 2023-10-03T19:12:13.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4ee78d640 1 -- 172.21.15.45:0/2850903422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d80094d0 con 0x7fd4e80a3ec0 2023-10-03T19:12:13.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4e4ff9640 1 -- 172.21.15.45:0/2850903422 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e00039a0 con 0x7fd4e80a3ec0 2023-10-03T19:12:13.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4ee78d640 1 -- 172.21.15.45:0/2850903422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e80bdb70 con 0x7fd4e80a3ec0 2023-10-03T19:12:13.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.050+0000 7fd4ee78d640 1 -- 172.21.15.45:0/2850903422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e806af10 con 0x7fd4e80a3ec0 2023-10-03T19:12:13.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.054+0000 7fd4e4ff9640 1 -- 172.21.15.45:0/2850903422 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 3) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fd4e0014480 con 0x7fd4e80a3ec0 2023-10-03T19:12:13.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.054+0000 7fd4e4ff9640 1 --2- 172.21.15.45:0/2850903422 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd4d40660d0 0x7fd4d4068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:13.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.054+0000 7fd4e4ff9640 1 -- 172.21.15.45:0/2850903422 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fd4e0083300 con 0x7fd4e80a3ec0 2023-10-03T19:12:13.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.054+0000 7fd4e7fff640 1 --2- 172.21.15.45:0/2850903422 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd4d40660d0 0x7fd4d4068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:13.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.054+0000 7fd4e7fff640 1 --2- 172.21.15.45:0/2850903422 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd4d40660d0 0x7fd4d4068580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd4d80b2000 tx=0x7fd4d80aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:13.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.070+0000 7fd4e4ff9640 1 -- 172.21.15.45:0/2850903422 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd4e0055670 con 0x7fd4e80a3ec0 2023-10-03T19:12:13.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.222+0000 7fd4ee78d640 1 -- 172.21.15.45:0/2850903422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4e806e200 con 0x7fd4e80a3ec0 2023-10-03T19:12:13.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.226+0000 7fd4e4ff9640 1 -- 172.21.15.45:0/2850903422 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fd4e0018070 con 0x7fd4e80a3ec0 2023-10-03T19:12:13.231 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:13.231 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":10,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:12:12.312314+0000","last_up_change":"0.000000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:12:13.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.226+0000 7fd4ee78d640 1 -- 172.21.15.45:0/2850903422 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd4d40660d0 msgr2=0x7fd4d4068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:13.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.226+0000 7fd4ee78d640 1 --2- 172.21.15.45:0/2850903422 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd4d40660d0 0x7fd4d4068580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd4d80b2000 tx=0x7fd4d80aa070 comp rx=0 tx=0).stop 2023-10-03T19:12:13.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.226+0000 7fd4ee78d640 1 -- 172.21.15.45:0/2850903422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4e80a3ec0 msgr2=0x7fd4e81d5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:13.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.226+0000 7fd4ee78d640 1 --2- 172.21.15.45:0/2850903422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4e80a3ec0 0x7fd4e81d5460 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd4e000efc0 tx=0x7fd4e000c490 comp rx=0 tx=0).stop 2023-10-03T19:12:13.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.226+0000 7fd4ee78d640 1 -- 172.21.15.45:0/2850903422 shutdown_connections 2023-10-03T19:12:13.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.226+0000 7fd4ee78d640 1 --2- 172.21.15.45:0/2850903422 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd4d40660d0 0x7fd4d4068580 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:13.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.226+0000 7fd4ee78d640 1 --2- 172.21.15.45:0/2850903422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4e80a3ec0 0x7fd4e81d5460 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:13.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.226+0000 7fd4ee78d640 1 --2- 172.21.15.45:0/2850903422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4e806d5b0 0x7fd4e814b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:13.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.226+0000 7fd4ee78d640 1 --2- 172.21.15.45:0/2850903422 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd4e806a6e0 0x7fd4e80a3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:13.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.226+0000 7fd4ee78d640 1 -- 172.21.15.45:0/2850903422 >> 172.21.15.45:0/2850903422 conn(0x7fd4e80c1600 msgr2=0x7fd4e8069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:13.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.226+0000 7fd4ee78d640 1 -- 172.21.15.45:0/2850903422 shutdown_connections 2023-10-03T19:12:13.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:13.226+0000 7fd4ee78d640 1 -- 172.21.15.45:0/2850903422 wait complete. 2023-10-03T19:12:13.250 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-03T19:12:13.250 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-03T19:12:13.420 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-03T19:12:13.414+0000 7f7a681b2640 -1 Falling back to public interface 2023-10-03T19:12:13.431 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-03T19:12:13.426+0000 7f5d2fa9b640 -1 Falling back to public interface 2023-10-03T19:12:13.528 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-03T19:12:13.522+0000 7f22f536b640 -1 Falling back to public interface 2023-10-03T19:12:13.529 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-03T19:12:13.522+0000 7f94fe803640 -1 Falling back to public interface 2023-10-03T19:12:13.530 INFO:tasks.ceph.osd.5.smithi079.stderr:2023-10-03T19:12:13.526+0000 7f3303e76640 -1 Falling back to public interface 2023-10-03T19:12:13.550 INFO:tasks.ceph.osd.4.smithi079.stderr:2023-10-03T19:12:13.546+0000 7fb75bb0a640 -1 Falling back to public interface 2023-10-03T19:12:13.557 INFO:tasks.ceph.osd.7.smithi079.stderr:2023-10-03T19:12:13.554+0000 7f643e276640 -1 Falling back to public interface 2023-10-03T19:12:13.558 INFO:tasks.ceph.osd.6.smithi079.stderr:2023-10-03T19:12:13.554+0000 7f8ebe2d3640 -1 Falling back to public interface 2023-10-03T19:12:14.057 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-03T19:12:14.179 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.174+0000 7f45c0a45640 1 Processor -- start 2023-10-03T19:12:14.179 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.174+0000 7f45c0a45640 1 -- start start 2023-10-03T19:12:14.181 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.174+0000 7f45c0a45640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f45bc0bbfb0 0x7f45bc0b8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:14.181 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.174+0000 7f45c0a45640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f45bc06e420 0x7f45bc1498c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:14.181 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.174+0000 7f45c0a45640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45bc0a4070 con 0x7f45bc0bea20 2023-10-03T19:12:14.181 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.174+0000 7f45c0a45640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45bc14cb80 con 0x7f45bc0bbfb0 2023-10-03T19:12:14.181 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.174+0000 7f45c0a45640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc1505a0 con 0x7f45bc06e420 2023-10-03T19:12:14.181 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.174+0000 7f45ba59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f45bc0bea20 0x7f45bc14c470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43102/0 (socket says 172.21.15.45:43102) 2023-10-03T19:12:14.181 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.174+0000 7f45ba59c640 1 -- 172.21.15.45:0/3961138031 learned_addr learned my addr 172.21.15.45:0/3961138031 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:14.181 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.174+0000 7f45bad9d640 1 --2- 172.21.15.45:0/3961138031 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f45bc06e420 0x7f45bc1498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:14.181 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.174+0000 7f45b9d9b640 1 --2- 172.21.15.45:0/3961138031 >> v2:172.21.15.79:3300/0 conn(0x7f45bc0bbfb0 0x7f45bc0b8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:14.182 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.174+0000 7f45b959a640 1 -- 172.21.15.45:0/3961138031 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195074721 0 0) 0x7f45bc0a4070 con 0x7f45bc0bea20 2023-10-03T19:12:14.182 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.174+0000 7f45b959a640 1 -- 172.21.15.45:0/3961138031 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45a4003530 con 0x7f45bc0bea20 2023-10-03T19:12:14.182 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.174+0000 7f45bad9d640 1 -- 172.21.15.45:0/3961138031 >> v2:172.21.15.79:3300/0 conn(0x7f45bc0bbfb0 msgr2=0x7f45bc0b8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:14.182 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.174+0000 7f45bad9d640 1 --2- 172.21.15.45:0/3961138031 >> v2:172.21.15.79:3300/0 conn(0x7f45bc0bbfb0 0x7f45bc0b8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:14.182 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.174+0000 7f45bad9d640 1 -- 172.21.15.45:0/3961138031 >> v1:172.21.15.45:6789/0 conn(0x7f45bc0bea20 legacy=0x7f45bc14c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:14.182 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.174+0000 7f45bad9d640 1 -- 172.21.15.45:0/3961138031 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45bc1508d0 con 0x7f45bc06e420 2023-10-03T19:12:14.183 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.178+0000 7f45bad9d640 1 --2- 172.21.15.45:0/3961138031 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f45bc06e420 0x7f45bc1498c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f45b4009d90 tx=0x7f45b401c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99ae2e9b0e3532fc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:14.183 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.178+0000 7f45b959a640 1 -- 172.21.15.45:0/3961138031 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b40a5780 con 0x7f45bc06e420 2023-10-03T19:12:14.183 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.178+0000 7f45b959a640 1 -- 172.21.15.45:0/3961138031 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b40a58e0 con 0x7f45bc06e420 2023-10-03T19:12:14.183 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.178+0000 7f45b959a640 1 -- 172.21.15.45:0/3961138031 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b40a5c70 con 0x7f45bc06e420 2023-10-03T19:12:14.184 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.178+0000 7f45c0a45640 1 -- 172.21.15.45:0/3961138031 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f45bc06e420 msgr2=0x7f45bc1498c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:14.184 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.178+0000 7f45c0a45640 1 --2- 172.21.15.45:0/3961138031 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f45bc06e420 0x7f45bc1498c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f45b4009d90 tx=0x7f45b401c8c0 comp rx=0 tx=0).stop 2023-10-03T19:12:14.184 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.178+0000 7f45c0a45640 1 -- 172.21.15.45:0/3961138031 shutdown_connections 2023-10-03T19:12:14.184 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.178+0000 7f45c0a45640 1 --2- 172.21.15.45:0/3961138031 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f45bc06e420 0x7f45bc1498c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:14.184 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.178+0000 7f45c0a45640 1 --2- 172.21.15.45:0/3961138031 >> v2:172.21.15.79:3300/0 conn(0x7f45bc0bbfb0 0x7f45bc0b8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:14.184 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.178+0000 7f45c0a45640 1 -- 172.21.15.45:0/3961138031 >> 172.21.15.45:0/3961138031 conn(0x7f45bc0c2260 msgr2=0x7f45bc0be0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:14.184 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.178+0000 7f45c0a45640 1 -- 172.21.15.45:0/3961138031 shutdown_connections 2023-10-03T19:12:14.185 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.178+0000 7f45c0a45640 1 -- 172.21.15.45:0/3961138031 wait complete. 2023-10-03T19:12:14.185 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.178+0000 7f45c0a45640 1 Processor -- start 2023-10-03T19:12:14.185 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.178+0000 7f45c0a45640 1 -- start start 2023-10-03T19:12:14.187 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.178+0000 7f45c0a45640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45bc06e420 0x7f45bc1ea380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:14.187 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.178+0000 7f45c0a45640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45bc0bbfb0 0x7f45bc1e8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:14.187 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.178+0000 7f45c0a45640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f45bc0bea20 0x7f45bc140d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:14.187 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.178+0000 7f45c0a45640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc1eac40 con 0x7f45bc06e420 2023-10-03T19:12:14.187 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.178+0000 7f45c0a45640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc0a7290 con 0x7f45bc0bbfb0 2023-10-03T19:12:14.187 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.178+0000 7f45c0a45640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc1eaee0 con 0x7f45bc0bea20 2023-10-03T19:12:14.187 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.178+0000 7f45ba59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45bc06e420 0x7f45bc1ea380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:14.187 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.178+0000 7f45ba59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45bc06e420 0x7f45bc1ea380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56320/0 (socket says 172.21.15.45:56320) 2023-10-03T19:12:14.188 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.178+0000 7f45ba59c640 1 -- 172.21.15.45:0/3996673166 learned_addr learned my addr 172.21.15.45:0/3996673166 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:14.188 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.178+0000 7f45bad9d640 1 --2- 172.21.15.45:0/3996673166 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f45bc0bea20 0x7f45bc140d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:14.188 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.182+0000 7f45b9d9b640 1 --2- 172.21.15.45:0/3996673166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45bc0bbfb0 0x7f45bc1e8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:14.188 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.182+0000 7f45ba59c640 1 -- 172.21.15.45:0/3996673166 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f45bc0bea20 msgr2=0x7f45bc140d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:14.188 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.182+0000 7f45ba59c640 1 --2- 172.21.15.45:0/3996673166 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f45bc0bea20 0x7f45bc140d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:14.188 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.182+0000 7f45ba59c640 1 -- 172.21.15.45:0/3996673166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45bc0bbfb0 msgr2=0x7f45bc1e8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:14.188 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.182+0000 7f45ba59c640 1 --2- 172.21.15.45:0/3996673166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45bc0bbfb0 0x7f45bc1e8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:14.188 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.182+0000 7f45ba59c640 1 -- 172.21.15.45:0/3996673166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b4009a70 con 0x7f45bc06e420 2023-10-03T19:12:14.188 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.182+0000 7f45ba59c640 1 --2- 172.21.15.45:0/3996673166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45bc06e420 0x7f45bc1ea380 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f45ac00c420 tx=0x7f45ac00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:14.189 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.182+0000 7f45aaffd640 1 -- 172.21.15.45:0/3996673166 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac005cf0 con 0x7f45bc06e420 2023-10-03T19:12:14.189 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.182+0000 7f45aaffd640 1 -- 172.21.15.45:0/3996673166 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac005e50 con 0x7f45bc06e420 2023-10-03T19:12:14.189 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.182+0000 7f45aaffd640 1 -- 172.21.15.45:0/3996673166 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac0072d0 con 0x7f45bc06e420 2023-10-03T19:12:14.189 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.182+0000 7f45c0a45640 1 -- 172.21.15.45:0/3996673166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45bc0bef80 con 0x7f45bc06e420 2023-10-03T19:12:14.189 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.182+0000 7f45c0a45640 1 -- 172.21.15.45:0/3996673166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45bc0bedf0 con 0x7f45bc06e420 2023-10-03T19:12:14.190 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.182+0000 7f45c0a45640 1 -- 172.21.15.45:0/3996673166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45bc157600 con 0x7f45bc06e420 2023-10-03T19:12:14.190 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.182+0000 7f45aaffd640 1 -- 172.21.15.45:0/3996673166 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 85602+0+0 (secure 0 0 0) 0x7f45ac007430 con 0x7f45bc06e420 2023-10-03T19:12:14.190 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.182+0000 7f45aaffd640 1 --2- 172.21.15.45:0/3996673166 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f459c0661f0 0x7f459c0686a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:14.190 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.182+0000 7f45aaffd640 1 -- 172.21.15.45:0/3996673166 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f45ac082050 con 0x7f45bc06e420 2023-10-03T19:12:14.190 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.182+0000 7f45b9d9b640 1 --2- 172.21.15.45:0/3996673166 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f459c0661f0 0x7f459c0686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:14.190 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.182+0000 7f45b9d9b640 1 --2- 172.21.15.45:0/3996673166 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f459c0661f0 0x7f459c0686a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f45bc14c200 tx=0x7f45b0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:14.193 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.186+0000 7f45aaffd640 1 -- 172.21.15.45:0/3996673166 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f45ac050700 con 0x7f45bc06e420 2023-10-03T19:12:14.348 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.342+0000 7f45c0a45640 1 -- 172.21.15.45:0/3996673166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45bc0b68e0 con 0x7f45bc06e420 2023-10-03T19:12:14.349 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.342+0000 7f45aaffd640 1 -- 172.21.15.45:0/3996673166 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f45ac017020 con 0x7f45bc06e420 2023-10-03T19:12:14.349 INFO:teuthology.misc.health.smithi045.stdout: 2023-10-03T19:12:14.350 INFO:teuthology.misc.health.smithi045.stdout:{"epoch":10,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:12:12.312314+0000","last_up_change":"0.000000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:12:14.352 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.346+0000 7f45c0a45640 1 -- 172.21.15.45:0/3996673166 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f459c0661f0 msgr2=0x7f459c0686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:14.352 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.346+0000 7f45c0a45640 1 --2- 172.21.15.45:0/3996673166 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f459c0661f0 0x7f459c0686a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f45bc14c200 tx=0x7f45b0008040 comp rx=0 tx=0).stop 2023-10-03T19:12:14.352 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.346+0000 7f45c0a45640 1 -- 172.21.15.45:0/3996673166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45bc06e420 msgr2=0x7f45bc1ea380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:14.352 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.346+0000 7f45c0a45640 1 --2- 172.21.15.45:0/3996673166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45bc06e420 0x7f45bc1ea380 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f45ac00c420 tx=0x7f45ac00c8e0 comp rx=0 tx=0).stop 2023-10-03T19:12:14.352 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.346+0000 7f45c0a45640 1 -- 172.21.15.45:0/3996673166 shutdown_connections 2023-10-03T19:12:14.352 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.346+0000 7f45c0a45640 1 --2- 172.21.15.45:0/3996673166 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f459c0661f0 0x7f459c0686a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:14.352 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.346+0000 7f45c0a45640 1 --2- 172.21.15.45:0/3996673166 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f45bc0bea20 0x7f45bc140d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:14.352 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.346+0000 7f45c0a45640 1 --2- 172.21.15.45:0/3996673166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45bc0bbfb0 0x7f45bc1e8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:14.352 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.346+0000 7f45c0a45640 1 --2- 172.21.15.45:0/3996673166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45bc06e420 0x7f45bc1ea380 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:14.353 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.346+0000 7f45c0a45640 1 -- 172.21.15.45:0/3996673166 >> 172.21.15.45:0/3996673166 conn(0x7f45bc0c2260 msgr2=0x7f45bc0bf7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:14.353 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.346+0000 7f45c0a45640 1 -- 172.21.15.45:0/3996673166 shutdown_connections 2023-10-03T19:12:14.353 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:14.346+0000 7f45c0a45640 1 -- 172.21.15.45:0/3996673166 wait complete. 2023-10-03T19:12:14.367 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-03T19:12:17.181 INFO:tasks.ceph.osd.5.smithi079.stderr:2023-10-03T19:12:17.178+0000 7f3303e76640 -1 osd.5 0 log_to_monitors true 2023-10-03T19:12:17.226 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-03T19:12:17.222+0000 7f7a681b2640 -1 osd.0 0 log_to_monitors true 2023-10-03T19:12:17.275 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-03T19:12:17.270+0000 7f5d2fa9b640 -1 osd.1 0 log_to_monitors true 2023-10-03T19:12:17.311 INFO:tasks.ceph.osd.4.smithi079.stderr:2023-10-03T19:12:17.306+0000 7fb75bb0a640 -1 osd.4 0 log_to_monitors true 2023-10-03T19:12:17.365 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-03T19:12:17.358+0000 7f22f536b640 -1 osd.2 0 log_to_monitors true 2023-10-03T19:12:17.379 INFO:tasks.ceph.osd.6.smithi079.stderr:2023-10-03T19:12:17.374+0000 7f8ebe2d3640 -1 osd.6 0 log_to_monitors true 2023-10-03T19:12:17.428 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-03T19:12:17.422+0000 7f94fe803640 -1 osd.3 0 log_to_monitors true 2023-10-03T19:12:17.462 INFO:tasks.ceph.osd.7.smithi079.stderr:2023-10-03T19:12:17.458+0000 7f643e276640 -1 osd.7 0 log_to_monitors true 2023-10-03T19:12:18.903 INFO:tasks.ceph.osd.5.smithi079.stderr:2023-10-03T19:12:18.897+0000 7f32ffe1b640 -1 osd.5 0 waiting for initial osdmap 2023-10-03T19:12:18.941 INFO:tasks.ceph.osd.5.smithi079.stderr:2023-10-03T19:12:18.937+0000 7f32f7c4e640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T19:12:19.023 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-03T19:12:19.018+0000 7f7a64157640 -1 osd.0 0 waiting for initial osdmap 2023-10-03T19:12:19.067 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-10-03T19:12:19.062+0000 7f7a5bf8a640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T19:12:20.157 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-03T19:12:20.154+0000 7f94fa7a8640 -1 osd.3 0 waiting for initial osdmap 2023-10-03T19:12:20.183 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-10-03T19:12:20.182+0000 7f94f25db640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T19:12:20.247 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-03T19:12:20.246+0000 7f5d2ba40640 -1 osd.1 0 waiting for initial osdmap 2023-10-03T19:12:20.263 INFO:tasks.ceph.osd.6.smithi079.stderr:2023-10-03T19:12:20.257+0000 7f8eba278640 -1 osd.6 0 waiting for initial osdmap 2023-10-03T19:12:20.264 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-03T19:12:20.262+0000 7f22f1b27640 -1 osd.2 0 waiting for initial osdmap 2023-10-03T19:12:20.267 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-10-03T19:12:20.266+0000 7f5d23873640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T19:12:20.282 INFO:tasks.ceph.osd.7.smithi079.stderr:2023-10-03T19:12:20.277+0000 7f643a21b640 -1 osd.7 0 waiting for initial osdmap 2023-10-03T19:12:20.294 INFO:tasks.ceph.osd.4.smithi079.stderr:2023-10-03T19:12:20.289+0000 7fb757aaf640 -1 osd.4 0 waiting for initial osdmap 2023-10-03T19:12:20.294 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-10-03T19:12:20.294+0000 7f22e9143640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T19:12:20.300 INFO:tasks.ceph.osd.6.smithi079.stderr:2023-10-03T19:12:20.297+0000 7f8eb20ab640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T19:12:20.321 INFO:tasks.ceph.osd.4.smithi079.stderr:2023-10-03T19:12:20.317+0000 7fb74f8e2640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T19:12:20.321 INFO:tasks.ceph.osd.7.smithi079.stderr:2023-10-03T19:12:20.317+0000 7f643204e640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T19:12:21.176 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-03T19:12:21.304 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.302+0000 7faf3cbf1640 1 Processor -- start 2023-10-03T19:12:21.305 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.302+0000 7faf3cbf1640 1 -- start start 2023-10-03T19:12:21.306 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.302+0000 7faf3cbf1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faf380c11e0 0x7faf380c15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:21.306 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.302+0000 7faf3cbf1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faf3806bbe0 0x7faf380c0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:21.306 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.302+0000 7faf3cbf1640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf380c2bc0 con 0x7faf3806ab20 2023-10-03T19:12:21.307 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.302+0000 7faf3cbf1640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3814f6a0 con 0x7faf380c11e0 2023-10-03T19:12:21.307 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.302+0000 7faf3cbf1640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf381528f0 con 0x7faf3806bbe0 2023-10-03T19:12:21.307 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.302+0000 7faf3659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faf380c11e0 0x7faf380c15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:21.307 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.302+0000 7faf3659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faf380c11e0 0x7faf380c15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49876/0 (socket says 172.21.15.45:49876) 2023-10-03T19:12:21.307 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.302+0000 7faf3659c640 1 -- 172.21.15.45:0/3650870904 learned_addr learned my addr 172.21.15.45:0/3650870904 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:21.307 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.302+0000 7faf35d9b640 1 --2- 172.21.15.45:0/3650870904 >> v2:172.21.15.79:3300/0 conn(0x7faf3806bbe0 0x7faf380c0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:21.307 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.302+0000 7faf3659c640 1 -- 172.21.15.45:0/3650870904 >> v2:172.21.15.79:3300/0 conn(0x7faf3806bbe0 msgr2=0x7faf380c0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:21.308 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.302+0000 7faf3659c640 1 --2- 172.21.15.45:0/3650870904 >> v2:172.21.15.79:3300/0 conn(0x7faf3806bbe0 0x7faf380c0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:21.308 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.302+0000 7faf3659c640 1 -- 172.21.15.45:0/3650870904 >> v1:172.21.15.45:6789/0 conn(0x7faf3806ab20 legacy=0x7faf3806af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:21.308 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.302+0000 7faf3659c640 1 -- 172.21.15.45:0/3650870904 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf380c2850 con 0x7faf380c11e0 2023-10-03T19:12:21.309 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.306+0000 7faf3659c640 1 --2- 172.21.15.45:0/3650870904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf380c11e0 0x7faf380c15b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faf380c2320 tx=0x7faf2801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd6d4f423130e7d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:21.309 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.306+0000 7faf3559a640 1 -- 172.21.15.45:0/3650870904 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf280a89f0 con 0x7faf380c11e0 2023-10-03T19:12:21.309 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.306+0000 7faf3559a640 1 -- 172.21.15.45:0/3650870904 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf280a8b50 con 0x7faf380c11e0 2023-10-03T19:12:21.309 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.306+0000 7faf3559a640 1 -- 172.21.15.45:0/3650870904 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf280b0440 con 0x7faf380c11e0 2023-10-03T19:12:21.311 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.306+0000 7faf3cbf1640 1 -- 172.21.15.45:0/3650870904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf380c11e0 msgr2=0x7faf380c15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:21.311 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.306+0000 7faf3cbf1640 1 --2- 172.21.15.45:0/3650870904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf380c11e0 0x7faf380c15b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faf380c2320 tx=0x7faf2801ecf0 comp rx=0 tx=0).stop 2023-10-03T19:12:21.311 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.306+0000 7faf3cbf1640 1 -- 172.21.15.45:0/3650870904 shutdown_connections 2023-10-03T19:12:21.312 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.306+0000 7faf3cbf1640 1 --2- 172.21.15.45:0/3650870904 >> v2:172.21.15.79:3300/0 conn(0x7faf3806bbe0 0x7faf380c0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:21.312 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.306+0000 7faf3cbf1640 1 --2- 172.21.15.45:0/3650870904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf380c11e0 0x7faf380c15b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:21.312 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.306+0000 7faf3cbf1640 1 -- 172.21.15.45:0/3650870904 >> 172.21.15.45:0/3650870904 conn(0x7faf380a6300 msgr2=0x7faf380a6700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:21.312 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.306+0000 7faf3cbf1640 1 -- 172.21.15.45:0/3650870904 shutdown_connections 2023-10-03T19:12:21.312 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.306+0000 7faf3cbf1640 1 -- 172.21.15.45:0/3650870904 wait complete. 2023-10-03T19:12:21.312 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.310+0000 7faf3cbf1640 1 Processor -- start 2023-10-03T19:12:21.312 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.310+0000 7faf3cbf1640 1 -- start start 2023-10-03T19:12:21.316 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.310+0000 7faf3cbf1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf3806ab20 0x7faf380bdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:21.316 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.310+0000 7faf3cbf1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf3806bbe0 0x7faf3814dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:21.316 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.310+0000 7faf3cbf1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf380c11e0 0x7faf381e3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:21.316 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.310+0000 7faf3cbf1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf380be0e0 con 0x7faf3806bbe0 2023-10-03T19:12:21.316 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.310+0000 7faf3cbf1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf380aa460 con 0x7faf380c11e0 2023-10-03T19:12:21.316 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.310+0000 7faf3cbf1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf380bd3a0 con 0x7faf3806ab20 2023-10-03T19:12:21.316 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.310+0000 7faf35d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf3806bbe0 0x7faf3814dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:21.317 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.310+0000 7faf35d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf3806bbe0 0x7faf3814dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49892/0 (socket says 172.21.15.45:49892) 2023-10-03T19:12:21.317 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.310+0000 7faf35d9b640 1 -- 172.21.15.45:0/1427109500 learned_addr learned my addr 172.21.15.45:0/1427109500 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:21.317 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.310+0000 7faf3659c640 1 --2- 172.21.15.45:0/1427109500 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf3806ab20 0x7faf380bdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:21.317 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.310+0000 7faf36d9d640 1 --2- 172.21.15.45:0/1427109500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf380c11e0 0x7faf381e3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:21.317 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.310+0000 7faf35d9b640 1 -- 172.21.15.45:0/1427109500 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf3806ab20 msgr2=0x7faf380bdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:21.317 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.310+0000 7faf35d9b640 1 --2- 172.21.15.45:0/1427109500 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf3806ab20 0x7faf380bdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:21.317 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.310+0000 7faf35d9b640 1 -- 172.21.15.45:0/1427109500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf380c11e0 msgr2=0x7faf381e3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:21.317 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.310+0000 7faf35d9b640 1 --2- 172.21.15.45:0/1427109500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf380c11e0 0x7faf381e3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:21.317 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.310+0000 7faf35d9b640 1 -- 172.21.15.45:0/1427109500 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf280094d0 con 0x7faf3806bbe0 2023-10-03T19:12:21.317 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.310+0000 7faf36d9d640 1 --2- 172.21.15.45:0/1427109500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf380c11e0 0x7faf381e3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:21.317 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.310+0000 7faf35d9b640 1 --2- 172.21.15.45:0/1427109500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf3806bbe0 0x7faf3814dbc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faf2000d800 tx=0x7faf2000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:21.318 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.310+0000 7faf2effd640 1 -- 172.21.15.45:0/1427109500 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2000b6c0 con 0x7faf3806bbe0 2023-10-03T19:12:21.318 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.310+0000 7faf2effd640 1 -- 172.21.15.45:0/1427109500 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2000b820 con 0x7faf3806bbe0 2023-10-03T19:12:21.318 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.310+0000 7faf3cbf1640 1 -- 172.21.15.45:0/1427109500 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf380c0e50 con 0x7faf3806bbe0 2023-10-03T19:12:21.318 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.310+0000 7faf2effd640 1 -- 172.21.15.45:0/1427109500 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2000bb90 con 0x7faf3806bbe0 2023-10-03T19:12:21.318 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.310+0000 7faf3cbf1640 1 -- 172.21.15.45:0/1427109500 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf3814c1f0 con 0x7faf3806bbe0 2023-10-03T19:12:21.318 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.310+0000 7faf3cbf1640 1 -- 172.21.15.45:0/1427109500 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf38152510 con 0x7faf3806bbe0 2023-10-03T19:12:21.318 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.310+0000 7faf2effd640 1 -- 172.21.15.45:0/1427109500 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 85602+0+0 (secure 0 0 0) 0x7faf2000bcf0 con 0x7faf3806bbe0 2023-10-03T19:12:21.318 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.314+0000 7faf2effd640 1 --2- 172.21.15.45:0/1427109500 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7faf180661f0 0x7faf180686a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:21.318 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.314+0000 7faf2effd640 1 -- 172.21.15.45:0/1427109500 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4846+0+0 (secure 0 0 0) 0x7faf20083c40 con 0x7faf3806bbe0 2023-10-03T19:12:21.318 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.314+0000 7faf3659c640 1 --2- 172.21.15.45:0/1427109500 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7faf180661f0 0x7faf180686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:21.321 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.314+0000 7faf3659c640 1 --2- 172.21.15.45:0/1427109500 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7faf180661f0 0x7faf180686a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faf280b2000 tx=0x7faf28008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:21.321 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.318+0000 7faf2effd640 1 -- 172.21.15.45:0/1427109500 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7faf2008a080 con 0x7faf3806bbe0 2023-10-03T19:12:21.470 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.466+0000 7faf3cbf1640 1 -- 172.21.15.45:0/1427109500 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf38073a60 con 0x7faf3806bbe0 2023-10-03T19:12:21.471 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.470+0000 7faf2effd640 1 -- 172.21.15.45:0/1427109500 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12691 (secure 0 0 0) 0x7faf200516f0 con 0x7faf3806bbe0 2023-10-03T19:12:21.472 INFO:teuthology.misc.health.smithi045.stdout: 2023-10-03T19:12:21.472 INFO:teuthology.misc.health.smithi045.stdout:{"epoch":15,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:12:21.282052+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:12:21.473 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.470+0000 7faf3cbf1640 1 -- 172.21.15.45:0/1427109500 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7faf180661f0 msgr2=0x7faf180686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:21.473 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.470+0000 7faf3cbf1640 1 --2- 172.21.15.45:0/1427109500 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7faf180661f0 0x7faf180686a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faf280b2000 tx=0x7faf28008040 comp rx=0 tx=0).stop 2023-10-03T19:12:21.473 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.470+0000 7faf3cbf1640 1 -- 172.21.15.45:0/1427109500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf3806bbe0 msgr2=0x7faf3814dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:21.473 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.470+0000 7faf3cbf1640 1 --2- 172.21.15.45:0/1427109500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf3806bbe0 0x7faf3814dbc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faf2000d800 tx=0x7faf2000dcc0 comp rx=0 tx=0).stop 2023-10-03T19:12:21.474 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.470+0000 7faf3cbf1640 1 -- 172.21.15.45:0/1427109500 shutdown_connections 2023-10-03T19:12:21.474 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.470+0000 7faf3cbf1640 1 --2- 172.21.15.45:0/1427109500 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7faf180661f0 0x7faf180686a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:21.474 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.470+0000 7faf3cbf1640 1 --2- 172.21.15.45:0/1427109500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf380c11e0 0x7faf381e3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:21.474 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.470+0000 7faf3cbf1640 1 --2- 172.21.15.45:0/1427109500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf3806bbe0 0x7faf3814dbc0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:21.474 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.470+0000 7faf3cbf1640 1 --2- 172.21.15.45:0/1427109500 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf3806ab20 0x7faf380bdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:21.474 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.470+0000 7faf3cbf1640 1 -- 172.21.15.45:0/1427109500 >> 172.21.15.45:0/1427109500 conn(0x7faf380a6300 msgr2=0x7faf380a66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:21.474 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.470+0000 7faf3cbf1640 1 -- 172.21.15.45:0/1427109500 shutdown_connections 2023-10-03T19:12:21.474 INFO:teuthology.misc.health.smithi045.stderr:2023-10-03T19:12:21.470+0000 7faf3cbf1640 1 -- 172.21.15.45:0/1427109500 wait complete. 2023-10-03T19:12:21.487 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-03T19:12:21.488 INFO:tasks.ceph:Creating RBD pool 2023-10-03T19:12:21.488 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-03T19:12:21.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd1a2d05640 1 Processor -- start 2023-10-03T19:12:21.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd1a2d05640 1 -- start start 2023-10-03T19:12:21.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd1a2d05640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd19c0c07b0 0x7fd19c0c0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:21.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd1a2d05640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd19c0a1c80 0x7fd19c14b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:21.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd1a2d05640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd19c0bc360 con 0x7fd19c0c1770 2023-10-03T19:12:21.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd1a2d05640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd19c0c1ed0 con 0x7fd19c0c07b0 2023-10-03T19:12:21.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd1a2d05640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c0c11b0 con 0x7fd19c0a1c80 2023-10-03T19:12:21.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd19bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd19c0c1770 0x7fd19c0bb990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52686/0 (socket says 172.21.15.45:52686) 2023-10-03T19:12:21.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd19bfff640 1 -- 172.21.15.45:0/1454072157 learned_addr learned my addr 172.21.15.45:0/1454072157 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:21.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd1a12a2640 1 --2- 172.21.15.45:0/1454072157 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd19c0a1c80 0x7fd19c14b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:21.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd1a0aa1640 1 --2- 172.21.15.45:0/1454072157 >> v2:172.21.15.79:3300/0 conn(0x7fd19c0c07b0 0x7fd19c0c0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:21.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd19b7fe640 1 -- 172.21.15.45:0/1454072157 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 910330019 0 0) 0x7fd19c0bc360 con 0x7fd19c0c1770 2023-10-03T19:12:21.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd19b7fe640 1 -- 172.21.15.45:0/1454072157 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd188003530 con 0x7fd19c0c1770 2023-10-03T19:12:21.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd19b7fe640 1 -- 172.21.15.45:0/1454072157 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 209930963 0 0) 0x7fd188003530 con 0x7fd19c0c1770 2023-10-03T19:12:21.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd19b7fe640 1 -- 172.21.15.45:0/1454072157 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd19c0a1c80 msgr2=0x7fd19c14b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:21.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd19b7fe640 1 --2- 172.21.15.45:0/1454072157 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd19c0a1c80 0x7fd19c14b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:21.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd19b7fe640 1 -- 172.21.15.45:0/1454072157 >> v2:172.21.15.79:3300/0 conn(0x7fd19c0c07b0 msgr2=0x7fd19c0c0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:21.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd19b7fe640 1 --2- 172.21.15.45:0/1454072157 >> v2:172.21.15.79:3300/0 conn(0x7fd19c0c07b0 0x7fd19c0c0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:21.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd19b7fe640 1 -- 172.21.15.45:0/1454072157 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19c1525e0 con 0x7fd19c0c1770 2023-10-03T19:12:21.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd19b7fe640 1 -- 172.21.15.45:0/1454072157 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fd184001680 con 0x7fd19c0c1770 2023-10-03T19:12:21.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd19b7fe640 1 -- 172.21.15.45:0/1454072157 >> v1:172.21.15.45:6789/0 conn(0x7fd19c0c1770 legacy=0x7fd19c0bb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:21.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd19b7fe640 1 --2- 172.21.15.45:0/1454072157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd188003980 0x7fd188003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:21.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd19b7fe640 1 --2- 172.21.15.45:0/1454072157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1880043b0 0x7fd188004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:21.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd19b7fe640 1 --2- 172.21.15.45:0/1454072157 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd19c0a1c80 0x7fd188004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:21.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd19b7fe640 1 -- 172.21.15.45:0/1454072157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c0c11b0 con 0x7fd188003980 2023-10-03T19:12:21.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd19b7fe640 1 -- 172.21.15.45:0/1454072157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18800b990 con 0x7fd1880043b0 2023-10-03T19:12:21.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd19b7fe640 1 -- 172.21.15.45:0/1454072157 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18800bad0 con 0x7fd19c0a1c80 2023-10-03T19:12:21.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd1a0aa1640 1 --2- 172.21.15.45:0/1454072157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd188003980 0x7fd188003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:21.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd19bfff640 1 --2- 172.21.15.45:0/1454072157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1880043b0 0x7fd188004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:21.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd1a12a2640 1 --2- 172.21.15.45:0/1454072157 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd19c0a1c80 0x7fd188004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:21.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd1a0aa1640 1 -- 172.21.15.45:0/1454072157 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd19c0a1c80 msgr2=0x7fd188004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:21.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd1a0aa1640 1 --2- 172.21.15.45:0/1454072157 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd19c0a1c80 0x7fd188004f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:21.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd1a0aa1640 1 -- 172.21.15.45:0/1454072157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1880043b0 msgr2=0x7fd188004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:21.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd1a0aa1640 1 --2- 172.21.15.45:0/1454072157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1880043b0 0x7fd188004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:21.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.598+0000 7fd1a0aa1640 1 -- 172.21.15.45:0/1454072157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd188003530 con 0x7fd188003980 2023-10-03T19:12:21.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.602+0000 7fd1a0aa1640 1 --2- 172.21.15.45:0/1454072157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd188003980 0x7fd188003d90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd194009fc0 tx=0x7fd19401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b87e6f780a5603 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:21.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.602+0000 7fd19b7fe640 1 -- 172.21.15.45:0/1454072157 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1940a5cb0 con 0x7fd188003980 2023-10-03T19:12:21.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.602+0000 7fd19b7fe640 1 -- 172.21.15.45:0/1454072157 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19400f040 con 0x7fd188003980 2023-10-03T19:12:21.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.602+0000 7fd19b7fe640 1 -- 172.21.15.45:0/1454072157 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1940ad680 con 0x7fd188003980 2023-10-03T19:12:21.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.602+0000 7fd1a2d05640 1 -- 172.21.15.45:0/1454072157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd188003980 msgr2=0x7fd188003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:21.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.602+0000 7fd1a2d05640 1 --2- 172.21.15.45:0/1454072157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd188003980 0x7fd188003d90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd194009fc0 tx=0x7fd19401cca0 comp rx=0 tx=0).stop 2023-10-03T19:12:21.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.602+0000 7fd1a12a2640 1 -- 172.21.15.45:0/1454072157 reap_dead start 2023-10-03T19:12:21.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.602+0000 7fd1a2d05640 1 -- 172.21.15.45:0/1454072157 shutdown_connections 2023-10-03T19:12:21.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.602+0000 7fd1a2d05640 1 -- 172.21.15.45:0/1454072157 >> 172.21.15.45:0/1454072157 conn(0x7fd19c0a4260 msgr2=0x7fd19c0a4660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:21.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.602+0000 7fd1a2d05640 1 -- 172.21.15.45:0/1454072157 shutdown_connections 2023-10-03T19:12:21.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.602+0000 7fd1a2d05640 1 -- 172.21.15.45:0/1454072157 wait complete. 2023-10-03T19:12:21.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.602+0000 7fd1a2d05640 1 Processor -- start 2023-10-03T19:12:21.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.602+0000 7fd1a2d05640 1 -- start start 2023-10-03T19:12:21.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.602+0000 7fd1a2d05640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd188003980 0x7fd19c149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:21.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.602+0000 7fd1a2d05640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd19c149f70 0x7fd19c149580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:21.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.602+0000 7fd1a2d05640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd19c151de0 0x7fd19c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:21.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.602+0000 7fd1a2d05640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c1e3120 con 0x7fd19c151de0 2023-10-03T19:12:21.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.602+0000 7fd1a2d05640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c14cee0 con 0x7fd188003980 2023-10-03T19:12:21.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.602+0000 7fd1a2d05640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c14fcd0 con 0x7fd19c149f70 2023-10-03T19:12:21.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.602+0000 7fd1a12a2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd19c151de0 0x7fd19c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:21.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.602+0000 7fd1a12a2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd19c151de0 0x7fd19c0a5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49918/0 (socket says 172.21.15.45:49918) 2023-10-03T19:12:21.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.602+0000 7fd1a12a2640 1 -- 172.21.15.45:0/2184655564 learned_addr learned my addr 172.21.15.45:0/2184655564 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:21.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.602+0000 7fd19bfff640 1 --2- 172.21.15.45:0/2184655564 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd19c149f70 0x7fd19c149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:21.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.602+0000 7fd1a0aa1640 1 --2- 172.21.15.45:0/2184655564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd188003980 0x7fd19c149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:21.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.606+0000 7fd1a12a2640 1 -- 172.21.15.45:0/2184655564 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd19c149f70 msgr2=0x7fd19c149580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:21.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.606+0000 7fd1a12a2640 1 --2- 172.21.15.45:0/2184655564 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd19c149f70 0x7fd19c149580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:21.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.606+0000 7fd1a12a2640 1 -- 172.21.15.45:0/2184655564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd188003980 msgr2=0x7fd19c149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:21.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.606+0000 7fd1a12a2640 1 --2- 172.21.15.45:0/2184655564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd188003980 0x7fd19c149040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:21.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.606+0000 7fd1a12a2640 1 -- 172.21.15.45:0/2184655564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19c0bc0a0 con 0x7fd19c151de0 2023-10-03T19:12:21.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.606+0000 7fd1a12a2640 1 --2- 172.21.15.45:0/2184655564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd19c151de0 0x7fd19c0a5870 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd19c1524f0 tx=0x7fd18c010850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:21.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.606+0000 7fd1997fa640 1 -- 172.21.15.45:0/2184655564 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c0143f0 con 0x7fd19c151de0 2023-10-03T19:12:21.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.606+0000 7fd1997fa640 1 -- 172.21.15.45:0/2184655564 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18c014570 con 0x7fd19c151de0 2023-10-03T19:12:21.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.606+0000 7fd1a2d05640 1 -- 172.21.15.45:0/2184655564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd19c1528c0 con 0x7fd19c151de0 2023-10-03T19:12:21.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.606+0000 7fd1997fa640 1 -- 172.21.15.45:0/2184655564 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c014920 con 0x7fd19c151de0 2023-10-03T19:12:21.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.606+0000 7fd1a2d05640 1 -- 172.21.15.45:0/2184655564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd19c14e540 con 0x7fd19c151de0 2023-10-03T19:12:21.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.606+0000 7fd1a2d05640 1 -- 172.21.15.45:0/2184655564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd19c0bfe20 con 0x7fd19c151de0 2023-10-03T19:12:21.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.606+0000 7fd1997fa640 1 -- 172.21.15.45:0/2184655564 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 85602+0+0 (secure 0 0 0) 0x7fd18c014a80 con 0x7fd19c151de0 2023-10-03T19:12:21.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.606+0000 7fd1997fa640 1 --2- 172.21.15.45:0/2184655564 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd17c066220 0x7fd17c0686d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:21.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.606+0000 7fd1997fa640 1 -- 172.21.15.45:0/2184655564 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4846+0+0 (secure 0 0 0) 0x7fd18c0831e0 con 0x7fd19c151de0 2023-10-03T19:12:21.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.606+0000 7fd1a0aa1640 1 --2- 172.21.15.45:0/2184655564 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd17c066220 0x7fd17c0686d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:21.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.606+0000 7fd1a0aa1640 1 --2- 172.21.15.45:0/2184655564 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd17c066220 0x7fd17c0686d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd1940af000 tx=0x7fd1940a7040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:21.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.610+0000 7fd1997fa640 1 -- 172.21.15.45:0/2184655564 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd18c050c90 con 0x7fd19c151de0 2023-10-03T19:12:21.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:21.758+0000 7fd1a2d05640 1 -- 172.21.15.45:0/2184655564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fd19c1e6690 con 0x7fd19c151de0 2023-10-03T19:12:22.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.310+0000 7fd1997fa640 1 -- 172.21.15.45:0/2184655564 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7fd19c1e6690 con 0x7fd19c151de0 2023-10-03T19:12:22.315 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'rbd' created 2023-10-03T19:12:22.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.318+0000 7fd1a2d05640 1 -- 172.21.15.45:0/2184655564 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd17c066220 msgr2=0x7fd17c0686d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:22.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.318+0000 7fd1a2d05640 1 --2- 172.21.15.45:0/2184655564 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd17c066220 0x7fd17c0686d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd1940af000 tx=0x7fd1940a7040 comp rx=0 tx=0).stop 2023-10-03T19:12:22.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.318+0000 7fd1a2d05640 1 -- 172.21.15.45:0/2184655564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd19c151de0 msgr2=0x7fd19c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:22.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.318+0000 7fd1a2d05640 1 --2- 172.21.15.45:0/2184655564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd19c151de0 0x7fd19c0a5870 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd19c1524f0 tx=0x7fd18c010850 comp rx=0 tx=0).stop 2023-10-03T19:12:22.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.318+0000 7fd1a2d05640 1 -- 172.21.15.45:0/2184655564 shutdown_connections 2023-10-03T19:12:22.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.318+0000 7fd1a2d05640 1 --2- 172.21.15.45:0/2184655564 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd17c066220 0x7fd17c0686d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:22.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.318+0000 7fd1a2d05640 1 --2- 172.21.15.45:0/2184655564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd19c151de0 0x7fd19c0a5870 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:22.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.318+0000 7fd1a2d05640 1 --2- 172.21.15.45:0/2184655564 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd19c149f70 0x7fd19c149580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:22.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.318+0000 7fd1a2d05640 1 --2- 172.21.15.45:0/2184655564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd188003980 0x7fd19c149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:22.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.318+0000 7fd1a2d05640 1 -- 172.21.15.45:0/2184655564 >> 172.21.15.45:0/2184655564 conn(0x7fd19c0a4260 msgr2=0x7fd19c14dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:22.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.318+0000 7fd1a2d05640 1 -- 172.21.15.45:0/2184655564 shutdown_connections 2023-10-03T19:12:22.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.318+0000 7fd1a2d05640 1 -- 172.21.15.45:0/2184655564 wait complete. 2023-10-03T19:12:22.344 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-03T19:12:22.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.478+0000 7fb514196640 1 Processor -- start 2023-10-03T19:12:22.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.478+0000 7fb514196640 1 -- start start 2023-10-03T19:12:22.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.482+0000 7fb514196640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb50c0c14f0 0x7fb50c14f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:22.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.482+0000 7fb514196640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb50c0c2780 0x7fb50c069b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:22.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.482+0000 7fb514196640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb50c0bf200 con 0x7fb50c14e840 2023-10-03T19:12:22.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.482+0000 7fb514196640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb50c0c0c60 con 0x7fb50c0c2780 2023-10-03T19:12:22.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.482+0000 7fb514196640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c0c0ed0 con 0x7fb50c0c14f0 2023-10-03T19:12:22.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.482+0000 7fb511f32640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb50c0c14f0 0x7fb50c14f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:22.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.482+0000 7fb511f32640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb50c0c14f0 0x7fb50c14f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:38734/0 (socket says 172.21.15.45:38734) 2023-10-03T19:12:22.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.482+0000 7fb511f32640 1 -- 172.21.15.45:0/950958491 learned_addr learned my addr 172.21.15.45:0/950958491 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:22.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.482+0000 7fb511731640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb50c0c2780 0x7fb50c069b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:22.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.482+0000 7fb511f32640 1 -- 172.21.15.45:0/950958491 >> v2:172.21.15.79:3300/0 conn(0x7fb50c0c2780 msgr2=0x7fb50c069b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:22.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.482+0000 7fb511f32640 1 --2- 172.21.15.45:0/950958491 >> v2:172.21.15.79:3300/0 conn(0x7fb50c0c2780 0x7fb50c069b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:22.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.482+0000 7fb511f32640 1 -- 172.21.15.45:0/950958491 >> v1:172.21.15.79:6789/0 conn(0x7fb50c14e840 legacy=0x7fb50c0a97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:22.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.482+0000 7fb511f32640 1 -- 172.21.15.45:0/950958491 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb50c0bf450 con 0x7fb50c0c14f0 2023-10-03T19:12:22.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.482+0000 7fb511f32640 1 --2- 172.21.15.45:0/950958491 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb50c0c14f0 0x7fb50c14f3c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb508009870 tx=0x7fb50801c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac1bc44cf57ce2fd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:22.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.482+0000 7fb510f30640 1 -- 172.21.15.45:0/950958491 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5080ab600 con 0x7fb50c0c14f0 2023-10-03T19:12:22.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.482+0000 7fb510f30640 1 -- 172.21.15.45:0/950958491 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5080a7050 con 0x7fb50c0c14f0 2023-10-03T19:12:22.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.482+0000 7fb510f30640 1 -- 172.21.15.45:0/950958491 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5080ab980 con 0x7fb50c0c14f0 2023-10-03T19:12:22.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.482+0000 7fb514196640 1 -- 172.21.15.45:0/950958491 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb50c0c14f0 msgr2=0x7fb50c14f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:22.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.482+0000 7fb514196640 1 --2- 172.21.15.45:0/950958491 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb50c0c14f0 0x7fb50c14f3c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb508009870 tx=0x7fb50801c420 comp rx=0 tx=0).stop 2023-10-03T19:12:22.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb514196640 1 -- 172.21.15.45:0/950958491 shutdown_connections 2023-10-03T19:12:22.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb514196640 1 --2- 172.21.15.45:0/950958491 >> v2:172.21.15.79:3300/0 conn(0x7fb50c0c2780 0x7fb50c069b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:22.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb514196640 1 --2- 172.21.15.45:0/950958491 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb50c0c14f0 0x7fb50c14f3c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:22.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb514196640 1 -- 172.21.15.45:0/950958491 >> 172.21.15.45:0/950958491 conn(0x7fb50c0a63d0 msgr2=0x7fb50c0a67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:22.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb514196640 1 -- 172.21.15.45:0/950958491 shutdown_connections 2023-10-03T19:12:22.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb514196640 1 -- 172.21.15.45:0/950958491 wait complete. 2023-10-03T19:12:22.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb514196640 1 Processor -- start 2023-10-03T19:12:22.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb514196640 1 -- start start 2023-10-03T19:12:22.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb514196640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb50c0c14f0 0x7fb50c14ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:22.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb514196640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb50c0c2780 0x7fb50c14b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:22.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb514196640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb50c14e840 0x7fb50c1eabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:22.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb514196640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c1504b0 con 0x7fb50c0c2780 2023-10-03T19:12:22.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb514196640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c1ea730 con 0x7fb50c14e840 2023-10-03T19:12:22.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb514196640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c14bde0 con 0x7fb50c0c14f0 2023-10-03T19:12:22.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb511731640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb50c0c2780 0x7fb50c14b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:22.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb511731640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb50c0c2780 0x7fb50c14b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49926/0 (socket says 172.21.15.45:49926) 2023-10-03T19:12:22.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb511731640 1 -- 172.21.15.45:0/446957917 learned_addr learned my addr 172.21.15.45:0/446957917 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:22.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb511f32640 1 --2- 172.21.15.45:0/446957917 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb50c0c14f0 0x7fb50c14ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:22.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb512733640 1 --2- 172.21.15.45:0/446957917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb50c14e840 0x7fb50c1eabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:22.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb511731640 1 -- 172.21.15.45:0/446957917 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb50c0c14f0 msgr2=0x7fb50c14ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:22.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb511731640 1 --2- 172.21.15.45:0/446957917 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb50c0c14f0 0x7fb50c14ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:22.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb511731640 1 -- 172.21.15.45:0/446957917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb50c14e840 msgr2=0x7fb50c1eabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:22.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb511731640 1 --2- 172.21.15.45:0/446957917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb50c14e840 0x7fb50c1eabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:22.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb511731640 1 -- 172.21.15.45:0/446957917 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5080094d0 con 0x7fb50c0c2780 2023-10-03T19:12:22.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb512733640 1 --2- 172.21.15.45:0/446957917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb50c14e840 0x7fb50c1eabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:12:22.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb511731640 1 --2- 172.21.15.45:0/446957917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb50c0c2780 0x7fb50c14b8a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00e930 tx=0x7fb4fc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:22.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb5027fc640 1 -- 172.21.15.45:0/446957917 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc009690 con 0x7fb50c0c2780 2023-10-03T19:12:22.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb5027fc640 1 -- 172.21.15.45:0/446957917 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4fc00ca00 con 0x7fb50c0c2780 2023-10-03T19:12:22.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb514196640 1 -- 172.21.15.45:0/446957917 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb50c0c1a50 con 0x7fb50c0c2780 2023-10-03T19:12:22.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb5027fc640 1 -- 172.21.15.45:0/446957917 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc00cd70 con 0x7fb50c0c2780 2023-10-03T19:12:22.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb514196640 1 -- 172.21.15.45:0/446957917 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb50c0c18c0 con 0x7fb50c0c2780 2023-10-03T19:12:22.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.486+0000 7fb514196640 1 -- 172.21.15.45:0/446957917 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb50c06a080 con 0x7fb50c0c2780 2023-10-03T19:12:22.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.490+0000 7fb5027fc640 1 -- 172.21.15.45:0/446957917 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 85602+0+0 (secure 0 0 0) 0x7fb4fc013470 con 0x7fb50c0c2780 2023-10-03T19:12:22.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.490+0000 7fb5027fc640 1 --2- 172.21.15.45:0/446957917 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb4f00661f0 0x7fb4f00686a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:22.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.490+0000 7fb5027fc640 1 -- 172.21.15.45:0/446957917 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5199+0+0 (secure 0 0 0) 0x7fb4fc0841f0 con 0x7fb50c0c2780 2023-10-03T19:12:22.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.490+0000 7fb511f32640 1 --2- 172.21.15.45:0/446957917 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb4f00661f0 0x7fb4f00686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:22.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.490+0000 7fb511f32640 1 --2- 172.21.15.45:0/446957917 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb4f00661f0 0x7fb4f00686a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb5080ad000 tx=0x7fb508008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:22.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.494+0000 7fb5027fc640 1 -- 172.21.15.45:0/446957917 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb4fc051d00 con 0x7fb50c0c2780 2023-10-03T19:12:22.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:22.654+0000 7fb514196640 1 -- 172.21.15.45:0/446957917 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb50c1ea8a0 con 0x7fb50c0c2780 2023-10-03T19:12:23.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.330+0000 7fb5027fc640 1 -- 172.21.15.45:0/446957917 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb4fc0520d0 con 0x7fb50c0c2780 2023-10-03T19:12:23.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.330+0000 7fb5027fc640 1 -- 172.21.15.45:0/446957917 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7fb4fc06f340 con 0x7fb50c0c2780 2023-10-03T19:12:23.335 INFO:teuthology.orchestra.run.smithi045.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-03T19:12:23.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.338+0000 7fb514196640 1 -- 172.21.15.45:0/446957917 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb4f00661f0 msgr2=0x7fb4f00686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:23.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.338+0000 7fb514196640 1 --2- 172.21.15.45:0/446957917 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb4f00661f0 0x7fb4f00686a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb5080ad000 tx=0x7fb508008040 comp rx=0 tx=0).stop 2023-10-03T19:12:23.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.338+0000 7fb514196640 1 -- 172.21.15.45:0/446957917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb50c0c2780 msgr2=0x7fb50c14b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:23.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.338+0000 7fb514196640 1 --2- 172.21.15.45:0/446957917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb50c0c2780 0x7fb50c14b8a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00e930 tx=0x7fb4fc00edf0 comp rx=0 tx=0).stop 2023-10-03T19:12:23.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.338+0000 7fb514196640 1 -- 172.21.15.45:0/446957917 shutdown_connections 2023-10-03T19:12:23.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.338+0000 7fb514196640 1 --2- 172.21.15.45:0/446957917 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb4f00661f0 0x7fb4f00686a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:23.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.338+0000 7fb514196640 1 --2- 172.21.15.45:0/446957917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb50c14e840 0x7fb50c1eabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:23.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.338+0000 7fb514196640 1 --2- 172.21.15.45:0/446957917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb50c0c2780 0x7fb50c14b8a0 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00e930 tx=0x7fb4fc00edf0 comp rx=0 tx=0).stop 2023-10-03T19:12:23.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.338+0000 7fb514196640 1 --2- 172.21.15.45:0/446957917 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb50c0c14f0 0x7fb50c14ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:23.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.338+0000 7fb514196640 1 -- 172.21.15.45:0/446957917 >> 172.21.15.45:0/446957917 conn(0x7fb50c0a63d0 msgr2=0x7fb50c14d850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:23.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.338+0000 7fb514196640 1 -- 172.21.15.45:0/446957917 shutdown_connections 2023-10-03T19:12:23.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.338+0000 7fb514196640 1 -- 172.21.15.45:0/446957917 wait complete. 2023-10-03T19:12:23.362 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-03T19:12:23.362 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-03T19:12:23.362 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-03T19:12:23.365 INFO:tasks.ceph.mds.a:Started 2023-10-03T19:12:23.365 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-03T19:12:23.365 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-03T19:12:23.367 INFO:tasks.ceph.mds.c:Started 2023-10-03T19:12:23.367 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-03T19:12:23.367 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-03T19:12:23.369 INFO:tasks.ceph.mds.b:Started 2023-10-03T19:12:23.369 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-03T19:12:23.370 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:12:23.441 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-10-03T19:12:23.441 INFO:tasks.ceph.mds.b.smithi079.stdout:starting mds.b at 2023-10-03T19:12:23.442 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-10-03T19:12:23.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.486+0000 7f85624c9640 1 Processor -- start 2023-10-03T19:12:23.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.486+0000 7f85624c9640 1 -- start start 2023-10-03T19:12:23.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.486+0000 7f85624c9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f855c14bb80 0x7f855c0be700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:23.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.486+0000 7f85624c9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f855c0bc900 0x7f855c152460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:23.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.486+0000 7f85624c9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f855c0c0fd0 con 0x7f855c0bec40 2023-10-03T19:12:23.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.486+0000 7f85624c9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f855c0bce20 con 0x7f855c14bb80 2023-10-03T19:12:23.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.486+0000 7f85624c9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f855c14bf50 con 0x7f855c0bc900 2023-10-03T19:12:23.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.486+0000 7f855bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f855c14bb80 0x7f855c0be700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:23.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.486+0000 7f855b7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f855c0bec40 0x7f855c151d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52700/0 (socket says 172.21.15.45:52700) 2023-10-03T19:12:23.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.486+0000 7f855b7fe640 1 -- 172.21.15.45:0/2196964016 learned_addr learned my addr 172.21.15.45:0/2196964016 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:23.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.486+0000 7f855bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f855c14bb80 0x7f855c0be700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49956/0 (socket says 172.21.15.45:49956) 2023-10-03T19:12:23.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.486+0000 7f8560a66640 1 --2- 172.21.15.45:0/2196964016 >> v2:172.21.15.79:3300/0 conn(0x7f855c0bc900 0x7f855c152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:23.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.486+0000 7f855bfff640 1 -- 172.21.15.45:0/2196964016 >> v2:172.21.15.79:3300/0 conn(0x7f855c0bc900 msgr2=0x7f855c152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:23.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.486+0000 7f855bfff640 1 --2- 172.21.15.45:0/2196964016 >> v2:172.21.15.79:3300/0 conn(0x7f855c0bc900 0x7f855c152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:23.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.486+0000 7f855bfff640 1 -- 172.21.15.45:0/2196964016 >> v1:172.21.15.45:6789/0 conn(0x7f855c0bec40 legacy=0x7f855c151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:23.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.486+0000 7f855bfff640 1 -- 172.21.15.45:0/2196964016 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855c0c0980 con 0x7f855c14bb80 2023-10-03T19:12:23.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.486+0000 7f855affd640 1 -- 172.21.15.45:0/2196964016 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2507815685 0 0) 0x7f855c0c0fd0 con 0x7f855c0bec40 2023-10-03T19:12:23.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.490+0000 7f855bfff640 1 --2- 172.21.15.45:0/2196964016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f855c14bb80 0x7f855c0be700 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f855c0c1520 tx=0x7f854c01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bbaf231adf9f68d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:23.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.490+0000 7f855affd640 1 -- 172.21.15.45:0/2196964016 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c0a8950 con 0x7f855c14bb80 2023-10-03T19:12:23.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.490+0000 7f855affd640 1 -- 172.21.15.45:0/2196964016 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c0a8ab0 con 0x7f855c14bb80 2023-10-03T19:12:23.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.490+0000 7f855affd640 1 -- 172.21.15.45:0/2196964016 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c0a8e40 con 0x7f855c14bb80 2023-10-03T19:12:23.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.490+0000 7f85624c9640 1 -- 172.21.15.45:0/2196964016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f855c14bb80 msgr2=0x7f855c0be700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:23.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.490+0000 7f85624c9640 1 --2- 172.21.15.45:0/2196964016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f855c14bb80 0x7f855c0be700 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f855c0c1520 tx=0x7f854c01ec50 comp rx=0 tx=0).stop 2023-10-03T19:12:23.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.490+0000 7f85624c9640 1 -- 172.21.15.45:0/2196964016 shutdown_connections 2023-10-03T19:12:23.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.490+0000 7f85624c9640 1 --2- 172.21.15.45:0/2196964016 >> v2:172.21.15.79:3300/0 conn(0x7f855c0bc900 0x7f855c152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:23.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.490+0000 7f85624c9640 1 --2- 172.21.15.45:0/2196964016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f855c14bb80 0x7f855c0be700 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:23.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.490+0000 7f85624c9640 1 -- 172.21.15.45:0/2196964016 >> 172.21.15.45:0/2196964016 conn(0x7f855c0c2200 msgr2=0x7f855c0bdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:23.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.490+0000 7f85624c9640 1 -- 172.21.15.45:0/2196964016 shutdown_connections 2023-10-03T19:12:23.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.490+0000 7f85624c9640 1 -- 172.21.15.45:0/2196964016 wait complete. 2023-10-03T19:12:23.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.490+0000 7f85624c9640 1 Processor -- start 2023-10-03T19:12:23.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.490+0000 7f85624c9640 1 -- start start 2023-10-03T19:12:23.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.490+0000 7f85624c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f855c0bc900 0x7f855c0ba4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:23.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.490+0000 7f85624c9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f855c0bec40 0x7f855c06d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:23.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.490+0000 7f85624c9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f855c14bb80 0x7f855c0a6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:23.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.490+0000 7f85624c9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c070f30 con 0x7f855c0bc900 2023-10-03T19:12:23.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.490+0000 7f85624c9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c0b8ae0 con 0x7f855c0bec40 2023-10-03T19:12:23.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.490+0000 7f85624c9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855c0ba9e0 con 0x7f855c14bb80 2023-10-03T19:12:23.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.490+0000 7f855bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f855c0bc900 0x7f855c0ba4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:23.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.490+0000 7f855bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f855c0bc900 0x7f855c0ba4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49972/0 (socket says 172.21.15.45:49972) 2023-10-03T19:12:23.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.490+0000 7f855bfff640 1 -- 172.21.15.45:0/3493831782 learned_addr learned my addr 172.21.15.45:0/3493831782 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:23.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.490+0000 7f8560a66640 1 --2- 172.21.15.45:0/3493831782 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f855c14bb80 0x7f855c0a6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:23.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.490+0000 7f855b7fe640 1 --2- 172.21.15.45:0/3493831782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f855c0bec40 0x7f855c06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:23.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.490+0000 7f855bfff640 1 -- 172.21.15.45:0/3493831782 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f855c14bb80 msgr2=0x7f855c0a6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:23.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.490+0000 7f855bfff640 1 --2- 172.21.15.45:0/3493831782 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f855c14bb80 0x7f855c0a6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:23.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.490+0000 7f855bfff640 1 -- 172.21.15.45:0/3493831782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f855c0bec40 msgr2=0x7f855c06d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:23.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.490+0000 7f855bfff640 1 --2- 172.21.15.45:0/3493831782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f855c0bec40 0x7f855c06d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:23.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.490+0000 7f855bfff640 1 -- 172.21.15.45:0/3493831782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854c009420 con 0x7f855c0bc900 2023-10-03T19:12:23.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.494+0000 7f855bfff640 1 --2- 172.21.15.45:0/3493831782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f855c0bc900 0x7f855c0ba4a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f854c0b3040 tx=0x7f854c01b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:23.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.494+0000 7f8558ff9640 1 -- 172.21.15.45:0/3493831782 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c0b0df0 con 0x7f855c0bc900 2023-10-03T19:12:23.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.494+0000 7f8558ff9640 1 -- 172.21.15.45:0/3493831782 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c0b9410 con 0x7f855c0bc900 2023-10-03T19:12:23.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.494+0000 7f85624c9640 1 -- 172.21.15.45:0/3493831782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855c1529a0 con 0x7f855c0bc900 2023-10-03T19:12:23.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.494+0000 7f8558ff9640 1 -- 172.21.15.45:0/3493831782 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c0b97c0 con 0x7f855c0bc900 2023-10-03T19:12:23.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.494+0000 7f85624c9640 1 -- 172.21.15.45:0/3493831782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855c0c0c60 con 0x7f855c0bc900 2023-10-03T19:12:23.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.494+0000 7f85624c9640 1 -- 172.21.15.45:0/3493831782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855c0c03f0 con 0x7f855c0bc900 2023-10-03T19:12:23.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.494+0000 7f8558ff9640 1 -- 172.21.15.45:0/3493831782 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f854c0b7040 con 0x7f855c0bc900 2023-10-03T19:12:23.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.494+0000 7f8558ff9640 1 --2- 172.21.15.45:0/3493831782 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8548066280 0x7f8548068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:23.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.494+0000 7f8558ff9640 1 -- 172.21.15.45:0/3493831782 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f854c121420 con 0x7f855c0bc900 2023-10-03T19:12:23.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.494+0000 7f855b7fe640 1 --2- 172.21.15.45:0/3493831782 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8548066280 0x7f8548068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:23.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.494+0000 7f855b7fe640 1 --2- 172.21.15.45:0/3493831782 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8548066280 0x7f8548068730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f855c0a4790 tx=0x7f8550007d60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:23.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.498+0000 7f8558ff9640 1 -- 172.21.15.45:0/3493831782 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f854c0eec90 con 0x7f855c0bc900 2023-10-03T19:12:23.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.654+0000 7f85624c9640 1 -- 172.21.15.45:0/3493831782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f855c04de80 con 0x7f855c0bc900 2023-10-03T19:12:23.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.662+0000 7f8558ff9640 1 -- 172.21.15.45:0/3493831782 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+14601 (secure 0 0 0) 0x7f854c0f22b0 con 0x7f855c0bc900 2023-10-03T19:12:23.665 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:23.666 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":17,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:12:23.310059+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:12:23.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.666+0000 7f85624c9640 1 -- 172.21.15.45:0/3493831782 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8548066280 msgr2=0x7f8548068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:23.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.666+0000 7f85624c9640 1 --2- 172.21.15.45:0/3493831782 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8548066280 0x7f8548068730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f855c0a4790 tx=0x7f8550007d60 comp rx=0 tx=0).stop 2023-10-03T19:12:23.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.666+0000 7f85624c9640 1 -- 172.21.15.45:0/3493831782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f855c0bc900 msgr2=0x7f855c0ba4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:23.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.666+0000 7f85624c9640 1 --2- 172.21.15.45:0/3493831782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f855c0bc900 0x7f855c0ba4a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f854c0b3040 tx=0x7f854c01b9f0 comp rx=0 tx=0).stop 2023-10-03T19:12:23.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.666+0000 7f85624c9640 1 -- 172.21.15.45:0/3493831782 shutdown_connections 2023-10-03T19:12:23.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.666+0000 7f85624c9640 1 --2- 172.21.15.45:0/3493831782 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8548066280 0x7f8548068730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:23.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.666+0000 7f85624c9640 1 --2- 172.21.15.45:0/3493831782 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f855c14bb80 0x7f855c0a6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:23.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.666+0000 7f85624c9640 1 --2- 172.21.15.45:0/3493831782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f855c0bec40 0x7f855c06d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:23.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.666+0000 7f85624c9640 1 --2- 172.21.15.45:0/3493831782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f855c0bc900 0x7f855c0ba4a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:23.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.666+0000 7f85624c9640 1 -- 172.21.15.45:0/3493831782 >> 172.21.15.45:0/3493831782 conn(0x7f855c0c2200 msgr2=0x7f855c0b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:23.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.666+0000 7f85624c9640 1 -- 172.21.15.45:0/3493831782 shutdown_connections 2023-10-03T19:12:23.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.666+0000 7f85624c9640 1 -- 172.21.15.45:0/3493831782 wait complete. 2023-10-03T19:12:23.684 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:12:23.685 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:12:23.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.802+0000 7f9fef9eb640 1 Processor -- start 2023-10-03T19:12:23.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.802+0000 7f9fef9eb640 1 -- start start 2023-10-03T19:12:23.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.806+0000 7f9fef9eb640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9fe8148540 0x7f9fe80bb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:23.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.806+0000 7f9fef9eb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9fe80bb5a0 0x7f9fe814f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:23.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.806+0000 7f9fef9eb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe80bcf80 con 0x7f9fe806d630 2023-10-03T19:12:23.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.806+0000 7f9fef9eb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe8152b50 con 0x7f9fe80bb5a0 2023-10-03T19:12:23.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.806+0000 7f9fef9eb640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe814e550 con 0x7f9fe8148540 2023-10-03T19:12:23.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.806+0000 7f9fecf86640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9fe806d630 0x7f9fe814e9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52714/0 (socket says 172.21.15.45:52714) 2023-10-03T19:12:23.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.806+0000 7f9fedf88640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9fe80bb5a0 0x7f9fe814f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:23.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.806+0000 7f9fecf86640 1 -- 172.21.15.45:0/1337771210 learned_addr learned my addr 172.21.15.45:0/1337771210 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:23.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.806+0000 7f9fed787640 1 --2- 172.21.15.45:0/1337771210 >> v2:172.21.15.79:3300/0 conn(0x7f9fe8148540 0x7f9fe80bb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:23.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.806+0000 7f9fedf88640 1 -- 172.21.15.45:0/1337771210 >> v2:172.21.15.79:3300/0 conn(0x7f9fe8148540 msgr2=0x7f9fe80bb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:23.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.806+0000 7f9fedf88640 1 --2- 172.21.15.45:0/1337771210 >> v2:172.21.15.79:3300/0 conn(0x7f9fe8148540 0x7f9fe80bb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:23.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.806+0000 7f9fedf88640 1 -- 172.21.15.45:0/1337771210 >> v1:172.21.15.45:6789/0 conn(0x7f9fe806d630 legacy=0x7f9fe814e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:23.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.806+0000 7f9fedf88640 1 -- 172.21.15.45:0/1337771210 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe80bd260 con 0x7f9fe80bb5a0 2023-10-03T19:12:23.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.806+0000 7f9fe7fff640 1 -- 172.21.15.45:0/1337771210 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 462208614 0 0) 0x7f9fe80bcf80 con 0x7f9fe806d630 2023-10-03T19:12:23.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.806+0000 7f9fedf88640 1 --2- 172.21.15.45:0/1337771210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fe80bb5a0 0x7f9fe814f0b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9fe80bd960 tx=0x7f9fe001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f563024898df007 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:23.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.806+0000 7f9fe7fff640 1 -- 172.21.15.45:0/1337771210 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe00a58d0 con 0x7f9fe80bb5a0 2023-10-03T19:12:23.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.806+0000 7f9fe7fff640 1 -- 172.21.15.45:0/1337771210 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe00a5a30 con 0x7f9fe80bb5a0 2023-10-03T19:12:23.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.806+0000 7f9fe7fff640 1 -- 172.21.15.45:0/1337771210 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe00a5dc0 con 0x7f9fe80bb5a0 2023-10-03T19:12:23.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fef9eb640 1 -- 172.21.15.45:0/1337771210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fe80bb5a0 msgr2=0x7f9fe814f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:23.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fef9eb640 1 --2- 172.21.15.45:0/1337771210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fe80bb5a0 0x7f9fe814f0b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9fe80bd960 tx=0x7f9fe001c8e0 comp rx=0 tx=0).stop 2023-10-03T19:12:23.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fef9eb640 1 -- 172.21.15.45:0/1337771210 shutdown_connections 2023-10-03T19:12:23.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fef9eb640 1 --2- 172.21.15.45:0/1337771210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fe80bb5a0 0x7f9fe814f0b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:23.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fef9eb640 1 --2- 172.21.15.45:0/1337771210 >> v2:172.21.15.79:3300/0 conn(0x7f9fe8148540 0x7f9fe80bb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:23.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fef9eb640 1 -- 172.21.15.45:0/1337771210 >> 172.21.15.45:0/1337771210 conn(0x7f9fe80a20d0 msgr2=0x7f9fe80a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:23.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fef9eb640 1 -- 172.21.15.45:0/1337771210 shutdown_connections 2023-10-03T19:12:23.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fef9eb640 1 -- 172.21.15.45:0/1337771210 wait complete. 2023-10-03T19:12:23.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fef9eb640 1 Processor -- start 2023-10-03T19:12:23.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fef9eb640 1 -- start start 2023-10-03T19:12:23.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fef9eb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fe806d630 0x7f9fe8150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:23.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fef9eb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fe80bb5a0 0x7f9fe81e6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:23.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fef9eb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fe8148540 0x7f9fe8144240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:23.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fef9eb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe814a9a0 con 0x7f9fe80bb5a0 2023-10-03T19:12:23.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fef9eb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe80a4700 con 0x7f9fe806d630 2023-10-03T19:12:23.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fef9eb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe80a5fb0 con 0x7f9fe8148540 2023-10-03T19:12:23.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fecf86640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fe80bb5a0 0x7f9fe81e6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:23.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fecf86640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fe80bb5a0 0x7f9fe81e6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49988/0 (socket says 172.21.15.45:49988) 2023-10-03T19:12:23.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fecf86640 1 -- 172.21.15.45:0/4055465944 learned_addr learned my addr 172.21.15.45:0/4055465944 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:23.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fed787640 1 --2- 172.21.15.45:0/4055465944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fe806d630 0x7f9fe8150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:23.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fedf88640 1 --2- 172.21.15.45:0/4055465944 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fe8148540 0x7f9fe8144240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:23.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fecf86640 1 -- 172.21.15.45:0/4055465944 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fe8148540 msgr2=0x7f9fe8144240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:23.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fecf86640 1 --2- 172.21.15.45:0/4055465944 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fe8148540 0x7f9fe8144240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:23.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fecf86640 1 -- 172.21.15.45:0/4055465944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fe806d630 msgr2=0x7f9fe8150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:23.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fecf86640 1 --2- 172.21.15.45:0/4055465944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fe806d630 0x7f9fe8150280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:23.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fecf86640 1 -- 172.21.15.45:0/4055465944 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe0009a70 con 0x7f9fe80bb5a0 2023-10-03T19:12:23.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fecf86640 1 --2- 172.21.15.45:0/4055465944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fe80bb5a0 0x7f9fe81e6430 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc00c4b0 tx=0x7f9fdc00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:23.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fe5ffb640 1 -- 172.21.15.45:0/4055465944 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc0074e0 con 0x7f9fe80bb5a0 2023-10-03T19:12:23.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fe5ffb640 1 -- 172.21.15.45:0/4055465944 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fdc007660 con 0x7f9fe80bb5a0 2023-10-03T19:12:23.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fef9eb640 1 -- 172.21.15.45:0/4055465944 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe80bdda0 con 0x7f9fe80bb5a0 2023-10-03T19:12:23.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fe5ffb640 1 -- 172.21.15.45:0/4055465944 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc004a30 con 0x7f9fe80bb5a0 2023-10-03T19:12:23.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.810+0000 7f9fef9eb640 1 -- 172.21.15.45:0/4055465944 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe80bdc10 con 0x7f9fe80bb5a0 2023-10-03T19:12:23.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.814+0000 7f9fef9eb640 1 -- 172.21.15.45:0/4055465944 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe8152350 con 0x7f9fe80bb5a0 2023-10-03T19:12:23.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.814+0000 7f9fe5ffb640 1 -- 172.21.15.45:0/4055465944 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9fdc004b90 con 0x7f9fe80bb5a0 2023-10-03T19:12:23.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.814+0000 7f9fe5ffb640 1 --2- 172.21.15.45:0/4055465944 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9fd4066280 0x7f9fd4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:23.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.814+0000 7f9fe5ffb640 1 -- 172.21.15.45:0/4055465944 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9fdc083140 con 0x7f9fe80bb5a0 2023-10-03T19:12:23.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.814+0000 7f9fed787640 1 --2- 172.21.15.45:0/4055465944 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9fd4066280 0x7f9fd4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:23.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.814+0000 7f9fed787640 1 --2- 172.21.15.45:0/4055465944 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9fd4066280 0x7f9fd4068730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9fd80079c0 tx=0x7f9fd8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:23.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.818+0000 7f9fe5ffb640 1 -- 172.21.15.45:0/4055465944 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9fdc050ae0 con 0x7f9fe80bb5a0 2023-10-03T19:12:23.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.974+0000 7f9fef9eb640 1 -- 172.21.15.45:0/4055465944 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9fe804de80 con 0x7f9fe80bb5a0 2023-10-03T19:12:23.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.974+0000 7f9fe5ffb640 1 -- 172.21.15.45:0/4055465944 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9fdc018020 con 0x7f9fe80bb5a0 2023-10-03T19:12:23.977 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:12:23.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.978+0000 7f9fef9eb640 1 -- 172.21.15.45:0/4055465944 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9fd4066280 msgr2=0x7f9fd4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:23.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.978+0000 7f9fef9eb640 1 --2- 172.21.15.45:0/4055465944 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9fd4066280 0x7f9fd4068730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9fd80079c0 tx=0x7f9fd8008040 comp rx=0 tx=0).stop 2023-10-03T19:12:23.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.978+0000 7f9fef9eb640 1 -- 172.21.15.45:0/4055465944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fe80bb5a0 msgr2=0x7f9fe81e6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:23.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.978+0000 7f9fef9eb640 1 --2- 172.21.15.45:0/4055465944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fe80bb5a0 0x7f9fe81e6430 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc00c4b0 tx=0x7f9fdc00c970 comp rx=0 tx=0).stop 2023-10-03T19:12:23.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.978+0000 7f9fef9eb640 1 -- 172.21.15.45:0/4055465944 shutdown_connections 2023-10-03T19:12:23.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.978+0000 7f9fef9eb640 1 --2- 172.21.15.45:0/4055465944 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9fd4066280 0x7f9fd4068730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:23.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.978+0000 7f9fef9eb640 1 --2- 172.21.15.45:0/4055465944 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fe8148540 0x7f9fe8144240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:23.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.978+0000 7f9fef9eb640 1 --2- 172.21.15.45:0/4055465944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fe80bb5a0 0x7f9fe81e6430 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:23.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.978+0000 7f9fef9eb640 1 --2- 172.21.15.45:0/4055465944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fe806d630 0x7f9fe8150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:23.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.978+0000 7f9fef9eb640 1 -- 172.21.15.45:0/4055465944 >> 172.21.15.45:0/4055465944 conn(0x7f9fe80a20d0 msgr2=0x7f9fe814d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:23.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.978+0000 7f9fef9eb640 1 -- 172.21.15.45:0/4055465944 shutdown_connections 2023-10-03T19:12:23.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:23.978+0000 7f9fef9eb640 1 -- 172.21.15.45:0/4055465944 wait complete. 2023-10-03T19:12:23.996 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:12:24.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.126+0000 7f6b8bb78640 1 Processor -- start 2023-10-03T19:12:24.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.126+0000 7f6b8bb78640 1 -- start start 2023-10-03T19:12:24.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.126+0000 7f6b8bb78640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6b840a4680 0x7f6b84150810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:24.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.126+0000 7f6b8bb78640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6b840a3db0 0x7f6b84065690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:24.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.126+0000 7f6b8bb78640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b84150380 con 0x7f6b84149d50 2023-10-03T19:12:24.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.126+0000 7f6b8bb78640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b840a4ed0 con 0x7f6b840a4680 2023-10-03T19:12:24.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.126+0000 7f6b8bb78640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b8414fd30 con 0x7f6b840a3db0 2023-10-03T19:12:24.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.126+0000 7f6b89113640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6b840a4680 0x7f6b84150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:24.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.126+0000 7f6b89914640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6b84149d50 0x7f6b8414c720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52724/0 (socket says 172.21.15.45:52724) 2023-10-03T19:12:24.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.126+0000 7f6b89113640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6b840a4680 0x7f6b84150810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49996/0 (socket says 172.21.15.45:49996) 2023-10-03T19:12:24.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.126+0000 7f6b89914640 1 -- 172.21.15.45:0/2394004708 learned_addr learned my addr 172.21.15.45:0/2394004708 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:24.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.126+0000 7f6b8a115640 1 --2- 172.21.15.45:0/2394004708 >> v2:172.21.15.79:3300/0 conn(0x7f6b840a3db0 0x7f6b84065690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:24.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.126+0000 7f6b89113640 1 -- 172.21.15.45:0/2394004708 >> v2:172.21.15.79:3300/0 conn(0x7f6b840a3db0 msgr2=0x7f6b84065690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:24.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.126+0000 7f6b89113640 1 --2- 172.21.15.45:0/2394004708 >> v2:172.21.15.79:3300/0 conn(0x7f6b840a3db0 0x7f6b84065690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:24.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.126+0000 7f6b89113640 1 -- 172.21.15.45:0/2394004708 >> v1:172.21.15.45:6789/0 conn(0x7f6b84149d50 legacy=0x7f6b8414c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:24.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.126+0000 7f6b89113640 1 -- 172.21.15.45:0/2394004708 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b84150010 con 0x7f6b840a4680 2023-10-03T19:12:24.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.126+0000 7f6b8a115640 1 --2- 172.21.15.45:0/2394004708 >> v2:172.21.15.79:3300/0 conn(0x7f6b840a3db0 0x7f6b84065690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:24.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b89113640 1 --2- 172.21.15.45:0/2394004708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b840a4680 0x7f6b84150810 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6b8406d1d0 tx=0x7f6b7401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33b000960155239 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:24.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b88912640 1 -- 172.21.15.45:0/2394004708 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b740a8950 con 0x7f6b840a4680 2023-10-03T19:12:24.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b88912640 1 -- 172.21.15.45:0/2394004708 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b740a8ab0 con 0x7f6b840a4680 2023-10-03T19:12:24.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b88912640 1 -- 172.21.15.45:0/2394004708 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b740a8e40 con 0x7f6b840a4680 2023-10-03T19:12:24.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b8bb78640 1 -- 172.21.15.45:0/2394004708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b840a4680 msgr2=0x7f6b84150810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:24.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b8bb78640 1 --2- 172.21.15.45:0/2394004708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b840a4680 0x7f6b84150810 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6b8406d1d0 tx=0x7f6b7401ec50 comp rx=0 tx=0).stop 2023-10-03T19:12:24.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b8bb78640 1 -- 172.21.15.45:0/2394004708 shutdown_connections 2023-10-03T19:12:24.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b8bb78640 1 --2- 172.21.15.45:0/2394004708 >> v2:172.21.15.79:3300/0 conn(0x7f6b840a3db0 0x7f6b84065690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:24.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b8bb78640 1 --2- 172.21.15.45:0/2394004708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b840a4680 0x7f6b84150810 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:24.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b8bb78640 1 -- 172.21.15.45:0/2394004708 >> 172.21.15.45:0/2394004708 conn(0x7f6b840c1530 msgr2=0x7f6b840c1930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:24.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b8bb78640 1 -- 172.21.15.45:0/2394004708 shutdown_connections 2023-10-03T19:12:24.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b8bb78640 1 -- 172.21.15.45:0/2394004708 wait complete. 2023-10-03T19:12:24.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b8bb78640 1 Processor -- start 2023-10-03T19:12:24.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b8bb78640 1 -- start start 2023-10-03T19:12:24.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b8bb78640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b840a3db0 0x7f6b840bab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:24.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b8bb78640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6b840a4680 0x7f6b8414e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:24.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b8bb78640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b84149d50 0x7f6b841e6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:24.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b8bb78640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b841454b0 con 0x7f6b84149d50 2023-10-03T19:12:24.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b8bb78640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b84071a10 con 0x7f6b840a3db0 2023-10-03T19:12:24.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b8bb78640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b840bb0a0 con 0x7f6b840a4680 2023-10-03T19:12:24.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b8a115640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b84149d50 0x7f6b841e6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:24.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b8a115640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b84149d50 0x7f6b841e6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50012/0 (socket says 172.21.15.45:50012) 2023-10-03T19:12:24.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b8a115640 1 -- 172.21.15.45:0/373974673 learned_addr learned my addr 172.21.15.45:0/373974673 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:24.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b89914640 1 --2- 172.21.15.45:0/373974673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b840a3db0 0x7f6b840bab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:24.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b89113640 1 --2- 172.21.15.45:0/373974673 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6b840a4680 0x7f6b8414e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:24.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b8a115640 1 -- 172.21.15.45:0/373974673 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6b840a4680 msgr2=0x7f6b8414e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:24.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b8a115640 1 --2- 172.21.15.45:0/373974673 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6b840a4680 0x7f6b8414e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:24.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b8a115640 1 -- 172.21.15.45:0/373974673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b840a3db0 msgr2=0x7f6b840bab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:24.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b8a115640 1 --2- 172.21.15.45:0/373974673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b840a3db0 0x7f6b840bab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:24.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b8a115640 1 -- 172.21.15.45:0/373974673 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b74009420 con 0x7f6b84149d50 2023-10-03T19:12:24.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b89914640 1 --2- 172.21.15.45:0/373974673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b840a3db0 0x7f6b840bab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:12:24.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.130+0000 7f6b8a115640 1 --2- 172.21.15.45:0/373974673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b84149d50 0x7f6b841e6e90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c00ced0 tx=0x7f6b7c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:24.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.134+0000 7f6b7a7fc640 1 -- 172.21.15.45:0/373974673 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c003ba0 con 0x7f6b84149d50 2023-10-03T19:12:24.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.134+0000 7f6b7a7fc640 1 -- 172.21.15.45:0/373974673 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7c003d20 con 0x7f6b84149d50 2023-10-03T19:12:24.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.134+0000 7f6b8bb78640 1 -- 172.21.15.45:0/373974673 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b8414ce30 con 0x7f6b84149d50 2023-10-03T19:12:24.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.134+0000 7f6b7a7fc640 1 -- 172.21.15.45:0/373974673 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c00d880 con 0x7f6b84149d50 2023-10-03T19:12:24.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.134+0000 7f6b8bb78640 1 -- 172.21.15.45:0/373974673 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b8414a120 con 0x7f6b84149d50 2023-10-03T19:12:24.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.134+0000 7f6b8bb78640 1 -- 172.21.15.45:0/373974673 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b840a4b60 con 0x7f6b84149d50 2023-10-03T19:12:24.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.134+0000 7f6b7a7fc640 1 -- 172.21.15.45:0/373974673 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6b7c00d9e0 con 0x7f6b84149d50 2023-10-03T19:12:24.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.134+0000 7f6b7a7fc640 1 --2- 172.21.15.45:0/373974673 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6b680662b0 0x7f6b68068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:24.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.134+0000 7f6b7a7fc640 1 -- 172.21.15.45:0/373974673 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6b7c084b50 con 0x7f6b84149d50 2023-10-03T19:12:24.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.134+0000 7f6b89914640 1 --2- 172.21.15.45:0/373974673 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6b680662b0 0x7f6b68068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:24.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.134+0000 7f6b89914640 1 --2- 172.21.15.45:0/373974673 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6b680662b0 0x7f6b68068760 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6b80005890 tx=0x7f6b80009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:24.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.138+0000 7f6b7a7fc640 1 -- 172.21.15.45:0/373974673 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6b7c052450 con 0x7f6b84149d50 2023-10-03T19:12:24.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.290+0000 7f6b8bb78640 1 -- 172.21.15.45:0/373974673 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6b8404de80 con 0x7f6b84149d50 2023-10-03T19:12:24.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.294+0000 7f6b7a7fc640 1 -- 172.21.15.45:0/373974673 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6b7c023020 con 0x7f6b84149d50 2023-10-03T19:12:24.295 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:12:24.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.294+0000 7f6b8bb78640 1 -- 172.21.15.45:0/373974673 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6b680662b0 msgr2=0x7f6b68068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:24.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.294+0000 7f6b8bb78640 1 --2- 172.21.15.45:0/373974673 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6b680662b0 0x7f6b68068760 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6b80005890 tx=0x7f6b80009040 comp rx=0 tx=0).stop 2023-10-03T19:12:24.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.294+0000 7f6b8bb78640 1 -- 172.21.15.45:0/373974673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b84149d50 msgr2=0x7f6b841e6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:24.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.294+0000 7f6b8bb78640 1 --2- 172.21.15.45:0/373974673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b84149d50 0x7f6b841e6e90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c00ced0 tx=0x7f6b7c00a710 comp rx=0 tx=0).stop 2023-10-03T19:12:24.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.294+0000 7f6b8bb78640 1 -- 172.21.15.45:0/373974673 shutdown_connections 2023-10-03T19:12:24.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.294+0000 7f6b8bb78640 1 --2- 172.21.15.45:0/373974673 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6b680662b0 0x7f6b68068760 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:24.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.294+0000 7f6b8bb78640 1 --2- 172.21.15.45:0/373974673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b84149d50 0x7f6b841e6e90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:24.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.294+0000 7f6b8bb78640 1 --2- 172.21.15.45:0/373974673 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6b840a4680 0x7f6b8414e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:24.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.294+0000 7f6b8bb78640 1 --2- 172.21.15.45:0/373974673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b840a3db0 0x7f6b840bab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:24.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.294+0000 7f6b8bb78640 1 -- 172.21.15.45:0/373974673 >> 172.21.15.45:0/373974673 conn(0x7f6b840c1530 msgr2=0x7f6b840bbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:24.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.294+0000 7f6b8bb78640 1 -- 172.21.15.45:0/373974673 shutdown_connections 2023-10-03T19:12:24.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.294+0000 7f6b8bb78640 1 -- 172.21.15.45:0/373974673 wait complete. 2023-10-03T19:12:24.315 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:12:24.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.438+0000 7fec598cc640 1 Processor -- start 2023-10-03T19:12:24.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.438+0000 7fec598cc640 1 -- start start 2023-10-03T19:12:24.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.442+0000 7fec598cc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fec540c5160 0x7fec54069ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:24.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.442+0000 7fec598cc640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec5414f120 con 0x7fec540a9f60 2023-10-03T19:12:24.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.442+0000 7fec598cc640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec5414f650 con 0x7fec540c5530 2023-10-03T19:12:24.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.442+0000 7fec598cc640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec540aa430 con 0x7fec540c5160 2023-10-03T19:12:24.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.442+0000 7fec537fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fec540a9f60 0x7fec540c3ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52738/0 (socket says 172.21.15.45:52738) 2023-10-03T19:12:24.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.442+0000 7fec537fe640 1 -- 172.21.15.45:0/2218073029 learned_addr learned my addr 172.21.15.45:0/2218073029 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:24.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.442+0000 7fec52ffd640 1 --2- 172.21.15.45:0/2218073029 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fec540c5160 0x7fec54069ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:24.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.442+0000 7fec51ffb640 1 -- 172.21.15.45:0/2218073029 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359789460 0 0) 0x7fec5414f120 con 0x7fec540a9f60 2023-10-03T19:12:24.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.442+0000 7fec51ffb640 1 -- 172.21.15.45:0/2218073029 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec3c003530 con 0x7fec540a9f60 2023-10-03T19:12:24.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.442+0000 7fec51ffb640 1 -- 172.21.15.45:0/2218073029 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 691447537 0 0) 0x7fec3c003530 con 0x7fec540a9f60 2023-10-03T19:12:24.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.442+0000 7fec51ffb640 1 -- 172.21.15.45:0/2218073029 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fec540c5160 msgr2=0x7fec54069ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:24.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.442+0000 7fec51ffb640 1 --2- 172.21.15.45:0/2218073029 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fec540c5160 0x7fec54069ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:24.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.442+0000 7fec51ffb640 1 -- 172.21.15.45:0/2218073029 >> v1:172.21.15.79:6789/0 conn(0x7fec540c5530 legacy=0x7fec540a9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:24.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.442+0000 7fec51ffb640 1 -- 172.21.15.45:0/2218073029 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5414f370 con 0x7fec540a9f60 2023-10-03T19:12:24.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.442+0000 7fec51ffb640 1 -- 172.21.15.45:0/2218073029 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fec4c0016d0 con 0x7fec540a9f60 2023-10-03T19:12:24.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.442+0000 7fec51ffb640 1 -- 172.21.15.45:0/2218073029 >> v1:172.21.15.45:6789/0 conn(0x7fec540a9f60 legacy=0x7fec540c3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:24.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.442+0000 7fec51ffb640 1 --2- 172.21.15.45:0/2218073029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec3c0039b0 0x7fec3c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:24.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.442+0000 7fec51ffb640 1 --2- 172.21.15.45:0/2218073029 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fec540c5160 0x7fec3c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:24.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.442+0000 7fec51ffb640 1 --2- 172.21.15.45:0/2218073029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec3c004d10 0x7fec3c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:24.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.442+0000 7fec51ffb640 1 -- 172.21.15.45:0/2218073029 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec540aa430 con 0x7fec3c004d10 2023-10-03T19:12:24.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.442+0000 7fec51ffb640 1 -- 172.21.15.45:0/2218073029 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c00baa0 con 0x7fec3c0039b0 2023-10-03T19:12:24.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.442+0000 7fec51ffb640 1 -- 172.21.15.45:0/2218073029 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c00bc60 con 0x7fec540c5160 2023-10-03T19:12:24.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.442+0000 7fec537fe640 1 --2- 172.21.15.45:0/2218073029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec3c004d10 0x7fec3c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:24.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.442+0000 7fec52ffd640 1 --2- 172.21.15.45:0/2218073029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec3c0039b0 0x7fec3c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:24.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.442+0000 7fec537fe640 1 -- 172.21.15.45:0/2218073029 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fec540c5160 msgr2=0x7fec3c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:24.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.442+0000 7fec537fe640 1 --2- 172.21.15.45:0/2218073029 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fec540c5160 0x7fec3c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:24.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.442+0000 7fec537fe640 1 -- 172.21.15.45:0/2218073029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec3c0039b0 msgr2=0x7fec3c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:24.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.442+0000 7fec537fe640 1 --2- 172.21.15.45:0/2218073029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec3c0039b0 0x7fec3c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:24.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.442+0000 7fec537fe640 1 -- 172.21.15.45:0/2218073029 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec3c003530 con 0x7fec3c004d10 2023-10-03T19:12:24.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.442+0000 7fec537fe640 1 --2- 172.21.15.45:0/2218073029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec3c004d10 0x7fec3c005180 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00c240 tx=0x7fec4c01f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6850353b32968a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:24.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec51ffb640 1 -- 172.21.15.45:0/2218073029 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c005b30 con 0x7fec3c004d10 2023-10-03T19:12:24.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec51ffb640 1 -- 172.21.15.45:0/2218073029 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4c0ab070 con 0x7fec3c004d10 2023-10-03T19:12:24.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec51ffb640 1 -- 172.21.15.45:0/2218073029 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c007070 con 0x7fec3c004d10 2023-10-03T19:12:24.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec598cc640 1 -- 172.21.15.45:0/2218073029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec3c004d10 msgr2=0x7fec3c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:24.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec598cc640 1 --2- 172.21.15.45:0/2218073029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec3c004d10 0x7fec3c005180 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00c240 tx=0x7fec4c01f390 comp rx=0 tx=0).stop 2023-10-03T19:12:24.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec537fe640 1 -- 172.21.15.45:0/2218073029 reap_dead start 2023-10-03T19:12:24.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec598cc640 1 -- 172.21.15.45:0/2218073029 shutdown_connections 2023-10-03T19:12:24.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec598cc640 1 -- 172.21.15.45:0/2218073029 >> 172.21.15.45:0/2218073029 conn(0x7fec540a7080 msgr2=0x7fec540c4880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:24.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec598cc640 1 -- 172.21.15.45:0/2218073029 shutdown_connections 2023-10-03T19:12:24.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec598cc640 1 -- 172.21.15.45:0/2218073029 wait complete. 2023-10-03T19:12:24.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec598cc640 1 Processor -- start 2023-10-03T19:12:24.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec598cc640 1 -- start start 2023-10-03T19:12:24.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec598cc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fec541520f0 0x7fec541524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:24.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec598cc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec540bb950 0x7fec541ebbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:24.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec598cc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec541e7be0 0x7fec5406f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:24.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec598cc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec540bdb10 con 0x7fec541e7be0 2023-10-03T19:12:24.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec598cc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec540a3af0 con 0x7fec540bb950 2023-10-03T19:12:24.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec598cc640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec541ec120 con 0x7fec541520f0 2023-10-03T19:12:24.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec537fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec541e7be0 0x7fec5406f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:24.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec537fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec541e7be0 0x7fec5406f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50032/0 (socket says 172.21.15.45:50032) 2023-10-03T19:12:24.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec537fe640 1 -- 172.21.15.45:0/101498121 learned_addr learned my addr 172.21.15.45:0/101498121 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:24.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec537fe640 1 -- 172.21.15.45:0/101498121 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fec541520f0 msgr2=0x7fec541524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:24.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec52ffd640 1 --2- 172.21.15.45:0/101498121 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fec541520f0 0x7fec541524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:24.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec527fc640 1 --2- 172.21.15.45:0/101498121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec540bb950 0x7fec541ebbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:24.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec537fe640 1 --2- 172.21.15.45:0/101498121 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fec541520f0 0x7fec541524c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:24.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec537fe640 1 -- 172.21.15.45:0/101498121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec540bb950 msgr2=0x7fec541ebbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:24.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec537fe640 1 --2- 172.21.15.45:0/101498121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec540bb950 0x7fec541ebbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:24.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec537fe640 1 -- 172.21.15.45:0/101498121 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5406b720 con 0x7fec541e7be0 2023-10-03T19:12:24.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec527fc640 1 --2- 172.21.15.45:0/101498121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec540bb950 0x7fec541ebbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:24.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec537fe640 1 --2- 172.21.15.45:0/101498121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec541e7be0 0x7fec5406f480 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fec4c000e70 tx=0x7fec3c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:24.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec3bfff640 1 -- 172.21.15.45:0/101498121 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c001690 con 0x7fec541e7be0 2023-10-03T19:12:24.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec3bfff640 1 -- 172.21.15.45:0/101498121 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4c001c80 con 0x7fec541e7be0 2023-10-03T19:12:24.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec598cc640 1 -- 172.21.15.45:0/101498121 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec5406b590 con 0x7fec541e7be0 2023-10-03T19:12:24.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec3bfff640 1 -- 172.21.15.45:0/101498121 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c007270 con 0x7fec541e7be0 2023-10-03T19:12:24.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.446+0000 7fec598cc640 1 -- 172.21.15.45:0/101498121 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec540bf200 con 0x7fec541e7be0 2023-10-03T19:12:24.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.450+0000 7fec598cc640 1 -- 172.21.15.45:0/101498121 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec5404de80 con 0x7fec541e7be0 2023-10-03T19:12:24.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.450+0000 7fec3bfff640 1 -- 172.21.15.45:0/101498121 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fec4c0073d0 con 0x7fec541e7be0 2023-10-03T19:12:24.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.450+0000 7fec3bfff640 1 --2- 172.21.15.45:0/101498121 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fec40066280 0x7fec40068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:24.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.450+0000 7fec3bfff640 1 -- 172.21.15.45:0/101498121 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fec4c0b7070 con 0x7fec541e7be0 2023-10-03T19:12:24.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.450+0000 7fec52ffd640 1 --2- 172.21.15.45:0/101498121 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fec40066280 0x7fec40068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:24.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.450+0000 7fec52ffd640 1 --2- 172.21.15.45:0/101498121 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fec40066280 0x7fec40068730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fec44007440 tx=0x7fec4400b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:24.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.454+0000 7fec3bfff640 1 -- 172.21.15.45:0/101498121 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fec4c0edeb0 con 0x7fec541e7be0 2023-10-03T19:12:24.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.642+0000 7fec598cc640 1 -- 172.21.15.45:0/101498121 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec5406b0b0 con 0x7fec541e7be0 2023-10-03T19:12:24.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.646+0000 7fec3bfff640 1 -- 172.21.15.45:0/101498121 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2762 (secure 0 0 0) 0x7fec4c0c0090 con 0x7fec541e7be0 2023-10-03T19:12:24.647 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:24.647 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/731286206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":731286206},{"type":"v1","addr":"172.21.15.45:6834","nonce":731286206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/144609891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":144609891},{"type":"v1","addr":"172.21.15.45:6835","nonce":144609891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2693877820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2693877820},{"type":"v1","addr":"172.21.15.79:6835","nonce":2693877820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-03T19:12:24.647 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 3 2023-10-03T19:12:24.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.646+0000 7fec598cc640 1 -- 172.21.15.45:0/101498121 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fec40066280 msgr2=0x7fec40068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:24.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.646+0000 7fec598cc640 1 --2- 172.21.15.45:0/101498121 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fec40066280 0x7fec40068730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fec44007440 tx=0x7fec4400b040 comp rx=0 tx=0).stop 2023-10-03T19:12:24.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.646+0000 7fec598cc640 1 -- 172.21.15.45:0/101498121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec541e7be0 msgr2=0x7fec5406f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:24.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.646+0000 7fec598cc640 1 --2- 172.21.15.45:0/101498121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec541e7be0 0x7fec5406f480 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fec4c000e70 tx=0x7fec3c005800 comp rx=0 tx=0).stop 2023-10-03T19:12:24.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.646+0000 7fec598cc640 1 -- 172.21.15.45:0/101498121 shutdown_connections 2023-10-03T19:12:24.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.646+0000 7fec598cc640 1 --2- 172.21.15.45:0/101498121 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fec40066280 0x7fec40068730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:24.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.646+0000 7fec598cc640 1 --2- 172.21.15.45:0/101498121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec541e7be0 0x7fec5406f480 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:24.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.646+0000 7fec598cc640 1 --2- 172.21.15.45:0/101498121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec540bb950 0x7fec541ebbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:24.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.646+0000 7fec598cc640 1 --2- 172.21.15.45:0/101498121 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fec541520f0 0x7fec541524c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:24.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.646+0000 7fec598cc640 1 -- 172.21.15.45:0/101498121 >> 172.21.15.45:0/101498121 conn(0x7fec540a7080 msgr2=0x7fec5414c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:24.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.646+0000 7fec598cc640 1 -- 172.21.15.45:0/101498121 shutdown_connections 2023-10-03T19:12:24.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.646+0000 7fec598cc640 1 -- 172.21.15.45:0/101498121 wait complete. 2023-10-03T19:12:24.665 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:12:24.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fde05cf1640 1 Processor -- start 2023-10-03T19:12:24.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fde05cf1640 1 -- start start 2023-10-03T19:12:24.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fde05cf1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde0006d170 0x7fde0014d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:24.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fde05cf1640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0006cac0 con 0x7fde0006f170 2023-10-03T19:12:24.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fde05cf1640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde000720d0 con 0x7fde000bc8b0 2023-10-03T19:12:24.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fde05cf1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde000a5ab0 con 0x7fde0006d170 2023-10-03T19:12:24.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fddff7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fde0006f170 0x7fde00150190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35690/0 (socket says 172.21.15.45:35690) 2023-10-03T19:12:24.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fddff7fe640 1 -- 172.21.15.45:0/2809490144 learned_addr learned my addr 172.21.15.45:0/2809490144 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:24.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fddfffff640 1 --2- 172.21.15.45:0/2809490144 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde0006d170 0x7fde0014d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:24.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fddfe7fc640 1 -- 172.21.15.45:0/2809490144 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1124820406 0 0) 0x7fddf0001120 con 0x7fde0006f170 2023-10-03T19:12:24.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fddfe7fc640 1 -- 172.21.15.45:0/2809490144 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdde8003530 con 0x7fde0006f170 2023-10-03T19:12:24.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fddfe7fc640 1 -- 172.21.15.45:0/2809490144 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 413882619 0 0) 0x7fdde8003530 con 0x7fde0006f170 2023-10-03T19:12:24.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fddfe7fc640 1 -- 172.21.15.45:0/2809490144 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde0006d170 msgr2=0x7fde0014d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:24.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fddfe7fc640 1 --2- 172.21.15.45:0/2809490144 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde0006d170 0x7fde0014d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:24.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fddfe7fc640 1 -- 172.21.15.45:0/2809490144 >> v1:172.21.15.79:6789/0 conn(0x7fde000bc8b0 legacy=0x7fde0014ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:24.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fddfe7fc640 1 -- 172.21.15.45:0/2809490144 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0006cd00 con 0x7fde0006f170 2023-10-03T19:12:24.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fddfe7fc640 1 -- 172.21.15.45:0/2809490144 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fddf0001810 con 0x7fde0006f170 2023-10-03T19:12:24.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fddfe7fc640 1 -- 172.21.15.45:0/2809490144 >> v1:172.21.15.45:6789/0 conn(0x7fde0006f170 legacy=0x7fde00150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:24.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fddfe7fc640 1 --2- 172.21.15.45:0/2809490144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdde80039b0 0x7fdde8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:24.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fddfe7fc640 1 --2- 172.21.15.45:0/2809490144 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde0006d170 0x7fdde80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:24.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fddfe7fc640 1 --2- 172.21.15.45:0/2809490144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdde8004d10 0x7fdde8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:24.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fddfe7fc640 1 -- 172.21.15.45:0/2809490144 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde000a5ab0 con 0x7fdde8004d10 2023-10-03T19:12:24.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fddfe7fc640 1 -- 172.21.15.45:0/2809490144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde800bad0 con 0x7fdde80039b0 2023-10-03T19:12:24.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fddfe7fc640 1 -- 172.21.15.45:0/2809490144 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde800bc60 con 0x7fde0006d170 2023-10-03T19:12:24.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fddfffff640 1 --2- 172.21.15.45:0/2809490144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdde8004d10 0x7fdde8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:24.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fddff7fe640 1 --2- 172.21.15.45:0/2809490144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdde80039b0 0x7fdde8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:24.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fddfeffd640 1 --2- 172.21.15.45:0/2809490144 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde0006d170 0x7fdde80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:24.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fddfffff640 1 -- 172.21.15.45:0/2809490144 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde0006d170 msgr2=0x7fdde80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:24.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fddfffff640 1 --2- 172.21.15.45:0/2809490144 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde0006d170 0x7fdde80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:24.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fddfffff640 1 -- 172.21.15.45:0/2809490144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdde80039b0 msgr2=0x7fdde8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:24.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fddfffff640 1 --2- 172.21.15.45:0/2809490144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdde80039b0 0x7fdde8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:24.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.778+0000 7fddfffff640 1 -- 172.21.15.45:0/2809490144 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde8003530 con 0x7fdde8004d10 2023-10-03T19:12:24.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.782+0000 7fddfffff640 1 --2- 172.21.15.45:0/2809490144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdde8004d10 0x7fdde8005180 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fddf8009fc0 tx=0x7fddf801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83dc4a9357d91a4a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:24.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.782+0000 7fddfe7fc640 1 -- 172.21.15.45:0/2809490144 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf80a5c70 con 0x7fdde8004d10 2023-10-03T19:12:24.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.782+0000 7fddfe7fc640 1 -- 172.21.15.45:0/2809490144 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf800f040 con 0x7fdde8004d10 2023-10-03T19:12:24.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.782+0000 7fddfe7fc640 1 -- 172.21.15.45:0/2809490144 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf80ad440 con 0x7fdde8004d10 2023-10-03T19:12:24.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.782+0000 7fde05cf1640 1 -- 172.21.15.45:0/2809490144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdde8004d10 msgr2=0x7fdde8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:24.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.782+0000 7fde05cf1640 1 --2- 172.21.15.45:0/2809490144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdde8004d10 0x7fdde8005180 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fddf8009fc0 tx=0x7fddf801cc60 comp rx=0 tx=0).stop 2023-10-03T19:12:24.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.782+0000 7fddfffff640 1 -- 172.21.15.45:0/2809490144 reap_dead start 2023-10-03T19:12:24.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.782+0000 7fde05cf1640 1 -- 172.21.15.45:0/2809490144 shutdown_connections 2023-10-03T19:12:24.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.782+0000 7fde05cf1640 1 -- 172.21.15.45:0/2809490144 >> 172.21.15.45:0/2809490144 conn(0x7fde000bcf50 msgr2=0x7fde000bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:24.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.782+0000 7fde05cf1640 1 -- 172.21.15.45:0/2809490144 shutdown_connections 2023-10-03T19:12:24.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.782+0000 7fde05cf1640 1 -- 172.21.15.45:0/2809490144 wait complete. 2023-10-03T19:12:24.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.782+0000 7fde05cf1640 1 Processor -- start 2023-10-03T19:12:24.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.782+0000 7fde05cf1640 1 -- start start 2023-10-03T19:12:24.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.782+0000 7fde05cf1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde0014ace0 0x7fde000b91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:24.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.782+0000 7fde05cf1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde00149b50 0x7fde000b6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:24.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.782+0000 7fde05cf1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde000b54e0 0x7fde00148b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:24.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.782+0000 7fde05cf1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde000b72b0 con 0x7fde00149b50 2023-10-03T19:12:24.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.782+0000 7fde05cf1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde000ba4c0 con 0x7fde0014ace0 2023-10-03T19:12:24.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.782+0000 7fde05cf1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde00149870 con 0x7fde000b54e0 2023-10-03T19:12:24.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.782+0000 7fddfeffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde00149b50 0x7fde000b6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:24.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.782+0000 7fddfeffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde00149b50 0x7fde000b6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46388/0 (socket says 172.21.15.45:46388) 2023-10-03T19:12:24.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.782+0000 7fddfeffd640 1 -- 172.21.15.45:0/4090606482 learned_addr learned my addr 172.21.15.45:0/4090606482 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:24.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.782+0000 7fddfffff640 1 --2- 172.21.15.45:0/4090606482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde000b54e0 0x7fde00148b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:24.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.782+0000 7fddff7fe640 1 --2- 172.21.15.45:0/4090606482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde0014ace0 0x7fde000b91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:24.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.782+0000 7fddfeffd640 1 -- 172.21.15.45:0/4090606482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde000b54e0 msgr2=0x7fde00148b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:24.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.782+0000 7fddfeffd640 1 --2- 172.21.15.45:0/4090606482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde000b54e0 0x7fde00148b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:24.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.782+0000 7fddfeffd640 1 -- 172.21.15.45:0/4090606482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde0014ace0 msgr2=0x7fde000b91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:24.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.782+0000 7fddfeffd640 1 --2- 172.21.15.45:0/4090606482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde0014ace0 0x7fde000b91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:24.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.782+0000 7fddfeffd640 1 -- 172.21.15.45:0/4090606482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0014c4a0 con 0x7fde00149b50 2023-10-03T19:12:24.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.786+0000 7fddfeffd640 1 --2- 172.21.15.45:0/4090606482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde00149b50 0x7fde000b6d70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fddf400e580 tx=0x7fddf400ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:24.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.786+0000 7fdde7fff640 1 -- 172.21.15.45:0/4090606482 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf40052e0 con 0x7fde00149b50 2023-10-03T19:12:24.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.786+0000 7fdde7fff640 1 -- 172.21.15.45:0/4090606482 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf4005440 con 0x7fde00149b50 2023-10-03T19:12:24.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.786+0000 7fde05cf1640 1 -- 172.21.15.45:0/4090606482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde0014fae0 con 0x7fde00149b50 2023-10-03T19:12:24.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.786+0000 7fdde7fff640 1 -- 172.21.15.45:0/4090606482 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4003840 con 0x7fde00149b50 2023-10-03T19:12:24.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.786+0000 7fde05cf1640 1 -- 172.21.15.45:0/4090606482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0006f540 con 0x7fde00149b50 2023-10-03T19:12:24.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.786+0000 7fde05cf1640 1 -- 172.21.15.45:0/4090606482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde0006d660 con 0x7fde00149b50 2023-10-03T19:12:24.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.786+0000 7fdde7fff640 1 -- 172.21.15.45:0/4090606482 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fddf40039a0 con 0x7fde00149b50 2023-10-03T19:12:24.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.786+0000 7fdde7fff640 1 --2- 172.21.15.45:0/4090606482 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fddec0662b0 0x7fddec068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:24.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.786+0000 7fdde7fff640 1 -- 172.21.15.45:0/4090606482 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fddf4083800 con 0x7fde00149b50 2023-10-03T19:12:24.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.786+0000 7fddff7fe640 1 --2- 172.21.15.45:0/4090606482 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fddec0662b0 0x7fddec068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:24.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.786+0000 7fddff7fe640 1 --2- 172.21.15.45:0/4090606482 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fddec0662b0 0x7fddec068760 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fddf0001060 tx=0x7fddf0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:24.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.790+0000 7fdde7fff640 1 -- 172.21.15.45:0/4090606482 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fddf4051090 con 0x7fde00149b50 2023-10-03T19:12:24.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.946+0000 7fde05cf1640 1 -- 172.21.15.45:0/4090606482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde000b6a90 con 0x7fde00149b50 2023-10-03T19:12:24.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.946+0000 7fdde7fff640 1 -- 172.21.15.45:0/4090606482 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+14588 (secure 0 0 0) 0x7fde000b6a90 con 0x7fde00149b50 2023-10-03T19:12:24.950 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:24.950 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":18,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:12:24.319914+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:12:24.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.950+0000 7fde05cf1640 1 -- 172.21.15.45:0/4090606482 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fddec0662b0 msgr2=0x7fddec068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:24.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.950+0000 7fde05cf1640 1 --2- 172.21.15.45:0/4090606482 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fddec0662b0 0x7fddec068760 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fddf0001060 tx=0x7fddf0009040 comp rx=0 tx=0).stop 2023-10-03T19:12:24.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.950+0000 7fde05cf1640 1 -- 172.21.15.45:0/4090606482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde00149b50 msgr2=0x7fde000b6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:24.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.950+0000 7fde05cf1640 1 --2- 172.21.15.45:0/4090606482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde00149b50 0x7fde000b6d70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fddf400e580 tx=0x7fddf400ea40 comp rx=0 tx=0).stop 2023-10-03T19:12:24.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.950+0000 7fde05cf1640 1 -- 172.21.15.45:0/4090606482 shutdown_connections 2023-10-03T19:12:24.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.950+0000 7fde05cf1640 1 --2- 172.21.15.45:0/4090606482 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fddec0662b0 0x7fddec068760 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:24.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.950+0000 7fde05cf1640 1 --2- 172.21.15.45:0/4090606482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde000b54e0 0x7fde00148b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:24.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.950+0000 7fde05cf1640 1 --2- 172.21.15.45:0/4090606482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde00149b50 0x7fde000b6d70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:24.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.950+0000 7fde05cf1640 1 --2- 172.21.15.45:0/4090606482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde0014ace0 0x7fde000b91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:24.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.950+0000 7fde05cf1640 1 -- 172.21.15.45:0/4090606482 >> 172.21.15.45:0/4090606482 conn(0x7fde000bcf50 msgr2=0x7fde0014e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:24.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.950+0000 7fde05cf1640 1 -- 172.21.15.45:0/4090606482 shutdown_connections 2023-10-03T19:12:24.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:24.950+0000 7fde05cf1640 1 -- 172.21.15.45:0/4090606482 wait complete. 2023-10-03T19:12:24.969 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:12:24.969 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:12:25.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.078+0000 7f051126c640 1 Processor -- start 2023-10-03T19:12:25.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.078+0000 7f051126c640 1 -- start start 2023-10-03T19:12:25.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.082+0000 7f051126c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f050c06f880 0x7f050c0a5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:25.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.082+0000 7f051126c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f050c14ba30 0x7f050c155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:25.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.082+0000 7f051126c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f050c14f080 con 0x7f050c14f510 2023-10-03T19:12:25.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.082+0000 7f051126c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f050c06f3e0 con 0x7f050c14ba30 2023-10-03T19:12:25.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.082+0000 7f051126c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050c070e90 con 0x7f050c06f880 2023-10-03T19:12:25.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.082+0000 7f050b7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f050c14ba30 0x7f050c155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:25.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.082+0000 7f050b7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f050c14ba30 0x7f050c155bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46396/0 (socket says 172.21.15.45:46396) 2023-10-03T19:12:25.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.082+0000 7f050b7fe640 1 -- 172.21.15.45:0/4129038484 learned_addr learned my addr 172.21.15.45:0/4129038484 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:25.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.082+0000 7f050affd640 1 --2- 172.21.15.45:0/4129038484 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f050c06f880 0x7f050c0a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:25.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.082+0000 7f050b7fe640 1 -- 172.21.15.45:0/4129038484 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f050c06f880 msgr2=0x7f050c0a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:25.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.082+0000 7f050b7fe640 1 --2- 172.21.15.45:0/4129038484 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f050c06f880 0x7f050c0a5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.082+0000 7f050b7fe640 1 -- 172.21.15.45:0/4129038484 >> v1:172.21.15.79:6789/0 conn(0x7f050c14f510 legacy=0x7f050c14b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:25.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.082+0000 7f050b7fe640 1 -- 172.21.15.45:0/4129038484 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050c14ea30 con 0x7f050c14ba30 2023-10-03T19:12:25.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.082+0000 7f050affd640 1 --2- 172.21.15.45:0/4129038484 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f050c06f880 0x7f050c0a5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:25.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.082+0000 7f050b7fe640 1 --2- 172.21.15.45:0/4129038484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f050c14ba30 0x7f050c155bc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0504009e50 tx=0x7f050401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57331434d81c565d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:25.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.082+0000 7f0509ffb640 1 -- 172.21.15.45:0/4129038484 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05040a5780 con 0x7f050c14ba30 2023-10-03T19:12:25.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.082+0000 7f0509ffb640 1 -- 172.21.15.45:0/4129038484 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05040a58e0 con 0x7f050c14ba30 2023-10-03T19:12:25.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.082+0000 7f0509ffb640 1 -- 172.21.15.45:0/4129038484 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05040a5c70 con 0x7f050c14ba30 2023-10-03T19:12:25.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.082+0000 7f051126c640 1 -- 172.21.15.45:0/4129038484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f050c14ba30 msgr2=0x7f050c155bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:25.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.082+0000 7f051126c640 1 --2- 172.21.15.45:0/4129038484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f050c14ba30 0x7f050c155bc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0504009e50 tx=0x7f050401c9a0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.082+0000 7f051126c640 1 -- 172.21.15.45:0/4129038484 shutdown_connections 2023-10-03T19:12:25.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.082+0000 7f051126c640 1 --2- 172.21.15.45:0/4129038484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f050c14ba30 0x7f050c155bc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.082+0000 7f051126c640 1 --2- 172.21.15.45:0/4129038484 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f050c06f880 0x7f050c0a5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.082+0000 7f051126c640 1 -- 172.21.15.45:0/4129038484 >> 172.21.15.45:0/4129038484 conn(0x7f050c0a20d0 msgr2=0x7f050c0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:25.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.082+0000 7f051126c640 1 -- 172.21.15.45:0/4129038484 shutdown_connections 2023-10-03T19:12:25.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.086+0000 7f051126c640 1 -- 172.21.15.45:0/4129038484 wait complete. 2023-10-03T19:12:25.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.086+0000 7f051126c640 1 Processor -- start 2023-10-03T19:12:25.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.086+0000 7f051126c640 1 -- start start 2023-10-03T19:12:25.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.086+0000 7f051126c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f050c06f880 0x7f050c141700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:25.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.086+0000 7f051126c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f050c14ba30 0x7f050c141fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:25.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.086+0000 7f051126c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f050c14f510 0x7f050c13fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:25.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.086+0000 7f051126c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c1e9200 con 0x7f050c14ba30 2023-10-03T19:12:25.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.086+0000 7f051126c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c140000 con 0x7f050c06f880 2023-10-03T19:12:25.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.086+0000 7f051126c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050c1e8c60 con 0x7f050c14f510 2023-10-03T19:12:25.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.086+0000 7f050a7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f050c14ba30 0x7f050c141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:25.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.086+0000 7f050a7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f050c14ba30 0x7f050c141fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46402/0 (socket says 172.21.15.45:46402) 2023-10-03T19:12:25.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.086+0000 7f050a7fc640 1 -- 172.21.15.45:0/29353894 learned_addr learned my addr 172.21.15.45:0/29353894 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:25.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.086+0000 7f050affd640 1 --2- 172.21.15.45:0/29353894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f050c06f880 0x7f050c141700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:25.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.086+0000 7f050b7fe640 1 --2- 172.21.15.45:0/29353894 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f050c14f510 0x7f050c13fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:25.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.086+0000 7f050a7fc640 1 -- 172.21.15.45:0/29353894 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f050c14f510 msgr2=0x7f050c13fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:25.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.086+0000 7f050a7fc640 1 --2- 172.21.15.45:0/29353894 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f050c14f510 0x7f050c13fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.086+0000 7f050a7fc640 1 -- 172.21.15.45:0/29353894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f050c06f880 msgr2=0x7f050c141700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:25.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.086+0000 7f050a7fc640 1 --2- 172.21.15.45:0/29353894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f050c06f880 0x7f050c141700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.086+0000 7f050a7fc640 1 -- 172.21.15.45:0/29353894 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0504009b30 con 0x7f050c14ba30 2023-10-03T19:12:25.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.086+0000 7f050affd640 1 --2- 172.21.15.45:0/29353894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f050c06f880 0x7f050c141700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:25.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.086+0000 7f050b7fe640 1 --2- 172.21.15.45:0/29353894 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f050c14f510 0x7f050c13fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:25.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.086+0000 7f050a7fc640 1 --2- 172.21.15.45:0/29353894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f050c14ba30 0x7f050c141fa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f050000b3e0 tx=0x7f050000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:25.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.086+0000 7f04f37fe640 1 -- 172.21.15.45:0/29353894 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0500011830 con 0x7f050c14ba30 2023-10-03T19:12:25.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.086+0000 7f04f37fe640 1 -- 172.21.15.45:0/29353894 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0500011990 con 0x7f050c14ba30 2023-10-03T19:12:25.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.086+0000 7f04f37fe640 1 -- 172.21.15.45:0/29353894 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0500011d40 con 0x7f050c14ba30 2023-10-03T19:12:25.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.086+0000 7f051126c640 1 -- 172.21.15.45:0/29353894 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f050c070a40 con 0x7f050c14ba30 2023-10-03T19:12:25.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.086+0000 7f051126c640 1 -- 172.21.15.45:0/29353894 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f050c06fc50 con 0x7f050c14ba30 2023-10-03T19:12:25.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.086+0000 7f051126c640 1 -- 172.21.15.45:0/29353894 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f050c070bd0 con 0x7f050c14ba30 2023-10-03T19:12:25.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.086+0000 7f04f37fe640 1 -- 172.21.15.45:0/29353894 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f050001a400 con 0x7f050c14ba30 2023-10-03T19:12:25.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.090+0000 7f04f37fe640 1 --2- 172.21.15.45:0/29353894 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f04f8066280 0x7f04f8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:25.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.090+0000 7f04f37fe640 1 -- 172.21.15.45:0/29353894 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0500083770 con 0x7f050c14ba30 2023-10-03T19:12:25.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.090+0000 7f050affd640 1 --2- 172.21.15.45:0/29353894 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f04f8066280 0x7f04f8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:25.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.090+0000 7f050affd640 1 --2- 172.21.15.45:0/29353894 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f04f8066280 0x7f04f8068730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f04fc008930 tx=0x7f04fc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:25.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.094+0000 7f04f37fe640 1 -- 172.21.15.45:0/29353894 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0500050fd0 con 0x7f050c14ba30 2023-10-03T19:12:25.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.238+0000 7f051126c640 1 -- 172.21.15.45:0/29353894 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f050c04de80 con 0x7f050c14ba30 2023-10-03T19:12:25.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.238+0000 7f04f37fe640 1 -- 172.21.15.45:0/29353894 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f05000545f0 con 0x7f050c14ba30 2023-10-03T19:12:25.242 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:12:25.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.242+0000 7f051126c640 1 -- 172.21.15.45:0/29353894 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f04f8066280 msgr2=0x7f04f8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:25.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.242+0000 7f051126c640 1 --2- 172.21.15.45:0/29353894 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f04f8066280 0x7f04f8068730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f04fc008930 tx=0x7f04fc008040 comp rx=0 tx=0).stop 2023-10-03T19:12:25.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.242+0000 7f051126c640 1 -- 172.21.15.45:0/29353894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f050c14ba30 msgr2=0x7f050c141fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:25.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.242+0000 7f051126c640 1 --2- 172.21.15.45:0/29353894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f050c14ba30 0x7f050c141fa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f050000b3e0 tx=0x7f050000b8a0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.242+0000 7f051126c640 1 -- 172.21.15.45:0/29353894 shutdown_connections 2023-10-03T19:12:25.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.242+0000 7f051126c640 1 --2- 172.21.15.45:0/29353894 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f04f8066280 0x7f04f8068730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.242+0000 7f051126c640 1 --2- 172.21.15.45:0/29353894 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f050c14f510 0x7f050c13fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.242+0000 7f051126c640 1 --2- 172.21.15.45:0/29353894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f050c14ba30 0x7f050c141fa0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.242+0000 7f051126c640 1 --2- 172.21.15.45:0/29353894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f050c06f880 0x7f050c141700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.242+0000 7f051126c640 1 -- 172.21.15.45:0/29353894 >> 172.21.15.45:0/29353894 conn(0x7f050c0a20d0 msgr2=0x7f050c14d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:25.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.242+0000 7f051126c640 1 -- 172.21.15.45:0/29353894 shutdown_connections 2023-10-03T19:12:25.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.242+0000 7f051126c640 1 -- 172.21.15.45:0/29353894 wait complete. 2023-10-03T19:12:25.259 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:12:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.378+0000 7fd6d75a6640 1 Processor -- start 2023-10-03T19:12:25.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.378+0000 7fd6d75a6640 1 -- start start 2023-10-03T19:12:25.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.378+0000 7fd6d75a6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd6d0148540 0x7fd6d00bb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:25.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.378+0000 7fd6d75a6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd6d006d630 0x7fd6d014e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:25.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.378+0000 7fd6d75a6640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d00bcf80 con 0x7fd6d00bb5a0 2023-10-03T19:12:25.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.378+0000 7fd6d75a6640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d0152b50 con 0x7fd6d006d630 2023-10-03T19:12:25.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.378+0000 7fd6d75a6640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d014e550 con 0x7fd6d0148540 2023-10-03T19:12:25.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.378+0000 7fd6d5b43640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd6d00bb5a0 0x7fd6d014eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35706/0 (socket says 172.21.15.45:35706) 2023-10-03T19:12:25.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.378+0000 7fd6d4b41640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd6d006d630 0x7fd6d014e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:25.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.378+0000 7fd6d5b43640 1 -- 172.21.15.45:0/1532121116 learned_addr learned my addr 172.21.15.45:0/1532121116 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:25.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.382+0000 7fd6d5342640 1 --2- 172.21.15.45:0/1532121116 >> v2:172.21.15.79:3300/0 conn(0x7fd6d0148540 0x7fd6d00bb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:25.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.382+0000 7fd6c7fff640 1 -- 172.21.15.45:0/1532121116 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 910731442 0 0) 0x7fd6d00bcf80 con 0x7fd6d00bb5a0 2023-10-03T19:12:25.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.382+0000 7fd6c7fff640 1 -- 172.21.15.45:0/1532121116 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6bc003530 con 0x7fd6d00bb5a0 2023-10-03T19:12:25.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.382+0000 7fd6d4b41640 1 -- 172.21.15.45:0/1532121116 >> v2:172.21.15.79:3300/0 conn(0x7fd6d0148540 msgr2=0x7fd6d00bb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:25.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.382+0000 7fd6d4b41640 1 --2- 172.21.15.45:0/1532121116 >> v2:172.21.15.79:3300/0 conn(0x7fd6d0148540 0x7fd6d00bb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.382+0000 7fd6d4b41640 1 -- 172.21.15.45:0/1532121116 >> v1:172.21.15.45:6789/0 conn(0x7fd6d00bb5a0 legacy=0x7fd6d014eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:25.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.382+0000 7fd6d4b41640 1 -- 172.21.15.45:0/1532121116 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d00bd260 con 0x7fd6d006d630 2023-10-03T19:12:25.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.382+0000 7fd6d4b41640 1 --2- 172.21.15.45:0/1532121116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6d006d630 0x7fd6d014e9a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd6d00bd960 tx=0x7fd6c001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec341010eb86665 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:25.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.382+0000 7fd6c7fff640 1 -- 172.21.15.45:0/1532121116 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c00ad660 con 0x7fd6d006d630 2023-10-03T19:12:25.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.382+0000 7fd6c7fff640 1 -- 172.21.15.45:0/1532121116 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c00ad7c0 con 0x7fd6d006d630 2023-10-03T19:12:25.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.382+0000 7fd6c7fff640 1 -- 172.21.15.45:0/1532121116 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c00adb30 con 0x7fd6d006d630 2023-10-03T19:12:25.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.382+0000 7fd6d75a6640 1 -- 172.21.15.45:0/1532121116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6d006d630 msgr2=0x7fd6d014e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:25.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.382+0000 7fd6d75a6640 1 --2- 172.21.15.45:0/1532121116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6d006d630 0x7fd6d014e9a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd6d00bd960 tx=0x7fd6c001c430 comp rx=0 tx=0).stop 2023-10-03T19:12:25.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.382+0000 7fd6d75a6640 1 -- 172.21.15.45:0/1532121116 shutdown_connections 2023-10-03T19:12:25.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.382+0000 7fd6d75a6640 1 --2- 172.21.15.45:0/1532121116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6d006d630 0x7fd6d014e9a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.382+0000 7fd6d75a6640 1 --2- 172.21.15.45:0/1532121116 >> v2:172.21.15.79:3300/0 conn(0x7fd6d0148540 0x7fd6d00bb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.382+0000 7fd6d75a6640 1 -- 172.21.15.45:0/1532121116 >> 172.21.15.45:0/1532121116 conn(0x7fd6d00a20d0 msgr2=0x7fd6d00a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:25.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.382+0000 7fd6d75a6640 1 -- 172.21.15.45:0/1532121116 shutdown_connections 2023-10-03T19:12:25.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.382+0000 7fd6d75a6640 1 -- 172.21.15.45:0/1532121116 wait complete. 2023-10-03T19:12:25.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.386+0000 7fd6d75a6640 1 Processor -- start 2023-10-03T19:12:25.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.386+0000 7fd6d75a6640 1 -- start start 2023-10-03T19:12:25.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.386+0000 7fd6d75a6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6d006d630 0x7fd6d0148c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:25.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.386+0000 7fd6d75a6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd6d00bb5a0 0x7fd6d00a4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:25.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.386+0000 7fd6d75a6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6d0148540 0x7fd6d0070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:25.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.386+0000 7fd6d75a6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d014a4c0 con 0x7fd6d006d630 2023-10-03T19:12:25.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.386+0000 7fd6d75a6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d00a4530 con 0x7fd6d0148540 2023-10-03T19:12:25.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.386+0000 7fd6d75a6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d00a4810 con 0x7fd6d00bb5a0 2023-10-03T19:12:25.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.386+0000 7fd6d5342640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6d006d630 0x7fd6d0148c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:25.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.386+0000 7fd6d5342640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6d006d630 0x7fd6d0148c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46416/0 (socket says 172.21.15.45:46416) 2023-10-03T19:12:25.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.386+0000 7fd6d5342640 1 -- 172.21.15.45:0/4216287681 learned_addr learned my addr 172.21.15.45:0/4216287681 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:25.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.386+0000 7fd6d4b41640 1 --2- 172.21.15.45:0/4216287681 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd6d00bb5a0 0x7fd6d00a4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:25.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.386+0000 7fd6d5b43640 1 --2- 172.21.15.45:0/4216287681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6d0148540 0x7fd6d0070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:25.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.386+0000 7fd6d5342640 1 -- 172.21.15.45:0/4216287681 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd6d00bb5a0 msgr2=0x7fd6d00a4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:25.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.386+0000 7fd6d5342640 1 --2- 172.21.15.45:0/4216287681 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd6d00bb5a0 0x7fd6d00a4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.386+0000 7fd6d5342640 1 -- 172.21.15.45:0/4216287681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6d0148540 msgr2=0x7fd6d0070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:25.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.386+0000 7fd6d5342640 1 --2- 172.21.15.45:0/4216287681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6d0148540 0x7fd6d0070470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.386+0000 7fd6d5342640 1 -- 172.21.15.45:0/4216287681 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c0009420 con 0x7fd6d006d630 2023-10-03T19:12:25.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.386+0000 7fd6d5342640 1 --2- 172.21.15.45:0/4216287681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6d006d630 0x7fd6d0148c10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc00d5f0 tx=0x7fd6cc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:25.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.386+0000 7fd6c5ffb640 1 -- 172.21.15.45:0/4216287681 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc0125f0 con 0x7fd6d006d630 2023-10-03T19:12:25.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.386+0000 7fd6c5ffb640 1 -- 172.21.15.45:0/4216287681 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6cc012750 con 0x7fd6d006d630 2023-10-03T19:12:25.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.386+0000 7fd6d75a6640 1 -- 172.21.15.45:0/4216287681 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d00bdda0 con 0x7fd6d006d630 2023-10-03T19:12:25.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.386+0000 7fd6c5ffb640 1 -- 172.21.15.45:0/4216287681 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc012ae0 con 0x7fd6d006d630 2023-10-03T19:12:25.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.386+0000 7fd6d75a6640 1 -- 172.21.15.45:0/4216287681 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d00bdc10 con 0x7fd6d006d630 2023-10-03T19:12:25.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.386+0000 7fd6d75a6640 1 -- 172.21.15.45:0/4216287681 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d0152350 con 0x7fd6d006d630 2023-10-03T19:12:25.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.386+0000 7fd6c5ffb640 1 -- 172.21.15.45:0/4216287681 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd6cc012c40 con 0x7fd6d006d630 2023-10-03T19:12:25.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.386+0000 7fd6c5ffb640 1 --2- 172.21.15.45:0/4216287681 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd6b4066280 0x7fd6b4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:25.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.386+0000 7fd6c5ffb640 1 -- 172.21.15.45:0/4216287681 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd6cc083f10 con 0x7fd6d006d630 2023-10-03T19:12:25.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.390+0000 7fd6d4b41640 1 --2- 172.21.15.45:0/4216287681 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd6b4066280 0x7fd6b4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:25.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.390+0000 7fd6d4b41640 1 --2- 172.21.15.45:0/4216287681 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd6b4066280 0x7fd6b4068730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd6c00af000 tx=0x7fd6c00a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:25.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.390+0000 7fd6c5ffb640 1 -- 172.21.15.45:0/4216287681 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd6cc0516d0 con 0x7fd6d006d630 2023-10-03T19:12:25.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.550+0000 7fd6d75a6640 1 -- 172.21.15.45:0/4216287681 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd6d00a49d0 con 0x7fd6d006d630 2023-10-03T19:12:25.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.550+0000 7fd6c5ffb640 1 -- 172.21.15.45:0/4216287681 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd6cc007380 con 0x7fd6d006d630 2023-10-03T19:12:25.553 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:12:25.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.554+0000 7fd6d75a6640 1 -- 172.21.15.45:0/4216287681 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd6b4066280 msgr2=0x7fd6b4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:25.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.554+0000 7fd6d75a6640 1 --2- 172.21.15.45:0/4216287681 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd6b4066280 0x7fd6b4068730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd6c00af000 tx=0x7fd6c00a7000 comp rx=0 tx=0).stop 2023-10-03T19:12:25.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.554+0000 7fd6d75a6640 1 -- 172.21.15.45:0/4216287681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6d006d630 msgr2=0x7fd6d0148c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:25.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.554+0000 7fd6d75a6640 1 --2- 172.21.15.45:0/4216287681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6d006d630 0x7fd6d0148c10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc00d5f0 tx=0x7fd6cc00dab0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.554+0000 7fd6d75a6640 1 -- 172.21.15.45:0/4216287681 shutdown_connections 2023-10-03T19:12:25.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.554+0000 7fd6d75a6640 1 --2- 172.21.15.45:0/4216287681 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd6b4066280 0x7fd6b4068730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.554+0000 7fd6d75a6640 1 --2- 172.21.15.45:0/4216287681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6d0148540 0x7fd6d0070470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.554+0000 7fd6d75a6640 1 --2- 172.21.15.45:0/4216287681 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd6d00bb5a0 0x7fd6d00a4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.554+0000 7fd6d75a6640 1 --2- 172.21.15.45:0/4216287681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6d006d630 0x7fd6d0148c10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.554+0000 7fd6d75a6640 1 -- 172.21.15.45:0/4216287681 >> 172.21.15.45:0/4216287681 conn(0x7fd6d00a20d0 msgr2=0x7fd6d00a24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:25.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.554+0000 7fd6d75a6640 1 -- 172.21.15.45:0/4216287681 shutdown_connections 2023-10-03T19:12:25.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.554+0000 7fd6d75a6640 1 -- 172.21.15.45:0/4216287681 wait complete. 2023-10-03T19:12:25.573 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-03T19:12:25.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.694+0000 7fab8d86e640 1 Processor -- start 2023-10-03T19:12:25.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.694+0000 7fab8d86e640 1 -- start start 2023-10-03T19:12:25.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.698+0000 7fab8d86e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fab88148b90 0x7fab880bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:25.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.698+0000 7fab8d86e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fab880bcb60 0x7fab8806c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:25.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.698+0000 7fab8d86e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab8814b610 con 0x7fab880bc4a0 2023-10-03T19:12:25.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.698+0000 7fab8d86e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab880a3670 con 0x7fab880bcb60 2023-10-03T19:12:25.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.698+0000 7fab8d86e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8814b370 con 0x7fab88148b90 2023-10-03T19:12:25.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.698+0000 7fab867fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fab880bcb60 0x7fab8806c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:25.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.698+0000 7fab867fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fab880bcb60 0x7fab8806c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46422/0 (socket says 172.21.15.45:46422) 2023-10-03T19:12:25.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.698+0000 7fab867fc640 1 -- 172.21.15.45:0/834172508 learned_addr learned my addr 172.21.15.45:0/834172508 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:25.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.698+0000 7fab86ffd640 1 --2- 172.21.15.45:0/834172508 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fab88148b90 0x7fab880bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:25.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.698+0000 7fab867fc640 1 -- 172.21.15.45:0/834172508 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fab88148b90 msgr2=0x7fab880bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:25.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.698+0000 7fab867fc640 1 --2- 172.21.15.45:0/834172508 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fab88148b90 0x7fab880bbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.698+0000 7fab867fc640 1 -- 172.21.15.45:0/834172508 >> v1:172.21.15.79:6789/0 conn(0x7fab880bc4a0 legacy=0x7fab8806c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:25.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.698+0000 7fab867fc640 1 -- 172.21.15.45:0/834172508 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab880a5580 con 0x7fab880bcb60 2023-10-03T19:12:25.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.698+0000 7fab867fc640 1 --2- 172.21.15.45:0/834172508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab880bcb60 0x7fab8806c290 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fab7c009870 tx=0x7fab7c01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=703d48e5ce067fdc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:25.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.698+0000 7fab85ffb640 1 -- 172.21.15.45:0/834172508 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c0a8a30 con 0x7fab880bcb60 2023-10-03T19:12:25.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.698+0000 7fab85ffb640 1 -- 172.21.15.45:0/834172508 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7c0a8b90 con 0x7fab880bcb60 2023-10-03T19:12:25.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.698+0000 7fab85ffb640 1 -- 172.21.15.45:0/834172508 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c0b0440 con 0x7fab880bcb60 2023-10-03T19:12:25.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.698+0000 7fab8d86e640 1 -- 172.21.15.45:0/834172508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab880bcb60 msgr2=0x7fab8806c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:25.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.698+0000 7fab8d86e640 1 --2- 172.21.15.45:0/834172508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab880bcb60 0x7fab8806c290 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fab7c009870 tx=0x7fab7c01ed30 comp rx=0 tx=0).stop 2023-10-03T19:12:25.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.698+0000 7fab8d86e640 1 -- 172.21.15.45:0/834172508 shutdown_connections 2023-10-03T19:12:25.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.698+0000 7fab8d86e640 1 --2- 172.21.15.45:0/834172508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab880bcb60 0x7fab8806c290 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.698+0000 7fab8d86e640 1 --2- 172.21.15.45:0/834172508 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fab88148b90 0x7fab880bbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.698+0000 7fab8d86e640 1 -- 172.21.15.45:0/834172508 >> 172.21.15.45:0/834172508 conn(0x7fab880bcf50 msgr2=0x7fab880bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:25.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.698+0000 7fab8d86e640 1 -- 172.21.15.45:0/834172508 shutdown_connections 2023-10-03T19:12:25.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.698+0000 7fab8d86e640 1 -- 172.21.15.45:0/834172508 wait complete. 2023-10-03T19:12:25.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.702+0000 7fab8d86e640 1 Processor -- start 2023-10-03T19:12:25.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.702+0000 7fab8d86e640 1 -- start start 2023-10-03T19:12:25.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.702+0000 7fab8d86e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fab880bc4a0 0x7fab880b9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:25.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.702+0000 7fab8d86e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab880bcb60 0x7fab88070e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:25.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.702+0000 7fab8d86e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab88148b90 0x7fab88142960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:25.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.702+0000 7fab8d86e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8806fc90 con 0x7fab880bcb60 2023-10-03T19:12:25.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.702+0000 7fab8d86e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab880ba090 con 0x7fab88148b90 2023-10-03T19:12:25.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.702+0000 7fab8d86e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8806fea0 con 0x7fab880bc4a0 2023-10-03T19:12:25.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.702+0000 7fab867fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab880bcb60 0x7fab88070e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:25.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.702+0000 7fab867fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab880bcb60 0x7fab88070e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46430/0 (socket says 172.21.15.45:46430) 2023-10-03T19:12:25.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.702+0000 7fab867fc640 1 -- 172.21.15.45:0/3321740935 learned_addr learned my addr 172.21.15.45:0/3321740935 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:25.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.702+0000 7fab86ffd640 1 --2- 172.21.15.45:0/3321740935 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fab880bc4a0 0x7fab880b9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:25.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.702+0000 7fab877fe640 1 --2- 172.21.15.45:0/3321740935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab88148b90 0x7fab88142960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:25.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.702+0000 7fab867fc640 1 -- 172.21.15.45:0/3321740935 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fab880bc4a0 msgr2=0x7fab880b9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:25.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.702+0000 7fab867fc640 1 --2- 172.21.15.45:0/3321740935 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fab880bc4a0 0x7fab880b9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.702+0000 7fab867fc640 1 -- 172.21.15.45:0/3321740935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab88148b90 msgr2=0x7fab88142960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:25.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.702+0000 7fab867fc640 1 --2- 172.21.15.45:0/3321740935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab88148b90 0x7fab88142960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.702+0000 7fab867fc640 1 -- 172.21.15.45:0/3321740935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab7c0094d0 con 0x7fab880bcb60 2023-10-03T19:12:25.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.702+0000 7fab877fe640 1 --2- 172.21.15.45:0/3321740935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab88148b90 0x7fab88142960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:25.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.702+0000 7fab867fc640 1 --2- 172.21.15.45:0/3321740935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab880bcb60 0x7fab88070e90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fab7c01d3e0 tx=0x7fab7c01bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:25.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.702+0000 7fab6ffff640 1 -- 172.21.15.45:0/3321740935 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c0ba600 con 0x7fab880bcb60 2023-10-03T19:12:25.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.702+0000 7fab6ffff640 1 -- 172.21.15.45:0/3321740935 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7c0ba780 con 0x7fab880bcb60 2023-10-03T19:12:25.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.702+0000 7fab8d86e640 1 -- 172.21.15.45:0/3321740935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8806cee0 con 0x7fab880bcb60 2023-10-03T19:12:25.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.702+0000 7fab6ffff640 1 -- 172.21.15.45:0/3321740935 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c0bab30 con 0x7fab880bcb60 2023-10-03T19:12:25.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.702+0000 7fab8d86e640 1 -- 172.21.15.45:0/3321740935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab880a5820 con 0x7fab880bcb60 2023-10-03T19:12:25.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.702+0000 7fab8d86e640 1 -- 172.21.15.45:0/3321740935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab88148f60 con 0x7fab880bcb60 2023-10-03T19:12:25.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.706+0000 7fab6ffff640 1 -- 172.21.15.45:0/3321740935 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fab7c0bac90 con 0x7fab880bcb60 2023-10-03T19:12:25.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.706+0000 7fab6ffff640 1 --2- 172.21.15.45:0/3321740935 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fab74066280 0x7fab74068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:25.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.706+0000 7fab6ffff640 1 -- 172.21.15.45:0/3321740935 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fab7c121ee0 con 0x7fab880bcb60 2023-10-03T19:12:25.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.706+0000 7fab86ffd640 1 --2- 172.21.15.45:0/3321740935 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fab74066280 0x7fab74068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:25.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.706+0000 7fab86ffd640 1 --2- 172.21.15.45:0/3321740935 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fab74066280 0x7fab74068730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fab780096f0 tx=0x7fab78008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:25.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.710+0000 7fab6ffff640 1 -- 172.21.15.45:0/3321740935 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fab7c0ef740 con 0x7fab880bcb60 2023-10-03T19:12:25.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.866+0000 7fab8d86e640 1 -- 172.21.15.45:0/3321740935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fab8806ffe0 con 0x7fab880bcb60 2023-10-03T19:12:25.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.866+0000 7fab6ffff640 1 -- 172.21.15.45:0/3321740935 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+126 (secure 0 0 0) 0x7fab8806ffe0 con 0x7fab880bcb60 2023-10-03T19:12:25.870 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:25.870 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-10-03T19:12:25.870 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:12:25.870 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-10-03T19:12:25.871 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-10-03T19:12:25.871 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:12:25.871 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:12:25.871 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 2, 2023-10-03T19:12:25.871 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "rbd" 2023-10-03T19:12:25.871 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:12:25.871 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-10-03T19:12:25.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.870+0000 7fab8d86e640 1 -- 172.21.15.45:0/3321740935 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fab74066280 msgr2=0x7fab74068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.870+0000 7fab8d86e640 1 --2- 172.21.15.45:0/3321740935 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fab74066280 0x7fab74068730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fab780096f0 tx=0x7fab78008040 comp rx=0 tx=0).stop 2023-10-03T19:12:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.870+0000 7fab8d86e640 1 -- 172.21.15.45:0/3321740935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab880bcb60 msgr2=0x7fab88070e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.870+0000 7fab8d86e640 1 --2- 172.21.15.45:0/3321740935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab880bcb60 0x7fab88070e90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fab7c01d3e0 tx=0x7fab7c01bad0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.870+0000 7fab8d86e640 1 -- 172.21.15.45:0/3321740935 shutdown_connections 2023-10-03T19:12:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.870+0000 7fab8d86e640 1 --2- 172.21.15.45:0/3321740935 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fab74066280 0x7fab74068730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.870+0000 7fab8d86e640 1 --2- 172.21.15.45:0/3321740935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab88148b90 0x7fab88142960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.870+0000 7fab8d86e640 1 --2- 172.21.15.45:0/3321740935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab880bcb60 0x7fab88070e90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.870+0000 7fab8d86e640 1 --2- 172.21.15.45:0/3321740935 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fab880bc4a0 0x7fab880b9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.870+0000 7fab8d86e640 1 -- 172.21.15.45:0/3321740935 >> 172.21.15.45:0/3321740935 conn(0x7fab880bcf50 msgr2=0x7fab880bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.870+0000 7fab8d86e640 1 -- 172.21.15.45:0/3321740935 shutdown_connections 2023-10-03T19:12:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:25.870+0000 7fab8d86e640 1 -- 172.21.15.45:0/3321740935 wait complete. 2023-10-03T19:12:25.889 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-03T19:12:25.890 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-03T19:12:26.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.018+0000 7f0e41a9d640 1 Processor -- start 2023-10-03T19:12:26.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.018+0000 7f0e41a9d640 1 -- start start 2023-10-03T19:12:26.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.018+0000 7f0e41a9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0e3c0c14e0 0x7f0e3c0c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:26.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.018+0000 7f0e41a9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0e3c0bf1f0 0x7f0e3c0a9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:26.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.018+0000 7f0e41a9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e3c0c2770 0x7f0e3c0a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:26.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.018+0000 7f0e41a9d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e3c06ac70 con 0x7f0e3c0bf1f0 2023-10-03T19:12:26.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.018+0000 7f0e41a9d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e3c0c3000 con 0x7f0e3c0c14e0 2023-10-03T19:12:26.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.018+0000 7f0e41a9d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c0aa5f0 con 0x7f0e3c0c2770 2023-10-03T19:12:26.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.018+0000 7f0e3affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0e3c0bf1f0 0x7f0e3c0a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:26.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.018+0000 7f0e3affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0e3c0bf1f0 0x7f0e3c0a9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46440/0 (socket says 172.21.15.45:46440) 2023-10-03T19:12:26.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.018+0000 7f0e3affd640 1 -- 172.21.15.45:0/3810865386 learned_addr learned my addr 172.21.15.45:0/3810865386 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:26.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.018+0000 7f0e3b7fe640 1 --2- 172.21.15.45:0/3810865386 >> v2:172.21.15.79:3300/0 conn(0x7f0e3c0c14e0 0x7f0e3c0c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:26.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.018+0000 7f0e3bfff640 1 --2- 172.21.15.45:0/3810865386 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e3c0c2770 0x7f0e3c0a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:26.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.018+0000 7f0e3affd640 1 -- 172.21.15.45:0/3810865386 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e3c0c2770 msgr2=0x7f0e3c0a9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:26.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.018+0000 7f0e3affd640 1 --2- 172.21.15.45:0/3810865386 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e3c0c2770 0x7f0e3c0a9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:26.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.018+0000 7f0e3affd640 1 -- 172.21.15.45:0/3810865386 >> v2:172.21.15.79:3300/0 conn(0x7f0e3c0c14e0 msgr2=0x7f0e3c0c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:26.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.018+0000 7f0e3affd640 1 --2- 172.21.15.45:0/3810865386 >> v2:172.21.15.79:3300/0 conn(0x7f0e3c0c14e0 0x7f0e3c0c0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:26.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.018+0000 7f0e3affd640 1 -- 172.21.15.45:0/3810865386 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c14f250 con 0x7f0e3c0bf1f0 2023-10-03T19:12:26.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e3affd640 1 --2- 172.21.15.45:0/3810865386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e3c0bf1f0 0x7f0e3c0a9860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c08aaa0 tx=0x7f0e3001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7889d8ad61f292a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:26.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e3a7fc640 1 -- 172.21.15.45:0/3810865386 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e300a89b0 con 0x7f0e3c0bf1f0 2023-10-03T19:12:26.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e3a7fc640 1 -- 172.21.15.45:0/3810865386 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e300a8b10 con 0x7f0e3c0bf1f0 2023-10-03T19:12:26.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e3a7fc640 1 -- 172.21.15.45:0/3810865386 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e300a8ea0 con 0x7f0e3c0bf1f0 2023-10-03T19:12:26.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e41a9d640 1 -- 172.21.15.45:0/3810865386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e3c0bf1f0 msgr2=0x7f0e3c0a9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:26.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e41a9d640 1 --2- 172.21.15.45:0/3810865386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e3c0bf1f0 0x7f0e3c0a9860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c08aaa0 tx=0x7f0e3001ecf0 comp rx=0 tx=0).stop 2023-10-03T19:12:26.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e41a9d640 1 -- 172.21.15.45:0/3810865386 shutdown_connections 2023-10-03T19:12:26.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e41a9d640 1 --2- 172.21.15.45:0/3810865386 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e3c0c2770 0x7f0e3c0a9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:26.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e41a9d640 1 --2- 172.21.15.45:0/3810865386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e3c0bf1f0 0x7f0e3c0a9860 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:26.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e41a9d640 1 --2- 172.21.15.45:0/3810865386 >> v2:172.21.15.79:3300/0 conn(0x7f0e3c0c14e0 0x7f0e3c0c0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:26.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e41a9d640 1 -- 172.21.15.45:0/3810865386 >> 172.21.15.45:0/3810865386 conn(0x7f0e3c0a6440 msgr2=0x7f0e3c0a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:26.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e41a9d640 1 -- 172.21.15.45:0/3810865386 shutdown_connections 2023-10-03T19:12:26.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e41a9d640 1 -- 172.21.15.45:0/3810865386 wait complete. 2023-10-03T19:12:26.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e41a9d640 1 Processor -- start 2023-10-03T19:12:26.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e41a9d640 1 -- start start 2023-10-03T19:12:26.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e41a9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e3c0bf1f0 0x7f0e3c1e7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:26.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e41a9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e3c0c14e0 0x7f0e3c09a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:26.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e41a9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e3c0c2770 0x7f0e3c0c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:26.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e41a9d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c09d730 con 0x7f0e3c0c14e0 2023-10-03T19:12:26.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e41a9d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c09aa60 con 0x7f0e3c0c2770 2023-10-03T19:12:26.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e41a9d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c09d0c0 con 0x7f0e3c0bf1f0 2023-10-03T19:12:26.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e3affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e3c0c14e0 0x7f0e3c09a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:26.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e3affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e3c0c14e0 0x7f0e3c09a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46456/0 (socket says 172.21.15.45:46456) 2023-10-03T19:12:26.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e3affd640 1 -- 172.21.15.45:0/1590736731 learned_addr learned my addr 172.21.15.45:0/1590736731 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:26.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e3bfff640 1 --2- 172.21.15.45:0/1590736731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e3c0c2770 0x7f0e3c0c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:26.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e3affd640 1 -- 172.21.15.45:0/1590736731 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e3c0bf1f0 msgr2=0x7f0e3c1e7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:26.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e3affd640 1 --2- 172.21.15.45:0/1590736731 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e3c0bf1f0 0x7f0e3c1e7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:26.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e3affd640 1 -- 172.21.15.45:0/1590736731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e3c0c2770 msgr2=0x7f0e3c0c4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:26.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e3affd640 1 --2- 172.21.15.45:0/1590736731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e3c0c2770 0x7f0e3c0c4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:26.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e3affd640 1 -- 172.21.15.45:0/1590736731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e300094d0 con 0x7f0e3c0c14e0 2023-10-03T19:12:26.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e3bfff640 1 --2- 172.21.15.45:0/1590736731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e3c0c2770 0x7f0e3c0c4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:26.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e3affd640 1 --2- 172.21.15.45:0/1590736731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e3c0c14e0 0x7f0e3c09a520 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0e3001d3a0 tx=0x7f0e3001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:26.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e23fff640 1 -- 172.21.15.45:0/1590736731 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e300ba600 con 0x7f0e3c0c14e0 2023-10-03T19:12:26.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e23fff640 1 -- 172.21.15.45:0/1590736731 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e300ba760 con 0x7f0e3c0c14e0 2023-10-03T19:12:26.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e41a9d640 1 -- 172.21.15.45:0/1590736731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e3c06b100 con 0x7f0e3c0c14e0 2023-10-03T19:12:26.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e23fff640 1 -- 172.21.15.45:0/1590736731 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e300bab10 con 0x7f0e3c0c14e0 2023-10-03T19:12:26.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.022+0000 7f0e41a9d640 1 -- 172.21.15.45:0/1590736731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3c14f530 con 0x7f0e3c0c14e0 2023-10-03T19:12:26.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.026+0000 7f0e41a9d640 1 -- 172.21.15.45:0/1590736731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e3c0aa2e0 con 0x7f0e3c0c14e0 2023-10-03T19:12:26.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.026+0000 7f0e23fff640 1 -- 172.21.15.45:0/1590736731 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0e300bac70 con 0x7f0e3c0c14e0 2023-10-03T19:12:26.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.026+0000 7f0e23fff640 1 --2- 172.21.15.45:0/1590736731 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0e28066280 0x7f0e28068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:26.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.026+0000 7f0e23fff640 1 -- 172.21.15.45:0/1590736731 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0e30121fe0 con 0x7f0e3c0c14e0 2023-10-03T19:12:26.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.026+0000 7f0e3b7fe640 1 --2- 172.21.15.45:0/1590736731 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0e28066280 0x7f0e28068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:26.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.026+0000 7f0e3b7fe640 1 --2- 172.21.15.45:0/1590736731 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0e28066280 0x7f0e28068730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c009870 tx=0x7f0e2c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:26.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.030+0000 7f0e23fff640 1 -- 172.21.15.45:0/1590736731 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0e300ef7c0 con 0x7f0e3c0c14e0 2023-10-03T19:12:26.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.182+0000 7f0e41a9d640 1 -- 172.21.15.45:0/1590736731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0e3c04de80 con 0x7f0e3c0c14e0 2023-10-03T19:12:26.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.542+0000 7f0e23fff640 1 -- 172.21.15.45:0/1590736731 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0e300b50b0 con 0x7f0e3c0c14e0 2023-10-03T19:12:26.544 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-10-03T19:12:26.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.546+0000 7f0e41a9d640 1 -- 172.21.15.45:0/1590736731 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0e28066280 msgr2=0x7f0e28068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:26.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.546+0000 7f0e41a9d640 1 --2- 172.21.15.45:0/1590736731 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0e28066280 0x7f0e28068730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c009870 tx=0x7f0e2c008040 comp rx=0 tx=0).stop 2023-10-03T19:12:26.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.546+0000 7f0e41a9d640 1 -- 172.21.15.45:0/1590736731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e3c0c14e0 msgr2=0x7f0e3c09a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:26.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.546+0000 7f0e41a9d640 1 --2- 172.21.15.45:0/1590736731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e3c0c14e0 0x7f0e3c09a520 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0e3001d3a0 tx=0x7f0e3001ba90 comp rx=0 tx=0).stop 2023-10-03T19:12:26.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.546+0000 7f0e41a9d640 1 -- 172.21.15.45:0/1590736731 shutdown_connections 2023-10-03T19:12:26.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.546+0000 7f0e41a9d640 1 --2- 172.21.15.45:0/1590736731 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0e28066280 0x7f0e28068730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:26.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.546+0000 7f0e41a9d640 1 --2- 172.21.15.45:0/1590736731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e3c0c2770 0x7f0e3c0c4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:26.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.546+0000 7f0e41a9d640 1 --2- 172.21.15.45:0/1590736731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e3c0c14e0 0x7f0e3c09a520 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:26.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.546+0000 7f0e41a9d640 1 --2- 172.21.15.45:0/1590736731 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e3c0bf1f0 0x7f0e3c1e7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:26.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.546+0000 7f0e41a9d640 1 -- 172.21.15.45:0/1590736731 >> 172.21.15.45:0/1590736731 conn(0x7f0e3c0a6440 msgr2=0x7f0e3c0c42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:26.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.546+0000 7f0e41a9d640 1 -- 172.21.15.45:0/1590736731 shutdown_connections 2023-10-03T19:12:26.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.546+0000 7f0e41a9d640 1 -- 172.21.15.45:0/1590736731 wait complete. 2023-10-03T19:12:26.577 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-03T19:12:26.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.710+0000 7fdc8225f640 1 Processor -- start 2023-10-03T19:12:26.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.710+0000 7fdc8225f640 1 -- start start 2023-10-03T19:12:26.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.710+0000 7fdc8225f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdc7c0bf170 0x7fdc7c0c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:26.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.710+0000 7fdc8225f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc7c14f660 con 0x7fdc7c0c26f0 2023-10-03T19:12:26.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.710+0000 7fdc8225f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc7c0c0f80 con 0x7fdc7c0c1200 2023-10-03T19:12:26.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.710+0000 7fdc8225f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc7c0c0b60 con 0x7fdc7c0bf170 2023-10-03T19:12:26.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.710+0000 7fdc7bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdc7c0c26f0 0x7fdc7c069ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35722/0 (socket says 172.21.15.45:35722) 2023-10-03T19:12:26.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.710+0000 7fdc7bfff640 1 -- 172.21.15.45:0/2533809104 learned_addr learned my addr 172.21.15.45:0/2533809104 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:26.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.710+0000 7fdc7affd640 1 --2- 172.21.15.45:0/2533809104 >> v2:172.21.15.45:3300/0 conn(0x7fdc7c0bf170 0x7fdc7c0c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:26.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.710+0000 7fdc7a7fc640 1 -- 172.21.15.45:0/2533809104 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3660699496 0 0) 0x7fdc7c14f660 con 0x7fdc7c0c26f0 2023-10-03T19:12:26.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.710+0000 7fdc7a7fc640 1 -- 172.21.15.45:0/2533809104 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc64003530 con 0x7fdc7c0c26f0 2023-10-03T19:12:26.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.710+0000 7fdc7affd640 1 -- 172.21.15.45:0/2533809104 >> v1:172.21.15.79:6789/0 conn(0x7fdc7c0c1200 legacy=0x7fdc7c14e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:26.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.710+0000 7fdc7affd640 1 -- 172.21.15.45:0/2533809104 >> v1:172.21.15.45:6789/0 conn(0x7fdc7c0c26f0 legacy=0x7fdc7c069ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:26.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.710+0000 7fdc7affd640 1 -- 172.21.15.45:0/2533809104 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc7c14f380 con 0x7fdc7c0bf170 2023-10-03T19:12:26.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.714+0000 7fdc7affd640 1 --2- 172.21.15.45:0/2533809104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc7c0bf170 0x7fdc7c0c15d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdc700097f0 tx=0x7fdc7001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c40b8ac6936580e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:26.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.714+0000 7fdc7a7fc640 1 -- 172.21.15.45:0/2533809104 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c06a5f0 con 0x7fdc7c0bf170 2023-10-03T19:12:26.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.714+0000 7fdc7a7fc640 1 -- 172.21.15.45:0/2533809104 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc700a7050 con 0x7fdc7c0bf170 2023-10-03T19:12:26.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.714+0000 7fdc7a7fc640 1 -- 172.21.15.45:0/2533809104 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc700ab820 con 0x7fdc7c0bf170 2023-10-03T19:12:26.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.714+0000 7fdc8225f640 1 -- 172.21.15.45:0/2533809104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc7c0bf170 msgr2=0x7fdc7c0c15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:26.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.714+0000 7fdc8225f640 1 --2- 172.21.15.45:0/2533809104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc7c0bf170 0x7fdc7c0c15d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdc700097f0 tx=0x7fdc7001c480 comp rx=0 tx=0).stop 2023-10-03T19:12:26.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.714+0000 7fdc8225f640 1 -- 172.21.15.45:0/2533809104 shutdown_connections 2023-10-03T19:12:26.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.714+0000 7fdc8225f640 1 --2- 172.21.15.45:0/2533809104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc7c0bf170 0x7fdc7c0c15d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:26.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.714+0000 7fdc8225f640 1 -- 172.21.15.45:0/2533809104 >> 172.21.15.45:0/2533809104 conn(0x7fdc7c0a6340 msgr2=0x7fdc7c0a6710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:26.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.714+0000 7fdc8225f640 1 -- 172.21.15.45:0/2533809104 shutdown_connections 2023-10-03T19:12:26.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.714+0000 7fdc8225f640 1 -- 172.21.15.45:0/2533809104 wait complete. 2023-10-03T19:12:26.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.718+0000 7fdc8225f640 1 Processor -- start 2023-10-03T19:12:26.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.718+0000 7fdc8225f640 1 -- start start 2023-10-03T19:12:26.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.718+0000 7fdc8225f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc7c0bf170 0x7fdc7c149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:26.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.718+0000 7fdc8225f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc7c0c1200 0x7fdc7c0ba170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:26.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.718+0000 7fdc8225f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc7c0c26f0 0x7fdc7c0ba6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:26.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.718+0000 7fdc8225f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c14d4a0 con 0x7fdc7c0c26f0 2023-10-03T19:12:26.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.718+0000 7fdc8225f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c0babf0 con 0x7fdc7c0c1200 2023-10-03T19:12:26.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.718+0000 7fdc8225f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c1eadf0 con 0x7fdc7c0bf170 2023-10-03T19:12:26.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.718+0000 7fdc7bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc7c0c26f0 0x7fdc7c0ba6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:26.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.718+0000 7fdc7bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc7c0c26f0 0x7fdc7c0ba6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46482/0 (socket says 172.21.15.45:46482) 2023-10-03T19:12:26.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.718+0000 7fdc7bfff640 1 -- 172.21.15.45:0/2976857234 learned_addr learned my addr 172.21.15.45:0/2976857234 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:26.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.718+0000 7fdc7affd640 1 --2- 172.21.15.45:0/2976857234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc7c0c1200 0x7fdc7c0ba170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:26.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.718+0000 7fdc7b7fe640 1 --2- 172.21.15.45:0/2976857234 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc7c0bf170 0x7fdc7c149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:26.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.718+0000 7fdc7bfff640 1 -- 172.21.15.45:0/2976857234 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc7c0bf170 msgr2=0x7fdc7c149240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:26.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.718+0000 7fdc7bfff640 1 --2- 172.21.15.45:0/2976857234 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc7c0bf170 0x7fdc7c149240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:26.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.718+0000 7fdc7bfff640 1 -- 172.21.15.45:0/2976857234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc7c0c1200 msgr2=0x7fdc7c0ba170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:26.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.718+0000 7fdc7bfff640 1 --2- 172.21.15.45:0/2976857234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc7c0c1200 0x7fdc7c0ba170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:26.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.718+0000 7fdc7bfff640 1 -- 172.21.15.45:0/2976857234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc70009420 con 0x7fdc7c0c26f0 2023-10-03T19:12:26.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.718+0000 7fdc7b7fe640 1 --2- 172.21.15.45:0/2976857234 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc7c0bf170 0x7fdc7c149240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:12:26.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.718+0000 7fdc7bfff640 1 --2- 172.21.15.45:0/2976857234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc7c0c26f0 0x7fdc7c0ba6b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c00c390 tx=0x7fdc6c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:26.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.718+0000 7fdc63fff640 1 -- 172.21.15.45:0/2976857234 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c005cf0 con 0x7fdc7c0c26f0 2023-10-03T19:12:26.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.718+0000 7fdc63fff640 1 -- 172.21.15.45:0/2976857234 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6c005e50 con 0x7fdc7c0c26f0 2023-10-03T19:12:26.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.718+0000 7fdc8225f640 1 -- 172.21.15.45:0/2976857234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc7c0aa100 con 0x7fdc7c0c26f0 2023-10-03T19:12:26.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.718+0000 7fdc63fff640 1 -- 172.21.15.45:0/2976857234 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c0072d0 con 0x7fdc7c0c26f0 2023-10-03T19:12:26.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.718+0000 7fdc8225f640 1 -- 172.21.15.45:0/2976857234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc7c0a9f70 con 0x7fdc7c0c26f0 2023-10-03T19:12:26.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.722+0000 7fdc8225f640 1 -- 172.21.15.45:0/2976857234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc7c0aa290 con 0x7fdc7c0c26f0 2023-10-03T19:12:26.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.722+0000 7fdc63fff640 1 -- 172.21.15.45:0/2976857234 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdc6c007430 con 0x7fdc7c0c26f0 2023-10-03T19:12:26.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.722+0000 7fdc63fff640 1 --2- 172.21.15.45:0/2976857234 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fdc68066280 0x7fdc68068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:26.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.722+0000 7fdc63fff640 1 -- 172.21.15.45:0/2976857234 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fdc6c083030 con 0x7fdc7c0c26f0 2023-10-03T19:12:26.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.722+0000 7fdc7b7fe640 1 --2- 172.21.15.45:0/2976857234 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fdc68066280 0x7fdc68068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:26.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.722+0000 7fdc7b7fe640 1 --2- 172.21.15.45:0/2976857234 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fdc68066280 0x7fdc68068730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdc740012f0 tx=0x7fdc74009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:26.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.726+0000 7fdc63fff640 1 -- 172.21.15.45:0/2976857234 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fdc6c050890 con 0x7fdc7c0c26f0 2023-10-03T19:12:26.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:26.882+0000 7fdc8225f640 1 -- 172.21.15.45:0/2976857234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdc7c14b7c0 con 0x7fdc7c0c26f0 2023-10-03T19:12:27.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.550+0000 7fdc63fff640 1 -- 172.21.15.45:0/2976857234 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7fdc7c14b7c0 con 0x7fdc7c0c26f0 2023-10-03T19:12:27.553 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-10-03T19:12:27.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.562+0000 7fdc8225f640 1 -- 172.21.15.45:0/2976857234 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fdc68066280 msgr2=0x7fdc68068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:27.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.562+0000 7fdc8225f640 1 --2- 172.21.15.45:0/2976857234 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fdc68066280 0x7fdc68068730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdc740012f0 tx=0x7fdc74009040 comp rx=0 tx=0).stop 2023-10-03T19:12:27.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.562+0000 7fdc8225f640 1 -- 172.21.15.45:0/2976857234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc7c0c26f0 msgr2=0x7fdc7c0ba6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:27.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.562+0000 7fdc8225f640 1 --2- 172.21.15.45:0/2976857234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc7c0c26f0 0x7fdc7c0ba6b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c00c390 tx=0x7fdc6c00c850 comp rx=0 tx=0).stop 2023-10-03T19:12:27.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.566+0000 7fdc8225f640 1 -- 172.21.15.45:0/2976857234 shutdown_connections 2023-10-03T19:12:27.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.566+0000 7fdc8225f640 1 --2- 172.21.15.45:0/2976857234 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fdc68066280 0x7fdc68068730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:27.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.566+0000 7fdc8225f640 1 --2- 172.21.15.45:0/2976857234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc7c0c26f0 0x7fdc7c0ba6b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:27.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.566+0000 7fdc8225f640 1 --2- 172.21.15.45:0/2976857234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc7c0c1200 0x7fdc7c0ba170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:27.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.566+0000 7fdc8225f640 1 --2- 172.21.15.45:0/2976857234 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc7c0bf170 0x7fdc7c149240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:27.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.566+0000 7fdc8225f640 1 -- 172.21.15.45:0/2976857234 >> 172.21.15.45:0/2976857234 conn(0x7fdc7c0a6340 msgr2=0x7fdc7c0a5270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:27.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.582+0000 7fdc8225f640 1 -- 172.21.15.45:0/2976857234 shutdown_connections 2023-10-03T19:12:27.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.582+0000 7fdc8225f640 1 -- 172.21.15.45:0/2976857234 wait complete. 2023-10-03T19:12:27.613 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-03T19:12:27.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.734+0000 7f9396efa640 1 Processor -- start 2023-10-03T19:12:27.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.734+0000 7f9396efa640 1 -- start start 2023-10-03T19:12:27.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.734+0000 7f9396efa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f93900712c0 0x7f93900bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:27.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.734+0000 7f9396efa640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f939006c760 0x7f93900bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:27.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.734+0000 7f9396efa640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f939006c2d0 con 0x7f939006d560 2023-10-03T19:12:27.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.734+0000 7f9396efa640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9390150610 con 0x7f93900712c0 2023-10-03T19:12:27.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.734+0000 7f9396efa640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93901508b0 con 0x7f939006c760 2023-10-03T19:12:27.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.734+0000 7f9394c96640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f93900712c0 0x7f93900bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:27.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.734+0000 7f9394c96640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f93900712c0 0x7f93900bcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46490/0 (socket says 172.21.15.45:46490) 2023-10-03T19:12:27.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.734+0000 7f9394c96640 1 -- 172.21.15.45:0/481070876 learned_addr learned my addr 172.21.15.45:0/481070876 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:27.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.734+0000 7f9395497640 1 --2- 172.21.15.45:0/481070876 >> v2:172.21.15.79:3300/0 conn(0x7f939006c760 0x7f93900bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:27.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.734+0000 7f9394c96640 1 -- 172.21.15.45:0/481070876 >> v2:172.21.15.79:3300/0 conn(0x7f939006c760 msgr2=0x7f93900bd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:27.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.734+0000 7f9394c96640 1 --2- 172.21.15.45:0/481070876 >> v2:172.21.15.79:3300/0 conn(0x7f939006c760 0x7f93900bd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:27.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.734+0000 7f9394c96640 1 -- 172.21.15.45:0/481070876 >> v1:172.21.15.79:6789/0 conn(0x7f939006d560 legacy=0x7f93900a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:27.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.734+0000 7f9394c96640 1 -- 172.21.15.45:0/481070876 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f939006d2e0 con 0x7f93900712c0 2023-10-03T19:12:27.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.734+0000 7f9395497640 1 --2- 172.21.15.45:0/481070876 >> v2:172.21.15.79:3300/0 conn(0x7f939006c760 0x7f93900bd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:27.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f9394c96640 1 --2- 172.21.15.45:0/481070876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93900712c0 0x7f93900bcbc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f93900c14e0 tx=0x7f938001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711e1e591c3e0d00 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:27.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f938f7fe640 1 -- 172.21.15.45:0/481070876 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93800ab600 con 0x7f93900712c0 2023-10-03T19:12:27.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f938f7fe640 1 -- 172.21.15.45:0/481070876 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93800ab760 con 0x7f93900712c0 2023-10-03T19:12:27.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f938f7fe640 1 -- 172.21.15.45:0/481070876 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93800abaf0 con 0x7f93900712c0 2023-10-03T19:12:27.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f9396efa640 1 -- 172.21.15.45:0/481070876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93900712c0 msgr2=0x7f93900bcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:27.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f9396efa640 1 --2- 172.21.15.45:0/481070876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93900712c0 0x7f93900bcbc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f93900c14e0 tx=0x7f938001c4c0 comp rx=0 tx=0).stop 2023-10-03T19:12:27.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f9396efa640 1 -- 172.21.15.45:0/481070876 shutdown_connections 2023-10-03T19:12:27.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f9396efa640 1 --2- 172.21.15.45:0/481070876 >> v2:172.21.15.79:3300/0 conn(0x7f939006c760 0x7f93900bd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:27.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f9396efa640 1 --2- 172.21.15.45:0/481070876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93900712c0 0x7f93900bcbc0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:27.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f9396efa640 1 -- 172.21.15.45:0/481070876 >> 172.21.15.45:0/481070876 conn(0x7f93900a20d0 msgr2=0x7f93900a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:27.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f9396efa640 1 -- 172.21.15.45:0/481070876 shutdown_connections 2023-10-03T19:12:27.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f9396efa640 1 -- 172.21.15.45:0/481070876 wait complete. 2023-10-03T19:12:27.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f9396efa640 1 Processor -- start 2023-10-03T19:12:27.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f9396efa640 1 -- start start 2023-10-03T19:12:27.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f9396efa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f939006c760 0x7f9390148540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:27.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f9396efa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f939006d560 0x7f939014df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:27.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f9396efa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93900712c0 0x7f939014e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:27.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f9396efa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939014ae70 con 0x7f93900712c0 2023-10-03T19:12:27.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f9396efa640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93901494e0 con 0x7f939006d560 2023-10-03T19:12:27.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f9396efa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f939014b0c0 con 0x7f939006c760 2023-10-03T19:12:27.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f9395497640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93900712c0 0x7f939014e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:27.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f9395497640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93900712c0 0x7f939014e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46492/0 (socket says 172.21.15.45:46492) 2023-10-03T19:12:27.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f9395497640 1 -- 172.21.15.45:0/1985449661 learned_addr learned my addr 172.21.15.45:0/1985449661 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:27.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f9394c96640 1 --2- 172.21.15.45:0/1985449661 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f939006c760 0x7f9390148540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:27.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f938ffff640 1 --2- 172.21.15.45:0/1985449661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f939006d560 0x7f939014df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:27.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f9395497640 1 -- 172.21.15.45:0/1985449661 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f939006c760 msgr2=0x7f9390148540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:27.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f9395497640 1 --2- 172.21.15.45:0/1985449661 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f939006c760 0x7f9390148540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:27.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f9395497640 1 -- 172.21.15.45:0/1985449661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f939006d560 msgr2=0x7f939014df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:27.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f9395497640 1 --2- 172.21.15.45:0/1985449661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f939006d560 0x7f939014df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:27.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f9395497640 1 -- 172.21.15.45:0/1985449661 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93800094d0 con 0x7f93900712c0 2023-10-03T19:12:27.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f9395497640 1 --2- 172.21.15.45:0/1985449661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93900712c0 0x7f939014e440 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f938800cd80 tx=0x7f938800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:27.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f938d7fa640 1 -- 172.21.15.45:0/1985449661 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938800f680 con 0x7f93900712c0 2023-10-03T19:12:27.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f938d7fa640 1 -- 172.21.15.45:0/1985449661 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938800f800 con 0x7f93900712c0 2023-10-03T19:12:27.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.738+0000 7f9396efa640 1 -- 172.21.15.45:0/1985449661 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93900a6070 con 0x7f93900712c0 2023-10-03T19:12:27.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.742+0000 7f938d7fa640 1 -- 172.21.15.45:0/1985449661 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938800fbb0 con 0x7f93900712c0 2023-10-03T19:12:27.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.742+0000 7f9396efa640 1 -- 172.21.15.45:0/1985449661 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93900a5ee0 con 0x7f93900712c0 2023-10-03T19:12:27.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.742+0000 7f9396efa640 1 -- 172.21.15.45:0/1985449661 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93901596f0 con 0x7f93900712c0 2023-10-03T19:12:27.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.742+0000 7f938d7fa640 1 -- 172.21.15.45:0/1985449661 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f938800b040 con 0x7f93900712c0 2023-10-03T19:12:27.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.742+0000 7f938d7fa640 1 --2- 172.21.15.45:0/1985449661 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f937c066280 0x7f937c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:27.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.742+0000 7f938d7fa640 1 -- 172.21.15.45:0/1985449661 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f9388084660 con 0x7f93900712c0 2023-10-03T19:12:27.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.742+0000 7f9394c96640 1 --2- 172.21.15.45:0/1985449661 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f937c066280 0x7f937c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:27.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.742+0000 7f9394c96640 1 --2- 172.21.15.45:0/1985449661 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f937c066280 0x7f937c068730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f93800af000 tx=0x7f93800a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:27.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.746+0000 7f938d7fa640 1 -- 172.21.15.45:0/1985449661 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9388051b40 con 0x7f93900712c0 2023-10-03T19:12:27.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.934+0000 7f9396efa640 1 -- 172.21.15.45:0/1985449661 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f93900bca30 con 0x7f93900712c0 2023-10-03T19:12:27.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.942+0000 7f938d7fa640 1 -- 172.21.15.45:0/1985449661 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9388055160 con 0x7f93900712c0 2023-10-03T19:12:27.945 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 3 and data pool 4 2023-10-03T19:12:27.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.950+0000 7f9396efa640 1 -- 172.21.15.45:0/1985449661 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f937c066280 msgr2=0x7f937c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:27.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.950+0000 7f9396efa640 1 --2- 172.21.15.45:0/1985449661 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f937c066280 0x7f937c068730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f93800af000 tx=0x7f93800a7000 comp rx=0 tx=0).stop 2023-10-03T19:12:27.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.950+0000 7f9396efa640 1 -- 172.21.15.45:0/1985449661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93900712c0 msgr2=0x7f939014e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:27.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.950+0000 7f9396efa640 1 --2- 172.21.15.45:0/1985449661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93900712c0 0x7f939014e440 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f938800cd80 tx=0x7f938800a650 comp rx=0 tx=0).stop 2023-10-03T19:12:27.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.958+0000 7f9396efa640 1 -- 172.21.15.45:0/1985449661 shutdown_connections 2023-10-03T19:12:27.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.958+0000 7f9396efa640 1 --2- 172.21.15.45:0/1985449661 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f937c066280 0x7f937c068730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:27.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.958+0000 7f9396efa640 1 --2- 172.21.15.45:0/1985449661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93900712c0 0x7f939014e440 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:27.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.958+0000 7f9396efa640 1 --2- 172.21.15.45:0/1985449661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f939006d560 0x7f939014df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:27.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.958+0000 7f9396efa640 1 --2- 172.21.15.45:0/1985449661 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f939006c760 0x7f9390148540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:27.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.958+0000 7f9396efa640 1 -- 172.21.15.45:0/1985449661 >> 172.21.15.45:0/1985449661 conn(0x7f93900a20d0 msgr2=0x7f93900a2820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:27.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.958+0000 7f9396efa640 1 -- 172.21.15.45:0/1985449661 shutdown_connections 2023-10-03T19:12:27.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:27.958+0000 7f9396efa640 1 -- 172.21.15.45:0/1985449661 wait complete. 2023-10-03T19:12:27.996 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:12:28.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.106+0000 7fbb6cfa3640 1 Processor -- start 2023-10-03T19:12:28.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.106+0000 7fbb6cfa3640 1 -- start start 2023-10-03T19:12:28.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.106+0000 7fbb6cfa3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbb6806d5b0 0x7fbb68069bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:28.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.106+0000 7fbb6cfa3640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb6806a170 0x7fbb681488f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:28.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.106+0000 7fbb6cfa3640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb6806a610 con 0x7fbb6806e100 2023-10-03T19:12:28.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.106+0000 7fbb6cfa3640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb6806a870 con 0x7fbb6806d5b0 2023-10-03T19:12:28.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.106+0000 7fbb6cfa3640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6806b290 con 0x7fbb6806a170 2023-10-03T19:12:28.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.106+0000 7fbb66d9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb6806a170 0x7fbb681488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:28.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.106+0000 7fbb6659c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbb6806d5b0 0x7fbb68069bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:28.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.106+0000 7fbb66d9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb6806a170 0x7fbb681488f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:55576/0 (socket says 172.21.15.45:55576) 2023-10-03T19:12:28.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.106+0000 7fbb66d9d640 1 -- 172.21.15.45:0/2492624497 learned_addr learned my addr 172.21.15.45:0/2492624497 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:28.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.106+0000 7fbb66d9d640 1 -- 172.21.15.45:0/2492624497 >> v2:172.21.15.79:3300/0 conn(0x7fbb6806d5b0 msgr2=0x7fbb68069bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:28.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.106+0000 7fbb66d9d640 1 --2- 172.21.15.45:0/2492624497 >> v2:172.21.15.79:3300/0 conn(0x7fbb6806d5b0 0x7fbb68069bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:28.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.106+0000 7fbb66d9d640 1 -- 172.21.15.45:0/2492624497 >> v1:172.21.15.79:6789/0 conn(0x7fbb6806e100 legacy=0x7fbb6814c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:28.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.106+0000 7fbb66d9d640 1 -- 172.21.15.45:0/2492624497 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb680a3f60 con 0x7fbb6806a170 2023-10-03T19:12:28.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.110+0000 7fbb66d9d640 1 --2- 172.21.15.45:0/2492624497 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb6806a170 0x7fbb681488f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbb6000f370 tx=0x7fbb600235f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c31a290a48935381 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:28.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.110+0000 7fbb65d9b640 1 -- 172.21.15.45:0/2492624497 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6000d2d0 con 0x7fbb6806a170 2023-10-03T19:12:28.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.110+0000 7fbb65d9b640 1 -- 172.21.15.45:0/2492624497 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb6000d430 con 0x7fbb6806a170 2023-10-03T19:12:28.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.110+0000 7fbb65d9b640 1 -- 172.21.15.45:0/2492624497 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6000b800 con 0x7fbb6806a170 2023-10-03T19:12:28.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.110+0000 7fbb6cfa3640 1 -- 172.21.15.45:0/2492624497 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb6806a170 msgr2=0x7fbb681488f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:28.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.110+0000 7fbb6cfa3640 1 --2- 172.21.15.45:0/2492624497 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb6806a170 0x7fbb681488f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbb6000f370 tx=0x7fbb600235f0 comp rx=0 tx=0).stop 2023-10-03T19:12:28.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.110+0000 7fbb6cfa3640 1 -- 172.21.15.45:0/2492624497 shutdown_connections 2023-10-03T19:12:28.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.110+0000 7fbb6cfa3640 1 --2- 172.21.15.45:0/2492624497 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb6806a170 0x7fbb681488f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:28.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.110+0000 7fbb6cfa3640 1 --2- 172.21.15.45:0/2492624497 >> v2:172.21.15.79:3300/0 conn(0x7fbb6806d5b0 0x7fbb68069bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:28.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.110+0000 7fbb6cfa3640 1 -- 172.21.15.45:0/2492624497 >> 172.21.15.45:0/2492624497 conn(0x7fbb680c1600 msgr2=0x7fbb680c1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:28.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.110+0000 7fbb6cfa3640 1 -- 172.21.15.45:0/2492624497 shutdown_connections 2023-10-03T19:12:28.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.110+0000 7fbb6cfa3640 1 -- 172.21.15.45:0/2492624497 wait complete. 2023-10-03T19:12:28.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.110+0000 7fbb6cfa3640 1 Processor -- start 2023-10-03T19:12:28.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.110+0000 7fbb6cfa3640 1 -- start start 2023-10-03T19:12:28.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.110+0000 7fbb6cfa3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb6806a170 0x7fbb6814c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:28.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.110+0000 7fbb6cfa3640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb6806d5b0 0x7fbb681492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:28.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.110+0000 7fbb6cfa3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb6806e100 0x7fbb681424b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:28.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.110+0000 7fbb6cfa3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6814d470 con 0x7fbb6806a170 2023-10-03T19:12:28.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.110+0000 7fbb6cfa3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb681478f0 con 0x7fbb6806e100 2023-10-03T19:12:28.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.110+0000 7fbb6cfa3640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb681df0c0 con 0x7fbb6806d5b0 2023-10-03T19:12:28.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.110+0000 7fbb6659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb6806a170 0x7fbb6814c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:28.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.110+0000 7fbb6659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb6806a170 0x7fbb6814c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46506/0 (socket says 172.21.15.45:46506) 2023-10-03T19:12:28.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.110+0000 7fbb6659c640 1 -- 172.21.15.45:0/4032287915 learned_addr learned my addr 172.21.15.45:0/4032287915 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:28.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.110+0000 7fbb5dd9b640 1 --2- 172.21.15.45:0/4032287915 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb6806d5b0 0x7fbb681492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:28.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.110+0000 7fbb66d9d640 1 --2- 172.21.15.45:0/4032287915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb6806e100 0x7fbb681424b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:28.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.114+0000 7fbb6659c640 1 -- 172.21.15.45:0/4032287915 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb6806d5b0 msgr2=0x7fbb681492e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:28.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.114+0000 7fbb6659c640 1 --2- 172.21.15.45:0/4032287915 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb6806d5b0 0x7fbb681492e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:28.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.114+0000 7fbb6659c640 1 -- 172.21.15.45:0/4032287915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb6806e100 msgr2=0x7fbb681424b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:28.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.114+0000 7fbb6659c640 1 --2- 172.21.15.45:0/4032287915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb6806e100 0x7fbb681424b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:28.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.114+0000 7fbb6659c640 1 -- 172.21.15.45:0/4032287915 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb6000f050 con 0x7fbb6806a170 2023-10-03T19:12:28.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.114+0000 7fbb6659c640 1 --2- 172.21.15.45:0/4032287915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb6806a170 0x7fbb6814c9f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800fbb0 tx=0x7fbb5800d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:28.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.114+0000 7fbb5f7fe640 1 -- 172.21.15.45:0/4032287915 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5800b740 con 0x7fbb6806a170 2023-10-03T19:12:28.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.114+0000 7fbb5f7fe640 1 -- 172.21.15.45:0/4032287915 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb58018640 con 0x7fbb6806a170 2023-10-03T19:12:28.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.114+0000 7fbb6cfa3640 1 -- 172.21.15.45:0/4032287915 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb6806aa50 con 0x7fbb6806a170 2023-10-03T19:12:28.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.114+0000 7fbb5f7fe640 1 -- 172.21.15.45:0/4032287915 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb580189b0 con 0x7fbb6806a170 2023-10-03T19:12:28.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.114+0000 7fbb6cfa3640 1 -- 172.21.15.45:0/4032287915 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb680bdc30 con 0x7fbb6806a170 2023-10-03T19:12:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.114+0000 7fbb6cfa3640 1 -- 172.21.15.45:0/4032287915 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb6806d980 con 0x7fbb6806a170 2023-10-03T19:12:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.114+0000 7fbb5f7fe640 1 -- 172.21.15.45:0/4032287915 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbb58018b10 con 0x7fbb6806a170 2023-10-03T19:12:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.114+0000 7fbb5f7fe640 1 --2- 172.21.15.45:0/4032287915 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbb480662b0 0x7fbb48068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.114+0000 7fbb5f7fe640 1 -- 172.21.15.45:0/4032287915 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbb580845e0 con 0x7fbb6806a170 2023-10-03T19:12:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.114+0000 7fbb5dd9b640 1 --2- 172.21.15.45:0/4032287915 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbb480662b0 0x7fbb48068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:28.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.114+0000 7fbb5dd9b640 1 --2- 172.21.15.45:0/4032287915 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbb480662b0 0x7fbb48068760 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbb6814b730 tx=0x7fbb50009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:28.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.118+0000 7fbb5f7fe640 1 -- 172.21.15.45:0/4032287915 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbb58051a80 con 0x7fbb6806a170 2023-10-03T19:12:28.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.274+0000 7fbb6cfa3640 1 -- 172.21.15.45:0/4032287915 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb681dfa20 con 0x7fbb6806a170 2023-10-03T19:12:28.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.278+0000 7fbb5f7fe640 1 -- 172.21.15.45:0/4032287915 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18244 (secure 0 0 0) 0x7fbb681dfa20 con 0x7fbb6806a170 2023-10-03T19:12:28.283 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:28.283 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:12:27.937699+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:12:26.226431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T19:12:26.923174+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:12:28.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.278+0000 7fbb6cfa3640 1 -- 172.21.15.45:0/4032287915 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbb480662b0 msgr2=0x7fbb48068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:28.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.278+0000 7fbb6cfa3640 1 --2- 172.21.15.45:0/4032287915 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbb480662b0 0x7fbb48068760 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbb6814b730 tx=0x7fbb50009040 comp rx=0 tx=0).stop 2023-10-03T19:12:28.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.278+0000 7fbb6cfa3640 1 -- 172.21.15.45:0/4032287915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb6806a170 msgr2=0x7fbb6814c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:28.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.278+0000 7fbb6cfa3640 1 --2- 172.21.15.45:0/4032287915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb6806a170 0x7fbb6814c9f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800fbb0 tx=0x7fbb5800d720 comp rx=0 tx=0).stop 2023-10-03T19:12:28.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.278+0000 7fbb6cfa3640 1 -- 172.21.15.45:0/4032287915 shutdown_connections 2023-10-03T19:12:28.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.278+0000 7fbb6cfa3640 1 --2- 172.21.15.45:0/4032287915 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbb480662b0 0x7fbb48068760 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:28.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.278+0000 7fbb6cfa3640 1 --2- 172.21.15.45:0/4032287915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb6806e100 0x7fbb681424b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:28.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.278+0000 7fbb6cfa3640 1 --2- 172.21.15.45:0/4032287915 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb6806d5b0 0x7fbb681492e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:28.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.278+0000 7fbb6cfa3640 1 --2- 172.21.15.45:0/4032287915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb6806a170 0x7fbb6814c9f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:28.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.278+0000 7fbb6cfa3640 1 -- 172.21.15.45:0/4032287915 >> 172.21.15.45:0/4032287915 conn(0x7fbb680c1600 msgr2=0x7fbb680be050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:28.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.278+0000 7fbb6cfa3640 1 -- 172.21.15.45:0/4032287915 shutdown_connections 2023-10-03T19:12:28.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.278+0000 7fbb6cfa3640 1 -- 172.21.15.45:0/4032287915 wait complete. 2023-10-03T19:12:28.299 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:12:28.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.413+0000 7febf0856640 1 Processor -- start 2023-10-03T19:12:28.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.413+0000 7febf0856640 1 -- start start 2023-10-03T19:12:28.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.417+0000 7febf0856640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7febec148b90 0x7febec0bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:28.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.417+0000 7febf0856640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febec14b610 con 0x7febec0bc4a0 2023-10-03T19:12:28.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.417+0000 7febf0856640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febec0a5580 con 0x7febec0bcb60 2023-10-03T19:12:28.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.417+0000 7febf0856640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febec0a3670 con 0x7febec148b90 2023-10-03T19:12:28.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.417+0000 7febea59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7febec148b90 0x7febec0bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:28.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.417+0000 7febead9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7febec0bc4a0 0x7febec06c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35738/0 (socket says 172.21.15.45:35738) 2023-10-03T19:12:28.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.417+0000 7febea59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7febec148b90 0x7febec0bbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46516/0 (socket says 172.21.15.45:46516) 2023-10-03T19:12:28.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.417+0000 7febead9d640 1 -- 172.21.15.45:0/1533370429 learned_addr learned my addr 172.21.15.45:0/1533370429 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:28.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.417+0000 7febea59c640 1 -- 172.21.15.45:0/1533370429 >> v1:172.21.15.79:6789/0 conn(0x7febec0bcb60 legacy=0x7febec06c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:28.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.417+0000 7febea59c640 1 -- 172.21.15.45:0/1533370429 >> v1:172.21.15.45:6789/0 conn(0x7febec0bc4a0 legacy=0x7febec06c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:28.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.417+0000 7febea59c640 1 -- 172.21.15.45:0/1533370429 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec0a5820 con 0x7febec148b90 2023-10-03T19:12:28.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.417+0000 7febea59c640 1 --2- 172.21.15.45:0/1533370429 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febec148b90 0x7febec0bbf60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7febdc0097c0 tx=0x7febdc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=744baeaad843bdf7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:28.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.417+0000 7febe959a640 1 -- 172.21.15.45:0/1533370429 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc0ab600 con 0x7febec148b90 2023-10-03T19:12:28.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.417+0000 7febe959a640 1 -- 172.21.15.45:0/1533370429 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febdc0a7050 con 0x7febec148b90 2023-10-03T19:12:28.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.417+0000 7febe959a640 1 -- 172.21.15.45:0/1533370429 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc0ab980 con 0x7febec148b90 2023-10-03T19:12:28.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.421+0000 7febf0856640 1 -- 172.21.15.45:0/1533370429 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febec148b90 msgr2=0x7febec0bbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:28.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.421+0000 7febf0856640 1 --2- 172.21.15.45:0/1533370429 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febec148b90 0x7febec0bbf60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7febdc0097c0 tx=0x7febdc01c480 comp rx=0 tx=0).stop 2023-10-03T19:12:28.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.421+0000 7febf0856640 1 -- 172.21.15.45:0/1533370429 shutdown_connections 2023-10-03T19:12:28.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.421+0000 7febf0856640 1 --2- 172.21.15.45:0/1533370429 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febec148b90 0x7febec0bbf60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:28.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.421+0000 7febf0856640 1 -- 172.21.15.45:0/1533370429 >> 172.21.15.45:0/1533370429 conn(0x7febec0bcf50 msgr2=0x7febec0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:28.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.421+0000 7febf0856640 1 -- 172.21.15.45:0/1533370429 shutdown_connections 2023-10-03T19:12:28.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.421+0000 7febf0856640 1 -- 172.21.15.45:0/1533370429 wait complete. 2023-10-03T19:12:28.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.421+0000 7febf0856640 1 Processor -- start 2023-10-03T19:12:28.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.421+0000 7febf0856640 1 -- start start 2023-10-03T19:12:28.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.421+0000 7febf0856640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7febec0bc4a0 0x7febec0b9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:28.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.421+0000 7febf0856640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febec0bcb60 0x7febec1e6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:28.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.421+0000 7febf0856640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febec148b90 0x7febec1e7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:28.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.421+0000 7febf0856640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec0ba090 con 0x7febec148b90 2023-10-03T19:12:28.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.421+0000 7febf0856640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec1ead70 con 0x7febec0bcb60 2023-10-03T19:12:28.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.421+0000 7febf0856640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febec1eb050 con 0x7febec0bc4a0 2023-10-03T19:12:28.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.421+0000 7febead9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febec148b90 0x7febec1e7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:28.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.421+0000 7febea59c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7febec0bc4a0 0x7febec0b9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:28.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.421+0000 7febe9d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febec0bcb60 0x7febec1e6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:28.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.421+0000 7febead9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febec148b90 0x7febec1e7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46524/0 (socket says 172.21.15.45:46524) 2023-10-03T19:12:28.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.421+0000 7febead9d640 1 -- 172.21.15.45:0/3826956218 learned_addr learned my addr 172.21.15.45:0/3826956218 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:28.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.421+0000 7febead9d640 1 -- 172.21.15.45:0/3826956218 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7febec0bc4a0 msgr2=0x7febec0b9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:28.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.421+0000 7febead9d640 1 --2- 172.21.15.45:0/3826956218 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7febec0bc4a0 0x7febec0b9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:28.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.421+0000 7febead9d640 1 -- 172.21.15.45:0/3826956218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febec0bcb60 msgr2=0x7febec1e6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:28.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.421+0000 7febead9d640 1 --2- 172.21.15.45:0/3826956218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febec0bcb60 0x7febec1e6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:28.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.421+0000 7febead9d640 1 -- 172.21.15.45:0/3826956218 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febdc009420 con 0x7febec148b90 2023-10-03T19:12:28.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.421+0000 7febead9d640 1 --2- 172.21.15.45:0/3826956218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febec148b90 0x7febec1e7290 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7febe400caa0 tx=0x7febe400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:28.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.421+0000 7febdaffd640 1 -- 172.21.15.45:0/3826956218 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe400ac00 con 0x7febec148b90 2023-10-03T19:12:28.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.421+0000 7febdaffd640 1 -- 172.21.15.45:0/3826956218 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe400ad60 con 0x7febec148b90 2023-10-03T19:12:28.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.421+0000 7febf0856640 1 -- 172.21.15.45:0/3826956218 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febec0bda30 con 0x7febec148b90 2023-10-03T19:12:28.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.421+0000 7febdaffd640 1 -- 172.21.15.45:0/3826956218 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe4012600 con 0x7febec148b90 2023-10-03T19:12:28.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.425+0000 7febf0856640 1 -- 172.21.15.45:0/3826956218 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febec0a3c30 con 0x7febec148b90 2023-10-03T19:12:28.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.425+0000 7febf0856640 1 -- 172.21.15.45:0/3826956218 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febec0bdbc0 con 0x7febec148b90 2023-10-03T19:12:28.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.425+0000 7febdaffd640 1 -- 172.21.15.45:0/3826956218 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7febe4007070 con 0x7febec148b90 2023-10-03T19:12:28.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.425+0000 7febdaffd640 1 --2- 172.21.15.45:0/3826956218 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7febcc066280 0x7febcc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:28.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.425+0000 7febdaffd640 1 -- 172.21.15.45:0/3826956218 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7febe4083bf0 con 0x7febec148b90 2023-10-03T19:12:28.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.425+0000 7febea59c640 1 --2- 172.21.15.45:0/3826956218 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7febcc066280 0x7febcc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:28.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.425+0000 7febea59c640 1 --2- 172.21.15.45:0/3826956218 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7febcc066280 0x7febcc068730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7febdc0ad000 tx=0x7febdc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:28.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.429+0000 7febdaffd640 1 -- 172.21.15.45:0/3826956218 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7febe4051090 con 0x7febec148b90 2023-10-03T19:12:28.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.589+0000 7febf0856640 1 -- 172.21.15.45:0/3826956218 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febec1eb210 con 0x7febec148b90 2023-10-03T19:12:28.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.589+0000 7febdaffd640 1 -- 172.21.15.45:0/3826956218 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18244 (secure 0 0 0) 0x7febec1eb210 con 0x7febec148b90 2023-10-03T19:12:28.594 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:28.595 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:12:27.937699+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:12:26.226431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T19:12:26.923174+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:12:28.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.593+0000 7febf0856640 1 -- 172.21.15.45:0/3826956218 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7febcc066280 msgr2=0x7febcc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:28.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.593+0000 7febf0856640 1 --2- 172.21.15.45:0/3826956218 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7febcc066280 0x7febcc068730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7febdc0ad000 tx=0x7febdc008040 comp rx=0 tx=0).stop 2023-10-03T19:12:28.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.593+0000 7febf0856640 1 -- 172.21.15.45:0/3826956218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febec148b90 msgr2=0x7febec1e7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:28.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.593+0000 7febf0856640 1 --2- 172.21.15.45:0/3826956218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febec148b90 0x7febec1e7290 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7febe400caa0 tx=0x7febe400cf60 comp rx=0 tx=0).stop 2023-10-03T19:12:28.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.593+0000 7febf0856640 1 -- 172.21.15.45:0/3826956218 shutdown_connections 2023-10-03T19:12:28.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.593+0000 7febf0856640 1 --2- 172.21.15.45:0/3826956218 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7febcc066280 0x7febcc068730 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:28.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.593+0000 7febf0856640 1 --2- 172.21.15.45:0/3826956218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febec148b90 0x7febec1e7290 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:28.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.593+0000 7febf0856640 1 --2- 172.21.15.45:0/3826956218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febec0bcb60 0x7febec1e6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:28.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.593+0000 7febf0856640 1 --2- 172.21.15.45:0/3826956218 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7febec0bc4a0 0x7febec0b9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:28.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.593+0000 7febf0856640 1 -- 172.21.15.45:0/3826956218 >> 172.21.15.45:0/3826956218 conn(0x7febec0bcf50 msgr2=0x7febec0bf620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:28.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.593+0000 7febf0856640 1 -- 172.21.15.45:0/3826956218 shutdown_connections 2023-10-03T19:12:28.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.593+0000 7febf0856640 1 -- 172.21.15.45:0/3826956218 wait complete. 2023-10-03T19:12:28.614 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-03T19:12:28.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10fef09640 1 Processor -- start 2023-10-03T19:12:28.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10fef09640 1 -- start start 2023-10-03T19:12:28.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10fef09640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f10f81487b0 0x7f10f8152480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:28.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10fef09640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f81529c0 con 0x7f10f806a280 2023-10-03T19:12:28.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10fef09640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f806a950 con 0x7f10f814e5f0 2023-10-03T19:12:28.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10fef09640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f80c09e0 con 0x7f10f81487b0 2023-10-03T19:12:28.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10f7fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f10f806a280 0x7f10f8065690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35750/0 (socket says 172.21.15.45:35750) 2023-10-03T19:12:28.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10f7fff640 1 -- 172.21.15.45:0/463832868 learned_addr learned my addr 172.21.15.45:0/463832868 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:28.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10fcca5640 1 --2- 172.21.15.45:0/463832868 >> v2:172.21.15.79:3300/0 conn(0x7f10f81487b0 0x7f10f8152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:28.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10f77fe640 1 -- 172.21.15.45:0/463832868 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3069673182 0 0) 0x7f10f81529c0 con 0x7f10f806a280 2023-10-03T19:12:28.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10f77fe640 1 -- 172.21.15.45:0/463832868 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10e0003530 con 0x7f10f806a280 2023-10-03T19:12:28.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10f77fe640 1 -- 172.21.15.45:0/463832868 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 963108342 0 0) 0x7f10e0003530 con 0x7f10f806a280 2023-10-03T19:12:28.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10f77fe640 1 -- 172.21.15.45:0/463832868 >> v2:172.21.15.79:3300/0 conn(0x7f10f81487b0 msgr2=0x7f10f8152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:28.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10f77fe640 1 --2- 172.21.15.45:0/463832868 >> v2:172.21.15.79:3300/0 conn(0x7f10f81487b0 0x7f10f8152480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:28.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10f77fe640 1 -- 172.21.15.45:0/463832868 >> v1:172.21.15.79:6789/0 conn(0x7f10f814e5f0 legacy=0x7f10f814ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:28.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10f77fe640 1 -- 172.21.15.45:0/463832868 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f806ac30 con 0x7f10f806a280 2023-10-03T19:12:28.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10f77fe640 1 -- 172.21.15.45:0/463832868 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f10ec0016a0 con 0x7f10f806a280 2023-10-03T19:12:28.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10f77fe640 1 -- 172.21.15.45:0/463832868 >> v1:172.21.15.45:6789/0 conn(0x7f10f806a280 legacy=0x7f10f8065690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:28.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10f77fe640 1 --2- 172.21.15.45:0/463832868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10e0003980 0x7f10e0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:28.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10f77fe640 1 --2- 172.21.15.45:0/463832868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e00047d0 0x7f10e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:28.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10f77fe640 1 --2- 172.21.15.45:0/463832868 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f10e0005180 0x7f10e000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:28.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10f77fe640 1 -- 172.21.15.45:0/463832868 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f80c09e0 con 0x7f10e00047d0 2023-10-03T19:12:28.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10f77fe640 1 -- 172.21.15.45:0/463832868 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e000bfe0 con 0x7f10e0003980 2023-10-03T19:12:28.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10f77fe640 1 -- 172.21.15.45:0/463832868 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e000c1a0 con 0x7f10e0005180 2023-10-03T19:12:28.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10f7fff640 1 --2- 172.21.15.45:0/463832868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e00047d0 0x7f10e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:28.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10fcca5640 1 --2- 172.21.15.45:0/463832868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10e0003980 0x7f10e0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:28.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10fd4a6640 1 --2- 172.21.15.45:0/463832868 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f10e0005180 0x7f10e000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:28.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10f7fff640 1 -- 172.21.15.45:0/463832868 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f10e0005180 msgr2=0x7f10e000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:28.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10f7fff640 1 --2- 172.21.15.45:0/463832868 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f10e0005180 0x7f10e000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:28.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10f7fff640 1 -- 172.21.15.45:0/463832868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10e0003980 msgr2=0x7f10e0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:28.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10f7fff640 1 --2- 172.21.15.45:0/463832868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10e0003980 0x7f10e0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:28.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10f7fff640 1 -- 172.21.15.45:0/463832868 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e0003530 con 0x7f10e00047d0 2023-10-03T19:12:28.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10fcca5640 1 --2- 172.21.15.45:0/463832868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10e0003980 0x7f10e0003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:28.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10fd4a6640 1 --2- 172.21.15.45:0/463832868 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f10e0005180 0x7f10e000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:28.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.737+0000 7f10fd4a6640 1 -- 172.21.15.45:0/463832868 reap_dead start 2023-10-03T19:12:28.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.741+0000 7f10f7fff640 1 --2- 172.21.15.45:0/463832868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e00047d0 0x7f10e0004c40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00c190 tx=0x7f10ec01cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f22bbe3c6316417 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:28.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.741+0000 7f10f77fe640 1 -- 172.21.15.45:0/463832868 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec0a5b90 con 0x7f10e00047d0 2023-10-03T19:12:28.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.741+0000 7f10f77fe640 1 -- 172.21.15.45:0/463832868 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ec0a5cf0 con 0x7f10e00047d0 2023-10-03T19:12:28.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.741+0000 7f10f77fe640 1 -- 172.21.15.45:0/463832868 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec005b20 con 0x7f10e00047d0 2023-10-03T19:12:28.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.741+0000 7f10fef09640 1 -- 172.21.15.45:0/463832868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e00047d0 msgr2=0x7f10e0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:28.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.741+0000 7f10fef09640 1 --2- 172.21.15.45:0/463832868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e00047d0 0x7f10e0004c40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00c190 tx=0x7f10ec01cc00 comp rx=0 tx=0).stop 2023-10-03T19:12:28.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.741+0000 7f10fef09640 1 -- 172.21.15.45:0/463832868 shutdown_connections 2023-10-03T19:12:28.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.741+0000 7f10fef09640 1 --2- 172.21.15.45:0/463832868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e00047d0 0x7f10e0004c40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:28.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.741+0000 7f10fef09640 1 -- 172.21.15.45:0/463832868 >> 172.21.15.45:0/463832868 conn(0x7f10f80c14f0 msgr2=0x7f10f80c18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:28.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.741+0000 7f10fef09640 1 -- 172.21.15.45:0/463832868 shutdown_connections 2023-10-03T19:12:28.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.741+0000 7f10fef09640 1 -- 172.21.15.45:0/463832868 wait complete. 2023-10-03T19:12:28.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.745+0000 7f10fef09640 1 Processor -- start 2023-10-03T19:12:28.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.745+0000 7f10fef09640 1 -- start start 2023-10-03T19:12:28.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.745+0000 7f10fef09640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e00047d0 0x7f10f81e4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:28.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.745+0000 7f10fef09640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10f806d390 0x7f10f8144510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:28.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.745+0000 7f10fef09640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f10f806e090 0x7f10f80a4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:28.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.745+0000 7f10fef09640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f81e4970 con 0x7f10e00047d0 2023-10-03T19:12:28.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.745+0000 7f10fef09640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f80a5ba0 con 0x7f10f806d390 2023-10-03T19:12:28.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.745+0000 7f10fef09640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f8145280 con 0x7f10f806e090 2023-10-03T19:12:28.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.745+0000 7f10fcca5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e00047d0 0x7f10f81e4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:28.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.745+0000 7f10fcca5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e00047d0 0x7f10f81e4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46540/0 (socket says 172.21.15.45:46540) 2023-10-03T19:12:28.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.745+0000 7f10fcca5640 1 -- 172.21.15.45:0/4014373685 learned_addr learned my addr 172.21.15.45:0/4014373685 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:28.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.745+0000 7f10f7fff640 1 --2- 172.21.15.45:0/4014373685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10f806d390 0x7f10f8144510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:28.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.745+0000 7f10fd4a6640 1 --2- 172.21.15.45:0/4014373685 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f10f806e090 0x7f10f80a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:28.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.745+0000 7f10fcca5640 1 -- 172.21.15.45:0/4014373685 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f10f806e090 msgr2=0x7f10f80a4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:28.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.745+0000 7f10fcca5640 1 --2- 172.21.15.45:0/4014373685 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f10f806e090 0x7f10f80a4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:28.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.745+0000 7f10fcca5640 1 -- 172.21.15.45:0/4014373685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10f806d390 msgr2=0x7f10f8144510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:28.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.745+0000 7f10fcca5640 1 --2- 172.21.15.45:0/4014373685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10f806d390 0x7f10f8144510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:28.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.745+0000 7f10fcca5640 1 -- 172.21.15.45:0/4014373685 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f806a000 con 0x7f10e00047d0 2023-10-03T19:12:28.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.745+0000 7f10fcca5640 1 --2- 172.21.15.45:0/4014373685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e00047d0 0x7f10f81e4430 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f10e8010950 tx=0x7f10e8010e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:28.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.745+0000 7f10f57fa640 1 -- 172.21.15.45:0/4014373685 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e800ec20 con 0x7f10e00047d0 2023-10-03T19:12:28.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.745+0000 7f10f57fa640 1 -- 172.21.15.45:0/4014373685 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e800ed80 con 0x7f10e00047d0 2023-10-03T19:12:28.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.745+0000 7f10fef09640 1 -- 172.21.15.45:0/4014373685 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f806af10 con 0x7f10e00047d0 2023-10-03T19:12:28.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.745+0000 7f10f57fa640 1 -- 172.21.15.45:0/4014373685 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e8004220 con 0x7f10e00047d0 2023-10-03T19:12:28.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.745+0000 7f10fef09640 1 -- 172.21.15.45:0/4014373685 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f8152480 con 0x7f10e00047d0 2023-10-03T19:12:28.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.745+0000 7f10fef09640 1 -- 172.21.15.45:0/4014373685 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f804de80 con 0x7f10e00047d0 2023-10-03T19:12:28.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.745+0000 7f10f57fa640 1 -- 172.21.15.45:0/4014373685 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f10e8004380 con 0x7f10e00047d0 2023-10-03T19:12:28.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.745+0000 7f10f57fa640 1 --2- 172.21.15.45:0/4014373685 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f10e40662b0 0x7f10e4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:28.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.745+0000 7f10f57fa640 1 -- 172.21.15.45:0/4014373685 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f10e8083df0 con 0x7f10e00047d0 2023-10-03T19:12:28.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.749+0000 7f10f7fff640 1 --2- 172.21.15.45:0/4014373685 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f10e40662b0 0x7f10e4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:28.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.749+0000 7f10f7fff640 1 --2- 172.21.15.45:0/4014373685 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f10e40662b0 0x7f10e4068760 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f10ec0ab000 tx=0x7f10ec006040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:28.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.753+0000 7f10f57fa640 1 -- 172.21.15.45:0/4014373685 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f10e80511d0 con 0x7f10e00047d0 2023-10-03T19:12:28.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:28.937+0000 7f10fef09640 1 -- 172.21.15.45:0/4014373685 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f10f8069de0 con 0x7f10e00047d0 2023-10-03T19:12:29.480 INFO:tasks.ceph.mds.b.smithi079.stderr:2023-10-03T19:12:29.473+0000 7f45fd6f9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-03T19:12:29.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:29.957+0000 7f10f57fa640 1 -- 172.21.15.45:0/4014373685 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f10e80547f0 con 0x7f10e00047d0 2023-10-03T19:12:29.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:29.965+0000 7f10fef09640 1 -- 172.21.15.45:0/4014373685 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f10e40662b0 msgr2=0x7f10e4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:29.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:29.965+0000 7f10fef09640 1 --2- 172.21.15.45:0/4014373685 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f10e40662b0 0x7f10e4068760 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f10ec0ab000 tx=0x7f10ec006040 comp rx=0 tx=0).stop 2023-10-03T19:12:29.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:29.965+0000 7f10fef09640 1 -- 172.21.15.45:0/4014373685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e00047d0 msgr2=0x7f10f81e4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:29.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:29.965+0000 7f10fef09640 1 --2- 172.21.15.45:0/4014373685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e00047d0 0x7f10f81e4430 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f10e8010950 tx=0x7f10e8010e10 comp rx=0 tx=0).stop 2023-10-03T19:12:29.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:29.965+0000 7f10fef09640 1 -- 172.21.15.45:0/4014373685 shutdown_connections 2023-10-03T19:12:29.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:29.965+0000 7f10fef09640 1 --2- 172.21.15.45:0/4014373685 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f10e40662b0 0x7f10e4068760 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:29.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:29.965+0000 7f10fef09640 1 --2- 172.21.15.45:0/4014373685 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f10f806e090 0x7f10f80a4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:29.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:29.965+0000 7f10fef09640 1 --2- 172.21.15.45:0/4014373685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10f806d390 0x7f10f8144510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:29.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:29.965+0000 7f10fef09640 1 --2- 172.21.15.45:0/4014373685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e00047d0 0x7f10f81e4430 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:29.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:29.965+0000 7f10fef09640 1 -- 172.21.15.45:0/4014373685 >> 172.21.15.45:0/4014373685 conn(0x7f10f80c14f0 msgr2=0x7f10f8065690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:29.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:29.965+0000 7f10fef09640 1 -- 172.21.15.45:0/4014373685 shutdown_connections 2023-10-03T19:12:29.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:29.965+0000 7f10fef09640 1 -- 172.21.15.45:0/4014373685 wait complete. 2023-10-03T19:12:29.992 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-03T19:12:29.992 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-03T19:12:30.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.121+0000 7f27dcf85640 1 Processor -- start 2023-10-03T19:12:30.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.121+0000 7f27dcf85640 1 -- start start 2023-10-03T19:12:30.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.125+0000 7f27dcf85640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f27d806f880 0x7f27d80a5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:30.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.125+0000 7f27dcf85640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f27d814ba30 0x7f27d8155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:30.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.125+0000 7f27dcf85640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d814f080 con 0x7f27d814f510 2023-10-03T19:12:30.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.125+0000 7f27dcf85640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d806f3e0 con 0x7f27d806f880 2023-10-03T19:12:30.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.125+0000 7f27dcf85640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d8070e90 con 0x7f27d814ba30 2023-10-03T19:12:30.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.125+0000 7f27d659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f27d806f880 0x7f27d80a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:30.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.125+0000 7f27d659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f27d806f880 0x7f27d80a5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46544/0 (socket says 172.21.15.45:46544) 2023-10-03T19:12:30.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.125+0000 7f27d659c640 1 -- 172.21.15.45:0/3769017313 learned_addr learned my addr 172.21.15.45:0/3769017313 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:30.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.125+0000 7f27d6d9d640 1 --2- 172.21.15.45:0/3769017313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f27d814ba30 0x7f27d8155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:30.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.125+0000 7f27d659c640 1 -- 172.21.15.45:0/3769017313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f27d814ba30 msgr2=0x7f27d8155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:30.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.125+0000 7f27d659c640 1 --2- 172.21.15.45:0/3769017313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f27d814ba30 0x7f27d8155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:30.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.125+0000 7f27d659c640 1 -- 172.21.15.45:0/3769017313 >> v1:172.21.15.79:6789/0 conn(0x7f27d814f510 legacy=0x7f27d814b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:30.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.125+0000 7f27d659c640 1 -- 172.21.15.45:0/3769017313 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d814ea30 con 0x7f27d806f880 2023-10-03T19:12:30.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.125+0000 7f27d659c640 1 --2- 172.21.15.45:0/3769017313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27d806f880 0x7f27d80a5940 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f27c800bb10 tx=0x7f27c801ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b16814a98aab78a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:30.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.129+0000 7f27d559a640 1 -- 172.21.15.45:0/3769017313 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c80a7b10 con 0x7f27d806f880 2023-10-03T19:12:30.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.129+0000 7f27d559a640 1 -- 172.21.15.45:0/3769017313 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c80a7c70 con 0x7f27d806f880 2023-10-03T19:12:30.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.129+0000 7f27d559a640 1 -- 172.21.15.45:0/3769017313 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c80af440 con 0x7f27d806f880 2023-10-03T19:12:30.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.129+0000 7f27dcf85640 1 -- 172.21.15.45:0/3769017313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27d806f880 msgr2=0x7f27d80a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:30.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.129+0000 7f27dcf85640 1 --2- 172.21.15.45:0/3769017313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27d806f880 0x7f27d80a5940 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f27c800bb10 tx=0x7f27c801ebe0 comp rx=0 tx=0).stop 2023-10-03T19:12:30.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.129+0000 7f27dcf85640 1 -- 172.21.15.45:0/3769017313 shutdown_connections 2023-10-03T19:12:30.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.129+0000 7f27dcf85640 1 --2- 172.21.15.45:0/3769017313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f27d814ba30 0x7f27d8155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:30.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.129+0000 7f27dcf85640 1 --2- 172.21.15.45:0/3769017313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27d806f880 0x7f27d80a5940 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:30.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.129+0000 7f27dcf85640 1 -- 172.21.15.45:0/3769017313 >> 172.21.15.45:0/3769017313 conn(0x7f27d80a20d0 msgr2=0x7f27d80a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:30.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.129+0000 7f27dcf85640 1 -- 172.21.15.45:0/3769017313 shutdown_connections 2023-10-03T19:12:30.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.129+0000 7f27dcf85640 1 -- 172.21.15.45:0/3769017313 wait complete. 2023-10-03T19:12:30.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.129+0000 7f27dcf85640 1 Processor -- start 2023-10-03T19:12:30.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.129+0000 7f27dcf85640 1 -- start start 2023-10-03T19:12:30.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.129+0000 7f27dcf85640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27d806f880 0x7f27d81419e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.129+0000 7f27dcf85640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f27d814ba30 0x7f27d81e40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.129+0000 7f27dcf85640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27d814f510 0x7f27d8143d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.129+0000 7f27dcf85640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d80c0200 con 0x7f27d806f880 2023-10-03T19:12:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.129+0000 7f27dcf85640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d81442c0 con 0x7f27d814f510 2023-10-03T19:12:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.129+0000 7f27dcf85640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d80c0400 con 0x7f27d814ba30 2023-10-03T19:12:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.129+0000 7f27d659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27d806f880 0x7f27d81419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:30.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.129+0000 7f27d659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27d806f880 0x7f27d81419e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46552/0 (socket says 172.21.15.45:46552) 2023-10-03T19:12:30.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.129+0000 7f27d659c640 1 -- 172.21.15.45:0/1796079852 learned_addr learned my addr 172.21.15.45:0/1796079852 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:30.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.129+0000 7f27d6d9d640 1 --2- 172.21.15.45:0/1796079852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27d814f510 0x7f27d8143d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:30.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.129+0000 7f27d5d9b640 1 --2- 172.21.15.45:0/1796079852 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f27d814ba30 0x7f27d81e40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:30.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.133+0000 7f27d659c640 1 -- 172.21.15.45:0/1796079852 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f27d814ba30 msgr2=0x7f27d81e40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:30.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.133+0000 7f27d659c640 1 --2- 172.21.15.45:0/1796079852 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f27d814ba30 0x7f27d81e40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:30.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.133+0000 7f27d659c640 1 -- 172.21.15.45:0/1796079852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27d814f510 msgr2=0x7f27d8143d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:30.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.133+0000 7f27d659c640 1 --2- 172.21.15.45:0/1796079852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27d814f510 0x7f27d8143d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:30.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.133+0000 7f27d659c640 1 -- 172.21.15.45:0/1796079852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c800b770 con 0x7f27d806f880 2023-10-03T19:12:30.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.133+0000 7f27d5d9b640 1 --2- 172.21.15.45:0/1796079852 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f27d814ba30 0x7f27d81e40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:12:30.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.133+0000 7f27d659c640 1 --2- 172.21.15.45:0/1796079852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27d806f880 0x7f27d81419e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f27c800b2c0 tx=0x7f27c801b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:30.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.133+0000 7f27c6ffd640 1 -- 172.21.15.45:0/1796079852 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c80bf070 con 0x7f27d806f880 2023-10-03T19:12:30.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.133+0000 7f27c6ffd640 1 -- 172.21.15.45:0/1796079852 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c80ba440 con 0x7f27d806f880 2023-10-03T19:12:30.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.133+0000 7f27dcf85640 1 -- 172.21.15.45:0/1796079852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d8070a40 con 0x7f27d806f880 2023-10-03T19:12:30.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.133+0000 7f27c6ffd640 1 -- 172.21.15.45:0/1796079852 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c8006ee0 con 0x7f27d806f880 2023-10-03T19:12:30.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.133+0000 7f27dcf85640 1 -- 172.21.15.45:0/1796079852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d806fc50 con 0x7f27d806f880 2023-10-03T19:12:30.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.133+0000 7f27dcf85640 1 -- 172.21.15.45:0/1796079852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d8070bd0 con 0x7f27d806f880 2023-10-03T19:12:30.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.133+0000 7f27c6ffd640 1 -- 172.21.15.45:0/1796079852 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f27c80b6040 con 0x7f27d806f880 2023-10-03T19:12:30.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.133+0000 7f27c6ffd640 1 --2- 172.21.15.45:0/1796079852 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f27b80662b0 0x7f27b8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:30.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.133+0000 7f27c6ffd640 1 -- 172.21.15.45:0/1796079852 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f27c81209a0 con 0x7f27d806f880 2023-10-03T19:12:30.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.133+0000 7f27d5d9b640 1 --2- 172.21.15.45:0/1796079852 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f27b80662b0 0x7f27b8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:30.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.133+0000 7f27d5d9b640 1 --2- 172.21.15.45:0/1796079852 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f27b80662b0 0x7f27b8068760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f27d80a2570 tx=0x7f27cc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:30.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.137+0000 7f27c6ffd640 1 -- 172.21.15.45:0/1796079852 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f27c80edd90 con 0x7f27d806f880 2023-10-03T19:12:30.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.333+0000 7f27dcf85640 1 -- 172.21.15.45:0/1796079852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f27d804de80 con 0x7f27d806f880 2023-10-03T19:12:30.965 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:12:30.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.961+0000 7f27c6ffd640 1 -- 172.21.15.45:0/1796079852 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f27c80b4020 con 0x7f27d806f880 2023-10-03T19:12:30.967 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:12:30.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.965+0000 7f27dcf85640 1 -- 172.21.15.45:0/1796079852 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f27b80662b0 msgr2=0x7f27b8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:30.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.965+0000 7f27dcf85640 1 --2- 172.21.15.45:0/1796079852 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f27b80662b0 0x7f27b8068760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f27d80a2570 tx=0x7f27cc009040 comp rx=0 tx=0).stop 2023-10-03T19:12:30.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.965+0000 7f27dcf85640 1 -- 172.21.15.45:0/1796079852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27d806f880 msgr2=0x7f27d81419e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:30.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.965+0000 7f27dcf85640 1 --2- 172.21.15.45:0/1796079852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27d806f880 0x7f27d81419e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f27c800b2c0 tx=0x7f27c801b980 comp rx=0 tx=0).stop 2023-10-03T19:12:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.965+0000 7f27dcf85640 1 -- 172.21.15.45:0/1796079852 shutdown_connections 2023-10-03T19:12:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.965+0000 7f27dcf85640 1 --2- 172.21.15.45:0/1796079852 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f27b80662b0 0x7f27b8068760 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.965+0000 7f27dcf85640 1 --2- 172.21.15.45:0/1796079852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27d814f510 0x7f27d8143d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.965+0000 7f27dcf85640 1 --2- 172.21.15.45:0/1796079852 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f27d814ba30 0x7f27d81e40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.965+0000 7f27dcf85640 1 --2- 172.21.15.45:0/1796079852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27d806f880 0x7f27d81419e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.965+0000 7f27dcf85640 1 -- 172.21.15.45:0/1796079852 >> 172.21.15.45:0/1796079852 conn(0x7f27d80a20d0 msgr2=0x7f27d80a3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.965+0000 7f27dcf85640 1 -- 172.21.15.45:0/1796079852 shutdown_connections 2023-10-03T19:12:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:30.965+0000 7f27dcf85640 1 -- 172.21.15.45:0/1796079852 wait complete. 2023-10-03T19:12:30.971 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:12:30.973 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:12:30.992 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-03T19:12:30.993 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:12:31.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.173+0000 7f0d801d3640 1 Processor -- start 2023-10-03T19:12:31.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.177+0000 7f0d801d3640 1 -- start start 2023-10-03T19:12:31.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.177+0000 7f0d801d3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0d7814bfa0 0x7f0d7806a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:31.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.177+0000 7f0d801d3640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d780bf210 0x7f0d7806a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:31.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.177+0000 7f0d801d3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0d780c0c20 0x7f0d780c10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:31.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.177+0000 7f0d801d3640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d7814f350 con 0x7f0d7814bfa0 2023-10-03T19:12:31.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.177+0000 7f0d801d3640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d780a3cf0 con 0x7f0d780c0c20 2023-10-03T19:12:31.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.177+0000 7f0d801d3640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7814c370 con 0x7f0d780bf210 2023-10-03T19:12:31.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.177+0000 7f0d7df6f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0d7814bfa0 0x7f0d7806a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:31.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.177+0000 7f0d7df6f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0d7814bfa0 0x7f0d7806a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46560/0 (socket says 172.21.15.45:46560) 2023-10-03T19:12:31.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.177+0000 7f0d7df6f640 1 -- 172.21.15.45:0/3016201705 learned_addr learned my addr 172.21.15.45:0/3016201705 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:31.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.177+0000 7f0d7d76e640 1 --2- 172.21.15.45:0/3016201705 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d780bf210 0x7f0d7806a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:31.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.177+0000 7f0d7e770640 1 --2- 172.21.15.45:0/3016201705 >> v2:172.21.15.79:3300/0 conn(0x7f0d780c0c20 0x7f0d780c10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:31.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.177+0000 7f0d7df6f640 1 -- 172.21.15.45:0/3016201705 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d780bf210 msgr2=0x7f0d7806a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:31.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.177+0000 7f0d7df6f640 1 --2- 172.21.15.45:0/3016201705 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d780bf210 0x7f0d7806a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:31.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.177+0000 7f0d7df6f640 1 -- 172.21.15.45:0/3016201705 >> v2:172.21.15.79:3300/0 conn(0x7f0d780c0c20 msgr2=0x7f0d780c10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:31.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.177+0000 7f0d7df6f640 1 --2- 172.21.15.45:0/3016201705 >> v2:172.21.15.79:3300/0 conn(0x7f0d780c0c20 0x7f0d780c10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:31.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.177+0000 7f0d7df6f640 1 -- 172.21.15.45:0/3016201705 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d780c2a50 con 0x7f0d7814bfa0 2023-10-03T19:12:31.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.177+0000 7f0d7df6f640 1 --2- 172.21.15.45:0/3016201705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d7814bfa0 0x7f0d7806a0e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0d7806b850 tx=0x7f0d7001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b9f97d466e133d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:31.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.177+0000 7f0d7cf6d640 1 -- 172.21.15.45:0/3016201705 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d700af400 con 0x7f0d7814bfa0 2023-10-03T19:12:31.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.177+0000 7f0d7cf6d640 1 -- 172.21.15.45:0/3016201705 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d700ab050 con 0x7f0d7814bfa0 2023-10-03T19:12:31.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.177+0000 7f0d7cf6d640 1 -- 172.21.15.45:0/3016201705 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d700af780 con 0x7f0d7814bfa0 2023-10-03T19:12:31.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d801d3640 1 -- 172.21.15.45:0/3016201705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d7814bfa0 msgr2=0x7f0d7806a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:31.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d801d3640 1 --2- 172.21.15.45:0/3016201705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d7814bfa0 0x7f0d7806a0e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0d7806b850 tx=0x7f0d7001f1c0 comp rx=0 tx=0).stop 2023-10-03T19:12:31.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d801d3640 1 -- 172.21.15.45:0/3016201705 shutdown_connections 2023-10-03T19:12:31.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d801d3640 1 --2- 172.21.15.45:0/3016201705 >> v2:172.21.15.79:3300/0 conn(0x7f0d780c0c20 0x7f0d780c10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:31.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d801d3640 1 --2- 172.21.15.45:0/3016201705 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d780bf210 0x7f0d7806a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:31.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d801d3640 1 --2- 172.21.15.45:0/3016201705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d7814bfa0 0x7f0d7806a0e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:31.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d801d3640 1 -- 172.21.15.45:0/3016201705 >> 172.21.15.45:0/3016201705 conn(0x7f0d780a64a0 msgr2=0x7f0d780a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:31.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d801d3640 1 -- 172.21.15.45:0/3016201705 shutdown_connections 2023-10-03T19:12:31.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d801d3640 1 -- 172.21.15.45:0/3016201705 wait complete. 2023-10-03T19:12:31.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d801d3640 1 Processor -- start 2023-10-03T19:12:31.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d801d3640 1 -- start start 2023-10-03T19:12:31.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d801d3640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d780bf210 0x7f0d780be720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:31.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d801d3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d780c0c20 0x7f0d780c37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:31.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d801d3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d7814bfa0 0x7f0d78148690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:31.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d801d3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d781e8280 con 0x7f0d780c0c20 2023-10-03T19:12:31.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d801d3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d781501d0 con 0x7f0d7814bfa0 2023-10-03T19:12:31.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d801d3640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d781e7cc0 con 0x7f0d780bf210 2023-10-03T19:12:31.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d7d76e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d780c0c20 0x7f0d780c37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:31.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d7d76e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d780c0c20 0x7f0d780c37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46568/0 (socket says 172.21.15.45:46568) 2023-10-03T19:12:31.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d7d76e640 1 -- 172.21.15.45:0/3552198162 learned_addr learned my addr 172.21.15.45:0/3552198162 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:31.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d7df6f640 1 --2- 172.21.15.45:0/3552198162 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d780bf210 0x7f0d780be720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:31.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d7e770640 1 --2- 172.21.15.45:0/3552198162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d7814bfa0 0x7f0d78148690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:31.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d7d76e640 1 -- 172.21.15.45:0/3552198162 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d780bf210 msgr2=0x7f0d780be720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:31.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d7d76e640 1 --2- 172.21.15.45:0/3552198162 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d780bf210 0x7f0d780be720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:31.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d7d76e640 1 -- 172.21.15.45:0/3552198162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d7814bfa0 msgr2=0x7f0d78148690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:31.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d7d76e640 1 --2- 172.21.15.45:0/3552198162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d7814bfa0 0x7f0d78148690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:31.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d7d76e640 1 -- 172.21.15.45:0/3552198162 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d70009b30 con 0x7f0d780c0c20 2023-10-03T19:12:31.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d7d76e640 1 --2- 172.21.15.45:0/3552198162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d780c0c20 0x7f0d780c37c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800d830 tx=0x7f0d6800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:31.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d6e7fc640 1 -- 172.21.15.45:0/3552198162 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d680096a0 con 0x7f0d780c0c20 2023-10-03T19:12:31.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d6e7fc640 1 -- 172.21.15.45:0/3552198162 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d68009800 con 0x7f0d780c0c20 2023-10-03T19:12:31.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d801d3640 1 -- 172.21.15.45:0/3552198162 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d7814f840 con 0x7f0d780c0c20 2023-10-03T19:12:31.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d6e7fc640 1 -- 172.21.15.45:0/3552198162 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d68009b70 con 0x7f0d780c0c20 2023-10-03T19:12:31.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.181+0000 7f0d801d3640 1 -- 172.21.15.45:0/3552198162 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d7806ab60 con 0x7f0d780c0c20 2023-10-03T19:12:31.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.185+0000 7f0d801d3640 1 -- 172.21.15.45:0/3552198162 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d7814f560 con 0x7f0d780c0c20 2023-10-03T19:12:31.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.185+0000 7f0d6e7fc640 1 -- 172.21.15.45:0/3552198162 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0d68014410 con 0x7f0d780c0c20 2023-10-03T19:12:31.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.185+0000 7f0d6e7fc640 1 --2- 172.21.15.45:0/3552198162 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0d5c0662b0 0x7f0d5c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:31.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.185+0000 7f0d6e7fc640 1 -- 172.21.15.45:0/3552198162 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0d680845a0 con 0x7f0d780c0c20 2023-10-03T19:12:31.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.185+0000 7f0d7df6f640 1 --2- 172.21.15.45:0/3552198162 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0d5c0662b0 0x7f0d5c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:31.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.185+0000 7f0d7df6f640 1 --2- 172.21.15.45:0/3552198162 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0d5c0662b0 0x7f0d5c068760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0d700b1000 tx=0x7f0d700aa000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:31.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.189+0000 7f0d6e7fc640 1 -- 172.21.15.45:0/3552198162 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0d68051a40 con 0x7f0d780c0c20 2023-10-03T19:12:31.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.377+0000 7f0d801d3640 1 -- 172.21.15.45:0/3552198162 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d7814ff80 con 0x7f0d780c0c20 2023-10-03T19:12:31.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.377+0000 7f0d6e7fc640 1 -- 172.21.15.45:0/3552198162 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3903 (secure 0 0 0) 0x7f0d68055060 con 0x7f0d780c0c20 2023-10-03T19:12:31.381 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:31.381 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/731286206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":731286206},{"type":"v1","addr":"172.21.15.45:6834","nonce":731286206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/144609891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":144609891},{"type":"v1","addr":"172.21.15.45:6835","nonce":144609891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:12:27.938475+0000","modified":"2023-10-03T19:12:30.957787+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/2693877820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2693877820},{"type":"v1","addr":"172.21.15.79:6835","nonce":2693877820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-03T19:12:31.382 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 7 2023-10-03T19:12:31.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.381+0000 7f0d801d3640 1 -- 172.21.15.45:0/3552198162 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0d5c0662b0 msgr2=0x7f0d5c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:31.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.381+0000 7f0d801d3640 1 --2- 172.21.15.45:0/3552198162 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0d5c0662b0 0x7f0d5c068760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0d700b1000 tx=0x7f0d700aa000 comp rx=0 tx=0).stop 2023-10-03T19:12:31.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.381+0000 7f0d801d3640 1 -- 172.21.15.45:0/3552198162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d780c0c20 msgr2=0x7f0d780c37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:31.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.381+0000 7f0d801d3640 1 --2- 172.21.15.45:0/3552198162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d780c0c20 0x7f0d780c37c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800d830 tx=0x7f0d6800dcf0 comp rx=0 tx=0).stop 2023-10-03T19:12:31.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.381+0000 7f0d801d3640 1 -- 172.21.15.45:0/3552198162 shutdown_connections 2023-10-03T19:12:31.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.381+0000 7f0d801d3640 1 --2- 172.21.15.45:0/3552198162 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0d5c0662b0 0x7f0d5c068760 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:31.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.381+0000 7f0d801d3640 1 --2- 172.21.15.45:0/3552198162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d7814bfa0 0x7f0d78148690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:31.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.381+0000 7f0d801d3640 1 --2- 172.21.15.45:0/3552198162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d780c0c20 0x7f0d780c37c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:31.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.381+0000 7f0d801d3640 1 --2- 172.21.15.45:0/3552198162 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d780bf210 0x7f0d780be720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:31.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.381+0000 7f0d801d3640 1 -- 172.21.15.45:0/3552198162 >> 172.21.15.45:0/3552198162 conn(0x7f0d780a64a0 msgr2=0x7f0d7814e750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:31.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.381+0000 7f0d801d3640 1 -- 172.21.15.45:0/3552198162 shutdown_connections 2023-10-03T19:12:31.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.381+0000 7f0d801d3640 1 -- 172.21.15.45:0/3552198162 wait complete. 2023-10-03T19:12:31.401 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:12:31.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.513+0000 7f7982e0c640 1 Processor -- start 2023-10-03T19:12:31.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.513+0000 7f7982e0c640 1 -- start start 2023-10-03T19:12:31.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.513+0000 7f7982e0c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f797c14bc10 0x7f797c0beca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:31.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.513+0000 7f7982e0c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f797c0ba1b0 0x7f797c159010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:31.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.513+0000 7f7982e0c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797c14f6b0 con 0x7f797c070b70 2023-10-03T19:12:31.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.513+0000 7f7982e0c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f797c0c0c10 con 0x7f797c14bc10 2023-10-03T19:12:31.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.513+0000 7f7982e0c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f797c071550 con 0x7f797c0ba1b0 2023-10-03T19:12:31.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.513+0000 7f7980ba8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f797c14bc10 0x7f797c0beca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:31.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.513+0000 7f797bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f797c070b70 0x7f797c14efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35766/0 (socket says 172.21.15.45:35766) 2023-10-03T19:12:31.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.513+0000 7f797bfff640 1 -- 172.21.15.45:0/160482484 learned_addr learned my addr 172.21.15.45:0/160482484 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:31.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.513+0000 7f79813a9640 1 --2- 172.21.15.45:0/160482484 >> v2:172.21.15.79:3300/0 conn(0x7f797c0ba1b0 0x7f797c159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:31.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.513+0000 7f7980ba8640 1 -- 172.21.15.45:0/160482484 >> v2:172.21.15.79:3300/0 conn(0x7f797c0ba1b0 msgr2=0x7f797c159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:31.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.513+0000 7f797b7fe640 1 -- 172.21.15.45:0/160482484 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2876292406 0 0) 0x7f7970001120 con 0x7f797c070b70 2023-10-03T19:12:31.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.513+0000 7f7980ba8640 1 --2- 172.21.15.45:0/160482484 >> v2:172.21.15.79:3300/0 conn(0x7f797c0ba1b0 0x7f797c159010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:31.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.513+0000 7f7980ba8640 1 -- 172.21.15.45:0/160482484 >> v1:172.21.15.45:6789/0 conn(0x7f797c070b70 legacy=0x7f797c14efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:31.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.513+0000 7f7980ba8640 1 -- 172.21.15.45:0/160482484 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c071270 con 0x7f797c14bc10 2023-10-03T19:12:31.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.517+0000 7f79813a9640 1 --2- 172.21.15.45:0/160482484 >> v2:172.21.15.79:3300/0 conn(0x7f797c0ba1b0 0x7f797c159010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:31.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.517+0000 7f7980ba8640 1 --2- 172.21.15.45:0/160482484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f797c14bc10 0x7f797c0beca0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f797c0be7d0 tx=0x7f796c01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb1e276264e28d48 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:31.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.517+0000 7f797b7fe640 1 -- 172.21.15.45:0/160482484 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c0a8950 con 0x7f797c14bc10 2023-10-03T19:12:31.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.517+0000 7f797b7fe640 1 -- 172.21.15.45:0/160482484 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796c0a8ab0 con 0x7f797c14bc10 2023-10-03T19:12:31.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.517+0000 7f797b7fe640 1 -- 172.21.15.45:0/160482484 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c0a8e40 con 0x7f797c14bc10 2023-10-03T19:12:31.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.517+0000 7f7982e0c640 1 -- 172.21.15.45:0/160482484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f797c14bc10 msgr2=0x7f797c0beca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:31.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.517+0000 7f7982e0c640 1 --2- 172.21.15.45:0/160482484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f797c14bc10 0x7f797c0beca0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f797c0be7d0 tx=0x7f796c01ec50 comp rx=0 tx=0).stop 2023-10-03T19:12:31.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.517+0000 7f7982e0c640 1 -- 172.21.15.45:0/160482484 shutdown_connections 2023-10-03T19:12:31.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.517+0000 7f7982e0c640 1 --2- 172.21.15.45:0/160482484 >> v2:172.21.15.79:3300/0 conn(0x7f797c0ba1b0 0x7f797c159010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:31.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.517+0000 7f7982e0c640 1 --2- 172.21.15.45:0/160482484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f797c14bc10 0x7f797c0beca0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:31.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.517+0000 7f7982e0c640 1 -- 172.21.15.45:0/160482484 >> 172.21.15.45:0/160482484 conn(0x7f797c0bd880 msgr2=0x7f797c0bdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:31.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.517+0000 7f7982e0c640 1 -- 172.21.15.45:0/160482484 shutdown_connections 2023-10-03T19:12:31.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.517+0000 7f7982e0c640 1 -- 172.21.15.45:0/160482484 wait complete. 2023-10-03T19:12:31.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.517+0000 7f7982e0c640 1 Processor -- start 2023-10-03T19:12:31.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.517+0000 7f7982e0c640 1 -- start start 2023-10-03T19:12:31.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.521+0000 7f7982e0c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f797c070b70 0x7f797c152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:31.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.521+0000 7f7982e0c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f797c0ba1b0 0x7f797c0a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:31.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.521+0000 7f7982e0c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f797c14bc10 0x7f797c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:31.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.521+0000 7f7982e0c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c1e4340 con 0x7f797c070b70 2023-10-03T19:12:31.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.521+0000 7f7982e0c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c152b50 con 0x7f797c0ba1b0 2023-10-03T19:12:31.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.521+0000 7f7982e0c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797c1e3fa0 con 0x7f797c14bc10 2023-10-03T19:12:31.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.521+0000 7f7980ba8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f797c070b70 0x7f797c152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:31.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.521+0000 7f7980ba8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f797c070b70 0x7f797c152610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46576/0 (socket says 172.21.15.45:46576) 2023-10-03T19:12:31.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.521+0000 7f7980ba8640 1 -- 172.21.15.45:0/3212307694 learned_addr learned my addr 172.21.15.45:0/3212307694 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:31.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.521+0000 7f797bfff640 1 --2- 172.21.15.45:0/3212307694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f797c0ba1b0 0x7f797c0a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:31.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.521+0000 7f7980ba8640 1 -- 172.21.15.45:0/3212307694 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f797c14bc10 msgr2=0x7f797c0a5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:31.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.521+0000 7f79813a9640 1 --2- 172.21.15.45:0/3212307694 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f797c14bc10 0x7f797c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:31.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.521+0000 7f7980ba8640 1 --2- 172.21.15.45:0/3212307694 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f797c14bc10 0x7f797c0a5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:31.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.521+0000 7f7980ba8640 1 -- 172.21.15.45:0/3212307694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f797c0ba1b0 msgr2=0x7f797c0a5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:31.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.521+0000 7f7980ba8640 1 --2- 172.21.15.45:0/3212307694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f797c0ba1b0 0x7f797c0a5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:31.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.521+0000 7f7980ba8640 1 -- 172.21.15.45:0/3212307694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c009420 con 0x7f797c070b70 2023-10-03T19:12:31.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.521+0000 7f797bfff640 1 --2- 172.21.15.45:0/3212307694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f797c0ba1b0 0x7f797c0a5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:31.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.521+0000 7f79813a9640 1 --2- 172.21.15.45:0/3212307694 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f797c14bc10 0x7f797c0a5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:31.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.521+0000 7f7980ba8640 1 --2- 172.21.15.45:0/3212307694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f797c070b70 0x7f797c152610 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f796c0b3040 tx=0x7f796c01b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:31.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.521+0000 7f79797fa640 1 -- 172.21.15.45:0/3212307694 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c0a8950 con 0x7f797c070b70 2023-10-03T19:12:31.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.521+0000 7f79797fa640 1 -- 172.21.15.45:0/3212307694 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796c0b9410 con 0x7f797c070b70 2023-10-03T19:12:31.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.521+0000 7f7982e0c640 1 -- 172.21.15.45:0/3212307694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797c14ea80 con 0x7f797c070b70 2023-10-03T19:12:31.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.521+0000 7f79797fa640 1 -- 172.21.15.45:0/3212307694 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c0b97c0 con 0x7f797c070b70 2023-10-03T19:12:31.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.521+0000 7f7982e0c640 1 -- 172.21.15.45:0/3212307694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f797c14e7a0 con 0x7f797c070b70 2023-10-03T19:12:31.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.521+0000 7f7982e0c640 1 -- 172.21.15.45:0/3212307694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f797c14bfe0 con 0x7f797c070b70 2023-10-03T19:12:31.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.521+0000 7f79797fa640 1 -- 172.21.15.45:0/3212307694 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f796c0b7040 con 0x7f797c070b70 2023-10-03T19:12:31.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.521+0000 7f79797fa640 1 --2- 172.21.15.45:0/3212307694 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f79680662b0 0x7f7968068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:31.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.521+0000 7f79797fa640 1 -- 172.21.15.45:0/3212307694 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f796c121ac0 con 0x7f797c070b70 2023-10-03T19:12:31.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.521+0000 7f797bfff640 1 --2- 172.21.15.45:0/3212307694 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f79680662b0 0x7f7968068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:31.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.525+0000 7f797bfff640 1 --2- 172.21.15.45:0/3212307694 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f79680662b0 0x7f7968068760 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f797c071920 tx=0x7f7970009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:31.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.525+0000 7f79797fa640 1 -- 172.21.15.45:0/3212307694 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f796c0eeeb0 con 0x7f797c070b70 2023-10-03T19:12:31.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.681+0000 7f7982e0c640 1 -- 172.21.15.45:0/3212307694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f797c04de80 con 0x7f797c070b70 2023-10-03T19:12:31.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.681+0000 7f79797fa640 1 -- 172.21.15.45:0/3212307694 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18231 (secure 0 0 0) 0x7f796c121e60 con 0x7f797c070b70 2023-10-03T19:12:31.686 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:31.686 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:12:28.941467+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:12:26.226431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T19:12:26.923174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:12:31.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.685+0000 7f7982e0c640 1 -- 172.21.15.45:0/3212307694 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f79680662b0 msgr2=0x7f7968068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:31.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.685+0000 7f7982e0c640 1 --2- 172.21.15.45:0/3212307694 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f79680662b0 0x7f7968068760 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f797c071920 tx=0x7f7970009040 comp rx=0 tx=0).stop 2023-10-03T19:12:31.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.685+0000 7f7982e0c640 1 -- 172.21.15.45:0/3212307694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f797c070b70 msgr2=0x7f797c152610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:31.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.685+0000 7f7982e0c640 1 --2- 172.21.15.45:0/3212307694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f797c070b70 0x7f797c152610 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f796c0b3040 tx=0x7f796c01b9f0 comp rx=0 tx=0).stop 2023-10-03T19:12:31.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.685+0000 7f7982e0c640 1 -- 172.21.15.45:0/3212307694 shutdown_connections 2023-10-03T19:12:31.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.685+0000 7f7982e0c640 1 --2- 172.21.15.45:0/3212307694 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f79680662b0 0x7f7968068760 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:31.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.685+0000 7f7982e0c640 1 --2- 172.21.15.45:0/3212307694 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f797c14bc10 0x7f797c0a5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:31.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.685+0000 7f7982e0c640 1 --2- 172.21.15.45:0/3212307694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f797c0ba1b0 0x7f797c0a5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:31.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.685+0000 7f7982e0c640 1 --2- 172.21.15.45:0/3212307694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f797c070b70 0x7f797c152610 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:31.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.685+0000 7f7982e0c640 1 -- 172.21.15.45:0/3212307694 >> 172.21.15.45:0/3212307694 conn(0x7f797c0bd880 msgr2=0x7f797c14b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:31.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.685+0000 7f7982e0c640 1 -- 172.21.15.45:0/3212307694 shutdown_connections 2023-10-03T19:12:31.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.685+0000 7f7982e0c640 1 -- 172.21.15.45:0/3212307694 wait complete. 2023-10-03T19:12:31.703 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-03T19:12:31.703 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:12:31.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f075a553640 1 Processor -- start 2023-10-03T19:12:31.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f075a553640 1 -- start start 2023-10-03T19:12:31.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f075a553640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07540a2e20 0x7f075406c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:31.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f075a553640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07540ba550 con 0x7f07540bc810 2023-10-03T19:12:31.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f075a553640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07541526d0 con 0x7f07540b98f0 2023-10-03T19:12:31.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f075a553640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07541529b0 con 0x7f07540a2e20 2023-10-03T19:12:31.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f074b7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f07540bc810 0x7f075406c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35770/0 (socket says 172.21.15.45:35770) 2023-10-03T19:12:31.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f074b7fe640 1 -- 172.21.15.45:0/2600231760 learned_addr learned my addr 172.21.15.45:0/2600231760 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:31.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f0758af0640 1 --2- 172.21.15.45:0/2600231760 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07540a2e20 0x7f075406c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:31.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f07537fe640 1 -- 172.21.15.45:0/2600231760 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305418600 0 0) 0x7f07540ba550 con 0x7f07540bc810 2023-10-03T19:12:31.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f07537fe640 1 -- 172.21.15.45:0/2600231760 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0740003530 con 0x7f07540bc810 2023-10-03T19:12:31.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f07537fe640 1 -- 172.21.15.45:0/2600231760 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4160062627 0 0) 0x7f0740003530 con 0x7f07540bc810 2023-10-03T19:12:31.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f07537fe640 1 -- 172.21.15.45:0/2600231760 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07540a2e20 msgr2=0x7f075406c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:31.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f07537fe640 1 --2- 172.21.15.45:0/2600231760 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07540a2e20 0x7f075406c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:31.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f07537fe640 1 -- 172.21.15.45:0/2600231760 >> v1:172.21.15.79:6789/0 conn(0x7f07540b98f0 legacy=0x7f07540b9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:31.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f07537fe640 1 -- 172.21.15.45:0/2600231760 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075406cee0 con 0x7f07540bc810 2023-10-03T19:12:31.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f07537fe640 1 -- 172.21.15.45:0/2600231760 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f073c001680 con 0x7f07540bc810 2023-10-03T19:12:31.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f07537fe640 1 -- 172.21.15.45:0/2600231760 >> v1:172.21.15.45:6789/0 conn(0x7f07540bc810 legacy=0x7f075406c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:31.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f07537fe640 1 --2- 172.21.15.45:0/2600231760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07400039b0 0x7f0740003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:31.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f07537fe640 1 --2- 172.21.15.45:0/2600231760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07400047d0 0x7f0740004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:31.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f07537fe640 1 --2- 172.21.15.45:0/2600231760 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07540a2e20 0x7f0740005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:31.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f07537fe640 1 -- 172.21.15.45:0/2600231760 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07541529b0 con 0x7f07400039b0 2023-10-03T19:12:31.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f07537fe640 1 -- 172.21.15.45:0/2600231760 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074000bad0 con 0x7f07400047d0 2023-10-03T19:12:31.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f07537fe640 1 -- 172.21.15.45:0/2600231760 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074000bc60 con 0x7f07540a2e20 2023-10-03T19:12:31.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f0753fff640 1 --2- 172.21.15.45:0/2600231760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07400039b0 0x7f0740003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:31.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f074b7fe640 1 --2- 172.21.15.45:0/2600231760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07400047d0 0x7f0740004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:31.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f0758af0640 1 --2- 172.21.15.45:0/2600231760 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07540a2e20 0x7f0740005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:31.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f0753fff640 1 -- 172.21.15.45:0/2600231760 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07540a2e20 msgr2=0x7f0740005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:31.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f0753fff640 1 --2- 172.21.15.45:0/2600231760 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07540a2e20 0x7f0740005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:31.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f0753fff640 1 -- 172.21.15.45:0/2600231760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07400047d0 msgr2=0x7f0740004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:31.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f0753fff640 1 --2- 172.21.15.45:0/2600231760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07400047d0 0x7f0740004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:31.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f0753fff640 1 -- 172.21.15.45:0/2600231760 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0740003530 con 0x7f07400039b0 2023-10-03T19:12:31.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.813+0000 7f0758af0640 1 --2- 172.21.15.45:0/2600231760 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07540a2e20 0x7f0740005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:31.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.817+0000 7f0753fff640 1 --2- 172.21.15.45:0/2600231760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07400039b0 0x7f0740003dc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0744001780 tx=0x7f074401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1455ccadc88b4fd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:31.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.817+0000 7f07537fe640 1 -- 172.21.15.45:0/2600231760 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07440052d0 con 0x7f07400039b0 2023-10-03T19:12:31.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.817+0000 7f07537fe640 1 -- 172.21.15.45:0/2600231760 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07440a7050 con 0x7f07400039b0 2023-10-03T19:12:31.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.817+0000 7f07537fe640 1 -- 172.21.15.45:0/2600231760 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0744003600 con 0x7f07400039b0 2023-10-03T19:12:31.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.817+0000 7f075a553640 1 -- 172.21.15.45:0/2600231760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07400039b0 msgr2=0x7f0740003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:31.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.817+0000 7f075a553640 1 --2- 172.21.15.45:0/2600231760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07400039b0 0x7f0740003dc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0744001780 tx=0x7f074401c400 comp rx=0 tx=0).stop 2023-10-03T19:12:31.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.817+0000 7f0758af0640 1 -- 172.21.15.45:0/2600231760 reap_dead start 2023-10-03T19:12:31.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.817+0000 7f075a553640 1 -- 172.21.15.45:0/2600231760 shutdown_connections 2023-10-03T19:12:31.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.817+0000 7f075a553640 1 -- 172.21.15.45:0/2600231760 >> 172.21.15.45:0/2600231760 conn(0x7f07540bcf50 msgr2=0x7f07540bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:31.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.817+0000 7f075a553640 1 -- 172.21.15.45:0/2600231760 shutdown_connections 2023-10-03T19:12:31.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.817+0000 7f075a553640 1 -- 172.21.15.45:0/2600231760 wait complete. 2023-10-03T19:12:31.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.817+0000 7f075a553640 1 Processor -- start 2023-10-03T19:12:31.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.817+0000 7f075a553640 1 -- start start 2023-10-03T19:12:31.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.817+0000 7f075a553640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07400039b0 0x7f0754143a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:31.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.817+0000 7f075a553640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f075413b5a0 0x7f0754070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:31.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.817+0000 7f075a553640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0754151700 0x7f0754070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:31.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.817+0000 7f075a553640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075413ba30 con 0x7f0754151700 2023-10-03T19:12:31.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.817+0000 7f075a553640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0754150690 con 0x7f075413b5a0 2023-10-03T19:12:31.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.817+0000 7f075a553640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0754070e90 con 0x7f07400039b0 2023-10-03T19:12:31.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.817+0000 7f0758af0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0754151700 0x7f0754070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:31.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.817+0000 7f0758af0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0754151700 0x7f0754070950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46604/0 (socket says 172.21.15.45:46604) 2023-10-03T19:12:31.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.817+0000 7f0758af0640 1 -- 172.21.15.45:0/468331398 learned_addr learned my addr 172.21.15.45:0/468331398 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:31.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.817+0000 7f0753fff640 1 --2- 172.21.15.45:0/468331398 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07400039b0 0x7f0754143a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:31.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.817+0000 7f074b7fe640 1 --2- 172.21.15.45:0/468331398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f075413b5a0 0x7f0754070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:31.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.817+0000 7f0758af0640 1 -- 172.21.15.45:0/468331398 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07400039b0 msgr2=0x7f0754143a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:31.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.817+0000 7f0758af0640 1 --2- 172.21.15.45:0/468331398 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07400039b0 0x7f0754143a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:31.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.817+0000 7f0758af0640 1 -- 172.21.15.45:0/468331398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f075413b5a0 msgr2=0x7f0754070410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:31.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.817+0000 7f0758af0640 1 --2- 172.21.15.45:0/468331398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f075413b5a0 0x7f0754070410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:31.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.817+0000 7f0758af0640 1 -- 172.21.15.45:0/468331398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07540baae0 con 0x7f0754151700 2023-10-03T19:12:31.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.817+0000 7f0753fff640 1 --2- 172.21.15.45:0/468331398 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07400039b0 0x7f0754143a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:12:31.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.821+0000 7f0758af0640 1 --2- 172.21.15.45:0/468331398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0754151700 0x7f0754070950 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f075406afd0 tx=0x7f074c00f0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:31.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.821+0000 7f07517fa640 1 -- 172.21.15.45:0/468331398 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c00f810 con 0x7f0754151700 2023-10-03T19:12:31.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.821+0000 7f07517fa640 1 -- 172.21.15.45:0/468331398 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074c011040 con 0x7f0754151700 2023-10-03T19:12:31.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.821+0000 7f075a553640 1 -- 172.21.15.45:0/468331398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07540ba950 con 0x7f0754151700 2023-10-03T19:12:31.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.821+0000 7f07517fa640 1 -- 172.21.15.45:0/468331398 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c00fb90 con 0x7f0754151700 2023-10-03T19:12:31.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.821+0000 7f075a553640 1 -- 172.21.15.45:0/468331398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075414bf50 con 0x7f0754151700 2023-10-03T19:12:31.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.821+0000 7f075a553640 1 -- 172.21.15.45:0/468331398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07541507d0 con 0x7f0754151700 2023-10-03T19:12:31.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.821+0000 7f07517fa640 1 -- 172.21.15.45:0/468331398 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f074c00fcf0 con 0x7f0754151700 2023-10-03T19:12:31.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.821+0000 7f07517fa640 1 --2- 172.21.15.45:0/468331398 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0734066280 0x7f0734068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:31.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.821+0000 7f07517fa640 1 -- 172.21.15.45:0/468331398 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f074c0837d0 con 0x7f0754151700 2023-10-03T19:12:31.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.821+0000 7f0753fff640 1 --2- 172.21.15.45:0/468331398 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0734066280 0x7f0734068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:31.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.821+0000 7f0753fff640 1 --2- 172.21.15.45:0/468331398 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0734066280 0x7f0734068730 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0744001750 tx=0x7f07440011a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:31.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.825+0000 7f07517fa640 1 -- 172.21.15.45:0/468331398 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f07541507d0 con 0x7f0754151700 2023-10-03T19:12:31.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:31.981+0000 7f075a553640 1 -- 172.21.15.45:0/468331398 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0754150430 con 0x7f0734066280 2023-10-03T19:12:32.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.001+0000 7f07517fa640 1 -- 172.21.15.45:0/468331398 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277453 (secure 0 0 0) 0x7f0744005450 con 0x7f0734066280 2023-10-03T19:12:32.009 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:32.011 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:12:32.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.005+0000 7f075a553640 1 -- 172.21.15.45:0/468331398 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0734066280 msgr2=0x7f0734068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:32.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.005+0000 7f075a553640 1 --2- 172.21.15.45:0/468331398 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0734066280 0x7f0734068730 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0744001750 tx=0x7f07440011a0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.005+0000 7f075a553640 1 -- 172.21.15.45:0/468331398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0754151700 msgr2=0x7f0754070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:32.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.005+0000 7f075a553640 1 --2- 172.21.15.45:0/468331398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0754151700 0x7f0754070950 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f075406afd0 tx=0x7f074c00f0d0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.005+0000 7f075a553640 1 -- 172.21.15.45:0/468331398 shutdown_connections 2023-10-03T19:12:32.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.005+0000 7f075a553640 1 --2- 172.21.15.45:0/468331398 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0734066280 0x7f0734068730 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.005+0000 7f075a553640 1 --2- 172.21.15.45:0/468331398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0754151700 0x7f0754070950 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.005+0000 7f075a553640 1 --2- 172.21.15.45:0/468331398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f075413b5a0 0x7f0754070410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.005+0000 7f075a553640 1 --2- 172.21.15.45:0/468331398 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07400039b0 0x7f0754143a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.005+0000 7f075a553640 1 -- 172.21.15.45:0/468331398 >> 172.21.15.45:0/468331398 conn(0x7f07540bcf50 msgr2=0x7f07540a4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:32.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.005+0000 7f075a553640 1 -- 172.21.15.45:0/468331398 shutdown_connections 2023-10-03T19:12:32.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.005+0000 7f075a553640 1 -- 172.21.15.45:0/468331398 wait complete. 2023-10-03T19:12:32.026 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-03T19:12:30.439821+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":169,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":102,"acting":102,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":75040,"kb_used_data":1556,"kb_used_omap":0,"kb_used_meta":73408,"kb_avail":754899680,"statfs":{"total":773094113280,"available":773017272320,"internally_reserved":0,"allocated":1593344,"data_stored":1664959,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":75169792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.894372"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954200+0000","last_change":"2023-10-03T19:12:27.970081+0000","last_active":"2023-10-03T19:12:28.954200+0000","last_peered":"2023-10-03T19:12:28.954200+0000","last_clean":"2023-10-03T19:12:28.954200+0000","last_became_active":"2023-10-03T19:12:27.969751+0000","last_became_peered":"2023-10-03T19:12:27.969751+0000","last_unstale":"2023-10-03T19:12:28.954200+0000","last_undegraded":"2023-10-03T19:12:28.954200+0000","last_fullsized":"2023-10-03T19:12:28.954200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:51:23.880877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.974769+0000","last_change":"2023-10-03T19:12:27.966859+0000","last_active":"2023-10-03T19:12:27.974769+0000","last_peered":"2023-10-03T19:12:27.974769+0000","last_clean":"2023-10-03T19:12:27.974769+0000","last_became_active":"2023-10-03T19:12:27.966145+0000","last_became_peered":"2023-10-03T19:12:27.966145+0000","last_unstale":"2023-10-03T19:12:27.974769+0000","last_undegraded":"2023-10-03T19:12:27.974769+0000","last_fullsized":"2023-10-03T19:12:27.974769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:22:31.716735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.951743+0000","last_change":"2023-10-03T19:12:27.959887+0000","last_active":"2023-10-03T19:12:28.951743+0000","last_peered":"2023-10-03T19:12:28.951743+0000","last_clean":"2023-10-03T19:12:28.951743+0000","last_became_active":"2023-10-03T19:12:27.959538+0000","last_became_peered":"2023-10-03T19:12:27.959538+0000","last_unstale":"2023-10-03T19:12:28.951743+0000","last_undegraded":"2023-10-03T19:12:28.951743+0000","last_fullsized":"2023-10-03T19:12:28.951743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:57:42.821868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.976471+0000","last_change":"2023-10-03T19:12:27.970249+0000","last_active":"2023-10-03T19:12:27.976471+0000","last_peered":"2023-10-03T19:12:27.976471+0000","last_clean":"2023-10-03T19:12:27.976471+0000","last_became_active":"2023-10-03T19:12:27.969995+0000","last_became_peered":"2023-10-03T19:12:27.969995+0000","last_unstale":"2023-10-03T19:12:27.976471+0000","last_undegraded":"2023-10-03T19:12:27.976471+0000","last_fullsized":"2023-10-03T19:12:27.976471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:23:25.342990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952651+0000","last_change":"2023-10-03T19:12:27.964836+0000","last_active":"2023-10-03T19:12:28.952651+0000","last_peered":"2023-10-03T19:12:28.952651+0000","last_clean":"2023-10-03T19:12:28.952651+0000","last_became_active":"2023-10-03T19:12:27.964025+0000","last_became_peered":"2023-10-03T19:12:27.964025+0000","last_unstale":"2023-10-03T19:12:28.952651+0000","last_undegraded":"2023-10-03T19:12:28.952651+0000","last_fullsized":"2023-10-03T19:12:28.952651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:22:33.134502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952943+0000","last_change":"2023-10-03T19:12:27.970387+0000","last_active":"2023-10-03T19:12:28.952943+0000","last_peered":"2023-10-03T19:12:28.952943+0000","last_clean":"2023-10-03T19:12:28.952943+0000","last_became_active":"2023-10-03T19:12:27.969970+0000","last_became_peered":"2023-10-03T19:12:27.969970+0000","last_unstale":"2023-10-03T19:12:28.952943+0000","last_undegraded":"2023-10-03T19:12:28.952943+0000","last_fullsized":"2023-10-03T19:12:28.952943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:57:10.455144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.974830+0000","last_change":"2023-10-03T19:12:27.968081+0000","last_active":"2023-10-03T19:12:27.974830+0000","last_peered":"2023-10-03T19:12:27.974830+0000","last_clean":"2023-10-03T19:12:27.974830+0000","last_became_active":"2023-10-03T19:12:27.967067+0000","last_became_peered":"2023-10-03T19:12:27.967067+0000","last_unstale":"2023-10-03T19:12:27.974830+0000","last_undegraded":"2023-10-03T19:12:27.974830+0000","last_fullsized":"2023-10-03T19:12:27.974830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:26:21.421555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.974568+0000","last_change":"2023-10-03T19:12:27.966759+0000","last_active":"2023-10-03T19:12:27.974568+0000","last_peered":"2023-10-03T19:12:27.974568+0000","last_clean":"2023-10-03T19:12:27.974568+0000","last_became_active":"2023-10-03T19:12:27.966395+0000","last_became_peered":"2023-10-03T19:12:27.966395+0000","last_unstale":"2023-10-03T19:12:27.974568+0000","last_undegraded":"2023-10-03T19:12:27.974568+0000","last_fullsized":"2023-10-03T19:12:27.974568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:44:35.789330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952353+0000","last_change":"2023-10-03T19:12:27.978614+0000","last_active":"2023-10-03T19:12:28.952353+0000","last_peered":"2023-10-03T19:12:28.952353+0000","last_clean":"2023-10-03T19:12:28.952353+0000","last_became_active":"2023-10-03T19:12:27.978222+0000","last_became_peered":"2023-10-03T19:12:27.978222+0000","last_unstale":"2023-10-03T19:12:28.952353+0000","last_undegraded":"2023-10-03T19:12:28.952353+0000","last_fullsized":"2023-10-03T19:12:28.952353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:47:33.343155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-03T19:12:26.557010+0000","last_change":"2023-10-03T19:12:26.557010+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.557010+0000","last_undegraded":"2023-10-03T19:12:26.557010+0000","last_fullsized":"2023-10-03T19:12:26.557010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953302+0000","last_change":"2023-10-03T19:12:27.984997+0000","last_active":"2023-10-03T19:12:28.953302+0000","last_peered":"2023-10-03T19:12:28.953302+0000","last_clean":"2023-10-03T19:12:28.953302+0000","last_became_active":"2023-10-03T19:12:27.984682+0000","last_became_peered":"2023-10-03T19:12:27.984682+0000","last_unstale":"2023-10-03T19:12:28.953302+0000","last_undegraded":"2023-10-03T19:12:28.953302+0000","last_fullsized":"2023-10-03T19:12:28.953302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:29:18.707428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.948688+0000","last_change":"2023-10-03T19:12:27.589809+0000","last_active":"2023-10-03T19:12:27.948688+0000","last_peered":"2023-10-03T19:12:27.948688+0000","last_clean":"2023-10-03T19:12:27.948688+0000","last_became_active":"2023-10-03T19:12:27.589415+0000","last_became_peered":"2023-10-03T19:12:27.589415+0000","last_unstale":"2023-10-03T19:12:27.948688+0000","last_undegraded":"2023-10-03T19:12:27.948688+0000","last_fullsized":"2023-10-03T19:12:27.948688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:32:27.170784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.974645+0000","last_change":"2023-10-03T19:12:27.966910+0000","last_active":"2023-10-03T19:12:27.974645+0000","last_peered":"2023-10-03T19:12:27.974645+0000","last_clean":"2023-10-03T19:12:27.974645+0000","last_became_active":"2023-10-03T19:12:27.966160+0000","last_became_peered":"2023-10-03T19:12:27.966160+0000","last_unstale":"2023-10-03T19:12:27.974645+0000","last_undegraded":"2023-10-03T19:12:27.974645+0000","last_fullsized":"2023-10-03T19:12:27.974645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:19:53.879346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-03T19:12:26.556110+0000","last_change":"2023-10-03T19:12:26.556110+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.556110+0000","last_undegraded":"2023-10-03T19:12:26.556110+0000","last_fullsized":"2023-10-03T19:12:26.556110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-03T19:12:26.561025+0000","last_change":"2023-10-03T19:12:26.561025+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.561025+0000","last_undegraded":"2023-10-03T19:12:26.561025+0000","last_fullsized":"2023-10-03T19:12:26.561025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-03T19:12:26.556023+0000","last_change":"2023-10-03T19:12:26.556023+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.556023+0000","last_undegraded":"2023-10-03T19:12:26.556023+0000","last_fullsized":"2023-10-03T19:12:26.556023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.951943+0000","last_change":"2023-10-03T19:12:27.978558+0000","last_active":"2023-10-03T19:12:28.951943+0000","last_peered":"2023-10-03T19:12:28.951943+0000","last_clean":"2023-10-03T19:12:28.951943+0000","last_became_active":"2023-10-03T19:12:27.978193+0000","last_became_peered":"2023-10-03T19:12:27.978193+0000","last_unstale":"2023-10-03T19:12:28.951943+0000","last_undegraded":"2023-10-03T19:12:28.951943+0000","last_fullsized":"2023-10-03T19:12:28.951943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:21:27.107002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-03T19:12:26.556852+0000","last_change":"2023-10-03T19:12:26.556852+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.556852+0000","last_undegraded":"2023-10-03T19:12:26.556852+0000","last_fullsized":"2023-10-03T19:12:26.556852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-03T19:12:26.556610+0000","last_change":"2023-10-03T19:12:26.556610+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.556610+0000","last_undegraded":"2023-10-03T19:12:26.556610+0000","last_fullsized":"2023-10-03T19:12:26.556610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952130+0000","last_change":"2023-10-03T19:12:27.594338+0000","last_active":"2023-10-03T19:12:28.952130+0000","last_peered":"2023-10-03T19:12:28.952130+0000","last_clean":"2023-10-03T19:12:28.952130+0000","last_became_active":"2023-10-03T19:12:27.593882+0000","last_became_peered":"2023-10-03T19:12:27.593882+0000","last_unstale":"2023-10-03T19:12:28.952130+0000","last_undegraded":"2023-10-03T19:12:28.952130+0000","last_fullsized":"2023-10-03T19:12:28.952130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:55:54.733983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.976214+0000","last_change":"2023-10-03T19:12:27.969749+0000","last_active":"2023-10-03T19:12:27.976214+0000","last_peered":"2023-10-03T19:12:27.976214+0000","last_clean":"2023-10-03T19:12:27.976214+0000","last_became_active":"2023-10-03T19:12:27.966817+0000","last_became_peered":"2023-10-03T19:12:27.966817+0000","last_unstale":"2023-10-03T19:12:27.976214+0000","last_undegraded":"2023-10-03T19:12:27.976214+0000","last_fullsized":"2023-10-03T19:12:27.976214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:38:08.924887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:26.526882+0000","last_change":"2023-10-03T19:12:26.526882+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.526882+0000","last_undegraded":"2023-10-03T19:12:26.526882+0000","last_fullsized":"2023-10-03T19:12:26.526882+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-03T19:12:26.561190+0000","last_change":"2023-10-03T19:12:26.561190+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.561190+0000","last_undegraded":"2023-10-03T19:12:26.561190+0000","last_fullsized":"2023-10-03T19:12:26.561190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-03T19:12:26.548822+0000","last_change":"2023-10-03T19:12:26.548822+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.548822+0000","last_undegraded":"2023-10-03T19:12:26.548822+0000","last_fullsized":"2023-10-03T19:12:26.548822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:26.526882+0000","last_change":"2023-10-03T19:12:26.526882+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.526882+0000","last_undegraded":"2023-10-03T19:12:26.526882+0000","last_fullsized":"2023-10-03T19:12:26.526882+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T19:12:26.560078+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:12:26.560078+0000","last_peered":"2023-10-03T19:12:26.560078+0000","last_clean":"2023-10-03T19:12:26.560078+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:12:26.560078+0000","last_undegraded":"2023-10-03T19:12:26.560078+0000","last_fullsized":"2023-10-03T19:12:26.560078+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:47:33.755621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.951827+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:12:28.951827+0000","last_peered":"2023-10-03T19:12:28.951827+0000","last_clean":"2023-10-03T19:12:28.951827+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:12:28.951827+0000","last_undegraded":"2023-10-03T19:12:28.951827+0000","last_fullsized":"2023-10-03T19:12:28.951827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:16:13.727679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:26.526882+0000","last_change":"2023-10-03T19:12:26.526882+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.526882+0000","last_undegraded":"2023-10-03T19:12:26.526882+0000","last_fullsized":"2023-10-03T19:12:26.526882+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T19:12:26.559661+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:12:26.559661+0000","last_peered":"2023-10-03T19:12:26.559661+0000","last_clean":"2023-10-03T19:12:26.559661+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:12:26.559661+0000","last_undegraded":"2023-10-03T19:12:26.559661+0000","last_fullsized":"2023-10-03T19:12:26.559661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:38:36.929803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.947801+0000","last_change":"2023-10-03T19:12:27.594044+0000","last_active":"2023-10-03T19:12:27.947801+0000","last_peered":"2023-10-03T19:12:27.947801+0000","last_clean":"2023-10-03T19:12:27.947801+0000","last_became_active":"2023-10-03T19:12:27.593678+0000","last_became_peered":"2023-10-03T19:12:27.593678+0000","last_unstale":"2023-10-03T19:12:27.947801+0000","last_undegraded":"2023-10-03T19:12:27.947801+0000","last_fullsized":"2023-10-03T19:12:27.947801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:27:39.006980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.976154+0000","last_change":"2023-10-03T19:12:27.969842+0000","last_active":"2023-10-03T19:12:27.976154+0000","last_peered":"2023-10-03T19:12:27.976154+0000","last_clean":"2023-10-03T19:12:27.976154+0000","last_became_active":"2023-10-03T19:12:27.966611+0000","last_became_peered":"2023-10-03T19:12:27.966611+0000","last_unstale":"2023-10-03T19:12:27.976154+0000","last_undegraded":"2023-10-03T19:12:27.976154+0000","last_fullsized":"2023-10-03T19:12:27.976154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:26:05.803303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T19:12:26.551864+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:12:26.551864+0000","last_peered":"2023-10-03T19:12:26.551864+0000","last_clean":"2023-10-03T19:12:26.551864+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:12:26.551864+0000","last_undegraded":"2023-10-03T19:12:26.551864+0000","last_fullsized":"2023-10-03T19:12:26.551864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:21:31.434022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-03T19:12:26.549149+0000","last_change":"2023-10-03T19:12:26.549149+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.549149+0000","last_undegraded":"2023-10-03T19:12:26.549149+0000","last_fullsized":"2023-10-03T19:12:26.549149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953153+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:12:28.953153+0000","last_peered":"2023-10-03T19:12:28.953153+0000","last_clean":"2023-10-03T19:12:28.953153+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:12:28.953153+0000","last_undegraded":"2023-10-03T19:12:28.953153+0000","last_fullsized":"2023-10-03T19:12:28.953153+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:50:46.706999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-03T19:12:26.546372+0000","last_change":"2023-10-03T19:12:26.546372+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.546372+0000","last_undegraded":"2023-10-03T19:12:26.546372+0000","last_fullsized":"2023-10-03T19:12:26.546372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952764+0000","last_change":"2023-10-03T19:12:27.595105+0000","last_active":"2023-10-03T19:12:28.952764+0000","last_peered":"2023-10-03T19:12:28.952764+0000","last_clean":"2023-10-03T19:12:28.952764+0000","last_became_active":"2023-10-03T19:12:27.594748+0000","last_became_peered":"2023-10-03T19:12:27.594748+0000","last_unstale":"2023-10-03T19:12:28.952764+0000","last_undegraded":"2023-10-03T19:12:28.952764+0000","last_fullsized":"2023-10-03T19:12:28.952764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:43:24.586460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T19:12:26.550224+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:12:26.550224+0000","last_peered":"2023-10-03T19:12:26.550224+0000","last_clean":"2023-10-03T19:12:26.550224+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:12:26.550224+0000","last_undegraded":"2023-10-03T19:12:26.550224+0000","last_fullsized":"2023-10-03T19:12:26.550224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:08:35.341715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-03T19:12:26.549152+0000","last_change":"2023-10-03T19:12:26.549152+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.549152+0000","last_undegraded":"2023-10-03T19:12:26.549152+0000","last_fullsized":"2023-10-03T19:12:26.549152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T19:12:26.563538+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:12:26.563538+0000","last_peered":"2023-10-03T19:12:26.563538+0000","last_clean":"2023-10-03T19:12:26.563538+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:12:26.563538+0000","last_undegraded":"2023-10-03T19:12:26.563538+0000","last_fullsized":"2023-10-03T19:12:26.563538+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:01:04.324866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.974615+0000","last_change":"2023-10-03T19:12:27.964905+0000","last_active":"2023-10-03T19:12:27.974615+0000","last_peered":"2023-10-03T19:12:27.974615+0000","last_clean":"2023-10-03T19:12:27.974615+0000","last_became_active":"2023-10-03T19:12:27.964614+0000","last_became_peered":"2023-10-03T19:12:27.964614+0000","last_unstale":"2023-10-03T19:12:27.974615+0000","last_undegraded":"2023-10-03T19:12:27.974615+0000","last_fullsized":"2023-10-03T19:12:27.974615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:12:10.609586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:26.526882+0000","last_change":"2023-10-03T19:12:26.526882+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.526882+0000","last_undegraded":"2023-10-03T19:12:26.526882+0000","last_fullsized":"2023-10-03T19:12:26.526882+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T19:12:26.550629+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:12:26.550629+0000","last_peered":"2023-10-03T19:12:26.550629+0000","last_clean":"2023-10-03T19:12:26.550629+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:12:26.550629+0000","last_undegraded":"2023-10-03T19:12:26.550629+0000","last_fullsized":"2023-10-03T19:12:26.550629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:56:45.930229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.949197+0000","last_change":"2023-10-03T19:12:27.583954+0000","last_active":"2023-10-03T19:12:27.949197+0000","last_peered":"2023-10-03T19:12:27.949197+0000","last_clean":"2023-10-03T19:12:27.949197+0000","last_became_active":"2023-10-03T19:12:27.583313+0000","last_became_peered":"2023-10-03T19:12:27.583313+0000","last_unstale":"2023-10-03T19:12:27.949197+0000","last_undegraded":"2023-10-03T19:12:27.949197+0000","last_fullsized":"2023-10-03T19:12:27.949197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:25:10.249460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T19:12:26.562524+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:12:26.562524+0000","last_peered":"2023-10-03T19:12:26.562524+0000","last_clean":"2023-10-03T19:12:26.562524+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:12:26.562524+0000","last_undegraded":"2023-10-03T19:12:26.562524+0000","last_fullsized":"2023-10-03T19:12:26.562524+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:56:45.930229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-03T19:12:26.546897+0000","last_change":"2023-10-03T19:12:26.546897+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.546897+0000","last_undegraded":"2023-10-03T19:12:26.546897+0000","last_fullsized":"2023-10-03T19:12:26.546897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-03T19:12:26.558692+0000","last_change":"2023-10-03T19:12:26.558692+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.558692+0000","last_undegraded":"2023-10-03T19:12:26.558692+0000","last_fullsized":"2023-10-03T19:12:26.558692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952982+0000","last_change":"2023-10-03T19:12:27.585305+0000","last_active":"2023-10-03T19:12:28.952982+0000","last_peered":"2023-10-03T19:12:28.952982+0000","last_clean":"2023-10-03T19:12:28.952982+0000","last_became_active":"2023-10-03T19:12:27.584635+0000","last_became_peered":"2023-10-03T19:12:27.584635+0000","last_unstale":"2023-10-03T19:12:28.952982+0000","last_undegraded":"2023-10-03T19:12:28.952982+0000","last_fullsized":"2023-10-03T19:12:28.952982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:37:44.604456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.952762+0000","last_change":"2023-10-03T19:12:27.592047+0000","last_active":"2023-10-03T19:12:27.952762+0000","last_peered":"2023-10-03T19:12:27.952762+0000","last_clean":"2023-10-03T19:12:27.952762+0000","last_became_active":"2023-10-03T19:12:27.591625+0000","last_became_peered":"2023-10-03T19:12:27.591625+0000","last_unstale":"2023-10-03T19:12:27.952762+0000","last_undegraded":"2023-10-03T19:12:27.952762+0000","last_fullsized":"2023-10-03T19:12:27.952762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:10:01.648289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:26.526882+0000","last_change":"2023-10-03T19:12:26.526882+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.526882+0000","last_undegraded":"2023-10-03T19:12:26.526882+0000","last_fullsized":"2023-10-03T19:12:26.526882+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.979286+0000","last_change":"2023-10-03T19:12:27.978101+0000","last_active":"2023-10-03T19:12:27.979286+0000","last_peered":"2023-10-03T19:12:27.979286+0000","last_clean":"2023-10-03T19:12:27.979286+0000","last_became_active":"2023-10-03T19:12:27.977700+0000","last_became_peered":"2023-10-03T19:12:27.977700+0000","last_unstale":"2023-10-03T19:12:27.979286+0000","last_undegraded":"2023-10-03T19:12:27.979286+0000","last_fullsized":"2023-10-03T19:12:27.979286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:01:03.468673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-03T19:12:26.549069+0000","last_change":"2023-10-03T19:12:26.549069+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.549069+0000","last_undegraded":"2023-10-03T19:12:26.549069+0000","last_fullsized":"2023-10-03T19:12:26.549069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-03T19:12:26.547509+0000","last_change":"2023-10-03T19:12:26.547509+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.547509+0000","last_undegraded":"2023-10-03T19:12:26.547509+0000","last_fullsized":"2023-10-03T19:12:26.547509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.979861+0000","last_change":"2023-10-03T19:12:27.593678+0000","last_active":"2023-10-03T19:12:27.979861+0000","last_peered":"2023-10-03T19:12:27.979861+0000","last_clean":"2023-10-03T19:12:27.979861+0000","last_became_active":"2023-10-03T19:12:27.593376+0000","last_became_peered":"2023-10-03T19:12:27.593376+0000","last_unstale":"2023-10-03T19:12:27.979861+0000","last_undegraded":"2023-10-03T19:12:27.979861+0000","last_fullsized":"2023-10-03T19:12:27.979861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:44:45.554309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952027+0000","last_change":"2023-10-03T19:12:27.588675+0000","last_active":"2023-10-03T19:12:28.952027+0000","last_peered":"2023-10-03T19:12:28.952027+0000","last_clean":"2023-10-03T19:12:28.952027+0000","last_became_active":"2023-10-03T19:12:27.588046+0000","last_became_peered":"2023-10-03T19:12:27.588046+0000","last_unstale":"2023-10-03T19:12:28.952027+0000","last_undegraded":"2023-10-03T19:12:28.952027+0000","last_fullsized":"2023-10-03T19:12:28.952027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:08:47.585355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952596+0000","last_change":"2023-10-03T19:12:27.587343+0000","last_active":"2023-10-03T19:12:28.952596+0000","last_peered":"2023-10-03T19:12:28.952596+0000","last_clean":"2023-10-03T19:12:28.952596+0000","last_became_active":"2023-10-03T19:12:27.586953+0000","last_became_peered":"2023-10-03T19:12:27.586953+0000","last_unstale":"2023-10-03T19:12:28.952596+0000","last_undegraded":"2023-10-03T19:12:28.952596+0000","last_fullsized":"2023-10-03T19:12:28.952596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:01:57.712265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:26.526882+0000","last_change":"2023-10-03T19:12:26.526882+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.526882+0000","last_undegraded":"2023-10-03T19:12:26.526882+0000","last_fullsized":"2023-10-03T19:12:26.526882+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.976701+0000","last_change":"2023-10-03T19:12:27.591787+0000","last_active":"2023-10-03T19:12:27.976701+0000","last_peered":"2023-10-03T19:12:27.976701+0000","last_clean":"2023-10-03T19:12:27.976701+0000","last_became_active":"2023-10-03T19:12:27.591472+0000","last_became_peered":"2023-10-03T19:12:27.591472+0000","last_unstale":"2023-10-03T19:12:27.976701+0000","last_undegraded":"2023-10-03T19:12:27.976701+0000","last_fullsized":"2023-10-03T19:12:27.976701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:35:42.979095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":2},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":52,"acting":52,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509443,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8700,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94363140,"statfs":{"total":96636764160,"available":96627855360,"internally_reserved":0,"allocated":237568,"data_stored":645367,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3320000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5149999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5449999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509443,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8172,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363668,"statfs":{"total":96636764160,"available":96628396032,"internally_reserved":0,"allocated":167936,"data_stored":53835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8176,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363664,"statfs":{"total":96636764160,"available":96628391936,"internally_reserved":0,"allocated":172032,"data_stored":54999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12268,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":12096,"kb_avail":94359572,"statfs":{"total":96636764160,"available":96624201728,"internally_reserved":0,"allocated":167936,"data_stored":53835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12386304},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4890000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509443,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8176,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363664,"statfs":{"total":96636764160,"available":96628391936,"internally_reserved":0,"allocated":172032,"data_stored":54999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542147,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8176,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363664,"statfs":{"total":96636764160,"available":96628391936,"internally_reserved":0,"allocated":172032,"data_stored":54999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8360,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363480,"statfs":{"total":96636764160,"available":96628203520,"internally_reserved":0,"allocated":229376,"data_stored":82222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13012,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":12736,"kb_avail":94358828,"statfs":{"total":96636764160,"available":96623439872,"internally_reserved":0,"allocated":274432,"data_stored":664703,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":13041664},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4410000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:12:32.035 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:12:32.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.177+0000 7fb5c7d29640 1 Processor -- start 2023-10-03T19:12:32.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.177+0000 7fb5c7d29640 1 -- start start 2023-10-03T19:12:32.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.181+0000 7fb5c7d29640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb5c00b98f0 0x7fb5c00b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:32.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.181+0000 7fb5c7d29640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb5c00a2e20 0x7fb5c006c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:32.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.181+0000 7fb5c7d29640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c00ba550 con 0x7fb5c00bc810 2023-10-03T19:12:32.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.181+0000 7fb5c7d29640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c01526d0 con 0x7fb5c00a2e20 2023-10-03T19:12:32.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.181+0000 7fb5c7d29640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c01529b0 con 0x7fb5c00b98f0 2023-10-03T19:12:32.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.181+0000 7fb5c5ac5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb5c00b98f0 0x7fb5c00b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:32.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.181+0000 7fb5c52c4640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb5c00bc810 0x7fb5c006c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:42700/0 (socket says 172.21.15.45:42700) 2023-10-03T19:12:32.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.181+0000 7fb5c52c4640 1 -- 172.21.15.45:0/3319762890 learned_addr learned my addr 172.21.15.45:0/3319762890 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:32.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.181+0000 7fb5c62c6640 1 --2- 172.21.15.45:0/3319762890 >> v2:172.21.15.79:3300/0 conn(0x7fb5c00a2e20 0x7fb5c006c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:32.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.181+0000 7fb5c4ac3640 1 -- 172.21.15.45:0/3319762890 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2462413549 0 0) 0x7fb5c00ba550 con 0x7fb5c00bc810 2023-10-03T19:12:32.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.181+0000 7fb5c4ac3640 1 -- 172.21.15.45:0/3319762890 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5ac003530 con 0x7fb5c00bc810 2023-10-03T19:12:32.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.181+0000 7fb5c5ac5640 1 -- 172.21.15.45:0/3319762890 >> v2:172.21.15.79:3300/0 conn(0x7fb5c00a2e20 msgr2=0x7fb5c006c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:32.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.181+0000 7fb5c5ac5640 1 --2- 172.21.15.45:0/3319762890 >> v2:172.21.15.79:3300/0 conn(0x7fb5c00a2e20 0x7fb5c006c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.181+0000 7fb5c5ac5640 1 -- 172.21.15.45:0/3319762890 >> v1:172.21.15.79:6789/0 conn(0x7fb5c00bc810 legacy=0x7fb5c006c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:32.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.181+0000 7fb5c5ac5640 1 -- 172.21.15.45:0/3319762890 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c006cee0 con 0x7fb5c00b98f0 2023-10-03T19:12:32.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c5ac5640 1 --2- 172.21.15.45:0/3319762890 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb5c00b98f0 0x7fb5c00b9cc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc0097c0 tx=0x7fb5bc01ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb8aeaa3ec3d20ae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:32.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c4ac3640 1 -- 172.21.15.45:0/3319762890 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc0a8970 con 0x7fb5c00b98f0 2023-10-03T19:12:32.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c4ac3640 1 -- 172.21.15.45:0/3319762890 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5bc0a8ad0 con 0x7fb5c00b98f0 2023-10-03T19:12:32.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c4ac3640 1 -- 172.21.15.45:0/3319762890 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc0a8e40 con 0x7fb5c00b98f0 2023-10-03T19:12:32.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c7d29640 1 -- 172.21.15.45:0/3319762890 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb5c00b98f0 msgr2=0x7fb5c00b9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:32.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c7d29640 1 --2- 172.21.15.45:0/3319762890 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb5c00b98f0 0x7fb5c00b9cc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc0097c0 tx=0x7fb5bc01ec70 comp rx=0 tx=0).stop 2023-10-03T19:12:32.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c7d29640 1 -- 172.21.15.45:0/3319762890 shutdown_connections 2023-10-03T19:12:32.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c7d29640 1 --2- 172.21.15.45:0/3319762890 >> v2:172.21.15.79:3300/0 conn(0x7fb5c00a2e20 0x7fb5c006c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c7d29640 1 --2- 172.21.15.45:0/3319762890 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb5c00b98f0 0x7fb5c00b9cc0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c7d29640 1 -- 172.21.15.45:0/3319762890 >> 172.21.15.45:0/3319762890 conn(0x7fb5c00bcf50 msgr2=0x7fb5c00bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:32.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c7d29640 1 -- 172.21.15.45:0/3319762890 shutdown_connections 2023-10-03T19:12:32.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c7d29640 1 -- 172.21.15.45:0/3319762890 wait complete. 2023-10-03T19:12:32.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c7d29640 1 Processor -- start 2023-10-03T19:12:32.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c7d29640 1 -- start start 2023-10-03T19:12:32.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c7d29640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5c00a2e20 0x7fb5c00becc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:32.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c7d29640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb5c00b98f0 0x7fb5c0070de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:32.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c7d29640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5c00bc810 0x7fb5c014afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:32.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c7d29640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c00be8a0 con 0x7fb5c00a2e20 2023-10-03T19:12:32.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c7d29640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c014b510 con 0x7fb5c00bc810 2023-10-03T19:12:32.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c7d29640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c00be1e0 con 0x7fb5c00b98f0 2023-10-03T19:12:32.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c5ac5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5c00a2e20 0x7fb5c00becc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:32.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c5ac5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5c00a2e20 0x7fb5c00becc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46620/0 (socket says 172.21.15.45:46620) 2023-10-03T19:12:32.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c5ac5640 1 -- 172.21.15.45:0/1665340978 learned_addr learned my addr 172.21.15.45:0/1665340978 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:32.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c62c6640 1 --2- 172.21.15.45:0/1665340978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5c00bc810 0x7fb5c014afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:32.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c52c4640 1 --2- 172.21.15.45:0/1665340978 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb5c00b98f0 0x7fb5c0070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:32.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c5ac5640 1 -- 172.21.15.45:0/1665340978 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb5c00b98f0 msgr2=0x7fb5c0070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:32.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c5ac5640 1 --2- 172.21.15.45:0/1665340978 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb5c00b98f0 0x7fb5c0070de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c5ac5640 1 -- 172.21.15.45:0/1665340978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5c00bc810 msgr2=0x7fb5c014afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:32.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c5ac5640 1 --2- 172.21.15.45:0/1665340978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5c00bc810 0x7fb5c014afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c5ac5640 1 -- 172.21.15.45:0/1665340978 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5bc009420 con 0x7fb5c00a2e20 2023-10-03T19:12:32.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c5ac5640 1 --2- 172.21.15.45:0/1665340978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5c00a2e20 0x7fb5c00becc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc000c10 tx=0x7fb5bc01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:32.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5b67fc640 1 -- 172.21.15.45:0/1665340978 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc004450 con 0x7fb5c00a2e20 2023-10-03T19:12:32.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5b67fc640 1 -- 172.21.15.45:0/1665340978 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5bc003620 con 0x7fb5c00a2e20 2023-10-03T19:12:32.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5c7d29640 1 -- 172.21.15.45:0/1665340978 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c00ba950 con 0x7fb5c00a2e20 2023-10-03T19:12:32.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.185+0000 7fb5b67fc640 1 -- 172.21.15.45:0/1665340978 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc003990 con 0x7fb5c00a2e20 2023-10-03T19:12:32.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.189+0000 7fb5c7d29640 1 -- 172.21.15.45:0/1665340978 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c00ba200 con 0x7fb5c00a2e20 2023-10-03T19:12:32.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.189+0000 7fb5c7d29640 1 -- 172.21.15.45:0/1665340978 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c00baae0 con 0x7fb5c00a2e20 2023-10-03T19:12:32.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.189+0000 7fb5b67fc640 1 -- 172.21.15.45:0/1665340978 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb5bc0b7040 con 0x7fb5c00a2e20 2023-10-03T19:12:32.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.189+0000 7fb5b67fc640 1 --2- 172.21.15.45:0/1665340978 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb5a40662b0 0x7fb5a4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:32.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.189+0000 7fb5b67fc640 1 -- 172.21.15.45:0/1665340978 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb5bc1214a0 con 0x7fb5c00a2e20 2023-10-03T19:12:32.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.189+0000 7fb5c52c4640 1 --2- 172.21.15.45:0/1665340978 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb5a40662b0 0x7fb5a4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:32.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.189+0000 7fb5c52c4640 1 --2- 172.21.15.45:0/1665340978 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb5a40662b0 0x7fb5a4068760 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb5c014b8f0 tx=0x7fb5b0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:32.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.193+0000 7fb5b67fc640 1 -- 172.21.15.45:0/1665340978 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb5bc0ee9b0 con 0x7fb5c00a2e20 2023-10-03T19:12:32.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.345+0000 7fb5c7d29640 1 -- 172.21.15.45:0/1665340978 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb5c00be350 con 0x7fb5a40662b0 2023-10-03T19:12:32.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.365+0000 7fb5b67fc640 1 -- 172.21.15.45:0/1665340978 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277453 (secure 0 0 0) 0x7fb5c00be350 con 0x7fb5a40662b0 2023-10-03T19:12:32.370 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:32.372 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:12:32.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.369+0000 7fb5c7d29640 1 -- 172.21.15.45:0/1665340978 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb5a40662b0 msgr2=0x7fb5a4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:32.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.369+0000 7fb5c7d29640 1 --2- 172.21.15.45:0/1665340978 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb5a40662b0 0x7fb5a4068760 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb5c014b8f0 tx=0x7fb5b0009040 comp rx=0 tx=0).stop 2023-10-03T19:12:32.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.369+0000 7fb5c7d29640 1 -- 172.21.15.45:0/1665340978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5c00a2e20 msgr2=0x7fb5c00becc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:32.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.369+0000 7fb5c7d29640 1 --2- 172.21.15.45:0/1665340978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5c00a2e20 0x7fb5c00becc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc000c10 tx=0x7fb5bc01ba10 comp rx=0 tx=0).stop 2023-10-03T19:12:32.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.369+0000 7fb5c7d29640 1 -- 172.21.15.45:0/1665340978 shutdown_connections 2023-10-03T19:12:32.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.369+0000 7fb5c7d29640 1 --2- 172.21.15.45:0/1665340978 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb5a40662b0 0x7fb5a4068760 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.369+0000 7fb5c7d29640 1 --2- 172.21.15.45:0/1665340978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5c00bc810 0x7fb5c014afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.369+0000 7fb5c7d29640 1 --2- 172.21.15.45:0/1665340978 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb5c00b98f0 0x7fb5c0070de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.369+0000 7fb5c7d29640 1 --2- 172.21.15.45:0/1665340978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5c00a2e20 0x7fb5c00becc0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.369+0000 7fb5c7d29640 1 -- 172.21.15.45:0/1665340978 >> 172.21.15.45:0/1665340978 conn(0x7fb5c00bcf50 msgr2=0x7fb5c0144450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:32.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.369+0000 7fb5c7d29640 1 -- 172.21.15.45:0/1665340978 shutdown_connections 2023-10-03T19:12:32.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.369+0000 7fb5c7d29640 1 -- 172.21.15.45:0/1665340978 wait complete. 2023-10-03T19:12:32.388 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-03T19:12:30.439821+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":169,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":102,"acting":102,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":75040,"kb_used_data":1556,"kb_used_omap":0,"kb_used_meta":73408,"kb_avail":754899680,"statfs":{"total":773094113280,"available":773017272320,"internally_reserved":0,"allocated":1593344,"data_stored":1664959,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":75169792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.894372"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954200+0000","last_change":"2023-10-03T19:12:27.970081+0000","last_active":"2023-10-03T19:12:28.954200+0000","last_peered":"2023-10-03T19:12:28.954200+0000","last_clean":"2023-10-03T19:12:28.954200+0000","last_became_active":"2023-10-03T19:12:27.969751+0000","last_became_peered":"2023-10-03T19:12:27.969751+0000","last_unstale":"2023-10-03T19:12:28.954200+0000","last_undegraded":"2023-10-03T19:12:28.954200+0000","last_fullsized":"2023-10-03T19:12:28.954200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:51:23.880877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.974769+0000","last_change":"2023-10-03T19:12:27.966859+0000","last_active":"2023-10-03T19:12:27.974769+0000","last_peered":"2023-10-03T19:12:27.974769+0000","last_clean":"2023-10-03T19:12:27.974769+0000","last_became_active":"2023-10-03T19:12:27.966145+0000","last_became_peered":"2023-10-03T19:12:27.966145+0000","last_unstale":"2023-10-03T19:12:27.974769+0000","last_undegraded":"2023-10-03T19:12:27.974769+0000","last_fullsized":"2023-10-03T19:12:27.974769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:22:31.716735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.951743+0000","last_change":"2023-10-03T19:12:27.959887+0000","last_active":"2023-10-03T19:12:28.951743+0000","last_peered":"2023-10-03T19:12:28.951743+0000","last_clean":"2023-10-03T19:12:28.951743+0000","last_became_active":"2023-10-03T19:12:27.959538+0000","last_became_peered":"2023-10-03T19:12:27.959538+0000","last_unstale":"2023-10-03T19:12:28.951743+0000","last_undegraded":"2023-10-03T19:12:28.951743+0000","last_fullsized":"2023-10-03T19:12:28.951743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:57:42.821868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.976471+0000","last_change":"2023-10-03T19:12:27.970249+0000","last_active":"2023-10-03T19:12:27.976471+0000","last_peered":"2023-10-03T19:12:27.976471+0000","last_clean":"2023-10-03T19:12:27.976471+0000","last_became_active":"2023-10-03T19:12:27.969995+0000","last_became_peered":"2023-10-03T19:12:27.969995+0000","last_unstale":"2023-10-03T19:12:27.976471+0000","last_undegraded":"2023-10-03T19:12:27.976471+0000","last_fullsized":"2023-10-03T19:12:27.976471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:23:25.342990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952651+0000","last_change":"2023-10-03T19:12:27.964836+0000","last_active":"2023-10-03T19:12:28.952651+0000","last_peered":"2023-10-03T19:12:28.952651+0000","last_clean":"2023-10-03T19:12:28.952651+0000","last_became_active":"2023-10-03T19:12:27.964025+0000","last_became_peered":"2023-10-03T19:12:27.964025+0000","last_unstale":"2023-10-03T19:12:28.952651+0000","last_undegraded":"2023-10-03T19:12:28.952651+0000","last_fullsized":"2023-10-03T19:12:28.952651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:22:33.134502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952943+0000","last_change":"2023-10-03T19:12:27.970387+0000","last_active":"2023-10-03T19:12:28.952943+0000","last_peered":"2023-10-03T19:12:28.952943+0000","last_clean":"2023-10-03T19:12:28.952943+0000","last_became_active":"2023-10-03T19:12:27.969970+0000","last_became_peered":"2023-10-03T19:12:27.969970+0000","last_unstale":"2023-10-03T19:12:28.952943+0000","last_undegraded":"2023-10-03T19:12:28.952943+0000","last_fullsized":"2023-10-03T19:12:28.952943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:57:10.455144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.974830+0000","last_change":"2023-10-03T19:12:27.968081+0000","last_active":"2023-10-03T19:12:27.974830+0000","last_peered":"2023-10-03T19:12:27.974830+0000","last_clean":"2023-10-03T19:12:27.974830+0000","last_became_active":"2023-10-03T19:12:27.967067+0000","last_became_peered":"2023-10-03T19:12:27.967067+0000","last_unstale":"2023-10-03T19:12:27.974830+0000","last_undegraded":"2023-10-03T19:12:27.974830+0000","last_fullsized":"2023-10-03T19:12:27.974830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:26:21.421555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.974568+0000","last_change":"2023-10-03T19:12:27.966759+0000","last_active":"2023-10-03T19:12:27.974568+0000","last_peered":"2023-10-03T19:12:27.974568+0000","last_clean":"2023-10-03T19:12:27.974568+0000","last_became_active":"2023-10-03T19:12:27.966395+0000","last_became_peered":"2023-10-03T19:12:27.966395+0000","last_unstale":"2023-10-03T19:12:27.974568+0000","last_undegraded":"2023-10-03T19:12:27.974568+0000","last_fullsized":"2023-10-03T19:12:27.974568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:44:35.789330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952353+0000","last_change":"2023-10-03T19:12:27.978614+0000","last_active":"2023-10-03T19:12:28.952353+0000","last_peered":"2023-10-03T19:12:28.952353+0000","last_clean":"2023-10-03T19:12:28.952353+0000","last_became_active":"2023-10-03T19:12:27.978222+0000","last_became_peered":"2023-10-03T19:12:27.978222+0000","last_unstale":"2023-10-03T19:12:28.952353+0000","last_undegraded":"2023-10-03T19:12:28.952353+0000","last_fullsized":"2023-10-03T19:12:28.952353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:47:33.343155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-03T19:12:26.557010+0000","last_change":"2023-10-03T19:12:26.557010+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.557010+0000","last_undegraded":"2023-10-03T19:12:26.557010+0000","last_fullsized":"2023-10-03T19:12:26.557010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953302+0000","last_change":"2023-10-03T19:12:27.984997+0000","last_active":"2023-10-03T19:12:28.953302+0000","last_peered":"2023-10-03T19:12:28.953302+0000","last_clean":"2023-10-03T19:12:28.953302+0000","last_became_active":"2023-10-03T19:12:27.984682+0000","last_became_peered":"2023-10-03T19:12:27.984682+0000","last_unstale":"2023-10-03T19:12:28.953302+0000","last_undegraded":"2023-10-03T19:12:28.953302+0000","last_fullsized":"2023-10-03T19:12:28.953302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:29:18.707428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.948688+0000","last_change":"2023-10-03T19:12:27.589809+0000","last_active":"2023-10-03T19:12:27.948688+0000","last_peered":"2023-10-03T19:12:27.948688+0000","last_clean":"2023-10-03T19:12:27.948688+0000","last_became_active":"2023-10-03T19:12:27.589415+0000","last_became_peered":"2023-10-03T19:12:27.589415+0000","last_unstale":"2023-10-03T19:12:27.948688+0000","last_undegraded":"2023-10-03T19:12:27.948688+0000","last_fullsized":"2023-10-03T19:12:27.948688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:32:27.170784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.974645+0000","last_change":"2023-10-03T19:12:27.966910+0000","last_active":"2023-10-03T19:12:27.974645+0000","last_peered":"2023-10-03T19:12:27.974645+0000","last_clean":"2023-10-03T19:12:27.974645+0000","last_became_active":"2023-10-03T19:12:27.966160+0000","last_became_peered":"2023-10-03T19:12:27.966160+0000","last_unstale":"2023-10-03T19:12:27.974645+0000","last_undegraded":"2023-10-03T19:12:27.974645+0000","last_fullsized":"2023-10-03T19:12:27.974645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:19:53.879346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-03T19:12:26.556110+0000","last_change":"2023-10-03T19:12:26.556110+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.556110+0000","last_undegraded":"2023-10-03T19:12:26.556110+0000","last_fullsized":"2023-10-03T19:12:26.556110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-03T19:12:26.561025+0000","last_change":"2023-10-03T19:12:26.561025+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.561025+0000","last_undegraded":"2023-10-03T19:12:26.561025+0000","last_fullsized":"2023-10-03T19:12:26.561025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-03T19:12:26.556023+0000","last_change":"2023-10-03T19:12:26.556023+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.556023+0000","last_undegraded":"2023-10-03T19:12:26.556023+0000","last_fullsized":"2023-10-03T19:12:26.556023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.951943+0000","last_change":"2023-10-03T19:12:27.978558+0000","last_active":"2023-10-03T19:12:28.951943+0000","last_peered":"2023-10-03T19:12:28.951943+0000","last_clean":"2023-10-03T19:12:28.951943+0000","last_became_active":"2023-10-03T19:12:27.978193+0000","last_became_peered":"2023-10-03T19:12:27.978193+0000","last_unstale":"2023-10-03T19:12:28.951943+0000","last_undegraded":"2023-10-03T19:12:28.951943+0000","last_fullsized":"2023-10-03T19:12:28.951943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:21:27.107002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-03T19:12:26.556852+0000","last_change":"2023-10-03T19:12:26.556852+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.556852+0000","last_undegraded":"2023-10-03T19:12:26.556852+0000","last_fullsized":"2023-10-03T19:12:26.556852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-03T19:12:26.556610+0000","last_change":"2023-10-03T19:12:26.556610+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.556610+0000","last_undegraded":"2023-10-03T19:12:26.556610+0000","last_fullsized":"2023-10-03T19:12:26.556610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952130+0000","last_change":"2023-10-03T19:12:27.594338+0000","last_active":"2023-10-03T19:12:28.952130+0000","last_peered":"2023-10-03T19:12:28.952130+0000","last_clean":"2023-10-03T19:12:28.952130+0000","last_became_active":"2023-10-03T19:12:27.593882+0000","last_became_peered":"2023-10-03T19:12:27.593882+0000","last_unstale":"2023-10-03T19:12:28.952130+0000","last_undegraded":"2023-10-03T19:12:28.952130+0000","last_fullsized":"2023-10-03T19:12:28.952130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:55:54.733983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.976214+0000","last_change":"2023-10-03T19:12:27.969749+0000","last_active":"2023-10-03T19:12:27.976214+0000","last_peered":"2023-10-03T19:12:27.976214+0000","last_clean":"2023-10-03T19:12:27.976214+0000","last_became_active":"2023-10-03T19:12:27.966817+0000","last_became_peered":"2023-10-03T19:12:27.966817+0000","last_unstale":"2023-10-03T19:12:27.976214+0000","last_undegraded":"2023-10-03T19:12:27.976214+0000","last_fullsized":"2023-10-03T19:12:27.976214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:38:08.924887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:26.526882+0000","last_change":"2023-10-03T19:12:26.526882+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.526882+0000","last_undegraded":"2023-10-03T19:12:26.526882+0000","last_fullsized":"2023-10-03T19:12:26.526882+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-03T19:12:26.561190+0000","last_change":"2023-10-03T19:12:26.561190+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.561190+0000","last_undegraded":"2023-10-03T19:12:26.561190+0000","last_fullsized":"2023-10-03T19:12:26.561190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-03T19:12:26.548822+0000","last_change":"2023-10-03T19:12:26.548822+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.548822+0000","last_undegraded":"2023-10-03T19:12:26.548822+0000","last_fullsized":"2023-10-03T19:12:26.548822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:26.526882+0000","last_change":"2023-10-03T19:12:26.526882+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.526882+0000","last_undegraded":"2023-10-03T19:12:26.526882+0000","last_fullsized":"2023-10-03T19:12:26.526882+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T19:12:26.560078+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:12:26.560078+0000","last_peered":"2023-10-03T19:12:26.560078+0000","last_clean":"2023-10-03T19:12:26.560078+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:12:26.560078+0000","last_undegraded":"2023-10-03T19:12:26.560078+0000","last_fullsized":"2023-10-03T19:12:26.560078+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:47:33.755621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.951827+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:12:28.951827+0000","last_peered":"2023-10-03T19:12:28.951827+0000","last_clean":"2023-10-03T19:12:28.951827+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:12:28.951827+0000","last_undegraded":"2023-10-03T19:12:28.951827+0000","last_fullsized":"2023-10-03T19:12:28.951827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:16:13.727679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:26.526882+0000","last_change":"2023-10-03T19:12:26.526882+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.526882+0000","last_undegraded":"2023-10-03T19:12:26.526882+0000","last_fullsized":"2023-10-03T19:12:26.526882+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T19:12:26.559661+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:12:26.559661+0000","last_peered":"2023-10-03T19:12:26.559661+0000","last_clean":"2023-10-03T19:12:26.559661+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:12:26.559661+0000","last_undegraded":"2023-10-03T19:12:26.559661+0000","last_fullsized":"2023-10-03T19:12:26.559661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:38:36.929803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.947801+0000","last_change":"2023-10-03T19:12:27.594044+0000","last_active":"2023-10-03T19:12:27.947801+0000","last_peered":"2023-10-03T19:12:27.947801+0000","last_clean":"2023-10-03T19:12:27.947801+0000","last_became_active":"2023-10-03T19:12:27.593678+0000","last_became_peered":"2023-10-03T19:12:27.593678+0000","last_unstale":"2023-10-03T19:12:27.947801+0000","last_undegraded":"2023-10-03T19:12:27.947801+0000","last_fullsized":"2023-10-03T19:12:27.947801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:27:39.006980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.976154+0000","last_change":"2023-10-03T19:12:27.969842+0000","last_active":"2023-10-03T19:12:27.976154+0000","last_peered":"2023-10-03T19:12:27.976154+0000","last_clean":"2023-10-03T19:12:27.976154+0000","last_became_active":"2023-10-03T19:12:27.966611+0000","last_became_peered":"2023-10-03T19:12:27.966611+0000","last_unstale":"2023-10-03T19:12:27.976154+0000","last_undegraded":"2023-10-03T19:12:27.976154+0000","last_fullsized":"2023-10-03T19:12:27.976154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:26:05.803303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T19:12:26.551864+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:12:26.551864+0000","last_peered":"2023-10-03T19:12:26.551864+0000","last_clean":"2023-10-03T19:12:26.551864+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:12:26.551864+0000","last_undegraded":"2023-10-03T19:12:26.551864+0000","last_fullsized":"2023-10-03T19:12:26.551864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:21:31.434022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-03T19:12:26.549149+0000","last_change":"2023-10-03T19:12:26.549149+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.549149+0000","last_undegraded":"2023-10-03T19:12:26.549149+0000","last_fullsized":"2023-10-03T19:12:26.549149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953153+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:12:28.953153+0000","last_peered":"2023-10-03T19:12:28.953153+0000","last_clean":"2023-10-03T19:12:28.953153+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:12:28.953153+0000","last_undegraded":"2023-10-03T19:12:28.953153+0000","last_fullsized":"2023-10-03T19:12:28.953153+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:50:46.706999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-03T19:12:26.546372+0000","last_change":"2023-10-03T19:12:26.546372+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.546372+0000","last_undegraded":"2023-10-03T19:12:26.546372+0000","last_fullsized":"2023-10-03T19:12:26.546372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952764+0000","last_change":"2023-10-03T19:12:27.595105+0000","last_active":"2023-10-03T19:12:28.952764+0000","last_peered":"2023-10-03T19:12:28.952764+0000","last_clean":"2023-10-03T19:12:28.952764+0000","last_became_active":"2023-10-03T19:12:27.594748+0000","last_became_peered":"2023-10-03T19:12:27.594748+0000","last_unstale":"2023-10-03T19:12:28.952764+0000","last_undegraded":"2023-10-03T19:12:28.952764+0000","last_fullsized":"2023-10-03T19:12:28.952764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:43:24.586460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T19:12:26.550224+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:12:26.550224+0000","last_peered":"2023-10-03T19:12:26.550224+0000","last_clean":"2023-10-03T19:12:26.550224+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:12:26.550224+0000","last_undegraded":"2023-10-03T19:12:26.550224+0000","last_fullsized":"2023-10-03T19:12:26.550224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:08:35.341715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-03T19:12:26.549152+0000","last_change":"2023-10-03T19:12:26.549152+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.549152+0000","last_undegraded":"2023-10-03T19:12:26.549152+0000","last_fullsized":"2023-10-03T19:12:26.549152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T19:12:26.563538+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:12:26.563538+0000","last_peered":"2023-10-03T19:12:26.563538+0000","last_clean":"2023-10-03T19:12:26.563538+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:12:26.563538+0000","last_undegraded":"2023-10-03T19:12:26.563538+0000","last_fullsized":"2023-10-03T19:12:26.563538+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:01:04.324866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.974615+0000","last_change":"2023-10-03T19:12:27.964905+0000","last_active":"2023-10-03T19:12:27.974615+0000","last_peered":"2023-10-03T19:12:27.974615+0000","last_clean":"2023-10-03T19:12:27.974615+0000","last_became_active":"2023-10-03T19:12:27.964614+0000","last_became_peered":"2023-10-03T19:12:27.964614+0000","last_unstale":"2023-10-03T19:12:27.974615+0000","last_undegraded":"2023-10-03T19:12:27.974615+0000","last_fullsized":"2023-10-03T19:12:27.974615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:12:10.609586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:26.526882+0000","last_change":"2023-10-03T19:12:26.526882+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.526882+0000","last_undegraded":"2023-10-03T19:12:26.526882+0000","last_fullsized":"2023-10-03T19:12:26.526882+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T19:12:26.550629+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:12:26.550629+0000","last_peered":"2023-10-03T19:12:26.550629+0000","last_clean":"2023-10-03T19:12:26.550629+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:12:26.550629+0000","last_undegraded":"2023-10-03T19:12:26.550629+0000","last_fullsized":"2023-10-03T19:12:26.550629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:56:45.930229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.949197+0000","last_change":"2023-10-03T19:12:27.583954+0000","last_active":"2023-10-03T19:12:27.949197+0000","last_peered":"2023-10-03T19:12:27.949197+0000","last_clean":"2023-10-03T19:12:27.949197+0000","last_became_active":"2023-10-03T19:12:27.583313+0000","last_became_peered":"2023-10-03T19:12:27.583313+0000","last_unstale":"2023-10-03T19:12:27.949197+0000","last_undegraded":"2023-10-03T19:12:27.949197+0000","last_fullsized":"2023-10-03T19:12:27.949197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:25:10.249460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T19:12:26.562524+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:12:26.562524+0000","last_peered":"2023-10-03T19:12:26.562524+0000","last_clean":"2023-10-03T19:12:26.562524+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:12:26.562524+0000","last_undegraded":"2023-10-03T19:12:26.562524+0000","last_fullsized":"2023-10-03T19:12:26.562524+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:56:45.930229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-03T19:12:26.546897+0000","last_change":"2023-10-03T19:12:26.546897+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.546897+0000","last_undegraded":"2023-10-03T19:12:26.546897+0000","last_fullsized":"2023-10-03T19:12:26.546897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-03T19:12:26.558692+0000","last_change":"2023-10-03T19:12:26.558692+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.558692+0000","last_undegraded":"2023-10-03T19:12:26.558692+0000","last_fullsized":"2023-10-03T19:12:26.558692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952982+0000","last_change":"2023-10-03T19:12:27.585305+0000","last_active":"2023-10-03T19:12:28.952982+0000","last_peered":"2023-10-03T19:12:28.952982+0000","last_clean":"2023-10-03T19:12:28.952982+0000","last_became_active":"2023-10-03T19:12:27.584635+0000","last_became_peered":"2023-10-03T19:12:27.584635+0000","last_unstale":"2023-10-03T19:12:28.952982+0000","last_undegraded":"2023-10-03T19:12:28.952982+0000","last_fullsized":"2023-10-03T19:12:28.952982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:37:44.604456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.952762+0000","last_change":"2023-10-03T19:12:27.592047+0000","last_active":"2023-10-03T19:12:27.952762+0000","last_peered":"2023-10-03T19:12:27.952762+0000","last_clean":"2023-10-03T19:12:27.952762+0000","last_became_active":"2023-10-03T19:12:27.591625+0000","last_became_peered":"2023-10-03T19:12:27.591625+0000","last_unstale":"2023-10-03T19:12:27.952762+0000","last_undegraded":"2023-10-03T19:12:27.952762+0000","last_fullsized":"2023-10-03T19:12:27.952762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:10:01.648289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:26.526882+0000","last_change":"2023-10-03T19:12:26.526882+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.526882+0000","last_undegraded":"2023-10-03T19:12:26.526882+0000","last_fullsized":"2023-10-03T19:12:26.526882+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.979286+0000","last_change":"2023-10-03T19:12:27.978101+0000","last_active":"2023-10-03T19:12:27.979286+0000","last_peered":"2023-10-03T19:12:27.979286+0000","last_clean":"2023-10-03T19:12:27.979286+0000","last_became_active":"2023-10-03T19:12:27.977700+0000","last_became_peered":"2023-10-03T19:12:27.977700+0000","last_unstale":"2023-10-03T19:12:27.979286+0000","last_undegraded":"2023-10-03T19:12:27.979286+0000","last_fullsized":"2023-10-03T19:12:27.979286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:01:03.468673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-03T19:12:26.549069+0000","last_change":"2023-10-03T19:12:26.549069+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.549069+0000","last_undegraded":"2023-10-03T19:12:26.549069+0000","last_fullsized":"2023-10-03T19:12:26.549069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-03T19:12:26.547509+0000","last_change":"2023-10-03T19:12:26.547509+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.547509+0000","last_undegraded":"2023-10-03T19:12:26.547509+0000","last_fullsized":"2023-10-03T19:12:26.547509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.979861+0000","last_change":"2023-10-03T19:12:27.593678+0000","last_active":"2023-10-03T19:12:27.979861+0000","last_peered":"2023-10-03T19:12:27.979861+0000","last_clean":"2023-10-03T19:12:27.979861+0000","last_became_active":"2023-10-03T19:12:27.593376+0000","last_became_peered":"2023-10-03T19:12:27.593376+0000","last_unstale":"2023-10-03T19:12:27.979861+0000","last_undegraded":"2023-10-03T19:12:27.979861+0000","last_fullsized":"2023-10-03T19:12:27.979861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:44:45.554309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952027+0000","last_change":"2023-10-03T19:12:27.588675+0000","last_active":"2023-10-03T19:12:28.952027+0000","last_peered":"2023-10-03T19:12:28.952027+0000","last_clean":"2023-10-03T19:12:28.952027+0000","last_became_active":"2023-10-03T19:12:27.588046+0000","last_became_peered":"2023-10-03T19:12:27.588046+0000","last_unstale":"2023-10-03T19:12:28.952027+0000","last_undegraded":"2023-10-03T19:12:28.952027+0000","last_fullsized":"2023-10-03T19:12:28.952027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:08:47.585355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952596+0000","last_change":"2023-10-03T19:12:27.587343+0000","last_active":"2023-10-03T19:12:28.952596+0000","last_peered":"2023-10-03T19:12:28.952596+0000","last_clean":"2023-10-03T19:12:28.952596+0000","last_became_active":"2023-10-03T19:12:27.586953+0000","last_became_peered":"2023-10-03T19:12:27.586953+0000","last_unstale":"2023-10-03T19:12:28.952596+0000","last_undegraded":"2023-10-03T19:12:28.952596+0000","last_fullsized":"2023-10-03T19:12:28.952596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:01:57.712265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:26.526882+0000","last_change":"2023-10-03T19:12:26.526882+0000","last_active":"2023-10-03T19:12:26.526882+0000","last_peered":"2023-10-03T19:12:26.526882+0000","last_clean":"2023-10-03T19:12:26.526882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:26.526882+0000","last_undegraded":"2023-10-03T19:12:26.526882+0000","last_fullsized":"2023-10-03T19:12:26.526882+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:12:27.537046+0000","last_change":"2023-10-03T19:12:27.537046+0000","last_active":"2023-10-03T19:12:27.537046+0000","last_peered":"2023-10-03T19:12:27.537046+0000","last_clean":"2023-10-03T19:12:27.537046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:12:27.537046+0000","last_undegraded":"2023-10-03T19:12:27.537046+0000","last_fullsized":"2023-10-03T19:12:27.537046+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.976701+0000","last_change":"2023-10-03T19:12:27.591787+0000","last_active":"2023-10-03T19:12:27.976701+0000","last_peered":"2023-10-03T19:12:27.976701+0000","last_clean":"2023-10-03T19:12:27.976701+0000","last_became_active":"2023-10-03T19:12:27.591472+0000","last_became_peered":"2023-10-03T19:12:27.591472+0000","last_unstale":"2023-10-03T19:12:27.976701+0000","last_undegraded":"2023-10-03T19:12:27.976701+0000","last_fullsized":"2023-10-03T19:12:27.976701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:35:42.979095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":2},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":52,"acting":52,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509443,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8700,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94363140,"statfs":{"total":96636764160,"available":96627855360,"internally_reserved":0,"allocated":237568,"data_stored":645367,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3320000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5149999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5449999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509443,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8172,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363668,"statfs":{"total":96636764160,"available":96628396032,"internally_reserved":0,"allocated":167936,"data_stored":53835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8176,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363664,"statfs":{"total":96636764160,"available":96628391936,"internally_reserved":0,"allocated":172032,"data_stored":54999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12268,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":12096,"kb_avail":94359572,"statfs":{"total":96636764160,"available":96624201728,"internally_reserved":0,"allocated":167936,"data_stored":53835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12386304},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4890000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509443,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8176,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363664,"statfs":{"total":96636764160,"available":96628391936,"internally_reserved":0,"allocated":172032,"data_stored":54999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542147,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8176,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363664,"statfs":{"total":96636764160,"available":96628391936,"internally_reserved":0,"allocated":172032,"data_stored":54999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8360,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363480,"statfs":{"total":96636764160,"available":96628203520,"internally_reserved":0,"allocated":229376,"data_stored":82222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13012,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":12736,"kb_avail":94358828,"statfs":{"total":96636764160,"available":96623439872,"internally_reserved":0,"allocated":274432,"data_stored":664703,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":13041664},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4410000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:12:32.394 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:12:32.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.549+0000 7f527a1c8640 1 Processor -- start 2023-10-03T19:12:32.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.549+0000 7f527a1c8640 1 -- start start 2023-10-03T19:12:32.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.553+0000 7f527a1c8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f52740bff30 0x7f52740bc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:32.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.553+0000 7f527a1c8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f52740bcb20 0x7f52740bec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:32.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.553+0000 7f527a1c8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52740bc0b0 con 0x7f52740bd130 2023-10-03T19:12:32.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.553+0000 7f527a1c8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52740bf870 con 0x7f52740bcb20 2023-10-03T19:12:32.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.553+0000 7f527a1c8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52740bb740 con 0x7f52740bff30 2023-10-03T19:12:32.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.553+0000 7f5272ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f52740bcb20 0x7f52740bec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:32.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.553+0000 7f52737fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f52740bff30 0x7f52740bc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:32.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.553+0000 7f5272ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f52740bcb20 0x7f52740bec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:46466/0 (socket says 172.21.15.45:46466) 2023-10-03T19:12:32.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.553+0000 7f5273fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f52740bd130 0x7f52740bf160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:42706/0 (socket says 172.21.15.45:42706) 2023-10-03T19:12:32.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.553+0000 7f5272ffd640 1 -- 172.21.15.45:0/3866366697 learned_addr learned my addr 172.21.15.45:0/3866366697 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:32.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.553+0000 7f5272ffd640 1 -- 172.21.15.45:0/3866366697 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f52740bff30 msgr2=0x7f52740bc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:32.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.553+0000 7f5272ffd640 1 --2- 172.21.15.45:0/3866366697 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f52740bff30 0x7f52740bc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.553+0000 7f5272ffd640 1 -- 172.21.15.45:0/3866366697 >> v1:172.21.15.79:6789/0 conn(0x7f52740bd130 legacy=0x7f52740bf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:32.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.553+0000 7f5272ffd640 1 -- 172.21.15.45:0/3866366697 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52740bba20 con 0x7f52740bcb20 2023-10-03T19:12:32.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.553+0000 7f52737fe640 1 --2- 172.21.15.45:0/3866366697 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f52740bff30 0x7f52740bc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:12:32.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.553+0000 7f5272ffd640 1 --2- 172.21.15.45:0/3866366697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52740bcb20 0x7f52740bec20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5268009870 tx=0x7f526801c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb441439d80b4a3a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:32.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f52727fc640 1 -- 172.21.15.45:0/3866366697 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52680a95f0 con 0x7f52740bcb20 2023-10-03T19:12:32.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f52727fc640 1 -- 172.21.15.45:0/3866366697 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52680a9750 con 0x7f52740bcb20 2023-10-03T19:12:32.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f52727fc640 1 -- 172.21.15.45:0/3866366697 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52680a9ae0 con 0x7f52740bcb20 2023-10-03T19:12:32.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f527a1c8640 1 -- 172.21.15.45:0/3866366697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52740bcb20 msgr2=0x7f52740bec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:32.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f527a1c8640 1 --2- 172.21.15.45:0/3866366697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52740bcb20 0x7f52740bec20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5268009870 tx=0x7f526801c510 comp rx=0 tx=0).stop 2023-10-03T19:12:32.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f527a1c8640 1 -- 172.21.15.45:0/3866366697 shutdown_connections 2023-10-03T19:12:32.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f527a1c8640 1 --2- 172.21.15.45:0/3866366697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52740bcb20 0x7f52740bec20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f527a1c8640 1 --2- 172.21.15.45:0/3866366697 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f52740bff30 0x7f52740bc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f527a1c8640 1 -- 172.21.15.45:0/3866366697 >> 172.21.15.45:0/3866366697 conn(0x7f52740c0d20 msgr2=0x7f52740c1120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:32.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f527a1c8640 1 -- 172.21.15.45:0/3866366697 shutdown_connections 2023-10-03T19:12:32.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f527a1c8640 1 -- 172.21.15.45:0/3866366697 wait complete. 2023-10-03T19:12:32.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f527a1c8640 1 Processor -- start 2023-10-03T19:12:32.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f527a1c8640 1 -- start start 2023-10-03T19:12:32.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f527a1c8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f52740bcb20 0x7f52741471c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:32.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f527a1c8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52740bd130 0x7f52741e7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:32.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f527a1c8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52740bff30 0x7f527413ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:32.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f527a1c8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52741477c0 con 0x7f52740bd130 2023-10-03T19:12:32.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f527a1c8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527414b220 con 0x7f52740bff30 2023-10-03T19:12:32.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f527a1c8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f527413f990 con 0x7f52740bcb20 2023-10-03T19:12:32.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f5272ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52740bd130 0x7f52741e7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:32.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f5272ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52740bd130 0x7f52741e7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46622/0 (socket says 172.21.15.45:46622) 2023-10-03T19:12:32.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f5272ffd640 1 -- 172.21.15.45:0/1644948491 learned_addr learned my addr 172.21.15.45:0/1644948491 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:32.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f52737fe640 1 --2- 172.21.15.45:0/1644948491 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f52740bcb20 0x7f52741471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:32.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f5273fff640 1 --2- 172.21.15.45:0/1644948491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52740bff30 0x7f527413ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:32.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f5272ffd640 1 -- 172.21.15.45:0/1644948491 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f52740bcb20 msgr2=0x7f52741471c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:32.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f5272ffd640 1 --2- 172.21.15.45:0/1644948491 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f52740bcb20 0x7f52741471c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f5272ffd640 1 -- 172.21.15.45:0/1644948491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52740bff30 msgr2=0x7f527413ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:32.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f5272ffd640 1 --2- 172.21.15.45:0/1644948491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52740bff30 0x7f527413ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f5272ffd640 1 -- 172.21.15.45:0/1644948491 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5264009420 con 0x7f52740bd130 2023-10-03T19:12:32.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f5272ffd640 1 --2- 172.21.15.45:0/1644948491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52740bd130 0x7f52741e7ff0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f526801cdb0 tx=0x7f52680192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:32.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f525bfff640 1 -- 172.21.15.45:0/1644948491 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52680bc650 con 0x7f52740bd130 2023-10-03T19:12:32.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f525bfff640 1 -- 172.21.15.45:0/1644948491 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52680bc7b0 con 0x7f52740bd130 2023-10-03T19:12:32.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f527a1c8640 1 -- 172.21.15.45:0/1644948491 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52680094d0 con 0x7f52740bd130 2023-10-03T19:12:32.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f525bfff640 1 -- 172.21.15.45:0/1644948491 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52680bcb20 con 0x7f52740bd130 2023-10-03T19:12:32.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.557+0000 7f527a1c8640 1 -- 172.21.15.45:0/1644948491 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5274159580 con 0x7f52740bd130 2023-10-03T19:12:32.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.561+0000 7f527a1c8640 1 -- 172.21.15.45:0/1644948491 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5274159710 con 0x7f52740bd130 2023-10-03T19:12:32.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.561+0000 7f525bfff640 1 -- 172.21.15.45:0/1644948491 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f52680b13f0 con 0x7f52740bd130 2023-10-03T19:12:32.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.561+0000 7f525bfff640 1 --2- 172.21.15.45:0/1644948491 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5260066280 0x7f5260068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:32.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.561+0000 7f525bfff640 1 -- 172.21.15.45:0/1644948491 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f526811f020 con 0x7f52740bd130 2023-10-03T19:12:32.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.561+0000 7f52737fe640 1 --2- 172.21.15.45:0/1644948491 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5260066280 0x7f5260068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:32.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.561+0000 7f52737fe640 1 --2- 172.21.15.45:0/1644948491 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5260066280 0x7f5260068730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5264009cf0 tx=0x7f5264009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:32.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.565+0000 7f525bfff640 1 -- 172.21.15.45:0/1644948491 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f52680ec630 con 0x7f52740bd130 2023-10-03T19:12:32.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.709+0000 7f527a1c8640 1 -- 172.21.15.45:0/1644948491 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f527404de80 con 0x7f5260066280 2023-10-03T19:12:32.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.729+0000 7f525bfff640 1 -- 172.21.15.45:0/1644948491 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286713 (secure 0 0 0) 0x7f527404de80 con 0x7f5260066280 2023-10-03T19:12:32.735 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:32.737 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:12:32.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.733+0000 7f527a1c8640 1 -- 172.21.15.45:0/1644948491 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5260066280 msgr2=0x7f5260068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:32.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.733+0000 7f527a1c8640 1 --2- 172.21.15.45:0/1644948491 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5260066280 0x7f5260068730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5264009cf0 tx=0x7f5264009190 comp rx=0 tx=0).stop 2023-10-03T19:12:32.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.733+0000 7f527a1c8640 1 -- 172.21.15.45:0/1644948491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52740bd130 msgr2=0x7f52741e7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:32.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.733+0000 7f527a1c8640 1 --2- 172.21.15.45:0/1644948491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52740bd130 0x7f52741e7ff0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f526801cdb0 tx=0x7f52680192b0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.733+0000 7f527a1c8640 1 -- 172.21.15.45:0/1644948491 shutdown_connections 2023-10-03T19:12:32.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.733+0000 7f527a1c8640 1 --2- 172.21.15.45:0/1644948491 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5260066280 0x7f5260068730 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.733+0000 7f527a1c8640 1 --2- 172.21.15.45:0/1644948491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52740bff30 0x7f527413ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.733+0000 7f527a1c8640 1 --2- 172.21.15.45:0/1644948491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52740bd130 0x7f52741e7ff0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.733+0000 7f527a1c8640 1 --2- 172.21.15.45:0/1644948491 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f52740bcb20 0x7f52741471c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.733+0000 7f527a1c8640 1 -- 172.21.15.45:0/1644948491 >> 172.21.15.45:0/1644948491 conn(0x7f52740c0d20 msgr2=0x7f5274156570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:32.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.733+0000 7f527a1c8640 1 -- 172.21.15.45:0/1644948491 shutdown_connections 2023-10-03T19:12:32.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.733+0000 7f527a1c8640 1 -- 172.21.15.45:0/1644948491 wait complete. 2023-10-03T19:12:32.751 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-03T19:12:32.440580+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":76344,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":74432,"kb_avail":754898376,"statfs":{"total":773094113280,"available":773015937024,"internally_reserved":0,"allocated":1892352,"data_stored":1801263,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":76218368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":63,"apply_latency_ms":63,"commit_latency_ns":63000000,"apply_latency_ns":63000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.895131"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.947798+0000","last_change":"2023-10-03T19:12:27.968561+0000","last_active":"2023-10-03T19:12:28.947798+0000","last_peered":"2023-10-03T19:12:28.947798+0000","last_clean":"2023-10-03T19:12:28.947798+0000","last_became_active":"2023-10-03T19:12:27.968018+0000","last_became_peered":"2023-10-03T19:12:27.968018+0000","last_unstale":"2023-10-03T19:12:28.947798+0000","last_undegraded":"2023-10-03T19:12:28.947798+0000","last_fullsized":"2023-10-03T19:12:28.947798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:02:17.085349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954200+0000","last_change":"2023-10-03T19:12:27.970081+0000","last_active":"2023-10-03T19:12:28.954200+0000","last_peered":"2023-10-03T19:12:28.954200+0000","last_clean":"2023-10-03T19:12:28.954200+0000","last_became_active":"2023-10-03T19:12:27.969751+0000","last_became_peered":"2023-10-03T19:12:27.969751+0000","last_unstale":"2023-10-03T19:12:28.954200+0000","last_undegraded":"2023-10-03T19:12:28.954200+0000","last_fullsized":"2023-10-03T19:12:28.954200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:51:23.880877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953910+0000","last_change":"2023-10-03T19:12:27.962924+0000","last_active":"2023-10-03T19:12:28.953910+0000","last_peered":"2023-10-03T19:12:28.953910+0000","last_clean":"2023-10-03T19:12:28.953910+0000","last_became_active":"2023-10-03T19:12:27.962634+0000","last_became_peered":"2023-10-03T19:12:27.962634+0000","last_unstale":"2023-10-03T19:12:28.953910+0000","last_undegraded":"2023-10-03T19:12:28.953910+0000","last_fullsized":"2023-10-03T19:12:28.953910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:39:07.804995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937912+0000","last_change":"2023-10-03T19:12:27.972848+0000","last_active":"2023-10-03T19:12:31.937912+0000","last_peered":"2023-10-03T19:12:31.937912+0000","last_clean":"2023-10-03T19:12:31.937912+0000","last_became_active":"2023-10-03T19:12:27.972451+0000","last_became_peered":"2023-10-03T19:12:27.972451+0000","last_unstale":"2023-10-03T19:12:31.937912+0000","last_undegraded":"2023-10-03T19:12:31.937912+0000","last_fullsized":"2023-10-03T19:12:31.937912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:51:42.777690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.974769+0000","last_change":"2023-10-03T19:12:27.966859+0000","last_active":"2023-10-03T19:12:27.974769+0000","last_peered":"2023-10-03T19:12:27.974769+0000","last_clean":"2023-10-03T19:12:27.974769+0000","last_became_active":"2023-10-03T19:12:27.966145+0000","last_became_peered":"2023-10-03T19:12:27.966145+0000","last_unstale":"2023-10-03T19:12:27.974769+0000","last_undegraded":"2023-10-03T19:12:27.974769+0000","last_fullsized":"2023-10-03T19:12:27.974769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:22:31.716735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953307+0000","last_change":"2023-10-03T19:12:27.967226+0000","last_active":"2023-10-03T19:12:28.953307+0000","last_peered":"2023-10-03T19:12:28.953307+0000","last_clean":"2023-10-03T19:12:28.953307+0000","last_became_active":"2023-10-03T19:12:27.966929+0000","last_became_peered":"2023-10-03T19:12:27.966929+0000","last_unstale":"2023-10-03T19:12:28.953307+0000","last_undegraded":"2023-10-03T19:12:28.953307+0000","last_fullsized":"2023-10-03T19:12:28.953307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:42:03.204018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937391+0000","last_change":"2023-10-03T19:12:27.988476+0000","last_active":"2023-10-03T19:12:31.937391+0000","last_peered":"2023-10-03T19:12:31.937391+0000","last_clean":"2023-10-03T19:12:31.937391+0000","last_became_active":"2023-10-03T19:12:27.988133+0000","last_became_peered":"2023-10-03T19:12:27.988133+0000","last_unstale":"2023-10-03T19:12:31.937391+0000","last_undegraded":"2023-10-03T19:12:31.937391+0000","last_fullsized":"2023-10-03T19:12:31.937391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:13:00.937958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.951743+0000","last_change":"2023-10-03T19:12:27.959887+0000","last_active":"2023-10-03T19:12:28.951743+0000","last_peered":"2023-10-03T19:12:28.951743+0000","last_clean":"2023-10-03T19:12:28.951743+0000","last_became_active":"2023-10-03T19:12:27.959538+0000","last_became_peered":"2023-10-03T19:12:27.959538+0000","last_unstale":"2023-10-03T19:12:28.951743+0000","last_undegraded":"2023-10-03T19:12:28.951743+0000","last_fullsized":"2023-10-03T19:12:28.951743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:57:42.821868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.976471+0000","last_change":"2023-10-03T19:12:27.970249+0000","last_active":"2023-10-03T19:12:27.976471+0000","last_peered":"2023-10-03T19:12:27.976471+0000","last_clean":"2023-10-03T19:12:27.976471+0000","last_became_active":"2023-10-03T19:12:27.969995+0000","last_became_peered":"2023-10-03T19:12:27.969995+0000","last_unstale":"2023-10-03T19:12:27.976471+0000","last_undegraded":"2023-10-03T19:12:27.976471+0000","last_fullsized":"2023-10-03T19:12:27.976471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:23:25.342990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952651+0000","last_change":"2023-10-03T19:12:27.964836+0000","last_active":"2023-10-03T19:12:28.952651+0000","last_peered":"2023-10-03T19:12:28.952651+0000","last_clean":"2023-10-03T19:12:28.952651+0000","last_became_active":"2023-10-03T19:12:27.964025+0000","last_became_peered":"2023-10-03T19:12:27.964025+0000","last_unstale":"2023-10-03T19:12:28.952651+0000","last_undegraded":"2023-10-03T19:12:28.952651+0000","last_fullsized":"2023-10-03T19:12:28.952651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:22:33.134502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954083+0000","last_change":"2023-10-03T19:12:27.986149+0000","last_active":"2023-10-03T19:12:28.954083+0000","last_peered":"2023-10-03T19:12:28.954083+0000","last_clean":"2023-10-03T19:12:28.954083+0000","last_became_active":"2023-10-03T19:12:27.983721+0000","last_became_peered":"2023-10-03T19:12:27.983721+0000","last_unstale":"2023-10-03T19:12:28.954083+0000","last_undegraded":"2023-10-03T19:12:28.954083+0000","last_fullsized":"2023-10-03T19:12:28.954083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:36:36.702280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.947612+0000","last_change":"2023-10-03T19:12:27.971272+0000","last_active":"2023-10-03T19:12:28.947612+0000","last_peered":"2023-10-03T19:12:28.947612+0000","last_clean":"2023-10-03T19:12:28.947612+0000","last_became_active":"2023-10-03T19:12:27.970796+0000","last_became_peered":"2023-10-03T19:12:27.970796+0000","last_unstale":"2023-10-03T19:12:28.947612+0000","last_undegraded":"2023-10-03T19:12:28.947612+0000","last_fullsized":"2023-10-03T19:12:28.947612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:32:28.423427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.947574+0000","last_change":"2023-10-03T19:12:27.968608+0000","last_active":"2023-10-03T19:12:28.947574+0000","last_peered":"2023-10-03T19:12:28.947574+0000","last_clean":"2023-10-03T19:12:28.947574+0000","last_became_active":"2023-10-03T19:12:27.968090+0000","last_became_peered":"2023-10-03T19:12:27.968090+0000","last_unstale":"2023-10-03T19:12:28.947574+0000","last_undegraded":"2023-10-03T19:12:28.947574+0000","last_fullsized":"2023-10-03T19:12:28.947574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:26:14.808258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952943+0000","last_change":"2023-10-03T19:12:27.970387+0000","last_active":"2023-10-03T19:12:28.952943+0000","last_peered":"2023-10-03T19:12:28.952943+0000","last_clean":"2023-10-03T19:12:28.952943+0000","last_became_active":"2023-10-03T19:12:27.969970+0000","last_became_peered":"2023-10-03T19:12:27.969970+0000","last_unstale":"2023-10-03T19:12:28.952943+0000","last_undegraded":"2023-10-03T19:12:28.952943+0000","last_fullsized":"2023-10-03T19:12:28.952943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:57:10.455144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937132+0000","last_change":"2023-10-03T19:12:27.988472+0000","last_active":"2023-10-03T19:12:31.937132+0000","last_peered":"2023-10-03T19:12:31.937132+0000","last_clean":"2023-10-03T19:12:31.937132+0000","last_became_active":"2023-10-03T19:12:27.988143+0000","last_became_peered":"2023-10-03T19:12:27.988143+0000","last_unstale":"2023-10-03T19:12:31.937132+0000","last_undegraded":"2023-10-03T19:12:31.937132+0000","last_fullsized":"2023-10-03T19:12:31.937132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:04:50.005254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952659+0000","last_change":"2023-10-03T19:12:27.960422+0000","last_active":"2023-10-03T19:12:28.952659+0000","last_peered":"2023-10-03T19:12:28.952659+0000","last_clean":"2023-10-03T19:12:28.952659+0000","last_became_active":"2023-10-03T19:12:27.958884+0000","last_became_peered":"2023-10-03T19:12:27.958884+0000","last_unstale":"2023-10-03T19:12:28.952659+0000","last_undegraded":"2023-10-03T19:12:28.952659+0000","last_fullsized":"2023-10-03T19:12:28.952659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:08:38.248650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.974830+0000","last_change":"2023-10-03T19:12:27.968081+0000","last_active":"2023-10-03T19:12:27.974830+0000","last_peered":"2023-10-03T19:12:27.974830+0000","last_clean":"2023-10-03T19:12:27.974830+0000","last_became_active":"2023-10-03T19:12:27.967067+0000","last_became_peered":"2023-10-03T19:12:27.967067+0000","last_unstale":"2023-10-03T19:12:27.974830+0000","last_undegraded":"2023-10-03T19:12:27.974830+0000","last_fullsized":"2023-10-03T19:12:27.974830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:26:21.421555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954083+0000","last_change":"2023-10-03T19:12:27.971067+0000","last_active":"2023-10-03T19:12:28.954083+0000","last_peered":"2023-10-03T19:12:28.954083+0000","last_clean":"2023-10-03T19:12:28.954083+0000","last_became_active":"2023-10-03T19:12:27.970697+0000","last_became_peered":"2023-10-03T19:12:27.970697+0000","last_unstale":"2023-10-03T19:12:28.954083+0000","last_undegraded":"2023-10-03T19:12:28.954083+0000","last_fullsized":"2023-10-03T19:12:28.954083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:48:06.317138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.947677+0000","last_change":"2023-10-03T19:12:27.982404+0000","last_active":"2023-10-03T19:12:28.947677+0000","last_peered":"2023-10-03T19:12:28.947677+0000","last_clean":"2023-10-03T19:12:28.947677+0000","last_became_active":"2023-10-03T19:12:27.982070+0000","last_became_peered":"2023-10-03T19:12:27.982070+0000","last_unstale":"2023-10-03T19:12:28.947677+0000","last_undegraded":"2023-10-03T19:12:28.947677+0000","last_fullsized":"2023-10-03T19:12:28.947677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:05:40.727058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953598+0000","last_change":"2023-10-03T19:12:27.978237+0000","last_active":"2023-10-03T19:12:28.953598+0000","last_peered":"2023-10-03T19:12:28.953598+0000","last_clean":"2023-10-03T19:12:28.953598+0000","last_became_active":"2023-10-03T19:12:27.977841+0000","last_became_peered":"2023-10-03T19:12:27.977841+0000","last_unstale":"2023-10-03T19:12:28.953598+0000","last_undegraded":"2023-10-03T19:12:28.953598+0000","last_fullsized":"2023-10-03T19:12:28.953598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:06:02.160141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937324+0000","last_change":"2023-10-03T19:12:27.978515+0000","last_active":"2023-10-03T19:12:31.937324+0000","last_peered":"2023-10-03T19:12:31.937324+0000","last_clean":"2023-10-03T19:12:31.937324+0000","last_became_active":"2023-10-03T19:12:27.977947+0000","last_became_peered":"2023-10-03T19:12:27.977947+0000","last_unstale":"2023-10-03T19:12:31.937324+0000","last_undegraded":"2023-10-03T19:12:31.937324+0000","last_fullsized":"2023-10-03T19:12:31.937324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:36:36.702280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.974568+0000","last_change":"2023-10-03T19:12:27.966759+0000","last_active":"2023-10-03T19:12:27.974568+0000","last_peered":"2023-10-03T19:12:27.974568+0000","last_clean":"2023-10-03T19:12:27.974568+0000","last_became_active":"2023-10-03T19:12:27.966395+0000","last_became_peered":"2023-10-03T19:12:27.966395+0000","last_unstale":"2023-10-03T19:12:27.974568+0000","last_undegraded":"2023-10-03T19:12:27.974568+0000","last_fullsized":"2023-10-03T19:12:27.974568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:44:35.789330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.974902+0000","last_change":"2023-10-03T19:12:27.965460+0000","last_active":"2023-10-03T19:12:27.974902+0000","last_peered":"2023-10-03T19:12:27.974902+0000","last_clean":"2023-10-03T19:12:27.974902+0000","last_became_active":"2023-10-03T19:12:27.965215+0000","last_became_peered":"2023-10-03T19:12:27.965215+0000","last_unstale":"2023-10-03T19:12:27.974902+0000","last_undegraded":"2023-10-03T19:12:27.974902+0000","last_fullsized":"2023-10-03T19:12:27.974902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:02:11.328680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937118+0000","last_change":"2023-10-03T19:12:27.978012+0000","last_active":"2023-10-03T19:12:31.937118+0000","last_peered":"2023-10-03T19:12:31.937118+0000","last_clean":"2023-10-03T19:12:31.937118+0000","last_became_active":"2023-10-03T19:12:27.977497+0000","last_became_peered":"2023-10-03T19:12:27.977497+0000","last_unstale":"2023-10-03T19:12:31.937118+0000","last_undegraded":"2023-10-03T19:12:31.937118+0000","last_fullsized":"2023-10-03T19:12:31.937118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:39:07.804995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938079+0000","last_change":"2023-10-03T19:12:27.982593+0000","last_active":"2023-10-03T19:12:31.938079+0000","last_peered":"2023-10-03T19:12:31.938079+0000","last_clean":"2023-10-03T19:12:31.938079+0000","last_became_active":"2023-10-03T19:12:27.982076+0000","last_became_peered":"2023-10-03T19:12:27.982076+0000","last_unstale":"2023-10-03T19:12:31.938079+0000","last_undegraded":"2023-10-03T19:12:31.938079+0000","last_fullsized":"2023-10-03T19:12:31.938079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:13:00.937958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937722+0000","last_change":"2023-10-03T19:12:27.969145+0000","last_active":"2023-10-03T19:12:31.937722+0000","last_peered":"2023-10-03T19:12:31.937722+0000","last_clean":"2023-10-03T19:12:31.937722+0000","last_became_active":"2023-10-03T19:12:27.968857+0000","last_became_peered":"2023-10-03T19:12:27.968857+0000","last_unstale":"2023-10-03T19:12:31.937722+0000","last_undegraded":"2023-10-03T19:12:31.937722+0000","last_fullsized":"2023-10-03T19:12:31.937722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:48:06.317138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952353+0000","last_change":"2023-10-03T19:12:27.978614+0000","last_active":"2023-10-03T19:12:28.952353+0000","last_peered":"2023-10-03T19:12:28.952353+0000","last_clean":"2023-10-03T19:12:28.952353+0000","last_became_active":"2023-10-03T19:12:27.978222+0000","last_became_peered":"2023-10-03T19:12:27.978222+0000","last_unstale":"2023-10-03T19:12:28.952353+0000","last_undegraded":"2023-10-03T19:12:28.952353+0000","last_fullsized":"2023-10-03T19:12:28.952353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:47:33.343155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936959+0000","last_change":"2023-10-03T19:12:27.977987+0000","last_active":"2023-10-03T19:12:31.936959+0000","last_peered":"2023-10-03T19:12:31.936959+0000","last_clean":"2023-10-03T19:12:31.936959+0000","last_became_active":"2023-10-03T19:12:27.977696+0000","last_became_peered":"2023-10-03T19:12:27.977696+0000","last_unstale":"2023-10-03T19:12:31.936959+0000","last_undegraded":"2023-10-03T19:12:31.936959+0000","last_fullsized":"2023-10-03T19:12:31.936959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:14:25.554969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.986271+0000","last_change":"2023-10-03T19:12:27.984102+0000","last_active":"2023-10-03T19:12:27.986271+0000","last_peered":"2023-10-03T19:12:27.986271+0000","last_clean":"2023-10-03T19:12:27.986271+0000","last_became_active":"2023-10-03T19:12:27.983835+0000","last_became_peered":"2023-10-03T19:12:27.983835+0000","last_unstale":"2023-10-03T19:12:27.986271+0000","last_undegraded":"2023-10-03T19:12:27.986271+0000","last_fullsized":"2023-10-03T19:12:27.986271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:26:14.808258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953719+0000","last_change":"2023-10-03T19:12:27.982956+0000","last_active":"2023-10-03T19:12:28.953719+0000","last_peered":"2023-10-03T19:12:28.953719+0000","last_clean":"2023-10-03T19:12:28.953719+0000","last_became_active":"2023-10-03T19:12:27.982622+0000","last_became_peered":"2023-10-03T19:12:27.982622+0000","last_unstale":"2023-10-03T19:12:28.953719+0000","last_undegraded":"2023-10-03T19:12:28.953719+0000","last_fullsized":"2023-10-03T19:12:28.953719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:58:41.915397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.975198+0000","last_change":"2023-10-03T19:12:27.969233+0000","last_active":"2023-10-03T19:12:27.975198+0000","last_peered":"2023-10-03T19:12:27.975198+0000","last_clean":"2023-10-03T19:12:27.975198+0000","last_became_active":"2023-10-03T19:12:27.968939+0000","last_became_peered":"2023-10-03T19:12:27.968939+0000","last_unstale":"2023-10-03T19:12:27.975198+0000","last_undegraded":"2023-10-03T19:12:27.975198+0000","last_fullsized":"2023-10-03T19:12:27.975198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:27:19.702607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937466+0000","last_change":"2023-10-03T19:12:27.982253+0000","last_active":"2023-10-03T19:12:31.937466+0000","last_peered":"2023-10-03T19:12:31.937466+0000","last_clean":"2023-10-03T19:12:31.937466+0000","last_became_active":"2023-10-03T19:12:27.974654+0000","last_became_peered":"2023-10-03T19:12:27.974654+0000","last_unstale":"2023-10-03T19:12:31.937466+0000","last_undegraded":"2023-10-03T19:12:31.937466+0000","last_fullsized":"2023-10-03T19:12:31.937466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:15:19.668421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.975253+0000","last_change":"2023-10-03T19:12:27.969223+0000","last_active":"2023-10-03T19:12:27.975253+0000","last_peered":"2023-10-03T19:12:27.975253+0000","last_clean":"2023-10-03T19:12:27.975253+0000","last_became_active":"2023-10-03T19:12:27.968920+0000","last_became_peered":"2023-10-03T19:12:27.968920+0000","last_unstale":"2023-10-03T19:12:27.975253+0000","last_undegraded":"2023-10-03T19:12:27.975253+0000","last_fullsized":"2023-10-03T19:12:27.975253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:05:40.727058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938352+0000","last_change":"2023-10-03T19:12:27.594756+0000","last_active":"2023-10-03T19:12:31.938352+0000","last_peered":"2023-10-03T19:12:31.938352+0000","last_clean":"2023-10-03T19:12:31.938352+0000","last_became_active":"2023-10-03T19:12:27.594156+0000","last_became_peered":"2023-10-03T19:12:27.594156+0000","last_unstale":"2023-10-03T19:12:31.938352+0000","last_undegraded":"2023-10-03T19:12:31.938352+0000","last_fullsized":"2023-10-03T19:12:31.938352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:51:27.857657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953302+0000","last_change":"2023-10-03T19:12:27.984997+0000","last_active":"2023-10-03T19:12:28.953302+0000","last_peered":"2023-10-03T19:12:28.953302+0000","last_clean":"2023-10-03T19:12:28.953302+0000","last_became_active":"2023-10-03T19:12:27.984682+0000","last_became_peered":"2023-10-03T19:12:27.984682+0000","last_unstale":"2023-10-03T19:12:28.953302+0000","last_undegraded":"2023-10-03T19:12:28.953302+0000","last_fullsized":"2023-10-03T19:12:28.953302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:29:18.707428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.948688+0000","last_change":"2023-10-03T19:12:27.589809+0000","last_active":"2023-10-03T19:12:27.948688+0000","last_peered":"2023-10-03T19:12:27.948688+0000","last_clean":"2023-10-03T19:12:27.948688+0000","last_became_active":"2023-10-03T19:12:27.589415+0000","last_became_peered":"2023-10-03T19:12:27.589415+0000","last_unstale":"2023-10-03T19:12:27.948688+0000","last_undegraded":"2023-10-03T19:12:27.948688+0000","last_fullsized":"2023-10-03T19:12:27.948688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:32:27.170784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.974645+0000","last_change":"2023-10-03T19:12:27.966910+0000","last_active":"2023-10-03T19:12:27.974645+0000","last_peered":"2023-10-03T19:12:27.974645+0000","last_clean":"2023-10-03T19:12:27.974645+0000","last_became_active":"2023-10-03T19:12:27.966160+0000","last_became_peered":"2023-10-03T19:12:27.966160+0000","last_unstale":"2023-10-03T19:12:27.974645+0000","last_undegraded":"2023-10-03T19:12:27.974645+0000","last_fullsized":"2023-10-03T19:12:27.974645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:19:53.879346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937350+0000","last_change":"2023-10-03T19:12:27.597122+0000","last_active":"2023-10-03T19:12:31.937350+0000","last_peered":"2023-10-03T19:12:31.937350+0000","last_clean":"2023-10-03T19:12:31.937350+0000","last_became_active":"2023-10-03T19:12:27.596367+0000","last_became_peered":"2023-10-03T19:12:27.596367+0000","last_unstale":"2023-10-03T19:12:31.937350+0000","last_undegraded":"2023-10-03T19:12:31.937350+0000","last_fullsized":"2023-10-03T19:12:31.937350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:09:55.002369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.986259+0000","last_change":"2023-10-03T19:12:27.983942+0000","last_active":"2023-10-03T19:12:27.986259+0000","last_peered":"2023-10-03T19:12:27.986259+0000","last_clean":"2023-10-03T19:12:27.986259+0000","last_became_active":"2023-10-03T19:12:27.983600+0000","last_became_peered":"2023-10-03T19:12:27.983600+0000","last_unstale":"2023-10-03T19:12:27.986259+0000","last_undegraded":"2023-10-03T19:12:27.986259+0000","last_fullsized":"2023-10-03T19:12:27.986259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:36:37.362689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'8","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937478+0000","last_change":"2023-10-03T19:12:27.580060+0000","last_active":"2023-10-03T19:12:31.937478+0000","last_peered":"2023-10-03T19:12:31.937478+0000","last_clean":"2023-10-03T19:12:31.937478+0000","last_became_active":"2023-10-03T19:12:27.579250+0000","last_became_peered":"2023-10-03T19:12:27.579250+0000","last_unstale":"2023-10-03T19:12:31.937478+0000","last_undegraded":"2023-10-03T19:12:31.937478+0000","last_fullsized":"2023-10-03T19:12:31.937478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:04:31.510597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938787+0000","last_change":"2023-10-03T19:12:27.597979+0000","last_active":"2023-10-03T19:12:31.938787+0000","last_peered":"2023-10-03T19:12:31.938787+0000","last_clean":"2023-10-03T19:12:31.938787+0000","last_became_active":"2023-10-03T19:12:27.595911+0000","last_became_peered":"2023-10-03T19:12:27.595911+0000","last_unstale":"2023-10-03T19:12:31.938787+0000","last_undegraded":"2023-10-03T19:12:31.938787+0000","last_fullsized":"2023-10-03T19:12:31.938787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:11:28.744038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.951943+0000","last_change":"2023-10-03T19:12:27.978558+0000","last_active":"2023-10-03T19:12:28.951943+0000","last_peered":"2023-10-03T19:12:28.951943+0000","last_clean":"2023-10-03T19:12:28.951943+0000","last_became_active":"2023-10-03T19:12:27.978193+0000","last_became_peered":"2023-10-03T19:12:27.978193+0000","last_unstale":"2023-10-03T19:12:28.951943+0000","last_undegraded":"2023-10-03T19:12:28.951943+0000","last_fullsized":"2023-10-03T19:12:28.951943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:21:27.107002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938789+0000","last_change":"2023-10-03T19:12:27.597785+0000","last_active":"2023-10-03T19:12:31.938789+0000","last_peered":"2023-10-03T19:12:31.938789+0000","last_clean":"2023-10-03T19:12:31.938789+0000","last_became_active":"2023-10-03T19:12:27.596252+0000","last_became_peered":"2023-10-03T19:12:27.596252+0000","last_unstale":"2023-10-03T19:12:31.938789+0000","last_undegraded":"2023-10-03T19:12:31.938789+0000","last_fullsized":"2023-10-03T19:12:31.938789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:55:56.909440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953146+0000","last_change":"2023-10-03T19:12:27.983791+0000","last_active":"2023-10-03T19:12:28.953146+0000","last_peered":"2023-10-03T19:12:28.953146+0000","last_clean":"2023-10-03T19:12:28.953146+0000","last_became_active":"2023-10-03T19:12:27.983498+0000","last_became_peered":"2023-10-03T19:12:27.983498+0000","last_unstale":"2023-10-03T19:12:28.953146+0000","last_undegraded":"2023-10-03T19:12:28.953146+0000","last_fullsized":"2023-10-03T19:12:28.953146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:56:53.031240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938558+0000","last_change":"2023-10-03T19:12:27.597281+0000","last_active":"2023-10-03T19:12:31.938558+0000","last_peered":"2023-10-03T19:12:31.938558+0000","last_clean":"2023-10-03T19:12:31.938558+0000","last_became_active":"2023-10-03T19:12:27.596699+0000","last_became_peered":"2023-10-03T19:12:27.596699+0000","last_unstale":"2023-10-03T19:12:31.938558+0000","last_undegraded":"2023-10-03T19:12:31.938558+0000","last_fullsized":"2023-10-03T19:12:31.938558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:02:43.719408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937888+0000","last_change":"2023-10-03T19:12:27.985128+0000","last_active":"2023-10-03T19:12:31.937888+0000","last_peered":"2023-10-03T19:12:31.937888+0000","last_clean":"2023-10-03T19:12:31.937888+0000","last_became_active":"2023-10-03T19:12:27.984570+0000","last_became_peered":"2023-10-03T19:12:27.984570+0000","last_unstale":"2023-10-03T19:12:31.937888+0000","last_undegraded":"2023-10-03T19:12:31.937888+0000","last_fullsized":"2023-10-03T19:12:31.937888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:23:37.424885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952130+0000","last_change":"2023-10-03T19:12:27.594338+0000","last_active":"2023-10-03T19:12:28.952130+0000","last_peered":"2023-10-03T19:12:28.952130+0000","last_clean":"2023-10-03T19:12:28.952130+0000","last_became_active":"2023-10-03T19:12:27.593882+0000","last_became_peered":"2023-10-03T19:12:27.593882+0000","last_unstale":"2023-10-03T19:12:28.952130+0000","last_undegraded":"2023-10-03T19:12:28.952130+0000","last_fullsized":"2023-10-03T19:12:28.952130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:55:54.733983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.976214+0000","last_change":"2023-10-03T19:12:27.969749+0000","last_active":"2023-10-03T19:12:27.976214+0000","last_peered":"2023-10-03T19:12:27.976214+0000","last_clean":"2023-10-03T19:12:27.976214+0000","last_became_active":"2023-10-03T19:12:27.966817+0000","last_became_peered":"2023-10-03T19:12:27.966817+0000","last_unstale":"2023-10-03T19:12:27.976214+0000","last_undegraded":"2023-10-03T19:12:27.976214+0000","last_fullsized":"2023-10-03T19:12:27.976214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:38:08.924887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.975277+0000","last_change":"2023-10-03T19:12:27.586872+0000","last_active":"2023-10-03T19:12:27.975277+0000","last_peered":"2023-10-03T19:12:27.975277+0000","last_clean":"2023-10-03T19:12:27.975277+0000","last_became_active":"2023-10-03T19:12:27.586119+0000","last_became_peered":"2023-10-03T19:12:27.586119+0000","last_unstale":"2023-10-03T19:12:27.975277+0000","last_undegraded":"2023-10-03T19:12:27.975277+0000","last_fullsized":"2023-10-03T19:12:27.975277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:15:18.658258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953682+0000","last_change":"2023-10-03T19:12:27.964111+0000","last_active":"2023-10-03T19:12:28.953682+0000","last_peered":"2023-10-03T19:12:28.953682+0000","last_clean":"2023-10-03T19:12:28.953682+0000","last_became_active":"2023-10-03T19:12:27.963620+0000","last_became_peered":"2023-10-03T19:12:27.963620+0000","last_unstale":"2023-10-03T19:12:28.953682+0000","last_undegraded":"2023-10-03T19:12:28.953682+0000","last_fullsized":"2023-10-03T19:12:28.953682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:14:25.554969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938077+0000","last_change":"2023-10-03T19:12:27.587990+0000","last_active":"2023-10-03T19:12:31.938077+0000","last_peered":"2023-10-03T19:12:31.938077+0000","last_clean":"2023-10-03T19:12:31.938077+0000","last_became_active":"2023-10-03T19:12:27.587316+0000","last_became_peered":"2023-10-03T19:12:27.587316+0000","last_unstale":"2023-10-03T19:12:31.938077+0000","last_undegraded":"2023-10-03T19:12:31.938077+0000","last_fullsized":"2023-10-03T19:12:31.938077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:08:37.238486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954191+0000","last_change":"2023-10-03T19:12:27.970739+0000","last_active":"2023-10-03T19:12:28.954191+0000","last_peered":"2023-10-03T19:12:28.954191+0000","last_clean":"2023-10-03T19:12:28.954191+0000","last_became_active":"2023-10-03T19:12:27.970408+0000","last_became_peered":"2023-10-03T19:12:27.970408+0000","last_unstale":"2023-10-03T19:12:28.954191+0000","last_undegraded":"2023-10-03T19:12:28.954191+0000","last_fullsized":"2023-10-03T19:12:28.954191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:13:00.937958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953950+0000","last_change":"2023-10-03T19:12:27.580938+0000","last_active":"2023-10-03T19:12:28.953950+0000","last_peered":"2023-10-03T19:12:28.953950+0000","last_clean":"2023-10-03T19:12:28.953950+0000","last_became_active":"2023-10-03T19:12:27.580538+0000","last_became_peered":"2023-10-03T19:12:27.580538+0000","last_unstale":"2023-10-03T19:12:28.953950+0000","last_undegraded":"2023-10-03T19:12:28.953950+0000","last_fullsized":"2023-10-03T19:12:28.953950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:04:48.995090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954372+0000","last_change":"2023-10-03T19:12:27.969234+0000","last_active":"2023-10-03T19:12:28.954372+0000","last_peered":"2023-10-03T19:12:28.954372+0000","last_clean":"2023-10-03T19:12:28.954372+0000","last_became_active":"2023-10-03T19:12:27.968880+0000","last_became_peered":"2023-10-03T19:12:27.968880+0000","last_unstale":"2023-10-03T19:12:28.954372+0000","last_undegraded":"2023-10-03T19:12:28.954372+0000","last_fullsized":"2023-10-03T19:12:28.954372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:09:56.012532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.950828+0000","last_change":"2023-10-03T19:12:27.592296+0000","last_active":"2023-10-03T19:12:27.950828+0000","last_peered":"2023-10-03T19:12:27.950828+0000","last_clean":"2023-10-03T19:12:27.950828+0000","last_became_active":"2023-10-03T19:12:27.588952+0000","last_became_peered":"2023-10-03T19:12:27.588952+0000","last_unstale":"2023-10-03T19:12:27.950828+0000","last_undegraded":"2023-10-03T19:12:27.950828+0000","last_fullsized":"2023-10-03T19:12:27.950828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:02:16.075186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937406+0000","last_change":"2023-10-03T19:12:27.967839+0000","last_active":"2023-10-03T19:12:31.937406+0000","last_peered":"2023-10-03T19:12:31.937406+0000","last_clean":"2023-10-03T19:12:31.937406+0000","last_became_active":"2023-10-03T19:12:27.967281+0000","last_became_peered":"2023-10-03T19:12:27.967281+0000","last_unstale":"2023-10-03T19:12:31.937406+0000","last_undegraded":"2023-10-03T19:12:31.937406+0000","last_fullsized":"2023-10-03T19:12:31.937406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:33:54.388967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":171,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937204+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:12:31.937204+0000","last_peered":"2023-10-03T19:12:31.937204+0000","last_clean":"2023-10-03T19:12:31.937204+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:12:31.937204+0000","last_undegraded":"2023-10-03T19:12:31.937204+0000","last_fullsized":"2023-10-03T19:12:31.937204+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:48:00.062144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.951827+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:12:28.951827+0000","last_peered":"2023-10-03T19:12:28.951827+0000","last_clean":"2023-10-03T19:12:28.951827+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:12:28.951827+0000","last_undegraded":"2023-10-03T19:12:28.951827+0000","last_fullsized":"2023-10-03T19:12:28.951827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:16:13.727679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.948136+0000","last_change":"2023-10-03T19:12:27.592604+0000","last_active":"2023-10-03T19:12:27.948136+0000","last_peered":"2023-10-03T19:12:27.948136+0000","last_clean":"2023-10-03T19:12:27.948136+0000","last_became_active":"2023-10-03T19:12:27.592242+0000","last_became_peered":"2023-10-03T19:12:27.592242+0000","last_unstale":"2023-10-03T19:12:27.948136+0000","last_undegraded":"2023-10-03T19:12:27.948136+0000","last_fullsized":"2023-10-03T19:12:27.948136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:26:38.455074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937821+0000","last_change":"2023-10-03T19:12:27.981742+0000","last_active":"2023-10-03T19:12:31.937821+0000","last_peered":"2023-10-03T19:12:31.937821+0000","last_clean":"2023-10-03T19:12:31.937821+0000","last_became_active":"2023-10-03T19:12:27.981480+0000","last_became_peered":"2023-10-03T19:12:27.981480+0000","last_unstale":"2023-10-03T19:12:31.937821+0000","last_undegraded":"2023-10-03T19:12:31.937821+0000","last_fullsized":"2023-10-03T19:12:31.937821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:32:27.213744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936854+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:12:31.936854+0000","last_peered":"2023-10-03T19:12:31.936854+0000","last_clean":"2023-10-03T19:12:31.936854+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:12:31.936854+0000","last_undegraded":"2023-10-03T19:12:31.936854+0000","last_fullsized":"2023-10-03T19:12:31.936854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:33:49.157041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.947801+0000","last_change":"2023-10-03T19:12:27.594044+0000","last_active":"2023-10-03T19:12:27.947801+0000","last_peered":"2023-10-03T19:12:27.947801+0000","last_clean":"2023-10-03T19:12:27.947801+0000","last_became_active":"2023-10-03T19:12:27.593678+0000","last_became_peered":"2023-10-03T19:12:27.593678+0000","last_unstale":"2023-10-03T19:12:27.947801+0000","last_undegraded":"2023-10-03T19:12:27.947801+0000","last_fullsized":"2023-10-03T19:12:27.947801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:27:39.006980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.976154+0000","last_change":"2023-10-03T19:12:27.969842+0000","last_active":"2023-10-03T19:12:27.976154+0000","last_peered":"2023-10-03T19:12:27.976154+0000","last_clean":"2023-10-03T19:12:27.976154+0000","last_became_active":"2023-10-03T19:12:27.966611+0000","last_became_peered":"2023-10-03T19:12:27.966611+0000","last_unstale":"2023-10-03T19:12:27.976154+0000","last_undegraded":"2023-10-03T19:12:27.976154+0000","last_fullsized":"2023-10-03T19:12:27.976154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:26:05.803303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.947762+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:12:28.947762+0000","last_peered":"2023-10-03T19:12:28.947762+0000","last_clean":"2023-10-03T19:12:28.947762+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:12:28.947762+0000","last_undegraded":"2023-10-03T19:12:28.947762+0000","last_fullsized":"2023-10-03T19:12:28.947762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:24:20.268582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936393+0000","last_change":"2023-10-03T19:12:27.579209+0000","last_active":"2023-10-03T19:12:31.936393+0000","last_peered":"2023-10-03T19:12:31.936393+0000","last_clean":"2023-10-03T19:12:31.936393+0000","last_became_active":"2023-10-03T19:12:27.578633+0000","last_became_peered":"2023-10-03T19:12:27.578633+0000","last_unstale":"2023-10-03T19:12:31.936393+0000","last_undegraded":"2023-10-03T19:12:31.936393+0000","last_fullsized":"2023-10-03T19:12:31.936393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:02:27.868659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937557+0000","last_change":"2023-10-03T19:12:27.966914+0000","last_active":"2023-10-03T19:12:31.937557+0000","last_peered":"2023-10-03T19:12:31.937557+0000","last_clean":"2023-10-03T19:12:31.937557+0000","last_became_active":"2023-10-03T19:12:27.966406+0000","last_became_peered":"2023-10-03T19:12:27.966406+0000","last_unstale":"2023-10-03T19:12:31.937557+0000","last_undegraded":"2023-10-03T19:12:31.937557+0000","last_fullsized":"2023-10-03T19:12:31.937557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:39:07.804995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953153+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:12:28.953153+0000","last_peered":"2023-10-03T19:12:28.953153+0000","last_clean":"2023-10-03T19:12:28.953153+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:12:28.953153+0000","last_undegraded":"2023-10-03T19:12:28.953153+0000","last_fullsized":"2023-10-03T19:12:28.953153+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:50:46.706999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954915+0000","last_change":"2023-10-03T19:12:27.586703+0000","last_active":"2023-10-03T19:12:28.954915+0000","last_peered":"2023-10-03T19:12:28.954915+0000","last_clean":"2023-10-03T19:12:28.954915+0000","last_became_active":"2023-10-03T19:12:27.586241+0000","last_became_peered":"2023-10-03T19:12:27.586241+0000","last_unstale":"2023-10-03T19:12:28.954915+0000","last_undegraded":"2023-10-03T19:12:28.954915+0000","last_fullsized":"2023-10-03T19:12:28.954915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:23:42.273581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936826+0000","last_change":"2023-10-03T19:12:27.972058+0000","last_active":"2023-10-03T19:12:31.936826+0000","last_peered":"2023-10-03T19:12:31.936826+0000","last_clean":"2023-10-03T19:12:31.936826+0000","last_became_active":"2023-10-03T19:12:27.971770+0000","last_became_peered":"2023-10-03T19:12:27.971770+0000","last_unstale":"2023-10-03T19:12:31.936826+0000","last_undegraded":"2023-10-03T19:12:31.936826+0000","last_fullsized":"2023-10-03T19:12:31.936826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:06:02.160141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952764+0000","last_change":"2023-10-03T19:12:27.595105+0000","last_active":"2023-10-03T19:12:28.952764+0000","last_peered":"2023-10-03T19:12:28.952764+0000","last_clean":"2023-10-03T19:12:28.952764+0000","last_became_active":"2023-10-03T19:12:27.594748+0000","last_became_peered":"2023-10-03T19:12:27.594748+0000","last_unstale":"2023-10-03T19:12:28.952764+0000","last_undegraded":"2023-10-03T19:12:28.952764+0000","last_fullsized":"2023-10-03T19:12:28.952764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:43:24.586460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937036+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:12:31.937036+0000","last_peered":"2023-10-03T19:12:31.937036+0000","last_clean":"2023-10-03T19:12:31.937036+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:12:31.937036+0000","last_undegraded":"2023-10-03T19:12:31.937036+0000","last_fullsized":"2023-10-03T19:12:31.937036+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:50:20.553324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937627+0000","last_change":"2023-10-03T19:12:27.966147+0000","last_active":"2023-10-03T19:12:31.937627+0000","last_peered":"2023-10-03T19:12:31.937627+0000","last_clean":"2023-10-03T19:12:31.937627+0000","last_became_active":"2023-10-03T19:12:27.965865+0000","last_became_peered":"2023-10-03T19:12:27.965865+0000","last_unstale":"2023-10-03T19:12:31.937627+0000","last_undegraded":"2023-10-03T19:12:31.937627+0000","last_fullsized":"2023-10-03T19:12:31.937627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:04:50.005254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936963+0000","last_change":"2023-10-03T19:12:27.581597+0000","last_active":"2023-10-03T19:12:31.936963+0000","last_peered":"2023-10-03T19:12:31.936963+0000","last_clean":"2023-10-03T19:12:31.936963+0000","last_became_active":"2023-10-03T19:12:27.581015+0000","last_became_peered":"2023-10-03T19:12:27.581015+0000","last_unstale":"2023-10-03T19:12:31.936963+0000","last_undegraded":"2023-10-03T19:12:31.936963+0000","last_fullsized":"2023-10-03T19:12:31.936963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:58:40.905233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938993+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:12:31.938993+0000","last_peered":"2023-10-03T19:12:31.938993+0000","last_clean":"2023-10-03T19:12:31.938993+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:12:31.938993+0000","last_undegraded":"2023-10-03T19:12:31.938993+0000","last_fullsized":"2023-10-03T19:12:31.938993+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:13:27.600123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.974615+0000","last_change":"2023-10-03T19:12:27.964905+0000","last_active":"2023-10-03T19:12:27.974615+0000","last_peered":"2023-10-03T19:12:27.974615+0000","last_clean":"2023-10-03T19:12:27.974615+0000","last_became_active":"2023-10-03T19:12:27.964614+0000","last_became_peered":"2023-10-03T19:12:27.964614+0000","last_unstale":"2023-10-03T19:12:27.974615+0000","last_undegraded":"2023-10-03T19:12:27.974615+0000","last_fullsized":"2023-10-03T19:12:27.974615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:12:10.609586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.984212+0000","last_change":"2023-10-03T19:12:27.588155+0000","last_active":"2023-10-03T19:12:27.984212+0000","last_peered":"2023-10-03T19:12:27.984212+0000","last_clean":"2023-10-03T19:12:27.984212+0000","last_became_active":"2023-10-03T19:12:27.587340+0000","last_became_peered":"2023-10-03T19:12:27.587340+0000","last_unstale":"2023-10-03T19:12:27.984212+0000","last_undegraded":"2023-10-03T19:12:27.984212+0000","last_fullsized":"2023-10-03T19:12:27.984212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:24:24.490344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937821+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:12:31.937821+0000","last_peered":"2023-10-03T19:12:31.937821+0000","last_clean":"2023-10-03T19:12:31.937821+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:12:31.937821+0000","last_undegraded":"2023-10-03T19:12:31.937821+0000","last_fullsized":"2023-10-03T19:12:31.937821+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:36:31.470355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.979909+0000","last_change":"2023-10-03T19:12:27.977940+0000","last_active":"2023-10-03T19:12:27.979909+0000","last_peered":"2023-10-03T19:12:27.979909+0000","last_clean":"2023-10-03T19:12:27.979909+0000","last_became_active":"2023-10-03T19:12:27.977495+0000","last_became_peered":"2023-10-03T19:12:27.977495+0000","last_unstale":"2023-10-03T19:12:27.979909+0000","last_undegraded":"2023-10-03T19:12:27.979909+0000","last_fullsized":"2023-10-03T19:12:27.979909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:34:17.232441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.949197+0000","last_change":"2023-10-03T19:12:27.583954+0000","last_active":"2023-10-03T19:12:27.949197+0000","last_peered":"2023-10-03T19:12:27.949197+0000","last_clean":"2023-10-03T19:12:27.949197+0000","last_became_active":"2023-10-03T19:12:27.583313+0000","last_became_peered":"2023-10-03T19:12:27.583313+0000","last_unstale":"2023-10-03T19:12:27.949197+0000","last_undegraded":"2023-10-03T19:12:27.949197+0000","last_fullsized":"2023-10-03T19:12:27.949197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:25:10.249460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938105+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:12:31.938105+0000","last_peered":"2023-10-03T19:12:31.938105+0000","last_clean":"2023-10-03T19:12:31.938105+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:12:31.938105+0000","last_undegraded":"2023-10-03T19:12:31.938105+0000","last_fullsized":"2023-10-03T19:12:31.938105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:56:47.799314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953723+0000","last_change":"2023-10-03T19:12:27.961343+0000","last_active":"2023-10-03T19:12:28.953723+0000","last_peered":"2023-10-03T19:12:28.953723+0000","last_clean":"2023-10-03T19:12:28.953723+0000","last_became_active":"2023-10-03T19:12:27.961065+0000","last_became_peered":"2023-10-03T19:12:27.961065+0000","last_unstale":"2023-10-03T19:12:28.953723+0000","last_undegraded":"2023-10-03T19:12:28.953723+0000","last_fullsized":"2023-10-03T19:12:28.953723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:50:25.785249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954854+0000","last_change":"2023-10-03T19:12:27.975142+0000","last_active":"2023-10-03T19:12:28.954854+0000","last_peered":"2023-10-03T19:12:28.954854+0000","last_clean":"2023-10-03T19:12:28.954854+0000","last_became_active":"2023-10-03T19:12:27.974173+0000","last_became_peered":"2023-10-03T19:12:27.974173+0000","last_unstale":"2023-10-03T19:12:28.954854+0000","last_undegraded":"2023-10-03T19:12:28.954854+0000","last_fullsized":"2023-10-03T19:12:28.954854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:02:44.729572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'6","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953832+0000","last_change":"2023-10-03T19:12:27.586506+0000","last_active":"2023-10-03T19:12:28.953832+0000","last_peered":"2023-10-03T19:12:28.953832+0000","last_clean":"2023-10-03T19:12:28.953832+0000","last_became_active":"2023-10-03T19:12:27.585847+0000","last_became_peered":"2023-10-03T19:12:27.585847+0000","last_unstale":"2023-10-03T19:12:28.953832+0000","last_undegraded":"2023-10-03T19:12:28.953832+0000","last_fullsized":"2023-10-03T19:12:28.953832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:33:53.378803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937279+0000","last_change":"2023-10-03T19:12:27.973591+0000","last_active":"2023-10-03T19:12:31.937279+0000","last_peered":"2023-10-03T19:12:31.937279+0000","last_clean":"2023-10-03T19:12:31.937279+0000","last_became_active":"2023-10-03T19:12:27.973308+0000","last_became_peered":"2023-10-03T19:12:27.973308+0000","last_unstale":"2023-10-03T19:12:31.937279+0000","last_undegraded":"2023-10-03T19:12:31.937279+0000","last_fullsized":"2023-10-03T19:12:31.937279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:40:40.179631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938677+0000","last_change":"2023-10-03T19:12:27.595373+0000","last_active":"2023-10-03T19:12:31.938677+0000","last_peered":"2023-10-03T19:12:31.938677+0000","last_clean":"2023-10-03T19:12:31.938677+0000","last_became_active":"2023-10-03T19:12:27.594761+0000","last_became_peered":"2023-10-03T19:12:27.594761+0000","last_unstale":"2023-10-03T19:12:31.938677+0000","last_undegraded":"2023-10-03T19:12:31.938677+0000","last_fullsized":"2023-10-03T19:12:31.938677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:23:42.273581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952982+0000","last_change":"2023-10-03T19:12:27.585305+0000","last_active":"2023-10-03T19:12:28.952982+0000","last_peered":"2023-10-03T19:12:28.952982+0000","last_clean":"2023-10-03T19:12:28.952982+0000","last_became_active":"2023-10-03T19:12:27.584635+0000","last_became_peered":"2023-10-03T19:12:27.584635+0000","last_unstale":"2023-10-03T19:12:28.952982+0000","last_undegraded":"2023-10-03T19:12:28.952982+0000","last_fullsized":"2023-10-03T19:12:28.952982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:37:44.604456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.980138+0000","last_change":"2023-10-03T19:12:27.978707+0000","last_active":"2023-10-03T19:12:27.980138+0000","last_peered":"2023-10-03T19:12:27.980138+0000","last_clean":"2023-10-03T19:12:27.980138+0000","last_became_active":"2023-10-03T19:12:27.978433+0000","last_became_peered":"2023-10-03T19:12:27.978433+0000","last_unstale":"2023-10-03T19:12:27.980138+0000","last_undegraded":"2023-10-03T19:12:27.980138+0000","last_fullsized":"2023-10-03T19:12:27.980138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:20:38.469750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.952762+0000","last_change":"2023-10-03T19:12:27.592047+0000","last_active":"2023-10-03T19:12:27.952762+0000","last_peered":"2023-10-03T19:12:27.952762+0000","last_clean":"2023-10-03T19:12:27.952762+0000","last_became_active":"2023-10-03T19:12:27.591625+0000","last_became_peered":"2023-10-03T19:12:27.591625+0000","last_unstale":"2023-10-03T19:12:27.952762+0000","last_undegraded":"2023-10-03T19:12:27.952762+0000","last_fullsized":"2023-10-03T19:12:27.952762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:10:01.648289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.985378+0000","last_change":"2023-10-03T19:12:27.982932+0000","last_active":"2023-10-03T19:12:27.985378+0000","last_peered":"2023-10-03T19:12:27.985378+0000","last_clean":"2023-10-03T19:12:27.985378+0000","last_became_active":"2023-10-03T19:12:27.982612+0000","last_became_peered":"2023-10-03T19:12:27.982612+0000","last_unstale":"2023-10-03T19:12:27.985378+0000","last_undegraded":"2023-10-03T19:12:27.985378+0000","last_fullsized":"2023-10-03T19:12:27.985378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:32:28.423427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937987+0000","last_change":"2023-10-03T19:12:27.974833+0000","last_active":"2023-10-03T19:12:31.937987+0000","last_peered":"2023-10-03T19:12:31.937987+0000","last_clean":"2023-10-03T19:12:31.937987+0000","last_became_active":"2023-10-03T19:12:27.973932+0000","last_became_peered":"2023-10-03T19:12:27.973932+0000","last_unstale":"2023-10-03T19:12:31.937987+0000","last_undegraded":"2023-10-03T19:12:31.937987+0000","last_fullsized":"2023-10-03T19:12:31.937987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:20:24.642279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.952654+0000","last_change":"2023-10-03T19:12:27.592021+0000","last_active":"2023-10-03T19:12:27.952654+0000","last_peered":"2023-10-03T19:12:27.952654+0000","last_clean":"2023-10-03T19:12:27.952654+0000","last_became_active":"2023-10-03T19:12:27.589194+0000","last_became_peered":"2023-10-03T19:12:27.589194+0000","last_unstale":"2023-10-03T19:12:27.952654+0000","last_undegraded":"2023-10-03T19:12:27.952654+0000","last_fullsized":"2023-10-03T19:12:27.952654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:54:40.090498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.979286+0000","last_change":"2023-10-03T19:12:27.978101+0000","last_active":"2023-10-03T19:12:27.979286+0000","last_peered":"2023-10-03T19:12:27.979286+0000","last_clean":"2023-10-03T19:12:27.979286+0000","last_became_active":"2023-10-03T19:12:27.977700+0000","last_became_peered":"2023-10-03T19:12:27.977700+0000","last_unstale":"2023-10-03T19:12:27.979286+0000","last_undegraded":"2023-10-03T19:12:27.979286+0000","last_fullsized":"2023-10-03T19:12:27.979286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:01:03.468673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936430+0000","last_change":"2023-10-03T19:12:27.578433+0000","last_active":"2023-10-03T19:12:31.936430+0000","last_peered":"2023-10-03T19:12:31.936430+0000","last_clean":"2023-10-03T19:12:31.936430+0000","last_became_active":"2023-10-03T19:12:27.577627+0000","last_became_peered":"2023-10-03T19:12:27.577627+0000","last_unstale":"2023-10-03T19:12:31.936430+0000","last_undegraded":"2023-10-03T19:12:31.936430+0000","last_fullsized":"2023-10-03T19:12:31.936430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:42:02.193854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.986241+0000","last_change":"2023-10-03T19:12:27.983570+0000","last_active":"2023-10-03T19:12:27.986241+0000","last_peered":"2023-10-03T19:12:27.986241+0000","last_clean":"2023-10-03T19:12:27.986241+0000","last_became_active":"2023-10-03T19:12:27.983296+0000","last_became_peered":"2023-10-03T19:12:27.983296+0000","last_unstale":"2023-10-03T19:12:27.986241+0000","last_undegraded":"2023-10-03T19:12:27.986241+0000","last_fullsized":"2023-10-03T19:12:27.986241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:13:22.936261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953770+0000","last_change":"2023-10-03T19:12:27.577852+0000","last_active":"2023-10-03T19:12:28.953770+0000","last_peered":"2023-10-03T19:12:28.953770+0000","last_clean":"2023-10-03T19:12:28.953770+0000","last_became_active":"2023-10-03T19:12:27.576792+0000","last_became_peered":"2023-10-03T19:12:27.576792+0000","last_unstale":"2023-10-03T19:12:28.953770+0000","last_undegraded":"2023-10-03T19:12:28.953770+0000","last_fullsized":"2023-10-03T19:12:28.953770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:40:39.169467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.947561+0000","last_change":"2023-10-03T19:12:27.983619+0000","last_active":"2023-10-03T19:12:28.947561+0000","last_peered":"2023-10-03T19:12:28.947561+0000","last_clean":"2023-10-03T19:12:28.947561+0000","last_became_active":"2023-10-03T19:12:27.983185+0000","last_became_peered":"2023-10-03T19:12:27.983185+0000","last_unstale":"2023-10-03T19:12:28.947561+0000","last_undegraded":"2023-10-03T19:12:28.947561+0000","last_fullsized":"2023-10-03T19:12:28.947561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:02:11.328680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.979861+0000","last_change":"2023-10-03T19:12:27.593678+0000","last_active":"2023-10-03T19:12:27.979861+0000","last_peered":"2023-10-03T19:12:27.979861+0000","last_clean":"2023-10-03T19:12:27.979861+0000","last_became_active":"2023-10-03T19:12:27.593376+0000","last_became_peered":"2023-10-03T19:12:27.593376+0000","last_unstale":"2023-10-03T19:12:27.979861+0000","last_undegraded":"2023-10-03T19:12:27.979861+0000","last_fullsized":"2023-10-03T19:12:27.979861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:44:45.554309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954797+0000","last_change":"2023-10-03T19:12:27.962395+0000","last_active":"2023-10-03T19:12:28.954797+0000","last_peered":"2023-10-03T19:12:28.954797+0000","last_clean":"2023-10-03T19:12:28.954797+0000","last_became_active":"2023-10-03T19:12:27.962105+0000","last_became_peered":"2023-10-03T19:12:27.962105+0000","last_unstale":"2023-10-03T19:12:28.954797+0000","last_undegraded":"2023-10-03T19:12:28.954797+0000","last_fullsized":"2023-10-03T19:12:28.954797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:51:28.867821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952027+0000","last_change":"2023-10-03T19:12:27.588675+0000","last_active":"2023-10-03T19:12:28.952027+0000","last_peered":"2023-10-03T19:12:28.952027+0000","last_clean":"2023-10-03T19:12:28.952027+0000","last_became_active":"2023-10-03T19:12:27.588046+0000","last_became_peered":"2023-10-03T19:12:27.588046+0000","last_unstale":"2023-10-03T19:12:28.952027+0000","last_undegraded":"2023-10-03T19:12:28.952027+0000","last_fullsized":"2023-10-03T19:12:28.952027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:08:47.585355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953482+0000","last_change":"2023-10-03T19:12:27.965478+0000","last_active":"2023-10-03T19:12:28.953482+0000","last_peered":"2023-10-03T19:12:28.953482+0000","last_clean":"2023-10-03T19:12:28.953482+0000","last_became_active":"2023-10-03T19:12:27.964064+0000","last_became_peered":"2023-10-03T19:12:27.964064+0000","last_unstale":"2023-10-03T19:12:28.953482+0000","last_undegraded":"2023-10-03T19:12:28.953482+0000","last_fullsized":"2023-10-03T19:12:28.953482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:02:28.878823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952596+0000","last_change":"2023-10-03T19:12:27.587343+0000","last_active":"2023-10-03T19:12:28.952596+0000","last_peered":"2023-10-03T19:12:28.952596+0000","last_clean":"2023-10-03T19:12:28.952596+0000","last_became_active":"2023-10-03T19:12:27.586953+0000","last_became_peered":"2023-10-03T19:12:27.586953+0000","last_unstale":"2023-10-03T19:12:28.952596+0000","last_undegraded":"2023-10-03T19:12:28.952596+0000","last_fullsized":"2023-10-03T19:12:28.952596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:01:57.712265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.975219+0000","last_change":"2023-10-03T19:12:27.970441+0000","last_active":"2023-10-03T19:12:27.975219+0000","last_peered":"2023-10-03T19:12:27.975219+0000","last_clean":"2023-10-03T19:12:27.975219+0000","last_became_active":"2023-10-03T19:12:27.970137+0000","last_became_peered":"2023-10-03T19:12:27.970137+0000","last_unstale":"2023-10-03T19:12:27.975219+0000","last_undegraded":"2023-10-03T19:12:27.975219+0000","last_fullsized":"2023-10-03T19:12:27.975219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:01:09.556791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.972925+0000","last_change":"2023-10-03T19:12:27.586020+0000","last_active":"2023-10-03T19:12:27.972925+0000","last_peered":"2023-10-03T19:12:27.972925+0000","last_clean":"2023-10-03T19:12:27.972925+0000","last_became_active":"2023-10-03T19:12:27.585736+0000","last_became_peered":"2023-10-03T19:12:27.585736+0000","last_unstale":"2023-10-03T19:12:27.972925+0000","last_undegraded":"2023-10-03T19:12:27.972925+0000","last_fullsized":"2023-10-03T19:12:27.972925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:09:55.424188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.951761+0000","last_change":"2023-10-03T19:12:27.986822+0000","last_active":"2023-10-03T19:12:28.951761+0000","last_peered":"2023-10-03T19:12:28.951761+0000","last_clean":"2023-10-03T19:12:28.951761+0000","last_became_active":"2023-10-03T19:12:27.986532+0000","last_became_peered":"2023-10-03T19:12:27.986532+0000","last_unstale":"2023-10-03T19:12:28.951761+0000","last_undegraded":"2023-10-03T19:12:28.951761+0000","last_fullsized":"2023-10-03T19:12:28.951761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:20:24.642279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.976701+0000","last_change":"2023-10-03T19:12:27.591787+0000","last_active":"2023-10-03T19:12:27.976701+0000","last_peered":"2023-10-03T19:12:27.976701+0000","last_clean":"2023-10-03T19:12:27.976701+0000","last_became_active":"2023-10-03T19:12:27.591472+0000","last_became_peered":"2023-10-03T19:12:27.591472+0000","last_unstale":"2023-10-03T19:12:27.976701+0000","last_undegraded":"2023-10-03T19:12:27.976701+0000","last_fullsized":"2023-10-03T19:12:27.976701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:35:42.979095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8944,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362896,"statfs":{"total":96636764160,"available":96627605504,"internally_reserved":0,"allocated":303104,"data_stored":667065,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]}]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8336,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363504,"statfs":{"total":96636764160,"available":96628228096,"internally_reserved":0,"allocated":204800,"data_stored":73753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8436,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363404,"statfs":{"total":96636764160,"available":96628125696,"internally_reserved":0,"allocated":241664,"data_stored":83190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]}]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12444,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":12224,"kb_avail":94359396,"statfs":{"total":96636764160,"available":96624021504,"internally_reserved":0,"allocated":217088,"data_stored":80406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12517376},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8404,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363436,"statfs":{"total":96636764160,"available":96628158464,"internally_reserved":0,"allocated":208896,"data_stored":74917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8408,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363432,"statfs":{"total":96636764160,"available":96628154368,"internally_reserved":0,"allocated":212992,"data_stored":75007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8360,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363480,"statfs":{"total":96636764160,"available":96628203520,"internally_reserved":0,"allocated":229376,"data_stored":82222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13012,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":12736,"kb_avail":94358828,"statfs":{"total":96636764160,"available":96623439872,"internally_reserved":0,"allocated":274432,"data_stored":664703,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":13041664},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4410000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:12:32.759 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-03T19:12:32.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.897+0000 7feadf04f640 1 Processor -- start 2023-10-03T19:12:32.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.897+0000 7feadf04f640 1 -- start start 2023-10-03T19:12:32.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7feadf04f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fead80bb1d0 0x7fead81528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:32.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7feadf04f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead806b2d0 con 0x7fead80c2790 2023-10-03T19:12:32.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7feadf04f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead80a3c60 con 0x7fead814f240 2023-10-03T19:12:32.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7feadf04f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead806b640 con 0x7fead80bb1d0 2023-10-03T19:12:32.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7fead7fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fead80c2790 0x7fead80c12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35786/0 (socket says 172.21.15.45:35786) 2023-10-03T19:12:32.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7fead7fff640 1 -- 172.21.15.45:0/1762689895 learned_addr learned my addr 172.21.15.45:0/1762689895 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:32.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7feadd5ec640 1 --2- 172.21.15.45:0/1762689895 >> v2:172.21.15.79:3300/0 conn(0x7fead80bb1d0 0x7fead81528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:32.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7fead77fe640 1 -- 172.21.15.45:0/1762689895 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 323670734 0 0) 0x7fead806b2d0 con 0x7fead80c2790 2023-10-03T19:12:32.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7fead77fe640 1 -- 172.21.15.45:0/1762689895 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feac0003530 con 0x7fead80c2790 2023-10-03T19:12:32.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7fead77fe640 1 -- 172.21.15.45:0/1762689895 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2747459053 0 0) 0x7feac0003530 con 0x7fead80c2790 2023-10-03T19:12:32.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7fead77fe640 1 -- 172.21.15.45:0/1762689895 >> v2:172.21.15.79:3300/0 conn(0x7fead80bb1d0 msgr2=0x7fead81528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:32.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7fead77fe640 1 --2- 172.21.15.45:0/1762689895 >> v2:172.21.15.79:3300/0 conn(0x7fead80bb1d0 0x7fead81528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7fead77fe640 1 -- 172.21.15.45:0/1762689895 >> v1:172.21.15.79:6789/0 conn(0x7fead814f240 legacy=0x7fead80c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:32.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7fead77fe640 1 -- 172.21.15.45:0/1762689895 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead80c19b0 con 0x7fead80c2790 2023-10-03T19:12:32.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7fead77fe640 1 -- 172.21.15.45:0/1762689895 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7feacc001800 con 0x7fead80c2790 2023-10-03T19:12:32.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7fead77fe640 1 -- 172.21.15.45:0/1762689895 >> v1:172.21.15.45:6789/0 conn(0x7fead80c2790 legacy=0x7fead80c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:32.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7fead77fe640 1 --2- 172.21.15.45:0/1762689895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feac0003980 0x7feac0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:32.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7fead77fe640 1 --2- 172.21.15.45:0/1762689895 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feac00047d0 0x7feac0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:32.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7fead77fe640 1 --2- 172.21.15.45:0/1762689895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feac0005180 0x7feac000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:32.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7fead77fe640 1 -- 172.21.15.45:0/1762689895 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead806b640 con 0x7feac0003980 2023-10-03T19:12:32.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7fead77fe640 1 -- 172.21.15.45:0/1762689895 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac000bfe0 con 0x7feac0005180 2023-10-03T19:12:32.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7fead77fe640 1 -- 172.21.15.45:0/1762689895 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac000c1a0 con 0x7feac00047d0 2023-10-03T19:12:32.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7feadcdeb640 1 --2- 172.21.15.45:0/1762689895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feac0003980 0x7feac0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:32.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7feadcdeb640 1 -- 172.21.15.45:0/1762689895 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feac00047d0 msgr2=0x7feac0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:32.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7feadcdeb640 1 --2- 172.21.15.45:0/1762689895 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feac00047d0 0x7feac0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7feadcdeb640 1 -- 172.21.15.45:0/1762689895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feac0005180 msgr2=0x7feac000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:32.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7feadcdeb640 1 --2- 172.21.15.45:0/1762689895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feac0005180 0x7feac000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7feadcdeb640 1 -- 172.21.15.45:0/1762689895 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac0003530 con 0x7feac0003980 2023-10-03T19:12:32.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7feadd5ec640 1 -- 172.21.15.45:0/1762689895 reap_dead start 2023-10-03T19:12:32.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7feadcdeb640 1 --2- 172.21.15.45:0/1762689895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feac0003980 0x7feac0003d90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7feac80017b0 tx=0x7feac801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801b37c9756c4a0c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:32.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7fead77fe640 1 -- 172.21.15.45:0/1762689895 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac80052d0 con 0x7feac0003980 2023-10-03T19:12:32.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7fead77fe640 1 -- 172.21.15.45:0/1762689895 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac80a7050 con 0x7feac0003980 2023-10-03T19:12:32.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.901+0000 7fead77fe640 1 -- 172.21.15.45:0/1762689895 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac8003650 con 0x7feac0003980 2023-10-03T19:12:32.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7feadf04f640 1 -- 172.21.15.45:0/1762689895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feac0003980 msgr2=0x7feac0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:32.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7feadf04f640 1 --2- 172.21.15.45:0/1762689895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feac0003980 0x7feac0003d90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7feac80017b0 tx=0x7feac801c3e0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7feadf04f640 1 -- 172.21.15.45:0/1762689895 shutdown_connections 2023-10-03T19:12:32.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7feadf04f640 1 --2- 172.21.15.45:0/1762689895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feac0003980 0x7feac0003d90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7feadf04f640 1 -- 172.21.15.45:0/1762689895 >> 172.21.15.45:0/1762689895 conn(0x7fead80a64a0 msgr2=0x7fead80a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:32.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7feadf04f640 1 -- 172.21.15.45:0/1762689895 shutdown_connections 2023-10-03T19:12:32.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7feadf04f640 1 -- 172.21.15.45:0/1762689895 wait complete. 2023-10-03T19:12:32.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7feadf04f640 1 Processor -- start 2023-10-03T19:12:32.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7feadf04f640 1 -- start start 2023-10-03T19:12:32.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7feadf04f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feac0003980 0x7fead8150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:32.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7feadf04f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fead80a7c50 0x7fead8151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:32.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7feadf04f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fead8151bd0 0x7fead81e71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:32.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7feadf04f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead80aa030 con 0x7fead80a7c50 2023-10-03T19:12:32.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7feadf04f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead8152050 con 0x7feac0003980 2023-10-03T19:12:32.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7feadf04f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead80aa280 con 0x7fead8151bd0 2023-10-03T19:12:32.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7fead7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fead80a7c50 0x7fead8151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:32.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7fead7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fead80a7c50 0x7fead8151690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46646/0 (socket says 172.21.15.45:46646) 2023-10-03T19:12:32.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7fead7fff640 1 -- 172.21.15.45:0/1042283485 learned_addr learned my addr 172.21.15.45:0/1042283485 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:32.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7feadd5ec640 1 --2- 172.21.15.45:0/1042283485 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fead8151bd0 0x7fead81e71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:32.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7feadcdeb640 1 --2- 172.21.15.45:0/1042283485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feac0003980 0x7fead8150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:32.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7fead7fff640 1 -- 172.21.15.45:0/1042283485 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fead8151bd0 msgr2=0x7fead81e71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:32.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7fead7fff640 1 --2- 172.21.15.45:0/1042283485 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fead8151bd0 0x7fead81e71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7fead7fff640 1 -- 172.21.15.45:0/1042283485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feac0003980 msgr2=0x7fead8150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:32.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7fead7fff640 1 --2- 172.21.15.45:0/1042283485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feac0003980 0x7fead8150290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:32.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7fead7fff640 1 -- 172.21.15.45:0/1042283485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead80a3f40 con 0x7fead80a7c50 2023-10-03T19:12:32.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7fead7fff640 1 --2- 172.21.15.45:0/1042283485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fead80a7c50 0x7fead8151690 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7feacc001370 tx=0x7feacc00f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:32.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7fead57fa640 1 -- 172.21.15.45:0/1042283485 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc00a0d0 con 0x7fead80a7c50 2023-10-03T19:12:32.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7fead57fa640 1 -- 172.21.15.45:0/1042283485 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feacc00a250 con 0x7fead80a7c50 2023-10-03T19:12:32.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7feadf04f640 1 -- 172.21.15.45:0/1042283485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead814e740 con 0x7fead80a7c50 2023-10-03T19:12:32.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7fead57fa640 1 -- 172.21.15.45:0/1042283485 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc00a600 con 0x7fead80a7c50 2023-10-03T19:12:32.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7feadf04f640 1 -- 172.21.15.45:0/1042283485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead814f610 con 0x7fead80a7c50 2023-10-03T19:12:32.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.905+0000 7feadf04f640 1 -- 172.21.15.45:0/1042283485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead804de80 con 0x7fead80a7c50 2023-10-03T19:12:32.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.909+0000 7fead57fa640 1 -- 172.21.15.45:0/1042283485 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7feacc0077c0 con 0x7fead80a7c50 2023-10-03T19:12:32.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.909+0000 7fead57fa640 1 --2- 172.21.15.45:0/1042283485 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7feac4066280 0x7feac4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:32.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.909+0000 7fead57fa640 1 -- 172.21.15.45:0/1042283485 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feacc086570 con 0x7fead80a7c50 2023-10-03T19:12:32.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.909+0000 7feadcdeb640 1 --2- 172.21.15.45:0/1042283485 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7feac4066280 0x7feac4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:32.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.909+0000 7feadcdeb640 1 --2- 172.21.15.45:0/1042283485 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7feac4066280 0x7feac4068730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7feac80ac000 tx=0x7feac80011f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:32.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:32.913+0000 7fead57fa640 1 -- 172.21.15.45:0/1042283485 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7feacc057480 con 0x7fead80a7c50 2023-10-03T19:12:33.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.121+0000 7feadf04f640 1 -- 172.21.15.45:0/1042283485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fead80c0280 con 0x7fead80a7c50 2023-10-03T19:12:33.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.121+0000 7fead57fa640 1 -- 172.21.15.45:0/1042283485 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1011 (secure 0 0 0) 0x7feacc057010 con 0x7fead80a7c50 2023-10-03T19:12:33.126 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:33.127 INFO:teuthology.orchestra.run.smithi045.stdout:{"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":27,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":22,"num_osds":8,"num_up_osds":8,"osd_up_since":1696360341,"num_in_osds":8,"osd_in_since":1696360332,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592730,"bytes_used":78176256,"bytes_avail":773015937024,"bytes_total":773094113280,"write_bytes_sec":2928,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":7,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4282}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-10-03T19:12:05.791210+0000","services":{}},"progress_events":{}} 2023-10-03T19:12:33.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.125+0000 7feadf04f640 1 -- 172.21.15.45:0/1042283485 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7feac4066280 msgr2=0x7feac4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:33.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.125+0000 7feadf04f640 1 --2- 172.21.15.45:0/1042283485 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7feac4066280 0x7feac4068730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7feac80ac000 tx=0x7feac80011f0 comp rx=0 tx=0).stop 2023-10-03T19:12:33.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.125+0000 7feadf04f640 1 -- 172.21.15.45:0/1042283485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fead80a7c50 msgr2=0x7fead8151690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:33.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.125+0000 7feadf04f640 1 --2- 172.21.15.45:0/1042283485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fead80a7c50 0x7fead8151690 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7feacc001370 tx=0x7feacc00f450 comp rx=0 tx=0).stop 2023-10-03T19:12:33.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.125+0000 7feadf04f640 1 -- 172.21.15.45:0/1042283485 shutdown_connections 2023-10-03T19:12:33.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.125+0000 7feadf04f640 1 --2- 172.21.15.45:0/1042283485 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7feac4066280 0x7feac4068730 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:33.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.125+0000 7feadf04f640 1 --2- 172.21.15.45:0/1042283485 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fead8151bd0 0x7fead81e71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:33.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.125+0000 7feadf04f640 1 --2- 172.21.15.45:0/1042283485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fead80a7c50 0x7fead8151690 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:33.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.125+0000 7feadf04f640 1 --2- 172.21.15.45:0/1042283485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feac0003980 0x7fead8150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:33.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.125+0000 7feadf04f640 1 -- 172.21.15.45:0/1042283485 >> 172.21.15.45:0/1042283485 conn(0x7fead80a64a0 msgr2=0x7fead80a6870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:33.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.125+0000 7feadf04f640 1 -- 172.21.15.45:0/1042283485 shutdown_connections 2023-10-03T19:12:33.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.125+0000 7feadf04f640 1 -- 172.21.15.45:0/1042283485 wait complete. 2023-10-03T19:12:33.145 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-03T19:12:33.146 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:12:33.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.257+0000 7feb046cb640 1 Processor -- start 2023-10-03T19:12:33.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.257+0000 7feb046cb640 1 -- start start 2023-10-03T19:12:33.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb046cb640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feafc06d170 0x7feafc14d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:33.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb046cb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feafc06cac0 con 0x7feafc06f170 2023-10-03T19:12:33.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb046cb640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feafc0720d0 con 0x7feafc0bc8b0 2023-10-03T19:12:33.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb046cb640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feafc0a5ab0 con 0x7feafc06d170 2023-10-03T19:12:33.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb02467640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7feafc06f170 0x7feafc150190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35792/0 (socket says 172.21.15.45:35792) 2023-10-03T19:12:33.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb02467640 1 -- 172.21.15.45:0/2363537319 learned_addr learned my addr 172.21.15.45:0/2363537319 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:33.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb01465640 1 -- 172.21.15.45:0/2363537319 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3420318073 0 0) 0x7feaf8001120 con 0x7feafc06f170 2023-10-03T19:12:33.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb02c68640 1 --2- 172.21.15.45:0/2363537319 >> v2:172.21.15.79:3300/0 conn(0x7feafc06d170 0x7feafc14d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:33.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb01465640 1 -- 172.21.15.45:0/2363537319 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feae8003530 con 0x7feafc06f170 2023-10-03T19:12:33.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb01465640 1 -- 172.21.15.45:0/2363537319 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 133947506 0 0) 0x7feae8003530 con 0x7feafc06f170 2023-10-03T19:12:33.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb01465640 1 -- 172.21.15.45:0/2363537319 >> v2:172.21.15.79:3300/0 conn(0x7feafc06d170 msgr2=0x7feafc14d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:33.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb01465640 1 --2- 172.21.15.45:0/2363537319 >> v2:172.21.15.79:3300/0 conn(0x7feafc06d170 0x7feafc14d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:33.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb01465640 1 -- 172.21.15.45:0/2363537319 >> v1:172.21.15.79:6789/0 conn(0x7feafc0bc8b0 legacy=0x7feafc14ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:33.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb01465640 1 -- 172.21.15.45:0/2363537319 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc06cd00 con 0x7feafc06f170 2023-10-03T19:12:33.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb01465640 1 -- 172.21.15.45:0/2363537319 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7feaf8001810 con 0x7feafc06f170 2023-10-03T19:12:33.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb01465640 1 -- 172.21.15.45:0/2363537319 >> v1:172.21.15.45:6789/0 conn(0x7feafc06f170 legacy=0x7feafc150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:33.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb01465640 1 --2- 172.21.15.45:0/2363537319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feae8003980 0x7feae8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:33.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb01465640 1 --2- 172.21.15.45:0/2363537319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feae80047d0 0x7feae8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:33.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb01465640 1 --2- 172.21.15.45:0/2363537319 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feae8005180 0x7feae800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:33.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb01465640 1 -- 172.21.15.45:0/2363537319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feafc0a5ab0 con 0x7feae80047d0 2023-10-03T19:12:33.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb01465640 1 -- 172.21.15.45:0/2363537319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae800bfe0 con 0x7feae8003980 2023-10-03T19:12:33.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb01465640 1 -- 172.21.15.45:0/2363537319 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae800c1a0 con 0x7feae8005180 2023-10-03T19:12:33.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb01c66640 1 --2- 172.21.15.45:0/2363537319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feae80047d0 0x7feae8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:33.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb02467640 1 --2- 172.21.15.45:0/2363537319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feae8003980 0x7feae8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:33.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb02c68640 1 --2- 172.21.15.45:0/2363537319 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feae8005180 0x7feae800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:33.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb01c66640 1 -- 172.21.15.45:0/2363537319 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feae8005180 msgr2=0x7feae800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:33.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb01c66640 1 --2- 172.21.15.45:0/2363537319 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feae8005180 0x7feae800b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:33.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb01c66640 1 -- 172.21.15.45:0/2363537319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feae8003980 msgr2=0x7feae8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:33.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb01c66640 1 --2- 172.21.15.45:0/2363537319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feae8003980 0x7feae8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:33.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb01c66640 1 -- 172.21.15.45:0/2363537319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae8003530 con 0x7feae80047d0 2023-10-03T19:12:33.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb02c68640 1 -- 172.21.15.45:0/2363537319 reap_dead start 2023-10-03T19:12:33.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb02467640 1 --2- 172.21.15.45:0/2363537319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feae8003980 0x7feae8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:33.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.261+0000 7feb01c66640 1 --2- 172.21.15.45:0/2363537319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feae80047d0 0x7feae8004c40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7feaf0001780 tx=0x7feaf001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f177e63c2797f84 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:33.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb01465640 1 -- 172.21.15.45:0/2363537319 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf00052d0 con 0x7feae80047d0 2023-10-03T19:12:33.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb01465640 1 -- 172.21.15.45:0/2363537319 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf00a7050 con 0x7feae80047d0 2023-10-03T19:12:33.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb01465640 1 -- 172.21.15.45:0/2363537319 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf0003600 con 0x7feae80047d0 2023-10-03T19:12:33.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb046cb640 1 -- 172.21.15.45:0/2363537319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feae80047d0 msgr2=0x7feae8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:33.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb046cb640 1 --2- 172.21.15.45:0/2363537319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feae80047d0 0x7feae8004c40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7feaf0001780 tx=0x7feaf001c3e0 comp rx=0 tx=0).stop 2023-10-03T19:12:33.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb046cb640 1 -- 172.21.15.45:0/2363537319 shutdown_connections 2023-10-03T19:12:33.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb046cb640 1 --2- 172.21.15.45:0/2363537319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feae80047d0 0x7feae8004c40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:33.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb046cb640 1 -- 172.21.15.45:0/2363537319 >> 172.21.15.45:0/2363537319 conn(0x7feafc0bcf50 msgr2=0x7feafc0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:33.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb046cb640 1 -- 172.21.15.45:0/2363537319 shutdown_connections 2023-10-03T19:12:33.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb046cb640 1 -- 172.21.15.45:0/2363537319 wait complete. 2023-10-03T19:12:33.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb046cb640 1 Processor -- start 2023-10-03T19:12:33.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb046cb640 1 -- start start 2023-10-03T19:12:33.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb046cb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feae80047d0 0x7feafc1d7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:33.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb046cb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feafc144ec0 0x7feafc1444a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:33.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb046cb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feafc1d75d0 0x7feafc1e5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:33.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb046cb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feafc147f60 con 0x7feafc144ec0 2023-10-03T19:12:33.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb046cb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feafc1d6c40 con 0x7feae80047d0 2023-10-03T19:12:33.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb046cb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feafc0b57c0 con 0x7feafc1d75d0 2023-10-03T19:12:33.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb01c66640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feafc144ec0 0x7feafc1444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:33.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb01c66640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feafc144ec0 0x7feafc1444a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46664/0 (socket says 172.21.15.45:46664) 2023-10-03T19:12:33.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb01c66640 1 -- 172.21.15.45:0/2429494404 learned_addr learned my addr 172.21.15.45:0/2429494404 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:33.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb02467640 1 --2- 172.21.15.45:0/2429494404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feae80047d0 0x7feafc1d7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:33.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb02c68640 1 --2- 172.21.15.45:0/2429494404 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feafc1d75d0 0x7feafc1e5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:33.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb01c66640 1 -- 172.21.15.45:0/2429494404 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feafc1d75d0 msgr2=0x7feafc1e5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:33.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb01c66640 1 --2- 172.21.15.45:0/2429494404 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feafc1d75d0 0x7feafc1e5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:33.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb01c66640 1 -- 172.21.15.45:0/2429494404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feae80047d0 msgr2=0x7feafc1d7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:33.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb01c66640 1 --2- 172.21.15.45:0/2429494404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feae80047d0 0x7feafc1d7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:33.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb01c66640 1 -- 172.21.15.45:0/2429494404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc14c4a0 con 0x7feafc144ec0 2023-10-03T19:12:33.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb01c66640 1 --2- 172.21.15.45:0/2429494404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feafc144ec0 0x7feafc1444a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feaf001c210 tx=0x7feae8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:33.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feaeeffd640 1 -- 172.21.15.45:0/2429494404 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf0007500 con 0x7feafc144ec0 2023-10-03T19:12:33.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feaeeffd640 1 -- 172.21.15.45:0/2429494404 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf0007660 con 0x7feafc144ec0 2023-10-03T19:12:33.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb046cb640 1 -- 172.21.15.45:0/2429494404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feafc14fae0 con 0x7feafc144ec0 2023-10-03T19:12:33.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feaeeffd640 1 -- 172.21.15.45:0/2429494404 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf0006a20 con 0x7feafc144ec0 2023-10-03T19:12:33.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.265+0000 7feb046cb640 1 -- 172.21.15.45:0/2429494404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feafc06f540 con 0x7feafc144ec0 2023-10-03T19:12:33.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.269+0000 7feb046cb640 1 -- 172.21.15.45:0/2429494404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feafc06d660 con 0x7feafc144ec0 2023-10-03T19:12:33.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.269+0000 7feaeeffd640 1 -- 172.21.15.45:0/2429494404 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7feaf0006b80 con 0x7feafc144ec0 2023-10-03T19:12:33.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.269+0000 7feaeeffd640 1 --2- 172.21.15.45:0/2429494404 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7feae00662b0 0x7feae0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:33.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.269+0000 7feaeeffd640 1 -- 172.21.15.45:0/2429494404 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feaf011e920 con 0x7feafc144ec0 2023-10-03T19:12:33.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.269+0000 7feb02467640 1 --2- 172.21.15.45:0/2429494404 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7feae00662b0 0x7feae0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:33.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.269+0000 7feb02467640 1 --2- 172.21.15.45:0/2429494404 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7feae00662b0 0x7feae0068760 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feaf8001940 tx=0x7feaf8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:33.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.273+0000 7feaeeffd640 1 -- 172.21.15.45:0/2429494404 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7feaf00ef910 con 0x7feafc144ec0 2023-10-03T19:12:33.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.417+0000 7feb046cb640 1 -- 172.21.15.45:0/2429494404 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feafc04de80 con 0x7feae00662b0 2023-10-03T19:12:33.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.437+0000 7feaeeffd640 1 -- 172.21.15.45:0/2429494404 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286713 (secure 0 0 0) 0x7feafc04de80 con 0x7feae00662b0 2023-10-03T19:12:33.444 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:33.446 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:12:33.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.441+0000 7feb046cb640 1 -- 172.21.15.45:0/2429494404 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7feae00662b0 msgr2=0x7feae0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:33.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.441+0000 7feb046cb640 1 --2- 172.21.15.45:0/2429494404 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7feae00662b0 0x7feae0068760 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feaf8001940 tx=0x7feaf8009040 comp rx=0 tx=0).stop 2023-10-03T19:12:33.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.441+0000 7feb046cb640 1 -- 172.21.15.45:0/2429494404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feafc144ec0 msgr2=0x7feafc1444a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:33.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.441+0000 7feb046cb640 1 --2- 172.21.15.45:0/2429494404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feafc144ec0 0x7feafc1444a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feaf001c210 tx=0x7feae8005800 comp rx=0 tx=0).stop 2023-10-03T19:12:33.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.441+0000 7feb046cb640 1 -- 172.21.15.45:0/2429494404 shutdown_connections 2023-10-03T19:12:33.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.441+0000 7feb046cb640 1 --2- 172.21.15.45:0/2429494404 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7feae00662b0 0x7feae0068760 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:33.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.441+0000 7feb046cb640 1 --2- 172.21.15.45:0/2429494404 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feafc1d75d0 0x7feafc1e5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:33.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.441+0000 7feb046cb640 1 --2- 172.21.15.45:0/2429494404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feafc144ec0 0x7feafc1444a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:33.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.441+0000 7feb046cb640 1 --2- 172.21.15.45:0/2429494404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feae80047d0 0x7feafc1d7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:33.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.441+0000 7feb046cb640 1 -- 172.21.15.45:0/2429494404 >> 172.21.15.45:0/2429494404 conn(0x7feafc0bcf50 msgr2=0x7feafc0c09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:33.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.441+0000 7feb046cb640 1 -- 172.21.15.45:0/2429494404 shutdown_connections 2023-10-03T19:12:33.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:33.441+0000 7feb046cb640 1 -- 172.21.15.45:0/2429494404 wait complete. 2023-10-03T19:12:33.461 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-03T19:12:32.440580+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":76344,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":74432,"kb_avail":754898376,"statfs":{"total":773094113280,"available":773015937024,"internally_reserved":0,"allocated":1892352,"data_stored":1801263,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":76218368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":63,"apply_latency_ms":63,"commit_latency_ns":63000000,"apply_latency_ns":63000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.895131"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.947798+0000","last_change":"2023-10-03T19:12:27.968561+0000","last_active":"2023-10-03T19:12:28.947798+0000","last_peered":"2023-10-03T19:12:28.947798+0000","last_clean":"2023-10-03T19:12:28.947798+0000","last_became_active":"2023-10-03T19:12:27.968018+0000","last_became_peered":"2023-10-03T19:12:27.968018+0000","last_unstale":"2023-10-03T19:12:28.947798+0000","last_undegraded":"2023-10-03T19:12:28.947798+0000","last_fullsized":"2023-10-03T19:12:28.947798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:02:17.085349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954200+0000","last_change":"2023-10-03T19:12:27.970081+0000","last_active":"2023-10-03T19:12:28.954200+0000","last_peered":"2023-10-03T19:12:28.954200+0000","last_clean":"2023-10-03T19:12:28.954200+0000","last_became_active":"2023-10-03T19:12:27.969751+0000","last_became_peered":"2023-10-03T19:12:27.969751+0000","last_unstale":"2023-10-03T19:12:28.954200+0000","last_undegraded":"2023-10-03T19:12:28.954200+0000","last_fullsized":"2023-10-03T19:12:28.954200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:51:23.880877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953910+0000","last_change":"2023-10-03T19:12:27.962924+0000","last_active":"2023-10-03T19:12:28.953910+0000","last_peered":"2023-10-03T19:12:28.953910+0000","last_clean":"2023-10-03T19:12:28.953910+0000","last_became_active":"2023-10-03T19:12:27.962634+0000","last_became_peered":"2023-10-03T19:12:27.962634+0000","last_unstale":"2023-10-03T19:12:28.953910+0000","last_undegraded":"2023-10-03T19:12:28.953910+0000","last_fullsized":"2023-10-03T19:12:28.953910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:39:07.804995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937912+0000","last_change":"2023-10-03T19:12:27.972848+0000","last_active":"2023-10-03T19:12:31.937912+0000","last_peered":"2023-10-03T19:12:31.937912+0000","last_clean":"2023-10-03T19:12:31.937912+0000","last_became_active":"2023-10-03T19:12:27.972451+0000","last_became_peered":"2023-10-03T19:12:27.972451+0000","last_unstale":"2023-10-03T19:12:31.937912+0000","last_undegraded":"2023-10-03T19:12:31.937912+0000","last_fullsized":"2023-10-03T19:12:31.937912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:51:42.777690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.974769+0000","last_change":"2023-10-03T19:12:27.966859+0000","last_active":"2023-10-03T19:12:27.974769+0000","last_peered":"2023-10-03T19:12:27.974769+0000","last_clean":"2023-10-03T19:12:27.974769+0000","last_became_active":"2023-10-03T19:12:27.966145+0000","last_became_peered":"2023-10-03T19:12:27.966145+0000","last_unstale":"2023-10-03T19:12:27.974769+0000","last_undegraded":"2023-10-03T19:12:27.974769+0000","last_fullsized":"2023-10-03T19:12:27.974769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:22:31.716735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953307+0000","last_change":"2023-10-03T19:12:27.967226+0000","last_active":"2023-10-03T19:12:28.953307+0000","last_peered":"2023-10-03T19:12:28.953307+0000","last_clean":"2023-10-03T19:12:28.953307+0000","last_became_active":"2023-10-03T19:12:27.966929+0000","last_became_peered":"2023-10-03T19:12:27.966929+0000","last_unstale":"2023-10-03T19:12:28.953307+0000","last_undegraded":"2023-10-03T19:12:28.953307+0000","last_fullsized":"2023-10-03T19:12:28.953307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:42:03.204018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937391+0000","last_change":"2023-10-03T19:12:27.988476+0000","last_active":"2023-10-03T19:12:31.937391+0000","last_peered":"2023-10-03T19:12:31.937391+0000","last_clean":"2023-10-03T19:12:31.937391+0000","last_became_active":"2023-10-03T19:12:27.988133+0000","last_became_peered":"2023-10-03T19:12:27.988133+0000","last_unstale":"2023-10-03T19:12:31.937391+0000","last_undegraded":"2023-10-03T19:12:31.937391+0000","last_fullsized":"2023-10-03T19:12:31.937391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:13:00.937958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.951743+0000","last_change":"2023-10-03T19:12:27.959887+0000","last_active":"2023-10-03T19:12:28.951743+0000","last_peered":"2023-10-03T19:12:28.951743+0000","last_clean":"2023-10-03T19:12:28.951743+0000","last_became_active":"2023-10-03T19:12:27.959538+0000","last_became_peered":"2023-10-03T19:12:27.959538+0000","last_unstale":"2023-10-03T19:12:28.951743+0000","last_undegraded":"2023-10-03T19:12:28.951743+0000","last_fullsized":"2023-10-03T19:12:28.951743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:57:42.821868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.976471+0000","last_change":"2023-10-03T19:12:27.970249+0000","last_active":"2023-10-03T19:12:27.976471+0000","last_peered":"2023-10-03T19:12:27.976471+0000","last_clean":"2023-10-03T19:12:27.976471+0000","last_became_active":"2023-10-03T19:12:27.969995+0000","last_became_peered":"2023-10-03T19:12:27.969995+0000","last_unstale":"2023-10-03T19:12:27.976471+0000","last_undegraded":"2023-10-03T19:12:27.976471+0000","last_fullsized":"2023-10-03T19:12:27.976471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:23:25.342990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952651+0000","last_change":"2023-10-03T19:12:27.964836+0000","last_active":"2023-10-03T19:12:28.952651+0000","last_peered":"2023-10-03T19:12:28.952651+0000","last_clean":"2023-10-03T19:12:28.952651+0000","last_became_active":"2023-10-03T19:12:27.964025+0000","last_became_peered":"2023-10-03T19:12:27.964025+0000","last_unstale":"2023-10-03T19:12:28.952651+0000","last_undegraded":"2023-10-03T19:12:28.952651+0000","last_fullsized":"2023-10-03T19:12:28.952651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:22:33.134502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954083+0000","last_change":"2023-10-03T19:12:27.986149+0000","last_active":"2023-10-03T19:12:28.954083+0000","last_peered":"2023-10-03T19:12:28.954083+0000","last_clean":"2023-10-03T19:12:28.954083+0000","last_became_active":"2023-10-03T19:12:27.983721+0000","last_became_peered":"2023-10-03T19:12:27.983721+0000","last_unstale":"2023-10-03T19:12:28.954083+0000","last_undegraded":"2023-10-03T19:12:28.954083+0000","last_fullsized":"2023-10-03T19:12:28.954083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:36:36.702280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.947612+0000","last_change":"2023-10-03T19:12:27.971272+0000","last_active":"2023-10-03T19:12:28.947612+0000","last_peered":"2023-10-03T19:12:28.947612+0000","last_clean":"2023-10-03T19:12:28.947612+0000","last_became_active":"2023-10-03T19:12:27.970796+0000","last_became_peered":"2023-10-03T19:12:27.970796+0000","last_unstale":"2023-10-03T19:12:28.947612+0000","last_undegraded":"2023-10-03T19:12:28.947612+0000","last_fullsized":"2023-10-03T19:12:28.947612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:32:28.423427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.947574+0000","last_change":"2023-10-03T19:12:27.968608+0000","last_active":"2023-10-03T19:12:28.947574+0000","last_peered":"2023-10-03T19:12:28.947574+0000","last_clean":"2023-10-03T19:12:28.947574+0000","last_became_active":"2023-10-03T19:12:27.968090+0000","last_became_peered":"2023-10-03T19:12:27.968090+0000","last_unstale":"2023-10-03T19:12:28.947574+0000","last_undegraded":"2023-10-03T19:12:28.947574+0000","last_fullsized":"2023-10-03T19:12:28.947574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:26:14.808258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952943+0000","last_change":"2023-10-03T19:12:27.970387+0000","last_active":"2023-10-03T19:12:28.952943+0000","last_peered":"2023-10-03T19:12:28.952943+0000","last_clean":"2023-10-03T19:12:28.952943+0000","last_became_active":"2023-10-03T19:12:27.969970+0000","last_became_peered":"2023-10-03T19:12:27.969970+0000","last_unstale":"2023-10-03T19:12:28.952943+0000","last_undegraded":"2023-10-03T19:12:28.952943+0000","last_fullsized":"2023-10-03T19:12:28.952943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:57:10.455144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937132+0000","last_change":"2023-10-03T19:12:27.988472+0000","last_active":"2023-10-03T19:12:31.937132+0000","last_peered":"2023-10-03T19:12:31.937132+0000","last_clean":"2023-10-03T19:12:31.937132+0000","last_became_active":"2023-10-03T19:12:27.988143+0000","last_became_peered":"2023-10-03T19:12:27.988143+0000","last_unstale":"2023-10-03T19:12:31.937132+0000","last_undegraded":"2023-10-03T19:12:31.937132+0000","last_fullsized":"2023-10-03T19:12:31.937132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:04:50.005254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952659+0000","last_change":"2023-10-03T19:12:27.960422+0000","last_active":"2023-10-03T19:12:28.952659+0000","last_peered":"2023-10-03T19:12:28.952659+0000","last_clean":"2023-10-03T19:12:28.952659+0000","last_became_active":"2023-10-03T19:12:27.958884+0000","last_became_peered":"2023-10-03T19:12:27.958884+0000","last_unstale":"2023-10-03T19:12:28.952659+0000","last_undegraded":"2023-10-03T19:12:28.952659+0000","last_fullsized":"2023-10-03T19:12:28.952659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:08:38.248650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.974830+0000","last_change":"2023-10-03T19:12:27.968081+0000","last_active":"2023-10-03T19:12:27.974830+0000","last_peered":"2023-10-03T19:12:27.974830+0000","last_clean":"2023-10-03T19:12:27.974830+0000","last_became_active":"2023-10-03T19:12:27.967067+0000","last_became_peered":"2023-10-03T19:12:27.967067+0000","last_unstale":"2023-10-03T19:12:27.974830+0000","last_undegraded":"2023-10-03T19:12:27.974830+0000","last_fullsized":"2023-10-03T19:12:27.974830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:26:21.421555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954083+0000","last_change":"2023-10-03T19:12:27.971067+0000","last_active":"2023-10-03T19:12:28.954083+0000","last_peered":"2023-10-03T19:12:28.954083+0000","last_clean":"2023-10-03T19:12:28.954083+0000","last_became_active":"2023-10-03T19:12:27.970697+0000","last_became_peered":"2023-10-03T19:12:27.970697+0000","last_unstale":"2023-10-03T19:12:28.954083+0000","last_undegraded":"2023-10-03T19:12:28.954083+0000","last_fullsized":"2023-10-03T19:12:28.954083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:48:06.317138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.947677+0000","last_change":"2023-10-03T19:12:27.982404+0000","last_active":"2023-10-03T19:12:28.947677+0000","last_peered":"2023-10-03T19:12:28.947677+0000","last_clean":"2023-10-03T19:12:28.947677+0000","last_became_active":"2023-10-03T19:12:27.982070+0000","last_became_peered":"2023-10-03T19:12:27.982070+0000","last_unstale":"2023-10-03T19:12:28.947677+0000","last_undegraded":"2023-10-03T19:12:28.947677+0000","last_fullsized":"2023-10-03T19:12:28.947677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:05:40.727058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953598+0000","last_change":"2023-10-03T19:12:27.978237+0000","last_active":"2023-10-03T19:12:28.953598+0000","last_peered":"2023-10-03T19:12:28.953598+0000","last_clean":"2023-10-03T19:12:28.953598+0000","last_became_active":"2023-10-03T19:12:27.977841+0000","last_became_peered":"2023-10-03T19:12:27.977841+0000","last_unstale":"2023-10-03T19:12:28.953598+0000","last_undegraded":"2023-10-03T19:12:28.953598+0000","last_fullsized":"2023-10-03T19:12:28.953598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:06:02.160141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937324+0000","last_change":"2023-10-03T19:12:27.978515+0000","last_active":"2023-10-03T19:12:31.937324+0000","last_peered":"2023-10-03T19:12:31.937324+0000","last_clean":"2023-10-03T19:12:31.937324+0000","last_became_active":"2023-10-03T19:12:27.977947+0000","last_became_peered":"2023-10-03T19:12:27.977947+0000","last_unstale":"2023-10-03T19:12:31.937324+0000","last_undegraded":"2023-10-03T19:12:31.937324+0000","last_fullsized":"2023-10-03T19:12:31.937324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:36:36.702280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.974568+0000","last_change":"2023-10-03T19:12:27.966759+0000","last_active":"2023-10-03T19:12:27.974568+0000","last_peered":"2023-10-03T19:12:27.974568+0000","last_clean":"2023-10-03T19:12:27.974568+0000","last_became_active":"2023-10-03T19:12:27.966395+0000","last_became_peered":"2023-10-03T19:12:27.966395+0000","last_unstale":"2023-10-03T19:12:27.974568+0000","last_undegraded":"2023-10-03T19:12:27.974568+0000","last_fullsized":"2023-10-03T19:12:27.974568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:44:35.789330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.974902+0000","last_change":"2023-10-03T19:12:27.965460+0000","last_active":"2023-10-03T19:12:27.974902+0000","last_peered":"2023-10-03T19:12:27.974902+0000","last_clean":"2023-10-03T19:12:27.974902+0000","last_became_active":"2023-10-03T19:12:27.965215+0000","last_became_peered":"2023-10-03T19:12:27.965215+0000","last_unstale":"2023-10-03T19:12:27.974902+0000","last_undegraded":"2023-10-03T19:12:27.974902+0000","last_fullsized":"2023-10-03T19:12:27.974902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:02:11.328680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937118+0000","last_change":"2023-10-03T19:12:27.978012+0000","last_active":"2023-10-03T19:12:31.937118+0000","last_peered":"2023-10-03T19:12:31.937118+0000","last_clean":"2023-10-03T19:12:31.937118+0000","last_became_active":"2023-10-03T19:12:27.977497+0000","last_became_peered":"2023-10-03T19:12:27.977497+0000","last_unstale":"2023-10-03T19:12:31.937118+0000","last_undegraded":"2023-10-03T19:12:31.937118+0000","last_fullsized":"2023-10-03T19:12:31.937118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:39:07.804995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938079+0000","last_change":"2023-10-03T19:12:27.982593+0000","last_active":"2023-10-03T19:12:31.938079+0000","last_peered":"2023-10-03T19:12:31.938079+0000","last_clean":"2023-10-03T19:12:31.938079+0000","last_became_active":"2023-10-03T19:12:27.982076+0000","last_became_peered":"2023-10-03T19:12:27.982076+0000","last_unstale":"2023-10-03T19:12:31.938079+0000","last_undegraded":"2023-10-03T19:12:31.938079+0000","last_fullsized":"2023-10-03T19:12:31.938079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:13:00.937958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937722+0000","last_change":"2023-10-03T19:12:27.969145+0000","last_active":"2023-10-03T19:12:31.937722+0000","last_peered":"2023-10-03T19:12:31.937722+0000","last_clean":"2023-10-03T19:12:31.937722+0000","last_became_active":"2023-10-03T19:12:27.968857+0000","last_became_peered":"2023-10-03T19:12:27.968857+0000","last_unstale":"2023-10-03T19:12:31.937722+0000","last_undegraded":"2023-10-03T19:12:31.937722+0000","last_fullsized":"2023-10-03T19:12:31.937722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:48:06.317138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952353+0000","last_change":"2023-10-03T19:12:27.978614+0000","last_active":"2023-10-03T19:12:28.952353+0000","last_peered":"2023-10-03T19:12:28.952353+0000","last_clean":"2023-10-03T19:12:28.952353+0000","last_became_active":"2023-10-03T19:12:27.978222+0000","last_became_peered":"2023-10-03T19:12:27.978222+0000","last_unstale":"2023-10-03T19:12:28.952353+0000","last_undegraded":"2023-10-03T19:12:28.952353+0000","last_fullsized":"2023-10-03T19:12:28.952353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:47:33.343155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936959+0000","last_change":"2023-10-03T19:12:27.977987+0000","last_active":"2023-10-03T19:12:31.936959+0000","last_peered":"2023-10-03T19:12:31.936959+0000","last_clean":"2023-10-03T19:12:31.936959+0000","last_became_active":"2023-10-03T19:12:27.977696+0000","last_became_peered":"2023-10-03T19:12:27.977696+0000","last_unstale":"2023-10-03T19:12:31.936959+0000","last_undegraded":"2023-10-03T19:12:31.936959+0000","last_fullsized":"2023-10-03T19:12:31.936959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:14:25.554969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.986271+0000","last_change":"2023-10-03T19:12:27.984102+0000","last_active":"2023-10-03T19:12:27.986271+0000","last_peered":"2023-10-03T19:12:27.986271+0000","last_clean":"2023-10-03T19:12:27.986271+0000","last_became_active":"2023-10-03T19:12:27.983835+0000","last_became_peered":"2023-10-03T19:12:27.983835+0000","last_unstale":"2023-10-03T19:12:27.986271+0000","last_undegraded":"2023-10-03T19:12:27.986271+0000","last_fullsized":"2023-10-03T19:12:27.986271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:26:14.808258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953719+0000","last_change":"2023-10-03T19:12:27.982956+0000","last_active":"2023-10-03T19:12:28.953719+0000","last_peered":"2023-10-03T19:12:28.953719+0000","last_clean":"2023-10-03T19:12:28.953719+0000","last_became_active":"2023-10-03T19:12:27.982622+0000","last_became_peered":"2023-10-03T19:12:27.982622+0000","last_unstale":"2023-10-03T19:12:28.953719+0000","last_undegraded":"2023-10-03T19:12:28.953719+0000","last_fullsized":"2023-10-03T19:12:28.953719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:58:41.915397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.975198+0000","last_change":"2023-10-03T19:12:27.969233+0000","last_active":"2023-10-03T19:12:27.975198+0000","last_peered":"2023-10-03T19:12:27.975198+0000","last_clean":"2023-10-03T19:12:27.975198+0000","last_became_active":"2023-10-03T19:12:27.968939+0000","last_became_peered":"2023-10-03T19:12:27.968939+0000","last_unstale":"2023-10-03T19:12:27.975198+0000","last_undegraded":"2023-10-03T19:12:27.975198+0000","last_fullsized":"2023-10-03T19:12:27.975198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:27:19.702607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937466+0000","last_change":"2023-10-03T19:12:27.982253+0000","last_active":"2023-10-03T19:12:31.937466+0000","last_peered":"2023-10-03T19:12:31.937466+0000","last_clean":"2023-10-03T19:12:31.937466+0000","last_became_active":"2023-10-03T19:12:27.974654+0000","last_became_peered":"2023-10-03T19:12:27.974654+0000","last_unstale":"2023-10-03T19:12:31.937466+0000","last_undegraded":"2023-10-03T19:12:31.937466+0000","last_fullsized":"2023-10-03T19:12:31.937466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:15:19.668421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.975253+0000","last_change":"2023-10-03T19:12:27.969223+0000","last_active":"2023-10-03T19:12:27.975253+0000","last_peered":"2023-10-03T19:12:27.975253+0000","last_clean":"2023-10-03T19:12:27.975253+0000","last_became_active":"2023-10-03T19:12:27.968920+0000","last_became_peered":"2023-10-03T19:12:27.968920+0000","last_unstale":"2023-10-03T19:12:27.975253+0000","last_undegraded":"2023-10-03T19:12:27.975253+0000","last_fullsized":"2023-10-03T19:12:27.975253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:05:40.727058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938352+0000","last_change":"2023-10-03T19:12:27.594756+0000","last_active":"2023-10-03T19:12:31.938352+0000","last_peered":"2023-10-03T19:12:31.938352+0000","last_clean":"2023-10-03T19:12:31.938352+0000","last_became_active":"2023-10-03T19:12:27.594156+0000","last_became_peered":"2023-10-03T19:12:27.594156+0000","last_unstale":"2023-10-03T19:12:31.938352+0000","last_undegraded":"2023-10-03T19:12:31.938352+0000","last_fullsized":"2023-10-03T19:12:31.938352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:51:27.857657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953302+0000","last_change":"2023-10-03T19:12:27.984997+0000","last_active":"2023-10-03T19:12:28.953302+0000","last_peered":"2023-10-03T19:12:28.953302+0000","last_clean":"2023-10-03T19:12:28.953302+0000","last_became_active":"2023-10-03T19:12:27.984682+0000","last_became_peered":"2023-10-03T19:12:27.984682+0000","last_unstale":"2023-10-03T19:12:28.953302+0000","last_undegraded":"2023-10-03T19:12:28.953302+0000","last_fullsized":"2023-10-03T19:12:28.953302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:29:18.707428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.948688+0000","last_change":"2023-10-03T19:12:27.589809+0000","last_active":"2023-10-03T19:12:27.948688+0000","last_peered":"2023-10-03T19:12:27.948688+0000","last_clean":"2023-10-03T19:12:27.948688+0000","last_became_active":"2023-10-03T19:12:27.589415+0000","last_became_peered":"2023-10-03T19:12:27.589415+0000","last_unstale":"2023-10-03T19:12:27.948688+0000","last_undegraded":"2023-10-03T19:12:27.948688+0000","last_fullsized":"2023-10-03T19:12:27.948688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:32:27.170784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.974645+0000","last_change":"2023-10-03T19:12:27.966910+0000","last_active":"2023-10-03T19:12:27.974645+0000","last_peered":"2023-10-03T19:12:27.974645+0000","last_clean":"2023-10-03T19:12:27.974645+0000","last_became_active":"2023-10-03T19:12:27.966160+0000","last_became_peered":"2023-10-03T19:12:27.966160+0000","last_unstale":"2023-10-03T19:12:27.974645+0000","last_undegraded":"2023-10-03T19:12:27.974645+0000","last_fullsized":"2023-10-03T19:12:27.974645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:19:53.879346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937350+0000","last_change":"2023-10-03T19:12:27.597122+0000","last_active":"2023-10-03T19:12:31.937350+0000","last_peered":"2023-10-03T19:12:31.937350+0000","last_clean":"2023-10-03T19:12:31.937350+0000","last_became_active":"2023-10-03T19:12:27.596367+0000","last_became_peered":"2023-10-03T19:12:27.596367+0000","last_unstale":"2023-10-03T19:12:31.937350+0000","last_undegraded":"2023-10-03T19:12:31.937350+0000","last_fullsized":"2023-10-03T19:12:31.937350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:09:55.002369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.986259+0000","last_change":"2023-10-03T19:12:27.983942+0000","last_active":"2023-10-03T19:12:27.986259+0000","last_peered":"2023-10-03T19:12:27.986259+0000","last_clean":"2023-10-03T19:12:27.986259+0000","last_became_active":"2023-10-03T19:12:27.983600+0000","last_became_peered":"2023-10-03T19:12:27.983600+0000","last_unstale":"2023-10-03T19:12:27.986259+0000","last_undegraded":"2023-10-03T19:12:27.986259+0000","last_fullsized":"2023-10-03T19:12:27.986259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:36:37.362689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'8","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937478+0000","last_change":"2023-10-03T19:12:27.580060+0000","last_active":"2023-10-03T19:12:31.937478+0000","last_peered":"2023-10-03T19:12:31.937478+0000","last_clean":"2023-10-03T19:12:31.937478+0000","last_became_active":"2023-10-03T19:12:27.579250+0000","last_became_peered":"2023-10-03T19:12:27.579250+0000","last_unstale":"2023-10-03T19:12:31.937478+0000","last_undegraded":"2023-10-03T19:12:31.937478+0000","last_fullsized":"2023-10-03T19:12:31.937478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:04:31.510597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938787+0000","last_change":"2023-10-03T19:12:27.597979+0000","last_active":"2023-10-03T19:12:31.938787+0000","last_peered":"2023-10-03T19:12:31.938787+0000","last_clean":"2023-10-03T19:12:31.938787+0000","last_became_active":"2023-10-03T19:12:27.595911+0000","last_became_peered":"2023-10-03T19:12:27.595911+0000","last_unstale":"2023-10-03T19:12:31.938787+0000","last_undegraded":"2023-10-03T19:12:31.938787+0000","last_fullsized":"2023-10-03T19:12:31.938787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:11:28.744038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.951943+0000","last_change":"2023-10-03T19:12:27.978558+0000","last_active":"2023-10-03T19:12:28.951943+0000","last_peered":"2023-10-03T19:12:28.951943+0000","last_clean":"2023-10-03T19:12:28.951943+0000","last_became_active":"2023-10-03T19:12:27.978193+0000","last_became_peered":"2023-10-03T19:12:27.978193+0000","last_unstale":"2023-10-03T19:12:28.951943+0000","last_undegraded":"2023-10-03T19:12:28.951943+0000","last_fullsized":"2023-10-03T19:12:28.951943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:21:27.107002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938789+0000","last_change":"2023-10-03T19:12:27.597785+0000","last_active":"2023-10-03T19:12:31.938789+0000","last_peered":"2023-10-03T19:12:31.938789+0000","last_clean":"2023-10-03T19:12:31.938789+0000","last_became_active":"2023-10-03T19:12:27.596252+0000","last_became_peered":"2023-10-03T19:12:27.596252+0000","last_unstale":"2023-10-03T19:12:31.938789+0000","last_undegraded":"2023-10-03T19:12:31.938789+0000","last_fullsized":"2023-10-03T19:12:31.938789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:55:56.909440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953146+0000","last_change":"2023-10-03T19:12:27.983791+0000","last_active":"2023-10-03T19:12:28.953146+0000","last_peered":"2023-10-03T19:12:28.953146+0000","last_clean":"2023-10-03T19:12:28.953146+0000","last_became_active":"2023-10-03T19:12:27.983498+0000","last_became_peered":"2023-10-03T19:12:27.983498+0000","last_unstale":"2023-10-03T19:12:28.953146+0000","last_undegraded":"2023-10-03T19:12:28.953146+0000","last_fullsized":"2023-10-03T19:12:28.953146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:56:53.031240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938558+0000","last_change":"2023-10-03T19:12:27.597281+0000","last_active":"2023-10-03T19:12:31.938558+0000","last_peered":"2023-10-03T19:12:31.938558+0000","last_clean":"2023-10-03T19:12:31.938558+0000","last_became_active":"2023-10-03T19:12:27.596699+0000","last_became_peered":"2023-10-03T19:12:27.596699+0000","last_unstale":"2023-10-03T19:12:31.938558+0000","last_undegraded":"2023-10-03T19:12:31.938558+0000","last_fullsized":"2023-10-03T19:12:31.938558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:02:43.719408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937888+0000","last_change":"2023-10-03T19:12:27.985128+0000","last_active":"2023-10-03T19:12:31.937888+0000","last_peered":"2023-10-03T19:12:31.937888+0000","last_clean":"2023-10-03T19:12:31.937888+0000","last_became_active":"2023-10-03T19:12:27.984570+0000","last_became_peered":"2023-10-03T19:12:27.984570+0000","last_unstale":"2023-10-03T19:12:31.937888+0000","last_undegraded":"2023-10-03T19:12:31.937888+0000","last_fullsized":"2023-10-03T19:12:31.937888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:23:37.424885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952130+0000","last_change":"2023-10-03T19:12:27.594338+0000","last_active":"2023-10-03T19:12:28.952130+0000","last_peered":"2023-10-03T19:12:28.952130+0000","last_clean":"2023-10-03T19:12:28.952130+0000","last_became_active":"2023-10-03T19:12:27.593882+0000","last_became_peered":"2023-10-03T19:12:27.593882+0000","last_unstale":"2023-10-03T19:12:28.952130+0000","last_undegraded":"2023-10-03T19:12:28.952130+0000","last_fullsized":"2023-10-03T19:12:28.952130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:55:54.733983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.976214+0000","last_change":"2023-10-03T19:12:27.969749+0000","last_active":"2023-10-03T19:12:27.976214+0000","last_peered":"2023-10-03T19:12:27.976214+0000","last_clean":"2023-10-03T19:12:27.976214+0000","last_became_active":"2023-10-03T19:12:27.966817+0000","last_became_peered":"2023-10-03T19:12:27.966817+0000","last_unstale":"2023-10-03T19:12:27.976214+0000","last_undegraded":"2023-10-03T19:12:27.976214+0000","last_fullsized":"2023-10-03T19:12:27.976214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:38:08.924887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.975277+0000","last_change":"2023-10-03T19:12:27.586872+0000","last_active":"2023-10-03T19:12:27.975277+0000","last_peered":"2023-10-03T19:12:27.975277+0000","last_clean":"2023-10-03T19:12:27.975277+0000","last_became_active":"2023-10-03T19:12:27.586119+0000","last_became_peered":"2023-10-03T19:12:27.586119+0000","last_unstale":"2023-10-03T19:12:27.975277+0000","last_undegraded":"2023-10-03T19:12:27.975277+0000","last_fullsized":"2023-10-03T19:12:27.975277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:15:18.658258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953682+0000","last_change":"2023-10-03T19:12:27.964111+0000","last_active":"2023-10-03T19:12:28.953682+0000","last_peered":"2023-10-03T19:12:28.953682+0000","last_clean":"2023-10-03T19:12:28.953682+0000","last_became_active":"2023-10-03T19:12:27.963620+0000","last_became_peered":"2023-10-03T19:12:27.963620+0000","last_unstale":"2023-10-03T19:12:28.953682+0000","last_undegraded":"2023-10-03T19:12:28.953682+0000","last_fullsized":"2023-10-03T19:12:28.953682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:14:25.554969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938077+0000","last_change":"2023-10-03T19:12:27.587990+0000","last_active":"2023-10-03T19:12:31.938077+0000","last_peered":"2023-10-03T19:12:31.938077+0000","last_clean":"2023-10-03T19:12:31.938077+0000","last_became_active":"2023-10-03T19:12:27.587316+0000","last_became_peered":"2023-10-03T19:12:27.587316+0000","last_unstale":"2023-10-03T19:12:31.938077+0000","last_undegraded":"2023-10-03T19:12:31.938077+0000","last_fullsized":"2023-10-03T19:12:31.938077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:08:37.238486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954191+0000","last_change":"2023-10-03T19:12:27.970739+0000","last_active":"2023-10-03T19:12:28.954191+0000","last_peered":"2023-10-03T19:12:28.954191+0000","last_clean":"2023-10-03T19:12:28.954191+0000","last_became_active":"2023-10-03T19:12:27.970408+0000","last_became_peered":"2023-10-03T19:12:27.970408+0000","last_unstale":"2023-10-03T19:12:28.954191+0000","last_undegraded":"2023-10-03T19:12:28.954191+0000","last_fullsized":"2023-10-03T19:12:28.954191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:13:00.937958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953950+0000","last_change":"2023-10-03T19:12:27.580938+0000","last_active":"2023-10-03T19:12:28.953950+0000","last_peered":"2023-10-03T19:12:28.953950+0000","last_clean":"2023-10-03T19:12:28.953950+0000","last_became_active":"2023-10-03T19:12:27.580538+0000","last_became_peered":"2023-10-03T19:12:27.580538+0000","last_unstale":"2023-10-03T19:12:28.953950+0000","last_undegraded":"2023-10-03T19:12:28.953950+0000","last_fullsized":"2023-10-03T19:12:28.953950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:04:48.995090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954372+0000","last_change":"2023-10-03T19:12:27.969234+0000","last_active":"2023-10-03T19:12:28.954372+0000","last_peered":"2023-10-03T19:12:28.954372+0000","last_clean":"2023-10-03T19:12:28.954372+0000","last_became_active":"2023-10-03T19:12:27.968880+0000","last_became_peered":"2023-10-03T19:12:27.968880+0000","last_unstale":"2023-10-03T19:12:28.954372+0000","last_undegraded":"2023-10-03T19:12:28.954372+0000","last_fullsized":"2023-10-03T19:12:28.954372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:09:56.012532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.950828+0000","last_change":"2023-10-03T19:12:27.592296+0000","last_active":"2023-10-03T19:12:27.950828+0000","last_peered":"2023-10-03T19:12:27.950828+0000","last_clean":"2023-10-03T19:12:27.950828+0000","last_became_active":"2023-10-03T19:12:27.588952+0000","last_became_peered":"2023-10-03T19:12:27.588952+0000","last_unstale":"2023-10-03T19:12:27.950828+0000","last_undegraded":"2023-10-03T19:12:27.950828+0000","last_fullsized":"2023-10-03T19:12:27.950828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:02:16.075186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937406+0000","last_change":"2023-10-03T19:12:27.967839+0000","last_active":"2023-10-03T19:12:31.937406+0000","last_peered":"2023-10-03T19:12:31.937406+0000","last_clean":"2023-10-03T19:12:31.937406+0000","last_became_active":"2023-10-03T19:12:27.967281+0000","last_became_peered":"2023-10-03T19:12:27.967281+0000","last_unstale":"2023-10-03T19:12:31.937406+0000","last_undegraded":"2023-10-03T19:12:31.937406+0000","last_fullsized":"2023-10-03T19:12:31.937406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:33:54.388967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":171,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937204+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:12:31.937204+0000","last_peered":"2023-10-03T19:12:31.937204+0000","last_clean":"2023-10-03T19:12:31.937204+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:12:31.937204+0000","last_undegraded":"2023-10-03T19:12:31.937204+0000","last_fullsized":"2023-10-03T19:12:31.937204+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:48:00.062144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.951827+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:12:28.951827+0000","last_peered":"2023-10-03T19:12:28.951827+0000","last_clean":"2023-10-03T19:12:28.951827+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:12:28.951827+0000","last_undegraded":"2023-10-03T19:12:28.951827+0000","last_fullsized":"2023-10-03T19:12:28.951827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:16:13.727679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.948136+0000","last_change":"2023-10-03T19:12:27.592604+0000","last_active":"2023-10-03T19:12:27.948136+0000","last_peered":"2023-10-03T19:12:27.948136+0000","last_clean":"2023-10-03T19:12:27.948136+0000","last_became_active":"2023-10-03T19:12:27.592242+0000","last_became_peered":"2023-10-03T19:12:27.592242+0000","last_unstale":"2023-10-03T19:12:27.948136+0000","last_undegraded":"2023-10-03T19:12:27.948136+0000","last_fullsized":"2023-10-03T19:12:27.948136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:26:38.455074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937821+0000","last_change":"2023-10-03T19:12:27.981742+0000","last_active":"2023-10-03T19:12:31.937821+0000","last_peered":"2023-10-03T19:12:31.937821+0000","last_clean":"2023-10-03T19:12:31.937821+0000","last_became_active":"2023-10-03T19:12:27.981480+0000","last_became_peered":"2023-10-03T19:12:27.981480+0000","last_unstale":"2023-10-03T19:12:31.937821+0000","last_undegraded":"2023-10-03T19:12:31.937821+0000","last_fullsized":"2023-10-03T19:12:31.937821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:32:27.213744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936854+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:12:31.936854+0000","last_peered":"2023-10-03T19:12:31.936854+0000","last_clean":"2023-10-03T19:12:31.936854+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:12:31.936854+0000","last_undegraded":"2023-10-03T19:12:31.936854+0000","last_fullsized":"2023-10-03T19:12:31.936854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:33:49.157041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.947801+0000","last_change":"2023-10-03T19:12:27.594044+0000","last_active":"2023-10-03T19:12:27.947801+0000","last_peered":"2023-10-03T19:12:27.947801+0000","last_clean":"2023-10-03T19:12:27.947801+0000","last_became_active":"2023-10-03T19:12:27.593678+0000","last_became_peered":"2023-10-03T19:12:27.593678+0000","last_unstale":"2023-10-03T19:12:27.947801+0000","last_undegraded":"2023-10-03T19:12:27.947801+0000","last_fullsized":"2023-10-03T19:12:27.947801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:27:39.006980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.976154+0000","last_change":"2023-10-03T19:12:27.969842+0000","last_active":"2023-10-03T19:12:27.976154+0000","last_peered":"2023-10-03T19:12:27.976154+0000","last_clean":"2023-10-03T19:12:27.976154+0000","last_became_active":"2023-10-03T19:12:27.966611+0000","last_became_peered":"2023-10-03T19:12:27.966611+0000","last_unstale":"2023-10-03T19:12:27.976154+0000","last_undegraded":"2023-10-03T19:12:27.976154+0000","last_fullsized":"2023-10-03T19:12:27.976154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:26:05.803303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.947762+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:12:28.947762+0000","last_peered":"2023-10-03T19:12:28.947762+0000","last_clean":"2023-10-03T19:12:28.947762+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:12:28.947762+0000","last_undegraded":"2023-10-03T19:12:28.947762+0000","last_fullsized":"2023-10-03T19:12:28.947762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:24:20.268582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936393+0000","last_change":"2023-10-03T19:12:27.579209+0000","last_active":"2023-10-03T19:12:31.936393+0000","last_peered":"2023-10-03T19:12:31.936393+0000","last_clean":"2023-10-03T19:12:31.936393+0000","last_became_active":"2023-10-03T19:12:27.578633+0000","last_became_peered":"2023-10-03T19:12:27.578633+0000","last_unstale":"2023-10-03T19:12:31.936393+0000","last_undegraded":"2023-10-03T19:12:31.936393+0000","last_fullsized":"2023-10-03T19:12:31.936393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:02:27.868659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937557+0000","last_change":"2023-10-03T19:12:27.966914+0000","last_active":"2023-10-03T19:12:31.937557+0000","last_peered":"2023-10-03T19:12:31.937557+0000","last_clean":"2023-10-03T19:12:31.937557+0000","last_became_active":"2023-10-03T19:12:27.966406+0000","last_became_peered":"2023-10-03T19:12:27.966406+0000","last_unstale":"2023-10-03T19:12:31.937557+0000","last_undegraded":"2023-10-03T19:12:31.937557+0000","last_fullsized":"2023-10-03T19:12:31.937557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:39:07.804995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953153+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:12:28.953153+0000","last_peered":"2023-10-03T19:12:28.953153+0000","last_clean":"2023-10-03T19:12:28.953153+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:12:28.953153+0000","last_undegraded":"2023-10-03T19:12:28.953153+0000","last_fullsized":"2023-10-03T19:12:28.953153+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:50:46.706999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954915+0000","last_change":"2023-10-03T19:12:27.586703+0000","last_active":"2023-10-03T19:12:28.954915+0000","last_peered":"2023-10-03T19:12:28.954915+0000","last_clean":"2023-10-03T19:12:28.954915+0000","last_became_active":"2023-10-03T19:12:27.586241+0000","last_became_peered":"2023-10-03T19:12:27.586241+0000","last_unstale":"2023-10-03T19:12:28.954915+0000","last_undegraded":"2023-10-03T19:12:28.954915+0000","last_fullsized":"2023-10-03T19:12:28.954915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:23:42.273581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936826+0000","last_change":"2023-10-03T19:12:27.972058+0000","last_active":"2023-10-03T19:12:31.936826+0000","last_peered":"2023-10-03T19:12:31.936826+0000","last_clean":"2023-10-03T19:12:31.936826+0000","last_became_active":"2023-10-03T19:12:27.971770+0000","last_became_peered":"2023-10-03T19:12:27.971770+0000","last_unstale":"2023-10-03T19:12:31.936826+0000","last_undegraded":"2023-10-03T19:12:31.936826+0000","last_fullsized":"2023-10-03T19:12:31.936826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:06:02.160141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952764+0000","last_change":"2023-10-03T19:12:27.595105+0000","last_active":"2023-10-03T19:12:28.952764+0000","last_peered":"2023-10-03T19:12:28.952764+0000","last_clean":"2023-10-03T19:12:28.952764+0000","last_became_active":"2023-10-03T19:12:27.594748+0000","last_became_peered":"2023-10-03T19:12:27.594748+0000","last_unstale":"2023-10-03T19:12:28.952764+0000","last_undegraded":"2023-10-03T19:12:28.952764+0000","last_fullsized":"2023-10-03T19:12:28.952764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:43:24.586460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937036+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:12:31.937036+0000","last_peered":"2023-10-03T19:12:31.937036+0000","last_clean":"2023-10-03T19:12:31.937036+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:12:31.937036+0000","last_undegraded":"2023-10-03T19:12:31.937036+0000","last_fullsized":"2023-10-03T19:12:31.937036+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:50:20.553324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937627+0000","last_change":"2023-10-03T19:12:27.966147+0000","last_active":"2023-10-03T19:12:31.937627+0000","last_peered":"2023-10-03T19:12:31.937627+0000","last_clean":"2023-10-03T19:12:31.937627+0000","last_became_active":"2023-10-03T19:12:27.965865+0000","last_became_peered":"2023-10-03T19:12:27.965865+0000","last_unstale":"2023-10-03T19:12:31.937627+0000","last_undegraded":"2023-10-03T19:12:31.937627+0000","last_fullsized":"2023-10-03T19:12:31.937627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:04:50.005254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936963+0000","last_change":"2023-10-03T19:12:27.581597+0000","last_active":"2023-10-03T19:12:31.936963+0000","last_peered":"2023-10-03T19:12:31.936963+0000","last_clean":"2023-10-03T19:12:31.936963+0000","last_became_active":"2023-10-03T19:12:27.581015+0000","last_became_peered":"2023-10-03T19:12:27.581015+0000","last_unstale":"2023-10-03T19:12:31.936963+0000","last_undegraded":"2023-10-03T19:12:31.936963+0000","last_fullsized":"2023-10-03T19:12:31.936963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:58:40.905233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938993+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:12:31.938993+0000","last_peered":"2023-10-03T19:12:31.938993+0000","last_clean":"2023-10-03T19:12:31.938993+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:12:31.938993+0000","last_undegraded":"2023-10-03T19:12:31.938993+0000","last_fullsized":"2023-10-03T19:12:31.938993+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:13:27.600123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.974615+0000","last_change":"2023-10-03T19:12:27.964905+0000","last_active":"2023-10-03T19:12:27.974615+0000","last_peered":"2023-10-03T19:12:27.974615+0000","last_clean":"2023-10-03T19:12:27.974615+0000","last_became_active":"2023-10-03T19:12:27.964614+0000","last_became_peered":"2023-10-03T19:12:27.964614+0000","last_unstale":"2023-10-03T19:12:27.974615+0000","last_undegraded":"2023-10-03T19:12:27.974615+0000","last_fullsized":"2023-10-03T19:12:27.974615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:12:10.609586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.984212+0000","last_change":"2023-10-03T19:12:27.588155+0000","last_active":"2023-10-03T19:12:27.984212+0000","last_peered":"2023-10-03T19:12:27.984212+0000","last_clean":"2023-10-03T19:12:27.984212+0000","last_became_active":"2023-10-03T19:12:27.587340+0000","last_became_peered":"2023-10-03T19:12:27.587340+0000","last_unstale":"2023-10-03T19:12:27.984212+0000","last_undegraded":"2023-10-03T19:12:27.984212+0000","last_fullsized":"2023-10-03T19:12:27.984212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:24:24.490344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937821+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:12:31.937821+0000","last_peered":"2023-10-03T19:12:31.937821+0000","last_clean":"2023-10-03T19:12:31.937821+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:12:31.937821+0000","last_undegraded":"2023-10-03T19:12:31.937821+0000","last_fullsized":"2023-10-03T19:12:31.937821+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:36:31.470355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.979909+0000","last_change":"2023-10-03T19:12:27.977940+0000","last_active":"2023-10-03T19:12:27.979909+0000","last_peered":"2023-10-03T19:12:27.979909+0000","last_clean":"2023-10-03T19:12:27.979909+0000","last_became_active":"2023-10-03T19:12:27.977495+0000","last_became_peered":"2023-10-03T19:12:27.977495+0000","last_unstale":"2023-10-03T19:12:27.979909+0000","last_undegraded":"2023-10-03T19:12:27.979909+0000","last_fullsized":"2023-10-03T19:12:27.979909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:34:17.232441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.949197+0000","last_change":"2023-10-03T19:12:27.583954+0000","last_active":"2023-10-03T19:12:27.949197+0000","last_peered":"2023-10-03T19:12:27.949197+0000","last_clean":"2023-10-03T19:12:27.949197+0000","last_became_active":"2023-10-03T19:12:27.583313+0000","last_became_peered":"2023-10-03T19:12:27.583313+0000","last_unstale":"2023-10-03T19:12:27.949197+0000","last_undegraded":"2023-10-03T19:12:27.949197+0000","last_fullsized":"2023-10-03T19:12:27.949197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:25:10.249460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938105+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:12:31.938105+0000","last_peered":"2023-10-03T19:12:31.938105+0000","last_clean":"2023-10-03T19:12:31.938105+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:12:31.938105+0000","last_undegraded":"2023-10-03T19:12:31.938105+0000","last_fullsized":"2023-10-03T19:12:31.938105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:56:47.799314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953723+0000","last_change":"2023-10-03T19:12:27.961343+0000","last_active":"2023-10-03T19:12:28.953723+0000","last_peered":"2023-10-03T19:12:28.953723+0000","last_clean":"2023-10-03T19:12:28.953723+0000","last_became_active":"2023-10-03T19:12:27.961065+0000","last_became_peered":"2023-10-03T19:12:27.961065+0000","last_unstale":"2023-10-03T19:12:28.953723+0000","last_undegraded":"2023-10-03T19:12:28.953723+0000","last_fullsized":"2023-10-03T19:12:28.953723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:50:25.785249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954854+0000","last_change":"2023-10-03T19:12:27.975142+0000","last_active":"2023-10-03T19:12:28.954854+0000","last_peered":"2023-10-03T19:12:28.954854+0000","last_clean":"2023-10-03T19:12:28.954854+0000","last_became_active":"2023-10-03T19:12:27.974173+0000","last_became_peered":"2023-10-03T19:12:27.974173+0000","last_unstale":"2023-10-03T19:12:28.954854+0000","last_undegraded":"2023-10-03T19:12:28.954854+0000","last_fullsized":"2023-10-03T19:12:28.954854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:02:44.729572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'6","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953832+0000","last_change":"2023-10-03T19:12:27.586506+0000","last_active":"2023-10-03T19:12:28.953832+0000","last_peered":"2023-10-03T19:12:28.953832+0000","last_clean":"2023-10-03T19:12:28.953832+0000","last_became_active":"2023-10-03T19:12:27.585847+0000","last_became_peered":"2023-10-03T19:12:27.585847+0000","last_unstale":"2023-10-03T19:12:28.953832+0000","last_undegraded":"2023-10-03T19:12:28.953832+0000","last_fullsized":"2023-10-03T19:12:28.953832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:33:53.378803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937279+0000","last_change":"2023-10-03T19:12:27.973591+0000","last_active":"2023-10-03T19:12:31.937279+0000","last_peered":"2023-10-03T19:12:31.937279+0000","last_clean":"2023-10-03T19:12:31.937279+0000","last_became_active":"2023-10-03T19:12:27.973308+0000","last_became_peered":"2023-10-03T19:12:27.973308+0000","last_unstale":"2023-10-03T19:12:31.937279+0000","last_undegraded":"2023-10-03T19:12:31.937279+0000","last_fullsized":"2023-10-03T19:12:31.937279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:40:40.179631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938677+0000","last_change":"2023-10-03T19:12:27.595373+0000","last_active":"2023-10-03T19:12:31.938677+0000","last_peered":"2023-10-03T19:12:31.938677+0000","last_clean":"2023-10-03T19:12:31.938677+0000","last_became_active":"2023-10-03T19:12:27.594761+0000","last_became_peered":"2023-10-03T19:12:27.594761+0000","last_unstale":"2023-10-03T19:12:31.938677+0000","last_undegraded":"2023-10-03T19:12:31.938677+0000","last_fullsized":"2023-10-03T19:12:31.938677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:23:42.273581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952982+0000","last_change":"2023-10-03T19:12:27.585305+0000","last_active":"2023-10-03T19:12:28.952982+0000","last_peered":"2023-10-03T19:12:28.952982+0000","last_clean":"2023-10-03T19:12:28.952982+0000","last_became_active":"2023-10-03T19:12:27.584635+0000","last_became_peered":"2023-10-03T19:12:27.584635+0000","last_unstale":"2023-10-03T19:12:28.952982+0000","last_undegraded":"2023-10-03T19:12:28.952982+0000","last_fullsized":"2023-10-03T19:12:28.952982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:37:44.604456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.980138+0000","last_change":"2023-10-03T19:12:27.978707+0000","last_active":"2023-10-03T19:12:27.980138+0000","last_peered":"2023-10-03T19:12:27.980138+0000","last_clean":"2023-10-03T19:12:27.980138+0000","last_became_active":"2023-10-03T19:12:27.978433+0000","last_became_peered":"2023-10-03T19:12:27.978433+0000","last_unstale":"2023-10-03T19:12:27.980138+0000","last_undegraded":"2023-10-03T19:12:27.980138+0000","last_fullsized":"2023-10-03T19:12:27.980138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:20:38.469750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.952762+0000","last_change":"2023-10-03T19:12:27.592047+0000","last_active":"2023-10-03T19:12:27.952762+0000","last_peered":"2023-10-03T19:12:27.952762+0000","last_clean":"2023-10-03T19:12:27.952762+0000","last_became_active":"2023-10-03T19:12:27.591625+0000","last_became_peered":"2023-10-03T19:12:27.591625+0000","last_unstale":"2023-10-03T19:12:27.952762+0000","last_undegraded":"2023-10-03T19:12:27.952762+0000","last_fullsized":"2023-10-03T19:12:27.952762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:10:01.648289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.985378+0000","last_change":"2023-10-03T19:12:27.982932+0000","last_active":"2023-10-03T19:12:27.985378+0000","last_peered":"2023-10-03T19:12:27.985378+0000","last_clean":"2023-10-03T19:12:27.985378+0000","last_became_active":"2023-10-03T19:12:27.982612+0000","last_became_peered":"2023-10-03T19:12:27.982612+0000","last_unstale":"2023-10-03T19:12:27.985378+0000","last_undegraded":"2023-10-03T19:12:27.985378+0000","last_fullsized":"2023-10-03T19:12:27.985378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:32:28.423427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937987+0000","last_change":"2023-10-03T19:12:27.974833+0000","last_active":"2023-10-03T19:12:31.937987+0000","last_peered":"2023-10-03T19:12:31.937987+0000","last_clean":"2023-10-03T19:12:31.937987+0000","last_became_active":"2023-10-03T19:12:27.973932+0000","last_became_peered":"2023-10-03T19:12:27.973932+0000","last_unstale":"2023-10-03T19:12:31.937987+0000","last_undegraded":"2023-10-03T19:12:31.937987+0000","last_fullsized":"2023-10-03T19:12:31.937987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:20:24.642279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.952654+0000","last_change":"2023-10-03T19:12:27.592021+0000","last_active":"2023-10-03T19:12:27.952654+0000","last_peered":"2023-10-03T19:12:27.952654+0000","last_clean":"2023-10-03T19:12:27.952654+0000","last_became_active":"2023-10-03T19:12:27.589194+0000","last_became_peered":"2023-10-03T19:12:27.589194+0000","last_unstale":"2023-10-03T19:12:27.952654+0000","last_undegraded":"2023-10-03T19:12:27.952654+0000","last_fullsized":"2023-10-03T19:12:27.952654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:54:40.090498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.979286+0000","last_change":"2023-10-03T19:12:27.978101+0000","last_active":"2023-10-03T19:12:27.979286+0000","last_peered":"2023-10-03T19:12:27.979286+0000","last_clean":"2023-10-03T19:12:27.979286+0000","last_became_active":"2023-10-03T19:12:27.977700+0000","last_became_peered":"2023-10-03T19:12:27.977700+0000","last_unstale":"2023-10-03T19:12:27.979286+0000","last_undegraded":"2023-10-03T19:12:27.979286+0000","last_fullsized":"2023-10-03T19:12:27.979286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:01:03.468673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936430+0000","last_change":"2023-10-03T19:12:27.578433+0000","last_active":"2023-10-03T19:12:31.936430+0000","last_peered":"2023-10-03T19:12:31.936430+0000","last_clean":"2023-10-03T19:12:31.936430+0000","last_became_active":"2023-10-03T19:12:27.577627+0000","last_became_peered":"2023-10-03T19:12:27.577627+0000","last_unstale":"2023-10-03T19:12:31.936430+0000","last_undegraded":"2023-10-03T19:12:31.936430+0000","last_fullsized":"2023-10-03T19:12:31.936430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:42:02.193854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.986241+0000","last_change":"2023-10-03T19:12:27.983570+0000","last_active":"2023-10-03T19:12:27.986241+0000","last_peered":"2023-10-03T19:12:27.986241+0000","last_clean":"2023-10-03T19:12:27.986241+0000","last_became_active":"2023-10-03T19:12:27.983296+0000","last_became_peered":"2023-10-03T19:12:27.983296+0000","last_unstale":"2023-10-03T19:12:27.986241+0000","last_undegraded":"2023-10-03T19:12:27.986241+0000","last_fullsized":"2023-10-03T19:12:27.986241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:13:22.936261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953770+0000","last_change":"2023-10-03T19:12:27.577852+0000","last_active":"2023-10-03T19:12:28.953770+0000","last_peered":"2023-10-03T19:12:28.953770+0000","last_clean":"2023-10-03T19:12:28.953770+0000","last_became_active":"2023-10-03T19:12:27.576792+0000","last_became_peered":"2023-10-03T19:12:27.576792+0000","last_unstale":"2023-10-03T19:12:28.953770+0000","last_undegraded":"2023-10-03T19:12:28.953770+0000","last_fullsized":"2023-10-03T19:12:28.953770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:40:39.169467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.947561+0000","last_change":"2023-10-03T19:12:27.983619+0000","last_active":"2023-10-03T19:12:28.947561+0000","last_peered":"2023-10-03T19:12:28.947561+0000","last_clean":"2023-10-03T19:12:28.947561+0000","last_became_active":"2023-10-03T19:12:27.983185+0000","last_became_peered":"2023-10-03T19:12:27.983185+0000","last_unstale":"2023-10-03T19:12:28.947561+0000","last_undegraded":"2023-10-03T19:12:28.947561+0000","last_fullsized":"2023-10-03T19:12:28.947561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:02:11.328680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.979861+0000","last_change":"2023-10-03T19:12:27.593678+0000","last_active":"2023-10-03T19:12:27.979861+0000","last_peered":"2023-10-03T19:12:27.979861+0000","last_clean":"2023-10-03T19:12:27.979861+0000","last_became_active":"2023-10-03T19:12:27.593376+0000","last_became_peered":"2023-10-03T19:12:27.593376+0000","last_unstale":"2023-10-03T19:12:27.979861+0000","last_undegraded":"2023-10-03T19:12:27.979861+0000","last_fullsized":"2023-10-03T19:12:27.979861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:44:45.554309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954797+0000","last_change":"2023-10-03T19:12:27.962395+0000","last_active":"2023-10-03T19:12:28.954797+0000","last_peered":"2023-10-03T19:12:28.954797+0000","last_clean":"2023-10-03T19:12:28.954797+0000","last_became_active":"2023-10-03T19:12:27.962105+0000","last_became_peered":"2023-10-03T19:12:27.962105+0000","last_unstale":"2023-10-03T19:12:28.954797+0000","last_undegraded":"2023-10-03T19:12:28.954797+0000","last_fullsized":"2023-10-03T19:12:28.954797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:51:28.867821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952027+0000","last_change":"2023-10-03T19:12:27.588675+0000","last_active":"2023-10-03T19:12:28.952027+0000","last_peered":"2023-10-03T19:12:28.952027+0000","last_clean":"2023-10-03T19:12:28.952027+0000","last_became_active":"2023-10-03T19:12:27.588046+0000","last_became_peered":"2023-10-03T19:12:27.588046+0000","last_unstale":"2023-10-03T19:12:28.952027+0000","last_undegraded":"2023-10-03T19:12:28.952027+0000","last_fullsized":"2023-10-03T19:12:28.952027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:08:47.585355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953482+0000","last_change":"2023-10-03T19:12:27.965478+0000","last_active":"2023-10-03T19:12:28.953482+0000","last_peered":"2023-10-03T19:12:28.953482+0000","last_clean":"2023-10-03T19:12:28.953482+0000","last_became_active":"2023-10-03T19:12:27.964064+0000","last_became_peered":"2023-10-03T19:12:27.964064+0000","last_unstale":"2023-10-03T19:12:28.953482+0000","last_undegraded":"2023-10-03T19:12:28.953482+0000","last_fullsized":"2023-10-03T19:12:28.953482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:02:28.878823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952596+0000","last_change":"2023-10-03T19:12:27.587343+0000","last_active":"2023-10-03T19:12:28.952596+0000","last_peered":"2023-10-03T19:12:28.952596+0000","last_clean":"2023-10-03T19:12:28.952596+0000","last_became_active":"2023-10-03T19:12:27.586953+0000","last_became_peered":"2023-10-03T19:12:27.586953+0000","last_unstale":"2023-10-03T19:12:28.952596+0000","last_undegraded":"2023-10-03T19:12:28.952596+0000","last_fullsized":"2023-10-03T19:12:28.952596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:01:57.712265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.975219+0000","last_change":"2023-10-03T19:12:27.970441+0000","last_active":"2023-10-03T19:12:27.975219+0000","last_peered":"2023-10-03T19:12:27.975219+0000","last_clean":"2023-10-03T19:12:27.975219+0000","last_became_active":"2023-10-03T19:12:27.970137+0000","last_became_peered":"2023-10-03T19:12:27.970137+0000","last_unstale":"2023-10-03T19:12:27.975219+0000","last_undegraded":"2023-10-03T19:12:27.975219+0000","last_fullsized":"2023-10-03T19:12:27.975219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:01:09.556791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.972925+0000","last_change":"2023-10-03T19:12:27.586020+0000","last_active":"2023-10-03T19:12:27.972925+0000","last_peered":"2023-10-03T19:12:27.972925+0000","last_clean":"2023-10-03T19:12:27.972925+0000","last_became_active":"2023-10-03T19:12:27.585736+0000","last_became_peered":"2023-10-03T19:12:27.585736+0000","last_unstale":"2023-10-03T19:12:27.972925+0000","last_undegraded":"2023-10-03T19:12:27.972925+0000","last_fullsized":"2023-10-03T19:12:27.972925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:09:55.424188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.951761+0000","last_change":"2023-10-03T19:12:27.986822+0000","last_active":"2023-10-03T19:12:28.951761+0000","last_peered":"2023-10-03T19:12:28.951761+0000","last_clean":"2023-10-03T19:12:28.951761+0000","last_became_active":"2023-10-03T19:12:27.986532+0000","last_became_peered":"2023-10-03T19:12:27.986532+0000","last_unstale":"2023-10-03T19:12:28.951761+0000","last_undegraded":"2023-10-03T19:12:28.951761+0000","last_fullsized":"2023-10-03T19:12:28.951761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:20:24.642279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T19:12:27.976701+0000","last_change":"2023-10-03T19:12:27.591787+0000","last_active":"2023-10-03T19:12:27.976701+0000","last_peered":"2023-10-03T19:12:27.976701+0000","last_clean":"2023-10-03T19:12:27.976701+0000","last_became_active":"2023-10-03T19:12:27.591472+0000","last_became_peered":"2023-10-03T19:12:27.591472+0000","last_unstale":"2023-10-03T19:12:27.976701+0000","last_undegraded":"2023-10-03T19:12:27.976701+0000","last_fullsized":"2023-10-03T19:12:27.976701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:35:42.979095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8944,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362896,"statfs":{"total":96636764160,"available":96627605504,"internally_reserved":0,"allocated":303104,"data_stored":667065,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]}]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8336,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363504,"statfs":{"total":96636764160,"available":96628228096,"internally_reserved":0,"allocated":204800,"data_stored":73753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8436,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363404,"statfs":{"total":96636764160,"available":96628125696,"internally_reserved":0,"allocated":241664,"data_stored":83190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]}]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12444,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":12224,"kb_avail":94359396,"statfs":{"total":96636764160,"available":96624021504,"internally_reserved":0,"allocated":217088,"data_stored":80406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12517376},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8404,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363436,"statfs":{"total":96636764160,"available":96628158464,"internally_reserved":0,"allocated":208896,"data_stored":74917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8408,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363432,"statfs":{"total":96636764160,"available":96628154368,"internally_reserved":0,"allocated":212992,"data_stored":75007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8360,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363480,"statfs":{"total":96636764160,"available":96628203520,"internally_reserved":0,"allocated":229376,"data_stored":82222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13012,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":12736,"kb_avail":94358828,"statfs":{"total":96636764160,"available":96623439872,"internally_reserved":0,"allocated":274432,"data_stored":664703,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":13041664},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4410000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:12:36.467 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:12:36.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.597+0000 7f4ea631a640 1 Processor -- start 2023-10-03T19:12:36.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.597+0000 7f4ea631a640 1 -- start start 2023-10-03T19:12:36.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.601+0000 7f4ea631a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4ea00bc8b0 0x7f4ea014ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:36.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.601+0000 7f4ea631a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ea006d170 0x7f4ea014cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:36.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.601+0000 7f4ea631a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ea006cac0 con 0x7f4ea006f170 2023-10-03T19:12:36.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.601+0000 7f4ea631a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea014d4f0 con 0x7f4ea00bc8b0 2023-10-03T19:12:36.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.601+0000 7f4ea631a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea00720d0 con 0x7f4ea006d170 2023-10-03T19:12:36.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.601+0000 7f4e9ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4ea006f170 0x7f4ea0150190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33418/0 (socket says 172.21.15.45:33418) 2023-10-03T19:12:36.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.601+0000 7f4e9ffff640 1 -- 172.21.15.45:0/3586618578 learned_addr learned my addr 172.21.15.45:0/3586618578 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:36.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.601+0000 7f4e9f7fe640 1 --2- 172.21.15.45:0/3586618578 >> v2:172.21.15.45:3300/0 conn(0x7f4ea00bc8b0 0x7f4ea014ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:36.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.601+0000 7f4ea48b7640 1 --2- 172.21.15.45:0/3586618578 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ea006d170 0x7f4ea014cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:36.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.601+0000 7f4e9effd640 1 -- 172.21.15.45:0/3586618578 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2112310606 0 0) 0x7f4e90001120 con 0x7f4ea006f170 2023-10-03T19:12:36.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.601+0000 7f4e9effd640 1 -- 172.21.15.45:0/3586618578 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e88003530 con 0x7f4ea006f170 2023-10-03T19:12:36.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.601+0000 7f4e9f7fe640 1 -- 172.21.15.45:0/3586618578 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ea006d170 msgr2=0x7f4ea014cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:36.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.601+0000 7f4e9f7fe640 1 --2- 172.21.15.45:0/3586618578 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ea006d170 0x7f4ea014cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:36.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.601+0000 7f4e9f7fe640 1 -- 172.21.15.45:0/3586618578 >> v1:172.21.15.45:6789/0 conn(0x7f4ea006f170 legacy=0x7f4ea0150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:36.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.601+0000 7f4e9f7fe640 1 -- 172.21.15.45:0/3586618578 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea00a5ab0 con 0x7f4ea00bc8b0 2023-10-03T19:12:36.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.601+0000 7f4e9f7fe640 1 --2- 172.21.15.45:0/3586618578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ea00bc8b0 0x7f4ea014ca70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4e940097c0 tx=0x7f4e9401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707fdf85f459ea60 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:36.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.601+0000 7f4e9effd640 1 -- 172.21.15.45:0/3586618578 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e940a8970 con 0x7f4ea00bc8b0 2023-10-03T19:12:36.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.601+0000 7f4e9effd640 1 -- 172.21.15.45:0/3586618578 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e940a8ad0 con 0x7f4ea00bc8b0 2023-10-03T19:12:36.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.601+0000 7f4e9effd640 1 -- 172.21.15.45:0/3586618578 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e940a8e60 con 0x7f4ea00bc8b0 2023-10-03T19:12:36.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4ea631a640 1 -- 172.21.15.45:0/3586618578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ea00bc8b0 msgr2=0x7f4ea014ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:36.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4ea631a640 1 --2- 172.21.15.45:0/3586618578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ea00bc8b0 0x7f4ea014ca70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4e940097c0 tx=0x7f4e9401ec70 comp rx=0 tx=0).stop 2023-10-03T19:12:36.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4ea631a640 1 -- 172.21.15.45:0/3586618578 shutdown_connections 2023-10-03T19:12:36.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4ea631a640 1 --2- 172.21.15.45:0/3586618578 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ea006d170 0x7f4ea014cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:36.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4ea631a640 1 --2- 172.21.15.45:0/3586618578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ea00bc8b0 0x7f4ea014ca70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:36.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4ea631a640 1 -- 172.21.15.45:0/3586618578 >> 172.21.15.45:0/3586618578 conn(0x7f4ea00bcf50 msgr2=0x7f4ea00bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:36.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4ea631a640 1 -- 172.21.15.45:0/3586618578 shutdown_connections 2023-10-03T19:12:36.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4ea631a640 1 -- 172.21.15.45:0/3586618578 wait complete. 2023-10-03T19:12:36.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4ea631a640 1 Processor -- start 2023-10-03T19:12:36.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4ea631a640 1 -- start start 2023-10-03T19:12:36.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4ea631a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ea006d170 0x7f4ea0147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:36.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4ea631a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ea006f170 0x7f4ea0146610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:36.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4ea631a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ea00bc8b0 0x7f4ea0141810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:36.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4ea631a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea01e5770 con 0x7f4ea006d170 2023-10-03T19:12:36.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4ea631a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea0145da0 con 0x7f4ea006f170 2023-10-03T19:12:36.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4ea631a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea01e5390 con 0x7f4ea00bc8b0 2023-10-03T19:12:36.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4e9ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ea006d170 0x7f4ea0147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:36.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4e9ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ea006d170 0x7f4ea0147ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41458/0 (socket says 172.21.15.45:41458) 2023-10-03T19:12:36.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4e9ffff640 1 -- 172.21.15.45:0/2428152806 learned_addr learned my addr 172.21.15.45:0/2428152806 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:36.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4e9f7fe640 1 --2- 172.21.15.45:0/2428152806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ea006f170 0x7f4ea0146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:36.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4ea48b7640 1 --2- 172.21.15.45:0/2428152806 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ea00bc8b0 0x7f4ea0141810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:36.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4e9ffff640 1 -- 172.21.15.45:0/2428152806 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ea00bc8b0 msgr2=0x7f4ea0141810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:36.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4e9ffff640 1 --2- 172.21.15.45:0/2428152806 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ea00bc8b0 0x7f4ea0141810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:36.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4e9ffff640 1 -- 172.21.15.45:0/2428152806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ea006f170 msgr2=0x7f4ea0146610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:36.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4e9ffff640 1 --2- 172.21.15.45:0/2428152806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ea006f170 0x7f4ea0146610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:36.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4e9ffff640 1 -- 172.21.15.45:0/2428152806 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e94009420 con 0x7f4ea006d170 2023-10-03T19:12:36.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4e9f7fe640 1 --2- 172.21.15.45:0/2428152806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ea006f170 0x7f4ea0146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:36.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4ea48b7640 1 --2- 172.21.15.45:0/2428152806 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ea00bc8b0 0x7f4ea0141810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:36.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4e9ffff640 1 --2- 172.21.15.45:0/2428152806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ea006d170 0x7f4ea0147ee0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4e9000c4d0 tx=0x7f4e9000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:36.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4e9cff9640 1 -- 172.21.15.45:0/2428152806 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e90005cf0 con 0x7f4ea006d170 2023-10-03T19:12:36.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4e9cff9640 1 -- 172.21.15.45:0/2428152806 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e90005e50 con 0x7f4ea006d170 2023-10-03T19:12:36.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4e9cff9640 1 -- 172.21.15.45:0/2428152806 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e90007290 con 0x7f4ea006d170 2023-10-03T19:12:36.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4ea631a640 1 -- 172.21.15.45:0/2428152806 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea014fae0 con 0x7f4ea006d170 2023-10-03T19:12:36.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.605+0000 7f4ea631a640 1 -- 172.21.15.45:0/2428152806 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea006cd00 con 0x7f4ea006d170 2023-10-03T19:12:36.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.609+0000 7f4ea631a640 1 -- 172.21.15.45:0/2428152806 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea006d660 con 0x7f4ea006d170 2023-10-03T19:12:36.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.609+0000 7f4e9cff9640 1 -- 172.21.15.45:0/2428152806 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4e900073f0 con 0x7f4ea006d170 2023-10-03T19:12:36.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.609+0000 7f4e9cff9640 1 --2- 172.21.15.45:0/2428152806 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4e8c066280 0x7f4e8c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:36.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.609+0000 7f4e9cff9640 1 -- 172.21.15.45:0/2428152806 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4e90083170 con 0x7f4ea006d170 2023-10-03T19:12:36.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.609+0000 7f4e9f7fe640 1 --2- 172.21.15.45:0/2428152806 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4e8c066280 0x7f4e8c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:36.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.609+0000 7f4e9f7fe640 1 --2- 172.21.15.45:0/2428152806 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4e8c066280 0x7f4e8c068730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4e940b2000 tx=0x7f4e940aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:36.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.613+0000 7f4e9cff9640 1 -- 172.21.15.45:0/2428152806 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4e900505f0 con 0x7f4ea006d170 2023-10-03T19:12:36.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.765+0000 7f4ea631a640 1 -- 172.21.15.45:0/2428152806 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4ea01416a0 con 0x7f4e8c066280 2023-10-03T19:12:36.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.785+0000 7f4e9cff9640 1 -- 172.21.15.45:0/2428152806 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286731 (secure 0 0 0) 0x7f4ea01416a0 con 0x7f4e8c066280 2023-10-03T19:12:36.794 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:36.796 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:12:36.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.789+0000 7f4ea631a640 1 -- 172.21.15.45:0/2428152806 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4e8c066280 msgr2=0x7f4e8c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:36.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.789+0000 7f4ea631a640 1 --2- 172.21.15.45:0/2428152806 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4e8c066280 0x7f4e8c068730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4e940b2000 tx=0x7f4e940aa070 comp rx=0 tx=0).stop 2023-10-03T19:12:36.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.789+0000 7f4ea631a640 1 -- 172.21.15.45:0/2428152806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ea006d170 msgr2=0x7f4ea0147ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:36.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.789+0000 7f4ea631a640 1 --2- 172.21.15.45:0/2428152806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ea006d170 0x7f4ea0147ee0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4e9000c4d0 tx=0x7f4e9000c990 comp rx=0 tx=0).stop 2023-10-03T19:12:36.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.789+0000 7f4ea631a640 1 -- 172.21.15.45:0/2428152806 shutdown_connections 2023-10-03T19:12:36.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.789+0000 7f4ea631a640 1 --2- 172.21.15.45:0/2428152806 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4e8c066280 0x7f4e8c068730 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:36.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.789+0000 7f4ea631a640 1 --2- 172.21.15.45:0/2428152806 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ea00bc8b0 0x7f4ea0141810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:36.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.789+0000 7f4ea631a640 1 --2- 172.21.15.45:0/2428152806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ea006f170 0x7f4ea0146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:36.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.789+0000 7f4ea631a640 1 --2- 172.21.15.45:0/2428152806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ea006d170 0x7f4ea0147ee0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:36.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.789+0000 7f4ea631a640 1 -- 172.21.15.45:0/2428152806 >> 172.21.15.45:0/2428152806 conn(0x7f4ea00bcf50 msgr2=0x7f4ea014d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:36.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.789+0000 7f4ea631a640 1 -- 172.21.15.45:0/2428152806 shutdown_connections 2023-10-03T19:12:36.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.789+0000 7f4ea631a640 1 -- 172.21.15.45:0/2428152806 wait complete. 2023-10-03T19:12:36.812 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-03T19:12:36.442166+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":201,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":76368,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":74432,"kb_avail":754898352,"statfs":{"total":773094113280,"available":773015912448,"internally_reserved":0,"allocated":1916928,"data_stored":1814569,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":76218368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.496271"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.947798+0000","last_change":"2023-10-03T19:12:27.968561+0000","last_active":"2023-10-03T19:12:28.947798+0000","last_peered":"2023-10-03T19:12:28.947798+0000","last_clean":"2023-10-03T19:12:28.947798+0000","last_became_active":"2023-10-03T19:12:27.968018+0000","last_became_peered":"2023-10-03T19:12:27.968018+0000","last_unstale":"2023-10-03T19:12:28.947798+0000","last_undegraded":"2023-10-03T19:12:28.947798+0000","last_fullsized":"2023-10-03T19:12:28.947798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:02:17.085349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954200+0000","last_change":"2023-10-03T19:12:27.970081+0000","last_active":"2023-10-03T19:12:28.954200+0000","last_peered":"2023-10-03T19:12:28.954200+0000","last_clean":"2023-10-03T19:12:28.954200+0000","last_became_active":"2023-10-03T19:12:27.969751+0000","last_became_peered":"2023-10-03T19:12:27.969751+0000","last_unstale":"2023-10-03T19:12:28.954200+0000","last_undegraded":"2023-10-03T19:12:28.954200+0000","last_fullsized":"2023-10-03T19:12:28.954200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:51:23.880877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953910+0000","last_change":"2023-10-03T19:12:27.962924+0000","last_active":"2023-10-03T19:12:28.953910+0000","last_peered":"2023-10-03T19:12:28.953910+0000","last_clean":"2023-10-03T19:12:28.953910+0000","last_became_active":"2023-10-03T19:12:27.962634+0000","last_became_peered":"2023-10-03T19:12:27.962634+0000","last_unstale":"2023-10-03T19:12:28.953910+0000","last_undegraded":"2023-10-03T19:12:28.953910+0000","last_fullsized":"2023-10-03T19:12:28.953910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:39:07.804995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937912+0000","last_change":"2023-10-03T19:12:27.972848+0000","last_active":"2023-10-03T19:12:31.937912+0000","last_peered":"2023-10-03T19:12:31.937912+0000","last_clean":"2023-10-03T19:12:31.937912+0000","last_became_active":"2023-10-03T19:12:27.972451+0000","last_became_peered":"2023-10-03T19:12:27.972451+0000","last_unstale":"2023-10-03T19:12:31.937912+0000","last_undegraded":"2023-10-03T19:12:31.937912+0000","last_fullsized":"2023-10-03T19:12:31.937912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:51:42.777690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936707+0000","last_change":"2023-10-03T19:12:27.966859+0000","last_active":"2023-10-03T19:12:31.936707+0000","last_peered":"2023-10-03T19:12:31.936707+0000","last_clean":"2023-10-03T19:12:31.936707+0000","last_became_active":"2023-10-03T19:12:27.966145+0000","last_became_peered":"2023-10-03T19:12:27.966145+0000","last_unstale":"2023-10-03T19:12:31.936707+0000","last_undegraded":"2023-10-03T19:12:31.936707+0000","last_fullsized":"2023-10-03T19:12:31.936707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:50:51.938925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953307+0000","last_change":"2023-10-03T19:12:27.967226+0000","last_active":"2023-10-03T19:12:28.953307+0000","last_peered":"2023-10-03T19:12:28.953307+0000","last_clean":"2023-10-03T19:12:28.953307+0000","last_became_active":"2023-10-03T19:12:27.966929+0000","last_became_peered":"2023-10-03T19:12:27.966929+0000","last_unstale":"2023-10-03T19:12:28.953307+0000","last_undegraded":"2023-10-03T19:12:28.953307+0000","last_fullsized":"2023-10-03T19:12:28.953307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:42:03.204018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937391+0000","last_change":"2023-10-03T19:12:27.988476+0000","last_active":"2023-10-03T19:12:31.937391+0000","last_peered":"2023-10-03T19:12:31.937391+0000","last_clean":"2023-10-03T19:12:31.937391+0000","last_became_active":"2023-10-03T19:12:27.988133+0000","last_became_peered":"2023-10-03T19:12:27.988133+0000","last_unstale":"2023-10-03T19:12:31.937391+0000","last_undegraded":"2023-10-03T19:12:31.937391+0000","last_fullsized":"2023-10-03T19:12:31.937391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:13:00.937958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.951743+0000","last_change":"2023-10-03T19:12:27.959887+0000","last_active":"2023-10-03T19:12:28.951743+0000","last_peered":"2023-10-03T19:12:28.951743+0000","last_clean":"2023-10-03T19:12:28.951743+0000","last_became_active":"2023-10-03T19:12:27.959538+0000","last_became_peered":"2023-10-03T19:12:27.959538+0000","last_unstale":"2023-10-03T19:12:28.951743+0000","last_undegraded":"2023-10-03T19:12:28.951743+0000","last_fullsized":"2023-10-03T19:12:28.951743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:57:42.821868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936053+0000","last_change":"2023-10-03T19:12:27.970249+0000","last_active":"2023-10-03T19:12:31.936053+0000","last_peered":"2023-10-03T19:12:31.936053+0000","last_clean":"2023-10-03T19:12:31.936053+0000","last_became_active":"2023-10-03T19:12:27.969995+0000","last_became_peered":"2023-10-03T19:12:27.969995+0000","last_unstale":"2023-10-03T19:12:31.936053+0000","last_undegraded":"2023-10-03T19:12:31.936053+0000","last_fullsized":"2023-10-03T19:12:31.936053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:22:33.134502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952651+0000","last_change":"2023-10-03T19:12:27.964836+0000","last_active":"2023-10-03T19:12:28.952651+0000","last_peered":"2023-10-03T19:12:28.952651+0000","last_clean":"2023-10-03T19:12:28.952651+0000","last_became_active":"2023-10-03T19:12:27.964025+0000","last_became_peered":"2023-10-03T19:12:27.964025+0000","last_unstale":"2023-10-03T19:12:28.952651+0000","last_undegraded":"2023-10-03T19:12:28.952651+0000","last_fullsized":"2023-10-03T19:12:28.952651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:22:33.134502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954083+0000","last_change":"2023-10-03T19:12:27.986149+0000","last_active":"2023-10-03T19:12:28.954083+0000","last_peered":"2023-10-03T19:12:28.954083+0000","last_clean":"2023-10-03T19:12:28.954083+0000","last_became_active":"2023-10-03T19:12:27.983721+0000","last_became_peered":"2023-10-03T19:12:27.983721+0000","last_unstale":"2023-10-03T19:12:28.954083+0000","last_undegraded":"2023-10-03T19:12:28.954083+0000","last_fullsized":"2023-10-03T19:12:28.954083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:36:36.702280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.947612+0000","last_change":"2023-10-03T19:12:27.971272+0000","last_active":"2023-10-03T19:12:28.947612+0000","last_peered":"2023-10-03T19:12:28.947612+0000","last_clean":"2023-10-03T19:12:28.947612+0000","last_became_active":"2023-10-03T19:12:27.970796+0000","last_became_peered":"2023-10-03T19:12:27.970796+0000","last_unstale":"2023-10-03T19:12:28.947612+0000","last_undegraded":"2023-10-03T19:12:28.947612+0000","last_fullsized":"2023-10-03T19:12:28.947612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:32:28.423427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.947574+0000","last_change":"2023-10-03T19:12:27.968608+0000","last_active":"2023-10-03T19:12:28.947574+0000","last_peered":"2023-10-03T19:12:28.947574+0000","last_clean":"2023-10-03T19:12:28.947574+0000","last_became_active":"2023-10-03T19:12:27.968090+0000","last_became_peered":"2023-10-03T19:12:27.968090+0000","last_unstale":"2023-10-03T19:12:28.947574+0000","last_undegraded":"2023-10-03T19:12:28.947574+0000","last_fullsized":"2023-10-03T19:12:28.947574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:26:14.808258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952943+0000","last_change":"2023-10-03T19:12:27.970387+0000","last_active":"2023-10-03T19:12:28.952943+0000","last_peered":"2023-10-03T19:12:28.952943+0000","last_clean":"2023-10-03T19:12:28.952943+0000","last_became_active":"2023-10-03T19:12:27.969970+0000","last_became_peered":"2023-10-03T19:12:27.969970+0000","last_unstale":"2023-10-03T19:12:28.952943+0000","last_undegraded":"2023-10-03T19:12:28.952943+0000","last_fullsized":"2023-10-03T19:12:28.952943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:57:10.455144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937132+0000","last_change":"2023-10-03T19:12:27.988472+0000","last_active":"2023-10-03T19:12:31.937132+0000","last_peered":"2023-10-03T19:12:31.937132+0000","last_clean":"2023-10-03T19:12:31.937132+0000","last_became_active":"2023-10-03T19:12:27.988143+0000","last_became_peered":"2023-10-03T19:12:27.988143+0000","last_unstale":"2023-10-03T19:12:31.937132+0000","last_undegraded":"2023-10-03T19:12:31.937132+0000","last_fullsized":"2023-10-03T19:12:31.937132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:04:50.005254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952659+0000","last_change":"2023-10-03T19:12:27.960422+0000","last_active":"2023-10-03T19:12:28.952659+0000","last_peered":"2023-10-03T19:12:28.952659+0000","last_clean":"2023-10-03T19:12:28.952659+0000","last_became_active":"2023-10-03T19:12:27.958884+0000","last_became_peered":"2023-10-03T19:12:27.958884+0000","last_unstale":"2023-10-03T19:12:28.952659+0000","last_undegraded":"2023-10-03T19:12:28.952659+0000","last_fullsized":"2023-10-03T19:12:28.952659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:08:38.248650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936380+0000","last_change":"2023-10-03T19:12:27.968081+0000","last_active":"2023-10-03T19:12:31.936380+0000","last_peered":"2023-10-03T19:12:31.936380+0000","last_clean":"2023-10-03T19:12:31.936380+0000","last_became_active":"2023-10-03T19:12:27.967067+0000","last_became_peered":"2023-10-03T19:12:27.967067+0000","last_unstale":"2023-10-03T19:12:31.936380+0000","last_undegraded":"2023-10-03T19:12:31.936380+0000","last_fullsized":"2023-10-03T19:12:31.936380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:57:10.455144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954083+0000","last_change":"2023-10-03T19:12:27.971067+0000","last_active":"2023-10-03T19:12:28.954083+0000","last_peered":"2023-10-03T19:12:28.954083+0000","last_clean":"2023-10-03T19:12:28.954083+0000","last_became_active":"2023-10-03T19:12:27.970697+0000","last_became_peered":"2023-10-03T19:12:27.970697+0000","last_unstale":"2023-10-03T19:12:28.954083+0000","last_undegraded":"2023-10-03T19:12:28.954083+0000","last_fullsized":"2023-10-03T19:12:28.954083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:48:06.317138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.947677+0000","last_change":"2023-10-03T19:12:27.982404+0000","last_active":"2023-10-03T19:12:28.947677+0000","last_peered":"2023-10-03T19:12:28.947677+0000","last_clean":"2023-10-03T19:12:28.947677+0000","last_became_active":"2023-10-03T19:12:27.982070+0000","last_became_peered":"2023-10-03T19:12:27.982070+0000","last_unstale":"2023-10-03T19:12:28.947677+0000","last_undegraded":"2023-10-03T19:12:28.947677+0000","last_fullsized":"2023-10-03T19:12:28.947677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:05:40.727058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953598+0000","last_change":"2023-10-03T19:12:27.978237+0000","last_active":"2023-10-03T19:12:28.953598+0000","last_peered":"2023-10-03T19:12:28.953598+0000","last_clean":"2023-10-03T19:12:28.953598+0000","last_became_active":"2023-10-03T19:12:27.977841+0000","last_became_peered":"2023-10-03T19:12:27.977841+0000","last_unstale":"2023-10-03T19:12:28.953598+0000","last_undegraded":"2023-10-03T19:12:28.953598+0000","last_fullsized":"2023-10-03T19:12:28.953598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:06:02.160141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937324+0000","last_change":"2023-10-03T19:12:27.978515+0000","last_active":"2023-10-03T19:12:31.937324+0000","last_peered":"2023-10-03T19:12:31.937324+0000","last_clean":"2023-10-03T19:12:31.937324+0000","last_became_active":"2023-10-03T19:12:27.977947+0000","last_became_peered":"2023-10-03T19:12:27.977947+0000","last_unstale":"2023-10-03T19:12:31.937324+0000","last_undegraded":"2023-10-03T19:12:31.937324+0000","last_fullsized":"2023-10-03T19:12:31.937324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:36:36.702280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.935287+0000","last_change":"2023-10-03T19:12:27.966759+0000","last_active":"2023-10-03T19:12:31.935287+0000","last_peered":"2023-10-03T19:12:31.935287+0000","last_clean":"2023-10-03T19:12:31.935287+0000","last_became_active":"2023-10-03T19:12:27.966395+0000","last_became_peered":"2023-10-03T19:12:27.966395+0000","last_unstale":"2023-10-03T19:12:31.935287+0000","last_undegraded":"2023-10-03T19:12:31.935287+0000","last_fullsized":"2023-10-03T19:12:31.935287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:01:29.251478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.445878+0000","last_change":"2023-10-03T19:12:27.965460+0000","last_active":"2023-10-03T19:12:31.445878+0000","last_peered":"2023-10-03T19:12:31.445878+0000","last_clean":"2023-10-03T19:12:31.445878+0000","last_became_active":"2023-10-03T19:12:27.965215+0000","last_became_peered":"2023-10-03T19:12:27.965215+0000","last_unstale":"2023-10-03T19:12:31.445878+0000","last_undegraded":"2023-10-03T19:12:31.445878+0000","last_fullsized":"2023-10-03T19:12:31.445878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:14:25.554969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937118+0000","last_change":"2023-10-03T19:12:27.978012+0000","last_active":"2023-10-03T19:12:31.937118+0000","last_peered":"2023-10-03T19:12:31.937118+0000","last_clean":"2023-10-03T19:12:31.937118+0000","last_became_active":"2023-10-03T19:12:27.977497+0000","last_became_peered":"2023-10-03T19:12:27.977497+0000","last_unstale":"2023-10-03T19:12:31.937118+0000","last_undegraded":"2023-10-03T19:12:31.937118+0000","last_fullsized":"2023-10-03T19:12:31.937118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:39:07.804995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938079+0000","last_change":"2023-10-03T19:12:27.982593+0000","last_active":"2023-10-03T19:12:31.938079+0000","last_peered":"2023-10-03T19:12:31.938079+0000","last_clean":"2023-10-03T19:12:31.938079+0000","last_became_active":"2023-10-03T19:12:27.982076+0000","last_became_peered":"2023-10-03T19:12:27.982076+0000","last_unstale":"2023-10-03T19:12:31.938079+0000","last_undegraded":"2023-10-03T19:12:31.938079+0000","last_fullsized":"2023-10-03T19:12:31.938079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:13:00.937958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937722+0000","last_change":"2023-10-03T19:12:27.969145+0000","last_active":"2023-10-03T19:12:31.937722+0000","last_peered":"2023-10-03T19:12:31.937722+0000","last_clean":"2023-10-03T19:12:31.937722+0000","last_became_active":"2023-10-03T19:12:27.968857+0000","last_became_peered":"2023-10-03T19:12:27.968857+0000","last_unstale":"2023-10-03T19:12:31.937722+0000","last_undegraded":"2023-10-03T19:12:31.937722+0000","last_fullsized":"2023-10-03T19:12:31.937722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:48:06.317138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952353+0000","last_change":"2023-10-03T19:12:27.978614+0000","last_active":"2023-10-03T19:12:28.952353+0000","last_peered":"2023-10-03T19:12:28.952353+0000","last_clean":"2023-10-03T19:12:28.952353+0000","last_became_active":"2023-10-03T19:12:27.978222+0000","last_became_peered":"2023-10-03T19:12:27.978222+0000","last_unstale":"2023-10-03T19:12:28.952353+0000","last_undegraded":"2023-10-03T19:12:28.952353+0000","last_fullsized":"2023-10-03T19:12:28.952353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:47:33.343155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936959+0000","last_change":"2023-10-03T19:12:27.977987+0000","last_active":"2023-10-03T19:12:31.936959+0000","last_peered":"2023-10-03T19:12:31.936959+0000","last_clean":"2023-10-03T19:12:31.936959+0000","last_became_active":"2023-10-03T19:12:27.977696+0000","last_became_peered":"2023-10-03T19:12:27.977696+0000","last_unstale":"2023-10-03T19:12:31.936959+0000","last_undegraded":"2023-10-03T19:12:31.936959+0000","last_fullsized":"2023-10-03T19:12:31.936959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:14:25.554969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.446109+0000","last_change":"2023-10-03T19:12:27.984102+0000","last_active":"2023-10-03T19:12:31.446109+0000","last_peered":"2023-10-03T19:12:31.446109+0000","last_clean":"2023-10-03T19:12:31.446109+0000","last_became_active":"2023-10-03T19:12:27.983835+0000","last_became_peered":"2023-10-03T19:12:27.983835+0000","last_unstale":"2023-10-03T19:12:31.446109+0000","last_undegraded":"2023-10-03T19:12:31.446109+0000","last_fullsized":"2023-10-03T19:12:31.446109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:40:40.179631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953719+0000","last_change":"2023-10-03T19:12:27.982956+0000","last_active":"2023-10-03T19:12:28.953719+0000","last_peered":"2023-10-03T19:12:28.953719+0000","last_clean":"2023-10-03T19:12:28.953719+0000","last_became_active":"2023-10-03T19:12:27.982622+0000","last_became_peered":"2023-10-03T19:12:27.982622+0000","last_unstale":"2023-10-03T19:12:28.953719+0000","last_undegraded":"2023-10-03T19:12:28.953719+0000","last_fullsized":"2023-10-03T19:12:28.953719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:58:41.915397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.445663+0000","last_change":"2023-10-03T19:12:27.969233+0000","last_active":"2023-10-03T19:12:31.445663+0000","last_peered":"2023-10-03T19:12:31.445663+0000","last_clean":"2023-10-03T19:12:31.445663+0000","last_became_active":"2023-10-03T19:12:27.968939+0000","last_became_peered":"2023-10-03T19:12:27.968939+0000","last_unstale":"2023-10-03T19:12:31.445663+0000","last_undegraded":"2023-10-03T19:12:31.445663+0000","last_fullsized":"2023-10-03T19:12:31.445663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:56:53.031240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937466+0000","last_change":"2023-10-03T19:12:27.982253+0000","last_active":"2023-10-03T19:12:31.937466+0000","last_peered":"2023-10-03T19:12:31.937466+0000","last_clean":"2023-10-03T19:12:31.937466+0000","last_became_active":"2023-10-03T19:12:27.974654+0000","last_became_peered":"2023-10-03T19:12:27.974654+0000","last_unstale":"2023-10-03T19:12:31.937466+0000","last_undegraded":"2023-10-03T19:12:31.937466+0000","last_fullsized":"2023-10-03T19:12:31.937466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:15:19.668421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.446441+0000","last_change":"2023-10-03T19:12:27.969223+0000","last_active":"2023-10-03T19:12:31.446441+0000","last_peered":"2023-10-03T19:12:31.446441+0000","last_clean":"2023-10-03T19:12:31.446441+0000","last_became_active":"2023-10-03T19:12:27.968920+0000","last_became_peered":"2023-10-03T19:12:27.968920+0000","last_unstale":"2023-10-03T19:12:31.446441+0000","last_undegraded":"2023-10-03T19:12:31.446441+0000","last_fullsized":"2023-10-03T19:12:31.446441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:36:36.702280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938352+0000","last_change":"2023-10-03T19:12:27.594756+0000","last_active":"2023-10-03T19:12:31.938352+0000","last_peered":"2023-10-03T19:12:31.938352+0000","last_clean":"2023-10-03T19:12:31.938352+0000","last_became_active":"2023-10-03T19:12:27.594156+0000","last_became_peered":"2023-10-03T19:12:27.594156+0000","last_unstale":"2023-10-03T19:12:31.938352+0000","last_undegraded":"2023-10-03T19:12:31.938352+0000","last_fullsized":"2023-10-03T19:12:31.938352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:51:27.857657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953302+0000","last_change":"2023-10-03T19:12:27.984997+0000","last_active":"2023-10-03T19:12:28.953302+0000","last_peered":"2023-10-03T19:12:28.953302+0000","last_clean":"2023-10-03T19:12:28.953302+0000","last_became_active":"2023-10-03T19:12:27.984682+0000","last_became_peered":"2023-10-03T19:12:27.984682+0000","last_unstale":"2023-10-03T19:12:28.953302+0000","last_undegraded":"2023-10-03T19:12:28.953302+0000","last_fullsized":"2023-10-03T19:12:28.953302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:29:18.707428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.935473+0000","last_change":"2023-10-03T19:12:27.589809+0000","last_active":"2023-10-03T19:12:31.935473+0000","last_peered":"2023-10-03T19:12:31.935473+0000","last_clean":"2023-10-03T19:12:31.935473+0000","last_became_active":"2023-10-03T19:12:27.589415+0000","last_became_peered":"2023-10-03T19:12:27.589415+0000","last_unstale":"2023-10-03T19:12:31.935473+0000","last_undegraded":"2023-10-03T19:12:31.935473+0000","last_fullsized":"2023-10-03T19:12:31.935473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:21:26.096838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.935811+0000","last_change":"2023-10-03T19:12:27.966910+0000","last_active":"2023-10-03T19:12:31.935811+0000","last_peered":"2023-10-03T19:12:31.935811+0000","last_clean":"2023-10-03T19:12:31.935811+0000","last_became_active":"2023-10-03T19:12:27.966160+0000","last_became_peered":"2023-10-03T19:12:27.966160+0000","last_unstale":"2023-10-03T19:12:31.935811+0000","last_undegraded":"2023-10-03T19:12:31.935811+0000","last_fullsized":"2023-10-03T19:12:31.935811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:55:55.744147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937350+0000","last_change":"2023-10-03T19:12:27.597122+0000","last_active":"2023-10-03T19:12:31.937350+0000","last_peered":"2023-10-03T19:12:31.937350+0000","last_clean":"2023-10-03T19:12:31.937350+0000","last_became_active":"2023-10-03T19:12:27.596367+0000","last_became_peered":"2023-10-03T19:12:27.596367+0000","last_unstale":"2023-10-03T19:12:31.937350+0000","last_undegraded":"2023-10-03T19:12:31.937350+0000","last_fullsized":"2023-10-03T19:12:31.937350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:09:55.002369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.446581+0000","last_change":"2023-10-03T19:12:27.983942+0000","last_active":"2023-10-03T19:12:31.446581+0000","last_peered":"2023-10-03T19:12:31.446581+0000","last_clean":"2023-10-03T19:12:31.446581+0000","last_became_active":"2023-10-03T19:12:27.983600+0000","last_became_peered":"2023-10-03T19:12:27.983600+0000","last_unstale":"2023-10-03T19:12:31.446581+0000","last_undegraded":"2023-10-03T19:12:31.446581+0000","last_fullsized":"2023-10-03T19:12:31.446581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:13:00.937958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'8","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937478+0000","last_change":"2023-10-03T19:12:27.580060+0000","last_active":"2023-10-03T19:12:31.937478+0000","last_peered":"2023-10-03T19:12:31.937478+0000","last_clean":"2023-10-03T19:12:31.937478+0000","last_became_active":"2023-10-03T19:12:27.579250+0000","last_became_peered":"2023-10-03T19:12:27.579250+0000","last_unstale":"2023-10-03T19:12:31.937478+0000","last_undegraded":"2023-10-03T19:12:31.937478+0000","last_fullsized":"2023-10-03T19:12:31.937478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:04:31.510597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938787+0000","last_change":"2023-10-03T19:12:27.597979+0000","last_active":"2023-10-03T19:12:31.938787+0000","last_peered":"2023-10-03T19:12:31.938787+0000","last_clean":"2023-10-03T19:12:31.938787+0000","last_became_active":"2023-10-03T19:12:27.595911+0000","last_became_peered":"2023-10-03T19:12:27.595911+0000","last_unstale":"2023-10-03T19:12:31.938787+0000","last_undegraded":"2023-10-03T19:12:31.938787+0000","last_fullsized":"2023-10-03T19:12:31.938787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:11:28.744038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.951943+0000","last_change":"2023-10-03T19:12:27.978558+0000","last_active":"2023-10-03T19:12:28.951943+0000","last_peered":"2023-10-03T19:12:28.951943+0000","last_clean":"2023-10-03T19:12:28.951943+0000","last_became_active":"2023-10-03T19:12:27.978193+0000","last_became_peered":"2023-10-03T19:12:27.978193+0000","last_unstale":"2023-10-03T19:12:28.951943+0000","last_undegraded":"2023-10-03T19:12:28.951943+0000","last_fullsized":"2023-10-03T19:12:28.951943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:21:27.107002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938789+0000","last_change":"2023-10-03T19:12:27.597785+0000","last_active":"2023-10-03T19:12:31.938789+0000","last_peered":"2023-10-03T19:12:31.938789+0000","last_clean":"2023-10-03T19:12:31.938789+0000","last_became_active":"2023-10-03T19:12:27.596252+0000","last_became_peered":"2023-10-03T19:12:27.596252+0000","last_unstale":"2023-10-03T19:12:31.938789+0000","last_undegraded":"2023-10-03T19:12:31.938789+0000","last_fullsized":"2023-10-03T19:12:31.938789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:55:56.909440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953146+0000","last_change":"2023-10-03T19:12:27.983791+0000","last_active":"2023-10-03T19:12:28.953146+0000","last_peered":"2023-10-03T19:12:28.953146+0000","last_clean":"2023-10-03T19:12:28.953146+0000","last_became_active":"2023-10-03T19:12:27.983498+0000","last_became_peered":"2023-10-03T19:12:27.983498+0000","last_unstale":"2023-10-03T19:12:28.953146+0000","last_undegraded":"2023-10-03T19:12:28.953146+0000","last_fullsized":"2023-10-03T19:12:28.953146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:56:53.031240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938558+0000","last_change":"2023-10-03T19:12:27.597281+0000","last_active":"2023-10-03T19:12:31.938558+0000","last_peered":"2023-10-03T19:12:31.938558+0000","last_clean":"2023-10-03T19:12:31.938558+0000","last_became_active":"2023-10-03T19:12:27.596699+0000","last_became_peered":"2023-10-03T19:12:27.596699+0000","last_unstale":"2023-10-03T19:12:31.938558+0000","last_undegraded":"2023-10-03T19:12:31.938558+0000","last_fullsized":"2023-10-03T19:12:31.938558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:02:43.719408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937888+0000","last_change":"2023-10-03T19:12:27.985128+0000","last_active":"2023-10-03T19:12:31.937888+0000","last_peered":"2023-10-03T19:12:31.937888+0000","last_clean":"2023-10-03T19:12:31.937888+0000","last_became_active":"2023-10-03T19:12:27.984570+0000","last_became_peered":"2023-10-03T19:12:27.984570+0000","last_unstale":"2023-10-03T19:12:31.937888+0000","last_undegraded":"2023-10-03T19:12:31.937888+0000","last_fullsized":"2023-10-03T19:12:31.937888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:23:37.424885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952130+0000","last_change":"2023-10-03T19:12:27.594338+0000","last_active":"2023-10-03T19:12:28.952130+0000","last_peered":"2023-10-03T19:12:28.952130+0000","last_clean":"2023-10-03T19:12:28.952130+0000","last_became_active":"2023-10-03T19:12:27.593882+0000","last_became_peered":"2023-10-03T19:12:27.593882+0000","last_unstale":"2023-10-03T19:12:28.952130+0000","last_undegraded":"2023-10-03T19:12:28.952130+0000","last_fullsized":"2023-10-03T19:12:28.952130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:55:54.733983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936024+0000","last_change":"2023-10-03T19:12:27.969749+0000","last_active":"2023-10-03T19:12:31.936024+0000","last_peered":"2023-10-03T19:12:31.936024+0000","last_clean":"2023-10-03T19:12:31.936024+0000","last_became_active":"2023-10-03T19:12:27.966817+0000","last_became_peered":"2023-10-03T19:12:27.966817+0000","last_unstale":"2023-10-03T19:12:31.936024+0000","last_undegraded":"2023-10-03T19:12:31.936024+0000","last_fullsized":"2023-10-03T19:12:31.936024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:01:58.722428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.446414+0000","last_change":"2023-10-03T19:12:27.586872+0000","last_active":"2023-10-03T19:12:31.446414+0000","last_peered":"2023-10-03T19:12:31.446414+0000","last_clean":"2023-10-03T19:12:31.446414+0000","last_became_active":"2023-10-03T19:12:27.586119+0000","last_became_peered":"2023-10-03T19:12:27.586119+0000","last_unstale":"2023-10-03T19:12:31.446414+0000","last_undegraded":"2023-10-03T19:12:31.446414+0000","last_fullsized":"2023-10-03T19:12:31.446414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:48:05.306974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953682+0000","last_change":"2023-10-03T19:12:27.964111+0000","last_active":"2023-10-03T19:12:28.953682+0000","last_peered":"2023-10-03T19:12:28.953682+0000","last_clean":"2023-10-03T19:12:28.953682+0000","last_became_active":"2023-10-03T19:12:27.963620+0000","last_became_peered":"2023-10-03T19:12:27.963620+0000","last_unstale":"2023-10-03T19:12:28.953682+0000","last_undegraded":"2023-10-03T19:12:28.953682+0000","last_fullsized":"2023-10-03T19:12:28.953682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:14:25.554969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938077+0000","last_change":"2023-10-03T19:12:27.587990+0000","last_active":"2023-10-03T19:12:31.938077+0000","last_peered":"2023-10-03T19:12:31.938077+0000","last_clean":"2023-10-03T19:12:31.938077+0000","last_became_active":"2023-10-03T19:12:27.587316+0000","last_became_peered":"2023-10-03T19:12:27.587316+0000","last_unstale":"2023-10-03T19:12:31.938077+0000","last_undegraded":"2023-10-03T19:12:31.938077+0000","last_fullsized":"2023-10-03T19:12:31.938077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:08:37.238486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954191+0000","last_change":"2023-10-03T19:12:27.970739+0000","last_active":"2023-10-03T19:12:28.954191+0000","last_peered":"2023-10-03T19:12:28.954191+0000","last_clean":"2023-10-03T19:12:28.954191+0000","last_became_active":"2023-10-03T19:12:27.970408+0000","last_became_peered":"2023-10-03T19:12:27.970408+0000","last_unstale":"2023-10-03T19:12:28.954191+0000","last_undegraded":"2023-10-03T19:12:28.954191+0000","last_fullsized":"2023-10-03T19:12:28.954191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:13:00.937958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953950+0000","last_change":"2023-10-03T19:12:27.580938+0000","last_active":"2023-10-03T19:12:28.953950+0000","last_peered":"2023-10-03T19:12:28.953950+0000","last_clean":"2023-10-03T19:12:28.953950+0000","last_became_active":"2023-10-03T19:12:27.580538+0000","last_became_peered":"2023-10-03T19:12:27.580538+0000","last_unstale":"2023-10-03T19:12:28.953950+0000","last_undegraded":"2023-10-03T19:12:28.953950+0000","last_fullsized":"2023-10-03T19:12:28.953950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:04:48.995090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954372+0000","last_change":"2023-10-03T19:12:27.969234+0000","last_active":"2023-10-03T19:12:28.954372+0000","last_peered":"2023-10-03T19:12:28.954372+0000","last_clean":"2023-10-03T19:12:28.954372+0000","last_became_active":"2023-10-03T19:12:27.968880+0000","last_became_peered":"2023-10-03T19:12:27.968880+0000","last_unstale":"2023-10-03T19:12:28.954372+0000","last_undegraded":"2023-10-03T19:12:28.954372+0000","last_fullsized":"2023-10-03T19:12:28.954372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:09:56.012532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.445909+0000","last_change":"2023-10-03T19:12:27.592296+0000","last_active":"2023-10-03T19:12:31.445909+0000","last_peered":"2023-10-03T19:12:31.445909+0000","last_clean":"2023-10-03T19:12:31.445909+0000","last_became_active":"2023-10-03T19:12:27.588952+0000","last_became_peered":"2023-10-03T19:12:27.588952+0000","last_unstale":"2023-10-03T19:12:31.445909+0000","last_undegraded":"2023-10-03T19:12:31.445909+0000","last_fullsized":"2023-10-03T19:12:31.445909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:58:40.905233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937406+0000","last_change":"2023-10-03T19:12:27.967839+0000","last_active":"2023-10-03T19:12:31.937406+0000","last_peered":"2023-10-03T19:12:31.937406+0000","last_clean":"2023-10-03T19:12:31.937406+0000","last_became_active":"2023-10-03T19:12:27.967281+0000","last_became_peered":"2023-10-03T19:12:27.967281+0000","last_unstale":"2023-10-03T19:12:31.937406+0000","last_undegraded":"2023-10-03T19:12:31.937406+0000","last_fullsized":"2023-10-03T19:12:31.937406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:33:54.388967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":171,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937204+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:12:31.937204+0000","last_peered":"2023-10-03T19:12:31.937204+0000","last_clean":"2023-10-03T19:12:31.937204+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:12:31.937204+0000","last_undegraded":"2023-10-03T19:12:31.937204+0000","last_fullsized":"2023-10-03T19:12:31.937204+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:48:00.062144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.951827+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:12:28.951827+0000","last_peered":"2023-10-03T19:12:28.951827+0000","last_clean":"2023-10-03T19:12:28.951827+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:12:28.951827+0000","last_undegraded":"2023-10-03T19:12:28.951827+0000","last_fullsized":"2023-10-03T19:12:28.951827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:16:13.727679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.445820+0000","last_change":"2023-10-03T19:12:27.592604+0000","last_active":"2023-10-03T19:12:31.445820+0000","last_peered":"2023-10-03T19:12:31.445820+0000","last_clean":"2023-10-03T19:12:31.445820+0000","last_became_active":"2023-10-03T19:12:27.592242+0000","last_became_peered":"2023-10-03T19:12:27.592242+0000","last_unstale":"2023-10-03T19:12:31.445820+0000","last_undegraded":"2023-10-03T19:12:31.445820+0000","last_fullsized":"2023-10-03T19:12:31.445820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:06:01.149977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937821+0000","last_change":"2023-10-03T19:12:27.981742+0000","last_active":"2023-10-03T19:12:31.937821+0000","last_peered":"2023-10-03T19:12:31.937821+0000","last_clean":"2023-10-03T19:12:31.937821+0000","last_became_active":"2023-10-03T19:12:27.981480+0000","last_became_peered":"2023-10-03T19:12:27.981480+0000","last_unstale":"2023-10-03T19:12:31.937821+0000","last_undegraded":"2023-10-03T19:12:31.937821+0000","last_fullsized":"2023-10-03T19:12:31.937821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:32:27.213744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936854+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:12:31.936854+0000","last_peered":"2023-10-03T19:12:31.936854+0000","last_clean":"2023-10-03T19:12:31.936854+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:12:31.936854+0000","last_undegraded":"2023-10-03T19:12:31.936854+0000","last_fullsized":"2023-10-03T19:12:31.936854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:33:49.157041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.935405+0000","last_change":"2023-10-03T19:12:27.594044+0000","last_active":"2023-10-03T19:12:31.935405+0000","last_peered":"2023-10-03T19:12:31.935405+0000","last_clean":"2023-10-03T19:12:31.935405+0000","last_became_active":"2023-10-03T19:12:27.593678+0000","last_became_peered":"2023-10-03T19:12:27.593678+0000","last_unstale":"2023-10-03T19:12:31.935405+0000","last_undegraded":"2023-10-03T19:12:31.935405+0000","last_fullsized":"2023-10-03T19:12:31.935405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:57:41.811705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.935677+0000","last_change":"2023-10-03T19:12:27.969842+0000","last_active":"2023-10-03T19:12:31.935677+0000","last_peered":"2023-10-03T19:12:31.935677+0000","last_clean":"2023-10-03T19:12:31.935677+0000","last_became_active":"2023-10-03T19:12:27.966611+0000","last_became_peered":"2023-10-03T19:12:27.966611+0000","last_unstale":"2023-10-03T19:12:31.935677+0000","last_undegraded":"2023-10-03T19:12:31.935677+0000","last_fullsized":"2023-10-03T19:12:31.935677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:16:18.959604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.947762+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:12:28.947762+0000","last_peered":"2023-10-03T19:12:28.947762+0000","last_clean":"2023-10-03T19:12:28.947762+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:12:28.947762+0000","last_undegraded":"2023-10-03T19:12:28.947762+0000","last_fullsized":"2023-10-03T19:12:28.947762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:24:20.268582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936393+0000","last_change":"2023-10-03T19:12:27.579209+0000","last_active":"2023-10-03T19:12:31.936393+0000","last_peered":"2023-10-03T19:12:31.936393+0000","last_clean":"2023-10-03T19:12:31.936393+0000","last_became_active":"2023-10-03T19:12:27.578633+0000","last_became_peered":"2023-10-03T19:12:27.578633+0000","last_unstale":"2023-10-03T19:12:31.936393+0000","last_undegraded":"2023-10-03T19:12:31.936393+0000","last_fullsized":"2023-10-03T19:12:31.936393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:02:27.868659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937557+0000","last_change":"2023-10-03T19:12:27.966914+0000","last_active":"2023-10-03T19:12:31.937557+0000","last_peered":"2023-10-03T19:12:31.937557+0000","last_clean":"2023-10-03T19:12:31.937557+0000","last_became_active":"2023-10-03T19:12:27.966406+0000","last_became_peered":"2023-10-03T19:12:27.966406+0000","last_unstale":"2023-10-03T19:12:31.937557+0000","last_undegraded":"2023-10-03T19:12:31.937557+0000","last_fullsized":"2023-10-03T19:12:31.937557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:39:07.804995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953153+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:12:28.953153+0000","last_peered":"2023-10-03T19:12:28.953153+0000","last_clean":"2023-10-03T19:12:28.953153+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:12:28.953153+0000","last_undegraded":"2023-10-03T19:12:28.953153+0000","last_fullsized":"2023-10-03T19:12:28.953153+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:50:46.706999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954915+0000","last_change":"2023-10-03T19:12:27.586703+0000","last_active":"2023-10-03T19:12:28.954915+0000","last_peered":"2023-10-03T19:12:28.954915+0000","last_clean":"2023-10-03T19:12:28.954915+0000","last_became_active":"2023-10-03T19:12:27.586241+0000","last_became_peered":"2023-10-03T19:12:27.586241+0000","last_unstale":"2023-10-03T19:12:28.954915+0000","last_undegraded":"2023-10-03T19:12:28.954915+0000","last_fullsized":"2023-10-03T19:12:28.954915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:23:42.273581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936826+0000","last_change":"2023-10-03T19:12:27.972058+0000","last_active":"2023-10-03T19:12:31.936826+0000","last_peered":"2023-10-03T19:12:31.936826+0000","last_clean":"2023-10-03T19:12:31.936826+0000","last_became_active":"2023-10-03T19:12:27.971770+0000","last_became_peered":"2023-10-03T19:12:27.971770+0000","last_unstale":"2023-10-03T19:12:31.936826+0000","last_undegraded":"2023-10-03T19:12:31.936826+0000","last_fullsized":"2023-10-03T19:12:31.936826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:06:02.160141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952764+0000","last_change":"2023-10-03T19:12:27.595105+0000","last_active":"2023-10-03T19:12:28.952764+0000","last_peered":"2023-10-03T19:12:28.952764+0000","last_clean":"2023-10-03T19:12:28.952764+0000","last_became_active":"2023-10-03T19:12:27.594748+0000","last_became_peered":"2023-10-03T19:12:27.594748+0000","last_unstale":"2023-10-03T19:12:28.952764+0000","last_undegraded":"2023-10-03T19:12:28.952764+0000","last_fullsized":"2023-10-03T19:12:28.952764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:43:24.586460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937036+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:12:31.937036+0000","last_peered":"2023-10-03T19:12:31.937036+0000","last_clean":"2023-10-03T19:12:31.937036+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:12:31.937036+0000","last_undegraded":"2023-10-03T19:12:31.937036+0000","last_fullsized":"2023-10-03T19:12:31.937036+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:50:20.553324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937627+0000","last_change":"2023-10-03T19:12:27.966147+0000","last_active":"2023-10-03T19:12:31.937627+0000","last_peered":"2023-10-03T19:12:31.937627+0000","last_clean":"2023-10-03T19:12:31.937627+0000","last_became_active":"2023-10-03T19:12:27.965865+0000","last_became_peered":"2023-10-03T19:12:27.965865+0000","last_unstale":"2023-10-03T19:12:31.937627+0000","last_undegraded":"2023-10-03T19:12:31.937627+0000","last_fullsized":"2023-10-03T19:12:31.937627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:04:50.005254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936963+0000","last_change":"2023-10-03T19:12:27.581597+0000","last_active":"2023-10-03T19:12:31.936963+0000","last_peered":"2023-10-03T19:12:31.936963+0000","last_clean":"2023-10-03T19:12:31.936963+0000","last_became_active":"2023-10-03T19:12:27.581015+0000","last_became_peered":"2023-10-03T19:12:27.581015+0000","last_unstale":"2023-10-03T19:12:31.936963+0000","last_undegraded":"2023-10-03T19:12:31.936963+0000","last_fullsized":"2023-10-03T19:12:31.936963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:58:40.905233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938993+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:12:31.938993+0000","last_peered":"2023-10-03T19:12:31.938993+0000","last_clean":"2023-10-03T19:12:31.938993+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:12:31.938993+0000","last_undegraded":"2023-10-03T19:12:31.938993+0000","last_fullsized":"2023-10-03T19:12:31.938993+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:13:27.600123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936370+0000","last_change":"2023-10-03T19:12:27.964905+0000","last_active":"2023-10-03T19:12:31.936370+0000","last_peered":"2023-10-03T19:12:31.936370+0000","last_clean":"2023-10-03T19:12:31.936370+0000","last_became_active":"2023-10-03T19:12:27.964614+0000","last_became_peered":"2023-10-03T19:12:27.964614+0000","last_unstale":"2023-10-03T19:12:31.936370+0000","last_undegraded":"2023-10-03T19:12:31.936370+0000","last_fullsized":"2023-10-03T19:12:31.936370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:43:25.596624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.446668+0000","last_change":"2023-10-03T19:12:27.588155+0000","last_active":"2023-10-03T19:12:31.446668+0000","last_peered":"2023-10-03T19:12:31.446668+0000","last_clean":"2023-10-03T19:12:31.446668+0000","last_became_active":"2023-10-03T19:12:27.587340+0000","last_became_peered":"2023-10-03T19:12:27.587340+0000","last_unstale":"2023-10-03T19:12:31.446668+0000","last_undegraded":"2023-10-03T19:12:31.446668+0000","last_fullsized":"2023-10-03T19:12:31.446668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:09:55.002369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937821+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:12:31.937821+0000","last_peered":"2023-10-03T19:12:31.937821+0000","last_clean":"2023-10-03T19:12:31.937821+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:12:31.937821+0000","last_undegraded":"2023-10-03T19:12:31.937821+0000","last_fullsized":"2023-10-03T19:12:31.937821+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:36:31.470355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.445724+0000","last_change":"2023-10-03T19:12:27.977940+0000","last_active":"2023-10-03T19:12:31.445724+0000","last_peered":"2023-10-03T19:12:31.445724+0000","last_clean":"2023-10-03T19:12:31.445724+0000","last_became_active":"2023-10-03T19:12:27.977495+0000","last_became_peered":"2023-10-03T19:12:27.977495+0000","last_unstale":"2023-10-03T19:12:31.445724+0000","last_undegraded":"2023-10-03T19:12:31.445724+0000","last_fullsized":"2023-10-03T19:12:31.445724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:42:03.204018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"22'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.935971+0000","last_change":"2023-10-03T19:12:27.583954+0000","last_active":"2023-10-03T19:12:31.935971+0000","last_peered":"2023-10-03T19:12:31.935971+0000","last_clean":"2023-10-03T19:12:31.935971+0000","last_became_active":"2023-10-03T19:12:27.583313+0000","last_became_peered":"2023-10-03T19:12:27.583313+0000","last_unstale":"2023-10-03T19:12:31.935971+0000","last_undegraded":"2023-10-03T19:12:31.935971+0000","last_fullsized":"2023-10-03T19:12:31.935971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:47:32.332991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938105+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:12:31.938105+0000","last_peered":"2023-10-03T19:12:31.938105+0000","last_clean":"2023-10-03T19:12:31.938105+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:12:31.938105+0000","last_undegraded":"2023-10-03T19:12:31.938105+0000","last_fullsized":"2023-10-03T19:12:31.938105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:56:47.799314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953723+0000","last_change":"2023-10-03T19:12:27.961343+0000","last_active":"2023-10-03T19:12:28.953723+0000","last_peered":"2023-10-03T19:12:28.953723+0000","last_clean":"2023-10-03T19:12:28.953723+0000","last_became_active":"2023-10-03T19:12:27.961065+0000","last_became_peered":"2023-10-03T19:12:27.961065+0000","last_unstale":"2023-10-03T19:12:28.953723+0000","last_undegraded":"2023-10-03T19:12:28.953723+0000","last_fullsized":"2023-10-03T19:12:28.953723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:50:25.785249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954854+0000","last_change":"2023-10-03T19:12:27.975142+0000","last_active":"2023-10-03T19:12:28.954854+0000","last_peered":"2023-10-03T19:12:28.954854+0000","last_clean":"2023-10-03T19:12:28.954854+0000","last_became_active":"2023-10-03T19:12:27.974173+0000","last_became_peered":"2023-10-03T19:12:27.974173+0000","last_unstale":"2023-10-03T19:12:28.954854+0000","last_undegraded":"2023-10-03T19:12:28.954854+0000","last_fullsized":"2023-10-03T19:12:28.954854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:02:44.729572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'6","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953832+0000","last_change":"2023-10-03T19:12:27.586506+0000","last_active":"2023-10-03T19:12:28.953832+0000","last_peered":"2023-10-03T19:12:28.953832+0000","last_clean":"2023-10-03T19:12:28.953832+0000","last_became_active":"2023-10-03T19:12:27.585847+0000","last_became_peered":"2023-10-03T19:12:27.585847+0000","last_unstale":"2023-10-03T19:12:28.953832+0000","last_undegraded":"2023-10-03T19:12:28.953832+0000","last_fullsized":"2023-10-03T19:12:28.953832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:33:53.378803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937279+0000","last_change":"2023-10-03T19:12:27.973591+0000","last_active":"2023-10-03T19:12:31.937279+0000","last_peered":"2023-10-03T19:12:31.937279+0000","last_clean":"2023-10-03T19:12:31.937279+0000","last_became_active":"2023-10-03T19:12:27.973308+0000","last_became_peered":"2023-10-03T19:12:27.973308+0000","last_unstale":"2023-10-03T19:12:31.937279+0000","last_undegraded":"2023-10-03T19:12:31.937279+0000","last_fullsized":"2023-10-03T19:12:31.937279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:40:40.179631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938677+0000","last_change":"2023-10-03T19:12:27.595373+0000","last_active":"2023-10-03T19:12:31.938677+0000","last_peered":"2023-10-03T19:12:31.938677+0000","last_clean":"2023-10-03T19:12:31.938677+0000","last_became_active":"2023-10-03T19:12:27.594761+0000","last_became_peered":"2023-10-03T19:12:27.594761+0000","last_unstale":"2023-10-03T19:12:31.938677+0000","last_undegraded":"2023-10-03T19:12:31.938677+0000","last_fullsized":"2023-10-03T19:12:31.938677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:23:42.273581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952982+0000","last_change":"2023-10-03T19:12:27.585305+0000","last_active":"2023-10-03T19:12:28.952982+0000","last_peered":"2023-10-03T19:12:28.952982+0000","last_clean":"2023-10-03T19:12:28.952982+0000","last_became_active":"2023-10-03T19:12:27.584635+0000","last_became_peered":"2023-10-03T19:12:27.584635+0000","last_unstale":"2023-10-03T19:12:28.952982+0000","last_undegraded":"2023-10-03T19:12:28.952982+0000","last_fullsized":"2023-10-03T19:12:28.952982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:37:44.604456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.446061+0000","last_change":"2023-10-03T19:12:27.978707+0000","last_active":"2023-10-03T19:12:31.446061+0000","last_peered":"2023-10-03T19:12:31.446061+0000","last_clean":"2023-10-03T19:12:31.446061+0000","last_became_active":"2023-10-03T19:12:27.978433+0000","last_became_peered":"2023-10-03T19:12:27.978433+0000","last_unstale":"2023-10-03T19:12:31.446061+0000","last_undegraded":"2023-10-03T19:12:31.446061+0000","last_fullsized":"2023-10-03T19:12:31.446061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:50:25.785249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936984+0000","last_change":"2023-10-03T19:12:27.592047+0000","last_active":"2023-10-03T19:12:31.936984+0000","last_peered":"2023-10-03T19:12:31.936984+0000","last_clean":"2023-10-03T19:12:31.936984+0000","last_became_active":"2023-10-03T19:12:27.591625+0000","last_became_peered":"2023-10-03T19:12:27.591625+0000","last_unstale":"2023-10-03T19:12:31.936984+0000","last_undegraded":"2023-10-03T19:12:31.936984+0000","last_fullsized":"2023-10-03T19:12:31.936984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:29:17.697265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.445602+0000","last_change":"2023-10-03T19:12:27.982932+0000","last_active":"2023-10-03T19:12:31.445602+0000","last_peered":"2023-10-03T19:12:31.445602+0000","last_clean":"2023-10-03T19:12:31.445602+0000","last_became_active":"2023-10-03T19:12:27.982612+0000","last_became_peered":"2023-10-03T19:12:27.982612+0000","last_unstale":"2023-10-03T19:12:31.445602+0000","last_undegraded":"2023-10-03T19:12:31.445602+0000","last_fullsized":"2023-10-03T19:12:31.445602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:08:38.248650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937987+0000","last_change":"2023-10-03T19:12:27.974833+0000","last_active":"2023-10-03T19:12:31.937987+0000","last_peered":"2023-10-03T19:12:31.937987+0000","last_clean":"2023-10-03T19:12:31.937987+0000","last_became_active":"2023-10-03T19:12:27.973932+0000","last_became_peered":"2023-10-03T19:12:27.973932+0000","last_unstale":"2023-10-03T19:12:31.937987+0000","last_undegraded":"2023-10-03T19:12:31.937987+0000","last_fullsized":"2023-10-03T19:12:31.937987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:20:24.642279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.445787+0000","last_change":"2023-10-03T19:12:27.592021+0000","last_active":"2023-10-03T19:12:31.445787+0000","last_peered":"2023-10-03T19:12:31.445787+0000","last_clean":"2023-10-03T19:12:31.445787+0000","last_became_active":"2023-10-03T19:12:27.589194+0000","last_became_peered":"2023-10-03T19:12:27.589194+0000","last_unstale":"2023-10-03T19:12:31.445787+0000","last_undegraded":"2023-10-03T19:12:31.445787+0000","last_fullsized":"2023-10-03T19:12:31.445787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:02:27.868659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.935544+0000","last_change":"2023-10-03T19:12:27.978101+0000","last_active":"2023-10-03T19:12:31.935544+0000","last_peered":"2023-10-03T19:12:31.935544+0000","last_clean":"2023-10-03T19:12:31.935544+0000","last_became_active":"2023-10-03T19:12:27.977700+0000","last_became_peered":"2023-10-03T19:12:27.977700+0000","last_unstale":"2023-10-03T19:12:31.935544+0000","last_undegraded":"2023-10-03T19:12:31.935544+0000","last_fullsized":"2023-10-03T19:12:31.935544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:08:48.595519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936430+0000","last_change":"2023-10-03T19:12:27.578433+0000","last_active":"2023-10-03T19:12:31.936430+0000","last_peered":"2023-10-03T19:12:31.936430+0000","last_clean":"2023-10-03T19:12:31.936430+0000","last_became_active":"2023-10-03T19:12:27.577627+0000","last_became_peered":"2023-10-03T19:12:27.577627+0000","last_unstale":"2023-10-03T19:12:31.936430+0000","last_undegraded":"2023-10-03T19:12:31.936430+0000","last_fullsized":"2023-10-03T19:12:31.936430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:42:02.193854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.446282+0000","last_change":"2023-10-03T19:12:27.983570+0000","last_active":"2023-10-03T19:12:31.446282+0000","last_peered":"2023-10-03T19:12:31.446282+0000","last_clean":"2023-10-03T19:12:31.446282+0000","last_became_active":"2023-10-03T19:12:27.983296+0000","last_became_peered":"2023-10-03T19:12:27.983296+0000","last_unstale":"2023-10-03T19:12:31.446282+0000","last_undegraded":"2023-10-03T19:12:31.446282+0000","last_fullsized":"2023-10-03T19:12:31.446282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:04:50.005254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953770+0000","last_change":"2023-10-03T19:12:27.577852+0000","last_active":"2023-10-03T19:12:28.953770+0000","last_peered":"2023-10-03T19:12:28.953770+0000","last_clean":"2023-10-03T19:12:28.953770+0000","last_became_active":"2023-10-03T19:12:27.576792+0000","last_became_peered":"2023-10-03T19:12:27.576792+0000","last_unstale":"2023-10-03T19:12:28.953770+0000","last_undegraded":"2023-10-03T19:12:28.953770+0000","last_fullsized":"2023-10-03T19:12:28.953770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:40:39.169467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.947561+0000","last_change":"2023-10-03T19:12:27.983619+0000","last_active":"2023-10-03T19:12:28.947561+0000","last_peered":"2023-10-03T19:12:28.947561+0000","last_clean":"2023-10-03T19:12:28.947561+0000","last_became_active":"2023-10-03T19:12:27.983185+0000","last_became_peered":"2023-10-03T19:12:27.983185+0000","last_unstale":"2023-10-03T19:12:28.947561+0000","last_undegraded":"2023-10-03T19:12:28.947561+0000","last_fullsized":"2023-10-03T19:12:28.947561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:02:11.328680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937025+0000","last_change":"2023-10-03T19:12:27.593678+0000","last_active":"2023-10-03T19:12:31.937025+0000","last_peered":"2023-10-03T19:12:31.937025+0000","last_clean":"2023-10-03T19:12:31.937025+0000","last_became_active":"2023-10-03T19:12:27.593376+0000","last_became_peered":"2023-10-03T19:12:27.593376+0000","last_unstale":"2023-10-03T19:12:31.937025+0000","last_undegraded":"2023-10-03T19:12:31.937025+0000","last_fullsized":"2023-10-03T19:12:31.937025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:51:22.870713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954797+0000","last_change":"2023-10-03T19:12:27.962395+0000","last_active":"2023-10-03T19:12:28.954797+0000","last_peered":"2023-10-03T19:12:28.954797+0000","last_clean":"2023-10-03T19:12:28.954797+0000","last_became_active":"2023-10-03T19:12:27.962105+0000","last_became_peered":"2023-10-03T19:12:27.962105+0000","last_unstale":"2023-10-03T19:12:28.954797+0000","last_undegraded":"2023-10-03T19:12:28.954797+0000","last_fullsized":"2023-10-03T19:12:28.954797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:51:28.867821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952027+0000","last_change":"2023-10-03T19:12:27.588675+0000","last_active":"2023-10-03T19:12:28.952027+0000","last_peered":"2023-10-03T19:12:28.952027+0000","last_clean":"2023-10-03T19:12:28.952027+0000","last_became_active":"2023-10-03T19:12:27.588046+0000","last_became_peered":"2023-10-03T19:12:27.588046+0000","last_unstale":"2023-10-03T19:12:28.952027+0000","last_undegraded":"2023-10-03T19:12:28.952027+0000","last_fullsized":"2023-10-03T19:12:28.952027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:08:47.585355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953482+0000","last_change":"2023-10-03T19:12:27.965478+0000","last_active":"2023-10-03T19:12:28.953482+0000","last_peered":"2023-10-03T19:12:28.953482+0000","last_clean":"2023-10-03T19:12:28.953482+0000","last_became_active":"2023-10-03T19:12:27.964064+0000","last_became_peered":"2023-10-03T19:12:27.964064+0000","last_unstale":"2023-10-03T19:12:28.953482+0000","last_undegraded":"2023-10-03T19:12:28.953482+0000","last_fullsized":"2023-10-03T19:12:28.953482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:02:28.878823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952596+0000","last_change":"2023-10-03T19:12:27.587343+0000","last_active":"2023-10-03T19:12:28.952596+0000","last_peered":"2023-10-03T19:12:28.952596+0000","last_clean":"2023-10-03T19:12:28.952596+0000","last_became_active":"2023-10-03T19:12:27.586953+0000","last_became_peered":"2023-10-03T19:12:27.586953+0000","last_unstale":"2023-10-03T19:12:28.952596+0000","last_undegraded":"2023-10-03T19:12:28.952596+0000","last_fullsized":"2023-10-03T19:12:28.952596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:01:57.712265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.446178+0000","last_change":"2023-10-03T19:12:27.970441+0000","last_active":"2023-10-03T19:12:31.446178+0000","last_peered":"2023-10-03T19:12:31.446178+0000","last_clean":"2023-10-03T19:12:31.446178+0000","last_became_active":"2023-10-03T19:12:27.970137+0000","last_became_peered":"2023-10-03T19:12:27.970137+0000","last_unstale":"2023-10-03T19:12:31.446178+0000","last_undegraded":"2023-10-03T19:12:31.446178+0000","last_fullsized":"2023-10-03T19:12:31.446178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:39:07.804995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.446174+0000","last_change":"2023-10-03T19:12:27.586020+0000","last_active":"2023-10-03T19:12:31.446174+0000","last_peered":"2023-10-03T19:12:31.446174+0000","last_clean":"2023-10-03T19:12:31.446174+0000","last_became_active":"2023-10-03T19:12:27.585736+0000","last_became_peered":"2023-10-03T19:12:27.585736+0000","last_unstale":"2023-10-03T19:12:31.446174+0000","last_undegraded":"2023-10-03T19:12:31.446174+0000","last_fullsized":"2023-10-03T19:12:31.446174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:33:53.378803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.951761+0000","last_change":"2023-10-03T19:12:27.986822+0000","last_active":"2023-10-03T19:12:28.951761+0000","last_peered":"2023-10-03T19:12:28.951761+0000","last_clean":"2023-10-03T19:12:28.951761+0000","last_became_active":"2023-10-03T19:12:27.986532+0000","last_became_peered":"2023-10-03T19:12:27.986532+0000","last_unstale":"2023-10-03T19:12:28.951761+0000","last_undegraded":"2023-10-03T19:12:28.951761+0000","last_fullsized":"2023-10-03T19:12:28.951761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:20:24.642279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'4","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936684+0000","last_change":"2023-10-03T19:12:27.591787+0000","last_active":"2023-10-03T19:12:31.936684+0000","last_peered":"2023-10-03T19:12:31.936684+0000","last_clean":"2023-10-03T19:12:31.936684+0000","last_became_active":"2023-10-03T19:12:27.591472+0000","last_became_peered":"2023-10-03T19:12:27.591472+0000","last_unstale":"2023-10-03T19:12:31.936684+0000","last_undegraded":"2023-10-03T19:12:31.936684+0000","last_fullsized":"2023-10-03T19:12:31.936684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:37:44.604456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8944,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362896,"statfs":{"total":96636764160,"available":96627605504,"internally_reserved":0,"allocated":303104,"data_stored":667065,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]}]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8336,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363504,"statfs":{"total":96636764160,"available":96628228096,"internally_reserved":0,"allocated":204800,"data_stored":73753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8436,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363404,"statfs":{"total":96636764160,"available":96628125696,"internally_reserved":0,"allocated":241664,"data_stored":83190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]}]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12444,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":12224,"kb_avail":94359396,"statfs":{"total":96636764160,"available":96624021504,"internally_reserved":0,"allocated":217088,"data_stored":80406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12517376},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8404,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363436,"statfs":{"total":96636764160,"available":96628158464,"internally_reserved":0,"allocated":208896,"data_stored":74917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8420,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363420,"statfs":{"total":96636764160,"available":96628142080,"internally_reserved":0,"allocated":225280,"data_stored":81660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8360,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363480,"statfs":{"total":96636764160,"available":96628203520,"internally_reserved":0,"allocated":229376,"data_stored":82222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13024,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":12736,"kb_avail":94358816,"statfs":{"total":96636764160,"available":96623427584,"internally_reserved":0,"allocated":286720,"data_stored":671356,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":13041664},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:12:36.818 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-03T19:12:36.819 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-03T19:12:36.819 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-03T19:12:36.819 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-03T19:12:36.819 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-03T19:12:36.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.981+0000 7f21cc29d640 1 Processor -- start 2023-10-03T19:12:36.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.981+0000 7f21cc29d640 1 -- start start 2023-10-03T19:12:36.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.985+0000 7f21cc29d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f21c4148b90 0x7f21c40bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:36.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.985+0000 7f21cc29d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f21c40bcb60 0x7f21c406c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:36.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.985+0000 7f21cc29d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21c40bc4a0 0x7f21c406c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:36.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.985+0000 7f21cc29d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c40a3670 con 0x7f21c4148b90 2023-10-03T19:12:36.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.985+0000 7f21cc29d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c414b370 con 0x7f21c40bcb60 2023-10-03T19:12:36.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.985+0000 7f21cc29d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c414b610 con 0x7f21c40bc4a0 2023-10-03T19:12:36.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.985+0000 7f21ca039640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f21c4148b90 0x7f21c40bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:36.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.985+0000 7f21ca039640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f21c4148b90 0x7f21c40bbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41472/0 (socket says 172.21.15.45:41472) 2023-10-03T19:12:36.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.985+0000 7f21ca039640 1 -- 172.21.15.45:0/3242049607 learned_addr learned my addr 172.21.15.45:0/3242049607 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:36.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.985+0000 7f21ca83a640 1 --2- 172.21.15.45:0/3242049607 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21c40bc4a0 0x7f21c406c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:36.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.985+0000 7f21c9838640 1 --2- 172.21.15.45:0/3242049607 >> v2:172.21.15.79:3300/0 conn(0x7f21c40bcb60 0x7f21c406c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:36.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.985+0000 7f21ca039640 1 -- 172.21.15.45:0/3242049607 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21c40bc4a0 msgr2=0x7f21c406c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:36.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.985+0000 7f21ca039640 1 --2- 172.21.15.45:0/3242049607 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21c40bc4a0 0x7f21c406c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:36.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.985+0000 7f21ca039640 1 -- 172.21.15.45:0/3242049607 >> v2:172.21.15.79:3300/0 conn(0x7f21c40bcb60 msgr2=0x7f21c406c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:36.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.985+0000 7f21ca039640 1 --2- 172.21.15.45:0/3242049607 >> v2:172.21.15.79:3300/0 conn(0x7f21c40bcb60 0x7f21c406c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:36.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.985+0000 7f21ca039640 1 -- 172.21.15.45:0/3242049607 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c40a5580 con 0x7f21c4148b90 2023-10-03T19:12:36.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.985+0000 7f21ca039640 1 --2- 172.21.15.45:0/3242049607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21c4148b90 0x7f21c40bbf60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f21c406b210 tx=0x7f21bc01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4626c19e1ce718 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:36.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.985+0000 7f21c9037640 1 -- 172.21.15.45:0/3242049607 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc0af400 con 0x7f21c4148b90 2023-10-03T19:12:36.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.985+0000 7f21c9037640 1 -- 172.21.15.45:0/3242049607 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21bc0ab050 con 0x7f21c4148b90 2023-10-03T19:12:36.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.985+0000 7f21c9037640 1 -- 172.21.15.45:0/3242049607 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc0af780 con 0x7f21c4148b90 2023-10-03T19:12:36.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.985+0000 7f21cc29d640 1 -- 172.21.15.45:0/3242049607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21c4148b90 msgr2=0x7f21c40bbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:36.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.985+0000 7f21cc29d640 1 --2- 172.21.15.45:0/3242049607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21c4148b90 0x7f21c40bbf60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f21c406b210 tx=0x7f21bc01f1c0 comp rx=0 tx=0).stop 2023-10-03T19:12:36.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.985+0000 7f21cc29d640 1 -- 172.21.15.45:0/3242049607 shutdown_connections 2023-10-03T19:12:36.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.985+0000 7f21cc29d640 1 --2- 172.21.15.45:0/3242049607 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21c40bc4a0 0x7f21c406c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:36.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.985+0000 7f21cc29d640 1 --2- 172.21.15.45:0/3242049607 >> v2:172.21.15.79:3300/0 conn(0x7f21c40bcb60 0x7f21c406c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:36.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.985+0000 7f21cc29d640 1 --2- 172.21.15.45:0/3242049607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21c4148b90 0x7f21c40bbf60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:36.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.985+0000 7f21cc29d640 1 -- 172.21.15.45:0/3242049607 >> 172.21.15.45:0/3242049607 conn(0x7f21c40bcf50 msgr2=0x7f21c40bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:36.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.985+0000 7f21cc29d640 1 -- 172.21.15.45:0/3242049607 shutdown_connections 2023-10-03T19:12:36.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.985+0000 7f21cc29d640 1 -- 172.21.15.45:0/3242049607 wait complete. 2023-10-03T19:12:36.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.989+0000 7f21cc29d640 1 Processor -- start 2023-10-03T19:12:36.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.989+0000 7f21cc29d640 1 -- start start 2023-10-03T19:12:36.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.989+0000 7f21cc29d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21c40bc4a0 0x7f21c41e1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:36.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.989+0000 7f21cc29d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21c40bcb60 0x7f21c41444a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:36.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.989+0000 7f21cc29d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c4148b90 0x7f21c41449e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:36.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.989+0000 7f21cc29d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c40b5ac0 con 0x7f21c40bcb60 2023-10-03T19:12:36.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.989+0000 7f21cc29d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c4144f20 con 0x7f21c4148b90 2023-10-03T19:12:36.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.989+0000 7f21cc29d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c41e2150 con 0x7f21c40bc4a0 2023-10-03T19:12:36.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.989+0000 7f21c9838640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21c40bcb60 0x7f21c41444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:36.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.989+0000 7f21c9838640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21c40bcb60 0x7f21c41444a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41476/0 (socket says 172.21.15.45:41476) 2023-10-03T19:12:36.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.989+0000 7f21c9838640 1 -- 172.21.15.45:0/1149840099 learned_addr learned my addr 172.21.15.45:0/1149840099 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:36.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.989+0000 7f21ca039640 1 --2- 172.21.15.45:0/1149840099 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21c40bc4a0 0x7f21c41e1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:36.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.989+0000 7f21ca83a640 1 --2- 172.21.15.45:0/1149840099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c4148b90 0x7f21c41449e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:36.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.989+0000 7f21c9838640 1 -- 172.21.15.45:0/1149840099 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21c40bc4a0 msgr2=0x7f21c41e1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:36.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.989+0000 7f21c9838640 1 --2- 172.21.15.45:0/1149840099 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21c40bc4a0 0x7f21c41e1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:36.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.989+0000 7f21c9838640 1 -- 172.21.15.45:0/1149840099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c4148b90 msgr2=0x7f21c41449e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:36.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.989+0000 7f21c9838640 1 --2- 172.21.15.45:0/1149840099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c4148b90 0x7f21c41449e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:36.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.989+0000 7f21c9838640 1 -- 172.21.15.45:0/1149840099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21bc009b30 con 0x7f21c40bcb60 2023-10-03T19:12:36.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.989+0000 7f21c9838640 1 --2- 172.21.15.45:0/1149840099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21c40bcb60 0x7f21c41444a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f21b800d830 tx=0x7f21b800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:36.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.989+0000 7f21c2ffd640 1 -- 172.21.15.45:0/1149840099 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b800b6c0 con 0x7f21c40bcb60 2023-10-03T19:12:36.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.989+0000 7f21c2ffd640 1 -- 172.21.15.45:0/1149840099 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b800b820 con 0x7f21c40bcb60 2023-10-03T19:12:36.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.989+0000 7f21cc29d640 1 -- 172.21.15.45:0/1149840099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c4148f60 con 0x7f21c40bcb60 2023-10-03T19:12:36.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.989+0000 7f21c2ffd640 1 -- 172.21.15.45:0/1149840099 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b800bb90 con 0x7f21c40bcb60 2023-10-03T19:12:36.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.989+0000 7f21cc29d640 1 -- 172.21.15.45:0/1149840099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c40a5820 con 0x7f21c40bcb60 2023-10-03T19:12:36.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.993+0000 7f21cc29d640 1 -- 172.21.15.45:0/1149840099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c40a3880 con 0x7f21c40bcb60 2023-10-03T19:12:36.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.993+0000 7f21c2ffd640 1 -- 172.21.15.45:0/1149840099 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f21b801e460 con 0x7f21c40bcb60 2023-10-03T19:12:36.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.993+0000 7f21c2ffd640 1 --2- 172.21.15.45:0/1149840099 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f21b0066280 0x7f21b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:36.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.993+0000 7f21c2ffd640 1 -- 172.21.15.45:0/1149840099 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f21b8084520 con 0x7f21c40bcb60 2023-10-03T19:12:36.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.993+0000 7f21ca039640 1 --2- 172.21.15.45:0/1149840099 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f21b0066280 0x7f21b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:36.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.993+0000 7f21ca039640 1 --2- 172.21.15.45:0/1149840099 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f21b0066280 0x7f21b0068730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f21bc0b1000 tx=0x7f21bc0aa000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:37.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:36.997+0000 7f21c2ffd640 1 -- 172.21.15.45:0/1149840099 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f21b8051910 con 0x7f21c40bcb60 2023-10-03T19:12:37.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.185+0000 7f21cc29d640 1 -- 172.21.15.45:0/1149840099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f21c404de80 con 0x7f21c40bcb60 2023-10-03T19:12:37.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.193+0000 7f21c2ffd640 1 -- 172.21.15.45:0/1149840099 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164242 (secure 0 0 0) 0x7f21b8054f30 con 0x7f21c40bcb60 2023-10-03T19:12:37.197 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.193+0000 7f21cc29d640 1 -- 172.21.15.45:0/1149840099 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f21b0066280 msgr2=0x7f21b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.193+0000 7f21cc29d640 1 --2- 172.21.15.45:0/1149840099 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f21b0066280 0x7f21b0068730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f21bc0b1000 tx=0x7f21bc0aa000 comp rx=0 tx=0).stop 2023-10-03T19:12:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.193+0000 7f21cc29d640 1 -- 172.21.15.45:0/1149840099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21c40bcb60 msgr2=0x7f21c41444a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.193+0000 7f21cc29d640 1 --2- 172.21.15.45:0/1149840099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21c40bcb60 0x7f21c41444a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f21b800d830 tx=0x7f21b800dcf0 comp rx=0 tx=0).stop 2023-10-03T19:12:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.193+0000 7f21cc29d640 1 -- 172.21.15.45:0/1149840099 shutdown_connections 2023-10-03T19:12:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.193+0000 7f21cc29d640 1 --2- 172.21.15.45:0/1149840099 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f21b0066280 0x7f21b0068730 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.193+0000 7f21cc29d640 1 --2- 172.21.15.45:0/1149840099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c4148b90 0x7f21c41449e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.193+0000 7f21cc29d640 1 --2- 172.21.15.45:0/1149840099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21c40bcb60 0x7f21c41444a0 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f21b800d830 tx=0x7f21b800dcf0 comp rx=0 tx=0).stop 2023-10-03T19:12:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.193+0000 7f21cc29d640 1 --2- 172.21.15.45:0/1149840099 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21c40bc4a0 0x7f21c41e1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.193+0000 7f21cc29d640 1 -- 172.21.15.45:0/1149840099 >> 172.21.15.45:0/1149840099 conn(0x7f21c40bcf50 msgr2=0x7f21c40bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.193+0000 7f21cc29d640 1 -- 172.21.15.45:0/1149840099 shutdown_connections 2023-10-03T19:12:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.193+0000 7f21cc29d640 1 -- 172.21.15.45:0/1149840099 wait complete. 2023-10-03T19:12:37.214 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":5,"active_gid":4106,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1497032475},{"type":"v1","addr":"172.21.15.79:6801","nonce":1497032475}]},"active_addr":"172.21.15.79:6801/1497032475","active_change":"2023-10-03T19:12:10.424736+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":2938913783}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":2832471109}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":4114391109}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":1525778118}]}]} 2023-10-03T19:12:37.218 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-03T19:12:37.218 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-03T19:12:37.219 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:12:37.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.333+0000 7fbfb9b06640 1 Processor -- start 2023-10-03T19:12:37.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.333+0000 7fbfb9b06640 1 -- start start 2023-10-03T19:12:37.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.337+0000 7fbfb9b06640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbfb406cd40 0x7fbfb414aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:37.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.337+0000 7fbfb9b06640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbfb4147ab0 0x7fbfb4147f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:37.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.337+0000 7fbfb9b06640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb40bc430 con 0x7fbfb40a3670 2023-10-03T19:12:37.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.337+0000 7fbfb9b06640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfb40a5db0 con 0x7fbfb406cd40 2023-10-03T19:12:37.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.337+0000 7fbfb9b06640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb4148470 con 0x7fbfb4147ab0 2023-10-03T19:12:37.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.337+0000 7fbfb37fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbfb406cd40 0x7fbfb414aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:37.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.337+0000 7fbfb2ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbfb40a3670 0x7fbfb40bbd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33422/0 (socket says 172.21.15.45:33422) 2023-10-03T19:12:37.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.337+0000 7fbfb2ffd640 1 -- 172.21.15.45:0/3834474550 learned_addr learned my addr 172.21.15.45:0/3834474550 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:37.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.337+0000 7fbfb3fff640 1 --2- 172.21.15.45:0/3834474550 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbfb4147ab0 0x7fbfb4147f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:37.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.337+0000 7fbfb37fe640 1 -- 172.21.15.45:0/3834474550 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbfb4147ab0 msgr2=0x7fbfb4147f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:37.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.337+0000 7fbfb37fe640 1 --2- 172.21.15.45:0/3834474550 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbfb4147ab0 0x7fbfb4147f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:37.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.337+0000 7fbfb37fe640 1 -- 172.21.15.45:0/3834474550 >> v1:172.21.15.45:6789/0 conn(0x7fbfb40a3670 legacy=0x7fbfb40bbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:37.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.337+0000 7fbfb37fe640 1 -- 172.21.15.45:0/3834474550 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb40baf60 con 0x7fbfb406cd40 2023-10-03T19:12:37.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.337+0000 7fbfb37fe640 1 --2- 172.21.15.45:0/3834474550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfb406cd40 0x7fbfb414aa50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbfa40097c0 tx=0x7fbfa4020e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f309a03eadcc18ff server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:37.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.337+0000 7fbfb27fc640 1 -- 172.21.15.45:0/3834474550 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa40aab80 con 0x7fbfb406cd40 2023-10-03T19:12:37.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.337+0000 7fbfb27fc640 1 -- 172.21.15.45:0/3834474550 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa40aace0 con 0x7fbfb406cd40 2023-10-03T19:12:37.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.337+0000 7fbfb27fc640 1 -- 172.21.15.45:0/3834474550 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa40b2660 con 0x7fbfb406cd40 2023-10-03T19:12:37.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.337+0000 7fbfb9b06640 1 -- 172.21.15.45:0/3834474550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfb406cd40 msgr2=0x7fbfb414aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:37.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.337+0000 7fbfb9b06640 1 --2- 172.21.15.45:0/3834474550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfb406cd40 0x7fbfb414aa50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbfa40097c0 tx=0x7fbfa4020e80 comp rx=0 tx=0).stop 2023-10-03T19:12:37.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbfb9b06640 1 -- 172.21.15.45:0/3834474550 shutdown_connections 2023-10-03T19:12:37.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbfb9b06640 1 --2- 172.21.15.45:0/3834474550 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbfb4147ab0 0x7fbfb4147f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:37.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbfb9b06640 1 --2- 172.21.15.45:0/3834474550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfb406cd40 0x7fbfb414aa50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:37.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbfb9b06640 1 -- 172.21.15.45:0/3834474550 >> 172.21.15.45:0/3834474550 conn(0x7fbfb40bcf50 msgr2=0x7fbfb40bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:37.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbfb9b06640 1 -- 172.21.15.45:0/3834474550 shutdown_connections 2023-10-03T19:12:37.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbfb9b06640 1 -- 172.21.15.45:0/3834474550 wait complete. 2023-10-03T19:12:37.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbfb9b06640 1 Processor -- start 2023-10-03T19:12:37.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbfb9b06640 1 -- start start 2023-10-03T19:12:37.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbfb9b06640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfb406cd40 0x7fbfb41d3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:37.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbfb9b06640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfb40a3670 0x7fbfb40bf420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:37.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbfb9b06640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbfb4147ab0 0x7fbfb414a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:37.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbfb9b06640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb41d4cf0 con 0x7fbfb406cd40 2023-10-03T19:12:37.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbfb9b06640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb4071840 con 0x7fbfb40a3670 2023-10-03T19:12:37.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbfb9b06640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb41d43a0 con 0x7fbfb4147ab0 2023-10-03T19:12:37.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbfb37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfb406cd40 0x7fbfb41d3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:37.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbfb37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfb406cd40 0x7fbfb41d3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41490/0 (socket says 172.21.15.45:41490) 2023-10-03T19:12:37.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbfb37fe640 1 -- 172.21.15.45:0/3820338535 learned_addr learned my addr 172.21.15.45:0/3820338535 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:37.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbfb2ffd640 1 --2- 172.21.15.45:0/3820338535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfb40a3670 0x7fbfb40bf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:37.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbfb3fff640 1 --2- 172.21.15.45:0/3820338535 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbfb4147ab0 0x7fbfb414a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:37.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbfb37fe640 1 -- 172.21.15.45:0/3820338535 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbfb4147ab0 msgr2=0x7fbfb414a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:37.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbfb37fe640 1 --2- 172.21.15.45:0/3820338535 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbfb4147ab0 0x7fbfb414a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:37.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbfb37fe640 1 -- 172.21.15.45:0/3820338535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfb40a3670 msgr2=0x7fbfb40bf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:37.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbfb37fe640 1 --2- 172.21.15.45:0/3820338535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfb40a3670 0x7fbfb40bf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:37.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbfb37fe640 1 -- 172.21.15.45:0/3820338535 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa4009420 con 0x7fbfb406cd40 2023-10-03T19:12:37.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbfb2ffd640 1 --2- 172.21.15.45:0/3820338535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfb40a3670 0x7fbfb40bf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:37.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbfb3fff640 1 --2- 172.21.15.45:0/3820338535 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbfb4147ab0 0x7fbfb414a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:37.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbfb37fe640 1 --2- 172.21.15.45:0/3820338535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfb406cd40 0x7fbfb41d3e60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbfa40b5040 tx=0x7fbfa401dc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:37.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbf9bfff640 1 -- 172.21.15.45:0/3820338535 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa40ba5f0 con 0x7fbfb406cd40 2023-10-03T19:12:37.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbf9bfff640 1 -- 172.21.15.45:0/3820338535 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa40ba770 con 0x7fbfb406cd40 2023-10-03T19:12:37.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbfb9b06640 1 -- 172.21.15.45:0/3820338535 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb40bb520 con 0x7fbfb406cd40 2023-10-03T19:12:37.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbf9bfff640 1 -- 172.21.15.45:0/3820338535 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa40bab20 con 0x7fbfb406cd40 2023-10-03T19:12:37.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbfb9b06640 1 -- 172.21.15.45:0/3820338535 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb40bb240 con 0x7fbfb406cd40 2023-10-03T19:12:37.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.341+0000 7fbfb9b06640 1 -- 172.21.15.45:0/3820338535 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfb40bb800 con 0x7fbfb406cd40 2023-10-03T19:12:37.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.345+0000 7fbf9bfff640 1 -- 172.21.15.45:0/3820338535 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbfa40bac80 con 0x7fbfb406cd40 2023-10-03T19:12:37.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.345+0000 7fbf9bfff640 1 --2- 172.21.15.45:0/3820338535 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbfa0066280 0x7fbfa0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:37.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.345+0000 7fbf9bfff640 1 -- 172.21.15.45:0/3820338535 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbfa4121cd0 con 0x7fbfb406cd40 2023-10-03T19:12:37.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.345+0000 7fbfb2ffd640 1 --2- 172.21.15.45:0/3820338535 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbfa0066280 0x7fbfa0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:37.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.345+0000 7fbfb2ffd640 1 --2- 172.21.15.45:0/3820338535 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbfa0066280 0x7fbfa0068730 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4147260 tx=0x7fbfa8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:37.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.349+0000 7fbf9bfff640 1 -- 172.21.15.45:0/3820338535 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbfa40ef1e0 con 0x7fbfb406cd40 2023-10-03T19:12:37.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.505+0000 7fbfb9b06640 1 -- 172.21.15.45:0/3820338535 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfb4067f40 con 0x7fbfb406cd40 2023-10-03T19:12:37.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.505+0000 7fbf9bfff640 1 -- 172.21.15.45:0/3820338535 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18231 (secure 0 0 0) 0x7fbfa4006e20 con 0x7fbfb406cd40 2023-10-03T19:12:37.511 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:37.511 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:12:28.941467+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:12:26.226431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T19:12:26.923174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:12:37.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.509+0000 7fbfb9b06640 1 -- 172.21.15.45:0/3820338535 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbfa0066280 msgr2=0x7fbfa0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:37.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.509+0000 7fbfb9b06640 1 --2- 172.21.15.45:0/3820338535 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbfa0066280 0x7fbfa0068730 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4147260 tx=0x7fbfa8009040 comp rx=0 tx=0).stop 2023-10-03T19:12:37.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.509+0000 7fbfb9b06640 1 -- 172.21.15.45:0/3820338535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfb406cd40 msgr2=0x7fbfb41d3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:37.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.509+0000 7fbfb9b06640 1 --2- 172.21.15.45:0/3820338535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfb406cd40 0x7fbfb41d3e60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbfa40b5040 tx=0x7fbfa401dc20 comp rx=0 tx=0).stop 2023-10-03T19:12:37.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.509+0000 7fbfb9b06640 1 -- 172.21.15.45:0/3820338535 shutdown_connections 2023-10-03T19:12:37.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.509+0000 7fbfb9b06640 1 --2- 172.21.15.45:0/3820338535 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbfa0066280 0x7fbfa0068730 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:37.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.509+0000 7fbfb9b06640 1 --2- 172.21.15.45:0/3820338535 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbfb4147ab0 0x7fbfb414a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:37.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.509+0000 7fbfb9b06640 1 --2- 172.21.15.45:0/3820338535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfb40a3670 0x7fbfb40bf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:37.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.509+0000 7fbfb9b06640 1 --2- 172.21.15.45:0/3820338535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfb406cd40 0x7fbfb41d3e60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:37.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.509+0000 7fbfb9b06640 1 -- 172.21.15.45:0/3820338535 >> 172.21.15.45:0/3820338535 conn(0x7fbfb40bcf50 msgr2=0x7fbfb40a3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:37.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.509+0000 7fbfb9b06640 1 -- 172.21.15.45:0/3820338535 shutdown_connections 2023-10-03T19:12:37.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.509+0000 7fbfb9b06640 1 -- 172.21.15.45:0/3820338535 wait complete. 2023-10-03T19:12:37.530 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-03T19:12:37.531 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:12:37.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.645+0000 7f212dc49640 1 Processor -- start 2023-10-03T19:12:37.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.645+0000 7f212dc49640 1 -- start start 2023-10-03T19:12:37.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.645+0000 7f212dc49640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f212814f240 0x7f21281528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:37.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.645+0000 7f212dc49640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f21280c2790 0x7f21280c0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:37.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.645+0000 7f212dc49640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f212806b2d0 con 0x7f21280bb1d0 2023-10-03T19:12:37.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.645+0000 7f212dc49640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f212806b640 con 0x7f21280c2790 2023-10-03T19:12:37.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.645+0000 7f212dc49640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21280c0fa0 con 0x7f212814f240 2023-10-03T19:12:37.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.645+0000 7f2126ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f21280c2790 0x7f21280c0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:37.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.645+0000 7f2126ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f21280c2790 0x7f21280c0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41496/0 (socket says 172.21.15.45:41496) 2023-10-03T19:12:37.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.645+0000 7f2126ffd640 1 -- 172.21.15.45:0/131101548 learned_addr learned my addr 172.21.15.45:0/131101548 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:37.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.645+0000 7f21277fe640 1 --2- 172.21.15.45:0/131101548 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f212814f240 0x7f21281528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:37.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.645+0000 7f2126ffd640 1 -- 172.21.15.45:0/131101548 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f212814f240 msgr2=0x7f21281528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:37.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.645+0000 7f2126ffd640 1 --2- 172.21.15.45:0/131101548 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f212814f240 0x7f21281528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:37.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.645+0000 7f2126ffd640 1 -- 172.21.15.45:0/131101548 >> v1:172.21.15.79:6789/0 conn(0x7f21280bb1d0 legacy=0x7f21280c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:37.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.645+0000 7f2126ffd640 1 -- 172.21.15.45:0/131101548 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21280a3c60 con 0x7f21280c2790 2023-10-03T19:12:37.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.645+0000 7f21277fe640 1 --2- 172.21.15.45:0/131101548 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f212814f240 0x7f21281528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:12:37.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f2126ffd640 1 --2- 172.21.15.45:0/131101548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21280c2790 0x7f21280c0a60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f211c006fd0 tx=0x7f211c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43948c4b8cbc7c3e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:37.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f21267fc640 1 -- 172.21.15.45:0/131101548 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c0a8a10 con 0x7f21280c2790 2023-10-03T19:12:37.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f21267fc640 1 -- 172.21.15.45:0/131101548 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211c0a8b70 con 0x7f21280c2790 2023-10-03T19:12:37.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f21267fc640 1 -- 172.21.15.45:0/131101548 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c0b0440 con 0x7f21280c2790 2023-10-03T19:12:37.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f212dc49640 1 -- 172.21.15.45:0/131101548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21280c2790 msgr2=0x7f21280c0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:37.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f212dc49640 1 --2- 172.21.15.45:0/131101548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21280c2790 0x7f21280c0a60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f211c006fd0 tx=0x7f211c01ed10 comp rx=0 tx=0).stop 2023-10-03T19:12:37.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f212dc49640 1 -- 172.21.15.45:0/131101548 shutdown_connections 2023-10-03T19:12:37.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f212dc49640 1 --2- 172.21.15.45:0/131101548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21280c2790 0x7f21280c0a60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:37.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f212dc49640 1 --2- 172.21.15.45:0/131101548 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f212814f240 0x7f21281528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:37.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f212dc49640 1 -- 172.21.15.45:0/131101548 >> 172.21.15.45:0/131101548 conn(0x7f21280a64a0 msgr2=0x7f21280a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:37.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f212dc49640 1 -- 172.21.15.45:0/131101548 shutdown_connections 2023-10-03T19:12:37.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f212dc49640 1 -- 172.21.15.45:0/131101548 wait complete. 2023-10-03T19:12:37.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f212dc49640 1 Processor -- start 2023-10-03T19:12:37.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f212dc49640 1 -- start start 2023-10-03T19:12:37.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f212dc49640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21280bb1d0 0x7f21281519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:37.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f212dc49640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21280c2790 0x7f21281daf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:37.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f212dc49640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f212814f240 0x7f21281e7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:37.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f212dc49640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21281515b0 con 0x7f212814f240 2023-10-03T19:12:37.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f212dc49640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2128149ca0 con 0x7f21280c2790 2023-10-03T19:12:37.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f212dc49640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2128149720 con 0x7f21280bb1d0 2023-10-03T19:12:37.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f2127fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f212814f240 0x7f21281e7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:37.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f2127fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f212814f240 0x7f21281e7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41506/0 (socket says 172.21.15.45:41506) 2023-10-03T19:12:37.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f2127fff640 1 -- 172.21.15.45:0/1275473067 learned_addr learned my addr 172.21.15.45:0/1275473067 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:37.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f2126ffd640 1 --2- 172.21.15.45:0/1275473067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21280c2790 0x7f21281daf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:37.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f21277fe640 1 --2- 172.21.15.45:0/1275473067 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21280bb1d0 0x7f21281519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:37.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f2127fff640 1 -- 172.21.15.45:0/1275473067 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21280bb1d0 msgr2=0x7f21281519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:37.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f2127fff640 1 --2- 172.21.15.45:0/1275473067 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21280bb1d0 0x7f21281519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:37.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f2127fff640 1 -- 172.21.15.45:0/1275473067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21280c2790 msgr2=0x7f21281daf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:37.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f2127fff640 1 --2- 172.21.15.45:0/1275473067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21280c2790 0x7f21281daf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:37.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f2127fff640 1 -- 172.21.15.45:0/1275473067 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211c009480 con 0x7f212814f240 2023-10-03T19:12:37.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f21277fe640 1 --2- 172.21.15.45:0/1275473067 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21280bb1d0 0x7f21281519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:37.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f2127fff640 1 --2- 172.21.15.45:0/1275473067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f212814f240 0x7f21281e7000 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f212000c770 tx=0x7f212000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:37.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.649+0000 7f210ffff640 1 -- 172.21.15.45:0/1275473067 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2120003b80 con 0x7f212814f240 2023-10-03T19:12:37.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.653+0000 7f210ffff640 1 -- 172.21.15.45:0/1275473067 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2120003ce0 con 0x7f212814f240 2023-10-03T19:12:37.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.653+0000 7f212dc49640 1 -- 172.21.15.45:0/1275473067 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212814e740 con 0x7f212814f240 2023-10-03T19:12:37.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.653+0000 7f210ffff640 1 -- 172.21.15.45:0/1275473067 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212000aa30 con 0x7f212814f240 2023-10-03T19:12:37.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.653+0000 7f212dc49640 1 -- 172.21.15.45:0/1275473067 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21280c19b0 con 0x7f212814f240 2023-10-03T19:12:37.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.653+0000 7f212dc49640 1 -- 172.21.15.45:0/1275473067 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21280a3f40 con 0x7f212814f240 2023-10-03T19:12:37.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.653+0000 7f210ffff640 1 -- 172.21.15.45:0/1275473067 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f212000ab90 con 0x7f212814f240 2023-10-03T19:12:37.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.653+0000 7f210ffff640 1 --2- 172.21.15.45:0/1275473067 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2114066280 0x7f2114068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:37.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.653+0000 7f210ffff640 1 -- 172.21.15.45:0/1275473067 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2120083a80 con 0x7f212814f240 2023-10-03T19:12:37.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.653+0000 7f21277fe640 1 --2- 172.21.15.45:0/1275473067 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2114066280 0x7f2114068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:37.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.653+0000 7f21277fe640 1 --2- 172.21.15.45:0/1275473067 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2114066280 0x7f2114068730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2118006fd0 tx=0x7f2118008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:37.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.657+0000 7f210ffff640 1 -- 172.21.15.45:0/1275473067 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2120050f90 con 0x7f212814f240 2023-10-03T19:12:37.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.813+0000 7f212dc49640 1 -- 172.21.15.45:0/1275473067 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21280bfa90 con 0x7f212814f240 2023-10-03T19:12:37.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.817+0000 7f210ffff640 1 -- 172.21.15.45:0/1275473067 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18231 (secure 0 0 0) 0x7f21200545b0 con 0x7f212814f240 2023-10-03T19:12:37.820 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:37.820 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:12:28.941467+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:12:26.226431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T19:12:26.923174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:12:37.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.817+0000 7f212dc49640 1 -- 172.21.15.45:0/1275473067 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2114066280 msgr2=0x7f2114068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:37.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.817+0000 7f212dc49640 1 --2- 172.21.15.45:0/1275473067 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2114066280 0x7f2114068730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2118006fd0 tx=0x7f2118008040 comp rx=0 tx=0).stop 2023-10-03T19:12:37.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.817+0000 7f212dc49640 1 -- 172.21.15.45:0/1275473067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f212814f240 msgr2=0x7f21281e7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:37.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.817+0000 7f212dc49640 1 --2- 172.21.15.45:0/1275473067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f212814f240 0x7f21281e7000 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f212000c770 tx=0x7f212000cc30 comp rx=0 tx=0).stop 2023-10-03T19:12:37.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.817+0000 7f212dc49640 1 -- 172.21.15.45:0/1275473067 shutdown_connections 2023-10-03T19:12:37.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.817+0000 7f212dc49640 1 --2- 172.21.15.45:0/1275473067 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2114066280 0x7f2114068730 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:37.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.817+0000 7f212dc49640 1 --2- 172.21.15.45:0/1275473067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f212814f240 0x7f21281e7000 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:37.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.817+0000 7f212dc49640 1 --2- 172.21.15.45:0/1275473067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21280c2790 0x7f21281daf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:37.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.817+0000 7f212dc49640 1 --2- 172.21.15.45:0/1275473067 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21280bb1d0 0x7f21281519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:37.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.817+0000 7f212dc49640 1 -- 172.21.15.45:0/1275473067 >> 172.21.15.45:0/1275473067 conn(0x7f21280a64a0 msgr2=0x7f21280c12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:37.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.817+0000 7f212dc49640 1 -- 172.21.15.45:0/1275473067 shutdown_connections 2023-10-03T19:12:37.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:37.817+0000 7f212dc49640 1 -- 172.21.15.45:0/1275473067 wait complete. 2023-10-03T19:12:37.840 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-03T19:12:37.840 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-03T19:12:37.841 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-03T19:12:37.841 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-03T19:12:37.842 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-03T19:12:37.842 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-03T19:12:37.842 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-03T19:12:37.843 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-03T19:12:38.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.013+0000 7f8c0b8ed640 1 Processor -- start 2023-10-03T19:12:38.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.013+0000 7f8c0b8ed640 1 -- start start 2023-10-03T19:12:38.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.017+0000 7f8c0b8ed640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8c04150400 0x7f8c0406c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.017+0000 7f8c0b8ed640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8c040bca80 0x7f8c04156820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.017+0000 7f8c0b8ed640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c040a1720 con 0x7f8c0406c620 2023-10-03T19:12:38.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.017+0000 7f8c0b8ed640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c040a2230 con 0x7f8c040bca80 2023-10-03T19:12:38.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.017+0000 7f8c0b8ed640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c040a18d0 con 0x7f8c04150400 2023-10-03T19:12:38.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.017+0000 7f8c08e88640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8c0406c620 0x7f8c04156110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33428/0 (socket says 172.21.15.45:33428) 2023-10-03T19:12:38.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.017+0000 7f8c08e88640 1 -- 172.21.15.45:0/2711319302 learned_addr learned my addr 172.21.15.45:0/2711319302 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:38.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.017+0000 7f8c09e8a640 1 --2- 172.21.15.45:0/2711319302 >> v2:172.21.15.45:3300/0 conn(0x7f8c040bca80 0x7f8c04156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.017+0000 7f8c09689640 1 --2- 172.21.15.45:0/2711319302 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8c04150400 0x7f8c0406c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.017+0000 7f8bfbfff640 1 -- 172.21.15.45:0/2711319302 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 492145270 0 0) 0x7f8c040a1720 con 0x7f8c0406c620 2023-10-03T19:12:38.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.017+0000 7f8bfbfff640 1 -- 172.21.15.45:0/2711319302 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bf0003530 con 0x7f8c0406c620 2023-10-03T19:12:38.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.017+0000 7f8c09e8a640 1 -- 172.21.15.45:0/2711319302 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8c04150400 msgr2=0x7f8c0406c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:38.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.017+0000 7f8c09e8a640 1 --2- 172.21.15.45:0/2711319302 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8c04150400 0x7f8c0406c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.017+0000 7f8c09e8a640 1 -- 172.21.15.45:0/2711319302 >> v1:172.21.15.45:6789/0 conn(0x7f8c0406c620 legacy=0x7f8c04156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.017+0000 7f8bfbfff640 1 -- 172.21.15.45:0/2711319302 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 870942954 0 0) 0x7f8bf0003530 con 0x7f8c0406c620 2023-10-03T19:12:38.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.017+0000 7f8c09e8a640 1 -- 172.21.15.45:0/2711319302 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c041507d0 con 0x7f8c040bca80 2023-10-03T19:12:38.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.017+0000 7f6ae5cca640 1 Processor -- start 2023-10-03T19:12:38.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.017+0000 7f6ae5cca640 1 -- start start 2023-10-03T19:12:38.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.017+0000 7f6ae5cca640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6ae0148360 0x7f6ae00703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.017+0000 7f6ae5cca640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6ae014e1a0 0x7f6ae00bdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.017+0000 7f6ae5cca640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae014ae50 con 0x7f6ae00be450 2023-10-03T19:12:38.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.017+0000 7f6ae5cca640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae006cc60 con 0x7f6ae0148360 2023-10-03T19:12:38.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.017+0000 7f6ae5cca640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae0070e10 con 0x7f6ae014e1a0 2023-10-03T19:12:38.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7f6adffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6ae00be450 0x7f6ae014b2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33434/0 (socket says 172.21.15.45:33434) 2023-10-03T19:12:38.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7f6adffff640 1 -- 172.21.15.45:0/1371766837 learned_addr learned my addr 172.21.15.45:0/1371766837 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:38.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7f6adeffd640 1 --2- 172.21.15.45:0/1371766837 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6ae014e1a0 0x7f6ae00bdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7f6ade7fc640 1 -- 172.21.15.45:0/1371766837 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 560208403 0 0) 0x7f6ae014ae50 con 0x7f6ae00be450 2023-10-03T19:12:38.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7f6ade7fc640 1 -- 172.21.15.45:0/1371766837 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ac8003530 con 0x7f6ae00be450 2023-10-03T19:12:38.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7f6adeffd640 1 -- 172.21.15.45:0/1371766837 >> v2:172.21.15.45:3300/0 conn(0x7f6ae0148360 msgr2=0x7f6ae00703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:38.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7f6adeffd640 1 --2- 172.21.15.45:0/1371766837 >> v2:172.21.15.45:3300/0 conn(0x7f6ae0148360 0x7f6ae00703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7f6adeffd640 1 -- 172.21.15.45:0/1371766837 >> v1:172.21.15.45:6789/0 conn(0x7f6ae00be450 legacy=0x7f6ae014b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7f6adeffd640 1 -- 172.21.15.45:0/1371766837 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae006c6e0 con 0x7f6ae014e1a0 2023-10-03T19:12:38.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7f8c09e8a640 1 --2- 172.21.15.45:0/2711319302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c040bca80 0x7f8c04156820 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8c000097c0 tx=0x7f8c0001c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4df00c265fa05 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7f8bfbfff640 1 -- 172.21.15.45:0/2711319302 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4001680 con 0x7f8c040bca80 2023-10-03T19:12:38.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7f8bfbfff640 1 -- 172.21.15.45:0/2711319302 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c000a7050 con 0x7f8c040bca80 2023-10-03T19:12:38.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7f8bfbfff640 1 -- 172.21.15.45:0/2711319302 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c000ab620 con 0x7f8c040bca80 2023-10-03T19:12:38.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7f50c18f9640 1 Processor -- start 2023-10-03T19:12:38.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7fcaa5bab640 1 Processor -- start 2023-10-03T19:12:38.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7fcaa5bab640 1 -- start start 2023-10-03T19:12:38.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7f8c0b8ed640 1 -- 172.21.15.45:0/2711319302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c040bca80 msgr2=0x7f8c04156820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7f8c0b8ed640 1 --2- 172.21.15.45:0/2711319302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c040bca80 0x7f8c04156820 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8c000097c0 tx=0x7f8c0001c310 comp rx=0 tx=0).stop 2023-10-03T19:12:38.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7f50c18f9640 1 -- start start 2023-10-03T19:12:38.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7f8c0b8ed640 1 -- 172.21.15.45:0/2711319302 shutdown_connections 2023-10-03T19:12:38.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7f8c0b8ed640 1 --2- 172.21.15.45:0/2711319302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c040bca80 0x7f8c04156820 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7f8c0b8ed640 1 --2- 172.21.15.45:0/2711319302 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8c04150400 0x7f8c0406c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7f8c0b8ed640 1 -- 172.21.15.45:0/2711319302 >> 172.21.15.45:0/2711319302 conn(0x7f8c040bcf50 msgr2=0x7f8c040bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7f8c0b8ed640 1 -- 172.21.15.45:0/2711319302 shutdown_connections 2023-10-03T19:12:38.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7fcaa5bab640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcaa0149d30 0x7fcaa00bd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7fcaa5bab640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcaa00bdba0 0x7fcaa006c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7fcaa5bab640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa014a100 con 0x7fcaa00bae50 2023-10-03T19:12:38.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7fcaa5bab640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa006f490 con 0x7fcaa0149d30 2023-10-03T19:12:38.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7fcaa5bab640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa006f1a0 con 0x7fcaa00bdba0 2023-10-03T19:12:38.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7f864c837640 1 Processor -- start 2023-10-03T19:12:38.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7fb0f359e640 1 Processor -- start 2023-10-03T19:12:38.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7f864c837640 1 -- start start 2023-10-03T19:12:38.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fb0f359e640 1 -- start start 2023-10-03T19:12:38.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fca9ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fcaa00bae50 0x7fcaa006c620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33444/0 (socket says 172.21.15.45:33444) 2023-10-03T19:12:38.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fca9ffff640 1 -- 172.21.15.45:0/1803515441 learned_addr learned my addr 172.21.15.45:0/1803515441 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:38.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.021+0000 7f8c0b8ed640 1 -- 172.21.15.45:0/2711319302 wait complete. 2023-10-03T19:12:38.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fca9f7fe640 1 --2- 172.21.15.45:0/1803515441 >> v2:172.21.15.79:3300/0 conn(0x7fcaa0149d30 0x7fcaa00bd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f50c18f9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f50b4045040 0x7f50b4045410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f50c18f9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f50b40d1e70 0x7f50b40d2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f6adeffd640 1 --2- 172.21.15.45:0/1371766837 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6ae014e1a0 0x7f6ae00bdf10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6ad00097c0 tx=0x7f6ad001c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5adb3f3074b77950 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fca9effd640 1 --2- 172.21.15.45:0/1803515441 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcaa00bdba0 0x7fcaa006c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8ab4bf2640 1 Processor -- start 2023-10-03T19:12:38.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f50c10f8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f50b40d1e70 0x7f50b40d2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f50c10f8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f50b40d1e70 0x7f50b40d2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41544/0 (socket says 172.21.15.45:41544) 2023-10-03T19:12:38.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f6ade7fc640 1 -- 172.21.15.45:0/1371766837 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad00ab600 con 0x7f6ae014e1a0 2023-10-03T19:12:38.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8ab4bf2640 1 -- start start 2023-10-03T19:12:38.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f50bbfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f50b4045db0 0x7f50b40d53e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:52826/0 (socket says 172.21.15.45:52826) 2023-10-03T19:12:38.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fca9e7fc640 1 -- 172.21.15.45:0/1803515441 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 234244757 0 0) 0x7fcaa014a100 con 0x7fcaa00bae50 2023-10-03T19:12:38.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fca9e7fc640 1 -- 172.21.15.45:0/1803515441 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca88003530 con 0x7fcaa00bae50 2023-10-03T19:12:38.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f50c10f8640 1 -- 172.21.15.45:0/667736060 learned_addr learned my addr 172.21.15.45:0/667736060 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:38.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f50c18f9640 1 -- 172.21.15.45:0/667736060 --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b4044010 con 0x7f50b4045db0 2023-10-03T19:12:38.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f864c837640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f86480bcf40 0x7f864814fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f864c837640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86480a23f0 con 0x7f86480a1210 2023-10-03T19:12:38.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f864c837640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86480a2c20 con 0x7f86480bb760 2023-10-03T19:12:38.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f864c837640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86480a2f00 con 0x7f86480bcf40 2023-10-03T19:12:38.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8646d9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f86480bcf40 0x7f864814fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f50c18f9640 1 -- 172.21.15.45:0/667736060 --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b40d5e90 con 0x7f50b40d1e70 2023-10-03T19:12:38.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f50c18f9640 1 -- 172.21.15.45:0/667736060 --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b4027750 con 0x7f50b4045040 2023-10-03T19:12:38.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f50c08f7640 1 --2- 172.21.15.45:0/667736060 >> v2:172.21.15.79:3300/0 conn(0x7f50b4045040 0x7f50b4045410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8c0b8ed640 1 Processor -- start 2023-10-03T19:12:38.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fca9e7fc640 1 -- 172.21.15.45:0/1803515441 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 913286842 0 0) 0x7fca88003530 con 0x7fcaa00bae50 2023-10-03T19:12:38.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fca9e7fc640 1 -- 172.21.15.45:0/1803515441 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcaa00bdba0 msgr2=0x7fcaa006c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:38.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fca9e7fc640 1 --2- 172.21.15.45:0/1803515441 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcaa00bdba0 0x7fcaa006c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fca9e7fc640 1 -- 172.21.15.45:0/1803515441 >> v2:172.21.15.79:3300/0 conn(0x7fcaa0149d30 msgr2=0x7fcaa00bd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:38.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fca9e7fc640 1 --2- 172.21.15.45:0/1803515441 >> v2:172.21.15.79:3300/0 conn(0x7fcaa0149d30 0x7fcaa00bd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fca9e7fc640 1 -- 172.21.15.45:0/1803515441 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa014d290 con 0x7fcaa00bae50 2023-10-03T19:12:38.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fca9e7fc640 1 -- 172.21.15.45:0/1803515441 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fca94001680 con 0x7fcaa00bae50 2023-10-03T19:12:38.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fca9e7fc640 1 -- 172.21.15.45:0/1803515441 >> v1:172.21.15.45:6789/0 conn(0x7fcaa00bae50 legacy=0x7fcaa006c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fca9e7fc640 1 --2- 172.21.15.45:0/1803515441 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca88003980 0x7fca88003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fca9e7fc640 1 --2- 172.21.15.45:0/1803515441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca88004360 0x7fca88004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fca9e7fc640 1 --2- 172.21.15.45:0/1803515441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca88004f40 0x7fca8800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fca9e7fc640 1 -- 172.21.15.45:0/1803515441 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa006f490 con 0x7fca88004360 2023-10-03T19:12:38.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fca9e7fc640 1 -- 172.21.15.45:0/1803515441 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa006f1a0 con 0x7fca88004f40 2023-10-03T19:12:38.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fca9e7fc640 1 -- 172.21.15.45:0/1803515441 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8800bed0 con 0x7fca88003980 2023-10-03T19:12:38.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8ab4bf2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8aa80ccbb0 0x7f8aa80d6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fb0f359e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb0ec046000 0x7fb0ec041710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fb0f359e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0ec0430f0 0x7fb0ec042230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fb0f359e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0ec03dc10 con 0x7fb0ec03d020 2023-10-03T19:12:38.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fb0f359e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0ec0d2e00 con 0x7fb0ec046000 2023-10-03T19:12:38.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fb0f359e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec03d720 con 0x7fb0ec0430f0 2023-10-03T19:12:38.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fb0f259c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb0ec046000 0x7fb0ec041710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8ab4bf2640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa800a710 con 0x7f8aa80099c0 2023-10-03T19:12:38.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8ab4bf2640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa8046b70 con 0x7f8aa80d2eb0 2023-10-03T19:12:38.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8ab4bf2640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa80d7490 con 0x7f8aa80ccbb0 2023-10-03T19:12:38.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8646d9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f86480bcf40 0x7f864814fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:40504/0 (socket says 172.21.15.45:40504) 2023-10-03T19:12:38.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8646d9d640 1 -- 172.21.15.45:0/2633291752 learned_addr learned my addr 172.21.15.45:0/2633291752 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:38.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8646d9d640 1 -- 172.21.15.45:0/2633291752 >> v1:172.21.15.79:6789/0 conn(0x7f86480bb760 legacy=0x7f8648152ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T19:12:38.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8646d9d640 1 -- 172.21.15.45:0/2633291752 >> v1:172.21.15.45:6789/0 conn(0x7f86480a1210 legacy=0x7f864815d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8645d9b640 1 -- 172.21.15.45:0/2633291752 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2707165510 0 0) 0x7f86480a23f0 con 0x7f86480a1210 2023-10-03T19:12:38.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f50bb7fe640 1 -- 172.21.15.45:0/667736060 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2082748910 0 0) 0x7f50b4044010 con 0x7f50b4045db0 2023-10-03T19:12:38.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f50bb7fe640 1 -- 172.21.15.45:0/667736060 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50ac003530 con 0x7f50b4045db0 2023-10-03T19:12:38.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f6ade7fc640 1 -- 172.21.15.45:0/1371766837 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad00a7050 con 0x7f6ae014e1a0 2023-10-03T19:12:38.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f6ade7fc640 1 -- 172.21.15.45:0/1371766837 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad00ab960 con 0x7f6ae014e1a0 2023-10-03T19:12:38.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f6ae5cca640 1 -- 172.21.15.45:0/1371766837 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6ae014e1a0 msgr2=0x7f6ae00bdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f6ae5cca640 1 --2- 172.21.15.45:0/1371766837 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6ae014e1a0 0x7f6ae00bdf10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6ad00097c0 tx=0x7f6ad001c460 comp rx=0 tx=0).stop 2023-10-03T19:12:38.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f6ae5cca640 1 -- 172.21.15.45:0/1371766837 shutdown_connections 2023-10-03T19:12:38.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f6ae5cca640 1 --2- 172.21.15.45:0/1371766837 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6ae014e1a0 0x7f6ae00bdf10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f6ae5cca640 1 --2- 172.21.15.45:0/1371766837 >> v2:172.21.15.45:3300/0 conn(0x7f6ae0148360 0x7f6ae00703a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f6ae5cca640 1 -- 172.21.15.45:0/1371766837 >> 172.21.15.45:0/1371766837 conn(0x7f6ae00c1a10 msgr2=0x7f6ae00bd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fb0f259c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb0ec046000 0x7fb0ec041710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:46788/0 (socket says 172.21.15.45:46788) 2023-10-03T19:12:38.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fb0f259c640 1 -- 172.21.15.45:0/2168104678 learned_addr learned my addr 172.21.15.45:0/2168104678 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:38.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fb0f2d9d640 1 --2- 172.21.15.45:0/2168104678 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0ec0430f0 0x7fb0ec042230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fb0f259c640 1 -- 172.21.15.45:0/2168104678 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0ec0430f0 msgr2=0x7fb0ec042230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:38.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fb0f259c640 1 --2- 172.21.15.45:0/2168104678 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0ec0430f0 0x7fb0ec042230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fb0f259c640 1 -- 172.21.15.45:0/2168104678 >> v1:172.21.15.45:6789/0 conn(0x7fb0ec03d020 legacy=0x7fb0ec0d26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fb0f259c640 1 -- 172.21.15.45:0/2168104678 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ec0d2260 con 0x7fb0ec046000 2023-10-03T19:12:38.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8c0b8ed640 1 -- start start 2023-10-03T19:12:38.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8c0b8ed640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c0406c620 0x7f8c04151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8c0b8ed640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8c040bca80 0x7f8c041ee8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8c0b8ed640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c04150400 0x7f8c0414ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8c0b8ed640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c04150d90 con 0x7f8c0406c620 2023-10-03T19:12:38.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8c0b8ed640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c04146650 con 0x7f8c04150400 2023-10-03T19:12:38.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8c0b8ed640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c041eee10 con 0x7f8c040bca80 2023-10-03T19:12:38.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fca9f7fe640 1 --2- 172.21.15.45:0/1803515441 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca88003980 0x7fca88003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fca9ffff640 1 --2- 172.21.15.45:0/1803515441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca88004f40 0x7fca8800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fca9effd640 1 --2- 172.21.15.45:0/1803515441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca88004360 0x7fca88004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8aaf7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8aa80ccbb0 0x7f8aa80d6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8aaffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8aa80099c0 0x7f8aa8006dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33474/0 (socket says 172.21.15.45:33474) 2023-10-03T19:12:38.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8aaffff640 1 -- 172.21.15.45:0/3189675507 learned_addr learned my addr 172.21.15.45:0/3189675507 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:38.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8646d9d640 1 -- 172.21.15.45:0/2633291752 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86480ba680 con 0x7f86480bcf40 2023-10-03T19:12:38.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8c09689640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c0406c620 0x7f8c04151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8c08e88640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8c040bca80 0x7f8c041ee8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8c09689640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c0406c620 0x7f8c04151530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41570/0 (socket says 172.21.15.45:41570) 2023-10-03T19:12:38.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8c09689640 1 -- 172.21.15.45:0/440812642 learned_addr learned my addr 172.21.15.45:0/440812642 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:38.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8c09e8a640 1 --2- 172.21.15.45:0/440812642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c04150400 0x7f8c0414ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8c09689640 1 -- 172.21.15.45:0/440812642 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8c040bca80 msgr2=0x7f8c041ee8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8c09689640 1 --2- 172.21.15.45:0/440812642 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8c040bca80 0x7f8c041ee8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8c09689640 1 -- 172.21.15.45:0/440812642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c04150400 msgr2=0x7f8c0414ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8c09689640 1 --2- 172.21.15.45:0/440812642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c04150400 0x7f8c0414ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8c09689640 1 -- 172.21.15.45:0/440812642 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c00009420 con 0x7f8c0406c620 2023-10-03T19:12:38.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8c09e8a640 1 --2- 172.21.15.45:0/440812642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c04150400 0x7f8c0414ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:38.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fca9ffff640 1 -- 172.21.15.45:0/1803515441 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca88003980 msgr2=0x7fca88003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:38.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fca9ffff640 1 --2- 172.21.15.45:0/1803515441 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca88003980 0x7fca88003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fca9ffff640 1 -- 172.21.15.45:0/1803515441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca88004360 msgr2=0x7fca88004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:38.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fca9ffff640 1 --2- 172.21.15.45:0/1803515441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca88004360 0x7fca88004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7fca9ffff640 1 -- 172.21.15.45:0/1803515441 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa014d290 con 0x7fca88004f40 2023-10-03T19:12:38.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8aae7fc640 1 -- 172.21.15.45:0/3189675507 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810966846 0 0) 0x7f8aa800a710 con 0x7f8aa80099c0 2023-10-03T19:12:38.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f8aae7fc640 1 -- 172.21.15.45:0/3189675507 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8aa0003530 con 0x7f8aa80099c0 2023-10-03T19:12:38.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f8aae7fc640 1 -- 172.21.15.45:0/3189675507 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 369756191 0 0) 0x7f8aa0003530 con 0x7f8aa80099c0 2023-10-03T19:12:38.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f8aae7fc640 1 -- 172.21.15.45:0/3189675507 >> v2:172.21.15.79:3300/0 conn(0x7f8aa80ccbb0 msgr2=0x7f8aa80d6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:38.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f8aae7fc640 1 --2- 172.21.15.45:0/3189675507 >> v2:172.21.15.79:3300/0 conn(0x7f8aa80ccbb0 0x7f8aa80d6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f8aae7fc640 1 -- 172.21.15.45:0/3189675507 >> v1:172.21.15.79:6789/0 conn(0x7f8aa80d2eb0 legacy=0x7f8aa800b320 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-03T19:12:38.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f8c09689640 1 --2- 172.21.15.45:0/440812642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c0406c620 0x7f8c04151530 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00efc0 tx=0x7f8bfc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f8aae7fc640 1 -- 172.21.15.45:0/3189675507 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa80417b0 con 0x7f8aa80099c0 2023-10-03T19:12:38.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f8aae7fc640 1 -- 172.21.15.45:0/3189675507 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f8ab004e4e0 con 0x7f8aa80099c0 2023-10-03T19:12:38.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f8aae7fc640 1 -- 172.21.15.45:0/3189675507 >> v1:172.21.15.45:6789/0 conn(0x7f8aa80099c0 legacy=0x7f8aa8006dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f8aae7fc640 1 --2- 172.21.15.45:0/3189675507 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8aa0003980 0x7f8aa0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f8aae7fc640 1 --2- 172.21.15.45:0/3189675507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8aa00047d0 0x7f8aa0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f8aae7fc640 1 --2- 172.21.15.45:0/3189675507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8aa0005180 0x7f8aa000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f8aae7fc640 1 -- 172.21.15.45:0/3189675507 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa80d7490 con 0x7f8aa00047d0 2023-10-03T19:12:38.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f8aae7fc640 1 -- 172.21.15.45:0/3189675507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa000bfd0 con 0x7f8aa0005180 2023-10-03T19:12:38.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f8aae7fc640 1 -- 172.21.15.45:0/3189675507 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa000c190 con 0x7f8aa0003980 2023-10-03T19:12:38.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f8bf9ffb640 1 -- 172.21.15.45:0/440812642 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc009b80 con 0x7f8c0406c620 2023-10-03T19:12:38.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f6ae5cca640 1 -- 172.21.15.45:0/1371766837 shutdown_connections 2023-10-03T19:12:38.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f6ae5cca640 1 -- 172.21.15.45:0/1371766837 wait complete. 2023-10-03T19:12:38.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f8c0b8ed640 1 -- 172.21.15.45:0/440812642 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c040bdbc0 con 0x7f8c0406c620 2023-10-03T19:12:38.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f8c0b8ed640 1 -- 172.21.15.45:0/440812642 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c040a1b20 con 0x7f8c0406c620 2023-10-03T19:12:38.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f8bf9ffb640 1 -- 172.21.15.45:0/440812642 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc00f040 con 0x7f8c0406c620 2023-10-03T19:12:38.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f8bf9ffb640 1 -- 172.21.15.45:0/440812642 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc0146a0 con 0x7f8c0406c620 2023-10-03T19:12:38.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f8aaffff640 1 --2- 172.21.15.45:0/3189675507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8aa0005180 0x7f8aa000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f8aaeffd640 1 --2- 172.21.15.45:0/3189675507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8aa00047d0 0x7f8aa0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f8aaf7fe640 1 --2- 172.21.15.45:0/3189675507 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8aa0003980 0x7f8aa0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f8aaffff640 1 -- 172.21.15.45:0/3189675507 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8aa0003980 msgr2=0x7f8aa0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:38.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f8aaffff640 1 --2- 172.21.15.45:0/3189675507 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8aa0003980 0x7f8aa0003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f8aaffff640 1 -- 172.21.15.45:0/3189675507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8aa00047d0 msgr2=0x7f8aa0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:38.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f50c10f8640 1 -- 172.21.15.45:0/667736060 >> v2:172.21.15.79:3300/0 conn(0x7f50b4045040 msgr2=0x7f50b4045410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:38.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f50c10f8640 1 --2- 172.21.15.45:0/667736060 >> v2:172.21.15.79:3300/0 conn(0x7f50b4045040 0x7f50b4045410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f50c10f8640 1 -- 172.21.15.45:0/667736060 >> v1:172.21.15.79:6789/0 conn(0x7f50b4045db0 legacy=0x7f50b40d53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f50c10f8640 1 -- 172.21.15.45:0/667736060 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b40d6130 con 0x7f50b40d1e70 2023-10-03T19:12:38.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7fb0f259c640 1 --2- 172.21.15.45:0/2168104678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0ec046000 0x7fb0ec041710 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8009870 tx=0x7fb0e801ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d2ce05f45cace38 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f8aaffff640 1 --2- 172.21.15.45:0/3189675507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8aa00047d0 0x7f8aa0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f8aaffff640 1 -- 172.21.15.45:0/3189675507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa0003530 con 0x7f8aa0005180 2023-10-03T19:12:38.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7fb0f159a640 1 -- 172.21.15.45:0/2168104678 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e80a8930 con 0x7fb0ec046000 2023-10-03T19:12:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f98b2dd4640 1 Processor -- start 2023-10-03T19:12:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.025+0000 7f98b2dd4640 1 -- start start 2023-10-03T19:12:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f98b2dd4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f98ac0a35e0 0x7f98ac0a5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f98b2dd4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98ac0bca70 0x7f98ac0bce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f98b2dd4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f98ac0bd3a0 0x7f98ac15ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f98b2dd4640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ac0bd7d0 con 0x7f98ac0a35e0 2023-10-03T19:12:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f98b2dd4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ac0a56d0 con 0x7f98ac0bd3a0 2023-10-03T19:12:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f98b2dd4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac0baf60 con 0x7f98ac0bca70 2023-10-03T19:12:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f98b1dd2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f98ac0a35e0 0x7f98ac0a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f98b1dd2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f98ac0a35e0 0x7f98ac0a5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41582/0 (socket says 172.21.15.45:41582) 2023-10-03T19:12:38.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f98b15d1640 1 --2- 172.21.15.45:0/983772868 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98ac0bca70 0x7f98ac0bce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f98b1dd2640 1 -- 172.21.15.45:0/983772868 learned_addr learned my addr 172.21.15.45:0/983772868 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:38.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f98b25d3640 1 --2- 172.21.15.45:0/983772868 >> v2:172.21.15.79:3300/0 conn(0x7f98ac0bd3a0 0x7f98ac15ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f50c10f8640 1 --2- 172.21.15.45:0/667736060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50b40d1e70 0x7f50b40d2290 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f50b400c470 tx=0x7f50b001e730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9181844b59b297 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7fb0f159a640 1 -- 172.21.15.45:0/2168104678 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e80a8a90 con 0x7fb0ec046000 2023-10-03T19:12:38.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7fca9ffff640 1 --2- 172.21.15.45:0/1803515441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca88004f40 0x7fca8800b990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fca9400c260 tx=0x7fca9401cc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba3892054715d24c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f50bb7fe640 1 -- 172.21.15.45:0/667736060 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b00ad660 con 0x7f50b40d1e70 2023-10-03T19:12:38.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f50bb7fe640 1 -- 172.21.15.45:0/667736060 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b00ad7c0 con 0x7f50b40d1e70 2023-10-03T19:12:38.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f50bb7fe640 1 -- 172.21.15.45:0/667736060 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b00adb50 con 0x7f50b40d1e70 2023-10-03T19:12:38.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f8c0b8ed640 1 -- 172.21.15.45:0/440812642 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8be4000fd0 con 0x7f8c0406c620 2023-10-03T19:12:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f98b1dd2640 1 -- 172.21.15.45:0/983772868 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98ac0bca70 msgr2=0x7f98ac0bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f98b1dd2640 1 --2- 172.21.15.45:0/983772868 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98ac0bca70 0x7f98ac0bce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f98b1dd2640 1 -- 172.21.15.45:0/983772868 >> v2:172.21.15.79:3300/0 conn(0x7f98ac0bd3a0 msgr2=0x7f98ac15ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f98b1dd2640 1 --2- 172.21.15.45:0/983772868 >> v2:172.21.15.79:3300/0 conn(0x7f98ac0bd3a0 0x7f98ac15ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f98b1dd2640 1 -- 172.21.15.45:0/983772868 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac0bb240 con 0x7f98ac0a35e0 2023-10-03T19:12:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f98b15d1640 1 --2- 172.21.15.45:0/983772868 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98ac0bca70 0x7f98ac0bce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:12:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7fca9e7fc640 1 -- 172.21.15.45:0/1803515441 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca940058e0 con 0x7fca88004f40 2023-10-03T19:12:38.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7fb0f159a640 1 -- 172.21.15.45:0/2168104678 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e80a8e20 con 0x7fb0ec046000 2023-10-03T19:12:38.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7fb0f359e640 1 -- 172.21.15.45:0/2168104678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0ec046000 msgr2=0x7fb0ec041710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7fb0f359e640 1 --2- 172.21.15.45:0/2168104678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0ec046000 0x7fb0ec041710 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8009870 tx=0x7fb0e801ed30 comp rx=0 tx=0).stop 2023-10-03T19:12:38.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f6ae5cca640 1 Processor -- start 2023-10-03T19:12:38.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f8646d9d640 1 --2- 172.21.15.45:0/2633291752 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f86480bcf40 0x7f864814fe30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f86380098a0 tx=0x7f863801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=232220991e8c5e90 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7fb0f359e640 1 -- 172.21.15.45:0/2168104678 shutdown_connections 2023-10-03T19:12:38.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7fb0f359e640 1 --2- 172.21.15.45:0/2168104678 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0ec0430f0 0x7fb0ec042230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7fb0f359e640 1 --2- 172.21.15.45:0/2168104678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0ec046000 0x7fb0ec041710 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8009870 tx=0x7fb0e801ed30 comp rx=0 tx=0).stop 2023-10-03T19:12:38.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7fb0f359e640 1 -- 172.21.15.45:0/2168104678 >> 172.21.15.45:0/2168104678 conn(0x7fb0ec043810 msgr2=0x7fb0ec043c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f8bf9ffb640 1 -- 172.21.15.45:0/440812642 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8bfc014800 con 0x7f8c0406c620 2023-10-03T19:12:38.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7fca9e7fc640 1 -- 172.21.15.45:0/1803515441 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca94005a40 con 0x7fca88004f40 2023-10-03T19:12:38.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7fca9e7fc640 1 -- 172.21.15.45:0/1803515441 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca94005df0 con 0x7fca88004f40 2023-10-03T19:12:38.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f50c18f9640 1 -- 172.21.15.45:0/667736060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50b40d1e70 msgr2=0x7f50b40d2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f50c18f9640 1 --2- 172.21.15.45:0/667736060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50b40d1e70 0x7f50b40d2290 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f50b400c470 tx=0x7f50b001e730 comp rx=0 tx=0).stop 2023-10-03T19:12:38.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f50c18f9640 1 -- 172.21.15.45:0/667736060 shutdown_connections 2023-10-03T19:12:38.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f50c18f9640 1 --2- 172.21.15.45:0/667736060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50b40d1e70 0x7f50b40d2290 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f50c18f9640 1 --2- 172.21.15.45:0/667736060 >> v2:172.21.15.79:3300/0 conn(0x7f50b4045040 0x7f50b4045410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7f50c18f9640 1 -- 172.21.15.45:0/667736060 >> 172.21.15.45:0/667736060 conn(0x7f50b4048af0 msgr2=0x7f50b4044930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.029+0000 7fcaa5bab640 1 -- 172.21.15.45:0/1803515441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca88004f40 msgr2=0x7fca8800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7fcaa5bab640 1 --2- 172.21.15.45:0/1803515441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca88004f40 0x7fca8800b990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fca9400c260 tx=0x7fca9401cc30 comp rx=0 tx=0).stop 2023-10-03T19:12:38.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f50c18f9640 1 -- 172.21.15.45:0/667736060 shutdown_connections 2023-10-03T19:12:38.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7fca9ffff640 1 -- 172.21.15.45:0/1803515441 reap_dead start 2023-10-03T19:12:38.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f50c18f9640 1 -- 172.21.15.45:0/667736060 wait complete. 2023-10-03T19:12:38.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f8bf9ffb640 1 --2- 172.21.15.45:0/440812642 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8be8066300 0x7f8be80687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f8aaffff640 1 -- 172.21.15.45:0/3189675507 reap_dead start 2023-10-03T19:12:38.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7fcaa5bab640 1 -- 172.21.15.45:0/1803515441 shutdown_connections 2023-10-03T19:12:38.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7fcaa5bab640 1 -- 172.21.15.45:0/1803515441 >> 172.21.15.45:0/1803515441 conn(0x7fcaa006a700 msgr2=0x7fcaa00bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f8aaeffd640 1 --2- 172.21.15.45:0/3189675507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8aa00047d0 0x7f8aa0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:12:38.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f8645d9b640 1 -- 172.21.15.45:0/2633291752 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86380aa640 con 0x7f86480bcf40 2023-10-03T19:12:38.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f6ae5cca640 1 -- start start 2023-10-03T19:12:38.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f8645d9b640 1 -- 172.21.15.45:0/2633291752 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86380aa7a0 con 0x7f86480bcf40 2023-10-03T19:12:38.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f8645d9b640 1 -- 172.21.15.45:0/2633291752 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86380aab30 con 0x7f86480bcf40 2023-10-03T19:12:38.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7fb0f359e640 1 -- 172.21.15.45:0/2168104678 shutdown_connections 2023-10-03T19:12:38.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7fb0f359e640 1 -- 172.21.15.45:0/2168104678 wait complete. 2023-10-03T19:12:38.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f8aaffff640 1 --2- 172.21.15.45:0/3189675507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8aa0005180 0x7f8aa000b980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0000b70 tx=0x7f8ab0098e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db1e898ef73b6196 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f8bf9ffb640 1 -- 172.21.15.45:0/440812642 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8bfc0846a0 con 0x7f8c0406c620 2023-10-03T19:12:38.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f8bf9ffb640 1 --2- 172.21.15.45:0/440812642 >> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] conn(0x7f8be806ebb0 0x7f8be8070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f8bf9ffb640 1 -- 172.21.15.45:0/440812642 --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8be8071670 con 0x7f8be806ebb0 2023-10-03T19:12:38.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f8bf9ffb640 1 -- 172.21.15.45:0/440812642 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8bfc086c80 con 0x7f8c0406c620 2023-10-03T19:12:38.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f8c08e88640 1 --2- 172.21.15.45:0/440812642 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8be8066300 0x7f8be80687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f8c09e8a640 1 --2- 172.21.15.45:0/440812642 >> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] conn(0x7f8be806ebb0 0x7f8be8070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f8aae7fc640 1 -- 172.21.15.45:0/3189675507 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab0069d90 con 0x7f8aa0005180 2023-10-03T19:12:38.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f6ae5cca640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6ae00be450 0x7f6ae013f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f6ae5cca640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ae0148360 0x7f6ae014d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f6ae5cca640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ae014e1a0 0x7f6ae014d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f6ae5cca640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae013cee0 con 0x7f6ae014e1a0 2023-10-03T19:12:38.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f6ae5cca640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae014de00 con 0x7f6ae0148360 2023-10-03T19:12:38.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f6ae5cca640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae00c0960 con 0x7f6ae00be450 2023-10-03T19:12:38.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f864c837640 1 -- 172.21.15.45:0/2633291752 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f86480bcf40 msgr2=0x7f864814fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f864c837640 1 --2- 172.21.15.45:0/2633291752 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f86480bcf40 0x7f864814fe30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f86380098a0 tx=0x7f863801c4c0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f8aae7fc640 1 -- 172.21.15.45:0/3189675507 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab0122830 con 0x7f8aa0005180 2023-10-03T19:12:38.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f8aae7fc640 1 -- 172.21.15.45:0/3189675507 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab0122be0 con 0x7f8aa0005180 2023-10-03T19:12:38.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f6adeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ae0148360 0x7f6ae014d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f8c08e88640 1 --2- 172.21.15.45:0/440812642 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8be8066300 0x7f8be80687b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8c0415cb40 tx=0x7f8bf4001ac0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f6adffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ae014e1a0 0x7f6ae014d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7fcaa5bab640 1 -- 172.21.15.45:0/1803515441 shutdown_connections 2023-10-03T19:12:38.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f6adffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ae014e1a0 0x7f6ae014d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41600/0 (socket says 172.21.15.45:41600) 2023-10-03T19:12:38.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f6adffff640 1 -- 172.21.15.45:0/2725955866 learned_addr learned my addr 172.21.15.45:0/2725955866 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:38.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f6adf7fe640 1 --2- 172.21.15.45:0/2725955866 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6ae00be450 0x7f6ae013f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f8c09e8a640 1 --2- 172.21.15.45:0/440812642 >> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] conn(0x7f8be806ebb0 0x7f8be8070fc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f50c18f9640 1 Processor -- start 2023-10-03T19:12:38.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f50c18f9640 1 -- start start 2023-10-03T19:12:38.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f6adffff640 1 -- 172.21.15.45:0/2725955866 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6ae00be450 msgr2=0x7f6ae013f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f6adffff640 1 --2- 172.21.15.45:0/2725955866 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6ae00be450 0x7f6ae013f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f6adffff640 1 -- 172.21.15.45:0/2725955866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ae0148360 msgr2=0x7f6ae014d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f6adffff640 1 --2- 172.21.15.45:0/2725955866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ae0148360 0x7f6ae014d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f6adffff640 1 -- 172.21.15.45:0/2725955866 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad0009420 con 0x7f6ae014e1a0 2023-10-03T19:12:38.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f6adffff640 1 --2- 172.21.15.45:0/2725955866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ae014e1a0 0x7f6ae014d8c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800c8f0 tx=0x7f6ad800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7fb0f359e640 1 Processor -- start 2023-10-03T19:12:38.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f8ab4bf2640 1 -- 172.21.15.45:0/3189675507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8aa0005180 msgr2=0x7f8aa000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f8ab4bf2640 1 --2- 172.21.15.45:0/3189675507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8aa0005180 0x7f8aa000b980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0000b70 tx=0x7f8ab0098e50 comp rx=0 tx=0).stop 2023-10-03T19:12:38.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f8ab4bf2640 1 -- 172.21.15.45:0/3189675507 shutdown_connections 2023-10-03T19:12:38.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f8ab4bf2640 1 --2- 172.21.15.45:0/3189675507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8aa0005180 0x7f8aa000b980 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f8ab4bf2640 1 -- 172.21.15.45:0/3189675507 >> 172.21.15.45:0/3189675507 conn(0x7f8aa8043810 msgr2=0x7f8aa8043c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f6ac7fff640 1 -- 172.21.15.45:0/2725955866 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad800a640 con 0x7f6ae014e1a0 2023-10-03T19:12:38.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f8ab4bf2640 1 -- 172.21.15.45:0/3189675507 shutdown_connections 2023-10-03T19:12:38.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f50c18f9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50b4045040 0x7f50b4041bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f6ae5cca640 1 -- 172.21.15.45:0/2725955866 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae014b9f0 con 0x7f6ae014e1a0 2023-10-03T19:12:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f6ae5cca640 1 -- 172.21.15.45:0/2725955866 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae0155530 con 0x7f6ae014e1a0 2023-10-03T19:12:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f6ac7fff640 1 -- 172.21.15.45:0/2725955866 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad800a7a0 con 0x7f6ae014e1a0 2023-10-03T19:12:38.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f50c08f7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50b4045040 0x7f50b4041bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f50c08f7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50b4045040 0x7f50b4041bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41610/0 (socket says 172.21.15.45:41610) 2023-10-03T19:12:38.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f50c08f7640 1 -- 172.21.15.45:0/2602280615 learned_addr learned my addr 172.21.15.45:0/2602280615 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:38.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f50c18f9640 1 --2- 172.21.15.45:0/2602280615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50b4045db0 0x7f50b402cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f50c18f9640 1 --2- 172.21.15.45:0/2602280615 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f50b40d1e70 0x7f50b403d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f50c18f9640 1 -- 172.21.15.45:0/2602280615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b40dcd70 con 0x7f50b4045040 2023-10-03T19:12:38.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f50c18f9640 1 -- 172.21.15.45:0/2602280615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b40dd500 con 0x7f50b4045db0 2023-10-03T19:12:38.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f50c18f9640 1 -- 172.21.15.45:0/2602280615 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b40dca90 con 0x7f50b40d1e70 2023-10-03T19:12:38.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7fcaa5bab640 1 -- 172.21.15.45:0/1803515441 wait complete. 2023-10-03T19:12:38.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7fcaa5bab640 1 Processor -- start 2023-10-03T19:12:38.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f50bbfff640 1 --2- 172.21.15.45:0/2602280615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50b4045db0 0x7f50b402cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f50c10f8640 1 --2- 172.21.15.45:0/2602280615 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f50b40d1e70 0x7f50b403d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f864c837640 1 -- 172.21.15.45:0/2633291752 shutdown_connections 2023-10-03T19:12:38.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f864c837640 1 --2- 172.21.15.45:0/2633291752 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f86480bcf40 0x7f864814fe30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f864c837640 1 -- 172.21.15.45:0/2633291752 >> 172.21.15.45:0/2633291752 conn(0x7f8648069ad0 msgr2=0x7f8648069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f8ab4bf2640 1 -- 172.21.15.45:0/3189675507 wait complete. 2023-10-03T19:12:38.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f8ab4bf2640 1 Processor -- start 2023-10-03T19:12:38.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f864c837640 1 -- 172.21.15.45:0/2633291752 shutdown_connections 2023-10-03T19:12:38.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f50c08f7640 1 -- 172.21.15.45:0/2602280615 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f50b40d1e70 msgr2=0x7f50b403d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f50c08f7640 1 --2- 172.21.15.45:0/2602280615 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f50b40d1e70 0x7f50b403d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f50c08f7640 1 -- 172.21.15.45:0/2602280615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50b4045db0 msgr2=0x7f50b402cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f50c08f7640 1 --2- 172.21.15.45:0/2602280615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50b4045db0 0x7f50b402cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7fb0f359e640 1 -- start start 2023-10-03T19:12:38.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7f50c08f7640 1 -- 172.21.15.45:0/2602280615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b00094d0 con 0x7f50b4045040 2023-10-03T19:12:38.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7fb0f359e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0ec03d020 0x7fb0ec0d0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7fb0f359e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0ec0430f0 0x7fb0ec1744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f50c08f7640 1 --2- 172.21.15.45:0/2602280615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50b4045040 0x7f50b4041bf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f50a800d800 tx=0x7f50a800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f50b97fa640 1 -- 172.21.15.45:0/2602280615 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a800b6c0 con 0x7f50b4045040 2023-10-03T19:12:38.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f8bf9ffb640 1 -- 172.21.15.45:0/440812642 <== osd.4 v2:172.21.15.79:6810/2234162464 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8be8071670 con 0x7f8be806ebb0 2023-10-03T19:12:38.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fb0f1d9b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0ec0430f0 0x7fb0ec1744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fb0f1d9b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0ec0430f0 0x7fb0ec1744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:40568/0 (socket says 172.21.15.45:40568) 2023-10-03T19:12:38.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fb0f359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0ec174a30 0x7fb0ec0d4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fb0f359e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec041030 con 0x7fb0ec174a30 2023-10-03T19:12:38.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fb0f359e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec0d1410 con 0x7fb0ec03d020 2023-10-03T19:12:38.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fb0f359e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec177e90 con 0x7fb0ec0430f0 2023-10-03T19:12:38.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f6ac7fff640 1 -- 172.21.15.45:0/2725955866 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad800ab10 con 0x7f6ae014e1a0 2023-10-03T19:12:38.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f6ae5cca640 1 -- 172.21.15.45:0/2725955866 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6ac0000fd0 con 0x7f6ae014e1a0 2023-10-03T19:12:38.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fb0f259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0ec03d020 0x7fb0ec0d0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.033+0000 7fcaa5bab640 1 -- start start 2023-10-03T19:12:38.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fcaa5bab640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcaa01f0c30 0x7fcaa00be640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fcaa5bab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa00beb80 0x7fcaa01f6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fcaa5bab640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcaa01f1000 0x7fcaa01f73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fcaa5bab640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa00c0190 con 0x7fcaa00beb80 2023-10-03T19:12:38.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fcaa5bab640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa00a5910 con 0x7fcaa01f0c30 2023-10-03T19:12:38.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fcaa5bab640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa00bfb40 con 0x7fcaa01f1000 2023-10-03T19:12:38.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fb0f1d9b640 1 -- 172.21.15.45:0/465350144 learned_addr learned my addr 172.21.15.45:0/465350144 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:38.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fca9f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcaa01f0c30 0x7fcaa00be640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f864c837640 1 -- 172.21.15.45:0/2633291752 wait complete. 2023-10-03T19:12:38.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f864c837640 1 Processor -- start 2023-10-03T19:12:38.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f6ac7fff640 1 -- 172.21.15.45:0/2725955866 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6ad800acf0 con 0x7f6ae014e1a0 2023-10-03T19:12:38.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f50c18f9640 1 -- 172.21.15.45:0/2602280615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b4042aa0 con 0x7f50b4045040 2023-10-03T19:12:38.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f50c18f9640 1 -- 172.21.15.45:0/2602280615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b4042910 con 0x7f50b4045040 2023-10-03T19:12:38.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fca9effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa00beb80 0x7fcaa01f6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fca9effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa00beb80 0x7fcaa01f6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41622/0 (socket says 172.21.15.45:41622) 2023-10-03T19:12:38.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fca9effd640 1 -- 172.21.15.45:0/2008233620 learned_addr learned my addr 172.21.15.45:0/2008233620 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:38.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fca9ffff640 1 --2- 172.21.15.45:0/2008233620 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcaa01f1000 0x7fcaa01f73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f50c18f9640 1 -- 172.21.15.45:0/2602280615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f50b40071f0 con 0x7f50b4045040 2023-10-03T19:12:38.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f6ac7fff640 1 --2- 172.21.15.45:0/2725955866 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6acc0663d0 0x7f6acc068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fb0f1d9b640 1 -- 172.21.15.45:0/465350144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0ec03d020 msgr2=0x7fb0ec0d0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fb0f1d9b640 1 --2- 172.21.15.45:0/465350144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0ec03d020 0x7fb0ec0d0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fb0f1d9b640 1 -- 172.21.15.45:0/465350144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0ec174a30 msgr2=0x7fb0ec0d4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fb0f1d9b640 1 --2- 172.21.15.45:0/465350144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0ec174a30 0x7fb0ec0d4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fb0f1d9b640 1 -- 172.21.15.45:0/465350144 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e80094d0 con 0x7fb0ec0430f0 2023-10-03T19:12:38.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f6ac7fff640 1 -- 172.21.15.45:0/2725955866 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6ad8083700 con 0x7f6ae014e1a0 2023-10-03T19:12:38.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fca9effd640 1 -- 172.21.15.45:0/2008233620 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcaa01f1000 msgr2=0x7fcaa01f73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fca9effd640 1 --2- 172.21.15.45:0/2008233620 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcaa01f1000 0x7fcaa01f73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fca9effd640 1 -- 172.21.15.45:0/2008233620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcaa01f0c30 msgr2=0x7fcaa00be640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fca9effd640 1 --2- 172.21.15.45:0/2008233620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcaa01f0c30 0x7fcaa00be640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fca9effd640 1 -- 172.21.15.45:0/2008233620 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa01578b0 con 0x7fcaa00beb80 2023-10-03T19:12:38.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f6ac7fff640 1 --2- 172.21.15.45:0/2725955866 >> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] conn(0x7f6acc06ea90 0x7f6acc070ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fca9effd640 1 --2- 172.21.15.45:0/2008233620 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa00beb80 0x7fcaa01f6e90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fca98011c80 tx=0x7fca98011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fb0f1d9b640 1 --2- 172.21.15.45:0/465350144 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0ec0430f0 0x7fb0ec1744f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb0e400c500 tx=0x7fb0e400c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f6adf7fe640 1 --2- 172.21.15.45:0/2725955866 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6acc0663d0 0x7f6acc068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f6ac7fff640 1 -- 172.21.15.45:0/2725955866 --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6acc071550 con 0x7f6acc06ea90 2023-10-03T19:12:38.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f6adeffd640 1 --2- 172.21.15.45:0/2725955866 >> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] conn(0x7f6acc06ea90 0x7f6acc070ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f8ab4bf2640 1 -- start start 2023-10-03T19:12:38.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f8ab4bf2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8aa0005180 0x7f8aa802b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f8ab4bf2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8aa802c8e0 0x7f8aa80d5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f8ab4bf2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8aa8176aa0 0x7f8aa8170630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f8ab4bf2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa802bee0 con 0x7f8aa8176aa0 2023-10-03T19:12:38.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f8ab4bf2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa8177a80 con 0x7f8aa802c8e0 2023-10-03T19:12:38.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f8ab4bf2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa80d5a90 con 0x7f8aa0005180 2023-10-03T19:12:38.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f8aaeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8aa802c8e0 0x7f8aa80d5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f8aaeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8aa802c8e0 0x7f8aa80d5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:46876/0 (socket says 172.21.15.45:46876) 2023-10-03T19:12:38.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f8aaeffd640 1 -- 172.21.15.45:0/3958912587 learned_addr learned my addr 172.21.15.45:0/3958912587 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:38.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f8aaf7fe640 1 --2- 172.21.15.45:0/3958912587 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8aa0005180 0x7f8aa802b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f864c837640 1 -- start start 2023-10-03T19:12:38.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f6adeffd640 1 --2- 172.21.15.45:0/2725955866 >> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] conn(0x7f6acc06ea90 0x7f6acc070ea0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f6adf7fe640 1 --2- 172.21.15.45:0/2725955866 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6acc0663d0 0x7f6acc068880 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4009990 tx=0x7f6ad4009110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fb0e2ffd640 1 -- 172.21.15.45:0/465350144 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e4005220 con 0x7fb0ec0430f0 2023-10-03T19:12:38.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fb0f359e640 1 -- 172.21.15.45:0/465350144 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0ec03d930 con 0x7fb0ec0430f0 2023-10-03T19:12:38.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fb0e2ffd640 1 -- 172.21.15.45:0/465350144 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e4005380 con 0x7fb0ec0430f0 2023-10-03T19:12:38.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fb0e2ffd640 1 -- 172.21.15.45:0/465350144 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e4007270 con 0x7fb0ec0430f0 2023-10-03T19:12:38.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fb0f359e640 1 -- 172.21.15.45:0/465350144 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0ec007490 con 0x7fb0ec0430f0 2023-10-03T19:12:38.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fb0f359e640 1 -- 172.21.15.45:0/465350144 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb0ec0d1ef0 con 0x7fb0ec0430f0 2023-10-03T19:12:38.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f50b97fa640 1 -- 172.21.15.45:0/2602280615 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a800b820 con 0x7f50b4045040 2023-10-03T19:12:38.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fca87fff640 1 -- 172.21.15.45:0/2008233620 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9800e040 con 0x7fcaa00beb80 2023-10-03T19:12:38.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fca87fff640 1 -- 172.21.15.45:0/2008233620 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9800f040 con 0x7fcaa00beb80 2023-10-03T19:12:38.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fca87fff640 1 -- 172.21.15.45:0/2008233620 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9800fe20 con 0x7fcaa00beb80 2023-10-03T19:12:38.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fcaa5bab640 1 -- 172.21.15.45:0/2008233620 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa0157720 con 0x7fcaa00beb80 2023-10-03T19:12:38.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7fcaa5bab640 1 -- 172.21.15.45:0/2008233620 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa0157a40 con 0x7fcaa00beb80 2023-10-03T19:12:38.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f864c837640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86480a1210 0x7f86480bf800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f864c837640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86480bb760 0x7f8648071360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f864c837640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f86480bcf40 0x7f8648149000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f864c837640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86481f3de0 con 0x7f86480a1210 2023-10-03T19:12:38.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f864c837640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86481f4d70 con 0x7f86480bb760 2023-10-03T19:12:38.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f864c837640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86481f48e0 con 0x7f86480bcf40 2023-10-03T19:12:38.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f8aaeffd640 1 -- 172.21.15.45:0/3958912587 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8aa0005180 msgr2=0x7f8aa802b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f8aaeffd640 1 --2- 172.21.15.45:0/3958912587 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8aa0005180 0x7f8aa802b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f8aaeffd640 1 -- 172.21.15.45:0/3958912587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8aa8176aa0 msgr2=0x7f8aa8170630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f8aaeffd640 1 --2- 172.21.15.45:0/3958912587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8aa8176aa0 0x7f8aa8170630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.037+0000 7f8aaeffd640 1 -- 172.21.15.45:0/3958912587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa8026380 con 0x7f8aa802c8e0 2023-10-03T19:12:38.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f8aaeffd640 1 --2- 172.21.15.45:0/3958912587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8aa802c8e0 0x7f8aa80d5550 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8aa400ba50 tx=0x7f8aa400bb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f6ac7fff640 1 -- 172.21.15.45:0/2725955866 <== osd.2 v2:172.21.15.45:6817/964866005 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6acc071550 con 0x7f6acc06ea90 2023-10-03T19:12:38.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f864659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86480bb760 0x7f8648071360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f864659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86480bb760 0x7f8648071360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:46886/0 (socket says 172.21.15.45:46886) 2023-10-03T19:12:38.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f864659c640 1 -- 172.21.15.45:0/1462570040 learned_addr learned my addr 172.21.15.45:0/1462570040 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:38.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f864759e640 1 --2- 172.21.15.45:0/1462570040 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f86480bcf40 0x7f8648149000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f864759e640 1 -- 172.21.15.45:0/1462570040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86480bb760 msgr2=0x7f8648071360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f864759e640 1 --2- 172.21.15.45:0/1462570040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86480bb760 0x7f8648071360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f864759e640 1 -- 172.21.15.45:0/1462570040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86480a1210 msgr2=0x7f86480bf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f864759e640 1 --2- 172.21.15.45:0/1462570040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86480a1210 0x7f86480bf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f864759e640 1 -- 172.21.15.45:0/1462570040 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86380094d0 con 0x7f86480bcf40 2023-10-03T19:12:38.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f864759e640 1 --2- 172.21.15.45:0/1462570040 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f86480bcf40 0x7f8648149000 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f864000c730 tx=0x7f864000cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f862f7fe640 1 -- 172.21.15.45:0/1462570040 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8640003db0 con 0x7f86480bcf40 2023-10-03T19:12:38.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f862f7fe640 1 -- 172.21.15.45:0/1462570040 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864000ce40 con 0x7f86480bcf40 2023-10-03T19:12:38.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f862f7fe640 1 -- 172.21.15.45:0/1462570040 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86400052b0 con 0x7f86480bcf40 2023-10-03T19:12:38.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f864c837640 1 -- 172.21.15.45:0/1462570040 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8648150370 con 0x7f86480bcf40 2023-10-03T19:12:38.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f864c837640 1 -- 172.21.15.45:0/1462570040 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86481535e0 con 0x7f86480bcf40 2023-10-03T19:12:38.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f864c837640 1 -- 172.21.15.45:0/1462570040 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8648150500 con 0x7f86480bcf40 2023-10-03T19:12:38.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f50b97fa640 1 -- 172.21.15.45:0/2602280615 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a800bb90 con 0x7f50b4045040 2023-10-03T19:12:38.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f50b97fa640 1 -- 172.21.15.45:0/2602280615 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f50a800bcf0 con 0x7f50b4045040 2023-10-03T19:12:38.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f50b97fa640 1 --2- 172.21.15.45:0/2602280615 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f50a0066330 0x7f50a00687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f50b97fa640 1 -- 172.21.15.45:0/2602280615 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f50a8084cf0 con 0x7f50b4045040 2023-10-03T19:12:38.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f50bbfff640 1 --2- 172.21.15.45:0/2602280615 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f50a0066330 0x7f50a00687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f50b97fa640 1 --2- 172.21.15.45:0/2602280615 >> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] conn(0x7f50a006ea70 0x7f50a0070e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f50c10f8640 1 --2- 172.21.15.45:0/2602280615 >> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] conn(0x7f50a006ea70 0x7f50a0070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f50c10f8640 1 --2- 172.21.15.45:0/2602280615 >> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] conn(0x7f50a006ea70 0x7f50a0070e80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f50b97fa640 1 -- 172.21.15.45:0/2602280615 --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f50a0071530 con 0x7f50a006ea70 2023-10-03T19:12:38.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f50bbfff640 1 --2- 172.21.15.45:0/2602280615 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f50a0066330 0x7f50a00687e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f50bc068460 tx=0x7f50bc04e4e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f50b97fa640 1 -- 172.21.15.45:0/2602280615 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50a8085050 con 0x7f50b4045040 2023-10-03T19:12:38.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f50b97fa640 1 -- 172.21.15.45:0/2602280615 <== osd.1 v2:172.21.15.45:6808/1433143371 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f50a0071530 con 0x7f50a006ea70 2023-10-03T19:12:38.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7fb0e2ffd640 1 -- 172.21.15.45:0/465350144 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb0e40073d0 con 0x7fb0ec0430f0 2023-10-03T19:12:38.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7fb0e2ffd640 1 --2- 172.21.15.45:0/465350144 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb0d4066280 0x7fb0d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7fb0e2ffd640 1 -- 172.21.15.45:0/465350144 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb0e40843f0 con 0x7fb0ec0430f0 2023-10-03T19:12:38.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7fb0e2ffd640 1 --2- 172.21.15.45:0/465350144 >> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] conn(0x7fb0d406ea30 0x7fb0d4070e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7fb0e2ffd640 1 -- 172.21.15.45:0/465350144 --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb0d40714f0 con 0x7fb0d406ea30 2023-10-03T19:12:38.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7fb0e2ffd640 1 -- 172.21.15.45:0/465350144 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0e4084760 con 0x7fb0ec0430f0 2023-10-03T19:12:38.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7fb0f259c640 1 --2- 172.21.15.45:0/465350144 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb0d4066280 0x7fb0d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7fb0f259c640 1 --2- 172.21.15.45:0/465350144 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb0d4066280 0x7fb0d4068730 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb0e80b2000 tx=0x7fb0e8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.045+0000 7fb0f2d9d640 1 --2- 172.21.15.45:0/465350144 >> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] conn(0x7fb0d406ea30 0x7fb0d4070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.045+0000 7fb0f2d9d640 1 --2- 172.21.15.45:0/465350144 >> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] conn(0x7fb0d406ea30 0x7fb0d4070e40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7fcaa5bab640 1 -- 172.21.15.45:0/2008233620 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcaa004de80 con 0x7fcaa00beb80 2023-10-03T19:12:38.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7fca87fff640 1 -- 172.21.15.45:0/2008233620 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fca98015430 con 0x7fcaa00beb80 2023-10-03T19:12:38.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7fca87fff640 1 --2- 172.21.15.45:0/2008233620 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fca8c066350 0x7fca8c068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7fca87fff640 1 -- 172.21.15.45:0/2008233620 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fca98084f70 con 0x7fcaa00beb80 2023-10-03T19:12:38.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7fca87fff640 1 --2- 172.21.15.45:0/2008233620 >> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] conn(0x7fca8c06ec00 0x7fca8c071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7fca87fff640 1 -- 172.21.15.45:0/2008233620 --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fca8c0716c0 con 0x7fca8c06ec00 2023-10-03T19:12:38.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7fca87fff640 1 -- 172.21.15.45:0/2008233620 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca98085320 con 0x7fcaa00beb80 2023-10-03T19:12:38.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7fca9f7fe640 1 --2- 172.21.15.45:0/2008233620 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fca8c066350 0x7fca8c068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7fca9ffff640 1 --2- 172.21.15.45:0/2008233620 >> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] conn(0x7fca8c06ec00 0x7fca8c071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.045+0000 7fca9f7fe640 1 --2- 172.21.15.45:0/2008233620 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fca8c066350 0x7fca8c068800 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fca90009b20 tx=0x7fca90008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.045+0000 7fca9ffff640 1 --2- 172.21.15.45:0/2008233620 >> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] conn(0x7fca8c06ec00 0x7fca8c071010 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f98b1dd2640 1 --2- 172.21.15.45:0/983772868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98ac0a35e0 0x7f98ac0a5190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f98ac071f60 tx=0x7f98a8023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3127c957946c00 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f98b0dd0640 1 -- 172.21.15.45:0/983772868 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a800d2d0 con 0x7f98ac0a35e0 2023-10-03T19:12:38.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f98b0dd0640 1 -- 172.21.15.45:0/983772868 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a80acbd0 con 0x7f98ac0a35e0 2023-10-03T19:12:38.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f98b2dd4640 1 -- 172.21.15.45:0/983772868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98ac0a35e0 msgr2=0x7f98ac0a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f98b2dd4640 1 --2- 172.21.15.45:0/983772868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98ac0a35e0 0x7f98ac0a5190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f98ac071f60 tx=0x7f98a8023000 comp rx=0 tx=0).stop 2023-10-03T19:12:38.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f98b2dd4640 1 -- 172.21.15.45:0/983772868 shutdown_connections 2023-10-03T19:12:38.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f98b2dd4640 1 --2- 172.21.15.45:0/983772868 >> v2:172.21.15.79:3300/0 conn(0x7f98ac0bd3a0 0x7f98ac15ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f98b2dd4640 1 --2- 172.21.15.45:0/983772868 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98ac0bca70 0x7f98ac0bce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f98b2dd4640 1 --2- 172.21.15.45:0/983772868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98ac0a35e0 0x7f98ac0a5190 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.041+0000 7f98b2dd4640 1 -- 172.21.15.45:0/983772868 >> 172.21.15.45:0/983772868 conn(0x7f98ac06b4b0 msgr2=0x7f98ac069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.045+0000 7f98b2dd4640 1 -- 172.21.15.45:0/983772868 shutdown_connections 2023-10-03T19:12:38.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.045+0000 7f862f7fe640 1 -- 172.21.15.45:0/1462570040 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8640005410 con 0x7f86480bcf40 2023-10-03T19:12:38.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.045+0000 7fb0e2ffd640 1 -- 172.21.15.45:0/465350144 <== osd.3 v2:172.21.15.45:6816/4227059688 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb0d40714f0 con 0x7fb0d406ea30 2023-10-03T19:12:38.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.045+0000 7f862f7fe640 1 --2- 172.21.15.45:0/1462570040 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8634066280 0x7f8634068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.045+0000 7f862f7fe640 1 -- 172.21.15.45:0/1462570040 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8640083ea0 con 0x7f86480bcf40 2023-10-03T19:12:38.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.045+0000 7f862f7fe640 1 --2- 172.21.15.45:0/1462570040 >> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] conn(0x7f863406ea30 0x7f8634070e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.045+0000 7f862f7fe640 1 -- 172.21.15.45:0/1462570040 --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f86340714f0 con 0x7f863406ea30 2023-10-03T19:12:38.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.045+0000 7f862f7fe640 1 -- 172.21.15.45:0/1462570040 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86400842f0 con 0x7f86480bcf40 2023-10-03T19:12:38.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.045+0000 7f864659c640 1 --2- 172.21.15.45:0/1462570040 >> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] conn(0x7f863406ea30 0x7f8634070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.045+0000 7f864659c640 1 --2- 172.21.15.45:0/1462570040 >> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] conn(0x7f863406ea30 0x7f8634070e40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.045+0000 7f862f7fe640 1 -- 172.21.15.45:0/1462570040 <== osd.0 v2:172.21.15.45:6800/1057586985 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f86340714f0 con 0x7f863406ea30 2023-10-03T19:12:38.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.049+0000 7f8646d9d640 1 --2- 172.21.15.45:0/1462570040 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8634066280 0x7f8634068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.049+0000 7f8646d9d640 1 --2- 172.21.15.45:0/1462570040 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8634066280 0x7f8634068730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f86380ae000 tx=0x7f8638008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.049+0000 7f6ac7fff640 1 -- 172.21.15.45:0/2725955866 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ad8050c10 con 0x7f6ae014e1a0 2023-10-03T19:12:38.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.045+0000 7fca87fff640 1 -- 172.21.15.45:0/2008233620 <== osd.5 v2:172.21.15.79:6802/2879380539 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fca8c0716c0 con 0x7fca8c06ec00 2023-10-03T19:12:38.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.045+0000 7f98b2dd4640 1 -- 172.21.15.45:0/983772868 wait complete. 2023-10-03T19:12:38.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.049+0000 7f98b2dd4640 1 Processor -- start 2023-10-03T19:12:38.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.049+0000 7f98b2dd4640 1 -- start start 2023-10-03T19:12:38.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.049+0000 7f98b2dd4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98ac0bca70 0x7f98ac1e5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.049+0000 7f98b2dd4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98ac0bd3a0 0x7f98ac1e45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.049+0000 7f98b2dd4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98ac1e3b50 0x7f98ac1e4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.049+0000 7f98b2dd4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac1552f0 con 0x7f98ac1e3b50 2023-10-03T19:12:38.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.049+0000 7f98b2dd4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac156680 con 0x7f98ac0bca70 2023-10-03T19:12:38.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.049+0000 7f98b2dd4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac1e64f0 con 0x7f98ac0bd3a0 2023-10-03T19:12:38.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.049+0000 7f98b25d3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98ac1e3b50 0x7f98ac1e4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.049+0000 7f98b25d3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98ac1e3b50 0x7f98ac1e4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41650/0 (socket says 172.21.15.45:41650) 2023-10-03T19:12:38.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.049+0000 7f98b25d3640 1 -- 172.21.15.45:0/3393482337 learned_addr learned my addr 172.21.15.45:0/3393482337 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:38.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.049+0000 7f98b15d1640 1 --2- 172.21.15.45:0/3393482337 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98ac0bd3a0 0x7f98ac1e45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.049+0000 7f98b15d1640 1 -- 172.21.15.45:0/3393482337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98ac0bca70 msgr2=0x7f98ac1e5fb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T19:12:38.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.049+0000 7f98b15d1640 1 --2- 172.21.15.45:0/3393482337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98ac0bca70 0x7f98ac1e5fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.049+0000 7f98b15d1640 1 -- 172.21.15.45:0/3393482337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98ac1e3b50 msgr2=0x7f98ac1e4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.049+0000 7f98b15d1640 1 --2- 172.21.15.45:0/3393482337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98ac1e3b50 0x7f98ac1e4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.049+0000 7f98b15d1640 1 -- 172.21.15.45:0/3393482337 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c00a630 con 0x7f98ac0bd3a0 2023-10-03T19:12:38.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.049+0000 7f98b15d1640 1 --2- 172.21.15.45:0/3393482337 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98ac0bd3a0 0x7f98ac1e45c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f989c009cf0 tx=0x7f989c00b410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.049+0000 7f98a27fc640 1 -- 172.21.15.45:0/3393482337 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c010040 con 0x7f98ac0bd3a0 2023-10-03T19:12:38.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.049+0000 7f98a27fc640 1 -- 172.21.15.45:0/3393482337 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989c0163f0 con 0x7f98ac0bd3a0 2023-10-03T19:12:38.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.049+0000 7f98a27fc640 1 -- 172.21.15.45:0/3393482337 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c016780 con 0x7f98ac0bd3a0 2023-10-03T19:12:38.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.049+0000 7f98b2dd4640 1 -- 172.21.15.45:0/3393482337 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a800d970 con 0x7f98ac0bd3a0 2023-10-03T19:12:38.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.049+0000 7f98b2dd4640 1 -- 172.21.15.45:0/3393482337 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ac0a4c90 con 0x7f98ac0bd3a0 2023-10-03T19:12:38.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.053+0000 7f8a9bfff640 1 -- 172.21.15.45:0/3958912587 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa400be70 con 0x7f8aa802c8e0 2023-10-03T19:12:38.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.053+0000 7f8a9bfff640 1 -- 172.21.15.45:0/3958912587 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa400d2e0 con 0x7f8aa802c8e0 2023-10-03T19:12:38.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.053+0000 7f98a27fc640 1 -- 172.21.15.45:0/3393482337 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f989c016af0 con 0x7f98ac0bd3a0 2023-10-03T19:12:38.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.053+0000 7f98a27fc640 1 --2- 172.21.15.45:0/3393482337 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f98900662b0 0x7f9890068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.053+0000 7f98a27fc640 1 -- 172.21.15.45:0/3393482337 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f989c084810 con 0x7f98ac0bd3a0 2023-10-03T19:12:38.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.053+0000 7f8a9bfff640 1 -- 172.21.15.45:0/3958912587 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa400f810 con 0x7f8aa802c8e0 2023-10-03T19:12:38.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.053+0000 7f8ab4bf2640 1 -- 172.21.15.45:0/3958912587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa8041c60 con 0x7f8aa802c8e0 2023-10-03T19:12:38.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.053+0000 7f8ab4bf2640 1 -- 172.21.15.45:0/3958912587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa8026660 con 0x7f8aa802c8e0 2023-10-03T19:12:38.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.053+0000 7f8ab4bf2640 1 -- 172.21.15.45:0/3958912587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8aa8005280 con 0x7f8aa802c8e0 2023-10-03T19:12:38.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.053+0000 7f98b1dd2640 1 --2- 172.21.15.45:0/3393482337 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f98900662b0 0x7f9890068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.057+0000 7f98b2dd4640 1 --2- 172.21.15.45:0/3393482337 >> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] conn(0x7f98ac153e80 0x7f98ac1f4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.057+0000 7f98b2dd4640 1 -- 172.21.15.45:0/3393482337 --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f98ac0bad30 con 0x7f98ac153e80 2023-10-03T19:12:38.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.057+0000 7f98b25d3640 1 --2- 172.21.15.45:0/3393482337 >> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] conn(0x7f98ac153e80 0x7f98ac1f4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.057+0000 7f98b1dd2640 1 --2- 172.21.15.45:0/3393482337 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f98900662b0 0x7f9890068760 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f98a80b5000 tx=0x7f98a80ae070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.057+0000 7f8a9bfff640 1 -- 172.21.15.45:0/3958912587 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8aa4014070 con 0x7f8aa802c8e0 2023-10-03T19:12:38.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.057+0000 7f98b25d3640 1 --2- 172.21.15.45:0/3393482337 >> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] conn(0x7f98ac153e80 0x7f98ac1f4200 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.057+0000 7f8a9bfff640 1 --2- 172.21.15.45:0/3958912587 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8a94066380 0x7f8a94068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.057+0000 7f8a9bfff640 1 -- 172.21.15.45:0/3958912587 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8aa4082d90 con 0x7f8aa802c8e0 2023-10-03T19:12:38.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.057+0000 7f8a9bfff640 1 --2- 172.21.15.45:0/3958912587 >> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] conn(0x7f8a9406eac0 0x7f8a94070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.057+0000 7f8a9bfff640 1 -- 172.21.15.45:0/3958912587 --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8a94071580 con 0x7f8a9406eac0 2023-10-03T19:12:38.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.057+0000 7f8a9bfff640 1 -- 172.21.15.45:0/3958912587 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8aa4083140 con 0x7f8aa802c8e0 2023-10-03T19:12:38.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.057+0000 7f8aaf7fe640 1 --2- 172.21.15.45:0/3958912587 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8a94066380 0x7f8a94068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.057+0000 7f8aaffff640 1 --2- 172.21.15.45:0/3958912587 >> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] conn(0x7f8a9406eac0 0x7f8a94070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.057+0000 7f8aaf7fe640 1 --2- 172.21.15.45:0/3958912587 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8a94066380 0x7f8a94068830 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00c800 tx=0x7f8a9c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.057+0000 7f8aaffff640 1 --2- 172.21.15.45:0/3958912587 >> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] conn(0x7f8a9406eac0 0x7f8a94070ed0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.057+0000 7f98a27fc640 1 -- 172.21.15.45:0/3393482337 <== osd.6 v2:172.21.15.79:6819/1486010128 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f98ac0bad30 con 0x7f98ac153e80 2023-10-03T19:12:38.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.061+0000 7f8c0b8ed640 1 -- 172.21.15.45:0/440812642 --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8be4002cc0 con 0x7f8be806ebb0 2023-10-03T19:12:38.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.065+0000 7f8a9bfff640 1 -- 172.21.15.45:0/3958912587 <== osd.7 v2:172.21.15.79:6818/3323397754 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8a94071580 con 0x7f8a9406eac0 2023-10-03T19:12:38.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.065+0000 7f50c18f9640 1 -- 172.21.15.45:0/2602280615 --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f50b40056d0 con 0x7f50a006ea70 2023-10-03T19:12:38.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.065+0000 7f8bf9ffb640 1 -- 172.21.15.45:0/440812642 <== osd.4 v2:172.21.15.79:6810/2234162464 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8be4002cc0 con 0x7f8be806ebb0 2023-10-03T19:12:38.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.065+0000 7f50b97fa640 1 -- 172.21.15.45:0/2602280615 <== osd.1 v2:172.21.15.45:6808/1433143371 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f50b40056d0 con 0x7f50a006ea70 2023-10-03T19:12:38.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.065+0000 7f8c0b8ed640 1 -- 172.21.15.45:0/440812642 >> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] conn(0x7f8be806ebb0 msgr2=0x7f8be8070fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.065+0000 7f8c0b8ed640 1 --2- 172.21.15.45:0/440812642 >> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] conn(0x7f8be806ebb0 0x7f8be8070fc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.069+0000 7f8c0b8ed640 1 -- 172.21.15.45:0/440812642 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8be8066300 msgr2=0x7f8be80687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.069+0000 7f8c0b8ed640 1 --2- 172.21.15.45:0/440812642 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8be8066300 0x7f8be80687b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8c0415cb40 tx=0x7f8bf4001ac0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.069+0000 7f8c0b8ed640 1 -- 172.21.15.45:0/440812642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c0406c620 msgr2=0x7f8c04151530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.069+0000 7f8c0b8ed640 1 --2- 172.21.15.45:0/440812642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c0406c620 0x7f8c04151530 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00efc0 tx=0x7f8bfc00c490 comp rx=0 tx=0).stop 2023-10-03T19:12:38.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.069+0000 7f8c09e8a640 1 -- 172.21.15.45:0/440812642 reap_dead start 2023-10-03T19:12:38.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.069+0000 7f8c0b8ed640 1 -- 172.21.15.45:0/440812642 shutdown_connections 2023-10-03T19:12:38.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.069+0000 7f8c0b8ed640 1 -- 172.21.15.45:0/440812642 >> 172.21.15.45:0/440812642 conn(0x7f8c040bcf50 msgr2=0x7f8c04149d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.069+0000 7f8c0b8ed640 1 -- 172.21.15.45:0/440812642 shutdown_connections 2023-10-03T19:12:38.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.069+0000 7f8c0b8ed640 1 -- 172.21.15.45:0/440812642 wait complete. 2023-10-03T19:12:38.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.069+0000 7f864c837640 1 -- 172.21.15.45:0/1462570040 --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f86481f4a20 con 0x7f863406ea30 2023-10-03T19:12:38.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.069+0000 7f862f7fe640 1 -- 172.21.15.45:0/1462570040 <== osd.0 v2:172.21.15.45:6800/1057586985 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f863c009660 con 0x7f863406ea30 2023-10-03T19:12:38.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.069+0000 7f6ae5cca640 1 -- 172.21.15.45:0/2725955866 --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6ac0002bf0 con 0x7f6acc06ea90 2023-10-03T19:12:38.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.069+0000 7f50c18f9640 1 -- 172.21.15.45:0/2602280615 >> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] conn(0x7f50a006ea70 msgr2=0x7f50a0070e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.069+0000 7f50c18f9640 1 --2- 172.21.15.45:0/2602280615 >> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] conn(0x7f50a006ea70 0x7f50a0070e80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.069+0000 7f50c18f9640 1 -- 172.21.15.45:0/2602280615 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f50a0066330 msgr2=0x7f50a00687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.069+0000 7f50c18f9640 1 --2- 172.21.15.45:0/2602280615 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f50a0066330 0x7f50a00687e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f50bc068460 tx=0x7f50bc04e4e0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.069+0000 7f50c18f9640 1 -- 172.21.15.45:0/2602280615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50b4045040 msgr2=0x7f50b4041bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.069+0000 7f50c18f9640 1 --2- 172.21.15.45:0/2602280615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50b4045040 0x7f50b4041bf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f50a800d800 tx=0x7f50a800dcc0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.069+0000 7f50c10f8640 1 -- 172.21.15.45:0/2602280615 reap_dead start 2023-10-03T19:12:38.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.073+0000 7f50c18f9640 1 -- 172.21.15.45:0/2602280615 shutdown_connections 2023-10-03T19:12:38.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.073+0000 7f50c18f9640 1 -- 172.21.15.45:0/2602280615 >> 172.21.15.45:0/2602280615 conn(0x7f50b4048af0 msgr2=0x7f50b40d1750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.073+0000 7f6ac7fff640 1 -- 172.21.15.45:0/2725955866 <== osd.2 v2:172.21.15.45:6817/964866005 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6ac0002bf0 con 0x7f6acc06ea90 2023-10-03T19:12:38.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.073+0000 7f50c18f9640 1 -- 172.21.15.45:0/2602280615 shutdown_connections 2023-10-03T19:12:38.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.073+0000 7f50c18f9640 1 -- 172.21.15.45:0/2602280615 wait complete. 2023-10-03T19:12:38.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.073+0000 7f6ae5cca640 1 -- 172.21.15.45:0/2725955866 >> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] conn(0x7f6acc06ea90 msgr2=0x7f6acc070ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.073+0000 7f6ae5cca640 1 --2- 172.21.15.45:0/2725955866 >> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] conn(0x7f6acc06ea90 0x7f6acc070ea0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.073+0000 7f6ae5cca640 1 -- 172.21.15.45:0/2725955866 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6acc0663d0 msgr2=0x7f6acc068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.073+0000 7f6ae5cca640 1 --2- 172.21.15.45:0/2725955866 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6acc0663d0 0x7f6acc068880 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4009990 tx=0x7f6ad4009110 comp rx=0 tx=0).stop 2023-10-03T19:12:38.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.073+0000 7f6ae5cca640 1 -- 172.21.15.45:0/2725955866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ae014e1a0 msgr2=0x7f6ae014d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.073+0000 7f6ae5cca640 1 --2- 172.21.15.45:0/2725955866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ae014e1a0 0x7f6ae014d8c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800c8f0 tx=0x7f6ad800cdb0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.073+0000 7f6adffff640 1 -- 172.21.15.45:0/2725955866 reap_dead start 2023-10-03T19:12:38.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.073+0000 7f864c837640 1 -- 172.21.15.45:0/1462570040 >> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] conn(0x7f863406ea30 msgr2=0x7f8634070e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.073+0000 7f864c837640 1 --2- 172.21.15.45:0/1462570040 >> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] conn(0x7f863406ea30 0x7f8634070e40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.073+0000 7f6ae5cca640 1 -- 172.21.15.45:0/2725955866 shutdown_connections 2023-10-03T19:12:38.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.073+0000 7f6ae5cca640 1 -- 172.21.15.45:0/2725955866 >> 172.21.15.45:0/2725955866 conn(0x7f6ae00c1a10 msgr2=0x7f6ae00bc000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.073+0000 7f6ae5cca640 1 -- 172.21.15.45:0/2725955866 shutdown_connections 2023-10-03T19:12:38.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.073+0000 7f6ae5cca640 1 -- 172.21.15.45:0/2725955866 wait complete. 2023-10-03T19:12:38.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.073+0000 7f864c837640 1 -- 172.21.15.45:0/1462570040 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8634066280 msgr2=0x7f8634068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.073+0000 7f864c837640 1 --2- 172.21.15.45:0/1462570040 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8634066280 0x7f8634068730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f86380ae000 tx=0x7f8638008040 comp rx=0 tx=0).stop 2023-10-03T19:12:38.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.073+0000 7f864c837640 1 -- 172.21.15.45:0/1462570040 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f86480bcf40 msgr2=0x7f8648149000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.073+0000 7f864c837640 1 --2- 172.21.15.45:0/1462570040 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f86480bcf40 0x7f8648149000 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f864000c730 tx=0x7f864000cbf0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.073+0000 7f864759e640 1 -- 172.21.15.45:0/1462570040 reap_dead start 2023-10-03T19:12:38.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.073+0000 7f864c837640 1 -- 172.21.15.45:0/1462570040 shutdown_connections 2023-10-03T19:12:38.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.073+0000 7f864c837640 1 -- 172.21.15.45:0/1462570040 >> 172.21.15.45:0/1462570040 conn(0x7f8648069ad0 msgr2=0x7f8648069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.073+0000 7f864c837640 1 -- 172.21.15.45:0/1462570040 shutdown_connections 2023-10-03T19:12:38.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.073+0000 7f864c837640 1 -- 172.21.15.45:0/1462570040 wait complete. 2023-10-03T19:12:38.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.077+0000 7fcaa5bab640 1 -- 172.21.15.45:0/2008233620 --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcaa00bb610 con 0x7fca8c06ec00 2023-10-03T19:12:38.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.077+0000 7fca87fff640 1 -- 172.21.15.45:0/2008233620 <== osd.5 v2:172.21.15.79:6802/2879380539 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcaa00bb610 con 0x7fca8c06ec00 2023-10-03T19:12:38.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.077+0000 7fcaa5bab640 1 -- 172.21.15.45:0/2008233620 >> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] conn(0x7fca8c06ec00 msgr2=0x7fca8c071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.077+0000 7fcaa5bab640 1 --2- 172.21.15.45:0/2008233620 >> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] conn(0x7fca8c06ec00 0x7fca8c071010 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.077+0000 7fcaa5bab640 1 -- 172.21.15.45:0/2008233620 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fca8c066350 msgr2=0x7fca8c068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.077+0000 7fcaa5bab640 1 --2- 172.21.15.45:0/2008233620 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fca8c066350 0x7fca8c068800 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fca90009b20 tx=0x7fca90008040 comp rx=0 tx=0).stop 2023-10-03T19:12:38.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.077+0000 7fcaa5bab640 1 -- 172.21.15.45:0/2008233620 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa00beb80 msgr2=0x7fcaa01f6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.077+0000 7fcaa5bab640 1 --2- 172.21.15.45:0/2008233620 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa00beb80 0x7fcaa01f6e90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fca98011c80 tx=0x7fca98011d70 comp rx=0 tx=0).stop 2023-10-03T19:12:38.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.077+0000 7fca9ffff640 1 -- 172.21.15.45:0/2008233620 reap_dead start 2023-10-03T19:12:38.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.077+0000 7fcaa5bab640 1 -- 172.21.15.45:0/2008233620 shutdown_connections 2023-10-03T19:12:38.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.077+0000 7fcaa5bab640 1 -- 172.21.15.45:0/2008233620 >> 172.21.15.45:0/2008233620 conn(0x7fca88004f40 msgr2=0x7fcaa01dd170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.077+0000 7fcaa5bab640 1 -- 172.21.15.45:0/2008233620 shutdown_connections 2023-10-03T19:12:38.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.077+0000 7fcaa5bab640 1 -- 172.21.15.45:0/2008233620 wait complete. 2023-10-03T19:12:38.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.077+0000 7fb0f359e640 1 -- 172.21.15.45:0/465350144 --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb0ec0d1ef0 con 0x7fb0d406ea30 2023-10-03T19:12:38.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.081+0000 7fb0e2ffd640 1 -- 172.21.15.45:0/465350144 <== osd.3 v2:172.21.15.45:6816/4227059688 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb0ec0d1ef0 con 0x7fb0d406ea30 2023-10-03T19:12:38.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.081+0000 7fb0f359e640 1 -- 172.21.15.45:0/465350144 >> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] conn(0x7fb0d406ea30 msgr2=0x7fb0d4070e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.081+0000 7fb0f359e640 1 --2- 172.21.15.45:0/465350144 >> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] conn(0x7fb0d406ea30 0x7fb0d4070e40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.089+0000 7fb0f359e640 1 -- 172.21.15.45:0/465350144 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb0d4066280 msgr2=0x7fb0d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.089+0000 7fb0f359e640 1 --2- 172.21.15.45:0/465350144 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb0d4066280 0x7fb0d4068730 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb0e80b2000 tx=0x7fb0e8009040 comp rx=0 tx=0).stop 2023-10-03T19:12:38.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.089+0000 7fb0f359e640 1 -- 172.21.15.45:0/465350144 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0ec0430f0 msgr2=0x7fb0ec1744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.089+0000 7fb0f359e640 1 --2- 172.21.15.45:0/465350144 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0ec0430f0 0x7fb0ec1744f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb0e400c500 tx=0x7fb0e400c9c0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.089+0000 7fb0f2d9d640 1 -- 172.21.15.45:0/465350144 reap_dead start 2023-10-03T19:12:38.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.089+0000 7fb0f359e640 1 -- 172.21.15.45:0/465350144 shutdown_connections 2023-10-03T19:12:38.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.089+0000 7fb0f359e640 1 -- 172.21.15.45:0/465350144 >> 172.21.15.45:0/465350144 conn(0x7fb0ec043810 msgr2=0x7fb0ec027c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.089+0000 7fb0f359e640 1 -- 172.21.15.45:0/465350144 shutdown_connections 2023-10-03T19:12:38.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.089+0000 7fb0f359e640 1 -- 172.21.15.45:0/465350144 wait complete. 2023-10-03T19:12:38.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.089+0000 7f98b2dd4640 1 -- 172.21.15.45:0/3393482337 --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f98ac0bb520 con 0x7f98ac153e80 2023-10-03T19:12:38.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.089+0000 7f98a27fc640 1 -- 172.21.15.45:0/3393482337 <== osd.6 v2:172.21.15.79:6819/1486010128 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f98ac0bb520 con 0x7f98ac153e80 2023-10-03T19:12:38.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.089+0000 7f8ab4bf2640 1 -- 172.21.15.45:0/3958912587 --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8aa802b6c0 con 0x7f8a9406eac0 2023-10-03T19:12:38.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.093+0000 7f8a9bfff640 1 -- 172.21.15.45:0/3958912587 <== osd.7 v2:172.21.15.79:6818/3323397754 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8aa802b6c0 con 0x7f8a9406eac0 2023-10-03T19:12:38.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.093+0000 7f8ab4bf2640 1 -- 172.21.15.45:0/3958912587 >> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] conn(0x7f8a9406eac0 msgr2=0x7f8a94070ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.093+0000 7f8ab4bf2640 1 --2- 172.21.15.45:0/3958912587 >> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] conn(0x7f8a9406eac0 0x7f8a94070ed0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.093+0000 7f8ab4bf2640 1 -- 172.21.15.45:0/3958912587 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8a94066380 msgr2=0x7f8a94068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.093+0000 7f8ab4bf2640 1 --2- 172.21.15.45:0/3958912587 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8a94066380 0x7f8a94068830 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00c800 tx=0x7f8a9c008040 comp rx=0 tx=0).stop 2023-10-03T19:12:38.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.093+0000 7f8ab4bf2640 1 -- 172.21.15.45:0/3958912587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8aa802c8e0 msgr2=0x7f8aa80d5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.093+0000 7f8ab4bf2640 1 --2- 172.21.15.45:0/3958912587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8aa802c8e0 0x7f8aa80d5550 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8aa400ba50 tx=0x7f8aa400bb40 comp rx=0 tx=0).stop 2023-10-03T19:12:38.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.093+0000 7f8aaffff640 1 -- 172.21.15.45:0/3958912587 reap_dead start 2023-10-03T19:12:38.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.093+0000 7f8ab4bf2640 1 -- 172.21.15.45:0/3958912587 shutdown_connections 2023-10-03T19:12:38.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.093+0000 7f8ab4bf2640 1 -- 172.21.15.45:0/3958912587 >> 172.21.15.45:0/3958912587 conn(0x7f8aa8043810 msgr2=0x7f8aa80d0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.130 INFO:teuthology.orchestra.run.smithi045.stdout:64424509447 2023-10-03T19:12:38.131 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-03T19:12:38.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.101+0000 7f8ab4bf2640 1 -- 172.21.15.45:0/3958912587 shutdown_connections 2023-10-03T19:12:38.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.101+0000 7f8ab4bf2640 1 -- 172.21.15.45:0/3958912587 wait complete. 2023-10-03T19:12:38.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.101+0000 7f98b2dd4640 1 -- 172.21.15.45:0/3393482337 >> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] conn(0x7f98ac153e80 msgr2=0x7f98ac1f4200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.101+0000 7f98b2dd4640 1 --2- 172.21.15.45:0/3393482337 >> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] conn(0x7f98ac153e80 0x7f98ac1f4200 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.101+0000 7f98b2dd4640 1 -- 172.21.15.45:0/3393482337 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f98900662b0 msgr2=0x7f9890068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.101+0000 7f98b2dd4640 1 --2- 172.21.15.45:0/3393482337 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f98900662b0 0x7f9890068760 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f98a80b5000 tx=0x7f98a80ae070 comp rx=0 tx=0).stop 2023-10-03T19:12:38.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.101+0000 7f98b2dd4640 1 -- 172.21.15.45:0/3393482337 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98ac0bd3a0 msgr2=0x7f98ac1e45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.101+0000 7f98b2dd4640 1 --2- 172.21.15.45:0/3393482337 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98ac0bd3a0 0x7f98ac1e45c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f989c009cf0 tx=0x7f989c00b410 comp rx=0 tx=0).stop 2023-10-03T19:12:38.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.101+0000 7f98b25d3640 1 -- 172.21.15.45:0/3393482337 reap_dead start 2023-10-03T19:12:38.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.101+0000 7f98b2dd4640 1 -- 172.21.15.45:0/3393482337 shutdown_connections 2023-10-03T19:12:38.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.101+0000 7f98b2dd4640 1 -- 172.21.15.45:0/3393482337 >> 172.21.15.45:0/3393482337 conn(0x7f98ac06b4b0 msgr2=0x7f98ac0a35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.101+0000 7f98b2dd4640 1 -- 172.21.15.45:0/3393482337 shutdown_connections 2023-10-03T19:12:38.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.101+0000 7f98b2dd4640 1 -- 172.21.15.45:0/3393482337 wait complete. 2023-10-03T19:12:38.133 INFO:teuthology.orchestra.run.smithi045.stdout:64424509446 2023-10-03T19:12:38.134 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T19:12:38.135 INFO:teuthology.orchestra.run.smithi045.stdout:64424509447 2023-10-03T19:12:38.135 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T19:12:38.136 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-10-03T19:12:38.136 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-03T19:12:38.136 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2023-10-03T19:12:38.137 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T19:12:38.137 INFO:teuthology.orchestra.run.smithi045.stdout:60129542150 2023-10-03T19:12:38.138 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T19:12:38.138 INFO:teuthology.orchestra.run.smithi045.stdout:64424509446 2023-10-03T19:12:38.139 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-03T19:12:38.139 INFO:teuthology.orchestra.run.smithi045.stdout:64424509446 2023-10-03T19:12:38.140 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-03T19:12:38.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.341+0000 7f891defe640 1 Processor -- start 2023-10-03T19:12:38.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.341+0000 7f891defe640 1 -- start start 2023-10-03T19:12:38.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.341+0000 7f891defe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f891806ca60 0x7f89180bbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.341+0000 7f891defe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89180a33f0 0x7f8918154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.341+0000 7f891defe640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f891806ce30 con 0x7f89180bb6a0 2023-10-03T19:12:38.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.341+0000 7f891defe640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89180a38b0 con 0x7f891806ca60 2023-10-03T19:12:38.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.341+0000 7f891defe640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89180bb4b0 con 0x7f89180a33f0 2023-10-03T19:12:38.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.341+0000 7f89177fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f891806ca60 0x7f89180bbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.341+0000 7f89177fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f891806ca60 0x7f89180bbbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41654/0 (socket says 172.21.15.45:41654) 2023-10-03T19:12:38.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.341+0000 7f89177fe640 1 -- 172.21.15.45:0/3673855887 learned_addr learned my addr 172.21.15.45:0/3673855887 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:38.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.341+0000 7f8917fff640 1 --2- 172.21.15.45:0/3673855887 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89180a33f0 0x7f8918154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.341+0000 7f89177fe640 1 -- 172.21.15.45:0/3673855887 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89180a33f0 msgr2=0x7f8918154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:38.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.341+0000 7f89177fe640 1 --2- 172.21.15.45:0/3673855887 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89180a33f0 0x7f8918154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.341+0000 7f89177fe640 1 -- 172.21.15.45:0/3673855887 >> v1:172.21.15.45:6789/0 conn(0x7f89180bb6a0 legacy=0x7f89180bcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:38.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.341+0000 7f89177fe640 1 -- 172.21.15.45:0/3673855887 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891806be40 con 0x7f891806ca60 2023-10-03T19:12:38.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.345+0000 7f89177fe640 1 --2- 172.21.15.45:0/3673855887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f891806ca60 0x7f89180bbbd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f890800aa10 tx=0x7f890801d840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cddac44273ae681 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.345+0000 7f89167fc640 1 -- 172.21.15.45:0/3673855887 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89080a67a0 con 0x7f891806ca60 2023-10-03T19:12:38.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.345+0000 7f89167fc640 1 -- 172.21.15.45:0/3673855887 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89080a6900 con 0x7f891806ca60 2023-10-03T19:12:38.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.345+0000 7f891defe640 1 -- 172.21.15.45:0/3673855887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f891806ca60 msgr2=0x7f89180bbbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.345+0000 7f891defe640 1 --2- 172.21.15.45:0/3673855887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f891806ca60 0x7f89180bbbd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f890800aa10 tx=0x7f890801d840 comp rx=0 tx=0).stop 2023-10-03T19:12:38.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.345+0000 7f891defe640 1 -- 172.21.15.45:0/3673855887 shutdown_connections 2023-10-03T19:12:38.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.345+0000 7f891defe640 1 --2- 172.21.15.45:0/3673855887 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89180a33f0 0x7f8918154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.345+0000 7f891defe640 1 --2- 172.21.15.45:0/3673855887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f891806ca60 0x7f89180bbbd0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.345+0000 7f891defe640 1 -- 172.21.15.45:0/3673855887 >> 172.21.15.45:0/3673855887 conn(0x7f891806b6e0 msgr2=0x7f8918069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.345+0000 7f891defe640 1 -- 172.21.15.45:0/3673855887 shutdown_connections 2023-10-03T19:12:38.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.345+0000 7f060010f640 1 Processor -- start 2023-10-03T19:12:38.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f060010f640 1 -- start start 2023-10-03T19:12:38.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.345+0000 7f891defe640 1 -- 172.21.15.45:0/3673855887 wait complete. 2023-10-03T19:12:38.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f891defe640 1 Processor -- start 2023-10-03T19:12:38.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7ff854a8c640 1 Processor -- start 2023-10-03T19:12:38.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f88e9e39640 1 Processor -- start 2023-10-03T19:12:38.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f88e9e39640 1 -- start start 2023-10-03T19:12:38.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f060010f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f05f80bc660 0x7f05f814c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f060010f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05f80bc010 0x7f05f814c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f060010f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05f80bd790 con 0x7f05f8149b30 2023-10-03T19:12:38.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f060010f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f806fb30 con 0x7f05f80bc010 2023-10-03T19:12:38.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f060010f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f80bd300 con 0x7f05f80bc660 2023-10-03T19:12:38.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f05fe6ac640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05f80bc010 0x7f05f814c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f05fe6ac640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05f80bc010 0x7f05f814c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41658/0 (socket says 172.21.15.45:41658) 2023-10-03T19:12:38.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f05fe6ac640 1 -- 172.21.15.45:0/2349003577 learned_addr learned my addr 172.21.15.45:0/2349003577 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:38.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f05fd6aa640 1 --2- 172.21.15.45:0/2349003577 >> v2:172.21.15.79:3300/0 conn(0x7f05f80bc660 0x7f05f814c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f5f15a2a640 1 Processor -- start 2023-10-03T19:12:38.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f5f15a2a640 1 -- start start 2023-10-03T19:12:38.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f891defe640 1 -- start start 2023-10-03T19:12:38.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f891defe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f891806ca60 0x7f8918158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f891defe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89180a33f0 0x7f8918141830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f891defe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89180bb6a0 0x7f8918141d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f891defe640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89181422b0 con 0x7f89180bb6a0 2023-10-03T19:12:38.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f891defe640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8918158950 con 0x7f891806ca60 2023-10-03T19:12:38.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f891defe640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8918159370 con 0x7f89180a33f0 2023-10-03T19:12:38.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f8916ffd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89180a33f0 0x7f8918141830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f8916ffd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89180a33f0 0x7f8918141830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:40648/0 (socket says 172.21.15.45:40648) 2023-10-03T19:12:38.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f8916ffd640 1 -- 172.21.15.45:0/273784232 learned_addr learned my addr 172.21.15.45:0/273784232 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:38.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f43d300c640 1 Processor -- start 2023-10-03T19:12:38.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7ff854a8c640 1 -- start start 2023-10-03T19:12:38.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7ff854a8c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff85006ca60 0x7ff8500bbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7ff854a8c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff85006ce30 con 0x7ff8500a33f0 2023-10-03T19:12:38.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7ff854a8c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8500a38b0 con 0x7ff8500bb6a0 2023-10-03T19:12:38.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7ff854a8c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8500bb4b0 con 0x7ff85006ca60 2023-10-03T19:12:38.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f8916ffd640 1 -- 172.21.15.45:0/273784232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f891806ca60 msgr2=0x7f8918158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f8916ffd640 1 --2- 172.21.15.45:0/273784232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f891806ca60 0x7f8918158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f8916ffd640 1 -- 172.21.15.45:0/273784232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89180bb6a0 msgr2=0x7f8918141d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f8916ffd640 1 --2- 172.21.15.45:0/273784232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89180bb6a0 0x7f8918141d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f8916ffd640 1 -- 172.21.15.45:0/273784232 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f890800a670 con 0x7f89180a33f0 2023-10-03T19:12:38.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f88e9e39640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88e40bb6a0 0x7f88e40bcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7ff84dd9b640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff8500bb6a0 0x7ff8500bcbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:52842/0 (socket says 172.21.15.45:52842) 2023-10-03T19:12:38.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7ff84dd9b640 1 -- 172.21.15.45:0/1874190120 learned_addr learned my addr 172.21.15.45:0/1874190120 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:38.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f8916ffd640 1 --2- 172.21.15.45:0/273784232 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89180a33f0 0x7f8918141830 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f890c00b410 tx=0x7f890c00b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f05fe6ac640 1 -- 172.21.15.45:0/2349003577 >> v2:172.21.15.79:3300/0 conn(0x7f05f80bc660 msgr2=0x7f05f814c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:38.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f05fe6ac640 1 --2- 172.21.15.45:0/2349003577 >> v2:172.21.15.79:3300/0 conn(0x7f05f80bc660 0x7f05f814c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f05fe6ac640 1 -- 172.21.15.45:0/2349003577 >> v1:172.21.15.79:6789/0 conn(0x7f05f8149b30 legacy=0x7f05f80bac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f05fe6ac640 1 -- 172.21.15.45:0/2349003577 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f8149f00 con 0x7f05f80bc010 2023-10-03T19:12:38.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f88e9e39640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e406ce30 con 0x7f88e406ca60 2023-10-03T19:12:38.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f88e9e39640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e40a38b0 con 0x7f88e40bd110 2023-10-03T19:12:38.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f5f15a2a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5f08041710 0x7f5f0803d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f5f15a2a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5f0800b6b0 0x7f5f08006dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f5f15a2a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f08009970 con 0x7f5f080f0420 2023-10-03T19:12:38.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f5f15a2a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f080267d0 con 0x7f5f08041710 2023-10-03T19:12:38.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f5f15a2a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f08046af0 con 0x7f5f0800b6b0 2023-10-03T19:12:38.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f5f0e7fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5f08041710 0x7f5f0803d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f88e9e39640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e40bb4b0 con 0x7f88e40bb6a0 2023-10-03T19:12:38.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f5f0effd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5f080f0420 0x7f5f080260c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33498/0 (socket says 172.21.15.45:33498) 2023-10-03T19:12:38.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f5f0effd640 1 -- 172.21.15.45:0/3474692376 learned_addr learned my addr 172.21.15.45:0/3474692376 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:38.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f5f0f7fe640 1 --2- 172.21.15.45:0/3474692376 >> v2:172.21.15.79:3300/0 conn(0x7f5f0800b6b0 0x7f5f08006dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f5f0e7fc640 1 -- 172.21.15.45:0/3474692376 >> v2:172.21.15.79:3300/0 conn(0x7f5f0800b6b0 msgr2=0x7f5f08006dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:38.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f5f0e7fc640 1 --2- 172.21.15.45:0/3474692376 >> v2:172.21.15.79:3300/0 conn(0x7f5f0800b6b0 0x7f5f08006dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f5f0e7fc640 1 -- 172.21.15.45:0/3474692376 >> v1:172.21.15.45:6789/0 conn(0x7f5f080f0420 legacy=0x7f5f080260c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:38.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f5f0e7fc640 1 -- 172.21.15.45:0/3474692376 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f080f70f0 con 0x7f5f08041710 2023-10-03T19:12:38.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f88e2ffd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88e40bb6a0 0x7f88e40bcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f88e2ffd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88e40bb6a0 0x7f88e40bcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:40656/0 (socket says 172.21.15.45:40656) 2023-10-03T19:12:38.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f88e2ffd640 1 -- 172.21.15.45:0/1394640180 learned_addr learned my addr 172.21.15.45:0/1394640180 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:38.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7ff84e59c640 1 --2- 172.21.15.45:0/1874190120 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff85006ca60 0x7ff8500bbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f05fe6ac640 1 --2- 172.21.15.45:0/2349003577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f80bc010 0x7f05f814c920 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f05f8072270 tx=0x7f05f001f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87bf341614f1fca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.349+0000 7f43d300c640 1 -- start start 2023-10-03T19:12:38.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7ff84d59a640 1 -- 172.21.15.45:0/1874190120 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3672020943 0 0) 0x7ff8500a38b0 con 0x7ff8500bb6a0 2023-10-03T19:12:38.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7ff84d59a640 1 -- 172.21.15.45:0/1874190120 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff838003530 con 0x7ff8500bb6a0 2023-10-03T19:12:38.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f88e2ffd640 1 -- 172.21.15.45:0/1394640180 >> v1:172.21.15.79:6789/0 conn(0x7f88e40bd110 legacy=0x7f88e4154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f88e2ffd640 1 -- 172.21.15.45:0/1394640180 >> v1:172.21.15.45:6789/0 conn(0x7f88e406ca60 legacy=0x7f88e40bbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:38.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f88e2ffd640 1 -- 172.21.15.45:0/1394640180 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e40bc2e0 con 0x7f88e40bb6a0 2023-10-03T19:12:38.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f05fcea9640 1 -- 172.21.15.45:0/2349003577 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f00af400 con 0x7f05f80bc010 2023-10-03T19:12:38.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f88fffff640 1 -- 172.21.15.45:0/273784232 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c004020 con 0x7f89180a33f0 2023-10-03T19:12:38.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f88fffff640 1 -- 172.21.15.45:0/273784232 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890c004180 con 0x7f89180a33f0 2023-10-03T19:12:38.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f88fffff640 1 -- 172.21.15.45:0/273784232 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c011630 con 0x7f89180a33f0 2023-10-03T19:12:38.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f05fcea9640 1 -- 172.21.15.45:0/2349003577 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f00ab050 con 0x7f05f80bc010 2023-10-03T19:12:38.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f05fcea9640 1 -- 172.21.15.45:0/2349003577 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f00af7c0 con 0x7f05f80bc010 2023-10-03T19:12:38.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7ff84d59a640 1 -- 172.21.15.45:0/1874190120 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1002040398 0 0) 0x7ff85006ce30 con 0x7ff8500a33f0 2023-10-03T19:12:38.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7ff84d59a640 1 -- 172.21.15.45:0/1874190120 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8500a38b0 con 0x7ff8500a33f0 2023-10-03T19:12:38.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7ff84e59c640 1 -- 172.21.15.45:0/1874190120 >> v1:172.21.15.79:6789/0 conn(0x7ff8500bb6a0 legacy=0x7ff8500bcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7ff84e59c640 1 -- 172.21.15.45:0/1874190120 >> v1:172.21.15.45:6789/0 conn(0x7ff8500a33f0 legacy=0x7ff850154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f43d300c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43cc0a33f0 0x7f43cc155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f43d300c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43cc06ce30 con 0x7f43cc06ca60 2023-10-03T19:12:38.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f43d300c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43cc0a38b0 con 0x7f43cc0bb6a0 2023-10-03T19:12:38.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f43d300c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc0bb4b0 con 0x7f43cc0a33f0 2023-10-03T19:12:38.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7ff84e59c640 1 -- 172.21.15.45:0/1874190120 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85006be40 con 0x7ff85006ca60 2023-10-03T19:12:38.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f43d0da8640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f43cc06ca60 0x7f43cc0bbbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33516/0 (socket says 172.21.15.45:33516) 2023-10-03T19:12:38.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f43d15a9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43cc0a33f0 0x7f43cc155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f43d0da8640 1 -- 172.21.15.45:0/757870678 learned_addr learned my addr 172.21.15.45:0/757870678 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:38.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f5f0e7fc640 1 --2- 172.21.15.45:0/3474692376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f08041710 0x7f5f0803d6e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5f080f3d10 tx=0x7f5f0002d290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b717225343436fa2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f060010f640 1 -- 172.21.15.45:0/2349003577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f80bc010 msgr2=0x7f05f814c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f060010f640 1 --2- 172.21.15.45:0/2349003577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f80bc010 0x7f05f814c920 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f05f8072270 tx=0x7f05f001f1e0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f060010f640 1 -- 172.21.15.45:0/2349003577 shutdown_connections 2023-10-03T19:12:38.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f060010f640 1 --2- 172.21.15.45:0/2349003577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f80bc010 0x7f05f814c920 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f060010f640 1 --2- 172.21.15.45:0/2349003577 >> v2:172.21.15.79:3300/0 conn(0x7f05f80bc660 0x7f05f814c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f060010f640 1 -- 172.21.15.45:0/2349003577 >> 172.21.15.45:0/2349003577 conn(0x7f05f8069ad0 msgr2=0x7f05f8069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f891defe640 1 -- 172.21.15.45:0/273784232 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89180a3b00 con 0x7f89180a33f0 2023-10-03T19:12:38.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f891defe640 1 -- 172.21.15.45:0/273784232 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89180bd2e0 con 0x7f89180a33f0 2023-10-03T19:12:38.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f43d15a9640 1 -- 172.21.15.45:0/757870678 >> v1:172.21.15.79:6789/0 conn(0x7f43cc0bb6a0 legacy=0x7f43cc0bcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f43d15a9640 1 -- 172.21.15.45:0/757870678 >> v1:172.21.15.45:6789/0 conn(0x7f43cc06ca60 legacy=0x7f43cc0bbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f43d15a9640 1 -- 172.21.15.45:0/757870678 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc0bc2e0 con 0x7f43cc0a33f0 2023-10-03T19:12:38.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f060010f640 1 -- 172.21.15.45:0/2349003577 shutdown_connections 2023-10-03T19:12:38.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f060010f640 1 -- 172.21.15.45:0/2349003577 wait complete. 2023-10-03T19:12:38.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7ffb37a99640 1 Processor -- start 2023-10-03T19:12:38.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f5f0dffb640 1 -- 172.21.15.45:0/3474692376 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f000112d0 con 0x7f5f08041710 2023-10-03T19:12:38.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f5f0dffb640 1 -- 172.21.15.45:0/3474692376 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f000b8050 con 0x7f5f08041710 2023-10-03T19:12:38.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f5f0dffb640 1 -- 172.21.15.45:0/3474692376 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f00011650 con 0x7f5f08041710 2023-10-03T19:12:38.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7ffb37a99640 1 -- start start 2023-10-03T19:12:38.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f891defe640 1 -- 172.21.15.45:0/273784232 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f8005260 con 0x7f89180a33f0 2023-10-03T19:12:38.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7ffb37a99640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffb300a3a50 0x7ffb3006aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7ffb37a99640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb300bbd50 0x7ffb3014e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7ffb35835640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffb300a3a50 0x7ffb3006aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f060010f640 1 Processor -- start 2023-10-03T19:12:38.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7f88e2ffd640 1 --2- 172.21.15.45:0/1394640180 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88e40bb6a0 0x7f88e40bcbd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f88d4009210 tx=0x7f88d401e7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71d22fe875478fb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7ffb35835640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffb300a3a50 0x7ffb3006aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:46918/0 (socket says 172.21.15.45:46918) 2023-10-03T19:12:38.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.353+0000 7ffb35835640 1 -- 172.21.15.45:0/1993491618 learned_addr learned my addr 172.21.15.45:0/1993491618 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:38.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7ffb35034640 1 --2- 172.21.15.45:0/1993491618 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb300bbd50 0x7ffb3014e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7ffb37a99640 1 -- 172.21.15.45:0/1993491618 --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb300bb5b0 con 0x7ffb300bc260 2023-10-03T19:12:38.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f5f15a2a640 1 -- 172.21.15.45:0/3474692376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f08041710 msgr2=0x7f5f0803d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f5f15a2a640 1 --2- 172.21.15.45:0/3474692376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f08041710 0x7f5f0803d6e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5f080f3d10 tx=0x7f5f0002d290 comp rx=0 tx=0).stop 2023-10-03T19:12:38.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7ff84e59c640 1 --2- 172.21.15.45:0/1874190120 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff85006ca60 0x7ff8500bbbd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff8440097f0 tx=0x7ff84401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dd72f139d4d34e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7ffb37a99640 1 -- 172.21.15.45:0/1993491618 --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb300a6e80 con 0x7ffb300a3a50 2023-10-03T19:12:38.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f060010f640 1 -- start start 2023-10-03T19:12:38.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7ffb37a99640 1 -- 172.21.15.45:0/1993491618 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb300bb890 con 0x7ffb300bbd50 2023-10-03T19:12:38.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f5f15a2a640 1 -- 172.21.15.45:0/3474692376 shutdown_connections 2023-10-03T19:12:38.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f5f15a2a640 1 --2- 172.21.15.45:0/3474692376 >> v2:172.21.15.79:3300/0 conn(0x7f5f0800b6b0 0x7f5f08006dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f5f15a2a640 1 --2- 172.21.15.45:0/3474692376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f08041710 0x7f5f0803d6e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f5f15a2a640 1 -- 172.21.15.45:0/3474692376 >> 172.21.15.45:0/3474692376 conn(0x7f5f08043810 msgr2=0x7f5f08043c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7ffb34833640 1 -- 172.21.15.45:0/1993491618 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 899347838 0 0) 0x7ffb300bb5b0 con 0x7ffb300bc260 2023-10-03T19:12:38.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7ffb34833640 1 -- 172.21.15.45:0/1993491618 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb1c005740 con 0x7ffb300bc260 2023-10-03T19:12:38.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f5f15a2a640 1 -- 172.21.15.45:0/3474692376 shutdown_connections 2023-10-03T19:12:38.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f5f15a2a640 1 -- 172.21.15.45:0/3474692376 wait complete. 2023-10-03T19:12:38.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f060010f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f80bc010 0x7f05f80b8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f060010f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f05f80bc660 0x7f05f80b6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f060010f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05f8149b30 0x7f05f80b6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f060010f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f814b7f0 con 0x7f05f80bc010 2023-10-03T19:12:38.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f060010f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f813ce10 con 0x7f05f8149b30 2023-10-03T19:12:38.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f060010f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f814b410 con 0x7f05f80bc660 2023-10-03T19:12:38.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f05fdeab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f80bc010 0x7f05f80b8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f05fdeab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f80bc010 0x7f05f80b8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41680/0 (socket says 172.21.15.45:41680) 2023-10-03T19:12:38.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f05fdeab640 1 -- 172.21.15.45:0/2844797369 learned_addr learned my addr 172.21.15.45:0/2844797369 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:38.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f05fe6ac640 1 --2- 172.21.15.45:0/2844797369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05f8149b30 0x7f05f80b6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f88fffff640 1 -- 172.21.15.45:0/273784232 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f890c011790 con 0x7f89180a33f0 2023-10-03T19:12:38.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f88fffff640 1 --2- 172.21.15.45:0/273784232 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8904066380 0x7f8904068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f88fffff640 1 -- 172.21.15.45:0/273784232 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f890c0841e0 con 0x7f89180a33f0 2023-10-03T19:12:38.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f89177fe640 1 --2- 172.21.15.45:0/273784232 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8904066380 0x7f8904068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7ffb35835640 1 -- 172.21.15.45:0/1993491618 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb300bbd50 msgr2=0x7ffb3014e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:38.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7ffb35835640 1 --2- 172.21.15.45:0/1993491618 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb300bbd50 0x7ffb3014e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7ffb35835640 1 -- 172.21.15.45:0/1993491618 >> v1:172.21.15.79:6789/0 conn(0x7ffb300bc260 legacy=0x7ffb301484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7ffb35835640 1 -- 172.21.15.45:0/1993491618 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb300a7060 con 0x7ffb300a3a50 2023-10-03T19:12:38.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f43d15a9640 1 --2- 172.21.15.45:0/757870678 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43cc0a33f0 0x7f43cc155fc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f43c0005a50 tx=0x7f43c001da60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=164b3c9d71c4768c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f05fdeab640 1 -- 172.21.15.45:0/2844797369 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f05f80bc660 msgr2=0x7f05f80b6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f05fdeab640 1 --2- 172.21.15.45:0/2844797369 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f05f80bc660 0x7f05f80b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f05fdeab640 1 -- 172.21.15.45:0/2844797369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05f8149b30 msgr2=0x7f05f80b6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f05fdeab640 1 --2- 172.21.15.45:0/2844797369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05f8149b30 0x7f05f80b6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f05fdeab640 1 -- 172.21.15.45:0/2844797369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f0009b30 con 0x7f05f80bc010 2023-10-03T19:12:38.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f05fdeab640 1 --2- 172.21.15.45:0/2844797369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f80bc010 0x7f05f80b8ec0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f05f400c3c0 tx=0x7f05f400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f5f15a2a640 1 Processor -- start 2023-10-03T19:12:38.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f05ee7fc640 1 -- 172.21.15.45:0/2844797369 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f40052d0 con 0x7f05f80bc010 2023-10-03T19:12:38.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f5f15a2a640 1 -- start start 2023-10-03T19:12:38.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f05ee7fc640 1 -- 172.21.15.45:0/2844797369 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f4005430 con 0x7f05f80bc010 2023-10-03T19:12:38.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f05ee7fc640 1 -- 172.21.15.45:0/2844797369 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f4003840 con 0x7f05f80bc010 2023-10-03T19:12:38.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f060010f640 1 -- 172.21.15.45:0/2844797369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f80bccb0 con 0x7f05f80bc010 2023-10-03T19:12:38.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f060010f640 1 -- 172.21.15.45:0/2844797369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f80bba80 con 0x7f05f80bc010 2023-10-03T19:12:38.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f89177fe640 1 --2- 172.21.15.45:0/273784232 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8904066380 0x7f8904068830 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f89080b0000 tx=0x7f8908004740 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f5f15a2a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f0800b6b0 0x7f5f080f45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f5f15a2a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f08041710 0x7f5f080f4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f060010f640 1 -- 172.21.15.45:0/2844797369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f80bcf90 con 0x7f05f80bc010 2023-10-03T19:12:38.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f5f15a2a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f080f0420 0x7f5f080eb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f5f15a2a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f080e8240 con 0x7f5f080f0420 2023-10-03T19:12:38.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f5f15a2a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f080ef680 con 0x7f5f08041710 2023-10-03T19:12:38.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.357+0000 7f5f15a2a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f080f5050 con 0x7f5f0800b6b0 2023-10-03T19:12:38.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7f5f0e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f08041710 0x7f5f080f4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7f5f0e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f08041710 0x7f5f080f4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:46930/0 (socket says 172.21.15.45:46930) 2023-10-03T19:12:38.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7f5f0e7fc640 1 -- 172.21.15.45:0/4213418127 learned_addr learned my addr 172.21.15.45:0/4213418127 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:38.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7f5f0effd640 1 --2- 172.21.15.45:0/4213418127 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f0800b6b0 0x7f5f080f45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7f05ee7fc640 1 -- 172.21.15.45:0/2844797369 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f05f40039a0 con 0x7f05f80bc010 2023-10-03T19:12:38.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7f5f0f7fe640 1 --2- 172.21.15.45:0/4213418127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f080f0420 0x7f5f080eb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7f05ee7fc640 1 --2- 172.21.15.45:0/2844797369 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f05dc066300 0x7f05dc0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7f05ee7fc640 1 -- 172.21.15.45:0/2844797369 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f05f4083010 con 0x7f05f80bc010 2023-10-03T19:12:38.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7f5f0e7fc640 1 -- 172.21.15.45:0/4213418127 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f0800b6b0 msgr2=0x7f5f080f45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7f5f0e7fc640 1 --2- 172.21.15.45:0/4213418127 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f0800b6b0 0x7f5f080f45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7f5f0e7fc640 1 -- 172.21.15.45:0/4213418127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f080f0420 msgr2=0x7f5f080eb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7f5f0e7fc640 1 --2- 172.21.15.45:0/4213418127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f080f0420 0x7f5f080eb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7f5f0e7fc640 1 -- 172.21.15.45:0/4213418127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f00011cc0 con 0x7f5f08041710 2023-10-03T19:12:38.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7ffb35835640 1 --2- 172.21.15.45:0/1993491618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb300a3a50 0x7ffb3006aed0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffb28009ed0 tx=0x7ffb28020e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8eb80aa86ea9ac25 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7f05fd6aa640 1 --2- 172.21.15.45:0/2844797369 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f05dc066300 0x7f05dc0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7f5f0e7fc640 1 --2- 172.21.15.45:0/4213418127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f08041710 0x7f5f080f4b10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5f00013110 tx=0x7f5f0002a030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7ffb34833640 1 -- 172.21.15.45:0/1993491618 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb280a9ad0 con 0x7ffb300a3a50 2023-10-03T19:12:38.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7ffb34833640 1 -- 172.21.15.45:0/1993491618 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb280a9c30 con 0x7ffb300a3a50 2023-10-03T19:12:38.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7ffb34833640 1 -- 172.21.15.45:0/1993491618 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb280b13f0 con 0x7ffb300a3a50 2023-10-03T19:12:38.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7f5ef7fff640 1 -- 172.21.15.45:0/4213418127 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f000c6440 con 0x7f5f08041710 2023-10-03T19:12:38.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7f5ef7fff640 1 -- 172.21.15.45:0/4213418127 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f000c65a0 con 0x7f5f08041710 2023-10-03T19:12:38.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7f5ef7fff640 1 -- 172.21.15.45:0/4213418127 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f000c6910 con 0x7f5f08041710 2023-10-03T19:12:38.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7f5f15a2a640 1 -- 172.21.15.45:0/4213418127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f080fbd20 con 0x7f5f08041710 2023-10-03T19:12:38.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7f5f15a2a640 1 -- 172.21.15.45:0/4213418127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f080f6e10 con 0x7f5f08041710 2023-10-03T19:12:38.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7ffb37a99640 1 -- 172.21.15.45:0/1993491618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb300a3a50 msgr2=0x7ffb3006aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7ffb37a99640 1 --2- 172.21.15.45:0/1993491618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb300a3a50 0x7ffb3006aed0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffb28009ed0 tx=0x7ffb28020e10 comp rx=0 tx=0).stop 2023-10-03T19:12:38.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7ffb37a99640 1 -- 172.21.15.45:0/1993491618 shutdown_connections 2023-10-03T19:12:38.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7ffb37a99640 1 --2- 172.21.15.45:0/1993491618 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb300bbd50 0x7ffb3014e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7ffb37a99640 1 --2- 172.21.15.45:0/1993491618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb300a3a50 0x7ffb3006aed0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7ffb37a99640 1 -- 172.21.15.45:0/1993491618 >> 172.21.15.45:0/1993491618 conn(0x7ffb3006dec0 msgr2=0x7ffb300a30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7ffb37a99640 1 -- 172.21.15.45:0/1993491618 shutdown_connections 2023-10-03T19:12:38.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7ffb37a99640 1 -- 172.21.15.45:0/1993491618 wait complete. 2023-10-03T19:12:38.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7f5f15a2a640 1 -- 172.21.15.45:0/4213418127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f080fbeb0 con 0x7f5f08041710 2023-10-03T19:12:38.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7f05fd6aa640 1 --2- 172.21.15.45:0/2844797369 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f05dc066300 0x7f05dc0687b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f05e8006aa0 tx=0x7f05e8006a30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.361+0000 7f5ef7fff640 1 -- 172.21.15.45:0/4213418127 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5f000c6a70 con 0x7f5f08041710 2023-10-03T19:12:38.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.365+0000 7f5ef7fff640 1 --2- 172.21.15.45:0/4213418127 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5efc0662b0 0x7f5efc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.365+0000 7f5ef7fff640 1 -- 172.21.15.45:0/4213418127 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5f0012fd40 con 0x7f5f08041710 2023-10-03T19:12:38.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.365+0000 7ffb37a99640 1 Processor -- start 2023-10-03T19:12:38.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.365+0000 7ffb37a99640 1 -- start start 2023-10-03T19:12:38.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.365+0000 7f5f0effd640 1 --2- 172.21.15.45:0/4213418127 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5efc0662b0 0x7f5efc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.365+0000 7f05ee7fc640 1 -- 172.21.15.45:0/2844797369 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f05f4088060 con 0x7f05f80bc010 2023-10-03T19:12:38.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.365+0000 7ffb37a99640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb300a3a50 0x7ffb301e5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.365+0000 7ffb37a99640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb300bbd50 0x7ffb30139720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.365+0000 7ffb37a99640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb300bc260 0x7ffb3013bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.365+0000 7ffb37a99640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb301e5ce0 con 0x7ffb300bc260 2023-10-03T19:12:38.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.365+0000 7ffb37a99640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3013d260 con 0x7ffb300bbd50 2023-10-03T19:12:38.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.365+0000 7ffb36036640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb300bc260 0x7ffb3013bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.365+0000 7ffb35835640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb300a3a50 0x7ffb301e5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.365+0000 7ffb36036640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb300bc260 0x7ffb3013bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41700/0 (socket says 172.21.15.45:41700) 2023-10-03T19:12:38.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.365+0000 7ffb36036640 1 -- 172.21.15.45:0/48857075 learned_addr learned my addr 172.21.15.45:0/48857075 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:38.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.365+0000 7ffb35034640 1 --2- 172.21.15.45:0/48857075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb300bbd50 0x7ffb30139720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.365+0000 7ffb37a99640 1 -- 172.21.15.45:0/48857075 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb301e5f80 con 0x7ffb300a3a50 2023-10-03T19:12:38.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.365+0000 7f5f0effd640 1 --2- 172.21.15.45:0/4213418127 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5efc0662b0 0x7f5efc068760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5f040092c0 tx=0x7f5f04009250 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.365+0000 7ffb36036640 1 -- 172.21.15.45:0/48857075 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb300a3a50 msgr2=0x7ffb301e5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.365+0000 7ffb36036640 1 --2- 172.21.15.45:0/48857075 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb300a3a50 0x7ffb301e5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.365+0000 7ffb36036640 1 -- 172.21.15.45:0/48857075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb300bbd50 msgr2=0x7ffb30139720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.365+0000 7ffb36036640 1 --2- 172.21.15.45:0/48857075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb300bbd50 0x7ffb30139720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.365+0000 7ffb36036640 1 -- 172.21.15.45:0/48857075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb28009b30 con 0x7ffb300bc260 2023-10-03T19:12:38.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.365+0000 7ffb36036640 1 --2- 172.21.15.45:0/48857075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb300bc260 0x7ffb3013bff0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000c3c0 tx=0x7ffb2000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.365+0000 7ffb267fc640 1 -- 172.21.15.45:0/48857075 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb20003600 con 0x7ffb300bc260 2023-10-03T19:12:38.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.365+0000 7ffb37a99640 1 -- 172.21.15.45:0/48857075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb3014ee30 con 0x7ffb300bc260 2023-10-03T19:12:38.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.365+0000 7ffb37a99640 1 -- 172.21.15.45:0/48857075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb3014eca0 con 0x7ffb300bc260 2023-10-03T19:12:38.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.365+0000 7ffb267fc640 1 -- 172.21.15.45:0/48857075 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb20003760 con 0x7ffb300bc260 2023-10-03T19:12:38.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.365+0000 7ffb267fc640 1 -- 172.21.15.45:0/48857075 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb20003b50 con 0x7ffb300bc260 2023-10-03T19:12:38.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.369+0000 7ffb13fff640 1 -- 172.21.15.45:0/48857075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0c005260 con 0x7ffb300bc260 2023-10-03T19:12:38.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.369+0000 7ffb267fc640 1 -- 172.21.15.45:0/48857075 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffb20003cb0 con 0x7ffb300bc260 2023-10-03T19:12:38.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.369+0000 7ffb267fc640 1 --2- 172.21.15.45:0/48857075 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ffb140662b0 0x7ffb14068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.369+0000 7ffb267fc640 1 -- 172.21.15.45:0/48857075 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffb20083240 con 0x7ffb300bc260 2023-10-03T19:12:38.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.369+0000 7ffb35835640 1 --2- 172.21.15.45:0/48857075 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ffb140662b0 0x7ffb14068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.369+0000 7ffb35835640 1 --2- 172.21.15.45:0/48857075 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ffb140662b0 0x7ffb14068760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ffb280b2000 tx=0x7ffb280ab070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.369+0000 7f43cb7fe640 1 -- 172.21.15.45:0/757870678 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c00a6a10 con 0x7f43cc0a33f0 2023-10-03T19:12:38.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.369+0000 7ff84d59a640 1 -- 172.21.15.45:0/1874190120 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8440a9620 con 0x7ff85006ca60 2023-10-03T19:12:38.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.369+0000 7f9c48fe6640 1 Processor -- start 2023-10-03T19:12:38.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.369+0000 7f88e27fc640 1 -- 172.21.15.45:0/1394640180 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d40a7770 con 0x7f88e40bb6a0 2023-10-03T19:12:38.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.369+0000 7f88e27fc640 1 -- 172.21.15.45:0/1394640180 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d40a78d0 con 0x7f88e40bb6a0 2023-10-03T19:12:38.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.369+0000 7f88e27fc640 1 -- 172.21.15.45:0/1394640180 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d40a7c60 con 0x7f88e40bb6a0 2023-10-03T19:12:38.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.369+0000 7f88fffff640 1 -- 172.21.15.45:0/273784232 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f890c0516d0 con 0x7f89180a33f0 2023-10-03T19:12:38.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.369+0000 7f9c48fe6640 1 -- start start 2023-10-03T19:12:38.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f9c48fe6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c3c047ac0 0x7f9c3c0d89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f9c48fe6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9c3c047450 0x7f9c3c0d8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f9c48fe6640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c3c0d5b80 con 0x7f9c3c0d2880 2023-10-03T19:12:38.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f9c48fe6640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c3c00b040 con 0x7f9c3c047450 2023-10-03T19:12:38.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f9c48fe6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c0d60b0 con 0x7f9c3c047ac0 2023-10-03T19:12:38.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f88e9e39640 1 -- 172.21.15.45:0/1394640180 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88e40bb6a0 msgr2=0x7f88e40bcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f88e9e39640 1 --2- 172.21.15.45:0/1394640180 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88e40bb6a0 0x7f88e40bcbd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f88d4009210 tx=0x7f88d401e7b0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7ff84d59a640 1 -- 172.21.15.45:0/1874190120 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8440a9780 con 0x7ff85006ca60 2023-10-03T19:12:38.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7ff84d59a640 1 -- 172.21.15.45:0/1874190120 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8440a9af0 con 0x7ff85006ca60 2023-10-03T19:12:38.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f9c437fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9c3c0d2880 0x7f9c3c007ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:52878/0 (socket says 172.21.15.45:52878) 2023-10-03T19:12:38.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f9c437fe640 1 -- 172.21.15.45:0/2835181822 learned_addr learned my addr 172.21.15.45:0/2835181822 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:38.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f9c43fff640 1 --2- 172.21.15.45:0/2835181822 >> v2:172.21.15.45:3300/0 conn(0x7f9c3c047450 0x7f9c3c0d8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f9c42ffd640 1 --2- 172.21.15.45:0/2835181822 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c3c047ac0 0x7f9c3c0d89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f9c43fff640 1 -- 172.21.15.45:0/2835181822 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c3c047ac0 msgr2=0x7f9c3c0d89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:38.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f9c43fff640 1 --2- 172.21.15.45:0/2835181822 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c3c047ac0 0x7f9c3c0d89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f9c43fff640 1 -- 172.21.15.45:0/2835181822 >> v1:172.21.15.79:6789/0 conn(0x7f9c3c0d2880 legacy=0x7f9c3c007ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f9c43fff640 1 -- 172.21.15.45:0/2835181822 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3c046fc0 con 0x7f9c3c047450 2023-10-03T19:12:38.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f9c42ffd640 1 --2- 172.21.15.45:0/2835181822 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c3c047ac0 0x7f9c3c0d89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:12:38.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7ff854a8c640 1 -- 172.21.15.45:0/1874190120 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff85006ca60 msgr2=0x7ff8500bbbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7ff854a8c640 1 --2- 172.21.15.45:0/1874190120 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff85006ca60 0x7ff8500bbbd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff8440097f0 tx=0x7ff84401c560 comp rx=0 tx=0).stop 2023-10-03T19:12:38.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7ff854a8c640 1 -- 172.21.15.45:0/1874190120 shutdown_connections 2023-10-03T19:12:38.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7ff854a8c640 1 --2- 172.21.15.45:0/1874190120 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff85006ca60 0x7ff8500bbbd0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7ff854a8c640 1 -- 172.21.15.45:0/1874190120 >> 172.21.15.45:0/1874190120 conn(0x7ff85006b6e0 msgr2=0x7ff850069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f88e9e39640 1 -- 172.21.15.45:0/1394640180 shutdown_connections 2023-10-03T19:12:38.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f88e9e39640 1 --2- 172.21.15.45:0/1394640180 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88e40bb6a0 0x7f88e40bcbd0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f88e9e39640 1 -- 172.21.15.45:0/1394640180 >> 172.21.15.45:0/1394640180 conn(0x7f88e406b6e0 msgr2=0x7f88e4069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7ff854a8c640 1 -- 172.21.15.45:0/1874190120 shutdown_connections 2023-10-03T19:12:38.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7ff854a8c640 1 -- 172.21.15.45:0/1874190120 wait complete. 2023-10-03T19:12:38.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f43cb7fe640 1 -- 172.21.15.45:0/757870678 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c00a6b70 con 0x7f43cc0a33f0 2023-10-03T19:12:38.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f43cb7fe640 1 -- 172.21.15.45:0/757870678 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c00ae440 con 0x7f43cc0a33f0 2023-10-03T19:12:38.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f88e9e39640 1 -- 172.21.15.45:0/1394640180 shutdown_connections 2023-10-03T19:12:38.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f43d300c640 1 -- 172.21.15.45:0/757870678 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43cc0a33f0 msgr2=0x7f43cc155fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f43d300c640 1 --2- 172.21.15.45:0/757870678 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43cc0a33f0 0x7f43cc155fc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f43c0005a50 tx=0x7f43c001da60 comp rx=0 tx=0).stop 2023-10-03T19:12:38.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f43d300c640 1 -- 172.21.15.45:0/757870678 shutdown_connections 2023-10-03T19:12:38.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f43d300c640 1 --2- 172.21.15.45:0/757870678 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43cc0a33f0 0x7f43cc155fc0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f43d300c640 1 -- 172.21.15.45:0/757870678 >> 172.21.15.45:0/757870678 conn(0x7f43cc06b6e0 msgr2=0x7f43cc069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f43d300c640 1 -- 172.21.15.45:0/757870678 shutdown_connections 2023-10-03T19:12:38.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7ff854a8c640 1 Processor -- start 2023-10-03T19:12:38.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7ff854a8c640 1 -- start start 2023-10-03T19:12:38.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7ff854a8c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff85006ca60 0x7ff85013fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7ff854a8c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff8500a33f0 0x7ff8501e2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7ff854a8c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8500bb6a0 0x7ff8501e26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7ff854a8c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff850147df0 con 0x7ff85006ca60 2023-10-03T19:12:38.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7ff854a8c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8501400b0 con 0x7ff8500bb6a0 2023-10-03T19:12:38.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7ff854a8c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8501e60e0 con 0x7ff8500a33f0 2023-10-03T19:12:38.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f43d300c640 1 -- 172.21.15.45:0/757870678 wait complete. 2023-10-03T19:12:38.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f43d300c640 1 Processor -- start 2023-10-03T19:12:38.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7ff84ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8500bb6a0 0x7ff8501e26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7ff84ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8500bb6a0 0x7ff8501e26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:46954/0 (socket says 172.21.15.45:46954) 2023-10-03T19:12:38.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7ff84ed9d640 1 -- 172.21.15.45:0/1930316103 learned_addr learned my addr 172.21.15.45:0/1930316103 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:38.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f43d300c640 1 -- start start 2023-10-03T19:12:38.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.373+0000 7f88e9e39640 1 -- 172.21.15.45:0/1394640180 wait complete. 2023-10-03T19:12:38.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f88e9e39640 1 Processor -- start 2023-10-03T19:12:38.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7ff84ed9d640 1 -- 172.21.15.45:0/1930316103 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff8500a33f0 msgr2=0x7ff8501e2180 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-03T19:12:38.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7ff84ed9d640 1 --2- 172.21.15.45:0/1930316103 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff8500a33f0 0x7ff8501e2180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7ff84ed9d640 1 -- 172.21.15.45:0/1930316103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff85006ca60 msgr2=0x7ff85013fb70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T19:12:38.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7ff84ed9d640 1 --2- 172.21.15.45:0/1930316103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff85006ca60 0x7ff85013fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7ff84ed9d640 1 -- 172.21.15.45:0/1930316103 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff844009420 con 0x7ff8500bb6a0 2023-10-03T19:12:38.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f43d300c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43cc06ca60 0x7f43cc1f6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f43d300c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43cc0a33f0 0x7f43cc06f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f43d300c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43cc0bb6a0 0x7f43cc147240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f43d300c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc0ba980 con 0x7f43cc0bb6a0 2023-10-03T19:12:38.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f43d300c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc0b78f0 con 0x7f43cc0a33f0 2023-10-03T19:12:38.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f43d300c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc1f7110 con 0x7f43cc06ca60 2023-10-03T19:12:38.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7ff84ed9d640 1 --2- 172.21.15.45:0/1930316103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8500bb6a0 0x7ff8501e26c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff84000c790 tx=0x7ff84000cc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f43d15a9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43cc0bb6a0 0x7f43cc147240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f43d15a9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43cc0bb6a0 0x7f43cc147240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41748/0 (socket says 172.21.15.45:41748) 2023-10-03T19:12:38.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f43d15a9640 1 -- 172.21.15.45:0/2788993594 learned_addr learned my addr 172.21.15.45:0/2788993594 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:38.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f43cbfff640 1 --2- 172.21.15.45:0/2788993594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43cc0a33f0 0x7f43cc06f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f43d0da8640 1 --2- 172.21.15.45:0/2788993594 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43cc06ca60 0x7f43cc1f6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f9c43fff640 1 --2- 172.21.15.45:0/2835181822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c3c047450 0x7f9c3c0d8f10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9c4404f0c0 tx=0x7f9c44098c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d55e752c83470fb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f43d15a9640 1 -- 172.21.15.45:0/2788993594 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43cc06ca60 msgr2=0x7f43cc1f6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f43d15a9640 1 --2- 172.21.15.45:0/2788993594 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43cc06ca60 0x7f43cc1f6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f43d15a9640 1 -- 172.21.15.45:0/2788993594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43cc0a33f0 msgr2=0x7f43cc06f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f43d15a9640 1 --2- 172.21.15.45:0/2788993594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43cc0a33f0 0x7f43cc06f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f43d15a9640 1 -- 172.21.15.45:0/2788993594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c0007cd0 con 0x7f43cc0bb6a0 2023-10-03T19:12:38.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f88e9e39640 1 -- start start 2023-10-03T19:12:38.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f88e9e39640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88e406ca60 0x7f88e41eefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f88e9e39640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88e40bb6a0 0x7f88e413fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f88e9e39640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88e40bd110 0x7f88e406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f88e9e39640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e406fb70 con 0x7f88e40bb6a0 2023-10-03T19:12:38.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f88e9e39640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e41ef520 con 0x7f88e40bd110 2023-10-03T19:12:38.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f88e9e39640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e41ee590 con 0x7f88e406ca60 2023-10-03T19:12:38.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f88e3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88e40bd110 0x7f88e406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f88e3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88e40bd110 0x7f88e406ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:46964/0 (socket says 172.21.15.45:46964) 2023-10-03T19:12:38.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f88e3fff640 1 -- 172.21.15.45:0/3339204019 learned_addr learned my addr 172.21.15.45:0/3339204019 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:38.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f88e37fe640 1 --2- 172.21.15.45:0/3339204019 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88e406ca60 0x7f88e41eefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f43d15a9640 1 --2- 172.21.15.45:0/2788993594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43cc0bb6a0 0x7f43cc147240 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f43c0005a50 tx=0x7f43c001a800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7ff83effd640 1 -- 172.21.15.45:0/1930316103 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84000cea0 con 0x7ff8500bb6a0 2023-10-03T19:12:38.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7ffb267fc640 1 -- 172.21.15.45:0/48857075 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ffb20050660 con 0x7ffb300bc260 2023-10-03T19:12:38.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f88e2ffd640 1 --2- 172.21.15.45:0/3339204019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88e40bb6a0 0x7f88e413fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7ff854a8c640 1 -- 172.21.15.45:0/1930316103 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8500a3b00 con 0x7ff8500bb6a0 2023-10-03T19:12:38.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7ff854a8c640 1 -- 172.21.15.45:0/1930316103 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8500bd2e0 con 0x7ff8500bb6a0 2023-10-03T19:12:38.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f5ef7fff640 1 -- 172.21.15.45:0/4213418127 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5f000fd1c0 con 0x7f5f08041710 2023-10-03T19:12:38.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f9c427fc640 1 -- 172.21.15.45:0/2835181822 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c441228f0 con 0x7f9c3c047450 2023-10-03T19:12:38.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f9c427fc640 1 -- 172.21.15.45:0/2835181822 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c44122a70 con 0x7f9c3c047450 2023-10-03T19:12:38.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f9c427fc640 1 -- 172.21.15.45:0/2835181822 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c44122ea0 con 0x7f9c3c047450 2023-10-03T19:12:38.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f88e2ffd640 1 -- 172.21.15.45:0/3339204019 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88e406ca60 msgr2=0x7f88e41eefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f88e2ffd640 1 --2- 172.21.15.45:0/3339204019 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88e406ca60 0x7f88e41eefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f88e2ffd640 1 -- 172.21.15.45:0/3339204019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88e40bd110 msgr2=0x7f88e406ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f88e2ffd640 1 --2- 172.21.15.45:0/3339204019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88e40bd110 0x7f88e406ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f88e2ffd640 1 -- 172.21.15.45:0/3339204019 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d4009d60 con 0x7f88e40bb6a0 2023-10-03T19:12:38.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f88e2ffd640 1 --2- 172.21.15.45:0/3339204019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88e40bb6a0 0x7f88e413fe50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f88d40ae000 tx=0x7f88d401b550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7ff854a8c640 1 -- 172.21.15.45:0/1930316103 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8500bc110 con 0x7ff8500bb6a0 2023-10-03T19:12:38.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7ff83effd640 1 -- 172.21.15.45:0/1930316103 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff840003db0 con 0x7ff8500bb6a0 2023-10-03T19:12:38.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7ff83effd640 1 -- 172.21.15.45:0/1930316103 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8400052b0 con 0x7ff8500bb6a0 2023-10-03T19:12:38.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.381+0000 7ff83effd640 1 -- 172.21.15.45:0/1930316103 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff840005410 con 0x7ff8500bb6a0 2023-10-03T19:12:38.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.381+0000 7ff83effd640 1 --2- 172.21.15.45:0/1930316103 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff830066300 0x7ff8300687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.381+0000 7ff83effd640 1 -- 172.21.15.45:0/1930316103 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff8400839a0 con 0x7ff8500bb6a0 2023-10-03T19:12:38.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.381+0000 7f88cbfff640 1 -- 172.21.15.45:0/3339204019 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d40afa50 con 0x7f88e40bb6a0 2023-10-03T19:12:38.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.381+0000 7f88cbfff640 1 -- 172.21.15.45:0/3339204019 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d40afbb0 con 0x7f88e40bb6a0 2023-10-03T19:12:38.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.381+0000 7f88cbfff640 1 -- 172.21.15.45:0/3339204019 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d40b8410 con 0x7f88e40bb6a0 2023-10-03T19:12:38.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.381+0000 7f88e9e39640 1 -- 172.21.15.45:0/3339204019 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e40a3b00 con 0x7f88e40bb6a0 2023-10-03T19:12:38.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.381+0000 7f88e9e39640 1 -- 172.21.15.45:0/3339204019 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e414b510 con 0x7f88e40bb6a0 2023-10-03T19:12:38.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f43c97fa640 1 -- 172.21.15.45:0/2788993594 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c00afea0 con 0x7f43cc0bb6a0 2023-10-03T19:12:38.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f43c97fa640 1 -- 172.21.15.45:0/2788993594 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c000d230 con 0x7f43cc0bb6a0 2023-10-03T19:12:38.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.377+0000 7f43c97fa640 1 -- 172.21.15.45:0/2788993594 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c00b9680 con 0x7f43cc0bb6a0 2023-10-03T19:12:38.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.381+0000 7ff84e59c640 1 --2- 172.21.15.45:0/1930316103 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff830066300 0x7ff8300687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.381+0000 7f43d300c640 1 -- 172.21.15.45:0/2788993594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43cc0bd2e0 con 0x7f43cc0bb6a0 2023-10-03T19:12:38.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.381+0000 7f43d300c640 1 -- 172.21.15.45:0/2788993594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43cc14b510 con 0x7f43cc0bb6a0 2023-10-03T19:12:38.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.381+0000 7ff84e59c640 1 --2- 172.21.15.45:0/1930316103 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff830066300 0x7ff8300687b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff8440ae000 tx=0x7ff8440b3040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.381+0000 7f43d300c640 1 -- 172.21.15.45:0/2788993594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43cc0a3b00 con 0x7f43cc0bb6a0 2023-10-03T19:12:38.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.385+0000 7f88e9e39640 1 -- 172.21.15.45:0/3339204019 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c4005260 con 0x7f88e40bb6a0 2023-10-03T19:12:38.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.385+0000 7f88cbfff640 1 -- 172.21.15.45:0/3339204019 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f88d40b8570 con 0x7f88e40bb6a0 2023-10-03T19:12:38.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.385+0000 7f88cbfff640 1 --2- 172.21.15.45:0/3339204019 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f88d0066380 0x7f88d0068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.385+0000 7f88cbfff640 1 -- 172.21.15.45:0/3339204019 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f88d411df30 con 0x7f88e40bb6a0 2023-10-03T19:12:38.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.385+0000 7f88e37fe640 1 --2- 172.21.15.45:0/3339204019 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f88d0066380 0x7f88d0068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.385+0000 7f88e37fe640 1 --2- 172.21.15.45:0/3339204019 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f88d0066380 0x7f88d0068830 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f88d8004e30 tx=0x7f88d8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.385+0000 7f9c48fe6640 1 -- 172.21.15.45:0/2835181822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c3c047450 msgr2=0x7f9c3c0d8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.385+0000 7f9c48fe6640 1 --2- 172.21.15.45:0/2835181822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c3c047450 0x7f9c3c0d8f10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9c4404f0c0 tx=0x7f9c44098c10 comp rx=0 tx=0).stop 2023-10-03T19:12:38.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.389+0000 7f43c97fa640 1 -- 172.21.15.45:0/2788993594 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f43c00b5040 con 0x7f43cc0bb6a0 2023-10-03T19:12:38.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.389+0000 7f43c97fa640 1 --2- 172.21.15.45:0/2788993594 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f43b8066350 0x7f43b8068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.389+0000 7f43c97fa640 1 -- 172.21.15.45:0/2788993594 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f43c01200c0 con 0x7f43cc0bb6a0 2023-10-03T19:12:38.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.389+0000 7f43d0da8640 1 --2- 172.21.15.45:0/2788993594 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f43b8066350 0x7f43b8068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.389+0000 7f43d0da8640 1 --2- 172.21.15.45:0/2788993594 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f43b8066350 0x7f43b8068800 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f43bc005890 tx=0x7f43bc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.393+0000 7f9c48fe6640 1 -- 172.21.15.45:0/2835181822 shutdown_connections 2023-10-03T19:12:38.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.393+0000 7f9c48fe6640 1 --2- 172.21.15.45:0/2835181822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c3c047450 0x7f9c3c0d8f10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.393+0000 7f9c48fe6640 1 --2- 172.21.15.45:0/2835181822 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c3c047ac0 0x7f9c3c0d89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.393+0000 7f9c48fe6640 1 -- 172.21.15.45:0/2835181822 >> 172.21.15.45:0/2835181822 conn(0x7f9c3c044a30 msgr2=0x7f9c3c044e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.393+0000 7f9c48fe6640 1 -- 172.21.15.45:0/2835181822 shutdown_connections 2023-10-03T19:12:38.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.393+0000 7f9c48fe6640 1 -- 172.21.15.45:0/2835181822 wait complete. 2023-10-03T19:12:38.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.393+0000 7f9c48fe6640 1 Processor -- start 2023-10-03T19:12:38.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.393+0000 7f9c48fe6640 1 -- start start 2023-10-03T19:12:38.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.393+0000 7ff83effd640 1 -- 172.21.15.45:0/1930316103 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff840050e90 con 0x7ff8500bb6a0 2023-10-03T19:12:38.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.393+0000 7f9c48fe6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c3c047450 0x7f9c3c0ce880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.393+0000 7f9c48fe6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c3c047ac0 0x7f9c3c0d3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.393+0000 7f9c48fe6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c3c0d2880 0x7f9c3c0d38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.393+0000 7f9c48fe6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c0ccee0 con 0x7f9c3c0d2880 2023-10-03T19:12:38.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.393+0000 7f9c48fe6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c0d4620 con 0x7f9c3c047ac0 2023-10-03T19:12:38.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.393+0000 7f9c48fe6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c0d48c0 con 0x7f9c3c047450 2023-10-03T19:12:38.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.393+0000 7f43c97fa640 1 -- 172.21.15.45:0/2788993594 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f43c00ed5b0 con 0x7f43cc0bb6a0 2023-10-03T19:12:38.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.393+0000 7f9c437fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c3c047450 0x7f9c3c0ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.393+0000 7f9c437fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c3c047450 0x7f9c3c0ce880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:40726/0 (socket says 172.21.15.45:40726) 2023-10-03T19:12:38.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.393+0000 7f9c437fe640 1 -- 172.21.15.45:0/3778994648 learned_addr learned my addr 172.21.15.45:0/3778994648 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:38.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.393+0000 7f9c42ffd640 1 --2- 172.21.15.45:0/3778994648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c3c047ac0 0x7f9c3c0d3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.393+0000 7f9c437fe640 1 -- 172.21.15.45:0/3778994648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c3c047ac0 msgr2=0x7f9c3c0d3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.393+0000 7f9c437fe640 1 --2- 172.21.15.45:0/3778994648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c3c047ac0 0x7f9c3c0d3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.393+0000 7f9c437fe640 1 -- 172.21.15.45:0/3778994648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c3c0d2880 msgr2=0x7f9c3c0d38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.393+0000 7f9c437fe640 1 --2- 172.21.15.45:0/3778994648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c3c0d2880 0x7f9c3c0d38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.393+0000 7f9c437fe640 1 -- 172.21.15.45:0/3778994648 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c440733a0 con 0x7f9c3c047450 2023-10-03T19:12:38.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.393+0000 7f9c437fe640 1 --2- 172.21.15.45:0/3778994648 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c3c047450 0x7f9c3c0ce880 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9c3800c400 tx=0x7f9c3800c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.397+0000 7f9c2ffff640 1 -- 172.21.15.45:0/3778994648 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c38005cf0 con 0x7f9c3c047450 2023-10-03T19:12:38.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.397+0000 7f9c2ffff640 1 -- 172.21.15.45:0/3778994648 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c38005e50 con 0x7f9c3c047450 2023-10-03T19:12:38.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.397+0000 7f9c2ffff640 1 -- 172.21.15.45:0/3778994648 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c380072d0 con 0x7f9c3c047450 2023-10-03T19:12:38.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.397+0000 7f9c48fe6640 1 -- 172.21.15.45:0/3778994648 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c3c046c50 con 0x7f9c3c047450 2023-10-03T19:12:38.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.397+0000 7f9c48fe6640 1 -- 172.21.15.45:0/3778994648 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c3c0d5dd0 con 0x7f9c3c047450 2023-10-03T19:12:38.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.397+0000 7f9c2ffff640 1 -- 172.21.15.45:0/3778994648 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9c38007430 con 0x7f9c3c047450 2023-10-03T19:12:38.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.397+0000 7f9c2ffff640 1 --2- 172.21.15.45:0/3778994648 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9c28066280 0x7f9c28068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.397+0000 7f9c2ffff640 1 -- 172.21.15.45:0/3778994648 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9c38083140 con 0x7f9c3c047450 2023-10-03T19:12:38.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.397+0000 7f9c42ffd640 1 --2- 172.21.15.45:0/3778994648 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9c28066280 0x7f9c28068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.397+0000 7f9c48fe6640 1 -- 172.21.15.45:0/3778994648 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c3c008700 con 0x7f9c3c047450 2023-10-03T19:12:38.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.401+0000 7f9c42ffd640 1 --2- 172.21.15.45:0/3778994648 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9c28066280 0x7f9c28068730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c0cf0b0 tx=0x7f9c30008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.405+0000 7f88cbfff640 1 -- 172.21.15.45:0/3339204019 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f88d40eb5f0 con 0x7f88e40bb6a0 2023-10-03T19:12:38.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.413+0000 7f9c2ffff640 1 -- 172.21.15.45:0/3778994648 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9c38050670 con 0x7f9c3c047450 2023-10-03T19:12:38.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.689+0000 7f060010f640 1 -- 172.21.15.45:0/2844797369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f05f814b5d0 con 0x7f05f80bc010 2023-10-03T19:12:38.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.689+0000 7f05ee7fc640 1 -- 172.21.15.45:0/2844797369 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f05f4017020 con 0x7f05f80bc010 2023-10-03T19:12:38.694 INFO:teuthology.orchestra.run.smithi045.stdout:64424509447 2023-10-03T19:12:38.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.689+0000 7ffb13fff640 1 -- 172.21.15.45:0/48857075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ffb0c0057e0 con 0x7ffb300bc260 2023-10-03T19:12:38.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.689+0000 7ffb267fc640 1 -- 172.21.15.45:0/48857075 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffb20017020 con 0x7ffb300bc260 2023-10-03T19:12:38.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.693+0000 7f060010f640 1 -- 172.21.15.45:0/2844797369 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f05dc066300 msgr2=0x7f05dc0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.693+0000 7f060010f640 1 --2- 172.21.15.45:0/2844797369 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f05dc066300 0x7f05dc0687b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f05e8006aa0 tx=0x7f05e8006a30 comp rx=0 tx=0).stop 2023-10-03T19:12:38.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.693+0000 7f060010f640 1 -- 172.21.15.45:0/2844797369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f80bc010 msgr2=0x7f05f80b8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.693+0000 7f060010f640 1 --2- 172.21.15.45:0/2844797369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f80bc010 0x7f05f80b8ec0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f05f400c3c0 tx=0x7f05f400c880 comp rx=0 tx=0).stop 2023-10-03T19:12:38.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.693+0000 7f060010f640 1 -- 172.21.15.45:0/2844797369 shutdown_connections 2023-10-03T19:12:38.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.693+0000 7f060010f640 1 --2- 172.21.15.45:0/2844797369 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f05dc066300 0x7f05dc0687b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.693+0000 7f060010f640 1 --2- 172.21.15.45:0/2844797369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05f8149b30 0x7f05f80b6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.693+0000 7f060010f640 1 --2- 172.21.15.45:0/2844797369 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f05f80bc660 0x7f05f80b6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.693+0000 7f060010f640 1 --2- 172.21.15.45:0/2844797369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f80bc010 0x7f05f80b8ec0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.693+0000 7f060010f640 1 -- 172.21.15.45:0/2844797369 >> 172.21.15.45:0/2844797369 conn(0x7f05f8069ad0 msgr2=0x7f05f8146ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.693+0000 7f060010f640 1 -- 172.21.15.45:0/2844797369 shutdown_connections 2023-10-03T19:12:38.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.693+0000 7f060010f640 1 -- 172.21.15.45:0/2844797369 wait complete. 2023-10-03T19:12:38.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.693+0000 7f891defe640 1 -- 172.21.15.45:0/273784232 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f88f80057e0 con 0x7f89180a33f0 2023-10-03T19:12:38.700 INFO:teuthology.orchestra.run.smithi045.stdout:60129542150 2023-10-03T19:12:38.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.693+0000 7f5f15a2a640 1 -- 172.21.15.45:0/4213418127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5f08005280 con 0x7f5f08041710 2023-10-03T19:12:38.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.693+0000 7f5ef7fff640 1 -- 172.21.15.45:0/4213418127 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5f000c1030 con 0x7f5f08041710 2023-10-03T19:12:38.700 INFO:teuthology.orchestra.run.smithi045.stdout:64424509446 2023-10-03T19:12:38.701 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-10-03T19:12:38.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.693+0000 7f88fffff640 1 -- 172.21.15.45:0/273784232 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f890c054cf0 con 0x7f89180a33f0 2023-10-03T19:12:38.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.693+0000 7ffb13fff640 1 -- 172.21.15.45:0/48857075 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ffb140662b0 msgr2=0x7ffb14068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.693+0000 7ffb13fff640 1 --2- 172.21.15.45:0/48857075 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ffb140662b0 0x7ffb14068760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ffb280b2000 tx=0x7ffb280ab070 comp rx=0 tx=0).stop 2023-10-03T19:12:38.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.693+0000 7ffb13fff640 1 -- 172.21.15.45:0/48857075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb300bc260 msgr2=0x7ffb3013bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.693+0000 7ffb13fff640 1 --2- 172.21.15.45:0/48857075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb300bc260 0x7ffb3013bff0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000c3c0 tx=0x7ffb2000c880 comp rx=0 tx=0).stop 2023-10-03T19:12:38.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.693+0000 7ffb13fff640 1 -- 172.21.15.45:0/48857075 shutdown_connections 2023-10-03T19:12:38.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.693+0000 7ffb13fff640 1 --2- 172.21.15.45:0/48857075 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ffb140662b0 0x7ffb14068760 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.693+0000 7ffb13fff640 1 --2- 172.21.15.45:0/48857075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb300bc260 0x7ffb3013bff0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.693+0000 7ffb13fff640 1 --2- 172.21.15.45:0/48857075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb300bbd50 0x7ffb30139720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.693+0000 7ffb13fff640 1 --2- 172.21.15.45:0/48857075 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb300a3a50 0x7ffb301e5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.693+0000 7ffb13fff640 1 -- 172.21.15.45:0/48857075 >> 172.21.15.45:0/48857075 conn(0x7ffb3006dec0 msgr2=0x7ffb300a30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.693+0000 7ffb13fff640 1 -- 172.21.15.45:0/48857075 shutdown_connections 2023-10-03T19:12:38.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.693+0000 7ffb13fff640 1 -- 172.21.15.45:0/48857075 wait complete. 2023-10-03T19:12:38.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.697+0000 7f891defe640 1 -- 172.21.15.45:0/273784232 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8904066380 msgr2=0x7f8904068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.697+0000 7f891defe640 1 --2- 172.21.15.45:0/273784232 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8904066380 0x7f8904068830 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f89080b0000 tx=0x7f8908004740 comp rx=0 tx=0).stop 2023-10-03T19:12:38.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.697+0000 7f891defe640 1 -- 172.21.15.45:0/273784232 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89180a33f0 msgr2=0x7f8918141830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.697+0000 7f891defe640 1 --2- 172.21.15.45:0/273784232 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89180a33f0 0x7f8918141830 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f890c00b410 tx=0x7f890c00b8d0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.701+0000 7f891defe640 1 -- 172.21.15.45:0/273784232 shutdown_connections 2023-10-03T19:12:38.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.701+0000 7f891defe640 1 --2- 172.21.15.45:0/273784232 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8904066380 0x7f8904068830 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.701+0000 7f891defe640 1 --2- 172.21.15.45:0/273784232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89180bb6a0 0x7f8918141d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.701+0000 7f891defe640 1 --2- 172.21.15.45:0/273784232 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89180a33f0 0x7f8918141830 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.701+0000 7f891defe640 1 --2- 172.21.15.45:0/273784232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f891806ca60 0x7f8918158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.701+0000 7f891defe640 1 -- 172.21.15.45:0/273784232 >> 172.21.15.45:0/273784232 conn(0x7f891806b6e0 msgr2=0x7f89180c0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.701+0000 7f43d300c640 1 -- 172.21.15.45:0/2788993594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f43cc0a3b00 con 0x7f43cc0bb6a0 2023-10-03T19:12:38.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.701+0000 7ff854a8c640 1 -- 172.21.15.45:0/1930316103 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff850147f60 con 0x7ff8500bb6a0 2023-10-03T19:12:38.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.701+0000 7f43c97fa640 1 -- 172.21.15.45:0/2788993594 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f43c00f0bd0 con 0x7f43cc0bb6a0 2023-10-03T19:12:38.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.701+0000 7f5f15a2a640 1 -- 172.21.15.45:0/4213418127 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5efc0662b0 msgr2=0x7f5efc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.701+0000 7f5f15a2a640 1 --2- 172.21.15.45:0/4213418127 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5efc0662b0 0x7f5efc068760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5f040092c0 tx=0x7f5f04009250 comp rx=0 tx=0).stop 2023-10-03T19:12:38.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.705+0000 7f891defe640 1 -- 172.21.15.45:0/273784232 shutdown_connections 2023-10-03T19:12:38.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.705+0000 7f5f15a2a640 1 -- 172.21.15.45:0/4213418127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f08041710 msgr2=0x7f5f080f4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.705+0000 7f5f15a2a640 1 --2- 172.21.15.45:0/4213418127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f08041710 0x7f5f080f4b10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5f00013110 tx=0x7f5f0002a030 comp rx=0 tx=0).stop 2023-10-03T19:12:38.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.705+0000 7f891defe640 1 -- 172.21.15.45:0/273784232 wait complete. 2023-10-03T19:12:38.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.705+0000 7ff83effd640 1 -- 172.21.15.45:0/1930316103 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff840081e60 con 0x7ff8500bb6a0 2023-10-03T19:12:38.710 INFO:teuthology.orchestra.run.smithi045.stdout:64424509446 2023-10-03T19:12:38.710 INFO:teuthology.orchestra.run.smithi045.stdout:64424509446 2023-10-03T19:12:38.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.705+0000 7f5f15a2a640 1 -- 172.21.15.45:0/4213418127 shutdown_connections 2023-10-03T19:12:38.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.705+0000 7f5f15a2a640 1 --2- 172.21.15.45:0/4213418127 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5efc0662b0 0x7f5efc068760 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.705+0000 7f5f15a2a640 1 --2- 172.21.15.45:0/4213418127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f080f0420 0x7f5f080eb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.705+0000 7f5f15a2a640 1 --2- 172.21.15.45:0/4213418127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f08041710 0x7f5f080f4b10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.705+0000 7f5f15a2a640 1 --2- 172.21.15.45:0/4213418127 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f0800b6b0 0x7f5f080f45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.705+0000 7f5f15a2a640 1 -- 172.21.15.45:0/4213418127 >> 172.21.15.45:0/4213418127 conn(0x7f5f08043810 msgr2=0x7f5f080260c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.705+0000 7f5f15a2a640 1 -- 172.21.15.45:0/4213418127 shutdown_connections 2023-10-03T19:12:38.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.705+0000 7f5f15a2a640 1 -- 172.21.15.45:0/4213418127 wait complete. 2023-10-03T19:12:38.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.705+0000 7ff854a8c640 1 -- 172.21.15.45:0/1930316103 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff830066300 msgr2=0x7ff8300687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.705+0000 7ff854a8c640 1 --2- 172.21.15.45:0/1930316103 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff830066300 0x7ff8300687b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff8440ae000 tx=0x7ff8440b3040 comp rx=0 tx=0).stop 2023-10-03T19:12:38.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.705+0000 7ff854a8c640 1 -- 172.21.15.45:0/1930316103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8500bb6a0 msgr2=0x7ff8501e26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.705+0000 7ff854a8c640 1 --2- 172.21.15.45:0/1930316103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8500bb6a0 0x7ff8501e26c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff84000c790 tx=0x7ff84000cc50 comp rx=0 tx=0).stop 2023-10-03T19:12:38.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.705+0000 7ff854a8c640 1 -- 172.21.15.45:0/1930316103 shutdown_connections 2023-10-03T19:12:38.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.705+0000 7ff854a8c640 1 --2- 172.21.15.45:0/1930316103 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff830066300 0x7ff8300687b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.705+0000 7ff854a8c640 1 --2- 172.21.15.45:0/1930316103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8500bb6a0 0x7ff8501e26c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.705+0000 7ff854a8c640 1 --2- 172.21.15.45:0/1930316103 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff8500a33f0 0x7ff8501e2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.705+0000 7ff854a8c640 1 --2- 172.21.15.45:0/1930316103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff85006ca60 0x7ff85013fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.705+0000 7ff854a8c640 1 -- 172.21.15.45:0/1930316103 >> 172.21.15.45:0/1930316103 conn(0x7ff85006b6e0 msgr2=0x7ff8500bcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.713+0000 7ff854a8c640 1 -- 172.21.15.45:0/1930316103 shutdown_connections 2023-10-03T19:12:38.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.713+0000 7ff854a8c640 1 -- 172.21.15.45:0/1930316103 wait complete. 2023-10-03T19:12:38.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.713+0000 7f43d300c640 1 -- 172.21.15.45:0/2788993594 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f43b8066350 msgr2=0x7f43b8068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.713+0000 7f43d300c640 1 --2- 172.21.15.45:0/2788993594 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f43b8066350 0x7f43b8068800 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f43bc005890 tx=0x7f43bc009040 comp rx=0 tx=0).stop 2023-10-03T19:12:38.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.713+0000 7f43d300c640 1 -- 172.21.15.45:0/2788993594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43cc0bb6a0 msgr2=0x7f43cc147240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.713+0000 7f43d300c640 1 --2- 172.21.15.45:0/2788993594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43cc0bb6a0 0x7f43cc147240 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f43c0005a50 tx=0x7f43c001a800 comp rx=0 tx=0).stop 2023-10-03T19:12:38.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.713+0000 7f43d300c640 1 -- 172.21.15.45:0/2788993594 shutdown_connections 2023-10-03T19:12:38.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.713+0000 7f43d300c640 1 --2- 172.21.15.45:0/2788993594 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f43b8066350 0x7f43b8068800 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.713+0000 7f43d300c640 1 --2- 172.21.15.45:0/2788993594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43cc0bb6a0 0x7f43cc147240 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.713+0000 7f43d300c640 1 --2- 172.21.15.45:0/2788993594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43cc0a33f0 0x7f43cc06f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.713+0000 7f43d300c640 1 --2- 172.21.15.45:0/2788993594 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43cc06ca60 0x7f43cc1f6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.713+0000 7f43d300c640 1 -- 172.21.15.45:0/2788993594 >> 172.21.15.45:0/2788993594 conn(0x7f43cc06b6e0 msgr2=0x7f43cc149200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.713+0000 7f43d300c640 1 -- 172.21.15.45:0/2788993594 shutdown_connections 2023-10-03T19:12:38.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.713+0000 7f43d300c640 1 -- 172.21.15.45:0/2788993594 wait complete. 2023-10-03T19:12:38.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.721+0000 7f88e9e39640 1 -- 172.21.15.45:0/3339204019 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f88c4005510 con 0x7f88e40bb6a0 2023-10-03T19:12:38.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.721+0000 7f88cbfff640 1 -- 172.21.15.45:0/3339204019 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f88d40eec10 con 0x7f88e40bb6a0 2023-10-03T19:12:38.727 INFO:teuthology.orchestra.run.smithi045.stdout:64424509447 2023-10-03T19:12:38.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.725+0000 7f88c9ffb640 1 -- 172.21.15.45:0/3339204019 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f88d0066380 msgr2=0x7f88d0068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.725+0000 7f88c9ffb640 1 --2- 172.21.15.45:0/3339204019 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f88d0066380 0x7f88d0068830 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f88d8004e30 tx=0x7f88d8009040 comp rx=0 tx=0).stop 2023-10-03T19:12:38.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.725+0000 7f88c9ffb640 1 -- 172.21.15.45:0/3339204019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88e40bb6a0 msgr2=0x7f88e413fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.725+0000 7f88c9ffb640 1 --2- 172.21.15.45:0/3339204019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88e40bb6a0 0x7f88e413fe50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f88d40ae000 tx=0x7f88d401b550 comp rx=0 tx=0).stop 2023-10-03T19:12:38.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.725+0000 7f88c9ffb640 1 -- 172.21.15.45:0/3339204019 shutdown_connections 2023-10-03T19:12:38.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.725+0000 7f88c9ffb640 1 --2- 172.21.15.45:0/3339204019 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f88d0066380 0x7f88d0068830 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.725+0000 7f88c9ffb640 1 --2- 172.21.15.45:0/3339204019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88e40bd110 0x7f88e406ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.725+0000 7f88c9ffb640 1 --2- 172.21.15.45:0/3339204019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88e40bb6a0 0x7f88e413fe50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.725+0000 7f88c9ffb640 1 --2- 172.21.15.45:0/3339204019 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88e406ca60 0x7f88e41eefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.725+0000 7f88c9ffb640 1 -- 172.21.15.45:0/3339204019 >> 172.21.15.45:0/3339204019 conn(0x7f88e406b6e0 msgr2=0x7f88e40bbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.725+0000 7f88c9ffb640 1 -- 172.21.15.45:0/3339204019 shutdown_connections 2023-10-03T19:12:38.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.725+0000 7f88c9ffb640 1 -- 172.21.15.45:0/3339204019 wait complete. 2023-10-03T19:12:38.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.2 2023-10-03T19:12:38.731 DEBUG:teuthology.parallel:result is None 2023-10-03T19:12:38.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.6 2023-10-03T19:12:38.732 DEBUG:teuthology.parallel:result is None 2023-10-03T19:12:38.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.729+0000 7f9c48fe6640 1 -- 172.21.15.45:0/3778994648 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9c3c0064f0 con 0x7f9c3c047450 2023-10-03T19:12:38.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.729+0000 7f9c2ffff640 1 -- 172.21.15.45:0/3778994648 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9c38017020 con 0x7f9c3c047450 2023-10-03T19:12:38.733 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2023-10-03T19:12:38.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.733+0000 7f9c48fe6640 1 -- 172.21.15.45:0/3778994648 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9c28066280 msgr2=0x7f9c28068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.733+0000 7f9c48fe6640 1 --2- 172.21.15.45:0/3778994648 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9c28066280 0x7f9c28068730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c0cf0b0 tx=0x7f9c30008040 comp rx=0 tx=0).stop 2023-10-03T19:12:38.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.733+0000 7f9c48fe6640 1 -- 172.21.15.45:0/3778994648 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c3c047450 msgr2=0x7f9c3c0ce880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.733+0000 7f9c48fe6640 1 --2- 172.21.15.45:0/3778994648 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c3c047450 0x7f9c3c0ce880 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9c3800c400 tx=0x7f9c3800c8c0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.733+0000 7f9c48fe6640 1 -- 172.21.15.45:0/3778994648 shutdown_connections 2023-10-03T19:12:38.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.733+0000 7f9c48fe6640 1 --2- 172.21.15.45:0/3778994648 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9c28066280 0x7f9c28068730 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.733+0000 7f9c48fe6640 1 --2- 172.21.15.45:0/3778994648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c3c0d2880 0x7f9c3c0d38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.733+0000 7f9c48fe6640 1 --2- 172.21.15.45:0/3778994648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c3c047ac0 0x7f9c3c0d3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.733+0000 7f9c48fe6640 1 --2- 172.21.15.45:0/3778994648 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c3c047450 0x7f9c3c0ce880 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.733+0000 7f9c48fe6640 1 -- 172.21.15.45:0/3778994648 >> 172.21.15.45:0/3778994648 conn(0x7f9c3c044a30 msgr2=0x7f9c3c044e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.733+0000 7f9c48fe6640 1 -- 172.21.15.45:0/3778994648 shutdown_connections 2023-10-03T19:12:38.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.733+0000 7f9c48fe6640 1 -- 172.21.15.45:0/3778994648 wait complete. 2023-10-03T19:12:38.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2023-10-03T19:12:38.738 DEBUG:teuthology.parallel:result is None 2023-10-03T19:12:38.741 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.3 2023-10-03T19:12:38.741 DEBUG:teuthology.parallel:result is None 2023-10-03T19:12:38.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.7 2023-10-03T19:12:38.749 DEBUG:teuthology.parallel:result is None 2023-10-03T19:12:38.749 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.1 2023-10-03T19:12:38.749 DEBUG:teuthology.parallel:result is None 2023-10-03T19:12:38.753 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.4 2023-10-03T19:12:38.753 DEBUG:teuthology.parallel:result is None 2023-10-03T19:12:38.756 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-10-03T19:12:38.756 DEBUG:teuthology.parallel:result is None 2023-10-03T19:12:38.757 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-03T19:12:38.757 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:12:38.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.901+0000 7f8b9bb7e640 1 Processor -- start 2023-10-03T19:12:38.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.901+0000 7f8b9bb7e640 1 -- start start 2023-10-03T19:12:38.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.901+0000 7f8b9bb7e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8b9414f240 0x7f8b941528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.901+0000 7f8b9bb7e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8b940c2790 0x7f8b940c0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.901+0000 7f8b9bb7e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b9406b2d0 con 0x7f8b940bb1d0 2023-10-03T19:12:38.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.901+0000 7f8b9bb7e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b9406b640 con 0x7f8b9414f240 2023-10-03T19:12:38.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.901+0000 7f8b9bb7e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b940c0fa0 con 0x7f8b940c2790 2023-10-03T19:12:38.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.905+0000 7f8b9991a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8b9414f240 0x7f8b941528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.905+0000 7f8b9991a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8b9414f240 0x7f8b941528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41776/0 (socket says 172.21.15.45:41776) 2023-10-03T19:12:38.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.905+0000 7f8b9991a640 1 -- 172.21.15.45:0/4131872620 learned_addr learned my addr 172.21.15.45:0/4131872620 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:38.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.905+0000 7f8b99119640 1 --2- 172.21.15.45:0/4131872620 >> v2:172.21.15.79:3300/0 conn(0x7f8b940c2790 0x7f8b940c0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.905+0000 7f8b9991a640 1 -- 172.21.15.45:0/4131872620 >> v2:172.21.15.79:3300/0 conn(0x7f8b940c2790 msgr2=0x7f8b940c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:38.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.905+0000 7f8b9991a640 1 --2- 172.21.15.45:0/4131872620 >> v2:172.21.15.79:3300/0 conn(0x7f8b940c2790 0x7f8b940c0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.905+0000 7f8b9991a640 1 -- 172.21.15.45:0/4131872620 >> v1:172.21.15.79:6789/0 conn(0x7f8b940bb1d0 legacy=0x7f8b940c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:38.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.905+0000 7f8b9991a640 1 -- 172.21.15.45:0/4131872620 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b940a3c60 con 0x7f8b9414f240 2023-10-03T19:12:38.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.905+0000 7f8b9991a640 1 --2- 172.21.15.45:0/4131872620 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b9414f240 0x7f8b941528d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8b94089fd0 tx=0x7f8b9001f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bde61677a20ceb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.905+0000 7f8b98918640 1 -- 172.21.15.45:0/4131872620 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b900af400 con 0x7f8b9414f240 2023-10-03T19:12:38.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.905+0000 7f8b98918640 1 -- 172.21.15.45:0/4131872620 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b900ab050 con 0x7f8b9414f240 2023-10-03T19:12:38.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.905+0000 7f8b98918640 1 -- 172.21.15.45:0/4131872620 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b900af780 con 0x7f8b9414f240 2023-10-03T19:12:38.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.905+0000 7f8b9bb7e640 1 -- 172.21.15.45:0/4131872620 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b9414f240 msgr2=0x7f8b941528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.905+0000 7f8b9bb7e640 1 --2- 172.21.15.45:0/4131872620 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b9414f240 0x7f8b941528d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8b94089fd0 tx=0x7f8b9001f180 comp rx=0 tx=0).stop 2023-10-03T19:12:38.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.905+0000 7f8b9bb7e640 1 -- 172.21.15.45:0/4131872620 shutdown_connections 2023-10-03T19:12:38.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.905+0000 7f8b9bb7e640 1 --2- 172.21.15.45:0/4131872620 >> v2:172.21.15.79:3300/0 conn(0x7f8b940c2790 0x7f8b940c0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.905+0000 7f8b9bb7e640 1 --2- 172.21.15.45:0/4131872620 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b9414f240 0x7f8b941528d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.905+0000 7f8b9bb7e640 1 -- 172.21.15.45:0/4131872620 >> 172.21.15.45:0/4131872620 conn(0x7f8b940a64a0 msgr2=0x7f8b940a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:38.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.905+0000 7f8b9bb7e640 1 -- 172.21.15.45:0/4131872620 shutdown_connections 2023-10-03T19:12:38.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.905+0000 7f8b9bb7e640 1 -- 172.21.15.45:0/4131872620 wait complete. 2023-10-03T19:12:38.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.909+0000 7f8b9bb7e640 1 Processor -- start 2023-10-03T19:12:38.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.909+0000 7f8b9bb7e640 1 -- start start 2023-10-03T19:12:38.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.909+0000 7f8b9bb7e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b940bb1d0 0x7f8b941db200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.909+0000 7f8b9bb7e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b940c2790 0x7f8b9414aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.909+0000 7f8b9bb7e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b9414f240 0x7f8b9414af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.909+0000 7f8b9bb7e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b940a7ff0 con 0x7f8b940c2790 2023-10-03T19:12:38.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.909+0000 7f8b9bb7e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b941db740 con 0x7f8b940bb1d0 2023-10-03T19:12:38.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.909+0000 7f8b9bb7e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b941e7850 con 0x7f8b9414f240 2023-10-03T19:12:38.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.909+0000 7f8b99119640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b940c2790 0x7f8b9414aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.909+0000 7f8b99119640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b940c2790 0x7f8b9414aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41792/0 (socket says 172.21.15.45:41792) 2023-10-03T19:12:38.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.909+0000 7f8b99119640 1 -- 172.21.15.45:0/2082750470 learned_addr learned my addr 172.21.15.45:0/2082750470 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:38.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.909+0000 7f8b9991a640 1 --2- 172.21.15.45:0/2082750470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b940bb1d0 0x7f8b941db200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.909+0000 7f8b9a11b640 1 --2- 172.21.15.45:0/2082750470 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b9414f240 0x7f8b9414af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.909+0000 7f8b99119640 1 -- 172.21.15.45:0/2082750470 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b9414f240 msgr2=0x7f8b9414af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.909+0000 7f8b99119640 1 --2- 172.21.15.45:0/2082750470 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b9414f240 0x7f8b9414af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.909+0000 7f8b99119640 1 -- 172.21.15.45:0/2082750470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b940bb1d0 msgr2=0x7f8b941db200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:38.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.909+0000 7f8b99119640 1 --2- 172.21.15.45:0/2082750470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b940bb1d0 0x7f8b941db200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:38.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.909+0000 7f8b99119640 1 -- 172.21.15.45:0/2082750470 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b90009ad0 con 0x7f8b940c2790 2023-10-03T19:12:38.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.909+0000 7f8b99119640 1 --2- 172.21.15.45:0/2082750470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b940c2790 0x7f8b9414aa00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8b8400c820 tx=0x7f8b8400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.909+0000 7f8b8a7fc640 1 -- 172.21.15.45:0/2082750470 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b84004220 con 0x7f8b940c2790 2023-10-03T19:12:38.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.909+0000 7f8b8a7fc640 1 -- 172.21.15.45:0/2082750470 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b840043a0 con 0x7f8b940c2790 2023-10-03T19:12:38.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.909+0000 7f8b8a7fc640 1 -- 172.21.15.45:0/2082750470 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b84004510 con 0x7f8b940c2790 2023-10-03T19:12:38.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.909+0000 7f8b9bb7e640 1 -- 172.21.15.45:0/2082750470 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b9414e740 con 0x7f8b940c2790 2023-10-03T19:12:38.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.909+0000 7f8b9bb7e640 1 -- 172.21.15.45:0/2082750470 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b940c19b0 con 0x7f8b940c2790 2023-10-03T19:12:38.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.909+0000 7f8b9bb7e640 1 -- 172.21.15.45:0/2082750470 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b940a3f40 con 0x7f8b940c2790 2023-10-03T19:12:38.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.913+0000 7f8b8a7fc640 1 -- 172.21.15.45:0/2082750470 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8b84007a70 con 0x7f8b940c2790 2023-10-03T19:12:38.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.913+0000 7f8b8a7fc640 1 --2- 172.21.15.45:0/2082750470 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8b780662b0 0x7f8b78068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:38.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.913+0000 7f8b8a7fc640 1 -- 172.21.15.45:0/2082750470 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8b84083a80 con 0x7f8b940c2790 2023-10-03T19:12:38.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.913+0000 7f8b9991a640 1 --2- 172.21.15.45:0/2082750470 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8b780662b0 0x7f8b78068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:38.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.913+0000 7f8b9991a640 1 --2- 172.21.15.45:0/2082750470 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8b780662b0 0x7f8b78068760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8b900b1000 tx=0x7f8b900aa000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:38.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:38.917+0000 7f8b8a7fc640 1 -- 172.21.15.45:0/2082750470 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8b84050f00 con 0x7f8b940c2790 2023-10-03T19:12:39.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.061+0000 7f8b9bb7e640 1 -- 172.21.15.45:0/2082750470 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b940bfa90 con 0x7f8b780662b0 2023-10-03T19:12:39.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.081+0000 7f8b8a7fc640 1 -- 172.21.15.45:0/2082750470 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286612 (secure 0 0 0) 0x7f8b940bfa90 con 0x7f8b780662b0 2023-10-03T19:12:39.089 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:39.091 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:12:39.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.085+0000 7f8b9bb7e640 1 -- 172.21.15.45:0/2082750470 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8b780662b0 msgr2=0x7f8b78068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:39.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.085+0000 7f8b9bb7e640 1 --2- 172.21.15.45:0/2082750470 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8b780662b0 0x7f8b78068760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8b900b1000 tx=0x7f8b900aa000 comp rx=0 tx=0).stop 2023-10-03T19:12:39.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.085+0000 7f8b9bb7e640 1 -- 172.21.15.45:0/2082750470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b940c2790 msgr2=0x7f8b9414aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:39.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.085+0000 7f8b9bb7e640 1 --2- 172.21.15.45:0/2082750470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b940c2790 0x7f8b9414aa00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8b8400c820 tx=0x7f8b8400cce0 comp rx=0 tx=0).stop 2023-10-03T19:12:39.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.085+0000 7f8b9bb7e640 1 -- 172.21.15.45:0/2082750470 shutdown_connections 2023-10-03T19:12:39.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.085+0000 7f8b9bb7e640 1 --2- 172.21.15.45:0/2082750470 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8b780662b0 0x7f8b78068760 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:39.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.085+0000 7f8b9bb7e640 1 --2- 172.21.15.45:0/2082750470 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b9414f240 0x7f8b9414af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:39.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.085+0000 7f8b9bb7e640 1 --2- 172.21.15.45:0/2082750470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b940c2790 0x7f8b9414aa00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:39.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.085+0000 7f8b9bb7e640 1 --2- 172.21.15.45:0/2082750470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b940bb1d0 0x7f8b941db200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:39.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.085+0000 7f8b9bb7e640 1 -- 172.21.15.45:0/2082750470 >> 172.21.15.45:0/2082750470 conn(0x7f8b940a64a0 msgr2=0x7f8b940c12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:39.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.085+0000 7f8b9bb7e640 1 -- 172.21.15.45:0/2082750470 shutdown_connections 2023-10-03T19:12:39.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.085+0000 7f8b9bb7e640 1 -- 172.21.15.45:0/2082750470 wait complete. 2023-10-03T19:12:39.107 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-10-03T19:12:38.442790+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":76404,"kb_used_data":1908,"kb_used_omap":0,"kb_used_meta":74432,"kb_avail":754898316,"statfs":{"total":773094113280,"available":773015875584,"internally_reserved":0,"allocated":1953792,"data_stored":1834528,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":76218368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003622"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.947798+0000","last_change":"2023-10-03T19:12:27.968561+0000","last_active":"2023-10-03T19:12:28.947798+0000","last_peered":"2023-10-03T19:12:28.947798+0000","last_clean":"2023-10-03T19:12:28.947798+0000","last_became_active":"2023-10-03T19:12:27.968018+0000","last_became_peered":"2023-10-03T19:12:27.968018+0000","last_unstale":"2023-10-03T19:12:28.947798+0000","last_undegraded":"2023-10-03T19:12:28.947798+0000","last_fullsized":"2023-10-03T19:12:28.947798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:02:17.085349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954200+0000","last_change":"2023-10-03T19:12:27.970081+0000","last_active":"2023-10-03T19:12:28.954200+0000","last_peered":"2023-10-03T19:12:28.954200+0000","last_clean":"2023-10-03T19:12:28.954200+0000","last_became_active":"2023-10-03T19:12:27.969751+0000","last_became_peered":"2023-10-03T19:12:27.969751+0000","last_unstale":"2023-10-03T19:12:28.954200+0000","last_undegraded":"2023-10-03T19:12:28.954200+0000","last_fullsized":"2023-10-03T19:12:28.954200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:51:23.880877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953910+0000","last_change":"2023-10-03T19:12:27.962924+0000","last_active":"2023-10-03T19:12:28.953910+0000","last_peered":"2023-10-03T19:12:28.953910+0000","last_clean":"2023-10-03T19:12:28.953910+0000","last_became_active":"2023-10-03T19:12:27.962634+0000","last_became_peered":"2023-10-03T19:12:27.962634+0000","last_unstale":"2023-10-03T19:12:28.953910+0000","last_undegraded":"2023-10-03T19:12:28.953910+0000","last_fullsized":"2023-10-03T19:12:28.953910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:39:07.804995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937912+0000","last_change":"2023-10-03T19:12:27.972848+0000","last_active":"2023-10-03T19:12:31.937912+0000","last_peered":"2023-10-03T19:12:31.937912+0000","last_clean":"2023-10-03T19:12:31.937912+0000","last_became_active":"2023-10-03T19:12:27.972451+0000","last_became_peered":"2023-10-03T19:12:27.972451+0000","last_unstale":"2023-10-03T19:12:31.937912+0000","last_undegraded":"2023-10-03T19:12:31.937912+0000","last_fullsized":"2023-10-03T19:12:31.937912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:51:42.777690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936707+0000","last_change":"2023-10-03T19:12:27.966859+0000","last_active":"2023-10-03T19:12:31.936707+0000","last_peered":"2023-10-03T19:12:31.936707+0000","last_clean":"2023-10-03T19:12:31.936707+0000","last_became_active":"2023-10-03T19:12:27.966145+0000","last_became_peered":"2023-10-03T19:12:27.966145+0000","last_unstale":"2023-10-03T19:12:31.936707+0000","last_undegraded":"2023-10-03T19:12:31.936707+0000","last_fullsized":"2023-10-03T19:12:31.936707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:50:51.938925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953307+0000","last_change":"2023-10-03T19:12:27.967226+0000","last_active":"2023-10-03T19:12:28.953307+0000","last_peered":"2023-10-03T19:12:28.953307+0000","last_clean":"2023-10-03T19:12:28.953307+0000","last_became_active":"2023-10-03T19:12:27.966929+0000","last_became_peered":"2023-10-03T19:12:27.966929+0000","last_unstale":"2023-10-03T19:12:28.953307+0000","last_undegraded":"2023-10-03T19:12:28.953307+0000","last_fullsized":"2023-10-03T19:12:28.953307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:42:03.204018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937391+0000","last_change":"2023-10-03T19:12:27.988476+0000","last_active":"2023-10-03T19:12:31.937391+0000","last_peered":"2023-10-03T19:12:31.937391+0000","last_clean":"2023-10-03T19:12:31.937391+0000","last_became_active":"2023-10-03T19:12:27.988133+0000","last_became_peered":"2023-10-03T19:12:27.988133+0000","last_unstale":"2023-10-03T19:12:31.937391+0000","last_undegraded":"2023-10-03T19:12:31.937391+0000","last_fullsized":"2023-10-03T19:12:31.937391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:13:00.937958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.951743+0000","last_change":"2023-10-03T19:12:27.959887+0000","last_active":"2023-10-03T19:12:28.951743+0000","last_peered":"2023-10-03T19:12:28.951743+0000","last_clean":"2023-10-03T19:12:28.951743+0000","last_became_active":"2023-10-03T19:12:27.959538+0000","last_became_peered":"2023-10-03T19:12:27.959538+0000","last_unstale":"2023-10-03T19:12:28.951743+0000","last_undegraded":"2023-10-03T19:12:28.951743+0000","last_fullsized":"2023-10-03T19:12:28.951743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:57:42.821868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936053+0000","last_change":"2023-10-03T19:12:27.970249+0000","last_active":"2023-10-03T19:12:31.936053+0000","last_peered":"2023-10-03T19:12:31.936053+0000","last_clean":"2023-10-03T19:12:31.936053+0000","last_became_active":"2023-10-03T19:12:27.969995+0000","last_became_peered":"2023-10-03T19:12:27.969995+0000","last_unstale":"2023-10-03T19:12:31.936053+0000","last_undegraded":"2023-10-03T19:12:31.936053+0000","last_fullsized":"2023-10-03T19:12:31.936053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:22:33.134502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952651+0000","last_change":"2023-10-03T19:12:27.964836+0000","last_active":"2023-10-03T19:12:28.952651+0000","last_peered":"2023-10-03T19:12:28.952651+0000","last_clean":"2023-10-03T19:12:28.952651+0000","last_became_active":"2023-10-03T19:12:27.964025+0000","last_became_peered":"2023-10-03T19:12:27.964025+0000","last_unstale":"2023-10-03T19:12:28.952651+0000","last_undegraded":"2023-10-03T19:12:28.952651+0000","last_fullsized":"2023-10-03T19:12:28.952651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:22:33.134502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954083+0000","last_change":"2023-10-03T19:12:27.986149+0000","last_active":"2023-10-03T19:12:28.954083+0000","last_peered":"2023-10-03T19:12:28.954083+0000","last_clean":"2023-10-03T19:12:28.954083+0000","last_became_active":"2023-10-03T19:12:27.983721+0000","last_became_peered":"2023-10-03T19:12:27.983721+0000","last_unstale":"2023-10-03T19:12:28.954083+0000","last_undegraded":"2023-10-03T19:12:28.954083+0000","last_fullsized":"2023-10-03T19:12:28.954083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:36:36.702280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.947612+0000","last_change":"2023-10-03T19:12:27.971272+0000","last_active":"2023-10-03T19:12:28.947612+0000","last_peered":"2023-10-03T19:12:28.947612+0000","last_clean":"2023-10-03T19:12:28.947612+0000","last_became_active":"2023-10-03T19:12:27.970796+0000","last_became_peered":"2023-10-03T19:12:27.970796+0000","last_unstale":"2023-10-03T19:12:28.947612+0000","last_undegraded":"2023-10-03T19:12:28.947612+0000","last_fullsized":"2023-10-03T19:12:28.947612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:32:28.423427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.947574+0000","last_change":"2023-10-03T19:12:27.968608+0000","last_active":"2023-10-03T19:12:28.947574+0000","last_peered":"2023-10-03T19:12:28.947574+0000","last_clean":"2023-10-03T19:12:28.947574+0000","last_became_active":"2023-10-03T19:12:27.968090+0000","last_became_peered":"2023-10-03T19:12:27.968090+0000","last_unstale":"2023-10-03T19:12:28.947574+0000","last_undegraded":"2023-10-03T19:12:28.947574+0000","last_fullsized":"2023-10-03T19:12:28.947574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:26:14.808258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952943+0000","last_change":"2023-10-03T19:12:27.970387+0000","last_active":"2023-10-03T19:12:28.952943+0000","last_peered":"2023-10-03T19:12:28.952943+0000","last_clean":"2023-10-03T19:12:28.952943+0000","last_became_active":"2023-10-03T19:12:27.969970+0000","last_became_peered":"2023-10-03T19:12:27.969970+0000","last_unstale":"2023-10-03T19:12:28.952943+0000","last_undegraded":"2023-10-03T19:12:28.952943+0000","last_fullsized":"2023-10-03T19:12:28.952943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:57:10.455144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937132+0000","last_change":"2023-10-03T19:12:27.988472+0000","last_active":"2023-10-03T19:12:31.937132+0000","last_peered":"2023-10-03T19:12:31.937132+0000","last_clean":"2023-10-03T19:12:31.937132+0000","last_became_active":"2023-10-03T19:12:27.988143+0000","last_became_peered":"2023-10-03T19:12:27.988143+0000","last_unstale":"2023-10-03T19:12:31.937132+0000","last_undegraded":"2023-10-03T19:12:31.937132+0000","last_fullsized":"2023-10-03T19:12:31.937132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:04:50.005254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952659+0000","last_change":"2023-10-03T19:12:27.960422+0000","last_active":"2023-10-03T19:12:28.952659+0000","last_peered":"2023-10-03T19:12:28.952659+0000","last_clean":"2023-10-03T19:12:28.952659+0000","last_became_active":"2023-10-03T19:12:27.958884+0000","last_became_peered":"2023-10-03T19:12:27.958884+0000","last_unstale":"2023-10-03T19:12:28.952659+0000","last_undegraded":"2023-10-03T19:12:28.952659+0000","last_fullsized":"2023-10-03T19:12:28.952659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:08:38.248650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936380+0000","last_change":"2023-10-03T19:12:27.968081+0000","last_active":"2023-10-03T19:12:31.936380+0000","last_peered":"2023-10-03T19:12:31.936380+0000","last_clean":"2023-10-03T19:12:31.936380+0000","last_became_active":"2023-10-03T19:12:27.967067+0000","last_became_peered":"2023-10-03T19:12:27.967067+0000","last_unstale":"2023-10-03T19:12:31.936380+0000","last_undegraded":"2023-10-03T19:12:31.936380+0000","last_fullsized":"2023-10-03T19:12:31.936380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:57:10.455144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954083+0000","last_change":"2023-10-03T19:12:27.971067+0000","last_active":"2023-10-03T19:12:28.954083+0000","last_peered":"2023-10-03T19:12:28.954083+0000","last_clean":"2023-10-03T19:12:28.954083+0000","last_became_active":"2023-10-03T19:12:27.970697+0000","last_became_peered":"2023-10-03T19:12:27.970697+0000","last_unstale":"2023-10-03T19:12:28.954083+0000","last_undegraded":"2023-10-03T19:12:28.954083+0000","last_fullsized":"2023-10-03T19:12:28.954083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:48:06.317138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.947677+0000","last_change":"2023-10-03T19:12:27.982404+0000","last_active":"2023-10-03T19:12:28.947677+0000","last_peered":"2023-10-03T19:12:28.947677+0000","last_clean":"2023-10-03T19:12:28.947677+0000","last_became_active":"2023-10-03T19:12:27.982070+0000","last_became_peered":"2023-10-03T19:12:27.982070+0000","last_unstale":"2023-10-03T19:12:28.947677+0000","last_undegraded":"2023-10-03T19:12:28.947677+0000","last_fullsized":"2023-10-03T19:12:28.947677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:05:40.727058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953598+0000","last_change":"2023-10-03T19:12:27.978237+0000","last_active":"2023-10-03T19:12:28.953598+0000","last_peered":"2023-10-03T19:12:28.953598+0000","last_clean":"2023-10-03T19:12:28.953598+0000","last_became_active":"2023-10-03T19:12:27.977841+0000","last_became_peered":"2023-10-03T19:12:27.977841+0000","last_unstale":"2023-10-03T19:12:28.953598+0000","last_undegraded":"2023-10-03T19:12:28.953598+0000","last_fullsized":"2023-10-03T19:12:28.953598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:06:02.160141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937324+0000","last_change":"2023-10-03T19:12:27.978515+0000","last_active":"2023-10-03T19:12:31.937324+0000","last_peered":"2023-10-03T19:12:31.937324+0000","last_clean":"2023-10-03T19:12:31.937324+0000","last_became_active":"2023-10-03T19:12:27.977947+0000","last_became_peered":"2023-10-03T19:12:27.977947+0000","last_unstale":"2023-10-03T19:12:31.937324+0000","last_undegraded":"2023-10-03T19:12:31.937324+0000","last_fullsized":"2023-10-03T19:12:31.937324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:36:36.702280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.935287+0000","last_change":"2023-10-03T19:12:27.966759+0000","last_active":"2023-10-03T19:12:31.935287+0000","last_peered":"2023-10-03T19:12:31.935287+0000","last_clean":"2023-10-03T19:12:31.935287+0000","last_became_active":"2023-10-03T19:12:27.966395+0000","last_became_peered":"2023-10-03T19:12:27.966395+0000","last_unstale":"2023-10-03T19:12:31.935287+0000","last_undegraded":"2023-10-03T19:12:31.935287+0000","last_fullsized":"2023-10-03T19:12:31.935287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:01:29.251478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.445878+0000","last_change":"2023-10-03T19:12:27.965460+0000","last_active":"2023-10-03T19:12:31.445878+0000","last_peered":"2023-10-03T19:12:31.445878+0000","last_clean":"2023-10-03T19:12:31.445878+0000","last_became_active":"2023-10-03T19:12:27.965215+0000","last_became_peered":"2023-10-03T19:12:27.965215+0000","last_unstale":"2023-10-03T19:12:31.445878+0000","last_undegraded":"2023-10-03T19:12:31.445878+0000","last_fullsized":"2023-10-03T19:12:31.445878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:14:25.554969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937118+0000","last_change":"2023-10-03T19:12:27.978012+0000","last_active":"2023-10-03T19:12:31.937118+0000","last_peered":"2023-10-03T19:12:31.937118+0000","last_clean":"2023-10-03T19:12:31.937118+0000","last_became_active":"2023-10-03T19:12:27.977497+0000","last_became_peered":"2023-10-03T19:12:27.977497+0000","last_unstale":"2023-10-03T19:12:31.937118+0000","last_undegraded":"2023-10-03T19:12:31.937118+0000","last_fullsized":"2023-10-03T19:12:31.937118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:39:07.804995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938079+0000","last_change":"2023-10-03T19:12:27.982593+0000","last_active":"2023-10-03T19:12:31.938079+0000","last_peered":"2023-10-03T19:12:31.938079+0000","last_clean":"2023-10-03T19:12:31.938079+0000","last_became_active":"2023-10-03T19:12:27.982076+0000","last_became_peered":"2023-10-03T19:12:27.982076+0000","last_unstale":"2023-10-03T19:12:31.938079+0000","last_undegraded":"2023-10-03T19:12:31.938079+0000","last_fullsized":"2023-10-03T19:12:31.938079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:13:00.937958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937722+0000","last_change":"2023-10-03T19:12:27.969145+0000","last_active":"2023-10-03T19:12:31.937722+0000","last_peered":"2023-10-03T19:12:31.937722+0000","last_clean":"2023-10-03T19:12:31.937722+0000","last_became_active":"2023-10-03T19:12:27.968857+0000","last_became_peered":"2023-10-03T19:12:27.968857+0000","last_unstale":"2023-10-03T19:12:31.937722+0000","last_undegraded":"2023-10-03T19:12:31.937722+0000","last_fullsized":"2023-10-03T19:12:31.937722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:48:06.317138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952353+0000","last_change":"2023-10-03T19:12:27.978614+0000","last_active":"2023-10-03T19:12:28.952353+0000","last_peered":"2023-10-03T19:12:28.952353+0000","last_clean":"2023-10-03T19:12:28.952353+0000","last_became_active":"2023-10-03T19:12:27.978222+0000","last_became_peered":"2023-10-03T19:12:27.978222+0000","last_unstale":"2023-10-03T19:12:28.952353+0000","last_undegraded":"2023-10-03T19:12:28.952353+0000","last_fullsized":"2023-10-03T19:12:28.952353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:47:33.343155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936959+0000","last_change":"2023-10-03T19:12:27.977987+0000","last_active":"2023-10-03T19:12:31.936959+0000","last_peered":"2023-10-03T19:12:31.936959+0000","last_clean":"2023-10-03T19:12:31.936959+0000","last_became_active":"2023-10-03T19:12:27.977696+0000","last_became_peered":"2023-10-03T19:12:27.977696+0000","last_unstale":"2023-10-03T19:12:31.936959+0000","last_undegraded":"2023-10-03T19:12:31.936959+0000","last_fullsized":"2023-10-03T19:12:31.936959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:14:25.554969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.446109+0000","last_change":"2023-10-03T19:12:27.984102+0000","last_active":"2023-10-03T19:12:31.446109+0000","last_peered":"2023-10-03T19:12:31.446109+0000","last_clean":"2023-10-03T19:12:31.446109+0000","last_became_active":"2023-10-03T19:12:27.983835+0000","last_became_peered":"2023-10-03T19:12:27.983835+0000","last_unstale":"2023-10-03T19:12:31.446109+0000","last_undegraded":"2023-10-03T19:12:31.446109+0000","last_fullsized":"2023-10-03T19:12:31.446109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:40:40.179631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953719+0000","last_change":"2023-10-03T19:12:27.982956+0000","last_active":"2023-10-03T19:12:28.953719+0000","last_peered":"2023-10-03T19:12:28.953719+0000","last_clean":"2023-10-03T19:12:28.953719+0000","last_became_active":"2023-10-03T19:12:27.982622+0000","last_became_peered":"2023-10-03T19:12:27.982622+0000","last_unstale":"2023-10-03T19:12:28.953719+0000","last_undegraded":"2023-10-03T19:12:28.953719+0000","last_fullsized":"2023-10-03T19:12:28.953719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:58:41.915397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.445663+0000","last_change":"2023-10-03T19:12:27.969233+0000","last_active":"2023-10-03T19:12:31.445663+0000","last_peered":"2023-10-03T19:12:31.445663+0000","last_clean":"2023-10-03T19:12:31.445663+0000","last_became_active":"2023-10-03T19:12:27.968939+0000","last_became_peered":"2023-10-03T19:12:27.968939+0000","last_unstale":"2023-10-03T19:12:31.445663+0000","last_undegraded":"2023-10-03T19:12:31.445663+0000","last_fullsized":"2023-10-03T19:12:31.445663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:56:53.031240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937466+0000","last_change":"2023-10-03T19:12:27.982253+0000","last_active":"2023-10-03T19:12:31.937466+0000","last_peered":"2023-10-03T19:12:31.937466+0000","last_clean":"2023-10-03T19:12:31.937466+0000","last_became_active":"2023-10-03T19:12:27.974654+0000","last_became_peered":"2023-10-03T19:12:27.974654+0000","last_unstale":"2023-10-03T19:12:31.937466+0000","last_undegraded":"2023-10-03T19:12:31.937466+0000","last_fullsized":"2023-10-03T19:12:31.937466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:15:19.668421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.446441+0000","last_change":"2023-10-03T19:12:27.969223+0000","last_active":"2023-10-03T19:12:31.446441+0000","last_peered":"2023-10-03T19:12:31.446441+0000","last_clean":"2023-10-03T19:12:31.446441+0000","last_became_active":"2023-10-03T19:12:27.968920+0000","last_became_peered":"2023-10-03T19:12:27.968920+0000","last_unstale":"2023-10-03T19:12:31.446441+0000","last_undegraded":"2023-10-03T19:12:31.446441+0000","last_fullsized":"2023-10-03T19:12:31.446441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:36:36.702280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938352+0000","last_change":"2023-10-03T19:12:27.594756+0000","last_active":"2023-10-03T19:12:31.938352+0000","last_peered":"2023-10-03T19:12:31.938352+0000","last_clean":"2023-10-03T19:12:31.938352+0000","last_became_active":"2023-10-03T19:12:27.594156+0000","last_became_peered":"2023-10-03T19:12:27.594156+0000","last_unstale":"2023-10-03T19:12:31.938352+0000","last_undegraded":"2023-10-03T19:12:31.938352+0000","last_fullsized":"2023-10-03T19:12:31.938352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:51:27.857657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953302+0000","last_change":"2023-10-03T19:12:27.984997+0000","last_active":"2023-10-03T19:12:28.953302+0000","last_peered":"2023-10-03T19:12:28.953302+0000","last_clean":"2023-10-03T19:12:28.953302+0000","last_became_active":"2023-10-03T19:12:27.984682+0000","last_became_peered":"2023-10-03T19:12:27.984682+0000","last_unstale":"2023-10-03T19:12:28.953302+0000","last_undegraded":"2023-10-03T19:12:28.953302+0000","last_fullsized":"2023-10-03T19:12:28.953302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:29:18.707428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.935473+0000","last_change":"2023-10-03T19:12:27.589809+0000","last_active":"2023-10-03T19:12:31.935473+0000","last_peered":"2023-10-03T19:12:31.935473+0000","last_clean":"2023-10-03T19:12:31.935473+0000","last_became_active":"2023-10-03T19:12:27.589415+0000","last_became_peered":"2023-10-03T19:12:27.589415+0000","last_unstale":"2023-10-03T19:12:31.935473+0000","last_undegraded":"2023-10-03T19:12:31.935473+0000","last_fullsized":"2023-10-03T19:12:31.935473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:21:26.096838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.935811+0000","last_change":"2023-10-03T19:12:27.966910+0000","last_active":"2023-10-03T19:12:31.935811+0000","last_peered":"2023-10-03T19:12:31.935811+0000","last_clean":"2023-10-03T19:12:31.935811+0000","last_became_active":"2023-10-03T19:12:27.966160+0000","last_became_peered":"2023-10-03T19:12:27.966160+0000","last_unstale":"2023-10-03T19:12:31.935811+0000","last_undegraded":"2023-10-03T19:12:31.935811+0000","last_fullsized":"2023-10-03T19:12:31.935811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:55:55.744147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937350+0000","last_change":"2023-10-03T19:12:27.597122+0000","last_active":"2023-10-03T19:12:31.937350+0000","last_peered":"2023-10-03T19:12:31.937350+0000","last_clean":"2023-10-03T19:12:31.937350+0000","last_became_active":"2023-10-03T19:12:27.596367+0000","last_became_peered":"2023-10-03T19:12:27.596367+0000","last_unstale":"2023-10-03T19:12:31.937350+0000","last_undegraded":"2023-10-03T19:12:31.937350+0000","last_fullsized":"2023-10-03T19:12:31.937350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:09:55.002369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.446581+0000","last_change":"2023-10-03T19:12:27.983942+0000","last_active":"2023-10-03T19:12:31.446581+0000","last_peered":"2023-10-03T19:12:31.446581+0000","last_clean":"2023-10-03T19:12:31.446581+0000","last_became_active":"2023-10-03T19:12:27.983600+0000","last_became_peered":"2023-10-03T19:12:27.983600+0000","last_unstale":"2023-10-03T19:12:31.446581+0000","last_undegraded":"2023-10-03T19:12:31.446581+0000","last_fullsized":"2023-10-03T19:12:31.446581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:13:00.937958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'8","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937478+0000","last_change":"2023-10-03T19:12:27.580060+0000","last_active":"2023-10-03T19:12:31.937478+0000","last_peered":"2023-10-03T19:12:31.937478+0000","last_clean":"2023-10-03T19:12:31.937478+0000","last_became_active":"2023-10-03T19:12:27.579250+0000","last_became_peered":"2023-10-03T19:12:27.579250+0000","last_unstale":"2023-10-03T19:12:31.937478+0000","last_undegraded":"2023-10-03T19:12:31.937478+0000","last_fullsized":"2023-10-03T19:12:31.937478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:04:31.510597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938787+0000","last_change":"2023-10-03T19:12:27.597979+0000","last_active":"2023-10-03T19:12:31.938787+0000","last_peered":"2023-10-03T19:12:31.938787+0000","last_clean":"2023-10-03T19:12:31.938787+0000","last_became_active":"2023-10-03T19:12:27.595911+0000","last_became_peered":"2023-10-03T19:12:27.595911+0000","last_unstale":"2023-10-03T19:12:31.938787+0000","last_undegraded":"2023-10-03T19:12:31.938787+0000","last_fullsized":"2023-10-03T19:12:31.938787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:11:28.744038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.951943+0000","last_change":"2023-10-03T19:12:27.978558+0000","last_active":"2023-10-03T19:12:28.951943+0000","last_peered":"2023-10-03T19:12:28.951943+0000","last_clean":"2023-10-03T19:12:28.951943+0000","last_became_active":"2023-10-03T19:12:27.978193+0000","last_became_peered":"2023-10-03T19:12:27.978193+0000","last_unstale":"2023-10-03T19:12:28.951943+0000","last_undegraded":"2023-10-03T19:12:28.951943+0000","last_fullsized":"2023-10-03T19:12:28.951943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:21:27.107002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938789+0000","last_change":"2023-10-03T19:12:27.597785+0000","last_active":"2023-10-03T19:12:31.938789+0000","last_peered":"2023-10-03T19:12:31.938789+0000","last_clean":"2023-10-03T19:12:31.938789+0000","last_became_active":"2023-10-03T19:12:27.596252+0000","last_became_peered":"2023-10-03T19:12:27.596252+0000","last_unstale":"2023-10-03T19:12:31.938789+0000","last_undegraded":"2023-10-03T19:12:31.938789+0000","last_fullsized":"2023-10-03T19:12:31.938789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:55:56.909440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953146+0000","last_change":"2023-10-03T19:12:27.983791+0000","last_active":"2023-10-03T19:12:28.953146+0000","last_peered":"2023-10-03T19:12:28.953146+0000","last_clean":"2023-10-03T19:12:28.953146+0000","last_became_active":"2023-10-03T19:12:27.983498+0000","last_became_peered":"2023-10-03T19:12:27.983498+0000","last_unstale":"2023-10-03T19:12:28.953146+0000","last_undegraded":"2023-10-03T19:12:28.953146+0000","last_fullsized":"2023-10-03T19:12:28.953146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:56:53.031240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938558+0000","last_change":"2023-10-03T19:12:27.597281+0000","last_active":"2023-10-03T19:12:31.938558+0000","last_peered":"2023-10-03T19:12:31.938558+0000","last_clean":"2023-10-03T19:12:31.938558+0000","last_became_active":"2023-10-03T19:12:27.596699+0000","last_became_peered":"2023-10-03T19:12:27.596699+0000","last_unstale":"2023-10-03T19:12:31.938558+0000","last_undegraded":"2023-10-03T19:12:31.938558+0000","last_fullsized":"2023-10-03T19:12:31.938558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:02:43.719408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937888+0000","last_change":"2023-10-03T19:12:27.985128+0000","last_active":"2023-10-03T19:12:31.937888+0000","last_peered":"2023-10-03T19:12:31.937888+0000","last_clean":"2023-10-03T19:12:31.937888+0000","last_became_active":"2023-10-03T19:12:27.984570+0000","last_became_peered":"2023-10-03T19:12:27.984570+0000","last_unstale":"2023-10-03T19:12:31.937888+0000","last_undegraded":"2023-10-03T19:12:31.937888+0000","last_fullsized":"2023-10-03T19:12:31.937888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:23:37.424885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952130+0000","last_change":"2023-10-03T19:12:27.594338+0000","last_active":"2023-10-03T19:12:28.952130+0000","last_peered":"2023-10-03T19:12:28.952130+0000","last_clean":"2023-10-03T19:12:28.952130+0000","last_became_active":"2023-10-03T19:12:27.593882+0000","last_became_peered":"2023-10-03T19:12:27.593882+0000","last_unstale":"2023-10-03T19:12:28.952130+0000","last_undegraded":"2023-10-03T19:12:28.952130+0000","last_fullsized":"2023-10-03T19:12:28.952130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:55:54.733983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936024+0000","last_change":"2023-10-03T19:12:27.969749+0000","last_active":"2023-10-03T19:12:31.936024+0000","last_peered":"2023-10-03T19:12:31.936024+0000","last_clean":"2023-10-03T19:12:31.936024+0000","last_became_active":"2023-10-03T19:12:27.966817+0000","last_became_peered":"2023-10-03T19:12:27.966817+0000","last_unstale":"2023-10-03T19:12:31.936024+0000","last_undegraded":"2023-10-03T19:12:31.936024+0000","last_fullsized":"2023-10-03T19:12:31.936024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:01:58.722428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.446414+0000","last_change":"2023-10-03T19:12:27.586872+0000","last_active":"2023-10-03T19:12:31.446414+0000","last_peered":"2023-10-03T19:12:31.446414+0000","last_clean":"2023-10-03T19:12:31.446414+0000","last_became_active":"2023-10-03T19:12:27.586119+0000","last_became_peered":"2023-10-03T19:12:27.586119+0000","last_unstale":"2023-10-03T19:12:31.446414+0000","last_undegraded":"2023-10-03T19:12:31.446414+0000","last_fullsized":"2023-10-03T19:12:31.446414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:48:05.306974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953682+0000","last_change":"2023-10-03T19:12:27.964111+0000","last_active":"2023-10-03T19:12:28.953682+0000","last_peered":"2023-10-03T19:12:28.953682+0000","last_clean":"2023-10-03T19:12:28.953682+0000","last_became_active":"2023-10-03T19:12:27.963620+0000","last_became_peered":"2023-10-03T19:12:27.963620+0000","last_unstale":"2023-10-03T19:12:28.953682+0000","last_undegraded":"2023-10-03T19:12:28.953682+0000","last_fullsized":"2023-10-03T19:12:28.953682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:14:25.554969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938077+0000","last_change":"2023-10-03T19:12:27.587990+0000","last_active":"2023-10-03T19:12:31.938077+0000","last_peered":"2023-10-03T19:12:31.938077+0000","last_clean":"2023-10-03T19:12:31.938077+0000","last_became_active":"2023-10-03T19:12:27.587316+0000","last_became_peered":"2023-10-03T19:12:27.587316+0000","last_unstale":"2023-10-03T19:12:31.938077+0000","last_undegraded":"2023-10-03T19:12:31.938077+0000","last_fullsized":"2023-10-03T19:12:31.938077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:08:37.238486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954191+0000","last_change":"2023-10-03T19:12:27.970739+0000","last_active":"2023-10-03T19:12:28.954191+0000","last_peered":"2023-10-03T19:12:28.954191+0000","last_clean":"2023-10-03T19:12:28.954191+0000","last_became_active":"2023-10-03T19:12:27.970408+0000","last_became_peered":"2023-10-03T19:12:27.970408+0000","last_unstale":"2023-10-03T19:12:28.954191+0000","last_undegraded":"2023-10-03T19:12:28.954191+0000","last_fullsized":"2023-10-03T19:12:28.954191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:13:00.937958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953950+0000","last_change":"2023-10-03T19:12:27.580938+0000","last_active":"2023-10-03T19:12:28.953950+0000","last_peered":"2023-10-03T19:12:28.953950+0000","last_clean":"2023-10-03T19:12:28.953950+0000","last_became_active":"2023-10-03T19:12:27.580538+0000","last_became_peered":"2023-10-03T19:12:27.580538+0000","last_unstale":"2023-10-03T19:12:28.953950+0000","last_undegraded":"2023-10-03T19:12:28.953950+0000","last_fullsized":"2023-10-03T19:12:28.953950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:04:48.995090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954372+0000","last_change":"2023-10-03T19:12:27.969234+0000","last_active":"2023-10-03T19:12:28.954372+0000","last_peered":"2023-10-03T19:12:28.954372+0000","last_clean":"2023-10-03T19:12:28.954372+0000","last_became_active":"2023-10-03T19:12:27.968880+0000","last_became_peered":"2023-10-03T19:12:27.968880+0000","last_unstale":"2023-10-03T19:12:28.954372+0000","last_undegraded":"2023-10-03T19:12:28.954372+0000","last_fullsized":"2023-10-03T19:12:28.954372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:09:56.012532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.445909+0000","last_change":"2023-10-03T19:12:27.592296+0000","last_active":"2023-10-03T19:12:31.445909+0000","last_peered":"2023-10-03T19:12:31.445909+0000","last_clean":"2023-10-03T19:12:31.445909+0000","last_became_active":"2023-10-03T19:12:27.588952+0000","last_became_peered":"2023-10-03T19:12:27.588952+0000","last_unstale":"2023-10-03T19:12:31.445909+0000","last_undegraded":"2023-10-03T19:12:31.445909+0000","last_fullsized":"2023-10-03T19:12:31.445909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:58:40.905233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937406+0000","last_change":"2023-10-03T19:12:27.967839+0000","last_active":"2023-10-03T19:12:31.937406+0000","last_peered":"2023-10-03T19:12:31.937406+0000","last_clean":"2023-10-03T19:12:31.937406+0000","last_became_active":"2023-10-03T19:12:27.967281+0000","last_became_peered":"2023-10-03T19:12:27.967281+0000","last_unstale":"2023-10-03T19:12:31.937406+0000","last_undegraded":"2023-10-03T19:12:31.937406+0000","last_fullsized":"2023-10-03T19:12:31.937406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:33:54.388967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":171,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937204+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:12:31.937204+0000","last_peered":"2023-10-03T19:12:31.937204+0000","last_clean":"2023-10-03T19:12:31.937204+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:12:31.937204+0000","last_undegraded":"2023-10-03T19:12:31.937204+0000","last_fullsized":"2023-10-03T19:12:31.937204+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:48:00.062144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.951827+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:12:28.951827+0000","last_peered":"2023-10-03T19:12:28.951827+0000","last_clean":"2023-10-03T19:12:28.951827+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:12:28.951827+0000","last_undegraded":"2023-10-03T19:12:28.951827+0000","last_fullsized":"2023-10-03T19:12:28.951827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:16:13.727679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.445820+0000","last_change":"2023-10-03T19:12:27.592604+0000","last_active":"2023-10-03T19:12:31.445820+0000","last_peered":"2023-10-03T19:12:31.445820+0000","last_clean":"2023-10-03T19:12:31.445820+0000","last_became_active":"2023-10-03T19:12:27.592242+0000","last_became_peered":"2023-10-03T19:12:27.592242+0000","last_unstale":"2023-10-03T19:12:31.445820+0000","last_undegraded":"2023-10-03T19:12:31.445820+0000","last_fullsized":"2023-10-03T19:12:31.445820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:06:01.149977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937821+0000","last_change":"2023-10-03T19:12:27.981742+0000","last_active":"2023-10-03T19:12:31.937821+0000","last_peered":"2023-10-03T19:12:31.937821+0000","last_clean":"2023-10-03T19:12:31.937821+0000","last_became_active":"2023-10-03T19:12:27.981480+0000","last_became_peered":"2023-10-03T19:12:27.981480+0000","last_unstale":"2023-10-03T19:12:31.937821+0000","last_undegraded":"2023-10-03T19:12:31.937821+0000","last_fullsized":"2023-10-03T19:12:31.937821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:32:27.213744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936854+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:12:31.936854+0000","last_peered":"2023-10-03T19:12:31.936854+0000","last_clean":"2023-10-03T19:12:31.936854+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:12:31.936854+0000","last_undegraded":"2023-10-03T19:12:31.936854+0000","last_fullsized":"2023-10-03T19:12:31.936854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:33:49.157041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.935405+0000","last_change":"2023-10-03T19:12:27.594044+0000","last_active":"2023-10-03T19:12:31.935405+0000","last_peered":"2023-10-03T19:12:31.935405+0000","last_clean":"2023-10-03T19:12:31.935405+0000","last_became_active":"2023-10-03T19:12:27.593678+0000","last_became_peered":"2023-10-03T19:12:27.593678+0000","last_unstale":"2023-10-03T19:12:31.935405+0000","last_undegraded":"2023-10-03T19:12:31.935405+0000","last_fullsized":"2023-10-03T19:12:31.935405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:57:41.811705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.935677+0000","last_change":"2023-10-03T19:12:27.969842+0000","last_active":"2023-10-03T19:12:31.935677+0000","last_peered":"2023-10-03T19:12:31.935677+0000","last_clean":"2023-10-03T19:12:31.935677+0000","last_became_active":"2023-10-03T19:12:27.966611+0000","last_became_peered":"2023-10-03T19:12:27.966611+0000","last_unstale":"2023-10-03T19:12:31.935677+0000","last_undegraded":"2023-10-03T19:12:31.935677+0000","last_fullsized":"2023-10-03T19:12:31.935677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:16:18.959604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.947762+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:12:28.947762+0000","last_peered":"2023-10-03T19:12:28.947762+0000","last_clean":"2023-10-03T19:12:28.947762+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:12:28.947762+0000","last_undegraded":"2023-10-03T19:12:28.947762+0000","last_fullsized":"2023-10-03T19:12:28.947762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:24:20.268582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936393+0000","last_change":"2023-10-03T19:12:27.579209+0000","last_active":"2023-10-03T19:12:31.936393+0000","last_peered":"2023-10-03T19:12:31.936393+0000","last_clean":"2023-10-03T19:12:31.936393+0000","last_became_active":"2023-10-03T19:12:27.578633+0000","last_became_peered":"2023-10-03T19:12:27.578633+0000","last_unstale":"2023-10-03T19:12:31.936393+0000","last_undegraded":"2023-10-03T19:12:31.936393+0000","last_fullsized":"2023-10-03T19:12:31.936393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:02:27.868659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937557+0000","last_change":"2023-10-03T19:12:27.966914+0000","last_active":"2023-10-03T19:12:31.937557+0000","last_peered":"2023-10-03T19:12:31.937557+0000","last_clean":"2023-10-03T19:12:31.937557+0000","last_became_active":"2023-10-03T19:12:27.966406+0000","last_became_peered":"2023-10-03T19:12:27.966406+0000","last_unstale":"2023-10-03T19:12:31.937557+0000","last_undegraded":"2023-10-03T19:12:31.937557+0000","last_fullsized":"2023-10-03T19:12:31.937557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:39:07.804995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953153+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:12:28.953153+0000","last_peered":"2023-10-03T19:12:28.953153+0000","last_clean":"2023-10-03T19:12:28.953153+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:12:28.953153+0000","last_undegraded":"2023-10-03T19:12:28.953153+0000","last_fullsized":"2023-10-03T19:12:28.953153+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:50:46.706999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954915+0000","last_change":"2023-10-03T19:12:27.586703+0000","last_active":"2023-10-03T19:12:28.954915+0000","last_peered":"2023-10-03T19:12:28.954915+0000","last_clean":"2023-10-03T19:12:28.954915+0000","last_became_active":"2023-10-03T19:12:27.586241+0000","last_became_peered":"2023-10-03T19:12:27.586241+0000","last_unstale":"2023-10-03T19:12:28.954915+0000","last_undegraded":"2023-10-03T19:12:28.954915+0000","last_fullsized":"2023-10-03T19:12:28.954915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:23:42.273581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936826+0000","last_change":"2023-10-03T19:12:27.972058+0000","last_active":"2023-10-03T19:12:31.936826+0000","last_peered":"2023-10-03T19:12:31.936826+0000","last_clean":"2023-10-03T19:12:31.936826+0000","last_became_active":"2023-10-03T19:12:27.971770+0000","last_became_peered":"2023-10-03T19:12:27.971770+0000","last_unstale":"2023-10-03T19:12:31.936826+0000","last_undegraded":"2023-10-03T19:12:31.936826+0000","last_fullsized":"2023-10-03T19:12:31.936826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:06:02.160141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952764+0000","last_change":"2023-10-03T19:12:27.595105+0000","last_active":"2023-10-03T19:12:28.952764+0000","last_peered":"2023-10-03T19:12:28.952764+0000","last_clean":"2023-10-03T19:12:28.952764+0000","last_became_active":"2023-10-03T19:12:27.594748+0000","last_became_peered":"2023-10-03T19:12:27.594748+0000","last_unstale":"2023-10-03T19:12:28.952764+0000","last_undegraded":"2023-10-03T19:12:28.952764+0000","last_fullsized":"2023-10-03T19:12:28.952764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:43:24.586460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937036+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:12:31.937036+0000","last_peered":"2023-10-03T19:12:31.937036+0000","last_clean":"2023-10-03T19:12:31.937036+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:12:31.937036+0000","last_undegraded":"2023-10-03T19:12:31.937036+0000","last_fullsized":"2023-10-03T19:12:31.937036+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:50:20.553324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937627+0000","last_change":"2023-10-03T19:12:27.966147+0000","last_active":"2023-10-03T19:12:31.937627+0000","last_peered":"2023-10-03T19:12:31.937627+0000","last_clean":"2023-10-03T19:12:31.937627+0000","last_became_active":"2023-10-03T19:12:27.965865+0000","last_became_peered":"2023-10-03T19:12:27.965865+0000","last_unstale":"2023-10-03T19:12:31.937627+0000","last_undegraded":"2023-10-03T19:12:31.937627+0000","last_fullsized":"2023-10-03T19:12:31.937627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:04:50.005254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936963+0000","last_change":"2023-10-03T19:12:27.581597+0000","last_active":"2023-10-03T19:12:31.936963+0000","last_peered":"2023-10-03T19:12:31.936963+0000","last_clean":"2023-10-03T19:12:31.936963+0000","last_became_active":"2023-10-03T19:12:27.581015+0000","last_became_peered":"2023-10-03T19:12:27.581015+0000","last_unstale":"2023-10-03T19:12:31.936963+0000","last_undegraded":"2023-10-03T19:12:31.936963+0000","last_fullsized":"2023-10-03T19:12:31.936963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:58:40.905233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938993+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:12:31.938993+0000","last_peered":"2023-10-03T19:12:31.938993+0000","last_clean":"2023-10-03T19:12:31.938993+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:12:31.938993+0000","last_undegraded":"2023-10-03T19:12:31.938993+0000","last_fullsized":"2023-10-03T19:12:31.938993+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:13:27.600123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936370+0000","last_change":"2023-10-03T19:12:27.964905+0000","last_active":"2023-10-03T19:12:31.936370+0000","last_peered":"2023-10-03T19:12:31.936370+0000","last_clean":"2023-10-03T19:12:31.936370+0000","last_became_active":"2023-10-03T19:12:27.964614+0000","last_became_peered":"2023-10-03T19:12:27.964614+0000","last_unstale":"2023-10-03T19:12:31.936370+0000","last_undegraded":"2023-10-03T19:12:31.936370+0000","last_fullsized":"2023-10-03T19:12:31.936370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:43:25.596624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.446668+0000","last_change":"2023-10-03T19:12:27.588155+0000","last_active":"2023-10-03T19:12:31.446668+0000","last_peered":"2023-10-03T19:12:31.446668+0000","last_clean":"2023-10-03T19:12:31.446668+0000","last_became_active":"2023-10-03T19:12:27.587340+0000","last_became_peered":"2023-10-03T19:12:27.587340+0000","last_unstale":"2023-10-03T19:12:31.446668+0000","last_undegraded":"2023-10-03T19:12:31.446668+0000","last_fullsized":"2023-10-03T19:12:31.446668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:09:55.002369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937821+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:12:31.937821+0000","last_peered":"2023-10-03T19:12:31.937821+0000","last_clean":"2023-10-03T19:12:31.937821+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:12:31.937821+0000","last_undegraded":"2023-10-03T19:12:31.937821+0000","last_fullsized":"2023-10-03T19:12:31.937821+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:36:31.470355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.445724+0000","last_change":"2023-10-03T19:12:27.977940+0000","last_active":"2023-10-03T19:12:31.445724+0000","last_peered":"2023-10-03T19:12:31.445724+0000","last_clean":"2023-10-03T19:12:31.445724+0000","last_became_active":"2023-10-03T19:12:27.977495+0000","last_became_peered":"2023-10-03T19:12:27.977495+0000","last_unstale":"2023-10-03T19:12:31.445724+0000","last_undegraded":"2023-10-03T19:12:31.445724+0000","last_fullsized":"2023-10-03T19:12:31.445724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:42:03.204018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"22'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.935971+0000","last_change":"2023-10-03T19:12:27.583954+0000","last_active":"2023-10-03T19:12:31.935971+0000","last_peered":"2023-10-03T19:12:31.935971+0000","last_clean":"2023-10-03T19:12:31.935971+0000","last_became_active":"2023-10-03T19:12:27.583313+0000","last_became_peered":"2023-10-03T19:12:27.583313+0000","last_unstale":"2023-10-03T19:12:31.935971+0000","last_undegraded":"2023-10-03T19:12:31.935971+0000","last_fullsized":"2023-10-03T19:12:31.935971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:47:32.332991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938105+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:12:31.938105+0000","last_peered":"2023-10-03T19:12:31.938105+0000","last_clean":"2023-10-03T19:12:31.938105+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:12:31.938105+0000","last_undegraded":"2023-10-03T19:12:31.938105+0000","last_fullsized":"2023-10-03T19:12:31.938105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:56:47.799314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953723+0000","last_change":"2023-10-03T19:12:27.961343+0000","last_active":"2023-10-03T19:12:28.953723+0000","last_peered":"2023-10-03T19:12:28.953723+0000","last_clean":"2023-10-03T19:12:28.953723+0000","last_became_active":"2023-10-03T19:12:27.961065+0000","last_became_peered":"2023-10-03T19:12:27.961065+0000","last_unstale":"2023-10-03T19:12:28.953723+0000","last_undegraded":"2023-10-03T19:12:28.953723+0000","last_fullsized":"2023-10-03T19:12:28.953723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:50:25.785249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954854+0000","last_change":"2023-10-03T19:12:27.975142+0000","last_active":"2023-10-03T19:12:28.954854+0000","last_peered":"2023-10-03T19:12:28.954854+0000","last_clean":"2023-10-03T19:12:28.954854+0000","last_became_active":"2023-10-03T19:12:27.974173+0000","last_became_peered":"2023-10-03T19:12:27.974173+0000","last_unstale":"2023-10-03T19:12:28.954854+0000","last_undegraded":"2023-10-03T19:12:28.954854+0000","last_fullsized":"2023-10-03T19:12:28.954854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:02:44.729572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'6","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953832+0000","last_change":"2023-10-03T19:12:27.586506+0000","last_active":"2023-10-03T19:12:28.953832+0000","last_peered":"2023-10-03T19:12:28.953832+0000","last_clean":"2023-10-03T19:12:28.953832+0000","last_became_active":"2023-10-03T19:12:27.585847+0000","last_became_peered":"2023-10-03T19:12:27.585847+0000","last_unstale":"2023-10-03T19:12:28.953832+0000","last_undegraded":"2023-10-03T19:12:28.953832+0000","last_fullsized":"2023-10-03T19:12:28.953832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:33:53.378803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937279+0000","last_change":"2023-10-03T19:12:27.973591+0000","last_active":"2023-10-03T19:12:31.937279+0000","last_peered":"2023-10-03T19:12:31.937279+0000","last_clean":"2023-10-03T19:12:31.937279+0000","last_became_active":"2023-10-03T19:12:27.973308+0000","last_became_peered":"2023-10-03T19:12:27.973308+0000","last_unstale":"2023-10-03T19:12:31.937279+0000","last_undegraded":"2023-10-03T19:12:31.937279+0000","last_fullsized":"2023-10-03T19:12:31.937279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:40:40.179631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938677+0000","last_change":"2023-10-03T19:12:27.595373+0000","last_active":"2023-10-03T19:12:31.938677+0000","last_peered":"2023-10-03T19:12:31.938677+0000","last_clean":"2023-10-03T19:12:31.938677+0000","last_became_active":"2023-10-03T19:12:27.594761+0000","last_became_peered":"2023-10-03T19:12:27.594761+0000","last_unstale":"2023-10-03T19:12:31.938677+0000","last_undegraded":"2023-10-03T19:12:31.938677+0000","last_fullsized":"2023-10-03T19:12:31.938677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:23:42.273581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952982+0000","last_change":"2023-10-03T19:12:27.585305+0000","last_active":"2023-10-03T19:12:28.952982+0000","last_peered":"2023-10-03T19:12:28.952982+0000","last_clean":"2023-10-03T19:12:28.952982+0000","last_became_active":"2023-10-03T19:12:27.584635+0000","last_became_peered":"2023-10-03T19:12:27.584635+0000","last_unstale":"2023-10-03T19:12:28.952982+0000","last_undegraded":"2023-10-03T19:12:28.952982+0000","last_fullsized":"2023-10-03T19:12:28.952982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:37:44.604456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.446061+0000","last_change":"2023-10-03T19:12:27.978707+0000","last_active":"2023-10-03T19:12:31.446061+0000","last_peered":"2023-10-03T19:12:31.446061+0000","last_clean":"2023-10-03T19:12:31.446061+0000","last_became_active":"2023-10-03T19:12:27.978433+0000","last_became_peered":"2023-10-03T19:12:27.978433+0000","last_unstale":"2023-10-03T19:12:31.446061+0000","last_undegraded":"2023-10-03T19:12:31.446061+0000","last_fullsized":"2023-10-03T19:12:31.446061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:50:25.785249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936984+0000","last_change":"2023-10-03T19:12:27.592047+0000","last_active":"2023-10-03T19:12:31.936984+0000","last_peered":"2023-10-03T19:12:31.936984+0000","last_clean":"2023-10-03T19:12:31.936984+0000","last_became_active":"2023-10-03T19:12:27.591625+0000","last_became_peered":"2023-10-03T19:12:27.591625+0000","last_unstale":"2023-10-03T19:12:31.936984+0000","last_undegraded":"2023-10-03T19:12:31.936984+0000","last_fullsized":"2023-10-03T19:12:31.936984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:29:17.697265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.445602+0000","last_change":"2023-10-03T19:12:27.982932+0000","last_active":"2023-10-03T19:12:31.445602+0000","last_peered":"2023-10-03T19:12:31.445602+0000","last_clean":"2023-10-03T19:12:31.445602+0000","last_became_active":"2023-10-03T19:12:27.982612+0000","last_became_peered":"2023-10-03T19:12:27.982612+0000","last_unstale":"2023-10-03T19:12:31.445602+0000","last_undegraded":"2023-10-03T19:12:31.445602+0000","last_fullsized":"2023-10-03T19:12:31.445602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:08:38.248650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937987+0000","last_change":"2023-10-03T19:12:27.974833+0000","last_active":"2023-10-03T19:12:31.937987+0000","last_peered":"2023-10-03T19:12:31.937987+0000","last_clean":"2023-10-03T19:12:31.937987+0000","last_became_active":"2023-10-03T19:12:27.973932+0000","last_became_peered":"2023-10-03T19:12:27.973932+0000","last_unstale":"2023-10-03T19:12:31.937987+0000","last_undegraded":"2023-10-03T19:12:31.937987+0000","last_fullsized":"2023-10-03T19:12:31.937987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:20:24.642279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.445787+0000","last_change":"2023-10-03T19:12:27.592021+0000","last_active":"2023-10-03T19:12:31.445787+0000","last_peered":"2023-10-03T19:12:31.445787+0000","last_clean":"2023-10-03T19:12:31.445787+0000","last_became_active":"2023-10-03T19:12:27.589194+0000","last_became_peered":"2023-10-03T19:12:27.589194+0000","last_unstale":"2023-10-03T19:12:31.445787+0000","last_undegraded":"2023-10-03T19:12:31.445787+0000","last_fullsized":"2023-10-03T19:12:31.445787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:02:27.868659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.935544+0000","last_change":"2023-10-03T19:12:27.978101+0000","last_active":"2023-10-03T19:12:31.935544+0000","last_peered":"2023-10-03T19:12:31.935544+0000","last_clean":"2023-10-03T19:12:31.935544+0000","last_became_active":"2023-10-03T19:12:27.977700+0000","last_became_peered":"2023-10-03T19:12:27.977700+0000","last_unstale":"2023-10-03T19:12:31.935544+0000","last_undegraded":"2023-10-03T19:12:31.935544+0000","last_fullsized":"2023-10-03T19:12:31.935544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:08:48.595519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936430+0000","last_change":"2023-10-03T19:12:27.578433+0000","last_active":"2023-10-03T19:12:31.936430+0000","last_peered":"2023-10-03T19:12:31.936430+0000","last_clean":"2023-10-03T19:12:31.936430+0000","last_became_active":"2023-10-03T19:12:27.577627+0000","last_became_peered":"2023-10-03T19:12:27.577627+0000","last_unstale":"2023-10-03T19:12:31.936430+0000","last_undegraded":"2023-10-03T19:12:31.936430+0000","last_fullsized":"2023-10-03T19:12:31.936430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:42:02.193854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.446282+0000","last_change":"2023-10-03T19:12:27.983570+0000","last_active":"2023-10-03T19:12:31.446282+0000","last_peered":"2023-10-03T19:12:31.446282+0000","last_clean":"2023-10-03T19:12:31.446282+0000","last_became_active":"2023-10-03T19:12:27.983296+0000","last_became_peered":"2023-10-03T19:12:27.983296+0000","last_unstale":"2023-10-03T19:12:31.446282+0000","last_undegraded":"2023-10-03T19:12:31.446282+0000","last_fullsized":"2023-10-03T19:12:31.446282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:04:50.005254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953770+0000","last_change":"2023-10-03T19:12:27.577852+0000","last_active":"2023-10-03T19:12:28.953770+0000","last_peered":"2023-10-03T19:12:28.953770+0000","last_clean":"2023-10-03T19:12:28.953770+0000","last_became_active":"2023-10-03T19:12:27.576792+0000","last_became_peered":"2023-10-03T19:12:27.576792+0000","last_unstale":"2023-10-03T19:12:28.953770+0000","last_undegraded":"2023-10-03T19:12:28.953770+0000","last_fullsized":"2023-10-03T19:12:28.953770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:40:39.169467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.947561+0000","last_change":"2023-10-03T19:12:27.983619+0000","last_active":"2023-10-03T19:12:28.947561+0000","last_peered":"2023-10-03T19:12:28.947561+0000","last_clean":"2023-10-03T19:12:28.947561+0000","last_became_active":"2023-10-03T19:12:27.983185+0000","last_became_peered":"2023-10-03T19:12:27.983185+0000","last_unstale":"2023-10-03T19:12:28.947561+0000","last_undegraded":"2023-10-03T19:12:28.947561+0000","last_fullsized":"2023-10-03T19:12:28.947561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:02:11.328680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937025+0000","last_change":"2023-10-03T19:12:27.593678+0000","last_active":"2023-10-03T19:12:31.937025+0000","last_peered":"2023-10-03T19:12:31.937025+0000","last_clean":"2023-10-03T19:12:31.937025+0000","last_became_active":"2023-10-03T19:12:27.593376+0000","last_became_peered":"2023-10-03T19:12:27.593376+0000","last_unstale":"2023-10-03T19:12:31.937025+0000","last_undegraded":"2023-10-03T19:12:31.937025+0000","last_fullsized":"2023-10-03T19:12:31.937025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:51:22.870713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954797+0000","last_change":"2023-10-03T19:12:27.962395+0000","last_active":"2023-10-03T19:12:28.954797+0000","last_peered":"2023-10-03T19:12:28.954797+0000","last_clean":"2023-10-03T19:12:28.954797+0000","last_became_active":"2023-10-03T19:12:27.962105+0000","last_became_peered":"2023-10-03T19:12:27.962105+0000","last_unstale":"2023-10-03T19:12:28.954797+0000","last_undegraded":"2023-10-03T19:12:28.954797+0000","last_fullsized":"2023-10-03T19:12:28.954797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:51:28.867821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952027+0000","last_change":"2023-10-03T19:12:27.588675+0000","last_active":"2023-10-03T19:12:28.952027+0000","last_peered":"2023-10-03T19:12:28.952027+0000","last_clean":"2023-10-03T19:12:28.952027+0000","last_became_active":"2023-10-03T19:12:27.588046+0000","last_became_peered":"2023-10-03T19:12:27.588046+0000","last_unstale":"2023-10-03T19:12:28.952027+0000","last_undegraded":"2023-10-03T19:12:28.952027+0000","last_fullsized":"2023-10-03T19:12:28.952027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:08:47.585355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953482+0000","last_change":"2023-10-03T19:12:27.965478+0000","last_active":"2023-10-03T19:12:28.953482+0000","last_peered":"2023-10-03T19:12:28.953482+0000","last_clean":"2023-10-03T19:12:28.953482+0000","last_became_active":"2023-10-03T19:12:27.964064+0000","last_became_peered":"2023-10-03T19:12:27.964064+0000","last_unstale":"2023-10-03T19:12:28.953482+0000","last_undegraded":"2023-10-03T19:12:28.953482+0000","last_fullsized":"2023-10-03T19:12:28.953482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:02:28.878823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952596+0000","last_change":"2023-10-03T19:12:27.587343+0000","last_active":"2023-10-03T19:12:28.952596+0000","last_peered":"2023-10-03T19:12:28.952596+0000","last_clean":"2023-10-03T19:12:28.952596+0000","last_became_active":"2023-10-03T19:12:27.586953+0000","last_became_peered":"2023-10-03T19:12:27.586953+0000","last_unstale":"2023-10-03T19:12:28.952596+0000","last_undegraded":"2023-10-03T19:12:28.952596+0000","last_fullsized":"2023-10-03T19:12:28.952596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:01:57.712265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.446178+0000","last_change":"2023-10-03T19:12:27.970441+0000","last_active":"2023-10-03T19:12:31.446178+0000","last_peered":"2023-10-03T19:12:31.446178+0000","last_clean":"2023-10-03T19:12:31.446178+0000","last_became_active":"2023-10-03T19:12:27.970137+0000","last_became_peered":"2023-10-03T19:12:27.970137+0000","last_unstale":"2023-10-03T19:12:31.446178+0000","last_undegraded":"2023-10-03T19:12:31.446178+0000","last_fullsized":"2023-10-03T19:12:31.446178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:39:07.804995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.446174+0000","last_change":"2023-10-03T19:12:27.586020+0000","last_active":"2023-10-03T19:12:31.446174+0000","last_peered":"2023-10-03T19:12:31.446174+0000","last_clean":"2023-10-03T19:12:31.446174+0000","last_became_active":"2023-10-03T19:12:27.585736+0000","last_became_peered":"2023-10-03T19:12:27.585736+0000","last_unstale":"2023-10-03T19:12:31.446174+0000","last_undegraded":"2023-10-03T19:12:31.446174+0000","last_fullsized":"2023-10-03T19:12:31.446174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:33:53.378803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.951761+0000","last_change":"2023-10-03T19:12:27.986822+0000","last_active":"2023-10-03T19:12:28.951761+0000","last_peered":"2023-10-03T19:12:28.951761+0000","last_clean":"2023-10-03T19:12:28.951761+0000","last_became_active":"2023-10-03T19:12:27.986532+0000","last_became_peered":"2023-10-03T19:12:27.986532+0000","last_unstale":"2023-10-03T19:12:28.951761+0000","last_undegraded":"2023-10-03T19:12:28.951761+0000","last_fullsized":"2023-10-03T19:12:28.951761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:20:24.642279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'4","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936684+0000","last_change":"2023-10-03T19:12:27.591787+0000","last_active":"2023-10-03T19:12:31.936684+0000","last_peered":"2023-10-03T19:12:31.936684+0000","last_clean":"2023-10-03T19:12:31.936684+0000","last_became_active":"2023-10-03T19:12:27.591472+0000","last_became_peered":"2023-10-03T19:12:27.591472+0000","last_unstale":"2023-10-03T19:12:31.936684+0000","last_undegraded":"2023-10-03T19:12:31.936684+0000","last_fullsized":"2023-10-03T19:12:31.936684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:37:44.604456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8956,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362884,"statfs":{"total":96636764160,"available":96627593216,"internally_reserved":0,"allocated":315392,"data_stored":673718,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2130000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8348,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363492,"statfs":{"total":96636764160,"available":96628215808,"internally_reserved":0,"allocated":217088,"data_stored":80406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8436,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363404,"statfs":{"total":96636764160,"available":96628125696,"internally_reserved":0,"allocated":241664,"data_stored":83190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12444,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":12224,"kb_avail":94359396,"statfs":{"total":96636764160,"available":96624021504,"internally_reserved":0,"allocated":217088,"data_stored":80406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12517376},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8416,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363424,"statfs":{"total":96636764160,"available":96628146176,"internally_reserved":0,"allocated":221184,"data_stored":81570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8420,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363420,"statfs":{"total":96636764160,"available":96628142080,"internally_reserved":0,"allocated":225280,"data_stored":81660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2849999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8360,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363480,"statfs":{"total":96636764160,"available":96628203520,"internally_reserved":0,"allocated":229376,"data_stored":82222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13024,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":12736,"kb_avail":94358816,"statfs":{"total":96636764160,"available":96623427584,"internally_reserved":0,"allocated":286720,"data_stored":671356,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":13041664},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:12:39.114 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:12:39.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.269+0000 7f6c49fcb640 1 Processor -- start 2023-10-03T19:12:39.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c49fcb640 1 -- start start 2023-10-03T19:12:39.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c49fcb640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6c4406cd40 0x7f6c4414aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:39.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c49fcb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c44147ab0 0x7f6c44147f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:39.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c49fcb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c440bc430 con 0x7f6c440a3670 2023-10-03T19:12:39.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c49fcb640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c440a5db0 con 0x7f6c4406cd40 2023-10-03T19:12:39.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c49fcb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c44148470 con 0x7f6c44147ab0 2023-10-03T19:12:39.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c3bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6c440a3670 0x7f6c440bbd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33520/0 (socket says 172.21.15.45:33520) 2023-10-03T19:12:39.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c3bfff640 1 -- 172.21.15.45:0/872456249 learned_addr learned my addr 172.21.15.45:0/872456249 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:39.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c43fff640 1 --2- 172.21.15.45:0/872456249 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c44147ab0 0x7f6c44147f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:39.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c42ffd640 1 -- 172.21.15.45:0/872456249 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 503746154 0 0) 0x7f6c440bc430 con 0x7f6c440a3670 2023-10-03T19:12:39.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c437fe640 1 --2- 172.21.15.45:0/872456249 >> v2:172.21.15.79:3300/0 conn(0x7f6c4406cd40 0x7f6c4414aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:39.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c42ffd640 1 -- 172.21.15.45:0/872456249 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c30003530 con 0x7f6c440a3670 2023-10-03T19:12:39.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c42ffd640 1 -- 172.21.15.45:0/872456249 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3580276588 0 0) 0x7f6c30003530 con 0x7f6c440a3670 2023-10-03T19:12:39.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c42ffd640 1 -- 172.21.15.45:0/872456249 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c44147ab0 msgr2=0x7f6c44147f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:39.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c42ffd640 1 --2- 172.21.15.45:0/872456249 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c44147ab0 0x7f6c44147f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:39.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c42ffd640 1 -- 172.21.15.45:0/872456249 >> v2:172.21.15.79:3300/0 conn(0x7f6c4406cd40 msgr2=0x7f6c4414aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:39.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c42ffd640 1 --2- 172.21.15.45:0/872456249 >> v2:172.21.15.79:3300/0 conn(0x7f6c4406cd40 0x7f6c4414aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:39.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c42ffd640 1 -- 172.21.15.45:0/872456249 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c440baf60 con 0x7f6c440a3670 2023-10-03T19:12:39.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c42ffd640 1 -- 172.21.15.45:0/872456249 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f6c2c001680 con 0x7f6c440a3670 2023-10-03T19:12:39.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c437fe640 1 --2- 172.21.15.45:0/872456249 >> v2:172.21.15.79:3300/0 conn(0x7f6c4406cd40 0x7f6c4414aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:12:39.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c42ffd640 1 -- 172.21.15.45:0/872456249 >> v1:172.21.15.45:6789/0 conn(0x7f6c440a3670 legacy=0x7f6c440bbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:39.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c42ffd640 1 --2- 172.21.15.45:0/872456249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c30003980 0x7f6c30003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:39.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c42ffd640 1 --2- 172.21.15.45:0/872456249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c300043b0 0x7f6c30004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:39.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c42ffd640 1 --2- 172.21.15.45:0/872456249 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c44147ab0 0x7f6c30004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:39.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c42ffd640 1 -- 172.21.15.45:0/872456249 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c44148470 con 0x7f6c300043b0 2023-10-03T19:12:39.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c42ffd640 1 -- 172.21.15.45:0/872456249 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3000b990 con 0x7f6c30003980 2023-10-03T19:12:39.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c42ffd640 1 -- 172.21.15.45:0/872456249 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3000bb50 con 0x7f6c44147ab0 2023-10-03T19:12:39.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c3bfff640 1 --2- 172.21.15.45:0/872456249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c300043b0 0x7f6c30004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:39.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c437fe640 1 --2- 172.21.15.45:0/872456249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c30003980 0x7f6c30003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:39.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c43fff640 1 --2- 172.21.15.45:0/872456249 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c44147ab0 0x7f6c30004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:39.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c3bfff640 1 -- 172.21.15.45:0/872456249 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c44147ab0 msgr2=0x7f6c30004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:39.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c3bfff640 1 --2- 172.21.15.45:0/872456249 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c44147ab0 0x7f6c30004ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:39.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c3bfff640 1 -- 172.21.15.45:0/872456249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c30003980 msgr2=0x7f6c30003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:39.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c3bfff640 1 --2- 172.21.15.45:0/872456249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c30003980 0x7f6c30003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:39.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.273+0000 7f6c3bfff640 1 -- 172.21.15.45:0/872456249 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c30003530 con 0x7f6c300043b0 2023-10-03T19:12:39.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c3bfff640 1 --2- 172.21.15.45:0/872456249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c300043b0 0x7f6c30004870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c00c240 tx=0x7f6c2c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60cd1cc4f1050d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:39.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c42ffd640 1 -- 172.21.15.45:0/872456249 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c0a5960 con 0x7f6c300043b0 2023-10-03T19:12:39.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c42ffd640 1 -- 172.21.15.45:0/872456249 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2c0a5ac0 con 0x7f6c300043b0 2023-10-03T19:12:39.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c42ffd640 1 -- 172.21.15.45:0/872456249 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c0058e0 con 0x7f6c300043b0 2023-10-03T19:12:39.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c49fcb640 1 -- 172.21.15.45:0/872456249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c300043b0 msgr2=0x7f6c30004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:39.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c49fcb640 1 --2- 172.21.15.45:0/872456249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c300043b0 0x7f6c30004870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c00c240 tx=0x7f6c2c01cc60 comp rx=0 tx=0).stop 2023-10-03T19:12:39.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c43fff640 1 -- 172.21.15.45:0/872456249 reap_dead start 2023-10-03T19:12:39.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c49fcb640 1 -- 172.21.15.45:0/872456249 shutdown_connections 2023-10-03T19:12:39.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c49fcb640 1 -- 172.21.15.45:0/872456249 >> 172.21.15.45:0/872456249 conn(0x7f6c440bcf50 msgr2=0x7f6c440bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:39.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c49fcb640 1 -- 172.21.15.45:0/872456249 shutdown_connections 2023-10-03T19:12:39.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c49fcb640 1 -- 172.21.15.45:0/872456249 wait complete. 2023-10-03T19:12:39.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c49fcb640 1 Processor -- start 2023-10-03T19:12:39.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c49fcb640 1 -- start start 2023-10-03T19:12:39.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c49fcb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c300043b0 0x7f6c4414e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:39.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c49fcb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c441d7ab0 0x7f6c4414ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:39.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c49fcb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c44143520 0x7f6c44143990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:39.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c49fcb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c441d5be0 con 0x7f6c300043b0 2023-10-03T19:12:39.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c49fcb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c44144150 con 0x7f6c44143520 2023-10-03T19:12:39.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c49fcb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c441d5750 con 0x7f6c441d7ab0 2023-10-03T19:12:39.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c437fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c300043b0 0x7f6c4414e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:39.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c437fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c300043b0 0x7f6c4414e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41816/0 (socket says 172.21.15.45:41816) 2023-10-03T19:12:39.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c437fe640 1 -- 172.21.15.45:0/1702171358 learned_addr learned my addr 172.21.15.45:0/1702171358 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:39.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c3bfff640 1 --2- 172.21.15.45:0/1702171358 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c441d7ab0 0x7f6c4414ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:39.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c43fff640 1 --2- 172.21.15.45:0/1702171358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c44143520 0x7f6c44143990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:39.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c437fe640 1 -- 172.21.15.45:0/1702171358 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c441d7ab0 msgr2=0x7f6c4414ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:39.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c437fe640 1 --2- 172.21.15.45:0/1702171358 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c441d7ab0 0x7f6c4414ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:39.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c437fe640 1 -- 172.21.15.45:0/1702171358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c44143520 msgr2=0x7f6c44143990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:39.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c437fe640 1 --2- 172.21.15.45:0/1702171358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c44143520 0x7f6c44143990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:39.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c437fe640 1 -- 172.21.15.45:0/1702171358 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c440bb520 con 0x7f6c300043b0 2023-10-03T19:12:39.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c3bfff640 1 --2- 172.21.15.45:0/1702171358 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c441d7ab0 0x7f6c4414ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:12:39.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c437fe640 1 --2- 172.21.15.45:0/1702171358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c300043b0 0x7f6c4414e530 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6c34010990 tx=0x7f6c34010e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:39.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c40ff9640 1 -- 172.21.15.45:0/1702171358 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3400aa90 con 0x7f6c300043b0 2023-10-03T19:12:39.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c40ff9640 1 -- 172.21.15.45:0/1702171358 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3400abf0 con 0x7f6c300043b0 2023-10-03T19:12:39.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c49fcb640 1 -- 172.21.15.45:0/1702171358 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c440bb240 con 0x7f6c300043b0 2023-10-03T19:12:39.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c40ff9640 1 -- 172.21.15.45:0/1702171358 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c34013470 con 0x7f6c300043b0 2023-10-03T19:12:39.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.277+0000 7f6c49fcb640 1 -- 172.21.15.45:0/1702171358 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c440bb800 con 0x7f6c300043b0 2023-10-03T19:12:39.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.281+0000 7f6c49fcb640 1 -- 172.21.15.45:0/1702171358 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c4404de80 con 0x7f6c300043b0 2023-10-03T19:12:39.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.281+0000 7f6c40ff9640 1 -- 172.21.15.45:0/1702171358 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6c340135d0 con 0x7f6c300043b0 2023-10-03T19:12:39.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.281+0000 7f6c40ff9640 1 --2- 172.21.15.45:0/1702171358 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6c24066280 0x7f6c24068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:39.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.281+0000 7f6c40ff9640 1 -- 172.21.15.45:0/1702171358 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6c340842f0 con 0x7f6c300043b0 2023-10-03T19:12:39.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.281+0000 7f6c3bfff640 1 --2- 172.21.15.45:0/1702171358 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6c24066280 0x7f6c24068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:39.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.281+0000 7f6c3bfff640 1 --2- 172.21.15.45:0/1702171358 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6c24066280 0x7f6c24068730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c0aa000 tx=0x7f6c2c001a80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:39.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.285+0000 7f6c40ff9640 1 -- 172.21.15.45:0/1702171358 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6c34051800 con 0x7f6c300043b0 2023-10-03T19:12:39.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.429+0000 7f6c49fcb640 1 -- 172.21.15.45:0/1702171358 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6c44143ed0 con 0x7f6c24066280 2023-10-03T19:12:39.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.449+0000 7f6c40ff9640 1 -- 172.21.15.45:0/1702171358 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286612 (secure 0 0 0) 0x7f6c44143ed0 con 0x7f6c24066280 2023-10-03T19:12:39.457 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:39.459 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:12:39.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.453+0000 7f6c49fcb640 1 -- 172.21.15.45:0/1702171358 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6c24066280 msgr2=0x7f6c24068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:39.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.453+0000 7f6c49fcb640 1 --2- 172.21.15.45:0/1702171358 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6c24066280 0x7f6c24068730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c0aa000 tx=0x7f6c2c001a80 comp rx=0 tx=0).stop 2023-10-03T19:12:39.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.453+0000 7f6c49fcb640 1 -- 172.21.15.45:0/1702171358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c300043b0 msgr2=0x7f6c4414e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:39.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.453+0000 7f6c49fcb640 1 --2- 172.21.15.45:0/1702171358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c300043b0 0x7f6c4414e530 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6c34010990 tx=0x7f6c34010e50 comp rx=0 tx=0).stop 2023-10-03T19:12:39.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.453+0000 7f6c49fcb640 1 -- 172.21.15.45:0/1702171358 shutdown_connections 2023-10-03T19:12:39.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.453+0000 7f6c49fcb640 1 --2- 172.21.15.45:0/1702171358 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6c24066280 0x7f6c24068730 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:39.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.453+0000 7f6c49fcb640 1 --2- 172.21.15.45:0/1702171358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c44143520 0x7f6c44143990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:39.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.453+0000 7f6c49fcb640 1 --2- 172.21.15.45:0/1702171358 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c441d7ab0 0x7f6c4414ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:39.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.453+0000 7f6c49fcb640 1 --2- 172.21.15.45:0/1702171358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c300043b0 0x7f6c4414e530 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:39.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.453+0000 7f6c49fcb640 1 -- 172.21.15.45:0/1702171358 >> 172.21.15.45:0/1702171358 conn(0x7f6c440bcf50 msgr2=0x7f6c440a3a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:39.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.453+0000 7f6c49fcb640 1 -- 172.21.15.45:0/1702171358 shutdown_connections 2023-10-03T19:12:39.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.453+0000 7f6c49fcb640 1 -- 172.21.15.45:0/1702171358 wait complete. 2023-10-03T19:12:39.474 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-10-03T19:12:38.442790+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":76404,"kb_used_data":1908,"kb_used_omap":0,"kb_used_meta":74432,"kb_avail":754898316,"statfs":{"total":773094113280,"available":773015875584,"internally_reserved":0,"allocated":1953792,"data_stored":1834528,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":76218368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003622"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.947798+0000","last_change":"2023-10-03T19:12:27.968561+0000","last_active":"2023-10-03T19:12:28.947798+0000","last_peered":"2023-10-03T19:12:28.947798+0000","last_clean":"2023-10-03T19:12:28.947798+0000","last_became_active":"2023-10-03T19:12:27.968018+0000","last_became_peered":"2023-10-03T19:12:27.968018+0000","last_unstale":"2023-10-03T19:12:28.947798+0000","last_undegraded":"2023-10-03T19:12:28.947798+0000","last_fullsized":"2023-10-03T19:12:28.947798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:02:17.085349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954200+0000","last_change":"2023-10-03T19:12:27.970081+0000","last_active":"2023-10-03T19:12:28.954200+0000","last_peered":"2023-10-03T19:12:28.954200+0000","last_clean":"2023-10-03T19:12:28.954200+0000","last_became_active":"2023-10-03T19:12:27.969751+0000","last_became_peered":"2023-10-03T19:12:27.969751+0000","last_unstale":"2023-10-03T19:12:28.954200+0000","last_undegraded":"2023-10-03T19:12:28.954200+0000","last_fullsized":"2023-10-03T19:12:28.954200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:51:23.880877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953910+0000","last_change":"2023-10-03T19:12:27.962924+0000","last_active":"2023-10-03T19:12:28.953910+0000","last_peered":"2023-10-03T19:12:28.953910+0000","last_clean":"2023-10-03T19:12:28.953910+0000","last_became_active":"2023-10-03T19:12:27.962634+0000","last_became_peered":"2023-10-03T19:12:27.962634+0000","last_unstale":"2023-10-03T19:12:28.953910+0000","last_undegraded":"2023-10-03T19:12:28.953910+0000","last_fullsized":"2023-10-03T19:12:28.953910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:39:07.804995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937912+0000","last_change":"2023-10-03T19:12:27.972848+0000","last_active":"2023-10-03T19:12:31.937912+0000","last_peered":"2023-10-03T19:12:31.937912+0000","last_clean":"2023-10-03T19:12:31.937912+0000","last_became_active":"2023-10-03T19:12:27.972451+0000","last_became_peered":"2023-10-03T19:12:27.972451+0000","last_unstale":"2023-10-03T19:12:31.937912+0000","last_undegraded":"2023-10-03T19:12:31.937912+0000","last_fullsized":"2023-10-03T19:12:31.937912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:51:42.777690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936707+0000","last_change":"2023-10-03T19:12:27.966859+0000","last_active":"2023-10-03T19:12:31.936707+0000","last_peered":"2023-10-03T19:12:31.936707+0000","last_clean":"2023-10-03T19:12:31.936707+0000","last_became_active":"2023-10-03T19:12:27.966145+0000","last_became_peered":"2023-10-03T19:12:27.966145+0000","last_unstale":"2023-10-03T19:12:31.936707+0000","last_undegraded":"2023-10-03T19:12:31.936707+0000","last_fullsized":"2023-10-03T19:12:31.936707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:50:51.938925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953307+0000","last_change":"2023-10-03T19:12:27.967226+0000","last_active":"2023-10-03T19:12:28.953307+0000","last_peered":"2023-10-03T19:12:28.953307+0000","last_clean":"2023-10-03T19:12:28.953307+0000","last_became_active":"2023-10-03T19:12:27.966929+0000","last_became_peered":"2023-10-03T19:12:27.966929+0000","last_unstale":"2023-10-03T19:12:28.953307+0000","last_undegraded":"2023-10-03T19:12:28.953307+0000","last_fullsized":"2023-10-03T19:12:28.953307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:42:03.204018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937391+0000","last_change":"2023-10-03T19:12:27.988476+0000","last_active":"2023-10-03T19:12:31.937391+0000","last_peered":"2023-10-03T19:12:31.937391+0000","last_clean":"2023-10-03T19:12:31.937391+0000","last_became_active":"2023-10-03T19:12:27.988133+0000","last_became_peered":"2023-10-03T19:12:27.988133+0000","last_unstale":"2023-10-03T19:12:31.937391+0000","last_undegraded":"2023-10-03T19:12:31.937391+0000","last_fullsized":"2023-10-03T19:12:31.937391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:13:00.937958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.951743+0000","last_change":"2023-10-03T19:12:27.959887+0000","last_active":"2023-10-03T19:12:28.951743+0000","last_peered":"2023-10-03T19:12:28.951743+0000","last_clean":"2023-10-03T19:12:28.951743+0000","last_became_active":"2023-10-03T19:12:27.959538+0000","last_became_peered":"2023-10-03T19:12:27.959538+0000","last_unstale":"2023-10-03T19:12:28.951743+0000","last_undegraded":"2023-10-03T19:12:28.951743+0000","last_fullsized":"2023-10-03T19:12:28.951743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:57:42.821868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936053+0000","last_change":"2023-10-03T19:12:27.970249+0000","last_active":"2023-10-03T19:12:31.936053+0000","last_peered":"2023-10-03T19:12:31.936053+0000","last_clean":"2023-10-03T19:12:31.936053+0000","last_became_active":"2023-10-03T19:12:27.969995+0000","last_became_peered":"2023-10-03T19:12:27.969995+0000","last_unstale":"2023-10-03T19:12:31.936053+0000","last_undegraded":"2023-10-03T19:12:31.936053+0000","last_fullsized":"2023-10-03T19:12:31.936053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:22:33.134502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952651+0000","last_change":"2023-10-03T19:12:27.964836+0000","last_active":"2023-10-03T19:12:28.952651+0000","last_peered":"2023-10-03T19:12:28.952651+0000","last_clean":"2023-10-03T19:12:28.952651+0000","last_became_active":"2023-10-03T19:12:27.964025+0000","last_became_peered":"2023-10-03T19:12:27.964025+0000","last_unstale":"2023-10-03T19:12:28.952651+0000","last_undegraded":"2023-10-03T19:12:28.952651+0000","last_fullsized":"2023-10-03T19:12:28.952651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:22:33.134502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954083+0000","last_change":"2023-10-03T19:12:27.986149+0000","last_active":"2023-10-03T19:12:28.954083+0000","last_peered":"2023-10-03T19:12:28.954083+0000","last_clean":"2023-10-03T19:12:28.954083+0000","last_became_active":"2023-10-03T19:12:27.983721+0000","last_became_peered":"2023-10-03T19:12:27.983721+0000","last_unstale":"2023-10-03T19:12:28.954083+0000","last_undegraded":"2023-10-03T19:12:28.954083+0000","last_fullsized":"2023-10-03T19:12:28.954083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:36:36.702280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.947612+0000","last_change":"2023-10-03T19:12:27.971272+0000","last_active":"2023-10-03T19:12:28.947612+0000","last_peered":"2023-10-03T19:12:28.947612+0000","last_clean":"2023-10-03T19:12:28.947612+0000","last_became_active":"2023-10-03T19:12:27.970796+0000","last_became_peered":"2023-10-03T19:12:27.970796+0000","last_unstale":"2023-10-03T19:12:28.947612+0000","last_undegraded":"2023-10-03T19:12:28.947612+0000","last_fullsized":"2023-10-03T19:12:28.947612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:32:28.423427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.947574+0000","last_change":"2023-10-03T19:12:27.968608+0000","last_active":"2023-10-03T19:12:28.947574+0000","last_peered":"2023-10-03T19:12:28.947574+0000","last_clean":"2023-10-03T19:12:28.947574+0000","last_became_active":"2023-10-03T19:12:27.968090+0000","last_became_peered":"2023-10-03T19:12:27.968090+0000","last_unstale":"2023-10-03T19:12:28.947574+0000","last_undegraded":"2023-10-03T19:12:28.947574+0000","last_fullsized":"2023-10-03T19:12:28.947574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:26:14.808258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952943+0000","last_change":"2023-10-03T19:12:27.970387+0000","last_active":"2023-10-03T19:12:28.952943+0000","last_peered":"2023-10-03T19:12:28.952943+0000","last_clean":"2023-10-03T19:12:28.952943+0000","last_became_active":"2023-10-03T19:12:27.969970+0000","last_became_peered":"2023-10-03T19:12:27.969970+0000","last_unstale":"2023-10-03T19:12:28.952943+0000","last_undegraded":"2023-10-03T19:12:28.952943+0000","last_fullsized":"2023-10-03T19:12:28.952943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:57:10.455144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937132+0000","last_change":"2023-10-03T19:12:27.988472+0000","last_active":"2023-10-03T19:12:31.937132+0000","last_peered":"2023-10-03T19:12:31.937132+0000","last_clean":"2023-10-03T19:12:31.937132+0000","last_became_active":"2023-10-03T19:12:27.988143+0000","last_became_peered":"2023-10-03T19:12:27.988143+0000","last_unstale":"2023-10-03T19:12:31.937132+0000","last_undegraded":"2023-10-03T19:12:31.937132+0000","last_fullsized":"2023-10-03T19:12:31.937132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:04:50.005254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952659+0000","last_change":"2023-10-03T19:12:27.960422+0000","last_active":"2023-10-03T19:12:28.952659+0000","last_peered":"2023-10-03T19:12:28.952659+0000","last_clean":"2023-10-03T19:12:28.952659+0000","last_became_active":"2023-10-03T19:12:27.958884+0000","last_became_peered":"2023-10-03T19:12:27.958884+0000","last_unstale":"2023-10-03T19:12:28.952659+0000","last_undegraded":"2023-10-03T19:12:28.952659+0000","last_fullsized":"2023-10-03T19:12:28.952659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:08:38.248650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936380+0000","last_change":"2023-10-03T19:12:27.968081+0000","last_active":"2023-10-03T19:12:31.936380+0000","last_peered":"2023-10-03T19:12:31.936380+0000","last_clean":"2023-10-03T19:12:31.936380+0000","last_became_active":"2023-10-03T19:12:27.967067+0000","last_became_peered":"2023-10-03T19:12:27.967067+0000","last_unstale":"2023-10-03T19:12:31.936380+0000","last_undegraded":"2023-10-03T19:12:31.936380+0000","last_fullsized":"2023-10-03T19:12:31.936380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:57:10.455144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954083+0000","last_change":"2023-10-03T19:12:27.971067+0000","last_active":"2023-10-03T19:12:28.954083+0000","last_peered":"2023-10-03T19:12:28.954083+0000","last_clean":"2023-10-03T19:12:28.954083+0000","last_became_active":"2023-10-03T19:12:27.970697+0000","last_became_peered":"2023-10-03T19:12:27.970697+0000","last_unstale":"2023-10-03T19:12:28.954083+0000","last_undegraded":"2023-10-03T19:12:28.954083+0000","last_fullsized":"2023-10-03T19:12:28.954083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:48:06.317138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.947677+0000","last_change":"2023-10-03T19:12:27.982404+0000","last_active":"2023-10-03T19:12:28.947677+0000","last_peered":"2023-10-03T19:12:28.947677+0000","last_clean":"2023-10-03T19:12:28.947677+0000","last_became_active":"2023-10-03T19:12:27.982070+0000","last_became_peered":"2023-10-03T19:12:27.982070+0000","last_unstale":"2023-10-03T19:12:28.947677+0000","last_undegraded":"2023-10-03T19:12:28.947677+0000","last_fullsized":"2023-10-03T19:12:28.947677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:05:40.727058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953598+0000","last_change":"2023-10-03T19:12:27.978237+0000","last_active":"2023-10-03T19:12:28.953598+0000","last_peered":"2023-10-03T19:12:28.953598+0000","last_clean":"2023-10-03T19:12:28.953598+0000","last_became_active":"2023-10-03T19:12:27.977841+0000","last_became_peered":"2023-10-03T19:12:27.977841+0000","last_unstale":"2023-10-03T19:12:28.953598+0000","last_undegraded":"2023-10-03T19:12:28.953598+0000","last_fullsized":"2023-10-03T19:12:28.953598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:06:02.160141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937324+0000","last_change":"2023-10-03T19:12:27.978515+0000","last_active":"2023-10-03T19:12:31.937324+0000","last_peered":"2023-10-03T19:12:31.937324+0000","last_clean":"2023-10-03T19:12:31.937324+0000","last_became_active":"2023-10-03T19:12:27.977947+0000","last_became_peered":"2023-10-03T19:12:27.977947+0000","last_unstale":"2023-10-03T19:12:31.937324+0000","last_undegraded":"2023-10-03T19:12:31.937324+0000","last_fullsized":"2023-10-03T19:12:31.937324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:36:36.702280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.935287+0000","last_change":"2023-10-03T19:12:27.966759+0000","last_active":"2023-10-03T19:12:31.935287+0000","last_peered":"2023-10-03T19:12:31.935287+0000","last_clean":"2023-10-03T19:12:31.935287+0000","last_became_active":"2023-10-03T19:12:27.966395+0000","last_became_peered":"2023-10-03T19:12:27.966395+0000","last_unstale":"2023-10-03T19:12:31.935287+0000","last_undegraded":"2023-10-03T19:12:31.935287+0000","last_fullsized":"2023-10-03T19:12:31.935287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:01:29.251478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.445878+0000","last_change":"2023-10-03T19:12:27.965460+0000","last_active":"2023-10-03T19:12:31.445878+0000","last_peered":"2023-10-03T19:12:31.445878+0000","last_clean":"2023-10-03T19:12:31.445878+0000","last_became_active":"2023-10-03T19:12:27.965215+0000","last_became_peered":"2023-10-03T19:12:27.965215+0000","last_unstale":"2023-10-03T19:12:31.445878+0000","last_undegraded":"2023-10-03T19:12:31.445878+0000","last_fullsized":"2023-10-03T19:12:31.445878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:14:25.554969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937118+0000","last_change":"2023-10-03T19:12:27.978012+0000","last_active":"2023-10-03T19:12:31.937118+0000","last_peered":"2023-10-03T19:12:31.937118+0000","last_clean":"2023-10-03T19:12:31.937118+0000","last_became_active":"2023-10-03T19:12:27.977497+0000","last_became_peered":"2023-10-03T19:12:27.977497+0000","last_unstale":"2023-10-03T19:12:31.937118+0000","last_undegraded":"2023-10-03T19:12:31.937118+0000","last_fullsized":"2023-10-03T19:12:31.937118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:39:07.804995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938079+0000","last_change":"2023-10-03T19:12:27.982593+0000","last_active":"2023-10-03T19:12:31.938079+0000","last_peered":"2023-10-03T19:12:31.938079+0000","last_clean":"2023-10-03T19:12:31.938079+0000","last_became_active":"2023-10-03T19:12:27.982076+0000","last_became_peered":"2023-10-03T19:12:27.982076+0000","last_unstale":"2023-10-03T19:12:31.938079+0000","last_undegraded":"2023-10-03T19:12:31.938079+0000","last_fullsized":"2023-10-03T19:12:31.938079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:13:00.937958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937722+0000","last_change":"2023-10-03T19:12:27.969145+0000","last_active":"2023-10-03T19:12:31.937722+0000","last_peered":"2023-10-03T19:12:31.937722+0000","last_clean":"2023-10-03T19:12:31.937722+0000","last_became_active":"2023-10-03T19:12:27.968857+0000","last_became_peered":"2023-10-03T19:12:27.968857+0000","last_unstale":"2023-10-03T19:12:31.937722+0000","last_undegraded":"2023-10-03T19:12:31.937722+0000","last_fullsized":"2023-10-03T19:12:31.937722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:48:06.317138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952353+0000","last_change":"2023-10-03T19:12:27.978614+0000","last_active":"2023-10-03T19:12:28.952353+0000","last_peered":"2023-10-03T19:12:28.952353+0000","last_clean":"2023-10-03T19:12:28.952353+0000","last_became_active":"2023-10-03T19:12:27.978222+0000","last_became_peered":"2023-10-03T19:12:27.978222+0000","last_unstale":"2023-10-03T19:12:28.952353+0000","last_undegraded":"2023-10-03T19:12:28.952353+0000","last_fullsized":"2023-10-03T19:12:28.952353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:47:33.343155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936959+0000","last_change":"2023-10-03T19:12:27.977987+0000","last_active":"2023-10-03T19:12:31.936959+0000","last_peered":"2023-10-03T19:12:31.936959+0000","last_clean":"2023-10-03T19:12:31.936959+0000","last_became_active":"2023-10-03T19:12:27.977696+0000","last_became_peered":"2023-10-03T19:12:27.977696+0000","last_unstale":"2023-10-03T19:12:31.936959+0000","last_undegraded":"2023-10-03T19:12:31.936959+0000","last_fullsized":"2023-10-03T19:12:31.936959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:14:25.554969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.446109+0000","last_change":"2023-10-03T19:12:27.984102+0000","last_active":"2023-10-03T19:12:31.446109+0000","last_peered":"2023-10-03T19:12:31.446109+0000","last_clean":"2023-10-03T19:12:31.446109+0000","last_became_active":"2023-10-03T19:12:27.983835+0000","last_became_peered":"2023-10-03T19:12:27.983835+0000","last_unstale":"2023-10-03T19:12:31.446109+0000","last_undegraded":"2023-10-03T19:12:31.446109+0000","last_fullsized":"2023-10-03T19:12:31.446109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:40:40.179631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953719+0000","last_change":"2023-10-03T19:12:27.982956+0000","last_active":"2023-10-03T19:12:28.953719+0000","last_peered":"2023-10-03T19:12:28.953719+0000","last_clean":"2023-10-03T19:12:28.953719+0000","last_became_active":"2023-10-03T19:12:27.982622+0000","last_became_peered":"2023-10-03T19:12:27.982622+0000","last_unstale":"2023-10-03T19:12:28.953719+0000","last_undegraded":"2023-10-03T19:12:28.953719+0000","last_fullsized":"2023-10-03T19:12:28.953719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:58:41.915397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.445663+0000","last_change":"2023-10-03T19:12:27.969233+0000","last_active":"2023-10-03T19:12:31.445663+0000","last_peered":"2023-10-03T19:12:31.445663+0000","last_clean":"2023-10-03T19:12:31.445663+0000","last_became_active":"2023-10-03T19:12:27.968939+0000","last_became_peered":"2023-10-03T19:12:27.968939+0000","last_unstale":"2023-10-03T19:12:31.445663+0000","last_undegraded":"2023-10-03T19:12:31.445663+0000","last_fullsized":"2023-10-03T19:12:31.445663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:56:53.031240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937466+0000","last_change":"2023-10-03T19:12:27.982253+0000","last_active":"2023-10-03T19:12:31.937466+0000","last_peered":"2023-10-03T19:12:31.937466+0000","last_clean":"2023-10-03T19:12:31.937466+0000","last_became_active":"2023-10-03T19:12:27.974654+0000","last_became_peered":"2023-10-03T19:12:27.974654+0000","last_unstale":"2023-10-03T19:12:31.937466+0000","last_undegraded":"2023-10-03T19:12:31.937466+0000","last_fullsized":"2023-10-03T19:12:31.937466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:15:19.668421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.446441+0000","last_change":"2023-10-03T19:12:27.969223+0000","last_active":"2023-10-03T19:12:31.446441+0000","last_peered":"2023-10-03T19:12:31.446441+0000","last_clean":"2023-10-03T19:12:31.446441+0000","last_became_active":"2023-10-03T19:12:27.968920+0000","last_became_peered":"2023-10-03T19:12:27.968920+0000","last_unstale":"2023-10-03T19:12:31.446441+0000","last_undegraded":"2023-10-03T19:12:31.446441+0000","last_fullsized":"2023-10-03T19:12:31.446441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:36:36.702280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938352+0000","last_change":"2023-10-03T19:12:27.594756+0000","last_active":"2023-10-03T19:12:31.938352+0000","last_peered":"2023-10-03T19:12:31.938352+0000","last_clean":"2023-10-03T19:12:31.938352+0000","last_became_active":"2023-10-03T19:12:27.594156+0000","last_became_peered":"2023-10-03T19:12:27.594156+0000","last_unstale":"2023-10-03T19:12:31.938352+0000","last_undegraded":"2023-10-03T19:12:31.938352+0000","last_fullsized":"2023-10-03T19:12:31.938352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:51:27.857657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953302+0000","last_change":"2023-10-03T19:12:27.984997+0000","last_active":"2023-10-03T19:12:28.953302+0000","last_peered":"2023-10-03T19:12:28.953302+0000","last_clean":"2023-10-03T19:12:28.953302+0000","last_became_active":"2023-10-03T19:12:27.984682+0000","last_became_peered":"2023-10-03T19:12:27.984682+0000","last_unstale":"2023-10-03T19:12:28.953302+0000","last_undegraded":"2023-10-03T19:12:28.953302+0000","last_fullsized":"2023-10-03T19:12:28.953302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:29:18.707428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.935473+0000","last_change":"2023-10-03T19:12:27.589809+0000","last_active":"2023-10-03T19:12:31.935473+0000","last_peered":"2023-10-03T19:12:31.935473+0000","last_clean":"2023-10-03T19:12:31.935473+0000","last_became_active":"2023-10-03T19:12:27.589415+0000","last_became_peered":"2023-10-03T19:12:27.589415+0000","last_unstale":"2023-10-03T19:12:31.935473+0000","last_undegraded":"2023-10-03T19:12:31.935473+0000","last_fullsized":"2023-10-03T19:12:31.935473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:21:26.096838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.935811+0000","last_change":"2023-10-03T19:12:27.966910+0000","last_active":"2023-10-03T19:12:31.935811+0000","last_peered":"2023-10-03T19:12:31.935811+0000","last_clean":"2023-10-03T19:12:31.935811+0000","last_became_active":"2023-10-03T19:12:27.966160+0000","last_became_peered":"2023-10-03T19:12:27.966160+0000","last_unstale":"2023-10-03T19:12:31.935811+0000","last_undegraded":"2023-10-03T19:12:31.935811+0000","last_fullsized":"2023-10-03T19:12:31.935811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:55:55.744147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937350+0000","last_change":"2023-10-03T19:12:27.597122+0000","last_active":"2023-10-03T19:12:31.937350+0000","last_peered":"2023-10-03T19:12:31.937350+0000","last_clean":"2023-10-03T19:12:31.937350+0000","last_became_active":"2023-10-03T19:12:27.596367+0000","last_became_peered":"2023-10-03T19:12:27.596367+0000","last_unstale":"2023-10-03T19:12:31.937350+0000","last_undegraded":"2023-10-03T19:12:31.937350+0000","last_fullsized":"2023-10-03T19:12:31.937350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:09:55.002369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.446581+0000","last_change":"2023-10-03T19:12:27.983942+0000","last_active":"2023-10-03T19:12:31.446581+0000","last_peered":"2023-10-03T19:12:31.446581+0000","last_clean":"2023-10-03T19:12:31.446581+0000","last_became_active":"2023-10-03T19:12:27.983600+0000","last_became_peered":"2023-10-03T19:12:27.983600+0000","last_unstale":"2023-10-03T19:12:31.446581+0000","last_undegraded":"2023-10-03T19:12:31.446581+0000","last_fullsized":"2023-10-03T19:12:31.446581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:13:00.937958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'8","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937478+0000","last_change":"2023-10-03T19:12:27.580060+0000","last_active":"2023-10-03T19:12:31.937478+0000","last_peered":"2023-10-03T19:12:31.937478+0000","last_clean":"2023-10-03T19:12:31.937478+0000","last_became_active":"2023-10-03T19:12:27.579250+0000","last_became_peered":"2023-10-03T19:12:27.579250+0000","last_unstale":"2023-10-03T19:12:31.937478+0000","last_undegraded":"2023-10-03T19:12:31.937478+0000","last_fullsized":"2023-10-03T19:12:31.937478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:04:31.510597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938787+0000","last_change":"2023-10-03T19:12:27.597979+0000","last_active":"2023-10-03T19:12:31.938787+0000","last_peered":"2023-10-03T19:12:31.938787+0000","last_clean":"2023-10-03T19:12:31.938787+0000","last_became_active":"2023-10-03T19:12:27.595911+0000","last_became_peered":"2023-10-03T19:12:27.595911+0000","last_unstale":"2023-10-03T19:12:31.938787+0000","last_undegraded":"2023-10-03T19:12:31.938787+0000","last_fullsized":"2023-10-03T19:12:31.938787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:11:28.744038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.951943+0000","last_change":"2023-10-03T19:12:27.978558+0000","last_active":"2023-10-03T19:12:28.951943+0000","last_peered":"2023-10-03T19:12:28.951943+0000","last_clean":"2023-10-03T19:12:28.951943+0000","last_became_active":"2023-10-03T19:12:27.978193+0000","last_became_peered":"2023-10-03T19:12:27.978193+0000","last_unstale":"2023-10-03T19:12:28.951943+0000","last_undegraded":"2023-10-03T19:12:28.951943+0000","last_fullsized":"2023-10-03T19:12:28.951943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:21:27.107002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938789+0000","last_change":"2023-10-03T19:12:27.597785+0000","last_active":"2023-10-03T19:12:31.938789+0000","last_peered":"2023-10-03T19:12:31.938789+0000","last_clean":"2023-10-03T19:12:31.938789+0000","last_became_active":"2023-10-03T19:12:27.596252+0000","last_became_peered":"2023-10-03T19:12:27.596252+0000","last_unstale":"2023-10-03T19:12:31.938789+0000","last_undegraded":"2023-10-03T19:12:31.938789+0000","last_fullsized":"2023-10-03T19:12:31.938789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:55:56.909440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953146+0000","last_change":"2023-10-03T19:12:27.983791+0000","last_active":"2023-10-03T19:12:28.953146+0000","last_peered":"2023-10-03T19:12:28.953146+0000","last_clean":"2023-10-03T19:12:28.953146+0000","last_became_active":"2023-10-03T19:12:27.983498+0000","last_became_peered":"2023-10-03T19:12:27.983498+0000","last_unstale":"2023-10-03T19:12:28.953146+0000","last_undegraded":"2023-10-03T19:12:28.953146+0000","last_fullsized":"2023-10-03T19:12:28.953146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:56:53.031240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938558+0000","last_change":"2023-10-03T19:12:27.597281+0000","last_active":"2023-10-03T19:12:31.938558+0000","last_peered":"2023-10-03T19:12:31.938558+0000","last_clean":"2023-10-03T19:12:31.938558+0000","last_became_active":"2023-10-03T19:12:27.596699+0000","last_became_peered":"2023-10-03T19:12:27.596699+0000","last_unstale":"2023-10-03T19:12:31.938558+0000","last_undegraded":"2023-10-03T19:12:31.938558+0000","last_fullsized":"2023-10-03T19:12:31.938558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:02:43.719408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937888+0000","last_change":"2023-10-03T19:12:27.985128+0000","last_active":"2023-10-03T19:12:31.937888+0000","last_peered":"2023-10-03T19:12:31.937888+0000","last_clean":"2023-10-03T19:12:31.937888+0000","last_became_active":"2023-10-03T19:12:27.984570+0000","last_became_peered":"2023-10-03T19:12:27.984570+0000","last_unstale":"2023-10-03T19:12:31.937888+0000","last_undegraded":"2023-10-03T19:12:31.937888+0000","last_fullsized":"2023-10-03T19:12:31.937888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:23:37.424885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952130+0000","last_change":"2023-10-03T19:12:27.594338+0000","last_active":"2023-10-03T19:12:28.952130+0000","last_peered":"2023-10-03T19:12:28.952130+0000","last_clean":"2023-10-03T19:12:28.952130+0000","last_became_active":"2023-10-03T19:12:27.593882+0000","last_became_peered":"2023-10-03T19:12:27.593882+0000","last_unstale":"2023-10-03T19:12:28.952130+0000","last_undegraded":"2023-10-03T19:12:28.952130+0000","last_fullsized":"2023-10-03T19:12:28.952130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:55:54.733983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936024+0000","last_change":"2023-10-03T19:12:27.969749+0000","last_active":"2023-10-03T19:12:31.936024+0000","last_peered":"2023-10-03T19:12:31.936024+0000","last_clean":"2023-10-03T19:12:31.936024+0000","last_became_active":"2023-10-03T19:12:27.966817+0000","last_became_peered":"2023-10-03T19:12:27.966817+0000","last_unstale":"2023-10-03T19:12:31.936024+0000","last_undegraded":"2023-10-03T19:12:31.936024+0000","last_fullsized":"2023-10-03T19:12:31.936024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:01:58.722428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.446414+0000","last_change":"2023-10-03T19:12:27.586872+0000","last_active":"2023-10-03T19:12:31.446414+0000","last_peered":"2023-10-03T19:12:31.446414+0000","last_clean":"2023-10-03T19:12:31.446414+0000","last_became_active":"2023-10-03T19:12:27.586119+0000","last_became_peered":"2023-10-03T19:12:27.586119+0000","last_unstale":"2023-10-03T19:12:31.446414+0000","last_undegraded":"2023-10-03T19:12:31.446414+0000","last_fullsized":"2023-10-03T19:12:31.446414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:48:05.306974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953682+0000","last_change":"2023-10-03T19:12:27.964111+0000","last_active":"2023-10-03T19:12:28.953682+0000","last_peered":"2023-10-03T19:12:28.953682+0000","last_clean":"2023-10-03T19:12:28.953682+0000","last_became_active":"2023-10-03T19:12:27.963620+0000","last_became_peered":"2023-10-03T19:12:27.963620+0000","last_unstale":"2023-10-03T19:12:28.953682+0000","last_undegraded":"2023-10-03T19:12:28.953682+0000","last_fullsized":"2023-10-03T19:12:28.953682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:14:25.554969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938077+0000","last_change":"2023-10-03T19:12:27.587990+0000","last_active":"2023-10-03T19:12:31.938077+0000","last_peered":"2023-10-03T19:12:31.938077+0000","last_clean":"2023-10-03T19:12:31.938077+0000","last_became_active":"2023-10-03T19:12:27.587316+0000","last_became_peered":"2023-10-03T19:12:27.587316+0000","last_unstale":"2023-10-03T19:12:31.938077+0000","last_undegraded":"2023-10-03T19:12:31.938077+0000","last_fullsized":"2023-10-03T19:12:31.938077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:08:37.238486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954191+0000","last_change":"2023-10-03T19:12:27.970739+0000","last_active":"2023-10-03T19:12:28.954191+0000","last_peered":"2023-10-03T19:12:28.954191+0000","last_clean":"2023-10-03T19:12:28.954191+0000","last_became_active":"2023-10-03T19:12:27.970408+0000","last_became_peered":"2023-10-03T19:12:27.970408+0000","last_unstale":"2023-10-03T19:12:28.954191+0000","last_undegraded":"2023-10-03T19:12:28.954191+0000","last_fullsized":"2023-10-03T19:12:28.954191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:13:00.937958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953950+0000","last_change":"2023-10-03T19:12:27.580938+0000","last_active":"2023-10-03T19:12:28.953950+0000","last_peered":"2023-10-03T19:12:28.953950+0000","last_clean":"2023-10-03T19:12:28.953950+0000","last_became_active":"2023-10-03T19:12:27.580538+0000","last_became_peered":"2023-10-03T19:12:27.580538+0000","last_unstale":"2023-10-03T19:12:28.953950+0000","last_undegraded":"2023-10-03T19:12:28.953950+0000","last_fullsized":"2023-10-03T19:12:28.953950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:04:48.995090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954372+0000","last_change":"2023-10-03T19:12:27.969234+0000","last_active":"2023-10-03T19:12:28.954372+0000","last_peered":"2023-10-03T19:12:28.954372+0000","last_clean":"2023-10-03T19:12:28.954372+0000","last_became_active":"2023-10-03T19:12:27.968880+0000","last_became_peered":"2023-10-03T19:12:27.968880+0000","last_unstale":"2023-10-03T19:12:28.954372+0000","last_undegraded":"2023-10-03T19:12:28.954372+0000","last_fullsized":"2023-10-03T19:12:28.954372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:09:56.012532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.445909+0000","last_change":"2023-10-03T19:12:27.592296+0000","last_active":"2023-10-03T19:12:31.445909+0000","last_peered":"2023-10-03T19:12:31.445909+0000","last_clean":"2023-10-03T19:12:31.445909+0000","last_became_active":"2023-10-03T19:12:27.588952+0000","last_became_peered":"2023-10-03T19:12:27.588952+0000","last_unstale":"2023-10-03T19:12:31.445909+0000","last_undegraded":"2023-10-03T19:12:31.445909+0000","last_fullsized":"2023-10-03T19:12:31.445909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:58:40.905233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937406+0000","last_change":"2023-10-03T19:12:27.967839+0000","last_active":"2023-10-03T19:12:31.937406+0000","last_peered":"2023-10-03T19:12:31.937406+0000","last_clean":"2023-10-03T19:12:31.937406+0000","last_became_active":"2023-10-03T19:12:27.967281+0000","last_became_peered":"2023-10-03T19:12:27.967281+0000","last_unstale":"2023-10-03T19:12:31.937406+0000","last_undegraded":"2023-10-03T19:12:31.937406+0000","last_fullsized":"2023-10-03T19:12:31.937406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:33:54.388967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":171,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937204+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:12:31.937204+0000","last_peered":"2023-10-03T19:12:31.937204+0000","last_clean":"2023-10-03T19:12:31.937204+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:12:31.937204+0000","last_undegraded":"2023-10-03T19:12:31.937204+0000","last_fullsized":"2023-10-03T19:12:31.937204+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:48:00.062144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.951827+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:12:28.951827+0000","last_peered":"2023-10-03T19:12:28.951827+0000","last_clean":"2023-10-03T19:12:28.951827+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:12:28.951827+0000","last_undegraded":"2023-10-03T19:12:28.951827+0000","last_fullsized":"2023-10-03T19:12:28.951827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:16:13.727679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.445820+0000","last_change":"2023-10-03T19:12:27.592604+0000","last_active":"2023-10-03T19:12:31.445820+0000","last_peered":"2023-10-03T19:12:31.445820+0000","last_clean":"2023-10-03T19:12:31.445820+0000","last_became_active":"2023-10-03T19:12:27.592242+0000","last_became_peered":"2023-10-03T19:12:27.592242+0000","last_unstale":"2023-10-03T19:12:31.445820+0000","last_undegraded":"2023-10-03T19:12:31.445820+0000","last_fullsized":"2023-10-03T19:12:31.445820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:06:01.149977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937821+0000","last_change":"2023-10-03T19:12:27.981742+0000","last_active":"2023-10-03T19:12:31.937821+0000","last_peered":"2023-10-03T19:12:31.937821+0000","last_clean":"2023-10-03T19:12:31.937821+0000","last_became_active":"2023-10-03T19:12:27.981480+0000","last_became_peered":"2023-10-03T19:12:27.981480+0000","last_unstale":"2023-10-03T19:12:31.937821+0000","last_undegraded":"2023-10-03T19:12:31.937821+0000","last_fullsized":"2023-10-03T19:12:31.937821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:32:27.213744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936854+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:12:31.936854+0000","last_peered":"2023-10-03T19:12:31.936854+0000","last_clean":"2023-10-03T19:12:31.936854+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:12:31.936854+0000","last_undegraded":"2023-10-03T19:12:31.936854+0000","last_fullsized":"2023-10-03T19:12:31.936854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:33:49.157041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.935405+0000","last_change":"2023-10-03T19:12:27.594044+0000","last_active":"2023-10-03T19:12:31.935405+0000","last_peered":"2023-10-03T19:12:31.935405+0000","last_clean":"2023-10-03T19:12:31.935405+0000","last_became_active":"2023-10-03T19:12:27.593678+0000","last_became_peered":"2023-10-03T19:12:27.593678+0000","last_unstale":"2023-10-03T19:12:31.935405+0000","last_undegraded":"2023-10-03T19:12:31.935405+0000","last_fullsized":"2023-10-03T19:12:31.935405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:57:41.811705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.935677+0000","last_change":"2023-10-03T19:12:27.969842+0000","last_active":"2023-10-03T19:12:31.935677+0000","last_peered":"2023-10-03T19:12:31.935677+0000","last_clean":"2023-10-03T19:12:31.935677+0000","last_became_active":"2023-10-03T19:12:27.966611+0000","last_became_peered":"2023-10-03T19:12:27.966611+0000","last_unstale":"2023-10-03T19:12:31.935677+0000","last_undegraded":"2023-10-03T19:12:31.935677+0000","last_fullsized":"2023-10-03T19:12:31.935677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:16:18.959604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.947762+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:12:28.947762+0000","last_peered":"2023-10-03T19:12:28.947762+0000","last_clean":"2023-10-03T19:12:28.947762+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:12:28.947762+0000","last_undegraded":"2023-10-03T19:12:28.947762+0000","last_fullsized":"2023-10-03T19:12:28.947762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:24:20.268582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936393+0000","last_change":"2023-10-03T19:12:27.579209+0000","last_active":"2023-10-03T19:12:31.936393+0000","last_peered":"2023-10-03T19:12:31.936393+0000","last_clean":"2023-10-03T19:12:31.936393+0000","last_became_active":"2023-10-03T19:12:27.578633+0000","last_became_peered":"2023-10-03T19:12:27.578633+0000","last_unstale":"2023-10-03T19:12:31.936393+0000","last_undegraded":"2023-10-03T19:12:31.936393+0000","last_fullsized":"2023-10-03T19:12:31.936393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:02:27.868659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937557+0000","last_change":"2023-10-03T19:12:27.966914+0000","last_active":"2023-10-03T19:12:31.937557+0000","last_peered":"2023-10-03T19:12:31.937557+0000","last_clean":"2023-10-03T19:12:31.937557+0000","last_became_active":"2023-10-03T19:12:27.966406+0000","last_became_peered":"2023-10-03T19:12:27.966406+0000","last_unstale":"2023-10-03T19:12:31.937557+0000","last_undegraded":"2023-10-03T19:12:31.937557+0000","last_fullsized":"2023-10-03T19:12:31.937557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:39:07.804995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953153+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:12:28.953153+0000","last_peered":"2023-10-03T19:12:28.953153+0000","last_clean":"2023-10-03T19:12:28.953153+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:12:28.953153+0000","last_undegraded":"2023-10-03T19:12:28.953153+0000","last_fullsized":"2023-10-03T19:12:28.953153+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:50:46.706999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954915+0000","last_change":"2023-10-03T19:12:27.586703+0000","last_active":"2023-10-03T19:12:28.954915+0000","last_peered":"2023-10-03T19:12:28.954915+0000","last_clean":"2023-10-03T19:12:28.954915+0000","last_became_active":"2023-10-03T19:12:27.586241+0000","last_became_peered":"2023-10-03T19:12:27.586241+0000","last_unstale":"2023-10-03T19:12:28.954915+0000","last_undegraded":"2023-10-03T19:12:28.954915+0000","last_fullsized":"2023-10-03T19:12:28.954915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:23:42.273581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936826+0000","last_change":"2023-10-03T19:12:27.972058+0000","last_active":"2023-10-03T19:12:31.936826+0000","last_peered":"2023-10-03T19:12:31.936826+0000","last_clean":"2023-10-03T19:12:31.936826+0000","last_became_active":"2023-10-03T19:12:27.971770+0000","last_became_peered":"2023-10-03T19:12:27.971770+0000","last_unstale":"2023-10-03T19:12:31.936826+0000","last_undegraded":"2023-10-03T19:12:31.936826+0000","last_fullsized":"2023-10-03T19:12:31.936826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:06:02.160141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952764+0000","last_change":"2023-10-03T19:12:27.595105+0000","last_active":"2023-10-03T19:12:28.952764+0000","last_peered":"2023-10-03T19:12:28.952764+0000","last_clean":"2023-10-03T19:12:28.952764+0000","last_became_active":"2023-10-03T19:12:27.594748+0000","last_became_peered":"2023-10-03T19:12:27.594748+0000","last_unstale":"2023-10-03T19:12:28.952764+0000","last_undegraded":"2023-10-03T19:12:28.952764+0000","last_fullsized":"2023-10-03T19:12:28.952764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:43:24.586460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937036+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:12:31.937036+0000","last_peered":"2023-10-03T19:12:31.937036+0000","last_clean":"2023-10-03T19:12:31.937036+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:12:31.937036+0000","last_undegraded":"2023-10-03T19:12:31.937036+0000","last_fullsized":"2023-10-03T19:12:31.937036+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:50:20.553324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937627+0000","last_change":"2023-10-03T19:12:27.966147+0000","last_active":"2023-10-03T19:12:31.937627+0000","last_peered":"2023-10-03T19:12:31.937627+0000","last_clean":"2023-10-03T19:12:31.937627+0000","last_became_active":"2023-10-03T19:12:27.965865+0000","last_became_peered":"2023-10-03T19:12:27.965865+0000","last_unstale":"2023-10-03T19:12:31.937627+0000","last_undegraded":"2023-10-03T19:12:31.937627+0000","last_fullsized":"2023-10-03T19:12:31.937627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:04:50.005254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936963+0000","last_change":"2023-10-03T19:12:27.581597+0000","last_active":"2023-10-03T19:12:31.936963+0000","last_peered":"2023-10-03T19:12:31.936963+0000","last_clean":"2023-10-03T19:12:31.936963+0000","last_became_active":"2023-10-03T19:12:27.581015+0000","last_became_peered":"2023-10-03T19:12:27.581015+0000","last_unstale":"2023-10-03T19:12:31.936963+0000","last_undegraded":"2023-10-03T19:12:31.936963+0000","last_fullsized":"2023-10-03T19:12:31.936963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:58:40.905233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938993+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:12:31.938993+0000","last_peered":"2023-10-03T19:12:31.938993+0000","last_clean":"2023-10-03T19:12:31.938993+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:12:31.938993+0000","last_undegraded":"2023-10-03T19:12:31.938993+0000","last_fullsized":"2023-10-03T19:12:31.938993+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:13:27.600123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936370+0000","last_change":"2023-10-03T19:12:27.964905+0000","last_active":"2023-10-03T19:12:31.936370+0000","last_peered":"2023-10-03T19:12:31.936370+0000","last_clean":"2023-10-03T19:12:31.936370+0000","last_became_active":"2023-10-03T19:12:27.964614+0000","last_became_peered":"2023-10-03T19:12:27.964614+0000","last_unstale":"2023-10-03T19:12:31.936370+0000","last_undegraded":"2023-10-03T19:12:31.936370+0000","last_fullsized":"2023-10-03T19:12:31.936370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:43:25.596624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.446668+0000","last_change":"2023-10-03T19:12:27.588155+0000","last_active":"2023-10-03T19:12:31.446668+0000","last_peered":"2023-10-03T19:12:31.446668+0000","last_clean":"2023-10-03T19:12:31.446668+0000","last_became_active":"2023-10-03T19:12:27.587340+0000","last_became_peered":"2023-10-03T19:12:27.587340+0000","last_unstale":"2023-10-03T19:12:31.446668+0000","last_undegraded":"2023-10-03T19:12:31.446668+0000","last_fullsized":"2023-10-03T19:12:31.446668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:09:55.002369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937821+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:12:31.937821+0000","last_peered":"2023-10-03T19:12:31.937821+0000","last_clean":"2023-10-03T19:12:31.937821+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:12:31.937821+0000","last_undegraded":"2023-10-03T19:12:31.937821+0000","last_fullsized":"2023-10-03T19:12:31.937821+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:36:31.470355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.445724+0000","last_change":"2023-10-03T19:12:27.977940+0000","last_active":"2023-10-03T19:12:31.445724+0000","last_peered":"2023-10-03T19:12:31.445724+0000","last_clean":"2023-10-03T19:12:31.445724+0000","last_became_active":"2023-10-03T19:12:27.977495+0000","last_became_peered":"2023-10-03T19:12:27.977495+0000","last_unstale":"2023-10-03T19:12:31.445724+0000","last_undegraded":"2023-10-03T19:12:31.445724+0000","last_fullsized":"2023-10-03T19:12:31.445724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:42:03.204018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"22'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.935971+0000","last_change":"2023-10-03T19:12:27.583954+0000","last_active":"2023-10-03T19:12:31.935971+0000","last_peered":"2023-10-03T19:12:31.935971+0000","last_clean":"2023-10-03T19:12:31.935971+0000","last_became_active":"2023-10-03T19:12:27.583313+0000","last_became_peered":"2023-10-03T19:12:27.583313+0000","last_unstale":"2023-10-03T19:12:31.935971+0000","last_undegraded":"2023-10-03T19:12:31.935971+0000","last_fullsized":"2023-10-03T19:12:31.935971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:47:32.332991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938105+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:12:31.938105+0000","last_peered":"2023-10-03T19:12:31.938105+0000","last_clean":"2023-10-03T19:12:31.938105+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:12:31.938105+0000","last_undegraded":"2023-10-03T19:12:31.938105+0000","last_fullsized":"2023-10-03T19:12:31.938105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:56:47.799314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953723+0000","last_change":"2023-10-03T19:12:27.961343+0000","last_active":"2023-10-03T19:12:28.953723+0000","last_peered":"2023-10-03T19:12:28.953723+0000","last_clean":"2023-10-03T19:12:28.953723+0000","last_became_active":"2023-10-03T19:12:27.961065+0000","last_became_peered":"2023-10-03T19:12:27.961065+0000","last_unstale":"2023-10-03T19:12:28.953723+0000","last_undegraded":"2023-10-03T19:12:28.953723+0000","last_fullsized":"2023-10-03T19:12:28.953723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:50:25.785249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954854+0000","last_change":"2023-10-03T19:12:27.975142+0000","last_active":"2023-10-03T19:12:28.954854+0000","last_peered":"2023-10-03T19:12:28.954854+0000","last_clean":"2023-10-03T19:12:28.954854+0000","last_became_active":"2023-10-03T19:12:27.974173+0000","last_became_peered":"2023-10-03T19:12:27.974173+0000","last_unstale":"2023-10-03T19:12:28.954854+0000","last_undegraded":"2023-10-03T19:12:28.954854+0000","last_fullsized":"2023-10-03T19:12:28.954854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:02:44.729572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'6","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953832+0000","last_change":"2023-10-03T19:12:27.586506+0000","last_active":"2023-10-03T19:12:28.953832+0000","last_peered":"2023-10-03T19:12:28.953832+0000","last_clean":"2023-10-03T19:12:28.953832+0000","last_became_active":"2023-10-03T19:12:27.585847+0000","last_became_peered":"2023-10-03T19:12:27.585847+0000","last_unstale":"2023-10-03T19:12:28.953832+0000","last_undegraded":"2023-10-03T19:12:28.953832+0000","last_fullsized":"2023-10-03T19:12:28.953832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:33:53.378803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937279+0000","last_change":"2023-10-03T19:12:27.973591+0000","last_active":"2023-10-03T19:12:31.937279+0000","last_peered":"2023-10-03T19:12:31.937279+0000","last_clean":"2023-10-03T19:12:31.937279+0000","last_became_active":"2023-10-03T19:12:27.973308+0000","last_became_peered":"2023-10-03T19:12:27.973308+0000","last_unstale":"2023-10-03T19:12:31.937279+0000","last_undegraded":"2023-10-03T19:12:31.937279+0000","last_fullsized":"2023-10-03T19:12:31.937279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:40:40.179631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.938677+0000","last_change":"2023-10-03T19:12:27.595373+0000","last_active":"2023-10-03T19:12:31.938677+0000","last_peered":"2023-10-03T19:12:31.938677+0000","last_clean":"2023-10-03T19:12:31.938677+0000","last_became_active":"2023-10-03T19:12:27.594761+0000","last_became_peered":"2023-10-03T19:12:27.594761+0000","last_unstale":"2023-10-03T19:12:31.938677+0000","last_undegraded":"2023-10-03T19:12:31.938677+0000","last_fullsized":"2023-10-03T19:12:31.938677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:23:42.273581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952982+0000","last_change":"2023-10-03T19:12:27.585305+0000","last_active":"2023-10-03T19:12:28.952982+0000","last_peered":"2023-10-03T19:12:28.952982+0000","last_clean":"2023-10-03T19:12:28.952982+0000","last_became_active":"2023-10-03T19:12:27.584635+0000","last_became_peered":"2023-10-03T19:12:27.584635+0000","last_unstale":"2023-10-03T19:12:28.952982+0000","last_undegraded":"2023-10-03T19:12:28.952982+0000","last_fullsized":"2023-10-03T19:12:28.952982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:37:44.604456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.446061+0000","last_change":"2023-10-03T19:12:27.978707+0000","last_active":"2023-10-03T19:12:31.446061+0000","last_peered":"2023-10-03T19:12:31.446061+0000","last_clean":"2023-10-03T19:12:31.446061+0000","last_became_active":"2023-10-03T19:12:27.978433+0000","last_became_peered":"2023-10-03T19:12:27.978433+0000","last_unstale":"2023-10-03T19:12:31.446061+0000","last_undegraded":"2023-10-03T19:12:31.446061+0000","last_fullsized":"2023-10-03T19:12:31.446061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:50:25.785249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936984+0000","last_change":"2023-10-03T19:12:27.592047+0000","last_active":"2023-10-03T19:12:31.936984+0000","last_peered":"2023-10-03T19:12:31.936984+0000","last_clean":"2023-10-03T19:12:31.936984+0000","last_became_active":"2023-10-03T19:12:27.591625+0000","last_became_peered":"2023-10-03T19:12:27.591625+0000","last_unstale":"2023-10-03T19:12:31.936984+0000","last_undegraded":"2023-10-03T19:12:31.936984+0000","last_fullsized":"2023-10-03T19:12:31.936984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:29:17.697265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.445602+0000","last_change":"2023-10-03T19:12:27.982932+0000","last_active":"2023-10-03T19:12:31.445602+0000","last_peered":"2023-10-03T19:12:31.445602+0000","last_clean":"2023-10-03T19:12:31.445602+0000","last_became_active":"2023-10-03T19:12:27.982612+0000","last_became_peered":"2023-10-03T19:12:27.982612+0000","last_unstale":"2023-10-03T19:12:31.445602+0000","last_undegraded":"2023-10-03T19:12:31.445602+0000","last_fullsized":"2023-10-03T19:12:31.445602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:08:38.248650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937987+0000","last_change":"2023-10-03T19:12:27.974833+0000","last_active":"2023-10-03T19:12:31.937987+0000","last_peered":"2023-10-03T19:12:31.937987+0000","last_clean":"2023-10-03T19:12:31.937987+0000","last_became_active":"2023-10-03T19:12:27.973932+0000","last_became_peered":"2023-10-03T19:12:27.973932+0000","last_unstale":"2023-10-03T19:12:31.937987+0000","last_undegraded":"2023-10-03T19:12:31.937987+0000","last_fullsized":"2023-10-03T19:12:31.937987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:20:24.642279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.445787+0000","last_change":"2023-10-03T19:12:27.592021+0000","last_active":"2023-10-03T19:12:31.445787+0000","last_peered":"2023-10-03T19:12:31.445787+0000","last_clean":"2023-10-03T19:12:31.445787+0000","last_became_active":"2023-10-03T19:12:27.589194+0000","last_became_peered":"2023-10-03T19:12:27.589194+0000","last_unstale":"2023-10-03T19:12:31.445787+0000","last_undegraded":"2023-10-03T19:12:31.445787+0000","last_fullsized":"2023-10-03T19:12:31.445787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:02:27.868659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.935544+0000","last_change":"2023-10-03T19:12:27.978101+0000","last_active":"2023-10-03T19:12:31.935544+0000","last_peered":"2023-10-03T19:12:31.935544+0000","last_clean":"2023-10-03T19:12:31.935544+0000","last_became_active":"2023-10-03T19:12:27.977700+0000","last_became_peered":"2023-10-03T19:12:27.977700+0000","last_unstale":"2023-10-03T19:12:31.935544+0000","last_undegraded":"2023-10-03T19:12:31.935544+0000","last_fullsized":"2023-10-03T19:12:31.935544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:08:48.595519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936430+0000","last_change":"2023-10-03T19:12:27.578433+0000","last_active":"2023-10-03T19:12:31.936430+0000","last_peered":"2023-10-03T19:12:31.936430+0000","last_clean":"2023-10-03T19:12:31.936430+0000","last_became_active":"2023-10-03T19:12:27.577627+0000","last_became_peered":"2023-10-03T19:12:27.577627+0000","last_unstale":"2023-10-03T19:12:31.936430+0000","last_undegraded":"2023-10-03T19:12:31.936430+0000","last_fullsized":"2023-10-03T19:12:31.936430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:42:02.193854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.446282+0000","last_change":"2023-10-03T19:12:27.983570+0000","last_active":"2023-10-03T19:12:31.446282+0000","last_peered":"2023-10-03T19:12:31.446282+0000","last_clean":"2023-10-03T19:12:31.446282+0000","last_became_active":"2023-10-03T19:12:27.983296+0000","last_became_peered":"2023-10-03T19:12:27.983296+0000","last_unstale":"2023-10-03T19:12:31.446282+0000","last_undegraded":"2023-10-03T19:12:31.446282+0000","last_fullsized":"2023-10-03T19:12:31.446282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:04:50.005254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953770+0000","last_change":"2023-10-03T19:12:27.577852+0000","last_active":"2023-10-03T19:12:28.953770+0000","last_peered":"2023-10-03T19:12:28.953770+0000","last_clean":"2023-10-03T19:12:28.953770+0000","last_became_active":"2023-10-03T19:12:27.576792+0000","last_became_peered":"2023-10-03T19:12:27.576792+0000","last_unstale":"2023-10-03T19:12:28.953770+0000","last_undegraded":"2023-10-03T19:12:28.953770+0000","last_fullsized":"2023-10-03T19:12:28.953770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:40:39.169467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.947561+0000","last_change":"2023-10-03T19:12:27.983619+0000","last_active":"2023-10-03T19:12:28.947561+0000","last_peered":"2023-10-03T19:12:28.947561+0000","last_clean":"2023-10-03T19:12:28.947561+0000","last_became_active":"2023-10-03T19:12:27.983185+0000","last_became_peered":"2023-10-03T19:12:27.983185+0000","last_unstale":"2023-10-03T19:12:28.947561+0000","last_undegraded":"2023-10-03T19:12:28.947561+0000","last_fullsized":"2023-10-03T19:12:28.947561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:02:11.328680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.937025+0000","last_change":"2023-10-03T19:12:27.593678+0000","last_active":"2023-10-03T19:12:31.937025+0000","last_peered":"2023-10-03T19:12:31.937025+0000","last_clean":"2023-10-03T19:12:31.937025+0000","last_became_active":"2023-10-03T19:12:27.593376+0000","last_became_peered":"2023-10-03T19:12:27.593376+0000","last_unstale":"2023-10-03T19:12:31.937025+0000","last_undegraded":"2023-10-03T19:12:31.937025+0000","last_fullsized":"2023-10-03T19:12:31.937025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:51:22.870713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.954797+0000","last_change":"2023-10-03T19:12:27.962395+0000","last_active":"2023-10-03T19:12:28.954797+0000","last_peered":"2023-10-03T19:12:28.954797+0000","last_clean":"2023-10-03T19:12:28.954797+0000","last_became_active":"2023-10-03T19:12:27.962105+0000","last_became_peered":"2023-10-03T19:12:27.962105+0000","last_unstale":"2023-10-03T19:12:28.954797+0000","last_undegraded":"2023-10-03T19:12:28.954797+0000","last_fullsized":"2023-10-03T19:12:28.954797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:51:28.867821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952027+0000","last_change":"2023-10-03T19:12:27.588675+0000","last_active":"2023-10-03T19:12:28.952027+0000","last_peered":"2023-10-03T19:12:28.952027+0000","last_clean":"2023-10-03T19:12:28.952027+0000","last_became_active":"2023-10-03T19:12:27.588046+0000","last_became_peered":"2023-10-03T19:12:27.588046+0000","last_unstale":"2023-10-03T19:12:28.952027+0000","last_undegraded":"2023-10-03T19:12:28.952027+0000","last_fullsized":"2023-10-03T19:12:28.952027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:08:47.585355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.953482+0000","last_change":"2023-10-03T19:12:27.965478+0000","last_active":"2023-10-03T19:12:28.953482+0000","last_peered":"2023-10-03T19:12:28.953482+0000","last_clean":"2023-10-03T19:12:28.953482+0000","last_became_active":"2023-10-03T19:12:27.964064+0000","last_became_peered":"2023-10-03T19:12:27.964064+0000","last_unstale":"2023-10-03T19:12:28.953482+0000","last_undegraded":"2023-10-03T19:12:28.953482+0000","last_fullsized":"2023-10-03T19:12:28.953482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:02:28.878823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.952596+0000","last_change":"2023-10-03T19:12:27.587343+0000","last_active":"2023-10-03T19:12:28.952596+0000","last_peered":"2023-10-03T19:12:28.952596+0000","last_clean":"2023-10-03T19:12:28.952596+0000","last_became_active":"2023-10-03T19:12:27.586953+0000","last_became_peered":"2023-10-03T19:12:27.586953+0000","last_unstale":"2023-10-03T19:12:28.952596+0000","last_undegraded":"2023-10-03T19:12:28.952596+0000","last_fullsized":"2023-10-03T19:12:28.952596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:01:57.712265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.446178+0000","last_change":"2023-10-03T19:12:27.970441+0000","last_active":"2023-10-03T19:12:31.446178+0000","last_peered":"2023-10-03T19:12:31.446178+0000","last_clean":"2023-10-03T19:12:31.446178+0000","last_became_active":"2023-10-03T19:12:27.970137+0000","last_became_peered":"2023-10-03T19:12:27.970137+0000","last_unstale":"2023-10-03T19:12:31.446178+0000","last_undegraded":"2023-10-03T19:12:31.446178+0000","last_fullsized":"2023-10-03T19:12:31.446178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:39:07.804995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.446174+0000","last_change":"2023-10-03T19:12:27.586020+0000","last_active":"2023-10-03T19:12:31.446174+0000","last_peered":"2023-10-03T19:12:31.446174+0000","last_clean":"2023-10-03T19:12:31.446174+0000","last_became_active":"2023-10-03T19:12:27.585736+0000","last_became_peered":"2023-10-03T19:12:27.585736+0000","last_unstale":"2023-10-03T19:12:31.446174+0000","last_undegraded":"2023-10-03T19:12:31.446174+0000","last_fullsized":"2023-10-03T19:12:31.446174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:33:53.378803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:28.951761+0000","last_change":"2023-10-03T19:12:27.986822+0000","last_active":"2023-10-03T19:12:28.951761+0000","last_peered":"2023-10-03T19:12:28.951761+0000","last_clean":"2023-10-03T19:12:28.951761+0000","last_became_active":"2023-10-03T19:12:27.986532+0000","last_became_peered":"2023-10-03T19:12:27.986532+0000","last_unstale":"2023-10-03T19:12:28.951761+0000","last_undegraded":"2023-10-03T19:12:28.951761+0000","last_fullsized":"2023-10-03T19:12:28.951761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:27.537046+0000","last_clean_scrub_stamp":"2023-10-03T19:12:27.537046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:20:24.642279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'4","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-03T19:12:31.936684+0000","last_change":"2023-10-03T19:12:27.591787+0000","last_active":"2023-10-03T19:12:31.936684+0000","last_peered":"2023-10-03T19:12:31.936684+0000","last_clean":"2023-10-03T19:12:31.936684+0000","last_became_active":"2023-10-03T19:12:27.591472+0000","last_became_peered":"2023-10-03T19:12:27.591472+0000","last_unstale":"2023-10-03T19:12:31.936684+0000","last_undegraded":"2023-10-03T19:12:31.936684+0000","last_fullsized":"2023-10-03T19:12:31.936684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:26.526882+0000","last_clean_scrub_stamp":"2023-10-03T19:12:26.526882+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:37:44.604456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8956,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362884,"statfs":{"total":96636764160,"available":96627593216,"internally_reserved":0,"allocated":315392,"data_stored":673718,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2130000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8348,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363492,"statfs":{"total":96636764160,"available":96628215808,"internally_reserved":0,"allocated":217088,"data_stored":80406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8436,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363404,"statfs":{"total":96636764160,"available":96628125696,"internally_reserved":0,"allocated":241664,"data_stored":83190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12444,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":12224,"kb_avail":94359396,"statfs":{"total":96636764160,"available":96624021504,"internally_reserved":0,"allocated":217088,"data_stored":80406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12517376},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8416,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363424,"statfs":{"total":96636764160,"available":96628146176,"internally_reserved":0,"allocated":221184,"data_stored":81570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8420,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363420,"statfs":{"total":96636764160,"available":96628142080,"internally_reserved":0,"allocated":225280,"data_stored":81660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2849999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8360,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363480,"statfs":{"total":96636764160,"available":96628203520,"internally_reserved":0,"allocated":229376,"data_stored":82222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13024,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":12736,"kb_avail":94358816,"statfs":{"total":96636764160,"available":96623427584,"internally_reserved":0,"allocated":286720,"data_stored":671356,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":13041664},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:12:39.481 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-03T19:12:39.481 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-03T19:12:39.481 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-03T19:12:39.481 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-03T19:12:39.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.629+0000 7fb90b778640 1 Processor -- start 2023-10-03T19:12:39.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb90b778640 1 -- start start 2023-10-03T19:12:39.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb90b778640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb9040bcb60 0x7fb90406c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:39.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb90b778640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb90414b610 con 0x7fb90406c7d0 2023-10-03T19:12:39.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb90b778640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9040a5580 con 0x7fb904148b90 2023-10-03T19:12:39.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb90b778640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9040a3670 con 0x7fb9040bcb60 2023-10-03T19:12:39.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb909d15640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb90406c7d0 0x7fb904155cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33524/0 (socket says 172.21.15.45:33524) 2023-10-03T19:12:39.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb909d15640 1 -- 172.21.15.45:0/1765180610 learned_addr learned my addr 172.21.15.45:0/1765180610 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:39.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb8fbfff640 1 -- 172.21.15.45:0/1765180610 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 867639014 0 0) 0x7fb90414b610 con 0x7fb90406c7d0 2023-10-03T19:12:39.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb8fbfff640 1 -- 172.21.15.45:0/1765180610 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8f0003530 con 0x7fb90406c7d0 2023-10-03T19:12:39.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb908d13640 1 --2- 172.21.15.45:0/1765180610 >> v2:172.21.15.79:3300/0 conn(0x7fb9040bcb60 0x7fb90406c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:39.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb8fbfff640 1 -- 172.21.15.45:0/1765180610 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 350922158 0 0) 0x7fb8f0003530 con 0x7fb90406c7d0 2023-10-03T19:12:39.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb8fbfff640 1 -- 172.21.15.45:0/1765180610 >> v2:172.21.15.79:3300/0 conn(0x7fb9040bcb60 msgr2=0x7fb90406c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:39.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb8fbfff640 1 --2- 172.21.15.45:0/1765180610 >> v2:172.21.15.79:3300/0 conn(0x7fb9040bcb60 0x7fb90406c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:39.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb8fbfff640 1 -- 172.21.15.45:0/1765180610 >> v1:172.21.15.79:6789/0 conn(0x7fb904148b90 legacy=0x7fb9040bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:39.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb8fbfff640 1 -- 172.21.15.45:0/1765180610 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9040a5820 con 0x7fb90406c7d0 2023-10-03T19:12:39.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb8fbfff640 1 -- 172.21.15.45:0/1765180610 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fb8fc001a00 con 0x7fb90406c7d0 2023-10-03T19:12:39.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb8fbfff640 1 -- 172.21.15.45:0/1765180610 >> v1:172.21.15.45:6789/0 conn(0x7fb90406c7d0 legacy=0x7fb904155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:39.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb8fbfff640 1 --2- 172.21.15.45:0/1765180610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb8f0003980 0x7fb8f0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:39.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb8fbfff640 1 --2- 172.21.15.45:0/1765180610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8f00047d0 0x7fb8f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:39.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb8fbfff640 1 --2- 172.21.15.45:0/1765180610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f0005180 0x7fb8f000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:39.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb8fbfff640 1 -- 172.21.15.45:0/1765180610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9040a3670 con 0x7fb8f0005180 2023-10-03T19:12:39.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb8fbfff640 1 -- 172.21.15.45:0/1765180610 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f000c0f0 con 0x7fb8f00047d0 2023-10-03T19:12:39.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb8fbfff640 1 -- 172.21.15.45:0/1765180610 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f000c2b0 con 0x7fb8f0003980 2023-10-03T19:12:39.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb909d15640 1 --2- 172.21.15.45:0/1765180610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f0005180 0x7fb8f000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:39.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb909514640 1 --2- 172.21.15.45:0/1765180610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb8f0003980 0x7fb8f0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:39.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb908d13640 1 --2- 172.21.15.45:0/1765180610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8f00047d0 0x7fb8f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:39.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb909d15640 1 -- 172.21.15.45:0/1765180610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb8f0003980 msgr2=0x7fb8f0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:39.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb909d15640 1 --2- 172.21.15.45:0/1765180610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb8f0003980 0x7fb8f0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:39.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb909d15640 1 -- 172.21.15.45:0/1765180610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8f00047d0 msgr2=0x7fb8f0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:39.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb909d15640 1 --2- 172.21.15.45:0/1765180610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8f00047d0 0x7fb8f0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:39.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.633+0000 7fb909d15640 1 -- 172.21.15.45:0/1765180610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f0003530 con 0x7fb8f0005180 2023-10-03T19:12:39.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb909d15640 1 -- 172.21.15.45:0/1765180610 reap_dead start 2023-10-03T19:12:39.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb909d15640 1 --2- 172.21.15.45:0/1765180610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f0005180 0x7fb8f000b990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc00a830 tx=0x7fb8fc01d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef330e56451c3000 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:39.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb8fbfff640 1 -- 172.21.15.45:0/1765180610 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc0072d0 con 0x7fb8f0005180 2023-10-03T19:12:39.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb8fbfff640 1 -- 172.21.15.45:0/1765180610 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8fc0a8070 con 0x7fb8f0005180 2023-10-03T19:12:39.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb8fbfff640 1 -- 172.21.15.45:0/1765180610 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc0076b0 con 0x7fb8f0005180 2023-10-03T19:12:39.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb90b778640 1 -- 172.21.15.45:0/1765180610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f0005180 msgr2=0x7fb8f000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:39.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb90b778640 1 --2- 172.21.15.45:0/1765180610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f0005180 0x7fb8f000b990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc00a830 tx=0x7fb8fc01d340 comp rx=0 tx=0).stop 2023-10-03T19:12:39.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb90b778640 1 -- 172.21.15.45:0/1765180610 shutdown_connections 2023-10-03T19:12:39.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb90b778640 1 --2- 172.21.15.45:0/1765180610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f0005180 0x7fb8f000b990 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:39.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb90b778640 1 -- 172.21.15.45:0/1765180610 >> 172.21.15.45:0/1765180610 conn(0x7fb9040bcf50 msgr2=0x7fb9040bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:39.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb90b778640 1 -- 172.21.15.45:0/1765180610 shutdown_connections 2023-10-03T19:12:39.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb90b778640 1 -- 172.21.15.45:0/1765180610 wait complete. 2023-10-03T19:12:39.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb90b778640 1 Processor -- start 2023-10-03T19:12:39.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb90b778640 1 -- start start 2023-10-03T19:12:39.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb90b778640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f0005180 0x7fb90409b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:39.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb90b778640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb90414a1a0 0x7fb9041e3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:39.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb90b778640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9041e3a70 0x7fb9041475f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:39.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb90b778640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb904099aa0 con 0x7fb8f0005180 2023-10-03T19:12:39.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb90b778640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9040beaf0 con 0x7fb9041e3a70 2023-10-03T19:12:39.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb90b778640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9041e3f10 con 0x7fb90414a1a0 2023-10-03T19:12:39.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb909514640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f0005180 0x7fb90409b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:39.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb909514640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f0005180 0x7fb90409b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41834/0 (socket says 172.21.15.45:41834) 2023-10-03T19:12:39.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb909514640 1 -- 172.21.15.45:0/2710635547 learned_addr learned my addr 172.21.15.45:0/2710635547 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:39.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb908d13640 1 --2- 172.21.15.45:0/2710635547 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb90414a1a0 0x7fb9041e3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:39.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb909d15640 1 --2- 172.21.15.45:0/2710635547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9041e3a70 0x7fb9041475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:39.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb909514640 1 -- 172.21.15.45:0/2710635547 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb90414a1a0 msgr2=0x7fb9041e3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:39.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb909514640 1 --2- 172.21.15.45:0/2710635547 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb90414a1a0 0x7fb9041e3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:39.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb909514640 1 -- 172.21.15.45:0/2710635547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9041e3a70 msgr2=0x7fb9041475f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:39.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb909514640 1 --2- 172.21.15.45:0/2710635547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9041e3a70 0x7fb9041475f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:39.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb909514640 1 -- 172.21.15.45:0/2710635547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9040a3880 con 0x7fb8f0005180 2023-10-03T19:12:39.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb908d13640 1 --2- 172.21.15.45:0/2710635547 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb90414a1a0 0x7fb9041e3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:39.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb909d15640 1 --2- 172.21.15.45:0/2710635547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9041e3a70 0x7fb9041475f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:39.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb909514640 1 --2- 172.21.15.45:0/2710635547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f0005180 0x7fb90409b200 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb90000e4b0 tx=0x7fb90000e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:39.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb8f9ffb640 1 -- 172.21.15.45:0/2710635547 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9000052e0 con 0x7fb8f0005180 2023-10-03T19:12:39.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb8f9ffb640 1 -- 172.21.15.45:0/2710635547 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb900005440 con 0x7fb8f0005180 2023-10-03T19:12:39.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb8f9ffb640 1 -- 172.21.15.45:0/2710635547 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb900003840 con 0x7fb8f0005180 2023-10-03T19:12:39.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb90b778640 1 -- 172.21.15.45:0/2710635547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb904148f60 con 0x7fb8f0005180 2023-10-03T19:12:39.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.637+0000 7fb90b778640 1 -- 172.21.15.45:0/2710635547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9040a3c30 con 0x7fb8f0005180 2023-10-03T19:12:39.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.641+0000 7fb90b778640 1 -- 172.21.15.45:0/2710635547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb90404de80 con 0x7fb8f0005180 2023-10-03T19:12:39.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.641+0000 7fb8f9ffb640 1 -- 172.21.15.45:0/2710635547 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb9000039a0 con 0x7fb8f0005180 2023-10-03T19:12:39.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.641+0000 7fb8f9ffb640 1 --2- 172.21.15.45:0/2710635547 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb8e80662b0 0x7fb8e8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:39.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.641+0000 7fb8f9ffb640 1 -- 172.21.15.45:0/2710635547 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb900083a30 con 0x7fb8f0005180 2023-10-03T19:12:39.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.641+0000 7fb908d13640 1 --2- 172.21.15.45:0/2710635547 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb8e80662b0 0x7fb8e8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:39.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.641+0000 7fb908d13640 1 --2- 172.21.15.45:0/2710635547 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb8e80662b0 0x7fb8e8068760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb904098ae0 tx=0x7fb8f4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:39.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.645+0000 7fb8f9ffb640 1 -- 172.21.15.45:0/2710635547 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb9000549f0 con 0x7fb8f0005180 2023-10-03T19:12:39.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.825+0000 7fb90b778640 1 -- 172.21.15.45:0/2710635547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb904098d80 con 0x7fb8f0005180 2023-10-03T19:12:39.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.825+0000 7fb8f9ffb640 1 -- 172.21.15.45:0/2710635547 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fb900054580 con 0x7fb8f0005180 2023-10-03T19:12:39.828 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:39.828 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-03T19:12:39.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.825+0000 7fb90b778640 1 -- 172.21.15.45:0/2710635547 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb8e80662b0 msgr2=0x7fb8e8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:39.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.825+0000 7fb90b778640 1 --2- 172.21.15.45:0/2710635547 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb8e80662b0 0x7fb8e8068760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb904098ae0 tx=0x7fb8f4008040 comp rx=0 tx=0).stop 2023-10-03T19:12:39.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.825+0000 7fb90b778640 1 -- 172.21.15.45:0/2710635547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f0005180 msgr2=0x7fb90409b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:39.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.825+0000 7fb90b778640 1 --2- 172.21.15.45:0/2710635547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f0005180 0x7fb90409b200 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb90000e4b0 tx=0x7fb90000e970 comp rx=0 tx=0).stop 2023-10-03T19:12:39.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.825+0000 7fb90b778640 1 -- 172.21.15.45:0/2710635547 shutdown_connections 2023-10-03T19:12:39.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.825+0000 7fb90b778640 1 --2- 172.21.15.45:0/2710635547 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb8e80662b0 0x7fb8e8068760 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:39.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.825+0000 7fb90b778640 1 --2- 172.21.15.45:0/2710635547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9041e3a70 0x7fb9041475f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:39.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.825+0000 7fb90b778640 1 --2- 172.21.15.45:0/2710635547 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb90414a1a0 0x7fb9041e3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:39.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.825+0000 7fb90b778640 1 --2- 172.21.15.45:0/2710635547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f0005180 0x7fb90409b200 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:39.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.825+0000 7fb90b778640 1 -- 172.21.15.45:0/2710635547 >> 172.21.15.45:0/2710635547 conn(0x7fb9040bcf50 msgr2=0x7fb90406cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:39.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.825+0000 7fb90b778640 1 -- 172.21.15.45:0/2710635547 shutdown_connections 2023-10-03T19:12:39.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.825+0000 7fb90b778640 1 -- 172.21.15.45:0/2710635547 wait complete. 2023-10-03T19:12:39.846 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-03T19:12:39.846 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:12:39.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.965+0000 7f8a4d408640 1 Processor -- start 2023-10-03T19:12:39.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.965+0000 7f8a4d408640 1 -- start start 2023-10-03T19:12:39.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.969+0000 7f8a4d408640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8a480bc8b0 0x7f8a4814ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:39.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.969+0000 7f8a4d408640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8a4806d170 0x7f8a4814cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:39.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.969+0000 7f8a4d408640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a4806cac0 con 0x7f8a4806f170 2023-10-03T19:12:39.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.969+0000 7f8a4d408640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a4814d4f0 con 0x7f8a480bc8b0 2023-10-03T19:12:39.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.969+0000 7f8a4d408640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a480720d0 con 0x7f8a4806d170 2023-10-03T19:12:39.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.969+0000 7f8a467fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8a480bc8b0 0x7f8a4814ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:39.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.969+0000 7f8a46ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8a4806f170 0x7f8a48150190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33536/0 (socket says 172.21.15.45:33536) 2023-10-03T19:12:39.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.969+0000 7f8a46ffd640 1 -- 172.21.15.45:0/4005408571 learned_addr learned my addr 172.21.15.45:0/4005408571 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:39.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.969+0000 7f8a477fe640 1 --2- 172.21.15.45:0/4005408571 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8a4806d170 0x7f8a4814cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:39.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.969+0000 7f8a467fc640 1 -- 172.21.15.45:0/4005408571 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8a4806d170 msgr2=0x7f8a4814cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:39.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.969+0000 7f8a467fc640 1 --2- 172.21.15.45:0/4005408571 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8a4806d170 0x7f8a4814cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:39.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.969+0000 7f8a467fc640 1 -- 172.21.15.45:0/4005408571 >> v1:172.21.15.45:6789/0 conn(0x7f8a4806f170 legacy=0x7f8a48150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:39.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.969+0000 7f8a467fc640 1 -- 172.21.15.45:0/4005408571 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a480a5ab0 con 0x7f8a480bc8b0 2023-10-03T19:12:39.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.969+0000 7f8a477fe640 1 --2- 172.21.15.45:0/4005408571 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8a4806d170 0x7f8a4814cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:39.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.969+0000 7f8a467fc640 1 --2- 172.21.15.45:0/4005408571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a480bc8b0 0x7f8a4814ca70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c0097c0 tx=0x7f8a3c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3219c93fad9c3b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:39.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.969+0000 7f8a45ffb640 1 -- 172.21.15.45:0/4005408571 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c0a8970 con 0x7f8a480bc8b0 2023-10-03T19:12:39.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.969+0000 7f8a45ffb640 1 -- 172.21.15.45:0/4005408571 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3c0a8ad0 con 0x7f8a480bc8b0 2023-10-03T19:12:39.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.969+0000 7f8a45ffb640 1 -- 172.21.15.45:0/4005408571 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c0a8e60 con 0x7f8a480bc8b0 2023-10-03T19:12:39.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.969+0000 7f8a4d408640 1 -- 172.21.15.45:0/4005408571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a480bc8b0 msgr2=0x7f8a4814ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:39.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.969+0000 7f8a4d408640 1 --2- 172.21.15.45:0/4005408571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a480bc8b0 0x7f8a4814ca70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c0097c0 tx=0x7f8a3c01ec70 comp rx=0 tx=0).stop 2023-10-03T19:12:39.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.969+0000 7f8a4d408640 1 -- 172.21.15.45:0/4005408571 shutdown_connections 2023-10-03T19:12:39.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.969+0000 7f8a4d408640 1 --2- 172.21.15.45:0/4005408571 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8a4806d170 0x7f8a4814cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:39.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.969+0000 7f8a4d408640 1 --2- 172.21.15.45:0/4005408571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a480bc8b0 0x7f8a4814ca70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:39.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.969+0000 7f8a4d408640 1 -- 172.21.15.45:0/4005408571 >> 172.21.15.45:0/4005408571 conn(0x7f8a480bcf50 msgr2=0x7f8a480bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:39.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.969+0000 7f8a4d408640 1 -- 172.21.15.45:0/4005408571 shutdown_connections 2023-10-03T19:12:39.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.969+0000 7f8a4d408640 1 -- 172.21.15.45:0/4005408571 wait complete. 2023-10-03T19:12:39.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.973+0000 7f8a4d408640 1 Processor -- start 2023-10-03T19:12:39.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.973+0000 7f8a4d408640 1 -- start start 2023-10-03T19:12:39.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.973+0000 7f8a4d408640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a4806d170 0x7f8a4809d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:39.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.973+0000 7f8a4d408640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8a4806f170 0x7f8a4809c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:39.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.973+0000 7f8a4d408640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a480bc8b0 0x7f8a48098950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:39.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.973+0000 7f8a4d408640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4809c450 con 0x7f8a4806d170 2023-10-03T19:12:39.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.973+0000 7f8a4d408640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4809a9c0 con 0x7f8a480bc8b0 2023-10-03T19:12:39.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.973+0000 7f8a4d408640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4809aca0 con 0x7f8a4806f170 2023-10-03T19:12:39.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.973+0000 7f8a46ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a4806d170 0x7f8a4809d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:39.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.973+0000 7f8a46ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a4806d170 0x7f8a4809d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41846/0 (socket says 172.21.15.45:41846) 2023-10-03T19:12:39.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.973+0000 7f8a46ffd640 1 -- 172.21.15.45:0/3320840060 learned_addr learned my addr 172.21.15.45:0/3320840060 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:39.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.973+0000 7f8a477fe640 1 --2- 172.21.15.45:0/3320840060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a480bc8b0 0x7f8a48098950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:39.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.973+0000 7f8a467fc640 1 --2- 172.21.15.45:0/3320840060 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8a4806f170 0x7f8a4809c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:39.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.973+0000 7f8a46ffd640 1 -- 172.21.15.45:0/3320840060 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8a4806f170 msgr2=0x7f8a4809c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:39.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.973+0000 7f8a46ffd640 1 --2- 172.21.15.45:0/3320840060 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8a4806f170 0x7f8a4809c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:39.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.973+0000 7f8a46ffd640 1 -- 172.21.15.45:0/3320840060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a480bc8b0 msgr2=0x7f8a48098950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:39.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.973+0000 7f8a46ffd640 1 --2- 172.21.15.45:0/3320840060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a480bc8b0 0x7f8a48098950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:39.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.973+0000 7f8a46ffd640 1 -- 172.21.15.45:0/3320840060 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3c009420 con 0x7f8a4806d170 2023-10-03T19:12:39.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.973+0000 7f8a46ffd640 1 --2- 172.21.15.45:0/3320840060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a4806d170 0x7f8a4809d070 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8a3800c500 tx=0x7f8a3800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:39.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.973+0000 7f8a2f7fe640 1 -- 172.21.15.45:0/3320840060 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a38005cf0 con 0x7f8a4806d170 2023-10-03T19:12:39.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.973+0000 7f8a2f7fe640 1 -- 172.21.15.45:0/3320840060 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a38005e50 con 0x7f8a4806d170 2023-10-03T19:12:39.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.973+0000 7f8a2f7fe640 1 -- 172.21.15.45:0/3320840060 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a380072f0 con 0x7f8a4806d170 2023-10-03T19:12:39.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.973+0000 7f8a4d408640 1 -- 172.21.15.45:0/3320840060 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a4814fae0 con 0x7f8a4806d170 2023-10-03T19:12:39.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.973+0000 7f8a4d408640 1 -- 172.21.15.45:0/3320840060 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a4806cd00 con 0x7f8a4806d170 2023-10-03T19:12:39.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.973+0000 7f8a4d408640 1 -- 172.21.15.45:0/3320840060 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a4806d660 con 0x7f8a4806d170 2023-10-03T19:12:39.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.973+0000 7f8a2f7fe640 1 -- 172.21.15.45:0/3320840060 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8a38007450 con 0x7f8a4806d170 2023-10-03T19:12:39.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.977+0000 7f8a2f7fe640 1 --2- 172.21.15.45:0/3320840060 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8a34066280 0x7f8a34068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:39.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.977+0000 7f8a2f7fe640 1 -- 172.21.15.45:0/3320840060 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8a38082fe0 con 0x7f8a4806d170 2023-10-03T19:12:39.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.977+0000 7f8a467fc640 1 --2- 172.21.15.45:0/3320840060 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8a34066280 0x7f8a34068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:39.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.977+0000 7f8a467fc640 1 --2- 172.21.15.45:0/3320840060 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8a34066280 0x7f8a34068730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c0b2000 tx=0x7f8a3c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:39.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:39.981+0000 7f8a2f7fe640 1 -- 172.21.15.45:0/3320840060 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8a380505a0 con 0x7f8a4806d170 2023-10-03T19:12:40.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.129+0000 7f8a4d408640 1 -- 172.21.15.45:0/3320840060 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a4809b150 con 0x7f8a4806d170 2023-10-03T19:12:40.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.133+0000 7f8a2f7fe640 1 -- 172.21.15.45:0/3320840060 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18231 (secure 0 0 0) 0x7f8a38017090 con 0x7f8a4806d170 2023-10-03T19:12:40.136 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:40.136 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:12:28.941467+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:12:26.226431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T19:12:26.923174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:12:40.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.133+0000 7f8a4d408640 1 -- 172.21.15.45:0/3320840060 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8a34066280 msgr2=0x7f8a34068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:40.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.133+0000 7f8a4d408640 1 --2- 172.21.15.45:0/3320840060 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8a34066280 0x7f8a34068730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c0b2000 tx=0x7f8a3c008040 comp rx=0 tx=0).stop 2023-10-03T19:12:40.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.133+0000 7f8a4d408640 1 -- 172.21.15.45:0/3320840060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a4806d170 msgr2=0x7f8a4809d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:40.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.133+0000 7f8a4d408640 1 --2- 172.21.15.45:0/3320840060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a4806d170 0x7f8a4809d070 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8a3800c500 tx=0x7f8a3800c9c0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.133+0000 7f8a4d408640 1 -- 172.21.15.45:0/3320840060 shutdown_connections 2023-10-03T19:12:40.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.133+0000 7f8a4d408640 1 --2- 172.21.15.45:0/3320840060 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8a34066280 0x7f8a34068730 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.133+0000 7f8a4d408640 1 --2- 172.21.15.45:0/3320840060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a480bc8b0 0x7f8a48098950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.133+0000 7f8a4d408640 1 --2- 172.21.15.45:0/3320840060 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8a4806f170 0x7f8a4809c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.133+0000 7f8a4d408640 1 --2- 172.21.15.45:0/3320840060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a4806d170 0x7f8a4809d070 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.133+0000 7f8a4d408640 1 -- 172.21.15.45:0/3320840060 >> 172.21.15.45:0/3320840060 conn(0x7f8a480bcf50 msgr2=0x7f8a4814f350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:40.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.133+0000 7f8a4d408640 1 -- 172.21.15.45:0/3320840060 shutdown_connections 2023-10-03T19:12:40.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.133+0000 7f8a4d408640 1 -- 172.21.15.45:0/3320840060 wait complete. 2023-10-03T19:12:40.154 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T19:12:26.226431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T19:12:26.923174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:12:40.155 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:12:40.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.269+0000 7f867b79c640 1 Processor -- start 2023-10-03T19:12:40.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.269+0000 7f867b79c640 1 -- start start 2023-10-03T19:12:40.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.273+0000 7f867b79c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f86740bf1f0 0x7f86740a9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:40.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.273+0000 7f867b79c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f86740c2770 0x7f86740a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:40.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.273+0000 7f867b79c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f867406ac70 con 0x7f86740c14e0 2023-10-03T19:12:40.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.273+0000 7f867b79c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867406aae0 con 0x7f86740bf1f0 2023-10-03T19:12:40.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.273+0000 7f867b79c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86740c3000 con 0x7f86740c2770 2023-10-03T19:12:40.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.273+0000 7f8678d37640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f86740bf1f0 0x7f86740a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:40.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.273+0000 7f8678d37640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f86740bf1f0 0x7f86740a9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41850/0 (socket says 172.21.15.45:41850) 2023-10-03T19:12:40.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.273+0000 7f8678d37640 1 -- 172.21.15.45:0/1669508628 learned_addr learned my addr 172.21.15.45:0/1669508628 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:40.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.273+0000 7f8679d39640 1 --2- 172.21.15.45:0/1669508628 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f86740c2770 0x7f86740a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:40.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.273+0000 7f8678d37640 1 -- 172.21.15.45:0/1669508628 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f86740c2770 msgr2=0x7f86740a9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:40.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.273+0000 7f8678d37640 1 --2- 172.21.15.45:0/1669508628 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f86740c2770 0x7f86740a9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.273+0000 7f8678d37640 1 -- 172.21.15.45:0/1669508628 >> v1:172.21.15.79:6789/0 conn(0x7f86740c14e0 legacy=0x7f86740c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:40.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.273+0000 7f8678d37640 1 -- 172.21.15.45:0/1669508628 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86740aa5f0 con 0x7f86740bf1f0 2023-10-03T19:12:40.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.273+0000 7f8678d37640 1 --2- 172.21.15.45:0/1669508628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86740bf1f0 0x7f86740a9860 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8664009870 tx=0x7f866401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa81cfb6b6d32a57 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:40.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.273+0000 7f866bfff640 1 -- 172.21.15.45:0/1669508628 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86640a8a30 con 0x7f86740bf1f0 2023-10-03T19:12:40.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.273+0000 7f866bfff640 1 -- 172.21.15.45:0/1669508628 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86640a8b90 con 0x7f86740bf1f0 2023-10-03T19:12:40.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.273+0000 7f866bfff640 1 -- 172.21.15.45:0/1669508628 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86640b0440 con 0x7f86740bf1f0 2023-10-03T19:12:40.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f867b79c640 1 -- 172.21.15.45:0/1669508628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86740bf1f0 msgr2=0x7f86740a9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:40.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f867b79c640 1 --2- 172.21.15.45:0/1669508628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86740bf1f0 0x7f86740a9860 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8664009870 tx=0x7f866401ed30 comp rx=0 tx=0).stop 2023-10-03T19:12:40.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f867b79c640 1 -- 172.21.15.45:0/1669508628 shutdown_connections 2023-10-03T19:12:40.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f867b79c640 1 --2- 172.21.15.45:0/1669508628 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f86740c2770 0x7f86740a9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f867b79c640 1 --2- 172.21.15.45:0/1669508628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86740bf1f0 0x7f86740a9860 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f867b79c640 1 -- 172.21.15.45:0/1669508628 >> 172.21.15.45:0/1669508628 conn(0x7f86740a6440 msgr2=0x7f86740a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:40.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f867b79c640 1 -- 172.21.15.45:0/1669508628 shutdown_connections 2023-10-03T19:12:40.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f867b79c640 1 -- 172.21.15.45:0/1669508628 wait complete. 2023-10-03T19:12:40.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f867b79c640 1 Processor -- start 2023-10-03T19:12:40.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f867b79c640 1 -- start start 2023-10-03T19:12:40.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f867b79c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f86740bf1f0 0x7f86741e7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:40.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f867b79c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86740c14e0 0x7f86741e7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:40.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f867b79c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86740c2770 0x7f86741d5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:40.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f867b79c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86740ba990 con 0x7f86740c14e0 2023-10-03T19:12:40.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f867b79c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86740ba4a0 con 0x7f86740c2770 2023-10-03T19:12:40.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f867b79c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86740ba740 con 0x7f86740bf1f0 2023-10-03T19:12:40.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f8678d37640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86740c14e0 0x7f86741e7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:40.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f8678d37640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86740c14e0 0x7f86741e7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41862/0 (socket says 172.21.15.45:41862) 2023-10-03T19:12:40.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f8678d37640 1 -- 172.21.15.45:0/978542432 learned_addr learned my addr 172.21.15.45:0/978542432 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:40.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f8679538640 1 --2- 172.21.15.45:0/978542432 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f86740bf1f0 0x7f86741e7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:40.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f8679d39640 1 --2- 172.21.15.45:0/978542432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86740c2770 0x7f86741d5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:40.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f8678d37640 1 -- 172.21.15.45:0/978542432 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f86740bf1f0 msgr2=0x7f86741e7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:40.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f8678d37640 1 --2- 172.21.15.45:0/978542432 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f86740bf1f0 0x7f86741e7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f8678d37640 1 -- 172.21.15.45:0/978542432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86740c2770 msgr2=0x7f86741d5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:40.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f8678d37640 1 --2- 172.21.15.45:0/978542432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86740c2770 0x7f86741d5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f8678d37640 1 -- 172.21.15.45:0/978542432 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86640094d0 con 0x7f86740c14e0 2023-10-03T19:12:40.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f8679538640 1 --2- 172.21.15.45:0/978542432 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f86740bf1f0 0x7f86741e7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:40.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f8679d39640 1 --2- 172.21.15.45:0/978542432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86740c2770 0x7f86741d5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:40.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f8678d37640 1 --2- 172.21.15.45:0/978542432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86740c14e0 0x7f86741e7670 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f86640b3040 tx=0x7f866401bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:40.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f8669ffb640 1 -- 172.21.15.45:0/978542432 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86640be070 con 0x7f86740c14e0 2023-10-03T19:12:40.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f8669ffb640 1 -- 172.21.15.45:0/978542432 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86640ba400 con 0x7f86740c14e0 2023-10-03T19:12:40.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f867b79c640 1 -- 172.21.15.45:0/978542432 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867414f530 con 0x7f86740c14e0 2023-10-03T19:12:40.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f8669ffb640 1 -- 172.21.15.45:0/978542432 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86640ba7d0 con 0x7f86740c14e0 2023-10-03T19:12:40.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.277+0000 7f867b79c640 1 -- 172.21.15.45:0/978542432 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867414f250 con 0x7f86740c14e0 2023-10-03T19:12:40.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.281+0000 7f867b79c640 1 -- 172.21.15.45:0/978542432 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867406b100 con 0x7f86740c14e0 2023-10-03T19:12:40.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.281+0000 7f8669ffb640 1 -- 172.21.15.45:0/978542432 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f86640c3410 con 0x7f86740c14e0 2023-10-03T19:12:40.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.281+0000 7f8669ffb640 1 --2- 172.21.15.45:0/978542432 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8658066280 0x7f8658068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:40.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.281+0000 7f8669ffb640 1 -- 172.21.15.45:0/978542432 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8664121860 con 0x7f86740c14e0 2023-10-03T19:12:40.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.281+0000 7f8679538640 1 --2- 172.21.15.45:0/978542432 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8658066280 0x7f8658068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:40.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.281+0000 7f8679538640 1 --2- 172.21.15.45:0/978542432 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8658066280 0x7f8658068730 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8670000f70 tx=0x7f8670009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:40.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.285+0000 7f8669ffb640 1 -- 172.21.15.45:0/978542432 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f86640eece0 con 0x7f86740c14e0 2023-10-03T19:12:40.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.429+0000 7f867b79c640 1 -- 172.21.15.45:0/978542432 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f867404de80 con 0x7f86740c14e0 2023-10-03T19:12:40.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.433+0000 7f8669ffb640 1 -- 172.21.15.45:0/978542432 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f86640f2300 con 0x7f86740c14e0 2023-10-03T19:12:40.436 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:12:40.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.433+0000 7f867b79c640 1 -- 172.21.15.45:0/978542432 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8658066280 msgr2=0x7f8658068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:40.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.433+0000 7f867b79c640 1 --2- 172.21.15.45:0/978542432 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8658066280 0x7f8658068730 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8670000f70 tx=0x7f8670009040 comp rx=0 tx=0).stop 2023-10-03T19:12:40.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.433+0000 7f867b79c640 1 -- 172.21.15.45:0/978542432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86740c14e0 msgr2=0x7f86741e7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:40.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.433+0000 7f867b79c640 1 --2- 172.21.15.45:0/978542432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86740c14e0 0x7f86741e7670 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f86640b3040 tx=0x7f866401bad0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.433+0000 7f867b79c640 1 -- 172.21.15.45:0/978542432 shutdown_connections 2023-10-03T19:12:40.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.433+0000 7f867b79c640 1 --2- 172.21.15.45:0/978542432 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8658066280 0x7f8658068730 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.433+0000 7f867b79c640 1 --2- 172.21.15.45:0/978542432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86740c2770 0x7f86741d5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.433+0000 7f867b79c640 1 --2- 172.21.15.45:0/978542432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86740c14e0 0x7f86741e7670 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.433+0000 7f867b79c640 1 --2- 172.21.15.45:0/978542432 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f86740bf1f0 0x7f86741e7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.433+0000 7f867b79c640 1 -- 172.21.15.45:0/978542432 >> 172.21.15.45:0/978542432 conn(0x7f86740a6440 msgr2=0x7f867414c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:40.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.433+0000 7f867b79c640 1 -- 172.21.15.45:0/978542432 shutdown_connections 2023-10-03T19:12:40.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.433+0000 7f867b79c640 1 -- 172.21.15.45:0/978542432 wait complete. 2023-10-03T19:12:40.453 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:12:40.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a7f4e640 1 Processor -- start 2023-10-03T19:12:40.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a7f4e640 1 -- start start 2023-10-03T19:12:40.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a7f4e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f46a006d630 0x7f46a014e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:40.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a7f4e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a00bcf80 con 0x7f46a0148540 2023-10-03T19:12:40.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a7f4e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a00bd260 con 0x7f46a006c1b0 2023-10-03T19:12:40.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a7f4e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a0152b50 con 0x7f46a006d630 2023-10-03T19:12:40.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a5cea640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f46a0148540 0x7f46a00bb060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33538/0 (socket says 172.21.15.45:33538) 2023-10-03T19:12:40.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a5cea640 1 -- 172.21.15.45:0/649951178 learned_addr learned my addr 172.21.15.45:0/649951178 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:40.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a4ce8640 1 -- 172.21.15.45:0/649951178 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2953779863 0 0) 0x7f46a00bcf80 con 0x7f46a0148540 2023-10-03T19:12:40.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a4ce8640 1 -- 172.21.15.45:0/649951178 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f468c003530 con 0x7f46a0148540 2023-10-03T19:12:40.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a54e9640 1 --2- 172.21.15.45:0/649951178 >> v2:172.21.15.79:3300/0 conn(0x7f46a006d630 0x7f46a014e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:40.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a4ce8640 1 -- 172.21.15.45:0/649951178 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3537979634 0 0) 0x7f468c003530 con 0x7f46a0148540 2023-10-03T19:12:40.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a4ce8640 1 -- 172.21.15.45:0/649951178 >> v2:172.21.15.79:3300/0 conn(0x7f46a006d630 msgr2=0x7f46a014e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:40.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a4ce8640 1 --2- 172.21.15.45:0/649951178 >> v2:172.21.15.79:3300/0 conn(0x7f46a006d630 0x7f46a014e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a4ce8640 1 -- 172.21.15.45:0/649951178 >> v1:172.21.15.79:6789/0 conn(0x7f46a006c1b0 legacy=0x7f46a014eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:40.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a4ce8640 1 -- 172.21.15.45:0/649951178 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a00bd540 con 0x7f46a0148540 2023-10-03T19:12:40.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a4ce8640 1 -- 172.21.15.45:0/649951178 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f4698001a00 con 0x7f46a0148540 2023-10-03T19:12:40.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a4ce8640 1 -- 172.21.15.45:0/649951178 >> v1:172.21.15.45:6789/0 conn(0x7f46a0148540 legacy=0x7f46a00bb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:40.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a4ce8640 1 --2- 172.21.15.45:0/649951178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f468c003980 0x7f468c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:40.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a4ce8640 1 --2- 172.21.15.45:0/649951178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f468c0047d0 0x7f468c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:40.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a4ce8640 1 --2- 172.21.15.45:0/649951178 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f468c005180 0x7f468c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:40.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a4ce8640 1 -- 172.21.15.45:0/649951178 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a0152b50 con 0x7f468c003980 2023-10-03T19:12:40.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a4ce8640 1 -- 172.21.15.45:0/649951178 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468c00c110 con 0x7f468c0047d0 2023-10-03T19:12:40.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a4ce8640 1 -- 172.21.15.45:0/649951178 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f468c00c2d0 con 0x7f468c005180 2023-10-03T19:12:40.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a5cea640 1 --2- 172.21.15.45:0/649951178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f468c003980 0x7f468c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:40.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a54e9640 1 --2- 172.21.15.45:0/649951178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f468c0047d0 0x7f468c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:40.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a64eb640 1 --2- 172.21.15.45:0/649951178 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f468c005180 0x7f468c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:40.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a5cea640 1 -- 172.21.15.45:0/649951178 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f468c005180 msgr2=0x7f468c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:40.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a5cea640 1 --2- 172.21.15.45:0/649951178 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f468c005180 0x7f468c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a5cea640 1 -- 172.21.15.45:0/649951178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f468c0047d0 msgr2=0x7f468c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:40.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a5cea640 1 --2- 172.21.15.45:0/649951178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f468c0047d0 0x7f468c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a5cea640 1 -- 172.21.15.45:0/649951178 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468c003530 con 0x7f468c003980 2023-10-03T19:12:40.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.573+0000 7f46a64eb640 1 -- 172.21.15.45:0/649951178 reap_dead start 2023-10-03T19:12:40.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a5cea640 1 --2- 172.21.15.45:0/649951178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f468c003980 0x7f468c003d90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f469800a800 tx=0x7f469801d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68888df2181d916c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:40.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a4ce8640 1 -- 172.21.15.45:0/649951178 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46980072d0 con 0x7f468c003980 2023-10-03T19:12:40.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a4ce8640 1 -- 172.21.15.45:0/649951178 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46980a8070 con 0x7f468c003980 2023-10-03T19:12:40.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a4ce8640 1 -- 172.21.15.45:0/649951178 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4698007690 con 0x7f468c003980 2023-10-03T19:12:40.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a7f4e640 1 -- 172.21.15.45:0/649951178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f468c003980 msgr2=0x7f468c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:40.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a7f4e640 1 --2- 172.21.15.45:0/649951178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f468c003980 0x7f468c003d90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f469800a800 tx=0x7f469801d2e0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a7f4e640 1 -- 172.21.15.45:0/649951178 shutdown_connections 2023-10-03T19:12:40.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a7f4e640 1 --2- 172.21.15.45:0/649951178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f468c003980 0x7f468c003d90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a7f4e640 1 -- 172.21.15.45:0/649951178 >> 172.21.15.45:0/649951178 conn(0x7f46a00a20d0 msgr2=0x7f46a00a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:40.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a7f4e640 1 -- 172.21.15.45:0/649951178 shutdown_connections 2023-10-03T19:12:40.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a7f4e640 1 -- 172.21.15.45:0/649951178 wait complete. 2023-10-03T19:12:40.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a7f4e640 1 Processor -- start 2023-10-03T19:12:40.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a7f4e640 1 -- start start 2023-10-03T19:12:40.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a7f4e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f468c003980 0x7f46a014ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:40.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a7f4e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46a01451a0 0x7f46a00be550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:40.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a7f4e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46a00bea90 0x7f46a0144240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:40.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a7f4e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a01ea970 con 0x7f46a00bea90 2023-10-03T19:12:40.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a7f4e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a0152960 con 0x7f468c003980 2023-10-03T19:12:40.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a7f4e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a014b0d0 con 0x7f46a01451a0 2023-10-03T19:12:40.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a64eb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46a00bea90 0x7f46a0144240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:40.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a64eb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46a00bea90 0x7f46a0144240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41890/0 (socket says 172.21.15.45:41890) 2023-10-03T19:12:40.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a64eb640 1 -- 172.21.15.45:0/3715360301 learned_addr learned my addr 172.21.15.45:0/3715360301 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:40.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a5cea640 1 --2- 172.21.15.45:0/3715360301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f468c003980 0x7f46a014ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:40.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a54e9640 1 --2- 172.21.15.45:0/3715360301 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46a01451a0 0x7f46a00be550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:40.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a64eb640 1 -- 172.21.15.45:0/3715360301 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46a01451a0 msgr2=0x7f46a00be550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:40.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a64eb640 1 --2- 172.21.15.45:0/3715360301 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46a01451a0 0x7f46a00be550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a64eb640 1 -- 172.21.15.45:0/3715360301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f468c003980 msgr2=0x7f46a014ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:40.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a64eb640 1 --2- 172.21.15.45:0/3715360301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f468c003980 0x7f46a014ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a64eb640 1 -- 172.21.15.45:0/3715360301 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a014eb10 con 0x7f46a00bea90 2023-10-03T19:12:40.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a5cea640 1 --2- 172.21.15.45:0/3715360301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f468c003980 0x7f46a014ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:12:40.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.577+0000 7f46a64eb640 1 --2- 172.21.15.45:0/3715360301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46a00bea90 0x7f46a0144240 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f46a006aab0 tx=0x7f469c00e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:40.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.581+0000 7f46967fc640 1 -- 172.21.15.45:0/3715360301 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c0052e0 con 0x7f46a00bea90 2023-10-03T19:12:40.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.581+0000 7f46967fc640 1 -- 172.21.15.45:0/3715360301 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469c005440 con 0x7f46a00bea90 2023-10-03T19:12:40.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.581+0000 7f46a7f4e640 1 -- 172.21.15.45:0/3715360301 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a014e980 con 0x7f46a00bea90 2023-10-03T19:12:40.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.581+0000 7f46967fc640 1 -- 172.21.15.45:0/3715360301 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c00ea20 con 0x7f46a00bea90 2023-10-03T19:12:40.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.581+0000 7f46a7f4e640 1 -- 172.21.15.45:0/3715360301 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a014eca0 con 0x7f46a00bea90 2023-10-03T19:12:40.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.581+0000 7f46a7f4e640 1 -- 172.21.15.45:0/3715360301 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a004de80 con 0x7f46a00bea90 2023-10-03T19:12:40.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.581+0000 7f46967fc640 1 -- 172.21.15.45:0/3715360301 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f469c00eb80 con 0x7f46a00bea90 2023-10-03T19:12:40.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.581+0000 7f46967fc640 1 --2- 172.21.15.45:0/3715360301 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f46840662b0 0x7f4684068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:40.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.581+0000 7f46967fc640 1 -- 172.21.15.45:0/3715360301 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f469c082b80 con 0x7f46a00bea90 2023-10-03T19:12:40.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.581+0000 7f46a5cea640 1 --2- 172.21.15.45:0/3715360301 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f46840662b0 0x7f4684068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:40.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.581+0000 7f46a5cea640 1 --2- 172.21.15.45:0/3715360301 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f46840662b0 0x7f4684068760 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f46980ad000 tx=0x7f4698009050 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:40.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.585+0000 7f46967fc640 1 -- 172.21.15.45:0/3715360301 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f469c050090 con 0x7f46a00bea90 2023-10-03T19:12:40.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.733+0000 7f46a7f4e640 1 -- 172.21.15.45:0/3715360301 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f46a00bd9f0 con 0x7f46a00bea90 2023-10-03T19:12:40.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.733+0000 7f46967fc640 1 -- 172.21.15.45:0/3715360301 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f469c0190a0 con 0x7f46a00bea90 2023-10-03T19:12:40.738 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:12:40.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.737+0000 7f46a7f4e640 1 -- 172.21.15.45:0/3715360301 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f46840662b0 msgr2=0x7f4684068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:40.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.737+0000 7f46a7f4e640 1 --2- 172.21.15.45:0/3715360301 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f46840662b0 0x7f4684068760 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f46980ad000 tx=0x7f4698009050 comp rx=0 tx=0).stop 2023-10-03T19:12:40.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.737+0000 7f46a7f4e640 1 -- 172.21.15.45:0/3715360301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46a00bea90 msgr2=0x7f46a0144240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:40.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.737+0000 7f46a7f4e640 1 --2- 172.21.15.45:0/3715360301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46a00bea90 0x7f46a0144240 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f46a006aab0 tx=0x7f469c00e4d0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.737+0000 7f46a7f4e640 1 -- 172.21.15.45:0/3715360301 shutdown_connections 2023-10-03T19:12:40.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.737+0000 7f46a7f4e640 1 --2- 172.21.15.45:0/3715360301 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f46840662b0 0x7f4684068760 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.737+0000 7f46a7f4e640 1 --2- 172.21.15.45:0/3715360301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46a00bea90 0x7f46a0144240 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.737+0000 7f46a7f4e640 1 --2- 172.21.15.45:0/3715360301 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46a01451a0 0x7f46a00be550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.737+0000 7f46a7f4e640 1 --2- 172.21.15.45:0/3715360301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f468c003980 0x7f46a014ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.737+0000 7f46a7f4e640 1 -- 172.21.15.45:0/3715360301 >> 172.21.15.45:0/3715360301 conn(0x7f46a00a20d0 msgr2=0x7f46a00bfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:40.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.737+0000 7f46a7f4e640 1 -- 172.21.15.45:0/3715360301 shutdown_connections 2023-10-03T19:12:40.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.737+0000 7f46a7f4e640 1 -- 172.21.15.45:0/3715360301 wait complete. 2023-10-03T19:12:40.757 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T19:12:40.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.877+0000 7f74f1265640 1 Processor -- start 2023-10-03T19:12:40.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.877+0000 7f74f1265640 1 -- start start 2023-10-03T19:12:40.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.877+0000 7f74f1265640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f74ec070700 0x7f74ec070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:40.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.877+0000 7f74f1265640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f74ec0bc800 0x7f74ec06f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:40.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.877+0000 7f74f1265640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74ec14b710 con 0x7f74ec14bba0 2023-10-03T19:12:40.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.877+0000 7f74f1265640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74ec14b190 con 0x7f74ec070700 2023-10-03T19:12:40.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.877+0000 7f74f1265640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74ec14e8b0 con 0x7f74ec0bc800 2023-10-03T19:12:40.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.881+0000 7f74eaffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f74ec070700 0x7f74ec070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:40.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.881+0000 7f74eaffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f74ec070700 0x7f74ec070b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41902/0 (socket says 172.21.15.45:41902) 2023-10-03T19:12:40.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.881+0000 7f74eaffd640 1 -- 172.21.15.45:0/2011548103 learned_addr learned my addr 172.21.15.45:0/2011548103 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:40.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.881+0000 7f74e3fff640 1 --2- 172.21.15.45:0/2011548103 >> v2:172.21.15.79:3300/0 conn(0x7f74ec0bc800 0x7f74ec06f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:40.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.881+0000 7f74eaffd640 1 -- 172.21.15.45:0/2011548103 >> v2:172.21.15.79:3300/0 conn(0x7f74ec0bc800 msgr2=0x7f74ec06f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:40.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.881+0000 7f74eaffd640 1 --2- 172.21.15.45:0/2011548103 >> v2:172.21.15.79:3300/0 conn(0x7f74ec0bc800 0x7f74ec06f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.881+0000 7f74eaffd640 1 -- 172.21.15.45:0/2011548103 >> v1:172.21.15.79:6789/0 conn(0x7f74ec14bba0 legacy=0x7f74ec0c1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:40.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.881+0000 7f74eaffd640 1 -- 172.21.15.45:0/2011548103 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ec14b3a0 con 0x7f74ec070700 2023-10-03T19:12:40.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.881+0000 7f74e3fff640 1 --2- 172.21.15.45:0/2011548103 >> v2:172.21.15.79:3300/0 conn(0x7f74ec0bc800 0x7f74ec06f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:40.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.881+0000 7f74eaffd640 1 --2- 172.21.15.45:0/2011548103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74ec070700 0x7f74ec070b50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f74ec0bd600 tx=0x7f74dc01eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1afaefda3580769 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:40.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.881+0000 7f74ea7fc640 1 -- 172.21.15.45:0/2011548103 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74dc0a7bf0 con 0x7f74ec070700 2023-10-03T19:12:40.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.881+0000 7f74ea7fc640 1 -- 172.21.15.45:0/2011548103 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74dc0a7d50 con 0x7f74ec070700 2023-10-03T19:12:40.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.881+0000 7f74ea7fc640 1 -- 172.21.15.45:0/2011548103 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74dc0af660 con 0x7f74ec070700 2023-10-03T19:12:40.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.881+0000 7f74f1265640 1 -- 172.21.15.45:0/2011548103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74ec070700 msgr2=0x7f74ec070b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:40.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.881+0000 7f74f1265640 1 --2- 172.21.15.45:0/2011548103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74ec070700 0x7f74ec070b50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f74ec0bd600 tx=0x7f74dc01eb60 comp rx=0 tx=0).stop 2023-10-03T19:12:40.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.881+0000 7f74f1265640 1 -- 172.21.15.45:0/2011548103 shutdown_connections 2023-10-03T19:12:40.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.881+0000 7f74f1265640 1 --2- 172.21.15.45:0/2011548103 >> v2:172.21.15.79:3300/0 conn(0x7f74ec0bc800 0x7f74ec06f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.881+0000 7f74f1265640 1 --2- 172.21.15.45:0/2011548103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74ec070700 0x7f74ec070b50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.881+0000 7f74f1265640 1 -- 172.21.15.45:0/2011548103 >> 172.21.15.45:0/2011548103 conn(0x7f74ec06a760 msgr2=0x7f74ec0c0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:40.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.881+0000 7f74f1265640 1 -- 172.21.15.45:0/2011548103 shutdown_connections 2023-10-03T19:12:40.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.881+0000 7f74f1265640 1 -- 172.21.15.45:0/2011548103 wait complete. 2023-10-03T19:12:40.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.885+0000 7f74f1265640 1 Processor -- start 2023-10-03T19:12:40.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.885+0000 7f74f1265640 1 -- start start 2023-10-03T19:12:40.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.885+0000 7f74f1265640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74ec070700 0x7f74ec152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:40.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.885+0000 7f74f1265640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74ec0bc800 0x7f74ec143ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:40.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.885+0000 7f74f1265640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74ec14bba0 0x7f74ec154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:40.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.885+0000 7f74f1265640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec14feb0 con 0x7f74ec070700 2023-10-03T19:12:40.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.885+0000 7f74f1265640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec143c50 con 0x7f74ec14bba0 2023-10-03T19:12:40.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.885+0000 7f74f1265640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec14fc10 con 0x7f74ec0bc800 2023-10-03T19:12:40.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.885+0000 7f74eaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74ec070700 0x7f74ec152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:40.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.885+0000 7f74eaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74ec070700 0x7f74ec152310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41914/0 (socket says 172.21.15.45:41914) 2023-10-03T19:12:40.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.885+0000 7f74eaffd640 1 -- 172.21.15.45:0/2488284829 learned_addr learned my addr 172.21.15.45:0/2488284829 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:40.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.885+0000 7f74e3fff640 1 --2- 172.21.15.45:0/2488284829 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74ec0bc800 0x7f74ec143ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:40.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.885+0000 7f74eb7fe640 1 --2- 172.21.15.45:0/2488284829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74ec14bba0 0x7f74ec154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:40.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.885+0000 7f74eaffd640 1 -- 172.21.15.45:0/2488284829 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74ec0bc800 msgr2=0x7f74ec143ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:40.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.885+0000 7f74eaffd640 1 --2- 172.21.15.45:0/2488284829 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74ec0bc800 0x7f74ec143ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.885+0000 7f74eaffd640 1 -- 172.21.15.45:0/2488284829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74ec14bba0 msgr2=0x7f74ec154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:40.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.885+0000 7f74eaffd640 1 --2- 172.21.15.45:0/2488284829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74ec14bba0 0x7f74ec154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:40.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.885+0000 7f74eaffd640 1 -- 172.21.15.45:0/2488284829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74dc00b770 con 0x7f74ec070700 2023-10-03T19:12:40.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.885+0000 7f74eb7fe640 1 --2- 172.21.15.45:0/2488284829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74ec14bba0 0x7f74ec154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:40.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.885+0000 7f74eaffd640 1 --2- 172.21.15.45:0/2488284829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74ec070700 0x7f74ec152310 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f74dc000c10 tx=0x7f74dc01b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:40.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.885+0000 7f74e37fe640 1 -- 172.21.15.45:0/2488284829 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74dc0b9600 con 0x7f74ec070700 2023-10-03T19:12:40.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.885+0000 7f74e37fe640 1 -- 172.21.15.45:0/2488284829 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74dc0b9760 con 0x7f74ec070700 2023-10-03T19:12:40.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.885+0000 7f74f1265640 1 -- 172.21.15.45:0/2488284829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74ec071900 con 0x7f74ec070700 2023-10-03T19:12:40.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.885+0000 7f74e37fe640 1 -- 172.21.15.45:0/2488284829 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74dc0b9b10 con 0x7f74ec070700 2023-10-03T19:12:40.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.885+0000 7f74f1265640 1 -- 172.21.15.45:0/2488284829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74ec071770 con 0x7f74ec070700 2023-10-03T19:12:40.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.889+0000 7f74f1265640 1 -- 172.21.15.45:0/2488284829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74ec14bfa0 con 0x7f74ec070700 2023-10-03T19:12:40.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.889+0000 7f74e37fe640 1 -- 172.21.15.45:0/2488284829 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f74dc0b9c70 con 0x7f74ec070700 2023-10-03T19:12:40.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.889+0000 7f74e37fe640 1 --2- 172.21.15.45:0/2488284829 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f74cc066280 0x7f74cc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:40.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.889+0000 7f74e37fe640 1 -- 172.21.15.45:0/2488284829 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f74dc11f550 con 0x7f74ec070700 2023-10-03T19:12:40.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.889+0000 7f74e3fff640 1 --2- 172.21.15.45:0/2488284829 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f74cc066280 0x7f74cc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:40.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.889+0000 7f74e3fff640 1 --2- 172.21.15.45:0/2488284829 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f74cc066280 0x7f74cc068730 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f74d4006fd0 tx=0x7f74d4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:40.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:40.893+0000 7f74e37fe640 1 -- 172.21.15.45:0/2488284829 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f74dc0ec9c0 con 0x7f74ec070700 2023-10-03T19:12:41.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.045+0000 7f74f1265640 1 -- 172.21.15.45:0/2488284829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f74ec14bfa0 con 0x7f74ec070700 2023-10-03T19:12:41.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.045+0000 7f74e37fe640 1 -- 172.21.15.45:0/2488284829 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f74dc0effe0 con 0x7f74ec070700 2023-10-03T19:12:41.049 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-03T19:12:41.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.045+0000 7f74f1265640 1 -- 172.21.15.45:0/2488284829 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f74cc066280 msgr2=0x7f74cc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:41.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.045+0000 7f74f1265640 1 --2- 172.21.15.45:0/2488284829 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f74cc066280 0x7f74cc068730 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f74d4006fd0 tx=0x7f74d4008040 comp rx=0 tx=0).stop 2023-10-03T19:12:41.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.045+0000 7f74f1265640 1 -- 172.21.15.45:0/2488284829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74ec070700 msgr2=0x7f74ec152310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:41.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.045+0000 7f74f1265640 1 --2- 172.21.15.45:0/2488284829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74ec070700 0x7f74ec152310 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f74dc000c10 tx=0x7f74dc01b900 comp rx=0 tx=0).stop 2023-10-03T19:12:41.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.045+0000 7f74f1265640 1 -- 172.21.15.45:0/2488284829 shutdown_connections 2023-10-03T19:12:41.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.045+0000 7f74f1265640 1 --2- 172.21.15.45:0/2488284829 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f74cc066280 0x7f74cc068730 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.045+0000 7f74f1265640 1 --2- 172.21.15.45:0/2488284829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74ec14bba0 0x7f74ec154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.045+0000 7f74f1265640 1 --2- 172.21.15.45:0/2488284829 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74ec0bc800 0x7f74ec143ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.045+0000 7f74f1265640 1 --2- 172.21.15.45:0/2488284829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74ec070700 0x7f74ec152310 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.045+0000 7f74f1265640 1 -- 172.21.15.45:0/2488284829 >> 172.21.15.45:0/2488284829 conn(0x7f74ec06a760 msgr2=0x7f74ec149750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:41.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.045+0000 7f74f1265640 1 -- 172.21.15.45:0/2488284829 shutdown_connections 2023-10-03T19:12:41.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.045+0000 7f74f1265640 1 -- 172.21.15.45:0/2488284829 wait complete. 2023-10-03T19:12:41.068 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T19:12:41.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.185+0000 7f24ef305640 1 Processor -- start 2023-10-03T19:12:41.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.185+0000 7f24ef305640 1 -- start start 2023-10-03T19:12:41.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.185+0000 7f24ef305640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f24e806f880 0x7f24e80a5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:41.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.185+0000 7f24ef305640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f24e814f510 0x7f24e814b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:41.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.185+0000 7f24ef305640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24e814f080 con 0x7f24e80bd9f0 2023-10-03T19:12:41.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.185+0000 7f24ef305640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24e806f3e0 con 0x7f24e814f510 2023-10-03T19:12:41.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.185+0000 7f24ef305640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24e8070e90 con 0x7f24e806f880 2023-10-03T19:12:41.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.185+0000 7f24ec8a0640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f24e814f510 0x7f24e814b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:41.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.185+0000 7f24ed8a2640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f24e80bd9f0 0x7f24e80badc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33544/0 (socket says 172.21.15.45:33544) 2023-10-03T19:12:41.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.185+0000 7f24ed8a2640 1 -- 172.21.15.45:0/1295421662 learned_addr learned my addr 172.21.15.45:0/1295421662 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:41.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.185+0000 7f24ed0a1640 1 --2- 172.21.15.45:0/1295421662 >> v2:172.21.15.79:3300/0 conn(0x7f24e806f880 0x7f24e80a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:41.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.185+0000 7f24ec8a0640 1 -- 172.21.15.45:0/1295421662 >> v2:172.21.15.79:3300/0 conn(0x7f24e806f880 msgr2=0x7f24e80a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:41.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.185+0000 7f24ec8a0640 1 --2- 172.21.15.45:0/1295421662 >> v2:172.21.15.79:3300/0 conn(0x7f24e806f880 0x7f24e80a5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.185+0000 7f24ec8a0640 1 -- 172.21.15.45:0/1295421662 >> v1:172.21.15.45:6789/0 conn(0x7f24e80bd9f0 legacy=0x7f24e80badc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:41.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.185+0000 7f24ec8a0640 1 -- 172.21.15.45:0/1295421662 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e814ea30 con 0x7f24e814f510 2023-10-03T19:12:41.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ec8a0640 1 --2- 172.21.15.45:0/1295421662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24e814f510 0x7f24e814b320 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f24e806ead0 tx=0x7f24e401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c2140be45bfa814 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:41.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24dffff640 1 -- 172.21.15.45:0/1295421662 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e40a8050 con 0x7f24e814f510 2023-10-03T19:12:41.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24dffff640 1 -- 172.21.15.45:0/1295421662 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e40ac5f0 con 0x7f24e814f510 2023-10-03T19:12:41.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24dffff640 1 -- 172.21.15.45:0/1295421662 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e40ac980 con 0x7f24e814f510 2023-10-03T19:12:41.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ef305640 1 -- 172.21.15.45:0/1295421662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24e814f510 msgr2=0x7f24e814b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:41.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ef305640 1 --2- 172.21.15.45:0/1295421662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24e814f510 0x7f24e814b320 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f24e806ead0 tx=0x7f24e401c430 comp rx=0 tx=0).stop 2023-10-03T19:12:41.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ef305640 1 -- 172.21.15.45:0/1295421662 shutdown_connections 2023-10-03T19:12:41.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ef305640 1 --2- 172.21.15.45:0/1295421662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24e814f510 0x7f24e814b320 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ef305640 1 --2- 172.21.15.45:0/1295421662 >> v2:172.21.15.79:3300/0 conn(0x7f24e806f880 0x7f24e80a5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ef305640 1 -- 172.21.15.45:0/1295421662 >> 172.21.15.45:0/1295421662 conn(0x7f24e80a20d0 msgr2=0x7f24e80a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:41.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ef305640 1 -- 172.21.15.45:0/1295421662 shutdown_connections 2023-10-03T19:12:41.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ef305640 1 -- 172.21.15.45:0/1295421662 wait complete. 2023-10-03T19:12:41.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ef305640 1 Processor -- start 2023-10-03T19:12:41.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ef305640 1 -- start start 2023-10-03T19:12:41.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ef305640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24e806f880 0x7f24e80b9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:41.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ef305640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24e80bd9f0 0x7f24e80a4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:41.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ef305640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24e814f510 0x7f24e81e4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:41.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ef305640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e81e8c70 con 0x7f24e806f880 2023-10-03T19:12:41.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ef305640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e80ba3e0 con 0x7f24e814f510 2023-10-03T19:12:41.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ef305640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e81e8ec0 con 0x7f24e80bd9f0 2023-10-03T19:12:41.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ed0a1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24e806f880 0x7f24e80b9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:41.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ed0a1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24e806f880 0x7f24e80b9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41930/0 (socket says 172.21.15.45:41930) 2023-10-03T19:12:41.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ed0a1640 1 -- 172.21.15.45:0/4189777991 learned_addr learned my addr 172.21.15.45:0/4189777991 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:41.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ed8a2640 1 --2- 172.21.15.45:0/4189777991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24e814f510 0x7f24e81e4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:41.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ec8a0640 1 --2- 172.21.15.45:0/4189777991 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24e80bd9f0 0x7f24e80a4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:41.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ed0a1640 1 -- 172.21.15.45:0/4189777991 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24e80bd9f0 msgr2=0x7f24e80a4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:41.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ed0a1640 1 --2- 172.21.15.45:0/4189777991 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24e80bd9f0 0x7f24e80a4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ed0a1640 1 -- 172.21.15.45:0/4189777991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24e814f510 msgr2=0x7f24e81e4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:41.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ed0a1640 1 --2- 172.21.15.45:0/4189777991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24e814f510 0x7f24e81e4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ed0a1640 1 -- 172.21.15.45:0/4189777991 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e4009420 con 0x7f24e806f880 2023-10-03T19:12:41.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ec8a0640 1 --2- 172.21.15.45:0/4189777991 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24e80bd9f0 0x7f24e80a4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:41.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ed8a2640 1 --2- 172.21.15.45:0/4189777991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24e814f510 0x7f24e81e4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:41.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ed0a1640 1 --2- 172.21.15.45:0/4189777991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24e806f880 0x7f24e80b9ea0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f24d800e930 tx=0x7f24d800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:41.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.189+0000 7f24ddffb640 1 -- 172.21.15.45:0/4189777991 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d8009690 con 0x7f24e806f880 2023-10-03T19:12:41.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.193+0000 7f24ef305640 1 -- 172.21.15.45:0/4189777991 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e806fc50 con 0x7f24e806f880 2023-10-03T19:12:41.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.193+0000 7f24ddffb640 1 -- 172.21.15.45:0/4189777991 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d800ca00 con 0x7f24e806f880 2023-10-03T19:12:41.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.193+0000 7f24ef305640 1 -- 172.21.15.45:0/4189777991 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e814bc70 con 0x7f24e806f880 2023-10-03T19:12:41.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.193+0000 7f24ddffb640 1 -- 172.21.15.45:0/4189777991 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d800cd70 con 0x7f24e806f880 2023-10-03T19:12:41.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.193+0000 7f24ef305640 1 -- 172.21.15.45:0/4189777991 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24e8070a40 con 0x7f24e806f880 2023-10-03T19:12:41.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.193+0000 7f24ddffb640 1 -- 172.21.15.45:0/4189777991 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f24d8013470 con 0x7f24e806f880 2023-10-03T19:12:41.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.193+0000 7f24ddffb640 1 --2- 172.21.15.45:0/4189777991 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f24cc0662b0 0x7f24cc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:41.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.193+0000 7f24ddffb640 1 -- 172.21.15.45:0/4189777991 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f24d8084310 con 0x7f24e806f880 2023-10-03T19:12:41.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.193+0000 7f24ec8a0640 1 --2- 172.21.15.45:0/4189777991 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f24cc0662b0 0x7f24cc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:41.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.193+0000 7f24ec8a0640 1 --2- 172.21.15.45:0/4189777991 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f24cc0662b0 0x7f24cc068760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f24e40ae000 tx=0x7f24e40a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:41.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.197+0000 7f24ddffb640 1 -- 172.21.15.45:0/4189777991 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f24d80517d0 con 0x7f24e806f880 2023-10-03T19:12:41.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.353+0000 7f24ef305640 1 -- 172.21.15.45:0/4189777991 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f24e80ba550 con 0x7f24e806f880 2023-10-03T19:12:41.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.353+0000 7f24ddffb640 1 -- 172.21.15.45:0/4189777991 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f24d8054df0 con 0x7f24e806f880 2023-10-03T19:12:41.359 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-03T19:12:41.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.357+0000 7f24ef305640 1 -- 172.21.15.45:0/4189777991 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f24cc0662b0 msgr2=0x7f24cc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:41.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.357+0000 7f24ef305640 1 --2- 172.21.15.45:0/4189777991 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f24cc0662b0 0x7f24cc068760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f24e40ae000 tx=0x7f24e40a7000 comp rx=0 tx=0).stop 2023-10-03T19:12:41.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.357+0000 7f24ef305640 1 -- 172.21.15.45:0/4189777991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24e806f880 msgr2=0x7f24e80b9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:41.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.357+0000 7f24ef305640 1 --2- 172.21.15.45:0/4189777991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24e806f880 0x7f24e80b9ea0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f24d800e930 tx=0x7f24d800edf0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.357+0000 7f24ef305640 1 -- 172.21.15.45:0/4189777991 shutdown_connections 2023-10-03T19:12:41.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.357+0000 7f24ef305640 1 --2- 172.21.15.45:0/4189777991 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f24cc0662b0 0x7f24cc068760 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.357+0000 7f24ef305640 1 --2- 172.21.15.45:0/4189777991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24e814f510 0x7f24e81e4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.357+0000 7f24ef305640 1 --2- 172.21.15.45:0/4189777991 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24e80bd9f0 0x7f24e80a4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.357+0000 7f24ef305640 1 --2- 172.21.15.45:0/4189777991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24e806f880 0x7f24e80b9ea0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.357+0000 7f24ef305640 1 -- 172.21.15.45:0/4189777991 >> 172.21.15.45:0/4189777991 conn(0x7f24e80a20d0 msgr2=0x7f24e80a4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:41.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.357+0000 7f24ef305640 1 -- 172.21.15.45:0/4189777991 shutdown_connections 2023-10-03T19:12:41.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.357+0000 7f24ef305640 1 -- 172.21.15.45:0/4189777991 wait complete. 2023-10-03T19:12:41.378 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:12:41.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.501+0000 7efcd88ef640 1 Processor -- start 2023-10-03T19:12:41.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.501+0000 7efcd88ef640 1 -- start start 2023-10-03T19:12:41.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.501+0000 7efcd88ef640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efcd40bf370 0x7efcd4149760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:41.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.501+0000 7efcd88ef640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efcd40a7100 0x7efcd4149ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:41.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.501+0000 7efcd88ef640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efcd406f5f0 0x7efcd414cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:41.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.501+0000 7efcd88ef640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd40bebc0 con 0x7efcd406f5f0 2023-10-03T19:12:41.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.501+0000 7efcd88ef640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd414c770 con 0x7efcd40a7100 2023-10-03T19:12:41.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.501+0000 7efcd88ef640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd406efe0 con 0x7efcd40bf370 2023-10-03T19:12:41.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.501+0000 7efcd2d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efcd406f5f0 0x7efcd414cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:41.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.501+0000 7efcd2d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efcd406f5f0 0x7efcd414cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41942/0 (socket says 172.21.15.45:41942) 2023-10-03T19:12:41.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.501+0000 7efcd2d9d640 1 -- 172.21.15.45:0/2072937156 learned_addr learned my addr 172.21.15.45:0/2072937156 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:41.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.501+0000 7efcc9d9b640 1 --2- 172.21.15.45:0/2072937156 >> v2:172.21.15.79:3300/0 conn(0x7efcd40a7100 0x7efcd4149ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:41.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.501+0000 7efcd259c640 1 --2- 172.21.15.45:0/2072937156 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efcd40bf370 0x7efcd4149760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:41.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.501+0000 7efcd2d9d640 1 -- 172.21.15.45:0/2072937156 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efcd40bf370 msgr2=0x7efcd4149760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:41.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.501+0000 7efcd2d9d640 1 --2- 172.21.15.45:0/2072937156 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efcd40bf370 0x7efcd4149760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.501+0000 7efcd2d9d640 1 -- 172.21.15.45:0/2072937156 >> v2:172.21.15.79:3300/0 conn(0x7efcd40a7100 msgr2=0x7efcd4149ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:41.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.501+0000 7efcd2d9d640 1 --2- 172.21.15.45:0/2072937156 >> v2:172.21.15.79:3300/0 conn(0x7efcd40a7100 0x7efcd4149ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.501+0000 7efcd2d9d640 1 -- 172.21.15.45:0/2072937156 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd406f2c0 con 0x7efcd406f5f0 2023-10-03T19:12:41.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.505+0000 7efcd2d9d640 1 --2- 172.21.15.45:0/2072937156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcd406f5f0 0x7efcd414cc00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efcd40721b0 tx=0x7efccc01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554cbd2e6cfed909 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:41.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.505+0000 7efcd1d9b640 1 -- 172.21.15.45:0/2072937156 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc0a5780 con 0x7efcd406f5f0 2023-10-03T19:12:41.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.505+0000 7efcd1d9b640 1 -- 172.21.15.45:0/2072937156 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efccc0a58e0 con 0x7efcd406f5f0 2023-10-03T19:12:41.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.505+0000 7efcd1d9b640 1 -- 172.21.15.45:0/2072937156 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc0a5c70 con 0x7efcd406f5f0 2023-10-03T19:12:41.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.505+0000 7efcd88ef640 1 -- 172.21.15.45:0/2072937156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcd406f5f0 msgr2=0x7efcd414cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:41.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.505+0000 7efcd88ef640 1 --2- 172.21.15.45:0/2072937156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcd406f5f0 0x7efcd414cc00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efcd40721b0 tx=0x7efccc01c940 comp rx=0 tx=0).stop 2023-10-03T19:12:41.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.505+0000 7efcd88ef640 1 -- 172.21.15.45:0/2072937156 shutdown_connections 2023-10-03T19:12:41.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.505+0000 7efcd88ef640 1 --2- 172.21.15.45:0/2072937156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcd406f5f0 0x7efcd414cc00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.505+0000 7efcd88ef640 1 --2- 172.21.15.45:0/2072937156 >> v2:172.21.15.79:3300/0 conn(0x7efcd40a7100 0x7efcd4149ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.505+0000 7efcd88ef640 1 --2- 172.21.15.45:0/2072937156 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efcd40bf370 0x7efcd4149760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.505+0000 7efcd88ef640 1 -- 172.21.15.45:0/2072937156 >> 172.21.15.45:0/2072937156 conn(0x7efcd406bce0 msgr2=0x7efcd406c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:41.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.505+0000 7efcd88ef640 1 -- 172.21.15.45:0/2072937156 shutdown_connections 2023-10-03T19:12:41.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.505+0000 7efcd88ef640 1 -- 172.21.15.45:0/2072937156 wait complete. 2023-10-03T19:12:41.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.509+0000 7efcd88ef640 1 Processor -- start 2023-10-03T19:12:41.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.509+0000 7efcd88ef640 1 -- start start 2023-10-03T19:12:41.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.509+0000 7efcd88ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcd406f5f0 0x7efcd414ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:41.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.509+0000 7efcd88ef640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efcd40a7100 0x7efcd41e70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:41.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.509+0000 7efcd88ef640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcd40bf370 0x7efcd41e75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:41.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.509+0000 7efcd88ef640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd40a47e0 con 0x7efcd406f5f0 2023-10-03T19:12:41.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.509+0000 7efcd88ef640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd41423f0 con 0x7efcd40bf370 2023-10-03T19:12:41.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.509+0000 7efcd88ef640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd414b160 con 0x7efcd40a7100 2023-10-03T19:12:41.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.509+0000 7efcd259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcd406f5f0 0x7efcd414ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:41.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.509+0000 7efcd259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcd406f5f0 0x7efcd414ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41950/0 (socket says 172.21.15.45:41950) 2023-10-03T19:12:41.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.509+0000 7efcd259c640 1 -- 172.21.15.45:0/152388332 learned_addr learned my addr 172.21.15.45:0/152388332 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:41.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.509+0000 7efcd2d9d640 1 --2- 172.21.15.45:0/152388332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcd40bf370 0x7efcd41e75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:41.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.509+0000 7efcc9d9b640 1 --2- 172.21.15.45:0/152388332 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efcd40a7100 0x7efcd41e70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:41.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.509+0000 7efcd259c640 1 -- 172.21.15.45:0/152388332 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efcd40a7100 msgr2=0x7efcd41e70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:41.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.509+0000 7efcd259c640 1 --2- 172.21.15.45:0/152388332 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efcd40a7100 0x7efcd41e70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.509+0000 7efcd259c640 1 -- 172.21.15.45:0/152388332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcd40bf370 msgr2=0x7efcd41e75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:41.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.509+0000 7efcd259c640 1 --2- 172.21.15.45:0/152388332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcd40bf370 0x7efcd41e75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.509+0000 7efcd259c640 1 -- 172.21.15.45:0/152388332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efccc009b30 con 0x7efcd406f5f0 2023-10-03T19:12:41.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.509+0000 7efcd259c640 1 --2- 172.21.15.45:0/152388332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcd406f5f0 0x7efcd414ac20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efcc400e8d0 tx=0x7efcc400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:41.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.509+0000 7efccb7fe640 1 -- 172.21.15.45:0/152388332 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc4009510 con 0x7efcd406f5f0 2023-10-03T19:12:41.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.509+0000 7efccb7fe640 1 -- 172.21.15.45:0/152388332 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc400c940 con 0x7efcd406f5f0 2023-10-03T19:12:41.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.509+0000 7efcd88ef640 1 -- 172.21.15.45:0/152388332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd40bf8d0 con 0x7efcd406f5f0 2023-10-03T19:12:41.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.509+0000 7efccb7fe640 1 -- 172.21.15.45:0/152388332 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc400ccb0 con 0x7efcd406f5f0 2023-10-03T19:12:41.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.509+0000 7efcd88ef640 1 -- 172.21.15.45:0/152388332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd40bf740 con 0x7efcd406f5f0 2023-10-03T19:12:41.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.509+0000 7efcd88ef640 1 -- 172.21.15.45:0/152388332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd4071930 con 0x7efcd406f5f0 2023-10-03T19:12:41.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.509+0000 7efccb7fe640 1 -- 172.21.15.45:0/152388332 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efcc4013470 con 0x7efcd406f5f0 2023-10-03T19:12:41.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.509+0000 7efccb7fe640 1 --2- 172.21.15.45:0/152388332 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efcb4066280 0x7efcb4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:41.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.509+0000 7efccb7fe640 1 -- 172.21.15.45:0/152388332 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efcc4083e60 con 0x7efcd406f5f0 2023-10-03T19:12:41.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.509+0000 7efcc9d9b640 1 --2- 172.21.15.45:0/152388332 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efcb4066280 0x7efcb4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:41.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.513+0000 7efcc9d9b640 1 --2- 172.21.15.45:0/152388332 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efcb4066280 0x7efcb4068730 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efcd4067360 tx=0x7efcbc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:41.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.517+0000 7efccb7fe640 1 -- 172.21.15.45:0/152388332 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7efcc40512e0 con 0x7efcd406f5f0 2023-10-03T19:12:41.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.697+0000 7efcd88ef640 1 -- 172.21.15.45:0/152388332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efcd40c2570 con 0x7efcd406f5f0 2023-10-03T19:12:41.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.697+0000 7efccb7fe640 1 -- 172.21.15.45:0/152388332 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3903 (secure 0 0 0) 0x7efcc4017090 con 0x7efcd406f5f0 2023-10-03T19:12:41.701 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:41.701 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/731286206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":731286206},{"type":"v1","addr":"172.21.15.45:6834","nonce":731286206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/144609891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":144609891},{"type":"v1","addr":"172.21.15.45:6835","nonce":144609891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:12:27.938475+0000","modified":"2023-10-03T19:12:30.957787+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/2693877820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2693877820},{"type":"v1","addr":"172.21.15.79:6835","nonce":2693877820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-03T19:12:41.701 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 7 2023-10-03T19:12:41.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.697+0000 7efcd88ef640 1 -- 172.21.15.45:0/152388332 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efcb4066280 msgr2=0x7efcb4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:41.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.697+0000 7efcd88ef640 1 --2- 172.21.15.45:0/152388332 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efcb4066280 0x7efcb4068730 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efcd4067360 tx=0x7efcbc008040 comp rx=0 tx=0).stop 2023-10-03T19:12:41.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.697+0000 7efcd88ef640 1 -- 172.21.15.45:0/152388332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcd406f5f0 msgr2=0x7efcd414ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:41.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.697+0000 7efcd88ef640 1 --2- 172.21.15.45:0/152388332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcd406f5f0 0x7efcd414ac20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efcc400e8d0 tx=0x7efcc400ecd0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.697+0000 7efcd88ef640 1 -- 172.21.15.45:0/152388332 shutdown_connections 2023-10-03T19:12:41.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.697+0000 7efcd88ef640 1 --2- 172.21.15.45:0/152388332 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efcb4066280 0x7efcb4068730 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.697+0000 7efcd88ef640 1 --2- 172.21.15.45:0/152388332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcd40bf370 0x7efcd41e75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.697+0000 7efcd88ef640 1 --2- 172.21.15.45:0/152388332 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efcd40a7100 0x7efcd41e70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.697+0000 7efcd88ef640 1 --2- 172.21.15.45:0/152388332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcd406f5f0 0x7efcd414ac20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.697+0000 7efcd88ef640 1 -- 172.21.15.45:0/152388332 >> 172.21.15.45:0/152388332 conn(0x7efcd406bce0 msgr2=0x7efcd40bba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:41.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.697+0000 7efcd88ef640 1 -- 172.21.15.45:0/152388332 shutdown_connections 2023-10-03T19:12:41.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.697+0000 7efcd88ef640 1 -- 172.21.15.45:0/152388332 wait complete. 2023-10-03T19:12:41.719 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:12:41.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.833+0000 7f2579eca640 1 Processor -- start 2023-10-03T19:12:41.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.833+0000 7f2579eca640 1 -- start start 2023-10-03T19:12:41.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.837+0000 7f2579eca640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f25740c2790 0x7f25741528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:41.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.837+0000 7f2579eca640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f25740bb1d0 0x7f25740c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:41.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.837+0000 7f2579eca640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f257406b2d0 con 0x7f257414f240 2023-10-03T19:12:41.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.837+0000 7f2579eca640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f257406b640 con 0x7f25740bb1d0 2023-10-03T19:12:41.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.837+0000 7f2579eca640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25740a3c60 con 0x7f25740c2790 2023-10-03T19:12:41.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.837+0000 7f2573fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f25740bb1d0 0x7f25740c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.837+0000 7f2573fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f25740bb1d0 0x7f25740c12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41952/0 (socket says 172.21.15.45:41952) 2023-10-03T19:12:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.837+0000 7f2573fff640 1 -- 172.21.15.45:0/1129541673 learned_addr learned my addr 172.21.15.45:0/1129541673 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.837+0000 7f2572ffd640 1 --2- 172.21.15.45:0/1129541673 >> v2:172.21.15.79:3300/0 conn(0x7f25740c2790 0x7f25741528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.837+0000 7f2573fff640 1 -- 172.21.15.45:0/1129541673 >> v2:172.21.15.79:3300/0 conn(0x7f25740c2790 msgr2=0x7f25741528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.837+0000 7f2573fff640 1 --2- 172.21.15.45:0/1129541673 >> v2:172.21.15.79:3300/0 conn(0x7f25740c2790 0x7f25741528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.837+0000 7f2573fff640 1 -- 172.21.15.45:0/1129541673 >> v1:172.21.15.79:6789/0 conn(0x7f257414f240 legacy=0x7f25740c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.837+0000 7f2573fff640 1 -- 172.21.15.45:0/1129541673 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257414e740 con 0x7f25740bb1d0 2023-10-03T19:12:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.837+0000 7f2572ffd640 1 --2- 172.21.15.45:0/1129541673 >> v2:172.21.15.79:3300/0 conn(0x7f25740c2790 0x7f25741528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:41.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.837+0000 7f2573fff640 1 --2- 172.21.15.45:0/1129541673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25740bb1d0 0x7f25740c12a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2574089fd0 tx=0x7f256c01f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=186eeb3cd2709159 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:41.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.837+0000 7f25727fc640 1 -- 172.21.15.45:0/1129541673 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c0af400 con 0x7f25740bb1d0 2023-10-03T19:12:41.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.837+0000 7f25727fc640 1 -- 172.21.15.45:0/1129541673 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256c0ab050 con 0x7f25740bb1d0 2023-10-03T19:12:41.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.837+0000 7f25727fc640 1 -- 172.21.15.45:0/1129541673 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c0af780 con 0x7f25740bb1d0 2023-10-03T19:12:41.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.837+0000 7f2579eca640 1 -- 172.21.15.45:0/1129541673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25740bb1d0 msgr2=0x7f25740c12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:41.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.837+0000 7f2579eca640 1 --2- 172.21.15.45:0/1129541673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25740bb1d0 0x7f25740c12a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2574089fd0 tx=0x7f256c01f180 comp rx=0 tx=0).stop 2023-10-03T19:12:41.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.837+0000 7f2579eca640 1 -- 172.21.15.45:0/1129541673 shutdown_connections 2023-10-03T19:12:41.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.837+0000 7f2579eca640 1 --2- 172.21.15.45:0/1129541673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25740bb1d0 0x7f25740c12a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.837+0000 7f2579eca640 1 --2- 172.21.15.45:0/1129541673 >> v2:172.21.15.79:3300/0 conn(0x7f25740c2790 0x7f25741528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.837+0000 7f2579eca640 1 -- 172.21.15.45:0/1129541673 >> 172.21.15.45:0/1129541673 conn(0x7f25740a64a0 msgr2=0x7f25740a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:41.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.837+0000 7f2579eca640 1 -- 172.21.15.45:0/1129541673 shutdown_connections 2023-10-03T19:12:41.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.837+0000 7f2579eca640 1 -- 172.21.15.45:0/1129541673 wait complete. 2023-10-03T19:12:41.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.841+0000 7f2579eca640 1 Processor -- start 2023-10-03T19:12:41.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.841+0000 7f2579eca640 1 -- start start 2023-10-03T19:12:41.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.841+0000 7f2579eca640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25740bb1d0 0x7f25741e7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:41.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.841+0000 7f2579eca640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25740c2790 0x7f25740be150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:41.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.841+0000 7f2579eca640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f257414f240 0x7f25740a31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:41.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.841+0000 7f2579eca640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25740a9610 con 0x7f25740bb1d0 2023-10-03T19:12:41.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.841+0000 7f2579eca640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25741e4820 con 0x7f25740c2790 2023-10-03T19:12:41.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.841+0000 7f2579eca640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25741e4cb0 con 0x7f257414f240 2023-10-03T19:12:41.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.841+0000 7f25737fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25740bb1d0 0x7f25741e7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:41.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.841+0000 7f25737fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25740bb1d0 0x7f25741e7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41958/0 (socket says 172.21.15.45:41958) 2023-10-03T19:12:41.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.841+0000 7f25737fe640 1 -- 172.21.15.45:0/534017390 learned_addr learned my addr 172.21.15.45:0/534017390 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:41.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.841+0000 7f2573fff640 1 --2- 172.21.15.45:0/534017390 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f257414f240 0x7f25740a31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:41.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.841+0000 7f2572ffd640 1 --2- 172.21.15.45:0/534017390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25740c2790 0x7f25740be150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:41.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.841+0000 7f25737fe640 1 -- 172.21.15.45:0/534017390 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f257414f240 msgr2=0x7f25740a31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:41.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.841+0000 7f25737fe640 1 --2- 172.21.15.45:0/534017390 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f257414f240 0x7f25740a31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.841+0000 7f25737fe640 1 -- 172.21.15.45:0/534017390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25740c2790 msgr2=0x7f25740be150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:41.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.841+0000 7f25737fe640 1 --2- 172.21.15.45:0/534017390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25740c2790 0x7f25740be150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:41.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.841+0000 7f25737fe640 1 -- 172.21.15.45:0/534017390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256c009b30 con 0x7f25740bb1d0 2023-10-03T19:12:41.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.841+0000 7f25737fe640 1 --2- 172.21.15.45:0/534017390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25740bb1d0 0x7f25741e7280 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f256400b3f0 tx=0x7f256400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.841+0000 7f256bfff640 1 -- 172.21.15.45:0/534017390 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2564011830 con 0x7f25740bb1d0 2023-10-03T19:12:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.841+0000 7f256bfff640 1 -- 172.21.15.45:0/534017390 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25640119b0 con 0x7f25740bb1d0 2023-10-03T19:12:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.841+0000 7f2579eca640 1 -- 172.21.15.45:0/534017390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f257414f610 con 0x7f25740bb1d0 2023-10-03T19:12:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.841+0000 7f256bfff640 1 -- 172.21.15.45:0/534017390 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2564011d60 con 0x7f25740bb1d0 2023-10-03T19:12:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.841+0000 7f2579eca640 1 -- 172.21.15.45:0/534017390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25740a3f40 con 0x7f25740bb1d0 2023-10-03T19:12:41.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.841+0000 7f2579eca640 1 -- 172.21.15.45:0/534017390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25740bf360 con 0x7f25740bb1d0 2023-10-03T19:12:41.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.841+0000 7f256bfff640 1 -- 172.21.15.45:0/534017390 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f256401a400 con 0x7f25740bb1d0 2023-10-03T19:12:41.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.845+0000 7f256bfff640 1 --2- 172.21.15.45:0/534017390 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2554066280 0x7f2554068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:41.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.845+0000 7f256bfff640 1 -- 172.21.15.45:0/534017390 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2564083f10 con 0x7f25740bb1d0 2023-10-03T19:12:41.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.845+0000 7f2572ffd640 1 --2- 172.21.15.45:0/534017390 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2554066280 0x7f2554068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:41.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.845+0000 7f2572ffd640 1 --2- 172.21.15.45:0/534017390 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2554066280 0x7f2554068730 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f25740a8f50 tx=0x7f255c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:41.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:41.849+0000 7f256bfff640 1 -- 172.21.15.45:0/534017390 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2564051380 con 0x7f25740bb1d0 2023-10-03T19:12:42.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.005+0000 7f2579eca640 1 -- 172.21.15.45:0/534017390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25740bfa60 con 0x7f25740bb1d0 2023-10-03T19:12:42.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.005+0000 7f256bfff640 1 -- 172.21.15.45:0/534017390 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18231 (secure 0 0 0) 0x7f2564015070 con 0x7f25740bb1d0 2023-10-03T19:12:42.011 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:42.011 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:12:28.941467+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:12:26.226431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T19:12:26.923174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:12:42.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.009+0000 7f2579eca640 1 -- 172.21.15.45:0/534017390 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2554066280 msgr2=0x7f2554068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:42.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.009+0000 7f2579eca640 1 --2- 172.21.15.45:0/534017390 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2554066280 0x7f2554068730 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f25740a8f50 tx=0x7f255c008040 comp rx=0 tx=0).stop 2023-10-03T19:12:42.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.009+0000 7f2579eca640 1 -- 172.21.15.45:0/534017390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25740bb1d0 msgr2=0x7f25741e7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:42.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.009+0000 7f2579eca640 1 --2- 172.21.15.45:0/534017390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25740bb1d0 0x7f25741e7280 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f256400b3f0 tx=0x7f256400b8b0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.009+0000 7f2579eca640 1 -- 172.21.15.45:0/534017390 shutdown_connections 2023-10-03T19:12:42.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.009+0000 7f2579eca640 1 --2- 172.21.15.45:0/534017390 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2554066280 0x7f2554068730 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.009+0000 7f2579eca640 1 --2- 172.21.15.45:0/534017390 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f257414f240 0x7f25740a31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.009+0000 7f2579eca640 1 --2- 172.21.15.45:0/534017390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25740c2790 0x7f25740be150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.009+0000 7f2579eca640 1 --2- 172.21.15.45:0/534017390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25740bb1d0 0x7f25741e7280 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.009+0000 7f2579eca640 1 -- 172.21.15.45:0/534017390 >> 172.21.15.45:0/534017390 conn(0x7f25740a64a0 msgr2=0x7f257414beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:42.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.009+0000 7f2579eca640 1 -- 172.21.15.45:0/534017390 shutdown_connections 2023-10-03T19:12:42.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.009+0000 7f2579eca640 1 -- 172.21.15.45:0/534017390 wait complete. 2023-10-03T19:12:42.030 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T19:12:26.226431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T19:12:26.923174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:12:42.031 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:12:42.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.149+0000 7f2ddb3f8640 1 Processor -- start 2023-10-03T19:12:42.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.153+0000 7f2ddb3f8640 1 -- start start 2023-10-03T19:12:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.153+0000 7f2ddb3f8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2dd40712c0 0x7f2dd40bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.153+0000 7f2ddb3f8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2dd406d560 0x7f2dd40bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.153+0000 7f2ddb3f8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2dd406c760 0x7f2dd40a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.153+0000 7f2ddb3f8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dd406c2d0 con 0x7f2dd406d560 2023-10-03T19:12:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.153+0000 7f2ddb3f8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dd4150610 con 0x7f2dd406c760 2023-10-03T19:12:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.153+0000 7f2ddb3f8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd41508b0 con 0x7f2dd40712c0 2023-10-03T19:12:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.153+0000 7f2dd8993640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2dd406d560 0x7f2dd40bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.153+0000 7f2dd8993640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2dd406d560 0x7f2dd40bd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41974/0 (socket says 172.21.15.45:41974) 2023-10-03T19:12:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.153+0000 7f2dd8993640 1 -- 172.21.15.45:0/3009835607 learned_addr learned my addr 172.21.15.45:0/3009835607 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.153+0000 7f2dd9194640 1 --2- 172.21.15.45:0/3009835607 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2dd40712c0 0x7f2dd40bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:42.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.153+0000 7f2dd9995640 1 --2- 172.21.15.45:0/3009835607 >> v2:172.21.15.79:3300/0 conn(0x7f2dd406c760 0x7f2dd40a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:42.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.153+0000 7f2dd8993640 1 -- 172.21.15.45:0/3009835607 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2dd40712c0 msgr2=0x7f2dd40bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:42.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.153+0000 7f2dd8993640 1 --2- 172.21.15.45:0/3009835607 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2dd40712c0 0x7f2dd40bcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.153+0000 7f2dd8993640 1 -- 172.21.15.45:0/3009835607 >> v2:172.21.15.79:3300/0 conn(0x7f2dd406c760 msgr2=0x7f2dd40a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:42.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.153+0000 7f2dd8993640 1 --2- 172.21.15.45:0/3009835607 >> v2:172.21.15.79:3300/0 conn(0x7f2dd406c760 0x7f2dd40a53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.153+0000 7f2dd8993640 1 -- 172.21.15.45:0/3009835607 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd406d2e0 con 0x7f2dd406d560 2023-10-03T19:12:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.153+0000 7f2dd8993640 1 --2- 172.21.15.45:0/3009835607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd406d560 0x7f2dd40bd100 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2dd406afd0 tx=0x7f2dd001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa40cf5260fc9a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.153+0000 7f2dc7fff640 1 -- 172.21.15.45:0/3009835607 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd00a5790 con 0x7f2dd406d560 2023-10-03T19:12:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2dc7fff640 1 -- 172.21.15.45:0/3009835607 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd00a58f0 con 0x7f2dd406d560 2023-10-03T19:12:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2dc7fff640 1 -- 172.21.15.45:0/3009835607 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd00a5c80 con 0x7f2dd406d560 2023-10-03T19:12:42.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2ddb3f8640 1 -- 172.21.15.45:0/3009835607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd406d560 msgr2=0x7f2dd40bd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:42.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2ddb3f8640 1 --2- 172.21.15.45:0/3009835607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd406d560 0x7f2dd40bd100 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2dd406afd0 tx=0x7f2dd001c9d0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2ddb3f8640 1 -- 172.21.15.45:0/3009835607 shutdown_connections 2023-10-03T19:12:42.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2ddb3f8640 1 --2- 172.21.15.45:0/3009835607 >> v2:172.21.15.79:3300/0 conn(0x7f2dd406c760 0x7f2dd40a53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2ddb3f8640 1 --2- 172.21.15.45:0/3009835607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd406d560 0x7f2dd40bd100 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2ddb3f8640 1 --2- 172.21.15.45:0/3009835607 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2dd40712c0 0x7f2dd40bcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2ddb3f8640 1 -- 172.21.15.45:0/3009835607 >> 172.21.15.45:0/3009835607 conn(0x7f2dd40a20d0 msgr2=0x7f2dd40a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:42.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2ddb3f8640 1 -- 172.21.15.45:0/3009835607 shutdown_connections 2023-10-03T19:12:42.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2ddb3f8640 1 -- 172.21.15.45:0/3009835607 wait complete. 2023-10-03T19:12:42.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2ddb3f8640 1 Processor -- start 2023-10-03T19:12:42.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2ddb3f8640 1 -- start start 2023-10-03T19:12:42.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2ddb3f8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2dd406c760 0x7f2dd4139190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:42.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2ddb3f8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd406d560 0x7f2dd41396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:42.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2ddb3f8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2dd40712c0 0x7f2dd40bf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:42.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2ddb3f8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd4149090 con 0x7f2dd406d560 2023-10-03T19:12:42.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2ddb3f8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd4139c10 con 0x7f2dd40712c0 2023-10-03T19:12:42.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2ddb3f8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd414dc00 con 0x7f2dd406c760 2023-10-03T19:12:42.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2dd8993640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd406d560 0x7f2dd41396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:42.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2dd8993640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd406d560 0x7f2dd41396d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41980/0 (socket says 172.21.15.45:41980) 2023-10-03T19:12:42.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2dd8993640 1 -- 172.21.15.45:0/2726573804 learned_addr learned my addr 172.21.15.45:0/2726573804 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:42.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2dd9995640 1 --2- 172.21.15.45:0/2726573804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2dd40712c0 0x7f2dd40bf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:42.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2dd9194640 1 --2- 172.21.15.45:0/2726573804 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2dd406c760 0x7f2dd4139190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:42.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2dd8993640 1 -- 172.21.15.45:0/2726573804 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2dd406c760 msgr2=0x7f2dd4139190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:42.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2dd8993640 1 --2- 172.21.15.45:0/2726573804 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2dd406c760 0x7f2dd4139190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2dd8993640 1 -- 172.21.15.45:0/2726573804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2dd40712c0 msgr2=0x7f2dd40bf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:42.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2dd8993640 1 --2- 172.21.15.45:0/2726573804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2dd40712c0 0x7f2dd40bf2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2dd8993640 1 -- 172.21.15.45:0/2726573804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd0009b30 con 0x7f2dd406d560 2023-10-03T19:12:42.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2dd9194640 1 --2- 172.21.15.45:0/2726573804 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2dd406c760 0x7f2dd4139190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:12:42.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2dd8993640 1 --2- 172.21.15.45:0/2726573804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd406d560 0x7f2dd41396d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2dd001b080 tx=0x7f2dd0019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:42.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2dc5ffb640 1 -- 172.21.15.45:0/2726573804 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd00b8670 con 0x7f2dd406d560 2023-10-03T19:12:42.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2dc5ffb640 1 -- 172.21.15.45:0/2726573804 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd00b87d0 con 0x7f2dd406d560 2023-10-03T19:12:42.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2dc5ffb640 1 -- 172.21.15.45:0/2726573804 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd00b8b80 con 0x7f2dd406d560 2023-10-03T19:12:42.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2ddb3f8640 1 -- 172.21.15.45:0/2726573804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd414c780 con 0x7f2dd406d560 2023-10-03T19:12:42.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.157+0000 7f2ddb3f8640 1 -- 172.21.15.45:0/2726573804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dd414c5f0 con 0x7f2dd406d560 2023-10-03T19:12:42.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.161+0000 7f2ddb3f8640 1 -- 172.21.15.45:0/2726573804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dd414c910 con 0x7f2dd406d560 2023-10-03T19:12:42.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.161+0000 7f2dc5ffb640 1 -- 172.21.15.45:0/2726573804 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2dd00b8ce0 con 0x7f2dd406d560 2023-10-03T19:12:42.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.161+0000 7f2dc5ffb640 1 --2- 172.21.15.45:0/2726573804 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2db8066280 0x7f2db8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:42.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.161+0000 7f2dc5ffb640 1 -- 172.21.15.45:0/2726573804 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2dd011f110 con 0x7f2dd406d560 2023-10-03T19:12:42.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.161+0000 7f2dd9194640 1 --2- 172.21.15.45:0/2726573804 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2db8066280 0x7f2db8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:42.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.161+0000 7f2dd9194640 1 --2- 172.21.15.45:0/2726573804 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2db8066280 0x7f2db8068730 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2dc800b9f0 tx=0x7f2dc8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:42.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.165+0000 7f2dc5ffb640 1 -- 172.21.15.45:0/2726573804 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2dd00ec620 con 0x7f2dd406d560 2023-10-03T19:12:42.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.317+0000 7f2ddb3f8640 1 -- 172.21.15.45:0/2726573804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2dd40bd1f0 con 0x7f2dd406d560 2023-10-03T19:12:42.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.317+0000 7f2dc5ffb640 1 -- 172.21.15.45:0/2726573804 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2dd00b6440 con 0x7f2dd406d560 2023-10-03T19:12:42.323 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:12:42.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.321+0000 7f2ddb3f8640 1 -- 172.21.15.45:0/2726573804 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2db8066280 msgr2=0x7f2db8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:42.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.321+0000 7f2ddb3f8640 1 --2- 172.21.15.45:0/2726573804 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2db8066280 0x7f2db8068730 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2dc800b9f0 tx=0x7f2dc8008040 comp rx=0 tx=0).stop 2023-10-03T19:12:42.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.321+0000 7f2ddb3f8640 1 -- 172.21.15.45:0/2726573804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd406d560 msgr2=0x7f2dd41396d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:42.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.321+0000 7f2ddb3f8640 1 --2- 172.21.15.45:0/2726573804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd406d560 0x7f2dd41396d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2dd001b080 tx=0x7f2dd0019770 comp rx=0 tx=0).stop 2023-10-03T19:12:42.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.321+0000 7f2ddb3f8640 1 -- 172.21.15.45:0/2726573804 shutdown_connections 2023-10-03T19:12:42.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.321+0000 7f2ddb3f8640 1 --2- 172.21.15.45:0/2726573804 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2db8066280 0x7f2db8068730 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.321+0000 7f2ddb3f8640 1 --2- 172.21.15.45:0/2726573804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2dd40712c0 0x7f2dd40bf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.321+0000 7f2ddb3f8640 1 --2- 172.21.15.45:0/2726573804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd406d560 0x7f2dd41396d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.321+0000 7f2ddb3f8640 1 --2- 172.21.15.45:0/2726573804 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2dd406c760 0x7f2dd4139190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.321+0000 7f2ddb3f8640 1 -- 172.21.15.45:0/2726573804 >> 172.21.15.45:0/2726573804 conn(0x7f2dd40a20d0 msgr2=0x7f2dd41471a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:42.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.321+0000 7f2ddb3f8640 1 -- 172.21.15.45:0/2726573804 shutdown_connections 2023-10-03T19:12:42.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.321+0000 7f2ddb3f8640 1 -- 172.21.15.45:0/2726573804 wait complete. 2023-10-03T19:12:42.343 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:12:42.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.465+0000 7fe6819dc640 1 Processor -- start 2023-10-03T19:12:42.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.465+0000 7fe6819dc640 1 -- start start 2023-10-03T19:12:42.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.465+0000 7fe6819dc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe67c0712c0 0x7fe67c0bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:42.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.465+0000 7fe6819dc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe67c06c760 0x7fe67c0bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:42.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.465+0000 7fe6819dc640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe67c06c2d0 con 0x7fe67c06d560 2023-10-03T19:12:42.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.465+0000 7fe6819dc640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe67c150610 con 0x7fe67c0712c0 2023-10-03T19:12:42.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.465+0000 7fe6819dc640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe67c1508b0 con 0x7fe67c06c760 2023-10-03T19:12:42.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.465+0000 7fe67affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe67c0712c0 0x7fe67c0bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:42.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.465+0000 7fe67affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe67c0712c0 0x7fe67c0bcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41996/0 (socket says 172.21.15.45:41996) 2023-10-03T19:12:42.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.465+0000 7fe67affd640 1 -- 172.21.15.45:0/4160622200 learned_addr learned my addr 172.21.15.45:0/4160622200 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:42.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.465+0000 7fe67affd640 1 -- 172.21.15.45:0/4160622200 >> v2:172.21.15.79:3300/0 conn(0x7fe67c06c760 msgr2=0x7fe67c0bd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:42.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.465+0000 7fe67affd640 1 --2- 172.21.15.45:0/4160622200 >> v2:172.21.15.79:3300/0 conn(0x7fe67c06c760 0x7fe67c0bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.465+0000 7fe67affd640 1 -- 172.21.15.45:0/4160622200 >> v1:172.21.15.79:6789/0 conn(0x7fe67c06d560 legacy=0x7fe67c0a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:42.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.465+0000 7fe67affd640 1 -- 172.21.15.45:0/4160622200 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe67c06d2e0 con 0x7fe67c0712c0 2023-10-03T19:12:42.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.469+0000 7fe67affd640 1 --2- 172.21.15.45:0/4160622200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67c0712c0 0x7fe67c0bcbc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe67c0c14e0 tx=0x7fe66c01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b17720ab44648c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:42.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.469+0000 7fe679ffb640 1 -- 172.21.15.45:0/4160622200 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c0ab600 con 0x7fe67c0712c0 2023-10-03T19:12:42.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.469+0000 7fe679ffb640 1 -- 172.21.15.45:0/4160622200 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66c0ab760 con 0x7fe67c0712c0 2023-10-03T19:12:42.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.469+0000 7fe679ffb640 1 -- 172.21.15.45:0/4160622200 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c0abaf0 con 0x7fe67c0712c0 2023-10-03T19:12:42.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.469+0000 7fe6819dc640 1 -- 172.21.15.45:0/4160622200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67c0712c0 msgr2=0x7fe67c0bcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:42.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.469+0000 7fe6819dc640 1 --2- 172.21.15.45:0/4160622200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67c0712c0 0x7fe67c0bcbc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe67c0c14e0 tx=0x7fe66c01c4c0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.469+0000 7fe6819dc640 1 -- 172.21.15.45:0/4160622200 shutdown_connections 2023-10-03T19:12:42.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.469+0000 7fe6819dc640 1 --2- 172.21.15.45:0/4160622200 >> v2:172.21.15.79:3300/0 conn(0x7fe67c06c760 0x7fe67c0bd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.469+0000 7fe6819dc640 1 --2- 172.21.15.45:0/4160622200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67c0712c0 0x7fe67c0bcbc0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.469+0000 7fe6819dc640 1 -- 172.21.15.45:0/4160622200 >> 172.21.15.45:0/4160622200 conn(0x7fe67c0a20d0 msgr2=0x7fe67c0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:42.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.469+0000 7fe6819dc640 1 -- 172.21.15.45:0/4160622200 shutdown_connections 2023-10-03T19:12:42.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.469+0000 7fe6819dc640 1 -- 172.21.15.45:0/4160622200 wait complete. 2023-10-03T19:12:42.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.469+0000 7fe6819dc640 1 Processor -- start 2023-10-03T19:12:42.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.469+0000 7fe6819dc640 1 -- start start 2023-10-03T19:12:42.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.469+0000 7fe6819dc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe67c06c760 0x7fe67c0b5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:42.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.469+0000 7fe6819dc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67c06d560 0x7fe67c14dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:42.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.469+0000 7fe6819dc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe67c0712c0 0x7fe67c1e4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:42.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.469+0000 7fe6819dc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67c0b5b30 con 0x7fe67c06d560 2023-10-03T19:12:42.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.469+0000 7fe6819dc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67c14e100 con 0x7fe67c06c760 2023-10-03T19:12:42.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.469+0000 7fe6819dc640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe67c0b9e80 con 0x7fe67c0712c0 2023-10-03T19:12:42.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.469+0000 7fe67a7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67c06d560 0x7fe67c14dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:42.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.469+0000 7fe67a7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67c06d560 0x7fe67c14dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42002/0 (socket says 172.21.15.45:42002) 2023-10-03T19:12:42.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.469+0000 7fe67a7fc640 1 -- 172.21.15.45:0/1494631458 learned_addr learned my addr 172.21.15.45:0/1494631458 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:42.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.469+0000 7fe67affd640 1 --2- 172.21.15.45:0/1494631458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe67c06c760 0x7fe67c0b5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:42.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.469+0000 7fe67b7fe640 1 --2- 172.21.15.45:0/1494631458 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe67c0712c0 0x7fe67c1e4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:42.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.469+0000 7fe67a7fc640 1 -- 172.21.15.45:0/1494631458 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe67c0712c0 msgr2=0x7fe67c1e4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:42.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.469+0000 7fe67a7fc640 1 --2- 172.21.15.45:0/1494631458 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe67c0712c0 0x7fe67c1e4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.469+0000 7fe67a7fc640 1 -- 172.21.15.45:0/1494631458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe67c06c760 msgr2=0x7fe67c0b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:42.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.469+0000 7fe67a7fc640 1 --2- 172.21.15.45:0/1494631458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe67c06c760 0x7fe67c0b5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.469+0000 7fe67a7fc640 1 -- 172.21.15.45:0/1494631458 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66c0094d0 con 0x7fe67c06d560 2023-10-03T19:12:42.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.473+0000 7fe67affd640 1 --2- 172.21.15.45:0/1494631458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe67c06c760 0x7fe67c0b5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:42.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.473+0000 7fe67b7fe640 1 --2- 172.21.15.45:0/1494631458 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe67c0712c0 0x7fe67c1e4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:42.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.473+0000 7fe67a7fc640 1 --2- 172.21.15.45:0/1494631458 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67c06d560 0x7fe67c14dbc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe66400c490 tx=0x7fe664001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:42.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.473+0000 7fe673fff640 1 -- 172.21.15.45:0/1494631458 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe664003600 con 0x7fe67c06d560 2023-10-03T19:12:42.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.473+0000 7fe673fff640 1 -- 172.21.15.45:0/1494631458 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe664003780 con 0x7fe67c06d560 2023-10-03T19:12:42.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.473+0000 7fe673fff640 1 -- 172.21.15.45:0/1494631458 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe664003b30 con 0x7fe67c06d560 2023-10-03T19:12:42.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.473+0000 7fe6819dc640 1 -- 172.21.15.45:0/1494631458 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe67c0a6070 con 0x7fe67c06d560 2023-10-03T19:12:42.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.473+0000 7fe6819dc640 1 -- 172.21.15.45:0/1494631458 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe67c0a5ee0 con 0x7fe67c06d560 2023-10-03T19:12:42.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.473+0000 7fe6819dc640 1 -- 172.21.15.45:0/1494631458 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe67c1596f0 con 0x7fe67c06d560 2023-10-03T19:12:42.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.473+0000 7fe673fff640 1 -- 172.21.15.45:0/1494631458 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe664003c90 con 0x7fe67c06d560 2023-10-03T19:12:42.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.473+0000 7fe673fff640 1 --2- 172.21.15.45:0/1494631458 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe65c066280 0x7fe65c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:42.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.473+0000 7fe673fff640 1 -- 172.21.15.45:0/1494631458 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe664082f80 con 0x7fe67c06d560 2023-10-03T19:12:42.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.473+0000 7fe67affd640 1 --2- 172.21.15.45:0/1494631458 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe65c066280 0x7fe65c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:42.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.473+0000 7fe67affd640 1 --2- 172.21.15.45:0/1494631458 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe65c066280 0x7fe65c068730 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe66c0af000 tx=0x7fe66c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:42.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.477+0000 7fe673fff640 1 -- 172.21.15.45:0/1494631458 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe6640b36f0 con 0x7fe67c06d560 2023-10-03T19:12:42.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.633+0000 7fe6819dc640 1 -- 172.21.15.45:0/1494631458 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe67c0b5ce0 con 0x7fe67c06d560 2023-10-03T19:12:42.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.633+0000 7fe673fff640 1 -- 172.21.15.45:0/1494631458 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe664017020 con 0x7fe67c06d560 2023-10-03T19:12:42.637 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:12:42.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.633+0000 7fe6819dc640 1 -- 172.21.15.45:0/1494631458 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe65c066280 msgr2=0x7fe65c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:42.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.633+0000 7fe6819dc640 1 --2- 172.21.15.45:0/1494631458 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe65c066280 0x7fe65c068730 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe66c0af000 tx=0x7fe66c008040 comp rx=0 tx=0).stop 2023-10-03T19:12:42.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.633+0000 7fe6819dc640 1 -- 172.21.15.45:0/1494631458 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67c06d560 msgr2=0x7fe67c14dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:42.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.633+0000 7fe6819dc640 1 --2- 172.21.15.45:0/1494631458 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67c06d560 0x7fe67c14dbc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe66400c490 tx=0x7fe664001e80 comp rx=0 tx=0).stop 2023-10-03T19:12:42.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.633+0000 7fe6819dc640 1 -- 172.21.15.45:0/1494631458 shutdown_connections 2023-10-03T19:12:42.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.633+0000 7fe6819dc640 1 --2- 172.21.15.45:0/1494631458 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe65c066280 0x7fe65c068730 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.633+0000 7fe6819dc640 1 --2- 172.21.15.45:0/1494631458 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe67c0712c0 0x7fe67c1e4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.633+0000 7fe6819dc640 1 --2- 172.21.15.45:0/1494631458 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67c06d560 0x7fe67c14dbc0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.633+0000 7fe6819dc640 1 --2- 172.21.15.45:0/1494631458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe67c06c760 0x7fe67c0b5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.633+0000 7fe6819dc640 1 -- 172.21.15.45:0/1494631458 >> 172.21.15.45:0/1494631458 conn(0x7fe67c0a20d0 msgr2=0x7fe67c0be010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:42.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.633+0000 7fe6819dc640 1 -- 172.21.15.45:0/1494631458 shutdown_connections 2023-10-03T19:12:42.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.633+0000 7fe6819dc640 1 -- 172.21.15.45:0/1494631458 wait complete. 2023-10-03T19:12:42.656 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T19:12:42.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaf0260640 1 Processor -- start 2023-10-03T19:12:42.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaf0260640 1 -- start start 2023-10-03T19:12:42.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaf0260640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffae814ba30 0x7ffae8156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:42.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaf0260640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffae814f080 con 0x7ffae806f880 2023-10-03T19:12:42.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaf0260640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffae8070e90 con 0x7ffae814f510 2023-10-03T19:12:42.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaf0260640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffae806f3e0 con 0x7ffae814ba30 2023-10-03T19:12:42.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaedffc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ffae806f880 0x7ffae80a5940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33558/0 (socket says 172.21.15.45:33558) 2023-10-03T19:12:42.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaedffc640 1 -- 172.21.15.45:0/630314992 learned_addr learned my addr 172.21.15.45:0/630314992 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:42.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaee7fd640 1 --2- 172.21.15.45:0/630314992 >> v2:172.21.15.79:3300/0 conn(0x7ffae814ba30 0x7ffae8156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:42.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaecffa640 1 -- 172.21.15.45:0/630314992 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 82128322 0 0) 0x7ffae814f080 con 0x7ffae806f880 2023-10-03T19:12:42.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaecffa640 1 -- 172.21.15.45:0/630314992 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffad4003530 con 0x7ffae806f880 2023-10-03T19:12:42.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaecffa640 1 -- 172.21.15.45:0/630314992 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1573823617 0 0) 0x7ffad4003530 con 0x7ffae806f880 2023-10-03T19:12:42.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaecffa640 1 -- 172.21.15.45:0/630314992 >> v2:172.21.15.79:3300/0 conn(0x7ffae814ba30 msgr2=0x7ffae8156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:42.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaecffa640 1 --2- 172.21.15.45:0/630314992 >> v2:172.21.15.79:3300/0 conn(0x7ffae814ba30 0x7ffae8156bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaecffa640 1 -- 172.21.15.45:0/630314992 >> v1:172.21.15.79:6789/0 conn(0x7ffae814f510 legacy=0x7ffae814b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:42.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaecffa640 1 -- 172.21.15.45:0/630314992 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae814ea30 con 0x7ffae806f880 2023-10-03T19:12:42.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaecffa640 1 -- 172.21.15.45:0/630314992 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7ffae4001680 con 0x7ffae806f880 2023-10-03T19:12:42.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaecffa640 1 -- 172.21.15.45:0/630314992 >> v1:172.21.15.45:6789/0 conn(0x7ffae806f880 legacy=0x7ffae80a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:42.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaecffa640 1 --2- 172.21.15.45:0/630314992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffad4003980 0x7ffad4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:42.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaecffa640 1 --2- 172.21.15.45:0/630314992 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffad40047d0 0x7ffad4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:42.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaecffa640 1 --2- 172.21.15.45:0/630314992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffad4005180 0x7ffad400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:42.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaecffa640 1 -- 172.21.15.45:0/630314992 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae806f3e0 con 0x7ffad4003980 2023-10-03T19:12:42.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaecffa640 1 -- 172.21.15.45:0/630314992 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad400c000 con 0x7ffad4005180 2023-10-03T19:12:42.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaecffa640 1 -- 172.21.15.45:0/630314992 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad400c1c0 con 0x7ffad40047d0 2023-10-03T19:12:42.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaedffc640 1 --2- 172.21.15.45:0/630314992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffad4003980 0x7ffad4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:42.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaed7fb640 1 --2- 172.21.15.45:0/630314992 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffad40047d0 0x7ffad4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:42.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaedffc640 1 -- 172.21.15.45:0/630314992 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffad40047d0 msgr2=0x7ffad4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:42.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaedffc640 1 --2- 172.21.15.45:0/630314992 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffad40047d0 0x7ffad4004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaedffc640 1 -- 172.21.15.45:0/630314992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffad4005180 msgr2=0x7ffad400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:42.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaedffc640 1 --2- 172.21.15.45:0/630314992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffad4005180 0x7ffad400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaedffc640 1 -- 172.21.15.45:0/630314992 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad4003530 con 0x7ffad4003980 2023-10-03T19:12:42.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.785+0000 7ffaee7fd640 1 -- 172.21.15.45:0/630314992 reap_dead start 2023-10-03T19:12:42.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.789+0000 7ffaedffc640 1 --2- 172.21.15.45:0/630314992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffad4003980 0x7ffad4003d90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ffae400c240 tx=0x7ffae401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=322b5b65b04e1299 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:42.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.789+0000 7ffaecffa640 1 -- 172.21.15.45:0/630314992 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae4005ae0 con 0x7ffad4003980 2023-10-03T19:12:42.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.789+0000 7ffaecffa640 1 -- 172.21.15.45:0/630314992 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae4005c40 con 0x7ffad4003980 2023-10-03T19:12:42.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.789+0000 7ffaecffa640 1 -- 172.21.15.45:0/630314992 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae40a59b0 con 0x7ffad4003980 2023-10-03T19:12:42.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.789+0000 7ffaf0260640 1 -- 172.21.15.45:0/630314992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffad4003980 msgr2=0x7ffad4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:42.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.789+0000 7ffaf0260640 1 --2- 172.21.15.45:0/630314992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffad4003980 0x7ffad4003d90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ffae400c240 tx=0x7ffae401cc10 comp rx=0 tx=0).stop 2023-10-03T19:12:42.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.789+0000 7ffaf0260640 1 -- 172.21.15.45:0/630314992 shutdown_connections 2023-10-03T19:12:42.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.789+0000 7ffaf0260640 1 --2- 172.21.15.45:0/630314992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffad4003980 0x7ffad4003d90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.789+0000 7ffaf0260640 1 -- 172.21.15.45:0/630314992 >> 172.21.15.45:0/630314992 conn(0x7ffae80a20d0 msgr2=0x7ffae80a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:42.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.789+0000 7ffaf0260640 1 -- 172.21.15.45:0/630314992 shutdown_connections 2023-10-03T19:12:42.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.789+0000 7ffaf0260640 1 -- 172.21.15.45:0/630314992 wait complete. 2023-10-03T19:12:42.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.789+0000 7ffaf0260640 1 Processor -- start 2023-10-03T19:12:42.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.789+0000 7ffaf0260640 1 -- start start 2023-10-03T19:12:42.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.789+0000 7ffaf0260640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffad4003980 0x7ffae813be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:42.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.789+0000 7ffaf0260640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffae8140f90 0x7ffae80bfb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:42.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.789+0000 7ffaf0260640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffae80be010 0x7ffae8141730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:42.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.789+0000 7ffaf0260640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae8145230 con 0x7ffae80be010 2023-10-03T19:12:42.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.789+0000 7ffaf0260640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae8140b00 con 0x7ffae8140f90 2023-10-03T19:12:42.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.789+0000 7ffaf0260640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffae81401d0 con 0x7ffad4003980 2023-10-03T19:12:42.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.789+0000 7ffaee7fd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffae80be010 0x7ffae8141730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:42.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.789+0000 7ffaee7fd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffae80be010 0x7ffae8141730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42014/0 (socket says 172.21.15.45:42014) 2023-10-03T19:12:42.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.789+0000 7ffaee7fd640 1 -- 172.21.15.45:0/907163092 learned_addr learned my addr 172.21.15.45:0/907163092 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:42.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.789+0000 7ffaed7fb640 1 --2- 172.21.15.45:0/907163092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffae8140f90 0x7ffae80bfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:42.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.789+0000 7ffaedffc640 1 --2- 172.21.15.45:0/907163092 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffad4003980 0x7ffae813be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:42.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.789+0000 7ffaee7fd640 1 -- 172.21.15.45:0/907163092 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffad4003980 msgr2=0x7ffae813be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:42.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.789+0000 7ffaee7fd640 1 --2- 172.21.15.45:0/907163092 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffad4003980 0x7ffae813be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.793+0000 7ffaee7fd640 1 -- 172.21.15.45:0/907163092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffae8140f90 msgr2=0x7ffae80bfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:42.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.793+0000 7ffaee7fd640 1 --2- 172.21.15.45:0/907163092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffae8140f90 0x7ffae80bfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.793+0000 7ffaee7fd640 1 -- 172.21.15.45:0/907163092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae806fc50 con 0x7ffae80be010 2023-10-03T19:12:42.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.793+0000 7ffaee7fd640 1 --2- 172.21.15.45:0/907163092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffae80be010 0x7ffae8141730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ffae814f8e0 tx=0x7ffae000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:42.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.793+0000 7ffade7fc640 1 -- 172.21.15.45:0/907163092 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae0010040 con 0x7ffae80be010 2023-10-03T19:12:42.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.793+0000 7ffade7fc640 1 -- 172.21.15.45:0/907163092 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae000eed0 con 0x7ffae80be010 2023-10-03T19:12:42.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.793+0000 7ffaf0260640 1 -- 172.21.15.45:0/907163092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae80a6150 con 0x7ffae80be010 2023-10-03T19:12:42.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.793+0000 7ffade7fc640 1 -- 172.21.15.45:0/907163092 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae0014a70 con 0x7ffae80be010 2023-10-03T19:12:42.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.793+0000 7ffaf0260640 1 -- 172.21.15.45:0/907163092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae814b730 con 0x7ffae80be010 2023-10-03T19:12:42.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.793+0000 7ffaf0260640 1 -- 172.21.15.45:0/907163092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffae8141360 con 0x7ffae80be010 2023-10-03T19:12:42.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.793+0000 7ffade7fc640 1 -- 172.21.15.45:0/907163092 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffae0014bd0 con 0x7ffae80be010 2023-10-03T19:12:42.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.793+0000 7ffade7fc640 1 --2- 172.21.15.45:0/907163092 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ffacc066280 0x7ffacc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:42.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.793+0000 7ffade7fc640 1 -- 172.21.15.45:0/907163092 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffae0083900 con 0x7ffae80be010 2023-10-03T19:12:42.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.793+0000 7ffaedffc640 1 --2- 172.21.15.45:0/907163092 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ffacc066280 0x7ffacc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:42.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.793+0000 7ffaedffc640 1 --2- 172.21.15.45:0/907163092 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ffacc066280 0x7ffacc068730 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffae40ab000 tx=0x7ffae40b1040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:42.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.797+0000 7ffade7fc640 1 -- 172.21.15.45:0/907163092 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ffae0054780 con 0x7ffae80be010 2023-10-03T19:12:42.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.949+0000 7ffaf0260640 1 -- 172.21.15.45:0/907163092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffae804de80 con 0x7ffae80be010 2023-10-03T19:12:42.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.949+0000 7ffade7fc640 1 -- 172.21.15.45:0/907163092 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffae0054310 con 0x7ffae80be010 2023-10-03T19:12:42.954 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-03T19:12:42.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.953+0000 7ffaf0260640 1 -- 172.21.15.45:0/907163092 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ffacc066280 msgr2=0x7ffacc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:42.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.953+0000 7ffaf0260640 1 --2- 172.21.15.45:0/907163092 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ffacc066280 0x7ffacc068730 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffae40ab000 tx=0x7ffae40b1040 comp rx=0 tx=0).stop 2023-10-03T19:12:42.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.953+0000 7ffaf0260640 1 -- 172.21.15.45:0/907163092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffae80be010 msgr2=0x7ffae8141730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:42.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.953+0000 7ffaf0260640 1 --2- 172.21.15.45:0/907163092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffae80be010 0x7ffae8141730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ffae814f8e0 tx=0x7ffae000eb80 comp rx=0 tx=0).stop 2023-10-03T19:12:42.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.953+0000 7ffaf0260640 1 -- 172.21.15.45:0/907163092 shutdown_connections 2023-10-03T19:12:42.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.953+0000 7ffaf0260640 1 --2- 172.21.15.45:0/907163092 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ffacc066280 0x7ffacc068730 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.953+0000 7ffaf0260640 1 --2- 172.21.15.45:0/907163092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffae80be010 0x7ffae8141730 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.953+0000 7ffaf0260640 1 --2- 172.21.15.45:0/907163092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffae8140f90 0x7ffae80bfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.953+0000 7ffaf0260640 1 --2- 172.21.15.45:0/907163092 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffad4003980 0x7ffae813be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:42.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.953+0000 7ffaf0260640 1 -- 172.21.15.45:0/907163092 >> 172.21.15.45:0/907163092 conn(0x7ffae80a20d0 msgr2=0x7ffae8142460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:42.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.953+0000 7ffaf0260640 1 -- 172.21.15.45:0/907163092 shutdown_connections 2023-10-03T19:12:42.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:42.953+0000 7ffaf0260640 1 -- 172.21.15.45:0/907163092 wait complete. 2023-10-03T19:12:42.973 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T19:12:43.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.081+0000 7f698ab27640 1 Processor -- start 2023-10-03T19:12:43.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.081+0000 7f698ab27640 1 -- start start 2023-10-03T19:12:43.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.085+0000 7f698ab27640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f698406f880 0x7f69840a5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:43.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.085+0000 7f698ab27640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f698414f510 0x7f698414b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:43.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.085+0000 7f698ab27640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f69840bd9f0 0x7f698414b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:43.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.085+0000 7f698ab27640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f698406f3e0 con 0x7f698406f880 2023-10-03T19:12:43.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.085+0000 7f698ab27640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f698414f080 con 0x7f69840bd9f0 2023-10-03T19:12:43.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.085+0000 7f698ab27640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6984070e90 con 0x7f698414f510 2023-10-03T19:12:43.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.085+0000 7f69888c3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f698406f880 0x7f69840a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:43.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.085+0000 7f69888c3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f698406f880 0x7f69840a5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42018/0 (socket says 172.21.15.45:42018) 2023-10-03T19:12:43.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.085+0000 7f69888c3640 1 -- 172.21.15.45:0/4122525963 learned_addr learned my addr 172.21.15.45:0/4122525963 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:43.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.085+0000 7f69888c3640 1 -- 172.21.15.45:0/4122525963 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f698414f510 msgr2=0x7f698414b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:43.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.085+0000 7f69888c3640 1 --2- 172.21.15.45:0/4122525963 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f698414f510 0x7f698414b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.085+0000 7f69888c3640 1 -- 172.21.15.45:0/4122525963 >> v2:172.21.15.79:3300/0 conn(0x7f69840bd9f0 msgr2=0x7f698414b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:43.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.085+0000 7f69890c4640 1 --2- 172.21.15.45:0/4122525963 >> v2:172.21.15.79:3300/0 conn(0x7f69840bd9f0 0x7f698414b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:43.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.085+0000 7f69888c3640 1 --2- 172.21.15.45:0/4122525963 >> v2:172.21.15.79:3300/0 conn(0x7f69840bd9f0 0x7f698414b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.085+0000 7f69888c3640 1 -- 172.21.15.45:0/4122525963 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698414ea30 con 0x7f698406f880 2023-10-03T19:12:43.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.089+0000 7f69888c3640 1 --2- 172.21.15.45:0/4122525963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f698406f880 0x7f69840a5940 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f69840a2080 tx=0x7f697401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec9066ce46655cc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:43.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.089+0000 7f69837fe640 1 -- 172.21.15.45:0/4122525963 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69740ab5f0 con 0x7f698406f880 2023-10-03T19:12:43.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.089+0000 7f69837fe640 1 -- 172.21.15.45:0/4122525963 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69740ab750 con 0x7f698406f880 2023-10-03T19:12:43.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.089+0000 7f69837fe640 1 -- 172.21.15.45:0/4122525963 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69740abae0 con 0x7f698406f880 2023-10-03T19:12:43.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.089+0000 7f698ab27640 1 -- 172.21.15.45:0/4122525963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f698406f880 msgr2=0x7f69840a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:43.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.089+0000 7f698ab27640 1 --2- 172.21.15.45:0/4122525963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f698406f880 0x7f69840a5940 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f69840a2080 tx=0x7f697401c4d0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.089+0000 7f698ab27640 1 -- 172.21.15.45:0/4122525963 shutdown_connections 2023-10-03T19:12:43.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.089+0000 7f698ab27640 1 --2- 172.21.15.45:0/4122525963 >> v2:172.21.15.79:3300/0 conn(0x7f69840bd9f0 0x7f698414b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.089+0000 7f698ab27640 1 --2- 172.21.15.45:0/4122525963 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f698414f510 0x7f698414b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.089+0000 7f698ab27640 1 --2- 172.21.15.45:0/4122525963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f698406f880 0x7f69840a5940 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.089+0000 7f698ab27640 1 -- 172.21.15.45:0/4122525963 >> 172.21.15.45:0/4122525963 conn(0x7f69840a20d0 msgr2=0x7f69840a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:43.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.089+0000 7f698ab27640 1 -- 172.21.15.45:0/4122525963 shutdown_connections 2023-10-03T19:12:43.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.089+0000 7f698ab27640 1 -- 172.21.15.45:0/4122525963 wait complete. 2023-10-03T19:12:43.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.093+0000 7f698ab27640 1 Processor -- start 2023-10-03T19:12:43.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.093+0000 7f698ab27640 1 -- start start 2023-10-03T19:12:43.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.093+0000 7f698ab27640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f698406f880 0x7f6984146b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:43.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.093+0000 7f698ab27640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f69840bd9f0 0x7f69841e8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:43.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.093+0000 7f698ab27640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f698414f510 0x7f698414cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:43.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.093+0000 7f698ab27640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6984147050 con 0x7f698414f510 2023-10-03T19:12:43.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.093+0000 7f698ab27640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69841e86f0 con 0x7f698406f880 2023-10-03T19:12:43.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.093+0000 7f698ab27640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6984146870 con 0x7f69840bd9f0 2023-10-03T19:12:43.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.093+0000 7f69890c4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f698414f510 0x7f698414cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:43.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.093+0000 7f69890c4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f698414f510 0x7f698414cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42024/0 (socket says 172.21.15.45:42024) 2023-10-03T19:12:43.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.093+0000 7f69890c4640 1 -- 172.21.15.45:0/2616378296 learned_addr learned my addr 172.21.15.45:0/2616378296 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:43.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.093+0000 7f69888c3640 1 --2- 172.21.15.45:0/2616378296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f698406f880 0x7f6984146b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:43.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.093+0000 7f6983fff640 1 --2- 172.21.15.45:0/2616378296 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f69840bd9f0 0x7f69841e8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:43.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.093+0000 7f69890c4640 1 -- 172.21.15.45:0/2616378296 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f69840bd9f0 msgr2=0x7f69841e8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:43.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.093+0000 7f69890c4640 1 --2- 172.21.15.45:0/2616378296 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f69840bd9f0 0x7f69841e8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.093+0000 7f69890c4640 1 -- 172.21.15.45:0/2616378296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f698406f880 msgr2=0x7f6984146b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:43.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.093+0000 7f69890c4640 1 --2- 172.21.15.45:0/2616378296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f698406f880 0x7f6984146b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.093+0000 7f69890c4640 1 -- 172.21.15.45:0/2616378296 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69740094d0 con 0x7f698414f510 2023-10-03T19:12:43.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.093+0000 7f69890c4640 1 --2- 172.21.15.45:0/2616378296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f698414f510 0x7f698414cd70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f697c00cd70 tx=0x7f697c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:43.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.093+0000 7f69817fa640 1 -- 172.21.15.45:0/2616378296 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c003ba0 con 0x7f698414f510 2023-10-03T19:12:43.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.093+0000 7f69817fa640 1 -- 172.21.15.45:0/2616378296 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697c003d00 con 0x7f698414f510 2023-10-03T19:12:43.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.093+0000 7f698ab27640 1 -- 172.21.15.45:0/2616378296 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6984070a40 con 0x7f698414f510 2023-10-03T19:12:43.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.093+0000 7f69817fa640 1 -- 172.21.15.45:0/2616378296 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c004240 con 0x7f698414f510 2023-10-03T19:12:43.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.093+0000 7f698ab27640 1 -- 172.21.15.45:0/2616378296 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f698406fc50 con 0x7f698414f510 2023-10-03T19:12:43.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.097+0000 7f698ab27640 1 -- 172.21.15.45:0/2616378296 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6984070bd0 con 0x7f698414f510 2023-10-03T19:12:43.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.097+0000 7f69817fa640 1 -- 172.21.15.45:0/2616378296 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f697c0043a0 con 0x7f698414f510 2023-10-03T19:12:43.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.097+0000 7f69817fa640 1 --2- 172.21.15.45:0/2616378296 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f69640662b0 0x7f6964068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:43.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.097+0000 7f69817fa640 1 -- 172.21.15.45:0/2616378296 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f697c012070 con 0x7f698414f510 2023-10-03T19:12:43.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.097+0000 7f69888c3640 1 --2- 172.21.15.45:0/2616378296 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f69640662b0 0x7f6964068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:43.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.097+0000 7f69888c3640 1 --2- 172.21.15.45:0/2616378296 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f69640662b0 0x7f6964068760 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f69740af000 tx=0x7f69740a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:43.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.101+0000 7f69817fa640 1 -- 172.21.15.45:0/2616378296 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f697c051b20 con 0x7f698414f510 2023-10-03T19:12:43.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.257+0000 7f698ab27640 1 -- 172.21.15.45:0/2616378296 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f69841e5280 con 0x7f698414f510 2023-10-03T19:12:43.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.257+0000 7f69817fa640 1 -- 172.21.15.45:0/2616378296 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f697c055140 con 0x7f698414f510 2023-10-03T19:12:43.260 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-03T19:12:43.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.257+0000 7f698ab27640 1 -- 172.21.15.45:0/2616378296 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f69640662b0 msgr2=0x7f6964068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:43.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.257+0000 7f698ab27640 1 --2- 172.21.15.45:0/2616378296 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f69640662b0 0x7f6964068760 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f69740af000 tx=0x7f69740a7000 comp rx=0 tx=0).stop 2023-10-03T19:12:43.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.257+0000 7f698ab27640 1 -- 172.21.15.45:0/2616378296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f698414f510 msgr2=0x7f698414cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:43.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.257+0000 7f698ab27640 1 --2- 172.21.15.45:0/2616378296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f698414f510 0x7f698414cd70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f697c00cd70 tx=0x7f697c00a660 comp rx=0 tx=0).stop 2023-10-03T19:12:43.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.257+0000 7f698ab27640 1 -- 172.21.15.45:0/2616378296 shutdown_connections 2023-10-03T19:12:43.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.257+0000 7f698ab27640 1 --2- 172.21.15.45:0/2616378296 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f69640662b0 0x7f6964068760 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.257+0000 7f698ab27640 1 --2- 172.21.15.45:0/2616378296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f698414f510 0x7f698414cd70 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.257+0000 7f698ab27640 1 --2- 172.21.15.45:0/2616378296 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f69840bd9f0 0x7f69841e8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.257+0000 7f698ab27640 1 --2- 172.21.15.45:0/2616378296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f698406f880 0x7f6984146b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.257+0000 7f698ab27640 1 -- 172.21.15.45:0/2616378296 >> 172.21.15.45:0/2616378296 conn(0x7f69840a20d0 msgr2=0x7f698414a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:43.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.257+0000 7f698ab27640 1 -- 172.21.15.45:0/2616378296 shutdown_connections 2023-10-03T19:12:43.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.257+0000 7f698ab27640 1 -- 172.21.15.45:0/2616378296 wait complete. 2023-10-03T19:12:43.280 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:12:43.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.389+0000 7fb4c893c640 1 Processor -- start 2023-10-03T19:12:43.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.389+0000 7fb4c893c640 1 -- start start 2023-10-03T19:12:43.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c893c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4c406f170 0x7fb4c4150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:43.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c893c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb4c40bc8b0 0x7fb4c414ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:43.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c893c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c406cac0 con 0x7fb4c406d170 2023-10-03T19:12:43.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c893c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c40720d0 con 0x7fb4c40bc8b0 2023-10-03T19:12:43.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c893c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c40a5ab0 con 0x7fb4c406f170 2023-10-03T19:12:43.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c2d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb4c406d170 0x7fb4c414cfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33572/0 (socket says 172.21.15.45:33572) 2023-10-03T19:12:43.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c2d9d640 1 -- 172.21.15.45:0/4110141097 learned_addr learned my addr 172.21.15.45:0/4110141097 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:43.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c259c640 1 --2- 172.21.15.45:0/4110141097 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4c406f170 0x7fb4c4150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:43.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c1d9b640 1 --2- 172.21.15.45:0/4110141097 >> v2:172.21.15.79:3300/0 conn(0x7fb4c40bc8b0 0x7fb4c414ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:43.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c159a640 1 -- 172.21.15.45:0/4110141097 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3433404183 0 0) 0x7fb4b4001120 con 0x7fb4c406d170 2023-10-03T19:12:43.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c159a640 1 -- 172.21.15.45:0/4110141097 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4b0003530 con 0x7fb4c406d170 2023-10-03T19:12:43.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c159a640 1 -- 172.21.15.45:0/4110141097 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1880312206 0 0) 0x7fb4b0003530 con 0x7fb4c406d170 2023-10-03T19:12:43.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c159a640 1 -- 172.21.15.45:0/4110141097 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4c406f170 msgr2=0x7fb4c4150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:43.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c159a640 1 --2- 172.21.15.45:0/4110141097 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4c406f170 0x7fb4c4150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c159a640 1 -- 172.21.15.45:0/4110141097 >> v2:172.21.15.79:3300/0 conn(0x7fb4c40bc8b0 msgr2=0x7fb4c414ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:43.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c159a640 1 --2- 172.21.15.45:0/4110141097 >> v2:172.21.15.79:3300/0 conn(0x7fb4c40bc8b0 0x7fb4c414ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c159a640 1 -- 172.21.15.45:0/4110141097 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c406cd00 con 0x7fb4c406d170 2023-10-03T19:12:43.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c159a640 1 -- 172.21.15.45:0/4110141097 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fb4b4001810 con 0x7fb4c406d170 2023-10-03T19:12:43.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c159a640 1 -- 172.21.15.45:0/4110141097 >> v1:172.21.15.45:6789/0 conn(0x7fb4c406d170 legacy=0x7fb4c414cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:43.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c159a640 1 --2- 172.21.15.45:0/4110141097 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4c406f170 0x7fb4b0003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:43.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c159a640 1 --2- 172.21.15.45:0/4110141097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4b0003f00 0x7fb4b00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:43.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c159a640 1 --2- 172.21.15.45:0/4110141097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4b0004d10 0x7fb4b0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:43.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c159a640 1 -- 172.21.15.45:0/4110141097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c40720d0 con 0x7fb4b0004d10 2023-10-03T19:12:43.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c159a640 1 -- 172.21.15.45:0/4110141097 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c40a5ab0 con 0x7fb4b0003f00 2023-10-03T19:12:43.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c159a640 1 -- 172.21.15.45:0/4110141097 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b000b9c0 con 0x7fb4c406f170 2023-10-03T19:12:43.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c2d9d640 1 --2- 172.21.15.45:0/4110141097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4b0004d10 0x7fb4b0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:43.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c259c640 1 --2- 172.21.15.45:0/4110141097 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4c406f170 0x7fb4b0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:43.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c2d9d640 1 -- 172.21.15.45:0/4110141097 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4c406f170 msgr2=0x7fb4b0003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:43.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c2d9d640 1 --2- 172.21.15.45:0/4110141097 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4c406f170 0x7fb4b0003980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c2d9d640 1 -- 172.21.15.45:0/4110141097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4b0003f00 msgr2=0x7fb4b00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:43.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c2d9d640 1 --2- 172.21.15.45:0/4110141097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4b0003f00 0x7fb4b00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c2d9d640 1 -- 172.21.15.45:0/4110141097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b0003530 con 0x7fb4b0004d10 2023-10-03T19:12:43.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.393+0000 7fb4c2d9d640 1 --2- 172.21.15.45:0/4110141097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4b0004d10 0x7fb4b0005180 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb4b400c210 tx=0x7fb4b401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a3553697d19c797 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:43.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c159a640 1 -- 172.21.15.45:0/4110141097 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b40a5940 con 0x7fb4b0004d10 2023-10-03T19:12:43.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c159a640 1 -- 172.21.15.45:0/4110141097 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b40a5aa0 con 0x7fb4b0004d10 2023-10-03T19:12:43.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c159a640 1 -- 172.21.15.45:0/4110141097 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b40a5e50 con 0x7fb4b0004d10 2023-10-03T19:12:43.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c893c640 1 -- 172.21.15.45:0/4110141097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4b0004d10 msgr2=0x7fb4b0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:43.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c893c640 1 --2- 172.21.15.45:0/4110141097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4b0004d10 0x7fb4b0005180 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb4b400c210 tx=0x7fb4b401cc40 comp rx=0 tx=0).stop 2023-10-03T19:12:43.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c2d9d640 1 -- 172.21.15.45:0/4110141097 reap_dead start 2023-10-03T19:12:43.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c893c640 1 -- 172.21.15.45:0/4110141097 shutdown_connections 2023-10-03T19:12:43.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c893c640 1 -- 172.21.15.45:0/4110141097 >> 172.21.15.45:0/4110141097 conn(0x7fb4c40bcf50 msgr2=0x7fb4c40bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:43.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c893c640 1 -- 172.21.15.45:0/4110141097 shutdown_connections 2023-10-03T19:12:43.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c893c640 1 -- 172.21.15.45:0/4110141097 wait complete. 2023-10-03T19:12:43.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c893c640 1 Processor -- start 2023-10-03T19:12:43.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c893c640 1 -- start start 2023-10-03T19:12:43.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c893c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4b0004d10 0x7fb4c40bf760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:43.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c893c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4c41d79c0 0x7fb4c413e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:43.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c893c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4c40bfca0 0x7fb4c413e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:43.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c893c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c4141220 con 0x7fb4c40bfca0 2023-10-03T19:12:43.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c893c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c41e21f0 con 0x7fb4c41d79c0 2023-10-03T19:12:43.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c893c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c41e24d0 con 0x7fb4b0004d10 2023-10-03T19:12:43.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c2d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4c40bfca0 0x7fb4c413e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:43.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c2d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4c40bfca0 0x7fb4c413e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42042/0 (socket says 172.21.15.45:42042) 2023-10-03T19:12:43.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c2d9d640 1 -- 172.21.15.45:0/1238013722 learned_addr learned my addr 172.21.15.45:0/1238013722 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:43.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c259c640 1 --2- 172.21.15.45:0/1238013722 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4b0004d10 0x7fb4c40bf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:43.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c1d9b640 1 --2- 172.21.15.45:0/1238013722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4c41d79c0 0x7fb4c413e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:43.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c2d9d640 1 -- 172.21.15.45:0/1238013722 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4b0004d10 msgr2=0x7fb4c40bf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:43.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c2d9d640 1 --2- 172.21.15.45:0/1238013722 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4b0004d10 0x7fb4c40bf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c2d9d640 1 -- 172.21.15.45:0/1238013722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4c41d79c0 msgr2=0x7fb4c413e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:43.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c2d9d640 1 --2- 172.21.15.45:0/1238013722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4c41d79c0 0x7fb4c413e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c2d9d640 1 -- 172.21.15.45:0/1238013722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c414c4a0 con 0x7fb4c40bfca0 2023-10-03T19:12:43.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c259c640 1 --2- 172.21.15.45:0/1238013722 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4b0004d10 0x7fb4c40bf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:43.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c2d9d640 1 --2- 172.21.15.45:0/1238013722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4c40bfca0 0x7fb4c413e750 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb4b40ab040 tx=0x7fb4b0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:43.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4baffd640 1 -- 172.21.15.45:0/1238013722 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4000e90 con 0x7fb4c40bfca0 2023-10-03T19:12:43.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4baffd640 1 -- 172.21.15.45:0/1238013722 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b40b3070 con 0x7fb4c40bfca0 2023-10-03T19:12:43.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4baffd640 1 -- 172.21.15.45:0/1238013722 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4007530 con 0x7fb4c40bfca0 2023-10-03T19:12:43.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c893c640 1 -- 172.21.15.45:0/1238013722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c414fae0 con 0x7fb4c40bfca0 2023-10-03T19:12:43.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.397+0000 7fb4c893c640 1 -- 172.21.15.45:0/1238013722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c406f540 con 0x7fb4c40bfca0 2023-10-03T19:12:43.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.401+0000 7fb4c893c640 1 -- 172.21.15.45:0/1238013722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c406d660 con 0x7fb4c40bfca0 2023-10-03T19:12:43.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.401+0000 7fb4baffd640 1 -- 172.21.15.45:0/1238013722 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb4b4007690 con 0x7fb4c40bfca0 2023-10-03T19:12:43.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.401+0000 7fb4baffd640 1 --2- 172.21.15.45:0/1238013722 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb4a4066280 0x7fb4a4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:43.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.401+0000 7fb4baffd640 1 -- 172.21.15.45:0/1238013722 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb4b40b5070 con 0x7fb4c40bfca0 2023-10-03T19:12:43.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.401+0000 7fb4c259c640 1 --2- 172.21.15.45:0/1238013722 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb4a4066280 0x7fb4a4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:43.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.401+0000 7fb4c259c640 1 --2- 172.21.15.45:0/1238013722 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb4a4066280 0x7fb4a4068730 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc007460 tx=0x7fb4bc00d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:43.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.405+0000 7fb4baffd640 1 -- 172.21.15.45:0/1238013722 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb4b40eaa90 con 0x7fb4c40bfca0 2023-10-03T19:12:43.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.589+0000 7fb4c893c640 1 -- 172.21.15.45:0/1238013722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4c41e2680 con 0x7fb4c40bfca0 2023-10-03T19:12:43.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.589+0000 7fb4baffd640 1 -- 172.21.15.45:0/1238013722 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3903 (secure 0 0 0) 0x7fb4c41e2680 con 0x7fb4c40bfca0 2023-10-03T19:12:43.594 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:43.595 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/731286206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":731286206},{"type":"v1","addr":"172.21.15.45:6834","nonce":731286206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/144609891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":144609891},{"type":"v1","addr":"172.21.15.45:6835","nonce":144609891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:12:27.938475+0000","modified":"2023-10-03T19:12:30.957787+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/2693877820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2693877820},{"type":"v1","addr":"172.21.15.79:6835","nonce":2693877820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-03T19:12:43.595 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 7 2023-10-03T19:12:43.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.593+0000 7fb4c893c640 1 -- 172.21.15.45:0/1238013722 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb4a4066280 msgr2=0x7fb4a4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:43.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.593+0000 7fb4c893c640 1 --2- 172.21.15.45:0/1238013722 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb4a4066280 0x7fb4a4068730 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc007460 tx=0x7fb4bc00d040 comp rx=0 tx=0).stop 2023-10-03T19:12:43.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.593+0000 7fb4c893c640 1 -- 172.21.15.45:0/1238013722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4c40bfca0 msgr2=0x7fb4c413e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:43.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.593+0000 7fb4c893c640 1 --2- 172.21.15.45:0/1238013722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4c40bfca0 0x7fb4c413e750 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb4b40ab040 tx=0x7fb4b0005800 comp rx=0 tx=0).stop 2023-10-03T19:12:43.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.593+0000 7fb4c893c640 1 -- 172.21.15.45:0/1238013722 shutdown_connections 2023-10-03T19:12:43.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.593+0000 7fb4c893c640 1 --2- 172.21.15.45:0/1238013722 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb4a4066280 0x7fb4a4068730 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.593+0000 7fb4c893c640 1 --2- 172.21.15.45:0/1238013722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4c40bfca0 0x7fb4c413e750 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.593+0000 7fb4c893c640 1 --2- 172.21.15.45:0/1238013722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4c41d79c0 0x7fb4c413e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.593+0000 7fb4c893c640 1 --2- 172.21.15.45:0/1238013722 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4b0004d10 0x7fb4c40bf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.593+0000 7fb4c893c640 1 -- 172.21.15.45:0/1238013722 >> 172.21.15.45:0/1238013722 conn(0x7fb4c40bcf50 msgr2=0x7fb4c40bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:43.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.593+0000 7fb4c893c640 1 -- 172.21.15.45:0/1238013722 shutdown_connections 2023-10-03T19:12:43.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.593+0000 7fb4c893c640 1 -- 172.21.15.45:0/1238013722 wait complete. 2023-10-03T19:12:43.612 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:12:43.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.725+0000 7fd9eee32640 1 Processor -- start 2023-10-03T19:12:43.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.725+0000 7fd9eee32640 1 -- start start 2023-10-03T19:12:43.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.729+0000 7fd9eee32640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd9e80b98f0 0x7fd9e80b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:43.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.729+0000 7fd9eee32640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd9e80a2e20 0x7fd9e806c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:43.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.729+0000 7fd9eee32640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9e80ba550 con 0x7fd9e80bc810 2023-10-03T19:12:43.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.729+0000 7fd9eee32640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9e81526d0 con 0x7fd9e80a2e20 2023-10-03T19:12:43.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.729+0000 7fd9eee32640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e81529b0 con 0x7fd9e80b98f0 2023-10-03T19:12:43.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.729+0000 7fd9ed3cf640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd9e80a2e20 0x7fd9e806c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:43.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.729+0000 7fd9ed3cf640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd9e80a2e20 0x7fd9e806c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42046/0 (socket says 172.21.15.45:42046) 2023-10-03T19:12:43.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.729+0000 7fd9ed3cf640 1 -- 172.21.15.45:0/2424343302 learned_addr learned my addr 172.21.15.45:0/2424343302 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:43.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.729+0000 7fd9ecbce640 1 --2- 172.21.15.45:0/2424343302 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd9e80b98f0 0x7fd9e80b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:43.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.729+0000 7fd9ed3cf640 1 -- 172.21.15.45:0/2424343302 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd9e80b98f0 msgr2=0x7fd9e80b9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:43.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.729+0000 7fd9ed3cf640 1 --2- 172.21.15.45:0/2424343302 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd9e80b98f0 0x7fd9e80b9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.729+0000 7fd9ed3cf640 1 -- 172.21.15.45:0/2424343302 >> v1:172.21.15.79:6789/0 conn(0x7fd9e80bc810 legacy=0x7fd9e806c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:43.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.729+0000 7fd9ed3cf640 1 -- 172.21.15.45:0/2424343302 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e806cee0 con 0x7fd9e80a2e20 2023-10-03T19:12:43.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.729+0000 7fd9ed3cf640 1 --2- 172.21.15.45:0/2424343302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e80a2e20 0x7fd9e806c9a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0009e50 tx=0x7fd9e001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9cdd9fc8c110adc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:43.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.729+0000 7fd9e77fe640 1 -- 172.21.15.45:0/2424343302 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e00af400 con 0x7fd9e80a2e20 2023-10-03T19:12:43.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.729+0000 7fd9e77fe640 1 -- 172.21.15.45:0/2424343302 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e00ab050 con 0x7fd9e80a2e20 2023-10-03T19:12:43.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.729+0000 7fd9e77fe640 1 -- 172.21.15.45:0/2424343302 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e00af780 con 0x7fd9e80a2e20 2023-10-03T19:12:43.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.729+0000 7fd9eee32640 1 -- 172.21.15.45:0/2424343302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e80a2e20 msgr2=0x7fd9e806c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:43.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.729+0000 7fd9eee32640 1 --2- 172.21.15.45:0/2424343302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e80a2e20 0x7fd9e806c9a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0009e50 tx=0x7fd9e001f1c0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.729+0000 7fd9eee32640 1 -- 172.21.15.45:0/2424343302 shutdown_connections 2023-10-03T19:12:43.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.729+0000 7fd9eee32640 1 --2- 172.21.15.45:0/2424343302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e80a2e20 0x7fd9e806c9a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.729+0000 7fd9eee32640 1 --2- 172.21.15.45:0/2424343302 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd9e80b98f0 0x7fd9e80b9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.729+0000 7fd9eee32640 1 -- 172.21.15.45:0/2424343302 >> 172.21.15.45:0/2424343302 conn(0x7fd9e80bcf50 msgr2=0x7fd9e80bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:43.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.729+0000 7fd9eee32640 1 -- 172.21.15.45:0/2424343302 shutdown_connections 2023-10-03T19:12:43.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.729+0000 7fd9eee32640 1 -- 172.21.15.45:0/2424343302 wait complete. 2023-10-03T19:12:43.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.733+0000 7fd9eee32640 1 Processor -- start 2023-10-03T19:12:43.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.733+0000 7fd9eee32640 1 -- start start 2023-10-03T19:12:43.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.733+0000 7fd9eee32640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e80a2e20 0x7fd9e81e7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:43.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.733+0000 7fd9eee32640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9e80b98f0 0x7fd9e81e7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:43.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.733+0000 7fd9eee32640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd9e80bc810 0x7fd9e81441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:43.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.733+0000 7fd9eee32640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e81e8500 con 0x7fd9e80a2e20 2023-10-03T19:12:43.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.733+0000 7fd9eee32640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e81e7d50 con 0x7fd9e80b98f0 2023-10-03T19:12:43.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.733+0000 7fd9eee32640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e8145490 con 0x7fd9e80bc810 2023-10-03T19:12:43.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.733+0000 7fd9ecbce640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e80a2e20 0x7fd9e81e7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:43.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.733+0000 7fd9ecbce640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e80a2e20 0x7fd9e81e7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42058/0 (socket says 172.21.15.45:42058) 2023-10-03T19:12:43.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.733+0000 7fd9ecbce640 1 -- 172.21.15.45:0/661146007 learned_addr learned my addr 172.21.15.45:0/661146007 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:43.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.733+0000 7fd9ed3cf640 1 --2- 172.21.15.45:0/661146007 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd9e80bc810 0x7fd9e81441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:43.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.733+0000 7fd9e7fff640 1 --2- 172.21.15.45:0/661146007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9e80b98f0 0x7fd9e81e7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:43.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.733+0000 7fd9ecbce640 1 -- 172.21.15.45:0/661146007 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd9e80bc810 msgr2=0x7fd9e81441c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:43.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.733+0000 7fd9ecbce640 1 --2- 172.21.15.45:0/661146007 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd9e80bc810 0x7fd9e81441c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.733+0000 7fd9ecbce640 1 -- 172.21.15.45:0/661146007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9e80b98f0 msgr2=0x7fd9e81e7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:43.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.733+0000 7fd9ecbce640 1 --2- 172.21.15.45:0/661146007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9e80b98f0 0x7fd9e81e7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.733+0000 7fd9ecbce640 1 -- 172.21.15.45:0/661146007 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e0009b30 con 0x7fd9e80a2e20 2023-10-03T19:12:43.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.733+0000 7fd9e7fff640 1 --2- 172.21.15.45:0/661146007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9e80b98f0 0x7fd9e81e7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:43.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.733+0000 7fd9ecbce640 1 --2- 172.21.15.45:0/661146007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e80a2e20 0x7fd9e81e7fc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd9d800d800 tx=0x7fd9d800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:43.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.733+0000 7fd9e57fa640 1 -- 172.21.15.45:0/661146007 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d800b6c0 con 0x7fd9e80a2e20 2023-10-03T19:12:43.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.733+0000 7fd9e57fa640 1 -- 172.21.15.45:0/661146007 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d800b820 con 0x7fd9e80a2e20 2023-10-03T19:12:43.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.733+0000 7fd9eee32640 1 -- 172.21.15.45:0/661146007 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9e80ba950 con 0x7fd9e80a2e20 2023-10-03T19:12:43.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.733+0000 7fd9e57fa640 1 -- 172.21.15.45:0/661146007 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d800bb90 con 0x7fd9e80a2e20 2023-10-03T19:12:43.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.733+0000 7fd9eee32640 1 -- 172.21.15.45:0/661146007 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e80ba200 con 0x7fd9e80a2e20 2023-10-03T19:12:43.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.733+0000 7fd9eee32640 1 -- 172.21.15.45:0/661146007 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e80baae0 con 0x7fd9e80a2e20 2023-10-03T19:12:43.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.737+0000 7fd9e57fa640 1 -- 172.21.15.45:0/661146007 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd9d800bcf0 con 0x7fd9e80a2e20 2023-10-03T19:12:43.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.737+0000 7fd9e57fa640 1 --2- 172.21.15.45:0/661146007 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd9d40662b0 0x7fd9d4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:43.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.737+0000 7fd9e57fa640 1 -- 172.21.15.45:0/661146007 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd9d8084d30 con 0x7fd9e80a2e20 2023-10-03T19:12:43.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.737+0000 7fd9e7fff640 1 --2- 172.21.15.45:0/661146007 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd9d40662b0 0x7fd9d4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:43.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.737+0000 7fd9e7fff640 1 --2- 172.21.15.45:0/661146007 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd9d40662b0 0x7fd9d4068760 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd9e80a5cd0 tx=0x7fd9dc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:43.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.737+0000 7fd9e57fa640 1 -- 172.21.15.45:0/661146007 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd9d8052290 con 0x7fd9e80a2e20 2023-10-03T19:12:43.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.893+0000 7fd9eee32640 1 -- 172.21.15.45:0/661146007 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9e804de80 con 0x7fd9e80a2e20 2023-10-03T19:12:43.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.897+0000 7fd9e57fa640 1 -- 172.21.15.45:0/661146007 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18231 (secure 0 0 0) 0x7fd9d805b020 con 0x7fd9e80a2e20 2023-10-03T19:12:43.900 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:43.900 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:12:28.941467+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:12:26.226431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T19:12:26.923174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:12:43.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.897+0000 7fd9eee32640 1 -- 172.21.15.45:0/661146007 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd9d40662b0 msgr2=0x7fd9d4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:43.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.897+0000 7fd9eee32640 1 --2- 172.21.15.45:0/661146007 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd9d40662b0 0x7fd9d4068760 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd9e80a5cd0 tx=0x7fd9dc008040 comp rx=0 tx=0).stop 2023-10-03T19:12:43.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.897+0000 7fd9eee32640 1 -- 172.21.15.45:0/661146007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e80a2e20 msgr2=0x7fd9e81e7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:43.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.897+0000 7fd9eee32640 1 --2- 172.21.15.45:0/661146007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e80a2e20 0x7fd9e81e7fc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd9d800d800 tx=0x7fd9d800dcc0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.897+0000 7fd9eee32640 1 -- 172.21.15.45:0/661146007 shutdown_connections 2023-10-03T19:12:43.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.897+0000 7fd9eee32640 1 --2- 172.21.15.45:0/661146007 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd9d40662b0 0x7fd9d4068760 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.897+0000 7fd9eee32640 1 --2- 172.21.15.45:0/661146007 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd9e80bc810 0x7fd9e81441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.897+0000 7fd9eee32640 1 --2- 172.21.15.45:0/661146007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9e80b98f0 0x7fd9e81e7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.897+0000 7fd9eee32640 1 --2- 172.21.15.45:0/661146007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e80a2e20 0x7fd9e81e7fc0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:43.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.897+0000 7fd9eee32640 1 -- 172.21.15.45:0/661146007 >> 172.21.15.45:0/661146007 conn(0x7fd9e80bcf50 msgr2=0x7fd9e80a48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:43.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.897+0000 7fd9eee32640 1 -- 172.21.15.45:0/661146007 shutdown_connections 2023-10-03T19:12:43.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:43.897+0000 7fd9eee32640 1 -- 172.21.15.45:0/661146007 wait complete. 2023-10-03T19:12:43.920 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:12:44.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.041+0000 7fbbd7766640 1 Processor -- start 2023-10-03T19:12:44.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.045+0000 7fbbd7766640 1 -- start start 2023-10-03T19:12:44.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.045+0000 7fbbd7766640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbbd00bc8b0 0x7fbbd014ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:44.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.045+0000 7fbbd7766640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbbd006d170 0x7fbbd014cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:44.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.045+0000 7fbbd7766640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd006cac0 con 0x7fbbd006f170 2023-10-03T19:12:44.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.045+0000 7fbbd7766640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd014d4f0 con 0x7fbbd00bc8b0 2023-10-03T19:12:44.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.045+0000 7fbbd7766640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd00720d0 con 0x7fbbd006d170 2023-10-03T19:12:44.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.045+0000 7fbbd5d03640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbbd006d170 0x7fbbd014cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:44.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.045+0000 7fbbd4d01640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbbd00bc8b0 0x7fbbd014ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:44.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.045+0000 7fbbd5d03640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbbd006d170 0x7fbbd014cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:40992/0 (socket says 172.21.15.45:40992) 2023-10-03T19:12:44.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.045+0000 7fbbd5d03640 1 -- 172.21.15.45:0/1562593645 learned_addr learned my addr 172.21.15.45:0/1562593645 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:44.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.045+0000 7fbbd5d03640 1 -- 172.21.15.45:0/1562593645 >> v2:172.21.15.79:3300/0 conn(0x7fbbd00bc8b0 msgr2=0x7fbbd014ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:44.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.045+0000 7fbbd5d03640 1 --2- 172.21.15.45:0/1562593645 >> v2:172.21.15.79:3300/0 conn(0x7fbbd00bc8b0 0x7fbbd014ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.045+0000 7fbbd5d03640 1 -- 172.21.15.45:0/1562593645 >> v1:172.21.15.79:6789/0 conn(0x7fbbd006f170 legacy=0x7fbbd0150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:44.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.045+0000 7fbbd5d03640 1 -- 172.21.15.45:0/1562593645 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd00a5ab0 con 0x7fbbd006d170 2023-10-03T19:12:44.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.049+0000 7fbbd5d03640 1 --2- 172.21.15.45:0/1562593645 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbbd006d170 0x7fbbd014cfb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8009e50 tx=0x7fbbc801f1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b0d05a69ba98bae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:44.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.049+0000 7fbbc7fff640 1 -- 172.21.15.45:0/1562593645 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc80af400 con 0x7fbbd006d170 2023-10-03T19:12:44.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.049+0000 7fbbc7fff640 1 -- 172.21.15.45:0/1562593645 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc80ab050 con 0x7fbbd006d170 2023-10-03T19:12:44.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.049+0000 7fbbc7fff640 1 -- 172.21.15.45:0/1562593645 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc80af780 con 0x7fbbd006d170 2023-10-03T19:12:44.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.049+0000 7fbbd7766640 1 -- 172.21.15.45:0/1562593645 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbbd006d170 msgr2=0x7fbbd014cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:44.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.049+0000 7fbbd7766640 1 --2- 172.21.15.45:0/1562593645 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbbd006d170 0x7fbbd014cfb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8009e50 tx=0x7fbbc801f1f0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.049+0000 7fbbd7766640 1 -- 172.21.15.45:0/1562593645 shutdown_connections 2023-10-03T19:12:44.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.049+0000 7fbbd7766640 1 --2- 172.21.15.45:0/1562593645 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbbd006d170 0x7fbbd014cfb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.049+0000 7fbbd7766640 1 --2- 172.21.15.45:0/1562593645 >> v2:172.21.15.79:3300/0 conn(0x7fbbd00bc8b0 0x7fbbd014ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.049+0000 7fbbd7766640 1 -- 172.21.15.45:0/1562593645 >> 172.21.15.45:0/1562593645 conn(0x7fbbd00bcf50 msgr2=0x7fbbd00bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:44.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.049+0000 7fbbd7766640 1 -- 172.21.15.45:0/1562593645 shutdown_connections 2023-10-03T19:12:44.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.049+0000 7fbbd7766640 1 -- 172.21.15.45:0/1562593645 wait complete. 2023-10-03T19:12:44.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.049+0000 7fbbd7766640 1 Processor -- start 2023-10-03T19:12:44.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.049+0000 7fbbd7766640 1 -- start start 2023-10-03T19:12:44.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.049+0000 7fbbd7766640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbd006d170 0x7fbbd00bafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:44.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.049+0000 7fbbd7766640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbd006f170 0x7fbbd0141690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:44.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.049+0000 7fbbd7766640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbbd00bc8b0 0x7fbbd0141bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:44.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.049+0000 7fbbd7766640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd00b6e50 con 0x7fbbd006f170 2023-10-03T19:12:44.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.049+0000 7fbbd7766640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd00ba350 con 0x7fbbd006d170 2023-10-03T19:12:44.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.049+0000 7fbbd7766640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd00bb4f0 con 0x7fbbd00bc8b0 2023-10-03T19:12:44.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.053+0000 7fbbd4d01640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbd006f170 0x7fbbd0141690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:44.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.053+0000 7fbbd4d01640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbd006f170 0x7fbbd0141690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42060/0 (socket says 172.21.15.45:42060) 2023-10-03T19:12:44.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.053+0000 7fbbd4d01640 1 -- 172.21.15.45:0/2961224046 learned_addr learned my addr 172.21.15.45:0/2961224046 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:44.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.053+0000 7fbbd5d03640 1 --2- 172.21.15.45:0/2961224046 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbbd00bc8b0 0x7fbbd0141bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:44.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.053+0000 7fbbd5502640 1 --2- 172.21.15.45:0/2961224046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbd006d170 0x7fbbd00bafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:44.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.053+0000 7fbbd4d01640 1 -- 172.21.15.45:0/2961224046 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbbd00bc8b0 msgr2=0x7fbbd0141bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:44.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.053+0000 7fbbd4d01640 1 --2- 172.21.15.45:0/2961224046 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbbd00bc8b0 0x7fbbd0141bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.053+0000 7fbbd4d01640 1 -- 172.21.15.45:0/2961224046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbd006d170 msgr2=0x7fbbd00bafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:44.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.053+0000 7fbbd4d01640 1 --2- 172.21.15.45:0/2961224046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbd006d170 0x7fbbd00bafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.053+0000 7fbbd4d01640 1 -- 172.21.15.45:0/2961224046 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc8009b30 con 0x7fbbd006f170 2023-10-03T19:12:44.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.053+0000 7fbbd4d01640 1 --2- 172.21.15.45:0/2961224046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbd006f170 0x7fbbd0141690 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000e960 tx=0x7fbbc000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:44.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.053+0000 7fbbc5ffb640 1 -- 172.21.15.45:0/2961224046 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0009690 con 0x7fbbd006f170 2023-10-03T19:12:44.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.053+0000 7fbbc5ffb640 1 -- 172.21.15.45:0/2961224046 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc000ca00 con 0x7fbbd006f170 2023-10-03T19:12:44.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.053+0000 7fbbd7766640 1 -- 172.21.15.45:0/2961224046 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd014fae0 con 0x7fbbd006f170 2023-10-03T19:12:44.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.053+0000 7fbbc5ffb640 1 -- 172.21.15.45:0/2961224046 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc000cd70 con 0x7fbbd006f170 2023-10-03T19:12:44.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.053+0000 7fbbd7766640 1 -- 172.21.15.45:0/2961224046 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd006cd00 con 0x7fbbd006f170 2023-10-03T19:12:44.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.053+0000 7fbbd7766640 1 -- 172.21.15.45:0/2961224046 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd014c4a0 con 0x7fbbd006f170 2023-10-03T19:12:44.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.053+0000 7fbbc5ffb640 1 -- 172.21.15.45:0/2961224046 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbbc0013470 con 0x7fbbd006f170 2023-10-03T19:12:44.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.053+0000 7fbbc5ffb640 1 --2- 172.21.15.45:0/2961224046 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbbb40662b0 0x7fbbb4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:44.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.053+0000 7fbbc5ffb640 1 -- 172.21.15.45:0/2961224046 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbbc0083fa0 con 0x7fbbd006f170 2023-10-03T19:12:44.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.053+0000 7fbbd5502640 1 --2- 172.21.15.45:0/2961224046 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbbb40662b0 0x7fbbb4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:44.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.053+0000 7fbbd5502640 1 --2- 172.21.15.45:0/2961224046 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbbb40662b0 0x7fbbb4068760 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc001650 tx=0x7fbbcc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:44.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.057+0000 7fbbc5ffb640 1 -- 172.21.15.45:0/2961224046 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbbc00b46f0 con 0x7fbbd006f170 2023-10-03T19:12:44.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.245+0000 7fbbd7766640 1 -- 172.21.15.45:0/2961224046 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbbd006d660 con 0x7fbbd006f170 2023-10-03T19:12:44.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.245+0000 7fbbc5ffb640 1 -- 172.21.15.45:0/2961224046 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3903 (secure 0 0 0) 0x7fbbc00513a0 con 0x7fbbd006f170 2023-10-03T19:12:44.253 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:44.253 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/731286206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":731286206},{"type":"v1","addr":"172.21.15.45:6834","nonce":731286206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/144609891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":144609891},{"type":"v1","addr":"172.21.15.45:6835","nonce":144609891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:12:27.938475+0000","modified":"2023-10-03T19:12:30.957787+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/2693877820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2693877820},{"type":"v1","addr":"172.21.15.79:6835","nonce":2693877820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-03T19:12:44.254 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 7 2023-10-03T19:12:44.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.249+0000 7fbbd7766640 1 -- 172.21.15.45:0/2961224046 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbbb40662b0 msgr2=0x7fbbb4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:44.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.249+0000 7fbbd7766640 1 --2- 172.21.15.45:0/2961224046 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbbb40662b0 0x7fbbb4068760 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc001650 tx=0x7fbbcc009040 comp rx=0 tx=0).stop 2023-10-03T19:12:44.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.249+0000 7fbbd7766640 1 -- 172.21.15.45:0/2961224046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbd006f170 msgr2=0x7fbbd0141690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:44.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.249+0000 7fbbd7766640 1 --2- 172.21.15.45:0/2961224046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbd006f170 0x7fbbd0141690 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000e960 tx=0x7fbbc000ee20 comp rx=0 tx=0).stop 2023-10-03T19:12:44.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.249+0000 7fbbd7766640 1 -- 172.21.15.45:0/2961224046 shutdown_connections 2023-10-03T19:12:44.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.249+0000 7fbbd7766640 1 --2- 172.21.15.45:0/2961224046 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbbb40662b0 0x7fbbb4068760 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.249+0000 7fbbd7766640 1 --2- 172.21.15.45:0/2961224046 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbbd00bc8b0 0x7fbbd0141bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.249+0000 7fbbd7766640 1 --2- 172.21.15.45:0/2961224046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbd006f170 0x7fbbd0141690 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.249+0000 7fbbd7766640 1 --2- 172.21.15.45:0/2961224046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbd006d170 0x7fbbd00bafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.249+0000 7fbbd7766640 1 -- 172.21.15.45:0/2961224046 >> 172.21.15.45:0/2961224046 conn(0x7fbbd00bcf50 msgr2=0x7fbbd014bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:44.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.249+0000 7fbbd7766640 1 -- 172.21.15.45:0/2961224046 shutdown_connections 2023-10-03T19:12:44.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.249+0000 7fbbd7766640 1 -- 172.21.15.45:0/2961224046 wait complete. 2023-10-03T19:12:44.573 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-03T19:12:27.938475+0000', 'modified': '2023-10-03T19:12:30.957787+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4282': {'gid': 4282, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6835/2693877820', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6834', 'nonce': 2693877820}, {'type': 'v1', 'addr': '172.21.15.79:6835', 'nonce': 2693877820}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-03T19:12:44.574 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-03T19:12:44.574 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-03T19:12:44.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3bd28d640 1 Processor -- start 2023-10-03T19:12:44.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3bd28d640 1 -- start start 2023-10-03T19:12:44.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3bd28d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe3b8157ff0 0x7fe3b815a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:44.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3bd28d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b8070d10 con 0x7fe3b8151dd0 2023-10-03T19:12:44.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3bd28d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b80bcac0 con 0x7fe3b814bbd0 2023-10-03T19:12:44.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3bd28d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b80bc7e0 con 0x7fe3b8157ff0 2023-10-03T19:12:44.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3b67fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe3b8151dd0 0x7fe3b81521c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38856/0 (socket says 172.21.15.45:38856) 2023-10-03T19:12:44.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3b67fc640 1 -- 172.21.15.45:0/3220036333 learned_addr learned my addr 172.21.15.45:0/3220036333 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:44.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3b77fe640 1 --2- 172.21.15.45:0/3220036333 >> v2:172.21.15.79:3300/0 conn(0x7fe3b8157ff0 0x7fe3b815a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:44.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3b5ffb640 1 -- 172.21.15.45:0/3220036333 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3354306472 0 0) 0x7fe3b8070d10 con 0x7fe3b8151dd0 2023-10-03T19:12:44.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3b5ffb640 1 -- 172.21.15.45:0/3220036333 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3a4003530 con 0x7fe3b8151dd0 2023-10-03T19:12:44.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3b5ffb640 1 -- 172.21.15.45:0/3220036333 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1865488068 0 0) 0x7fe3a4003530 con 0x7fe3b8151dd0 2023-10-03T19:12:44.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3b5ffb640 1 -- 172.21.15.45:0/3220036333 >> v2:172.21.15.79:3300/0 conn(0x7fe3b8157ff0 msgr2=0x7fe3b815a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:44.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3b5ffb640 1 --2- 172.21.15.45:0/3220036333 >> v2:172.21.15.79:3300/0 conn(0x7fe3b8157ff0 0x7fe3b815a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3b5ffb640 1 -- 172.21.15.45:0/3220036333 >> v1:172.21.15.79:6789/0 conn(0x7fe3b814bbd0 legacy=0x7fe3b80ba140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:44.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3b5ffb640 1 -- 172.21.15.45:0/3220036333 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b8071350 con 0x7fe3b8151dd0 2023-10-03T19:12:44.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3b5ffb640 1 -- 172.21.15.45:0/3220036333 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fe3a0001680 con 0x7fe3b8151dd0 2023-10-03T19:12:44.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3b5ffb640 1 -- 172.21.15.45:0/3220036333 >> v1:172.21.15.45:6789/0 conn(0x7fe3b8151dd0 legacy=0x7fe3b81521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:44.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3b5ffb640 1 --2- 172.21.15.45:0/3220036333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3a4003980 0x7fe3a4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:44.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3b5ffb640 1 --2- 172.21.15.45:0/3220036333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3a40047d0 0x7fe3a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:44.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3b5ffb640 1 --2- 172.21.15.45:0/3220036333 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3a4005180 0x7fe3a400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:44.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3b5ffb640 1 -- 172.21.15.45:0/3220036333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b80bc7e0 con 0x7fe3a4003980 2023-10-03T19:12:44.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3b5ffb640 1 -- 172.21.15.45:0/3220036333 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a400c000 con 0x7fe3a40047d0 2023-10-03T19:12:44.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3b5ffb640 1 -- 172.21.15.45:0/3220036333 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a400c1c0 con 0x7fe3a4005180 2023-10-03T19:12:44.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3b6ffd640 1 --2- 172.21.15.45:0/3220036333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3a4003980 0x7fe3a4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:44.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3b6ffd640 1 -- 172.21.15.45:0/3220036333 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3a4005180 msgr2=0x7fe3a400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:44.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3b6ffd640 1 --2- 172.21.15.45:0/3220036333 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3a4005180 0x7fe3a400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3b6ffd640 1 -- 172.21.15.45:0/3220036333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3a40047d0 msgr2=0x7fe3a4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:44.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3b67fc640 1 --2- 172.21.15.45:0/3220036333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3a40047d0 0x7fe3a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:44.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3b6ffd640 1 --2- 172.21.15.45:0/3220036333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3a40047d0 0x7fe3a4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3b77fe640 1 -- 172.21.15.45:0/3220036333 reap_dead start 2023-10-03T19:12:44.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3b6ffd640 1 -- 172.21.15.45:0/3220036333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a4003530 con 0x7fe3a4003980 2023-10-03T19:12:44.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.705+0000 7fe3b67fc640 1 --2- 172.21.15.45:0/3220036333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3a40047d0 0x7fe3a4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:44.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.709+0000 7fe3b6ffd640 1 --2- 172.21.15.45:0/3220036333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3a4003980 0x7fe3a4003d90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0001e70 tx=0x7fe3b001c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3499d2d66b5b6ec2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:44.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.709+0000 7fe3b5ffb640 1 -- 172.21.15.45:0/3220036333 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b0003980 con 0x7fe3a4003980 2023-10-03T19:12:44.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.709+0000 7fe3b5ffb640 1 -- 172.21.15.45:0/3220036333 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b80ba950 con 0x7fe3a4003980 2023-10-03T19:12:44.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.709+0000 7fe3b5ffb640 1 -- 172.21.15.45:0/3220036333 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b0003d20 con 0x7fe3a4003980 2023-10-03T19:12:44.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.709+0000 7fe3bd28d640 1 -- 172.21.15.45:0/3220036333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3a4003980 msgr2=0x7fe3a4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:44.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.709+0000 7fe3bd28d640 1 --2- 172.21.15.45:0/3220036333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3a4003980 0x7fe3a4003d90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0001e70 tx=0x7fe3b001c6e0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.709+0000 7fe3bd28d640 1 -- 172.21.15.45:0/3220036333 shutdown_connections 2023-10-03T19:12:44.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.709+0000 7fe3bd28d640 1 --2- 172.21.15.45:0/3220036333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3a4003980 0x7fe3a4003d90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.709+0000 7fe3bd28d640 1 -- 172.21.15.45:0/3220036333 >> 172.21.15.45:0/3220036333 conn(0x7fe3b80c0d20 msgr2=0x7fe3b80c1120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:44.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.709+0000 7fe3bd28d640 1 -- 172.21.15.45:0/3220036333 shutdown_connections 2023-10-03T19:12:44.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.709+0000 7fe3bd28d640 1 -- 172.21.15.45:0/3220036333 wait complete. 2023-10-03T19:12:44.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.709+0000 7fe3bd28d640 1 Processor -- start 2023-10-03T19:12:44.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.709+0000 7fe3bd28d640 1 -- start start 2023-10-03T19:12:44.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.713+0000 7fe3bd28d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3a4003980 0x7fe3b8150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:44.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.713+0000 7fe3bd28d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3b814ae70 0x7fe3b8151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:44.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.713+0000 7fe3bd28d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3b81460e0 0x7fe3b8146550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:44.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.713+0000 7fe3bd28d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b8147ae0 con 0x7fe3b81460e0 2023-10-03T19:12:44.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.713+0000 7fe3bd28d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b8146a90 con 0x7fe3b814ae70 2023-10-03T19:12:44.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.713+0000 7fe3bd28d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b81498c0 con 0x7fe3a4003980 2023-10-03T19:12:44.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.713+0000 7fe3b77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3b81460e0 0x7fe3b8146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:44.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.713+0000 7fe3b77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3b81460e0 0x7fe3b8146550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35830/0 (socket says 172.21.15.45:35830) 2023-10-03T19:12:44.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.713+0000 7fe3b77fe640 1 -- 172.21.15.45:0/3311631255 learned_addr learned my addr 172.21.15.45:0/3311631255 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:44.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.713+0000 7fe3b6ffd640 1 --2- 172.21.15.45:0/3311631255 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3a4003980 0x7fe3b8150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:44.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.713+0000 7fe3b67fc640 1 --2- 172.21.15.45:0/3311631255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3b814ae70 0x7fe3b8151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:44.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.713+0000 7fe3b77fe640 1 -- 172.21.15.45:0/3311631255 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3a4003980 msgr2=0x7fe3b8150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:44.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.713+0000 7fe3b77fe640 1 --2- 172.21.15.45:0/3311631255 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3a4003980 0x7fe3b8150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.713+0000 7fe3b77fe640 1 -- 172.21.15.45:0/3311631255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3b814ae70 msgr2=0x7fe3b8151030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:44.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.713+0000 7fe3b77fe640 1 --2- 172.21.15.45:0/3311631255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3b814ae70 0x7fe3b8151030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.713+0000 7fe3b77fe640 1 -- 172.21.15.45:0/3311631255 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b80c08b0 con 0x7fe3b81460e0 2023-10-03T19:12:44.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.713+0000 7fe3b77fe640 1 --2- 172.21.15.45:0/3311631255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3b81460e0 0x7fe3b8146550 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe3b80a7080 tx=0x7fe3a800e830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:44.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.713+0000 7fe3af7fe640 1 -- 172.21.15.45:0/3311631255 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a800edc0 con 0x7fe3b81460e0 2023-10-03T19:12:44.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.713+0000 7fe3af7fe640 1 -- 172.21.15.45:0/3311631255 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a8013470 con 0x7fe3b81460e0 2023-10-03T19:12:44.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.713+0000 7fe3bd28d640 1 -- 172.21.15.45:0/3311631255 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b814bfa0 con 0x7fe3b81460e0 2023-10-03T19:12:44.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.713+0000 7fe3af7fe640 1 -- 172.21.15.45:0/3311631255 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a8013820 con 0x7fe3b81460e0 2023-10-03T19:12:44.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.713+0000 7fe3bd28d640 1 -- 172.21.15.45:0/3311631255 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b80c0a40 con 0x7fe3b81460e0 2023-10-03T19:12:44.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.713+0000 7fe3af7fe640 1 -- 172.21.15.45:0/3311631255 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe3a8013980 con 0x7fe3b81460e0 2023-10-03T19:12:44.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.713+0000 7fe3af7fe640 1 --2- 172.21.15.45:0/3311631255 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe398066280 0x7fe398068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:44.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.713+0000 7fe3af7fe640 1 -- 172.21.15.45:0/3311631255 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe3a80830d0 con 0x7fe3b81460e0 2023-10-03T19:12:44.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.713+0000 7fe3b6ffd640 1 --2- 172.21.15.45:0/3311631255 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe398066280 0x7fe398068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:44.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3c03b1000 1 Processor -- start 2023-10-03T19:12:44.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3c03b1000 1 -- start start 2023-10-03T19:12:44.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3b6ffd640 1 --2- 172.21.15.45:0/3311631255 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe398066280 0x7fe398068730 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0005000 tx=0x7fe3b0001520 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:44.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3c03b1000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7498556f0 0x55d74984cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:44.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3c03b1000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d74984d020 0x55d74984d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:44.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3c03b1000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d74984d930 0x55d74984dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:44.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3c03b1000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d749717310 con 0x55d74984d930 2023-10-03T19:12:44.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3c03b1000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d749651980 con 0x55d7498556f0 2023-10-03T19:12:44.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3c03b1000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d7496a5040 con 0x55d74984d020 2023-10-03T19:12:44.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3b77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d74984d930 0x55d74984dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:44.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3b77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d74984d930 0x55d74984dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35832/0 (socket says 172.21.15.45:35832) 2023-10-03T19:12:44.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3b77fe640 1 -- 172.21.15.45:0/3164981095 learned_addr learned my addr 172.21.15.45:0/3164981095 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:44.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3b6ffd640 1 --2- 172.21.15.45:0/3164981095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7498556f0 0x55d74984cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:44.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3b67fc640 1 --2- 172.21.15.45:0/3164981095 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d74984d020 0x55d74984d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:44.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3b77fe640 1 -- 172.21.15.45:0/3164981095 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d74984d020 msgr2=0x55d74984d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:44.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3b77fe640 1 --2- 172.21.15.45:0/3164981095 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d74984d020 0x55d74984d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3b77fe640 1 -- 172.21.15.45:0/3164981095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7498556f0 msgr2=0x55d74984cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:44.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3b77fe640 1 --2- 172.21.15.45:0/3164981095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7498556f0 0x55d74984cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3b77fe640 1 -- 172.21.15.45:0/3164981095 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7496630b0 con 0x55d74984d930 2023-10-03T19:12:44.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3b77fe640 1 --2- 172.21.15.45:0/3164981095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d74984d930 0x55d74984dd00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8053e70 tx=0x7fe3a8053ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d45de054ecf1c1e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:44.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3acff9640 1 -- 172.21.15.45:0/3164981095 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a805c4c0 con 0x55d74984d930 2023-10-03T19:12:44.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3acff9640 1 -- 172.21.15.45:0/3164981095 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a8052510 con 0x55d74984d930 2023-10-03T19:12:44.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3acff9640 1 -- 172.21.15.45:0/3164981095 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a8053660 con 0x55d74984d930 2023-10-03T19:12:44.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3c03b1000 1 -- 172.21.15.45:0/3164981095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d74984d930 msgr2=0x55d74984dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:44.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3c03b1000 1 --2- 172.21.15.45:0/3164981095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d74984d930 0x55d74984dd00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8053e70 tx=0x7fe3a8053ad0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3c03b1000 1 -- 172.21.15.45:0/3164981095 shutdown_connections 2023-10-03T19:12:44.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3c03b1000 1 --2- 172.21.15.45:0/3164981095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d74984d930 0x55d74984dd00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3c03b1000 1 --2- 172.21.15.45:0/3164981095 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d74984d020 0x55d74984d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3c03b1000 1 --2- 172.21.15.45:0/3164981095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7498556f0 0x55d74984cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3c03b1000 1 -- 172.21.15.45:0/3164981095 >> 172.21.15.45:0/3164981095 conn(0x55d749887220 msgr2=0x55d749889600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:44.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3c03b1000 1 -- 172.21.15.45:0/3164981095 shutdown_connections 2023-10-03T19:12:44.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3c03b1000 1 -- 172.21.15.45:0/3164981095 wait complete. 2023-10-03T19:12:44.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3c03b1000 1 -- start start 2023-10-03T19:12:44.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3c03b1000 1 Processor -- start 2023-10-03T19:12:44.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3c03b1000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d74984d020 0x55d7498863b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3c03b1000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d74984d930 0x55d7498868f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3c03b1000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d7498556f0 0x55d7498906d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3c03b1000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d74969e0e0 con 0x55d7498556f0 2023-10-03T19:12:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3c03b1000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d74965abd0 con 0x55d74984d020 2023-10-03T19:12:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3c03b1000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d74965a870 con 0x55d74984d930 2023-10-03T19:12:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3c03b1000 10 client.0 _ll_register_callbacks cb 0x55d74983ac20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T19:12:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3b77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d7498556f0 0x55d7498906d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3b77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d7498556f0 0x55d7498906d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35840/0 (socket says 172.21.15.45:35840) 2023-10-03T19:12:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.717+0000 7fe3b77fe640 1 -- 172.21.15.45:0/13406265 learned_addr learned my addr 172.21.15.45:0/13406265 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe3b6ffd640 1 --2- 172.21.15.45:0/13406265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d74984d020 0x55d7498863b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe3b67fc640 1 --2- 172.21.15.45:0/13406265 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d74984d930 0x55d7498868f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:44.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe3b77fe640 1 -- 172.21.15.45:0/13406265 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d74984d930 msgr2=0x55d7498868f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:44.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe3b77fe640 1 --2- 172.21.15.45:0/13406265 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d74984d930 0x55d7498868f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe3b77fe640 1 -- 172.21.15.45:0/13406265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d74984d020 msgr2=0x55d7498863b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:44.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe3b77fe640 1 --2- 172.21.15.45:0/13406265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d74984d020 0x55d7498863b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe3b77fe640 1 -- 172.21.15.45:0/13406265 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b80c0a40 con 0x55d7498556f0 2023-10-03T19:12:44.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe3b77fe640 1 --2- 172.21.15.45:0/13406265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d7498556f0 0x55d7498906d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8050620 tx=0x7fe3a80046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb4d68f2a12379a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:44.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe395ffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-10-03T19:12:44.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe395ffb640 1 -- 172.21.15.45:0/13406265 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a805c030 con 0x55d7498556f0 2023-10-03T19:12:44.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe3c03b1000 1 -- 172.21.15.45:0/13406265 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d7496998b0 con 0x55d7498556f0 2023-10-03T19:12:44.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe395ffb640 1 -- 172.21.15.45:0/13406265 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe3a805c190 con 0x55d7498556f0 2023-10-03T19:12:44.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe395ffb640 1 -- 172.21.15.45:0/13406265 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3a8081020 con 0x55d7498556f0 2023-10-03T19:12:44.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe3c03b1000 10 client.4617 fetch_fsmap learned FSMap version 7 2023-10-03T19:12:44.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe3c03b1000 1 -- 172.21.15.45:0/13406265 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55d74939a890 con 0x55d7498556f0 2023-10-03T19:12:44.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe395ffb640 1 -- 172.21.15.45:0/13406265 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d7496998b0 con 0x55d7498556f0 2023-10-03T19:12:44.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe395ffb640 1 -- 172.21.15.45:0/13406265 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 7) v1 ==== 2569+0+0 (secure 0 0 0) 0x7fe3a8011070 con 0x55d7498556f0 2023-10-03T19:12:44.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe3c03b1000 10 client.4617 fetch_fsmap finished waiting for FSMap version 7 2023-10-03T19:12:44.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe3c03b1000 10 client.4617 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-03T19:12:44.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe3c03b1000 20 client.4617 populate_metadata read hostname 'smithi045' 2023-10-03T19:12:44.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe3c03b1000 1 --2- 172.21.15.45:0/13406265 >> [v2:172.21.15.79:6834/2693877820,v1:172.21.15.79:6835/2693877820] conn(0x55d7498910e0 0x55d7498914b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:44.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe3c03b1000 4 client.4617 mds_command: new command op to 4282 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-03T19:12:44.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe3c03b1000 1 -- 172.21.15.45:0/13406265 --> [v2:172.21.15.79:6834/2693877820,v1:172.21.15.79:6835/2693877820] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d7496ccf70 con 0x55d7498910e0 2023-10-03T19:12:44.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe3b6ffd640 1 --2- 172.21.15.45:0/13406265 >> [v2:172.21.15.79:6834/2693877820,v1:172.21.15.79:6835/2693877820] conn(0x55d7498910e0 0x55d7498914b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:44.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe395ffb640 10 client.4617 ms_handle_connect on v2:172.21.15.79:6834/2693877820 2023-10-03T19:12:44.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe3b6ffd640 1 --2- 172.21.15.45:0/13406265 >> [v2:172.21.15.79:6834/2693877820,v1:172.21.15.79:6835/2693877820] conn(0x55d7498910e0 0x55d7498914b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fd7dbbba9d927d9 server_cookie=9734ab5c28ec44e2 in_seq=0 out_seq=0 2023-10-03T19:12:44.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe395ffb640 1 -- 172.21.15.45:0/13406265 <== mds.0 v2:172.21.15.79:6834/2693877820 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d7496ccf70 con 0x55d7498910e0 2023-10-03T19:12:44.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe395ffb640 10 client.4617 handle_command_reply: tid=0 2023-10-03T19:12:44.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe3c03b1000 1 client.4617 shutdown 2023-10-03T19:12:44.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe3c03b1000 1 -- 172.21.15.45:0/13406265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d7498556f0 msgr2=0x55d7498906d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:44.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe3c03b1000 1 --2- 172.21.15.45:0/13406265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d7498556f0 0x55d7498906d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8050620 tx=0x7fe3a80046d0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe3c03b1000 1 -- 172.21.15.45:0/13406265 shutdown_connections 2023-10-03T19:12:44.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe3c03b1000 1 --2- 172.21.15.45:0/13406265 >> [v2:172.21.15.79:6834/2693877820,v1:172.21.15.79:6835/2693877820] conn(0x55d7498910e0 0x55d7498914b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe3c03b1000 1 --2- 172.21.15.45:0/13406265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d7498556f0 0x55d7498906d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe3c03b1000 1 --2- 172.21.15.45:0/13406265 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d74984d930 0x55d7498868f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe3c03b1000 1 --2- 172.21.15.45:0/13406265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d74984d020 0x55d7498863b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe3c03b1000 1 -- 172.21.15.45:0/13406265 >> 172.21.15.45:0/13406265 conn(0x55d749887220 msgr2=0x55d749889600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:44.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe395ffb640 0 client.4617 ms_handle_reset on v2:172.21.15.79:6834/2693877820 2023-10-03T19:12:44.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe3c03b1000 1 -- 172.21.15.45:0/13406265 shutdown_connections 2023-10-03T19:12:44.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.721+0000 7fe3c03b1000 1 -- 172.21.15.45:0/13406265 wait complete. 2023-10-03T19:12:44.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.725+0000 7fe3c03b1000 20 client.4617 trim_cache size 0 max 16384 2023-10-03T19:12:44.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.737+0000 7fe3c03b1000 1 Processor -- start 2023-10-03T19:12:44.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.737+0000 7fe3c03b1000 1 -- start start 2023-10-03T19:12:44.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3c03b1000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d74984d020 0x55d74989d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:44.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3c03b1000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d74984d930 0x55d74989da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:44.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3c03b1000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7498556f0 0x55d74989df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:44.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3c03b1000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d749890ad0 con 0x55d74984d020 2023-10-03T19:12:44.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3c03b1000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d74935b940 con 0x55d7498556f0 2023-10-03T19:12:44.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3c03b1000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d7496e1150 con 0x55d74984d930 2023-10-03T19:12:44.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3b6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d74984d020 0x55d74989d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:44.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3b6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d74984d020 0x55d74989d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35856/0 (socket says 172.21.15.45:35856) 2023-10-03T19:12:44.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3b6ffd640 1 -- 172.21.15.45:0/921596219 learned_addr learned my addr 172.21.15.45:0/921596219 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:44.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3b6ffd640 1 -- 172.21.15.45:0/921596219 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d74984d930 msgr2=0x55d74989da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:44.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3b67fc640 1 --2- 172.21.15.45:0/921596219 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d74984d930 0x55d74989da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:44.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3b77fe640 1 --2- 172.21.15.45:0/921596219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7498556f0 0x55d74989df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:44.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3b6ffd640 1 --2- 172.21.15.45:0/921596219 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d74984d930 0x55d74989da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3b6ffd640 1 -- 172.21.15.45:0/921596219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7498556f0 msgr2=0x55d74989df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:44.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3b6ffd640 1 --2- 172.21.15.45:0/921596219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7498556f0 0x55d74989df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3b6ffd640 1 -- 172.21.15.45:0/921596219 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d749663360 con 0x55d74984d020 2023-10-03T19:12:44.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3b6ffd640 1 --2- 172.21.15.45:0/921596219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d74984d020 0x55d74989d4e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe3b00ab040 tx=0x7fe3b00014b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b64fc9938a84f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:44.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3ad7fa640 1 -- 172.21.15.45:0/921596219 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b00c1040 con 0x55d74984d020 2023-10-03T19:12:44.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3ad7fa640 1 -- 172.21.15.45:0/921596219 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b00b6070 con 0x55d74984d020 2023-10-03T19:12:44.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3ad7fa640 1 -- 172.21.15.45:0/921596219 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b00c9df0 con 0x55d74984d020 2023-10-03T19:12:44.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3c03b1000 1 -- 172.21.15.45:0/921596219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d74984d020 msgr2=0x55d74989d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:44.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3c03b1000 1 --2- 172.21.15.45:0/921596219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d74984d020 0x55d74989d4e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe3b00ab040 tx=0x7fe3b00014b0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3c03b1000 1 -- 172.21.15.45:0/921596219 shutdown_connections 2023-10-03T19:12:44.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3c03b1000 1 --2- 172.21.15.45:0/921596219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7498556f0 0x55d74989df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3c03b1000 1 --2- 172.21.15.45:0/921596219 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d74984d930 0x55d74989da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3c03b1000 1 --2- 172.21.15.45:0/921596219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d74984d020 0x55d74989d4e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3c03b1000 1 -- 172.21.15.45:0/921596219 >> 172.21.15.45:0/921596219 conn(0x55d749887220 msgr2=0x55d7498e30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:44.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3c03b1000 1 -- 172.21.15.45:0/921596219 shutdown_connections 2023-10-03T19:12:44.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3c03b1000 1 -- 172.21.15.45:0/921596219 wait complete. 2023-10-03T19:12:44.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3c03b1000 1 -- start start 2023-10-03T19:12:44.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3c03b1000 1 Processor -- start 2023-10-03T19:12:44.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3c03b1000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d74984d020 0x55d7498a1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:44.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3c03b1000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d74984d930 0x55d7498b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:44.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3c03b1000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7498556f0 0x55d7498b1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:44.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3c03b1000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d74969e0e0 con 0x55d74984d020 2023-10-03T19:12:44.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3c03b1000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d749699a50 con 0x55d7498556f0 2023-10-03T19:12:44.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3c03b1000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d74966d620 con 0x55d74984d930 2023-10-03T19:12:44.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3c03b1000 10 client.0 _ll_register_callbacks cb 0x55d7496a0260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T19:12:44.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3b6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d74984d020 0x55d7498a1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:44.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3b6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d74984d020 0x55d7498a1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35870/0 (socket says 172.21.15.45:35870) 2023-10-03T19:12:44.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3b6ffd640 1 -- 172.21.15.45:0/1411196482 learned_addr learned my addr 172.21.15.45:0/1411196482 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:44.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3b67fc640 1 --2- 172.21.15.45:0/1411196482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d74984d930 0x55d7498b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:44.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3b77fe640 1 --2- 172.21.15.45:0/1411196482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7498556f0 0x55d7498b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:44.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3b6ffd640 1 -- 172.21.15.45:0/1411196482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d74984d930 msgr2=0x55d7498b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:44.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3b6ffd640 1 --2- 172.21.15.45:0/1411196482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d74984d930 0x55d7498b0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3b6ffd640 1 -- 172.21.15.45:0/1411196482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7498556f0 msgr2=0x55d7498b1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:44.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3b6ffd640 1 --2- 172.21.15.45:0/1411196482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7498556f0 0x55d7498b1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3b6ffd640 1 -- 172.21.15.45:0/1411196482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a4003530 con 0x55d74984d020 2023-10-03T19:12:44.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3b67fc640 1 --2- 172.21.15.45:0/1411196482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d74984d930 0x55d7498b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:44.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3b6ffd640 1 --2- 172.21.15.45:0/1411196482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d74984d020 0x55d7498a1350 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0007f30 tx=0x7fe3b001af80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6098d85da2e80edb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:44.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe395ffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-10-03T19:12:44.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe395ffb640 1 -- 172.21.15.45:0/1411196482 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b00c1040 con 0x55d74984d020 2023-10-03T19:12:44.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe395ffb640 1 -- 172.21.15.45:0/1411196482 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe3b00cad20 con 0x55d74984d020 2023-10-03T19:12:44.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe3c03b1000 1 -- 172.21.15.45:0/1411196482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe3a8052510 con 0x55d74984d020 2023-10-03T19:12:44.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.741+0000 7fe395ffb640 1 -- 172.21.15.45:0/1411196482 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3b00caee0 con 0x55d74984d020 2023-10-03T19:12:44.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3c03b1000 10 client.4623 fetch_fsmap learned FSMap version 7 2023-10-03T19:12:44.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3c03b1000 1 -- 172.21.15.45:0/1411196482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55d749648be0 con 0x55d74984d020 2023-10-03T19:12:44.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe395ffb640 1 -- 172.21.15.45:0/1411196482 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a8052510 con 0x55d74984d020 2023-10-03T19:12:44.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe395ffb640 1 -- 172.21.15.45:0/1411196482 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 7) v1 ==== 2569+0+0 (secure 0 0 0) 0x7fe3b00ba040 con 0x55d74984d020 2023-10-03T19:12:44.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3c03b1000 10 client.4623 fetch_fsmap finished waiting for FSMap version 7 2023-10-03T19:12:44.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3c03b1000 10 client.4623 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-03T19:12:44.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3c03b1000 20 client.4623 populate_metadata read hostname 'smithi045' 2023-10-03T19:12:44.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3c03b1000 1 --2- 172.21.15.45:0/1411196482 >> [v2:172.21.15.79:6834/2693877820,v1:172.21.15.79:6835/2693877820] conn(0x55d7498f13b0 0x55d7498f3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:44.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3c03b1000 4 client.4623 mds_command: new command op to 4282 tid=0[{"prefix": "status"}] 2023-10-03T19:12:44.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3c03b1000 1 -- 172.21.15.45:0/1411196482 --> [v2:172.21.15.79:6834/2693877820,v1:172.21.15.79:6835/2693877820] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d7496970c0 con 0x55d7498f13b0 2023-10-03T19:12:44.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3b67fc640 1 --2- 172.21.15.45:0/1411196482 >> [v2:172.21.15.79:6834/2693877820,v1:172.21.15.79:6835/2693877820] conn(0x55d7498f13b0 0x55d7498f3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:44.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3b67fc640 1 --2- 172.21.15.45:0/1411196482 >> [v2:172.21.15.79:6834/2693877820,v1:172.21.15.79:6835/2693877820] conn(0x55d7498f13b0 0x55d7498f3790 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44cc79b185624efa server_cookie=82aa3e60e323baf7 in_seq=0 out_seq=0 2023-10-03T19:12:44.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe395ffb640 10 client.4623 ms_handle_connect on v2:172.21.15.79:6834/2693877820 2023-10-03T19:12:44.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe395ffb640 1 -- 172.21.15.45:0/1411196482 <== mds.0 v2:172.21.15.79:6834/2693877820 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55d7496970c0 con 0x55d7498f13b0 2023-10-03T19:12:44.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe395ffb640 10 client.4623 handle_command_reply: tid=0 2023-10-03T19:12:44.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3c03b1000 1 client.4623 shutdown 2023-10-03T19:12:44.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3c03b1000 1 -- 172.21.15.45:0/1411196482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d74984d020 msgr2=0x55d7498a1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:44.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3c03b1000 1 --2- 172.21.15.45:0/1411196482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d74984d020 0x55d7498a1350 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0007f30 tx=0x7fe3b001af80 comp rx=0 tx=0).stop 2023-10-03T19:12:44.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3c03b1000 1 -- 172.21.15.45:0/1411196482 shutdown_connections 2023-10-03T19:12:44.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3c03b1000 1 --2- 172.21.15.45:0/1411196482 >> [v2:172.21.15.79:6834/2693877820,v1:172.21.15.79:6835/2693877820] conn(0x55d7498f13b0 0x55d7498f3790 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3c03b1000 1 --2- 172.21.15.45:0/1411196482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7498556f0 0x55d7498b1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3c03b1000 1 --2- 172.21.15.45:0/1411196482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d74984d930 0x55d7498b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe395ffb640 0 client.4623 ms_handle_reset on v2:172.21.15.79:6834/2693877820 2023-10-03T19:12:44.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3c03b1000 1 --2- 172.21.15.45:0/1411196482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d74984d020 0x55d7498a1350 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3c03b1000 1 -- 172.21.15.45:0/1411196482 >> 172.21.15.45:0/1411196482 conn(0x55d749887220 msgr2=0x55d7498e2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:44.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3c03b1000 1 -- 172.21.15.45:0/1411196482 shutdown_connections 2023-10-03T19:12:44.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3c03b1000 1 -- 172.21.15.45:0/1411196482 wait complete. 2023-10-03T19:12:44.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3c03b1000 20 client.4623 trim_cache size 0 max 16384 2023-10-03T19:12:44.756 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-03T19:12:44.756 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "58400977-12ba-4c73-bb3e-1589b2492669", 2023-10-03T19:12:44.756 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-10-03T19:12:44.756 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4282, 2023-10-03T19:12:44.756 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-10-03T19:12:44.756 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-10-03T19:12:44.757 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-10-03T19:12:44.757 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 16.804624235999999, 2023-10-03T19:12:44.757 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 7, 2023-10-03T19:12:44.757 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 22, 2023-10-03T19:12:44.757 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 22, 2023-10-03T19:12:44.757 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 21.306361473999999 2023-10-03T19:12:44.757 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-03T19:12:44.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3bd28d640 1 -- 172.21.15.45:0/3311631255 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe398066280 msgr2=0x7fe398068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:44.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3bd28d640 1 --2- 172.21.15.45:0/3311631255 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe398066280 0x7fe398068730 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0005000 tx=0x7fe3b0001520 comp rx=0 tx=0).stop 2023-10-03T19:12:44.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3bd28d640 1 -- 172.21.15.45:0/3311631255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3b81460e0 msgr2=0x7fe3b8146550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:44.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3bd28d640 1 --2- 172.21.15.45:0/3311631255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3b81460e0 0x7fe3b8146550 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe3b80a7080 tx=0x7fe3a800e830 comp rx=0 tx=0).stop 2023-10-03T19:12:44.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3bd28d640 1 -- 172.21.15.45:0/3311631255 shutdown_connections 2023-10-03T19:12:44.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3bd28d640 1 --2- 172.21.15.45:0/3311631255 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe398066280 0x7fe398068730 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3bd28d640 1 --2- 172.21.15.45:0/3311631255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3b81460e0 0x7fe3b8146550 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3bd28d640 1 --2- 172.21.15.45:0/3311631255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3b814ae70 0x7fe3b8151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3bd28d640 1 --2- 172.21.15.45:0/3311631255 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3a4003980 0x7fe3b8150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:44.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3bd28d640 1 -- 172.21.15.45:0/3311631255 >> 172.21.15.45:0/3311631255 conn(0x7fe3b80c0d20 msgr2=0x7fe3b81521a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:44.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3bd28d640 1 -- 172.21.15.45:0/3311631255 shutdown_connections 2023-10-03T19:12:44.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:44.745+0000 7fe3bd28d640 1 -- 172.21.15.45:0/3311631255 wait complete. 2023-10-03T19:12:44.766 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-03T19:12:44.788 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-03T19:12:44.788 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2023-10-03T19:12:44.789 INFO:tasks.ceph_fuse:client.0 config is {} 2023-10-03T19:12:44.789 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-03T19:12:44.789 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-03T19:12:44.789 INFO:tasks.ceph_fuse:client.1 config is {} 2023-10-03T19:12:44.789 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-03T19:12:44.789 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-03T19:12:44.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:44.790 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2023-10-03T19:12:44.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:44.797 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link delete ceph-brx 2023-10-03T19:12:44.861 INFO:teuthology.orchestra.run.smithi172.stderr:Cannot find device "ceph-brx" 2023-10-03T19:12:44.862 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T19:12:44.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:44.863 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-10-03T19:12:44.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:44.871 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2023-10-03T19:12:44.930 INFO:teuthology.orchestra.run.smithi146.stderr:Cannot find device "ceph-brx" 2023-10-03T19:12:44.931 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T19:12:44.931 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-03T19:12:44.931 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-03T19:12:45.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.057+0000 7f7abb6ae640 1 Processor -- start 2023-10-03T19:12:45.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.057+0000 7f7abb6ae640 1 -- start start 2023-10-03T19:12:45.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7abb6ae640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7ab40bc8b0 0x7f7ab414ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:45.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7abb6ae640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab406cac0 con 0x7f7ab406f170 2023-10-03T19:12:45.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7abb6ae640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab40720d0 con 0x7f7ab406d170 2023-10-03T19:12:45.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7abb6ae640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40a5ab0 con 0x7f7ab40bc8b0 2023-10-03T19:12:45.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7ab944a640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7ab406f170 0x7f7ab4150190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38870/0 (socket says 172.21.15.45:38870) 2023-10-03T19:12:45.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7ab944a640 1 -- 172.21.15.45:0/3297923260 learned_addr learned my addr 172.21.15.45:0/3297923260 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:45.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7ab8c49640 1 --2- 172.21.15.45:0/3297923260 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7ab40bc8b0 0x7f7ab414ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:45.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7aabfff640 1 -- 172.21.15.45:0/3297923260 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3706002828 0 0) 0x7f7ab00014a0 con 0x7f7ab406f170 2023-10-03T19:12:45.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7aabfff640 1 -- 172.21.15.45:0/3297923260 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7aa0003530 con 0x7f7ab406f170 2023-10-03T19:12:45.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7aabfff640 1 -- 172.21.15.45:0/3297923260 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1269131629 0 0) 0x7f7aa0003530 con 0x7f7ab406f170 2023-10-03T19:12:45.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7aabfff640 1 -- 172.21.15.45:0/3297923260 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7ab40bc8b0 msgr2=0x7f7ab414ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:45.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7aabfff640 1 --2- 172.21.15.45:0/3297923260 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7ab40bc8b0 0x7f7ab414ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:45.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7aabfff640 1 -- 172.21.15.45:0/3297923260 >> v1:172.21.15.79:6789/0 conn(0x7f7ab406d170 legacy=0x7f7ab414cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:45.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7aabfff640 1 -- 172.21.15.45:0/3297923260 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab406cd00 con 0x7f7ab406f170 2023-10-03T19:12:45.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7aabfff640 1 -- 172.21.15.45:0/3297923260 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f7ab0001b90 con 0x7f7ab406f170 2023-10-03T19:12:45.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7aabfff640 1 -- 172.21.15.45:0/3297923260 >> v1:172.21.15.45:6789/0 conn(0x7f7ab406f170 legacy=0x7f7ab4150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:45.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7aabfff640 1 --2- 172.21.15.45:0/3297923260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7aa00039b0 0x7f7aa0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:45.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7aabfff640 1 --2- 172.21.15.45:0/3297923260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aa00047d0 0x7f7aa0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:45.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7aabfff640 1 --2- 172.21.15.45:0/3297923260 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7ab40bc8b0 0x7f7aa0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:45.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7aabfff640 1 -- 172.21.15.45:0/3297923260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40a5ab0 con 0x7f7aa00047d0 2023-10-03T19:12:45.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7aabfff640 1 -- 172.21.15.45:0/3297923260 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa000bad0 con 0x7f7aa00039b0 2023-10-03T19:12:45.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7aabfff640 1 -- 172.21.15.45:0/3297923260 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa000bc60 con 0x7f7ab40bc8b0 2023-10-03T19:12:45.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7ab8c49640 1 --2- 172.21.15.45:0/3297923260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aa00047d0 0x7f7aa0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:45.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7ab944a640 1 --2- 172.21.15.45:0/3297923260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7aa00039b0 0x7f7aa0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:45.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7ab9c4b640 1 --2- 172.21.15.45:0/3297923260 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7ab40bc8b0 0x7f7aa0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:45.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7ab8c49640 1 -- 172.21.15.45:0/3297923260 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7ab40bc8b0 msgr2=0x7f7aa0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:45.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7ab8c49640 1 --2- 172.21.15.45:0/3297923260 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7ab40bc8b0 0x7f7aa0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:45.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7ab8c49640 1 -- 172.21.15.45:0/3297923260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7aa00039b0 msgr2=0x7f7aa0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:45.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7ab8c49640 1 --2- 172.21.15.45:0/3297923260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7aa00039b0 0x7f7aa0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:45.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7ab8c49640 1 -- 172.21.15.45:0/3297923260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa0003530 con 0x7f7aa00047d0 2023-10-03T19:12:45.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7ab944a640 1 --2- 172.21.15.45:0/3297923260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7aa00039b0 0x7f7aa0003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:45.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.061+0000 7f7ab9c4b640 1 --2- 172.21.15.45:0/3297923260 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7ab40bc8b0 0x7f7aa0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:45.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.065+0000 7f7ab8c49640 1 --2- 172.21.15.45:0/3297923260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aa00047d0 0x7f7aa0004c40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4009ae0 tx=0x7f7aa401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f350c968aed6f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:45.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.065+0000 7f7aabfff640 1 -- 172.21.15.45:0/3297923260 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa40a5640 con 0x7f7aa00047d0 2023-10-03T19:12:45.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.065+0000 7f7aabfff640 1 -- 172.21.15.45:0/3297923260 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa40a57a0 con 0x7f7aa00047d0 2023-10-03T19:12:45.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.065+0000 7f7aabfff640 1 -- 172.21.15.45:0/3297923260 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa40a5b50 con 0x7f7aa00047d0 2023-10-03T19:12:45.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.065+0000 7f7abb6ae640 1 -- 172.21.15.45:0/3297923260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aa00047d0 msgr2=0x7f7aa0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:45.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.065+0000 7f7abb6ae640 1 --2- 172.21.15.45:0/3297923260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aa00047d0 0x7f7aa0004c40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4009ae0 tx=0x7f7aa401ca50 comp rx=0 tx=0).stop 2023-10-03T19:12:45.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.065+0000 7f7ab9c4b640 1 -- 172.21.15.45:0/3297923260 reap_dead start 2023-10-03T19:12:45.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.065+0000 7f7abb6ae640 1 -- 172.21.15.45:0/3297923260 shutdown_connections 2023-10-03T19:12:45.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.065+0000 7f7abb6ae640 1 -- 172.21.15.45:0/3297923260 >> 172.21.15.45:0/3297923260 conn(0x7f7ab40bcf50 msgr2=0x7f7ab40bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:45.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.065+0000 7f7abb6ae640 1 -- 172.21.15.45:0/3297923260 shutdown_connections 2023-10-03T19:12:45.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.065+0000 7f7abb6ae640 1 -- 172.21.15.45:0/3297923260 wait complete. 2023-10-03T19:12:45.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.065+0000 7f7abb6ae640 1 Processor -- start 2023-10-03T19:12:45.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.065+0000 7f7abb6ae640 1 -- start start 2023-10-03T19:12:45.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.065+0000 7f7abb6ae640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7aa00047d0 0x7f7ab4144c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:45.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.065+0000 7f7abb6ae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ab40a4e10 0x7f7ab41426a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:45.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.065+0000 7f7abb6ae640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ab4142be0 0x7f7ab4148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:45.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.065+0000 7f7abb6ae640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab41e42f0 con 0x7f7ab40a4e10 2023-10-03T19:12:45.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.065+0000 7f7abb6ae640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab41e4820 con 0x7f7ab4142be0 2023-10-03T19:12:45.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.065+0000 7f7abb6ae640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab41487a0 con 0x7f7aa00047d0 2023-10-03T19:12:45.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.065+0000 7f7ab8c49640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ab40a4e10 0x7f7ab41426a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:45.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.065+0000 7f7ab8c49640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ab40a4e10 0x7f7ab41426a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35894/0 (socket says 172.21.15.45:35894) 2023-10-03T19:12:45.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.065+0000 7f7ab8c49640 1 -- 172.21.15.45:0/1912851979 learned_addr learned my addr 172.21.15.45:0/1912851979 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:45.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.065+0000 7f7ab944a640 1 --2- 172.21.15.45:0/1912851979 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7aa00047d0 0x7f7ab4144c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:45.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.065+0000 7f7ab8c49640 1 -- 172.21.15.45:0/1912851979 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7aa00047d0 msgr2=0x7f7ab4144c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:45.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.065+0000 7f7ab8c49640 1 --2- 172.21.15.45:0/1912851979 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7aa00047d0 0x7f7ab4144c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:45.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.065+0000 7f7ab8c49640 1 -- 172.21.15.45:0/1912851979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ab4142be0 msgr2=0x7f7ab4148cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:45.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.065+0000 7f7ab8c49640 1 --2- 172.21.15.45:0/1912851979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ab4142be0 0x7f7ab4148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:45.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.065+0000 7f7ab8c49640 1 -- 172.21.15.45:0/1912851979 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab414c4a0 con 0x7f7ab40a4e10 2023-10-03T19:12:45.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.065+0000 7f7ab8c49640 1 --2- 172.21.15.45:0/1912851979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ab40a4e10 0x7f7ab41426a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4009ae0 tx=0x7f7aa0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:45.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.069+0000 7f7aa9ffb640 1 -- 172.21.15.45:0/1912851979 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4004230 con 0x7f7ab40a4e10 2023-10-03T19:12:45.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.069+0000 7f7aa9ffb640 1 -- 172.21.15.45:0/1912851979 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa4004390 con 0x7f7ab40a4e10 2023-10-03T19:12:45.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.069+0000 7f7abb6ae640 1 -- 172.21.15.45:0/1912851979 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab414fae0 con 0x7f7ab40a4e10 2023-10-03T19:12:45.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.069+0000 7f7aa9ffb640 1 -- 172.21.15.45:0/1912851979 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa40ad850 con 0x7f7ab40a4e10 2023-10-03T19:12:45.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.069+0000 7f7abb6ae640 1 -- 172.21.15.45:0/1912851979 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab406f540 con 0x7f7ab40a4e10 2023-10-03T19:12:45.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.069+0000 7f7abb6ae640 1 -- 172.21.15.45:0/1912851979 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab406d660 con 0x7f7ab40a4e10 2023-10-03T19:12:45.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.069+0000 7f7aa9ffb640 1 -- 172.21.15.45:0/1912851979 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7aa40b4040 con 0x7f7ab40a4e10 2023-10-03T19:12:45.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.069+0000 7f7aa9ffb640 1 --2- 172.21.15.45:0/1912851979 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7a980662b0 0x7f7a98068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:45.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.069+0000 7f7aa9ffb640 1 -- 172.21.15.45:0/1912851979 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7aa411e410 con 0x7f7ab40a4e10 2023-10-03T19:12:45.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.069+0000 7f7ab944a640 1 --2- 172.21.15.45:0/1912851979 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7a980662b0 0x7f7a98068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:45.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.069+0000 7f7ab944a640 1 --2- 172.21.15.45:0/1912851979 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7a980662b0 0x7f7a98068760 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0001d40 tx=0x7f7ab0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:45.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.073+0000 7f7aa9ffb640 1 -- 172.21.15.45:0/1912851979 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7aa40ebaf0 con 0x7f7ab40a4e10 2023-10-03T19:12:45.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.261+0000 7f7abb6ae640 1 -- 172.21.15.45:0/1912851979 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7ab404de80 con 0x7f7ab40a4e10 2023-10-03T19:12:45.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.261+0000 7f7aa9ffb640 1 -- 172.21.15.45:0/1912851979 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7aa40ef110 con 0x7f7ab40a4e10 2023-10-03T19:12:45.266 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-03T19:12:45.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.265+0000 7f7abb6ae640 1 -- 172.21.15.45:0/1912851979 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7a980662b0 msgr2=0x7f7a98068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:45.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.265+0000 7f7abb6ae640 1 --2- 172.21.15.45:0/1912851979 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7a980662b0 0x7f7a98068760 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0001d40 tx=0x7f7ab0009040 comp rx=0 tx=0).stop 2023-10-03T19:12:45.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.265+0000 7f7abb6ae640 1 -- 172.21.15.45:0/1912851979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ab40a4e10 msgr2=0x7f7ab41426a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:45.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.265+0000 7f7abb6ae640 1 --2- 172.21.15.45:0/1912851979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ab40a4e10 0x7f7ab41426a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4009ae0 tx=0x7f7aa0005800 comp rx=0 tx=0).stop 2023-10-03T19:12:45.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.265+0000 7f7abb6ae640 1 -- 172.21.15.45:0/1912851979 shutdown_connections 2023-10-03T19:12:45.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.265+0000 7f7abb6ae640 1 --2- 172.21.15.45:0/1912851979 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7a980662b0 0x7f7a98068760 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:45.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.265+0000 7f7abb6ae640 1 --2- 172.21.15.45:0/1912851979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ab4142be0 0x7f7ab4148cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:45.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.265+0000 7f7abb6ae640 1 --2- 172.21.15.45:0/1912851979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ab40a4e10 0x7f7ab41426a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:45.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.265+0000 7f7abb6ae640 1 --2- 172.21.15.45:0/1912851979 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7aa00047d0 0x7f7ab4144c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:45.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.265+0000 7f7abb6ae640 1 -- 172.21.15.45:0/1912851979 >> 172.21.15.45:0/1912851979 conn(0x7f7ab40bcf50 msgr2=0x7f7ab414d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:45.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.265+0000 7f7abb6ae640 1 -- 172.21.15.45:0/1912851979 shutdown_connections 2023-10-03T19:12:45.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:45.265+0000 7f7abb6ae640 1 -- 172.21.15.45:0/1912851979 wait complete. 2023-10-03T19:12:45.285 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-03T19:12:45.285 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-03T19:12:45.285 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-10-03T19:12:45.285 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-03T19:12:45.285 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-03T19:12:45.285 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-03T19:12:45.285 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-03T19:12:45.285 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-03T19:12:45.286 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-03T19:12:45.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:45.286 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-10-03T19:12:45.292 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-03T19:12:45.292 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-03T19:12:45.292 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-10-03T19:12:45.292 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:12:45.293 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-10-03T19:12:45.293 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:12:45.293 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:12:45.293 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-10-03T19:12:45.293 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-10-03T19:12:45.293 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:12:45.293 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-10-03T19:12:45.293 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-10-03T19:12:45.293 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:12:45.294 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-10-03T19:12:45.294 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-03T19:12:45.294 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-10-03T19:12:45.294 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-03T19:12:45.294 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42417sec preferred_lft 42417sec 2023-10-03T19:12:45.294 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2023-10-03T19:12:45.294 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:12:45.294 INFO:teuthology.orchestra.run.smithi146.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-03T19:12:45.294 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 02:42:a6:2d:ab:3b brd ff:ff:ff:ff:ff:ff 2023-10-03T19:12:45.294 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-03T19:12:45.294 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:12:45.295 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-03T19:12:45.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:45.295 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-03T19:12:45.295 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-03T19:12:45.295 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add name ceph-brx type bridge 2023-10-03T19:12:45.295 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip addr flush dev ceph-brx 2023-10-03T19:12:45.295 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set ceph-brx up 2023-10-03T19:12:45.295 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-03T19:12:45.296 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-03T19:12:45.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:45.377 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-03T19:12:45.430 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T19:12:45.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:45.432 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-10-03T19:12:45.497 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-10-03T19:12:45.497 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-03T19:12:45.497 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-03T19:12:45.497 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-03T19:12:45.497 INFO:teuthology.orchestra.run.smithi146.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-03T19:12:45.497 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-03T19:12:45.498 INFO:teuthology.orchestra.run.smithi146.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:12:45.498 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:12:45.498 INFO:teuthology.orchestra.run.smithi146.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:12:45.498 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-03T19:12:45.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:45.498 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-03T19:12:45.499 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-03T19:12:45.499 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-03T19:12:45.499 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-03T19:12:45.499 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-03T19:12:45.499 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-03T19:12:45.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:45.572 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-10-03T19:12:45.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:45.618 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list-id 2023-10-03T19:12:45.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:45.666 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-03T19:12:45.666 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-03T19:12:45.666 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T19:12:45.666 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-03T19:12:45.667 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-03T19:12:45.735 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-03T19:12:45.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:45.735 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-03T19:12:45.735 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-03T19:12:45.735 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-03T19:12:45.735 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-03T19:12:45.735 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-03T19:12:45.735 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-03T19:12:45.736 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-03T19:12:45.736 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-03T19:12:45.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:45.835 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-03T19:12:45.835 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-03T19:12:45.835 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-10-03T19:12:45.836 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set dev brx.0 master ceph-brx 2023-10-03T19:12:45.836 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-03T19:12:45.855 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-03T19:12:45.855 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T19:12:45.855 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-03T19:12:45.901 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-03T19:12:45.901 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T19:12:45.902 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-03T19:12:45.948 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-03T19:12:46.004 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:12:46.004 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:12:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:12:46.055 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:12:46.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:46.056 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-03T19:12:46.101 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-03T19:12:46.101 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-03T19:12:46.146 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-03T19:12:46.160 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:12:46.161 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:12:46.215 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:12:46.216 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:12:46.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:46.216 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-03T19:12:46.233 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:2023-10-03T19:12:46.227+0000 7f2b5d32e580 -1 init, newargv = 0x564b5b00e410 newargc=15 2023-10-03T19:12:46.233 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[33119]: starting ceph client 2023-10-03T19:12:46.243 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[33119]: starting fuse 2023-10-03T19:12:47.339 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-03T19:12:47.355 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:12:47.355 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:12:47.409 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:12:47.410 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:12:47.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:47.411 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-03T19:12:47.462 INFO:teuthology.orchestra.run.smithi146.stdout:45 2023-10-03T19:12:47.463 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-03T19:12:47.463 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-03T19:12:47.463 DEBUG:teuthology.orchestra.run.smithi146:> import glob 2023-10-03T19:12:47.463 DEBUG:teuthology.orchestra.run.smithi146:> import re 2023-10-03T19:12:47.463 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-03T19:12:47.464 DEBUG:teuthology.orchestra.run.smithi146:> import subprocess 2023-10-03T19:12:47.464 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:12:47.464 DEBUG:teuthology.orchestra.run.smithi146:> def _find_admin_socket(client_name): 2023-10-03T19:12:47.464 DEBUG:teuthology.orchestra.run.smithi146:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-03T19:12:47.464 DEBUG:teuthology.orchestra.run.smithi146:> files = glob.glob(asok_path) 2023-10-03T19:12:47.464 DEBUG:teuthology.orchestra.run.smithi146:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-03T19:12:47.464 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:12:47.465 DEBUG:teuthology.orchestra.run.smithi146:> # Given a non-glob path, it better be there 2023-10-03T19:12:47.465 DEBUG:teuthology.orchestra.run.smithi146:> if "*" not in asok_path: 2023-10-03T19:12:47.465 DEBUG:teuthology.orchestra.run.smithi146:> assert(len(files) == 1) 2023-10-03T19:12:47.465 DEBUG:teuthology.orchestra.run.smithi146:> return files[0] 2023-10-03T19:12:47.465 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:12:47.465 DEBUG:teuthology.orchestra.run.smithi146:> for f in files: 2023-10-03T19:12:47.465 DEBUG:teuthology.orchestra.run.smithi146:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-03T19:12:47.466 DEBUG:teuthology.orchestra.run.smithi146:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-03T19:12:47.466 DEBUG:teuthology.orchestra.run.smithi146:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-03T19:12:47.466 DEBUG:teuthology.orchestra.run.smithi146:> contents = proc_f.read() 2023-10-03T19:12:47.466 DEBUG:teuthology.orchestra.run.smithi146:> if mountpoint in contents: 2023-10-03T19:12:47.466 DEBUG:teuthology.orchestra.run.smithi146:> return f 2023-10-03T19:12:47.466 DEBUG:teuthology.orchestra.run.smithi146:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-03T19:12:47.467 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:12:47.467 DEBUG:teuthology.orchestra.run.smithi146:> print(_find_admin_socket("client.0")) 2023-10-03T19:12:47.467 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-03T19:12:47.580 INFO:teuthology.orchestra.run.smithi146.stdout:/var/run/ceph/ceph-client.0.33119.asok 2023-10-03T19:12:47.764 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.33119.asok 2023-10-03T19:12:47.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:47.764 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.33119.asok status 2023-10-03T19:12:47.918 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-03T19:12:47.918 INFO:teuthology.orchestra.run.smithi146.stdout: "metadata": { 2023-10-03T19:12:47.919 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_sha1": "05a43c8fb3988914c879a50970f9054a098e0612", 2023-10-03T19:12:47.919 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 18.0.0-3908-g05a43c8f (05a43c8fb3988914c879a50970f9054a098e0612) reef (dev)", 2023-10-03T19:12:47.919 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "0", 2023-10-03T19:12:47.919 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2023-10-03T19:12:47.919 INFO:teuthology.orchestra.run.smithi146.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-03T19:12:47.919 INFO:teuthology.orchestra.run.smithi146.stdout: "pid": "33119", 2023-10-03T19:12:47.919 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2023-10-03T19:12:47.919 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:12:47.919 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_count": 0, 2023-10-03T19:12:47.919 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_pinned_count": 0, 2023-10-03T19:12:47.919 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 4635, 2023-10-03T19:12:47.919 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": { 2023-10-03T19:12:47.920 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2023-10-03T19:12:47.920 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2023-10-03T19:12:47.920 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 4635 2023-10-03T19:12:47.920 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:12:47.920 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-03T19:12:47.920 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T19:12:47.920 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:0", 2023-10-03T19:12:47.920 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 1810493262 2023-10-03T19:12:47.920 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T19:12:47.920 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:12:47.920 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-03T19:12:47.920 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T19:12:47.921 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:0", 2023-10-03T19:12:47.921 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 1810493262 2023-10-03T19:12:47.921 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:12:47.921 INFO:teuthology.orchestra.run.smithi146.stdout: "inst_str": "client.4635 172.21.15.146:0/1810493262", 2023-10-03T19:12:47.921 INFO:teuthology.orchestra.run.smithi146.stdout: "addr_str": "172.21.15.146:0/1810493262", 2023-10-03T19:12:47.921 INFO:teuthology.orchestra.run.smithi146.stdout: "inode_count": 1, 2023-10-03T19:12:47.921 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_epoch": 7, 2023-10-03T19:12:47.921 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch": 22, 2023-10-03T19:12:47.921 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch_barrier": 0, 2023-10-03T19:12:47.921 INFO:teuthology.orchestra.run.smithi146.stdout: "blocklisted": false, 2023-10-03T19:12:47.921 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs" 2023-10-03T19:12:47.921 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-03T19:12:47.934 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-03T19:12:48.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.065+0000 7f9511a26640 1 Processor -- start 2023-10-03T19:12:48.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.065+0000 7f9511a26640 1 -- start start 2023-10-03T19:12:48.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.069+0000 7f9511a26640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f950c0bcb60 0x7f950c06c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:48.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.069+0000 7f9511a26640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f950c14b610 con 0x7f950c06c7d0 2023-10-03T19:12:48.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.069+0000 7f9511a26640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f950c0a5580 con 0x7f950c148b90 2023-10-03T19:12:48.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.069+0000 7f9511a26640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f950c0a3670 con 0x7f950c0bcb60 2023-10-03T19:12:48.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.069+0000 7f950a7fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f950c0bcb60 0x7f950c06c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:48.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.069+0000 7f950b7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f950c06c7d0 0x7f950c155cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38880/0 (socket says 172.21.15.45:38880) 2023-10-03T19:12:48.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.069+0000 7f950b7fe640 1 -- 172.21.15.45:0/3930366716 learned_addr learned my addr 172.21.15.45:0/3930366716 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:48.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.069+0000 7f9509ffb640 1 -- 172.21.15.45:0/3930366716 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3736594923 0 0) 0x7f950c14b610 con 0x7f950c06c7d0 2023-10-03T19:12:48.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.069+0000 7f950a7fc640 1 -- 172.21.15.45:0/3930366716 >> v1:172.21.15.79:6789/0 conn(0x7f950c148b90 legacy=0x7f950c0bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:48.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.069+0000 7f950a7fc640 1 -- 172.21.15.45:0/3930366716 >> v1:172.21.15.45:6789/0 conn(0x7f950c06c7d0 legacy=0x7f950c155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:48.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.069+0000 7f950a7fc640 1 -- 172.21.15.45:0/3930366716 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f950c0a5820 con 0x7f950c0bcb60 2023-10-03T19:12:48.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.069+0000 7f950a7fc640 1 --2- 172.21.15.45:0/3930366716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f950c0bcb60 0x7f950c06c290 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f94f4009d90 tx=0x7f94f401f100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc3d2f95b94eff server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:48.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.069+0000 7f9509ffb640 1 -- 172.21.15.45:0/3930366716 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f40af600 con 0x7f950c0bcb60 2023-10-03T19:12:48.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.069+0000 7f9509ffb640 1 -- 172.21.15.45:0/3930366716 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f40ab050 con 0x7f950c0bcb60 2023-10-03T19:12:48.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.069+0000 7f9509ffb640 1 -- 172.21.15.45:0/3930366716 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f40af980 con 0x7f950c0bcb60 2023-10-03T19:12:48.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f9511a26640 1 -- 172.21.15.45:0/3930366716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f950c0bcb60 msgr2=0x7f950c06c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:48.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f9511a26640 1 --2- 172.21.15.45:0/3930366716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f950c0bcb60 0x7f950c06c290 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f94f4009d90 tx=0x7f94f401f100 comp rx=0 tx=0).stop 2023-10-03T19:12:48.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f9511a26640 1 -- 172.21.15.45:0/3930366716 shutdown_connections 2023-10-03T19:12:48.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f9511a26640 1 --2- 172.21.15.45:0/3930366716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f950c0bcb60 0x7f950c06c290 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:48.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f9511a26640 1 -- 172.21.15.45:0/3930366716 >> 172.21.15.45:0/3930366716 conn(0x7f950c0bcf50 msgr2=0x7f950c0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:48.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f9511a26640 1 -- 172.21.15.45:0/3930366716 shutdown_connections 2023-10-03T19:12:48.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f9511a26640 1 -- 172.21.15.45:0/3930366716 wait complete. 2023-10-03T19:12:48.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f9511a26640 1 Processor -- start 2023-10-03T19:12:48.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f9511a26640 1 -- start start 2023-10-03T19:12:48.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f9511a26640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f950c06c7d0 0x7f950c06fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:48.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f9511a26640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f950c0bcb60 0x7f950c0b9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:48.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f9511a26640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f950c148b90 0x7f950c14e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:48.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f9511a26640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950c070280 con 0x7f950c148b90 2023-10-03T19:12:48.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f9511a26640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950c0ba090 con 0x7f950c0bcb60 2023-10-03T19:12:48.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f9511a26640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f950c070e80 con 0x7f950c06c7d0 2023-10-03T19:12:48.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f950b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f950c148b90 0x7f950c14e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:48.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f950b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f950c148b90 0x7f950c14e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35910/0 (socket says 172.21.15.45:35910) 2023-10-03T19:12:48.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f950b7fe640 1 -- 172.21.15.45:0/3121871777 learned_addr learned my addr 172.21.15.45:0/3121871777 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:48.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f950affd640 1 --2- 172.21.15.45:0/3121871777 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f950c06c7d0 0x7f950c06fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:48.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f950a7fc640 1 --2- 172.21.15.45:0/3121871777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f950c0bcb60 0x7f950c0b9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:48.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f950b7fe640 1 -- 172.21.15.45:0/3121871777 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f950c06c7d0 msgr2=0x7f950c06fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:48.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f950b7fe640 1 --2- 172.21.15.45:0/3121871777 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f950c06c7d0 0x7f950c06fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:48.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f950b7fe640 1 -- 172.21.15.45:0/3121871777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f950c0bcb60 msgr2=0x7f950c0b9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:48.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f950b7fe640 1 --2- 172.21.15.45:0/3121871777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f950c0bcb60 0x7f950c0b9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:48.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f950b7fe640 1 -- 172.21.15.45:0/3121871777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f4009a70 con 0x7f950c148b90 2023-10-03T19:12:48.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f950b7fe640 1 --2- 172.21.15.45:0/3121871777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f950c148b90 0x7f950c14e670 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f950400c480 tx=0x7f950400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:48.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f9503fff640 1 -- 172.21.15.45:0/3121871777 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95040074e0 con 0x7f950c148b90 2023-10-03T19:12:48.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f9503fff640 1 -- 172.21.15.45:0/3121871777 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9504007640 con 0x7f950c148b90 2023-10-03T19:12:48.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f9511a26640 1 -- 172.21.15.45:0/3121871777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f950c148f60 con 0x7f950c148b90 2023-10-03T19:12:48.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f9503fff640 1 -- 172.21.15.45:0/3121871777 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9504004a10 con 0x7f950c148b90 2023-10-03T19:12:48.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f9511a26640 1 -- 172.21.15.45:0/3121871777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f950c0bc670 con 0x7f950c148b90 2023-10-03T19:12:48.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.073+0000 7f9511a26640 1 -- 172.21.15.45:0/3121871777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f950c0a3880 con 0x7f950c148b90 2023-10-03T19:12:48.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.077+0000 7f9503fff640 1 -- 172.21.15.45:0/3121871777 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9504004b70 con 0x7f950c148b90 2023-10-03T19:12:48.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.077+0000 7f9503fff640 1 --2- 172.21.15.45:0/3121871777 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f94ec0662b0 0x7f94ec068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:48.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.077+0000 7f9503fff640 1 -- 172.21.15.45:0/3121871777 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9504083250 con 0x7f950c148b90 2023-10-03T19:12:48.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.077+0000 7f950affd640 1 --2- 172.21.15.45:0/3121871777 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f94ec0662b0 0x7f94ec068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:48.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.077+0000 7f950affd640 1 --2- 172.21.15.45:0/3121871777 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f94ec0662b0 0x7f94ec068760 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f94fc00b810 tx=0x7f94fc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:48.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.081+0000 7f9503fff640 1 -- 172.21.15.45:0/3121871777 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f95040506d0 con 0x7f950c148b90 2023-10-03T19:12:48.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.269+0000 7f9511a26640 1 -- 172.21.15.45:0/3121871777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f950c04de80 con 0x7f950c148b90 2023-10-03T19:12:48.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.269+0000 7f9503fff640 1 -- 172.21.15.45:0/3121871777 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9504053cf0 con 0x7f950c148b90 2023-10-03T19:12:48.275 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-03T19:12:48.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.273+0000 7f9511a26640 1 -- 172.21.15.45:0/3121871777 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f94ec0662b0 msgr2=0x7f94ec068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:48.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.273+0000 7f9511a26640 1 --2- 172.21.15.45:0/3121871777 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f94ec0662b0 0x7f94ec068760 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f94fc00b810 tx=0x7f94fc008040 comp rx=0 tx=0).stop 2023-10-03T19:12:48.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.273+0000 7f9511a26640 1 -- 172.21.15.45:0/3121871777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f950c148b90 msgr2=0x7f950c14e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:48.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.273+0000 7f9511a26640 1 --2- 172.21.15.45:0/3121871777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f950c148b90 0x7f950c14e670 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f950400c480 tx=0x7f950400c940 comp rx=0 tx=0).stop 2023-10-03T19:12:48.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.273+0000 7f9511a26640 1 -- 172.21.15.45:0/3121871777 shutdown_connections 2023-10-03T19:12:48.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.273+0000 7f9511a26640 1 --2- 172.21.15.45:0/3121871777 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f94ec0662b0 0x7f94ec068760 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:48.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.273+0000 7f9511a26640 1 --2- 172.21.15.45:0/3121871777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f950c148b90 0x7f950c14e670 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:48.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.273+0000 7f9511a26640 1 --2- 172.21.15.45:0/3121871777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f950c0bcb60 0x7f950c0b9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:48.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.273+0000 7f9511a26640 1 --2- 172.21.15.45:0/3121871777 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f950c06c7d0 0x7f950c06fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:48.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.273+0000 7f9511a26640 1 -- 172.21.15.45:0/3121871777 >> 172.21.15.45:0/3121871777 conn(0x7f950c0bcf50 msgr2=0x7f950c0bedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:48.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.273+0000 7f9511a26640 1 -- 172.21.15.45:0/3121871777 shutdown_connections 2023-10-03T19:12:48.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:48.273+0000 7f9511a26640 1 -- 172.21.15.45:0/3121871777 wait complete. 2023-10-03T19:12:48.294 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-03T19:12:48.294 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-03T19:12:48.294 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi172.front.sepia.ceph.com 2023-10-03T19:12:48.295 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-03T19:12:48.295 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-03T19:12:48.295 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-03T19:12:48.295 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-03T19:12:48.295 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-03T19:12:48.295 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-03T19:12:48.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:48.295 DEBUG:teuthology.orchestra.run.smithi172:> ip addr 2023-10-03T19:12:48.302 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-03T19:12:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-03T19:12:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2023-10-03T19:12:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:12:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2023-10-03T19:12:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:12:48.303 INFO:teuthology.orchestra.run.smithi172.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:12:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2c brd ff:ff:ff:ff:ff:ff 2023-10-03T19:12:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f0 2023-10-03T19:12:48.303 INFO:teuthology.orchestra.run.smithi172.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:12:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2d brd ff:ff:ff:ff:ff:ff 2023-10-03T19:12:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f1 2023-10-03T19:12:48.303 INFO:teuthology.orchestra.run.smithi172.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:12:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:90 brd ff:ff:ff:ff:ff:ff 2023-10-03T19:12:48.303 INFO:teuthology.orchestra.run.smithi172.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-03T19:12:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:91 brd ff:ff:ff:ff:ff:ff 2023-10-03T19:12:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.21.15.172/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-03T19:12:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft 42407sec preferred_lft 42407sec 2023-10-03T19:12:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::ec4:7aff:fe88:7f91/64 scope link 2023-10-03T19:12:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:12:48.304 INFO:teuthology.orchestra.run.smithi172.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-03T19:12:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 02:42:f8:ea:71:4e brd ff:ff:ff:ff:ff:ff 2023-10-03T19:12:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-03T19:12:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:12:48.304 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-03T19:12:48.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:48.305 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-10-03T19:12:48.305 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-10-03T19:12:48.305 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link add name ceph-brx type bridge 2023-10-03T19:12:48.305 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip addr flush dev ceph-brx 2023-10-03T19:12:48.305 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set ceph-brx up 2023-10-03T19:12:48.305 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-03T19:12:48.305 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-10-03T19:12:48.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:48.387 DEBUG:teuthology.orchestra.run.smithi172:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-03T19:12:48.437 INFO:teuthology.orchestra.run.smithi172.stdout:1 2023-10-03T19:12:48.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:48.439 DEBUG:teuthology.orchestra.run.smithi172:> route 2023-10-03T19:12:48.507 INFO:teuthology.orchestra.run.smithi172.stdout:Kernel IP routing table 2023-10-03T19:12:48.507 INFO:teuthology.orchestra.run.smithi172.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-03T19:12:48.507 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-03T19:12:48.507 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-03T19:12:48.507 INFO:teuthology.orchestra.run.smithi172.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-03T19:12:48.507 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-03T19:12:48.508 INFO:teuthology.orchestra.run.smithi172.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:12:48.508 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:12:48.508 INFO:teuthology.orchestra.run.smithi172.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:12:48.508 INFO:teuthology.orchestra.run.smithi172.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-03T19:12:48.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:48.508 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-10-03T19:12:48.508 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-10-03T19:12:48.508 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-03T19:12:48.509 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-03T19:12:48.509 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-03T19:12:48.509 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-10-03T19:12:48.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:48.581 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2023-10-03T19:12:48.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:48.629 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list-id 2023-10-03T19:12:48.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:48.680 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-10-03T19:12:48.681 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-10-03T19:12:48.681 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-03T19:12:48.681 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-03T19:12:48.681 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-10-03T19:12:48.750 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-03T19:12:48.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:48.750 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-10-03T19:12:48.751 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-10-03T19:12:48.751 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-03T19:12:48.751 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-03T19:12:48.751 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-03T19:12:48.751 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-03T19:12:48.751 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-03T19:12:48.751 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-10-03T19:12:48.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:48.849 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-10-03T19:12:48.849 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-10-03T19:12:48.849 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set brx.0 up 2023-10-03T19:12:48.849 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set dev brx.0 master ceph-brx 2023-10-03T19:12:48.849 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-10-03T19:12:48.867 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-03T19:12:48.867 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T19:12:48.868 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-03T19:12:48.920 INFO:teuthology.orchestra.run.smithi172.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-03T19:12:48.920 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T19:12:48.921 DEBUG:teuthology.orchestra.run.smithi172:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-03T19:12:48.968 DEBUG:teuthology.orchestra.run.smithi172:> sudo modprobe fuse 2023-10-03T19:12:49.026 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:12:49.026 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:12:49.080 INFO:teuthology.orchestra.run.smithi172.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:12:49.081 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:12:49.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:49.081 DEBUG:teuthology.orchestra.run.smithi172:> ls /sys/fs/fuse/connections 2023-10-03T19:12:49.129 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-03T19:12:49.129 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-03T19:12:49.174 DEBUG:teuthology.orchestra.run.smithi172:> sudo modprobe fuse 2023-10-03T19:12:49.188 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:12:49.188 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:12:49.242 INFO:teuthology.orchestra.run.smithi172.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:12:49.243 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:12:49.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:49.244 DEBUG:teuthology.orchestra.run.smithi172:> ls /sys/fs/fuse/connections 2023-10-03T19:12:49.264 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi172.stderr:2023-10-03T19:12:49.261+0000 7fa2edf11580 -1 init, newargv = 0x56315ebae560 newargc=15 2023-10-03T19:12:49.264 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi172.stderr:ceph-fuse[33118]: starting ceph client 2023-10-03T19:12:49.273 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi172.stderr:ceph-fuse[33118]: starting fuse 2023-10-03T19:12:50.369 DEBUG:teuthology.orchestra.run.smithi172:> sudo modprobe fuse 2023-10-03T19:12:50.385 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:12:50.386 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:12:50.439 INFO:teuthology.orchestra.run.smithi172.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:12:50.441 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:12:50.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:50.442 DEBUG:teuthology.orchestra.run.smithi172:> ls /sys/fs/fuse/connections 2023-10-03T19:12:50.488 INFO:teuthology.orchestra.run.smithi172.stdout:45 2023-10-03T19:12:50.489 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-03T19:12:50.489 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-03T19:12:50.489 DEBUG:teuthology.orchestra.run.smithi172:> import glob 2023-10-03T19:12:50.489 DEBUG:teuthology.orchestra.run.smithi172:> import re 2023-10-03T19:12:50.489 DEBUG:teuthology.orchestra.run.smithi172:> import os 2023-10-03T19:12:50.489 DEBUG:teuthology.orchestra.run.smithi172:> import subprocess 2023-10-03T19:12:50.489 DEBUG:teuthology.orchestra.run.smithi172:> 2023-10-03T19:12:50.489 DEBUG:teuthology.orchestra.run.smithi172:> def _find_admin_socket(client_name): 2023-10-03T19:12:50.490 DEBUG:teuthology.orchestra.run.smithi172:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-03T19:12:50.490 DEBUG:teuthology.orchestra.run.smithi172:> files = glob.glob(asok_path) 2023-10-03T19:12:50.490 DEBUG:teuthology.orchestra.run.smithi172:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-03T19:12:50.490 DEBUG:teuthology.orchestra.run.smithi172:> 2023-10-03T19:12:50.490 DEBUG:teuthology.orchestra.run.smithi172:> # Given a non-glob path, it better be there 2023-10-03T19:12:50.490 DEBUG:teuthology.orchestra.run.smithi172:> if "*" not in asok_path: 2023-10-03T19:12:50.490 DEBUG:teuthology.orchestra.run.smithi172:> assert(len(files) == 1) 2023-10-03T19:12:50.490 DEBUG:teuthology.orchestra.run.smithi172:> return files[0] 2023-10-03T19:12:50.490 DEBUG:teuthology.orchestra.run.smithi172:> 2023-10-03T19:12:50.490 DEBUG:teuthology.orchestra.run.smithi172:> for f in files: 2023-10-03T19:12:50.490 DEBUG:teuthology.orchestra.run.smithi172:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-03T19:12:50.490 DEBUG:teuthology.orchestra.run.smithi172:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-03T19:12:50.491 DEBUG:teuthology.orchestra.run.smithi172:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-03T19:12:50.491 DEBUG:teuthology.orchestra.run.smithi172:> contents = proc_f.read() 2023-10-03T19:12:50.491 DEBUG:teuthology.orchestra.run.smithi172:> if mountpoint in contents: 2023-10-03T19:12:50.491 DEBUG:teuthology.orchestra.run.smithi172:> return f 2023-10-03T19:12:50.491 DEBUG:teuthology.orchestra.run.smithi172:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-03T19:12:50.491 DEBUG:teuthology.orchestra.run.smithi172:> 2023-10-03T19:12:50.491 DEBUG:teuthology.orchestra.run.smithi172:> print(_find_admin_socket("client.1")) 2023-10-03T19:12:50.491 DEBUG:teuthology.orchestra.run.smithi172:> ' 2023-10-03T19:12:50.609 INFO:teuthology.orchestra.run.smithi172.stdout:/var/run/ceph/ceph-client.1.33118.asok 2023-10-03T19:12:50.791 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.33118.asok 2023-10-03T19:12:50.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:50.791 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.33118.asok status 2023-10-03T19:12:50.949 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2023-10-03T19:12:50.949 INFO:teuthology.orchestra.run.smithi172.stdout: "metadata": { 2023-10-03T19:12:50.950 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_sha1": "05a43c8fb3988914c879a50970f9054a098e0612", 2023-10-03T19:12:50.950 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_version": "ceph version 18.0.0-3908-g05a43c8f (05a43c8fb3988914c879a50970f9054a098e0612) reef (dev)", 2023-10-03T19:12:50.950 INFO:teuthology.orchestra.run.smithi172.stdout: "entity_id": "1", 2023-10-03T19:12:50.950 INFO:teuthology.orchestra.run.smithi172.stdout: "hostname": "smithi172", 2023-10-03T19:12:50.950 INFO:teuthology.orchestra.run.smithi172.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-03T19:12:50.950 INFO:teuthology.orchestra.run.smithi172.stdout: "pid": "33118", 2023-10-03T19:12:50.950 INFO:teuthology.orchestra.run.smithi172.stdout: "root": "/" 2023-10-03T19:12:50.950 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-03T19:12:50.950 INFO:teuthology.orchestra.run.smithi172.stdout: "dentry_count": 0, 2023-10-03T19:12:50.951 INFO:teuthology.orchestra.run.smithi172.stdout: "dentry_pinned_count": 0, 2023-10-03T19:12:50.951 INFO:teuthology.orchestra.run.smithi172.stdout: "id": 4502, 2023-10-03T19:12:50.951 INFO:teuthology.orchestra.run.smithi172.stdout: "inst": { 2023-10-03T19:12:50.951 INFO:teuthology.orchestra.run.smithi172.stdout: "name": { 2023-10-03T19:12:50.951 INFO:teuthology.orchestra.run.smithi172.stdout: "type": "client", 2023-10-03T19:12:50.951 INFO:teuthology.orchestra.run.smithi172.stdout: "num": 4502 2023-10-03T19:12:50.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-03T19:12:50.951 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": { 2023-10-03T19:12:50.951 INFO:teuthology.orchestra.run.smithi172.stdout: "type": "v1", 2023-10-03T19:12:50.951 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": "172.21.15.172:0", 2023-10-03T19:12:50.951 INFO:teuthology.orchestra.run.smithi172.stdout: "nonce": 593744088 2023-10-03T19:12:50.951 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-03T19:12:50.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-03T19:12:50.952 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": { 2023-10-03T19:12:50.952 INFO:teuthology.orchestra.run.smithi172.stdout: "type": "v1", 2023-10-03T19:12:50.952 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": "172.21.15.172:0", 2023-10-03T19:12:50.952 INFO:teuthology.orchestra.run.smithi172.stdout: "nonce": 593744088 2023-10-03T19:12:50.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-03T19:12:50.952 INFO:teuthology.orchestra.run.smithi172.stdout: "inst_str": "client.4502 172.21.15.172:0/593744088", 2023-10-03T19:12:50.952 INFO:teuthology.orchestra.run.smithi172.stdout: "addr_str": "172.21.15.172:0/593744088", 2023-10-03T19:12:50.952 INFO:teuthology.orchestra.run.smithi172.stdout: "inode_count": 1, 2023-10-03T19:12:50.952 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_epoch": 7, 2023-10-03T19:12:50.952 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_epoch": 22, 2023-10-03T19:12:50.952 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_epoch_barrier": 0, 2023-10-03T19:12:50.952 INFO:teuthology.orchestra.run.smithi172.stdout: "blocklisted": false, 2023-10-03T19:12:50.953 INFO:teuthology.orchestra.run.smithi172.stdout: "fs_name": "cephfs" 2023-10-03T19:12:50.953 INFO:teuthology.orchestra.run.smithi172.stdout:} 2023-10-03T19:12:50.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:50.965 DEBUG:teuthology.orchestra.run.smithi146:> stat --file-system '--printf=%T 2023-10-03T19:12:50.965 DEBUG:teuthology.orchestra.run.smithi146:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-03T19:12:50.973 INFO:teuthology.orchestra.run.smithi146.stdout:fuseblk 2023-10-03T19:12:50.973 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-03T19:12:50.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:50.973 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-03T19:12:51.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:51.033 DEBUG:teuthology.orchestra.run.smithi172:> stat --file-system '--printf=%T 2023-10-03T19:12:51.033 DEBUG:teuthology.orchestra.run.smithi172:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-03T19:12:51.040 INFO:teuthology.orchestra.run.smithi172.stdout:fuseblk 2023-10-03T19:12:51.041 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-03T19:12:51.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:12:51.041 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-03T19:12:51.102 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-03T19:12:51.119 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:12:51.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.249+0000 7f457e457640 1 Processor -- start 2023-10-03T19:12:51.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.249+0000 7f457e457640 1 -- start start 2023-10-03T19:12:51.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.249+0000 7f457e457640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f457814f240 0x7f45781528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:51.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.249+0000 7f457e457640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f45780c2790 0x7f45780c0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:51.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.249+0000 7f457e457640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f457806b2d0 con 0x7f45780bb1d0 2023-10-03T19:12:51.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.249+0000 7f457e457640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f457806b640 con 0x7f45780c2790 2023-10-03T19:12:51.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.249+0000 7f457e457640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45780c0fa0 con 0x7f457814f240 2023-10-03T19:12:51.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.249+0000 7f45777fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f45780c2790 0x7f45780c0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:51.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.249+0000 7f45777fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f45780c2790 0x7f45780c0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35912/0 (socket says 172.21.15.45:35912) 2023-10-03T19:12:51.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.249+0000 7f45777fe640 1 -- 172.21.15.45:0/637141672 learned_addr learned my addr 172.21.15.45:0/637141672 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:51.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.249+0000 7f457c9f4640 1 --1- 172.21.15.45:0/637141672 >> v1:172.21.15.45:6789/0 conn(0x7f45780bb1d0 0x7f45780c12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38888/0 (socket says 172.21.15.45:38888) 2023-10-03T19:12:51.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.249+0000 7f4577fff640 1 --2- 172.21.15.45:0/637141672 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f457814f240 0x7f45781528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:51.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.249+0000 7f45777fe640 1 -- 172.21.15.45:0/637141672 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f457814f240 msgr2=0x7f45781528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:51.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.249+0000 7f45777fe640 1 --2- 172.21.15.45:0/637141672 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f457814f240 0x7f45781528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:51.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.249+0000 7f45777fe640 1 -- 172.21.15.45:0/637141672 >> v1:172.21.15.45:6789/0 conn(0x7f45780bb1d0 legacy=0x7f45780c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:51.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.249+0000 7f45777fe640 1 -- 172.21.15.45:0/637141672 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45780a3c60 con 0x7f45780c2790 2023-10-03T19:12:51.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.249+0000 7f4577fff640 1 --2- 172.21.15.45:0/637141672 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f457814f240 0x7f45781528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:51.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.249+0000 7f45777fe640 1 --2- 172.21.15.45:0/637141672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45780c2790 0x7f45780c0a60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f456c006fd0 tx=0x7f456c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8846cf8d20af7d16 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:51.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f4576ffd640 1 -- 172.21.15.45:0/637141672 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c0a8a10 con 0x7f45780c2790 2023-10-03T19:12:51.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f4576ffd640 1 -- 172.21.15.45:0/637141672 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f456c0a8b70 con 0x7f45780c2790 2023-10-03T19:12:51.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f4576ffd640 1 -- 172.21.15.45:0/637141672 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c0b0440 con 0x7f45780c2790 2023-10-03T19:12:51.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f457e457640 1 -- 172.21.15.45:0/637141672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45780c2790 msgr2=0x7f45780c0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:51.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f457e457640 1 --2- 172.21.15.45:0/637141672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45780c2790 0x7f45780c0a60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f456c006fd0 tx=0x7f456c01ed10 comp rx=0 tx=0).stop 2023-10-03T19:12:51.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f457e457640 1 -- 172.21.15.45:0/637141672 shutdown_connections 2023-10-03T19:12:51.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f457e457640 1 --2- 172.21.15.45:0/637141672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45780c2790 0x7f45780c0a60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:51.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f457e457640 1 --2- 172.21.15.45:0/637141672 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f457814f240 0x7f45781528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:51.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f457e457640 1 -- 172.21.15.45:0/637141672 >> 172.21.15.45:0/637141672 conn(0x7f45780a64a0 msgr2=0x7f45780a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:51.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f457e457640 1 -- 172.21.15.45:0/637141672 shutdown_connections 2023-10-03T19:12:51.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f457e457640 1 -- 172.21.15.45:0/637141672 wait complete. 2023-10-03T19:12:51.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f457e457640 1 Processor -- start 2023-10-03T19:12:51.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f457e457640 1 -- start start 2023-10-03T19:12:51.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f457e457640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f45780bb1d0 0x7f45781e4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:51.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f457e457640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45780c2790 0x7f457814fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:51.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f457e457640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f457814f240 0x7f4578150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:51.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f457e457640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45781e8470 con 0x7f45780c2790 2023-10-03T19:12:51.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f457e457640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45780aa270 con 0x7f457814f240 2023-10-03T19:12:51.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f457e457640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45781e7e60 con 0x7f45780bb1d0 2023-10-03T19:12:51.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f45777fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45780c2790 0x7f457814fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:51.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f45777fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45780c2790 0x7f457814fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35928/0 (socket says 172.21.15.45:35928) 2023-10-03T19:12:51.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f45777fe640 1 -- 172.21.15.45:0/3339324801 learned_addr learned my addr 172.21.15.45:0/3339324801 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:51.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f45777fe640 1 -- 172.21.15.45:0/3339324801 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f45780bb1d0 msgr2=0x7f45781e4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:51.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f45777fe640 1 --2- 172.21.15.45:0/3339324801 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f45780bb1d0 0x7f45781e4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:51.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f457c9f4640 1 --2- 172.21.15.45:0/3339324801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f457814f240 0x7f4578150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:51.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f45777fe640 1 -- 172.21.15.45:0/3339324801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f457814f240 msgr2=0x7f4578150820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:51.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f45777fe640 1 --2- 172.21.15.45:0/3339324801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f457814f240 0x7f4578150820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:51.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f45777fe640 1 -- 172.21.15.45:0/3339324801 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456c009480 con 0x7f45780c2790 2023-10-03T19:12:51.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f45777fe640 1 --2- 172.21.15.45:0/3339324801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45780c2790 0x7f457814fa10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f456c01d3c0 tx=0x7f456c01bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:51.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f4574ff9640 1 -- 172.21.15.45:0/3339324801 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c005ba0 con 0x7f45780c2790 2023-10-03T19:12:51.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f4574ff9640 1 -- 172.21.15.45:0/3339324801 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f456c005d00 con 0x7f45780c2790 2023-10-03T19:12:51.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f457e457640 1 -- 172.21.15.45:0/3339324801 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f457814e740 con 0x7f45780c2790 2023-10-03T19:12:51.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f4574ff9640 1 -- 172.21.15.45:0/3339324801 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c003860 con 0x7f45780c2790 2023-10-03T19:12:51.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.253+0000 7f457e457640 1 -- 172.21.15.45:0/3339324801 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45780c19b0 con 0x7f45780c2790 2023-10-03T19:12:51.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.257+0000 7f457e457640 1 -- 172.21.15.45:0/3339324801 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45780a3f40 con 0x7f45780c2790 2023-10-03T19:12:51.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.257+0000 7f4574ff9640 1 -- 172.21.15.45:0/3339324801 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f456c0039c0 con 0x7f45780c2790 2023-10-03T19:12:51.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.257+0000 7f4574ff9640 1 --2- 172.21.15.45:0/3339324801 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f45640662b0 0x7f4564068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:51.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.257+0000 7f4574ff9640 1 -- 172.21.15.45:0/3339324801 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f456c120ca0 con 0x7f45780c2790 2023-10-03T19:12:51.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.257+0000 7f4577fff640 1 --2- 172.21.15.45:0/3339324801 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f45640662b0 0x7f4564068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:51.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.257+0000 7f4577fff640 1 --2- 172.21.15.45:0/3339324801 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f45640662b0 0x7f4564068760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4568006fd0 tx=0x7f4568008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:51.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.261+0000 7f4574ff9640 1 -- 172.21.15.45:0/3339324801 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f456c0ee1b0 con 0x7f45780c2790 2023-10-03T19:12:51.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.417+0000 7f457e457640 1 -- 172.21.15.45:0/3339324801 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45780bfa60 con 0x7f45780c2790 2023-10-03T19:12:51.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.421+0000 7f4574ff9640 1 -- 172.21.15.45:0/3339324801 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18231 (secure 0 0 0) 0x7f456c0b5020 con 0x7f45780c2790 2023-10-03T19:12:51.424 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:51.425 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:12:28.941467+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:12:26.226431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T19:12:26.923174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:12:51.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.421+0000 7f457e457640 1 -- 172.21.15.45:0/3339324801 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f45640662b0 msgr2=0x7f4564068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:51.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.421+0000 7f457e457640 1 --2- 172.21.15.45:0/3339324801 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f45640662b0 0x7f4564068760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4568006fd0 tx=0x7f4568008040 comp rx=0 tx=0).stop 2023-10-03T19:12:51.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.421+0000 7f457e457640 1 -- 172.21.15.45:0/3339324801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45780c2790 msgr2=0x7f457814fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:51.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.421+0000 7f457e457640 1 --2- 172.21.15.45:0/3339324801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45780c2790 0x7f457814fa10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f456c01d3c0 tx=0x7f456c01bab0 comp rx=0 tx=0).stop 2023-10-03T19:12:51.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.421+0000 7f457e457640 1 -- 172.21.15.45:0/3339324801 shutdown_connections 2023-10-03T19:12:51.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.421+0000 7f457e457640 1 --2- 172.21.15.45:0/3339324801 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f45640662b0 0x7f4564068760 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:51.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.421+0000 7f457e457640 1 --2- 172.21.15.45:0/3339324801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f457814f240 0x7f4578150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:51.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.421+0000 7f457e457640 1 --2- 172.21.15.45:0/3339324801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45780c2790 0x7f457814fa10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:51.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.421+0000 7f457e457640 1 --2- 172.21.15.45:0/3339324801 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f45780bb1d0 0x7f45781e4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:51.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.421+0000 7f457e457640 1 -- 172.21.15.45:0/3339324801 >> 172.21.15.45:0/3339324801 conn(0x7f45780a64a0 msgr2=0x7f45780bf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:51.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.421+0000 7f457e457640 1 -- 172.21.15.45:0/3339324801 shutdown_connections 2023-10-03T19:12:51.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.421+0000 7f457e457640 1 -- 172.21.15.45:0/3339324801 wait complete. 2023-10-03T19:12:51.445 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T19:12:26.226431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T19:12:26.923174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:12:51.445 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:12:51.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.573+0000 7f93d8bff640 1 Processor -- start 2023-10-03T19:12:51.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.573+0000 7f93d8bff640 1 -- start start 2023-10-03T19:12:51.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.573+0000 7f93d8bff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f93d40712c0 0x7f93d40bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:51.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.573+0000 7f93d8bff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f93d406c760 0x7f93d40bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:51.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.573+0000 7f93d8bff640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93d406c2d0 con 0x7f93d406d560 2023-10-03T19:12:51.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.573+0000 7f93d8bff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d4150610 con 0x7f93d40712c0 2023-10-03T19:12:51.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.573+0000 7f93d8bff640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d41508b0 con 0x7f93d406c760 2023-10-03T19:12:51.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.573+0000 7f93d259c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f93d40712c0 0x7f93d40bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:51.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.573+0000 7f93d259c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f93d40712c0 0x7f93d40bcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35936/0 (socket says 172.21.15.45:35936) 2023-10-03T19:12:51.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.573+0000 7f93d259c640 1 -- 172.21.15.45:0/937251010 learned_addr learned my addr 172.21.15.45:0/937251010 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:51.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.573+0000 7f93d2d9d640 1 --2- 172.21.15.45:0/937251010 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f93d406c760 0x7f93d40bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:51.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.573+0000 7f93d259c640 1 -- 172.21.15.45:0/937251010 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f93d406c760 msgr2=0x7f93d40bd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:51.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.573+0000 7f93d259c640 1 --2- 172.21.15.45:0/937251010 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f93d406c760 0x7f93d40bd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:51.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.573+0000 7f93d259c640 1 -- 172.21.15.45:0/937251010 >> v1:172.21.15.79:6789/0 conn(0x7f93d406d560 legacy=0x7f93d40a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:51.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.573+0000 7f93d259c640 1 -- 172.21.15.45:0/937251010 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d406d2e0 con 0x7f93d40712c0 2023-10-03T19:12:51.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.577+0000 7f93d259c640 1 --2- 172.21.15.45:0/937251010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d40712c0 0x7f93d40bcbc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f93c4009870 tx=0x7f93c401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ddbafafec7db34 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:51.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.577+0000 7f93d159a640 1 -- 172.21.15.45:0/937251010 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c40ab680 con 0x7f93d40712c0 2023-10-03T19:12:51.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.577+0000 7f93d159a640 1 -- 172.21.15.45:0/937251010 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c40ab7e0 con 0x7f93d40712c0 2023-10-03T19:12:51.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.577+0000 7f93d159a640 1 -- 172.21.15.45:0/937251010 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c40abb70 con 0x7f93d40712c0 2023-10-03T19:12:51.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.577+0000 7f93d8bff640 1 -- 172.21.15.45:0/937251010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d40712c0 msgr2=0x7f93d40bcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:51.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.577+0000 7f93d8bff640 1 --2- 172.21.15.45:0/937251010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d40712c0 0x7f93d40bcbc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f93c4009870 tx=0x7f93c401c540 comp rx=0 tx=0).stop 2023-10-03T19:12:51.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.577+0000 7f93d8bff640 1 -- 172.21.15.45:0/937251010 shutdown_connections 2023-10-03T19:12:51.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.577+0000 7f93d8bff640 1 --2- 172.21.15.45:0/937251010 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f93d406c760 0x7f93d40bd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:51.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.577+0000 7f93d8bff640 1 --2- 172.21.15.45:0/937251010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d40712c0 0x7f93d40bcbc0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:51.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.577+0000 7f93d8bff640 1 -- 172.21.15.45:0/937251010 >> 172.21.15.45:0/937251010 conn(0x7f93d40a20d0 msgr2=0x7f93d40a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:51.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.577+0000 7f93d8bff640 1 -- 172.21.15.45:0/937251010 shutdown_connections 2023-10-03T19:12:51.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.577+0000 7f93d8bff640 1 -- 172.21.15.45:0/937251010 wait complete. 2023-10-03T19:12:51.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.577+0000 7f93d8bff640 1 Processor -- start 2023-10-03T19:12:51.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.577+0000 7f93d8bff640 1 -- start start 2023-10-03T19:12:51.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.577+0000 7f93d8bff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93d406c760 0x7f93d40bce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:51.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.577+0000 7f93d8bff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d406d560 0x7f93d4145710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:51.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.577+0000 7f93d8bff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f93d40712c0 0x7f93d4145c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:51.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.577+0000 7f93d8bff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d414c9a0 con 0x7f93d406d560 2023-10-03T19:12:51.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.577+0000 7f93d8bff640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d40bd360 con 0x7f93d406c760 2023-10-03T19:12:51.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.577+0000 7f93d8bff640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d41e5600 con 0x7f93d40712c0 2023-10-03T19:12:51.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.577+0000 7f93d259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93d406c760 0x7f93d40bce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:51.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.577+0000 7f93d259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93d406c760 0x7f93d40bce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:59704/0 (socket says 172.21.15.45:59704) 2023-10-03T19:12:51.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.577+0000 7f93d259c640 1 -- 172.21.15.45:0/967461760 learned_addr learned my addr 172.21.15.45:0/967461760 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:51.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.577+0000 7f93d2d9d640 1 --2- 172.21.15.45:0/967461760 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f93d40712c0 0x7f93d4145c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:51.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.577+0000 7f93d1d9b640 1 --2- 172.21.15.45:0/967461760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d406d560 0x7f93d4145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:51.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.581+0000 7f93d1d9b640 1 -- 172.21.15.45:0/967461760 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f93d40712c0 msgr2=0x7f93d4145c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:51.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.581+0000 7f93d1d9b640 1 --2- 172.21.15.45:0/967461760 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f93d40712c0 0x7f93d4145c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:51.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.581+0000 7f93d1d9b640 1 -- 172.21.15.45:0/967461760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93d406c760 msgr2=0x7f93d40bce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:51.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.581+0000 7f93d1d9b640 1 --2- 172.21.15.45:0/967461760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93d406c760 0x7f93d40bce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:51.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.581+0000 7f93d1d9b640 1 -- 172.21.15.45:0/967461760 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c40094d0 con 0x7f93d406d560 2023-10-03T19:12:51.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.581+0000 7f93d1d9b640 1 --2- 172.21.15.45:0/967461760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d406d560 0x7f93d4145710 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f93c8000f70 tx=0x7f93c800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:51.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.581+0000 7f93c2ffd640 1 -- 172.21.15.45:0/967461760 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c80052d0 con 0x7f93d406d560 2023-10-03T19:12:51.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.581+0000 7f93c2ffd640 1 -- 172.21.15.45:0/967461760 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c8005430 con 0x7f93d406d560 2023-10-03T19:12:51.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.581+0000 7f93d8bff640 1 -- 172.21.15.45:0/967461760 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d40a6070 con 0x7f93d406d560 2023-10-03T19:12:51.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.581+0000 7f93c2ffd640 1 -- 172.21.15.45:0/967461760 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c8003840 con 0x7f93d406d560 2023-10-03T19:12:51.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.581+0000 7f93d8bff640 1 -- 172.21.15.45:0/967461760 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d40a5ee0 con 0x7f93d406d560 2023-10-03T19:12:51.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.581+0000 7f93d8bff640 1 -- 172.21.15.45:0/967461760 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d41596f0 con 0x7f93d406d560 2023-10-03T19:12:51.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.581+0000 7f93c2ffd640 1 -- 172.21.15.45:0/967461760 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f93c80039a0 con 0x7f93d406d560 2023-10-03T19:12:51.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.581+0000 7f93c2ffd640 1 --2- 172.21.15.45:0/967461760 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f93b40662b0 0x7f93b4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:51.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.581+0000 7f93c2ffd640 1 -- 172.21.15.45:0/967461760 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f93c8083520 con 0x7f93d406d560 2023-10-03T19:12:51.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.581+0000 7f93d259c640 1 --2- 172.21.15.45:0/967461760 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f93b40662b0 0x7f93b4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:51.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.581+0000 7f93d259c640 1 --2- 172.21.15.45:0/967461760 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f93b40662b0 0x7f93b4068760 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f93c401c580 tx=0x7f93c40b6040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:51.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.585+0000 7f93c2ffd640 1 -- 172.21.15.45:0/967461760 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f93c8050bc0 con 0x7f93d406d560 2023-10-03T19:12:51.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.741+0000 7f93d8bff640 1 -- 172.21.15.45:0/967461760 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f93d40bca30 con 0x7f93d406d560 2023-10-03T19:12:51.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.741+0000 7f93c2ffd640 1 -- 172.21.15.45:0/967461760 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f93c80541e0 con 0x7f93d406d560 2023-10-03T19:12:51.745 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:12:51.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.741+0000 7f93d8bff640 1 -- 172.21.15.45:0/967461760 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f93b40662b0 msgr2=0x7f93b4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:51.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.741+0000 7f93d8bff640 1 --2- 172.21.15.45:0/967461760 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f93b40662b0 0x7f93b4068760 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f93c401c580 tx=0x7f93c40b6040 comp rx=0 tx=0).stop 2023-10-03T19:12:51.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.741+0000 7f93d8bff640 1 -- 172.21.15.45:0/967461760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d406d560 msgr2=0x7f93d4145710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:51.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.741+0000 7f93d8bff640 1 --2- 172.21.15.45:0/967461760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d406d560 0x7f93d4145710 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f93c8000f70 tx=0x7f93c800c820 comp rx=0 tx=0).stop 2023-10-03T19:12:51.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.741+0000 7f93d8bff640 1 -- 172.21.15.45:0/967461760 shutdown_connections 2023-10-03T19:12:51.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.741+0000 7f93d8bff640 1 --2- 172.21.15.45:0/967461760 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f93b40662b0 0x7f93b4068760 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:51.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.741+0000 7f93d8bff640 1 --2- 172.21.15.45:0/967461760 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f93d40712c0 0x7f93d4145c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:51.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.741+0000 7f93d8bff640 1 --2- 172.21.15.45:0/967461760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d406d560 0x7f93d4145710 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:51.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.741+0000 7f93d8bff640 1 --2- 172.21.15.45:0/967461760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93d406c760 0x7f93d40bce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:51.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.741+0000 7f93d8bff640 1 -- 172.21.15.45:0/967461760 >> 172.21.15.45:0/967461760 conn(0x7f93d40a20d0 msgr2=0x7f93d40a51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:51.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.745+0000 7f93d8bff640 1 -- 172.21.15.45:0/967461760 shutdown_connections 2023-10-03T19:12:51.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.745+0000 7f93d8bff640 1 -- 172.21.15.45:0/967461760 wait complete. 2023-10-03T19:12:51.764 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:12:51.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.881+0000 7f9fde2bd640 1 Processor -- start 2023-10-03T19:12:51.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.881+0000 7f9fde2bd640 1 -- start start 2023-10-03T19:12:51.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.881+0000 7f9fde2bd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9fd806d560 0x7f9fd80a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:51.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.881+0000 7f9fde2bd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9fd806c760 0x7f9fd80a5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:51.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.881+0000 7f9fde2bd640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fd806c2d0 con 0x7f9fd80712c0 2023-10-03T19:12:51.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.881+0000 7f9fde2bd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd8150610 con 0x7f9fd806d560 2023-10-03T19:12:51.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.881+0000 7f9fde2bd640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd81508b0 con 0x7f9fd806c760 2023-10-03T19:12:51.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.881+0000 7f9fcffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9fd806d560 0x7f9fd80a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:51.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.881+0000 7f9fcffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9fd806d560 0x7f9fd80a53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35956/0 (socket says 172.21.15.45:35956) 2023-10-03T19:12:51.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.881+0000 7f9fcffff640 1 -- 172.21.15.45:0/1383630760 learned_addr learned my addr 172.21.15.45:0/1383630760 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:51.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.881+0000 7f9fdc85a640 1 --2- 172.21.15.45:0/1383630760 >> v2:172.21.15.79:3300/0 conn(0x7f9fd806c760 0x7f9fd80a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:51.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.881+0000 7f9fcffff640 1 -- 172.21.15.45:0/1383630760 >> v2:172.21.15.79:3300/0 conn(0x7f9fd806c760 msgr2=0x7f9fd80a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:51.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.881+0000 7f9fcffff640 1 --2- 172.21.15.45:0/1383630760 >> v2:172.21.15.79:3300/0 conn(0x7f9fd806c760 0x7f9fd80a5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:51.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.881+0000 7f9fcffff640 1 -- 172.21.15.45:0/1383630760 >> v1:172.21.15.79:6789/0 conn(0x7f9fd80712c0 legacy=0x7f9fd80bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:51.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.881+0000 7f9fcffff640 1 -- 172.21.15.45:0/1383630760 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd806d2e0 con 0x7f9fd806d560 2023-10-03T19:12:51.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.885+0000 7f9fcffff640 1 --2- 172.21.15.45:0/1383630760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fd806d560 0x7f9fd80a53c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9fd80c14e0 tx=0x7f9fc001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42064f56d06d7cd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:51.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.885+0000 7f9fd77fe640 1 -- 172.21.15.45:0/1383630760 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc00ab640 con 0x7f9fd806d560 2023-10-03T19:12:51.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.885+0000 7f9fd77fe640 1 -- 172.21.15.45:0/1383630760 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc00a7070 con 0x7f9fd806d560 2023-10-03T19:12:51.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.885+0000 7f9fd77fe640 1 -- 172.21.15.45:0/1383630760 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc00ab9c0 con 0x7f9fd806d560 2023-10-03T19:12:51.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.885+0000 7f9fde2bd640 1 -- 172.21.15.45:0/1383630760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fd806d560 msgr2=0x7f9fd80a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:51.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.885+0000 7f9fde2bd640 1 --2- 172.21.15.45:0/1383630760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fd806d560 0x7f9fd80a53c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9fd80c14e0 tx=0x7f9fc001c500 comp rx=0 tx=0).stop 2023-10-03T19:12:51.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.885+0000 7f9fde2bd640 1 -- 172.21.15.45:0/1383630760 shutdown_connections 2023-10-03T19:12:51.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.885+0000 7f9fde2bd640 1 --2- 172.21.15.45:0/1383630760 >> v2:172.21.15.79:3300/0 conn(0x7f9fd806c760 0x7f9fd80a5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:51.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.885+0000 7f9fde2bd640 1 --2- 172.21.15.45:0/1383630760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fd806d560 0x7f9fd80a53c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:51.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.885+0000 7f9fde2bd640 1 -- 172.21.15.45:0/1383630760 >> 172.21.15.45:0/1383630760 conn(0x7f9fd80a20d0 msgr2=0x7f9fd80a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:51.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.885+0000 7f9fde2bd640 1 -- 172.21.15.45:0/1383630760 shutdown_connections 2023-10-03T19:12:51.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.885+0000 7f9fde2bd640 1 -- 172.21.15.45:0/1383630760 wait complete. 2023-10-03T19:12:51.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.885+0000 7f9fde2bd640 1 Processor -- start 2023-10-03T19:12:51.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.885+0000 7f9fde2bd640 1 -- start start 2023-10-03T19:12:51.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.885+0000 7f9fde2bd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fd806c760 0x7f9fd81e5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:51.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.885+0000 7f9fde2bd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fd806d560 0x7f9fd813fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:51.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.885+0000 7f9fde2bd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fd80712c0 0x7f9fd8140160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:51.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.885+0000 7f9fde2bd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd81406a0 con 0x7f9fd80712c0 2023-10-03T19:12:51.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.885+0000 7f9fde2bd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd8143640 con 0x7f9fd806d560 2023-10-03T19:12:51.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.885+0000 7f9fde2bd640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd81e5980 con 0x7f9fd806c760 2023-10-03T19:12:51.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.885+0000 7f9fdc85a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fd80712c0 0x7f9fd8140160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:51.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.885+0000 7f9fdc85a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fd80712c0 0x7f9fd8140160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35972/0 (socket says 172.21.15.45:35972) 2023-10-03T19:12:51.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.885+0000 7f9fdc85a640 1 -- 172.21.15.45:0/1401674339 learned_addr learned my addr 172.21.15.45:0/1401674339 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:51.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.885+0000 7f9fcffff640 1 --2- 172.21.15.45:0/1401674339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fd806d560 0x7f9fd813fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:51.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.885+0000 7f9fd7fff640 1 --2- 172.21.15.45:0/1401674339 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fd806c760 0x7f9fd81e5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:51.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.889+0000 7f9fdc85a640 1 -- 172.21.15.45:0/1401674339 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fd806c760 msgr2=0x7f9fd81e5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:51.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.889+0000 7f9fdc85a640 1 --2- 172.21.15.45:0/1401674339 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fd806c760 0x7f9fd81e5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:51.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.889+0000 7f9fdc85a640 1 -- 172.21.15.45:0/1401674339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fd806d560 msgr2=0x7f9fd813fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:51.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.889+0000 7f9fdc85a640 1 --2- 172.21.15.45:0/1401674339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fd806d560 0x7f9fd813fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:51.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.889+0000 7f9fdc85a640 1 -- 172.21.15.45:0/1401674339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc00094d0 con 0x7f9fd80712c0 2023-10-03T19:12:51.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.889+0000 7f9fdc85a640 1 --2- 172.21.15.45:0/1401674339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fd80712c0 0x7f9fd8140160 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000efc0 tx=0x7f9fd000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:51.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.889+0000 7f9fd57fa640 1 -- 172.21.15.45:0/1401674339 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0009b20 con 0x7f9fd80712c0 2023-10-03T19:12:51.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.889+0000 7f9fd57fa640 1 -- 172.21.15.45:0/1401674339 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd000f040 con 0x7f9fd80712c0 2023-10-03T19:12:51.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.889+0000 7f9fde2bd640 1 -- 172.21.15.45:0/1401674339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fd80bd460 con 0x7f9fd80712c0 2023-10-03T19:12:51.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.889+0000 7f9fd57fa640 1 -- 172.21.15.45:0/1401674339 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd00146c0 con 0x7f9fd80712c0 2023-10-03T19:12:51.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.889+0000 7f9fde2bd640 1 -- 172.21.15.45:0/1401674339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd80bd2d0 con 0x7f9fd80712c0 2023-10-03T19:12:51.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.889+0000 7f9fde2bd640 1 -- 172.21.15.45:0/1401674339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fd81596f0 con 0x7f9fd80712c0 2023-10-03T19:12:51.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.889+0000 7f9fd57fa640 1 -- 172.21.15.45:0/1401674339 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9fd0014820 con 0x7f9fd80712c0 2023-10-03T19:12:51.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.889+0000 7f9fd57fa640 1 --2- 172.21.15.45:0/1401674339 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9fb8066280 0x7f9fb8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:51.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.889+0000 7f9fd57fa640 1 -- 172.21.15.45:0/1401674339 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9fd0084a10 con 0x7f9fd80712c0 2023-10-03T19:12:51.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.889+0000 7f9fd7fff640 1 --2- 172.21.15.45:0/1401674339 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9fb8066280 0x7f9fb8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:51.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.889+0000 7f9fd7fff640 1 --2- 172.21.15.45:0/1401674339 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9fb8066280 0x7f9fb8068730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8007fd0 tx=0x7f9fc8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:51.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:51.893+0000 7f9fd57fa640 1 -- 172.21.15.45:0/1401674339 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9fd0051f30 con 0x7f9fd80712c0 2023-10-03T19:12:52.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.053+0000 7f9fde2bd640 1 -- 172.21.15.45:0/1401674339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9fd80bca30 con 0x7f9fd80712c0 2023-10-03T19:12:52.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.053+0000 7f9fd57fa640 1 -- 172.21.15.45:0/1401674339 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9fd00180a0 con 0x7f9fd80712c0 2023-10-03T19:12:52.057 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:12:52.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.053+0000 7f9fde2bd640 1 -- 172.21.15.45:0/1401674339 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9fb8066280 msgr2=0x7f9fb8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:52.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.053+0000 7f9fde2bd640 1 --2- 172.21.15.45:0/1401674339 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9fb8066280 0x7f9fb8068730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8007fd0 tx=0x7f9fc8009040 comp rx=0 tx=0).stop 2023-10-03T19:12:52.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.053+0000 7f9fde2bd640 1 -- 172.21.15.45:0/1401674339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fd80712c0 msgr2=0x7f9fd8140160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:52.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.053+0000 7f9fde2bd640 1 --2- 172.21.15.45:0/1401674339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fd80712c0 0x7f9fd8140160 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000efc0 tx=0x7f9fd000c490 comp rx=0 tx=0).stop 2023-10-03T19:12:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.053+0000 7f9fde2bd640 1 -- 172.21.15.45:0/1401674339 shutdown_connections 2023-10-03T19:12:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.053+0000 7f9fde2bd640 1 --2- 172.21.15.45:0/1401674339 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9fb8066280 0x7f9fb8068730 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.053+0000 7f9fde2bd640 1 --2- 172.21.15.45:0/1401674339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fd80712c0 0x7f9fd8140160 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.053+0000 7f9fde2bd640 1 --2- 172.21.15.45:0/1401674339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fd806d560 0x7f9fd813fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.053+0000 7f9fde2bd640 1 --2- 172.21.15.45:0/1401674339 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fd806c760 0x7f9fd81e5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.053+0000 7f9fde2bd640 1 -- 172.21.15.45:0/1401674339 >> 172.21.15.45:0/1401674339 conn(0x7f9fd80a20d0 msgr2=0x7f9fd80be010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.053+0000 7f9fde2bd640 1 -- 172.21.15.45:0/1401674339 shutdown_connections 2023-10-03T19:12:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.053+0000 7f9fde2bd640 1 -- 172.21.15.45:0/1401674339 wait complete. 2023-10-03T19:12:52.075 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T19:12:52.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.201+0000 7fe9f388e640 1 Processor -- start 2023-10-03T19:12:52.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.201+0000 7fe9f388e640 1 -- start start 2023-10-03T19:12:52.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.201+0000 7fe9f388e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9ec0658f0 0x7fe9ec14bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:52.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.201+0000 7fe9f388e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe9ec14c0a0 0x7fe9ec069ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:52.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.201+0000 7fe9f388e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9ec06a720 con 0x7fe9ec06ae30 2023-10-03T19:12:52.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.201+0000 7fe9f388e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9ec151ca0 con 0x7fe9ec14c0a0 2023-10-03T19:12:52.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.201+0000 7fe9f388e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec151f40 con 0x7fe9ec0658f0 2023-10-03T19:12:52.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.201+0000 7fe9f0e29640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe9ec14c0a0 0x7fe9ec069ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:52.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.201+0000 7fe9f1e2b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe9ec06ae30 0x7fe9ec06a010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38896/0 (socket says 172.21.15.45:38896) 2023-10-03T19:12:52.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.201+0000 7fe9f0e29640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe9ec14c0a0 0x7fe9ec069ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35982/0 (socket says 172.21.15.45:35982) 2023-10-03T19:12:52.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.201+0000 7fe9f1e2b640 1 -- 172.21.15.45:0/939410999 learned_addr learned my addr 172.21.15.45:0/939410999 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:52.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.201+0000 7fe9f162a640 1 --2- 172.21.15.45:0/939410999 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9ec0658f0 0x7fe9ec14bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:52.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.201+0000 7fe9f0e29640 1 -- 172.21.15.45:0/939410999 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9ec0658f0 msgr2=0x7fe9ec14bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:52.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.201+0000 7fe9f0e29640 1 --2- 172.21.15.45:0/939410999 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9ec0658f0 0x7fe9ec14bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.201+0000 7fe9f0e29640 1 -- 172.21.15.45:0/939410999 >> v1:172.21.15.45:6789/0 conn(0x7fe9ec06ae30 legacy=0x7fe9ec06a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:52.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.201+0000 7fe9f0e29640 1 -- 172.21.15.45:0/939410999 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec152220 con 0x7fe9ec14c0a0 2023-10-03T19:12:52.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.201+0000 7fe9e3fff640 1 -- 172.21.15.45:0/939410999 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813050564 0 0) 0x7fe9ec06a720 con 0x7fe9ec06ae30 2023-10-03T19:12:52.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9f0e29640 1 --2- 172.21.15.45:0/939410999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9ec14c0a0 0x7fe9ec069ad0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc0097c0 tx=0x7fe9dc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b42debf1950bf79 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:52.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9e3fff640 1 -- 172.21.15.45:0/939410999 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc0ab650 con 0x7fe9ec14c0a0 2023-10-03T19:12:52.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9e3fff640 1 -- 172.21.15.45:0/939410999 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9dc0ab7b0 con 0x7fe9ec14c0a0 2023-10-03T19:12:52.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9e3fff640 1 -- 172.21.15.45:0/939410999 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc0abb40 con 0x7fe9ec14c0a0 2023-10-03T19:12:52.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9f388e640 1 -- 172.21.15.45:0/939410999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9ec14c0a0 msgr2=0x7fe9ec069ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:52.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9f388e640 1 --2- 172.21.15.45:0/939410999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9ec14c0a0 0x7fe9ec069ad0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc0097c0 tx=0x7fe9dc01c450 comp rx=0 tx=0).stop 2023-10-03T19:12:52.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9f388e640 1 -- 172.21.15.45:0/939410999 shutdown_connections 2023-10-03T19:12:52.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9f388e640 1 --2- 172.21.15.45:0/939410999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9ec14c0a0 0x7fe9ec069ad0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9f388e640 1 --2- 172.21.15.45:0/939410999 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9ec0658f0 0x7fe9ec14bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9f388e640 1 -- 172.21.15.45:0/939410999 >> 172.21.15.45:0/939410999 conn(0x7fe9ec0be190 msgr2=0x7fe9ec0be590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:52.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9f388e640 1 -- 172.21.15.45:0/939410999 shutdown_connections 2023-10-03T19:12:52.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9f388e640 1 -- 172.21.15.45:0/939410999 wait complete. 2023-10-03T19:12:52.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9f388e640 1 Processor -- start 2023-10-03T19:12:52.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9f388e640 1 -- start start 2023-10-03T19:12:52.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9f388e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9ec0658f0 0x7fe9ec0baf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:52.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9f388e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9ec06ae30 0x7fe9ec0c0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:52.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9f388e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9ec14c0a0 0x7fe9ec0c0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:52.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9f388e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0a6690 con 0x7fe9ec0658f0 2023-10-03T19:12:52.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9f388e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0a6380 con 0x7fe9ec14c0a0 2023-10-03T19:12:52.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9f388e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0c11d0 con 0x7fe9ec06ae30 2023-10-03T19:12:52.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9f162a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9ec0658f0 0x7fe9ec0baf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:52.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9f162a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9ec0658f0 0x7fe9ec0baf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35992/0 (socket says 172.21.15.45:35992) 2023-10-03T19:12:52.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9f162a640 1 -- 172.21.15.45:0/2135626387 learned_addr learned my addr 172.21.15.45:0/2135626387 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:52.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9f0e29640 1 --2- 172.21.15.45:0/2135626387 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9ec06ae30 0x7fe9ec0c0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:52.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9f1e2b640 1 --2- 172.21.15.45:0/2135626387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9ec14c0a0 0x7fe9ec0c0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:52.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9f162a640 1 -- 172.21.15.45:0/2135626387 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9ec06ae30 msgr2=0x7fe9ec0c0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:52.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9f162a640 1 --2- 172.21.15.45:0/2135626387 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9ec06ae30 0x7fe9ec0c0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9f162a640 1 -- 172.21.15.45:0/2135626387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9ec14c0a0 msgr2=0x7fe9ec0c0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:52.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9f162a640 1 --2- 172.21.15.45:0/2135626387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9ec14c0a0 0x7fe9ec0c0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9f162a640 1 -- 172.21.15.45:0/2135626387 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9dc009420 con 0x7fe9ec0658f0 2023-10-03T19:12:52.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9f0e29640 1 --2- 172.21.15.45:0/2135626387 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9ec06ae30 0x7fe9ec0c0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:52.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9f1e2b640 1 --2- 172.21.15.45:0/2135626387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9ec14c0a0 0x7fe9ec0c0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:52.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.205+0000 7fe9f162a640 1 --2- 172.21.15.45:0/2135626387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9ec0658f0 0x7fe9ec0baf80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8007ef0 tx=0x7fe9e800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:52.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.209+0000 7fe9e1ffb640 1 -- 172.21.15.45:0/2135626387 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8014620 con 0x7fe9ec0658f0 2023-10-03T19:12:52.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.209+0000 7fe9e1ffb640 1 -- 172.21.15.45:0/2135626387 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e800ee90 con 0x7fe9ec0658f0 2023-10-03T19:12:52.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.209+0000 7fe9f388e640 1 -- 172.21.15.45:0/2135626387 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9ec071c40 con 0x7fe9ec0658f0 2023-10-03T19:12:52.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.209+0000 7fe9e1ffb640 1 -- 172.21.15.45:0/2135626387 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e80149c0 con 0x7fe9ec0658f0 2023-10-03T19:12:52.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.209+0000 7fe9f388e640 1 -- 172.21.15.45:0/2135626387 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ec06e4a0 con 0x7fe9ec0658f0 2023-10-03T19:12:52.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.209+0000 7fe9f388e640 1 -- 172.21.15.45:0/2135626387 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9ec071dd0 con 0x7fe9ec0658f0 2023-10-03T19:12:52.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.209+0000 7fe9e1ffb640 1 -- 172.21.15.45:0/2135626387 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe9e8014b20 con 0x7fe9ec0658f0 2023-10-03T19:12:52.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.209+0000 7fe9e1ffb640 1 --2- 172.21.15.45:0/2135626387 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe9d00662b0 0x7fe9d0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:52.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.209+0000 7fe9e1ffb640 1 -- 172.21.15.45:0/2135626387 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe9e8084750 con 0x7fe9ec0658f0 2023-10-03T19:12:52.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.209+0000 7fe9f0e29640 1 --2- 172.21.15.45:0/2135626387 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe9d00662b0 0x7fe9d0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:52.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.209+0000 7fe9f0e29640 1 --2- 172.21.15.45:0/2135626387 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe9d00662b0 0x7fe9d0068760 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc0af000 tx=0x7fe9dc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:52.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.213+0000 7fe9e1ffb640 1 -- 172.21.15.45:0/2135626387 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe9e80555d0 con 0x7fe9ec0658f0 2023-10-03T19:12:52.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.365+0000 7fe9f388e640 1 -- 172.21.15.45:0/2135626387 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe9ec04de80 con 0x7fe9ec0658f0 2023-10-03T19:12:52.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.369+0000 7fe9e1ffb640 1 -- 172.21.15.45:0/2135626387 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe9e8055160 con 0x7fe9ec0658f0 2023-10-03T19:12:52.372 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-03T19:12:52.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.369+0000 7fe9f388e640 1 -- 172.21.15.45:0/2135626387 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe9d00662b0 msgr2=0x7fe9d0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:52.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.369+0000 7fe9f388e640 1 --2- 172.21.15.45:0/2135626387 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe9d00662b0 0x7fe9d0068760 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc0af000 tx=0x7fe9dc008040 comp rx=0 tx=0).stop 2023-10-03T19:12:52.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.369+0000 7fe9f388e640 1 -- 172.21.15.45:0/2135626387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9ec0658f0 msgr2=0x7fe9ec0baf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:52.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.369+0000 7fe9f388e640 1 --2- 172.21.15.45:0/2135626387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9ec0658f0 0x7fe9ec0baf80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8007ef0 tx=0x7fe9e800e4b0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.369+0000 7fe9f388e640 1 -- 172.21.15.45:0/2135626387 shutdown_connections 2023-10-03T19:12:52.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.369+0000 7fe9f388e640 1 --2- 172.21.15.45:0/2135626387 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe9d00662b0 0x7fe9d0068760 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.369+0000 7fe9f388e640 1 --2- 172.21.15.45:0/2135626387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9ec14c0a0 0x7fe9ec0c0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.369+0000 7fe9f388e640 1 --2- 172.21.15.45:0/2135626387 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9ec06ae30 0x7fe9ec0c0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.369+0000 7fe9f388e640 1 --2- 172.21.15.45:0/2135626387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9ec0658f0 0x7fe9ec0baf80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.369+0000 7fe9f388e640 1 -- 172.21.15.45:0/2135626387 >> 172.21.15.45:0/2135626387 conn(0x7fe9ec0be190 msgr2=0x7fe9ec06d420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:52.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.369+0000 7fe9f388e640 1 -- 172.21.15.45:0/2135626387 shutdown_connections 2023-10-03T19:12:52.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.369+0000 7fe9f388e640 1 -- 172.21.15.45:0/2135626387 wait complete. 2023-10-03T19:12:52.391 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T19:12:52.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.509+0000 7fac416a6640 1 Processor -- start 2023-10-03T19:12:52.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.509+0000 7fac416a6640 1 -- start start 2023-10-03T19:12:52.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.509+0000 7fac416a6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fac3c0bbd00 0x7fac3c0c1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:52.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.509+0000 7fac416a6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fac3c0c18a0 0x7fac3c14e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:52.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.509+0000 7fac416a6640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac3c0718f0 con 0x7fac3c148030 2023-10-03T19:12:52.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.509+0000 7fac416a6640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac3c070d50 con 0x7fac3c0c18a0 2023-10-03T19:12:52.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.509+0000 7fac416a6640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac3c148400 con 0x7fac3c0bbd00 2023-10-03T19:12:52.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.509+0000 7fac3b7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fac3c0c18a0 0x7fac3c14e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:52.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.509+0000 7fac3affd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fac3c148030 0x7fac3c070120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:41962/0 (socket says 172.21.15.45:41962) 2023-10-03T19:12:52.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.509+0000 7fac3affd640 1 -- 172.21.15.45:0/638561967 learned_addr learned my addr 172.21.15.45:0/638561967 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:52.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.509+0000 7fac3a7fc640 1 --2- 172.21.15.45:0/638561967 >> v2:172.21.15.79:3300/0 conn(0x7fac3c0bbd00 0x7fac3c0c1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:52.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.509+0000 7fac3b7fe640 1 -- 172.21.15.45:0/638561967 >> v2:172.21.15.79:3300/0 conn(0x7fac3c0bbd00 msgr2=0x7fac3c0c1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:52.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.509+0000 7fac3b7fe640 1 --2- 172.21.15.45:0/638561967 >> v2:172.21.15.79:3300/0 conn(0x7fac3c0bbd00 0x7fac3c0c1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.509+0000 7fac3b7fe640 1 -- 172.21.15.45:0/638561967 >> v1:172.21.15.79:6789/0 conn(0x7fac3c148030 legacy=0x7fac3c070120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:52.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.509+0000 7fac3b7fe640 1 -- 172.21.15.45:0/638561967 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac3c0bcd60 con 0x7fac3c0c18a0 2023-10-03T19:12:52.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.509+0000 7fac3a7fc640 1 --2- 172.21.15.45:0/638561967 >> v2:172.21.15.79:3300/0 conn(0x7fac3c0bbd00 0x7fac3c0c1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:12:52.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.513+0000 7fac3b7fe640 1 --2- 172.21.15.45:0/638561967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac3c0c18a0 0x7fac3c14e4c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fac3c06dbc0 tx=0x7fac2c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9380d45d92b923 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:52.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.513+0000 7fac39ffb640 1 -- 172.21.15.45:0/638561967 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c0ab600 con 0x7fac3c0c18a0 2023-10-03T19:12:52.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.513+0000 7fac39ffb640 1 -- 172.21.15.45:0/638561967 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2c0a7050 con 0x7fac3c0c18a0 2023-10-03T19:12:52.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.513+0000 7fac39ffb640 1 -- 172.21.15.45:0/638561967 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c0ab980 con 0x7fac3c0c18a0 2023-10-03T19:12:52.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.513+0000 7fac416a6640 1 -- 172.21.15.45:0/638561967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac3c0c18a0 msgr2=0x7fac3c14e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:52.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.513+0000 7fac416a6640 1 --2- 172.21.15.45:0/638561967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac3c0c18a0 0x7fac3c14e4c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fac3c06dbc0 tx=0x7fac2c01c3a0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.513+0000 7fac416a6640 1 -- 172.21.15.45:0/638561967 shutdown_connections 2023-10-03T19:12:52.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.513+0000 7fac416a6640 1 --2- 172.21.15.45:0/638561967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac3c0c18a0 0x7fac3c14e4c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.513+0000 7fac416a6640 1 --2- 172.21.15.45:0/638561967 >> v2:172.21.15.79:3300/0 conn(0x7fac3c0bbd00 0x7fac3c0c1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.513+0000 7fac416a6640 1 -- 172.21.15.45:0/638561967 >> 172.21.15.45:0/638561967 conn(0x7fac3c06a760 msgr2=0x7fac3c0c0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:52.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.513+0000 7fac416a6640 1 -- 172.21.15.45:0/638561967 shutdown_connections 2023-10-03T19:12:52.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.513+0000 7fac416a6640 1 -- 172.21.15.45:0/638561967 wait complete. 2023-10-03T19:12:52.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.513+0000 7fac416a6640 1 Processor -- start 2023-10-03T19:12:52.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.513+0000 7fac416a6640 1 -- start start 2023-10-03T19:12:52.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.513+0000 7fac416a6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac3c0bbd00 0x7fac3c1466b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:52.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.513+0000 7fac416a6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fac3c0c18a0 0x7fac3c153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:52.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.517+0000 7fac416a6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac3c148030 0x7fac3c1536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:52.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.517+0000 7fac416a6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c153be0 con 0x7fac3c0bbd00 2023-10-03T19:12:52.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.517+0000 7fac416a6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c0c01e0 con 0x7fac3c148030 2023-10-03T19:12:52.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.517+0000 7fac416a6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c1e5fe0 con 0x7fac3c0c18a0 2023-10-03T19:12:52.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.517+0000 7fac3affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac3c0bbd00 0x7fac3c1466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:52.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.517+0000 7fac3affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac3c0bbd00 0x7fac3c1466b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36006/0 (socket says 172.21.15.45:36006) 2023-10-03T19:12:52.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.517+0000 7fac3affd640 1 -- 172.21.15.45:0/4281352222 learned_addr learned my addr 172.21.15.45:0/4281352222 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:52.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.517+0000 7fac3b7fe640 1 --2- 172.21.15.45:0/4281352222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac3c148030 0x7fac3c1536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:52.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.517+0000 7fac3a7fc640 1 --2- 172.21.15.45:0/4281352222 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fac3c0c18a0 0x7fac3c153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:52.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.517+0000 7fac3affd640 1 -- 172.21.15.45:0/4281352222 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fac3c0c18a0 msgr2=0x7fac3c153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:52.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.517+0000 7fac3affd640 1 --2- 172.21.15.45:0/4281352222 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fac3c0c18a0 0x7fac3c153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.517+0000 7fac3affd640 1 -- 172.21.15.45:0/4281352222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac3c148030 msgr2=0x7fac3c1536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:52.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.517+0000 7fac3affd640 1 --2- 172.21.15.45:0/4281352222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac3c148030 0x7fac3c1536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.517+0000 7fac3affd640 1 -- 172.21.15.45:0/4281352222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2c009420 con 0x7fac3c0bbd00 2023-10-03T19:12:52.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.517+0000 7fac3b7fe640 1 --2- 172.21.15.45:0/4281352222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac3c148030 0x7fac3c1536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:12:52.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.517+0000 7fac3affd640 1 --2- 172.21.15.45:0/4281352222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac3c0bbd00 0x7fac3c1466b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fac3400cbc0 tx=0x7fac3400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:52.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.517+0000 7fac337fe640 1 -- 172.21.15.45:0/4281352222 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3400aca0 con 0x7fac3c0bbd00 2023-10-03T19:12:52.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.517+0000 7fac337fe640 1 -- 172.21.15.45:0/4281352222 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3400ae00 con 0x7fac3c0bbd00 2023-10-03T19:12:52.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.517+0000 7fac416a6640 1 -- 172.21.15.45:0/4281352222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac3c14a910 con 0x7fac3c0bbd00 2023-10-03T19:12:52.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.517+0000 7fac337fe640 1 -- 172.21.15.45:0/4281352222 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac34012600 con 0x7fac3c0bbd00 2023-10-03T19:12:52.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.517+0000 7fac416a6640 1 -- 172.21.15.45:0/4281352222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac3c0bd320 con 0x7fac3c0bbd00 2023-10-03T19:12:52.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.517+0000 7fac416a6640 1 -- 172.21.15.45:0/4281352222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac3c14aaa0 con 0x7fac3c0bbd00 2023-10-03T19:12:52.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.517+0000 7fac337fe640 1 -- 172.21.15.45:0/4281352222 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fac34007070 con 0x7fac3c0bbd00 2023-10-03T19:12:52.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.517+0000 7fac337fe640 1 --2- 172.21.15.45:0/4281352222 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fac1c0662b0 0x7fac1c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:52.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.517+0000 7fac337fe640 1 -- 172.21.15.45:0/4281352222 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fac340839a0 con 0x7fac3c0bbd00 2023-10-03T19:12:52.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.517+0000 7fac3a7fc640 1 --2- 172.21.15.45:0/4281352222 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fac1c0662b0 0x7fac1c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:52.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.521+0000 7fac3a7fc640 1 --2- 172.21.15.45:0/4281352222 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fac1c0662b0 0x7fac1c068760 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fac3c0c0b40 tx=0x7fac24008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:52.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.521+0000 7fac337fe640 1 -- 172.21.15.45:0/4281352222 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fac34050ed0 con 0x7fac3c0bbd00 2023-10-03T19:12:52.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.677+0000 7fac416a6640 1 -- 172.21.15.45:0/4281352222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fac3c0bc300 con 0x7fac3c0bbd00 2023-10-03T19:12:52.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.677+0000 7fac337fe640 1 -- 172.21.15.45:0/4281352222 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fac340170a0 con 0x7fac3c0bbd00 2023-10-03T19:12:52.681 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-03T19:12:52.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.677+0000 7fac416a6640 1 -- 172.21.15.45:0/4281352222 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fac1c0662b0 msgr2=0x7fac1c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:52.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.677+0000 7fac416a6640 1 --2- 172.21.15.45:0/4281352222 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fac1c0662b0 0x7fac1c068760 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fac3c0c0b40 tx=0x7fac24008040 comp rx=0 tx=0).stop 2023-10-03T19:12:52.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.677+0000 7fac416a6640 1 -- 172.21.15.45:0/4281352222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac3c0bbd00 msgr2=0x7fac3c1466b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:52.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.677+0000 7fac416a6640 1 --2- 172.21.15.45:0/4281352222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac3c0bbd00 0x7fac3c1466b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fac3400cbc0 tx=0x7fac3400a060 comp rx=0 tx=0).stop 2023-10-03T19:12:52.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.677+0000 7fac416a6640 1 -- 172.21.15.45:0/4281352222 shutdown_connections 2023-10-03T19:12:52.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.677+0000 7fac416a6640 1 --2- 172.21.15.45:0/4281352222 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fac1c0662b0 0x7fac1c068760 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.677+0000 7fac416a6640 1 --2- 172.21.15.45:0/4281352222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac3c148030 0x7fac3c1536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.677+0000 7fac416a6640 1 --2- 172.21.15.45:0/4281352222 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fac3c0c18a0 0x7fac3c153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.677+0000 7fac416a6640 1 --2- 172.21.15.45:0/4281352222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac3c0bbd00 0x7fac3c1466b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.677+0000 7fac416a6640 1 -- 172.21.15.45:0/4281352222 >> 172.21.15.45:0/4281352222 conn(0x7fac3c06a760 msgr2=0x7fac3c06d070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:52.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.677+0000 7fac416a6640 1 -- 172.21.15.45:0/4281352222 shutdown_connections 2023-10-03T19:12:52.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.677+0000 7fac416a6640 1 -- 172.21.15.45:0/4281352222 wait complete. 2023-10-03T19:12:52.700 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:12:52.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.809+0000 7f5e2e509640 1 Processor -- start 2023-10-03T19:12:52.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.809+0000 7f5e2e509640 1 -- start start 2023-10-03T19:12:52.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.809+0000 7f5e2e509640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e280b98f0 0x7f5e280b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:52.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.809+0000 7f5e2e509640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5e280a2e20 0x7f5e2806c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:52.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.809+0000 7f5e2e509640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e280ba550 con 0x7f5e280bc810 2023-10-03T19:12:52.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.809+0000 7f5e2e509640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e281526d0 con 0x7f5e280a2e20 2023-10-03T19:12:52.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.809+0000 7f5e2e509640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e281529b0 con 0x7f5e280b98f0 2023-10-03T19:12:52.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.809+0000 7f5e27fff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e280b98f0 0x7f5e280b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:52.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.809+0000 7f5e2caa6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5e280a2e20 0x7f5e2806c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:52.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.809+0000 7f5e27fff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e280b98f0 0x7f5e280b9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:41444/0 (socket says 172.21.15.45:41444) 2023-10-03T19:12:52.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.809+0000 7f5e27fff640 1 -- 172.21.15.45:0/3109825574 learned_addr learned my addr 172.21.15.45:0/3109825574 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:52.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.809+0000 7f5e27fff640 1 -- 172.21.15.45:0/3109825574 >> v2:172.21.15.79:3300/0 conn(0x7f5e280a2e20 msgr2=0x7f5e2806c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:52.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.809+0000 7f5e27fff640 1 --2- 172.21.15.45:0/3109825574 >> v2:172.21.15.79:3300/0 conn(0x7f5e280a2e20 0x7f5e2806c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.809+0000 7f5e27fff640 1 -- 172.21.15.45:0/3109825574 >> v1:172.21.15.79:6789/0 conn(0x7f5e280bc810 legacy=0x7f5e2806c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:52.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.809+0000 7f5e27fff640 1 -- 172.21.15.45:0/3109825574 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e2806cee0 con 0x7f5e280b98f0 2023-10-03T19:12:52.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.813+0000 7f5e27fff640 1 --2- 172.21.15.45:0/3109825574 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e280b98f0 0x7f5e280b9cc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5e10009870 tx=0x7f5e1001ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b63af738d9981b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:52.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.813+0000 7f5e26ffd640 1 -- 172.21.15.45:0/3109825574 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e100a8a30 con 0x7f5e280b98f0 2023-10-03T19:12:52.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.813+0000 7f5e26ffd640 1 -- 172.21.15.45:0/3109825574 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e100a8b90 con 0x7f5e280b98f0 2023-10-03T19:12:52.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.813+0000 7f5e26ffd640 1 -- 172.21.15.45:0/3109825574 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e100b0440 con 0x7f5e280b98f0 2023-10-03T19:12:52.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.813+0000 7f5e2e509640 1 -- 172.21.15.45:0/3109825574 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e280b98f0 msgr2=0x7f5e280b9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:52.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.813+0000 7f5e2e509640 1 --2- 172.21.15.45:0/3109825574 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e280b98f0 0x7f5e280b9cc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5e10009870 tx=0x7f5e1001ed30 comp rx=0 tx=0).stop 2023-10-03T19:12:52.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.813+0000 7f5e2e509640 1 -- 172.21.15.45:0/3109825574 shutdown_connections 2023-10-03T19:12:52.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.813+0000 7f5e2e509640 1 --2- 172.21.15.45:0/3109825574 >> v2:172.21.15.79:3300/0 conn(0x7f5e280a2e20 0x7f5e2806c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.813+0000 7f5e2e509640 1 --2- 172.21.15.45:0/3109825574 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e280b98f0 0x7f5e280b9cc0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.813+0000 7f5e2e509640 1 -- 172.21.15.45:0/3109825574 >> 172.21.15.45:0/3109825574 conn(0x7f5e280bcf50 msgr2=0x7f5e280bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:52.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.813+0000 7f5e2e509640 1 -- 172.21.15.45:0/3109825574 shutdown_connections 2023-10-03T19:12:52.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.813+0000 7f5e2e509640 1 -- 172.21.15.45:0/3109825574 wait complete. 2023-10-03T19:12:52.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.813+0000 7f5e2e509640 1 Processor -- start 2023-10-03T19:12:52.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.813+0000 7f5e2e509640 1 -- start start 2023-10-03T19:12:52.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.813+0000 7f5e2e509640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e280a2e20 0x7f5e2814b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:52.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.813+0000 7f5e2e509640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e280b98f0 0x7f5e2813a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:52.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.813+0000 7f5e2e509640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e280bc810 0x7f5e28150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:52.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.813+0000 7f5e2e509640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e28071470 con 0x7f5e280a2e20 2023-10-03T19:12:52.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.813+0000 7f5e2e509640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2814b640 con 0x7f5e280bc810 2023-10-03T19:12:52.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.813+0000 7f5e2e509640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e280719a0 con 0x7f5e280b98f0 2023-10-03T19:12:52.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.813+0000 7f5e27fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e280a2e20 0x7f5e2814b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:52.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.813+0000 7f5e27fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e280a2e20 0x7f5e2814b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36012/0 (socket says 172.21.15.45:36012) 2023-10-03T19:12:52.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.813+0000 7f5e27fff640 1 -- 172.21.15.45:0/2746614872 learned_addr learned my addr 172.21.15.45:0/2746614872 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:52.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.813+0000 7f5e2caa6640 1 --2- 172.21.15.45:0/2746614872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e280bc810 0x7f5e28150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:52.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.817+0000 7f5e277fe640 1 --2- 172.21.15.45:0/2746614872 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e280b98f0 0x7f5e2813a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:52.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.817+0000 7f5e27fff640 1 -- 172.21.15.45:0/2746614872 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e280b98f0 msgr2=0x7f5e2813a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:52.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.817+0000 7f5e27fff640 1 --2- 172.21.15.45:0/2746614872 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e280b98f0 0x7f5e2813a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.817+0000 7f5e27fff640 1 -- 172.21.15.45:0/2746614872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e280bc810 msgr2=0x7f5e28150760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:52.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.817+0000 7f5e27fff640 1 --2- 172.21.15.45:0/2746614872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e280bc810 0x7f5e28150760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.817+0000 7f5e27fff640 1 -- 172.21.15.45:0/2746614872 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e100094d0 con 0x7f5e280a2e20 2023-10-03T19:12:52.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.817+0000 7f5e277fe640 1 --2- 172.21.15.45:0/2746614872 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e280b98f0 0x7f5e2813a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:12:52.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.817+0000 7f5e27fff640 1 --2- 172.21.15.45:0/2746614872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e280a2e20 0x7f5e2814b100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5e1001c960 tx=0x7f5e1001bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:52.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.817+0000 7f5e24ff9640 1 -- 172.21.15.45:0/2746614872 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e100b0de0 con 0x7f5e280a2e20 2023-10-03T19:12:52.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.817+0000 7f5e24ff9640 1 -- 172.21.15.45:0/2746614872 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e100bb420 con 0x7f5e280a2e20 2023-10-03T19:12:52.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.817+0000 7f5e2e509640 1 -- 172.21.15.45:0/2746614872 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e280ba950 con 0x7f5e280a2e20 2023-10-03T19:12:52.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.817+0000 7f5e24ff9640 1 -- 172.21.15.45:0/2746614872 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e100bb7d0 con 0x7f5e280a2e20 2023-10-03T19:12:52.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.817+0000 7f5e2e509640 1 -- 172.21.15.45:0/2746614872 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e280ba200 con 0x7f5e280a2e20 2023-10-03T19:12:52.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.817+0000 7f5e2e509640 1 -- 172.21.15.45:0/2746614872 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e280baae0 con 0x7f5e280a2e20 2023-10-03T19:12:52.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.817+0000 7f5e24ff9640 1 -- 172.21.15.45:0/2746614872 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5e100b7040 con 0x7f5e280a2e20 2023-10-03T19:12:52.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.817+0000 7f5e24ff9640 1 --2- 172.21.15.45:0/2746614872 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5e08066280 0x7f5e08068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:52.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.817+0000 7f5e24ff9640 1 -- 172.21.15.45:0/2746614872 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5e10121980 con 0x7f5e280a2e20 2023-10-03T19:12:52.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.817+0000 7f5e277fe640 1 --2- 172.21.15.45:0/2746614872 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5e08066280 0x7f5e08068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:52.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.817+0000 7f5e277fe640 1 --2- 172.21.15.45:0/2746614872 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5e08066280 0x7f5e08068730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5e2813af90 tx=0x7f5e18009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:52.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.821+0000 7f5e24ff9640 1 -- 172.21.15.45:0/2746614872 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5e100ef060 con 0x7f5e280a2e20 2023-10-03T19:12:52.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.973+0000 7f5e2e509640 1 -- 172.21.15.45:0/2746614872 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e2804de80 con 0x7f5e280a2e20 2023-10-03T19:12:52.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.977+0000 7f5e24ff9640 1 -- 172.21.15.45:0/2746614872 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18231 (secure 0 0 0) 0x7f5e10121070 con 0x7f5e280a2e20 2023-10-03T19:12:52.982 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:52.982 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:12:28.941467+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:12:26.226431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T19:12:26.923174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:12:52.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.977+0000 7f5e2e509640 1 -- 172.21.15.45:0/2746614872 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5e08066280 msgr2=0x7f5e08068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:52.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.977+0000 7f5e2e509640 1 --2- 172.21.15.45:0/2746614872 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5e08066280 0x7f5e08068730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5e2813af90 tx=0x7f5e18009040 comp rx=0 tx=0).stop 2023-10-03T19:12:52.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.977+0000 7f5e2e509640 1 -- 172.21.15.45:0/2746614872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e280a2e20 msgr2=0x7f5e2814b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:52.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.977+0000 7f5e2e509640 1 --2- 172.21.15.45:0/2746614872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e280a2e20 0x7f5e2814b100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5e1001c960 tx=0x7f5e1001bad0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.977+0000 7f5e2e509640 1 -- 172.21.15.45:0/2746614872 shutdown_connections 2023-10-03T19:12:52.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.977+0000 7f5e2e509640 1 --2- 172.21.15.45:0/2746614872 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5e08066280 0x7f5e08068730 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.977+0000 7f5e2e509640 1 --2- 172.21.15.45:0/2746614872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e280bc810 0x7f5e28150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.977+0000 7f5e2e509640 1 --2- 172.21.15.45:0/2746614872 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e280b98f0 0x7f5e2813a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.977+0000 7f5e2e509640 1 --2- 172.21.15.45:0/2746614872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e280a2e20 0x7f5e2814b100 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:52.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.981+0000 7f5e2e509640 1 -- 172.21.15.45:0/2746614872 >> 172.21.15.45:0/2746614872 conn(0x7f5e280bcf50 msgr2=0x7f5e2806c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:52.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.981+0000 7f5e2e509640 1 -- 172.21.15.45:0/2746614872 shutdown_connections 2023-10-03T19:12:52.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:52.981+0000 7f5e2e509640 1 -- 172.21.15.45:0/2746614872 wait complete. 2023-10-03T19:12:52.999 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T19:12:26.226431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T19:12:26.923174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:12:53.000 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:12:53.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.109+0000 7f01574e9640 1 Processor -- start 2023-10-03T19:12:53.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.109+0000 7f01574e9640 1 -- start start 2023-10-03T19:12:53.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f01574e9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f01500c14e0 0x7f01500c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:53.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f01574e9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f01500bf1f0 0x7f01500a9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:53.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f01574e9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01500c2770 0x7f01500a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:53.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f01574e9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f015006ac70 con 0x7f01500c14e0 2023-10-03T19:12:53.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f01574e9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01500c3000 con 0x7f01500bf1f0 2023-10-03T19:12:53.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f01574e9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01500aa5f0 con 0x7f01500c2770 2023-10-03T19:12:53.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f0155285640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f01500c14e0 0x7f01500c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:53.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f0155285640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f01500c14e0 0x7f01500c0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36014/0 (socket says 172.21.15.45:36014) 2023-10-03T19:12:53.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f0155285640 1 -- 172.21.15.45:0/4197727816 learned_addr learned my addr 172.21.15.45:0/4197727816 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f0154a84640 1 --2- 172.21.15.45:0/4197727816 >> v2:172.21.15.79:3300/0 conn(0x7f01500bf1f0 0x7f01500a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f0155285640 1 -- 172.21.15.45:0/4197727816 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01500c2770 msgr2=0x7f01500a9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f0155a86640 1 --2- 172.21.15.45:0/4197727816 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01500c2770 0x7f01500a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f0155285640 1 --2- 172.21.15.45:0/4197727816 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01500c2770 0x7f01500a9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f0155285640 1 -- 172.21.15.45:0/4197727816 >> v2:172.21.15.79:3300/0 conn(0x7f01500bf1f0 msgr2=0x7f01500a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f0155285640 1 --2- 172.21.15.45:0/4197727816 >> v2:172.21.15.79:3300/0 conn(0x7f01500bf1f0 0x7f01500a9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f0155285640 1 -- 172.21.15.45:0/4197727816 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f015014f250 con 0x7f01500c14e0 2023-10-03T19:12:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f0154a84640 1 --2- 172.21.15.45:0/4197727816 >> v2:172.21.15.79:3300/0 conn(0x7f01500bf1f0 0x7f01500a9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f0155a86640 1 --2- 172.21.15.45:0/4197727816 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01500c2770 0x7f01500a9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:53.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f0155285640 1 --2- 172.21.15.45:0/4197727816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01500c14e0 0x7f01500c0a40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f01500c0110 tx=0x7f014c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763f917c35d48507 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:53.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f0147fff640 1 -- 172.21.15.45:0/4197727816 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c0a89b0 con 0x7f01500c14e0 2023-10-03T19:12:53.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f0147fff640 1 -- 172.21.15.45:0/4197727816 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014c0a8b10 con 0x7f01500c14e0 2023-10-03T19:12:53.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f0147fff640 1 -- 172.21.15.45:0/4197727816 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c0a8ea0 con 0x7f01500c14e0 2023-10-03T19:12:53.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f01574e9640 1 -- 172.21.15.45:0/4197727816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01500c14e0 msgr2=0x7f01500c0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:53.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f01574e9640 1 --2- 172.21.15.45:0/4197727816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01500c14e0 0x7f01500c0a40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f01500c0110 tx=0x7f014c01ecf0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f01574e9640 1 -- 172.21.15.45:0/4197727816 shutdown_connections 2023-10-03T19:12:53.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f01574e9640 1 --2- 172.21.15.45:0/4197727816 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01500c2770 0x7f01500a9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f01574e9640 1 --2- 172.21.15.45:0/4197727816 >> v2:172.21.15.79:3300/0 conn(0x7f01500bf1f0 0x7f01500a9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f01574e9640 1 --2- 172.21.15.45:0/4197727816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01500c14e0 0x7f01500c0a40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f01574e9640 1 -- 172.21.15.45:0/4197727816 >> 172.21.15.45:0/4197727816 conn(0x7f01500a6440 msgr2=0x7f01500a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:53.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f01574e9640 1 -- 172.21.15.45:0/4197727816 shutdown_connections 2023-10-03T19:12:53.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.113+0000 7f01574e9640 1 -- 172.21.15.45:0/4197727816 wait complete. 2023-10-03T19:12:53.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.117+0000 7f01574e9640 1 Processor -- start 2023-10-03T19:12:53.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.117+0000 7f01574e9640 1 -- start start 2023-10-03T19:12:53.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.117+0000 7f01574e9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01500bf1f0 0x7f01501e40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:53.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.117+0000 7f01574e9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01500c14e0 0x7f01501e3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:53.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.117+0000 7f01574e9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01500c2770 0x7f01500bbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:53.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.117+0000 7f01574e9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01500be640 con 0x7f01500c14e0 2023-10-03T19:12:53.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.117+0000 7f01574e9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01500bc7d0 con 0x7f01500c2770 2023-10-03T19:12:53.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.117+0000 7f01574e9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01500bcb30 con 0x7f01500bf1f0 2023-10-03T19:12:53.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.117+0000 7f0154a84640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01500c14e0 0x7f01501e3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:53.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.117+0000 7f0154a84640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01500c14e0 0x7f01501e3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36026/0 (socket says 172.21.15.45:36026) 2023-10-03T19:12:53.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.117+0000 7f0154a84640 1 -- 172.21.15.45:0/3878458553 learned_addr learned my addr 172.21.15.45:0/3878458553 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:53.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.117+0000 7f0155a86640 1 --2- 172.21.15.45:0/3878458553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01500c2770 0x7f01500bbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:53.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.117+0000 7f0155285640 1 --2- 172.21.15.45:0/3878458553 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01500bf1f0 0x7f01501e40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:53.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.117+0000 7f0154a84640 1 -- 172.21.15.45:0/3878458553 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01500bf1f0 msgr2=0x7f01501e40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:53.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.117+0000 7f0154a84640 1 --2- 172.21.15.45:0/3878458553 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01500bf1f0 0x7f01501e40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.117+0000 7f0154a84640 1 -- 172.21.15.45:0/3878458553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01500c2770 msgr2=0x7f01500bbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:53.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.117+0000 7f0154a84640 1 --2- 172.21.15.45:0/3878458553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01500c2770 0x7f01500bbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.117+0000 7f0154a84640 1 -- 172.21.15.45:0/3878458553 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c0094d0 con 0x7f01500c14e0 2023-10-03T19:12:53.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.117+0000 7f0154a84640 1 --2- 172.21.15.45:0/3878458553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01500c14e0 0x7f01501e3810 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f014000c7c0 tx=0x7f014000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:53.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.117+0000 7f0145ffb640 1 -- 172.21.15.45:0/3878458553 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0140007820 con 0x7f01500c14e0 2023-10-03T19:12:53.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.117+0000 7f0145ffb640 1 -- 172.21.15.45:0/3878458553 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0140007980 con 0x7f01500c14e0 2023-10-03T19:12:53.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.117+0000 7f01574e9640 1 -- 172.21.15.45:0/3878458553 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f015006b100 con 0x7f01500c14e0 2023-10-03T19:12:53.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.117+0000 7f0145ffb640 1 -- 172.21.15.45:0/3878458553 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0140007d10 con 0x7f01500c14e0 2023-10-03T19:12:53.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.117+0000 7f01574e9640 1 -- 172.21.15.45:0/3878458553 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f015014f530 con 0x7f01500c14e0 2023-10-03T19:12:53.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.117+0000 7f01574e9640 1 -- 172.21.15.45:0/3878458553 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01500aa2e0 con 0x7f01500c14e0 2023-10-03T19:12:53.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.117+0000 7f0145ffb640 1 -- 172.21.15.45:0/3878458553 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f01400113f0 con 0x7f01500c14e0 2023-10-03T19:12:53.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.121+0000 7f0145ffb640 1 --2- 172.21.15.45:0/3878458553 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0134066280 0x7f0134068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:53.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.121+0000 7f0145ffb640 1 -- 172.21.15.45:0/3878458553 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0140083e00 con 0x7f01500c14e0 2023-10-03T19:12:53.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.121+0000 7f0155285640 1 --2- 172.21.15.45:0/3878458553 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0134066280 0x7f0134068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:53.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.121+0000 7f0155285640 1 --2- 172.21.15.45:0/3878458553 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0134066280 0x7f0134068730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f014c0b2000 tx=0x7f014c0aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:53.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.125+0000 7f0145ffb640 1 -- 172.21.15.45:0/3878458553 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0140051310 con 0x7f01500c14e0 2023-10-03T19:12:53.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.273+0000 7f01574e9640 1 -- 172.21.15.45:0/3878458553 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f015009a6f0 con 0x7f01500c14e0 2023-10-03T19:12:53.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.273+0000 7f0145ffb640 1 -- 172.21.15.45:0/3878458553 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f014001f0a0 con 0x7f01500c14e0 2023-10-03T19:12:53.279 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:12:53.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.277+0000 7f01574e9640 1 -- 172.21.15.45:0/3878458553 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0134066280 msgr2=0x7f0134068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:53.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.277+0000 7f01574e9640 1 --2- 172.21.15.45:0/3878458553 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0134066280 0x7f0134068730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f014c0b2000 tx=0x7f014c0aa070 comp rx=0 tx=0).stop 2023-10-03T19:12:53.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.277+0000 7f01574e9640 1 -- 172.21.15.45:0/3878458553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01500c14e0 msgr2=0x7f01501e3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:53.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.277+0000 7f01574e9640 1 --2- 172.21.15.45:0/3878458553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01500c14e0 0x7f01501e3810 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f014000c7c0 tx=0x7f014000cc80 comp rx=0 tx=0).stop 2023-10-03T19:12:53.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.277+0000 7f01574e9640 1 -- 172.21.15.45:0/3878458553 shutdown_connections 2023-10-03T19:12:53.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.277+0000 7f01574e9640 1 --2- 172.21.15.45:0/3878458553 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0134066280 0x7f0134068730 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.277+0000 7f01574e9640 1 --2- 172.21.15.45:0/3878458553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01500c2770 0x7f01500bbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.277+0000 7f01574e9640 1 --2- 172.21.15.45:0/3878458553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01500c14e0 0x7f01501e3810 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.277+0000 7f01574e9640 1 --2- 172.21.15.45:0/3878458553 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01500bf1f0 0x7f01501e40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.277+0000 7f01574e9640 1 -- 172.21.15.45:0/3878458553 >> 172.21.15.45:0/3878458553 conn(0x7f01500a6440 msgr2=0x7f01500a6810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:53.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.277+0000 7f01574e9640 1 -- 172.21.15.45:0/3878458553 shutdown_connections 2023-10-03T19:12:53.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.277+0000 7f01574e9640 1 -- 172.21.15.45:0/3878458553 wait complete. 2023-10-03T19:12:53.297 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:12:53.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.405+0000 7f4b96f19640 1 Processor -- start 2023-10-03T19:12:53.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.405+0000 7f4b96f19640 1 -- start start 2023-10-03T19:12:53.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.409+0000 7f4b96f19640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4b90149e50 0x7f4b900c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:53.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.409+0000 7f4b96f19640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b900c07b0 0x7f4b900bfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:53.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.409+0000 7f4b96f19640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b900bf410 con 0x7f4b900bc750 2023-10-03T19:12:53.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.409+0000 7f4b96f19640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b9014a220 con 0x7f4b90149e50 2023-10-03T19:12:53.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.409+0000 7f4b96f19640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900bf940 con 0x7f4b900c07b0 2023-10-03T19:12:53.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.409+0000 7f4b94cb5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4b90149e50 0x7f4b900c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:53.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.409+0000 7f4b94cb5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4b90149e50 0x7f4b900c0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36032/0 (socket says 172.21.15.45:36032) 2023-10-03T19:12:53.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.409+0000 7f4b94cb5640 1 -- 172.21.15.45:0/3733975086 learned_addr learned my addr 172.21.15.45:0/3733975086 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:53.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.409+0000 7f4b954b6640 1 --2- 172.21.15.45:0/3733975086 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b900c07b0 0x7f4b900bfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:53.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.409+0000 7f4b94cb5640 1 -- 172.21.15.45:0/3733975086 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b900c07b0 msgr2=0x7f4b900bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:53.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.409+0000 7f4b94cb5640 1 --2- 172.21.15.45:0/3733975086 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b900c07b0 0x7f4b900bfe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.409+0000 7f4b94cb5640 1 -- 172.21.15.45:0/3733975086 >> v1:172.21.15.79:6789/0 conn(0x7f4b900bc750 legacy=0x7f4b900bbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:53.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.409+0000 7f4b94cb5640 1 -- 172.21.15.45:0/3733975086 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b90150720 con 0x7f4b90149e50 2023-10-03T19:12:53.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.409+0000 7f4b954b6640 1 --2- 172.21.15.45:0/3733975086 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b900c07b0 0x7f4b900bfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:53.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.409+0000 7f4b94cb5640 1 --2- 172.21.15.45:0/3733975086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b90149e50 0x7f4b900c0ef0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009870 tx=0x7f4b8001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b61c129901a47337 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:53.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.409+0000 7f4b8f7fe640 1 -- 172.21.15.45:0/3733975086 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b800ac620 con 0x7f4b90149e50 2023-10-03T19:12:53.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.409+0000 7f4b8f7fe640 1 -- 172.21.15.45:0/3733975086 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b90065ea0 con 0x7f4b90149e50 2023-10-03T19:12:53.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.409+0000 7f4b8f7fe640 1 -- 172.21.15.45:0/3733975086 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b800ac9a0 con 0x7f4b90149e50 2023-10-03T19:12:53.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b96f19640 1 -- 172.21.15.45:0/3733975086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b90149e50 msgr2=0x7f4b900c0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:53.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b96f19640 1 --2- 172.21.15.45:0/3733975086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b90149e50 0x7f4b900c0ef0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009870 tx=0x7f4b8001c4b0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b96f19640 1 -- 172.21.15.45:0/3733975086 shutdown_connections 2023-10-03T19:12:53.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b96f19640 1 --2- 172.21.15.45:0/3733975086 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b900c07b0 0x7f4b900bfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b96f19640 1 --2- 172.21.15.45:0/3733975086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b90149e50 0x7f4b900c0ef0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b96f19640 1 -- 172.21.15.45:0/3733975086 >> 172.21.15.45:0/3733975086 conn(0x7f4b900c1510 msgr2=0x7f4b900c1910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:53.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b96f19640 1 -- 172.21.15.45:0/3733975086 shutdown_connections 2023-10-03T19:12:53.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b96f19640 1 -- 172.21.15.45:0/3733975086 wait complete. 2023-10-03T19:12:53.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b96f19640 1 Processor -- start 2023-10-03T19:12:53.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b96f19640 1 -- start start 2023-10-03T19:12:53.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b96f19640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b900bc750 0x7f4b901e6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:53.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b96f19640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b900c07b0 0x7f4b900a2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:53.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b96f19640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b90149e50 0x7f4b900a5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:53.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b96f19640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9014a9f0 con 0x7f4b900bc750 2023-10-03T19:12:53.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b96f19640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900a6800 con 0x7f4b900c07b0 2023-10-03T19:12:53.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b96f19640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b90155e00 con 0x7f4b90149e50 2023-10-03T19:12:53.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b94cb5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b900bc750 0x7f4b901e6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:53.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b94cb5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b900bc750 0x7f4b901e6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36042/0 (socket says 172.21.15.45:36042) 2023-10-03T19:12:53.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b94cb5640 1 -- 172.21.15.45:0/792858873 learned_addr learned my addr 172.21.15.45:0/792858873 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:53.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b94cb5640 1 -- 172.21.15.45:0/792858873 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b90149e50 msgr2=0x7f4b900a5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:53.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b94cb5640 1 --2- 172.21.15.45:0/792858873 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b90149e50 0x7f4b900a5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b94cb5640 1 -- 172.21.15.45:0/792858873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b900c07b0 msgr2=0x7f4b900a2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:53.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b8ffff640 1 --2- 172.21.15.45:0/792858873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b900c07b0 0x7f4b900a2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:53.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b94cb5640 1 --2- 172.21.15.45:0/792858873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b900c07b0 0x7f4b900a2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b94cb5640 1 -- 172.21.15.45:0/792858873 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b800094d0 con 0x7f4b900bc750 2023-10-03T19:12:53.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b94cb5640 1 --2- 172.21.15.45:0/792858873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b900bc750 0x7f4b901e6e30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4b800af040 tx=0x7f4b80019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:53.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b8d7fa640 1 -- 172.21.15.45:0/792858873 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b800b5640 con 0x7f4b900bc750 2023-10-03T19:12:53.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b8d7fa640 1 -- 172.21.15.45:0/792858873 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b800ace90 con 0x7f4b900bc750 2023-10-03T19:12:53.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b96f19640 1 -- 172.21.15.45:0/792858873 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b901597e0 con 0x7f4b900bc750 2023-10-03T19:12:53.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b8d7fa640 1 -- 172.21.15.45:0/792858873 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b800b5a00 con 0x7f4b900bc750 2023-10-03T19:12:53.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b96f19640 1 -- 172.21.15.45:0/792858873 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b90159650 con 0x7f4b900bc750 2023-10-03T19:12:53.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.413+0000 7f4b96f19640 1 -- 172.21.15.45:0/792858873 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b90159970 con 0x7f4b900bc750 2023-10-03T19:12:53.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.417+0000 7f4b8d7fa640 1 -- 172.21.15.45:0/792858873 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4b800b3070 con 0x7f4b900bc750 2023-10-03T19:12:53.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.417+0000 7f4b8d7fa640 1 --2- 172.21.15.45:0/792858873 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4b7c066280 0x7f4b7c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:53.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.417+0000 7f4b8d7fa640 1 -- 172.21.15.45:0/792858873 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4b8011dfa0 con 0x7f4b900bc750 2023-10-03T19:12:53.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.417+0000 7f4b8ffff640 1 --2- 172.21.15.45:0/792858873 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4b7c066280 0x7f4b7c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:53.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.417+0000 7f4b8ffff640 1 --2- 172.21.15.45:0/792858873 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4b7c066280 0x7f4b7c068730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4b9014fe90 tx=0x7f4b84009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:53.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.421+0000 7f4b8d7fa640 1 -- 172.21.15.45:0/792858873 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4b800eb6b0 con 0x7f4b900bc750 2023-10-03T19:12:53.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.565+0000 7f4b96f19640 1 -- 172.21.15.45:0/792858873 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4b90146db0 con 0x7f4b900bc750 2023-10-03T19:12:53.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.569+0000 7f4b8d7fa640 1 -- 172.21.15.45:0/792858873 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4b800eecd0 con 0x7f4b900bc750 2023-10-03T19:12:53.572 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:12:53.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.569+0000 7f4b96f19640 1 -- 172.21.15.45:0/792858873 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4b7c066280 msgr2=0x7f4b7c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:53.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.569+0000 7f4b96f19640 1 --2- 172.21.15.45:0/792858873 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4b7c066280 0x7f4b7c068730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4b9014fe90 tx=0x7f4b84009040 comp rx=0 tx=0).stop 2023-10-03T19:12:53.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.569+0000 7f4b96f19640 1 -- 172.21.15.45:0/792858873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b900bc750 msgr2=0x7f4b901e6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:53.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.569+0000 7f4b96f19640 1 --2- 172.21.15.45:0/792858873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b900bc750 0x7f4b901e6e30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4b800af040 tx=0x7f4b80019250 comp rx=0 tx=0).stop 2023-10-03T19:12:53.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.569+0000 7f4b96f19640 1 -- 172.21.15.45:0/792858873 shutdown_connections 2023-10-03T19:12:53.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.569+0000 7f4b96f19640 1 --2- 172.21.15.45:0/792858873 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4b7c066280 0x7f4b7c068730 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.569+0000 7f4b96f19640 1 --2- 172.21.15.45:0/792858873 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b90149e50 0x7f4b900a5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.569+0000 7f4b96f19640 1 --2- 172.21.15.45:0/792858873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b900c07b0 0x7f4b900a2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.569+0000 7f4b96f19640 1 --2- 172.21.15.45:0/792858873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b900bc750 0x7f4b901e6e30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.569+0000 7f4b96f19640 1 -- 172.21.15.45:0/792858873 >> 172.21.15.45:0/792858873 conn(0x7f4b900c1510 msgr2=0x7f4b900c18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:53.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.569+0000 7f4b96f19640 1 -- 172.21.15.45:0/792858873 shutdown_connections 2023-10-03T19:12:53.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.569+0000 7f4b96f19640 1 -- 172.21.15.45:0/792858873 wait complete. 2023-10-03T19:12:53.590 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T19:12:53.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.701+0000 7f948448e640 1 Processor -- start 2023-10-03T19:12:53.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.701+0000 7f948448e640 1 -- start start 2023-10-03T19:12:53.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.701+0000 7f948448e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f947c0bf1f0 0x7f947c0a9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:53.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.701+0000 7f948448e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f947c0c2770 0x7f947c0a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:53.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.701+0000 7f948448e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f947c06ac70 con 0x7f947c0c14e0 2023-10-03T19:12:53.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.701+0000 7f948448e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f947c06aae0 con 0x7f947c0c2770 2023-10-03T19:12:53.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.701+0000 7f948448e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f947c0c3000 con 0x7f947c0bf1f0 2023-10-03T19:12:53.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.701+0000 7f948222a640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f947c0c14e0 0x7f947c0c0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38902/0 (socket says 172.21.15.45:38902) 2023-10-03T19:12:53.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.701+0000 7f948222a640 1 -- 172.21.15.45:0/2783201513 learned_addr learned my addr 172.21.15.45:0/2783201513 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:53.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.701+0000 7f9482a2b640 1 --2- 172.21.15.45:0/2783201513 >> v2:172.21.15.45:3300/0 conn(0x7f947c0c2770 0x7f947c0a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:53.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.701+0000 7f9481a29640 1 --2- 172.21.15.45:0/2783201513 >> v2:172.21.15.79:3300/0 conn(0x7f947c0bf1f0 0x7f947c0a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:53.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.701+0000 7f9481228640 1 -- 172.21.15.45:0/2783201513 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4138165882 0 0) 0x7f947c06ac70 con 0x7f947c0c14e0 2023-10-03T19:12:53.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.701+0000 7f9481228640 1 -- 172.21.15.45:0/2783201513 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9468003530 con 0x7f947c0c14e0 2023-10-03T19:12:53.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.701+0000 7f9482a2b640 1 -- 172.21.15.45:0/2783201513 >> v2:172.21.15.79:3300/0 conn(0x7f947c0bf1f0 msgr2=0x7f947c0a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:53.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.701+0000 7f9482a2b640 1 --2- 172.21.15.45:0/2783201513 >> v2:172.21.15.79:3300/0 conn(0x7f947c0bf1f0 0x7f947c0a9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.701+0000 7f9482a2b640 1 -- 172.21.15.45:0/2783201513 >> v1:172.21.15.45:6789/0 conn(0x7f947c0c14e0 legacy=0x7f947c0c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:53.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.701+0000 7f9482a2b640 1 -- 172.21.15.45:0/2783201513 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c0aa5f0 con 0x7f947c0c2770 2023-10-03T19:12:53.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.705+0000 7f9482a2b640 1 --2- 172.21.15.45:0/2783201513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f947c0c2770 0x7f947c0a9da0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f947c0c0110 tx=0x7f947401f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc423b8c4fa1f101 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:53.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.705+0000 7f9481228640 1 -- 172.21.15.45:0/2783201513 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94740b0440 con 0x7f947c0c2770 2023-10-03T19:12:53.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.705+0000 7f9481228640 1 -- 172.21.15.45:0/2783201513 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94740b05a0 con 0x7f947c0c2770 2023-10-03T19:12:53.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.705+0000 7f9481228640 1 -- 172.21.15.45:0/2783201513 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94740b0930 con 0x7f947c0c2770 2023-10-03T19:12:53.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.705+0000 7f948448e640 1 -- 172.21.15.45:0/2783201513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f947c0c2770 msgr2=0x7f947c0a9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:53.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.705+0000 7f948448e640 1 --2- 172.21.15.45:0/2783201513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f947c0c2770 0x7f947c0a9da0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f947c0c0110 tx=0x7f947401f0f0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.705+0000 7f948448e640 1 -- 172.21.15.45:0/2783201513 shutdown_connections 2023-10-03T19:12:53.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.705+0000 7f948448e640 1 --2- 172.21.15.45:0/2783201513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f947c0c2770 0x7f947c0a9da0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.705+0000 7f948448e640 1 --2- 172.21.15.45:0/2783201513 >> v2:172.21.15.79:3300/0 conn(0x7f947c0bf1f0 0x7f947c0a9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.705+0000 7f948448e640 1 -- 172.21.15.45:0/2783201513 >> 172.21.15.45:0/2783201513 conn(0x7f947c0a6440 msgr2=0x7f947c0a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:53.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.705+0000 7f948448e640 1 -- 172.21.15.45:0/2783201513 shutdown_connections 2023-10-03T19:12:53.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.705+0000 7f948448e640 1 -- 172.21.15.45:0/2783201513 wait complete. 2023-10-03T19:12:53.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.705+0000 7f948448e640 1 Processor -- start 2023-10-03T19:12:53.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.705+0000 7f948448e640 1 -- start start 2023-10-03T19:12:53.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.705+0000 7f948448e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f947c0bf1f0 0x7f947c099890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:53.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.705+0000 7f948448e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f947c0c14e0 0x7f947c0be280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:53.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.705+0000 7f948448e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f947c0c2770 0x7f947c0b9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:53.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.705+0000 7f948448e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c1e7230 con 0x7f947c0bf1f0 2023-10-03T19:12:53.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.705+0000 7f948448e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c0be7c0 con 0x7f947c0c14e0 2023-10-03T19:12:53.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.705+0000 7f948448e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947c0bb4b0 con 0x7f947c0c2770 2023-10-03T19:12:53.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.705+0000 7f948222a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f947c0bf1f0 0x7f947c099890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:53.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.705+0000 7f948222a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f947c0bf1f0 0x7f947c099890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36064/0 (socket says 172.21.15.45:36064) 2023-10-03T19:12:53.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.705+0000 7f948222a640 1 -- 172.21.15.45:0/3500375000 learned_addr learned my addr 172.21.15.45:0/3500375000 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:53.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.705+0000 7f948222a640 1 -- 172.21.15.45:0/3500375000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f947c0c2770 msgr2=0x7f947c0b9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:53.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.705+0000 7f948222a640 1 --2- 172.21.15.45:0/3500375000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f947c0c2770 0x7f947c0b9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.705+0000 7f948222a640 1 -- 172.21.15.45:0/3500375000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f947c0c14e0 msgr2=0x7f947c0be280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:53.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.705+0000 7f948222a640 1 --2- 172.21.15.45:0/3500375000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f947c0c14e0 0x7f947c0be280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.705+0000 7f948222a640 1 -- 172.21.15.45:0/3500375000 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9474009a70 con 0x7f947c0bf1f0 2023-10-03T19:12:53.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.705+0000 7f948222a640 1 --2- 172.21.15.45:0/3500375000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f947c0bf1f0 0x7f947c099890 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f947800c4d0 tx=0x7f947800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:53.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.709+0000 7f9472ffd640 1 -- 172.21.15.45:0/3500375000 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9478005cf0 con 0x7f947c0bf1f0 2023-10-03T19:12:53.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.709+0000 7f9472ffd640 1 -- 172.21.15.45:0/3500375000 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9478005e50 con 0x7f947c0bf1f0 2023-10-03T19:12:53.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.709+0000 7f948448e640 1 -- 172.21.15.45:0/3500375000 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f947c14f530 con 0x7f947c0bf1f0 2023-10-03T19:12:53.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.709+0000 7f9472ffd640 1 -- 172.21.15.45:0/3500375000 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9478007270 con 0x7f947c0bf1f0 2023-10-03T19:12:53.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.709+0000 7f948448e640 1 -- 172.21.15.45:0/3500375000 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947c14f250 con 0x7f947c0bf1f0 2023-10-03T19:12:53.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.709+0000 7f948448e640 1 -- 172.21.15.45:0/3500375000 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f947c06b100 con 0x7f947c0bf1f0 2023-10-03T19:12:53.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.709+0000 7f9472ffd640 1 -- 172.21.15.45:0/3500375000 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f94780073d0 con 0x7f947c0bf1f0 2023-10-03T19:12:53.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.709+0000 7f9472ffd640 1 --2- 172.21.15.45:0/3500375000 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9460066280 0x7f9460068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:53.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.709+0000 7f9472ffd640 1 -- 172.21.15.45:0/3500375000 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f94780831b0 con 0x7f947c0bf1f0 2023-10-03T19:12:53.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.709+0000 7f9481a29640 1 --2- 172.21.15.45:0/3500375000 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9460066280 0x7f9460068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:53.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.709+0000 7f9481a29640 1 --2- 172.21.15.45:0/3500375000 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9460066280 0x7f9460068730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f947c0bf5c0 tx=0x7f946c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:53.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.713+0000 7f9472ffd640 1 -- 172.21.15.45:0/3500375000 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9478050750 con 0x7f947c0bf1f0 2023-10-03T19:12:53.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.861+0000 7f948448e640 1 -- 172.21.15.45:0/3500375000 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f947c1e7080 con 0x7f947c0bf1f0 2023-10-03T19:12:53.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.861+0000 7f9472ffd640 1 -- 172.21.15.45:0/3500375000 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9478053d70 con 0x7f947c0bf1f0 2023-10-03T19:12:53.864 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-03T19:12:53.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.861+0000 7f948448e640 1 -- 172.21.15.45:0/3500375000 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9460066280 msgr2=0x7f9460068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:53.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.861+0000 7f948448e640 1 --2- 172.21.15.45:0/3500375000 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9460066280 0x7f9460068730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f947c0bf5c0 tx=0x7f946c008040 comp rx=0 tx=0).stop 2023-10-03T19:12:53.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.861+0000 7f948448e640 1 -- 172.21.15.45:0/3500375000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f947c0bf1f0 msgr2=0x7f947c099890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:53.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.861+0000 7f948448e640 1 --2- 172.21.15.45:0/3500375000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f947c0bf1f0 0x7f947c099890 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f947800c4d0 tx=0x7f947800c990 comp rx=0 tx=0).stop 2023-10-03T19:12:53.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.861+0000 7f948448e640 1 -- 172.21.15.45:0/3500375000 shutdown_connections 2023-10-03T19:12:53.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.861+0000 7f948448e640 1 --2- 172.21.15.45:0/3500375000 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9460066280 0x7f9460068730 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.861+0000 7f948448e640 1 --2- 172.21.15.45:0/3500375000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f947c0c2770 0x7f947c0b9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.861+0000 7f948448e640 1 --2- 172.21.15.45:0/3500375000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f947c0c14e0 0x7f947c0be280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.861+0000 7f948448e640 1 --2- 172.21.15.45:0/3500375000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f947c0bf1f0 0x7f947c099890 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:53.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.861+0000 7f948448e640 1 -- 172.21.15.45:0/3500375000 >> 172.21.15.45:0/3500375000 conn(0x7f947c0a6440 msgr2=0x7f947c0a6810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:53.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.861+0000 7f948448e640 1 -- 172.21.15.45:0/3500375000 shutdown_connections 2023-10-03T19:12:53.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:53.861+0000 7f948448e640 1 -- 172.21.15.45:0/3500375000 wait complete. 2023-10-03T19:12:53.882 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T19:12:54.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.005+0000 7f0ced16b640 1 Processor -- start 2023-10-03T19:12:54.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.005+0000 7f0ced16b640 1 -- start start 2023-10-03T19:12:54.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.005+0000 7f0ced16b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0ce80712c0 0x7f0ce80bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:54.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.005+0000 7f0ced16b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0ce806d560 0x7f0ce80bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:54.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.005+0000 7f0ced16b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce806c2d0 con 0x7f0ce806c760 2023-10-03T19:12:54.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.005+0000 7f0ced16b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce8150610 con 0x7f0ce806d560 2023-10-03T19:12:54.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.005+0000 7f0ced16b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce81508b0 con 0x7f0ce80712c0 2023-10-03T19:12:54.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.005+0000 7f0cdffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0ce806d560 0x7f0ce80bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:54.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.005+0000 7f0cdffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0ce806d560 0x7f0ce80bd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36070/0 (socket says 172.21.15.45:36070) 2023-10-03T19:12:54.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.005+0000 7f0cdffff640 1 -- 172.21.15.45:0/4283492153 learned_addr learned my addr 172.21.15.45:0/4283492153 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:54.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.005+0000 7f0ce6d9d640 1 --2- 172.21.15.45:0/4283492153 >> v2:172.21.15.79:3300/0 conn(0x7f0ce80712c0 0x7f0ce80bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:54.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.005+0000 7f0cdffff640 1 -- 172.21.15.45:0/4283492153 >> v2:172.21.15.79:3300/0 conn(0x7f0ce80712c0 msgr2=0x7f0ce80bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:54.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.005+0000 7f0cdffff640 1 --2- 172.21.15.45:0/4283492153 >> v2:172.21.15.79:3300/0 conn(0x7f0ce80712c0 0x7f0ce80bcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.005+0000 7f0cdffff640 1 -- 172.21.15.45:0/4283492153 >> v1:172.21.15.79:6789/0 conn(0x7f0ce806c760 legacy=0x7f0ce80a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:54.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.005+0000 7f0cdffff640 1 -- 172.21.15.45:0/4283492153 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce806d2e0 con 0x7f0ce806d560 2023-10-03T19:12:54.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.009+0000 7f0cdffff640 1 --2- 172.21.15.45:0/4283492153 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ce806d560 0x7f0ce80bd100 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0ce80a2fd0 tx=0x7f0cd001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e92f1b1e82a513e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:54.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.009+0000 7f0ce659c640 1 -- 172.21.15.45:0/4283492153 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd00ab640 con 0x7f0ce806d560 2023-10-03T19:12:54.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.009+0000 7f0ce659c640 1 -- 172.21.15.45:0/4283492153 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd00a7070 con 0x7f0ce806d560 2023-10-03T19:12:54.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.009+0000 7f0ce659c640 1 -- 172.21.15.45:0/4283492153 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd00ab9c0 con 0x7f0ce806d560 2023-10-03T19:12:54.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.009+0000 7f0ced16b640 1 -- 172.21.15.45:0/4283492153 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ce806d560 msgr2=0x7f0ce80bd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:54.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.009+0000 7f0ced16b640 1 --2- 172.21.15.45:0/4283492153 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ce806d560 0x7f0ce80bd100 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0ce80a2fd0 tx=0x7f0cd001c500 comp rx=0 tx=0).stop 2023-10-03T19:12:54.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.009+0000 7f0ced16b640 1 -- 172.21.15.45:0/4283492153 shutdown_connections 2023-10-03T19:12:54.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.009+0000 7f0ced16b640 1 --2- 172.21.15.45:0/4283492153 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ce806d560 0x7f0ce80bd100 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.009+0000 7f0ced16b640 1 --2- 172.21.15.45:0/4283492153 >> v2:172.21.15.79:3300/0 conn(0x7f0ce80712c0 0x7f0ce80bcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.009+0000 7f0ced16b640 1 -- 172.21.15.45:0/4283492153 >> 172.21.15.45:0/4283492153 conn(0x7f0ce80a20d0 msgr2=0x7f0ce80a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:54.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.009+0000 7f0ced16b640 1 -- 172.21.15.45:0/4283492153 shutdown_connections 2023-10-03T19:12:54.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.009+0000 7f0ced16b640 1 -- 172.21.15.45:0/4283492153 wait complete. 2023-10-03T19:12:54.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.009+0000 7f0ced16b640 1 Processor -- start 2023-10-03T19:12:54.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.013+0000 7f0ced16b640 1 -- start start 2023-10-03T19:12:54.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.013+0000 7f0ced16b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce806c760 0x7f0ce814a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:54.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.013+0000 7f0ced16b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ce806d560 0x7f0ce81461f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:54.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.013+0000 7f0ced16b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ce80712c0 0x7f0ce80b9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:54.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.013+0000 7f0ced16b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce8141e60 con 0x7f0ce80712c0 2023-10-03T19:12:54.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.013+0000 7f0ced16b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce8148e40 con 0x7f0ce806c760 2023-10-03T19:12:54.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.013+0000 7f0ced16b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce81e6390 con 0x7f0ce806d560 2023-10-03T19:12:54.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.013+0000 7f0ce759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ce80712c0 0x7f0ce80b9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:54.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.013+0000 7f0ce759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ce80712c0 0x7f0ce80b9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36076/0 (socket says 172.21.15.45:36076) 2023-10-03T19:12:54.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.013+0000 7f0ce759e640 1 -- 172.21.15.45:0/735768678 learned_addr learned my addr 172.21.15.45:0/735768678 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:54.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.013+0000 7f0ce6d9d640 1 --2- 172.21.15.45:0/735768678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce806c760 0x7f0ce814a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:54.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.013+0000 7f0cdffff640 1 --2- 172.21.15.45:0/735768678 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ce806d560 0x7f0ce81461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:54.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.013+0000 7f0ce759e640 1 -- 172.21.15.45:0/735768678 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ce806d560 msgr2=0x7f0ce81461f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:54.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.013+0000 7f0ce759e640 1 --2- 172.21.15.45:0/735768678 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ce806d560 0x7f0ce81461f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.013+0000 7f0ce759e640 1 -- 172.21.15.45:0/735768678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce806c760 msgr2=0x7f0ce814a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:54.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.013+0000 7f0ce759e640 1 --2- 172.21.15.45:0/735768678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce806c760 0x7f0ce814a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.013+0000 7f0ce759e640 1 -- 172.21.15.45:0/735768678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd00094d0 con 0x7f0ce80712c0 2023-10-03T19:12:54.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.013+0000 7f0cdffff640 1 --2- 172.21.15.45:0/735768678 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ce806d560 0x7f0ce81461f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:54.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.013+0000 7f0ce759e640 1 --2- 172.21.15.45:0/735768678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ce80712c0 0x7f0ce80b9940 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0ce000c700 tx=0x7f0ce000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:54.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.013+0000 7f0cdf7fe640 1 -- 172.21.15.45:0/735768678 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0003b80 con 0x7f0ce80712c0 2023-10-03T19:12:54.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.013+0000 7f0cdf7fe640 1 -- 172.21.15.45:0/735768678 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce0003ce0 con 0x7f0ce80712c0 2023-10-03T19:12:54.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.013+0000 7f0ced16b640 1 -- 172.21.15.45:0/735768678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce80a6070 con 0x7f0ce80712c0 2023-10-03T19:12:54.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.013+0000 7f0cdf7fe640 1 -- 172.21.15.45:0/735768678 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce000aa90 con 0x7f0ce80712c0 2023-10-03T19:12:54.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.013+0000 7f0ced16b640 1 -- 172.21.15.45:0/735768678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce80a5ee0 con 0x7f0ce80712c0 2023-10-03T19:12:54.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.013+0000 7f0ced16b640 1 -- 172.21.15.45:0/735768678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce81596f0 con 0x7f0ce80712c0 2023-10-03T19:12:54.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.013+0000 7f0cdf7fe640 1 -- 172.21.15.45:0/735768678 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0ce000abf0 con 0x7f0ce80712c0 2023-10-03T19:12:54.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.013+0000 7f0cdf7fe640 1 --2- 172.21.15.45:0/735768678 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0cc80662b0 0x7f0cc8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:54.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.013+0000 7f0cdf7fe640 1 -- 172.21.15.45:0/735768678 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0ce0083a40 con 0x7f0ce80712c0 2023-10-03T19:12:54.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.017+0000 7f0ce6d9d640 1 --2- 172.21.15.45:0/735768678 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0cc80662b0 0x7f0cc8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:54.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.017+0000 7f0ce6d9d640 1 --2- 172.21.15.45:0/735768678 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0cc80662b0 0x7f0cc8068760 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0cd800b930 tx=0x7f0cd8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:54.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.021+0000 7f0cdf7fe640 1 -- 172.21.15.45:0/735768678 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0ce0085e60 con 0x7f0ce80712c0 2023-10-03T19:12:54.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.173+0000 7f0ced16b640 1 -- 172.21.15.45:0/735768678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0ce80bca30 con 0x7f0ce80712c0 2023-10-03T19:12:54.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.173+0000 7f0cdf7fe640 1 -- 172.21.15.45:0/735768678 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0ce0050f50 con 0x7f0ce80712c0 2023-10-03T19:12:54.178 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-03T19:12:54.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.173+0000 7f0ced16b640 1 -- 172.21.15.45:0/735768678 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0cc80662b0 msgr2=0x7f0cc8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:54.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.173+0000 7f0ced16b640 1 --2- 172.21.15.45:0/735768678 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0cc80662b0 0x7f0cc8068760 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0cd800b930 tx=0x7f0cd8008040 comp rx=0 tx=0).stop 2023-10-03T19:12:54.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.173+0000 7f0ced16b640 1 -- 172.21.15.45:0/735768678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ce80712c0 msgr2=0x7f0ce80b9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:54.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.173+0000 7f0ced16b640 1 --2- 172.21.15.45:0/735768678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ce80712c0 0x7f0ce80b9940 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0ce000c700 tx=0x7f0ce000cbc0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.177+0000 7f0ced16b640 1 -- 172.21.15.45:0/735768678 shutdown_connections 2023-10-03T19:12:54.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.177+0000 7f0ced16b640 1 --2- 172.21.15.45:0/735768678 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0cc80662b0 0x7f0cc8068760 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.177+0000 7f0ced16b640 1 --2- 172.21.15.45:0/735768678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ce80712c0 0x7f0ce80b9940 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.177+0000 7f0ced16b640 1 --2- 172.21.15.45:0/735768678 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ce806d560 0x7f0ce81461f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.177+0000 7f0ced16b640 1 --2- 172.21.15.45:0/735768678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce806c760 0x7f0ce814a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.177+0000 7f0ced16b640 1 -- 172.21.15.45:0/735768678 >> 172.21.15.45:0/735768678 conn(0x7f0ce80a20d0 msgr2=0x7f0ce80bbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:54.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.177+0000 7f0ced16b640 1 -- 172.21.15.45:0/735768678 shutdown_connections 2023-10-03T19:12:54.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.177+0000 7f0ced16b640 1 -- 172.21.15.45:0/735768678 wait complete. 2023-10-03T19:12:54.196 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:12:54.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.316+0000 7f841f996640 1 Processor -- start 2023-10-03T19:12:54.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.316+0000 7f841f996640 1 -- start start 2023-10-03T19:12:54.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.316+0000 7f841f996640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f841814f240 0x7f84181528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:54.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.316+0000 7f841f996640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f84180c2790 0x7f84180c0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:54.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.316+0000 7f841f996640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f841806b2d0 con 0x7f84180bb1d0 2023-10-03T19:12:54.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.316+0000 7f841f996640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f841806b640 con 0x7f84180c2790 2023-10-03T19:12:54.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.316+0000 7f841f996640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84180c0fa0 con 0x7f841814f240 2023-10-03T19:12:54.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.316+0000 7f841cf31640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f84180c2790 0x7f84180c0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:54.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.316+0000 7f841df33640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f84180bb1d0 0x7f84180c12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38918/0 (socket says 172.21.15.45:38918) 2023-10-03T19:12:54.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.316+0000 7f841df33640 1 -- 172.21.15.45:0/703424090 learned_addr learned my addr 172.21.15.45:0/703424090 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:54.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.316+0000 7f841d732640 1 --2- 172.21.15.45:0/703424090 >> v2:172.21.15.79:3300/0 conn(0x7f841814f240 0x7f84181528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:54.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.316+0000 7f841cf31640 1 -- 172.21.15.45:0/703424090 >> v2:172.21.15.79:3300/0 conn(0x7f841814f240 msgr2=0x7f84181528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:54.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.316+0000 7f841cf31640 1 --2- 172.21.15.45:0/703424090 >> v2:172.21.15.79:3300/0 conn(0x7f841814f240 0x7f84181528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.316+0000 7f841cf31640 1 -- 172.21.15.45:0/703424090 >> v1:172.21.15.45:6789/0 conn(0x7f84180bb1d0 legacy=0x7f84180c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:54.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.316+0000 7f841cf31640 1 -- 172.21.15.45:0/703424090 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84180a3c60 con 0x7f84180c2790 2023-10-03T19:12:54.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.316+0000 7f840ffff640 1 -- 172.21.15.45:0/703424090 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2502107492 0 0) 0x7f841806b2d0 con 0x7f84180bb1d0 2023-10-03T19:12:54.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f841cf31640 1 --2- 172.21.15.45:0/703424090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84180c2790 0x7f84180c0a60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f84180c47f0 tx=0x7f840801ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ab56d2dcf77502 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:54.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f840ffff640 1 -- 172.21.15.45:0/703424090 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84080a8930 con 0x7f84180c2790 2023-10-03T19:12:54.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f840ffff640 1 -- 172.21.15.45:0/703424090 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84080a8a90 con 0x7f84180c2790 2023-10-03T19:12:54.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f840ffff640 1 -- 172.21.15.45:0/703424090 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84080a8e20 con 0x7f84180c2790 2023-10-03T19:12:54.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f841f996640 1 -- 172.21.15.45:0/703424090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84180c2790 msgr2=0x7f84180c0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:54.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f841f996640 1 --2- 172.21.15.45:0/703424090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84180c2790 0x7f84180c0a60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f84180c47f0 tx=0x7f840801ec30 comp rx=0 tx=0).stop 2023-10-03T19:12:54.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f841f996640 1 -- 172.21.15.45:0/703424090 shutdown_connections 2023-10-03T19:12:54.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f841f996640 1 --2- 172.21.15.45:0/703424090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84180c2790 0x7f84180c0a60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f841f996640 1 --2- 172.21.15.45:0/703424090 >> v2:172.21.15.79:3300/0 conn(0x7f841814f240 0x7f84181528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f841f996640 1 -- 172.21.15.45:0/703424090 >> 172.21.15.45:0/703424090 conn(0x7f84180a64a0 msgr2=0x7f84180a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:54.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f841f996640 1 -- 172.21.15.45:0/703424090 shutdown_connections 2023-10-03T19:12:54.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f841f996640 1 -- 172.21.15.45:0/703424090 wait complete. 2023-10-03T19:12:54.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f841f996640 1 Processor -- start 2023-10-03T19:12:54.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f841f996640 1 -- start start 2023-10-03T19:12:54.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f841f996640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84180bb1d0 0x7f84181e7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:54.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f841f996640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84180c2790 0x7f841814c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:54.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f841f996640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f841814f240 0x7f8418149160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:54.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f841f996640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84181e7e80 con 0x7f841814f240 2023-10-03T19:12:54.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f841f996640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841814cc40 con 0x7f84180c2790 2023-10-03T19:12:54.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f841f996640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84180c4f20 con 0x7f84180bb1d0 2023-10-03T19:12:54.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f841df33640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f841814f240 0x7f8418149160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:54.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f841df33640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f841814f240 0x7f8418149160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36094/0 (socket says 172.21.15.45:36094) 2023-10-03T19:12:54.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f841df33640 1 -- 172.21.15.45:0/3930148959 learned_addr learned my addr 172.21.15.45:0/3930148959 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:54.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f841cf31640 1 --2- 172.21.15.45:0/3930148959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84180c2790 0x7f841814c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:54.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f841d732640 1 --2- 172.21.15.45:0/3930148959 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84180bb1d0 0x7f84181e7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:54.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f841df33640 1 -- 172.21.15.45:0/3930148959 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84180bb1d0 msgr2=0x7f84181e7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:54.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f841df33640 1 --2- 172.21.15.45:0/3930148959 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84180bb1d0 0x7f84181e7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f841df33640 1 -- 172.21.15.45:0/3930148959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84180c2790 msgr2=0x7f841814c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:54.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f841df33640 1 --2- 172.21.15.45:0/3930148959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84180c2790 0x7f841814c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f841df33640 1 -- 172.21.15.45:0/3930148959 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84080093b0 con 0x7f841814f240 2023-10-03T19:12:54.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f841df33640 1 --2- 172.21.15.45:0/3930148959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f841814f240 0x7f8418149160 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8410001570 tx=0x7f841000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:54.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f840dffb640 1 -- 172.21.15.45:0/3930148959 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841000a640 con 0x7f841814f240 2023-10-03T19:12:54.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f840dffb640 1 -- 172.21.15.45:0/3930148959 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841000a7c0 con 0x7f841814f240 2023-10-03T19:12:54.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.320+0000 7f841f996640 1 -- 172.21.15.45:0/3930148959 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f841814e740 con 0x7f841814f240 2023-10-03T19:12:54.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.324+0000 7f840dffb640 1 -- 172.21.15.45:0/3930148959 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841000ab70 con 0x7f841814f240 2023-10-03T19:12:54.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.324+0000 7f841f996640 1 -- 172.21.15.45:0/3930148959 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84180c19b0 con 0x7f841814f240 2023-10-03T19:12:54.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.324+0000 7f841f996640 1 -- 172.21.15.45:0/3930148959 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84180a3f40 con 0x7f841814f240 2023-10-03T19:12:54.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.324+0000 7f840dffb640 1 -- 172.21.15.45:0/3930148959 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f841000acd0 con 0x7f841814f240 2023-10-03T19:12:54.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.324+0000 7f840dffb640 1 --2- 172.21.15.45:0/3930148959 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f83fc0662b0 0x7f83fc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:54.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.324+0000 7f840dffb640 1 -- 172.21.15.45:0/3930148959 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8410083500 con 0x7f841814f240 2023-10-03T19:12:54.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.324+0000 7f841d732640 1 --2- 172.21.15.45:0/3930148959 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f83fc0662b0 0x7f83fc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:54.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.324+0000 7f841d732640 1 --2- 172.21.15.45:0/3930148959 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f83fc0662b0 0x7f83fc068760 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8414006fd0 tx=0x7f8414008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:54.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.328+0000 7f840dffb640 1 -- 172.21.15.45:0/3930148959 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8410050a10 con 0x7f841814f240 2023-10-03T19:12:54.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.480+0000 7f841f996640 1 -- 172.21.15.45:0/3930148959 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84180bfa90 con 0x7f841814f240 2023-10-03T19:12:54.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.480+0000 7f840dffb640 1 -- 172.21.15.45:0/3930148959 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18231 (secure 0 0 0) 0x7f8410054030 con 0x7f841814f240 2023-10-03T19:12:54.486 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:54.486 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:12:28.941467+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:12:26.226431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T19:12:26.923174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:12:54.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.484+0000 7f841f996640 1 -- 172.21.15.45:0/3930148959 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f83fc0662b0 msgr2=0x7f83fc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:54.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.484+0000 7f841f996640 1 --2- 172.21.15.45:0/3930148959 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f83fc0662b0 0x7f83fc068760 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8414006fd0 tx=0x7f8414008040 comp rx=0 tx=0).stop 2023-10-03T19:12:54.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.484+0000 7f841f996640 1 -- 172.21.15.45:0/3930148959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f841814f240 msgr2=0x7f8418149160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:54.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.484+0000 7f841f996640 1 --2- 172.21.15.45:0/3930148959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f841814f240 0x7f8418149160 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8410001570 tx=0x7f841000cca0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.484+0000 7f841f996640 1 -- 172.21.15.45:0/3930148959 shutdown_connections 2023-10-03T19:12:54.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.484+0000 7f841f996640 1 --2- 172.21.15.45:0/3930148959 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f83fc0662b0 0x7f83fc068760 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.484+0000 7f841f996640 1 --2- 172.21.15.45:0/3930148959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f841814f240 0x7f8418149160 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.484+0000 7f841f996640 1 --2- 172.21.15.45:0/3930148959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84180c2790 0x7f841814c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.484+0000 7f841f996640 1 --2- 172.21.15.45:0/3930148959 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84180bb1d0 0x7f84181e7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.484+0000 7f841f996640 1 -- 172.21.15.45:0/3930148959 >> 172.21.15.45:0/3930148959 conn(0x7f84180a64a0 msgr2=0x7f84180a6870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:54.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.484+0000 7f841f996640 1 -- 172.21.15.45:0/3930148959 shutdown_connections 2023-10-03T19:12:54.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.484+0000 7f841f996640 1 -- 172.21.15.45:0/3930148959 wait complete. 2023-10-03T19:12:54.506 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T19:12:26.226431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T19:12:26.923174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:12:54.506 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:12:54.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.628+0000 7f96ef466640 1 Processor -- start 2023-10-03T19:12:54.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.628+0000 7f96ef466640 1 -- start start 2023-10-03T19:12:54.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.628+0000 7f96ef466640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f96e80bc800 0x7f96e8070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:54.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.628+0000 7f96ef466640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f96e814bba0 0x7f96e80c1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:54.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.628+0000 7f96ef466640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e814b710 con 0x7f96e8070700 2023-10-03T19:12:54.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.628+0000 7f96ef466640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e814b190 con 0x7f96e814bba0 2023-10-03T19:12:54.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.628+0000 7f96ef466640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e814e8b0 con 0x7f96e80bc800 2023-10-03T19:12:54.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.628+0000 7f96ed202640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f96e8070700 0x7f96e806f710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38610/0 (socket says 172.21.15.45:38610) 2023-10-03T19:12:54.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.628+0000 7f96eda03640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f96e814bba0 0x7f96e80c1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:54.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.628+0000 7f96ed202640 1 -- 172.21.15.45:0/146046624 learned_addr learned my addr 172.21.15.45:0/146046624 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:54.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.628+0000 7f96eca01640 1 --2- 172.21.15.45:0/146046624 >> v2:172.21.15.79:3300/0 conn(0x7f96e80bc800 0x7f96e8070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:54.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.628+0000 7f96eda03640 1 -- 172.21.15.45:0/146046624 >> v2:172.21.15.79:3300/0 conn(0x7f96e80bc800 msgr2=0x7f96e8070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.628+0000 7f96eda03640 1 --2- 172.21.15.45:0/146046624 >> v2:172.21.15.79:3300/0 conn(0x7f96e80bc800 0x7f96e8070b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.628+0000 7f96eda03640 1 -- 172.21.15.45:0/146046624 >> v1:172.21.15.45:6789/0 conn(0x7f96e8070700 legacy=0x7f96e806f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.628+0000 7f96eda03640 1 -- 172.21.15.45:0/146046624 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e814b3a0 con 0x7f96e814bba0 2023-10-03T19:12:54.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.632+0000 7f96eda03640 1 --2- 172.21.15.45:0/146046624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96e814bba0 0x7f96e80c1360 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f96e806f560 tx=0x7f96e001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447d033844c9e309 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:54.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.632+0000 7f96dffff640 1 -- 172.21.15.45:0/146046624 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e00a58e0 con 0x7f96e814bba0 2023-10-03T19:12:54.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.632+0000 7f96dffff640 1 -- 172.21.15.45:0/146046624 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e00a5a40 con 0x7f96e814bba0 2023-10-03T19:12:54.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.632+0000 7f96dffff640 1 -- 172.21.15.45:0/146046624 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e00a5dd0 con 0x7f96e814bba0 2023-10-03T19:12:54.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.632+0000 7f96ef466640 1 -- 172.21.15.45:0/146046624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96e814bba0 msgr2=0x7f96e80c1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:54.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.632+0000 7f96ef466640 1 --2- 172.21.15.45:0/146046624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96e814bba0 0x7f96e80c1360 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f96e806f560 tx=0x7f96e001c910 comp rx=0 tx=0).stop 2023-10-03T19:12:54.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.632+0000 7f96ef466640 1 -- 172.21.15.45:0/146046624 shutdown_connections 2023-10-03T19:12:54.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.632+0000 7f96ef466640 1 --2- 172.21.15.45:0/146046624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96e814bba0 0x7f96e80c1360 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.632+0000 7f96ef466640 1 --2- 172.21.15.45:0/146046624 >> v2:172.21.15.79:3300/0 conn(0x7f96e80bc800 0x7f96e8070b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.632+0000 7f96ef466640 1 -- 172.21.15.45:0/146046624 >> 172.21.15.45:0/146046624 conn(0x7f96e806a760 msgr2=0x7f96e80c0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:54.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.632+0000 7f96ef466640 1 -- 172.21.15.45:0/146046624 shutdown_connections 2023-10-03T19:12:54.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.632+0000 7f96ef466640 1 -- 172.21.15.45:0/146046624 wait complete. 2023-10-03T19:12:54.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.632+0000 7f96ef466640 1 Processor -- start 2023-10-03T19:12:54.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.632+0000 7f96ef466640 1 -- start start 2023-10-03T19:12:54.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.632+0000 7f96ef466640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96e8070700 0x7f96e813f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:54.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.632+0000 7f96ef466640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96e80bc800 0x7f96e80c02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:54.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.632+0000 7f96ef466640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96e814bba0 0x7f96e81e6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:54.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.632+0000 7f96ef466640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e81478d0 con 0x7f96e814bba0 2023-10-03T19:12:54.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.632+0000 7f96ef466640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e80c0820 con 0x7f96e8070700 2023-10-03T19:12:54.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.632+0000 7f96ef466640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e81e7020 con 0x7f96e80bc800 2023-10-03T19:12:54.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.632+0000 7f96eda03640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96e814bba0 0x7f96e81e6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:54.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.632+0000 7f96eda03640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96e814bba0 0x7f96e81e6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53930/0 (socket says 172.21.15.45:53930) 2023-10-03T19:12:54.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.632+0000 7f96eda03640 1 -- 172.21.15.45:0/3450896007 learned_addr learned my addr 172.21.15.45:0/3450896007 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:54.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.636+0000 7f96ed202640 1 --2- 172.21.15.45:0/3450896007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96e8070700 0x7f96e813f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:54.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.636+0000 7f96eca01640 1 --2- 172.21.15.45:0/3450896007 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96e80bc800 0x7f96e80c02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:54.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.636+0000 7f96eda03640 1 -- 172.21.15.45:0/3450896007 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96e80bc800 msgr2=0x7f96e80c02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:54.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.636+0000 7f96eda03640 1 --2- 172.21.15.45:0/3450896007 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96e80bc800 0x7f96e80c02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.636+0000 7f96eda03640 1 -- 172.21.15.45:0/3450896007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96e8070700 msgr2=0x7f96e813f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:54.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.636+0000 7f96eda03640 1 --2- 172.21.15.45:0/3450896007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96e8070700 0x7f96e813f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.636+0000 7f96eda03640 1 -- 172.21.15.45:0/3450896007 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e0009a70 con 0x7f96e814bba0 2023-10-03T19:12:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.636+0000 7f96eda03640 1 --2- 172.21.15.45:0/3450896007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96e814bba0 0x7f96e81e6ae0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f96e00b0040 tx=0x7f96e00196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.636+0000 7f96ddffb640 1 -- 172.21.15.45:0/3450896007 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e00ad850 con 0x7f96e814bba0 2023-10-03T19:12:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.636+0000 7f96ddffb640 1 -- 172.21.15.45:0/3450896007 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e00ad9b0 con 0x7f96e814bba0 2023-10-03T19:12:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.636+0000 7f96ef466640 1 -- 172.21.15.45:0/3450896007 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e81453f0 con 0x7f96e814bba0 2023-10-03T19:12:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.636+0000 7f96ddffb640 1 -- 172.21.15.45:0/3450896007 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e00add60 con 0x7f96e814bba0 2023-10-03T19:12:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.636+0000 7f96ef466640 1 -- 172.21.15.45:0/3450896007 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e8145260 con 0x7f96e814bba0 2023-10-03T19:12:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.636+0000 7f96ef466640 1 -- 172.21.15.45:0/3450896007 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e8145580 con 0x7f96e814bba0 2023-10-03T19:12:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.636+0000 7f96ddffb640 1 -- 172.21.15.45:0/3450896007 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f96e00b4050 con 0x7f96e814bba0 2023-10-03T19:12:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.636+0000 7f96ddffb640 1 --2- 172.21.15.45:0/3450896007 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f96cc0662b0 0x7f96cc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.636+0000 7f96ddffb640 1 -- 172.21.15.45:0/3450896007 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f96e011edb0 con 0x7f96e814bba0 2023-10-03T19:12:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.636+0000 7f96ed202640 1 --2- 172.21.15.45:0/3450896007 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f96cc0662b0 0x7f96cc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:54.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.640+0000 7f96ed202640 1 --2- 172.21.15.45:0/3450896007 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f96cc0662b0 0x7f96cc068760 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f96e4000f70 tx=0x7f96e4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:54.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.640+0000 7f96ddffb640 1 -- 172.21.15.45:0/3450896007 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f96e00ec310 con 0x7f96e814bba0 2023-10-03T19:12:54.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.796+0000 7f96ef466640 1 -- 172.21.15.45:0/3450896007 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f96e81465b0 con 0x7f96e814bba0 2023-10-03T19:12:54.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.796+0000 7f96ddffb640 1 -- 172.21.15.45:0/3450896007 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f96e00ef930 con 0x7f96e814bba0 2023-10-03T19:12:54.801 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:12:54.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.796+0000 7f96ef466640 1 -- 172.21.15.45:0/3450896007 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f96cc0662b0 msgr2=0x7f96cc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:54.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.796+0000 7f96ef466640 1 --2- 172.21.15.45:0/3450896007 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f96cc0662b0 0x7f96cc068760 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f96e4000f70 tx=0x7f96e4009040 comp rx=0 tx=0).stop 2023-10-03T19:12:54.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.796+0000 7f96ef466640 1 -- 172.21.15.45:0/3450896007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96e814bba0 msgr2=0x7f96e81e6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:54.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.796+0000 7f96ef466640 1 --2- 172.21.15.45:0/3450896007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96e814bba0 0x7f96e81e6ae0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f96e00b0040 tx=0x7f96e00196b0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.796+0000 7f96ef466640 1 -- 172.21.15.45:0/3450896007 shutdown_connections 2023-10-03T19:12:54.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.796+0000 7f96ef466640 1 --2- 172.21.15.45:0/3450896007 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f96cc0662b0 0x7f96cc068760 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.796+0000 7f96ef466640 1 --2- 172.21.15.45:0/3450896007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96e814bba0 0x7f96e81e6ae0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.796+0000 7f96ef466640 1 --2- 172.21.15.45:0/3450896007 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96e80bc800 0x7f96e80c02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.796+0000 7f96ef466640 1 --2- 172.21.15.45:0/3450896007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96e8070700 0x7f96e813f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.796+0000 7f96ef466640 1 -- 172.21.15.45:0/3450896007 >> 172.21.15.45:0/3450896007 conn(0x7f96e806a760 msgr2=0x7f96e806c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:54.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.796+0000 7f96ef466640 1 -- 172.21.15.45:0/3450896007 shutdown_connections 2023-10-03T19:12:54.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.800+0000 7f96ef466640 1 -- 172.21.15.45:0/3450896007 wait complete. 2023-10-03T19:12:54.820 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:12:54.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.936+0000 7fe3deb53640 1 Processor -- start 2023-10-03T19:12:54.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.936+0000 7fe3deb53640 1 -- start start 2023-10-03T19:12:54.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.936+0000 7fe3deb53640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3d80712c0 0x7fe3d80bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:54.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.936+0000 7fe3deb53640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe3d806d560 0x7fe3d80bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:54.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.936+0000 7fe3deb53640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d806c2d0 con 0x7fe3d806c760 2023-10-03T19:12:54.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.936+0000 7fe3deb53640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d8150610 con 0x7fe3d806d560 2023-10-03T19:12:54.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.936+0000 7fe3deb53640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d81508b0 con 0x7fe3d80712c0 2023-10-03T19:12:54.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.940+0000 7fe3dc8ef640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3d80712c0 0x7fe3d80bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:54.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.940+0000 7fe3d7fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe3d806d560 0x7fe3d80bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:54.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.940+0000 7fe3dd0f0640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe3d806c760 0x7fe3d80a53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:52682/0 (socket says 172.21.15.45:52682) 2023-10-03T19:12:54.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.940+0000 7fe3dd0f0640 1 -- 172.21.15.45:0/1088008463 learned_addr learned my addr 172.21.15.45:0/1088008463 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:54.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.940+0000 7fe3dc8ef640 1 -- 172.21.15.45:0/1088008463 >> v2:172.21.15.79:3300/0 conn(0x7fe3d806d560 msgr2=0x7fe3d80bd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:54.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.940+0000 7fe3dc8ef640 1 --2- 172.21.15.45:0/1088008463 >> v2:172.21.15.79:3300/0 conn(0x7fe3d806d560 0x7fe3d80bd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.940+0000 7fe3dc8ef640 1 -- 172.21.15.45:0/1088008463 >> v1:172.21.15.79:6789/0 conn(0x7fe3d806c760 legacy=0x7fe3d80a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:54.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.940+0000 7fe3dc8ef640 1 -- 172.21.15.45:0/1088008463 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d806d2e0 con 0x7fe3d80712c0 2023-10-03T19:12:54.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.940+0000 7fe3dc8ef640 1 --2- 172.21.15.45:0/1088008463 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3d80712c0 0x7fe3d80bcbc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009d90 tx=0x7fe3c801c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23504047c617d2b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:54.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.940+0000 7fe3d77fe640 1 -- 172.21.15.45:0/1088008463 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c80a5950 con 0x7fe3d80712c0 2023-10-03T19:12:54.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.940+0000 7fe3d77fe640 1 -- 172.21.15.45:0/1088008463 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c80a5ab0 con 0x7fe3d80712c0 2023-10-03T19:12:54.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.940+0000 7fe3d77fe640 1 -- 172.21.15.45:0/1088008463 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c80a5e40 con 0x7fe3d80712c0 2023-10-03T19:12:54.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3deb53640 1 -- 172.21.15.45:0/1088008463 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3d80712c0 msgr2=0x7fe3d80bcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:54.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3deb53640 1 --2- 172.21.15.45:0/1088008463 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3d80712c0 0x7fe3d80bcbc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009d90 tx=0x7fe3c801c950 comp rx=0 tx=0).stop 2023-10-03T19:12:54.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3deb53640 1 -- 172.21.15.45:0/1088008463 shutdown_connections 2023-10-03T19:12:54.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3deb53640 1 --2- 172.21.15.45:0/1088008463 >> v2:172.21.15.79:3300/0 conn(0x7fe3d806d560 0x7fe3d80bd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3deb53640 1 --2- 172.21.15.45:0/1088008463 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3d80712c0 0x7fe3d80bcbc0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3deb53640 1 -- 172.21.15.45:0/1088008463 >> 172.21.15.45:0/1088008463 conn(0x7fe3d80a20d0 msgr2=0x7fe3d80a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:54.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3deb53640 1 -- 172.21.15.45:0/1088008463 shutdown_connections 2023-10-03T19:12:54.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3deb53640 1 -- 172.21.15.45:0/1088008463 wait complete. 2023-10-03T19:12:54.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3deb53640 1 Processor -- start 2023-10-03T19:12:54.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3deb53640 1 -- start start 2023-10-03T19:12:54.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3deb53640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3d806c760 0x7fe3d80b99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:54.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3deb53640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3d806d560 0x7fe3d806f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:54.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3deb53640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3d80712c0 0x7fe3d806ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:54.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3deb53640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d81496d0 con 0x7fe3d806d560 2023-10-03T19:12:54.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3deb53640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d80b9f20 con 0x7fe3d80712c0 2023-10-03T19:12:54.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3deb53640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d81e7760 con 0x7fe3d806c760 2023-10-03T19:12:54.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3d7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3d806d560 0x7fe3d806f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:54.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3d7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3d806d560 0x7fe3d806f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53934/0 (socket says 172.21.15.45:53934) 2023-10-03T19:12:54.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3d7fff640 1 -- 172.21.15.45:0/1412106605 learned_addr learned my addr 172.21.15.45:0/1412106605 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:54.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3dc8ef640 1 --2- 172.21.15.45:0/1412106605 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3d806c760 0x7fe3d80b99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:54.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3dd0f0640 1 --2- 172.21.15.45:0/1412106605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3d80712c0 0x7fe3d806ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:54.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3d7fff640 1 -- 172.21.15.45:0/1412106605 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3d806c760 msgr2=0x7fe3d80b99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:54.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3d7fff640 1 --2- 172.21.15.45:0/1412106605 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3d806c760 0x7fe3d80b99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3d7fff640 1 -- 172.21.15.45:0/1412106605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3d80712c0 msgr2=0x7fe3d806ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:54.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3d7fff640 1 --2- 172.21.15.45:0/1412106605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3d80712c0 0x7fe3d806ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:54.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3d7fff640 1 -- 172.21.15.45:0/1412106605 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c8009a70 con 0x7fe3d806d560 2023-10-03T19:12:54.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3d7fff640 1 --2- 172.21.15.45:0/1412106605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3d806d560 0x7fe3d806f9d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe3c000e960 tx=0x7fe3c000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:54.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3d57fa640 1 -- 172.21.15.45:0/1412106605 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c0009690 con 0x7fe3d806d560 2023-10-03T19:12:54.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3d57fa640 1 -- 172.21.15.45:0/1412106605 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c000ca00 con 0x7fe3d806d560 2023-10-03T19:12:54.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3deb53640 1 -- 172.21.15.45:0/1412106605 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d80a6070 con 0x7fe3d806d560 2023-10-03T19:12:54.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3d57fa640 1 -- 172.21.15.45:0/1412106605 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c000cd70 con 0x7fe3d806d560 2023-10-03T19:12:54.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3deb53640 1 -- 172.21.15.45:0/1412106605 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d80a5ee0 con 0x7fe3d806d560 2023-10-03T19:12:54.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.944+0000 7fe3deb53640 1 -- 172.21.15.45:0/1412106605 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d81596f0 con 0x7fe3d806d560 2023-10-03T19:12:54.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.948+0000 7fe3d57fa640 1 -- 172.21.15.45:0/1412106605 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe3c0013470 con 0x7fe3d806d560 2023-10-03T19:12:54.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.948+0000 7fe3d57fa640 1 --2- 172.21.15.45:0/1412106605 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe3b80662b0 0x7fe3b8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:54.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.948+0000 7fe3d57fa640 1 -- 172.21.15.45:0/1412106605 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe3c0083f40 con 0x7fe3d806d560 2023-10-03T19:12:54.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.948+0000 7fe3dc8ef640 1 --2- 172.21.15.45:0/1412106605 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe3b80662b0 0x7fe3b8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:54.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.948+0000 7fe3dc8ef640 1 --2- 172.21.15.45:0/1412106605 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe3b80662b0 0x7fe3b8068760 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe3c80af000 tx=0x7fe3c80a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:54.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:54.952+0000 7fe3d57fa640 1 -- 172.21.15.45:0/1412106605 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe3c00513b0 con 0x7fe3d806d560 2023-10-03T19:12:55.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.104+0000 7fe3deb53640 1 -- 172.21.15.45:0/1412106605 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe3d80bca30 con 0x7fe3d806d560 2023-10-03T19:12:55.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.104+0000 7fe3d57fa640 1 -- 172.21.15.45:0/1412106605 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe3c00170a0 con 0x7fe3d806d560 2023-10-03T19:12:55.111 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:12:55.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.108+0000 7fe3deb53640 1 -- 172.21.15.45:0/1412106605 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe3b80662b0 msgr2=0x7fe3b8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:55.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.108+0000 7fe3deb53640 1 --2- 172.21.15.45:0/1412106605 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe3b80662b0 0x7fe3b8068760 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe3c80af000 tx=0x7fe3c80a7070 comp rx=0 tx=0).stop 2023-10-03T19:12:55.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.108+0000 7fe3deb53640 1 -- 172.21.15.45:0/1412106605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3d806d560 msgr2=0x7fe3d806f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:55.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.108+0000 7fe3deb53640 1 --2- 172.21.15.45:0/1412106605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3d806d560 0x7fe3d806f9d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe3c000e960 tx=0x7fe3c000ee20 comp rx=0 tx=0).stop 2023-10-03T19:12:55.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.108+0000 7fe3deb53640 1 -- 172.21.15.45:0/1412106605 shutdown_connections 2023-10-03T19:12:55.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.108+0000 7fe3deb53640 1 --2- 172.21.15.45:0/1412106605 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe3b80662b0 0x7fe3b8068760 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.108+0000 7fe3deb53640 1 --2- 172.21.15.45:0/1412106605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3d80712c0 0x7fe3d806ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.108+0000 7fe3deb53640 1 --2- 172.21.15.45:0/1412106605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3d806d560 0x7fe3d806f9d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.108+0000 7fe3deb53640 1 --2- 172.21.15.45:0/1412106605 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3d806c760 0x7fe3d80b99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.108+0000 7fe3deb53640 1 -- 172.21.15.45:0/1412106605 >> 172.21.15.45:0/1412106605 conn(0x7fe3d80a20d0 msgr2=0x7fe3d814d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:55.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.108+0000 7fe3deb53640 1 -- 172.21.15.45:0/1412106605 shutdown_connections 2023-10-03T19:12:55.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.108+0000 7fe3deb53640 1 -- 172.21.15.45:0/1412106605 wait complete. 2023-10-03T19:12:55.130 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T19:12:55.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.240+0000 7f04f51fb640 1 Processor -- start 2023-10-03T19:12:55.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.240+0000 7f04f51fb640 1 -- start start 2023-10-03T19:12:55.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.240+0000 7f04f51fb640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f04f00712c0 0x7f04f00bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:55.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.240+0000 7f04f51fb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f04f006c760 0x7f04f00bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:55.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.240+0000 7f04f51fb640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f006c2d0 con 0x7f04f006d560 2023-10-03T19:12:55.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.240+0000 7f04f51fb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f0150610 con 0x7f04f006c760 2023-10-03T19:12:55.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.240+0000 7f04f51fb640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f01508b0 con 0x7f04f00712c0 2023-10-03T19:12:55.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.240+0000 7f04ef59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f04f006c760 0x7f04f00bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:55.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.240+0000 7f04ef59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f04f006c760 0x7f04f00bd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53938/0 (socket says 172.21.15.45:53938) 2023-10-03T19:12:55.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.240+0000 7f04ef59e640 1 -- 172.21.15.45:0/2952870675 learned_addr learned my addr 172.21.15.45:0/2952870675 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:55.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.240+0000 7f04eed9d640 1 --2- 172.21.15.45:0/2952870675 >> v2:172.21.15.79:3300/0 conn(0x7f04f00712c0 0x7f04f00bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:55.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.240+0000 7f04ef59e640 1 -- 172.21.15.45:0/2952870675 >> v2:172.21.15.79:3300/0 conn(0x7f04f00712c0 msgr2=0x7f04f00bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:55.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.240+0000 7f04ef59e640 1 --2- 172.21.15.45:0/2952870675 >> v2:172.21.15.79:3300/0 conn(0x7f04f00712c0 0x7f04f00bcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.240+0000 7f04ef59e640 1 -- 172.21.15.45:0/2952870675 >> v1:172.21.15.79:6789/0 conn(0x7f04f006d560 legacy=0x7f04f00a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:55.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.240+0000 7f04ef59e640 1 -- 172.21.15.45:0/2952870675 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f006d2e0 con 0x7f04f006c760 2023-10-03T19:12:55.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.240+0000 7f04ef59e640 1 --2- 172.21.15.45:0/2952870675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04f006c760 0x7f04f00bd100 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f04f00a2fd0 tx=0x7f04e801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca7a31d70ee9441 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:55.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04edd9b640 1 -- 172.21.15.45:0/2952870675 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e80a57d0 con 0x7f04f006c760 2023-10-03T19:12:55.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04edd9b640 1 -- 172.21.15.45:0/2952870675 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e80a5930 con 0x7f04f006c760 2023-10-03T19:12:55.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04edd9b640 1 -- 172.21.15.45:0/2952870675 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e80a5cc0 con 0x7f04f006c760 2023-10-03T19:12:55.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04f51fb640 1 -- 172.21.15.45:0/2952870675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04f006c760 msgr2=0x7f04f00bd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:55.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04f51fb640 1 --2- 172.21.15.45:0/2952870675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04f006c760 0x7f04f00bd100 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f04f00a2fd0 tx=0x7f04e801c9d0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04f51fb640 1 -- 172.21.15.45:0/2952870675 shutdown_connections 2023-10-03T19:12:55.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04f51fb640 1 --2- 172.21.15.45:0/2952870675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04f006c760 0x7f04f00bd100 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04f51fb640 1 --2- 172.21.15.45:0/2952870675 >> v2:172.21.15.79:3300/0 conn(0x7f04f00712c0 0x7f04f00bcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04f51fb640 1 -- 172.21.15.45:0/2952870675 >> 172.21.15.45:0/2952870675 conn(0x7f04f00a20d0 msgr2=0x7f04f00a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:55.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04f51fb640 1 -- 172.21.15.45:0/2952870675 shutdown_connections 2023-10-03T19:12:55.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04f51fb640 1 -- 172.21.15.45:0/2952870675 wait complete. 2023-10-03T19:12:55.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04f51fb640 1 Processor -- start 2023-10-03T19:12:55.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04f51fb640 1 -- start start 2023-10-03T19:12:55.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04f51fb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f006c760 0x7f04f0142d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:55.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04f51fb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04f006d560 0x7f04f0070a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:55.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04f51fb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04f00712c0 0x7f04f00b99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:55.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04f51fb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f006f8c0 con 0x7f04f006d560 2023-10-03T19:12:55.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04f51fb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f00a1f70 con 0x7f04f006c760 2023-10-03T19:12:55.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04f51fb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f00b9ef0 con 0x7f04f00712c0 2023-10-03T19:12:55.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04ee59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04f006d560 0x7f04f0070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:55.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04ee59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04f006d560 0x7f04f0070a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53952/0 (socket says 172.21.15.45:53952) 2023-10-03T19:12:55.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04ee59c640 1 -- 172.21.15.45:0/965423652 learned_addr learned my addr 172.21.15.45:0/965423652 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:55.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04ef59e640 1 --2- 172.21.15.45:0/965423652 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04f00712c0 0x7f04f00b99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:55.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04eed9d640 1 --2- 172.21.15.45:0/965423652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f006c760 0x7f04f0142d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:55.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04ee59c640 1 -- 172.21.15.45:0/965423652 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04f00712c0 msgr2=0x7f04f00b99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:55.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04ee59c640 1 --2- 172.21.15.45:0/965423652 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04f00712c0 0x7f04f00b99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04ee59c640 1 -- 172.21.15.45:0/965423652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f006c760 msgr2=0x7f04f0142d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:55.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04ee59c640 1 --2- 172.21.15.45:0/965423652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f006c760 0x7f04f0142d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04ee59c640 1 -- 172.21.15.45:0/965423652 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e8009b30 con 0x7f04f006d560 2023-10-03T19:12:55.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04ee59c640 1 --2- 172.21.15.45:0/965423652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04f006d560 0x7f04f0070a40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f04e400c420 tx=0x7f04e400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:55.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04d77fe640 1 -- 172.21.15.45:0/965423652 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e40052d0 con 0x7f04f006d560 2023-10-03T19:12:55.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04d77fe640 1 -- 172.21.15.45:0/965423652 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e4005430 con 0x7f04f006d560 2023-10-03T19:12:55.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04f51fb640 1 -- 172.21.15.45:0/965423652 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f00a6070 con 0x7f04f006d560 2023-10-03T19:12:55.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04d77fe640 1 -- 172.21.15.45:0/965423652 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e4007260 con 0x7f04f006d560 2023-10-03T19:12:55.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.244+0000 7f04f51fb640 1 -- 172.21.15.45:0/965423652 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f00a5ee0 con 0x7f04f006d560 2023-10-03T19:12:55.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.248+0000 7f04f51fb640 1 -- 172.21.15.45:0/965423652 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f01596f0 con 0x7f04f006d560 2023-10-03T19:12:55.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.248+0000 7f04d77fe640 1 -- 172.21.15.45:0/965423652 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f04e40073c0 con 0x7f04f006d560 2023-10-03T19:12:55.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.248+0000 7f04d77fe640 1 --2- 172.21.15.45:0/965423652 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f04dc066280 0x7f04dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:55.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.248+0000 7f04d77fe640 1 -- 172.21.15.45:0/965423652 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f04e4083170 con 0x7f04f006d560 2023-10-03T19:12:55.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.248+0000 7f04eed9d640 1 --2- 172.21.15.45:0/965423652 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f04dc066280 0x7f04dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:55.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.248+0000 7f04eed9d640 1 --2- 172.21.15.45:0/965423652 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f04dc066280 0x7f04dc068730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f04e00096f0 tx=0x7f04e0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:55.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.252+0000 7f04d77fe640 1 -- 172.21.15.45:0/965423652 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f04e40505f0 con 0x7f04f006d560 2023-10-03T19:12:55.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.404+0000 7f04f51fb640 1 -- 172.21.15.45:0/965423652 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f04f00bca30 con 0x7f04f006d560 2023-10-03T19:12:55.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.404+0000 7f04d77fe640 1 -- 172.21.15.45:0/965423652 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f04e4053c10 con 0x7f04f006d560 2023-10-03T19:12:55.410 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-03T19:12:55.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.408+0000 7f04f51fb640 1 -- 172.21.15.45:0/965423652 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f04dc066280 msgr2=0x7f04dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:55.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.408+0000 7f04f51fb640 1 --2- 172.21.15.45:0/965423652 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f04dc066280 0x7f04dc068730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f04e00096f0 tx=0x7f04e0008040 comp rx=0 tx=0).stop 2023-10-03T19:12:55.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.408+0000 7f04f51fb640 1 -- 172.21.15.45:0/965423652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04f006d560 msgr2=0x7f04f0070a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:55.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.408+0000 7f04f51fb640 1 --2- 172.21.15.45:0/965423652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04f006d560 0x7f04f0070a40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f04e400c420 tx=0x7f04e400c8e0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.408+0000 7f04f51fb640 1 -- 172.21.15.45:0/965423652 shutdown_connections 2023-10-03T19:12:55.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.408+0000 7f04f51fb640 1 --2- 172.21.15.45:0/965423652 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f04dc066280 0x7f04dc068730 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.408+0000 7f04f51fb640 1 --2- 172.21.15.45:0/965423652 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04f00712c0 0x7f04f00b99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.408+0000 7f04f51fb640 1 --2- 172.21.15.45:0/965423652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04f006d560 0x7f04f0070a40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.408+0000 7f04f51fb640 1 --2- 172.21.15.45:0/965423652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f006c760 0x7f04f0142d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.408+0000 7f04f51fb640 1 -- 172.21.15.45:0/965423652 >> 172.21.15.45:0/965423652 conn(0x7f04f00a20d0 msgr2=0x7f04f00a3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:55.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.408+0000 7f04f51fb640 1 -- 172.21.15.45:0/965423652 shutdown_connections 2023-10-03T19:12:55.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.408+0000 7f04f51fb640 1 -- 172.21.15.45:0/965423652 wait complete. 2023-10-03T19:12:55.429 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T19:12:55.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.552+0000 7f0173488640 1 Processor -- start 2023-10-03T19:12:55.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.552+0000 7f0173488640 1 -- start start 2023-10-03T19:12:55.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.556+0000 7f0173488640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f016c0658f0 0x7f016c0bfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:55.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.556+0000 7f0173488640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f016c0bbf30 con 0x7f016c0a0d00 2023-10-03T19:12:55.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.556+0000 7f0173488640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f016c14d0a0 con 0x7f016c0c1040 2023-10-03T19:12:55.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.556+0000 7f0173488640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f016c0c0b80 con 0x7f016c0658f0 2023-10-03T19:12:55.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.556+0000 7f0171a25640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f016c0a0d00 0x7f016c149350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38626/0 (socket says 172.21.15.45:38626) 2023-10-03T19:12:55.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.556+0000 7f0171a25640 1 -- 172.21.15.45:0/1774425464 learned_addr learned my addr 172.21.15.45:0/1774425464 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:55.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.556+0000 7f0171224640 1 --2- 172.21.15.45:0/1774425464 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f016c0658f0 0x7f016c0bfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:55.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.556+0000 7f0163fff640 1 -- 172.21.15.45:0/1774425464 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1549296794 0 0) 0x7f016c0bbf30 con 0x7f016c0a0d00 2023-10-03T19:12:55.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.556+0000 7f0163fff640 1 -- 172.21.15.45:0/1774425464 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0158003530 con 0x7f016c0a0d00 2023-10-03T19:12:55.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.556+0000 7f0163fff640 1 -- 172.21.15.45:0/1774425464 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 630101495 0 0) 0x7f0158003530 con 0x7f016c0a0d00 2023-10-03T19:12:55.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.556+0000 7f0163fff640 1 -- 172.21.15.45:0/1774425464 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f016c0658f0 msgr2=0x7f016c0bfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:55.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.556+0000 7f0163fff640 1 --2- 172.21.15.45:0/1774425464 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f016c0658f0 0x7f016c0bfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.556+0000 7f0163fff640 1 -- 172.21.15.45:0/1774425464 >> v1:172.21.15.79:6789/0 conn(0x7f016c0c1040 legacy=0x7f016c0bf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:55.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.556+0000 7f0163fff640 1 -- 172.21.15.45:0/1774425464 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016c14d380 con 0x7f016c0a0d00 2023-10-03T19:12:55.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.556+0000 7f0163fff640 1 -- 172.21.15.45:0/1774425464 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f0164001a00 con 0x7f016c0a0d00 2023-10-03T19:12:55.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.556+0000 7f0163fff640 1 -- 172.21.15.45:0/1774425464 >> v1:172.21.15.45:6789/0 conn(0x7f016c0a0d00 legacy=0x7f016c149350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:55.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.556+0000 7f0163fff640 1 --2- 172.21.15.45:0/1774425464 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f016c0658f0 0x7f01580039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:55.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.556+0000 7f0163fff640 1 --2- 172.21.15.45:0/1774425464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0158003f30 0x7f01580047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:55.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.556+0000 7f0163fff640 1 --2- 172.21.15.45:0/1774425464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0158004d10 0x7f0158005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:55.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.556+0000 7f0163fff640 1 -- 172.21.15.45:0/1774425464 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016c0c0b80 con 0x7f0158003f30 2023-10-03T19:12:55.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.556+0000 7f0163fff640 1 -- 172.21.15.45:0/1774425464 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015800bb00 con 0x7f0158004d10 2023-10-03T19:12:55.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.556+0000 7f0163fff640 1 -- 172.21.15.45:0/1774425464 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015800bcc0 con 0x7f016c0658f0 2023-10-03T19:12:55.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.556+0000 7f0170a23640 1 --2- 172.21.15.45:0/1774425464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0158003f30 0x7f01580047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:55.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.556+0000 7f0171a25640 1 --2- 172.21.15.45:0/1774425464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0158004d10 0x7f0158005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:55.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.556+0000 7f0171224640 1 --2- 172.21.15.45:0/1774425464 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f016c0658f0 0x7f01580039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:55.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.556+0000 7f0170a23640 1 -- 172.21.15.45:0/1774425464 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f016c0658f0 msgr2=0x7f01580039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:55.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.556+0000 7f0170a23640 1 --2- 172.21.15.45:0/1774425464 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f016c0658f0 0x7f01580039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.556+0000 7f0170a23640 1 -- 172.21.15.45:0/1774425464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0158004d10 msgr2=0x7f0158005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:55.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.556+0000 7f0170a23640 1 --2- 172.21.15.45:0/1774425464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0158004d10 0x7f0158005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.556+0000 7f0170a23640 1 -- 172.21.15.45:0/1774425464 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0158003530 con 0x7f0158003f30 2023-10-03T19:12:55.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0170a23640 1 --2- 172.21.15.45:0/1774425464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0158003f30 0x7f01580047d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f016c0c1410 tx=0x7f015c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f0f67687c79fe6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:55.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0163fff640 1 -- 172.21.15.45:0/1774425464 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015c0052d0 con 0x7f0158003f30 2023-10-03T19:12:55.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0163fff640 1 -- 172.21.15.45:0/1774425464 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015c0a7050 con 0x7f0158003f30 2023-10-03T19:12:55.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0163fff640 1 -- 172.21.15.45:0/1774425464 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015c003600 con 0x7f0158003f30 2023-10-03T19:12:55.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0173488640 1 -- 172.21.15.45:0/1774425464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0158003f30 msgr2=0x7f01580047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:55.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0173488640 1 --2- 172.21.15.45:0/1774425464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0158003f30 0x7f01580047d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f016c0c1410 tx=0x7f015c01c3a0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0171a25640 1 -- 172.21.15.45:0/1774425464 reap_dead start 2023-10-03T19:12:55.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0173488640 1 -- 172.21.15.45:0/1774425464 shutdown_connections 2023-10-03T19:12:55.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0173488640 1 -- 172.21.15.45:0/1774425464 >> 172.21.15.45:0/1774425464 conn(0x7f016c0c1510 msgr2=0x7f016c0c1910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:55.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0173488640 1 -- 172.21.15.45:0/1774425464 shutdown_connections 2023-10-03T19:12:55.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0173488640 1 -- 172.21.15.45:0/1774425464 wait complete. 2023-10-03T19:12:55.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0173488640 1 Processor -- start 2023-10-03T19:12:55.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0173488640 1 -- start start 2023-10-03T19:12:55.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0173488640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0158003f30 0x7f016c0a47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:55.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0173488640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f016c14f320 0x7f016c1e7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:55.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0173488640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f016c1e7690 0x7f016c06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:55.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0173488640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016c14e090 con 0x7f016c1e7690 2023-10-03T19:12:55.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0173488640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016c0a4d30 con 0x7f0158003f30 2023-10-03T19:12:55.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0173488640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f016c14d7f0 con 0x7f016c14f320 2023-10-03T19:12:55.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0171a25640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f016c1e7690 0x7f016c06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:55.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0171a25640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f016c1e7690 0x7f016c06d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53972/0 (socket says 172.21.15.45:53972) 2023-10-03T19:12:55.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0171a25640 1 -- 172.21.15.45:0/4038854340 learned_addr learned my addr 172.21.15.45:0/4038854340 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:55.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0171224640 1 --2- 172.21.15.45:0/4038854340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0158003f30 0x7f016c0a47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:55.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0170a23640 1 --2- 172.21.15.45:0/4038854340 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f016c14f320 0x7f016c1e7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:55.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0171a25640 1 -- 172.21.15.45:0/4038854340 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f016c14f320 msgr2=0x7f016c1e7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:55.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0171a25640 1 --2- 172.21.15.45:0/4038854340 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f016c14f320 0x7f016c1e7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0171a25640 1 -- 172.21.15.45:0/4038854340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0158003f30 msgr2=0x7f016c0a47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:55.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0171a25640 1 --2- 172.21.15.45:0/4038854340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0158003f30 0x7f016c0a47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0171a25640 1 -- 172.21.15.45:0/4038854340 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016c065cc0 con 0x7f016c1e7690 2023-10-03T19:12:55.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0171a25640 1 --2- 172.21.15.45:0/4038854340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f016c1e7690 0x7f016c06d9e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f016c0bdc80 tx=0x7f0164007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:55.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0161ffb640 1 -- 172.21.15.45:0/4038854340 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0164010510 con 0x7f016c1e7690 2023-10-03T19:12:55.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0161ffb640 1 -- 172.21.15.45:0/4038854340 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0164010670 con 0x7f016c1e7690 2023-10-03T19:12:55.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0161ffb640 1 -- 172.21.15.45:0/4038854340 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0164010a20 con 0x7f016c1e7690 2023-10-03T19:12:55.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0173488640 1 -- 172.21.15.45:0/4038854340 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f016c0c0810 con 0x7f016c1e7690 2023-10-03T19:12:55.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.560+0000 7f0173488640 1 -- 172.21.15.45:0/4038854340 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f016c065e50 con 0x7f016c1e7690 2023-10-03T19:12:55.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.564+0000 7f0173488640 1 -- 172.21.15.45:0/4038854340 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f016c04de80 con 0x7f016c1e7690 2023-10-03T19:12:55.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.564+0000 7f0161ffb640 1 -- 172.21.15.45:0/4038854340 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0164010b80 con 0x7f016c1e7690 2023-10-03T19:12:55.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.564+0000 7f0161ffb640 1 --2- 172.21.15.45:0/4038854340 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f01500662b0 0x7f0150068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:55.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.564+0000 7f0161ffb640 1 -- 172.21.15.45:0/4038854340 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0164083680 con 0x7f016c1e7690 2023-10-03T19:12:55.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.564+0000 7f0171224640 1 --2- 172.21.15.45:0/4038854340 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f01500662b0 0x7f0150068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:55.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.564+0000 7f0171224640 1 --2- 172.21.15.45:0/4038854340 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f01500662b0 0x7f0150068760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0168009a30 tx=0x7f0168008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:55.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.568+0000 7f0161ffb640 1 -- 172.21.15.45:0/4038854340 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0164050a70 con 0x7f016c1e7690 2023-10-03T19:12:55.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.716+0000 7f0173488640 1 -- 172.21.15.45:0/4038854340 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f016c0c05d0 con 0x7f016c1e7690 2023-10-03T19:12:55.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.716+0000 7f0161ffb640 1 -- 172.21.15.45:0/4038854340 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0164019020 con 0x7f016c1e7690 2023-10-03T19:12:55.723 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-03T19:12:55.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.720+0000 7f0173488640 1 -- 172.21.15.45:0/4038854340 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f01500662b0 msgr2=0x7f0150068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:55.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.720+0000 7f0173488640 1 --2- 172.21.15.45:0/4038854340 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f01500662b0 0x7f0150068760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0168009a30 tx=0x7f0168008040 comp rx=0 tx=0).stop 2023-10-03T19:12:55.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.720+0000 7f0173488640 1 -- 172.21.15.45:0/4038854340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f016c1e7690 msgr2=0x7f016c06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:55.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.720+0000 7f0173488640 1 --2- 172.21.15.45:0/4038854340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f016c1e7690 0x7f016c06d9e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f016c0bdc80 tx=0x7f0164007a20 comp rx=0 tx=0).stop 2023-10-03T19:12:55.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.720+0000 7f0173488640 1 -- 172.21.15.45:0/4038854340 shutdown_connections 2023-10-03T19:12:55.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.720+0000 7f0173488640 1 --2- 172.21.15.45:0/4038854340 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f01500662b0 0x7f0150068760 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.720+0000 7f0173488640 1 --2- 172.21.15.45:0/4038854340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f016c1e7690 0x7f016c06d9e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.720+0000 7f0173488640 1 --2- 172.21.15.45:0/4038854340 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f016c14f320 0x7f016c1e7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.720+0000 7f0173488640 1 --2- 172.21.15.45:0/4038854340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0158003f30 0x7f016c0a47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.720+0000 7f0173488640 1 -- 172.21.15.45:0/4038854340 >> 172.21.15.45:0/4038854340 conn(0x7f016c0c1510 msgr2=0x7f016c0ba860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:55.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.720+0000 7f0173488640 1 -- 172.21.15.45:0/4038854340 shutdown_connections 2023-10-03T19:12:55.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.720+0000 7f0173488640 1 -- 172.21.15.45:0/4038854340 wait complete. 2023-10-03T19:12:55.741 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:12:55.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.852+0000 7fd15433d640 1 Processor -- start 2023-10-03T19:12:55.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.852+0000 7fd15433d640 1 -- start start 2023-10-03T19:12:55.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.856+0000 7fd15433d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd14c06f170 0x7fd14c150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:55.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.856+0000 7fd15433d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd14c0bc8b0 0x7fd14c14ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:55.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.856+0000 7fd15433d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd14c06d170 0x7fd14c14cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:55.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.856+0000 7fd15433d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd14c06cac0 con 0x7fd14c0bc8b0 2023-10-03T19:12:55.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.856+0000 7fd15433d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd14c14d4f0 con 0x7fd14c06f170 2023-10-03T19:12:55.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.856+0000 7fd15433d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c0720d0 con 0x7fd14c06d170 2023-10-03T19:12:55.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.856+0000 7fd1518d8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd14c0bc8b0 0x7fd14c14ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:55.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.856+0000 7fd1518d8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd14c0bc8b0 0x7fd14c14ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53978/0 (socket says 172.21.15.45:53978) 2023-10-03T19:12:55.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.856+0000 7fd1518d8640 1 -- 172.21.15.45:0/352807821 learned_addr learned my addr 172.21.15.45:0/352807821 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:55.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.856+0000 7fd1528da640 1 --2- 172.21.15.45:0/352807821 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd14c06d170 0x7fd14c14cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:55.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.856+0000 7fd1520d9640 1 --2- 172.21.15.45:0/352807821 >> v2:172.21.15.79:3300/0 conn(0x7fd14c06f170 0x7fd14c150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:55.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.856+0000 7fd1518d8640 1 -- 172.21.15.45:0/352807821 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd14c06d170 msgr2=0x7fd14c14cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:55.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.856+0000 7fd1518d8640 1 --2- 172.21.15.45:0/352807821 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd14c06d170 0x7fd14c14cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.856+0000 7fd1518d8640 1 -- 172.21.15.45:0/352807821 >> v2:172.21.15.79:3300/0 conn(0x7fd14c06f170 msgr2=0x7fd14c150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:55.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.856+0000 7fd1518d8640 1 --2- 172.21.15.45:0/352807821 >> v2:172.21.15.79:3300/0 conn(0x7fd14c06f170 0x7fd14c150190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.856+0000 7fd1518d8640 1 -- 172.21.15.45:0/352807821 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14c0a5ab0 con 0x7fd14c0bc8b0 2023-10-03T19:12:55.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.856+0000 7fd1528da640 1 --2- 172.21.15.45:0/352807821 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd14c06d170 0x7fd14c14cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:55.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.856+0000 7fd1518d8640 1 --2- 172.21.15.45:0/352807821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd14c0bc8b0 0x7fd14c14ca70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd14c0bdf90 tx=0x7fd13c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55210fe286b0dce4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:55.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.856+0000 7fd1510d7640 1 -- 172.21.15.45:0/352807821 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13c0a89b0 con 0x7fd14c0bc8b0 2023-10-03T19:12:55.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.856+0000 7fd1510d7640 1 -- 172.21.15.45:0/352807821 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13c0a8b10 con 0x7fd14c0bc8b0 2023-10-03T19:12:55.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.856+0000 7fd1510d7640 1 -- 172.21.15.45:0/352807821 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13c0a8ea0 con 0x7fd14c0bc8b0 2023-10-03T19:12:55.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.856+0000 7fd15433d640 1 -- 172.21.15.45:0/352807821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd14c0bc8b0 msgr2=0x7fd14c14ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:55.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.856+0000 7fd15433d640 1 --2- 172.21.15.45:0/352807821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd14c0bc8b0 0x7fd14c14ca70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd14c0bdf90 tx=0x7fd13c01ecf0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.856+0000 7fd15433d640 1 -- 172.21.15.45:0/352807821 shutdown_connections 2023-10-03T19:12:55.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.856+0000 7fd15433d640 1 --2- 172.21.15.45:0/352807821 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd14c06d170 0x7fd14c14cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.856+0000 7fd15433d640 1 --2- 172.21.15.45:0/352807821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd14c0bc8b0 0x7fd14c14ca70 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.856+0000 7fd15433d640 1 --2- 172.21.15.45:0/352807821 >> v2:172.21.15.79:3300/0 conn(0x7fd14c06f170 0x7fd14c150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.856+0000 7fd15433d640 1 -- 172.21.15.45:0/352807821 >> 172.21.15.45:0/352807821 conn(0x7fd14c0bcf50 msgr2=0x7fd14c0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:55.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.856+0000 7fd15433d640 1 -- 172.21.15.45:0/352807821 shutdown_connections 2023-10-03T19:12:55.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.856+0000 7fd15433d640 1 -- 172.21.15.45:0/352807821 wait complete. 2023-10-03T19:12:55.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.860+0000 7fd15433d640 1 Processor -- start 2023-10-03T19:12:55.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.860+0000 7fd15433d640 1 -- start start 2023-10-03T19:12:55.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.860+0000 7fd15433d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd14c06d170 0x7fd14c146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:55.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.860+0000 7fd15433d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd14c06f170 0x7fd14c0c02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:55.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.860+0000 7fd15433d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd14c0bc8b0 0x7fd14c0b9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:55.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.860+0000 7fd15433d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c148570 con 0x7fd14c06d170 2023-10-03T19:12:55.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.860+0000 7fd15433d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c0b9900 con 0x7fd14c06f170 2023-10-03T19:12:55.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.860+0000 7fd15433d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c0c07f0 con 0x7fd14c0bc8b0 2023-10-03T19:12:55.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.860+0000 7fd1520d9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd14c06d170 0x7fd14c146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:55.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.860+0000 7fd1520d9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd14c06d170 0x7fd14c146630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53984/0 (socket says 172.21.15.45:53984) 2023-10-03T19:12:55.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.860+0000 7fd1520d9640 1 -- 172.21.15.45:0/986091670 learned_addr learned my addr 172.21.15.45:0/986091670 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:55.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.860+0000 7fd1518d8640 1 --2- 172.21.15.45:0/986091670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd14c06f170 0x7fd14c0c02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:55.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.860+0000 7fd1528da640 1 --2- 172.21.15.45:0/986091670 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd14c0bc8b0 0x7fd14c0b9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:55.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.860+0000 7fd1520d9640 1 -- 172.21.15.45:0/986091670 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd14c0bc8b0 msgr2=0x7fd14c0b9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:55.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.860+0000 7fd1520d9640 1 --2- 172.21.15.45:0/986091670 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd14c0bc8b0 0x7fd14c0b9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.860+0000 7fd1520d9640 1 -- 172.21.15.45:0/986091670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd14c06f170 msgr2=0x7fd14c0c02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:55.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.860+0000 7fd1520d9640 1 --2- 172.21.15.45:0/986091670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd14c06f170 0x7fd14c0c02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:55.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.860+0000 7fd1520d9640 1 -- 172.21.15.45:0/986091670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13c0094d0 con 0x7fd14c06d170 2023-10-03T19:12:55.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.860+0000 7fd1518d8640 1 --2- 172.21.15.45:0/986091670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd14c06f170 0x7fd14c0c02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:55.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.860+0000 7fd1520d9640 1 --2- 172.21.15.45:0/986091670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd14c06d170 0x7fd14c146630 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd14800c7f0 tx=0x7fd14800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:55.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.860+0000 7fd142ffd640 1 -- 172.21.15.45:0/986091670 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd148007820 con 0x7fd14c06d170 2023-10-03T19:12:55.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.860+0000 7fd142ffd640 1 -- 172.21.15.45:0/986091670 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd148007980 con 0x7fd14c06d170 2023-10-03T19:12:55.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.860+0000 7fd15433d640 1 -- 172.21.15.45:0/986091670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd14c14fae0 con 0x7fd14c06d170 2023-10-03T19:12:55.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.860+0000 7fd142ffd640 1 -- 172.21.15.45:0/986091670 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd148007d30 con 0x7fd14c06d170 2023-10-03T19:12:55.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.860+0000 7fd15433d640 1 -- 172.21.15.45:0/986091670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd14c06cd00 con 0x7fd14c06d170 2023-10-03T19:12:55.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.860+0000 7fd15433d640 1 -- 172.21.15.45:0/986091670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd14c14c4a0 con 0x7fd14c06d170 2023-10-03T19:12:55.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.860+0000 7fd142ffd640 1 -- 172.21.15.45:0/986091670 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd1480113f0 con 0x7fd14c06d170 2023-10-03T19:12:55.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.864+0000 7fd142ffd640 1 --2- 172.21.15.45:0/986091670 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd1300662b0 0x7fd130068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:55.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.864+0000 7fd142ffd640 1 -- 172.21.15.45:0/986091670 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd148083c90 con 0x7fd14c06d170 2023-10-03T19:12:55.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.864+0000 7fd1518d8640 1 --2- 172.21.15.45:0/986091670 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd1300662b0 0x7fd130068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:55.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.864+0000 7fd1518d8640 1 --2- 172.21.15.45:0/986091670 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd1300662b0 0x7fd130068760 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd13c0b2000 tx=0x7fd13c0aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:55.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:55.868+0000 7fd142ffd640 1 -- 172.21.15.45:0/986091670 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd1480511a0 con 0x7fd14c06d170 2023-10-03T19:12:56.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.016+0000 7fd15433d640 1 -- 172.21.15.45:0/986091670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd14c06d660 con 0x7fd14c06d170 2023-10-03T19:12:56.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.016+0000 7fd142ffd640 1 -- 172.21.15.45:0/986091670 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18231 (secure 0 0 0) 0x7fd14801f090 con 0x7fd14c06d170 2023-10-03T19:12:56.023 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:56.023 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:12:28.941467+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:12:26.226431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T19:12:26.923174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:12:56.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.020+0000 7fd15433d640 1 -- 172.21.15.45:0/986091670 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd1300662b0 msgr2=0x7fd130068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:56.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.020+0000 7fd15433d640 1 --2- 172.21.15.45:0/986091670 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd1300662b0 0x7fd130068760 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd13c0b2000 tx=0x7fd13c0aa070 comp rx=0 tx=0).stop 2023-10-03T19:12:56.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.020+0000 7fd15433d640 1 -- 172.21.15.45:0/986091670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd14c06d170 msgr2=0x7fd14c146630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:56.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.020+0000 7fd15433d640 1 --2- 172.21.15.45:0/986091670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd14c06d170 0x7fd14c146630 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd14800c7f0 tx=0x7fd14800ccb0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.020+0000 7fd15433d640 1 -- 172.21.15.45:0/986091670 shutdown_connections 2023-10-03T19:12:56.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.020+0000 7fd15433d640 1 --2- 172.21.15.45:0/986091670 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd1300662b0 0x7fd130068760 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.020+0000 7fd15433d640 1 --2- 172.21.15.45:0/986091670 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd14c0bc8b0 0x7fd14c0b9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.020+0000 7fd15433d640 1 --2- 172.21.15.45:0/986091670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd14c06f170 0x7fd14c0c02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.020+0000 7fd15433d640 1 --2- 172.21.15.45:0/986091670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd14c06d170 0x7fd14c146630 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.020+0000 7fd15433d640 1 -- 172.21.15.45:0/986091670 >> 172.21.15.45:0/986091670 conn(0x7fd14c0bcf50 msgr2=0x7fd14c0bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:56.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.020+0000 7fd15433d640 1 -- 172.21.15.45:0/986091670 shutdown_connections 2023-10-03T19:12:56.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.020+0000 7fd15433d640 1 -- 172.21.15.45:0/986091670 wait complete. 2023-10-03T19:12:56.040 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T19:12:26.226431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T19:12:26.923174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:12:56.041 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:12:56.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b9504640 1 Processor -- start 2023-10-03T19:12:56.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b9504640 1 -- start start 2023-10-03T19:12:56.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b9504640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f84b406d560 0x7f84b40a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:56.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b9504640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b406c2d0 con 0x7f84b40712c0 2023-10-03T19:12:56.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b9504640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b4150610 con 0x7f84b406c760 2023-10-03T19:12:56.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b9504640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b41508b0 con 0x7f84b406d560 2023-10-03T19:12:56.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b2ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f84b40712c0 0x7f84b40bcbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38636/0 (socket says 172.21.15.45:38636) 2023-10-03T19:12:56.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b2ffd640 1 -- 172.21.15.45:0/1587020396 learned_addr learned my addr 172.21.15.45:0/1587020396 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:56.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b27fc640 1 --2- 172.21.15.45:0/1587020396 >> v2:172.21.15.79:3300/0 conn(0x7f84b406d560 0x7f84b40a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:56.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b1ffb640 1 -- 172.21.15.45:0/1587020396 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3892393153 0 0) 0x7f84b406c2d0 con 0x7f84b40712c0 2023-10-03T19:12:56.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b1ffb640 1 -- 172.21.15.45:0/1587020396 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f849c003530 con 0x7f84b40712c0 2023-10-03T19:12:56.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b1ffb640 1 -- 172.21.15.45:0/1587020396 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2398716516 0 0) 0x7f849c003530 con 0x7f84b40712c0 2023-10-03T19:12:56.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b1ffb640 1 -- 172.21.15.45:0/1587020396 >> v2:172.21.15.79:3300/0 conn(0x7f84b406d560 msgr2=0x7f84b40a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:56.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b1ffb640 1 --2- 172.21.15.45:0/1587020396 >> v2:172.21.15.79:3300/0 conn(0x7f84b406d560 0x7f84b40a53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b1ffb640 1 -- 172.21.15.45:0/1587020396 >> v1:172.21.15.79:6789/0 conn(0x7f84b406c760 legacy=0x7f84b40a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:56.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b1ffb640 1 -- 172.21.15.45:0/1587020396 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b406d2e0 con 0x7f84b40712c0 2023-10-03T19:12:56.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b1ffb640 1 -- 172.21.15.45:0/1587020396 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f84a4001680 con 0x7f84b40712c0 2023-10-03T19:12:56.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b1ffb640 1 -- 172.21.15.45:0/1587020396 >> v1:172.21.15.45:6789/0 conn(0x7f84b40712c0 legacy=0x7f84b40bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:56.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b1ffb640 1 --2- 172.21.15.45:0/1587020396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f849c003980 0x7f849c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:56.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b1ffb640 1 --2- 172.21.15.45:0/1587020396 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f849c0047d0 0x7f849c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:56.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b1ffb640 1 --2- 172.21.15.45:0/1587020396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f849c005180 0x7f849c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:56.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b1ffb640 1 -- 172.21.15.45:0/1587020396 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b41508b0 con 0x7f849c005180 2023-10-03T19:12:56.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b1ffb640 1 -- 172.21.15.45:0/1587020396 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849c00c000 con 0x7f849c003980 2023-10-03T19:12:56.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b1ffb640 1 -- 172.21.15.45:0/1587020396 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849c00c1c0 con 0x7f849c0047d0 2023-10-03T19:12:56.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b37fe640 1 --2- 172.21.15.45:0/1587020396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f849c005180 0x7f849c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:56.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b2ffd640 1 --2- 172.21.15.45:0/1587020396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f849c003980 0x7f849c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:56.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b27fc640 1 --2- 172.21.15.45:0/1587020396 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f849c0047d0 0x7f849c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:56.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b37fe640 1 -- 172.21.15.45:0/1587020396 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f849c0047d0 msgr2=0x7f849c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:56.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b37fe640 1 --2- 172.21.15.45:0/1587020396 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f849c0047d0 0x7f849c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b37fe640 1 -- 172.21.15.45:0/1587020396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f849c003980 msgr2=0x7f849c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:56.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b37fe640 1 --2- 172.21.15.45:0/1587020396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f849c003980 0x7f849c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b37fe640 1 -- 172.21.15.45:0/1587020396 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849c003530 con 0x7f849c005180 2023-10-03T19:12:56.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.156+0000 7f84b2ffd640 1 --2- 172.21.15.45:0/1587020396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f849c003980 0x7f849c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:56.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.160+0000 7f84b37fe640 1 -- 172.21.15.45:0/1587020396 reap_dead start 2023-10-03T19:12:56.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.160+0000 7f84b37fe640 1 --2- 172.21.15.45:0/1587020396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f849c005180 0x7f849c00b990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f84ac001e40 tx=0x7f84ac01c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aacc7add01fd5745 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:56.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.160+0000 7f84b1ffb640 1 -- 172.21.15.45:0/1587020396 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac003b80 con 0x7f849c005180 2023-10-03T19:12:56.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.160+0000 7f84b1ffb640 1 -- 172.21.15.45:0/1587020396 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ac003ce0 con 0x7f849c005180 2023-10-03T19:12:56.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.160+0000 7f84b1ffb640 1 -- 172.21.15.45:0/1587020396 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac005260 con 0x7f849c005180 2023-10-03T19:12:56.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.160+0000 7f84b9504640 1 -- 172.21.15.45:0/1587020396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f849c005180 msgr2=0x7f849c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:56.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.160+0000 7f84b9504640 1 --2- 172.21.15.45:0/1587020396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f849c005180 0x7f849c00b990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f84ac001e40 tx=0x7f84ac01c740 comp rx=0 tx=0).stop 2023-10-03T19:12:56.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.160+0000 7f84b9504640 1 -- 172.21.15.45:0/1587020396 shutdown_connections 2023-10-03T19:12:56.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.160+0000 7f84b9504640 1 --2- 172.21.15.45:0/1587020396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f849c005180 0x7f849c00b990 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.160+0000 7f84b9504640 1 -- 172.21.15.45:0/1587020396 >> 172.21.15.45:0/1587020396 conn(0x7f84b40a20d0 msgr2=0x7f84b40a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:56.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.160+0000 7f84b9504640 1 -- 172.21.15.45:0/1587020396 shutdown_connections 2023-10-03T19:12:56.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.160+0000 7f84b9504640 1 -- 172.21.15.45:0/1587020396 wait complete. 2023-10-03T19:12:56.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.160+0000 7f84b9504640 1 Processor -- start 2023-10-03T19:12:56.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.160+0000 7f84b9504640 1 -- start start 2023-10-03T19:12:56.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.160+0000 7f84b9504640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f849c005180 0x7f84b4141cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:56.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.160+0000 7f84b9504640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84b40b5ec0 0x7f84b41e4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:56.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.160+0000 7f84b9504640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84b41e2960 0x7f84b413e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.160+0000 7f84b9504640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b4141280 con 0x7f84b41e2960 2023-10-03T19:12:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.160+0000 7f84b9504640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b41e5580 con 0x7f849c005180 2023-10-03T19:12:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.160+0000 7f84b9504640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b41414d0 con 0x7f84b40b5ec0 2023-10-03T19:12:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.160+0000 7f84b37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84b41e2960 0x7f84b413e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.160+0000 7f84b37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84b41e2960 0x7f84b413e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54000/0 (socket says 172.21.15.45:54000) 2023-10-03T19:12:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.160+0000 7f84b37fe640 1 -- 172.21.15.45:0/249188192 learned_addr learned my addr 172.21.15.45:0/249188192 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.160+0000 7f84b2ffd640 1 --2- 172.21.15.45:0/249188192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f849c005180 0x7f84b4141cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.160+0000 7f84b27fc640 1 --2- 172.21.15.45:0/249188192 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84b40b5ec0 0x7f84b41e4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.160+0000 7f84b37fe640 1 -- 172.21.15.45:0/249188192 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84b40b5ec0 msgr2=0x7f84b41e4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.160+0000 7f84b37fe640 1 --2- 172.21.15.45:0/249188192 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84b40b5ec0 0x7f84b41e4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.164+0000 7f84b37fe640 1 -- 172.21.15.45:0/249188192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f849c005180 msgr2=0x7f84b4141cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.164+0000 7f84b37fe640 1 --2- 172.21.15.45:0/249188192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f849c005180 0x7f84b4141cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.164+0000 7f84b37fe640 1 -- 172.21.15.45:0/249188192 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b4071690 con 0x7f84b41e2960 2023-10-03T19:12:56.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.164+0000 7f84b37fe640 1 --2- 172.21.15.45:0/249188192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84b41e2960 0x7f84b413e630 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f84ac01cfe0 tx=0x7f849c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:56.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.164+0000 7f849b7fe640 1 -- 172.21.15.45:0/249188192 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac005220 con 0x7f84b41e2960 2023-10-03T19:12:56.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.164+0000 7f849b7fe640 1 -- 172.21.15.45:0/249188192 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ac005380 con 0x7f84b41e2960 2023-10-03T19:12:56.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.164+0000 7f84b9504640 1 -- 172.21.15.45:0/249188192 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b406cf40 con 0x7f84b41e2960 2023-10-03T19:12:56.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.164+0000 7f849b7fe640 1 -- 172.21.15.45:0/249188192 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac005730 con 0x7f84b41e2960 2023-10-03T19:12:56.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.164+0000 7f84b9504640 1 -- 172.21.15.45:0/249188192 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b4071820 con 0x7f84b41e2960 2023-10-03T19:12:56.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.164+0000 7f84b9504640 1 -- 172.21.15.45:0/249188192 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b41419b0 con 0x7f84b41e2960 2023-10-03T19:12:56.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.164+0000 7f849b7fe640 1 -- 172.21.15.45:0/249188192 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f84ac0ba460 con 0x7f84b41e2960 2023-10-03T19:12:56.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.164+0000 7f849b7fe640 1 --2- 172.21.15.45:0/249188192 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f84a00662b0 0x7f84a0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:56.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.164+0000 7f849b7fe640 1 -- 172.21.15.45:0/249188192 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f84ac11d3b0 con 0x7f84b41e2960 2023-10-03T19:12:56.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.164+0000 7f84b2ffd640 1 --2- 172.21.15.45:0/249188192 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f84a00662b0 0x7f84a0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:56.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.164+0000 7f84b2ffd640 1 --2- 172.21.15.45:0/249188192 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f84a00662b0 0x7f84a0068760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f84a40018f0 tx=0x7f84a4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:56.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.168+0000 7f849b7fe640 1 -- 172.21.15.45:0/249188192 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f84ac0ea840 con 0x7f84b41e2960 2023-10-03T19:12:56.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.316+0000 7f84b9504640 1 -- 172.21.15.45:0/249188192 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f84b404de80 con 0x7f84b41e2960 2023-10-03T19:12:56.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.316+0000 7f849b7fe640 1 -- 172.21.15.45:0/249188192 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f84ac0ede60 con 0x7f84b41e2960 2023-10-03T19:12:56.323 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:12:56.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.320+0000 7f84b9504640 1 -- 172.21.15.45:0/249188192 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f84a00662b0 msgr2=0x7f84a0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:56.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.320+0000 7f84b9504640 1 --2- 172.21.15.45:0/249188192 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f84a00662b0 0x7f84a0068760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f84a40018f0 tx=0x7f84a4009040 comp rx=0 tx=0).stop 2023-10-03T19:12:56.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.320+0000 7f84b9504640 1 -- 172.21.15.45:0/249188192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84b41e2960 msgr2=0x7f84b413e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:56.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.320+0000 7f84b9504640 1 --2- 172.21.15.45:0/249188192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84b41e2960 0x7f84b413e630 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f84ac01cfe0 tx=0x7f849c005800 comp rx=0 tx=0).stop 2023-10-03T19:12:56.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.320+0000 7f84b9504640 1 -- 172.21.15.45:0/249188192 shutdown_connections 2023-10-03T19:12:56.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.320+0000 7f84b9504640 1 --2- 172.21.15.45:0/249188192 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f84a00662b0 0x7f84a0068760 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.320+0000 7f84b9504640 1 --2- 172.21.15.45:0/249188192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84b41e2960 0x7f84b413e630 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.320+0000 7f84b9504640 1 --2- 172.21.15.45:0/249188192 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84b40b5ec0 0x7f84b41e4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.320+0000 7f84b9504640 1 --2- 172.21.15.45:0/249188192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f849c005180 0x7f84b4141cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.320+0000 7f84b9504640 1 -- 172.21.15.45:0/249188192 >> 172.21.15.45:0/249188192 conn(0x7f84b40a20d0 msgr2=0x7f84b40c0440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:56.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.320+0000 7f84b9504640 1 -- 172.21.15.45:0/249188192 shutdown_connections 2023-10-03T19:12:56.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.320+0000 7f84b9504640 1 -- 172.21.15.45:0/249188192 wait complete. 2023-10-03T19:12:56.340 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:12:56.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.460+0000 7fbba1700640 1 Processor -- start 2023-10-03T19:12:56.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.460+0000 7fbba1700640 1 -- start start 2023-10-03T19:12:56.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.464+0000 7fbba1700640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbb9c0712c0 0x7fbb9c0bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:56.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.464+0000 7fbba1700640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb9c06c760 0x7fbb9c0bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:56.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.464+0000 7fbba1700640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb9c06c2d0 con 0x7fbb9c06d560 2023-10-03T19:12:56.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.464+0000 7fbba1700640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb9c150610 con 0x7fbb9c0712c0 2023-10-03T19:12:56.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.464+0000 7fbba1700640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c1508b0 con 0x7fbb9c06c760 2023-10-03T19:12:56.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.464+0000 7fbb9affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbb9c0712c0 0x7fbb9c0bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:56.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.464+0000 7fbb9affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbb9c0712c0 0x7fbb9c0bcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54006/0 (socket says 172.21.15.45:54006) 2023-10-03T19:12:56.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.464+0000 7fbb9affd640 1 -- 172.21.15.45:0/2001855313 learned_addr learned my addr 172.21.15.45:0/2001855313 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:56.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.464+0000 7fbb9b7fe640 1 --2- 172.21.15.45:0/2001855313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb9c06c760 0x7fbb9c0bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:56.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.464+0000 7fbb9affd640 1 -- 172.21.15.45:0/2001855313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb9c06c760 msgr2=0x7fbb9c0bd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:56.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.464+0000 7fbb9affd640 1 --2- 172.21.15.45:0/2001855313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb9c06c760 0x7fbb9c0bd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.464+0000 7fbb9affd640 1 -- 172.21.15.45:0/2001855313 >> v1:172.21.15.79:6789/0 conn(0x7fbb9c06d560 legacy=0x7fbb9c0a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:56.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.464+0000 7fbb9affd640 1 -- 172.21.15.45:0/2001855313 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9c06d2e0 con 0x7fbb9c0712c0 2023-10-03T19:12:56.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.464+0000 7fbb9affd640 1 --2- 172.21.15.45:0/2001855313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c0712c0 0x7fbb9c0bcbc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c009870 tx=0x7fbb8c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1badb5fd6457b1d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:56.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.464+0000 7fbb99ffb640 1 -- 172.21.15.45:0/2001855313 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c0ab680 con 0x7fbb9c0712c0 2023-10-03T19:12:56.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.464+0000 7fbb99ffb640 1 -- 172.21.15.45:0/2001855313 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8c0ab7e0 con 0x7fbb9c0712c0 2023-10-03T19:12:56.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.464+0000 7fbb99ffb640 1 -- 172.21.15.45:0/2001855313 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c0abb70 con 0x7fbb9c0712c0 2023-10-03T19:12:56.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbba1700640 1 -- 172.21.15.45:0/2001855313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c0712c0 msgr2=0x7fbb9c0bcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:56.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbba1700640 1 --2- 172.21.15.45:0/2001855313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c0712c0 0x7fbb9c0bcbc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c009870 tx=0x7fbb8c01c540 comp rx=0 tx=0).stop 2023-10-03T19:12:56.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbba1700640 1 -- 172.21.15.45:0/2001855313 shutdown_connections 2023-10-03T19:12:56.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbba1700640 1 --2- 172.21.15.45:0/2001855313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb9c06c760 0x7fbb9c0bd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbba1700640 1 --2- 172.21.15.45:0/2001855313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c0712c0 0x7fbb9c0bcbc0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbba1700640 1 -- 172.21.15.45:0/2001855313 >> 172.21.15.45:0/2001855313 conn(0x7fbb9c0a20d0 msgr2=0x7fbb9c0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:56.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbba1700640 1 -- 172.21.15.45:0/2001855313 shutdown_connections 2023-10-03T19:12:56.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbba1700640 1 -- 172.21.15.45:0/2001855313 wait complete. 2023-10-03T19:12:56.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbba1700640 1 Processor -- start 2023-10-03T19:12:56.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbba1700640 1 -- start start 2023-10-03T19:12:56.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbba1700640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb9c06c760 0x7fbb9c0b99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:56.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbba1700640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c06d560 0x7fbb9c14d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:56.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbba1700640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb9c0712c0 0x7fbb9c1456a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:56.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbba1700640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c14d040 con 0x7fbb9c06d560 2023-10-03T19:12:56.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbba1700640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c06eef0 con 0x7fbb9c0712c0 2023-10-03T19:12:56.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbba1700640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c0b9ef0 con 0x7fbb9c06c760 2023-10-03T19:12:56.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbb9a7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c06d560 0x7fbb9c14d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:56.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbb9a7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c06d560 0x7fbb9c14d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54008/0 (socket says 172.21.15.45:54008) 2023-10-03T19:12:56.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbb9a7fc640 1 -- 172.21.15.45:0/2697225388 learned_addr learned my addr 172.21.15.45:0/2697225388 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:56.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbb9affd640 1 --2- 172.21.15.45:0/2697225388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb9c06c760 0x7fbb9c0b99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:56.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbb9b7fe640 1 --2- 172.21.15.45:0/2697225388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb9c0712c0 0x7fbb9c1456a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:56.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbb9a7fc640 1 -- 172.21.15.45:0/2697225388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb9c06c760 msgr2=0x7fbb9c0b99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:56.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbb9a7fc640 1 --2- 172.21.15.45:0/2697225388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb9c06c760 0x7fbb9c0b99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbb9a7fc640 1 -- 172.21.15.45:0/2697225388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb9c0712c0 msgr2=0x7fbb9c1456a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:56.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbb9a7fc640 1 --2- 172.21.15.45:0/2697225388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb9c0712c0 0x7fbb9c1456a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbb9a7fc640 1 -- 172.21.15.45:0/2697225388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8c0094d0 con 0x7fbb9c06d560 2023-10-03T19:12:56.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbb9b7fe640 1 --2- 172.21.15.45:0/2697225388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb9c0712c0 0x7fbb9c1456a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:12:56.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbb9a7fc640 1 --2- 172.21.15.45:0/2697225388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c06d560 0x7fbb9c14d810 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbb9000c3f0 tx=0x7fbb9000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:56.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbb837fe640 1 -- 172.21.15.45:0/2697225388 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb900052d0 con 0x7fbb9c06d560 2023-10-03T19:12:56.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbb837fe640 1 -- 172.21.15.45:0/2697225388 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb90005430 con 0x7fbb9c06d560 2023-10-03T19:12:56.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbba1700640 1 -- 172.21.15.45:0/2697225388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb9c0a6070 con 0x7fbb9c06d560 2023-10-03T19:12:56.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbb837fe640 1 -- 172.21.15.45:0/2697225388 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb90003840 con 0x7fbb9c06d560 2023-10-03T19:12:56.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.468+0000 7fbba1700640 1 -- 172.21.15.45:0/2697225388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb9c0a5ee0 con 0x7fbb9c06d560 2023-10-03T19:12:56.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.472+0000 7fbba1700640 1 -- 172.21.15.45:0/2697225388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb9c1596f0 con 0x7fbb9c06d560 2023-10-03T19:12:56.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.472+0000 7fbb837fe640 1 -- 172.21.15.45:0/2697225388 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbb900039a0 con 0x7fbb9c06d560 2023-10-03T19:12:56.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.472+0000 7fbb837fe640 1 --2- 172.21.15.45:0/2697225388 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbb88066280 0x7fbb88068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:56.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.472+0000 7fbb837fe640 1 -- 172.21.15.45:0/2697225388 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbb90083300 con 0x7fbb9c06d560 2023-10-03T19:12:56.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.472+0000 7fbb9affd640 1 --2- 172.21.15.45:0/2697225388 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbb88066280 0x7fbb88068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:56.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.472+0000 7fbb9affd640 1 --2- 172.21.15.45:0/2697225388 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbb88066280 0x7fbb88068730 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0af000 tx=0x7fbb8c0a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:56.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.476+0000 7fbb837fe640 1 -- 172.21.15.45:0/2697225388 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbb90050780 con 0x7fbb9c06d560 2023-10-03T19:12:56.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.624+0000 7fbba1700640 1 -- 172.21.15.45:0/2697225388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbb9c06f0c0 con 0x7fbb9c06d560 2023-10-03T19:12:56.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.624+0000 7fbb837fe640 1 -- 172.21.15.45:0/2697225388 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbb9c06f0c0 con 0x7fbb9c06d560 2023-10-03T19:12:56.631 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:12:56.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.628+0000 7fbba1700640 1 -- 172.21.15.45:0/2697225388 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbb88066280 msgr2=0x7fbb88068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:56.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.628+0000 7fbba1700640 1 --2- 172.21.15.45:0/2697225388 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbb88066280 0x7fbb88068730 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0af000 tx=0x7fbb8c0a7000 comp rx=0 tx=0).stop 2023-10-03T19:12:56.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.628+0000 7fbba1700640 1 -- 172.21.15.45:0/2697225388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c06d560 msgr2=0x7fbb9c14d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:56.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.628+0000 7fbba1700640 1 --2- 172.21.15.45:0/2697225388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c06d560 0x7fbb9c14d810 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbb9000c3f0 tx=0x7fbb9000c8b0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.628+0000 7fbba1700640 1 -- 172.21.15.45:0/2697225388 shutdown_connections 2023-10-03T19:12:56.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.628+0000 7fbba1700640 1 --2- 172.21.15.45:0/2697225388 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbb88066280 0x7fbb88068730 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.628+0000 7fbba1700640 1 --2- 172.21.15.45:0/2697225388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb9c0712c0 0x7fbb9c1456a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.628+0000 7fbba1700640 1 --2- 172.21.15.45:0/2697225388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c06d560 0x7fbb9c14d810 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.628+0000 7fbba1700640 1 --2- 172.21.15.45:0/2697225388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb9c06c760 0x7fbb9c0b99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.628+0000 7fbba1700640 1 -- 172.21.15.45:0/2697225388 >> 172.21.15.45:0/2697225388 conn(0x7fbb9c0a20d0 msgr2=0x7fbb9c0a51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:56.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.628+0000 7fbba1700640 1 -- 172.21.15.45:0/2697225388 shutdown_connections 2023-10-03T19:12:56.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.628+0000 7fbba1700640 1 -- 172.21.15.45:0/2697225388 wait complete. 2023-10-03T19:12:56.649 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T19:12:56.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.768+0000 7f0ab2b5c640 1 Processor -- start 2023-10-03T19:12:56.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.768+0000 7f0ab2b5c640 1 -- start start 2023-10-03T19:12:56.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.772+0000 7f0ab2b5c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0aac0baec0 0x7f0aac14f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:56.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.772+0000 7f0ab2b5c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0aac14b9b0 0x7f0aac14be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:56.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.772+0000 7f0ab2b5c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aac14f8d0 con 0x7f0aac06a440 2023-10-03T19:12:56.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.772+0000 7f0ab2b5c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aac14b560 con 0x7f0aac14b9b0 2023-10-03T19:12:56.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.772+0000 7f0ab2b5c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac14c370 con 0x7f0aac0baec0 2023-10-03T19:12:56.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.772+0000 7f0ab10f9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0aac14b9b0 0x7f0aac14be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:56.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.772+0000 7f0ab10f9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0aac14b9b0 0x7f0aac14be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54016/0 (socket says 172.21.15.45:54016) 2023-10-03T19:12:56.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.772+0000 7f0ab10f9640 1 -- 172.21.15.45:0/3629050127 learned_addr learned my addr 172.21.15.45:0/3629050127 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:56.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.772+0000 7f0aa3fff640 1 --2- 172.21.15.45:0/3629050127 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0aac0baec0 0x7f0aac14f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:56.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.772+0000 7f0ab10f9640 1 -- 172.21.15.45:0/3629050127 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0aac0baec0 msgr2=0x7f0aac14f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:56.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.772+0000 7f0ab10f9640 1 --2- 172.21.15.45:0/3629050127 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0aac0baec0 0x7f0aac14f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.772+0000 7f0ab10f9640 1 -- 172.21.15.45:0/3629050127 >> v1:172.21.15.79:6789/0 conn(0x7f0aac06a440 legacy=0x7f0aac148810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:56.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.772+0000 7f0ab10f9640 1 -- 172.21.15.45:0/3629050127 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aac070d30 con 0x7f0aac14b9b0 2023-10-03T19:12:56.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.772+0000 7f0aa3fff640 1 --2- 172.21.15.45:0/3629050127 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0aac0baec0 0x7f0aac14f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:56.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.772+0000 7f0ab10f9640 1 --2- 172.21.15.45:0/3629050127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0aac14b9b0 0x7f0aac14be30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0aac14fa60 tx=0x7f0aa401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d77a82d5fad842 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:56.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.772+0000 7f0aa37fe640 1 -- 172.21.15.45:0/3629050127 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa40a5710 con 0x7f0aac14b9b0 2023-10-03T19:12:56.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.772+0000 7f0aa37fe640 1 -- 172.21.15.45:0/3629050127 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa40a5870 con 0x7f0aac14b9b0 2023-10-03T19:12:56.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.772+0000 7f0aa37fe640 1 -- 172.21.15.45:0/3629050127 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa40a5c00 con 0x7f0aac14b9b0 2023-10-03T19:12:56.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0ab2b5c640 1 -- 172.21.15.45:0/3629050127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0aac14b9b0 msgr2=0x7f0aac14be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:56.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0ab2b5c640 1 --2- 172.21.15.45:0/3629050127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0aac14b9b0 0x7f0aac14be30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0aac14fa60 tx=0x7f0aa401c980 comp rx=0 tx=0).stop 2023-10-03T19:12:56.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0ab2b5c640 1 -- 172.21.15.45:0/3629050127 shutdown_connections 2023-10-03T19:12:56.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0ab2b5c640 1 --2- 172.21.15.45:0/3629050127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0aac14b9b0 0x7f0aac14be30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0ab2b5c640 1 --2- 172.21.15.45:0/3629050127 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0aac0baec0 0x7f0aac14f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0ab2b5c640 1 -- 172.21.15.45:0/3629050127 >> 172.21.15.45:0/3629050127 conn(0x7f0aac0be590 msgr2=0x7f0aac069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:56.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0ab2b5c640 1 -- 172.21.15.45:0/3629050127 shutdown_connections 2023-10-03T19:12:56.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0ab2b5c640 1 -- 172.21.15.45:0/3629050127 wait complete. 2023-10-03T19:12:56.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0ab2b5c640 1 Processor -- start 2023-10-03T19:12:56.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0ab2b5c640 1 -- start start 2023-10-03T19:12:56.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0ab2b5c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aac06a440 0x7f0aac1404e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:56.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0ab2b5c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0aac0baec0 0x7f0aac14a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:56.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0ab2b5c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0aac14b9b0 0x7f0aac13ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:56.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0ab2b5c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac14e8d0 con 0x7f0aac0baec0 2023-10-03T19:12:56.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0ab2b5c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac144d20 con 0x7f0aac06a440 2023-10-03T19:12:56.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0ab2b5c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac14aa20 con 0x7f0aac14b9b0 2023-10-03T19:12:56.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0aa3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0aac0baec0 0x7f0aac14a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:56.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0aa3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0aac0baec0 0x7f0aac14a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54026/0 (socket says 172.21.15.45:54026) 2023-10-03T19:12:56.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0aa3fff640 1 -- 172.21.15.45:0/444411625 learned_addr learned my addr 172.21.15.45:0/444411625 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:56.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0ab08f8640 1 --2- 172.21.15.45:0/444411625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aac06a440 0x7f0aac1404e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:56.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0ab10f9640 1 --2- 172.21.15.45:0/444411625 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0aac14b9b0 0x7f0aac13ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:56.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0aa3fff640 1 -- 172.21.15.45:0/444411625 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0aac14b9b0 msgr2=0x7f0aac13ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:56.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0aa3fff640 1 --2- 172.21.15.45:0/444411625 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0aac14b9b0 0x7f0aac13ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0aa3fff640 1 -- 172.21.15.45:0/444411625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aac06a440 msgr2=0x7f0aac1404e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:56.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0aa3fff640 1 --2- 172.21.15.45:0/444411625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aac06a440 0x7f0aac1404e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0aa3fff640 1 -- 172.21.15.45:0/444411625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa4009b30 con 0x7f0aac0baec0 2023-10-03T19:12:56.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0ab10f9640 1 --2- 172.21.15.45:0/444411625 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0aac14b9b0 0x7f0aac13ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:56.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0aa3fff640 1 --2- 172.21.15.45:0/444411625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0aac0baec0 0x7f0aac14a4e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00c7c0 tx=0x7f0a9c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:56.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0aa17fa640 1 -- 172.21.15.45:0/444411625 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c007a30 con 0x7f0aac0baec0 2023-10-03T19:12:56.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0aa17fa640 1 -- 172.21.15.45:0/444411625 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9c007b90 con 0x7f0aac0baec0 2023-10-03T19:12:56.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0aa17fa640 1 -- 172.21.15.45:0/444411625 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c00ce70 con 0x7f0aac0baec0 2023-10-03T19:12:56.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0ab2b5c640 1 -- 172.21.15.45:0/444411625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aac06bec0 con 0x7f0aac0baec0 2023-10-03T19:12:56.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.776+0000 7f0ab2b5c640 1 -- 172.21.15.45:0/444411625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aac148f20 con 0x7f0aac0baec0 2023-10-03T19:12:56.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.780+0000 7f0ab2b5c640 1 -- 172.21.15.45:0/444411625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aac14ea10 con 0x7f0aac0baec0 2023-10-03T19:12:56.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.780+0000 7f0aa17fa640 1 -- 172.21.15.45:0/444411625 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0a9c0113f0 con 0x7f0aac0baec0 2023-10-03T19:12:56.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.780+0000 7f0aa17fa640 1 --2- 172.21.15.45:0/444411625 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0a98066280 0x7f0a98068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:56.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.780+0000 7f0aa17fa640 1 -- 172.21.15.45:0/444411625 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0a9c084140 con 0x7f0aac0baec0 2023-10-03T19:12:56.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.780+0000 7f0ab08f8640 1 --2- 172.21.15.45:0/444411625 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0a98066280 0x7f0a98068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:56.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.780+0000 7f0ab08f8640 1 --2- 172.21.15.45:0/444411625 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0a98066280 0x7f0a98068730 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8004e30 tx=0x7f0aa8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:56.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.784+0000 7f0aa17fa640 1 -- 172.21.15.45:0/444411625 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0aac14ea10 con 0x7f0aac0baec0 2023-10-03T19:12:56.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.936+0000 7f0ab2b5c640 1 -- 172.21.15.45:0/444411625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0aac14ea10 con 0x7f0aac0baec0 2023-10-03T19:12:56.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.936+0000 7f0aa17fa640 1 -- 172.21.15.45:0/444411625 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0aac14ea10 con 0x7f0aac0baec0 2023-10-03T19:12:56.943 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-03T19:12:56.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.940+0000 7f0ab2b5c640 1 -- 172.21.15.45:0/444411625 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0a98066280 msgr2=0x7f0a98068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:56.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.940+0000 7f0ab2b5c640 1 --2- 172.21.15.45:0/444411625 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0a98066280 0x7f0a98068730 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8004e30 tx=0x7f0aa8009040 comp rx=0 tx=0).stop 2023-10-03T19:12:56.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.940+0000 7f0ab2b5c640 1 -- 172.21.15.45:0/444411625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0aac0baec0 msgr2=0x7f0aac14a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:56.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.940+0000 7f0ab2b5c640 1 --2- 172.21.15.45:0/444411625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0aac0baec0 0x7f0aac14a4e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00c7c0 tx=0x7f0a9c00cc80 comp rx=0 tx=0).stop 2023-10-03T19:12:56.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.940+0000 7f0ab2b5c640 1 -- 172.21.15.45:0/444411625 shutdown_connections 2023-10-03T19:12:56.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.940+0000 7f0ab2b5c640 1 --2- 172.21.15.45:0/444411625 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0a98066280 0x7f0a98068730 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.940+0000 7f0ab2b5c640 1 --2- 172.21.15.45:0/444411625 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0aac14b9b0 0x7f0aac13ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.940+0000 7f0ab2b5c640 1 --2- 172.21.15.45:0/444411625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0aac0baec0 0x7f0aac14a4e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.940+0000 7f0ab2b5c640 1 --2- 172.21.15.45:0/444411625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aac06a440 0x7f0aac1404e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:56.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.940+0000 7f0ab2b5c640 1 -- 172.21.15.45:0/444411625 >> 172.21.15.45:0/444411625 conn(0x7f0aac0be590 msgr2=0x7f0aac0bd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:56.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.940+0000 7f0ab2b5c640 1 -- 172.21.15.45:0/444411625 shutdown_connections 2023-10-03T19:12:56.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:56.940+0000 7f0ab2b5c640 1 -- 172.21.15.45:0/444411625 wait complete. 2023-10-03T19:12:56.962 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T19:12:57.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.088+0000 7f09a5942640 1 Processor -- start 2023-10-03T19:12:57.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.088+0000 7f09a5942640 1 -- start start 2023-10-03T19:12:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.088+0000 7f09a5942640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f09a00c1cc0 0x7f09a014bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.088+0000 7f09a5942640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f09a00a1f10 0x7f09a014c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.088+0000 7f09a5942640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f09a00bf620 0x7f09a014e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:57.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.088+0000 7f09a5942640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a006fb80 con 0x7f09a00a1f10 2023-10-03T19:12:57.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.088+0000 7f09a5942640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a00c08d0 con 0x7f09a00c1cc0 2023-10-03T19:12:57.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.088+0000 7f09a5942640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a00bbc20 con 0x7f09a00bf620 2023-10-03T19:12:57.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.088+0000 7f099e7fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f09a00a1f10 0x7f09a014c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:57.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.088+0000 7f099e7fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f09a00a1f10 0x7f09a014c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54034/0 (socket says 172.21.15.45:54034) 2023-10-03T19:12:57.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.088+0000 7f099e7fc640 1 -- 172.21.15.45:0/1390701096 learned_addr learned my addr 172.21.15.45:0/1390701096 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:57.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.088+0000 7f099effd640 1 --2- 172.21.15.45:0/1390701096 >> v2:172.21.15.79:3300/0 conn(0x7f09a00c1cc0 0x7f09a014bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:57.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.088+0000 7f099f7fe640 1 --2- 172.21.15.45:0/1390701096 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f09a00bf620 0x7f09a014e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:57.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.088+0000 7f099e7fc640 1 -- 172.21.15.45:0/1390701096 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f09a00bf620 msgr2=0x7f09a014e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:57.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.088+0000 7f099e7fc640 1 --2- 172.21.15.45:0/1390701096 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f09a00bf620 0x7f09a014e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.088+0000 7f099e7fc640 1 -- 172.21.15.45:0/1390701096 >> v2:172.21.15.79:3300/0 conn(0x7f09a00c1cc0 msgr2=0x7f09a014bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:57.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.088+0000 7f099e7fc640 1 --2- 172.21.15.45:0/1390701096 >> v2:172.21.15.79:3300/0 conn(0x7f09a00c1cc0 0x7f09a014bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.088+0000 7f099e7fc640 1 -- 172.21.15.45:0/1390701096 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a00bbf00 con 0x7f09a00a1f10 2023-10-03T19:12:57.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.092+0000 7f099e7fc640 1 --2- 172.21.15.45:0/1390701096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09a00a1f10 0x7f09a014c090 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f09a0072240 tx=0x7f099401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfcfef0e1972fbc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:57.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.092+0000 7f099dffb640 1 -- 172.21.15.45:0/1390701096 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09940ac640 con 0x7f09a00a1f10 2023-10-03T19:12:57.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.092+0000 7f099dffb640 1 -- 172.21.15.45:0/1390701096 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09940ac7a0 con 0x7f09a00a1f10 2023-10-03T19:12:57.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.092+0000 7f099dffb640 1 -- 172.21.15.45:0/1390701096 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09940acb30 con 0x7f09a00a1f10 2023-10-03T19:12:57.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.092+0000 7f09a5942640 1 -- 172.21.15.45:0/1390701096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09a00a1f10 msgr2=0x7f09a014c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:57.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.092+0000 7f09a5942640 1 --2- 172.21.15.45:0/1390701096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09a00a1f10 0x7f09a014c090 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f09a0072240 tx=0x7f099401c500 comp rx=0 tx=0).stop 2023-10-03T19:12:57.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.092+0000 7f09a5942640 1 -- 172.21.15.45:0/1390701096 shutdown_connections 2023-10-03T19:12:57.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.092+0000 7f09a5942640 1 --2- 172.21.15.45:0/1390701096 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f09a00bf620 0x7f09a014e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.092+0000 7f09a5942640 1 --2- 172.21.15.45:0/1390701096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09a00a1f10 0x7f09a014c090 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.092+0000 7f09a5942640 1 --2- 172.21.15.45:0/1390701096 >> v2:172.21.15.79:3300/0 conn(0x7f09a00c1cc0 0x7f09a014bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.092+0000 7f09a5942640 1 -- 172.21.15.45:0/1390701096 >> 172.21.15.45:0/1390701096 conn(0x7f09a00a4400 msgr2=0x7f09a00a4800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:57.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.092+0000 7f09a5942640 1 -- 172.21.15.45:0/1390701096 shutdown_connections 2023-10-03T19:12:57.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.092+0000 7f09a5942640 1 -- 172.21.15.45:0/1390701096 wait complete. 2023-10-03T19:12:57.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.092+0000 7f09a5942640 1 Processor -- start 2023-10-03T19:12:57.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.092+0000 7f09a5942640 1 -- start start 2023-10-03T19:12:57.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.096+0000 7f09a5942640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09a00a1f10 0x7f09a01e6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:57.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.096+0000 7f09a5942640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09a00bf620 0x7f09a01e6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:57.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.096+0000 7f09a5942640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f09a00c1cc0 0x7f09a0148210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:57.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.096+0000 7f09a5942640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a01e7110 con 0x7f09a00bf620 2023-10-03T19:12:57.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.096+0000 7f09a5942640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a006afe0 con 0x7f09a00a1f10 2023-10-03T19:12:57.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.096+0000 7f09a5942640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a006bab0 con 0x7f09a00c1cc0 2023-10-03T19:12:57.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.096+0000 7f099e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09a00bf620 0x7f09a01e6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:57.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.096+0000 7f099e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09a00bf620 0x7f09a01e6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54044/0 (socket says 172.21.15.45:54044) 2023-10-03T19:12:57.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.096+0000 7f099e7fc640 1 -- 172.21.15.45:0/3024531637 learned_addr learned my addr 172.21.15.45:0/3024531637 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:57.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.096+0000 7f099effd640 1 --2- 172.21.15.45:0/3024531637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09a00a1f10 0x7f09a01e6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:57.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.096+0000 7f099f7fe640 1 --2- 172.21.15.45:0/3024531637 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f09a00c1cc0 0x7f09a0148210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:57.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.096+0000 7f099e7fc640 1 -- 172.21.15.45:0/3024531637 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f09a00c1cc0 msgr2=0x7f09a0148210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:57.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.096+0000 7f099e7fc640 1 --2- 172.21.15.45:0/3024531637 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f09a00c1cc0 0x7f09a0148210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.096+0000 7f099e7fc640 1 -- 172.21.15.45:0/3024531637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09a00a1f10 msgr2=0x7f09a01e6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:57.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.096+0000 7f099e7fc640 1 --2- 172.21.15.45:0/3024531637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09a00a1f10 0x7f09a01e6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.096+0000 7f099e7fc640 1 -- 172.21.15.45:0/3024531637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09940094d0 con 0x7f09a00bf620 2023-10-03T19:12:57.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.096+0000 7f099effd640 1 --2- 172.21.15.45:0/3024531637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09a00a1f10 0x7f09a01e6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:12:57.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.096+0000 7f099e7fc640 1 --2- 172.21.15.45:0/3024531637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09a00bf620 0x7f09a01e6bd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f099401cda0 tx=0x7f09940192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:57.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.096+0000 7f0987fff640 1 -- 172.21.15.45:0/3024531637 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09940b5640 con 0x7f09a00bf620 2023-10-03T19:12:57.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.096+0000 7f0987fff640 1 -- 172.21.15.45:0/3024531637 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09940b57a0 con 0x7f09a00bf620 2023-10-03T19:12:57.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.096+0000 7f09a5942640 1 -- 172.21.15.45:0/3024531637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a00c2220 con 0x7f09a00bf620 2023-10-03T19:12:57.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.096+0000 7f0987fff640 1 -- 172.21.15.45:0/3024531637 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09940b5b50 con 0x7f09a00bf620 2023-10-03T19:12:57.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.096+0000 7f09a5942640 1 -- 172.21.15.45:0/3024531637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a00c2090 con 0x7f09a00bf620 2023-10-03T19:12:57.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.096+0000 7f09a5942640 1 -- 172.21.15.45:0/3024531637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a00710f0 con 0x7f09a00bf620 2023-10-03T19:12:57.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.096+0000 7f0987fff640 1 -- 172.21.15.45:0/3024531637 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f09940b3070 con 0x7f09a00bf620 2023-10-03T19:12:57.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.096+0000 7f0987fff640 1 --2- 172.21.15.45:0/3024531637 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f098c066280 0x7f098c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:57.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.096+0000 7f0987fff640 1 -- 172.21.15.45:0/3024531637 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f099411dee0 con 0x7f09a00bf620 2023-10-03T19:12:57.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.096+0000 7f099effd640 1 --2- 172.21.15.45:0/3024531637 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f098c066280 0x7f098c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:57.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.100+0000 7f099effd640 1 --2- 172.21.15.45:0/3024531637 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f098c066280 0x7f098c068730 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f099000b9f0 tx=0x7f0990008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:57.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.100+0000 7f0987fff640 1 -- 172.21.15.45:0/3024531637 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f09940eb3f0 con 0x7f09a00bf620 2023-10-03T19:12:57.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.252+0000 7f09a5942640 1 -- 172.21.15.45:0/3024531637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f09a004de80 con 0x7f09a00bf620 2023-10-03T19:12:57.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.256+0000 7f0987fff640 1 -- 172.21.15.45:0/3024531637 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f09940b10a0 con 0x7f09a00bf620 2023-10-03T19:12:57.260 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-03T19:12:57.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.256+0000 7f09a5942640 1 -- 172.21.15.45:0/3024531637 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f098c066280 msgr2=0x7f098c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:57.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.256+0000 7f09a5942640 1 --2- 172.21.15.45:0/3024531637 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f098c066280 0x7f098c068730 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f099000b9f0 tx=0x7f0990008040 comp rx=0 tx=0).stop 2023-10-03T19:12:57.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.256+0000 7f09a5942640 1 -- 172.21.15.45:0/3024531637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09a00bf620 msgr2=0x7f09a01e6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:57.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.256+0000 7f09a5942640 1 --2- 172.21.15.45:0/3024531637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09a00bf620 0x7f09a01e6bd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f099401cda0 tx=0x7f09940192a0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.256+0000 7f09a5942640 1 -- 172.21.15.45:0/3024531637 shutdown_connections 2023-10-03T19:12:57.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.256+0000 7f09a5942640 1 --2- 172.21.15.45:0/3024531637 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f098c066280 0x7f098c068730 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.256+0000 7f09a5942640 1 --2- 172.21.15.45:0/3024531637 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f09a00c1cc0 0x7f09a0148210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.256+0000 7f09a5942640 1 --2- 172.21.15.45:0/3024531637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09a00bf620 0x7f09a01e6bd0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.256+0000 7f09a5942640 1 --2- 172.21.15.45:0/3024531637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09a00a1f10 0x7f09a01e6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.256+0000 7f09a5942640 1 -- 172.21.15.45:0/3024531637 >> 172.21.15.45:0/3024531637 conn(0x7f09a00a4400 msgr2=0x7f09a00bcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:57.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.256+0000 7f09a5942640 1 -- 172.21.15.45:0/3024531637 shutdown_connections 2023-10-03T19:12:57.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.256+0000 7f09a5942640 1 -- 172.21.15.45:0/3024531637 wait complete. 2023-10-03T19:12:57.287 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop) Basic test for checking drop cache command. 2023-10-03T19:12:57.287 INFO:tasks.cephfs_test_runner:test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop) 2023-10-03T19:12:57.287 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command' 2023-10-03T19:12:57.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.408+0000 7f42c9528640 1 Processor -- start 2023-10-03T19:12:57.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.408+0000 7f42c9528640 1 -- start start 2023-10-03T19:12:57.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.408+0000 7f42c9528640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42c406d5b0 0x7f42c406ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:57.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.408+0000 7f42c9528640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f42c40a6590 0x7f42c414d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:57.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.408+0000 7f42c9528640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c406a370 con 0x7f42c40bb970 2023-10-03T19:12:57.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.408+0000 7f42c9528640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c414d640 con 0x7f42c40a6590 2023-10-03T19:12:57.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.408+0000 7f42c9528640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c40a5520 con 0x7f42c406d5b0 2023-10-03T19:12:57.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.408+0000 7f42c27fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f42c40a6590 0x7f42c414d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:57.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.408+0000 7f42c37fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f42c40bb970 0x7f42c414bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38646/0 (socket says 172.21.15.45:38646) 2023-10-03T19:12:57.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.408+0000 7f42c27fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f42c40a6590 0x7f42c414d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54054/0 (socket says 172.21.15.45:54054) 2023-10-03T19:12:57.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.408+0000 7f42c37fe640 1 -- 172.21.15.45:0/1323580165 learned_addr learned my addr 172.21.15.45:0/1323580165 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:57.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.408+0000 7f42c2ffd640 1 --2- 172.21.15.45:0/1323580165 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42c406d5b0 0x7f42c406ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:57.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.408+0000 7f42c27fc640 1 -- 172.21.15.45:0/1323580165 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42c406d5b0 msgr2=0x7f42c406ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:57.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.408+0000 7f42c27fc640 1 --2- 172.21.15.45:0/1323580165 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42c406d5b0 0x7f42c406ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.408+0000 7f42c27fc640 1 -- 172.21.15.45:0/1323580165 >> v1:172.21.15.45:6789/0 conn(0x7f42c40bb970 legacy=0x7f42c414bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:57.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.408+0000 7f42c27fc640 1 -- 172.21.15.45:0/1323580165 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c40a5800 con 0x7f42c40a6590 2023-10-03T19:12:57.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.408+0000 7f42c1ffb640 1 -- 172.21.15.45:0/1323580165 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1349139251 0 0) 0x7f42c406a370 con 0x7f42c40bb970 2023-10-03T19:12:57.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c27fc640 1 --2- 172.21.15.45:0/1323580165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42c40a6590 0x7f42c414d100 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f42b80097c0 tx=0x7f42b801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=210bd6349c096ddf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:57.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c1ffb640 1 -- 172.21.15.45:0/1323580165 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b80a8970 con 0x7f42c40a6590 2023-10-03T19:12:57.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c1ffb640 1 -- 172.21.15.45:0/1323580165 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b80a8ad0 con 0x7f42c40a6590 2023-10-03T19:12:57.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c1ffb640 1 -- 172.21.15.45:0/1323580165 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b80a8e60 con 0x7f42c40a6590 2023-10-03T19:12:57.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c9528640 1 -- 172.21.15.45:0/1323580165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42c40a6590 msgr2=0x7f42c414d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:57.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c9528640 1 --2- 172.21.15.45:0/1323580165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42c40a6590 0x7f42c414d100 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f42b80097c0 tx=0x7f42b801ec70 comp rx=0 tx=0).stop 2023-10-03T19:12:57.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c9528640 1 -- 172.21.15.45:0/1323580165 shutdown_connections 2023-10-03T19:12:57.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c9528640 1 --2- 172.21.15.45:0/1323580165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42c40a6590 0x7f42c414d100 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c9528640 1 --2- 172.21.15.45:0/1323580165 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42c406d5b0 0x7f42c406ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c9528640 1 -- 172.21.15.45:0/1323580165 >> 172.21.15.45:0/1323580165 conn(0x7f42c40c1600 msgr2=0x7f42c40c1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:57.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c9528640 1 -- 172.21.15.45:0/1323580165 shutdown_connections 2023-10-03T19:12:57.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c9528640 1 -- 172.21.15.45:0/1323580165 wait complete. 2023-10-03T19:12:57.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c9528640 1 Processor -- start 2023-10-03T19:12:57.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c9528640 1 -- start start 2023-10-03T19:12:57.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c9528640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42c406d5b0 0x7f42c406fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:57.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c9528640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42c40a6590 0x7f42c4070e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:57.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c9528640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42c40bb970 0x7f42c4150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:57.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c9528640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c414efe0 con 0x7f42c40a6590 2023-10-03T19:12:57.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c9528640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c4150010 con 0x7f42c40bb970 2023-10-03T19:12:57.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c9528640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c4148df0 con 0x7f42c406d5b0 2023-10-03T19:12:57.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c27fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42c40a6590 0x7f42c4070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:57.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c27fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42c40a6590 0x7f42c4070e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54068/0 (socket says 172.21.15.45:54068) 2023-10-03T19:12:57.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c27fc640 1 -- 172.21.15.45:0/483897524 learned_addr learned my addr 172.21.15.45:0/483897524 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:57.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c37fe640 1 --2- 172.21.15.45:0/483897524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42c40bb970 0x7f42c4150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:57.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c2ffd640 1 --2- 172.21.15.45:0/483897524 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42c406d5b0 0x7f42c406fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:57.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c27fc640 1 -- 172.21.15.45:0/483897524 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42c406d5b0 msgr2=0x7f42c406fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:57.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c27fc640 1 --2- 172.21.15.45:0/483897524 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42c406d5b0 0x7f42c406fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c27fc640 1 -- 172.21.15.45:0/483897524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42c40bb970 msgr2=0x7f42c4150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:57.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c27fc640 1 --2- 172.21.15.45:0/483897524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42c40bb970 0x7f42c4150430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c27fc640 1 -- 172.21.15.45:0/483897524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b8009420 con 0x7f42c40a6590 2023-10-03T19:12:57.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c27fc640 1 --2- 172.21.15.45:0/483897524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42c40a6590 0x7f42c4070e40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f42b801c8a0 tx=0x7f42b801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:57.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42ab7fe640 1 -- 172.21.15.45:0/483897524 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b80b9630 con 0x7f42c40a6590 2023-10-03T19:12:57.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42ab7fe640 1 -- 172.21.15.45:0/483897524 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b80b97b0 con 0x7f42c40a6590 2023-10-03T19:12:57.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42c9528640 1 -- 172.21.15.45:0/483897524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c4069ad0 con 0x7f42c40a6590 2023-10-03T19:12:57.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.412+0000 7f42ab7fe640 1 -- 172.21.15.45:0/483897524 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b80b9b60 con 0x7f42c40a6590 2023-10-03T19:12:57.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.416+0000 7f42c9528640 1 -- 172.21.15.45:0/483897524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c406a5c0 con 0x7f42c40a6590 2023-10-03T19:12:57.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.416+0000 7f42c9528640 1 -- 172.21.15.45:0/483897524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c4071380 con 0x7f42c40a6590 2023-10-03T19:12:57.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.416+0000 7f42ab7fe640 1 -- 172.21.15.45:0/483897524 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f42b80b7040 con 0x7f42c40a6590 2023-10-03T19:12:57.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.416+0000 7f42ab7fe640 1 --2- 172.21.15.45:0/483897524 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f42b00662b0 0x7f42b0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:57.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.416+0000 7f42ab7fe640 1 -- 172.21.15.45:0/483897524 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f42b8121f90 con 0x7f42c40a6590 2023-10-03T19:12:57.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.416+0000 7f42c2ffd640 1 --2- 172.21.15.45:0/483897524 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f42b00662b0 0x7f42b0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:57.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.416+0000 7f42c2ffd640 1 --2- 172.21.15.45:0/483897524 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f42b00662b0 0x7f42b0068760 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f42b400b9d0 tx=0x7f42b4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:57.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.420+0000 7f42ab7fe640 1 -- 172.21.15.45:0/483897524 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f42b80ef580 con 0x7f42c40a6590 2023-10-03T19:12:57.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.628+0000 7f42c9528640 1 -- 172.21.15.45:0/483897524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]} v 0) v1 -- 0x7f42c406d980 con 0x7f42c40a6590 2023-10-03T19:12:57.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.644+0000 7f42ab7fe640 1 -- 172.21.15.45:0/483897524 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]}]=0 v47) v1 ==== 142+0+0 (secure 0 0 0) 0x7f42b80f2ba0 con 0x7f42c40a6590 2023-10-03T19:12:57.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.644+0000 7f42c9528640 1 -- 172.21.15.45:0/483897524 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f42b00662b0 msgr2=0x7f42b0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:57.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.644+0000 7f42c9528640 1 --2- 172.21.15.45:0/483897524 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f42b00662b0 0x7f42b0068760 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f42b400b9d0 tx=0x7f42b4008040 comp rx=0 tx=0).stop 2023-10-03T19:12:57.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.644+0000 7f42c9528640 1 -- 172.21.15.45:0/483897524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42c40a6590 msgr2=0x7f42c4070e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:57.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.644+0000 7f42c9528640 1 --2- 172.21.15.45:0/483897524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42c40a6590 0x7f42c4070e40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f42b801c8a0 tx=0x7f42b801ba10 comp rx=0 tx=0).stop 2023-10-03T19:12:57.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.644+0000 7f42c9528640 1 -- 172.21.15.45:0/483897524 shutdown_connections 2023-10-03T19:12:57.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.644+0000 7f42c9528640 1 --2- 172.21.15.45:0/483897524 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f42b00662b0 0x7f42b0068760 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.644+0000 7f42c9528640 1 --2- 172.21.15.45:0/483897524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42c40bb970 0x7f42c4150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.644+0000 7f42c9528640 1 --2- 172.21.15.45:0/483897524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42c40a6590 0x7f42c4070e40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.644+0000 7f42c9528640 1 --2- 172.21.15.45:0/483897524 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f42c406d5b0 0x7f42c406fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.644+0000 7f42c9528640 1 -- 172.21.15.45:0/483897524 >> 172.21.15.45:0/483897524 conn(0x7f42c40c1600 msgr2=0x7f42c41d9600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:57.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.644+0000 7f42c9528640 1 -- 172.21.15.45:0/483897524 shutdown_connections 2023-10-03T19:12:57.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.644+0000 7f42c9528640 1 -- 172.21.15.45:0/483897524 wait complete. 2023-10-03T19:12:57.666 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-03T19:12:57.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.788+0000 7f46c2b3e640 1 Processor -- start 2023-10-03T19:12:57.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.788+0000 7f46c2b3e640 1 -- start start 2023-10-03T19:12:57.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46c2b3e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f46bc06ee50 0x7f46bc1563a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:57.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46c2b3e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46bc06f650 con 0x7f46bc06cc20 2023-10-03T19:12:57.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46c2b3e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46bc06f3b0 con 0x7f46bc06c410 2023-10-03T19:12:57.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46c2b3e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46bc14b680 con 0x7f46bc06ee50 2023-10-03T19:12:57.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46bbfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f46bc06cc20 0x7f46bc147d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38654/0 (socket says 172.21.15.45:38654) 2023-10-03T19:12:57.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46bbfff640 1 -- 172.21.15.45:0/1176295059 learned_addr learned my addr 172.21.15.45:0/1176295059 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:57.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46c10db640 1 --2- 172.21.15.45:0/1176295059 >> v2:172.21.15.79:3300/0 conn(0x7f46bc06ee50 0x7f46bc1563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:57.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46bb7fe640 1 -- 172.21.15.45:0/1176295059 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 888656894 0 0) 0x7f46bc06f650 con 0x7f46bc06cc20 2023-10-03T19:12:57.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46bb7fe640 1 -- 172.21.15.45:0/1176295059 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46ac003530 con 0x7f46bc06cc20 2023-10-03T19:12:57.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46bb7fe640 1 -- 172.21.15.45:0/1176295059 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3443351844 0 0) 0x7f46ac003530 con 0x7f46bc06cc20 2023-10-03T19:12:57.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46bb7fe640 1 -- 172.21.15.45:0/1176295059 >> v2:172.21.15.79:3300/0 conn(0x7f46bc06ee50 msgr2=0x7f46bc1563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:57.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46bb7fe640 1 --2- 172.21.15.45:0/1176295059 >> v2:172.21.15.79:3300/0 conn(0x7f46bc06ee50 0x7f46bc1563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46bb7fe640 1 -- 172.21.15.45:0/1176295059 >> v1:172.21.15.79:6789/0 conn(0x7f46bc06c410 legacy=0x7f46bc0bc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:57.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46bb7fe640 1 -- 172.21.15.45:0/1176295059 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46bc14b960 con 0x7f46bc06cc20 2023-10-03T19:12:57.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46bb7fe640 1 -- 172.21.15.45:0/1176295059 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f46a8001680 con 0x7f46bc06cc20 2023-10-03T19:12:57.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46bb7fe640 1 -- 172.21.15.45:0/1176295059 >> v1:172.21.15.45:6789/0 conn(0x7f46bc06cc20 legacy=0x7f46bc147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:57.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46bb7fe640 1 --2- 172.21.15.45:0/1176295059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46ac0039b0 0x7f46ac003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:57.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46bb7fe640 1 --2- 172.21.15.45:0/1176295059 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46ac0047d0 0x7f46ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:57.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46bb7fe640 1 --2- 172.21.15.45:0/1176295059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46ac005180 0x7f46ac00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:57.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46bb7fe640 1 -- 172.21.15.45:0/1176295059 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc14b680 con 0x7f46ac005180 2023-10-03T19:12:57.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46bb7fe640 1 -- 172.21.15.45:0/1176295059 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac00e270 con 0x7f46ac0039b0 2023-10-03T19:12:57.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46bb7fe640 1 -- 172.21.15.45:0/1176295059 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac00e400 con 0x7f46ac0047d0 2023-10-03T19:12:57.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46c10db640 1 --2- 172.21.15.45:0/1176295059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46ac005180 0x7f46ac00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:57.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46bbfff640 1 --2- 172.21.15.45:0/1176295059 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46ac0047d0 0x7f46ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:57.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46c08da640 1 --2- 172.21.15.45:0/1176295059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46ac0039b0 0x7f46ac003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:57.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46c10db640 1 -- 172.21.15.45:0/1176295059 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46ac0047d0 msgr2=0x7f46ac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:57.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46c10db640 1 --2- 172.21.15.45:0/1176295059 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46ac0047d0 0x7f46ac004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46c10db640 1 -- 172.21.15.45:0/1176295059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46ac0039b0 msgr2=0x7f46ac003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:57.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46c10db640 1 --2- 172.21.15.45:0/1176295059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46ac0039b0 0x7f46ac003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46c10db640 1 -- 172.21.15.45:0/1176295059 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ac003530 con 0x7f46ac005180 2023-10-03T19:12:57.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.792+0000 7f46c08da640 1 --2- 172.21.15.45:0/1176295059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46ac0039b0 0x7f46ac003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:57.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.796+0000 7f46c10db640 1 -- 172.21.15.45:0/1176295059 reap_dead start 2023-10-03T19:12:57.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.796+0000 7f46c10db640 1 --2- 172.21.15.45:0/1176295059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46ac005180 0x7f46ac00b990 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f46b4009f90 tx=0x7f46b401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d02f10f043495d0e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:57.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.796+0000 7f46bb7fe640 1 -- 172.21.15.45:0/1176295059 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b40a5c70 con 0x7f46ac005180 2023-10-03T19:12:57.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.796+0000 7f46bb7fe640 1 -- 172.21.15.45:0/1176295059 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b400f040 con 0x7f46ac005180 2023-10-03T19:12:57.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.796+0000 7f46bb7fe640 1 -- 172.21.15.45:0/1176295059 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b40039a0 con 0x7f46ac005180 2023-10-03T19:12:57.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.796+0000 7f46c2b3e640 1 -- 172.21.15.45:0/1176295059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46ac005180 msgr2=0x7f46ac00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:57.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.796+0000 7f46c2b3e640 1 --2- 172.21.15.45:0/1176295059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46ac005180 0x7f46ac00b990 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f46b4009f90 tx=0x7f46b401cc60 comp rx=0 tx=0).stop 2023-10-03T19:12:57.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.796+0000 7f46c2b3e640 1 -- 172.21.15.45:0/1176295059 shutdown_connections 2023-10-03T19:12:57.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.796+0000 7f46c2b3e640 1 --2- 172.21.15.45:0/1176295059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46ac005180 0x7f46ac00b990 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.796+0000 7f46c2b3e640 1 -- 172.21.15.45:0/1176295059 >> 172.21.15.45:0/1176295059 conn(0x7f46bc0a20d0 msgr2=0x7f46bc0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:57.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.796+0000 7f46c2b3e640 1 -- 172.21.15.45:0/1176295059 shutdown_connections 2023-10-03T19:12:57.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.796+0000 7f46c2b3e640 1 -- 172.21.15.45:0/1176295059 wait complete. 2023-10-03T19:12:57.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.796+0000 7f46c2b3e640 1 Processor -- start 2023-10-03T19:12:57.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.796+0000 7f46c2b3e640 1 -- start start 2023-10-03T19:12:57.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.796+0000 7f46c2b3e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46ac005180 0x7f46bc13f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:57.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.796+0000 7f46c2b3e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46bc13c330 0x7f46bc13b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:57.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.796+0000 7f46c2b3e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46bc13b800 0x7f46bc1e33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:57.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.796+0000 7f46c2b3e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc1e7570 con 0x7f46bc13c330 2023-10-03T19:12:57.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.796+0000 7f46c2b3e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc0bca30 con 0x7f46bc13b800 2023-10-03T19:12:57.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.796+0000 7f46c2b3e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc13fa90 con 0x7f46ac005180 2023-10-03T19:12:57.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.796+0000 7f46bbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46bc13c330 0x7f46bc13b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:57.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.796+0000 7f46bbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46bc13c330 0x7f46bc13b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54094/0 (socket says 172.21.15.45:54094) 2023-10-03T19:12:57.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.796+0000 7f46bbfff640 1 -- 172.21.15.45:0/1113445977 learned_addr learned my addr 172.21.15.45:0/1113445977 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:57.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.796+0000 7f46c10db640 1 --2- 172.21.15.45:0/1113445977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46bc13b800 0x7f46bc1e33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:57.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.796+0000 7f46c08da640 1 --2- 172.21.15.45:0/1113445977 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46ac005180 0x7f46bc13f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:57.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.796+0000 7f46bbfff640 1 -- 172.21.15.45:0/1113445977 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46ac005180 msgr2=0x7f46bc13f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:57.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.796+0000 7f46bbfff640 1 --2- 172.21.15.45:0/1113445977 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46ac005180 0x7f46bc13f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.796+0000 7f46bbfff640 1 -- 172.21.15.45:0/1113445977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46bc13b800 msgr2=0x7f46bc1e33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:57.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.796+0000 7f46bbfff640 1 --2- 172.21.15.45:0/1113445977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46bc13b800 0x7f46bc1e33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.796+0000 7f46bbfff640 1 -- 172.21.15.45:0/1113445977 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46bc06c970 con 0x7f46bc13c330 2023-10-03T19:12:57.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.800+0000 7f46bbfff640 1 --2- 172.21.15.45:0/1113445977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46bc13c330 0x7f46bc13b2c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f46a800e700 tx=0x7f46a800ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:57.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.800+0000 7f46b97fa640 1 -- 172.21.15.45:0/1113445977 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a800c6c0 con 0x7f46bc13c330 2023-10-03T19:12:57.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.800+0000 7f46b97fa640 1 -- 172.21.15.45:0/1113445977 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a800c820 con 0x7f46bc13c330 2023-10-03T19:12:57.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.800+0000 7f46c2b3e640 1 -- 172.21.15.45:0/1113445977 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46bc06c7e0 con 0x7f46bc13c330 2023-10-03T19:12:57.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.800+0000 7f46b97fa640 1 -- 172.21.15.45:0/1113445977 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a800cbb0 con 0x7f46bc13c330 2023-10-03T19:12:57.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.800+0000 7f46c2b3e640 1 -- 172.21.15.45:0/1113445977 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46bc0ba6c0 con 0x7f46bc13c330 2023-10-03T19:12:57.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.800+0000 7f46c2b3e640 1 -- 172.21.15.45:0/1113445977 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46bc14e440 con 0x7f46bc13c330 2023-10-03T19:12:57.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.800+0000 7f46b97fa640 1 -- 172.21.15.45:0/1113445977 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f46a800cd10 con 0x7f46bc13c330 2023-10-03T19:12:57.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.800+0000 7f46b97fa640 1 --2- 172.21.15.45:0/1113445977 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f46a0066280 0x7f46a0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:57.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.800+0000 7f46b97fa640 1 -- 172.21.15.45:0/1113445977 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f46a8083a40 con 0x7f46bc13c330 2023-10-03T19:12:57.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.800+0000 7f46c08da640 1 --2- 172.21.15.45:0/1113445977 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f46a0066280 0x7f46a0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:57.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.800+0000 7f46c08da640 1 --2- 172.21.15.45:0/1113445977 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f46a0066280 0x7f46a0068730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f46b0007fd0 tx=0x7f46b0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:57.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.804+0000 7f46b97fa640 1 -- 172.21.15.45:0/1113445977 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f46bc14e440 con 0x7f46bc13c330 2023-10-03T19:12:57.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.960+0000 7f46c2b3e640 1 -- 172.21.15.45:0/1113445977 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f46bc1e76b0 con 0x7f46bc13c330 2023-10-03T19:12:57.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.964+0000 7f46b97fa640 1 -- 172.21.15.45:0/1113445977 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f46bc1e76b0 con 0x7f46bc13c330 2023-10-03T19:12:57.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.968+0000 7f46c2b3e640 1 -- 172.21.15.45:0/1113445977 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f46a0066280 msgr2=0x7f46a0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:57.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.968+0000 7f46c2b3e640 1 --2- 172.21.15.45:0/1113445977 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f46a0066280 0x7f46a0068730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f46b0007fd0 tx=0x7f46b0009040 comp rx=0 tx=0).stop 2023-10-03T19:12:57.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.968+0000 7f46c2b3e640 1 -- 172.21.15.45:0/1113445977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46bc13c330 msgr2=0x7f46bc13b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:57.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.968+0000 7f46c2b3e640 1 --2- 172.21.15.45:0/1113445977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46bc13c330 0x7f46bc13b2c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f46a800e700 tx=0x7f46a800ebc0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.968+0000 7f46c2b3e640 1 -- 172.21.15.45:0/1113445977 shutdown_connections 2023-10-03T19:12:57.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.968+0000 7f46c2b3e640 1 --2- 172.21.15.45:0/1113445977 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f46a0066280 0x7f46a0068730 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.968+0000 7f46c2b3e640 1 --2- 172.21.15.45:0/1113445977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46bc13b800 0x7f46bc1e33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.968+0000 7f46c2b3e640 1 --2- 172.21.15.45:0/1113445977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46bc13c330 0x7f46bc13b2c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.968+0000 7f46c2b3e640 1 --2- 172.21.15.45:0/1113445977 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46ac005180 0x7f46bc13f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:57.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.968+0000 7f46c2b3e640 1 -- 172.21.15.45:0/1113445977 >> 172.21.15.45:0/1113445977 conn(0x7f46bc0a20d0 msgr2=0x7f46bc0a24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:57.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.968+0000 7f46c2b3e640 1 -- 172.21.15.45:0/1113445977 shutdown_connections 2023-10-03T19:12:57.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:57.968+0000 7f46c2b3e640 1 -- 172.21.15.45:0/1113445977 wait complete. 2023-10-03T19:12:57.991 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-03T19:12:57.991 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:12:58.041 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:12:58.094 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:12:58.159 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:12:58.198 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-03T19:12:58.198 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:12:58.198 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:12:58.204 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:12:58.204 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:12:58.250 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:12:58.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.380+0000 7f0c9fb82640 1 Processor -- start 2023-10-03T19:12:58.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.380+0000 7f0c9fb82640 1 -- start start 2023-10-03T19:12:58.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.380+0000 7f0c9fb82640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0c98148b90 0x7f0c980bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:58.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.380+0000 7f0c9fb82640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c980bc4a0 0x7f0c9806c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:58.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.380+0000 7f0c9fb82640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c9814b610 con 0x7f0c980bcb60 2023-10-03T19:12:58.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.380+0000 7f0c9fb82640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c980a3670 con 0x7f0c98148b90 2023-10-03T19:12:58.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.380+0000 7f0c9fb82640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9814b370 con 0x7f0c980bc4a0 2023-10-03T19:12:58.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.380+0000 7f0c9d91e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0c98148b90 0x7f0c980bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:58.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.380+0000 7f0c9d91e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0c98148b90 0x7f0c980bbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54100/0 (socket says 172.21.15.45:54100) 2023-10-03T19:12:58.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.380+0000 7f0c9d91e640 1 -- 172.21.15.45:0/1540060934 learned_addr learned my addr 172.21.15.45:0/1540060934 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:58.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.380+0000 7f0c9e11f640 1 --2- 172.21.15.45:0/1540060934 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c980bc4a0 0x7f0c9806c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:58.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.380+0000 7f0c9d91e640 1 -- 172.21.15.45:0/1540060934 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c980bc4a0 msgr2=0x7f0c9806c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:58.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.380+0000 7f0c9d91e640 1 --2- 172.21.15.45:0/1540060934 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c980bc4a0 0x7f0c9806c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:58.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.380+0000 7f0c9d91e640 1 -- 172.21.15.45:0/1540060934 >> v1:172.21.15.79:6789/0 conn(0x7f0c980bcb60 legacy=0x7f0c9806c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:58.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.380+0000 7f0c9d91e640 1 -- 172.21.15.45:0/1540060934 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c980a5580 con 0x7f0c98148b90 2023-10-03T19:12:58.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.380+0000 7f0c9e11f640 1 --2- 172.21.15.45:0/1540060934 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c980bc4a0 0x7f0c9806c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:58.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.380+0000 7f0c9d91e640 1 --2- 172.21.15.45:0/1540060934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c98148b90 0x7f0c980bbf60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0c94009e50 tx=0x7f0c9401f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9184b7477a28f1fa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:58.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9c91c640 1 -- 172.21.15.45:0/1540060934 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c940af400 con 0x7f0c98148b90 2023-10-03T19:12:58.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9c91c640 1 -- 172.21.15.45:0/1540060934 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c940ab050 con 0x7f0c98148b90 2023-10-03T19:12:58.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9c91c640 1 -- 172.21.15.45:0/1540060934 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c940af780 con 0x7f0c98148b90 2023-10-03T19:12:58.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9fb82640 1 -- 172.21.15.45:0/1540060934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c98148b90 msgr2=0x7f0c980bbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:58.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9fb82640 1 --2- 172.21.15.45:0/1540060934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c98148b90 0x7f0c980bbf60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0c94009e50 tx=0x7f0c9401f1f0 comp rx=0 tx=0).stop 2023-10-03T19:12:58.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9fb82640 1 -- 172.21.15.45:0/1540060934 shutdown_connections 2023-10-03T19:12:58.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9fb82640 1 --2- 172.21.15.45:0/1540060934 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c980bc4a0 0x7f0c9806c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:58.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9fb82640 1 --2- 172.21.15.45:0/1540060934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c98148b90 0x7f0c980bbf60 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:58.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9fb82640 1 -- 172.21.15.45:0/1540060934 >> 172.21.15.45:0/1540060934 conn(0x7f0c980bcf50 msgr2=0x7f0c980bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:58.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9fb82640 1 -- 172.21.15.45:0/1540060934 shutdown_connections 2023-10-03T19:12:58.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9fb82640 1 -- 172.21.15.45:0/1540060934 wait complete. 2023-10-03T19:12:58.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9fb82640 1 Processor -- start 2023-10-03T19:12:58.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9fb82640 1 -- start start 2023-10-03T19:12:58.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9fb82640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c980bc4a0 0x7f0c981d5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:58.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9fb82640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c980bcb60 0x7f0c981d5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:58.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9fb82640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c98148b90 0x7f0c9814e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:58.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9fb82640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c98146ef0 con 0x7f0c98148b90 2023-10-03T19:12:58.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9fb82640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c98146c80 con 0x7f0c980bc4a0 2023-10-03T19:12:58.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9fb82640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c981467c0 con 0x7f0c980bcb60 2023-10-03T19:12:58.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9e11f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c98148b90 0x7f0c9814e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:58.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9e11f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c98148b90 0x7f0c9814e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54106/0 (socket says 172.21.15.45:54106) 2023-10-03T19:12:58.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9e11f640 1 -- 172.21.15.45:0/1988382385 learned_addr learned my addr 172.21.15.45:0/1988382385 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:58.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9d91e640 1 --2- 172.21.15.45:0/1988382385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c980bc4a0 0x7f0c981d5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:58.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9d11d640 1 --2- 172.21.15.45:0/1988382385 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c980bcb60 0x7f0c981d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:58.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9e11f640 1 -- 172.21.15.45:0/1988382385 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c980bcb60 msgr2=0x7f0c981d5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:58.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9e11f640 1 --2- 172.21.15.45:0/1988382385 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c980bcb60 0x7f0c981d5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:58.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9e11f640 1 -- 172.21.15.45:0/1988382385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c980bc4a0 msgr2=0x7f0c981d5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:58.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9e11f640 1 --2- 172.21.15.45:0/1988382385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c980bc4a0 0x7f0c981d5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:58.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9e11f640 1 -- 172.21.15.45:0/1988382385 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c94009b30 con 0x7f0c98148b90 2023-10-03T19:12:58.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9d91e640 1 --2- 172.21.15.45:0/1988382385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c980bc4a0 0x7f0c981d5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:12:58.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9e11f640 1 --2- 172.21.15.45:0/1988382385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c98148b90 0x7f0c9814e900 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000c820 tx=0x7f0c9000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:58.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c8e7fc640 1 -- 172.21.15.45:0/1988382385 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c90007a30 con 0x7f0c98148b90 2023-10-03T19:12:58.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c8e7fc640 1 -- 172.21.15.45:0/1988382385 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c90007bd0 con 0x7f0c98148b90 2023-10-03T19:12:58.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9fb82640 1 -- 172.21.15.45:0/1988382385 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c9806cee0 con 0x7f0c98148b90 2023-10-03T19:12:58.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c8e7fc640 1 -- 172.21.15.45:0/1988382385 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9000ce10 con 0x7f0c98148b90 2023-10-03T19:12:58.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.384+0000 7f0c9fb82640 1 -- 172.21.15.45:0/1988382385 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c980a5820 con 0x7f0c98148b90 2023-10-03T19:12:58.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.388+0000 7f0c9fb82640 1 -- 172.21.15.45:0/1988382385 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c98148f60 con 0x7f0c98148b90 2023-10-03T19:12:58.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.388+0000 7f0c8e7fc640 1 -- 172.21.15.45:0/1988382385 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0c900113f0 con 0x7f0c98148b90 2023-10-03T19:12:58.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.388+0000 7f0c8e7fc640 1 --2- 172.21.15.45:0/1988382385 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0c7c066280 0x7f0c7c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:58.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.388+0000 7f0c8e7fc640 1 -- 172.21.15.45:0/1988382385 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0c90083e30 con 0x7f0c98148b90 2023-10-03T19:12:58.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.388+0000 7f0c9d91e640 1 --2- 172.21.15.45:0/1988382385 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0c7c066280 0x7f0c7c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:58.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.388+0000 7f0c9d91e640 1 --2- 172.21.15.45:0/1988382385 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0c7c066280 0x7f0c7c068730 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0c940b1000 tx=0x7f0c940aa000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:58.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.392+0000 7f0c8e7fc640 1 -- 172.21.15.45:0/1988382385 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0c90054dd0 con 0x7f0c98148b90 2023-10-03T19:12:58.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.552+0000 7f0c9fb82640 1 -- 172.21.15.45:0/1988382385 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c98146980 con 0x7f0c98148b90 2023-10-03T19:12:58.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.552+0000 7f0c8e7fc640 1 -- 172.21.15.45:0/1988382385 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18231 (secure 0 0 0) 0x7f0c9001f090 con 0x7f0c98148b90 2023-10-03T19:12:58.557 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:12:58.558 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:12:28.941467+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:12:26.226431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T19:12:26.923174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:12:58.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.552+0000 7f0c9fb82640 1 -- 172.21.15.45:0/1988382385 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0c7c066280 msgr2=0x7f0c7c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:58.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.552+0000 7f0c9fb82640 1 --2- 172.21.15.45:0/1988382385 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0c7c066280 0x7f0c7c068730 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0c940b1000 tx=0x7f0c940aa000 comp rx=0 tx=0).stop 2023-10-03T19:12:58.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.552+0000 7f0c9fb82640 1 -- 172.21.15.45:0/1988382385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c98148b90 msgr2=0x7f0c9814e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:58.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.552+0000 7f0c9fb82640 1 --2- 172.21.15.45:0/1988382385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c98148b90 0x7f0c9814e900 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000c820 tx=0x7f0c9000cce0 comp rx=0 tx=0).stop 2023-10-03T19:12:58.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.552+0000 7f0c9fb82640 1 -- 172.21.15.45:0/1988382385 shutdown_connections 2023-10-03T19:12:58.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.552+0000 7f0c9fb82640 1 --2- 172.21.15.45:0/1988382385 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0c7c066280 0x7f0c7c068730 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:58.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.552+0000 7f0c9fb82640 1 --2- 172.21.15.45:0/1988382385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c98148b90 0x7f0c9814e900 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:58.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.552+0000 7f0c9fb82640 1 --2- 172.21.15.45:0/1988382385 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c980bcb60 0x7f0c981d5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:58.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.552+0000 7f0c9fb82640 1 --2- 172.21.15.45:0/1988382385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c980bc4a0 0x7f0c981d5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:58.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.556+0000 7f0c9fb82640 1 -- 172.21.15.45:0/1988382385 >> 172.21.15.45:0/1988382385 conn(0x7f0c980bcf50 msgr2=0x7f0c9806c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:58.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.556+0000 7f0c9fb82640 1 -- 172.21.15.45:0/1988382385 shutdown_connections 2023-10-03T19:12:58.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.556+0000 7f0c9fb82640 1 -- 172.21.15.45:0/1988382385 wait complete. 2023-10-03T19:12:58.577 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T19:12:26.226431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T19:12:26.923174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:12:58.577 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:12:58.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.696+0000 7f912c2d3640 1 Processor -- start 2023-10-03T19:12:58.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.696+0000 7f912c2d3640 1 -- start start 2023-10-03T19:12:58.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.696+0000 7f912c2d3640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9124070df0 0x7f912406aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:58.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.696+0000 7f912c2d3640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91240a11d0 con 0x7f9124070140 2023-10-03T19:12:58.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.700+0000 7f912c2d3640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f912406a460 con 0x7f91241500f0 2023-10-03T19:12:58.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.700+0000 7f912c2d3640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9124069f70 con 0x7f9124070df0 2023-10-03T19:12:58.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.700+0000 7f912a870640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9124070140 0x7f912414c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38660/0 (socket says 172.21.15.45:38660) 2023-10-03T19:12:58.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.700+0000 7f912a870640 1 -- 172.21.15.45:0/3567604434 learned_addr learned my addr 172.21.15.45:0/3567604434 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:58.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.700+0000 7f912986e640 1 --2- 172.21.15.45:0/3567604434 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9124070df0 0x7f912406aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:58.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.700+0000 7f912906d640 1 -- 172.21.15.45:0/3567604434 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2040860928 0 0) 0x7f91240a11d0 con 0x7f9124070140 2023-10-03T19:12:58.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.700+0000 7f912906d640 1 -- 172.21.15.45:0/3567604434 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9110003530 con 0x7f9124070140 2023-10-03T19:12:58.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.700+0000 7f912906d640 1 -- 172.21.15.45:0/3567604434 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628788556 0 0) 0x7f912406a460 con 0x7f91241500f0 2023-10-03T19:12:58.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.700+0000 7f912906d640 1 -- 172.21.15.45:0/3567604434 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91240a11d0 con 0x7f91241500f0 2023-10-03T19:12:58.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.700+0000 7f912906d640 1 -- 172.21.15.45:0/3567604434 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1552586390 0 0) 0x7f9110003530 con 0x7f9124070140 2023-10-03T19:12:58.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.700+0000 7f912906d640 1 -- 172.21.15.45:0/3567604434 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9124070df0 msgr2=0x7f912406aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:58.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.700+0000 7f912906d640 1 --2- 172.21.15.45:0/3567604434 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9124070df0 0x7f912406aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:58.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.700+0000 7f912906d640 1 -- 172.21.15.45:0/3567604434 >> v1:172.21.15.79:6789/0 conn(0x7f91241500f0 legacy=0x7f91240a3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:58.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.700+0000 7f912906d640 1 -- 172.21.15.45:0/3567604434 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91241504c0 con 0x7f9124070140 2023-10-03T19:12:58.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.700+0000 7f912906d640 1 -- 172.21.15.45:0/3567604434 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f911c001680 con 0x7f9124070140 2023-10-03T19:12:58.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.700+0000 7f912906d640 1 -- 172.21.15.45:0/3567604434 >> v1:172.21.15.45:6789/0 conn(0x7f9124070140 legacy=0x7f912414c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:58.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.700+0000 7f912906d640 1 --2- 172.21.15.45:0/3567604434 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9124070df0 0x7f9110003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:58.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.700+0000 7f912906d640 1 --2- 172.21.15.45:0/3567604434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91100040f0 0x7f91100047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:58.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.700+0000 7f912906d640 1 --2- 172.21.15.45:0/3567604434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9110004d10 0x7f9110005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:58.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.700+0000 7f912906d640 1 -- 172.21.15.45:0/3567604434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9124069f70 con 0x7f91100040f0 2023-10-03T19:12:58.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.700+0000 7f912906d640 1 -- 172.21.15.45:0/3567604434 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911000baa0 con 0x7f9110004d10 2023-10-03T19:12:58.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.700+0000 7f912906d640 1 -- 172.21.15.45:0/3567604434 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f911000bc60 con 0x7f9124070df0 2023-10-03T19:12:58.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.700+0000 7f912986e640 1 --2- 172.21.15.45:0/3567604434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91100040f0 0x7f91100047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:58.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.700+0000 7f912a870640 1 --2- 172.21.15.45:0/3567604434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9110004d10 0x7f9110005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:58.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.700+0000 7f912a06f640 1 --2- 172.21.15.45:0/3567604434 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9124070df0 0x7f9110003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:58.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.700+0000 7f912986e640 1 -- 172.21.15.45:0/3567604434 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9124070df0 msgr2=0x7f9110003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:58.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.700+0000 7f912986e640 1 --2- 172.21.15.45:0/3567604434 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9124070df0 0x7f9110003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:58.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.700+0000 7f912986e640 1 -- 172.21.15.45:0/3567604434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9110004d10 msgr2=0x7f9110005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:58.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.700+0000 7f912986e640 1 --2- 172.21.15.45:0/3567604434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9110004d10 0x7f9110005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:58.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.700+0000 7f912986e640 1 -- 172.21.15.45:0/3567604434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9110003530 con 0x7f91100040f0 2023-10-03T19:12:58.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912986e640 1 --2- 172.21.15.45:0/3567604434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91100040f0 0x7f91100047d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9114009ae0 tx=0x7f911401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304a57da8072e97e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:58.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912906d640 1 -- 172.21.15.45:0/3567604434 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91140a5640 con 0x7f91100040f0 2023-10-03T19:12:58.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912906d640 1 -- 172.21.15.45:0/3567604434 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91140a57a0 con 0x7f91100040f0 2023-10-03T19:12:58.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912906d640 1 -- 172.21.15.45:0/3567604434 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91140a5b50 con 0x7f91100040f0 2023-10-03T19:12:58.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912c2d3640 1 -- 172.21.15.45:0/3567604434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91100040f0 msgr2=0x7f91100047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:58.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912c2d3640 1 --2- 172.21.15.45:0/3567604434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91100040f0 0x7f91100047d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9114009ae0 tx=0x7f911401ca50 comp rx=0 tx=0).stop 2023-10-03T19:12:58.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912a870640 1 -- 172.21.15.45:0/3567604434 reap_dead start 2023-10-03T19:12:58.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912c2d3640 1 -- 172.21.15.45:0/3567604434 shutdown_connections 2023-10-03T19:12:58.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912c2d3640 1 -- 172.21.15.45:0/3567604434 >> 172.21.15.45:0/3567604434 conn(0x7f91240be190 msgr2=0x7f91240be590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:58.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912c2d3640 1 -- 172.21.15.45:0/3567604434 shutdown_connections 2023-10-03T19:12:58.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912c2d3640 1 -- 172.21.15.45:0/3567604434 wait complete. 2023-10-03T19:12:58.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912c2d3640 1 Processor -- start 2023-10-03T19:12:58.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912c2d3640 1 -- start start 2023-10-03T19:12:58.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912c2d3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91100040f0 0x7f91240a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:58.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912c2d3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f912414ccf0 0x7f91241459d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:58.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912c2d3640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9124145f10 0x7f91240a6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:58.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912c2d3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912414c900 con 0x7f91100040f0 2023-10-03T19:12:58.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912c2d3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912414d620 con 0x7f912414ccf0 2023-10-03T19:12:58.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912c2d3640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91240a5d20 con 0x7f9124145f10 2023-10-03T19:12:58.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912a06f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91100040f0 0x7f91240a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:58.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912a06f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91100040f0 0x7f91240a48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54122/0 (socket says 172.21.15.45:54122) 2023-10-03T19:12:58.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912a06f640 1 -- 172.21.15.45:0/1333900860 learned_addr learned my addr 172.21.15.45:0/1333900860 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:58.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912986e640 1 --2- 172.21.15.45:0/1333900860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f912414ccf0 0x7f91241459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:58.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912a870640 1 --2- 172.21.15.45:0/1333900860 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9124145f10 0x7f91240a6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:58.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912a06f640 1 -- 172.21.15.45:0/1333900860 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9124145f10 msgr2=0x7f91240a6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:58.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912a06f640 1 --2- 172.21.15.45:0/1333900860 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9124145f10 0x7f91240a6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:58.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912a06f640 1 -- 172.21.15.45:0/1333900860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f912414ccf0 msgr2=0x7f91241459d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:58.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912a06f640 1 --2- 172.21.15.45:0/1333900860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f912414ccf0 0x7f91241459d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:58.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912a06f640 1 -- 172.21.15.45:0/1333900860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9124150780 con 0x7f91100040f0 2023-10-03T19:12:58.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912a06f640 1 --2- 172.21.15.45:0/1333900860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91100040f0 0x7f91240a48e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f912000eb50 tx=0x7f912000c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:58.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f911affd640 1 -- 172.21.15.45:0/1333900860 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912000ee50 con 0x7f91100040f0 2023-10-03T19:12:58.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f911affd640 1 -- 172.21.15.45:0/1333900860 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912000cbc0 con 0x7f91100040f0 2023-10-03T19:12:58.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912c2d3640 1 -- 172.21.15.45:0/1333900860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f912406a180 con 0x7f91100040f0 2023-10-03T19:12:58.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f911affd640 1 -- 172.21.15.45:0/1333900860 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9120003980 con 0x7f91100040f0 2023-10-03T19:12:58.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.704+0000 7f912c2d3640 1 -- 172.21.15.45:0/1333900860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9124150a60 con 0x7f91100040f0 2023-10-03T19:12:58.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.708+0000 7f912c2d3640 1 -- 172.21.15.45:0/1333900860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f912414ca40 con 0x7f91100040f0 2023-10-03T19:12:58.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.708+0000 7f911affd640 1 -- 172.21.15.45:0/1333900860 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9120003ae0 con 0x7f91100040f0 2023-10-03T19:12:58.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.708+0000 7f911affd640 1 --2- 172.21.15.45:0/1333900860 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9108066280 0x7f9108068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:58.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.708+0000 7f911affd640 1 -- 172.21.15.45:0/1333900860 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9120083ea0 con 0x7f91100040f0 2023-10-03T19:12:58.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.708+0000 7f912986e640 1 --2- 172.21.15.45:0/1333900860 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9108066280 0x7f9108068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:58.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.708+0000 7f912986e640 1 --2- 172.21.15.45:0/1333900860 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9108066280 0x7f9108068730 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f91140af000 tx=0x7f91140046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:58.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.712+0000 7f911affd640 1 -- 172.21.15.45:0/1333900860 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f912414ca40 con 0x7f91100040f0 2023-10-03T19:12:58.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.868+0000 7f912c2d3640 1 -- 172.21.15.45:0/1333900860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f912414ca40 con 0x7f91100040f0 2023-10-03T19:12:58.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.868+0000 7f911affd640 1 -- 172.21.15.45:0/1333900860 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f912414ca40 con 0x7f91100040f0 2023-10-03T19:12:58.873 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:12:58.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.868+0000 7f912c2d3640 1 -- 172.21.15.45:0/1333900860 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9108066280 msgr2=0x7f9108068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:58.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.868+0000 7f912c2d3640 1 --2- 172.21.15.45:0/1333900860 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9108066280 0x7f9108068730 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f91140af000 tx=0x7f91140046d0 comp rx=0 tx=0).stop 2023-10-03T19:12:58.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.868+0000 7f912c2d3640 1 -- 172.21.15.45:0/1333900860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91100040f0 msgr2=0x7f91240a48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:58.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.868+0000 7f912c2d3640 1 --2- 172.21.15.45:0/1333900860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91100040f0 0x7f91240a48e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f912000eb50 tx=0x7f912000c4b0 comp rx=0 tx=0).stop 2023-10-03T19:12:58.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.868+0000 7f912c2d3640 1 -- 172.21.15.45:0/1333900860 shutdown_connections 2023-10-03T19:12:58.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.868+0000 7f912c2d3640 1 --2- 172.21.15.45:0/1333900860 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9108066280 0x7f9108068730 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:58.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.868+0000 7f912c2d3640 1 --2- 172.21.15.45:0/1333900860 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9124145f10 0x7f91240a6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:58.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.868+0000 7f912c2d3640 1 --2- 172.21.15.45:0/1333900860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f912414ccf0 0x7f91241459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:58.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.868+0000 7f912c2d3640 1 --2- 172.21.15.45:0/1333900860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91100040f0 0x7f91240a48e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:58.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.868+0000 7f912c2d3640 1 -- 172.21.15.45:0/1333900860 >> 172.21.15.45:0/1333900860 conn(0x7f91240be190 msgr2=0x7f912406e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:58.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.868+0000 7f912c2d3640 1 -- 172.21.15.45:0/1333900860 shutdown_connections 2023-10-03T19:12:58.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:58.868+0000 7f912c2d3640 1 -- 172.21.15.45:0/1333900860 wait complete. 2023-10-03T19:12:58.893 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:12:59.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c976f0640 1 Processor -- start 2023-10-03T19:12:59.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c976f0640 1 -- start start 2023-10-03T19:12:59.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c976f0640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6c900c14e0 0x7f6c900c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:59.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c976f0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c900c2770 0x7f6c900a9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:59.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c976f0640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c9006ac70 con 0x7f6c900bf1f0 2023-10-03T19:12:59.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c976f0640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c9006aae0 con 0x7f6c900c14e0 2023-10-03T19:12:59.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c976f0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c900c3000 con 0x7f6c900c2770 2023-10-03T19:12:59.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c94c8b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6c900bf1f0 0x7f6c900a9860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38670/0 (socket says 172.21.15.45:38670) 2023-10-03T19:12:59.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c94c8b640 1 -- 172.21.15.45:0/2079706909 learned_addr learned my addr 172.21.15.45:0/2079706909 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:59.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c9548c640 1 --2- 172.21.15.45:0/2079706909 >> v2:172.21.15.79:3300/0 conn(0x7f6c900c14e0 0x7f6c900c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:59.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c95c8d640 1 --2- 172.21.15.45:0/2079706909 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c900c2770 0x7f6c900a9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:59.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c87fff640 1 -- 172.21.15.45:0/2079706909 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 908888601 0 0) 0x7f6c9006ac70 con 0x7f6c900bf1f0 2023-10-03T19:12:59.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c87fff640 1 -- 172.21.15.45:0/2079706909 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c7c003530 con 0x7f6c900bf1f0 2023-10-03T19:12:59.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c87fff640 1 -- 172.21.15.45:0/2079706909 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1572548300 0 0) 0x7f6c7c003530 con 0x7f6c900bf1f0 2023-10-03T19:12:59.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c87fff640 1 -- 172.21.15.45:0/2079706909 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c900c2770 msgr2=0x7f6c900a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:59.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c87fff640 1 --2- 172.21.15.45:0/2079706909 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c900c2770 0x7f6c900a9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c87fff640 1 -- 172.21.15.45:0/2079706909 >> v2:172.21.15.79:3300/0 conn(0x7f6c900c14e0 msgr2=0x7f6c900c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:59.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c87fff640 1 --2- 172.21.15.45:0/2079706909 >> v2:172.21.15.79:3300/0 conn(0x7f6c900c14e0 0x7f6c900c0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c87fff640 1 -- 172.21.15.45:0/2079706909 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c900aa5f0 con 0x7f6c900bf1f0 2023-10-03T19:12:59.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c87fff640 1 -- 172.21.15.45:0/2079706909 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f6c80001680 con 0x7f6c900bf1f0 2023-10-03T19:12:59.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c87fff640 1 -- 172.21.15.45:0/2079706909 >> v1:172.21.15.45:6789/0 conn(0x7f6c900bf1f0 legacy=0x7f6c900a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:59.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c87fff640 1 --2- 172.21.15.45:0/2079706909 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c900c2770 0x7f6c7c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:59.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c87fff640 1 --2- 172.21.15.45:0/2079706909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c7c003f00 0x7f6c7c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:59.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c87fff640 1 --2- 172.21.15.45:0/2079706909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c7c004d10 0x7f6c7c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:59.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c87fff640 1 -- 172.21.15.45:0/2079706909 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c900c3000 con 0x7f6c7c004d10 2023-10-03T19:12:59.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c87fff640 1 -- 172.21.15.45:0/2079706909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c00b990 con 0x7f6c7c003f00 2023-10-03T19:12:59.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c87fff640 1 -- 172.21.15.45:0/2079706909 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c00bb00 con 0x7f6c900c2770 2023-10-03T19:12:59.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c95c8d640 1 --2- 172.21.15.45:0/2079706909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c7c004d10 0x7f6c7c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:59.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c94c8b640 1 --2- 172.21.15.45:0/2079706909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c7c003f00 0x7f6c7c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:59.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c9548c640 1 --2- 172.21.15.45:0/2079706909 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c900c2770 0x7f6c7c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:59.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c95c8d640 1 -- 172.21.15.45:0/2079706909 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c900c2770 msgr2=0x7f6c7c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:59.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c95c8d640 1 --2- 172.21.15.45:0/2079706909 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c900c2770 0x7f6c7c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c95c8d640 1 -- 172.21.15.45:0/2079706909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c7c003f00 msgr2=0x7f6c7c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:59.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c95c8d640 1 --2- 172.21.15.45:0/2079706909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c7c003f00 0x7f6c7c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.020+0000 7f6c95c8d640 1 -- 172.21.15.45:0/2079706909 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c003530 con 0x7f6c7c004d10 2023-10-03T19:12:59.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.024+0000 7f6c95c8d640 1 --2- 172.21.15.45:0/2079706909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c7c004d10 0x7f6c7c005180 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6c88009fc0 tx=0x7f6c8801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=130280bbc699bf7f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:59.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.024+0000 7f6c87fff640 1 -- 172.21.15.45:0/2079706909 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c880a5c70 con 0x7f6c7c004d10 2023-10-03T19:12:59.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.024+0000 7f6c87fff640 1 -- 172.21.15.45:0/2079706909 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8800f040 con 0x7f6c7c004d10 2023-10-03T19:12:59.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.024+0000 7f6c87fff640 1 -- 172.21.15.45:0/2079706909 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c880ad440 con 0x7f6c7c004d10 2023-10-03T19:12:59.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.024+0000 7f6c976f0640 1 -- 172.21.15.45:0/2079706909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c7c004d10 msgr2=0x7f6c7c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:59.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.024+0000 7f6c976f0640 1 --2- 172.21.15.45:0/2079706909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c7c004d10 0x7f6c7c005180 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6c88009fc0 tx=0x7f6c8801cc60 comp rx=0 tx=0).stop 2023-10-03T19:12:59.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.024+0000 7f6c95c8d640 1 -- 172.21.15.45:0/2079706909 reap_dead start 2023-10-03T19:12:59.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.024+0000 7f6c976f0640 1 -- 172.21.15.45:0/2079706909 shutdown_connections 2023-10-03T19:12:59.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.024+0000 7f6c976f0640 1 -- 172.21.15.45:0/2079706909 >> 172.21.15.45:0/2079706909 conn(0x7f6c900a6440 msgr2=0x7f6c900a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:59.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.024+0000 7f6c976f0640 1 -- 172.21.15.45:0/2079706909 shutdown_connections 2023-10-03T19:12:59.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.024+0000 7f6c976f0640 1 -- 172.21.15.45:0/2079706909 wait complete. 2023-10-03T19:12:59.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.024+0000 7f6c976f0640 1 Processor -- start 2023-10-03T19:12:59.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.024+0000 7f6c976f0640 1 -- start start 2023-10-03T19:12:59.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.028+0000 7f6c976f0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c901d9470 0x7f6c900a8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:59.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.028+0000 7f6c976f0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c901d9840 0x7f6c900bdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:59.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.028+0000 7f6c976f0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c901d9c70 0x7f6c900be010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:59.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.028+0000 7f6c976f0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c901e6e80 con 0x7f6c901d9840 2023-10-03T19:12:59.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.028+0000 7f6c976f0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c901e7120 con 0x7f6c901d9c70 2023-10-03T19:12:59.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.028+0000 7f6c976f0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c900a78e0 con 0x7f6c901d9470 2023-10-03T19:12:59.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.028+0000 7f6c94c8b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c901d9840 0x7f6c900bdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:59.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.028+0000 7f6c94c8b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c901d9840 0x7f6c900bdad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54134/0 (socket says 172.21.15.45:54134) 2023-10-03T19:12:59.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.028+0000 7f6c94c8b640 1 -- 172.21.15.45:0/3314475758 learned_addr learned my addr 172.21.15.45:0/3314475758 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:59.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.028+0000 7f6c95c8d640 1 --2- 172.21.15.45:0/3314475758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c901d9c70 0x7f6c900be010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:59.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.028+0000 7f6c9548c640 1 --2- 172.21.15.45:0/3314475758 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c901d9470 0x7f6c900a8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:59.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.028+0000 7f6c94c8b640 1 -- 172.21.15.45:0/3314475758 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c901d9470 msgr2=0x7f6c900a8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:59.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.028+0000 7f6c94c8b640 1 --2- 172.21.15.45:0/3314475758 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c901d9470 0x7f6c900a8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.028+0000 7f6c94c8b640 1 -- 172.21.15.45:0/3314475758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c901d9c70 msgr2=0x7f6c900be010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:59.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.028+0000 7f6c94c8b640 1 --2- 172.21.15.45:0/3314475758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c901d9c70 0x7f6c900be010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.028+0000 7f6c94c8b640 1 -- 172.21.15.45:0/3314475758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9014f530 con 0x7f6c901d9840 2023-10-03T19:12:59.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.028+0000 7f6c94c8b640 1 --2- 172.21.15.45:0/3314475758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c901d9840 0x7f6c900bdad0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000eb20 tx=0x7f6c800016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:59.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.028+0000 7f6c85ffb640 1 -- 172.21.15.45:0/3314475758 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8000c850 con 0x7f6c901d9840 2023-10-03T19:12:59.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.028+0000 7f6c85ffb640 1 -- 172.21.15.45:0/3314475758 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8000c9b0 con 0x7f6c901d9840 2023-10-03T19:12:59.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.028+0000 7f6c85ffb640 1 -- 172.21.15.45:0/3314475758 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8000cd40 con 0x7f6c901d9840 2023-10-03T19:12:59.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.028+0000 7f6c976f0640 1 -- 172.21.15.45:0/3314475758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c9014f250 con 0x7f6c901d9840 2023-10-03T19:12:59.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.028+0000 7f6c976f0640 1 -- 172.21.15.45:0/3314475758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c9006b100 con 0x7f6c901d9840 2023-10-03T19:12:59.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.028+0000 7f6c976f0640 1 -- 172.21.15.45:0/3314475758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c900a7740 con 0x7f6c901d9840 2023-10-03T19:12:59.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.028+0000 7f6c85ffb640 1 -- 172.21.15.45:0/3314475758 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6c8001d460 con 0x7f6c901d9840 2023-10-03T19:12:59.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.028+0000 7f6c85ffb640 1 --2- 172.21.15.45:0/3314475758 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6c740662b0 0x7f6c74068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:59.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.028+0000 7f6c85ffb640 1 -- 172.21.15.45:0/3314475758 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6c80083db0 con 0x7f6c901d9840 2023-10-03T19:12:59.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.028+0000 7f6c9548c640 1 --2- 172.21.15.45:0/3314475758 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6c740662b0 0x7f6c74068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:59.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.032+0000 7f6c9548c640 1 --2- 172.21.15.45:0/3314475758 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6c740662b0 0x7f6c74068760 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c009ad0 tx=0x7f6c8c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:59.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.032+0000 7f6c85ffb640 1 -- 172.21.15.45:0/3314475758 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6c900a7740 con 0x7f6c901d9840 2023-10-03T19:12:59.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.188+0000 7f6c976f0640 1 -- 172.21.15.45:0/3314475758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6c900a7740 con 0x7f6c901d9840 2023-10-03T19:12:59.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.188+0000 7f6c85ffb640 1 -- 172.21.15.45:0/3314475758 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6c900a7740 con 0x7f6c901d9840 2023-10-03T19:12:59.193 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:12:59.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.188+0000 7f6c976f0640 1 -- 172.21.15.45:0/3314475758 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6c740662b0 msgr2=0x7f6c74068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:59.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.188+0000 7f6c976f0640 1 --2- 172.21.15.45:0/3314475758 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6c740662b0 0x7f6c74068760 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c009ad0 tx=0x7f6c8c008040 comp rx=0 tx=0).stop 2023-10-03T19:12:59.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.188+0000 7f6c976f0640 1 -- 172.21.15.45:0/3314475758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c901d9840 msgr2=0x7f6c900bdad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:59.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.188+0000 7f6c976f0640 1 --2- 172.21.15.45:0/3314475758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c901d9840 0x7f6c900bdad0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000eb20 tx=0x7f6c800016f0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.188+0000 7f6c976f0640 1 -- 172.21.15.45:0/3314475758 shutdown_connections 2023-10-03T19:12:59.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.188+0000 7f6c976f0640 1 --2- 172.21.15.45:0/3314475758 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6c740662b0 0x7f6c74068760 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.188+0000 7f6c976f0640 1 --2- 172.21.15.45:0/3314475758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c901d9c70 0x7f6c900be010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.188+0000 7f6c976f0640 1 --2- 172.21.15.45:0/3314475758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c901d9840 0x7f6c900bdad0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.188+0000 7f6c976f0640 1 --2- 172.21.15.45:0/3314475758 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c901d9470 0x7f6c900a8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.188+0000 7f6c976f0640 1 -- 172.21.15.45:0/3314475758 >> 172.21.15.45:0/3314475758 conn(0x7f6c900a6440 msgr2=0x7f6c900a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:59.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.188+0000 7f6c976f0640 1 -- 172.21.15.45:0/3314475758 shutdown_connections 2023-10-03T19:12:59.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.188+0000 7f6c976f0640 1 -- 172.21.15.45:0/3314475758 wait complete. 2023-10-03T19:12:59.211 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T19:12:59.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.336+0000 7f50da0a7640 1 Processor -- start 2023-10-03T19:12:59.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.336+0000 7f50da0a7640 1 -- start start 2023-10-03T19:12:59.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.340+0000 7f50da0a7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f50d414f370 0x7f50d40ba140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:59.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.340+0000 7f50da0a7640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d40714d0 con 0x7f50d4070d80 2023-10-03T19:12:59.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.340+0000 7f50da0a7640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d40717b0 con 0x7f50d40ba680 2023-10-03T19:12:59.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.340+0000 7f50da0a7640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50d4151fa0 con 0x7f50d414f370 2023-10-03T19:12:59.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.340+0000 7f50d3fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f50d4070d80 0x7f50d41591b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38678/0 (socket says 172.21.15.45:38678) 2023-10-03T19:12:59.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.340+0000 7f50d3fff640 1 -- 172.21.15.45:0/1097231172 learned_addr learned my addr 172.21.15.45:0/1097231172 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:59.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.340+0000 7f50d37fe640 1 --2- 172.21.15.45:0/1097231172 >> v2:172.21.15.79:3300/0 conn(0x7f50d414f370 0x7f50d40ba140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:59.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.340+0000 7f50d27fc640 1 -- 172.21.15.45:0/1097231172 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3266953124 0 0) 0x7f50d40714d0 con 0x7f50d4070d80 2023-10-03T19:12:59.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.340+0000 7f50d27fc640 1 -- 172.21.15.45:0/1097231172 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50bc003530 con 0x7f50d4070d80 2023-10-03T19:12:59.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.340+0000 7f50d27fc640 1 -- 172.21.15.45:0/1097231172 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2308468232 0 0) 0x7f50bc003530 con 0x7f50d4070d80 2023-10-03T19:12:59.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.340+0000 7f50d27fc640 1 -- 172.21.15.45:0/1097231172 >> v2:172.21.15.79:3300/0 conn(0x7f50d414f370 msgr2=0x7f50d40ba140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:59.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.340+0000 7f50d27fc640 1 --2- 172.21.15.45:0/1097231172 >> v2:172.21.15.79:3300/0 conn(0x7f50d414f370 0x7f50d40ba140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.340+0000 7f50d27fc640 1 -- 172.21.15.45:0/1097231172 >> v1:172.21.15.79:6789/0 conn(0x7f50d40ba680 legacy=0x7f50d41524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:59.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.340+0000 7f50d27fc640 1 -- 172.21.15.45:0/1097231172 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d414f740 con 0x7f50d4070d80 2023-10-03T19:12:59.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.340+0000 7f50d27fc640 1 -- 172.21.15.45:0/1097231172 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f50cc001a00 con 0x7f50d4070d80 2023-10-03T19:12:59.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.340+0000 7f50d27fc640 1 -- 172.21.15.45:0/1097231172 >> v1:172.21.15.45:6789/0 conn(0x7f50d4070d80 legacy=0x7f50d41591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:59.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.340+0000 7f50d27fc640 1 --2- 172.21.15.45:0/1097231172 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f50bc003980 0x7f50bc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:59.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.340+0000 7f50d27fc640 1 --2- 172.21.15.45:0/1097231172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50bc0047d0 0x7f50bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:59.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.340+0000 7f50d27fc640 1 --2- 172.21.15.45:0/1097231172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50bc005180 0x7f50bc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:59.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.340+0000 7f50d27fc640 1 -- 172.21.15.45:0/1097231172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d4151fa0 con 0x7f50bc005180 2023-10-03T19:12:59.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.340+0000 7f50d27fc640 1 -- 172.21.15.45:0/1097231172 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc00bfe0 con 0x7f50bc0047d0 2023-10-03T19:12:59.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.340+0000 7f50d27fc640 1 -- 172.21.15.45:0/1097231172 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc00c1a0 con 0x7f50bc003980 2023-10-03T19:12:59.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.340+0000 7f50d3fff640 1 --2- 172.21.15.45:0/1097231172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50bc005180 0x7f50bc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:59.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.340+0000 7f50d37fe640 1 --2- 172.21.15.45:0/1097231172 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f50bc003980 0x7f50bc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:59.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.340+0000 7f50d2ffd640 1 --2- 172.21.15.45:0/1097231172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50bc0047d0 0x7f50bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:59.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.340+0000 7f50d3fff640 1 -- 172.21.15.45:0/1097231172 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f50bc003980 msgr2=0x7f50bc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:59.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.340+0000 7f50d3fff640 1 --2- 172.21.15.45:0/1097231172 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f50bc003980 0x7f50bc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.340+0000 7f50d3fff640 1 -- 172.21.15.45:0/1097231172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50bc0047d0 msgr2=0x7f50bc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:59.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.340+0000 7f50d3fff640 1 --2- 172.21.15.45:0/1097231172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50bc0047d0 0x7f50bc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.340+0000 7f50d3fff640 1 -- 172.21.15.45:0/1097231172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50bc003530 con 0x7f50bc005180 2023-10-03T19:12:59.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.344+0000 7f50d3fff640 1 -- 172.21.15.45:0/1097231172 reap_dead start 2023-10-03T19:12:59.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.344+0000 7f50d3fff640 1 --2- 172.21.15.45:0/1097231172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50bc005180 0x7f50bc00b990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00a830 tx=0x7f50cc01d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4982ff8c48a3d478 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:59.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.344+0000 7f50d27fc640 1 -- 172.21.15.45:0/1097231172 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0072d0 con 0x7f50bc005180 2023-10-03T19:12:59.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.344+0000 7f50d27fc640 1 -- 172.21.15.45:0/1097231172 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50cc0a8070 con 0x7f50bc005180 2023-10-03T19:12:59.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.344+0000 7f50d27fc640 1 -- 172.21.15.45:0/1097231172 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0076b0 con 0x7f50bc005180 2023-10-03T19:12:59.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.344+0000 7f50da0a7640 1 -- 172.21.15.45:0/1097231172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50bc005180 msgr2=0x7f50bc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:59.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.344+0000 7f50da0a7640 1 --2- 172.21.15.45:0/1097231172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50bc005180 0x7f50bc00b990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00a830 tx=0x7f50cc01d340 comp rx=0 tx=0).stop 2023-10-03T19:12:59.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.344+0000 7f50da0a7640 1 -- 172.21.15.45:0/1097231172 shutdown_connections 2023-10-03T19:12:59.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.344+0000 7f50da0a7640 1 --2- 172.21.15.45:0/1097231172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50bc005180 0x7f50bc00b990 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.344+0000 7f50da0a7640 1 -- 172.21.15.45:0/1097231172 >> 172.21.15.45:0/1097231172 conn(0x7f50d40c0d00 msgr2=0x7f50d40c1100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:59.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.344+0000 7f50da0a7640 1 -- 172.21.15.45:0/1097231172 shutdown_connections 2023-10-03T19:12:59.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.344+0000 7f50da0a7640 1 -- 172.21.15.45:0/1097231172 wait complete. 2023-10-03T19:12:59.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.344+0000 7f50da0a7640 1 Processor -- start 2023-10-03T19:12:59.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.344+0000 7f50da0a7640 1 -- start start 2023-10-03T19:12:59.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.344+0000 7f50da0a7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50bc005180 0x7f50d40bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:59.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.344+0000 7f50da0a7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50d40c0300 0x7f50d41e3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:59.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.344+0000 7f50da0a7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f50d4148ef0 0x7f50d41e4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:59.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.344+0000 7f50da0a7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d41e3720 con 0x7f50bc005180 2023-10-03T19:12:59.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.344+0000 7f50da0a7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d41519c0 con 0x7f50d40c0300 2023-10-03T19:12:59.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.344+0000 7f50da0a7640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d414aeb0 con 0x7f50d4148ef0 2023-10-03T19:12:59.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.344+0000 7f50d37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50bc005180 0x7f50d40bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:59.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.344+0000 7f50d37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50bc005180 0x7f50d40bfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54148/0 (socket says 172.21.15.45:54148) 2023-10-03T19:12:59.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.344+0000 7f50d37fe640 1 -- 172.21.15.45:0/2044955619 learned_addr learned my addr 172.21.15.45:0/2044955619 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:59.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.344+0000 7f50d2ffd640 1 --2- 172.21.15.45:0/2044955619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50d40c0300 0x7f50d41e3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:59.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.348+0000 7f50d3fff640 1 --2- 172.21.15.45:0/2044955619 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f50d4148ef0 0x7f50d41e4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:59.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.348+0000 7f50d37fe640 1 -- 172.21.15.45:0/2044955619 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f50d4148ef0 msgr2=0x7f50d41e4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:59.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.348+0000 7f50d37fe640 1 --2- 172.21.15.45:0/2044955619 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f50d4148ef0 0x7f50d41e4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.348+0000 7f50d37fe640 1 -- 172.21.15.45:0/2044955619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50d40c0300 msgr2=0x7f50d41e3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:59.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.348+0000 7f50d37fe640 1 --2- 172.21.15.45:0/2044955619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50d40c0300 0x7f50d41e3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.348+0000 7f50d37fe640 1 -- 172.21.15.45:0/2044955619 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d40bad30 con 0x7f50bc005180 2023-10-03T19:12:59.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.348+0000 7f50d3fff640 1 --2- 172.21.15.45:0/2044955619 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f50d4148ef0 0x7f50d41e4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:12:59.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.348+0000 7f50d37fe640 1 --2- 172.21.15.45:0/2044955619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50bc005180 0x7f50d40bfdc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f50c4011560 tx=0x7f50c4011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:59.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.348+0000 7f50bbfff640 1 -- 172.21.15.45:0/2044955619 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c4015930 con 0x7f50bc005180 2023-10-03T19:12:59.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.348+0000 7f50bbfff640 1 -- 172.21.15.45:0/2044955619 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c4015a90 con 0x7f50bc005180 2023-10-03T19:12:59.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.348+0000 7f50bbfff640 1 -- 172.21.15.45:0/2044955619 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c4015e20 con 0x7f50bc005180 2023-10-03T19:12:59.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.348+0000 7f50da0a7640 1 -- 172.21.15.45:0/2044955619 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50d40baba0 con 0x7f50bc005180 2023-10-03T19:12:59.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.348+0000 7f50da0a7640 1 -- 172.21.15.45:0/2044955619 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d414e830 con 0x7f50bc005180 2023-10-03T19:12:59.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.348+0000 7f50da0a7640 1 -- 172.21.15.45:0/2044955619 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50d404de80 con 0x7f50bc005180 2023-10-03T19:12:59.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.348+0000 7f50bbfff640 1 -- 172.21.15.45:0/2044955619 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f50c400f460 con 0x7f50bc005180 2023-10-03T19:12:59.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.348+0000 7f50bbfff640 1 --2- 172.21.15.45:0/2044955619 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f50c0066280 0x7f50c0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:59.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.348+0000 7f50bbfff640 1 -- 172.21.15.45:0/2044955619 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f50c4084490 con 0x7f50bc005180 2023-10-03T19:12:59.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.348+0000 7f50d2ffd640 1 --2- 172.21.15.45:0/2044955619 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f50c0066280 0x7f50c0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:59.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.348+0000 7f50d2ffd640 1 --2- 172.21.15.45:0/2044955619 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f50c0066280 0x7f50c0068730 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f50d4098c90 tx=0x7f50c8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:59.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.352+0000 7f50bbfff640 1 -- 172.21.15.45:0/2044955619 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f50c4055430 con 0x7f50bc005180 2023-10-03T19:12:59.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.504+0000 7f50da0a7640 1 -- 172.21.15.45:0/2044955619 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f50d406d4d0 con 0x7f50bc005180 2023-10-03T19:12:59.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.504+0000 7f50bbfff640 1 -- 172.21.15.45:0/2044955619 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f50c4054fc0 con 0x7f50bc005180 2023-10-03T19:12:59.511 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-03T19:12:59.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.508+0000 7f50da0a7640 1 -- 172.21.15.45:0/2044955619 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f50c0066280 msgr2=0x7f50c0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:59.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.508+0000 7f50da0a7640 1 --2- 172.21.15.45:0/2044955619 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f50c0066280 0x7f50c0068730 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f50d4098c90 tx=0x7f50c8009040 comp rx=0 tx=0).stop 2023-10-03T19:12:59.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.508+0000 7f50da0a7640 1 -- 172.21.15.45:0/2044955619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50bc005180 msgr2=0x7f50d40bfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:59.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.508+0000 7f50da0a7640 1 --2- 172.21.15.45:0/2044955619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50bc005180 0x7f50d40bfdc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f50c4011560 tx=0x7f50c4011a20 comp rx=0 tx=0).stop 2023-10-03T19:12:59.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.508+0000 7f50da0a7640 1 -- 172.21.15.45:0/2044955619 shutdown_connections 2023-10-03T19:12:59.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.508+0000 7f50da0a7640 1 --2- 172.21.15.45:0/2044955619 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f50c0066280 0x7f50c0068730 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.508+0000 7f50da0a7640 1 --2- 172.21.15.45:0/2044955619 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f50d4148ef0 0x7f50d41e4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.508+0000 7f50da0a7640 1 --2- 172.21.15.45:0/2044955619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50d40c0300 0x7f50d41e3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.508+0000 7f50da0a7640 1 --2- 172.21.15.45:0/2044955619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50bc005180 0x7f50d40bfdc0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.508+0000 7f50da0a7640 1 -- 172.21.15.45:0/2044955619 >> 172.21.15.45:0/2044955619 conn(0x7f50d40c0d00 msgr2=0x7f50d414c350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:59.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.508+0000 7f50da0a7640 1 -- 172.21.15.45:0/2044955619 shutdown_connections 2023-10-03T19:12:59.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.508+0000 7f50da0a7640 1 -- 172.21.15.45:0/2044955619 wait complete. 2023-10-03T19:12:59.530 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T19:12:59.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.644+0000 7fe0db77e640 1 Processor -- start 2023-10-03T19:12:59.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.644+0000 7fe0db77e640 1 -- start start 2023-10-03T19:12:59.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.644+0000 7fe0db77e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0d414f510 0x7fe0d414b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:59.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.644+0000 7fe0db77e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe0d40bd9f0 0x7fe0d414b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:59.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.644+0000 7fe0db77e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d414f080 con 0x7fe0d406f880 2023-10-03T19:12:59.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.644+0000 7fe0db77e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0d406f3e0 con 0x7fe0d40bd9f0 2023-10-03T19:12:59.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.644+0000 7fe0db77e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d4070e90 con 0x7fe0d414f510 2023-10-03T19:12:59.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.644+0000 7fe0d951a640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe0d406f880 0x7fe0d40a5940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38684/0 (socket says 172.21.15.45:38684) 2023-10-03T19:12:59.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.644+0000 7fe0d951a640 1 -- 172.21.15.45:0/2705237475 learned_addr learned my addr 172.21.15.45:0/2705237475 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:12:59.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.644+0000 7fe0d9d1b640 1 --2- 172.21.15.45:0/2705237475 >> v2:172.21.15.45:3300/0 conn(0x7fe0d40bd9f0 0x7fe0d414b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:59.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.644+0000 7fe0d8d19640 1 --2- 172.21.15.45:0/2705237475 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0d414f510 0x7fe0d414b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:59.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.644+0000 7fe0cbfff640 1 -- 172.21.15.45:0/2705237475 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1957538347 0 0) 0x7fe0d414f080 con 0x7fe0d406f880 2023-10-03T19:12:59.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.644+0000 7fe0d9d1b640 1 -- 172.21.15.45:0/2705237475 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0d414f510 msgr2=0x7fe0d414b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:59.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.644+0000 7fe0d9d1b640 1 --2- 172.21.15.45:0/2705237475 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0d414f510 0x7fe0d414b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.644+0000 7fe0d9d1b640 1 -- 172.21.15.45:0/2705237475 >> v1:172.21.15.45:6789/0 conn(0x7fe0d406f880 legacy=0x7fe0d40a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:59.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.644+0000 7fe0d9d1b640 1 -- 172.21.15.45:0/2705237475 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d414ea30 con 0x7fe0d40bd9f0 2023-10-03T19:12:59.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.644+0000 7fe0d8d19640 1 --2- 172.21.15.45:0/2705237475 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0d414f510 0x7fe0d414b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:12:59.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0d9d1b640 1 --2- 172.21.15.45:0/2705237475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0d40bd9f0 0x7fe0d414b860 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc009d90 tx=0x7fe0cc01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6215bd797aa218 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:59.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0cbfff640 1 -- 172.21.15.45:0/2705237475 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc0a5940 con 0x7fe0d40bd9f0 2023-10-03T19:12:59.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0cbfff640 1 -- 172.21.15.45:0/2705237475 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0cc0a5aa0 con 0x7fe0d40bd9f0 2023-10-03T19:12:59.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0cbfff640 1 -- 172.21.15.45:0/2705237475 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc0a5e30 con 0x7fe0d40bd9f0 2023-10-03T19:12:59.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0db77e640 1 -- 172.21.15.45:0/2705237475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0d40bd9f0 msgr2=0x7fe0d414b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:59.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0db77e640 1 --2- 172.21.15.45:0/2705237475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0d40bd9f0 0x7fe0d414b860 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc009d90 tx=0x7fe0cc01c920 comp rx=0 tx=0).stop 2023-10-03T19:12:59.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0db77e640 1 -- 172.21.15.45:0/2705237475 shutdown_connections 2023-10-03T19:12:59.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0db77e640 1 --2- 172.21.15.45:0/2705237475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0d40bd9f0 0x7fe0d414b860 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0db77e640 1 --2- 172.21.15.45:0/2705237475 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0d414f510 0x7fe0d414b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0db77e640 1 -- 172.21.15.45:0/2705237475 >> 172.21.15.45:0/2705237475 conn(0x7fe0d40a20d0 msgr2=0x7fe0d40a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:59.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0db77e640 1 -- 172.21.15.45:0/2705237475 shutdown_connections 2023-10-03T19:12:59.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0db77e640 1 -- 172.21.15.45:0/2705237475 wait complete. 2023-10-03T19:12:59.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0db77e640 1 Processor -- start 2023-10-03T19:12:59.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0db77e640 1 -- start start 2023-10-03T19:12:59.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0db77e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0d406f880 0x7fe0d40a2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:59.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0db77e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0d40bd9f0 0x7fe0d4146000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:59.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0db77e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0d414f510 0x7fe0d4146540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:59.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0db77e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d4145bb0 con 0x7fe0d406f880 2023-10-03T19:12:59.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0db77e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d4146a80 con 0x7fe0d40bd9f0 2023-10-03T19:12:59.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0db77e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d4148490 con 0x7fe0d414f510 2023-10-03T19:12:59.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0d951a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0d406f880 0x7fe0d40a2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:59.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0d951a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0d406f880 0x7fe0d40a2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54168/0 (socket says 172.21.15.45:54168) 2023-10-03T19:12:59.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0d951a640 1 -- 172.21.15.45:0/968747480 learned_addr learned my addr 172.21.15.45:0/968747480 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:59.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0d8d19640 1 --2- 172.21.15.45:0/968747480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0d40bd9f0 0x7fe0d4146000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:59.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0d9d1b640 1 --2- 172.21.15.45:0/968747480 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0d414f510 0x7fe0d4146540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:59.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0d951a640 1 -- 172.21.15.45:0/968747480 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0d414f510 msgr2=0x7fe0d4146540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:59.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0d951a640 1 --2- 172.21.15.45:0/968747480 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0d414f510 0x7fe0d4146540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0d951a640 1 -- 172.21.15.45:0/968747480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0d40bd9f0 msgr2=0x7fe0d4146000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:59.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0d951a640 1 --2- 172.21.15.45:0/968747480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0d40bd9f0 0x7fe0d4146000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0d951a640 1 -- 172.21.15.45:0/968747480 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0cc009a70 con 0x7fe0d406f880 2023-10-03T19:12:59.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.648+0000 7fe0d951a640 1 --2- 172.21.15.45:0/968747480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0d406f880 0x7fe0d40a2820 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000c4b0 tx=0x7fe0d000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:59.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.652+0000 7fe0c9ffb640 1 -- 172.21.15.45:0/968747480 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d00074e0 con 0x7fe0d406f880 2023-10-03T19:12:59.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.652+0000 7fe0c9ffb640 1 -- 172.21.15.45:0/968747480 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d0007660 con 0x7fe0d406f880 2023-10-03T19:12:59.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.652+0000 7fe0db77e640 1 -- 172.21.15.45:0/968747480 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d40a6050 con 0x7fe0d406f880 2023-10-03T19:12:59.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.652+0000 7fe0c9ffb640 1 -- 172.21.15.45:0/968747480 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0004a30 con 0x7fe0d406f880 2023-10-03T19:12:59.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.652+0000 7fe0db77e640 1 -- 172.21.15.45:0/968747480 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d406fc50 con 0x7fe0d406f880 2023-10-03T19:12:59.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.652+0000 7fe0db77e640 1 -- 172.21.15.45:0/968747480 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d40a61e0 con 0x7fe0d406f880 2023-10-03T19:12:59.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.652+0000 7fe0c9ffb640 1 -- 172.21.15.45:0/968747480 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe0d0004b90 con 0x7fe0d406f880 2023-10-03T19:12:59.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.652+0000 7fe0c9ffb640 1 --2- 172.21.15.45:0/968747480 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe0b80662b0 0x7fe0b8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:59.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.652+0000 7fe0c9ffb640 1 -- 172.21.15.45:0/968747480 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe0d00830d0 con 0x7fe0d406f880 2023-10-03T19:12:59.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.652+0000 7fe0d8d19640 1 --2- 172.21.15.45:0/968747480 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe0b80662b0 0x7fe0b8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:59.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.652+0000 7fe0d8d19640 1 --2- 172.21.15.45:0/968747480 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe0b80662b0 0x7fe0b8068760 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4145a50 tx=0x7fe0c4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:59.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.656+0000 7fe0c9ffb640 1 -- 172.21.15.45:0/968747480 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe0d00505e0 con 0x7fe0d406f880 2023-10-03T19:12:59.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.808+0000 7fe0db77e640 1 -- 172.21.15.45:0/968747480 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe0d404de80 con 0x7fe0d406f880 2023-10-03T19:12:59.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.808+0000 7fe0c9ffb640 1 -- 172.21.15.45:0/968747480 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe0d0053c00 con 0x7fe0d406f880 2023-10-03T19:12:59.815 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-03T19:12:59.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.812+0000 7fe0db77e640 1 -- 172.21.15.45:0/968747480 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe0b80662b0 msgr2=0x7fe0b8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:59.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.812+0000 7fe0db77e640 1 --2- 172.21.15.45:0/968747480 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe0b80662b0 0x7fe0b8068760 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4145a50 tx=0x7fe0c4008040 comp rx=0 tx=0).stop 2023-10-03T19:12:59.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.812+0000 7fe0db77e640 1 -- 172.21.15.45:0/968747480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0d406f880 msgr2=0x7fe0d40a2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:59.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.812+0000 7fe0db77e640 1 --2- 172.21.15.45:0/968747480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0d406f880 0x7fe0d40a2820 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000c4b0 tx=0x7fe0d000c970 comp rx=0 tx=0).stop 2023-10-03T19:12:59.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.812+0000 7fe0db77e640 1 -- 172.21.15.45:0/968747480 shutdown_connections 2023-10-03T19:12:59.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.812+0000 7fe0db77e640 1 --2- 172.21.15.45:0/968747480 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe0b80662b0 0x7fe0b8068760 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.812+0000 7fe0db77e640 1 --2- 172.21.15.45:0/968747480 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0d414f510 0x7fe0d4146540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.812+0000 7fe0db77e640 1 --2- 172.21.15.45:0/968747480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0d40bd9f0 0x7fe0d4146000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.812+0000 7fe0db77e640 1 --2- 172.21.15.45:0/968747480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0d406f880 0x7fe0d40a2820 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.812+0000 7fe0db77e640 1 -- 172.21.15.45:0/968747480 >> 172.21.15.45:0/968747480 conn(0x7fe0d40a20d0 msgr2=0x7fe0d414b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:59.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.812+0000 7fe0db77e640 1 -- 172.21.15.45:0/968747480 shutdown_connections 2023-10-03T19:12:59.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.812+0000 7fe0db77e640 1 -- 172.21.15.45:0/968747480 wait complete. 2023-10-03T19:12:59.834 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-03T19:12:59.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.952+0000 7f18056fb640 1 Processor -- start 2023-10-03T19:12:59.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.952+0000 7f18056fb640 1 -- start start 2023-10-03T19:12:59.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.952+0000 7f18056fb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18000bc8b0 0x7f180014ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:59.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.952+0000 7f18056fb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f180006d170 0x7f180014cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:59.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.952+0000 7f18056fb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180006cac0 con 0x7f180006f170 2023-10-03T19:12:59.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.952+0000 7f18056fb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f180014d4f0 con 0x7f180006d170 2023-10-03T19:12:59.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.952+0000 7f18056fb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18000720d0 con 0x7f18000bc8b0 2023-10-03T19:12:59.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.952+0000 7f17ff7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f180006d170 0x7f180014cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:59.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.952+0000 7f17ff7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f180006d170 0x7f180014cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54184/0 (socket says 172.21.15.45:54184) 2023-10-03T19:12:59.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.952+0000 7f17ff7fe640 1 -- 172.21.15.45:0/3175906866 learned_addr learned my addr 172.21.15.45:0/3175906866 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:59.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.952+0000 7f17fe7fc640 1 --2- 172.21.15.45:0/3175906866 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18000bc8b0 0x7f180014ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:59.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.952+0000 7f17ff7fe640 1 -- 172.21.15.45:0/3175906866 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18000bc8b0 msgr2=0x7f180014ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:12:59.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.952+0000 7f17ff7fe640 1 --2- 172.21.15.45:0/3175906866 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18000bc8b0 0x7f180014ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.952+0000 7f17ff7fe640 1 -- 172.21.15.45:0/3175906866 >> v1:172.21.15.45:6789/0 conn(0x7f180006f170 legacy=0x7f1800150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:59.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.952+0000 7f17ff7fe640 1 -- 172.21.15.45:0/3175906866 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18000a5ab0 con 0x7f180006d170 2023-10-03T19:12:59.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.952+0000 7f17fdffb640 1 -- 172.21.15.45:0/3175906866 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078653199 0 0) 0x7f17f0001120 con 0x7f180006f170 2023-10-03T19:12:59.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.956+0000 7f17ff7fe640 1 --2- 172.21.15.45:0/3175906866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f180006d170 0x7f180014cfb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f17f8009870 tx=0x7f17f801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22dfdbc5a22c3ea9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:59.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.956+0000 7f17fdffb640 1 -- 172.21.15.45:0/3175906866 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f80a8a30 con 0x7f180006d170 2023-10-03T19:12:59.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.956+0000 7f17fdffb640 1 -- 172.21.15.45:0/3175906866 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f80a8b90 con 0x7f180006d170 2023-10-03T19:12:59.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.956+0000 7f17fdffb640 1 -- 172.21.15.45:0/3175906866 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f80b0440 con 0x7f180006d170 2023-10-03T19:12:59.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.956+0000 7f18056fb640 1 -- 172.21.15.45:0/3175906866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f180006d170 msgr2=0x7f180014cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:59.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.956+0000 7f18056fb640 1 --2- 172.21.15.45:0/3175906866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f180006d170 0x7f180014cfb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f17f8009870 tx=0x7f17f801ed30 comp rx=0 tx=0).stop 2023-10-03T19:12:59.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.956+0000 7f18056fb640 1 -- 172.21.15.45:0/3175906866 shutdown_connections 2023-10-03T19:12:59.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.956+0000 7f18056fb640 1 --2- 172.21.15.45:0/3175906866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f180006d170 0x7f180014cfb0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.956+0000 7f18056fb640 1 --2- 172.21.15.45:0/3175906866 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18000bc8b0 0x7f180014ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.956+0000 7f18056fb640 1 -- 172.21.15.45:0/3175906866 >> 172.21.15.45:0/3175906866 conn(0x7f18000bcf50 msgr2=0x7f18000bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:12:59.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.956+0000 7f18056fb640 1 -- 172.21.15.45:0/3175906866 shutdown_connections 2023-10-03T19:12:59.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.956+0000 7f18056fb640 1 -- 172.21.15.45:0/3175906866 wait complete. 2023-10-03T19:12:59.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.956+0000 7f18056fb640 1 Processor -- start 2023-10-03T19:12:59.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.956+0000 7f18056fb640 1 -- start start 2023-10-03T19:12:59.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.960+0000 7f18056fb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f180006d170 0x7f1800146bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:59.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.960+0000 7f18056fb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f180006f170 0x7f18000b9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:59.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.960+0000 7f18056fb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18000bc8b0 0x7f1800138500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:59.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.960+0000 7f18056fb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18001484b0 con 0x7f18000bc8b0 2023-10-03T19:12:59.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.960+0000 7f18056fb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18000ba090 con 0x7f180006d170 2023-10-03T19:12:59.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.960+0000 7f18056fb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1800148720 con 0x7f180006f170 2023-10-03T19:12:59.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.960+0000 7f17ff7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18000bc8b0 0x7f1800138500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:59.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.960+0000 7f17ff7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18000bc8b0 0x7f1800138500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54196/0 (socket says 172.21.15.45:54196) 2023-10-03T19:12:59.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.960+0000 7f17ff7fe640 1 -- 172.21.15.45:0/1504324416 learned_addr learned my addr 172.21.15.45:0/1504324416 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:12:59.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.960+0000 7f17feffd640 1 --2- 172.21.15.45:0/1504324416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f180006d170 0x7f1800146bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:59.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.960+0000 7f17fe7fc640 1 --2- 172.21.15.45:0/1504324416 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f180006f170 0x7f18000b9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:59.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.960+0000 7f17ff7fe640 1 -- 172.21.15.45:0/1504324416 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f180006f170 msgr2=0x7f18000b9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:59.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.960+0000 7f17ff7fe640 1 --2- 172.21.15.45:0/1504324416 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f180006f170 0x7f18000b9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.960+0000 7f17ff7fe640 1 -- 172.21.15.45:0/1504324416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f180006d170 msgr2=0x7f1800146bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:12:59.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.960+0000 7f17ff7fe640 1 --2- 172.21.15.45:0/1504324416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f180006d170 0x7f1800146bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:12:59.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.960+0000 7f17ff7fe640 1 -- 172.21.15.45:0/1504324416 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f80094d0 con 0x7f18000bc8b0 2023-10-03T19:12:59.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.960+0000 7f17ff7fe640 1 --2- 172.21.15.45:0/1504324416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18000bc8b0 0x7f1800138500 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f17f801d3e0 tx=0x7f17f801d570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:59.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.960+0000 7f17e77fe640 1 -- 172.21.15.45:0/1504324416 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f80b1e90 con 0x7f18000bc8b0 2023-10-03T19:12:59.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.960+0000 7f17e77fe640 1 -- 172.21.15.45:0/1504324416 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f8004030 con 0x7f18000bc8b0 2023-10-03T19:12:59.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.960+0000 7f17e77fe640 1 -- 172.21.15.45:0/1504324416 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f80043a0 con 0x7f18000bc8b0 2023-10-03T19:12:59.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.960+0000 7f18056fb640 1 -- 172.21.15.45:0/1504324416 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f180014fae0 con 0x7f18000bc8b0 2023-10-03T19:12:59.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.960+0000 7f18056fb640 1 -- 172.21.15.45:0/1504324416 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f180006cd00 con 0x7f18000bc8b0 2023-10-03T19:12:59.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.960+0000 7f18056fb640 1 -- 172.21.15.45:0/1504324416 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f180006d660 con 0x7f18000bc8b0 2023-10-03T19:12:59.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.960+0000 7f17e77fe640 1 -- 172.21.15.45:0/1504324416 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f17f80b7040 con 0x7f18000bc8b0 2023-10-03T19:12:59.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.960+0000 7f17e77fe640 1 --2- 172.21.15.45:0/1504324416 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f17ec066280 0x7f17ec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:12:59.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.960+0000 7f17e77fe640 1 -- 172.21.15.45:0/1504324416 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f17f8121070 con 0x7f18000bc8b0 2023-10-03T19:12:59.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.960+0000 7f17feffd640 1 --2- 172.21.15.45:0/1504324416 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f17ec066280 0x7f17ec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:12:59.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.964+0000 7f17feffd640 1 --2- 172.21.15.45:0/1504324416 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f17ec066280 0x7f17ec068730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f17f0000f70 tx=0x7f17f0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:12:59.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:12:59.968+0000 7f17e77fe640 1 -- 172.21.15.45:0/1504324416 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f17f80ee610 con 0x7f18000bc8b0 2023-10-03T19:13:00.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.128+0000 7f18056fb640 1 -- 172.21.15.45:0/1504324416 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f180014c480 con 0x7f18000bc8b0 2023-10-03T19:13:00.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.128+0000 7f17e77fe640 1 -- 172.21.15.45:0/1504324416 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f17f80f1c30 con 0x7f18000bc8b0 2023-10-03T19:13:00.133 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-10-03T19:13:00.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.128+0000 7f18056fb640 1 -- 172.21.15.45:0/1504324416 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f17ec066280 msgr2=0x7f17ec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:00.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.128+0000 7f18056fb640 1 --2- 172.21.15.45:0/1504324416 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f17ec066280 0x7f17ec068730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f17f0000f70 tx=0x7f17f0009040 comp rx=0 tx=0).stop 2023-10-03T19:13:00.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.128+0000 7f18056fb640 1 -- 172.21.15.45:0/1504324416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18000bc8b0 msgr2=0x7f1800138500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:00.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.128+0000 7f18056fb640 1 --2- 172.21.15.45:0/1504324416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18000bc8b0 0x7f1800138500 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f17f801d3e0 tx=0x7f17f801d570 comp rx=0 tx=0).stop 2023-10-03T19:13:00.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.132+0000 7f18056fb640 1 -- 172.21.15.45:0/1504324416 shutdown_connections 2023-10-03T19:13:00.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.132+0000 7f18056fb640 1 --2- 172.21.15.45:0/1504324416 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f17ec066280 0x7f17ec068730 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:00.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.132+0000 7f18056fb640 1 --2- 172.21.15.45:0/1504324416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18000bc8b0 0x7f1800138500 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:00.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.132+0000 7f18056fb640 1 --2- 172.21.15.45:0/1504324416 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f180006f170 0x7f18000b9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:00.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.132+0000 7f18056fb640 1 --2- 172.21.15.45:0/1504324416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f180006d170 0x7f1800146bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:00.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.132+0000 7f18056fb640 1 -- 172.21.15.45:0/1504324416 >> 172.21.15.45:0/1504324416 conn(0x7f18000bcf50 msgr2=0x7f18000bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:00.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.132+0000 7f18056fb640 1 -- 172.21.15.45:0/1504324416 shutdown_connections 2023-10-03T19:13:00.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.132+0000 7f18056fb640 1 -- 172.21.15.45:0/1504324416 wait complete. 2023-10-03T19:13:00.151 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:13:00.151 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:13:00.158 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:13:00.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.264+0000 7f591f509640 1 Processor -- start 2023-10-03T19:13:00.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.264+0000 7f591f509640 1 -- start start 2023-10-03T19:13:00.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.264+0000 7f591f509640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5918150400 0x7f591806c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:00.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.264+0000 7f591f509640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f59180bca80 0x7f5918156820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:00.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.264+0000 7f591f509640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59180a1720 con 0x7f591806c620 2023-10-03T19:13:00.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.264+0000 7f591f509640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59180a2230 con 0x7f59180bca80 2023-10-03T19:13:00.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.264+0000 7f591f509640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59180a18d0 con 0x7f5918150400 2023-10-03T19:13:00.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.264+0000 7f591caa4640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f591806c620 0x7f5918156110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38704/0 (socket says 172.21.15.45:38704) 2023-10-03T19:13:00.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.264+0000 7f591caa4640 1 -- 172.21.15.45:0/941022899 learned_addr learned my addr 172.21.15.45:0/941022899 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:00.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.264+0000 7f591daa6640 1 --2- 172.21.15.45:0/941022899 >> v2:172.21.15.45:3300/0 conn(0x7f59180bca80 0x7f5918156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:00.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.264+0000 7f591d2a5640 1 --2- 172.21.15.45:0/941022899 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5918150400 0x7f591806c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:00.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.264+0000 7f590bfff640 1 -- 172.21.15.45:0/941022899 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3230794987 0 0) 0x7f59180a1720 con 0x7f591806c620 2023-10-03T19:13:00.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.264+0000 7f590bfff640 1 -- 172.21.15.45:0/941022899 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5904003530 con 0x7f591806c620 2023-10-03T19:13:00.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.264+0000 7f591daa6640 1 -- 172.21.15.45:0/941022899 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5918150400 msgr2=0x7f591806c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:00.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.264+0000 7f591daa6640 1 --2- 172.21.15.45:0/941022899 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5918150400 0x7f591806c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:00.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.264+0000 7f591daa6640 1 -- 172.21.15.45:0/941022899 >> v1:172.21.15.45:6789/0 conn(0x7f591806c620 legacy=0x7f5918156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:00.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.264+0000 7f591daa6640 1 -- 172.21.15.45:0/941022899 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59181507d0 con 0x7f59180bca80 2023-10-03T19:13:00.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.264+0000 7f591daa6640 1 --2- 172.21.15.45:0/941022899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59180bca80 0x7f5918156820 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f59100097c0 tx=0x7f591001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1edf4fbb32846e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:00.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.264+0000 7f590bfff640 1 -- 172.21.15.45:0/941022899 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59100ab600 con 0x7f59180bca80 2023-10-03T19:13:00.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.264+0000 7f590bfff640 1 -- 172.21.15.45:0/941022899 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59100a7050 con 0x7f59180bca80 2023-10-03T19:13:00.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.264+0000 7f590bfff640 1 -- 172.21.15.45:0/941022899 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59100ab980 con 0x7f59180bca80 2023-10-03T19:13:00.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f591f509640 1 -- 172.21.15.45:0/941022899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59180bca80 msgr2=0x7f5918156820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:00.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f591f509640 1 --2- 172.21.15.45:0/941022899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59180bca80 0x7f5918156820 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f59100097c0 tx=0x7f591001c3f0 comp rx=0 tx=0).stop 2023-10-03T19:13:00.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f591f509640 1 -- 172.21.15.45:0/941022899 shutdown_connections 2023-10-03T19:13:00.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f591f509640 1 --2- 172.21.15.45:0/941022899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59180bca80 0x7f5918156820 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:00.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f591f509640 1 --2- 172.21.15.45:0/941022899 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5918150400 0x7f591806c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:00.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f591f509640 1 -- 172.21.15.45:0/941022899 >> 172.21.15.45:0/941022899 conn(0x7f59180bcf50 msgr2=0x7f59180bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:00.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f591f509640 1 -- 172.21.15.45:0/941022899 shutdown_connections 2023-10-03T19:13:00.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f591f509640 1 -- 172.21.15.45:0/941022899 wait complete. 2023-10-03T19:13:00.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f591f509640 1 Processor -- start 2023-10-03T19:13:00.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f591f509640 1 -- start start 2023-10-03T19:13:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f591f509640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f591806c620 0x7f59181498d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f591f509640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59180bca80 0x7f5918152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f591f509640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5918150400 0x7f5918153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f591f509640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59181ebf60 con 0x7f5918150400 2023-10-03T19:13:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f591f509640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5918151b80 con 0x7f591806c620 2023-10-03T19:13:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f591f509640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5918144bc0 con 0x7f59180bca80 2023-10-03T19:13:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f591daa6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5918150400 0x7f5918153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f591daa6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5918150400 0x7f5918153520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54216/0 (socket says 172.21.15.45:54216) 2023-10-03T19:13:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f591daa6640 1 -- 172.21.15.45:0/3829133891 learned_addr learned my addr 172.21.15.45:0/3829133891 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f591caa4640 1 --2- 172.21.15.45:0/3829133891 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59180bca80 0x7f5918152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f591daa6640 1 -- 172.21.15.45:0/3829133891 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59180bca80 msgr2=0x7f5918152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f591daa6640 1 --2- 172.21.15.45:0/3829133891 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59180bca80 0x7f5918152fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f591daa6640 1 -- 172.21.15.45:0/3829133891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f591806c620 msgr2=0x7f59181498d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f591d2a5640 1 --2- 172.21.15.45:0/3829133891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f591806c620 0x7f59181498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f591daa6640 1 --2- 172.21.15.45:0/3829133891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f591806c620 0x7f59181498d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f591daa6640 1 -- 172.21.15.45:0/3829133891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5910009420 con 0x7f5918150400 2023-10-03T19:13:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f591daa6640 1 --2- 172.21.15.45:0/3829133891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5918150400 0x7f5918153520 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f59100ae040 tx=0x7f5910019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f5909ffb640 1 -- 172.21.15.45:0/3829133891 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59100b4410 con 0x7f5918150400 2023-10-03T19:13:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f5909ffb640 1 -- 172.21.15.45:0/3829133891 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59100b4570 con 0x7f5918150400 2023-10-03T19:13:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f591f509640 1 -- 172.21.15.45:0/3829133891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59180bdbc0 con 0x7f5918150400 2023-10-03T19:13:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f5909ffb640 1 -- 172.21.15.45:0/3829133891 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59100b4900 con 0x7f5918150400 2023-10-03T19:13:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.268+0000 7f591f509640 1 -- 172.21.15.45:0/3829133891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59180a1b20 con 0x7f5918150400 2023-10-03T19:13:00.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.272+0000 7f591f509640 1 -- 172.21.15.45:0/3829133891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f591815fc60 con 0x7f5918150400 2023-10-03T19:13:00.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.272+0000 7f5909ffb640 1 -- 172.21.15.45:0/3829133891 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f59100b2040 con 0x7f5918150400 2023-10-03T19:13:00.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.272+0000 7f5909ffb640 1 --2- 172.21.15.45:0/3829133891 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f58fc0662b0 0x7f58fc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:00.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.272+0000 7f5909ffb640 1 -- 172.21.15.45:0/3829133891 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f591011dd10 con 0x7f5918150400 2023-10-03T19:13:00.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.272+0000 7f591d2a5640 1 --2- 172.21.15.45:0/3829133891 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f58fc0662b0 0x7f58fc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:00.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.272+0000 7f591d2a5640 1 --2- 172.21.15.45:0/3829133891 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f58fc0662b0 0x7f58fc068760 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f59140096f0 tx=0x7f5914008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:00.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.276+0000 7f5909ffb640 1 -- 172.21.15.45:0/3829133891 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f59100eb190 con 0x7f5918150400 2023-10-03T19:13:00.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.428+0000 7f591f509640 1 -- 172.21.15.45:0/3829133891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5918152d00 con 0x7f5918150400 2023-10-03T19:13:00.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.428+0000 7f5909ffb640 1 -- 172.21.15.45:0/3829133891 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18231 (secure 0 0 0) 0x7f5918152d00 con 0x7f5918150400 2023-10-03T19:13:00.436 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:13:00.436 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:12:28.941467+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:12:26.226431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T19:12:26.923174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:13:00.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.432+0000 7f591f509640 1 -- 172.21.15.45:0/3829133891 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f58fc0662b0 msgr2=0x7f58fc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:00.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.432+0000 7f591f509640 1 --2- 172.21.15.45:0/3829133891 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f58fc0662b0 0x7f58fc068760 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f59140096f0 tx=0x7f5914008040 comp rx=0 tx=0).stop 2023-10-03T19:13:00.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.432+0000 7f591f509640 1 -- 172.21.15.45:0/3829133891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5918150400 msgr2=0x7f5918153520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:00.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.432+0000 7f591f509640 1 --2- 172.21.15.45:0/3829133891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5918150400 0x7f5918153520 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f59100ae040 tx=0x7f5910019190 comp rx=0 tx=0).stop 2023-10-03T19:13:00.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.432+0000 7f591f509640 1 -- 172.21.15.45:0/3829133891 shutdown_connections 2023-10-03T19:13:00.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.432+0000 7f591f509640 1 --2- 172.21.15.45:0/3829133891 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f58fc0662b0 0x7f58fc068760 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:00.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.432+0000 7f591f509640 1 --2- 172.21.15.45:0/3829133891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5918150400 0x7f5918153520 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:00.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.432+0000 7f591f509640 1 --2- 172.21.15.45:0/3829133891 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59180bca80 0x7f5918152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:00.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.432+0000 7f591f509640 1 --2- 172.21.15.45:0/3829133891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f591806c620 0x7f59181498d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:00.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.432+0000 7f591f509640 1 -- 172.21.15.45:0/3829133891 >> 172.21.15.45:0/3829133891 conn(0x7f59180bcf50 msgr2=0x7f591815c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:00.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.432+0000 7f591f509640 1 -- 172.21.15.45:0/3829133891 shutdown_connections 2023-10-03T19:13:00.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.432+0000 7f591f509640 1 -- 172.21.15.45:0/3829133891 wait complete. 2023-10-03T19:13:00.453 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T19:12:26.226431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T19:12:26.923174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:13:00.454 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:13:00.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.572+0000 7f9ff2699640 1 Processor -- start 2023-10-03T19:13:00.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.576+0000 7f9ff2699640 1 -- start start 2023-10-03T19:13:00.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.576+0000 7f9ff2699640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9fec14f510 0x7f9fec14b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:00.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.576+0000 7f9ff2699640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fec0bd9f0 0x7f9fec14b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:00.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.576+0000 7f9ff2699640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fec14f080 con 0x7f9fec06f880 2023-10-03T19:13:00.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.576+0000 7f9ff2699640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fec06f3e0 con 0x7f9fec14f510 2023-10-03T19:13:00.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.576+0000 7f9ff2699640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec070e90 con 0x7f9fec0bd9f0 2023-10-03T19:13:00.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.576+0000 7f9feb7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9fec14f510 0x7f9fec14b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:00.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.576+0000 7f9ff0c36640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fec0bd9f0 0x7f9fec14b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:00.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.576+0000 7f9feb7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9fec14f510 0x7f9fec14b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:45102/0 (socket says 172.21.15.45:45102) 2023-10-03T19:13:00.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.576+0000 7f9feb7fe640 1 -- 172.21.15.45:0/3017954805 learned_addr learned my addr 172.21.15.45:0/3017954805 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:00.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.576+0000 7f9feb7fe640 1 -- 172.21.15.45:0/3017954805 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fec0bd9f0 msgr2=0x7f9fec14b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:00.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.576+0000 7f9feb7fe640 1 --2- 172.21.15.45:0/3017954805 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fec0bd9f0 0x7f9fec14b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:00.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.576+0000 7f9feb7fe640 1 -- 172.21.15.45:0/3017954805 >> v1:172.21.15.79:6789/0 conn(0x7f9fec06f880 legacy=0x7f9fec0a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:00.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.576+0000 7f9feb7fe640 1 -- 172.21.15.45:0/3017954805 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fec14ea30 con 0x7f9fec14f510 2023-10-03T19:13:00.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.580+0000 7f9feb7fe640 1 --2- 172.21.15.45:0/3017954805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fec14f510 0x7f9fec14b320 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0009870 tx=0x7f9fe001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9c4935d4a3e3d45 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:00.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.580+0000 7f9feaffd640 1 -- 172.21.15.45:0/3017954805 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe00ab670 con 0x7f9fec14f510 2023-10-03T19:13:00.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.580+0000 7f9feaffd640 1 -- 172.21.15.45:0/3017954805 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe00ab7d0 con 0x7f9fec14f510 2023-10-03T19:13:00.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.580+0000 7f9feaffd640 1 -- 172.21.15.45:0/3017954805 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe00abb60 con 0x7f9fec14f510 2023-10-03T19:13:00.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.580+0000 7f9ff2699640 1 -- 172.21.15.45:0/3017954805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fec14f510 msgr2=0x7f9fec14b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:00.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.580+0000 7f9ff2699640 1 --2- 172.21.15.45:0/3017954805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fec14f510 0x7f9fec14b320 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0009870 tx=0x7f9fe001c510 comp rx=0 tx=0).stop 2023-10-03T19:13:00.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.580+0000 7f9ff2699640 1 -- 172.21.15.45:0/3017954805 shutdown_connections 2023-10-03T19:13:00.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.580+0000 7f9ff2699640 1 --2- 172.21.15.45:0/3017954805 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fec0bd9f0 0x7f9fec14b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:00.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.580+0000 7f9ff2699640 1 --2- 172.21.15.45:0/3017954805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fec14f510 0x7f9fec14b320 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:00.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.580+0000 7f9ff2699640 1 -- 172.21.15.45:0/3017954805 >> 172.21.15.45:0/3017954805 conn(0x7f9fec0a20d0 msgr2=0x7f9fec0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:00.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.580+0000 7f9ff2699640 1 -- 172.21.15.45:0/3017954805 shutdown_connections 2023-10-03T19:13:00.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.580+0000 7f9ff2699640 1 -- 172.21.15.45:0/3017954805 wait complete. 2023-10-03T19:13:00.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.580+0000 7f9ff2699640 1 Processor -- start 2023-10-03T19:13:00.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.580+0000 7f9ff2699640 1 -- start start 2023-10-03T19:13:00.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.580+0000 7f9ff2699640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fec06f880 0x7f9fec137320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:00.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.580+0000 7f9ff2699640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fec0bd9f0 0x7f9fec139e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:00.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.580+0000 7f9ff2699640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fec14f510 0x7f9fec144dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:00.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.580+0000 7f9ff2699640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec137860 con 0x7f9fec0bd9f0 2023-10-03T19:13:00.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.580+0000 7f9ff2699640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec13a350 con 0x7f9fec14f510 2023-10-03T19:13:00.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.580+0000 7f9ff2699640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec145310 con 0x7f9fec06f880 2023-10-03T19:13:00.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.580+0000 7f9feb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fec0bd9f0 0x7f9fec139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:00.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.584+0000 7f9feb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fec0bd9f0 0x7f9fec139e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54224/0 (socket says 172.21.15.45:54224) 2023-10-03T19:13:00.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.584+0000 7f9feb7fe640 1 -- 172.21.15.45:0/576474260 learned_addr learned my addr 172.21.15.45:0/576474260 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:00.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.584+0000 7f9febfff640 1 --2- 172.21.15.45:0/576474260 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fec06f880 0x7f9fec137320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:00.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.584+0000 7f9ff0c36640 1 --2- 172.21.15.45:0/576474260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fec14f510 0x7f9fec144dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:00.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.584+0000 7f9feb7fe640 1 -- 172.21.15.45:0/576474260 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fec06f880 msgr2=0x7f9fec137320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:00.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.584+0000 7f9feb7fe640 1 --2- 172.21.15.45:0/576474260 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fec06f880 0x7f9fec137320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:00.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.584+0000 7f9feb7fe640 1 -- 172.21.15.45:0/576474260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fec14f510 msgr2=0x7f9fec144dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:00.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.584+0000 7f9feb7fe640 1 --2- 172.21.15.45:0/576474260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fec14f510 0x7f9fec144dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:00.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.584+0000 7f9feb7fe640 1 -- 172.21.15.45:0/576474260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe00094d0 con 0x7f9fec0bd9f0 2023-10-03T19:13:00.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.584+0000 7f9feb7fe640 1 --2- 172.21.15.45:0/576474260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fec0bd9f0 0x7f9fec139e10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9fe001abc0 tx=0x7f9fe001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:00.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.584+0000 7f9fe8ff9640 1 -- 172.21.15.45:0/576474260 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe00b4800 con 0x7f9fec0bd9f0 2023-10-03T19:13:00.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.584+0000 7f9fe8ff9640 1 -- 172.21.15.45:0/576474260 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe00b4960 con 0x7f9fec0bd9f0 2023-10-03T19:13:00.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.584+0000 7f9ff2699640 1 -- 172.21.15.45:0/576474260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fec0a6050 con 0x7f9fec0bd9f0 2023-10-03T19:13:00.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.584+0000 7f9fe8ff9640 1 -- 172.21.15.45:0/576474260 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe00b4cf0 con 0x7f9fec0bd9f0 2023-10-03T19:13:00.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.584+0000 7f9ff2699640 1 -- 172.21.15.45:0/576474260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fec06fc50 con 0x7f9fec0bd9f0 2023-10-03T19:13:00.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.584+0000 7f9ff2699640 1 -- 172.21.15.45:0/576474260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fec0a61e0 con 0x7f9fec0bd9f0 2023-10-03T19:13:00.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.584+0000 7f9fe8ff9640 1 -- 172.21.15.45:0/576474260 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9fe00b3380 con 0x7f9fec0bd9f0 2023-10-03T19:13:00.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.584+0000 7f9fe8ff9640 1 --2- 172.21.15.45:0/576474260 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9fd8066280 0x7f9fd8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:00.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.584+0000 7f9fe8ff9640 1 -- 172.21.15.45:0/576474260 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9fe011dce0 con 0x7f9fec0bd9f0 2023-10-03T19:13:00.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.584+0000 7f9febfff640 1 --2- 172.21.15.45:0/576474260 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9fd8066280 0x7f9fd8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:00.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.584+0000 7f9febfff640 1 --2- 172.21.15.45:0/576474260 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9fd8066280 0x7f9fd8068730 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc001810 tx=0x7f9fdc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:00.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.588+0000 7f9fe8ff9640 1 -- 172.21.15.45:0/576474260 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9fe00eb2a0 con 0x7f9fec0bd9f0 2023-10-03T19:13:00.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.736+0000 7f9ff2699640 1 -- 172.21.15.45:0/576474260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9fec04de80 con 0x7f9fec0bd9f0 2023-10-03T19:13:00.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.740+0000 7f9fe8ff9640 1 -- 172.21.15.45:0/576474260 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9fe00ee8c0 con 0x7f9fec0bd9f0 2023-10-03T19:13:00.744 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:13:00.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.740+0000 7f9ff2699640 1 -- 172.21.15.45:0/576474260 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9fd8066280 msgr2=0x7f9fd8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:00.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.740+0000 7f9ff2699640 1 --2- 172.21.15.45:0/576474260 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9fd8066280 0x7f9fd8068730 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc001810 tx=0x7f9fdc009040 comp rx=0 tx=0).stop 2023-10-03T19:13:00.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.740+0000 7f9ff2699640 1 -- 172.21.15.45:0/576474260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fec0bd9f0 msgr2=0x7f9fec139e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:00.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.740+0000 7f9ff2699640 1 --2- 172.21.15.45:0/576474260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fec0bd9f0 0x7f9fec139e10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9fe001abc0 tx=0x7f9fe001ad50 comp rx=0 tx=0).stop 2023-10-03T19:13:00.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.740+0000 7f9ff2699640 1 -- 172.21.15.45:0/576474260 shutdown_connections 2023-10-03T19:13:00.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.740+0000 7f9ff2699640 1 --2- 172.21.15.45:0/576474260 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9fd8066280 0x7f9fd8068730 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:00.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.740+0000 7f9ff2699640 1 --2- 172.21.15.45:0/576474260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fec14f510 0x7f9fec144dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:00.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.740+0000 7f9ff2699640 1 --2- 172.21.15.45:0/576474260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fec0bd9f0 0x7f9fec139e10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:00.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.740+0000 7f9ff2699640 1 --2- 172.21.15.45:0/576474260 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fec06f880 0x7f9fec137320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:00.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.740+0000 7f9ff2699640 1 -- 172.21.15.45:0/576474260 >> 172.21.15.45:0/576474260 conn(0x7f9fec0a20d0 msgr2=0x7f9fec0a5930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:00.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.740+0000 7f9ff2699640 1 -- 172.21.15.45:0/576474260 shutdown_connections 2023-10-03T19:13:00.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.740+0000 7f9ff2699640 1 -- 172.21.15.45:0/576474260 wait complete. 2023-10-03T19:13:00.762 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:13:00.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.880+0000 7f31f7642640 1 Processor -- start 2023-10-03T19:13:00.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.880+0000 7f31f7642640 1 -- start start 2023-10-03T19:13:00.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.884+0000 7f31f7642640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31f006d560 0x7f31f00a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:00.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.884+0000 7f31f7642640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f31f006c760 0x7f31f00a5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:00.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.884+0000 7f31f7642640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f006c2d0 con 0x7f31f00712c0 2023-10-03T19:13:00.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.884+0000 7f31f7642640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f0150610 con 0x7f31f006c760 2023-10-03T19:13:00.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.884+0000 7f31f7642640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f01508b0 con 0x7f31f006d560 2023-10-03T19:13:00.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.884+0000 7f31f5bdf640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f31f006c760 0x7f31f00a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:00.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.884+0000 7f31f4bdd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31f006d560 0x7f31f00a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:00.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.884+0000 7f31f5bdf640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f31f006c760 0x7f31f00a5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:45128/0 (socket says 172.21.15.45:45128) 2023-10-03T19:13:00.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.884+0000 7f31f5bdf640 1 -- 172.21.15.45:0/1817152285 learned_addr learned my addr 172.21.15.45:0/1817152285 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:00.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.884+0000 7f31f53de640 1 --1- 172.21.15.45:0/1817152285 >> v1:172.21.15.79:6789/0 conn(0x7f31f00712c0 0x7f31f00bcbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:52754/0 (socket says 172.21.15.45:52754) 2023-10-03T19:13:00.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.884+0000 7f31f4bdd640 1 -- 172.21.15.45:0/1817152285 >> v2:172.21.15.79:3300/0 conn(0x7f31f006c760 msgr2=0x7f31f00a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:00.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.884+0000 7f31f4bdd640 1 --2- 172.21.15.45:0/1817152285 >> v2:172.21.15.79:3300/0 conn(0x7f31f006c760 0x7f31f00a5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:00.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.884+0000 7f31f4bdd640 1 -- 172.21.15.45:0/1817152285 >> v1:172.21.15.79:6789/0 conn(0x7f31f00712c0 legacy=0x7f31f00bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:00.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.884+0000 7f31f4bdd640 1 -- 172.21.15.45:0/1817152285 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f006d2e0 con 0x7f31f006d560 2023-10-03T19:13:00.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.884+0000 7f31f4bdd640 1 --2- 172.21.15.45:0/1817152285 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31f006d560 0x7f31f00a53c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f31e00097c0 tx=0x7f31e001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12654c06272f6041 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:00.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31e7fff640 1 -- 172.21.15.45:0/1817152285 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e00ac620 con 0x7f31f006d560 2023-10-03T19:13:00.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31e7fff640 1 -- 172.21.15.45:0/1817152285 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e00ac780 con 0x7f31f006d560 2023-10-03T19:13:00.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31e7fff640 1 -- 172.21.15.45:0/1817152285 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e00acb10 con 0x7f31f006d560 2023-10-03T19:13:00.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31f7642640 1 -- 172.21.15.45:0/1817152285 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31f006d560 msgr2=0x7f31f00a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:00.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31f7642640 1 --2- 172.21.15.45:0/1817152285 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31f006d560 0x7f31f00a53c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f31e00097c0 tx=0x7f31e001c480 comp rx=0 tx=0).stop 2023-10-03T19:13:00.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31f7642640 1 -- 172.21.15.45:0/1817152285 shutdown_connections 2023-10-03T19:13:00.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31f7642640 1 --2- 172.21.15.45:0/1817152285 >> v2:172.21.15.79:3300/0 conn(0x7f31f006c760 0x7f31f00a5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:00.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31f7642640 1 --2- 172.21.15.45:0/1817152285 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31f006d560 0x7f31f00a53c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:00.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31f7642640 1 -- 172.21.15.45:0/1817152285 >> 172.21.15.45:0/1817152285 conn(0x7f31f00a20d0 msgr2=0x7f31f00a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:00.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31f7642640 1 -- 172.21.15.45:0/1817152285 shutdown_connections 2023-10-03T19:13:00.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31f7642640 1 -- 172.21.15.45:0/1817152285 wait complete. 2023-10-03T19:13:00.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31f7642640 1 Processor -- start 2023-10-03T19:13:00.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31f7642640 1 -- start start 2023-10-03T19:13:00.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31f7642640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31f006c760 0x7f31f006ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:00.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31f7642640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31f006d560 0x7f31f0143e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:00.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31f7642640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31f00712c0 0x7f31f01406c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:00.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31f7642640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f01443a0 con 0x7f31f006d560 2023-10-03T19:13:00.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31f7642640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f01eaff0 con 0x7f31f00712c0 2023-10-03T19:13:00.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31f7642640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f00b9d40 con 0x7f31f006c760 2023-10-03T19:13:00.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31f4bdd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31f006d560 0x7f31f0143e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:00.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31f4bdd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31f006d560 0x7f31f0143e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54232/0 (socket says 172.21.15.45:54232) 2023-10-03T19:13:00.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31f4bdd640 1 -- 172.21.15.45:0/2560824625 learned_addr learned my addr 172.21.15.45:0/2560824625 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:00.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31f5bdf640 1 --2- 172.21.15.45:0/2560824625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31f00712c0 0x7f31f01406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:00.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31f53de640 1 --2- 172.21.15.45:0/2560824625 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31f006c760 0x7f31f006ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:00.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31f4bdd640 1 -- 172.21.15.45:0/2560824625 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31f006c760 msgr2=0x7f31f006ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:00.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31f4bdd640 1 --2- 172.21.15.45:0/2560824625 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31f006c760 0x7f31f006ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:00.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31f4bdd640 1 -- 172.21.15.45:0/2560824625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31f00712c0 msgr2=0x7f31f01406c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:00.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31f4bdd640 1 --2- 172.21.15.45:0/2560824625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31f00712c0 0x7f31f01406c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:00.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31f4bdd640 1 -- 172.21.15.45:0/2560824625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e0009420 con 0x7f31f006d560 2023-10-03T19:13:00.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31f4bdd640 1 --2- 172.21.15.45:0/2560824625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31f006d560 0x7f31f0143e60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f31e001ab30 tx=0x7f31e0019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:00.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31e5ffb640 1 -- 172.21.15.45:0/2560824625 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e00bb070 con 0x7f31f006d560 2023-10-03T19:13:00.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31e5ffb640 1 -- 172.21.15.45:0/2560824625 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e00ac420 con 0x7f31f006d560 2023-10-03T19:13:00.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31e5ffb640 1 -- 172.21.15.45:0/2560824625 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e00b5660 con 0x7f31f006d560 2023-10-03T19:13:00.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31f7642640 1 -- 172.21.15.45:0/2560824625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f00bd460 con 0x7f31f006d560 2023-10-03T19:13:00.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.888+0000 7f31f7642640 1 -- 172.21.15.45:0/2560824625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f00bd2d0 con 0x7f31f006d560 2023-10-03T19:13:00.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.892+0000 7f31f7642640 1 -- 172.21.15.45:0/2560824625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f01596f0 con 0x7f31f006d560 2023-10-03T19:13:00.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.892+0000 7f31e5ffb640 1 -- 172.21.15.45:0/2560824625 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f31e00b3040 con 0x7f31f006d560 2023-10-03T19:13:00.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.892+0000 7f31e5ffb640 1 --2- 172.21.15.45:0/2560824625 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f31d40662b0 0x7f31d4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:00.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.892+0000 7f31e5ffb640 1 -- 172.21.15.45:0/2560824625 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f31e011d2d0 con 0x7f31f006d560 2023-10-03T19:13:00.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.892+0000 7f31f53de640 1 --2- 172.21.15.45:0/2560824625 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f31d40662b0 0x7f31d4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:00.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.892+0000 7f31f53de640 1 --2- 172.21.15.45:0/2560824625 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f31d40662b0 0x7f31d4068760 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f31ec000f70 tx=0x7f31ec007cf0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:00.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:00.896+0000 7f31e5ffb640 1 -- 172.21.15.45:0/2560824625 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f31e00ea6d0 con 0x7f31f006d560 2023-10-03T19:13:01.019 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:13:01.022 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:13:01.024 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:13:01.027 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:13:01.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.048+0000 7f31f7642640 1 -- 172.21.15.45:0/2560824625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f31f00bca30 con 0x7f31f006d560 2023-10-03T19:13:01.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.048+0000 7f31e5ffb640 1 -- 172.21.15.45:0/2560824625 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f31e00edcf0 con 0x7f31f006d560 2023-10-03T19:13:01.053 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:13:01.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.048+0000 7f31f7642640 1 -- 172.21.15.45:0/2560824625 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f31d40662b0 msgr2=0x7f31d4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:01.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.048+0000 7f31f7642640 1 --2- 172.21.15.45:0/2560824625 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f31d40662b0 0x7f31d4068760 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f31ec000f70 tx=0x7f31ec007cf0 comp rx=0 tx=0).stop 2023-10-03T19:13:01.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.048+0000 7f31f7642640 1 -- 172.21.15.45:0/2560824625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31f006d560 msgr2=0x7f31f0143e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:01.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.048+0000 7f31f7642640 1 --2- 172.21.15.45:0/2560824625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31f006d560 0x7f31f0143e60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f31e001ab30 tx=0x7f31e0019220 comp rx=0 tx=0).stop 2023-10-03T19:13:01.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.048+0000 7f31f7642640 1 -- 172.21.15.45:0/2560824625 shutdown_connections 2023-10-03T19:13:01.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.048+0000 7f31f7642640 1 --2- 172.21.15.45:0/2560824625 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f31d40662b0 0x7f31d4068760 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:01.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.048+0000 7f31f7642640 1 --2- 172.21.15.45:0/2560824625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31f00712c0 0x7f31f01406c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:01.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.048+0000 7f31f7642640 1 --2- 172.21.15.45:0/2560824625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31f006d560 0x7f31f0143e60 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:01.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.048+0000 7f31f7642640 1 --2- 172.21.15.45:0/2560824625 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31f006c760 0x7f31f006ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:01.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.048+0000 7f31f7642640 1 -- 172.21.15.45:0/2560824625 >> 172.21.15.45:0/2560824625 conn(0x7f31f00a20d0 msgr2=0x7f31f00bcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:01.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.048+0000 7f31f7642640 1 -- 172.21.15.45:0/2560824625 shutdown_connections 2023-10-03T19:13:01.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.048+0000 7f31f7642640 1 -- 172.21.15.45:0/2560824625 wait complete. 2023-10-03T19:13:01.070 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T19:13:01.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.224+0000 7fe7fb01f640 1 Processor -- start 2023-10-03T19:13:01.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.228+0000 7fe7fb01f640 1 -- start start 2023-10-03T19:13:01.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.228+0000 7fe7fb01f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7f406d560 0x7fe7f40a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:01.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.228+0000 7fe7fb01f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe7f406c760 0x7fe7f40a5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:01.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.228+0000 7fe7fb01f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7f406c2d0 con 0x7fe7f40712c0 2023-10-03T19:13:01.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.228+0000 7fe7fb01f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7f4150610 con 0x7fe7f406c760 2023-10-03T19:13:01.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.228+0000 7fe7fb01f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f41508b0 con 0x7fe7f406d560 2023-10-03T19:13:01.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.228+0000 7fe7f95bc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe7f406c760 0x7fe7f40a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:01.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.228+0000 7fe7f8dbb640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe7f40712c0 0x7fe7f40bcbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38706/0 (socket says 172.21.15.45:38706) 2023-10-03T19:13:01.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.228+0000 7fe7f8dbb640 1 -- 172.21.15.45:0/158493390 learned_addr learned my addr 172.21.15.45:0/158493390 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:01.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.228+0000 7fe7f3fff640 1 --2- 172.21.15.45:0/158493390 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7f406d560 0x7fe7f40a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:01.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.228+0000 7fe7f95bc640 1 -- 172.21.15.45:0/158493390 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7f406d560 msgr2=0x7fe7f40a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:01.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.228+0000 7fe7f95bc640 1 --2- 172.21.15.45:0/158493390 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7f406d560 0x7fe7f40a53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:01.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.228+0000 7fe7f95bc640 1 -- 172.21.15.45:0/158493390 >> v1:172.21.15.45:6789/0 conn(0x7fe7f40712c0 legacy=0x7fe7f40bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:01.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.228+0000 7fe7f95bc640 1 -- 172.21.15.45:0/158493390 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f406d2e0 con 0x7fe7f406c760 2023-10-03T19:13:01.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.228+0000 7fe7f95bc640 1 --2- 172.21.15.45:0/158493390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7f406c760 0x7fe7f40a5900 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec009d90 tx=0x7fe7ec01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd3199b9120994a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:01.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.228+0000 7fe7f37fe640 1 -- 172.21.15.45:0/158493390 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec0a5950 con 0x7fe7f406c760 2023-10-03T19:13:01.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.228+0000 7fe7f37fe640 1 -- 172.21.15.45:0/158493390 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ec0a5ab0 con 0x7fe7f406c760 2023-10-03T19:13:01.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.228+0000 7fe7f37fe640 1 -- 172.21.15.45:0/158493390 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec0a5e40 con 0x7fe7f406c760 2023-10-03T19:13:01.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7fb01f640 1 -- 172.21.15.45:0/158493390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7f406c760 msgr2=0x7fe7f40a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:01.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7fb01f640 1 --2- 172.21.15.45:0/158493390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7f406c760 0x7fe7f40a5900 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec009d90 tx=0x7fe7ec01c950 comp rx=0 tx=0).stop 2023-10-03T19:13:01.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7fb01f640 1 -- 172.21.15.45:0/158493390 shutdown_connections 2023-10-03T19:13:01.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7fb01f640 1 --2- 172.21.15.45:0/158493390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7f406c760 0x7fe7f40a5900 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:01.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7fb01f640 1 --2- 172.21.15.45:0/158493390 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7f406d560 0x7fe7f40a53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:01.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7fb01f640 1 -- 172.21.15.45:0/158493390 >> 172.21.15.45:0/158493390 conn(0x7fe7f40a20d0 msgr2=0x7fe7f40a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:01.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7fb01f640 1 -- 172.21.15.45:0/158493390 shutdown_connections 2023-10-03T19:13:01.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7fb01f640 1 -- 172.21.15.45:0/158493390 wait complete. 2023-10-03T19:13:01.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7fb01f640 1 Processor -- start 2023-10-03T19:13:01.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7fb01f640 1 -- start start 2023-10-03T19:13:01.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7fb01f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7f406c760 0x7fe7f4147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:01.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7fb01f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7f406d560 0x7fe7f41e55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:01.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7fb01f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7f40712c0 0x7fe7f414d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:01.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7fb01f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f41e5160 con 0x7fe7f40712c0 2023-10-03T19:13:01.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7fb01f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f414bca0 con 0x7fe7f406d560 2023-10-03T19:13:01.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7fb01f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f414b9c0 con 0x7fe7f406c760 2023-10-03T19:13:01.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7f95bc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7f40712c0 0x7fe7f414d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:01.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7f95bc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7f40712c0 0x7fe7f414d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54238/0 (socket says 172.21.15.45:54238) 2023-10-03T19:13:01.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7f95bc640 1 -- 172.21.15.45:0/2660101852 learned_addr learned my addr 172.21.15.45:0/2660101852 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:01.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7f95bc640 1 -- 172.21.15.45:0/2660101852 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7f406c760 msgr2=0x7fe7f4147480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:01.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7f95bc640 1 --2- 172.21.15.45:0/2660101852 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7f406c760 0x7fe7f4147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:01.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7f95bc640 1 -- 172.21.15.45:0/2660101852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7f406d560 msgr2=0x7fe7f41e55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:01.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7f95bc640 1 --2- 172.21.15.45:0/2660101852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7f406d560 0x7fe7f41e55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:01.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7f95bc640 1 -- 172.21.15.45:0/2660101852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ec009a70 con 0x7fe7f40712c0 2023-10-03T19:13:01.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7f95bc640 1 --2- 172.21.15.45:0/2660101852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7f40712c0 0x7fe7f414d9b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec0b0040 tx=0x7fe7ec0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:01.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7f17fa640 1 -- 172.21.15.45:0/2660101852 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec0ade40 con 0x7fe7f40712c0 2023-10-03T19:13:01.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7f17fa640 1 -- 172.21.15.45:0/2660101852 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ec0b9450 con 0x7fe7f40712c0 2023-10-03T19:13:01.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7fb01f640 1 -- 172.21.15.45:0/2660101852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f40bd460 con 0x7fe7f40712c0 2023-10-03T19:13:01.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7f17fa640 1 -- 172.21.15.45:0/2660101852 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec0b9800 con 0x7fe7f40712c0 2023-10-03T19:13:01.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7fb01f640 1 -- 172.21.15.45:0/2660101852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f40bd2d0 con 0x7fe7f40712c0 2023-10-03T19:13:01.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.232+0000 7fe7fb01f640 1 -- 172.21.15.45:0/2660101852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f41596f0 con 0x7fe7f40712c0 2023-10-03T19:13:01.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.236+0000 7fe7f17fa640 1 -- 172.21.15.45:0/2660101852 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe7ec0b9960 con 0x7fe7f40712c0 2023-10-03T19:13:01.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.236+0000 7fe7f17fa640 1 --2- 172.21.15.45:0/2660101852 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe7d4066280 0x7fe7d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:01.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.236+0000 7fe7f17fa640 1 -- 172.21.15.45:0/2660101852 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe7ec1200c0 con 0x7fe7f40712c0 2023-10-03T19:13:01.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.236+0000 7fe7f8dbb640 1 --2- 172.21.15.45:0/2660101852 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe7d4066280 0x7fe7d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:01.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.236+0000 7fe7f8dbb640 1 --2- 172.21.15.45:0/2660101852 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe7d4066280 0x7fe7d4068730 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc001600 tx=0x7fe7dc007a50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:01.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.240+0000 7fe7f17fa640 1 -- 172.21.15.45:0/2660101852 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe7ec0ed5e0 con 0x7fe7f40712c0 2023-10-03T19:13:01.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.384+0000 7fe7fb01f640 1 -- 172.21.15.45:0/2660101852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe7f40bca30 con 0x7fe7f40712c0 2023-10-03T19:13:01.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.384+0000 7fe7f17fa640 1 -- 172.21.15.45:0/2660101852 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe7ec0f0c00 con 0x7fe7f40712c0 2023-10-03T19:13:01.391 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-03T19:13:01.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.388+0000 7fe7fb01f640 1 -- 172.21.15.45:0/2660101852 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe7d4066280 msgr2=0x7fe7d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:01.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.388+0000 7fe7fb01f640 1 --2- 172.21.15.45:0/2660101852 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe7d4066280 0x7fe7d4068730 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc001600 tx=0x7fe7dc007a50 comp rx=0 tx=0).stop 2023-10-03T19:13:01.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.388+0000 7fe7fb01f640 1 -- 172.21.15.45:0/2660101852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7f40712c0 msgr2=0x7fe7f414d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:01.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.388+0000 7fe7fb01f640 1 --2- 172.21.15.45:0/2660101852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7f40712c0 0x7fe7f414d9b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec0b0040 tx=0x7fe7ec0196f0 comp rx=0 tx=0).stop 2023-10-03T19:13:01.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.388+0000 7fe7fb01f640 1 -- 172.21.15.45:0/2660101852 shutdown_connections 2023-10-03T19:13:01.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.388+0000 7fe7fb01f640 1 --2- 172.21.15.45:0/2660101852 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe7d4066280 0x7fe7d4068730 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:01.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.388+0000 7fe7fb01f640 1 --2- 172.21.15.45:0/2660101852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7f40712c0 0x7fe7f414d9b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:01.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.388+0000 7fe7fb01f640 1 --2- 172.21.15.45:0/2660101852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7f406d560 0x7fe7f41e55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:01.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.388+0000 7fe7fb01f640 1 --2- 172.21.15.45:0/2660101852 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7f406c760 0x7fe7f4147480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:01.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.388+0000 7fe7fb01f640 1 -- 172.21.15.45:0/2660101852 >> 172.21.15.45:0/2660101852 conn(0x7fe7f40a20d0 msgr2=0x7fe7f40a5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:01.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.388+0000 7fe7fb01f640 1 -- 172.21.15.45:0/2660101852 shutdown_connections 2023-10-03T19:13:01.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.388+0000 7fe7fb01f640 1 -- 172.21.15.45:0/2660101852 wait complete. 2023-10-03T19:13:01.408 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T19:13:01.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.532+0000 7f5d2eb68640 1 Processor -- start 2023-10-03T19:13:01.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.532+0000 7f5d2eb68640 1 -- start start 2023-10-03T19:13:01.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.532+0000 7f5d2eb68640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5d280712c0 0x7f5d280bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:01.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.532+0000 7f5d2eb68640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5d2806c760 0x7f5d280bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:01.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.532+0000 7f5d2eb68640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d2806c2d0 con 0x7f5d2806d560 2023-10-03T19:13:01.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.532+0000 7f5d2eb68640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d28150610 con 0x7f5d2806c760 2023-10-03T19:13:01.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.532+0000 7f5d2eb68640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d281508b0 con 0x7f5d280712c0 2023-10-03T19:13:01.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.532+0000 7f5d2d105640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5d2806c760 0x7f5d280bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:01.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.532+0000 7f5d27fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5d2806d560 0x7f5d280a53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38714/0 (socket says 172.21.15.45:38714) 2023-10-03T19:13:01.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.532+0000 7f5d27fff640 1 -- 172.21.15.45:0/3481599874 learned_addr learned my addr 172.21.15.45:0/3481599874 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:01.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.532+0000 7f5d2c904640 1 --2- 172.21.15.45:0/3481599874 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5d280712c0 0x7f5d280bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:01.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.532+0000 7f5d2d105640 1 -- 172.21.15.45:0/3481599874 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5d280712c0 msgr2=0x7f5d280bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:01.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.532+0000 7f5d2d105640 1 --2- 172.21.15.45:0/3481599874 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5d280712c0 0x7f5d280bcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:01.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.532+0000 7f5d2d105640 1 -- 172.21.15.45:0/3481599874 >> v1:172.21.15.45:6789/0 conn(0x7f5d2806d560 legacy=0x7f5d280a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:01.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.532+0000 7f5d2d105640 1 -- 172.21.15.45:0/3481599874 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d2806d2e0 con 0x7f5d2806c760 2023-10-03T19:13:01.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.532+0000 7f5d277fe640 1 -- 172.21.15.45:0/3481599874 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 460080400 0 0) 0x7f5d2806c2d0 con 0x7f5d2806d560 2023-10-03T19:13:01.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.532+0000 7f5d2c904640 1 --2- 172.21.15.45:0/3481599874 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5d280712c0 0x7f5d280bcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:01.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d2d105640 1 --2- 172.21.15.45:0/3481599874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d2806c760 0x7f5d280bd100 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5d20009d90 tx=0x7f5d2001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac0ddf2f553a8fe8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:01.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d277fe640 1 -- 172.21.15.45:0/3481599874 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d200a5950 con 0x7f5d2806c760 2023-10-03T19:13:01.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d277fe640 1 -- 172.21.15.45:0/3481599874 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d200a5ab0 con 0x7f5d2806c760 2023-10-03T19:13:01.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d277fe640 1 -- 172.21.15.45:0/3481599874 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d200a5e40 con 0x7f5d2806c760 2023-10-03T19:13:01.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d2eb68640 1 -- 172.21.15.45:0/3481599874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d2806c760 msgr2=0x7f5d280bd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:01.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d2eb68640 1 --2- 172.21.15.45:0/3481599874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d2806c760 0x7f5d280bd100 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5d20009d90 tx=0x7f5d2001c950 comp rx=0 tx=0).stop 2023-10-03T19:13:01.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d2eb68640 1 -- 172.21.15.45:0/3481599874 shutdown_connections 2023-10-03T19:13:01.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d2eb68640 1 --2- 172.21.15.45:0/3481599874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d2806c760 0x7f5d280bd100 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:01.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d2eb68640 1 --2- 172.21.15.45:0/3481599874 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5d280712c0 0x7f5d280bcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:01.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d2eb68640 1 -- 172.21.15.45:0/3481599874 >> 172.21.15.45:0/3481599874 conn(0x7f5d280a20d0 msgr2=0x7f5d280a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:01.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d2eb68640 1 -- 172.21.15.45:0/3481599874 shutdown_connections 2023-10-03T19:13:01.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d2eb68640 1 -- 172.21.15.45:0/3481599874 wait complete. 2023-10-03T19:13:01.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d2eb68640 1 Processor -- start 2023-10-03T19:13:01.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d2eb68640 1 -- start start 2023-10-03T19:13:01.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d2eb68640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d2806c760 0x7f5d280b8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:01.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d2eb68640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d2806d560 0x7f5d28156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:01.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d2eb68640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5d280712c0 0x7f5d2814a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:01.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d2eb68640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2814c400 con 0x7f5d2806c760 2023-10-03T19:13:01.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d2eb68640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d281e5770 con 0x7f5d2806d560 2023-10-03T19:13:01.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d2eb68640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2814c650 con 0x7f5d280712c0 2023-10-03T19:13:01.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d2c904640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d2806c760 0x7f5d280b8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:01.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d2c904640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d2806c760 0x7f5d280b8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54258/0 (socket says 172.21.15.45:54258) 2023-10-03T19:13:01.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d2c904640 1 -- 172.21.15.45:0/507447259 learned_addr learned my addr 172.21.15.45:0/507447259 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:01.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d2d105640 1 --2- 172.21.15.45:0/507447259 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5d280712c0 0x7f5d2814a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:01.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d27fff640 1 --2- 172.21.15.45:0/507447259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d2806d560 0x7f5d28156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:01.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d2c904640 1 -- 172.21.15.45:0/507447259 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5d280712c0 msgr2=0x7f5d2814a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:01.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d2c904640 1 --2- 172.21.15.45:0/507447259 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5d280712c0 0x7f5d2814a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:01.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d2c904640 1 -- 172.21.15.45:0/507447259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d2806d560 msgr2=0x7f5d28156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:01.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d2c904640 1 --2- 172.21.15.45:0/507447259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d2806d560 0x7f5d28156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:01.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d2c904640 1 -- 172.21.15.45:0/507447259 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d20009a70 con 0x7f5d2806c760 2023-10-03T19:13:01.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d27fff640 1 --2- 172.21.15.45:0/507447259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d2806d560 0x7f5d28156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:01.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d2c904640 1 --2- 172.21.15.45:0/507447259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d2806c760 0x7f5d280b8880 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5d1800c7f0 tx=0x7f5d1800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:01.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d257fa640 1 -- 172.21.15.45:0/507447259 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d18007820 con 0x7f5d2806c760 2023-10-03T19:13:01.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d257fa640 1 -- 172.21.15.45:0/507447259 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d18007980 con 0x7f5d2806c760 2023-10-03T19:13:01.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d2eb68640 1 -- 172.21.15.45:0/507447259 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d280a6070 con 0x7f5d2806c760 2023-10-03T19:13:01.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.536+0000 7f5d257fa640 1 -- 172.21.15.45:0/507447259 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d18007d30 con 0x7f5d2806c760 2023-10-03T19:13:01.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.540+0000 7f5d2eb68640 1 -- 172.21.15.45:0/507447259 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d280a5ee0 con 0x7f5d2806c760 2023-10-03T19:13:01.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.540+0000 7f5d2eb68640 1 -- 172.21.15.45:0/507447259 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d281596f0 con 0x7f5d2806c760 2023-10-03T19:13:01.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.540+0000 7f5d257fa640 1 -- 172.21.15.45:0/507447259 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5d180113f0 con 0x7f5d2806c760 2023-10-03T19:13:01.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.540+0000 7f5d257fa640 1 --2- 172.21.15.45:0/507447259 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5d14066280 0x7f5d14068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:01.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.540+0000 7f5d257fa640 1 -- 172.21.15.45:0/507447259 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5d180840a0 con 0x7f5d2806c760 2023-10-03T19:13:01.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.540+0000 7f5d27fff640 1 --2- 172.21.15.45:0/507447259 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5d14066280 0x7f5d14068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:01.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.540+0000 7f5d27fff640 1 --2- 172.21.15.45:0/507447259 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5d14066280 0x7f5d14068730 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5d28150e30 tx=0x7f5d1c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:01.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.544+0000 7f5d257fa640 1 -- 172.21.15.45:0/507447259 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5d180514c0 con 0x7f5d2806c760 2023-10-03T19:13:01.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.700+0000 7f5d2eb68640 1 -- 172.21.15.45:0/507447259 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5d281e5560 con 0x7f5d2806c760 2023-10-03T19:13:01.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.700+0000 7f5d257fa640 1 -- 172.21.15.45:0/507447259 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5d18054ae0 con 0x7f5d2806c760 2023-10-03T19:13:01.705 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-03T19:13:01.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.700+0000 7f5d2eb68640 1 -- 172.21.15.45:0/507447259 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5d14066280 msgr2=0x7f5d14068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:01.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.700+0000 7f5d2eb68640 1 --2- 172.21.15.45:0/507447259 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5d14066280 0x7f5d14068730 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5d28150e30 tx=0x7f5d1c009040 comp rx=0 tx=0).stop 2023-10-03T19:13:01.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.700+0000 7f5d2eb68640 1 -- 172.21.15.45:0/507447259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d2806c760 msgr2=0x7f5d280b8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:01.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.700+0000 7f5d2eb68640 1 --2- 172.21.15.45:0/507447259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d2806c760 0x7f5d280b8880 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5d1800c7f0 tx=0x7f5d1800ccb0 comp rx=0 tx=0).stop 2023-10-03T19:13:01.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.700+0000 7f5d2eb68640 1 -- 172.21.15.45:0/507447259 shutdown_connections 2023-10-03T19:13:01.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.700+0000 7f5d2eb68640 1 --2- 172.21.15.45:0/507447259 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5d14066280 0x7f5d14068730 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:01.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.700+0000 7f5d2eb68640 1 --2- 172.21.15.45:0/507447259 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5d280712c0 0x7f5d2814a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:01.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.700+0000 7f5d2eb68640 1 --2- 172.21.15.45:0/507447259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d2806d560 0x7f5d28156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:01.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.700+0000 7f5d2eb68640 1 --2- 172.21.15.45:0/507447259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d2806c760 0x7f5d280b8880 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:01.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.700+0000 7f5d2eb68640 1 -- 172.21.15.45:0/507447259 >> 172.21.15.45:0/507447259 conn(0x7f5d280a20d0 msgr2=0x7f5d280befe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:01.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.700+0000 7f5d2eb68640 1 -- 172.21.15.45:0/507447259 shutdown_connections 2023-10-03T19:13:01.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.700+0000 7f5d2eb68640 1 -- 172.21.15.45:0/507447259 wait complete. 2023-10-03T19:13:01.724 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-03T19:13:01.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.844+0000 7fe9bd95f640 1 Processor -- start 2023-10-03T19:13:01.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.844+0000 7fe9bd95f640 1 -- start start 2023-10-03T19:13:01.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.844+0000 7fe9bd95f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe9b81481c0 0x7fe9b80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:01.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.844+0000 7fe9bd95f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9b80bc430 con 0x7fe9b814aa50 2023-10-03T19:13:01.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.844+0000 7fe9bd95f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9b80baf60 con 0x7fe9b806cd40 2023-10-03T19:13:01.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.844+0000 7fe9bd95f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9b80a5db0 con 0x7fe9b81481c0 2023-10-03T19:13:01.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.844+0000 7fe9b67fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe9b814aa50 0x7fe9b8147ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38720/0 (socket says 172.21.15.45:38720) 2023-10-03T19:13:01.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.844+0000 7fe9b67fc640 1 -- 172.21.15.45:0/2403604917 learned_addr learned my addr 172.21.15.45:0/2403604917 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:01.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.844+0000 7fe9b77fe640 1 --2- 172.21.15.45:0/2403604917 >> v2:172.21.15.45:3300/0 conn(0x7fe9b81481c0 0x7fe9b80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:01.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.844+0000 7fe9b77fe640 1 -- 172.21.15.45:0/2403604917 >> v1:172.21.15.79:6789/0 conn(0x7fe9b806cd40 legacy=0x7fe9b80bbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:01.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.844+0000 7fe9b77fe640 1 -- 172.21.15.45:0/2403604917 >> v1:172.21.15.45:6789/0 conn(0x7fe9b814aa50 legacy=0x7fe9b8147ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:01.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.844+0000 7fe9b77fe640 1 -- 172.21.15.45:0/2403604917 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b80bb240 con 0x7fe9b81481c0 2023-10-03T19:13:01.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.848+0000 7fe9b77fe640 1 --2- 172.21.15.45:0/2403604917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9b81481c0 0x7fe9b80a3670 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe9a800a960 tx=0x7fe9a8020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1035e6e0c4ba3252 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:01.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.848+0000 7fe9b5ffb640 1 -- 172.21.15.45:0/2403604917 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a80a9e10 con 0x7fe9b81481c0 2023-10-03T19:13:01.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.848+0000 7fe9b5ffb640 1 -- 172.21.15.45:0/2403604917 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a80b1440 con 0x7fe9b81481c0 2023-10-03T19:13:01.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.848+0000 7fe9b5ffb640 1 -- 172.21.15.45:0/2403604917 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a80b17d0 con 0x7fe9b81481c0 2023-10-03T19:13:01.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.848+0000 7fe9bd95f640 1 -- 172.21.15.45:0/2403604917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9b81481c0 msgr2=0x7fe9b80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:01.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.848+0000 7fe9bd95f640 1 --2- 172.21.15.45:0/2403604917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9b81481c0 0x7fe9b80a3670 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe9a800a960 tx=0x7fe9a8020000 comp rx=0 tx=0).stop 2023-10-03T19:13:01.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.848+0000 7fe9bd95f640 1 -- 172.21.15.45:0/2403604917 shutdown_connections 2023-10-03T19:13:01.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.848+0000 7fe9bd95f640 1 --2- 172.21.15.45:0/2403604917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9b81481c0 0x7fe9b80a3670 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:01.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.848+0000 7fe9bd95f640 1 -- 172.21.15.45:0/2403604917 >> 172.21.15.45:0/2403604917 conn(0x7fe9b80bcf50 msgr2=0x7fe9b80bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:01.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.848+0000 7fe9bd95f640 1 -- 172.21.15.45:0/2403604917 shutdown_connections 2023-10-03T19:13:01.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.848+0000 7fe9bd95f640 1 -- 172.21.15.45:0/2403604917 wait complete. 2023-10-03T19:13:01.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.848+0000 7fe9bd95f640 1 Processor -- start 2023-10-03T19:13:01.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.848+0000 7fe9bd95f640 1 -- start start 2023-10-03T19:13:01.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.848+0000 7fe9bd95f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9b806cd40 0x7fe9b81e0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:01.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.848+0000 7fe9bd95f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9b81481c0 0x7fe9b814c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:01.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.848+0000 7fe9bd95f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b814aa50 0x7fe9b814ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:01.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.848+0000 7fe9bd95f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b814d8c0 con 0x7fe9b81481c0 2023-10-03T19:13:01.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.848+0000 7fe9bd95f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b814c590 con 0x7fe9b814aa50 2023-10-03T19:13:01.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.848+0000 7fe9bd95f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b80bee70 con 0x7fe9b806cd40 2023-10-03T19:13:01.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.848+0000 7fe9b67fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9b81481c0 0x7fe9b814c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:01.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.848+0000 7fe9b67fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9b81481c0 0x7fe9b814c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54278/0 (socket says 172.21.15.45:54278) 2023-10-03T19:13:01.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.848+0000 7fe9b67fc640 1 -- 172.21.15.45:0/3065946419 learned_addr learned my addr 172.21.15.45:0/3065946419 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:01.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.852+0000 7fe9b77fe640 1 --2- 172.21.15.45:0/3065946419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b814aa50 0x7fe9b814ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:01.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.852+0000 7fe9b6ffd640 1 --2- 172.21.15.45:0/3065946419 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9b806cd40 0x7fe9b81e0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:01.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.852+0000 7fe9b67fc640 1 -- 172.21.15.45:0/3065946419 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9b806cd40 msgr2=0x7fe9b81e0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:01.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.852+0000 7fe9b67fc640 1 --2- 172.21.15.45:0/3065946419 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9b806cd40 0x7fe9b81e0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:01.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.852+0000 7fe9b67fc640 1 -- 172.21.15.45:0/3065946419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b814aa50 msgr2=0x7fe9b814ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:01.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.852+0000 7fe9b67fc640 1 --2- 172.21.15.45:0/3065946419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b814aa50 0x7fe9b814ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:01.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.852+0000 7fe9b67fc640 1 -- 172.21.15.45:0/3065946419 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a800a5c0 con 0x7fe9b81481c0 2023-10-03T19:13:01.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.852+0000 7fe9b67fc640 1 --2- 172.21.15.45:0/3065946419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9b81481c0 0x7fe9b814c050 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe9a000cbc0 tx=0x7fe9a000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:01.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.852+0000 7fe9affff640 1 -- 172.21.15.45:0/3065946419 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a000aca0 con 0x7fe9b81481c0 2023-10-03T19:13:01.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.852+0000 7fe9affff640 1 -- 172.21.15.45:0/3065946419 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a000ae00 con 0x7fe9b81481c0 2023-10-03T19:13:01.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.852+0000 7fe9bd95f640 1 -- 172.21.15.45:0/3065946419 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b80bb800 con 0x7fe9b81481c0 2023-10-03T19:13:01.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.852+0000 7fe9affff640 1 -- 172.21.15.45:0/3065946419 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a0012600 con 0x7fe9b81481c0 2023-10-03T19:13:01.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.852+0000 7fe9bd95f640 1 -- 172.21.15.45:0/3065946419 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b80bb520 con 0x7fe9b81481c0 2023-10-03T19:13:01.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.852+0000 7fe9bd95f640 1 -- 172.21.15.45:0/3065946419 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9b80bcc90 con 0x7fe9b81481c0 2023-10-03T19:13:01.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.852+0000 7fe9affff640 1 -- 172.21.15.45:0/3065946419 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe9a0007070 con 0x7fe9b81481c0 2023-10-03T19:13:01.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.852+0000 7fe9affff640 1 --2- 172.21.15.45:0/3065946419 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe998066280 0x7fe998068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:01.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.852+0000 7fe9affff640 1 -- 172.21.15.45:0/3065946419 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe9a0083c10 con 0x7fe9b81481c0 2023-10-03T19:13:01.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.852+0000 7fe9b6ffd640 1 --2- 172.21.15.45:0/3065946419 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe998066280 0x7fe998068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:01.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.852+0000 7fe9b6ffd640 1 --2- 172.21.15.45:0/3065946419 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe998066280 0x7fe998068730 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0004e30 tx=0x7fe9b0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:01.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:01.856+0000 7fe9affff640 1 -- 172.21.15.45:0/3065946419 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe9a00510b0 con 0x7fe9b81481c0 2023-10-03T19:13:02.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.012+0000 7fe9bd95f640 1 -- 172.21.15.45:0/3065946419 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe9b80bf950 con 0x7fe9b81481c0 2023-10-03T19:13:02.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.012+0000 7fe9affff640 1 -- 172.21.15.45:0/3065946419 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe9a0017070 con 0x7fe9b81481c0 2023-10-03T19:13:02.020 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-10-03T19:13:02.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.016+0000 7fe9bd95f640 1 -- 172.21.15.45:0/3065946419 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe998066280 msgr2=0x7fe998068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:02.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.016+0000 7fe9bd95f640 1 --2- 172.21.15.45:0/3065946419 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe998066280 0x7fe998068730 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0004e30 tx=0x7fe9b0009040 comp rx=0 tx=0).stop 2023-10-03T19:13:02.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.016+0000 7fe9bd95f640 1 -- 172.21.15.45:0/3065946419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9b81481c0 msgr2=0x7fe9b814c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:02.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.016+0000 7fe9bd95f640 1 --2- 172.21.15.45:0/3065946419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9b81481c0 0x7fe9b814c050 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe9a000cbc0 tx=0x7fe9a000a060 comp rx=0 tx=0).stop 2023-10-03T19:13:02.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.016+0000 7fe9bd95f640 1 -- 172.21.15.45:0/3065946419 shutdown_connections 2023-10-03T19:13:02.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.016+0000 7fe9bd95f640 1 --2- 172.21.15.45:0/3065946419 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe998066280 0x7fe998068730 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:02.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.016+0000 7fe9bd95f640 1 --2- 172.21.15.45:0/3065946419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b814aa50 0x7fe9b814ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:02.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.016+0000 7fe9bd95f640 1 --2- 172.21.15.45:0/3065946419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9b81481c0 0x7fe9b814c050 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:02.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.016+0000 7fe9bd95f640 1 --2- 172.21.15.45:0/3065946419 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9b806cd40 0x7fe9b81e0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:02.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.016+0000 7fe9bd95f640 1 -- 172.21.15.45:0/3065946419 >> 172.21.15.45:0/3065946419 conn(0x7fe9b80bcf50 msgr2=0x7fe9b80bbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:02.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.016+0000 7fe9bd95f640 1 -- 172.21.15.45:0/3065946419 shutdown_connections 2023-10-03T19:13:02.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.016+0000 7fe9bd95f640 1 -- 172.21.15.45:0/3065946419 wait complete. 2023-10-03T19:13:02.038 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi146.front.sepia.ceph.com... 2023-10-03T19:13:02.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:13:02.038 DEBUG:teuthology.orchestra.run.smithi146:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-03T19:13:02.064 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:13:02.064 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-03T19:13:02.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:13:02.064 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-03T19:13:02.118 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-03T19:13:02.119 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:13:02.125 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-03T19:13:02.125 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:13:02.173 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:13:02.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.296+0000 7f215f1c3640 1 Processor -- start 2023-10-03T19:13:02.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.296+0000 7f215f1c3640 1 -- start start 2023-10-03T19:13:02.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.296+0000 7f215f1c3640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f215806f170 0x7f2158150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:02.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.296+0000 7f215f1c3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f215806d170 0x7f215814d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:02.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.296+0000 7f215f1c3640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f215806cac0 con 0x7f21580bc8b0 2023-10-03T19:13:02.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.296+0000 7f215f1c3640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21580720d0 con 0x7f215806d170 2023-10-03T19:13:02.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.296+0000 7f215f1c3640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21580a5ab0 con 0x7f215806f170 2023-10-03T19:13:02.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.296+0000 7f215d760640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f215806d170 0x7f215814d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:02.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.296+0000 7f215cf5f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f215806f170 0x7f2158150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:02.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.296+0000 7f215d760640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f215806d170 0x7f215814d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:45168/0 (socket says 172.21.15.45:45168) 2023-10-03T19:13:02.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.296+0000 7f215d760640 1 -- 172.21.15.45:0/1491511801 learned_addr learned my addr 172.21.15.45:0/1491511801 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:02.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.296+0000 7f215d760640 1 -- 172.21.15.45:0/1491511801 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f215806f170 msgr2=0x7f2158150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:02.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.296+0000 7f215d760640 1 --2- 172.21.15.45:0/1491511801 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f215806f170 0x7f2158150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:02.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.296+0000 7f215d760640 1 -- 172.21.15.45:0/1491511801 >> v1:172.21.15.79:6789/0 conn(0x7f21580bc8b0 legacy=0x7f215814ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:02.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.296+0000 7f215d760640 1 -- 172.21.15.45:0/1491511801 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f215806cd00 con 0x7f215806d170 2023-10-03T19:13:02.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.300+0000 7f215d760640 1 --2- 172.21.15.45:0/1491511801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f215806d170 0x7f215814d180 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2150009870 tx=0x7f215001c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fcfe5e034bac717 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:02.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.300+0000 7f21577fe640 1 -- 172.21.15.45:0/1491511801 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21500ab650 con 0x7f215806d170 2023-10-03T19:13:02.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.300+0000 7f21577fe640 1 -- 172.21.15.45:0/1491511801 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21500ab7b0 con 0x7f215806d170 2023-10-03T19:13:02.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.300+0000 7f21577fe640 1 -- 172.21.15.45:0/1491511801 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21500abb40 con 0x7f215806d170 2023-10-03T19:13:02.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.300+0000 7f215f1c3640 1 -- 172.21.15.45:0/1491511801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f215806d170 msgr2=0x7f215814d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:02.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.300+0000 7f215f1c3640 1 --2- 172.21.15.45:0/1491511801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f215806d170 0x7f215814d180 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2150009870 tx=0x7f215001c500 comp rx=0 tx=0).stop 2023-10-03T19:13:02.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.300+0000 7f215f1c3640 1 -- 172.21.15.45:0/1491511801 shutdown_connections 2023-10-03T19:13:02.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.300+0000 7f215f1c3640 1 --2- 172.21.15.45:0/1491511801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f215806d170 0x7f215814d180 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:02.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.300+0000 7f215f1c3640 1 --2- 172.21.15.45:0/1491511801 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f215806f170 0x7f2158150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:02.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.300+0000 7f215f1c3640 1 -- 172.21.15.45:0/1491511801 >> 172.21.15.45:0/1491511801 conn(0x7f21580bcf50 msgr2=0x7f21580bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:02.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.300+0000 7f215f1c3640 1 -- 172.21.15.45:0/1491511801 shutdown_connections 2023-10-03T19:13:02.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.300+0000 7f215f1c3640 1 -- 172.21.15.45:0/1491511801 wait complete. 2023-10-03T19:13:02.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.300+0000 7f215f1c3640 1 Processor -- start 2023-10-03T19:13:02.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.300+0000 7f215f1c3640 1 -- start start 2023-10-03T19:13:02.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.300+0000 7f215f1c3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f215806d170 0x7f215814f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:02.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.300+0000 7f215f1c3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f215806f170 0x7f2158140b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:02.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.300+0000 7f215f1c3640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21580bc8b0 0x7f215813c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:02.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.300+0000 7f215f1c3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215813f090 con 0x7f215806f170 2023-10-03T19:13:02.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.300+0000 7f215f1c3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21581e68e0 con 0x7f215806d170 2023-10-03T19:13:02.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.300+0000 7f215f1c3640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2158143e20 con 0x7f21580bc8b0 2023-10-03T19:13:02.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.300+0000 7f2157fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f215806f170 0x7f2158140b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:02.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.300+0000 7f2157fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f215806f170 0x7f2158140b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54284/0 (socket says 172.21.15.45:54284) 2023-10-03T19:13:02.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.300+0000 7f2157fff640 1 -- 172.21.15.45:0/3523249167 learned_addr learned my addr 172.21.15.45:0/3523249167 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:02.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.300+0000 7f215d760640 1 --2- 172.21.15.45:0/3523249167 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21580bc8b0 0x7f215813c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:02.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.300+0000 7f215cf5f640 1 --2- 172.21.15.45:0/3523249167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f215806d170 0x7f215814f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:02.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.300+0000 7f2157fff640 1 -- 172.21.15.45:0/3523249167 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21580bc8b0 msgr2=0x7f215813c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:02.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.300+0000 7f2157fff640 1 --2- 172.21.15.45:0/3523249167 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21580bc8b0 0x7f215813c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:02.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.300+0000 7f2157fff640 1 -- 172.21.15.45:0/3523249167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f215806d170 msgr2=0x7f215814f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:02.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.300+0000 7f2157fff640 1 --2- 172.21.15.45:0/3523249167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f215806d170 0x7f215814f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:02.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.300+0000 7f2157fff640 1 -- 172.21.15.45:0/3523249167 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21500094d0 con 0x7f215806f170 2023-10-03T19:13:02.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.304+0000 7f2157fff640 1 --2- 172.21.15.45:0/3523249167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f215806f170 0x7f2158140b40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f214800c7f0 tx=0x7f214800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:02.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.304+0000 7f21557fa640 1 -- 172.21.15.45:0/3523249167 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2148006d60 con 0x7f215806f170 2023-10-03T19:13:02.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.304+0000 7f21557fa640 1 -- 172.21.15.45:0/3523249167 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2148003980 con 0x7f215806f170 2023-10-03T19:13:02.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.304+0000 7f21557fa640 1 -- 172.21.15.45:0/3523249167 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2148003d30 con 0x7f215806f170 2023-10-03T19:13:02.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.304+0000 7f215f1c3640 1 -- 172.21.15.45:0/3523249167 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f215806f6d0 con 0x7f215806f170 2023-10-03T19:13:02.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.304+0000 7f215f1c3640 1 -- 172.21.15.45:0/3523249167 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f215806f540 con 0x7f215806f170 2023-10-03T19:13:02.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.304+0000 7f215f1c3640 1 -- 172.21.15.45:0/3523249167 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2158159670 con 0x7f215806f170 2023-10-03T19:13:02.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.304+0000 7f21557fa640 1 -- 172.21.15.45:0/3523249167 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f214800a7f0 con 0x7f215806f170 2023-10-03T19:13:02.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.304+0000 7f21557fa640 1 --2- 172.21.15.45:0/3523249167 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f21440662b0 0x7f2144068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:02.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.304+0000 7f21557fa640 1 -- 172.21.15.45:0/3523249167 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2148083550 con 0x7f215806f170 2023-10-03T19:13:02.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.304+0000 7f215cf5f640 1 --2- 172.21.15.45:0/3523249167 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f21440662b0 0x7f2144068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:02.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.304+0000 7f215cf5f640 1 --2- 172.21.15.45:0/3523249167 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f21440662b0 0x7f2144068760 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f214c009b60 tx=0x7f214c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:02.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.308+0000 7f21557fa640 1 -- 172.21.15.45:0/3523249167 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2148050b10 con 0x7f215806f170 2023-10-03T19:13:02.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.468+0000 7f215f1c3640 1 -- 172.21.15.45:0/3523249167 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f215806d660 con 0x7f215806f170 2023-10-03T19:13:02.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.472+0000 7f21557fa640 1 -- 172.21.15.45:0/3523249167 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18231 (secure 0 0 0) 0x7f2148054130 con 0x7f215806f170 2023-10-03T19:13:02.476 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:13:02.476 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:12:28.941467+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:12:26.226431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T19:12:26.923174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:13:02.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.472+0000 7f215f1c3640 1 -- 172.21.15.45:0/3523249167 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f21440662b0 msgr2=0x7f2144068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:02.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.472+0000 7f215f1c3640 1 --2- 172.21.15.45:0/3523249167 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f21440662b0 0x7f2144068760 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f214c009b60 tx=0x7f214c009190 comp rx=0 tx=0).stop 2023-10-03T19:13:02.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.472+0000 7f215f1c3640 1 -- 172.21.15.45:0/3523249167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f215806f170 msgr2=0x7f2158140b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:02.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.472+0000 7f215f1c3640 1 --2- 172.21.15.45:0/3523249167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f215806f170 0x7f2158140b40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f214800c7f0 tx=0x7f214800ccb0 comp rx=0 tx=0).stop 2023-10-03T19:13:02.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.472+0000 7f215f1c3640 1 -- 172.21.15.45:0/3523249167 shutdown_connections 2023-10-03T19:13:02.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.472+0000 7f215f1c3640 1 --2- 172.21.15.45:0/3523249167 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f21440662b0 0x7f2144068760 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:02.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.472+0000 7f215f1c3640 1 --2- 172.21.15.45:0/3523249167 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21580bc8b0 0x7f215813c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:02.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.472+0000 7f215f1c3640 1 --2- 172.21.15.45:0/3523249167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f215806f170 0x7f2158140b40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:02.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.472+0000 7f215f1c3640 1 --2- 172.21.15.45:0/3523249167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f215806d170 0x7f215814f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:02.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.472+0000 7f215f1c3640 1 -- 172.21.15.45:0/3523249167 >> 172.21.15.45:0/3523249167 conn(0x7f21580bcf50 msgr2=0x7f215814e890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:02.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.472+0000 7f215f1c3640 1 -- 172.21.15.45:0/3523249167 shutdown_connections 2023-10-03T19:13:02.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.472+0000 7f215f1c3640 1 -- 172.21.15.45:0/3523249167 wait complete. 2023-10-03T19:13:02.496 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T19:12:26.226431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T19:12:26.923174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:13:02.496 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:13:02.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.620+0000 7f8b65fc4640 1 Processor -- start 2023-10-03T19:13:02.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.620+0000 7f8b65fc4640 1 -- start start 2023-10-03T19:13:02.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.624+0000 7f8b65fc4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b600712c0 0x7f8b600bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:02.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.624+0000 7f8b65fc4640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b6006c2d0 con 0x7f8b6006c760 2023-10-03T19:13:02.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.624+0000 7f8b65fc4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b60150610 con 0x7f8b6006d560 2023-10-03T19:13:02.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.624+0000 7f8b65fc4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b601508b0 con 0x7f8b600712c0 2023-10-03T19:13:02.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.624+0000 7f8b5ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8b6006c760 0x7f8b600a5ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38730/0 (socket says 172.21.15.45:38730) 2023-10-03T19:13:02.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.624+0000 7f8b5ffff640 1 -- 172.21.15.45:0/660951521 learned_addr learned my addr 172.21.15.45:0/660951521 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:02.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.624+0000 7f8b5f7fe640 1 --2- 172.21.15.45:0/660951521 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b600712c0 0x7f8b600bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:02.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.624+0000 7f8b5e7fc640 1 -- 172.21.15.45:0/660951521 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1963717931 0 0) 0x7f8b6006c2d0 con 0x7f8b6006c760 2023-10-03T19:13:02.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.624+0000 7f8b5e7fc640 1 -- 172.21.15.45:0/660951521 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b48003530 con 0x7f8b6006c760 2023-10-03T19:13:02.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.624+0000 7f8b5e7fc640 1 -- 172.21.15.45:0/660951521 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 741597188 0 0) 0x7f8b48003530 con 0x7f8b6006c760 2023-10-03T19:13:02.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.624+0000 7f8b5e7fc640 1 -- 172.21.15.45:0/660951521 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b600712c0 msgr2=0x7f8b600bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:02.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.624+0000 7f8b5e7fc640 1 --2- 172.21.15.45:0/660951521 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b600712c0 0x7f8b600bcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:02.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.624+0000 7f8b5e7fc640 1 -- 172.21.15.45:0/660951521 >> v1:172.21.15.79:6789/0 conn(0x7f8b6006d560 legacy=0x7f8b600a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:02.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.624+0000 7f8b5e7fc640 1 -- 172.21.15.45:0/660951521 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6006d2e0 con 0x7f8b6006c760 2023-10-03T19:13:02.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.624+0000 7f8b5e7fc640 1 -- 172.21.15.45:0/660951521 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f8b58001a00 con 0x7f8b6006c760 2023-10-03T19:13:02.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.624+0000 7f8b5e7fc640 1 -- 172.21.15.45:0/660951521 >> v1:172.21.15.45:6789/0 conn(0x7f8b6006c760 legacy=0x7f8b600a5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:02.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.624+0000 7f8b5e7fc640 1 --2- 172.21.15.45:0/660951521 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b600712c0 0x7f8b480039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:02.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.624+0000 7f8b5e7fc640 1 --2- 172.21.15.45:0/660951521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b48003f30 0x7f8b480047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:02.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.624+0000 7f8b5e7fc640 1 --2- 172.21.15.45:0/660951521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b48004d10 0x7f8b48005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:02.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.624+0000 7f8b5e7fc640 1 -- 172.21.15.45:0/660951521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b601508b0 con 0x7f8b48004d10 2023-10-03T19:13:02.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.624+0000 7f8b5e7fc640 1 -- 172.21.15.45:0/660951521 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4800ba70 con 0x7f8b48003f30 2023-10-03T19:13:02.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.624+0000 7f8b5e7fc640 1 -- 172.21.15.45:0/660951521 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4800bc30 con 0x7f8b600712c0 2023-10-03T19:13:02.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.624+0000 7f8b5ffff640 1 --2- 172.21.15.45:0/660951521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b48004d10 0x7f8b48005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:02.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.624+0000 7f8b5f7fe640 1 --2- 172.21.15.45:0/660951521 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b600712c0 0x7f8b480039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:02.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.624+0000 7f8b5effd640 1 --2- 172.21.15.45:0/660951521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b48003f30 0x7f8b480047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:02.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.624+0000 7f8b5ffff640 1 -- 172.21.15.45:0/660951521 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b600712c0 msgr2=0x7f8b480039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:02.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.624+0000 7f8b5ffff640 1 --2- 172.21.15.45:0/660951521 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b600712c0 0x7f8b480039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:02.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.624+0000 7f8b5ffff640 1 -- 172.21.15.45:0/660951521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b48003f30 msgr2=0x7f8b480047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:02.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.624+0000 7f8b5ffff640 1 --2- 172.21.15.45:0/660951521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b48003f30 0x7f8b480047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:02.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.624+0000 7f8b5ffff640 1 -- 172.21.15.45:0/660951521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b48003530 con 0x7f8b48004d10 2023-10-03T19:13:02.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b5ffff640 1 --2- 172.21.15.45:0/660951521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b48004d10 0x7f8b48005180 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8b6006cbc0 tx=0x7f8b5801d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe76c32e547385f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:02.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b5e7fc640 1 -- 172.21.15.45:0/660951521 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b580072d0 con 0x7f8b48004d10 2023-10-03T19:13:02.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b5e7fc640 1 -- 172.21.15.45:0/660951521 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b580a8070 con 0x7f8b48004d10 2023-10-03T19:13:02.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b5e7fc640 1 -- 172.21.15.45:0/660951521 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b580076f0 con 0x7f8b48004d10 2023-10-03T19:13:02.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b65fc4640 1 -- 172.21.15.45:0/660951521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b48004d10 msgr2=0x7f8b48005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:02.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b65fc4640 1 --2- 172.21.15.45:0/660951521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b48004d10 0x7f8b48005180 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8b6006cbc0 tx=0x7f8b5801d2e0 comp rx=0 tx=0).stop 2023-10-03T19:13:02.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b5ffff640 1 -- 172.21.15.45:0/660951521 reap_dead start 2023-10-03T19:13:02.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b65fc4640 1 -- 172.21.15.45:0/660951521 shutdown_connections 2023-10-03T19:13:02.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b65fc4640 1 -- 172.21.15.45:0/660951521 >> 172.21.15.45:0/660951521 conn(0x7f8b600a20d0 msgr2=0x7f8b600a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:02.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b65fc4640 1 -- 172.21.15.45:0/660951521 shutdown_connections 2023-10-03T19:13:02.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b65fc4640 1 -- 172.21.15.45:0/660951521 wait complete. 2023-10-03T19:13:02.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b65fc4640 1 Processor -- start 2023-10-03T19:13:02.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b65fc4640 1 -- start start 2023-10-03T19:13:02.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b65fc4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b600b99b0 0x7f8b60070060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:02.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b65fc4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b6014d200 0x7f8b6013e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:02.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b65fc4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b6006f410 0x7f8b6013ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:02.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b65fc4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6014aa00 con 0x7f8b6014d200 2023-10-03T19:13:02.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b65fc4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6013f120 con 0x7f8b600b99b0 2023-10-03T19:13:02.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b65fc4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6006f8b0 con 0x7f8b6006f410 2023-10-03T19:13:02.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b5effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b6014d200 0x7f8b6013e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:02.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b5effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b6014d200 0x7f8b6013e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54310/0 (socket says 172.21.15.45:54310) 2023-10-03T19:13:02.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b5effd640 1 -- 172.21.15.45:0/863348041 learned_addr learned my addr 172.21.15.45:0/863348041 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:02.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b5f7fe640 1 --2- 172.21.15.45:0/863348041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b600b99b0 0x7f8b60070060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:02.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b5ffff640 1 --2- 172.21.15.45:0/863348041 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b6006f410 0x7f8b6013ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:02.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b5effd640 1 -- 172.21.15.45:0/863348041 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b6006f410 msgr2=0x7f8b6013ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:02.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b5effd640 1 --2- 172.21.15.45:0/863348041 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b6006f410 0x7f8b6013ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:02.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b5effd640 1 -- 172.21.15.45:0/863348041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b600b99b0 msgr2=0x7f8b60070060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:02.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b5effd640 1 --2- 172.21.15.45:0/863348041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b600b99b0 0x7f8b60070060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:02.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b5effd640 1 -- 172.21.15.45:0/863348041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b60071690 con 0x7f8b6014d200 2023-10-03T19:13:02.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b5f7fe640 1 --2- 172.21.15.45:0/863348041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b600b99b0 0x7f8b60070060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:13:02.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b5effd640 1 --2- 172.21.15.45:0/863348041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b6014d200 0x7f8b6013e6a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400e550 tx=0x7f8b5400ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:02.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b47fff640 1 -- 172.21.15.45:0/863348041 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b540052e0 con 0x7f8b6014d200 2023-10-03T19:13:02.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b47fff640 1 -- 172.21.15.45:0/863348041 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b54005440 con 0x7f8b6014d200 2023-10-03T19:13:02.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b65fc4640 1 -- 172.21.15.45:0/863348041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b6006cf40 con 0x7f8b6014d200 2023-10-03T19:13:02.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b47fff640 1 -- 172.21.15.45:0/863348041 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b54003820 con 0x7f8b6014d200 2023-10-03T19:13:02.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.628+0000 7f8b65fc4640 1 -- 172.21.15.45:0/863348041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b60071820 con 0x7f8b6014d200 2023-10-03T19:13:02.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.632+0000 7f8b65fc4640 1 -- 172.21.15.45:0/863348041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b6004de80 con 0x7f8b6014d200 2023-10-03T19:13:02.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.632+0000 7f8b47fff640 1 -- 172.21.15.45:0/863348041 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8b54003980 con 0x7f8b6014d200 2023-10-03T19:13:02.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.632+0000 7f8b47fff640 1 --2- 172.21.15.45:0/863348041 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8b4c0662b0 0x7f8b4c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:02.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.632+0000 7f8b47fff640 1 -- 172.21.15.45:0/863348041 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8b54083840 con 0x7f8b6014d200 2023-10-03T19:13:02.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.632+0000 7f8b5f7fe640 1 --2- 172.21.15.45:0/863348041 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8b4c0662b0 0x7f8b4c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:02.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.632+0000 7f8b5f7fe640 1 --2- 172.21.15.45:0/863348041 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8b4c0662b0 0x7f8b4c068760 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009af0 tx=0x7f8b50008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:02.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.636+0000 7f8b47fff640 1 -- 172.21.15.45:0/863348041 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8b54050d50 con 0x7f8b6014d200 2023-10-03T19:13:02.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.792+0000 7f8b65fc4640 1 -- 172.21.15.45:0/863348041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8b600ba160 con 0x7f8b6014d200 2023-10-03T19:13:02.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.792+0000 7f8b47fff640 1 -- 172.21.15.45:0/863348041 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8b54054370 con 0x7f8b6014d200 2023-10-03T19:13:02.797 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:13:02.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.796+0000 7f8b65fc4640 1 -- 172.21.15.45:0/863348041 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8b4c0662b0 msgr2=0x7f8b4c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:02.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.796+0000 7f8b65fc4640 1 --2- 172.21.15.45:0/863348041 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8b4c0662b0 0x7f8b4c068760 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009af0 tx=0x7f8b50008040 comp rx=0 tx=0).stop 2023-10-03T19:13:02.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.796+0000 7f8b65fc4640 1 -- 172.21.15.45:0/863348041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b6014d200 msgr2=0x7f8b6013e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:02.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.796+0000 7f8b65fc4640 1 --2- 172.21.15.45:0/863348041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b6014d200 0x7f8b6013e6a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400e550 tx=0x7f8b5400ea10 comp rx=0 tx=0).stop 2023-10-03T19:13:02.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.796+0000 7f8b65fc4640 1 -- 172.21.15.45:0/863348041 shutdown_connections 2023-10-03T19:13:02.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.796+0000 7f8b65fc4640 1 --2- 172.21.15.45:0/863348041 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8b4c0662b0 0x7f8b4c068760 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:02.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.796+0000 7f8b65fc4640 1 --2- 172.21.15.45:0/863348041 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b6006f410 0x7f8b6013ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:02.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.796+0000 7f8b65fc4640 1 --2- 172.21.15.45:0/863348041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b6014d200 0x7f8b6013e6a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:02.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.796+0000 7f8b65fc4640 1 --2- 172.21.15.45:0/863348041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b600b99b0 0x7f8b60070060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:02.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.796+0000 7f8b65fc4640 1 -- 172.21.15.45:0/863348041 >> 172.21.15.45:0/863348041 conn(0x7f8b600a20d0 msgr2=0x7f8b600be010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:02.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.796+0000 7f8b65fc4640 1 -- 172.21.15.45:0/863348041 shutdown_connections 2023-10-03T19:13:02.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.796+0000 7f8b65fc4640 1 -- 172.21.15.45:0/863348041 wait complete. 2023-10-03T19:13:02.817 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:13:02.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.936+0000 7f38ccfe2640 1 Processor -- start 2023-10-03T19:13:02.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.936+0000 7f38ccfe2640 1 -- start start 2023-10-03T19:13:02.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.936+0000 7f38ccfe2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38c806c410 0x7f38c80bc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:02.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.936+0000 7f38ccfe2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f38c80bc860 0x7f38c8147d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:02.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.936+0000 7f38ccfe2640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c806f650 con 0x7f38c806cc20 2023-10-03T19:13:02.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.936+0000 7f38ccfe2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c806f3b0 con 0x7f38c80bc860 2023-10-03T19:13:02.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.936+0000 7f38ccfe2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c814b680 con 0x7f38c806c410 2023-10-03T19:13:02.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.936+0000 7f38c6d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f38c806cc20 0x7f38c814e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38742/0 (socket says 172.21.15.45:38742) 2023-10-03T19:13:02.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.936+0000 7f38c5d9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f38c80bc860 0x7f38c8147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:02.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.936+0000 7f38c6d9d640 1 -- 172.21.15.45:0/1116314237 learned_addr learned my addr 172.21.15.45:0/1116314237 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:02.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.936+0000 7f38c659c640 1 --2- 172.21.15.45:0/1116314237 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38c806c410 0x7f38c80bc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:02.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.936+0000 7f38c559a640 1 -- 172.21.15.45:0/1116314237 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160920445 0 0) 0x7f38c806f650 con 0x7f38c806cc20 2023-10-03T19:13:02.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.936+0000 7f38c5d9b640 1 -- 172.21.15.45:0/1116314237 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38c806c410 msgr2=0x7f38c80bc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:02.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.936+0000 7f38c5d9b640 1 --2- 172.21.15.45:0/1116314237 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38c806c410 0x7f38c80bc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:02.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.936+0000 7f38c5d9b640 1 -- 172.21.15.45:0/1116314237 >> v1:172.21.15.45:6789/0 conn(0x7f38c806cc20 legacy=0x7f38c814e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:02.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.936+0000 7f38c5d9b640 1 -- 172.21.15.45:0/1116314237 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c814b960 con 0x7f38c80bc860 2023-10-03T19:13:02.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.936+0000 7f38c5d9b640 1 --2- 172.21.15.45:0/1116314237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38c80bc860 0x7f38c8147d10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f38bc0097f0 tx=0x7f38bc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc6c2d3e52a434f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:02.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38c559a640 1 -- 172.21.15.45:0/1116314237 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc0a6040 con 0x7f38c80bc860 2023-10-03T19:13:02.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38c559a640 1 -- 172.21.15.45:0/1116314237 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38bc0aa600 con 0x7f38c80bc860 2023-10-03T19:13:02.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38c559a640 1 -- 172.21.15.45:0/1116314237 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc0aa990 con 0x7f38c80bc860 2023-10-03T19:13:02.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38ccfe2640 1 -- 172.21.15.45:0/1116314237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38c80bc860 msgr2=0x7f38c8147d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:02.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38ccfe2640 1 --2- 172.21.15.45:0/1116314237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38c80bc860 0x7f38c8147d10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f38bc0097f0 tx=0x7f38bc01c480 comp rx=0 tx=0).stop 2023-10-03T19:13:02.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38ccfe2640 1 -- 172.21.15.45:0/1116314237 shutdown_connections 2023-10-03T19:13:02.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38ccfe2640 1 --2- 172.21.15.45:0/1116314237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38c80bc860 0x7f38c8147d10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:02.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38ccfe2640 1 --2- 172.21.15.45:0/1116314237 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38c806c410 0x7f38c80bc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:02.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38ccfe2640 1 -- 172.21.15.45:0/1116314237 >> 172.21.15.45:0/1116314237 conn(0x7f38c80a20d0 msgr2=0x7f38c80a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:02.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38ccfe2640 1 -- 172.21.15.45:0/1116314237 shutdown_connections 2023-10-03T19:13:02.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38ccfe2640 1 -- 172.21.15.45:0/1116314237 wait complete. 2023-10-03T19:13:02.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38ccfe2640 1 Processor -- start 2023-10-03T19:13:02.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38ccfe2640 1 -- start start 2023-10-03T19:13:02.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38ccfe2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38c806c410 0x7f38c81457a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:02.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38ccfe2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38c806cc20 0x7f38c8134e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:02.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38ccfe2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38c8145e80 0x7f38c8131460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:02.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38ccfe2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c8145ce0 con 0x7f38c8145e80 2023-10-03T19:13:02.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38ccfe2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c81477e0 con 0x7f38c806cc20 2023-10-03T19:13:02.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38ccfe2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c8134160 con 0x7f38c806c410 2023-10-03T19:13:02.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38c6d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38c8145e80 0x7f38c8131460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:02.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38c6d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38c8145e80 0x7f38c8131460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54334/0 (socket says 172.21.15.45:54334) 2023-10-03T19:13:02.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38c6d9d640 1 -- 172.21.15.45:0/2449877641 learned_addr learned my addr 172.21.15.45:0/2449877641 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:02.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38c659c640 1 --2- 172.21.15.45:0/2449877641 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38c806c410 0x7f38c81457a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:02.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38c5d9b640 1 --2- 172.21.15.45:0/2449877641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38c806cc20 0x7f38c8134e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:02.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38c6d9d640 1 -- 172.21.15.45:0/2449877641 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38c806c410 msgr2=0x7f38c81457a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:02.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38c6d9d640 1 --2- 172.21.15.45:0/2449877641 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38c806c410 0x7f38c81457a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:02.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38c6d9d640 1 -- 172.21.15.45:0/2449877641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38c806cc20 msgr2=0x7f38c8134e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:02.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38c6d9d640 1 --2- 172.21.15.45:0/2449877641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38c806cc20 0x7f38c8134e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:02.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38c6d9d640 1 -- 172.21.15.45:0/2449877641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38bc009420 con 0x7f38c8145e80 2023-10-03T19:13:02.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38c6d9d640 1 --2- 172.21.15.45:0/2449877641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38c8145e80 0x7f38c8131460 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f38c000c7e0 tx=0x7f38c000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:02.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38b6ffd640 1 -- 172.21.15.45:0/2449877641 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c000a640 con 0x7f38c8145e80 2023-10-03T19:13:02.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38b6ffd640 1 -- 172.21.15.45:0/2449877641 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c000a7a0 con 0x7f38c8145e80 2023-10-03T19:13:02.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38ccfe2640 1 -- 172.21.15.45:0/2449877641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c81483e0 con 0x7f38c8145e80 2023-10-03T19:13:02.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38b6ffd640 1 -- 172.21.15.45:0/2449877641 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c000ab10 con 0x7f38c8145e80 2023-10-03T19:13:02.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.940+0000 7f38ccfe2640 1 -- 172.21.15.45:0/2449877641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c8148250 con 0x7f38c8145e80 2023-10-03T19:13:02.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.944+0000 7f38ccfe2640 1 -- 172.21.15.45:0/2449877641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c8148570 con 0x7f38c8145e80 2023-10-03T19:13:02.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.944+0000 7f38b6ffd640 1 -- 172.21.15.45:0/2449877641 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f38c000ac70 con 0x7f38c8145e80 2023-10-03T19:13:02.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.944+0000 7f38b6ffd640 1 --2- 172.21.15.45:0/2449877641 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f38a80662b0 0x7f38a8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:02.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.944+0000 7f38b6ffd640 1 -- 172.21.15.45:0/2449877641 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f38c0083540 con 0x7f38c8145e80 2023-10-03T19:13:02.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.944+0000 7f38c659c640 1 --2- 172.21.15.45:0/2449877641 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f38a80662b0 0x7f38a8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:02.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.944+0000 7f38c659c640 1 --2- 172.21.15.45:0/2449877641 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f38a80662b0 0x7f38a8068760 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f38b8007a60 tx=0x7f38b8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:02.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:02.948+0000 7f38b6ffd640 1 -- 172.21.15.45:0/2449877641 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f38c0050b00 con 0x7f38c8145e80 2023-10-03T19:13:03.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.100+0000 7f38ccfe2640 1 -- 172.21.15.45:0/2449877641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f38c8132570 con 0x7f38c8145e80 2023-10-03T19:13:03.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.100+0000 7f38b6ffd640 1 -- 172.21.15.45:0/2449877641 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f38c8132570 con 0x7f38c8145e80 2023-10-03T19:13:03.106 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:13:03.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.100+0000 7f38ccfe2640 1 -- 172.21.15.45:0/2449877641 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f38a80662b0 msgr2=0x7f38a8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:03.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.100+0000 7f38ccfe2640 1 --2- 172.21.15.45:0/2449877641 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f38a80662b0 0x7f38a8068760 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f38b8007a60 tx=0x7f38b8008040 comp rx=0 tx=0).stop 2023-10-03T19:13:03.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.100+0000 7f38ccfe2640 1 -- 172.21.15.45:0/2449877641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38c8145e80 msgr2=0x7f38c8131460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:03.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.100+0000 7f38ccfe2640 1 --2- 172.21.15.45:0/2449877641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38c8145e80 0x7f38c8131460 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f38c000c7e0 tx=0x7f38c000cca0 comp rx=0 tx=0).stop 2023-10-03T19:13:03.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.100+0000 7f38ccfe2640 1 -- 172.21.15.45:0/2449877641 shutdown_connections 2023-10-03T19:13:03.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.100+0000 7f38ccfe2640 1 --2- 172.21.15.45:0/2449877641 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f38a80662b0 0x7f38a8068760 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:03.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.100+0000 7f38ccfe2640 1 --2- 172.21.15.45:0/2449877641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38c8145e80 0x7f38c8131460 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:03.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.100+0000 7f38ccfe2640 1 --2- 172.21.15.45:0/2449877641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38c806cc20 0x7f38c8134e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:03.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.100+0000 7f38ccfe2640 1 --2- 172.21.15.45:0/2449877641 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38c806c410 0x7f38c81457a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:03.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.100+0000 7f38ccfe2640 1 -- 172.21.15.45:0/2449877641 >> 172.21.15.45:0/2449877641 conn(0x7f38c80a20d0 msgr2=0x7f38c80a2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:03.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.100+0000 7f38ccfe2640 1 -- 172.21.15.45:0/2449877641 shutdown_connections 2023-10-03T19:13:03.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.100+0000 7f38ccfe2640 1 -- 172.21.15.45:0/2449877641 wait complete. 2023-10-03T19:13:03.124 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T19:13:03.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.236+0000 7f4badff2640 1 Processor -- start 2023-10-03T19:13:03.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.236+0000 7f4badff2640 1 -- start start 2023-10-03T19:13:03.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.236+0000 7f4badff2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ba80c07f0 0x7f4ba80bd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:03.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.236+0000 7f4badff2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4ba80c19b0 0x7f4ba814bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:03.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.236+0000 7f4badff2640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba80c14c0 con 0x7f4ba814bff0 2023-10-03T19:13:03.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.236+0000 7f4badff2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ba80be420 con 0x7f4ba80c19b0 2023-10-03T19:13:03.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.236+0000 7f4badff2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba80a1f80 con 0x7f4ba80c07f0 2023-10-03T19:13:03.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.236+0000 7f4ba6ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4ba80c19b0 0x7f4ba814bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:03.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.236+0000 7f4ba6ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4ba80c19b0 0x7f4ba814bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54342/0 (socket says 172.21.15.45:54342) 2023-10-03T19:13:03.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.236+0000 7f4ba6ffd640 1 -- 172.21.15.45:0/1848796319 learned_addr learned my addr 172.21.15.45:0/1848796319 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:03.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.236+0000 7f4ba77fe640 1 --2- 172.21.15.45:0/1848796319 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ba80c07f0 0x7f4ba80bd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:03.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.236+0000 7f4ba6ffd640 1 -- 172.21.15.45:0/1848796319 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ba80c07f0 msgr2=0x7f4ba80bd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:03.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.236+0000 7f4ba6ffd640 1 --2- 172.21.15.45:0/1848796319 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ba80c07f0 0x7f4ba80bd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:03.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.236+0000 7f4ba6ffd640 1 -- 172.21.15.45:0/1848796319 >> v1:172.21.15.79:6789/0 conn(0x7f4ba814bff0 legacy=0x7f4ba814fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:03.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.236+0000 7f4ba6ffd640 1 -- 172.21.15.45:0/1848796319 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba80bd070 con 0x7f4ba80c19b0 2023-10-03T19:13:03.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.240+0000 7f4ba6ffd640 1 --2- 172.21.15.45:0/1848796319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ba80c19b0 0x7f4ba814bab0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c009870 tx=0x7f4b9c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1649cc2437cbd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:03.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.240+0000 7f4ba67fc640 1 -- 172.21.15.45:0/1848796319 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c0ab680 con 0x7f4ba80c19b0 2023-10-03T19:13:03.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.240+0000 7f4ba67fc640 1 -- 172.21.15.45:0/1848796319 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c0ab7e0 con 0x7f4ba80c19b0 2023-10-03T19:13:03.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.240+0000 7f4ba67fc640 1 -- 172.21.15.45:0/1848796319 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c0abb70 con 0x7f4ba80c19b0 2023-10-03T19:13:03.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.240+0000 7f4badff2640 1 -- 172.21.15.45:0/1848796319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ba80c19b0 msgr2=0x7f4ba814bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:03.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.240+0000 7f4badff2640 1 --2- 172.21.15.45:0/1848796319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ba80c19b0 0x7f4ba814bab0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c009870 tx=0x7f4b9c01c480 comp rx=0 tx=0).stop 2023-10-03T19:13:03.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.240+0000 7f4badff2640 1 -- 172.21.15.45:0/1848796319 shutdown_connections 2023-10-03T19:13:03.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.240+0000 7f4badff2640 1 --2- 172.21.15.45:0/1848796319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ba80c19b0 0x7f4ba814bab0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:03.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.240+0000 7f4badff2640 1 --2- 172.21.15.45:0/1848796319 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ba80c07f0 0x7f4ba80bd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:03.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.240+0000 7f4badff2640 1 -- 172.21.15.45:0/1848796319 >> 172.21.15.45:0/1848796319 conn(0x7f4ba80a4260 msgr2=0x7f4ba80a4660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:03.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.240+0000 7f4badff2640 1 -- 172.21.15.45:0/1848796319 shutdown_connections 2023-10-03T19:13:03.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.240+0000 7f4badff2640 1 -- 172.21.15.45:0/1848796319 wait complete. 2023-10-03T19:13:03.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.240+0000 7f4badff2640 1 Processor -- start 2023-10-03T19:13:03.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.240+0000 7f4badff2640 1 -- start start 2023-10-03T19:13:03.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.240+0000 7f4badff2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ba80c07f0 0x7f4ba814ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:03.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.240+0000 7f4badff2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ba80c19b0 0x7f4ba814f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:03.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.240+0000 7f4badff2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ba814bff0 0x7f4ba814f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:03.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.240+0000 7f4badff2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba8145c30 con 0x7f4ba80c19b0 2023-10-03T19:13:03.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.240+0000 7f4badff2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba814fba0 con 0x7f4ba814bff0 2023-10-03T19:13:03.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.240+0000 7f4badff2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba814b2d0 con 0x7f4ba80c07f0 2023-10-03T19:13:03.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.240+0000 7f4ba6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ba80c19b0 0x7f4ba814f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:03.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.240+0000 7f4ba6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ba80c19b0 0x7f4ba814f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54352/0 (socket says 172.21.15.45:54352) 2023-10-03T19:13:03.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.240+0000 7f4ba6ffd640 1 -- 172.21.15.45:0/4250574284 learned_addr learned my addr 172.21.15.45:0/4250574284 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:03.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.244+0000 7f4ba77fe640 1 --2- 172.21.15.45:0/4250574284 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ba80c07f0 0x7f4ba814ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:03.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.244+0000 7f4ba7fff640 1 --2- 172.21.15.45:0/4250574284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ba814bff0 0x7f4ba814f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:03.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.244+0000 7f4ba6ffd640 1 -- 172.21.15.45:0/4250574284 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ba80c07f0 msgr2=0x7f4ba814ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:03.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.244+0000 7f4ba6ffd640 1 --2- 172.21.15.45:0/4250574284 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ba80c07f0 0x7f4ba814ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:03.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.244+0000 7f4ba6ffd640 1 -- 172.21.15.45:0/4250574284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ba814bff0 msgr2=0x7f4ba814f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:03.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.244+0000 7f4ba6ffd640 1 --2- 172.21.15.45:0/4250574284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ba814bff0 0x7f4ba814f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:03.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.244+0000 7f4ba6ffd640 1 -- 172.21.15.45:0/4250574284 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9c0094d0 con 0x7f4ba80c19b0 2023-10-03T19:13:03.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.244+0000 7f4ba6ffd640 1 --2- 172.21.15.45:0/4250574284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ba80c19b0 0x7f4ba814f120 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c0ad040 tx=0x7f4b9c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:03.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.244+0000 7f4b8ffff640 1 -- 172.21.15.45:0/4250574284 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c0ab680 con 0x7f4ba80c19b0 2023-10-03T19:13:03.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.244+0000 7f4b8ffff640 1 -- 172.21.15.45:0/4250574284 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c0b4800 con 0x7f4ba80c19b0 2023-10-03T19:13:03.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.244+0000 7f4badff2640 1 -- 172.21.15.45:0/4250574284 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ba80c0d50 con 0x7f4ba80c19b0 2023-10-03T19:13:03.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.244+0000 7f4b8ffff640 1 -- 172.21.15.45:0/4250574284 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c0b4bb0 con 0x7f4ba80c19b0 2023-10-03T19:13:03.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.244+0000 7f4badff2640 1 -- 172.21.15.45:0/4250574284 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba80c0bc0 con 0x7f4ba80c19b0 2023-10-03T19:13:03.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.244+0000 7f4badff2640 1 -- 172.21.15.45:0/4250574284 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ba8150540 con 0x7f4ba80c19b0 2023-10-03T19:13:03.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.244+0000 7f4b8ffff640 1 -- 172.21.15.45:0/4250574284 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4b9c0b4d10 con 0x7f4ba80c19b0 2023-10-03T19:13:03.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.244+0000 7f4b8ffff640 1 --2- 172.21.15.45:0/4250574284 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4b940662b0 0x7f4b94068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:03.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.244+0000 7f4b8ffff640 1 -- 172.21.15.45:0/4250574284 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4b9c11eb70 con 0x7f4ba80c19b0 2023-10-03T19:13:03.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.244+0000 7f4ba77fe640 1 --2- 172.21.15.45:0/4250574284 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4b940662b0 0x7f4b94068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:03.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.244+0000 7f4ba77fe640 1 --2- 172.21.15.45:0/4250574284 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4b940662b0 0x7f4b94068760 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4b98009af0 tx=0x7f4b98008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:03.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.248+0000 7f4b8ffff640 1 -- 172.21.15.45:0/4250574284 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4b9c0ebfe0 con 0x7f4ba80c19b0 2023-10-03T19:13:03.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.404+0000 7f4badff2640 1 -- 172.21.15.45:0/4250574284 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4ba804de80 con 0x7f4ba80c19b0 2023-10-03T19:13:03.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.404+0000 7f4b8ffff640 1 -- 172.21.15.45:0/4250574284 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4b9c0ef600 con 0x7f4ba80c19b0 2023-10-03T19:13:03.411 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-03T19:13:03.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.408+0000 7f4badff2640 1 -- 172.21.15.45:0/4250574284 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4b940662b0 msgr2=0x7f4b94068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:03.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.408+0000 7f4badff2640 1 --2- 172.21.15.45:0/4250574284 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4b940662b0 0x7f4b94068760 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4b98009af0 tx=0x7f4b98008040 comp rx=0 tx=0).stop 2023-10-03T19:13:03.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.408+0000 7f4badff2640 1 -- 172.21.15.45:0/4250574284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ba80c19b0 msgr2=0x7f4ba814f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:03.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.408+0000 7f4badff2640 1 --2- 172.21.15.45:0/4250574284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ba80c19b0 0x7f4ba814f120 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c0ad040 tx=0x7f4b9c01acc0 comp rx=0 tx=0).stop 2023-10-03T19:13:03.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.408+0000 7f4badff2640 1 -- 172.21.15.45:0/4250574284 shutdown_connections 2023-10-03T19:13:03.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.408+0000 7f4badff2640 1 --2- 172.21.15.45:0/4250574284 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4b940662b0 0x7f4b94068760 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:03.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.408+0000 7f4badff2640 1 --2- 172.21.15.45:0/4250574284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ba814bff0 0x7f4ba814f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:03.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.408+0000 7f4badff2640 1 --2- 172.21.15.45:0/4250574284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ba80c19b0 0x7f4ba814f120 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:03.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.408+0000 7f4badff2640 1 --2- 172.21.15.45:0/4250574284 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ba80c07f0 0x7f4ba814ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:03.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.408+0000 7f4badff2640 1 -- 172.21.15.45:0/4250574284 >> 172.21.15.45:0/4250574284 conn(0x7f4ba80a4260 msgr2=0x7f4ba814cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:03.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.408+0000 7f4badff2640 1 -- 172.21.15.45:0/4250574284 shutdown_connections 2023-10-03T19:13:03.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.408+0000 7f4badff2640 1 -- 172.21.15.45:0/4250574284 wait complete. 2023-10-03T19:13:03.429 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T19:13:03.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.536+0000 7fbf3315f640 1 Processor -- start 2023-10-03T19:13:03.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.540+0000 7fbf3315f640 1 -- start start 2023-10-03T19:13:03.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.540+0000 7fbf3315f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbf2c14f510 0x7fbf2c14b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:03.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.540+0000 7fbf3315f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf2c0bd9f0 0x7fbf2c14b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:03.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.540+0000 7fbf3315f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf2c14f080 con 0x7fbf2c06f880 2023-10-03T19:13:03.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.540+0000 7fbf3315f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf2c06f3e0 con 0x7fbf2c14f510 2023-10-03T19:13:03.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.540+0000 7fbf3315f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c070e90 con 0x7fbf2c0bd9f0 2023-10-03T19:13:03.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.540+0000 7fbf23fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbf2c14f510 0x7fbf2c14b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:03.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.540+0000 7fbf30efb640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbf2c06f880 0x7fbf2c0a5940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38756/0 (socket says 172.21.15.45:38756) 2023-10-03T19:13:03.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.540+0000 7fbf30efb640 1 -- 172.21.15.45:0/2474972767 learned_addr learned my addr 172.21.15.45:0/2474972767 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:03.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.540+0000 7fbf316fc640 1 --2- 172.21.15.45:0/2474972767 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf2c0bd9f0 0x7fbf2c14b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:03.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.540+0000 7fbf23fff640 1 -- 172.21.15.45:0/2474972767 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf2c0bd9f0 msgr2=0x7fbf2c14b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:03.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.540+0000 7fbf23fff640 1 --2- 172.21.15.45:0/2474972767 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf2c0bd9f0 0x7fbf2c14b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:03.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.540+0000 7fbf23fff640 1 -- 172.21.15.45:0/2474972767 >> v1:172.21.15.45:6789/0 conn(0x7fbf2c06f880 legacy=0x7fbf2c0a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:03.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.540+0000 7fbf237fe640 1 -- 172.21.15.45:0/2474972767 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3778628697 0 0) 0x7fbf2c14f080 con 0x7fbf2c06f880 2023-10-03T19:13:03.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.540+0000 7fbf23fff640 1 -- 172.21.15.45:0/2474972767 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2c14ea30 con 0x7fbf2c14f510 2023-10-03T19:13:03.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.540+0000 7fbf23fff640 1 --2- 172.21.15.45:0/2474972767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf2c14f510 0x7fbf2c14b320 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c0097c0 tx=0x7fbf1c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653172f30e1f4349 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:03.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.540+0000 7fbf237fe640 1 -- 172.21.15.45:0/2474972767 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c0ac410 con 0x7fbf2c14f510 2023-10-03T19:13:03.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.540+0000 7fbf237fe640 1 -- 172.21.15.45:0/2474972767 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1c0ac570 con 0x7fbf2c14f510 2023-10-03T19:13:03.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.540+0000 7fbf237fe640 1 -- 172.21.15.45:0/2474972767 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c0ac900 con 0x7fbf2c14f510 2023-10-03T19:13:03.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf3315f640 1 -- 172.21.15.45:0/2474972767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf2c14f510 msgr2=0x7fbf2c14b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:03.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf3315f640 1 --2- 172.21.15.45:0/2474972767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf2c14f510 0x7fbf2c14b320 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c0097c0 tx=0x7fbf1c01c450 comp rx=0 tx=0).stop 2023-10-03T19:13:03.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf3315f640 1 -- 172.21.15.45:0/2474972767 shutdown_connections 2023-10-03T19:13:03.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf3315f640 1 --2- 172.21.15.45:0/2474972767 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf2c0bd9f0 0x7fbf2c14b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:03.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf3315f640 1 --2- 172.21.15.45:0/2474972767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf2c14f510 0x7fbf2c14b320 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:03.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf3315f640 1 -- 172.21.15.45:0/2474972767 >> 172.21.15.45:0/2474972767 conn(0x7fbf2c0a20d0 msgr2=0x7fbf2c0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:03.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf3315f640 1 -- 172.21.15.45:0/2474972767 shutdown_connections 2023-10-03T19:13:03.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf3315f640 1 -- 172.21.15.45:0/2474972767 wait complete. 2023-10-03T19:13:03.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf3315f640 1 Processor -- start 2023-10-03T19:13:03.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf3315f640 1 -- start start 2023-10-03T19:13:03.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf3315f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf2c06f880 0x7fbf2c14b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:03.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf3315f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf2c0bd9f0 0x7fbf2c148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:03.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf3315f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf2c14f510 0x7fbf2c0be780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:03.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf3315f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c149a20 con 0x7fbf2c0bd9f0 2023-10-03T19:13:03.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf3315f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c0be010 con 0x7fbf2c06f880 2023-10-03T19:13:03.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf3315f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c1486b0 con 0x7fbf2c14f510 2023-10-03T19:13:03.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf23fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf2c0bd9f0 0x7fbf2c148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:03.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf23fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf2c0bd9f0 0x7fbf2c148170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54376/0 (socket says 172.21.15.45:54376) 2023-10-03T19:13:03.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf23fff640 1 -- 172.21.15.45:0/1617986809 learned_addr learned my addr 172.21.15.45:0/1617986809 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:03.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf30efb640 1 --2- 172.21.15.45:0/1617986809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf2c06f880 0x7fbf2c14b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:03.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf316fc640 1 --2- 172.21.15.45:0/1617986809 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf2c14f510 0x7fbf2c0be780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:03.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf23fff640 1 -- 172.21.15.45:0/1617986809 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf2c14f510 msgr2=0x7fbf2c0be780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:03.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf23fff640 1 --2- 172.21.15.45:0/1617986809 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf2c14f510 0x7fbf2c0be780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:03.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf23fff640 1 -- 172.21.15.45:0/1617986809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf2c06f880 msgr2=0x7fbf2c14b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:03.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf23fff640 1 --2- 172.21.15.45:0/1617986809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf2c06f880 0x7fbf2c14b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:03.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf23fff640 1 -- 172.21.15.45:0/1617986809 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1c009420 con 0x7fbf2c0bd9f0 2023-10-03T19:13:03.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf30efb640 1 --2- 172.21.15.45:0/1617986809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf2c06f880 0x7fbf2c14b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:03.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf23fff640 1 --2- 172.21.15.45:0/1617986809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf2c0bd9f0 0x7fbf2c148170 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c01a080 tx=0x7fbf1c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:03.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf217fa640 1 -- 172.21.15.45:0/1617986809 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c0ac410 con 0x7fbf2c0bd9f0 2023-10-03T19:13:03.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf217fa640 1 -- 172.21.15.45:0/1617986809 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1c006e20 con 0x7fbf2c0bd9f0 2023-10-03T19:13:03.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf3315f640 1 -- 172.21.15.45:0/1617986809 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf2c0a6050 con 0x7fbf2c0bd9f0 2023-10-03T19:13:03.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf217fa640 1 -- 172.21.15.45:0/1617986809 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c004230 con 0x7fbf2c0bd9f0 2023-10-03T19:13:03.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.544+0000 7fbf3315f640 1 -- 172.21.15.45:0/1617986809 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf2c06fc50 con 0x7fbf2c0bd9f0 2023-10-03T19:13:03.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.548+0000 7fbf3315f640 1 -- 172.21.15.45:0/1617986809 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf2c0a61e0 con 0x7fbf2c0bd9f0 2023-10-03T19:13:03.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.548+0000 7fbf217fa640 1 -- 172.21.15.45:0/1617986809 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbf1c004390 con 0x7fbf2c0bd9f0 2023-10-03T19:13:03.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.548+0000 7fbf217fa640 1 --2- 172.21.15.45:0/1617986809 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbf18066280 0x7fbf18068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:03.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.548+0000 7fbf217fa640 1 -- 172.21.15.45:0/1617986809 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbf1c11e020 con 0x7fbf2c0bd9f0 2023-10-03T19:13:03.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.548+0000 7fbf30efb640 1 --2- 172.21.15.45:0/1617986809 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbf18066280 0x7fbf18068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:03.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.548+0000 7fbf30efb640 1 --2- 172.21.15.45:0/1617986809 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbf18066280 0x7fbf18068730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbf28000f70 tx=0x7fbf28009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:03.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.552+0000 7fbf217fa640 1 -- 172.21.15.45:0/1617986809 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbf1c0eb650 con 0x7fbf2c0bd9f0 2023-10-03T19:13:03.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.696+0000 7fbf3315f640 1 -- 172.21.15.45:0/1617986809 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbf2c04de80 con 0x7fbf2c0bd9f0 2023-10-03T19:13:03.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.696+0000 7fbf217fa640 1 -- 172.21.15.45:0/1617986809 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbf1c0eec70 con 0x7fbf2c0bd9f0 2023-10-03T19:13:03.704 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-03T19:13:03.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.700+0000 7fbf3315f640 1 -- 172.21.15.45:0/1617986809 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbf18066280 msgr2=0x7fbf18068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:03.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.700+0000 7fbf3315f640 1 --2- 172.21.15.45:0/1617986809 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbf18066280 0x7fbf18068730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbf28000f70 tx=0x7fbf28009040 comp rx=0 tx=0).stop 2023-10-03T19:13:03.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.700+0000 7fbf3315f640 1 -- 172.21.15.45:0/1617986809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf2c0bd9f0 msgr2=0x7fbf2c148170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:03.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.700+0000 7fbf3315f640 1 --2- 172.21.15.45:0/1617986809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf2c0bd9f0 0x7fbf2c148170 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c01a080 tx=0x7fbf1c01ac90 comp rx=0 tx=0).stop 2023-10-03T19:13:03.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.700+0000 7fbf3315f640 1 -- 172.21.15.45:0/1617986809 shutdown_connections 2023-10-03T19:13:03.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.700+0000 7fbf3315f640 1 --2- 172.21.15.45:0/1617986809 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbf18066280 0x7fbf18068730 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:03.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.700+0000 7fbf3315f640 1 --2- 172.21.15.45:0/1617986809 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf2c14f510 0x7fbf2c0be780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:03.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.700+0000 7fbf3315f640 1 --2- 172.21.15.45:0/1617986809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf2c0bd9f0 0x7fbf2c148170 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:03.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.700+0000 7fbf3315f640 1 --2- 172.21.15.45:0/1617986809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf2c06f880 0x7fbf2c14b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:03.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.700+0000 7fbf3315f640 1 -- 172.21.15.45:0/1617986809 >> 172.21.15.45:0/1617986809 conn(0x7fbf2c0a20d0 msgr2=0x7fbf2c0a24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:03.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.700+0000 7fbf3315f640 1 -- 172.21.15.45:0/1617986809 shutdown_connections 2023-10-03T19:13:03.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.700+0000 7fbf3315f640 1 -- 172.21.15.45:0/1617986809 wait complete. 2023-10-03T19:13:03.722 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-03T19:13:03.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.836+0000 7f1437e19640 1 Processor -- start 2023-10-03T19:13:03.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.836+0000 7f1437e19640 1 -- start start 2023-10-03T19:13:03.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.836+0000 7f1437e19640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f143006f170 0x7f1430150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:03.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.836+0000 7f1437e19640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f143006d170 0x7f143014d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:03.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.836+0000 7f1437e19640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f143006cac0 con 0x7f14300bc8b0 2023-10-03T19:13:03.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.836+0000 7f1437e19640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14300720d0 con 0x7f143006f170 2023-10-03T19:13:03.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.836+0000 7f1437e19640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14300a5ab0 con 0x7f143006d170 2023-10-03T19:13:03.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.836+0000 7f1435bb5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f143006f170 0x7f1430150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:03.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.836+0000 7f1435bb5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f143006f170 0x7f1430150190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54382/0 (socket says 172.21.15.45:54382) 2023-10-03T19:13:03.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.836+0000 7f1435bb5640 1 -- 172.21.15.45:0/3054431334 learned_addr learned my addr 172.21.15.45:0/3054431334 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:03.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.836+0000 7f14363b6640 1 --2- 172.21.15.45:0/3054431334 >> v2:172.21.15.79:3300/0 conn(0x7f143006d170 0x7f143014d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:03.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.836+0000 7f1435bb5640 1 -- 172.21.15.45:0/3054431334 >> v2:172.21.15.79:3300/0 conn(0x7f143006d170 msgr2=0x7f143014d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:03.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.836+0000 7f1435bb5640 1 --2- 172.21.15.45:0/3054431334 >> v2:172.21.15.79:3300/0 conn(0x7f143006d170 0x7f143014d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:03.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.836+0000 7f1435bb5640 1 -- 172.21.15.45:0/3054431334 >> v1:172.21.15.45:6789/0 conn(0x7f14300bc8b0 legacy=0x7f143014ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:03.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.836+0000 7f1435bb5640 1 -- 172.21.15.45:0/3054431334 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143006cd00 con 0x7f143006f170 2023-10-03T19:13:03.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.836+0000 7f1434bb3640 1 -- 172.21.15.45:0/3054431334 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2932248996 0 0) 0x7f1420001120 con 0x7f14300bc8b0 2023-10-03T19:13:03.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.840+0000 7f1435bb5640 1 --2- 172.21.15.45:0/3054431334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f143006f170 0x7f1430150190 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f14300bcf00 tx=0x7f142c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd49ed6a0c175a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:03.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.840+0000 7f1434bb3640 1 -- 172.21.15.45:0/3054431334 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c0a89f0 con 0x7f143006f170 2023-10-03T19:13:03.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.840+0000 7f1434bb3640 1 -- 172.21.15.45:0/3054431334 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142c0a8b50 con 0x7f143006f170 2023-10-03T19:13:03.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.840+0000 7f1434bb3640 1 -- 172.21.15.45:0/3054431334 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c0b0440 con 0x7f143006f170 2023-10-03T19:13:03.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.840+0000 7f1437e19640 1 -- 172.21.15.45:0/3054431334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f143006f170 msgr2=0x7f1430150190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:03.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.840+0000 7f1437e19640 1 --2- 172.21.15.45:0/3054431334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f143006f170 0x7f1430150190 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f14300bcf00 tx=0x7f142c01ecf0 comp rx=0 tx=0).stop 2023-10-03T19:13:03.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.840+0000 7f1437e19640 1 -- 172.21.15.45:0/3054431334 shutdown_connections 2023-10-03T19:13:03.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.840+0000 7f1437e19640 1 --2- 172.21.15.45:0/3054431334 >> v2:172.21.15.79:3300/0 conn(0x7f143006d170 0x7f143014d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:03.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.840+0000 7f1437e19640 1 --2- 172.21.15.45:0/3054431334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f143006f170 0x7f1430150190 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:03.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.840+0000 7f1437e19640 1 -- 172.21.15.45:0/3054431334 >> 172.21.15.45:0/3054431334 conn(0x7f14300bcf50 msgr2=0x7f14300bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:03.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.840+0000 7f1437e19640 1 -- 172.21.15.45:0/3054431334 shutdown_connections 2023-10-03T19:13:03.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.840+0000 7f1437e19640 1 -- 172.21.15.45:0/3054431334 wait complete. 2023-10-03T19:13:03.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.840+0000 7f1437e19640 1 Processor -- start 2023-10-03T19:13:03.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.840+0000 7f1437e19640 1 -- start start 2023-10-03T19:13:03.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.840+0000 7f1437e19640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f143006d170 0x7f14300b9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:03.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.840+0000 7f1437e19640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f143006f170 0x7f14301454b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:03.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.840+0000 7f1437e19640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f14300bc8b0 0x7f14301e6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:03.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.840+0000 7f1437e19640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1430146810 con 0x7f143006d170 2023-10-03T19:13:03.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.844+0000 7f1437e19640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1430149770 con 0x7f143006f170 2023-10-03T19:13:03.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.844+0000 7f1437e19640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14301d72e0 con 0x7f14300bc8b0 2023-10-03T19:13:03.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.844+0000 7f1435bb5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f143006d170 0x7f14300b9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:03.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.844+0000 7f1435bb5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f143006d170 0x7f14300b9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54388/0 (socket says 172.21.15.45:54388) 2023-10-03T19:13:03.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.844+0000 7f1435bb5640 1 -- 172.21.15.45:0/2110674022 learned_addr learned my addr 172.21.15.45:0/2110674022 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:03.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.844+0000 7f14353b4640 1 --2- 172.21.15.45:0/2110674022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f143006f170 0x7f14301454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:03.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.844+0000 7f14363b6640 1 --2- 172.21.15.45:0/2110674022 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f14300bc8b0 0x7f14301e6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:03.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.844+0000 7f1435bb5640 1 -- 172.21.15.45:0/2110674022 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f14300bc8b0 msgr2=0x7f14301e6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:03.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.844+0000 7f1435bb5640 1 --2- 172.21.15.45:0/2110674022 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f14300bc8b0 0x7f14301e6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:03.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.844+0000 7f1435bb5640 1 -- 172.21.15.45:0/2110674022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f143006f170 msgr2=0x7f14301454b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:03.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.844+0000 7f1435bb5640 1 --2- 172.21.15.45:0/2110674022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f143006f170 0x7f14301454b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:03.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.844+0000 7f1435bb5640 1 -- 172.21.15.45:0/2110674022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142c0094d0 con 0x7f143006d170 2023-10-03T19:13:03.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.844+0000 7f1435bb5640 1 --2- 172.21.15.45:0/2110674022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f143006d170 0x7f14300b9b50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f142c01b900 tx=0x7f142c01d530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:03.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.844+0000 7f14267fc640 1 -- 172.21.15.45:0/2110674022 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c0a89f0 con 0x7f143006d170 2023-10-03T19:13:03.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.844+0000 7f14267fc640 1 -- 172.21.15.45:0/2110674022 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142c004030 con 0x7f143006d170 2023-10-03T19:13:03.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.844+0000 7f1437e19640 1 -- 172.21.15.45:0/2110674022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f143014c4a0 con 0x7f143006d170 2023-10-03T19:13:03.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.844+0000 7f14267fc640 1 -- 172.21.15.45:0/2110674022 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c0043a0 con 0x7f143006d170 2023-10-03T19:13:03.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.844+0000 7f1437e19640 1 -- 172.21.15.45:0/2110674022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f143014fae0 con 0x7f143006d170 2023-10-03T19:13:03.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.844+0000 7f1437e19640 1 -- 172.21.15.45:0/2110674022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f143006f540 con 0x7f143006d170 2023-10-03T19:13:03.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.844+0000 7f14267fc640 1 -- 172.21.15.45:0/2110674022 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f142c0b7040 con 0x7f143006d170 2023-10-03T19:13:03.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.844+0000 7f14267fc640 1 --2- 172.21.15.45:0/2110674022 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f14140662b0 0x7f1414068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:03.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.844+0000 7f14267fc640 1 -- 172.21.15.45:0/2110674022 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f142c121510 con 0x7f143006d170 2023-10-03T19:13:03.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.844+0000 7f14353b4640 1 --2- 172.21.15.45:0/2110674022 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f14140662b0 0x7f1414068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:03.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.848+0000 7f14353b4640 1 --2- 172.21.15.45:0/2110674022 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f14140662b0 0x7f1414068760 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f14300a4fe0 tx=0x7f1420009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:03.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:03.848+0000 7f14267fc640 1 -- 172.21.15.45:0/2110674022 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f142c0eea20 con 0x7f143006d170 2023-10-03T19:13:04.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.016+0000 7f1437e19640 1 -- 172.21.15.45:0/2110674022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f143006d660 con 0x7f143006d170 2023-10-03T19:13:04.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.016+0000 7f14267fc640 1 -- 172.21.15.45:0/2110674022 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f142c0f2040 con 0x7f143006d170 2023-10-03T19:13:04.021 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-10-03T19:13:04.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.016+0000 7f1437e19640 1 -- 172.21.15.45:0/2110674022 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f14140662b0 msgr2=0x7f1414068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:04.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.016+0000 7f1437e19640 1 --2- 172.21.15.45:0/2110674022 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f14140662b0 0x7f1414068760 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f14300a4fe0 tx=0x7f1420009040 comp rx=0 tx=0).stop 2023-10-03T19:13:04.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.016+0000 7f1437e19640 1 -- 172.21.15.45:0/2110674022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f143006d170 msgr2=0x7f14300b9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:04.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.016+0000 7f1437e19640 1 --2- 172.21.15.45:0/2110674022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f143006d170 0x7f14300b9b50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f142c01b900 tx=0x7f142c01d530 comp rx=0 tx=0).stop 2023-10-03T19:13:04.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.016+0000 7f1437e19640 1 -- 172.21.15.45:0/2110674022 shutdown_connections 2023-10-03T19:13:04.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.016+0000 7f1437e19640 1 --2- 172.21.15.45:0/2110674022 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f14140662b0 0x7f1414068760 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.016+0000 7f1437e19640 1 --2- 172.21.15.45:0/2110674022 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f14300bc8b0 0x7f14301e6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.016+0000 7f1437e19640 1 --2- 172.21.15.45:0/2110674022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f143006f170 0x7f14301454b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.016+0000 7f1437e19640 1 --2- 172.21.15.45:0/2110674022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f143006d170 0x7f14300b9b50 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.016+0000 7f1437e19640 1 -- 172.21.15.45:0/2110674022 >> 172.21.15.45:0/2110674022 conn(0x7f14300bcf50 msgr2=0x7f14300bbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:04.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.020+0000 7f1437e19640 1 -- 172.21.15.45:0/2110674022 shutdown_connections 2023-10-03T19:13:04.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.020+0000 7f1437e19640 1 -- 172.21.15.45:0/2110674022 wait complete. 2023-10-03T19:13:04.041 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-03T19:13:04.041 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:13:04.047 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:13:04.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.160+0000 7f77a83c3640 1 Processor -- start 2023-10-03T19:13:04.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.160+0000 7f77a83c3640 1 -- start start 2023-10-03T19:13:04.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.160+0000 7f77a83c3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f77a00bd5a0 0x7f77a00a1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:04.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.160+0000 7f77a83c3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f77a00a16a0 0x7f77a0156000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:04.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.160+0000 7f77a83c3640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a0071ab0 con 0x7f77a006ed20 2023-10-03T19:13:04.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.160+0000 7f77a83c3640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a006f650 con 0x7f77a00a16a0 2023-10-03T19:13:04.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.160+0000 7f77a83c3640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a0071d50 con 0x7f77a00bd5a0 2023-10-03T19:13:04.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.160+0000 7f77a595e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f77a00a16a0 0x7f77a0156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:04.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.160+0000 7f77a595e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f77a00a16a0 0x7f77a0156000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54400/0 (socket says 172.21.15.45:54400) 2023-10-03T19:13:04.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.160+0000 7f77a595e640 1 -- 172.21.15.45:0/2895019104 learned_addr learned my addr 172.21.15.45:0/2895019104 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:04.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.160+0000 7f77a615f640 1 --2- 172.21.15.45:0/2895019104 >> v2:172.21.15.79:3300/0 conn(0x7f77a00bd5a0 0x7f77a00a1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:04.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.160+0000 7f77a595e640 1 -- 172.21.15.45:0/2895019104 >> v2:172.21.15.79:3300/0 conn(0x7f77a00bd5a0 msgr2=0x7f77a00a1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:04.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.160+0000 7f77a595e640 1 --2- 172.21.15.45:0/2895019104 >> v2:172.21.15.79:3300/0 conn(0x7f77a00bd5a0 0x7f77a00a1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.160+0000 7f77a595e640 1 -- 172.21.15.45:0/2895019104 >> v1:172.21.15.45:6789/0 conn(0x7f77a006ed20 legacy=0x7f77a0156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:04.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.160+0000 7f77a595e640 1 -- 172.21.15.45:0/2895019104 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a0156c50 con 0x7f77a00a16a0 2023-10-03T19:13:04.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.160+0000 7f77a615f640 1 --2- 172.21.15.45:0/2895019104 >> v2:172.21.15.79:3300/0 conn(0x7f77a00bd5a0 0x7f77a00a1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:04.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.164+0000 7f77a595e640 1 --2- 172.21.15.45:0/2895019104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77a00a16a0 0x7f77a0156000 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f77a00a5450 tx=0x7f779401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a71285bac5cbcff9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:04.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.164+0000 7f77a515d640 1 -- 172.21.15.45:0/2895019104 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77940a5820 con 0x7f77a00a16a0 2023-10-03T19:13:04.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.164+0000 7f77a515d640 1 -- 172.21.15.45:0/2895019104 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77940a5980 con 0x7f77a00a16a0 2023-10-03T19:13:04.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.164+0000 7f77a515d640 1 -- 172.21.15.45:0/2895019104 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77940a5d10 con 0x7f77a00a16a0 2023-10-03T19:13:04.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.164+0000 7f77a83c3640 1 -- 172.21.15.45:0/2895019104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77a00a16a0 msgr2=0x7f77a0156000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:04.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.164+0000 7f77a83c3640 1 --2- 172.21.15.45:0/2895019104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77a00a16a0 0x7f77a0156000 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f77a00a5450 tx=0x7f779401c940 comp rx=0 tx=0).stop 2023-10-03T19:13:04.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.164+0000 7f77a83c3640 1 -- 172.21.15.45:0/2895019104 shutdown_connections 2023-10-03T19:13:04.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.164+0000 7f77a83c3640 1 --2- 172.21.15.45:0/2895019104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77a00a16a0 0x7f77a0156000 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.164+0000 7f77a83c3640 1 --2- 172.21.15.45:0/2895019104 >> v2:172.21.15.79:3300/0 conn(0x7f77a00bd5a0 0x7f77a00a1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.164+0000 7f77a83c3640 1 -- 172.21.15.45:0/2895019104 >> 172.21.15.45:0/2895019104 conn(0x7f77a006bce0 msgr2=0x7f77a006c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:04.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.164+0000 7f77a83c3640 1 -- 172.21.15.45:0/2895019104 shutdown_connections 2023-10-03T19:13:04.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.164+0000 7f77a83c3640 1 -- 172.21.15.45:0/2895019104 wait complete. 2023-10-03T19:13:04.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.164+0000 7f77a83c3640 1 Processor -- start 2023-10-03T19:13:04.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.164+0000 7f77a83c3640 1 -- start start 2023-10-03T19:13:04.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.164+0000 7f77a83c3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77a006ed20 0x7f77a0155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:04.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.164+0000 7f77a83c3640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77a00a16a0 0x7f77a014f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:04.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.164+0000 7f77a83c3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77a00bd5a0 0x7f77a0150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:04.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.164+0000 7f77a83c3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a0155b80 con 0x7f77a006ed20 2023-10-03T19:13:04.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.164+0000 7f77a83c3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a014b0a0 con 0x7f77a00bd5a0 2023-10-03T19:13:04.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.164+0000 7f77a83c3640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a0153990 con 0x7f77a00a16a0 2023-10-03T19:13:04.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.164+0000 7f77a615f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77a006ed20 0x7f77a0155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:04.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.164+0000 7f77a615f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77a006ed20 0x7f77a0155640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54412/0 (socket says 172.21.15.45:54412) 2023-10-03T19:13:04.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.164+0000 7f77a615f640 1 -- 172.21.15.45:0/3900421117 learned_addr learned my addr 172.21.15.45:0/3900421117 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:04.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.164+0000 7f77a595e640 1 --2- 172.21.15.45:0/3900421117 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77a00a16a0 0x7f77a014f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:04.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.164+0000 7f77a6960640 1 --2- 172.21.15.45:0/3900421117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77a00bd5a0 0x7f77a0150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:04.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.164+0000 7f77a615f640 1 -- 172.21.15.45:0/3900421117 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77a00a16a0 msgr2=0x7f77a014f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:04.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.164+0000 7f77a615f640 1 --2- 172.21.15.45:0/3900421117 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77a00a16a0 0x7f77a014f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.164+0000 7f77a615f640 1 -- 172.21.15.45:0/3900421117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77a00bd5a0 msgr2=0x7f77a0150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:04.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.164+0000 7f77a615f640 1 --2- 172.21.15.45:0/3900421117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77a00bd5a0 0x7f77a0150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.164+0000 7f77a615f640 1 -- 172.21.15.45:0/3900421117 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7794009b30 con 0x7f77a006ed20 2023-10-03T19:13:04.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.168+0000 7f77a615f640 1 --2- 172.21.15.45:0/3900421117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77a006ed20 0x7f77a0155640 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f779000c7f0 tx=0x7f779000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:04.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.168+0000 7f779effd640 1 -- 172.21.15.45:0/3900421117 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779000cea0 con 0x7f77a006ed20 2023-10-03T19:13:04.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.168+0000 7f779effd640 1 -- 172.21.15.45:0/3900421117 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7790007a30 con 0x7f77a006ed20 2023-10-03T19:13:04.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.168+0000 7f779effd640 1 -- 172.21.15.45:0/3900421117 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7790007de0 con 0x7f77a006ed20 2023-10-03T19:13:04.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.168+0000 7f77a83c3640 1 -- 172.21.15.45:0/3900421117 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a006f400 con 0x7f77a006ed20 2023-10-03T19:13:04.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.168+0000 7f77a83c3640 1 -- 172.21.15.45:0/3900421117 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a006f270 con 0x7f77a006ed20 2023-10-03T19:13:04.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.168+0000 7f77a83c3640 1 -- 172.21.15.45:0/3900421117 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a006e410 con 0x7f77a006ed20 2023-10-03T19:13:04.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.168+0000 7f779effd640 1 -- 172.21.15.45:0/3900421117 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f77900113f0 con 0x7f77a006ed20 2023-10-03T19:13:04.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.168+0000 7f779effd640 1 --2- 172.21.15.45:0/3900421117 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f778c066280 0x7f778c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:04.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.168+0000 7f779effd640 1 -- 172.21.15.45:0/3900421117 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7790083e80 con 0x7f77a006ed20 2023-10-03T19:13:04.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.168+0000 7f77a595e640 1 --2- 172.21.15.45:0/3900421117 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f778c066280 0x7f778c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:04.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.168+0000 7f77a595e640 1 --2- 172.21.15.45:0/3900421117 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f778c066280 0x7f778c068730 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f77940ae000 tx=0x7f77940a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:04.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.172+0000 7f779effd640 1 -- 172.21.15.45:0/3900421117 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7790051300 con 0x7f77a006ed20 2023-10-03T19:13:04.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.324+0000 7f77a83c3640 1 -- 172.21.15.45:0/3900421117 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77a004de80 con 0x7f77a006ed20 2023-10-03T19:13:04.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.328+0000 7f779effd640 1 -- 172.21.15.45:0/3900421117 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18231 (secure 0 0 0) 0x7f7790054920 con 0x7f77a006ed20 2023-10-03T19:13:04.332 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:13:04.333 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:12:28.941467+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:12:26.226431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T19:12:26.923174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:13:04.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.328+0000 7f77a83c3640 1 -- 172.21.15.45:0/3900421117 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f778c066280 msgr2=0x7f778c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:04.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.328+0000 7f77a83c3640 1 --2- 172.21.15.45:0/3900421117 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f778c066280 0x7f778c068730 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f77940ae000 tx=0x7f77940a7070 comp rx=0 tx=0).stop 2023-10-03T19:13:04.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.328+0000 7f77a83c3640 1 -- 172.21.15.45:0/3900421117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77a006ed20 msgr2=0x7f77a0155640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:04.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.328+0000 7f77a83c3640 1 --2- 172.21.15.45:0/3900421117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77a006ed20 0x7f77a0155640 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f779000c7f0 tx=0x7f779000ccb0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.328+0000 7f77a83c3640 1 -- 172.21.15.45:0/3900421117 shutdown_connections 2023-10-03T19:13:04.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.328+0000 7f77a83c3640 1 --2- 172.21.15.45:0/3900421117 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f778c066280 0x7f778c068730 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.328+0000 7f77a83c3640 1 --2- 172.21.15.45:0/3900421117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77a00bd5a0 0x7f77a0150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.328+0000 7f77a83c3640 1 --2- 172.21.15.45:0/3900421117 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77a00a16a0 0x7f77a014f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.328+0000 7f77a83c3640 1 --2- 172.21.15.45:0/3900421117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77a006ed20 0x7f77a0155640 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.328+0000 7f77a83c3640 1 -- 172.21.15.45:0/3900421117 >> 172.21.15.45:0/3900421117 conn(0x7f77a006bce0 msgr2=0x7f77a00c02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:04.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.328+0000 7f77a83c3640 1 -- 172.21.15.45:0/3900421117 shutdown_connections 2023-10-03T19:13:04.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.328+0000 7f77a83c3640 1 -- 172.21.15.45:0/3900421117 wait complete. 2023-10-03T19:13:04.349 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T19:12:26.226431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T19:12:26.923174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:13:04.350 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:13:04.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f40192cd640 1 Processor -- start 2023-10-03T19:13:04.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f40192cd640 1 -- start start 2023-10-03T19:13:04.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f40192cd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f401414f510 0x7f401414b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:04.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f40192cd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f40140bd9f0 0x7f401414b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:04.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f40192cd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f401414f080 con 0x7f401406f880 2023-10-03T19:13:04.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f40192cd640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f401406f3e0 con 0x7f40140bd9f0 2023-10-03T19:13:04.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f40192cd640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4014070e90 con 0x7f401414f510 2023-10-03T19:13:04.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f4012ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f401406f880 0x7f40140a5940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38784/0 (socket says 172.21.15.45:38784) 2023-10-03T19:13:04.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f4012ffd640 1 -- 172.21.15.45:0/1687306397 learned_addr learned my addr 172.21.15.45:0/1687306397 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:04.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f400bfff640 1 --2- 172.21.15.45:0/1687306397 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f401414f510 0x7f401414b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:04.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f40127fc640 1 -- 172.21.15.45:0/1687306397 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1699720631 0 0) 0x7f401414f080 con 0x7f401406f880 2023-10-03T19:13:04.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f40137fe640 1 --2- 172.21.15.45:0/1687306397 >> v2:172.21.15.79:3300/0 conn(0x7f40140bd9f0 0x7f401414b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:04.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f40127fc640 1 -- 172.21.15.45:0/1687306397 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4000003530 con 0x7f401406f880 2023-10-03T19:13:04.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f40127fc640 1 -- 172.21.15.45:0/1687306397 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1124703976 0 0) 0x7f4000003530 con 0x7f401406f880 2023-10-03T19:13:04.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f40127fc640 1 -- 172.21.15.45:0/1687306397 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f401414f510 msgr2=0x7f401414b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:04.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f40127fc640 1 --2- 172.21.15.45:0/1687306397 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f401414f510 0x7f401414b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f40127fc640 1 -- 172.21.15.45:0/1687306397 >> v2:172.21.15.79:3300/0 conn(0x7f40140bd9f0 msgr2=0x7f401414b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:04.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f40127fc640 1 --2- 172.21.15.45:0/1687306397 >> v2:172.21.15.79:3300/0 conn(0x7f40140bd9f0 0x7f401414b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f40127fc640 1 -- 172.21.15.45:0/1687306397 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401414ea30 con 0x7f401406f880 2023-10-03T19:13:04.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f40127fc640 1 -- 172.21.15.45:0/1687306397 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f3ffc001680 con 0x7f401406f880 2023-10-03T19:13:04.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f40127fc640 1 -- 172.21.15.45:0/1687306397 >> v1:172.21.15.45:6789/0 conn(0x7f401406f880 legacy=0x7f40140a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:04.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f40127fc640 1 --2- 172.21.15.45:0/1687306397 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f401414f510 0x7f4000003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:04.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f40127fc640 1 --2- 172.21.15.45:0/1687306397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4000003f00 0x7f40000047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:04.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f40127fc640 1 --2- 172.21.15.45:0/1687306397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4000004d10 0x7f4000005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:04.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f40127fc640 1 -- 172.21.15.45:0/1687306397 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401406f3e0 con 0x7f4000003f00 2023-10-03T19:13:04.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f40127fc640 1 -- 172.21.15.45:0/1687306397 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4014070e90 con 0x7f4000004d10 2023-10-03T19:13:04.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f40127fc640 1 -- 172.21.15.45:0/1687306397 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400000b990 con 0x7f401414f510 2023-10-03T19:13:04.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f400bfff640 1 --2- 172.21.15.45:0/1687306397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4000003f00 0x7f40000047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:04.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f40137fe640 1 --2- 172.21.15.45:0/1687306397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4000004d10 0x7f4000005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:04.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f4012ffd640 1 --2- 172.21.15.45:0/1687306397 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f401414f510 0x7f4000003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:04.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f400bfff640 1 -- 172.21.15.45:0/1687306397 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f401414f510 msgr2=0x7f4000003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:04.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f400bfff640 1 --2- 172.21.15.45:0/1687306397 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f401414f510 0x7f4000003980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f400bfff640 1 -- 172.21.15.45:0/1687306397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4000004d10 msgr2=0x7f4000005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:04.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f400bfff640 1 --2- 172.21.15.45:0/1687306397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4000004d10 0x7f4000005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f400bfff640 1 -- 172.21.15.45:0/1687306397 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4000003530 con 0x7f4000003f00 2023-10-03T19:13:04.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.468+0000 7f40137fe640 1 --2- 172.21.15.45:0/1687306397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4000004d10 0x7f4000005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:04.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.472+0000 7f400bfff640 1 --2- 172.21.15.45:0/1687306397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4000003f00 0x7f40000047d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4004009ae0 tx=0x7f400401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7abcbd440fa16a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:04.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.472+0000 7f40127fc640 1 -- 172.21.15.45:0/1687306397 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40040a5640 con 0x7f4000003f00 2023-10-03T19:13:04.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.472+0000 7f40127fc640 1 -- 172.21.15.45:0/1687306397 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40040a57a0 con 0x7f4000003f00 2023-10-03T19:13:04.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.472+0000 7f40127fc640 1 -- 172.21.15.45:0/1687306397 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40040a5b50 con 0x7f4000003f00 2023-10-03T19:13:04.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.472+0000 7f40192cd640 1 -- 172.21.15.45:0/1687306397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4000003f00 msgr2=0x7f40000047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:04.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.472+0000 7f40192cd640 1 --2- 172.21.15.45:0/1687306397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4000003f00 0x7f40000047d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4004009ae0 tx=0x7f400401ca50 comp rx=0 tx=0).stop 2023-10-03T19:13:04.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.472+0000 7f40137fe640 1 -- 172.21.15.45:0/1687306397 reap_dead start 2023-10-03T19:13:04.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.472+0000 7f40192cd640 1 -- 172.21.15.45:0/1687306397 shutdown_connections 2023-10-03T19:13:04.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.472+0000 7f40192cd640 1 -- 172.21.15.45:0/1687306397 >> 172.21.15.45:0/1687306397 conn(0x7f40140a20d0 msgr2=0x7f40140a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:04.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.472+0000 7f40192cd640 1 -- 172.21.15.45:0/1687306397 shutdown_connections 2023-10-03T19:13:04.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.472+0000 7f40192cd640 1 -- 172.21.15.45:0/1687306397 wait complete. 2023-10-03T19:13:04.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.472+0000 7f40192cd640 1 Processor -- start 2023-10-03T19:13:04.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.472+0000 7f40192cd640 1 -- start start 2023-10-03T19:13:04.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.472+0000 7f40192cd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4000003f00 0x7f4014142d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:04.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.472+0000 7f40192cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40140b9220 0x7f40140b9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:04.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.472+0000 7f40192cd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40141486d0 0x7f40140beb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:04.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.472+0000 7f40192cd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40140b8650 con 0x7f40140b9220 2023-10-03T19:13:04.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.472+0000 7f40192cd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40140b8000 con 0x7f40141486d0 2023-10-03T19:13:04.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.472+0000 7f40192cd640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40141432d0 con 0x7f4000003f00 2023-10-03T19:13:04.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.472+0000 7f400bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40140b9220 0x7f40140b9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:04.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.472+0000 7f400bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40140b9220 0x7f40140b9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54426/0 (socket says 172.21.15.45:54426) 2023-10-03T19:13:04.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.472+0000 7f400bfff640 1 -- 172.21.15.45:0/982878336 learned_addr learned my addr 172.21.15.45:0/982878336 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:04.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.472+0000 7f4012ffd640 1 --2- 172.21.15.45:0/982878336 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4000003f00 0x7f4014142d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:04.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.472+0000 7f40137fe640 1 --2- 172.21.15.45:0/982878336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40141486d0 0x7f40140beb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:04.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.472+0000 7f400bfff640 1 -- 172.21.15.45:0/982878336 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4000003f00 msgr2=0x7f4014142d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:04.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.472+0000 7f400bfff640 1 --2- 172.21.15.45:0/982878336 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4000003f00 0x7f4014142d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.476+0000 7f400bfff640 1 -- 172.21.15.45:0/982878336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40141486d0 msgr2=0x7f40140beb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:04.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.476+0000 7f400bfff640 1 --2- 172.21.15.45:0/982878336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40141486d0 0x7f40140beb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.476+0000 7f400bfff640 1 -- 172.21.15.45:0/982878336 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401406f070 con 0x7f40140b9220 2023-10-03T19:13:04.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.476+0000 7f400bfff640 1 --2- 172.21.15.45:0/982878336 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40140b9220 0x7f40140b9e90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f400401c880 tx=0x7f4000005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:04.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.476+0000 7f400b7fe640 1 -- 172.21.15.45:0/982878336 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004004220 con 0x7f40140b9220 2023-10-03T19:13:04.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.476+0000 7f400b7fe640 1 -- 172.21.15.45:0/982878336 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4004004380 con 0x7f40140b9220 2023-10-03T19:13:04.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.476+0000 7f40192cd640 1 -- 172.21.15.45:0/982878336 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f401414ed10 con 0x7f40140b9220 2023-10-03T19:13:04.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.476+0000 7f400b7fe640 1 -- 172.21.15.45:0/982878336 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004003820 con 0x7f40140b9220 2023-10-03T19:13:04.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.476+0000 7f40192cd640 1 -- 172.21.15.45:0/982878336 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f401406fc50 con 0x7f40140b9220 2023-10-03T19:13:04.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.476+0000 7f40192cd640 1 -- 172.21.15.45:0/982878336 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f401404de80 con 0x7f40140b9220 2023-10-03T19:13:04.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.476+0000 7f400b7fe640 1 -- 172.21.15.45:0/982878336 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f40040b4040 con 0x7f40140b9220 2023-10-03T19:13:04.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.476+0000 7f400b7fe640 1 --2- 172.21.15.45:0/982878336 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3ff4066280 0x7f3ff4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:04.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.476+0000 7f400b7fe640 1 -- 172.21.15.45:0/982878336 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f400411d8e0 con 0x7f40140b9220 2023-10-03T19:13:04.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.476+0000 7f4012ffd640 1 --2- 172.21.15.45:0/982878336 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3ff4066280 0x7f3ff4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:04.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.476+0000 7f4012ffd640 1 --2- 172.21.15.45:0/982878336 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3ff4066280 0x7f3ff4068730 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc004880 tx=0x7f3ffc0015a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:04.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.480+0000 7f400b7fe640 1 -- 172.21.15.45:0/982878336 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f40040eadf0 con 0x7f40140b9220 2023-10-03T19:13:04.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.628+0000 7f40192cd640 1 -- 172.21.15.45:0/982878336 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f40140bf900 con 0x7f40140b9220 2023-10-03T19:13:04.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.628+0000 7f400b7fe640 1 -- 172.21.15.45:0/982878336 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f40040ee410 con 0x7f40140b9220 2023-10-03T19:13:04.635 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:13:04.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.632+0000 7f40192cd640 1 -- 172.21.15.45:0/982878336 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3ff4066280 msgr2=0x7f3ff4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:04.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.632+0000 7f40192cd640 1 --2- 172.21.15.45:0/982878336 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3ff4066280 0x7f3ff4068730 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc004880 tx=0x7f3ffc0015a0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.632+0000 7f40192cd640 1 -- 172.21.15.45:0/982878336 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40140b9220 msgr2=0x7f40140b9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:04.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.632+0000 7f40192cd640 1 --2- 172.21.15.45:0/982878336 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40140b9220 0x7f40140b9e90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f400401c880 tx=0x7f4000005800 comp rx=0 tx=0).stop 2023-10-03T19:13:04.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.632+0000 7f40192cd640 1 -- 172.21.15.45:0/982878336 shutdown_connections 2023-10-03T19:13:04.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.632+0000 7f40192cd640 1 --2- 172.21.15.45:0/982878336 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3ff4066280 0x7f3ff4068730 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.632+0000 7f40192cd640 1 --2- 172.21.15.45:0/982878336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40141486d0 0x7f40140beb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.632+0000 7f40192cd640 1 --2- 172.21.15.45:0/982878336 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40140b9220 0x7f40140b9e90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.632+0000 7f40192cd640 1 --2- 172.21.15.45:0/982878336 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4000003f00 0x7f4014142d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.632+0000 7f40192cd640 1 -- 172.21.15.45:0/982878336 >> 172.21.15.45:0/982878336 conn(0x7f40140a20d0 msgr2=0x7f40140a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:04.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.632+0000 7f40192cd640 1 -- 172.21.15.45:0/982878336 shutdown_connections 2023-10-03T19:13:04.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.632+0000 7f40192cd640 1 -- 172.21.15.45:0/982878336 wait complete. 2023-10-03T19:13:04.651 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:13:04.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b2c7c5640 1 Processor -- start 2023-10-03T19:13:04.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b2c7c5640 1 -- start start 2023-10-03T19:13:04.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b2c7c5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4b24070df0 0x7f4b2406aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:04.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b2c7c5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b240a11d0 con 0x7f4b24070140 2023-10-03T19:13:04.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b2c7c5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2406a460 con 0x7f4b241500f0 2023-10-03T19:13:04.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b2c7c5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b24069f70 con 0x7f4b24070df0 2023-10-03T19:13:04.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b2ad62640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4b24070140 0x7f4b2414c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34720/0 (socket says 172.21.15.45:34720) 2023-10-03T19:13:04.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b2ad62640 1 -- 172.21.15.45:0/3893882976 learned_addr learned my addr 172.21.15.45:0/3893882976 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:04.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b29d60640 1 --2- 172.21.15.45:0/3893882976 >> v2:172.21.15.79:3300/0 conn(0x7f4b24070df0 0x7f4b2406aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:04.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b2955f640 1 -- 172.21.15.45:0/3893882976 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 960316568 0 0) 0x7f4b240a11d0 con 0x7f4b24070140 2023-10-03T19:13:04.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b2955f640 1 -- 172.21.15.45:0/3893882976 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b10003530 con 0x7f4b24070140 2023-10-03T19:13:04.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b2955f640 1 -- 172.21.15.45:0/3893882976 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 224100594 0 0) 0x7f4b10003530 con 0x7f4b24070140 2023-10-03T19:13:04.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b2955f640 1 -- 172.21.15.45:0/3893882976 >> v2:172.21.15.79:3300/0 conn(0x7f4b24070df0 msgr2=0x7f4b2406aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:04.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b2955f640 1 --2- 172.21.15.45:0/3893882976 >> v2:172.21.15.79:3300/0 conn(0x7f4b24070df0 0x7f4b2406aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b2955f640 1 -- 172.21.15.45:0/3893882976 >> v1:172.21.15.79:6789/0 conn(0x7f4b241500f0 legacy=0x7f4b240a3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:04.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b2955f640 1 -- 172.21.15.45:0/3893882976 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b241504c0 con 0x7f4b24070140 2023-10-03T19:13:04.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b2955f640 1 -- 172.21.15.45:0/3893882976 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f4b1c001a00 con 0x7f4b24070140 2023-10-03T19:13:04.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b2955f640 1 -- 172.21.15.45:0/3893882976 >> v1:172.21.15.45:6789/0 conn(0x7f4b24070140 legacy=0x7f4b2414c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:04.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b2955f640 1 --2- 172.21.15.45:0/3893882976 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b10003980 0x7f4b10003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:04.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b2955f640 1 --2- 172.21.15.45:0/3893882976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b100047d0 0x7f4b10004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:04.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b2955f640 1 --2- 172.21.15.45:0/3893882976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b10005180 0x7f4b1000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:04.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b2955f640 1 -- 172.21.15.45:0/3893882976 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b24069f70 con 0x7f4b10005180 2023-10-03T19:13:04.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b2955f640 1 -- 172.21.15.45:0/3893882976 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1000bfe0 con 0x7f4b100047d0 2023-10-03T19:13:04.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b2955f640 1 -- 172.21.15.45:0/3893882976 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1000c1a0 con 0x7f4b10003980 2023-10-03T19:13:04.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b2ad62640 1 --2- 172.21.15.45:0/3893882976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b10005180 0x7f4b1000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:04.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b2a561640 1 --2- 172.21.15.45:0/3893882976 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b10003980 0x7f4b10003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:04.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b2ad62640 1 -- 172.21.15.45:0/3893882976 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b10003980 msgr2=0x7f4b10003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:04.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b2ad62640 1 --2- 172.21.15.45:0/3893882976 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b10003980 0x7f4b10003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b2ad62640 1 -- 172.21.15.45:0/3893882976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b100047d0 msgr2=0x7f4b10004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:04.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b29d60640 1 --2- 172.21.15.45:0/3893882976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b100047d0 0x7f4b10004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:04.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b2ad62640 1 --2- 172.21.15.45:0/3893882976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b100047d0 0x7f4b10004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.772+0000 7f4b2ad62640 1 -- 172.21.15.45:0/3893882976 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b10003530 con 0x7f4b10005180 2023-10-03T19:13:04.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.776+0000 7f4b2ad62640 1 -- 172.21.15.45:0/3893882976 reap_dead start 2023-10-03T19:13:04.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.776+0000 7f4b2ad62640 1 --2- 172.21.15.45:0/3893882976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b10005180 0x7f4b1000b990 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00a830 tx=0x7f4b1c01d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=834cc6bdbde6bd80 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:04.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.776+0000 7f4b2955f640 1 -- 172.21.15.45:0/3893882976 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c0072d0 con 0x7f4b10005180 2023-10-03T19:13:04.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.776+0000 7f4b2955f640 1 -- 172.21.15.45:0/3893882976 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1c0a8070 con 0x7f4b10005180 2023-10-03T19:13:04.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.776+0000 7f4b2955f640 1 -- 172.21.15.45:0/3893882976 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c0076b0 con 0x7f4b10005180 2023-10-03T19:13:04.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.776+0000 7f4b2c7c5640 1 -- 172.21.15.45:0/3893882976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b10005180 msgr2=0x7f4b1000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:04.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.776+0000 7f4b2c7c5640 1 --2- 172.21.15.45:0/3893882976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b10005180 0x7f4b1000b990 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00a830 tx=0x7f4b1c01d340 comp rx=0 tx=0).stop 2023-10-03T19:13:04.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.776+0000 7f4b2c7c5640 1 -- 172.21.15.45:0/3893882976 shutdown_connections 2023-10-03T19:13:04.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.776+0000 7f4b2c7c5640 1 --2- 172.21.15.45:0/3893882976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b10005180 0x7f4b1000b990 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.776+0000 7f4b2c7c5640 1 -- 172.21.15.45:0/3893882976 >> 172.21.15.45:0/3893882976 conn(0x7f4b240be190 msgr2=0x7f4b240be590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:04.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.776+0000 7f4b2c7c5640 1 -- 172.21.15.45:0/3893882976 shutdown_connections 2023-10-03T19:13:04.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.776+0000 7f4b2c7c5640 1 -- 172.21.15.45:0/3893882976 wait complete. 2023-10-03T19:13:04.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.776+0000 7f4b2c7c5640 1 Processor -- start 2023-10-03T19:13:04.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.776+0000 7f4b2c7c5640 1 -- start start 2023-10-03T19:13:04.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.780+0000 7f4b2c7c5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b10005180 0x7f4b241d6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:04.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.780+0000 7f4b2c7c5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b240bb8a0 0x7f4b241479f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:04.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.780+0000 7f4b2c7c5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b24147f30 0x7f4b240a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:04.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.780+0000 7f4b2c7c5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2414d600 con 0x7f4b10005180 2023-10-03T19:13:04.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.780+0000 7f4b2c7c5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b240a6b90 con 0x7f4b24147f30 2023-10-03T19:13:04.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.780+0000 7f4b2c7c5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b241d7500 con 0x7f4b240bb8a0 2023-10-03T19:13:04.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.780+0000 7f4b2a561640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b10005180 0x7f4b241d6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:04.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.780+0000 7f4b2a561640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b10005180 0x7f4b241d6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46226/0 (socket says 172.21.15.45:46226) 2023-10-03T19:13:04.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.780+0000 7f4b2a561640 1 -- 172.21.15.45:0/866335428 learned_addr learned my addr 172.21.15.45:0/866335428 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:04.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.780+0000 7f4b29d60640 1 --2- 172.21.15.45:0/866335428 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b240bb8a0 0x7f4b241479f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:04.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.780+0000 7f4b2a561640 1 -- 172.21.15.45:0/866335428 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b240bb8a0 msgr2=0x7f4b241479f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:04.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.780+0000 7f4b2a561640 1 --2- 172.21.15.45:0/866335428 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b240bb8a0 0x7f4b241479f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.780+0000 7f4b2ad62640 1 --2- 172.21.15.45:0/866335428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b24147f30 0x7f4b240a54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:04.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.780+0000 7f4b2a561640 1 -- 172.21.15.45:0/866335428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b24147f30 msgr2=0x7f4b240a54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:04.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.780+0000 7f4b2a561640 1 --2- 172.21.15.45:0/866335428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b24147f30 0x7f4b240a54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.780+0000 7f4b2a561640 1 -- 172.21.15.45:0/866335428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b24150780 con 0x7f4b10005180 2023-10-03T19:13:04.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.780+0000 7f4b29d60640 1 --2- 172.21.15.45:0/866335428 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b240bb8a0 0x7f4b241479f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:04.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.780+0000 7f4b2ad62640 1 --2- 172.21.15.45:0/866335428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b24147f30 0x7f4b240a54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:04.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.780+0000 7f4b2a561640 1 --2- 172.21.15.45:0/866335428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b10005180 0x7f4b241d6fc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4b2000e4b0 tx=0x7f4b2000e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:04.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.780+0000 7f4b1affd640 1 -- 172.21.15.45:0/866335428 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b200052e0 con 0x7f4b10005180 2023-10-03T19:13:04.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.780+0000 7f4b1affd640 1 -- 172.21.15.45:0/866335428 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b20005440 con 0x7f4b10005180 2023-10-03T19:13:04.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.780+0000 7f4b2c7c5640 1 -- 172.21.15.45:0/866335428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2406a180 con 0x7f4b10005180 2023-10-03T19:13:04.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.780+0000 7f4b1affd640 1 -- 172.21.15.45:0/866335428 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b20003840 con 0x7f4b10005180 2023-10-03T19:13:04.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.780+0000 7f4b2c7c5640 1 -- 172.21.15.45:0/866335428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b24150a60 con 0x7f4b10005180 2023-10-03T19:13:04.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.780+0000 7f4b2c7c5640 1 -- 172.21.15.45:0/866335428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b2404de80 con 0x7f4b10005180 2023-10-03T19:13:04.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.780+0000 7f4b1affd640 1 -- 172.21.15.45:0/866335428 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4b200039a0 con 0x7f4b10005180 2023-10-03T19:13:04.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.780+0000 7f4b1affd640 1 --2- 172.21.15.45:0/866335428 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4b080662b0 0x7f4b08068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:04.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.780+0000 7f4b1affd640 1 -- 172.21.15.45:0/866335428 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4b20083b90 con 0x7f4b10005180 2023-10-03T19:13:04.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.784+0000 7f4b29d60640 1 --2- 172.21.15.45:0/866335428 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4b080662b0 0x7f4b08068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:04.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.784+0000 7f4b29d60640 1 --2- 172.21.15.45:0/866335428 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4b080662b0 0x7f4b08068760 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4b240bf1a0 tx=0x7f4b14008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:04.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.784+0000 7f4b1affd640 1 -- 172.21.15.45:0/866335428 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4b20050f80 con 0x7f4b10005180 2023-10-03T19:13:04.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.936+0000 7f4b2c7c5640 1 -- 172.21.15.45:0/866335428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4b240ba4c0 con 0x7f4b10005180 2023-10-03T19:13:04.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.936+0000 7f4b1affd640 1 -- 172.21.15.45:0/866335428 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4b200545a0 con 0x7f4b10005180 2023-10-03T19:13:04.943 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:13:04.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.940+0000 7f4b2c7c5640 1 -- 172.21.15.45:0/866335428 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4b080662b0 msgr2=0x7f4b08068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:04.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.940+0000 7f4b2c7c5640 1 --2- 172.21.15.45:0/866335428 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4b080662b0 0x7f4b08068760 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4b240bf1a0 tx=0x7f4b14008040 comp rx=0 tx=0).stop 2023-10-03T19:13:04.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.940+0000 7f4b2c7c5640 1 -- 172.21.15.45:0/866335428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b10005180 msgr2=0x7f4b241d6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:04.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.940+0000 7f4b2c7c5640 1 --2- 172.21.15.45:0/866335428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b10005180 0x7f4b241d6fc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4b2000e4b0 tx=0x7f4b2000e970 comp rx=0 tx=0).stop 2023-10-03T19:13:04.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.940+0000 7f4b2c7c5640 1 -- 172.21.15.45:0/866335428 shutdown_connections 2023-10-03T19:13:04.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.940+0000 7f4b2c7c5640 1 --2- 172.21.15.45:0/866335428 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4b080662b0 0x7f4b08068760 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.940+0000 7f4b2c7c5640 1 --2- 172.21.15.45:0/866335428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b24147f30 0x7f4b240a54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.940+0000 7f4b2c7c5640 1 --2- 172.21.15.45:0/866335428 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b240bb8a0 0x7f4b241479f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.940+0000 7f4b2c7c5640 1 --2- 172.21.15.45:0/866335428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b10005180 0x7f4b241d6fc0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:04.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.940+0000 7f4b2c7c5640 1 -- 172.21.15.45:0/866335428 >> 172.21.15.45:0/866335428 conn(0x7f4b240be190 msgr2=0x7f4b240b7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:04.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.940+0000 7f4b2c7c5640 1 -- 172.21.15.45:0/866335428 shutdown_connections 2023-10-03T19:13:04.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:04.940+0000 7f4b2c7c5640 1 -- 172.21.15.45:0/866335428 wait complete. 2023-10-03T19:13:04.960 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T19:13:05.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.072+0000 7f085d32f640 1 Processor -- start 2023-10-03T19:13:05.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.072+0000 7f085d32f640 1 -- start start 2023-10-03T19:13:05.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.072+0000 7f085d32f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f08580712c0 0x7f08580bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:05.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.072+0000 7f085d32f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f085806d560 0x7f08580bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:05.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.072+0000 7f085d32f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f085806c2d0 con 0x7f085806c760 2023-10-03T19:13:05.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.072+0000 7f085d32f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0858150610 con 0x7f08580712c0 2023-10-03T19:13:05.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.072+0000 7f085d32f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08581508b0 con 0x7f085806d560 2023-10-03T19:13:05.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.072+0000 7f0856ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f08580712c0 0x7f08580bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:05.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.072+0000 7f0856ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f08580712c0 0x7f08580bcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46232/0 (socket says 172.21.15.45:46232) 2023-10-03T19:13:05.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.072+0000 7f0856ffd640 1 -- 172.21.15.45:0/3737998603 learned_addr learned my addr 172.21.15.45:0/3737998603 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:05.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.072+0000 7f084ffff640 1 --2- 172.21.15.45:0/3737998603 >> v2:172.21.15.79:3300/0 conn(0x7f085806d560 0x7f08580bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:05.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.072+0000 7f0856ffd640 1 -- 172.21.15.45:0/3737998603 >> v2:172.21.15.79:3300/0 conn(0x7f085806d560 msgr2=0x7f08580bd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:05.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.072+0000 7f0856ffd640 1 --2- 172.21.15.45:0/3737998603 >> v2:172.21.15.79:3300/0 conn(0x7f085806d560 0x7f08580bd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.072+0000 7f0856ffd640 1 -- 172.21.15.45:0/3737998603 >> v1:172.21.15.79:6789/0 conn(0x7f085806c760 legacy=0x7f08580a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:05.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.072+0000 7f0856ffd640 1 -- 172.21.15.45:0/3737998603 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085806d2e0 con 0x7f08580712c0 2023-10-03T19:13:05.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f0856ffd640 1 --2- 172.21.15.45:0/3737998603 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08580712c0 0x7f08580bcbc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f085806ba20 tx=0x7f084801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9c354f2a74340 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:05.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f08567fc640 1 -- 172.21.15.45:0/3737998603 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08480ab640 con 0x7f08580712c0 2023-10-03T19:13:05.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f08567fc640 1 -- 172.21.15.45:0/3737998603 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08480a7070 con 0x7f08580712c0 2023-10-03T19:13:05.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f08567fc640 1 -- 172.21.15.45:0/3737998603 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08480ab9c0 con 0x7f08580712c0 2023-10-03T19:13:05.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f085d32f640 1 -- 172.21.15.45:0/3737998603 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08580712c0 msgr2=0x7f08580bcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:05.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f085d32f640 1 --2- 172.21.15.45:0/3737998603 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08580712c0 0x7f08580bcbc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f085806ba20 tx=0x7f084801c500 comp rx=0 tx=0).stop 2023-10-03T19:13:05.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f085d32f640 1 -- 172.21.15.45:0/3737998603 shutdown_connections 2023-10-03T19:13:05.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f085d32f640 1 --2- 172.21.15.45:0/3737998603 >> v2:172.21.15.79:3300/0 conn(0x7f085806d560 0x7f08580bd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f085d32f640 1 --2- 172.21.15.45:0/3737998603 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08580712c0 0x7f08580bcbc0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f085d32f640 1 -- 172.21.15.45:0/3737998603 >> 172.21.15.45:0/3737998603 conn(0x7f08580a20d0 msgr2=0x7f08580a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:05.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f085d32f640 1 -- 172.21.15.45:0/3737998603 shutdown_connections 2023-10-03T19:13:05.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f085d32f640 1 -- 172.21.15.45:0/3737998603 wait complete. 2023-10-03T19:13:05.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f085d32f640 1 Processor -- start 2023-10-03T19:13:05.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f085d32f640 1 -- start start 2023-10-03T19:13:05.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f085d32f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f085806c760 0x7f085814a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:05.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f085d32f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f085806d560 0x7f0858147f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:05.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f085d32f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08580712c0 0x7f08581e91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:05.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f085d32f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085814fcc0 con 0x7f085806d560 2023-10-03T19:13:05.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f085d32f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085814be80 con 0x7f085806c760 2023-10-03T19:13:05.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f085d32f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08581e8d50 con 0x7f08580712c0 2023-10-03T19:13:05.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f084ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f085806d560 0x7f0858147f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:05.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f084ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f085806d560 0x7f0858147f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46248/0 (socket says 172.21.15.45:46248) 2023-10-03T19:13:05.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f084ffff640 1 -- 172.21.15.45:0/3114536910 learned_addr learned my addr 172.21.15.45:0/3114536910 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:05.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f0856ffd640 1 --2- 172.21.15.45:0/3114536910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f085806c760 0x7f085814a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:05.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f08577fe640 1 --2- 172.21.15.45:0/3114536910 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08580712c0 0x7f08581e91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:05.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f084ffff640 1 -- 172.21.15.45:0/3114536910 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08580712c0 msgr2=0x7f08581e91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:05.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f084ffff640 1 --2- 172.21.15.45:0/3114536910 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08580712c0 0x7f08581e91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f084ffff640 1 -- 172.21.15.45:0/3114536910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f085806c760 msgr2=0x7f085814a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:05.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f084ffff640 1 --2- 172.21.15.45:0/3114536910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f085806c760 0x7f085814a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f084ffff640 1 -- 172.21.15.45:0/3114536910 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08480094d0 con 0x7f085806d560 2023-10-03T19:13:05.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f084ffff640 1 --2- 172.21.15.45:0/3114536910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f085806d560 0x7f0858147f90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f084000d830 tx=0x7f084000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:05.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f084f7fe640 1 -- 172.21.15.45:0/3114536910 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084000b6c0 con 0x7f085806d560 2023-10-03T19:13:05.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f084f7fe640 1 -- 172.21.15.45:0/3114536910 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084000b860 con 0x7f085806d560 2023-10-03T19:13:05.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f085d32f640 1 -- 172.21.15.45:0/3114536910 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08580a6070 con 0x7f085806d560 2023-10-03T19:13:05.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f084f7fe640 1 -- 172.21.15.45:0/3114536910 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084000bc10 con 0x7f085806d560 2023-10-03T19:13:05.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.076+0000 7f085d32f640 1 -- 172.21.15.45:0/3114536910 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08580a5ee0 con 0x7f085806d560 2023-10-03T19:13:05.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.080+0000 7f085d32f640 1 -- 172.21.15.45:0/3114536910 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08581596f0 con 0x7f085806d560 2023-10-03T19:13:05.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.080+0000 7f084f7fe640 1 -- 172.21.15.45:0/3114536910 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f084001e460 con 0x7f085806d560 2023-10-03T19:13:05.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.080+0000 7f084f7fe640 1 --2- 172.21.15.45:0/3114536910 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0838066280 0x7f0838068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:05.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.080+0000 7f084f7fe640 1 -- 172.21.15.45:0/3114536910 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0840084570 con 0x7f085806d560 2023-10-03T19:13:05.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.080+0000 7f0856ffd640 1 --2- 172.21.15.45:0/3114536910 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0838066280 0x7f0838068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:05.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.080+0000 7f0856ffd640 1 --2- 172.21.15.45:0/3114536910 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0838066280 0x7f0838068730 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f08480af000 tx=0x7f08480a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:05.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.084+0000 7f084f7fe640 1 -- 172.21.15.45:0/3114536910 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f08400519f0 con 0x7f085806d560 2023-10-03T19:13:05.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.236+0000 7f085d32f640 1 -- 172.21.15.45:0/3114536910 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f08580bca30 con 0x7f085806d560 2023-10-03T19:13:05.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.236+0000 7f084f7fe640 1 -- 172.21.15.45:0/3114536910 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0840055010 con 0x7f085806d560 2023-10-03T19:13:05.243 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-03T19:13:05.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.240+0000 7f085d32f640 1 -- 172.21.15.45:0/3114536910 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0838066280 msgr2=0x7f0838068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:05.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.240+0000 7f085d32f640 1 --2- 172.21.15.45:0/3114536910 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0838066280 0x7f0838068730 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f08480af000 tx=0x7f08480a7000 comp rx=0 tx=0).stop 2023-10-03T19:13:05.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.240+0000 7f085d32f640 1 -- 172.21.15.45:0/3114536910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f085806d560 msgr2=0x7f0858147f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:05.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.240+0000 7f085d32f640 1 --2- 172.21.15.45:0/3114536910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f085806d560 0x7f0858147f90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f084000d830 tx=0x7f084000dcf0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.240+0000 7f085d32f640 1 -- 172.21.15.45:0/3114536910 shutdown_connections 2023-10-03T19:13:05.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.240+0000 7f085d32f640 1 --2- 172.21.15.45:0/3114536910 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0838066280 0x7f0838068730 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.240+0000 7f085d32f640 1 --2- 172.21.15.45:0/3114536910 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08580712c0 0x7f08581e91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.240+0000 7f085d32f640 1 --2- 172.21.15.45:0/3114536910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f085806d560 0x7f0858147f90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.240+0000 7f085d32f640 1 --2- 172.21.15.45:0/3114536910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f085806c760 0x7f085814a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.240+0000 7f085d32f640 1 -- 172.21.15.45:0/3114536910 >> 172.21.15.45:0/3114536910 conn(0x7f08580a20d0 msgr2=0x7f08580bcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:05.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.240+0000 7f085d32f640 1 -- 172.21.15.45:0/3114536910 shutdown_connections 2023-10-03T19:13:05.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.240+0000 7f085d32f640 1 -- 172.21.15.45:0/3114536910 wait complete. 2023-10-03T19:13:05.261 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T19:13:05.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.368+0000 7fce21385640 1 Processor -- start 2023-10-03T19:13:05.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.368+0000 7fce21385640 1 -- start start 2023-10-03T19:13:05.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce21385640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fce1c14f510 0x7fce1c14b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:05.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce21385640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce1c0bd9f0 0x7fce1c14b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:05.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce21385640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce1c14f080 con 0x7fce1c06f880 2023-10-03T19:13:05.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce21385640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce1c06f3e0 con 0x7fce1c14f510 2023-10-03T19:13:05.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce21385640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c070e90 con 0x7fce1c0bd9f0 2023-10-03T19:13:05.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce1affd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fce1c06f880 0x7fce1c0a5940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34726/0 (socket says 172.21.15.45:34726) 2023-10-03T19:13:05.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce1affd640 1 -- 172.21.15.45:0/476338825 learned_addr learned my addr 172.21.15.45:0/476338825 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:05.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce1a7fc640 1 --2- 172.21.15.45:0/476338825 >> v2:172.21.15.79:3300/0 conn(0x7fce1c14f510 0x7fce1c14b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:05.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce1b7fe640 1 --2- 172.21.15.45:0/476338825 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce1c0bd9f0 0x7fce1c14b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:05.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce19ffb640 1 -- 172.21.15.45:0/476338825 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2274938320 0 0) 0x7fce1c14f080 con 0x7fce1c06f880 2023-10-03T19:13:05.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce19ffb640 1 -- 172.21.15.45:0/476338825 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce08003530 con 0x7fce1c06f880 2023-10-03T19:13:05.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce19ffb640 1 -- 172.21.15.45:0/476338825 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 821567066 0 0) 0x7fce08003530 con 0x7fce1c06f880 2023-10-03T19:13:05.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce19ffb640 1 -- 172.21.15.45:0/476338825 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce1c0bd9f0 msgr2=0x7fce1c14b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:05.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce19ffb640 1 --2- 172.21.15.45:0/476338825 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce1c0bd9f0 0x7fce1c14b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce19ffb640 1 -- 172.21.15.45:0/476338825 >> v2:172.21.15.79:3300/0 conn(0x7fce1c14f510 msgr2=0x7fce1c14b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:05.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce19ffb640 1 --2- 172.21.15.45:0/476338825 >> v2:172.21.15.79:3300/0 conn(0x7fce1c14f510 0x7fce1c14b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce19ffb640 1 -- 172.21.15.45:0/476338825 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce1c14ea30 con 0x7fce1c06f880 2023-10-03T19:13:05.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce19ffb640 1 -- 172.21.15.45:0/476338825 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fce14001a00 con 0x7fce1c06f880 2023-10-03T19:13:05.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce19ffb640 1 -- 172.21.15.45:0/476338825 >> v1:172.21.15.45:6789/0 conn(0x7fce1c06f880 legacy=0x7fce1c0a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:05.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce19ffb640 1 --2- 172.21.15.45:0/476338825 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce1c0bd9f0 0x7fce08003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:05.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce19ffb640 1 --2- 172.21.15.45:0/476338825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce08003f00 0x7fce080047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:05.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce19ffb640 1 --2- 172.21.15.45:0/476338825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce08004d10 0x7fce08005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:05.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce19ffb640 1 -- 172.21.15.45:0/476338825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c06f3e0 con 0x7fce08004d10 2023-10-03T19:13:05.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce19ffb640 1 -- 172.21.15.45:0/476338825 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c070e90 con 0x7fce08003f00 2023-10-03T19:13:05.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce19ffb640 1 -- 172.21.15.45:0/476338825 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0800b990 con 0x7fce1c0bd9f0 2023-10-03T19:13:05.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce1b7fe640 1 --2- 172.21.15.45:0/476338825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce08004d10 0x7fce08005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:05.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce1a7fc640 1 --2- 172.21.15.45:0/476338825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce08003f00 0x7fce080047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:05.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce1affd640 1 --2- 172.21.15.45:0/476338825 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce1c0bd9f0 0x7fce08003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:05.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce1b7fe640 1 -- 172.21.15.45:0/476338825 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce1c0bd9f0 msgr2=0x7fce08003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:05.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce1b7fe640 1 --2- 172.21.15.45:0/476338825 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce1c0bd9f0 0x7fce08003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce1b7fe640 1 -- 172.21.15.45:0/476338825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce08003f00 msgr2=0x7fce080047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:05.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce1b7fe640 1 --2- 172.21.15.45:0/476338825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce08003f00 0x7fce080047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce1b7fe640 1 -- 172.21.15.45:0/476338825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce08003530 con 0x7fce08004d10 2023-10-03T19:13:05.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce1affd640 1 --2- 172.21.15.45:0/476338825 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce1c0bd9f0 0x7fce08003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:13:05.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.372+0000 7fce1b7fe640 1 --2- 172.21.15.45:0/476338825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce08004d10 0x7fce08005180 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fce0c009ae0 tx=0x7fce0c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e1e4f7437a3dd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:05.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce19ffb640 1 -- 172.21.15.45:0/476338825 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c0a5640 con 0x7fce08004d10 2023-10-03T19:13:05.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce19ffb640 1 -- 172.21.15.45:0/476338825 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0c0a57a0 con 0x7fce08004d10 2023-10-03T19:13:05.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce19ffb640 1 -- 172.21.15.45:0/476338825 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c0a5b50 con 0x7fce08004d10 2023-10-03T19:13:05.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce21385640 1 -- 172.21.15.45:0/476338825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce08004d10 msgr2=0x7fce08005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:05.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce21385640 1 --2- 172.21.15.45:0/476338825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce08004d10 0x7fce08005180 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fce0c009ae0 tx=0x7fce0c01ca50 comp rx=0 tx=0).stop 2023-10-03T19:13:05.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce1b7fe640 1 -- 172.21.15.45:0/476338825 reap_dead start 2023-10-03T19:13:05.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce21385640 1 -- 172.21.15.45:0/476338825 shutdown_connections 2023-10-03T19:13:05.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce21385640 1 -- 172.21.15.45:0/476338825 >> 172.21.15.45:0/476338825 conn(0x7fce1c0a20d0 msgr2=0x7fce1c0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:05.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce21385640 1 -- 172.21.15.45:0/476338825 shutdown_connections 2023-10-03T19:13:05.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce21385640 1 -- 172.21.15.45:0/476338825 wait complete. 2023-10-03T19:13:05.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce21385640 1 Processor -- start 2023-10-03T19:13:05.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce21385640 1 -- start start 2023-10-03T19:13:05.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce21385640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce1c14c8f0 0x7fce1c1df480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:05.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce21385640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce1c1e3310 0x7fce1c141d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:05.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce21385640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce1c142270 0x7fce1c0be010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:05.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce21385640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c13fa10 con 0x7fce1c14c8f0 2023-10-03T19:13:05.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce21385640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c1df9c0 con 0x7fce1c1e3310 2023-10-03T19:13:05.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce21385640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c0bfd80 con 0x7fce1c142270 2023-10-03T19:13:05.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce1affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce1c14c8f0 0x7fce1c1df480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:05.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce1affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce1c14c8f0 0x7fce1c1df480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46262/0 (socket says 172.21.15.45:46262) 2023-10-03T19:13:05.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce1b7fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce1c142270 0x7fce1c0be010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:05.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce1affd640 1 -- 172.21.15.45:0/3302144058 learned_addr learned my addr 172.21.15.45:0/3302144058 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:05.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce1a7fc640 1 --2- 172.21.15.45:0/3302144058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce1c1e3310 0x7fce1c141d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:05.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce1affd640 1 -- 172.21.15.45:0/3302144058 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce1c142270 msgr2=0x7fce1c0be010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:05.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce1affd640 1 --2- 172.21.15.45:0/3302144058 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce1c142270 0x7fce1c0be010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce1affd640 1 -- 172.21.15.45:0/3302144058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce1c1e3310 msgr2=0x7fce1c141d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:05.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce1affd640 1 --2- 172.21.15.45:0/3302144058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce1c1e3310 0x7fce1c141d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce1affd640 1 -- 172.21.15.45:0/3302144058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce1c06f070 con 0x7fce1c14c8f0 2023-10-03T19:13:05.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce1affd640 1 --2- 172.21.15.45:0/3302144058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce1c14c8f0 0x7fce1c1df480 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fce1400e4b0 tx=0x7fce1400e8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:05.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce137fe640 1 -- 172.21.15.45:0/3302144058 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce14012590 con 0x7fce1c14c8f0 2023-10-03T19:13:05.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce137fe640 1 -- 172.21.15.45:0/3302144058 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce140126f0 con 0x7fce1c14c8f0 2023-10-03T19:13:05.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce21385640 1 -- 172.21.15.45:0/3302144058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce1c14ed10 con 0x7fce1c14c8f0 2023-10-03T19:13:05.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce137fe640 1 -- 172.21.15.45:0/3302144058 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce14012a60 con 0x7fce1c14c8f0 2023-10-03T19:13:05.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.376+0000 7fce21385640 1 -- 172.21.15.45:0/3302144058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce1c06fc50 con 0x7fce1c14c8f0 2023-10-03T19:13:05.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.380+0000 7fce21385640 1 -- 172.21.15.45:0/3302144058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce1c04de80 con 0x7fce1c14c8f0 2023-10-03T19:13:05.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.380+0000 7fce137fe640 1 -- 172.21.15.45:0/3302144058 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fce14012bc0 con 0x7fce1c14c8f0 2023-10-03T19:13:05.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.380+0000 7fce137fe640 1 --2- 172.21.15.45:0/3302144058 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcdfc0662b0 0x7fcdfc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:05.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.380+0000 7fce137fe640 1 -- 172.21.15.45:0/3302144058 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fce14084710 con 0x7fce1c14c8f0 2023-10-03T19:13:05.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.380+0000 7fce1a7fc640 1 --2- 172.21.15.45:0/3302144058 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcdfc0662b0 0x7fcdfc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:05.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.380+0000 7fce1a7fc640 1 --2- 172.21.15.45:0/3302144058 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcdfc0662b0 0x7fcdfc068760 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fce1c0701d0 tx=0x7fce04013040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:05.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.384+0000 7fce137fe640 1 -- 172.21.15.45:0/3302144058 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fce14051c20 con 0x7fce1c14c8f0 2023-10-03T19:13:05.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.536+0000 7fce21385640 1 -- 172.21.15.45:0/3302144058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fce1c14d100 con 0x7fce1c14c8f0 2023-10-03T19:13:05.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.536+0000 7fce137fe640 1 -- 172.21.15.45:0/3302144058 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fce14055240 con 0x7fce1c14c8f0 2023-10-03T19:13:05.540 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-03T19:13:05.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.536+0000 7fce21385640 1 -- 172.21.15.45:0/3302144058 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcdfc0662b0 msgr2=0x7fcdfc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:05.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.536+0000 7fce21385640 1 --2- 172.21.15.45:0/3302144058 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcdfc0662b0 0x7fcdfc068760 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fce1c0701d0 tx=0x7fce04013040 comp rx=0 tx=0).stop 2023-10-03T19:13:05.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.536+0000 7fce21385640 1 -- 172.21.15.45:0/3302144058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce1c14c8f0 msgr2=0x7fce1c1df480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:05.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.536+0000 7fce21385640 1 --2- 172.21.15.45:0/3302144058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce1c14c8f0 0x7fce1c1df480 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fce1400e4b0 tx=0x7fce1400e8b0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.536+0000 7fce21385640 1 -- 172.21.15.45:0/3302144058 shutdown_connections 2023-10-03T19:13:05.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.536+0000 7fce21385640 1 --2- 172.21.15.45:0/3302144058 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcdfc0662b0 0x7fcdfc068760 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.536+0000 7fce21385640 1 --2- 172.21.15.45:0/3302144058 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce1c142270 0x7fce1c0be010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.536+0000 7fce21385640 1 --2- 172.21.15.45:0/3302144058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce1c1e3310 0x7fce1c141d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.536+0000 7fce21385640 1 --2- 172.21.15.45:0/3302144058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce1c14c8f0 0x7fce1c1df480 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.536+0000 7fce21385640 1 -- 172.21.15.45:0/3302144058 >> 172.21.15.45:0/3302144058 conn(0x7fce1c0a20d0 msgr2=0x7fce1c0bc890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:05.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.536+0000 7fce21385640 1 -- 172.21.15.45:0/3302144058 shutdown_connections 2023-10-03T19:13:05.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.536+0000 7fce21385640 1 -- 172.21.15.45:0/3302144058 wait complete. 2023-10-03T19:13:05.559 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-03T19:13:05.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.680+0000 7f297eacd640 1 Processor -- start 2023-10-03T19:13:05.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.680+0000 7f297eacd640 1 -- start start 2023-10-03T19:13:05.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.680+0000 7f297eacd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f29780a6af0 0x7f2978070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:05.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.680+0000 7f297eacd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29781503e0 0x7f297814b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:05.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.680+0000 7f297eacd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f297806a240 con 0x7f297814be70 2023-10-03T19:13:05.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.680+0000 7f297eacd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29780bc0f0 con 0x7f29780a6af0 2023-10-03T19:13:05.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.680+0000 7f297eacd640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29780a75e0 con 0x7f29781503e0 2023-10-03T19:13:05.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.680+0000 7f297c869640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f29780a6af0 0x7f2978070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:05.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.680+0000 7f297d06a640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f297814be70 0x7f2978065690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34742/0 (socket says 172.21.15.45:34742) 2023-10-03T19:13:05.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.680+0000 7f297d06a640 1 -- 172.21.15.45:0/625622908 learned_addr learned my addr 172.21.15.45:0/625622908 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:05.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.680+0000 7f2977fff640 1 --2- 172.21.15.45:0/625622908 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29781503e0 0x7f297814b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:05.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.680+0000 7f297c869640 1 -- 172.21.15.45:0/625622908 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29781503e0 msgr2=0x7f297814b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:05.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.680+0000 7f297c869640 1 --2- 172.21.15.45:0/625622908 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29781503e0 0x7f297814b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.680+0000 7f297c869640 1 -- 172.21.15.45:0/625622908 >> v1:172.21.15.45:6789/0 conn(0x7f297814be70 legacy=0x7f2978065690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:05.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.680+0000 7f297c869640 1 -- 172.21.15.45:0/625622908 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2978069db0 con 0x7f29780a6af0 2023-10-03T19:13:05.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.680+0000 7f2977fff640 1 --2- 172.21.15.45:0/625622908 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29781503e0 0x7f297814b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:13:05.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.684+0000 7f297c869640 1 --2- 172.21.15.45:0/625622908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29780a6af0 0x7f2978070b50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f296c0097c0 tx=0x7f296c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61d9aa2eab377d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:05.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.684+0000 7f29777fe640 1 -- 172.21.15.45:0/625622908 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296c0ab600 con 0x7f29780a6af0 2023-10-03T19:13:05.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.684+0000 7f29777fe640 1 -- 172.21.15.45:0/625622908 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296c0a7050 con 0x7f29780a6af0 2023-10-03T19:13:05.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.684+0000 7f29777fe640 1 -- 172.21.15.45:0/625622908 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296c0ab980 con 0x7f29780a6af0 2023-10-03T19:13:05.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.684+0000 7f297eacd640 1 -- 172.21.15.45:0/625622908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29780a6af0 msgr2=0x7f2978070b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:05.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.684+0000 7f297eacd640 1 --2- 172.21.15.45:0/625622908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29780a6af0 0x7f2978070b50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f296c0097c0 tx=0x7f296c01c480 comp rx=0 tx=0).stop 2023-10-03T19:13:05.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.684+0000 7f297eacd640 1 -- 172.21.15.45:0/625622908 shutdown_connections 2023-10-03T19:13:05.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.684+0000 7f297eacd640 1 --2- 172.21.15.45:0/625622908 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29781503e0 0x7f297814b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.684+0000 7f297eacd640 1 --2- 172.21.15.45:0/625622908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29780a6af0 0x7f2978070b50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.684+0000 7f297eacd640 1 -- 172.21.15.45:0/625622908 >> 172.21.15.45:0/625622908 conn(0x7f29780bed00 msgr2=0x7f297806d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:05.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.684+0000 7f297eacd640 1 -- 172.21.15.45:0/625622908 shutdown_connections 2023-10-03T19:13:05.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.684+0000 7f297eacd640 1 -- 172.21.15.45:0/625622908 wait complete. 2023-10-03T19:13:05.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.684+0000 7f297eacd640 1 Processor -- start 2023-10-03T19:13:05.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.684+0000 7f297eacd640 1 -- start start 2023-10-03T19:13:05.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.684+0000 7f297eacd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29780a6af0 0x7f29780a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:05.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.684+0000 7f297eacd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f297814be70 0x7f297814ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:05.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.684+0000 7f297eacd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29781503e0 0x7f2978143720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:05.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.684+0000 7f297eacd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297814b180 con 0x7f297814be70 2023-10-03T19:13:05.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.684+0000 7f297eacd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29781ea2e0 con 0x7f29780a6af0 2023-10-03T19:13:05.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.684+0000 7f297eacd640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29780bd070 con 0x7f29781503e0 2023-10-03T19:13:05.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.688+0000 7f2977fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f297814be70 0x7f297814ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:05.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.688+0000 7f2977fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f297814be70 0x7f297814ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46276/0 (socket says 172.21.15.45:46276) 2023-10-03T19:13:05.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.688+0000 7f2977fff640 1 -- 172.21.15.45:0/844947032 learned_addr learned my addr 172.21.15.45:0/844947032 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:05.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.688+0000 7f297c869640 1 --2- 172.21.15.45:0/844947032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29780a6af0 0x7f29780a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:05.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.688+0000 7f297d06a640 1 --2- 172.21.15.45:0/844947032 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29781503e0 0x7f2978143720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:05.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.688+0000 7f2977fff640 1 -- 172.21.15.45:0/844947032 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29781503e0 msgr2=0x7f2978143720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:05.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.688+0000 7f2977fff640 1 --2- 172.21.15.45:0/844947032 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29781503e0 0x7f2978143720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.688+0000 7f2977fff640 1 -- 172.21.15.45:0/844947032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29780a6af0 msgr2=0x7f29780a59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:05.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.688+0000 7f2977fff640 1 --2- 172.21.15.45:0/844947032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29780a6af0 0x7f29780a59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.688+0000 7f2977fff640 1 -- 172.21.15.45:0/844947032 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296c009420 con 0x7f297814be70 2023-10-03T19:13:05.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.688+0000 7f297c869640 1 --2- 172.21.15.45:0/844947032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29780a6af0 0x7f29780a59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:13:05.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.688+0000 7f2977fff640 1 --2- 172.21.15.45:0/844947032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f297814be70 0x7f297814ac40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f296800d800 tx=0x7f296800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:05.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.688+0000 7f29757fa640 1 -- 172.21.15.45:0/844947032 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296800b6c0 con 0x7f297814be70 2023-10-03T19:13:05.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.688+0000 7f29757fa640 1 -- 172.21.15.45:0/844947032 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296800b820 con 0x7f297814be70 2023-10-03T19:13:05.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.688+0000 7f297eacd640 1 -- 172.21.15.45:0/844947032 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29780bdd60 con 0x7f297814be70 2023-10-03T19:13:05.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.688+0000 7f29757fa640 1 -- 172.21.15.45:0/844947032 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296800bbd0 con 0x7f297814be70 2023-10-03T19:13:05.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.688+0000 7f297eacd640 1 -- 172.21.15.45:0/844947032 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f297806b010 con 0x7f297814be70 2023-10-03T19:13:05.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.688+0000 7f297eacd640 1 -- 172.21.15.45:0/844947032 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f297814c270 con 0x7f297814be70 2023-10-03T19:13:05.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.688+0000 7f29757fa640 1 -- 172.21.15.45:0/844947032 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f296800bd30 con 0x7f297814be70 2023-10-03T19:13:05.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.688+0000 7f29757fa640 1 --2- 172.21.15.45:0/844947032 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f29640662b0 0x7f2964068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:05.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.688+0000 7f29757fa640 1 -- 172.21.15.45:0/844947032 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f29680842b0 con 0x7f297814be70 2023-10-03T19:13:05.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.688+0000 7f297c869640 1 --2- 172.21.15.45:0/844947032 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f29640662b0 0x7f2964068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:05.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.688+0000 7f297c869640 1 --2- 172.21.15.45:0/844947032 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f29640662b0 0x7f2964068760 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f296c0ad000 tx=0x7f296c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:05.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.692+0000 7f29757fa640 1 -- 172.21.15.45:0/844947032 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2968055130 con 0x7f297814be70 2023-10-03T19:13:05.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.852+0000 7f297eacd640 1 -- 172.21.15.45:0/844947032 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f29781ea780 con 0x7f297814be70 2023-10-03T19:13:05.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.852+0000 7f29757fa640 1 -- 172.21.15.45:0/844947032 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2968054cc0 con 0x7f297814be70 2023-10-03T19:13:05.857 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-10-03T19:13:05.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.852+0000 7f297eacd640 1 -- 172.21.15.45:0/844947032 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f29640662b0 msgr2=0x7f2964068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:05.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.852+0000 7f297eacd640 1 --2- 172.21.15.45:0/844947032 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f29640662b0 0x7f2964068760 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f296c0ad000 tx=0x7f296c008040 comp rx=0 tx=0).stop 2023-10-03T19:13:05.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.852+0000 7f297eacd640 1 -- 172.21.15.45:0/844947032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f297814be70 msgr2=0x7f297814ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:05.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.852+0000 7f297eacd640 1 --2- 172.21.15.45:0/844947032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f297814be70 0x7f297814ac40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f296800d800 tx=0x7f296800dcc0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.852+0000 7f297eacd640 1 -- 172.21.15.45:0/844947032 shutdown_connections 2023-10-03T19:13:05.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.852+0000 7f297eacd640 1 --2- 172.21.15.45:0/844947032 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f29640662b0 0x7f2964068760 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.852+0000 7f297eacd640 1 --2- 172.21.15.45:0/844947032 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29781503e0 0x7f2978143720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.852+0000 7f297eacd640 1 --2- 172.21.15.45:0/844947032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f297814be70 0x7f297814ac40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.852+0000 7f297eacd640 1 --2- 172.21.15.45:0/844947032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29780a6af0 0x7f29780a59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:05.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.852+0000 7f297eacd640 1 -- 172.21.15.45:0/844947032 >> 172.21.15.45:0/844947032 conn(0x7f29780bed00 msgr2=0x7f2978146e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:05.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.852+0000 7f297eacd640 1 -- 172.21.15.45:0/844947032 shutdown_connections 2023-10-03T19:13:05.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:05.852+0000 7f297eacd640 1 -- 172.21.15.45:0/844947032 wait complete. 2023-10-03T19:13:05.875 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi172.front.sepia.ceph.com... 2023-10-03T19:13:05.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:13:05.875 DEBUG:teuthology.orchestra.run.smithi172:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-03T19:13:05.899 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:13:05.899 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2023-10-03T19:13:05.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:13:05.900 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-03T19:13:05.956 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-10-03T19:13:05.956 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:13:06.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.076+0000 7f31c6c8c640 1 Processor -- start 2023-10-03T19:13:06.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.076+0000 7f31c6c8c640 1 -- start start 2023-10-03T19:13:06.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.076+0000 7f31c6c8c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31c00bcb60 0x7f31c006c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:06.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.076+0000 7f31c6c8c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f31c006c7d0 0x7f31c0155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:06.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.076+0000 7f31c6c8c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c014b610 con 0x7f31c0148b90 2023-10-03T19:13:06.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.076+0000 7f31c6c8c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c00a3670 con 0x7f31c00bcb60 2023-10-03T19:13:06.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.076+0000 7f31c6c8c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c014b370 con 0x7f31c006c7d0 2023-10-03T19:13:06.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.076+0000 7f31bffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31c00bcb60 0x7f31c006c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:06.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.076+0000 7f31bffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31c00bcb60 0x7f31c006c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46290/0 (socket says 172.21.15.45:46290) 2023-10-03T19:13:06.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.076+0000 7f31bffff640 1 -- 172.21.15.45:0/1056392652 learned_addr learned my addr 172.21.15.45:0/1056392652 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:06.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.076+0000 7f31c5229640 1 --2- 172.21.15.45:0/1056392652 >> v2:172.21.15.79:3300/0 conn(0x7f31c006c7d0 0x7f31c0155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:06.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.076+0000 7f31bffff640 1 -- 172.21.15.45:0/1056392652 >> v2:172.21.15.79:3300/0 conn(0x7f31c006c7d0 msgr2=0x7f31c0155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:06.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.076+0000 7f31bffff640 1 --2- 172.21.15.45:0/1056392652 >> v2:172.21.15.79:3300/0 conn(0x7f31c006c7d0 0x7f31c0155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.076+0000 7f31bffff640 1 -- 172.21.15.45:0/1056392652 >> v1:172.21.15.79:6789/0 conn(0x7f31c0148b90 legacy=0x7f31c00bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:06.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.076+0000 7f31bffff640 1 -- 172.21.15.45:0/1056392652 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c00a5580 con 0x7f31c00bcb60 2023-10-03T19:13:06.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.076+0000 7f31c5229640 1 --2- 172.21.15.45:0/1056392652 >> v2:172.21.15.79:3300/0 conn(0x7f31c006c7d0 0x7f31c0155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:06.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31bffff640 1 --2- 172.21.15.45:0/1056392652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c00bcb60 0x7f31c006c290 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f31c006aa90 tx=0x7f31b001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=887cda3957c49705 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:06.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31bf7fe640 1 -- 172.21.15.45:0/1056392652 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b00a89f0 con 0x7f31c00bcb60 2023-10-03T19:13:06.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31bf7fe640 1 -- 172.21.15.45:0/1056392652 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b00a8b50 con 0x7f31c00bcb60 2023-10-03T19:13:06.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31bf7fe640 1 -- 172.21.15.45:0/1056392652 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b00b0440 con 0x7f31c00bcb60 2023-10-03T19:13:06.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31c6c8c640 1 -- 172.21.15.45:0/1056392652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c00bcb60 msgr2=0x7f31c006c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:06.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31c6c8c640 1 --2- 172.21.15.45:0/1056392652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c00bcb60 0x7f31c006c290 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f31c006aa90 tx=0x7f31b001ecf0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31c6c8c640 1 -- 172.21.15.45:0/1056392652 shutdown_connections 2023-10-03T19:13:06.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31c6c8c640 1 --2- 172.21.15.45:0/1056392652 >> v2:172.21.15.79:3300/0 conn(0x7f31c006c7d0 0x7f31c0155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31c6c8c640 1 --2- 172.21.15.45:0/1056392652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c00bcb60 0x7f31c006c290 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31c6c8c640 1 -- 172.21.15.45:0/1056392652 >> 172.21.15.45:0/1056392652 conn(0x7f31c00bcf50 msgr2=0x7f31c00bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:06.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31c6c8c640 1 -- 172.21.15.45:0/1056392652 shutdown_connections 2023-10-03T19:13:06.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31c6c8c640 1 -- 172.21.15.45:0/1056392652 wait complete. 2023-10-03T19:13:06.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31c6c8c640 1 Processor -- start 2023-10-03T19:13:06.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31c6c8c640 1 -- start start 2023-10-03T19:13:06.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31c6c8c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c006c7d0 0x7f31c00b9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:06.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31c6c8c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31c00bcb60 0x7f31c01405f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:06.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31c6c8c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31c0148b90 0x7f31c0140b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:06.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31c6c8c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c01446e0 con 0x7f31c006c7d0 2023-10-03T19:13:06.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31c6c8c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c0144030 con 0x7f31c0148b90 2023-10-03T19:13:06.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31c6c8c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c0141070 con 0x7f31c00bcb60 2023-10-03T19:13:06.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31c4a28640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c006c7d0 0x7f31c00b9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:06.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31c4a28640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c006c7d0 0x7f31c00b9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46306/0 (socket says 172.21.15.45:46306) 2023-10-03T19:13:06.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31c4a28640 1 -- 172.21.15.45:0/1814292504 learned_addr learned my addr 172.21.15.45:0/1814292504 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:06.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31bffff640 1 --2- 172.21.15.45:0/1814292504 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31c00bcb60 0x7f31c01405f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:06.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31c5229640 1 --2- 172.21.15.45:0/1814292504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31c0148b90 0x7f31c0140b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:06.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31c4a28640 1 -- 172.21.15.45:0/1814292504 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31c00bcb60 msgr2=0x7f31c01405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:06.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31c4a28640 1 --2- 172.21.15.45:0/1814292504 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31c00bcb60 0x7f31c01405f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31c4a28640 1 -- 172.21.15.45:0/1814292504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31c0148b90 msgr2=0x7f31c0140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:06.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31c4a28640 1 --2- 172.21.15.45:0/1814292504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31c0148b90 0x7f31c0140b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31c4a28640 1 -- 172.21.15.45:0/1814292504 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b00094d0 con 0x7f31c006c7d0 2023-10-03T19:13:06.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.080+0000 7f31c5229640 1 --2- 172.21.15.45:0/1814292504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31c0148b90 0x7f31c0140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:06.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.084+0000 7f31c4a28640 1 --2- 172.21.15.45:0/1814292504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c006c7d0 0x7f31c00b9af0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f31a800c3f0 tx=0x7f31a800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:06.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.084+0000 7f31bd7fa640 1 -- 172.21.15.45:0/1814292504 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a80052d0 con 0x7f31c006c7d0 2023-10-03T19:13:06.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.084+0000 7f31bd7fa640 1 -- 172.21.15.45:0/1814292504 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a8005430 con 0x7f31c006c7d0 2023-10-03T19:13:06.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.084+0000 7f31c6c8c640 1 -- 172.21.15.45:0/1814292504 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c00bc670 con 0x7f31c006c7d0 2023-10-03T19:13:06.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.084+0000 7f31bd7fa640 1 -- 172.21.15.45:0/1814292504 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a8003840 con 0x7f31c006c7d0 2023-10-03T19:13:06.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.084+0000 7f31c6c8c640 1 -- 172.21.15.45:0/1814292504 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c00a5820 con 0x7f31c006c7d0 2023-10-03T19:13:06.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.084+0000 7f31c6c8c640 1 -- 172.21.15.45:0/1814292504 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c0148f60 con 0x7f31c006c7d0 2023-10-03T19:13:06.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.084+0000 7f31bd7fa640 1 -- 172.21.15.45:0/1814292504 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f31a80039a0 con 0x7f31c006c7d0 2023-10-03T19:13:06.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.084+0000 7f31bd7fa640 1 --2- 172.21.15.45:0/1814292504 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f31a0066280 0x7f31a0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:06.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.084+0000 7f31bd7fa640 1 -- 172.21.15.45:0/1814292504 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f31a8083340 con 0x7f31c006c7d0 2023-10-03T19:13:06.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.084+0000 7f31bffff640 1 --2- 172.21.15.45:0/1814292504 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f31a0066280 0x7f31a0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:06.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.084+0000 7f31bffff640 1 --2- 172.21.15.45:0/1814292504 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f31a0066280 0x7f31a0068730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f31b00b2000 tx=0x7f31b0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:06.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.088+0000 7f31bd7fa640 1 -- 172.21.15.45:0/1814292504 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f31a8050730 con 0x7f31c006c7d0 2023-10-03T19:13:06.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.276+0000 7f31c6c8c640 1 -- 172.21.15.45:0/1814292504 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31c0144170 con 0x7f31c006c7d0 2023-10-03T19:13:06.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.276+0000 7f31bd7fa640 1 -- 172.21.15.45:0/1814292504 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3903 (secure 0 0 0) 0x7f31c0144170 con 0x7f31c006c7d0 2023-10-03T19:13:06.283 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:13:06.283 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/731286206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":731286206},{"type":"v1","addr":"172.21.15.45:6834","nonce":731286206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/144609891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":144609891},{"type":"v1","addr":"172.21.15.45:6835","nonce":144609891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:12:27.938475+0000","modified":"2023-10-03T19:12:30.957787+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/2693877820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2693877820},{"type":"v1","addr":"172.21.15.79:6835","nonce":2693877820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-03T19:13:06.283 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 7 2023-10-03T19:13:06.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.280+0000 7f31c6c8c640 1 -- 172.21.15.45:0/1814292504 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f31a0066280 msgr2=0x7f31a0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:06.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.280+0000 7f31c6c8c640 1 --2- 172.21.15.45:0/1814292504 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f31a0066280 0x7f31a0068730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f31b00b2000 tx=0x7f31b0008040 comp rx=0 tx=0).stop 2023-10-03T19:13:06.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.280+0000 7f31c6c8c640 1 -- 172.21.15.45:0/1814292504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c006c7d0 msgr2=0x7f31c00b9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:06.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.280+0000 7f31c6c8c640 1 --2- 172.21.15.45:0/1814292504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c006c7d0 0x7f31c00b9af0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f31a800c3f0 tx=0x7f31a800c8b0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.280+0000 7f31c6c8c640 1 -- 172.21.15.45:0/1814292504 shutdown_connections 2023-10-03T19:13:06.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.280+0000 7f31c6c8c640 1 --2- 172.21.15.45:0/1814292504 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f31a0066280 0x7f31a0068730 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.280+0000 7f31c6c8c640 1 --2- 172.21.15.45:0/1814292504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31c0148b90 0x7f31c0140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.280+0000 7f31c6c8c640 1 --2- 172.21.15.45:0/1814292504 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31c00bcb60 0x7f31c01405f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.280+0000 7f31c6c8c640 1 --2- 172.21.15.45:0/1814292504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c006c7d0 0x7f31c00b9af0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.280+0000 7f31c6c8c640 1 -- 172.21.15.45:0/1814292504 >> 172.21.15.45:0/1814292504 conn(0x7f31c00bcf50 msgr2=0x7f31c00719b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:06.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.280+0000 7f31c6c8c640 1 -- 172.21.15.45:0/1814292504 shutdown_connections 2023-10-03T19:13:06.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.280+0000 7f31c6c8c640 1 -- 172.21.15.45:0/1814292504 wait complete. 2023-10-03T19:13:06.302 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:13:06.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.420+0000 7f8224092640 1 Processor -- start 2023-10-03T19:13:06.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.420+0000 7f8224092640 1 -- start start 2023-10-03T19:13:06.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.424+0000 7f8224092640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f821c06f170 0x7f821c150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:06.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.424+0000 7f8224092640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f821c06d170 0x7f821c14d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:06.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.424+0000 7f8224092640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f821c06cac0 con 0x7f821c0bc8b0 2023-10-03T19:13:06.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.424+0000 7f8224092640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821c0720d0 con 0x7f821c06d170 2023-10-03T19:13:06.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.424+0000 7f8224092640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821c0a5ab0 con 0x7f821c06f170 2023-10-03T19:13:06.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.424+0000 7f822262f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f821c06d170 0x7f821c14d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:06.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.424+0000 7f822162d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f821c0bc8b0 0x7f821c14ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34756/0 (socket says 172.21.15.45:34756) 2023-10-03T19:13:06.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.424+0000 7f822162d640 1 -- 172.21.15.45:0/3885895858 learned_addr learned my addr 172.21.15.45:0/3885895858 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:06.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.424+0000 7f8221e2e640 1 --2- 172.21.15.45:0/3885895858 >> v2:172.21.15.79:3300/0 conn(0x7f821c06f170 0x7f821c150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:06.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.424+0000 7f822262f640 1 -- 172.21.15.45:0/3885895858 >> v2:172.21.15.79:3300/0 conn(0x7f821c06f170 msgr2=0x7f821c150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:06.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.424+0000 7f822262f640 1 --2- 172.21.15.45:0/3885895858 >> v2:172.21.15.79:3300/0 conn(0x7f821c06f170 0x7f821c150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.424+0000 7f822262f640 1 -- 172.21.15.45:0/3885895858 >> v1:172.21.15.45:6789/0 conn(0x7f821c0bc8b0 legacy=0x7f821c14ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:06.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.424+0000 7f822262f640 1 -- 172.21.15.45:0/3885895858 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c06cd00 con 0x7f821c06d170 2023-10-03T19:13:06.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.424+0000 7f822262f640 1 --2- 172.21.15.45:0/3885895858 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f821c06d170 0x7f821c14d180 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f821c0bdf90 tx=0x7f821401f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=235b3bc867f74760 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:06.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.424+0000 7f8220e2c640 1 -- 172.21.15.45:0/3885895858 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82140b0440 con 0x7f821c06d170 2023-10-03T19:13:06.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.424+0000 7f8220e2c640 1 -- 172.21.15.45:0/3885895858 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82140b05a0 con 0x7f821c06d170 2023-10-03T19:13:06.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.424+0000 7f8220e2c640 1 -- 172.21.15.45:0/3885895858 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82140b0930 con 0x7f821c06d170 2023-10-03T19:13:06.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.424+0000 7f8224092640 1 -- 172.21.15.45:0/3885895858 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f821c06d170 msgr2=0x7f821c14d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:06.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.424+0000 7f8224092640 1 --2- 172.21.15.45:0/3885895858 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f821c06d170 0x7f821c14d180 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f821c0bdf90 tx=0x7f821401f0f0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.424+0000 7f8224092640 1 -- 172.21.15.45:0/3885895858 shutdown_connections 2023-10-03T19:13:06.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.424+0000 7f8224092640 1 --2- 172.21.15.45:0/3885895858 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f821c06d170 0x7f821c14d180 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.424+0000 7f8224092640 1 --2- 172.21.15.45:0/3885895858 >> v2:172.21.15.79:3300/0 conn(0x7f821c06f170 0x7f821c150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.424+0000 7f8224092640 1 -- 172.21.15.45:0/3885895858 >> 172.21.15.45:0/3885895858 conn(0x7f821c0bcf50 msgr2=0x7f821c0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:06.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.424+0000 7f8224092640 1 -- 172.21.15.45:0/3885895858 shutdown_connections 2023-10-03T19:13:06.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.424+0000 7f8224092640 1 -- 172.21.15.45:0/3885895858 wait complete. 2023-10-03T19:13:06.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.428+0000 7f8224092640 1 Processor -- start 2023-10-03T19:13:06.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.428+0000 7f8224092640 1 -- start start 2023-10-03T19:13:06.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.428+0000 7f8224092640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f821c06d170 0x7f821c142c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:06.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.428+0000 7f8224092640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f821c06f170 0x7f821c147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:06.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.428+0000 7f8224092640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f821c0bc8b0 0x7f821c148f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:06.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.428+0000 7f8224092640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c14ab60 con 0x7f821c06f170 2023-10-03T19:13:06.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.428+0000 7f8224092640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c144360 con 0x7f821c06d170 2023-10-03T19:13:06.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.428+0000 7f8224092640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c14a6d0 con 0x7f821c0bc8b0 2023-10-03T19:13:06.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.428+0000 7f822162d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f821c06f170 0x7f821c147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:06.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.428+0000 7f822162d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f821c06f170 0x7f821c147ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46322/0 (socket says 172.21.15.45:46322) 2023-10-03T19:13:06.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.428+0000 7f822162d640 1 -- 172.21.15.45:0/1881009103 learned_addr learned my addr 172.21.15.45:0/1881009103 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:06.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.428+0000 7f8221e2e640 1 --2- 172.21.15.45:0/1881009103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f821c06d170 0x7f821c142c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:06.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.428+0000 7f822262f640 1 --2- 172.21.15.45:0/1881009103 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f821c0bc8b0 0x7f821c148f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:06.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.428+0000 7f822162d640 1 -- 172.21.15.45:0/1881009103 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f821c0bc8b0 msgr2=0x7f821c148f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:06.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.428+0000 7f822162d640 1 --2- 172.21.15.45:0/1881009103 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f821c0bc8b0 0x7f821c148f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.428+0000 7f822162d640 1 -- 172.21.15.45:0/1881009103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f821c06d170 msgr2=0x7f821c142c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:06.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.428+0000 7f822162d640 1 --2- 172.21.15.45:0/1881009103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f821c06d170 0x7f821c142c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.428+0000 7f822162d640 1 -- 172.21.15.45:0/1881009103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8214009a70 con 0x7f821c06f170 2023-10-03T19:13:06.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.428+0000 7f822162d640 1 --2- 172.21.15.45:0/1881009103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f821c06f170 0x7f821c147ef0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f820c00c500 tx=0x7f820c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:06.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.428+0000 7f82127fc640 1 -- 172.21.15.45:0/1881009103 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c005cf0 con 0x7f821c06f170 2023-10-03T19:13:06.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.428+0000 7f82127fc640 1 -- 172.21.15.45:0/1881009103 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c005e50 con 0x7f821c06f170 2023-10-03T19:13:06.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.428+0000 7f82127fc640 1 -- 172.21.15.45:0/1881009103 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c0072f0 con 0x7f821c06f170 2023-10-03T19:13:06.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.428+0000 7f8224092640 1 -- 172.21.15.45:0/1881009103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821c14c4a0 con 0x7f821c06f170 2023-10-03T19:13:06.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.428+0000 7f8224092640 1 -- 172.21.15.45:0/1881009103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821c14fae0 con 0x7f821c06f170 2023-10-03T19:13:06.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.428+0000 7f8224092640 1 -- 172.21.15.45:0/1881009103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f821c06f540 con 0x7f821c06f170 2023-10-03T19:13:06.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.428+0000 7f82127fc640 1 -- 172.21.15.45:0/1881009103 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f820c007450 con 0x7f821c06f170 2023-10-03T19:13:06.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.432+0000 7f82127fc640 1 --2- 172.21.15.45:0/1881009103 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8200066280 0x7f8200068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:06.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.432+0000 7f82127fc640 1 -- 172.21.15.45:0/1881009103 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f820c083080 con 0x7f821c06f170 2023-10-03T19:13:06.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.432+0000 7f8221e2e640 1 --2- 172.21.15.45:0/1881009103 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8200066280 0x7f8200068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:06.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.432+0000 7f8221e2e640 1 --2- 172.21.15.45:0/1881009103 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8200066280 0x7f8200068730 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f821800b9d0 tx=0x7f8218008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:06.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.436+0000 7f82127fc640 1 -- 172.21.15.45:0/1881009103 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f820c0b36f0 con 0x7f821c06f170 2023-10-03T19:13:06.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.592+0000 7f8224092640 1 -- 172.21.15.45:0/1881009103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f821c06d660 con 0x7f821c06f170 2023-10-03T19:13:06.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.596+0000 7f82127fc640 1 -- 172.21.15.45:0/1881009103 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18231 (secure 0 0 0) 0x7f820c017020 con 0x7f821c06f170 2023-10-03T19:13:06.601 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:13:06.602 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:12:28.941467+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:12:26.226431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T19:12:26.923174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:13:06.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.596+0000 7f8224092640 1 -- 172.21.15.45:0/1881009103 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8200066280 msgr2=0x7f8200068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:06.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.596+0000 7f8224092640 1 --2- 172.21.15.45:0/1881009103 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8200066280 0x7f8200068730 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f821800b9d0 tx=0x7f8218008040 comp rx=0 tx=0).stop 2023-10-03T19:13:06.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.596+0000 7f8224092640 1 -- 172.21.15.45:0/1881009103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f821c06f170 msgr2=0x7f821c147ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:06.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.596+0000 7f8224092640 1 --2- 172.21.15.45:0/1881009103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f821c06f170 0x7f821c147ef0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f820c00c500 tx=0x7f820c00c9c0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.596+0000 7f8224092640 1 -- 172.21.15.45:0/1881009103 shutdown_connections 2023-10-03T19:13:06.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.596+0000 7f8224092640 1 --2- 172.21.15.45:0/1881009103 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8200066280 0x7f8200068730 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.596+0000 7f8224092640 1 --2- 172.21.15.45:0/1881009103 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f821c0bc8b0 0x7f821c148f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.596+0000 7f8224092640 1 --2- 172.21.15.45:0/1881009103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f821c06f170 0x7f821c147ef0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.596+0000 7f8224092640 1 --2- 172.21.15.45:0/1881009103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f821c06d170 0x7f821c142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.596+0000 7f8224092640 1 -- 172.21.15.45:0/1881009103 >> 172.21.15.45:0/1881009103 conn(0x7f821c0bcf50 msgr2=0x7f821c14ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:06.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.600+0000 7f8224092640 1 -- 172.21.15.45:0/1881009103 shutdown_connections 2023-10-03T19:13:06.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.600+0000 7f8224092640 1 -- 172.21.15.45:0/1881009103 wait complete. 2023-10-03T19:13:06.621 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T19:12:26.226431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T19:12:26.923174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:13:06.622 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:13:06.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.740+0000 7efc1a2cc640 1 Processor -- start 2023-10-03T19:13:06.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.740+0000 7efc1a2cc640 1 -- start start 2023-10-03T19:13:06.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc1a2cc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efc1406d560 0x7efc140a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:06.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc1a2cc640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc1406c2d0 con 0x7efc140712c0 2023-10-03T19:13:06.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc1a2cc640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc14150610 con 0x7efc1406c760 2023-10-03T19:13:06.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc1a2cc640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc141508b0 con 0x7efc1406d560 2023-10-03T19:13:06.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc13fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7efc140712c0 0x7efc140bcbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34766/0 (socket says 172.21.15.45:34766) 2023-10-03T19:13:06.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc13fff640 1 -- 172.21.15.45:0/2381220337 learned_addr learned my addr 172.21.15.45:0/2381220337 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:06.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc137fe640 1 --2- 172.21.15.45:0/2381220337 >> v2:172.21.15.79:3300/0 conn(0x7efc1406d560 0x7efc140a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:06.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc12ffd640 1 -- 172.21.15.45:0/2381220337 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 923289636 0 0) 0x7efc1406c2d0 con 0x7efc140712c0 2023-10-03T19:13:06.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc12ffd640 1 -- 172.21.15.45:0/2381220337 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc00003530 con 0x7efc140712c0 2023-10-03T19:13:06.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc12ffd640 1 -- 172.21.15.45:0/2381220337 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3601404060 0 0) 0x7efc14150610 con 0x7efc1406c760 2023-10-03T19:13:06.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc12ffd640 1 -- 172.21.15.45:0/2381220337 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc1406c2d0 con 0x7efc1406c760 2023-10-03T19:13:06.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc12ffd640 1 -- 172.21.15.45:0/2381220337 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 966910464 0 0) 0x7efc00003530 con 0x7efc140712c0 2023-10-03T19:13:06.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc12ffd640 1 -- 172.21.15.45:0/2381220337 >> v2:172.21.15.79:3300/0 conn(0x7efc1406d560 msgr2=0x7efc140a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:06.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc12ffd640 1 --2- 172.21.15.45:0/2381220337 >> v2:172.21.15.79:3300/0 conn(0x7efc1406d560 0x7efc140a53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc12ffd640 1 -- 172.21.15.45:0/2381220337 >> v1:172.21.15.79:6789/0 conn(0x7efc1406c760 legacy=0x7efc140a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:06.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc12ffd640 1 -- 172.21.15.45:0/2381220337 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1406d2e0 con 0x7efc140712c0 2023-10-03T19:13:06.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc12ffd640 1 -- 172.21.15.45:0/2381220337 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7efc0c001a00 con 0x7efc140712c0 2023-10-03T19:13:06.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc12ffd640 1 -- 172.21.15.45:0/2381220337 >> v1:172.21.15.45:6789/0 conn(0x7efc140712c0 legacy=0x7efc140bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:06.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc12ffd640 1 --2- 172.21.15.45:0/2381220337 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc00003b10 0x7efc00003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:06.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc12ffd640 1 --2- 172.21.15.45:0/2381220337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc000047d0 0x7efc00004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:06.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc12ffd640 1 --2- 172.21.15.45:0/2381220337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc00005180 0x7efc0000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:06.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc12ffd640 1 -- 172.21.15.45:0/2381220337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc141508b0 con 0x7efc000047d0 2023-10-03T19:13:06.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc12ffd640 1 -- 172.21.15.45:0/2381220337 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0000bfe0 con 0x7efc00005180 2023-10-03T19:13:06.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc12ffd640 1 -- 172.21.15.45:0/2381220337 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0000c1a0 con 0x7efc00003b10 2023-10-03T19:13:06.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc137fe640 1 --2- 172.21.15.45:0/2381220337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc000047d0 0x7efc00004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:06.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc13fff640 1 --2- 172.21.15.45:0/2381220337 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc00003b10 0x7efc00003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:06.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc18869640 1 --2- 172.21.15.45:0/2381220337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc00005180 0x7efc0000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:06.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc137fe640 1 -- 172.21.15.45:0/2381220337 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc00003b10 msgr2=0x7efc00003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:06.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc137fe640 1 --2- 172.21.15.45:0/2381220337 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc00003b10 0x7efc00003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc137fe640 1 -- 172.21.15.45:0/2381220337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc00005180 msgr2=0x7efc0000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:06.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc137fe640 1 --2- 172.21.15.45:0/2381220337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc00005180 0x7efc0000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc137fe640 1 -- 172.21.15.45:0/2381220337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc00003530 con 0x7efc000047d0 2023-10-03T19:13:06.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc18869640 1 --2- 172.21.15.45:0/2381220337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc00005180 0x7efc0000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:13:06.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.744+0000 7efc18869640 1 -- 172.21.15.45:0/2381220337 reap_dead start 2023-10-03T19:13:06.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc137fe640 1 --2- 172.21.15.45:0/2381220337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc000047d0 0x7efc00004c40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7efbfc009ae0 tx=0x7efbfc01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ebf86c705557dc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:06.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc12ffd640 1 -- 172.21.15.45:0/2381220337 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc0a5560 con 0x7efc000047d0 2023-10-03T19:13:06.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc12ffd640 1 -- 172.21.15.45:0/2381220337 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbfc0a56c0 con 0x7efc000047d0 2023-10-03T19:13:06.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc12ffd640 1 -- 172.21.15.45:0/2381220337 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc0a5a70 con 0x7efc000047d0 2023-10-03T19:13:06.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc1a2cc640 1 -- 172.21.15.45:0/2381220337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc000047d0 msgr2=0x7efc00004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:06.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc1a2cc640 1 --2- 172.21.15.45:0/2381220337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc000047d0 0x7efc00004c40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7efbfc009ae0 tx=0x7efbfc01ca50 comp rx=0 tx=0).stop 2023-10-03T19:13:06.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc1a2cc640 1 -- 172.21.15.45:0/2381220337 shutdown_connections 2023-10-03T19:13:06.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc1a2cc640 1 --2- 172.21.15.45:0/2381220337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc000047d0 0x7efc00004c40 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc1a2cc640 1 -- 172.21.15.45:0/2381220337 >> 172.21.15.45:0/2381220337 conn(0x7efc140a20d0 msgr2=0x7efc140a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:06.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc1a2cc640 1 -- 172.21.15.45:0/2381220337 shutdown_connections 2023-10-03T19:13:06.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc1a2cc640 1 -- 172.21.15.45:0/2381220337 wait complete. 2023-10-03T19:13:06.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc1a2cc640 1 Processor -- start 2023-10-03T19:13:06.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc1a2cc640 1 -- start start 2023-10-03T19:13:06.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc1a2cc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc000047d0 0x7efc141e68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:06.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc1a2cc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc1414ab70 0x7efc14144810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:06.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc1a2cc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc1414b0a0 0x7efc14070890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:06.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc1a2cc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc14070470 con 0x7efc000047d0 2023-10-03T19:13:06.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc1a2cc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1414bb00 con 0x7efc1414b0a0 2023-10-03T19:13:06.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc1a2cc640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1414a460 con 0x7efc1414ab70 2023-10-03T19:13:06.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc13fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc000047d0 0x7efc141e68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:06.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc13fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc000047d0 0x7efc141e68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46342/0 (socket says 172.21.15.45:46342) 2023-10-03T19:13:06.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc13fff640 1 -- 172.21.15.45:0/1336101552 learned_addr learned my addr 172.21.15.45:0/1336101552 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:06.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc18869640 1 --2- 172.21.15.45:0/1336101552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc1414b0a0 0x7efc14070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:06.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc137fe640 1 --2- 172.21.15.45:0/1336101552 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc1414ab70 0x7efc14144810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:06.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc13fff640 1 -- 172.21.15.45:0/1336101552 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc1414ab70 msgr2=0x7efc14144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:06.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc13fff640 1 --2- 172.21.15.45:0/1336101552 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc1414ab70 0x7efc14144810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc13fff640 1 -- 172.21.15.45:0/1336101552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc1414b0a0 msgr2=0x7efc14070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:06.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc13fff640 1 --2- 172.21.15.45:0/1336101552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc1414b0a0 0x7efc14070890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc13fff640 1 -- 172.21.15.45:0/1336101552 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc14071690 con 0x7efc000047d0 2023-10-03T19:13:06.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc13fff640 1 --2- 172.21.15.45:0/1336101552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc000047d0 0x7efc141e68a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efc0c007a90 tx=0x7efc0c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:06.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc10ff9640 1 -- 172.21.15.45:0/1336101552 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c00eeb0 con 0x7efc000047d0 2023-10-03T19:13:06.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc10ff9640 1 -- 172.21.15.45:0/1336101552 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0c013420 con 0x7efc000047d0 2023-10-03T19:13:06.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc1a2cc640 1 -- 172.21.15.45:0/1336101552 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc1406cf40 con 0x7efc000047d0 2023-10-03T19:13:06.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc10ff9640 1 -- 172.21.15.45:0/1336101552 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c0137b0 con 0x7efc000047d0 2023-10-03T19:13:06.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.748+0000 7efc1a2cc640 1 -- 172.21.15.45:0/1336101552 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc14071820 con 0x7efc000047d0 2023-10-03T19:13:06.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.752+0000 7efc1a2cc640 1 -- 172.21.15.45:0/1336101552 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc14144d50 con 0x7efc000047d0 2023-10-03T19:13:06.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.752+0000 7efc10ff9640 1 -- 172.21.15.45:0/1336101552 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efc0c013910 con 0x7efc000047d0 2023-10-03T19:13:06.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.752+0000 7efc10ff9640 1 --2- 172.21.15.45:0/1336101552 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efbf40662b0 0x7efbf4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:06.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.752+0000 7efc10ff9640 1 -- 172.21.15.45:0/1336101552 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efc0c084490 con 0x7efc000047d0 2023-10-03T19:13:06.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.752+0000 7efc137fe640 1 --2- 172.21.15.45:0/1336101552 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efbf40662b0 0x7efbf4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:06.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.752+0000 7efc137fe640 1 --2- 172.21.15.45:0/1336101552 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efbf40662b0 0x7efbf4068760 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0af000 tx=0x7efbfc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:06.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.756+0000 7efc10ff9640 1 -- 172.21.15.45:0/1336101552 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7efc0c051910 con 0x7efc000047d0 2023-10-03T19:13:06.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.908+0000 7efc1a2cc640 1 -- 172.21.15.45:0/1336101552 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efc1404de80 con 0x7efc000047d0 2023-10-03T19:13:06.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.912+0000 7efc10ff9640 1 -- 172.21.15.45:0/1336101552 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7efc0c054f30 con 0x7efc000047d0 2023-10-03T19:13:06.916 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:13:06.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.912+0000 7efc1a2cc640 1 -- 172.21.15.45:0/1336101552 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efbf40662b0 msgr2=0x7efbf4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:06.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.912+0000 7efc1a2cc640 1 --2- 172.21.15.45:0/1336101552 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efbf40662b0 0x7efbf4068760 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0af000 tx=0x7efbfc008040 comp rx=0 tx=0).stop 2023-10-03T19:13:06.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.912+0000 7efc1a2cc640 1 -- 172.21.15.45:0/1336101552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc000047d0 msgr2=0x7efc141e68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:06.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.912+0000 7efc1a2cc640 1 --2- 172.21.15.45:0/1336101552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc000047d0 0x7efc141e68a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efc0c007a90 tx=0x7efc0c00e530 comp rx=0 tx=0).stop 2023-10-03T19:13:06.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.912+0000 7efc1a2cc640 1 -- 172.21.15.45:0/1336101552 shutdown_connections 2023-10-03T19:13:06.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.912+0000 7efc1a2cc640 1 --2- 172.21.15.45:0/1336101552 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efbf40662b0 0x7efbf4068760 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.912+0000 7efc1a2cc640 1 --2- 172.21.15.45:0/1336101552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc1414b0a0 0x7efc14070890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.912+0000 7efc1a2cc640 1 --2- 172.21.15.45:0/1336101552 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc1414ab70 0x7efc14144810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.912+0000 7efc1a2cc640 1 --2- 172.21.15.45:0/1336101552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc000047d0 0x7efc141e68a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:06.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.912+0000 7efc1a2cc640 1 -- 172.21.15.45:0/1336101552 >> 172.21.15.45:0/1336101552 conn(0x7efc140a20d0 msgr2=0x7efc140c0440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:06.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.912+0000 7efc1a2cc640 1 -- 172.21.15.45:0/1336101552 shutdown_connections 2023-10-03T19:13:06.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:06.912+0000 7efc1a2cc640 1 -- 172.21.15.45:0/1336101552 wait complete. 2023-10-03T19:13:06.936 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:13:07.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.064+0000 7f8611151640 1 Processor -- start 2023-10-03T19:13:07.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.064+0000 7f8611151640 1 -- start start 2023-10-03T19:13:07.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.064+0000 7f8611151640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f860c0c14e0 0x7f860c0c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:07.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.064+0000 7f8611151640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f860c0bf1f0 0x7f860c0a9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:07.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.064+0000 7f8611151640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f860c0c2770 0x7f860c0a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:07.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.064+0000 7f8611151640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f860c06ac70 con 0x7f860c0c14e0 2023-10-03T19:13:07.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.064+0000 7f8611151640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f860c0c3000 con 0x7f860c0c2770 2023-10-03T19:13:07.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.064+0000 7f8611151640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860c0aa5f0 con 0x7f860c0bf1f0 2023-10-03T19:13:07.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.064+0000 7f860ad9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f860c0c14e0 0x7f860c0c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:07.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.064+0000 7f860ad9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f860c0c14e0 0x7f860c0c0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46346/0 (socket says 172.21.15.45:46346) 2023-10-03T19:13:07.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.064+0000 7f860ad9d640 1 -- 172.21.15.45:0/2124545946 learned_addr learned my addr 172.21.15.45:0/2124545946 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:07.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.064+0000 7f860a59c640 1 --2- 172.21.15.45:0/2124545946 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f860c0bf1f0 0x7f860c0a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:07.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.064+0000 7f860b59e640 1 --2- 172.21.15.45:0/2124545946 >> v2:172.21.15.79:3300/0 conn(0x7f860c0c2770 0x7f860c0a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:07.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.064+0000 7f860ad9d640 1 -- 172.21.15.45:0/2124545946 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f860c0bf1f0 msgr2=0x7f860c0a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:07.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.064+0000 7f860ad9d640 1 --2- 172.21.15.45:0/2124545946 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f860c0bf1f0 0x7f860c0a9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.064+0000 7f860ad9d640 1 -- 172.21.15.45:0/2124545946 >> v2:172.21.15.79:3300/0 conn(0x7f860c0c2770 msgr2=0x7f860c0a9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:07.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.064+0000 7f860ad9d640 1 --2- 172.21.15.45:0/2124545946 >> v2:172.21.15.79:3300/0 conn(0x7f860c0c2770 0x7f860c0a9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.064+0000 7f860ad9d640 1 -- 172.21.15.45:0/2124545946 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c14f250 con 0x7f860c0c14e0 2023-10-03T19:13:07.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.064+0000 7f860ad9d640 1 --2- 172.21.15.45:0/2124545946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f860c0c14e0 0x7f860c0c0a40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f860c0a7500 tx=0x7f85fc01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b6eab3e0fb528d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:07.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.064+0000 7f8609d9b640 1 -- 172.21.15.45:0/2124545946 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc0a89b0 con 0x7f860c0c14e0 2023-10-03T19:13:07.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.064+0000 7f8609d9b640 1 -- 172.21.15.45:0/2124545946 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85fc0a8b10 con 0x7f860c0c14e0 2023-10-03T19:13:07.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.064+0000 7f8609d9b640 1 -- 172.21.15.45:0/2124545946 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc0a8ea0 con 0x7f860c0c14e0 2023-10-03T19:13:07.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f8611151640 1 -- 172.21.15.45:0/2124545946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f860c0c14e0 msgr2=0x7f860c0c0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:07.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f8611151640 1 --2- 172.21.15.45:0/2124545946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f860c0c14e0 0x7f860c0c0a40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f860c0a7500 tx=0x7f85fc01ecf0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f8611151640 1 -- 172.21.15.45:0/2124545946 shutdown_connections 2023-10-03T19:13:07.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f8611151640 1 --2- 172.21.15.45:0/2124545946 >> v2:172.21.15.79:3300/0 conn(0x7f860c0c2770 0x7f860c0a9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f8611151640 1 --2- 172.21.15.45:0/2124545946 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f860c0bf1f0 0x7f860c0a9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f8611151640 1 --2- 172.21.15.45:0/2124545946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f860c0c14e0 0x7f860c0c0a40 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f8611151640 1 -- 172.21.15.45:0/2124545946 >> 172.21.15.45:0/2124545946 conn(0x7f860c0a6440 msgr2=0x7f860c0a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:07.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f8611151640 1 -- 172.21.15.45:0/2124545946 shutdown_connections 2023-10-03T19:13:07.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f8611151640 1 -- 172.21.15.45:0/2124545946 wait complete. 2023-10-03T19:13:07.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f8611151640 1 Processor -- start 2023-10-03T19:13:07.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f8611151640 1 -- start start 2023-10-03T19:13:07.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f8611151640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f860c0bf1f0 0x7f860c0bdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:07.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f8611151640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f860c0c14e0 0x7f860c14b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:07.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f8611151640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f860c0c2770 0x7f860c14bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:07.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f8611151640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c09a4a0 con 0x7f860c0c2770 2023-10-03T19:13:07.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f8611151640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c0be2b0 con 0x7f860c0c14e0 2023-10-03T19:13:07.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f8611151640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860c09a0f0 con 0x7f860c0bf1f0 2023-10-03T19:13:07.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f860b59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f860c0c2770 0x7f860c14bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:07.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f860b59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f860c0c2770 0x7f860c14bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46356/0 (socket says 172.21.15.45:46356) 2023-10-03T19:13:07.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f860b59e640 1 -- 172.21.15.45:0/1099188930 learned_addr learned my addr 172.21.15.45:0/1099188930 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:07.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f860ad9d640 1 --2- 172.21.15.45:0/1099188930 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f860c0bf1f0 0x7f860c0bdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:07.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f860a59c640 1 --2- 172.21.15.45:0/1099188930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f860c0c14e0 0x7f860c14b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:07.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f860b59e640 1 -- 172.21.15.45:0/1099188930 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f860c0bf1f0 msgr2=0x7f860c0bdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:07.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f860b59e640 1 --2- 172.21.15.45:0/1099188930 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f860c0bf1f0 0x7f860c0bdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f860b59e640 1 -- 172.21.15.45:0/1099188930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f860c0c14e0 msgr2=0x7f860c14b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:07.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f860b59e640 1 --2- 172.21.15.45:0/1099188930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f860c0c14e0 0x7f860c14b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f860b59e640 1 -- 172.21.15.45:0/1099188930 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85fc0094d0 con 0x7f860c0c2770 2023-10-03T19:13:07.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f860b59e640 1 --2- 172.21.15.45:0/1099188930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f860c0c2770 0x7f860c14bb50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8604007d80 tx=0x7f860400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:07.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f85f37fe640 1 -- 172.21.15.45:0/1099188930 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8604014420 con 0x7f860c0c2770 2023-10-03T19:13:07.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f85f37fe640 1 -- 172.21.15.45:0/1099188930 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8604014580 con 0x7f860c0c2770 2023-10-03T19:13:07.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f8611151640 1 -- 172.21.15.45:0/1099188930 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f860c06b100 con 0x7f860c0c2770 2023-10-03T19:13:07.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f85f37fe640 1 -- 172.21.15.45:0/1099188930 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8604014930 con 0x7f860c0c2770 2023-10-03T19:13:07.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.068+0000 7f8611151640 1 -- 172.21.15.45:0/1099188930 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f860c14f530 con 0x7f860c0c2770 2023-10-03T19:13:07.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.072+0000 7f8611151640 1 -- 172.21.15.45:0/1099188930 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f860c0aa2e0 con 0x7f860c0c2770 2023-10-03T19:13:07.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.072+0000 7f85f37fe640 1 -- 172.21.15.45:0/1099188930 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8604014a90 con 0x7f860c0c2770 2023-10-03T19:13:07.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.072+0000 7f85f37fe640 1 --2- 172.21.15.45:0/1099188930 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f85f8066280 0x7f85f8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:07.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.072+0000 7f85f37fe640 1 -- 172.21.15.45:0/1099188930 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8604084650 con 0x7f860c0c2770 2023-10-03T19:13:07.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.072+0000 7f860ad9d640 1 --2- 172.21.15.45:0/1099188930 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f85f8066280 0x7f85f8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:07.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.072+0000 7f860ad9d640 1 --2- 172.21.15.45:0/1099188930 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f85f8066280 0x7f85f8068730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0b2000 tx=0x7f85fc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:07.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.076+0000 7f85f37fe640 1 -- 172.21.15.45:0/1099188930 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8604055560 con 0x7f860c0c2770 2023-10-03T19:13:07.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.232+0000 7f8611151640 1 -- 172.21.15.45:0/1099188930 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f860c04de80 con 0x7f860c0c2770 2023-10-03T19:13:07.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.232+0000 7f85f37fe640 1 -- 172.21.15.45:0/1099188930 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f86040550f0 con 0x7f860c0c2770 2023-10-03T19:13:07.238 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:13:07.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.236+0000 7f8611151640 1 -- 172.21.15.45:0/1099188930 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f85f8066280 msgr2=0x7f85f8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:07.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.236+0000 7f8611151640 1 --2- 172.21.15.45:0/1099188930 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f85f8066280 0x7f85f8068730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0b2000 tx=0x7f85fc008040 comp rx=0 tx=0).stop 2023-10-03T19:13:07.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.236+0000 7f8611151640 1 -- 172.21.15.45:0/1099188930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f860c0c2770 msgr2=0x7f860c14bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:07.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.236+0000 7f8611151640 1 --2- 172.21.15.45:0/1099188930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f860c0c2770 0x7f860c14bb50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8604007d80 tx=0x7f860400e4b0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.236+0000 7f8611151640 1 -- 172.21.15.45:0/1099188930 shutdown_connections 2023-10-03T19:13:07.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.236+0000 7f8611151640 1 --2- 172.21.15.45:0/1099188930 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f85f8066280 0x7f85f8068730 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.236+0000 7f8611151640 1 --2- 172.21.15.45:0/1099188930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f860c0c2770 0x7f860c14bb50 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.236+0000 7f8611151640 1 --2- 172.21.15.45:0/1099188930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f860c0c14e0 0x7f860c14b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.236+0000 7f8611151640 1 --2- 172.21.15.45:0/1099188930 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f860c0bf1f0 0x7f860c0bdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.236+0000 7f8611151640 1 -- 172.21.15.45:0/1099188930 >> 172.21.15.45:0/1099188930 conn(0x7f860c0a6440 msgr2=0x7f860c0c3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:07.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.236+0000 7f8611151640 1 -- 172.21.15.45:0/1099188930 shutdown_connections 2023-10-03T19:13:07.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.236+0000 7f8611151640 1 -- 172.21.15.45:0/1099188930 wait complete. 2023-10-03T19:13:07.257 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T19:13:07.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.384+0000 7f3264649640 1 Processor -- start 2023-10-03T19:13:07.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.384+0000 7f3264649640 1 -- start start 2023-10-03T19:13:07.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.384+0000 7f3264649640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f325c0712c0 0x7f325c0bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:07.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.384+0000 7f3264649640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f325c06c760 0x7f325c0bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:07.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.384+0000 7f3264649640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f325c06c2d0 con 0x7f325c06d560 2023-10-03T19:13:07.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.384+0000 7f3264649640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f325c150610 con 0x7f325c06c760 2023-10-03T19:13:07.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.384+0000 7f3264649640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f325c1508b0 con 0x7f325c0712c0 2023-10-03T19:13:07.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.384+0000 7f3261be4640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f325c06d560 0x7f325c0a53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34772/0 (socket says 172.21.15.45:34772) 2023-10-03T19:13:07.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.384+0000 7f3261be4640 1 -- 172.21.15.45:0/763519322 learned_addr learned my addr 172.21.15.45:0/763519322 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:07.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.384+0000 7f32623e5640 1 --2- 172.21.15.45:0/763519322 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f325c0712c0 0x7f325c0bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:07.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.384+0000 7f3262be6640 1 --2- 172.21.15.45:0/763519322 >> v2:172.21.15.79:3300/0 conn(0x7f325c06c760 0x7f325c0bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:07.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.384+0000 7f32613e3640 1 -- 172.21.15.45:0/763519322 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3888242621 0 0) 0x7f325c06c2d0 con 0x7f325c06d560 2023-10-03T19:13:07.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.384+0000 7f32613e3640 1 -- 172.21.15.45:0/763519322 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3248003530 con 0x7f325c06d560 2023-10-03T19:13:07.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.384+0000 7f32613e3640 1 -- 172.21.15.45:0/763519322 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2556315385 0 0) 0x7f3248003530 con 0x7f325c06d560 2023-10-03T19:13:07.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.384+0000 7f32613e3640 1 -- 172.21.15.45:0/763519322 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f325c0712c0 msgr2=0x7f325c0bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:07.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.384+0000 7f32613e3640 1 --2- 172.21.15.45:0/763519322 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f325c0712c0 0x7f325c0bcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.384+0000 7f32613e3640 1 -- 172.21.15.45:0/763519322 >> v2:172.21.15.79:3300/0 conn(0x7f325c06c760 msgr2=0x7f325c0bd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:07.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.384+0000 7f32613e3640 1 --2- 172.21.15.45:0/763519322 >> v2:172.21.15.79:3300/0 conn(0x7f325c06c760 0x7f325c0bd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.384+0000 7f32613e3640 1 -- 172.21.15.45:0/763519322 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325c06d2e0 con 0x7f325c06d560 2023-10-03T19:13:07.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.384+0000 7f32613e3640 1 -- 172.21.15.45:0/763519322 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f324c001680 con 0x7f325c06d560 2023-10-03T19:13:07.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.384+0000 7f32613e3640 1 -- 172.21.15.45:0/763519322 >> v1:172.21.15.45:6789/0 conn(0x7f325c06d560 legacy=0x7f325c0a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:07.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.384+0000 7f32613e3640 1 --2- 172.21.15.45:0/763519322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3248003980 0x7f3248003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:07.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.388+0000 7f32613e3640 1 --2- 172.21.15.45:0/763519322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32480043b0 0x7f3248004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:07.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.388+0000 7f32613e3640 1 --2- 172.21.15.45:0/763519322 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f325c0712c0 0x7f3248004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:07.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.388+0000 7f32613e3640 1 -- 172.21.15.45:0/763519322 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325c150610 con 0x7f3248003980 2023-10-03T19:13:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.388+0000 7f32613e3640 1 -- 172.21.15.45:0/763519322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325c1508b0 con 0x7f32480043b0 2023-10-03T19:13:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.388+0000 7f32613e3640 1 -- 172.21.15.45:0/763519322 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324800b990 con 0x7f325c0712c0 2023-10-03T19:13:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.388+0000 7f32623e5640 1 --2- 172.21.15.45:0/763519322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3248003980 0x7f3248003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.388+0000 7f3261be4640 1 --2- 172.21.15.45:0/763519322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32480043b0 0x7f3248004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.388+0000 7f3262be6640 1 --2- 172.21.15.45:0/763519322 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f325c0712c0 0x7f3248004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.388+0000 7f32623e5640 1 -- 172.21.15.45:0/763519322 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f325c0712c0 msgr2=0x7f3248004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.388+0000 7f32623e5640 1 --2- 172.21.15.45:0/763519322 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f325c0712c0 0x7f3248004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.388+0000 7f32623e5640 1 -- 172.21.15.45:0/763519322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32480043b0 msgr2=0x7f3248004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.388+0000 7f32623e5640 1 --2- 172.21.15.45:0/763519322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32480043b0 0x7f3248004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.388+0000 7f32623e5640 1 -- 172.21.15.45:0/763519322 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3248003530 con 0x7f3248003980 2023-10-03T19:13:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.388+0000 7f3262be6640 1 --2- 172.21.15.45:0/763519322 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f325c0712c0 0x7f3248004f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:07.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.392+0000 7f32623e5640 1 --2- 172.21.15.45:0/763519322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3248003980 0x7f3248003d90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3258009ae0 tx=0x7f325801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=602227e5444b620c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:07.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.392+0000 7f32613e3640 1 -- 172.21.15.45:0/763519322 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32580a6460 con 0x7f3248003980 2023-10-03T19:13:07.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.392+0000 7f32613e3640 1 -- 172.21.15.45:0/763519322 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32580a65c0 con 0x7f3248003980 2023-10-03T19:13:07.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.392+0000 7f32613e3640 1 -- 172.21.15.45:0/763519322 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32580a6970 con 0x7f3248003980 2023-10-03T19:13:07.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.392+0000 7f3264649640 1 -- 172.21.15.45:0/763519322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3248003980 msgr2=0x7f3248003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:07.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.392+0000 7f3264649640 1 --2- 172.21.15.45:0/763519322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3248003980 0x7f3248003d90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3258009ae0 tx=0x7f325801ca50 comp rx=0 tx=0).stop 2023-10-03T19:13:07.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.392+0000 7f3262be6640 1 -- 172.21.15.45:0/763519322 reap_dead start 2023-10-03T19:13:07.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.392+0000 7f3264649640 1 -- 172.21.15.45:0/763519322 shutdown_connections 2023-10-03T19:13:07.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.392+0000 7f3264649640 1 -- 172.21.15.45:0/763519322 >> 172.21.15.45:0/763519322 conn(0x7f325c0a20d0 msgr2=0x7f325c0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:07.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.392+0000 7f3264649640 1 -- 172.21.15.45:0/763519322 shutdown_connections 2023-10-03T19:13:07.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.392+0000 7f3264649640 1 -- 172.21.15.45:0/763519322 wait complete. 2023-10-03T19:13:07.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.392+0000 7f3264649640 1 Processor -- start 2023-10-03T19:13:07.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.392+0000 7f3264649640 1 -- start start 2023-10-03T19:13:07.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.392+0000 7f3264649640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3248003980 0x7f325c1562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:07.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.392+0000 7f3264649640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f325c14ca10 0x7f325c146260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:07.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.392+0000 7f3264649640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f325c1567e0 0x7f325c153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:07.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.392+0000 7f3264649640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325c14c7c0 con 0x7f325c14ca10 2023-10-03T19:13:07.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.392+0000 7f3264649640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325c146ff0 con 0x7f3248003980 2023-10-03T19:13:07.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.392+0000 7f3264649640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f325c146d10 con 0x7f325c1567e0 2023-10-03T19:13:07.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.392+0000 7f3261be4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f325c14ca10 0x7f325c146260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:07.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.392+0000 7f3261be4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f325c14ca10 0x7f325c146260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46374/0 (socket says 172.21.15.45:46374) 2023-10-03T19:13:07.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.392+0000 7f32623e5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3248003980 0x7f325c1562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:07.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.392+0000 7f3261be4640 1 -- 172.21.15.45:0/2126620380 learned_addr learned my addr 172.21.15.45:0/2126620380 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:07.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.392+0000 7f3262be6640 1 --2- 172.21.15.45:0/2126620380 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f325c1567e0 0x7f325c153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:07.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.396+0000 7f3261be4640 1 -- 172.21.15.45:0/2126620380 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f325c1567e0 msgr2=0x7f325c153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:07.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.396+0000 7f3261be4640 1 --2- 172.21.15.45:0/2126620380 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f325c1567e0 0x7f325c153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.396+0000 7f3261be4640 1 -- 172.21.15.45:0/2126620380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3248003980 msgr2=0x7f325c1562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:07.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.396+0000 7f3261be4640 1 --2- 172.21.15.45:0/2126620380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3248003980 0x7f325c1562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.396+0000 7f3261be4640 1 -- 172.21.15.45:0/2126620380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325c0a6070 con 0x7f325c14ca10 2023-10-03T19:13:07.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.396+0000 7f3261be4640 1 --2- 172.21.15.45:0/2126620380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f325c14ca10 0x7f325c146260 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f324c00e800 tx=0x7f324c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:07.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.396+0000 7f3252ffd640 1 -- 172.21.15.45:0/2126620380 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c00c5c0 con 0x7f325c14ca10 2023-10-03T19:13:07.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.396+0000 7f3252ffd640 1 -- 172.21.15.45:0/2126620380 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324c00c740 con 0x7f325c14ca10 2023-10-03T19:13:07.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.396+0000 7f3264649640 1 -- 172.21.15.45:0/2126620380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f325c0a5ee0 con 0x7f325c14ca10 2023-10-03T19:13:07.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.396+0000 7f3252ffd640 1 -- 172.21.15.45:0/2126620380 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c00caf0 con 0x7f325c14ca10 2023-10-03T19:13:07.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.396+0000 7f3264649640 1 -- 172.21.15.45:0/2126620380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f325c1576e0 con 0x7f325c14ca10 2023-10-03T19:13:07.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.396+0000 7f3264649640 1 -- 172.21.15.45:0/2126620380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f325c1e5a00 con 0x7f325c14ca10 2023-10-03T19:13:07.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.396+0000 7f3252ffd640 1 -- 172.21.15.45:0/2126620380 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f324c00cc50 con 0x7f325c14ca10 2023-10-03T19:13:07.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.396+0000 7f3252ffd640 1 --2- 172.21.15.45:0/2126620380 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f32400662b0 0x7f3240068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:07.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.396+0000 7f3252ffd640 1 -- 172.21.15.45:0/2126620380 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f324c083970 con 0x7f325c14ca10 2023-10-03T19:13:07.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.396+0000 7f32623e5640 1 --2- 172.21.15.45:0/2126620380 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f32400662b0 0x7f3240068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:07.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.396+0000 7f32623e5640 1 --2- 172.21.15.45:0/2126620380 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f32400662b0 0x7f3240068760 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f32580ad000 tx=0x7f32580046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:07.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.400+0000 7f3252ffd640 1 -- 172.21.15.45:0/2126620380 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f324c050f30 con 0x7f325c14ca10 2023-10-03T19:13:07.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.552+0000 7f3264649640 1 -- 172.21.15.45:0/2126620380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f325c04de80 con 0x7f325c14ca10 2023-10-03T19:13:07.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.556+0000 7f3252ffd640 1 -- 172.21.15.45:0/2126620380 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f324c054550 con 0x7f325c14ca10 2023-10-03T19:13:07.560 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-03T19:13:07.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.556+0000 7f3264649640 1 -- 172.21.15.45:0/2126620380 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f32400662b0 msgr2=0x7f3240068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:07.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.556+0000 7f3264649640 1 --2- 172.21.15.45:0/2126620380 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f32400662b0 0x7f3240068760 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f32580ad000 tx=0x7f32580046d0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.556+0000 7f3264649640 1 -- 172.21.15.45:0/2126620380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f325c14ca10 msgr2=0x7f325c146260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:07.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.556+0000 7f3264649640 1 --2- 172.21.15.45:0/2126620380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f325c14ca10 0x7f325c146260 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f324c00e800 tx=0x7f324c00ecc0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.556+0000 7f3264649640 1 -- 172.21.15.45:0/2126620380 shutdown_connections 2023-10-03T19:13:07.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.556+0000 7f3264649640 1 --2- 172.21.15.45:0/2126620380 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f32400662b0 0x7f3240068760 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.556+0000 7f3264649640 1 --2- 172.21.15.45:0/2126620380 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f325c1567e0 0x7f325c153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.556+0000 7f3264649640 1 --2- 172.21.15.45:0/2126620380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f325c14ca10 0x7f325c146260 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.556+0000 7f3264649640 1 --2- 172.21.15.45:0/2126620380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3248003980 0x7f325c1562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.556+0000 7f3264649640 1 -- 172.21.15.45:0/2126620380 >> 172.21.15.45:0/2126620380 conn(0x7f325c0a20d0 msgr2=0x7f325c0bfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:07.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.556+0000 7f3264649640 1 -- 172.21.15.45:0/2126620380 shutdown_connections 2023-10-03T19:13:07.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.556+0000 7f3264649640 1 -- 172.21.15.45:0/2126620380 wait complete. 2023-10-03T19:13:07.580 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T19:13:07.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.696+0000 7f4138e3b640 1 Processor -- start 2023-10-03T19:13:07.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.696+0000 7f4138e3b640 1 -- start start 2023-10-03T19:13:07.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f4138e3b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4134152ec0 0x7f4134069ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:07.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f4138e3b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f413406b560 con 0x7f41340bd860 2023-10-03T19:13:07.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f4138e3b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41340bfc90 con 0x7f41340bcff0 2023-10-03T19:13:07.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f4138e3b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41340beb70 con 0x7f4134152ec0 2023-10-03T19:13:07.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f413259c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f41340bd860 0x7f41341527b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34778/0 (socket says 172.21.15.45:34778) 2023-10-03T19:13:07.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f413259c640 1 -- 172.21.15.45:0/841221031 learned_addr learned my addr 172.21.15.45:0/841221031 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:07.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f4131d9b640 1 --2- 172.21.15.45:0/841221031 >> v2:172.21.15.79:3300/0 conn(0x7f4134152ec0 0x7f4134069ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:07.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f413159a640 1 -- 172.21.15.45:0/841221031 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3150870103 0 0) 0x7f413406b560 con 0x7f41340bd860 2023-10-03T19:13:07.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f413159a640 1 -- 172.21.15.45:0/841221031 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4120003530 con 0x7f41340bd860 2023-10-03T19:13:07.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f413159a640 1 -- 172.21.15.45:0/841221031 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 325157595 0 0) 0x7f4120003530 con 0x7f41340bd860 2023-10-03T19:13:07.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f413159a640 1 -- 172.21.15.45:0/841221031 >> v2:172.21.15.79:3300/0 conn(0x7f4134152ec0 msgr2=0x7f4134069ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:07.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f413159a640 1 --2- 172.21.15.45:0/841221031 >> v2:172.21.15.79:3300/0 conn(0x7f4134152ec0 0x7f4134069ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f413159a640 1 -- 172.21.15.45:0/841221031 >> v1:172.21.15.79:6789/0 conn(0x7f41340bcff0 legacy=0x7f413406a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:07.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f413159a640 1 -- 172.21.15.45:0/841221031 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41340a8340 con 0x7f41340bd860 2023-10-03T19:13:07.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f413159a640 1 -- 172.21.15.45:0/841221031 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f4124001800 con 0x7f41340bd860 2023-10-03T19:13:07.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f413159a640 1 -- 172.21.15.45:0/841221031 >> v1:172.21.15.45:6789/0 conn(0x7f41340bd860 legacy=0x7f41341527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:07.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f413159a640 1 --2- 172.21.15.45:0/841221031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4120003980 0x7f4120003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:07.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f413159a640 1 --2- 172.21.15.45:0/841221031 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f41200047d0 0x7f4120004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:07.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f413159a640 1 --2- 172.21.15.45:0/841221031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4120005180 0x7f412000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:07.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f413159a640 1 -- 172.21.15.45:0/841221031 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41340beb70 con 0x7f4120005180 2023-10-03T19:13:07.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f413159a640 1 -- 172.21.15.45:0/841221031 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412000c000 con 0x7f4120003980 2023-10-03T19:13:07.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f413159a640 1 -- 172.21.15.45:0/841221031 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f412000c1c0 con 0x7f41200047d0 2023-10-03T19:13:07.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f4132d9d640 1 --2- 172.21.15.45:0/841221031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4120005180 0x7f412000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:07.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f413259c640 1 --2- 172.21.15.45:0/841221031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4120003980 0x7f4120003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:07.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f4131d9b640 1 --2- 172.21.15.45:0/841221031 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f41200047d0 0x7f4120004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:07.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f4132d9d640 1 -- 172.21.15.45:0/841221031 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f41200047d0 msgr2=0x7f4120004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:07.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f4132d9d640 1 --2- 172.21.15.45:0/841221031 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f41200047d0 0x7f4120004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f4132d9d640 1 -- 172.21.15.45:0/841221031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4120003980 msgr2=0x7f4120003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:07.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f4132d9d640 1 --2- 172.21.15.45:0/841221031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4120003980 0x7f4120003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f4132d9d640 1 -- 172.21.15.45:0/841221031 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4120003530 con 0x7f4120005180 2023-10-03T19:13:07.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.700+0000 7f413259c640 1 --2- 172.21.15.45:0/841221031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4120003980 0x7f4120003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:13:07.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f4132d9d640 1 -- 172.21.15.45:0/841221031 reap_dead start 2023-10-03T19:13:07.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f4132d9d640 1 --2- 172.21.15.45:0/841221031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4120005180 0x7f412000b990 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f412c001e40 tx=0x7f412c01c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7118e761ef9bc495 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:07.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f413159a640 1 -- 172.21.15.45:0/841221031 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c003b80 con 0x7f4120005180 2023-10-03T19:13:07.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f413159a640 1 -- 172.21.15.45:0/841221031 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412c003ce0 con 0x7f4120005180 2023-10-03T19:13:07.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f413159a640 1 -- 172.21.15.45:0/841221031 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c005260 con 0x7f4120005180 2023-10-03T19:13:07.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f4138e3b640 1 -- 172.21.15.45:0/841221031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4120005180 msgr2=0x7f412000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:07.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f4138e3b640 1 --2- 172.21.15.45:0/841221031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4120005180 0x7f412000b990 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f412c001e40 tx=0x7f412c01c740 comp rx=0 tx=0).stop 2023-10-03T19:13:07.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f4138e3b640 1 -- 172.21.15.45:0/841221031 shutdown_connections 2023-10-03T19:13:07.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f4138e3b640 1 --2- 172.21.15.45:0/841221031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4120005180 0x7f412000b990 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f4138e3b640 1 -- 172.21.15.45:0/841221031 >> 172.21.15.45:0/841221031 conn(0x7f4134071060 msgr2=0x7f4134071460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:07.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f4138e3b640 1 -- 172.21.15.45:0/841221031 shutdown_connections 2023-10-03T19:13:07.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f4138e3b640 1 -- 172.21.15.45:0/841221031 wait complete. 2023-10-03T19:13:07.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f4138e3b640 1 Processor -- start 2023-10-03T19:13:07.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f4138e3b640 1 -- start start 2023-10-03T19:13:07.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f4138e3b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4120005180 0x7f41340bb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:07.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f4138e3b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41340bbac0 0x7f41340a7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:07.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f4138e3b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41340a77b0 0x7f41341e6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:07.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f4138e3b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413406b8d0 con 0x7f41340bbac0 2023-10-03T19:13:07.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f4138e3b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41340b79b0 con 0x7f41340a77b0 2023-10-03T19:13:07.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f4138e3b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4134146870 con 0x7f4120005180 2023-10-03T19:13:07.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f4131d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41340bbac0 0x7f41340a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:07.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f4131d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41340bbac0 0x7f41340a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46390/0 (socket says 172.21.15.45:46390) 2023-10-03T19:13:07.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f4131d9b640 1 -- 172.21.15.45:0/1406134490 learned_addr learned my addr 172.21.15.45:0/1406134490 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:07.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f413259c640 1 --2- 172.21.15.45:0/1406134490 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4120005180 0x7f41340bb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:07.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f4132d9d640 1 --2- 172.21.15.45:0/1406134490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41340a77b0 0x7f41341e6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:07.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f4131d9b640 1 -- 172.21.15.45:0/1406134490 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4120005180 msgr2=0x7f41340bb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:07.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f4131d9b640 1 --2- 172.21.15.45:0/1406134490 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4120005180 0x7f41340bb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f4131d9b640 1 -- 172.21.15.45:0/1406134490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41340a77b0 msgr2=0x7f41341e6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:07.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f4131d9b640 1 --2- 172.21.15.45:0/1406134490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41340a77b0 0x7f41341e6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f4131d9b640 1 -- 172.21.15.45:0/1406134490 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41340be800 con 0x7f41340bbac0 2023-10-03T19:13:07.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f4131d9b640 1 --2- 172.21.15.45:0/1406134490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41340bbac0 0x7f41340a7270 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f411c011560 tx=0x7f411c011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:07.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f412affd640 1 -- 172.21.15.45:0/1406134490 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c015930 con 0x7f41340bbac0 2023-10-03T19:13:07.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.704+0000 7f412affd640 1 -- 172.21.15.45:0/1406134490 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411c015a90 con 0x7f41340bbac0 2023-10-03T19:13:07.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.708+0000 7f4138e3b640 1 -- 172.21.15.45:0/1406134490 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41341521a0 con 0x7f41340bbac0 2023-10-03T19:13:07.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.708+0000 7f412affd640 1 -- 172.21.15.45:0/1406134490 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c015e20 con 0x7f41340bbac0 2023-10-03T19:13:07.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.708+0000 7f4138e3b640 1 -- 172.21.15.45:0/1406134490 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4134071b70 con 0x7f41340bbac0 2023-10-03T19:13:07.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.708+0000 7f4138e3b640 1 -- 172.21.15.45:0/1406134490 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f413404de80 con 0x7f41340bbac0 2023-10-03T19:13:07.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.708+0000 7f412affd640 1 -- 172.21.15.45:0/1406134490 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f411c00f460 con 0x7f41340bbac0 2023-10-03T19:13:07.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.708+0000 7f412affd640 1 --2- 172.21.15.45:0/1406134490 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4114066280 0x7f4114068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:07.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.708+0000 7f412affd640 1 -- 172.21.15.45:0/1406134490 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f411c084530 con 0x7f41340bbac0 2023-10-03T19:13:07.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.708+0000 7f413259c640 1 --2- 172.21.15.45:0/1406134490 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4114066280 0x7f4114068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:07.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.708+0000 7f413259c640 1 --2- 172.21.15.45:0/1406134490 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4114066280 0x7f4114068730 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4124001390 tx=0x7f4124009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:07.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.712+0000 7f412affd640 1 -- 172.21.15.45:0/1406134490 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f411c051a40 con 0x7f41340bbac0 2023-10-03T19:13:07.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.868+0000 7f4138e3b640 1 -- 172.21.15.45:0/1406134490 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f41340b5af0 con 0x7f41340bbac0 2023-10-03T19:13:07.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.868+0000 7f412affd640 1 -- 172.21.15.45:0/1406134490 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f411c055060 con 0x7f41340bbac0 2023-10-03T19:13:07.874 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-03T19:13:07.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.868+0000 7f4138e3b640 1 -- 172.21.15.45:0/1406134490 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4114066280 msgr2=0x7f4114068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:07.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.868+0000 7f4138e3b640 1 --2- 172.21.15.45:0/1406134490 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4114066280 0x7f4114068730 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4124001390 tx=0x7f4124009040 comp rx=0 tx=0).stop 2023-10-03T19:13:07.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.868+0000 7f4138e3b640 1 -- 172.21.15.45:0/1406134490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41340bbac0 msgr2=0x7f41340a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:07.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.868+0000 7f4138e3b640 1 --2- 172.21.15.45:0/1406134490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41340bbac0 0x7f41340a7270 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f411c011560 tx=0x7f411c011a20 comp rx=0 tx=0).stop 2023-10-03T19:13:07.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.868+0000 7f4138e3b640 1 -- 172.21.15.45:0/1406134490 shutdown_connections 2023-10-03T19:13:07.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.868+0000 7f4138e3b640 1 --2- 172.21.15.45:0/1406134490 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4114066280 0x7f4114068730 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.868+0000 7f4138e3b640 1 --2- 172.21.15.45:0/1406134490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41340a77b0 0x7f41341e6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.868+0000 7f4138e3b640 1 --2- 172.21.15.45:0/1406134490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41340bbac0 0x7f41340a7270 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.868+0000 7f4138e3b640 1 --2- 172.21.15.45:0/1406134490 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4120005180 0x7f41340bb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:07.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.872+0000 7f4138e3b640 1 -- 172.21.15.45:0/1406134490 >> 172.21.15.45:0/1406134490 conn(0x7f4134071060 msgr2=0x7f41340c0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:07.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.872+0000 7f4138e3b640 1 -- 172.21.15.45:0/1406134490 shutdown_connections 2023-10-03T19:13:07.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:07.872+0000 7f4138e3b640 1 -- 172.21.15.45:0/1406134490 wait complete. 2023-10-03T19:13:07.892 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:13:08.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d1ef72640 1 Processor -- start 2023-10-03T19:13:08.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d1ef72640 1 -- start start 2023-10-03T19:13:08.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d1ef72640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1d1814f240 0x7f1d181528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:08.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d1ef72640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d180bb1d0 0x7f1d180c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:08.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d1ef72640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d1806b2d0 con 0x7f1d180c2790 2023-10-03T19:13:08.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d1ef72640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d1806b640 con 0x7f1d1814f240 2023-10-03T19:13:08.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d1ef72640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d180a3c60 con 0x7f1d180bb1d0 2023-10-03T19:13:08.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d17fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1d180c2790 0x7f1d180c0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34790/0 (socket says 172.21.15.45:34790) 2023-10-03T19:13:08.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d17fff640 1 -- 172.21.15.45:0/893867367 learned_addr learned my addr 172.21.15.45:0/893867367 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:08.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d1cd0e640 1 --2- 172.21.15.45:0/893867367 >> v2:172.21.15.79:3300/0 conn(0x7f1d1814f240 0x7f1d181528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:08.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d1d50f640 1 --2- 172.21.15.45:0/893867367 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d180bb1d0 0x7f1d180c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:08.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d177fe640 1 -- 172.21.15.45:0/893867367 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 374024380 0 0) 0x7f1d1806b2d0 con 0x7f1d180c2790 2023-10-03T19:13:08.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d177fe640 1 -- 172.21.15.45:0/893867367 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d04003530 con 0x7f1d180c2790 2023-10-03T19:13:08.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d177fe640 1 -- 172.21.15.45:0/893867367 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3299389560 0 0) 0x7f1d04003530 con 0x7f1d180c2790 2023-10-03T19:13:08.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d177fe640 1 -- 172.21.15.45:0/893867367 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d180bb1d0 msgr2=0x7f1d180c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:08.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d177fe640 1 --2- 172.21.15.45:0/893867367 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d180bb1d0 0x7f1d180c12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d177fe640 1 -- 172.21.15.45:0/893867367 >> v2:172.21.15.79:3300/0 conn(0x7f1d1814f240 msgr2=0x7f1d181528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:08.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d177fe640 1 --2- 172.21.15.45:0/893867367 >> v2:172.21.15.79:3300/0 conn(0x7f1d1814f240 0x7f1d181528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d177fe640 1 -- 172.21.15.45:0/893867367 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1814e740 con 0x7f1d180c2790 2023-10-03T19:13:08.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d177fe640 1 -- 172.21.15.45:0/893867367 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f1d00001800 con 0x7f1d180c2790 2023-10-03T19:13:08.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d177fe640 1 -- 172.21.15.45:0/893867367 >> v1:172.21.15.45:6789/0 conn(0x7f1d180c2790 legacy=0x7f1d180c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:08.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d177fe640 1 --2- 172.21.15.45:0/893867367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d04003980 0x7f1d04003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:08.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d177fe640 1 --2- 172.21.15.45:0/893867367 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d180bb1d0 0x7f1d040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:08.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d177fe640 1 --2- 172.21.15.45:0/893867367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d04004d10 0x7f1d04005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:08.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d177fe640 1 -- 172.21.15.45:0/893867367 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1806b640 con 0x7f1d04003980 2023-10-03T19:13:08.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d177fe640 1 -- 172.21.15.45:0/893867367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d180a3c60 con 0x7f1d04004d10 2023-10-03T19:13:08.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d177fe640 1 -- 172.21.15.45:0/893867367 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0400b9c0 con 0x7f1d180bb1d0 2023-10-03T19:13:08.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d1cd0e640 1 --2- 172.21.15.45:0/893867367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d04003980 0x7f1d04003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:08.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d1d50f640 1 --2- 172.21.15.45:0/893867367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d04004d10 0x7f1d04005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:08.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d17fff640 1 --2- 172.21.15.45:0/893867367 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d180bb1d0 0x7f1d040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:08.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d1cd0e640 1 -- 172.21.15.45:0/893867367 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d180bb1d0 msgr2=0x7f1d040047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:08.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d1cd0e640 1 --2- 172.21.15.45:0/893867367 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d180bb1d0 0x7f1d040047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d1cd0e640 1 -- 172.21.15.45:0/893867367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d04004d10 msgr2=0x7f1d04005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:08.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d1cd0e640 1 --2- 172.21.15.45:0/893867367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d04004d10 0x7f1d04005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.016+0000 7f1d1cd0e640 1 -- 172.21.15.45:0/893867367 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d04003530 con 0x7f1d04003980 2023-10-03T19:13:08.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.020+0000 7f1d1cd0e640 1 --2- 172.21.15.45:0/893867367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d04003980 0x7f1d04003d90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1d08009ac0 tx=0x7f1d0801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a626e532ee8a115d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:08.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.020+0000 7f1d177fe640 1 -- 172.21.15.45:0/893867367 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d080059a0 con 0x7f1d04003980 2023-10-03T19:13:08.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.020+0000 7f1d177fe640 1 -- 172.21.15.45:0/893867367 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d08005b00 con 0x7f1d04003980 2023-10-03T19:13:08.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.020+0000 7f1d177fe640 1 -- 172.21.15.45:0/893867367 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d080a5630 con 0x7f1d04003980 2023-10-03T19:13:08.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.020+0000 7f1d1ef72640 1 -- 172.21.15.45:0/893867367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d04003980 msgr2=0x7f1d04003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:08.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.020+0000 7f1d1ef72640 1 --2- 172.21.15.45:0/893867367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d04003980 0x7f1d04003d90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1d08009ac0 tx=0x7f1d0801ca10 comp rx=0 tx=0).stop 2023-10-03T19:13:08.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.020+0000 7f1d1d50f640 1 -- 172.21.15.45:0/893867367 reap_dead start 2023-10-03T19:13:08.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.020+0000 7f1d1ef72640 1 -- 172.21.15.45:0/893867367 shutdown_connections 2023-10-03T19:13:08.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.020+0000 7f1d1ef72640 1 -- 172.21.15.45:0/893867367 >> 172.21.15.45:0/893867367 conn(0x7f1d180a64a0 msgr2=0x7f1d180a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:08.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.020+0000 7f1d1ef72640 1 -- 172.21.15.45:0/893867367 shutdown_connections 2023-10-03T19:13:08.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.020+0000 7f1d1ef72640 1 -- 172.21.15.45:0/893867367 wait complete. 2023-10-03T19:13:08.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.020+0000 7f1d1ef72640 1 Processor -- start 2023-10-03T19:13:08.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.020+0000 7f1d1ef72640 1 -- start start 2023-10-03T19:13:08.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.024+0000 7f1d1ef72640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d04003980 0x7f1d18148d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:08.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.024+0000 7f1d1ef72640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d180bea40 0x7f1d1814a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:08.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.024+0000 7f1d1ef72640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d180a9dc0 0x7f1d180aa230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:08.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.024+0000 7f1d1ef72640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d18149240 con 0x7f1d180bea40 2023-10-03T19:13:08.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.024+0000 7f1d1ef72640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d18147c00 con 0x7f1d04003980 2023-10-03T19:13:08.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.024+0000 7f1d1ef72640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d181e4770 con 0x7f1d180a9dc0 2023-10-03T19:13:08.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.024+0000 7f1d17fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d180bea40 0x7f1d1814a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:08.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.024+0000 7f1d17fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d180bea40 0x7f1d1814a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46406/0 (socket says 172.21.15.45:46406) 2023-10-03T19:13:08.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.024+0000 7f1d17fff640 1 -- 172.21.15.45:0/565188716 learned_addr learned my addr 172.21.15.45:0/565188716 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:08.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.024+0000 7f1d1cd0e640 1 --2- 172.21.15.45:0/565188716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d04003980 0x7f1d18148d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:08.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.024+0000 7f1d1d50f640 1 --2- 172.21.15.45:0/565188716 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d180a9dc0 0x7f1d180aa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:08.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.024+0000 7f1d17fff640 1 -- 172.21.15.45:0/565188716 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d180a9dc0 msgr2=0x7f1d180aa230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:08.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.024+0000 7f1d17fff640 1 --2- 172.21.15.45:0/565188716 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d180a9dc0 0x7f1d180aa230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.024+0000 7f1d17fff640 1 -- 172.21.15.45:0/565188716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d04003980 msgr2=0x7f1d18148d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:08.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.024+0000 7f1d17fff640 1 --2- 172.21.15.45:0/565188716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d04003980 0x7f1d18148d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.024+0000 7f1d17fff640 1 -- 172.21.15.45:0/565188716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1814f610 con 0x7f1d180bea40 2023-10-03T19:13:08.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.024+0000 7f1d1d50f640 1 --2- 172.21.15.45:0/565188716 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d180a9dc0 0x7f1d180aa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:08.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.024+0000 7f1d17fff640 1 --2- 172.21.15.45:0/565188716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d180bea40 0x7f1d1814a0e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000f420 tx=0x7f1d0000f8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:08.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.024+0000 7f1d157fa640 1 -- 172.21.15.45:0/565188716 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d00014630 con 0x7f1d180bea40 2023-10-03T19:13:08.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.024+0000 7f1d157fa640 1 -- 172.21.15.45:0/565188716 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d00014790 con 0x7f1d180bea40 2023-10-03T19:13:08.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.024+0000 7f1d1ef72640 1 -- 172.21.15.45:0/565188716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d180a3f40 con 0x7f1d180bea40 2023-10-03T19:13:08.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.024+0000 7f1d157fa640 1 -- 172.21.15.45:0/565188716 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d00014b40 con 0x7f1d180bea40 2023-10-03T19:13:08.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.024+0000 7f1d1ef72640 1 -- 172.21.15.45:0/565188716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d180bf360 con 0x7f1d180bea40 2023-10-03T19:13:08.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.024+0000 7f1d1ef72640 1 -- 172.21.15.45:0/565188716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d1804de80 con 0x7f1d180bea40 2023-10-03T19:13:08.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.024+0000 7f1d157fa640 1 -- 172.21.15.45:0/565188716 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1d00014ca0 con 0x7f1d180bea40 2023-10-03T19:13:08.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.024+0000 7f1d157fa640 1 --2- 172.21.15.45:0/565188716 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1cf80662b0 0x7f1cf8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:08.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.024+0000 7f1d157fa640 1 -- 172.21.15.45:0/565188716 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1d00086f90 con 0x7f1d180bea40 2023-10-03T19:13:08.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.024+0000 7f1d1cd0e640 1 --2- 172.21.15.45:0/565188716 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1cf80662b0 0x7f1cf8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:08.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.028+0000 7f1d1cd0e640 1 --2- 172.21.15.45:0/565188716 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1cf80662b0 0x7f1cf8068760 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1d080ae000 tx=0x7f1d080046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:08.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.028+0000 7f1d157fa640 1 -- 172.21.15.45:0/565188716 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1d00054580 con 0x7f1d180bea40 2023-10-03T19:13:08.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.220+0000 7f1d1ef72640 1 -- 172.21.15.45:0/565188716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d181e48b0 con 0x7f1d180bea40 2023-10-03T19:13:08.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.220+0000 7f1d157fa640 1 -- 172.21.15.45:0/565188716 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3903 (secure 0 0 0) 0x7f1d00057ba0 con 0x7f1d180bea40 2023-10-03T19:13:08.225 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:13:08.225 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/731286206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":731286206},{"type":"v1","addr":"172.21.15.45:6834","nonce":731286206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/144609891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":144609891},{"type":"v1","addr":"172.21.15.45:6835","nonce":144609891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:12:27.938475+0000","modified":"2023-10-03T19:12:30.957787+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/2693877820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2693877820},{"type":"v1","addr":"172.21.15.79:6835","nonce":2693877820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-03T19:13:08.225 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 7 2023-10-03T19:13:08.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.220+0000 7f1d1ef72640 1 -- 172.21.15.45:0/565188716 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1cf80662b0 msgr2=0x7f1cf8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:08.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.220+0000 7f1d1ef72640 1 --2- 172.21.15.45:0/565188716 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1cf80662b0 0x7f1cf8068760 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1d080ae000 tx=0x7f1d080046d0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.220+0000 7f1d1ef72640 1 -- 172.21.15.45:0/565188716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d180bea40 msgr2=0x7f1d1814a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:08.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.220+0000 7f1d1ef72640 1 --2- 172.21.15.45:0/565188716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d180bea40 0x7f1d1814a0e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000f420 tx=0x7f1d0000f8e0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.220+0000 7f1d1ef72640 1 -- 172.21.15.45:0/565188716 shutdown_connections 2023-10-03T19:13:08.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.220+0000 7f1d1ef72640 1 --2- 172.21.15.45:0/565188716 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1cf80662b0 0x7f1cf8068760 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.220+0000 7f1d1ef72640 1 --2- 172.21.15.45:0/565188716 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d180a9dc0 0x7f1d180aa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.220+0000 7f1d1ef72640 1 --2- 172.21.15.45:0/565188716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d180bea40 0x7f1d1814a0e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.220+0000 7f1d1ef72640 1 --2- 172.21.15.45:0/565188716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d04003980 0x7f1d18148d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.220+0000 7f1d1ef72640 1 -- 172.21.15.45:0/565188716 >> 172.21.15.45:0/565188716 conn(0x7f1d180a64a0 msgr2=0x7f1d180a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:08.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.220+0000 7f1d1ef72640 1 -- 172.21.15.45:0/565188716 shutdown_connections 2023-10-03T19:13:08.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.220+0000 7f1d1ef72640 1 -- 172.21.15.45:0/565188716 wait complete. 2023-10-03T19:13:08.244 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:13:08.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.352+0000 7fded5191640 1 Processor -- start 2023-10-03T19:13:08.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.352+0000 7fded5191640 1 -- start start 2023-10-03T19:13:08.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.352+0000 7fded5191640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fded006f170 0x7fded0150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:08.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.352+0000 7fded5191640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fded006d170 0x7fded014d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:08.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.352+0000 7fded5191640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded006cac0 con 0x7fded00bc8b0 2023-10-03T19:13:08.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.352+0000 7fded5191640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded00720d0 con 0x7fded006d170 2023-10-03T19:13:08.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.352+0000 7fded5191640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded00a5ab0 con 0x7fded006f170 2023-10-03T19:13:08.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.352+0000 7fdece59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fded00bc8b0 0x7fded014ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34804/0 (socket says 172.21.15.45:34804) 2023-10-03T19:13:08.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.352+0000 7fdece59c640 1 -- 172.21.15.45:0/913083990 learned_addr learned my addr 172.21.15.45:0/913083990 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:08.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.352+0000 7fdecf59e640 1 --2- 172.21.15.45:0/913083990 >> v2:172.21.15.79:3300/0 conn(0x7fded006d170 0x7fded014d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:08.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.352+0000 7fdeced9d640 1 --2- 172.21.15.45:0/913083990 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fded006f170 0x7fded0150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:08.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.356+0000 7fdecf59e640 1 -- 172.21.15.45:0/913083990 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fded006f170 msgr2=0x7fded0150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:08.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.356+0000 7fdecf59e640 1 --2- 172.21.15.45:0/913083990 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fded006f170 0x7fded0150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.356+0000 7fdecf59e640 1 -- 172.21.15.45:0/913083990 >> v1:172.21.15.45:6789/0 conn(0x7fded00bc8b0 legacy=0x7fded014ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:08.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.356+0000 7fdecdd9b640 1 -- 172.21.15.45:0/913083990 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325977357 0 0) 0x7fdeb8001120 con 0x7fded00bc8b0 2023-10-03T19:13:08.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.356+0000 7fdecf59e640 1 -- 172.21.15.45:0/913083990 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded006cd00 con 0x7fded006d170 2023-10-03T19:13:08.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.356+0000 7fdecf59e640 1 --2- 172.21.15.45:0/913083990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fded006d170 0x7fded014d180 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdec00097c0 tx=0x7fdec001c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f0d9805aebace4e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:08.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.356+0000 7fdecdd9b640 1 -- 172.21.15.45:0/913083990 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec00ad640 con 0x7fded006d170 2023-10-03T19:13:08.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.356+0000 7fdecdd9b640 1 -- 172.21.15.45:0/913083990 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec00ad7a0 con 0x7fded006d170 2023-10-03T19:13:08.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.356+0000 7fdecdd9b640 1 -- 172.21.15.45:0/913083990 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec00adb30 con 0x7fded006d170 2023-10-03T19:13:08.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fded5191640 1 -- 172.21.15.45:0/913083990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fded006d170 msgr2=0x7fded014d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:08.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fded5191640 1 --2- 172.21.15.45:0/913083990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fded006d170 0x7fded014d180 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdec00097c0 tx=0x7fdec001c440 comp rx=0 tx=0).stop 2023-10-03T19:13:08.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fded5191640 1 -- 172.21.15.45:0/913083990 shutdown_connections 2023-10-03T19:13:08.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fded5191640 1 --2- 172.21.15.45:0/913083990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fded006d170 0x7fded014d180 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fded5191640 1 --2- 172.21.15.45:0/913083990 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fded006f170 0x7fded0150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fded5191640 1 -- 172.21.15.45:0/913083990 >> 172.21.15.45:0/913083990 conn(0x7fded00bcf50 msgr2=0x7fded00bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:08.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fded5191640 1 -- 172.21.15.45:0/913083990 shutdown_connections 2023-10-03T19:13:08.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fded5191640 1 -- 172.21.15.45:0/913083990 wait complete. 2023-10-03T19:13:08.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fded5191640 1 Processor -- start 2023-10-03T19:13:08.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fded5191640 1 -- start start 2023-10-03T19:13:08.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fded5191640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fded006d170 0x7fded01518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:08.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fded5191640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fded006f170 0x7fded00bef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:08.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fded5191640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fded00bc8b0 0x7fded01e7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:08.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fded5191640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded00b96e0 con 0x7fded006d170 2023-10-03T19:13:08.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fded5191640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded0151e20 con 0x7fded00bc8b0 2023-10-03T19:13:08.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fded5191640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded00b9020 con 0x7fded006f170 2023-10-03T19:13:08.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fdeced9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fded006d170 0x7fded01518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:08.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fdeced9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fded006d170 0x7fded01518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46418/0 (socket says 172.21.15.45:46418) 2023-10-03T19:13:08.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fdeced9d640 1 -- 172.21.15.45:0/2325028182 learned_addr learned my addr 172.21.15.45:0/2325028182 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:08.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fdecf59e640 1 --2- 172.21.15.45:0/2325028182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fded00bc8b0 0x7fded01e7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:08.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fdece59c640 1 --2- 172.21.15.45:0/2325028182 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fded006f170 0x7fded00bef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:08.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fdeced9d640 1 -- 172.21.15.45:0/2325028182 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fded006f170 msgr2=0x7fded00bef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:08.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fdeced9d640 1 --2- 172.21.15.45:0/2325028182 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fded006f170 0x7fded00bef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fdeced9d640 1 -- 172.21.15.45:0/2325028182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fded00bc8b0 msgr2=0x7fded01e7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:08.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fdeced9d640 1 --2- 172.21.15.45:0/2325028182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fded00bc8b0 0x7fded01e7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fdeced9d640 1 -- 172.21.15.45:0/2325028182 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec0009420 con 0x7fded006d170 2023-10-03T19:13:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fdeced9d640 1 --2- 172.21.15.45:0/2325028182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fded006d170 0x7fded01518e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdec8009db0 tx=0x7fdec800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fdec77fe640 1 -- 172.21.15.45:0/2325028182 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec8014480 con 0x7fded006d170 2023-10-03T19:13:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fdec77fe640 1 -- 172.21.15.45:0/2325028182 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec800f040 con 0x7fded006d170 2023-10-03T19:13:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fded5191640 1 -- 172.21.15.45:0/2325028182 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded006f6d0 con 0x7fded006d170 2023-10-03T19:13:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fdec77fe640 1 -- 172.21.15.45:0/2325028182 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec8014800 con 0x7fded006d170 2023-10-03T19:13:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.360+0000 7fded5191640 1 -- 172.21.15.45:0/2325028182 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded006f540 con 0x7fded006d170 2023-10-03T19:13:08.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.364+0000 7fded5191640 1 -- 172.21.15.45:0/2325028182 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded0159670 con 0x7fded006d170 2023-10-03T19:13:08.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.364+0000 7fdec77fe640 1 -- 172.21.15.45:0/2325028182 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdec8014960 con 0x7fded006d170 2023-10-03T19:13:08.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.364+0000 7fdec77fe640 1 --2- 172.21.15.45:0/2325028182 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fdeb0066280 0x7fdeb0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:08.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.364+0000 7fdec77fe640 1 -- 172.21.15.45:0/2325028182 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdec8084c00 con 0x7fded006d170 2023-10-03T19:13:08.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.364+0000 7fdece59c640 1 --2- 172.21.15.45:0/2325028182 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fdeb0066280 0x7fdeb0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:08.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.364+0000 7fdece59c640 1 --2- 172.21.15.45:0/2325028182 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fdeb0066280 0x7fdeb0068730 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8007fd0 tx=0x7fdeb8007a20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:08.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.368+0000 7fdec77fe640 1 -- 172.21.15.45:0/2325028182 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fdec808b080 con 0x7fded006d170 2023-10-03T19:13:08.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.524+0000 7fded5191640 1 -- 172.21.15.45:0/2325028182 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fded006d660 con 0x7fded006d170 2023-10-03T19:13:08.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.528+0000 7fdec77fe640 1 -- 172.21.15.45:0/2325028182 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18231 (secure 0 0 0) 0x7fdec8052080 con 0x7fded006d170 2023-10-03T19:13:08.532 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:13:08.533 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:12:28.941467+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:12:26.226431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T19:12:26.923174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:13:08.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.528+0000 7fded5191640 1 -- 172.21.15.45:0/2325028182 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fdeb0066280 msgr2=0x7fdeb0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:08.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.528+0000 7fded5191640 1 --2- 172.21.15.45:0/2325028182 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fdeb0066280 0x7fdeb0068730 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8007fd0 tx=0x7fdeb8007a20 comp rx=0 tx=0).stop 2023-10-03T19:13:08.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.528+0000 7fded5191640 1 -- 172.21.15.45:0/2325028182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fded006d170 msgr2=0x7fded01518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:08.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.528+0000 7fded5191640 1 --2- 172.21.15.45:0/2325028182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fded006d170 0x7fded01518e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdec8009db0 tx=0x7fdec800c490 comp rx=0 tx=0).stop 2023-10-03T19:13:08.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.528+0000 7fded5191640 1 -- 172.21.15.45:0/2325028182 shutdown_connections 2023-10-03T19:13:08.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.528+0000 7fded5191640 1 --2- 172.21.15.45:0/2325028182 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fdeb0066280 0x7fdeb0068730 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.528+0000 7fded5191640 1 --2- 172.21.15.45:0/2325028182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fded00bc8b0 0x7fded01e7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.528+0000 7fded5191640 1 --2- 172.21.15.45:0/2325028182 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fded006f170 0x7fded00bef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.528+0000 7fded5191640 1 --2- 172.21.15.45:0/2325028182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fded006d170 0x7fded01518e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.528+0000 7fded5191640 1 -- 172.21.15.45:0/2325028182 >> 172.21.15.45:0/2325028182 conn(0x7fded00bcf50 msgr2=0x7fded00c0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:08.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.528+0000 7fded5191640 1 -- 172.21.15.45:0/2325028182 shutdown_connections 2023-10-03T19:13:08.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.528+0000 7fded5191640 1 -- 172.21.15.45:0/2325028182 wait complete. 2023-10-03T19:13:08.552 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-03T19:13:08.552 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:13:08.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf64227640 1 Processor -- start 2023-10-03T19:13:08.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf64227640 1 -- start start 2023-10-03T19:13:08.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf64227640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf5c06f170 0x7fcf5c150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:08.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf64227640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcf5c0bc8b0 0x7fcf5c14ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:08.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf64227640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5c06cac0 con 0x7fcf5c06d170 2023-10-03T19:13:08.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf64227640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5c0720d0 con 0x7fcf5c0bc8b0 2023-10-03T19:13:08.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf64227640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0a5ab0 con 0x7fcf5c06f170 2023-10-03T19:13:08.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf627c4640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fcf5c06d170 0x7fcf5c14cfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34814/0 (socket says 172.21.15.45:34814) 2023-10-03T19:13:08.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf627c4640 1 -- 172.21.15.45:0/1958367685 learned_addr learned my addr 172.21.15.45:0/1958367685 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:08.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf617c2640 1 --2- 172.21.15.45:0/1958367685 >> v2:172.21.15.79:3300/0 conn(0x7fcf5c0bc8b0 0x7fcf5c14ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:08.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf61fc3640 1 --2- 172.21.15.45:0/1958367685 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf5c06f170 0x7fcf5c150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:08.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf60fc1640 1 -- 172.21.15.45:0/1958367685 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 808924848 0 0) 0x7fcf540014a0 con 0x7fcf5c06d170 2023-10-03T19:13:08.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf60fc1640 1 -- 172.21.15.45:0/1958367685 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf48003530 con 0x7fcf5c06d170 2023-10-03T19:13:08.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf60fc1640 1 -- 172.21.15.45:0/1958367685 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3314964351 0 0) 0x7fcf48003530 con 0x7fcf5c06d170 2023-10-03T19:13:08.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf60fc1640 1 -- 172.21.15.45:0/1958367685 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf5c06f170 msgr2=0x7fcf5c150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:08.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf60fc1640 1 --2- 172.21.15.45:0/1958367685 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf5c06f170 0x7fcf5c150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf60fc1640 1 -- 172.21.15.45:0/1958367685 >> v2:172.21.15.79:3300/0 conn(0x7fcf5c0bc8b0 msgr2=0x7fcf5c14ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:08.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf60fc1640 1 --2- 172.21.15.45:0/1958367685 >> v2:172.21.15.79:3300/0 conn(0x7fcf5c0bc8b0 0x7fcf5c14ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf60fc1640 1 -- 172.21.15.45:0/1958367685 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c06cd00 con 0x7fcf5c06d170 2023-10-03T19:13:08.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf60fc1640 1 -- 172.21.15.45:0/1958367685 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fcf54001b90 con 0x7fcf5c06d170 2023-10-03T19:13:08.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf60fc1640 1 -- 172.21.15.45:0/1958367685 >> v1:172.21.15.45:6789/0 conn(0x7fcf5c06d170 legacy=0x7fcf5c14cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:08.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf60fc1640 1 --2- 172.21.15.45:0/1958367685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf48003980 0x7fcf48003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf60fc1640 1 --2- 172.21.15.45:0/1958367685 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf5c06f170 0x7fcf480047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf60fc1640 1 --2- 172.21.15.45:0/1958367685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf48004d10 0x7fcf48005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf60fc1640 1 -- 172.21.15.45:0/1958367685 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0720d0 con 0x7fcf48004d10 2023-10-03T19:13:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf60fc1640 1 -- 172.21.15.45:0/1958367685 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0a5ab0 con 0x7fcf48003980 2023-10-03T19:13:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf60fc1640 1 -- 172.21.15.45:0/1958367685 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4800b990 con 0x7fcf5c06f170 2023-10-03T19:13:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf627c4640 1 --2- 172.21.15.45:0/1958367685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf48004d10 0x7fcf48005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf61fc3640 1 --2- 172.21.15.45:0/1958367685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf48003980 0x7fcf48003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf627c4640 1 -- 172.21.15.45:0/1958367685 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf5c06f170 msgr2=0x7fcf480047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf617c2640 1 --2- 172.21.15.45:0/1958367685 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf5c06f170 0x7fcf480047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf627c4640 1 --2- 172.21.15.45:0/1958367685 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf5c06f170 0x7fcf480047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf627c4640 1 -- 172.21.15.45:0/1958367685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf48003980 msgr2=0x7fcf48003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:08.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf627c4640 1 --2- 172.21.15.45:0/1958367685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf48003980 0x7fcf48003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.672+0000 7fcf627c4640 1 -- 172.21.15.45:0/1958367685 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf48003530 con 0x7fcf48004d10 2023-10-03T19:13:08.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.676+0000 7fcf627c4640 1 --2- 172.21.15.45:0/1958367685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf48004d10 0x7fcf48005180 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400a860 tx=0x7fcf5401d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67421b97ad3c3274 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:08.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.676+0000 7fcf60fc1640 1 -- 172.21.15.45:0/1958367685 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf540ad630 con 0x7fcf48004d10 2023-10-03T19:13:08.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.676+0000 7fcf60fc1640 1 -- 172.21.15.45:0/1958367685 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf540a8070 con 0x7fcf48004d10 2023-10-03T19:13:08.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.676+0000 7fcf60fc1640 1 -- 172.21.15.45:0/1958367685 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf540ad9f0 con 0x7fcf48004d10 2023-10-03T19:13:08.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.676+0000 7fcf64227640 1 -- 172.21.15.45:0/1958367685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf48004d10 msgr2=0x7fcf48005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:08.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.676+0000 7fcf64227640 1 --2- 172.21.15.45:0/1958367685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf48004d10 0x7fcf48005180 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400a860 tx=0x7fcf5401d2e0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.676+0000 7fcf627c4640 1 -- 172.21.15.45:0/1958367685 reap_dead start 2023-10-03T19:13:08.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.676+0000 7fcf64227640 1 -- 172.21.15.45:0/1958367685 shutdown_connections 2023-10-03T19:13:08.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.676+0000 7fcf64227640 1 -- 172.21.15.45:0/1958367685 >> 172.21.15.45:0/1958367685 conn(0x7fcf5c0bcf50 msgr2=0x7fcf5c0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:08.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.676+0000 7fcf64227640 1 -- 172.21.15.45:0/1958367685 shutdown_connections 2023-10-03T19:13:08.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.676+0000 7fcf64227640 1 -- 172.21.15.45:0/1958367685 wait complete. 2023-10-03T19:13:08.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.676+0000 7fcf64227640 1 Processor -- start 2023-10-03T19:13:08.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.676+0000 7fcf64227640 1 -- start start 2023-10-03T19:13:08.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.676+0000 7fcf64227640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf5c14efc0 0x7fcf5c1e14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:08.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.676+0000 7fcf64227640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf5c142c90 0x7fcf5c14a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:08.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.676+0000 7fcf64227640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf5c0bfbc0 0x7fcf5c1d7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:08.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.676+0000 7fcf64227640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c1d5640 con 0x7fcf5c14efc0 2023-10-03T19:13:08.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.676+0000 7fcf64227640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c14a1e0 con 0x7fcf5c142c90 2023-10-03T19:13:08.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.676+0000 7fcf64227640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c1e1a30 con 0x7fcf5c0bfbc0 2023-10-03T19:13:08.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.676+0000 7fcf61fc3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf5c14efc0 0x7fcf5c1e14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:08.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.676+0000 7fcf61fc3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf5c14efc0 0x7fcf5c1e14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46432/0 (socket says 172.21.15.45:46432) 2023-10-03T19:13:08.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.676+0000 7fcf61fc3640 1 -- 172.21.15.45:0/2243504339 learned_addr learned my addr 172.21.15.45:0/2243504339 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:08.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.680+0000 7fcf617c2640 1 --2- 172.21.15.45:0/2243504339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf5c142c90 0x7fcf5c14a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:08.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.680+0000 7fcf627c4640 1 --2- 172.21.15.45:0/2243504339 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf5c0bfbc0 0x7fcf5c1d7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:08.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.680+0000 7fcf61fc3640 1 -- 172.21.15.45:0/2243504339 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf5c0bfbc0 msgr2=0x7fcf5c1d7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:08.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.680+0000 7fcf61fc3640 1 --2- 172.21.15.45:0/2243504339 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf5c0bfbc0 0x7fcf5c1d7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.680+0000 7fcf61fc3640 1 -- 172.21.15.45:0/2243504339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf5c142c90 msgr2=0x7fcf5c14a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:08.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.680+0000 7fcf61fc3640 1 --2- 172.21.15.45:0/2243504339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf5c142c90 0x7fcf5c14a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.680+0000 7fcf61fc3640 1 -- 172.21.15.45:0/2243504339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c14c4a0 con 0x7fcf5c14efc0 2023-10-03T19:13:08.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.680+0000 7fcf617c2640 1 --2- 172.21.15.45:0/2243504339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf5c142c90 0x7fcf5c14a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:13:08.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.680+0000 7fcf61fc3640 1 --2- 172.21.15.45:0/2243504339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf5c14efc0 0x7fcf5c1e14f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcf58011560 tx=0x7fcf58011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:08.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.680+0000 7fcf527fc640 1 -- 172.21.15.45:0/2243504339 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf58015930 con 0x7fcf5c14efc0 2023-10-03T19:13:08.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.680+0000 7fcf527fc640 1 -- 172.21.15.45:0/2243504339 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf58015a90 con 0x7fcf5c14efc0 2023-10-03T19:13:08.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.680+0000 7fcf64227640 1 -- 172.21.15.45:0/2243504339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5c14fae0 con 0x7fcf5c14efc0 2023-10-03T19:13:08.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.680+0000 7fcf527fc640 1 -- 172.21.15.45:0/2243504339 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf58015e20 con 0x7fcf5c14efc0 2023-10-03T19:13:08.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.680+0000 7fcf64227640 1 -- 172.21.15.45:0/2243504339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5c06f540 con 0x7fcf5c14efc0 2023-10-03T19:13:08.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.680+0000 7fcf64227640 1 -- 172.21.15.45:0/2243504339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf5c06d660 con 0x7fcf5c14efc0 2023-10-03T19:13:08.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.680+0000 7fcf527fc640 1 -- 172.21.15.45:0/2243504339 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcf5800f460 con 0x7fcf5c14efc0 2023-10-03T19:13:08.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.680+0000 7fcf527fc640 1 --2- 172.21.15.45:0/2243504339 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcf400662b0 0x7fcf40068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:08.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.680+0000 7fcf527fc640 1 -- 172.21.15.45:0/2243504339 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcf580845c0 con 0x7fcf5c14efc0 2023-10-03T19:13:08.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.680+0000 7fcf617c2640 1 --2- 172.21.15.45:0/2243504339 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcf400662b0 0x7fcf40068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:08.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.680+0000 7fcf617c2640 1 --2- 172.21.15.45:0/2243504339 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcf400662b0 0x7fcf40068760 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c143490 tx=0x7fcf4c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:08.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.684+0000 7fcf527fc640 1 -- 172.21.15.45:0/2243504339 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fcf580519b0 con 0x7fcf5c14efc0 2023-10-03T19:13:08.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.868+0000 7fcf64227640 1 -- 172.21.15.45:0/2243504339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf5c04de80 con 0x7fcf5c14efc0 2023-10-03T19:13:08.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.868+0000 7fcf527fc640 1 -- 172.21.15.45:0/2243504339 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3903 (secure 0 0 0) 0x7fcf58054fd0 con 0x7fcf5c14efc0 2023-10-03T19:13:08.875 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:13:08.875 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/731286206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":731286206},{"type":"v1","addr":"172.21.15.45:6834","nonce":731286206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/144609891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":144609891},{"type":"v1","addr":"172.21.15.45:6835","nonce":144609891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:12:27.938475+0000","modified":"2023-10-03T19:12:30.957787+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/2693877820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2693877820},{"type":"v1","addr":"172.21.15.79:6835","nonce":2693877820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-03T19:13:08.876 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 7 2023-10-03T19:13:08.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.872+0000 7fcf64227640 1 -- 172.21.15.45:0/2243504339 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcf400662b0 msgr2=0x7fcf40068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:08.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.872+0000 7fcf64227640 1 --2- 172.21.15.45:0/2243504339 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcf400662b0 0x7fcf40068760 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c143490 tx=0x7fcf4c008040 comp rx=0 tx=0).stop 2023-10-03T19:13:08.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.872+0000 7fcf64227640 1 -- 172.21.15.45:0/2243504339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf5c14efc0 msgr2=0x7fcf5c1e14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:08.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.872+0000 7fcf64227640 1 --2- 172.21.15.45:0/2243504339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf5c14efc0 0x7fcf5c1e14f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcf58011560 tx=0x7fcf58011a20 comp rx=0 tx=0).stop 2023-10-03T19:13:08.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.872+0000 7fcf64227640 1 -- 172.21.15.45:0/2243504339 shutdown_connections 2023-10-03T19:13:08.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.872+0000 7fcf64227640 1 --2- 172.21.15.45:0/2243504339 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcf400662b0 0x7fcf40068760 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.872+0000 7fcf64227640 1 --2- 172.21.15.45:0/2243504339 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf5c0bfbc0 0x7fcf5c1d7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.872+0000 7fcf64227640 1 --2- 172.21.15.45:0/2243504339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf5c142c90 0x7fcf5c14a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.872+0000 7fcf64227640 1 --2- 172.21.15.45:0/2243504339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf5c14efc0 0x7fcf5c1e14f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:08.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.872+0000 7fcf64227640 1 -- 172.21.15.45:0/2243504339 >> 172.21.15.45:0/2243504339 conn(0x7fcf5c0bcf50 msgr2=0x7fcf5c14fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:08.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.872+0000 7fcf64227640 1 -- 172.21.15.45:0/2243504339 shutdown_connections 2023-10-03T19:13:08.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.872+0000 7fcf64227640 1 -- 172.21.15.45:0/2243504339 wait complete. 2023-10-03T19:13:08.893 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:13:09.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.996+0000 7fed3b481640 1 Processor -- start 2023-10-03T19:13:09.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:08.996+0000 7fed3b481640 1 -- start start 2023-10-03T19:13:09.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.000+0000 7fed3b481640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed3406f170 0x7fed34150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:09.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.000+0000 7fed3b481640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fed3406d170 0x7fed3414d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:09.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.000+0000 7fed3b481640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed3406cac0 con 0x7fed340bc8b0 2023-10-03T19:13:09.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.000+0000 7fed3b481640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed340720d0 con 0x7fed3406d170 2023-10-03T19:13:09.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.000+0000 7fed3b481640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed340a5ab0 con 0x7fed3406f170 2023-10-03T19:13:09.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.000+0000 7fed39a1e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fed3406d170 0x7fed3414d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:09.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.000+0000 7fed38a1c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fed340bc8b0 0x7fed3414ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34828/0 (socket says 172.21.15.45:34828) 2023-10-03T19:13:09.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.000+0000 7fed39a1e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fed3406d170 0x7fed3414d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46442/0 (socket says 172.21.15.45:46442) 2023-10-03T19:13:09.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.000+0000 7fed38a1c640 1 -- 172.21.15.45:0/86915782 learned_addr learned my addr 172.21.15.45:0/86915782 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:09.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.000+0000 7fed3921d640 1 --2- 172.21.15.45:0/86915782 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed3406f170 0x7fed34150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:09.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.000+0000 7fed39a1e640 1 -- 172.21.15.45:0/86915782 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed3406f170 msgr2=0x7fed34150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:09.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.000+0000 7fed39a1e640 1 --2- 172.21.15.45:0/86915782 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed3406f170 0x7fed34150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:09.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.000+0000 7fed39a1e640 1 -- 172.21.15.45:0/86915782 >> v1:172.21.15.45:6789/0 conn(0x7fed340bc8b0 legacy=0x7fed3414ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:09.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.000+0000 7fed39a1e640 1 -- 172.21.15.45:0/86915782 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3406cd00 con 0x7fed3406d170 2023-10-03T19:13:09.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.000+0000 7fed2bfff640 1 -- 172.21.15.45:0/86915782 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 199073355 0 0) 0x7fed30001120 con 0x7fed340bc8b0 2023-10-03T19:13:09.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.000+0000 7fed39a1e640 1 --2- 172.21.15.45:0/86915782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed3406d170 0x7fed3414d180 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fed2c009d90 tx=0x7fed2c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69160570a527d80e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:09.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.000+0000 7fed2bfff640 1 -- 172.21.15.45:0/86915782 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c0a5920 con 0x7fed3406d170 2023-10-03T19:13:09.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.000+0000 7fed2bfff640 1 -- 172.21.15.45:0/86915782 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2c0a5a80 con 0x7fed3406d170 2023-10-03T19:13:09.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.000+0000 7fed2bfff640 1 -- 172.21.15.45:0/86915782 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c0a5e10 con 0x7fed3406d170 2023-10-03T19:13:09.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed3b481640 1 -- 172.21.15.45:0/86915782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed3406d170 msgr2=0x7fed3414d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:09.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed3b481640 1 --2- 172.21.15.45:0/86915782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed3406d170 0x7fed3414d180 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fed2c009d90 tx=0x7fed2c01c910 comp rx=0 tx=0).stop 2023-10-03T19:13:09.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed3b481640 1 -- 172.21.15.45:0/86915782 shutdown_connections 2023-10-03T19:13:09.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed3b481640 1 --2- 172.21.15.45:0/86915782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed3406d170 0x7fed3414d180 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:09.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed3b481640 1 --2- 172.21.15.45:0/86915782 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed3406f170 0x7fed34150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:09.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed3b481640 1 -- 172.21.15.45:0/86915782 >> 172.21.15.45:0/86915782 conn(0x7fed340bcf50 msgr2=0x7fed340bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:09.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed3b481640 1 -- 172.21.15.45:0/86915782 shutdown_connections 2023-10-03T19:13:09.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed3b481640 1 -- 172.21.15.45:0/86915782 wait complete. 2023-10-03T19:13:09.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed3b481640 1 Processor -- start 2023-10-03T19:13:09.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed3b481640 1 -- start start 2023-10-03T19:13:09.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed3b481640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed3406d170 0x7fed3413cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:09.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed3b481640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed3406f170 0x7fed34145c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:09.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed3b481640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed340bc8b0 0x7fed340bad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:09.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed3b481640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed340ba400 con 0x7fed340bc8b0 2023-10-03T19:13:09.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed3b481640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3413e260 con 0x7fed3406d170 2023-10-03T19:13:09.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed3b481640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3413e500 con 0x7fed3406f170 2023-10-03T19:13:09.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed39a1e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed340bc8b0 0x7fed340bad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:09.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed39a1e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed340bc8b0 0x7fed340bad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46458/0 (socket says 172.21.15.45:46458) 2023-10-03T19:13:09.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed39a1e640 1 -- 172.21.15.45:0/4044718371 learned_addr learned my addr 172.21.15.45:0/4044718371 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:09.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed38a1c640 1 --2- 172.21.15.45:0/4044718371 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed3406f170 0x7fed34145c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:09.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed39a1e640 1 -- 172.21.15.45:0/4044718371 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed3406f170 msgr2=0x7fed34145c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:09.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed39a1e640 1 --2- 172.21.15.45:0/4044718371 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed3406f170 0x7fed34145c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:09.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed3921d640 1 --2- 172.21.15.45:0/4044718371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed3406d170 0x7fed3413cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:09.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed39a1e640 1 -- 172.21.15.45:0/4044718371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed3406d170 msgr2=0x7fed3413cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:09.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed39a1e640 1 --2- 172.21.15.45:0/4044718371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed3406d170 0x7fed3413cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:09.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed39a1e640 1 -- 172.21.15.45:0/4044718371 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2c009a70 con 0x7fed340bc8b0 2023-10-03T19:13:09.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed3921d640 1 --2- 172.21.15.45:0/4044718371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed3406d170 0x7fed3413cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:09.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed39a1e640 1 --2- 172.21.15.45:0/4044718371 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed340bc8b0 0x7fed340bad50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fed2c01afc0 tx=0x7fed2c0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:09.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed29ffb640 1 -- 172.21.15.45:0/4044718371 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c0ad850 con 0x7fed340bc8b0 2023-10-03T19:13:09.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed29ffb640 1 -- 172.21.15.45:0/4044718371 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2c0ad9b0 con 0x7fed340bc8b0 2023-10-03T19:13:09.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed3b481640 1 -- 172.21.15.45:0/4044718371 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed3406f6d0 con 0x7fed340bc8b0 2023-10-03T19:13:09.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed29ffb640 1 -- 172.21.15.45:0/4044718371 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c0add20 con 0x7fed340bc8b0 2023-10-03T19:13:09.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed3b481640 1 -- 172.21.15.45:0/4044718371 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed3406f540 con 0x7fed340bc8b0 2023-10-03T19:13:09.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.004+0000 7fed3b481640 1 -- 172.21.15.45:0/4044718371 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed34159670 con 0x7fed340bc8b0 2023-10-03T19:13:09.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.008+0000 7fed29ffb640 1 -- 172.21.15.45:0/4044718371 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fed2c0b4050 con 0x7fed340bc8b0 2023-10-03T19:13:09.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.008+0000 7fed29ffb640 1 --2- 172.21.15.45:0/4044718371 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fed18066280 0x7fed18068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:09.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.008+0000 7fed29ffb640 1 -- 172.21.15.45:0/4044718371 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fed2c11eb90 con 0x7fed340bc8b0 2023-10-03T19:13:09.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.008+0000 7fed3921d640 1 --2- 172.21.15.45:0/4044718371 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fed18066280 0x7fed18068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:09.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.008+0000 7fed3921d640 1 --2- 172.21.15.45:0/4044718371 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fed18066280 0x7fed18068730 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fed24009ae0 tx=0x7fed24008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:09.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.012+0000 7fed29ffb640 1 -- 172.21.15.45:0/4044718371 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fed2c0ec0a0 con 0x7fed340bc8b0 2023-10-03T19:13:09.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.188+0000 7fed3b481640 1 -- 172.21.15.45:0/4044718371 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed3406d660 con 0x7fed340bc8b0 2023-10-03T19:13:09.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.192+0000 7fed29ffb640 1 -- 172.21.15.45:0/4044718371 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3903 (secure 0 0 0) 0x7fed2c0b2090 con 0x7fed340bc8b0 2023-10-03T19:13:09.196 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:13:09.197 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/731286206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":731286206},{"type":"v1","addr":"172.21.15.45:6834","nonce":731286206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/144609891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":144609891},{"type":"v1","addr":"172.21.15.45:6835","nonce":144609891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:12:27.938475+0000","modified":"2023-10-03T19:12:30.957787+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/2693877820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2693877820},{"type":"v1","addr":"172.21.15.79:6835","nonce":2693877820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-03T19:13:09.197 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 7 2023-10-03T19:13:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.192+0000 7fed3b481640 1 -- 172.21.15.45:0/4044718371 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fed18066280 msgr2=0x7fed18068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:09.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.192+0000 7fed3b481640 1 --2- 172.21.15.45:0/4044718371 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fed18066280 0x7fed18068730 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fed24009ae0 tx=0x7fed24008040 comp rx=0 tx=0).stop 2023-10-03T19:13:09.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.192+0000 7fed3b481640 1 -- 172.21.15.45:0/4044718371 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed340bc8b0 msgr2=0x7fed340bad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:09.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.192+0000 7fed3b481640 1 --2- 172.21.15.45:0/4044718371 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed340bc8b0 0x7fed340bad50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fed2c01afc0 tx=0x7fed2c0196b0 comp rx=0 tx=0).stop 2023-10-03T19:13:09.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.192+0000 7fed3b481640 1 -- 172.21.15.45:0/4044718371 shutdown_connections 2023-10-03T19:13:09.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.192+0000 7fed3b481640 1 --2- 172.21.15.45:0/4044718371 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fed18066280 0x7fed18068730 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:09.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.192+0000 7fed3b481640 1 --2- 172.21.15.45:0/4044718371 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed340bc8b0 0x7fed340bad50 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:09.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.192+0000 7fed3b481640 1 --2- 172.21.15.45:0/4044718371 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed3406f170 0x7fed34145c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:09.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.192+0000 7fed3b481640 1 --2- 172.21.15.45:0/4044718371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed3406d170 0x7fed3413cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:09.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.192+0000 7fed3b481640 1 -- 172.21.15.45:0/4044718371 >> 172.21.15.45:0/4044718371 conn(0x7fed340bcf50 msgr2=0x7fed3414e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:09.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.192+0000 7fed3b481640 1 -- 172.21.15.45:0/4044718371 shutdown_connections 2023-10-03T19:13:09.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.192+0000 7fed3b481640 1 -- 172.21.15.45:0/4044718371 wait complete. 2023-10-03T19:13:09.214 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:13:09.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.328+0000 7ffa0121c640 1 Processor -- start 2023-10-03T19:13:09.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.328+0000 7ffa0121c640 1 -- start start 2023-10-03T19:13:09.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.328+0000 7ffa0121c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff9fc0bbce0 0x7ff9fc14f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:09.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.328+0000 7ffa0121c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff9fc06f780 0x7ff9fc14ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:09.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.328+0000 7ffa0121c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9fc151c80 con 0x7ff9fc14bfc0 2023-10-03T19:13:09.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.328+0000 7ffa0121c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9fc0bd630 con 0x7ff9fc06f780 2023-10-03T19:13:09.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.328+0000 7ffa0121c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc0bc620 con 0x7ff9fc0bbce0 2023-10-03T19:13:09.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.328+0000 7ff9fa59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff9fc06f780 0x7ff9fc14ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:09.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.328+0000 7ff9fa59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff9fc06f780 0x7ff9fc14ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46466/0 (socket says 172.21.15.45:46466) 2023-10-03T19:13:09.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.328+0000 7ff9fa59c640 1 -- 172.21.15.45:0/3262989121 learned_addr learned my addr 172.21.15.45:0/3262989121 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:09.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.328+0000 7ff9fad9d640 1 --2- 172.21.15.45:0/3262989121 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff9fc0bbce0 0x7ff9fc14f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:09.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.328+0000 7ff9fa59c640 1 -- 172.21.15.45:0/3262989121 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff9fc0bbce0 msgr2=0x7ff9fc14f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:09.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.328+0000 7ff9fa59c640 1 --2- 172.21.15.45:0/3262989121 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff9fc0bbce0 0x7ff9fc14f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:09.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.328+0000 7ff9fa59c640 1 -- 172.21.15.45:0/3262989121 >> v1:172.21.15.79:6789/0 conn(0x7ff9fc14bfc0 legacy=0x7ff9fc06e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:09.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.328+0000 7ff9fa59c640 1 -- 172.21.15.45:0/3262989121 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9fc151ed0 con 0x7ff9fc06f780 2023-10-03T19:13:09.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.328+0000 7ff9fad9d640 1 --2- 172.21.15.45:0/3262989121 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff9fc0bbce0 0x7ff9fc14f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:09.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ff9fa59c640 1 --2- 172.21.15.45:0/3262989121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9fc06f780 0x7ff9fc14ba80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0009870 tx=0x7ff9f001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6233accd545e873b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:09.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ff9f9d9b640 1 -- 172.21.15.45:0/3262989121 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f00a7070 con 0x7ff9fc06f780 2023-10-03T19:13:09.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ff9f9d9b640 1 -- 172.21.15.45:0/3262989121 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f00ab430 con 0x7ff9fc06f780 2023-10-03T19:13:09.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ff9f9d9b640 1 -- 172.21.15.45:0/3262989121 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f00ab7c0 con 0x7ff9fc06f780 2023-10-03T19:13:09.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ffa0121c640 1 -- 172.21.15.45:0/3262989121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9fc06f780 msgr2=0x7ff9fc14ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:09.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ffa0121c640 1 --2- 172.21.15.45:0/3262989121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9fc06f780 0x7ff9fc14ba80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0009870 tx=0x7ff9f001c470 comp rx=0 tx=0).stop 2023-10-03T19:13:09.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ffa0121c640 1 -- 172.21.15.45:0/3262989121 shutdown_connections 2023-10-03T19:13:09.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ffa0121c640 1 --2- 172.21.15.45:0/3262989121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9fc06f780 0x7ff9fc14ba80 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:09.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ffa0121c640 1 --2- 172.21.15.45:0/3262989121 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff9fc0bbce0 0x7ff9fc14f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:09.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ffa0121c640 1 -- 172.21.15.45:0/3262989121 >> 172.21.15.45:0/3262989121 conn(0x7ff9fc06bce0 msgr2=0x7ff9fc06c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:09.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ffa0121c640 1 -- 172.21.15.45:0/3262989121 shutdown_connections 2023-10-03T19:13:09.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ffa0121c640 1 -- 172.21.15.45:0/3262989121 wait complete. 2023-10-03T19:13:09.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ffa0121c640 1 Processor -- start 2023-10-03T19:13:09.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ffa0121c640 1 -- start start 2023-10-03T19:13:09.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ffa0121c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9fc06f780 0x7ff9fc0a7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:09.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ffa0121c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9fc0bbce0 0x7ff9fc14d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:09.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ffa0121c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff9fc14bfc0 0x7ff9fc14de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:09.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ffa0121c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc0a7760 con 0x7ff9fc06f780 2023-10-03T19:13:09.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ffa0121c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc0c1fc0 con 0x7ff9fc0bbce0 2023-10-03T19:13:09.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ffa0121c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc0a7bd0 con 0x7ff9fc14bfc0 2023-10-03T19:13:09.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ff9fad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9fc06f780 0x7ff9fc0a7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:09.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ff9fad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9fc06f780 0x7ff9fc0a7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46478/0 (socket says 172.21.15.45:46478) 2023-10-03T19:13:09.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ff9fad9d640 1 -- 172.21.15.45:0/1772269500 learned_addr learned my addr 172.21.15.45:0/1772269500 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:09.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ff9fa59c640 1 --2- 172.21.15.45:0/1772269500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9fc0bbce0 0x7ff9fc14d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:09.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ff9fb59e640 1 --2- 172.21.15.45:0/1772269500 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff9fc14bfc0 0x7ff9fc14de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:09.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ff9fad9d640 1 -- 172.21.15.45:0/1772269500 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff9fc14bfc0 msgr2=0x7ff9fc14de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:09.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ff9fad9d640 1 --2- 172.21.15.45:0/1772269500 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff9fc14bfc0 0x7ff9fc14de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:09.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ff9fad9d640 1 -- 172.21.15.45:0/1772269500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9fc0bbce0 msgr2=0x7ff9fc14d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:09.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ff9fad9d640 1 --2- 172.21.15.45:0/1772269500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9fc0bbce0 0x7ff9fc14d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:09.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ff9fad9d640 1 -- 172.21.15.45:0/1772269500 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f00094d0 con 0x7ff9fc06f780 2023-10-03T19:13:09.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ff9fad9d640 1 --2- 172.21.15.45:0/1772269500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9fc06f780 0x7ff9fc0a7220 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec00c7c0 tx=0x7ff9ec00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:09.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ff9e37fe640 1 -- 172.21.15.45:0/1772269500 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec007a30 con 0x7ff9fc06f780 2023-10-03T19:13:09.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ff9e37fe640 1 -- 172.21.15.45:0/1772269500 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ec007b90 con 0x7ff9fc06f780 2023-10-03T19:13:09.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ffa0121c640 1 -- 172.21.15.45:0/1772269500 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9fc0bc240 con 0x7ff9fc06f780 2023-10-03T19:13:09.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ff9e37fe640 1 -- 172.21.15.45:0/1772269500 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec00ce70 con 0x7ff9fc06f780 2023-10-03T19:13:09.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.332+0000 7ffa0121c640 1 -- 172.21.15.45:0/1772269500 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9fc0bc0b0 con 0x7ff9fc06f780 2023-10-03T19:13:09.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.336+0000 7ffa0121c640 1 -- 172.21.15.45:0/1772269500 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9fc1529b0 con 0x7ff9fc06f780 2023-10-03T19:13:09.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.336+0000 7ff9e37fe640 1 -- 172.21.15.45:0/1772269500 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff9ec0113f0 con 0x7ff9fc06f780 2023-10-03T19:13:09.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.336+0000 7ff9e37fe640 1 --2- 172.21.15.45:0/1772269500 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff9e8066280 0x7ff9e8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:09.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.336+0000 7ff9e37fe640 1 -- 172.21.15.45:0/1772269500 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff9ec084160 con 0x7ff9fc06f780 2023-10-03T19:13:09.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.336+0000 7ff9fa59c640 1 --2- 172.21.15.45:0/1772269500 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff9e8066280 0x7ff9e8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:09.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.336+0000 7ff9fa59c640 1 --2- 172.21.15.45:0/1772269500 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff9e8066280 0x7ff9e8068730 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff9f00af000 tx=0x7ff9f0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:09.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.340+0000 7ff9e37fe640 1 -- 172.21.15.45:0/1772269500 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff9ec051670 con 0x7ff9fc06f780 2023-10-03T19:13:09.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.488+0000 7ffa0121c640 1 -- 172.21.15.45:0/1772269500 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9fc04de80 con 0x7ff9fc06f780 2023-10-03T19:13:09.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.488+0000 7ff9e37fe640 1 -- 172.21.15.45:0/1772269500 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18231 (secure 0 0 0) 0x7ff9ec054c90 con 0x7ff9fc06f780 2023-10-03T19:13:09.495 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:13:09.495 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:12:28.941467+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:12:26.226431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T19:12:26.923174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:13:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.492+0000 7ffa0121c640 1 -- 172.21.15.45:0/1772269500 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff9e8066280 msgr2=0x7ff9e8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.492+0000 7ffa0121c640 1 --2- 172.21.15.45:0/1772269500 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff9e8066280 0x7ff9e8068730 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff9f00af000 tx=0x7ff9f0008040 comp rx=0 tx=0).stop 2023-10-03T19:13:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.492+0000 7ffa0121c640 1 -- 172.21.15.45:0/1772269500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9fc06f780 msgr2=0x7ff9fc0a7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.492+0000 7ffa0121c640 1 --2- 172.21.15.45:0/1772269500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9fc06f780 0x7ff9fc0a7220 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec00c7c0 tx=0x7ff9ec00cc80 comp rx=0 tx=0).stop 2023-10-03T19:13:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.492+0000 7ffa0121c640 1 -- 172.21.15.45:0/1772269500 shutdown_connections 2023-10-03T19:13:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.492+0000 7ffa0121c640 1 --2- 172.21.15.45:0/1772269500 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff9e8066280 0x7ff9e8068730 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.492+0000 7ffa0121c640 1 --2- 172.21.15.45:0/1772269500 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff9fc14bfc0 0x7ff9fc14de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.492+0000 7ffa0121c640 1 --2- 172.21.15.45:0/1772269500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9fc0bbce0 0x7ff9fc14d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.492+0000 7ffa0121c640 1 --2- 172.21.15.45:0/1772269500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9fc06f780 0x7ff9fc0a7220 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.492+0000 7ffa0121c640 1 -- 172.21.15.45:0/1772269500 >> 172.21.15.45:0/1772269500 conn(0x7ff9fc06bce0 msgr2=0x7ff9fc070fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:09.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.492+0000 7ffa0121c640 1 -- 172.21.15.45:0/1772269500 shutdown_connections 2023-10-03T19:13:09.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.492+0000 7ffa0121c640 1 -- 172.21.15.45:0/1772269500 wait complete. 2023-10-03T19:13:09.512 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-03T19:13:09.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.632+0000 7f6546c3f640 1 Processor -- start 2023-10-03T19:13:09.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.632+0000 7f6546c3f640 1 -- start start 2023-10-03T19:13:09.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.632+0000 7f6546c3f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65400a6f00 0x7f65400bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:09.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.632+0000 7f6546c3f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f654006f050 0x7f65400be010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:09.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.632+0000 7f6546c3f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f654014fd70 con 0x7f65400bed20 2023-10-03T19:13:09.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.632+0000 7f6546c3f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f654014d420 con 0x7f654006f050 2023-10-03T19:13:09.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.632+0000 7f6546c3f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6540146910 con 0x7f65400a6f00 2023-10-03T19:13:09.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.632+0000 7f65451dc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f654006f050 0x7f65400be010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:09.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.632+0000 7f65451dc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f654006f050 0x7f65400be010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46494/0 (socket says 172.21.15.45:46494) 2023-10-03T19:13:09.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.632+0000 7f65451dc640 1 -- 172.21.15.45:0/2387735820 learned_addr learned my addr 172.21.15.45:0/2387735820 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:09.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.632+0000 7f653ffff640 1 --2- 172.21.15.45:0/2387735820 >> v2:172.21.15.79:3300/0 conn(0x7f65400a6f00 0x7f65400bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:09.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.632+0000 7f65451dc640 1 -- 172.21.15.45:0/2387735820 >> v2:172.21.15.79:3300/0 conn(0x7f65400a6f00 msgr2=0x7f65400bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:09.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.632+0000 7f65451dc640 1 --2- 172.21.15.45:0/2387735820 >> v2:172.21.15.79:3300/0 conn(0x7f65400a6f00 0x7f65400bf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:09.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.632+0000 7f65451dc640 1 -- 172.21.15.45:0/2387735820 >> v1:172.21.15.79:6789/0 conn(0x7f65400bed20 legacy=0x7f6540150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:09.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.632+0000 7f65451dc640 1 -- 172.21.15.45:0/2387735820 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654006e9f0 con 0x7f654006f050 2023-10-03T19:13:09.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.632+0000 7f653ffff640 1 --2- 172.21.15.45:0/2387735820 >> v2:172.21.15.79:3300/0 conn(0x7f65400a6f00 0x7f65400bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:13:09.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f65451dc640 1 --2- 172.21.15.45:0/2387735820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f654006f050 0x7f65400be010 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f65400a5e80 tx=0x7f653801c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3398ccc01af227b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:09.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f653f7fe640 1 -- 172.21.15.45:0/2387735820 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65380a5650 con 0x7f654006f050 2023-10-03T19:13:09.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f653f7fe640 1 -- 172.21.15.45:0/2387735820 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65380a57b0 con 0x7f654006f050 2023-10-03T19:13:09.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f653f7fe640 1 -- 172.21.15.45:0/2387735820 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65380a5b40 con 0x7f654006f050 2023-10-03T19:13:09.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f6546c3f640 1 -- 172.21.15.45:0/2387735820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f654006f050 msgr2=0x7f65400be010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:09.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f6546c3f640 1 --2- 172.21.15.45:0/2387735820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f654006f050 0x7f65400be010 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f65400a5e80 tx=0x7f653801c990 comp rx=0 tx=0).stop 2023-10-03T19:13:09.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f6546c3f640 1 -- 172.21.15.45:0/2387735820 shutdown_connections 2023-10-03T19:13:09.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f6546c3f640 1 --2- 172.21.15.45:0/2387735820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f654006f050 0x7f65400be010 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:09.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f6546c3f640 1 --2- 172.21.15.45:0/2387735820 >> v2:172.21.15.79:3300/0 conn(0x7f65400a6f00 0x7f65400bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:09.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f6546c3f640 1 -- 172.21.15.45:0/2387735820 >> 172.21.15.45:0/2387735820 conn(0x7f654006d990 msgr2=0x7f654006bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:09.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f6546c3f640 1 -- 172.21.15.45:0/2387735820 shutdown_connections 2023-10-03T19:13:09.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f6546c3f640 1 -- 172.21.15.45:0/2387735820 wait complete. 2023-10-03T19:13:09.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f6546c3f640 1 Processor -- start 2023-10-03T19:13:09.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f6546c3f640 1 -- start start 2023-10-03T19:13:09.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f6546c3f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f654006f050 0x7f65400bbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:09.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f6546c3f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65400a6f00 0x7f65401565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:09.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f6546c3f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65400bed20 0x7f65401457f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:09.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f6546c3f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65401453a0 con 0x7f65400a6f00 2023-10-03T19:13:09.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f6546c3f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6540144a40 con 0x7f65400bed20 2023-10-03T19:13:09.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f6546c3f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6540151ad0 con 0x7f654006f050 2023-10-03T19:13:09.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f653ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65400a6f00 0x7f65401565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:09.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f653ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65400a6f00 0x7f65401565d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46496/0 (socket says 172.21.15.45:46496) 2023-10-03T19:13:09.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f653ffff640 1 -- 172.21.15.45:0/2788474471 learned_addr learned my addr 172.21.15.45:0/2788474471 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:09.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f65449db640 1 --2- 172.21.15.45:0/2788474471 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f654006f050 0x7f65400bbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:09.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f65451dc640 1 --2- 172.21.15.45:0/2788474471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65400bed20 0x7f65401457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:09.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f653ffff640 1 -- 172.21.15.45:0/2788474471 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f654006f050 msgr2=0x7f65400bbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:09.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f653ffff640 1 --2- 172.21.15.45:0/2788474471 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f654006f050 0x7f65400bbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:09.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f653ffff640 1 -- 172.21.15.45:0/2788474471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65400bed20 msgr2=0x7f65401457f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:09.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f653ffff640 1 --2- 172.21.15.45:0/2788474471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65400bed20 0x7f65401457f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:09.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f653ffff640 1 -- 172.21.15.45:0/2788474471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6538009b30 con 0x7f65400a6f00 2023-10-03T19:13:09.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f65451dc640 1 --2- 172.21.15.45:0/2788474471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65400bed20 0x7f65401457f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:09.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.636+0000 7f653ffff640 1 --2- 172.21.15.45:0/2788474471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65400a6f00 0x7f65401565d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f653400e840 tx=0x7f653400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:09.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.640+0000 7f653d7fa640 1 -- 172.21.15.45:0/2788474471 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653400c8d0 con 0x7f65400a6f00 2023-10-03T19:13:09.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.640+0000 7f653d7fa640 1 -- 172.21.15.45:0/2788474471 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653400ca30 con 0x7f65400a6f00 2023-10-03T19:13:09.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.640+0000 7f6546c3f640 1 -- 172.21.15.45:0/2788474471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65400bf840 con 0x7f65400a6f00 2023-10-03T19:13:09.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.640+0000 7f653d7fa640 1 -- 172.21.15.45:0/2788474471 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653400cdc0 con 0x7f65400a6f00 2023-10-03T19:13:09.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.640+0000 7f6546c3f640 1 -- 172.21.15.45:0/2788474471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f654014f9b0 con 0x7f65400a6f00 2023-10-03T19:13:09.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.640+0000 7f6546c3f640 1 -- 172.21.15.45:0/2788474471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65400bf9d0 con 0x7f65400a6f00 2023-10-03T19:13:09.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.640+0000 7f653d7fa640 1 -- 172.21.15.45:0/2788474471 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6534013410 con 0x7f65400a6f00 2023-10-03T19:13:09.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.640+0000 7f653d7fa640 1 --2- 172.21.15.45:0/2788474471 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f652c0662b0 0x7f652c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:09.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.640+0000 7f653d7fa640 1 -- 172.21.15.45:0/2788474471 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6534083a10 con 0x7f65400a6f00 2023-10-03T19:13:09.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.640+0000 7f65449db640 1 --2- 172.21.15.45:0/2788474471 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f652c0662b0 0x7f652c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:09.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.640+0000 7f65449db640 1 --2- 172.21.15.45:0/2788474471 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f652c0662b0 0x7f652c068760 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6530003d60 tx=0x7f6530009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:09.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.644+0000 7f653d7fa640 1 -- 172.21.15.45:0/2788474471 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6534050f20 con 0x7f65400a6f00 2023-10-03T19:13:09.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:09.832+0000 7f6546c3f640 1 -- 172.21.15.45:0/2788474471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f654004de80 con 0x7f65400a6f00 2023-10-03T19:13:10.708 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-10-03T19:13:10.704+0000 7f00b6fb3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-03T19:13:10.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.716+0000 7f653d7fa640 1 -- 172.21.15.45:0/2788474471 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6534054540 con 0x7f65400a6f00 2023-10-03T19:13:10.723 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-03T19:13:10.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.720+0000 7f6546c3f640 1 -- 172.21.15.45:0/2788474471 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f652c0662b0 msgr2=0x7f652c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:10.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.720+0000 7f6546c3f640 1 --2- 172.21.15.45:0/2788474471 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f652c0662b0 0x7f652c068760 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6530003d60 tx=0x7f6530009040 comp rx=0 tx=0).stop 2023-10-03T19:13:10.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.720+0000 7f6546c3f640 1 -- 172.21.15.45:0/2788474471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65400a6f00 msgr2=0x7f65401565d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:10.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.720+0000 7f6546c3f640 1 --2- 172.21.15.45:0/2788474471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65400a6f00 0x7f65401565d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f653400e840 tx=0x7f653400ed00 comp rx=0 tx=0).stop 2023-10-03T19:13:10.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.720+0000 7f6546c3f640 1 -- 172.21.15.45:0/2788474471 shutdown_connections 2023-10-03T19:13:10.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.720+0000 7f6546c3f640 1 --2- 172.21.15.45:0/2788474471 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f652c0662b0 0x7f652c068760 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:10.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.720+0000 7f6546c3f640 1 --2- 172.21.15.45:0/2788474471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65400bed20 0x7f65401457f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:10.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.720+0000 7f6546c3f640 1 --2- 172.21.15.45:0/2788474471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65400a6f00 0x7f65401565d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:10.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.720+0000 7f6546c3f640 1 --2- 172.21.15.45:0/2788474471 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f654006f050 0x7f65400bbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:10.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.720+0000 7f6546c3f640 1 -- 172.21.15.45:0/2788474471 >> 172.21.15.45:0/2788474471 conn(0x7f654006d990 msgr2=0x7f654014bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:10.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.720+0000 7f6546c3f640 1 -- 172.21.15.45:0/2788474471 shutdown_connections 2023-10-03T19:13:10.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.720+0000 7f6546c3f640 1 -- 172.21.15.45:0/2788474471 wait complete. 2023-10-03T19:13:10.728 INFO:tasks.ceph.mds.b.smithi079.stderr: -1808> 2023-10-03T19:12:29.473+0000 7f45fd6f9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-03T19:13:10.746 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-03T19:13:10.762 INFO:tasks.ceph.mds.b.smithi079.stdout:starting mds.b at 2023-10-03T19:13:10.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72cff4e640 1 Processor -- start 2023-10-03T19:13:10.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72cff4e640 1 -- start start 2023-10-03T19:13:10.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72cff4e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72c80c0420 0x7f72c80bf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:10.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72cff4e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f72c80c08c0 0x7f72c814bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:10.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72cff4e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c80bf930 con 0x7f72c80658f0 2023-10-03T19:13:10.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72cff4e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c80bfe70 con 0x7f72c80c08c0 2023-10-03T19:13:10.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72cff4e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c80c0150 con 0x7f72c80c0420 2023-10-03T19:13:10.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72cdcea640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f72c80658f0 0x7f72c80bbe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34842/0 (socket says 172.21.15.45:34842) 2023-10-03T19:13:10.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72cdcea640 1 -- 172.21.15.45:0/3490659107 learned_addr learned my addr 172.21.15.45:0/3490659107 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:10.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72ce4eb640 1 --2- 172.21.15.45:0/3490659107 >> v2:172.21.15.79:3300/0 conn(0x7f72c80c08c0 0x7f72c814bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:10.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72cd4e9640 1 --2- 172.21.15.45:0/3490659107 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72c80c0420 0x7f72c80bf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:10.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72ccce8640 1 -- 172.21.15.45:0/3490659107 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080302595 0 0) 0x7f72c80bf930 con 0x7f72c80658f0 2023-10-03T19:13:10.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72ccce8640 1 -- 172.21.15.45:0/3490659107 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72b4003530 con 0x7f72c80658f0 2023-10-03T19:13:10.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72ccce8640 1 -- 172.21.15.45:0/3490659107 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1882442392 0 0) 0x7f72b4003530 con 0x7f72c80658f0 2023-10-03T19:13:10.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72ccce8640 1 -- 172.21.15.45:0/3490659107 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72c80c0420 msgr2=0x7f72c80bf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:10.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72ccce8640 1 --2- 172.21.15.45:0/3490659107 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72c80c0420 0x7f72c80bf3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72ccce8640 1 -- 172.21.15.45:0/3490659107 >> v2:172.21.15.79:3300/0 conn(0x7f72c80c08c0 msgr2=0x7f72c814bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72ccce8640 1 --2- 172.21.15.45:0/3490659107 >> v2:172.21.15.79:3300/0 conn(0x7f72c80c08c0 0x7f72c814bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72ccce8640 1 -- 172.21.15.45:0/3490659107 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c80c0fd0 con 0x7f72c80658f0 2023-10-03T19:13:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72ccce8640 1 -- 172.21.15.45:0/3490659107 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f72c4001680 con 0x7f72c80658f0 2023-10-03T19:13:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72ccce8640 1 -- 172.21.15.45:0/3490659107 >> v1:172.21.15.45:6789/0 conn(0x7f72c80658f0 legacy=0x7f72c80bbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72ccce8640 1 --2- 172.21.15.45:0/3490659107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72b4003980 0x7f72b4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72ccce8640 1 --2- 172.21.15.45:0/3490659107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72b40043b0 0x7f72b4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72ccce8640 1 --2- 172.21.15.45:0/3490659107 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72c80c0420 0x7f72b4004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72ccce8640 1 -- 172.21.15.45:0/3490659107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c80bfe70 con 0x7f72b4003980 2023-10-03T19:13:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72ccce8640 1 -- 172.21.15.45:0/3490659107 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c80c0150 con 0x7f72b40043b0 2023-10-03T19:13:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72ccce8640 1 -- 172.21.15.45:0/3490659107 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b400b990 con 0x7f72c80c0420 2023-10-03T19:13:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72cdcea640 1 --2- 172.21.15.45:0/3490659107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72b4003980 0x7f72b4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:10.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72cd4e9640 1 --2- 172.21.15.45:0/3490659107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72b40043b0 0x7f72b4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:10.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72ce4eb640 1 --2- 172.21.15.45:0/3490659107 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72c80c0420 0x7f72b4004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:10.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72cdcea640 1 -- 172.21.15.45:0/3490659107 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72c80c0420 msgr2=0x7f72b4004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:10.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72cdcea640 1 --2- 172.21.15.45:0/3490659107 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72c80c0420 0x7f72b4004f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:10.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72cdcea640 1 -- 172.21.15.45:0/3490659107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72b40043b0 msgr2=0x7f72b4004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:10.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72cdcea640 1 --2- 172.21.15.45:0/3490659107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72b40043b0 0x7f72b4004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:10.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.872+0000 7f72cdcea640 1 -- 172.21.15.45:0/3490659107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b4003530 con 0x7f72b4003980 2023-10-03T19:13:10.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.876+0000 7f72cdcea640 1 --2- 172.21.15.45:0/3490659107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72b4003980 0x7f72b4003d90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f72c400c290 tx=0x7f72c401f430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e31407fae532a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:10.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.876+0000 7f72ccce8640 1 -- 172.21.15.45:0/3490659107 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4005ae0 con 0x7f72b4003980 2023-10-03T19:13:10.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.876+0000 7f72ccce8640 1 -- 172.21.15.45:0/3490659107 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c40ab070 con 0x7f72b4003980 2023-10-03T19:13:10.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.876+0000 7f72ccce8640 1 -- 172.21.15.45:0/3490659107 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4005e80 con 0x7f72b4003980 2023-10-03T19:13:10.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.876+0000 7f72cff4e640 1 -- 172.21.15.45:0/3490659107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72b4003980 msgr2=0x7f72b4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:10.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.876+0000 7f72cff4e640 1 --2- 172.21.15.45:0/3490659107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72b4003980 0x7f72b4003d90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f72c400c290 tx=0x7f72c401f430 comp rx=0 tx=0).stop 2023-10-03T19:13:10.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.876+0000 7f72ce4eb640 1 -- 172.21.15.45:0/3490659107 reap_dead start 2023-10-03T19:13:10.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.876+0000 7f72cff4e640 1 -- 172.21.15.45:0/3490659107 shutdown_connections 2023-10-03T19:13:10.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.876+0000 7f72cff4e640 1 -- 172.21.15.45:0/3490659107 >> 172.21.15.45:0/3490659107 conn(0x7f72c80c14f0 msgr2=0x7f72c80c18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:10.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.876+0000 7f72cff4e640 1 -- 172.21.15.45:0/3490659107 shutdown_connections 2023-10-03T19:13:10.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.876+0000 7f72cff4e640 1 -- 172.21.15.45:0/3490659107 wait complete. 2023-10-03T19:13:10.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.876+0000 7f72cff4e640 1 Processor -- start 2023-10-03T19:13:10.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.876+0000 7f72cff4e640 1 -- start start 2023-10-03T19:13:10.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.880+0000 7f72cff4e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72b4003980 0x7f72c806d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:10.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.880+0000 7f72cff4e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72c814ecc0 0x7f72c81456b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:10.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.880+0000 7f72cff4e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72c8145bf0 0x7f72c80a47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:10.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.880+0000 7f72cff4e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c814f500 con 0x7f72b4003980 2023-10-03T19:13:10.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.880+0000 7f72cff4e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c806dd70 con 0x7f72c8145bf0 2023-10-03T19:13:10.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.880+0000 7f72cff4e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c80a5b90 con 0x7f72c814ecc0 2023-10-03T19:13:10.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.880+0000 7f72cdcea640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72b4003980 0x7f72c806d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:10.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.880+0000 7f72cdcea640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72b4003980 0x7f72c806d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46518/0 (socket says 172.21.15.45:46518) 2023-10-03T19:13:10.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.880+0000 7f72cdcea640 1 -- 172.21.15.45:0/2042140986 learned_addr learned my addr 172.21.15.45:0/2042140986 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:10.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.880+0000 7f72ce4eb640 1 --2- 172.21.15.45:0/2042140986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72c8145bf0 0x7f72c80a47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:10.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.880+0000 7f72cd4e9640 1 --2- 172.21.15.45:0/2042140986 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72c814ecc0 0x7f72c81456b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:10.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.880+0000 7f72cdcea640 1 -- 172.21.15.45:0/2042140986 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72c814ecc0 msgr2=0x7f72c81456b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:10.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.880+0000 7f72cdcea640 1 --2- 172.21.15.45:0/2042140986 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72c814ecc0 0x7f72c81456b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:10.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.880+0000 7f72cdcea640 1 -- 172.21.15.45:0/2042140986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72c8145bf0 msgr2=0x7f72c80a47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:10.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.880+0000 7f72cdcea640 1 --2- 172.21.15.45:0/2042140986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72c8145bf0 0x7f72c80a47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:10.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.880+0000 7f72cdcea640 1 -- 172.21.15.45:0/2042140986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c8150600 con 0x7f72b4003980 2023-10-03T19:13:10.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.880+0000 7f72ce4eb640 1 --2- 172.21.15.45:0/2042140986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72c8145bf0 0x7f72c80a47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:10.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.880+0000 7f72cdcea640 1 --2- 172.21.15.45:0/2042140986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72b4003980 0x7f72c806d830 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f72c4001940 tx=0x7f72b4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:10.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.880+0000 7f72be7fc640 1 -- 172.21.15.45:0/2042140986 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c40b7070 con 0x7f72b4003980 2023-10-03T19:13:10.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.880+0000 7f72be7fc640 1 -- 172.21.15.45:0/2042140986 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c4005940 con 0x7f72b4003980 2023-10-03T19:13:10.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.880+0000 7f72cff4e640 1 -- 172.21.15.45:0/2042140986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c80c12b0 con 0x7f72b4003980 2023-10-03T19:13:10.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.880+0000 7f72be7fc640 1 -- 172.21.15.45:0/2042140986 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4005cf0 con 0x7f72b4003980 2023-10-03T19:13:10.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.880+0000 7f72cff4e640 1 -- 172.21.15.45:0/2042140986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c8065cc0 con 0x7f72b4003980 2023-10-03T19:13:10.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.880+0000 7f72cff4e640 1 -- 172.21.15.45:0/2042140986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c804de80 con 0x7f72b4003980 2023-10-03T19:13:10.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.880+0000 7f72be7fc640 1 -- 172.21.15.45:0/2042140986 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f72c40ad020 con 0x7f72b4003980 2023-10-03T19:13:10.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.880+0000 7f72be7fc640 1 --2- 172.21.15.45:0/2042140986 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f72ac0662b0 0x7f72ac068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:10.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.880+0000 7f72be7fc640 1 -- 172.21.15.45:0/2042140986 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f72c4120720 con 0x7f72b4003980 2023-10-03T19:13:10.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.880+0000 7f72cd4e9640 1 --2- 172.21.15.45:0/2042140986 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f72ac0662b0 0x7f72ac068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:10.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.884+0000 7f72cd4e9640 1 --2- 172.21.15.45:0/2042140986 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f72ac0662b0 0x7f72ac068760 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f72c81e2750 tx=0x7f72b8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:10.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:10.884+0000 7f72be7fc640 1 -- 172.21.15.45:0/2042140986 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f72c40f1510 con 0x7f72b4003980 2023-10-03T19:13:11.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.076+0000 7f72cff4e640 1 -- 172.21.15.45:0/2042140986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f72c806b1b0 con 0x7f72b4003980 2023-10-03T19:13:11.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.720+0000 7f72be7fc640 1 -- 172.21.15.45:0/2042140986 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f72c40b40a0 con 0x7f72b4003980 2023-10-03T19:13:11.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.724+0000 7f72cff4e640 1 -- 172.21.15.45:0/2042140986 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f72ac0662b0 msgr2=0x7f72ac068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:11.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.724+0000 7f72cff4e640 1 --2- 172.21.15.45:0/2042140986 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f72ac0662b0 0x7f72ac068760 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f72c81e2750 tx=0x7f72b8008040 comp rx=0 tx=0).stop 2023-10-03T19:13:11.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.724+0000 7f72cff4e640 1 -- 172.21.15.45:0/2042140986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72b4003980 msgr2=0x7f72c806d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:11.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.724+0000 7f72cff4e640 1 --2- 172.21.15.45:0/2042140986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72b4003980 0x7f72c806d830 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f72c4001940 tx=0x7f72b4005800 comp rx=0 tx=0).stop 2023-10-03T19:13:11.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.724+0000 7f72cff4e640 1 -- 172.21.15.45:0/2042140986 shutdown_connections 2023-10-03T19:13:11.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.724+0000 7f72cff4e640 1 --2- 172.21.15.45:0/2042140986 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f72ac0662b0 0x7f72ac068760 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:11.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.724+0000 7f72cff4e640 1 --2- 172.21.15.45:0/2042140986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72c8145bf0 0x7f72c80a47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:11.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.724+0000 7f72cff4e640 1 --2- 172.21.15.45:0/2042140986 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72c814ecc0 0x7f72c81456b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:11.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.724+0000 7f72cff4e640 1 --2- 172.21.15.45:0/2042140986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72b4003980 0x7f72c806d830 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:11.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.724+0000 7f72cff4e640 1 -- 172.21.15.45:0/2042140986 >> 172.21.15.45:0/2042140986 conn(0x7f72c80c14f0 msgr2=0x7f72c80a19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:11.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.724+0000 7f72cff4e640 1 -- 172.21.15.45:0/2042140986 shutdown_connections 2023-10-03T19:13:11.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.724+0000 7f72cff4e640 1 -- 172.21.15.45:0/2042140986 wait complete. 2023-10-03T19:13:11.751 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-03T19:13:11.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.884+0000 7f6dfa2f1640 1 Processor -- start 2023-10-03T19:13:11.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.884+0000 7f6dfa2f1640 1 -- start start 2023-10-03T19:13:11.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.884+0000 7f6dfa2f1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6df4071280 0x7f6df41497e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:11.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.884+0000 7f6dfa2f1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6df40a7ab0 0x7f6df414c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:11.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.884+0000 7f6dfa2f1640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6df40a82e0 con 0x7f6df4149d20 2023-10-03T19:13:11.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.884+0000 7f6dfa2f1640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df40a85e0 con 0x7f6df4071280 2023-10-03T19:13:11.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.884+0000 7f6dfa2f1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df40a8000 con 0x7f6df40a7ab0 2023-10-03T19:13:11.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.884+0000 7f6df37fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6df40a7ab0 0x7f6df414c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:11.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.884+0000 7f6df3fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6df4071280 0x7f6df41497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:11.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.884+0000 7f6df3fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6df4071280 0x7f6df41497e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:59738/0 (socket says 172.21.15.45:59738) 2023-10-03T19:13:11.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.884+0000 7f6df3fff640 1 -- 172.21.15.45:0/1181586678 learned_addr learned my addr 172.21.15.45:0/1181586678 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:11.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.884+0000 7f6df37fe640 1 --2- 172.21.15.45:0/1181586678 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6df40a7ab0 0x7f6df414c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:34268/0 (socket says 172.21.15.45:34268) 2023-10-03T19:13:11.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.884+0000 7f6df3fff640 1 -- 172.21.15.45:0/1181586678 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6df40a7ab0 msgr2=0x7f6df414c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:11.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.884+0000 7f6df3fff640 1 --2- 172.21.15.45:0/1181586678 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6df40a7ab0 0x7f6df414c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:11.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.884+0000 7f6df3fff640 1 -- 172.21.15.45:0/1181586678 >> v1:172.21.15.79:6789/0 conn(0x7f6df4149d20 legacy=0x7f6df406e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:11.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.884+0000 7f6df3fff640 1 -- 172.21.15.45:0/1181586678 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df40a4d50 con 0x7f6df4071280 2023-10-03T19:13:11.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.888+0000 7f6df3fff640 1 --2- 172.21.15.45:0/1181586678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6df4071280 0x7f6df41497e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6dec009e50 tx=0x7f6dec01f1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7d0320b0bccd181 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:11.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.888+0000 7f6df2ffd640 1 -- 172.21.15.45:0/1181586678 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec0af400 con 0x7f6df4071280 2023-10-03T19:13:11.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.888+0000 7f6df2ffd640 1 -- 172.21.15.45:0/1181586678 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dec0ab050 con 0x7f6df4071280 2023-10-03T19:13:11.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.888+0000 7f6df2ffd640 1 -- 172.21.15.45:0/1181586678 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec0af780 con 0x7f6df4071280 2023-10-03T19:13:11.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.888+0000 7f6dfa2f1640 1 -- 172.21.15.45:0/1181586678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6df4071280 msgr2=0x7f6df41497e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:11.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.888+0000 7f6dfa2f1640 1 --2- 172.21.15.45:0/1181586678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6df4071280 0x7f6df41497e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6dec009e50 tx=0x7f6dec01f1f0 comp rx=0 tx=0).stop 2023-10-03T19:13:11.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.888+0000 7f6dfa2f1640 1 -- 172.21.15.45:0/1181586678 shutdown_connections 2023-10-03T19:13:11.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.888+0000 7f6dfa2f1640 1 --2- 172.21.15.45:0/1181586678 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6df40a7ab0 0x7f6df414c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:11.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.888+0000 7f6dfa2f1640 1 --2- 172.21.15.45:0/1181586678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6df4071280 0x7f6df41497e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:11.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.888+0000 7f6dfa2f1640 1 -- 172.21.15.45:0/1181586678 >> 172.21.15.45:0/1181586678 conn(0x7f6df40c25f0 msgr2=0x7f6df40c29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:11.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.888+0000 7f6dfa2f1640 1 -- 172.21.15.45:0/1181586678 shutdown_connections 2023-10-03T19:13:11.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.888+0000 7f6dfa2f1640 1 -- 172.21.15.45:0/1181586678 wait complete. 2023-10-03T19:13:11.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.888+0000 7f6dfa2f1640 1 Processor -- start 2023-10-03T19:13:11.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.888+0000 7f6dfa2f1640 1 -- start start 2023-10-03T19:13:11.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.892+0000 7f6dfa2f1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6df4071280 0x7f6df4143df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:11.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.892+0000 7f6dfa2f1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6df40a7ab0 0x7f6df4141a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:11.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.892+0000 7f6dfa2f1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6df4149d20 0x7f6df4141f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:11.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.892+0000 7f6dfa2f1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df41e5b90 con 0x7f6df40a7ab0 2023-10-03T19:13:11.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.892+0000 7f6dfa2f1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df41e5fe0 con 0x7f6df4071280 2023-10-03T19:13:11.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.892+0000 7f6dfa2f1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df40bb7e0 con 0x7f6df4149d20 2023-10-03T19:13:11.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.892+0000 7f6df37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6df40a7ab0 0x7f6df4141a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:11.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.892+0000 7f6df37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6df40a7ab0 0x7f6df4141a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46532/0 (socket says 172.21.15.45:46532) 2023-10-03T19:13:11.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.892+0000 7f6df37fe640 1 -- 172.21.15.45:0/520360470 learned_addr learned my addr 172.21.15.45:0/520360470 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:11.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.892+0000 7f6df3fff640 1 --2- 172.21.15.45:0/520360470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6df4071280 0x7f6df4143df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:11.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.892+0000 7f6df888e640 1 --2- 172.21.15.45:0/520360470 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6df4149d20 0x7f6df4141f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:11.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.892+0000 7f6df37fe640 1 -- 172.21.15.45:0/520360470 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6df4149d20 msgr2=0x7f6df4141f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:11.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.892+0000 7f6df37fe640 1 --2- 172.21.15.45:0/520360470 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6df4149d20 0x7f6df4141f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:11.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.892+0000 7f6df37fe640 1 -- 172.21.15.45:0/520360470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6df4071280 msgr2=0x7f6df4143df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:11.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.892+0000 7f6df37fe640 1 --2- 172.21.15.45:0/520360470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6df4071280 0x7f6df4143df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:11.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.892+0000 7f6df37fe640 1 -- 172.21.15.45:0/520360470 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dec009b30 con 0x7f6df40a7ab0 2023-10-03T19:13:11.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.892+0000 7f6df888e640 1 --2- 172.21.15.45:0/520360470 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6df4149d20 0x7f6df4141f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:13:11.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.892+0000 7f6df37fe640 1 --2- 172.21.15.45:0/520360470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6df40a7ab0 0x7f6df4141a20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6de800e960 tx=0x7f6de800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:11.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.892+0000 7f6df0ff9640 1 -- 172.21.15.45:0/520360470 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de8009690 con 0x7f6df40a7ab0 2023-10-03T19:13:11.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.892+0000 7f6df0ff9640 1 -- 172.21.15.45:0/520360470 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de800ca00 con 0x7f6df40a7ab0 2023-10-03T19:13:11.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.892+0000 7f6dfa2f1640 1 -- 172.21.15.45:0/520360470 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df40b7490 con 0x7f6df40a7ab0 2023-10-03T19:13:11.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.892+0000 7f6df0ff9640 1 -- 172.21.15.45:0/520360470 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de800cd70 con 0x7f6df40a7ab0 2023-10-03T19:13:11.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.892+0000 7f6dfa2f1640 1 -- 172.21.15.45:0/520360470 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6df40a5030 con 0x7f6df40a7ab0 2023-10-03T19:13:11.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.892+0000 7f6dfa2f1640 1 -- 172.21.15.45:0/520360470 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6df414c3b0 con 0x7f6df40a7ab0 2023-10-03T19:13:11.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.892+0000 7f6df0ff9640 1 -- 172.21.15.45:0/520360470 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6de8013470 con 0x7f6df40a7ab0 2023-10-03T19:13:11.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.892+0000 7f6df0ff9640 1 --2- 172.21.15.45:0/520360470 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6de0066280 0x7f6de0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:11.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.892+0000 7f6df0ff9640 1 -- 172.21.15.45:0/520360470 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f6de8083e60 con 0x7f6df40a7ab0 2023-10-03T19:13:11.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.892+0000 7f6df3fff640 1 --2- 172.21.15.45:0/520360470 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6de0066280 0x7f6de0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:11.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.896+0000 7f6df3fff640 1 --2- 172.21.15.45:0/520360470 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6de0066280 0x7f6de0068730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6dec0b1000 tx=0x7f6dec0aa000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:11.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:11.896+0000 7f6df0ff9640 1 -- 172.21.15.45:0/520360470 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6de8051390 con 0x7f6df40a7ab0 2023-10-03T19:13:12.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:12.052+0000 7f6dfa2f1640 1 -- 172.21.15.45:0/520360470 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6df40b7e90 con 0x7f6df40a7ab0 2023-10-03T19:13:12.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:12.868+0000 7f6df0ff9640 1 -- 172.21.15.45:0/520360470 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6de80170d0 con 0x7f6df40a7ab0 2023-10-03T19:13:12.875 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-10-03T19:13:12.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:12.876+0000 7f6dfa2f1640 1 -- 172.21.15.45:0/520360470 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6de0066280 msgr2=0x7f6de0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:12.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:12.876+0000 7f6dfa2f1640 1 --2- 172.21.15.45:0/520360470 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6de0066280 0x7f6de0068730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6dec0b1000 tx=0x7f6dec0aa000 comp rx=0 tx=0).stop 2023-10-03T19:13:12.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:12.876+0000 7f6dfa2f1640 1 -- 172.21.15.45:0/520360470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6df40a7ab0 msgr2=0x7f6df4141a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:12.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:12.876+0000 7f6dfa2f1640 1 --2- 172.21.15.45:0/520360470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6df40a7ab0 0x7f6df4141a20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6de800e960 tx=0x7f6de800ee20 comp rx=0 tx=0).stop 2023-10-03T19:13:12.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:12.876+0000 7f6dfa2f1640 1 -- 172.21.15.45:0/520360470 shutdown_connections 2023-10-03T19:13:12.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:12.876+0000 7f6dfa2f1640 1 --2- 172.21.15.45:0/520360470 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6de0066280 0x7f6de0068730 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:12.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:12.876+0000 7f6dfa2f1640 1 --2- 172.21.15.45:0/520360470 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6df4149d20 0x7f6df4141f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:12.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:12.876+0000 7f6dfa2f1640 1 --2- 172.21.15.45:0/520360470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6df40a7ab0 0x7f6df4141a20 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:12.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:12.876+0000 7f6dfa2f1640 1 --2- 172.21.15.45:0/520360470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6df4071280 0x7f6df4143df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:12.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:12.876+0000 7f6dfa2f1640 1 -- 172.21.15.45:0/520360470 >> 172.21.15.45:0/520360470 conn(0x7f6df40c25f0 msgr2=0x7f6df40c29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:12.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:12.880+0000 7f6dfa2f1640 1 -- 172.21.15.45:0/520360470 shutdown_connections 2023-10-03T19:13:12.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:12.880+0000 7f6dfa2f1640 1 -- 172.21.15.45:0/520360470 wait complete. 2023-10-03T19:13:12.906 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-03T19:13:13.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d48299640 1 Processor -- start 2023-10-03T19:13:13.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d48299640 1 -- start start 2023-10-03T19:13:13.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d48299640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d400712c0 0x7f1d400bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:13.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d48299640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d4006c2d0 con 0x7f1d4006d560 2023-10-03T19:13:13.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d48299640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d40150610 con 0x7f1d4006c760 2023-10-03T19:13:13.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d48299640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d401508b0 con 0x7f1d400712c0 2023-10-03T19:13:13.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d45834640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1d4006d560 0x7f1d400a53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34852/0 (socket says 172.21.15.45:34852) 2023-10-03T19:13:13.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d45834640 1 -- 172.21.15.45:0/2309184386 learned_addr learned my addr 172.21.15.45:0/2309184386 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:13.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d46035640 1 --2- 172.21.15.45:0/2309184386 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d400712c0 0x7f1d400bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:13.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d45033640 1 -- 172.21.15.45:0/2309184386 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3668509536 0 0) 0x7f1d4006c2d0 con 0x7f1d4006d560 2023-10-03T19:13:13.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d45033640 1 -- 172.21.15.45:0/2309184386 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d2c003530 con 0x7f1d4006d560 2023-10-03T19:13:13.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d45033640 1 -- 172.21.15.45:0/2309184386 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431730280 0 0) 0x7f1d40150610 con 0x7f1d4006c760 2023-10-03T19:13:13.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d45033640 1 -- 172.21.15.45:0/2309184386 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d4006c2d0 con 0x7f1d4006c760 2023-10-03T19:13:13.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d45033640 1 -- 172.21.15.45:0/2309184386 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3762186889 0 0) 0x7f1d2c003530 con 0x7f1d4006d560 2023-10-03T19:13:13.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d45033640 1 -- 172.21.15.45:0/2309184386 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d400712c0 msgr2=0x7f1d400bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:13.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d45033640 1 --2- 172.21.15.45:0/2309184386 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d400712c0 0x7f1d400bcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:13.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d45033640 1 -- 172.21.15.45:0/2309184386 >> v1:172.21.15.79:6789/0 conn(0x7f1d4006c760 legacy=0x7f1d400a5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:13.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d45033640 1 -- 172.21.15.45:0/2309184386 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4006d2e0 con 0x7f1d4006d560 2023-10-03T19:13:13.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d45033640 1 -- 172.21.15.45:0/2309184386 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f1d34001a00 con 0x7f1d4006d560 2023-10-03T19:13:13.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d45033640 1 -- 172.21.15.45:0/2309184386 >> v1:172.21.15.45:6789/0 conn(0x7f1d4006d560 legacy=0x7f1d400a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:13.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d45033640 1 --2- 172.21.15.45:0/2309184386 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d400712c0 0x7f1d2c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:13.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d45033640 1 --2- 172.21.15.45:0/2309184386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d2c0040a0 0x7f1d2c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:13.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d45033640 1 --2- 172.21.15.45:0/2309184386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d2c004d10 0x7f1d2c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:13.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d45033640 1 -- 172.21.15.45:0/2309184386 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d401508b0 con 0x7f1d2c004d10 2023-10-03T19:13:13.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d45033640 1 -- 172.21.15.45:0/2309184386 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c00ba40 con 0x7f1d2c0040a0 2023-10-03T19:13:13.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d45033640 1 -- 172.21.15.45:0/2309184386 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c00bc00 con 0x7f1d400712c0 2023-10-03T19:13:13.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d46836640 1 --2- 172.21.15.45:0/2309184386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d2c004d10 0x7f1d2c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:13.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d45834640 1 --2- 172.21.15.45:0/2309184386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d2c0040a0 0x7f1d2c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:13.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d46836640 1 -- 172.21.15.45:0/2309184386 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d400712c0 msgr2=0x7f1d2c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:13.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d46035640 1 --2- 172.21.15.45:0/2309184386 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d400712c0 0x7f1d2c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:13.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d46836640 1 --2- 172.21.15.45:0/2309184386 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d400712c0 0x7f1d2c003b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:13.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d46836640 1 -- 172.21.15.45:0/2309184386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d2c0040a0 msgr2=0x7f1d2c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:13.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d46836640 1 --2- 172.21.15.45:0/2309184386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d2c0040a0 0x7f1d2c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:13.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.032+0000 7f1d46836640 1 -- 172.21.15.45:0/2309184386 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2c003530 con 0x7f1d2c004d10 2023-10-03T19:13:13.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.036+0000 7f1d46836640 1 --2- 172.21.15.45:0/2309184386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d2c004d10 0x7f1d2c005180 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1d38007fd0 tx=0x7f1d3801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed082a4bb21aaf6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:13.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.036+0000 7f1d45033640 1 -- 172.21.15.45:0/2309184386 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d380052d0 con 0x7f1d2c004d10 2023-10-03T19:13:13.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.036+0000 7f1d45033640 1 -- 172.21.15.45:0/2309184386 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d380a7070 con 0x7f1d2c004d10 2023-10-03T19:13:13.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.036+0000 7f1d45033640 1 -- 172.21.15.45:0/2309184386 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d38003600 con 0x7f1d2c004d10 2023-10-03T19:13:13.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.036+0000 7f1d48299640 1 -- 172.21.15.45:0/2309184386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d2c004d10 msgr2=0x7f1d2c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:13.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.036+0000 7f1d48299640 1 --2- 172.21.15.45:0/2309184386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d2c004d10 0x7f1d2c005180 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1d38007fd0 tx=0x7f1d3801c500 comp rx=0 tx=0).stop 2023-10-03T19:13:13.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.036+0000 7f1d46836640 1 -- 172.21.15.45:0/2309184386 reap_dead start 2023-10-03T19:13:13.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.036+0000 7f1d48299640 1 -- 172.21.15.45:0/2309184386 shutdown_connections 2023-10-03T19:13:13.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.036+0000 7f1d48299640 1 -- 172.21.15.45:0/2309184386 >> 172.21.15.45:0/2309184386 conn(0x7f1d400a20d0 msgr2=0x7f1d400a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:13.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.036+0000 7f1d48299640 1 -- 172.21.15.45:0/2309184386 shutdown_connections 2023-10-03T19:13:13.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.036+0000 7f1d48299640 1 -- 172.21.15.45:0/2309184386 wait complete. 2023-10-03T19:13:13.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.040+0000 7f1d48299640 1 Processor -- start 2023-10-03T19:13:13.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.040+0000 7f1d48299640 1 -- start start 2023-10-03T19:13:13.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.040+0000 7f1d48299640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d2c004d10 0x7f1d400bf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:13.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.040+0000 7f1d48299640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d40098e00 0x7f1d4006f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:13.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.040+0000 7f1d48299640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d40099450 0x7f1d40147980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:13.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.040+0000 7f1d48299640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4014d4d0 con 0x7f1d40099450 2023-10-03T19:13:13.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.040+0000 7f1d48299640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d400bfbe0 con 0x7f1d2c004d10 2023-10-03T19:13:13.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.040+0000 7f1d48299640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d401e7bf0 con 0x7f1d40098e00 2023-10-03T19:13:13.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.040+0000 7f1d46836640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d40099450 0x7f1d40147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:13.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.040+0000 7f1d46836640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d40099450 0x7f1d40147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46562/0 (socket says 172.21.15.45:46562) 2023-10-03T19:13:13.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.040+0000 7f1d46836640 1 -- 172.21.15.45:0/4163974526 learned_addr learned my addr 172.21.15.45:0/4163974526 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:13.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.040+0000 7f1d46035640 1 --2- 172.21.15.45:0/4163974526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d2c004d10 0x7f1d400bf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:13.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.040+0000 7f1d45834640 1 --2- 172.21.15.45:0/4163974526 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d40098e00 0x7f1d4006f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:13.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.040+0000 7f1d46836640 1 -- 172.21.15.45:0/4163974526 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d40098e00 msgr2=0x7f1d4006f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:13.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.040+0000 7f1d46836640 1 --2- 172.21.15.45:0/4163974526 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d40098e00 0x7f1d4006f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:13.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.040+0000 7f1d46836640 1 -- 172.21.15.45:0/4163974526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d2c004d10 msgr2=0x7f1d400bf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:13.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.040+0000 7f1d46836640 1 --2- 172.21.15.45:0/4163974526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d2c004d10 0x7f1d400bf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:13.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.040+0000 7f1d46836640 1 -- 172.21.15.45:0/4163974526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d40071690 con 0x7f1d40099450 2023-10-03T19:13:13.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.040+0000 7f1d46836640 1 --2- 172.21.15.45:0/4163974526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d40099450 0x7f1d40147980 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1d38005040 tx=0x7f1d2c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:13.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.040+0000 7f1d32ffd640 1 -- 172.21.15.45:0/4163974526 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d380069e0 con 0x7f1d40099450 2023-10-03T19:13:13.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.040+0000 7f1d32ffd640 1 -- 172.21.15.45:0/4163974526 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d38006b40 con 0x7f1d40099450 2023-10-03T19:13:13.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.040+0000 7f1d48299640 1 -- 172.21.15.45:0/4163974526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d4006cf40 con 0x7f1d40099450 2023-10-03T19:13:13.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.040+0000 7f1d32ffd640 1 -- 172.21.15.45:0/4163974526 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d38007030 con 0x7f1d40099450 2023-10-03T19:13:13.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.040+0000 7f1d48299640 1 -- 172.21.15.45:0/4163974526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d40071820 con 0x7f1d40099450 2023-10-03T19:13:13.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.040+0000 7f1d48299640 1 -- 172.21.15.45:0/4163974526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d4004de80 con 0x7f1d40099450 2023-10-03T19:13:13.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.040+0000 7f1d32ffd640 1 -- 172.21.15.45:0/4163974526 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1d380b2050 con 0x7f1d40099450 2023-10-03T19:13:13.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.044+0000 7f1d32ffd640 1 --2- 172.21.15.45:0/4163974526 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1d240662b0 0x7f1d24068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:13.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.044+0000 7f1d32ffd640 1 -- 172.21.15.45:0/4163974526 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f1d3811cb90 con 0x7f1d40099450 2023-10-03T19:13:13.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.044+0000 7f1d46035640 1 --2- 172.21.15.45:0/4163974526 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1d240662b0 0x7f1d24068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:13.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.044+0000 7f1d46035640 1 --2- 172.21.15.45:0/4163974526 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1d240662b0 0x7f1d24068760 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009a30 tx=0x7f1d3c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:13.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.048+0000 7f1d32ffd640 1 -- 172.21.15.45:0/4163974526 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1d380ea1f0 con 0x7f1d40099450 2023-10-03T19:13:13.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.200+0000 7f1d48299640 1 -- 172.21.15.45:0/4163974526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1d4006fba0 con 0x7f1d40099450 2023-10-03T19:13:13.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.868+0000 7f1d32ffd640 1 -- 172.21.15.45:0/4163974526 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1d380b00d0 con 0x7f1d40099450 2023-10-03T19:13:13.873 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-10-03T19:13:13.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.872+0000 7f1d48299640 1 -- 172.21.15.45:0/4163974526 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1d240662b0 msgr2=0x7f1d24068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:13.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.872+0000 7f1d48299640 1 --2- 172.21.15.45:0/4163974526 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1d240662b0 0x7f1d24068760 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009a30 tx=0x7f1d3c008040 comp rx=0 tx=0).stop 2023-10-03T19:13:13.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.872+0000 7f1d48299640 1 -- 172.21.15.45:0/4163974526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d40099450 msgr2=0x7f1d40147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:13.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.872+0000 7f1d48299640 1 --2- 172.21.15.45:0/4163974526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d40099450 0x7f1d40147980 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1d38005040 tx=0x7f1d2c005800 comp rx=0 tx=0).stop 2023-10-03T19:13:13.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.872+0000 7f1d48299640 1 -- 172.21.15.45:0/4163974526 shutdown_connections 2023-10-03T19:13:13.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.872+0000 7f1d48299640 1 --2- 172.21.15.45:0/4163974526 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1d240662b0 0x7f1d24068760 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:13.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.872+0000 7f1d48299640 1 --2- 172.21.15.45:0/4163974526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d40099450 0x7f1d40147980 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:13.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.872+0000 7f1d48299640 1 --2- 172.21.15.45:0/4163974526 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d40098e00 0x7f1d4006f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:13.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.872+0000 7f1d48299640 1 --2- 172.21.15.45:0/4163974526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d2c004d10 0x7f1d400bf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:13.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.872+0000 7f1d48299640 1 -- 172.21.15.45:0/4163974526 >> 172.21.15.45:0/4163974526 conn(0x7f1d400a20d0 msgr2=0x7f1d400bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:13.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.872+0000 7f1d48299640 1 -- 172.21.15.45:0/4163974526 shutdown_connections 2023-10-03T19:13:13.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:13.872+0000 7f1d48299640 1 -- 172.21.15.45:0/4163974526 wait complete. 2023-10-03T19:13:13.903 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-03T19:13:13.903 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-03T19:13:13.903 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-03T19:13:13.903 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:13:13.904 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-03T19:13:13.904 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-03T19:13:13.904 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-03T19:13:13.904 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:13:13.904 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-03T19:13:13.904 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-03T19:13:13.904 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-03T19:13:13.905 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:13:13.915 INFO:tasks.ceph.mds.c:Stopped 2023-10-03T19:13:13.916 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-03T19:13:13.916 INFO:tasks.ceph.mds.a:Stopped 2023-10-03T19:13:13.917 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-03T19:13:13.920 INFO:tasks.ceph.mds.b:Stopped 2023-10-03T19:13:13.921 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-03T19:13:13.961 INFO:tasks.ceph.mds.c:Started 2023-10-03T19:13:13.961 DEBUG:teuthology.parallel:result is None 2023-10-03T19:13:13.962 INFO:tasks.ceph.mds.a:Started 2023-10-03T19:13:13.962 DEBUG:teuthology.parallel:result is None 2023-10-03T19:13:13.965 INFO:tasks.ceph.mds.b:Started 2023-10-03T19:13:13.965 DEBUG:teuthology.parallel:result is None 2023-10-03T19:13:13.965 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-03T19:13:14.033 INFO:tasks.ceph.mds.b.smithi079.stdout:starting mds.b at 2023-10-03T19:13:14.385 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-10-03T19:13:14.385 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-10-03T19:13:14.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.092+0000 7f74ddd99640 1 Processor -- start 2023-10-03T19:13:14.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.092+0000 7f74ddd99640 1 -- start start 2023-10-03T19:13:14.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.092+0000 7f74ddd99640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74d80bd130 0x7f74d80bec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:14.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.092+0000 7f74ddd99640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d80bc0b0 con 0x7f74d80b6370 2023-10-03T19:13:14.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.092+0000 7f74ddd99640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d80bb740 con 0x7f74d80bff30 2023-10-03T19:13:14.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.092+0000 7f74ddd99640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d80bf870 con 0x7f74d80bd130 2023-10-03T19:13:14.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.096+0000 7f74d7fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f74d80b6370 0x7f74d80bf160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34874/0 (socket says 172.21.15.45:34874) 2023-10-03T19:13:14.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.096+0000 7f74d7fff640 1 -- 172.21.15.45:0/1904446143 learned_addr learned my addr 172.21.15.45:0/1904446143 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:14.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.096+0000 7f74d6ffd640 1 --2- 172.21.15.45:0/1904446143 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74d80bd130 0x7f74d80bec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:14.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.096+0000 7f74d67fc640 1 -- 172.21.15.45:0/1904446143 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 878578080 0 0) 0x7f74d80bc0b0 con 0x7f74d80b6370 2023-10-03T19:13:14.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.096+0000 7f74d67fc640 1 -- 172.21.15.45:0/1904446143 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74c0003530 con 0x7f74d80b6370 2023-10-03T19:13:14.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.096+0000 7f74d67fc640 1 -- 172.21.15.45:0/1904446143 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1401432068 0 0) 0x7f74d80bb740 con 0x7f74d80bff30 2023-10-03T19:13:14.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.096+0000 7f74d67fc640 1 -- 172.21.15.45:0/1904446143 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74d80bc0b0 con 0x7f74d80bff30 2023-10-03T19:13:14.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.096+0000 7f74d6ffd640 1 -- 172.21.15.45:0/1904446143 >> v1:172.21.15.79:6789/0 conn(0x7f74d80bff30 legacy=0x7f74d80bc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:14.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.096+0000 7f74d6ffd640 1 -- 172.21.15.45:0/1904446143 >> v1:172.21.15.45:6789/0 conn(0x7f74d80b6370 legacy=0x7f74d80bf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:14.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.096+0000 7f74d6ffd640 1 -- 172.21.15.45:0/1904446143 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d80bba20 con 0x7f74d80bd130 2023-10-03T19:13:14.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.096+0000 7f74d6ffd640 1 --2- 172.21.15.45:0/1904446143 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74d80bd130 0x7f74d80bec20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f74cc0097f0 tx=0x7f74cc01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3095abe7223b9ae8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:14.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.096+0000 7f74d67fc640 1 -- 172.21.15.45:0/1904446143 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc0ab650 con 0x7f74d80bd130 2023-10-03T19:13:14.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.096+0000 7f74d67fc640 1 -- 172.21.15.45:0/1904446143 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74cc0ab7b0 con 0x7f74d80bd130 2023-10-03T19:13:14.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.096+0000 7f74d67fc640 1 -- 172.21.15.45:0/1904446143 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc0abb20 con 0x7f74d80bd130 2023-10-03T19:13:14.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.096+0000 7f74ddd99640 1 -- 172.21.15.45:0/1904446143 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74d80bd130 msgr2=0x7f74d80bec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:14.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.096+0000 7f74ddd99640 1 --2- 172.21.15.45:0/1904446143 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74d80bd130 0x7f74d80bec20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f74cc0097f0 tx=0x7f74cc01c490 comp rx=0 tx=0).stop 2023-10-03T19:13:14.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.096+0000 7f74ddd99640 1 -- 172.21.15.45:0/1904446143 shutdown_connections 2023-10-03T19:13:14.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.096+0000 7f74ddd99640 1 --2- 172.21.15.45:0/1904446143 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74d80bd130 0x7f74d80bec20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:14.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.096+0000 7f74ddd99640 1 -- 172.21.15.45:0/1904446143 >> 172.21.15.45:0/1904446143 conn(0x7f74d80c0d20 msgr2=0x7f74d80c1120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:14.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.096+0000 7f74ddd99640 1 -- 172.21.15.45:0/1904446143 shutdown_connections 2023-10-03T19:13:14.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.096+0000 7f74ddd99640 1 -- 172.21.15.45:0/1904446143 wait complete. 2023-10-03T19:13:14.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.100+0000 7f74ddd99640 1 Processor -- start 2023-10-03T19:13:14.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.100+0000 7f74ddd99640 1 -- start start 2023-10-03T19:13:14.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.100+0000 7f74ddd99640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74d80b6370 0x7f74d814e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:14.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.100+0000 7f74ddd99640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d80bd130 0x7f74d81e7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:14.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.100+0000 7f74ddd99640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74d80bff30 0x7f74d813ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:14.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.100+0000 7f74ddd99640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d813f720 con 0x7f74d80bd130 2023-10-03T19:13:14.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.100+0000 7f74ddd99640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d814fb90 con 0x7f74d80b6370 2023-10-03T19:13:14.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.100+0000 7f74ddd99640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d814db70 con 0x7f74d80bff30 2023-10-03T19:13:14.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.100+0000 7f74d6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d80bd130 0x7f74d81e7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:14.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.100+0000 7f74d6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d80bd130 0x7f74d81e7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46596/0 (socket says 172.21.15.45:46596) 2023-10-03T19:13:14.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.100+0000 7f74d6ffd640 1 -- 172.21.15.45:0/2518879744 learned_addr learned my addr 172.21.15.45:0/2518879744 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:14.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.100+0000 7f74d7fff640 1 --2- 172.21.15.45:0/2518879744 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74d80bff30 0x7f74d813ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:14.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.100+0000 7f74d77fe640 1 --2- 172.21.15.45:0/2518879744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74d80b6370 0x7f74d814e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:14.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.100+0000 7f74d6ffd640 1 -- 172.21.15.45:0/2518879744 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74d80bff30 msgr2=0x7f74d813ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:14.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.100+0000 7f74d6ffd640 1 --2- 172.21.15.45:0/2518879744 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74d80bff30 0x7f74d813ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:14.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.100+0000 7f74d6ffd640 1 -- 172.21.15.45:0/2518879744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74d80b6370 msgr2=0x7f74d814e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.100+0000 7f74d6ffd640 1 --2- 172.21.15.45:0/2518879744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74d80b6370 0x7f74d814e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.100+0000 7f74d6ffd640 1 -- 172.21.15.45:0/2518879744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74cc009420 con 0x7f74d80bd130 2023-10-03T19:13:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.100+0000 7f74d77fe640 1 --2- 172.21.15.45:0/2518879744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74d80b6370 0x7f74d814e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:13:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.100+0000 7f74d6ffd640 1 --2- 172.21.15.45:0/2518879744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d80bd130 0x7f74d81e7880 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f74cc000c10 tx=0x7f74cc01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.100+0000 7f74bffff640 1 -- 172.21.15.45:0/2518879744 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc0bf610 con 0x7f74d80bd130 2023-10-03T19:13:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.100+0000 7f74bffff640 1 -- 172.21.15.45:0/2518879744 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74cc0bf770 con 0x7f74d80bd130 2023-10-03T19:13:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.100+0000 7f74ddd99640 1 -- 172.21.15.45:0/2518879744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d80bbd40 con 0x7f74d80bd130 2023-10-03T19:13:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.100+0000 7f74bffff640 1 -- 172.21.15.45:0/2518879744 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc0bfae0 con 0x7f74d80bd130 2023-10-03T19:13:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.100+0000 7f74ddd99640 1 -- 172.21.15.45:0/2518879744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d80c0300 con 0x7f74d80bd130 2023-10-03T19:13:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.100+0000 7f74ddd99640 1 -- 172.21.15.45:0/2518879744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d815a590 con 0x7f74d80bd130 2023-10-03T19:13:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.100+0000 7f74bffff640 1 -- 172.21.15.45:0/2518879744 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f74cc0bfc40 con 0x7f74d80bd130 2023-10-03T19:13:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.104+0000 7f74bffff640 1 --2- 172.21.15.45:0/2518879744 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f74c4066280 0x7f74c4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:14.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.104+0000 7f74bffff640 1 -- 172.21.15.45:0/2518879744 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f74cc11e4c0 con 0x7f74d80bd130 2023-10-03T19:13:14.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.104+0000 7f74d77fe640 1 --2- 172.21.15.45:0/2518879744 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f74c4066280 0x7f74c4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:14.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.104+0000 7f74d77fe640 1 --2- 172.21.15.45:0/2518879744 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f74c4066280 0x7f74c4068730 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f74c8001740 tx=0x7f74c8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:14.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.108+0000 7f74bffff640 1 -- 172.21.15.45:0/2518879744 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f74cc0ebe20 con 0x7f74d80bd130 2023-10-03T19:13:14.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:14.304+0000 7f74ddd99640 1 -- 172.21.15.45:0/2518879744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f74d804de80 con 0x7f74d80bd130 2023-10-03T19:13:15.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.076+0000 7f74bffff640 1 -- 172.21.15.45:0/2518879744 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v31) v1 ==== 97+0+0 (secure 0 0 0) 0x7f74cc0ef440 con 0x7f74d80bd130 2023-10-03T19:13:15.082 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-10-03T19:13:15.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.080+0000 7f74ddd99640 1 -- 172.21.15.45:0/2518879744 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f74c4066280 msgr2=0x7f74c4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:15.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.080+0000 7f74ddd99640 1 --2- 172.21.15.45:0/2518879744 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f74c4066280 0x7f74c4068730 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f74c8001740 tx=0x7f74c8009040 comp rx=0 tx=0).stop 2023-10-03T19:13:15.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.080+0000 7f74ddd99640 1 -- 172.21.15.45:0/2518879744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d80bd130 msgr2=0x7f74d81e7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:15.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.080+0000 7f74ddd99640 1 --2- 172.21.15.45:0/2518879744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d80bd130 0x7f74d81e7880 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f74cc000c10 tx=0x7f74cc01acd0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.080+0000 7f74ddd99640 1 -- 172.21.15.45:0/2518879744 shutdown_connections 2023-10-03T19:13:15.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.080+0000 7f74ddd99640 1 --2- 172.21.15.45:0/2518879744 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f74c4066280 0x7f74c4068730 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.080+0000 7f74ddd99640 1 --2- 172.21.15.45:0/2518879744 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74d80bff30 0x7f74d813ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.080+0000 7f74ddd99640 1 --2- 172.21.15.45:0/2518879744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d80bd130 0x7f74d81e7880 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.080+0000 7f74ddd99640 1 --2- 172.21.15.45:0/2518879744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74d80b6370 0x7f74d814e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.080+0000 7f74ddd99640 1 -- 172.21.15.45:0/2518879744 >> 172.21.15.45:0/2518879744 conn(0x7f74d80c0d20 msgr2=0x7f74d814a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:15.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.080+0000 7f74ddd99640 1 -- 172.21.15.45:0/2518879744 shutdown_connections 2023-10-03T19:13:15.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.080+0000 7f74ddd99640 1 -- 172.21.15.45:0/2518879744 wait complete. 2023-10-03T19:13:15.106 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-03T19:13:15.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.228+0000 7f19ae5b2640 1 Processor -- start 2023-10-03T19:13:15.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.228+0000 7f19ae5b2640 1 -- start start 2023-10-03T19:13:15.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.232+0000 7f19ae5b2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f19a80bcb60 0x7f19a806c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:15.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.232+0000 7f19ae5b2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f19a806c7d0 0x7f19a8155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:15.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.232+0000 7f19ae5b2640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a814b610 con 0x7f19a8148b90 2023-10-03T19:13:15.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.232+0000 7f19ae5b2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a80a3670 con 0x7f19a80bcb60 2023-10-03T19:13:15.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.232+0000 7f19ae5b2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a814b370 con 0x7f19a806c7d0 2023-10-03T19:13:15.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.232+0000 7f19a77fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f19a80bcb60 0x7f19a806c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:15.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.232+0000 7f19a77fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f19a80bcb60 0x7f19a806c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36328/0 (socket says 172.21.15.45:36328) 2023-10-03T19:13:15.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.232+0000 7f19a77fe640 1 -- 172.21.15.45:0/3748712052 learned_addr learned my addr 172.21.15.45:0/3748712052 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:15.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.232+0000 7f19a77fe640 1 -- 172.21.15.45:0/3748712052 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f19a806c7d0 msgr2=0x7f19a8155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:15.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.232+0000 7f19acb4f640 1 --2- 172.21.15.45:0/3748712052 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f19a806c7d0 0x7f19a8155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:15.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.232+0000 7f19a77fe640 1 --2- 172.21.15.45:0/3748712052 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f19a806c7d0 0x7f19a8155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.232+0000 7f19a77fe640 1 -- 172.21.15.45:0/3748712052 >> v1:172.21.15.79:6789/0 conn(0x7f19a8148b90 legacy=0x7f19a80bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:15.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.232+0000 7f19a77fe640 1 -- 172.21.15.45:0/3748712052 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a80a5580 con 0x7f19a80bcb60 2023-10-03T19:13:15.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.232+0000 7f19acb4f640 1 --2- 172.21.15.45:0/3748712052 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f19a806c7d0 0x7f19a8155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:15.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.232+0000 7f19a77fe640 1 --2- 172.21.15.45:0/3748712052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19a80bcb60 0x7f19a806c290 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f199c009870 tx=0x7f199c01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673c58cbb8e37f76 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:15.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.232+0000 7f19a6ffd640 1 -- 172.21.15.45:0/3748712052 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c0a8a30 con 0x7f19a80bcb60 2023-10-03T19:13:15.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.232+0000 7f19a6ffd640 1 -- 172.21.15.45:0/3748712052 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199c0a8b90 con 0x7f19a80bcb60 2023-10-03T19:13:15.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.232+0000 7f19a6ffd640 1 -- 172.21.15.45:0/3748712052 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c0b0440 con 0x7f19a80bcb60 2023-10-03T19:13:15.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19ae5b2640 1 -- 172.21.15.45:0/3748712052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19a80bcb60 msgr2=0x7f19a806c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:15.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19ae5b2640 1 --2- 172.21.15.45:0/3748712052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19a80bcb60 0x7f19a806c290 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f199c009870 tx=0x7f199c01ed30 comp rx=0 tx=0).stop 2023-10-03T19:13:15.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19ae5b2640 1 -- 172.21.15.45:0/3748712052 shutdown_connections 2023-10-03T19:13:15.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19ae5b2640 1 --2- 172.21.15.45:0/3748712052 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f19a806c7d0 0x7f19a8155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19ae5b2640 1 --2- 172.21.15.45:0/3748712052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19a80bcb60 0x7f19a806c290 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19ae5b2640 1 -- 172.21.15.45:0/3748712052 >> 172.21.15.45:0/3748712052 conn(0x7f19a80bcf50 msgr2=0x7f19a80bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:15.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19ae5b2640 1 -- 172.21.15.45:0/3748712052 shutdown_connections 2023-10-03T19:13:15.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19ae5b2640 1 -- 172.21.15.45:0/3748712052 wait complete. 2023-10-03T19:13:15.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19ae5b2640 1 Processor -- start 2023-10-03T19:13:15.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19ae5b2640 1 -- start start 2023-10-03T19:13:15.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19ae5b2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f19a806c7d0 0x7f19a80bb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:15.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19ae5b2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19a80bcb60 0x7f19a81e5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:15.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19ae5b2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19a8148b90 0x7f19a81e5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:15.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19ae5b2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a814f860 con 0x7f19a80bcb60 2023-10-03T19:13:15.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19ae5b2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a814f2f0 con 0x7f19a8148b90 2023-10-03T19:13:15.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19ae5b2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a80bb5f0 con 0x7f19a806c7d0 2023-10-03T19:13:15.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19a77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19a80bcb60 0x7f19a81e5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:15.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19a77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19a80bcb60 0x7f19a81e5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36334/0 (socket says 172.21.15.45:36334) 2023-10-03T19:13:15.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19a77fe640 1 -- 172.21.15.45:0/428299169 learned_addr learned my addr 172.21.15.45:0/428299169 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:15.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19acb4f640 1 --2- 172.21.15.45:0/428299169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19a8148b90 0x7f19a81e5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:15.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19a77fe640 1 -- 172.21.15.45:0/428299169 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f19a806c7d0 msgr2=0x7f19a80bb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:15.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19a77fe640 1 --2- 172.21.15.45:0/428299169 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f19a806c7d0 0x7f19a80bb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19a77fe640 1 -- 172.21.15.45:0/428299169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19a8148b90 msgr2=0x7f19a81e5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:15.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19a77fe640 1 --2- 172.21.15.45:0/428299169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19a8148b90 0x7f19a81e5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19a77fe640 1 -- 172.21.15.45:0/428299169 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c0094d0 con 0x7f19a80bcb60 2023-10-03T19:13:15.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19acb4f640 1 --2- 172.21.15.45:0/428299169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19a8148b90 0x7f19a81e5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:15.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19a77fe640 1 --2- 172.21.15.45:0/428299169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19a80bcb60 0x7f19a81e5040 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f199c01c960 tx=0x7f199c01bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:15.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19a4ff9640 1 -- 172.21.15.45:0/428299169 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c0be070 con 0x7f19a80bcb60 2023-10-03T19:13:15.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19a4ff9640 1 -- 172.21.15.45:0/428299169 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199c0ba400 con 0x7f19a80bcb60 2023-10-03T19:13:15.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19a4ff9640 1 -- 172.21.15.45:0/428299169 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c0ba7b0 con 0x7f19a80bcb60 2023-10-03T19:13:15.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19ae5b2640 1 -- 172.21.15.45:0/428299169 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a80bc670 con 0x7f19a80bcb60 2023-10-03T19:13:15.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.236+0000 7f19ae5b2640 1 -- 172.21.15.45:0/428299169 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a80a5820 con 0x7f19a80bcb60 2023-10-03T19:13:15.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.240+0000 7f19ae5b2640 1 -- 172.21.15.45:0/428299169 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a8148f60 con 0x7f19a80bcb60 2023-10-03T19:13:15.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.240+0000 7f19a4ff9640 1 -- 172.21.15.45:0/428299169 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f199c0ba910 con 0x7f19a80bcb60 2023-10-03T19:13:15.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.240+0000 7f19a4ff9640 1 --2- 172.21.15.45:0/428299169 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1994066280 0x7f1994068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:15.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.240+0000 7f19a4ff9640 1 -- 172.21.15.45:0/428299169 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f199c121770 con 0x7f19a80bcb60 2023-10-03T19:13:15.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.240+0000 7f19a7fff640 1 --2- 172.21.15.45:0/428299169 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1994066280 0x7f1994068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:15.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.240+0000 7f19a7fff640 1 --2- 172.21.15.45:0/428299169 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1994066280 0x7f1994068730 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1998000f70 tx=0x7f19980079c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:15.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.244+0000 7f19a4ff9640 1 -- 172.21.15.45:0/428299169 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f199c0eefd0 con 0x7f19a80bcb60 2023-10-03T19:13:15.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.452+0000 7f19ae5b2640 1 -- 172.21.15.45:0/428299169 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f19a804de80 con 0x7f19a80bcb60 2023-10-03T19:13:15.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.452+0000 7f19a4ff9640 1 -- 172.21.15.45:0/428299169 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+5781 (secure 0 0 0) 0x7f199c0f25f0 con 0x7f19a80bcb60 2023-10-03T19:13:15.459 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:13:15.459 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-03T19:13:15.459 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-10-03T19:13:15.459 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:13:15.459 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-10-03T19:13:15.459 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlfyzhExAABLhtkQEZuiLwovBSO0kuAA==", 2023-10-03T19:13:15.459 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:13:15.460 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:13:15.460 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-03T19:13:15.460 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-03T19:13:15.460 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:13:15.460 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:13:15.460 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:13:15.460 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:13:15.460 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-10-03T19:13:15.460 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlzM8pIBAAMie9jpxS/xt2cymMpyJmiQ==", 2023-10-03T19:13:15.460 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:13:15.460 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:13:15.460 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-03T19:13:15.461 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-03T19:13:15.461 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:13:15.461 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:13:15.461 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:13:15.461 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:13:15.461 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-10-03T19:13:15.461 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlAsGOHBAAIHprnd9orKMQjzkNQZz94A==", 2023-10-03T19:13:15.461 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:13:15.461 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:13:15.461 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-03T19:13:15.461 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-03T19:13:15.461 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:13:15.462 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:13:15.462 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:13:15.462 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:13:15.462 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-10-03T19:13:15.462 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBmZxxlb0zQLRAA3z+f4/jsLTLUmFg/WOD/Xg==", 2023-10-03T19:13:15.462 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:13:15.462 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:13:15.462 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:13:15.462 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:13:15.462 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:13:15.462 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:13:15.462 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:13:15.463 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-10-03T19:13:15.463 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBpZxxlTjtZNRAA3HFqXjGLO7JoX+GBegGfqw==", 2023-10-03T19:13:15.463 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:13:15.463 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:13:15.463 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:13:15.463 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:13:15.463 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:13:15.463 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:13:15.463 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:13:15.463 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-10-03T19:13:15.463 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBtZxxld6kUBBAATcGPrxBbPLswrUHihB7AgQ==", 2023-10-03T19:13:15.463 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:13:15.463 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:13:15.464 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:13:15.464 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:13:15.464 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:13:15.464 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:13:15.464 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:13:15.464 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-10-03T19:13:15.464 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBwZxxlWUL3DBAAk4TW6N5mpjjyP7QgQAIuDw==", 2023-10-03T19:13:15.464 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:13:15.464 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:13:15.464 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:13:15.464 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:13:15.464 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:13:15.465 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:13:15.465 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:13:15.465 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-10-03T19:13:15.465 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQB2ZxxlK3KNIhAAjhvxAU0shg+5PbJfq1LEog==", 2023-10-03T19:13:15.465 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:13:15.465 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:13:15.465 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:13:15.465 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:13:15.465 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:13:15.465 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:13:15.465 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:13:15.465 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-10-03T19:13:15.466 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQB5ZxxlRAxuKhAA5ma3eAt3kkukdhgZN4wwEg==", 2023-10-03T19:13:15.466 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:13:15.466 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:13:15.466 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:13:15.466 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:13:15.466 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:13:15.466 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:13:15.466 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:13:15.466 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-10-03T19:13:15.466 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQB8ZxxlkQqOMxAAuKGy7vJQLUDsqgjPVtWMWg==", 2023-10-03T19:13:15.466 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:13:15.466 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:13:15.467 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:13:15.467 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:13:15.467 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:13:15.467 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:13:15.467 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:13:15.467 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-10-03T19:13:15.467 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCAZxxl65r/ABAAeWtP7nMLVm5NBU4vWQ6ceg==", 2023-10-03T19:13:15.467 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:13:15.467 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:13:15.467 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:13:15.467 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:13:15.467 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:13:15.468 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:13:15.468 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:13:15.468 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-10-03T19:13:15.468 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlg5PgJRAAvvN5Xrw/ZW4rSdJ1/adnzA==", 2023-10-03T19:13:15.468 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:13:15.468 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:13:15.468 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-10-03T19:13:15.468 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-10-03T19:13:15.468 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-10-03T19:13:15.468 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:13:15.468 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:13:15.468 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:13:15.468 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-10-03T19:13:15.469 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlKkW+KRAALzVyQ+iTWuD5FMLDKXNVTg==", 2023-10-03T19:13:15.469 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:13:15.469 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:13:15.469 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-10-03T19:13:15.469 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-10-03T19:13:15.469 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-10-03T19:13:15.469 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:13:15.469 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:13:15.469 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:13:15.469 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-10-03T19:13:15.469 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBkZxxldHb4LxAAc/oJcXFjNgH5Wxwv04WHgw==", 2023-10-03T19:13:15.469 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:13:15.470 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-10-03T19:13:15.470 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-03T19:13:15.470 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-03T19:13:15.470 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:13:15.470 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:13:15.470 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:13:15.470 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:13:15.470 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-mds", 2023-10-03T19:13:15.470 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCFZxxlm6YYLxAAGijD5Q8KbBGUK1Cdh44crA==", 2023-10-03T19:13:15.470 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:13:15.470 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-mds" 2023-10-03T19:13:15.470 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:13:15.471 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:13:15.471 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:13:15.471 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-mgr", 2023-10-03T19:13:15.471 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCFZxxlIbUYLxAA3vfjSSWbF6S1qTUUoe9oyw==", 2023-10-03T19:13:15.471 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:13:15.471 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-03T19:13:15.471 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:13:15.471 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:13:15.471 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:13:15.471 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-osd", 2023-10-03T19:13:15.471 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCFZxxlt8EYLxAAviff4GUcdPj6+9jUg3T1hQ==", 2023-10-03T19:13:15.471 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:13:15.471 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-osd" 2023-10-03T19:13:15.472 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:13:15.472 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:13:15.472 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:13:15.472 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-rbd", 2023-10-03T19:13:15.472 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCFZxxlfM8YLxAAs1ogxIR47Exk0H0kOWwszw==", 2023-10-03T19:13:15.472 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:13:15.472 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-03T19:13:15.472 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:13:15.472 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:13:15.472 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:13:15.472 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-03T19:13:15.473 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCFZxxlnd0YLxAAiUWB45oBiAIMwA/NMegFgA==", 2023-10-03T19:13:15.473 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:13:15.473 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-03T19:13:15.473 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:13:15.473 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:13:15.473 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:13:15.473 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-rgw", 2023-10-03T19:13:15.473 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCFZxxleOkYLxAAQqc3p8AETZxT1RcTNYIzhw==", 2023-10-03T19:13:15.473 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:13:15.473 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-03T19:13:15.473 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:13:15.473 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:13:15.473 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:13:15.474 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-10-03T19:13:15.474 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxl4txNEBAAonNqY2PmtF0vZGFmvzxIKw==", 2023-10-03T19:13:15.474 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:13:15.474 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-10-03T19:13:15.474 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-10-03T19:13:15.474 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:13:15.474 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:13:15.474 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:13:15.474 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:13:15.474 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-10-03T19:13:15.474 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlUmKhDRAA7UKlGP9q9aKsk+J+nTxrUA==", 2023-10-03T19:13:15.475 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:13:15.475 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-10-03T19:13:15.475 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-10-03T19:13:15.475 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:13:15.475 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:13:15.475 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:13:15.475 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-10-03T19:13:15.475 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-03T19:13:15.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.456+0000 7f19ae5b2640 1 -- 172.21.15.45:0/428299169 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1994066280 msgr2=0x7f1994068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:15.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.456+0000 7f19ae5b2640 1 --2- 172.21.15.45:0/428299169 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1994066280 0x7f1994068730 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1998000f70 tx=0x7f19980079c0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.456+0000 7f19ae5b2640 1 -- 172.21.15.45:0/428299169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19a80bcb60 msgr2=0x7f19a81e5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:15.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.456+0000 7f19ae5b2640 1 --2- 172.21.15.45:0/428299169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19a80bcb60 0x7f19a81e5040 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f199c01c960 tx=0x7f199c01bad0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.456+0000 7f19ae5b2640 1 -- 172.21.15.45:0/428299169 shutdown_connections 2023-10-03T19:13:15.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.456+0000 7f19ae5b2640 1 --2- 172.21.15.45:0/428299169 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1994066280 0x7f1994068730 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.456+0000 7f19ae5b2640 1 --2- 172.21.15.45:0/428299169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19a8148b90 0x7f19a81e5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.456+0000 7f19ae5b2640 1 --2- 172.21.15.45:0/428299169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19a80bcb60 0x7f19a81e5040 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.456+0000 7f19ae5b2640 1 --2- 172.21.15.45:0/428299169 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f19a806c7d0 0x7f19a80bb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.456+0000 7f19ae5b2640 1 -- 172.21.15.45:0/428299169 >> 172.21.15.45:0/428299169 conn(0x7f19a80bcf50 msgr2=0x7f19a814aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:15.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.456+0000 7f19ae5b2640 1 -- 172.21.15.45:0/428299169 shutdown_connections 2023-10-03T19:13:15.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.456+0000 7f19ae5b2640 1 -- 172.21.15.45:0/428299169 wait complete. 2023-10-03T19:13:15.478 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-03T19:13:15.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.592+0000 7f777a616640 1 Processor -- start 2023-10-03T19:13:15.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.592+0000 7f777a616640 1 -- start start 2023-10-03T19:13:15.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.596+0000 7f777a616640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f77740bf370 0x7f7774149760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:15.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.596+0000 7f777a616640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f777414c770 con 0x7f777414d310 2023-10-03T19:13:15.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.596+0000 7f777a616640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f777406efe0 con 0x7f77740a7100 2023-10-03T19:13:15.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.596+0000 7f777a616640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77740bebc0 con 0x7f77740bf370 2023-10-03T19:13:15.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.596+0000 7f7773fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f77740bf370 0x7f7774149760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:15.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.596+0000 7f7778bb3640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f777414d310 0x7f777414fbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50984/0 (socket says 172.21.15.45:50984) 2023-10-03T19:13:15.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.596+0000 7f7773fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f77740bf370 0x7f7774149760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36344/0 (socket says 172.21.15.45:36344) 2023-10-03T19:13:15.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.596+0000 7f7778bb3640 1 -- 172.21.15.45:0/3964517038 learned_addr learned my addr 172.21.15.45:0/3964517038 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:15.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.596+0000 7f7773fff640 1 -- 172.21.15.45:0/3964517038 >> v1:172.21.15.79:6789/0 conn(0x7f77740a7100 legacy=0x7f777414cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:15.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.596+0000 7f7773fff640 1 -- 172.21.15.45:0/3964517038 >> v1:172.21.15.45:6789/0 conn(0x7f777414d310 legacy=0x7f777414fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:15.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.596+0000 7f7772ffd640 1 -- 172.21.15.45:0/3964517038 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4162213945 0 0) 0x7f777414c770 con 0x7f777414d310 2023-10-03T19:13:15.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.596+0000 7f7773fff640 1 -- 172.21.15.45:0/3964517038 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777406f2c0 con 0x7f77740bf370 2023-10-03T19:13:15.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.596+0000 7f7773fff640 1 --2- 172.21.15.45:0/3964517038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77740bf370 0x7f7774149760 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7764009d90 tx=0x7f776401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb23d5126e66dbff server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:15.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.596+0000 7f7772ffd640 1 -- 172.21.15.45:0/3964517038 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77640a59a0 con 0x7f77740bf370 2023-10-03T19:13:15.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.596+0000 7f7772ffd640 1 -- 172.21.15.45:0/3964517038 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77640a5b00 con 0x7f77740bf370 2023-10-03T19:13:15.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.596+0000 7f7772ffd640 1 -- 172.21.15.45:0/3964517038 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77640a5e90 con 0x7f77740bf370 2023-10-03T19:13:15.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.596+0000 7f777a616640 1 -- 172.21.15.45:0/3964517038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77740bf370 msgr2=0x7f7774149760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:15.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.596+0000 7f777a616640 1 --2- 172.21.15.45:0/3964517038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77740bf370 0x7f7774149760 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7764009d90 tx=0x7f776401c8c0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.596+0000 7f777a616640 1 -- 172.21.15.45:0/3964517038 shutdown_connections 2023-10-03T19:13:15.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.596+0000 7f777a616640 1 --2- 172.21.15.45:0/3964517038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77740bf370 0x7f7774149760 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.596+0000 7f777a616640 1 -- 172.21.15.45:0/3964517038 >> 172.21.15.45:0/3964517038 conn(0x7f777406bce0 msgr2=0x7f777406c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:15.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.596+0000 7f777a616640 1 -- 172.21.15.45:0/3964517038 shutdown_connections 2023-10-03T19:13:15.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.596+0000 7f777a616640 1 -- 172.21.15.45:0/3964517038 wait complete. 2023-10-03T19:13:15.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.600+0000 7f777a616640 1 Processor -- start 2023-10-03T19:13:15.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.600+0000 7f777a616640 1 -- start start 2023-10-03T19:13:15.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.600+0000 7f777a616640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77740a7100 0x7f77741e81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:15.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.600+0000 7f777a616640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77740bf370 0x7f77741414b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:15.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.600+0000 7f777a616640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f777414d310 0x7f77741419f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:15.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.600+0000 7f777a616640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7774142960 con 0x7f777414d310 2023-10-03T19:13:15.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.600+0000 7f777a616640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77741e8a80 con 0x7f77740bf370 2023-10-03T19:13:15.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.600+0000 7f777a616640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77741426f0 con 0x7f77740a7100 2023-10-03T19:13:15.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.600+0000 7f7778bb3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f777414d310 0x7f77741419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:15.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.600+0000 7f7778bb3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f777414d310 0x7f77741419f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36360/0 (socket says 172.21.15.45:36360) 2023-10-03T19:13:15.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.600+0000 7f7778bb3640 1 -- 172.21.15.45:0/3390603579 learned_addr learned my addr 172.21.15.45:0/3390603579 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:15.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.600+0000 7f77737fe640 1 --2- 172.21.15.45:0/3390603579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77740bf370 0x7f77741414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:15.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.600+0000 7f7773fff640 1 --2- 172.21.15.45:0/3390603579 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77740a7100 0x7f77741e81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:15.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.600+0000 7f7778bb3640 1 -- 172.21.15.45:0/3390603579 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77740a7100 msgr2=0x7f77741e81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:15.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.600+0000 7f7778bb3640 1 --2- 172.21.15.45:0/3390603579 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77740a7100 0x7f77741e81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.600+0000 7f7778bb3640 1 -- 172.21.15.45:0/3390603579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77740bf370 msgr2=0x7f77741414b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:15.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.600+0000 7f7778bb3640 1 --2- 172.21.15.45:0/3390603579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77740bf370 0x7f77741414b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.600+0000 7f7778bb3640 1 -- 172.21.15.45:0/3390603579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7764009a70 con 0x7f777414d310 2023-10-03T19:13:15.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.600+0000 7f7773fff640 1 --2- 172.21.15.45:0/3390603579 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77740a7100 0x7f77741e81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:15.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.600+0000 7f7778bb3640 1 --2- 172.21.15.45:0/3390603579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f777414d310 0x7f77741419f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f776c00c4b0 tx=0x7f776c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:15.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.600+0000 7f7770ff9640 1 -- 172.21.15.45:0/3390603579 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c0074e0 con 0x7f777414d310 2023-10-03T19:13:15.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.600+0000 7f7770ff9640 1 -- 172.21.15.45:0/3390603579 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776c007640 con 0x7f777414d310 2023-10-03T19:13:15.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.600+0000 7f7770ff9640 1 -- 172.21.15.45:0/3390603579 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c004a30 con 0x7f777414d310 2023-10-03T19:13:15.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.604+0000 7f777a616640 1 -- 172.21.15.45:0/3390603579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7774150b10 con 0x7f777414d310 2023-10-03T19:13:15.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.604+0000 7f777a616640 1 -- 172.21.15.45:0/3390603579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f777414a0b0 con 0x7f777414d310 2023-10-03T19:13:15.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.604+0000 7f777a616640 1 -- 172.21.15.45:0/3390603579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f777415afb0 con 0x7f777414d310 2023-10-03T19:13:15.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.604+0000 7f7770ff9640 1 -- 172.21.15.45:0/3390603579 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f776c004b90 con 0x7f777414d310 2023-10-03T19:13:15.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.604+0000 7f7770ff9640 1 --2- 172.21.15.45:0/3390603579 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7760066280 0x7f7760068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:15.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.604+0000 7f7770ff9640 1 -- 172.21.15.45:0/3390603579 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f776c082b80 con 0x7f777414d310 2023-10-03T19:13:15.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.604+0000 7f7773fff640 1 --2- 172.21.15.45:0/3390603579 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7760066280 0x7f7760068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:15.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.604+0000 7f7773fff640 1 --2- 172.21.15.45:0/3390603579 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7760066280 0x7f7760068730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f77640af000 tx=0x7f77640a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:15.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.608+0000 7f7770ff9640 1 -- 172.21.15.45:0/3390603579 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f776c0503e0 con 0x7f777414d310 2023-10-03T19:13:15.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.816+0000 7f777a616640 1 -- 172.21.15.45:0/3390603579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f777404def0 con 0x7f777414d310 2023-10-03T19:13:15.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.824+0000 7f7770ff9640 1 -- 172.21.15.45:0/3390603579 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f777404def0 con 0x7f777414d310 2023-10-03T19:13:15.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.824+0000 7f777a616640 1 -- 172.21.15.45:0/3390603579 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7760066280 msgr2=0x7f7760068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:15.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.824+0000 7f777a616640 1 --2- 172.21.15.45:0/3390603579 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7760066280 0x7f7760068730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f77640af000 tx=0x7f77640a7070 comp rx=0 tx=0).stop 2023-10-03T19:13:15.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.824+0000 7f777a616640 1 -- 172.21.15.45:0/3390603579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f777414d310 msgr2=0x7f77741419f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:15.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.824+0000 7f777a616640 1 --2- 172.21.15.45:0/3390603579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f777414d310 0x7f77741419f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f776c00c4b0 tx=0x7f776c00c970 comp rx=0 tx=0).stop 2023-10-03T19:13:15.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.824+0000 7f777a616640 1 -- 172.21.15.45:0/3390603579 shutdown_connections 2023-10-03T19:13:15.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.824+0000 7f777a616640 1 --2- 172.21.15.45:0/3390603579 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7760066280 0x7f7760068730 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.824+0000 7f777a616640 1 --2- 172.21.15.45:0/3390603579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f777414d310 0x7f77741419f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.824+0000 7f777a616640 1 --2- 172.21.15.45:0/3390603579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77740bf370 0x7f77741414b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.824+0000 7f777a616640 1 --2- 172.21.15.45:0/3390603579 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77740a7100 0x7f77741e81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.824+0000 7f777a616640 1 -- 172.21.15.45:0/3390603579 >> 172.21.15.45:0/3390603579 conn(0x7f777406bce0 msgr2=0x7f77740bdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:15.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.824+0000 7f777a616640 1 -- 172.21.15.45:0/3390603579 shutdown_connections 2023-10-03T19:13:15.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.824+0000 7f777a616640 1 -- 172.21.15.45:0/3390603579 wait complete. 2023-10-03T19:13:15.848 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-03T19:13:15.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.960+0000 7fa2d6a7e640 1 Processor -- start 2023-10-03T19:13:15.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.960+0000 7fa2d6a7e640 1 -- start start 2023-10-03T19:13:15.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.960+0000 7fa2d6a7e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa2d006f170 0x7fa2d0150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:15.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.960+0000 7fa2d6a7e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2d00bc8b0 0x7fa2d014ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:15.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.960+0000 7fa2d6a7e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa2d006d170 0x7fa2d014cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:15.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.960+0000 7fa2d6a7e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d006cac0 con 0x7fa2d006f170 2023-10-03T19:13:15.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.960+0000 7fa2d6a7e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d014d4f0 con 0x7fa2d006d170 2023-10-03T19:13:15.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.960+0000 7fa2d6a7e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d00720d0 con 0x7fa2d00bc8b0 2023-10-03T19:13:15.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.960+0000 7fa2d481a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa2d006f170 0x7fa2d0150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:15.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.960+0000 7fa2d481a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa2d006f170 0x7fa2d0150190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36370/0 (socket says 172.21.15.45:36370) 2023-10-03T19:13:15.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.960+0000 7fa2d481a640 1 -- 172.21.15.45:0/3860876531 learned_addr learned my addr 172.21.15.45:0/3860876531 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:15.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.960+0000 7fa2cffff640 1 --2- 172.21.15.45:0/3860876531 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2d00bc8b0 0x7fa2d014ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:15.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.960+0000 7fa2d481a640 1 -- 172.21.15.45:0/3860876531 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2d00bc8b0 msgr2=0x7fa2d014ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:15.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.960+0000 7fa2d481a640 1 --2- 172.21.15.45:0/3860876531 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2d00bc8b0 0x7fa2d014ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.960+0000 7fa2d501b640 1 --2- 172.21.15.45:0/3860876531 >> v2:172.21.15.79:3300/0 conn(0x7fa2d006d170 0x7fa2d014cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:15.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.960+0000 7fa2d481a640 1 -- 172.21.15.45:0/3860876531 >> v2:172.21.15.79:3300/0 conn(0x7fa2d006d170 msgr2=0x7fa2d014cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:15.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.960+0000 7fa2d481a640 1 --2- 172.21.15.45:0/3860876531 >> v2:172.21.15.79:3300/0 conn(0x7fa2d006d170 0x7fa2d014cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.960+0000 7fa2d481a640 1 -- 172.21.15.45:0/3860876531 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d00a5ab0 con 0x7fa2d006f170 2023-10-03T19:13:15.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2d481a640 1 --2- 172.21.15.45:0/3860876531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2d006f170 0x7fa2d0150190 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0070560 tx=0x7fa2b801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4fb0f5b49721060 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:15.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2cf7fe640 1 -- 172.21.15.45:0/3860876531 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b80a89b0 con 0x7fa2d006f170 2023-10-03T19:13:15.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2cf7fe640 1 -- 172.21.15.45:0/3860876531 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b80a8b10 con 0x7fa2d006f170 2023-10-03T19:13:15.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2cf7fe640 1 -- 172.21.15.45:0/3860876531 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b80a8ea0 con 0x7fa2d006f170 2023-10-03T19:13:15.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2d6a7e640 1 -- 172.21.15.45:0/3860876531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2d006f170 msgr2=0x7fa2d0150190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:15.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2d6a7e640 1 --2- 172.21.15.45:0/3860876531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2d006f170 0x7fa2d0150190 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0070560 tx=0x7fa2b801ecf0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2d6a7e640 1 -- 172.21.15.45:0/3860876531 shutdown_connections 2023-10-03T19:13:15.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2d6a7e640 1 --2- 172.21.15.45:0/3860876531 >> v2:172.21.15.79:3300/0 conn(0x7fa2d006d170 0x7fa2d014cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2d6a7e640 1 --2- 172.21.15.45:0/3860876531 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2d00bc8b0 0x7fa2d014ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2d6a7e640 1 --2- 172.21.15.45:0/3860876531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2d006f170 0x7fa2d0150190 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2d6a7e640 1 -- 172.21.15.45:0/3860876531 >> 172.21.15.45:0/3860876531 conn(0x7fa2d00bcf50 msgr2=0x7fa2d00bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:15.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2d6a7e640 1 -- 172.21.15.45:0/3860876531 shutdown_connections 2023-10-03T19:13:15.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2d6a7e640 1 -- 172.21.15.45:0/3860876531 wait complete. 2023-10-03T19:13:15.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2d6a7e640 1 Processor -- start 2023-10-03T19:13:15.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2d6a7e640 1 -- start start 2023-10-03T19:13:15.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2d6a7e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2d006d170 0x7fa2d00b9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:15.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2d6a7e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2d006f170 0x7fa2d01e4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:15.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2d6a7e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2d00bc8b0 0x7fa2d01e46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:15.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2d6a7e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d009b090 con 0x7fa2d006d170 2023-10-03T19:13:15.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2d6a7e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d00ba090 con 0x7fa2d006f170 2023-10-03T19:13:15.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2d6a7e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d0146f40 con 0x7fa2d00bc8b0 2023-10-03T19:13:15.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2d481a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2d006d170 0x7fa2d00b9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:15.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2d481a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2d006d170 0x7fa2d00b9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36386/0 (socket says 172.21.15.45:36386) 2023-10-03T19:13:15.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2d481a640 1 -- 172.21.15.45:0/1776865257 learned_addr learned my addr 172.21.15.45:0/1776865257 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:15.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2cffff640 1 --2- 172.21.15.45:0/1776865257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2d006f170 0x7fa2d01e4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:15.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2d501b640 1 --2- 172.21.15.45:0/1776865257 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2d00bc8b0 0x7fa2d01e46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:15.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2d481a640 1 -- 172.21.15.45:0/1776865257 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2d00bc8b0 msgr2=0x7fa2d01e46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:15.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2d481a640 1 --2- 172.21.15.45:0/1776865257 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2d00bc8b0 0x7fa2d01e46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2d481a640 1 -- 172.21.15.45:0/1776865257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2d006f170 msgr2=0x7fa2d01e4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:15.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2d481a640 1 --2- 172.21.15.45:0/1776865257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2d006f170 0x7fa2d01e4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:15.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2d481a640 1 -- 172.21.15.45:0/1776865257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b80094d0 con 0x7fa2d006d170 2023-10-03T19:13:15.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.964+0000 7fa2cffff640 1 --2- 172.21.15.45:0/1776865257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2d006f170 0x7fa2d01e4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:15.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.968+0000 7fa2d481a640 1 --2- 172.21.15.45:0/1776865257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2d006d170 0x7fa2d00b9b50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa2b80b3040 tx=0x7fa2b801ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:15.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.968+0000 7fa2cd7fa640 1 -- 172.21.15.45:0/1776865257 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b80ba600 con 0x7fa2d006d170 2023-10-03T19:13:15.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.968+0000 7fa2cd7fa640 1 -- 172.21.15.45:0/1776865257 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b80ba780 con 0x7fa2d006d170 2023-10-03T19:13:15.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.968+0000 7fa2cd7fa640 1 -- 172.21.15.45:0/1776865257 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b80bab30 con 0x7fa2d006d170 2023-10-03T19:13:15.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.968+0000 7fa2d6a7e640 1 -- 172.21.15.45:0/1776865257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d014fae0 con 0x7fa2d006d170 2023-10-03T19:13:15.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.968+0000 7fa2d6a7e640 1 -- 172.21.15.45:0/1776865257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d006cd00 con 0x7fa2d006d170 2023-10-03T19:13:15.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.968+0000 7fa2d6a7e640 1 -- 172.21.15.45:0/1776865257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d006d660 con 0x7fa2d006d170 2023-10-03T19:13:15.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.968+0000 7fa2cd7fa640 1 -- 172.21.15.45:0/1776865257 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa2b80bac90 con 0x7fa2d006d170 2023-10-03T19:13:15.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.968+0000 7fa2cd7fa640 1 --2- 172.21.15.45:0/1776865257 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa2b0066280 0x7fa2b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:15.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.968+0000 7fa2cd7fa640 1 -- 172.21.15.45:0/1776865257 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa2b81220a0 con 0x7fa2d006d170 2023-10-03T19:13:15.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.968+0000 7fa2cffff640 1 --2- 172.21.15.45:0/1776865257 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa2b0066280 0x7fa2b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:15.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.968+0000 7fa2cffff640 1 --2- 172.21.15.45:0/1776865257 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa2b0066280 0x7fa2b0068730 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0006fd0 tx=0x7fa2c0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:15.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:15.972+0000 7fa2cd7fa640 1 -- 172.21.15.45:0/1776865257 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa2b80ef860 con 0x7fa2d006d170 2023-10-03T19:13:16.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.176+0000 7fa2d6a7e640 1 -- 172.21.15.45:0/1776865257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fa2d014c480 con 0x7fa2d006d170 2023-10-03T19:13:16.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.180+0000 7fa2cd7fa640 1 -- 172.21.15.45:0/1776865257 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa2b80f2e80 con 0x7fa2d006d170 2023-10-03T19:13:16.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.184+0000 7fa2d6a7e640 1 -- 172.21.15.45:0/1776865257 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa2b0066280 msgr2=0x7fa2b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:16.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.184+0000 7fa2d6a7e640 1 --2- 172.21.15.45:0/1776865257 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa2b0066280 0x7fa2b0068730 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0006fd0 tx=0x7fa2c0008040 comp rx=0 tx=0).stop 2023-10-03T19:13:16.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.184+0000 7fa2d6a7e640 1 -- 172.21.15.45:0/1776865257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2d006d170 msgr2=0x7fa2d00b9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:16.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.184+0000 7fa2d6a7e640 1 --2- 172.21.15.45:0/1776865257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2d006d170 0x7fa2d00b9b50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa2b80b3040 tx=0x7fa2b801ba90 comp rx=0 tx=0).stop 2023-10-03T19:13:16.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.184+0000 7fa2d6a7e640 1 -- 172.21.15.45:0/1776865257 shutdown_connections 2023-10-03T19:13:16.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.184+0000 7fa2d6a7e640 1 --2- 172.21.15.45:0/1776865257 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa2b0066280 0x7fa2b0068730 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:16.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.184+0000 7fa2d6a7e640 1 --2- 172.21.15.45:0/1776865257 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2d00bc8b0 0x7fa2d01e46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:16.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.184+0000 7fa2d6a7e640 1 --2- 172.21.15.45:0/1776865257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2d006f170 0x7fa2d01e4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:16.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.184+0000 7fa2d6a7e640 1 --2- 172.21.15.45:0/1776865257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2d006d170 0x7fa2d00b9b50 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:16.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.184+0000 7fa2d6a7e640 1 -- 172.21.15.45:0/1776865257 >> 172.21.15.45:0/1776865257 conn(0x7fa2d00bcf50 msgr2=0x7fa2d00bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:16.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.184+0000 7fa2d6a7e640 1 -- 172.21.15.45:0/1776865257 shutdown_connections 2023-10-03T19:13:16.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.184+0000 7fa2d6a7e640 1 -- 172.21.15.45:0/1776865257 wait complete. 2023-10-03T19:13:16.206 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-03T19:13:16.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.324+0000 7ff35adbc640 1 Processor -- start 2023-10-03T19:13:16.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.324+0000 7ff35adbc640 1 -- start start 2023-10-03T19:13:16.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.324+0000 7ff35adbc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff3540bc8b0 0x7ff35414ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:16.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.324+0000 7ff35adbc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff35406d170 0x7ff35414cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:16.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.324+0000 7ff35adbc640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff35406cac0 con 0x7ff35406f170 2023-10-03T19:13:16.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.324+0000 7ff35adbc640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff35414d4f0 con 0x7ff3540bc8b0 2023-10-03T19:13:16.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.324+0000 7ff35adbc640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3540720d0 con 0x7ff35406d170 2023-10-03T19:13:16.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.324+0000 7ff353fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff3540bc8b0 0x7ff35414ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:16.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.324+0000 7ff358b58640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff35406f170 0x7ff354150190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50986/0 (socket says 172.21.15.45:50986) 2023-10-03T19:13:16.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.324+0000 7ff358b58640 1 -- 172.21.15.45:0/1501029844 learned_addr learned my addr 172.21.15.45:0/1501029844 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:16.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.328+0000 7ff359359640 1 --2- 172.21.15.45:0/1501029844 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff35406d170 0x7ff35414cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:16.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.328+0000 7ff353fff640 1 -- 172.21.15.45:0/1501029844 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff35406d170 msgr2=0x7ff35414cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:16.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.328+0000 7ff353fff640 1 --2- 172.21.15.45:0/1501029844 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff35406d170 0x7ff35414cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:16.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.328+0000 7ff353fff640 1 -- 172.21.15.45:0/1501029844 >> v1:172.21.15.45:6789/0 conn(0x7ff35406f170 legacy=0x7ff354150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:16.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.328+0000 7ff3537fe640 1 -- 172.21.15.45:0/1501029844 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1260072645 0 0) 0x7ff348001120 con 0x7ff35406f170 2023-10-03T19:13:16.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.328+0000 7ff353fff640 1 -- 172.21.15.45:0/1501029844 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3540a5ab0 con 0x7ff3540bc8b0 2023-10-03T19:13:16.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.328+0000 7ff353fff640 1 --2- 172.21.15.45:0/1501029844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3540bc8b0 0x7ff35414ca70 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff3400097c0 tx=0x7ff34001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f6e6d3c980ff9d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:16.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.328+0000 7ff3537fe640 1 -- 172.21.15.45:0/1501029844 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3400a8970 con 0x7ff3540bc8b0 2023-10-03T19:13:16.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.328+0000 7ff3537fe640 1 -- 172.21.15.45:0/1501029844 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3400a8ad0 con 0x7ff3540bc8b0 2023-10-03T19:13:16.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.328+0000 7ff3537fe640 1 -- 172.21.15.45:0/1501029844 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3400a8e60 con 0x7ff3540bc8b0 2023-10-03T19:13:16.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.328+0000 7ff35adbc640 1 -- 172.21.15.45:0/1501029844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3540bc8b0 msgr2=0x7ff35414ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:16.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.328+0000 7ff35adbc640 1 --2- 172.21.15.45:0/1501029844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3540bc8b0 0x7ff35414ca70 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff3400097c0 tx=0x7ff34001ec70 comp rx=0 tx=0).stop 2023-10-03T19:13:16.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.328+0000 7ff35adbc640 1 -- 172.21.15.45:0/1501029844 shutdown_connections 2023-10-03T19:13:16.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.328+0000 7ff35adbc640 1 --2- 172.21.15.45:0/1501029844 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff35406d170 0x7ff35414cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:16.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.328+0000 7ff35adbc640 1 --2- 172.21.15.45:0/1501029844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3540bc8b0 0x7ff35414ca70 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:16.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.328+0000 7ff35adbc640 1 -- 172.21.15.45:0/1501029844 >> 172.21.15.45:0/1501029844 conn(0x7ff3540bcf50 msgr2=0x7ff3540bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:16.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.328+0000 7ff35adbc640 1 -- 172.21.15.45:0/1501029844 shutdown_connections 2023-10-03T19:13:16.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.328+0000 7ff35adbc640 1 -- 172.21.15.45:0/1501029844 wait complete. 2023-10-03T19:13:16.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.332+0000 7ff35adbc640 1 Processor -- start 2023-10-03T19:13:16.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.332+0000 7ff35adbc640 1 -- start start 2023-10-03T19:13:16.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.332+0000 7ff35adbc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff35406d170 0x7ff3541d4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:16.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.332+0000 7ff35adbc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff35406f170 0x7ff354147890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:16.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.332+0000 7ff35adbc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3540bc8b0 0x7ff3541d5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:16.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.332+0000 7ff35adbc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3541d7560 con 0x7ff3540bc8b0 2023-10-03T19:13:16.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.332+0000 7ff35adbc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3541d52e0 con 0x7ff35406d170 2023-10-03T19:13:16.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.332+0000 7ff35adbc640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3541d6c40 con 0x7ff35406f170 2023-10-03T19:13:16.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.332+0000 7ff359359640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3540bc8b0 0x7ff3541d5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:16.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.332+0000 7ff359359640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3540bc8b0 0x7ff3541d5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36392/0 (socket says 172.21.15.45:36392) 2023-10-03T19:13:16.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.332+0000 7ff359359640 1 -- 172.21.15.45:0/2982360477 learned_addr learned my addr 172.21.15.45:0/2982360477 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:16.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.332+0000 7ff353fff640 1 --2- 172.21.15.45:0/2982360477 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff35406f170 0x7ff354147890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:16.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.332+0000 7ff358b58640 1 --2- 172.21.15.45:0/2982360477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff35406d170 0x7ff3541d4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:16.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.332+0000 7ff359359640 1 -- 172.21.15.45:0/2982360477 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff35406f170 msgr2=0x7ff354147890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:16.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.332+0000 7ff359359640 1 --2- 172.21.15.45:0/2982360477 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff35406f170 0x7ff354147890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:16.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.332+0000 7ff359359640 1 -- 172.21.15.45:0/2982360477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff35406d170 msgr2=0x7ff3541d4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:16.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.332+0000 7ff359359640 1 --2- 172.21.15.45:0/2982360477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff35406d170 0x7ff3541d4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:16.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.332+0000 7ff359359640 1 -- 172.21.15.45:0/2982360477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff340009420 con 0x7ff3540bc8b0 2023-10-03T19:13:16.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.332+0000 7ff358b58640 1 --2- 172.21.15.45:0/2982360477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff35406d170 0x7ff3541d4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:16.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.332+0000 7ff359359640 1 --2- 172.21.15.45:0/2982360477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3540bc8b0 0x7ff3541d5ad0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff34c007e70 tx=0x7ff34c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:16.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.332+0000 7ff3517fa640 1 -- 172.21.15.45:0/2982360477 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c014620 con 0x7ff3540bc8b0 2023-10-03T19:13:16.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.332+0000 7ff3517fa640 1 -- 172.21.15.45:0/2982360477 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34c0147a0 con 0x7ff3540bc8b0 2023-10-03T19:13:16.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.332+0000 7ff35adbc640 1 -- 172.21.15.45:0/2982360477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff35414fae0 con 0x7ff3540bc8b0 2023-10-03T19:13:16.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.332+0000 7ff3517fa640 1 -- 172.21.15.45:0/2982360477 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c014b50 con 0x7ff3540bc8b0 2023-10-03T19:13:16.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.332+0000 7ff35adbc640 1 -- 172.21.15.45:0/2982360477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35406cd00 con 0x7ff3540bc8b0 2023-10-03T19:13:16.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.332+0000 7ff35adbc640 1 -- 172.21.15.45:0/2982360477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff35414c4a0 con 0x7ff3540bc8b0 2023-10-03T19:13:16.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.336+0000 7ff3517fa640 1 -- 172.21.15.45:0/2982360477 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff34c014cb0 con 0x7ff3540bc8b0 2023-10-03T19:13:16.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.336+0000 7ff3517fa640 1 --2- 172.21.15.45:0/2982360477 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff338066280 0x7ff338068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:16.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.336+0000 7ff3517fa640 1 -- 172.21.15.45:0/2982360477 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff34c084420 con 0x7ff3540bc8b0 2023-10-03T19:13:16.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.336+0000 7ff358b58640 1 --2- 172.21.15.45:0/2982360477 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff338066280 0x7ff338068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:16.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.336+0000 7ff358b58640 1 --2- 172.21.15.45:0/2982360477 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff338066280 0x7ff338068730 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff348007fd0 tx=0x7ff348009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:16.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.340+0000 7ff3517fa640 1 -- 172.21.15.45:0/2982360477 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff34c0555f0 con 0x7ff3540bc8b0 2023-10-03T19:13:16.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.544+0000 7ff35adbc640 1 -- 172.21.15.45:0/2982360477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7ff35406d660 con 0x7ff3540bc8b0 2023-10-03T19:13:16.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.552+0000 7ff3517fa640 1 -- 172.21.15.45:0/2982360477 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff34c055180 con 0x7ff3540bc8b0 2023-10-03T19:13:16.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.556+0000 7ff35adbc640 1 -- 172.21.15.45:0/2982360477 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff338066280 msgr2=0x7ff338068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:16.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.556+0000 7ff35adbc640 1 --2- 172.21.15.45:0/2982360477 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff338066280 0x7ff338068730 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff348007fd0 tx=0x7ff348009040 comp rx=0 tx=0).stop 2023-10-03T19:13:16.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.556+0000 7ff35adbc640 1 -- 172.21.15.45:0/2982360477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3540bc8b0 msgr2=0x7ff3541d5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:16.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.556+0000 7ff35adbc640 1 --2- 172.21.15.45:0/2982360477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3540bc8b0 0x7ff3541d5ad0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff34c007e70 tx=0x7ff34c00e4b0 comp rx=0 tx=0).stop 2023-10-03T19:13:16.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.556+0000 7ff35adbc640 1 -- 172.21.15.45:0/2982360477 shutdown_connections 2023-10-03T19:13:16.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.556+0000 7ff35adbc640 1 --2- 172.21.15.45:0/2982360477 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff338066280 0x7ff338068730 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:16.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.556+0000 7ff35adbc640 1 --2- 172.21.15.45:0/2982360477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3540bc8b0 0x7ff3541d5ad0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:16.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.556+0000 7ff35adbc640 1 --2- 172.21.15.45:0/2982360477 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff35406f170 0x7ff354147890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:16.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.556+0000 7ff35adbc640 1 --2- 172.21.15.45:0/2982360477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff35406d170 0x7ff3541d4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:16.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.556+0000 7ff35adbc640 1 -- 172.21.15.45:0/2982360477 >> 172.21.15.45:0/2982360477 conn(0x7ff3540bcf50 msgr2=0x7ff35414f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:16.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.556+0000 7ff35adbc640 1 -- 172.21.15.45:0/2982360477 shutdown_connections 2023-10-03T19:13:16.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.556+0000 7ff35adbc640 1 -- 172.21.15.45:0/2982360477 wait complete. 2023-10-03T19:13:16.578 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-03T19:13:16.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.688+0000 7f20a3491640 1 Processor -- start 2023-10-03T19:13:16.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.688+0000 7f20a3491640 1 -- start start 2023-10-03T19:13:16.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.688+0000 7f20a3491640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f209c0c2810 0x7f209c0c16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:16.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.688+0000 7f20a3491640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f209c0aa370 0x7f209c0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:16.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.688+0000 7f20a3491640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f209c0c0a10 con 0x7f209c0c1320 2023-10-03T19:13:16.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.688+0000 7f20a3491640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f209c0bf840 con 0x7f209c0c2810 2023-10-03T19:13:16.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.688+0000 7f20a3491640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f209c0c11a0 con 0x7f209c0aa370 2023-10-03T19:13:16.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.688+0000 7f20a0a2c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f209c0c2810 0x7f209c0c16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:16.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.688+0000 7f20a0a2c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f209c0c2810 0x7f209c0c16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36404/0 (socket says 172.21.15.45:36404) 2023-10-03T19:13:16.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.688+0000 7f20a0a2c640 1 -- 172.21.15.45:0/1413961126 learned_addr learned my addr 172.21.15.45:0/1413961126 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:16.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.688+0000 7f20a1a2e640 1 --2- 172.21.15.45:0/1413961126 >> v2:172.21.15.79:3300/0 conn(0x7f209c0aa370 0x7f209c0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:16.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.688+0000 7f20a0a2c640 1 -- 172.21.15.45:0/1413961126 >> v2:172.21.15.79:3300/0 conn(0x7f209c0aa370 msgr2=0x7f209c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:16.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.688+0000 7f20a0a2c640 1 --2- 172.21.15.45:0/1413961126 >> v2:172.21.15.79:3300/0 conn(0x7f209c0aa370 0x7f209c0a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:16.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.688+0000 7f20a0a2c640 1 -- 172.21.15.45:0/1413961126 >> v1:172.21.15.79:6789/0 conn(0x7f209c0c1320 legacy=0x7f209c0a39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:16.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.688+0000 7f20a0a2c640 1 -- 172.21.15.45:0/1413961126 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209c14f2f0 con 0x7f209c0c2810 2023-10-03T19:13:16.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.692+0000 7f20a0a2c640 1 --2- 172.21.15.45:0/1413961126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f209c0c2810 0x7f209c0c16f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f209c152de0 tx=0x7f208c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd9c5b6bd208c97 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:16.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.692+0000 7f2093fff640 1 -- 172.21.15.45:0/1413961126 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208c0ac600 con 0x7f209c0c2810 2023-10-03T19:13:16.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.692+0000 7f2093fff640 1 -- 172.21.15.45:0/1413961126 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208c0a8050 con 0x7f209c0c2810 2023-10-03T19:13:16.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.692+0000 7f2093fff640 1 -- 172.21.15.45:0/1413961126 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208c0ac980 con 0x7f209c0c2810 2023-10-03T19:13:16.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.692+0000 7f20a3491640 1 -- 172.21.15.45:0/1413961126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f209c0c2810 msgr2=0x7f209c0c16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:16.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.692+0000 7f20a3491640 1 --2- 172.21.15.45:0/1413961126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f209c0c2810 0x7f209c0c16f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f209c152de0 tx=0x7f208c01c490 comp rx=0 tx=0).stop 2023-10-03T19:13:16.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.692+0000 7f20a3491640 1 -- 172.21.15.45:0/1413961126 shutdown_connections 2023-10-03T19:13:16.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.692+0000 7f20a3491640 1 --2- 172.21.15.45:0/1413961126 >> v2:172.21.15.79:3300/0 conn(0x7f209c0aa370 0x7f209c0a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:16.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.692+0000 7f20a3491640 1 --2- 172.21.15.45:0/1413961126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f209c0c2810 0x7f209c0c16f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:16.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.692+0000 7f20a3491640 1 -- 172.21.15.45:0/1413961126 >> 172.21.15.45:0/1413961126 conn(0x7f209c0a64a0 msgr2=0x7f209c0a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:16.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.692+0000 7f20a3491640 1 -- 172.21.15.45:0/1413961126 shutdown_connections 2023-10-03T19:13:16.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.692+0000 7f20a3491640 1 -- 172.21.15.45:0/1413961126 wait complete. 2023-10-03T19:13:16.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.692+0000 7f20a3491640 1 Processor -- start 2023-10-03T19:13:16.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.692+0000 7f20a3491640 1 -- start start 2023-10-03T19:13:16.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.692+0000 7f20a3491640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f209c0aa370 0x7f209c149c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:16.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.692+0000 7f20a3491640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f209c0c1320 0x7f209c152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:16.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.692+0000 7f20a3491640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f209c0c2810 0x7f209c1ea400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:16.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.692+0000 7f20a3491640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209c1e9f70 con 0x7f209c0c1320 2023-10-03T19:13:16.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.692+0000 7f20a3491640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209c152a80 con 0x7f209c0c2810 2023-10-03T19:13:16.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.692+0000 7f20a3491640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f209c150940 con 0x7f209c0aa370 2023-10-03T19:13:16.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.696+0000 7f20a0a2c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f209c0c1320 0x7f209c152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:16.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.696+0000 7f20a0a2c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f209c0c1320 0x7f209c152540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36420/0 (socket says 172.21.15.45:36420) 2023-10-03T19:13:16.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.696+0000 7f20a0a2c640 1 -- 172.21.15.45:0/1966377782 learned_addr learned my addr 172.21.15.45:0/1966377782 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:16.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.696+0000 7f20a1a2e640 1 --2- 172.21.15.45:0/1966377782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f209c0c2810 0x7f209c1ea400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:16.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.696+0000 7f20a0a2c640 1 -- 172.21.15.45:0/1966377782 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f209c0aa370 msgr2=0x7f209c149c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:16.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.696+0000 7f20a122d640 1 --2- 172.21.15.45:0/1966377782 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f209c0aa370 0x7f209c149c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:16.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.696+0000 7f20a0a2c640 1 --2- 172.21.15.45:0/1966377782 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f209c0aa370 0x7f209c149c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:16.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.696+0000 7f20a0a2c640 1 -- 172.21.15.45:0/1966377782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f209c0c2810 msgr2=0x7f209c1ea400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:16.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.696+0000 7f20a0a2c640 1 --2- 172.21.15.45:0/1966377782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f209c0c2810 0x7f209c1ea400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:16.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.696+0000 7f20a0a2c640 1 -- 172.21.15.45:0/1966377782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208c0094d0 con 0x7f209c0c1320 2023-10-03T19:13:16.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.696+0000 7f20a1a2e640 1 --2- 172.21.15.45:0/1966377782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f209c0c2810 0x7f209c1ea400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:16.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.696+0000 7f20a0a2c640 1 --2- 172.21.15.45:0/1966377782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f209c0c1320 0x7f209c152540 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f208c01ab40 tx=0x7f208c01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:16.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.696+0000 7f2091ffb640 1 -- 172.21.15.45:0/1966377782 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208c0b7650 con 0x7f209c0c1320 2023-10-03T19:13:16.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.696+0000 7f2091ffb640 1 -- 172.21.15.45:0/1966377782 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208c0b77b0 con 0x7f209c0c1320 2023-10-03T19:13:16.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.696+0000 7f2091ffb640 1 -- 172.21.15.45:0/1966377782 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208c0b7b60 con 0x7f209c0c1320 2023-10-03T19:13:16.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.696+0000 7f20a3491640 1 -- 172.21.15.45:0/1966377782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f209c14c330 con 0x7f209c0c1320 2023-10-03T19:13:16.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.696+0000 7f20a3491640 1 -- 172.21.15.45:0/1966377782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f209c0bf300 con 0x7f209c0c1320 2023-10-03T19:13:16.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.696+0000 7f20a3491640 1 -- 172.21.15.45:0/1966377782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f209c0a40c0 con 0x7f209c0c1320 2023-10-03T19:13:16.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.696+0000 7f2091ffb640 1 -- 172.21.15.45:0/1966377782 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f208c0b3070 con 0x7f209c0c1320 2023-10-03T19:13:16.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.696+0000 7f2091ffb640 1 --2- 172.21.15.45:0/1966377782 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2080066280 0x7f2080068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:16.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.696+0000 7f2091ffb640 1 -- 172.21.15.45:0/1966377782 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f208c11e140 con 0x7f209c0c1320 2023-10-03T19:13:16.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.696+0000 7f20a122d640 1 --2- 172.21.15.45:0/1966377782 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2080066280 0x7f2080068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:16.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.696+0000 7f20a122d640 1 --2- 172.21.15.45:0/1966377782 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2080066280 0x7f2080068730 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f209800a750 tx=0x7f2098008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:16.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.700+0000 7f2091ffb640 1 -- 172.21.15.45:0/1966377782 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f208c0eb9a0 con 0x7f209c0c1320 2023-10-03T19:13:16.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.904+0000 7f20a3491640 1 -- 172.21.15.45:0/1966377782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f209c04de80 con 0x7f209c0c1320 2023-10-03T19:13:16.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.908+0000 7f2091ffb640 1 -- 172.21.15.45:0/1966377782 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f208c0eefc0 con 0x7f209c0c1320 2023-10-03T19:13:16.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.912+0000 7f20a3491640 1 -- 172.21.15.45:0/1966377782 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2080066280 msgr2=0x7f2080068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:16.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.912+0000 7f20a3491640 1 --2- 172.21.15.45:0/1966377782 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2080066280 0x7f2080068730 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f209800a750 tx=0x7f2098008040 comp rx=0 tx=0).stop 2023-10-03T19:13:16.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.912+0000 7f20a3491640 1 -- 172.21.15.45:0/1966377782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f209c0c1320 msgr2=0x7f209c152540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:16.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.912+0000 7f20a3491640 1 --2- 172.21.15.45:0/1966377782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f209c0c1320 0x7f209c152540 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f208c01ab40 tx=0x7f208c01acd0 comp rx=0 tx=0).stop 2023-10-03T19:13:16.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.912+0000 7f20a3491640 1 -- 172.21.15.45:0/1966377782 shutdown_connections 2023-10-03T19:13:16.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.912+0000 7f20a3491640 1 --2- 172.21.15.45:0/1966377782 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2080066280 0x7f2080068730 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:16.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.912+0000 7f20a3491640 1 --2- 172.21.15.45:0/1966377782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f209c0c2810 0x7f209c1ea400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:16.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.912+0000 7f20a3491640 1 --2- 172.21.15.45:0/1966377782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f209c0c1320 0x7f209c152540 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:16.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.912+0000 7f20a3491640 1 --2- 172.21.15.45:0/1966377782 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f209c0aa370 0x7f209c149c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:16.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.912+0000 7f20a3491640 1 -- 172.21.15.45:0/1966377782 >> 172.21.15.45:0/1966377782 conn(0x7f209c0a64a0 msgr2=0x7f209c14cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:16.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.912+0000 7f20a3491640 1 -- 172.21.15.45:0/1966377782 shutdown_connections 2023-10-03T19:13:16.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:16.912+0000 7f20a3491640 1 -- 172.21.15.45:0/1966377782 wait complete. 2023-10-03T19:13:16.932 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-03T19:13:17.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.044+0000 7f8bec21d640 1 Processor -- start 2023-10-03T19:13:17.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.044+0000 7f8bec21d640 1 -- start start 2023-10-03T19:13:17.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.044+0000 7f8bec21d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8be4148b90 0x7f8be40bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:17.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.044+0000 7f8bec21d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8be40bc4a0 0x7f8be406c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:17.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.044+0000 7f8bec21d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8be414b610 con 0x7f8be40bcb60 2023-10-03T19:13:17.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.044+0000 7f8bec21d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be40a3670 con 0x7f8be40bc4a0 2023-10-03T19:13:17.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.044+0000 7f8bec21d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be414b370 con 0x7f8be4148b90 2023-10-03T19:13:17.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.044+0000 7f8bea7ba640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8be40bc4a0 0x7f8be406c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:17.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.044+0000 7f8bea7ba640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8be40bc4a0 0x7f8be406c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36436/0 (socket says 172.21.15.45:36436) 2023-10-03T19:13:17.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.044+0000 7f8bea7ba640 1 -- 172.21.15.45:0/650835279 learned_addr learned my addr 172.21.15.45:0/650835279 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:17.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.044+0000 7f8be9fb9640 1 --2- 172.21.15.45:0/650835279 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8be4148b90 0x7f8be40bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:17.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.044+0000 7f8bea7ba640 1 -- 172.21.15.45:0/650835279 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8be4148b90 msgr2=0x7f8be40bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:17.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.044+0000 7f8bea7ba640 1 --2- 172.21.15.45:0/650835279 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8be4148b90 0x7f8be40bbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.044+0000 7f8bea7ba640 1 -- 172.21.15.45:0/650835279 >> v1:172.21.15.79:6789/0 conn(0x7f8be40bcb60 legacy=0x7f8be406c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:17.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.044+0000 7f8bea7ba640 1 -- 172.21.15.45:0/650835279 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be40a5580 con 0x7f8be40bc4a0 2023-10-03T19:13:17.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.048+0000 7f8bea7ba640 1 --2- 172.21.15.45:0/650835279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8be40bc4a0 0x7f8be406c9a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc009e50 tx=0x7f8bdc01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2842639f1c2bd58e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:17.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.048+0000 7f8be8fb7640 1 -- 172.21.15.45:0/650835279 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc0af400 con 0x7f8be40bc4a0 2023-10-03T19:13:17.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.048+0000 7f8be8fb7640 1 -- 172.21.15.45:0/650835279 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bdc0ab050 con 0x7f8be40bc4a0 2023-10-03T19:13:17.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.048+0000 7f8be8fb7640 1 -- 172.21.15.45:0/650835279 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc0af780 con 0x7f8be40bc4a0 2023-10-03T19:13:17.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.048+0000 7f8bec21d640 1 -- 172.21.15.45:0/650835279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8be40bc4a0 msgr2=0x7f8be406c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:17.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.048+0000 7f8bec21d640 1 --2- 172.21.15.45:0/650835279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8be40bc4a0 0x7f8be406c9a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc009e50 tx=0x7f8bdc01f1c0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.048+0000 7f8bec21d640 1 -- 172.21.15.45:0/650835279 shutdown_connections 2023-10-03T19:13:17.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.048+0000 7f8bec21d640 1 --2- 172.21.15.45:0/650835279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8be40bc4a0 0x7f8be406c9a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.048+0000 7f8bec21d640 1 --2- 172.21.15.45:0/650835279 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8be4148b90 0x7f8be40bbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.048+0000 7f8bec21d640 1 -- 172.21.15.45:0/650835279 >> 172.21.15.45:0/650835279 conn(0x7f8be40bcf50 msgr2=0x7f8be40bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:17.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.048+0000 7f8bec21d640 1 -- 172.21.15.45:0/650835279 shutdown_connections 2023-10-03T19:13:17.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.048+0000 7f8bec21d640 1 -- 172.21.15.45:0/650835279 wait complete. 2023-10-03T19:13:17.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.048+0000 7f8bec21d640 1 Processor -- start 2023-10-03T19:13:17.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.048+0000 7f8bec21d640 1 -- start start 2023-10-03T19:13:17.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.048+0000 7f8bec21d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8be40bc4a0 0x7f8be414d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:17.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.048+0000 7f8bec21d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8be40bcb60 0x7f8be414ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:17.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.048+0000 7f8bec21d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8be4148b90 0x7f8be41d8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:17.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.048+0000 7f8bec21d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be414dde0 con 0x7f8be40bcb60 2023-10-03T19:13:17.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.048+0000 7f8bec21d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be414c5c0 con 0x7f8be4148b90 2023-10-03T19:13:17.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.048+0000 7f8bec21d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be41d9350 con 0x7f8be40bc4a0 2023-10-03T19:13:17.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.048+0000 7f8be97b8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8be40bcb60 0x7f8be414ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:17.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.048+0000 7f8be97b8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8be40bcb60 0x7f8be414ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36452/0 (socket says 172.21.15.45:36452) 2023-10-03T19:13:17.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.048+0000 7f8be97b8640 1 -- 172.21.15.45:0/228094624 learned_addr learned my addr 172.21.15.45:0/228094624 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:17.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.048+0000 7f8bea7ba640 1 --2- 172.21.15.45:0/228094624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8be4148b90 0x7f8be41d8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:17.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.048+0000 7f8be9fb9640 1 --2- 172.21.15.45:0/228094624 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8be40bc4a0 0x7f8be414d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:17.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.048+0000 7f8be97b8640 1 -- 172.21.15.45:0/228094624 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8be40bc4a0 msgr2=0x7f8be414d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:17.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.048+0000 7f8be97b8640 1 --2- 172.21.15.45:0/228094624 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8be40bc4a0 0x7f8be414d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.048+0000 7f8be97b8640 1 -- 172.21.15.45:0/228094624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8be4148b90 msgr2=0x7f8be41d8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:17.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.048+0000 7f8be97b8640 1 --2- 172.21.15.45:0/228094624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8be4148b90 0x7f8be41d8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.048+0000 7f8be97b8640 1 -- 172.21.15.45:0/228094624 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bdc009b30 con 0x7f8be40bcb60 2023-10-03T19:13:17.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.052+0000 7f8be97b8640 1 --2- 172.21.15.45:0/228094624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8be40bcb60 0x7f8be414ca50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8bd400c450 tx=0x7f8bd400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:17.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.052+0000 7f8bda7fc640 1 -- 172.21.15.45:0/228094624 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4012830 con 0x7f8be40bcb60 2023-10-03T19:13:17.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.052+0000 7f8bda7fc640 1 -- 172.21.15.45:0/228094624 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd40129b0 con 0x7f8be40bcb60 2023-10-03T19:13:17.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.052+0000 7f8bec21d640 1 -- 172.21.15.45:0/228094624 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be406cee0 con 0x7f8be40bcb60 2023-10-03T19:13:17.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.052+0000 7f8bda7fc640 1 -- 172.21.15.45:0/228094624 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4012d60 con 0x7f8be40bcb60 2023-10-03T19:13:17.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.052+0000 7f8bec21d640 1 -- 172.21.15.45:0/228094624 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be40a5820 con 0x7f8be40bcb60 2023-10-03T19:13:17.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.052+0000 7f8bec21d640 1 -- 172.21.15.45:0/228094624 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be4148f60 con 0x7f8be40bcb60 2023-10-03T19:13:17.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.052+0000 7f8bda7fc640 1 -- 172.21.15.45:0/228094624 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8bd401c460 con 0x7f8be40bcb60 2023-10-03T19:13:17.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.052+0000 7f8bda7fc640 1 --2- 172.21.15.45:0/228094624 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8bc8066280 0x7f8bc8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:17.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.052+0000 7f8bda7fc640 1 -- 172.21.15.45:0/228094624 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8bd4083900 con 0x7f8be40bcb60 2023-10-03T19:13:17.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.052+0000 7f8be9fb9640 1 --2- 172.21.15.45:0/228094624 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8bc8066280 0x7f8bc8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:17.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.052+0000 7f8be9fb9640 1 --2- 172.21.15.45:0/228094624 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8bc8066280 0x7f8bc8068730 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8be000b7c0 tx=0x7f8be0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:17.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.056+0000 7f8bda7fc640 1 -- 172.21.15.45:0/228094624 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8bd4051040 con 0x7f8be40bcb60 2023-10-03T19:13:17.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.260+0000 7f8bec21d640 1 -- 172.21.15.45:0/228094624 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f8be4071ba0 con 0x7f8be40bcb60 2023-10-03T19:13:17.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.268+0000 7f8bda7fc640 1 -- 172.21.15.45:0/228094624 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8bd4054660 con 0x7f8be40bcb60 2023-10-03T19:13:17.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.268+0000 7f8bec21d640 1 -- 172.21.15.45:0/228094624 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8bc8066280 msgr2=0x7f8bc8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:17.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.268+0000 7f8bec21d640 1 --2- 172.21.15.45:0/228094624 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8bc8066280 0x7f8bc8068730 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8be000b7c0 tx=0x7f8be0008040 comp rx=0 tx=0).stop 2023-10-03T19:13:17.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.268+0000 7f8bec21d640 1 -- 172.21.15.45:0/228094624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8be40bcb60 msgr2=0x7f8be414ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:17.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.268+0000 7f8bec21d640 1 --2- 172.21.15.45:0/228094624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8be40bcb60 0x7f8be414ca50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8bd400c450 tx=0x7f8bd400c910 comp rx=0 tx=0).stop 2023-10-03T19:13:17.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.272+0000 7f8bec21d640 1 -- 172.21.15.45:0/228094624 shutdown_connections 2023-10-03T19:13:17.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.272+0000 7f8bec21d640 1 --2- 172.21.15.45:0/228094624 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8bc8066280 0x7f8bc8068730 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.272+0000 7f8bec21d640 1 --2- 172.21.15.45:0/228094624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8be4148b90 0x7f8be41d8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.272+0000 7f8bec21d640 1 --2- 172.21.15.45:0/228094624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8be40bcb60 0x7f8be414ca50 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.272+0000 7f8bec21d640 1 --2- 172.21.15.45:0/228094624 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8be40bc4a0 0x7f8be414d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.272+0000 7f8bec21d640 1 -- 172.21.15.45:0/228094624 >> 172.21.15.45:0/228094624 conn(0x7f8be40bcf50 msgr2=0x7f8be40bb4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:17.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.272+0000 7f8bec21d640 1 -- 172.21.15.45:0/228094624 shutdown_connections 2023-10-03T19:13:17.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.272+0000 7f8bec21d640 1 -- 172.21.15.45:0/228094624 wait complete. 2023-10-03T19:13:17.291 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-03T19:13:17.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.408+0000 7fdef1d9f640 1 Processor -- start 2023-10-03T19:13:17.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.408+0000 7fdef1d9f640 1 -- start start 2023-10-03T19:13:17.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.408+0000 7fdef1d9f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdeec14f240 0x7fdeec1528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:17.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.408+0000 7fdef1d9f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeec06b2d0 con 0x7fdeec0c2790 2023-10-03T19:13:17.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.408+0000 7fdef1d9f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeec0a3c60 con 0x7fdeec0bb1d0 2023-10-03T19:13:17.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.408+0000 7fdef1d9f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec06b640 con 0x7fdeec14f240 2023-10-03T19:13:17.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.408+0000 7fdeeaffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdeec0c2790 0x7fdeec0c0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50996/0 (socket says 172.21.15.45:50996) 2023-10-03T19:13:17.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.408+0000 7fdeeaffd640 1 -- 172.21.15.45:0/190744809 learned_addr learned my addr 172.21.15.45:0/190744809 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:17.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.408+0000 7fdeea7fc640 1 -- 172.21.15.45:0/190744809 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782310440 0 0) 0x7fdeec06b2d0 con 0x7fdeec0c2790 2023-10-03T19:13:17.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.408+0000 7fdeeb7fe640 1 --2- 172.21.15.45:0/190744809 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdeec14f240 0x7fdeec1528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:17.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.408+0000 7fdeea7fc640 1 -- 172.21.15.45:0/190744809 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fded4003530 con 0x7fdeec0c2790 2023-10-03T19:13:17.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdeea7fc640 1 -- 172.21.15.45:0/190744809 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 442126424 0 0) 0x7fded4003530 con 0x7fdeec0c2790 2023-10-03T19:13:17.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdeea7fc640 1 -- 172.21.15.45:0/190744809 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdeec14f240 msgr2=0x7fdeec1528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:17.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdeea7fc640 1 --2- 172.21.15.45:0/190744809 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdeec14f240 0x7fdeec1528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdeea7fc640 1 -- 172.21.15.45:0/190744809 >> v1:172.21.15.79:6789/0 conn(0x7fdeec0bb1d0 legacy=0x7fdeec0c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:17.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdeea7fc640 1 -- 172.21.15.45:0/190744809 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeec0c19b0 con 0x7fdeec0c2790 2023-10-03T19:13:17.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdeea7fc640 1 -- 172.21.15.45:0/190744809 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fdee0001800 con 0x7fdeec0c2790 2023-10-03T19:13:17.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdeeb7fe640 1 --2- 172.21.15.45:0/190744809 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdeec14f240 0x7fdeec1528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:13:17.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdeea7fc640 1 -- 172.21.15.45:0/190744809 >> v1:172.21.15.45:6789/0 conn(0x7fdeec0c2790 legacy=0x7fdeec0c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:17.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdeea7fc640 1 --2- 172.21.15.45:0/190744809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fded40039b0 0x7fded4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:17.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdeea7fc640 1 --2- 172.21.15.45:0/190744809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fded40047d0 0x7fded4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:17.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdeea7fc640 1 --2- 172.21.15.45:0/190744809 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdeec14f240 0x7fded4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:17.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdeea7fc640 1 -- 172.21.15.45:0/190744809 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec06b640 con 0x7fded40047d0 2023-10-03T19:13:17.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdeea7fc640 1 -- 172.21.15.45:0/190744809 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded400bb00 con 0x7fded40039b0 2023-10-03T19:13:17.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdeea7fc640 1 -- 172.21.15.45:0/190744809 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded400bcc0 con 0x7fdeec14f240 2023-10-03T19:13:17.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdeeaffd640 1 --2- 172.21.15.45:0/190744809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fded40047d0 0x7fded4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:17.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdeeb7fe640 1 --2- 172.21.15.45:0/190744809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fded40039b0 0x7fded4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:17.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdeebfff640 1 --2- 172.21.15.45:0/190744809 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdeec14f240 0x7fded4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:17.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdeeaffd640 1 -- 172.21.15.45:0/190744809 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdeec14f240 msgr2=0x7fded4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:17.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdeeaffd640 1 --2- 172.21.15.45:0/190744809 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdeec14f240 0x7fded4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdeeaffd640 1 -- 172.21.15.45:0/190744809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fded40039b0 msgr2=0x7fded4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:17.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdeeaffd640 1 --2- 172.21.15.45:0/190744809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fded40039b0 0x7fded4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdeeaffd640 1 -- 172.21.15.45:0/190744809 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded4003530 con 0x7fded40047d0 2023-10-03T19:13:17.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdeeaffd640 1 --2- 172.21.15.45:0/190744809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fded40047d0 0x7fded4004c40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fdee000c240 tx=0x7fdee001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5050983c755c0f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:17.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdeea7fc640 1 -- 172.21.15.45:0/190744809 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee00a5b20 con 0x7fded40047d0 2023-10-03T19:13:17.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdeea7fc640 1 -- 172.21.15.45:0/190744809 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee00a5ca0 con 0x7fded40047d0 2023-10-03T19:13:17.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdeea7fc640 1 -- 172.21.15.45:0/190744809 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee00072b0 con 0x7fded40047d0 2023-10-03T19:13:17.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdef1d9f640 1 -- 172.21.15.45:0/190744809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fded40047d0 msgr2=0x7fded4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:17.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdef1d9f640 1 --2- 172.21.15.45:0/190744809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fded40047d0 0x7fded4004c40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fdee000c240 tx=0x7fdee001cc20 comp rx=0 tx=0).stop 2023-10-03T19:13:17.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdeebfff640 1 -- 172.21.15.45:0/190744809 reap_dead start 2023-10-03T19:13:17.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdef1d9f640 1 -- 172.21.15.45:0/190744809 shutdown_connections 2023-10-03T19:13:17.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdef1d9f640 1 -- 172.21.15.45:0/190744809 >> 172.21.15.45:0/190744809 conn(0x7fdeec0a64a0 msgr2=0x7fdeec0a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:17.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdef1d9f640 1 -- 172.21.15.45:0/190744809 shutdown_connections 2023-10-03T19:13:17.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.412+0000 7fdef1d9f640 1 -- 172.21.15.45:0/190744809 wait complete. 2023-10-03T19:13:17.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.416+0000 7fdef1d9f640 1 Processor -- start 2023-10-03T19:13:17.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.416+0000 7fdef1d9f640 1 -- start start 2023-10-03T19:13:17.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.416+0000 7fdef1d9f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fded40047d0 0x7fdeec0bc300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:17.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.416+0000 7fdef1d9f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdeec0bbbe0 0x7fdeec0a9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:17.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.416+0000 7fdef1d9f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdeec0aa260 0x7fdeec1e74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:17.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.416+0000 7fdef1d9f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec14fab0 con 0x7fdeec0bbbe0 2023-10-03T19:13:17.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.416+0000 7fdef1d9f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec0bcdc0 con 0x7fdeec0aa260 2023-10-03T19:13:17.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.416+0000 7fdef1d9f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec0bd0a0 con 0x7fded40047d0 2023-10-03T19:13:17.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.416+0000 7fdeeaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdeec0bbbe0 0x7fdeec0a9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:17.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.416+0000 7fdeeaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdeec0bbbe0 0x7fdeec0a9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36480/0 (socket says 172.21.15.45:36480) 2023-10-03T19:13:17.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.416+0000 7fdeeaffd640 1 -- 172.21.15.45:0/1037021041 learned_addr learned my addr 172.21.15.45:0/1037021041 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:17.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.416+0000 7fdeeb7fe640 1 --2- 172.21.15.45:0/1037021041 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fded40047d0 0x7fdeec0bc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:17.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.416+0000 7fdeebfff640 1 --2- 172.21.15.45:0/1037021041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdeec0aa260 0x7fdeec1e74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:17.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.416+0000 7fdeeaffd640 1 -- 172.21.15.45:0/1037021041 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fded40047d0 msgr2=0x7fdeec0bc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:17.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.416+0000 7fdeeaffd640 1 --2- 172.21.15.45:0/1037021041 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fded40047d0 0x7fdeec0bc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.416+0000 7fdeeaffd640 1 -- 172.21.15.45:0/1037021041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdeec0aa260 msgr2=0x7fdeec1e74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:17.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.416+0000 7fdeeaffd640 1 --2- 172.21.15.45:0/1037021041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdeec0aa260 0x7fdeec1e74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.416+0000 7fdeeaffd640 1 -- 172.21.15.45:0/1037021041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeec0a3f40 con 0x7fdeec0bbbe0 2023-10-03T19:13:17.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.416+0000 7fdeeaffd640 1 --2- 172.21.15.45:0/1037021041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdeec0bbbe0 0x7fdeec0a9d20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fdee001ca50 tx=0x7fded4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:17.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.416+0000 7fded3fff640 1 -- 172.21.15.45:0/1037021041 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee00b4070 con 0x7fdeec0bbbe0 2023-10-03T19:13:17.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.416+0000 7fded3fff640 1 -- 172.21.15.45:0/1037021041 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee00a5920 con 0x7fdeec0bbbe0 2023-10-03T19:13:17.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.416+0000 7fdef1d9f640 1 -- 172.21.15.45:0/1037021041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeec14e740 con 0x7fdeec0bbbe0 2023-10-03T19:13:17.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.416+0000 7fded3fff640 1 -- 172.21.15.45:0/1037021041 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee00015c0 con 0x7fdeec0bbbe0 2023-10-03T19:13:17.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.416+0000 7fdef1d9f640 1 -- 172.21.15.45:0/1037021041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeec14f610 con 0x7fdeec0bbbe0 2023-10-03T19:13:17.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.416+0000 7fdef1d9f640 1 -- 172.21.15.45:0/1037021041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeec066d80 con 0x7fdeec0bbbe0 2023-10-03T19:13:17.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.416+0000 7fded3fff640 1 -- 172.21.15.45:0/1037021041 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdee00057b0 con 0x7fdeec0bbbe0 2023-10-03T19:13:17.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.420+0000 7fded3fff640 1 --2- 172.21.15.45:0/1037021041 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fded80662b0 0x7fded8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:17.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.420+0000 7fded3fff640 1 -- 172.21.15.45:0/1037021041 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdee011dcb0 con 0x7fdeec0bbbe0 2023-10-03T19:13:17.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.420+0000 7fdeeb7fe640 1 --2- 172.21.15.45:0/1037021041 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fded80662b0 0x7fded8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:17.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.420+0000 7fdeeb7fe640 1 --2- 172.21.15.45:0/1037021041 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fded80662b0 0x7fded8068760 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdedc006fd0 tx=0x7fdedc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:17.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.420+0000 7fded3fff640 1 -- 172.21.15.45:0/1037021041 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fdee00eb560 con 0x7fdeec0bbbe0 2023-10-03T19:13:17.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.624+0000 7fdef1d9f640 1 -- 172.21.15.45:0/1037021041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fdeec04de80 con 0x7fdeec0bbbe0 2023-10-03T19:13:17.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.632+0000 7fded3fff640 1 -- 172.21.15.45:0/1037021041 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fdee00bd0a0 con 0x7fdeec0bbbe0 2023-10-03T19:13:17.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.636+0000 7fdef1d9f640 1 -- 172.21.15.45:0/1037021041 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fded80662b0 msgr2=0x7fded8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:17.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.636+0000 7fdef1d9f640 1 --2- 172.21.15.45:0/1037021041 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fded80662b0 0x7fded8068760 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdedc006fd0 tx=0x7fdedc008040 comp rx=0 tx=0).stop 2023-10-03T19:13:17.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.636+0000 7fdef1d9f640 1 -- 172.21.15.45:0/1037021041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdeec0bbbe0 msgr2=0x7fdeec0a9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:17.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.636+0000 7fdef1d9f640 1 --2- 172.21.15.45:0/1037021041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdeec0bbbe0 0x7fdeec0a9d20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fdee001ca50 tx=0x7fded4005800 comp rx=0 tx=0).stop 2023-10-03T19:13:17.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.636+0000 7fdef1d9f640 1 -- 172.21.15.45:0/1037021041 shutdown_connections 2023-10-03T19:13:17.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.636+0000 7fdef1d9f640 1 --2- 172.21.15.45:0/1037021041 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fded80662b0 0x7fded8068760 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.636+0000 7fdef1d9f640 1 --2- 172.21.15.45:0/1037021041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdeec0aa260 0x7fdeec1e74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.636+0000 7fdef1d9f640 1 --2- 172.21.15.45:0/1037021041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdeec0bbbe0 0x7fdeec0a9d20 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.636+0000 7fdef1d9f640 1 --2- 172.21.15.45:0/1037021041 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fded40047d0 0x7fdeec0bc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.636+0000 7fdef1d9f640 1 -- 172.21.15.45:0/1037021041 >> 172.21.15.45:0/1037021041 conn(0x7fdeec0a64a0 msgr2=0x7fdeec0a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:17.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.636+0000 7fdef1d9f640 1 -- 172.21.15.45:0/1037021041 shutdown_connections 2023-10-03T19:13:17.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.636+0000 7fdef1d9f640 1 -- 172.21.15.45:0/1037021041 wait complete. 2023-10-03T19:13:17.656 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:13:17.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.772+0000 7f627387a640 1 Processor -- start 2023-10-03T19:13:17.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.772+0000 7f627387a640 1 -- start start 2023-10-03T19:13:17.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.776+0000 7f627387a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f626c148b90 0x7f626c0bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:17.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.776+0000 7f627387a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f626c0bcb60 0x7f626c06c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:17.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.776+0000 7f627387a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f626c0bc4a0 0x7f626c06c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:17.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.776+0000 7f627387a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f626c0a3670 con 0x7f626c0bcb60 2023-10-03T19:13:17.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.776+0000 7f627387a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f626c14b370 con 0x7f626c148b90 2023-10-03T19:13:17.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.776+0000 7f627387a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626c14b610 con 0x7f626c0bc4a0 2023-10-03T19:13:17.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.776+0000 7f6270e15640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f626c0bcb60 0x7f626c06c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:17.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.776+0000 7f6270e15640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f626c0bcb60 0x7f626c06c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36494/0 (socket says 172.21.15.45:36494) 2023-10-03T19:13:17.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.776+0000 7f6270e15640 1 -- 172.21.15.45:0/2329182548 learned_addr learned my addr 172.21.15.45:0/2329182548 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:17.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.776+0000 7f6271616640 1 --2- 172.21.15.45:0/2329182548 >> v2:172.21.15.79:3300/0 conn(0x7f626c148b90 0x7f626c0bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:17.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.776+0000 7f6271e17640 1 --2- 172.21.15.45:0/2329182548 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f626c0bc4a0 0x7f626c06c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:17.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.776+0000 7f6270e15640 1 -- 172.21.15.45:0/2329182548 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f626c0bc4a0 msgr2=0x7f626c06c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:17.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.776+0000 7f6270e15640 1 --2- 172.21.15.45:0/2329182548 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f626c0bc4a0 0x7f626c06c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.776+0000 7f6270e15640 1 -- 172.21.15.45:0/2329182548 >> v2:172.21.15.79:3300/0 conn(0x7f626c148b90 msgr2=0x7f626c0bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:17.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.776+0000 7f6270e15640 1 --2- 172.21.15.45:0/2329182548 >> v2:172.21.15.79:3300/0 conn(0x7f626c148b90 0x7f626c0bbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.776+0000 7f6270e15640 1 -- 172.21.15.45:0/2329182548 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626c0a5580 con 0x7f626c0bcb60 2023-10-03T19:13:17.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.776+0000 7f6271616640 1 --2- 172.21.15.45:0/2329182548 >> v2:172.21.15.79:3300/0 conn(0x7f626c148b90 0x7f626c0bbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:17.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.776+0000 7f6270e15640 1 --2- 172.21.15.45:0/2329182548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626c0bcb60 0x7f626c06c290 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f626c06d660 tx=0x7f625c0213c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed2080b22d440ed2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:17.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.776+0000 7f6263fff640 1 -- 172.21.15.45:0/2329182548 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c0b1600 con 0x7f626c0bcb60 2023-10-03T19:13:17.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.776+0000 7f6263fff640 1 -- 172.21.15.45:0/2329182548 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625c0ad050 con 0x7f626c0bcb60 2023-10-03T19:13:17.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.776+0000 7f6263fff640 1 -- 172.21.15.45:0/2329182548 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c0b1980 con 0x7f626c0bcb60 2023-10-03T19:13:17.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f627387a640 1 -- 172.21.15.45:0/2329182548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626c0bcb60 msgr2=0x7f626c06c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:17.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f627387a640 1 --2- 172.21.15.45:0/2329182548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626c0bcb60 0x7f626c06c290 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f626c06d660 tx=0x7f625c0213c0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f627387a640 1 -- 172.21.15.45:0/2329182548 shutdown_connections 2023-10-03T19:13:17.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f627387a640 1 --2- 172.21.15.45:0/2329182548 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f626c0bc4a0 0x7f626c06c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f627387a640 1 --2- 172.21.15.45:0/2329182548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626c0bcb60 0x7f626c06c290 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f627387a640 1 --2- 172.21.15.45:0/2329182548 >> v2:172.21.15.79:3300/0 conn(0x7f626c148b90 0x7f626c0bbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f627387a640 1 -- 172.21.15.45:0/2329182548 >> 172.21.15.45:0/2329182548 conn(0x7f626c0bcf50 msgr2=0x7f626c0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:17.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f627387a640 1 -- 172.21.15.45:0/2329182548 shutdown_connections 2023-10-03T19:13:17.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f627387a640 1 -- 172.21.15.45:0/2329182548 wait complete. 2023-10-03T19:13:17.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f627387a640 1 Processor -- start 2023-10-03T19:13:17.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f627387a640 1 -- start start 2023-10-03T19:13:17.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f627387a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626c0bc4a0 0x7f626c1def20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:17.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f627387a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f626c0bcb60 0x7f626c06fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:17.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f627387a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f626c148b90 0x7f626c071440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:17.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f627387a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626c070fb0 con 0x7f626c0bc4a0 2023-10-03T19:13:17.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f627387a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626c070300 con 0x7f626c148b90 2023-10-03T19:13:17.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f627387a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626c13faa0 con 0x7f626c0bcb60 2023-10-03T19:13:17.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f6271616640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626c0bc4a0 0x7f626c1def20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:17.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f6271616640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626c0bc4a0 0x7f626c1def20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36510/0 (socket says 172.21.15.45:36510) 2023-10-03T19:13:17.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f6271616640 1 -- 172.21.15.45:0/2263692440 learned_addr learned my addr 172.21.15.45:0/2263692440 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:17.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f6271e17640 1 --2- 172.21.15.45:0/2263692440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f626c148b90 0x7f626c071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:17.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f6271616640 1 -- 172.21.15.45:0/2263692440 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f626c0bcb60 msgr2=0x7f626c06fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:17.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f6271616640 1 --2- 172.21.15.45:0/2263692440 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f626c0bcb60 0x7f626c06fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f6271616640 1 -- 172.21.15.45:0/2263692440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f626c148b90 msgr2=0x7f626c071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:17.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f6271616640 1 --2- 172.21.15.45:0/2263692440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f626c148b90 0x7f626c071440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f6271616640 1 -- 172.21.15.45:0/2263692440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625c00b770 con 0x7f626c0bc4a0 2023-10-03T19:13:17.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f6271616640 1 --2- 172.21.15.45:0/2263692440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626c0bc4a0 0x7f626c1def20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f626800c820 tx=0x7f626800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:17.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f6261ffb640 1 -- 172.21.15.45:0/2263692440 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6268007a30 con 0x7f626c0bc4a0 2023-10-03T19:13:17.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f6261ffb640 1 -- 172.21.15.45:0/2263692440 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6268007b90 con 0x7f626c0bc4a0 2023-10-03T19:13:17.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f6261ffb640 1 -- 172.21.15.45:0/2263692440 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626800ce10 con 0x7f626c0bc4a0 2023-10-03T19:13:17.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f627387a640 1 -- 172.21.15.45:0/2263692440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f626c148f60 con 0x7f626c0bc4a0 2023-10-03T19:13:17.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.780+0000 7f627387a640 1 -- 172.21.15.45:0/2263692440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626c0a5820 con 0x7f626c0bc4a0 2023-10-03T19:13:17.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.784+0000 7f627387a640 1 -- 172.21.15.45:0/2263692440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f626c0a3880 con 0x7f626c0bc4a0 2023-10-03T19:13:17.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.784+0000 7f6261ffb640 1 -- 172.21.15.45:0/2263692440 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f62680113f0 con 0x7f626c0bc4a0 2023-10-03T19:13:17.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.784+0000 7f6261ffb640 1 --2- 172.21.15.45:0/2263692440 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f62500662b0 0x7f6250068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:17.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.784+0000 7f6261ffb640 1 -- 172.21.15.45:0/2263692440 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6268083ad0 con 0x7f626c0bc4a0 2023-10-03T19:13:17.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.784+0000 7f6270e15640 1 --2- 172.21.15.45:0/2263692440 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f62500662b0 0x7f6250068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:17.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.784+0000 7f6270e15640 1 --2- 172.21.15.45:0/2263692440 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f62500662b0 0x7f6250068760 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f625c0b3000 tx=0x7f625c004740 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:17.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.788+0000 7f6261ffb640 1 -- 172.21.15.45:0/2263692440 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6268051200 con 0x7f626c0bc4a0 2023-10-03T19:13:17.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.936+0000 7f627387a640 1 -- 172.21.15.45:0/2263692440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f626c04de80 con 0x7f626c0bc4a0 2023-10-03T19:13:17.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.940+0000 7f6261ffb640 1 -- 172.21.15.45:0/2263692440 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+14591 (secure 0 0 0) 0x7f626801f090 con 0x7f626c0bc4a0 2023-10-03T19:13:17.945 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:13:17.945 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":31,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:13:15.072122+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:13:17.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.940+0000 7f627387a640 1 -- 172.21.15.45:0/2263692440 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f62500662b0 msgr2=0x7f6250068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:17.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.940+0000 7f627387a640 1 --2- 172.21.15.45:0/2263692440 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f62500662b0 0x7f6250068760 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f625c0b3000 tx=0x7f625c004740 comp rx=0 tx=0).stop 2023-10-03T19:13:17.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.940+0000 7f627387a640 1 -- 172.21.15.45:0/2263692440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626c0bc4a0 msgr2=0x7f626c1def20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:17.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.940+0000 7f627387a640 1 --2- 172.21.15.45:0/2263692440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626c0bc4a0 0x7f626c1def20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f626800c820 tx=0x7f626800cce0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.940+0000 7f627387a640 1 -- 172.21.15.45:0/2263692440 shutdown_connections 2023-10-03T19:13:17.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.940+0000 7f627387a640 1 --2- 172.21.15.45:0/2263692440 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f62500662b0 0x7f6250068760 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.940+0000 7f627387a640 1 --2- 172.21.15.45:0/2263692440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f626c148b90 0x7f626c071440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.940+0000 7f627387a640 1 --2- 172.21.15.45:0/2263692440 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f626c0bcb60 0x7f626c06fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.940+0000 7f627387a640 1 --2- 172.21.15.45:0/2263692440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626c0bc4a0 0x7f626c1def20 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:17.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.940+0000 7f627387a640 1 -- 172.21.15.45:0/2263692440 >> 172.21.15.45:0/2263692440 conn(0x7f626c0bcf50 msgr2=0x7f626c0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:17.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.940+0000 7f627387a640 1 -- 172.21.15.45:0/2263692440 shutdown_connections 2023-10-03T19:13:17.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:17.940+0000 7f627387a640 1 -- 172.21.15.45:0/2263692440 wait complete. 2023-10-03T19:13:17.962 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:13:17.962 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:13:18.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.072+0000 7f0c4a723640 1 Processor -- start 2023-10-03T19:13:18.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.076+0000 7f0c4a723640 1 -- start start 2023-10-03T19:13:18.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.076+0000 7f0c4a723640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0c4406c410 0x7f0c440bc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:18.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.076+0000 7f0c4a723640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0c440bc860 0x7f0c44147d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:18.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.076+0000 7f0c4a723640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c4406f650 con 0x7f0c4406cc20 2023-10-03T19:13:18.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.076+0000 7f0c4a723640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c4406f3b0 con 0x7f0c4406c410 2023-10-03T19:13:18.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.076+0000 7f0c4a723640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c4414b680 con 0x7f0c440bc860 2023-10-03T19:13:18.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.076+0000 7f0c43fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0c4406c410 0x7f0c440bc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:18.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.076+0000 7f0c43fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0c4406c410 0x7f0c440bc320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36514/0 (socket says 172.21.15.45:36514) 2023-10-03T19:13:18.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.076+0000 7f0c43fff640 1 -- 172.21.15.45:0/777034012 learned_addr learned my addr 172.21.15.45:0/777034012 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:18.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.076+0000 7f0c3bfff640 1 --2- 172.21.15.45:0/777034012 >> v2:172.21.15.79:3300/0 conn(0x7f0c440bc860 0x7f0c44147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:18.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.076+0000 7f0c43fff640 1 -- 172.21.15.45:0/777034012 >> v2:172.21.15.79:3300/0 conn(0x7f0c440bc860 msgr2=0x7f0c44147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:18.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.076+0000 7f0c43fff640 1 --2- 172.21.15.45:0/777034012 >> v2:172.21.15.79:3300/0 conn(0x7f0c440bc860 0x7f0c44147d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:18.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.076+0000 7f0c43fff640 1 -- 172.21.15.45:0/777034012 >> v1:172.21.15.79:6789/0 conn(0x7f0c4406cc20 legacy=0x7f0c4414e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:18.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.076+0000 7f0c43fff640 1 -- 172.21.15.45:0/777034012 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4414b960 con 0x7f0c4406c410 2023-10-03T19:13:18.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c43fff640 1 --2- 172.21.15.45:0/777034012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c4406c410 0x7f0c440bc320 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0c4406e900 tx=0x7f0c3401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6b3dbc039748447 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:18.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c437fe640 1 -- 172.21.15.45:0/777034012 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c340ac630 con 0x7f0c4406c410 2023-10-03T19:13:18.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c437fe640 1 -- 172.21.15.45:0/777034012 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c340ac790 con 0x7f0c4406c410 2023-10-03T19:13:18.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c437fe640 1 -- 172.21.15.45:0/777034012 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c340acb20 con 0x7f0c4406c410 2023-10-03T19:13:18.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c4a723640 1 -- 172.21.15.45:0/777034012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c4406c410 msgr2=0x7f0c440bc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:18.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c4a723640 1 --2- 172.21.15.45:0/777034012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c4406c410 0x7f0c440bc320 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0c4406e900 tx=0x7f0c3401c4c0 comp rx=0 tx=0).stop 2023-10-03T19:13:18.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c4a723640 1 -- 172.21.15.45:0/777034012 shutdown_connections 2023-10-03T19:13:18.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c4a723640 1 --2- 172.21.15.45:0/777034012 >> v2:172.21.15.79:3300/0 conn(0x7f0c440bc860 0x7f0c44147d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:18.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c4a723640 1 --2- 172.21.15.45:0/777034012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c4406c410 0x7f0c440bc320 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:18.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c4a723640 1 -- 172.21.15.45:0/777034012 >> 172.21.15.45:0/777034012 conn(0x7f0c440a20d0 msgr2=0x7f0c440a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:18.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c4a723640 1 -- 172.21.15.45:0/777034012 shutdown_connections 2023-10-03T19:13:18.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c4a723640 1 -- 172.21.15.45:0/777034012 wait complete. 2023-10-03T19:13:18.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c4a723640 1 Processor -- start 2023-10-03T19:13:18.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c4a723640 1 -- start start 2023-10-03T19:13:18.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c4a723640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c4406c410 0x7f0c441ea8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:18.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c4a723640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c4406cc20 0x7f0c441eae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:18.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c4a723640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c440bc860 0x7f0c4414ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:18.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c4a723640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4414e590 con 0x7f0c440bc860 2023-10-03T19:13:18.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c4a723640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4414c580 con 0x7f0c4406c410 2023-10-03T19:13:18.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c4a723640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4414e2b0 con 0x7f0c4406cc20 2023-10-03T19:13:18.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c48cc0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c440bc860 0x7f0c4414ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:18.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c48cc0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c440bc860 0x7f0c4414ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36526/0 (socket says 172.21.15.45:36526) 2023-10-03T19:13:18.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c48cc0640 1 -- 172.21.15.45:0/3199306161 learned_addr learned my addr 172.21.15.45:0/3199306161 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:18.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c43fff640 1 --2- 172.21.15.45:0/3199306161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c4406c410 0x7f0c441ea8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:18.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c3bfff640 1 --2- 172.21.15.45:0/3199306161 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c4406cc20 0x7f0c441eae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:18.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c48cc0640 1 -- 172.21.15.45:0/3199306161 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c4406cc20 msgr2=0x7f0c441eae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:18.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c48cc0640 1 --2- 172.21.15.45:0/3199306161 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c4406cc20 0x7f0c441eae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:18.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c48cc0640 1 -- 172.21.15.45:0/3199306161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c4406c410 msgr2=0x7f0c441ea8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:18.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c48cc0640 1 --2- 172.21.15.45:0/3199306161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c4406c410 0x7f0c441ea8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:18.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c48cc0640 1 -- 172.21.15.45:0/3199306161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c340094d0 con 0x7f0c440bc860 2023-10-03T19:13:18.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c43fff640 1 --2- 172.21.15.45:0/3199306161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c4406c410 0x7f0c441ea8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:18.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c48cc0640 1 --2- 172.21.15.45:0/3199306161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c440bc860 0x7f0c4414ca60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c00c780 tx=0x7f0c3c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:18.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c417fa640 1 -- 172.21.15.45:0/3199306161 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c00a9f0 con 0x7f0c440bc860 2023-10-03T19:13:18.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c417fa640 1 -- 172.21.15.45:0/3199306161 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3c00ce90 con 0x7f0c440bc860 2023-10-03T19:13:18.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c4a723640 1 -- 172.21.15.45:0/3199306161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c441483e0 con 0x7f0c440bc860 2023-10-03T19:13:18.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c417fa640 1 -- 172.21.15.45:0/3199306161 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c00add0 con 0x7f0c440bc860 2023-10-03T19:13:18.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.080+0000 7f0c4a723640 1 -- 172.21.15.45:0/3199306161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c44148250 con 0x7f0c440bc860 2023-10-03T19:13:18.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.084+0000 7f0c4a723640 1 -- 172.21.15.45:0/3199306161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c44148570 con 0x7f0c440bc860 2023-10-03T19:13:18.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.084+0000 7f0c417fa640 1 -- 172.21.15.45:0/3199306161 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0c3c012420 con 0x7f0c440bc860 2023-10-03T19:13:18.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.084+0000 7f0c417fa640 1 --2- 172.21.15.45:0/3199306161 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0c24066280 0x7f0c24068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:18.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.084+0000 7f0c417fa640 1 -- 172.21.15.45:0/3199306161 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0c3c083a80 con 0x7f0c440bc860 2023-10-03T19:13:18.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.084+0000 7f0c43fff640 1 --2- 172.21.15.45:0/3199306161 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0c24066280 0x7f0c24068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:18.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.084+0000 7f0c43fff640 1 --2- 172.21.15.45:0/3199306161 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0c24066280 0x7f0c24068730 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0c340ae000 tx=0x7f0c34008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:18.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.088+0000 7f0c417fa640 1 -- 172.21.15.45:0/3199306161 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0c3c0512e0 con 0x7f0c440bc860 2023-10-03T19:13:18.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.240+0000 7f0c4a723640 1 -- 172.21.15.45:0/3199306161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0c4414c740 con 0x7f0c440bc860 2023-10-03T19:13:18.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.240+0000 7f0c417fa640 1 -- 172.21.15.45:0/3199306161 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0c3c016020 con 0x7f0c440bc860 2023-10-03T19:13:18.247 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:13:18.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.240+0000 7f0c4a723640 1 -- 172.21.15.45:0/3199306161 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0c24066280 msgr2=0x7f0c24068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:18.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.240+0000 7f0c4a723640 1 --2- 172.21.15.45:0/3199306161 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0c24066280 0x7f0c24068730 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0c340ae000 tx=0x7f0c34008040 comp rx=0 tx=0).stop 2023-10-03T19:13:18.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.240+0000 7f0c4a723640 1 -- 172.21.15.45:0/3199306161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c440bc860 msgr2=0x7f0c4414ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:18.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.240+0000 7f0c4a723640 1 --2- 172.21.15.45:0/3199306161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c440bc860 0x7f0c4414ca60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c00c780 tx=0x7f0c3c00cc40 comp rx=0 tx=0).stop 2023-10-03T19:13:18.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.240+0000 7f0c4a723640 1 -- 172.21.15.45:0/3199306161 shutdown_connections 2023-10-03T19:13:18.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.240+0000 7f0c4a723640 1 --2- 172.21.15.45:0/3199306161 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0c24066280 0x7f0c24068730 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:18.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.240+0000 7f0c4a723640 1 --2- 172.21.15.45:0/3199306161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c440bc860 0x7f0c4414ca60 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:18.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.240+0000 7f0c4a723640 1 --2- 172.21.15.45:0/3199306161 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c4406cc20 0x7f0c441eae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:18.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.240+0000 7f0c4a723640 1 --2- 172.21.15.45:0/3199306161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c4406c410 0x7f0c441ea8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:18.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.240+0000 7f0c4a723640 1 -- 172.21.15.45:0/3199306161 >> 172.21.15.45:0/3199306161 conn(0x7f0c440a20d0 msgr2=0x7f0c440b9750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:18.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.240+0000 7f0c4a723640 1 -- 172.21.15.45:0/3199306161 shutdown_connections 2023-10-03T19:13:18.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.240+0000 7f0c4a723640 1 -- 172.21.15.45:0/3199306161 wait complete. 2023-10-03T19:13:18.263 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:13:18.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.372+0000 7fe598557640 1 Processor -- start 2023-10-03T19:13:18.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.372+0000 7fe598557640 1 -- start start 2023-10-03T19:13:18.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.376+0000 7fe598557640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe59006f880 0x7fe5900a5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:18.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.376+0000 7fe598557640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe59014f080 con 0x7fe59014f510 2023-10-03T19:13:18.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.376+0000 7fe598557640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe590070e90 con 0x7fe59014ba30 2023-10-03T19:13:18.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.376+0000 7fe598557640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe59006f3e0 con 0x7fe59006f880 2023-10-03T19:13:18.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.376+0000 7fe595af2640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe59014f510 0x7fe59014b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50998/0 (socket says 172.21.15.45:50998) 2023-10-03T19:13:18.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.376+0000 7fe595af2640 1 -- 172.21.15.45:0/919924571 learned_addr learned my addr 172.21.15.45:0/919924571 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:18.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.376+0000 7fe5962f3640 1 --2- 172.21.15.45:0/919924571 >> v2:172.21.15.45:3300/0 conn(0x7fe59006f880 0x7fe5900a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:18.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.376+0000 7fe5962f3640 1 -- 172.21.15.45:0/919924571 >> v1:172.21.15.79:6789/0 conn(0x7fe59014ba30 legacy=0x7fe590155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:18.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.376+0000 7fe5962f3640 1 -- 172.21.15.45:0/919924571 >> v1:172.21.15.45:6789/0 conn(0x7fe59014f510 legacy=0x7fe59014b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:18.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.376+0000 7fe5952f1640 1 -- 172.21.15.45:0/919924571 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997372480 0 0) 0x7fe59014f080 con 0x7fe59014f510 2023-10-03T19:13:18.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.376+0000 7fe5962f3640 1 -- 172.21.15.45:0/919924571 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59014ea30 con 0x7fe59006f880 2023-10-03T19:13:18.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.380+0000 7fe5962f3640 1 --2- 172.21.15.45:0/919924571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe59006f880 0x7fe5900a5940 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe58c009d90 tx=0x7fe58c01eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d31699eb960cec server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:18.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.380+0000 7fe5952f1640 1 -- 172.21.15.45:0/919924571 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c0a7a60 con 0x7fe59006f880 2023-10-03T19:13:18.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.380+0000 7fe5952f1640 1 -- 172.21.15.45:0/919924571 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58c0a7bc0 con 0x7fe59006f880 2023-10-03T19:13:18.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.380+0000 7fe5952f1640 1 -- 172.21.15.45:0/919924571 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c0af440 con 0x7fe59006f880 2023-10-03T19:13:18.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.380+0000 7fe598557640 1 -- 172.21.15.45:0/919924571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe59006f880 msgr2=0x7fe5900a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:18.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.380+0000 7fe598557640 1 --2- 172.21.15.45:0/919924571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe59006f880 0x7fe5900a5940 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe58c009d90 tx=0x7fe58c01eb30 comp rx=0 tx=0).stop 2023-10-03T19:13:18.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.380+0000 7fe598557640 1 -- 172.21.15.45:0/919924571 shutdown_connections 2023-10-03T19:13:18.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.380+0000 7fe598557640 1 --2- 172.21.15.45:0/919924571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe59006f880 0x7fe5900a5940 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:18.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.380+0000 7fe598557640 1 -- 172.21.15.45:0/919924571 >> 172.21.15.45:0/919924571 conn(0x7fe5900a20d0 msgr2=0x7fe5900a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:18.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.380+0000 7fe598557640 1 -- 172.21.15.45:0/919924571 shutdown_connections 2023-10-03T19:13:18.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.380+0000 7fe598557640 1 -- 172.21.15.45:0/919924571 wait complete. 2023-10-03T19:13:18.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.380+0000 7fe598557640 1 Processor -- start 2023-10-03T19:13:18.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.380+0000 7fe598557640 1 -- start start 2023-10-03T19:13:18.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.380+0000 7fe598557640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe59006f880 0x7fe590142de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:18.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.380+0000 7fe598557640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe59014ba30 0x7fe5900b9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:18.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.380+0000 7fe598557640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe59014f510 0x7fe5901eb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:18.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.380+0000 7fe598557640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5901eac00 con 0x7fe59006f880 2023-10-03T19:13:18.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.380+0000 7fe598557640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5900bfd40 con 0x7fe59014f510 2023-10-03T19:13:18.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.380+0000 7fe598557640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5900bf780 con 0x7fe59014ba30 2023-10-03T19:13:18.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.380+0000 7fe5962f3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe59006f880 0x7fe590142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:18.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.380+0000 7fe5962f3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe59006f880 0x7fe590142de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36536/0 (socket says 172.21.15.45:36536) 2023-10-03T19:13:18.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.380+0000 7fe5962f3640 1 -- 172.21.15.45:0/3533273995 learned_addr learned my addr 172.21.15.45:0/3533273995 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:18.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.380+0000 7fe596af4640 1 --2- 172.21.15.45:0/3533273995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe59014f510 0x7fe5901eb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:18.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.380+0000 7fe5962f3640 1 -- 172.21.15.45:0/3533273995 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe59014ba30 msgr2=0x7fe5900b9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:18.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.380+0000 7fe5962f3640 1 --2- 172.21.15.45:0/3533273995 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe59014ba30 0x7fe5900b9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:18.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.380+0000 7fe5962f3640 1 -- 172.21.15.45:0/3533273995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe59014f510 msgr2=0x7fe5901eb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:18.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.380+0000 7fe5962f3640 1 --2- 172.21.15.45:0/3533273995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe59014f510 0x7fe5901eb020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:18.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.380+0000 7fe5962f3640 1 -- 172.21.15.45:0/3533273995 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe58c009a70 con 0x7fe59006f880 2023-10-03T19:13:18.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.380+0000 7fe5962f3640 1 --2- 172.21.15.45:0/3533273995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe59006f880 0x7fe590142de0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe58c0b2040 tx=0x7fe58c01b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:18.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.384+0000 7fe586ffd640 1 -- 172.21.15.45:0/3533273995 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c0a7860 con 0x7fe59006f880 2023-10-03T19:13:18.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.384+0000 7fe586ffd640 1 -- 172.21.15.45:0/3533273995 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58c0a79c0 con 0x7fe59006f880 2023-10-03T19:13:18.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.384+0000 7fe598557640 1 -- 172.21.15.45:0/3533273995 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe590070a40 con 0x7fe59006f880 2023-10-03T19:13:18.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.384+0000 7fe586ffd640 1 -- 172.21.15.45:0/3533273995 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c0b8640 con 0x7fe59006f880 2023-10-03T19:13:18.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.384+0000 7fe598557640 1 -- 172.21.15.45:0/3533273995 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe59006fc50 con 0x7fe59006f880 2023-10-03T19:13:18.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.384+0000 7fe598557640 1 -- 172.21.15.45:0/3533273995 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe590070bd0 con 0x7fe59006f880 2023-10-03T19:13:18.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.384+0000 7fe586ffd640 1 -- 172.21.15.45:0/3533273995 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe58c0b6070 con 0x7fe59006f880 2023-10-03T19:13:18.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.384+0000 7fe586ffd640 1 --2- 172.21.15.45:0/3533273995 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe574066280 0x7fe574068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:18.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.384+0000 7fe586ffd640 1 -- 172.21.15.45:0/3533273995 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe58c11e8d0 con 0x7fe59006f880 2023-10-03T19:13:18.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.384+0000 7fe595af2640 1 --2- 172.21.15.45:0/3533273995 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe574066280 0x7fe574068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:18.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.384+0000 7fe595af2640 1 --2- 172.21.15.45:0/3533273995 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe574066280 0x7fe574068730 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe580000c10 tx=0x7fe5800079d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:18.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.388+0000 7fe586ffd640 1 -- 172.21.15.45:0/3533273995 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe58c0ec010 con 0x7fe59006f880 2023-10-03T19:13:18.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.540+0000 7fe598557640 1 -- 172.21.15.45:0/3533273995 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe59004de80 con 0x7fe59006f880 2023-10-03T19:13:18.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.540+0000 7fe586ffd640 1 -- 172.21.15.45:0/3533273995 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe58c0ef630 con 0x7fe59006f880 2023-10-03T19:13:18.547 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:13:18.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.544+0000 7fe598557640 1 -- 172.21.15.45:0/3533273995 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe574066280 msgr2=0x7fe574068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:18.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.544+0000 7fe598557640 1 --2- 172.21.15.45:0/3533273995 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe574066280 0x7fe574068730 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe580000c10 tx=0x7fe5800079d0 comp rx=0 tx=0).stop 2023-10-03T19:13:18.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.544+0000 7fe598557640 1 -- 172.21.15.45:0/3533273995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe59006f880 msgr2=0x7fe590142de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:18.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.544+0000 7fe598557640 1 --2- 172.21.15.45:0/3533273995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe59006f880 0x7fe590142de0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe58c0b2040 tx=0x7fe58c01b8d0 comp rx=0 tx=0).stop 2023-10-03T19:13:18.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.544+0000 7fe598557640 1 -- 172.21.15.45:0/3533273995 shutdown_connections 2023-10-03T19:13:18.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.544+0000 7fe598557640 1 --2- 172.21.15.45:0/3533273995 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe574066280 0x7fe574068730 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:18.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.544+0000 7fe598557640 1 --2- 172.21.15.45:0/3533273995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe59014f510 0x7fe5901eb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:18.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.544+0000 7fe598557640 1 --2- 172.21.15.45:0/3533273995 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe59014ba30 0x7fe5900b9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:18.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.544+0000 7fe598557640 1 --2- 172.21.15.45:0/3533273995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe59006f880 0x7fe590142de0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:18.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.544+0000 7fe598557640 1 -- 172.21.15.45:0/3533273995 >> 172.21.15.45:0/3533273995 conn(0x7fe5900a20d0 msgr2=0x7fe59014db00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:18.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.544+0000 7fe598557640 1 -- 172.21.15.45:0/3533273995 shutdown_connections 2023-10-03T19:13:18.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.544+0000 7fe598557640 1 -- 172.21.15.45:0/3533273995 wait complete. 2023-10-03T19:13:18.566 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-03T19:13:18.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.680+0000 7ff04c36d640 1 Processor -- start 2023-10-03T19:13:18.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.680+0000 7ff04c36d640 1 -- start start 2023-10-03T19:13:18.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.680+0000 7ff04c36d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff0440bca80 0x7ff044156110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:18.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.680+0000 7ff04c36d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff04406d0f0 0x7ff044156650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:18.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.680+0000 7ff04c36d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0440a1720 con 0x7ff044150400 2023-10-03T19:13:18.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.680+0000 7ff04c36d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0440a2230 con 0x7ff04406d0f0 2023-10-03T19:13:18.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.680+0000 7ff04c36d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0440a18d0 con 0x7ff0440bca80 2023-10-03T19:13:18.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.680+0000 7ff04a109640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff044150400 0x7ff04406c0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51012/0 (socket says 172.21.15.45:51012) 2023-10-03T19:13:18.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.680+0000 7ff04a109640 1 -- 172.21.15.45:0/2331334796 learned_addr learned my addr 172.21.15.45:0/2331334796 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:18.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.680+0000 7ff04a90a640 1 --2- 172.21.15.45:0/2331334796 >> v2:172.21.15.45:3300/0 conn(0x7ff04406d0f0 0x7ff044156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:18.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.680+0000 7ff049908640 1 --2- 172.21.15.45:0/2331334796 >> v2:172.21.15.79:3300/0 conn(0x7ff0440bca80 0x7ff044156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:18.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.680+0000 7ff049107640 1 -- 172.21.15.45:0/2331334796 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1212194513 0 0) 0x7ff0440a1720 con 0x7ff044150400 2023-10-03T19:13:18.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.680+0000 7ff049107640 1 -- 172.21.15.45:0/2331334796 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff030003530 con 0x7ff044150400 2023-10-03T19:13:18.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.680+0000 7ff04a90a640 1 -- 172.21.15.45:0/2331334796 >> v2:172.21.15.79:3300/0 conn(0x7ff0440bca80 msgr2=0x7ff044156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:18.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.680+0000 7ff04a90a640 1 --2- 172.21.15.45:0/2331334796 >> v2:172.21.15.79:3300/0 conn(0x7ff0440bca80 0x7ff044156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:18.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.680+0000 7ff04a90a640 1 -- 172.21.15.45:0/2331334796 >> v1:172.21.15.45:6789/0 conn(0x7ff044150400 legacy=0x7ff04406c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:18.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.684+0000 7ff04a90a640 1 -- 172.21.15.45:0/2331334796 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff044156b90 con 0x7ff04406d0f0 2023-10-03T19:13:18.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.684+0000 7ff04a90a640 1 --2- 172.21.15.45:0/2331334796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff04406d0f0 0x7ff044156650 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff04406e9c0 tx=0x7ff04001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9bc5cd7b3fb4e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:18.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.684+0000 7ff049107640 1 -- 172.21.15.45:0/2331334796 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0400a5830 con 0x7ff04406d0f0 2023-10-03T19:13:18.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.684+0000 7ff049107640 1 -- 172.21.15.45:0/2331334796 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0400a5990 con 0x7ff04406d0f0 2023-10-03T19:13:18.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.684+0000 7ff049107640 1 -- 172.21.15.45:0/2331334796 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0400a5d20 con 0x7ff04406d0f0 2023-10-03T19:13:18.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.684+0000 7ff04c36d640 1 -- 172.21.15.45:0/2331334796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff04406d0f0 msgr2=0x7ff044156650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:18.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.684+0000 7ff04c36d640 1 --2- 172.21.15.45:0/2331334796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff04406d0f0 0x7ff044156650 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff04406e9c0 tx=0x7ff04001c880 comp rx=0 tx=0).stop 2023-10-03T19:13:18.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.684+0000 7ff04c36d640 1 -- 172.21.15.45:0/2331334796 shutdown_connections 2023-10-03T19:13:18.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.684+0000 7ff04c36d640 1 --2- 172.21.15.45:0/2331334796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff04406d0f0 0x7ff044156650 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:18.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.684+0000 7ff04c36d640 1 --2- 172.21.15.45:0/2331334796 >> v2:172.21.15.79:3300/0 conn(0x7ff0440bca80 0x7ff044156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:18.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.684+0000 7ff04c36d640 1 -- 172.21.15.45:0/2331334796 >> 172.21.15.45:0/2331334796 conn(0x7ff0440bcf50 msgr2=0x7ff0440bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:18.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.684+0000 7ff04c36d640 1 -- 172.21.15.45:0/2331334796 shutdown_connections 2023-10-03T19:13:18.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.684+0000 7ff04c36d640 1 -- 172.21.15.45:0/2331334796 wait complete. 2023-10-03T19:13:18.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.684+0000 7ff04c36d640 1 Processor -- start 2023-10-03T19:13:18.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.684+0000 7ff04c36d640 1 -- start start 2023-10-03T19:13:18.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.688+0000 7ff04c36d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff04406d0f0 0x7ff044146a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:18.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.688+0000 7ff04c36d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0440bca80 0x7ff044141c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:18.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.688+0000 7ff04c36d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff044150400 0x7ff0441421b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:18.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.688+0000 7ff04c36d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0440a3f80 con 0x7ff044150400 2023-10-03T19:13:18.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.688+0000 7ff04c36d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0440a4220 con 0x7ff0440bca80 2023-10-03T19:13:18.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.688+0000 7ff04c36d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff044146f70 con 0x7ff04406d0f0 2023-10-03T19:13:18.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.688+0000 7ff04a90a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff044150400 0x7ff0441421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:18.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.688+0000 7ff04a90a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff044150400 0x7ff0441421b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36552/0 (socket says 172.21.15.45:36552) 2023-10-03T19:13:18.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.688+0000 7ff04a90a640 1 -- 172.21.15.45:0/782572074 learned_addr learned my addr 172.21.15.45:0/782572074 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:18.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.688+0000 7ff049908640 1 --2- 172.21.15.45:0/782572074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0440bca80 0x7ff044141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:18.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.688+0000 7ff04a109640 1 --2- 172.21.15.45:0/782572074 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff04406d0f0 0x7ff044146a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:18.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.688+0000 7ff04a90a640 1 -- 172.21.15.45:0/782572074 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff04406d0f0 msgr2=0x7ff044146a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:18.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.688+0000 7ff04a90a640 1 --2- 172.21.15.45:0/782572074 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff04406d0f0 0x7ff044146a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:18.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.688+0000 7ff04a90a640 1 -- 172.21.15.45:0/782572074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0440bca80 msgr2=0x7ff044141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:18.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.688+0000 7ff04a90a640 1 --2- 172.21.15.45:0/782572074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0440bca80 0x7ff044141c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:18.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.688+0000 7ff04a90a640 1 -- 172.21.15.45:0/782572074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff040009a70 con 0x7ff044150400 2023-10-03T19:13:18.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.688+0000 7ff049908640 1 --2- 172.21.15.45:0/782572074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0440bca80 0x7ff044141c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:18.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.688+0000 7ff04a109640 1 --2- 172.21.15.45:0/782572074 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff04406d0f0 0x7ff044146a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:18.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.688+0000 7ff04a90a640 1 --2- 172.21.15.45:0/782572074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff044150400 0x7ff0441421b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff0400b0040 tx=0x7ff040019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:18.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.688+0000 7ff03affd640 1 -- 172.21.15.45:0/782572074 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0400ad640 con 0x7ff044150400 2023-10-03T19:13:18.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.688+0000 7ff03affd640 1 -- 172.21.15.45:0/782572074 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0400ad7a0 con 0x7ff044150400 2023-10-03T19:13:18.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.688+0000 7ff04c36d640 1 -- 172.21.15.45:0/782572074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff04406c7f0 con 0x7ff044150400 2023-10-03T19:13:18.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.688+0000 7ff03affd640 1 -- 172.21.15.45:0/782572074 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0400adb70 con 0x7ff044150400 2023-10-03T19:13:18.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.688+0000 7ff04c36d640 1 -- 172.21.15.45:0/782572074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0440a1200 con 0x7ff044150400 2023-10-03T19:13:18.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.688+0000 7ff04c36d640 1 -- 172.21.15.45:0/782572074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0440a1b20 con 0x7ff044150400 2023-10-03T19:13:18.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.688+0000 7ff03affd640 1 -- 172.21.15.45:0/782572074 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff0400b4050 con 0x7ff044150400 2023-10-03T19:13:18.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.688+0000 7ff03affd640 1 --2- 172.21.15.45:0/782572074 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff0280662b0 0x7ff028068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:18.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.688+0000 7ff03affd640 1 -- 172.21.15.45:0/782572074 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff04011f020 con 0x7ff044150400 2023-10-03T19:13:18.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.688+0000 7ff04a109640 1 --2- 172.21.15.45:0/782572074 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff0280662b0 0x7ff028068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:18.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.692+0000 7ff04a109640 1 --2- 172.21.15.45:0/782572074 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff0280662b0 0x7ff028068760 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff03c0011f0 tx=0x7ff03c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:18.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.692+0000 7ff03affd640 1 -- 172.21.15.45:0/782572074 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff0400ec960 con 0x7ff044150400 2023-10-03T19:13:18.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.848+0000 7ff04c36d640 1 -- 172.21.15.45:0/782572074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff04404de80 con 0x7ff044150400 2023-10-03T19:13:18.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.848+0000 7ff03affd640 1 -- 172.21.15.45:0/782572074 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+126 (secure 0 0 0) 0x7ff0400b2030 con 0x7ff044150400 2023-10-03T19:13:18.854 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:13:18.855 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-10-03T19:13:18.855 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:13:18.855 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-10-03T19:13:18.855 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-10-03T19:13:18.855 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:13:18.855 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:13:18.855 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 2, 2023-10-03T19:13:18.855 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "rbd" 2023-10-03T19:13:18.855 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:13:18.855 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-10-03T19:13:18.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.852+0000 7ff04c36d640 1 -- 172.21.15.45:0/782572074 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff0280662b0 msgr2=0x7ff028068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:18.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.852+0000 7ff04c36d640 1 --2- 172.21.15.45:0/782572074 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff0280662b0 0x7ff028068760 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff03c0011f0 tx=0x7ff03c009040 comp rx=0 tx=0).stop 2023-10-03T19:13:18.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.852+0000 7ff04c36d640 1 -- 172.21.15.45:0/782572074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff044150400 msgr2=0x7ff0441421b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:18.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.852+0000 7ff04c36d640 1 --2- 172.21.15.45:0/782572074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff044150400 0x7ff0441421b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff0400b0040 tx=0x7ff040019620 comp rx=0 tx=0).stop 2023-10-03T19:13:18.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.852+0000 7ff04c36d640 1 -- 172.21.15.45:0/782572074 shutdown_connections 2023-10-03T19:13:18.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.852+0000 7ff04c36d640 1 --2- 172.21.15.45:0/782572074 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff0280662b0 0x7ff028068760 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:18.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.852+0000 7ff04c36d640 1 --2- 172.21.15.45:0/782572074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff044150400 0x7ff0441421b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:18.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.852+0000 7ff04c36d640 1 --2- 172.21.15.45:0/782572074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0440bca80 0x7ff044141c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:18.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.852+0000 7ff04c36d640 1 --2- 172.21.15.45:0/782572074 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff04406d0f0 0x7ff044146a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:18.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.852+0000 7ff04c36d640 1 -- 172.21.15.45:0/782572074 >> 172.21.15.45:0/782572074 conn(0x7ff0440bcf50 msgr2=0x7ff0440bb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:18.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.852+0000 7ff04c36d640 1 -- 172.21.15.45:0/782572074 shutdown_connections 2023-10-03T19:13:18.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:18.852+0000 7ff04c36d640 1 -- 172.21.15.45:0/782572074 wait complete. 2023-10-03T19:13:18.873 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-03T19:13:18.873 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-03T19:13:19.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa31526640 1 Processor -- start 2023-10-03T19:13:19.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa31526640 1 -- start start 2023-10-03T19:13:19.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa31526640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffa2c0712c0 0x7ffa2c0bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:19.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa31526640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffa2c06c760 0x7ffa2c0bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:19.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa31526640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa2c06c2d0 con 0x7ffa2c06d560 2023-10-03T19:13:19.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa31526640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa2c150610 con 0x7ffa2c0712c0 2023-10-03T19:13:19.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa31526640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c1508b0 con 0x7ffa2c06c760 2023-10-03T19:13:19.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa2a7fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ffa2c06d560 0x7ffa2c0a53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51018/0 (socket says 172.21.15.45:51018) 2023-10-03T19:13:19.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa2a7fc640 1 -- 172.21.15.45:0/974696771 learned_addr learned my addr 172.21.15.45:0/974696771 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:19.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa2b7fe640 1 --2- 172.21.15.45:0/974696771 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffa2c06c760 0x7ffa2c0bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:19.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa2affd640 1 --2- 172.21.15.45:0/974696771 >> v2:172.21.15.79:3300/0 conn(0x7ffa2c0712c0 0x7ffa2c0bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:19.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa29ffb640 1 -- 172.21.15.45:0/974696771 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036252307 0 0) 0x7ffa2c06c2d0 con 0x7ffa2c06d560 2023-10-03T19:13:19.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa29ffb640 1 -- 172.21.15.45:0/974696771 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa14003530 con 0x7ffa2c06d560 2023-10-03T19:13:19.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa29ffb640 1 -- 172.21.15.45:0/974696771 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3131258578 0 0) 0x7ffa14003530 con 0x7ffa2c06d560 2023-10-03T19:13:19.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa29ffb640 1 -- 172.21.15.45:0/974696771 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffa2c06c760 msgr2=0x7ffa2c0bd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:19.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa29ffb640 1 --2- 172.21.15.45:0/974696771 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffa2c06c760 0x7ffa2c0bd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:19.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa29ffb640 1 -- 172.21.15.45:0/974696771 >> v2:172.21.15.79:3300/0 conn(0x7ffa2c0712c0 msgr2=0x7ffa2c0bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:19.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa29ffb640 1 --2- 172.21.15.45:0/974696771 >> v2:172.21.15.79:3300/0 conn(0x7ffa2c0712c0 0x7ffa2c0bcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:19.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa29ffb640 1 -- 172.21.15.45:0/974696771 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa2c06d2e0 con 0x7ffa2c06d560 2023-10-03T19:13:19.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa29ffb640 1 -- 172.21.15.45:0/974696771 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7ffa1c001680 con 0x7ffa2c06d560 2023-10-03T19:13:19.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa29ffb640 1 -- 172.21.15.45:0/974696771 >> v1:172.21.15.45:6789/0 conn(0x7ffa2c06d560 legacy=0x7ffa2c0a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:19.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa29ffb640 1 --2- 172.21.15.45:0/974696771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa14003980 0x7ffa14003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:19.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa29ffb640 1 --2- 172.21.15.45:0/974696771 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffa2c06c760 0x7ffa140047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:19.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa29ffb640 1 --2- 172.21.15.45:0/974696771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa14004d10 0x7ffa14005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:19.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa29ffb640 1 -- 172.21.15.45:0/974696771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c150610 con 0x7ffa14003980 2023-10-03T19:13:19.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa29ffb640 1 -- 172.21.15.45:0/974696771 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c1508b0 con 0x7ffa14004d10 2023-10-03T19:13:19.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa29ffb640 1 -- 172.21.15.45:0/974696771 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1400b990 con 0x7ffa2c06c760 2023-10-03T19:13:19.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa2affd640 1 --2- 172.21.15.45:0/974696771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa14003980 0x7ffa14003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:19.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa2a7fc640 1 --2- 172.21.15.45:0/974696771 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffa2c06c760 0x7ffa140047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:19.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa2b7fe640 1 --2- 172.21.15.45:0/974696771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa14004d10 0x7ffa14005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:19.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa2affd640 1 -- 172.21.15.45:0/974696771 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffa2c06c760 msgr2=0x7ffa140047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:19.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa2affd640 1 --2- 172.21.15.45:0/974696771 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffa2c06c760 0x7ffa140047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:19.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa2affd640 1 -- 172.21.15.45:0/974696771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa14004d10 msgr2=0x7ffa14005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:19.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa2affd640 1 --2- 172.21.15.45:0/974696771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa14004d10 0x7ffa14005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:19.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.000+0000 7ffa2affd640 1 -- 172.21.15.45:0/974696771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa14003530 con 0x7ffa14003980 2023-10-03T19:13:19.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.004+0000 7ffa2affd640 1 --2- 172.21.15.45:0/974696771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa14003980 0x7ffa14003d90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ffa20009ae0 tx=0x7ffa2001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c647484fcab1267 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:19.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.004+0000 7ffa29ffb640 1 -- 172.21.15.45:0/974696771 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa200a64a0 con 0x7ffa14003980 2023-10-03T19:13:19.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.004+0000 7ffa29ffb640 1 -- 172.21.15.45:0/974696771 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa200a6600 con 0x7ffa14003980 2023-10-03T19:13:19.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.004+0000 7ffa29ffb640 1 -- 172.21.15.45:0/974696771 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa200a69b0 con 0x7ffa14003980 2023-10-03T19:13:19.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.004+0000 7ffa31526640 1 -- 172.21.15.45:0/974696771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa14003980 msgr2=0x7ffa14003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:19.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.004+0000 7ffa31526640 1 --2- 172.21.15.45:0/974696771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa14003980 0x7ffa14003d90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ffa20009ae0 tx=0x7ffa2001ca90 comp rx=0 tx=0).stop 2023-10-03T19:13:19.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.004+0000 7ffa2b7fe640 1 -- 172.21.15.45:0/974696771 reap_dead start 2023-10-03T19:13:19.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.004+0000 7ffa31526640 1 -- 172.21.15.45:0/974696771 shutdown_connections 2023-10-03T19:13:19.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.004+0000 7ffa31526640 1 -- 172.21.15.45:0/974696771 >> 172.21.15.45:0/974696771 conn(0x7ffa2c0a20d0 msgr2=0x7ffa2c0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:19.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.004+0000 7ffa31526640 1 -- 172.21.15.45:0/974696771 shutdown_connections 2023-10-03T19:13:19.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.004+0000 7ffa31526640 1 -- 172.21.15.45:0/974696771 wait complete. 2023-10-03T19:13:19.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.004+0000 7ffa31526640 1 Processor -- start 2023-10-03T19:13:19.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.004+0000 7ffa31526640 1 -- start start 2023-10-03T19:13:19.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.008+0000 7ffa31526640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa14003980 0x7ffa2c13f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:19.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.008+0000 7ffa31526640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffa2c13fd20 0x7ffa2c1e49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:19.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.008+0000 7ffa31526640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa2c1e87c0 0x7ffa2c1412c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:19.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.008+0000 7ffa31526640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c1e4f30 con 0x7ffa2c1e87c0 2023-10-03T19:13:19.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.008+0000 7ffa31526640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c14ee40 con 0x7ffa14003980 2023-10-03T19:13:19.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.008+0000 7ffa31526640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c1e8000 con 0x7ffa2c13fd20 2023-10-03T19:13:19.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.008+0000 7ffa2b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa2c1e87c0 0x7ffa2c1412c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:19.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.008+0000 7ffa2b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa2c1e87c0 0x7ffa2c1412c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36574/0 (socket says 172.21.15.45:36574) 2023-10-03T19:13:19.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.008+0000 7ffa2b7fe640 1 -- 172.21.15.45:0/3591793879 learned_addr learned my addr 172.21.15.45:0/3591793879 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:19.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.008+0000 7ffa2a7fc640 1 --2- 172.21.15.45:0/3591793879 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffa2c13fd20 0x7ffa2c1e49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:19.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.008+0000 7ffa2affd640 1 --2- 172.21.15.45:0/3591793879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa14003980 0x7ffa2c13f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:19.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.008+0000 7ffa2b7fe640 1 -- 172.21.15.45:0/3591793879 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffa2c13fd20 msgr2=0x7ffa2c1e49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:19.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.008+0000 7ffa2b7fe640 1 --2- 172.21.15.45:0/3591793879 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffa2c13fd20 0x7ffa2c1e49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:19.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.008+0000 7ffa2b7fe640 1 -- 172.21.15.45:0/3591793879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa14003980 msgr2=0x7ffa2c13f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:19.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.008+0000 7ffa2b7fe640 1 --2- 172.21.15.45:0/3591793879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa14003980 0x7ffa2c13f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:19.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.008+0000 7ffa2b7fe640 1 -- 172.21.15.45:0/3591793879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa2c0a6070 con 0x7ffa2c1e87c0 2023-10-03T19:13:19.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.008+0000 7ffa2a7fc640 1 --2- 172.21.15.45:0/3591793879 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffa2c13fd20 0x7ffa2c1e49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:19.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.008+0000 7ffa2b7fe640 1 --2- 172.21.15.45:0/3591793879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa2c1e87c0 0x7ffa2c1412c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c0a2fa0 tx=0x7ffa2400f0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:19.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.008+0000 7ffa137fe640 1 -- 172.21.15.45:0/3591793879 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2400f810 con 0x7ffa2c1e87c0 2023-10-03T19:13:19.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.008+0000 7ffa137fe640 1 -- 172.21.15.45:0/3591793879 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa24011040 con 0x7ffa2c1e87c0 2023-10-03T19:13:19.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.008+0000 7ffa31526640 1 -- 172.21.15.45:0/3591793879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa2c0a5ee0 con 0x7ffa2c1e87c0 2023-10-03T19:13:19.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.008+0000 7ffa137fe640 1 -- 172.21.15.45:0/3591793879 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2400fbd0 con 0x7ffa2c1e87c0 2023-10-03T19:13:19.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.008+0000 7ffa31526640 1 -- 172.21.15.45:0/3591793879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa2c1576e0 con 0x7ffa2c1e87c0 2023-10-03T19:13:19.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.008+0000 7ffa31526640 1 -- 172.21.15.45:0/3591793879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa2c14fba0 con 0x7ffa2c1e87c0 2023-10-03T19:13:19.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.008+0000 7ffa137fe640 1 -- 172.21.15.45:0/3591793879 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffa2400fd30 con 0x7ffa2c1e87c0 2023-10-03T19:13:19.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.008+0000 7ffa137fe640 1 --2- 172.21.15.45:0/3591793879 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ffa18066280 0x7ffa18068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:19.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.008+0000 7ffa137fe640 1 -- 172.21.15.45:0/3591793879 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ffa240836e0 con 0x7ffa2c1e87c0 2023-10-03T19:13:19.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.008+0000 7ffa2affd640 1 --2- 172.21.15.45:0/3591793879 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ffa18066280 0x7ffa18068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:19.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.012+0000 7ffa2affd640 1 --2- 172.21.15.45:0/3591793879 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ffa18066280 0x7ffa18068730 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ffa200ad000 tx=0x7ffa200046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:19.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.012+0000 7ffa137fe640 1 -- 172.21.15.45:0/3591793879 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ffa24050f40 con 0x7ffa2c1e87c0 2023-10-03T19:13:19.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.160+0000 7ffa31526640 1 -- 172.21.15.45:0/3591793879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ffa2c04de80 con 0x7ffa2c1e87c0 2023-10-03T19:13:19.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.908+0000 7ffa137fe640 1 -- 172.21.15.45:0/3591793879 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) v1 ==== 138+0+0 (secure 0 0 0) 0x7ffa24054560 con 0x7ffa2c1e87c0 2023-10-03T19:13:19.918 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-10-03T19:13:19.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.912+0000 7ffa31526640 1 -- 172.21.15.45:0/3591793879 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ffa18066280 msgr2=0x7ffa18068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:19.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.912+0000 7ffa31526640 1 --2- 172.21.15.45:0/3591793879 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ffa18066280 0x7ffa18068730 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ffa200ad000 tx=0x7ffa200046d0 comp rx=0 tx=0).stop 2023-10-03T19:13:19.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.912+0000 7ffa31526640 1 -- 172.21.15.45:0/3591793879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa2c1e87c0 msgr2=0x7ffa2c1412c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:19.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.912+0000 7ffa31526640 1 --2- 172.21.15.45:0/3591793879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa2c1e87c0 0x7ffa2c1412c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c0a2fa0 tx=0x7ffa2400f0d0 comp rx=0 tx=0).stop 2023-10-03T19:13:19.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.912+0000 7ffa31526640 1 -- 172.21.15.45:0/3591793879 shutdown_connections 2023-10-03T19:13:19.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.912+0000 7ffa31526640 1 --2- 172.21.15.45:0/3591793879 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ffa18066280 0x7ffa18068730 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:19.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.912+0000 7ffa31526640 1 --2- 172.21.15.45:0/3591793879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa2c1e87c0 0x7ffa2c1412c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:19.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.916+0000 7ffa31526640 1 --2- 172.21.15.45:0/3591793879 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffa2c13fd20 0x7ffa2c1e49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:19.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.916+0000 7ffa31526640 1 --2- 172.21.15.45:0/3591793879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa14003980 0x7ffa2c13f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:19.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.916+0000 7ffa31526640 1 -- 172.21.15.45:0/3591793879 >> 172.21.15.45:0/3591793879 conn(0x7ffa2c0a20d0 msgr2=0x7ffa2c0bf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:19.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.916+0000 7ffa31526640 1 -- 172.21.15.45:0/3591793879 shutdown_connections 2023-10-03T19:13:19.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:19.916+0000 7ffa31526640 1 -- 172.21.15.45:0/3591793879 wait complete. 2023-10-03T19:13:19.947 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-03T19:13:20.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.072+0000 7faf6d516640 1 Processor -- start 2023-10-03T19:13:20.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.072+0000 7faf6d516640 1 -- start start 2023-10-03T19:13:20.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.072+0000 7faf6d516640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faf6806ee50 0x7faf6814ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:20.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.072+0000 7faf6d516640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf68148330 0x7faf6814b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:20.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.072+0000 7faf6d516640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf6806cd20 con 0x7faf680bc520 2023-10-03T19:13:20.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.072+0000 7faf6d516640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf6806d5f0 con 0x7faf6806ee50 2023-10-03T19:13:20.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.072+0000 7faf6d516640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6806d2e0 con 0x7faf68148330 2023-10-03T19:13:20.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.072+0000 7faf677fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf68148330 0x7faf6814b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:20.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.072+0000 7faf677fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf68148330 0x7faf6814b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:38228/0 (socket says 172.21.15.45:38228) 2023-10-03T19:13:20.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.072+0000 7faf667fc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faf6806ee50 0x7faf6814ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:20.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.072+0000 7faf677fe640 1 -- 172.21.15.45:0/1345396145 learned_addr learned my addr 172.21.15.45:0/1345396145 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:20.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.072+0000 7faf66ffd640 1 --1- 172.21.15.45:0/1345396145 >> v1:172.21.15.79:6789/0 conn(0x7faf680bc520 0x7faf68147c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:42428/0 (socket says 172.21.15.45:42428) 2023-10-03T19:13:20.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.072+0000 7faf677fe640 1 -- 172.21.15.45:0/1345396145 >> v2:172.21.15.79:3300/0 conn(0x7faf6806ee50 msgr2=0x7faf6814ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:20.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.072+0000 7faf677fe640 1 --2- 172.21.15.45:0/1345396145 >> v2:172.21.15.79:3300/0 conn(0x7faf6806ee50 0x7faf6814ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:20.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.072+0000 7faf677fe640 1 -- 172.21.15.45:0/1345396145 >> v1:172.21.15.79:6789/0 conn(0x7faf680bc520 legacy=0x7faf68147c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:20.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.072+0000 7faf677fe640 1 -- 172.21.15.45:0/1345396145 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6806f310 con 0x7faf68148330 2023-10-03T19:13:20.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.076+0000 7faf677fe640 1 --2- 172.21.15.45:0/1345396145 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf68148330 0x7faf6814b040 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faf60009e50 tx=0x7faf6001f1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=329d63bd2b8a498 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:20.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.076+0000 7faf65ffb640 1 -- 172.21.15.45:0/1345396145 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf600af400 con 0x7faf68148330 2023-10-03T19:13:20.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.076+0000 7faf65ffb640 1 -- 172.21.15.45:0/1345396145 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf600ab050 con 0x7faf68148330 2023-10-03T19:13:20.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.076+0000 7faf65ffb640 1 -- 172.21.15.45:0/1345396145 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf600af780 con 0x7faf68148330 2023-10-03T19:13:20.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.076+0000 7faf6d516640 1 -- 172.21.15.45:0/1345396145 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf68148330 msgr2=0x7faf6814b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:20.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.076+0000 7faf6d516640 1 --2- 172.21.15.45:0/1345396145 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf68148330 0x7faf6814b040 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faf60009e50 tx=0x7faf6001f1f0 comp rx=0 tx=0).stop 2023-10-03T19:13:20.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.076+0000 7faf6d516640 1 -- 172.21.15.45:0/1345396145 shutdown_connections 2023-10-03T19:13:20.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.076+0000 7faf6d516640 1 --2- 172.21.15.45:0/1345396145 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf68148330 0x7faf6814b040 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:20.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.076+0000 7faf6d516640 1 --2- 172.21.15.45:0/1345396145 >> v2:172.21.15.79:3300/0 conn(0x7faf6806ee50 0x7faf6814ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:20.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.076+0000 7faf6d516640 1 -- 172.21.15.45:0/1345396145 >> 172.21.15.45:0/1345396145 conn(0x7faf680a20d0 msgr2=0x7faf680a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:20.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.076+0000 7faf6d516640 1 -- 172.21.15.45:0/1345396145 shutdown_connections 2023-10-03T19:13:20.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.076+0000 7faf6d516640 1 -- 172.21.15.45:0/1345396145 wait complete. 2023-10-03T19:13:20.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.080+0000 7faf6d516640 1 Processor -- start 2023-10-03T19:13:20.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.080+0000 7faf6d516640 1 -- start start 2023-10-03T19:13:20.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.080+0000 7faf6d516640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf6806ee50 0x7faf68149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:20.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.080+0000 7faf6d516640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf680bc520 0x7faf681e5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:20.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.080+0000 7faf6d516640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf68148330 0x7faf6814e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:20.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.080+0000 7faf6d516640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf681471c0 con 0x7faf680bc520 2023-10-03T19:13:20.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.080+0000 7faf6d516640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf681e2360 con 0x7faf68148330 2023-10-03T19:13:20.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.080+0000 7faf6d516640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf681e2640 con 0x7faf6806ee50 2023-10-03T19:13:20.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.080+0000 7faf667fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf680bc520 0x7faf681e5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:20.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.080+0000 7faf667fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf680bc520 0x7faf681e5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36584/0 (socket says 172.21.15.45:36584) 2023-10-03T19:13:20.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.080+0000 7faf667fc640 1 -- 172.21.15.45:0/2386863650 learned_addr learned my addr 172.21.15.45:0/2386863650 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:20.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.080+0000 7faf677fe640 1 --2- 172.21.15.45:0/2386863650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf68148330 0x7faf6814e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:20.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.080+0000 7faf66ffd640 1 --2- 172.21.15.45:0/2386863650 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf6806ee50 0x7faf68149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:20.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.080+0000 7faf667fc640 1 -- 172.21.15.45:0/2386863650 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf6806ee50 msgr2=0x7faf68149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:20.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.080+0000 7faf667fc640 1 --2- 172.21.15.45:0/2386863650 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf6806ee50 0x7faf68149fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:20.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.080+0000 7faf667fc640 1 -- 172.21.15.45:0/2386863650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf68148330 msgr2=0x7faf6814e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:20.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.080+0000 7faf667fc640 1 --2- 172.21.15.45:0/2386863650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf68148330 0x7faf6814e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:20.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.080+0000 7faf667fc640 1 -- 172.21.15.45:0/2386863650 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf60009b30 con 0x7faf680bc520 2023-10-03T19:13:20.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.080+0000 7faf677fe640 1 --2- 172.21.15.45:0/2386863650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf68148330 0x7faf6814e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:13:20.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.080+0000 7faf66ffd640 1 --2- 172.21.15.45:0/2386863650 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf6806ee50 0x7faf68149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:13:20.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.080+0000 7faf667fc640 1 --2- 172.21.15.45:0/2386863650 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf680bc520 0x7faf681e5530 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7faf5c00e8d0 tx=0x7faf5c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:20.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.080+0000 7faf4f7fe640 1 -- 172.21.15.45:0/2386863650 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c00c940 con 0x7faf680bc520 2023-10-03T19:13:20.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.080+0000 7faf4f7fe640 1 -- 172.21.15.45:0/2386863650 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c00caa0 con 0x7faf680bc520 2023-10-03T19:13:20.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.080+0000 7faf6d516640 1 -- 172.21.15.45:0/2386863650 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf680bca80 con 0x7faf680bc520 2023-10-03T19:13:20.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.080+0000 7faf4f7fe640 1 -- 172.21.15.45:0/2386863650 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c00ce10 con 0x7faf680bc520 2023-10-03T19:13:20.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.080+0000 7faf6d516640 1 -- 172.21.15.45:0/2386863650 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf680bc8f0 con 0x7faf680bc520 2023-10-03T19:13:20.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.080+0000 7faf6d516640 1 -- 172.21.15.45:0/2386863650 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf680ba6c0 con 0x7faf680bc520 2023-10-03T19:13:20.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.080+0000 7faf4f7fe640 1 -- 172.21.15.45:0/2386863650 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faf5c013470 con 0x7faf680bc520 2023-10-03T19:13:20.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.084+0000 7faf4f7fe640 1 --2- 172.21.15.45:0/2386863650 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7faf54066280 0x7faf54068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:20.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.084+0000 7faf4f7fe640 1 -- 172.21.15.45:0/2386863650 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5580+0+0 (secure 0 0 0) 0x7faf5c083db0 con 0x7faf680bc520 2023-10-03T19:13:20.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.084+0000 7faf66ffd640 1 --2- 172.21.15.45:0/2386863650 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7faf54066280 0x7faf54068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:20.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.084+0000 7faf66ffd640 1 --2- 172.21.15.45:0/2386863650 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7faf54066280 0x7faf54068730 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faf58000f70 tx=0x7faf58007d70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:20.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.088+0000 7faf4f7fe640 1 -- 172.21.15.45:0/2386863650 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7faf5c088070 con 0x7faf680bc520 2023-10-03T19:13:20.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.240+0000 7faf6d516640 1 -- 172.21.15.45:0/2386863650 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7faf68070120 con 0x7faf680bc520 2023-10-03T19:13:20.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.928+0000 7faf4f7fe640 1 -- 172.21.15.45:0/2386863650 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) v1 ==== 170+0+0 (secure 0 0 0) 0x7faf5c0170d0 con 0x7faf680bc520 2023-10-03T19:13:20.939 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-10-03T19:13:20.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.944+0000 7faf6d516640 1 -- 172.21.15.45:0/2386863650 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7faf54066280 msgr2=0x7faf54068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:20.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.944+0000 7faf6d516640 1 --2- 172.21.15.45:0/2386863650 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7faf54066280 0x7faf54068730 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faf58000f70 tx=0x7faf58007d70 comp rx=0 tx=0).stop 2023-10-03T19:13:20.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.944+0000 7faf6d516640 1 -- 172.21.15.45:0/2386863650 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf680bc520 msgr2=0x7faf681e5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:20.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.944+0000 7faf6d516640 1 --2- 172.21.15.45:0/2386863650 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf680bc520 0x7faf681e5530 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7faf5c00e8d0 tx=0x7faf5c00ed90 comp rx=0 tx=0).stop 2023-10-03T19:13:20.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.944+0000 7faf6d516640 1 -- 172.21.15.45:0/2386863650 shutdown_connections 2023-10-03T19:13:20.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.944+0000 7faf6d516640 1 --2- 172.21.15.45:0/2386863650 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7faf54066280 0x7faf54068730 secure :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faf58000f70 tx=0x7faf58007d70 comp rx=0 tx=0).stop 2023-10-03T19:13:20.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.944+0000 7faf6d516640 1 --2- 172.21.15.45:0/2386863650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf68148330 0x7faf6814e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:20.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.944+0000 7faf6d516640 1 --2- 172.21.15.45:0/2386863650 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf680bc520 0x7faf681e5530 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:20.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.944+0000 7faf6d516640 1 --2- 172.21.15.45:0/2386863650 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf6806ee50 0x7faf68149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:20.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.944+0000 7faf6d516640 1 -- 172.21.15.45:0/2386863650 >> 172.21.15.45:0/2386863650 conn(0x7faf680a20d0 msgr2=0x7faf680bac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:20.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.944+0000 7faf6d516640 1 -- 172.21.15.45:0/2386863650 shutdown_connections 2023-10-03T19:13:20.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:20.944+0000 7faf6d516640 1 -- 172.21.15.45:0/2386863650 wait complete. 2023-10-03T19:13:20.978 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-03T19:13:21.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.096+0000 7f233f29d640 1 Processor -- start 2023-10-03T19:13:21.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.096+0000 7f233f29d640 1 -- start start 2023-10-03T19:13:21.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.096+0000 7f233f29d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f23380c0420 0x7f23380bf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:21.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.096+0000 7f233f29d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23380c08c0 0x7f233814bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:21.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.096+0000 7f233f29d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23380bf930 con 0x7f23380658f0 2023-10-03T19:13:21.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.096+0000 7f233f29d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23380bfe70 con 0x7f23380c0420 2023-10-03T19:13:21.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.096+0000 7f233f29d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23380c0150 con 0x7f23380c08c0 2023-10-03T19:13:21.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.096+0000 7f233c838640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f23380c0420 0x7f23380bf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:21.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.096+0000 7f233d83a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23380c08c0 0x7f233814bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:21.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.096+0000 7f233d039640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f23380658f0 0x7f23380bbe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:42442/0 (socket says 172.21.15.45:42442) 2023-10-03T19:13:21.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.096+0000 7f233d039640 1 -- 172.21.15.45:0/541815947 learned_addr learned my addr 172.21.15.45:0/541815947 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:21.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.096+0000 7f232ffff640 1 -- 172.21.15.45:0/541815947 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98232830 0 0) 0x7f23380bf930 con 0x7f23380658f0 2023-10-03T19:13:21.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.096+0000 7f232ffff640 1 -- 172.21.15.45:0/541815947 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2324003530 con 0x7f23380658f0 2023-10-03T19:13:21.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.096+0000 7f233d83a640 1 -- 172.21.15.45:0/541815947 >> v2:172.21.15.45:3300/0 conn(0x7f23380c0420 msgr2=0x7f23380bf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:21.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.096+0000 7f233d83a640 1 --2- 172.21.15.45:0/541815947 >> v2:172.21.15.45:3300/0 conn(0x7f23380c0420 0x7f23380bf3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:21.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.096+0000 7f233d83a640 1 -- 172.21.15.45:0/541815947 >> v1:172.21.15.79:6789/0 conn(0x7f23380658f0 legacy=0x7f23380bbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:21.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.096+0000 7f233d83a640 1 -- 172.21.15.45:0/541815947 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23380c0fd0 con 0x7f23380c08c0 2023-10-03T19:13:21.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.096+0000 7f233c838640 1 --2- 172.21.15.45:0/541815947 >> v2:172.21.15.45:3300/0 conn(0x7f23380c0420 0x7f23380bf3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:13:21.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.100+0000 7f233d83a640 1 --2- 172.21.15.45:0/541815947 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23380c08c0 0x7f233814bb60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f23300097c0 tx=0x7f233001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89bfddbc7fefe6d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:21.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.100+0000 7f232ffff640 1 -- 172.21.15.45:0/541815947 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23300ad660 con 0x7f23380c08c0 2023-10-03T19:13:21.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.100+0000 7f232ffff640 1 -- 172.21.15.45:0/541815947 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23300ad7c0 con 0x7f23380c08c0 2023-10-03T19:13:21.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.100+0000 7f232ffff640 1 -- 172.21.15.45:0/541815947 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23300adb30 con 0x7f23380c08c0 2023-10-03T19:13:21.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.100+0000 7f233f29d640 1 -- 172.21.15.45:0/541815947 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23380c08c0 msgr2=0x7f233814bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:21.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.100+0000 7f233f29d640 1 --2- 172.21.15.45:0/541815947 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23380c08c0 0x7f233814bb60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f23300097c0 tx=0x7f233001c450 comp rx=0 tx=0).stop 2023-10-03T19:13:21.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.100+0000 7f233f29d640 1 -- 172.21.15.45:0/541815947 shutdown_connections 2023-10-03T19:13:21.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.100+0000 7f233f29d640 1 --2- 172.21.15.45:0/541815947 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23380c08c0 0x7f233814bb60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:21.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.100+0000 7f233f29d640 1 --2- 172.21.15.45:0/541815947 >> v2:172.21.15.45:3300/0 conn(0x7f23380c0420 0x7f23380bf3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:21.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.100+0000 7f233f29d640 1 -- 172.21.15.45:0/541815947 >> 172.21.15.45:0/541815947 conn(0x7f23380c14f0 msgr2=0x7f23380c18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:21.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.100+0000 7f233f29d640 1 -- 172.21.15.45:0/541815947 shutdown_connections 2023-10-03T19:13:21.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.100+0000 7f233f29d640 1 -- 172.21.15.45:0/541815947 wait complete. 2023-10-03T19:13:21.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.104+0000 7f233f29d640 1 Processor -- start 2023-10-03T19:13:21.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.104+0000 7f233f29d640 1 -- start start 2023-10-03T19:13:21.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.104+0000 7f233f29d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23380658f0 0x7f2338143840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:21.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.104+0000 7f233f29d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23380c0420 0x7f2338147c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:21.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.104+0000 7f233f29d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23380c08c0 0x7f233806c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:21.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.104+0000 7f233f29d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233814fef0 con 0x7f23380c0420 2023-10-03T19:13:21.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.104+0000 7f233f29d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23380a4ef0 con 0x7f23380658f0 2023-10-03T19:13:21.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.104+0000 7f233f29d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233806dfc0 con 0x7f23380c08c0 2023-10-03T19:13:21.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.104+0000 7f233c838640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23380c0420 0x7f2338147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:21.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.104+0000 7f233c838640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23380c0420 0x7f2338147c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36612/0 (socket says 172.21.15.45:36612) 2023-10-03T19:13:21.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.104+0000 7f233c838640 1 -- 172.21.15.45:0/3012692254 learned_addr learned my addr 172.21.15.45:0/3012692254 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:21.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.104+0000 7f233d039640 1 --2- 172.21.15.45:0/3012692254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23380658f0 0x7f2338143840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:21.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.104+0000 7f233d83a640 1 --2- 172.21.15.45:0/3012692254 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23380c08c0 0x7f233806c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:21.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.104+0000 7f233c838640 1 -- 172.21.15.45:0/3012692254 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23380c08c0 msgr2=0x7f233806c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:21.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.104+0000 7f233c838640 1 --2- 172.21.15.45:0/3012692254 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23380c08c0 0x7f233806c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:21.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.104+0000 7f233c838640 1 -- 172.21.15.45:0/3012692254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23380658f0 msgr2=0x7f2338143840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:21.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.104+0000 7f233c838640 1 --2- 172.21.15.45:0/3012692254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23380658f0 0x7f2338143840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:21.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.104+0000 7f233c838640 1 -- 172.21.15.45:0/3012692254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2328009420 con 0x7f23380c0420 2023-10-03T19:13:21.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.104+0000 7f233c838640 1 --2- 172.21.15.45:0/3012692254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23380c0420 0x7f2338147c40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f232800e9b0 tx=0x7f232800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:21.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.104+0000 7f232dffb640 1 -- 172.21.15.45:0/3012692254 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232800c9a0 con 0x7f23380c0420 2023-10-03T19:13:21.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.104+0000 7f232dffb640 1 -- 172.21.15.45:0/3012692254 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232800cb00 con 0x7f23380c0420 2023-10-03T19:13:21.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.104+0000 7f232dffb640 1 -- 172.21.15.45:0/3012692254 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2328013470 con 0x7f23380c0420 2023-10-03T19:13:21.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.104+0000 7f233f29d640 1 -- 172.21.15.45:0/3012692254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2330009420 con 0x7f23380c0420 2023-10-03T19:13:21.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.104+0000 7f233f29d640 1 -- 172.21.15.45:0/3012692254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2338065e50 con 0x7f23380c0420 2023-10-03T19:13:21.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.104+0000 7f233f29d640 1 -- 172.21.15.45:0/3012692254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2338065cc0 con 0x7f23380c0420 2023-10-03T19:13:21.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.108+0000 7f232dffb640 1 -- 172.21.15.45:0/3012692254 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2328004020 con 0x7f23380c0420 2023-10-03T19:13:21.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.108+0000 7f232dffb640 1 --2- 172.21.15.45:0/3012692254 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f231c0662b0 0x7f231c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:21.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.108+0000 7f232dffb640 1 -- 172.21.15.45:0/3012692254 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f2328083f00 con 0x7f23380c0420 2023-10-03T19:13:21.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.108+0000 7f233d039640 1 --2- 172.21.15.45:0/3012692254 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f231c0662b0 0x7f231c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:21.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.108+0000 7f233d039640 1 --2- 172.21.15.45:0/3012692254 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f231c0662b0 0x7f231c068760 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2334005c10 tx=0x7f2334009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:21.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.112+0000 7f232dffb640 1 -- 172.21.15.45:0/3012692254 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f23280513c0 con 0x7f23380c0420 2023-10-03T19:13:21.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.300+0000 7f233f29d640 1 -- 172.21.15.45:0/3012692254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f233806e650 con 0x7f23380c0420 2023-10-03T19:13:21.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.316+0000 7f232dffb640 1 -- 172.21.15.45:0/3012692254 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7f23280210c0 con 0x7f23380c0420 2023-10-03T19:13:21.320 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 5 and data pool 6 2023-10-03T19:13:21.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.320+0000 7f233f29d640 1 -- 172.21.15.45:0/3012692254 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f231c0662b0 msgr2=0x7f231c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:21.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.320+0000 7f233f29d640 1 --2- 172.21.15.45:0/3012692254 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f231c0662b0 0x7f231c068760 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2334005c10 tx=0x7f2334009040 comp rx=0 tx=0).stop 2023-10-03T19:13:21.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.320+0000 7f233f29d640 1 -- 172.21.15.45:0/3012692254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23380c0420 msgr2=0x7f2338147c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:21.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.320+0000 7f233f29d640 1 --2- 172.21.15.45:0/3012692254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23380c0420 0x7f2338147c40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f232800e9b0 tx=0x7f232800ee70 comp rx=0 tx=0).stop 2023-10-03T19:13:21.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.320+0000 7f233f29d640 1 -- 172.21.15.45:0/3012692254 shutdown_connections 2023-10-03T19:13:21.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.320+0000 7f233f29d640 1 --2- 172.21.15.45:0/3012692254 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f231c0662b0 0x7f231c068760 secure :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2334005c10 tx=0x7f2334009040 comp rx=0 tx=0).stop 2023-10-03T19:13:21.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.320+0000 7f233f29d640 1 --2- 172.21.15.45:0/3012692254 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23380c08c0 0x7f233806c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:21.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.320+0000 7f233f29d640 1 --2- 172.21.15.45:0/3012692254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23380c0420 0x7f2338147c40 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:21.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.320+0000 7f233f29d640 1 --2- 172.21.15.45:0/3012692254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23380658f0 0x7f2338143840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:21.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.320+0000 7f233f29d640 1 -- 172.21.15.45:0/3012692254 >> 172.21.15.45:0/3012692254 conn(0x7f23380c14f0 msgr2=0x7f23380c18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:21.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.320+0000 7f233f29d640 1 -- 172.21.15.45:0/3012692254 shutdown_connections 2023-10-03T19:13:21.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.320+0000 7f233f29d640 1 -- 172.21.15.45:0/3012692254 wait complete. 2023-10-03T19:13:21.354 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:13:21.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.472+0000 7feafb3f4640 1 Processor -- start 2023-10-03T19:13:21.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.472+0000 7feafb3f4640 1 -- start start 2023-10-03T19:13:21.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.472+0000 7feafb3f4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feaf40b98f0 0x7feaf40b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:21.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.472+0000 7feafb3f4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7feaf40bc810 0x7feaf406c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:21.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.472+0000 7feafb3f4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf40ba550 con 0x7feaf40a2e20 2023-10-03T19:13:21.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.472+0000 7feafb3f4640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf41526d0 con 0x7feaf40bc810 2023-10-03T19:13:21.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.472+0000 7feafb3f4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf41529b0 con 0x7feaf40b98f0 2023-10-03T19:13:21.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.472+0000 7feaf898f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7feaf40bc810 0x7feaf406c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:21.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.472+0000 7feaf898f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7feaf40bc810 0x7feaf406c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36626/0 (socket says 172.21.15.45:36626) 2023-10-03T19:13:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.472+0000 7feaf898f640 1 -- 172.21.15.45:0/3087714796 learned_addr learned my addr 172.21.15.45:0/3087714796 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.472+0000 7feaf898f640 1 -- 172.21.15.45:0/3087714796 >> v2:172.21.15.79:3300/0 conn(0x7feaf40b98f0 msgr2=0x7feaf40b9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.472+0000 7feaf9190640 1 --2- 172.21.15.45:0/3087714796 >> v2:172.21.15.79:3300/0 conn(0x7feaf40b98f0 0x7feaf40b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.472+0000 7feaf898f640 1 --2- 172.21.15.45:0/3087714796 >> v2:172.21.15.79:3300/0 conn(0x7feaf40b98f0 0x7feaf40b9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.472+0000 7feaf898f640 1 -- 172.21.15.45:0/3087714796 >> v1:172.21.15.79:6789/0 conn(0x7feaf40a2e20 legacy=0x7feaf406c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.472+0000 7feaf898f640 1 -- 172.21.15.45:0/3087714796 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf406cee0 con 0x7feaf40bc810 2023-10-03T19:13:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.472+0000 7feaf9190640 1 --2- 172.21.15.45:0/3087714796 >> v2:172.21.15.79:3300/0 conn(0x7feaf40b98f0 0x7feaf40b9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:21.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.472+0000 7feaf898f640 1 --2- 172.21.15.45:0/3087714796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaf40bc810 0x7feaf406c290 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7feaf40bad20 tx=0x7feae401ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36bd75f3c620affb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:21.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feaebfff640 1 -- 172.21.15.45:0/3087714796 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae40a89b0 con 0x7feaf40bc810 2023-10-03T19:13:21.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feaebfff640 1 -- 172.21.15.45:0/3087714796 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae40a8b10 con 0x7feaf40bc810 2023-10-03T19:13:21.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feaebfff640 1 -- 172.21.15.45:0/3087714796 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae40a8ea0 con 0x7feaf40bc810 2023-10-03T19:13:21.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feafb3f4640 1 -- 172.21.15.45:0/3087714796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaf40bc810 msgr2=0x7feaf406c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:21.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feafb3f4640 1 --2- 172.21.15.45:0/3087714796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaf40bc810 0x7feaf406c290 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7feaf40bad20 tx=0x7feae401ecb0 comp rx=0 tx=0).stop 2023-10-03T19:13:21.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feafb3f4640 1 -- 172.21.15.45:0/3087714796 shutdown_connections 2023-10-03T19:13:21.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feafb3f4640 1 --2- 172.21.15.45:0/3087714796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaf40bc810 0x7feaf406c290 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:21.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feafb3f4640 1 --2- 172.21.15.45:0/3087714796 >> v2:172.21.15.79:3300/0 conn(0x7feaf40b98f0 0x7feaf40b9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:21.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feafb3f4640 1 -- 172.21.15.45:0/3087714796 >> 172.21.15.45:0/3087714796 conn(0x7feaf40bcf50 msgr2=0x7feaf40bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:21.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feafb3f4640 1 -- 172.21.15.45:0/3087714796 shutdown_connections 2023-10-03T19:13:21.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feafb3f4640 1 -- 172.21.15.45:0/3087714796 wait complete. 2023-10-03T19:13:21.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feafb3f4640 1 Processor -- start 2023-10-03T19:13:21.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feafb3f4640 1 -- start start 2023-10-03T19:13:21.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feafb3f4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf40a2e20 0x7feaf414aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:21.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feafb3f4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaf40b98f0 0x7feaf40be040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:21.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feafb3f4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaf40bc810 0x7feaf40be580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:21.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feafb3f4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf40c0160 con 0x7feaf40bc810 2023-10-03T19:13:21.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feafb3f4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf414af70 con 0x7feaf40a2e20 2023-10-03T19:13:21.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feafb3f4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf41513f0 con 0x7feaf40b98f0 2023-10-03T19:13:21.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feaf9991640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaf40bc810 0x7feaf40be580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:21.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feaf9991640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaf40bc810 0x7feaf40be580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36640/0 (socket says 172.21.15.45:36640) 2023-10-03T19:13:21.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feaf9991640 1 -- 172.21.15.45:0/2696230155 learned_addr learned my addr 172.21.15.45:0/2696230155 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:21.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feaf898f640 1 --2- 172.21.15.45:0/2696230155 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaf40b98f0 0x7feaf40be040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:21.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feaf9190640 1 --2- 172.21.15.45:0/2696230155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf40a2e20 0x7feaf414aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:21.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feaf9991640 1 -- 172.21.15.45:0/2696230155 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaf40b98f0 msgr2=0x7feaf40be040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:21.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feaf9991640 1 --2- 172.21.15.45:0/2696230155 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaf40b98f0 0x7feaf40be040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:21.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feaf9991640 1 -- 172.21.15.45:0/2696230155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf40a2e20 msgr2=0x7feaf414aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:21.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feaf9991640 1 --2- 172.21.15.45:0/2696230155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf40a2e20 0x7feaf414aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:21.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feaf9991640 1 -- 172.21.15.45:0/2696230155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae40094d0 con 0x7feaf40bc810 2023-10-03T19:13:21.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feaf9991640 1 --2- 172.21.15.45:0/2696230155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaf40bc810 0x7feaf40be580 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7feaf000b410 tx=0x7feaf000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:21.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feae9ffb640 1 -- 172.21.15.45:0/2696230155 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf0011830 con 0x7feaf40bc810 2023-10-03T19:13:21.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feae9ffb640 1 -- 172.21.15.45:0/2696230155 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf00119d0 con 0x7feaf40bc810 2023-10-03T19:13:21.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feae9ffb640 1 -- 172.21.15.45:0/2696230155 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf0011d80 con 0x7feaf40bc810 2023-10-03T19:13:21.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feafb3f4640 1 -- 172.21.15.45:0/2696230155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf40ba950 con 0x7feaf40bc810 2023-10-03T19:13:21.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.476+0000 7feafb3f4640 1 -- 172.21.15.45:0/2696230155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf40ba200 con 0x7feaf40bc810 2023-10-03T19:13:21.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.480+0000 7feafb3f4640 1 -- 172.21.15.45:0/2696230155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf40baae0 con 0x7feaf40bc810 2023-10-03T19:13:21.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.480+0000 7feae9ffb640 1 -- 172.21.15.45:0/2696230155 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7feaf00193b0 con 0x7feaf40bc810 2023-10-03T19:13:21.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.480+0000 7feae9ffb640 1 --2- 172.21.15.45:0/2696230155 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fead8066280 0x7fead8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:21.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.480+0000 7feae9ffb640 1 -- 172.21.15.45:0/2696230155 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feaf0083bb0 con 0x7feaf40bc810 2023-10-03T19:13:21.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.480+0000 7feaf9190640 1 --2- 172.21.15.45:0/2696230155 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fead8066280 0x7fead8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:21.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.480+0000 7feaf9190640 1 --2- 172.21.15.45:0/2696230155 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fead8066280 0x7fead8068730 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7feaec0075b0 tx=0x7feaec007540 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:21.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.484+0000 7feae9ffb640 1 -- 172.21.15.45:0/2696230155 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7feaf0050f90 con 0x7feaf40bc810 2023-10-03T19:13:21.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.640+0000 7feafb3f4640 1 -- 172.21.15.45:0/2696230155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feaf404de80 con 0x7feaf40bc810 2023-10-03T19:13:21.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.640+0000 7feae9ffb640 1 -- 172.21.15.45:0/2696230155 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+18316 (secure 0 0 0) 0x7feaf00545b0 con 0x7feaf40bc810 2023-10-03T19:13:21.647 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:13:21.647 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":34,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:13:21.306851+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:13:19.206863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-03T19:13:20.283396+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:13:21.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.644+0000 7feafb3f4640 1 -- 172.21.15.45:0/2696230155 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fead8066280 msgr2=0x7fead8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:21.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.644+0000 7feafb3f4640 1 --2- 172.21.15.45:0/2696230155 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fead8066280 0x7fead8068730 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7feaec0075b0 tx=0x7feaec007540 comp rx=0 tx=0).stop 2023-10-03T19:13:21.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.644+0000 7feafb3f4640 1 -- 172.21.15.45:0/2696230155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaf40bc810 msgr2=0x7feaf40be580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:21.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.644+0000 7feafb3f4640 1 --2- 172.21.15.45:0/2696230155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaf40bc810 0x7feaf40be580 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7feaf000b410 tx=0x7feaf000b8d0 comp rx=0 tx=0).stop 2023-10-03T19:13:21.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.644+0000 7feafb3f4640 1 -- 172.21.15.45:0/2696230155 shutdown_connections 2023-10-03T19:13:21.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.644+0000 7feafb3f4640 1 --2- 172.21.15.45:0/2696230155 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fead8066280 0x7fead8068730 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:21.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.644+0000 7feafb3f4640 1 --2- 172.21.15.45:0/2696230155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaf40bc810 0x7feaf40be580 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:21.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.644+0000 7feafb3f4640 1 --2- 172.21.15.45:0/2696230155 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaf40b98f0 0x7feaf40be040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:21.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.644+0000 7feafb3f4640 1 --2- 172.21.15.45:0/2696230155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf40a2e20 0x7feaf414aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:21.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.644+0000 7feafb3f4640 1 -- 172.21.15.45:0/2696230155 >> 172.21.15.45:0/2696230155 conn(0x7feaf40bcf50 msgr2=0x7feaf40c03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:21.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.644+0000 7feafb3f4640 1 -- 172.21.15.45:0/2696230155 shutdown_connections 2023-10-03T19:13:21.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.644+0000 7feafb3f4640 1 -- 172.21.15.45:0/2696230155 wait complete. 2023-10-03T19:13:21.666 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:13:21.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.780+0000 7ff99b5cd640 1 Processor -- start 2023-10-03T19:13:21.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.780+0000 7ff99b5cd640 1 -- start start 2023-10-03T19:13:21.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff99b5cd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff99406f170 0x7ff994150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:21.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff99b5cd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff99406cac0 con 0x7ff9940bc8b0 2023-10-03T19:13:21.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff99b5cd640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9940720d0 con 0x7ff99406d170 2023-10-03T19:13:21.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff99b5cd640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9940a5ab0 con 0x7ff99406f170 2023-10-03T19:13:21.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff998b68640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff9940bc8b0 0x7ff99414ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51026/0 (socket says 172.21.15.45:51026) 2023-10-03T19:13:21.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff998b68640 1 -- 172.21.15.45:0/611884939 learned_addr learned my addr 172.21.15.45:0/611884939 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:21.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff999369640 1 --2- 172.21.15.45:0/611884939 >> v2:172.21.15.79:3300/0 conn(0x7ff99406f170 0x7ff994150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:21.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff98bfff640 1 -- 172.21.15.45:0/611884939 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4184664105 0 0) 0x7ff984001120 con 0x7ff9940bc8b0 2023-10-03T19:13:21.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff98bfff640 1 -- 172.21.15.45:0/611884939 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff980003530 con 0x7ff9940bc8b0 2023-10-03T19:13:21.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff98bfff640 1 -- 172.21.15.45:0/611884939 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2354705482 0 0) 0x7ff980003530 con 0x7ff9940bc8b0 2023-10-03T19:13:21.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff98bfff640 1 -- 172.21.15.45:0/611884939 >> v2:172.21.15.79:3300/0 conn(0x7ff99406f170 msgr2=0x7ff994150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:21.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff98bfff640 1 --2- 172.21.15.45:0/611884939 >> v2:172.21.15.79:3300/0 conn(0x7ff99406f170 0x7ff994150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:21.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff98bfff640 1 -- 172.21.15.45:0/611884939 >> v1:172.21.15.79:6789/0 conn(0x7ff99406d170 legacy=0x7ff994156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:21.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff98bfff640 1 -- 172.21.15.45:0/611884939 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99406cd00 con 0x7ff9940bc8b0 2023-10-03T19:13:21.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff98bfff640 1 -- 172.21.15.45:0/611884939 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7ff984001810 con 0x7ff9940bc8b0 2023-10-03T19:13:21.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff98bfff640 1 -- 172.21.15.45:0/611884939 >> v1:172.21.15.45:6789/0 conn(0x7ff9940bc8b0 legacy=0x7ff99414ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:21.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff98bfff640 1 --2- 172.21.15.45:0/611884939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff980003980 0x7ff980003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:21.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff98bfff640 1 --2- 172.21.15.45:0/611884939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9800047d0 0x7ff980004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:21.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff98bfff640 1 --2- 172.21.15.45:0/611884939 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff980005180 0x7ff98000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:21.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff98bfff640 1 -- 172.21.15.45:0/611884939 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9940a5ab0 con 0x7ff980003980 2023-10-03T19:13:21.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff98bfff640 1 -- 172.21.15.45:0/611884939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98000bfe0 con 0x7ff9800047d0 2023-10-03T19:13:21.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff98bfff640 1 -- 172.21.15.45:0/611884939 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff98000c1a0 con 0x7ff980005180 2023-10-03T19:13:21.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff999369640 1 --2- 172.21.15.45:0/611884939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff980003980 0x7ff980003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:21.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff999b6a640 1 --2- 172.21.15.45:0/611884939 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff980005180 0x7ff98000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:21.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff998b68640 1 --2- 172.21.15.45:0/611884939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9800047d0 0x7ff980004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:21.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff999369640 1 -- 172.21.15.45:0/611884939 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff980005180 msgr2=0x7ff98000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:21.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff999369640 1 --2- 172.21.15.45:0/611884939 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff980005180 0x7ff98000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:21.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff999369640 1 -- 172.21.15.45:0/611884939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9800047d0 msgr2=0x7ff980004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:21.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff999369640 1 --2- 172.21.15.45:0/611884939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9800047d0 0x7ff980004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:21.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff999369640 1 -- 172.21.15.45:0/611884939 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff980003530 con 0x7ff980003980 2023-10-03T19:13:21.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff999b6a640 1 --2- 172.21.15.45:0/611884939 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff980005180 0x7ff98000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:21.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.784+0000 7ff999b6a640 1 -- 172.21.15.45:0/611884939 reap_dead start 2023-10-03T19:13:21.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff999369640 1 --2- 172.21.15.45:0/611884939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff980003980 0x7ff980003d90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff990009ae0 tx=0x7ff99001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=356da20d0b9e38dc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:21.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff98bfff640 1 -- 172.21.15.45:0/611884939 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9900a5640 con 0x7ff980003980 2023-10-03T19:13:21.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff98bfff640 1 -- 172.21.15.45:0/611884939 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9900a57a0 con 0x7ff980003980 2023-10-03T19:13:21.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff98bfff640 1 -- 172.21.15.45:0/611884939 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9900a5b50 con 0x7ff980003980 2023-10-03T19:13:21.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff99b5cd640 1 -- 172.21.15.45:0/611884939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff980003980 msgr2=0x7ff980003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:21.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff99b5cd640 1 --2- 172.21.15.45:0/611884939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff980003980 0x7ff980003d90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff990009ae0 tx=0x7ff99001ca50 comp rx=0 tx=0).stop 2023-10-03T19:13:21.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff99b5cd640 1 -- 172.21.15.45:0/611884939 shutdown_connections 2023-10-03T19:13:21.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff99b5cd640 1 --2- 172.21.15.45:0/611884939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff980003980 0x7ff980003d90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:21.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff99b5cd640 1 -- 172.21.15.45:0/611884939 >> 172.21.15.45:0/611884939 conn(0x7ff9940bcf50 msgr2=0x7ff9940bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:21.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff99b5cd640 1 -- 172.21.15.45:0/611884939 shutdown_connections 2023-10-03T19:13:21.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff99b5cd640 1 -- 172.21.15.45:0/611884939 wait complete. 2023-10-03T19:13:21.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff99b5cd640 1 Processor -- start 2023-10-03T19:13:21.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff99b5cd640 1 -- start start 2023-10-03T19:13:21.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff99b5cd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff980003980 0x7ff99414e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:21.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff99b5cd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff994147f60 0x7ff9941e6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:21.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff99b5cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff99414bd60 0x7ff9941e7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:21.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff99b5cd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff994148ce0 con 0x7ff99414bd60 2023-10-03T19:13:21.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff99b5cd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99414e800 con 0x7ff994147f60 2023-10-03T19:13:21.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff99b5cd640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff994146540 con 0x7ff980003980 2023-10-03T19:13:21.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff999b6a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff99414bd60 0x7ff9941e7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:21.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff999b6a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff99414bd60 0x7ff9941e7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36664/0 (socket says 172.21.15.45:36664) 2023-10-03T19:13:21.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff999b6a640 1 -- 172.21.15.45:0/4130319804 learned_addr learned my addr 172.21.15.45:0/4130319804 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:21.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff998b68640 1 --2- 172.21.15.45:0/4130319804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff994147f60 0x7ff9941e6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:21.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff999369640 1 --2- 172.21.15.45:0/4130319804 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff980003980 0x7ff99414e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:21.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff999b6a640 1 -- 172.21.15.45:0/4130319804 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff980003980 msgr2=0x7ff99414e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:21.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff999b6a640 1 --2- 172.21.15.45:0/4130319804 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff980003980 0x7ff99414e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:21.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff999b6a640 1 -- 172.21.15.45:0/4130319804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff994147f60 msgr2=0x7ff9941e6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:21.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff999b6a640 1 --2- 172.21.15.45:0/4130319804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff994147f60 0x7ff9941e6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:21.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff999b6a640 1 -- 172.21.15.45:0/4130319804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99414c4a0 con 0x7ff99414bd60 2023-10-03T19:13:21.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff999b6a640 1 --2- 172.21.15.45:0/4130319804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff99414bd60 0x7ff9941e7350 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff99406eec0 tx=0x7ff98c00d830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:21.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff989ffb640 1 -- 172.21.15.45:0/4130319804 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c00b070 con 0x7ff99414bd60 2023-10-03T19:13:21.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff989ffb640 1 -- 172.21.15.45:0/4130319804 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98c003980 con 0x7ff99414bd60 2023-10-03T19:13:21.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.788+0000 7ff989ffb640 1 -- 172.21.15.45:0/4130319804 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c003d30 con 0x7ff99414bd60 2023-10-03T19:13:21.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.792+0000 7ff99b5cd640 1 -- 172.21.15.45:0/4130319804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff99414fae0 con 0x7ff99414bd60 2023-10-03T19:13:21.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.792+0000 7ff99b5cd640 1 -- 172.21.15.45:0/4130319804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff99406f540 con 0x7ff99414bd60 2023-10-03T19:13:21.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.792+0000 7ff99b5cd640 1 -- 172.21.15.45:0/4130319804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff99406d660 con 0x7ff99414bd60 2023-10-03T19:13:21.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.792+0000 7ff989ffb640 1 -- 172.21.15.45:0/4130319804 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff98c005070 con 0x7ff99414bd60 2023-10-03T19:13:21.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.792+0000 7ff989ffb640 1 --2- 172.21.15.45:0/4130319804 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff9780662b0 0x7ff978068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:21.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.792+0000 7ff989ffb640 1 -- 172.21.15.45:0/4130319804 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff98c082ae0 con 0x7ff99414bd60 2023-10-03T19:13:21.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.792+0000 7ff999369640 1 --2- 172.21.15.45:0/4130319804 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff9780662b0 0x7ff978068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:21.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.792+0000 7ff999369640 1 --2- 172.21.15.45:0/4130319804 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff9780662b0 0x7ff978068760 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff9900af000 tx=0x7ff990008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:21.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.796+0000 7ff989ffb640 1 -- 172.21.15.45:0/4130319804 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff98c04ff50 con 0x7ff99414bd60 2023-10-03T19:13:21.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.956+0000 7ff99b5cd640 1 -- 172.21.15.45:0/4130319804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff99404de80 con 0x7ff99414bd60 2023-10-03T19:13:21.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.956+0000 7ff989ffb640 1 -- 172.21.15.45:0/4130319804 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+18316 (secure 0 0 0) 0x7ff98c018090 con 0x7ff99414bd60 2023-10-03T19:13:21.963 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:13:21.963 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":34,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:13:21.306851+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:13:19.206863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-03T19:13:20.283396+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:13:21.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.960+0000 7ff99b5cd640 1 -- 172.21.15.45:0/4130319804 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff9780662b0 msgr2=0x7ff978068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:21.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.960+0000 7ff99b5cd640 1 --2- 172.21.15.45:0/4130319804 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff9780662b0 0x7ff978068760 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff9900af000 tx=0x7ff990008040 comp rx=0 tx=0).stop 2023-10-03T19:13:21.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.960+0000 7ff99b5cd640 1 -- 172.21.15.45:0/4130319804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff99414bd60 msgr2=0x7ff9941e7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:21.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.960+0000 7ff99b5cd640 1 --2- 172.21.15.45:0/4130319804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff99414bd60 0x7ff9941e7350 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff99406eec0 tx=0x7ff98c00d830 comp rx=0 tx=0).stop 2023-10-03T19:13:21.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.960+0000 7ff99b5cd640 1 -- 172.21.15.45:0/4130319804 shutdown_connections 2023-10-03T19:13:21.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.960+0000 7ff99b5cd640 1 --2- 172.21.15.45:0/4130319804 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff9780662b0 0x7ff978068760 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:21.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.960+0000 7ff99b5cd640 1 --2- 172.21.15.45:0/4130319804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff99414bd60 0x7ff9941e7350 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:21.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.960+0000 7ff99b5cd640 1 --2- 172.21.15.45:0/4130319804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff994147f60 0x7ff9941e6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:21.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.960+0000 7ff99b5cd640 1 --2- 172.21.15.45:0/4130319804 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff980003980 0x7ff99414e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:21.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.960+0000 7ff99b5cd640 1 -- 172.21.15.45:0/4130319804 >> 172.21.15.45:0/4130319804 conn(0x7ff9940bcf50 msgr2=0x7ff9940c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:21.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.960+0000 7ff99b5cd640 1 -- 172.21.15.45:0/4130319804 shutdown_connections 2023-10-03T19:13:21.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:21.960+0000 7ff99b5cd640 1 -- 172.21.15.45:0/4130319804 wait complete. 2023-10-03T19:13:21.982 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-03T19:13:22.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.108+0000 7f4438804640 1 Processor -- start 2023-10-03T19:13:22.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.108+0000 7f4438804640 1 -- start start 2023-10-03T19:13:22.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.112+0000 7f4438804640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f443406d630 0x7f443414e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:22.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.112+0000 7f4438804640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44340bcf80 con 0x7f4434148540 2023-10-03T19:13:22.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.112+0000 7f4438804640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44340bd260 con 0x7f443406c1b0 2023-10-03T19:13:22.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.112+0000 7f4438804640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4434152b50 con 0x7f443406d630 2023-10-03T19:13:22.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.112+0000 7f443259c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4434148540 0x7f44340bb060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51034/0 (socket says 172.21.15.45:51034) 2023-10-03T19:13:22.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.112+0000 7f443259c640 1 -- 172.21.15.45:0/4113668492 learned_addr learned my addr 172.21.15.45:0/4113668492 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:22.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.112+0000 7f4431d9b640 1 --2- 172.21.15.45:0/4113668492 >> v2:172.21.15.79:3300/0 conn(0x7f443406d630 0x7f443414e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:22.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.112+0000 7f443159a640 1 -- 172.21.15.45:0/4113668492 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032125802 0 0) 0x7f44340bcf80 con 0x7f4434148540 2023-10-03T19:13:22.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.112+0000 7f443159a640 1 -- 172.21.15.45:0/4113668492 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4420003530 con 0x7f4434148540 2023-10-03T19:13:22.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.112+0000 7f443159a640 1 -- 172.21.15.45:0/4113668492 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 709528738 0 0) 0x7f4420003530 con 0x7f4434148540 2023-10-03T19:13:22.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.112+0000 7f443159a640 1 -- 172.21.15.45:0/4113668492 >> v2:172.21.15.79:3300/0 conn(0x7f443406d630 msgr2=0x7f443414e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:22.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.112+0000 7f443159a640 1 --2- 172.21.15.45:0/4113668492 >> v2:172.21.15.79:3300/0 conn(0x7f443406d630 0x7f443414e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:22.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.112+0000 7f443159a640 1 -- 172.21.15.45:0/4113668492 >> v1:172.21.15.79:6789/0 conn(0x7f443406c1b0 legacy=0x7f443414eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:22.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.112+0000 7f443159a640 1 -- 172.21.15.45:0/4113668492 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44340bd540 con 0x7f4434148540 2023-10-03T19:13:22.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.112+0000 7f443159a640 1 -- 172.21.15.45:0/4113668492 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f4424001680 con 0x7f4434148540 2023-10-03T19:13:22.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.112+0000 7f443159a640 1 -- 172.21.15.45:0/4113668492 >> v1:172.21.15.45:6789/0 conn(0x7f4434148540 legacy=0x7f44340bb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:22.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.112+0000 7f443159a640 1 --2- 172.21.15.45:0/4113668492 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4420003980 0x7f4420003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:22.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.112+0000 7f443159a640 1 --2- 172.21.15.45:0/4113668492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44200047d0 0x7f4420004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:22.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.112+0000 7f443159a640 1 --2- 172.21.15.45:0/4113668492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4420005180 0x7f442000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:22.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.112+0000 7f443159a640 1 -- 172.21.15.45:0/4113668492 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4434152b50 con 0x7f4420005180 2023-10-03T19:13:22.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.112+0000 7f443159a640 1 -- 172.21.15.45:0/4113668492 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442000c000 con 0x7f44200047d0 2023-10-03T19:13:22.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.112+0000 7f443159a640 1 -- 172.21.15.45:0/4113668492 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f442000c1c0 con 0x7f4420003980 2023-10-03T19:13:22.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.112+0000 7f4432d9d640 1 --2- 172.21.15.45:0/4113668492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4420005180 0x7f442000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:22.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.112+0000 7f443259c640 1 --2- 172.21.15.45:0/4113668492 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4420003980 0x7f4420003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:22.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.112+0000 7f4431d9b640 1 --2- 172.21.15.45:0/4113668492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44200047d0 0x7f4420004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:22.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.112+0000 7f4432d9d640 1 -- 172.21.15.45:0/4113668492 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4420003980 msgr2=0x7f4420003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:22.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.112+0000 7f4432d9d640 1 --2- 172.21.15.45:0/4113668492 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4420003980 0x7f4420003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:22.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.112+0000 7f4432d9d640 1 -- 172.21.15.45:0/4113668492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44200047d0 msgr2=0x7f4420004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:22.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.112+0000 7f4432d9d640 1 --2- 172.21.15.45:0/4113668492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44200047d0 0x7f4420004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:22.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.112+0000 7f4432d9d640 1 -- 172.21.15.45:0/4113668492 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4420003530 con 0x7f4420005180 2023-10-03T19:13:22.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f4432d9d640 1 -- 172.21.15.45:0/4113668492 reap_dead start 2023-10-03T19:13:22.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f4432d9d640 1 --2- 172.21.15.45:0/4113668492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4420005180 0x7f442000b990 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f442c001750 tx=0x7f442c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1eb5d6a1ed9a674 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:22.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f443159a640 1 -- 172.21.15.45:0/4113668492 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c0052d0 con 0x7f4420005180 2023-10-03T19:13:22.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f443159a640 1 -- 172.21.15.45:0/4113668492 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442c0a7050 con 0x7f4420005180 2023-10-03T19:13:22.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f443159a640 1 -- 172.21.15.45:0/4113668492 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c003600 con 0x7f4420005180 2023-10-03T19:13:22.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f4438804640 1 -- 172.21.15.45:0/4113668492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4420005180 msgr2=0x7f442000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:22.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f4438804640 1 --2- 172.21.15.45:0/4113668492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4420005180 0x7f442000b990 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f442c001750 tx=0x7f442c01c3c0 comp rx=0 tx=0).stop 2023-10-03T19:13:22.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f4438804640 1 -- 172.21.15.45:0/4113668492 shutdown_connections 2023-10-03T19:13:22.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f4438804640 1 --2- 172.21.15.45:0/4113668492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4420005180 0x7f442000b990 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:22.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f4438804640 1 -- 172.21.15.45:0/4113668492 >> 172.21.15.45:0/4113668492 conn(0x7f44340a20d0 msgr2=0x7f44340a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:22.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f4438804640 1 -- 172.21.15.45:0/4113668492 shutdown_connections 2023-10-03T19:13:22.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f4438804640 1 -- 172.21.15.45:0/4113668492 wait complete. 2023-10-03T19:13:22.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f4438804640 1 Processor -- start 2023-10-03T19:13:22.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f4438804640 1 -- start start 2023-10-03T19:13:22.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f4438804640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4420005180 0x7f44340a5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:22.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f4438804640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44340a62a0 0x7f443414de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:22.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f4438804640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f443414e360 0x7f443406fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:22.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f4438804640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4434150260 con 0x7f44340a62a0 2023-10-03T19:13:22.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f4438804640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44341e3b70 con 0x7f4420005180 2023-10-03T19:13:22.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f4438804640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44341e3e50 con 0x7f443414e360 2023-10-03T19:13:22.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f4431d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44340a62a0 0x7f443414de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:22.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f4431d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44340a62a0 0x7f443414de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36684/0 (socket says 172.21.15.45:36684) 2023-10-03T19:13:22.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f4431d9b640 1 -- 172.21.15.45:0/2746191732 learned_addr learned my addr 172.21.15.45:0/2746191732 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:22.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f443259c640 1 --2- 172.21.15.45:0/2746191732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4420005180 0x7f44340a5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:22.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f4432d9d640 1 --2- 172.21.15.45:0/2746191732 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f443414e360 0x7f443406fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:22.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f4431d9b640 1 -- 172.21.15.45:0/2746191732 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f443414e360 msgr2=0x7f443406fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:22.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f4431d9b640 1 --2- 172.21.15.45:0/2746191732 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f443414e360 0x7f443406fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:22.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f4431d9b640 1 -- 172.21.15.45:0/2746191732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4420005180 msgr2=0x7f44340a5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:22.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f4431d9b640 1 --2- 172.21.15.45:0/2746191732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4420005180 0x7f44340a5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:22.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f4431d9b640 1 -- 172.21.15.45:0/2746191732 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44340bdc10 con 0x7f44340a62a0 2023-10-03T19:13:22.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f443259c640 1 --2- 172.21.15.45:0/2746191732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4420005180 0x7f44340a5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:13:22.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f4431d9b640 1 --2- 172.21.15.45:0/2746191732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44340a62a0 0x7f443414de20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f441c00f380 tx=0x7f441c00f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:22.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f442affd640 1 -- 172.21.15.45:0/2746191732 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c017600 con 0x7f44340a62a0 2023-10-03T19:13:22.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f442affd640 1 -- 172.21.15.45:0/2746191732 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441c011040 con 0x7f44340a62a0 2023-10-03T19:13:22.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.116+0000 7f4438804640 1 -- 172.21.15.45:0/2746191732 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4434148910 con 0x7f44340a62a0 2023-10-03T19:13:22.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.120+0000 7f442affd640 1 -- 172.21.15.45:0/2746191732 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c0179a0 con 0x7f44340a62a0 2023-10-03T19:13:22.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.120+0000 7f4438804640 1 -- 172.21.15.45:0/2746191732 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44340bdda0 con 0x7f44340a62a0 2023-10-03T19:13:22.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.120+0000 7f4438804640 1 -- 172.21.15.45:0/2746191732 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44341e4010 con 0x7f44340a62a0 2023-10-03T19:13:22.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.120+0000 7f442affd640 1 -- 172.21.15.45:0/2746191732 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f441c017b00 con 0x7f44340a62a0 2023-10-03T19:13:22.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.120+0000 7f442affd640 1 --2- 172.21.15.45:0/2746191732 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f44140662b0 0x7f4414068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:22.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.120+0000 7f442affd640 1 -- 172.21.15.45:0/2746191732 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f441c084490 con 0x7f44340a62a0 2023-10-03T19:13:22.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.120+0000 7f443259c640 1 --2- 172.21.15.45:0/2746191732 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f44140662b0 0x7f4414068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:22.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.120+0000 7f443259c640 1 --2- 172.21.15.45:0/2746191732 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f44140662b0 0x7f4414068760 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4424005a40 tx=0x7f4424009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:22.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.124+0000 7f442affd640 1 -- 172.21.15.45:0/2746191732 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f44341e4010 con 0x7f44340a62a0 2023-10-03T19:13:22.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:22.316+0000 7f4438804640 1 -- 172.21.15.45:0/2746191732 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f44341e4010 con 0x7f44340a62a0 2023-10-03T19:13:23.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.332+0000 7f442affd640 1 -- 172.21.15.45:0/2746191732 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7f44341e4010 con 0x7f44340a62a0 2023-10-03T19:13:23.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.336+0000 7f4438804640 1 -- 172.21.15.45:0/2746191732 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f44140662b0 msgr2=0x7f4414068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:23.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.336+0000 7f4438804640 1 --2- 172.21.15.45:0/2746191732 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f44140662b0 0x7f4414068760 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4424005a40 tx=0x7f4424009040 comp rx=0 tx=0).stop 2023-10-03T19:13:23.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.336+0000 7f4438804640 1 -- 172.21.15.45:0/2746191732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44340a62a0 msgr2=0x7f443414de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:23.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.336+0000 7f4438804640 1 --2- 172.21.15.45:0/2746191732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44340a62a0 0x7f443414de20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f441c00f380 tx=0x7f441c00f840 comp rx=0 tx=0).stop 2023-10-03T19:13:23.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.336+0000 7f4438804640 1 -- 172.21.15.45:0/2746191732 shutdown_connections 2023-10-03T19:13:23.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.336+0000 7f4438804640 1 --2- 172.21.15.45:0/2746191732 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f44140662b0 0x7f4414068760 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:23.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.336+0000 7f4438804640 1 --2- 172.21.15.45:0/2746191732 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f443414e360 0x7f443406fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:23.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.336+0000 7f4438804640 1 --2- 172.21.15.45:0/2746191732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44340a62a0 0x7f443414de20 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:23.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.336+0000 7f4438804640 1 --2- 172.21.15.45:0/2746191732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4420005180 0x7f44340a5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:23.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.336+0000 7f4438804640 1 -- 172.21.15.45:0/2746191732 >> 172.21.15.45:0/2746191732 conn(0x7f44340a20d0 msgr2=0x7f44340a24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:23.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.336+0000 7f4438804640 1 -- 172.21.15.45:0/2746191732 shutdown_connections 2023-10-03T19:13:23.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.336+0000 7f4438804640 1 -- 172.21.15.45:0/2746191732 wait complete. 2023-10-03T19:13:23.364 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-03T19:13:23.364 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-03T19:13:23.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d9b8a640 1 Processor -- start 2023-10-03T19:13:23.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d9b8a640 1 -- start start 2023-10-03T19:13:23.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d9b8a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f21d406cc20 0x7f21d4147d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:23.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d9b8a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d406f650 con 0x7f21d406ee50 2023-10-03T19:13:23.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d9b8a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d406f3b0 con 0x7f21d406c410 2023-10-03T19:13:23.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d9b8a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d414b680 con 0x7f21d406cc20 2023-10-03T19:13:23.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d3fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f21d406ee50 0x7f21d4155390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51040/0 (socket says 172.21.15.45:51040) 2023-10-03T19:13:23.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d3fff640 1 -- 172.21.15.45:0/4036842695 learned_addr learned my addr 172.21.15.45:0/4036842695 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:23.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d2ffd640 1 --2- 172.21.15.45:0/4036842695 >> v2:172.21.15.79:3300/0 conn(0x7f21d406cc20 0x7f21d4147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:23.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d27fc640 1 -- 172.21.15.45:0/4036842695 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3814722049 0 0) 0x7f21d406f650 con 0x7f21d406ee50 2023-10-03T19:13:23.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d27fc640 1 -- 172.21.15.45:0/4036842695 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21c0003530 con 0x7f21d406ee50 2023-10-03T19:13:23.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d27fc640 1 -- 172.21.15.45:0/4036842695 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 677283725 0 0) 0x7f21c0003530 con 0x7f21d406ee50 2023-10-03T19:13:23.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d27fc640 1 -- 172.21.15.45:0/4036842695 >> v2:172.21.15.79:3300/0 conn(0x7f21d406cc20 msgr2=0x7f21d4147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:23.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d27fc640 1 --2- 172.21.15.45:0/4036842695 >> v2:172.21.15.79:3300/0 conn(0x7f21d406cc20 0x7f21d4147d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:23.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d27fc640 1 -- 172.21.15.45:0/4036842695 >> v1:172.21.15.79:6789/0 conn(0x7f21d406c410 legacy=0x7f21d40bc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:23.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d27fc640 1 -- 172.21.15.45:0/4036842695 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d414b960 con 0x7f21d406ee50 2023-10-03T19:13:23.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d27fc640 1 -- 172.21.15.45:0/4036842695 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f21cc001a00 con 0x7f21d406ee50 2023-10-03T19:13:23.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d27fc640 1 -- 172.21.15.45:0/4036842695 >> v1:172.21.15.45:6789/0 conn(0x7f21d406ee50 legacy=0x7f21d4155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:23.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d27fc640 1 --2- 172.21.15.45:0/4036842695 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21c0003980 0x7f21c0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:23.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d27fc640 1 --2- 172.21.15.45:0/4036842695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21c00047d0 0x7f21c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:23.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d27fc640 1 --2- 172.21.15.45:0/4036842695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c0005180 0x7f21c000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:23.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d27fc640 1 -- 172.21.15.45:0/4036842695 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d414b680 con 0x7f21c00047d0 2023-10-03T19:13:23.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d27fc640 1 -- 172.21.15.45:0/4036842695 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c000c000 con 0x7f21c0005180 2023-10-03T19:13:23.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d27fc640 1 -- 172.21.15.45:0/4036842695 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c000c1c0 con 0x7f21c0003980 2023-10-03T19:13:23.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d2ffd640 1 --2- 172.21.15.45:0/4036842695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21c00047d0 0x7f21c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:23.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d37fe640 1 --2- 172.21.15.45:0/4036842695 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21c0003980 0x7f21c0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:23.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d2ffd640 1 -- 172.21.15.45:0/4036842695 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21c0003980 msgr2=0x7f21c0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:23.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d2ffd640 1 --2- 172.21.15.45:0/4036842695 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21c0003980 0x7f21c0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:23.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d2ffd640 1 -- 172.21.15.45:0/4036842695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c0005180 msgr2=0x7f21c000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:23.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d2ffd640 1 --2- 172.21.15.45:0/4036842695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c0005180 0x7f21c000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:23.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d3fff640 1 -- 172.21.15.45:0/4036842695 reap_dead start 2023-10-03T19:13:23.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.492+0000 7f21d2ffd640 1 -- 172.21.15.45:0/4036842695 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c0003530 con 0x7f21c00047d0 2023-10-03T19:13:23.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d2ffd640 1 --2- 172.21.15.45:0/4036842695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21c00047d0 0x7f21c0004c40 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f21bc009ab0 tx=0x7f21bc01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba9c789002f78b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:23.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d27fc640 1 -- 172.21.15.45:0/4036842695 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc0a5560 con 0x7f21c00047d0 2023-10-03T19:13:23.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d27fc640 1 -- 172.21.15.45:0/4036842695 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21bc0a56c0 con 0x7f21c00047d0 2023-10-03T19:13:23.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d27fc640 1 -- 172.21.15.45:0/4036842695 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc0a5a70 con 0x7f21c00047d0 2023-10-03T19:13:23.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d9b8a640 1 -- 172.21.15.45:0/4036842695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21c00047d0 msgr2=0x7f21c0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:23.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d9b8a640 1 --2- 172.21.15.45:0/4036842695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21c00047d0 0x7f21c0004c40 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f21bc009ab0 tx=0x7f21bc01ca50 comp rx=0 tx=0).stop 2023-10-03T19:13:23.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d9b8a640 1 -- 172.21.15.45:0/4036842695 shutdown_connections 2023-10-03T19:13:23.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d9b8a640 1 --2- 172.21.15.45:0/4036842695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21c00047d0 0x7f21c0004c40 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:23.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d9b8a640 1 -- 172.21.15.45:0/4036842695 >> 172.21.15.45:0/4036842695 conn(0x7f21d40a20d0 msgr2=0x7f21d40a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:23.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d9b8a640 1 -- 172.21.15.45:0/4036842695 shutdown_connections 2023-10-03T19:13:23.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d9b8a640 1 -- 172.21.15.45:0/4036842695 wait complete. 2023-10-03T19:13:23.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d9b8a640 1 Processor -- start 2023-10-03T19:13:23.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d9b8a640 1 -- start start 2023-10-03T19:13:23.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d9b8a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c00047d0 0x7f21d41d6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:23.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d9b8a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21d41d6ce0 0x7f21d4145950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:23.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d9b8a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21d40b9920 0x7f21d41e3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:23.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d9b8a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d41467f0 con 0x7f21d41d6ce0 2023-10-03T19:13:23.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d9b8a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d41448d0 con 0x7f21c00047d0 2023-10-03T19:13:23.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d9b8a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d4145e90 con 0x7f21d40b9920 2023-10-03T19:13:23.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21d41d6ce0 0x7f21d4145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:23.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21d41d6ce0 0x7f21d4145950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36708/0 (socket says 172.21.15.45:36708) 2023-10-03T19:13:23.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d2ffd640 1 -- 172.21.15.45:0/2498367497 learned_addr learned my addr 172.21.15.45:0/2498367497 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:23.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d37fe640 1 --2- 172.21.15.45:0/2498367497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c00047d0 0x7f21d41d6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:23.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d3fff640 1 --2- 172.21.15.45:0/2498367497 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21d40b9920 0x7f21d41e3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:23.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d2ffd640 1 -- 172.21.15.45:0/2498367497 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21d40b9920 msgr2=0x7f21d41e3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:23.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d2ffd640 1 --2- 172.21.15.45:0/2498367497 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21d40b9920 0x7f21d41e3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:23.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d2ffd640 1 -- 172.21.15.45:0/2498367497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c00047d0 msgr2=0x7f21d41d6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:23.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d2ffd640 1 --2- 172.21.15.45:0/2498367497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c00047d0 0x7f21d41d6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:23.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d2ffd640 1 -- 172.21.15.45:0/2498367497 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d406c970 con 0x7f21d41d6ce0 2023-10-03T19:13:23.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d37fe640 1 --2- 172.21.15.45:0/2498367497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c00047d0 0x7f21d41d6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:23.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d3fff640 1 --2- 172.21.15.45:0/2498367497 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21d40b9920 0x7f21d41e3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:23.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.496+0000 7f21d2ffd640 1 --2- 172.21.15.45:0/2498367497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21d41d6ce0 0x7f21d4145950 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f21bc0b0040 tx=0x7f21bc0197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:23.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.500+0000 7f21cbfff640 1 -- 172.21.15.45:0/2498367497 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc0bb070 con 0x7f21d41d6ce0 2023-10-03T19:13:23.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.500+0000 7f21cbfff640 1 -- 172.21.15.45:0/2498367497 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21bc0ad440 con 0x7f21d41d6ce0 2023-10-03T19:13:23.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.500+0000 7f21d9b8a640 1 -- 172.21.15.45:0/2498367497 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d406c7e0 con 0x7f21d41d6ce0 2023-10-03T19:13:23.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.500+0000 7f21cbfff640 1 -- 172.21.15.45:0/2498367497 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc0ad7f0 con 0x7f21d41d6ce0 2023-10-03T19:13:23.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.500+0000 7f21d9b8a640 1 -- 172.21.15.45:0/2498367497 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d40ba6c0 con 0x7f21d41d6ce0 2023-10-03T19:13:23.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.500+0000 7f21d9b8a640 1 -- 172.21.15.45:0/2498367497 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d404de80 con 0x7f21d41d6ce0 2023-10-03T19:13:23.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.500+0000 7f21cbfff640 1 -- 172.21.15.45:0/2498367497 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f21bc0b4070 con 0x7f21d41d6ce0 2023-10-03T19:13:23.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.500+0000 7f21cbfff640 1 --2- 172.21.15.45:0/2498367497 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f21b40662b0 0x7f21b4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:23.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.500+0000 7f21cbfff640 1 -- 172.21.15.45:0/2498367497 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f21bc11d450 con 0x7f21d41d6ce0 2023-10-03T19:13:23.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.500+0000 7f21d37fe640 1 --2- 172.21.15.45:0/2498367497 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f21b40662b0 0x7f21b4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:23.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.500+0000 7f21d37fe640 1 --2- 172.21.15.45:0/2498367497 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f21b40662b0 0x7f21b4068760 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f21c4007fd0 tx=0x7f21c4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:23.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.504+0000 7f21cbfff640 1 -- 172.21.15.45:0/2498367497 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f21bc0ea8d0 con 0x7f21d41d6ce0 2023-10-03T19:13:23.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:23.696+0000 7f21d9b8a640 1 -- 172.21.15.45:0/2498367497 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f21d40bdbf0 con 0x7f21d41d6ce0 2023-10-03T19:13:24.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.344+0000 7f21cbfff640 1 -- 172.21.15.45:0/2498367497 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f21bc0edef0 con 0x7f21d41d6ce0 2023-10-03T19:13:24.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.348+0000 7f21d9b8a640 1 -- 172.21.15.45:0/2498367497 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f21b40662b0 msgr2=0x7f21b4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:24.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.348+0000 7f21d9b8a640 1 --2- 172.21.15.45:0/2498367497 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f21b40662b0 0x7f21b4068760 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f21c4007fd0 tx=0x7f21c4009040 comp rx=0 tx=0).stop 2023-10-03T19:13:24.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.348+0000 7f21d9b8a640 1 -- 172.21.15.45:0/2498367497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21d41d6ce0 msgr2=0x7f21d4145950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:24.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.348+0000 7f21d9b8a640 1 --2- 172.21.15.45:0/2498367497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21d41d6ce0 0x7f21d4145950 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f21bc0b0040 tx=0x7f21bc0197f0 comp rx=0 tx=0).stop 2023-10-03T19:13:24.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.348+0000 7f21d9b8a640 1 -- 172.21.15.45:0/2498367497 shutdown_connections 2023-10-03T19:13:24.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.348+0000 7f21d9b8a640 1 --2- 172.21.15.45:0/2498367497 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f21b40662b0 0x7f21b4068760 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:24.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.348+0000 7f21d9b8a640 1 --2- 172.21.15.45:0/2498367497 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21d40b9920 0x7f21d41e3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:24.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.348+0000 7f21d9b8a640 1 --2- 172.21.15.45:0/2498367497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21d41d6ce0 0x7f21d4145950 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:24.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.348+0000 7f21d9b8a640 1 --2- 172.21.15.45:0/2498367497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c00047d0 0x7f21d41d6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:24.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.348+0000 7f21d9b8a640 1 -- 172.21.15.45:0/2498367497 >> 172.21.15.45:0/2498367497 conn(0x7f21d40a20d0 msgr2=0x7f21d41d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:24.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.348+0000 7f21d9b8a640 1 -- 172.21.15.45:0/2498367497 shutdown_connections 2023-10-03T19:13:24.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.348+0000 7f21d9b8a640 1 -- 172.21.15.45:0/2498367497 wait complete. 2023-10-03T19:13:24.374 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-03T19:13:24.374 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:13:24.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.492+0000 7f6f686bd640 1 Processor -- start 2023-10-03T19:13:24.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.492+0000 7f6f686bd640 1 -- start start 2023-10-03T19:13:24.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.492+0000 7f6f686bd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6f6006c9a0 0x7f6f60156d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:24.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.492+0000 7f6f686bd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f6014b610 con 0x7f6f60148b90 2023-10-03T19:13:24.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.492+0000 7f6f686bd640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f600a5580 con 0x7f6f600bcb60 2023-10-03T19:13:24.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.492+0000 7f6f686bd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f600a3670 con 0x7f6f6006c9a0 2023-10-03T19:13:24.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.492+0000 7f6f66459640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6f60148b90 0x7f6f600bbf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51042/0 (socket says 172.21.15.45:51042) 2023-10-03T19:13:24.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.492+0000 7f6f66459640 1 -- 172.21.15.45:0/3834317235 learned_addr learned my addr 172.21.15.45:0/3834317235 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:24.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.492+0000 7f6f66c5a640 1 --2- 172.21.15.45:0/3834317235 >> v2:172.21.15.45:3300/0 conn(0x7f6f6006c9a0 0x7f6f60156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:24.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.492+0000 7f6f65457640 1 -- 172.21.15.45:0/3834317235 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 929546862 0 0) 0x7f6f6014b610 con 0x7f6f60148b90 2023-10-03T19:13:24.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.492+0000 7f6f65457640 1 -- 172.21.15.45:0/3834317235 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f4c003530 con 0x7f6f60148b90 2023-10-03T19:13:24.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.492+0000 7f6f66c5a640 1 -- 172.21.15.45:0/3834317235 >> v1:172.21.15.79:6789/0 conn(0x7f6f600bcb60 legacy=0x7f6f6006c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:24.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.492+0000 7f6f66c5a640 1 -- 172.21.15.45:0/3834317235 >> v1:172.21.15.45:6789/0 conn(0x7f6f60148b90 legacy=0x7f6f600bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:24.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.492+0000 7f6f66c5a640 1 -- 172.21.15.45:0/3834317235 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f600a5820 con 0x7f6f6006c9a0 2023-10-03T19:13:24.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f66c5a640 1 --2- 172.21.15.45:0/3834317235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f6006c9a0 0x7f6f60156d00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6f58009d90 tx=0x7f6f5801f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccbe27c97d56ff40 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:24.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f65457640 1 -- 172.21.15.45:0/3834317235 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f580af600 con 0x7f6f6006c9a0 2023-10-03T19:13:24.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f65457640 1 -- 172.21.15.45:0/3834317235 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f580ab050 con 0x7f6f6006c9a0 2023-10-03T19:13:24.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f65457640 1 -- 172.21.15.45:0/3834317235 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f580af980 con 0x7f6f6006c9a0 2023-10-03T19:13:24.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f686bd640 1 -- 172.21.15.45:0/3834317235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f6006c9a0 msgr2=0x7f6f60156d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:24.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f686bd640 1 --2- 172.21.15.45:0/3834317235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f6006c9a0 0x7f6f60156d00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6f58009d90 tx=0x7f6f5801f130 comp rx=0 tx=0).stop 2023-10-03T19:13:24.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f686bd640 1 -- 172.21.15.45:0/3834317235 shutdown_connections 2023-10-03T19:13:24.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f686bd640 1 --2- 172.21.15.45:0/3834317235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f6006c9a0 0x7f6f60156d00 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:24.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f686bd640 1 -- 172.21.15.45:0/3834317235 >> 172.21.15.45:0/3834317235 conn(0x7f6f600bcf50 msgr2=0x7f6f600bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:24.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f686bd640 1 -- 172.21.15.45:0/3834317235 shutdown_connections 2023-10-03T19:13:24.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f686bd640 1 -- 172.21.15.45:0/3834317235 wait complete. 2023-10-03T19:13:24.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f686bd640 1 Processor -- start 2023-10-03T19:13:24.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f686bd640 1 -- start start 2023-10-03T19:13:24.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f686bd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f6006c9a0 0x7f6f60142a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:24.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f686bd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6f600bcb60 0x7f6f600bafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:24.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f686bd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f60148b90 0x7f6f6014a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:24.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f686bd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6014ae70 con 0x7f6f60148b90 2023-10-03T19:13:24.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f686bd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f60142fb0 con 0x7f6f6006c9a0 2023-10-03T19:13:24.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f686bd640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6014b340 con 0x7f6f600bcb60 2023-10-03T19:13:24.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f66c5a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f60148b90 0x7f6f6014a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:24.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f66c5a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f60148b90 0x7f6f6014a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36736/0 (socket says 172.21.15.45:36736) 2023-10-03T19:13:24.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f66c5a640 1 -- 172.21.15.45:0/1037938910 learned_addr learned my addr 172.21.15.45:0/1037938910 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:24.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f66459640 1 --2- 172.21.15.45:0/1037938910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f6006c9a0 0x7f6f60142a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:24.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f65c58640 1 --2- 172.21.15.45:0/1037938910 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6f600bcb60 0x7f6f600bafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:24.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f66c5a640 1 -- 172.21.15.45:0/1037938910 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6f600bcb60 msgr2=0x7f6f600bafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:24.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f66c5a640 1 --2- 172.21.15.45:0/1037938910 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6f600bcb60 0x7f6f600bafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:24.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f66c5a640 1 -- 172.21.15.45:0/1037938910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f6006c9a0 msgr2=0x7f6f60142a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:24.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f66c5a640 1 --2- 172.21.15.45:0/1037938910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f6006c9a0 0x7f6f60142a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:24.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f66c5a640 1 -- 172.21.15.45:0/1037938910 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f58009a70 con 0x7f6f60148b90 2023-10-03T19:13:24.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f65c58640 1 --2- 172.21.15.45:0/1037938910 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6f600bcb60 0x7f6f600bafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:24.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f66c5a640 1 --2- 172.21.15.45:0/1037938910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f60148b90 0x7f6f6014a140 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6f5801cd60 tx=0x7f6f5801bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:24.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f56ffd640 1 -- 172.21.15.45:0/1037938910 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f58009450 con 0x7f6f60148b90 2023-10-03T19:13:24.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f56ffd640 1 -- 172.21.15.45:0/1037938910 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f580ba480 con 0x7f6f60148b90 2023-10-03T19:13:24.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f686bd640 1 -- 172.21.15.45:0/1037938910 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f60148f60 con 0x7f6f60148b90 2023-10-03T19:13:24.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f56ffd640 1 -- 172.21.15.45:0/1037938910 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f580ba810 con 0x7f6f60148b90 2023-10-03T19:13:24.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.496+0000 7f6f686bd640 1 -- 172.21.15.45:0/1037938910 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f600bc670 con 0x7f6f60148b90 2023-10-03T19:13:24.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.500+0000 7f6f686bd640 1 -- 172.21.15.45:0/1037938910 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f600a3880 con 0x7f6f60148b90 2023-10-03T19:13:24.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.500+0000 7f6f56ffd640 1 -- 172.21.15.45:0/1037938910 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6f580b6040 con 0x7f6f60148b90 2023-10-03T19:13:24.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.500+0000 7f6f56ffd640 1 --2- 172.21.15.45:0/1037938910 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6f44066280 0x7f6f44068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:24.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.500+0000 7f6f56ffd640 1 -- 172.21.15.45:0/1037938910 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6f581225b0 con 0x7f6f60148b90 2023-10-03T19:13:24.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.500+0000 7f6f66459640 1 --2- 172.21.15.45:0/1037938910 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6f44066280 0x7f6f44068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:24.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.500+0000 7f6f66459640 1 --2- 172.21.15.45:0/1037938910 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6f44066280 0x7f6f44068730 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0011f0 tx=0x7f6f5c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:24.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.504+0000 7f6f56ffd640 1 -- 172.21.15.45:0/1037938910 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6f580efac0 con 0x7f6f60148b90 2023-10-03T19:13:24.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.692+0000 7f6f686bd640 1 -- 172.21.15.45:0/1037938910 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f6004de80 con 0x7f6f60148b90 2023-10-03T19:13:24.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.696+0000 7f6f56ffd640 1 -- 172.21.15.45:0/1037938910 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+3908 (secure 0 0 0) 0x7f6f580f30e0 con 0x7f6f60148b90 2023-10-03T19:13:24.700 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:13:24.701 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4727,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/659816428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":659816428},{"type":"v1","addr":"172.21.15.79:6835","nonce":659816428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5073,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3273073650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3273073650},{"type":"v1","addr":"172.21.15.45:6834","nonce":3273073650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:13:21.307600+0000","modified":"2023-10-03T19:13:24.332226+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5076},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5076":{"gid":5076,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/252012936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":252012936},{"type":"v1","addr":"172.21.15.45:6835","nonce":252012936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-03T19:13:24.701 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 15 2023-10-03T19:13:24.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.696+0000 7f6f686bd640 1 -- 172.21.15.45:0/1037938910 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6f44066280 msgr2=0x7f6f44068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:24.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.696+0000 7f6f686bd640 1 --2- 172.21.15.45:0/1037938910 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6f44066280 0x7f6f44068730 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0011f0 tx=0x7f6f5c009040 comp rx=0 tx=0).stop 2023-10-03T19:13:24.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.696+0000 7f6f686bd640 1 -- 172.21.15.45:0/1037938910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f60148b90 msgr2=0x7f6f6014a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:24.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.696+0000 7f6f686bd640 1 --2- 172.21.15.45:0/1037938910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f60148b90 0x7f6f6014a140 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6f5801cd60 tx=0x7f6f5801bed0 comp rx=0 tx=0).stop 2023-10-03T19:13:24.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.696+0000 7f6f686bd640 1 -- 172.21.15.45:0/1037938910 shutdown_connections 2023-10-03T19:13:24.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.696+0000 7f6f686bd640 1 --2- 172.21.15.45:0/1037938910 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6f44066280 0x7f6f44068730 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:24.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.696+0000 7f6f686bd640 1 --2- 172.21.15.45:0/1037938910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f60148b90 0x7f6f6014a140 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:24.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.696+0000 7f6f686bd640 1 --2- 172.21.15.45:0/1037938910 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6f600bcb60 0x7f6f600bafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:24.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.696+0000 7f6f686bd640 1 --2- 172.21.15.45:0/1037938910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f6006c9a0 0x7f6f60142a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:24.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.696+0000 7f6f686bd640 1 -- 172.21.15.45:0/1037938910 >> 172.21.15.45:0/1037938910 conn(0x7f6f600bcf50 msgr2=0x7f6f601449d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:24.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.696+0000 7f6f686bd640 1 -- 172.21.15.45:0/1037938910 shutdown_connections 2023-10-03T19:13:24.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.696+0000 7f6f686bd640 1 -- 172.21.15.45:0/1037938910 wait complete. 2023-10-03T19:13:24.718 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:13:24.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.840+0000 7f7d12f18640 1 Processor -- start 2023-10-03T19:13:24.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.840+0000 7f7d12f18640 1 -- start start 2023-10-03T19:13:24.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.840+0000 7f7d12f18640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d0c0bc810 0x7f7d0c06c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:24.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.840+0000 7f7d12f18640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0c0ba550 con 0x7f7d0c0a2e20 2023-10-03T19:13:24.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.840+0000 7f7d12f18640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0c1526d0 con 0x7f7d0c0b98f0 2023-10-03T19:13:24.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.840+0000 7f7d12f18640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d0c1529b0 con 0x7f7d0c0bc810 2023-10-03T19:13:24.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.840+0000 7f7d114b5640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7d0c0a2e20 0x7f7d0c06c7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35802/0 (socket says 172.21.15.45:35802) 2023-10-03T19:13:24.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.840+0000 7f7d114b5640 1 -- 172.21.15.45:0/172321778 learned_addr learned my addr 172.21.15.45:0/172321778 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:24.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.840+0000 7f7d0bfff640 1 --2- 172.21.15.45:0/172321778 >> v2:172.21.15.45:3300/0 conn(0x7f7d0c0bc810 0x7f7d0c06c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:24.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.840+0000 7f7d0b7fe640 1 -- 172.21.15.45:0/172321778 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 158929124 0 0) 0x7f7d0c0ba550 con 0x7f7d0c0a2e20 2023-10-03T19:13:24.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.840+0000 7f7d0b7fe640 1 -- 172.21.15.45:0/172321778 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cfc003530 con 0x7f7d0c0a2e20 2023-10-03T19:13:24.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.840+0000 7f7d0bfff640 1 -- 172.21.15.45:0/172321778 >> v1:172.21.15.79:6789/0 conn(0x7f7d0c0b98f0 legacy=0x7f7d0c0b9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:24.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.840+0000 7f7d0bfff640 1 -- 172.21.15.45:0/172321778 >> v1:172.21.15.45:6789/0 conn(0x7f7d0c0a2e20 legacy=0x7f7d0c06c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:24.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.840+0000 7f7d0bfff640 1 -- 172.21.15.45:0/172321778 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c06cee0 con 0x7f7d0c0bc810 2023-10-03T19:13:24.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d0bfff640 1 --2- 172.21.15.45:0/172321778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d0c0bc810 0x7f7d0c06c290 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7cf80097c0 tx=0x7f7cf801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb02d2110090898 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:24.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d0b7fe640 1 -- 172.21.15.45:0/172321778 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf80a8970 con 0x7f7d0c0bc810 2023-10-03T19:13:24.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d0b7fe640 1 -- 172.21.15.45:0/172321778 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf80a8ad0 con 0x7f7d0c0bc810 2023-10-03T19:13:24.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d0b7fe640 1 -- 172.21.15.45:0/172321778 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf80a8e40 con 0x7f7d0c0bc810 2023-10-03T19:13:24.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d12f18640 1 -- 172.21.15.45:0/172321778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d0c0bc810 msgr2=0x7f7d0c06c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:24.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d12f18640 1 --2- 172.21.15.45:0/172321778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d0c0bc810 0x7f7d0c06c290 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7cf80097c0 tx=0x7f7cf801ec70 comp rx=0 tx=0).stop 2023-10-03T19:13:24.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d12f18640 1 -- 172.21.15.45:0/172321778 shutdown_connections 2023-10-03T19:13:24.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d12f18640 1 --2- 172.21.15.45:0/172321778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d0c0bc810 0x7f7d0c06c290 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:24.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d12f18640 1 -- 172.21.15.45:0/172321778 >> 172.21.15.45:0/172321778 conn(0x7f7d0c0bcf50 msgr2=0x7f7d0c0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:24.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d12f18640 1 -- 172.21.15.45:0/172321778 shutdown_connections 2023-10-03T19:13:24.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d12f18640 1 -- 172.21.15.45:0/172321778 wait complete. 2023-10-03T19:13:24.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d12f18640 1 Processor -- start 2023-10-03T19:13:24.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d12f18640 1 -- start start 2023-10-03T19:13:24.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d12f18640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d0c0a2e20 0x7f7d0c143a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:24.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d12f18640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d0c0b98f0 0x7f7d0c150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:24.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d12f18640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d0c0bc810 0x7f7d0c1508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:24.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d12f18640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c1415c0 con 0x7f7d0c0a2e20 2023-10-03T19:13:24.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d12f18640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c143fa0 con 0x7f7d0c0bc810 2023-10-03T19:13:24.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d12f18640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c14fb30 con 0x7f7d0c0b98f0 2023-10-03T19:13:24.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d10cb4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d0c0a2e20 0x7f7d0c143a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:24.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d10cb4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d0c0a2e20 0x7f7d0c143a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54018/0 (socket says 172.21.15.45:54018) 2023-10-03T19:13:24.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d10cb4640 1 -- 172.21.15.45:0/3932698979 learned_addr learned my addr 172.21.15.45:0/3932698979 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:24.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d114b5640 1 --2- 172.21.15.45:0/3932698979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d0c0bc810 0x7f7d0c1508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:24.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d0bfff640 1 --2- 172.21.15.45:0/3932698979 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d0c0b98f0 0x7f7d0c150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:24.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d10cb4640 1 -- 172.21.15.45:0/3932698979 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d0c0b98f0 msgr2=0x7f7d0c150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:24.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d10cb4640 1 --2- 172.21.15.45:0/3932698979 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d0c0b98f0 0x7f7d0c150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:24.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d10cb4640 1 -- 172.21.15.45:0/3932698979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d0c0bc810 msgr2=0x7f7d0c1508c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:24.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d10cb4640 1 --2- 172.21.15.45:0/3932698979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d0c0bc810 0x7f7d0c1508c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:24.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d10cb4640 1 -- 172.21.15.45:0/3932698979 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf8009420 con 0x7f7d0c0a2e20 2023-10-03T19:13:24.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d10cb4640 1 --2- 172.21.15.45:0/3932698979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d0c0a2e20 0x7f7d0c143a60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7d0000c3a0 tx=0x7f7d0000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:24.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d097fa640 1 -- 172.21.15.45:0/3932698979 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d000052d0 con 0x7f7d0c0a2e20 2023-10-03T19:13:24.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d097fa640 1 -- 172.21.15.45:0/3932698979 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d00005430 con 0x7f7d0c0a2e20 2023-10-03T19:13:24.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d097fa640 1 -- 172.21.15.45:0/3932698979 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d00007260 con 0x7f7d0c0a2e20 2023-10-03T19:13:24.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d12f18640 1 -- 172.21.15.45:0/3932698979 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d0c0baae0 con 0x7f7d0c0a2e20 2023-10-03T19:13:24.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.844+0000 7f7d12f18640 1 -- 172.21.15.45:0/3932698979 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0c0ba950 con 0x7f7d0c0a2e20 2023-10-03T19:13:24.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.848+0000 7f7d12f18640 1 -- 172.21.15.45:0/3932698979 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d0c14bf50 con 0x7f7d0c0a2e20 2023-10-03T19:13:24.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.848+0000 7f7d097fa640 1 -- 172.21.15.45:0/3932698979 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7d000073c0 con 0x7f7d0c0a2e20 2023-10-03T19:13:24.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.848+0000 7f7d097fa640 1 --2- 172.21.15.45:0/3932698979 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7cf00662b0 0x7f7cf0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:24.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.848+0000 7f7d097fa640 1 -- 172.21.15.45:0/3932698979 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7d00083050 con 0x7f7d0c0a2e20 2023-10-03T19:13:24.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.848+0000 7f7d0bfff640 1 --2- 172.21.15.45:0/3932698979 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7cf00662b0 0x7f7cf0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:24.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.848+0000 7f7d0bfff640 1 --2- 172.21.15.45:0/3932698979 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7cf00662b0 0x7f7cf0068760 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7cf80b2000 tx=0x7f7cf80aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:24.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:24.852+0000 7f7d097fa640 1 -- 172.21.15.45:0/3932698979 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7d00050560 con 0x7f7d0c0a2e20 2023-10-03T19:13:24.884 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-03T19:13:24.880+0000 7f0f08d69640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-03T19:13:25.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.008+0000 7f7d12f18640 1 -- 172.21.15.45:0/3932698979 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d0c04de80 con 0x7f7d0c0a2e20 2023-10-03T19:13:25.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.008+0000 7f7d097fa640 1 -- 172.21.15.45:0/3932698979 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+18303 (secure 0 0 0) 0x7f7d00053b80 con 0x7f7d0c0a2e20 2023-10-03T19:13:25.015 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:13:25.016 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":35,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:13:22.312003+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:13:19.206863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-03T19:13:20.283396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:13:25.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.012+0000 7f7d12f18640 1 -- 172.21.15.45:0/3932698979 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7cf00662b0 msgr2=0x7f7cf0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:25.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.012+0000 7f7d12f18640 1 --2- 172.21.15.45:0/3932698979 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7cf00662b0 0x7f7cf0068760 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7cf80b2000 tx=0x7f7cf80aa070 comp rx=0 tx=0).stop 2023-10-03T19:13:25.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.012+0000 7f7d12f18640 1 -- 172.21.15.45:0/3932698979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d0c0a2e20 msgr2=0x7f7d0c143a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:25.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.012+0000 7f7d12f18640 1 --2- 172.21.15.45:0/3932698979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d0c0a2e20 0x7f7d0c143a60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7d0000c3a0 tx=0x7f7d0000c860 comp rx=0 tx=0).stop 2023-10-03T19:13:25.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.012+0000 7f7d12f18640 1 -- 172.21.15.45:0/3932698979 shutdown_connections 2023-10-03T19:13:25.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.012+0000 7f7d12f18640 1 --2- 172.21.15.45:0/3932698979 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7cf00662b0 0x7f7cf0068760 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.012+0000 7f7d12f18640 1 --2- 172.21.15.45:0/3932698979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d0c0bc810 0x7f7d0c1508c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.012+0000 7f7d12f18640 1 --2- 172.21.15.45:0/3932698979 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d0c0b98f0 0x7f7d0c150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.012+0000 7f7d12f18640 1 --2- 172.21.15.45:0/3932698979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d0c0a2e20 0x7f7d0c143a60 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.012+0000 7f7d12f18640 1 -- 172.21.15.45:0/3932698979 >> 172.21.15.45:0/3932698979 conn(0x7f7d0c0bcf50 msgr2=0x7f7d0c0a5010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:25.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.012+0000 7f7d12f18640 1 -- 172.21.15.45:0/3932698979 shutdown_connections 2023-10-03T19:13:25.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.012+0000 7f7d12f18640 1 -- 172.21.15.45:0/3932698979 wait complete. 2023-10-03T19:13:25.034 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-03T19:13:25.034 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:13:25.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.152+0000 7f3691a2e640 1 Processor -- start 2023-10-03T19:13:25.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.152+0000 7f3691a2e640 1 -- start start 2023-10-03T19:13:25.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.152+0000 7f3691a2e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f368c06f170 0x7f368c150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:25.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.152+0000 7f3691a2e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f368c0bc8b0 0x7f368c14ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:25.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.152+0000 7f3691a2e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f368c06d170 0x7f368c14cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:25.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.152+0000 7f3691a2e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f368c06cac0 con 0x7f368c06f170 2023-10-03T19:13:25.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.152+0000 7f3691a2e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f368c14d4f0 con 0x7f368c0bc8b0 2023-10-03T19:13:25.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.152+0000 7f3691a2e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368c0720d0 con 0x7f368c06d170 2023-10-03T19:13:25.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.152+0000 7f368affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f368c06f170 0x7f368c150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:25.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.152+0000 7f368affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f368c06f170 0x7f368c150190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54030/0 (socket says 172.21.15.45:54030) 2023-10-03T19:13:25.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.152+0000 7f368affd640 1 -- 172.21.15.45:0/771643618 learned_addr learned my addr 172.21.15.45:0/771643618 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:25.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.152+0000 7f36827fc640 1 --2- 172.21.15.45:0/771643618 >> v2:172.21.15.79:3300/0 conn(0x7f368c0bc8b0 0x7f368c14ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:25.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.152+0000 7f368b7fe640 1 --2- 172.21.15.45:0/771643618 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f368c06d170 0x7f368c14cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:25.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.152+0000 7f368affd640 1 -- 172.21.15.45:0/771643618 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f368c06d170 msgr2=0x7f368c14cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:25.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.152+0000 7f368affd640 1 --2- 172.21.15.45:0/771643618 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f368c06d170 0x7f368c14cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.152+0000 7f368affd640 1 -- 172.21.15.45:0/771643618 >> v2:172.21.15.79:3300/0 conn(0x7f368c0bc8b0 msgr2=0x7f368c14ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:25.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.152+0000 7f368affd640 1 --2- 172.21.15.45:0/771643618 >> v2:172.21.15.79:3300/0 conn(0x7f368c0bc8b0 0x7f368c14ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.152+0000 7f368affd640 1 -- 172.21.15.45:0/771643618 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368c0a5ab0 con 0x7f368c06f170 2023-10-03T19:13:25.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.156+0000 7f368affd640 1 --2- 172.21.15.45:0/771643618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f368c06f170 0x7f368c150190 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f368c06e9c0 tx=0x7f367c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8212583e7c77ce88 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:25.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.156+0000 7f368a7fc640 1 -- 172.21.15.45:0/771643618 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c0a89b0 con 0x7f368c06f170 2023-10-03T19:13:25.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.156+0000 7f368a7fc640 1 -- 172.21.15.45:0/771643618 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367c0a8b10 con 0x7f368c06f170 2023-10-03T19:13:25.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.156+0000 7f368a7fc640 1 -- 172.21.15.45:0/771643618 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c0a8ea0 con 0x7f368c06f170 2023-10-03T19:13:25.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.156+0000 7f3691a2e640 1 -- 172.21.15.45:0/771643618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f368c06f170 msgr2=0x7f368c150190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:25.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.156+0000 7f3691a2e640 1 --2- 172.21.15.45:0/771643618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f368c06f170 0x7f368c150190 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f368c06e9c0 tx=0x7f367c01ecf0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.156+0000 7f3691a2e640 1 -- 172.21.15.45:0/771643618 shutdown_connections 2023-10-03T19:13:25.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.156+0000 7f3691a2e640 1 --2- 172.21.15.45:0/771643618 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f368c06d170 0x7f368c14cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.156+0000 7f3691a2e640 1 --2- 172.21.15.45:0/771643618 >> v2:172.21.15.79:3300/0 conn(0x7f368c0bc8b0 0x7f368c14ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.156+0000 7f3691a2e640 1 --2- 172.21.15.45:0/771643618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f368c06f170 0x7f368c150190 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.156+0000 7f3691a2e640 1 -- 172.21.15.45:0/771643618 >> 172.21.15.45:0/771643618 conn(0x7f368c0bcf50 msgr2=0x7f368c0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:25.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.156+0000 7f3691a2e640 1 -- 172.21.15.45:0/771643618 shutdown_connections 2023-10-03T19:13:25.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.156+0000 7f3691a2e640 1 -- 172.21.15.45:0/771643618 wait complete. 2023-10-03T19:13:25.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.160+0000 7f3691a2e640 1 Processor -- start 2023-10-03T19:13:25.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.160+0000 7f3691a2e640 1 -- start start 2023-10-03T19:13:25.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.160+0000 7f3691a2e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f368c06d170 0x7f368c1d9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:25.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.160+0000 7f3691a2e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f368c06f170 0x7f368c0a4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:25.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.160+0000 7f3691a2e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f368c0bc8b0 0x7f368c1488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:25.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.160+0000 7f3691a2e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368c1d6f80 con 0x7f368c06f170 2023-10-03T19:13:25.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.160+0000 7f3691a2e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368c1d7a20 con 0x7f368c06d170 2023-10-03T19:13:25.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.160+0000 7f3691a2e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368c0a45d0 con 0x7f368c0bc8b0 2023-10-03T19:13:25.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.160+0000 7f36827fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f368c06f170 0x7f368c0a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:25.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.160+0000 7f36827fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f368c06f170 0x7f368c0a4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54046/0 (socket says 172.21.15.45:54046) 2023-10-03T19:13:25.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.160+0000 7f36827fc640 1 -- 172.21.15.45:0/1810384163 learned_addr learned my addr 172.21.15.45:0/1810384163 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:25.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.160+0000 7f368affd640 1 --2- 172.21.15.45:0/1810384163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f368c06d170 0x7f368c1d9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:25.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.160+0000 7f368b7fe640 1 --2- 172.21.15.45:0/1810384163 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f368c0bc8b0 0x7f368c1488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:25.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.160+0000 7f36827fc640 1 -- 172.21.15.45:0/1810384163 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f368c0bc8b0 msgr2=0x7f368c1488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:25.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.160+0000 7f36827fc640 1 --2- 172.21.15.45:0/1810384163 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f368c0bc8b0 0x7f368c1488c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.160+0000 7f36827fc640 1 -- 172.21.15.45:0/1810384163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f368c06d170 msgr2=0x7f368c1d9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:25.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.160+0000 7f36827fc640 1 --2- 172.21.15.45:0/1810384163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f368c06d170 0x7f368c1d9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.160+0000 7f36827fc640 1 -- 172.21.15.45:0/1810384163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367c0094d0 con 0x7f368c06f170 2023-10-03T19:13:25.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.160+0000 7f36827fc640 1 --2- 172.21.15.45:0/1810384163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f368c06f170 0x7f368c0a4090 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f367400d800 tx=0x7f367400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:25.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.160+0000 7f3688ff9640 1 -- 172.21.15.45:0/1810384163 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367400b6c0 con 0x7f368c06f170 2023-10-03T19:13:25.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.160+0000 7f3688ff9640 1 -- 172.21.15.45:0/1810384163 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367400b860 con 0x7f368c06f170 2023-10-03T19:13:25.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.160+0000 7f3691a2e640 1 -- 172.21.15.45:0/1810384163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f368c14fae0 con 0x7f368c06f170 2023-10-03T19:13:25.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.160+0000 7f3688ff9640 1 -- 172.21.15.45:0/1810384163 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367400bc10 con 0x7f368c06f170 2023-10-03T19:13:25.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.160+0000 7f3691a2e640 1 -- 172.21.15.45:0/1810384163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f368c06cd00 con 0x7f368c06f170 2023-10-03T19:13:25.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.160+0000 7f3691a2e640 1 -- 172.21.15.45:0/1810384163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f368c14c4a0 con 0x7f368c06f170 2023-10-03T19:13:25.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.160+0000 7f3688ff9640 1 -- 172.21.15.45:0/1810384163 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f367401e460 con 0x7f368c06f170 2023-10-03T19:13:25.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.160+0000 7f3688ff9640 1 --2- 172.21.15.45:0/1810384163 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f366c066280 0x7f366c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:25.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.160+0000 7f3688ff9640 1 -- 172.21.15.45:0/1810384163 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3674084320 con 0x7f368c06f170 2023-10-03T19:13:25.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.160+0000 7f368affd640 1 --2- 172.21.15.45:0/1810384163 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f366c066280 0x7f366c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:25.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.164+0000 7f368affd640 1 --2- 172.21.15.45:0/1810384163 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f366c066280 0x7f366c068730 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f367c0b2000 tx=0x7f367c0aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:25.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.164+0000 7f3688ff9640 1 -- 172.21.15.45:0/1810384163 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3674055230 con 0x7f368c06f170 2023-10-03T19:13:25.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.308+0000 7f3691a2e640 1 -- 172.21.15.45:0/1810384163 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f368c06d660 con 0x7f366c066280 2023-10-03T19:13:25.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.332+0000 7f3688ff9640 1 -- 172.21.15.45:0/1810384163 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+298804 (secure 0 0 0) 0x7f368c06d660 con 0x7f366c066280 2023-10-03T19:13:25.341 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:13:25.343 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:13:25.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.336+0000 7f3691a2e640 1 -- 172.21.15.45:0/1810384163 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f366c066280 msgr2=0x7f366c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:25.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.336+0000 7f3691a2e640 1 --2- 172.21.15.45:0/1810384163 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f366c066280 0x7f366c068730 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f367c0b2000 tx=0x7f367c0aa070 comp rx=0 tx=0).stop 2023-10-03T19:13:25.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.336+0000 7f3691a2e640 1 -- 172.21.15.45:0/1810384163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f368c06f170 msgr2=0x7f368c0a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:25.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.336+0000 7f3691a2e640 1 --2- 172.21.15.45:0/1810384163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f368c06f170 0x7f368c0a4090 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f367400d800 tx=0x7f367400dcc0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.336+0000 7f3691a2e640 1 -- 172.21.15.45:0/1810384163 shutdown_connections 2023-10-03T19:13:25.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.336+0000 7f3691a2e640 1 --2- 172.21.15.45:0/1810384163 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f366c066280 0x7f366c068730 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.336+0000 7f3691a2e640 1 --2- 172.21.15.45:0/1810384163 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f368c0bc8b0 0x7f368c1488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.336+0000 7f3691a2e640 1 --2- 172.21.15.45:0/1810384163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f368c06f170 0x7f368c0a4090 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.336+0000 7f3691a2e640 1 --2- 172.21.15.45:0/1810384163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f368c06d170 0x7f368c1d9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.336+0000 7f3691a2e640 1 -- 172.21.15.45:0/1810384163 >> 172.21.15.45:0/1810384163 conn(0x7f368c0bcf50 msgr2=0x7f368c14d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:25.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.336+0000 7f3691a2e640 1 -- 172.21.15.45:0/1810384163 shutdown_connections 2023-10-03T19:13:25.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.336+0000 7f3691a2e640 1 -- 172.21.15.45:0/1810384163 wait complete. 2023-10-03T19:13:25.358 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2023-10-03T19:13:24.459943+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591132,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":194,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":143,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":79568,"kb_used_data":3088,"kb_used_omap":0,"kb_used_meta":76416,"kb_avail":754895152,"statfs":{"total":773094113280,"available":773012635648,"internally_reserved":0,"allocated":3162112,"data_stored":2414252,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":78249984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":71,"apply_latency_ms":71,"commit_latency_ns":71000000,"apply_latency_ns":71000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":764,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.547947"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-03T19:13:20.946816+0000","last_change":"2023-10-03T19:13:20.946816+0000","last_active":"2023-10-03T19:13:20.908525+0000","last_peered":"2023-10-03T19:13:20.908525+0000","last_clean":"2023-10-03T19:13:20.908525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:13:20.946816+0000","last_undegraded":"2023-10-03T19:13:20.946816+0000","last_fullsized":"2023-10-03T19:13:20.946816+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-03T19:13:20.946605+0000","last_change":"2023-10-03T19:13:20.946605+0000","last_active":"2023-10-03T19:13:20.908525+0000","last_peered":"2023-10-03T19:13:20.908525+0000","last_clean":"2023-10-03T19:13:20.908525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:13:20.946605+0000","last_undegraded":"2023-10-03T19:13:20.946605+0000","last_fullsized":"2023-10-03T19:13:20.946605+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344409+0000","last_change":"2023-10-03T19:13:21.385258+0000","last_active":"2023-10-03T19:13:23.344409+0000","last_peered":"2023-10-03T19:13:23.344409+0000","last_clean":"2023-10-03T19:13:23.344409+0000","last_became_active":"2023-10-03T19:13:21.384907+0000","last_became_peered":"2023-10-03T19:13:21.384907+0000","last_unstale":"2023-10-03T19:13:23.344409+0000","last_undegraded":"2023-10-03T19:13:23.344409+0000","last_fullsized":"2023-10-03T19:13:23.344409+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:00:58.500162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.365163+0000","last_change":"2023-10-03T19:13:21.364377+0000","last_active":"2023-10-03T19:13:21.365163+0000","last_peered":"2023-10-03T19:13:21.365163+0000","last_clean":"2023-10-03T19:13:21.365163+0000","last_became_active":"2023-10-03T19:13:21.364029+0000","last_became_peered":"2023-10-03T19:13:21.364029+0000","last_unstale":"2023-10-03T19:13:21.365163+0000","last_undegraded":"2023-10-03T19:13:21.365163+0000","last_fullsized":"2023-10-03T19:13:21.365163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:28:09.213667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.364572+0000","last_change":"2023-10-03T19:13:21.363282+0000","last_active":"2023-10-03T19:13:21.364572+0000","last_peered":"2023-10-03T19:13:21.364572+0000","last_clean":"2023-10-03T19:13:21.364572+0000","last_became_active":"2023-10-03T19:13:21.362984+0000","last_became_peered":"2023-10-03T19:13:21.362984+0000","last_unstale":"2023-10-03T19:13:21.364572+0000","last_undegraded":"2023-10-03T19:13:21.364572+0000","last_fullsized":"2023-10-03T19:13:21.364572+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:19:43.624473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.339533+0000","last_change":"2023-10-03T19:13:21.336852+0000","last_active":"2023-10-03T19:13:21.339533+0000","last_peered":"2023-10-03T19:13:21.339533+0000","last_clean":"2023-10-03T19:13:21.339533+0000","last_became_active":"2023-10-03T19:13:21.336505+0000","last_became_peered":"2023-10-03T19:13:21.336505+0000","last_unstale":"2023-10-03T19:13:21.339533+0000","last_undegraded":"2023-10-03T19:13:21.339533+0000","last_fullsized":"2023-10-03T19:13:21.339533+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:39:44.903301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.331242+0000","last_change":"2023-10-03T19:13:21.386226+0000","last_active":"2023-10-03T19:13:22.331242+0000","last_peered":"2023-10-03T19:13:22.331242+0000","last_clean":"2023-10-03T19:13:22.331242+0000","last_became_active":"2023-10-03T19:13:21.381498+0000","last_became_peered":"2023-10-03T19:13:21.381498+0000","last_unstale":"2023-10-03T19:13:22.331242+0000","last_undegraded":"2023-10-03T19:13:22.331242+0000","last_fullsized":"2023-10-03T19:13:22.331242+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:05:10.879452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-03T19:13:20.946219+0000","last_change":"2023-10-03T19:13:20.946219+0000","last_active":"2023-10-03T19:13:20.908525+0000","last_peered":"2023-10-03T19:13:20.908525+0000","last_clean":"2023-10-03T19:13:20.908525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:13:20.946219+0000","last_undegraded":"2023-10-03T19:13:20.946219+0000","last_fullsized":"2023-10-03T19:13:20.946219+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344660+0000","last_change":"2023-10-03T19:13:21.379630+0000","last_active":"2023-10-03T19:13:23.344660+0000","last_peered":"2023-10-03T19:13:23.344660+0000","last_clean":"2023-10-03T19:13:23.344660+0000","last_became_active":"2023-10-03T19:13:21.379337+0000","last_became_peered":"2023-10-03T19:13:21.379337+0000","last_unstale":"2023-10-03T19:13:23.344660+0000","last_undegraded":"2023-10-03T19:13:23.344660+0000","last_fullsized":"2023-10-03T19:13:23.344660+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:05:21.993046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.333045+0000","last_change":"2023-10-03T19:13:21.387777+0000","last_active":"2023-10-03T19:13:22.333045+0000","last_peered":"2023-10-03T19:13:22.333045+0000","last_clean":"2023-10-03T19:13:22.333045+0000","last_became_active":"2023-10-03T19:13:21.387128+0000","last_became_peered":"2023-10-03T19:13:21.387128+0000","last_unstale":"2023-10-03T19:13:22.333045+0000","last_undegraded":"2023-10-03T19:13:22.333045+0000","last_fullsized":"2023-10-03T19:13:22.333045+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:33:35.559553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332600+0000","last_change":"2023-10-03T19:13:21.381901+0000","last_active":"2023-10-03T19:13:22.332600+0000","last_peered":"2023-10-03T19:13:22.332600+0000","last_clean":"2023-10-03T19:13:22.332600+0000","last_became_active":"2023-10-03T19:13:21.380706+0000","last_became_peered":"2023-10-03T19:13:21.380706+0000","last_unstale":"2023-10-03T19:13:22.332600+0000","last_undegraded":"2023-10-03T19:13:22.332600+0000","last_fullsized":"2023-10-03T19:13:22.332600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:12:39.485705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344538+0000","last_change":"2023-10-03T19:13:21.337436+0000","last_active":"2023-10-03T19:13:23.344538+0000","last_peered":"2023-10-03T19:13:23.344538+0000","last_clean":"2023-10-03T19:13:23.344538+0000","last_became_active":"2023-10-03T19:13:21.337123+0000","last_became_peered":"2023-10-03T19:13:21.337123+0000","last_unstale":"2023-10-03T19:13:23.344538+0000","last_undegraded":"2023-10-03T19:13:23.344538+0000","last_fullsized":"2023-10-03T19:13:23.344538+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:16:02.368990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332506+0000","last_change":"2023-10-03T19:13:21.387101+0000","last_active":"2023-10-03T19:13:22.332506+0000","last_peered":"2023-10-03T19:13:22.332506+0000","last_clean":"2023-10-03T19:13:22.332506+0000","last_became_active":"2023-10-03T19:13:21.386571+0000","last_became_peered":"2023-10-03T19:13:21.386571+0000","last_unstale":"2023-10-03T19:13:22.332506+0000","last_undegraded":"2023-10-03T19:13:22.332506+0000","last_fullsized":"2023-10-03T19:13:22.332506+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:48:36.421606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.382081+0000","last_change":"2023-10-03T19:13:21.365622+0000","last_active":"2023-10-03T19:13:21.382081+0000","last_peered":"2023-10-03T19:13:21.382081+0000","last_clean":"2023-10-03T19:13:21.382081+0000","last_became_active":"2023-10-03T19:13:21.364997+0000","last_became_peered":"2023-10-03T19:13:21.364997+0000","last_unstale":"2023-10-03T19:13:21.382081+0000","last_undegraded":"2023-10-03T19:13:21.382081+0000","last_fullsized":"2023-10-03T19:13:21.382081+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:50:20.193476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.331431+0000","last_change":"2023-10-03T19:13:21.382122+0000","last_active":"2023-10-03T19:13:22.331431+0000","last_peered":"2023-10-03T19:13:22.331431+0000","last_clean":"2023-10-03T19:13:22.331431+0000","last_became_active":"2023-10-03T19:13:21.380853+0000","last_became_peered":"2023-10-03T19:13:21.380853+0000","last_unstale":"2023-10-03T19:13:22.331431+0000","last_undegraded":"2023-10-03T19:13:22.331431+0000","last_fullsized":"2023-10-03T19:13:22.331431+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:12:09.744127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388977+0000","last_change":"2023-10-03T19:13:21.382147+0000","last_active":"2023-10-03T19:13:21.388977+0000","last_peered":"2023-10-03T19:13:21.388977+0000","last_clean":"2023-10-03T19:13:21.388977+0000","last_became_active":"2023-10-03T19:13:21.381614+0000","last_became_peered":"2023-10-03T19:13:21.381614+0000","last_unstale":"2023-10-03T19:13:21.388977+0000","last_undegraded":"2023-10-03T19:13:21.388977+0000","last_fullsized":"2023-10-03T19:13:21.388977+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:03:08.567828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.393291+0000","last_change":"2023-10-03T19:13:21.391132+0000","last_active":"2023-10-03T19:13:21.393291+0000","last_peered":"2023-10-03T19:13:21.393291+0000","last_clean":"2023-10-03T19:13:21.393291+0000","last_became_active":"2023-10-03T19:13:21.390626+0000","last_became_peered":"2023-10-03T19:13:21.390626+0000","last_unstale":"2023-10-03T19:13:21.393291+0000","last_undegraded":"2023-10-03T19:13:21.393291+0000","last_fullsized":"2023-10-03T19:13:21.393291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:52:31.490114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.376272+0000","last_change":"2023-10-03T19:13:21.369754+0000","last_active":"2023-10-03T19:13:21.376272+0000","last_peered":"2023-10-03T19:13:21.376272+0000","last_clean":"2023-10-03T19:13:21.376272+0000","last_became_active":"2023-10-03T19:13:21.368680+0000","last_became_peered":"2023-10-03T19:13:21.368680+0000","last_unstale":"2023-10-03T19:13:21.376272+0000","last_undegraded":"2023-10-03T19:13:21.376272+0000","last_fullsized":"2023-10-03T19:13:21.376272+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:38:54.659714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.338097+0000","last_change":"2023-10-03T19:13:21.332782+0000","last_active":"2023-10-03T19:13:21.338097+0000","last_peered":"2023-10-03T19:13:21.338097+0000","last_clean":"2023-10-03T19:13:21.338097+0000","last_became_active":"2023-10-03T19:13:21.332537+0000","last_became_peered":"2023-10-03T19:13:21.332537+0000","last_unstale":"2023-10-03T19:13:21.338097+0000","last_undegraded":"2023-10-03T19:13:21.338097+0000","last_fullsized":"2023-10-03T19:13:21.338097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:39:33.232842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.369427+0000","last_change":"2023-10-03T19:13:21.366160+0000","last_active":"2023-10-03T19:13:21.369427+0000","last_peered":"2023-10-03T19:13:21.369427+0000","last_clean":"2023-10-03T19:13:21.369427+0000","last_became_active":"2023-10-03T19:13:21.365568+0000","last_became_peered":"2023-10-03T19:13:21.365568+0000","last_unstale":"2023-10-03T19:13:21.369427+0000","last_undegraded":"2023-10-03T19:13:21.369427+0000","last_fullsized":"2023-10-03T19:13:21.369427+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:48:02.179860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332079+0000","last_change":"2023-10-03T19:13:21.380192+0000","last_active":"2023-10-03T19:13:22.332079+0000","last_peered":"2023-10-03T19:13:22.332079+0000","last_clean":"2023-10-03T19:13:22.332079+0000","last_became_active":"2023-10-03T19:13:21.379452+0000","last_became_peered":"2023-10-03T19:13:21.379452+0000","last_unstale":"2023-10-03T19:13:22.332079+0000","last_undegraded":"2023-10-03T19:13:22.332079+0000","last_fullsized":"2023-10-03T19:13:22.332079+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:10:18.652000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.382002+0000","last_change":"2023-10-03T19:13:21.362845+0000","last_active":"2023-10-03T19:13:21.382002+0000","last_peered":"2023-10-03T19:13:21.382002+0000","last_clean":"2023-10-03T19:13:21.382002+0000","last_became_active":"2023-10-03T19:13:21.361610+0000","last_became_peered":"2023-10-03T19:13:21.361610+0000","last_unstale":"2023-10-03T19:13:21.382002+0000","last_undegraded":"2023-10-03T19:13:21.382002+0000","last_fullsized":"2023-10-03T19:13:21.382002+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:19:45.728456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388429+0000","last_change":"2023-10-03T19:13:21.371753+0000","last_active":"2023-10-03T19:13:21.388429+0000","last_peered":"2023-10-03T19:13:21.388429+0000","last_clean":"2023-10-03T19:13:21.388429+0000","last_became_active":"2023-10-03T19:13:21.370040+0000","last_became_peered":"2023-10-03T19:13:21.370040+0000","last_unstale":"2023-10-03T19:13:21.388429+0000","last_undegraded":"2023-10-03T19:13:21.388429+0000","last_fullsized":"2023-10-03T19:13:21.388429+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:21:52.323037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.370133+0000","last_change":"2023-10-03T19:13:21.368517+0000","last_active":"2023-10-03T19:13:21.370133+0000","last_peered":"2023-10-03T19:13:21.370133+0000","last_clean":"2023-10-03T19:13:21.370133+0000","last_became_active":"2023-10-03T19:13:21.368223+0000","last_became_peered":"2023-10-03T19:13:21.368223+0000","last_unstale":"2023-10-03T19:13:21.370133+0000","last_undegraded":"2023-10-03T19:13:21.370133+0000","last_fullsized":"2023-10-03T19:13:21.370133+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:44:21.225478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.361781+0000","last_change":"2023-10-03T19:13:21.340602+0000","last_active":"2023-10-03T19:13:21.361781+0000","last_peered":"2023-10-03T19:13:21.361781+0000","last_clean":"2023-10-03T19:13:21.361781+0000","last_became_active":"2023-10-03T19:13:21.338940+0000","last_became_peered":"2023-10-03T19:13:21.338940+0000","last_unstale":"2023-10-03T19:13:21.361781+0000","last_undegraded":"2023-10-03T19:13:21.361781+0000","last_fullsized":"2023-10-03T19:13:21.361781+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:18:54.472816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.372433+0000","last_change":"2023-10-03T19:13:21.371393+0000","last_active":"2023-10-03T19:13:21.372433+0000","last_peered":"2023-10-03T19:13:21.372433+0000","last_clean":"2023-10-03T19:13:21.372433+0000","last_became_active":"2023-10-03T19:13:21.371075+0000","last_became_peered":"2023-10-03T19:13:21.371075+0000","last_unstale":"2023-10-03T19:13:21.372433+0000","last_undegraded":"2023-10-03T19:13:21.372433+0000","last_fullsized":"2023-10-03T19:13:21.372433+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:09:25.508263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.362808+0000","last_change":"2023-10-03T19:13:21.341738+0000","last_active":"2023-10-03T19:13:21.362808+0000","last_peered":"2023-10-03T19:13:21.362808+0000","last_clean":"2023-10-03T19:13:21.362808+0000","last_became_active":"2023-10-03T19:13:21.340877+0000","last_became_peered":"2023-10-03T19:13:21.340877+0000","last_unstale":"2023-10-03T19:13:21.362808+0000","last_undegraded":"2023-10-03T19:13:21.362808+0000","last_fullsized":"2023-10-03T19:13:21.362808+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:50:45.720443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332435+0000","last_change":"2023-10-03T19:13:21.363972+0000","last_active":"2023-10-03T19:13:22.332435+0000","last_peered":"2023-10-03T19:13:22.332435+0000","last_clean":"2023-10-03T19:13:22.332435+0000","last_became_active":"2023-10-03T19:13:21.363452+0000","last_became_peered":"2023-10-03T19:13:21.363452+0000","last_unstale":"2023-10-03T19:13:22.332435+0000","last_undegraded":"2023-10-03T19:13:22.332435+0000","last_fullsized":"2023-10-03T19:13:22.332435+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:56:31.353897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.353062+0000","last_change":"2023-10-03T19:13:21.334239+0000","last_active":"2023-10-03T19:13:21.353062+0000","last_peered":"2023-10-03T19:13:21.353062+0000","last_clean":"2023-10-03T19:13:21.353062+0000","last_became_active":"2023-10-03T19:13:21.333456+0000","last_became_peered":"2023-10-03T19:13:21.333456+0000","last_unstale":"2023-10-03T19:13:21.353062+0000","last_undegraded":"2023-10-03T19:13:21.353062+0000","last_fullsized":"2023-10-03T19:13:21.353062+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:54:32.970270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.361714+0000","last_change":"2023-10-03T19:13:21.339712+0000","last_active":"2023-10-03T19:13:21.361714+0000","last_peered":"2023-10-03T19:13:21.361714+0000","last_clean":"2023-10-03T19:13:21.361714+0000","last_became_active":"2023-10-03T19:13:21.338930+0000","last_became_peered":"2023-10-03T19:13:21.338930+0000","last_unstale":"2023-10-03T19:13:21.361714+0000","last_undegraded":"2023-10-03T19:13:21.361714+0000","last_fullsized":"2023-10-03T19:13:21.361714+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:52:54.145637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388471+0000","last_change":"2023-10-03T19:13:21.372961+0000","last_active":"2023-10-03T19:13:21.388471+0000","last_peered":"2023-10-03T19:13:21.388471+0000","last_clean":"2023-10-03T19:13:21.388471+0000","last_became_active":"2023-10-03T19:13:21.372269+0000","last_became_peered":"2023-10-03T19:13:21.372269+0000","last_unstale":"2023-10-03T19:13:21.388471+0000","last_undegraded":"2023-10-03T19:13:21.388471+0000","last_fullsized":"2023-10-03T19:13:21.388471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:42:26.752455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.339370+0000","last_change":"2023-10-03T19:13:21.337355+0000","last_active":"2023-10-03T19:13:21.339370+0000","last_peered":"2023-10-03T19:13:21.339370+0000","last_clean":"2023-10-03T19:13:21.339370+0000","last_became_active":"2023-10-03T19:13:21.337084+0000","last_became_peered":"2023-10-03T19:13:21.337084+0000","last_unstale":"2023-10-03T19:13:21.339370+0000","last_undegraded":"2023-10-03T19:13:21.339370+0000","last_fullsized":"2023-10-03T19:13:21.339370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:23:59.311834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.394182+0000","last_change":"2023-10-03T19:13:21.391912+0000","last_active":"2023-10-03T19:13:21.394182+0000","last_peered":"2023-10-03T19:13:21.394182+0000","last_clean":"2023-10-03T19:13:21.394182+0000","last_became_active":"2023-10-03T19:13:21.390545+0000","last_became_peered":"2023-10-03T19:13:21.390545+0000","last_unstale":"2023-10-03T19:13:21.394182+0000","last_undegraded":"2023-10-03T19:13:21.394182+0000","last_fullsized":"2023-10-03T19:13:21.394182+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:38:14.290892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"34'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.377742+0000","last_change":"2023-10-03T19:13:20.969426+0000","last_active":"2023-10-03T19:13:21.377742+0000","last_peered":"2023-10-03T19:13:21.377742+0000","last_clean":"2023-10-03T19:13:21.377742+0000","last_became_active":"2023-10-03T19:13:20.968732+0000","last_became_peered":"2023-10-03T19:13:20.968732+0000","last_unstale":"2023-10-03T19:13:21.377742+0000","last_undegraded":"2023-10-03T19:13:21.377742+0000","last_fullsized":"2023-10-03T19:13:21.377742+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:54:05.602230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.386027+0000","last_change":"2023-10-03T19:13:21.385217+0000","last_active":"2023-10-03T19:13:21.386027+0000","last_peered":"2023-10-03T19:13:21.386027+0000","last_clean":"2023-10-03T19:13:21.386027+0000","last_became_active":"2023-10-03T19:13:21.384926+0000","last_became_peered":"2023-10-03T19:13:21.384926+0000","last_unstale":"2023-10-03T19:13:21.386027+0000","last_undegraded":"2023-10-03T19:13:21.386027+0000","last_fullsized":"2023-10-03T19:13:21.386027+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:43:13.606613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344952+0000","last_change":"2023-10-03T19:13:20.972150+0000","last_active":"2023-10-03T19:13:23.344952+0000","last_peered":"2023-10-03T19:13:23.344952+0000","last_clean":"2023-10-03T19:13:23.344952+0000","last_became_active":"2023-10-03T19:13:20.971821+0000","last_became_peered":"2023-10-03T19:13:20.971821+0000","last_unstale":"2023-10-03T19:13:23.344952+0000","last_undegraded":"2023-10-03T19:13:23.344952+0000","last_fullsized":"2023-10-03T19:13:23.344952+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:46:55.064511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.382104+0000","last_change":"2023-10-03T19:13:21.365006+0000","last_active":"2023-10-03T19:13:21.382104+0000","last_peered":"2023-10-03T19:13:21.382104+0000","last_clean":"2023-10-03T19:13:21.382104+0000","last_became_active":"2023-10-03T19:13:21.364499+0000","last_became_peered":"2023-10-03T19:13:21.364499+0000","last_unstale":"2023-10-03T19:13:21.382104+0000","last_undegraded":"2023-10-03T19:13:21.382104+0000","last_fullsized":"2023-10-03T19:13:21.382104+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:45:17.978390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.359478+0000","last_change":"2023-10-03T19:13:20.950958+0000","last_active":"2023-10-03T19:13:21.359478+0000","last_peered":"2023-10-03T19:13:21.359478+0000","last_clean":"2023-10-03T19:13:21.359478+0000","last_became_active":"2023-10-03T19:13:20.950561+0000","last_became_peered":"2023-10-03T19:13:20.950561+0000","last_unstale":"2023-10-03T19:13:21.359478+0000","last_undegraded":"2023-10-03T19:13:21.359478+0000","last_fullsized":"2023-10-03T19:13:21.359478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:55:54.835749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-03T19:13:20.946012+0000","last_change":"2023-10-03T19:13:20.946012+0000","last_active":"2023-10-03T19:13:20.908525+0000","last_peered":"2023-10-03T19:13:20.908525+0000","last_clean":"2023-10-03T19:13:20.908525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:13:20.946012+0000","last_undegraded":"2023-10-03T19:13:20.946012+0000","last_fullsized":"2023-10-03T19:13:20.946012+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.376007+0000","last_change":"2023-10-03T19:13:20.953487+0000","last_active":"2023-10-03T19:13:21.376007+0000","last_peered":"2023-10-03T19:13:21.376007+0000","last_clean":"2023-10-03T19:13:21.376007+0000","last_became_active":"2023-10-03T19:13:20.952739+0000","last_became_peered":"2023-10-03T19:13:20.952739+0000","last_unstale":"2023-10-03T19:13:21.376007+0000","last_undegraded":"2023-10-03T19:13:21.376007+0000","last_fullsized":"2023-10-03T19:13:21.376007+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:41:26.248555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344143+0000","last_change":"2023-10-03T19:13:21.335933+0000","last_active":"2023-10-03T19:13:23.344143+0000","last_peered":"2023-10-03T19:13:23.344143+0000","last_clean":"2023-10-03T19:13:23.344143+0000","last_became_active":"2023-10-03T19:13:21.335661+0000","last_became_peered":"2023-10-03T19:13:21.335661+0000","last_unstale":"2023-10-03T19:13:23.344143+0000","last_undegraded":"2023-10-03T19:13:23.344143+0000","last_fullsized":"2023-10-03T19:13:23.344143+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:14:24.053747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332061+0000","last_change":"2023-10-03T19:13:20.957478+0000","last_active":"2023-10-03T19:13:22.332061+0000","last_peered":"2023-10-03T19:13:22.332061+0000","last_clean":"2023-10-03T19:13:22.332061+0000","last_became_active":"2023-10-03T19:13:20.956389+0000","last_became_peered":"2023-10-03T19:13:20.956389+0000","last_unstale":"2023-10-03T19:13:22.332061+0000","last_undegraded":"2023-10-03T19:13:22.332061+0000","last_fullsized":"2023-10-03T19:13:22.332061+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:17:04.660877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.331680+0000","last_change":"2023-10-03T19:13:21.380338+0000","last_active":"2023-10-03T19:13:22.331680+0000","last_peered":"2023-10-03T19:13:22.331680+0000","last_clean":"2023-10-03T19:13:22.331680+0000","last_became_active":"2023-10-03T19:13:21.379660+0000","last_became_peered":"2023-10-03T19:13:21.379660+0000","last_unstale":"2023-10-03T19:13:22.331680+0000","last_undegraded":"2023-10-03T19:13:22.331680+0000","last_fullsized":"2023-10-03T19:13:22.331680+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:11:08.676258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.374578+0000","last_change":"2023-10-03T19:13:20.974925+0000","last_active":"2023-10-03T19:13:21.374578+0000","last_peered":"2023-10-03T19:13:21.374578+0000","last_clean":"2023-10-03T19:13:21.374578+0000","last_became_active":"2023-10-03T19:13:20.974368+0000","last_became_peered":"2023-10-03T19:13:20.974368+0000","last_unstale":"2023-10-03T19:13:21.374578+0000","last_undegraded":"2023-10-03T19:13:21.374578+0000","last_fullsized":"2023-10-03T19:13:21.374578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:31:41.223618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.383953+0000","last_change":"2023-10-03T19:13:21.379900+0000","last_active":"2023-10-03T19:13:21.383953+0000","last_peered":"2023-10-03T19:13:21.383953+0000","last_clean":"2023-10-03T19:13:21.383953+0000","last_became_active":"2023-10-03T19:13:21.379296+0000","last_became_peered":"2023-10-03T19:13:21.379296+0000","last_unstale":"2023-10-03T19:13:21.383953+0000","last_undegraded":"2023-10-03T19:13:21.383953+0000","last_fullsized":"2023-10-03T19:13:21.383953+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:57:55.230179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.326794+0000","last_change":"2023-10-03T19:13:20.963235+0000","last_active":"2023-10-03T19:13:21.326794+0000","last_peered":"2023-10-03T19:13:21.326794+0000","last_clean":"2023-10-03T19:13:21.326794+0000","last_became_active":"2023-10-03T19:13:20.962810+0000","last_became_peered":"2023-10-03T19:13:20.962810+0000","last_unstale":"2023-10-03T19:13:21.326794+0000","last_undegraded":"2023-10-03T19:13:21.326794+0000","last_fullsized":"2023-10-03T19:13:21.326794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:00:49.525990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-03T19:13:20.948617+0000","last_change":"2023-10-03T19:13:20.948617+0000","last_active":"2023-10-03T19:13:20.908525+0000","last_peered":"2023-10-03T19:13:20.908525+0000","last_clean":"2023-10-03T19:13:20.908525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:13:20.948617+0000","last_undegraded":"2023-10-03T19:13:20.948617+0000","last_fullsized":"2023-10-03T19:13:20.948617+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.348006+0000","last_change":"2023-10-03T19:13:20.970078+0000","last_active":"2023-10-03T19:13:21.348006+0000","last_peered":"2023-10-03T19:13:21.348006+0000","last_clean":"2023-10-03T19:13:21.348006+0000","last_became_active":"2023-10-03T19:13:20.969404+0000","last_became_peered":"2023-10-03T19:13:20.969404+0000","last_unstale":"2023-10-03T19:13:21.348006+0000","last_undegraded":"2023-10-03T19:13:21.348006+0000","last_fullsized":"2023-10-03T19:13:21.348006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:06:40.574599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.365149+0000","last_change":"2023-10-03T19:13:21.364013+0000","last_active":"2023-10-03T19:13:21.365149+0000","last_peered":"2023-10-03T19:13:21.365149+0000","last_clean":"2023-10-03T19:13:21.365149+0000","last_became_active":"2023-10-03T19:13:21.363513+0000","last_became_peered":"2023-10-03T19:13:21.363513+0000","last_unstale":"2023-10-03T19:13:21.365149+0000","last_undegraded":"2023-10-03T19:13:21.365149+0000","last_fullsized":"2023-10-03T19:13:21.365149+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:37:09.701876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-03T19:13:20.967365+0000","last_change":"2023-10-03T19:13:20.952503+0000","last_active":"2023-10-03T19:13:20.967365+0000","last_peered":"2023-10-03T19:13:20.967365+0000","last_clean":"2023-10-03T19:13:20.967365+0000","last_became_active":"2023-10-03T19:13:20.951828+0000","last_became_peered":"2023-10-03T19:13:20.951828+0000","last_unstale":"2023-10-03T19:13:20.967365+0000","last_undegraded":"2023-10-03T19:13:20.967365+0000","last_fullsized":"2023-10-03T19:13:20.967365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:43:12.595096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388642+0000","last_change":"2023-10-03T19:13:21.376107+0000","last_active":"2023-10-03T19:13:21.388642+0000","last_peered":"2023-10-03T19:13:21.388642+0000","last_clean":"2023-10-03T19:13:21.388642+0000","last_became_active":"2023-10-03T19:13:21.373484+0000","last_became_peered":"2023-10-03T19:13:21.373484+0000","last_unstale":"2023-10-03T19:13:21.388642+0000","last_undegraded":"2023-10-03T19:13:21.388642+0000","last_fullsized":"2023-10-03T19:13:21.388642+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:10:43.840486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.333208+0000","last_change":"2023-10-03T19:13:20.960847+0000","last_active":"2023-10-03T19:13:22.333208+0000","last_peered":"2023-10-03T19:13:22.333208+0000","last_clean":"2023-10-03T19:13:22.333208+0000","last_became_active":"2023-10-03T19:13:20.960078+0000","last_became_peered":"2023-10-03T19:13:20.960078+0000","last_unstale":"2023-10-03T19:13:22.333208+0000","last_undegraded":"2023-10-03T19:13:22.333208+0000","last_fullsized":"2023-10-03T19:13:22.333208+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:14:11.662112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344788+0000","last_change":"2023-10-03T19:13:21.370395+0000","last_active":"2023-10-03T19:13:23.344788+0000","last_peered":"2023-10-03T19:13:23.344788+0000","last_clean":"2023-10-03T19:13:23.344788+0000","last_became_active":"2023-10-03T19:13:21.370113+0000","last_became_peered":"2023-10-03T19:13:21.370113+0000","last_unstale":"2023-10-03T19:13:23.344788+0000","last_undegraded":"2023-10-03T19:13:23.344788+0000","last_fullsized":"2023-10-03T19:13:23.344788+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:47:43.653717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"34'3","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332813+0000","last_change":"2023-10-03T19:13:20.961265+0000","last_active":"2023-10-03T19:13:22.332813+0000","last_peered":"2023-10-03T19:13:22.332813+0000","last_clean":"2023-10-03T19:13:22.332813+0000","last_became_active":"2023-10-03T19:13:20.959393+0000","last_became_peered":"2023-10-03T19:13:20.959393+0000","last_unstale":"2023-10-03T19:13:22.332813+0000","last_undegraded":"2023-10-03T19:13:22.332813+0000","last_fullsized":"2023-10-03T19:13:22.332813+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:40:36.494610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.382201+0000","last_change":"2023-10-03T19:13:21.362691+0000","last_active":"2023-10-03T19:13:21.382201+0000","last_peered":"2023-10-03T19:13:21.382201+0000","last_clean":"2023-10-03T19:13:21.382201+0000","last_became_active":"2023-10-03T19:13:21.361488+0000","last_became_peered":"2023-10-03T19:13:21.361488+0000","last_unstale":"2023-10-03T19:13:21.382201+0000","last_undegraded":"2023-10-03T19:13:21.382201+0000","last_fullsized":"2023-10-03T19:13:21.382201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:53:21.733701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-03T19:13:20.974287+0000","last_change":"2023-10-03T19:13:20.972865+0000","last_active":"2023-10-03T19:13:20.974287+0000","last_peered":"2023-10-03T19:13:20.974287+0000","last_clean":"2023-10-03T19:13:20.974287+0000","last_became_active":"2023-10-03T19:13:20.972358+0000","last_became_peered":"2023-10-03T19:13:20.972358+0000","last_unstale":"2023-10-03T19:13:20.974287+0000","last_undegraded":"2023-10-03T19:13:20.974287+0000","last_fullsized":"2023-10-03T19:13:20.974287+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:43:54.362050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344127+0000","last_change":"2023-10-03T19:13:21.361649+0000","last_active":"2023-10-03T19:13:23.344127+0000","last_peered":"2023-10-03T19:13:23.344127+0000","last_clean":"2023-10-03T19:13:23.344127+0000","last_became_active":"2023-10-03T19:13:21.361411+0000","last_became_peered":"2023-10-03T19:13:21.361411+0000","last_unstale":"2023-10-03T19:13:23.344127+0000","last_undegraded":"2023-10-03T19:13:23.344127+0000","last_fullsized":"2023-10-03T19:13:23.344127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:57:14.066081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-03T19:13:20.967555+0000","last_change":"2023-10-03T19:13:20.964862+0000","last_active":"2023-10-03T19:13:20.967555+0000","last_peered":"2023-10-03T19:13:20.967555+0000","last_clean":"2023-10-03T19:13:20.967555+0000","last_became_active":"2023-10-03T19:13:20.964523+0000","last_became_peered":"2023-10-03T19:13:20.964523+0000","last_unstale":"2023-10-03T19:13:20.967555+0000","last_undegraded":"2023-10-03T19:13:20.967555+0000","last_fullsized":"2023-10-03T19:13:20.967555+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:25:57.148818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-03T19:13:20.943585+0000","last_change":"2023-10-03T19:13:20.943585+0000","last_active":"2023-10-03T19:13:20.908525+0000","last_peered":"2023-10-03T19:13:20.908525+0000","last_clean":"2023-10-03T19:13:20.908525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:13:20.943585+0000","last_undegraded":"2023-10-03T19:13:20.943585+0000","last_fullsized":"2023-10-03T19:13:20.943585+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.326593+0000","last_change":"2023-10-03T19:13:20.962572+0000","last_active":"2023-10-03T19:13:21.326593+0000","last_peered":"2023-10-03T19:13:21.326593+0000","last_clean":"2023-10-03T19:13:21.326593+0000","last_became_active":"2023-10-03T19:13:20.962094+0000","last_became_peered":"2023-10-03T19:13:20.962094+0000","last_unstale":"2023-10-03T19:13:21.326593+0000","last_undegraded":"2023-10-03T19:13:21.326593+0000","last_fullsized":"2023-10-03T19:13:21.326593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:43:54.362050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388247+0000","last_change":"2023-10-03T19:13:21.371030+0000","last_active":"2023-10-03T19:13:21.388247+0000","last_peered":"2023-10-03T19:13:21.388247+0000","last_clean":"2023-10-03T19:13:21.388247+0000","last_became_active":"2023-10-03T19:13:21.369954+0000","last_became_peered":"2023-10-03T19:13:21.369954+0000","last_unstale":"2023-10-03T19:13:21.388247+0000","last_undegraded":"2023-10-03T19:13:21.388247+0000","last_fullsized":"2023-10-03T19:13:21.388247+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:19:02.156799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.328519+0000","last_change":"2023-10-03T19:13:20.967774+0000","last_active":"2023-10-03T19:13:21.328519+0000","last_peered":"2023-10-03T19:13:21.328519+0000","last_clean":"2023-10-03T19:13:21.328519+0000","last_became_active":"2023-10-03T19:13:20.965529+0000","last_became_peered":"2023-10-03T19:13:20.965529+0000","last_unstale":"2023-10-03T19:13:21.328519+0000","last_undegraded":"2023-10-03T19:13:21.328519+0000","last_fullsized":"2023-10-03T19:13:21.328519+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:17:30.367274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-03T19:13:20.947840+0000","last_change":"2023-10-03T19:13:20.947840+0000","last_active":"2023-10-03T19:13:20.908525+0000","last_peered":"2023-10-03T19:13:20.908525+0000","last_clean":"2023-10-03T19:13:20.908525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:13:20.947840+0000","last_undegraded":"2023-10-03T19:13:20.947840+0000","last_fullsized":"2023-10-03T19:13:20.947840+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"34'8","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.382682+0000","last_change":"2023-10-03T19:13:20.975023+0000","last_active":"2023-10-03T19:13:21.382682+0000","last_peered":"2023-10-03T19:13:21.382682+0000","last_clean":"2023-10-03T19:13:21.382682+0000","last_became_active":"2023-10-03T19:13:20.973808+0000","last_became_peered":"2023-10-03T19:13:20.973808+0000","last_unstale":"2023-10-03T19:13:21.382682+0000","last_undegraded":"2023-10-03T19:13:21.382682+0000","last_fullsized":"2023-10-03T19:13:21.382682+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:39:54.101849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-03T19:13:20.942312+0000","last_change":"2023-10-03T19:13:20.942312+0000","last_active":"2023-10-03T19:13:20.908525+0000","last_peered":"2023-10-03T19:13:20.908525+0000","last_clean":"2023-10-03T19:13:20.908525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:13:20.942312+0000","last_undegraded":"2023-10-03T19:13:20.942312+0000","last_fullsized":"2023-10-03T19:13:20.942312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.333263+0000","last_change":"2023-10-03T19:13:20.957758+0000","last_active":"2023-10-03T19:13:22.333263+0000","last_peered":"2023-10-03T19:13:22.333263+0000","last_clean":"2023-10-03T19:13:22.333263+0000","last_became_active":"2023-10-03T19:13:20.957023+0000","last_became_peered":"2023-10-03T19:13:20.957023+0000","last_unstale":"2023-10-03T19:13:22.333263+0000","last_undegraded":"2023-10-03T19:13:22.333263+0000","last_fullsized":"2023-10-03T19:13:22.333263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:36:11.572563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332770+0000","last_change":"2023-10-03T19:13:21.386225+0000","last_active":"2023-10-03T19:13:22.332770+0000","last_peered":"2023-10-03T19:13:22.332770+0000","last_clean":"2023-10-03T19:13:22.332770+0000","last_became_active":"2023-10-03T19:13:21.381348+0000","last_became_peered":"2023-10-03T19:13:21.381348+0000","last_unstale":"2023-10-03T19:13:22.332770+0000","last_undegraded":"2023-10-03T19:13:22.332770+0000","last_fullsized":"2023-10-03T19:13:22.332770+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:59:12.814362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.391164+0000","last_change":"2023-10-03T19:13:20.965203+0000","last_active":"2023-10-03T19:13:21.391164+0000","last_peered":"2023-10-03T19:13:21.391164+0000","last_clean":"2023-10-03T19:13:21.391164+0000","last_became_active":"2023-10-03T19:13:20.963356+0000","last_became_peered":"2023-10-03T19:13:20.963356+0000","last_unstale":"2023-10-03T19:13:21.391164+0000","last_undegraded":"2023-10-03T19:13:21.391164+0000","last_fullsized":"2023-10-03T19:13:21.391164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:41:28.447361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.382600+0000","last_change":"2023-10-03T19:13:21.368113+0000","last_active":"2023-10-03T19:13:21.382600+0000","last_peered":"2023-10-03T19:13:21.382600+0000","last_clean":"2023-10-03T19:13:21.382600+0000","last_became_active":"2023-10-03T19:13:21.367345+0000","last_became_peered":"2023-10-03T19:13:21.367345+0000","last_unstale":"2023-10-03T19:13:21.382600+0000","last_undegraded":"2023-10-03T19:13:21.382600+0000","last_fullsized":"2023-10-03T19:13:21.382600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:26:10.484739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.374764+0000","last_change":"2023-10-03T19:13:20.972574+0000","last_active":"2023-10-03T19:13:21.374764+0000","last_peered":"2023-10-03T19:13:21.374764+0000","last_clean":"2023-10-03T19:13:21.374764+0000","last_became_active":"2023-10-03T19:13:20.972119+0000","last_became_peered":"2023-10-03T19:13:20.972119+0000","last_unstale":"2023-10-03T19:13:21.374764+0000","last_undegraded":"2023-10-03T19:13:21.374764+0000","last_fullsized":"2023-10-03T19:13:21.374764+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:14:08.106459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.341400+0000","last_change":"2023-10-03T19:13:21.339682+0000","last_active":"2023-10-03T19:13:21.341400+0000","last_peered":"2023-10-03T19:13:21.341400+0000","last_clean":"2023-10-03T19:13:21.341400+0000","last_became_active":"2023-10-03T19:13:21.339291+0000","last_became_peered":"2023-10-03T19:13:21.339291+0000","last_unstale":"2023-10-03T19:13:21.341400+0000","last_undegraded":"2023-10-03T19:13:21.341400+0000","last_fullsized":"2023-10-03T19:13:21.341400+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:11:12.253825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.327634+0000","last_change":"2023-10-03T19:13:20.951006+0000","last_active":"2023-10-03T19:13:21.327634+0000","last_peered":"2023-10-03T19:13:21.327634+0000","last_clean":"2023-10-03T19:13:21.327634+0000","last_became_active":"2023-10-03T19:13:20.950606+0000","last_became_peered":"2023-10-03T19:13:20.950606+0000","last_unstale":"2023-10-03T19:13:21.327634+0000","last_undegraded":"2023-10-03T19:13:21.327634+0000","last_fullsized":"2023-10-03T19:13:21.327634+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:03:32.890413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388419+0000","last_change":"2023-10-03T19:13:21.372118+0000","last_active":"2023-10-03T19:13:21.388419+0000","last_peered":"2023-10-03T19:13:21.388419+0000","last_clean":"2023-10-03T19:13:21.388419+0000","last_became_active":"2023-10-03T19:13:21.370009+0000","last_became_peered":"2023-10-03T19:13:21.370009+0000","last_unstale":"2023-10-03T19:13:21.388419+0000","last_undegraded":"2023-10-03T19:13:21.388419+0000","last_fullsized":"2023-10-03T19:13:21.388419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:53:06.561881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.337198+0000","last_change":"2023-10-03T19:13:20.954261+0000","last_active":"2023-10-03T19:13:21.337198+0000","last_peered":"2023-10-03T19:13:21.337198+0000","last_clean":"2023-10-03T19:13:21.337198+0000","last_became_active":"2023-10-03T19:13:20.953905+0000","last_became_peered":"2023-10-03T19:13:20.953905+0000","last_unstale":"2023-10-03T19:13:21.337198+0000","last_undegraded":"2023-10-03T19:13:21.337198+0000","last_fullsized":"2023-10-03T19:13:21.337198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:19:04.380130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344213+0000","last_change":"2023-10-03T19:13:21.372131+0000","last_active":"2023-10-03T19:13:23.344213+0000","last_peered":"2023-10-03T19:13:23.344213+0000","last_clean":"2023-10-03T19:13:23.344213+0000","last_became_active":"2023-10-03T19:13:21.371809+0000","last_became_peered":"2023-10-03T19:13:21.371809+0000","last_unstale":"2023-10-03T19:13:23.344213+0000","last_undegraded":"2023-10-03T19:13:23.344213+0000","last_fullsized":"2023-10-03T19:13:23.344213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:57:40.440963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.320058+0000","last_change":"2023-10-03T19:13:20.960919+0000","last_active":"2023-10-03T19:13:21.320058+0000","last_peered":"2023-10-03T19:13:21.320058+0000","last_clean":"2023-10-03T19:13:21.320058+0000","last_became_active":"2023-10-03T19:13:20.960593+0000","last_became_peered":"2023-10-03T19:13:20.960593+0000","last_unstale":"2023-10-03T19:13:21.320058+0000","last_undegraded":"2023-10-03T19:13:21.320058+0000","last_fullsized":"2023-10-03T19:13:21.320058+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:56:05.170459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332228+0000","last_change":"2023-10-03T19:13:21.365073+0000","last_active":"2023-10-03T19:13:22.332228+0000","last_peered":"2023-10-03T19:13:22.332228+0000","last_clean":"2023-10-03T19:13:22.332228+0000","last_became_active":"2023-10-03T19:13:21.364541+0000","last_became_peered":"2023-10-03T19:13:21.364541+0000","last_unstale":"2023-10-03T19:13:22.332228+0000","last_undegraded":"2023-10-03T19:13:22.332228+0000","last_fullsized":"2023-10-03T19:13:22.332228+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:00:58.829969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.326883+0000","last_change":"2023-10-03T19:13:20.977060+0000","last_active":"2023-10-03T19:13:21.326883+0000","last_peered":"2023-10-03T19:13:21.326883+0000","last_clean":"2023-10-03T19:13:21.326883+0000","last_became_active":"2023-10-03T19:13:20.976504+0000","last_became_peered":"2023-10-03T19:13:20.976504+0000","last_unstale":"2023-10-03T19:13:21.326883+0000","last_undegraded":"2023-10-03T19:13:21.326883+0000","last_fullsized":"2023-10-03T19:13:21.326883+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:48:48.027499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-03T19:13:20.946084+0000","last_change":"2023-10-03T19:13:20.946084+0000","last_active":"2023-10-03T19:13:20.908525+0000","last_peered":"2023-10-03T19:13:20.908525+0000","last_clean":"2023-10-03T19:13:20.908525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:13:20.946084+0000","last_undegraded":"2023-10-03T19:13:20.946084+0000","last_fullsized":"2023-10-03T19:13:20.946084+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.320048+0000","last_change":"2023-10-03T19:13:20.958773+0000","last_active":"2023-10-03T19:13:21.320048+0000","last_peered":"2023-10-03T19:13:21.320048+0000","last_clean":"2023-10-03T19:13:21.320048+0000","last_became_active":"2023-10-03T19:13:20.958365+0000","last_became_peered":"2023-10-03T19:13:20.958365+0000","last_unstale":"2023-10-03T19:13:21.320048+0000","last_undegraded":"2023-10-03T19:13:21.320048+0000","last_fullsized":"2023-10-03T19:13:21.320048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:28:03.119661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332884+0000","last_change":"2023-10-03T19:13:21.392175+0000","last_active":"2023-10-03T19:13:22.332884+0000","last_peered":"2023-10-03T19:13:22.332884+0000","last_clean":"2023-10-03T19:13:22.332884+0000","last_became_active":"2023-10-03T19:13:21.389898+0000","last_became_peered":"2023-10-03T19:13:21.389898+0000","last_unstale":"2023-10-03T19:13:22.332884+0000","last_undegraded":"2023-10-03T19:13:22.332884+0000","last_fullsized":"2023-10-03T19:13:22.332884+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:26:48.120113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.338248+0000","last_change":"2023-10-03T19:13:20.974327+0000","last_active":"2023-10-03T19:13:21.338248+0000","last_peered":"2023-10-03T19:13:21.338248+0000","last_clean":"2023-10-03T19:13:21.338248+0000","last_became_active":"2023-10-03T19:13:20.973755+0000","last_became_peered":"2023-10-03T19:13:20.973755+0000","last_unstale":"2023-10-03T19:13:21.338248+0000","last_undegraded":"2023-10-03T19:13:21.338248+0000","last_fullsized":"2023-10-03T19:13:21.338248+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:53:20.722184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":191,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.326398+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:13:21.326398+0000","last_peered":"2023-10-03T19:13:21.326398+0000","last_clean":"2023-10-03T19:13:21.326398+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:13:21.326398+0000","last_undegraded":"2023-10-03T19:13:21.326398+0000","last_fullsized":"2023-10-03T19:13:21.326398+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:13:03.709387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332331+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:13:22.332331+0000","last_peered":"2023-10-03T19:13:22.332331+0000","last_clean":"2023-10-03T19:13:22.332331+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:13:22.332331+0000","last_undegraded":"2023-10-03T19:13:22.332331+0000","last_fullsized":"2023-10-03T19:13:22.332331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:23:55.753435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.378172+0000","last_change":"2023-10-03T19:13:21.377405+0000","last_active":"2023-10-03T19:13:21.378172+0000","last_peered":"2023-10-03T19:13:21.378172+0000","last_clean":"2023-10-03T19:13:21.378172+0000","last_became_active":"2023-10-03T19:13:21.377187+0000","last_became_peered":"2023-10-03T19:13:21.377187+0000","last_unstale":"2023-10-03T19:13:21.378172+0000","last_undegraded":"2023-10-03T19:13:21.378172+0000","last_fullsized":"2023-10-03T19:13:21.378172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:04:27.975140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.333408+0000","last_change":"2023-10-03T19:13:20.958706+0000","last_active":"2023-10-03T19:13:22.333408+0000","last_peered":"2023-10-03T19:13:22.333408+0000","last_clean":"2023-10-03T19:13:22.333408+0000","last_became_active":"2023-10-03T19:13:20.956435+0000","last_became_peered":"2023-10-03T19:13:20.956435+0000","last_unstale":"2023-10-03T19:13:22.333408+0000","last_undegraded":"2023-10-03T19:13:22.333408+0000","last_fullsized":"2023-10-03T19:13:22.333408+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:04:53.519874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.325293+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:13:21.325293+0000","last_peered":"2023-10-03T19:13:21.325293+0000","last_clean":"2023-10-03T19:13:21.325293+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:13:21.325293+0000","last_undegraded":"2023-10-03T19:13:21.325293+0000","last_fullsized":"2023-10-03T19:13:21.325293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:07:00.971532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388558+0000","last_change":"2023-10-03T19:13:21.374113+0000","last_active":"2023-10-03T19:13:21.388558+0000","last_peered":"2023-10-03T19:13:21.388558+0000","last_clean":"2023-10-03T19:13:21.388558+0000","last_became_active":"2023-10-03T19:13:21.370727+0000","last_became_peered":"2023-10-03T19:13:21.370727+0000","last_unstale":"2023-10-03T19:13:21.388558+0000","last_undegraded":"2023-10-03T19:13:21.388558+0000","last_fullsized":"2023-10-03T19:13:21.388558+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:15:55.983735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.325186+0000","last_change":"2023-10-03T19:13:20.961506+0000","last_active":"2023-10-03T19:13:21.325186+0000","last_peered":"2023-10-03T19:13:21.325186+0000","last_clean":"2023-10-03T19:13:21.325186+0000","last_became_active":"2023-10-03T19:13:20.961101+0000","last_became_peered":"2023-10-03T19:13:20.961101+0000","last_unstale":"2023-10-03T19:13:21.325186+0000","last_undegraded":"2023-10-03T19:13:21.325186+0000","last_fullsized":"2023-10-03T19:13:21.325186+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:08:18.162950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.319655+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:13:21.319655+0000","last_peered":"2023-10-03T19:13:21.319655+0000","last_clean":"2023-10-03T19:13:21.319655+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:13:21.319655+0000","last_undegraded":"2023-10-03T19:13:21.319655+0000","last_fullsized":"2023-10-03T19:13:21.319655+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:04:05.555255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-03T19:13:20.945349+0000","last_change":"2023-10-03T19:13:20.945349+0000","last_active":"2023-10-03T19:13:20.908525+0000","last_peered":"2023-10-03T19:13:20.908525+0000","last_clean":"2023-10-03T19:13:20.908525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:13:20.945349+0000","last_undegraded":"2023-10-03T19:13:20.945349+0000","last_fullsized":"2023-10-03T19:13:20.945349+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344207+0000","last_change":"2023-10-03T19:13:20.951648+0000","last_active":"2023-10-03T19:13:23.344207+0000","last_peered":"2023-10-03T19:13:23.344207+0000","last_clean":"2023-10-03T19:13:23.344207+0000","last_became_active":"2023-10-03T19:13:20.950901+0000","last_became_peered":"2023-10-03T19:13:20.950901+0000","last_unstale":"2023-10-03T19:13:23.344207+0000","last_undegraded":"2023-10-03T19:13:23.344207+0000","last_fullsized":"2023-10-03T19:13:23.344207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:27:55.601869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332066+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:13:22.332066+0000","last_peered":"2023-10-03T19:13:22.332066+0000","last_clean":"2023-10-03T19:13:22.332066+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:13:22.332066+0000","last_undegraded":"2023-10-03T19:13:22.332066+0000","last_fullsized":"2023-10-03T19:13:22.332066+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:11:13.218075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344474+0000","last_change":"2023-10-03T19:13:21.339724+0000","last_active":"2023-10-03T19:13:23.344474+0000","last_peered":"2023-10-03T19:13:23.344474+0000","last_clean":"2023-10-03T19:13:23.344474+0000","last_became_active":"2023-10-03T19:13:21.339332+0000","last_became_peered":"2023-10-03T19:13:21.339332+0000","last_unstale":"2023-10-03T19:13:23.344474+0000","last_undegraded":"2023-10-03T19:13:23.344474+0000","last_fullsized":"2023-10-03T19:13:23.344474+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:01:06.037410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344737+0000","last_change":"2023-10-03T19:13:20.970059+0000","last_active":"2023-10-03T19:13:23.344737+0000","last_peered":"2023-10-03T19:13:23.344737+0000","last_clean":"2023-10-03T19:13:23.344737+0000","last_became_active":"2023-10-03T19:13:20.969451+0000","last_became_peered":"2023-10-03T19:13:20.969451+0000","last_unstale":"2023-10-03T19:13:23.344737+0000","last_undegraded":"2023-10-03T19:13:23.344737+0000","last_fullsized":"2023-10-03T19:13:23.344737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:27:28.531397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.327570+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:13:21.327570+0000","last_peered":"2023-10-03T19:13:21.327570+0000","last_clean":"2023-10-03T19:13:21.327570+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:13:21.327570+0000","last_undegraded":"2023-10-03T19:13:21.327570+0000","last_fullsized":"2023-10-03T19:13:21.327570+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:18:44.840190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.340055+0000","last_change":"2023-10-03T19:13:21.339247+0000","last_active":"2023-10-03T19:13:21.340055+0000","last_peered":"2023-10-03T19:13:21.340055+0000","last_clean":"2023-10-03T19:13:21.340055+0000","last_became_active":"2023-10-03T19:13:21.338947+0000","last_became_peered":"2023-10-03T19:13:21.338947+0000","last_unstale":"2023-10-03T19:13:21.340055+0000","last_undegraded":"2023-10-03T19:13:21.340055+0000","last_fullsized":"2023-10-03T19:13:21.340055+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:25:58.160334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.328948+0000","last_change":"2023-10-03T19:13:20.964605+0000","last_active":"2023-10-03T19:13:21.328948+0000","last_peered":"2023-10-03T19:13:21.328948+0000","last_clean":"2023-10-03T19:13:21.328948+0000","last_became_active":"2023-10-03T19:13:20.963993+0000","last_became_peered":"2023-10-03T19:13:20.963993+0000","last_unstale":"2023-10-03T19:13:21.328948+0000","last_undegraded":"2023-10-03T19:13:21.328948+0000","last_fullsized":"2023-10-03T19:13:21.328948+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:48:12.274201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.331038+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:13:21.331038+0000","last_peered":"2023-10-03T19:13:21.331038+0000","last_clean":"2023-10-03T19:13:21.331038+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:13:21.331038+0000","last_undegraded":"2023-10-03T19:13:21.331038+0000","last_fullsized":"2023-10-03T19:13:21.331038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:32:43.995165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.382046+0000","last_change":"2023-10-03T19:13:21.363349+0000","last_active":"2023-10-03T19:13:21.382046+0000","last_peered":"2023-10-03T19:13:21.382046+0000","last_clean":"2023-10-03T19:13:21.382046+0000","last_became_active":"2023-10-03T19:13:21.362328+0000","last_became_peered":"2023-10-03T19:13:21.362328+0000","last_unstale":"2023-10-03T19:13:21.382046+0000","last_undegraded":"2023-10-03T19:13:21.382046+0000","last_fullsized":"2023-10-03T19:13:21.382046+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:56:03.182827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.347635+0000","last_change":"2023-10-03T19:13:20.954919+0000","last_active":"2023-10-03T19:13:21.347635+0000","last_peered":"2023-10-03T19:13:21.347635+0000","last_clean":"2023-10-03T19:13:21.347635+0000","last_became_active":"2023-10-03T19:13:20.954183+0000","last_became_peered":"2023-10-03T19:13:20.954183+0000","last_unstale":"2023-10-03T19:13:21.347635+0000","last_undegraded":"2023-10-03T19:13:21.347635+0000","last_fullsized":"2023-10-03T19:13:21.347635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:45:23.847643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.327829+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:13:21.327829+0000","last_peered":"2023-10-03T19:13:21.327829+0000","last_clean":"2023-10-03T19:13:21.327829+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:13:21.327829+0000","last_undegraded":"2023-10-03T19:13:21.327829+0000","last_fullsized":"2023-10-03T19:13:21.327829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:38:27.108483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388363+0000","last_change":"2023-10-03T19:13:21.371931+0000","last_active":"2023-10-03T19:13:21.388363+0000","last_peered":"2023-10-03T19:13:21.388363+0000","last_clean":"2023-10-03T19:13:21.388363+0000","last_became_active":"2023-10-03T19:13:21.370833+0000","last_became_peered":"2023-10-03T19:13:21.370833+0000","last_unstale":"2023-10-03T19:13:21.388363+0000","last_undegraded":"2023-10-03T19:13:21.388363+0000","last_fullsized":"2023-10-03T19:13:21.388363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:32:53.308272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-03T19:13:20.967314+0000","last_change":"2023-10-03T19:13:20.952123+0000","last_active":"2023-10-03T19:13:20.967314+0000","last_peered":"2023-10-03T19:13:20.967314+0000","last_clean":"2023-10-03T19:13:20.967314+0000","last_became_active":"2023-10-03T19:13:20.951627+0000","last_became_peered":"2023-10-03T19:13:20.951627+0000","last_unstale":"2023-10-03T19:13:20.967314+0000","last_undegraded":"2023-10-03T19:13:20.967314+0000","last_fullsized":"2023-10-03T19:13:20.967314+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:39:43.891784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.330387+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:13:21.330387+0000","last_peered":"2023-10-03T19:13:21.330387+0000","last_clean":"2023-10-03T19:13:21.330387+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:13:21.330387+0000","last_undegraded":"2023-10-03T19:13:21.330387+0000","last_fullsized":"2023-10-03T19:13:21.330387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:32:54.906695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":764,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9416,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362424,"statfs":{"total":96636764160,"available":96627122176,"internally_reserved":0,"allocated":458752,"data_stored":747260,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]}]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8696,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363144,"statfs":{"total":96636764160,"available":96627859456,"internally_reserved":0,"allocated":376832,"data_stored":154676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":0.90300000000000002}]},{"osd":1,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.93700000000000006}]},{"osd":2,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.63300000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":0.67000000000000004}]},{"osd":4,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":1.054},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.997}]},{"osd":5,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.2570000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.1319999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.095},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.0289999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8812,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94363028,"statfs":{"total":96636764160,"available":96627740672,"internally_reserved":0,"allocated":364544,"data_stored":148130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":1.071}]},{"osd":1,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.9750000000000001,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.58499999999999996}]},{"osd":2,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.8809999999999998,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":1.153}]},{"osd":3,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":3.0369999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":1.121}]},{"osd":5,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.948},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":1.2909999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":3.0840000000000001,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.8919999999999999,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":2.0760000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.327},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":3.1230000000000002,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":1.1930000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12856,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":12480,"kb_avail":94358984,"statfs":{"total":96636764160,"available":96623599616,"internally_reserved":0,"allocated":376832,"data_stored":154164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12779520},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.68700000000000006}]},{"osd":1,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.497},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.56999999999999995}]},{"osd":3,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.82399999999999995}]},{"osd":4,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":1.0660000000000001}]},{"osd":5,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.92500000000000004}]},{"osd":6,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.034}]},{"osd":7,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":1.016}]}]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8828,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94363012,"statfs":{"total":96636764160,"available":96627724288,"internally_reserved":0,"allocated":380928,"data_stored":155348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542159,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8672,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363168,"statfs":{"total":96636764160,"available":96627884032,"internally_reserved":0,"allocated":352256,"data_stored":141502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8844,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362996,"statfs":{"total":96636764160,"available":96627707904,"internally_reserved":0,"allocated":397312,"data_stored":162023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:13:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.83199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":3,"last update":"Tue Oct 3 19:13:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.60099999999999998},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.73199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13444,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":12992,"kb_avail":94358396,"statfs":{"total":96636764160,"available":96622997504,"internally_reserved":0,"allocated":454656,"data_stored":751149,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":13303808},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":1.218}]},{"osd":2,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.94699999999999995}]},{"osd":3,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.75900000000000001}]},{"osd":4,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.347}]},{"osd":5,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.3009999999999999},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.84999999999999998}]},{"osd":6,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.034},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.056}]},{"osd":7,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.1499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:13:25.365 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:13:25.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.512+0000 7f83e3767640 1 Processor -- start 2023-10-03T19:13:25.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83e3767640 1 -- start start 2023-10-03T19:13:25.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83e3767640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f83dc14ba80 0x7f83dc0be850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:25.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83e3767640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f83dc156ea0 0x7f83dc159280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:25.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83e3767640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83dc06e660 con 0x7f83dc0bd000 2023-10-03T19:13:25.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83e3767640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83dc0a4c20 con 0x7f83dc14ba80 2023-10-03T19:13:25.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83e3767640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc0a4f70 con 0x7f83dc156ea0 2023-10-03T19:13:25.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83e0d02640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f83dc0bd000 0x7f83dc0bf090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35814/0 (socket says 172.21.15.45:35814) 2023-10-03T19:13:25.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83e0d02640 1 -- 172.21.15.45:0/2344848997 learned_addr learned my addr 172.21.15.45:0/2344848997 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:25.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83e1d04640 1 --2- 172.21.15.45:0/2344848997 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f83dc156ea0 0x7f83dc159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:25.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83e1503640 1 --2- 172.21.15.45:0/2344848997 >> v2:172.21.15.79:3300/0 conn(0x7f83dc14ba80 0x7f83dc0be850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:25.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83cffff640 1 -- 172.21.15.45:0/2344848997 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3292542527 0 0) 0x7f83dc06e660 con 0x7f83dc0bd000 2023-10-03T19:13:25.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83cffff640 1 -- 172.21.15.45:0/2344848997 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83c8003530 con 0x7f83dc0bd000 2023-10-03T19:13:25.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83cffff640 1 -- 172.21.15.45:0/2344848997 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2127787663 0 0) 0x7f83c8003530 con 0x7f83dc0bd000 2023-10-03T19:13:25.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83cffff640 1 -- 172.21.15.45:0/2344848997 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f83dc156ea0 msgr2=0x7f83dc159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:25.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83cffff640 1 --2- 172.21.15.45:0/2344848997 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f83dc156ea0 0x7f83dc159280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83cffff640 1 -- 172.21.15.45:0/2344848997 >> v2:172.21.15.79:3300/0 conn(0x7f83dc14ba80 msgr2=0x7f83dc0be850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:25.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83cffff640 1 --2- 172.21.15.45:0/2344848997 >> v2:172.21.15.79:3300/0 conn(0x7f83dc14ba80 0x7f83dc0be850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83cffff640 1 -- 172.21.15.45:0/2344848997 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83dc06ec10 con 0x7f83dc0bd000 2023-10-03T19:13:25.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83cffff640 1 -- 172.21.15.45:0/2344848997 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f83d8001680 con 0x7f83dc0bd000 2023-10-03T19:13:25.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83cffff640 1 -- 172.21.15.45:0/2344848997 >> v1:172.21.15.45:6789/0 conn(0x7f83dc0bd000 legacy=0x7f83dc0bf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:25.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83cffff640 1 --2- 172.21.15.45:0/2344848997 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f83dc156ea0 0x7f83c8003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:25.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83cffff640 1 --2- 172.21.15.45:0/2344848997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c8003f00 0x7f83c80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:25.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83cffff640 1 --2- 172.21.15.45:0/2344848997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83c8004d10 0x7f83c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:25.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83cffff640 1 -- 172.21.15.45:0/2344848997 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc0a4c20 con 0x7f83c8004d10 2023-10-03T19:13:25.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83cffff640 1 -- 172.21.15.45:0/2344848997 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc0a4f70 con 0x7f83c8003f00 2023-10-03T19:13:25.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83cffff640 1 -- 172.21.15.45:0/2344848997 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c800b990 con 0x7f83dc156ea0 2023-10-03T19:13:25.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83e1d04640 1 --2- 172.21.15.45:0/2344848997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83c8004d10 0x7f83c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:25.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83e1503640 1 --2- 172.21.15.45:0/2344848997 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f83dc156ea0 0x7f83c8003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:25.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83e0d02640 1 --2- 172.21.15.45:0/2344848997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c8003f00 0x7f83c80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:25.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83e1d04640 1 -- 172.21.15.45:0/2344848997 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f83dc156ea0 msgr2=0x7f83c8003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:25.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83e1d04640 1 --2- 172.21.15.45:0/2344848997 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f83dc156ea0 0x7f83c8003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83e1d04640 1 -- 172.21.15.45:0/2344848997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c8003f00 msgr2=0x7f83c80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:25.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83e1d04640 1 --2- 172.21.15.45:0/2344848997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c8003f00 0x7f83c80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.516+0000 7f83e1d04640 1 -- 172.21.15.45:0/2344848997 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c8003530 con 0x7f83c8004d10 2023-10-03T19:13:25.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.520+0000 7f83e1d04640 1 --2- 172.21.15.45:0/2344848997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83c8004d10 0x7f83c8005180 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f83dc0bfb70 tx=0x7f83d401cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4e5a973102266b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:25.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.520+0000 7f83cffff640 1 -- 172.21.15.45:0/2344848997 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d40a5cb0 con 0x7f83c8004d10 2023-10-03T19:13:25.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.520+0000 7f83cffff640 1 -- 172.21.15.45:0/2344848997 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d400f040 con 0x7f83c8004d10 2023-10-03T19:13:25.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.520+0000 7f83cffff640 1 -- 172.21.15.45:0/2344848997 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d40ad660 con 0x7f83c8004d10 2023-10-03T19:13:25.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.520+0000 7f83e3767640 1 -- 172.21.15.45:0/2344848997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83c8004d10 msgr2=0x7f83c8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:25.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.520+0000 7f83e3767640 1 --2- 172.21.15.45:0/2344848997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83c8004d10 0x7f83c8005180 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f83dc0bfb70 tx=0x7f83d401cbe0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.520+0000 7f83e1d04640 1 -- 172.21.15.45:0/2344848997 reap_dead start 2023-10-03T19:13:25.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.520+0000 7f83e3767640 1 -- 172.21.15.45:0/2344848997 shutdown_connections 2023-10-03T19:13:25.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.520+0000 7f83e3767640 1 -- 172.21.15.45:0/2344848997 >> 172.21.15.45:0/2344848997 conn(0x7f83dc06d990 msgr2=0x7f83dc06bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:25.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.520+0000 7f83e3767640 1 -- 172.21.15.45:0/2344848997 shutdown_connections 2023-10-03T19:13:25.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.520+0000 7f83e3767640 1 -- 172.21.15.45:0/2344848997 wait complete. 2023-10-03T19:13:25.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.520+0000 7f83e3767640 1 Processor -- start 2023-10-03T19:13:25.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.520+0000 7f83e3767640 1 -- start start 2023-10-03T19:13:25.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.520+0000 7f83e3767640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c8004d10 0x7f83dc1e6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:25.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.520+0000 7f83e3767640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83dc151b10 0x7f83dc14f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:25.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.520+0000 7f83e3767640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f83dc14fb00 0x7f83dc144c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:25.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.520+0000 7f83e3767640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc1e7200 con 0x7f83dc151b10 2023-10-03T19:13:25.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.520+0000 7f83e3767640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc14e4a0 con 0x7f83c8004d10 2023-10-03T19:13:25.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.520+0000 7f83e3767640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc14e780 con 0x7f83dc14fb00 2023-10-03T19:13:25.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.520+0000 7f83e0d02640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83dc151b10 0x7f83dc14f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:25.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.520+0000 7f83e0d02640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83dc151b10 0x7f83dc14f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54052/0 (socket says 172.21.15.45:54052) 2023-10-03T19:13:25.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.520+0000 7f83e0d02640 1 -- 172.21.15.45:0/1690499883 learned_addr learned my addr 172.21.15.45:0/1690499883 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:25.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.520+0000 7f83e1d04640 1 --2- 172.21.15.45:0/1690499883 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f83dc14fb00 0x7f83dc144c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:25.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.520+0000 7f83e1503640 1 --2- 172.21.15.45:0/1690499883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c8004d10 0x7f83dc1e6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:25.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.520+0000 7f83e0d02640 1 -- 172.21.15.45:0/1690499883 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f83dc14fb00 msgr2=0x7f83dc144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:25.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.520+0000 7f83e0d02640 1 --2- 172.21.15.45:0/1690499883 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f83dc14fb00 0x7f83dc144c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.520+0000 7f83e0d02640 1 -- 172.21.15.45:0/1690499883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c8004d10 msgr2=0x7f83dc1e6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:25.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.520+0000 7f83e0d02640 1 --2- 172.21.15.45:0/1690499883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c8004d10 0x7f83dc1e6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.520+0000 7f83e0d02640 1 -- 172.21.15.45:0/1690499883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83dc0bf7a0 con 0x7f83dc151b10 2023-10-03T19:13:25.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.520+0000 7f83e1503640 1 --2- 172.21.15.45:0/1690499883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c8004d10 0x7f83dc1e6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:13:25.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.524+0000 7f83e0d02640 1 --2- 172.21.15.45:0/1690499883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83dc151b10 0x7f83dc14f5c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f83d800e850 tx=0x7f83d800ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:25.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.524+0000 7f83cdffb640 1 -- 172.21.15.45:0/1690499883 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d800c8d0 con 0x7f83dc151b10 2023-10-03T19:13:25.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.524+0000 7f83cdffb640 1 -- 172.21.15.45:0/1690499883 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d800ca30 con 0x7f83dc151b10 2023-10-03T19:13:25.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.524+0000 7f83cdffb640 1 -- 172.21.15.45:0/1690499883 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d800cde0 con 0x7f83dc151b10 2023-10-03T19:13:25.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.524+0000 7f83e3767640 1 -- 172.21.15.45:0/1690499883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83dc14be50 con 0x7f83dc151b10 2023-10-03T19:13:25.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.524+0000 7f83e3767640 1 -- 172.21.15.45:0/1690499883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83dc0bed90 con 0x7f83dc151b10 2023-10-03T19:13:25.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.524+0000 7f83e3767640 1 -- 172.21.15.45:0/1690499883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83dc14e970 con 0x7f83dc151b10 2023-10-03T19:13:25.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.524+0000 7f83cdffb640 1 -- 172.21.15.45:0/1690499883 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f83d801d460 con 0x7f83dc151b10 2023-10-03T19:13:25.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.524+0000 7f83cdffb640 1 --2- 172.21.15.45:0/1690499883 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f83c0066280 0x7f83c0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:25.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.524+0000 7f83cdffb640 1 -- 172.21.15.45:0/1690499883 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f83d8083c80 con 0x7f83dc151b10 2023-10-03T19:13:25.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.524+0000 7f83e1503640 1 --2- 172.21.15.45:0/1690499883 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f83c0066280 0x7f83c0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:25.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.524+0000 7f83e1503640 1 --2- 172.21.15.45:0/1690499883 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f83c0066280 0x7f83c0068730 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f83d0009b70 tx=0x7f83d0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:25.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.528+0000 7f83cdffb640 1 -- 172.21.15.45:0/1690499883 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f83d8051100 con 0x7f83dc151b10 2023-10-03T19:13:25.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.680+0000 7f83e3767640 1 -- 172.21.15.45:0/1690499883 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f83dc14e610 con 0x7f83c0066280 2023-10-03T19:13:25.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.700+0000 7f83cdffb640 1 -- 172.21.15.45:0/1690499883 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+298804 (secure 0 0 0) 0x7f83dc14e610 con 0x7f83c0066280 2023-10-03T19:13:25.708 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:13:25.711 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:13:25.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.704+0000 7f83e3767640 1 -- 172.21.15.45:0/1690499883 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f83c0066280 msgr2=0x7f83c0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:25.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.704+0000 7f83e3767640 1 --2- 172.21.15.45:0/1690499883 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f83c0066280 0x7f83c0068730 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f83d0009b70 tx=0x7f83d0008040 comp rx=0 tx=0).stop 2023-10-03T19:13:25.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.704+0000 7f83e3767640 1 -- 172.21.15.45:0/1690499883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83dc151b10 msgr2=0x7f83dc14f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:25.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.704+0000 7f83e3767640 1 --2- 172.21.15.45:0/1690499883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83dc151b10 0x7f83dc14f5c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f83d800e850 tx=0x7f83d800ed10 comp rx=0 tx=0).stop 2023-10-03T19:13:25.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.704+0000 7f83e3767640 1 -- 172.21.15.45:0/1690499883 shutdown_connections 2023-10-03T19:13:25.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.704+0000 7f83e3767640 1 --2- 172.21.15.45:0/1690499883 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f83c0066280 0x7f83c0068730 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.704+0000 7f83e3767640 1 --2- 172.21.15.45:0/1690499883 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f83dc14fb00 0x7f83dc144c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.704+0000 7f83e3767640 1 --2- 172.21.15.45:0/1690499883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83dc151b10 0x7f83dc14f5c0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.704+0000 7f83e3767640 1 --2- 172.21.15.45:0/1690499883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c8004d10 0x7f83dc1e6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.704+0000 7f83e3767640 1 -- 172.21.15.45:0/1690499883 >> 172.21.15.45:0/1690499883 conn(0x7f83dc06d990 msgr2=0x7f83dc06bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:25.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.704+0000 7f83e3767640 1 -- 172.21.15.45:0/1690499883 shutdown_connections 2023-10-03T19:13:25.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.704+0000 7f83e3767640 1 -- 172.21.15.45:0/1690499883 wait complete. 2023-10-03T19:13:25.728 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2023-10-03T19:13:24.459943+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591132,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":194,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":143,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":79568,"kb_used_data":3088,"kb_used_omap":0,"kb_used_meta":76416,"kb_avail":754895152,"statfs":{"total":773094113280,"available":773012635648,"internally_reserved":0,"allocated":3162112,"data_stored":2414252,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":78249984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":71,"apply_latency_ms":71,"commit_latency_ns":71000000,"apply_latency_ns":71000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":764,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.547947"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-03T19:13:20.946816+0000","last_change":"2023-10-03T19:13:20.946816+0000","last_active":"2023-10-03T19:13:20.908525+0000","last_peered":"2023-10-03T19:13:20.908525+0000","last_clean":"2023-10-03T19:13:20.908525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:13:20.946816+0000","last_undegraded":"2023-10-03T19:13:20.946816+0000","last_fullsized":"2023-10-03T19:13:20.946816+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-03T19:13:20.946605+0000","last_change":"2023-10-03T19:13:20.946605+0000","last_active":"2023-10-03T19:13:20.908525+0000","last_peered":"2023-10-03T19:13:20.908525+0000","last_clean":"2023-10-03T19:13:20.908525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:13:20.946605+0000","last_undegraded":"2023-10-03T19:13:20.946605+0000","last_fullsized":"2023-10-03T19:13:20.946605+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344409+0000","last_change":"2023-10-03T19:13:21.385258+0000","last_active":"2023-10-03T19:13:23.344409+0000","last_peered":"2023-10-03T19:13:23.344409+0000","last_clean":"2023-10-03T19:13:23.344409+0000","last_became_active":"2023-10-03T19:13:21.384907+0000","last_became_peered":"2023-10-03T19:13:21.384907+0000","last_unstale":"2023-10-03T19:13:23.344409+0000","last_undegraded":"2023-10-03T19:13:23.344409+0000","last_fullsized":"2023-10-03T19:13:23.344409+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:00:58.500162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.365163+0000","last_change":"2023-10-03T19:13:21.364377+0000","last_active":"2023-10-03T19:13:21.365163+0000","last_peered":"2023-10-03T19:13:21.365163+0000","last_clean":"2023-10-03T19:13:21.365163+0000","last_became_active":"2023-10-03T19:13:21.364029+0000","last_became_peered":"2023-10-03T19:13:21.364029+0000","last_unstale":"2023-10-03T19:13:21.365163+0000","last_undegraded":"2023-10-03T19:13:21.365163+0000","last_fullsized":"2023-10-03T19:13:21.365163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:28:09.213667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.364572+0000","last_change":"2023-10-03T19:13:21.363282+0000","last_active":"2023-10-03T19:13:21.364572+0000","last_peered":"2023-10-03T19:13:21.364572+0000","last_clean":"2023-10-03T19:13:21.364572+0000","last_became_active":"2023-10-03T19:13:21.362984+0000","last_became_peered":"2023-10-03T19:13:21.362984+0000","last_unstale":"2023-10-03T19:13:21.364572+0000","last_undegraded":"2023-10-03T19:13:21.364572+0000","last_fullsized":"2023-10-03T19:13:21.364572+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:19:43.624473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.339533+0000","last_change":"2023-10-03T19:13:21.336852+0000","last_active":"2023-10-03T19:13:21.339533+0000","last_peered":"2023-10-03T19:13:21.339533+0000","last_clean":"2023-10-03T19:13:21.339533+0000","last_became_active":"2023-10-03T19:13:21.336505+0000","last_became_peered":"2023-10-03T19:13:21.336505+0000","last_unstale":"2023-10-03T19:13:21.339533+0000","last_undegraded":"2023-10-03T19:13:21.339533+0000","last_fullsized":"2023-10-03T19:13:21.339533+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:39:44.903301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.331242+0000","last_change":"2023-10-03T19:13:21.386226+0000","last_active":"2023-10-03T19:13:22.331242+0000","last_peered":"2023-10-03T19:13:22.331242+0000","last_clean":"2023-10-03T19:13:22.331242+0000","last_became_active":"2023-10-03T19:13:21.381498+0000","last_became_peered":"2023-10-03T19:13:21.381498+0000","last_unstale":"2023-10-03T19:13:22.331242+0000","last_undegraded":"2023-10-03T19:13:22.331242+0000","last_fullsized":"2023-10-03T19:13:22.331242+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:05:10.879452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-03T19:13:20.946219+0000","last_change":"2023-10-03T19:13:20.946219+0000","last_active":"2023-10-03T19:13:20.908525+0000","last_peered":"2023-10-03T19:13:20.908525+0000","last_clean":"2023-10-03T19:13:20.908525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:13:20.946219+0000","last_undegraded":"2023-10-03T19:13:20.946219+0000","last_fullsized":"2023-10-03T19:13:20.946219+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344660+0000","last_change":"2023-10-03T19:13:21.379630+0000","last_active":"2023-10-03T19:13:23.344660+0000","last_peered":"2023-10-03T19:13:23.344660+0000","last_clean":"2023-10-03T19:13:23.344660+0000","last_became_active":"2023-10-03T19:13:21.379337+0000","last_became_peered":"2023-10-03T19:13:21.379337+0000","last_unstale":"2023-10-03T19:13:23.344660+0000","last_undegraded":"2023-10-03T19:13:23.344660+0000","last_fullsized":"2023-10-03T19:13:23.344660+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:05:21.993046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.333045+0000","last_change":"2023-10-03T19:13:21.387777+0000","last_active":"2023-10-03T19:13:22.333045+0000","last_peered":"2023-10-03T19:13:22.333045+0000","last_clean":"2023-10-03T19:13:22.333045+0000","last_became_active":"2023-10-03T19:13:21.387128+0000","last_became_peered":"2023-10-03T19:13:21.387128+0000","last_unstale":"2023-10-03T19:13:22.333045+0000","last_undegraded":"2023-10-03T19:13:22.333045+0000","last_fullsized":"2023-10-03T19:13:22.333045+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:33:35.559553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332600+0000","last_change":"2023-10-03T19:13:21.381901+0000","last_active":"2023-10-03T19:13:22.332600+0000","last_peered":"2023-10-03T19:13:22.332600+0000","last_clean":"2023-10-03T19:13:22.332600+0000","last_became_active":"2023-10-03T19:13:21.380706+0000","last_became_peered":"2023-10-03T19:13:21.380706+0000","last_unstale":"2023-10-03T19:13:22.332600+0000","last_undegraded":"2023-10-03T19:13:22.332600+0000","last_fullsized":"2023-10-03T19:13:22.332600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:12:39.485705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344538+0000","last_change":"2023-10-03T19:13:21.337436+0000","last_active":"2023-10-03T19:13:23.344538+0000","last_peered":"2023-10-03T19:13:23.344538+0000","last_clean":"2023-10-03T19:13:23.344538+0000","last_became_active":"2023-10-03T19:13:21.337123+0000","last_became_peered":"2023-10-03T19:13:21.337123+0000","last_unstale":"2023-10-03T19:13:23.344538+0000","last_undegraded":"2023-10-03T19:13:23.344538+0000","last_fullsized":"2023-10-03T19:13:23.344538+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:16:02.368990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332506+0000","last_change":"2023-10-03T19:13:21.387101+0000","last_active":"2023-10-03T19:13:22.332506+0000","last_peered":"2023-10-03T19:13:22.332506+0000","last_clean":"2023-10-03T19:13:22.332506+0000","last_became_active":"2023-10-03T19:13:21.386571+0000","last_became_peered":"2023-10-03T19:13:21.386571+0000","last_unstale":"2023-10-03T19:13:22.332506+0000","last_undegraded":"2023-10-03T19:13:22.332506+0000","last_fullsized":"2023-10-03T19:13:22.332506+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:48:36.421606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.382081+0000","last_change":"2023-10-03T19:13:21.365622+0000","last_active":"2023-10-03T19:13:21.382081+0000","last_peered":"2023-10-03T19:13:21.382081+0000","last_clean":"2023-10-03T19:13:21.382081+0000","last_became_active":"2023-10-03T19:13:21.364997+0000","last_became_peered":"2023-10-03T19:13:21.364997+0000","last_unstale":"2023-10-03T19:13:21.382081+0000","last_undegraded":"2023-10-03T19:13:21.382081+0000","last_fullsized":"2023-10-03T19:13:21.382081+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:50:20.193476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.331431+0000","last_change":"2023-10-03T19:13:21.382122+0000","last_active":"2023-10-03T19:13:22.331431+0000","last_peered":"2023-10-03T19:13:22.331431+0000","last_clean":"2023-10-03T19:13:22.331431+0000","last_became_active":"2023-10-03T19:13:21.380853+0000","last_became_peered":"2023-10-03T19:13:21.380853+0000","last_unstale":"2023-10-03T19:13:22.331431+0000","last_undegraded":"2023-10-03T19:13:22.331431+0000","last_fullsized":"2023-10-03T19:13:22.331431+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:12:09.744127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388977+0000","last_change":"2023-10-03T19:13:21.382147+0000","last_active":"2023-10-03T19:13:21.388977+0000","last_peered":"2023-10-03T19:13:21.388977+0000","last_clean":"2023-10-03T19:13:21.388977+0000","last_became_active":"2023-10-03T19:13:21.381614+0000","last_became_peered":"2023-10-03T19:13:21.381614+0000","last_unstale":"2023-10-03T19:13:21.388977+0000","last_undegraded":"2023-10-03T19:13:21.388977+0000","last_fullsized":"2023-10-03T19:13:21.388977+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:03:08.567828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.393291+0000","last_change":"2023-10-03T19:13:21.391132+0000","last_active":"2023-10-03T19:13:21.393291+0000","last_peered":"2023-10-03T19:13:21.393291+0000","last_clean":"2023-10-03T19:13:21.393291+0000","last_became_active":"2023-10-03T19:13:21.390626+0000","last_became_peered":"2023-10-03T19:13:21.390626+0000","last_unstale":"2023-10-03T19:13:21.393291+0000","last_undegraded":"2023-10-03T19:13:21.393291+0000","last_fullsized":"2023-10-03T19:13:21.393291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:52:31.490114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.376272+0000","last_change":"2023-10-03T19:13:21.369754+0000","last_active":"2023-10-03T19:13:21.376272+0000","last_peered":"2023-10-03T19:13:21.376272+0000","last_clean":"2023-10-03T19:13:21.376272+0000","last_became_active":"2023-10-03T19:13:21.368680+0000","last_became_peered":"2023-10-03T19:13:21.368680+0000","last_unstale":"2023-10-03T19:13:21.376272+0000","last_undegraded":"2023-10-03T19:13:21.376272+0000","last_fullsized":"2023-10-03T19:13:21.376272+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:38:54.659714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.338097+0000","last_change":"2023-10-03T19:13:21.332782+0000","last_active":"2023-10-03T19:13:21.338097+0000","last_peered":"2023-10-03T19:13:21.338097+0000","last_clean":"2023-10-03T19:13:21.338097+0000","last_became_active":"2023-10-03T19:13:21.332537+0000","last_became_peered":"2023-10-03T19:13:21.332537+0000","last_unstale":"2023-10-03T19:13:21.338097+0000","last_undegraded":"2023-10-03T19:13:21.338097+0000","last_fullsized":"2023-10-03T19:13:21.338097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:39:33.232842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.369427+0000","last_change":"2023-10-03T19:13:21.366160+0000","last_active":"2023-10-03T19:13:21.369427+0000","last_peered":"2023-10-03T19:13:21.369427+0000","last_clean":"2023-10-03T19:13:21.369427+0000","last_became_active":"2023-10-03T19:13:21.365568+0000","last_became_peered":"2023-10-03T19:13:21.365568+0000","last_unstale":"2023-10-03T19:13:21.369427+0000","last_undegraded":"2023-10-03T19:13:21.369427+0000","last_fullsized":"2023-10-03T19:13:21.369427+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:48:02.179860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332079+0000","last_change":"2023-10-03T19:13:21.380192+0000","last_active":"2023-10-03T19:13:22.332079+0000","last_peered":"2023-10-03T19:13:22.332079+0000","last_clean":"2023-10-03T19:13:22.332079+0000","last_became_active":"2023-10-03T19:13:21.379452+0000","last_became_peered":"2023-10-03T19:13:21.379452+0000","last_unstale":"2023-10-03T19:13:22.332079+0000","last_undegraded":"2023-10-03T19:13:22.332079+0000","last_fullsized":"2023-10-03T19:13:22.332079+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:10:18.652000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.382002+0000","last_change":"2023-10-03T19:13:21.362845+0000","last_active":"2023-10-03T19:13:21.382002+0000","last_peered":"2023-10-03T19:13:21.382002+0000","last_clean":"2023-10-03T19:13:21.382002+0000","last_became_active":"2023-10-03T19:13:21.361610+0000","last_became_peered":"2023-10-03T19:13:21.361610+0000","last_unstale":"2023-10-03T19:13:21.382002+0000","last_undegraded":"2023-10-03T19:13:21.382002+0000","last_fullsized":"2023-10-03T19:13:21.382002+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:19:45.728456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388429+0000","last_change":"2023-10-03T19:13:21.371753+0000","last_active":"2023-10-03T19:13:21.388429+0000","last_peered":"2023-10-03T19:13:21.388429+0000","last_clean":"2023-10-03T19:13:21.388429+0000","last_became_active":"2023-10-03T19:13:21.370040+0000","last_became_peered":"2023-10-03T19:13:21.370040+0000","last_unstale":"2023-10-03T19:13:21.388429+0000","last_undegraded":"2023-10-03T19:13:21.388429+0000","last_fullsized":"2023-10-03T19:13:21.388429+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:21:52.323037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.370133+0000","last_change":"2023-10-03T19:13:21.368517+0000","last_active":"2023-10-03T19:13:21.370133+0000","last_peered":"2023-10-03T19:13:21.370133+0000","last_clean":"2023-10-03T19:13:21.370133+0000","last_became_active":"2023-10-03T19:13:21.368223+0000","last_became_peered":"2023-10-03T19:13:21.368223+0000","last_unstale":"2023-10-03T19:13:21.370133+0000","last_undegraded":"2023-10-03T19:13:21.370133+0000","last_fullsized":"2023-10-03T19:13:21.370133+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:44:21.225478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.361781+0000","last_change":"2023-10-03T19:13:21.340602+0000","last_active":"2023-10-03T19:13:21.361781+0000","last_peered":"2023-10-03T19:13:21.361781+0000","last_clean":"2023-10-03T19:13:21.361781+0000","last_became_active":"2023-10-03T19:13:21.338940+0000","last_became_peered":"2023-10-03T19:13:21.338940+0000","last_unstale":"2023-10-03T19:13:21.361781+0000","last_undegraded":"2023-10-03T19:13:21.361781+0000","last_fullsized":"2023-10-03T19:13:21.361781+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:18:54.472816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.372433+0000","last_change":"2023-10-03T19:13:21.371393+0000","last_active":"2023-10-03T19:13:21.372433+0000","last_peered":"2023-10-03T19:13:21.372433+0000","last_clean":"2023-10-03T19:13:21.372433+0000","last_became_active":"2023-10-03T19:13:21.371075+0000","last_became_peered":"2023-10-03T19:13:21.371075+0000","last_unstale":"2023-10-03T19:13:21.372433+0000","last_undegraded":"2023-10-03T19:13:21.372433+0000","last_fullsized":"2023-10-03T19:13:21.372433+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:09:25.508263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.362808+0000","last_change":"2023-10-03T19:13:21.341738+0000","last_active":"2023-10-03T19:13:21.362808+0000","last_peered":"2023-10-03T19:13:21.362808+0000","last_clean":"2023-10-03T19:13:21.362808+0000","last_became_active":"2023-10-03T19:13:21.340877+0000","last_became_peered":"2023-10-03T19:13:21.340877+0000","last_unstale":"2023-10-03T19:13:21.362808+0000","last_undegraded":"2023-10-03T19:13:21.362808+0000","last_fullsized":"2023-10-03T19:13:21.362808+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:50:45.720443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332435+0000","last_change":"2023-10-03T19:13:21.363972+0000","last_active":"2023-10-03T19:13:22.332435+0000","last_peered":"2023-10-03T19:13:22.332435+0000","last_clean":"2023-10-03T19:13:22.332435+0000","last_became_active":"2023-10-03T19:13:21.363452+0000","last_became_peered":"2023-10-03T19:13:21.363452+0000","last_unstale":"2023-10-03T19:13:22.332435+0000","last_undegraded":"2023-10-03T19:13:22.332435+0000","last_fullsized":"2023-10-03T19:13:22.332435+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:56:31.353897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.353062+0000","last_change":"2023-10-03T19:13:21.334239+0000","last_active":"2023-10-03T19:13:21.353062+0000","last_peered":"2023-10-03T19:13:21.353062+0000","last_clean":"2023-10-03T19:13:21.353062+0000","last_became_active":"2023-10-03T19:13:21.333456+0000","last_became_peered":"2023-10-03T19:13:21.333456+0000","last_unstale":"2023-10-03T19:13:21.353062+0000","last_undegraded":"2023-10-03T19:13:21.353062+0000","last_fullsized":"2023-10-03T19:13:21.353062+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:54:32.970270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.361714+0000","last_change":"2023-10-03T19:13:21.339712+0000","last_active":"2023-10-03T19:13:21.361714+0000","last_peered":"2023-10-03T19:13:21.361714+0000","last_clean":"2023-10-03T19:13:21.361714+0000","last_became_active":"2023-10-03T19:13:21.338930+0000","last_became_peered":"2023-10-03T19:13:21.338930+0000","last_unstale":"2023-10-03T19:13:21.361714+0000","last_undegraded":"2023-10-03T19:13:21.361714+0000","last_fullsized":"2023-10-03T19:13:21.361714+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:52:54.145637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388471+0000","last_change":"2023-10-03T19:13:21.372961+0000","last_active":"2023-10-03T19:13:21.388471+0000","last_peered":"2023-10-03T19:13:21.388471+0000","last_clean":"2023-10-03T19:13:21.388471+0000","last_became_active":"2023-10-03T19:13:21.372269+0000","last_became_peered":"2023-10-03T19:13:21.372269+0000","last_unstale":"2023-10-03T19:13:21.388471+0000","last_undegraded":"2023-10-03T19:13:21.388471+0000","last_fullsized":"2023-10-03T19:13:21.388471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:42:26.752455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.339370+0000","last_change":"2023-10-03T19:13:21.337355+0000","last_active":"2023-10-03T19:13:21.339370+0000","last_peered":"2023-10-03T19:13:21.339370+0000","last_clean":"2023-10-03T19:13:21.339370+0000","last_became_active":"2023-10-03T19:13:21.337084+0000","last_became_peered":"2023-10-03T19:13:21.337084+0000","last_unstale":"2023-10-03T19:13:21.339370+0000","last_undegraded":"2023-10-03T19:13:21.339370+0000","last_fullsized":"2023-10-03T19:13:21.339370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:23:59.311834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.394182+0000","last_change":"2023-10-03T19:13:21.391912+0000","last_active":"2023-10-03T19:13:21.394182+0000","last_peered":"2023-10-03T19:13:21.394182+0000","last_clean":"2023-10-03T19:13:21.394182+0000","last_became_active":"2023-10-03T19:13:21.390545+0000","last_became_peered":"2023-10-03T19:13:21.390545+0000","last_unstale":"2023-10-03T19:13:21.394182+0000","last_undegraded":"2023-10-03T19:13:21.394182+0000","last_fullsized":"2023-10-03T19:13:21.394182+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:38:14.290892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"34'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.377742+0000","last_change":"2023-10-03T19:13:20.969426+0000","last_active":"2023-10-03T19:13:21.377742+0000","last_peered":"2023-10-03T19:13:21.377742+0000","last_clean":"2023-10-03T19:13:21.377742+0000","last_became_active":"2023-10-03T19:13:20.968732+0000","last_became_peered":"2023-10-03T19:13:20.968732+0000","last_unstale":"2023-10-03T19:13:21.377742+0000","last_undegraded":"2023-10-03T19:13:21.377742+0000","last_fullsized":"2023-10-03T19:13:21.377742+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:54:05.602230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.386027+0000","last_change":"2023-10-03T19:13:21.385217+0000","last_active":"2023-10-03T19:13:21.386027+0000","last_peered":"2023-10-03T19:13:21.386027+0000","last_clean":"2023-10-03T19:13:21.386027+0000","last_became_active":"2023-10-03T19:13:21.384926+0000","last_became_peered":"2023-10-03T19:13:21.384926+0000","last_unstale":"2023-10-03T19:13:21.386027+0000","last_undegraded":"2023-10-03T19:13:21.386027+0000","last_fullsized":"2023-10-03T19:13:21.386027+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:43:13.606613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344952+0000","last_change":"2023-10-03T19:13:20.972150+0000","last_active":"2023-10-03T19:13:23.344952+0000","last_peered":"2023-10-03T19:13:23.344952+0000","last_clean":"2023-10-03T19:13:23.344952+0000","last_became_active":"2023-10-03T19:13:20.971821+0000","last_became_peered":"2023-10-03T19:13:20.971821+0000","last_unstale":"2023-10-03T19:13:23.344952+0000","last_undegraded":"2023-10-03T19:13:23.344952+0000","last_fullsized":"2023-10-03T19:13:23.344952+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:46:55.064511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.382104+0000","last_change":"2023-10-03T19:13:21.365006+0000","last_active":"2023-10-03T19:13:21.382104+0000","last_peered":"2023-10-03T19:13:21.382104+0000","last_clean":"2023-10-03T19:13:21.382104+0000","last_became_active":"2023-10-03T19:13:21.364499+0000","last_became_peered":"2023-10-03T19:13:21.364499+0000","last_unstale":"2023-10-03T19:13:21.382104+0000","last_undegraded":"2023-10-03T19:13:21.382104+0000","last_fullsized":"2023-10-03T19:13:21.382104+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:45:17.978390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.359478+0000","last_change":"2023-10-03T19:13:20.950958+0000","last_active":"2023-10-03T19:13:21.359478+0000","last_peered":"2023-10-03T19:13:21.359478+0000","last_clean":"2023-10-03T19:13:21.359478+0000","last_became_active":"2023-10-03T19:13:20.950561+0000","last_became_peered":"2023-10-03T19:13:20.950561+0000","last_unstale":"2023-10-03T19:13:21.359478+0000","last_undegraded":"2023-10-03T19:13:21.359478+0000","last_fullsized":"2023-10-03T19:13:21.359478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:55:54.835749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-03T19:13:20.946012+0000","last_change":"2023-10-03T19:13:20.946012+0000","last_active":"2023-10-03T19:13:20.908525+0000","last_peered":"2023-10-03T19:13:20.908525+0000","last_clean":"2023-10-03T19:13:20.908525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:13:20.946012+0000","last_undegraded":"2023-10-03T19:13:20.946012+0000","last_fullsized":"2023-10-03T19:13:20.946012+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.376007+0000","last_change":"2023-10-03T19:13:20.953487+0000","last_active":"2023-10-03T19:13:21.376007+0000","last_peered":"2023-10-03T19:13:21.376007+0000","last_clean":"2023-10-03T19:13:21.376007+0000","last_became_active":"2023-10-03T19:13:20.952739+0000","last_became_peered":"2023-10-03T19:13:20.952739+0000","last_unstale":"2023-10-03T19:13:21.376007+0000","last_undegraded":"2023-10-03T19:13:21.376007+0000","last_fullsized":"2023-10-03T19:13:21.376007+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:41:26.248555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344143+0000","last_change":"2023-10-03T19:13:21.335933+0000","last_active":"2023-10-03T19:13:23.344143+0000","last_peered":"2023-10-03T19:13:23.344143+0000","last_clean":"2023-10-03T19:13:23.344143+0000","last_became_active":"2023-10-03T19:13:21.335661+0000","last_became_peered":"2023-10-03T19:13:21.335661+0000","last_unstale":"2023-10-03T19:13:23.344143+0000","last_undegraded":"2023-10-03T19:13:23.344143+0000","last_fullsized":"2023-10-03T19:13:23.344143+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:14:24.053747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332061+0000","last_change":"2023-10-03T19:13:20.957478+0000","last_active":"2023-10-03T19:13:22.332061+0000","last_peered":"2023-10-03T19:13:22.332061+0000","last_clean":"2023-10-03T19:13:22.332061+0000","last_became_active":"2023-10-03T19:13:20.956389+0000","last_became_peered":"2023-10-03T19:13:20.956389+0000","last_unstale":"2023-10-03T19:13:22.332061+0000","last_undegraded":"2023-10-03T19:13:22.332061+0000","last_fullsized":"2023-10-03T19:13:22.332061+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:17:04.660877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.331680+0000","last_change":"2023-10-03T19:13:21.380338+0000","last_active":"2023-10-03T19:13:22.331680+0000","last_peered":"2023-10-03T19:13:22.331680+0000","last_clean":"2023-10-03T19:13:22.331680+0000","last_became_active":"2023-10-03T19:13:21.379660+0000","last_became_peered":"2023-10-03T19:13:21.379660+0000","last_unstale":"2023-10-03T19:13:22.331680+0000","last_undegraded":"2023-10-03T19:13:22.331680+0000","last_fullsized":"2023-10-03T19:13:22.331680+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:11:08.676258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.374578+0000","last_change":"2023-10-03T19:13:20.974925+0000","last_active":"2023-10-03T19:13:21.374578+0000","last_peered":"2023-10-03T19:13:21.374578+0000","last_clean":"2023-10-03T19:13:21.374578+0000","last_became_active":"2023-10-03T19:13:20.974368+0000","last_became_peered":"2023-10-03T19:13:20.974368+0000","last_unstale":"2023-10-03T19:13:21.374578+0000","last_undegraded":"2023-10-03T19:13:21.374578+0000","last_fullsized":"2023-10-03T19:13:21.374578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:31:41.223618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.383953+0000","last_change":"2023-10-03T19:13:21.379900+0000","last_active":"2023-10-03T19:13:21.383953+0000","last_peered":"2023-10-03T19:13:21.383953+0000","last_clean":"2023-10-03T19:13:21.383953+0000","last_became_active":"2023-10-03T19:13:21.379296+0000","last_became_peered":"2023-10-03T19:13:21.379296+0000","last_unstale":"2023-10-03T19:13:21.383953+0000","last_undegraded":"2023-10-03T19:13:21.383953+0000","last_fullsized":"2023-10-03T19:13:21.383953+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:57:55.230179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.326794+0000","last_change":"2023-10-03T19:13:20.963235+0000","last_active":"2023-10-03T19:13:21.326794+0000","last_peered":"2023-10-03T19:13:21.326794+0000","last_clean":"2023-10-03T19:13:21.326794+0000","last_became_active":"2023-10-03T19:13:20.962810+0000","last_became_peered":"2023-10-03T19:13:20.962810+0000","last_unstale":"2023-10-03T19:13:21.326794+0000","last_undegraded":"2023-10-03T19:13:21.326794+0000","last_fullsized":"2023-10-03T19:13:21.326794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:00:49.525990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-03T19:13:20.948617+0000","last_change":"2023-10-03T19:13:20.948617+0000","last_active":"2023-10-03T19:13:20.908525+0000","last_peered":"2023-10-03T19:13:20.908525+0000","last_clean":"2023-10-03T19:13:20.908525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:13:20.948617+0000","last_undegraded":"2023-10-03T19:13:20.948617+0000","last_fullsized":"2023-10-03T19:13:20.948617+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.348006+0000","last_change":"2023-10-03T19:13:20.970078+0000","last_active":"2023-10-03T19:13:21.348006+0000","last_peered":"2023-10-03T19:13:21.348006+0000","last_clean":"2023-10-03T19:13:21.348006+0000","last_became_active":"2023-10-03T19:13:20.969404+0000","last_became_peered":"2023-10-03T19:13:20.969404+0000","last_unstale":"2023-10-03T19:13:21.348006+0000","last_undegraded":"2023-10-03T19:13:21.348006+0000","last_fullsized":"2023-10-03T19:13:21.348006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:06:40.574599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.365149+0000","last_change":"2023-10-03T19:13:21.364013+0000","last_active":"2023-10-03T19:13:21.365149+0000","last_peered":"2023-10-03T19:13:21.365149+0000","last_clean":"2023-10-03T19:13:21.365149+0000","last_became_active":"2023-10-03T19:13:21.363513+0000","last_became_peered":"2023-10-03T19:13:21.363513+0000","last_unstale":"2023-10-03T19:13:21.365149+0000","last_undegraded":"2023-10-03T19:13:21.365149+0000","last_fullsized":"2023-10-03T19:13:21.365149+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:37:09.701876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-03T19:13:20.967365+0000","last_change":"2023-10-03T19:13:20.952503+0000","last_active":"2023-10-03T19:13:20.967365+0000","last_peered":"2023-10-03T19:13:20.967365+0000","last_clean":"2023-10-03T19:13:20.967365+0000","last_became_active":"2023-10-03T19:13:20.951828+0000","last_became_peered":"2023-10-03T19:13:20.951828+0000","last_unstale":"2023-10-03T19:13:20.967365+0000","last_undegraded":"2023-10-03T19:13:20.967365+0000","last_fullsized":"2023-10-03T19:13:20.967365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:43:12.595096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388642+0000","last_change":"2023-10-03T19:13:21.376107+0000","last_active":"2023-10-03T19:13:21.388642+0000","last_peered":"2023-10-03T19:13:21.388642+0000","last_clean":"2023-10-03T19:13:21.388642+0000","last_became_active":"2023-10-03T19:13:21.373484+0000","last_became_peered":"2023-10-03T19:13:21.373484+0000","last_unstale":"2023-10-03T19:13:21.388642+0000","last_undegraded":"2023-10-03T19:13:21.388642+0000","last_fullsized":"2023-10-03T19:13:21.388642+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:10:43.840486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.333208+0000","last_change":"2023-10-03T19:13:20.960847+0000","last_active":"2023-10-03T19:13:22.333208+0000","last_peered":"2023-10-03T19:13:22.333208+0000","last_clean":"2023-10-03T19:13:22.333208+0000","last_became_active":"2023-10-03T19:13:20.960078+0000","last_became_peered":"2023-10-03T19:13:20.960078+0000","last_unstale":"2023-10-03T19:13:22.333208+0000","last_undegraded":"2023-10-03T19:13:22.333208+0000","last_fullsized":"2023-10-03T19:13:22.333208+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:14:11.662112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344788+0000","last_change":"2023-10-03T19:13:21.370395+0000","last_active":"2023-10-03T19:13:23.344788+0000","last_peered":"2023-10-03T19:13:23.344788+0000","last_clean":"2023-10-03T19:13:23.344788+0000","last_became_active":"2023-10-03T19:13:21.370113+0000","last_became_peered":"2023-10-03T19:13:21.370113+0000","last_unstale":"2023-10-03T19:13:23.344788+0000","last_undegraded":"2023-10-03T19:13:23.344788+0000","last_fullsized":"2023-10-03T19:13:23.344788+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:47:43.653717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"34'3","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332813+0000","last_change":"2023-10-03T19:13:20.961265+0000","last_active":"2023-10-03T19:13:22.332813+0000","last_peered":"2023-10-03T19:13:22.332813+0000","last_clean":"2023-10-03T19:13:22.332813+0000","last_became_active":"2023-10-03T19:13:20.959393+0000","last_became_peered":"2023-10-03T19:13:20.959393+0000","last_unstale":"2023-10-03T19:13:22.332813+0000","last_undegraded":"2023-10-03T19:13:22.332813+0000","last_fullsized":"2023-10-03T19:13:22.332813+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:40:36.494610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.382201+0000","last_change":"2023-10-03T19:13:21.362691+0000","last_active":"2023-10-03T19:13:21.382201+0000","last_peered":"2023-10-03T19:13:21.382201+0000","last_clean":"2023-10-03T19:13:21.382201+0000","last_became_active":"2023-10-03T19:13:21.361488+0000","last_became_peered":"2023-10-03T19:13:21.361488+0000","last_unstale":"2023-10-03T19:13:21.382201+0000","last_undegraded":"2023-10-03T19:13:21.382201+0000","last_fullsized":"2023-10-03T19:13:21.382201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:53:21.733701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-03T19:13:20.974287+0000","last_change":"2023-10-03T19:13:20.972865+0000","last_active":"2023-10-03T19:13:20.974287+0000","last_peered":"2023-10-03T19:13:20.974287+0000","last_clean":"2023-10-03T19:13:20.974287+0000","last_became_active":"2023-10-03T19:13:20.972358+0000","last_became_peered":"2023-10-03T19:13:20.972358+0000","last_unstale":"2023-10-03T19:13:20.974287+0000","last_undegraded":"2023-10-03T19:13:20.974287+0000","last_fullsized":"2023-10-03T19:13:20.974287+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:43:54.362050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344127+0000","last_change":"2023-10-03T19:13:21.361649+0000","last_active":"2023-10-03T19:13:23.344127+0000","last_peered":"2023-10-03T19:13:23.344127+0000","last_clean":"2023-10-03T19:13:23.344127+0000","last_became_active":"2023-10-03T19:13:21.361411+0000","last_became_peered":"2023-10-03T19:13:21.361411+0000","last_unstale":"2023-10-03T19:13:23.344127+0000","last_undegraded":"2023-10-03T19:13:23.344127+0000","last_fullsized":"2023-10-03T19:13:23.344127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:57:14.066081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-03T19:13:20.967555+0000","last_change":"2023-10-03T19:13:20.964862+0000","last_active":"2023-10-03T19:13:20.967555+0000","last_peered":"2023-10-03T19:13:20.967555+0000","last_clean":"2023-10-03T19:13:20.967555+0000","last_became_active":"2023-10-03T19:13:20.964523+0000","last_became_peered":"2023-10-03T19:13:20.964523+0000","last_unstale":"2023-10-03T19:13:20.967555+0000","last_undegraded":"2023-10-03T19:13:20.967555+0000","last_fullsized":"2023-10-03T19:13:20.967555+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:25:57.148818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-03T19:13:20.943585+0000","last_change":"2023-10-03T19:13:20.943585+0000","last_active":"2023-10-03T19:13:20.908525+0000","last_peered":"2023-10-03T19:13:20.908525+0000","last_clean":"2023-10-03T19:13:20.908525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:13:20.943585+0000","last_undegraded":"2023-10-03T19:13:20.943585+0000","last_fullsized":"2023-10-03T19:13:20.943585+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.326593+0000","last_change":"2023-10-03T19:13:20.962572+0000","last_active":"2023-10-03T19:13:21.326593+0000","last_peered":"2023-10-03T19:13:21.326593+0000","last_clean":"2023-10-03T19:13:21.326593+0000","last_became_active":"2023-10-03T19:13:20.962094+0000","last_became_peered":"2023-10-03T19:13:20.962094+0000","last_unstale":"2023-10-03T19:13:21.326593+0000","last_undegraded":"2023-10-03T19:13:21.326593+0000","last_fullsized":"2023-10-03T19:13:21.326593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:43:54.362050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388247+0000","last_change":"2023-10-03T19:13:21.371030+0000","last_active":"2023-10-03T19:13:21.388247+0000","last_peered":"2023-10-03T19:13:21.388247+0000","last_clean":"2023-10-03T19:13:21.388247+0000","last_became_active":"2023-10-03T19:13:21.369954+0000","last_became_peered":"2023-10-03T19:13:21.369954+0000","last_unstale":"2023-10-03T19:13:21.388247+0000","last_undegraded":"2023-10-03T19:13:21.388247+0000","last_fullsized":"2023-10-03T19:13:21.388247+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:19:02.156799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.328519+0000","last_change":"2023-10-03T19:13:20.967774+0000","last_active":"2023-10-03T19:13:21.328519+0000","last_peered":"2023-10-03T19:13:21.328519+0000","last_clean":"2023-10-03T19:13:21.328519+0000","last_became_active":"2023-10-03T19:13:20.965529+0000","last_became_peered":"2023-10-03T19:13:20.965529+0000","last_unstale":"2023-10-03T19:13:21.328519+0000","last_undegraded":"2023-10-03T19:13:21.328519+0000","last_fullsized":"2023-10-03T19:13:21.328519+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:17:30.367274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-03T19:13:20.947840+0000","last_change":"2023-10-03T19:13:20.947840+0000","last_active":"2023-10-03T19:13:20.908525+0000","last_peered":"2023-10-03T19:13:20.908525+0000","last_clean":"2023-10-03T19:13:20.908525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:13:20.947840+0000","last_undegraded":"2023-10-03T19:13:20.947840+0000","last_fullsized":"2023-10-03T19:13:20.947840+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"34'8","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.382682+0000","last_change":"2023-10-03T19:13:20.975023+0000","last_active":"2023-10-03T19:13:21.382682+0000","last_peered":"2023-10-03T19:13:21.382682+0000","last_clean":"2023-10-03T19:13:21.382682+0000","last_became_active":"2023-10-03T19:13:20.973808+0000","last_became_peered":"2023-10-03T19:13:20.973808+0000","last_unstale":"2023-10-03T19:13:21.382682+0000","last_undegraded":"2023-10-03T19:13:21.382682+0000","last_fullsized":"2023-10-03T19:13:21.382682+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:39:54.101849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-03T19:13:20.942312+0000","last_change":"2023-10-03T19:13:20.942312+0000","last_active":"2023-10-03T19:13:20.908525+0000","last_peered":"2023-10-03T19:13:20.908525+0000","last_clean":"2023-10-03T19:13:20.908525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:13:20.942312+0000","last_undegraded":"2023-10-03T19:13:20.942312+0000","last_fullsized":"2023-10-03T19:13:20.942312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.333263+0000","last_change":"2023-10-03T19:13:20.957758+0000","last_active":"2023-10-03T19:13:22.333263+0000","last_peered":"2023-10-03T19:13:22.333263+0000","last_clean":"2023-10-03T19:13:22.333263+0000","last_became_active":"2023-10-03T19:13:20.957023+0000","last_became_peered":"2023-10-03T19:13:20.957023+0000","last_unstale":"2023-10-03T19:13:22.333263+0000","last_undegraded":"2023-10-03T19:13:22.333263+0000","last_fullsized":"2023-10-03T19:13:22.333263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:36:11.572563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332770+0000","last_change":"2023-10-03T19:13:21.386225+0000","last_active":"2023-10-03T19:13:22.332770+0000","last_peered":"2023-10-03T19:13:22.332770+0000","last_clean":"2023-10-03T19:13:22.332770+0000","last_became_active":"2023-10-03T19:13:21.381348+0000","last_became_peered":"2023-10-03T19:13:21.381348+0000","last_unstale":"2023-10-03T19:13:22.332770+0000","last_undegraded":"2023-10-03T19:13:22.332770+0000","last_fullsized":"2023-10-03T19:13:22.332770+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:59:12.814362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.391164+0000","last_change":"2023-10-03T19:13:20.965203+0000","last_active":"2023-10-03T19:13:21.391164+0000","last_peered":"2023-10-03T19:13:21.391164+0000","last_clean":"2023-10-03T19:13:21.391164+0000","last_became_active":"2023-10-03T19:13:20.963356+0000","last_became_peered":"2023-10-03T19:13:20.963356+0000","last_unstale":"2023-10-03T19:13:21.391164+0000","last_undegraded":"2023-10-03T19:13:21.391164+0000","last_fullsized":"2023-10-03T19:13:21.391164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:41:28.447361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.382600+0000","last_change":"2023-10-03T19:13:21.368113+0000","last_active":"2023-10-03T19:13:21.382600+0000","last_peered":"2023-10-03T19:13:21.382600+0000","last_clean":"2023-10-03T19:13:21.382600+0000","last_became_active":"2023-10-03T19:13:21.367345+0000","last_became_peered":"2023-10-03T19:13:21.367345+0000","last_unstale":"2023-10-03T19:13:21.382600+0000","last_undegraded":"2023-10-03T19:13:21.382600+0000","last_fullsized":"2023-10-03T19:13:21.382600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:26:10.484739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.374764+0000","last_change":"2023-10-03T19:13:20.972574+0000","last_active":"2023-10-03T19:13:21.374764+0000","last_peered":"2023-10-03T19:13:21.374764+0000","last_clean":"2023-10-03T19:13:21.374764+0000","last_became_active":"2023-10-03T19:13:20.972119+0000","last_became_peered":"2023-10-03T19:13:20.972119+0000","last_unstale":"2023-10-03T19:13:21.374764+0000","last_undegraded":"2023-10-03T19:13:21.374764+0000","last_fullsized":"2023-10-03T19:13:21.374764+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:14:08.106459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.341400+0000","last_change":"2023-10-03T19:13:21.339682+0000","last_active":"2023-10-03T19:13:21.341400+0000","last_peered":"2023-10-03T19:13:21.341400+0000","last_clean":"2023-10-03T19:13:21.341400+0000","last_became_active":"2023-10-03T19:13:21.339291+0000","last_became_peered":"2023-10-03T19:13:21.339291+0000","last_unstale":"2023-10-03T19:13:21.341400+0000","last_undegraded":"2023-10-03T19:13:21.341400+0000","last_fullsized":"2023-10-03T19:13:21.341400+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:11:12.253825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.327634+0000","last_change":"2023-10-03T19:13:20.951006+0000","last_active":"2023-10-03T19:13:21.327634+0000","last_peered":"2023-10-03T19:13:21.327634+0000","last_clean":"2023-10-03T19:13:21.327634+0000","last_became_active":"2023-10-03T19:13:20.950606+0000","last_became_peered":"2023-10-03T19:13:20.950606+0000","last_unstale":"2023-10-03T19:13:21.327634+0000","last_undegraded":"2023-10-03T19:13:21.327634+0000","last_fullsized":"2023-10-03T19:13:21.327634+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:03:32.890413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388419+0000","last_change":"2023-10-03T19:13:21.372118+0000","last_active":"2023-10-03T19:13:21.388419+0000","last_peered":"2023-10-03T19:13:21.388419+0000","last_clean":"2023-10-03T19:13:21.388419+0000","last_became_active":"2023-10-03T19:13:21.370009+0000","last_became_peered":"2023-10-03T19:13:21.370009+0000","last_unstale":"2023-10-03T19:13:21.388419+0000","last_undegraded":"2023-10-03T19:13:21.388419+0000","last_fullsized":"2023-10-03T19:13:21.388419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:53:06.561881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.337198+0000","last_change":"2023-10-03T19:13:20.954261+0000","last_active":"2023-10-03T19:13:21.337198+0000","last_peered":"2023-10-03T19:13:21.337198+0000","last_clean":"2023-10-03T19:13:21.337198+0000","last_became_active":"2023-10-03T19:13:20.953905+0000","last_became_peered":"2023-10-03T19:13:20.953905+0000","last_unstale":"2023-10-03T19:13:21.337198+0000","last_undegraded":"2023-10-03T19:13:21.337198+0000","last_fullsized":"2023-10-03T19:13:21.337198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:19:04.380130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344213+0000","last_change":"2023-10-03T19:13:21.372131+0000","last_active":"2023-10-03T19:13:23.344213+0000","last_peered":"2023-10-03T19:13:23.344213+0000","last_clean":"2023-10-03T19:13:23.344213+0000","last_became_active":"2023-10-03T19:13:21.371809+0000","last_became_peered":"2023-10-03T19:13:21.371809+0000","last_unstale":"2023-10-03T19:13:23.344213+0000","last_undegraded":"2023-10-03T19:13:23.344213+0000","last_fullsized":"2023-10-03T19:13:23.344213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:57:40.440963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.320058+0000","last_change":"2023-10-03T19:13:20.960919+0000","last_active":"2023-10-03T19:13:21.320058+0000","last_peered":"2023-10-03T19:13:21.320058+0000","last_clean":"2023-10-03T19:13:21.320058+0000","last_became_active":"2023-10-03T19:13:20.960593+0000","last_became_peered":"2023-10-03T19:13:20.960593+0000","last_unstale":"2023-10-03T19:13:21.320058+0000","last_undegraded":"2023-10-03T19:13:21.320058+0000","last_fullsized":"2023-10-03T19:13:21.320058+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:56:05.170459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332228+0000","last_change":"2023-10-03T19:13:21.365073+0000","last_active":"2023-10-03T19:13:22.332228+0000","last_peered":"2023-10-03T19:13:22.332228+0000","last_clean":"2023-10-03T19:13:22.332228+0000","last_became_active":"2023-10-03T19:13:21.364541+0000","last_became_peered":"2023-10-03T19:13:21.364541+0000","last_unstale":"2023-10-03T19:13:22.332228+0000","last_undegraded":"2023-10-03T19:13:22.332228+0000","last_fullsized":"2023-10-03T19:13:22.332228+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:00:58.829969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.326883+0000","last_change":"2023-10-03T19:13:20.977060+0000","last_active":"2023-10-03T19:13:21.326883+0000","last_peered":"2023-10-03T19:13:21.326883+0000","last_clean":"2023-10-03T19:13:21.326883+0000","last_became_active":"2023-10-03T19:13:20.976504+0000","last_became_peered":"2023-10-03T19:13:20.976504+0000","last_unstale":"2023-10-03T19:13:21.326883+0000","last_undegraded":"2023-10-03T19:13:21.326883+0000","last_fullsized":"2023-10-03T19:13:21.326883+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:48:48.027499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-03T19:13:20.946084+0000","last_change":"2023-10-03T19:13:20.946084+0000","last_active":"2023-10-03T19:13:20.908525+0000","last_peered":"2023-10-03T19:13:20.908525+0000","last_clean":"2023-10-03T19:13:20.908525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:13:20.946084+0000","last_undegraded":"2023-10-03T19:13:20.946084+0000","last_fullsized":"2023-10-03T19:13:20.946084+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.320048+0000","last_change":"2023-10-03T19:13:20.958773+0000","last_active":"2023-10-03T19:13:21.320048+0000","last_peered":"2023-10-03T19:13:21.320048+0000","last_clean":"2023-10-03T19:13:21.320048+0000","last_became_active":"2023-10-03T19:13:20.958365+0000","last_became_peered":"2023-10-03T19:13:20.958365+0000","last_unstale":"2023-10-03T19:13:21.320048+0000","last_undegraded":"2023-10-03T19:13:21.320048+0000","last_fullsized":"2023-10-03T19:13:21.320048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:28:03.119661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332884+0000","last_change":"2023-10-03T19:13:21.392175+0000","last_active":"2023-10-03T19:13:22.332884+0000","last_peered":"2023-10-03T19:13:22.332884+0000","last_clean":"2023-10-03T19:13:22.332884+0000","last_became_active":"2023-10-03T19:13:21.389898+0000","last_became_peered":"2023-10-03T19:13:21.389898+0000","last_unstale":"2023-10-03T19:13:22.332884+0000","last_undegraded":"2023-10-03T19:13:22.332884+0000","last_fullsized":"2023-10-03T19:13:22.332884+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:26:48.120113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.338248+0000","last_change":"2023-10-03T19:13:20.974327+0000","last_active":"2023-10-03T19:13:21.338248+0000","last_peered":"2023-10-03T19:13:21.338248+0000","last_clean":"2023-10-03T19:13:21.338248+0000","last_became_active":"2023-10-03T19:13:20.973755+0000","last_became_peered":"2023-10-03T19:13:20.973755+0000","last_unstale":"2023-10-03T19:13:21.338248+0000","last_undegraded":"2023-10-03T19:13:21.338248+0000","last_fullsized":"2023-10-03T19:13:21.338248+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:53:20.722184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":191,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.326398+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:13:21.326398+0000","last_peered":"2023-10-03T19:13:21.326398+0000","last_clean":"2023-10-03T19:13:21.326398+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:13:21.326398+0000","last_undegraded":"2023-10-03T19:13:21.326398+0000","last_fullsized":"2023-10-03T19:13:21.326398+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:13:03.709387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332331+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:13:22.332331+0000","last_peered":"2023-10-03T19:13:22.332331+0000","last_clean":"2023-10-03T19:13:22.332331+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:13:22.332331+0000","last_undegraded":"2023-10-03T19:13:22.332331+0000","last_fullsized":"2023-10-03T19:13:22.332331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:23:55.753435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.378172+0000","last_change":"2023-10-03T19:13:21.377405+0000","last_active":"2023-10-03T19:13:21.378172+0000","last_peered":"2023-10-03T19:13:21.378172+0000","last_clean":"2023-10-03T19:13:21.378172+0000","last_became_active":"2023-10-03T19:13:21.377187+0000","last_became_peered":"2023-10-03T19:13:21.377187+0000","last_unstale":"2023-10-03T19:13:21.378172+0000","last_undegraded":"2023-10-03T19:13:21.378172+0000","last_fullsized":"2023-10-03T19:13:21.378172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:04:27.975140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.333408+0000","last_change":"2023-10-03T19:13:20.958706+0000","last_active":"2023-10-03T19:13:22.333408+0000","last_peered":"2023-10-03T19:13:22.333408+0000","last_clean":"2023-10-03T19:13:22.333408+0000","last_became_active":"2023-10-03T19:13:20.956435+0000","last_became_peered":"2023-10-03T19:13:20.956435+0000","last_unstale":"2023-10-03T19:13:22.333408+0000","last_undegraded":"2023-10-03T19:13:22.333408+0000","last_fullsized":"2023-10-03T19:13:22.333408+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:04:53.519874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.325293+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:13:21.325293+0000","last_peered":"2023-10-03T19:13:21.325293+0000","last_clean":"2023-10-03T19:13:21.325293+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:13:21.325293+0000","last_undegraded":"2023-10-03T19:13:21.325293+0000","last_fullsized":"2023-10-03T19:13:21.325293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:07:00.971532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388558+0000","last_change":"2023-10-03T19:13:21.374113+0000","last_active":"2023-10-03T19:13:21.388558+0000","last_peered":"2023-10-03T19:13:21.388558+0000","last_clean":"2023-10-03T19:13:21.388558+0000","last_became_active":"2023-10-03T19:13:21.370727+0000","last_became_peered":"2023-10-03T19:13:21.370727+0000","last_unstale":"2023-10-03T19:13:21.388558+0000","last_undegraded":"2023-10-03T19:13:21.388558+0000","last_fullsized":"2023-10-03T19:13:21.388558+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:15:55.983735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.325186+0000","last_change":"2023-10-03T19:13:20.961506+0000","last_active":"2023-10-03T19:13:21.325186+0000","last_peered":"2023-10-03T19:13:21.325186+0000","last_clean":"2023-10-03T19:13:21.325186+0000","last_became_active":"2023-10-03T19:13:20.961101+0000","last_became_peered":"2023-10-03T19:13:20.961101+0000","last_unstale":"2023-10-03T19:13:21.325186+0000","last_undegraded":"2023-10-03T19:13:21.325186+0000","last_fullsized":"2023-10-03T19:13:21.325186+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:08:18.162950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.319655+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:13:21.319655+0000","last_peered":"2023-10-03T19:13:21.319655+0000","last_clean":"2023-10-03T19:13:21.319655+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:13:21.319655+0000","last_undegraded":"2023-10-03T19:13:21.319655+0000","last_fullsized":"2023-10-03T19:13:21.319655+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:04:05.555255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-03T19:13:20.945349+0000","last_change":"2023-10-03T19:13:20.945349+0000","last_active":"2023-10-03T19:13:20.908525+0000","last_peered":"2023-10-03T19:13:20.908525+0000","last_clean":"2023-10-03T19:13:20.908525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:13:20.945349+0000","last_undegraded":"2023-10-03T19:13:20.945349+0000","last_fullsized":"2023-10-03T19:13:20.945349+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344207+0000","last_change":"2023-10-03T19:13:20.951648+0000","last_active":"2023-10-03T19:13:23.344207+0000","last_peered":"2023-10-03T19:13:23.344207+0000","last_clean":"2023-10-03T19:13:23.344207+0000","last_became_active":"2023-10-03T19:13:20.950901+0000","last_became_peered":"2023-10-03T19:13:20.950901+0000","last_unstale":"2023-10-03T19:13:23.344207+0000","last_undegraded":"2023-10-03T19:13:23.344207+0000","last_fullsized":"2023-10-03T19:13:23.344207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:27:55.601869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332066+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:13:22.332066+0000","last_peered":"2023-10-03T19:13:22.332066+0000","last_clean":"2023-10-03T19:13:22.332066+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:13:22.332066+0000","last_undegraded":"2023-10-03T19:13:22.332066+0000","last_fullsized":"2023-10-03T19:13:22.332066+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:11:13.218075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344474+0000","last_change":"2023-10-03T19:13:21.339724+0000","last_active":"2023-10-03T19:13:23.344474+0000","last_peered":"2023-10-03T19:13:23.344474+0000","last_clean":"2023-10-03T19:13:23.344474+0000","last_became_active":"2023-10-03T19:13:21.339332+0000","last_became_peered":"2023-10-03T19:13:21.339332+0000","last_unstale":"2023-10-03T19:13:23.344474+0000","last_undegraded":"2023-10-03T19:13:23.344474+0000","last_fullsized":"2023-10-03T19:13:23.344474+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:01:06.037410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344737+0000","last_change":"2023-10-03T19:13:20.970059+0000","last_active":"2023-10-03T19:13:23.344737+0000","last_peered":"2023-10-03T19:13:23.344737+0000","last_clean":"2023-10-03T19:13:23.344737+0000","last_became_active":"2023-10-03T19:13:20.969451+0000","last_became_peered":"2023-10-03T19:13:20.969451+0000","last_unstale":"2023-10-03T19:13:23.344737+0000","last_undegraded":"2023-10-03T19:13:23.344737+0000","last_fullsized":"2023-10-03T19:13:23.344737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:27:28.531397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.327570+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:13:21.327570+0000","last_peered":"2023-10-03T19:13:21.327570+0000","last_clean":"2023-10-03T19:13:21.327570+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:13:21.327570+0000","last_undegraded":"2023-10-03T19:13:21.327570+0000","last_fullsized":"2023-10-03T19:13:21.327570+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:18:44.840190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.340055+0000","last_change":"2023-10-03T19:13:21.339247+0000","last_active":"2023-10-03T19:13:21.340055+0000","last_peered":"2023-10-03T19:13:21.340055+0000","last_clean":"2023-10-03T19:13:21.340055+0000","last_became_active":"2023-10-03T19:13:21.338947+0000","last_became_peered":"2023-10-03T19:13:21.338947+0000","last_unstale":"2023-10-03T19:13:21.340055+0000","last_undegraded":"2023-10-03T19:13:21.340055+0000","last_fullsized":"2023-10-03T19:13:21.340055+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:25:58.160334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.328948+0000","last_change":"2023-10-03T19:13:20.964605+0000","last_active":"2023-10-03T19:13:21.328948+0000","last_peered":"2023-10-03T19:13:21.328948+0000","last_clean":"2023-10-03T19:13:21.328948+0000","last_became_active":"2023-10-03T19:13:20.963993+0000","last_became_peered":"2023-10-03T19:13:20.963993+0000","last_unstale":"2023-10-03T19:13:21.328948+0000","last_undegraded":"2023-10-03T19:13:21.328948+0000","last_fullsized":"2023-10-03T19:13:21.328948+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:48:12.274201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.331038+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:13:21.331038+0000","last_peered":"2023-10-03T19:13:21.331038+0000","last_clean":"2023-10-03T19:13:21.331038+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:13:21.331038+0000","last_undegraded":"2023-10-03T19:13:21.331038+0000","last_fullsized":"2023-10-03T19:13:21.331038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:32:43.995165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.382046+0000","last_change":"2023-10-03T19:13:21.363349+0000","last_active":"2023-10-03T19:13:21.382046+0000","last_peered":"2023-10-03T19:13:21.382046+0000","last_clean":"2023-10-03T19:13:21.382046+0000","last_became_active":"2023-10-03T19:13:21.362328+0000","last_became_peered":"2023-10-03T19:13:21.362328+0000","last_unstale":"2023-10-03T19:13:21.382046+0000","last_undegraded":"2023-10-03T19:13:21.382046+0000","last_fullsized":"2023-10-03T19:13:21.382046+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:56:03.182827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.347635+0000","last_change":"2023-10-03T19:13:20.954919+0000","last_active":"2023-10-03T19:13:21.347635+0000","last_peered":"2023-10-03T19:13:21.347635+0000","last_clean":"2023-10-03T19:13:21.347635+0000","last_became_active":"2023-10-03T19:13:20.954183+0000","last_became_peered":"2023-10-03T19:13:20.954183+0000","last_unstale":"2023-10-03T19:13:21.347635+0000","last_undegraded":"2023-10-03T19:13:21.347635+0000","last_fullsized":"2023-10-03T19:13:21.347635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:45:23.847643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.327829+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:13:21.327829+0000","last_peered":"2023-10-03T19:13:21.327829+0000","last_clean":"2023-10-03T19:13:21.327829+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:13:21.327829+0000","last_undegraded":"2023-10-03T19:13:21.327829+0000","last_fullsized":"2023-10-03T19:13:21.327829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:38:27.108483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388363+0000","last_change":"2023-10-03T19:13:21.371931+0000","last_active":"2023-10-03T19:13:21.388363+0000","last_peered":"2023-10-03T19:13:21.388363+0000","last_clean":"2023-10-03T19:13:21.388363+0000","last_became_active":"2023-10-03T19:13:21.370833+0000","last_became_peered":"2023-10-03T19:13:21.370833+0000","last_unstale":"2023-10-03T19:13:21.388363+0000","last_undegraded":"2023-10-03T19:13:21.388363+0000","last_fullsized":"2023-10-03T19:13:21.388363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:32:53.308272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-03T19:13:20.967314+0000","last_change":"2023-10-03T19:13:20.952123+0000","last_active":"2023-10-03T19:13:20.967314+0000","last_peered":"2023-10-03T19:13:20.967314+0000","last_clean":"2023-10-03T19:13:20.967314+0000","last_became_active":"2023-10-03T19:13:20.951627+0000","last_became_peered":"2023-10-03T19:13:20.951627+0000","last_unstale":"2023-10-03T19:13:20.967314+0000","last_undegraded":"2023-10-03T19:13:20.967314+0000","last_fullsized":"2023-10-03T19:13:20.967314+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:39:43.891784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.330387+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:13:21.330387+0000","last_peered":"2023-10-03T19:13:21.330387+0000","last_clean":"2023-10-03T19:13:21.330387+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:13:21.330387+0000","last_undegraded":"2023-10-03T19:13:21.330387+0000","last_fullsized":"2023-10-03T19:13:21.330387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:32:54.906695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":764,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9416,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362424,"statfs":{"total":96636764160,"available":96627122176,"internally_reserved":0,"allocated":458752,"data_stored":747260,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]}]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8696,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363144,"statfs":{"total":96636764160,"available":96627859456,"internally_reserved":0,"allocated":376832,"data_stored":154676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":0.90300000000000002}]},{"osd":1,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.93700000000000006}]},{"osd":2,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.63300000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":0.67000000000000004}]},{"osd":4,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":1.054},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.997}]},{"osd":5,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.2570000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.1319999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.095},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.0289999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8812,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94363028,"statfs":{"total":96636764160,"available":96627740672,"internally_reserved":0,"allocated":364544,"data_stored":148130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":1.071}]},{"osd":1,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.9750000000000001,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.58499999999999996}]},{"osd":2,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.8809999999999998,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":1.153}]},{"osd":3,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":3.0369999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":1.121}]},{"osd":5,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.948},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":1.2909999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":3.0840000000000001,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.8919999999999999,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":2.0760000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.327},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":3.1230000000000002,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":1.1930000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12856,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":12480,"kb_avail":94358984,"statfs":{"total":96636764160,"available":96623599616,"internally_reserved":0,"allocated":376832,"data_stored":154164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12779520},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.68700000000000006}]},{"osd":1,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.497},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.56999999999999995}]},{"osd":3,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.82399999999999995}]},{"osd":4,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":1.0660000000000001}]},{"osd":5,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.92500000000000004}]},{"osd":6,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.034}]},{"osd":7,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":1.016}]}]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8828,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94363012,"statfs":{"total":96636764160,"available":96627724288,"internally_reserved":0,"allocated":380928,"data_stored":155348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542159,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8672,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363168,"statfs":{"total":96636764160,"available":96627884032,"internally_reserved":0,"allocated":352256,"data_stored":141502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8844,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362996,"statfs":{"total":96636764160,"available":96627707904,"internally_reserved":0,"allocated":397312,"data_stored":162023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:13:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.83199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":3,"last update":"Tue Oct 3 19:13:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.60099999999999998},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.73199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13444,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":12992,"kb_avail":94358396,"statfs":{"total":96636764160,"available":96622997504,"internally_reserved":0,"allocated":454656,"data_stored":751149,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":13303808},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":1.218}]},{"osd":2,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.94699999999999995}]},{"osd":3,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.75900000000000001}]},{"osd":4,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.347}]},{"osd":5,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.3009999999999999},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.84999999999999998}]},{"osd":6,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.034},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.056}]},{"osd":7,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.1499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:13:25.734 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:13:25.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee865bf640 1 Processor -- start 2023-10-03T19:13:25.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee865bf640 1 -- start start 2023-10-03T19:13:25.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee865bf640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fee8006c9a0 0x7fee80156d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:25.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee865bf640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee8014b610 con 0x7fee80148b90 2023-10-03T19:13:25.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee865bf640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee800a5580 con 0x7fee800bcb60 2023-10-03T19:13:25.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee865bf640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee800a3670 con 0x7fee8006c9a0 2023-10-03T19:13:25.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee7ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fee80148b90 0x7fee800bbf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35820/0 (socket says 172.21.15.45:35820) 2023-10-03T19:13:25.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee7ffff640 1 -- 172.21.15.45:0/2080760513 learned_addr learned my addr 172.21.15.45:0/2080760513 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:25.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee84b5c640 1 --2- 172.21.15.45:0/2080760513 >> v2:172.21.15.79:3300/0 conn(0x7fee8006c9a0 0x7fee80156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:25.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee7effd640 1 -- 172.21.15.45:0/2080760513 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2340855356 0 0) 0x7fee8014b610 con 0x7fee80148b90 2023-10-03T19:13:25.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee7effd640 1 -- 172.21.15.45:0/2080760513 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee6c005740 con 0x7fee80148b90 2023-10-03T19:13:25.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee7effd640 1 -- 172.21.15.45:0/2080760513 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3380000658 0 0) 0x7fee6c005740 con 0x7fee80148b90 2023-10-03T19:13:25.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee7effd640 1 -- 172.21.15.45:0/2080760513 >> v2:172.21.15.79:3300/0 conn(0x7fee8006c9a0 msgr2=0x7fee80156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:25.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee7effd640 1 --2- 172.21.15.45:0/2080760513 >> v2:172.21.15.79:3300/0 conn(0x7fee8006c9a0 0x7fee80156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee7effd640 1 -- 172.21.15.45:0/2080760513 >> v1:172.21.15.79:6789/0 conn(0x7fee800bcb60 legacy=0x7fee8006c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:25.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee7effd640 1 -- 172.21.15.45:0/2080760513 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee800a5820 con 0x7fee80148b90 2023-10-03T19:13:25.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee7effd640 1 -- 172.21.15.45:0/2080760513 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fee70001a00 con 0x7fee80148b90 2023-10-03T19:13:25.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee7effd640 1 -- 172.21.15.45:0/2080760513 >> v1:172.21.15.45:6789/0 conn(0x7fee80148b90 legacy=0x7fee800bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:25.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee7effd640 1 --2- 172.21.15.45:0/2080760513 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee6c005b90 0x7fee6c005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:25.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee7effd640 1 --2- 172.21.15.45:0/2080760513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee6c0069e0 0x7fee6c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:25.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee7effd640 1 --2- 172.21.15.45:0/2080760513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee6c007390 0x7fee6c00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:25.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee7effd640 1 -- 172.21.15.45:0/2080760513 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee800a3670 con 0x7fee6c0069e0 2023-10-03T19:13:25.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee7effd640 1 -- 172.21.15.45:0/2080760513 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c00e1f0 con 0x7fee6c007390 2023-10-03T19:13:25.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee7effd640 1 -- 172.21.15.45:0/2080760513 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c00e3b0 con 0x7fee6c005b90 2023-10-03T19:13:25.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee7f7fe640 1 --2- 172.21.15.45:0/2080760513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee6c0069e0 0x7fee6c006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:25.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee7ffff640 1 --2- 172.21.15.45:0/2080760513 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee6c005b90 0x7fee6c005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:25.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee7f7fe640 1 -- 172.21.15.45:0/2080760513 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee6c005b90 msgr2=0x7fee6c005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:25.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee7f7fe640 1 --2- 172.21.15.45:0/2080760513 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee6c005b90 0x7fee6c005fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee7f7fe640 1 -- 172.21.15.45:0/2080760513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee6c007390 msgr2=0x7fee6c00dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:25.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee7f7fe640 1 --2- 172.21.15.45:0/2080760513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee6c007390 0x7fee6c00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee7f7fe640 1 -- 172.21.15.45:0/2080760513 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6c005740 con 0x7fee6c0069e0 2023-10-03T19:13:25.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.884+0000 7fee84b5c640 1 -- 172.21.15.45:0/2080760513 reap_dead start 2023-10-03T19:13:25.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.888+0000 7fee7f7fe640 1 --2- 172.21.15.45:0/2080760513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee6c0069e0 0x7fee6c006e50 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fee68001780 tx=0x7fee6801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f6fa645185cb706 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:25.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.888+0000 7fee7effd640 1 -- 172.21.15.45:0/2080760513 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee680052d0 con 0x7fee6c0069e0 2023-10-03T19:13:25.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.888+0000 7fee7effd640 1 -- 172.21.15.45:0/2080760513 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee680a7050 con 0x7fee6c0069e0 2023-10-03T19:13:25.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.888+0000 7fee7effd640 1 -- 172.21.15.45:0/2080760513 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee68003600 con 0x7fee6c0069e0 2023-10-03T19:13:25.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.888+0000 7fee865bf640 1 -- 172.21.15.45:0/2080760513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee6c0069e0 msgr2=0x7fee6c006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:25.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.888+0000 7fee865bf640 1 --2- 172.21.15.45:0/2080760513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee6c0069e0 0x7fee6c006e50 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fee68001780 tx=0x7fee6801c400 comp rx=0 tx=0).stop 2023-10-03T19:13:25.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.888+0000 7fee865bf640 1 -- 172.21.15.45:0/2080760513 shutdown_connections 2023-10-03T19:13:25.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.888+0000 7fee865bf640 1 --2- 172.21.15.45:0/2080760513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee6c0069e0 0x7fee6c006e50 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.888+0000 7fee865bf640 1 -- 172.21.15.45:0/2080760513 >> 172.21.15.45:0/2080760513 conn(0x7fee800bcf50 msgr2=0x7fee800bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:25.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.888+0000 7fee865bf640 1 -- 172.21.15.45:0/2080760513 shutdown_connections 2023-10-03T19:13:25.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.888+0000 7fee865bf640 1 -- 172.21.15.45:0/2080760513 wait complete. 2023-10-03T19:13:25.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.888+0000 7fee865bf640 1 Processor -- start 2023-10-03T19:13:25.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.888+0000 7fee865bf640 1 -- start start 2023-10-03T19:13:25.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.892+0000 7fee865bf640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee6c0069e0 0x7fee8014ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:25.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.892+0000 7fee865bf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee800b54e0 0x7fee8014dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:25.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.892+0000 7fee865bf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee8014f3e0 0x7fee801df320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:25.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.892+0000 7fee865bf640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee800b6330 con 0x7fee8014f3e0 2023-10-03T19:13:25.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.892+0000 7fee865bf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee800b5fc0 con 0x7fee800b54e0 2023-10-03T19:13:25.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.892+0000 7fee865bf640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee8014e6c0 con 0x7fee6c0069e0 2023-10-03T19:13:25.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.892+0000 7fee84b5c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee8014f3e0 0x7fee801df320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:25.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.892+0000 7fee7f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee800b54e0 0x7fee8014dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:25.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.892+0000 7fee84b5c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee8014f3e0 0x7fee801df320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54070/0 (socket says 172.21.15.45:54070) 2023-10-03T19:13:25.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.892+0000 7fee84b5c640 1 -- 172.21.15.45:0/1499371500 learned_addr learned my addr 172.21.15.45:0/1499371500 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:25.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.892+0000 7fee7ffff640 1 --2- 172.21.15.45:0/1499371500 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee6c0069e0 0x7fee8014ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:25.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.892+0000 7fee84b5c640 1 -- 172.21.15.45:0/1499371500 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee6c0069e0 msgr2=0x7fee8014ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:25.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.892+0000 7fee84b5c640 1 --2- 172.21.15.45:0/1499371500 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee6c0069e0 0x7fee8014ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.892+0000 7fee84b5c640 1 -- 172.21.15.45:0/1499371500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee800b54e0 msgr2=0x7fee8014dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:25.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.892+0000 7fee84b5c640 1 --2- 172.21.15.45:0/1499371500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee800b54e0 0x7fee8014dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:25.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.892+0000 7fee84b5c640 1 -- 172.21.15.45:0/1499371500 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee800a3880 con 0x7fee8014f3e0 2023-10-03T19:13:25.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.892+0000 7fee84b5c640 1 --2- 172.21.15.45:0/1499371500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee8014f3e0 0x7fee801df320 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fee8006efa0 tx=0x7fee7800e830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:25.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.892+0000 7fee7cff9640 1 -- 172.21.15.45:0/1499371500 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7800eca0 con 0x7fee8014f3e0 2023-10-03T19:13:25.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.892+0000 7fee7cff9640 1 -- 172.21.15.45:0/1499371500 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7800ee20 con 0x7fee8014f3e0 2023-10-03T19:13:25.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.892+0000 7fee7cff9640 1 -- 172.21.15.45:0/1499371500 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee78004270 con 0x7fee8014f3e0 2023-10-03T19:13:25.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.892+0000 7fee865bf640 1 -- 172.21.15.45:0/1499371500 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee80148f60 con 0x7fee8014f3e0 2023-10-03T19:13:25.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.892+0000 7fee865bf640 1 -- 172.21.15.45:0/1499371500 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee800a3c30 con 0x7fee8014f3e0 2023-10-03T19:13:25.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.892+0000 7fee865bf640 1 -- 172.21.15.45:0/1499371500 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee8004de80 con 0x7fee8014f3e0 2023-10-03T19:13:25.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.892+0000 7fee7cff9640 1 -- 172.21.15.45:0/1499371500 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fee780043d0 con 0x7fee8014f3e0 2023-10-03T19:13:25.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.892+0000 7fee7cff9640 1 --2- 172.21.15.45:0/1499371500 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fee600662b0 0x7fee60068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:25.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.896+0000 7fee7cff9640 1 -- 172.21.15.45:0/1499371500 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fee78082e60 con 0x7fee8014f3e0 2023-10-03T19:13:25.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.896+0000 7fee7ffff640 1 --2- 172.21.15.45:0/1499371500 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fee600662b0 0x7fee60068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:25.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.896+0000 7fee7ffff640 1 --2- 172.21.15.45:0/1499371500 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fee600662b0 0x7fee60068760 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fee70001340 tx=0x7fee70009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:25.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:25.900+0000 7fee7cff9640 1 -- 172.21.15.45:0/1499371500 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fee780502f0 con 0x7fee8014f3e0 2023-10-03T19:13:26.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.048+0000 7fee865bf640 1 -- 172.21.15.45:0/1499371500 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fee800be250 con 0x7fee600662b0 2023-10-03T19:13:26.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.072+0000 7fee7cff9640 1 -- 172.21.15.45:0/1499371500 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+298804 (secure 0 0 0) 0x7fee800be250 con 0x7fee600662b0 2023-10-03T19:13:26.078 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:13:26.080 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:13:26.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.072+0000 7fee865bf640 1 -- 172.21.15.45:0/1499371500 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fee600662b0 msgr2=0x7fee60068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:26.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.072+0000 7fee865bf640 1 --2- 172.21.15.45:0/1499371500 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fee600662b0 0x7fee60068760 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fee70001340 tx=0x7fee70009040 comp rx=0 tx=0).stop 2023-10-03T19:13:26.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.072+0000 7fee865bf640 1 -- 172.21.15.45:0/1499371500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee8014f3e0 msgr2=0x7fee801df320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:26.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.072+0000 7fee865bf640 1 --2- 172.21.15.45:0/1499371500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee8014f3e0 0x7fee801df320 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fee8006efa0 tx=0x7fee7800e830 comp rx=0 tx=0).stop 2023-10-03T19:13:26.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.072+0000 7fee865bf640 1 -- 172.21.15.45:0/1499371500 shutdown_connections 2023-10-03T19:13:26.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.072+0000 7fee865bf640 1 --2- 172.21.15.45:0/1499371500 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fee600662b0 0x7fee60068760 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:26.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.072+0000 7fee865bf640 1 --2- 172.21.15.45:0/1499371500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee8014f3e0 0x7fee801df320 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:26.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.072+0000 7fee865bf640 1 --2- 172.21.15.45:0/1499371500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee800b54e0 0x7fee8014dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:26.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.072+0000 7fee865bf640 1 --2- 172.21.15.45:0/1499371500 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee6c0069e0 0x7fee8014ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:26.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.072+0000 7fee865bf640 1 -- 172.21.15.45:0/1499371500 >> 172.21.15.45:0/1499371500 conn(0x7fee800bcf50 msgr2=0x7fee800bf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:26.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.072+0000 7fee865bf640 1 -- 172.21.15.45:0/1499371500 shutdown_connections 2023-10-03T19:13:26.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.072+0000 7fee865bf640 1 -- 172.21.15.45:0/1499371500 wait complete. 2023-10-03T19:13:26.094 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2023-10-03T19:13:24.459943+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591132,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":194,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":143,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":79568,"kb_used_data":3088,"kb_used_omap":0,"kb_used_meta":76416,"kb_avail":754895152,"statfs":{"total":773094113280,"available":773012635648,"internally_reserved":0,"allocated":3162112,"data_stored":2414252,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":78249984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":71,"apply_latency_ms":71,"commit_latency_ns":71000000,"apply_latency_ns":71000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":764,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.547947"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-03T19:13:20.946816+0000","last_change":"2023-10-03T19:13:20.946816+0000","last_active":"2023-10-03T19:13:20.908525+0000","last_peered":"2023-10-03T19:13:20.908525+0000","last_clean":"2023-10-03T19:13:20.908525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:13:20.946816+0000","last_undegraded":"2023-10-03T19:13:20.946816+0000","last_fullsized":"2023-10-03T19:13:20.946816+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-03T19:13:20.946605+0000","last_change":"2023-10-03T19:13:20.946605+0000","last_active":"2023-10-03T19:13:20.908525+0000","last_peered":"2023-10-03T19:13:20.908525+0000","last_clean":"2023-10-03T19:13:20.908525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:13:20.946605+0000","last_undegraded":"2023-10-03T19:13:20.946605+0000","last_fullsized":"2023-10-03T19:13:20.946605+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344409+0000","last_change":"2023-10-03T19:13:21.385258+0000","last_active":"2023-10-03T19:13:23.344409+0000","last_peered":"2023-10-03T19:13:23.344409+0000","last_clean":"2023-10-03T19:13:23.344409+0000","last_became_active":"2023-10-03T19:13:21.384907+0000","last_became_peered":"2023-10-03T19:13:21.384907+0000","last_unstale":"2023-10-03T19:13:23.344409+0000","last_undegraded":"2023-10-03T19:13:23.344409+0000","last_fullsized":"2023-10-03T19:13:23.344409+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:00:58.500162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.365163+0000","last_change":"2023-10-03T19:13:21.364377+0000","last_active":"2023-10-03T19:13:21.365163+0000","last_peered":"2023-10-03T19:13:21.365163+0000","last_clean":"2023-10-03T19:13:21.365163+0000","last_became_active":"2023-10-03T19:13:21.364029+0000","last_became_peered":"2023-10-03T19:13:21.364029+0000","last_unstale":"2023-10-03T19:13:21.365163+0000","last_undegraded":"2023-10-03T19:13:21.365163+0000","last_fullsized":"2023-10-03T19:13:21.365163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:28:09.213667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.364572+0000","last_change":"2023-10-03T19:13:21.363282+0000","last_active":"2023-10-03T19:13:21.364572+0000","last_peered":"2023-10-03T19:13:21.364572+0000","last_clean":"2023-10-03T19:13:21.364572+0000","last_became_active":"2023-10-03T19:13:21.362984+0000","last_became_peered":"2023-10-03T19:13:21.362984+0000","last_unstale":"2023-10-03T19:13:21.364572+0000","last_undegraded":"2023-10-03T19:13:21.364572+0000","last_fullsized":"2023-10-03T19:13:21.364572+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:19:43.624473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.339533+0000","last_change":"2023-10-03T19:13:21.336852+0000","last_active":"2023-10-03T19:13:21.339533+0000","last_peered":"2023-10-03T19:13:21.339533+0000","last_clean":"2023-10-03T19:13:21.339533+0000","last_became_active":"2023-10-03T19:13:21.336505+0000","last_became_peered":"2023-10-03T19:13:21.336505+0000","last_unstale":"2023-10-03T19:13:21.339533+0000","last_undegraded":"2023-10-03T19:13:21.339533+0000","last_fullsized":"2023-10-03T19:13:21.339533+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:39:44.903301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.331242+0000","last_change":"2023-10-03T19:13:21.386226+0000","last_active":"2023-10-03T19:13:22.331242+0000","last_peered":"2023-10-03T19:13:22.331242+0000","last_clean":"2023-10-03T19:13:22.331242+0000","last_became_active":"2023-10-03T19:13:21.381498+0000","last_became_peered":"2023-10-03T19:13:21.381498+0000","last_unstale":"2023-10-03T19:13:22.331242+0000","last_undegraded":"2023-10-03T19:13:22.331242+0000","last_fullsized":"2023-10-03T19:13:22.331242+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:05:10.879452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-03T19:13:20.946219+0000","last_change":"2023-10-03T19:13:20.946219+0000","last_active":"2023-10-03T19:13:20.908525+0000","last_peered":"2023-10-03T19:13:20.908525+0000","last_clean":"2023-10-03T19:13:20.908525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:13:20.946219+0000","last_undegraded":"2023-10-03T19:13:20.946219+0000","last_fullsized":"2023-10-03T19:13:20.946219+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344660+0000","last_change":"2023-10-03T19:13:21.379630+0000","last_active":"2023-10-03T19:13:23.344660+0000","last_peered":"2023-10-03T19:13:23.344660+0000","last_clean":"2023-10-03T19:13:23.344660+0000","last_became_active":"2023-10-03T19:13:21.379337+0000","last_became_peered":"2023-10-03T19:13:21.379337+0000","last_unstale":"2023-10-03T19:13:23.344660+0000","last_undegraded":"2023-10-03T19:13:23.344660+0000","last_fullsized":"2023-10-03T19:13:23.344660+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:05:21.993046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.333045+0000","last_change":"2023-10-03T19:13:21.387777+0000","last_active":"2023-10-03T19:13:22.333045+0000","last_peered":"2023-10-03T19:13:22.333045+0000","last_clean":"2023-10-03T19:13:22.333045+0000","last_became_active":"2023-10-03T19:13:21.387128+0000","last_became_peered":"2023-10-03T19:13:21.387128+0000","last_unstale":"2023-10-03T19:13:22.333045+0000","last_undegraded":"2023-10-03T19:13:22.333045+0000","last_fullsized":"2023-10-03T19:13:22.333045+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:33:35.559553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332600+0000","last_change":"2023-10-03T19:13:21.381901+0000","last_active":"2023-10-03T19:13:22.332600+0000","last_peered":"2023-10-03T19:13:22.332600+0000","last_clean":"2023-10-03T19:13:22.332600+0000","last_became_active":"2023-10-03T19:13:21.380706+0000","last_became_peered":"2023-10-03T19:13:21.380706+0000","last_unstale":"2023-10-03T19:13:22.332600+0000","last_undegraded":"2023-10-03T19:13:22.332600+0000","last_fullsized":"2023-10-03T19:13:22.332600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:12:39.485705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344538+0000","last_change":"2023-10-03T19:13:21.337436+0000","last_active":"2023-10-03T19:13:23.344538+0000","last_peered":"2023-10-03T19:13:23.344538+0000","last_clean":"2023-10-03T19:13:23.344538+0000","last_became_active":"2023-10-03T19:13:21.337123+0000","last_became_peered":"2023-10-03T19:13:21.337123+0000","last_unstale":"2023-10-03T19:13:23.344538+0000","last_undegraded":"2023-10-03T19:13:23.344538+0000","last_fullsized":"2023-10-03T19:13:23.344538+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:16:02.368990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332506+0000","last_change":"2023-10-03T19:13:21.387101+0000","last_active":"2023-10-03T19:13:22.332506+0000","last_peered":"2023-10-03T19:13:22.332506+0000","last_clean":"2023-10-03T19:13:22.332506+0000","last_became_active":"2023-10-03T19:13:21.386571+0000","last_became_peered":"2023-10-03T19:13:21.386571+0000","last_unstale":"2023-10-03T19:13:22.332506+0000","last_undegraded":"2023-10-03T19:13:22.332506+0000","last_fullsized":"2023-10-03T19:13:22.332506+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:48:36.421606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.382081+0000","last_change":"2023-10-03T19:13:21.365622+0000","last_active":"2023-10-03T19:13:21.382081+0000","last_peered":"2023-10-03T19:13:21.382081+0000","last_clean":"2023-10-03T19:13:21.382081+0000","last_became_active":"2023-10-03T19:13:21.364997+0000","last_became_peered":"2023-10-03T19:13:21.364997+0000","last_unstale":"2023-10-03T19:13:21.382081+0000","last_undegraded":"2023-10-03T19:13:21.382081+0000","last_fullsized":"2023-10-03T19:13:21.382081+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:50:20.193476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.331431+0000","last_change":"2023-10-03T19:13:21.382122+0000","last_active":"2023-10-03T19:13:22.331431+0000","last_peered":"2023-10-03T19:13:22.331431+0000","last_clean":"2023-10-03T19:13:22.331431+0000","last_became_active":"2023-10-03T19:13:21.380853+0000","last_became_peered":"2023-10-03T19:13:21.380853+0000","last_unstale":"2023-10-03T19:13:22.331431+0000","last_undegraded":"2023-10-03T19:13:22.331431+0000","last_fullsized":"2023-10-03T19:13:22.331431+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:12:09.744127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388977+0000","last_change":"2023-10-03T19:13:21.382147+0000","last_active":"2023-10-03T19:13:21.388977+0000","last_peered":"2023-10-03T19:13:21.388977+0000","last_clean":"2023-10-03T19:13:21.388977+0000","last_became_active":"2023-10-03T19:13:21.381614+0000","last_became_peered":"2023-10-03T19:13:21.381614+0000","last_unstale":"2023-10-03T19:13:21.388977+0000","last_undegraded":"2023-10-03T19:13:21.388977+0000","last_fullsized":"2023-10-03T19:13:21.388977+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:03:08.567828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.393291+0000","last_change":"2023-10-03T19:13:21.391132+0000","last_active":"2023-10-03T19:13:21.393291+0000","last_peered":"2023-10-03T19:13:21.393291+0000","last_clean":"2023-10-03T19:13:21.393291+0000","last_became_active":"2023-10-03T19:13:21.390626+0000","last_became_peered":"2023-10-03T19:13:21.390626+0000","last_unstale":"2023-10-03T19:13:21.393291+0000","last_undegraded":"2023-10-03T19:13:21.393291+0000","last_fullsized":"2023-10-03T19:13:21.393291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:52:31.490114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.376272+0000","last_change":"2023-10-03T19:13:21.369754+0000","last_active":"2023-10-03T19:13:21.376272+0000","last_peered":"2023-10-03T19:13:21.376272+0000","last_clean":"2023-10-03T19:13:21.376272+0000","last_became_active":"2023-10-03T19:13:21.368680+0000","last_became_peered":"2023-10-03T19:13:21.368680+0000","last_unstale":"2023-10-03T19:13:21.376272+0000","last_undegraded":"2023-10-03T19:13:21.376272+0000","last_fullsized":"2023-10-03T19:13:21.376272+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:38:54.659714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.338097+0000","last_change":"2023-10-03T19:13:21.332782+0000","last_active":"2023-10-03T19:13:21.338097+0000","last_peered":"2023-10-03T19:13:21.338097+0000","last_clean":"2023-10-03T19:13:21.338097+0000","last_became_active":"2023-10-03T19:13:21.332537+0000","last_became_peered":"2023-10-03T19:13:21.332537+0000","last_unstale":"2023-10-03T19:13:21.338097+0000","last_undegraded":"2023-10-03T19:13:21.338097+0000","last_fullsized":"2023-10-03T19:13:21.338097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:39:33.232842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.369427+0000","last_change":"2023-10-03T19:13:21.366160+0000","last_active":"2023-10-03T19:13:21.369427+0000","last_peered":"2023-10-03T19:13:21.369427+0000","last_clean":"2023-10-03T19:13:21.369427+0000","last_became_active":"2023-10-03T19:13:21.365568+0000","last_became_peered":"2023-10-03T19:13:21.365568+0000","last_unstale":"2023-10-03T19:13:21.369427+0000","last_undegraded":"2023-10-03T19:13:21.369427+0000","last_fullsized":"2023-10-03T19:13:21.369427+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:48:02.179860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332079+0000","last_change":"2023-10-03T19:13:21.380192+0000","last_active":"2023-10-03T19:13:22.332079+0000","last_peered":"2023-10-03T19:13:22.332079+0000","last_clean":"2023-10-03T19:13:22.332079+0000","last_became_active":"2023-10-03T19:13:21.379452+0000","last_became_peered":"2023-10-03T19:13:21.379452+0000","last_unstale":"2023-10-03T19:13:22.332079+0000","last_undegraded":"2023-10-03T19:13:22.332079+0000","last_fullsized":"2023-10-03T19:13:22.332079+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:10:18.652000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.382002+0000","last_change":"2023-10-03T19:13:21.362845+0000","last_active":"2023-10-03T19:13:21.382002+0000","last_peered":"2023-10-03T19:13:21.382002+0000","last_clean":"2023-10-03T19:13:21.382002+0000","last_became_active":"2023-10-03T19:13:21.361610+0000","last_became_peered":"2023-10-03T19:13:21.361610+0000","last_unstale":"2023-10-03T19:13:21.382002+0000","last_undegraded":"2023-10-03T19:13:21.382002+0000","last_fullsized":"2023-10-03T19:13:21.382002+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:19:45.728456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388429+0000","last_change":"2023-10-03T19:13:21.371753+0000","last_active":"2023-10-03T19:13:21.388429+0000","last_peered":"2023-10-03T19:13:21.388429+0000","last_clean":"2023-10-03T19:13:21.388429+0000","last_became_active":"2023-10-03T19:13:21.370040+0000","last_became_peered":"2023-10-03T19:13:21.370040+0000","last_unstale":"2023-10-03T19:13:21.388429+0000","last_undegraded":"2023-10-03T19:13:21.388429+0000","last_fullsized":"2023-10-03T19:13:21.388429+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:21:52.323037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.370133+0000","last_change":"2023-10-03T19:13:21.368517+0000","last_active":"2023-10-03T19:13:21.370133+0000","last_peered":"2023-10-03T19:13:21.370133+0000","last_clean":"2023-10-03T19:13:21.370133+0000","last_became_active":"2023-10-03T19:13:21.368223+0000","last_became_peered":"2023-10-03T19:13:21.368223+0000","last_unstale":"2023-10-03T19:13:21.370133+0000","last_undegraded":"2023-10-03T19:13:21.370133+0000","last_fullsized":"2023-10-03T19:13:21.370133+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:44:21.225478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.361781+0000","last_change":"2023-10-03T19:13:21.340602+0000","last_active":"2023-10-03T19:13:21.361781+0000","last_peered":"2023-10-03T19:13:21.361781+0000","last_clean":"2023-10-03T19:13:21.361781+0000","last_became_active":"2023-10-03T19:13:21.338940+0000","last_became_peered":"2023-10-03T19:13:21.338940+0000","last_unstale":"2023-10-03T19:13:21.361781+0000","last_undegraded":"2023-10-03T19:13:21.361781+0000","last_fullsized":"2023-10-03T19:13:21.361781+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:18:54.472816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.372433+0000","last_change":"2023-10-03T19:13:21.371393+0000","last_active":"2023-10-03T19:13:21.372433+0000","last_peered":"2023-10-03T19:13:21.372433+0000","last_clean":"2023-10-03T19:13:21.372433+0000","last_became_active":"2023-10-03T19:13:21.371075+0000","last_became_peered":"2023-10-03T19:13:21.371075+0000","last_unstale":"2023-10-03T19:13:21.372433+0000","last_undegraded":"2023-10-03T19:13:21.372433+0000","last_fullsized":"2023-10-03T19:13:21.372433+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:09:25.508263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.362808+0000","last_change":"2023-10-03T19:13:21.341738+0000","last_active":"2023-10-03T19:13:21.362808+0000","last_peered":"2023-10-03T19:13:21.362808+0000","last_clean":"2023-10-03T19:13:21.362808+0000","last_became_active":"2023-10-03T19:13:21.340877+0000","last_became_peered":"2023-10-03T19:13:21.340877+0000","last_unstale":"2023-10-03T19:13:21.362808+0000","last_undegraded":"2023-10-03T19:13:21.362808+0000","last_fullsized":"2023-10-03T19:13:21.362808+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:50:45.720443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332435+0000","last_change":"2023-10-03T19:13:21.363972+0000","last_active":"2023-10-03T19:13:22.332435+0000","last_peered":"2023-10-03T19:13:22.332435+0000","last_clean":"2023-10-03T19:13:22.332435+0000","last_became_active":"2023-10-03T19:13:21.363452+0000","last_became_peered":"2023-10-03T19:13:21.363452+0000","last_unstale":"2023-10-03T19:13:22.332435+0000","last_undegraded":"2023-10-03T19:13:22.332435+0000","last_fullsized":"2023-10-03T19:13:22.332435+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:56:31.353897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.353062+0000","last_change":"2023-10-03T19:13:21.334239+0000","last_active":"2023-10-03T19:13:21.353062+0000","last_peered":"2023-10-03T19:13:21.353062+0000","last_clean":"2023-10-03T19:13:21.353062+0000","last_became_active":"2023-10-03T19:13:21.333456+0000","last_became_peered":"2023-10-03T19:13:21.333456+0000","last_unstale":"2023-10-03T19:13:21.353062+0000","last_undegraded":"2023-10-03T19:13:21.353062+0000","last_fullsized":"2023-10-03T19:13:21.353062+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:54:32.970270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.361714+0000","last_change":"2023-10-03T19:13:21.339712+0000","last_active":"2023-10-03T19:13:21.361714+0000","last_peered":"2023-10-03T19:13:21.361714+0000","last_clean":"2023-10-03T19:13:21.361714+0000","last_became_active":"2023-10-03T19:13:21.338930+0000","last_became_peered":"2023-10-03T19:13:21.338930+0000","last_unstale":"2023-10-03T19:13:21.361714+0000","last_undegraded":"2023-10-03T19:13:21.361714+0000","last_fullsized":"2023-10-03T19:13:21.361714+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:52:54.145637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388471+0000","last_change":"2023-10-03T19:13:21.372961+0000","last_active":"2023-10-03T19:13:21.388471+0000","last_peered":"2023-10-03T19:13:21.388471+0000","last_clean":"2023-10-03T19:13:21.388471+0000","last_became_active":"2023-10-03T19:13:21.372269+0000","last_became_peered":"2023-10-03T19:13:21.372269+0000","last_unstale":"2023-10-03T19:13:21.388471+0000","last_undegraded":"2023-10-03T19:13:21.388471+0000","last_fullsized":"2023-10-03T19:13:21.388471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:42:26.752455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.339370+0000","last_change":"2023-10-03T19:13:21.337355+0000","last_active":"2023-10-03T19:13:21.339370+0000","last_peered":"2023-10-03T19:13:21.339370+0000","last_clean":"2023-10-03T19:13:21.339370+0000","last_became_active":"2023-10-03T19:13:21.337084+0000","last_became_peered":"2023-10-03T19:13:21.337084+0000","last_unstale":"2023-10-03T19:13:21.339370+0000","last_undegraded":"2023-10-03T19:13:21.339370+0000","last_fullsized":"2023-10-03T19:13:21.339370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:23:59.311834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.394182+0000","last_change":"2023-10-03T19:13:21.391912+0000","last_active":"2023-10-03T19:13:21.394182+0000","last_peered":"2023-10-03T19:13:21.394182+0000","last_clean":"2023-10-03T19:13:21.394182+0000","last_became_active":"2023-10-03T19:13:21.390545+0000","last_became_peered":"2023-10-03T19:13:21.390545+0000","last_unstale":"2023-10-03T19:13:21.394182+0000","last_undegraded":"2023-10-03T19:13:21.394182+0000","last_fullsized":"2023-10-03T19:13:21.394182+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:38:14.290892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"34'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.377742+0000","last_change":"2023-10-03T19:13:20.969426+0000","last_active":"2023-10-03T19:13:21.377742+0000","last_peered":"2023-10-03T19:13:21.377742+0000","last_clean":"2023-10-03T19:13:21.377742+0000","last_became_active":"2023-10-03T19:13:20.968732+0000","last_became_peered":"2023-10-03T19:13:20.968732+0000","last_unstale":"2023-10-03T19:13:21.377742+0000","last_undegraded":"2023-10-03T19:13:21.377742+0000","last_fullsized":"2023-10-03T19:13:21.377742+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:54:05.602230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.386027+0000","last_change":"2023-10-03T19:13:21.385217+0000","last_active":"2023-10-03T19:13:21.386027+0000","last_peered":"2023-10-03T19:13:21.386027+0000","last_clean":"2023-10-03T19:13:21.386027+0000","last_became_active":"2023-10-03T19:13:21.384926+0000","last_became_peered":"2023-10-03T19:13:21.384926+0000","last_unstale":"2023-10-03T19:13:21.386027+0000","last_undegraded":"2023-10-03T19:13:21.386027+0000","last_fullsized":"2023-10-03T19:13:21.386027+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:43:13.606613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344952+0000","last_change":"2023-10-03T19:13:20.972150+0000","last_active":"2023-10-03T19:13:23.344952+0000","last_peered":"2023-10-03T19:13:23.344952+0000","last_clean":"2023-10-03T19:13:23.344952+0000","last_became_active":"2023-10-03T19:13:20.971821+0000","last_became_peered":"2023-10-03T19:13:20.971821+0000","last_unstale":"2023-10-03T19:13:23.344952+0000","last_undegraded":"2023-10-03T19:13:23.344952+0000","last_fullsized":"2023-10-03T19:13:23.344952+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:46:55.064511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.382104+0000","last_change":"2023-10-03T19:13:21.365006+0000","last_active":"2023-10-03T19:13:21.382104+0000","last_peered":"2023-10-03T19:13:21.382104+0000","last_clean":"2023-10-03T19:13:21.382104+0000","last_became_active":"2023-10-03T19:13:21.364499+0000","last_became_peered":"2023-10-03T19:13:21.364499+0000","last_unstale":"2023-10-03T19:13:21.382104+0000","last_undegraded":"2023-10-03T19:13:21.382104+0000","last_fullsized":"2023-10-03T19:13:21.382104+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:45:17.978390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.359478+0000","last_change":"2023-10-03T19:13:20.950958+0000","last_active":"2023-10-03T19:13:21.359478+0000","last_peered":"2023-10-03T19:13:21.359478+0000","last_clean":"2023-10-03T19:13:21.359478+0000","last_became_active":"2023-10-03T19:13:20.950561+0000","last_became_peered":"2023-10-03T19:13:20.950561+0000","last_unstale":"2023-10-03T19:13:21.359478+0000","last_undegraded":"2023-10-03T19:13:21.359478+0000","last_fullsized":"2023-10-03T19:13:21.359478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:55:54.835749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-03T19:13:20.946012+0000","last_change":"2023-10-03T19:13:20.946012+0000","last_active":"2023-10-03T19:13:20.908525+0000","last_peered":"2023-10-03T19:13:20.908525+0000","last_clean":"2023-10-03T19:13:20.908525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:13:20.946012+0000","last_undegraded":"2023-10-03T19:13:20.946012+0000","last_fullsized":"2023-10-03T19:13:20.946012+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.376007+0000","last_change":"2023-10-03T19:13:20.953487+0000","last_active":"2023-10-03T19:13:21.376007+0000","last_peered":"2023-10-03T19:13:21.376007+0000","last_clean":"2023-10-03T19:13:21.376007+0000","last_became_active":"2023-10-03T19:13:20.952739+0000","last_became_peered":"2023-10-03T19:13:20.952739+0000","last_unstale":"2023-10-03T19:13:21.376007+0000","last_undegraded":"2023-10-03T19:13:21.376007+0000","last_fullsized":"2023-10-03T19:13:21.376007+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:41:26.248555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344143+0000","last_change":"2023-10-03T19:13:21.335933+0000","last_active":"2023-10-03T19:13:23.344143+0000","last_peered":"2023-10-03T19:13:23.344143+0000","last_clean":"2023-10-03T19:13:23.344143+0000","last_became_active":"2023-10-03T19:13:21.335661+0000","last_became_peered":"2023-10-03T19:13:21.335661+0000","last_unstale":"2023-10-03T19:13:23.344143+0000","last_undegraded":"2023-10-03T19:13:23.344143+0000","last_fullsized":"2023-10-03T19:13:23.344143+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:14:24.053747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332061+0000","last_change":"2023-10-03T19:13:20.957478+0000","last_active":"2023-10-03T19:13:22.332061+0000","last_peered":"2023-10-03T19:13:22.332061+0000","last_clean":"2023-10-03T19:13:22.332061+0000","last_became_active":"2023-10-03T19:13:20.956389+0000","last_became_peered":"2023-10-03T19:13:20.956389+0000","last_unstale":"2023-10-03T19:13:22.332061+0000","last_undegraded":"2023-10-03T19:13:22.332061+0000","last_fullsized":"2023-10-03T19:13:22.332061+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:17:04.660877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.331680+0000","last_change":"2023-10-03T19:13:21.380338+0000","last_active":"2023-10-03T19:13:22.331680+0000","last_peered":"2023-10-03T19:13:22.331680+0000","last_clean":"2023-10-03T19:13:22.331680+0000","last_became_active":"2023-10-03T19:13:21.379660+0000","last_became_peered":"2023-10-03T19:13:21.379660+0000","last_unstale":"2023-10-03T19:13:22.331680+0000","last_undegraded":"2023-10-03T19:13:22.331680+0000","last_fullsized":"2023-10-03T19:13:22.331680+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:11:08.676258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.374578+0000","last_change":"2023-10-03T19:13:20.974925+0000","last_active":"2023-10-03T19:13:21.374578+0000","last_peered":"2023-10-03T19:13:21.374578+0000","last_clean":"2023-10-03T19:13:21.374578+0000","last_became_active":"2023-10-03T19:13:20.974368+0000","last_became_peered":"2023-10-03T19:13:20.974368+0000","last_unstale":"2023-10-03T19:13:21.374578+0000","last_undegraded":"2023-10-03T19:13:21.374578+0000","last_fullsized":"2023-10-03T19:13:21.374578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:31:41.223618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.383953+0000","last_change":"2023-10-03T19:13:21.379900+0000","last_active":"2023-10-03T19:13:21.383953+0000","last_peered":"2023-10-03T19:13:21.383953+0000","last_clean":"2023-10-03T19:13:21.383953+0000","last_became_active":"2023-10-03T19:13:21.379296+0000","last_became_peered":"2023-10-03T19:13:21.379296+0000","last_unstale":"2023-10-03T19:13:21.383953+0000","last_undegraded":"2023-10-03T19:13:21.383953+0000","last_fullsized":"2023-10-03T19:13:21.383953+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:57:55.230179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.326794+0000","last_change":"2023-10-03T19:13:20.963235+0000","last_active":"2023-10-03T19:13:21.326794+0000","last_peered":"2023-10-03T19:13:21.326794+0000","last_clean":"2023-10-03T19:13:21.326794+0000","last_became_active":"2023-10-03T19:13:20.962810+0000","last_became_peered":"2023-10-03T19:13:20.962810+0000","last_unstale":"2023-10-03T19:13:21.326794+0000","last_undegraded":"2023-10-03T19:13:21.326794+0000","last_fullsized":"2023-10-03T19:13:21.326794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:00:49.525990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-03T19:13:20.948617+0000","last_change":"2023-10-03T19:13:20.948617+0000","last_active":"2023-10-03T19:13:20.908525+0000","last_peered":"2023-10-03T19:13:20.908525+0000","last_clean":"2023-10-03T19:13:20.908525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:13:20.948617+0000","last_undegraded":"2023-10-03T19:13:20.948617+0000","last_fullsized":"2023-10-03T19:13:20.948617+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.348006+0000","last_change":"2023-10-03T19:13:20.970078+0000","last_active":"2023-10-03T19:13:21.348006+0000","last_peered":"2023-10-03T19:13:21.348006+0000","last_clean":"2023-10-03T19:13:21.348006+0000","last_became_active":"2023-10-03T19:13:20.969404+0000","last_became_peered":"2023-10-03T19:13:20.969404+0000","last_unstale":"2023-10-03T19:13:21.348006+0000","last_undegraded":"2023-10-03T19:13:21.348006+0000","last_fullsized":"2023-10-03T19:13:21.348006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:06:40.574599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.365149+0000","last_change":"2023-10-03T19:13:21.364013+0000","last_active":"2023-10-03T19:13:21.365149+0000","last_peered":"2023-10-03T19:13:21.365149+0000","last_clean":"2023-10-03T19:13:21.365149+0000","last_became_active":"2023-10-03T19:13:21.363513+0000","last_became_peered":"2023-10-03T19:13:21.363513+0000","last_unstale":"2023-10-03T19:13:21.365149+0000","last_undegraded":"2023-10-03T19:13:21.365149+0000","last_fullsized":"2023-10-03T19:13:21.365149+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:37:09.701876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-03T19:13:20.967365+0000","last_change":"2023-10-03T19:13:20.952503+0000","last_active":"2023-10-03T19:13:20.967365+0000","last_peered":"2023-10-03T19:13:20.967365+0000","last_clean":"2023-10-03T19:13:20.967365+0000","last_became_active":"2023-10-03T19:13:20.951828+0000","last_became_peered":"2023-10-03T19:13:20.951828+0000","last_unstale":"2023-10-03T19:13:20.967365+0000","last_undegraded":"2023-10-03T19:13:20.967365+0000","last_fullsized":"2023-10-03T19:13:20.967365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:43:12.595096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388642+0000","last_change":"2023-10-03T19:13:21.376107+0000","last_active":"2023-10-03T19:13:21.388642+0000","last_peered":"2023-10-03T19:13:21.388642+0000","last_clean":"2023-10-03T19:13:21.388642+0000","last_became_active":"2023-10-03T19:13:21.373484+0000","last_became_peered":"2023-10-03T19:13:21.373484+0000","last_unstale":"2023-10-03T19:13:21.388642+0000","last_undegraded":"2023-10-03T19:13:21.388642+0000","last_fullsized":"2023-10-03T19:13:21.388642+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:10:43.840486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.333208+0000","last_change":"2023-10-03T19:13:20.960847+0000","last_active":"2023-10-03T19:13:22.333208+0000","last_peered":"2023-10-03T19:13:22.333208+0000","last_clean":"2023-10-03T19:13:22.333208+0000","last_became_active":"2023-10-03T19:13:20.960078+0000","last_became_peered":"2023-10-03T19:13:20.960078+0000","last_unstale":"2023-10-03T19:13:22.333208+0000","last_undegraded":"2023-10-03T19:13:22.333208+0000","last_fullsized":"2023-10-03T19:13:22.333208+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:14:11.662112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344788+0000","last_change":"2023-10-03T19:13:21.370395+0000","last_active":"2023-10-03T19:13:23.344788+0000","last_peered":"2023-10-03T19:13:23.344788+0000","last_clean":"2023-10-03T19:13:23.344788+0000","last_became_active":"2023-10-03T19:13:21.370113+0000","last_became_peered":"2023-10-03T19:13:21.370113+0000","last_unstale":"2023-10-03T19:13:23.344788+0000","last_undegraded":"2023-10-03T19:13:23.344788+0000","last_fullsized":"2023-10-03T19:13:23.344788+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:47:43.653717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"34'3","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332813+0000","last_change":"2023-10-03T19:13:20.961265+0000","last_active":"2023-10-03T19:13:22.332813+0000","last_peered":"2023-10-03T19:13:22.332813+0000","last_clean":"2023-10-03T19:13:22.332813+0000","last_became_active":"2023-10-03T19:13:20.959393+0000","last_became_peered":"2023-10-03T19:13:20.959393+0000","last_unstale":"2023-10-03T19:13:22.332813+0000","last_undegraded":"2023-10-03T19:13:22.332813+0000","last_fullsized":"2023-10-03T19:13:22.332813+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:40:36.494610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.382201+0000","last_change":"2023-10-03T19:13:21.362691+0000","last_active":"2023-10-03T19:13:21.382201+0000","last_peered":"2023-10-03T19:13:21.382201+0000","last_clean":"2023-10-03T19:13:21.382201+0000","last_became_active":"2023-10-03T19:13:21.361488+0000","last_became_peered":"2023-10-03T19:13:21.361488+0000","last_unstale":"2023-10-03T19:13:21.382201+0000","last_undegraded":"2023-10-03T19:13:21.382201+0000","last_fullsized":"2023-10-03T19:13:21.382201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:53:21.733701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-03T19:13:20.974287+0000","last_change":"2023-10-03T19:13:20.972865+0000","last_active":"2023-10-03T19:13:20.974287+0000","last_peered":"2023-10-03T19:13:20.974287+0000","last_clean":"2023-10-03T19:13:20.974287+0000","last_became_active":"2023-10-03T19:13:20.972358+0000","last_became_peered":"2023-10-03T19:13:20.972358+0000","last_unstale":"2023-10-03T19:13:20.974287+0000","last_undegraded":"2023-10-03T19:13:20.974287+0000","last_fullsized":"2023-10-03T19:13:20.974287+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:43:54.362050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344127+0000","last_change":"2023-10-03T19:13:21.361649+0000","last_active":"2023-10-03T19:13:23.344127+0000","last_peered":"2023-10-03T19:13:23.344127+0000","last_clean":"2023-10-03T19:13:23.344127+0000","last_became_active":"2023-10-03T19:13:21.361411+0000","last_became_peered":"2023-10-03T19:13:21.361411+0000","last_unstale":"2023-10-03T19:13:23.344127+0000","last_undegraded":"2023-10-03T19:13:23.344127+0000","last_fullsized":"2023-10-03T19:13:23.344127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:57:14.066081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-03T19:13:20.967555+0000","last_change":"2023-10-03T19:13:20.964862+0000","last_active":"2023-10-03T19:13:20.967555+0000","last_peered":"2023-10-03T19:13:20.967555+0000","last_clean":"2023-10-03T19:13:20.967555+0000","last_became_active":"2023-10-03T19:13:20.964523+0000","last_became_peered":"2023-10-03T19:13:20.964523+0000","last_unstale":"2023-10-03T19:13:20.967555+0000","last_undegraded":"2023-10-03T19:13:20.967555+0000","last_fullsized":"2023-10-03T19:13:20.967555+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:25:57.148818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-03T19:13:20.943585+0000","last_change":"2023-10-03T19:13:20.943585+0000","last_active":"2023-10-03T19:13:20.908525+0000","last_peered":"2023-10-03T19:13:20.908525+0000","last_clean":"2023-10-03T19:13:20.908525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:13:20.943585+0000","last_undegraded":"2023-10-03T19:13:20.943585+0000","last_fullsized":"2023-10-03T19:13:20.943585+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.326593+0000","last_change":"2023-10-03T19:13:20.962572+0000","last_active":"2023-10-03T19:13:21.326593+0000","last_peered":"2023-10-03T19:13:21.326593+0000","last_clean":"2023-10-03T19:13:21.326593+0000","last_became_active":"2023-10-03T19:13:20.962094+0000","last_became_peered":"2023-10-03T19:13:20.962094+0000","last_unstale":"2023-10-03T19:13:21.326593+0000","last_undegraded":"2023-10-03T19:13:21.326593+0000","last_fullsized":"2023-10-03T19:13:21.326593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:43:54.362050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388247+0000","last_change":"2023-10-03T19:13:21.371030+0000","last_active":"2023-10-03T19:13:21.388247+0000","last_peered":"2023-10-03T19:13:21.388247+0000","last_clean":"2023-10-03T19:13:21.388247+0000","last_became_active":"2023-10-03T19:13:21.369954+0000","last_became_peered":"2023-10-03T19:13:21.369954+0000","last_unstale":"2023-10-03T19:13:21.388247+0000","last_undegraded":"2023-10-03T19:13:21.388247+0000","last_fullsized":"2023-10-03T19:13:21.388247+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:19:02.156799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.328519+0000","last_change":"2023-10-03T19:13:20.967774+0000","last_active":"2023-10-03T19:13:21.328519+0000","last_peered":"2023-10-03T19:13:21.328519+0000","last_clean":"2023-10-03T19:13:21.328519+0000","last_became_active":"2023-10-03T19:13:20.965529+0000","last_became_peered":"2023-10-03T19:13:20.965529+0000","last_unstale":"2023-10-03T19:13:21.328519+0000","last_undegraded":"2023-10-03T19:13:21.328519+0000","last_fullsized":"2023-10-03T19:13:21.328519+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:17:30.367274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-03T19:13:20.947840+0000","last_change":"2023-10-03T19:13:20.947840+0000","last_active":"2023-10-03T19:13:20.908525+0000","last_peered":"2023-10-03T19:13:20.908525+0000","last_clean":"2023-10-03T19:13:20.908525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:13:20.947840+0000","last_undegraded":"2023-10-03T19:13:20.947840+0000","last_fullsized":"2023-10-03T19:13:20.947840+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"34'8","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.382682+0000","last_change":"2023-10-03T19:13:20.975023+0000","last_active":"2023-10-03T19:13:21.382682+0000","last_peered":"2023-10-03T19:13:21.382682+0000","last_clean":"2023-10-03T19:13:21.382682+0000","last_became_active":"2023-10-03T19:13:20.973808+0000","last_became_peered":"2023-10-03T19:13:20.973808+0000","last_unstale":"2023-10-03T19:13:21.382682+0000","last_undegraded":"2023-10-03T19:13:21.382682+0000","last_fullsized":"2023-10-03T19:13:21.382682+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:39:54.101849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-03T19:13:20.942312+0000","last_change":"2023-10-03T19:13:20.942312+0000","last_active":"2023-10-03T19:13:20.908525+0000","last_peered":"2023-10-03T19:13:20.908525+0000","last_clean":"2023-10-03T19:13:20.908525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:13:20.942312+0000","last_undegraded":"2023-10-03T19:13:20.942312+0000","last_fullsized":"2023-10-03T19:13:20.942312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.333263+0000","last_change":"2023-10-03T19:13:20.957758+0000","last_active":"2023-10-03T19:13:22.333263+0000","last_peered":"2023-10-03T19:13:22.333263+0000","last_clean":"2023-10-03T19:13:22.333263+0000","last_became_active":"2023-10-03T19:13:20.957023+0000","last_became_peered":"2023-10-03T19:13:20.957023+0000","last_unstale":"2023-10-03T19:13:22.333263+0000","last_undegraded":"2023-10-03T19:13:22.333263+0000","last_fullsized":"2023-10-03T19:13:22.333263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:36:11.572563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332770+0000","last_change":"2023-10-03T19:13:21.386225+0000","last_active":"2023-10-03T19:13:22.332770+0000","last_peered":"2023-10-03T19:13:22.332770+0000","last_clean":"2023-10-03T19:13:22.332770+0000","last_became_active":"2023-10-03T19:13:21.381348+0000","last_became_peered":"2023-10-03T19:13:21.381348+0000","last_unstale":"2023-10-03T19:13:22.332770+0000","last_undegraded":"2023-10-03T19:13:22.332770+0000","last_fullsized":"2023-10-03T19:13:22.332770+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:59:12.814362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.391164+0000","last_change":"2023-10-03T19:13:20.965203+0000","last_active":"2023-10-03T19:13:21.391164+0000","last_peered":"2023-10-03T19:13:21.391164+0000","last_clean":"2023-10-03T19:13:21.391164+0000","last_became_active":"2023-10-03T19:13:20.963356+0000","last_became_peered":"2023-10-03T19:13:20.963356+0000","last_unstale":"2023-10-03T19:13:21.391164+0000","last_undegraded":"2023-10-03T19:13:21.391164+0000","last_fullsized":"2023-10-03T19:13:21.391164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:41:28.447361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.382600+0000","last_change":"2023-10-03T19:13:21.368113+0000","last_active":"2023-10-03T19:13:21.382600+0000","last_peered":"2023-10-03T19:13:21.382600+0000","last_clean":"2023-10-03T19:13:21.382600+0000","last_became_active":"2023-10-03T19:13:21.367345+0000","last_became_peered":"2023-10-03T19:13:21.367345+0000","last_unstale":"2023-10-03T19:13:21.382600+0000","last_undegraded":"2023-10-03T19:13:21.382600+0000","last_fullsized":"2023-10-03T19:13:21.382600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:26:10.484739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.374764+0000","last_change":"2023-10-03T19:13:20.972574+0000","last_active":"2023-10-03T19:13:21.374764+0000","last_peered":"2023-10-03T19:13:21.374764+0000","last_clean":"2023-10-03T19:13:21.374764+0000","last_became_active":"2023-10-03T19:13:20.972119+0000","last_became_peered":"2023-10-03T19:13:20.972119+0000","last_unstale":"2023-10-03T19:13:21.374764+0000","last_undegraded":"2023-10-03T19:13:21.374764+0000","last_fullsized":"2023-10-03T19:13:21.374764+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:14:08.106459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.341400+0000","last_change":"2023-10-03T19:13:21.339682+0000","last_active":"2023-10-03T19:13:21.341400+0000","last_peered":"2023-10-03T19:13:21.341400+0000","last_clean":"2023-10-03T19:13:21.341400+0000","last_became_active":"2023-10-03T19:13:21.339291+0000","last_became_peered":"2023-10-03T19:13:21.339291+0000","last_unstale":"2023-10-03T19:13:21.341400+0000","last_undegraded":"2023-10-03T19:13:21.341400+0000","last_fullsized":"2023-10-03T19:13:21.341400+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:11:12.253825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.327634+0000","last_change":"2023-10-03T19:13:20.951006+0000","last_active":"2023-10-03T19:13:21.327634+0000","last_peered":"2023-10-03T19:13:21.327634+0000","last_clean":"2023-10-03T19:13:21.327634+0000","last_became_active":"2023-10-03T19:13:20.950606+0000","last_became_peered":"2023-10-03T19:13:20.950606+0000","last_unstale":"2023-10-03T19:13:21.327634+0000","last_undegraded":"2023-10-03T19:13:21.327634+0000","last_fullsized":"2023-10-03T19:13:21.327634+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:03:32.890413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388419+0000","last_change":"2023-10-03T19:13:21.372118+0000","last_active":"2023-10-03T19:13:21.388419+0000","last_peered":"2023-10-03T19:13:21.388419+0000","last_clean":"2023-10-03T19:13:21.388419+0000","last_became_active":"2023-10-03T19:13:21.370009+0000","last_became_peered":"2023-10-03T19:13:21.370009+0000","last_unstale":"2023-10-03T19:13:21.388419+0000","last_undegraded":"2023-10-03T19:13:21.388419+0000","last_fullsized":"2023-10-03T19:13:21.388419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:53:06.561881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.337198+0000","last_change":"2023-10-03T19:13:20.954261+0000","last_active":"2023-10-03T19:13:21.337198+0000","last_peered":"2023-10-03T19:13:21.337198+0000","last_clean":"2023-10-03T19:13:21.337198+0000","last_became_active":"2023-10-03T19:13:20.953905+0000","last_became_peered":"2023-10-03T19:13:20.953905+0000","last_unstale":"2023-10-03T19:13:21.337198+0000","last_undegraded":"2023-10-03T19:13:21.337198+0000","last_fullsized":"2023-10-03T19:13:21.337198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:19:04.380130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344213+0000","last_change":"2023-10-03T19:13:21.372131+0000","last_active":"2023-10-03T19:13:23.344213+0000","last_peered":"2023-10-03T19:13:23.344213+0000","last_clean":"2023-10-03T19:13:23.344213+0000","last_became_active":"2023-10-03T19:13:21.371809+0000","last_became_peered":"2023-10-03T19:13:21.371809+0000","last_unstale":"2023-10-03T19:13:23.344213+0000","last_undegraded":"2023-10-03T19:13:23.344213+0000","last_fullsized":"2023-10-03T19:13:23.344213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:57:40.440963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.320058+0000","last_change":"2023-10-03T19:13:20.960919+0000","last_active":"2023-10-03T19:13:21.320058+0000","last_peered":"2023-10-03T19:13:21.320058+0000","last_clean":"2023-10-03T19:13:21.320058+0000","last_became_active":"2023-10-03T19:13:20.960593+0000","last_became_peered":"2023-10-03T19:13:20.960593+0000","last_unstale":"2023-10-03T19:13:21.320058+0000","last_undegraded":"2023-10-03T19:13:21.320058+0000","last_fullsized":"2023-10-03T19:13:21.320058+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:56:05.170459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332228+0000","last_change":"2023-10-03T19:13:21.365073+0000","last_active":"2023-10-03T19:13:22.332228+0000","last_peered":"2023-10-03T19:13:22.332228+0000","last_clean":"2023-10-03T19:13:22.332228+0000","last_became_active":"2023-10-03T19:13:21.364541+0000","last_became_peered":"2023-10-03T19:13:21.364541+0000","last_unstale":"2023-10-03T19:13:22.332228+0000","last_undegraded":"2023-10-03T19:13:22.332228+0000","last_fullsized":"2023-10-03T19:13:22.332228+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:00:58.829969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.326883+0000","last_change":"2023-10-03T19:13:20.977060+0000","last_active":"2023-10-03T19:13:21.326883+0000","last_peered":"2023-10-03T19:13:21.326883+0000","last_clean":"2023-10-03T19:13:21.326883+0000","last_became_active":"2023-10-03T19:13:20.976504+0000","last_became_peered":"2023-10-03T19:13:20.976504+0000","last_unstale":"2023-10-03T19:13:21.326883+0000","last_undegraded":"2023-10-03T19:13:21.326883+0000","last_fullsized":"2023-10-03T19:13:21.326883+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:48:48.027499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-03T19:13:20.946084+0000","last_change":"2023-10-03T19:13:20.946084+0000","last_active":"2023-10-03T19:13:20.908525+0000","last_peered":"2023-10-03T19:13:20.908525+0000","last_clean":"2023-10-03T19:13:20.908525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:13:20.946084+0000","last_undegraded":"2023-10-03T19:13:20.946084+0000","last_fullsized":"2023-10-03T19:13:20.946084+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.320048+0000","last_change":"2023-10-03T19:13:20.958773+0000","last_active":"2023-10-03T19:13:21.320048+0000","last_peered":"2023-10-03T19:13:21.320048+0000","last_clean":"2023-10-03T19:13:21.320048+0000","last_became_active":"2023-10-03T19:13:20.958365+0000","last_became_peered":"2023-10-03T19:13:20.958365+0000","last_unstale":"2023-10-03T19:13:21.320048+0000","last_undegraded":"2023-10-03T19:13:21.320048+0000","last_fullsized":"2023-10-03T19:13:21.320048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:28:03.119661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332884+0000","last_change":"2023-10-03T19:13:21.392175+0000","last_active":"2023-10-03T19:13:22.332884+0000","last_peered":"2023-10-03T19:13:22.332884+0000","last_clean":"2023-10-03T19:13:22.332884+0000","last_became_active":"2023-10-03T19:13:21.389898+0000","last_became_peered":"2023-10-03T19:13:21.389898+0000","last_unstale":"2023-10-03T19:13:22.332884+0000","last_undegraded":"2023-10-03T19:13:22.332884+0000","last_fullsized":"2023-10-03T19:13:22.332884+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:26:48.120113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.338248+0000","last_change":"2023-10-03T19:13:20.974327+0000","last_active":"2023-10-03T19:13:21.338248+0000","last_peered":"2023-10-03T19:13:21.338248+0000","last_clean":"2023-10-03T19:13:21.338248+0000","last_became_active":"2023-10-03T19:13:20.973755+0000","last_became_peered":"2023-10-03T19:13:20.973755+0000","last_unstale":"2023-10-03T19:13:21.338248+0000","last_undegraded":"2023-10-03T19:13:21.338248+0000","last_fullsized":"2023-10-03T19:13:21.338248+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:53:20.722184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":191,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.326398+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:13:21.326398+0000","last_peered":"2023-10-03T19:13:21.326398+0000","last_clean":"2023-10-03T19:13:21.326398+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:13:21.326398+0000","last_undegraded":"2023-10-03T19:13:21.326398+0000","last_fullsized":"2023-10-03T19:13:21.326398+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:13:03.709387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332331+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:13:22.332331+0000","last_peered":"2023-10-03T19:13:22.332331+0000","last_clean":"2023-10-03T19:13:22.332331+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:13:22.332331+0000","last_undegraded":"2023-10-03T19:13:22.332331+0000","last_fullsized":"2023-10-03T19:13:22.332331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:23:55.753435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.378172+0000","last_change":"2023-10-03T19:13:21.377405+0000","last_active":"2023-10-03T19:13:21.378172+0000","last_peered":"2023-10-03T19:13:21.378172+0000","last_clean":"2023-10-03T19:13:21.378172+0000","last_became_active":"2023-10-03T19:13:21.377187+0000","last_became_peered":"2023-10-03T19:13:21.377187+0000","last_unstale":"2023-10-03T19:13:21.378172+0000","last_undegraded":"2023-10-03T19:13:21.378172+0000","last_fullsized":"2023-10-03T19:13:21.378172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:04:27.975140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.333408+0000","last_change":"2023-10-03T19:13:20.958706+0000","last_active":"2023-10-03T19:13:22.333408+0000","last_peered":"2023-10-03T19:13:22.333408+0000","last_clean":"2023-10-03T19:13:22.333408+0000","last_became_active":"2023-10-03T19:13:20.956435+0000","last_became_peered":"2023-10-03T19:13:20.956435+0000","last_unstale":"2023-10-03T19:13:22.333408+0000","last_undegraded":"2023-10-03T19:13:22.333408+0000","last_fullsized":"2023-10-03T19:13:22.333408+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:04:53.519874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.325293+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:13:21.325293+0000","last_peered":"2023-10-03T19:13:21.325293+0000","last_clean":"2023-10-03T19:13:21.325293+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:13:21.325293+0000","last_undegraded":"2023-10-03T19:13:21.325293+0000","last_fullsized":"2023-10-03T19:13:21.325293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:07:00.971532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388558+0000","last_change":"2023-10-03T19:13:21.374113+0000","last_active":"2023-10-03T19:13:21.388558+0000","last_peered":"2023-10-03T19:13:21.388558+0000","last_clean":"2023-10-03T19:13:21.388558+0000","last_became_active":"2023-10-03T19:13:21.370727+0000","last_became_peered":"2023-10-03T19:13:21.370727+0000","last_unstale":"2023-10-03T19:13:21.388558+0000","last_undegraded":"2023-10-03T19:13:21.388558+0000","last_fullsized":"2023-10-03T19:13:21.388558+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:15:55.983735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.325186+0000","last_change":"2023-10-03T19:13:20.961506+0000","last_active":"2023-10-03T19:13:21.325186+0000","last_peered":"2023-10-03T19:13:21.325186+0000","last_clean":"2023-10-03T19:13:21.325186+0000","last_became_active":"2023-10-03T19:13:20.961101+0000","last_became_peered":"2023-10-03T19:13:20.961101+0000","last_unstale":"2023-10-03T19:13:21.325186+0000","last_undegraded":"2023-10-03T19:13:21.325186+0000","last_fullsized":"2023-10-03T19:13:21.325186+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:08:18.162950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.319655+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:13:21.319655+0000","last_peered":"2023-10-03T19:13:21.319655+0000","last_clean":"2023-10-03T19:13:21.319655+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:13:21.319655+0000","last_undegraded":"2023-10-03T19:13:21.319655+0000","last_fullsized":"2023-10-03T19:13:21.319655+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:04:05.555255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-03T19:13:20.945349+0000","last_change":"2023-10-03T19:13:20.945349+0000","last_active":"2023-10-03T19:13:20.908525+0000","last_peered":"2023-10-03T19:13:20.908525+0000","last_clean":"2023-10-03T19:13:20.908525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:13:20.945349+0000","last_undegraded":"2023-10-03T19:13:20.945349+0000","last_fullsized":"2023-10-03T19:13:20.945349+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344207+0000","last_change":"2023-10-03T19:13:20.951648+0000","last_active":"2023-10-03T19:13:23.344207+0000","last_peered":"2023-10-03T19:13:23.344207+0000","last_clean":"2023-10-03T19:13:23.344207+0000","last_became_active":"2023-10-03T19:13:20.950901+0000","last_became_peered":"2023-10-03T19:13:20.950901+0000","last_unstale":"2023-10-03T19:13:23.344207+0000","last_undegraded":"2023-10-03T19:13:23.344207+0000","last_fullsized":"2023-10-03T19:13:23.344207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:27:55.601869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332066+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:13:22.332066+0000","last_peered":"2023-10-03T19:13:22.332066+0000","last_clean":"2023-10-03T19:13:22.332066+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:13:22.332066+0000","last_undegraded":"2023-10-03T19:13:22.332066+0000","last_fullsized":"2023-10-03T19:13:22.332066+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:11:13.218075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344474+0000","last_change":"2023-10-03T19:13:21.339724+0000","last_active":"2023-10-03T19:13:23.344474+0000","last_peered":"2023-10-03T19:13:23.344474+0000","last_clean":"2023-10-03T19:13:23.344474+0000","last_became_active":"2023-10-03T19:13:21.339332+0000","last_became_peered":"2023-10-03T19:13:21.339332+0000","last_unstale":"2023-10-03T19:13:23.344474+0000","last_undegraded":"2023-10-03T19:13:23.344474+0000","last_fullsized":"2023-10-03T19:13:23.344474+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:01:06.037410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344737+0000","last_change":"2023-10-03T19:13:20.970059+0000","last_active":"2023-10-03T19:13:23.344737+0000","last_peered":"2023-10-03T19:13:23.344737+0000","last_clean":"2023-10-03T19:13:23.344737+0000","last_became_active":"2023-10-03T19:13:20.969451+0000","last_became_peered":"2023-10-03T19:13:20.969451+0000","last_unstale":"2023-10-03T19:13:23.344737+0000","last_undegraded":"2023-10-03T19:13:23.344737+0000","last_fullsized":"2023-10-03T19:13:23.344737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:27:28.531397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.327570+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:13:21.327570+0000","last_peered":"2023-10-03T19:13:21.327570+0000","last_clean":"2023-10-03T19:13:21.327570+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:13:21.327570+0000","last_undegraded":"2023-10-03T19:13:21.327570+0000","last_fullsized":"2023-10-03T19:13:21.327570+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:18:44.840190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.340055+0000","last_change":"2023-10-03T19:13:21.339247+0000","last_active":"2023-10-03T19:13:21.340055+0000","last_peered":"2023-10-03T19:13:21.340055+0000","last_clean":"2023-10-03T19:13:21.340055+0000","last_became_active":"2023-10-03T19:13:21.338947+0000","last_became_peered":"2023-10-03T19:13:21.338947+0000","last_unstale":"2023-10-03T19:13:21.340055+0000","last_undegraded":"2023-10-03T19:13:21.340055+0000","last_fullsized":"2023-10-03T19:13:21.340055+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:25:58.160334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.328948+0000","last_change":"2023-10-03T19:13:20.964605+0000","last_active":"2023-10-03T19:13:21.328948+0000","last_peered":"2023-10-03T19:13:21.328948+0000","last_clean":"2023-10-03T19:13:21.328948+0000","last_became_active":"2023-10-03T19:13:20.963993+0000","last_became_peered":"2023-10-03T19:13:20.963993+0000","last_unstale":"2023-10-03T19:13:21.328948+0000","last_undegraded":"2023-10-03T19:13:21.328948+0000","last_fullsized":"2023-10-03T19:13:21.328948+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:48:12.274201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.331038+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:13:21.331038+0000","last_peered":"2023-10-03T19:13:21.331038+0000","last_clean":"2023-10-03T19:13:21.331038+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:13:21.331038+0000","last_undegraded":"2023-10-03T19:13:21.331038+0000","last_fullsized":"2023-10-03T19:13:21.331038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:32:43.995165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.382046+0000","last_change":"2023-10-03T19:13:21.363349+0000","last_active":"2023-10-03T19:13:21.382046+0000","last_peered":"2023-10-03T19:13:21.382046+0000","last_clean":"2023-10-03T19:13:21.382046+0000","last_became_active":"2023-10-03T19:13:21.362328+0000","last_became_peered":"2023-10-03T19:13:21.362328+0000","last_unstale":"2023-10-03T19:13:21.382046+0000","last_undegraded":"2023-10-03T19:13:21.382046+0000","last_fullsized":"2023-10-03T19:13:21.382046+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:56:03.182827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.347635+0000","last_change":"2023-10-03T19:13:20.954919+0000","last_active":"2023-10-03T19:13:21.347635+0000","last_peered":"2023-10-03T19:13:21.347635+0000","last_clean":"2023-10-03T19:13:21.347635+0000","last_became_active":"2023-10-03T19:13:20.954183+0000","last_became_peered":"2023-10-03T19:13:20.954183+0000","last_unstale":"2023-10-03T19:13:21.347635+0000","last_undegraded":"2023-10-03T19:13:21.347635+0000","last_fullsized":"2023-10-03T19:13:21.347635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:45:23.847643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.327829+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:13:21.327829+0000","last_peered":"2023-10-03T19:13:21.327829+0000","last_clean":"2023-10-03T19:13:21.327829+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:13:21.327829+0000","last_undegraded":"2023-10-03T19:13:21.327829+0000","last_fullsized":"2023-10-03T19:13:21.327829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:38:27.108483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388363+0000","last_change":"2023-10-03T19:13:21.371931+0000","last_active":"2023-10-03T19:13:21.388363+0000","last_peered":"2023-10-03T19:13:21.388363+0000","last_clean":"2023-10-03T19:13:21.388363+0000","last_became_active":"2023-10-03T19:13:21.370833+0000","last_became_peered":"2023-10-03T19:13:21.370833+0000","last_unstale":"2023-10-03T19:13:21.388363+0000","last_undegraded":"2023-10-03T19:13:21.388363+0000","last_fullsized":"2023-10-03T19:13:21.388363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:32:53.308272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-03T19:13:20.967314+0000","last_change":"2023-10-03T19:13:20.952123+0000","last_active":"2023-10-03T19:13:20.967314+0000","last_peered":"2023-10-03T19:13:20.967314+0000","last_clean":"2023-10-03T19:13:20.967314+0000","last_became_active":"2023-10-03T19:13:20.951627+0000","last_became_peered":"2023-10-03T19:13:20.951627+0000","last_unstale":"2023-10-03T19:13:20.967314+0000","last_undegraded":"2023-10-03T19:13:20.967314+0000","last_fullsized":"2023-10-03T19:13:20.967314+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:39:43.891784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.330387+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:13:21.330387+0000","last_peered":"2023-10-03T19:13:21.330387+0000","last_clean":"2023-10-03T19:13:21.330387+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:13:21.330387+0000","last_undegraded":"2023-10-03T19:13:21.330387+0000","last_fullsized":"2023-10-03T19:13:21.330387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:32:54.906695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":764,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9416,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362424,"statfs":{"total":96636764160,"available":96627122176,"internally_reserved":0,"allocated":458752,"data_stored":747260,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]}]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8696,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363144,"statfs":{"total":96636764160,"available":96627859456,"internally_reserved":0,"allocated":376832,"data_stored":154676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":0.90300000000000002}]},{"osd":1,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.93700000000000006}]},{"osd":2,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.63300000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":0.67000000000000004}]},{"osd":4,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":1.054},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.997}]},{"osd":5,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.2570000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.1319999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.095},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.0289999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8812,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94363028,"statfs":{"total":96636764160,"available":96627740672,"internally_reserved":0,"allocated":364544,"data_stored":148130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":1.071}]},{"osd":1,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.9750000000000001,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.58499999999999996}]},{"osd":2,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.8809999999999998,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":1.153}]},{"osd":3,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":3.0369999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":1.121}]},{"osd":5,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.948},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":1.2909999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":3.0840000000000001,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.8919999999999999,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":2.0760000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.327},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":3.1230000000000002,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":1.1930000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12856,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":12480,"kb_avail":94358984,"statfs":{"total":96636764160,"available":96623599616,"internally_reserved":0,"allocated":376832,"data_stored":154164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12779520},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.68700000000000006}]},{"osd":1,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.497},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.56999999999999995}]},{"osd":3,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.82399999999999995}]},{"osd":4,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":1.0660000000000001}]},{"osd":5,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.92500000000000004}]},{"osd":6,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.034}]},{"osd":7,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":1.016}]}]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8828,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94363012,"statfs":{"total":96636764160,"available":96627724288,"internally_reserved":0,"allocated":380928,"data_stored":155348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542159,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8672,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363168,"statfs":{"total":96636764160,"available":96627884032,"internally_reserved":0,"allocated":352256,"data_stored":141502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8844,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362996,"statfs":{"total":96636764160,"available":96627707904,"internally_reserved":0,"allocated":397312,"data_stored":162023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:13:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.83199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":3,"last update":"Tue Oct 3 19:13:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.60099999999999998},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.73199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13444,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":12992,"kb_avail":94358396,"statfs":{"total":96636764160,"available":96622997504,"internally_reserved":0,"allocated":454656,"data_stored":751149,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":13303808},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":1.218}]},{"osd":2,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.94699999999999995}]},{"osd":3,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.75900000000000001}]},{"osd":4,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.347}]},{"osd":5,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.3009999999999999},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.84999999999999998}]},{"osd":6,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.034},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.056}]},{"osd":7,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.1499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:13:26.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2023-10-03T19:13:26.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:13:20.946816+0000', 'last_change': '2023-10-03T19:13:20.946816+0000', 'last_active': '2023-10-03T19:13:20.908525+0000', 'last_peered': '2023-10-03T19:13:20.908525+0000', 'last_clean': '2023-10-03T19:13:20.908525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:13:20.946816+0000', 'last_undegraded': '2023-10-03T19:13:20.946816+0000', 'last_fullsized': '2023-10-03T19:13:20.946816+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:13:20.908525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:13:20.908525+0000', 'last_clean_scrub_stamp': '2023-10-03T19:13:20.908525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:13:26.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2023-10-03T19:13:26.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:13:20.946605+0000', 'last_change': '2023-10-03T19:13:20.946605+0000', 'last_active': '2023-10-03T19:13:20.908525+0000', 'last_peered': '2023-10-03T19:13:20.908525+0000', 'last_clean': '2023-10-03T19:13:20.908525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:13:20.946605+0000', 'last_undegraded': '2023-10-03T19:13:20.946605+0000', 'last_fullsized': '2023-10-03T19:13:20.946605+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:13:20.908525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:13:20.908525+0000', 'last_clean_scrub_stamp': '2023-10-03T19:13:20.908525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:13:26.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2023-10-03T19:13:26.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:13:20.946219+0000', 'last_change': '2023-10-03T19:13:20.946219+0000', 'last_active': '2023-10-03T19:13:20.908525+0000', 'last_peered': '2023-10-03T19:13:20.908525+0000', 'last_clean': '2023-10-03T19:13:20.908525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:13:20.946219+0000', 'last_undegraded': '2023-10-03T19:13:20.946219+0000', 'last_fullsized': '2023-10-03T19:13:20.946219+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:13:20.908525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:13:20.908525+0000', 'last_clean_scrub_stamp': '2023-10-03T19:13:20.908525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:13:26.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-10-03T19:13:26.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:13:20.946012+0000', 'last_change': '2023-10-03T19:13:20.946012+0000', 'last_active': '2023-10-03T19:13:20.908525+0000', 'last_peered': '2023-10-03T19:13:20.908525+0000', 'last_clean': '2023-10-03T19:13:20.908525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:13:20.946012+0000', 'last_undegraded': '2023-10-03T19:13:20.946012+0000', 'last_fullsized': '2023-10-03T19:13:20.946012+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:13:20.908525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:13:20.908525+0000', 'last_clean_scrub_stamp': '2023-10-03T19:13:20.908525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:13:26.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-10-03T19:13:26.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:13:20.948617+0000', 'last_change': '2023-10-03T19:13:20.948617+0000', 'last_active': '2023-10-03T19:13:20.908525+0000', 'last_peered': '2023-10-03T19:13:20.908525+0000', 'last_clean': '2023-10-03T19:13:20.908525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:13:20.948617+0000', 'last_undegraded': '2023-10-03T19:13:20.948617+0000', 'last_fullsized': '2023-10-03T19:13:20.948617+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:13:20.908525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:13:20.908525+0000', 'last_clean_scrub_stamp': '2023-10-03T19:13:20.908525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:13:26.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-10-03T19:13:26.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:13:20.943585+0000', 'last_change': '2023-10-03T19:13:20.943585+0000', 'last_active': '2023-10-03T19:13:20.908525+0000', 'last_peered': '2023-10-03T19:13:20.908525+0000', 'last_clean': '2023-10-03T19:13:20.908525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:13:20.943585+0000', 'last_undegraded': '2023-10-03T19:13:20.943585+0000', 'last_fullsized': '2023-10-03T19:13:20.943585+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:13:20.908525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:13:20.908525+0000', 'last_clean_scrub_stamp': '2023-10-03T19:13:20.908525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:13:26.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-10-03T19:13:26.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:13:20.947840+0000', 'last_change': '2023-10-03T19:13:20.947840+0000', 'last_active': '2023-10-03T19:13:20.908525+0000', 'last_peered': '2023-10-03T19:13:20.908525+0000', 'last_clean': '2023-10-03T19:13:20.908525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:13:20.947840+0000', 'last_undegraded': '2023-10-03T19:13:20.947840+0000', 'last_fullsized': '2023-10-03T19:13:20.947840+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:13:20.908525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:13:20.908525+0000', 'last_clean_scrub_stamp': '2023-10-03T19:13:20.908525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:13:26.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-10-03T19:13:26.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:13:20.942312+0000', 'last_change': '2023-10-03T19:13:20.942312+0000', 'last_active': '2023-10-03T19:13:20.908525+0000', 'last_peered': '2023-10-03T19:13:20.908525+0000', 'last_clean': '2023-10-03T19:13:20.908525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:13:20.942312+0000', 'last_undegraded': '2023-10-03T19:13:20.942312+0000', 'last_fullsized': '2023-10-03T19:13:20.942312+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:13:20.908525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:13:20.908525+0000', 'last_clean_scrub_stamp': '2023-10-03T19:13:20.908525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:13:26.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-10-03T19:13:26.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:13:20.946084+0000', 'last_change': '2023-10-03T19:13:20.946084+0000', 'last_active': '2023-10-03T19:13:20.908525+0000', 'last_peered': '2023-10-03T19:13:20.908525+0000', 'last_clean': '2023-10-03T19:13:20.908525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:13:20.946084+0000', 'last_undegraded': '2023-10-03T19:13:20.946084+0000', 'last_fullsized': '2023-10-03T19:13:20.946084+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:13:20.908525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:13:20.908525+0000', 'last_clean_scrub_stamp': '2023-10-03T19:13:20.908525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:13:26.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-10-03T19:13:26.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:13:20.945349+0000', 'last_change': '2023-10-03T19:13:20.945349+0000', 'last_active': '2023-10-03T19:13:20.908525+0000', 'last_peered': '2023-10-03T19:13:20.908525+0000', 'last_clean': '2023-10-03T19:13:20.908525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:13:20.945349+0000', 'last_undegraded': '2023-10-03T19:13:20.945349+0000', 'last_fullsized': '2023-10-03T19:13:20.945349+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:13:20.908525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:13:20.908525+0000', 'last_clean_scrub_stamp': '2023-10-03T19:13:20.908525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:13:26.104 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-03T19:13:26.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.256+0000 7f3cc921e640 1 Processor -- start 2023-10-03T19:13:26.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.256+0000 7f3cc921e640 1 -- start start 2023-10-03T19:13:26.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.256+0000 7f3cc921e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cc414aa50 0x7f3cc40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:26.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.256+0000 7f3cc921e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3cc40bbd20 0x7f3cc4147ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:26.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.256+0000 7f3cc921e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cc414ae20 con 0x7f3cc406cd40 2023-10-03T19:13:26.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.256+0000 7f3cc921e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cc40a5db0 con 0x7f3cc40bbd20 2023-10-03T19:13:26.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.256+0000 7f3cc921e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc406c930 con 0x7f3cc414aa50 2023-10-03T19:13:26.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.256+0000 7f3cc359e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3cc40bbd20 0x7f3cc4147ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:26.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.256+0000 7f3cc359e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3cc40bbd20 0x7f3cc4147ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54080/0 (socket says 172.21.15.45:54080) 2023-10-03T19:13:26.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.256+0000 7f3cc359e640 1 -- 172.21.15.45:0/729837920 learned_addr learned my addr 172.21.15.45:0/729837920 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:26.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.256+0000 7f3cc2d9d640 1 --2- 172.21.15.45:0/729837920 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cc414aa50 0x7f3cc40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:26.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.256+0000 7f3cc359e640 1 -- 172.21.15.45:0/729837920 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cc414aa50 msgr2=0x7f3cc40a3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:26.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.256+0000 7f3cc359e640 1 --2- 172.21.15.45:0/729837920 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cc414aa50 0x7f3cc40a3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:26.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.256+0000 7f3cc359e640 1 -- 172.21.15.45:0/729837920 >> v1:172.21.15.79:6789/0 conn(0x7f3cc406cd40 legacy=0x7f3cc406c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:26.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.256+0000 7f3cc359e640 1 -- 172.21.15.45:0/729837920 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc40baf60 con 0x7f3cc40bbd20 2023-10-03T19:13:26.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.260+0000 7f3cc359e640 1 --2- 172.21.15.45:0/729837920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cc40bbd20 0x7f3cc4147ab0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3cb400bb10 tx=0x7f3cb40213c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e175d5327ab580 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:26.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.260+0000 7f3cc1d9b640 1 -- 172.21.15.45:0/729837920 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb40b1600 con 0x7f3cc40bbd20 2023-10-03T19:13:26.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.260+0000 7f3cc1d9b640 1 -- 172.21.15.45:0/729837920 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb40ad050 con 0x7f3cc40bbd20 2023-10-03T19:13:26.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.260+0000 7f3cc1d9b640 1 -- 172.21.15.45:0/729837920 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb40b1980 con 0x7f3cc40bbd20 2023-10-03T19:13:26.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.260+0000 7f3cc921e640 1 -- 172.21.15.45:0/729837920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cc40bbd20 msgr2=0x7f3cc4147ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:26.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.260+0000 7f3cc921e640 1 --2- 172.21.15.45:0/729837920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cc40bbd20 0x7f3cc4147ab0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3cb400bb10 tx=0x7f3cb40213c0 comp rx=0 tx=0).stop 2023-10-03T19:13:26.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.260+0000 7f3cc921e640 1 -- 172.21.15.45:0/729837920 shutdown_connections 2023-10-03T19:13:26.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.260+0000 7f3cc921e640 1 --2- 172.21.15.45:0/729837920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cc40bbd20 0x7f3cc4147ab0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:26.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.260+0000 7f3cc921e640 1 --2- 172.21.15.45:0/729837920 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cc414aa50 0x7f3cc40a3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:26.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.260+0000 7f3cc921e640 1 -- 172.21.15.45:0/729837920 >> 172.21.15.45:0/729837920 conn(0x7f3cc40bcf50 msgr2=0x7f3cc40bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:26.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.260+0000 7f3cc921e640 1 -- 172.21.15.45:0/729837920 shutdown_connections 2023-10-03T19:13:26.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.260+0000 7f3cc921e640 1 -- 172.21.15.45:0/729837920 wait complete. 2023-10-03T19:13:26.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.260+0000 7f3cc921e640 1 Processor -- start 2023-10-03T19:13:26.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.264+0000 7f3cc921e640 1 -- start start 2023-10-03T19:13:26.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.264+0000 7f3cc921e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cc406cd40 0x7f3cc41e2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:26.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.264+0000 7f3cc921e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cc40bbd20 0x7f3cc4144a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:26.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.264+0000 7f3cc921e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cc414aa50 0x7f3cc414be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:26.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.264+0000 7f3cc921e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc414cb90 con 0x7f3cc414aa50 2023-10-03T19:13:26.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.264+0000 7f3cc921e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc414ef60 con 0x7f3cc40bbd20 2023-10-03T19:13:26.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.264+0000 7f3cc921e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc40716a0 con 0x7f3cc406cd40 2023-10-03T19:13:26.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.264+0000 7f3cc359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cc414aa50 0x7f3cc414be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:26.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.264+0000 7f3cc359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cc414aa50 0x7f3cc414be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54084/0 (socket says 172.21.15.45:54084) 2023-10-03T19:13:26.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.264+0000 7f3cc359e640 1 -- 172.21.15.45:0/339562169 learned_addr learned my addr 172.21.15.45:0/339562169 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:26.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.264+0000 7f3cc2d9d640 1 --2- 172.21.15.45:0/339562169 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cc406cd40 0x7f3cc41e2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:26.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.264+0000 7f3cc359e640 1 -- 172.21.15.45:0/339562169 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cc406cd40 msgr2=0x7f3cc41e2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:26.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.264+0000 7f3cc359e640 1 --2- 172.21.15.45:0/339562169 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cc406cd40 0x7f3cc41e2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:26.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.264+0000 7f3cc359e640 1 -- 172.21.15.45:0/339562169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cc40bbd20 msgr2=0x7f3cc4144a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:26.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.264+0000 7f3cc259c640 1 --2- 172.21.15.45:0/339562169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cc40bbd20 0x7f3cc4144a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:26.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.264+0000 7f3cc359e640 1 --2- 172.21.15.45:0/339562169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cc40bbd20 0x7f3cc4144a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:26.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.264+0000 7f3cc359e640 1 -- 172.21.15.45:0/339562169 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb400b770 con 0x7f3cc414aa50 2023-10-03T19:13:26.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.264+0000 7f3cc359e640 1 --2- 172.21.15.45:0/339562169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cc414aa50 0x7f3cc414be40 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3cb400b2c0 tx=0x7f3cb401e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:26.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.264+0000 7f3cbb7fe640 1 -- 172.21.15.45:0/339562169 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb40ba810 con 0x7f3cc414aa50 2023-10-03T19:13:26.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.264+0000 7f3cbb7fe640 1 -- 172.21.15.45:0/339562169 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb40ba970 con 0x7f3cc414aa50 2023-10-03T19:13:26.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.264+0000 7f3cbb7fe640 1 -- 172.21.15.45:0/339562169 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb40bad20 con 0x7f3cc414aa50 2023-10-03T19:13:26.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.264+0000 7f3cc921e640 1 -- 172.21.15.45:0/339562169 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc40bb520 con 0x7f3cc414aa50 2023-10-03T19:13:26.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.264+0000 7f3cc921e640 1 -- 172.21.15.45:0/339562169 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc40bb240 con 0x7f3cc414aa50 2023-10-03T19:13:26.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.264+0000 7f3cc921e640 1 -- 172.21.15.45:0/339562169 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cc40bb800 con 0x7f3cc414aa50 2023-10-03T19:13:26.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.264+0000 7f3cbb7fe640 1 -- 172.21.15.45:0/339562169 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3cb40b8040 con 0x7f3cc414aa50 2023-10-03T19:13:26.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.264+0000 7f3cbb7fe640 1 --2- 172.21.15.45:0/339562169 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3ca4066280 0x7f3ca4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:26.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.264+0000 7f3cbb7fe640 1 -- 172.21.15.45:0/339562169 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3cb4124390 con 0x7f3cc414aa50 2023-10-03T19:13:26.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.268+0000 7f3cc2d9d640 1 --2- 172.21.15.45:0/339562169 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3ca4066280 0x7f3ca4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:26.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.268+0000 7f3cc2d9d640 1 --2- 172.21.15.45:0/339562169 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3ca4066280 0x7f3ca4068730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc008e50 tx=0x7f3cbc0083a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:26.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.268+0000 7f3cbb7fe640 1 -- 172.21.15.45:0/339562169 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3cb40f1810 con 0x7f3cc414aa50 2023-10-03T19:13:26.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.480+0000 7f3cc921e640 1 -- 172.21.15.45:0/339562169 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f3cc4071c60 con 0x7f3cc414aa50 2023-10-03T19:13:26.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.480+0000 7f3cbb7fe640 1 -- 172.21.15.45:0/339562169 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1516 (secure 0 0 0) 0x7f3cb40b6600 con 0x7f3cc414aa50 2023-10-03T19:13:26.486 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:13:26.486 INFO:teuthology.orchestra.run.smithi045.stdout:{"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":80,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":35,"num_osds":8,"num_up_osds":8,"osd_up_since":1696360341,"num_in_osds":8,"osd_in_since":1696360332,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":95},{"state_name":"creating+peering","count":10}],"num_pgs":105,"num_pools":4,"num_objects":17,"data_bytes":591132,"bytes_used":81477632,"bytes_avail":773012635648,"bytes_total":773094113280,"inactive_pgs_ratio":0.095238097012042999,"write_bytes_sec":900,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":15,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5076}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-10-03T19:13:22.459397+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-03T19:13:26.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.480+0000 7f3cc921e640 1 -- 172.21.15.45:0/339562169 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3ca4066280 msgr2=0x7f3ca4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:26.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.480+0000 7f3cc921e640 1 --2- 172.21.15.45:0/339562169 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3ca4066280 0x7f3ca4068730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc008e50 tx=0x7f3cbc0083a0 comp rx=0 tx=0).stop 2023-10-03T19:13:26.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.480+0000 7f3cc921e640 1 -- 172.21.15.45:0/339562169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cc414aa50 msgr2=0x7f3cc414be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:26.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.480+0000 7f3cc921e640 1 --2- 172.21.15.45:0/339562169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cc414aa50 0x7f3cc414be40 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3cb400b2c0 tx=0x7f3cb401e160 comp rx=0 tx=0).stop 2023-10-03T19:13:26.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.480+0000 7f3cc921e640 1 -- 172.21.15.45:0/339562169 shutdown_connections 2023-10-03T19:13:26.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.480+0000 7f3cc921e640 1 --2- 172.21.15.45:0/339562169 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3ca4066280 0x7f3ca4068730 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:26.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.480+0000 7f3cc921e640 1 --2- 172.21.15.45:0/339562169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cc414aa50 0x7f3cc414be40 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:26.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.480+0000 7f3cc921e640 1 --2- 172.21.15.45:0/339562169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cc40bbd20 0x7f3cc4144a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:26.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.480+0000 7f3cc921e640 1 --2- 172.21.15.45:0/339562169 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cc406cd40 0x7f3cc41e2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:26.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.480+0000 7f3cc921e640 1 -- 172.21.15.45:0/339562169 >> 172.21.15.45:0/339562169 conn(0x7f3cc40bcf50 msgr2=0x7f3cc4145db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:26.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.484+0000 7f3cc921e640 1 -- 172.21.15.45:0/339562169 shutdown_connections 2023-10-03T19:13:26.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.484+0000 7f3cc921e640 1 -- 172.21.15.45:0/339562169 wait complete. 2023-10-03T19:13:26.504 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-03T19:13:26.504 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:13:26.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.620+0000 7f7e6549e640 1 Processor -- start 2023-10-03T19:13:26.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.620+0000 7f7e6549e640 1 -- start start 2023-10-03T19:13:26.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.624+0000 7f7e6549e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7e6006f170 0x7f7e60150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:26.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.624+0000 7f7e6549e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e6006cac0 con 0x7f7e600bc8b0 2023-10-03T19:13:26.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.624+0000 7f7e6549e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e600720d0 con 0x7f7e6006d170 2023-10-03T19:13:26.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.624+0000 7f7e6549e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e600a5ab0 con 0x7f7e6006f170 2023-10-03T19:13:26.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.624+0000 7f7e5e7fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7e600bc8b0 0x7f7e6014ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35834/0 (socket says 172.21.15.45:35834) 2023-10-03T19:13:26.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.624+0000 7f7e5e7fc640 1 -- 172.21.15.45:0/740084418 learned_addr learned my addr 172.21.15.45:0/740084418 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:26.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.624+0000 7f7e5effd640 1 --2- 172.21.15.45:0/740084418 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7e6006f170 0x7f7e60150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:26.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.624+0000 7f7e5dffb640 1 -- 172.21.15.45:0/740084418 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 294823316 0 0) 0x7f7e500014a0 con 0x7f7e600bc8b0 2023-10-03T19:13:26.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.624+0000 7f7e5dffb640 1 -- 172.21.15.45:0/740084418 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e4c003530 con 0x7f7e600bc8b0 2023-10-03T19:13:26.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.624+0000 7f7e5dffb640 1 -- 172.21.15.45:0/740084418 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2716509243 0 0) 0x7f7e4c003530 con 0x7f7e600bc8b0 2023-10-03T19:13:26.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.624+0000 7f7e5dffb640 1 -- 172.21.15.45:0/740084418 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7e6006f170 msgr2=0x7f7e60150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:26.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.624+0000 7f7e5dffb640 1 --2- 172.21.15.45:0/740084418 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7e6006f170 0x7f7e60150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:26.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.624+0000 7f7e5dffb640 1 -- 172.21.15.45:0/740084418 >> v1:172.21.15.79:6789/0 conn(0x7f7e6006d170 legacy=0x7f7e60156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:26.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.624+0000 7f7e5dffb640 1 -- 172.21.15.45:0/740084418 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6006cd00 con 0x7f7e600bc8b0 2023-10-03T19:13:26.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.624+0000 7f7e5dffb640 1 -- 172.21.15.45:0/740084418 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f7e50001b90 con 0x7f7e600bc8b0 2023-10-03T19:13:26.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.624+0000 7f7e5dffb640 1 -- 172.21.15.45:0/740084418 >> v1:172.21.15.45:6789/0 conn(0x7f7e600bc8b0 legacy=0x7f7e6014ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:26.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.624+0000 7f7e5dffb640 1 --2- 172.21.15.45:0/740084418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e4c0039b0 0x7f7e4c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:26.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.624+0000 7f7e5dffb640 1 --2- 172.21.15.45:0/740084418 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7e6006f170 0x7f7e4c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:26.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.624+0000 7f7e5dffb640 1 --2- 172.21.15.45:0/740084418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e4c004d10 0x7f7e4c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:26.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.624+0000 7f7e5dffb640 1 -- 172.21.15.45:0/740084418 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e600a5ab0 con 0x7f7e4c0039b0 2023-10-03T19:13:26.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.624+0000 7f7e5dffb640 1 -- 172.21.15.45:0/740084418 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c00ba40 con 0x7f7e4c004d10 2023-10-03T19:13:26.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.624+0000 7f7e5dffb640 1 -- 172.21.15.45:0/740084418 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c00bbd0 con 0x7f7e6006f170 2023-10-03T19:13:26.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.624+0000 7f7e5effd640 1 --2- 172.21.15.45:0/740084418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e4c0039b0 0x7f7e4c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:26.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.624+0000 7f7e5e7fc640 1 --2- 172.21.15.45:0/740084418 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7e6006f170 0x7f7e4c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:26.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.624+0000 7f7e5f7fe640 1 --2- 172.21.15.45:0/740084418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e4c004d10 0x7f7e4c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:26.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.624+0000 7f7e5effd640 1 -- 172.21.15.45:0/740084418 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7e6006f170 msgr2=0x7f7e4c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:26.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.624+0000 7f7e5effd640 1 --2- 172.21.15.45:0/740084418 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7e6006f170 0x7f7e4c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:26.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.624+0000 7f7e5effd640 1 -- 172.21.15.45:0/740084418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e4c004d10 msgr2=0x7f7e4c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:26.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.624+0000 7f7e5effd640 1 --2- 172.21.15.45:0/740084418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e4c004d10 0x7f7e4c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:26.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.624+0000 7f7e5effd640 1 -- 172.21.15.45:0/740084418 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4c003530 con 0x7f7e4c0039b0 2023-10-03T19:13:26.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e5effd640 1 --2- 172.21.15.45:0/740084418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e4c0039b0 0x7f7e4c003dc0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7e48009ae0 tx=0x7f7e4801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9721078816692be0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:26.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e5dffb640 1 -- 172.21.15.45:0/740084418 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e480a5530 con 0x7f7e4c0039b0 2023-10-03T19:13:26.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e5dffb640 1 -- 172.21.15.45:0/740084418 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e480a5690 con 0x7f7e4c0039b0 2023-10-03T19:13:26.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e5dffb640 1 -- 172.21.15.45:0/740084418 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e480a5a40 con 0x7f7e4c0039b0 2023-10-03T19:13:26.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e6549e640 1 -- 172.21.15.45:0/740084418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e4c0039b0 msgr2=0x7f7e4c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:26.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e6549e640 1 --2- 172.21.15.45:0/740084418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e4c0039b0 0x7f7e4c003dc0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7e48009ae0 tx=0x7f7e4801ca10 comp rx=0 tx=0).stop 2023-10-03T19:13:26.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e5f7fe640 1 -- 172.21.15.45:0/740084418 reap_dead start 2023-10-03T19:13:26.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e6549e640 1 -- 172.21.15.45:0/740084418 shutdown_connections 2023-10-03T19:13:26.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e6549e640 1 -- 172.21.15.45:0/740084418 >> 172.21.15.45:0/740084418 conn(0x7f7e600bcf50 msgr2=0x7f7e600bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:26.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e6549e640 1 -- 172.21.15.45:0/740084418 shutdown_connections 2023-10-03T19:13:26.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e6549e640 1 -- 172.21.15.45:0/740084418 wait complete. 2023-10-03T19:13:26.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e6549e640 1 Processor -- start 2023-10-03T19:13:26.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e6549e640 1 -- start start 2023-10-03T19:13:26.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e6549e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7e4c0039b0 0x7f7e60142d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:26.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e6549e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e60141850 0x7f7e60141c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:26.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e6549e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e601e7150 0x7f7e601e75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:26.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e6549e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e600a46f0 con 0x7f7e60141850 2023-10-03T19:13:26.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e6549e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e601432a0 con 0x7f7e601e7150 2023-10-03T19:13:26.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e6549e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e60157770 con 0x7f7e4c0039b0 2023-10-03T19:13:26.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e5e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e60141850 0x7f7e60141c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:26.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e5e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e60141850 0x7f7e60141c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54114/0 (socket says 172.21.15.45:54114) 2023-10-03T19:13:26.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e5e7fc640 1 -- 172.21.15.45:0/626086962 learned_addr learned my addr 172.21.15.45:0/626086962 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:26.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e5f7fe640 1 --2- 172.21.15.45:0/626086962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e601e7150 0x7f7e601e75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:26.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e5effd640 1 --2- 172.21.15.45:0/626086962 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7e4c0039b0 0x7f7e60142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:26.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e5e7fc640 1 -- 172.21.15.45:0/626086962 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7e4c0039b0 msgr2=0x7f7e60142d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:26.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e5e7fc640 1 --2- 172.21.15.45:0/626086962 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7e4c0039b0 0x7f7e60142d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:26.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e5e7fc640 1 -- 172.21.15.45:0/626086962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e601e7150 msgr2=0x7f7e601e75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:26.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e5e7fc640 1 --2- 172.21.15.45:0/626086962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e601e7150 0x7f7e601e75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:26.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e5e7fc640 1 -- 172.21.15.45:0/626086962 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6006f6d0 con 0x7f7e60141850 2023-10-03T19:13:26.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e5e7fc640 1 --2- 172.21.15.45:0/626086962 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e60141850 0x7f7e60141c80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7e50007a60 tx=0x7f7e5000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:26.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e577fe640 1 -- 172.21.15.45:0/626086962 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e50013420 con 0x7f7e60141850 2023-10-03T19:13:26.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e577fe640 1 -- 172.21.15.45:0/626086962 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e50013580 con 0x7f7e60141850 2023-10-03T19:13:26.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e577fe640 1 -- 172.21.15.45:0/626086962 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e50013930 con 0x7f7e60141850 2023-10-03T19:13:26.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e6549e640 1 -- 172.21.15.45:0/626086962 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e6006f540 con 0x7f7e60141850 2023-10-03T19:13:26.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.628+0000 7f7e6549e640 1 -- 172.21.15.45:0/626086962 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e60158570 con 0x7f7e60141850 2023-10-03T19:13:26.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.632+0000 7f7e6549e640 1 -- 172.21.15.45:0/626086962 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e6006d660 con 0x7f7e60141850 2023-10-03T19:13:26.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.632+0000 7f7e577fe640 1 -- 172.21.15.45:0/626086962 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7e50013a90 con 0x7f7e60141850 2023-10-03T19:13:26.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.632+0000 7f7e577fe640 1 --2- 172.21.15.45:0/626086962 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7e400662b0 0x7f7e40068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:26.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.632+0000 7f7e577fe640 1 -- 172.21.15.45:0/626086962 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7e50084340 con 0x7f7e60141850 2023-10-03T19:13:26.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.632+0000 7f7e5effd640 1 --2- 172.21.15.45:0/626086962 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7e400662b0 0x7f7e40068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:26.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.632+0000 7f7e5effd640 1 --2- 172.21.15.45:0/626086962 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7e400662b0 0x7f7e40068760 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7e480af000 tx=0x7f7e480046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:26.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.636+0000 7f7e577fe640 1 -- 172.21.15.45:0/626086962 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7e50051850 con 0x7f7e60141850 2023-10-03T19:13:26.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.792+0000 7f7e6549e640 1 -- 172.21.15.45:0/626086962 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7e601575d0 con 0x7f7e400662b0 2023-10-03T19:13:26.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.812+0000 7f7e577fe640 1 -- 172.21.15.45:0/626086962 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302643 (secure 0 0 0) 0x7f7e601575d0 con 0x7f7e400662b0 2023-10-03T19:13:26.823 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:13:26.825 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:13:26.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.820+0000 7f7e6549e640 1 -- 172.21.15.45:0/626086962 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7e400662b0 msgr2=0x7f7e40068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:26.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.820+0000 7f7e6549e640 1 --2- 172.21.15.45:0/626086962 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7e400662b0 0x7f7e40068760 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7e480af000 tx=0x7f7e480046d0 comp rx=0 tx=0).stop 2023-10-03T19:13:26.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.820+0000 7f7e6549e640 1 -- 172.21.15.45:0/626086962 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e60141850 msgr2=0x7f7e60141c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:26.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.820+0000 7f7e6549e640 1 --2- 172.21.15.45:0/626086962 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e60141850 0x7f7e60141c80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7e50007a60 tx=0x7f7e5000e530 comp rx=0 tx=0).stop 2023-10-03T19:13:26.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.820+0000 7f7e6549e640 1 -- 172.21.15.45:0/626086962 shutdown_connections 2023-10-03T19:13:26.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.820+0000 7f7e6549e640 1 --2- 172.21.15.45:0/626086962 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7e400662b0 0x7f7e40068760 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:26.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.820+0000 7f7e6549e640 1 --2- 172.21.15.45:0/626086962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e601e7150 0x7f7e601e75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:26.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.820+0000 7f7e6549e640 1 --2- 172.21.15.45:0/626086962 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e60141850 0x7f7e60141c80 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:26.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.820+0000 7f7e6549e640 1 --2- 172.21.15.45:0/626086962 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7e4c0039b0 0x7f7e60142d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:26.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.820+0000 7f7e6549e640 1 -- 172.21.15.45:0/626086962 >> 172.21.15.45:0/626086962 conn(0x7f7e600bcf50 msgr2=0x7f7e60149d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:26.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.820+0000 7f7e6549e640 1 -- 172.21.15.45:0/626086962 shutdown_connections 2023-10-03T19:13:26.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:26.820+0000 7f7e6549e640 1 -- 172.21.15.45:0/626086962 wait complete. 2023-10-03T19:13:26.842 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2023-10-03T19:13:26.460639+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":168,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":79812,"kb_used_data":3140,"kb_used_omap":0,"kb_used_meta":76608,"kb_avail":754894908,"statfs":{"total":773094113280,"available":773012385792,"internally_reserved":0,"allocated":3215360,"data_stored":2436259,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":78446592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":66,"apply_latency_ms":66,"commit_latency_ns":66000000,"apply_latency_ns":66000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001888"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.630079+0000","last_change":"2023-10-03T19:13:21.340387+0000","last_active":"2023-10-03T19:13:23.630079+0000","last_peered":"2023-10-03T19:13:23.630079+0000","last_clean":"2023-10-03T19:13:23.630079+0000","last_became_active":"2023-10-03T19:13:21.338937+0000","last_became_peered":"2023-10-03T19:13:21.338937+0000","last_unstale":"2023-10-03T19:13:23.630079+0000","last_undegraded":"2023-10-03T19:13:23.630079+0000","last_fullsized":"2023-10-03T19:13:23.630079+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:56:03.182827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.629256+0000","last_change":"2023-10-03T19:13:21.332772+0000","last_active":"2023-10-03T19:13:23.629256+0000","last_peered":"2023-10-03T19:13:23.629256+0000","last_clean":"2023-10-03T19:13:23.629256+0000","last_became_active":"2023-10-03T19:13:21.332383+0000","last_became_peered":"2023-10-03T19:13:21.332383+0000","last_unstale":"2023-10-03T19:13:23.629256+0000","last_undegraded":"2023-10-03T19:13:23.629256+0000","last_fullsized":"2023-10-03T19:13:23.629256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:38:14.290892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344409+0000","last_change":"2023-10-03T19:13:21.385258+0000","last_active":"2023-10-03T19:13:23.344409+0000","last_peered":"2023-10-03T19:13:23.344409+0000","last_clean":"2023-10-03T19:13:23.344409+0000","last_became_active":"2023-10-03T19:13:21.384907+0000","last_became_peered":"2023-10-03T19:13:21.384907+0000","last_unstale":"2023-10-03T19:13:23.344409+0000","last_undegraded":"2023-10-03T19:13:23.344409+0000","last_fullsized":"2023-10-03T19:13:23.344409+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:00:58.500162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.365163+0000","last_change":"2023-10-03T19:13:21.364377+0000","last_active":"2023-10-03T19:13:21.365163+0000","last_peered":"2023-10-03T19:13:21.365163+0000","last_clean":"2023-10-03T19:13:21.365163+0000","last_became_active":"2023-10-03T19:13:21.364029+0000","last_became_peered":"2023-10-03T19:13:21.364029+0000","last_unstale":"2023-10-03T19:13:21.365163+0000","last_undegraded":"2023-10-03T19:13:21.365163+0000","last_fullsized":"2023-10-03T19:13:21.365163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:28:09.213667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.364572+0000","last_change":"2023-10-03T19:13:21.363282+0000","last_active":"2023-10-03T19:13:21.364572+0000","last_peered":"2023-10-03T19:13:21.364572+0000","last_clean":"2023-10-03T19:13:21.364572+0000","last_became_active":"2023-10-03T19:13:21.362984+0000","last_became_peered":"2023-10-03T19:13:21.362984+0000","last_unstale":"2023-10-03T19:13:21.364572+0000","last_undegraded":"2023-10-03T19:13:21.364572+0000","last_fullsized":"2023-10-03T19:13:21.364572+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:19:43.624473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.339533+0000","last_change":"2023-10-03T19:13:21.336852+0000","last_active":"2023-10-03T19:13:21.339533+0000","last_peered":"2023-10-03T19:13:21.339533+0000","last_clean":"2023-10-03T19:13:21.339533+0000","last_became_active":"2023-10-03T19:13:21.336505+0000","last_became_peered":"2023-10-03T19:13:21.336505+0000","last_unstale":"2023-10-03T19:13:21.339533+0000","last_undegraded":"2023-10-03T19:13:21.339533+0000","last_fullsized":"2023-10-03T19:13:21.339533+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:39:44.903301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.331242+0000","last_change":"2023-10-03T19:13:21.386226+0000","last_active":"2023-10-03T19:13:22.331242+0000","last_peered":"2023-10-03T19:13:22.331242+0000","last_clean":"2023-10-03T19:13:22.331242+0000","last_became_active":"2023-10-03T19:13:21.381498+0000","last_became_peered":"2023-10-03T19:13:21.381498+0000","last_unstale":"2023-10-03T19:13:22.331242+0000","last_undegraded":"2023-10-03T19:13:22.331242+0000","last_fullsized":"2023-10-03T19:13:22.331242+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:05:10.879452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.628310+0000","last_change":"2023-10-03T19:13:21.379609+0000","last_active":"2023-10-03T19:13:23.628310+0000","last_peered":"2023-10-03T19:13:23.628310+0000","last_clean":"2023-10-03T19:13:23.628310+0000","last_became_active":"2023-10-03T19:13:21.379288+0000","last_became_peered":"2023-10-03T19:13:21.379288+0000","last_unstale":"2023-10-03T19:13:23.628310+0000","last_undegraded":"2023-10-03T19:13:23.628310+0000","last_fullsized":"2023-10-03T19:13:23.628310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:10:43.840486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344660+0000","last_change":"2023-10-03T19:13:21.379630+0000","last_active":"2023-10-03T19:13:23.344660+0000","last_peered":"2023-10-03T19:13:23.344660+0000","last_clean":"2023-10-03T19:13:23.344660+0000","last_became_active":"2023-10-03T19:13:21.379337+0000","last_became_peered":"2023-10-03T19:13:21.379337+0000","last_unstale":"2023-10-03T19:13:23.344660+0000","last_undegraded":"2023-10-03T19:13:23.344660+0000","last_fullsized":"2023-10-03T19:13:23.344660+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:05:21.993046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.333045+0000","last_change":"2023-10-03T19:13:21.387777+0000","last_active":"2023-10-03T19:13:22.333045+0000","last_peered":"2023-10-03T19:13:22.333045+0000","last_clean":"2023-10-03T19:13:22.333045+0000","last_became_active":"2023-10-03T19:13:21.387128+0000","last_became_peered":"2023-10-03T19:13:21.387128+0000","last_unstale":"2023-10-03T19:13:22.333045+0000","last_undegraded":"2023-10-03T19:13:22.333045+0000","last_fullsized":"2023-10-03T19:13:22.333045+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:33:35.559553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332600+0000","last_change":"2023-10-03T19:13:21.381901+0000","last_active":"2023-10-03T19:13:22.332600+0000","last_peered":"2023-10-03T19:13:22.332600+0000","last_clean":"2023-10-03T19:13:22.332600+0000","last_became_active":"2023-10-03T19:13:21.380706+0000","last_became_peered":"2023-10-03T19:13:21.380706+0000","last_unstale":"2023-10-03T19:13:22.332600+0000","last_undegraded":"2023-10-03T19:13:22.332600+0000","last_fullsized":"2023-10-03T19:13:22.332600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:12:39.485705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344538+0000","last_change":"2023-10-03T19:13:21.337436+0000","last_active":"2023-10-03T19:13:23.344538+0000","last_peered":"2023-10-03T19:13:23.344538+0000","last_clean":"2023-10-03T19:13:23.344538+0000","last_became_active":"2023-10-03T19:13:21.337123+0000","last_became_peered":"2023-10-03T19:13:21.337123+0000","last_unstale":"2023-10-03T19:13:23.344538+0000","last_undegraded":"2023-10-03T19:13:23.344538+0000","last_fullsized":"2023-10-03T19:13:23.344538+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:16:02.368990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332506+0000","last_change":"2023-10-03T19:13:21.387101+0000","last_active":"2023-10-03T19:13:22.332506+0000","last_peered":"2023-10-03T19:13:22.332506+0000","last_clean":"2023-10-03T19:13:22.332506+0000","last_became_active":"2023-10-03T19:13:21.386571+0000","last_became_peered":"2023-10-03T19:13:21.386571+0000","last_unstale":"2023-10-03T19:13:22.332506+0000","last_undegraded":"2023-10-03T19:13:22.332506+0000","last_fullsized":"2023-10-03T19:13:22.332506+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:48:36.421606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.382081+0000","last_change":"2023-10-03T19:13:21.365622+0000","last_active":"2023-10-03T19:13:21.382081+0000","last_peered":"2023-10-03T19:13:21.382081+0000","last_clean":"2023-10-03T19:13:21.382081+0000","last_became_active":"2023-10-03T19:13:21.364997+0000","last_became_peered":"2023-10-03T19:13:21.364997+0000","last_unstale":"2023-10-03T19:13:21.382081+0000","last_undegraded":"2023-10-03T19:13:21.382081+0000","last_fullsized":"2023-10-03T19:13:21.382081+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:50:20.193476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.331431+0000","last_change":"2023-10-03T19:13:21.382122+0000","last_active":"2023-10-03T19:13:22.331431+0000","last_peered":"2023-10-03T19:13:22.331431+0000","last_clean":"2023-10-03T19:13:22.331431+0000","last_became_active":"2023-10-03T19:13:21.380853+0000","last_became_peered":"2023-10-03T19:13:21.380853+0000","last_unstale":"2023-10-03T19:13:22.331431+0000","last_undegraded":"2023-10-03T19:13:22.331431+0000","last_fullsized":"2023-10-03T19:13:22.331431+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:12:09.744127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388977+0000","last_change":"2023-10-03T19:13:21.382147+0000","last_active":"2023-10-03T19:13:21.388977+0000","last_peered":"2023-10-03T19:13:21.388977+0000","last_clean":"2023-10-03T19:13:21.388977+0000","last_became_active":"2023-10-03T19:13:21.381614+0000","last_became_peered":"2023-10-03T19:13:21.381614+0000","last_unstale":"2023-10-03T19:13:21.388977+0000","last_undegraded":"2023-10-03T19:13:21.388977+0000","last_fullsized":"2023-10-03T19:13:21.388977+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:03:08.567828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.393291+0000","last_change":"2023-10-03T19:13:21.391132+0000","last_active":"2023-10-03T19:13:21.393291+0000","last_peered":"2023-10-03T19:13:21.393291+0000","last_clean":"2023-10-03T19:13:21.393291+0000","last_became_active":"2023-10-03T19:13:21.390626+0000","last_became_peered":"2023-10-03T19:13:21.390626+0000","last_unstale":"2023-10-03T19:13:21.393291+0000","last_undegraded":"2023-10-03T19:13:21.393291+0000","last_fullsized":"2023-10-03T19:13:21.393291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:52:31.490114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.376272+0000","last_change":"2023-10-03T19:13:21.369754+0000","last_active":"2023-10-03T19:13:21.376272+0000","last_peered":"2023-10-03T19:13:21.376272+0000","last_clean":"2023-10-03T19:13:21.376272+0000","last_became_active":"2023-10-03T19:13:21.368680+0000","last_became_peered":"2023-10-03T19:13:21.368680+0000","last_unstale":"2023-10-03T19:13:21.376272+0000","last_undegraded":"2023-10-03T19:13:21.376272+0000","last_fullsized":"2023-10-03T19:13:21.376272+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:38:54.659714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.338097+0000","last_change":"2023-10-03T19:13:21.332782+0000","last_active":"2023-10-03T19:13:21.338097+0000","last_peered":"2023-10-03T19:13:21.338097+0000","last_clean":"2023-10-03T19:13:21.338097+0000","last_became_active":"2023-10-03T19:13:21.332537+0000","last_became_peered":"2023-10-03T19:13:21.332537+0000","last_unstale":"2023-10-03T19:13:21.338097+0000","last_undegraded":"2023-10-03T19:13:21.338097+0000","last_fullsized":"2023-10-03T19:13:21.338097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:39:33.232842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.369427+0000","last_change":"2023-10-03T19:13:21.366160+0000","last_active":"2023-10-03T19:13:21.369427+0000","last_peered":"2023-10-03T19:13:21.369427+0000","last_clean":"2023-10-03T19:13:21.369427+0000","last_became_active":"2023-10-03T19:13:21.365568+0000","last_became_peered":"2023-10-03T19:13:21.365568+0000","last_unstale":"2023-10-03T19:13:21.369427+0000","last_undegraded":"2023-10-03T19:13:21.369427+0000","last_fullsized":"2023-10-03T19:13:21.369427+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:48:02.179860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332079+0000","last_change":"2023-10-03T19:13:21.380192+0000","last_active":"2023-10-03T19:13:22.332079+0000","last_peered":"2023-10-03T19:13:22.332079+0000","last_clean":"2023-10-03T19:13:22.332079+0000","last_became_active":"2023-10-03T19:13:21.379452+0000","last_became_peered":"2023-10-03T19:13:21.379452+0000","last_unstale":"2023-10-03T19:13:22.332079+0000","last_undegraded":"2023-10-03T19:13:22.332079+0000","last_fullsized":"2023-10-03T19:13:22.332079+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:10:18.652000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.382002+0000","last_change":"2023-10-03T19:13:21.362845+0000","last_active":"2023-10-03T19:13:21.382002+0000","last_peered":"2023-10-03T19:13:21.382002+0000","last_clean":"2023-10-03T19:13:21.382002+0000","last_became_active":"2023-10-03T19:13:21.361610+0000","last_became_peered":"2023-10-03T19:13:21.361610+0000","last_unstale":"2023-10-03T19:13:21.382002+0000","last_undegraded":"2023-10-03T19:13:21.382002+0000","last_fullsized":"2023-10-03T19:13:21.382002+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:19:45.728456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388429+0000","last_change":"2023-10-03T19:13:21.371753+0000","last_active":"2023-10-03T19:13:21.388429+0000","last_peered":"2023-10-03T19:13:21.388429+0000","last_clean":"2023-10-03T19:13:21.388429+0000","last_became_active":"2023-10-03T19:13:21.370040+0000","last_became_peered":"2023-10-03T19:13:21.370040+0000","last_unstale":"2023-10-03T19:13:21.388429+0000","last_undegraded":"2023-10-03T19:13:21.388429+0000","last_fullsized":"2023-10-03T19:13:21.388429+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:21:52.323037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.370133+0000","last_change":"2023-10-03T19:13:21.368517+0000","last_active":"2023-10-03T19:13:21.370133+0000","last_peered":"2023-10-03T19:13:21.370133+0000","last_clean":"2023-10-03T19:13:21.370133+0000","last_became_active":"2023-10-03T19:13:21.368223+0000","last_became_peered":"2023-10-03T19:13:21.368223+0000","last_unstale":"2023-10-03T19:13:21.370133+0000","last_undegraded":"2023-10-03T19:13:21.370133+0000","last_fullsized":"2023-10-03T19:13:21.370133+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:44:21.225478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.361781+0000","last_change":"2023-10-03T19:13:21.340602+0000","last_active":"2023-10-03T19:13:21.361781+0000","last_peered":"2023-10-03T19:13:21.361781+0000","last_clean":"2023-10-03T19:13:21.361781+0000","last_became_active":"2023-10-03T19:13:21.338940+0000","last_became_peered":"2023-10-03T19:13:21.338940+0000","last_unstale":"2023-10-03T19:13:21.361781+0000","last_undegraded":"2023-10-03T19:13:21.361781+0000","last_fullsized":"2023-10-03T19:13:21.361781+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:18:54.472816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.372433+0000","last_change":"2023-10-03T19:13:21.371393+0000","last_active":"2023-10-03T19:13:21.372433+0000","last_peered":"2023-10-03T19:13:21.372433+0000","last_clean":"2023-10-03T19:13:21.372433+0000","last_became_active":"2023-10-03T19:13:21.371075+0000","last_became_peered":"2023-10-03T19:13:21.371075+0000","last_unstale":"2023-10-03T19:13:21.372433+0000","last_undegraded":"2023-10-03T19:13:21.372433+0000","last_fullsized":"2023-10-03T19:13:21.372433+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:09:25.508263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.362808+0000","last_change":"2023-10-03T19:13:21.341738+0000","last_active":"2023-10-03T19:13:21.362808+0000","last_peered":"2023-10-03T19:13:21.362808+0000","last_clean":"2023-10-03T19:13:21.362808+0000","last_became_active":"2023-10-03T19:13:21.340877+0000","last_became_peered":"2023-10-03T19:13:21.340877+0000","last_unstale":"2023-10-03T19:13:21.362808+0000","last_undegraded":"2023-10-03T19:13:21.362808+0000","last_fullsized":"2023-10-03T19:13:21.362808+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:50:45.720443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332435+0000","last_change":"2023-10-03T19:13:21.363972+0000","last_active":"2023-10-03T19:13:22.332435+0000","last_peered":"2023-10-03T19:13:22.332435+0000","last_clean":"2023-10-03T19:13:22.332435+0000","last_became_active":"2023-10-03T19:13:21.363452+0000","last_became_peered":"2023-10-03T19:13:21.363452+0000","last_unstale":"2023-10-03T19:13:22.332435+0000","last_undegraded":"2023-10-03T19:13:22.332435+0000","last_fullsized":"2023-10-03T19:13:22.332435+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:56:31.353897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.353062+0000","last_change":"2023-10-03T19:13:21.334239+0000","last_active":"2023-10-03T19:13:21.353062+0000","last_peered":"2023-10-03T19:13:21.353062+0000","last_clean":"2023-10-03T19:13:21.353062+0000","last_became_active":"2023-10-03T19:13:21.333456+0000","last_became_peered":"2023-10-03T19:13:21.333456+0000","last_unstale":"2023-10-03T19:13:21.353062+0000","last_undegraded":"2023-10-03T19:13:21.353062+0000","last_fullsized":"2023-10-03T19:13:21.353062+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:54:32.970270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.361714+0000","last_change":"2023-10-03T19:13:21.339712+0000","last_active":"2023-10-03T19:13:21.361714+0000","last_peered":"2023-10-03T19:13:21.361714+0000","last_clean":"2023-10-03T19:13:21.361714+0000","last_became_active":"2023-10-03T19:13:21.338930+0000","last_became_peered":"2023-10-03T19:13:21.338930+0000","last_unstale":"2023-10-03T19:13:21.361714+0000","last_undegraded":"2023-10-03T19:13:21.361714+0000","last_fullsized":"2023-10-03T19:13:21.361714+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:52:54.145637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388471+0000","last_change":"2023-10-03T19:13:21.372961+0000","last_active":"2023-10-03T19:13:21.388471+0000","last_peered":"2023-10-03T19:13:21.388471+0000","last_clean":"2023-10-03T19:13:21.388471+0000","last_became_active":"2023-10-03T19:13:21.372269+0000","last_became_peered":"2023-10-03T19:13:21.372269+0000","last_unstale":"2023-10-03T19:13:21.388471+0000","last_undegraded":"2023-10-03T19:13:21.388471+0000","last_fullsized":"2023-10-03T19:13:21.388471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:42:26.752455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.339370+0000","last_change":"2023-10-03T19:13:21.337355+0000","last_active":"2023-10-03T19:13:21.339370+0000","last_peered":"2023-10-03T19:13:21.339370+0000","last_clean":"2023-10-03T19:13:21.339370+0000","last_became_active":"2023-10-03T19:13:21.337084+0000","last_became_peered":"2023-10-03T19:13:21.337084+0000","last_unstale":"2023-10-03T19:13:21.339370+0000","last_undegraded":"2023-10-03T19:13:21.339370+0000","last_fullsized":"2023-10-03T19:13:21.339370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:23:59.311834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.394182+0000","last_change":"2023-10-03T19:13:21.391912+0000","last_active":"2023-10-03T19:13:21.394182+0000","last_peered":"2023-10-03T19:13:21.394182+0000","last_clean":"2023-10-03T19:13:21.394182+0000","last_became_active":"2023-10-03T19:13:21.390545+0000","last_became_peered":"2023-10-03T19:13:21.390545+0000","last_unstale":"2023-10-03T19:13:21.394182+0000","last_undegraded":"2023-10-03T19:13:21.394182+0000","last_fullsized":"2023-10-03T19:13:21.394182+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:38:14.290892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"34'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.377742+0000","last_change":"2023-10-03T19:13:20.969426+0000","last_active":"2023-10-03T19:13:21.377742+0000","last_peered":"2023-10-03T19:13:21.377742+0000","last_clean":"2023-10-03T19:13:21.377742+0000","last_became_active":"2023-10-03T19:13:20.968732+0000","last_became_peered":"2023-10-03T19:13:20.968732+0000","last_unstale":"2023-10-03T19:13:21.377742+0000","last_undegraded":"2023-10-03T19:13:21.377742+0000","last_fullsized":"2023-10-03T19:13:21.377742+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:54:05.602230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.386027+0000","last_change":"2023-10-03T19:13:21.385217+0000","last_active":"2023-10-03T19:13:21.386027+0000","last_peered":"2023-10-03T19:13:21.386027+0000","last_clean":"2023-10-03T19:13:21.386027+0000","last_became_active":"2023-10-03T19:13:21.384926+0000","last_became_peered":"2023-10-03T19:13:21.384926+0000","last_unstale":"2023-10-03T19:13:21.386027+0000","last_undegraded":"2023-10-03T19:13:21.386027+0000","last_fullsized":"2023-10-03T19:13:21.386027+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:43:13.606613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344952+0000","last_change":"2023-10-03T19:13:20.972150+0000","last_active":"2023-10-03T19:13:23.344952+0000","last_peered":"2023-10-03T19:13:23.344952+0000","last_clean":"2023-10-03T19:13:23.344952+0000","last_became_active":"2023-10-03T19:13:20.971821+0000","last_became_peered":"2023-10-03T19:13:20.971821+0000","last_unstale":"2023-10-03T19:13:23.344952+0000","last_undegraded":"2023-10-03T19:13:23.344952+0000","last_fullsized":"2023-10-03T19:13:23.344952+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:46:55.064511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.382104+0000","last_change":"2023-10-03T19:13:21.365006+0000","last_active":"2023-10-03T19:13:21.382104+0000","last_peered":"2023-10-03T19:13:21.382104+0000","last_clean":"2023-10-03T19:13:21.382104+0000","last_became_active":"2023-10-03T19:13:21.364499+0000","last_became_peered":"2023-10-03T19:13:21.364499+0000","last_unstale":"2023-10-03T19:13:21.382104+0000","last_undegraded":"2023-10-03T19:13:21.382104+0000","last_fullsized":"2023-10-03T19:13:21.382104+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:45:17.978390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.359478+0000","last_change":"2023-10-03T19:13:20.950958+0000","last_active":"2023-10-03T19:13:21.359478+0000","last_peered":"2023-10-03T19:13:21.359478+0000","last_clean":"2023-10-03T19:13:21.359478+0000","last_became_active":"2023-10-03T19:13:20.950561+0000","last_became_peered":"2023-10-03T19:13:20.950561+0000","last_unstale":"2023-10-03T19:13:21.359478+0000","last_undegraded":"2023-10-03T19:13:21.359478+0000","last_fullsized":"2023-10-03T19:13:21.359478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:55:54.835749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.629374+0000","last_change":"2023-10-03T19:13:21.337474+0000","last_active":"2023-10-03T19:13:23.629374+0000","last_peered":"2023-10-03T19:13:23.629374+0000","last_clean":"2023-10-03T19:13:23.629374+0000","last_became_active":"2023-10-03T19:13:21.337090+0000","last_became_peered":"2023-10-03T19:13:21.337090+0000","last_unstale":"2023-10-03T19:13:23.629374+0000","last_undegraded":"2023-10-03T19:13:23.629374+0000","last_fullsized":"2023-10-03T19:13:23.629374+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:33:42.598570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.376007+0000","last_change":"2023-10-03T19:13:20.953487+0000","last_active":"2023-10-03T19:13:21.376007+0000","last_peered":"2023-10-03T19:13:21.376007+0000","last_clean":"2023-10-03T19:13:21.376007+0000","last_became_active":"2023-10-03T19:13:20.952739+0000","last_became_peered":"2023-10-03T19:13:20.952739+0000","last_unstale":"2023-10-03T19:13:21.376007+0000","last_undegraded":"2023-10-03T19:13:21.376007+0000","last_fullsized":"2023-10-03T19:13:21.376007+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:41:26.248555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344143+0000","last_change":"2023-10-03T19:13:21.335933+0000","last_active":"2023-10-03T19:13:23.344143+0000","last_peered":"2023-10-03T19:13:23.344143+0000","last_clean":"2023-10-03T19:13:23.344143+0000","last_became_active":"2023-10-03T19:13:21.335661+0000","last_became_peered":"2023-10-03T19:13:21.335661+0000","last_unstale":"2023-10-03T19:13:23.344143+0000","last_undegraded":"2023-10-03T19:13:23.344143+0000","last_fullsized":"2023-10-03T19:13:23.344143+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:14:24.053747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332061+0000","last_change":"2023-10-03T19:13:20.957478+0000","last_active":"2023-10-03T19:13:22.332061+0000","last_peered":"2023-10-03T19:13:22.332061+0000","last_clean":"2023-10-03T19:13:22.332061+0000","last_became_active":"2023-10-03T19:13:20.956389+0000","last_became_peered":"2023-10-03T19:13:20.956389+0000","last_unstale":"2023-10-03T19:13:22.332061+0000","last_undegraded":"2023-10-03T19:13:22.332061+0000","last_fullsized":"2023-10-03T19:13:22.332061+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:17:04.660877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.331680+0000","last_change":"2023-10-03T19:13:21.380338+0000","last_active":"2023-10-03T19:13:22.331680+0000","last_peered":"2023-10-03T19:13:22.331680+0000","last_clean":"2023-10-03T19:13:22.331680+0000","last_became_active":"2023-10-03T19:13:21.379660+0000","last_became_peered":"2023-10-03T19:13:21.379660+0000","last_unstale":"2023-10-03T19:13:22.331680+0000","last_undegraded":"2023-10-03T19:13:22.331680+0000","last_fullsized":"2023-10-03T19:13:22.331680+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:11:08.676258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.374578+0000","last_change":"2023-10-03T19:13:20.974925+0000","last_active":"2023-10-03T19:13:21.374578+0000","last_peered":"2023-10-03T19:13:21.374578+0000","last_clean":"2023-10-03T19:13:21.374578+0000","last_became_active":"2023-10-03T19:13:20.974368+0000","last_became_peered":"2023-10-03T19:13:20.974368+0000","last_unstale":"2023-10-03T19:13:21.374578+0000","last_undegraded":"2023-10-03T19:13:21.374578+0000","last_fullsized":"2023-10-03T19:13:21.374578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:31:41.223618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.383953+0000","last_change":"2023-10-03T19:13:21.379900+0000","last_active":"2023-10-03T19:13:21.383953+0000","last_peered":"2023-10-03T19:13:21.383953+0000","last_clean":"2023-10-03T19:13:21.383953+0000","last_became_active":"2023-10-03T19:13:21.379296+0000","last_became_peered":"2023-10-03T19:13:21.379296+0000","last_unstale":"2023-10-03T19:13:21.383953+0000","last_undegraded":"2023-10-03T19:13:21.383953+0000","last_fullsized":"2023-10-03T19:13:21.383953+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:57:55.230179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.326794+0000","last_change":"2023-10-03T19:13:20.963235+0000","last_active":"2023-10-03T19:13:21.326794+0000","last_peered":"2023-10-03T19:13:21.326794+0000","last_clean":"2023-10-03T19:13:21.326794+0000","last_became_active":"2023-10-03T19:13:20.962810+0000","last_became_peered":"2023-10-03T19:13:20.962810+0000","last_unstale":"2023-10-03T19:13:21.326794+0000","last_undegraded":"2023-10-03T19:13:21.326794+0000","last_fullsized":"2023-10-03T19:13:21.326794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:00:49.525990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.629124+0000","last_change":"2023-10-03T19:13:21.368821+0000","last_active":"2023-10-03T19:13:23.629124+0000","last_peered":"2023-10-03T19:13:23.629124+0000","last_clean":"2023-10-03T19:13:23.629124+0000","last_became_active":"2023-10-03T19:13:21.368521+0000","last_became_peered":"2023-10-03T19:13:21.368521+0000","last_unstale":"2023-10-03T19:13:23.629124+0000","last_undegraded":"2023-10-03T19:13:23.629124+0000","last_fullsized":"2023-10-03T19:13:23.629124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:52:31.490114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.348006+0000","last_change":"2023-10-03T19:13:20.970078+0000","last_active":"2023-10-03T19:13:21.348006+0000","last_peered":"2023-10-03T19:13:21.348006+0000","last_clean":"2023-10-03T19:13:21.348006+0000","last_became_active":"2023-10-03T19:13:20.969404+0000","last_became_peered":"2023-10-03T19:13:20.969404+0000","last_unstale":"2023-10-03T19:13:21.348006+0000","last_undegraded":"2023-10-03T19:13:21.348006+0000","last_fullsized":"2023-10-03T19:13:21.348006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:06:40.574599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.365149+0000","last_change":"2023-10-03T19:13:21.364013+0000","last_active":"2023-10-03T19:13:21.365149+0000","last_peered":"2023-10-03T19:13:21.365149+0000","last_clean":"2023-10-03T19:13:21.365149+0000","last_became_active":"2023-10-03T19:13:21.363513+0000","last_became_peered":"2023-10-03T19:13:21.363513+0000","last_unstale":"2023-10-03T19:13:21.365149+0000","last_undegraded":"2023-10-03T19:13:21.365149+0000","last_fullsized":"2023-10-03T19:13:21.365149+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:37:09.701876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.630369+0000","last_change":"2023-10-03T19:13:20.952503+0000","last_active":"2023-10-03T19:13:23.630369+0000","last_peered":"2023-10-03T19:13:23.630369+0000","last_clean":"2023-10-03T19:13:23.630369+0000","last_became_active":"2023-10-03T19:13:20.951828+0000","last_became_peered":"2023-10-03T19:13:20.951828+0000","last_unstale":"2023-10-03T19:13:23.630369+0000","last_undegraded":"2023-10-03T19:13:23.630369+0000","last_fullsized":"2023-10-03T19:13:23.630369+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:45:23.847643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388642+0000","last_change":"2023-10-03T19:13:21.376107+0000","last_active":"2023-10-03T19:13:21.388642+0000","last_peered":"2023-10-03T19:13:21.388642+0000","last_clean":"2023-10-03T19:13:21.388642+0000","last_became_active":"2023-10-03T19:13:21.373484+0000","last_became_peered":"2023-10-03T19:13:21.373484+0000","last_unstale":"2023-10-03T19:13:21.388642+0000","last_undegraded":"2023-10-03T19:13:21.388642+0000","last_fullsized":"2023-10-03T19:13:21.388642+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:10:43.840486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.333208+0000","last_change":"2023-10-03T19:13:20.960847+0000","last_active":"2023-10-03T19:13:22.333208+0000","last_peered":"2023-10-03T19:13:22.333208+0000","last_clean":"2023-10-03T19:13:22.333208+0000","last_became_active":"2023-10-03T19:13:20.960078+0000","last_became_peered":"2023-10-03T19:13:20.960078+0000","last_unstale":"2023-10-03T19:13:22.333208+0000","last_undegraded":"2023-10-03T19:13:22.333208+0000","last_fullsized":"2023-10-03T19:13:22.333208+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:14:11.662112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344788+0000","last_change":"2023-10-03T19:13:21.370395+0000","last_active":"2023-10-03T19:13:23.344788+0000","last_peered":"2023-10-03T19:13:23.344788+0000","last_clean":"2023-10-03T19:13:23.344788+0000","last_became_active":"2023-10-03T19:13:21.370113+0000","last_became_peered":"2023-10-03T19:13:21.370113+0000","last_unstale":"2023-10-03T19:13:23.344788+0000","last_undegraded":"2023-10-03T19:13:23.344788+0000","last_fullsized":"2023-10-03T19:13:23.344788+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:47:43.653717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"34'3","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332813+0000","last_change":"2023-10-03T19:13:20.961265+0000","last_active":"2023-10-03T19:13:22.332813+0000","last_peered":"2023-10-03T19:13:22.332813+0000","last_clean":"2023-10-03T19:13:22.332813+0000","last_became_active":"2023-10-03T19:13:20.959393+0000","last_became_peered":"2023-10-03T19:13:20.959393+0000","last_unstale":"2023-10-03T19:13:22.332813+0000","last_undegraded":"2023-10-03T19:13:22.332813+0000","last_fullsized":"2023-10-03T19:13:22.332813+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:40:36.494610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.382201+0000","last_change":"2023-10-03T19:13:21.362691+0000","last_active":"2023-10-03T19:13:21.382201+0000","last_peered":"2023-10-03T19:13:21.382201+0000","last_clean":"2023-10-03T19:13:21.382201+0000","last_became_active":"2023-10-03T19:13:21.361488+0000","last_became_peered":"2023-10-03T19:13:21.361488+0000","last_unstale":"2023-10-03T19:13:21.382201+0000","last_undegraded":"2023-10-03T19:13:21.382201+0000","last_fullsized":"2023-10-03T19:13:21.382201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:53:21.733701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"34'6","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.629949+0000","last_change":"2023-10-03T19:13:20.972865+0000","last_active":"2023-10-03T19:13:23.629949+0000","last_peered":"2023-10-03T19:13:23.629949+0000","last_clean":"2023-10-03T19:13:23.629949+0000","last_became_active":"2023-10-03T19:13:20.972358+0000","last_became_peered":"2023-10-03T19:13:20.972358+0000","last_unstale":"2023-10-03T19:13:23.629949+0000","last_undegraded":"2023-10-03T19:13:23.629949+0000","last_fullsized":"2023-10-03T19:13:23.629949+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:57:54.218663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344127+0000","last_change":"2023-10-03T19:13:21.361649+0000","last_active":"2023-10-03T19:13:23.344127+0000","last_peered":"2023-10-03T19:13:23.344127+0000","last_clean":"2023-10-03T19:13:23.344127+0000","last_became_active":"2023-10-03T19:13:21.361411+0000","last_became_peered":"2023-10-03T19:13:21.361411+0000","last_unstale":"2023-10-03T19:13:23.344127+0000","last_undegraded":"2023-10-03T19:13:23.344127+0000","last_fullsized":"2023-10-03T19:13:23.344127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:57:14.066081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.629883+0000","last_change":"2023-10-03T19:13:20.964862+0000","last_active":"2023-10-03T19:13:23.629883+0000","last_peered":"2023-10-03T19:13:23.629883+0000","last_clean":"2023-10-03T19:13:23.629883+0000","last_became_active":"2023-10-03T19:13:20.964523+0000","last_became_peered":"2023-10-03T19:13:20.964523+0000","last_unstale":"2023-10-03T19:13:23.629883+0000","last_undegraded":"2023-10-03T19:13:23.629883+0000","last_fullsized":"2023-10-03T19:13:23.629883+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:19:44.716940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.628598+0000","last_change":"2023-10-03T19:13:21.335001+0000","last_active":"2023-10-03T19:13:23.628598+0000","last_peered":"2023-10-03T19:13:23.628598+0000","last_clean":"2023-10-03T19:13:23.628598+0000","last_became_active":"2023-10-03T19:13:21.334682+0000","last_became_peered":"2023-10-03T19:13:21.334682+0000","last_unstale":"2023-10-03T19:13:23.628598+0000","last_undegraded":"2023-10-03T19:13:23.628598+0000","last_fullsized":"2023-10-03T19:13:23.628598+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:15:55.983735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.326593+0000","last_change":"2023-10-03T19:13:20.962572+0000","last_active":"2023-10-03T19:13:21.326593+0000","last_peered":"2023-10-03T19:13:21.326593+0000","last_clean":"2023-10-03T19:13:21.326593+0000","last_became_active":"2023-10-03T19:13:20.962094+0000","last_became_peered":"2023-10-03T19:13:20.962094+0000","last_unstale":"2023-10-03T19:13:21.326593+0000","last_undegraded":"2023-10-03T19:13:21.326593+0000","last_fullsized":"2023-10-03T19:13:21.326593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:43:54.362050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388247+0000","last_change":"2023-10-03T19:13:21.371030+0000","last_active":"2023-10-03T19:13:21.388247+0000","last_peered":"2023-10-03T19:13:21.388247+0000","last_clean":"2023-10-03T19:13:21.388247+0000","last_became_active":"2023-10-03T19:13:21.369954+0000","last_became_peered":"2023-10-03T19:13:21.369954+0000","last_unstale":"2023-10-03T19:13:21.388247+0000","last_undegraded":"2023-10-03T19:13:21.388247+0000","last_fullsized":"2023-10-03T19:13:21.388247+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:19:02.156799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.328519+0000","last_change":"2023-10-03T19:13:20.967774+0000","last_active":"2023-10-03T19:13:21.328519+0000","last_peered":"2023-10-03T19:13:21.328519+0000","last_clean":"2023-10-03T19:13:21.328519+0000","last_became_active":"2023-10-03T19:13:20.965529+0000","last_became_peered":"2023-10-03T19:13:20.965529+0000","last_unstale":"2023-10-03T19:13:21.328519+0000","last_undegraded":"2023-10-03T19:13:21.328519+0000","last_fullsized":"2023-10-03T19:13:21.328519+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:17:30.367274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.629539+0000","last_change":"2023-10-03T19:13:21.342147+0000","last_active":"2023-10-03T19:13:23.629539+0000","last_peered":"2023-10-03T19:13:23.629539+0000","last_clean":"2023-10-03T19:13:23.629539+0000","last_became_active":"2023-10-03T19:13:21.341813+0000","last_became_peered":"2023-10-03T19:13:21.341813+0000","last_unstale":"2023-10-03T19:13:23.629539+0000","last_undegraded":"2023-10-03T19:13:23.629539+0000","last_fullsized":"2023-10-03T19:13:23.629539+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:45:17.978390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"34'8","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.382682+0000","last_change":"2023-10-03T19:13:20.975023+0000","last_active":"2023-10-03T19:13:21.382682+0000","last_peered":"2023-10-03T19:13:21.382682+0000","last_clean":"2023-10-03T19:13:21.382682+0000","last_became_active":"2023-10-03T19:13:20.973808+0000","last_became_peered":"2023-10-03T19:13:20.973808+0000","last_unstale":"2023-10-03T19:13:21.382682+0000","last_undegraded":"2023-10-03T19:13:21.382682+0000","last_fullsized":"2023-10-03T19:13:21.382682+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:39:54.101849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.629414+0000","last_change":"2023-10-03T19:13:21.337931+0000","last_active":"2023-10-03T19:13:23.629414+0000","last_peered":"2023-10-03T19:13:23.629414+0000","last_clean":"2023-10-03T19:13:23.629414+0000","last_became_active":"2023-10-03T19:13:21.337645+0000","last_became_peered":"2023-10-03T19:13:21.337645+0000","last_unstale":"2023-10-03T19:13:23.629414+0000","last_undegraded":"2023-10-03T19:13:23.629414+0000","last_fullsized":"2023-10-03T19:13:23.629414+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:53:21.733701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.333263+0000","last_change":"2023-10-03T19:13:20.957758+0000","last_active":"2023-10-03T19:13:22.333263+0000","last_peered":"2023-10-03T19:13:22.333263+0000","last_clean":"2023-10-03T19:13:22.333263+0000","last_became_active":"2023-10-03T19:13:20.957023+0000","last_became_peered":"2023-10-03T19:13:20.957023+0000","last_unstale":"2023-10-03T19:13:22.333263+0000","last_undegraded":"2023-10-03T19:13:22.333263+0000","last_fullsized":"2023-10-03T19:13:22.333263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:36:11.572563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332770+0000","last_change":"2023-10-03T19:13:21.386225+0000","last_active":"2023-10-03T19:13:22.332770+0000","last_peered":"2023-10-03T19:13:22.332770+0000","last_clean":"2023-10-03T19:13:22.332770+0000","last_became_active":"2023-10-03T19:13:21.381348+0000","last_became_peered":"2023-10-03T19:13:21.381348+0000","last_unstale":"2023-10-03T19:13:22.332770+0000","last_undegraded":"2023-10-03T19:13:22.332770+0000","last_fullsized":"2023-10-03T19:13:22.332770+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:59:12.814362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.391164+0000","last_change":"2023-10-03T19:13:20.965203+0000","last_active":"2023-10-03T19:13:21.391164+0000","last_peered":"2023-10-03T19:13:21.391164+0000","last_clean":"2023-10-03T19:13:21.391164+0000","last_became_active":"2023-10-03T19:13:20.963356+0000","last_became_peered":"2023-10-03T19:13:20.963356+0000","last_unstale":"2023-10-03T19:13:21.391164+0000","last_undegraded":"2023-10-03T19:13:21.391164+0000","last_fullsized":"2023-10-03T19:13:21.391164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:41:28.447361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.382600+0000","last_change":"2023-10-03T19:13:21.368113+0000","last_active":"2023-10-03T19:13:21.382600+0000","last_peered":"2023-10-03T19:13:21.382600+0000","last_clean":"2023-10-03T19:13:21.382600+0000","last_became_active":"2023-10-03T19:13:21.367345+0000","last_became_peered":"2023-10-03T19:13:21.367345+0000","last_unstale":"2023-10-03T19:13:21.382600+0000","last_undegraded":"2023-10-03T19:13:21.382600+0000","last_fullsized":"2023-10-03T19:13:21.382600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:26:10.484739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.374764+0000","last_change":"2023-10-03T19:13:20.972574+0000","last_active":"2023-10-03T19:13:21.374764+0000","last_peered":"2023-10-03T19:13:21.374764+0000","last_clean":"2023-10-03T19:13:21.374764+0000","last_became_active":"2023-10-03T19:13:20.972119+0000","last_became_peered":"2023-10-03T19:13:20.972119+0000","last_unstale":"2023-10-03T19:13:21.374764+0000","last_undegraded":"2023-10-03T19:13:21.374764+0000","last_fullsized":"2023-10-03T19:13:21.374764+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:14:08.106459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.341400+0000","last_change":"2023-10-03T19:13:21.339682+0000","last_active":"2023-10-03T19:13:21.341400+0000","last_peered":"2023-10-03T19:13:21.341400+0000","last_clean":"2023-10-03T19:13:21.341400+0000","last_became_active":"2023-10-03T19:13:21.339291+0000","last_became_peered":"2023-10-03T19:13:21.339291+0000","last_unstale":"2023-10-03T19:13:21.341400+0000","last_undegraded":"2023-10-03T19:13:21.341400+0000","last_fullsized":"2023-10-03T19:13:21.341400+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:11:12.253825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.327634+0000","last_change":"2023-10-03T19:13:20.951006+0000","last_active":"2023-10-03T19:13:21.327634+0000","last_peered":"2023-10-03T19:13:21.327634+0000","last_clean":"2023-10-03T19:13:21.327634+0000","last_became_active":"2023-10-03T19:13:20.950606+0000","last_became_peered":"2023-10-03T19:13:20.950606+0000","last_unstale":"2023-10-03T19:13:21.327634+0000","last_undegraded":"2023-10-03T19:13:21.327634+0000","last_fullsized":"2023-10-03T19:13:21.327634+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:03:32.890413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388419+0000","last_change":"2023-10-03T19:13:21.372118+0000","last_active":"2023-10-03T19:13:21.388419+0000","last_peered":"2023-10-03T19:13:21.388419+0000","last_clean":"2023-10-03T19:13:21.388419+0000","last_became_active":"2023-10-03T19:13:21.370009+0000","last_became_peered":"2023-10-03T19:13:21.370009+0000","last_unstale":"2023-10-03T19:13:21.388419+0000","last_undegraded":"2023-10-03T19:13:21.388419+0000","last_fullsized":"2023-10-03T19:13:21.388419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:53:06.561881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.337198+0000","last_change":"2023-10-03T19:13:20.954261+0000","last_active":"2023-10-03T19:13:21.337198+0000","last_peered":"2023-10-03T19:13:21.337198+0000","last_clean":"2023-10-03T19:13:21.337198+0000","last_became_active":"2023-10-03T19:13:20.953905+0000","last_became_peered":"2023-10-03T19:13:20.953905+0000","last_unstale":"2023-10-03T19:13:21.337198+0000","last_undegraded":"2023-10-03T19:13:21.337198+0000","last_fullsized":"2023-10-03T19:13:21.337198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:19:04.380130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344213+0000","last_change":"2023-10-03T19:13:21.372131+0000","last_active":"2023-10-03T19:13:23.344213+0000","last_peered":"2023-10-03T19:13:23.344213+0000","last_clean":"2023-10-03T19:13:23.344213+0000","last_became_active":"2023-10-03T19:13:21.371809+0000","last_became_peered":"2023-10-03T19:13:21.371809+0000","last_unstale":"2023-10-03T19:13:23.344213+0000","last_undegraded":"2023-10-03T19:13:23.344213+0000","last_fullsized":"2023-10-03T19:13:23.344213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:57:40.440963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.320058+0000","last_change":"2023-10-03T19:13:20.960919+0000","last_active":"2023-10-03T19:13:21.320058+0000","last_peered":"2023-10-03T19:13:21.320058+0000","last_clean":"2023-10-03T19:13:21.320058+0000","last_became_active":"2023-10-03T19:13:20.960593+0000","last_became_peered":"2023-10-03T19:13:20.960593+0000","last_unstale":"2023-10-03T19:13:21.320058+0000","last_undegraded":"2023-10-03T19:13:21.320058+0000","last_fullsized":"2023-10-03T19:13:21.320058+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:56:05.170459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332228+0000","last_change":"2023-10-03T19:13:21.365073+0000","last_active":"2023-10-03T19:13:22.332228+0000","last_peered":"2023-10-03T19:13:22.332228+0000","last_clean":"2023-10-03T19:13:22.332228+0000","last_became_active":"2023-10-03T19:13:21.364541+0000","last_became_peered":"2023-10-03T19:13:21.364541+0000","last_unstale":"2023-10-03T19:13:22.332228+0000","last_undegraded":"2023-10-03T19:13:22.332228+0000","last_fullsized":"2023-10-03T19:13:22.332228+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:00:58.829969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.326883+0000","last_change":"2023-10-03T19:13:20.977060+0000","last_active":"2023-10-03T19:13:21.326883+0000","last_peered":"2023-10-03T19:13:21.326883+0000","last_clean":"2023-10-03T19:13:21.326883+0000","last_became_active":"2023-10-03T19:13:20.976504+0000","last_became_peered":"2023-10-03T19:13:20.976504+0000","last_unstale":"2023-10-03T19:13:21.326883+0000","last_undegraded":"2023-10-03T19:13:21.326883+0000","last_fullsized":"2023-10-03T19:13:21.326883+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:48:48.027499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.629715+0000","last_change":"2023-10-03T19:13:21.368817+0000","last_active":"2023-10-03T19:13:23.629715+0000","last_peered":"2023-10-03T19:13:23.629715+0000","last_clean":"2023-10-03T19:13:23.629715+0000","last_became_active":"2023-10-03T19:13:21.368494+0000","last_became_peered":"2023-10-03T19:13:21.368494+0000","last_unstale":"2023-10-03T19:13:23.629715+0000","last_undegraded":"2023-10-03T19:13:23.629715+0000","last_fullsized":"2023-10-03T19:13:23.629715+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:26:10.484739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.320048+0000","last_change":"2023-10-03T19:13:20.958773+0000","last_active":"2023-10-03T19:13:21.320048+0000","last_peered":"2023-10-03T19:13:21.320048+0000","last_clean":"2023-10-03T19:13:21.320048+0000","last_became_active":"2023-10-03T19:13:20.958365+0000","last_became_peered":"2023-10-03T19:13:20.958365+0000","last_unstale":"2023-10-03T19:13:21.320048+0000","last_undegraded":"2023-10-03T19:13:21.320048+0000","last_fullsized":"2023-10-03T19:13:21.320048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:28:03.119661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332884+0000","last_change":"2023-10-03T19:13:21.392175+0000","last_active":"2023-10-03T19:13:22.332884+0000","last_peered":"2023-10-03T19:13:22.332884+0000","last_clean":"2023-10-03T19:13:22.332884+0000","last_became_active":"2023-10-03T19:13:21.389898+0000","last_became_peered":"2023-10-03T19:13:21.389898+0000","last_unstale":"2023-10-03T19:13:22.332884+0000","last_undegraded":"2023-10-03T19:13:22.332884+0000","last_fullsized":"2023-10-03T19:13:22.332884+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:26:48.120113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.338248+0000","last_change":"2023-10-03T19:13:20.974327+0000","last_active":"2023-10-03T19:13:21.338248+0000","last_peered":"2023-10-03T19:13:21.338248+0000","last_clean":"2023-10-03T19:13:21.338248+0000","last_became_active":"2023-10-03T19:13:20.973755+0000","last_became_peered":"2023-10-03T19:13:20.973755+0000","last_unstale":"2023-10-03T19:13:21.338248+0000","last_undegraded":"2023-10-03T19:13:21.338248+0000","last_fullsized":"2023-10-03T19:13:21.338248+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:53:20.722184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":191,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.326398+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:13:21.326398+0000","last_peered":"2023-10-03T19:13:21.326398+0000","last_clean":"2023-10-03T19:13:21.326398+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:13:21.326398+0000","last_undegraded":"2023-10-03T19:13:21.326398+0000","last_fullsized":"2023-10-03T19:13:21.326398+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:13:03.709387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332331+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:13:22.332331+0000","last_peered":"2023-10-03T19:13:22.332331+0000","last_clean":"2023-10-03T19:13:22.332331+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:13:22.332331+0000","last_undegraded":"2023-10-03T19:13:22.332331+0000","last_fullsized":"2023-10-03T19:13:22.332331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:23:55.753435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.378172+0000","last_change":"2023-10-03T19:13:21.377405+0000","last_active":"2023-10-03T19:13:21.378172+0000","last_peered":"2023-10-03T19:13:21.378172+0000","last_clean":"2023-10-03T19:13:21.378172+0000","last_became_active":"2023-10-03T19:13:21.377187+0000","last_became_peered":"2023-10-03T19:13:21.377187+0000","last_unstale":"2023-10-03T19:13:21.378172+0000","last_undegraded":"2023-10-03T19:13:21.378172+0000","last_fullsized":"2023-10-03T19:13:21.378172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:04:27.975140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.333408+0000","last_change":"2023-10-03T19:13:20.958706+0000","last_active":"2023-10-03T19:13:22.333408+0000","last_peered":"2023-10-03T19:13:22.333408+0000","last_clean":"2023-10-03T19:13:22.333408+0000","last_became_active":"2023-10-03T19:13:20.956435+0000","last_became_peered":"2023-10-03T19:13:20.956435+0000","last_unstale":"2023-10-03T19:13:22.333408+0000","last_undegraded":"2023-10-03T19:13:22.333408+0000","last_fullsized":"2023-10-03T19:13:22.333408+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:04:53.519874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.325293+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:13:21.325293+0000","last_peered":"2023-10-03T19:13:21.325293+0000","last_clean":"2023-10-03T19:13:21.325293+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:13:21.325293+0000","last_undegraded":"2023-10-03T19:13:21.325293+0000","last_fullsized":"2023-10-03T19:13:21.325293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:07:00.971532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388558+0000","last_change":"2023-10-03T19:13:21.374113+0000","last_active":"2023-10-03T19:13:21.388558+0000","last_peered":"2023-10-03T19:13:21.388558+0000","last_clean":"2023-10-03T19:13:21.388558+0000","last_became_active":"2023-10-03T19:13:21.370727+0000","last_became_peered":"2023-10-03T19:13:21.370727+0000","last_unstale":"2023-10-03T19:13:21.388558+0000","last_undegraded":"2023-10-03T19:13:21.388558+0000","last_fullsized":"2023-10-03T19:13:21.388558+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:15:55.983735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.325186+0000","last_change":"2023-10-03T19:13:20.961506+0000","last_active":"2023-10-03T19:13:21.325186+0000","last_peered":"2023-10-03T19:13:21.325186+0000","last_clean":"2023-10-03T19:13:21.325186+0000","last_became_active":"2023-10-03T19:13:20.961101+0000","last_became_peered":"2023-10-03T19:13:20.961101+0000","last_unstale":"2023-10-03T19:13:21.325186+0000","last_undegraded":"2023-10-03T19:13:21.325186+0000","last_fullsized":"2023-10-03T19:13:21.325186+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:08:18.162950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.319655+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:13:21.319655+0000","last_peered":"2023-10-03T19:13:21.319655+0000","last_clean":"2023-10-03T19:13:21.319655+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:13:21.319655+0000","last_undegraded":"2023-10-03T19:13:21.319655+0000","last_fullsized":"2023-10-03T19:13:21.319655+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:04:05.555255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.630226+0000","last_change":"2023-10-03T19:13:21.374564+0000","last_active":"2023-10-03T19:13:23.630226+0000","last_peered":"2023-10-03T19:13:23.630226+0000","last_clean":"2023-10-03T19:13:23.630226+0000","last_became_active":"2023-10-03T19:13:21.374299+0000","last_became_peered":"2023-10-03T19:13:21.374299+0000","last_unstale":"2023-10-03T19:13:23.630226+0000","last_undegraded":"2023-10-03T19:13:23.630226+0000","last_fullsized":"2023-10-03T19:13:23.630226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:50:20.193476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344207+0000","last_change":"2023-10-03T19:13:20.951648+0000","last_active":"2023-10-03T19:13:23.344207+0000","last_peered":"2023-10-03T19:13:23.344207+0000","last_clean":"2023-10-03T19:13:23.344207+0000","last_became_active":"2023-10-03T19:13:20.950901+0000","last_became_peered":"2023-10-03T19:13:20.950901+0000","last_unstale":"2023-10-03T19:13:23.344207+0000","last_undegraded":"2023-10-03T19:13:23.344207+0000","last_fullsized":"2023-10-03T19:13:23.344207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:27:55.601869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332066+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:13:22.332066+0000","last_peered":"2023-10-03T19:13:22.332066+0000","last_clean":"2023-10-03T19:13:22.332066+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:13:22.332066+0000","last_undegraded":"2023-10-03T19:13:22.332066+0000","last_fullsized":"2023-10-03T19:13:22.332066+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:11:13.218075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344474+0000","last_change":"2023-10-03T19:13:21.339724+0000","last_active":"2023-10-03T19:13:23.344474+0000","last_peered":"2023-10-03T19:13:23.344474+0000","last_clean":"2023-10-03T19:13:23.344474+0000","last_became_active":"2023-10-03T19:13:21.339332+0000","last_became_peered":"2023-10-03T19:13:21.339332+0000","last_unstale":"2023-10-03T19:13:23.344474+0000","last_undegraded":"2023-10-03T19:13:23.344474+0000","last_fullsized":"2023-10-03T19:13:23.344474+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:01:06.037410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344737+0000","last_change":"2023-10-03T19:13:20.970059+0000","last_active":"2023-10-03T19:13:23.344737+0000","last_peered":"2023-10-03T19:13:23.344737+0000","last_clean":"2023-10-03T19:13:23.344737+0000","last_became_active":"2023-10-03T19:13:20.969451+0000","last_became_peered":"2023-10-03T19:13:20.969451+0000","last_unstale":"2023-10-03T19:13:23.344737+0000","last_undegraded":"2023-10-03T19:13:23.344737+0000","last_fullsized":"2023-10-03T19:13:23.344737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:27:28.531397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.327570+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:13:21.327570+0000","last_peered":"2023-10-03T19:13:21.327570+0000","last_clean":"2023-10-03T19:13:21.327570+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:13:21.327570+0000","last_undegraded":"2023-10-03T19:13:21.327570+0000","last_fullsized":"2023-10-03T19:13:21.327570+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:18:44.840190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.340055+0000","last_change":"2023-10-03T19:13:21.339247+0000","last_active":"2023-10-03T19:13:21.340055+0000","last_peered":"2023-10-03T19:13:21.340055+0000","last_clean":"2023-10-03T19:13:21.340055+0000","last_became_active":"2023-10-03T19:13:21.338947+0000","last_became_peered":"2023-10-03T19:13:21.338947+0000","last_unstale":"2023-10-03T19:13:21.340055+0000","last_undegraded":"2023-10-03T19:13:21.340055+0000","last_fullsized":"2023-10-03T19:13:21.340055+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:25:58.160334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.328948+0000","last_change":"2023-10-03T19:13:20.964605+0000","last_active":"2023-10-03T19:13:21.328948+0000","last_peered":"2023-10-03T19:13:21.328948+0000","last_clean":"2023-10-03T19:13:21.328948+0000","last_became_active":"2023-10-03T19:13:20.963993+0000","last_became_peered":"2023-10-03T19:13:20.963993+0000","last_unstale":"2023-10-03T19:13:21.328948+0000","last_undegraded":"2023-10-03T19:13:21.328948+0000","last_fullsized":"2023-10-03T19:13:21.328948+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:48:12.274201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.331038+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:13:21.331038+0000","last_peered":"2023-10-03T19:13:21.331038+0000","last_clean":"2023-10-03T19:13:21.331038+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:13:21.331038+0000","last_undegraded":"2023-10-03T19:13:21.331038+0000","last_fullsized":"2023-10-03T19:13:21.331038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:32:43.995165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.382046+0000","last_change":"2023-10-03T19:13:21.363349+0000","last_active":"2023-10-03T19:13:21.382046+0000","last_peered":"2023-10-03T19:13:21.382046+0000","last_clean":"2023-10-03T19:13:21.382046+0000","last_became_active":"2023-10-03T19:13:21.362328+0000","last_became_peered":"2023-10-03T19:13:21.362328+0000","last_unstale":"2023-10-03T19:13:21.382046+0000","last_undegraded":"2023-10-03T19:13:21.382046+0000","last_fullsized":"2023-10-03T19:13:21.382046+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:56:03.182827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.347635+0000","last_change":"2023-10-03T19:13:20.954919+0000","last_active":"2023-10-03T19:13:21.347635+0000","last_peered":"2023-10-03T19:13:21.347635+0000","last_clean":"2023-10-03T19:13:21.347635+0000","last_became_active":"2023-10-03T19:13:20.954183+0000","last_became_peered":"2023-10-03T19:13:20.954183+0000","last_unstale":"2023-10-03T19:13:21.347635+0000","last_undegraded":"2023-10-03T19:13:21.347635+0000","last_fullsized":"2023-10-03T19:13:21.347635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:45:23.847643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.327829+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:13:21.327829+0000","last_peered":"2023-10-03T19:13:21.327829+0000","last_clean":"2023-10-03T19:13:21.327829+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:13:21.327829+0000","last_undegraded":"2023-10-03T19:13:21.327829+0000","last_fullsized":"2023-10-03T19:13:21.327829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:38:27.108483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.388363+0000","last_change":"2023-10-03T19:13:21.371931+0000","last_active":"2023-10-03T19:13:21.388363+0000","last_peered":"2023-10-03T19:13:21.388363+0000","last_clean":"2023-10-03T19:13:21.388363+0000","last_became_active":"2023-10-03T19:13:21.370833+0000","last_became_peered":"2023-10-03T19:13:21.370833+0000","last_unstale":"2023-10-03T19:13:21.388363+0000","last_undegraded":"2023-10-03T19:13:21.388363+0000","last_fullsized":"2023-10-03T19:13:21.388363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:32:53.308272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.628265+0000","last_change":"2023-10-03T19:13:20.952123+0000","last_active":"2023-10-03T19:13:23.628265+0000","last_peered":"2023-10-03T19:13:23.628265+0000","last_clean":"2023-10-03T19:13:23.628265+0000","last_became_active":"2023-10-03T19:13:20.951627+0000","last_became_peered":"2023-10-03T19:13:20.951627+0000","last_unstale":"2023-10-03T19:13:23.628265+0000","last_undegraded":"2023-10-03T19:13:23.628265+0000","last_fullsized":"2023-10-03T19:13:23.628265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:32:52.296756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-03T19:13:21.330387+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:13:21.330387+0000","last_peered":"2023-10-03T19:13:21.330387+0000","last_clean":"2023-10-03T19:13:21.330387+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:13:21.330387+0000","last_undegraded":"2023-10-03T19:13:21.330387+0000","last_fullsized":"2023-10-03T19:13:21.330387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:32:54.906695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9416,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362424,"statfs":{"total":96636764160,"available":96627122176,"internally_reserved":0,"allocated":458752,"data_stored":747260,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]}]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8696,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363144,"statfs":{"total":96636764160,"available":96627859456,"internally_reserved":0,"allocated":376832,"data_stored":154676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":0.90300000000000002}]},{"osd":1,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.93700000000000006}]},{"osd":2,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.63300000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":0.67000000000000004}]},{"osd":4,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":1.054},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.997}]},{"osd":5,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.2570000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.1319999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.095},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.0289999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8812,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94363028,"statfs":{"total":96636764160,"available":96627740672,"internally_reserved":0,"allocated":364544,"data_stored":148130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":1.071}]},{"osd":1,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.9750000000000001,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.58499999999999996}]},{"osd":2,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.8809999999999998,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":1.153}]},{"osd":3,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":3.0369999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":1.121}]},{"osd":5,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.948},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":1.2909999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":3.0840000000000001,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.8919999999999999,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":2.0760000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.327},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":3.1230000000000002,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":1.1930000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12856,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":12480,"kb_avail":94358984,"statfs":{"total":96636764160,"available":96623599616,"internally_reserved":0,"allocated":376832,"data_stored":154164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12779520},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.68700000000000006}]},{"osd":1,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.497},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.56999999999999995}]},{"osd":3,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.82399999999999995}]},{"osd":4,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":1.0660000000000001}]},{"osd":5,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.92500000000000004}]},{"osd":6,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.034}]},{"osd":7,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":1.016}]}]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8828,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94363012,"statfs":{"total":96636764160,"available":96627724288,"internally_reserved":0,"allocated":380928,"data_stored":155348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542160,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8916,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362924,"statfs":{"total":96636764160,"available":96627634176,"internally_reserved":0,"allocated":405504,"data_stored":163509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.55900000000000005}]},{"osd":1,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.47299999999999998}]},{"osd":2,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.57999999999999996}]},{"osd":4,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.72299999999999998}]},{"osd":5,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.73899999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.70599999999999996}]},{"osd":7,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.879}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8844,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362996,"statfs":{"total":96636764160,"available":96627707904,"internally_reserved":0,"allocated":397312,"data_stored":162023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:13:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.83199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":3,"last update":"Tue Oct 3 19:13:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.60099999999999998},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.73199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13444,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":12992,"kb_avail":94358396,"statfs":{"total":96636764160,"available":96622997504,"internally_reserved":0,"allocated":454656,"data_stored":751149,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":13303808},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":1.218}]},{"osd":2,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.94699999999999995}]},{"osd":3,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.75900000000000001}]},{"osd":4,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.347}]},{"osd":5,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.3009999999999999},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.84999999999999998}]},{"osd":6,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.034},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.056}]},{"osd":7,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.1499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:13:29.852 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:13:29.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.984+0000 7fa28959e640 1 Processor -- start 2023-10-03T19:13:29.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.984+0000 7fa28959e640 1 -- start start 2023-10-03T19:13:29.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.984+0000 7fa28959e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa284148b90 0x7fa2840bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:29.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.984+0000 7fa28959e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa2840bcb60 0x7fa28406c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:29.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.984+0000 7fa28959e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa28414b610 con 0x7fa2840bc4a0 2023-10-03T19:13:29.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.984+0000 7fa28959e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2840a3670 con 0x7fa2840bcb60 2023-10-03T19:13:29.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.984+0000 7fa28959e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa28414b370 con 0x7fa284148b90 2023-10-03T19:13:29.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.984+0000 7fa2827fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa2840bcb60 0x7fa28406c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:29.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.984+0000 7fa2837fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa2840bc4a0 0x7fa28406c7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35836/0 (socket says 172.21.15.45:35836) 2023-10-03T19:13:29.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.984+0000 7fa2837fe640 1 -- 172.21.15.45:0/2962152382 learned_addr learned my addr 172.21.15.45:0/2962152382 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:29.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.984+0000 7fa282ffd640 1 --2- 172.21.15.45:0/2962152382 >> v2:172.21.15.79:3300/0 conn(0x7fa284148b90 0x7fa2840bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:29.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.984+0000 7fa2827fc640 1 -- 172.21.15.45:0/2962152382 >> v2:172.21.15.79:3300/0 conn(0x7fa284148b90 msgr2=0x7fa2840bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:29.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.984+0000 7fa2827fc640 1 --2- 172.21.15.45:0/2962152382 >> v2:172.21.15.79:3300/0 conn(0x7fa284148b90 0x7fa2840bbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:29.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.984+0000 7fa2827fc640 1 -- 172.21.15.45:0/2962152382 >> v1:172.21.15.45:6789/0 conn(0x7fa2840bc4a0 legacy=0x7fa28406c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:29.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.984+0000 7fa281ffb640 1 -- 172.21.15.45:0/2962152382 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3159012461 0 0) 0x7fa28414b610 con 0x7fa2840bc4a0 2023-10-03T19:13:29.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.984+0000 7fa2827fc640 1 -- 172.21.15.45:0/2962152382 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2840a5580 con 0x7fa2840bcb60 2023-10-03T19:13:29.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.988+0000 7fa2827fc640 1 --2- 172.21.15.45:0/2962152382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2840bcb60 0x7fa28406c290 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa28406d660 tx=0x7fa27801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608c6f7dc5a71e0e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:29.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.988+0000 7fa281ffb640 1 -- 172.21.15.45:0/2962152382 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2780a8950 con 0x7fa2840bcb60 2023-10-03T19:13:29.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.988+0000 7fa281ffb640 1 -- 172.21.15.45:0/2962152382 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2780a8ab0 con 0x7fa2840bcb60 2023-10-03T19:13:29.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.988+0000 7fa281ffb640 1 -- 172.21.15.45:0/2962152382 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2780a8e40 con 0x7fa2840bcb60 2023-10-03T19:13:29.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.988+0000 7fa28959e640 1 -- 172.21.15.45:0/2962152382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2840bcb60 msgr2=0x7fa28406c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:29.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.988+0000 7fa28959e640 1 --2- 172.21.15.45:0/2962152382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2840bcb60 0x7fa28406c290 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa28406d660 tx=0x7fa27801ec50 comp rx=0 tx=0).stop 2023-10-03T19:13:29.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.988+0000 7fa28959e640 1 -- 172.21.15.45:0/2962152382 shutdown_connections 2023-10-03T19:13:29.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.988+0000 7fa28959e640 1 --2- 172.21.15.45:0/2962152382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2840bcb60 0x7fa28406c290 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:29.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.988+0000 7fa28959e640 1 --2- 172.21.15.45:0/2962152382 >> v2:172.21.15.79:3300/0 conn(0x7fa284148b90 0x7fa2840bbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:29.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.988+0000 7fa28959e640 1 -- 172.21.15.45:0/2962152382 >> 172.21.15.45:0/2962152382 conn(0x7fa2840bcf50 msgr2=0x7fa2840bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:29.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.988+0000 7fa28959e640 1 -- 172.21.15.45:0/2962152382 shutdown_connections 2023-10-03T19:13:29.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.988+0000 7fa28959e640 1 -- 172.21.15.45:0/2962152382 wait complete. 2023-10-03T19:13:29.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.988+0000 7fa28959e640 1 Processor -- start 2023-10-03T19:13:29.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.988+0000 7fa28959e640 1 -- start start 2023-10-03T19:13:29.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.988+0000 7fa28959e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2840bc4a0 0x7fa28414ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:29.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.988+0000 7fa28959e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2840bcb60 0x7fa2840bf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:29.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.988+0000 7fa28959e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa284148b90 0x7fa2841e2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:29.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.988+0000 7fa28959e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28414e7f0 con 0x7fa284148b90 2023-10-03T19:13:29.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.988+0000 7fa28959e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2840bf830 con 0x7fa2840bcb60 2023-10-03T19:13:29.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.988+0000 7fa28959e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2840b6c10 con 0x7fa2840bc4a0 2023-10-03T19:13:29.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.988+0000 7fa2837fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa284148b90 0x7fa2841e2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:29.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.988+0000 7fa2837fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa284148b90 0x7fa2841e2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54136/0 (socket says 172.21.15.45:54136) 2023-10-03T19:13:29.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.988+0000 7fa2837fe640 1 -- 172.21.15.45:0/3656429973 learned_addr learned my addr 172.21.15.45:0/3656429973 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:29.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.988+0000 7fa2827fc640 1 --2- 172.21.15.45:0/3656429973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2840bcb60 0x7fa2840bf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:29.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.988+0000 7fa282ffd640 1 --2- 172.21.15.45:0/3656429973 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2840bc4a0 0x7fa28414ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:29.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.988+0000 7fa2837fe640 1 -- 172.21.15.45:0/3656429973 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2840bc4a0 msgr2=0x7fa28414ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:29.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.988+0000 7fa2837fe640 1 --2- 172.21.15.45:0/3656429973 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2840bc4a0 0x7fa28414ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:29.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.988+0000 7fa2837fe640 1 -- 172.21.15.45:0/3656429973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2840bcb60 msgr2=0x7fa2840bf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:29.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.988+0000 7fa2837fe640 1 --2- 172.21.15.45:0/3656429973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2840bcb60 0x7fa2840bf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:29.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.988+0000 7fa2837fe640 1 -- 172.21.15.45:0/3656429973 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa278009420 con 0x7fa284148b90 2023-10-03T19:13:29.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.992+0000 7fa2837fe640 1 --2- 172.21.15.45:0/3656429973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa284148b90 0x7fa2841e2b10 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa27c001570 tx=0x7fa27c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:29.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.992+0000 7fa26b7fe640 1 -- 172.21.15.45:0/3656429973 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c00a640 con 0x7fa284148b90 2023-10-03T19:13:29.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.992+0000 7fa26b7fe640 1 -- 172.21.15.45:0/3656429973 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27c00a7a0 con 0x7fa284148b90 2023-10-03T19:13:29.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.992+0000 7fa26b7fe640 1 -- 172.21.15.45:0/3656429973 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c00ab90 con 0x7fa284148b90 2023-10-03T19:13:29.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.992+0000 7fa28959e640 1 -- 172.21.15.45:0/3656429973 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa28406cee0 con 0x7fa284148b90 2023-10-03T19:13:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.992+0000 7fa28959e640 1 -- 172.21.15.45:0/3656429973 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2840a5820 con 0x7fa284148b90 2023-10-03T19:13:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.992+0000 7fa28959e640 1 -- 172.21.15.45:0/3656429973 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa284148f60 con 0x7fa284148b90 2023-10-03T19:13:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.992+0000 7fa26b7fe640 1 -- 172.21.15.45:0/3656429973 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa27c00acf0 con 0x7fa284148b90 2023-10-03T19:13:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.992+0000 7fa26b7fe640 1 --2- 172.21.15.45:0/3656429973 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa270066280 0x7fa270068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.992+0000 7fa26b7fe640 1 -- 172.21.15.45:0/3656429973 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa27c0831f0 con 0x7fa284148b90 2023-10-03T19:13:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.992+0000 7fa282ffd640 1 --2- 172.21.15.45:0/3656429973 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa270066280 0x7fa270068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.992+0000 7fa282ffd640 1 --2- 172.21.15.45:0/3656429973 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa270066280 0x7fa270068730 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa274009a50 tx=0x7fa274008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:30.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:29.996+0000 7fa26b7fe640 1 -- 172.21.15.45:0/3656429973 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa27c050710 con 0x7fa284148b90 2023-10-03T19:13:30.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.148+0000 7fa28959e640 1 -- 172.21.15.45:0/3656429973 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa28404de80 con 0x7fa270066280 2023-10-03T19:13:30.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.172+0000 7fa26b7fe640 1 -- 172.21.15.45:0/3656429973 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308631 (secure 0 0 0) 0x7fa28404de80 con 0x7fa270066280 2023-10-03T19:13:30.178 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:13:30.181 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:13:30.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.176+0000 7fa28959e640 1 -- 172.21.15.45:0/3656429973 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa270066280 msgr2=0x7fa270068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:30.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.176+0000 7fa28959e640 1 --2- 172.21.15.45:0/3656429973 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa270066280 0x7fa270068730 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa274009a50 tx=0x7fa274008040 comp rx=0 tx=0).stop 2023-10-03T19:13:30.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.176+0000 7fa28959e640 1 -- 172.21.15.45:0/3656429973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa284148b90 msgr2=0x7fa2841e2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:30.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.176+0000 7fa28959e640 1 --2- 172.21.15.45:0/3656429973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa284148b90 0x7fa2841e2b10 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa27c001570 tx=0x7fa27c00cc70 comp rx=0 tx=0).stop 2023-10-03T19:13:30.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.176+0000 7fa28959e640 1 -- 172.21.15.45:0/3656429973 shutdown_connections 2023-10-03T19:13:30.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.176+0000 7fa28959e640 1 --2- 172.21.15.45:0/3656429973 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa270066280 0x7fa270068730 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:30.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.176+0000 7fa28959e640 1 --2- 172.21.15.45:0/3656429973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa284148b90 0x7fa2841e2b10 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:30.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.176+0000 7fa28959e640 1 --2- 172.21.15.45:0/3656429973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2840bcb60 0x7fa2840bf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:30.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.176+0000 7fa28959e640 1 --2- 172.21.15.45:0/3656429973 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2840bc4a0 0x7fa28414ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:30.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.176+0000 7fa28959e640 1 -- 172.21.15.45:0/3656429973 >> 172.21.15.45:0/3656429973 conn(0x7fa2840bcf50 msgr2=0x7fa28406c190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:30.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.176+0000 7fa28959e640 1 -- 172.21.15.45:0/3656429973 shutdown_connections 2023-10-03T19:13:30.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.176+0000 7fa28959e640 1 -- 172.21.15.45:0/3656429973 wait complete. 2023-10-03T19:13:30.199 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2023-10-03T19:13:28.461330+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":199,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":80084,"kb_used_data":3220,"kb_used_omap":0,"kb_used_meta":76800,"kb_avail":754894636,"statfs":{"total":773094113280,"available":773012107264,"internally_reserved":0,"allocated":3297280,"data_stored":2477256,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":78643200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.535647"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.630079+0000","last_change":"2023-10-03T19:13:21.340387+0000","last_active":"2023-10-03T19:13:23.630079+0000","last_peered":"2023-10-03T19:13:23.630079+0000","last_clean":"2023-10-03T19:13:23.630079+0000","last_became_active":"2023-10-03T19:13:21.338937+0000","last_became_peered":"2023-10-03T19:13:21.338937+0000","last_unstale":"2023-10-03T19:13:23.630079+0000","last_undegraded":"2023-10-03T19:13:23.630079+0000","last_fullsized":"2023-10-03T19:13:23.630079+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:56:03.182827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.629256+0000","last_change":"2023-10-03T19:13:21.332772+0000","last_active":"2023-10-03T19:13:23.629256+0000","last_peered":"2023-10-03T19:13:23.629256+0000","last_clean":"2023-10-03T19:13:23.629256+0000","last_became_active":"2023-10-03T19:13:21.332383+0000","last_became_peered":"2023-10-03T19:13:21.332383+0000","last_unstale":"2023-10-03T19:13:23.629256+0000","last_undegraded":"2023-10-03T19:13:23.629256+0000","last_fullsized":"2023-10-03T19:13:23.629256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:38:14.290892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344409+0000","last_change":"2023-10-03T19:13:21.385258+0000","last_active":"2023-10-03T19:13:23.344409+0000","last_peered":"2023-10-03T19:13:23.344409+0000","last_clean":"2023-10-03T19:13:23.344409+0000","last_became_active":"2023-10-03T19:13:21.384907+0000","last_became_peered":"2023-10-03T19:13:21.384907+0000","last_unstale":"2023-10-03T19:13:23.344409+0000","last_undegraded":"2023-10-03T19:13:23.344409+0000","last_fullsized":"2023-10-03T19:13:23.344409+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:00:58.500162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.630690+0000","last_change":"2023-10-03T19:13:21.364377+0000","last_active":"2023-10-03T19:13:23.630690+0000","last_peered":"2023-10-03T19:13:23.630690+0000","last_clean":"2023-10-03T19:13:23.630690+0000","last_became_active":"2023-10-03T19:13:21.364029+0000","last_became_peered":"2023-10-03T19:13:21.364029+0000","last_unstale":"2023-10-03T19:13:23.630690+0000","last_undegraded":"2023-10-03T19:13:23.630690+0000","last_fullsized":"2023-10-03T19:13:23.630690+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:33:53.510100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.629860+0000","last_change":"2023-10-03T19:13:21.363282+0000","last_active":"2023-10-03T19:13:23.629860+0000","last_peered":"2023-10-03T19:13:23.629860+0000","last_clean":"2023-10-03T19:13:23.629860+0000","last_became_active":"2023-10-03T19:13:21.362984+0000","last_became_peered":"2023-10-03T19:13:21.362984+0000","last_unstale":"2023-10-03T19:13:23.629860+0000","last_undegraded":"2023-10-03T19:13:23.629860+0000","last_fullsized":"2023-10-03T19:13:23.629860+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:50:45.720443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.324573+0000","last_change":"2023-10-03T19:13:21.336852+0000","last_active":"2023-10-03T19:13:22.324573+0000","last_peered":"2023-10-03T19:13:22.324573+0000","last_clean":"2023-10-03T19:13:22.324573+0000","last_became_active":"2023-10-03T19:13:21.336505+0000","last_became_peered":"2023-10-03T19:13:21.336505+0000","last_unstale":"2023-10-03T19:13:22.324573+0000","last_undegraded":"2023-10-03T19:13:22.324573+0000","last_fullsized":"2023-10-03T19:13:22.324573+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:07:59.574937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.331242+0000","last_change":"2023-10-03T19:13:21.386226+0000","last_active":"2023-10-03T19:13:22.331242+0000","last_peered":"2023-10-03T19:13:22.331242+0000","last_clean":"2023-10-03T19:13:22.331242+0000","last_became_active":"2023-10-03T19:13:21.381498+0000","last_became_peered":"2023-10-03T19:13:21.381498+0000","last_unstale":"2023-10-03T19:13:22.331242+0000","last_undegraded":"2023-10-03T19:13:22.331242+0000","last_fullsized":"2023-10-03T19:13:22.331242+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:05:10.879452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.628310+0000","last_change":"2023-10-03T19:13:21.379609+0000","last_active":"2023-10-03T19:13:23.628310+0000","last_peered":"2023-10-03T19:13:23.628310+0000","last_clean":"2023-10-03T19:13:23.628310+0000","last_became_active":"2023-10-03T19:13:21.379288+0000","last_became_peered":"2023-10-03T19:13:21.379288+0000","last_unstale":"2023-10-03T19:13:23.628310+0000","last_undegraded":"2023-10-03T19:13:23.628310+0000","last_fullsized":"2023-10-03T19:13:23.628310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:10:43.840486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344660+0000","last_change":"2023-10-03T19:13:21.379630+0000","last_active":"2023-10-03T19:13:23.344660+0000","last_peered":"2023-10-03T19:13:23.344660+0000","last_clean":"2023-10-03T19:13:23.344660+0000","last_became_active":"2023-10-03T19:13:21.379337+0000","last_became_peered":"2023-10-03T19:13:21.379337+0000","last_unstale":"2023-10-03T19:13:23.344660+0000","last_undegraded":"2023-10-03T19:13:23.344660+0000","last_fullsized":"2023-10-03T19:13:23.344660+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:05:21.993046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.333045+0000","last_change":"2023-10-03T19:13:21.387777+0000","last_active":"2023-10-03T19:13:22.333045+0000","last_peered":"2023-10-03T19:13:22.333045+0000","last_clean":"2023-10-03T19:13:22.333045+0000","last_became_active":"2023-10-03T19:13:21.387128+0000","last_became_peered":"2023-10-03T19:13:21.387128+0000","last_unstale":"2023-10-03T19:13:22.333045+0000","last_undegraded":"2023-10-03T19:13:22.333045+0000","last_fullsized":"2023-10-03T19:13:22.333045+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:33:35.559553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332600+0000","last_change":"2023-10-03T19:13:21.381901+0000","last_active":"2023-10-03T19:13:22.332600+0000","last_peered":"2023-10-03T19:13:22.332600+0000","last_clean":"2023-10-03T19:13:22.332600+0000","last_became_active":"2023-10-03T19:13:21.380706+0000","last_became_peered":"2023-10-03T19:13:21.380706+0000","last_unstale":"2023-10-03T19:13:22.332600+0000","last_undegraded":"2023-10-03T19:13:22.332600+0000","last_fullsized":"2023-10-03T19:13:22.332600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:12:39.485705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344538+0000","last_change":"2023-10-03T19:13:21.337436+0000","last_active":"2023-10-03T19:13:23.344538+0000","last_peered":"2023-10-03T19:13:23.344538+0000","last_clean":"2023-10-03T19:13:23.344538+0000","last_became_active":"2023-10-03T19:13:21.337123+0000","last_became_peered":"2023-10-03T19:13:21.337123+0000","last_unstale":"2023-10-03T19:13:23.344538+0000","last_undegraded":"2023-10-03T19:13:23.344538+0000","last_fullsized":"2023-10-03T19:13:23.344538+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:16:02.368990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332506+0000","last_change":"2023-10-03T19:13:21.387101+0000","last_active":"2023-10-03T19:13:22.332506+0000","last_peered":"2023-10-03T19:13:22.332506+0000","last_clean":"2023-10-03T19:13:22.332506+0000","last_became_active":"2023-10-03T19:13:21.386571+0000","last_became_peered":"2023-10-03T19:13:21.386571+0000","last_unstale":"2023-10-03T19:13:22.332506+0000","last_undegraded":"2023-10-03T19:13:22.332506+0000","last_fullsized":"2023-10-03T19:13:22.332506+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:48:36.421606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.329357+0000","last_change":"2023-10-03T19:13:21.365622+0000","last_active":"2023-10-03T19:13:22.329357+0000","last_peered":"2023-10-03T19:13:22.329357+0000","last_clean":"2023-10-03T19:13:22.329357+0000","last_became_active":"2023-10-03T19:13:21.364997+0000","last_became_peered":"2023-10-03T19:13:21.364997+0000","last_unstale":"2023-10-03T19:13:22.329357+0000","last_undegraded":"2023-10-03T19:13:22.329357+0000","last_fullsized":"2023-10-03T19:13:22.329357+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:58:14.458315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.331431+0000","last_change":"2023-10-03T19:13:21.382122+0000","last_active":"2023-10-03T19:13:22.331431+0000","last_peered":"2023-10-03T19:13:22.331431+0000","last_clean":"2023-10-03T19:13:22.331431+0000","last_became_active":"2023-10-03T19:13:21.380853+0000","last_became_peered":"2023-10-03T19:13:21.380853+0000","last_unstale":"2023-10-03T19:13:22.331431+0000","last_undegraded":"2023-10-03T19:13:22.331431+0000","last_fullsized":"2023-10-03T19:13:22.331431+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:12:09.744127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.780305+0000","last_change":"2023-10-03T19:13:21.382147+0000","last_active":"2023-10-03T19:13:22.780305+0000","last_peered":"2023-10-03T19:13:22.780305+0000","last_clean":"2023-10-03T19:13:22.780305+0000","last_became_active":"2023-10-03T19:13:21.381614+0000","last_became_peered":"2023-10-03T19:13:21.381614+0000","last_unstale":"2023-10-03T19:13:22.780305+0000","last_undegraded":"2023-10-03T19:13:22.780305+0000","last_fullsized":"2023-10-03T19:13:22.780305+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:56:03.182827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.781328+0000","last_change":"2023-10-03T19:13:21.391132+0000","last_active":"2023-10-03T19:13:22.781328+0000","last_peered":"2023-10-03T19:13:22.781328+0000","last_clean":"2023-10-03T19:13:22.781328+0000","last_became_active":"2023-10-03T19:13:21.390626+0000","last_became_peered":"2023-10-03T19:13:21.390626+0000","last_unstale":"2023-10-03T19:13:22.781328+0000","last_undegraded":"2023-10-03T19:13:22.781328+0000","last_fullsized":"2023-10-03T19:13:22.781328+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:45:26.719227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.399948+0000","last_change":"2023-10-03T19:13:21.369754+0000","last_active":"2023-10-03T19:13:23.399948+0000","last_peered":"2023-10-03T19:13:23.399948+0000","last_clean":"2023-10-03T19:13:23.399948+0000","last_became_active":"2023-10-03T19:13:21.368680+0000","last_became_peered":"2023-10-03T19:13:21.368680+0000","last_unstale":"2023-10-03T19:13:23.399948+0000","last_undegraded":"2023-10-03T19:13:23.399948+0000","last_fullsized":"2023-10-03T19:13:23.399948+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:03:18.902558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.630858+0000","last_change":"2023-10-03T19:13:21.332782+0000","last_active":"2023-10-03T19:13:23.630858+0000","last_peered":"2023-10-03T19:13:23.630858+0000","last_clean":"2023-10-03T19:13:23.630858+0000","last_became_active":"2023-10-03T19:13:21.332537+0000","last_became_peered":"2023-10-03T19:13:21.332537+0000","last_unstale":"2023-10-03T19:13:23.630858+0000","last_undegraded":"2023-10-03T19:13:23.630858+0000","last_fullsized":"2023-10-03T19:13:23.630858+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:21:55.879302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.399835+0000","last_change":"2023-10-03T19:13:21.366160+0000","last_active":"2023-10-03T19:13:23.399835+0000","last_peered":"2023-10-03T19:13:23.399835+0000","last_clean":"2023-10-03T19:13:23.399835+0000","last_became_active":"2023-10-03T19:13:21.365568+0000","last_became_peered":"2023-10-03T19:13:21.365568+0000","last_unstale":"2023-10-03T19:13:23.399835+0000","last_undegraded":"2023-10-03T19:13:23.399835+0000","last_fullsized":"2023-10-03T19:13:23.399835+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:10:30.742287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332079+0000","last_change":"2023-10-03T19:13:21.380192+0000","last_active":"2023-10-03T19:13:22.332079+0000","last_peered":"2023-10-03T19:13:22.332079+0000","last_clean":"2023-10-03T19:13:22.332079+0000","last_became_active":"2023-10-03T19:13:21.379452+0000","last_became_peered":"2023-10-03T19:13:21.379452+0000","last_unstale":"2023-10-03T19:13:22.332079+0000","last_undegraded":"2023-10-03T19:13:22.332079+0000","last_fullsized":"2023-10-03T19:13:22.332079+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:10:18.652000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.330125+0000","last_change":"2023-10-03T19:13:21.362845+0000","last_active":"2023-10-03T19:13:22.330125+0000","last_peered":"2023-10-03T19:13:22.330125+0000","last_clean":"2023-10-03T19:13:22.330125+0000","last_became_active":"2023-10-03T19:13:21.361610+0000","last_became_peered":"2023-10-03T19:13:21.361610+0000","last_unstale":"2023-10-03T19:13:22.330125+0000","last_undegraded":"2023-10-03T19:13:22.330125+0000","last_fullsized":"2023-10-03T19:13:22.330125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:21:46.925044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.780344+0000","last_change":"2023-10-03T19:13:21.371753+0000","last_active":"2023-10-03T19:13:22.780344+0000","last_peered":"2023-10-03T19:13:22.780344+0000","last_clean":"2023-10-03T19:13:22.780344+0000","last_became_active":"2023-10-03T19:13:21.370040+0000","last_became_peered":"2023-10-03T19:13:21.370040+0000","last_unstale":"2023-10-03T19:13:22.780344+0000","last_undegraded":"2023-10-03T19:13:22.780344+0000","last_fullsized":"2023-10-03T19:13:22.780344+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:50:20.193476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.629196+0000","last_change":"2023-10-03T19:13:21.368517+0000","last_active":"2023-10-03T19:13:23.629196+0000","last_peered":"2023-10-03T19:13:23.629196+0000","last_clean":"2023-10-03T19:13:23.629196+0000","last_became_active":"2023-10-03T19:13:21.368223+0000","last_became_peered":"2023-10-03T19:13:21.368223+0000","last_unstale":"2023-10-03T19:13:23.629196+0000","last_undegraded":"2023-10-03T19:13:23.629196+0000","last_fullsized":"2023-10-03T19:13:23.629196+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:38:54.659714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.400088+0000","last_change":"2023-10-03T19:13:21.340602+0000","last_active":"2023-10-03T19:13:23.400088+0000","last_peered":"2023-10-03T19:13:23.400088+0000","last_clean":"2023-10-03T19:13:23.400088+0000","last_became_active":"2023-10-03T19:13:21.338940+0000","last_became_peered":"2023-10-03T19:13:21.338940+0000","last_unstale":"2023-10-03T19:13:23.400088+0000","last_undegraded":"2023-10-03T19:13:23.400088+0000","last_fullsized":"2023-10-03T19:13:23.400088+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:47:48.086064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.325379+0000","last_change":"2023-10-03T19:13:21.371393+0000","last_active":"2023-10-03T19:13:22.325379+0000","last_peered":"2023-10-03T19:13:22.325379+0000","last_clean":"2023-10-03T19:13:22.325379+0000","last_became_active":"2023-10-03T19:13:21.371075+0000","last_became_peered":"2023-10-03T19:13:21.371075+0000","last_unstale":"2023-10-03T19:13:22.325379+0000","last_undegraded":"2023-10-03T19:13:22.325379+0000","last_fullsized":"2023-10-03T19:13:22.325379+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:32:53.308272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.399814+0000","last_change":"2023-10-03T19:13:21.341738+0000","last_active":"2023-10-03T19:13:23.399814+0000","last_peered":"2023-10-03T19:13:23.399814+0000","last_clean":"2023-10-03T19:13:23.399814+0000","last_became_active":"2023-10-03T19:13:21.340877+0000","last_became_peered":"2023-10-03T19:13:21.340877+0000","last_unstale":"2023-10-03T19:13:23.399814+0000","last_undegraded":"2023-10-03T19:13:23.399814+0000","last_fullsized":"2023-10-03T19:13:23.399814+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:41:25.370096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332435+0000","last_change":"2023-10-03T19:13:21.363972+0000","last_active":"2023-10-03T19:13:22.332435+0000","last_peered":"2023-10-03T19:13:22.332435+0000","last_clean":"2023-10-03T19:13:22.332435+0000","last_became_active":"2023-10-03T19:13:21.363452+0000","last_became_peered":"2023-10-03T19:13:21.363452+0000","last_unstale":"2023-10-03T19:13:22.332435+0000","last_undegraded":"2023-10-03T19:13:22.332435+0000","last_fullsized":"2023-10-03T19:13:22.332435+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:56:31.353897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.399508+0000","last_change":"2023-10-03T19:13:21.334239+0000","last_active":"2023-10-03T19:13:23.399508+0000","last_peered":"2023-10-03T19:13:23.399508+0000","last_clean":"2023-10-03T19:13:23.399508+0000","last_became_active":"2023-10-03T19:13:21.333456+0000","last_became_peered":"2023-10-03T19:13:21.333456+0000","last_unstale":"2023-10-03T19:13:23.399508+0000","last_undegraded":"2023-10-03T19:13:23.399508+0000","last_fullsized":"2023-10-03T19:13:23.399508+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:49:42.119982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.399700+0000","last_change":"2023-10-03T19:13:21.339712+0000","last_active":"2023-10-03T19:13:23.399700+0000","last_peered":"2023-10-03T19:13:23.399700+0000","last_clean":"2023-10-03T19:13:23.399700+0000","last_became_active":"2023-10-03T19:13:21.338930+0000","last_became_peered":"2023-10-03T19:13:21.338930+0000","last_unstale":"2023-10-03T19:13:23.399700+0000","last_undegraded":"2023-10-03T19:13:23.399700+0000","last_fullsized":"2023-10-03T19:13:23.399700+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:55:47.519655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.780582+0000","last_change":"2023-10-03T19:13:21.372961+0000","last_active":"2023-10-03T19:13:22.780582+0000","last_peered":"2023-10-03T19:13:22.780582+0000","last_clean":"2023-10-03T19:13:22.780582+0000","last_became_active":"2023-10-03T19:13:21.372269+0000","last_became_peered":"2023-10-03T19:13:21.372269+0000","last_unstale":"2023-10-03T19:13:22.780582+0000","last_undegraded":"2023-10-03T19:13:22.780582+0000","last_fullsized":"2023-10-03T19:13:22.780582+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:41:27.260071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.324425+0000","last_change":"2023-10-03T19:13:21.337355+0000","last_active":"2023-10-03T19:13:22.324425+0000","last_peered":"2023-10-03T19:13:22.324425+0000","last_clean":"2023-10-03T19:13:22.324425+0000","last_became_active":"2023-10-03T19:13:21.337084+0000","last_became_peered":"2023-10-03T19:13:21.337084+0000","last_unstale":"2023-10-03T19:13:22.324425+0000","last_undegraded":"2023-10-03T19:13:22.324425+0000","last_fullsized":"2023-10-03T19:13:22.324425+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:21:52.323037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.780801+0000","last_change":"2023-10-03T19:13:21.391912+0000","last_active":"2023-10-03T19:13:22.780801+0000","last_peered":"2023-10-03T19:13:22.780801+0000","last_clean":"2023-10-03T19:13:22.780801+0000","last_became_active":"2023-10-03T19:13:21.390545+0000","last_became_peered":"2023-10-03T19:13:21.390545+0000","last_unstale":"2023-10-03T19:13:22.780801+0000","last_undegraded":"2023-10-03T19:13:22.780801+0000","last_fullsized":"2023-10-03T19:13:22.780801+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:13:04.121184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"34'4","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.400271+0000","last_change":"2023-10-03T19:13:20.969426+0000","last_active":"2023-10-03T19:13:23.400271+0000","last_peered":"2023-10-03T19:13:23.400271+0000","last_clean":"2023-10-03T19:13:23.400271+0000","last_became_active":"2023-10-03T19:13:20.968732+0000","last_became_peered":"2023-10-03T19:13:20.968732+0000","last_unstale":"2023-10-03T19:13:23.400271+0000","last_undegraded":"2023-10-03T19:13:23.400271+0000","last_fullsized":"2023-10-03T19:13:23.400271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:08:21.076070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.325333+0000","last_change":"2023-10-03T19:13:21.385217+0000","last_active":"2023-10-03T19:13:22.325333+0000","last_peered":"2023-10-03T19:13:22.325333+0000","last_clean":"2023-10-03T19:13:22.325333+0000","last_became_active":"2023-10-03T19:13:21.384926+0000","last_became_peered":"2023-10-03T19:13:21.384926+0000","last_unstale":"2023-10-03T19:13:22.325333+0000","last_undegraded":"2023-10-03T19:13:22.325333+0000","last_fullsized":"2023-10-03T19:13:22.325333+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:31:42.235135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344952+0000","last_change":"2023-10-03T19:13:20.972150+0000","last_active":"2023-10-03T19:13:23.344952+0000","last_peered":"2023-10-03T19:13:23.344952+0000","last_clean":"2023-10-03T19:13:23.344952+0000","last_became_active":"2023-10-03T19:13:20.971821+0000","last_became_peered":"2023-10-03T19:13:20.971821+0000","last_unstale":"2023-10-03T19:13:23.344952+0000","last_undegraded":"2023-10-03T19:13:23.344952+0000","last_fullsized":"2023-10-03T19:13:23.344952+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:46:55.064511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.330410+0000","last_change":"2023-10-03T19:13:21.365006+0000","last_active":"2023-10-03T19:13:22.330410+0000","last_peered":"2023-10-03T19:13:22.330410+0000","last_clean":"2023-10-03T19:13:22.330410+0000","last_became_active":"2023-10-03T19:13:21.364499+0000","last_became_peered":"2023-10-03T19:13:21.364499+0000","last_unstale":"2023-10-03T19:13:22.330410+0000","last_undegraded":"2023-10-03T19:13:22.330410+0000","last_fullsized":"2023-10-03T19:13:22.330410+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:25:12.372562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.325521+0000","last_change":"2023-10-03T19:13:20.950958+0000","last_active":"2023-10-03T19:13:22.325521+0000","last_peered":"2023-10-03T19:13:22.325521+0000","last_clean":"2023-10-03T19:13:22.325521+0000","last_became_active":"2023-10-03T19:13:20.950561+0000","last_became_peered":"2023-10-03T19:13:20.950561+0000","last_unstale":"2023-10-03T19:13:22.325521+0000","last_undegraded":"2023-10-03T19:13:22.325521+0000","last_fullsized":"2023-10-03T19:13:22.325521+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:15:54.972219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.629374+0000","last_change":"2023-10-03T19:13:21.337474+0000","last_active":"2023-10-03T19:13:23.629374+0000","last_peered":"2023-10-03T19:13:23.629374+0000","last_clean":"2023-10-03T19:13:23.629374+0000","last_became_active":"2023-10-03T19:13:21.337090+0000","last_became_peered":"2023-10-03T19:13:21.337090+0000","last_unstale":"2023-10-03T19:13:23.629374+0000","last_undegraded":"2023-10-03T19:13:23.629374+0000","last_fullsized":"2023-10-03T19:13:23.629374+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:33:42.598570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.329735+0000","last_change":"2023-10-03T19:13:20.953487+0000","last_active":"2023-10-03T19:13:22.329735+0000","last_peered":"2023-10-03T19:13:22.329735+0000","last_clean":"2023-10-03T19:13:22.329735+0000","last_became_active":"2023-10-03T19:13:20.952739+0000","last_became_peered":"2023-10-03T19:13:20.952739+0000","last_unstale":"2023-10-03T19:13:22.329735+0000","last_undegraded":"2023-10-03T19:13:22.329735+0000","last_fullsized":"2023-10-03T19:13:22.329735+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:45:25.707710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344143+0000","last_change":"2023-10-03T19:13:21.335933+0000","last_active":"2023-10-03T19:13:23.344143+0000","last_peered":"2023-10-03T19:13:23.344143+0000","last_clean":"2023-10-03T19:13:23.344143+0000","last_became_active":"2023-10-03T19:13:21.335661+0000","last_became_peered":"2023-10-03T19:13:21.335661+0000","last_unstale":"2023-10-03T19:13:23.344143+0000","last_undegraded":"2023-10-03T19:13:23.344143+0000","last_fullsized":"2023-10-03T19:13:23.344143+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:14:24.053747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332061+0000","last_change":"2023-10-03T19:13:20.957478+0000","last_active":"2023-10-03T19:13:22.332061+0000","last_peered":"2023-10-03T19:13:22.332061+0000","last_clean":"2023-10-03T19:13:22.332061+0000","last_became_active":"2023-10-03T19:13:20.956389+0000","last_became_peered":"2023-10-03T19:13:20.956389+0000","last_unstale":"2023-10-03T19:13:22.332061+0000","last_undegraded":"2023-10-03T19:13:22.332061+0000","last_fullsized":"2023-10-03T19:13:22.332061+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:17:04.660877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.331680+0000","last_change":"2023-10-03T19:13:21.380338+0000","last_active":"2023-10-03T19:13:22.331680+0000","last_peered":"2023-10-03T19:13:22.331680+0000","last_clean":"2023-10-03T19:13:22.331680+0000","last_became_active":"2023-10-03T19:13:21.379660+0000","last_became_peered":"2023-10-03T19:13:21.379660+0000","last_unstale":"2023-10-03T19:13:22.331680+0000","last_undegraded":"2023-10-03T19:13:22.331680+0000","last_fullsized":"2023-10-03T19:13:22.331680+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:11:08.676258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.780417+0000","last_change":"2023-10-03T19:13:20.974925+0000","last_active":"2023-10-03T19:13:22.780417+0000","last_peered":"2023-10-03T19:13:22.780417+0000","last_clean":"2023-10-03T19:13:22.780417+0000","last_became_active":"2023-10-03T19:13:20.974368+0000","last_became_peered":"2023-10-03T19:13:20.974368+0000","last_unstale":"2023-10-03T19:13:22.780417+0000","last_undegraded":"2023-10-03T19:13:22.780417+0000","last_fullsized":"2023-10-03T19:13:22.780417+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:06:40.574599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.329858+0000","last_change":"2023-10-03T19:13:21.379900+0000","last_active":"2023-10-03T19:13:22.329858+0000","last_peered":"2023-10-03T19:13:22.329858+0000","last_clean":"2023-10-03T19:13:22.329858+0000","last_became_active":"2023-10-03T19:13:21.379296+0000","last_became_peered":"2023-10-03T19:13:21.379296+0000","last_unstale":"2023-10-03T19:13:22.329858+0000","last_undegraded":"2023-10-03T19:13:22.329858+0000","last_fullsized":"2023-10-03T19:13:22.329858+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:52:53.124746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.324613+0000","last_change":"2023-10-03T19:13:20.963235+0000","last_active":"2023-10-03T19:13:22.324613+0000","last_peered":"2023-10-03T19:13:22.324613+0000","last_clean":"2023-10-03T19:13:22.324613+0000","last_became_active":"2023-10-03T19:13:20.962810+0000","last_became_peered":"2023-10-03T19:13:20.962810+0000","last_unstale":"2023-10-03T19:13:22.324613+0000","last_undegraded":"2023-10-03T19:13:22.324613+0000","last_fullsized":"2023-10-03T19:13:22.324613+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:19:01.145282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.629124+0000","last_change":"2023-10-03T19:13:21.368821+0000","last_active":"2023-10-03T19:13:23.629124+0000","last_peered":"2023-10-03T19:13:23.629124+0000","last_clean":"2023-10-03T19:13:23.629124+0000","last_became_active":"2023-10-03T19:13:21.368521+0000","last_became_peered":"2023-10-03T19:13:21.368521+0000","last_unstale":"2023-10-03T19:13:23.629124+0000","last_undegraded":"2023-10-03T19:13:23.629124+0000","last_fullsized":"2023-10-03T19:13:23.629124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:52:31.490114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.328962+0000","last_change":"2023-10-03T19:13:20.970078+0000","last_active":"2023-10-03T19:13:22.328962+0000","last_peered":"2023-10-03T19:13:22.328962+0000","last_clean":"2023-10-03T19:13:22.328962+0000","last_became_active":"2023-10-03T19:13:20.969404+0000","last_became_peered":"2023-10-03T19:13:20.969404+0000","last_unstale":"2023-10-03T19:13:22.328962+0000","last_undegraded":"2023-10-03T19:13:22.328962+0000","last_fullsized":"2023-10-03T19:13:22.328962+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:07:33.250723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.631002+0000","last_change":"2023-10-03T19:13:21.364013+0000","last_active":"2023-10-03T19:13:23.631002+0000","last_peered":"2023-10-03T19:13:23.631002+0000","last_clean":"2023-10-03T19:13:23.631002+0000","last_became_active":"2023-10-03T19:13:21.363513+0000","last_became_peered":"2023-10-03T19:13:21.363513+0000","last_unstale":"2023-10-03T19:13:23.631002+0000","last_undegraded":"2023-10-03T19:13:23.631002+0000","last_fullsized":"2023-10-03T19:13:23.631002+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:09:05.040306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.630369+0000","last_change":"2023-10-03T19:13:20.952503+0000","last_active":"2023-10-03T19:13:23.630369+0000","last_peered":"2023-10-03T19:13:23.630369+0000","last_clean":"2023-10-03T19:13:23.630369+0000","last_became_active":"2023-10-03T19:13:20.951828+0000","last_became_peered":"2023-10-03T19:13:20.951828+0000","last_unstale":"2023-10-03T19:13:23.630369+0000","last_undegraded":"2023-10-03T19:13:23.630369+0000","last_fullsized":"2023-10-03T19:13:23.630369+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:45:23.847643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.780929+0000","last_change":"2023-10-03T19:13:21.376107+0000","last_active":"2023-10-03T19:13:22.780929+0000","last_peered":"2023-10-03T19:13:22.780929+0000","last_clean":"2023-10-03T19:13:22.780929+0000","last_became_active":"2023-10-03T19:13:21.373484+0000","last_became_peered":"2023-10-03T19:13:21.373484+0000","last_unstale":"2023-10-03T19:13:22.780929+0000","last_undegraded":"2023-10-03T19:13:22.780929+0000","last_fullsized":"2023-10-03T19:13:22.780929+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:31:40.253475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.333208+0000","last_change":"2023-10-03T19:13:20.960847+0000","last_active":"2023-10-03T19:13:22.333208+0000","last_peered":"2023-10-03T19:13:22.333208+0000","last_clean":"2023-10-03T19:13:22.333208+0000","last_became_active":"2023-10-03T19:13:20.960078+0000","last_became_peered":"2023-10-03T19:13:20.960078+0000","last_unstale":"2023-10-03T19:13:22.333208+0000","last_undegraded":"2023-10-03T19:13:22.333208+0000","last_fullsized":"2023-10-03T19:13:22.333208+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:14:11.662112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344788+0000","last_change":"2023-10-03T19:13:21.370395+0000","last_active":"2023-10-03T19:13:23.344788+0000","last_peered":"2023-10-03T19:13:23.344788+0000","last_clean":"2023-10-03T19:13:23.344788+0000","last_became_active":"2023-10-03T19:13:21.370113+0000","last_became_peered":"2023-10-03T19:13:21.370113+0000","last_unstale":"2023-10-03T19:13:23.344788+0000","last_undegraded":"2023-10-03T19:13:23.344788+0000","last_fullsized":"2023-10-03T19:13:23.344788+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:47:43.653717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"34'3","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332813+0000","last_change":"2023-10-03T19:13:20.961265+0000","last_active":"2023-10-03T19:13:22.332813+0000","last_peered":"2023-10-03T19:13:22.332813+0000","last_clean":"2023-10-03T19:13:22.332813+0000","last_became_active":"2023-10-03T19:13:20.959393+0000","last_became_peered":"2023-10-03T19:13:20.959393+0000","last_unstale":"2023-10-03T19:13:22.332813+0000","last_undegraded":"2023-10-03T19:13:22.332813+0000","last_fullsized":"2023-10-03T19:13:22.332813+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:40:36.494610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.331408+0000","last_change":"2023-10-03T19:13:21.362691+0000","last_active":"2023-10-03T19:13:22.331408+0000","last_peered":"2023-10-03T19:13:22.331408+0000","last_clean":"2023-10-03T19:13:22.331408+0000","last_became_active":"2023-10-03T19:13:21.361488+0000","last_became_peered":"2023-10-03T19:13:21.361488+0000","last_unstale":"2023-10-03T19:13:22.331408+0000","last_undegraded":"2023-10-03T19:13:22.331408+0000","last_fullsized":"2023-10-03T19:13:22.331408+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:22:29.352359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"34'6","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.629949+0000","last_change":"2023-10-03T19:13:20.972865+0000","last_active":"2023-10-03T19:13:23.629949+0000","last_peered":"2023-10-03T19:13:23.629949+0000","last_clean":"2023-10-03T19:13:23.629949+0000","last_became_active":"2023-10-03T19:13:20.972358+0000","last_became_peered":"2023-10-03T19:13:20.972358+0000","last_unstale":"2023-10-03T19:13:23.629949+0000","last_undegraded":"2023-10-03T19:13:23.629949+0000","last_fullsized":"2023-10-03T19:13:23.629949+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:57:54.218663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344127+0000","last_change":"2023-10-03T19:13:21.361649+0000","last_active":"2023-10-03T19:13:23.344127+0000","last_peered":"2023-10-03T19:13:23.344127+0000","last_clean":"2023-10-03T19:13:23.344127+0000","last_became_active":"2023-10-03T19:13:21.361411+0000","last_became_peered":"2023-10-03T19:13:21.361411+0000","last_unstale":"2023-10-03T19:13:23.344127+0000","last_undegraded":"2023-10-03T19:13:23.344127+0000","last_fullsized":"2023-10-03T19:13:23.344127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:57:14.066081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.629883+0000","last_change":"2023-10-03T19:13:20.964862+0000","last_active":"2023-10-03T19:13:23.629883+0000","last_peered":"2023-10-03T19:13:23.629883+0000","last_clean":"2023-10-03T19:13:23.629883+0000","last_became_active":"2023-10-03T19:13:20.964523+0000","last_became_peered":"2023-10-03T19:13:20.964523+0000","last_unstale":"2023-10-03T19:13:23.629883+0000","last_undegraded":"2023-10-03T19:13:23.629883+0000","last_fullsized":"2023-10-03T19:13:23.629883+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:19:44.716940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.628598+0000","last_change":"2023-10-03T19:13:21.335001+0000","last_active":"2023-10-03T19:13:23.628598+0000","last_peered":"2023-10-03T19:13:23.628598+0000","last_clean":"2023-10-03T19:13:23.628598+0000","last_became_active":"2023-10-03T19:13:21.334682+0000","last_became_peered":"2023-10-03T19:13:21.334682+0000","last_unstale":"2023-10-03T19:13:23.628598+0000","last_undegraded":"2023-10-03T19:13:23.628598+0000","last_fullsized":"2023-10-03T19:13:23.628598+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:15:55.983735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.324726+0000","last_change":"2023-10-03T19:13:20.962572+0000","last_active":"2023-10-03T19:13:22.324726+0000","last_peered":"2023-10-03T19:13:22.324726+0000","last_clean":"2023-10-03T19:13:22.324726+0000","last_became_active":"2023-10-03T19:13:20.962094+0000","last_became_peered":"2023-10-03T19:13:20.962094+0000","last_unstale":"2023-10-03T19:13:22.324726+0000","last_undegraded":"2023-10-03T19:13:22.324726+0000","last_fullsized":"2023-10-03T19:13:22.324726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:53:05.550365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.780374+0000","last_change":"2023-10-03T19:13:21.371030+0000","last_active":"2023-10-03T19:13:22.780374+0000","last_peered":"2023-10-03T19:13:22.780374+0000","last_clean":"2023-10-03T19:13:22.780374+0000","last_became_active":"2023-10-03T19:13:21.369954+0000","last_became_peered":"2023-10-03T19:13:21.369954+0000","last_unstale":"2023-10-03T19:13:22.780374+0000","last_undegraded":"2023-10-03T19:13:22.780374+0000","last_fullsized":"2023-10-03T19:13:22.780374+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:45:24.859160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.399419+0000","last_change":"2023-10-03T19:13:20.967774+0000","last_active":"2023-10-03T19:13:23.399419+0000","last_peered":"2023-10-03T19:13:23.399419+0000","last_clean":"2023-10-03T19:13:23.399419+0000","last_became_active":"2023-10-03T19:13:20.965529+0000","last_became_peered":"2023-10-03T19:13:20.965529+0000","last_unstale":"2023-10-03T19:13:23.399419+0000","last_undegraded":"2023-10-03T19:13:23.399419+0000","last_fullsized":"2023-10-03T19:13:23.399419+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:49:32.300660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.629539+0000","last_change":"2023-10-03T19:13:21.342147+0000","last_active":"2023-10-03T19:13:23.629539+0000","last_peered":"2023-10-03T19:13:23.629539+0000","last_clean":"2023-10-03T19:13:23.629539+0000","last_became_active":"2023-10-03T19:13:21.341813+0000","last_became_peered":"2023-10-03T19:13:21.341813+0000","last_unstale":"2023-10-03T19:13:23.629539+0000","last_undegraded":"2023-10-03T19:13:23.629539+0000","last_fullsized":"2023-10-03T19:13:23.629539+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:45:17.978390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"34'8","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.780134+0000","last_change":"2023-10-03T19:13:20.975023+0000","last_active":"2023-10-03T19:13:22.780134+0000","last_peered":"2023-10-03T19:13:22.780134+0000","last_clean":"2023-10-03T19:13:22.780134+0000","last_became_active":"2023-10-03T19:13:20.973808+0000","last_became_peered":"2023-10-03T19:13:20.973808+0000","last_unstale":"2023-10-03T19:13:22.780134+0000","last_undegraded":"2023-10-03T19:13:22.780134+0000","last_fullsized":"2023-10-03T19:13:22.780134+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:57:54.218663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.629414+0000","last_change":"2023-10-03T19:13:21.337931+0000","last_active":"2023-10-03T19:13:23.629414+0000","last_peered":"2023-10-03T19:13:23.629414+0000","last_clean":"2023-10-03T19:13:23.629414+0000","last_became_active":"2023-10-03T19:13:21.337645+0000","last_became_peered":"2023-10-03T19:13:21.337645+0000","last_unstale":"2023-10-03T19:13:23.629414+0000","last_undegraded":"2023-10-03T19:13:23.629414+0000","last_fullsized":"2023-10-03T19:13:23.629414+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:53:21.733701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.333263+0000","last_change":"2023-10-03T19:13:20.957758+0000","last_active":"2023-10-03T19:13:22.333263+0000","last_peered":"2023-10-03T19:13:22.333263+0000","last_clean":"2023-10-03T19:13:22.333263+0000","last_became_active":"2023-10-03T19:13:20.957023+0000","last_became_peered":"2023-10-03T19:13:20.957023+0000","last_unstale":"2023-10-03T19:13:22.333263+0000","last_undegraded":"2023-10-03T19:13:22.333263+0000","last_fullsized":"2023-10-03T19:13:22.333263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:36:11.572563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332770+0000","last_change":"2023-10-03T19:13:21.386225+0000","last_active":"2023-10-03T19:13:22.332770+0000","last_peered":"2023-10-03T19:13:22.332770+0000","last_clean":"2023-10-03T19:13:22.332770+0000","last_became_active":"2023-10-03T19:13:21.381348+0000","last_became_peered":"2023-10-03T19:13:21.381348+0000","last_unstale":"2023-10-03T19:13:22.332770+0000","last_undegraded":"2023-10-03T19:13:22.332770+0000","last_fullsized":"2023-10-03T19:13:22.332770+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:59:12.814362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.330724+0000","last_change":"2023-10-03T19:13:20.965203+0000","last_active":"2023-10-03T19:13:22.330724+0000","last_peered":"2023-10-03T19:13:22.330724+0000","last_clean":"2023-10-03T19:13:22.330724+0000","last_became_active":"2023-10-03T19:13:20.963356+0000","last_became_peered":"2023-10-03T19:13:20.963356+0000","last_unstale":"2023-10-03T19:13:22.330724+0000","last_undegraded":"2023-10-03T19:13:22.330724+0000","last_fullsized":"2023-10-03T19:13:22.330724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:21:57.957159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.331725+0000","last_change":"2023-10-03T19:13:21.368113+0000","last_active":"2023-10-03T19:13:22.331725+0000","last_peered":"2023-10-03T19:13:22.331725+0000","last_clean":"2023-10-03T19:13:22.331725+0000","last_became_active":"2023-10-03T19:13:21.367345+0000","last_became_peered":"2023-10-03T19:13:21.367345+0000","last_unstale":"2023-10-03T19:13:22.331725+0000","last_undegraded":"2023-10-03T19:13:22.331725+0000","last_fullsized":"2023-10-03T19:13:22.331725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:00:40.503052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.631190+0000","last_change":"2023-10-03T19:13:20.972574+0000","last_active":"2023-10-03T19:13:23.631190+0000","last_peered":"2023-10-03T19:13:23.631190+0000","last_clean":"2023-10-03T19:13:23.631190+0000","last_became_active":"2023-10-03T19:13:20.972119+0000","last_became_peered":"2023-10-03T19:13:20.972119+0000","last_unstale":"2023-10-03T19:13:23.631190+0000","last_undegraded":"2023-10-03T19:13:23.631190+0000","last_fullsized":"2023-10-03T19:13:23.631190+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:43:20.100653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.631033+0000","last_change":"2023-10-03T19:13:21.339682+0000","last_active":"2023-10-03T19:13:23.631033+0000","last_peered":"2023-10-03T19:13:23.631033+0000","last_clean":"2023-10-03T19:13:23.631033+0000","last_became_active":"2023-10-03T19:13:21.339291+0000","last_became_peered":"2023-10-03T19:13:21.339291+0000","last_unstale":"2023-10-03T19:13:23.631033+0000","last_undegraded":"2023-10-03T19:13:23.631033+0000","last_fullsized":"2023-10-03T19:13:23.631033+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:12:26.835334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.325234+0000","last_change":"2023-10-03T19:13:20.951006+0000","last_active":"2023-10-03T19:13:22.325234+0000","last_peered":"2023-10-03T19:13:22.325234+0000","last_clean":"2023-10-03T19:13:22.325234+0000","last_became_active":"2023-10-03T19:13:20.950606+0000","last_became_peered":"2023-10-03T19:13:20.950606+0000","last_unstale":"2023-10-03T19:13:22.325234+0000","last_undegraded":"2023-10-03T19:13:22.325234+0000","last_fullsized":"2023-10-03T19:13:22.325234+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:48:48.027499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.780776+0000","last_change":"2023-10-03T19:13:21.372118+0000","last_active":"2023-10-03T19:13:22.780776+0000","last_peered":"2023-10-03T19:13:22.780776+0000","last_clean":"2023-10-03T19:13:22.780776+0000","last_became_active":"2023-10-03T19:13:21.370009+0000","last_became_peered":"2023-10-03T19:13:21.370009+0000","last_unstale":"2023-10-03T19:13:22.780776+0000","last_undegraded":"2023-10-03T19:13:22.780776+0000","last_fullsized":"2023-10-03T19:13:22.780776+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:41:29.458877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.630207+0000","last_change":"2023-10-03T19:13:20.954261+0000","last_active":"2023-10-03T19:13:23.630207+0000","last_peered":"2023-10-03T19:13:23.630207+0000","last_clean":"2023-10-03T19:13:23.630207+0000","last_became_active":"2023-10-03T19:13:20.953905+0000","last_became_peered":"2023-10-03T19:13:20.953905+0000","last_unstale":"2023-10-03T19:13:23.630207+0000","last_undegraded":"2023-10-03T19:13:23.630207+0000","last_fullsized":"2023-10-03T19:13:23.630207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:17:30.367274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344213+0000","last_change":"2023-10-03T19:13:21.372131+0000","last_active":"2023-10-03T19:13:23.344213+0000","last_peered":"2023-10-03T19:13:23.344213+0000","last_clean":"2023-10-03T19:13:23.344213+0000","last_became_active":"2023-10-03T19:13:21.371809+0000","last_became_peered":"2023-10-03T19:13:21.371809+0000","last_unstale":"2023-10-03T19:13:23.344213+0000","last_undegraded":"2023-10-03T19:13:23.344213+0000","last_fullsized":"2023-10-03T19:13:23.344213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:57:40.440963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.630699+0000","last_change":"2023-10-03T19:13:20.960919+0000","last_active":"2023-10-03T19:13:23.630699+0000","last_peered":"2023-10-03T19:13:23.630699+0000","last_clean":"2023-10-03T19:13:23.630699+0000","last_became_active":"2023-10-03T19:13:20.960593+0000","last_became_peered":"2023-10-03T19:13:20.960593+0000","last_unstale":"2023-10-03T19:13:23.630699+0000","last_undegraded":"2023-10-03T19:13:23.630699+0000","last_fullsized":"2023-10-03T19:13:23.630699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:54:05.602230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332228+0000","last_change":"2023-10-03T19:13:21.365073+0000","last_active":"2023-10-03T19:13:22.332228+0000","last_peered":"2023-10-03T19:13:22.332228+0000","last_clean":"2023-10-03T19:13:22.332228+0000","last_became_active":"2023-10-03T19:13:21.364541+0000","last_became_peered":"2023-10-03T19:13:21.364541+0000","last_unstale":"2023-10-03T19:13:22.332228+0000","last_undegraded":"2023-10-03T19:13:22.332228+0000","last_fullsized":"2023-10-03T19:13:22.332228+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:00:58.829969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.781113+0000","last_change":"2023-10-03T19:13:20.977060+0000","last_active":"2023-10-03T19:13:22.781113+0000","last_peered":"2023-10-03T19:13:22.781113+0000","last_clean":"2023-10-03T19:13:22.781113+0000","last_became_active":"2023-10-03T19:13:20.976504+0000","last_became_peered":"2023-10-03T19:13:20.976504+0000","last_unstale":"2023-10-03T19:13:22.781113+0000","last_undegraded":"2023-10-03T19:13:22.781113+0000","last_fullsized":"2023-10-03T19:13:22.781113+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:58:13.446799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.629715+0000","last_change":"2023-10-03T19:13:21.368817+0000","last_active":"2023-10-03T19:13:23.629715+0000","last_peered":"2023-10-03T19:13:23.629715+0000","last_clean":"2023-10-03T19:13:23.629715+0000","last_became_active":"2023-10-03T19:13:21.368494+0000","last_became_peered":"2023-10-03T19:13:21.368494+0000","last_unstale":"2023-10-03T19:13:23.629715+0000","last_undegraded":"2023-10-03T19:13:23.629715+0000","last_fullsized":"2023-10-03T19:13:23.629715+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:26:10.484739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.629523+0000","last_change":"2023-10-03T19:13:20.958773+0000","last_active":"2023-10-03T19:13:23.629523+0000","last_peered":"2023-10-03T19:13:23.629523+0000","last_clean":"2023-10-03T19:13:23.629523+0000","last_became_active":"2023-10-03T19:13:20.958365+0000","last_became_peered":"2023-10-03T19:13:20.958365+0000","last_unstale":"2023-10-03T19:13:23.629523+0000","last_undegraded":"2023-10-03T19:13:23.629523+0000","last_fullsized":"2023-10-03T19:13:23.629523+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:18:53.461300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332884+0000","last_change":"2023-10-03T19:13:21.392175+0000","last_active":"2023-10-03T19:13:22.332884+0000","last_peered":"2023-10-03T19:13:22.332884+0000","last_clean":"2023-10-03T19:13:22.332884+0000","last_became_active":"2023-10-03T19:13:21.389898+0000","last_became_peered":"2023-10-03T19:13:21.389898+0000","last_unstale":"2023-10-03T19:13:22.332884+0000","last_undegraded":"2023-10-03T19:13:22.332884+0000","last_fullsized":"2023-10-03T19:13:22.332884+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:26:48.120113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.781061+0000","last_change":"2023-10-03T19:13:20.974327+0000","last_active":"2023-10-03T19:13:22.781061+0000","last_peered":"2023-10-03T19:13:22.781061+0000","last_clean":"2023-10-03T19:13:22.781061+0000","last_became_active":"2023-10-03T19:13:20.973755+0000","last_became_peered":"2023-10-03T19:13:20.973755+0000","last_unstale":"2023-10-03T19:13:22.781061+0000","last_undegraded":"2023-10-03T19:13:22.781061+0000","last_fullsized":"2023-10-03T19:13:22.781061+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:55:38.048388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":193,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.781175+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:13:22.781175+0000","last_peered":"2023-10-03T19:13:22.781175+0000","last_clean":"2023-10-03T19:13:22.781175+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:13:22.781175+0000","last_undegraded":"2023-10-03T19:13:22.781175+0000","last_fullsized":"2023-10-03T19:13:22.781175+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:15:06.050278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332331+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:13:22.332331+0000","last_peered":"2023-10-03T19:13:22.332331+0000","last_clean":"2023-10-03T19:13:22.332331+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:13:22.332331+0000","last_undegraded":"2023-10-03T19:13:22.332331+0000","last_fullsized":"2023-10-03T19:13:22.332331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:23:55.753435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.325084+0000","last_change":"2023-10-03T19:13:21.377405+0000","last_active":"2023-10-03T19:13:22.325084+0000","last_peered":"2023-10-03T19:13:22.325084+0000","last_clean":"2023-10-03T19:13:22.325084+0000","last_became_active":"2023-10-03T19:13:21.377187+0000","last_became_peered":"2023-10-03T19:13:21.377187+0000","last_unstale":"2023-10-03T19:13:22.325084+0000","last_undegraded":"2023-10-03T19:13:22.325084+0000","last_fullsized":"2023-10-03T19:13:22.325084+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:42:26.752455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.333408+0000","last_change":"2023-10-03T19:13:20.958706+0000","last_active":"2023-10-03T19:13:22.333408+0000","last_peered":"2023-10-03T19:13:22.333408+0000","last_clean":"2023-10-03T19:13:22.333408+0000","last_became_active":"2023-10-03T19:13:20.956435+0000","last_became_peered":"2023-10-03T19:13:20.956435+0000","last_unstale":"2023-10-03T19:13:22.333408+0000","last_undegraded":"2023-10-03T19:13:22.333408+0000","last_fullsized":"2023-10-03T19:13:22.333408+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:04:53.519874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.781357+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:13:22.781357+0000","last_peered":"2023-10-03T19:13:22.781357+0000","last_clean":"2023-10-03T19:13:22.781357+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:13:22.781357+0000","last_undegraded":"2023-10-03T19:13:22.781357+0000","last_fullsized":"2023-10-03T19:13:22.781357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:51:54.521342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.781434+0000","last_change":"2023-10-03T19:13:21.374113+0000","last_active":"2023-10-03T19:13:22.781434+0000","last_peered":"2023-10-03T19:13:22.781434+0000","last_clean":"2023-10-03T19:13:22.781434+0000","last_became_active":"2023-10-03T19:13:21.370727+0000","last_became_peered":"2023-10-03T19:13:21.370727+0000","last_unstale":"2023-10-03T19:13:22.781434+0000","last_undegraded":"2023-10-03T19:13:22.781434+0000","last_fullsized":"2023-10-03T19:13:22.781434+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:21:46.925044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"35'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.631336+0000","last_change":"2023-10-03T19:13:20.961506+0000","last_active":"2023-10-03T19:13:23.631336+0000","last_peered":"2023-10-03T19:13:23.631336+0000","last_clean":"2023-10-03T19:13:23.631336+0000","last_became_active":"2023-10-03T19:13:20.961101+0000","last_became_peered":"2023-10-03T19:13:20.961101+0000","last_unstale":"2023-10-03T19:13:23.631336+0000","last_undegraded":"2023-10-03T19:13:23.631336+0000","last_fullsized":"2023-10-03T19:13:23.631336+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:49:32.300660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.630379+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:13:23.630379+0000","last_peered":"2023-10-03T19:13:23.630379+0000","last_clean":"2023-10-03T19:13:23.630379+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:13:23.630379+0000","last_undegraded":"2023-10-03T19:13:23.630379+0000","last_fullsized":"2023-10-03T19:13:23.630379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:47:14.682313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.630226+0000","last_change":"2023-10-03T19:13:21.374564+0000","last_active":"2023-10-03T19:13:23.630226+0000","last_peered":"2023-10-03T19:13:23.630226+0000","last_clean":"2023-10-03T19:13:23.630226+0000","last_became_active":"2023-10-03T19:13:21.374299+0000","last_became_peered":"2023-10-03T19:13:21.374299+0000","last_unstale":"2023-10-03T19:13:23.630226+0000","last_undegraded":"2023-10-03T19:13:23.630226+0000","last_fullsized":"2023-10-03T19:13:23.630226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:50:20.193476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344207+0000","last_change":"2023-10-03T19:13:20.951648+0000","last_active":"2023-10-03T19:13:23.344207+0000","last_peered":"2023-10-03T19:13:23.344207+0000","last_clean":"2023-10-03T19:13:23.344207+0000","last_became_active":"2023-10-03T19:13:20.950901+0000","last_became_peered":"2023-10-03T19:13:20.950901+0000","last_unstale":"2023-10-03T19:13:23.344207+0000","last_undegraded":"2023-10-03T19:13:23.344207+0000","last_fullsized":"2023-10-03T19:13:23.344207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:27:55.601869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.332066+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:13:22.332066+0000","last_peered":"2023-10-03T19:13:22.332066+0000","last_clean":"2023-10-03T19:13:22.332066+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:13:22.332066+0000","last_undegraded":"2023-10-03T19:13:22.332066+0000","last_fullsized":"2023-10-03T19:13:22.332066+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:11:13.218075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344474+0000","last_change":"2023-10-03T19:13:21.339724+0000","last_active":"2023-10-03T19:13:23.344474+0000","last_peered":"2023-10-03T19:13:23.344474+0000","last_clean":"2023-10-03T19:13:23.344474+0000","last_became_active":"2023-10-03T19:13:21.339332+0000","last_became_peered":"2023-10-03T19:13:21.339332+0000","last_unstale":"2023-10-03T19:13:23.344474+0000","last_undegraded":"2023-10-03T19:13:23.344474+0000","last_fullsized":"2023-10-03T19:13:23.344474+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:01:06.037410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.344737+0000","last_change":"2023-10-03T19:13:20.970059+0000","last_active":"2023-10-03T19:13:23.344737+0000","last_peered":"2023-10-03T19:13:23.344737+0000","last_clean":"2023-10-03T19:13:23.344737+0000","last_became_active":"2023-10-03T19:13:20.969451+0000","last_became_peered":"2023-10-03T19:13:20.969451+0000","last_unstale":"2023-10-03T19:13:23.344737+0000","last_undegraded":"2023-10-03T19:13:23.344737+0000","last_fullsized":"2023-10-03T19:13:23.344737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:27:28.531397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.325179+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:13:22.325179+0000","last_peered":"2023-10-03T19:13:22.325179+0000","last_clean":"2023-10-03T19:13:22.325179+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:13:22.325179+0000","last_undegraded":"2023-10-03T19:13:22.325179+0000","last_fullsized":"2023-10-03T19:13:22.325179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:13:04.732456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.324538+0000","last_change":"2023-10-03T19:13:21.339247+0000","last_active":"2023-10-03T19:13:22.324538+0000","last_peered":"2023-10-03T19:13:22.324538+0000","last_clean":"2023-10-03T19:13:22.324538+0000","last_became_active":"2023-10-03T19:13:21.338947+0000","last_became_peered":"2023-10-03T19:13:21.338947+0000","last_unstale":"2023-10-03T19:13:22.324538+0000","last_undegraded":"2023-10-03T19:13:22.324538+0000","last_fullsized":"2023-10-03T19:13:22.324538+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:03:08.567828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.399711+0000","last_change":"2023-10-03T19:13:20.964605+0000","last_active":"2023-10-03T19:13:23.399711+0000","last_peered":"2023-10-03T19:13:23.399711+0000","last_clean":"2023-10-03T19:13:23.399711+0000","last_became_active":"2023-10-03T19:13:20.963993+0000","last_became_peered":"2023-10-03T19:13:20.963993+0000","last_unstale":"2023-10-03T19:13:23.399711+0000","last_undegraded":"2023-10-03T19:13:23.399711+0000","last_fullsized":"2023-10-03T19:13:23.399711+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:20:32.617592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.781525+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:13:22.781525+0000","last_peered":"2023-10-03T19:13:22.781525+0000","last_clean":"2023-10-03T19:13:22.781525+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:13:22.781525+0000","last_undegraded":"2023-10-03T19:13:22.781525+0000","last_fullsized":"2023-10-03T19:13:22.781525+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:24:13.769158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.329609+0000","last_change":"2023-10-03T19:13:21.363349+0000","last_active":"2023-10-03T19:13:22.329609+0000","last_peered":"2023-10-03T19:13:22.329609+0000","last_clean":"2023-10-03T19:13:22.329609+0000","last_became_active":"2023-10-03T19:13:21.362328+0000","last_became_peered":"2023-10-03T19:13:21.362328+0000","last_unstale":"2023-10-03T19:13:22.329609+0000","last_undegraded":"2023-10-03T19:13:22.329609+0000","last_fullsized":"2023-10-03T19:13:22.329609+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:16:05.676751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.329086+0000","last_change":"2023-10-03T19:13:20.954919+0000","last_active":"2023-10-03T19:13:22.329086+0000","last_peered":"2023-10-03T19:13:22.329086+0000","last_clean":"2023-10-03T19:13:22.329086+0000","last_became_active":"2023-10-03T19:13:20.954183+0000","last_became_peered":"2023-10-03T19:13:20.954183+0000","last_unstale":"2023-10-03T19:13:22.329086+0000","last_undegraded":"2023-10-03T19:13:22.329086+0000","last_fullsized":"2023-10-03T19:13:22.329086+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:55:38.048388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.325392+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:13:22.325392+0000","last_peered":"2023-10-03T19:13:22.325392+0000","last_clean":"2023-10-03T19:13:22.325392+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:13:22.325392+0000","last_undegraded":"2023-10-03T19:13:22.325392+0000","last_fullsized":"2023-10-03T19:13:22.325392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:09:45.237081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:22.780937+0000","last_change":"2023-10-03T19:13:21.371931+0000","last_active":"2023-10-03T19:13:22.780937+0000","last_peered":"2023-10-03T19:13:22.780937+0000","last_clean":"2023-10-03T19:13:22.780937+0000","last_became_active":"2023-10-03T19:13:21.370833+0000","last_became_peered":"2023-10-03T19:13:21.370833+0000","last_unstale":"2023-10-03T19:13:22.780937+0000","last_undegraded":"2023-10-03T19:13:22.780937+0000","last_fullsized":"2023-10-03T19:13:22.780937+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:20.908525+0000","last_clean_scrub_stamp":"2023-10-03T19:13:20.908525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:07:34.262239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.628265+0000","last_change":"2023-10-03T19:13:20.952123+0000","last_active":"2023-10-03T19:13:23.628265+0000","last_peered":"2023-10-03T19:13:23.628265+0000","last_clean":"2023-10-03T19:13:23.628265+0000","last_became_active":"2023-10-03T19:13:20.951627+0000","last_became_peered":"2023-10-03T19:13:20.951627+0000","last_unstale":"2023-10-03T19:13:23.628265+0000","last_undegraded":"2023-10-03T19:13:23.628265+0000","last_fullsized":"2023-10-03T19:13:23.628265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:13:19.897009+0000","last_clean_scrub_stamp":"2023-10-03T19:13:19.897009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:32:52.296756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-03T19:13:23.400426+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:13:23.400426+0000","last_peered":"2023-10-03T19:13:23.400426+0000","last_clean":"2023-10-03T19:13:23.400426+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:13:23.400426+0000","last_undegraded":"2023-10-03T19:13:23.400426+0000","last_fullsized":"2023-10-03T19:13:23.400426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:08:04.782275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9428,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362412,"statfs":{"total":96636764160,"available":96627109888,"internally_reserved":0,"allocated":471040,"data_stored":753913,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:13:22 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":4.0469999999999997,"5min":4.0469999999999997,"15min":4.0469999999999997},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.96999999999999997}]},{"osd":1,"last update":"Tue Oct 3 19:13:22 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":3.8239999999999998,"5min":3.8239999999999998,"15min":3.8239999999999998},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":1.075}]},{"osd":2,"last update":"Tue Oct 3 19:13:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":1.044},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":3.98,"5min":3.98,"15min":3.98},"last":0.75800000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:13:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":3.9140000000000001,"5min":3.9140000000000001,"15min":3.9140000000000001},"last":0.91400000000000003}]},{"osd":4,"last update":"Tue Oct 3 19:13:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":5.1130000000000004,"5min":5.1130000000000004,"15min":5.1130000000000004},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.80500000000000005}]},{"osd":5,"last update":"Tue Oct 3 19:13:22 2023","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":5.1859999999999999,"5min":5.1859999999999999,"15min":5.1859999999999999},"last":1.014},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.1559999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:13:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.877},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":2.177,"5min":2.177,"15min":2.177},"last":1.1100000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8772,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94363068,"statfs":{"total":96636764160,"available":96627781632,"internally_reserved":0,"allocated":389120,"data_stored":161329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.755},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":0.44600000000000001}]},{"osd":1,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.86399999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.024},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.72199999999999998}]},{"osd":3,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":0.57199999999999995}]},{"osd":4,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.999}]},{"osd":5,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.2570000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.149}]},{"osd":7,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":0.79100000000000004}]}]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8972,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362868,"statfs":{"total":96636764160,"available":96627576832,"internally_reserved":0,"allocated":397312,"data_stored":162515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.81200000000000006}]},{"osd":1,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.9750000000000001,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.85699999999999998}]},{"osd":2,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.8809999999999998,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.95199999999999996}]},{"osd":3,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":3.0369999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.90400000000000003}]},{"osd":5,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.65700000000000003}]},{"osd":6,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":3.0840000000000001,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.8919999999999999,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":1.1040000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":3.1230000000000002,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.97299999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12868,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":12480,"kb_avail":94358972,"statfs":{"total":96636764160,"available":96623587328,"internally_reserved":0,"allocated":389120,"data_stored":160817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12779520},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.51000000000000001}]},{"osd":1,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.61399999999999999}]},{"osd":3,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.66600000000000004}]},{"osd":4,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.79500000000000004}]},{"osd":5,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.877}]},{"osd":6,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.006}]},{"osd":7,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.90900000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8840,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94363000,"statfs":{"total":96636764160,"available":96627712000,"internally_reserved":0,"allocated":393216,"data_stored":162001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:13:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.72599999999999998}]},{"osd":2,"last update":"Tue Oct 3 19:13:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.879}]},{"osd":3,"last update":"Tue Oct 3 19:13:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.91500000000000004}]},{"osd":4,"last update":"Tue Oct 3 19:13:25 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":1.0629999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:13:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":1.04},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.96199999999999997}]},{"osd":6,"last update":"Tue Oct 3 19:13:25 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":1.1359999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:13:25 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.097},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":1.1639999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542160,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8916,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362924,"statfs":{"total":96636764160,"available":96627634176,"internally_reserved":0,"allocated":405504,"data_stored":163509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.55900000000000005}]},{"osd":1,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.47299999999999998}]},{"osd":2,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.57999999999999996}]},{"osd":4,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.72299999999999998}]},{"osd":5,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.73899999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.70599999999999996}]},{"osd":7,"last update":"Tue Oct 3 19:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.879}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8844,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362996,"statfs":{"total":96636764160,"available":96627707904,"internally_reserved":0,"allocated":397312,"data_stored":162023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:13:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.83199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":3,"last update":"Tue Oct 3 19:13:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.60099999999999998},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.73199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13444,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":12992,"kb_avail":94358396,"statfs":{"total":96636764160,"available":96622997504,"internally_reserved":0,"allocated":454656,"data_stored":751149,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":13303808},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":1.218}]},{"osd":2,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.94699999999999995}]},{"osd":3,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.75900000000000001}]},{"osd":4,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.347}]},{"osd":5,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.3009999999999999},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.84999999999999998}]},{"osd":6,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.034},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.056}]},{"osd":7,"last update":"Tue Oct 3 19:13:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.1499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:13:30.206 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-03T19:13:30.206 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-03T19:13:30.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.376+0000 7f190d1ee640 1 Processor -- start 2023-10-03T19:13:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.376+0000 7f190d1ee640 1 -- start start 2023-10-03T19:13:30.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.376+0000 7f190d1ee640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f19080bf170 0x7f19080c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:30.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.376+0000 7f190d1ee640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f19080c26f0 0x7f1908069ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:30.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.376+0000 7f190d1ee640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f190814f660 con 0x7f19080c1200 2023-10-03T19:13:30.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.376+0000 7f190d1ee640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19080c0b60 con 0x7f19080bf170 2023-10-03T19:13:30.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.376+0000 7f190d1ee640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19080c0f80 con 0x7f19080c26f0 2023-10-03T19:13:30.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.376+0000 7f1906d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f19080c1200 0x7f190814e6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35838/0 (socket says 172.21.15.45:35838) 2023-10-03T19:13:30.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.376+0000 7f1906d9d640 1 -- 172.21.15.45:0/2067224878 learned_addr learned my addr 172.21.15.45:0/2067224878 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:30.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.376+0000 7f18fffff640 1 --2- 172.21.15.45:0/2067224878 >> v2:172.21.15.45:3300/0 conn(0x7f19080bf170 0x7f19080c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:30.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.376+0000 7f190759e640 1 --2- 172.21.15.45:0/2067224878 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f19080c26f0 0x7f1908069ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:30.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.376+0000 7f190659c640 1 -- 172.21.15.45:0/2067224878 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 116664600 0 0) 0x7f190814f660 con 0x7f19080c1200 2023-10-03T19:13:30.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.376+0000 7f190659c640 1 -- 172.21.15.45:0/2067224878 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18f4003530 con 0x7f19080c1200 2023-10-03T19:13:30.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.376+0000 7f18fffff640 1 -- 172.21.15.45:0/2067224878 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f19080c26f0 msgr2=0x7f1908069ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:30.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.376+0000 7f18fffff640 1 --2- 172.21.15.45:0/2067224878 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f19080c26f0 0x7f1908069ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:30.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.376+0000 7f18fffff640 1 -- 172.21.15.45:0/2067224878 >> v1:172.21.15.45:6789/0 conn(0x7f19080c1200 legacy=0x7f190814e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:30.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.376+0000 7f18fffff640 1 -- 172.21.15.45:0/2067224878 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f190814f380 con 0x7f19080bf170 2023-10-03T19:13:30.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.380+0000 7f18fffff640 1 --2- 172.21.15.45:0/2067224878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19080bf170 0x7f19080c15d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f18f00097c0 tx=0x7f18f001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c62414bbbd0d4c6e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:30.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.380+0000 7f190659c640 1 -- 172.21.15.45:0/2067224878 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f00ab600 con 0x7f19080bf170 2023-10-03T19:13:30.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.380+0000 7f190659c640 1 -- 172.21.15.45:0/2067224878 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f00a7050 con 0x7f19080bf170 2023-10-03T19:13:30.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.380+0000 7f190659c640 1 -- 172.21.15.45:0/2067224878 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f00ab980 con 0x7f19080bf170 2023-10-03T19:13:30.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.380+0000 7f190d1ee640 1 -- 172.21.15.45:0/2067224878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19080bf170 msgr2=0x7f19080c15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.380+0000 7f190d1ee640 1 --2- 172.21.15.45:0/2067224878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19080bf170 0x7f19080c15d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f18f00097c0 tx=0x7f18f001c480 comp rx=0 tx=0).stop 2023-10-03T19:13:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.380+0000 7f190d1ee640 1 -- 172.21.15.45:0/2067224878 shutdown_connections 2023-10-03T19:13:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.380+0000 7f190d1ee640 1 --2- 172.21.15.45:0/2067224878 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f19080c26f0 0x7f1908069ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.380+0000 7f190d1ee640 1 --2- 172.21.15.45:0/2067224878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19080bf170 0x7f19080c15d0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.380+0000 7f190d1ee640 1 -- 172.21.15.45:0/2067224878 >> 172.21.15.45:0/2067224878 conn(0x7f19080a6340 msgr2=0x7f19080a6710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.380+0000 7f190d1ee640 1 -- 172.21.15.45:0/2067224878 shutdown_connections 2023-10-03T19:13:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.380+0000 7f190d1ee640 1 -- 172.21.15.45:0/2067224878 wait complete. 2023-10-03T19:13:30.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.380+0000 7f190d1ee640 1 Processor -- start 2023-10-03T19:13:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.384+0000 7f190d1ee640 1 -- start start 2023-10-03T19:13:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.384+0000 7f190d1ee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19080bf170 0x7f19081484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.384+0000 7f190d1ee640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19080c1200 0x7f19081435a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.384+0000 7f190d1ee640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f19080c26f0 0x7f19080b6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.384+0000 7f190d1ee640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f190814d710 con 0x7f19080c1200 2023-10-03T19:13:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.384+0000 7f190d1ee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19080b7290 con 0x7f19080bf170 2023-10-03T19:13:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.384+0000 7f190d1ee640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19080b7020 con 0x7f19080c26f0 2023-10-03T19:13:30.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.384+0000 7f18fffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19080c1200 0x7f19081435a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:30.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.384+0000 7f18fffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19080c1200 0x7f19081435a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54154/0 (socket says 172.21.15.45:54154) 2023-10-03T19:13:30.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.384+0000 7f18fffff640 1 -- 172.21.15.45:0/3032899204 learned_addr learned my addr 172.21.15.45:0/3032899204 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:30.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.384+0000 7f190759e640 1 --2- 172.21.15.45:0/3032899204 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f19080c26f0 0x7f19080b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:30.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.384+0000 7f1906d9d640 1 --2- 172.21.15.45:0/3032899204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19080bf170 0x7f19081484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:30.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.384+0000 7f18fffff640 1 -- 172.21.15.45:0/3032899204 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f19080c26f0 msgr2=0x7f19080b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:30.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.384+0000 7f18fffff640 1 --2- 172.21.15.45:0/3032899204 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f19080c26f0 0x7f19080b6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:30.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.384+0000 7f18fffff640 1 -- 172.21.15.45:0/3032899204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19080bf170 msgr2=0x7f19081484a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:30.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.384+0000 7f18fffff640 1 --2- 172.21.15.45:0/3032899204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19080bf170 0x7f19081484a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.384+0000 7f18fffff640 1 -- 172.21.15.45:0/3032899204 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f0009420 con 0x7f19080c1200 2023-10-03T19:13:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.384+0000 7f18fffff640 1 --2- 172.21.15.45:0/3032899204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19080c1200 0x7f19081435a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f18f00ae040 tx=0x7f18f0019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.384+0000 7f18ff7fe640 1 -- 172.21.15.45:0/3032899204 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f00b4840 con 0x7f19080c1200 2023-10-03T19:13:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.384+0000 7f18ff7fe640 1 -- 172.21.15.45:0/3032899204 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f00b49c0 con 0x7f19080c1200 2023-10-03T19:13:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.384+0000 7f190d1ee640 1 -- 172.21.15.45:0/3032899204 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19080aa100 con 0x7f19080c1200 2023-10-03T19:13:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.384+0000 7f18ff7fe640 1 -- 172.21.15.45:0/3032899204 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f00b4d70 con 0x7f19080c1200 2023-10-03T19:13:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.384+0000 7f190d1ee640 1 -- 172.21.15.45:0/3032899204 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19080a9f70 con 0x7f19080c1200 2023-10-03T19:13:30.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.384+0000 7f190d1ee640 1 -- 172.21.15.45:0/3032899204 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19080aa290 con 0x7f19080c1200 2023-10-03T19:13:30.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.384+0000 7f18ff7fe640 1 -- 172.21.15.45:0/3032899204 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f18f00b2040 con 0x7f19080c1200 2023-10-03T19:13:30.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.384+0000 7f18ff7fe640 1 --2- 172.21.15.45:0/3032899204 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f18e8066280 0x7f18e8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:30.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.384+0000 7f18ff7fe640 1 -- 172.21.15.45:0/3032899204 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f18f011dfc0 con 0x7f19080c1200 2023-10-03T19:13:30.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.384+0000 7f1906d9d640 1 --2- 172.21.15.45:0/3032899204 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f18e8066280 0x7f18e8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:30.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.388+0000 7f1906d9d640 1 --2- 172.21.15.45:0/3032899204 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f18e8066280 0x7f18e8068730 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f18f80011f0 tx=0x7f18f8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:30.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.388+0000 7f18ff7fe640 1 -- 172.21.15.45:0/3032899204 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f18f00eb4d0 con 0x7f19080c1200 2023-10-03T19:13:30.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.600+0000 7f190d1ee640 1 -- 172.21.15.45:0/3032899204 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f190814cfc0 con 0x7f19080c1200 2023-10-03T19:13:30.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.608+0000 7f18ff7fe640 1 -- 172.21.15.45:0/3032899204 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f18f00b00e0 con 0x7f19080c1200 2023-10-03T19:13:30.613 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-10-03T19:13:30.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.608+0000 7f190d1ee640 1 -- 172.21.15.45:0/3032899204 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f18e8066280 msgr2=0x7f18e8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:30.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.608+0000 7f190d1ee640 1 --2- 172.21.15.45:0/3032899204 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f18e8066280 0x7f18e8068730 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f18f80011f0 tx=0x7f18f8009040 comp rx=0 tx=0).stop 2023-10-03T19:13:30.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.608+0000 7f190d1ee640 1 -- 172.21.15.45:0/3032899204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19080c1200 msgr2=0x7f19081435a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:30.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.608+0000 7f190d1ee640 1 --2- 172.21.15.45:0/3032899204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19080c1200 0x7f19081435a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f18f00ae040 tx=0x7f18f0019220 comp rx=0 tx=0).stop 2023-10-03T19:13:30.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.612+0000 7f190d1ee640 1 -- 172.21.15.45:0/3032899204 shutdown_connections 2023-10-03T19:13:30.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.612+0000 7f190d1ee640 1 --2- 172.21.15.45:0/3032899204 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f18e8066280 0x7f18e8068730 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:30.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.612+0000 7f190d1ee640 1 --2- 172.21.15.45:0/3032899204 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f19080c26f0 0x7f19080b6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:30.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.612+0000 7f190d1ee640 1 --2- 172.21.15.45:0/3032899204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19080c1200 0x7f19081435a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:30.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.612+0000 7f190d1ee640 1 --2- 172.21.15.45:0/3032899204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19080bf170 0x7f19081484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:30.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.612+0000 7f190d1ee640 1 -- 172.21.15.45:0/3032899204 >> 172.21.15.45:0/3032899204 conn(0x7f19080a6340 msgr2=0x7f19080c2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:30.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.612+0000 7f190d1ee640 1 -- 172.21.15.45:0/3032899204 shutdown_connections 2023-10-03T19:13:30.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.612+0000 7f190d1ee640 1 -- 172.21.15.45:0/3032899204 wait complete. 2023-10-03T19:13:30.633 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:13:30.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.752+0000 7f638ec29640 1 Processor -- start 2023-10-03T19:13:30.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.752+0000 7f638ec29640 1 -- start start 2023-10-03T19:13:30.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.756+0000 7f638ec29640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f638806f170 0x7f6388150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:30.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.756+0000 7f638ec29640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f63880bc8b0 0x7f638814ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:30.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.756+0000 7f638ec29640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f638806cac0 con 0x7f638806d170 2023-10-03T19:13:30.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.756+0000 7f638ec29640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63880720d0 con 0x7f63880bc8b0 2023-10-03T19:13:30.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.756+0000 7f638ec29640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63880a5ab0 con 0x7f638806f170 2023-10-03T19:13:30.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.756+0000 7f6387fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f63880bc8b0 0x7f638814ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:30.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.756+0000 7f6387fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f63880bc8b0 0x7f638814ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54166/0 (socket says 172.21.15.45:54166) 2023-10-03T19:13:30.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.756+0000 7f6387fff640 1 -- 172.21.15.45:0/2937408592 learned_addr learned my addr 172.21.15.45:0/2937408592 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:30.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.756+0000 7f638c9c5640 1 --2- 172.21.15.45:0/2937408592 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f638806f170 0x7f6388150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:30.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.756+0000 7f6387fff640 1 -- 172.21.15.45:0/2937408592 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f638806f170 msgr2=0x7f6388150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:30.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.756+0000 7f6387fff640 1 --2- 172.21.15.45:0/2937408592 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f638806f170 0x7f6388150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:30.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.756+0000 7f6387fff640 1 -- 172.21.15.45:0/2937408592 >> v1:172.21.15.79:6789/0 conn(0x7f638806d170 legacy=0x7f638814cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:30.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.756+0000 7f6387fff640 1 -- 172.21.15.45:0/2937408592 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638806cd00 con 0x7f63880bc8b0 2023-10-03T19:13:30.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.756+0000 7f638c9c5640 1 --2- 172.21.15.45:0/2937408592 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f638806f170 0x7f6388150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:30.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.756+0000 7f6387fff640 1 --2- 172.21.15.45:0/2937408592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63880bc8b0 0x7f638814ca70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6370009e50 tx=0x7f637001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3364ac795f97fc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:30.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.756+0000 7f63877fe640 1 -- 172.21.15.45:0/2937408592 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63700af400 con 0x7f63880bc8b0 2023-10-03T19:13:30.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.756+0000 7f63877fe640 1 -- 172.21.15.45:0/2937408592 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63700ab050 con 0x7f63880bc8b0 2023-10-03T19:13:30.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.756+0000 7f63877fe640 1 -- 172.21.15.45:0/2937408592 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63700af780 con 0x7f63880bc8b0 2023-10-03T19:13:30.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f638ec29640 1 -- 172.21.15.45:0/2937408592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63880bc8b0 msgr2=0x7f638814ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:30.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f638ec29640 1 --2- 172.21.15.45:0/2937408592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63880bc8b0 0x7f638814ca70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6370009e50 tx=0x7f637001f1c0 comp rx=0 tx=0).stop 2023-10-03T19:13:30.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f638ec29640 1 -- 172.21.15.45:0/2937408592 shutdown_connections 2023-10-03T19:13:30.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f638ec29640 1 --2- 172.21.15.45:0/2937408592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63880bc8b0 0x7f638814ca70 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:30.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f638ec29640 1 --2- 172.21.15.45:0/2937408592 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f638806f170 0x7f6388150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:30.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f638ec29640 1 -- 172.21.15.45:0/2937408592 >> 172.21.15.45:0/2937408592 conn(0x7f63880bcf50 msgr2=0x7f63880bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:30.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f638ec29640 1 -- 172.21.15.45:0/2937408592 shutdown_connections 2023-10-03T19:13:30.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f638ec29640 1 -- 172.21.15.45:0/2937408592 wait complete. 2023-10-03T19:13:30.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f638ec29640 1 Processor -- start 2023-10-03T19:13:30.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f638ec29640 1 -- start start 2023-10-03T19:13:30.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f638ec29640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f638806d170 0x7f638814b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:30.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f638ec29640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f638806f170 0x7f63881446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:30.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f638ec29640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63880bc8b0 0x7f6388144c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:30.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f638ec29640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6388147e50 con 0x7f638806f170 2023-10-03T19:13:30.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f638ec29640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63881e5260 con 0x7f63880bc8b0 2023-10-03T19:13:30.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f638ec29640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f638814bc20 con 0x7f638806d170 2023-10-03T19:13:30.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f6387fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f638806f170 0x7f63881446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:30.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f6387fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f638806f170 0x7f63881446c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54172/0 (socket says 172.21.15.45:54172) 2023-10-03T19:13:30.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f6387fff640 1 -- 172.21.15.45:0/1045682271 learned_addr learned my addr 172.21.15.45:0/1045682271 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:30.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f638c9c5640 1 --2- 172.21.15.45:0/1045682271 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f638806d170 0x7f638814b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:30.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f638d1c6640 1 --2- 172.21.15.45:0/1045682271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63880bc8b0 0x7f6388144c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:30.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f6387fff640 1 -- 172.21.15.45:0/1045682271 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f638806d170 msgr2=0x7f638814b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:30.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f6387fff640 1 --2- 172.21.15.45:0/1045682271 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f638806d170 0x7f638814b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:30.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f6387fff640 1 -- 172.21.15.45:0/1045682271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63880bc8b0 msgr2=0x7f6388144c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:30.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f6387fff640 1 --2- 172.21.15.45:0/1045682271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63880bc8b0 0x7f6388144c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:30.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f6387fff640 1 -- 172.21.15.45:0/1045682271 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6370009b30 con 0x7f638806f170 2023-10-03T19:13:30.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f6387fff640 1 --2- 172.21.15.45:0/1045682271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f638806f170 0x7f63881446c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f63700b2040 tx=0x7f637001bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:30.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f63857fa640 1 -- 172.21.15.45:0/1045682271 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63700c0070 con 0x7f638806f170 2023-10-03T19:13:30.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f63857fa640 1 -- 172.21.15.45:0/1045682271 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6370009510 con 0x7f638806f170 2023-10-03T19:13:30.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f638ec29640 1 -- 172.21.15.45:0/1045682271 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f638814c4a0 con 0x7f638806f170 2023-10-03T19:13:30.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f63857fa640 1 -- 172.21.15.45:0/1045682271 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63700afe80 con 0x7f638806f170 2023-10-03T19:13:30.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.760+0000 7f638ec29640 1 -- 172.21.15.45:0/1045682271 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f638814fae0 con 0x7f638806f170 2023-10-03T19:13:30.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.764+0000 7f638ec29640 1 -- 172.21.15.45:0/1045682271 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f638806f540 con 0x7f638806f170 2023-10-03T19:13:30.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.764+0000 7f63857fa640 1 -- 172.21.15.45:0/1045682271 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f63700b6040 con 0x7f638806f170 2023-10-03T19:13:30.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.764+0000 7f63857fa640 1 --2- 172.21.15.45:0/1045682271 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6368066280 0x7f6368068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:30.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.764+0000 7f63857fa640 1 -- 172.21.15.45:0/1045682271 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6370121730 con 0x7f638806f170 2023-10-03T19:13:30.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.764+0000 7f638c9c5640 1 --2- 172.21.15.45:0/1045682271 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6368066280 0x7f6368068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:30.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.764+0000 7f638c9c5640 1 --2- 172.21.15.45:0/1045682271 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6368066280 0x7f6368068730 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f637800ab60 tx=0x7f6378008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:30.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.768+0000 7f63857fa640 1 -- 172.21.15.45:0/1045682271 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f63700eec70 con 0x7f638806f170 2023-10-03T19:13:30.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.956+0000 7f638ec29640 1 -- 172.21.15.45:0/1045682271 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f638806d660 con 0x7f638806f170 2023-10-03T19:13:30.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.956+0000 7f63857fa640 1 -- 172.21.15.45:0/1045682271 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+3908 (secure 0 0 0) 0x7f63700f2290 con 0x7f638806f170 2023-10-03T19:13:30.962 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:13:30.963 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4727,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/659816428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":659816428},{"type":"v1","addr":"172.21.15.79:6835","nonce":659816428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5073,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3273073650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3273073650},{"type":"v1","addr":"172.21.15.45:6834","nonce":3273073650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:13:21.307600+0000","modified":"2023-10-03T19:13:24.332226+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5076},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5076":{"gid":5076,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/252012936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":252012936},{"type":"v1","addr":"172.21.15.45:6835","nonce":252012936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-03T19:13:30.963 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 15 2023-10-03T19:13:30.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.960+0000 7f638ec29640 1 -- 172.21.15.45:0/1045682271 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6368066280 msgr2=0x7f6368068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:30.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.960+0000 7f638ec29640 1 --2- 172.21.15.45:0/1045682271 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6368066280 0x7f6368068730 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f637800ab60 tx=0x7f6378008040 comp rx=0 tx=0).stop 2023-10-03T19:13:30.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.960+0000 7f638ec29640 1 -- 172.21.15.45:0/1045682271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f638806f170 msgr2=0x7f63881446c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:30.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.960+0000 7f638ec29640 1 --2- 172.21.15.45:0/1045682271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f638806f170 0x7f63881446c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f63700b2040 tx=0x7f637001bf60 comp rx=0 tx=0).stop 2023-10-03T19:13:30.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.960+0000 7f638ec29640 1 -- 172.21.15.45:0/1045682271 shutdown_connections 2023-10-03T19:13:30.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.960+0000 7f638ec29640 1 --2- 172.21.15.45:0/1045682271 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6368066280 0x7f6368068730 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:30.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.960+0000 7f638ec29640 1 --2- 172.21.15.45:0/1045682271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63880bc8b0 0x7f6388144c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:30.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.960+0000 7f638ec29640 1 --2- 172.21.15.45:0/1045682271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f638806f170 0x7f63881446c0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:30.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.960+0000 7f638ec29640 1 --2- 172.21.15.45:0/1045682271 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f638806d170 0x7f638814b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:30.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.960+0000 7f638ec29640 1 -- 172.21.15.45:0/1045682271 >> 172.21.15.45:0/1045682271 conn(0x7f63880bcf50 msgr2=0x7f6388070a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:30.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.960+0000 7f638ec29640 1 -- 172.21.15.45:0/1045682271 shutdown_connections 2023-10-03T19:13:30.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:30.960+0000 7f638ec29640 1 -- 172.21.15.45:0/1045682271 wait complete. 2023-10-03T19:13:31.082 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:13:31.085 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:13:31.087 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:13:31.090 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:13:31.284 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-03T19:13:21.307600+0000', 'modified': '2023-10-03T19:13:24.332226+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5076}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5076': {'gid': 5076, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6835/252012936', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6833', 'nonce': 252012936}, {'type': 'v1', 'addr': '172.21.15.45:6835', 'nonce': 252012936}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-03T19:13:31.284 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-03T19:13:31.284 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-03T19:13:31.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.416+0000 7fb73c772640 1 Processor -- start 2023-10-03T19:13:31.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.416+0000 7fb73c772640 1 -- start start 2023-10-03T19:13:31.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.416+0000 7fb73c772640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb734148170 0x7fb7340bc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:31.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.416+0000 7fb73c772640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb7340bd3b0 0x7fb73414e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:31.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.416+0000 7fb73c772640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb734148540 con 0x7fb7340bc220 2023-10-03T19:13:31.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.416+0000 7fb73c772640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb734072aa0 con 0x7fb734148170 2023-10-03T19:13:31.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.416+0000 7fb73c772640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb73406f730 con 0x7fb7340bd3b0 2023-10-03T19:13:31.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.416+0000 7fb73a50e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb734148170 0x7fb7340bc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:31.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.416+0000 7fb73a50e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb734148170 0x7fb7340bc9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54186/0 (socket says 172.21.15.45:54186) 2023-10-03T19:13:31.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.416+0000 7fb73a50e640 1 -- 172.21.15.45:0/1805933867 learned_addr learned my addr 172.21.15.45:0/1805933867 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:31.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.416+0000 7fb739d0d640 1 --2- 172.21.15.45:0/1805933867 >> v2:172.21.15.79:3300/0 conn(0x7fb7340bd3b0 0x7fb73414e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:31.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.416+0000 7fb73a50e640 1 -- 172.21.15.45:0/1805933867 >> v2:172.21.15.79:3300/0 conn(0x7fb7340bd3b0 msgr2=0x7fb73414e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:31.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.416+0000 7fb73a50e640 1 --2- 172.21.15.45:0/1805933867 >> v2:172.21.15.79:3300/0 conn(0x7fb7340bd3b0 0x7fb73414e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.416+0000 7fb73a50e640 1 -- 172.21.15.45:0/1805933867 >> v1:172.21.15.79:6789/0 conn(0x7fb7340bc220 legacy=0x7fb734072390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:31.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.416+0000 7fb73a50e640 1 -- 172.21.15.45:0/1805933867 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb734070690 con 0x7fb734148170 2023-10-03T19:13:31.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb73a50e640 1 --2- 172.21.15.45:0/1805933867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb734148170 0x7fb7340bc9d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb7340c1940 tx=0x7fb72c01f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f9dbc199ada7212 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:31.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb73950c640 1 -- 172.21.15.45:0/1805933867 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c0af400 con 0x7fb734148170 2023-10-03T19:13:31.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb73950c640 1 -- 172.21.15.45:0/1805933867 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72c0ab050 con 0x7fb734148170 2023-10-03T19:13:31.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb73950c640 1 -- 172.21.15.45:0/1805933867 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c0af780 con 0x7fb734148170 2023-10-03T19:13:31.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb73c772640 1 -- 172.21.15.45:0/1805933867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb734148170 msgr2=0x7fb7340bc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:31.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb73c772640 1 --2- 172.21.15.45:0/1805933867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb734148170 0x7fb7340bc9d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb7340c1940 tx=0x7fb72c01f180 comp rx=0 tx=0).stop 2023-10-03T19:13:31.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb73c772640 1 -- 172.21.15.45:0/1805933867 shutdown_connections 2023-10-03T19:13:31.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb73c772640 1 --2- 172.21.15.45:0/1805933867 >> v2:172.21.15.79:3300/0 conn(0x7fb7340bd3b0 0x7fb73414e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb73c772640 1 --2- 172.21.15.45:0/1805933867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb734148170 0x7fb7340bc9d0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb73c772640 1 -- 172.21.15.45:0/1805933867 >> 172.21.15.45:0/1805933867 conn(0x7fb7340c0d20 msgr2=0x7fb7340c1120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:31.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb73c772640 1 -- 172.21.15.45:0/1805933867 shutdown_connections 2023-10-03T19:13:31.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb73c772640 1 -- 172.21.15.45:0/1805933867 wait complete. 2023-10-03T19:13:31.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb73c772640 1 Processor -- start 2023-10-03T19:13:31.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb73c772640 1 -- start start 2023-10-03T19:13:31.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb73c772640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb7340bc220 0x7fb73413ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:31.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb73c772640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7340bd3b0 0x7fb7340ba710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:31.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb73c772640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb734148170 0x7fb734138f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:31.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb73c772640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7341e4790 con 0x7fb7340bd3b0 2023-10-03T19:13:31.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb73c772640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73406cc90 con 0x7fb734148170 2023-10-03T19:13:31.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb73c772640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7340bac50 con 0x7fb7340bc220 2023-10-03T19:13:31.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb739d0d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7340bd3b0 0x7fb7340ba710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:31.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb739d0d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7340bd3b0 0x7fb7340ba710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54188/0 (socket says 172.21.15.45:54188) 2023-10-03T19:13:31.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb739d0d640 1 -- 172.21.15.45:0/1989099522 learned_addr learned my addr 172.21.15.45:0/1989099522 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:31.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb73ad0f640 1 --2- 172.21.15.45:0/1989099522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb734148170 0x7fb734138f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:31.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb73a50e640 1 --2- 172.21.15.45:0/1989099522 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb7340bc220 0x7fb73413ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:31.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb739d0d640 1 -- 172.21.15.45:0/1989099522 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb7340bc220 msgr2=0x7fb73413ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:31.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb739d0d640 1 --2- 172.21.15.45:0/1989099522 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb7340bc220 0x7fb73413ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb739d0d640 1 -- 172.21.15.45:0/1989099522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb734148170 msgr2=0x7fb734138f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:31.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb739d0d640 1 --2- 172.21.15.45:0/1989099522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb734148170 0x7fb734138f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb739d0d640 1 -- 172.21.15.45:0/1989099522 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72c009b30 con 0x7fb7340bd3b0 2023-10-03T19:13:31.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb739d0d640 1 --2- 172.21.15.45:0/1989099522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7340bd3b0 0x7fb7340ba710 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb72800d800 tx=0x7fb72800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:31.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.420+0000 7fb732ffd640 1 -- 172.21.15.45:0/1989099522 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72800b6c0 con 0x7fb7340bd3b0 2023-10-03T19:13:31.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.424+0000 7fb732ffd640 1 -- 172.21.15.45:0/1989099522 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72800b820 con 0x7fb7340bd3b0 2023-10-03T19:13:31.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.424+0000 7fb73c772640 1 -- 172.21.15.45:0/1989099522 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb73406fd20 con 0x7fb7340bd3b0 2023-10-03T19:13:31.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.424+0000 7fb732ffd640 1 -- 172.21.15.45:0/1989099522 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72800bb90 con 0x7fb7340bd3b0 2023-10-03T19:13:31.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.424+0000 7fb73c772640 1 -- 172.21.15.45:0/1989099522 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb73406f9d0 con 0x7fb7340bd3b0 2023-10-03T19:13:31.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.424+0000 7fb732ffd640 1 -- 172.21.15.45:0/1989099522 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb72800bcf0 con 0x7fb7340bd3b0 2023-10-03T19:13:31.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.424+0000 7fb732ffd640 1 --2- 172.21.15.45:0/1989099522 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb720066280 0x7fb720068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:31.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.424+0000 7fb732ffd640 1 -- 172.21.15.45:0/1989099522 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb728084240 con 0x7fb7340bd3b0 2023-10-03T19:13:31.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.424+0000 7fb73a50e640 1 --2- 172.21.15.45:0/1989099522 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb720066280 0x7fb720068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:31.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.424+0000 7fb73f896000 1 Processor -- start 2023-10-03T19:13:31.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.424+0000 7fb73f896000 1 -- start start 2023-10-03T19:13:31.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.424+0000 7fb73a50e640 1 --2- 172.21.15.45:0/1989099522 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb720066280 0x7fb720068730 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb72c0b1000 tx=0x7fb72c0aa000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:31.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.424+0000 7fb73f896000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b94da5b6f0 0x55b94da52ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:31.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.424+0000 7fb73f896000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b94da53020 0x55b94da533f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:31.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.424+0000 7fb73f896000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55b94da53930 0x55b94da53d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:31.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.424+0000 7fb73f896000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b94d91d310 con 0x55b94da5b6f0 2023-10-03T19:13:31.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.424+0000 7fb73f896000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b94d857980 con 0x55b94da53020 2023-10-03T19:13:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.424+0000 7fb73f896000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b94d8ab040 con 0x55b94da53930 2023-10-03T19:13:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.424+0000 7fb73a50e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b94da5b6f0 0x55b94da52ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.424+0000 7fb73a50e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b94da5b6f0 0x55b94da52ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54190/0 (socket says 172.21.15.45:54190) 2023-10-03T19:13:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.424+0000 7fb73a50e640 1 -- 172.21.15.45:0/3459563518 learned_addr learned my addr 172.21.15.45:0/3459563518 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb739d0d640 1 --2- 172.21.15.45:0/3459563518 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b94da53020 0x55b94da533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73ad0f640 1 --2- 172.21.15.45:0/3459563518 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55b94da53930 0x55b94da53d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73a50e640 1 -- 172.21.15.45:0/3459563518 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55b94da53930 msgr2=0x55b94da53d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73a50e640 1 --2- 172.21.15.45:0/3459563518 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55b94da53930 0x55b94da53d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73a50e640 1 -- 172.21.15.45:0/3459563518 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b94da53020 msgr2=0x55b94da533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73a50e640 1 --2- 172.21.15.45:0/3459563518 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b94da53020 0x55b94da533f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73a50e640 1 -- 172.21.15.45:0/3459563518 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b94d8690b0 con 0x55b94da5b6f0 2023-10-03T19:13:31.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73a50e640 1 --2- 172.21.15.45:0/3459563518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b94da5b6f0 0x55b94da52ae0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb72c01cdb0 tx=0x7fb72c004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff9dc59b9fe4011 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:31.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb71bfff640 1 -- 172.21.15.45:0/3459563518 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c0c5600 con 0x55b94da5b6f0 2023-10-03T19:13:31.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb71bfff640 1 -- 172.21.15.45:0/3459563518 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72c0c5760 con 0x55b94da5b6f0 2023-10-03T19:13:31.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb71bfff640 1 -- 172.21.15.45:0/3459563518 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c0c5ad0 con 0x55b94da5b6f0 2023-10-03T19:13:31.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73f896000 1 -- 172.21.15.45:0/3459563518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b94da5b6f0 msgr2=0x55b94da52ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:31.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73f896000 1 --2- 172.21.15.45:0/3459563518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b94da5b6f0 0x55b94da52ae0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb72c01cdb0 tx=0x7fb72c004ac0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73f896000 1 -- 172.21.15.45:0/3459563518 shutdown_connections 2023-10-03T19:13:31.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73f896000 1 --2- 172.21.15.45:0/3459563518 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55b94da53930 0x55b94da53d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73f896000 1 --2- 172.21.15.45:0/3459563518 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b94da53020 0x55b94da533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73f896000 1 --2- 172.21.15.45:0/3459563518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b94da5b6f0 0x55b94da52ae0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73f896000 1 -- 172.21.15.45:0/3459563518 >> 172.21.15.45:0/3459563518 conn(0x55b94da8d220 msgr2=0x55b94da8f600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:31.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73f896000 1 -- 172.21.15.45:0/3459563518 shutdown_connections 2023-10-03T19:13:31.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73f896000 1 -- 172.21.15.45:0/3459563518 wait complete. 2023-10-03T19:13:31.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73f896000 1 -- start start 2023-10-03T19:13:31.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73f896000 1 Processor -- start 2023-10-03T19:13:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73f896000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55b94da53020 0x55b94da57f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73f896000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b94da53930 0x55b94da584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73f896000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b94da5b6f0 0x55b94da589e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73f896000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b94d8a40e0 con 0x55b94da5b6f0 2023-10-03T19:13:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73f896000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b94d860bd0 con 0x55b94da53930 2023-10-03T19:13:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73f896000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b94d860870 con 0x55b94da53020 2023-10-03T19:13:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73f896000 10 client.0 _ll_register_callbacks cb 0x55b94da40c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T19:13:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73ad0f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b94da5b6f0 0x55b94da589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73ad0f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b94da5b6f0 0x55b94da589e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54202/0 (socket says 172.21.15.45:54202) 2023-10-03T19:13:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73ad0f640 1 -- 172.21.15.45:0/2494005887 learned_addr learned my addr 172.21.15.45:0/2494005887 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb739d0d640 1 --2- 172.21.15.45:0/2494005887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b94da53930 0x55b94da584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73a50e640 1 --2- 172.21.15.45:0/2494005887 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55b94da53020 0x55b94da57f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73ad0f640 1 -- 172.21.15.45:0/2494005887 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55b94da53020 msgr2=0x55b94da57f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73ad0f640 1 --2- 172.21.15.45:0/2494005887 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55b94da53020 0x55b94da57f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73ad0f640 1 -- 172.21.15.45:0/2494005887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b94da53930 msgr2=0x55b94da584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73ad0f640 1 --2- 172.21.15.45:0/2494005887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b94da53930 0x55b94da584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73ad0f640 1 -- 172.21.15.45:0/2494005887 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb734070690 con 0x55b94da5b6f0 2023-10-03T19:13:31.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73a50e640 1 --2- 172.21.15.45:0/2494005887 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55b94da53020 0x55b94da57f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:31.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73ad0f640 1 --2- 172.21.15.45:0/2494005887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b94da5b6f0 0x55b94da589e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb724005520 tx=0x7fb72400f540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a53a7fcfb252d727 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:31.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb7197fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-10-03T19:13:31.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb7197fa640 1 -- 172.21.15.45:0/2494005887 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72400d070 con 0x55b94da5b6f0 2023-10-03T19:13:31.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb7197fa640 1 -- 172.21.15.45:0/2494005887 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb724003870 con 0x55b94da5b6f0 2023-10-03T19:13:31.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73f896000 1 -- 172.21.15.45:0/2494005887 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b94d89f8b0 con 0x55b94da5b6f0 2023-10-03T19:13:31.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb7197fa640 1 -- 172.21.15.45:0/2494005887 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb724003a30 con 0x55b94da5b6f0 2023-10-03T19:13:31.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73f896000 10 client.5283 fetch_fsmap learned FSMap version 15 2023-10-03T19:13:31.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb73f896000 1 -- 172.21.15.45:0/2494005887 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55b94d5a0890 con 0x55b94da5b6f0 2023-10-03T19:13:31.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb7197fa640 1 -- 172.21.15.45:0/2494005887 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b94d89f8b0 con 0x55b94da5b6f0 2023-10-03T19:13:31.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.428+0000 7fb7197fa640 1 -- 172.21.15.45:0/2494005887 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 15) v1 ==== 2569+0+0 (secure 0 0 0) 0x7fb724003b90 con 0x55b94da5b6f0 2023-10-03T19:13:31.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.432+0000 7fb73f896000 10 client.5283 fetch_fsmap finished waiting for FSMap version 15 2023-10-03T19:13:31.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.432+0000 7fb73f896000 10 client.5283 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T19:13:31.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.432+0000 7fb73f896000 20 client.5283 populate_metadata read hostname 'smithi045' 2023-10-03T19:13:31.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.432+0000 7fb73f896000 1 --2- 172.21.15.45:0/2494005887 >> [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] conn(0x55b94daa1820 0x55b94daa3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:31.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.432+0000 7fb73f896000 4 client.5283 mds_command: new command op to 5076 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-03T19:13:31.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.432+0000 7fb73f896000 1 -- 172.21.15.45:0/2494005887 --> [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b94d8d2f70 con 0x55b94daa1820 2023-10-03T19:13:31.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.432+0000 7fb73a50e640 1 --2- 172.21.15.45:0/2494005887 >> [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] conn(0x55b94daa1820 0x55b94daa3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:31.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.432+0000 7fb73a50e640 1 --2- 172.21.15.45:0/2494005887 >> [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] conn(0x55b94daa1820 0x55b94daa3c00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6a9075caba434f9 server_cookie=44fdb0a9c2bf69c in_seq=0 out_seq=0 2023-10-03T19:13:31.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.432+0000 7fb7197fa640 10 client.5283 ms_handle_connect on v2:172.21.15.45:6833/252012936 2023-10-03T19:13:31.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.432+0000 7fb7197fa640 1 -- 172.21.15.45:0/2494005887 <== mds.0 v2:172.21.15.45:6833/252012936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b94d8d2f70 con 0x55b94daa1820 2023-10-03T19:13:31.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.432+0000 7fb7197fa640 10 client.5283 handle_command_reply: tid=0 2023-10-03T19:13:31.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.432+0000 7fb73f896000 1 client.5283 shutdown 2023-10-03T19:13:31.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.432+0000 7fb73f896000 1 -- 172.21.15.45:0/2494005887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b94da5b6f0 msgr2=0x55b94da589e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:31.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.432+0000 7fb73f896000 1 --2- 172.21.15.45:0/2494005887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b94da5b6f0 0x55b94da589e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb724005520 tx=0x7fb72400f540 comp rx=0 tx=0).stop 2023-10-03T19:13:31.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.432+0000 7fb73f896000 1 -- 172.21.15.45:0/2494005887 shutdown_connections 2023-10-03T19:13:31.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.432+0000 7fb73f896000 1 --2- 172.21.15.45:0/2494005887 >> [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] conn(0x55b94daa1820 0x55b94daa3c00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.432+0000 7fb73f896000 1 --2- 172.21.15.45:0/2494005887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b94da5b6f0 0x55b94da589e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.432+0000 7fb73f896000 1 --2- 172.21.15.45:0/2494005887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b94da53930 0x55b94da584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.432+0000 7fb73f896000 1 --2- 172.21.15.45:0/2494005887 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55b94da53020 0x55b94da57f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.432+0000 7fb7197fa640 0 client.5283 ms_handle_reset on v2:172.21.15.45:6833/252012936 2023-10-03T19:13:31.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.432+0000 7fb73f896000 1 -- 172.21.15.45:0/2494005887 >> 172.21.15.45:0/2494005887 conn(0x55b94da8d220 msgr2=0x55b94da8f600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:31.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.432+0000 7fb73f896000 1 -- 172.21.15.45:0/2494005887 shutdown_connections 2023-10-03T19:13:31.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.432+0000 7fb73f896000 1 -- 172.21.15.45:0/2494005887 wait complete. 2023-10-03T19:13:31.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.432+0000 7fb73f896000 20 client.5283 trim_cache size 0 max 16384 2023-10-03T19:13:31.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb73f896000 1 Processor -- start 2023-10-03T19:13:31.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb73f896000 1 -- start start 2023-10-03T19:13:31.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb73f896000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b94da53020 0x55b94daa5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:31.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb73f896000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55b94da53930 0x55b94daa3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:31.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb73f896000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b94da5b6f0 0x55b94daa4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:31.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb73f896000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b94d561940 con 0x55b94da5b6f0 2023-10-03T19:13:31.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb73f896000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b94da8fa60 con 0x55b94da53020 2023-10-03T19:13:31.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb73f896000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b94d873620 con 0x55b94da53930 2023-10-03T19:13:31.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb73ad0f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b94da5b6f0 0x55b94daa4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:31.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb73ad0f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b94da5b6f0 0x55b94daa4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54208/0 (socket says 172.21.15.45:54208) 2023-10-03T19:13:31.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb73ad0f640 1 -- 172.21.15.45:0/3250661842 learned_addr learned my addr 172.21.15.45:0/3250661842 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:31.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb73a50e640 1 --2- 172.21.15.45:0/3250661842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b94da53020 0x55b94daa5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:31.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb739d0d640 1 --2- 172.21.15.45:0/3250661842 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55b94da53930 0x55b94daa3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:31.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb73ad0f640 1 -- 172.21.15.45:0/3250661842 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55b94da53930 msgr2=0x55b94daa3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:31.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb73ad0f640 1 --2- 172.21.15.45:0/3250661842 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55b94da53930 0x55b94daa3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb73ad0f640 1 -- 172.21.15.45:0/3250661842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b94da53020 msgr2=0x55b94daa5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:31.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb73ad0f640 1 --2- 172.21.15.45:0/3250661842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b94da53020 0x55b94daa5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb73ad0f640 1 -- 172.21.15.45:0/3250661842 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b94d869360 con 0x55b94da5b6f0 2023-10-03T19:13:31.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb73a50e640 1 --2- 172.21.15.45:0/3250661842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b94da53020 0x55b94daa5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:31.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb739d0d640 1 --2- 172.21.15.45:0/3250661842 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55b94da53930 0x55b94daa3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:31.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb73ad0f640 1 --2- 172.21.15.45:0/3250661842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b94da5b6f0 0x55b94daa4140 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb7240054f0 tx=0x7fb724013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e5b8c7cdf71e78 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:31.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb730ff9640 1 -- 172.21.15.45:0/3250661842 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb724003870 con 0x55b94da5b6f0 2023-10-03T19:13:31.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb730ff9640 1 -- 172.21.15.45:0/3250661842 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7240039f0 con 0x55b94da5b6f0 2023-10-03T19:13:31.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb730ff9640 1 -- 172.21.15.45:0/3250661842 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7240040a0 con 0x55b94da5b6f0 2023-10-03T19:13:31.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb73f896000 1 -- 172.21.15.45:0/3250661842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b94da5b6f0 msgr2=0x55b94daa4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:31.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb73f896000 1 --2- 172.21.15.45:0/3250661842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b94da5b6f0 0x55b94daa4140 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb7240054f0 tx=0x7fb724013000 comp rx=0 tx=0).stop 2023-10-03T19:13:31.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb73f896000 1 -- 172.21.15.45:0/3250661842 shutdown_connections 2023-10-03T19:13:31.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb73f896000 1 --2- 172.21.15.45:0/3250661842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b94da5b6f0 0x55b94daa4140 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb73f896000 1 --2- 172.21.15.45:0/3250661842 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55b94da53930 0x55b94daa3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb73f896000 1 --2- 172.21.15.45:0/3250661842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b94da53020 0x55b94daa5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb73f896000 1 -- 172.21.15.45:0/3250661842 >> 172.21.15.45:0/3250661842 conn(0x55b94da8d220 msgr2=0x55b94da9ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:31.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb73f896000 1 -- 172.21.15.45:0/3250661842 shutdown_connections 2023-10-03T19:13:31.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb73f896000 1 -- 172.21.15.45:0/3250661842 wait complete. 2023-10-03T19:13:31.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb73f896000 1 -- start start 2023-10-03T19:13:31.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.448+0000 7fb73f896000 1 Processor -- start 2023-10-03T19:13:31.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73f896000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55b94da53020 0x55b94daa5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:31.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73f896000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b94da53930 0x55b94daee8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:31.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73f896000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b94da5b6f0 0x55b94daeee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:31.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73f896000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b94d8e7150 con 0x55b94da53930 2023-10-03T19:13:31.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73f896000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b94d5a11b0 con 0x55b94da5b6f0 2023-10-03T19:13:31.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73f896000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b94d8a6c40 con 0x55b94da53020 2023-10-03T19:13:31.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73f896000 10 client.0 _ll_register_callbacks cb 0x55b94d8a6260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T19:13:31.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb739d0d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b94da53930 0x55b94daee8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:31.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb739d0d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b94da53930 0x55b94daee8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54220/0 (socket says 172.21.15.45:54220) 2023-10-03T19:13:31.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb739d0d640 1 -- 172.21.15.45:0/1275868682 learned_addr learned my addr 172.21.15.45:0/1275868682 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:31.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73a50e640 1 --2- 172.21.15.45:0/1275868682 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55b94da53020 0x55b94daa5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:31.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb739d0d640 1 -- 172.21.15.45:0/1275868682 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55b94da53020 msgr2=0x55b94daa5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:31.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb739d0d640 1 --2- 172.21.15.45:0/1275868682 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55b94da53020 0x55b94daa5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb739d0d640 1 -- 172.21.15.45:0/1275868682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b94da5b6f0 msgr2=0x55b94daeee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:31.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73ad0f640 1 --2- 172.21.15.45:0/1275868682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b94da5b6f0 0x55b94daeee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:31.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb739d0d640 1 --2- 172.21.15.45:0/1275868682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b94da5b6f0 0x55b94daeee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb739d0d640 1 -- 172.21.15.45:0/1275868682 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b94d5a0890 con 0x55b94da53930 2023-10-03T19:13:31.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73a50e640 1 --2- 172.21.15.45:0/1275868682 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55b94da53020 0x55b94daa5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:31.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb739d0d640 1 --2- 172.21.15.45:0/1275868682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b94da53930 0x55b94daee8d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb72805d230 tx=0x7fb7280593d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b00737cc93b18f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:31.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb7197fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-10-03T19:13:31.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb7197fa640 1 -- 172.21.15.45:0/1275868682 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb728051b20 con 0x55b94da53930 2023-10-03T19:13:31.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb7197fa640 1 -- 172.21.15.45:0/1275868682 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb728051c80 con 0x55b94da53930 2023-10-03T19:13:31.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73f896000 1 -- 172.21.15.45:0/1275868682 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b94da8fba0 con 0x55b94da53930 2023-10-03T19:13:31.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb7197fa640 1 -- 172.21.15.45:0/1275868682 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb728082250 con 0x55b94da53930 2023-10-03T19:13:31.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73f896000 10 client.5289 fetch_fsmap learned FSMap version 15 2023-10-03T19:13:31.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73f896000 1 -- 172.21.15.45:0/1275868682 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55b94d84ebe0 con 0x55b94da53930 2023-10-03T19:13:31.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb7197fa640 1 -- 172.21.15.45:0/1275868682 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b94da8fba0 con 0x55b94da53930 2023-10-03T19:13:31.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb7197fa640 1 -- 172.21.15.45:0/1275868682 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 15) v1 ==== 2569+0+0 (secure 0 0 0) 0x7fb72805b0b0 con 0x55b94da53930 2023-10-03T19:13:31.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73f896000 10 client.5289 fetch_fsmap finished waiting for FSMap version 15 2023-10-03T19:13:31.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73f896000 10 client.5289 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T19:13:31.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73f896000 20 client.5289 populate_metadata read hostname 'smithi045' 2023-10-03T19:13:31.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73f896000 1 --2- 172.21.15.45:0/1275868682 >> [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] conn(0x55b94daed6b0 0x55b94daeda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:31.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73f896000 4 client.5289 mds_command: new command op to 5076 tid=0[{"prefix": "status"}] 2023-10-03T19:13:31.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73f896000 1 -- 172.21.15.45:0/1275868682 --> [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b94da569a0 con 0x55b94daed6b0 2023-10-03T19:13:31.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73a50e640 1 --2- 172.21.15.45:0/1275868682 >> [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] conn(0x55b94daed6b0 0x55b94daeda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:31.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73a50e640 1 --2- 172.21.15.45:0/1275868682 >> [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] conn(0x55b94daed6b0 0x55b94daeda80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b94dcbb05fdd9c6 server_cookie=c6fb24928852e671 in_seq=0 out_seq=0 2023-10-03T19:13:31.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb7197fa640 10 client.5289 ms_handle_connect on v2:172.21.15.45:6833/252012936 2023-10-03T19:13:31.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb7197fa640 1 -- 172.21.15.45:0/1275868682 <== mds.0 v2:172.21.15.45:6833/252012936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55b94da569a0 con 0x55b94daed6b0 2023-10-03T19:13:31.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb7197fa640 10 client.5289 handle_command_reply: tid=0 2023-10-03T19:13:31.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73f896000 1 client.5289 shutdown 2023-10-03T19:13:31.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73f896000 1 -- 172.21.15.45:0/1275868682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b94da53930 msgr2=0x55b94daee8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:31.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73f896000 1 --2- 172.21.15.45:0/1275868682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b94da53930 0x55b94daee8d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb72805d230 tx=0x7fb7280593d0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73f896000 1 -- 172.21.15.45:0/1275868682 shutdown_connections 2023-10-03T19:13:31.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73f896000 1 --2- 172.21.15.45:0/1275868682 >> [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] conn(0x55b94daed6b0 0x55b94daeda80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73f896000 1 --2- 172.21.15.45:0/1275868682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b94da5b6f0 0x55b94daeee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73f896000 1 --2- 172.21.15.45:0/1275868682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b94da53930 0x55b94daee8d0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb7197fa640 0 client.5289 ms_handle_reset on v2:172.21.15.45:6833/252012936 2023-10-03T19:13:31.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73f896000 1 --2- 172.21.15.45:0/1275868682 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55b94da53020 0x55b94daa5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73f896000 1 -- 172.21.15.45:0/1275868682 >> 172.21.15.45:0/1275868682 conn(0x55b94da8d220 msgr2=0x55b94da9e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:31.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73f896000 1 -- 172.21.15.45:0/1275868682 shutdown_connections 2023-10-03T19:13:31.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73f896000 1 -- 172.21.15.45:0/1275868682 wait complete. 2023-10-03T19:13:31.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73f896000 20 client.5289 trim_cache size 0 max 16384 2023-10-03T19:13:31.466 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-03T19:13:31.466 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "58400977-12ba-4c73-bb3e-1589b2492669", 2023-10-03T19:13:31.466 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-10-03T19:13:31.466 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 5076, 2023-10-03T19:13:31.466 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-10-03T19:13:31.466 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-10-03T19:13:31.466 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-10-03T19:13:31.466 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 10.144574186, 2023-10-03T19:13:31.466 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 15, 2023-10-03T19:13:31.467 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 35, 2023-10-03T19:13:31.467 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 35, 2023-10-03T19:13:31.467 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 17.419519386000001 2023-10-03T19:13:31.467 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-03T19:13:31.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73c772640 1 -- 172.21.15.45:0/1989099522 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb720066280 msgr2=0x7fb720068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:31.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73c772640 1 --2- 172.21.15.45:0/1989099522 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb720066280 0x7fb720068730 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb72c0b1000 tx=0x7fb72c0aa000 comp rx=0 tx=0).stop 2023-10-03T19:13:31.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73c772640 1 -- 172.21.15.45:0/1989099522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7340bd3b0 msgr2=0x7fb7340ba710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:31.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73c772640 1 --2- 172.21.15.45:0/1989099522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7340bd3b0 0x7fb7340ba710 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb72800d800 tx=0x7fb72800dcc0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73c772640 1 -- 172.21.15.45:0/1989099522 shutdown_connections 2023-10-03T19:13:31.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73c772640 1 --2- 172.21.15.45:0/1989099522 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb720066280 0x7fb720068730 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73c772640 1 --2- 172.21.15.45:0/1989099522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb734148170 0x7fb734138f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73c772640 1 --2- 172.21.15.45:0/1989099522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7340bd3b0 0x7fb7340ba710 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73c772640 1 --2- 172.21.15.45:0/1989099522 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb7340bc220 0x7fb73413ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73c772640 1 -- 172.21.15.45:0/1989099522 >> 172.21.15.45:0/1989099522 conn(0x7fb7340c0d20 msgr2=0x7fb734072390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:31.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73c772640 1 -- 172.21.15.45:0/1989099522 shutdown_connections 2023-10-03T19:13:31.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.452+0000 7fb73c772640 1 -- 172.21.15.45:0/1989099522 wait complete. 2023-10-03T19:13:31.474 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-03T19:13:31.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.580+0000 7fc728c63640 1 Processor -- start 2023-10-03T19:13:31.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.580+0000 7fc728c63640 1 -- start start 2023-10-03T19:13:31.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.580+0000 7fc728c63640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc724148b90 0x7fc7240bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:31.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.580+0000 7fc728c63640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7240bc4a0 0x7fc72406c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:31.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.580+0000 7fc728c63640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc72414b610 con 0x7fc7240bcb60 2023-10-03T19:13:31.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.580+0000 7fc728c63640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7240a3670 con 0x7fc724148b90 2023-10-03T19:13:31.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.580+0000 7fc728c63640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc72414b370 con 0x7fc7240bc4a0 2023-10-03T19:13:31.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.580+0000 7fc721d9b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc7240bcb60 0x7fc72406c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35846/0 (socket says 172.21.15.45:35846) 2023-10-03T19:13:31.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.580+0000 7fc721d9b640 1 -- 172.21.15.45:0/695463796 learned_addr learned my addr 172.21.15.45:0/695463796 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:31.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc722d9d640 1 --2- 172.21.15.45:0/695463796 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7240bc4a0 0x7fc72406c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:31.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc72259c640 1 --2- 172.21.15.45:0/695463796 >> v2:172.21.15.79:3300/0 conn(0x7fc724148b90 0x7fc7240bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:31.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc72159a640 1 -- 172.21.15.45:0/695463796 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4249911756 0 0) 0x7fc72414b610 con 0x7fc7240bcb60 2023-10-03T19:13:31.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc72159a640 1 -- 172.21.15.45:0/695463796 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc70c003530 con 0x7fc7240bcb60 2023-10-03T19:13:31.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc72159a640 1 -- 172.21.15.45:0/695463796 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1531414946 0 0) 0x7fc70c003530 con 0x7fc7240bcb60 2023-10-03T19:13:31.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc72159a640 1 -- 172.21.15.45:0/695463796 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7240bc4a0 msgr2=0x7fc72406c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:31.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc72159a640 1 --2- 172.21.15.45:0/695463796 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7240bc4a0 0x7fc72406c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc72159a640 1 -- 172.21.15.45:0/695463796 >> v2:172.21.15.79:3300/0 conn(0x7fc724148b90 msgr2=0x7fc7240bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:31.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc72159a640 1 --2- 172.21.15.45:0/695463796 >> v2:172.21.15.79:3300/0 conn(0x7fc724148b90 0x7fc7240bbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc72159a640 1 -- 172.21.15.45:0/695463796 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7240a5580 con 0x7fc7240bcb60 2023-10-03T19:13:31.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc72159a640 1 -- 172.21.15.45:0/695463796 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fc714001680 con 0x7fc7240bcb60 2023-10-03T19:13:31.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc72159a640 1 -- 172.21.15.45:0/695463796 >> v1:172.21.15.45:6789/0 conn(0x7fc7240bcb60 legacy=0x7fc72406c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:31.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc72159a640 1 --2- 172.21.15.45:0/695463796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc70c003980 0x7fc70c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:31.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc72159a640 1 --2- 172.21.15.45:0/695463796 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7240bc4a0 0x7fc70c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:31.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc72159a640 1 --2- 172.21.15.45:0/695463796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc70c004d10 0x7fc70c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:31.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc72159a640 1 -- 172.21.15.45:0/695463796 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7240a3670 con 0x7fc70c003980 2023-10-03T19:13:31.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc72159a640 1 -- 172.21.15.45:0/695463796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72414b370 con 0x7fc70c004d10 2023-10-03T19:13:31.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc72159a640 1 -- 172.21.15.45:0/695463796 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c00b990 con 0x7fc7240bc4a0 2023-10-03T19:13:31.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc72259c640 1 --2- 172.21.15.45:0/695463796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc70c003980 0x7fc70c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:31.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc72259c640 1 -- 172.21.15.45:0/695463796 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7240bc4a0 msgr2=0x7fc70c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:31.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc72259c640 1 --2- 172.21.15.45:0/695463796 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7240bc4a0 0x7fc70c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc72259c640 1 -- 172.21.15.45:0/695463796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc70c004d10 msgr2=0x7fc70c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:31.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc72259c640 1 --2- 172.21.15.45:0/695463796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc70c004d10 0x7fc70c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc72259c640 1 -- 172.21.15.45:0/695463796 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70c003530 con 0x7fc70c003980 2023-10-03T19:13:31.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc72259c640 1 --2- 172.21.15.45:0/695463796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc70c003980 0x7fc70c003d90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc718009b10 tx=0x7fc71801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac5f0eae783456a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:31.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc72159a640 1 -- 172.21.15.45:0/695463796 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7180a5680 con 0x7fc70c003980 2023-10-03T19:13:31.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc72159a640 1 -- 172.21.15.45:0/695463796 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7180a57e0 con 0x7fc70c003980 2023-10-03T19:13:31.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc72159a640 1 -- 172.21.15.45:0/695463796 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7180a5b90 con 0x7fc70c003980 2023-10-03T19:13:31.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc728c63640 1 -- 172.21.15.45:0/695463796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc70c003980 msgr2=0x7fc70c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:31.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc728c63640 1 --2- 172.21.15.45:0/695463796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc70c003980 0x7fc70c003d90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc718009b10 tx=0x7fc71801ca30 comp rx=0 tx=0).stop 2023-10-03T19:13:31.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc722d9d640 1 -- 172.21.15.45:0/695463796 reap_dead start 2023-10-03T19:13:31.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc728c63640 1 -- 172.21.15.45:0/695463796 shutdown_connections 2023-10-03T19:13:31.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc728c63640 1 -- 172.21.15.45:0/695463796 >> 172.21.15.45:0/695463796 conn(0x7fc7240bcf50 msgr2=0x7fc7240bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:31.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc728c63640 1 -- 172.21.15.45:0/695463796 shutdown_connections 2023-10-03T19:13:31.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.584+0000 7fc728c63640 1 -- 172.21.15.45:0/695463796 wait complete. 2023-10-03T19:13:31.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.588+0000 7fc728c63640 1 Processor -- start 2023-10-03T19:13:31.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.588+0000 7fc728c63640 1 -- start start 2023-10-03T19:13:31.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.588+0000 7fc728c63640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc70c003980 0x7fc7240bd580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:31.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.588+0000 7fc728c63640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc724146200 0x7fc724146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:31.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.588+0000 7fc728c63640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7241e3690 0x7fc7241e3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:31.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.588+0000 7fc728c63640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7241e3240 con 0x7fc70c003980 2023-10-03T19:13:31.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.588+0000 7fc728c63640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7241d6c80 con 0x7fc7241e3690 2023-10-03T19:13:31.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.588+0000 7fc728c63640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7240bdac0 con 0x7fc724146200 2023-10-03T19:13:31.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.588+0000 7fc72259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc70c003980 0x7fc7240bd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:31.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.588+0000 7fc72259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc70c003980 0x7fc7240bd580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54236/0 (socket says 172.21.15.45:54236) 2023-10-03T19:13:31.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.588+0000 7fc72259c640 1 -- 172.21.15.45:0/253250448 learned_addr learned my addr 172.21.15.45:0/253250448 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:31.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.588+0000 7fc72259c640 1 -- 172.21.15.45:0/253250448 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc724146200 msgr2=0x7fc724146630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:31.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.588+0000 7fc72259c640 1 --2- 172.21.15.45:0/253250448 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc724146200 0x7fc724146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.588+0000 7fc72259c640 1 -- 172.21.15.45:0/253250448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7241e3690 msgr2=0x7fc7241e3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:31.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.588+0000 7fc72259c640 1 --2- 172.21.15.45:0/253250448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7241e3690 0x7fc7241e3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.588+0000 7fc72259c640 1 -- 172.21.15.45:0/253250448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc724148f60 con 0x7fc70c003980 2023-10-03T19:13:31.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.588+0000 7fc72259c640 1 --2- 172.21.15.45:0/253250448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc70c003980 0x7fc7240bd580 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc71801d2d0 tx=0x7fc70c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:31.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.588+0000 7fc712ffd640 1 -- 172.21.15.45:0/253250448 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7180be070 con 0x7fc70c003980 2023-10-03T19:13:31.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.588+0000 7fc712ffd640 1 -- 172.21.15.45:0/253250448 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7180a5e70 con 0x7fc70c003980 2023-10-03T19:13:31.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.588+0000 7fc728c63640 1 -- 172.21.15.45:0/253250448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7240a5820 con 0x7fc70c003980 2023-10-03T19:13:31.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.588+0000 7fc712ffd640 1 -- 172.21.15.45:0/253250448 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc718004260 con 0x7fc70c003980 2023-10-03T19:13:31.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.588+0000 7fc728c63640 1 -- 172.21.15.45:0/253250448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7240a3880 con 0x7fc70c003980 2023-10-03T19:13:31.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.588+0000 7fc728c63640 1 -- 172.21.15.45:0/253250448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc72404de80 con 0x7fc70c003980 2023-10-03T19:13:31.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.588+0000 7fc712ffd640 1 -- 172.21.15.45:0/253250448 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc7180b4040 con 0x7fc70c003980 2023-10-03T19:13:31.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.592+0000 7fc712ffd640 1 --2- 172.21.15.45:0/253250448 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc704066280 0x7fc704068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:31.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.592+0000 7fc712ffd640 1 -- 172.21.15.45:0/253250448 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc71811dbf0 con 0x7fc70c003980 2023-10-03T19:13:31.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.592+0000 7fc721d9b640 1 --2- 172.21.15.45:0/253250448 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc704066280 0x7fc704068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:31.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.592+0000 7fc721d9b640 1 --2- 172.21.15.45:0/253250448 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc704066280 0x7fc704068730 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc714000f70 tx=0x7fc7140014f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:31.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.596+0000 7fc712ffd640 1 -- 172.21.15.45:0/253250448 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc7180eafd0 con 0x7fc70c003980 2023-10-03T19:13:31.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.772+0000 7fc728c63640 1 -- 172.21.15.45:0/253250448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc7240a3f40 con 0x7fc70c003980 2023-10-03T19:13:31.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.776+0000 7fc712ffd640 1 -- 172.21.15.45:0/253250448 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc7180ee5f0 con 0x7fc70c003980 2023-10-03T19:13:31.780 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-03T19:13:31.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.776+0000 7fc728c63640 1 -- 172.21.15.45:0/253250448 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc704066280 msgr2=0x7fc704068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:31.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.776+0000 7fc728c63640 1 --2- 172.21.15.45:0/253250448 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc704066280 0x7fc704068730 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc714000f70 tx=0x7fc7140014f0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.776+0000 7fc728c63640 1 -- 172.21.15.45:0/253250448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc70c003980 msgr2=0x7fc7240bd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:31.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.776+0000 7fc728c63640 1 --2- 172.21.15.45:0/253250448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc70c003980 0x7fc7240bd580 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc71801d2d0 tx=0x7fc70c005800 comp rx=0 tx=0).stop 2023-10-03T19:13:31.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.776+0000 7fc728c63640 1 -- 172.21.15.45:0/253250448 shutdown_connections 2023-10-03T19:13:31.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.776+0000 7fc728c63640 1 --2- 172.21.15.45:0/253250448 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc704066280 0x7fc704068730 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.776+0000 7fc728c63640 1 --2- 172.21.15.45:0/253250448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7241e3690 0x7fc7241e3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.776+0000 7fc728c63640 1 --2- 172.21.15.45:0/253250448 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc724146200 0x7fc724146630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.776+0000 7fc728c63640 1 --2- 172.21.15.45:0/253250448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc70c003980 0x7fc7240bd580 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:31.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.776+0000 7fc728c63640 1 -- 172.21.15.45:0/253250448 >> 172.21.15.45:0/253250448 conn(0x7fc7240bcf50 msgr2=0x7fc724071b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:31.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.776+0000 7fc728c63640 1 -- 172.21.15.45:0/253250448 shutdown_connections 2023-10-03T19:13:31.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:31.776+0000 7fc728c63640 1 -- 172.21.15.45:0/253250448 wait complete. 2023-10-03T19:13:31.797 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-03T19:13:31.798 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-03T19:13:31.798 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-10-03T19:13:31.798 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-03T19:13:31.798 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-03T19:13:31.798 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-03T19:13:31.798 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-03T19:13:31.798 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-03T19:13:31.798 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-03T19:13:31.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:13:31.799 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-10-03T19:13:31.805 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-03T19:13:31.805 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-03T19:13:31.805 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-10-03T19:13:31.805 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:13:31.806 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-10-03T19:13:31.806 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:13:31.806 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:13:31.806 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-10-03T19:13:31.806 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-10-03T19:13:31.806 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:13:31.806 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-10-03T19:13:31.806 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-10-03T19:13:31.806 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:13:31.806 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-10-03T19:13:31.806 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-03T19:13:31.807 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-10-03T19:13:31.807 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-03T19:13:31.807 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42371sec preferred_lft 42371sec 2023-10-03T19:13:31.807 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2023-10-03T19:13:31.807 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:13:31.807 INFO:teuthology.orchestra.run.smithi146.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-03T19:13:31.807 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 02:42:a6:2d:ab:3b brd ff:ff:ff:ff:ff:ff 2023-10-03T19:13:31.807 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-03T19:13:31.807 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:13:31.807 INFO:teuthology.orchestra.run.smithi146.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-03T19:13:31.807 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-03T19:13:31.808 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-03T19:13:31.808 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:13:31.808 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::5c3e:4eff:fee6:56da/64 scope link 2023-10-03T19:13:31.808 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:13:31.808 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-03T19:13:31.808 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T19:13:31.808 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-03T19:13:31.808 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:13:31.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:13:31.809 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-03T19:13:31.861 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T19:13:31.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:13:31.862 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-10-03T19:13:31.913 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-10-03T19:13:31.913 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-03T19:13:31.914 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-03T19:13:31.914 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-03T19:13:31.914 INFO:teuthology.orchestra.run.smithi146.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-03T19:13:31.914 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-03T19:13:31.914 INFO:teuthology.orchestra.run.smithi146.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:13:31.914 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:13:31.914 INFO:teuthology.orchestra.run.smithi146.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:13:31.914 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-03T19:13:31.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:13:31.915 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-03T19:13:31.915 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-03T19:13:31.915 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-03T19:13:31.915 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-03T19:13:31.915 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-03T19:13:31.915 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-03T19:13:31.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:13:31.990 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-10-03T19:13:32.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-03T19:13:32.039 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-03T19:13:32.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:13:32.039 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-10-03T19:13:32.094 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-03T19:13:32.094 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T19:13:32.094 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-03T19:13:32.142 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-03T19:13:32.143 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T19:13:32.143 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-03T19:13:32.189 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-03T19:13:32.245 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:13:32.245 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:13:32.300 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:13:32.301 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:13:32.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:13:32.302 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-03T19:13:32.350 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-03T19:13:32.350 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-03T19:13:32.395 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-03T19:13:32.411 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:13:32.411 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:13:32.464 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:13:32.465 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:13:32.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:13:32.466 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-03T19:13:32.471 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:2023-10-03T19:13:32.466+0000 7fe440ae4580 -1 init, newargv = 0x5616e56eb690 newargc=15 2023-10-03T19:13:32.471 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[33217]: starting ceph client 2023-10-03T19:13:32.481 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[33217]: starting fuse 2023-10-03T19:13:33.575 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-03T19:13:33.591 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:13:33.592 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:13:33.645 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:13:33.646 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:13:33.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:13:33.647 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-03T19:13:33.694 INFO:teuthology.orchestra.run.smithi146.stdout:45 2023-10-03T19:13:33.694 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-03T19:13:33.694 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-03T19:13:33.695 DEBUG:teuthology.orchestra.run.smithi146:> import glob 2023-10-03T19:13:33.695 DEBUG:teuthology.orchestra.run.smithi146:> import re 2023-10-03T19:13:33.695 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-03T19:13:33.695 DEBUG:teuthology.orchestra.run.smithi146:> import subprocess 2023-10-03T19:13:33.695 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:13:33.695 DEBUG:teuthology.orchestra.run.smithi146:> def _find_admin_socket(client_name): 2023-10-03T19:13:33.695 DEBUG:teuthology.orchestra.run.smithi146:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-03T19:13:33.695 DEBUG:teuthology.orchestra.run.smithi146:> files = glob.glob(asok_path) 2023-10-03T19:13:33.695 DEBUG:teuthology.orchestra.run.smithi146:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-03T19:13:33.695 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:13:33.695 DEBUG:teuthology.orchestra.run.smithi146:> # Given a non-glob path, it better be there 2023-10-03T19:13:33.695 DEBUG:teuthology.orchestra.run.smithi146:> if "*" not in asok_path: 2023-10-03T19:13:33.696 DEBUG:teuthology.orchestra.run.smithi146:> assert(len(files) == 1) 2023-10-03T19:13:33.696 DEBUG:teuthology.orchestra.run.smithi146:> return files[0] 2023-10-03T19:13:33.696 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:13:33.696 DEBUG:teuthology.orchestra.run.smithi146:> for f in files: 2023-10-03T19:13:33.696 DEBUG:teuthology.orchestra.run.smithi146:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-03T19:13:33.696 DEBUG:teuthology.orchestra.run.smithi146:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-03T19:13:33.696 DEBUG:teuthology.orchestra.run.smithi146:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-03T19:13:33.696 DEBUG:teuthology.orchestra.run.smithi146:> contents = proc_f.read() 2023-10-03T19:13:33.696 DEBUG:teuthology.orchestra.run.smithi146:> if mountpoint in contents: 2023-10-03T19:13:33.697 DEBUG:teuthology.orchestra.run.smithi146:> return f 2023-10-03T19:13:33.697 DEBUG:teuthology.orchestra.run.smithi146:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-03T19:13:33.697 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:13:33.697 DEBUG:teuthology.orchestra.run.smithi146:> print(_find_admin_socket("client.0")) 2023-10-03T19:13:33.697 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-03T19:13:33.812 INFO:teuthology.orchestra.run.smithi146.stdout:/var/run/ceph/ceph-client.0.33217.asok 2023-10-03T19:13:33.994 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.33217.asok 2023-10-03T19:13:33.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:13:33.994 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.33217.asok status 2023-10-03T19:13:34.153 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-03T19:13:34.153 INFO:teuthology.orchestra.run.smithi146.stdout: "metadata": { 2023-10-03T19:13:34.153 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_sha1": "05a43c8fb3988914c879a50970f9054a098e0612", 2023-10-03T19:13:34.153 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 18.0.0-3908-g05a43c8f (05a43c8fb3988914c879a50970f9054a098e0612) reef (dev)", 2023-10-03T19:13:34.153 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "0", 2023-10-03T19:13:34.154 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2023-10-03T19:13:34.154 INFO:teuthology.orchestra.run.smithi146.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-03T19:13:34.154 INFO:teuthology.orchestra.run.smithi146.stdout: "pid": "33217", 2023-10-03T19:13:34.154 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2023-10-03T19:13:34.154 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:13:34.154 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_count": 0, 2023-10-03T19:13:34.155 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_pinned_count": 0, 2023-10-03T19:13:34.155 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 5304, 2023-10-03T19:13:34.155 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": { 2023-10-03T19:13:34.155 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2023-10-03T19:13:34.155 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2023-10-03T19:13:34.155 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 5304 2023-10-03T19:13:34.155 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:13:34.156 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-03T19:13:34.156 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T19:13:34.156 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:0", 2023-10-03T19:13:34.156 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 2715925302 2023-10-03T19:13:34.156 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T19:13:34.156 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:13:34.156 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-03T19:13:34.156 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T19:13:34.156 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:0", 2023-10-03T19:13:34.156 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 2715925302 2023-10-03T19:13:34.157 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:13:34.157 INFO:teuthology.orchestra.run.smithi146.stdout: "inst_str": "client.5304 172.21.15.146:0/2715925302", 2023-10-03T19:13:34.157 INFO:teuthology.orchestra.run.smithi146.stdout: "addr_str": "172.21.15.146:0/2715925302", 2023-10-03T19:13:34.157 INFO:teuthology.orchestra.run.smithi146.stdout: "inode_count": 1, 2023-10-03T19:13:34.157 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_epoch": 15, 2023-10-03T19:13:34.157 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch": 35, 2023-10-03T19:13:34.157 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch_barrier": 0, 2023-10-03T19:13:34.158 INFO:teuthology.orchestra.run.smithi146.stdout: "blocklisted": false, 2023-10-03T19:13:34.158 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs" 2023-10-03T19:13:34.158 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-03T19:13:34.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:13:34.167 DEBUG:teuthology.orchestra.run.smithi146:> stat --file-system '--printf=%T 2023-10-03T19:13:34.167 DEBUG:teuthology.orchestra.run.smithi146:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-03T19:13:34.173 INFO:teuthology.orchestra.run.smithi146.stdout:fuseblk 2023-10-03T19:13:34.174 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-03T19:13:34.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:13:34.174 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-03T19:13:34.231 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_min_caps_per_client 2023-10-03T19:13:34.370 INFO:teuthology.orchestra.run.smithi045.stdout:{"mds_min_caps_per_client":"100"} 2023-10-03T19:13:34.370 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_min_caps_per_client": "100" } 2023-10-03T19:13:34.371 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:13:34.371 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:13:34.377 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-03T19:13:34.377 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-03T19:13:34.377 DEBUG:teuthology.orchestra.run.smithi146:> import uuid 2023-10-03T19:13:34.377 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:13:34.377 DEBUG:teuthology.orchestra.run.smithi146:> n = 1000 2023-10-03T19:13:34.377 DEBUG:teuthology.orchestra.run.smithi146:> create_hard_links = False 2023-10-03T19:13:34.378 DEBUG:teuthology.orchestra.run.smithi146:> if 0 > 0: 2023-10-03T19:13:34.378 DEBUG:teuthology.orchestra.run.smithi146:> create_hard_links = True 2023-10-03T19:13:34.378 DEBUG:teuthology.orchestra.run.smithi146:> path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2023-10-03T19:13:34.378 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:13:34.378 DEBUG:teuthology.orchestra.run.smithi146:> dpath = os.path.dirname(path) 2023-10-03T19:13:34.378 DEBUG:teuthology.orchestra.run.smithi146:> fnameprefix = os.path.basename(path) 2023-10-03T19:13:34.378 DEBUG:teuthology.orchestra.run.smithi146:> os.makedirs(dpath, exist_ok=True) 2023-10-03T19:13:34.378 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:13:34.378 DEBUG:teuthology.orchestra.run.smithi146:> try: 2023-10-03T19:13:34.378 DEBUG:teuthology.orchestra.run.smithi146:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-10-03T19:13:34.378 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:13:34.378 DEBUG:teuthology.orchestra.run.smithi146:> for i in range(n): 2023-10-03T19:13:34.379 DEBUG:teuthology.orchestra.run.smithi146:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-10-03T19:13:34.379 DEBUG:teuthology.orchestra.run.smithi146:> with open(fpath, '"'"'w'"'"') as f: 2023-10-03T19:13:34.379 DEBUG:teuthology.orchestra.run.smithi146:> f.write(f"{i}") 2023-10-03T19:13:34.379 DEBUG:teuthology.orchestra.run.smithi146:> if True: 2023-10-03T19:13:34.379 DEBUG:teuthology.orchestra.run.smithi146:> f.flush() 2023-10-03T19:13:34.379 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(f.fileno()) 2023-10-03T19:13:34.379 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2023-10-03T19:13:34.379 DEBUG:teuthology.orchestra.run.smithi146:> os.unlink(fpath) 2023-10-03T19:13:34.379 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2023-10-03T19:13:34.379 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(dirfd) 2023-10-03T19:13:34.379 DEBUG:teuthology.orchestra.run.smithi146:> if create_hard_links: 2023-10-03T19:13:34.379 DEBUG:teuthology.orchestra.run.smithi146:> for j in range(0): 2023-10-03T19:13:34.380 DEBUG:teuthology.orchestra.run.smithi146:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-10-03T19:13:34.380 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2023-10-03T19:13:34.380 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(dirfd) 2023-10-03T19:13:34.380 DEBUG:teuthology.orchestra.run.smithi146:> finally: 2023-10-03T19:13:34.380 DEBUG:teuthology.orchestra.run.smithi146:> os.close(dirfd) 2023-10-03T19:13:34.380 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-03T19:13:47.092 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:13:47.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.220+0000 7f91a2a87640 1 Processor -- start 2023-10-03T19:13:47.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.220+0000 7f91a2a87640 1 -- start start 2023-10-03T19:13:47.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f91a2a87640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f919c06d5b0 0x7f919c069bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:47.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f91a2a87640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f919c06e100 0x7f919c06a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:47.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f91a2a87640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f919c06b290 con 0x7f919c14c000 2023-10-03T19:13:47.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f91a2a87640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f919c06a870 con 0x7f919c06d5b0 2023-10-03T19:13:47.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f91a2a87640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f919c0a3f60 con 0x7f919c06e100 2023-10-03T19:13:47.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f91a1024640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f919c14c000 0x7f919c1488f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55210/0 (socket says 172.21.15.45:55210) 2023-10-03T19:13:47.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f91a1024640 1 -- 172.21.15.45:0/3433190707 learned_addr learned my addr 172.21.15.45:0/3433190707 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:47.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f91a0823640 1 --2- 172.21.15.45:0/3433190707 >> v2:172.21.15.79:3300/0 conn(0x7f919c06d5b0 0x7f919c069bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:47.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f919bfff640 1 --2- 172.21.15.45:0/3433190707 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f919c06e100 0x7f919c06a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:47.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f919b7fe640 1 -- 172.21.15.45:0/3433190707 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 186410085 0 0) 0x7f919c06b290 con 0x7f919c14c000 2023-10-03T19:13:47.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f919b7fe640 1 -- 172.21.15.45:0/3433190707 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9184003530 con 0x7f919c14c000 2023-10-03T19:13:47.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f919b7fe640 1 -- 172.21.15.45:0/3433190707 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 15159608 0 0) 0x7f9184003530 con 0x7f919c14c000 2023-10-03T19:13:47.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f919b7fe640 1 -- 172.21.15.45:0/3433190707 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f919c06e100 msgr2=0x7f919c06a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:47.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f919b7fe640 1 --2- 172.21.15.45:0/3433190707 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f919c06e100 0x7f919c06a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:47.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f919b7fe640 1 -- 172.21.15.45:0/3433190707 >> v2:172.21.15.79:3300/0 conn(0x7f919c06d5b0 msgr2=0x7f919c069bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:47.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f919b7fe640 1 --2- 172.21.15.45:0/3433190707 >> v2:172.21.15.79:3300/0 conn(0x7f919c06d5b0 0x7f919c069bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:47.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f919b7fe640 1 -- 172.21.15.45:0/3433190707 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f919c0bdc30 con 0x7f919c14c000 2023-10-03T19:13:47.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f919b7fe640 1 -- 172.21.15.45:0/3433190707 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f918c001680 con 0x7f919c14c000 2023-10-03T19:13:47.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f919b7fe640 1 -- 172.21.15.45:0/3433190707 >> v1:172.21.15.45:6789/0 conn(0x7f919c14c000 legacy=0x7f919c1488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:47.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f919b7fe640 1 --2- 172.21.15.45:0/3433190707 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f919c06e100 0x7f9184003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:47.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f919b7fe640 1 --2- 172.21.15.45:0/3433190707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9184003f50 0x7f91840047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:47.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f919b7fe640 1 --2- 172.21.15.45:0/3433190707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9184004d10 0x7f9184005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:47.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f919b7fe640 1 -- 172.21.15.45:0/3433190707 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c06a870 con 0x7f9184004d10 2023-10-03T19:13:47.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f919b7fe640 1 -- 172.21.15.45:0/3433190707 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c0a3f60 con 0x7f9184003f50 2023-10-03T19:13:47.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f919b7fe640 1 -- 172.21.15.45:0/3433190707 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f918400ba10 con 0x7f919c06e100 2023-10-03T19:13:47.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f91a1024640 1 --2- 172.21.15.45:0/3433190707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9184004d10 0x7f9184005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:47.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f919bfff640 1 --2- 172.21.15.45:0/3433190707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9184003f50 0x7f91840047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:47.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f91a0823640 1 --2- 172.21.15.45:0/3433190707 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f919c06e100 0x7f9184003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:47.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f91a1024640 1 -- 172.21.15.45:0/3433190707 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f919c06e100 msgr2=0x7f9184003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:47.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f91a1024640 1 --2- 172.21.15.45:0/3433190707 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f919c06e100 0x7f9184003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:47.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f91a1024640 1 -- 172.21.15.45:0/3433190707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9184003f50 msgr2=0x7f91840047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:47.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f91a1024640 1 --2- 172.21.15.45:0/3433190707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9184003f50 0x7f91840047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:47.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.224+0000 7f91a1024640 1 -- 172.21.15.45:0/3433190707 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9184003530 con 0x7f9184004d10 2023-10-03T19:13:47.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.228+0000 7f91a1024640 1 --2- 172.21.15.45:0/3433190707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9184004d10 0x7f9184005180 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f918c00c160 tx=0x7f918c01cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9265c9ef67c44f71 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:47.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.228+0000 7f919b7fe640 1 -- 172.21.15.45:0/3433190707 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c0058e0 con 0x7f9184004d10 2023-10-03T19:13:47.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.228+0000 7f919b7fe640 1 -- 172.21.15.45:0/3433190707 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f918c005a40 con 0x7f9184004d10 2023-10-03T19:13:47.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.228+0000 7f919b7fe640 1 -- 172.21.15.45:0/3433190707 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c005e30 con 0x7f9184004d10 2023-10-03T19:13:47.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.228+0000 7f91a2a87640 1 -- 172.21.15.45:0/3433190707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9184004d10 msgr2=0x7f9184005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:47.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.228+0000 7f91a2a87640 1 --2- 172.21.15.45:0/3433190707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9184004d10 0x7f9184005180 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f918c00c160 tx=0x7f918c01cb80 comp rx=0 tx=0).stop 2023-10-03T19:13:47.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.228+0000 7f91a1024640 1 -- 172.21.15.45:0/3433190707 reap_dead start 2023-10-03T19:13:47.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.228+0000 7f91a2a87640 1 -- 172.21.15.45:0/3433190707 shutdown_connections 2023-10-03T19:13:47.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.228+0000 7f91a2a87640 1 -- 172.21.15.45:0/3433190707 >> 172.21.15.45:0/3433190707 conn(0x7f919c0c1600 msgr2=0x7f919c0c1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:47.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.228+0000 7f91a2a87640 1 -- 172.21.15.45:0/3433190707 shutdown_connections 2023-10-03T19:13:47.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.228+0000 7f91a2a87640 1 -- 172.21.15.45:0/3433190707 wait complete. 2023-10-03T19:13:47.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.232+0000 7f91a2a87640 1 Processor -- start 2023-10-03T19:13:47.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.232+0000 7f91a2a87640 1 -- start start 2023-10-03T19:13:47.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.232+0000 7f91a2a87640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f919c0c07e0 0x7f919c13e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:47.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.232+0000 7f91a2a87640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f919c14ac70 0x7f919c13eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:47.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.232+0000 7f91a2a87640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f919c1e3410 0x7f919c1e3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:47.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.232+0000 7f91a2a87640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c14ce80 con 0x7f919c0c07e0 2023-10-03T19:13:47.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.232+0000 7f91a2a87640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c1e7570 con 0x7f919c1e3410 2023-10-03T19:13:47.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.232+0000 7f91a2a87640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f919c13f0d0 con 0x7f919c14ac70 2023-10-03T19:13:47.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.232+0000 7f91a0823640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f919c0c07e0 0x7f919c13e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:47.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.232+0000 7f91a0823640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f919c0c07e0 0x7f919c13e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42488/0 (socket says 172.21.15.45:42488) 2023-10-03T19:13:47.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.232+0000 7f91a0823640 1 -- 172.21.15.45:0/2164814656 learned_addr learned my addr 172.21.15.45:0/2164814656 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:47.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.232+0000 7f91a1024640 1 --2- 172.21.15.45:0/2164814656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f919c1e3410 0x7f919c1e3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:47.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.232+0000 7f91a0823640 1 -- 172.21.15.45:0/2164814656 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f919c14ac70 msgr2=0x7f919c13eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:47.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.232+0000 7f91a0823640 1 --2- 172.21.15.45:0/2164814656 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f919c14ac70 0x7f919c13eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:47.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.232+0000 7f91a0823640 1 -- 172.21.15.45:0/2164814656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f919c1e3410 msgr2=0x7f919c1e3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:47.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.232+0000 7f91a0823640 1 --2- 172.21.15.45:0/2164814656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f919c1e3410 0x7f919c1e3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:47.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.232+0000 7f91a0823640 1 -- 172.21.15.45:0/2164814656 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f919c14c480 con 0x7f919c0c07e0 2023-10-03T19:13:47.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.232+0000 7f91a1024640 1 --2- 172.21.15.45:0/2164814656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f919c1e3410 0x7f919c1e3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:47.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.232+0000 7f91a0823640 1 --2- 172.21.15.45:0/2164814656 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f919c0c07e0 0x7f919c13e650 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9194011e60 tx=0x7f919400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:47.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.232+0000 7f91997fa640 1 -- 172.21.15.45:0/2164814656 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919400e040 con 0x7f919c0c07e0 2023-10-03T19:13:47.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.232+0000 7f91997fa640 1 -- 172.21.15.45:0/2164814656 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919400f040 con 0x7f919c0c07e0 2023-10-03T19:13:47.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.232+0000 7f91a2a87640 1 -- 172.21.15.45:0/2164814656 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f919c06aa50 con 0x7f919c0c07e0 2023-10-03T19:13:47.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.232+0000 7f91997fa640 1 -- 172.21.15.45:0/2164814656 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9194015850 con 0x7f919c0c07e0 2023-10-03T19:13:47.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.232+0000 7f91a2a87640 1 -- 172.21.15.45:0/2164814656 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f919c06d980 con 0x7f919c0c07e0 2023-10-03T19:13:47.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.232+0000 7f91a2a87640 1 -- 172.21.15.45:0/2164814656 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f919c06b3e0 con 0x7f919c0c07e0 2023-10-03T19:13:47.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.232+0000 7f91997fa640 1 -- 172.21.15.45:0/2164814656 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f91940159b0 con 0x7f919c0c07e0 2023-10-03T19:13:47.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.236+0000 7f91997fa640 1 --2- 172.21.15.45:0/2164814656 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f91880662b0 0x7f9188068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:47.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.236+0000 7f91997fa640 1 -- 172.21.15.45:0/2164814656 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9194084b30 con 0x7f919c0c07e0 2023-10-03T19:13:47.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.236+0000 7f919bfff640 1 --2- 172.21.15.45:0/2164814656 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f91880662b0 0x7f9188068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:47.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.236+0000 7f919bfff640 1 --2- 172.21.15.45:0/2164814656 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f91880662b0 0x7f9188068760 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f919c0c1100 tx=0x7f91900095f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:47.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.240+0000 7f91997fa640 1 -- 172.21.15.45:0/2164814656 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9194051fb0 con 0x7f919c0c07e0 2023-10-03T19:13:47.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.428+0000 7f91a2a87640 1 -- 172.21.15.45:0/2164814656 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f919c04de80 con 0x7f919c0c07e0 2023-10-03T19:13:47.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.428+0000 7f91997fa640 1 -- 172.21.15.45:0/2164814656 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+3908 (secure 0 0 0) 0x7f91940555d0 con 0x7f919c0c07e0 2023-10-03T19:13:47.433 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:13:47.433 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4727,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/659816428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":659816428},{"type":"v1","addr":"172.21.15.79:6835","nonce":659816428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5073,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3273073650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3273073650},{"type":"v1","addr":"172.21.15.45:6834","nonce":3273073650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:13:21.307600+0000","modified":"2023-10-03T19:13:24.332226+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5076},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5076":{"gid":5076,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/252012936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":252012936},{"type":"v1","addr":"172.21.15.45:6835","nonce":252012936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-03T19:13:47.433 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 15 2023-10-03T19:13:47.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.428+0000 7f91a2a87640 1 -- 172.21.15.45:0/2164814656 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f91880662b0 msgr2=0x7f9188068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:47.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.428+0000 7f91a2a87640 1 --2- 172.21.15.45:0/2164814656 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f91880662b0 0x7f9188068760 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f919c0c1100 tx=0x7f91900095f0 comp rx=0 tx=0).stop 2023-10-03T19:13:47.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.428+0000 7f91a2a87640 1 -- 172.21.15.45:0/2164814656 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f919c0c07e0 msgr2=0x7f919c13e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:47.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.428+0000 7f91a2a87640 1 --2- 172.21.15.45:0/2164814656 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f919c0c07e0 0x7f919c13e650 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9194011e60 tx=0x7f919400f580 comp rx=0 tx=0).stop 2023-10-03T19:13:47.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.428+0000 7f91a2a87640 1 -- 172.21.15.45:0/2164814656 shutdown_connections 2023-10-03T19:13:47.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.428+0000 7f91a2a87640 1 --2- 172.21.15.45:0/2164814656 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f91880662b0 0x7f9188068760 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:47.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.428+0000 7f91a2a87640 1 --2- 172.21.15.45:0/2164814656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f919c1e3410 0x7f919c1e3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:47.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.428+0000 7f91a2a87640 1 --2- 172.21.15.45:0/2164814656 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f919c14ac70 0x7f919c13eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:47.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.428+0000 7f91a2a87640 1 --2- 172.21.15.45:0/2164814656 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f919c0c07e0 0x7f919c13e650 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:47.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.428+0000 7f91a2a87640 1 -- 172.21.15.45:0/2164814656 >> 172.21.15.45:0/2164814656 conn(0x7f919c0c1600 msgr2=0x7f919c1479f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:47.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.428+0000 7f91a2a87640 1 -- 172.21.15.45:0/2164814656 shutdown_connections 2023-10-03T19:13:47.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.428+0000 7f91a2a87640 1 -- 172.21.15.45:0/2164814656 wait complete. 2023-10-03T19:13:47.451 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2023-10-03T19:13:47.612 INFO:teuthology.orchestra.run.smithi045.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2023-10-03T19:13:47.612 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2023-10-03T19:13:47.613 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:13:47.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.732+0000 7f1a1ced4640 1 Processor -- start 2023-10-03T19:13:47.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.732+0000 7f1a1ced4640 1 -- start start 2023-10-03T19:13:47.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.732+0000 7f1a1ced4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a1806a440 0x7f1a1814f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:47.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.732+0000 7f1a1ced4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1a181524c0 0x7f1a18144b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:47.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.732+0000 7f1a1ced4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a1814f5c0 con 0x7f1a180ba340 2023-10-03T19:13:47.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.732+0000 7f1a1ced4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a1814e630 con 0x7f1a181524c0 2023-10-03T19:13:47.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.732+0000 7f1a1ced4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1814ebf0 con 0x7f1a1806a440 2023-10-03T19:13:47.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.732+0000 7f1a1659c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a1806a440 0x7f1a1814f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:47.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.732+0000 7f1a16d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1a181524c0 0x7f1a18144b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:47.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.732+0000 7f1a1659c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a1806a440 0x7f1a1814f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:56690/0 (socket says 172.21.15.45:56690) 2023-10-03T19:13:47.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.732+0000 7f1a1659c640 1 -- 172.21.15.45:0/3266279907 learned_addr learned my addr 172.21.15.45:0/3266279907 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:47.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.732+0000 7f1a1659c640 1 -- 172.21.15.45:0/3266279907 >> v2:172.21.15.79:3300/0 conn(0x7f1a181524c0 msgr2=0x7f1a18144b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:47.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.732+0000 7f1a1659c640 1 --2- 172.21.15.45:0/3266279907 >> v2:172.21.15.79:3300/0 conn(0x7f1a181524c0 0x7f1a18144b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:47.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.732+0000 7f1a1659c640 1 -- 172.21.15.45:0/3266279907 >> v1:172.21.15.79:6789/0 conn(0x7f1a180ba340 legacy=0x7f1a1806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:47.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.732+0000 7f1a1659c640 1 -- 172.21.15.45:0/3266279907 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a180ba8b0 con 0x7f1a1806a440 2023-10-03T19:13:47.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.736+0000 7f1a1659c640 1 --2- 172.21.15.45:0/3266279907 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a1806a440 0x7f1a1814f080 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1a08009870 tx=0x7f1a0801ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cb6806ed07ba4d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:47.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.736+0000 7f1a1559a640 1 -- 172.21.15.45:0/3266279907 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a080a8a30 con 0x7f1a1806a440 2023-10-03T19:13:47.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.736+0000 7f1a1559a640 1 -- 172.21.15.45:0/3266279907 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a080a8b90 con 0x7f1a1806a440 2023-10-03T19:13:47.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.736+0000 7f1a1559a640 1 -- 172.21.15.45:0/3266279907 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a080b0440 con 0x7f1a1806a440 2023-10-03T19:13:47.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.736+0000 7f1a1ced4640 1 -- 172.21.15.45:0/3266279907 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a1806a440 msgr2=0x7f1a1814f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:47.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.736+0000 7f1a1ced4640 1 --2- 172.21.15.45:0/3266279907 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a1806a440 0x7f1a1814f080 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1a08009870 tx=0x7f1a0801ed30 comp rx=0 tx=0).stop 2023-10-03T19:13:47.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.736+0000 7f1a1ced4640 1 -- 172.21.15.45:0/3266279907 shutdown_connections 2023-10-03T19:13:47.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.736+0000 7f1a1ced4640 1 --2- 172.21.15.45:0/3266279907 >> v2:172.21.15.79:3300/0 conn(0x7f1a181524c0 0x7f1a18144b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:47.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.736+0000 7f1a1ced4640 1 --2- 172.21.15.45:0/3266279907 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a1806a440 0x7f1a1814f080 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:47.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.736+0000 7f1a1ced4640 1 -- 172.21.15.45:0/3266279907 >> 172.21.15.45:0/3266279907 conn(0x7f1a180be510 msgr2=0x7f1a18069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:47.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.736+0000 7f1a1ced4640 1 -- 172.21.15.45:0/3266279907 shutdown_connections 2023-10-03T19:13:47.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.736+0000 7f1a1ced4640 1 -- 172.21.15.45:0/3266279907 wait complete. 2023-10-03T19:13:47.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.736+0000 7f1a1ced4640 1 Processor -- start 2023-10-03T19:13:47.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.736+0000 7f1a1ced4640 1 -- start start 2023-10-03T19:13:47.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.736+0000 7f1a1ced4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a1806a440 0x7f1a18150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:47.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.736+0000 7f1a1ced4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a180ba340 0x7f1a180bfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:47.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.736+0000 7f1a1ced4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a181524c0 0x7f1a18142d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:47.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.736+0000 7f1a1ced4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a181e7170 con 0x7f1a181524c0 2023-10-03T19:13:47.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.736+0000 7f1a1ced4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1814ac00 con 0x7f1a1806a440 2023-10-03T19:13:47.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.736+0000 7f1a1ced4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a181e3340 con 0x7f1a180ba340 2023-10-03T19:13:47.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.736+0000 7f1a16d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a181524c0 0x7f1a18142d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:47.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.736+0000 7f1a16d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a181524c0 0x7f1a18142d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42492/0 (socket says 172.21.15.45:42492) 2023-10-03T19:13:47.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.736+0000 7f1a16d9d640 1 -- 172.21.15.45:0/1995922102 learned_addr learned my addr 172.21.15.45:0/1995922102 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:47.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.736+0000 7f1a1659c640 1 --2- 172.21.15.45:0/1995922102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a1806a440 0x7f1a18150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:47.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.736+0000 7f1a15d9b640 1 --2- 172.21.15.45:0/1995922102 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a180ba340 0x7f1a180bfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:47.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.736+0000 7f1a16d9d640 1 -- 172.21.15.45:0/1995922102 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a180ba340 msgr2=0x7f1a180bfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:47.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.736+0000 7f1a16d9d640 1 --2- 172.21.15.45:0/1995922102 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a180ba340 0x7f1a180bfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:47.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.736+0000 7f1a16d9d640 1 -- 172.21.15.45:0/1995922102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a1806a440 msgr2=0x7f1a18150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:47.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.736+0000 7f1a16d9d640 1 --2- 172.21.15.45:0/1995922102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a1806a440 0x7f1a18150c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:47.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.736+0000 7f1a16d9d640 1 -- 172.21.15.45:0/1995922102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a080094d0 con 0x7f1a181524c0 2023-10-03T19:13:47.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.740+0000 7f1a16d9d640 1 --2- 172.21.15.45:0/1995922102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a181524c0 0x7f1a18142d50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1a10009d30 tx=0x7f1a1000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:47.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.740+0000 7f1a06ffd640 1 -- 172.21.15.45:0/1995922102 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10009ba0 con 0x7f1a181524c0 2023-10-03T19:13:47.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.740+0000 7f1a06ffd640 1 -- 172.21.15.45:0/1995922102 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1000f040 con 0x7f1a181524c0 2023-10-03T19:13:47.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.740+0000 7f1a1ced4640 1 -- 172.21.15.45:0/1995922102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a1806a810 con 0x7f1a181524c0 2023-10-03T19:13:47.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.740+0000 7f1a06ffd640 1 -- 172.21.15.45:0/1995922102 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a100146c0 con 0x7f1a181524c0 2023-10-03T19:13:47.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.740+0000 7f1a1ced4640 1 -- 172.21.15.45:0/1995922102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a1814e880 con 0x7f1a181524c0 2023-10-03T19:13:47.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.740+0000 7f1a1ced4640 1 -- 172.21.15.45:0/1995922102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a1806a9a0 con 0x7f1a181524c0 2023-10-03T19:13:47.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.740+0000 7f1a06ffd640 1 -- 172.21.15.45:0/1995922102 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1a10014820 con 0x7f1a181524c0 2023-10-03T19:13:47.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.740+0000 7f1a06ffd640 1 --2- 172.21.15.45:0/1995922102 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f19f80662b0 0x7f19f8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:47.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.740+0000 7f1a06ffd640 1 -- 172.21.15.45:0/1995922102 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1a100846c0 con 0x7f1a181524c0 2023-10-03T19:13:47.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.740+0000 7f1a1659c640 1 --2- 172.21.15.45:0/1995922102 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f19f80662b0 0x7f19f8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:47.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.740+0000 7f1a1659c640 1 --2- 172.21.15.45:0/1995922102 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f19f80662b0 0x7f19f8068760 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1a080b2000 tx=0x7f1a080aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:47.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.744+0000 7f1a06ffd640 1 -- 172.21.15.45:0/1995922102 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1a10051b40 con 0x7f1a181524c0 2023-10-03T19:13:47.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.936+0000 7f1a1ced4640 1 -- 172.21.15.45:0/1995922102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a18151140 con 0x7f1a181524c0 2023-10-03T19:13:47.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.936+0000 7f1a06ffd640 1 -- 172.21.15.45:0/1995922102 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+3908 (secure 0 0 0) 0x7f1a10055160 con 0x7f1a181524c0 2023-10-03T19:13:47.941 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:13:47.941 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4727,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/659816428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":659816428},{"type":"v1","addr":"172.21.15.79:6835","nonce":659816428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5073,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3273073650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3273073650},{"type":"v1","addr":"172.21.15.45:6834","nonce":3273073650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:13:21.307600+0000","modified":"2023-10-03T19:13:24.332226+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5076},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5076":{"gid":5076,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/252012936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":252012936},{"type":"v1","addr":"172.21.15.45:6835","nonce":252012936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-03T19:13:47.942 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 15 2023-10-03T19:13:47.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.936+0000 7f1a1ced4640 1 -- 172.21.15.45:0/1995922102 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f19f80662b0 msgr2=0x7f19f8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:47.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.936+0000 7f1a1ced4640 1 --2- 172.21.15.45:0/1995922102 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f19f80662b0 0x7f19f8068760 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1a080b2000 tx=0x7f1a080aa070 comp rx=0 tx=0).stop 2023-10-03T19:13:47.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.936+0000 7f1a1ced4640 1 -- 172.21.15.45:0/1995922102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a181524c0 msgr2=0x7f1a18142d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:47.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.936+0000 7f1a1ced4640 1 --2- 172.21.15.45:0/1995922102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a181524c0 0x7f1a18142d50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1a10009d30 tx=0x7f1a1000c490 comp rx=0 tx=0).stop 2023-10-03T19:13:47.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.936+0000 7f1a1ced4640 1 -- 172.21.15.45:0/1995922102 shutdown_connections 2023-10-03T19:13:47.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.936+0000 7f1a1ced4640 1 --2- 172.21.15.45:0/1995922102 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f19f80662b0 0x7f19f8068760 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:47.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.936+0000 7f1a1ced4640 1 --2- 172.21.15.45:0/1995922102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a181524c0 0x7f1a18142d50 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:47.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.936+0000 7f1a1ced4640 1 --2- 172.21.15.45:0/1995922102 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a180ba340 0x7f1a180bfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:47.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.936+0000 7f1a1ced4640 1 --2- 172.21.15.45:0/1995922102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a1806a440 0x7f1a18150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:47.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.936+0000 7f1a1ced4640 1 -- 172.21.15.45:0/1995922102 >> 172.21.15.45:0/1995922102 conn(0x7f1a180be510 msgr2=0x7f1a18069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:47.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.936+0000 7f1a1ced4640 1 -- 172.21.15.45:0/1995922102 shutdown_connections 2023-10-03T19:13:47.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:47.940+0000 7f1a1ced4640 1 -- 172.21.15.45:0/1995922102 wait complete. 2023-10-03T19:13:47.960 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2023-10-03T19:13:48.097 INFO:teuthology.orchestra.run.smithi045.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2023-10-03T19:13:48.097 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2023-10-03T19:13:48.097 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 cache drop 2023-10-03T19:13:48.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.216+0000 7f2384723640 1 Processor -- start 2023-10-03T19:13:48.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.216+0000 7f2384723640 1 -- start start 2023-10-03T19:13:48.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.216+0000 7f2384723640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f237c0712c0 0x7f237c0bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:48.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.216+0000 7f2384723640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f237c06d560 0x7f237c0bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:48.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.220+0000 7f2384723640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f237c06c2d0 con 0x7f237c06c760 2023-10-03T19:13:48.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.220+0000 7f2384723640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f237c150610 con 0x7f237c06d560 2023-10-03T19:13:48.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.220+0000 7f2384723640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f237c1508b0 con 0x7f237c0712c0 2023-10-03T19:13:48.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.220+0000 7f2381cbe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f237c06d560 0x7f237c0bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:48.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.220+0000 7f2382cc0640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f237c06c760 0x7f237c0a53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55220/0 (socket says 172.21.15.45:55220) 2023-10-03T19:13:48.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.220+0000 7f2382cc0640 1 -- 172.21.15.45:0/1030018363 learned_addr learned my addr 172.21.15.45:0/1030018363 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:13:48.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.220+0000 7f23824bf640 1 --2- 172.21.15.45:0/1030018363 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f237c0712c0 0x7f237c0bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:48.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.220+0000 7f2381cbe640 1 -- 172.21.15.45:0/1030018363 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f237c0712c0 msgr2=0x7f237c0bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:48.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.220+0000 7f2381cbe640 1 --2- 172.21.15.45:0/1030018363 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f237c0712c0 0x7f237c0bcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:48.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.220+0000 7f2381cbe640 1 -- 172.21.15.45:0/1030018363 >> v1:172.21.15.45:6789/0 conn(0x7f237c06c760 legacy=0x7f237c0a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:48.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.220+0000 7f23814bd640 1 -- 172.21.15.45:0/1030018363 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 412431812 0 0) 0x7f237c06c2d0 con 0x7f237c06c760 2023-10-03T19:13:48.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.220+0000 7f2381cbe640 1 -- 172.21.15.45:0/1030018363 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237c06d2e0 con 0x7f237c06d560 2023-10-03T19:13:48.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.220+0000 7f2381cbe640 1 --2- 172.21.15.45:0/1030018363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f237c06d560 0x7f237c0bd100 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f236c0097c0 tx=0x7f236c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c66ac2fffe645e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:48.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.220+0000 7f23814bd640 1 -- 172.21.15.45:0/1030018363 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c0ac620 con 0x7f237c06d560 2023-10-03T19:13:48.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.220+0000 7f23814bd640 1 -- 172.21.15.45:0/1030018363 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236c0ac780 con 0x7f237c06d560 2023-10-03T19:13:48.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.220+0000 7f23814bd640 1 -- 172.21.15.45:0/1030018363 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c0acb10 con 0x7f237c06d560 2023-10-03T19:13:48.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.220+0000 7f2384723640 1 -- 172.21.15.45:0/1030018363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f237c06d560 msgr2=0x7f237c0bd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:48.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.220+0000 7f2384723640 1 --2- 172.21.15.45:0/1030018363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f237c06d560 0x7f237c0bd100 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f236c0097c0 tx=0x7f236c01c480 comp rx=0 tx=0).stop 2023-10-03T19:13:48.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.220+0000 7f2384723640 1 -- 172.21.15.45:0/1030018363 shutdown_connections 2023-10-03T19:13:48.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.220+0000 7f2384723640 1 --2- 172.21.15.45:0/1030018363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f237c06d560 0x7f237c0bd100 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:48.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.220+0000 7f2384723640 1 --2- 172.21.15.45:0/1030018363 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f237c0712c0 0x7f237c0bcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:48.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.220+0000 7f2384723640 1 -- 172.21.15.45:0/1030018363 >> 172.21.15.45:0/1030018363 conn(0x7f237c0a20d0 msgr2=0x7f237c0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:48.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.220+0000 7f2384723640 1 -- 172.21.15.45:0/1030018363 shutdown_connections 2023-10-03T19:13:48.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.220+0000 7f2384723640 1 -- 172.21.15.45:0/1030018363 wait complete. 2023-10-03T19:13:48.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.224+0000 7f2384723640 1 Processor -- start 2023-10-03T19:13:48.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.224+0000 7f2384723640 1 -- start start 2023-10-03T19:13:48.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.224+0000 7f2384723640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f237c06c760 0x7f237c06f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:48.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.224+0000 7f2384723640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f237c06d560 0x7f237c1479d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:48.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.224+0000 7f2384723640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f237c0712c0 0x7f237c1e6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:48.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.224+0000 7f2384723640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237c06fb00 con 0x7f237c0712c0 2023-10-03T19:13:48.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.224+0000 7f2384723640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237c06ee50 con 0x7f237c06d560 2023-10-03T19:13:48.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.224+0000 7f2384723640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f237c148d80 con 0x7f237c06c760 2023-10-03T19:13:48.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.224+0000 7f2382cc0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f237c0712c0 0x7f237c1e6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:48.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.224+0000 7f2382cc0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f237c0712c0 0x7f237c1e6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42506/0 (socket says 172.21.15.45:42506) 2023-10-03T19:13:48.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.224+0000 7f2382cc0640 1 -- 172.21.15.45:0/1165464026 learned_addr learned my addr 172.21.15.45:0/1165464026 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:48.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.224+0000 7f2381cbe640 1 --2- 172.21.15.45:0/1165464026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f237c06d560 0x7f237c1479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:48.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.224+0000 7f23824bf640 1 --2- 172.21.15.45:0/1165464026 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f237c06c760 0x7f237c06f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:48.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.224+0000 7f2382cc0640 1 -- 172.21.15.45:0/1165464026 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f237c06c760 msgr2=0x7f237c06f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:48.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.224+0000 7f2382cc0640 1 --2- 172.21.15.45:0/1165464026 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f237c06c760 0x7f237c06f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:48.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.224+0000 7f2382cc0640 1 -- 172.21.15.45:0/1165464026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f237c06d560 msgr2=0x7f237c1479d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:48.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.224+0000 7f2382cc0640 1 --2- 172.21.15.45:0/1165464026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f237c06d560 0x7f237c1479d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:48.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.224+0000 7f2382cc0640 1 -- 172.21.15.45:0/1165464026 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236c009420 con 0x7f237c0712c0 2023-10-03T19:13:48.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.224+0000 7f2381cbe640 1 --2- 172.21.15.45:0/1165464026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f237c06d560 0x7f237c1479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:13:48.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.224+0000 7f2382cc0640 1 --2- 172.21.15.45:0/1165464026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f237c0712c0 0x7f237c1e6ef0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2374001570 tx=0x7f237400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:48.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.224+0000 7f2372ffd640 1 -- 172.21.15.45:0/1165464026 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237400a640 con 0x7f237c0712c0 2023-10-03T19:13:48.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.224+0000 7f2372ffd640 1 -- 172.21.15.45:0/1165464026 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237400a7a0 con 0x7f237c0712c0 2023-10-03T19:13:48.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.224+0000 7f2384723640 1 -- 172.21.15.45:0/1165464026 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f237c0a6070 con 0x7f237c0712c0 2023-10-03T19:13:48.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.224+0000 7f2372ffd640 1 -- 172.21.15.45:0/1165464026 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237400ab50 con 0x7f237c0712c0 2023-10-03T19:13:48.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.224+0000 7f2384723640 1 -- 172.21.15.45:0/1165464026 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f237c0a5ee0 con 0x7f237c0712c0 2023-10-03T19:13:48.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f2372ffd640 1 -- 172.21.15.45:0/1165464026 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f237400acb0 con 0x7f237c0712c0 2023-10-03T19:13:48.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f2372ffd640 1 --2- 172.21.15.45:0/1165464026 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2360066280 0x7f2360068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:48.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f2372ffd640 1 -- 172.21.15.45:0/1165464026 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2374083680 con 0x7f237c0712c0 2023-10-03T19:13:48.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f23824bf640 1 --2- 172.21.15.45:0/1165464026 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2360066280 0x7f2360068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:48.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f2387847000 1 Processor -- start 2023-10-03T19:13:48.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f2387847000 1 -- start start 2023-10-03T19:13:48.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f23824bf640 1 --2- 172.21.15.45:0/1165464026 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2360066280 0x7f2360068730 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f237800b930 tx=0x7f2378008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:48.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f2387847000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f7dac82f0 0x563f7dabf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:48.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f2387847000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x563f7dabfa10 0x563f7dabfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:48.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f2387847000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f7dac0320 0x563f7dac06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:48.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f2387847000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f7d989ac0 con 0x563f7dac82f0 2023-10-03T19:13:48.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f2387847000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f7d8c3a70 con 0x563f7dac0320 2023-10-03T19:13:48.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f2387847000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f7d917130 con 0x563f7dabfa10 2023-10-03T19:13:48.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f23824bf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f7dac82f0 0x563f7dabf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:48.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f23824bf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f7dac82f0 0x563f7dabf4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42522/0 (socket says 172.21.15.45:42522) 2023-10-03T19:13:48.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f23824bf640 1 -- 172.21.15.45:0/1275306950 learned_addr learned my addr 172.21.15.45:0/1275306950 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:48.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f2382cc0640 1 --2- 172.21.15.45:0/1275306950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f7dac0320 0x563f7dac06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:48.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f2381cbe640 1 --2- 172.21.15.45:0/1275306950 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x563f7dabfa10 0x563f7dabfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:48.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f23824bf640 1 -- 172.21.15.45:0/1275306950 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x563f7dabfa10 msgr2=0x563f7dabfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:48.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f23824bf640 1 --2- 172.21.15.45:0/1275306950 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x563f7dabfa10 0x563f7dabfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:48.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f23824bf640 1 -- 172.21.15.45:0/1275306950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f7dac0320 msgr2=0x563f7dac06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:48.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f23824bf640 1 --2- 172.21.15.45:0/1275306950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f7dac0320 0x563f7dac06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:48.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f23824bf640 1 -- 172.21.15.45:0/1275306950 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f7d8d4fa0 con 0x563f7dac82f0 2023-10-03T19:13:48.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f2381cbe640 1 --2- 172.21.15.45:0/1275306950 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x563f7dabfa10 0x563f7dabfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:48.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f23824bf640 1 --2- 172.21.15.45:0/1275306950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f7dac82f0 0x563f7dabf4d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f237800b2d0 tx=0x7f2378012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de937add4e845153 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:48.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f235ffff640 1 -- 172.21.15.45:0/1275306950 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237800b170 con 0x563f7dac82f0 2023-10-03T19:13:48.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f235ffff640 1 -- 172.21.15.45:0/1275306950 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2378019070 con 0x563f7dac82f0 2023-10-03T19:13:48.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f235ffff640 1 -- 172.21.15.45:0/1275306950 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2378014de0 con 0x563f7dac82f0 2023-10-03T19:13:48.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f2387847000 1 -- 172.21.15.45:0/1275306950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f7dac82f0 msgr2=0x563f7dabf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:48.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f2387847000 1 --2- 172.21.15.45:0/1275306950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f7dac82f0 0x563f7dabf4d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f237800b2d0 tx=0x7f2378012000 comp rx=0 tx=0).stop 2023-10-03T19:13:48.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f2387847000 1 -- 172.21.15.45:0/1275306950 shutdown_connections 2023-10-03T19:13:48.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f2387847000 1 --2- 172.21.15.45:0/1275306950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f7dac0320 0x563f7dac06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:48.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f2387847000 1 --2- 172.21.15.45:0/1275306950 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x563f7dabfa10 0x563f7dabfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:48.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f2387847000 1 --2- 172.21.15.45:0/1275306950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f7dac82f0 0x563f7dabf4d0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:48.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f2387847000 1 -- 172.21.15.45:0/1275306950 >> 172.21.15.45:0/1275306950 conn(0x563f7daf97f0 msgr2=0x563f7dafbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:48.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f2387847000 1 -- 172.21.15.45:0/1275306950 shutdown_connections 2023-10-03T19:13:48.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.228+0000 7f2387847000 1 -- 172.21.15.45:0/1275306950 wait complete. 2023-10-03T19:13:48.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f2387847000 1 -- start start 2023-10-03T19:13:48.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f2387847000 1 Processor -- start 2023-10-03T19:13:48.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f2387847000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f7dabfa10 0x563f7dac4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:48.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f2387847000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f7dac0320 0x563f7dac5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:48.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f2387847000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x563f7dac82f0 0x563f7dac56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:48.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f2387847000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f7d9101d0 con 0x563f7dabfa10 2023-10-03T19:13:48.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f2387847000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f7d8ad920 con 0x563f7dac0320 2023-10-03T19:13:48.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f2387847000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f7d8ad5c0 con 0x563f7dac82f0 2023-10-03T19:13:48.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f2387847000 10 client.0 _ll_register_callbacks cb 0x563f7daad610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T19:13:48.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f23824bf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f7dabfa10 0x563f7dac4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:48.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f23824bf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f7dabfa10 0x563f7dac4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42526/0 (socket says 172.21.15.45:42526) 2023-10-03T19:13:48.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f23824bf640 1 -- 172.21.15.45:0/2210718336 learned_addr learned my addr 172.21.15.45:0/2210718336 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:48.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f2381cbe640 1 --2- 172.21.15.45:0/2210718336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f7dac0320 0x563f7dac5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:48.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f2382cc0640 1 --2- 172.21.15.45:0/2210718336 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x563f7dac82f0 0x563f7dac56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:48.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f23824bf640 1 -- 172.21.15.45:0/2210718336 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x563f7dac82f0 msgr2=0x563f7dac56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:48.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f23824bf640 1 --2- 172.21.15.45:0/2210718336 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x563f7dac82f0 0x563f7dac56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:48.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f23824bf640 1 -- 172.21.15.45:0/2210718336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f7dac0320 msgr2=0x563f7dac5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:48.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f23824bf640 1 --2- 172.21.15.45:0/2210718336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f7dac0320 0x563f7dac5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:48.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f23824bf640 1 -- 172.21.15.45:0/2210718336 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f237800e040 con 0x563f7dabfa10 2023-10-03T19:13:48.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f23824bf640 1 --2- 172.21.15.45:0/2210718336 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f7dabfa10 0x563f7dac4c40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2378005c50 tx=0x7f2378004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e81029ed5c8b59 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:48.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f235d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-10-03T19:13:48.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f235d7fa640 1 -- 172.21.15.45:0/2210718336 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237800b170 con 0x563f7dabfa10 2023-10-03T19:13:48.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f235d7fa640 1 -- 172.21.15.45:0/2210718336 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2378005e30 con 0x563f7dabfa10 2023-10-03T19:13:48.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f2387847000 1 -- 172.21.15.45:0/2210718336 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563f7d8cd480 con 0x563f7dabfa10 2023-10-03T19:13:48.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f235d7fa640 1 -- 172.21.15.45:0/2210718336 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2378014e90 con 0x563f7dabfa10 2023-10-03T19:13:48.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f2387847000 10 client.5328 fetch_fsmap learned FSMap version 15 2023-10-03T19:13:48.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f2387847000 1 -- 172.21.15.45:0/2210718336 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x563f7d7309b0 con 0x563f7dabfa10 2023-10-03T19:13:48.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f235d7fa640 1 -- 172.21.15.45:0/2210718336 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563f7d8cd480 con 0x563f7dabfa10 2023-10-03T19:13:48.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f235d7fa640 1 -- 172.21.15.45:0/2210718336 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 15) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f2378006450 con 0x563f7dabfa10 2023-10-03T19:13:48.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f2387847000 10 client.5328 fetch_fsmap finished waiting for FSMap version 15 2023-10-03T19:13:48.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f2387847000 10 client.5328 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2023-10-03T19:13:48.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f2387847000 20 client.5328 populate_metadata read hostname 'smithi045' 2023-10-03T19:13:48.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f2387847000 1 --2- 172.21.15.45:0/2210718336 >> [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] conn(0x563f7dac60d0 0x563f7db0fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:48.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f2387847000 4 client.5328 mds_command: new command op to 5076 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-03T19:13:48.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f2387847000 1 -- 172.21.15.45:0/2210718336 --> [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563f7d8d94b0 con 0x563f7dac60d0 2023-10-03T19:13:48.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f2381cbe640 1 --2- 172.21.15.45:0/2210718336 >> [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] conn(0x563f7dac60d0 0x563f7db0fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:48.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f235d7fa640 10 client.5328 ms_handle_connect on v2:172.21.15.45:6833/252012936 2023-10-03T19:13:48.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f2381cbe640 1 --2- 172.21.15.45:0/2210718336 >> [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] conn(0x563f7dac60d0 0x563f7db0fe00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad96a57cc43d4abc server_cookie=8eb385d99d655b4a in_seq=0 out_seq=0 2023-10-03T19:13:48.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f235d7fa640 1 -- 172.21.15.45:0/2210718336 <== mds.0 v2:172.21.15.45:6833/252012936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x563f7d8d94b0 con 0x563f7dac60d0 2023-10-03T19:13:48.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f235d7fa640 10 client.5328 handle_command_reply: tid=0 2023-10-03T19:13:48.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.232+0000 7f2387847000 1 client.5328 shutdown 2023-10-03T19:13:48.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.236+0000 7f2387847000 1 -- 172.21.15.45:0/2210718336 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f7dabfa10 msgr2=0x563f7dac4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:48.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.236+0000 7f2387847000 1 --2- 172.21.15.45:0/2210718336 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f7dabfa10 0x563f7dac4c40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2378005c50 tx=0x7f2378004740 comp rx=0 tx=0).stop 2023-10-03T19:13:48.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.236+0000 7f2387847000 1 -- 172.21.15.45:0/2210718336 shutdown_connections 2023-10-03T19:13:48.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.236+0000 7f2387847000 1 --2- 172.21.15.45:0/2210718336 >> [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] conn(0x563f7dac60d0 0x563f7db0fe00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:48.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.236+0000 7f2387847000 1 --2- 172.21.15.45:0/2210718336 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x563f7dac82f0 0x563f7dac56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:48.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.236+0000 7f2387847000 1 --2- 172.21.15.45:0/2210718336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f7dac0320 0x563f7dac5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:48.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.236+0000 7f2387847000 1 --2- 172.21.15.45:0/2210718336 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f7dabfa10 0x563f7dac4c40 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:48.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.236+0000 7f235d7fa640 0 client.5328 ms_handle_reset on v2:172.21.15.45:6833/252012936 2023-10-03T19:13:48.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.236+0000 7f2387847000 1 -- 172.21.15.45:0/2210718336 >> 172.21.15.45:0/2210718336 conn(0x563f7daf97f0 msgr2=0x563f7dabebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:48.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.236+0000 7f2387847000 1 -- 172.21.15.45:0/2210718336 shutdown_connections 2023-10-03T19:13:48.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.236+0000 7f2387847000 1 -- 172.21.15.45:0/2210718336 wait complete. 2023-10-03T19:13:48.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.236+0000 7f2387847000 20 client.5328 trim_cache size 0 max 16384 2023-10-03T19:13:48.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.244+0000 7f2387847000 1 Processor -- start 2023-10-03T19:13:48.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.244+0000 7f2387847000 1 -- start start 2023-10-03T19:13:48.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.244+0000 7f2387847000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x563f7dabfa10 0x563f7db11bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:48.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.244+0000 7f2387847000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f7dac0320 0x563f7db0fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:48.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.244+0000 7f2387847000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f7dac82f0 0x563f7db10340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:48.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.244+0000 7f2387847000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f7d5cda40 con 0x563f7dac82f0 2023-10-03T19:13:48.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.244+0000 7f2387847000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f7d985940 con 0x563f7dac0320 2023-10-03T19:13:48.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.244+0000 7f2387847000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f7d8d20f0 con 0x563f7dabfa10 2023-10-03T19:13:48.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.244+0000 7f2382cc0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f7dac82f0 0x563f7db10340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:48.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.244+0000 7f2382cc0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f7dac82f0 0x563f7db10340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42538/0 (socket says 172.21.15.45:42538) 2023-10-03T19:13:48.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.244+0000 7f2382cc0640 1 -- 172.21.15.45:0/2671661174 learned_addr learned my addr 172.21.15.45:0/2671661174 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:48.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.244+0000 7f2382cc0640 1 -- 172.21.15.45:0/2671661174 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x563f7dabfa10 msgr2=0x563f7db11bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:48.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.244+0000 7f2382cc0640 1 --2- 172.21.15.45:0/2671661174 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x563f7dabfa10 0x563f7db11bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:48.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.244+0000 7f2382cc0640 1 -- 172.21.15.45:0/2671661174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f7dac0320 msgr2=0x563f7db0fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:48.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.244+0000 7f2382cc0640 1 --2- 172.21.15.45:0/2671661174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f7dac0320 0x563f7db0fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:48.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.244+0000 7f2382cc0640 1 -- 172.21.15.45:0/2671661174 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f7d8d5250 con 0x563f7dac82f0 2023-10-03T19:13:48.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.244+0000 7f2382cc0640 1 --2- 172.21.15.45:0/2671661174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f7dac82f0 0x563f7db10340 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2374054740 tx=0x7f2374054110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65fd1136faf7cfc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:48.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.244+0000 7f2370ff9640 1 -- 172.21.15.45:0/2671661174 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2374052b50 con 0x563f7dac82f0 2023-10-03T19:13:48.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.244+0000 7f2370ff9640 1 -- 172.21.15.45:0/2671661174 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2374050ec0 con 0x563f7dac82f0 2023-10-03T19:13:48.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.244+0000 7f2370ff9640 1 -- 172.21.15.45:0/2671661174 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2374055da0 con 0x563f7dac82f0 2023-10-03T19:13:48.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2387847000 1 -- 172.21.15.45:0/2671661174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f7dac82f0 msgr2=0x563f7db10340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:13:48.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2387847000 1 --2- 172.21.15.45:0/2671661174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f7dac82f0 0x563f7db10340 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2374054740 tx=0x7f2374054110 comp rx=0 tx=0).stop 2023-10-03T19:13:48.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2387847000 1 -- 172.21.15.45:0/2671661174 shutdown_connections 2023-10-03T19:13:48.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2387847000 1 --2- 172.21.15.45:0/2671661174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f7dac82f0 0x563f7db10340 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:48.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2387847000 1 --2- 172.21.15.45:0/2671661174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f7dac0320 0x563f7db0fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:48.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2387847000 1 --2- 172.21.15.45:0/2671661174 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x563f7dabfa10 0x563f7db11bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:48.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2387847000 1 -- 172.21.15.45:0/2671661174 >> 172.21.15.45:0/2671661174 conn(0x563f7daf97f0 msgr2=0x563f7db0af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:13:48.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2387847000 1 -- 172.21.15.45:0/2671661174 shutdown_connections 2023-10-03T19:13:48.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2387847000 1 -- 172.21.15.45:0/2671661174 wait complete. 2023-10-03T19:13:48.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2387847000 1 -- start start 2023-10-03T19:13:48.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2387847000 1 Processor -- start 2023-10-03T19:13:48.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2387847000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f7dabfa10 0x563f7db11200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:48.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2387847000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f7dac0320 0x563f7db5ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:48.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2387847000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x563f7dac82f0 0x563f7db5b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:48.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2387847000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f7d90cfd0 con 0x563f7dac0320 2023-10-03T19:13:48.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2387847000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f7db147d0 con 0x563f7dabfa10 2023-10-03T19:13:48.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2387847000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f7d8ce8a0 con 0x563f7dac82f0 2023-10-03T19:13:48.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2387847000 10 client.0 _ll_register_callbacks cb 0x563f7d8be9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T19:13:48.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2381cbe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f7dac0320 0x563f7db5ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:48.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2381cbe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f7dac0320 0x563f7db5ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42552/0 (socket says 172.21.15.45:42552) 2023-10-03T19:13:48.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2381cbe640 1 -- 172.21.15.45:0/2799686777 learned_addr learned my addr 172.21.15.45:0/2799686777 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:13:48.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2381cbe640 1 -- 172.21.15.45:0/2799686777 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x563f7dac82f0 msgr2=0x563f7db5b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:48.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2381cbe640 1 --2- 172.21.15.45:0/2799686777 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x563f7dac82f0 0x563f7db5b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:48.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2381cbe640 1 -- 172.21.15.45:0/2799686777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f7dabfa10 msgr2=0x563f7db11200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:13:48.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f23824bf640 1 --2- 172.21.15.45:0/2799686777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f7dabfa10 0x563f7db11200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:48.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2381cbe640 1 --2- 172.21.15.45:0/2799686777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f7dabfa10 0x563f7db11200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:13:48.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2381cbe640 1 -- 172.21.15.45:0/2799686777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f237c0a5ee0 con 0x563f7dac0320 2023-10-03T19:13:48.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f23824bf640 1 --2- 172.21.15.45:0/2799686777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f7dabfa10 0x563f7db11200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:13:48.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2381cbe640 1 --2- 172.21.15.45:0/2799686777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f7dac0320 0x563f7db5ace0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f236c01a0b0 tx=0x7f236c019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba5f95a2c942425 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:13:48.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f235d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-10-03T19:13:48.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f235d7fa640 1 -- 172.21.15.45:0/2799686777 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c004380 con 0x563f7dac0320 2023-10-03T19:13:48.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f235d7fa640 1 -- 172.21.15.45:0/2799686777 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f236c0ac970 con 0x563f7dac0320 2023-10-03T19:13:48.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2387847000 1 -- 172.21.15.45:0/2799686777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563f7d8df4e0 con 0x563f7dac0320 2023-10-03T19:13:48.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f235d7fa640 1 -- 172.21.15.45:0/2799686777 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f236c0044e0 con 0x563f7dac0320 2023-10-03T19:13:48.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2387847000 10 client.5334 fetch_fsmap learned FSMap version 15 2023-10-03T19:13:48.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2387847000 1 -- 172.21.15.45:0/2799686777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x563f7d8bac50 con 0x563f7dac0320 2023-10-03T19:13:48.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f235d7fa640 1 -- 172.21.15.45:0/2799686777 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563f7d8df4e0 con 0x563f7dac0320 2023-10-03T19:13:48.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f235d7fa640 1 -- 172.21.15.45:0/2799686777 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 15) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f236c0c3020 con 0x563f7dac0320 2023-10-03T19:13:48.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2387847000 10 client.5334 fetch_fsmap finished waiting for FSMap version 15 2023-10-03T19:13:48.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2387847000 10 client.5334 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2023-10-03T19:13:48.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2387847000 20 client.5334 populate_metadata read hostname 'smithi045' 2023-10-03T19:13:48.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2387847000 1 --2- 172.21.15.45:0/2799686777 >> [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] conn(0x563f7db598b0 0x563f7db59cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:13:48.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2387847000 4 client.5334 mds_command: new command op to 5076 tid=0[{"prefix": "cache drop"}] 2023-10-03T19:13:48.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f2387847000 1 -- 172.21.15.45:0/2799686777 --> [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] -- command(tid 0: {"prefix": "cache drop"}) v1 -- 0x563f7d9091b0 con 0x563f7db598b0 2023-10-03T19:13:48.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f23824bf640 1 --2- 172.21.15.45:0/2799686777 >> [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] conn(0x563f7db598b0 0x563f7db59cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:13:48.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f235d7fa640 10 client.5334 ms_handle_connect on v2:172.21.15.45:6833/252012936 2023-10-03T19:13:48.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:13:48.248+0000 7f23824bf640 1 --2- 172.21.15.45:0/2799686777 >> [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] conn(0x563f7db598b0 0x563f7db59cb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a75a337d886ed3a1 server_cookie=50eb5e15552f8c51 in_seq=0 out_seq=0 2023-10-03T19:14:01.219 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:14:01.222 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:14:01.225 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:14:01.228 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:14:31.349 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:14:31.352 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:14:31.354 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:14:31.357 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:15:01.420 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:15:01.423 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:15:01.426 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:15:01.428 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:15:17.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:17.727+0000 7f235d7fa640 1 -- 172.21.15.45:0/2799686777 <== mds.0 v2:172.21.15.45:6833/252012936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+387 (crc 0 0 0) 0x563f7d9091b0 con 0x563f7db598b0 2023-10-03T19:15:17.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:17.727+0000 7f235d7fa640 10 client.5334 handle_command_reply: tid=0 2023-10-03T19:15:17.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:17.727+0000 7f2387847000 1 client.5334 shutdown 2023-10-03T19:15:17.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:17.727+0000 7f2387847000 1 -- 172.21.15.45:0/2799686777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f7dac0320 msgr2=0x563f7db5ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:17.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:17.727+0000 7f2387847000 1 --2- 172.21.15.45:0/2799686777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f7dac0320 0x563f7db5ace0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f236c01a0b0 tx=0x7f236c019220 comp rx=0 tx=0).stop 2023-10-03T19:15:17.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:17.727+0000 7f2387847000 1 -- 172.21.15.45:0/2799686777 shutdown_connections 2023-10-03T19:15:17.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:17.727+0000 7f2387847000 1 --2- 172.21.15.45:0/2799686777 >> [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] conn(0x563f7db598b0 0x563f7db59cb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:17.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:17.727+0000 7f2387847000 1 --2- 172.21.15.45:0/2799686777 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x563f7dac82f0 0x563f7db5b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:17.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:17.727+0000 7f2387847000 1 --2- 172.21.15.45:0/2799686777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f7dac0320 0x563f7db5ace0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:17.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:17.727+0000 7f235d7fa640 0 client.5334 ms_handle_reset on v2:172.21.15.45:6833/252012936 2023-10-03T19:15:17.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:17.727+0000 7f2387847000 1 --2- 172.21.15.45:0/2799686777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f7dabfa10 0x563f7db11200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:17.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:17.727+0000 7f2387847000 1 -- 172.21.15.45:0/2799686777 >> 172.21.15.45:0/2799686777 conn(0x563f7daf97f0 msgr2=0x563f7db0a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:17.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:17.727+0000 7f2387847000 1 -- 172.21.15.45:0/2799686777 shutdown_connections 2023-10-03T19:15:17.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:17.727+0000 7f2387847000 1 -- 172.21.15.45:0/2799686777 wait complete. 2023-10-03T19:15:17.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:17.727+0000 7f2387847000 20 client.5334 trim_cache size 0 max 16384 2023-10-03T19:15:17.734 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-03T19:15:17.734 INFO:teuthology.orchestra.run.smithi045.stdout: "client_recall": { 2023-10-03T19:15:17.734 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2023-10-03T19:15:17.734 INFO:teuthology.orchestra.run.smithi045.stdout: "message": "(0) Success", 2023-10-03T19:15:17.734 INFO:teuthology.orchestra.run.smithi045.stdout: "recalled": 1820 2023-10-03T19:15:17.734 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:15:17.734 INFO:teuthology.orchestra.run.smithi045.stdout: "flush_journal": { 2023-10-03T19:15:17.734 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2023-10-03T19:15:17.735 INFO:teuthology.orchestra.run.smithi045.stdout: "message": "" 2023-10-03T19:15:17.735 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:15:17.735 INFO:teuthology.orchestra.run.smithi045.stdout: "trim_cache": { 2023-10-03T19:15:17.735 INFO:teuthology.orchestra.run.smithi045.stdout: "trimmed": 900 2023-10-03T19:15:17.735 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:15:17.735 INFO:teuthology.orchestra.run.smithi045.stdout: "cache": { 2023-10-03T19:15:17.735 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": { 2023-10-03T19:15:17.735 INFO:teuthology.orchestra.run.smithi045.stdout: "items": 2239, 2023-10-03T19:15:17.735 INFO:teuthology.orchestra.run.smithi045.stdout: "bytes": 372472 2023-10-03T19:15:17.735 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:15:17.735 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:15:17.735 INFO:teuthology.orchestra.run.smithi045.stdout: "duration": 89.476192936999993 2023-10-03T19:15:17.736 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-03T19:15:17.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:17.727+0000 7f2384723640 1 -- 172.21.15.45:0/1165464026 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2360066280 msgr2=0x7f2360068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:17.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:17.727+0000 7f2384723640 1 --2- 172.21.15.45:0/1165464026 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2360066280 0x7f2360068730 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f237800b930 tx=0x7f2378008040 comp rx=0 tx=0).stop 2023-10-03T19:15:17.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:17.727+0000 7f2384723640 1 -- 172.21.15.45:0/1165464026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f237c0712c0 msgr2=0x7f237c1e6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:17.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:17.727+0000 7f2384723640 1 --2- 172.21.15.45:0/1165464026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f237c0712c0 0x7f237c1e6ef0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2374001570 tx=0x7f237400cc70 comp rx=0 tx=0).stop 2023-10-03T19:15:17.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:17.727+0000 7f2384723640 1 -- 172.21.15.45:0/1165464026 shutdown_connections 2023-10-03T19:15:17.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:17.727+0000 7f2384723640 1 --2- 172.21.15.45:0/1165464026 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2360066280 0x7f2360068730 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:17.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:17.727+0000 7f2384723640 1 --2- 172.21.15.45:0/1165464026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f237c0712c0 0x7f237c1e6ef0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:17.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:17.727+0000 7f2384723640 1 --2- 172.21.15.45:0/1165464026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f237c06d560 0x7f237c1479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:17.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:17.727+0000 7f2384723640 1 --2- 172.21.15.45:0/1165464026 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f237c06c760 0x7f237c06f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:17.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:17.727+0000 7f2384723640 1 -- 172.21.15.45:0/1165464026 >> 172.21.15.45:0/1165464026 conn(0x7f237c0a20d0 msgr2=0x7f237c0be010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:17.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:17.727+0000 7f2384723640 1 -- 172.21.15.45:0/1165464026 shutdown_connections 2023-10-03T19:15:17.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:17.727+0000 7f2384723640 1 -- 172.21.15.45:0/1165464026 wait complete. 2023-10-03T19:15:17.748 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-03T19:15:17.749 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:15:17.793 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:15:17.860 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:15:17.907 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:15:17.970 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-03T19:15:17.970 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:15:17.970 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:15:17.976 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:15:18.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.107+0000 7fef619b1640 1 Processor -- start 2023-10-03T19:15:18.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.107+0000 7fef619b1640 1 -- start start 2023-10-03T19:15:18.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.107+0000 7fef619b1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fef5c06f170 0x7fef5c150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:18.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.107+0000 7fef619b1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fef5c06d170 0x7fef5c14d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:18.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.107+0000 7fef619b1640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5c06cac0 con 0x7fef5c0bc8b0 2023-10-03T19:15:18.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.107+0000 7fef619b1640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef5c0720d0 con 0x7fef5c06d170 2023-10-03T19:15:18.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.107+0000 7fef619b1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c0a5ab0 con 0x7fef5c06f170 2023-10-03T19:15:18.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.107+0000 7fef5affd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fef5c06f170 0x7fef5c150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:18.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.107+0000 7fef5b7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fef5c06d170 0x7fef5c14d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:18.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.107+0000 7fef5affd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fef5c06f170 0x7fef5c150190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:40026/0 (socket says 172.21.15.45:40026) 2023-10-03T19:15:18.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.107+0000 7fef5affd640 1 -- 172.21.15.45:0/2107783759 learned_addr learned my addr 172.21.15.45:0/2107783759 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:18.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.107+0000 7fef5a7fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fef5c0bc8b0 0x7fef5c14ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:50418/0 (socket says 172.21.15.45:50418) 2023-10-03T19:15:18.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.107+0000 7fef5b7fe640 1 -- 172.21.15.45:0/2107783759 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fef5c06f170 msgr2=0x7fef5c150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:18.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.107+0000 7fef5b7fe640 1 --2- 172.21.15.45:0/2107783759 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fef5c06f170 0x7fef5c150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.107+0000 7fef5b7fe640 1 -- 172.21.15.45:0/2107783759 >> v1:172.21.15.79:6789/0 conn(0x7fef5c0bc8b0 legacy=0x7fef5c14ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:18.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.107+0000 7fef5b7fe640 1 -- 172.21.15.45:0/2107783759 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5c06cd00 con 0x7fef5c06d170 2023-10-03T19:15:18.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.111+0000 7fef5b7fe640 1 --2- 172.21.15.45:0/2107783759 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef5c06d170 0x7fef5c14d180 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fef54009d90 tx=0x7fef5401c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7121088d1aee5c0b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:18.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.111+0000 7fef59ffb640 1 -- 172.21.15.45:0/2107783759 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef540a5920 con 0x7fef5c06d170 2023-10-03T19:15:18.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.111+0000 7fef59ffb640 1 -- 172.21.15.45:0/2107783759 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef540a5a80 con 0x7fef5c06d170 2023-10-03T19:15:18.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.111+0000 7fef59ffb640 1 -- 172.21.15.45:0/2107783759 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef540a5e10 con 0x7fef5c06d170 2023-10-03T19:15:18.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.111+0000 7fef619b1640 1 -- 172.21.15.45:0/2107783759 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef5c06d170 msgr2=0x7fef5c14d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:18.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.111+0000 7fef619b1640 1 --2- 172.21.15.45:0/2107783759 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef5c06d170 0x7fef5c14d180 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fef54009d90 tx=0x7fef5401c910 comp rx=0 tx=0).stop 2023-10-03T19:15:18.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.111+0000 7fef619b1640 1 -- 172.21.15.45:0/2107783759 shutdown_connections 2023-10-03T19:15:18.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.111+0000 7fef619b1640 1 --2- 172.21.15.45:0/2107783759 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef5c06d170 0x7fef5c14d180 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.111+0000 7fef619b1640 1 --2- 172.21.15.45:0/2107783759 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fef5c06f170 0x7fef5c150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.111+0000 7fef619b1640 1 -- 172.21.15.45:0/2107783759 >> 172.21.15.45:0/2107783759 conn(0x7fef5c0bcf50 msgr2=0x7fef5c0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:18.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.111+0000 7fef619b1640 1 -- 172.21.15.45:0/2107783759 shutdown_connections 2023-10-03T19:15:18.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.111+0000 7fef619b1640 1 -- 172.21.15.45:0/2107783759 wait complete. 2023-10-03T19:15:18.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.111+0000 7fef619b1640 1 Processor -- start 2023-10-03T19:15:18.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.111+0000 7fef619b1640 1 -- start start 2023-10-03T19:15:18.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.111+0000 7fef619b1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef5c06d170 0x7fef5c13d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:18.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.111+0000 7fef619b1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fef5c06f170 0x7fef5c14f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:18.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.111+0000 7fef619b1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef5c0bc8b0 0x7fef5c1e8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:18.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.111+0000 7fef619b1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c147010 con 0x7fef5c06d170 2023-10-03T19:15:18.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.111+0000 7fef619b1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c1e7df0 con 0x7fef5c0bc8b0 2023-10-03T19:15:18.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.111+0000 7fef619b1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c14f730 con 0x7fef5c06f170 2023-10-03T19:15:18.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.111+0000 7fef5affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef5c06d170 0x7fef5c13d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:18.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.111+0000 7fef5affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef5c06d170 0x7fef5c13d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44630/0 (socket says 172.21.15.45:44630) 2023-10-03T19:15:18.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.111+0000 7fef5affd640 1 -- 172.21.15.45:0/2905886648 learned_addr learned my addr 172.21.15.45:0/2905886648 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:18.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.111+0000 7fef5b7fe640 1 --2- 172.21.15.45:0/2905886648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef5c0bc8b0 0x7fef5c1e8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:18.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.111+0000 7fef5a7fc640 1 --2- 172.21.15.45:0/2905886648 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fef5c06f170 0x7fef5c14f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:18.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.115+0000 7fef5affd640 1 -- 172.21.15.45:0/2905886648 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fef5c06f170 msgr2=0x7fef5c14f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:18.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.115+0000 7fef5affd640 1 --2- 172.21.15.45:0/2905886648 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fef5c06f170 0x7fef5c14f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.115+0000 7fef5affd640 1 -- 172.21.15.45:0/2905886648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef5c0bc8b0 msgr2=0x7fef5c1e8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:18.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.115+0000 7fef5affd640 1 --2- 172.21.15.45:0/2905886648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef5c0bc8b0 0x7fef5c1e8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.115+0000 7fef5affd640 1 -- 172.21.15.45:0/2905886648 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef54009a70 con 0x7fef5c06d170 2023-10-03T19:15:18.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.115+0000 7fef5b7fe640 1 --2- 172.21.15.45:0/2905886648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef5c0bc8b0 0x7fef5c1e8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:15:18.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.115+0000 7fef5affd640 1 --2- 172.21.15.45:0/2905886648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef5c06d170 0x7fef5c13d5c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00e890 tx=0x7fef4c00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:18.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.115+0000 7fef43fff640 1 -- 172.21.15.45:0/2905886648 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c009620 con 0x7fef5c06d170 2023-10-03T19:15:18.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.115+0000 7fef43fff640 1 -- 172.21.15.45:0/2905886648 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4c00c940 con 0x7fef5c06d170 2023-10-03T19:15:18.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.115+0000 7fef619b1640 1 -- 172.21.15.45:0/2905886648 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef5c06f6d0 con 0x7fef5c06d170 2023-10-03T19:15:18.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.115+0000 7fef43fff640 1 -- 172.21.15.45:0/2905886648 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c00ccf0 con 0x7fef5c06d170 2023-10-03T19:15:18.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.115+0000 7fef619b1640 1 -- 172.21.15.45:0/2905886648 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5c06f540 con 0x7fef5c06d170 2023-10-03T19:15:18.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.115+0000 7fef619b1640 1 -- 172.21.15.45:0/2905886648 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5c159670 con 0x7fef5c06d170 2023-10-03T19:15:18.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.115+0000 7fef43fff640 1 -- 172.21.15.45:0/2905886648 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fef4c013470 con 0x7fef5c06d170 2023-10-03T19:15:18.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.115+0000 7fef43fff640 1 --2- 172.21.15.45:0/2905886648 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fef48066280 0x7fef48068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:18.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.115+0000 7fef43fff640 1 -- 172.21.15.45:0/2905886648 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fef4c0841b0 con 0x7fef5c06d170 2023-10-03T19:15:18.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.115+0000 7fef5a7fc640 1 --2- 172.21.15.45:0/2905886648 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fef48066280 0x7fef48068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:18.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.115+0000 7fef5a7fc640 1 --2- 172.21.15.45:0/2905886648 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fef48066280 0x7fef48068730 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fef5c148430 tx=0x7fef50007cf0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:18.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.119+0000 7fef43fff640 1 -- 172.21.15.45:0/2905886648 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fef4c0516a0 con 0x7fef5c06d170 2023-10-03T19:15:18.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.275+0000 7fef619b1640 1 -- 172.21.15.45:0/2905886648 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef5c06d660 con 0x7fef5c06d170 2023-10-03T19:15:18.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.279+0000 7fef43fff640 1 -- 172.21.15.45:0/2905886648 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18296 (secure 0 0 0) 0x7fef4c054cc0 con 0x7fef5c06d170 2023-10-03T19:15:18.283 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:15:18.284 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":37,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:14:12.706533+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:13:19.206863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-03T19:13:20.283396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.36","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:15:18.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.279+0000 7fef619b1640 1 -- 172.21.15.45:0/2905886648 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fef48066280 msgr2=0x7fef48068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:18.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.279+0000 7fef619b1640 1 --2- 172.21.15.45:0/2905886648 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fef48066280 0x7fef48068730 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fef5c148430 tx=0x7fef50007cf0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.279+0000 7fef619b1640 1 -- 172.21.15.45:0/2905886648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef5c06d170 msgr2=0x7fef5c13d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:18.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.279+0000 7fef619b1640 1 --2- 172.21.15.45:0/2905886648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef5c06d170 0x7fef5c13d5c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00e890 tx=0x7fef4c00ed50 comp rx=0 tx=0).stop 2023-10-03T19:15:18.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.279+0000 7fef619b1640 1 -- 172.21.15.45:0/2905886648 shutdown_connections 2023-10-03T19:15:18.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.279+0000 7fef619b1640 1 --2- 172.21.15.45:0/2905886648 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fef48066280 0x7fef48068730 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.279+0000 7fef619b1640 1 --2- 172.21.15.45:0/2905886648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef5c0bc8b0 0x7fef5c1e8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.279+0000 7fef619b1640 1 --2- 172.21.15.45:0/2905886648 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fef5c06f170 0x7fef5c14f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.279+0000 7fef619b1640 1 --2- 172.21.15.45:0/2905886648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef5c06d170 0x7fef5c13d5c0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.279+0000 7fef619b1640 1 -- 172.21.15.45:0/2905886648 >> 172.21.15.45:0/2905886648 conn(0x7fef5c0bcf50 msgr2=0x7fef5c14fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:18.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.279+0000 7fef619b1640 1 -- 172.21.15.45:0/2905886648 shutdown_connections 2023-10-03T19:15:18.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.279+0000 7fef619b1640 1 -- 172.21.15.45:0/2905886648 wait complete. 2023-10-03T19:15:18.303 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T19:13:19.206863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T19:13:20.283396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:15:18.303 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:15:18.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.419+0000 7f63116b4640 1 Processor -- start 2023-10-03T19:15:18.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.419+0000 7f63116b4640 1 -- start start 2023-10-03T19:15:18.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.419+0000 7f63116b4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f630c0bf1f0 0x7f630c0a9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:18.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.419+0000 7f63116b4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f630c0c2770 0x7f630c0a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:18.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.419+0000 7f63116b4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f630c06ac70 con 0x7f630c0c14e0 2023-10-03T19:15:18.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.419+0000 7f63116b4640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f630c06aae0 con 0x7f630c0bf1f0 2023-10-03T19:15:18.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.419+0000 7f63116b4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630c0c3000 con 0x7f630c0c2770 2023-10-03T19:15:18.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.419+0000 7f630a7fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f630c0bf1f0 0x7f630c0a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:18.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.419+0000 7f630a7fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f630c0bf1f0 0x7f630c0a9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44636/0 (socket says 172.21.15.45:44636) 2023-10-03T19:15:18.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.419+0000 7f630a7fc640 1 -- 172.21.15.45:0/578339464 learned_addr learned my addr 172.21.15.45:0/578339464 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:18.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.423+0000 7f630b7fe640 1 --2- 172.21.15.45:0/578339464 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f630c0c2770 0x7f630c0a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:18.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.423+0000 7f630a7fc640 1 -- 172.21.15.45:0/578339464 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f630c0c2770 msgr2=0x7f630c0a9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:18.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.423+0000 7f630a7fc640 1 --2- 172.21.15.45:0/578339464 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f630c0c2770 0x7f630c0a9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.423+0000 7f630a7fc640 1 -- 172.21.15.45:0/578339464 >> v1:172.21.15.79:6789/0 conn(0x7f630c0c14e0 legacy=0x7f630c0c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:18.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.423+0000 7f630a7fc640 1 -- 172.21.15.45:0/578339464 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630c0aa5f0 con 0x7f630c0bf1f0 2023-10-03T19:15:18.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.423+0000 7f630a7fc640 1 --2- 172.21.15.45:0/578339464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f630c0bf1f0 0x7f630c0a9860 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6300009870 tx=0x7f630001ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e49bf84dea070 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:18.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.423+0000 7f6309ffb640 1 -- 172.21.15.45:0/578339464 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63000a8a30 con 0x7f630c0bf1f0 2023-10-03T19:15:18.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.423+0000 7f6309ffb640 1 -- 172.21.15.45:0/578339464 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63000a8b90 con 0x7f630c0bf1f0 2023-10-03T19:15:18.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.423+0000 7f6309ffb640 1 -- 172.21.15.45:0/578339464 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63000b0440 con 0x7f630c0bf1f0 2023-10-03T19:15:18.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.423+0000 7f63116b4640 1 -- 172.21.15.45:0/578339464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f630c0bf1f0 msgr2=0x7f630c0a9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:18.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f63116b4640 1 --2- 172.21.15.45:0/578339464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f630c0bf1f0 0x7f630c0a9860 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6300009870 tx=0x7f630001ed30 comp rx=0 tx=0).stop 2023-10-03T19:15:18.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f63116b4640 1 -- 172.21.15.45:0/578339464 shutdown_connections 2023-10-03T19:15:18.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f63116b4640 1 --2- 172.21.15.45:0/578339464 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f630c0c2770 0x7f630c0a9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f63116b4640 1 --2- 172.21.15.45:0/578339464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f630c0bf1f0 0x7f630c0a9860 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f63116b4640 1 -- 172.21.15.45:0/578339464 >> 172.21.15.45:0/578339464 conn(0x7f630c0a6440 msgr2=0x7f630c0a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:18.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f63116b4640 1 -- 172.21.15.45:0/578339464 shutdown_connections 2023-10-03T19:15:18.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f63116b4640 1 -- 172.21.15.45:0/578339464 wait complete. 2023-10-03T19:15:18.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f63116b4640 1 Processor -- start 2023-10-03T19:15:18.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f63116b4640 1 -- start start 2023-10-03T19:15:18.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f63116b4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f630c0bf1f0 0x7f630c1d8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:18.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f63116b4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f630c0c14e0 0x7f630c0bdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:18.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f63116b4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f630c0c2770 0x7f630c14b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:18.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f63116b4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c1d9370 con 0x7f630c0bf1f0 2023-10-03T19:15:18.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f63116b4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c1e43f0 con 0x7f630c0c14e0 2023-10-03T19:15:18.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f63116b4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630c0be2b0 con 0x7f630c0c2770 2023-10-03T19:15:18.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f630affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f630c0bf1f0 0x7f630c1d8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:18.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f630affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f630c0bf1f0 0x7f630c1d8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44650/0 (socket says 172.21.15.45:44650) 2023-10-03T19:15:18.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f630affd640 1 -- 172.21.15.45:0/2600503128 learned_addr learned my addr 172.21.15.45:0/2600503128 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:18.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f630a7fc640 1 --2- 172.21.15.45:0/2600503128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f630c0c14e0 0x7f630c0bdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:18.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f630b7fe640 1 --2- 172.21.15.45:0/2600503128 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f630c0c2770 0x7f630c14b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:18.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f630affd640 1 -- 172.21.15.45:0/2600503128 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f630c0c2770 msgr2=0x7f630c14b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:18.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f630affd640 1 --2- 172.21.15.45:0/2600503128 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f630c0c2770 0x7f630c14b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f630affd640 1 -- 172.21.15.45:0/2600503128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f630c0c14e0 msgr2=0x7f630c0bdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:18.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f630affd640 1 --2- 172.21.15.45:0/2600503128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f630c0c14e0 0x7f630c0bdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f630affd640 1 -- 172.21.15.45:0/2600503128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63000094d0 con 0x7f630c0bf1f0 2023-10-03T19:15:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f630affd640 1 --2- 172.21.15.45:0/2600503128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f630c0bf1f0 0x7f630c1d8570 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00c420 tx=0x7f62fc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f62f37fe640 1 -- 172.21.15.45:0/2600503128 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc0052d0 con 0x7f630c0bf1f0 2023-10-03T19:15:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f62f37fe640 1 -- 172.21.15.45:0/2600503128 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62fc005430 con 0x7f630c0bf1f0 2023-10-03T19:15:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f63116b4640 1 -- 172.21.15.45:0/2600503128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f630c14f530 con 0x7f630c0bf1f0 2023-10-03T19:15:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f62f37fe640 1 -- 172.21.15.45:0/2600503128 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc007260 con 0x7f630c0bf1f0 2023-10-03T19:15:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.427+0000 7f63116b4640 1 -- 172.21.15.45:0/2600503128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f630c14f250 con 0x7f630c0bf1f0 2023-10-03T19:15:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.431+0000 7f63116b4640 1 -- 172.21.15.45:0/2600503128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f630c06b100 con 0x7f630c0bf1f0 2023-10-03T19:15:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.431+0000 7f62f37fe640 1 -- 172.21.15.45:0/2600503128 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f62fc0073c0 con 0x7f630c0bf1f0 2023-10-03T19:15:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.431+0000 7f62f37fe640 1 --2- 172.21.15.45:0/2600503128 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f62f80662b0 0x7f62f8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.431+0000 7f62f37fe640 1 -- 172.21.15.45:0/2600503128 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f62fc083100 con 0x7f630c0bf1f0 2023-10-03T19:15:18.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.431+0000 7f630a7fc640 1 --2- 172.21.15.45:0/2600503128 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f62f80662b0 0x7f62f8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:18.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.431+0000 7f630a7fc640 1 --2- 172.21.15.45:0/2600503128 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f62f80662b0 0x7f62f8068760 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f63000b2000 tx=0x7f63000aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:18.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.435+0000 7f62f37fe640 1 -- 172.21.15.45:0/2600503128 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f62fc050580 con 0x7f630c0bf1f0 2023-10-03T19:15:18.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.587+0000 7f63116b4640 1 -- 172.21.15.45:0/2600503128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f630c04de80 con 0x7f630c0bf1f0 2023-10-03T19:15:18.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.587+0000 7f62f37fe640 1 -- 172.21.15.45:0/2600503128 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f62fc053ba0 con 0x7f630c0bf1f0 2023-10-03T19:15:18.594 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:15:18.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.591+0000 7f63116b4640 1 -- 172.21.15.45:0/2600503128 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f62f80662b0 msgr2=0x7f62f8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:18.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.591+0000 7f63116b4640 1 --2- 172.21.15.45:0/2600503128 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f62f80662b0 0x7f62f8068760 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f63000b2000 tx=0x7f63000aa070 comp rx=0 tx=0).stop 2023-10-03T19:15:18.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.591+0000 7f63116b4640 1 -- 172.21.15.45:0/2600503128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f630c0bf1f0 msgr2=0x7f630c1d8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:18.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.591+0000 7f63116b4640 1 --2- 172.21.15.45:0/2600503128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f630c0bf1f0 0x7f630c1d8570 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00c420 tx=0x7f62fc00c8e0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.591+0000 7f63116b4640 1 -- 172.21.15.45:0/2600503128 shutdown_connections 2023-10-03T19:15:18.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.591+0000 7f63116b4640 1 --2- 172.21.15.45:0/2600503128 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f62f80662b0 0x7f62f8068760 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.591+0000 7f63116b4640 1 --2- 172.21.15.45:0/2600503128 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f630c0c2770 0x7f630c14b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.591+0000 7f63116b4640 1 --2- 172.21.15.45:0/2600503128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f630c0c14e0 0x7f630c0bdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.591+0000 7f63116b4640 1 --2- 172.21.15.45:0/2600503128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f630c0bf1f0 0x7f630c1d8570 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.591+0000 7f63116b4640 1 -- 172.21.15.45:0/2600503128 >> 172.21.15.45:0/2600503128 conn(0x7f630c0a6440 msgr2=0x7f630c0a5960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:18.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.591+0000 7f63116b4640 1 -- 172.21.15.45:0/2600503128 shutdown_connections 2023-10-03T19:15:18.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.591+0000 7f63116b4640 1 -- 172.21.15.45:0/2600503128 wait complete. 2023-10-03T19:15:18.615 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:15:18.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.731+0000 7fdaf1d66640 1 Processor -- start 2023-10-03T19:15:18.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.731+0000 7fdaf1d66640 1 -- start start 2023-10-03T19:15:18.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.731+0000 7fdaf1d66640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdaec14f510 0x7fdaec14b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:18.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.731+0000 7fdaf1d66640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdaec0bd9f0 0x7fdaec14b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:18.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.731+0000 7fdaf1d66640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaec14f080 con 0x7fdaec06f880 2023-10-03T19:15:18.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.731+0000 7fdaf1d66640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaec06f3e0 con 0x7fdaec14f510 2023-10-03T19:15:18.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.731+0000 7fdaf1d66640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaec070e90 con 0x7fdaec0bd9f0 2023-10-03T19:15:18.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.731+0000 7fdaeaffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdaec14f510 0x7fdaec14b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:18.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.731+0000 7fdaeaffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdaec14f510 0x7fdaec14b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44666/0 (socket says 172.21.15.45:44666) 2023-10-03T19:15:18.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.731+0000 7fdaeaffd640 1 -- 172.21.15.45:0/937549349 learned_addr learned my addr 172.21.15.45:0/937549349 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:18.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.735+0000 7fdaebfff640 1 --2- 172.21.15.45:0/937549349 >> v2:172.21.15.79:3300/0 conn(0x7fdaec0bd9f0 0x7fdaec14b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:18.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.735+0000 7fdaeaffd640 1 -- 172.21.15.45:0/937549349 >> v2:172.21.15.79:3300/0 conn(0x7fdaec0bd9f0 msgr2=0x7fdaec14b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:18.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.735+0000 7fdaeaffd640 1 --2- 172.21.15.45:0/937549349 >> v2:172.21.15.79:3300/0 conn(0x7fdaec0bd9f0 0x7fdaec14b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.735+0000 7fdaeaffd640 1 -- 172.21.15.45:0/937549349 >> v1:172.21.15.79:6789/0 conn(0x7fdaec06f880 legacy=0x7fdaec0a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:18.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.735+0000 7fdaeaffd640 1 -- 172.21.15.45:0/937549349 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaec14ea30 con 0x7fdaec14f510 2023-10-03T19:15:18.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.735+0000 7fdaeaffd640 1 --2- 172.21.15.45:0/937549349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaec14f510 0x7fdaec14b320 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fdaec06ec00 tx=0x7fdad401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc3b4eac02a00e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:18.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.735+0000 7fdaea7fc640 1 -- 172.21.15.45:0/937549349 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad40a7070 con 0x7fdaec14f510 2023-10-03T19:15:18.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.735+0000 7fdaea7fc640 1 -- 172.21.15.45:0/937549349 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad40ab430 con 0x7fdaec14f510 2023-10-03T19:15:18.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.735+0000 7fdaea7fc640 1 -- 172.21.15.45:0/937549349 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad40ab7c0 con 0x7fdaec14f510 2023-10-03T19:15:18.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.735+0000 7fdaf1d66640 1 -- 172.21.15.45:0/937549349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaec14f510 msgr2=0x7fdaec14b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:18.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.735+0000 7fdaf1d66640 1 --2- 172.21.15.45:0/937549349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaec14f510 0x7fdaec14b320 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fdaec06ec00 tx=0x7fdad401c4d0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.735+0000 7fdaf1d66640 1 -- 172.21.15.45:0/937549349 shutdown_connections 2023-10-03T19:15:18.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.735+0000 7fdaf1d66640 1 --2- 172.21.15.45:0/937549349 >> v2:172.21.15.79:3300/0 conn(0x7fdaec0bd9f0 0x7fdaec14b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.735+0000 7fdaf1d66640 1 --2- 172.21.15.45:0/937549349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaec14f510 0x7fdaec14b320 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.735+0000 7fdaf1d66640 1 -- 172.21.15.45:0/937549349 >> 172.21.15.45:0/937549349 conn(0x7fdaec0a20d0 msgr2=0x7fdaec0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:18.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.735+0000 7fdaf1d66640 1 -- 172.21.15.45:0/937549349 shutdown_connections 2023-10-03T19:15:18.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.735+0000 7fdaf1d66640 1 -- 172.21.15.45:0/937549349 wait complete. 2023-10-03T19:15:18.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.739+0000 7fdaf1d66640 1 Processor -- start 2023-10-03T19:15:18.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.739+0000 7fdaf1d66640 1 -- start start 2023-10-03T19:15:18.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.739+0000 7fdaf1d66640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaec06f880 0x7fdaec0be270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:18.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.739+0000 7fdaf1d66640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdaec0bd9f0 0x7fdaec143a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:18.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.739+0000 7fdaf1d66640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdaec14f510 0x7fdaec143f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:18.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.739+0000 7fdaf1d66640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaec0bfc50 con 0x7fdaec06f880 2023-10-03T19:15:18.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.739+0000 7fdaf1d66640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaec145390 con 0x7fdaec0bd9f0 2023-10-03T19:15:18.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.739+0000 7fdaf1d66640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaec0be7b0 con 0x7fdaec14f510 2023-10-03T19:15:18.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.739+0000 7fdaeb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaec06f880 0x7fdaec0be270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:18.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.739+0000 7fdaeb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaec06f880 0x7fdaec0be270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44682/0 (socket says 172.21.15.45:44682) 2023-10-03T19:15:18.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.739+0000 7fdaeb7fe640 1 -- 172.21.15.45:0/3035850417 learned_addr learned my addr 172.21.15.45:0/3035850417 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:18.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.739+0000 7fdaeaffd640 1 --2- 172.21.15.45:0/3035850417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdaec0bd9f0 0x7fdaec143a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:18.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.739+0000 7fdaebfff640 1 --2- 172.21.15.45:0/3035850417 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdaec14f510 0x7fdaec143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:18.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.739+0000 7fdaeb7fe640 1 -- 172.21.15.45:0/3035850417 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdaec14f510 msgr2=0x7fdaec143f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:18.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.739+0000 7fdaeb7fe640 1 --2- 172.21.15.45:0/3035850417 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdaec14f510 0x7fdaec143f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.739+0000 7fdaeb7fe640 1 -- 172.21.15.45:0/3035850417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdaec0bd9f0 msgr2=0x7fdaec143a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:18.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.739+0000 7fdaeb7fe640 1 --2- 172.21.15.45:0/3035850417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdaec0bd9f0 0x7fdaec143a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.739+0000 7fdaeb7fe640 1 -- 172.21.15.45:0/3035850417 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad40094d0 con 0x7fdaec06f880 2023-10-03T19:15:18.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.739+0000 7fdaeb7fe640 1 --2- 172.21.15.45:0/3035850417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaec06f880 0x7fdaec0be270 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fdae400c730 tx=0x7fdae400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:18.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.739+0000 7fdae3fff640 1 -- 172.21.15.45:0/3035850417 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae4006d60 con 0x7fdaec06f880 2023-10-03T19:15:18.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.739+0000 7fdae3fff640 1 -- 172.21.15.45:0/3035850417 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae400ce40 con 0x7fdaec06f880 2023-10-03T19:15:18.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.739+0000 7fdaf1d66640 1 -- 172.21.15.45:0/3035850417 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaec0a6050 con 0x7fdaec06f880 2023-10-03T19:15:18.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.739+0000 7fdae3fff640 1 -- 172.21.15.45:0/3035850417 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae4003bc0 con 0x7fdaec06f880 2023-10-03T19:15:18.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.739+0000 7fdaf1d66640 1 -- 172.21.15.45:0/3035850417 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaec06fc50 con 0x7fdaec06f880 2023-10-03T19:15:18.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.739+0000 7fdaf1d66640 1 -- 172.21.15.45:0/3035850417 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaec0a61e0 con 0x7fdaec06f880 2023-10-03T19:15:18.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.743+0000 7fdae3fff640 1 -- 172.21.15.45:0/3035850417 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdae4003d20 con 0x7fdaec06f880 2023-10-03T19:15:18.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.743+0000 7fdae3fff640 1 --2- 172.21.15.45:0/3035850417 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fdacc066280 0x7fdacc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:18.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.743+0000 7fdae3fff640 1 -- 172.21.15.45:0/3035850417 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fdae40846d0 con 0x7fdaec06f880 2023-10-03T19:15:18.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.743+0000 7fdaeaffd640 1 --2- 172.21.15.45:0/3035850417 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fdacc066280 0x7fdacc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:18.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.743+0000 7fdaeaffd640 1 --2- 172.21.15.45:0/3035850417 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fdacc066280 0x7fdacc068730 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdad40af000 tx=0x7fdad40a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:18.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.747+0000 7fdae3fff640 1 -- 172.21.15.45:0/3035850417 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fdae4055630 con 0x7fdaec06f880 2023-10-03T19:15:18.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.899+0000 7fdaf1d66640 1 -- 172.21.15.45:0/3035850417 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdaec04de80 con 0x7fdaec06f880 2023-10-03T19:15:18.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.899+0000 7fdae3fff640 1 -- 172.21.15.45:0/3035850417 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdae40551c0 con 0x7fdaec06f880 2023-10-03T19:15:18.904 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:15:18.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.899+0000 7fdaf1d66640 1 -- 172.21.15.45:0/3035850417 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fdacc066280 msgr2=0x7fdacc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:18.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.899+0000 7fdaf1d66640 1 --2- 172.21.15.45:0/3035850417 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fdacc066280 0x7fdacc068730 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdad40af000 tx=0x7fdad40a7000 comp rx=0 tx=0).stop 2023-10-03T19:15:18.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.899+0000 7fdaf1d66640 1 -- 172.21.15.45:0/3035850417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaec06f880 msgr2=0x7fdaec0be270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:18.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.899+0000 7fdaf1d66640 1 --2- 172.21.15.45:0/3035850417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaec06f880 0x7fdaec0be270 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fdae400c730 tx=0x7fdae400cbf0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.899+0000 7fdaf1d66640 1 -- 172.21.15.45:0/3035850417 shutdown_connections 2023-10-03T19:15:18.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.899+0000 7fdaf1d66640 1 --2- 172.21.15.45:0/3035850417 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fdacc066280 0x7fdacc068730 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.899+0000 7fdaf1d66640 1 --2- 172.21.15.45:0/3035850417 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdaec14f510 0x7fdaec143f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.899+0000 7fdaf1d66640 1 --2- 172.21.15.45:0/3035850417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdaec0bd9f0 0x7fdaec143a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.899+0000 7fdaf1d66640 1 --2- 172.21.15.45:0/3035850417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaec06f880 0x7fdaec0be270 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:18.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.899+0000 7fdaf1d66640 1 -- 172.21.15.45:0/3035850417 >> 172.21.15.45:0/3035850417 conn(0x7fdaec0a20d0 msgr2=0x7fdaec14b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:18.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.899+0000 7fdaf1d66640 1 -- 172.21.15.45:0/3035850417 shutdown_connections 2023-10-03T19:15:18.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:18.899+0000 7fdaf1d66640 1 -- 172.21.15.45:0/3035850417 wait complete. 2023-10-03T19:15:18.923 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T19:15:19.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.047+0000 7faf03b45640 1 Processor -- start 2023-10-03T19:15:19.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.047+0000 7faf03b45640 1 -- start start 2023-10-03T19:15:19.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.047+0000 7faf03b45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faefc06c760 0x7faefc0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:19.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.047+0000 7faf03b45640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faefc06c2d0 con 0x7faefc06d560 2023-10-03T19:15:19.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.047+0000 7faf03b45640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faefc150610 con 0x7faefc0712c0 2023-10-03T19:15:19.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.047+0000 7faf03b45640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faefc1508b0 con 0x7faefc06c760 2023-10-03T19:15:19.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.047+0000 7faf020e2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faefc06c760 0x7faefc0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:19.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.047+0000 7faf010e0640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7faefc06d560 0x7faefc0a53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43192/0 (socket says 172.21.15.45:43192) 2023-10-03T19:15:19.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.047+0000 7faf010e0640 1 -- 172.21.15.45:0/3433002674 learned_addr learned my addr 172.21.15.45:0/3433002674 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:15:19.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.047+0000 7faf020e2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faefc06c760 0x7faefc0a5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44692/0 (socket says 172.21.15.45:44692) 2023-10-03T19:15:19.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.047+0000 7faf020e2640 1 -- 172.21.15.45:0/3433002674 >> v1:172.21.15.79:6789/0 conn(0x7faefc0712c0 legacy=0x7faefc0bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:19.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.047+0000 7faf020e2640 1 -- 172.21.15.45:0/3433002674 >> v1:172.21.15.45:6789/0 conn(0x7faefc06d560 legacy=0x7faefc0a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:19.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.047+0000 7faf008df640 1 -- 172.21.15.45:0/3433002674 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2682357626 0 0) 0x7faefc06c2d0 con 0x7faefc06d560 2023-10-03T19:15:19.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.047+0000 7faf020e2640 1 -- 172.21.15.45:0/3433002674 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faefc06d2e0 con 0x7faefc06c760 2023-10-03T19:15:19.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faf020e2640 1 --2- 172.21.15.45:0/3433002674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faefc06c760 0x7faefc0a5ad0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7faef4009d90 tx=0x7faef401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efcb7b2770da9806 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:19.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faf008df640 1 -- 172.21.15.45:0/3433002674 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef40a58b0 con 0x7faefc06c760 2023-10-03T19:15:19.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faf008df640 1 -- 172.21.15.45:0/3433002674 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef40a5a10 con 0x7faefc06c760 2023-10-03T19:15:19.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faf008df640 1 -- 172.21.15.45:0/3433002674 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef40a5da0 con 0x7faefc06c760 2023-10-03T19:15:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faf03b45640 1 -- 172.21.15.45:0/3433002674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faefc06c760 msgr2=0x7faefc0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faf03b45640 1 --2- 172.21.15.45:0/3433002674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faefc06c760 0x7faefc0a5ad0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7faef4009d90 tx=0x7faef401c8c0 comp rx=0 tx=0).stop 2023-10-03T19:15:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faf03b45640 1 -- 172.21.15.45:0/3433002674 shutdown_connections 2023-10-03T19:15:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faf03b45640 1 --2- 172.21.15.45:0/3433002674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faefc06c760 0x7faefc0a5ad0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faf03b45640 1 -- 172.21.15.45:0/3433002674 >> 172.21.15.45:0/3433002674 conn(0x7faefc0a20d0 msgr2=0x7faefc0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faf03b45640 1 -- 172.21.15.45:0/3433002674 shutdown_connections 2023-10-03T19:15:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faf03b45640 1 -- 172.21.15.45:0/3433002674 wait complete. 2023-10-03T19:15:19.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faf03b45640 1 Processor -- start 2023-10-03T19:15:19.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faf03b45640 1 -- start start 2023-10-03T19:15:19.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faf03b45640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faefc06c760 0x7faefc14e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:19.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faf03b45640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faefc06d560 0x7faefc1e7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:19.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faf03b45640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faefc0712c0 0x7faefc14bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:19.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faf03b45640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc1e86a0 con 0x7faefc0712c0 2023-10-03T19:15:19.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faf03b45640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc0b7b90 con 0x7faefc06c760 2023-10-03T19:15:19.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faf03b45640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faefc0b67d0 con 0x7faefc06d560 2023-10-03T19:15:19.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faf020e2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faefc0712c0 0x7faefc14bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:19.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faf020e2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faefc0712c0 0x7faefc14bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44700/0 (socket says 172.21.15.45:44700) 2023-10-03T19:15:19.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faf020e2640 1 -- 172.21.15.45:0/2159737431 learned_addr learned my addr 172.21.15.45:0/2159737431 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:19.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faf018e1640 1 --2- 172.21.15.45:0/2159737431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faefc06c760 0x7faefc14e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:19.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faf010e0640 1 --2- 172.21.15.45:0/2159737431 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faefc06d560 0x7faefc1e7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:19.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faf020e2640 1 -- 172.21.15.45:0/2159737431 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faefc06d560 msgr2=0x7faefc1e7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:19.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faf020e2640 1 --2- 172.21.15.45:0/2159737431 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faefc06d560 0x7faefc1e7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:19.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faf020e2640 1 -- 172.21.15.45:0/2159737431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faefc06c760 msgr2=0x7faefc14e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:19.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faf020e2640 1 --2- 172.21.15.45:0/2159737431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faefc06c760 0x7faefc14e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:19.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faf020e2640 1 -- 172.21.15.45:0/2159737431 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef4009a70 con 0x7faefc0712c0 2023-10-03T19:15:19.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faf020e2640 1 --2- 172.21.15.45:0/2159737431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faefc0712c0 0x7faefc14bfc0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7faef401a4f0 tx=0x7faef4019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:19.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.051+0000 7faef27fc640 1 -- 172.21.15.45:0/2159737431 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef4003ba0 con 0x7faefc0712c0 2023-10-03T19:15:19.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.055+0000 7faef27fc640 1 -- 172.21.15.45:0/2159737431 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef4003d00 con 0x7faefc0712c0 2023-10-03T19:15:19.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.055+0000 7faf03b45640 1 -- 172.21.15.45:0/2159737431 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faefc071820 con 0x7faefc0712c0 2023-10-03T19:15:19.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.055+0000 7faef27fc640 1 -- 172.21.15.45:0/2159737431 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef40ad910 con 0x7faefc0712c0 2023-10-03T19:15:19.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.055+0000 7faf03b45640 1 -- 172.21.15.45:0/2159737431 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faefc071690 con 0x7faefc0712c0 2023-10-03T19:15:19.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.055+0000 7faf03b45640 1 -- 172.21.15.45:0/2159737431 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faefc0bd2d0 con 0x7faefc0712c0 2023-10-03T19:15:19.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.055+0000 7faef27fc640 1 -- 172.21.15.45:0/2159737431 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faef40b4070 con 0x7faefc0712c0 2023-10-03T19:15:19.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.055+0000 7faef27fc640 1 --2- 172.21.15.45:0/2159737431 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7faee00662b0 0x7faee0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:19.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.055+0000 7faef27fc640 1 -- 172.21.15.45:0/2159737431 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7faef411e0e0 con 0x7faefc0712c0 2023-10-03T19:15:19.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.055+0000 7faf018e1640 1 --2- 172.21.15.45:0/2159737431 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7faee00662b0 0x7faee0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:19.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.055+0000 7faf018e1640 1 --2- 172.21.15.45:0/2159737431 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7faee00662b0 0x7faee0068760 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faef8000f70 tx=0x7faef8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:19.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.059+0000 7faef27fc640 1 -- 172.21.15.45:0/2159737431 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7faef40eef40 con 0x7faefc0712c0 2023-10-03T19:15:19.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.211+0000 7faf03b45640 1 -- 172.21.15.45:0/2159737431 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faefc04de80 con 0x7faefc0712c0 2023-10-03T19:15:19.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.211+0000 7faef27fc640 1 -- 172.21.15.45:0/2159737431 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7faef40eead0 con 0x7faefc0712c0 2023-10-03T19:15:19.218 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-03T19:15:19.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.215+0000 7faf03b45640 1 -- 172.21.15.45:0/2159737431 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7faee00662b0 msgr2=0x7faee0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:19.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.215+0000 7faf03b45640 1 --2- 172.21.15.45:0/2159737431 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7faee00662b0 0x7faee0068760 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faef8000f70 tx=0x7faef8009040 comp rx=0 tx=0).stop 2023-10-03T19:15:19.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.215+0000 7faf03b45640 1 -- 172.21.15.45:0/2159737431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faefc0712c0 msgr2=0x7faefc14bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:19.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.215+0000 7faf03b45640 1 --2- 172.21.15.45:0/2159737431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faefc0712c0 0x7faefc14bfc0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7faef401a4f0 tx=0x7faef4019660 comp rx=0 tx=0).stop 2023-10-03T19:15:19.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.215+0000 7faf03b45640 1 -- 172.21.15.45:0/2159737431 shutdown_connections 2023-10-03T19:15:19.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.215+0000 7faf03b45640 1 --2- 172.21.15.45:0/2159737431 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7faee00662b0 0x7faee0068760 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:19.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.215+0000 7faf03b45640 1 --2- 172.21.15.45:0/2159737431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faefc0712c0 0x7faefc14bfc0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:19.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.215+0000 7faf03b45640 1 --2- 172.21.15.45:0/2159737431 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faefc06d560 0x7faefc1e7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:19.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.215+0000 7faf03b45640 1 --2- 172.21.15.45:0/2159737431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faefc06c760 0x7faefc14e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:19.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.215+0000 7faf03b45640 1 -- 172.21.15.45:0/2159737431 >> 172.21.15.45:0/2159737431 conn(0x7faefc0a20d0 msgr2=0x7faefc0be010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:19.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.215+0000 7faf03b45640 1 -- 172.21.15.45:0/2159737431 shutdown_connections 2023-10-03T19:15:19.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.215+0000 7faf03b45640 1 -- 172.21.15.45:0/2159737431 wait complete. 2023-10-03T19:15:19.236 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T19:15:19.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa03a394640 1 Processor -- start 2023-10-03T19:15:19.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa03a394640 1 -- start start 2023-10-03T19:15:19.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa03a394640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa03406d560 0x7fa0340a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:19.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa03a394640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa03406c2d0 con 0x7fa0340712c0 2023-10-03T19:15:19.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa03a394640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa034150610 con 0x7fa03406c760 2023-10-03T19:15:19.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa03a394640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0341508b0 con 0x7fa03406d560 2023-10-03T19:15:19.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa033fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa0340712c0 0x7fa0340bcbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43198/0 (socket says 172.21.15.45:43198) 2023-10-03T19:15:19.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa033fff640 1 -- 172.21.15.45:0/3824624275 learned_addr learned my addr 172.21.15.45:0/3824624275 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:15:19.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa0337fe640 1 --2- 172.21.15.45:0/3824624275 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa03406d560 0x7fa0340a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:19.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa032ffd640 1 -- 172.21.15.45:0/3824624275 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2189018791 0 0) 0x7fa03406c2d0 con 0x7fa0340712c0 2023-10-03T19:15:19.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa032ffd640 1 -- 172.21.15.45:0/3824624275 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa01c003530 con 0x7fa0340712c0 2023-10-03T19:15:19.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa032ffd640 1 -- 172.21.15.45:0/3824624275 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2060777849 0 0) 0x7fa01c003530 con 0x7fa0340712c0 2023-10-03T19:15:19.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa032ffd640 1 -- 172.21.15.45:0/3824624275 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa03406d560 msgr2=0x7fa0340a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:19.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa032ffd640 1 --2- 172.21.15.45:0/3824624275 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa03406d560 0x7fa0340a53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:19.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa032ffd640 1 -- 172.21.15.45:0/3824624275 >> v1:172.21.15.79:6789/0 conn(0x7fa03406c760 legacy=0x7fa0340a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:19.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa032ffd640 1 -- 172.21.15.45:0/3824624275 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03406d2e0 con 0x7fa0340712c0 2023-10-03T19:15:19.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa032ffd640 1 -- 172.21.15.45:0/3824624275 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fa024001680 con 0x7fa0340712c0 2023-10-03T19:15:19.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa032ffd640 1 -- 172.21.15.45:0/3824624275 >> v1:172.21.15.45:6789/0 conn(0x7fa0340712c0 legacy=0x7fa0340bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:19.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa032ffd640 1 --2- 172.21.15.45:0/3824624275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa01c0039b0 0x7fa01c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:19.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa032ffd640 1 --2- 172.21.15.45:0/3824624275 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa03406d560 0x7fa01c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:19.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa032ffd640 1 --2- 172.21.15.45:0/3824624275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa01c004d10 0x7fa01c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:19.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa032ffd640 1 -- 172.21.15.45:0/3824624275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0341508b0 con 0x7fa01c004d10 2023-10-03T19:15:19.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa032ffd640 1 -- 172.21.15.45:0/3824624275 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c00ba40 con 0x7fa01c0039b0 2023-10-03T19:15:19.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa032ffd640 1 -- 172.21.15.45:0/3824624275 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c00bbd0 con 0x7fa03406d560 2023-10-03T19:15:19.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa038931640 1 --2- 172.21.15.45:0/3824624275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa01c004d10 0x7fa01c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:19.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa033fff640 1 --2- 172.21.15.45:0/3824624275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa01c0039b0 0x7fa01c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:19.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa0337fe640 1 --2- 172.21.15.45:0/3824624275 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa03406d560 0x7fa01c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:19.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa038931640 1 -- 172.21.15.45:0/3824624275 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa03406d560 msgr2=0x7fa01c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:19.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa038931640 1 --2- 172.21.15.45:0/3824624275 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa03406d560 0x7fa01c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:19.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa038931640 1 -- 172.21.15.45:0/3824624275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa01c0039b0 msgr2=0x7fa01c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:19.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa038931640 1 --2- 172.21.15.45:0/3824624275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa01c0039b0 0x7fa01c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:19.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.355+0000 7fa038931640 1 -- 172.21.15.45:0/3824624275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01c003530 con 0x7fa01c004d10 2023-10-03T19:15:19.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.359+0000 7fa038931640 1 --2- 172.21.15.45:0/3824624275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa01c004d10 0x7fa01c005180 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa02c001e40 tx=0x7fa02c01c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13081e65a7e70f03 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:19.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.359+0000 7fa032ffd640 1 -- 172.21.15.45:0/3824624275 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c003b80 con 0x7fa01c004d10 2023-10-03T19:15:19.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.359+0000 7fa032ffd640 1 -- 172.21.15.45:0/3824624275 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02c003ce0 con 0x7fa01c004d10 2023-10-03T19:15:19.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.359+0000 7fa032ffd640 1 -- 172.21.15.45:0/3824624275 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c0052c0 con 0x7fa01c004d10 2023-10-03T19:15:19.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.359+0000 7fa03a394640 1 -- 172.21.15.45:0/3824624275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa01c004d10 msgr2=0x7fa01c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:19.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.359+0000 7fa03a394640 1 --2- 172.21.15.45:0/3824624275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa01c004d10 0x7fa01c005180 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa02c001e40 tx=0x7fa02c01c740 comp rx=0 tx=0).stop 2023-10-03T19:15:19.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.359+0000 7fa038931640 1 -- 172.21.15.45:0/3824624275 reap_dead start 2023-10-03T19:15:19.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.359+0000 7fa03a394640 1 -- 172.21.15.45:0/3824624275 shutdown_connections 2023-10-03T19:15:19.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.359+0000 7fa03a394640 1 -- 172.21.15.45:0/3824624275 >> 172.21.15.45:0/3824624275 conn(0x7fa0340a20d0 msgr2=0x7fa0340a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:19.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.359+0000 7fa03a394640 1 -- 172.21.15.45:0/3824624275 shutdown_connections 2023-10-03T19:15:19.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.359+0000 7fa03a394640 1 -- 172.21.15.45:0/3824624275 wait complete. 2023-10-03T19:15:19.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.359+0000 7fa03a394640 1 Processor -- start 2023-10-03T19:15:19.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.359+0000 7fa03a394640 1 -- start start 2023-10-03T19:15:19.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.359+0000 7fa03a394640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa01c004d10 0x7fa034143280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:19.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.359+0000 7fa03a394640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa03414e2c0 0x7fa03414bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:19.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.359+0000 7fa03a394640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa03413e7d0 0x7fa03413ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:19.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.359+0000 7fa03a394640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03414cd90 con 0x7fa01c004d10 2023-10-03T19:15:19.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.359+0000 7fa03a394640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03414c080 con 0x7fa03413e7d0 2023-10-03T19:15:19.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.359+0000 7fa03a394640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03414e7c0 con 0x7fa03414e2c0 2023-10-03T19:15:19.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.363+0000 7fa033fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa01c004d10 0x7fa034143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:19.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.363+0000 7fa033fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa01c004d10 0x7fa034143280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44718/0 (socket says 172.21.15.45:44718) 2023-10-03T19:15:19.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.363+0000 7fa033fff640 1 -- 172.21.15.45:0/2785464781 learned_addr learned my addr 172.21.15.45:0/2785464781 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:19.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.363+0000 7fa038931640 1 --2- 172.21.15.45:0/2785464781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa03413e7d0 0x7fa03413ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:19.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.363+0000 7fa0337fe640 1 --2- 172.21.15.45:0/2785464781 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa03414e2c0 0x7fa03414bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:19.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.363+0000 7fa033fff640 1 -- 172.21.15.45:0/2785464781 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa03414e2c0 msgr2=0x7fa03414bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:19.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.363+0000 7fa033fff640 1 --2- 172.21.15.45:0/2785464781 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa03414e2c0 0x7fa03414bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:19.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.363+0000 7fa033fff640 1 -- 172.21.15.45:0/2785464781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa03413e7d0 msgr2=0x7fa03413ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:19.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.363+0000 7fa033fff640 1 --2- 172.21.15.45:0/2785464781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa03413e7d0 0x7fa03413ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:19.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.363+0000 7fa033fff640 1 -- 172.21.15.45:0/2785464781 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03406cf40 con 0x7fa01c004d10 2023-10-03T19:15:19.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.363+0000 7fa0337fe640 1 --2- 172.21.15.45:0/2785464781 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa03414e2c0 0x7fa03414bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:15:19.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.363+0000 7fa033fff640 1 --2- 172.21.15.45:0/2785464781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa01c004d10 0x7fa034143280 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa024001060 tx=0x7fa02400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:19.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.363+0000 7fa030ff9640 1 -- 172.21.15.45:0/2785464781 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa024017070 con 0x7fa01c004d10 2023-10-03T19:15:19.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.363+0000 7fa030ff9640 1 -- 172.21.15.45:0/2785464781 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02400c8d0 con 0x7fa01c004d10 2023-10-03T19:15:19.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.363+0000 7fa030ff9640 1 -- 172.21.15.45:0/2785464781 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02400ca80 con 0x7fa01c004d10 2023-10-03T19:15:19.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.363+0000 7fa03a394640 1 -- 172.21.15.45:0/2785464781 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0340a6010 con 0x7fa01c004d10 2023-10-03T19:15:19.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.363+0000 7fa03a394640 1 -- 172.21.15.45:0/2785464781 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa034071690 con 0x7fa01c004d10 2023-10-03T19:15:19.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.363+0000 7fa03a394640 1 -- 172.21.15.45:0/2785464781 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa03404de80 con 0x7fa01c004d10 2023-10-03T19:15:19.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.363+0000 7fa030ff9640 1 -- 172.21.15.45:0/2785464781 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa02400cbe0 con 0x7fa01c004d10 2023-10-03T19:15:19.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.363+0000 7fa030ff9640 1 --2- 172.21.15.45:0/2785464781 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa020066280 0x7fa020068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:19.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.363+0000 7fa030ff9640 1 -- 172.21.15.45:0/2785464781 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fa0240835f0 con 0x7fa01c004d10 2023-10-03T19:15:19.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.363+0000 7fa0337fe640 1 --2- 172.21.15.45:0/2785464781 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa020066280 0x7fa020068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:19.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.367+0000 7fa0337fe640 1 --2- 172.21.15.45:0/2785464781 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa020066280 0x7fa020068730 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa03414ef30 tx=0x7fa028008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:19.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.367+0000 7fa030ff9640 1 -- 172.21.15.45:0/2785464781 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa024050a50 con 0x7fa01c004d10 2023-10-03T19:15:19.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.515+0000 7fa03a394640 1 -- 172.21.15.45:0/2785464781 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa0340bd9b0 con 0x7fa01c004d10 2023-10-03T19:15:19.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.519+0000 7fa030ff9640 1 -- 172.21.15.45:0/2785464781 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa024054070 con 0x7fa01c004d10 2023-10-03T19:15:19.523 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-03T19:15:19.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.519+0000 7fa03a394640 1 -- 172.21.15.45:0/2785464781 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa020066280 msgr2=0x7fa020068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:19.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.519+0000 7fa03a394640 1 --2- 172.21.15.45:0/2785464781 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa020066280 0x7fa020068730 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa03414ef30 tx=0x7fa028008040 comp rx=0 tx=0).stop 2023-10-03T19:15:19.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.519+0000 7fa03a394640 1 -- 172.21.15.45:0/2785464781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa01c004d10 msgr2=0x7fa034143280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:19.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.519+0000 7fa03a394640 1 --2- 172.21.15.45:0/2785464781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa01c004d10 0x7fa034143280 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa024001060 tx=0x7fa02400ed50 comp rx=0 tx=0).stop 2023-10-03T19:15:19.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.519+0000 7fa03a394640 1 -- 172.21.15.45:0/2785464781 shutdown_connections 2023-10-03T19:15:19.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.519+0000 7fa03a394640 1 --2- 172.21.15.45:0/2785464781 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa020066280 0x7fa020068730 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:19.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.519+0000 7fa03a394640 1 --2- 172.21.15.45:0/2785464781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa03413e7d0 0x7fa03413ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:19.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.519+0000 7fa03a394640 1 --2- 172.21.15.45:0/2785464781 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa03414e2c0 0x7fa03414bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:19.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.519+0000 7fa03a394640 1 --2- 172.21.15.45:0/2785464781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa01c004d10 0x7fa034143280 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:19.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.519+0000 7fa03a394640 1 -- 172.21.15.45:0/2785464781 >> 172.21.15.45:0/2785464781 conn(0x7fa0340a20d0 msgr2=0x7fa0340bfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:19.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.519+0000 7fa03a394640 1 -- 172.21.15.45:0/2785464781 shutdown_connections 2023-10-03T19:15:19.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.519+0000 7fa03a394640 1 -- 172.21.15.45:0/2785464781 wait complete. 2023-10-03T19:15:19.540 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-03T19:15:19.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.659+0000 7fa8041de640 1 Processor -- start 2023-10-03T19:15:19.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.659+0000 7fa8041de640 1 -- start start 2023-10-03T19:15:19.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.659+0000 7fa8041de640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7fc0bcb60 0x7fa7fc06c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:19.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.659+0000 7fa8041de640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa7fc06c7d0 0x7fa7fc155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:19.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.659+0000 7fa8041de640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7fc14b610 con 0x7fa7fc148b90 2023-10-03T19:15:19.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.659+0000 7fa8041de640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7fc0a3670 con 0x7fa7fc06c7d0 2023-10-03T19:15:19.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.659+0000 7fa8041de640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc14b370 con 0x7fa7fc0bcb60 2023-10-03T19:15:19.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.659+0000 7fa80277b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa7fc06c7d0 0x7fa7fc155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:19.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.659+0000 7fa801779640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7fc0bcb60 0x7fa7fc06c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:19.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.659+0000 7fa80277b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa7fc06c7d0 0x7fa7fc155cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:53542/0 (socket says 172.21.15.45:53542) 2023-10-03T19:15:19.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.659+0000 7fa80277b640 1 -- 172.21.15.45:0/2909469447 learned_addr learned my addr 172.21.15.45:0/2909469447 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:19.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.659+0000 7fa801779640 1 -- 172.21.15.45:0/2909469447 >> v2:172.21.15.79:3300/0 conn(0x7fa7fc06c7d0 msgr2=0x7fa7fc155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:19.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.659+0000 7fa801779640 1 --2- 172.21.15.45:0/2909469447 >> v2:172.21.15.79:3300/0 conn(0x7fa7fc06c7d0 0x7fa7fc155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:19.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.659+0000 7fa801779640 1 -- 172.21.15.45:0/2909469447 >> v1:172.21.15.79:6789/0 conn(0x7fa7fc148b90 legacy=0x7fa7fc0bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:19.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.659+0000 7fa801779640 1 -- 172.21.15.45:0/2909469447 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7fc0a5580 con 0x7fa7fc0bcb60 2023-10-03T19:15:19.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.659+0000 7fa80277b640 1 --2- 172.21.15.45:0/2909469447 >> v2:172.21.15.79:3300/0 conn(0x7fa7fc06c7d0 0x7fa7fc155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:15:19.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.663+0000 7fa801779640 1 --2- 172.21.15.45:0/2909469447 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7fc0bcb60 0x7fa7fc06c290 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0097c0 tx=0x7fa7ec01ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38773f79d7f4847c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:19.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.663+0000 7fa800f78640 1 -- 172.21.15.45:0/2909469447 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec0a8970 con 0x7fa7fc0bcb60 2023-10-03T19:15:19.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.663+0000 7fa800f78640 1 -- 172.21.15.45:0/2909469447 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ec0a8ad0 con 0x7fa7fc0bcb60 2023-10-03T19:15:19.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.663+0000 7fa800f78640 1 -- 172.21.15.45:0/2909469447 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec0a8e60 con 0x7fa7fc0bcb60 2023-10-03T19:15:19.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.663+0000 7fa8041de640 1 -- 172.21.15.45:0/2909469447 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7fc0bcb60 msgr2=0x7fa7fc06c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:19.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.663+0000 7fa8041de640 1 --2- 172.21.15.45:0/2909469447 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7fc0bcb60 0x7fa7fc06c290 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0097c0 tx=0x7fa7ec01ec70 comp rx=0 tx=0).stop 2023-10-03T19:15:19.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.663+0000 7fa8041de640 1 -- 172.21.15.45:0/2909469447 shutdown_connections 2023-10-03T19:15:19.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.663+0000 7fa8041de640 1 --2- 172.21.15.45:0/2909469447 >> v2:172.21.15.79:3300/0 conn(0x7fa7fc06c7d0 0x7fa7fc155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:19.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.663+0000 7fa8041de640 1 --2- 172.21.15.45:0/2909469447 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7fc0bcb60 0x7fa7fc06c290 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:19.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.663+0000 7fa8041de640 1 -- 172.21.15.45:0/2909469447 >> 172.21.15.45:0/2909469447 conn(0x7fa7fc0bcf50 msgr2=0x7fa7fc0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:19.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.663+0000 7fa8041de640 1 -- 172.21.15.45:0/2909469447 shutdown_connections 2023-10-03T19:15:19.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.663+0000 7fa8041de640 1 -- 172.21.15.45:0/2909469447 wait complete. 2023-10-03T19:15:19.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.663+0000 7fa8041de640 1 Processor -- start 2023-10-03T19:15:19.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.663+0000 7fa8041de640 1 -- start start 2023-10-03T19:15:19.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.663+0000 7fa8041de640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7fc06c7d0 0x7fa7fc0bf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:19.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.663+0000 7fa8041de640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7fc0bcb60 0x7fa7fc14df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:19.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.663+0000 7fa8041de640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7fc148b90 0x7fa7fc14c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:19.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.663+0000 7fa8041de640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc0bf830 con 0x7fa7fc0bcb60 2023-10-03T19:15:19.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.663+0000 7fa8041de640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc14f840 con 0x7fa7fc06c7d0 2023-10-03T19:15:19.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.663+0000 7fa8041de640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc1d5450 con 0x7fa7fc148b90 2023-10-03T19:15:19.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.663+0000 7fa801779640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7fc0bcb60 0x7fa7fc14df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:19.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.663+0000 7fa801779640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7fc0bcb60 0x7fa7fc14df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44726/0 (socket says 172.21.15.45:44726) 2023-10-03T19:15:19.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.663+0000 7fa801779640 1 -- 172.21.15.45:0/3495680103 learned_addr learned my addr 172.21.15.45:0/3495680103 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:19.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.667+0000 7fa801f7a640 1 --2- 172.21.15.45:0/3495680103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7fc06c7d0 0x7fa7fc0bf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:19.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.667+0000 7fa80277b640 1 --2- 172.21.15.45:0/3495680103 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7fc148b90 0x7fa7fc14c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:19.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.667+0000 7fa801779640 1 -- 172.21.15.45:0/3495680103 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7fc148b90 msgr2=0x7fa7fc14c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:19.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.667+0000 7fa801779640 1 --2- 172.21.15.45:0/3495680103 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7fc148b90 0x7fa7fc14c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:19.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.667+0000 7fa801779640 1 -- 172.21.15.45:0/3495680103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7fc06c7d0 msgr2=0x7fa7fc0bf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:19.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.667+0000 7fa801779640 1 --2- 172.21.15.45:0/3495680103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7fc06c7d0 0x7fa7fc0bf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:19.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.667+0000 7fa801779640 1 -- 172.21.15.45:0/3495680103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f40094d0 con 0x7fa7fc0bcb60 2023-10-03T19:15:19.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.667+0000 7fa801779640 1 --2- 172.21.15.45:0/3495680103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7fc0bcb60 0x7fa7fc14df60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec01c8a0 tx=0x7fa7ec01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:19.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.667+0000 7fa7f27fc640 1 -- 172.21.15.45:0/3495680103 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec0b1e20 con 0x7fa7fc0bcb60 2023-10-03T19:15:19.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.667+0000 7fa7f27fc640 1 -- 172.21.15.45:0/3495680103 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ec0b9410 con 0x7fa7fc0bcb60 2023-10-03T19:15:19.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.667+0000 7fa8041de640 1 -- 172.21.15.45:0/3495680103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ec009420 con 0x7fa7fc0bcb60 2023-10-03T19:15:19.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.667+0000 7fa7f27fc640 1 -- 172.21.15.45:0/3495680103 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec0b97c0 con 0x7fa7fc0bcb60 2023-10-03T19:15:19.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.667+0000 7fa8041de640 1 -- 172.21.15.45:0/3495680103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7fc0bc670 con 0x7fa7fc0bcb60 2023-10-03T19:15:19.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.667+0000 7fa8041de640 1 -- 172.21.15.45:0/3495680103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7fc0a5820 con 0x7fa7fc0bcb60 2023-10-03T19:15:19.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.667+0000 7fa7f27fc640 1 -- 172.21.15.45:0/3495680103 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa7ec0b7040 con 0x7fa7fc0bcb60 2023-10-03T19:15:19.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.667+0000 7fa7f27fc640 1 --2- 172.21.15.45:0/3495680103 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa7e0066280 0x7fa7e0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:19.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.667+0000 7fa7f27fc640 1 -- 172.21.15.45:0/3495680103 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fa7ec121860 con 0x7fa7fc0bcb60 2023-10-03T19:15:19.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.667+0000 7fa801f7a640 1 --2- 172.21.15.45:0/3495680103 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa7e0066280 0x7fa7e0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:19.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.667+0000 7fa801f7a640 1 --2- 172.21.15.45:0/3495680103 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa7e0066280 0x7fa7e0068730 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8001cb0 tx=0x7fa7f8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:19.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.671+0000 7fa7f27fc640 1 -- 172.21.15.45:0/3495680103 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa7ec0eed50 con 0x7fa7fc0bcb60 2023-10-03T19:15:19.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.835+0000 7fa8041de640 1 -- 172.21.15.45:0/3495680103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa7fc148f60 con 0x7fa7fc0bcb60 2023-10-03T19:15:19.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.835+0000 7fa7f27fc640 1 -- 172.21.15.45:0/3495680103 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa7ec0b5080 con 0x7fa7fc0bcb60 2023-10-03T19:15:19.841 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-10-03T19:15:19.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.839+0000 7fa8041de640 1 -- 172.21.15.45:0/3495680103 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa7e0066280 msgr2=0x7fa7e0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:19.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.839+0000 7fa8041de640 1 --2- 172.21.15.45:0/3495680103 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa7e0066280 0x7fa7e0068730 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8001cb0 tx=0x7fa7f8009040 comp rx=0 tx=0).stop 2023-10-03T19:15:19.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.839+0000 7fa8041de640 1 -- 172.21.15.45:0/3495680103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7fc0bcb60 msgr2=0x7fa7fc14df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:19.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.839+0000 7fa8041de640 1 --2- 172.21.15.45:0/3495680103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7fc0bcb60 0x7fa7fc14df60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec01c8a0 tx=0x7fa7ec01ba10 comp rx=0 tx=0).stop 2023-10-03T19:15:19.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.839+0000 7fa8041de640 1 -- 172.21.15.45:0/3495680103 shutdown_connections 2023-10-03T19:15:19.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.839+0000 7fa8041de640 1 --2- 172.21.15.45:0/3495680103 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa7e0066280 0x7fa7e0068730 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:19.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.839+0000 7fa8041de640 1 --2- 172.21.15.45:0/3495680103 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7fc148b90 0x7fa7fc14c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:19.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.839+0000 7fa8041de640 1 --2- 172.21.15.45:0/3495680103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7fc0bcb60 0x7fa7fc14df60 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:19.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.839+0000 7fa8041de640 1 --2- 172.21.15.45:0/3495680103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7fc06c7d0 0x7fa7fc0bf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:19.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.839+0000 7fa8041de640 1 -- 172.21.15.45:0/3495680103 >> 172.21.15.45:0/3495680103 conn(0x7fa7fc0bcf50 msgr2=0x7fa7fc14a380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:19.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.839+0000 7fa8041de640 1 -- 172.21.15.45:0/3495680103 shutdown_connections 2023-10-03T19:15:19.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:19.839+0000 7fa8041de640 1 -- 172.21.15.45:0/3495680103 wait complete. 2023-10-03T19:15:19.858 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi146.front.sepia.ceph.com... 2023-10-03T19:15:19.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:15:19.859 DEBUG:teuthology.orchestra.run.smithi146:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-03T19:15:19.871 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[33217]: fuse finished with error 0 and tester_r 0 2023-10-03T19:15:19.873 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-03T19:15:19.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:15:19.874 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-03T19:15:20.018 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-03T19:15:20.018 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:15:20.024 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336540k,nr_inodes=4084135,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=22607 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-10-03T19:15:20.024 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2023-10-03T19:15:20.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:15:20.024 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-03T19:15:20.073 INFO:teuthology.orchestra.run.smithi172.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-03T19:15:20.073 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T19:15:20.074 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:15:20.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48e1671640 1 Processor -- start 2023-10-03T19:15:20.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48e1671640 1 -- start start 2023-10-03T19:15:20.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48e1671640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48dc148b90 0x7f48dc0bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:20.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48e1671640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48dc14b610 con 0x7f48dc0bcb60 2023-10-03T19:15:20.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48e1671640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48dc0a5580 con 0x7f48dc0bc4a0 2023-10-03T19:15:20.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48e1671640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc0a3670 con 0x7f48dc148b90 2023-10-03T19:15:20.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48da7fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f48dc0bcb60 0x7f48dc06c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43214/0 (socket says 172.21.15.45:43214) 2023-10-03T19:15:20.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48da7fc640 1 -- 172.21.15.45:0/4108084608 learned_addr learned my addr 172.21.15.45:0/4108084608 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:15:20.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48d9ffb640 1 -- 172.21.15.45:0/4108084608 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531899737 0 0) 0x7f48dc14b610 con 0x7f48dc0bcb60 2023-10-03T19:15:20.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48d9ffb640 1 -- 172.21.15.45:0/4108084608 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48c4003530 con 0x7f48dc0bcb60 2023-10-03T19:15:20.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48daffd640 1 --2- 172.21.15.45:0/4108084608 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48dc148b90 0x7f48dc0bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:20.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48d9ffb640 1 -- 172.21.15.45:0/4108084608 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 643705606 0 0) 0x7f48c4003530 con 0x7f48dc0bcb60 2023-10-03T19:15:20.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48d9ffb640 1 -- 172.21.15.45:0/4108084608 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48dc148b90 msgr2=0x7f48dc0bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:20.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48d9ffb640 1 --2- 172.21.15.45:0/4108084608 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48dc148b90 0x7f48dc0bbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:20.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48d9ffb640 1 -- 172.21.15.45:0/4108084608 >> v1:172.21.15.79:6789/0 conn(0x7f48dc0bc4a0 legacy=0x7f48dc06c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:20.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48d9ffb640 1 -- 172.21.15.45:0/4108084608 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48dc0a5820 con 0x7f48dc0bcb60 2023-10-03T19:15:20.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48d9ffb640 1 -- 172.21.15.45:0/4108084608 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f48d0001680 con 0x7f48dc0bcb60 2023-10-03T19:15:20.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48d9ffb640 1 -- 172.21.15.45:0/4108084608 >> v1:172.21.15.45:6789/0 conn(0x7f48dc0bcb60 legacy=0x7f48dc06c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:20.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48d9ffb640 1 --2- 172.21.15.45:0/4108084608 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48dc148b90 0x7f48c40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:20.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48d9ffb640 1 --2- 172.21.15.45:0/4108084608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48c4003fe0 0x7f48c40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:20.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48d9ffb640 1 --2- 172.21.15.45:0/4108084608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48c4004d10 0x7f48c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:20.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48d9ffb640 1 -- 172.21.15.45:0/4108084608 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc0a3670 con 0x7f48c4004d10 2023-10-03T19:15:20.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48d9ffb640 1 -- 172.21.15.45:0/4108084608 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c400bb20 con 0x7f48c4003fe0 2023-10-03T19:15:20.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48d9ffb640 1 -- 172.21.15.45:0/4108084608 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c400bce0 con 0x7f48dc148b90 2023-10-03T19:15:20.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48db7fe640 1 --2- 172.21.15.45:0/4108084608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48c4004d10 0x7f48c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:20.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48daffd640 1 --2- 172.21.15.45:0/4108084608 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48dc148b90 0x7f48c40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:20.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48da7fc640 1 --2- 172.21.15.45:0/4108084608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48c4003fe0 0x7f48c40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:20.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48db7fe640 1 -- 172.21.15.45:0/4108084608 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48dc148b90 msgr2=0x7f48c40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:20.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48db7fe640 1 --2- 172.21.15.45:0/4108084608 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48dc148b90 0x7f48c40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:20.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48db7fe640 1 -- 172.21.15.45:0/4108084608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48c4003fe0 msgr2=0x7f48c40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:20.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48db7fe640 1 --2- 172.21.15.45:0/4108084608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48c4003fe0 0x7f48c40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:20.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.195+0000 7f48db7fe640 1 -- 172.21.15.45:0/4108084608 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c4003530 con 0x7f48c4004d10 2023-10-03T19:15:20.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48db7fe640 1 --2- 172.21.15.45:0/4108084608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48c4004d10 0x7f48c4005180 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f48d4001e40 tx=0x7f48d401c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dac7ee938cf409f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:20.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48d9ffb640 1 -- 172.21.15.45:0/4108084608 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d4003b80 con 0x7f48c4004d10 2023-10-03T19:15:20.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48d9ffb640 1 -- 172.21.15.45:0/4108084608 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d4003ce0 con 0x7f48c4004d10 2023-10-03T19:15:20.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48d9ffb640 1 -- 172.21.15.45:0/4108084608 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d40052c0 con 0x7f48c4004d10 2023-10-03T19:15:20.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48e1671640 1 -- 172.21.15.45:0/4108084608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48c4004d10 msgr2=0x7f48c4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:20.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48e1671640 1 --2- 172.21.15.45:0/4108084608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48c4004d10 0x7f48c4005180 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f48d4001e40 tx=0x7f48d401c740 comp rx=0 tx=0).stop 2023-10-03T19:15:20.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48db7fe640 1 -- 172.21.15.45:0/4108084608 reap_dead start 2023-10-03T19:15:20.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48e1671640 1 -- 172.21.15.45:0/4108084608 shutdown_connections 2023-10-03T19:15:20.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48e1671640 1 -- 172.21.15.45:0/4108084608 >> 172.21.15.45:0/4108084608 conn(0x7f48dc0bcf50 msgr2=0x7f48dc0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:20.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48e1671640 1 -- 172.21.15.45:0/4108084608 shutdown_connections 2023-10-03T19:15:20.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48e1671640 1 -- 172.21.15.45:0/4108084608 wait complete. 2023-10-03T19:15:20.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48e1671640 1 Processor -- start 2023-10-03T19:15:20.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48e1671640 1 -- start start 2023-10-03T19:15:20.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48e1671640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48c4004d10 0x7f48dc14e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:20.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48e1671640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48dc14f5e0 0x7f48dc071440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:20.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48e1671640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48dc1d47a0 0x7f48dc14e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:20.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48e1671640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc1d6fc0 con 0x7f48dc1d47a0 2023-10-03T19:15:20.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48e1671640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc1d5d00 con 0x7f48dc14f5e0 2023-10-03T19:15:20.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48e1671640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc146c80 con 0x7f48c4004d10 2023-10-03T19:15:20.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48db7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48dc1d47a0 0x7f48dc14e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:20.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48db7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48dc1d47a0 0x7f48dc14e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44756/0 (socket says 172.21.15.45:44756) 2023-10-03T19:15:20.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48db7fe640 1 -- 172.21.15.45:0/1227972417 learned_addr learned my addr 172.21.15.45:0/1227972417 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:20.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48da7fc640 1 --2- 172.21.15.45:0/1227972417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48dc14f5e0 0x7f48dc071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:20.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48daffd640 1 --2- 172.21.15.45:0/1227972417 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48c4004d10 0x7f48dc14e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:20.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48db7fe640 1 -- 172.21.15.45:0/1227972417 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48c4004d10 msgr2=0x7f48dc14e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:20.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48db7fe640 1 --2- 172.21.15.45:0/1227972417 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48c4004d10 0x7f48dc14e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:20.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48db7fe640 1 -- 172.21.15.45:0/1227972417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48dc14f5e0 msgr2=0x7f48dc071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:20.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48db7fe640 1 --2- 172.21.15.45:0/1227972417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48dc14f5e0 0x7f48dc071440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:20.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48db7fe640 1 -- 172.21.15.45:0/1227972417 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48dc0a3880 con 0x7f48dc1d47a0 2023-10-03T19:15:20.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48db7fe640 1 --2- 172.21.15.45:0/1227972417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48dc1d47a0 0x7f48dc14e0e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f48d401cc20 tx=0x7f48c4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:20.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48c37fe640 1 -- 172.21.15.45:0/1227972417 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d40012e0 con 0x7f48dc1d47a0 2023-10-03T19:15:20.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48c37fe640 1 -- 172.21.15.45:0/1227972417 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d4005030 con 0x7f48dc1d47a0 2023-10-03T19:15:20.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48e1671640 1 -- 172.21.15.45:0/1227972417 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48dc148f60 con 0x7f48dc1d47a0 2023-10-03T19:15:20.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.199+0000 7f48c37fe640 1 -- 172.21.15.45:0/1227972417 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d40053a0 con 0x7f48dc1d47a0 2023-10-03T19:15:20.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.203+0000 7f48e1671640 1 -- 172.21.15.45:0/1227972417 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48dc0a3c30 con 0x7f48dc1d47a0 2023-10-03T19:15:20.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.203+0000 7f48e1671640 1 -- 172.21.15.45:0/1227972417 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48dc14ee80 con 0x7f48dc1d47a0 2023-10-03T19:15:20.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.203+0000 7f48c37fe640 1 -- 172.21.15.45:0/1227972417 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f48d4005500 con 0x7f48dc1d47a0 2023-10-03T19:15:20.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.203+0000 7f48c37fe640 1 --2- 172.21.15.45:0/1227972417 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f48c80662b0 0x7f48c8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:20.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.203+0000 7f48c37fe640 1 -- 172.21.15.45:0/1227972417 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f48d411d960 con 0x7f48dc1d47a0 2023-10-03T19:15:20.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.203+0000 7f48daffd640 1 --2- 172.21.15.45:0/1227972417 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f48c80662b0 0x7f48c8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:20.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.203+0000 7f48daffd640 1 --2- 172.21.15.45:0/1227972417 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f48c80662b0 0x7f48c8068760 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f48cc00b9b0 tx=0x7f48cc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:20.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.207+0000 7f48c37fe640 1 -- 172.21.15.45:0/1227972417 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f48dc14ee80 con 0x7f48dc1d47a0 2023-10-03T19:15:20.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.387+0000 7f48e1671640 1 -- 172.21.15.45:0/1227972417 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48dc14b3b0 con 0x7f48dc1d47a0 2023-10-03T19:15:20.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.391+0000 7f48c37fe640 1 -- 172.21.15.45:0/1227972417 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+3908 (secure 0 0 0) 0x7f48d40bb020 con 0x7f48dc1d47a0 2023-10-03T19:15:20.396 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:15:20.396 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4727,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/659816428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":659816428},{"type":"v1","addr":"172.21.15.79:6835","nonce":659816428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5073,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3273073650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3273073650},{"type":"v1","addr":"172.21.15.45:6834","nonce":3273073650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:13:21.307600+0000","modified":"2023-10-03T19:13:24.332226+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5076},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5076":{"gid":5076,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/252012936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":252012936},{"type":"v1","addr":"172.21.15.45:6835","nonce":252012936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-03T19:15:20.396 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 15 2023-10-03T19:15:20.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.391+0000 7f48e1671640 1 -- 172.21.15.45:0/1227972417 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f48c80662b0 msgr2=0x7f48c8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:20.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.391+0000 7f48e1671640 1 --2- 172.21.15.45:0/1227972417 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f48c80662b0 0x7f48c8068760 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f48cc00b9b0 tx=0x7f48cc008040 comp rx=0 tx=0).stop 2023-10-03T19:15:20.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.391+0000 7f48e1671640 1 -- 172.21.15.45:0/1227972417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48dc1d47a0 msgr2=0x7f48dc14e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:20.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.391+0000 7f48e1671640 1 --2- 172.21.15.45:0/1227972417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48dc1d47a0 0x7f48dc14e0e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f48d401cc20 tx=0x7f48c4005800 comp rx=0 tx=0).stop 2023-10-03T19:15:20.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.391+0000 7f48e1671640 1 -- 172.21.15.45:0/1227972417 shutdown_connections 2023-10-03T19:15:20.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.391+0000 7f48e1671640 1 --2- 172.21.15.45:0/1227972417 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f48c80662b0 0x7f48c8068760 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:20.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.391+0000 7f48e1671640 1 --2- 172.21.15.45:0/1227972417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48dc1d47a0 0x7f48dc14e0e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:20.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.391+0000 7f48e1671640 1 --2- 172.21.15.45:0/1227972417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48dc14f5e0 0x7f48dc071440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:20.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.391+0000 7f48e1671640 1 --2- 172.21.15.45:0/1227972417 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48c4004d10 0x7f48dc14e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:20.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.391+0000 7f48e1671640 1 -- 172.21.15.45:0/1227972417 >> 172.21.15.45:0/1227972417 conn(0x7f48dc0bcf50 msgr2=0x7f48dc0bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:20.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.391+0000 7f48e1671640 1 -- 172.21.15.45:0/1227972417 shutdown_connections 2023-10-03T19:15:20.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.391+0000 7f48e1671640 1 -- 172.21.15.45:0/1227972417 wait complete. 2023-10-03T19:15:20.414 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:15:20.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.519+0000 7f089e8cb640 1 Processor -- start 2023-10-03T19:15:20.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f089e8cb640 1 -- start start 2023-10-03T19:15:20.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f089e8cb640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f089806d170 0x7f089814d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:20.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f089e8cb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f089806cac0 con 0x7f089806f170 2023-10-03T19:15:20.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f089e8cb640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08980720d0 con 0x7f08980bc8b0 2023-10-03T19:15:20.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f089e8cb640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08980a5ab0 con 0x7f089806d170 2023-10-03T19:15:20.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f0897fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f089806f170 0x7f0898150190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43230/0 (socket says 172.21.15.45:43230) 2023-10-03T19:15:20.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f0897fff640 1 -- 172.21.15.45:0/3606951865 learned_addr learned my addr 172.21.15.45:0/3606951865 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:15:20.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f0896ffd640 1 -- 172.21.15.45:0/3606951865 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955785885 0 0) 0x7f088c001120 con 0x7f089806f170 2023-10-03T19:15:20.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f089ce68640 1 --2- 172.21.15.45:0/3606951865 >> v2:172.21.15.79:3300/0 conn(0x7f089806d170 0x7f089814d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:20.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f0896ffd640 1 -- 172.21.15.45:0/3606951865 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0880003530 con 0x7f089806f170 2023-10-03T19:15:20.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f0896ffd640 1 -- 172.21.15.45:0/3606951865 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3025472499 0 0) 0x7f0880003530 con 0x7f089806f170 2023-10-03T19:15:20.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f0896ffd640 1 -- 172.21.15.45:0/3606951865 >> v2:172.21.15.79:3300/0 conn(0x7f089806d170 msgr2=0x7f089814d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:20.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f0896ffd640 1 --2- 172.21.15.45:0/3606951865 >> v2:172.21.15.79:3300/0 conn(0x7f089806d170 0x7f089814d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:20.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f0896ffd640 1 -- 172.21.15.45:0/3606951865 >> v1:172.21.15.79:6789/0 conn(0x7f08980bc8b0 legacy=0x7f089814ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:20.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f0896ffd640 1 -- 172.21.15.45:0/3606951865 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f089806cd00 con 0x7f089806f170 2023-10-03T19:15:20.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f0896ffd640 1 -- 172.21.15.45:0/3606951865 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f088c001810 con 0x7f089806f170 2023-10-03T19:15:20.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f0896ffd640 1 -- 172.21.15.45:0/3606951865 >> v1:172.21.15.45:6789/0 conn(0x7f089806f170 legacy=0x7f0898150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:20.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f0896ffd640 1 --2- 172.21.15.45:0/3606951865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0880003980 0x7f0880003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:20.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f0896ffd640 1 --2- 172.21.15.45:0/3606951865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08800047d0 0x7f0880004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:20.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f0896ffd640 1 --2- 172.21.15.45:0/3606951865 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0880005180 0x7f088000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:20.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f0896ffd640 1 -- 172.21.15.45:0/3606951865 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08980a5ab0 con 0x7f08800047d0 2023-10-03T19:15:20.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f0896ffd640 1 -- 172.21.15.45:0/3606951865 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088000bfe0 con 0x7f0880003980 2023-10-03T19:15:20.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f0896ffd640 1 -- 172.21.15.45:0/3606951865 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088000c1a0 con 0x7f0880005180 2023-10-03T19:15:20.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f08977fe640 1 --2- 172.21.15.45:0/3606951865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08800047d0 0x7f0880004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:20.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f0897fff640 1 --2- 172.21.15.45:0/3606951865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0880003980 0x7f0880003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:20.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f08977fe640 1 -- 172.21.15.45:0/3606951865 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0880005180 msgr2=0x7f088000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:20.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f08977fe640 1 --2- 172.21.15.45:0/3606951865 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0880005180 0x7f088000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:20.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f08977fe640 1 -- 172.21.15.45:0/3606951865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0880003980 msgr2=0x7f0880003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:20.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f08977fe640 1 --2- 172.21.15.45:0/3606951865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0880003980 0x7f0880003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:20.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f08977fe640 1 -- 172.21.15.45:0/3606951865 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0880003530 con 0x7f08800047d0 2023-10-03T19:15:20.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f089ce68640 1 -- 172.21.15.45:0/3606951865 reap_dead start 2023-10-03T19:15:20.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.523+0000 7f0897fff640 1 --2- 172.21.15.45:0/3606951865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0880003980 0x7f0880003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:15:20.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f08977fe640 1 --2- 172.21.15.45:0/3606951865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08800047d0 0x7f0880004c40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0888001780 tx=0x7f088801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5dfa71d4537d33 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:20.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f0896ffd640 1 -- 172.21.15.45:0/3606951865 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08880052d0 con 0x7f08800047d0 2023-10-03T19:15:20.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f0896ffd640 1 -- 172.21.15.45:0/3606951865 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0888005450 con 0x7f08800047d0 2023-10-03T19:15:20.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f0896ffd640 1 -- 172.21.15.45:0/3606951865 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0888003840 con 0x7f08800047d0 2023-10-03T19:15:20.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f089e8cb640 1 -- 172.21.15.45:0/3606951865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08800047d0 msgr2=0x7f0880004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:20.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f089e8cb640 1 --2- 172.21.15.45:0/3606951865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08800047d0 0x7f0880004c40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0888001780 tx=0x7f088801c400 comp rx=0 tx=0).stop 2023-10-03T19:15:20.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f089e8cb640 1 -- 172.21.15.45:0/3606951865 shutdown_connections 2023-10-03T19:15:20.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f089e8cb640 1 --2- 172.21.15.45:0/3606951865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08800047d0 0x7f0880004c40 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:20.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f089e8cb640 1 -- 172.21.15.45:0/3606951865 >> 172.21.15.45:0/3606951865 conn(0x7f08980bcf50 msgr2=0x7f08980bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:20.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f089e8cb640 1 -- 172.21.15.45:0/3606951865 shutdown_connections 2023-10-03T19:15:20.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f089e8cb640 1 -- 172.21.15.45:0/3606951865 wait complete. 2023-10-03T19:15:20.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f089e8cb640 1 Processor -- start 2023-10-03T19:15:20.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f089e8cb640 1 -- start start 2023-10-03T19:15:20.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f089e8cb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08800047d0 0x7f0898145d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:20.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f089e8cb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0898142a10 0x7f08981418c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:20.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f089e8cb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0898141e00 0x7f08981e49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:20.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f089e8cb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0898149080 con 0x7f08800047d0 2023-10-03T19:15:20.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f089e8cb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08981d56f0 con 0x7f0898142a10 2023-10-03T19:15:20.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f089e8cb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f089814a940 con 0x7f0898141e00 2023-10-03T19:15:20.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f0897fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08800047d0 0x7f0898145d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:20.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f0897fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08800047d0 0x7f0898145d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44778/0 (socket says 172.21.15.45:44778) 2023-10-03T19:15:20.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f0897fff640 1 -- 172.21.15.45:0/3442873678 learned_addr learned my addr 172.21.15.45:0/3442873678 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:20.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f089ce68640 1 --2- 172.21.15.45:0/3442873678 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0898141e00 0x7f08981e49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:20.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f08977fe640 1 --2- 172.21.15.45:0/3442873678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0898142a10 0x7f08981418c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:20.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f0897fff640 1 -- 172.21.15.45:0/3442873678 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0898141e00 msgr2=0x7f08981e49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:20.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f0897fff640 1 --2- 172.21.15.45:0/3442873678 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0898141e00 0x7f08981e49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:20.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f0897fff640 1 -- 172.21.15.45:0/3442873678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0898142a10 msgr2=0x7f08981418c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:20.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f0897fff640 1 --2- 172.21.15.45:0/3442873678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0898142a10 0x7f08981418c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:20.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f0897fff640 1 -- 172.21.15.45:0/3442873678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f089814c4a0 con 0x7f08800047d0 2023-10-03T19:15:20.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f0897fff640 1 --2- 172.21.15.45:0/3442873678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08800047d0 0x7f0898145d60 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f088c000fc0 tx=0x7f088c00dc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:20.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f0894ff9640 1 -- 172.21.15.45:0/3442873678 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c0074e0 con 0x7f08800047d0 2023-10-03T19:15:20.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f0894ff9640 1 -- 172.21.15.45:0/3442873678 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088c007640 con 0x7f08800047d0 2023-10-03T19:15:20.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f0894ff9640 1 -- 172.21.15.45:0/3442873678 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c004a30 con 0x7f08800047d0 2023-10-03T19:15:20.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f089e8cb640 1 -- 172.21.15.45:0/3442873678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f089814fae0 con 0x7f08800047d0 2023-10-03T19:15:20.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.527+0000 7f089e8cb640 1 -- 172.21.15.45:0/3442873678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f089806f540 con 0x7f08800047d0 2023-10-03T19:15:20.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.531+0000 7f089e8cb640 1 -- 172.21.15.45:0/3442873678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f089806d660 con 0x7f08800047d0 2023-10-03T19:15:20.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.531+0000 7f0894ff9640 1 -- 172.21.15.45:0/3442873678 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f088c004b90 con 0x7f08800047d0 2023-10-03T19:15:20.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.531+0000 7f0894ff9640 1 --2- 172.21.15.45:0/3442873678 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0884066280 0x7f0884068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:20.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.531+0000 7f0894ff9640 1 -- 172.21.15.45:0/3442873678 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f088c083700 con 0x7f08800047d0 2023-10-03T19:15:20.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.531+0000 7f08977fe640 1 --2- 172.21.15.45:0/3442873678 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0884066280 0x7f0884068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:20.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.531+0000 7f08977fe640 1 --2- 172.21.15.45:0/3442873678 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0884066280 0x7f0884068730 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0888001750 tx=0x7f08880011a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:20.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.535+0000 7f0894ff9640 1 -- 172.21.15.45:0/3442873678 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f088c050ca0 con 0x7f08800047d0 2023-10-03T19:15:20.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.691+0000 7f089e8cb640 1 -- 172.21.15.45:0/3442873678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f089806cac0 con 0x7f08800047d0 2023-10-03T19:15:20.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.695+0000 7f0894ff9640 1 -- 172.21.15.45:0/3442873678 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18296 (secure 0 0 0) 0x7f089806cac0 con 0x7f08800047d0 2023-10-03T19:15:20.699 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:15:20.700 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":37,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:14:12.706533+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:13:19.206863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-03T19:13:20.283396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.36","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:15:20.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.695+0000 7f089e8cb640 1 -- 172.21.15.45:0/3442873678 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0884066280 msgr2=0x7f0884068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:20.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.695+0000 7f089e8cb640 1 --2- 172.21.15.45:0/3442873678 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0884066280 0x7f0884068730 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0888001750 tx=0x7f08880011a0 comp rx=0 tx=0).stop 2023-10-03T19:15:20.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.695+0000 7f089e8cb640 1 -- 172.21.15.45:0/3442873678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08800047d0 msgr2=0x7f0898145d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:20.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.695+0000 7f089e8cb640 1 --2- 172.21.15.45:0/3442873678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08800047d0 0x7f0898145d60 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f088c000fc0 tx=0x7f088c00dc70 comp rx=0 tx=0).stop 2023-10-03T19:15:20.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.695+0000 7f089e8cb640 1 -- 172.21.15.45:0/3442873678 shutdown_connections 2023-10-03T19:15:20.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.695+0000 7f089e8cb640 1 --2- 172.21.15.45:0/3442873678 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0884066280 0x7f0884068730 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:20.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.695+0000 7f089e8cb640 1 --2- 172.21.15.45:0/3442873678 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0898141e00 0x7f08981e49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:20.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.695+0000 7f089e8cb640 1 --2- 172.21.15.45:0/3442873678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0898142a10 0x7f08981418c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:20.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.695+0000 7f089e8cb640 1 --2- 172.21.15.45:0/3442873678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08800047d0 0x7f0898145d60 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:20.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.695+0000 7f089e8cb640 1 -- 172.21.15.45:0/3442873678 >> 172.21.15.45:0/3442873678 conn(0x7f08980bcf50 msgr2=0x7f089814abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:20.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.695+0000 7f089e8cb640 1 -- 172.21.15.45:0/3442873678 shutdown_connections 2023-10-03T19:15:20.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.695+0000 7f089e8cb640 1 -- 172.21.15.45:0/3442873678 wait complete. 2023-10-03T19:15:20.719 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T19:13:19.206863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T19:13:20.283396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:15:20.719 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:15:20.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.847+0000 7f77b5a87640 1 Processor -- start 2023-10-03T19:15:20.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.847+0000 7f77b5a87640 1 -- start start 2023-10-03T19:15:20.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.847+0000 7f77b5a87640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f77b0152ec0 0x7f77b0069ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:20.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.847+0000 7f77b5a87640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b006b560 con 0x7f77b00bcff0 2023-10-03T19:15:20.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.847+0000 7f77b5a87640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b00bfc90 con 0x7f77b00bd860 2023-10-03T19:15:20.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.847+0000 7f77b5a87640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b00beb70 con 0x7f77b0152ec0 2023-10-03T19:15:20.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.847+0000 7f77affff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f77b00bcff0 0x7f77b006a010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43238/0 (socket says 172.21.15.45:43238) 2023-10-03T19:15:20.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.847+0000 7f77affff640 1 -- 172.21.15.45:0/42318027 learned_addr learned my addr 172.21.15.45:0/42318027 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:15:20.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.847+0000 7f77aeffd640 1 --2- 172.21.15.45:0/42318027 >> v2:172.21.15.45:3300/0 conn(0x7f77b0152ec0 0x7f77b0069ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:20.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.847+0000 7f77aeffd640 1 -- 172.21.15.45:0/42318027 >> v1:172.21.15.79:6789/0 conn(0x7f77b00bd860 legacy=0x7f77b01527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:20.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.847+0000 7f77aeffd640 1 -- 172.21.15.45:0/42318027 >> v1:172.21.15.45:6789/0 conn(0x7f77b00bcff0 legacy=0x7f77b006a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:20.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.847+0000 7f77aeffd640 1 -- 172.21.15.45:0/42318027 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b00a8340 con 0x7f77b0152ec0 2023-10-03T19:15:20.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.847+0000 7f77ae7fc640 1 -- 172.21.15.45:0/42318027 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2574999862 0 0) 0x7f77b006b560 con 0x7f77b00bcff0 2023-10-03T19:15:20.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.851+0000 7f77aeffd640 1 --2- 172.21.15.45:0/42318027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77b0152ec0 0x7f77b0069ad0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f77a40097c0 tx=0x7f77a401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a9c696cdb29ef84 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:20.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.851+0000 7f77ae7fc640 1 -- 172.21.15.45:0/42318027 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a40ac640 con 0x7f77b0152ec0 2023-10-03T19:15:20.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.851+0000 7f77ae7fc640 1 -- 172.21.15.45:0/42318027 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a40ac7a0 con 0x7f77b0152ec0 2023-10-03T19:15:20.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.851+0000 7f77ae7fc640 1 -- 172.21.15.45:0/42318027 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a40acb30 con 0x7f77b0152ec0 2023-10-03T19:15:20.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.851+0000 7f77b5a87640 1 -- 172.21.15.45:0/42318027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77b0152ec0 msgr2=0x7f77b0069ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:20.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.851+0000 7f77b5a87640 1 --2- 172.21.15.45:0/42318027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77b0152ec0 0x7f77b0069ad0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f77a40097c0 tx=0x7f77a401c480 comp rx=0 tx=0).stop 2023-10-03T19:15:20.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.851+0000 7f77b5a87640 1 -- 172.21.15.45:0/42318027 shutdown_connections 2023-10-03T19:15:20.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.851+0000 7f77b5a87640 1 --2- 172.21.15.45:0/42318027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77b0152ec0 0x7f77b0069ad0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:20.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.851+0000 7f77b5a87640 1 -- 172.21.15.45:0/42318027 >> 172.21.15.45:0/42318027 conn(0x7f77b0071060 msgr2=0x7f77b0071460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:20.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.851+0000 7f77b5a87640 1 -- 172.21.15.45:0/42318027 shutdown_connections 2023-10-03T19:15:20.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.851+0000 7f77b5a87640 1 -- 172.21.15.45:0/42318027 wait complete. 2023-10-03T19:15:20.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.851+0000 7f77b5a87640 1 Processor -- start 2023-10-03T19:15:20.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.851+0000 7f77b5a87640 1 -- start start 2023-10-03T19:15:20.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.851+0000 7f77b5a87640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77b00bcff0 0x7f77b00ba650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:20.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.851+0000 7f77b5a87640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77b00bd860 0x7f77b014b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:20.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.851+0000 7f77b5a87640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77b0152ec0 0x7f77b014b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:20.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.851+0000 7f77b5a87640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b006b8d0 con 0x7f77b0152ec0 2023-10-03T19:15:20.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.851+0000 7f77b5a87640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b00b6a90 con 0x7f77b00bd860 2023-10-03T19:15:20.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.851+0000 7f77b5a87640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b00b7840 con 0x7f77b00bcff0 2023-10-03T19:15:20.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.851+0000 7f77affff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77b0152ec0 0x7f77b014b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:20.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.851+0000 7f77affff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77b0152ec0 0x7f77b014b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44800/0 (socket says 172.21.15.45:44800) 2023-10-03T19:15:20.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.851+0000 7f77affff640 1 -- 172.21.15.45:0/4111964051 learned_addr learned my addr 172.21.15.45:0/4111964051 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:20.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.851+0000 7f77aeffd640 1 --2- 172.21.15.45:0/4111964051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77b00bd860 0x7f77b014b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:20.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.851+0000 7f77af7fe640 1 --2- 172.21.15.45:0/4111964051 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77b00bcff0 0x7f77b00ba650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:20.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.851+0000 7f77affff640 1 -- 172.21.15.45:0/4111964051 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77b00bcff0 msgr2=0x7f77b00ba650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:20.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.851+0000 7f77affff640 1 --2- 172.21.15.45:0/4111964051 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77b00bcff0 0x7f77b00ba650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:20.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.851+0000 7f77affff640 1 -- 172.21.15.45:0/4111964051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77b00bd860 msgr2=0x7f77b014b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:20.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.851+0000 7f77affff640 1 --2- 172.21.15.45:0/4111964051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77b00bd860 0x7f77b014b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:20.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.851+0000 7f77affff640 1 -- 172.21.15.45:0/4111964051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a4009420 con 0x7f77b0152ec0 2023-10-03T19:15:20.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.851+0000 7f77affff640 1 --2- 172.21.15.45:0/4111964051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77b0152ec0 0x7f77b014b740 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f77a800c7b0 tx=0x7f77a800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:20.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.855+0000 7f7797fff640 1 -- 172.21.15.45:0/4111964051 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a800a640 con 0x7f77b0152ec0 2023-10-03T19:15:20.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.855+0000 7f7797fff640 1 -- 172.21.15.45:0/4111964051 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a800a7a0 con 0x7f77b0152ec0 2023-10-03T19:15:20.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.855+0000 7f77b5a87640 1 -- 172.21.15.45:0/4111964051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b00bdc30 con 0x7f77b0152ec0 2023-10-03T19:15:20.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.855+0000 7f7797fff640 1 -- 172.21.15.45:0/4111964051 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a800ab90 con 0x7f77b0152ec0 2023-10-03T19:15:20.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.855+0000 7f77b5a87640 1 -- 172.21.15.45:0/4111964051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b0071b70 con 0x7f77b0152ec0 2023-10-03T19:15:20.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.855+0000 7f77b5a87640 1 -- 172.21.15.45:0/4111964051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b00bddc0 con 0x7f77b0152ec0 2023-10-03T19:15:20.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.855+0000 7f7797fff640 1 -- 172.21.15.45:0/4111964051 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f77a800acf0 con 0x7f77b0152ec0 2023-10-03T19:15:20.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.855+0000 7f7797fff640 1 --2- 172.21.15.45:0/4111964051 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f779c0662b0 0x7f779c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:20.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.855+0000 7f7797fff640 1 -- 172.21.15.45:0/4111964051 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f77a80835b0 con 0x7f77b0152ec0 2023-10-03T19:15:20.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.855+0000 7f77af7fe640 1 --2- 172.21.15.45:0/4111964051 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f779c0662b0 0x7f779c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:20.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.855+0000 7f77af7fe640 1 --2- 172.21.15.45:0/4111964051 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f779c0662b0 0x7f779c068760 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f77a0000fc0 tx=0x7f77a0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:20.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:20.859+0000 7f7797fff640 1 -- 172.21.15.45:0/4111964051 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f77a8050a10 con 0x7f77b0152ec0 2023-10-03T19:15:21.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.015+0000 7f77b5a87640 1 -- 172.21.15.45:0/4111964051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f77b00b9500 con 0x7f77b0152ec0 2023-10-03T19:15:21.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.015+0000 7f7797fff640 1 -- 172.21.15.45:0/4111964051 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f77a8054030 con 0x7f77b0152ec0 2023-10-03T19:15:21.020 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:15:21.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.015+0000 7f77b5a87640 1 -- 172.21.15.45:0/4111964051 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f779c0662b0 msgr2=0x7f779c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:21.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.015+0000 7f77b5a87640 1 --2- 172.21.15.45:0/4111964051 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f779c0662b0 0x7f779c068760 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f77a0000fc0 tx=0x7f77a0009040 comp rx=0 tx=0).stop 2023-10-03T19:15:21.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.015+0000 7f77b5a87640 1 -- 172.21.15.45:0/4111964051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77b0152ec0 msgr2=0x7f77b014b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:21.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.015+0000 7f77b5a87640 1 --2- 172.21.15.45:0/4111964051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77b0152ec0 0x7f77b014b740 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f77a800c7b0 tx=0x7f77a800cc70 comp rx=0 tx=0).stop 2023-10-03T19:15:21.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.015+0000 7f77b5a87640 1 -- 172.21.15.45:0/4111964051 shutdown_connections 2023-10-03T19:15:21.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.015+0000 7f77b5a87640 1 --2- 172.21.15.45:0/4111964051 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f779c0662b0 0x7f779c068760 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.015+0000 7f77b5a87640 1 --2- 172.21.15.45:0/4111964051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77b0152ec0 0x7f77b014b740 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.015+0000 7f77b5a87640 1 --2- 172.21.15.45:0/4111964051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77b00bd860 0x7f77b014b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.015+0000 7f77b5a87640 1 --2- 172.21.15.45:0/4111964051 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77b00bcff0 0x7f77b00ba650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.015+0000 7f77b5a87640 1 -- 172.21.15.45:0/4111964051 >> 172.21.15.45:0/4111964051 conn(0x7f77b0071060 msgr2=0x7f77b014e330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:21.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.015+0000 7f77b5a87640 1 -- 172.21.15.45:0/4111964051 shutdown_connections 2023-10-03T19:15:21.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.015+0000 7f77b5a87640 1 -- 172.21.15.45:0/4111964051 wait complete. 2023-10-03T19:15:21.039 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:15:21.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.163+0000 7fbae90d2640 1 Processor -- start 2023-10-03T19:15:21.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.163+0000 7fbae90d2640 1 -- start start 2023-10-03T19:15:21.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.163+0000 7fbae90d2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbae406f880 0x7fbae40a5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:21.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.163+0000 7fbae90d2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbae414f510 0x7fbae414b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:21.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.163+0000 7fbae90d2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbae40bd9f0 0x7fbae414b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:21.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.163+0000 7fbae90d2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae406f3e0 con 0x7fbae406f880 2023-10-03T19:15:21.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.163+0000 7fbae90d2640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae414f080 con 0x7fbae414f510 2023-10-03T19:15:21.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.163+0000 7fbae90d2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae4070e90 con 0x7fbae40bd9f0 2023-10-03T19:15:21.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.163+0000 7fbae2d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbae406f880 0x7fbae40a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:21.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.163+0000 7fbae2d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbae406f880 0x7fbae40a5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44806/0 (socket says 172.21.15.45:44806) 2023-10-03T19:15:21.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.163+0000 7fbae2d9d640 1 -- 172.21.15.45:0/2847331496 learned_addr learned my addr 172.21.15.45:0/2847331496 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:21.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.163+0000 7fbae259c640 1 --2- 172.21.15.45:0/2847331496 >> v2:172.21.15.79:3300/0 conn(0x7fbae414f510 0x7fbae414b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:21.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.163+0000 7fbae359e640 1 --2- 172.21.15.45:0/2847331496 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbae40bd9f0 0x7fbae414b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:21.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.163+0000 7fbae2d9d640 1 -- 172.21.15.45:0/2847331496 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbae40bd9f0 msgr2=0x7fbae414b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:21.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.163+0000 7fbae2d9d640 1 --2- 172.21.15.45:0/2847331496 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbae40bd9f0 0x7fbae414b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.163+0000 7fbae2d9d640 1 -- 172.21.15.45:0/2847331496 >> v2:172.21.15.79:3300/0 conn(0x7fbae414f510 msgr2=0x7fbae414b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:21.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.163+0000 7fbae2d9d640 1 --2- 172.21.15.45:0/2847331496 >> v2:172.21.15.79:3300/0 conn(0x7fbae414f510 0x7fbae414b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.163+0000 7fbae2d9d640 1 -- 172.21.15.45:0/2847331496 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae414ea30 con 0x7fbae406f880 2023-10-03T19:15:21.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.167+0000 7fbae2d9d640 1 --2- 172.21.15.45:0/2847331496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbae406f880 0x7fbae40a5940 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbae40712b0 tx=0x7fbad401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b64f1dc42f1cf07f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:21.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.167+0000 7fbae1d9b640 1 -- 172.21.15.45:0/2847331496 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad40ab5f0 con 0x7fbae406f880 2023-10-03T19:15:21.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.167+0000 7fbae1d9b640 1 -- 172.21.15.45:0/2847331496 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad40ab750 con 0x7fbae406f880 2023-10-03T19:15:21.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.167+0000 7fbae1d9b640 1 -- 172.21.15.45:0/2847331496 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad40abae0 con 0x7fbae406f880 2023-10-03T19:15:21.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.167+0000 7fbae90d2640 1 -- 172.21.15.45:0/2847331496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbae406f880 msgr2=0x7fbae40a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:21.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.167+0000 7fbae90d2640 1 --2- 172.21.15.45:0/2847331496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbae406f880 0x7fbae40a5940 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbae40712b0 tx=0x7fbad401c4d0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.167+0000 7fbae90d2640 1 -- 172.21.15.45:0/2847331496 shutdown_connections 2023-10-03T19:15:21.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.167+0000 7fbae90d2640 1 --2- 172.21.15.45:0/2847331496 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbae40bd9f0 0x7fbae414b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.167+0000 7fbae90d2640 1 --2- 172.21.15.45:0/2847331496 >> v2:172.21.15.79:3300/0 conn(0x7fbae414f510 0x7fbae414b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.167+0000 7fbae90d2640 1 --2- 172.21.15.45:0/2847331496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbae406f880 0x7fbae40a5940 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.167+0000 7fbae90d2640 1 -- 172.21.15.45:0/2847331496 >> 172.21.15.45:0/2847331496 conn(0x7fbae40a20d0 msgr2=0x7fbae40a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:21.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.167+0000 7fbae90d2640 1 -- 172.21.15.45:0/2847331496 shutdown_connections 2023-10-03T19:15:21.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.167+0000 7fbae90d2640 1 -- 172.21.15.45:0/2847331496 wait complete. 2023-10-03T19:15:21.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.167+0000 7fbae90d2640 1 Processor -- start 2023-10-03T19:15:21.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.167+0000 7fbae90d2640 1 -- start start 2023-10-03T19:15:21.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.167+0000 7fbae90d2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbae406f880 0x7fbae4157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:21.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.167+0000 7fbae90d2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbae40bd9f0 0x7fbae4154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:21.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.167+0000 7fbae90d2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbae414f510 0x7fbae40b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:21.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.167+0000 7fbae90d2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae40b5340 con 0x7fbae414f510 2023-10-03T19:15:21.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.167+0000 7fbae90d2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae4154740 con 0x7fbae40bd9f0 2023-10-03T19:15:21.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.167+0000 7fbae90d2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae41eaf30 con 0x7fbae406f880 2023-10-03T19:15:21.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.171+0000 7fbae359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbae414f510 0x7fbae40b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:21.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.171+0000 7fbae359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbae414f510 0x7fbae40b5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44812/0 (socket says 172.21.15.45:44812) 2023-10-03T19:15:21.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.171+0000 7fbae359e640 1 -- 172.21.15.45:0/2706128641 learned_addr learned my addr 172.21.15.45:0/2706128641 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:21.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.171+0000 7fbae2d9d640 1 --2- 172.21.15.45:0/2706128641 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbae406f880 0x7fbae4157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:21.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.171+0000 7fbae259c640 1 --2- 172.21.15.45:0/2706128641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbae40bd9f0 0x7fbae4154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:21.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.171+0000 7fbae359e640 1 -- 172.21.15.45:0/2706128641 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbae406f880 msgr2=0x7fbae4157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:21.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.171+0000 7fbae359e640 1 --2- 172.21.15.45:0/2706128641 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbae406f880 0x7fbae4157870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.171+0000 7fbae359e640 1 -- 172.21.15.45:0/2706128641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbae40bd9f0 msgr2=0x7fbae4154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:21.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.171+0000 7fbae359e640 1 --2- 172.21.15.45:0/2706128641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbae40bd9f0 0x7fbae4154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.171+0000 7fbae359e640 1 -- 172.21.15.45:0/2706128641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad40094d0 con 0x7fbae414f510 2023-10-03T19:15:21.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.171+0000 7fbae259c640 1 --2- 172.21.15.45:0/2706128641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbae40bd9f0 0x7fbae4154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:15:21.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.171+0000 7fbae359e640 1 --2- 172.21.15.45:0/2706128641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbae414f510 0x7fbae40b5ab0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbadc007e40 tx=0x7fbadc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:21.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.171+0000 7fbacb7fe640 1 -- 172.21.15.45:0/2706128641 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc014620 con 0x7fbae414f510 2023-10-03T19:15:21.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.171+0000 7fbacb7fe640 1 -- 172.21.15.45:0/2706128641 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbadc00ee90 con 0x7fbae414f510 2023-10-03T19:15:21.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.171+0000 7fbae90d2640 1 -- 172.21.15.45:0/2706128641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae4070a40 con 0x7fbae414f510 2023-10-03T19:15:21.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.171+0000 7fbacb7fe640 1 -- 172.21.15.45:0/2706128641 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc0149e0 con 0x7fbae414f510 2023-10-03T19:15:21.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.171+0000 7fbae90d2640 1 -- 172.21.15.45:0/2706128641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae406fc50 con 0x7fbae414f510 2023-10-03T19:15:21.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.171+0000 7fbae90d2640 1 -- 172.21.15.45:0/2706128641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae4070bd0 con 0x7fbae414f510 2023-10-03T19:15:21.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.171+0000 7fbacb7fe640 1 -- 172.21.15.45:0/2706128641 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbadc014b40 con 0x7fbae414f510 2023-10-03T19:15:21.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.171+0000 7fbacb7fe640 1 --2- 172.21.15.45:0/2706128641 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbad00662b0 0x7fbad0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:21.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.171+0000 7fbacb7fe640 1 -- 172.21.15.45:0/2706128641 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fbadc084670 con 0x7fbae414f510 2023-10-03T19:15:21.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.171+0000 7fbae2d9d640 1 --2- 172.21.15.45:0/2706128641 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbad00662b0 0x7fbad0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:21.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.175+0000 7fbae2d9d640 1 --2- 172.21.15.45:0/2706128641 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbad00662b0 0x7fbad0068760 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbad40af000 tx=0x7fbad40a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:21.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.175+0000 7fbacb7fe640 1 -- 172.21.15.45:0/2706128641 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbadc051ad0 con 0x7fbae414f510 2023-10-03T19:15:21.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.327+0000 7fbae90d2640 1 -- 172.21.15.45:0/2706128641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbae404de80 con 0x7fbae414f510 2023-10-03T19:15:21.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.331+0000 7fbacb7fe640 1 -- 172.21.15.45:0/2706128641 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbadc0550f0 con 0x7fbae414f510 2023-10-03T19:15:21.335 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:15:21.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.331+0000 7fbae90d2640 1 -- 172.21.15.45:0/2706128641 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbad00662b0 msgr2=0x7fbad0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:21.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.331+0000 7fbae90d2640 1 --2- 172.21.15.45:0/2706128641 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbad00662b0 0x7fbad0068760 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbad40af000 tx=0x7fbad40a7000 comp rx=0 tx=0).stop 2023-10-03T19:15:21.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.331+0000 7fbae90d2640 1 -- 172.21.15.45:0/2706128641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbae414f510 msgr2=0x7fbae40b5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:21.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.331+0000 7fbae90d2640 1 --2- 172.21.15.45:0/2706128641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbae414f510 0x7fbae40b5ab0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbadc007e40 tx=0x7fbadc00e4b0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.331+0000 7fbae90d2640 1 -- 172.21.15.45:0/2706128641 shutdown_connections 2023-10-03T19:15:21.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.331+0000 7fbae90d2640 1 --2- 172.21.15.45:0/2706128641 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbad00662b0 0x7fbad0068760 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.331+0000 7fbae90d2640 1 --2- 172.21.15.45:0/2706128641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbae414f510 0x7fbae40b5ab0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.331+0000 7fbae90d2640 1 --2- 172.21.15.45:0/2706128641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbae40bd9f0 0x7fbae4154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.331+0000 7fbae90d2640 1 --2- 172.21.15.45:0/2706128641 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbae406f880 0x7fbae4157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.331+0000 7fbae90d2640 1 -- 172.21.15.45:0/2706128641 >> 172.21.15.45:0/2706128641 conn(0x7fbae40a20d0 msgr2=0x7fbae40a24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:21.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.331+0000 7fbae90d2640 1 -- 172.21.15.45:0/2706128641 shutdown_connections 2023-10-03T19:15:21.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.331+0000 7fbae90d2640 1 -- 172.21.15.45:0/2706128641 wait complete. 2023-10-03T19:15:21.355 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T19:15:21.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a0e307640 1 Processor -- start 2023-10-03T19:15:21.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a0e307640 1 -- start start 2023-10-03T19:15:21.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a0e307640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5a0806d560 0x7f5a080a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:21.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a0e307640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5a0806c760 0x7f5a080a5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:21.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a0e307640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a0806c2d0 con 0x7f5a080712c0 2023-10-03T19:15:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a0e307640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a08150610 con 0x7f5a0806c760 2023-10-03T19:15:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a0e307640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a081508b0 con 0x7f5a0806d560 2023-10-03T19:15:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a07fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5a080712c0 0x7f5a080bcbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43246/0 (socket says 172.21.15.45:43246) 2023-10-03T19:15:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a07fff640 1 -- 172.21.15.45:0/1200977035 learned_addr learned my addr 172.21.15.45:0/1200977035 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:15:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a0c8a4640 1 --2- 172.21.15.45:0/1200977035 >> v2:172.21.15.79:3300/0 conn(0x7f5a0806c760 0x7f5a080a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a06ffd640 1 -- 172.21.15.45:0/1200977035 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2329370510 0 0) 0x7f5a0806c2d0 con 0x7f5a080712c0 2023-10-03T19:15:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a077fe640 1 --2- 172.21.15.45:0/1200977035 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5a0806d560 0x7f5a080a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a06ffd640 1 -- 172.21.15.45:0/1200977035 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59f4003530 con 0x7f5a080712c0 2023-10-03T19:15:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a06ffd640 1 -- 172.21.15.45:0/1200977035 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2856556831 0 0) 0x7f59f4003530 con 0x7f5a080712c0 2023-10-03T19:15:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a06ffd640 1 -- 172.21.15.45:0/1200977035 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5a0806d560 msgr2=0x7f5a080a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a06ffd640 1 --2- 172.21.15.45:0/1200977035 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5a0806d560 0x7f5a080a53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a06ffd640 1 -- 172.21.15.45:0/1200977035 >> v2:172.21.15.79:3300/0 conn(0x7f5a0806c760 msgr2=0x7f5a080a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:21.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a06ffd640 1 --2- 172.21.15.45:0/1200977035 >> v2:172.21.15.79:3300/0 conn(0x7f5a0806c760 0x7f5a080a5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a06ffd640 1 -- 172.21.15.45:0/1200977035 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0806d2e0 con 0x7f5a080712c0 2023-10-03T19:15:21.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a06ffd640 1 -- 172.21.15.45:0/1200977035 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f59f8001680 con 0x7f5a080712c0 2023-10-03T19:15:21.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a06ffd640 1 -- 172.21.15.45:0/1200977035 >> v1:172.21.15.45:6789/0 conn(0x7f5a080712c0 legacy=0x7f5a080bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:21.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a06ffd640 1 --2- 172.21.15.45:0/1200977035 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59f4003980 0x7f59f4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:21.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a06ffd640 1 --2- 172.21.15.45:0/1200977035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59f40043b0 0x7f59f4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:21.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a06ffd640 1 --2- 172.21.15.45:0/1200977035 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5a0806d560 0x7f59f4004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:21.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a06ffd640 1 -- 172.21.15.45:0/1200977035 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a08150610 con 0x7f59f4003980 2023-10-03T19:15:21.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a06ffd640 1 -- 172.21.15.45:0/1200977035 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a081508b0 con 0x7f59f40043b0 2023-10-03T19:15:21.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a06ffd640 1 -- 172.21.15.45:0/1200977035 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f400b990 con 0x7f5a0806d560 2023-10-03T19:15:21.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a07fff640 1 --2- 172.21.15.45:0/1200977035 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59f4003980 0x7f59f4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:21.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a077fe640 1 --2- 172.21.15.45:0/1200977035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59f40043b0 0x7f59f4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:21.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a0c8a4640 1 --2- 172.21.15.45:0/1200977035 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5a0806d560 0x7f59f4004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:21.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a07fff640 1 -- 172.21.15.45:0/1200977035 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5a0806d560 msgr2=0x7f59f4004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:21.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a07fff640 1 --2- 172.21.15.45:0/1200977035 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5a0806d560 0x7f59f4004f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a07fff640 1 -- 172.21.15.45:0/1200977035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59f40043b0 msgr2=0x7f59f4004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:21.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a07fff640 1 --2- 172.21.15.45:0/1200977035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59f40043b0 0x7f59f4004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.471+0000 7f5a07fff640 1 -- 172.21.15.45:0/1200977035 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f4003530 con 0x7f59f4003980 2023-10-03T19:15:21.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.475+0000 7f5a07fff640 1 --2- 172.21.15.45:0/1200977035 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59f4003980 0x7f59f4003d90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f59f800c290 tx=0x7f59f801cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3617afc441cb1716 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:21.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.475+0000 7f5a06ffd640 1 -- 172.21.15.45:0/1200977035 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f80058e0 con 0x7f59f4003980 2023-10-03T19:15:21.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.475+0000 7f5a06ffd640 1 -- 172.21.15.45:0/1200977035 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f8005a40 con 0x7f59f4003980 2023-10-03T19:15:21.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.475+0000 7f5a06ffd640 1 -- 172.21.15.45:0/1200977035 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f8005df0 con 0x7f59f4003980 2023-10-03T19:15:21.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.475+0000 7f5a0e307640 1 -- 172.21.15.45:0/1200977035 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59f4003980 msgr2=0x7f59f4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:21.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.475+0000 7f5a0e307640 1 --2- 172.21.15.45:0/1200977035 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59f4003980 0x7f59f4003d90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f59f800c290 tx=0x7f59f801cce0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.475+0000 7f5a0c8a4640 1 -- 172.21.15.45:0/1200977035 reap_dead start 2023-10-03T19:15:21.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.475+0000 7f5a0e307640 1 -- 172.21.15.45:0/1200977035 shutdown_connections 2023-10-03T19:15:21.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.475+0000 7f5a0e307640 1 -- 172.21.15.45:0/1200977035 >> 172.21.15.45:0/1200977035 conn(0x7f5a080a20d0 msgr2=0x7f5a080a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:21.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.475+0000 7f5a0e307640 1 -- 172.21.15.45:0/1200977035 shutdown_connections 2023-10-03T19:15:21.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.475+0000 7f5a0e307640 1 -- 172.21.15.45:0/1200977035 wait complete. 2023-10-03T19:15:21.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.475+0000 7f5a0e307640 1 Processor -- start 2023-10-03T19:15:21.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.475+0000 7f5a0e307640 1 -- start start 2023-10-03T19:15:21.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.479+0000 7f5a0e307640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a080b99b0 0x7f5a08143920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:21.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.479+0000 7f5a0e307640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a080bfe70 0x7f5a08143e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:21.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.479+0000 7f5a0e307640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5a081ead10 0x7f5a081eb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:21.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.479+0000 7f5a0e307640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a080bf4a0 con 0x7f5a080bfe70 2023-10-03T19:15:21.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.479+0000 7f5a0e307640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a08070490 con 0x7f5a080b99b0 2023-10-03T19:15:21.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.479+0000 7f5a0e307640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a080bee50 con 0x7f5a081ead10 2023-10-03T19:15:21.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.479+0000 7f5a077fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a080bfe70 0x7f5a08143e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:21.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.479+0000 7f5a077fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a080bfe70 0x7f5a08143e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44828/0 (socket says 172.21.15.45:44828) 2023-10-03T19:15:21.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.479+0000 7f5a077fe640 1 -- 172.21.15.45:0/4179816569 learned_addr learned my addr 172.21.15.45:0/4179816569 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:21.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.479+0000 7f5a07fff640 1 --2- 172.21.15.45:0/4179816569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a080b99b0 0x7f5a08143920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:21.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.479+0000 7f5a0c8a4640 1 --2- 172.21.15.45:0/4179816569 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5a081ead10 0x7f5a081eb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:21.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.479+0000 7f5a077fe640 1 -- 172.21.15.45:0/4179816569 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5a081ead10 msgr2=0x7f5a081eb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:21.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.479+0000 7f5a077fe640 1 --2- 172.21.15.45:0/4179816569 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5a081ead10 0x7f5a081eb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.479+0000 7f5a077fe640 1 -- 172.21.15.45:0/4179816569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a080b99b0 msgr2=0x7f5a08143920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:21.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.479+0000 7f5a077fe640 1 --2- 172.21.15.45:0/4179816569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a080b99b0 0x7f5a08143920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.479+0000 7f5a077fe640 1 -- 172.21.15.45:0/4179816569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a080bd460 con 0x7f5a080bfe70 2023-10-03T19:15:21.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.479+0000 7f5a07fff640 1 --2- 172.21.15.45:0/4179816569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a080b99b0 0x7f5a08143920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:15:21.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.479+0000 7f5a0c8a4640 1 --2- 172.21.15.45:0/4179816569 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5a081ead10 0x7f5a081eb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:15:21.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.479+0000 7f5a077fe640 1 --2- 172.21.15.45:0/4179816569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a080bfe70 0x7f5a08143e60 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f59f0011590 tx=0x7f59f0011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:21.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.479+0000 7f5a04ff9640 1 -- 172.21.15.45:0/4179816569 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f0015930 con 0x7f5a080bfe70 2023-10-03T19:15:21.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.479+0000 7f5a04ff9640 1 -- 172.21.15.45:0/4179816569 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f0015a90 con 0x7f5a080bfe70 2023-10-03T19:15:21.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.479+0000 7f5a0e307640 1 -- 172.21.15.45:0/4179816569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a080bd2d0 con 0x7f5a080bfe70 2023-10-03T19:15:21.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.479+0000 7f5a04ff9640 1 -- 172.21.15.45:0/4179816569 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f0015e20 con 0x7f5a080bfe70 2023-10-03T19:15:21.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.479+0000 7f5a0e307640 1 -- 172.21.15.45:0/4179816569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a081576e0 con 0x7f5a080bfe70 2023-10-03T19:15:21.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.479+0000 7f5a0e307640 1 -- 172.21.15.45:0/4179816569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a080bf650 con 0x7f5a080bfe70 2023-10-03T19:15:21.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.479+0000 7f5a04ff9640 1 -- 172.21.15.45:0/4179816569 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f59f000f460 con 0x7f5a080bfe70 2023-10-03T19:15:21.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.479+0000 7f5a04ff9640 1 --2- 172.21.15.45:0/4179816569 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f59e80662b0 0x7f59e8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:21.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.479+0000 7f5a04ff9640 1 -- 172.21.15.45:0/4179816569 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f59f0084570 con 0x7f5a080bfe70 2023-10-03T19:15:21.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.479+0000 7f5a07fff640 1 --2- 172.21.15.45:0/4179816569 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f59e80662b0 0x7f59e8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:21.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.483+0000 7f5a07fff640 1 --2- 172.21.15.45:0/4179816569 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f59e80662b0 0x7f59e8068760 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f59f80aa000 tx=0x7f59f8001a10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:21.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.483+0000 7f5a04ff9640 1 -- 172.21.15.45:0/4179816569 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5a080bf650 con 0x7f5a080bfe70 2023-10-03T19:15:21.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.639+0000 7f5a0e307640 1 -- 172.21.15.45:0/4179816569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5a080bf650 con 0x7f5a080bfe70 2023-10-03T19:15:21.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.639+0000 7f5a04ff9640 1 -- 172.21.15.45:0/4179816569 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5a080bf650 con 0x7f5a080bfe70 2023-10-03T19:15:21.645 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-03T19:15:21.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.643+0000 7f5a0e307640 1 -- 172.21.15.45:0/4179816569 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f59e80662b0 msgr2=0x7f59e8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:21.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.643+0000 7f5a0e307640 1 --2- 172.21.15.45:0/4179816569 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f59e80662b0 0x7f59e8068760 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f59f80aa000 tx=0x7f59f8001a10 comp rx=0 tx=0).stop 2023-10-03T19:15:21.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.643+0000 7f5a0e307640 1 -- 172.21.15.45:0/4179816569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a080bfe70 msgr2=0x7f5a08143e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:21.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.643+0000 7f5a0e307640 1 --2- 172.21.15.45:0/4179816569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a080bfe70 0x7f5a08143e60 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f59f0011590 tx=0x7f59f0011a50 comp rx=0 tx=0).stop 2023-10-03T19:15:21.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.643+0000 7f5a0e307640 1 -- 172.21.15.45:0/4179816569 shutdown_connections 2023-10-03T19:15:21.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.643+0000 7f5a0e307640 1 --2- 172.21.15.45:0/4179816569 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f59e80662b0 0x7f59e8068760 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.643+0000 7f5a0e307640 1 --2- 172.21.15.45:0/4179816569 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5a081ead10 0x7f5a081eb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.643+0000 7f5a0e307640 1 --2- 172.21.15.45:0/4179816569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a080bfe70 0x7f5a08143e60 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.643+0000 7f5a0e307640 1 --2- 172.21.15.45:0/4179816569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a080b99b0 0x7f5a08143920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.643+0000 7f5a0e307640 1 -- 172.21.15.45:0/4179816569 >> 172.21.15.45:0/4179816569 conn(0x7f5a080a20d0 msgr2=0x7f5a08154ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:21.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.643+0000 7f5a0e307640 1 -- 172.21.15.45:0/4179816569 shutdown_connections 2023-10-03T19:15:21.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.643+0000 7f5a0e307640 1 -- 172.21.15.45:0/4179816569 wait complete. 2023-10-03T19:15:21.664 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T19:15:21.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f590a88f640 1 Processor -- start 2023-10-03T19:15:21.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f590a88f640 1 -- start start 2023-10-03T19:15:21.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f590a88f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5904148840 0x7f5904152100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:21.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f590a88f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59040bbc70 con 0x7f5904148470 2023-10-03T19:15:21.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f590a88f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5904151c20 con 0x7f59040c1770 2023-10-03T19:15:21.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f590a88f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59040c1ed0 con 0x7f5904148840 2023-10-03T19:15:21.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f5903fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5904148470 0x7f59040bc360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43248/0 (socket says 172.21.15.45:43248) 2023-10-03T19:15:21.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f5903fff640 1 -- 172.21.15.45:0/1696997362 learned_addr learned my addr 172.21.15.45:0/1696997362 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:15:21.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f59037fe640 1 --2- 172.21.15.45:0/1696997362 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5904148840 0x7f5904152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:21.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f5902ffd640 1 -- 172.21.15.45:0/1696997362 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1245098445 0 0) 0x7f59040bbc70 con 0x7f5904148470 2023-10-03T19:15:21.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f5902ffd640 1 -- 172.21.15.45:0/1696997362 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58ec003530 con 0x7f5904148470 2023-10-03T19:15:21.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f5902ffd640 1 -- 172.21.15.45:0/1696997362 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3528362834 0 0) 0x7f58ec003530 con 0x7f5904148470 2023-10-03T19:15:21.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f5902ffd640 1 -- 172.21.15.45:0/1696997362 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5904148840 msgr2=0x7f5904152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:21.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f5902ffd640 1 --2- 172.21.15.45:0/1696997362 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5904148840 0x7f5904152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f5902ffd640 1 -- 172.21.15.45:0/1696997362 >> v1:172.21.15.79:6789/0 conn(0x7f59040c1770 legacy=0x7f5904158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:21.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f5902ffd640 1 -- 172.21.15.45:0/1696997362 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59040bb990 con 0x7f5904148470 2023-10-03T19:15:21.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f5902ffd640 1 -- 172.21.15.45:0/1696997362 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f58f4001680 con 0x7f5904148470 2023-10-03T19:15:21.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f59037fe640 1 --2- 172.21.15.45:0/1696997362 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5904148840 0x7f5904152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:15:21.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f5902ffd640 1 -- 172.21.15.45:0/1696997362 >> v1:172.21.15.45:6789/0 conn(0x7f5904148470 legacy=0x7f59040bc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:21.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f5902ffd640 1 --2- 172.21.15.45:0/1696997362 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58ec0039b0 0x7f58ec003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:21.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f5902ffd640 1 --2- 172.21.15.45:0/1696997362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58ec0047d0 0x7f58ec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:21.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f5902ffd640 1 --2- 172.21.15.45:0/1696997362 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5904148840 0x7f58ec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:21.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f5902ffd640 1 -- 172.21.15.45:0/1696997362 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec00bad0 con 0x7f58ec0039b0 2023-10-03T19:15:21.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f5902ffd640 1 -- 172.21.15.45:0/1696997362 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec00bc40 con 0x7f58ec0047d0 2023-10-03T19:15:21.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f5902ffd640 1 -- 172.21.15.45:0/1696997362 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec00be00 con 0x7f5904148840 2023-10-03T19:15:21.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f5903fff640 1 --2- 172.21.15.45:0/1696997362 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58ec0039b0 0x7f58ec003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:21.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f59037fe640 1 --2- 172.21.15.45:0/1696997362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58ec0047d0 0x7f58ec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:21.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f5908e2c640 1 --2- 172.21.15.45:0/1696997362 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5904148840 0x7f58ec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:21.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f5903fff640 1 -- 172.21.15.45:0/1696997362 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5904148840 msgr2=0x7f58ec005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:21.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f5903fff640 1 --2- 172.21.15.45:0/1696997362 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5904148840 0x7f58ec005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f5903fff640 1 -- 172.21.15.45:0/1696997362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58ec0047d0 msgr2=0x7f58ec004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:21.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f5903fff640 1 --2- 172.21.15.45:0/1696997362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58ec0047d0 0x7f58ec004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.787+0000 7f5903fff640 1 -- 172.21.15.45:0/1696997362 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ec003530 con 0x7f58ec0039b0 2023-10-03T19:15:21.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.791+0000 7f5903fff640 1 --2- 172.21.15.45:0/1696997362 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58ec0039b0 0x7f58ec003dc0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f58f400c1c0 tx=0x7f58f401f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82f9806b890a335 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:21.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.791+0000 7f5902ffd640 1 -- 172.21.15.45:0/1696997362 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f4005ae0 con 0x7f58ec0039b0 2023-10-03T19:15:21.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.791+0000 7f5902ffd640 1 -- 172.21.15.45:0/1696997362 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f40ab070 con 0x7f58ec0039b0 2023-10-03T19:15:21.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.791+0000 7f5902ffd640 1 -- 172.21.15.45:0/1696997362 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f4007070 con 0x7f58ec0039b0 2023-10-03T19:15:21.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.791+0000 7f590a88f640 1 -- 172.21.15.45:0/1696997362 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58ec0039b0 msgr2=0x7f58ec003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:21.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.791+0000 7f590a88f640 1 --2- 172.21.15.45:0/1696997362 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58ec0039b0 0x7f58ec003dc0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f58f400c1c0 tx=0x7f58f401f390 comp rx=0 tx=0).stop 2023-10-03T19:15:21.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.791+0000 7f5908e2c640 1 -- 172.21.15.45:0/1696997362 reap_dead start 2023-10-03T19:15:21.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.791+0000 7f590a88f640 1 -- 172.21.15.45:0/1696997362 shutdown_connections 2023-10-03T19:15:21.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.791+0000 7f590a88f640 1 -- 172.21.15.45:0/1696997362 >> 172.21.15.45:0/1696997362 conn(0x7f59040a4260 msgr2=0x7f59040a4660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:21.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.791+0000 7f590a88f640 1 -- 172.21.15.45:0/1696997362 shutdown_connections 2023-10-03T19:15:21.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.791+0000 7f590a88f640 1 -- 172.21.15.45:0/1696997362 wait complete. 2023-10-03T19:15:21.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.791+0000 7f590a88f640 1 Processor -- start 2023-10-03T19:15:21.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.791+0000 7f590a88f640 1 -- start start 2023-10-03T19:15:21.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.795+0000 7f590a88f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58ec0039b0 0x7f59040a2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:21.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.795+0000 7f590a88f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f590414bc50 0x7f590414b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:21.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.795+0000 7f590a88f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f590414b700 0x7f59041e6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:21.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.795+0000 7f590a88f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59040a3bf0 con 0x7f590414b700 2023-10-03T19:15:21.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.795+0000 7f590a88f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59040a5ac0 con 0x7f58ec0039b0 2023-10-03T19:15:21.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.795+0000 7f590a88f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59040a3e00 con 0x7f590414bc50 2023-10-03T19:15:21.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.795+0000 7f5908e2c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f590414b700 0x7f59041e6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:21.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.795+0000 7f5908e2c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f590414b700 0x7f59041e6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44836/0 (socket says 172.21.15.45:44836) 2023-10-03T19:15:21.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.795+0000 7f5908e2c640 1 -- 172.21.15.45:0/1980147888 learned_addr learned my addr 172.21.15.45:0/1980147888 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:21.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.795+0000 7f5903fff640 1 --2- 172.21.15.45:0/1980147888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58ec0039b0 0x7f59040a2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:21.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.795+0000 7f59037fe640 1 --2- 172.21.15.45:0/1980147888 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f590414bc50 0x7f590414b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:21.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.795+0000 7f5908e2c640 1 -- 172.21.15.45:0/1980147888 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f590414bc50 msgr2=0x7f590414b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:21.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.795+0000 7f5908e2c640 1 --2- 172.21.15.45:0/1980147888 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f590414bc50 0x7f590414b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.795+0000 7f5908e2c640 1 -- 172.21.15.45:0/1980147888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58ec0039b0 msgr2=0x7f59040a2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:21.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.795+0000 7f5908e2c640 1 --2- 172.21.15.45:0/1980147888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58ec0039b0 0x7f59040a2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.795+0000 7f5908e2c640 1 -- 172.21.15.45:0/1980147888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59040bca70 con 0x7f590414b700 2023-10-03T19:15:21.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.795+0000 7f5908e2c640 1 --2- 172.21.15.45:0/1980147888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f590414b700 0x7f59041e6890 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5904070e90 tx=0x7f58fc00e840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:21.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.795+0000 7f5900ff9640 1 -- 172.21.15.45:0/1980147888 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc00ed60 con 0x7f590414b700 2023-10-03T19:15:21.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.795+0000 7f5900ff9640 1 -- 172.21.15.45:0/1980147888 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58fc003980 con 0x7f590414b700 2023-10-03T19:15:21.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.795+0000 7f590a88f640 1 -- 172.21.15.45:0/1980147888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5904071ad0 con 0x7f590414b700 2023-10-03T19:15:21.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.795+0000 7f5900ff9640 1 -- 172.21.15.45:0/1980147888 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc00eee0 con 0x7f590414b700 2023-10-03T19:15:21.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.795+0000 7f590a88f640 1 -- 172.21.15.45:0/1980147888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5904071db0 con 0x7f590414b700 2023-10-03T19:15:21.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.795+0000 7f590a88f640 1 -- 172.21.15.45:0/1980147888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f590404de80 con 0x7f590414b700 2023-10-03T19:15:21.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.795+0000 7f5900ff9640 1 -- 172.21.15.45:0/1980147888 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f58fc003d30 con 0x7f590414b700 2023-10-03T19:15:21.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.795+0000 7f5900ff9640 1 --2- 172.21.15.45:0/1980147888 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f58f0066250 0x7f58f0068700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:21.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.795+0000 7f5900ff9640 1 -- 172.21.15.45:0/1980147888 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f58fc082f60 con 0x7f590414b700 2023-10-03T19:15:21.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.795+0000 7f5903fff640 1 --2- 172.21.15.45:0/1980147888 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f58f0066250 0x7f58f0068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:21.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.799+0000 7f5903fff640 1 --2- 172.21.15.45:0/1980147888 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f58f0066250 0x7f58f0068700 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f58f40af000 tx=0x7f58f40aa000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:21.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.799+0000 7f5900ff9640 1 -- 172.21.15.45:0/1980147888 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f58fc053e50 con 0x7f590414b700 2023-10-03T19:15:21.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.955+0000 7f590a88f640 1 -- 172.21.15.45:0/1980147888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f59040a4a40 con 0x7f590414b700 2023-10-03T19:15:21.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.955+0000 7f5900ff9640 1 -- 172.21.15.45:0/1980147888 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f58fc019020 con 0x7f590414b700 2023-10-03T19:15:21.962 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-03T19:15:21.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.959+0000 7f590a88f640 1 -- 172.21.15.45:0/1980147888 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f58f0066250 msgr2=0x7f58f0068700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:21.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.959+0000 7f590a88f640 1 --2- 172.21.15.45:0/1980147888 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f58f0066250 0x7f58f0068700 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f58f40af000 tx=0x7f58f40aa000 comp rx=0 tx=0).stop 2023-10-03T19:15:21.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.959+0000 7f590a88f640 1 -- 172.21.15.45:0/1980147888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f590414b700 msgr2=0x7f59041e6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:21.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.959+0000 7f590a88f640 1 --2- 172.21.15.45:0/1980147888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f590414b700 0x7f59041e6890 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5904070e90 tx=0x7f58fc00e840 comp rx=0 tx=0).stop 2023-10-03T19:15:21.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.959+0000 7f590a88f640 1 -- 172.21.15.45:0/1980147888 shutdown_connections 2023-10-03T19:15:21.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.959+0000 7f590a88f640 1 --2- 172.21.15.45:0/1980147888 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f58f0066250 0x7f58f0068700 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.959+0000 7f590a88f640 1 --2- 172.21.15.45:0/1980147888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f590414b700 0x7f59041e6890 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.959+0000 7f590a88f640 1 --2- 172.21.15.45:0/1980147888 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f590414bc50 0x7f590414b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.959+0000 7f590a88f640 1 --2- 172.21.15.45:0/1980147888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58ec0039b0 0x7f59040a2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:21.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.959+0000 7f590a88f640 1 -- 172.21.15.45:0/1980147888 >> 172.21.15.45:0/1980147888 conn(0x7f59040a4260 msgr2=0x7f590414d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:21.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.959+0000 7f590a88f640 1 -- 172.21.15.45:0/1980147888 shutdown_connections 2023-10-03T19:15:21.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:21.959+0000 7f590a88f640 1 -- 172.21.15.45:0/1980147888 wait complete. 2023-10-03T19:15:21.981 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:15:22.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.091+0000 7f21d6d34640 1 Processor -- start 2023-10-03T19:15:22.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.095+0000 7f21d6d34640 1 -- start start 2023-10-03T19:15:22.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.095+0000 7f21d6d34640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f21d00bcb60 0x7f21d006c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:22.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.095+0000 7f21d6d34640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d014b610 con 0x7f21d0148b90 2023-10-03T19:15:22.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.095+0000 7f21d6d34640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d00a5580 con 0x7f21d006c7d0 2023-10-03T19:15:22.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.095+0000 7f21d6d34640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d00a3670 con 0x7f21d00bcb60 2023-10-03T19:15:22.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.095+0000 7f21d4ad0640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f21d0148b90 0x7f21d00bbf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43262/0 (socket says 172.21.15.45:43262) 2023-10-03T19:15:22.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.095+0000 7f21d4ad0640 1 -- 172.21.15.45:0/1773749855 learned_addr learned my addr 172.21.15.45:0/1773749855 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:15:22.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.095+0000 7f21cffff640 1 --2- 172.21.15.45:0/1773749855 >> v2:172.21.15.45:3300/0 conn(0x7f21d00bcb60 0x7f21d006c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:22.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.095+0000 7f21cffff640 1 -- 172.21.15.45:0/1773749855 >> v1:172.21.15.79:6789/0 conn(0x7f21d006c7d0 legacy=0x7f21d0155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:22.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.095+0000 7f21cffff640 1 -- 172.21.15.45:0/1773749855 >> v1:172.21.15.45:6789/0 conn(0x7f21d0148b90 legacy=0x7f21d00bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:22.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.095+0000 7f21cffff640 1 -- 172.21.15.45:0/1773749855 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d00a5820 con 0x7f21d00bcb60 2023-10-03T19:15:22.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.095+0000 7f21cffff640 1 --2- 172.21.15.45:0/1773749855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21d00bcb60 0x7f21d006c290 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f21c40097c0 tx=0x7f21c401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b318e3d581e4c7a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:22.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21cf7fe640 1 -- 172.21.15.45:0/1773749855 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c40a8970 con 0x7f21d00bcb60 2023-10-03T19:15:22.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21cf7fe640 1 -- 172.21.15.45:0/1773749855 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c40a8ad0 con 0x7f21d00bcb60 2023-10-03T19:15:22.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21cf7fe640 1 -- 172.21.15.45:0/1773749855 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c40a8e60 con 0x7f21d00bcb60 2023-10-03T19:15:22.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21d6d34640 1 -- 172.21.15.45:0/1773749855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21d00bcb60 msgr2=0x7f21d006c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:22.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21d6d34640 1 --2- 172.21.15.45:0/1773749855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21d00bcb60 0x7f21d006c290 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f21c40097c0 tx=0x7f21c401ec70 comp rx=0 tx=0).stop 2023-10-03T19:15:22.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21d6d34640 1 -- 172.21.15.45:0/1773749855 shutdown_connections 2023-10-03T19:15:22.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21d6d34640 1 --2- 172.21.15.45:0/1773749855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21d00bcb60 0x7f21d006c290 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:22.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21d6d34640 1 -- 172.21.15.45:0/1773749855 >> 172.21.15.45:0/1773749855 conn(0x7f21d00bcf50 msgr2=0x7f21d00bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:22.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21d6d34640 1 -- 172.21.15.45:0/1773749855 shutdown_connections 2023-10-03T19:15:22.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21d6d34640 1 -- 172.21.15.45:0/1773749855 wait complete. 2023-10-03T19:15:22.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21d6d34640 1 Processor -- start 2023-10-03T19:15:22.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21d6d34640 1 -- start start 2023-10-03T19:15:22.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21d6d34640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21d006c7d0 0x7f21d00b98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:22.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21d6d34640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21d00bcb60 0x7f21d00710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:22.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21d6d34640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21d0148b90 0x7f21d0071600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:22.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21d6d34640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d0144de0 con 0x7f21d00bcb60 2023-10-03T19:15:22.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21d6d34640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d0071b40 con 0x7f21d006c7d0 2023-10-03T19:15:22.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21d6d34640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d01e78a0 con 0x7f21d0148b90 2023-10-03T19:15:22.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21cffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21d00bcb60 0x7f21d00710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:22.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21cffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21d00bcb60 0x7f21d00710c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44858/0 (socket says 172.21.15.45:44858) 2023-10-03T19:15:22.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21cffff640 1 -- 172.21.15.45:0/888741482 learned_addr learned my addr 172.21.15.45:0/888741482 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:22.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21d4ad0640 1 --2- 172.21.15.45:0/888741482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21d006c7d0 0x7f21d00b98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:22.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21d52d1640 1 --2- 172.21.15.45:0/888741482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21d0148b90 0x7f21d0071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:22.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21cffff640 1 -- 172.21.15.45:0/888741482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21d0148b90 msgr2=0x7f21d0071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:22.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21cffff640 1 --2- 172.21.15.45:0/888741482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21d0148b90 0x7f21d0071600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:22.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21cffff640 1 -- 172.21.15.45:0/888741482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21d006c7d0 msgr2=0x7f21d00b98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:22.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21cffff640 1 --2- 172.21.15.45:0/888741482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21d006c7d0 0x7f21d00b98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:22.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21cffff640 1 -- 172.21.15.45:0/888741482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c4009420 con 0x7f21d00bcb60 2023-10-03T19:15:22.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21d52d1640 1 --2- 172.21.15.45:0/888741482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21d0148b90 0x7f21d0071600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:15:22.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21cffff640 1 --2- 172.21.15.45:0/888741482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21d00bcb60 0x7f21d00710c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f21c401b880 tx=0x7f21c401ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:22.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21cd7fa640 1 -- 172.21.15.45:0/888741482 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c40bf070 con 0x7f21d00bcb60 2023-10-03T19:15:22.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21cd7fa640 1 -- 172.21.15.45:0/888741482 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c40b0c60 con 0x7f21d00bcb60 2023-10-03T19:15:22.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21d6d34640 1 -- 172.21.15.45:0/888741482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d0148f60 con 0x7f21d00bcb60 2023-10-03T19:15:22.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21cd7fa640 1 -- 172.21.15.45:0/888741482 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c40b9400 con 0x7f21d00bcb60 2023-10-03T19:15:22.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.099+0000 7f21d6d34640 1 -- 172.21.15.45:0/888741482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d00bc670 con 0x7f21d00bcb60 2023-10-03T19:15:22.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.103+0000 7f21d6d34640 1 -- 172.21.15.45:0/888741482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d00a3880 con 0x7f21d00bcb60 2023-10-03T19:15:22.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.103+0000 7f21cd7fa640 1 -- 172.21.15.45:0/888741482 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f21c40b7040 con 0x7f21d00bcb60 2023-10-03T19:15:22.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.103+0000 7f21cd7fa640 1 --2- 172.21.15.45:0/888741482 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f21bc066280 0x7f21bc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:22.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.103+0000 7f21cd7fa640 1 -- 172.21.15.45:0/888741482 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f21c4121190 con 0x7f21d00bcb60 2023-10-03T19:15:22.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.103+0000 7f21d4ad0640 1 --2- 172.21.15.45:0/888741482 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f21bc066280 0x7f21bc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:22.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.103+0000 7f21d4ad0640 1 --2- 172.21.15.45:0/888741482 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f21bc066280 0x7f21bc068730 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f21c0005890 tx=0x7f21c0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:22.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.107+0000 7f21cd7fa640 1 -- 172.21.15.45:0/888741482 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f21c40ee680 con 0x7f21d00bcb60 2023-10-03T19:15:22.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.295+0000 7f21d6d34640 1 -- 172.21.15.45:0/888741482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21d01e7700 con 0x7f21d00bcb60 2023-10-03T19:15:22.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.295+0000 7f21cd7fa640 1 -- 172.21.15.45:0/888741482 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+3908 (secure 0 0 0) 0x7f21d01e7700 con 0x7f21d00bcb60 2023-10-03T19:15:22.301 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:15:22.301 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4727,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/659816428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":659816428},{"type":"v1","addr":"172.21.15.79:6835","nonce":659816428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5073,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3273073650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3273073650},{"type":"v1","addr":"172.21.15.45:6834","nonce":3273073650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:13:21.307600+0000","modified":"2023-10-03T19:13:24.332226+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5076},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5076":{"gid":5076,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/252012936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":252012936},{"type":"v1","addr":"172.21.15.45:6835","nonce":252012936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-03T19:15:22.301 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 15 2023-10-03T19:15:22.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.295+0000 7f21d6d34640 1 -- 172.21.15.45:0/888741482 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f21bc066280 msgr2=0x7f21bc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:22.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.295+0000 7f21d6d34640 1 --2- 172.21.15.45:0/888741482 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f21bc066280 0x7f21bc068730 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f21c0005890 tx=0x7f21c0009040 comp rx=0 tx=0).stop 2023-10-03T19:15:22.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.295+0000 7f21d6d34640 1 -- 172.21.15.45:0/888741482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21d00bcb60 msgr2=0x7f21d00710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:22.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.295+0000 7f21d6d34640 1 --2- 172.21.15.45:0/888741482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21d00bcb60 0x7f21d00710c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f21c401b880 tx=0x7f21c401ba10 comp rx=0 tx=0).stop 2023-10-03T19:15:22.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.299+0000 7f21d6d34640 1 -- 172.21.15.45:0/888741482 shutdown_connections 2023-10-03T19:15:22.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.299+0000 7f21d6d34640 1 --2- 172.21.15.45:0/888741482 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f21bc066280 0x7f21bc068730 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:22.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.299+0000 7f21d6d34640 1 --2- 172.21.15.45:0/888741482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21d0148b90 0x7f21d0071600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:22.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.299+0000 7f21d6d34640 1 --2- 172.21.15.45:0/888741482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21d00bcb60 0x7f21d00710c0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:22.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.299+0000 7f21d6d34640 1 --2- 172.21.15.45:0/888741482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21d006c7d0 0x7f21d00b98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:22.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.299+0000 7f21d6d34640 1 -- 172.21.15.45:0/888741482 >> 172.21.15.45:0/888741482 conn(0x7f21d00bcf50 msgr2=0x7f21d00bf390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:22.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.299+0000 7f21d6d34640 1 -- 172.21.15.45:0/888741482 shutdown_connections 2023-10-03T19:15:22.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.299+0000 7f21d6d34640 1 -- 172.21.15.45:0/888741482 wait complete. 2023-10-03T19:15:22.319 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:15:22.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.439+0000 7fa9bb4a6640 1 Processor -- start 2023-10-03T19:15:22.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.439+0000 7fa9bb4a6640 1 -- start start 2023-10-03T19:15:22.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.439+0000 7fa9bb4a6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa9b40bf370 0x7fa9b4149760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:22.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.439+0000 7fa9bb4a6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa9b40a7100 0x7fa9b4149ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:22.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.439+0000 7fa9bb4a6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa9b406f5f0 0x7fa9b414cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:22.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.439+0000 7fa9bb4a6640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9b40bebc0 con 0x7fa9b40a7100 2023-10-03T19:15:22.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.439+0000 7fa9bb4a6640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9b414c770 con 0x7fa9b40bf370 2023-10-03T19:15:22.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.439+0000 7fa9bb4a6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b406efe0 con 0x7fa9b406f5f0 2023-10-03T19:15:22.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.439+0000 7fa9b8a41640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa9b40a7100 0x7fa9b4149ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:22.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.439+0000 7fa9b8a41640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa9b40a7100 0x7fa9b4149ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44868/0 (socket says 172.21.15.45:44868) 2023-10-03T19:15:22.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.439+0000 7fa9b8a41640 1 -- 172.21.15.45:0/543851072 learned_addr learned my addr 172.21.15.45:0/543851072 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:22.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.439+0000 7fa9b9242640 1 --2- 172.21.15.45:0/543851072 >> v2:172.21.15.79:3300/0 conn(0x7fa9b40bf370 0x7fa9b4149760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:22.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.439+0000 7fa9b9a43640 1 --2- 172.21.15.45:0/543851072 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa9b406f5f0 0x7fa9b414cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:22.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.439+0000 7fa9b8a41640 1 -- 172.21.15.45:0/543851072 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa9b406f5f0 msgr2=0x7fa9b414cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:22.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.439+0000 7fa9b8a41640 1 --2- 172.21.15.45:0/543851072 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa9b406f5f0 0x7fa9b414cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:22.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.439+0000 7fa9b8a41640 1 -- 172.21.15.45:0/543851072 >> v2:172.21.15.79:3300/0 conn(0x7fa9b40bf370 msgr2=0x7fa9b4149760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:22.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.439+0000 7fa9b8a41640 1 --2- 172.21.15.45:0/543851072 >> v2:172.21.15.79:3300/0 conn(0x7fa9b40bf370 0x7fa9b4149760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:22.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.439+0000 7fa9b8a41640 1 -- 172.21.15.45:0/543851072 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b406f2c0 con 0x7fa9b40a7100 2023-10-03T19:15:22.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.439+0000 7fa9b9242640 1 --2- 172.21.15.45:0/543851072 >> v2:172.21.15.79:3300/0 conn(0x7fa9b40bf370 0x7fa9b4149760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:15:22.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.443+0000 7fa9b8a41640 1 --2- 172.21.15.45:0/543851072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9b40a7100 0x7fa9b4149ca0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa9b406ebb0 tx=0x7fa9a401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc92d37be4ad0896 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:22.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.443+0000 7fa9abfff640 1 -- 172.21.15.45:0/543851072 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a40ab5f0 con 0x7fa9b40a7100 2023-10-03T19:15:22.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.443+0000 7fa9abfff640 1 -- 172.21.15.45:0/543851072 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a40ab750 con 0x7fa9b40a7100 2023-10-03T19:15:22.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.443+0000 7fa9abfff640 1 -- 172.21.15.45:0/543851072 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a40abae0 con 0x7fa9b40a7100 2023-10-03T19:15:22.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.443+0000 7fa9bb4a6640 1 -- 172.21.15.45:0/543851072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9b40a7100 msgr2=0x7fa9b4149ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:22.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.443+0000 7fa9bb4a6640 1 --2- 172.21.15.45:0/543851072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9b40a7100 0x7fa9b4149ca0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa9b406ebb0 tx=0x7fa9a401c470 comp rx=0 tx=0).stop 2023-10-03T19:15:22.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.443+0000 7fa9bb4a6640 1 -- 172.21.15.45:0/543851072 shutdown_connections 2023-10-03T19:15:22.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.443+0000 7fa9bb4a6640 1 --2- 172.21.15.45:0/543851072 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa9b406f5f0 0x7fa9b414cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:22.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.443+0000 7fa9bb4a6640 1 --2- 172.21.15.45:0/543851072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9b40a7100 0x7fa9b4149ca0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:22.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.443+0000 7fa9bb4a6640 1 --2- 172.21.15.45:0/543851072 >> v2:172.21.15.79:3300/0 conn(0x7fa9b40bf370 0x7fa9b4149760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:22.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.443+0000 7fa9bb4a6640 1 -- 172.21.15.45:0/543851072 >> 172.21.15.45:0/543851072 conn(0x7fa9b406bce0 msgr2=0x7fa9b406c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:22.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.443+0000 7fa9bb4a6640 1 -- 172.21.15.45:0/543851072 shutdown_connections 2023-10-03T19:15:22.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.443+0000 7fa9bb4a6640 1 -- 172.21.15.45:0/543851072 wait complete. 2023-10-03T19:15:22.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.443+0000 7fa9bb4a6640 1 Processor -- start 2023-10-03T19:15:22.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.443+0000 7fa9bb4a6640 1 -- start start 2023-10-03T19:15:22.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.447+0000 7fa9bb4a6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa9b406f5f0 0x7fa9b41428f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:22.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.447+0000 7fa9bb4a6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9b40a7100 0x7fa9b4148f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:22.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.447+0000 7fa9bb4a6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9b40bf370 0x7fa9b4147330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:22.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.447+0000 7fa9bb4a6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b4147870 con 0x7fa9b40a7100 2023-10-03T19:15:22.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.447+0000 7fa9bb4a6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b41497d0 con 0x7fa9b40bf370 2023-10-03T19:15:22.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.447+0000 7fa9bb4a6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b4149ab0 con 0x7fa9b406f5f0 2023-10-03T19:15:22.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.447+0000 7fa9b8a41640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9b40a7100 0x7fa9b4148f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:22.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.447+0000 7fa9b8a41640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9b40a7100 0x7fa9b4148f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44876/0 (socket says 172.21.15.45:44876) 2023-10-03T19:15:22.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.447+0000 7fa9b8a41640 1 -- 172.21.15.45:0/1469364821 learned_addr learned my addr 172.21.15.45:0/1469364821 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:22.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.447+0000 7fa9b9a43640 1 --2- 172.21.15.45:0/1469364821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9b40bf370 0x7fa9b4147330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:22.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.447+0000 7fa9b9242640 1 --2- 172.21.15.45:0/1469364821 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa9b406f5f0 0x7fa9b41428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:22.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.447+0000 7fa9b8a41640 1 -- 172.21.15.45:0/1469364821 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa9b406f5f0 msgr2=0x7fa9b41428f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:22.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.447+0000 7fa9b8a41640 1 --2- 172.21.15.45:0/1469364821 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa9b406f5f0 0x7fa9b41428f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:22.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.447+0000 7fa9b8a41640 1 -- 172.21.15.45:0/1469364821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9b40bf370 msgr2=0x7fa9b4147330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:22.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.447+0000 7fa9b8a41640 1 --2- 172.21.15.45:0/1469364821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9b40bf370 0x7fa9b4147330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:22.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.447+0000 7fa9b8a41640 1 -- 172.21.15.45:0/1469364821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a40094d0 con 0x7fa9b40a7100 2023-10-03T19:15:22.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.447+0000 7fa9b9242640 1 --2- 172.21.15.45:0/1469364821 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa9b406f5f0 0x7fa9b41428f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:15:22.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.447+0000 7fa9b8a41640 1 --2- 172.21.15.45:0/1469364821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9b40a7100 0x7fa9b4148f60 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa9a401ab20 tx=0x7fa9a401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:22.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.447+0000 7fa9a9ffb640 1 -- 172.21.15.45:0/1469364821 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a40be5f0 con 0x7fa9b40a7100 2023-10-03T19:15:22.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.447+0000 7fa9a9ffb640 1 -- 172.21.15.45:0/1469364821 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a40be750 con 0x7fa9b40a7100 2023-10-03T19:15:22.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.447+0000 7fa9a9ffb640 1 -- 172.21.15.45:0/1469364821 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a40beb00 con 0x7fa9b40a7100 2023-10-03T19:15:22.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.447+0000 7fa9bb4a6640 1 -- 172.21.15.45:0/1469364821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b40bf8d0 con 0x7fa9b40a7100 2023-10-03T19:15:22.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.447+0000 7fa9bb4a6640 1 -- 172.21.15.45:0/1469364821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b40bf740 con 0x7fa9b40a7100 2023-10-03T19:15:22.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.447+0000 7fa9bb4a6640 1 -- 172.21.15.45:0/1469364821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b41494a0 con 0x7fa9b40a7100 2023-10-03T19:15:22.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.447+0000 7fa9a9ffb640 1 -- 172.21.15.45:0/1469364821 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa9a40b43f0 con 0x7fa9b40a7100 2023-10-03T19:15:22.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.447+0000 7fa9a9ffb640 1 --2- 172.21.15.45:0/1469364821 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa998066280 0x7fa998068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:22.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.447+0000 7fa9a9ffb640 1 -- 172.21.15.45:0/1469364821 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fa9a40a8050 con 0x7fa9b40a7100 2023-10-03T19:15:22.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.447+0000 7fa9b9242640 1 --2- 172.21.15.45:0/1469364821 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa998066280 0x7fa998068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:22.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.451+0000 7fa9b9242640 1 --2- 172.21.15.45:0/1469364821 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa998066280 0x7fa998068730 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa9b00097a0 tx=0x7fa9b0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:22.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.451+0000 7fa9a9ffb640 1 -- 172.21.15.45:0/1469364821 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa9a40ebf50 con 0x7fa9b40a7100 2023-10-03T19:15:22.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.607+0000 7fa9bb4a6640 1 -- 172.21.15.45:0/1469364821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9b4071930 con 0x7fa9b40a7100 2023-10-03T19:15:22.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.611+0000 7fa9a9ffb640 1 -- 172.21.15.45:0/1469364821 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18296 (secure 0 0 0) 0x7fa9a40ef570 con 0x7fa9b40a7100 2023-10-03T19:15:22.618 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:15:22.618 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":37,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:14:12.706533+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:13:19.206863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-03T19:13:20.283396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.36","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:15:22.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.615+0000 7fa9bb4a6640 1 -- 172.21.15.45:0/1469364821 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa998066280 msgr2=0x7fa998068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:22.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.615+0000 7fa9bb4a6640 1 --2- 172.21.15.45:0/1469364821 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa998066280 0x7fa998068730 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa9b00097a0 tx=0x7fa9b0008040 comp rx=0 tx=0).stop 2023-10-03T19:15:22.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.615+0000 7fa9bb4a6640 1 -- 172.21.15.45:0/1469364821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9b40a7100 msgr2=0x7fa9b4148f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:22.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.615+0000 7fa9bb4a6640 1 --2- 172.21.15.45:0/1469364821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9b40a7100 0x7fa9b4148f60 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa9a401ab20 tx=0x7fa9a401acb0 comp rx=0 tx=0).stop 2023-10-03T19:15:22.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.615+0000 7fa9bb4a6640 1 -- 172.21.15.45:0/1469364821 shutdown_connections 2023-10-03T19:15:22.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.615+0000 7fa9bb4a6640 1 --2- 172.21.15.45:0/1469364821 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa998066280 0x7fa998068730 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:22.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.615+0000 7fa9bb4a6640 1 --2- 172.21.15.45:0/1469364821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9b40bf370 0x7fa9b4147330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:22.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.615+0000 7fa9bb4a6640 1 --2- 172.21.15.45:0/1469364821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9b40a7100 0x7fa9b4148f60 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:22.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.615+0000 7fa9bb4a6640 1 --2- 172.21.15.45:0/1469364821 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa9b406f5f0 0x7fa9b41428f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:22.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.615+0000 7fa9bb4a6640 1 -- 172.21.15.45:0/1469364821 >> 172.21.15.45:0/1469364821 conn(0x7fa9b406bce0 msgr2=0x7fa9b4145660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:22.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.615+0000 7fa9bb4a6640 1 -- 172.21.15.45:0/1469364821 shutdown_connections 2023-10-03T19:15:22.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.615+0000 7fa9bb4a6640 1 -- 172.21.15.45:0/1469364821 wait complete. 2023-10-03T19:15:22.637 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-03T19:15:22.638 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:15:22.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.759+0000 7f594db0a640 1 Processor -- start 2023-10-03T19:15:22.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.763+0000 7f594db0a640 1 -- start start 2023-10-03T19:15:22.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.763+0000 7f594db0a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f594806f170 0x7f5948150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:22.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.763+0000 7f594db0a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f594806d170 0x7f594814d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:22.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.763+0000 7f594db0a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f594806cac0 con 0x7f59480bc8b0 2023-10-03T19:15:22.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.763+0000 7f594db0a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59480720d0 con 0x7f594806d170 2023-10-03T19:15:22.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.763+0000 7f594db0a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59480a5ab0 con 0x7f594806f170 2023-10-03T19:15:22.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.763+0000 7f5947fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f594806d170 0x7f594814d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:22.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.763+0000 7f59477fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f594806f170 0x7f5948150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:22.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.763+0000 7f5947fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f594806d170 0x7f594814d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:53680/0 (socket says 172.21.15.45:53680) 2023-10-03T19:15:22.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.763+0000 7f59477fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f594806f170 0x7f5948150190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:40300/0 (socket says 172.21.15.45:40300) 2023-10-03T19:15:22.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.763+0000 7f5946ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f59480bc8b0 0x7f594814ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:50482/0 (socket says 172.21.15.45:50482) 2023-10-03T19:15:22.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.763+0000 7f5947fff640 1 -- 172.21.15.45:0/3601646861 learned_addr learned my addr 172.21.15.45:0/3601646861 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:22.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.763+0000 7f5947fff640 1 -- 172.21.15.45:0/3601646861 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f594806f170 msgr2=0x7f5948150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:22.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.763+0000 7f5947fff640 1 --2- 172.21.15.45:0/3601646861 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f594806f170 0x7f5948150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:22.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.763+0000 7f5947fff640 1 -- 172.21.15.45:0/3601646861 >> v1:172.21.15.79:6789/0 conn(0x7f59480bc8b0 legacy=0x7f594814ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:22.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.763+0000 7f5947fff640 1 -- 172.21.15.45:0/3601646861 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f594806cd00 con 0x7f594806d170 2023-10-03T19:15:22.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.763+0000 7f59477fe640 1 --2- 172.21.15.45:0/3601646861 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f594806f170 0x7f5948150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:15:22.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f5947fff640 1 --2- 172.21.15.45:0/3601646861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f594806d170 0x7f594814d180 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5940009e50 tx=0x7f594001c9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51114e6dca244f8d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:22.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f59467fc640 1 -- 172.21.15.45:0/3601646861 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59400a57f0 con 0x7f594806d170 2023-10-03T19:15:22.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f59467fc640 1 -- 172.21.15.45:0/3601646861 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59400a5950 con 0x7f594806d170 2023-10-03T19:15:22.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f59467fc640 1 -- 172.21.15.45:0/3601646861 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59400a5ce0 con 0x7f594806d170 2023-10-03T19:15:22.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f594db0a640 1 -- 172.21.15.45:0/3601646861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f594806d170 msgr2=0x7f594814d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:22.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f594db0a640 1 --2- 172.21.15.45:0/3601646861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f594806d170 0x7f594814d180 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5940009e50 tx=0x7f594001c9d0 comp rx=0 tx=0).stop 2023-10-03T19:15:22.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f594db0a640 1 -- 172.21.15.45:0/3601646861 shutdown_connections 2023-10-03T19:15:22.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f594db0a640 1 --2- 172.21.15.45:0/3601646861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f594806d170 0x7f594814d180 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:22.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f594db0a640 1 --2- 172.21.15.45:0/3601646861 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f594806f170 0x7f5948150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:22.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f594db0a640 1 -- 172.21.15.45:0/3601646861 >> 172.21.15.45:0/3601646861 conn(0x7f59480bcf50 msgr2=0x7f59480bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:22.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f594db0a640 1 -- 172.21.15.45:0/3601646861 shutdown_connections 2023-10-03T19:15:22.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f594db0a640 1 -- 172.21.15.45:0/3601646861 wait complete. 2023-10-03T19:15:22.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f594db0a640 1 Processor -- start 2023-10-03T19:15:22.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f594db0a640 1 -- start start 2023-10-03T19:15:22.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f594db0a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f594806d170 0x7f5948145f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:22.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f594db0a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f594806f170 0x7f59480a38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:22.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f594db0a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59480bc8b0 0x7f5948147030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:22.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f594db0a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59481ef090 con 0x7f594806d170 2023-10-03T19:15:22.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f594db0a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59480a3e10 con 0x7f59480bc8b0 2023-10-03T19:15:22.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f594db0a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5948147ac0 con 0x7f594806f170 2023-10-03T19:15:22.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f59477fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f594806d170 0x7f5948145f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:22.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f59477fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f594806d170 0x7f5948145f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44886/0 (socket says 172.21.15.45:44886) 2023-10-03T19:15:22.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f59477fe640 1 -- 172.21.15.45:0/3803990658 learned_addr learned my addr 172.21.15.45:0/3803990658 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:22.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f5946ffd640 1 --2- 172.21.15.45:0/3803990658 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f594806f170 0x7f59480a38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:22.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f5947fff640 1 --2- 172.21.15.45:0/3803990658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59480bc8b0 0x7f5948147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:22.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f59477fe640 1 -- 172.21.15.45:0/3803990658 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f594806f170 msgr2=0x7f59480a38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:22.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f59477fe640 1 --2- 172.21.15.45:0/3803990658 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f594806f170 0x7f59480a38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:22.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f59477fe640 1 -- 172.21.15.45:0/3803990658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59480bc8b0 msgr2=0x7f5948147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:22.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f59477fe640 1 --2- 172.21.15.45:0/3803990658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59480bc8b0 0x7f5948147030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:22.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f59477fe640 1 -- 172.21.15.45:0/3803990658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5938009420 con 0x7f594806d170 2023-10-03T19:15:22.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.767+0000 7f5947fff640 1 --2- 172.21.15.45:0/3803990658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59480bc8b0 0x7f5948147030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:15:22.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.771+0000 7f59477fe640 1 --2- 172.21.15.45:0/3803990658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f594806d170 0x7f5948145f70 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f593800e980 tx=0x7f593800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:22.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.771+0000 7f592ffff640 1 -- 172.21.15.45:0/3803990658 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593800ca00 con 0x7f594806d170 2023-10-03T19:15:22.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.771+0000 7f592ffff640 1 -- 172.21.15.45:0/3803990658 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593800cb60 con 0x7f594806d170 2023-10-03T19:15:22.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.771+0000 7f594db0a640 1 -- 172.21.15.45:0/3803990658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5940009b30 con 0x7f594806d170 2023-10-03T19:15:22.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.771+0000 7f592ffff640 1 -- 172.21.15.45:0/3803990658 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5938013470 con 0x7f594806d170 2023-10-03T19:15:22.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.771+0000 7f594db0a640 1 -- 172.21.15.45:0/3803990658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f594806f6d0 con 0x7f594806d170 2023-10-03T19:15:22.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.771+0000 7f594db0a640 1 -- 172.21.15.45:0/3803990658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f594806f540 con 0x7f594806d170 2023-10-03T19:15:22.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.771+0000 7f592ffff640 1 -- 172.21.15.45:0/3803990658 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f59380135d0 con 0x7f594806d170 2023-10-03T19:15:22.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.771+0000 7f592ffff640 1 --2- 172.21.15.45:0/3803990658 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f59340662b0 0x7f5934068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:22.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.771+0000 7f592ffff640 1 -- 172.21.15.45:0/3803990658 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f59380842b0 con 0x7f594806d170 2023-10-03T19:15:22.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.771+0000 7f5946ffd640 1 --2- 172.21.15.45:0/3803990658 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f59340662b0 0x7f5934068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:22.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.771+0000 7f5946ffd640 1 --2- 172.21.15.45:0/3803990658 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f59340662b0 0x7f5934068760 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5948148530 tx=0x7f593c007cb0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:22.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.775+0000 7f592ffff640 1 -- 172.21.15.45:0/3803990658 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f59380517a0 con 0x7f594806d170 2023-10-03T19:15:22.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.963+0000 7f594db0a640 1 -- 172.21.15.45:0/3803990658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f594806d660 con 0x7f594806d170 2023-10-03T19:15:22.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.963+0000 7f592ffff640 1 -- 172.21.15.45:0/3803990658 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+3908 (secure 0 0 0) 0x7f5938054dc0 con 0x7f594806d170 2023-10-03T19:15:22.970 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:15:22.970 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4727,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/659816428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":659816428},{"type":"v1","addr":"172.21.15.79:6835","nonce":659816428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5073,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3273073650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3273073650},{"type":"v1","addr":"172.21.15.45:6834","nonce":3273073650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:13:21.307600+0000","modified":"2023-10-03T19:13:24.332226+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5076},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5076":{"gid":5076,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/252012936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":252012936},{"type":"v1","addr":"172.21.15.45:6835","nonce":252012936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-03T19:15:22.971 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 15 2023-10-03T19:15:22.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.967+0000 7f594db0a640 1 -- 172.21.15.45:0/3803990658 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f59340662b0 msgr2=0x7f5934068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:22.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.967+0000 7f594db0a640 1 --2- 172.21.15.45:0/3803990658 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f59340662b0 0x7f5934068760 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5948148530 tx=0x7f593c007cb0 comp rx=0 tx=0).stop 2023-10-03T19:15:22.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.967+0000 7f594db0a640 1 -- 172.21.15.45:0/3803990658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f594806d170 msgr2=0x7f5948145f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:22.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.967+0000 7f594db0a640 1 --2- 172.21.15.45:0/3803990658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f594806d170 0x7f5948145f70 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f593800e980 tx=0x7f593800ee40 comp rx=0 tx=0).stop 2023-10-03T19:15:22.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.967+0000 7f594db0a640 1 -- 172.21.15.45:0/3803990658 shutdown_connections 2023-10-03T19:15:22.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.967+0000 7f594db0a640 1 --2- 172.21.15.45:0/3803990658 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f59340662b0 0x7f5934068760 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:22.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.967+0000 7f594db0a640 1 --2- 172.21.15.45:0/3803990658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59480bc8b0 0x7f5948147030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:22.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.967+0000 7f594db0a640 1 --2- 172.21.15.45:0/3803990658 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f594806f170 0x7f59480a38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:22.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.967+0000 7f594db0a640 1 --2- 172.21.15.45:0/3803990658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f594806d170 0x7f5948145f70 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:22.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.967+0000 7f594db0a640 1 -- 172.21.15.45:0/3803990658 >> 172.21.15.45:0/3803990658 conn(0x7f59480bcf50 msgr2=0x7f59481487a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:22.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.967+0000 7f594db0a640 1 -- 172.21.15.45:0/3803990658 shutdown_connections 2023-10-03T19:15:22.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:22.967+0000 7f594db0a640 1 -- 172.21.15.45:0/3803990658 wait complete. 2023-10-03T19:15:22.989 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:15:23.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.103+0000 7f6397fff640 1 Processor -- start 2023-10-03T19:15:23.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.103+0000 7f6397fff640 1 -- start start 2023-10-03T19:15:23.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.103+0000 7f6397fff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f639814f1c0 0x7f63981527a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:23.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.103+0000 7f6397fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f639806b080 0x7f6398065690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:23.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.103+0000 7f6397fff640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63980bbd20 con 0x7f63980bc420 2023-10-03T19:15:23.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.103+0000 7f6397fff640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63980bc250 con 0x7f639806b080 2023-10-03T19:15:23.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.103+0000 7f6397fff640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f639806a4a0 con 0x7f639814f1c0 2023-10-03T19:15:23.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.103+0000 7f63977fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f639806b080 0x7f6398065690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:23.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.103+0000 7f63977fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f639806b080 0x7f6398065690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:53704/0 (socket says 172.21.15.45:53704) 2023-10-03T19:15:23.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.103+0000 7f63977fe640 1 -- 172.21.15.45:0/2171678383 learned_addr learned my addr 172.21.15.45:0/2171678383 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:23.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.103+0000 7f6396ffd640 1 --2- 172.21.15.45:0/2171678383 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f639814f1c0 0x7f63981527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:23.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.103+0000 7f63977fe640 1 -- 172.21.15.45:0/2171678383 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f639814f1c0 msgr2=0x7f63981527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:23.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.103+0000 7f63977fe640 1 --2- 172.21.15.45:0/2171678383 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f639814f1c0 0x7f63981527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:23.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.103+0000 7f63977fe640 1 -- 172.21.15.45:0/2171678383 >> v1:172.21.15.79:6789/0 conn(0x7f63980bc420 legacy=0x7f63980bc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:23.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.103+0000 7f63977fe640 1 -- 172.21.15.45:0/2171678383 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f639814e770 con 0x7f639806b080 2023-10-03T19:15:23.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.107+0000 7f63977fe640 1 --2- 172.21.15.45:0/2171678383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f639806b080 0x7f6398065690 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6390009e50 tx=0x7f639001c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4cae01893541738 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:23.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.107+0000 7f6395ffb640 1 -- 172.21.15.45:0/2171678383 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63900a57c0 con 0x7f639806b080 2023-10-03T19:15:23.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.107+0000 7f6395ffb640 1 -- 172.21.15.45:0/2171678383 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63900a5920 con 0x7f639806b080 2023-10-03T19:15:23.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.107+0000 7f6395ffb640 1 -- 172.21.15.45:0/2171678383 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63900a5cb0 con 0x7f639806b080 2023-10-03T19:15:23.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.107+0000 7f6397fff640 1 -- 172.21.15.45:0/2171678383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f639806b080 msgr2=0x7f6398065690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:23.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.107+0000 7f6397fff640 1 --2- 172.21.15.45:0/2171678383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f639806b080 0x7f6398065690 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6390009e50 tx=0x7f639001c9e0 comp rx=0 tx=0).stop 2023-10-03T19:15:23.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.107+0000 7f6397fff640 1 -- 172.21.15.45:0/2171678383 shutdown_connections 2023-10-03T19:15:23.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.107+0000 7f6397fff640 1 --2- 172.21.15.45:0/2171678383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f639806b080 0x7f6398065690 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:23.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.107+0000 7f6397fff640 1 --2- 172.21.15.45:0/2171678383 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f639814f1c0 0x7f63981527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:23.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.107+0000 7f6397fff640 1 -- 172.21.15.45:0/2171678383 >> 172.21.15.45:0/2171678383 conn(0x7f63980bde20 msgr2=0x7f63980be220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:23.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.107+0000 7f6397fff640 1 -- 172.21.15.45:0/2171678383 shutdown_connections 2023-10-03T19:15:23.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.107+0000 7f6397fff640 1 -- 172.21.15.45:0/2171678383 wait complete. 2023-10-03T19:15:23.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.107+0000 7f6397fff640 1 Processor -- start 2023-10-03T19:15:23.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.107+0000 7f6397fff640 1 -- start start 2023-10-03T19:15:23.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.107+0000 7f6397fff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f639806b080 0x7f63981437a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:23.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.107+0000 7f6397fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63980bc420 0x7f63981e70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:23.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.107+0000 7f6397fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f639814f1c0 0x7f639814a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:23.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.107+0000 7f6397fff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6398143ce0 con 0x7f639814f1c0 2023-10-03T19:15:23.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.107+0000 7f6397fff640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63980a6640 con 0x7f63980bc420 2023-10-03T19:15:23.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.107+0000 7f6397fff640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63980a68b0 con 0x7f639806b080 2023-10-03T19:15:23.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.107+0000 7f63977fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f639814f1c0 0x7f639814a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:23.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.107+0000 7f63977fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f639814f1c0 0x7f639814a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44890/0 (socket says 172.21.15.45:44890) 2023-10-03T19:15:23.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.107+0000 7f63977fe640 1 -- 172.21.15.45:0/1625799395 learned_addr learned my addr 172.21.15.45:0/1625799395 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:23.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.111+0000 7f6396ffd640 1 --2- 172.21.15.45:0/1625799395 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f639806b080 0x7f63981437a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:23.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.111+0000 7f63967fc640 1 --2- 172.21.15.45:0/1625799395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63980bc420 0x7f63981e70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:23.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.111+0000 7f63977fe640 1 -- 172.21.15.45:0/1625799395 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f639806b080 msgr2=0x7f63981437a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:23.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.111+0000 7f63977fe640 1 --2- 172.21.15.45:0/1625799395 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f639806b080 0x7f63981437a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:23.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.111+0000 7f63977fe640 1 -- 172.21.15.45:0/1625799395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63980bc420 msgr2=0x7f63981e70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:23.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.111+0000 7f63977fe640 1 --2- 172.21.15.45:0/1625799395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63980bc420 0x7f63981e70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:23.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.111+0000 7f63977fe640 1 -- 172.21.15.45:0/1625799395 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6390009b30 con 0x7f639814f1c0 2023-10-03T19:15:23.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.111+0000 7f63977fe640 1 --2- 172.21.15.45:0/1625799395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f639814f1c0 0x7f639814a050 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f639001a610 tx=0x7f6390019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:23.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.111+0000 7f637f7fe640 1 -- 172.21.15.45:0/1625799395 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63900b8670 con 0x7f639814f1c0 2023-10-03T19:15:23.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.111+0000 7f637f7fe640 1 -- 172.21.15.45:0/1625799395 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63900b87d0 con 0x7f639814f1c0 2023-10-03T19:15:23.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.111+0000 7f6397fff640 1 -- 172.21.15.45:0/1625799395 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f639814f720 con 0x7f639814f1c0 2023-10-03T19:15:23.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.111+0000 7f637f7fe640 1 -- 172.21.15.45:0/1625799395 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63900b8b80 con 0x7f639814f1c0 2023-10-03T19:15:23.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.111+0000 7f6397fff640 1 -- 172.21.15.45:0/1625799395 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f639814f590 con 0x7f639814f1c0 2023-10-03T19:15:23.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.111+0000 7f6397fff640 1 -- 172.21.15.45:0/1625799395 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f639815b830 con 0x7f639814f1c0 2023-10-03T19:15:23.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.111+0000 7f637f7fe640 1 -- 172.21.15.45:0/1625799395 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f63900b8ce0 con 0x7f639814f1c0 2023-10-03T19:15:23.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.111+0000 7f637f7fe640 1 --2- 172.21.15.45:0/1625799395 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f63840662b0 0x7f6384068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:23.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.111+0000 7f637f7fe640 1 -- 172.21.15.45:0/1625799395 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f639011f250 con 0x7f639814f1c0 2023-10-03T19:15:23.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.111+0000 7f6396ffd640 1 --2- 172.21.15.45:0/1625799395 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f63840662b0 0x7f6384068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:23.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.111+0000 7f6396ffd640 1 --2- 172.21.15.45:0/1625799395 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f63840662b0 0x7f6384068760 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f638c009a50 tx=0x7f638c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:23.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.115+0000 7f637f7fe640 1 -- 172.21.15.45:0/1625799395 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f63900ec740 con 0x7f639814f1c0 2023-10-03T19:15:23.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.303+0000 7f6397fff640 1 -- 172.21.15.45:0/1625799395 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f639814aee0 con 0x7f639814f1c0 2023-10-03T19:15:23.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.303+0000 7f637f7fe640 1 -- 172.21.15.45:0/1625799395 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+3908 (secure 0 0 0) 0x7f63900efd60 con 0x7f639814f1c0 2023-10-03T19:15:23.309 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:15:23.309 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4727,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/659816428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":659816428},{"type":"v1","addr":"172.21.15.79:6835","nonce":659816428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5073,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3273073650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3273073650},{"type":"v1","addr":"172.21.15.45:6834","nonce":3273073650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:13:21.307600+0000","modified":"2023-10-03T19:13:24.332226+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5076},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5076":{"gid":5076,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/252012936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":252012936},{"type":"v1","addr":"172.21.15.45:6835","nonce":252012936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-03T19:15:23.309 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 15 2023-10-03T19:15:23.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.303+0000 7f6397fff640 1 -- 172.21.15.45:0/1625799395 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f63840662b0 msgr2=0x7f6384068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:23.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.303+0000 7f6397fff640 1 --2- 172.21.15.45:0/1625799395 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f63840662b0 0x7f6384068760 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f638c009a50 tx=0x7f638c008040 comp rx=0 tx=0).stop 2023-10-03T19:15:23.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.303+0000 7f6397fff640 1 -- 172.21.15.45:0/1625799395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f639814f1c0 msgr2=0x7f639814a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:23.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.303+0000 7f6397fff640 1 --2- 172.21.15.45:0/1625799395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f639814f1c0 0x7f639814a050 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f639001a610 tx=0x7f6390019780 comp rx=0 tx=0).stop 2023-10-03T19:15:23.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.303+0000 7f6397fff640 1 -- 172.21.15.45:0/1625799395 shutdown_connections 2023-10-03T19:15:23.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.303+0000 7f6397fff640 1 --2- 172.21.15.45:0/1625799395 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f63840662b0 0x7f6384068760 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:23.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.303+0000 7f6397fff640 1 --2- 172.21.15.45:0/1625799395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f639814f1c0 0x7f639814a050 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:23.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.303+0000 7f6397fff640 1 --2- 172.21.15.45:0/1625799395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63980bc420 0x7f63981e70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:23.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.303+0000 7f6397fff640 1 --2- 172.21.15.45:0/1625799395 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f639806b080 0x7f63981437a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:23.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.303+0000 7f6397fff640 1 -- 172.21.15.45:0/1625799395 >> 172.21.15.45:0/1625799395 conn(0x7f63980bde20 msgr2=0x7f639814d780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:23.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.307+0000 7f6397fff640 1 -- 172.21.15.45:0/1625799395 shutdown_connections 2023-10-03T19:15:23.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.307+0000 7f6397fff640 1 -- 172.21.15.45:0/1625799395 wait complete. 2023-10-03T19:15:23.327 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:15:23.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.431+0000 7f929dcaf640 1 Processor -- start 2023-10-03T19:15:23.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.431+0000 7f929dcaf640 1 -- start start 2023-10-03T19:15:23.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.435+0000 7f929dcaf640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f929814fe70 0x7f9298150280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:23.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.435+0000 7f929dcaf640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f929806c3d0 0x7f929806c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:23.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.435+0000 7f929dcaf640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92981507c0 con 0x7f929814faa0 2023-10-03T19:15:23.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.435+0000 7f929dcaf640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92980719b0 con 0x7f929806c3d0 2023-10-03T19:15:23.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.435+0000 7f929dcaf640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92980baa00 con 0x7f929814fe70 2023-10-03T19:15:23.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.435+0000 7f9297fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f929806c3d0 0x7f929806c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:23.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.435+0000 7f928ffff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f929814fe70 0x7f9298150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:23.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.435+0000 7f9297fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f929806c3d0 0x7f929806c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:53718/0 (socket says 172.21.15.45:53718) 2023-10-03T19:15:23.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.435+0000 7f9297fff640 1 -- 172.21.15.45:0/253361895 learned_addr learned my addr 172.21.15.45:0/253361895 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:23.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.435+0000 7f9297fff640 1 -- 172.21.15.45:0/253361895 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f929814fe70 msgr2=0x7f9298150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:23.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.435+0000 7f9297fff640 1 --2- 172.21.15.45:0/253361895 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f929814fe70 0x7f9298150280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:23.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.435+0000 7f9297fff640 1 -- 172.21.15.45:0/253361895 >> v1:172.21.15.79:6789/0 conn(0x7f929814faa0 legacy=0x7f9298149720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:23.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.435+0000 7f9297fff640 1 -- 172.21.15.45:0/253361895 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9298071080 con 0x7f929806c3d0 2023-10-03T19:15:23.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.435+0000 7f9297fff640 1 --2- 172.21.15.45:0/253361895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f929806c3d0 0x7f929806c850 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9290009e50 tx=0x7f929001c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19f1416a7436c48c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:23.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.435+0000 7f9296ffd640 1 -- 172.21.15.45:0/253361895 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92900a58a0 con 0x7f929806c3d0 2023-10-03T19:15:23.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.435+0000 7f9296ffd640 1 -- 172.21.15.45:0/253361895 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92900a5a00 con 0x7f929806c3d0 2023-10-03T19:15:23.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.435+0000 7f9296ffd640 1 -- 172.21.15.45:0/253361895 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92900a5d90 con 0x7f929806c3d0 2023-10-03T19:15:23.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f929dcaf640 1 -- 172.21.15.45:0/253361895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f929806c3d0 msgr2=0x7f929806c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:23.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f929dcaf640 1 --2- 172.21.15.45:0/253361895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f929806c3d0 0x7f929806c850 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9290009e50 tx=0x7f929001c9e0 comp rx=0 tx=0).stop 2023-10-03T19:15:23.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f929dcaf640 1 -- 172.21.15.45:0/253361895 shutdown_connections 2023-10-03T19:15:23.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f929dcaf640 1 --2- 172.21.15.45:0/253361895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f929806c3d0 0x7f929806c850 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:23.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f929dcaf640 1 --2- 172.21.15.45:0/253361895 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f929814fe70 0x7f9298150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:23.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f929dcaf640 1 -- 172.21.15.45:0/253361895 >> 172.21.15.45:0/253361895 conn(0x7f9298065a90 msgr2=0x7f9298069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:23.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f929dcaf640 1 -- 172.21.15.45:0/253361895 shutdown_connections 2023-10-03T19:15:23.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f929dcaf640 1 -- 172.21.15.45:0/253361895 wait complete. 2023-10-03T19:15:23.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f929dcaf640 1 Processor -- start 2023-10-03T19:15:23.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f929dcaf640 1 -- start start 2023-10-03T19:15:23.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f929dcaf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f929806c3d0 0x7f92980a4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:23.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f929dcaf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f929814faa0 0x7f92981419f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:23.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f929dcaf640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f929814fe70 0x7f9298141f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:23.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f929dcaf640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9298148ce0 con 0x7f929806c3d0 2023-10-03T19:15:23.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f929dcaf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92980a4e70 con 0x7f929814faa0 2023-10-03T19:15:23.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f929dcaf640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9298142db0 con 0x7f929814fe70 2023-10-03T19:15:23.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f92977fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f929806c3d0 0x7f92980a4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:23.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f92977fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f929806c3d0 0x7f92980a4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44896/0 (socket says 172.21.15.45:44896) 2023-10-03T19:15:23.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f92977fe640 1 -- 172.21.15.45:0/2860222430 learned_addr learned my addr 172.21.15.45:0/2860222430 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:23.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f9297fff640 1 --2- 172.21.15.45:0/2860222430 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f929814fe70 0x7f9298141f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:23.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f928ffff640 1 --2- 172.21.15.45:0/2860222430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f929814faa0 0x7f92981419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:23.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f92977fe640 1 -- 172.21.15.45:0/2860222430 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f929814fe70 msgr2=0x7f9298141f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:23.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f92977fe640 1 --2- 172.21.15.45:0/2860222430 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f929814fe70 0x7f9298141f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:23.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f92977fe640 1 -- 172.21.15.45:0/2860222430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f929814faa0 msgr2=0x7f92981419f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:23.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f92977fe640 1 --2- 172.21.15.45:0/2860222430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f929814faa0 0x7f92981419f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:23.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f92977fe640 1 -- 172.21.15.45:0/2860222430 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9290009b30 con 0x7f929806c3d0 2023-10-03T19:15:23.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f9297fff640 1 --2- 172.21.15.45:0/2860222430 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f929814fe70 0x7f9298141f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:15:23.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f92977fe640 1 --2- 172.21.15.45:0/2860222430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f929806c3d0 0x7f92980a4930 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f928800c500 tx=0x7f928800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:23.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f9294ff9640 1 -- 172.21.15.45:0/2860222430 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9288005220 con 0x7f929806c3d0 2023-10-03T19:15:23.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f929dcaf640 1 -- 172.21.15.45:0/2860222430 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f929806ee10 con 0x7f929806c3d0 2023-10-03T19:15:23.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f9294ff9640 1 -- 172.21.15.45:0/2860222430 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9288005380 con 0x7f929806c3d0 2023-10-03T19:15:23.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f9294ff9640 1 -- 172.21.15.45:0/2860222430 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9288007270 con 0x7f929806c3d0 2023-10-03T19:15:23.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.439+0000 7f929dcaf640 1 -- 172.21.15.45:0/2860222430 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9298149e30 con 0x7f929806c3d0 2023-10-03T19:15:23.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.443+0000 7f929dcaf640 1 -- 172.21.15.45:0/2860222430 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92981593f0 con 0x7f929806c3d0 2023-10-03T19:15:23.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.443+0000 7f9294ff9640 1 -- 172.21.15.45:0/2860222430 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f92880073d0 con 0x7f929806c3d0 2023-10-03T19:15:23.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.443+0000 7f9294ff9640 1 --2- 172.21.15.45:0/2860222430 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f92780662b0 0x7f9278068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:23.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.443+0000 7f9294ff9640 1 -- 172.21.15.45:0/2860222430 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f9288083530 con 0x7f929806c3d0 2023-10-03T19:15:23.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.443+0000 7f928ffff640 1 --2- 172.21.15.45:0/2860222430 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f92780662b0 0x7f9278068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:23.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.443+0000 7f928ffff640 1 --2- 172.21.15.45:0/2860222430 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f92780662b0 0x7f9278068760 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f929814ae50 tx=0x7f9280008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:23.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.447+0000 7f9294ff9640 1 -- 172.21.15.45:0/2860222430 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9288050900 con 0x7f929806c3d0 2023-10-03T19:15:23.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.599+0000 7f929dcaf640 1 -- 172.21.15.45:0/2860222430 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92981507c0 con 0x7f929806c3d0 2023-10-03T19:15:23.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.599+0000 7f9294ff9640 1 -- 172.21.15.45:0/2860222430 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18296 (secure 0 0 0) 0x7f92981507c0 con 0x7f929806c3d0 2023-10-03T19:15:23.606 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:15:23.607 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":37,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:14:12.706533+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:13:19.206863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-03T19:13:20.283396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.36","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:15:23.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.603+0000 7f929dcaf640 1 -- 172.21.15.45:0/2860222430 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f92780662b0 msgr2=0x7f9278068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:23.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.603+0000 7f929dcaf640 1 --2- 172.21.15.45:0/2860222430 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f92780662b0 0x7f9278068760 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f929814ae50 tx=0x7f9280008040 comp rx=0 tx=0).stop 2023-10-03T19:15:23.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.603+0000 7f929dcaf640 1 -- 172.21.15.45:0/2860222430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f929806c3d0 msgr2=0x7f92980a4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:23.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.603+0000 7f929dcaf640 1 --2- 172.21.15.45:0/2860222430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f929806c3d0 0x7f92980a4930 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f928800c500 tx=0x7f928800c9c0 comp rx=0 tx=0).stop 2023-10-03T19:15:23.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.603+0000 7f929dcaf640 1 -- 172.21.15.45:0/2860222430 shutdown_connections 2023-10-03T19:15:23.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.603+0000 7f929dcaf640 1 --2- 172.21.15.45:0/2860222430 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f92780662b0 0x7f9278068760 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:23.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.603+0000 7f929dcaf640 1 --2- 172.21.15.45:0/2860222430 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f929814fe70 0x7f9298141f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:23.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.603+0000 7f929dcaf640 1 --2- 172.21.15.45:0/2860222430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f929814faa0 0x7f92981419f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:23.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.603+0000 7f929dcaf640 1 --2- 172.21.15.45:0/2860222430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f929806c3d0 0x7f92980a4930 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:23.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.603+0000 7f929dcaf640 1 -- 172.21.15.45:0/2860222430 >> 172.21.15.45:0/2860222430 conn(0x7f9298065a90 msgr2=0x7f9298146ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:23.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.603+0000 7f929dcaf640 1 -- 172.21.15.45:0/2860222430 shutdown_connections 2023-10-03T19:15:23.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.603+0000 7f929dcaf640 1 -- 172.21.15.45:0/2860222430 wait complete. 2023-10-03T19:15:23.625 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-03T19:15:23.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.743+0000 7fed817fc640 1 Processor -- start 2023-10-03T19:15:23.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.743+0000 7fed817fc640 1 -- start start 2023-10-03T19:15:23.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.743+0000 7fed817fc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed7c0bf370 0x7fed7c149760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:23.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.743+0000 7fed817fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fed7c0a7100 0x7fed7c149ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:23.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.743+0000 7fed817fc640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed7c14c770 con 0x7fed7c06f5f0 2023-10-03T19:15:23.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.743+0000 7fed817fc640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed7c150c00 con 0x7fed7c0a7100 2023-10-03T19:15:23.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.743+0000 7fed817fc640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c0bebc0 con 0x7fed7c0bf370 2023-10-03T19:15:23.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.743+0000 7fed7a7fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fed7c0a7100 0x7fed7c149ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:23.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.743+0000 7fed7a7fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fed7c0a7100 0x7fed7c149ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44898/0 (socket says 172.21.15.45:44898) 2023-10-03T19:15:23.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.743+0000 7fed7a7fc640 1 -- 172.21.15.45:0/277220485 learned_addr learned my addr 172.21.15.45:0/277220485 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:23.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.743+0000 7fed7affd640 1 --2- 172.21.15.45:0/277220485 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed7c0bf370 0x7fed7c149760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:23.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.747+0000 7fed7a7fc640 1 -- 172.21.15.45:0/277220485 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed7c0bf370 msgr2=0x7fed7c149760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:23.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.747+0000 7fed7a7fc640 1 --2- 172.21.15.45:0/277220485 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed7c0bf370 0x7fed7c149760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:23.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.747+0000 7fed7a7fc640 1 -- 172.21.15.45:0/277220485 >> v1:172.21.15.79:6789/0 conn(0x7fed7c06f5f0 legacy=0x7fed7c14cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:23.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.747+0000 7fed7a7fc640 1 -- 172.21.15.45:0/277220485 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed7c06efe0 con 0x7fed7c0a7100 2023-10-03T19:15:23.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.747+0000 7fed7a7fc640 1 --2- 172.21.15.45:0/277220485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed7c0a7100 0x7fed7c149ca0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fed70009870 tx=0x7fed7001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee25d63a33c4df6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:23.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.747+0000 7fed79ffb640 1 -- 172.21.15.45:0/277220485 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed700ab650 con 0x7fed7c0a7100 2023-10-03T19:15:23.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.747+0000 7fed79ffb640 1 -- 172.21.15.45:0/277220485 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed700ab7b0 con 0x7fed7c0a7100 2023-10-03T19:15:23.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.747+0000 7fed79ffb640 1 -- 172.21.15.45:0/277220485 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed700abb40 con 0x7fed7c0a7100 2023-10-03T19:15:23.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.747+0000 7fed817fc640 1 -- 172.21.15.45:0/277220485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed7c0a7100 msgr2=0x7fed7c149ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:23.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.747+0000 7fed817fc640 1 --2- 172.21.15.45:0/277220485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed7c0a7100 0x7fed7c149ca0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fed70009870 tx=0x7fed7001c470 comp rx=0 tx=0).stop 2023-10-03T19:15:23.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.747+0000 7fed817fc640 1 -- 172.21.15.45:0/277220485 shutdown_connections 2023-10-03T19:15:23.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.747+0000 7fed817fc640 1 --2- 172.21.15.45:0/277220485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed7c0a7100 0x7fed7c149ca0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:23.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.747+0000 7fed817fc640 1 --2- 172.21.15.45:0/277220485 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed7c0bf370 0x7fed7c149760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:23.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.747+0000 7fed817fc640 1 -- 172.21.15.45:0/277220485 >> 172.21.15.45:0/277220485 conn(0x7fed7c06bce0 msgr2=0x7fed7c06c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:23.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.747+0000 7fed817fc640 1 -- 172.21.15.45:0/277220485 shutdown_connections 2023-10-03T19:15:23.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.747+0000 7fed817fc640 1 -- 172.21.15.45:0/277220485 wait complete. 2023-10-03T19:15:23.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.751+0000 7fed817fc640 1 Processor -- start 2023-10-03T19:15:23.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.751+0000 7fed817fc640 1 -- start start 2023-10-03T19:15:23.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.751+0000 7fed817fc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed7c06f5f0 0x7fed7c141500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:23.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.751+0000 7fed817fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed7c0a7100 0x7fed7c141e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:23.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.751+0000 7fed817fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed7c0bf370 0x7fed7c0c1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:23.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.751+0000 7fed817fc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c143b30 con 0x7fed7c0a7100 2023-10-03T19:15:23.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.751+0000 7fed817fc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c143830 con 0x7fed7c0bf370 2023-10-03T19:15:23.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.751+0000 7fed817fc640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c149990 con 0x7fed7c06f5f0 2023-10-03T19:15:23.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.751+0000 7fed7a7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed7c0a7100 0x7fed7c141e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:23.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.751+0000 7fed7a7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed7c0a7100 0x7fed7c141e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44910/0 (socket says 172.21.15.45:44910) 2023-10-03T19:15:23.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.751+0000 7fed7a7fc640 1 -- 172.21.15.45:0/609188527 learned_addr learned my addr 172.21.15.45:0/609188527 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:23.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.751+0000 7fed7a7fc640 1 -- 172.21.15.45:0/609188527 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed7c06f5f0 msgr2=0x7fed7c141500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:23.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.751+0000 7fed7a7fc640 1 --2- 172.21.15.45:0/609188527 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed7c06f5f0 0x7fed7c141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:23.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.751+0000 7fed7b7fe640 1 --2- 172.21.15.45:0/609188527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed7c0bf370 0x7fed7c0c1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:23.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.751+0000 7fed7a7fc640 1 -- 172.21.15.45:0/609188527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed7c0bf370 msgr2=0x7fed7c0c1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:23.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.751+0000 7fed7a7fc640 1 --2- 172.21.15.45:0/609188527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed7c0bf370 0x7fed7c0c1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:23.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.751+0000 7fed7a7fc640 1 -- 172.21.15.45:0/609188527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed700094d0 con 0x7fed7c0a7100 2023-10-03T19:15:23.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.751+0000 7fed7a7fc640 1 --2- 172.21.15.45:0/609188527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed7c0a7100 0x7fed7c141e70 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fed700ad040 tx=0x7fed7001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:23.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.751+0000 7fed637fe640 1 -- 172.21.15.45:0/609188527 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed700b4800 con 0x7fed7c0a7100 2023-10-03T19:15:23.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.751+0000 7fed637fe640 1 -- 172.21.15.45:0/609188527 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed700b4960 con 0x7fed7c0a7100 2023-10-03T19:15:23.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.751+0000 7fed637fe640 1 -- 172.21.15.45:0/609188527 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed700b4d10 con 0x7fed7c0a7100 2023-10-03T19:15:23.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.751+0000 7fed817fc640 1 -- 172.21.15.45:0/609188527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed7c0bca70 con 0x7fed7c0a7100 2023-10-03T19:15:23.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.751+0000 7fed817fc640 1 -- 172.21.15.45:0/609188527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed7c0bc8e0 con 0x7fed7c0a7100 2023-10-03T19:15:23.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.751+0000 7fed817fc640 1 -- 172.21.15.45:0/609188527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed7c150400 con 0x7fed7c0a7100 2023-10-03T19:15:23.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.751+0000 7fed637fe640 1 -- 172.21.15.45:0/609188527 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fed700b3380 con 0x7fed7c0a7100 2023-10-03T19:15:23.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.751+0000 7fed637fe640 1 --2- 172.21.15.45:0/609188527 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fed68066280 0x7fed68068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:23.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.751+0000 7fed637fe640 1 -- 172.21.15.45:0/609188527 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fed7011e5a0 con 0x7fed7c0a7100 2023-10-03T19:15:23.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.755+0000 7fed7affd640 1 --2- 172.21.15.45:0/609188527 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fed68066280 0x7fed68068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:23.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.755+0000 7fed7affd640 1 --2- 172.21.15.45:0/609188527 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fed68066280 0x7fed68068730 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fed6c0070b0 tx=0x7fed6c007040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:23.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.759+0000 7fed637fe640 1 -- 172.21.15.45:0/609188527 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fed700ebb40 con 0x7fed7c0a7100 2023-10-03T19:15:23.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:23.939+0000 7fed817fc640 1 -- 172.21.15.45:0/609188527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fed7c141a40 con 0x7fed7c0a7100 2023-10-03T19:15:24.044 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-03T19:15:24.039+0000 7f0f05562640 -1 MDSIOContextBase: failed with -108, restarting... 2023-10-03T19:15:24.079 INFO:tasks.ceph.mds.a.smithi045.stderr: -1> 2023-10-03T19:15:24.039+0000 7f0f05562640 -1 MDSIOContextBase: failed with -108, restarting... 2023-10-03T19:15:24.131 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-10-03T19:15:24.641 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-10-03T19:15:24.635+0000 7f00b6fb3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-03T19:15:24.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.651+0000 7fed637fe640 1 -- 172.21.15.45:0/609188527 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) v1 ==== 161+0+0 (secure 0 0 0) 0x7fed700ef160 con 0x7fed7c0a7100 2023-10-03T19:15:24.655 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-03T19:15:24.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.655+0000 7fed817fc640 1 -- 172.21.15.45:0/609188527 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fed68066280 msgr2=0x7fed68068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:24.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.655+0000 7fed817fc640 1 --2- 172.21.15.45:0/609188527 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fed68066280 0x7fed68068730 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fed6c0070b0 tx=0x7fed6c007040 comp rx=0 tx=0).stop 2023-10-03T19:15:24.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.655+0000 7fed817fc640 1 -- 172.21.15.45:0/609188527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed7c0a7100 msgr2=0x7fed7c141e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:24.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.655+0000 7fed817fc640 1 --2- 172.21.15.45:0/609188527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed7c0a7100 0x7fed7c141e70 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fed700ad040 tx=0x7fed7001acb0 comp rx=0 tx=0).stop 2023-10-03T19:15:24.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.655+0000 7fed817fc640 1 -- 172.21.15.45:0/609188527 shutdown_connections 2023-10-03T19:15:24.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.655+0000 7fed817fc640 1 --2- 172.21.15.45:0/609188527 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fed68066280 0x7fed68068730 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:24.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.655+0000 7fed817fc640 1 --2- 172.21.15.45:0/609188527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed7c0bf370 0x7fed7c0c1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:24.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.655+0000 7fed817fc640 1 --2- 172.21.15.45:0/609188527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed7c0a7100 0x7fed7c141e70 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:24.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.655+0000 7fed817fc640 1 --2- 172.21.15.45:0/609188527 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed7c06f5f0 0x7fed7c141500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:24.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.655+0000 7fed817fc640 1 -- 172.21.15.45:0/609188527 >> 172.21.15.45:0/609188527 conn(0x7fed7c06bce0 msgr2=0x7fed7c14b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:24.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.655+0000 7fed817fc640 1 -- 172.21.15.45:0/609188527 shutdown_connections 2023-10-03T19:15:24.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.655+0000 7fed817fc640 1 -- 172.21.15.45:0/609188527 wait complete. 2023-10-03T19:15:24.681 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-03T19:15:24.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.811+0000 7fd29dfe0640 1 Processor -- start 2023-10-03T19:15:24.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.811+0000 7fd29dfe0640 1 -- start start 2023-10-03T19:15:24.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.811+0000 7fd29dfe0640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd2980c19b0 0x7fd2980bd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:24.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.811+0000 7fd29dfe0640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2980c14c0 con 0x7fd2980c07f0 2023-10-03T19:15:24.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.811+0000 7fd29dfe0640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2980a1f80 con 0x7fd29814fa20 2023-10-03T19:15:24.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.811+0000 7fd29dfe0640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2980be420 con 0x7fd2980c19b0 2023-10-03T19:15:24.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.811+0000 7fd296ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd2980c19b0 0x7fd2980bd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:24.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.811+0000 7fd296ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd2980c19b0 0x7fd2980bd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40412/0 (socket says 172.21.15.45:40412) 2023-10-03T19:15:24.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.811+0000 7fd2977fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd2980c07f0 0x7fd29814bab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41878/0 (socket says 172.21.15.45:41878) 2023-10-03T19:15:24.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.811+0000 7fd296ffd640 1 -- 172.21.15.45:0/3371240410 learned_addr learned my addr 172.21.15.45:0/3371240410 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:24.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.811+0000 7fd296ffd640 1 -- 172.21.15.45:0/3371240410 >> v1:172.21.15.79:6789/0 conn(0x7fd29814fa20 legacy=0x7fd29814fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:24.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.811+0000 7fd296ffd640 1 -- 172.21.15.45:0/3371240410 >> v1:172.21.15.45:6789/0 conn(0x7fd2980c07f0 legacy=0x7fd29814bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:24.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.811+0000 7fd2967fc640 1 -- 172.21.15.45:0/3371240410 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2048806288 0 0) 0x7fd2980c14c0 con 0x7fd2980c07f0 2023-10-03T19:15:24.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.811+0000 7fd296ffd640 1 -- 172.21.15.45:0/3371240410 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2980bd070 con 0x7fd2980c19b0 2023-10-03T19:15:24.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.811+0000 7fd296ffd640 1 --2- 172.21.15.45:0/3371240410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2980c19b0 0x7fd2980bd640 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0098a0 tx=0x7fd28c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c30ed482f931c37 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:24.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd2967fc640 1 -- 172.21.15.45:0/3371240410 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28c0ab620 con 0x7fd2980c19b0 2023-10-03T19:15:24.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd2967fc640 1 -- 172.21.15.45:0/3371240410 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28c0ab780 con 0x7fd2980c19b0 2023-10-03T19:15:24.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd2967fc640 1 -- 172.21.15.45:0/3371240410 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28c0abb10 con 0x7fd2980c19b0 2023-10-03T19:15:24.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd29dfe0640 1 -- 172.21.15.45:0/3371240410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2980c19b0 msgr2=0x7fd2980bd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:24.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd29dfe0640 1 --2- 172.21.15.45:0/3371240410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2980c19b0 0x7fd2980bd640 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0098a0 tx=0x7fd28c01c420 comp rx=0 tx=0).stop 2023-10-03T19:15:24.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd29dfe0640 1 -- 172.21.15.45:0/3371240410 shutdown_connections 2023-10-03T19:15:24.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd29dfe0640 1 --2- 172.21.15.45:0/3371240410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2980c19b0 0x7fd2980bd640 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:24.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd29dfe0640 1 -- 172.21.15.45:0/3371240410 >> 172.21.15.45:0/3371240410 conn(0x7fd2980a4260 msgr2=0x7fd2980a4660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:24.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd29dfe0640 1 -- 172.21.15.45:0/3371240410 shutdown_connections 2023-10-03T19:15:24.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd29dfe0640 1 -- 172.21.15.45:0/3371240410 wait complete. 2023-10-03T19:15:24.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd29dfe0640 1 Processor -- start 2023-10-03T19:15:24.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd29dfe0640 1 -- start start 2023-10-03T19:15:24.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd29dfe0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2980c07f0 0x7fd2980b74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:24.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd29dfe0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2980c19b0 0x7fd29814b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:24.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd29dfe0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd29814fa20 0x7fd29814a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:24.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd29dfe0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2981e7770 con 0x7fd2980c07f0 2023-10-03T19:15:24.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd29dfe0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2980b89b0 con 0x7fd2980c19b0 2023-10-03T19:15:24.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd29dfe0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2980b8c90 con 0x7fd29814fa20 2023-10-03T19:15:24.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd2977fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2980c07f0 0x7fd2980b74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:24.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd2977fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2980c07f0 0x7fd2980b74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40420/0 (socket says 172.21.15.45:40420) 2023-10-03T19:15:24.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd2977fe640 1 -- 172.21.15.45:0/2469871065 learned_addr learned my addr 172.21.15.45:0/2469871065 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:24.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd296ffd640 1 --2- 172.21.15.45:0/2469871065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2980c19b0 0x7fd29814b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:24.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd2977fe640 1 -- 172.21.15.45:0/2469871065 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd29814fa20 msgr2=0x7fd29814a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:24.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd2977fe640 1 --2- 172.21.15.45:0/2469871065 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd29814fa20 0x7fd29814a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:24.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd2977fe640 1 -- 172.21.15.45:0/2469871065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2980c19b0 msgr2=0x7fd29814b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:24.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd2977fe640 1 --2- 172.21.15.45:0/2469871065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2980c19b0 0x7fd29814b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:24.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd2977fe640 1 -- 172.21.15.45:0/2469871065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28c0094d0 con 0x7fd2980c07f0 2023-10-03T19:15:24.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd296ffd640 1 --2- 172.21.15.45:0/2469871065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2980c19b0 0x7fd29814b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:15:24.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd2977fe640 1 --2- 172.21.15.45:0/2469871065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2980c07f0 0x7fd2980b74d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd2880011f0 tx=0x7fd28800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:24.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd27ffff640 1 -- 172.21.15.45:0/2469871065 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2880074e0 con 0x7fd2980c07f0 2023-10-03T19:15:24.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd27ffff640 1 -- 172.21.15.45:0/2469871065 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd288007640 con 0x7fd2980c07f0 2023-10-03T19:15:24.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd27ffff640 1 -- 172.21.15.45:0/2469871065 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd288004a10 con 0x7fd2980c07f0 2023-10-03T19:15:24.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd29dfe0640 1 -- 172.21.15.45:0/2469871065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd298150700 con 0x7fd2980c07f0 2023-10-03T19:15:24.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.815+0000 7fd29dfe0640 1 -- 172.21.15.45:0/2469871065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd298150570 con 0x7fd2980c07f0 2023-10-03T19:15:24.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.819+0000 7fd29dfe0640 1 -- 172.21.15.45:0/2469871065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2980c0bc0 con 0x7fd2980c07f0 2023-10-03T19:15:24.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.819+0000 7fd27ffff640 1 -- 172.21.15.45:0/2469871065 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd288004b70 con 0x7fd2980c07f0 2023-10-03T19:15:24.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.819+0000 7fd27ffff640 1 --2- 172.21.15.45:0/2469871065 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd2840662b0 0x7fd284068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:24.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.819+0000 7fd27ffff640 1 -- 172.21.15.45:0/2469871065 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fd288082f70 con 0x7fd2980c07f0 2023-10-03T19:15:24.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.819+0000 7fd296ffd640 1 --2- 172.21.15.45:0/2469871065 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd2840662b0 0x7fd284068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:24.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.819+0000 7fd296ffd640 1 --2- 172.21.15.45:0/2469871065 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd2840662b0 0x7fd284068760 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0af000 tx=0x7fd28c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:24.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:24.823+0000 7fd27ffff640 1 -- 172.21.15.45:0/2469871065 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd288050360 con 0x7fd2980c07f0 2023-10-03T19:15:25.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.015+0000 7fd29dfe0640 1 -- 172.21.15.45:0/2469871065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd2980b8eb0 con 0x7fd2980c07f0 2023-10-03T19:15:25.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.651+0000 7fd27ffff640 1 -- 172.21.15.45:0/2469871065 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd2980b8eb0 con 0x7fd2980c07f0 2023-10-03T19:15:25.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.655+0000 7fd29dfe0640 1 -- 172.21.15.45:0/2469871065 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd2840662b0 msgr2=0x7fd284068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:25.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.655+0000 7fd29dfe0640 1 --2- 172.21.15.45:0/2469871065 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd2840662b0 0x7fd284068760 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0af000 tx=0x7fd28c008040 comp rx=0 tx=0).stop 2023-10-03T19:15:25.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.655+0000 7fd29dfe0640 1 -- 172.21.15.45:0/2469871065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2980c07f0 msgr2=0x7fd2980b74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:25.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.655+0000 7fd29dfe0640 1 --2- 172.21.15.45:0/2469871065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2980c07f0 0x7fd2980b74d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd2880011f0 tx=0x7fd28800c9b0 comp rx=0 tx=0).stop 2023-10-03T19:15:25.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.655+0000 7fd29dfe0640 1 -- 172.21.15.45:0/2469871065 shutdown_connections 2023-10-03T19:15:25.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.655+0000 7fd29dfe0640 1 --2- 172.21.15.45:0/2469871065 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd2840662b0 0x7fd284068760 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:25.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.655+0000 7fd29dfe0640 1 --2- 172.21.15.45:0/2469871065 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd29814fa20 0x7fd29814a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:25.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.655+0000 7fd29dfe0640 1 --2- 172.21.15.45:0/2469871065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2980c19b0 0x7fd29814b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:25.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.655+0000 7fd29dfe0640 1 --2- 172.21.15.45:0/2469871065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2980c07f0 0x7fd2980b74d0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:25.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.655+0000 7fd29dfe0640 1 -- 172.21.15.45:0/2469871065 >> 172.21.15.45:0/2469871065 conn(0x7fd2980a4260 msgr2=0x7fd2980a4630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:25.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.655+0000 7fd29dfe0640 1 -- 172.21.15.45:0/2469871065 shutdown_connections 2023-10-03T19:15:25.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.655+0000 7fd29dfe0640 1 -- 172.21.15.45:0/2469871065 wait complete. 2023-10-03T19:15:25.681 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-03T19:15:25.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0eb0fb6640 1 Processor -- start 2023-10-03T19:15:25.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0eb0fb6640 1 -- start start 2023-10-03T19:15:25.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0eb0fb6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0eac06a0e0 0x7f0eac152620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:25.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0eb0fb6640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eac152b60 con 0x7f0eac14bde0 2023-10-03T19:15:25.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0eb0fb6640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eac0bc3c0 con 0x7f0eac14e660 2023-10-03T19:15:25.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0eb0fb6640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eac14ebf0 con 0x7f0eac06a0e0 2023-10-03T19:15:25.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0eaa59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0eac14bde0 0x7f0eac065690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41888/0 (socket says 172.21.15.45:41888) 2023-10-03T19:15:25.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0eaa59c640 1 -- 172.21.15.45:0/2083017011 learned_addr learned my addr 172.21.15.45:0/2083017011 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:15:25.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0ea9d9b640 1 -- 172.21.15.45:0/2083017011 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2691393443 0 0) 0x7f0eac152b60 con 0x7f0eac14bde0 2023-10-03T19:15:25.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0eaad9d640 1 --2- 172.21.15.45:0/2083017011 >> v2:172.21.15.79:3300/0 conn(0x7f0eac06a0e0 0x7f0eac152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:25.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0ea9d9b640 1 -- 172.21.15.45:0/2083017011 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e98003530 con 0x7f0eac14bde0 2023-10-03T19:15:25.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0ea9d9b640 1 -- 172.21.15.45:0/2083017011 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 192828673 0 0) 0x7f0e98003530 con 0x7f0eac14bde0 2023-10-03T19:15:25.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0ea9d9b640 1 -- 172.21.15.45:0/2083017011 >> v2:172.21.15.79:3300/0 conn(0x7f0eac06a0e0 msgr2=0x7f0eac152620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:25.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0ea9d9b640 1 --2- 172.21.15.45:0/2083017011 >> v2:172.21.15.79:3300/0 conn(0x7f0eac06a0e0 0x7f0eac152620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:25.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0ea9d9b640 1 -- 172.21.15.45:0/2083017011 >> v1:172.21.15.79:6789/0 conn(0x7f0eac14e660 legacy=0x7f0eac151f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:25.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0ea9d9b640 1 -- 172.21.15.45:0/2083017011 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac14eed0 con 0x7f0eac14bde0 2023-10-03T19:15:25.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0ea9d9b640 1 -- 172.21.15.45:0/2083017011 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f0e9c001680 con 0x7f0eac14bde0 2023-10-03T19:15:25.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0ea9d9b640 1 -- 172.21.15.45:0/2083017011 >> v1:172.21.15.45:6789/0 conn(0x7f0eac14bde0 legacy=0x7f0eac065690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:25.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0ea9d9b640 1 --2- 172.21.15.45:0/2083017011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e98003980 0x7f0e98003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:25.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0ea9d9b640 1 --2- 172.21.15.45:0/2083017011 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e980047d0 0x7f0e98004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:25.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0ea9d9b640 1 --2- 172.21.15.45:0/2083017011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e98005180 0x7f0e9800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:25.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0ea9d9b640 1 -- 172.21.15.45:0/2083017011 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac14ebf0 con 0x7f0e98005180 2023-10-03T19:15:25.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0ea9d9b640 1 -- 172.21.15.45:0/2083017011 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9800c000 con 0x7f0e98003980 2023-10-03T19:15:25.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0ea9d9b640 1 -- 172.21.15.45:0/2083017011 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9800c1c0 con 0x7f0e980047d0 2023-10-03T19:15:25.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0eaad9d640 1 --2- 172.21.15.45:0/2083017011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e98005180 0x7f0e9800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:25.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0ea3fff640 1 --2- 172.21.15.45:0/2083017011 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e980047d0 0x7f0e98004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:25.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0eaa59c640 1 --2- 172.21.15.45:0/2083017011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e98003980 0x7f0e98003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:25.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0eaad9d640 1 -- 172.21.15.45:0/2083017011 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e980047d0 msgr2=0x7f0e98004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:25.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0eaad9d640 1 --2- 172.21.15.45:0/2083017011 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e980047d0 0x7f0e98004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:25.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0eaad9d640 1 -- 172.21.15.45:0/2083017011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e98003980 msgr2=0x7f0e98003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:25.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0eaad9d640 1 --2- 172.21.15.45:0/2083017011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e98003980 0x7f0e98003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:25.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0eaad9d640 1 -- 172.21.15.45:0/2083017011 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e98003530 con 0x7f0e98005180 2023-10-03T19:15:25.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.807+0000 7f0ea3fff640 1 --2- 172.21.15.45:0/2083017011 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e980047d0 0x7f0e98004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:15:25.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.811+0000 7f0eaad9d640 1 -- 172.21.15.45:0/2083017011 reap_dead start 2023-10-03T19:15:25.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.811+0000 7f0eaad9d640 1 --2- 172.21.15.45:0/2083017011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e98005180 0x7f0e9800b990 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4009fc0 tx=0x7f0ea401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14925865d58a163d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:25.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.811+0000 7f0ea9d9b640 1 -- 172.21.15.45:0/2083017011 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea40a5cb0 con 0x7f0e98005180 2023-10-03T19:15:25.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.811+0000 7f0ea9d9b640 1 -- 172.21.15.45:0/2083017011 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea400f040 con 0x7f0e98005180 2023-10-03T19:15:25.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.811+0000 7f0ea9d9b640 1 -- 172.21.15.45:0/2083017011 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea4003be0 con 0x7f0e98005180 2023-10-03T19:15:25.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.811+0000 7f0eb0fb6640 1 -- 172.21.15.45:0/2083017011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e98005180 msgr2=0x7f0e9800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:25.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.811+0000 7f0eb0fb6640 1 --2- 172.21.15.45:0/2083017011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e98005180 0x7f0e9800b990 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4009fc0 tx=0x7f0ea401cca0 comp rx=0 tx=0).stop 2023-10-03T19:15:25.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.811+0000 7f0eb0fb6640 1 -- 172.21.15.45:0/2083017011 shutdown_connections 2023-10-03T19:15:25.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.811+0000 7f0eb0fb6640 1 --2- 172.21.15.45:0/2083017011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e98005180 0x7f0e9800b990 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:25.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.811+0000 7f0eb0fb6640 1 -- 172.21.15.45:0/2083017011 >> 172.21.15.45:0/2083017011 conn(0x7f0eac0c1510 msgr2=0x7f0eac0c1910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:25.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.811+0000 7f0eb0fb6640 1 -- 172.21.15.45:0/2083017011 shutdown_connections 2023-10-03T19:15:25.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.811+0000 7f0eb0fb6640 1 -- 172.21.15.45:0/2083017011 wait complete. 2023-10-03T19:15:25.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.811+0000 7f0eb0fb6640 1 Processor -- start 2023-10-03T19:15:25.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.811+0000 7f0eb0fb6640 1 -- start start 2023-10-03T19:15:25.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.815+0000 7f0eb0fb6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e98005180 0x7f0eac149610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:25.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.815+0000 7f0eb0fb6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0eac149e00 0x7f0eac142730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:25.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.815+0000 7f0eb0fb6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0eac071240 0x7f0eac14de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:25.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.815+0000 7f0eb0fb6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac14c3d0 con 0x7f0e98005180 2023-10-03T19:15:25.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.815+0000 7f0eb0fb6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac1e4970 con 0x7f0eac071240 2023-10-03T19:15:25.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.815+0000 7f0eb0fb6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac14c900 con 0x7f0eac149e00 2023-10-03T19:15:25.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.815+0000 7f0eaa59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e98005180 0x7f0eac149610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:25.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.815+0000 7f0eaa59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e98005180 0x7f0eac149610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40444/0 (socket says 172.21.15.45:40444) 2023-10-03T19:15:25.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.815+0000 7f0eaa59c640 1 -- 172.21.15.45:0/859659694 learned_addr learned my addr 172.21.15.45:0/859659694 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:25.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.815+0000 7f0eaad9d640 1 --2- 172.21.15.45:0/859659694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0eac071240 0x7f0eac14de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:25.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.815+0000 7f0ea3fff640 1 --2- 172.21.15.45:0/859659694 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0eac149e00 0x7f0eac142730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:25.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.815+0000 7f0eaa59c640 1 -- 172.21.15.45:0/859659694 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0eac149e00 msgr2=0x7f0eac142730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:25.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.815+0000 7f0eaa59c640 1 --2- 172.21.15.45:0/859659694 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0eac149e00 0x7f0eac142730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:25.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.815+0000 7f0eaa59c640 1 -- 172.21.15.45:0/859659694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0eac071240 msgr2=0x7f0eac14de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:25.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.815+0000 7f0eaa59c640 1 --2- 172.21.15.45:0/859659694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0eac071240 0x7f0eac14de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:25.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.815+0000 7f0eaa59c640 1 -- 172.21.15.45:0/859659694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac14f490 con 0x7f0e98005180 2023-10-03T19:15:25.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.815+0000 7f0eaa59c640 1 --2- 172.21.15.45:0/859659694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e98005180 0x7f0eac149610 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c00d6f0 tx=0x7f0e9c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:25.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.815+0000 7f0ea2ffd640 1 -- 172.21.15.45:0/859659694 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c0072d0 con 0x7f0e98005180 2023-10-03T19:15:25.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.815+0000 7f0ea2ffd640 1 -- 172.21.15.45:0/859659694 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9c007430 con 0x7f0e98005180 2023-10-03T19:15:25.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.815+0000 7f0ea2ffd640 1 -- 172.21.15.45:0/859659694 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c0047f0 con 0x7f0e98005180 2023-10-03T19:15:25.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.815+0000 7f0eb0fb6640 1 -- 172.21.15.45:0/859659694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eac14f1b0 con 0x7f0e98005180 2023-10-03T19:15:25.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.815+0000 7f0eb0fb6640 1 -- 172.21.15.45:0/859659694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eac065690 con 0x7f0e98005180 2023-10-03T19:15:25.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.815+0000 7f0eb0fb6640 1 -- 172.21.15.45:0/859659694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eac04de80 con 0x7f0e98005180 2023-10-03T19:15:25.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.815+0000 7f0ea2ffd640 1 -- 172.21.15.45:0/859659694 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0e9c004950 con 0x7f0e98005180 2023-10-03T19:15:25.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.815+0000 7f0ea2ffd640 1 --2- 172.21.15.45:0/859659694 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0e8c066280 0x7f0e8c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:25.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.815+0000 7f0ea2ffd640 1 -- 172.21.15.45:0/859659694 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f0e9c083770 con 0x7f0e98005180 2023-10-03T19:15:25.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.815+0000 7f0ea3fff640 1 --2- 172.21.15.45:0/859659694 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0e8c066280 0x7f0e8c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:25.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.819+0000 7f0ea3fff640 1 --2- 172.21.15.45:0/859659694 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0e8c066280 0x7f0e8c068730 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0e94007fd0 tx=0x7f0e94009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:25.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.819+0000 7f0ea2ffd640 1 -- 172.21.15.45:0/859659694 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0e9c050cb0 con 0x7f0e98005180 2023-10-03T19:15:25.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:25.979+0000 7f0eb0fb6640 1 -- 172.21.15.45:0/859659694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0eac1e4740 con 0x7f0e98005180 2023-10-03T19:15:26.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:26.671+0000 7f0ea2ffd640 1 -- 172.21.15.45:0/859659694 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v39) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0e9c0542d0 con 0x7f0e98005180 2023-10-03T19:15:26.856 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-10-03T19:15:26.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:26.675+0000 7f0eb0fb6640 1 -- 172.21.15.45:0/859659694 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0e8c066280 msgr2=0x7f0e8c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:26.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:26.675+0000 7f0eb0fb6640 1 --2- 172.21.15.45:0/859659694 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0e8c066280 0x7f0e8c068730 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0e94007fd0 tx=0x7f0e94009040 comp rx=0 tx=0).stop 2023-10-03T19:15:26.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:26.675+0000 7f0eb0fb6640 1 -- 172.21.15.45:0/859659694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e98005180 msgr2=0x7f0eac149610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:26.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:26.675+0000 7f0eb0fb6640 1 --2- 172.21.15.45:0/859659694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e98005180 0x7f0eac149610 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c00d6f0 tx=0x7f0e9c00dbb0 comp rx=0 tx=0).stop 2023-10-03T19:15:26.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:26.675+0000 7f0eb0fb6640 1 -- 172.21.15.45:0/859659694 shutdown_connections 2023-10-03T19:15:26.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:26.675+0000 7f0eb0fb6640 1 --2- 172.21.15.45:0/859659694 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0e8c066280 0x7f0e8c068730 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:26.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:26.675+0000 7f0eb0fb6640 1 --2- 172.21.15.45:0/859659694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0eac071240 0x7f0eac14de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:26.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:26.675+0000 7f0eb0fb6640 1 --2- 172.21.15.45:0/859659694 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0eac149e00 0x7f0eac142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:26.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:26.675+0000 7f0eb0fb6640 1 --2- 172.21.15.45:0/859659694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e98005180 0x7f0eac149610 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:26.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:26.675+0000 7f0eb0fb6640 1 -- 172.21.15.45:0/859659694 >> 172.21.15.45:0/859659694 conn(0x7f0eac0c1510 msgr2=0x7f0eac0bdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:26.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:26.675+0000 7f0eb0fb6640 1 -- 172.21.15.45:0/859659694 shutdown_connections 2023-10-03T19:15:26.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:26.675+0000 7f0eb0fb6640 1 -- 172.21.15.45:0/859659694 wait complete. 2023-10-03T19:15:26.861 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-03T19:15:27.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.003+0000 7f853ce85640 1 Processor -- start 2023-10-03T19:15:27.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.003+0000 7f853ce85640 1 -- start start 2023-10-03T19:15:27.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.003+0000 7f853ce85640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f853806f880 0x7f85380a5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:27.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.003+0000 7f853ce85640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f853814f510 0x7f853814b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:27.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.003+0000 7f853ce85640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f853814f080 con 0x7f85380bd9f0 2023-10-03T19:15:27.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.003+0000 7f853ce85640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f853806f3e0 con 0x7f853806f880 2023-10-03T19:15:27.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.003+0000 7f853ce85640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8538070e90 con 0x7f853814f510 2023-10-03T19:15:27.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.003+0000 7f853659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f853806f880 0x7f85380a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:27.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.003+0000 7f853659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f853806f880 0x7f85380a5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40448/0 (socket says 172.21.15.45:40448) 2023-10-03T19:15:27.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.003+0000 7f853659c640 1 -- 172.21.15.45:0/3469778959 learned_addr learned my addr 172.21.15.45:0/3469778959 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:27.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.003+0000 7f8535d9b640 1 --2- 172.21.15.45:0/3469778959 >> v2:172.21.15.79:3300/0 conn(0x7f853814f510 0x7f853814b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:27.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.003+0000 7f853659c640 1 -- 172.21.15.45:0/3469778959 >> v2:172.21.15.79:3300/0 conn(0x7f853814f510 msgr2=0x7f853814b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:27.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.003+0000 7f853659c640 1 --2- 172.21.15.45:0/3469778959 >> v2:172.21.15.79:3300/0 conn(0x7f853814f510 0x7f853814b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:27.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.003+0000 7f853659c640 1 -- 172.21.15.45:0/3469778959 >> v1:172.21.15.79:6789/0 conn(0x7f85380bd9f0 legacy=0x7f85380badc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:27.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.003+0000 7f853659c640 1 -- 172.21.15.45:0/3469778959 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853814ea30 con 0x7f853806f880 2023-10-03T19:15:27.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f853659c640 1 --2- 172.21.15.45:0/3469778959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f853806f880 0x7f85380a5940 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f85380712b0 tx=0x7f852801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805334d22c1709e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:27.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f853559a640 1 -- 172.21.15.45:0/3469778959 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85280ab5f0 con 0x7f853806f880 2023-10-03T19:15:27.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f853559a640 1 -- 172.21.15.45:0/3469778959 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85280ab750 con 0x7f853806f880 2023-10-03T19:15:27.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f853559a640 1 -- 172.21.15.45:0/3469778959 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85280abae0 con 0x7f853806f880 2023-10-03T19:15:27.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f853ce85640 1 -- 172.21.15.45:0/3469778959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f853806f880 msgr2=0x7f85380a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:27.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f853ce85640 1 --2- 172.21.15.45:0/3469778959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f853806f880 0x7f85380a5940 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f85380712b0 tx=0x7f852801c490 comp rx=0 tx=0).stop 2023-10-03T19:15:27.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f853ce85640 1 -- 172.21.15.45:0/3469778959 shutdown_connections 2023-10-03T19:15:27.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f853ce85640 1 --2- 172.21.15.45:0/3469778959 >> v2:172.21.15.79:3300/0 conn(0x7f853814f510 0x7f853814b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:27.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f853ce85640 1 --2- 172.21.15.45:0/3469778959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f853806f880 0x7f85380a5940 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:27.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f853ce85640 1 -- 172.21.15.45:0/3469778959 >> 172.21.15.45:0/3469778959 conn(0x7f85380a20d0 msgr2=0x7f85380a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:27.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f853ce85640 1 -- 172.21.15.45:0/3469778959 shutdown_connections 2023-10-03T19:15:27.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f853ce85640 1 -- 172.21.15.45:0/3469778959 wait complete. 2023-10-03T19:15:27.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f853ce85640 1 Processor -- start 2023-10-03T19:15:27.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f853ce85640 1 -- start start 2023-10-03T19:15:27.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f853ce85640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f853806f880 0x7f85380be010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:27.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f853ce85640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85380bd9f0 0x7f8538145ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:27.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f853ce85640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f853814f510 0x7f85380bfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:27.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f853ce85640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8538155af0 con 0x7f853806f880 2023-10-03T19:15:27.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f853ce85640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8538145ff0 con 0x7f85380bd9f0 2023-10-03T19:15:27.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f853ce85640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8538154140 con 0x7f853814f510 2023-10-03T19:15:27.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f853659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f853806f880 0x7f85380be010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:27.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f853659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f853806f880 0x7f85380be010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40450/0 (socket says 172.21.15.45:40450) 2023-10-03T19:15:27.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f853659c640 1 -- 172.21.15.45:0/4185624833 learned_addr learned my addr 172.21.15.45:0/4185624833 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:27.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f8535d9b640 1 --2- 172.21.15.45:0/4185624833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85380bd9f0 0x7f8538145ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:27.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f8536d9d640 1 --2- 172.21.15.45:0/4185624833 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f853814f510 0x7f85380bfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:27.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f853659c640 1 -- 172.21.15.45:0/4185624833 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f853814f510 msgr2=0x7f85380bfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:27.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f853659c640 1 --2- 172.21.15.45:0/4185624833 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f853814f510 0x7f85380bfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:27.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f853659c640 1 -- 172.21.15.45:0/4185624833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85380bd9f0 msgr2=0x7f8538145ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:27.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f853659c640 1 --2- 172.21.15.45:0/4185624833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85380bd9f0 0x7f8538145ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:27.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f853659c640 1 -- 172.21.15.45:0/4185624833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85280094d0 con 0x7f853806f880 2023-10-03T19:15:27.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f8536d9d640 1 --2- 172.21.15.45:0/4185624833 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f853814f510 0x7f85380bfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:15:27.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.007+0000 7f853659c640 1 --2- 172.21.15.45:0/4185624833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f853806f880 0x7f85380be010 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f852801c970 tx=0x7f852801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:27.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.011+0000 7f8526ffd640 1 -- 172.21.15.45:0/4185624833 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85280be5f0 con 0x7f853806f880 2023-10-03T19:15:27.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.011+0000 7f8526ffd640 1 -- 172.21.15.45:0/4185624833 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85280be770 con 0x7f853806f880 2023-10-03T19:15:27.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.011+0000 7f853ce85640 1 -- 172.21.15.45:0/4185624833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f853806fc50 con 0x7f853806f880 2023-10-03T19:15:27.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.011+0000 7f8526ffd640 1 -- 172.21.15.45:0/4185624833 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85280beb20 con 0x7f853806f880 2023-10-03T19:15:27.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.011+0000 7f853ce85640 1 -- 172.21.15.45:0/4185624833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f853814bc70 con 0x7f853806f880 2023-10-03T19:15:27.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.011+0000 7f853ce85640 1 -- 172.21.15.45:0/4185624833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8538070a40 con 0x7f853806f880 2023-10-03T19:15:27.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.011+0000 7f8526ffd640 1 -- 172.21.15.45:0/4185624833 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f85280b43f0 con 0x7f853806f880 2023-10-03T19:15:27.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.011+0000 7f8526ffd640 1 --2- 172.21.15.45:0/4185624833 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8518066280 0x7f8518068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:27.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.011+0000 7f8526ffd640 1 -- 172.21.15.45:0/4185624833 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5739+0+0 (secure 0 0 0) 0x7f85280a8050 con 0x7f853806f880 2023-10-03T19:15:27.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.011+0000 7f8535d9b640 1 --2- 172.21.15.45:0/4185624833 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8518066280 0x7f8518068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:27.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.011+0000 7f8535d9b640 1 --2- 172.21.15.45:0/4185624833 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8518066280 0x7f8518068730 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f85380a3740 tx=0x7f852c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:27.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.015+0000 7f8526ffd640 1 -- 172.21.15.45:0/4185624833 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f85280ebd90 con 0x7f853806f880 2023-10-03T19:15:27.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.171+0000 7f853ce85640 1 -- 172.21.15.45:0/4185624833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f853804de80 con 0x7f853806f880 2023-10-03T19:15:27.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.675+0000 7f8526ffd640 1 -- 172.21.15.45:0/4185624833 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v40) v1 ==== 169+0+0 (secure 0 0 0) 0x7f85280ef3b0 con 0x7f853806f880 2023-10-03T19:15:27.752 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-10-03T19:15:27.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.679+0000 7f853ce85640 1 -- 172.21.15.45:0/4185624833 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8518066280 msgr2=0x7f8518068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:27.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.679+0000 7f853ce85640 1 --2- 172.21.15.45:0/4185624833 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8518066280 0x7f8518068730 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f85380a3740 tx=0x7f852c008040 comp rx=0 tx=0).stop 2023-10-03T19:15:27.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.679+0000 7f853ce85640 1 -- 172.21.15.45:0/4185624833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f853806f880 msgr2=0x7f85380be010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:27.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.679+0000 7f853ce85640 1 --2- 172.21.15.45:0/4185624833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f853806f880 0x7f85380be010 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f852801c970 tx=0x7f852801acd0 comp rx=0 tx=0).stop 2023-10-03T19:15:27.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.683+0000 7f853ce85640 1 -- 172.21.15.45:0/4185624833 shutdown_connections 2023-10-03T19:15:27.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.683+0000 7f853ce85640 1 --2- 172.21.15.45:0/4185624833 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8518066280 0x7f8518068730 secure :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f85380a3740 tx=0x7f852c008040 comp rx=0 tx=0).stop 2023-10-03T19:15:27.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.683+0000 7f853ce85640 1 --2- 172.21.15.45:0/4185624833 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f853814f510 0x7f85380bfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:27.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.683+0000 7f853ce85640 1 --2- 172.21.15.45:0/4185624833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85380bd9f0 0x7f8538145ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:27.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.683+0000 7f853ce85640 1 --2- 172.21.15.45:0/4185624833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f853806f880 0x7f85380be010 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:27.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.683+0000 7f853ce85640 1 -- 172.21.15.45:0/4185624833 >> 172.21.15.45:0/4185624833 conn(0x7f85380a20d0 msgr2=0x7f8538147a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:27.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.687+0000 7f853ce85640 1 -- 172.21.15.45:0/4185624833 shutdown_connections 2023-10-03T19:15:27.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.687+0000 7f853ce85640 1 -- 172.21.15.45:0/4185624833 wait complete. 2023-10-03T19:15:27.755 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-03T19:15:27.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.887+0000 7f0734732640 1 Processor -- start 2023-10-03T19:15:27.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.887+0000 7f0734732640 1 -- start start 2023-10-03T19:15:27.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f0734732640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f072c0712c0 0x7f072c0bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:27.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f0734732640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f072c06c2d0 con 0x7f072c06c760 2023-10-03T19:15:27.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f0734732640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f072c150610 con 0x7f072c06d560 2023-10-03T19:15:27.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f0734732640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f072c1508b0 con 0x7f072c0712c0 2023-10-03T19:15:27.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f0732ccf640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f072c06c760 0x7f072c0a5ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41890/0 (socket says 172.21.15.45:41890) 2023-10-03T19:15:27.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f0732ccf640 1 -- 172.21.15.45:0/2262268485 learned_addr learned my addr 172.21.15.45:0/2262268485 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:15:27.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f07324ce640 1 --2- 172.21.15.45:0/2262268485 >> v2:172.21.15.79:3300/0 conn(0x7f072c0712c0 0x7f072c0bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:28.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f07314cc640 1 -- 172.21.15.45:0/2262268485 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3588769475 0 0) 0x7f072c06c2d0 con 0x7f072c06c760 2023-10-03T19:15:28.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f07314cc640 1 -- 172.21.15.45:0/2262268485 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0714003530 con 0x7f072c06c760 2023-10-03T19:15:28.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f07314cc640 1 -- 172.21.15.45:0/2262268485 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1536370525 0 0) 0x7f0714003530 con 0x7f072c06c760 2023-10-03T19:15:28.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f07314cc640 1 -- 172.21.15.45:0/2262268485 >> v2:172.21.15.79:3300/0 conn(0x7f072c0712c0 msgr2=0x7f072c0bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:28.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f07314cc640 1 --2- 172.21.15.45:0/2262268485 >> v2:172.21.15.79:3300/0 conn(0x7f072c0712c0 0x7f072c0bcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:28.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f07314cc640 1 -- 172.21.15.45:0/2262268485 >> v1:172.21.15.79:6789/0 conn(0x7f072c06d560 legacy=0x7f072c0a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:28.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f07314cc640 1 -- 172.21.15.45:0/2262268485 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072c06d2e0 con 0x7f072c06c760 2023-10-03T19:15:28.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f07314cc640 1 -- 172.21.15.45:0/2262268485 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f071c001680 con 0x7f072c06c760 2023-10-03T19:15:28.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f07314cc640 1 -- 172.21.15.45:0/2262268485 >> v1:172.21.15.45:6789/0 conn(0x7f072c06c760 legacy=0x7f072c0a5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:28.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f07314cc640 1 --2- 172.21.15.45:0/2262268485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0714003980 0x7f0714003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:28.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f07314cc640 1 --2- 172.21.15.45:0/2262268485 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07140047d0 0x7f0714004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:28.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f07314cc640 1 --2- 172.21.15.45:0/2262268485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0714005180 0x7f071400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:28.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f07314cc640 1 -- 172.21.15.45:0/2262268485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072c1508b0 con 0x7f0714003980 2023-10-03T19:15:28.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f07314cc640 1 -- 172.21.15.45:0/2262268485 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071400c000 con 0x7f0714005180 2023-10-03T19:15:28.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f07314cc640 1 -- 172.21.15.45:0/2262268485 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071400c1c0 con 0x7f07140047d0 2023-10-03T19:15:28.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f07324ce640 1 --2- 172.21.15.45:0/2262268485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0714003980 0x7f0714003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:28.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f0731ccd640 1 --2- 172.21.15.45:0/2262268485 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07140047d0 0x7f0714004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:28.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f07324ce640 1 -- 172.21.15.45:0/2262268485 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07140047d0 msgr2=0x7f0714004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:28.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f07324ce640 1 --2- 172.21.15.45:0/2262268485 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07140047d0 0x7f0714004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:28.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f07324ce640 1 -- 172.21.15.45:0/2262268485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0714005180 msgr2=0x7f071400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:28.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f07324ce640 1 --2- 172.21.15.45:0/2262268485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0714005180 0x7f071400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:28.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f0732ccf640 1 -- 172.21.15.45:0/2262268485 reap_dead start 2023-10-03T19:15:28.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f07324ce640 1 -- 172.21.15.45:0/2262268485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0714003530 con 0x7f0714003980 2023-10-03T19:15:28.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.891+0000 7f07324ce640 1 --2- 172.21.15.45:0/2262268485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0714003980 0x7f0714003d90 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0724009fc0 tx=0x7f072401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe5c2b3ab0c7871a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:28.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f07314cc640 1 -- 172.21.15.45:0/2262268485 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07240a5ad0 con 0x7f0714003980 2023-10-03T19:15:28.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f07314cc640 1 -- 172.21.15.45:0/2262268485 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072400f040 con 0x7f0714003980 2023-10-03T19:15:28.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f07314cc640 1 -- 172.21.15.45:0/2262268485 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07240a5e70 con 0x7f0714003980 2023-10-03T19:15:28.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f0734732640 1 -- 172.21.15.45:0/2262268485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0714003980 msgr2=0x7f0714003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:28.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f0734732640 1 --2- 172.21.15.45:0/2262268485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0714003980 0x7f0714003d90 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0724009fc0 tx=0x7f072401cca0 comp rx=0 tx=0).stop 2023-10-03T19:15:28.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f0734732640 1 -- 172.21.15.45:0/2262268485 shutdown_connections 2023-10-03T19:15:28.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f0734732640 1 --2- 172.21.15.45:0/2262268485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0714003980 0x7f0714003d90 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:28.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f0734732640 1 -- 172.21.15.45:0/2262268485 >> 172.21.15.45:0/2262268485 conn(0x7f072c0a20d0 msgr2=0x7f072c0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:28.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f0734732640 1 -- 172.21.15.45:0/2262268485 shutdown_connections 2023-10-03T19:15:28.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f0734732640 1 -- 172.21.15.45:0/2262268485 wait complete. 2023-10-03T19:15:28.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f0734732640 1 Processor -- start 2023-10-03T19:15:28.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f0734732640 1 -- start start 2023-10-03T19:15:28.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f0734732640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0714003980 0x7f072c14ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:28.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f0734732640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f072c146e90 0x7f072c146490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:28.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f0734732640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f072c14e2f0 0x7f072c0b5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:28.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f0734732640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072c0b5500 con 0x7f072c146e90 2023-10-03T19:15:28.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f0734732640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072c1e87f0 con 0x7f0714003980 2023-10-03T19:15:28.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f0734732640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072c1e8d20 con 0x7f072c14e2f0 2023-10-03T19:15:28.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f0731ccd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f072c146e90 0x7f072c146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:28.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f0731ccd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f072c146e90 0x7f072c146490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40464/0 (socket says 172.21.15.45:40464) 2023-10-03T19:15:28.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f0731ccd640 1 -- 172.21.15.45:0/3954505155 learned_addr learned my addr 172.21.15.45:0/3954505155 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:28.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f07324ce640 1 --2- 172.21.15.45:0/3954505155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0714003980 0x7f072c14ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:28.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f0732ccf640 1 --2- 172.21.15.45:0/3954505155 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f072c14e2f0 0x7f072c0b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:28.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f0731ccd640 1 -- 172.21.15.45:0/3954505155 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f072c14e2f0 msgr2=0x7f072c0b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:28.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f0731ccd640 1 --2- 172.21.15.45:0/3954505155 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f072c14e2f0 0x7f072c0b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:28.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f0731ccd640 1 -- 172.21.15.45:0/3954505155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0714003980 msgr2=0x7f072c14ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:28.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f0731ccd640 1 --2- 172.21.15.45:0/3954505155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0714003980 0x7f072c14ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:28.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f0731ccd640 1 -- 172.21.15.45:0/3954505155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072c0a5550 con 0x7f072c146e90 2023-10-03T19:15:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f07324ce640 1 --2- 172.21.15.45:0/3954505155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0714003980 0x7f072c14ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:15:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f0732ccf640 1 --2- 172.21.15.45:0/3954505155 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f072c14e2f0 0x7f072c0b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:15:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f0731ccd640 1 --2- 172.21.15.45:0/3954505155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f072c146e90 0x7f072c146490 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f072000d570 tx=0x7f072000da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f072affd640 1 -- 172.21.15.45:0/3954505155 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0720005480 con 0x7f072c146e90 2023-10-03T19:15:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f072affd640 1 -- 172.21.15.45:0/3954505155 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0720003620 con 0x7f072c146e90 2023-10-03T19:15:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f072affd640 1 -- 172.21.15.45:0/3954505155 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0720003990 con 0x7f072c146e90 2023-10-03T19:15:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f0734732640 1 -- 172.21.15.45:0/3954505155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f072c0a53c0 con 0x7f072c146e90 2023-10-03T19:15:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.895+0000 7f0734732640 1 -- 172.21.15.45:0/3954505155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f072c0a56e0 con 0x7f072c146e90 2023-10-03T19:15:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.899+0000 7f0734732640 1 -- 172.21.15.45:0/3954505155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f072c04de80 con 0x7f072c146e90 2023-10-03T19:15:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.899+0000 7f072affd640 1 -- 172.21.15.45:0/3954505155 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0720003af0 con 0x7f072c146e90 2023-10-03T19:15:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.899+0000 7f072affd640 1 --2- 172.21.15.45:0/3954505155 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0718066280 0x7f0718068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.899+0000 7f072affd640 1 -- 172.21.15.45:0/3954505155 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0720083870 con 0x7f072c146e90 2023-10-03T19:15:28.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.899+0000 7f07324ce640 1 --2- 172.21.15.45:0/3954505155 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0718066280 0x7f0718068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:28.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.899+0000 7f07324ce640 1 --2- 172.21.15.45:0/3954505155 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0718066280 0x7f0718068730 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f07240af000 tx=0x7f07240a7040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:28.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:27.903+0000 7f072affd640 1 -- 172.21.15.45:0/3954505155 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0720051080 con 0x7f072c146e90 2023-10-03T19:15:28.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.067+0000 7f0734732640 1 -- 172.21.15.45:0/3954505155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f072c066d00 con 0x7f072c146e90 2023-10-03T19:15:28.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.071+0000 7f072affd640 1 -- 172.21.15.45:0/3954505155 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f07200546a0 con 0x7f072c146e90 2023-10-03T19:15:28.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.075+0000 7f0734732640 1 -- 172.21.15.45:0/3954505155 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0718066280 msgr2=0x7f0718068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:28.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.075+0000 7f0734732640 1 --2- 172.21.15.45:0/3954505155 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0718066280 0x7f0718068730 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f07240af000 tx=0x7f07240a7040 comp rx=0 tx=0).stop 2023-10-03T19:15:28.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.075+0000 7f0734732640 1 -- 172.21.15.45:0/3954505155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f072c146e90 msgr2=0x7f072c146490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:28.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.075+0000 7f0734732640 1 --2- 172.21.15.45:0/3954505155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f072c146e90 0x7f072c146490 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f072000d570 tx=0x7f072000da30 comp rx=0 tx=0).stop 2023-10-03T19:15:28.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.075+0000 7f0734732640 1 -- 172.21.15.45:0/3954505155 shutdown_connections 2023-10-03T19:15:28.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.075+0000 7f0734732640 1 --2- 172.21.15.45:0/3954505155 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0718066280 0x7f0718068730 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:28.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.075+0000 7f0734732640 1 --2- 172.21.15.45:0/3954505155 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f072c14e2f0 0x7f072c0b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:28.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.075+0000 7f0734732640 1 --2- 172.21.15.45:0/3954505155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f072c146e90 0x7f072c146490 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:28.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.075+0000 7f0734732640 1 --2- 172.21.15.45:0/3954505155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0714003980 0x7f072c14ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:28.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.075+0000 7f0734732640 1 -- 172.21.15.45:0/3954505155 >> 172.21.15.45:0/3954505155 conn(0x7f072c0a20d0 msgr2=0x7f072c0bfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:28.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.075+0000 7f0734732640 1 -- 172.21.15.45:0/3954505155 shutdown_connections 2023-10-03T19:15:28.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.075+0000 7f0734732640 1 -- 172.21.15.45:0/3954505155 wait complete. 2023-10-03T19:15:28.282 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command' 2023-10-03T19:15:28.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.411+0000 7f0247b96640 1 Processor -- start 2023-10-03T19:15:28.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.415+0000 7f0247b96640 1 -- start start 2023-10-03T19:15:28.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.415+0000 7f0247b96640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f02400c2790 0x7f02401528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:28.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.415+0000 7f0247b96640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f02400bb1d0 0x7f02400c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:28.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.415+0000 7f0247b96640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f024006b2d0 con 0x7f024014f240 2023-10-03T19:15:28.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.415+0000 7f0247b96640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f024006b640 con 0x7f02400bb1d0 2023-10-03T19:15:28.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.415+0000 7f0247b96640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02400a3c60 con 0x7f02400c2790 2023-10-03T19:15:28.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.415+0000 7f0245131640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f02400c2790 0x7f02401528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:28.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.415+0000 7f0245131640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f02400c2790 0x7f02401528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:45450/0 (socket says 172.21.15.45:45450) 2023-10-03T19:15:28.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.415+0000 7f0245131640 1 -- 172.21.15.45:0/1856568985 learned_addr learned my addr 172.21.15.45:0/1856568985 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:28.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.415+0000 7f0245131640 1 -- 172.21.15.45:0/1856568985 >> v2:172.21.15.45:3300/0 conn(0x7f02400bb1d0 msgr2=0x7f02400c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:28.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.415+0000 7f0245131640 1 --2- 172.21.15.45:0/1856568985 >> v2:172.21.15.45:3300/0 conn(0x7f02400bb1d0 0x7f02400c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:28.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.415+0000 7f0245131640 1 -- 172.21.15.45:0/1856568985 >> v1:172.21.15.79:6789/0 conn(0x7f024014f240 legacy=0x7f02400c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:28.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.415+0000 7f0245131640 1 -- 172.21.15.45:0/1856568985 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024014e740 con 0x7f02400c2790 2023-10-03T19:15:28.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.419+0000 7f0245131640 1 --2- 172.21.15.45:0/1856568985 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f02400c2790 0x7f02401528d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0230006fd0 tx=0x7f023001ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20de6cddd201758a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:28.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.423+0000 7f0244930640 1 -- 172.21.15.45:0/1856568985 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02300a8990 con 0x7f02400c2790 2023-10-03T19:15:28.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.423+0000 7f0244930640 1 -- 172.21.15.45:0/1856568985 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02300a8af0 con 0x7f02400c2790 2023-10-03T19:15:28.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.423+0000 7f0244930640 1 -- 172.21.15.45:0/1856568985 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02300a8e80 con 0x7f02400c2790 2023-10-03T19:15:28.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.423+0000 7f0247b96640 1 -- 172.21.15.45:0/1856568985 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f02400c2790 msgr2=0x7f02401528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:28.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.423+0000 7f0247b96640 1 --2- 172.21.15.45:0/1856568985 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f02400c2790 0x7f02401528d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0230006fd0 tx=0x7f023001ecd0 comp rx=0 tx=0).stop 2023-10-03T19:15:28.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.423+0000 7f0247b96640 1 -- 172.21.15.45:0/1856568985 shutdown_connections 2023-10-03T19:15:28.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.423+0000 7f0247b96640 1 --2- 172.21.15.45:0/1856568985 >> v2:172.21.15.45:3300/0 conn(0x7f02400bb1d0 0x7f02400c12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:28.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.423+0000 7f0247b96640 1 --2- 172.21.15.45:0/1856568985 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f02400c2790 0x7f02401528d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:28.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.423+0000 7f0247b96640 1 -- 172.21.15.45:0/1856568985 >> 172.21.15.45:0/1856568985 conn(0x7f02400a64a0 msgr2=0x7f02400a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:28.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.423+0000 7f0247b96640 1 -- 172.21.15.45:0/1856568985 shutdown_connections 2023-10-03T19:15:28.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.427+0000 7f0247b96640 1 -- 172.21.15.45:0/1856568985 wait complete. 2023-10-03T19:15:28.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.427+0000 7f0247b96640 1 Processor -- start 2023-10-03T19:15:28.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.427+0000 7f0247b96640 1 -- start start 2023-10-03T19:15:28.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.427+0000 7f0247b96640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f02400bb1d0 0x7f02400aa280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:28.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.427+0000 7f0247b96640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02400c2790 0x7f02400bdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:28.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.427+0000 7f0245131640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02400c2790 0x7f02400bdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:28.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.427+0000 7f0247b96640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f024014f240 0x7f024013d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:28.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.431+0000 7f0247b96640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02400be160 con 0x7f02400c2790 2023-10-03T19:15:28.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.427+0000 7f0245131640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02400c2790 0x7f02400bdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40468/0 (socket says 172.21.15.45:40468) 2023-10-03T19:15:28.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.431+0000 7f0247b96640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02400bd460 con 0x7f024014f240 2023-10-03T19:15:28.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.431+0000 7f0247b96640 1 -- 172.21.15.45:0/736856253 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f024006ca40 con 0x7f02400bb1d0 2023-10-03T19:15:28.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.431+0000 7f0245131640 1 -- 172.21.15.45:0/736856253 learned_addr learned my addr 172.21.15.45:0/736856253 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:28.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.431+0000 7f0245932640 1 --2- 172.21.15.45:0/736856253 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f02400bb1d0 0x7f02400aa280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:28.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.431+0000 7f0245131640 1 -- 172.21.15.45:0/736856253 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f02400bb1d0 msgr2=0x7f02400aa280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:28.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.431+0000 7f0245131640 1 --2- 172.21.15.45:0/736856253 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f02400bb1d0 0x7f02400aa280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:28.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.431+0000 7f0245131640 1 -- 172.21.15.45:0/736856253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f024014f240 msgr2=0x7f024013d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:28.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.431+0000 7f0245131640 1 --2- 172.21.15.45:0/736856253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f024014f240 0x7f024013d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:28.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.431+0000 7f0245131640 1 -- 172.21.15.45:0/736856253 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0230009480 con 0x7f02400c2790 2023-10-03T19:15:28.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.431+0000 7f0245131640 1 --2- 172.21.15.45:0/736856253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02400c2790 0x7f02400bdc20 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f023001d380 tx=0x7f023001ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:28.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.431+0000 7f02367fc640 1 -- 172.21.15.45:0/736856253 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0230004220 con 0x7f02400c2790 2023-10-03T19:15:28.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.431+0000 7f0247b96640 1 -- 172.21.15.45:0/736856253 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f024014f610 con 0x7f02400c2790 2023-10-03T19:15:28.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.431+0000 7f0247b96640 1 -- 172.21.15.45:0/736856253 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02400a3f40 con 0x7f02400c2790 2023-10-03T19:15:28.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.431+0000 7f02367fc640 1 -- 172.21.15.45:0/736856253 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0230004380 con 0x7f02400c2790 2023-10-03T19:15:28.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.431+0000 7f02367fc640 1 -- 172.21.15.45:0/736856253 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0230006490 con 0x7f02400c2790 2023-10-03T19:15:28.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.431+0000 7f0247b96640 1 -- 172.21.15.45:0/736856253 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0228005260 con 0x7f02400c2790 2023-10-03T19:15:28.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.435+0000 7f02367fc640 1 -- 172.21.15.45:0/736856253 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f02300b7040 con 0x7f02400c2790 2023-10-03T19:15:28.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.435+0000 7f02367fc640 1 --2- 172.21.15.45:0/736856253 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0224066350 0x7f0224068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:28.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.435+0000 7f02367fc640 1 -- 172.21.15.45:0/736856253 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0230120fd0 con 0x7f02400c2790 2023-10-03T19:15:28.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.435+0000 7f0245932640 1 --2- 172.21.15.45:0/736856253 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0224066350 0x7f0224068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:28.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.435+0000 7f0245932640 1 --2- 172.21.15.45:0/736856253 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0224066350 0x7f0224068800 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f023c003cb0 tx=0x7f023c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:28.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.439+0000 7f02367fc640 1 -- 172.21.15.45:0/736856253 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f02300ee750 con 0x7f02400c2790 2023-10-03T19:15:28.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.667+0000 7f0247b96640 1 -- 172.21.15.45:0/736856253 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]} v 0) v1 -- 0x7f0228005510 con 0x7f02400c2790 2023-10-03T19:15:28.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.695+0000 7f02367fc640 1 -- 172.21.15.45:0/736856253 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]}]=0 v145) v1 ==== 139+0+0 (secure 0 0 0) 0x7f02300f1d70 con 0x7f02400c2790 2023-10-03T19:15:28.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.699+0000 7f0247b96640 1 -- 172.21.15.45:0/736856253 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0224066350 msgr2=0x7f0224068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:28.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.699+0000 7f0247b96640 1 --2- 172.21.15.45:0/736856253 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0224066350 0x7f0224068800 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f023c003cb0 tx=0x7f023c009040 comp rx=0 tx=0).stop 2023-10-03T19:15:28.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.699+0000 7f0247b96640 1 -- 172.21.15.45:0/736856253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02400c2790 msgr2=0x7f02400bdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:28.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.699+0000 7f0247b96640 1 --2- 172.21.15.45:0/736856253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02400c2790 0x7f02400bdc20 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f023001d380 tx=0x7f023001ba70 comp rx=0 tx=0).stop 2023-10-03T19:15:28.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.699+0000 7f0247b96640 1 -- 172.21.15.45:0/736856253 shutdown_connections 2023-10-03T19:15:28.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.699+0000 7f0247b96640 1 --2- 172.21.15.45:0/736856253 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0224066350 0x7f0224068800 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:28.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.699+0000 7f0247b96640 1 --2- 172.21.15.45:0/736856253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f024014f240 0x7f024013d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:28.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.699+0000 7f0247b96640 1 --2- 172.21.15.45:0/736856253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02400c2790 0x7f02400bdc20 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:28.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.699+0000 7f0247b96640 1 --2- 172.21.15.45:0/736856253 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f02400bb1d0 0x7f02400aa280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:28.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.699+0000 7f0247b96640 1 -- 172.21.15.45:0/736856253 >> 172.21.15.45:0/736856253 conn(0x7f02400a64a0 msgr2=0x7f0240151900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:28.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.699+0000 7f0247b96640 1 -- 172.21.15.45:0/736856253 shutdown_connections 2023-10-03T19:15:28.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.699+0000 7f0247b96640 1 -- 172.21.15.45:0/736856253 wait complete. 2023-10-03T19:15:28.845 INFO:tasks.cephfs_test_runner:Basic test for checking drop cache command. ... ok 2023-10-03T19:15:28.845 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_dead (tasks.cephfs.test_misc.TestCacheDrop) Check drop cache command with non-responding client using tell 2023-10-03T19:15:28.846 INFO:tasks.cephfs_test_runner:test_drop_cache_command_dead (tasks.cephfs.test_misc.TestCacheDrop) 2023-10-03T19:15:28.846 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead' 2023-10-03T19:15:28.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.975+0000 7f049cac0640 1 Processor -- start 2023-10-03T19:15:29.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.975+0000 7f049cac0640 1 -- start start 2023-10-03T19:15:29.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.975+0000 7f049cac0640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f04980b98f0 0x7f04980b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:29.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.975+0000 7f049cac0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04980bc810 0x7f049806c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:29.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.975+0000 7f049cac0640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04980ba550 con 0x7f04980a2e20 2023-10-03T19:15:29.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.975+0000 7f049cac0640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04981526d0 con 0x7f04980b98f0 2023-10-03T19:15:29.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.975+0000 7f049cac0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04981529b0 con 0x7f04980bc810 2023-10-03T19:15:29.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.975+0000 7f0495d9b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04980bc810 0x7f049806c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:29.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.975+0000 7f049659c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f04980b98f0 0x7f04980b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:29.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.975+0000 7f0495d9b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04980bc810 0x7f049806c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:45466/0 (socket says 172.21.15.45:45466) 2023-10-03T19:15:29.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.975+0000 7f0495d9b640 1 -- 172.21.15.45:0/4083066044 learned_addr learned my addr 172.21.15.45:0/4083066044 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:29.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.975+0000 7f0495d9b640 1 -- 172.21.15.45:0/4083066044 >> v2:172.21.15.79:3300/0 conn(0x7f04980b98f0 msgr2=0x7f04980b9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:29.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.975+0000 7f0495d9b640 1 --2- 172.21.15.45:0/4083066044 >> v2:172.21.15.79:3300/0 conn(0x7f04980b98f0 0x7f04980b9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:29.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.975+0000 7f0495d9b640 1 -- 172.21.15.45:0/4083066044 >> v1:172.21.15.79:6789/0 conn(0x7f04980a2e20 legacy=0x7f049806c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:29.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.975+0000 7f0495d9b640 1 -- 172.21.15.45:0/4083066044 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049806cee0 con 0x7f04980bc810 2023-10-03T19:15:29.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.979+0000 7f0495d9b640 1 --2- 172.21.15.45:0/4083066044 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04980bc810 0x7f049806c290 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0490009e50 tx=0x7f049001f1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49dd52e31b6570fb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:29.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.979+0000 7f049559a640 1 -- 172.21.15.45:0/4083066044 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04900af400 con 0x7f04980bc810 2023-10-03T19:15:29.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.979+0000 7f049559a640 1 -- 172.21.15.45:0/4083066044 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04900ab050 con 0x7f04980bc810 2023-10-03T19:15:29.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.979+0000 7f049559a640 1 -- 172.21.15.45:0/4083066044 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04900af780 con 0x7f04980bc810 2023-10-03T19:15:29.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.979+0000 7f049cac0640 1 -- 172.21.15.45:0/4083066044 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04980bc810 msgr2=0x7f049806c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:29.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.979+0000 7f049cac0640 1 --2- 172.21.15.45:0/4083066044 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04980bc810 0x7f049806c290 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0490009e50 tx=0x7f049001f1f0 comp rx=0 tx=0).stop 2023-10-03T19:15:29.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.979+0000 7f049cac0640 1 -- 172.21.15.45:0/4083066044 shutdown_connections 2023-10-03T19:15:29.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.979+0000 7f049cac0640 1 --2- 172.21.15.45:0/4083066044 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04980bc810 0x7f049806c290 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:29.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.979+0000 7f049cac0640 1 --2- 172.21.15.45:0/4083066044 >> v2:172.21.15.79:3300/0 conn(0x7f04980b98f0 0x7f04980b9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:29.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.979+0000 7f049cac0640 1 -- 172.21.15.45:0/4083066044 >> 172.21.15.45:0/4083066044 conn(0x7f04980bcf50 msgr2=0x7f04980bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:29.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.979+0000 7f049cac0640 1 -- 172.21.15.45:0/4083066044 shutdown_connections 2023-10-03T19:15:29.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.979+0000 7f049cac0640 1 -- 172.21.15.45:0/4083066044 wait complete. 2023-10-03T19:15:29.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.983+0000 7f049cac0640 1 Processor -- start 2023-10-03T19:15:29.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.983+0000 7f049cac0640 1 -- start start 2023-10-03T19:15:29.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.983+0000 7f049cac0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04980a2e20 0x7f049814ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:29.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.983+0000 7f049cac0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04980b98f0 0x7f04981da180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:29.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.983+0000 7f049cac0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04980bc810 0x7f04981da6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:29.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.983+0000 7f049cac0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049814b240 con 0x7f04980a2e20 2023-10-03T19:15:29.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.983+0000 7f049cac0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0498151ee0 con 0x7f04980b98f0 2023-10-03T19:15:29.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.983+0000 7f049cac0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04981e7a00 con 0x7f04980bc810 2023-10-03T19:15:29.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.983+0000 7f049659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04980a2e20 0x7f049814ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:29.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.983+0000 7f049659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04980a2e20 0x7f049814ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40474/0 (socket says 172.21.15.45:40474) 2023-10-03T19:15:29.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.983+0000 7f049659c640 1 -- 172.21.15.45:0/3549695662 learned_addr learned my addr 172.21.15.45:0/3549695662 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:29.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.983+0000 7f0495d9b640 1 --2- 172.21.15.45:0/3549695662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04980b98f0 0x7f04981da180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:29.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.983+0000 7f0496d9d640 1 --2- 172.21.15.45:0/3549695662 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04980bc810 0x7f04981da6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:29.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.983+0000 7f049659c640 1 -- 172.21.15.45:0/3549695662 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04980bc810 msgr2=0x7f04981da6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:29.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.983+0000 7f049659c640 1 --2- 172.21.15.45:0/3549695662 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04980bc810 0x7f04981da6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:29.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.983+0000 7f049659c640 1 -- 172.21.15.45:0/3549695662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04980b98f0 msgr2=0x7f04981da180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:29.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.983+0000 7f049659c640 1 --2- 172.21.15.45:0/3549695662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04980b98f0 0x7f04981da180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:29.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.983+0000 7f049659c640 1 -- 172.21.15.45:0/3549695662 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0490009b30 con 0x7f04980a2e20 2023-10-03T19:15:29.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.983+0000 7f049659c640 1 --2- 172.21.15.45:0/3549695662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04980a2e20 0x7f049814ad00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f048800e930 tx=0x7f048800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:29.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.983+0000 7f048effd640 1 -- 172.21.15.45:0/3549695662 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0488009690 con 0x7f04980a2e20 2023-10-03T19:15:29.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.983+0000 7f048effd640 1 -- 172.21.15.45:0/3549695662 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048800ca00 con 0x7f04980a2e20 2023-10-03T19:15:29.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.983+0000 7f049cac0640 1 -- 172.21.15.45:0/3549695662 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04980ba950 con 0x7f04980a2e20 2023-10-03T19:15:29.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.983+0000 7f048effd640 1 -- 172.21.15.45:0/3549695662 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048800cd70 con 0x7f04980a2e20 2023-10-03T19:15:29.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.983+0000 7f049cac0640 1 -- 172.21.15.45:0/3549695662 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04980ba200 con 0x7f04980a2e20 2023-10-03T19:15:29.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.983+0000 7f049cac0640 1 -- 172.21.15.45:0/3549695662 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04980baae0 con 0x7f04980a2e20 2023-10-03T19:15:29.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.983+0000 7f048effd640 1 -- 172.21.15.45:0/3549695662 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0488013470 con 0x7f04980a2e20 2023-10-03T19:15:29.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.987+0000 7f048effd640 1 --2- 172.21.15.45:0/3549695662 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f047c0662b0 0x7f047c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:29.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.987+0000 7f048effd640 1 -- 172.21.15.45:0/3549695662 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0488084040 con 0x7f04980a2e20 2023-10-03T19:15:29.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.987+0000 7f0495d9b640 1 --2- 172.21.15.45:0/3549695662 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f047c0662b0 0x7f047c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:29.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.987+0000 7f0495d9b640 1 --2- 172.21.15.45:0/3549695662 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f047c0662b0 0x7f047c068760 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f04900b1000 tx=0x7f04900aa000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:29.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:28.991+0000 7f048effd640 1 -- 172.21.15.45:0/3549695662 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f04880b46f0 con 0x7f04980a2e20 2023-10-03T19:15:29.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.199+0000 7f049cac0640 1 -- 172.21.15.45:0/3549695662 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]} v 0) v1 -- 0x7f049804de80 con 0x7f04980a2e20 2023-10-03T19:15:29.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.699+0000 7f048effd640 1 -- 172.21.15.45:0/3549695662 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]}]=0 v146) v1 ==== 147+0+0 (secure 0 0 0) 0x7f0488051890 con 0x7f04980a2e20 2023-10-03T19:15:29.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.703+0000 7f049cac0640 1 -- 172.21.15.45:0/3549695662 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f047c0662b0 msgr2=0x7f047c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:29.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.703+0000 7f049cac0640 1 --2- 172.21.15.45:0/3549695662 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f047c0662b0 0x7f047c068760 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f04900b1000 tx=0x7f04900aa000 comp rx=0 tx=0).stop 2023-10-03T19:15:29.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.703+0000 7f049cac0640 1 -- 172.21.15.45:0/3549695662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04980a2e20 msgr2=0x7f049814ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:29.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.703+0000 7f049cac0640 1 --2- 172.21.15.45:0/3549695662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04980a2e20 0x7f049814ad00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f048800e930 tx=0x7f048800edf0 comp rx=0 tx=0).stop 2023-10-03T19:15:29.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.703+0000 7f049cac0640 1 -- 172.21.15.45:0/3549695662 shutdown_connections 2023-10-03T19:15:29.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.703+0000 7f049cac0640 1 --2- 172.21.15.45:0/3549695662 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f047c0662b0 0x7f047c068760 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:29.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.703+0000 7f049cac0640 1 --2- 172.21.15.45:0/3549695662 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04980bc810 0x7f04981da6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:29.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.703+0000 7f049cac0640 1 --2- 172.21.15.45:0/3549695662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04980b98f0 0x7f04981da180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:29.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.703+0000 7f049cac0640 1 --2- 172.21.15.45:0/3549695662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04980a2e20 0x7f049814ad00 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:29.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.703+0000 7f049cac0640 1 -- 172.21.15.45:0/3549695662 >> 172.21.15.45:0/3549695662 conn(0x7f04980bcf50 msgr2=0x7f0498147050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:29.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.703+0000 7f049cac0640 1 -- 172.21.15.45:0/3549695662 shutdown_connections 2023-10-03T19:15:29.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.703+0000 7f049cac0640 1 -- 172.21.15.45:0/3549695662 wait complete. 2023-10-03T19:15:29.854 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-03T19:15:29.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.991+0000 7f11fc3ef640 1 Processor -- start 2023-10-03T19:15:30.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.991+0000 7f11fc3ef640 1 -- start start 2023-10-03T19:15:30.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.991+0000 7f11fc3ef640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f11f40c14e0 0x7f11f40c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:30.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.991+0000 7f11fc3ef640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f11f40c2770 0x7f11f40a9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:30.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.991+0000 7f11fc3ef640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11f406ac70 con 0x7f11f40bf1f0 2023-10-03T19:15:30.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.991+0000 7f11fc3ef640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f406aae0 con 0x7f11f40c2770 2023-10-03T19:15:30.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.991+0000 7f11fc3ef640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f40c3000 con 0x7f11f40c14e0 2023-10-03T19:15:30.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.991+0000 7f11fa98c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f11f40c2770 0x7f11f40a9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:30.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.991+0000 7f11fa98c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f11f40c2770 0x7f11f40a9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40476/0 (socket says 172.21.15.45:40476) 2023-10-03T19:15:30.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.991+0000 7f11fa98c640 1 -- 172.21.15.45:0/3873320313 learned_addr learned my addr 172.21.15.45:0/3873320313 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:30.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.991+0000 7f11fa18b640 1 --2- 172.21.15.45:0/3873320313 >> v2:172.21.15.79:3300/0 conn(0x7f11f40c14e0 0x7f11f40c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:30.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.991+0000 7f11fa98c640 1 -- 172.21.15.45:0/3873320313 >> v2:172.21.15.79:3300/0 conn(0x7f11f40c14e0 msgr2=0x7f11f40c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:30.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.991+0000 7f11fa98c640 1 --2- 172.21.15.45:0/3873320313 >> v2:172.21.15.79:3300/0 conn(0x7f11f40c14e0 0x7f11f40c0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:30.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.991+0000 7f11fa98c640 1 -- 172.21.15.45:0/3873320313 >> v1:172.21.15.79:6789/0 conn(0x7f11f40bf1f0 legacy=0x7f11f40a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:30.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.991+0000 7f11fa98c640 1 -- 172.21.15.45:0/3873320313 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f40aa5f0 con 0x7f11f40c2770 2023-10-03T19:15:30.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.991+0000 7f11fa98c640 1 --2- 172.21.15.45:0/3873320313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11f40c2770 0x7f11f40a9f70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f11f408aaa0 tx=0x7f11ec01f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e59742bec4f6faf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:30.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.991+0000 7f11f9189640 1 -- 172.21.15.45:0/3873320313 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec0af400 con 0x7f11f40c2770 2023-10-03T19:15:30.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11f9189640 1 -- 172.21.15.45:0/3873320313 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ec0ab050 con 0x7f11f40c2770 2023-10-03T19:15:30.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11f9189640 1 -- 172.21.15.45:0/3873320313 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec0af780 con 0x7f11f40c2770 2023-10-03T19:15:30.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11fc3ef640 1 -- 172.21.15.45:0/3873320313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11f40c2770 msgr2=0x7f11f40a9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:30.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11fc3ef640 1 --2- 172.21.15.45:0/3873320313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11f40c2770 0x7f11f40a9f70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f11f408aaa0 tx=0x7f11ec01f180 comp rx=0 tx=0).stop 2023-10-03T19:15:30.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11fc3ef640 1 -- 172.21.15.45:0/3873320313 shutdown_connections 2023-10-03T19:15:30.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11fc3ef640 1 --2- 172.21.15.45:0/3873320313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11f40c2770 0x7f11f40a9f70 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:30.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11fc3ef640 1 --2- 172.21.15.45:0/3873320313 >> v2:172.21.15.79:3300/0 conn(0x7f11f40c14e0 0x7f11f40c0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:30.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11fc3ef640 1 -- 172.21.15.45:0/3873320313 >> 172.21.15.45:0/3873320313 conn(0x7f11f40a6440 msgr2=0x7f11f40a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:30.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11fc3ef640 1 -- 172.21.15.45:0/3873320313 shutdown_connections 2023-10-03T19:15:30.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11fc3ef640 1 -- 172.21.15.45:0/3873320313 wait complete. 2023-10-03T19:15:30.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11fc3ef640 1 Processor -- start 2023-10-03T19:15:30.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11fc3ef640 1 -- start start 2023-10-03T19:15:30.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11fc3ef640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11f40bf1f0 0x7f11f40bdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:30.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11fc3ef640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f11f40c14e0 0x7f11f40b8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:30.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11fc3ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11f40c2770 0x7f11f41e6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:30.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11fc3ef640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f40b8920 con 0x7f11f40c2770 2023-10-03T19:15:30.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11fc3ef640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f40be2b0 con 0x7f11f40bf1f0 2023-10-03T19:15:30.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11fc3ef640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f40b9280 con 0x7f11f40c14e0 2023-10-03T19:15:30.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11fa98c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11f40c2770 0x7f11f41e6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:30.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11fa98c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11f40c2770 0x7f11f41e6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40492/0 (socket says 172.21.15.45:40492) 2023-10-03T19:15:30.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11fa98c640 1 -- 172.21.15.45:0/1230175643 learned_addr learned my addr 172.21.15.45:0/1230175643 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:30.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11fa18b640 1 --2- 172.21.15.45:0/1230175643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11f40bf1f0 0x7f11f40bdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:30.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11f998a640 1 --2- 172.21.15.45:0/1230175643 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f11f40c14e0 0x7f11f40b8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:30.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11fa98c640 1 -- 172.21.15.45:0/1230175643 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f11f40c14e0 msgr2=0x7f11f40b8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:30.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11fa98c640 1 --2- 172.21.15.45:0/1230175643 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f11f40c14e0 0x7f11f40b8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:30.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11fa98c640 1 -- 172.21.15.45:0/1230175643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11f40bf1f0 msgr2=0x7f11f40bdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:30.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11fa98c640 1 --2- 172.21.15.45:0/1230175643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11f40bf1f0 0x7f11f40bdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:30.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11fa98c640 1 -- 172.21.15.45:0/1230175643 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ec009b30 con 0x7f11f40c2770 2023-10-03T19:15:30.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11fa98c640 1 --2- 172.21.15.45:0/1230175643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11f40c2770 0x7f11f41e6790 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f11ec0b2040 tx=0x7f11ec01bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:30.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11eaffd640 1 -- 172.21.15.45:0/1230175643 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec0afde0 con 0x7f11f40c2770 2023-10-03T19:15:30.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11eaffd640 1 -- 172.21.15.45:0/1230175643 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ec009510 con 0x7f11f40c2770 2023-10-03T19:15:30.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11fc3ef640 1 -- 172.21.15.45:0/1230175643 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f414f530 con 0x7f11f40c2770 2023-10-03T19:15:30.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11eaffd640 1 -- 172.21.15.45:0/1230175643 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec0ba660 con 0x7f11f40c2770 2023-10-03T19:15:30.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.995+0000 7f11fc3ef640 1 -- 172.21.15.45:0/1230175643 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f414f250 con 0x7f11f40c2770 2023-10-03T19:15:30.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.999+0000 7f11fc3ef640 1 -- 172.21.15.45:0/1230175643 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11f406b100 con 0x7f11f40c2770 2023-10-03T19:15:30.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.999+0000 7f11eaffd640 1 -- 172.21.15.45:0/1230175643 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f11ec0b6040 con 0x7f11f40c2770 2023-10-03T19:15:30.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.999+0000 7f11eaffd640 1 --2- 172.21.15.45:0/1230175643 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f11d8066280 0x7f11d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:30.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.999+0000 7f11eaffd640 1 -- 172.21.15.45:0/1230175643 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f11ec121b20 con 0x7f11f40c2770 2023-10-03T19:15:30.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.999+0000 7f11fa18b640 1 --2- 172.21.15.45:0/1230175643 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f11d8066280 0x7f11d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:30.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:29.999+0000 7f11fa18b640 1 --2- 172.21.15.45:0/1230175643 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f11d8066280 0x7f11d8068730 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f11f0007a60 tx=0x7f11f0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:30.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:30.003+0000 7f11eaffd640 1 -- 172.21.15.45:0/1230175643 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f11ec0ef410 con 0x7f11f40c2770 2023-10-03T19:15:30.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:30.159+0000 7f11fc3ef640 1 -- 172.21.15.45:0/1230175643 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f11f40b8a60 con 0x7f11f40c2770 2023-10-03T19:15:30.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:30.167+0000 7f11eaffd640 1 -- 172.21.15.45:0/1230175643 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f11f40b8a60 con 0x7f11f40c2770 2023-10-03T19:15:30.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:30.167+0000 7f11fc3ef640 1 -- 172.21.15.45:0/1230175643 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f11d8066280 msgr2=0x7f11d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:30.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:30.167+0000 7f11fc3ef640 1 --2- 172.21.15.45:0/1230175643 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f11d8066280 0x7f11d8068730 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f11f0007a60 tx=0x7f11f0008040 comp rx=0 tx=0).stop 2023-10-03T19:15:30.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:30.167+0000 7f11fc3ef640 1 -- 172.21.15.45:0/1230175643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11f40c2770 msgr2=0x7f11f41e6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:30.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:30.167+0000 7f11fc3ef640 1 --2- 172.21.15.45:0/1230175643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11f40c2770 0x7f11f41e6790 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f11ec0b2040 tx=0x7f11ec01bf20 comp rx=0 tx=0).stop 2023-10-03T19:15:30.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:30.167+0000 7f11fc3ef640 1 -- 172.21.15.45:0/1230175643 shutdown_connections 2023-10-03T19:15:30.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:30.167+0000 7f11fc3ef640 1 --2- 172.21.15.45:0/1230175643 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f11d8066280 0x7f11d8068730 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:30.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:30.167+0000 7f11fc3ef640 1 --2- 172.21.15.45:0/1230175643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11f40c2770 0x7f11f41e6790 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:30.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:30.167+0000 7f11fc3ef640 1 --2- 172.21.15.45:0/1230175643 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f11f40c14e0 0x7f11f40b8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:30.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:30.167+0000 7f11fc3ef640 1 --2- 172.21.15.45:0/1230175643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11f40bf1f0 0x7f11f40bdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:30.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:30.167+0000 7f11fc3ef640 1 -- 172.21.15.45:0/1230175643 >> 172.21.15.45:0/1230175643 conn(0x7f11f40a6440 msgr2=0x7f11f40c3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:30.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:30.171+0000 7f11fc3ef640 1 -- 172.21.15.45:0/1230175643 shutdown_connections 2023-10-03T19:15:30.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:30.171+0000 7f11fc3ef640 1 -- 172.21.15.45:0/1230175643 wait complete. 2023-10-03T19:15:30.345 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-03T19:15:30.345 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:15:30.380 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:15:30.572 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:15:30.720 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:15:30.922 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-03T19:15:31.004 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:15:31.004 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:15:31.011 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336540k,nr_inodes=4084135,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16206 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-10-03T19:15:31.167 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-03T19:15:31.167 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:15:31.173 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336540k,nr_inodes=4084135,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=22607 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-10-03T19:15:31.173 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-10-03T19:15:31.328 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:15:31.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.463+0000 7ffbe0425640 1 Processor -- start 2023-10-03T19:15:31.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.463+0000 7ffbe0425640 1 -- start start 2023-10-03T19:15:31.800 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:15:31.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbe0425640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffbd806f170 0x7ffbd8150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:31.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbe0425640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd806cac0 con 0x7ffbd806d170 2023-10-03T19:15:31.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbe0425640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd80720d0 con 0x7ffbd80bc8b0 2023-10-03T19:15:31.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbe0425640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd80a5ab0 con 0x7ffbd806f170 2023-10-03T19:15:31.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbde9c2640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ffbd806d170 0x7ffbd8156e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41900/0 (socket says 172.21.15.45:41900) 2023-10-03T19:15:31.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbde9c2640 1 -- 172.21.15.45:0/3439215927 learned_addr learned my addr 172.21.15.45:0/3439215927 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:15:31.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbde1c1640 1 --2- 172.21.15.45:0/3439215927 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffbd806f170 0x7ffbd8150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:31.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbdd1bf640 1 -- 172.21.15.45:0/3439215927 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1157711967 0 0) 0x7ffbd0001120 con 0x7ffbd806d170 2023-10-03T19:15:31.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbdd1bf640 1 -- 172.21.15.45:0/3439215927 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbc4003530 con 0x7ffbd806d170 2023-10-03T19:15:31.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbdd1bf640 1 -- 172.21.15.45:0/3439215927 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 76006971 0 0) 0x7ffbc4003530 con 0x7ffbd806d170 2023-10-03T19:15:31.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbdd1bf640 1 -- 172.21.15.45:0/3439215927 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffbd806f170 msgr2=0x7ffbd8150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:31.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbdd1bf640 1 --2- 172.21.15.45:0/3439215927 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffbd806f170 0x7ffbd8150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:31.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbdd1bf640 1 -- 172.21.15.45:0/3439215927 >> v1:172.21.15.79:6789/0 conn(0x7ffbd80bc8b0 legacy=0x7ffbd814ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:31.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbdd1bf640 1 -- 172.21.15.45:0/3439215927 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd806cd00 con 0x7ffbd806d170 2023-10-03T19:15:31.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbdd1bf640 1 -- 172.21.15.45:0/3439215927 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7ffbd0001810 con 0x7ffbd806d170 2023-10-03T19:15:31.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbdd1bf640 1 -- 172.21.15.45:0/3439215927 >> v1:172.21.15.45:6789/0 conn(0x7ffbd806d170 legacy=0x7ffbd8156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:31.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbdd1bf640 1 --2- 172.21.15.45:0/3439215927 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffbd806f170 0x7ffbc40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:31.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbdd1bf640 1 --2- 172.21.15.45:0/3439215927 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbc4003f80 0x7ffbc40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:31.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbdd1bf640 1 --2- 172.21.15.45:0/3439215927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbc4004d10 0x7ffbc4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:31.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbdd1bf640 1 -- 172.21.15.45:0/3439215927 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd80a5ab0 con 0x7ffbc4003f80 2023-10-03T19:15:31.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbdd1bf640 1 -- 172.21.15.45:0/3439215927 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc400baa0 con 0x7ffbc4004d10 2023-10-03T19:15:31.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbdd1bf640 1 -- 172.21.15.45:0/3439215927 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc400bc60 con 0x7ffbd806f170 2023-10-03T19:15:31.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbdd9c0640 1 --2- 172.21.15.45:0/3439215927 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbc4003f80 0x7ffbc40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:31.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbde1c1640 1 --2- 172.21.15.45:0/3439215927 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffbd806f170 0x7ffbc40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:31.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbde9c2640 1 --2- 172.21.15.45:0/3439215927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbc4004d10 0x7ffbc4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:31.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbdd9c0640 1 -- 172.21.15.45:0/3439215927 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffbd806f170 msgr2=0x7ffbc40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:31.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbdd9c0640 1 --2- 172.21.15.45:0/3439215927 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffbd806f170 0x7ffbc40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:31.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbdd9c0640 1 -- 172.21.15.45:0/3439215927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbc4004d10 msgr2=0x7ffbc4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:31.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbdd9c0640 1 --2- 172.21.15.45:0/3439215927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbc4004d10 0x7ffbc4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:31.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbdd9c0640 1 -- 172.21.15.45:0/3439215927 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc4003530 con 0x7ffbc4003f80 2023-10-03T19:15:31.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.467+0000 7ffbde9c2640 1 --2- 172.21.15.45:0/3439215927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbc4004d10 0x7ffbc4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:15:31.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbdd9c0640 1 --2- 172.21.15.45:0/3439215927 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbc4003f80 0x7ffbc40047d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4001780 tx=0x7ffbd401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab032048886f2b10 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:31.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbdd1bf640 1 -- 172.21.15.45:0/3439215927 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd40052d0 con 0x7ffbc4003f80 2023-10-03T19:15:31.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbdd1bf640 1 -- 172.21.15.45:0/3439215927 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd40a7050 con 0x7ffbc4003f80 2023-10-03T19:15:31.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbdd1bf640 1 -- 172.21.15.45:0/3439215927 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4003600 con 0x7ffbc4003f80 2023-10-03T19:15:31.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbe0425640 1 -- 172.21.15.45:0/3439215927 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbc4003f80 msgr2=0x7ffbc40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:31.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbe0425640 1 --2- 172.21.15.45:0/3439215927 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbc4003f80 0x7ffbc40047d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4001780 tx=0x7ffbd401c400 comp rx=0 tx=0).stop 2023-10-03T19:15:31.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbde9c2640 1 -- 172.21.15.45:0/3439215927 reap_dead start 2023-10-03T19:15:31.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbe0425640 1 -- 172.21.15.45:0/3439215927 shutdown_connections 2023-10-03T19:15:31.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbe0425640 1 -- 172.21.15.45:0/3439215927 >> 172.21.15.45:0/3439215927 conn(0x7ffbd80bcf50 msgr2=0x7ffbd80bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:31.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbe0425640 1 -- 172.21.15.45:0/3439215927 shutdown_connections 2023-10-03T19:15:31.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbe0425640 1 -- 172.21.15.45:0/3439215927 wait complete. 2023-10-03T19:15:31.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbe0425640 1 Processor -- start 2023-10-03T19:15:31.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbe0425640 1 -- start start 2023-10-03T19:15:31.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbe0425640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffbc4003f80 0x7ffbd80b9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:31.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbe0425640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbd8148950 0x7ffbd8142250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:31.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbe0425640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbd8142790 0x7ffbd81e4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:31.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbe0425640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd80bfa90 con 0x7ffbd8148950 2023-10-03T19:15:31.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbe0425640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd80bec50 con 0x7ffbd8142790 2023-10-03T19:15:31.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbe0425640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd80ba090 con 0x7ffbc4003f80 2023-10-03T19:15:31.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbdd9c0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbd8148950 0x7ffbd8142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:31.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbdd9c0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbd8148950 0x7ffbd8142250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40512/0 (socket says 172.21.15.45:40512) 2023-10-03T19:15:31.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbdd9c0640 1 -- 172.21.15.45:0/3428894852 learned_addr learned my addr 172.21.15.45:0/3428894852 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:31.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbde1c1640 1 --2- 172.21.15.45:0/3428894852 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffbc4003f80 0x7ffbd80b9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:31.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbde9c2640 1 --2- 172.21.15.45:0/3428894852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbd8142790 0x7ffbd81e4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:31.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbdd9c0640 1 -- 172.21.15.45:0/3428894852 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffbc4003f80 msgr2=0x7ffbd80b9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:31.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbdd9c0640 1 --2- 172.21.15.45:0/3428894852 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffbc4003f80 0x7ffbd80b9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:31.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbdd9c0640 1 -- 172.21.15.45:0/3428894852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbd8142790 msgr2=0x7ffbd81e4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:31.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbdd9c0640 1 --2- 172.21.15.45:0/3428894852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbd8142790 0x7ffbd81e4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:31.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbdd9c0640 1 -- 172.21.15.45:0/3428894852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd814c4a0 con 0x7ffbd8148950 2023-10-03T19:15:31.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbdd9c0640 1 --2- 172.21.15.45:0/3428894852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbd8148950 0x7ffbd8142250 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ffbd401c230 tx=0x7ffbc4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:31.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.471+0000 7ffbcaffd640 1 -- 172.21.15.45:0/3428894852 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4007410 con 0x7ffbd8148950 2023-10-03T19:15:31.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.475+0000 7ffbcaffd640 1 -- 172.21.15.45:0/3428894852 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd4007590 con 0x7ffbd8148950 2023-10-03T19:15:31.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.475+0000 7ffbe0425640 1 -- 172.21.15.45:0/3428894852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd814fae0 con 0x7ffbd8148950 2023-10-03T19:15:31.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.475+0000 7ffbcaffd640 1 -- 172.21.15.45:0/3428894852 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4006a20 con 0x7ffbd8148950 2023-10-03T19:15:31.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.475+0000 7ffbe0425640 1 -- 172.21.15.45:0/3428894852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd806f540 con 0x7ffbd8148950 2023-10-03T19:15:31.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.475+0000 7ffbcaffd640 1 -- 172.21.15.45:0/3428894852 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffbd4006b80 con 0x7ffbd8148950 2023-10-03T19:15:31.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.475+0000 7ffbe0425640 1 -- 172.21.15.45:0/3428894852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd806d660 con 0x7ffbd8148950 2023-10-03T19:15:31.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.475+0000 7ffbcaffd640 1 --2- 172.21.15.45:0/3428894852 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ffbbc066280 0x7ffbbc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:31.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.475+0000 7ffbcaffd640 1 -- 172.21.15.45:0/3428894852 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ffbd411df50 con 0x7ffbd8148950 2023-10-03T19:15:31.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.475+0000 7ffbde1c1640 1 --2- 172.21.15.45:0/3428894852 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ffbbc066280 0x7ffbbc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:31.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.475+0000 7ffbde1c1640 1 --2- 172.21.15.45:0/3428894852 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ffbbc066280 0x7ffbbc068730 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc007520 tx=0x7ffbcc00b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:31.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.479+0000 7ffbcaffd640 1 -- 172.21.15.45:0/3428894852 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ffbd40eb7f0 con 0x7ffbd8148950 2023-10-03T19:15:31.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.663+0000 7ffbe0425640 1 -- 172.21.15.45:0/3428894852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffbd804de80 con 0x7ffbd8148950 2023-10-03T19:15:31.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.667+0000 7ffbcaffd640 1 -- 172.21.15.45:0/3428894852 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+2769 (secure 0 0 0) 0x7ffbd40eee10 con 0x7ffbd8148950 2023-10-03T19:15:31.859 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:15:31.859 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4727,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/659816428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":659816428},{"type":"v1","addr":"172.21.15.79:6835","nonce":659816428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5073,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3273073650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3273073650},{"type":"v1","addr":"172.21.15.45:6834","nonce":3273073650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5445,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/4248083336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":4248083336},{"type":"v1","addr":"172.21.15.45:6835","nonce":4248083336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[]} 2023-10-03T19:15:31.860 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 17 2023-10-03T19:15:32.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.667+0000 7ffbe0425640 1 -- 172.21.15.45:0/3428894852 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ffbbc066280 msgr2=0x7ffbbc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:32.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.667+0000 7ffbe0425640 1 --2- 172.21.15.45:0/3428894852 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ffbbc066280 0x7ffbbc068730 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc007520 tx=0x7ffbcc00b040 comp rx=0 tx=0).stop 2023-10-03T19:15:32.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.667+0000 7ffbe0425640 1 -- 172.21.15.45:0/3428894852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbd8148950 msgr2=0x7ffbd8142250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:32.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.667+0000 7ffbe0425640 1 --2- 172.21.15.45:0/3428894852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbd8148950 0x7ffbd8142250 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ffbd401c230 tx=0x7ffbc4005800 comp rx=0 tx=0).stop 2023-10-03T19:15:32.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.667+0000 7ffbe0425640 1 -- 172.21.15.45:0/3428894852 shutdown_connections 2023-10-03T19:15:32.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.667+0000 7ffbe0425640 1 --2- 172.21.15.45:0/3428894852 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ffbbc066280 0x7ffbbc068730 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:32.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.667+0000 7ffbe0425640 1 --2- 172.21.15.45:0/3428894852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbd8142790 0x7ffbd81e4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:32.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.667+0000 7ffbe0425640 1 --2- 172.21.15.45:0/3428894852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbd8148950 0x7ffbd8142250 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:32.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.667+0000 7ffbe0425640 1 --2- 172.21.15.45:0/3428894852 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffbc4003f80 0x7ffbd80b9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:32.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.667+0000 7ffbe0425640 1 -- 172.21.15.45:0/3428894852 >> 172.21.15.45:0/3428894852 conn(0x7ffbd80bcf50 msgr2=0x7ffbd81d79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:32.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.667+0000 7ffbe0425640 1 -- 172.21.15.45:0/3428894852 shutdown_connections 2023-10-03T19:15:32.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:31.667+0000 7ffbe0425640 1 -- 172.21.15.45:0/3428894852 wait complete. 2023-10-03T19:15:32.086 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-03T19:15:32.086 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-03T19:15:32.086 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-03T19:15:32.087 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:15:32.087 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-03T19:15:32.087 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-03T19:15:32.087 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-03T19:15:32.087 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:15:32.087 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-03T19:15:32.088 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-03T19:15:32.088 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-03T19:15:32.088 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:15:32.089 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:15:32.091 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:15:32.093 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:15:37.638 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-10-03T19:15:37.729 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-10-03T19:15:37.730 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-03T19:15:38.278 INFO:tasks.ceph.mds.a:Stopped 2023-10-03T19:15:38.673 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-03T19:15:38.674 INFO:tasks.ceph.mds.c:Stopped 2023-10-03T19:15:38.674 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-03T19:15:38.675 INFO:tasks.ceph.mds.b:Stopped 2023-10-03T19:15:38.675 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-03T19:15:38.677 INFO:tasks.ceph.mds.a:Started 2023-10-03T19:15:38.678 DEBUG:teuthology.parallel:result is None 2023-10-03T19:15:38.828 INFO:tasks.ceph.mds.b:Started 2023-10-03T19:15:38.829 INFO:tasks.ceph.mds.c:Started 2023-10-03T19:15:38.829 INFO:tasks.ceph.mds.b.smithi079.stdout:starting mds.b at 2023-10-03T19:15:38.829 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-10-03T19:15:38.830 DEBUG:teuthology.parallel:result is None 2023-10-03T19:15:38.830 DEBUG:teuthology.parallel:result is None 2023-10-03T19:15:38.830 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-03T19:15:38.830 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-10-03T19:15:38.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.951+0000 7fe150883640 1 Processor -- start 2023-10-03T19:15:39.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.951+0000 7fe150883640 1 -- start start 2023-10-03T19:15:39.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.951+0000 7fe150883640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe14c0be180 0x7fe14c070160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:39.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.951+0000 7fe150883640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14c06f890 con 0x7fe14c149f40 2023-10-03T19:15:39.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.951+0000 7fe150883640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14c1504e0 con 0x7fe14c0b6240 2023-10-03T19:15:39.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.951+0000 7fe150883640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0b7220 con 0x7fe14c0be180 2023-10-03T19:15:39.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.951+0000 7fe14ad9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe14c149f40 0x7fe14c14c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50252/0 (socket says 172.21.15.45:50252) 2023-10-03T19:15:39.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.951+0000 7fe14ad9d640 1 -- 172.21.15.45:0/3106402374 learned_addr learned my addr 172.21.15.45:0/3106402374 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:15:39.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.951+0000 7fe14a59c640 1 --2- 172.21.15.45:0/3106402374 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe14c0be180 0x7fe14c070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:39.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.951+0000 7fe14959a640 1 -- 172.21.15.45:0/3106402374 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1994855360 0 0) 0x7fe14c06f890 con 0x7fe14c149f40 2023-10-03T19:15:39.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.951+0000 7fe14959a640 1 -- 172.21.15.45:0/3106402374 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe138003530 con 0x7fe14c149f40 2023-10-03T19:15:39.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.951+0000 7fe14959a640 1 -- 172.21.15.45:0/3106402374 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 245422269 0 0) 0x7fe14c1504e0 con 0x7fe14c0b6240 2023-10-03T19:15:39.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.951+0000 7fe14a59c640 1 -- 172.21.15.45:0/3106402374 >> v1:172.21.15.79:6789/0 conn(0x7fe14c0b6240 legacy=0x7fe14c149830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:39.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.951+0000 7fe14a59c640 1 -- 172.21.15.45:0/3106402374 >> v1:172.21.15.45:6789/0 conn(0x7fe14c149f40 legacy=0x7fe14c14c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:39.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.951+0000 7fe14a59c640 1 -- 172.21.15.45:0/3106402374 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c06fae0 con 0x7fe14c0be180 2023-10-03T19:15:39.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.955+0000 7fe14a59c640 1 --2- 172.21.15.45:0/3106402374 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe14c0be180 0x7fe14c070160 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe13c009dc0 tx=0x7fe13c01c720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d7a105fbbaa9e1c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:39.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.955+0000 7fe14959a640 1 -- 172.21.15.45:0/3106402374 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe144001680 con 0x7fe14c0be180 2023-10-03T19:15:39.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.955+0000 7fe14959a640 1 -- 172.21.15.45:0/3106402374 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13c0a8410 con 0x7fe14c0be180 2023-10-03T19:15:39.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.955+0000 7fe14959a640 1 -- 172.21.15.45:0/3106402374 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c0a8780 con 0x7fe14c0be180 2023-10-03T19:15:39.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.955+0000 7fe150883640 1 -- 172.21.15.45:0/3106402374 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe14c0be180 msgr2=0x7fe14c070160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:39.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.955+0000 7fe150883640 1 --2- 172.21.15.45:0/3106402374 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe14c0be180 0x7fe14c070160 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe13c009dc0 tx=0x7fe13c01c720 comp rx=0 tx=0).stop 2023-10-03T19:15:39.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.955+0000 7fe150883640 1 -- 172.21.15.45:0/3106402374 shutdown_connections 2023-10-03T19:15:39.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.955+0000 7fe150883640 1 --2- 172.21.15.45:0/3106402374 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe14c0be180 0x7fe14c070160 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:39.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.955+0000 7fe150883640 1 -- 172.21.15.45:0/3106402374 >> 172.21.15.45:0/3106402374 conn(0x7fe14c0c1a20 msgr2=0x7fe14c0bd810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:39.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.955+0000 7fe150883640 1 -- 172.21.15.45:0/3106402374 shutdown_connections 2023-10-03T19:15:39.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.955+0000 7fe150883640 1 -- 172.21.15.45:0/3106402374 wait complete. 2023-10-03T19:15:39.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.955+0000 7fe150883640 1 Processor -- start 2023-10-03T19:15:39.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.955+0000 7fe150883640 1 -- start start 2023-10-03T19:15:39.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.959+0000 7fe150883640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe14c0b6240 0x7fe14c0c0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:39.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.959+0000 7fe150883640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe14c0be180 0x7fe14c141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:39.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.959+0000 7fe150883640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe14c149f40 0x7fe14c142060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:39.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.959+0000 7fe150883640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c143660 con 0x7fe14c149f40 2023-10-03T19:15:39.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.959+0000 7fe150883640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c1ea800 con 0x7fe14c0be180 2023-10-03T19:15:39.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.959+0000 7fe150883640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0c0860 con 0x7fe14c0b6240 2023-10-03T19:15:39.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.959+0000 7fe14ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe14c149f40 0x7fe14c142060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:39.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.959+0000 7fe14ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe14c149f40 0x7fe14c142060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53180/0 (socket says 172.21.15.45:53180) 2023-10-03T19:15:39.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.959+0000 7fe14ad9d640 1 -- 172.21.15.45:0/1302281853 learned_addr learned my addr 172.21.15.45:0/1302281853 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:39.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.959+0000 7fe14a59c640 1 --2- 172.21.15.45:0/1302281853 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe14c0b6240 0x7fe14c0c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:39.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.959+0000 7fe149d9b640 1 --2- 172.21.15.45:0/1302281853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe14c0be180 0x7fe14c141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:39.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.959+0000 7fe14ad9d640 1 -- 172.21.15.45:0/1302281853 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe14c0b6240 msgr2=0x7fe14c0c0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:39.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.959+0000 7fe14ad9d640 1 --2- 172.21.15.45:0/1302281853 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe14c0b6240 0x7fe14c0c0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:39.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.959+0000 7fe14ad9d640 1 -- 172.21.15.45:0/1302281853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe14c0be180 msgr2=0x7fe14c141360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:39.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.959+0000 7fe14ad9d640 1 --2- 172.21.15.45:0/1302281853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe14c0be180 0x7fe14c141360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:39.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.959+0000 7fe14ad9d640 1 -- 172.21.15.45:0/1302281853 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13c009a70 con 0x7fe14c149f40 2023-10-03T19:15:39.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.959+0000 7fe14ad9d640 1 --2- 172.21.15.45:0/1302281853 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe14c149f40 0x7fe14c142060 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fe14400c700 tx=0x7fe14400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:39.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.959+0000 7fe142ffd640 1 -- 172.21.15.45:0/1302281853 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1440074e0 con 0x7fe14c149f40 2023-10-03T19:15:39.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.959+0000 7fe142ffd640 1 -- 172.21.15.45:0/1302281853 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe144007640 con 0x7fe14c149f40 2023-10-03T19:15:39.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.959+0000 7fe150883640 1 -- 172.21.15.45:0/1302281853 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe14c14d2e0 con 0x7fe14c149f40 2023-10-03T19:15:39.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.959+0000 7fe142ffd640 1 -- 172.21.15.45:0/1302281853 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe144004a10 con 0x7fe14c149f40 2023-10-03T19:15:39.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.959+0000 7fe150883640 1 -- 172.21.15.45:0/1302281853 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe14c14d150 con 0x7fe14c149f40 2023-10-03T19:15:39.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.959+0000 7fe150883640 1 -- 172.21.15.45:0/1302281853 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe14c15a590 con 0x7fe14c149f40 2023-10-03T19:15:39.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.959+0000 7fe142ffd640 1 -- 172.21.15.45:0/1302281853 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe144004b70 con 0x7fe14c149f40 2023-10-03T19:15:39.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.959+0000 7fe142ffd640 1 --2- 172.21.15.45:0/1302281853 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe12c066280 0x7fe12c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:39.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.959+0000 7fe142ffd640 1 -- 172.21.15.45:0/1302281853 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fe144082ef0 con 0x7fe14c149f40 2023-10-03T19:15:39.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.959+0000 7fe14a59c640 1 --2- 172.21.15.45:0/1302281853 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe12c066280 0x7fe12c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:39.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.963+0000 7fe14a59c640 1 --2- 172.21.15.45:0/1302281853 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe12c066280 0x7fe12c068730 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0af000 tx=0x7fe13c0a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:39.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:38.963+0000 7fe142ffd640 1 -- 172.21.15.45:0/1302281853 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe1440505f0 con 0x7fe14c149f40 2023-10-03T19:15:39.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:39.135+0000 7fe150883640 1 -- 172.21.15.45:0/1302281853 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe14c04de80 con 0x7fe14c149f40 2023-10-03T19:15:39.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:39.791+0000 7fe142ffd640 1 -- 172.21.15.45:0/1302281853 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v44) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe144053c10 con 0x7fe14c149f40 2023-10-03T19:15:40.196 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-10-03T19:15:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:39.795+0000 7fe150883640 1 -- 172.21.15.45:0/1302281853 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe12c066280 msgr2=0x7fe12c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:39.795+0000 7fe150883640 1 --2- 172.21.15.45:0/1302281853 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe12c066280 0x7fe12c068730 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0af000 tx=0x7fe13c0a7000 comp rx=0 tx=0).stop 2023-10-03T19:15:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:39.795+0000 7fe150883640 1 -- 172.21.15.45:0/1302281853 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe14c149f40 msgr2=0x7fe14c142060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:39.795+0000 7fe150883640 1 --2- 172.21.15.45:0/1302281853 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe14c149f40 0x7fe14c142060 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fe14400c700 tx=0x7fe14400cbc0 comp rx=0 tx=0).stop 2023-10-03T19:15:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:39.795+0000 7fe150883640 1 -- 172.21.15.45:0/1302281853 shutdown_connections 2023-10-03T19:15:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:39.795+0000 7fe150883640 1 --2- 172.21.15.45:0/1302281853 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe12c066280 0x7fe12c068730 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:39.795+0000 7fe150883640 1 --2- 172.21.15.45:0/1302281853 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe14c149f40 0x7fe14c142060 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:39.795+0000 7fe150883640 1 --2- 172.21.15.45:0/1302281853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe14c0be180 0x7fe14c141360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:39.795+0000 7fe150883640 1 --2- 172.21.15.45:0/1302281853 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe14c0b6240 0x7fe14c0c0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:39.795+0000 7fe150883640 1 -- 172.21.15.45:0/1302281853 >> 172.21.15.45:0/1302281853 conn(0x7fe14c0c1a20 msgr2=0x7fe14c146870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:39.795+0000 7fe150883640 1 -- 172.21.15.45:0/1302281853 shutdown_connections 2023-10-03T19:15:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:39.795+0000 7fe150883640 1 -- 172.21.15.45:0/1302281853 wait complete. 2023-10-03T19:15:40.199 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-03T19:15:40.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.327+0000 7f96cb237640 1 Processor -- start 2023-10-03T19:15:40.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.327+0000 7f96cb237640 1 -- start start 2023-10-03T19:15:40.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96cb237640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f96c4148b90 0x7f96c40bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:40.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96cb237640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c414b610 con 0x7f96c40bcb60 2023-10-03T19:15:40.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96cb237640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c40a5580 con 0x7f96c40bc4a0 2023-10-03T19:15:40.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96cb237640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c40a3670 con 0x7f96c4148b90 2023-10-03T19:15:40.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96c3fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f96c40bcb60 0x7f96c406c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50254/0 (socket says 172.21.15.45:50254) 2023-10-03T19:15:40.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96c3fff640 1 -- 172.21.15.45:0/3844508343 learned_addr learned my addr 172.21.15.45:0/3844508343 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:15:40.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96c8fd3640 1 --2- 172.21.15.45:0/3844508343 >> v2:172.21.15.79:3300/0 conn(0x7f96c4148b90 0x7f96c40bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:40.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96c37fe640 1 -- 172.21.15.45:0/3844508343 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2239807893 0 0) 0x7f96c414b610 con 0x7f96c40bcb60 2023-10-03T19:15:40.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96c37fe640 1 -- 172.21.15.45:0/3844508343 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96ac003530 con 0x7f96c40bcb60 2023-10-03T19:15:40.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96c37fe640 1 -- 172.21.15.45:0/3844508343 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 703009626 0 0) 0x7f96ac003530 con 0x7f96c40bcb60 2023-10-03T19:15:40.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96c37fe640 1 -- 172.21.15.45:0/3844508343 >> v2:172.21.15.79:3300/0 conn(0x7f96c4148b90 msgr2=0x7f96c40bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:40.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96c37fe640 1 --2- 172.21.15.45:0/3844508343 >> v2:172.21.15.79:3300/0 conn(0x7f96c4148b90 0x7f96c40bbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:40.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96c37fe640 1 -- 172.21.15.45:0/3844508343 >> v1:172.21.15.79:6789/0 conn(0x7f96c40bc4a0 legacy=0x7f96c406c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:40.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96c37fe640 1 -- 172.21.15.45:0/3844508343 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c40a5820 con 0x7f96c40bcb60 2023-10-03T19:15:40.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96c37fe640 1 -- 172.21.15.45:0/3844508343 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f96b8001680 con 0x7f96c40bcb60 2023-10-03T19:15:40.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96c37fe640 1 -- 172.21.15.45:0/3844508343 >> v1:172.21.15.45:6789/0 conn(0x7f96c40bcb60 legacy=0x7f96c406c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:40.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96c37fe640 1 --2- 172.21.15.45:0/3844508343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96ac003980 0x7f96ac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:40.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96c37fe640 1 --2- 172.21.15.45:0/3844508343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96ac0047d0 0x7f96ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:40.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96c37fe640 1 --2- 172.21.15.45:0/3844508343 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96ac005180 0x7f96ac00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:40.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96c37fe640 1 -- 172.21.15.45:0/3844508343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c40a3670 con 0x7f96ac0047d0 2023-10-03T19:15:40.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96c37fe640 1 -- 172.21.15.45:0/3844508343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ac00c000 con 0x7f96ac003980 2023-10-03T19:15:40.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96c37fe640 1 -- 172.21.15.45:0/3844508343 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96ac00c1c0 con 0x7f96ac005180 2023-10-03T19:15:40.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96c3fff640 1 --2- 172.21.15.45:0/3844508343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96ac0047d0 0x7f96ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:40.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96c97d4640 1 --2- 172.21.15.45:0/3844508343 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96ac005180 0x7f96ac00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:40.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96c8fd3640 1 --2- 172.21.15.45:0/3844508343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96ac003980 0x7f96ac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:40.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96c3fff640 1 -- 172.21.15.45:0/3844508343 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96ac005180 msgr2=0x7f96ac00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:40.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96c3fff640 1 --2- 172.21.15.45:0/3844508343 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96ac005180 0x7f96ac00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:40.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96c3fff640 1 -- 172.21.15.45:0/3844508343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96ac003980 msgr2=0x7f96ac003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:40.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96c3fff640 1 --2- 172.21.15.45:0/3844508343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96ac003980 0x7f96ac003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:40.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96c3fff640 1 -- 172.21.15.45:0/3844508343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ac003530 con 0x7f96ac0047d0 2023-10-03T19:15:40.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.331+0000 7f96c97d4640 1 -- 172.21.15.45:0/3844508343 reap_dead start 2023-10-03T19:15:40.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96c3fff640 1 --2- 172.21.15.45:0/3844508343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96ac0047d0 0x7f96ac004c40 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f96b8001060 tx=0x7f96b801f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b3b97d5bdf943d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:40.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96c37fe640 1 -- 172.21.15.45:0/3844508343 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b80a8c90 con 0x7f96ac0047d0 2023-10-03T19:15:40.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96c37fe640 1 -- 172.21.15.45:0/3844508343 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b80a8df0 con 0x7f96ac0047d0 2023-10-03T19:15:40.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96c37fe640 1 -- 172.21.15.45:0/3844508343 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b8005b00 con 0x7f96ac0047d0 2023-10-03T19:15:40.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96cb237640 1 -- 172.21.15.45:0/3844508343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96ac0047d0 msgr2=0x7f96ac004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:40.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96cb237640 1 --2- 172.21.15.45:0/3844508343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96ac0047d0 0x7f96ac004c40 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f96b8001060 tx=0x7f96b801f370 comp rx=0 tx=0).stop 2023-10-03T19:15:40.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96cb237640 1 -- 172.21.15.45:0/3844508343 shutdown_connections 2023-10-03T19:15:40.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96cb237640 1 --2- 172.21.15.45:0/3844508343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96ac0047d0 0x7f96ac004c40 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:40.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96cb237640 1 -- 172.21.15.45:0/3844508343 >> 172.21.15.45:0/3844508343 conn(0x7f96c40bcf50 msgr2=0x7f96c40bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:40.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96cb237640 1 -- 172.21.15.45:0/3844508343 shutdown_connections 2023-10-03T19:15:40.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96cb237640 1 -- 172.21.15.45:0/3844508343 wait complete. 2023-10-03T19:15:40.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96cb237640 1 Processor -- start 2023-10-03T19:15:40.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96cb237640 1 -- start start 2023-10-03T19:15:40.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96cb237640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96ac0047d0 0x7f96c40b6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:40.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96cb237640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96c4145510 0x7f96c41e5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:40.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96cb237640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96c40a2480 0x7f96c40b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:40.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96cb237640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c40b84c0 con 0x7f96c40a2480 2023-10-03T19:15:40.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96cb237640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c41e5a80 con 0x7f96ac0047d0 2023-10-03T19:15:40.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96cb237640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c40b6620 con 0x7f96c4145510 2023-10-03T19:15:40.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96c97d4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96c40a2480 0x7f96c40b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:40.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96c97d4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96c40a2480 0x7f96c40b60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53194/0 (socket says 172.21.15.45:53194) 2023-10-03T19:15:40.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96c97d4640 1 -- 172.21.15.45:0/1894831719 learned_addr learned my addr 172.21.15.45:0/1894831719 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:40.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96c3fff640 1 --2- 172.21.15.45:0/1894831719 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96c4145510 0x7f96c41e5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:40.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96c8fd3640 1 --2- 172.21.15.45:0/1894831719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96ac0047d0 0x7f96c40b6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:40.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96c97d4640 1 -- 172.21.15.45:0/1894831719 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96c4145510 msgr2=0x7f96c41e5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:40.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96c97d4640 1 --2- 172.21.15.45:0/1894831719 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96c4145510 0x7f96c41e5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:40.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96c97d4640 1 -- 172.21.15.45:0/1894831719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96ac0047d0 msgr2=0x7f96c40b6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:40.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96c97d4640 1 --2- 172.21.15.45:0/1894831719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96ac0047d0 0x7f96c40b6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:40.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96c97d4640 1 -- 172.21.15.45:0/1894831719 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c40a3880 con 0x7f96c40a2480 2023-10-03T19:15:40.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96c8fd3640 1 --2- 172.21.15.45:0/1894831719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96ac0047d0 0x7f96c40b6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:15:40.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.335+0000 7f96c97d4640 1 --2- 172.21.15.45:0/1894831719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96c40a2480 0x7f96c40b60e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f96c406aa90 tx=0x7f96bc00e7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:40.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.339+0000 7f96c17fa640 1 -- 172.21.15.45:0/1894831719 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc00ec80 con 0x7f96c40a2480 2023-10-03T19:15:40.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.339+0000 7f96c17fa640 1 -- 172.21.15.45:0/1894831719 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96bc00ee20 con 0x7f96c40a2480 2023-10-03T19:15:40.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.339+0000 7f96cb237640 1 -- 172.21.15.45:0/1894831719 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c4148f60 con 0x7f96c40a2480 2023-10-03T19:15:40.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.339+0000 7f96c17fa640 1 -- 172.21.15.45:0/1894831719 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc003bc0 con 0x7f96c40a2480 2023-10-03T19:15:40.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.339+0000 7f96cb237640 1 -- 172.21.15.45:0/1894831719 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c40a3c30 con 0x7f96c40a2480 2023-10-03T19:15:40.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.339+0000 7f96cb237640 1 -- 172.21.15.45:0/1894831719 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96c404de80 con 0x7f96c40a2480 2023-10-03T19:15:40.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.339+0000 7f96c17fa640 1 -- 172.21.15.45:0/1894831719 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f96bc003d20 con 0x7f96c40a2480 2023-10-03T19:15:40.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.339+0000 7f96c17fa640 1 --2- 172.21.15.45:0/1894831719 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f96b00662b0 0x7f96b0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:40.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.339+0000 7f96c17fa640 1 -- 172.21.15.45:0/1894831719 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f96bc082970 con 0x7f96c40a2480 2023-10-03T19:15:40.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.339+0000 7f96c8fd3640 1 --2- 172.21.15.45:0/1894831719 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f96b00662b0 0x7f96b0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:40.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.339+0000 7f96c8fd3640 1 --2- 172.21.15.45:0/1894831719 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f96b00662b0 0x7f96b0068760 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f96b4009a80 tx=0x7f96b4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:40.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.343+0000 7f96c17fa640 1 -- 172.21.15.45:0/1894831719 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f96bc0501f0 con 0x7f96c40a2480 2023-10-03T19:15:40.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.555+0000 7f96cb237640 1 -- 172.21.15.45:0/1894831719 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f96c41481d0 con 0x7f96c40a2480 2023-10-03T19:15:40.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.555+0000 7f96c17fa640 1 -- 172.21.15.45:0/1894831719 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+4440 (secure 0 0 0) 0x7f96bc019090 con 0x7f96c40a2480 2023-10-03T19:15:40.560 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:15:40.560 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-03T19:15:40.560 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-10-03T19:15:40.560 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:15:40.560 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-10-03T19:15:40.560 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlfyzhExAABLhtkQEZuiLwovBSO0kuAA==", 2023-10-03T19:15:40.560 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:15:40.560 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:15:40.561 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-03T19:15:40.561 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-03T19:15:40.561 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:15:40.561 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:15:40.561 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:15:40.561 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:15:40.561 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-10-03T19:15:40.561 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlzM8pIBAAMie9jpxS/xt2cymMpyJmiQ==", 2023-10-03T19:15:40.561 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:15:40.561 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:15:40.561 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-03T19:15:40.561 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-03T19:15:40.562 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:15:40.562 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:15:40.562 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:15:40.562 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:15:40.562 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-10-03T19:15:40.562 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlAsGOHBAAIHprnd9orKMQjzkNQZz94A==", 2023-10-03T19:15:40.562 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:15:40.562 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:15:40.562 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-03T19:15:40.562 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-03T19:15:40.562 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:15:40.562 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:15:40.563 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:15:40.563 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:15:40.640 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-10-03T19:15:40.641 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBmZxxlb0zQLRAA3z+f4/jsLTLUmFg/WOD/Xg==", 2023-10-03T19:15:40.641 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:15:40.641 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:15:40.641 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:15:40.641 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:15:40.641 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:15:40.641 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:15:40.641 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:15:40.641 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-10-03T19:15:40.642 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBpZxxlTjtZNRAA3HFqXjGLO7JoX+GBegGfqw==", 2023-10-03T19:15:40.642 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:15:40.642 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:15:40.642 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:15:40.642 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:15:40.642 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:15:40.642 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:15:40.642 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:15:40.642 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-10-03T19:15:40.642 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBtZxxld6kUBBAATcGPrxBbPLswrUHihB7AgQ==", 2023-10-03T19:15:40.642 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:15:40.643 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:15:40.643 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:15:40.643 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:15:40.643 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:15:40.643 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:15:40.643 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:15:40.643 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-10-03T19:15:40.643 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBwZxxlWUL3DBAAk4TW6N5mpjjyP7QgQAIuDw==", 2023-10-03T19:15:40.643 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:15:40.643 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:15:40.643 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:15:40.643 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:15:40.644 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:15:40.644 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:15:40.644 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:15:40.644 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-10-03T19:15:40.644 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQB2ZxxlK3KNIhAAjhvxAU0shg+5PbJfq1LEog==", 2023-10-03T19:15:40.644 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:15:40.644 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:15:40.644 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:15:40.644 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:15:40.644 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:15:40.644 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:15:40.644 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:15:40.644 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-10-03T19:15:40.645 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQB5ZxxlRAxuKhAA5ma3eAt3kkukdhgZN4wwEg==", 2023-10-03T19:15:40.645 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:15:40.645 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:15:40.645 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:15:40.645 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:15:40.645 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:15:40.645 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:15:40.645 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:15:40.645 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-10-03T19:15:40.645 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQB8ZxxlkQqOMxAAuKGy7vJQLUDsqgjPVtWMWg==", 2023-10-03T19:15:40.645 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:15:40.645 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:15:40.646 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:15:40.646 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:15:40.646 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:15:40.646 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:15:40.646 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:15:40.646 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-10-03T19:15:40.646 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCAZxxl65r/ABAAeWtP7nMLVm5NBU4vWQ6ceg==", 2023-10-03T19:15:40.646 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:15:40.646 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:15:40.646 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:15:40.646 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:15:40.646 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:15:40.647 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:15:40.711 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:15:40.711 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-10-03T19:15:40.711 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlg5PgJRAAvvN5Xrw/ZW4rSdJ1/adnzA==", 2023-10-03T19:15:40.711 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:15:40.711 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:15:40.711 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow r", 2023-10-03T19:15:40.711 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-03T19:15:40.712 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:15:40.712 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:15:40.712 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:15:40.712 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-10-03T19:15:40.712 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlKkW+KRAALzVyQ+iTWuD5FMLDKXNVTg==", 2023-10-03T19:15:40.712 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:15:40.712 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:15:40.712 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-10-03T19:15:40.712 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-10-03T19:15:40.712 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-10-03T19:15:40.712 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:15:40.713 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:15:40.713 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:15:40.713 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-10-03T19:15:40.713 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBkZxxldHb4LxAAc/oJcXFjNgH5Wxwv04WHgw==", 2023-10-03T19:15:40.713 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:15:40.713 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-10-03T19:15:40.713 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-03T19:15:40.713 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-03T19:15:40.713 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:15:40.713 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:15:40.713 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:15:40.714 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:15:40.714 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-10-03T19:15:40.714 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxl4txNEBAAonNqY2PmtF0vZGFmvzxIKw==", 2023-10-03T19:15:40.714 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:15:40.714 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-10-03T19:15:40.714 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-10-03T19:15:40.714 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:15:40.714 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:15:40.714 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:15:40.714 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:15:40.714 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-10-03T19:15:40.715 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlUmKhDRAA7UKlGP9q9aKsk+J+nTxrUA==", 2023-10-03T19:15:40.715 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:15:40.715 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-10-03T19:15:40.715 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-10-03T19:15:40.715 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:15:40.715 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:15:40.715 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:15:40.715 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-10-03T19:15:40.715 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-03T19:15:40.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.555+0000 7f96cb237640 1 -- 172.21.15.45:0/1894831719 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f96b00662b0 msgr2=0x7f96b0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:40.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.555+0000 7f96cb237640 1 --2- 172.21.15.45:0/1894831719 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f96b00662b0 0x7f96b0068760 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f96b4009a80 tx=0x7f96b4008040 comp rx=0 tx=0).stop 2023-10-03T19:15:40.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.555+0000 7f96cb237640 1 -- 172.21.15.45:0/1894831719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96c40a2480 msgr2=0x7f96c40b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:40.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.555+0000 7f96cb237640 1 --2- 172.21.15.45:0/1894831719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96c40a2480 0x7f96c40b60e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f96c406aa90 tx=0x7f96bc00e7c0 comp rx=0 tx=0).stop 2023-10-03T19:15:40.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.555+0000 7f96cb237640 1 -- 172.21.15.45:0/1894831719 shutdown_connections 2023-10-03T19:15:40.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.555+0000 7f96cb237640 1 --2- 172.21.15.45:0/1894831719 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f96b00662b0 0x7f96b0068760 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:40.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.555+0000 7f96cb237640 1 --2- 172.21.15.45:0/1894831719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96c40a2480 0x7f96c40b60e0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:40.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.555+0000 7f96cb237640 1 --2- 172.21.15.45:0/1894831719 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96c4145510 0x7f96c41e5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:40.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.555+0000 7f96cb237640 1 --2- 172.21.15.45:0/1894831719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96ac0047d0 0x7f96c40b6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:40.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.555+0000 7f96cb237640 1 -- 172.21.15.45:0/1894831719 >> 172.21.15.45:0/1894831719 conn(0x7f96c40bcf50 msgr2=0x7f96c40bbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:40.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.555+0000 7f96cb237640 1 -- 172.21.15.45:0/1894831719 shutdown_connections 2023-10-03T19:15:40.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.555+0000 7f96cb237640 1 -- 172.21.15.45:0/1894831719 wait complete. 2023-10-03T19:15:40.718 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:15:40.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.935+0000 7f01d40a0640 1 Processor -- start 2023-10-03T19:15:42.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.935+0000 7f01d40a0640 1 -- start start 2023-10-03T19:15:42.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.939+0000 7f01d40a0640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f01cc0bc8b0 0x7f01cc14ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:42.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.939+0000 7f01d40a0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01cc06d170 0x7f01cc14cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:42.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.939+0000 7f01d40a0640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01cc06cac0 con 0x7f01cc06f170 2023-10-03T19:15:42.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.939+0000 7f01d40a0640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01cc14d4f0 con 0x7f01cc0bc8b0 2023-10-03T19:15:42.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.939+0000 7f01d40a0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc0720d0 con 0x7f01cc06d170 2023-10-03T19:15:42.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.939+0000 7f01d1e3c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f01cc06f170 0x7f01cc150190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50268/0 (socket says 172.21.15.45:50268) 2023-10-03T19:15:42.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.939+0000 7f01d1e3c640 1 -- 172.21.15.45:0/1835976872 learned_addr learned my addr 172.21.15.45:0/1835976872 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:15:42.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.939+0000 7f01d163b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f01cc0bc8b0 0x7f01cc14ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:42.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.939+0000 7f01d263d640 1 --2- 172.21.15.45:0/1835976872 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01cc06d170 0x7f01cc14cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:42.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.939+0000 7f01d163b640 1 -- 172.21.15.45:0/1835976872 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01cc06d170 msgr2=0x7f01cc14cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:42.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.939+0000 7f01d163b640 1 --2- 172.21.15.45:0/1835976872 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01cc06d170 0x7f01cc14cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:42.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.939+0000 7f01d163b640 1 -- 172.21.15.45:0/1835976872 >> v1:172.21.15.45:6789/0 conn(0x7f01cc06f170 legacy=0x7f01cc150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:42.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.939+0000 7f01d163b640 1 -- 172.21.15.45:0/1835976872 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc0a5ab0 con 0x7f01cc0bc8b0 2023-10-03T19:15:42.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.939+0000 7f01d163b640 1 --2- 172.21.15.45:0/1835976872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01cc0bc8b0 0x7f01cc14ca70 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009d90 tx=0x7f01c801f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06fc1d430814c0b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:42.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.939+0000 7f01d0e3a640 1 -- 172.21.15.45:0/1835976872 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c80af600 con 0x7f01cc0bc8b0 2023-10-03T19:15:42.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.939+0000 7f01d0e3a640 1 -- 172.21.15.45:0/1835976872 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c80ab050 con 0x7f01cc0bc8b0 2023-10-03T19:15:42.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.939+0000 7f01d0e3a640 1 -- 172.21.15.45:0/1835976872 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c80af980 con 0x7f01cc0bc8b0 2023-10-03T19:15:42.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01d40a0640 1 -- 172.21.15.45:0/1835976872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01cc0bc8b0 msgr2=0x7f01cc14ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:42.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01d40a0640 1 --2- 172.21.15.45:0/1835976872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01cc0bc8b0 0x7f01cc14ca70 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009d90 tx=0x7f01c801f130 comp rx=0 tx=0).stop 2023-10-03T19:15:42.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01d40a0640 1 -- 172.21.15.45:0/1835976872 shutdown_connections 2023-10-03T19:15:42.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01d40a0640 1 --2- 172.21.15.45:0/1835976872 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01cc06d170 0x7f01cc14cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:42.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01d40a0640 1 --2- 172.21.15.45:0/1835976872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01cc0bc8b0 0x7f01cc14ca70 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:42.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01d40a0640 1 -- 172.21.15.45:0/1835976872 >> 172.21.15.45:0/1835976872 conn(0x7f01cc0bcf50 msgr2=0x7f01cc0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:42.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01d40a0640 1 -- 172.21.15.45:0/1835976872 shutdown_connections 2023-10-03T19:15:42.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01d40a0640 1 -- 172.21.15.45:0/1835976872 wait complete. 2023-10-03T19:15:42.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01d40a0640 1 Processor -- start 2023-10-03T19:15:42.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01d40a0640 1 -- start start 2023-10-03T19:15:42.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01d40a0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01cc06d170 0x7f01cc1d8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:42.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01d40a0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01cc06f170 0x7f01cc141240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:42.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01d40a0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01cc0bc8b0 0x7f01cc1e33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:42.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01d40a0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc144dc0 con 0x7f01cc06d170 2023-10-03T19:15:42.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01d40a0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc1e7400 con 0x7f01cc0bc8b0 2023-10-03T19:15:42.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01d40a0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc1e76e0 con 0x7f01cc06f170 2023-10-03T19:15:42.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01d1e3c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01cc06d170 0x7f01cc1d8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:42.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01d1e3c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01cc06d170 0x7f01cc1d8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53202/0 (socket says 172.21.15.45:53202) 2023-10-03T19:15:42.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01d1e3c640 1 -- 172.21.15.45:0/1333484322 learned_addr learned my addr 172.21.15.45:0/1333484322 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:42.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01d263d640 1 --2- 172.21.15.45:0/1333484322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01cc0bc8b0 0x7f01cc1e33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:42.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01d1e3c640 1 -- 172.21.15.45:0/1333484322 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01cc06f170 msgr2=0x7f01cc141240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:42.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01d1e3c640 1 --2- 172.21.15.45:0/1333484322 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01cc06f170 0x7f01cc141240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:42.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01d1e3c640 1 -- 172.21.15.45:0/1333484322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01cc0bc8b0 msgr2=0x7f01cc1e33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:42.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01d1e3c640 1 --2- 172.21.15.45:0/1333484322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01cc0bc8b0 0x7f01cc1e33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:42.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01d1e3c640 1 -- 172.21.15.45:0/1333484322 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c8009a70 con 0x7f01cc06d170 2023-10-03T19:15:42.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01d263d640 1 --2- 172.21.15.45:0/1333484322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01cc0bc8b0 0x7f01cc1e33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:15:42.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01d1e3c640 1 --2- 172.21.15.45:0/1333484322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01cc06d170 0x7f01cc1d8d90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f01c400c500 tx=0x7f01c400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:43.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01c27fc640 1 -- 172.21.15.45:0/1333484322 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c4005cf0 con 0x7f01cc06d170 2023-10-03T19:15:43.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01c27fc640 1 -- 172.21.15.45:0/1333484322 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c4005e50 con 0x7f01cc06d170 2023-10-03T19:15:43.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01d40a0640 1 -- 172.21.15.45:0/1333484322 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01cc14fae0 con 0x7f01cc06d170 2023-10-03T19:15:43.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01c27fc640 1 -- 172.21.15.45:0/1333484322 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c40072f0 con 0x7f01cc06d170 2023-10-03T19:15:43.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.943+0000 7f01d40a0640 1 -- 172.21.15.45:0/1333484322 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01cc06cd00 con 0x7f01cc06d170 2023-10-03T19:15:43.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.947+0000 7f01d40a0640 1 -- 172.21.15.45:0/1333484322 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01cc06d660 con 0x7f01cc06d170 2023-10-03T19:15:43.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.947+0000 7f01c27fc640 1 -- 172.21.15.45:0/1333484322 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f01c4007450 con 0x7f01cc06d170 2023-10-03T19:15:43.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.947+0000 7f01c27fc640 1 --2- 172.21.15.45:0/1333484322 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f01b8066280 0x7f01b8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:43.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.947+0000 7f01c27fc640 1 -- 172.21.15.45:0/1333484322 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f01c4082ca0 con 0x7f01cc06d170 2023-10-03T19:15:43.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.947+0000 7f01d163b640 1 --2- 172.21.15.45:0/1333484322 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f01b8066280 0x7f01b8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:43.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.947+0000 7f01d163b640 1 --2- 172.21.15.45:0/1333484322 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f01b8066280 0x7f01b8068730 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f01c80b1000 tx=0x7f01c8004ac0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:43.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:40.951+0000 7f01c27fc640 1 -- 172.21.15.45:0/1333484322 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f01c40505b0 con 0x7f01cc06d170 2023-10-03T19:15:43.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:41.103+0000 7f01d40a0640 1 -- 172.21.15.45:0/1333484322 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01cc06cac0 con 0x7f01cc06d170 2023-10-03T19:15:43.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:41.107+0000 7f01c27fc640 1 -- 172.21.15.45:0/1333484322 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+14591 (secure 0 0 0) 0x7f01cc06cac0 con 0x7f01cc06d170 2023-10-03T19:15:43.026 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:15:43.026 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":44,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:15:39.786847+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:15:43.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:41.111+0000 7f01d40a0640 1 -- 172.21.15.45:0/1333484322 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f01b8066280 msgr2=0x7f01b8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:43.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:41.111+0000 7f01d40a0640 1 --2- 172.21.15.45:0/1333484322 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f01b8066280 0x7f01b8068730 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f01c80b1000 tx=0x7f01c8004ac0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:41.111+0000 7f01d40a0640 1 -- 172.21.15.45:0/1333484322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01cc06d170 msgr2=0x7f01cc1d8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:43.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:41.111+0000 7f01d40a0640 1 --2- 172.21.15.45:0/1333484322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01cc06d170 0x7f01cc1d8d90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f01c400c500 tx=0x7f01c400c9c0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:41.111+0000 7f01d40a0640 1 -- 172.21.15.45:0/1333484322 shutdown_connections 2023-10-03T19:15:43.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:41.111+0000 7f01d40a0640 1 --2- 172.21.15.45:0/1333484322 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f01b8066280 0x7f01b8068730 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:41.111+0000 7f01d40a0640 1 --2- 172.21.15.45:0/1333484322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01cc0bc8b0 0x7f01cc1e33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:41.111+0000 7f01d40a0640 1 --2- 172.21.15.45:0/1333484322 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01cc06f170 0x7f01cc141240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:41.111+0000 7f01d40a0640 1 --2- 172.21.15.45:0/1333484322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01cc06d170 0x7f01cc1d8d90 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:41.111+0000 7f01d40a0640 1 -- 172.21.15.45:0/1333484322 >> 172.21.15.45:0/1333484322 conn(0x7f01cc0bcf50 msgr2=0x7f01cc0bc170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:43.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:41.111+0000 7f01d40a0640 1 -- 172.21.15.45:0/1333484322 shutdown_connections 2023-10-03T19:15:43.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:41.111+0000 7f01d40a0640 1 -- 172.21.15.45:0/1333484322 wait complete. 2023-10-03T19:15:43.032 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:15:43.033 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:15:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.171+0000 7f96b63fa640 1 Processor -- start 2023-10-03T19:15:43.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.171+0000 7f96b63fa640 1 -- start start 2023-10-03T19:15:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.171+0000 7f96b63fa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f96b014f510 0x7f96b014b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:43.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.171+0000 7f96b63fa640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f96b00bd9f0 0x7f96b014b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:43.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.171+0000 7f96b63fa640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b014f080 con 0x7f96b006f880 2023-10-03T19:15:43.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.171+0000 7f96b63fa640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96b006f3e0 con 0x7f96b014f510 2023-10-03T19:15:43.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.171+0000 7f96b63fa640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96b0070e90 con 0x7f96b00bd9f0 2023-10-03T19:15:43.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.171+0000 7f96af7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f96b014f510 0x7f96b014b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:43.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.171+0000 7f96af7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f96b014f510 0x7f96b014b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53214/0 (socket says 172.21.15.45:53214) 2023-10-03T19:15:43.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.171+0000 7f96af7fe640 1 -- 172.21.15.45:0/1479619315 learned_addr learned my addr 172.21.15.45:0/1479619315 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:43.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.171+0000 7f96b4997640 1 --2- 172.21.15.45:0/1479619315 >> v2:172.21.15.79:3300/0 conn(0x7f96b00bd9f0 0x7f96b014b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:43.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.171+0000 7f96af7fe640 1 -- 172.21.15.45:0/1479619315 >> v2:172.21.15.79:3300/0 conn(0x7f96b00bd9f0 msgr2=0x7f96b014b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:43.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.171+0000 7f96af7fe640 1 --2- 172.21.15.45:0/1479619315 >> v2:172.21.15.79:3300/0 conn(0x7f96b00bd9f0 0x7f96b014b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.171+0000 7f96af7fe640 1 -- 172.21.15.45:0/1479619315 >> v1:172.21.15.79:6789/0 conn(0x7f96b006f880 legacy=0x7f96b00a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:43.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.171+0000 7f96af7fe640 1 -- 172.21.15.45:0/1479619315 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b014ea30 con 0x7f96b014f510 2023-10-03T19:15:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.175+0000 7f96af7fe640 1 --2- 172.21.15.45:0/1479619315 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96b014f510 0x7f96b014b320 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f96b006ec00 tx=0x7f96a401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54302bbc7c4f76f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.175+0000 7f96aeffd640 1 -- 172.21.15.45:0/1479619315 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a40ab5f0 con 0x7f96b014f510 2023-10-03T19:15:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.175+0000 7f96aeffd640 1 -- 172.21.15.45:0/1479619315 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a40ab750 con 0x7f96b014f510 2023-10-03T19:15:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.175+0000 7f96aeffd640 1 -- 172.21.15.45:0/1479619315 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a40abae0 con 0x7f96b014f510 2023-10-03T19:15:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.175+0000 7f96b63fa640 1 -- 172.21.15.45:0/1479619315 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96b014f510 msgr2=0x7f96b014b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.175+0000 7f96b63fa640 1 --2- 172.21.15.45:0/1479619315 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96b014f510 0x7f96b014b320 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f96b006ec00 tx=0x7f96a401c490 comp rx=0 tx=0).stop 2023-10-03T19:15:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.175+0000 7f96b63fa640 1 -- 172.21.15.45:0/1479619315 shutdown_connections 2023-10-03T19:15:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.175+0000 7f96b63fa640 1 --2- 172.21.15.45:0/1479619315 >> v2:172.21.15.79:3300/0 conn(0x7f96b00bd9f0 0x7f96b014b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.175+0000 7f96b63fa640 1 --2- 172.21.15.45:0/1479619315 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96b014f510 0x7f96b014b320 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.175+0000 7f96b63fa640 1 -- 172.21.15.45:0/1479619315 >> 172.21.15.45:0/1479619315 conn(0x7f96b00a20d0 msgr2=0x7f96b00a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:43.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.175+0000 7f96b63fa640 1 -- 172.21.15.45:0/1479619315 shutdown_connections 2023-10-03T19:15:43.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.175+0000 7f96b63fa640 1 -- 172.21.15.45:0/1479619315 wait complete. 2023-10-03T19:15:43.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.175+0000 7f96b63fa640 1 Processor -- start 2023-10-03T19:15:43.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.175+0000 7f96b63fa640 1 -- start start 2023-10-03T19:15:43.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.175+0000 7f96b63fa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96b006f880 0x7f96b0145bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:43.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.175+0000 7f96b63fa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96b00bd9f0 0x7f96b01e6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:43.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.175+0000 7f96b63fa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96b014f510 0x7f96b01e6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:43.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.175+0000 7f96b63fa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b0144660 con 0x7f96b006f880 2023-10-03T19:15:43.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.175+0000 7f96b63fa640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b01449b0 con 0x7f96b014f510 2023-10-03T19:15:43.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.175+0000 7f96b63fa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b014e400 con 0x7f96b00bd9f0 2023-10-03T19:15:43.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.175+0000 7f96affff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96b006f880 0x7f96b0145bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:43.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.175+0000 7f96affff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96b006f880 0x7f96b0145bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53216/0 (socket says 172.21.15.45:53216) 2023-10-03T19:15:43.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.175+0000 7f96affff640 1 -- 172.21.15.45:0/733299012 learned_addr learned my addr 172.21.15.45:0/733299012 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:43.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.175+0000 7f96b4997640 1 --2- 172.21.15.45:0/733299012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96b014f510 0x7f96b01e6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:43.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.175+0000 7f96af7fe640 1 --2- 172.21.15.45:0/733299012 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96b00bd9f0 0x7f96b01e6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:43.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.179+0000 7f96affff640 1 -- 172.21.15.45:0/733299012 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96b00bd9f0 msgr2=0x7f96b01e6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:43.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.179+0000 7f96affff640 1 --2- 172.21.15.45:0/733299012 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96b00bd9f0 0x7f96b01e6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.179+0000 7f96affff640 1 -- 172.21.15.45:0/733299012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96b014f510 msgr2=0x7f96b01e6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:43.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.179+0000 7f96affff640 1 --2- 172.21.15.45:0/733299012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96b014f510 0x7f96b01e6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.179+0000 7f96affff640 1 -- 172.21.15.45:0/733299012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a40094d0 con 0x7f96b006f880 2023-10-03T19:15:43.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.179+0000 7f96af7fe640 1 --2- 172.21.15.45:0/733299012 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96b00bd9f0 0x7f96b01e6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:15:43.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.179+0000 7f96b4997640 1 --2- 172.21.15.45:0/733299012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96b014f510 0x7f96b01e6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:15:43.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.179+0000 7f96affff640 1 --2- 172.21.15.45:0/733299012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96b006f880 0x7f96b0145bc0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f96a000b410 tx=0x7f96a000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:43.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.179+0000 7f96acff9640 1 -- 172.21.15.45:0/733299012 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a0004020 con 0x7f96b006f880 2023-10-03T19:15:43.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.179+0000 7f96acff9640 1 -- 172.21.15.45:0/733299012 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a0004180 con 0x7f96b006f880 2023-10-03T19:15:43.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.179+0000 7f96b63fa640 1 -- 172.21.15.45:0/733299012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b00a6050 con 0x7f96b006f880 2023-10-03T19:15:43.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.179+0000 7f96acff9640 1 -- 172.21.15.45:0/733299012 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a0011630 con 0x7f96b006f880 2023-10-03T19:15:43.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.179+0000 7f96b63fa640 1 -- 172.21.15.45:0/733299012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b006fc50 con 0x7f96b006f880 2023-10-03T19:15:43.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.179+0000 7f96b63fa640 1 -- 172.21.15.45:0/733299012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b00a61e0 con 0x7f96b006f880 2023-10-03T19:15:43.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.179+0000 7f96acff9640 1 -- 172.21.15.45:0/733299012 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f96a0011790 con 0x7f96b006f880 2023-10-03T19:15:43.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.179+0000 7f96acff9640 1 --2- 172.21.15.45:0/733299012 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f969c066280 0x7f969c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:43.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.179+0000 7f96acff9640 1 -- 172.21.15.45:0/733299012 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f96a00836a0 con 0x7f96b006f880 2023-10-03T19:15:43.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.179+0000 7f96af7fe640 1 --2- 172.21.15.45:0/733299012 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f969c066280 0x7f969c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:43.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.179+0000 7f96af7fe640 1 --2- 172.21.15.45:0/733299012 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f969c066280 0x7f969c068730 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f96a40af000 tx=0x7f96a40a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:43.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.183+0000 7f96acff9640 1 -- 172.21.15.45:0/733299012 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f96a0050f00 con 0x7f96b006f880 2023-10-03T19:15:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.335+0000 7f96b63fa640 1 -- 172.21.15.45:0/733299012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f96b0143330 con 0x7f96b006f880 2023-10-03T19:15:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.335+0000 7f96acff9640 1 -- 172.21.15.45:0/733299012 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f96b0143330 con 0x7f96b006f880 2023-10-03T19:15:43.349 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:15:43.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.339+0000 7f96b63fa640 1 -- 172.21.15.45:0/733299012 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f969c066280 msgr2=0x7f969c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:43.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.339+0000 7f96b63fa640 1 --2- 172.21.15.45:0/733299012 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f969c066280 0x7f969c068730 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f96a40af000 tx=0x7f96a40a7000 comp rx=0 tx=0).stop 2023-10-03T19:15:43.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.339+0000 7f96b63fa640 1 -- 172.21.15.45:0/733299012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96b006f880 msgr2=0x7f96b0145bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:43.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.339+0000 7f96b63fa640 1 --2- 172.21.15.45:0/733299012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96b006f880 0x7f96b0145bc0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f96a000b410 tx=0x7f96a000b8d0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.339+0000 7f96b63fa640 1 -- 172.21.15.45:0/733299012 shutdown_connections 2023-10-03T19:15:43.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.339+0000 7f96b63fa640 1 --2- 172.21.15.45:0/733299012 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f969c066280 0x7f969c068730 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.339+0000 7f96b63fa640 1 --2- 172.21.15.45:0/733299012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96b014f510 0x7f96b01e6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.339+0000 7f96b63fa640 1 --2- 172.21.15.45:0/733299012 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96b00bd9f0 0x7f96b01e6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.339+0000 7f96b63fa640 1 --2- 172.21.15.45:0/733299012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96b006f880 0x7f96b0145bc0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.339+0000 7f96b63fa640 1 -- 172.21.15.45:0/733299012 >> 172.21.15.45:0/733299012 conn(0x7f96b00a20d0 msgr2=0x7f96b00a24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:43.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.339+0000 7f96b63fa640 1 -- 172.21.15.45:0/733299012 shutdown_connections 2023-10-03T19:15:43.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.339+0000 7f96b63fa640 1 -- 172.21.15.45:0/733299012 wait complete. 2023-10-03T19:15:43.362 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:15:43.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.631+0000 7f3c0987b640 1 Processor -- start 2023-10-03T19:15:43.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.631+0000 7f3c0987b640 1 -- start start 2023-10-03T19:15:43.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.635+0000 7f3c0987b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3c040712c0 0x7f3c040bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:43.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.635+0000 7f3c0987b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c0406d560 0x7f3c040bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:43.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.635+0000 7f3c0987b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3c0406c760 0x7f3c040a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:43.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.635+0000 7f3c0987b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c0406c2d0 con 0x7f3c0406c760 2023-10-03T19:15:43.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.635+0000 7f3c0987b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c04150610 con 0x7f3c040712c0 2023-10-03T19:15:43.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.635+0000 7f3c0987b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c041508b0 con 0x7f3c0406d560 2023-10-03T19:15:43.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.635+0000 7f3c037fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3c0406c760 0x7f3c040a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:43.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.635+0000 7f3c037fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3c0406c760 0x7f3c040a53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53224/0 (socket says 172.21.15.45:53224) 2023-10-03T19:15:43.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.635+0000 7f3c037fe640 1 -- 172.21.15.45:0/502527308 learned_addr learned my addr 172.21.15.45:0/502527308 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:43.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.635+0000 7f3c027fc640 1 --2- 172.21.15.45:0/502527308 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c0406d560 0x7f3c040bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:43.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.635+0000 7f3c02ffd640 1 --2- 172.21.15.45:0/502527308 >> v2:172.21.15.79:3300/0 conn(0x7f3c040712c0 0x7f3c040bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:43.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.635+0000 7f3c037fe640 1 -- 172.21.15.45:0/502527308 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c0406d560 msgr2=0x7f3c040bd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:43.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.635+0000 7f3c037fe640 1 --2- 172.21.15.45:0/502527308 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c0406d560 0x7f3c040bd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.635+0000 7f3c037fe640 1 -- 172.21.15.45:0/502527308 >> v2:172.21.15.79:3300/0 conn(0x7f3c040712c0 msgr2=0x7f3c040bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:43.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.635+0000 7f3c037fe640 1 --2- 172.21.15.45:0/502527308 >> v2:172.21.15.79:3300/0 conn(0x7f3c040712c0 0x7f3c040bcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.635+0000 7f3c037fe640 1 -- 172.21.15.45:0/502527308 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0406d2e0 con 0x7f3c0406c760 2023-10-03T19:15:43.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.635+0000 7f3c037fe640 1 --2- 172.21.15.45:0/502527308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c0406c760 0x7f3c040a53c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f3c040a2fd0 tx=0x7f3bfc01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f67396b863a5617 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:43.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.635+0000 7f3c01ffb640 1 -- 172.21.15.45:0/502527308 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc0a5790 con 0x7f3c0406c760 2023-10-03T19:15:43.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.635+0000 7f3c01ffb640 1 -- 172.21.15.45:0/502527308 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bfc0a58f0 con 0x7f3c0406c760 2023-10-03T19:15:43.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.635+0000 7f3c01ffb640 1 -- 172.21.15.45:0/502527308 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc0a5c80 con 0x7f3c0406c760 2023-10-03T19:15:43.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c0987b640 1 -- 172.21.15.45:0/502527308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c0406c760 msgr2=0x7f3c040a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:43.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c0987b640 1 --2- 172.21.15.45:0/502527308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c0406c760 0x7f3c040a53c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f3c040a2fd0 tx=0x7f3bfc01c9d0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c0987b640 1 -- 172.21.15.45:0/502527308 shutdown_connections 2023-10-03T19:15:43.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c0987b640 1 --2- 172.21.15.45:0/502527308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c0406c760 0x7f3c040a53c0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c0987b640 1 --2- 172.21.15.45:0/502527308 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c0406d560 0x7f3c040bd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c0987b640 1 --2- 172.21.15.45:0/502527308 >> v2:172.21.15.79:3300/0 conn(0x7f3c040712c0 0x7f3c040bcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c0987b640 1 -- 172.21.15.45:0/502527308 >> 172.21.15.45:0/502527308 conn(0x7f3c040a20d0 msgr2=0x7f3c040a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:43.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c0987b640 1 -- 172.21.15.45:0/502527308 shutdown_connections 2023-10-03T19:15:43.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c0987b640 1 -- 172.21.15.45:0/502527308 wait complete. 2023-10-03T19:15:43.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c0987b640 1 Processor -- start 2023-10-03T19:15:43.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c0987b640 1 -- start start 2023-10-03T19:15:43.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c0987b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c0406c760 0x7f3c041e4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:43.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c0987b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c0406d560 0x7f3c04147a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:43.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c0987b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c040712c0 0x7f3c04141210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:43.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c0987b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c040ba660 con 0x7f3c040712c0 2023-10-03T19:15:43.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c0987b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c041e53f0 con 0x7f3c0406d560 2023-10-03T19:15:43.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c0987b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c040bfb90 con 0x7f3c0406c760 2023-10-03T19:15:43.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c037fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c040712c0 0x7f3c04141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:43.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c037fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c040712c0 0x7f3c04141210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53234/0 (socket says 172.21.15.45:53234) 2023-10-03T19:15:43.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c037fe640 1 -- 172.21.15.45:0/2748053043 learned_addr learned my addr 172.21.15.45:0/2748053043 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:43.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c027fc640 1 --2- 172.21.15.45:0/2748053043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c0406d560 0x7f3c04147a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:43.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c02ffd640 1 --2- 172.21.15.45:0/2748053043 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c0406c760 0x7f3c041e4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:43.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c037fe640 1 -- 172.21.15.45:0/2748053043 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c0406c760 msgr2=0x7f3c041e4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:43.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c037fe640 1 --2- 172.21.15.45:0/2748053043 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c0406c760 0x7f3c041e4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c037fe640 1 -- 172.21.15.45:0/2748053043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c0406d560 msgr2=0x7f3c04147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:43.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c037fe640 1 --2- 172.21.15.45:0/2748053043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c0406d560 0x7f3c04147a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c037fe640 1 -- 172.21.15.45:0/2748053043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bfc009b30 con 0x7f3c040712c0 2023-10-03T19:15:43.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c027fc640 1 --2- 172.21.15.45:0/2748053043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c0406d560 0x7f3c04147a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:15:43.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c037fe640 1 --2- 172.21.15.45:0/2748053043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c040712c0 0x7f3c04141210 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc0af040 tx=0x7f3bfc019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:43.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3bfbfff640 1 -- 172.21.15.45:0/2748053043 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc0b8670 con 0x7f3c040712c0 2023-10-03T19:15:43.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3bfbfff640 1 -- 172.21.15.45:0/2748053043 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bfc0b87d0 con 0x7f3c040712c0 2023-10-03T19:15:43.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c0987b640 1 -- 172.21.15.45:0/2748053043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c0414c780 con 0x7f3c040712c0 2023-10-03T19:15:43.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3bfbfff640 1 -- 172.21.15.45:0/2748053043 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc0b8b80 con 0x7f3c040712c0 2023-10-03T19:15:43.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.639+0000 7f3c0987b640 1 -- 172.21.15.45:0/2748053043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c0414c5f0 con 0x7f3c040712c0 2023-10-03T19:15:43.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.643+0000 7f3c0987b640 1 -- 172.21.15.45:0/2748053043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c0414c910 con 0x7f3c040712c0 2023-10-03T19:15:43.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.643+0000 7f3bfbfff640 1 -- 172.21.15.45:0/2748053043 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3bfc0b8ce0 con 0x7f3c040712c0 2023-10-03T19:15:43.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.643+0000 7f3bfbfff640 1 --2- 172.21.15.45:0/2748053043 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3be4066280 0x7f3be4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:43.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.643+0000 7f3bfbfff640 1 -- 172.21.15.45:0/2748053043 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3bfc11f9d0 con 0x7f3c040712c0 2023-10-03T19:15:43.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.643+0000 7f3c02ffd640 1 --2- 172.21.15.45:0/2748053043 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3be4066280 0x7f3be4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:43.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.643+0000 7f3c02ffd640 1 --2- 172.21.15.45:0/2748053043 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3be4066280 0x7f3be4068730 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00b930 tx=0x7f3bec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:43.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.647+0000 7f3bfbfff640 1 -- 172.21.15.45:0/2748053043 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3bfc0ed460 con 0x7f3c040712c0 2023-10-03T19:15:43.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.803+0000 7f3c0987b640 1 -- 172.21.15.45:0/2748053043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3c040bca30 con 0x7f3c040712c0 2023-10-03T19:15:43.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.803+0000 7f3bfbfff640 1 -- 172.21.15.45:0/2748053043 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v44) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3bfc0f0a80 con 0x7f3c040712c0 2023-10-03T19:15:43.808 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:15:43.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.803+0000 7f3c0987b640 1 -- 172.21.15.45:0/2748053043 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3be4066280 msgr2=0x7f3be4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:43.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.803+0000 7f3c0987b640 1 --2- 172.21.15.45:0/2748053043 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3be4066280 0x7f3be4068730 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00b930 tx=0x7f3bec008040 comp rx=0 tx=0).stop 2023-10-03T19:15:43.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.803+0000 7f3c0987b640 1 -- 172.21.15.45:0/2748053043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c040712c0 msgr2=0x7f3c04141210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:43.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.803+0000 7f3c0987b640 1 --2- 172.21.15.45:0/2748053043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c040712c0 0x7f3c04141210 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc0af040 tx=0x7f3bfc019770 comp rx=0 tx=0).stop 2023-10-03T19:15:43.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.803+0000 7f3c0987b640 1 -- 172.21.15.45:0/2748053043 shutdown_connections 2023-10-03T19:15:43.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.803+0000 7f3c0987b640 1 --2- 172.21.15.45:0/2748053043 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3be4066280 0x7f3be4068730 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.803+0000 7f3c0987b640 1 --2- 172.21.15.45:0/2748053043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c040712c0 0x7f3c04141210 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.803+0000 7f3c0987b640 1 --2- 172.21.15.45:0/2748053043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c0406d560 0x7f3c04147a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.803+0000 7f3c0987b640 1 --2- 172.21.15.45:0/2748053043 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c0406c760 0x7f3c041e4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.803+0000 7f3c0987b640 1 -- 172.21.15.45:0/2748053043 >> 172.21.15.45:0/2748053043 conn(0x7f3c040a20d0 msgr2=0x7f3c0414a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:43.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.803+0000 7f3c0987b640 1 -- 172.21.15.45:0/2748053043 shutdown_connections 2023-10-03T19:15:43.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.803+0000 7f3c0987b640 1 -- 172.21.15.45:0/2748053043 wait complete. 2023-10-03T19:15:43.826 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-03T19:15:43.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.935+0000 7f90cd9fe640 1 Processor -- start 2023-10-03T19:15:43.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.935+0000 7f90cd9fe640 1 -- start start 2023-10-03T19:15:43.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.935+0000 7f90cd9fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f90c814bb80 0x7f90c80be700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:43.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.935+0000 7f90cd9fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f90c80bec40 0x7f90c8151d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:43.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.935+0000 7f90cd9fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90c80bc900 0x7f90c8152290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:43.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.935+0000 7f90cd9fe640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c80bce20 con 0x7f90c814bb80 2023-10-03T19:15:43.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.935+0000 7f90cd9fe640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c80c0fd0 con 0x7f90c80bec40 2023-10-03T19:15:43.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.935+0000 7f90cd9fe640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c814bf50 con 0x7f90c80bc900 2023-10-03T19:15:43.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.935+0000 7f90c6ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f90c814bb80 0x7f90c80be700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:43.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.935+0000 7f90c6ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f90c814bb80 0x7f90c80be700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53242/0 (socket says 172.21.15.45:53242) 2023-10-03T19:15:43.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.935+0000 7f90c6ffd640 1 -- 172.21.15.45:0/489326610 learned_addr learned my addr 172.21.15.45:0/489326610 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:43.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.935+0000 7f90c67fc640 1 --2- 172.21.15.45:0/489326610 >> v2:172.21.15.79:3300/0 conn(0x7f90c80bec40 0x7f90c8151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:43.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.935+0000 7f90c6ffd640 1 -- 172.21.15.45:0/489326610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90c80bc900 msgr2=0x7f90c8152290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:43.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.935+0000 7f90c77fe640 1 --2- 172.21.15.45:0/489326610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90c80bc900 0x7f90c8152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:43.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.935+0000 7f90c6ffd640 1 --2- 172.21.15.45:0/489326610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90c80bc900 0x7f90c8152290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.935+0000 7f90c6ffd640 1 -- 172.21.15.45:0/489326610 >> v2:172.21.15.79:3300/0 conn(0x7f90c80bec40 msgr2=0x7f90c8151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:43.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.935+0000 7f90c6ffd640 1 --2- 172.21.15.45:0/489326610 >> v2:172.21.15.79:3300/0 conn(0x7f90c80bec40 0x7f90c8151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.935+0000 7f90c6ffd640 1 -- 172.21.15.45:0/489326610 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c80c0980 con 0x7f90c814bb80 2023-10-03T19:15:43.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.935+0000 7f90c67fc640 1 --2- 172.21.15.45:0/489326610 >> v2:172.21.15.79:3300/0 conn(0x7f90c80bec40 0x7f90c8151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:15:43.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.935+0000 7f90c77fe640 1 --2- 172.21.15.45:0/489326610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90c80bc900 0x7f90c8152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:15:43.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.935+0000 7f90c6ffd640 1 --2- 172.21.15.45:0/489326610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90c814bb80 0x7f90c80be700 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f90c806fa80 tx=0x7f90c001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f7f45097b1f9c45 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:43.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90c5ffb640 1 -- 172.21.15.45:0/489326610 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c00af400 con 0x7f90c814bb80 2023-10-03T19:15:43.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90c5ffb640 1 -- 172.21.15.45:0/489326610 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c00ab050 con 0x7f90c814bb80 2023-10-03T19:15:43.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90c5ffb640 1 -- 172.21.15.45:0/489326610 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c00af780 con 0x7f90c814bb80 2023-10-03T19:15:43.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90cd9fe640 1 -- 172.21.15.45:0/489326610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90c814bb80 msgr2=0x7f90c80be700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:43.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90cd9fe640 1 --2- 172.21.15.45:0/489326610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90c814bb80 0x7f90c80be700 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f90c806fa80 tx=0x7f90c001f1c0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90cd9fe640 1 -- 172.21.15.45:0/489326610 shutdown_connections 2023-10-03T19:15:43.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90cd9fe640 1 --2- 172.21.15.45:0/489326610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90c80bc900 0x7f90c8152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90cd9fe640 1 --2- 172.21.15.45:0/489326610 >> v2:172.21.15.79:3300/0 conn(0x7f90c80bec40 0x7f90c8151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90cd9fe640 1 --2- 172.21.15.45:0/489326610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90c814bb80 0x7f90c80be700 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90cd9fe640 1 -- 172.21.15.45:0/489326610 >> 172.21.15.45:0/489326610 conn(0x7f90c80c2200 msgr2=0x7f90c80bdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:43.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90cd9fe640 1 -- 172.21.15.45:0/489326610 shutdown_connections 2023-10-03T19:15:43.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90cd9fe640 1 -- 172.21.15.45:0/489326610 wait complete. 2023-10-03T19:15:43.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90cd9fe640 1 Processor -- start 2023-10-03T19:15:43.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90cd9fe640 1 -- start start 2023-10-03T19:15:43.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90cd9fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90c80bc900 0x7f90c806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:43.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90cd9fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90c80bec40 0x7f90c80a69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:43.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90cd9fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90c814bb80 0x7f90c80a4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:43.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90cd9fe640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c80bad40 con 0x7f90c80bec40 2023-10-03T19:15:43.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90cd9fe640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c80a4610 con 0x7f90c814bb80 2023-10-03T19:15:43.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90cd9fe640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c80bb550 con 0x7f90c80bc900 2023-10-03T19:15:43.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90c67fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90c80bec40 0x7f90c80a69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:43.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90c67fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90c80bec40 0x7f90c80a69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53248/0 (socket says 172.21.15.45:53248) 2023-10-03T19:15:43.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90c67fc640 1 -- 172.21.15.45:0/63622981 learned_addr learned my addr 172.21.15.45:0/63622981 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:43.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90c6ffd640 1 --2- 172.21.15.45:0/63622981 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90c80bc900 0x7f90c806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:43.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90c77fe640 1 --2- 172.21.15.45:0/63622981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90c814bb80 0x7f90c80a4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:43.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90c67fc640 1 -- 172.21.15.45:0/63622981 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90c80bc900 msgr2=0x7f90c806d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:43.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90c67fc640 1 --2- 172.21.15.45:0/63622981 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90c80bc900 0x7f90c806d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90c67fc640 1 -- 172.21.15.45:0/63622981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90c814bb80 msgr2=0x7f90c80a4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:43.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90c67fc640 1 --2- 172.21.15.45:0/63622981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90c814bb80 0x7f90c80a4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:43.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90c67fc640 1 -- 172.21.15.45:0/63622981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c0009b30 con 0x7f90c80bec40 2023-10-03T19:15:43.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90c6ffd640 1 --2- 172.21.15.45:0/63622981 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90c80bc900 0x7f90c806d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:15:43.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90c67fc640 1 --2- 172.21.15.45:0/63622981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90c80bec40 0x7f90c80a69d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00c7f0 tx=0x7f90bc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:43.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90affff640 1 -- 172.21.15.45:0/63622981 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc00cea0 con 0x7f90c80bec40 2023-10-03T19:15:43.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90affff640 1 -- 172.21.15.45:0/63622981 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90bc007a30 con 0x7f90c80bec40 2023-10-03T19:15:43.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90cd9fe640 1 -- 172.21.15.45:0/63622981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c80c03f0 con 0x7f90c80bec40 2023-10-03T19:15:43.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90affff640 1 -- 172.21.15.45:0/63622981 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc007dc0 con 0x7f90c80bec40 2023-10-03T19:15:43.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.939+0000 7f90cd9fe640 1 -- 172.21.15.45:0/63622981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c80c0c60 con 0x7f90c80bec40 2023-10-03T19:15:43.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.943+0000 7f90cd9fe640 1 -- 172.21.15.45:0/63622981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c80c0580 con 0x7f90c80bec40 2023-10-03T19:15:43.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.943+0000 7f90affff640 1 -- 172.21.15.45:0/63622981 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f90bc0113f0 con 0x7f90c80bec40 2023-10-03T19:15:43.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.943+0000 7f90affff640 1 --2- 172.21.15.45:0/63622981 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f90b4066280 0x7f90b4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:43.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.943+0000 7f90affff640 1 -- 172.21.15.45:0/63622981 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f90bc083c20 con 0x7f90c80bec40 2023-10-03T19:15:43.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.943+0000 7f90c6ffd640 1 --2- 172.21.15.45:0/63622981 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f90b4066280 0x7f90b4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:43.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.943+0000 7f90c6ffd640 1 --2- 172.21.15.45:0/63622981 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f90b4066280 0x7f90b4068730 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f90c00b1000 tx=0x7f90c00aa000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:43.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:43.947+0000 7f90affff640 1 -- 172.21.15.45:0/63622981 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f90bc0512c0 con 0x7f90c80bec40 2023-10-03T19:15:44.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.099+0000 7f90cd9fe640 1 -- 172.21.15.45:0/63622981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f90c80a4780 con 0x7f90c80bec40 2023-10-03T19:15:44.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.103+0000 7f90affff640 1 -- 172.21.15.45:0/63622981 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v44) v1 ==== 84+0+126 (secure 0 0 0) 0x7f90bc0548e0 con 0x7f90c80bec40 2023-10-03T19:15:44.107 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:15:44.107 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-10-03T19:15:44.108 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:15:44.108 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-10-03T19:15:44.108 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-10-03T19:15:44.108 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:15:44.108 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:15:44.108 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 2, 2023-10-03T19:15:44.108 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "rbd" 2023-10-03T19:15:44.108 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:15:44.108 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-10-03T19:15:44.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.103+0000 7f90cd9fe640 1 -- 172.21.15.45:0/63622981 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f90b4066280 msgr2=0x7f90b4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:44.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.103+0000 7f90cd9fe640 1 --2- 172.21.15.45:0/63622981 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f90b4066280 0x7f90b4068730 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f90c00b1000 tx=0x7f90c00aa000 comp rx=0 tx=0).stop 2023-10-03T19:15:44.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.103+0000 7f90cd9fe640 1 -- 172.21.15.45:0/63622981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90c80bec40 msgr2=0x7f90c80a69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:44.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.103+0000 7f90cd9fe640 1 --2- 172.21.15.45:0/63622981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90c80bec40 0x7f90c80a69d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00c7f0 tx=0x7f90bc00ccb0 comp rx=0 tx=0).stop 2023-10-03T19:15:44.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.103+0000 7f90cd9fe640 1 -- 172.21.15.45:0/63622981 shutdown_connections 2023-10-03T19:15:44.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.103+0000 7f90cd9fe640 1 --2- 172.21.15.45:0/63622981 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f90b4066280 0x7f90b4068730 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:44.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.103+0000 7f90cd9fe640 1 --2- 172.21.15.45:0/63622981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90c814bb80 0x7f90c80a4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:44.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.103+0000 7f90cd9fe640 1 --2- 172.21.15.45:0/63622981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90c80bec40 0x7f90c80a69d0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:44.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.103+0000 7f90cd9fe640 1 --2- 172.21.15.45:0/63622981 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90c80bc900 0x7f90c806d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:44.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.103+0000 7f90cd9fe640 1 -- 172.21.15.45:0/63622981 >> 172.21.15.45:0/63622981 conn(0x7f90c80c2200 msgr2=0x7f90c80bdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:44.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.103+0000 7f90cd9fe640 1 -- 172.21.15.45:0/63622981 shutdown_connections 2023-10-03T19:15:44.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.103+0000 7f90cd9fe640 1 -- 172.21.15.45:0/63622981 wait complete. 2023-10-03T19:15:44.127 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-03T19:15:44.127 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-03T19:15:44.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.243+0000 7f85ae0f9640 1 Processor -- start 2023-10-03T19:15:44.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.243+0000 7f85ae0f9640 1 -- start start 2023-10-03T19:15:44.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.243+0000 7f85ae0f9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f85a806c760 0x7f85a80a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:44.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.243+0000 7f85ae0f9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a806c2d0 con 0x7f85a806d560 2023-10-03T19:15:44.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.243+0000 7f85ae0f9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a8150610 con 0x7f85a80712c0 2023-10-03T19:15:44.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.243+0000 7f85ae0f9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a81508b0 con 0x7f85a806c760 2023-10-03T19:15:44.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.243+0000 7f85a7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f85a806c760 0x7f85a80a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:44.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.243+0000 7f85a6ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f85a806d560 0x7f85a80a53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50272/0 (socket says 172.21.15.45:50272) 2023-10-03T19:15:44.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.243+0000 7f85a6ffd640 1 -- 172.21.15.45:0/1805729926 learned_addr learned my addr 172.21.15.45:0/1805729926 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:15:44.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.243+0000 7f85a7fff640 1 -- 172.21.15.45:0/1805729926 >> v1:172.21.15.79:6789/0 conn(0x7f85a80712c0 legacy=0x7f85a80bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:44.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.243+0000 7f85a7fff640 1 -- 172.21.15.45:0/1805729926 >> v1:172.21.15.45:6789/0 conn(0x7f85a806d560 legacy=0x7f85a80a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:44.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.243+0000 7f85a7fff640 1 -- 172.21.15.45:0/1805729926 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a806d2e0 con 0x7f85a806c760 2023-10-03T19:15:44.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.247+0000 7f85a7fff640 1 --2- 172.21.15.45:0/1805729926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85a806c760 0x7f85a80a5ad0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f85a0009d90 tx=0x7f85a001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed3d23c6dd06e52 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:44.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.247+0000 7f85a67fc640 1 -- 172.21.15.45:0/1805729926 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a00a58b0 con 0x7f85a806c760 2023-10-03T19:15:44.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.247+0000 7f85a67fc640 1 -- 172.21.15.45:0/1805729926 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a00a5a10 con 0x7f85a806c760 2023-10-03T19:15:44.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.247+0000 7f85a67fc640 1 -- 172.21.15.45:0/1805729926 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a00a5da0 con 0x7f85a806c760 2023-10-03T19:15:44.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.247+0000 7f85ae0f9640 1 -- 172.21.15.45:0/1805729926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85a806c760 msgr2=0x7f85a80a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:44.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.247+0000 7f85ae0f9640 1 --2- 172.21.15.45:0/1805729926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85a806c760 0x7f85a80a5ad0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f85a0009d90 tx=0x7f85a001c8c0 comp rx=0 tx=0).stop 2023-10-03T19:15:44.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.247+0000 7f85ae0f9640 1 -- 172.21.15.45:0/1805729926 shutdown_connections 2023-10-03T19:15:44.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.247+0000 7f85ae0f9640 1 --2- 172.21.15.45:0/1805729926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85a806c760 0x7f85a80a5ad0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:44.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.247+0000 7f85ae0f9640 1 -- 172.21.15.45:0/1805729926 >> 172.21.15.45:0/1805729926 conn(0x7f85a80a20d0 msgr2=0x7f85a80a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:44.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.247+0000 7f85ae0f9640 1 -- 172.21.15.45:0/1805729926 shutdown_connections 2023-10-03T19:15:44.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.247+0000 7f85ae0f9640 1 -- 172.21.15.45:0/1805729926 wait complete. 2023-10-03T19:15:44.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.247+0000 7f85ae0f9640 1 Processor -- start 2023-10-03T19:15:44.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.247+0000 7f85ae0f9640 1 -- start start 2023-10-03T19:15:44.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.251+0000 7f85ae0f9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85a806c760 0x7f85a8142220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:44.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.251+0000 7f85ae0f9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85a806d560 0x7f85a81477a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:44.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.251+0000 7f85ae0f9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85a80712c0 0x7f85a81e6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:44.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.251+0000 7f85ae0f9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a814a930 con 0x7f85a806c760 2023-10-03T19:15:44.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.251+0000 7f85ae0f9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a814de20 con 0x7f85a80712c0 2023-10-03T19:15:44.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.251+0000 7f85ae0f9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a814a5e0 con 0x7f85a806d560 2023-10-03T19:15:44.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.251+0000 7f85a77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85a806c760 0x7f85a8142220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:44.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.251+0000 7f85a77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85a806c760 0x7f85a8142220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53266/0 (socket says 172.21.15.45:53266) 2023-10-03T19:15:44.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.251+0000 7f85a77fe640 1 -- 172.21.15.45:0/3712482626 learned_addr learned my addr 172.21.15.45:0/3712482626 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:44.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.251+0000 7f85a7fff640 1 --2- 172.21.15.45:0/3712482626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85a80712c0 0x7f85a81e6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:44.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.251+0000 7f85a77fe640 1 -- 172.21.15.45:0/3712482626 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85a806d560 msgr2=0x7f85a81477a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:44.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.251+0000 7f85a6ffd640 1 --2- 172.21.15.45:0/3712482626 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85a806d560 0x7f85a81477a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:44.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.251+0000 7f85a77fe640 1 --2- 172.21.15.45:0/3712482626 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85a806d560 0x7f85a81477a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:44.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.251+0000 7f85a77fe640 1 -- 172.21.15.45:0/3712482626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85a80712c0 msgr2=0x7f85a81e6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:44.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.251+0000 7f85a77fe640 1 --2- 172.21.15.45:0/3712482626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85a80712c0 0x7f85a81e6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:44.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.251+0000 7f85a77fe640 1 -- 172.21.15.45:0/3712482626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a0009a70 con 0x7f85a806c760 2023-10-03T19:15:44.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.251+0000 7f85a77fe640 1 --2- 172.21.15.45:0/3712482626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85a806c760 0x7f85a8142220 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f859800c3f0 tx=0x7f859800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:44.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.251+0000 7f858ffff640 1 -- 172.21.15.45:0/3712482626 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85980052d0 con 0x7f85a806c760 2023-10-03T19:15:44.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.251+0000 7f858ffff640 1 -- 172.21.15.45:0/3712482626 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8598005430 con 0x7f85a806c760 2023-10-03T19:15:44.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.251+0000 7f858ffff640 1 -- 172.21.15.45:0/3712482626 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8598003840 con 0x7f85a806c760 2023-10-03T19:15:44.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.251+0000 7f85ae0f9640 1 -- 172.21.15.45:0/3712482626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a8071820 con 0x7f85a806c760 2023-10-03T19:15:44.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.251+0000 7f85ae0f9640 1 -- 172.21.15.45:0/3712482626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a8071690 con 0x7f85a806c760 2023-10-03T19:15:44.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.251+0000 7f85ae0f9640 1 -- 172.21.15.45:0/3712482626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a81eafc0 con 0x7f85a806c760 2023-10-03T19:15:44.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.251+0000 7f858ffff640 1 -- 172.21.15.45:0/3712482626 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f85980039a0 con 0x7f85a806c760 2023-10-03T19:15:44.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.251+0000 7f858ffff640 1 --2- 172.21.15.45:0/3712482626 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f85940662b0 0x7f8594068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:44.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.251+0000 7f858ffff640 1 -- 172.21.15.45:0/3712482626 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8598082f50 con 0x7f85a806c760 2023-10-03T19:15:44.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.251+0000 7f85a6ffd640 1 --2- 172.21.15.45:0/3712482626 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f85940662b0 0x7f8594068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:44.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.255+0000 7f85a6ffd640 1 --2- 172.21.15.45:0/3712482626 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f85940662b0 0x7f8594068760 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f85a80bbdc0 tx=0x7f859c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:44.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.255+0000 7f858ffff640 1 -- 172.21.15.45:0/3712482626 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8598050710 con 0x7f85a806c760 2023-10-03T19:15:44.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.411+0000 7f85ae0f9640 1 -- 172.21.15.45:0/3712482626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f85a804de80 con 0x7f85a806c760 2023-10-03T19:15:44.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-10-03T19:15:44.730 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-10-03T19:15:44.730 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-03T19:15:44.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.807+0000 7f858ffff640 1 -- 172.21.15.45:0/3712482626 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v45) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8598053d30 con 0x7f85a806c760 2023-10-03T19:15:44.878 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-10-03T19:15:44.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.811+0000 7f85ae0f9640 1 -- 172.21.15.45:0/3712482626 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f85940662b0 msgr2=0x7f8594068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:44.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.811+0000 7f85ae0f9640 1 --2- 172.21.15.45:0/3712482626 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f85940662b0 0x7f8594068760 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f85a80bbdc0 tx=0x7f859c009040 comp rx=0 tx=0).stop 2023-10-03T19:15:44.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.811+0000 7f85ae0f9640 1 -- 172.21.15.45:0/3712482626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85a806c760 msgr2=0x7f85a8142220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:44.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.811+0000 7f85ae0f9640 1 --2- 172.21.15.45:0/3712482626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85a806c760 0x7f85a8142220 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f859800c3f0 tx=0x7f859800c8b0 comp rx=0 tx=0).stop 2023-10-03T19:15:44.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.811+0000 7f85ae0f9640 1 -- 172.21.15.45:0/3712482626 shutdown_connections 2023-10-03T19:15:44.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.811+0000 7f85ae0f9640 1 --2- 172.21.15.45:0/3712482626 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f85940662b0 0x7f8594068760 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:44.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.811+0000 7f85ae0f9640 1 --2- 172.21.15.45:0/3712482626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85a80712c0 0x7f85a81e6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:44.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.811+0000 7f85ae0f9640 1 --2- 172.21.15.45:0/3712482626 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85a806d560 0x7f85a81477a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:44.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.811+0000 7f85ae0f9640 1 --2- 172.21.15.45:0/3712482626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85a806c760 0x7f85a8142220 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:44.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.811+0000 7f85ae0f9640 1 -- 172.21.15.45:0/3712482626 >> 172.21.15.45:0/3712482626 conn(0x7f85a80a20d0 msgr2=0x7f85a80c0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:44.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.811+0000 7f85ae0f9640 1 -- 172.21.15.45:0/3712482626 shutdown_connections 2023-10-03T19:15:44.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:44.811+0000 7f85ae0f9640 1 -- 172.21.15.45:0/3712482626 wait complete. 2023-10-03T19:15:44.881 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-03T19:15:45.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.011+0000 7f1c68364640 1 Processor -- start 2023-10-03T19:15:45.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.011+0000 7f1c68364640 1 -- start start 2023-10-03T19:15:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.011+0000 7f1c68364640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1c600be9c0 0x7f1c600bd550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.011+0000 7f1c68364640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1c6014c970 0x7f1c6014cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.011+0000 7f1c68364640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6014c490 con 0x7f1c600a5f60 2023-10-03T19:15:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.011+0000 7f1c68364640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6006af90 con 0x7f1c6014c970 2023-10-03T19:15:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.011+0000 7f1c68364640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6006acb0 con 0x7f1c600be9c0 2023-10-03T19:15:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.011+0000 7f1c66901640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1c6014c970 0x7f1c6014cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.011+0000 7f1c658ff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1c600a5f60 0x7f1c60149620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50712/0 (socket says 172.21.15.45:50712) 2023-10-03T19:15:45.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.011+0000 7f1c658ff640 1 -- 172.21.15.45:0/3387370697 learned_addr learned my addr 172.21.15.45:0/3387370697 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:15:45.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.015+0000 7f1c66100640 1 --2- 172.21.15.45:0/3387370697 >> v2:172.21.15.79:3300/0 conn(0x7f1c600be9c0 0x7f1c600bd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:45.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.015+0000 7f1c66901640 1 -- 172.21.15.45:0/3387370697 >> v2:172.21.15.79:3300/0 conn(0x7f1c600be9c0 msgr2=0x7f1c600bd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:45.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.015+0000 7f1c66901640 1 --2- 172.21.15.45:0/3387370697 >> v2:172.21.15.79:3300/0 conn(0x7f1c600be9c0 0x7f1c600bd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:45.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.015+0000 7f1c66901640 1 -- 172.21.15.45:0/3387370697 >> v1:172.21.15.45:6789/0 conn(0x7f1c600a5f60 legacy=0x7f1c60149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:45.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.015+0000 7f1c66901640 1 -- 172.21.15.45:0/3387370697 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6006a5c0 con 0x7f1c6014c970 2023-10-03T19:15:45.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.015+0000 7f1c650fe640 1 -- 172.21.15.45:0/3387370697 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1984768118 0 0) 0x7f1c6014c490 con 0x7f1c600a5f60 2023-10-03T19:15:45.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.015+0000 7f1c66901640 1 --2- 172.21.15.45:0/3387370697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c6014c970 0x7f1c6014cdd0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1c6006a270 tx=0x7f1c5801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38656852b1b35e24 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:45.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.015+0000 7f1c650fe640 1 -- 172.21.15.45:0/3387370697 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c580a5940 con 0x7f1c6014c970 2023-10-03T19:15:45.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.015+0000 7f1c650fe640 1 -- 172.21.15.45:0/3387370697 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c580a5aa0 con 0x7f1c6014c970 2023-10-03T19:15:45.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.015+0000 7f1c650fe640 1 -- 172.21.15.45:0/3387370697 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c580a5e30 con 0x7f1c6014c970 2023-10-03T19:15:45.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.015+0000 7f1c68364640 1 -- 172.21.15.45:0/3387370697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c6014c970 msgr2=0x7f1c6014cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:45.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.015+0000 7f1c68364640 1 --2- 172.21.15.45:0/3387370697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c6014c970 0x7f1c6014cdd0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1c6006a270 tx=0x7f1c5801c8e0 comp rx=0 tx=0).stop 2023-10-03T19:15:45.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.015+0000 7f1c68364640 1 -- 172.21.15.45:0/3387370697 shutdown_connections 2023-10-03T19:15:45.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.015+0000 7f1c68364640 1 --2- 172.21.15.45:0/3387370697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c6014c970 0x7f1c6014cdd0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:45.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.015+0000 7f1c68364640 1 --2- 172.21.15.45:0/3387370697 >> v2:172.21.15.79:3300/0 conn(0x7f1c600be9c0 0x7f1c600bd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:45.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.015+0000 7f1c68364640 1 -- 172.21.15.45:0/3387370697 >> 172.21.15.45:0/3387370697 conn(0x7f1c600c2240 msgr2=0x7f1c600be050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:45.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.015+0000 7f1c68364640 1 -- 172.21.15.45:0/3387370697 shutdown_connections 2023-10-03T19:15:45.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.015+0000 7f1c68364640 1 -- 172.21.15.45:0/3387370697 wait complete. 2023-10-03T19:15:45.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.019+0000 7f1c68364640 1 Processor -- start 2023-10-03T19:15:45.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.019+0000 7f1c68364640 1 -- start start 2023-10-03T19:15:45.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.019+0000 7f1c68364640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c600a5f60 0x7f1c60148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:45.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.019+0000 7f1c68364640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c600be9c0 0x7f1c601e6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:45.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.019+0000 7f1c68364640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c6014c970 0x7f1c601e65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:45.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.019+0000 7f1c68364640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c60070150 con 0x7f1c600a5f60 2023-10-03T19:15:45.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.019+0000 7f1c68364640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c600716d0 con 0x7f1c6014c970 2023-10-03T19:15:45.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.019+0000 7f1c68364640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6014e580 con 0x7f1c600be9c0 2023-10-03T19:15:45.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.019+0000 7f1c66100640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c600a5f60 0x7f1c60148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:45.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.019+0000 7f1c66100640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c600a5f60 0x7f1c60148dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37650/0 (socket says 172.21.15.45:37650) 2023-10-03T19:15:45.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.019+0000 7f1c66100640 1 -- 172.21.15.45:0/1789788921 learned_addr learned my addr 172.21.15.45:0/1789788921 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:45.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.019+0000 7f1c66901640 1 --2- 172.21.15.45:0/1789788921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c6014c970 0x7f1c601e65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:45.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.019+0000 7f1c658ff640 1 --2- 172.21.15.45:0/1789788921 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c600be9c0 0x7f1c601e6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:45.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.019+0000 7f1c66100640 1 -- 172.21.15.45:0/1789788921 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c600be9c0 msgr2=0x7f1c601e6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:45.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.019+0000 7f1c66100640 1 --2- 172.21.15.45:0/1789788921 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c600be9c0 0x7f1c601e6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:45.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.019+0000 7f1c66100640 1 -- 172.21.15.45:0/1789788921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c6014c970 msgr2=0x7f1c601e65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:45.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.019+0000 7f1c66100640 1 --2- 172.21.15.45:0/1789788921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c6014c970 0x7f1c601e65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:45.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.019+0000 7f1c66100640 1 -- 172.21.15.45:0/1789788921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c58009a70 con 0x7f1c600a5f60 2023-10-03T19:15:45.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.019+0000 7f1c66100640 1 --2- 172.21.15.45:0/1789788921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c600a5f60 0x7f1c60148dd0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00d800 tx=0x7f1c5c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:45.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.019+0000 7f1c56ffd640 1 -- 172.21.15.45:0/1789788921 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c00b6c0 con 0x7f1c600a5f60 2023-10-03T19:15:45.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.019+0000 7f1c56ffd640 1 -- 172.21.15.45:0/1789788921 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5c00b820 con 0x7f1c600a5f60 2023-10-03T19:15:45.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.019+0000 7f1c68364640 1 -- 172.21.15.45:0/1789788921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c600bef20 con 0x7f1c600a5f60 2023-10-03T19:15:45.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.019+0000 7f1c56ffd640 1 -- 172.21.15.45:0/1789788921 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c00bb90 con 0x7f1c600a5f60 2023-10-03T19:15:45.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.019+0000 7f1c68364640 1 -- 172.21.15.45:0/1789788921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c600bed90 con 0x7f1c600a5f60 2023-10-03T19:15:45.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.019+0000 7f1c68364640 1 -- 172.21.15.45:0/1789788921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c6006b3e0 con 0x7f1c600a5f60 2023-10-03T19:15:45.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.019+0000 7f1c56ffd640 1 -- 172.21.15.45:0/1789788921 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1c5c00bcf0 con 0x7f1c600a5f60 2023-10-03T19:15:45.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.023+0000 7f1c56ffd640 1 --2- 172.21.15.45:0/1789788921 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1c44066280 0x7f1c44068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:45.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.023+0000 7f1c56ffd640 1 -- 172.21.15.45:0/1789788921 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f1c5c084030 con 0x7f1c600a5f60 2023-10-03T19:15:45.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.023+0000 7f1c658ff640 1 --2- 172.21.15.45:0/1789788921 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1c44066280 0x7f1c44068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:45.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.023+0000 7f1c658ff640 1 --2- 172.21.15.45:0/1789788921 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1c44066280 0x7f1c44068730 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1c600a4ee0 tx=0x7f1c50007c10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:45.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.027+0000 7f1c56ffd640 1 -- 172.21.15.45:0/1789788921 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1c5c0551b0 con 0x7f1c600a5f60 2023-10-03T19:15:45.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.175+0000 7f1c68364640 1 -- 172.21.15.45:0/1789788921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1c600a6750 con 0x7f1c600a5f60 2023-10-03T19:15:45.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.811+0000 7f1c56ffd640 1 -- 172.21.15.45:0/1789788921 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v46) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1c5c054d40 con 0x7f1c600a5f60 2023-10-03T19:15:45.862 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-10-03T19:15:45.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.819+0000 7f1c68364640 1 -- 172.21.15.45:0/1789788921 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1c44066280 msgr2=0x7f1c44068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:45.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.819+0000 7f1c68364640 1 --2- 172.21.15.45:0/1789788921 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1c44066280 0x7f1c44068730 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1c600a4ee0 tx=0x7f1c50007c10 comp rx=0 tx=0).stop 2023-10-03T19:15:45.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.819+0000 7f1c68364640 1 -- 172.21.15.45:0/1789788921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c600a5f60 msgr2=0x7f1c60148dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:45.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.819+0000 7f1c68364640 1 --2- 172.21.15.45:0/1789788921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c600a5f60 0x7f1c60148dd0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00d800 tx=0x7f1c5c00dcc0 comp rx=0 tx=0).stop 2023-10-03T19:15:45.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.819+0000 7f1c68364640 1 -- 172.21.15.45:0/1789788921 shutdown_connections 2023-10-03T19:15:45.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.819+0000 7f1c68364640 1 --2- 172.21.15.45:0/1789788921 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1c44066280 0x7f1c44068730 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:45.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.819+0000 7f1c68364640 1 --2- 172.21.15.45:0/1789788921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c6014c970 0x7f1c601e65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:45.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.819+0000 7f1c68364640 1 --2- 172.21.15.45:0/1789788921 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c600be9c0 0x7f1c601e6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:45.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.819+0000 7f1c68364640 1 --2- 172.21.15.45:0/1789788921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c600a5f60 0x7f1c60148dd0 secure :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00d800 tx=0x7f1c5c00dcc0 comp rx=0 tx=0).stop 2023-10-03T19:15:45.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.819+0000 7f1c68364640 1 -- 172.21.15.45:0/1789788921 >> 172.21.15.45:0/1789788921 conn(0x7f1c600c2240 msgr2=0x7f1c6006e000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:45.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.823+0000 7f1c68364640 1 -- 172.21.15.45:0/1789788921 shutdown_connections 2023-10-03T19:15:45.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:45.827+0000 7f1c68364640 1 -- 172.21.15.45:0/1789788921 wait complete. 2023-10-03T19:15:45.872 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-03T19:15:46.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdda5eaf640 1 Processor -- start 2023-10-03T19:15:46.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdda5eaf640 1 -- start start 2023-10-03T19:15:46.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdda5eaf640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdda006f880 0x7fdda00a5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:46.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdda5eaf640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda014f080 con 0x7fdda014f510 2023-10-03T19:15:46.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdda5eaf640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda0070e90 con 0x7fdda014ba30 2023-10-03T19:15:46.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdda5eaf640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda006f3e0 con 0x7fdda006f880 2023-10-03T19:15:46.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdd9effd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdda014f510 0x7fdda014b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50724/0 (socket says 172.21.15.45:50724) 2023-10-03T19:15:46.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdd9effd640 1 -- 172.21.15.45:0/3911935122 learned_addr learned my addr 172.21.15.45:0/3911935122 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:15:46.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdd9e7fc640 1 -- 172.21.15.45:0/3911935122 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2532141420 0 0) 0x7fdda014f080 con 0x7fdda014f510 2023-10-03T19:15:46.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdd9f7fe640 1 --2- 172.21.15.45:0/3911935122 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdda006f880 0x7fdda00a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:46.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdd9e7fc640 1 -- 172.21.15.45:0/3911935122 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd8c005740 con 0x7fdda014f510 2023-10-03T19:15:46.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdd9e7fc640 1 -- 172.21.15.45:0/3911935122 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 906557345 0 0) 0x7fdd8c005740 con 0x7fdda014f510 2023-10-03T19:15:46.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdd9e7fc640 1 -- 172.21.15.45:0/3911935122 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdda006f880 msgr2=0x7fdda00a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:46.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdd9e7fc640 1 --2- 172.21.15.45:0/3911935122 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdda006f880 0x7fdda00a5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:46.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdd9e7fc640 1 -- 172.21.15.45:0/3911935122 >> v1:172.21.15.79:6789/0 conn(0x7fdda014ba30 legacy=0x7fdda0155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:46.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdd9e7fc640 1 -- 172.21.15.45:0/3911935122 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda014ea30 con 0x7fdda014f510 2023-10-03T19:15:46.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdd9e7fc640 1 -- 172.21.15.45:0/3911935122 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fdd88001680 con 0x7fdda014f510 2023-10-03T19:15:46.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdd9e7fc640 1 -- 172.21.15.45:0/3911935122 >> v1:172.21.15.45:6789/0 conn(0x7fdda014f510 legacy=0x7fdda014b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:46.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdd9e7fc640 1 --2- 172.21.15.45:0/3911935122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd8c005bc0 0x7fdd8c005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:46.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdd9e7fc640 1 --2- 172.21.15.45:0/3911935122 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdda006f880 0x7fdd8c0069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:46.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdd9e7fc640 1 --2- 172.21.15.45:0/3911935122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd8c006f20 0x7fdd8c007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:46.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdd9e7fc640 1 -- 172.21.15.45:0/3911935122 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda006f3e0 con 0x7fdd8c005bc0 2023-10-03T19:15:46.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdd9e7fc640 1 -- 172.21.15.45:0/3911935122 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c00dc50 con 0x7fdd8c006f20 2023-10-03T19:15:46.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdd9e7fc640 1 -- 172.21.15.45:0/3911935122 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c00dde0 con 0x7fdda006f880 2023-10-03T19:15:46.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdd9f7fe640 1 --2- 172.21.15.45:0/3911935122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd8c005bc0 0x7fdd8c005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:46.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdd9effd640 1 --2- 172.21.15.45:0/3911935122 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdda006f880 0x7fdd8c0069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:46.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdd9ffff640 1 --2- 172.21.15.45:0/3911935122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd8c006f20 0x7fdd8c007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:46.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdd9f7fe640 1 -- 172.21.15.45:0/3911935122 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdda006f880 msgr2=0x7fdd8c0069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:46.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdd9f7fe640 1 --2- 172.21.15.45:0/3911935122 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdda006f880 0x7fdd8c0069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:46.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdd9f7fe640 1 -- 172.21.15.45:0/3911935122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd8c006f20 msgr2=0x7fdd8c007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:46.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdd9f7fe640 1 --2- 172.21.15.45:0/3911935122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd8c006f20 0x7fdd8c007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:46.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdd9f7fe640 1 -- 172.21.15.45:0/3911935122 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c005740 con 0x7fdd8c005bc0 2023-10-03T19:15:46.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdd9effd640 1 --2- 172.21.15.45:0/3911935122 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdda006f880 0x7fdd8c0069e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:15:46.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.123+0000 7fdd9ffff640 1 --2- 172.21.15.45:0/3911935122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd8c006f20 0x7fdd8c007390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:15:46.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.127+0000 7fdd9f7fe640 1 --2- 172.21.15.45:0/3911935122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd8c005bc0 0x7fdd8c005fd0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009ae0 tx=0x7fdd9001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d770826b5946230d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:46.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.127+0000 7fdd9e7fc640 1 -- 172.21.15.45:0/3911935122 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd900a5550 con 0x7fdd8c005bc0 2023-10-03T19:15:46.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.127+0000 7fdd9e7fc640 1 -- 172.21.15.45:0/3911935122 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd900a56b0 con 0x7fdd8c005bc0 2023-10-03T19:15:46.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.127+0000 7fdd9e7fc640 1 -- 172.21.15.45:0/3911935122 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd900a5a60 con 0x7fdd8c005bc0 2023-10-03T19:15:46.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.127+0000 7fdda5eaf640 1 -- 172.21.15.45:0/3911935122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd8c005bc0 msgr2=0x7fdd8c005fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:46.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.127+0000 7fdda5eaf640 1 --2- 172.21.15.45:0/3911935122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd8c005bc0 0x7fdd8c005fd0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009ae0 tx=0x7fdd9001ca20 comp rx=0 tx=0).stop 2023-10-03T19:15:46.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.127+0000 7fdd9ffff640 1 -- 172.21.15.45:0/3911935122 reap_dead start 2023-10-03T19:15:46.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.127+0000 7fdda5eaf640 1 -- 172.21.15.45:0/3911935122 shutdown_connections 2023-10-03T19:15:46.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.127+0000 7fdda5eaf640 1 -- 172.21.15.45:0/3911935122 >> 172.21.15.45:0/3911935122 conn(0x7fdda00a20d0 msgr2=0x7fdda00a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:46.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.127+0000 7fdda5eaf640 1 -- 172.21.15.45:0/3911935122 shutdown_connections 2023-10-03T19:15:46.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.127+0000 7fdda5eaf640 1 -- 172.21.15.45:0/3911935122 wait complete. 2023-10-03T19:15:46.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.127+0000 7fdda5eaf640 1 Processor -- start 2023-10-03T19:15:46.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.127+0000 7fdda5eaf640 1 -- start start 2023-10-03T19:15:46.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.131+0000 7fdda5eaf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd8c005bc0 0x7fdda00be010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:46.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.131+0000 7fdda5eaf640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdda00bffb0 0x7fdda01e61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:46.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.131+0000 7fdda5eaf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdda0142c40 0x7fdda0141fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:46.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.131+0000 7fdda5eaf640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda00bc900 con 0x7fdd8c005bc0 2023-10-03T19:15:46.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.131+0000 7fdda5eaf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda01e6dd0 con 0x7fdda0142c40 2023-10-03T19:15:46.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.131+0000 7fdda5eaf640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda0140a00 con 0x7fdda00bffb0 2023-10-03T19:15:46.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.131+0000 7fdd9f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd8c005bc0 0x7fdda00be010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:46.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.131+0000 7fdd9f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd8c005bc0 0x7fdda00be010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37662/0 (socket says 172.21.15.45:37662) 2023-10-03T19:15:46.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.131+0000 7fdd9f7fe640 1 -- 172.21.15.45:0/4242653234 learned_addr learned my addr 172.21.15.45:0/4242653234 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:46.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.131+0000 7fdd9ffff640 1 --2- 172.21.15.45:0/4242653234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdda0142c40 0x7fdda0141fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:46.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.131+0000 7fdd9f7fe640 1 -- 172.21.15.45:0/4242653234 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdda00bffb0 msgr2=0x7fdda01e61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:46.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.131+0000 7fdd9f7fe640 1 --2- 172.21.15.45:0/4242653234 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdda00bffb0 0x7fdda01e61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:46.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.131+0000 7fdd9f7fe640 1 -- 172.21.15.45:0/4242653234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdda0142c40 msgr2=0x7fdda0141fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:46.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.131+0000 7fdd9f7fe640 1 --2- 172.21.15.45:0/4242653234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdda0142c40 0x7fdda0141fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:46.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.131+0000 7fdd9f7fe640 1 -- 172.21.15.45:0/4242653234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda0070a40 con 0x7fdd8c005bc0 2023-10-03T19:15:46.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.131+0000 7fdd9f7fe640 1 --2- 172.21.15.45:0/4242653234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd8c005bc0 0x7fdda00be010 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009ae0 tx=0x7fdd8c007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:46.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.131+0000 7fdd97fff640 1 -- 172.21.15.45:0/4242653234 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd900a5ea0 con 0x7fdd8c005bc0 2023-10-03T19:15:46.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.131+0000 7fdd97fff640 1 -- 172.21.15.45:0/4242653234 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd90004020 con 0x7fdd8c005bc0 2023-10-03T19:15:46.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.131+0000 7fdda5eaf640 1 -- 172.21.15.45:0/4242653234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda006fc50 con 0x7fdd8c005bc0 2023-10-03T19:15:46.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.131+0000 7fdd97fff640 1 -- 172.21.15.45:0/4242653234 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd90004390 con 0x7fdd8c005bc0 2023-10-03T19:15:46.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.131+0000 7fdda5eaf640 1 -- 172.21.15.45:0/4242653234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda0070bd0 con 0x7fdd8c005bc0 2023-10-03T19:15:46.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.131+0000 7fdda5eaf640 1 -- 172.21.15.45:0/4242653234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda0140ee0 con 0x7fdd8c005bc0 2023-10-03T19:15:46.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.131+0000 7fdd97fff640 1 -- 172.21.15.45:0/4242653234 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdd900b4040 con 0x7fdd8c005bc0 2023-10-03T19:15:46.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.131+0000 7fdd97fff640 1 --2- 172.21.15.45:0/4242653234 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fdd80066280 0x7fdd80068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:46.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.131+0000 7fdd97fff640 1 -- 172.21.15.45:0/4242653234 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fdd9011dd90 con 0x7fdd8c005bc0 2023-10-03T19:15:46.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.131+0000 7fdd9effd640 1 --2- 172.21.15.45:0/4242653234 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fdd80066280 0x7fdd80068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:46.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.135+0000 7fdd9effd640 1 --2- 172.21.15.45:0/4242653234 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fdd80066280 0x7fdd80068730 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdd88000f70 tx=0x7fdd88009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:46.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.135+0000 7fdd97fff640 1 -- 172.21.15.45:0/4242653234 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fdda0140ee0 con 0x7fdd8c005bc0 2023-10-03T19:15:46.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.323+0000 7fdda5eaf640 1 -- 172.21.15.45:0/4242653234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdda0140ee0 con 0x7fdd8c005bc0 2023-10-03T19:15:46.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.351+0000 7fdd97fff640 1 -- 172.21.15.45:0/4242653234 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v19) v1 ==== 172+0+0 (secure 0 0 0) 0x7fdda0140ee0 con 0x7fdd8c005bc0 2023-10-03T19:15:46.776 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 7 and data pool 8 2023-10-03T19:15:46.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.363+0000 7fdda5eaf640 1 -- 172.21.15.45:0/4242653234 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fdd80066280 msgr2=0x7fdd80068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:46.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.363+0000 7fdda5eaf640 1 --2- 172.21.15.45:0/4242653234 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fdd80066280 0x7fdd80068730 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdd88000f70 tx=0x7fdd88009040 comp rx=0 tx=0).stop 2023-10-03T19:15:46.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.363+0000 7fdda5eaf640 1 -- 172.21.15.45:0/4242653234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd8c005bc0 msgr2=0x7fdda00be010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:46.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.363+0000 7fdda5eaf640 1 --2- 172.21.15.45:0/4242653234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd8c005bc0 0x7fdda00be010 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009ae0 tx=0x7fdd8c007a10 comp rx=0 tx=0).stop 2023-10-03T19:15:46.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.363+0000 7fdda5eaf640 1 -- 172.21.15.45:0/4242653234 shutdown_connections 2023-10-03T19:15:46.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.363+0000 7fdda5eaf640 1 --2- 172.21.15.45:0/4242653234 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fdd80066280 0x7fdd80068730 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:46.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.363+0000 7fdda5eaf640 1 --2- 172.21.15.45:0/4242653234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdda0142c40 0x7fdda0141fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:46.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.363+0000 7fdda5eaf640 1 --2- 172.21.15.45:0/4242653234 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdda00bffb0 0x7fdda01e61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:46.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.363+0000 7fdda5eaf640 1 --2- 172.21.15.45:0/4242653234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd8c005bc0 0x7fdda00be010 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:46.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.363+0000 7fdda5eaf640 1 -- 172.21.15.45:0/4242653234 >> 172.21.15.45:0/4242653234 conn(0x7fdda00a20d0 msgr2=0x7fdda00bd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:46.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.367+0000 7fdda5eaf640 1 -- 172.21.15.45:0/4242653234 shutdown_connections 2023-10-03T19:15:46.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.367+0000 7fdda5eaf640 1 -- 172.21.15.45:0/4242653234 wait complete. 2023-10-03T19:15:46.780 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:15:46.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.911+0000 7fb5ea974640 1 Processor -- start 2023-10-03T19:15:46.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.911+0000 7fb5ea974640 1 -- start start 2023-10-03T19:15:46.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.911+0000 7fb5ea974640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb5e4071380 0x7fb5e40bc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:46.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.911+0000 7fb5ea974640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb5e40bcb80 0x7fb5e4152850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:46.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.911+0000 7fb5ea974640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5e4152d90 con 0x7fb5e4071750 2023-10-03T19:15:46.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.911+0000 7fb5ea974640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5e414f860 con 0x7fb5e4071380 2023-10-03T19:15:46.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.911+0000 7fb5ea974640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5e40bd220 con 0x7fb5e40bcb80 2023-10-03T19:15:46.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.911+0000 7fb5e3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb5e4071380 0x7fb5e40bc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:46.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.911+0000 7fb5e8f11640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb5e4071750 0x7fb5e414b9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50730/0 (socket says 172.21.15.45:50730) 2023-10-03T19:15:46.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.911+0000 7fb5e8f11640 1 -- 172.21.15.45:0/1607047943 learned_addr learned my addr 172.21.15.45:0/1607047943 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:15:46.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.911+0000 7fb5db7fe640 1 --2- 172.21.15.45:0/1607047943 >> v2:172.21.15.79:3300/0 conn(0x7fb5e40bcb80 0x7fb5e4152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:46.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.911+0000 7fb5e3fff640 1 -- 172.21.15.45:0/1607047943 >> v2:172.21.15.79:3300/0 conn(0x7fb5e40bcb80 msgr2=0x7fb5e4152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:46.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.911+0000 7fb5e3fff640 1 --2- 172.21.15.45:0/1607047943 >> v2:172.21.15.79:3300/0 conn(0x7fb5e40bcb80 0x7fb5e4152850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:46.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.911+0000 7fb5e3fff640 1 -- 172.21.15.45:0/1607047943 >> v1:172.21.15.45:6789/0 conn(0x7fb5e4071750 legacy=0x7fb5e414b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:46.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.911+0000 7fb5e37fe640 1 -- 172.21.15.45:0/1607047943 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2547201774 0 0) 0x7fb5e4152d90 con 0x7fb5e4071750 2023-10-03T19:15:46.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.911+0000 7fb5e3fff640 1 -- 172.21.15.45:0/1607047943 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e4071cf0 con 0x7fb5e4071380 2023-10-03T19:15:46.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5e3fff640 1 --2- 172.21.15.45:0/1607047943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5e4071380 0x7fb5e40bc4f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4072180 tx=0x7fb5d401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce926e5624cd4b3d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:46.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5e37fe640 1 -- 172.21.15.45:0/1607047943 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d40ab600 con 0x7fb5e4071380 2023-10-03T19:15:46.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5e37fe640 1 -- 172.21.15.45:0/1607047943 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d40a7050 con 0x7fb5e4071380 2023-10-03T19:15:46.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5e37fe640 1 -- 172.21.15.45:0/1607047943 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d40ab980 con 0x7fb5e4071380 2023-10-03T19:15:46.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5ea974640 1 -- 172.21.15.45:0/1607047943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5e4071380 msgr2=0x7fb5e40bc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:46.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5ea974640 1 --2- 172.21.15.45:0/1607047943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5e4071380 0x7fb5e40bc4f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4072180 tx=0x7fb5d401c460 comp rx=0 tx=0).stop 2023-10-03T19:15:46.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5ea974640 1 -- 172.21.15.45:0/1607047943 shutdown_connections 2023-10-03T19:15:46.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5ea974640 1 --2- 172.21.15.45:0/1607047943 >> v2:172.21.15.79:3300/0 conn(0x7fb5e40bcb80 0x7fb5e4152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:46.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5ea974640 1 --2- 172.21.15.45:0/1607047943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5e4071380 0x7fb5e40bc4f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:46.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5ea974640 1 -- 172.21.15.45:0/1607047943 >> 172.21.15.45:0/1607047943 conn(0x7fb5e406bce0 msgr2=0x7fb5e406c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:46.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5ea974640 1 -- 172.21.15.45:0/1607047943 shutdown_connections 2023-10-03T19:15:46.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5ea974640 1 -- 172.21.15.45:0/1607047943 wait complete. 2023-10-03T19:15:46.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5ea974640 1 Processor -- start 2023-10-03T19:15:46.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5ea974640 1 -- start start 2023-10-03T19:15:46.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5ea974640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb5e4071380 0x7fb5e40a7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:46.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5ea974640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5e4071750 0x7fb5e41e6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:46.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5ea974640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5e40bcb80 0x7fb5e41446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:46.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5ea974640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e40c1900 con 0x7fb5e4071750 2023-10-03T19:15:46.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5ea974640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e41e65b0 con 0x7fb5e40bcb80 2023-10-03T19:15:46.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5ea974640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e41e6890 con 0x7fb5e4071380 2023-10-03T19:15:46.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5db7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5e4071750 0x7fb5e41e6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:46.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5db7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5e4071750 0x7fb5e41e6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37670/0 (socket says 172.21.15.45:37670) 2023-10-03T19:15:46.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5db7fe640 1 -- 172.21.15.45:0/3269066826 learned_addr learned my addr 172.21.15.45:0/3269066826 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:46.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5e3fff640 1 --2- 172.21.15.45:0/3269066826 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb5e4071380 0x7fb5e40a7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:46.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5e8f11640 1 --2- 172.21.15.45:0/3269066826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5e40bcb80 0x7fb5e41446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:46.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5db7fe640 1 -- 172.21.15.45:0/3269066826 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb5e4071380 msgr2=0x7fb5e40a7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:46.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5db7fe640 1 --2- 172.21.15.45:0/3269066826 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb5e4071380 0x7fb5e40a7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:46.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5db7fe640 1 -- 172.21.15.45:0/3269066826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5e40bcb80 msgr2=0x7fb5e41446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:46.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5db7fe640 1 --2- 172.21.15.45:0/3269066826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5e40bcb80 0x7fb5e41446c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:46.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5db7fe640 1 -- 172.21.15.45:0/3269066826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d4009420 con 0x7fb5e4071750 2023-10-03T19:15:46.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5e8f11640 1 --2- 172.21.15.45:0/3269066826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5e40bcb80 0x7fb5e41446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:15:46.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5db7fe640 1 --2- 172.21.15.45:0/3269066826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5e4071750 0x7fb5e41e6db0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc006e90 tx=0x7fb5cc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:46.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5e17fa640 1 -- 172.21.15.45:0/3269066826 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc00b6c0 con 0x7fb5e4071750 2023-10-03T19:15:46.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5e17fa640 1 -- 172.21.15.45:0/3269066826 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5cc00b840 con 0x7fb5e4071750 2023-10-03T19:15:46.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5ea974640 1 -- 172.21.15.45:0/3269066826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e40a1d80 con 0x7fb5e4071750 2023-10-03T19:15:46.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5e17fa640 1 -- 172.21.15.45:0/3269066826 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc00bbf0 con 0x7fb5e4071750 2023-10-03T19:15:46.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.915+0000 7fb5ea974640 1 -- 172.21.15.45:0/3269066826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e40a1bf0 con 0x7fb5e4071750 2023-10-03T19:15:46.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.919+0000 7fb5ea974640 1 -- 172.21.15.45:0/3269066826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5e414c0b0 con 0x7fb5e4071750 2023-10-03T19:15:46.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.919+0000 7fb5e17fa640 1 -- 172.21.15.45:0/3269066826 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb5cc00bd50 con 0x7fb5e4071750 2023-10-03T19:15:46.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.919+0000 7fb5e17fa640 1 --2- 172.21.15.45:0/3269066826 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb5c40662b0 0x7fb5c4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:46.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.919+0000 7fb5e17fa640 1 -- 172.21.15.45:0/3269066826 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb5cc0841b0 con 0x7fb5e4071750 2023-10-03T19:15:46.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.919+0000 7fb5e3fff640 1 --2- 172.21.15.45:0/3269066826 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb5c40662b0 0x7fb5c4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:46.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.919+0000 7fb5e3fff640 1 --2- 172.21.15.45:0/3269066826 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb5c40662b0 0x7fb5c4068760 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb5d40ad000 tx=0x7fb5d40a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:46.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:46.923+0000 7fb5e17fa640 1 -- 172.21.15.45:0/3269066826 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb5cc051620 con 0x7fb5e4071750 2023-10-03T19:15:47.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.079+0000 7fb5ea974640 1 -- 172.21.15.45:0/3269066826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5e41e6ad0 con 0x7fb5e4071750 2023-10-03T19:15:47.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.083+0000 7fb5e17fa640 1 -- 172.21.15.45:0/3269066826 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+18316 (secure 0 0 0) 0x7fb5cc054c40 con 0x7fb5e4071750 2023-10-03T19:15:47.088 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:15:47.088 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":47,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:15:46.329520+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:15:44.458794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-03T19:15:45.219182+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:15:47.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.083+0000 7fb5ea974640 1 -- 172.21.15.45:0/3269066826 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb5c40662b0 msgr2=0x7fb5c4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:47.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.083+0000 7fb5ea974640 1 --2- 172.21.15.45:0/3269066826 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb5c40662b0 0x7fb5c4068760 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb5d40ad000 tx=0x7fb5d40a6000 comp rx=0 tx=0).stop 2023-10-03T19:15:47.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.083+0000 7fb5ea974640 1 -- 172.21.15.45:0/3269066826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5e4071750 msgr2=0x7fb5e41e6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:47.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.083+0000 7fb5ea974640 1 --2- 172.21.15.45:0/3269066826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5e4071750 0x7fb5e41e6db0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc006e90 tx=0x7fb5cc00dc60 comp rx=0 tx=0).stop 2023-10-03T19:15:47.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.083+0000 7fb5ea974640 1 -- 172.21.15.45:0/3269066826 shutdown_connections 2023-10-03T19:15:47.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.083+0000 7fb5ea974640 1 --2- 172.21.15.45:0/3269066826 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb5c40662b0 0x7fb5c4068760 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:47.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.083+0000 7fb5ea974640 1 --2- 172.21.15.45:0/3269066826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5e40bcb80 0x7fb5e41446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:47.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.083+0000 7fb5ea974640 1 --2- 172.21.15.45:0/3269066826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5e4071750 0x7fb5e41e6db0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:47.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.083+0000 7fb5ea974640 1 --2- 172.21.15.45:0/3269066826 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb5e4071380 0x7fb5e40a7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:47.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.083+0000 7fb5ea974640 1 -- 172.21.15.45:0/3269066826 >> 172.21.15.45:0/3269066826 conn(0x7fb5e406bce0 msgr2=0x7fb5e4152750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:47.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.083+0000 7fb5ea974640 1 -- 172.21.15.45:0/3269066826 shutdown_connections 2023-10-03T19:15:47.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.083+0000 7fb5ea974640 1 -- 172.21.15.45:0/3269066826 wait complete. 2023-10-03T19:15:47.116 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:15:47.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb125ba640 1 Processor -- start 2023-10-03T19:15:47.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb125ba640 1 -- start start 2023-10-03T19:15:47.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb125ba640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feb0c0a71d0 0x7feb0c06a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:47.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb125ba640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb0c070d60 con 0x7feb0c0bc550 2023-10-03T19:15:47.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb125ba640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb0c070880 con 0x7feb0c0bce80 2023-10-03T19:15:47.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb125ba640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb0c0bc3a0 con 0x7feb0c0a71d0 2023-10-03T19:15:47.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb10b57640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7feb0c0bc550 0x7feb0c14bbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50740/0 (socket says 172.21.15.45:50740) 2023-10-03T19:15:47.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb10b57640 1 -- 172.21.15.45:0/374261504 learned_addr learned my addr 172.21.15.45:0/374261504 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:15:47.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb0bfff640 1 --2- 172.21.15.45:0/374261504 >> v2:172.21.15.79:3300/0 conn(0x7feb0c0a71d0 0x7feb0c06a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:47.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb0affd640 1 -- 172.21.15.45:0/374261504 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443204006 0 0) 0x7feb0c070d60 con 0x7feb0c0bc550 2023-10-03T19:15:47.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb0affd640 1 -- 172.21.15.45:0/374261504 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaf4005740 con 0x7feb0c0bc550 2023-10-03T19:15:47.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb0affd640 1 -- 172.21.15.45:0/374261504 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1304423315 0 0) 0x7feaf4005740 con 0x7feb0c0bc550 2023-10-03T19:15:47.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb0affd640 1 -- 172.21.15.45:0/374261504 >> v2:172.21.15.79:3300/0 conn(0x7feb0c0a71d0 msgr2=0x7feb0c06a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:47.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb0affd640 1 --2- 172.21.15.45:0/374261504 >> v2:172.21.15.79:3300/0 conn(0x7feb0c0a71d0 0x7feb0c06a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:47.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb0affd640 1 -- 172.21.15.45:0/374261504 >> v1:172.21.15.79:6789/0 conn(0x7feb0c0bce80 legacy=0x7feb0c14b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:47.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb0affd640 1 -- 172.21.15.45:0/374261504 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb0c071900 con 0x7feb0c0bc550 2023-10-03T19:15:47.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb0affd640 1 -- 172.21.15.45:0/374261504 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7feb04001a00 con 0x7feb0c0bc550 2023-10-03T19:15:47.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb0affd640 1 -- 172.21.15.45:0/374261504 >> v1:172.21.15.45:6789/0 conn(0x7feb0c0bc550 legacy=0x7feb0c14bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:47.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb0affd640 1 --2- 172.21.15.45:0/374261504 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaf4005b90 0x7feaf4005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:47.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb0affd640 1 --2- 172.21.15.45:0/374261504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaf40069e0 0x7feaf4006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:47.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb0affd640 1 --2- 172.21.15.45:0/374261504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf4007390 0x7feaf400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:47.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb0affd640 1 -- 172.21.15.45:0/374261504 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c0bc3a0 con 0x7feaf40069e0 2023-10-03T19:15:47.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb0affd640 1 -- 172.21.15.45:0/374261504 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf400e1f0 con 0x7feaf4007390 2023-10-03T19:15:47.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb0affd640 1 -- 172.21.15.45:0/374261504 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf400e3b0 con 0x7feaf4005b90 2023-10-03T19:15:47.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb0b7fe640 1 --2- 172.21.15.45:0/374261504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaf40069e0 0x7feaf4006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:47.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb10b57640 1 --2- 172.21.15.45:0/374261504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf4007390 0x7feaf400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:47.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb0bfff640 1 --2- 172.21.15.45:0/374261504 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaf4005b90 0x7feaf4005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:47.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb0b7fe640 1 -- 172.21.15.45:0/374261504 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaf4005b90 msgr2=0x7feaf4005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:47.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb0b7fe640 1 --2- 172.21.15.45:0/374261504 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaf4005b90 0x7feaf4005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:47.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb0b7fe640 1 -- 172.21.15.45:0/374261504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf4007390 msgr2=0x7feaf400dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:47.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb0b7fe640 1 --2- 172.21.15.45:0/374261504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf4007390 0x7feaf400dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:47.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb0b7fe640 1 -- 172.21.15.45:0/374261504 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf4005740 con 0x7feaf40069e0 2023-10-03T19:15:47.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb10b57640 1 --2- 172.21.15.45:0/374261504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf4007390 0x7feaf400dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:15:47.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.239+0000 7feb10b57640 1 -- 172.21.15.45:0/374261504 reap_dead start 2023-10-03T19:15:47.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.243+0000 7feb0b7fe640 1 --2- 172.21.15.45:0/374261504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaf40069e0 0x7feaf4006e50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7feb00001780 tx=0x7feb0001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdcc79ae7f6247d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:47.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.243+0000 7feb0affd640 1 -- 172.21.15.45:0/374261504 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb000052d0 con 0x7feaf40069e0 2023-10-03T19:15:47.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.243+0000 7feb0affd640 1 -- 172.21.15.45:0/374261504 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb000a7050 con 0x7feaf40069e0 2023-10-03T19:15:47.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.243+0000 7feb0affd640 1 -- 172.21.15.45:0/374261504 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb00003600 con 0x7feaf40069e0 2023-10-03T19:15:47.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.243+0000 7feb125ba640 1 -- 172.21.15.45:0/374261504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaf40069e0 msgr2=0x7feaf4006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:47.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.243+0000 7feb125ba640 1 --2- 172.21.15.45:0/374261504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaf40069e0 0x7feaf4006e50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7feb00001780 tx=0x7feb0001c3e0 comp rx=0 tx=0).stop 2023-10-03T19:15:47.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.243+0000 7feb125ba640 1 -- 172.21.15.45:0/374261504 shutdown_connections 2023-10-03T19:15:47.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.243+0000 7feb125ba640 1 --2- 172.21.15.45:0/374261504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaf40069e0 0x7feaf4006e50 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:47.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.243+0000 7feb125ba640 1 -- 172.21.15.45:0/374261504 >> 172.21.15.45:0/374261504 conn(0x7feb0c0bed00 msgr2=0x7feb0c06d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:47.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.243+0000 7feb125ba640 1 -- 172.21.15.45:0/374261504 shutdown_connections 2023-10-03T19:15:47.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.243+0000 7feb125ba640 1 -- 172.21.15.45:0/374261504 wait complete. 2023-10-03T19:15:47.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.243+0000 7feb125ba640 1 Processor -- start 2023-10-03T19:15:47.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.243+0000 7feb125ba640 1 -- start start 2023-10-03T19:15:47.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.243+0000 7feb125ba640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaf40069e0 0x7feb0c099eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:47.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.243+0000 7feb125ba640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb0c0a3a40 0x7feb0c14ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:47.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.243+0000 7feb125ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb0c1466c0 0x7feb0c146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:47.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.243+0000 7feb125ba640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c14f210 con 0x7feb0c1466c0 2023-10-03T19:15:47.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.243+0000 7feb125ba640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c0ba9a0 con 0x7feb0c0a3a40 2023-10-03T19:15:47.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.243+0000 7feb125ba640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c0bb440 con 0x7feaf40069e0 2023-10-03T19:15:47.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.243+0000 7feb10b57640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb0c1466c0 0x7feb0c146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:47.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.243+0000 7feb10b57640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb0c1466c0 0x7feb0c146b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37690/0 (socket says 172.21.15.45:37690) 2023-10-03T19:15:47.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.243+0000 7feb10b57640 1 -- 172.21.15.45:0/55577873 learned_addr learned my addr 172.21.15.45:0/55577873 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:47.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.247+0000 7feb0bfff640 1 --2- 172.21.15.45:0/55577873 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaf40069e0 0x7feb0c099eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:47.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.247+0000 7feb0b7fe640 1 --2- 172.21.15.45:0/55577873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb0c0a3a40 0x7feb0c14ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:47.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.247+0000 7feb10b57640 1 -- 172.21.15.45:0/55577873 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaf40069e0 msgr2=0x7feb0c099eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:47.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.247+0000 7feb10b57640 1 --2- 172.21.15.45:0/55577873 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaf40069e0 0x7feb0c099eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:47.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.247+0000 7feb10b57640 1 -- 172.21.15.45:0/55577873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb0c0a3a40 msgr2=0x7feb0c14ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:47.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.247+0000 7feb10b57640 1 --2- 172.21.15.45:0/55577873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb0c0a3a40 0x7feb0c14ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:47.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.247+0000 7feb10b57640 1 -- 172.21.15.45:0/55577873 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb0c0a75a0 con 0x7feb0c1466c0 2023-10-03T19:15:47.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.247+0000 7feb10b57640 1 --2- 172.21.15.45:0/55577873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb0c1466c0 0x7feb0c146b60 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7feb04000f90 tx=0x7feb04007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:47.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.247+0000 7feb08ff9640 1 -- 172.21.15.45:0/55577873 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb04010510 con 0x7feb0c1466c0 2023-10-03T19:15:47.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.247+0000 7feb08ff9640 1 -- 172.21.15.45:0/55577873 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb04010670 con 0x7feb0c1466c0 2023-10-03T19:15:47.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.247+0000 7feb08ff9640 1 -- 172.21.15.45:0/55577873 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb040109e0 con 0x7feb0c1466c0 2023-10-03T19:15:47.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.247+0000 7feb125ba640 1 -- 172.21.15.45:0/55577873 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb0c071be0 con 0x7feb0c1466c0 2023-10-03T19:15:47.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.247+0000 7feb125ba640 1 -- 172.21.15.45:0/55577873 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb0c0bc000 con 0x7feb0c1466c0 2023-10-03T19:15:47.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.247+0000 7feb125ba640 1 -- 172.21.15.45:0/55577873 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb0c04de80 con 0x7feb0c1466c0 2023-10-03T19:15:47.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.247+0000 7feb08ff9640 1 -- 172.21.15.45:0/55577873 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7feb04010b40 con 0x7feb0c1466c0 2023-10-03T19:15:47.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.247+0000 7feb08ff9640 1 --2- 172.21.15.45:0/55577873 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7feaf80662b0 0x7feaf8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:47.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.247+0000 7feb08ff9640 1 -- 172.21.15.45:0/55577873 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feb04083350 con 0x7feb0c1466c0 2023-10-03T19:15:47.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.247+0000 7feb0bfff640 1 --2- 172.21.15.45:0/55577873 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7feaf80662b0 0x7feaf8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:47.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.247+0000 7feb0bfff640 1 --2- 172.21.15.45:0/55577873 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7feaf80662b0 0x7feaf8068760 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7feafc009ab0 tx=0x7feafc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:47.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.251+0000 7feb08ff9640 1 -- 172.21.15.45:0/55577873 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7feb04050730 con 0x7feb0c1466c0 2023-10-03T19:15:47.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.407+0000 7feb125ba640 1 -- 172.21.15.45:0/55577873 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb0c0705c0 con 0x7feb0c1466c0 2023-10-03T19:15:47.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.411+0000 7feb08ff9640 1 -- 172.21.15.45:0/55577873 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+18303 (secure 0 0 0) 0x7feb04053d50 con 0x7feb0c1466c0 2023-10-03T19:15:47.475 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:15:47.475 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":48,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:15:47.332569+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:15:44.458794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-03T19:15:45.219182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:15:47.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.411+0000 7feb125ba640 1 -- 172.21.15.45:0/55577873 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7feaf80662b0 msgr2=0x7feaf8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:47.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.411+0000 7feb125ba640 1 --2- 172.21.15.45:0/55577873 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7feaf80662b0 0x7feaf8068760 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7feafc009ab0 tx=0x7feafc008040 comp rx=0 tx=0).stop 2023-10-03T19:15:47.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.411+0000 7feb125ba640 1 -- 172.21.15.45:0/55577873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb0c1466c0 msgr2=0x7feb0c146b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:47.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.411+0000 7feb125ba640 1 --2- 172.21.15.45:0/55577873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb0c1466c0 0x7feb0c146b60 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7feb04000f90 tx=0x7feb04007a20 comp rx=0 tx=0).stop 2023-10-03T19:15:47.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.411+0000 7feb125ba640 1 -- 172.21.15.45:0/55577873 shutdown_connections 2023-10-03T19:15:47.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.411+0000 7feb125ba640 1 --2- 172.21.15.45:0/55577873 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7feaf80662b0 0x7feaf8068760 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:47.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.411+0000 7feb125ba640 1 --2- 172.21.15.45:0/55577873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb0c1466c0 0x7feb0c146b60 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:47.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.411+0000 7feb125ba640 1 --2- 172.21.15.45:0/55577873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb0c0a3a40 0x7feb0c14ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:47.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.411+0000 7feb125ba640 1 --2- 172.21.15.45:0/55577873 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaf40069e0 0x7feb0c099eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:47.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.411+0000 7feb125ba640 1 -- 172.21.15.45:0/55577873 >> 172.21.15.45:0/55577873 conn(0x7feb0c0bed00 msgr2=0x7feb0c149640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:47.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.411+0000 7feb125ba640 1 -- 172.21.15.45:0/55577873 shutdown_connections 2023-10-03T19:15:47.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.411+0000 7feb125ba640 1 -- 172.21.15.45:0/55577873 wait complete. 2023-10-03T19:15:47.478 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-03T19:15:47.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.675+0000 7f56836b0640 1 Processor -- start 2023-10-03T19:15:47.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.675+0000 7f56836b0640 1 -- start start 2023-10-03T19:15:47.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.679+0000 7f56836b0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f567c06d560 0x7f567c0a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:47.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.679+0000 7f56836b0640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f567c06c760 0x7f567c0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:47.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.679+0000 7f56836b0640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f567c06c2d0 con 0x7f567c0712c0 2023-10-03T19:15:47.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.679+0000 7f56836b0640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f567c150610 con 0x7f567c06c760 2023-10-03T19:15:47.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.679+0000 7f56836b0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567c1508b0 con 0x7f567c06d560 2023-10-03T19:15:47.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.679+0000 7f5681c4d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f567c06c760 0x7f567c0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:47.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.679+0000 7f5680c4b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f567c06d560 0x7f567c0a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:47.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.679+0000 7f5681c4d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f567c06c760 0x7f567c0a5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:54396/0 (socket says 172.21.15.45:54396) 2023-10-03T19:15:47.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.679+0000 7f5681c4d640 1 -- 172.21.15.45:0/3810077499 learned_addr learned my addr 172.21.15.45:0/3810077499 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:47.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.679+0000 7f568144c640 1 --1- 172.21.15.45:0/3810077499 >> v1:172.21.15.79:6789/0 conn(0x7f567c0712c0 0x7f567c0bcbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:56216/0 (socket says 172.21.15.45:56216) 2023-10-03T19:15:47.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.679+0000 7f5681c4d640 1 -- 172.21.15.45:0/3810077499 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f567c06d560 msgr2=0x7f567c0a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:47.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.679+0000 7f5681c4d640 1 --2- 172.21.15.45:0/3810077499 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f567c06d560 0x7f567c0a53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:47.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.679+0000 7f5681c4d640 1 -- 172.21.15.45:0/3810077499 >> v1:172.21.15.79:6789/0 conn(0x7f567c0712c0 legacy=0x7f567c0bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:47.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.679+0000 7f5681c4d640 1 -- 172.21.15.45:0/3810077499 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f567c06d2e0 con 0x7f567c06c760 2023-10-03T19:15:47.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.679+0000 7f5680c4b640 1 --2- 172.21.15.45:0/3810077499 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f567c06d560 0x7f567c0a53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:15:47.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f5681c4d640 1 --2- 172.21.15.45:0/3810077499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f567c06c760 0x7f567c0a5900 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5674009e50 tx=0x7f567401ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7621476aad2c2759 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:47.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f5673fff640 1 -- 172.21.15.45:0/3810077499 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56740a5810 con 0x7f567c06c760 2023-10-03T19:15:47.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f5673fff640 1 -- 172.21.15.45:0/3810077499 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56740a5970 con 0x7f567c06c760 2023-10-03T19:15:47.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f5673fff640 1 -- 172.21.15.45:0/3810077499 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56740a5d00 con 0x7f567c06c760 2023-10-03T19:15:47.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f56836b0640 1 -- 172.21.15.45:0/3810077499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f567c06c760 msgr2=0x7f567c0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:47.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f56836b0640 1 --2- 172.21.15.45:0/3810077499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f567c06c760 0x7f567c0a5900 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5674009e50 tx=0x7f567401ca10 comp rx=0 tx=0).stop 2023-10-03T19:15:47.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f56836b0640 1 -- 172.21.15.45:0/3810077499 shutdown_connections 2023-10-03T19:15:47.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f56836b0640 1 --2- 172.21.15.45:0/3810077499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f567c06c760 0x7f567c0a5900 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:47.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f56836b0640 1 --2- 172.21.15.45:0/3810077499 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f567c06d560 0x7f567c0a53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:47.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f56836b0640 1 -- 172.21.15.45:0/3810077499 >> 172.21.15.45:0/3810077499 conn(0x7f567c0a20d0 msgr2=0x7f567c0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:47.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f56836b0640 1 -- 172.21.15.45:0/3810077499 shutdown_connections 2023-10-03T19:15:47.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f56836b0640 1 -- 172.21.15.45:0/3810077499 wait complete. 2023-10-03T19:15:47.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f56836b0640 1 Processor -- start 2023-10-03T19:15:47.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f56836b0640 1 -- start start 2023-10-03T19:15:47.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f56836b0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f567c06c760 0x7f567c0be0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:47.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f56836b0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f567c06d560 0x7f567c155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:47.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f56836b0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f567c0712c0 0x7f567c1561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:47.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f56836b0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567c1e93e0 con 0x7f567c0712c0 2023-10-03T19:15:47.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f56836b0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567c1e6bf0 con 0x7f567c06d560 2023-10-03T19:15:47.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f56836b0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567c1e6350 con 0x7f567c06c760 2023-10-03T19:15:47.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f5681c4d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f567c0712c0 0x7f567c1561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:47.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f5681c4d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f567c0712c0 0x7f567c1561b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37694/0 (socket says 172.21.15.45:37694) 2023-10-03T19:15:47.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f5681c4d640 1 -- 172.21.15.45:0/327872484 learned_addr learned my addr 172.21.15.45:0/327872484 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:47.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f568144c640 1 --2- 172.21.15.45:0/327872484 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f567c06c760 0x7f567c0be0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:47.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f5680c4b640 1 --2- 172.21.15.45:0/327872484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f567c06d560 0x7f567c155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:47.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f5681c4d640 1 -- 172.21.15.45:0/327872484 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f567c06c760 msgr2=0x7f567c0be0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:47.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f5681c4d640 1 --2- 172.21.15.45:0/327872484 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f567c06c760 0x7f567c0be0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:47.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f5681c4d640 1 -- 172.21.15.45:0/327872484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f567c06d560 msgr2=0x7f567c155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:47.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f5681c4d640 1 --2- 172.21.15.45:0/327872484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f567c06d560 0x7f567c155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:47.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f5681c4d640 1 -- 172.21.15.45:0/327872484 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566c009420 con 0x7f567c0712c0 2023-10-03T19:15:47.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f5680c4b640 1 --2- 172.21.15.45:0/327872484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f567c06d560 0x7f567c155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:15:47.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.683+0000 7f568144c640 1 --2- 172.21.15.45:0/327872484 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f567c06c760 0x7f567c0be0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:15:47.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.687+0000 7f5681c4d640 1 --2- 172.21.15.45:0/327872484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f567c0712c0 0x7f567c1561b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f567401a640 tx=0x7f56740197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:47.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.687+0000 7f5671ffb640 1 -- 172.21.15.45:0/327872484 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56740b8670 con 0x7f567c0712c0 2023-10-03T19:15:47.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.687+0000 7f5671ffb640 1 -- 172.21.15.45:0/327872484 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56740b87d0 con 0x7f567c0712c0 2023-10-03T19:15:47.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.687+0000 7f56836b0640 1 -- 172.21.15.45:0/327872484 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5674009b30 con 0x7f567c0712c0 2023-10-03T19:15:47.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.687+0000 7f5671ffb640 1 -- 172.21.15.45:0/327872484 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56740b8b40 con 0x7f567c0712c0 2023-10-03T19:15:47.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.687+0000 7f56836b0640 1 -- 172.21.15.45:0/327872484 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f567c0bd460 con 0x7f567c0712c0 2023-10-03T19:15:47.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.687+0000 7f56836b0640 1 -- 172.21.15.45:0/327872484 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f567c0bd2d0 con 0x7f567c0712c0 2023-10-03T19:15:47.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.687+0000 7f5671ffb640 1 -- 172.21.15.45:0/327872484 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f56740b8ca0 con 0x7f567c0712c0 2023-10-03T19:15:47.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.687+0000 7f5671ffb640 1 --2- 172.21.15.45:0/327872484 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5660066280 0x7f5660068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.687+0000 7f5671ffb640 1 -- 172.21.15.45:0/327872484 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f567411f650 con 0x7f567c0712c0 2023-10-03T19:15:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.687+0000 7f568144c640 1 --2- 172.21.15.45:0/327872484 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5660066280 0x7f5660068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.687+0000 7f568144c640 1 --2- 172.21.15.45:0/327872484 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5660066280 0x7f5660068730 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5678000f70 tx=0x7f5678007d50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.691+0000 7f5671ffb640 1 -- 172.21.15.45:0/327872484 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f56740ecd60 con 0x7f567c0712c0 2023-10-03T19:15:47.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:47.879+0000 7f56836b0640 1 -- 172.21.15.45:0/327872484 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f567c0bca30 con 0x7f567c0712c0 2023-10-03T19:15:48.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:48.847+0000 7f5671ffb640 1 -- 172.21.15.45:0/327872484 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v22) v1 ==== 118+0+0 (secure 0 0 0) 0x7f56740f0380 con 0x7f567c0712c0 2023-10-03T19:15:48.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:48.851+0000 7f56836b0640 1 -- 172.21.15.45:0/327872484 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5660066280 msgr2=0x7f5660068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:48.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:48.851+0000 7f56836b0640 1 --2- 172.21.15.45:0/327872484 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5660066280 0x7f5660068730 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5678000f70 tx=0x7f5678007d50 comp rx=0 tx=0).stop 2023-10-03T19:15:48.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:48.851+0000 7f56836b0640 1 -- 172.21.15.45:0/327872484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f567c0712c0 msgr2=0x7f567c1561b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:48.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:48.851+0000 7f56836b0640 1 --2- 172.21.15.45:0/327872484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f567c0712c0 0x7f567c1561b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f567401a640 tx=0x7f56740197b0 comp rx=0 tx=0).stop 2023-10-03T19:15:48.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:48.851+0000 7f56836b0640 1 -- 172.21.15.45:0/327872484 shutdown_connections 2023-10-03T19:15:48.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:48.851+0000 7f56836b0640 1 --2- 172.21.15.45:0/327872484 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5660066280 0x7f5660068730 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:48.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:48.851+0000 7f56836b0640 1 --2- 172.21.15.45:0/327872484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f567c0712c0 0x7f567c1561b0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:48.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:48.851+0000 7f56836b0640 1 --2- 172.21.15.45:0/327872484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f567c06d560 0x7f567c155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:48.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:48.851+0000 7f56836b0640 1 --2- 172.21.15.45:0/327872484 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f567c06c760 0x7f567c0be0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:48.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:48.851+0000 7f56836b0640 1 -- 172.21.15.45:0/327872484 >> 172.21.15.45:0/327872484 conn(0x7f567c0a20d0 msgr2=0x7f567c0bb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:48.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:48.851+0000 7f56836b0640 1 -- 172.21.15.45:0/327872484 shutdown_connections 2023-10-03T19:15:48.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:48.855+0000 7f56836b0640 1 -- 172.21.15.45:0/327872484 wait complete. 2023-10-03T19:15:48.936 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-03T19:15:48.937 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-03T19:15:49.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad7cf9640 1 Processor -- start 2023-10-03T19:15:49.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad7cf9640 1 -- start start 2023-10-03T19:15:49.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad7cf9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbad006ae30 0x7fbad0069ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:49.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad7cf9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbad006a010 0x7fbad0159030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:49.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad7cf9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad0151ca0 con 0x7fbad00658f0 2023-10-03T19:15:49.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad7cf9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad0151f40 con 0x7fbad006ae30 2023-10-03T19:15:49.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad7cf9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad0152220 con 0x7fbad006a010 2023-10-03T19:15:49.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad5a95640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbad00658f0 0x7fbad014bb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50742/0 (socket says 172.21.15.45:50742) 2023-10-03T19:15:49.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad5a95640 1 -- 172.21.15.45:0/4202846444 learned_addr learned my addr 172.21.15.45:0/4202846444 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:15:49.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad5294640 1 --2- 172.21.15.45:0/4202846444 >> v2:172.21.15.79:3300/0 conn(0x7fbad006ae30 0x7fbad0069ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:49.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad6296640 1 --2- 172.21.15.45:0/4202846444 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbad006a010 0x7fbad0159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:49.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad4a93640 1 -- 172.21.15.45:0/4202846444 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3439093179 0 0) 0x7fbad0151ca0 con 0x7fbad00658f0 2023-10-03T19:15:49.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad4a93640 1 -- 172.21.15.45:0/4202846444 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbab8003530 con 0x7fbad00658f0 2023-10-03T19:15:49.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad4a93640 1 -- 172.21.15.45:0/4202846444 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3922383391 0 0) 0x7fbab8003530 con 0x7fbad00658f0 2023-10-03T19:15:49.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad4a93640 1 -- 172.21.15.45:0/4202846444 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbad006a010 msgr2=0x7fbad0159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:49.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad4a93640 1 --2- 172.21.15.45:0/4202846444 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbad006a010 0x7fbad0159030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:49.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad4a93640 1 -- 172.21.15.45:0/4202846444 >> v2:172.21.15.79:3300/0 conn(0x7fbad006ae30 msgr2=0x7fbad0069ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:49.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad4a93640 1 --2- 172.21.15.45:0/4202846444 >> v2:172.21.15.79:3300/0 conn(0x7fbad006ae30 0x7fbad0069ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:49.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad4a93640 1 -- 172.21.15.45:0/4202846444 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad0152500 con 0x7fbad00658f0 2023-10-03T19:15:49.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad4a93640 1 -- 172.21.15.45:0/4202846444 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fbac0001a00 con 0x7fbad00658f0 2023-10-03T19:15:49.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad4a93640 1 -- 172.21.15.45:0/4202846444 >> v1:172.21.15.45:6789/0 conn(0x7fbad00658f0 legacy=0x7fbad014bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:49.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad4a93640 1 --2- 172.21.15.45:0/4202846444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbab8003980 0x7fbab8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:49.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad4a93640 1 --2- 172.21.15.45:0/4202846444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbab80043b0 0x7fbab8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:49.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad4a93640 1 --2- 172.21.15.45:0/4202846444 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbad006a010 0x7fbab8004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:49.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad4a93640 1 -- 172.21.15.45:0/4202846444 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad0151f40 con 0x7fbab80043b0 2023-10-03T19:15:49.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad4a93640 1 -- 172.21.15.45:0/4202846444 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad0152220 con 0x7fbab8003980 2023-10-03T19:15:49.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad4a93640 1 -- 172.21.15.45:0/4202846444 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab800b990 con 0x7fbad006a010 2023-10-03T19:15:49.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad5294640 1 --2- 172.21.15.45:0/4202846444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbab80043b0 0x7fbab8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:49.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad5a95640 1 --2- 172.21.15.45:0/4202846444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbab8003980 0x7fbab8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:49.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad5294640 1 -- 172.21.15.45:0/4202846444 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbad006a010 msgr2=0x7fbab8004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:49.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad5294640 1 --2- 172.21.15.45:0/4202846444 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbad006a010 0x7fbab8004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:49.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad5294640 1 -- 172.21.15.45:0/4202846444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbab8003980 msgr2=0x7fbab8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:49.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad5294640 1 --2- 172.21.15.45:0/4202846444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbab8003980 0x7fbab8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:49.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.071+0000 7fbad5294640 1 -- 172.21.15.45:0/4202846444 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab8003530 con 0x7fbab80043b0 2023-10-03T19:15:49.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.075+0000 7fbad5294640 1 --2- 172.21.15.45:0/4202846444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbab80043b0 0x7fbab8004870 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fbac4009ae0 tx=0x7fbac401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c35142098a4b4c15 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:49.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.075+0000 7fbad4a93640 1 -- 172.21.15.45:0/4202846444 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac40a5680 con 0x7fbab80043b0 2023-10-03T19:15:49.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.075+0000 7fbad4a93640 1 -- 172.21.15.45:0/4202846444 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac40a57e0 con 0x7fbab80043b0 2023-10-03T19:15:49.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.075+0000 7fbad4a93640 1 -- 172.21.15.45:0/4202846444 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac40a5b90 con 0x7fbab80043b0 2023-10-03T19:15:49.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.075+0000 7fbad7cf9640 1 -- 172.21.15.45:0/4202846444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbab80043b0 msgr2=0x7fbab8004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:49.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.075+0000 7fbad7cf9640 1 --2- 172.21.15.45:0/4202846444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbab80043b0 0x7fbab8004870 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fbac4009ae0 tx=0x7fbac401ca90 comp rx=0 tx=0).stop 2023-10-03T19:15:49.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.075+0000 7fbad6296640 1 -- 172.21.15.45:0/4202846444 reap_dead start 2023-10-03T19:15:49.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.075+0000 7fbad7cf9640 1 -- 172.21.15.45:0/4202846444 shutdown_connections 2023-10-03T19:15:49.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.075+0000 7fbad7cf9640 1 -- 172.21.15.45:0/4202846444 >> 172.21.15.45:0/4202846444 conn(0x7fbad00be190 msgr2=0x7fbad00be590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:49.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.075+0000 7fbad7cf9640 1 -- 172.21.15.45:0/4202846444 shutdown_connections 2023-10-03T19:15:49.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.075+0000 7fbad7cf9640 1 -- 172.21.15.45:0/4202846444 wait complete. 2023-10-03T19:15:49.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.075+0000 7fbad7cf9640 1 Processor -- start 2023-10-03T19:15:49.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.075+0000 7fbad7cf9640 1 -- start start 2023-10-03T19:15:49.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.075+0000 7fbad7cf9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbab80043b0 0x7fbad014dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:49.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.075+0000 7fbad7cf9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbad0147f50 0x7fbad01e3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:49.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.075+0000 7fbad7cf9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbad01e43d0 0x7fbad0145a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:49.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.075+0000 7fbad7cf9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad01e36f0 con 0x7fbad0147f50 2023-10-03T19:15:49.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.075+0000 7fbad7cf9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad01e6e00 con 0x7fbab80043b0 2023-10-03T19:15:49.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.075+0000 7fbad7cf9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad01e3970 con 0x7fbad01e43d0 2023-10-03T19:15:49.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.075+0000 7fbad5294640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbad0147f50 0x7fbad01e3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:49.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.075+0000 7fbad5294640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbad0147f50 0x7fbad01e3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37712/0 (socket says 172.21.15.45:37712) 2023-10-03T19:15:49.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.075+0000 7fbad5294640 1 -- 172.21.15.45:0/2455027219 learned_addr learned my addr 172.21.15.45:0/2455027219 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:49.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.075+0000 7fbad5a95640 1 --2- 172.21.15.45:0/2455027219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbab80043b0 0x7fbad014dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:49.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.075+0000 7fbad6296640 1 --2- 172.21.15.45:0/2455027219 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbad01e43d0 0x7fbad0145a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:49.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.079+0000 7fbad5294640 1 -- 172.21.15.45:0/2455027219 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbad01e43d0 msgr2=0x7fbad0145a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:49.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.079+0000 7fbad5294640 1 --2- 172.21.15.45:0/2455027219 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbad01e43d0 0x7fbad0145a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:49.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.079+0000 7fbad5294640 1 -- 172.21.15.45:0/2455027219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbab80043b0 msgr2=0x7fbad014dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:49.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.079+0000 7fbad5294640 1 --2- 172.21.15.45:0/2455027219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbab80043b0 0x7fbad014dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:49.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.079+0000 7fbad5294640 1 -- 172.21.15.45:0/2455027219 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad006e4a0 con 0x7fbad0147f50 2023-10-03T19:15:49.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.079+0000 7fbad5a95640 1 --2- 172.21.15.45:0/2455027219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbab80043b0 0x7fbad014dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:15:49.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.079+0000 7fbad5294640 1 --2- 172.21.15.45:0/2455027219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbad0147f50 0x7fbad01e3e90 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fbac4009ae0 tx=0x7fbab8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:49.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.079+0000 7fbace7fc640 1 -- 172.21.15.45:0/2455027219 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac40be070 con 0x7fbad0147f50 2023-10-03T19:15:49.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.079+0000 7fbace7fc640 1 -- 172.21.15.45:0/2455027219 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac4004020 con 0x7fbad0147f50 2023-10-03T19:15:49.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.079+0000 7fbace7fc640 1 -- 172.21.15.45:0/2455027219 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4004390 con 0x7fbad0147f50 2023-10-03T19:15:49.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.079+0000 7fbad7cf9640 1 -- 172.21.15.45:0/2455027219 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad01527e0 con 0x7fbad0147f50 2023-10-03T19:15:49.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.079+0000 7fbad7cf9640 1 -- 172.21.15.45:0/2455027219 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad014c270 con 0x7fbad0147f50 2023-10-03T19:15:49.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.079+0000 7fbad7cf9640 1 -- 172.21.15.45:0/2455027219 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad006aa90 con 0x7fbad0147f50 2023-10-03T19:15:49.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.079+0000 7fbace7fc640 1 -- 172.21.15.45:0/2455027219 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbac40b4040 con 0x7fbad0147f50 2023-10-03T19:15:49.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.079+0000 7fbace7fc640 1 --2- 172.21.15.45:0/2455027219 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbabc0662b0 0x7fbabc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:49.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.079+0000 7fbace7fc640 1 -- 172.21.15.45:0/2455027219 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbac411daf0 con 0x7fbad0147f50 2023-10-03T19:15:49.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.079+0000 7fbad5a95640 1 --2- 172.21.15.45:0/2455027219 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbabc0662b0 0x7fbabc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:49.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.079+0000 7fbad5a95640 1 --2- 172.21.15.45:0/2455027219 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbabc0662b0 0x7fbabc068760 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbac00013e0 tx=0x7fbac0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:49.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.083+0000 7fbace7fc640 1 -- 172.21.15.45:0/2455027219 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbac40eb120 con 0x7fbad0147f50 2023-10-03T19:15:49.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.275+0000 7fbad7cf9640 1 -- 172.21.15.45:0/2455027219 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbad01e3b00 con 0x7fbad0147f50 2023-10-03T19:15:49.747 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-03T19:15:49.743+0000 7f3ed8bc4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-03T19:15:49.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.851+0000 7fbace7fc640 1 -- 172.21.15.45:0/2455027219 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v23) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbac40ee740 con 0x7fbad0147f50 2023-10-03T19:15:49.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.855+0000 7fbad7cf9640 1 -- 172.21.15.45:0/2455027219 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbabc0662b0 msgr2=0x7fbabc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:49.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.855+0000 7fbad7cf9640 1 --2- 172.21.15.45:0/2455027219 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbabc0662b0 0x7fbabc068760 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbac00013e0 tx=0x7fbac0009040 comp rx=0 tx=0).stop 2023-10-03T19:15:49.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.855+0000 7fbad7cf9640 1 -- 172.21.15.45:0/2455027219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbad0147f50 msgr2=0x7fbad01e3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.855+0000 7fbad7cf9640 1 --2- 172.21.15.45:0/2455027219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbad0147f50 0x7fbad01e3e90 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fbac4009ae0 tx=0x7fbab8005800 comp rx=0 tx=0).stop 2023-10-03T19:15:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.855+0000 7fbad7cf9640 1 -- 172.21.15.45:0/2455027219 shutdown_connections 2023-10-03T19:15:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.855+0000 7fbad7cf9640 1 --2- 172.21.15.45:0/2455027219 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbabc0662b0 0x7fbabc068760 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.855+0000 7fbad7cf9640 1 --2- 172.21.15.45:0/2455027219 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbad01e43d0 0x7fbad0145a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.855+0000 7fbad7cf9640 1 --2- 172.21.15.45:0/2455027219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbad0147f50 0x7fbad01e3e90 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.855+0000 7fbad7cf9640 1 --2- 172.21.15.45:0/2455027219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbab80043b0 0x7fbad014dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.855+0000 7fbad7cf9640 1 -- 172.21.15.45:0/2455027219 >> 172.21.15.45:0/2455027219 conn(0x7fbad00be190 msgr2=0x7fbad0070350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.855+0000 7fbad7cf9640 1 -- 172.21.15.45:0/2455027219 shutdown_connections 2023-10-03T19:15:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:49.855+0000 7fbad7cf9640 1 -- 172.21.15.45:0/2455027219 wait complete. 2023-10-03T19:15:49.882 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-03T19:15:49.882 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:15:50.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4ebc878640 1 Processor -- start 2023-10-03T19:15:50.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4ebc878640 1 -- start start 2023-10-03T19:15:50.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4ebc878640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4eb814be50 0x7f4eb806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:50.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4ebc878640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4eb806ee60 0x7f4eb81504e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:50.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4ebc878640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eb806ebe0 con 0x7f4eb80c07d0 2023-10-03T19:15:50.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4ebc878640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eb8150a20 con 0x7f4eb814be50 2023-10-03T19:15:50.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4ebc878640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb806e8e0 con 0x7f4eb806ee60 2023-10-03T19:15:50.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4eaffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4eb80c07d0 0x7f4eb80c2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50756/0 (socket says 172.21.15.45:50756) 2023-10-03T19:15:50.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4eaffff640 1 -- 172.21.15.45:0/3476711827 learned_addr learned my addr 172.21.15.45:0/3476711827 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:15:50.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4eb659c640 1 --2- 172.21.15.45:0/3476711827 >> v2:172.21.15.79:3300/0 conn(0x7f4eb814be50 0x7f4eb806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:50.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4eb6d9d640 1 --2- 172.21.15.45:0/3476711827 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4eb806ee60 0x7f4eb81504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:50.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4eb5d9b640 1 -- 172.21.15.45:0/3476711827 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3039386271 0 0) 0x7f4eb806ebe0 con 0x7f4eb80c07d0 2023-10-03T19:15:50.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4eb5d9b640 1 -- 172.21.15.45:0/3476711827 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ea4003530 con 0x7f4eb80c07d0 2023-10-03T19:15:50.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4eb5d9b640 1 -- 172.21.15.45:0/3476711827 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 378043797 0 0) 0x7f4ea4003530 con 0x7f4eb80c07d0 2023-10-03T19:15:50.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4eb5d9b640 1 -- 172.21.15.45:0/3476711827 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4eb806ee60 msgr2=0x7f4eb81504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:50.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4eb5d9b640 1 --2- 172.21.15.45:0/3476711827 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4eb806ee60 0x7f4eb81504e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:50.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4eb5d9b640 1 -- 172.21.15.45:0/3476711827 >> v2:172.21.15.79:3300/0 conn(0x7f4eb814be50 msgr2=0x7f4eb806f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:50.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4eb5d9b640 1 --2- 172.21.15.45:0/3476711827 >> v2:172.21.15.79:3300/0 conn(0x7f4eb814be50 0x7f4eb806f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:50.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4eb5d9b640 1 -- 172.21.15.45:0/3476711827 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb806ddd0 con 0x7f4eb80c07d0 2023-10-03T19:15:50.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4eb5d9b640 1 -- 172.21.15.45:0/3476711827 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f4ea0001680 con 0x7f4eb80c07d0 2023-10-03T19:15:50.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4eb5d9b640 1 -- 172.21.15.45:0/3476711827 >> v1:172.21.15.45:6789/0 conn(0x7f4eb80c07d0 legacy=0x7f4eb80c2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:50.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4eb5d9b640 1 --2- 172.21.15.45:0/3476711827 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4eb806ee60 0x7f4ea4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:50.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4eb5d9b640 1 --2- 172.21.15.45:0/3476711827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ea4003f00 0x7f4ea40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:50.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4eb5d9b640 1 --2- 172.21.15.45:0/3476711827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ea4004d10 0x7f4ea4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:50.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4eb5d9b640 1 -- 172.21.15.45:0/3476711827 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb8150a20 con 0x7f4ea4004d10 2023-10-03T19:15:50.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4eb5d9b640 1 -- 172.21.15.45:0/3476711827 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb806e8e0 con 0x7f4ea4003f00 2023-10-03T19:15:50.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4eb5d9b640 1 -- 172.21.15.45:0/3476711827 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea400b9c0 con 0x7f4eb806ee60 2023-10-03T19:15:50.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4eb659c640 1 --2- 172.21.15.45:0/3476711827 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4eb806ee60 0x7f4ea4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:50.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4eaffff640 1 --2- 172.21.15.45:0/3476711827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ea4003f00 0x7f4ea40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:50.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4eb6d9d640 1 --2- 172.21.15.45:0/3476711827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ea4004d10 0x7f4ea4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:50.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4eb6d9d640 1 -- 172.21.15.45:0/3476711827 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4eb806ee60 msgr2=0x7f4ea4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:50.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4eb6d9d640 1 --2- 172.21.15.45:0/3476711827 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4eb806ee60 0x7f4ea4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:50.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4eb6d9d640 1 -- 172.21.15.45:0/3476711827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ea4003f00 msgr2=0x7f4ea40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:50.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4eb6d9d640 1 --2- 172.21.15.45:0/3476711827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ea4003f00 0x7f4ea40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:50.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.007+0000 7f4eb6d9d640 1 -- 172.21.15.45:0/3476711827 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea4003530 con 0x7f4ea4004d10 2023-10-03T19:15:50.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.011+0000 7f4eb6d9d640 1 --2- 172.21.15.45:0/3476711827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ea4004d10 0x7f4ea4005180 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0009fc0 tx=0x7f4eb001cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd88b621bef8671 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:50.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.015+0000 7f4eb5d9b640 1 -- 172.21.15.45:0/3476711827 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb00a5c70 con 0x7f4ea4004d10 2023-10-03T19:15:50.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.015+0000 7f4eb5d9b640 1 -- 172.21.15.45:0/3476711827 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb000f040 con 0x7f4ea4004d10 2023-10-03T19:15:50.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.015+0000 7f4eb5d9b640 1 -- 172.21.15.45:0/3476711827 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb00ad440 con 0x7f4ea4004d10 2023-10-03T19:15:50.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.015+0000 7f4ebc878640 1 -- 172.21.15.45:0/3476711827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ea4004d10 msgr2=0x7f4ea4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:50.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.015+0000 7f4ebc878640 1 --2- 172.21.15.45:0/3476711827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ea4004d10 0x7f4ea4005180 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0009fc0 tx=0x7f4eb001cc00 comp rx=0 tx=0).stop 2023-10-03T19:15:50.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.015+0000 7f4eb6d9d640 1 -- 172.21.15.45:0/3476711827 reap_dead start 2023-10-03T19:15:50.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.015+0000 7f4ebc878640 1 -- 172.21.15.45:0/3476711827 shutdown_connections 2023-10-03T19:15:50.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.015+0000 7f4ebc878640 1 -- 172.21.15.45:0/3476711827 >> 172.21.15.45:0/3476711827 conn(0x7f4eb80a4400 msgr2=0x7f4eb80a47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:50.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.015+0000 7f4ebc878640 1 -- 172.21.15.45:0/3476711827 shutdown_connections 2023-10-03T19:15:50.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.015+0000 7f4ebc878640 1 -- 172.21.15.45:0/3476711827 wait complete. 2023-10-03T19:15:50.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.015+0000 7f4ebc878640 1 Processor -- start 2023-10-03T19:15:50.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.015+0000 7f4ebc878640 1 -- start start 2023-10-03T19:15:50.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.015+0000 7f4ebc878640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4eb80bc000 0x7f4eb80bcf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:50.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.015+0000 7f4ebc878640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4eb80a7980 0x7f4eb80bc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:50.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.015+0000 7f4ebc878640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eb8145480 0x7f4eb81e12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:50.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.015+0000 7f4ebc878640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb80bbc40 con 0x7f4eb8145480 2023-10-03T19:15:50.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.015+0000 7f4ebc878640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb81e56c0 con 0x7f4eb80a7980 2023-10-03T19:15:50.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.015+0000 7f4ebc878640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb8145ec0 con 0x7f4eb80bc000 2023-10-03T19:15:50.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.015+0000 7f4eb6d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eb8145480 0x7f4eb81e12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:50.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.015+0000 7f4eb6d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eb8145480 0x7f4eb81e12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37730/0 (socket says 172.21.15.45:37730) 2023-10-03T19:15:50.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.015+0000 7f4eb6d9d640 1 -- 172.21.15.45:0/2570959549 learned_addr learned my addr 172.21.15.45:0/2570959549 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:50.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.015+0000 7f4eaffff640 1 --2- 172.21.15.45:0/2570959549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4eb80a7980 0x7f4eb80bc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:50.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.015+0000 7f4eb659c640 1 --2- 172.21.15.45:0/2570959549 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4eb80bc000 0x7f4eb80bcf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:50.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.015+0000 7f4eb6d9d640 1 -- 172.21.15.45:0/2570959549 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4eb80bc000 msgr2=0x7f4eb80bcf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:50.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.015+0000 7f4eb6d9d640 1 --2- 172.21.15.45:0/2570959549 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4eb80bc000 0x7f4eb80bcf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:50.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.015+0000 7f4eb6d9d640 1 -- 172.21.15.45:0/2570959549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4eb80a7980 msgr2=0x7f4eb80bc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:50.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.015+0000 7f4eb6d9d640 1 --2- 172.21.15.45:0/2570959549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4eb80a7980 0x7f4eb80bc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:50.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.015+0000 7f4eb6d9d640 1 -- 172.21.15.45:0/2570959549 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb806e070 con 0x7f4eb8145480 2023-10-03T19:15:50.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.019+0000 7f4eb6d9d640 1 --2- 172.21.15.45:0/2570959549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eb8145480 0x7f4eb81e12e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0002240 tx=0x7f4eb0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:50.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.019+0000 7f4eaeffd640 1 -- 172.21.15.45:0/2570959549 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb00ba070 con 0x7f4eb8145480 2023-10-03T19:15:50.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.019+0000 7f4eaeffd640 1 -- 172.21.15.45:0/2570959549 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb00039a0 con 0x7f4eb8145480 2023-10-03T19:15:50.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.019+0000 7f4ebc878640 1 -- 172.21.15.45:0/2570959549 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb80c2d30 con 0x7f4eb8145480 2023-10-03T19:15:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.019+0000 7f4eaeffd640 1 -- 172.21.15.45:0/2570959549 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0003b30 con 0x7f4eb8145480 2023-10-03T19:15:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.019+0000 7f4ebc878640 1 -- 172.21.15.45:0/2570959549 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb80c0ec0 con 0x7f4eb8145480 2023-10-03T19:15:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.019+0000 7f4ebc878640 1 -- 172.21.15.45:0/2570959549 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb804de80 con 0x7f4eb8145480 2023-10-03T19:15:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.019+0000 7f4eaeffd640 1 -- 172.21.15.45:0/2570959549 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4eb00b4040 con 0x7f4eb8145480 2023-10-03T19:15:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.019+0000 7f4eaeffd640 1 --2- 172.21.15.45:0/2570959549 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4e980662b0 0x7f4e98068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.019+0000 7f4eaeffd640 1 -- 172.21.15.45:0/2570959549 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4eb011d580 con 0x7f4eb8145480 2023-10-03T19:15:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.019+0000 7f4eb659c640 1 --2- 172.21.15.45:0/2570959549 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4e980662b0 0x7f4e98068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.019+0000 7f4eb659c640 1 --2- 172.21.15.45:0/2570959549 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4e980662b0 0x7f4e98068760 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009c60 tx=0x7f4ea8009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:50.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.023+0000 7f4eaeffd640 1 -- 172.21.15.45:0/2570959549 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4eb00eaa40 con 0x7f4eb8145480 2023-10-03T19:15:50.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.211+0000 7f4ebc878640 1 -- 172.21.15.45:0/2570959549 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4eb80c3480 con 0x7f4eb8145480 2023-10-03T19:15:50.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.211+0000 7f4eaeffd640 1 -- 172.21.15.45:0/2570959549 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+3914 (secure 0 0 0) 0x7f4eb00ee060 con 0x7f4eb8145480 2023-10-03T19:15:50.319 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:15:50.319 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2315858323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2315858323},{"type":"v1","addr":"172.21.15.79:6835","nonce":2315858323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1525989510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1525989510},{"type":"v1","addr":"172.21.15.45:6834","nonce":1525989510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:15:46.329993+0000","modified":"2023-10-03T19:15:49.849869+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5514":{"gid":5514,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1319730866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1319730866},{"type":"v1","addr":"172.21.15.45:6835","nonce":1319730866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-10-03T19:15:50.320 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 23 2023-10-03T19:15:50.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.215+0000 7f4ebc878640 1 -- 172.21.15.45:0/2570959549 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4e980662b0 msgr2=0x7f4e98068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:50.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.215+0000 7f4ebc878640 1 --2- 172.21.15.45:0/2570959549 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4e980662b0 0x7f4e98068760 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009c60 tx=0x7f4ea8009190 comp rx=0 tx=0).stop 2023-10-03T19:15:50.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.215+0000 7f4ebc878640 1 -- 172.21.15.45:0/2570959549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eb8145480 msgr2=0x7f4eb81e12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:50.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.215+0000 7f4ebc878640 1 --2- 172.21.15.45:0/2570959549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eb8145480 0x7f4eb81e12e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0002240 tx=0x7f4eb0009750 comp rx=0 tx=0).stop 2023-10-03T19:15:50.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.215+0000 7f4ebc878640 1 -- 172.21.15.45:0/2570959549 shutdown_connections 2023-10-03T19:15:50.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.215+0000 7f4ebc878640 1 --2- 172.21.15.45:0/2570959549 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4e980662b0 0x7f4e98068760 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:50.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.215+0000 7f4ebc878640 1 --2- 172.21.15.45:0/2570959549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eb8145480 0x7f4eb81e12e0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:50.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.215+0000 7f4ebc878640 1 --2- 172.21.15.45:0/2570959549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4eb80a7980 0x7f4eb80bc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:50.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.215+0000 7f4ebc878640 1 --2- 172.21.15.45:0/2570959549 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4eb80bc000 0x7f4eb80bcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:50.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.215+0000 7f4ebc878640 1 -- 172.21.15.45:0/2570959549 >> 172.21.15.45:0/2570959549 conn(0x7f4eb80a4400 msgr2=0x7f4eb80a1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:50.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.215+0000 7f4ebc878640 1 -- 172.21.15.45:0/2570959549 shutdown_connections 2023-10-03T19:15:50.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.215+0000 7f4ebc878640 1 -- 172.21.15.45:0/2570959549 wait complete. 2023-10-03T19:15:50.322 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:15:50.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.443+0000 7f2c77285640 1 Processor -- start 2023-10-03T19:15:50.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c77285640 1 -- start start 2023-10-03T19:15:50.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c77285640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2c700b98f0 0x7f2c700b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:50.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c77285640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c700ba550 con 0x7f2c700a2e20 2023-10-03T19:15:50.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c77285640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c701526d0 con 0x7f2c700bc810 2023-10-03T19:15:50.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c77285640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c701529b0 con 0x7f2c700b98f0 2023-10-03T19:15:50.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c75822640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2c700a2e20 0x7f2c7006c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50762/0 (socket says 172.21.15.45:50762) 2023-10-03T19:15:50.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c75822640 1 -- 172.21.15.45:0/2499561866 learned_addr learned my addr 172.21.15.45:0/2499561866 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:15:50.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c75021640 1 --2- 172.21.15.45:0/2499561866 >> v2:172.21.15.79:3300/0 conn(0x7f2c700b98f0 0x7f2c700b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:50.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c63fff640 1 -- 172.21.15.45:0/2499561866 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022956169 0 0) 0x7f2c700ba550 con 0x7f2c700a2e20 2023-10-03T19:15:50.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c63fff640 1 -- 172.21.15.45:0/2499561866 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c5c003530 con 0x7f2c700a2e20 2023-10-03T19:15:50.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c63fff640 1 -- 172.21.15.45:0/2499561866 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3479326859 0 0) 0x7f2c5c003530 con 0x7f2c700a2e20 2023-10-03T19:15:50.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c63fff640 1 -- 172.21.15.45:0/2499561866 >> v2:172.21.15.79:3300/0 conn(0x7f2c700b98f0 msgr2=0x7f2c700b9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:50.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c63fff640 1 --2- 172.21.15.45:0/2499561866 >> v2:172.21.15.79:3300/0 conn(0x7f2c700b98f0 0x7f2c700b9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:50.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c63fff640 1 -- 172.21.15.45:0/2499561866 >> v1:172.21.15.79:6789/0 conn(0x7f2c700bc810 legacy=0x7f2c7006c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:50.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c63fff640 1 -- 172.21.15.45:0/2499561866 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c700ba200 con 0x7f2c700a2e20 2023-10-03T19:15:50.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c63fff640 1 -- 172.21.15.45:0/2499561866 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f2c68001a00 con 0x7f2c700a2e20 2023-10-03T19:15:50.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c63fff640 1 -- 172.21.15.45:0/2499561866 >> v1:172.21.15.45:6789/0 conn(0x7f2c700a2e20 legacy=0x7f2c7006c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:50.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c63fff640 1 --2- 172.21.15.45:0/2499561866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c5c003980 0x7f2c5c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:50.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c63fff640 1 --2- 172.21.15.45:0/2499561866 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2c5c0047d0 0x7f2c5c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:50.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c63fff640 1 --2- 172.21.15.45:0/2499561866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c5c005180 0x7f2c5c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:50.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c63fff640 1 -- 172.21.15.45:0/2499561866 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c701529b0 con 0x7f2c5c005180 2023-10-03T19:15:50.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c63fff640 1 -- 172.21.15.45:0/2499561866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5c00c000 con 0x7f2c5c003980 2023-10-03T19:15:50.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c63fff640 1 -- 172.21.15.45:0/2499561866 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5c00c1c0 con 0x7f2c5c0047d0 2023-10-03T19:15:50.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c75822640 1 --2- 172.21.15.45:0/2499561866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c5c005180 0x7f2c5c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:50.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c75021640 1 --2- 172.21.15.45:0/2499561866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c5c003980 0x7f2c5c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:50.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c75822640 1 -- 172.21.15.45:0/2499561866 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2c5c0047d0 msgr2=0x7f2c5c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:50.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c75822640 1 --2- 172.21.15.45:0/2499561866 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2c5c0047d0 0x7f2c5c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:50.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c75822640 1 -- 172.21.15.45:0/2499561866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c5c003980 msgr2=0x7f2c5c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:50.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c75822640 1 --2- 172.21.15.45:0/2499561866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c5c003980 0x7f2c5c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:50.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c75822640 1 -- 172.21.15.45:0/2499561866 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c5c003530 con 0x7f2c5c005180 2023-10-03T19:15:50.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.447+0000 7f2c75021640 1 --2- 172.21.15.45:0/2499561866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c5c003980 0x7f2c5c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:15:50.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.451+0000 7f2c75822640 1 -- 172.21.15.45:0/2499561866 reap_dead start 2023-10-03T19:15:50.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.451+0000 7f2c75822640 1 --2- 172.21.15.45:0/2499561866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c5c005180 0x7f2c5c00b990 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800a830 tx=0x7f2c6801d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36cd7f457f88161a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:50.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.451+0000 7f2c63fff640 1 -- 172.21.15.45:0/2499561866 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c680072d0 con 0x7f2c5c005180 2023-10-03T19:15:50.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.451+0000 7f2c63fff640 1 -- 172.21.15.45:0/2499561866 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c680a8070 con 0x7f2c5c005180 2023-10-03T19:15:50.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.451+0000 7f2c63fff640 1 -- 172.21.15.45:0/2499561866 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c680076b0 con 0x7f2c5c005180 2023-10-03T19:15:50.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c77285640 1 -- 172.21.15.45:0/2499561866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c5c005180 msgr2=0x7f2c5c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:50.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c77285640 1 --2- 172.21.15.45:0/2499561866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c5c005180 0x7f2c5c00b990 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800a830 tx=0x7f2c6801d340 comp rx=0 tx=0).stop 2023-10-03T19:15:50.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c77285640 1 -- 172.21.15.45:0/2499561866 shutdown_connections 2023-10-03T19:15:50.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c77285640 1 --2- 172.21.15.45:0/2499561866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c5c005180 0x7f2c5c00b990 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:50.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c77285640 1 -- 172.21.15.45:0/2499561866 >> 172.21.15.45:0/2499561866 conn(0x7f2c700bcf50 msgr2=0x7f2c700bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:50.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c77285640 1 -- 172.21.15.45:0/2499561866 shutdown_connections 2023-10-03T19:15:50.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c77285640 1 -- 172.21.15.45:0/2499561866 wait complete. 2023-10-03T19:15:50.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c77285640 1 Processor -- start 2023-10-03T19:15:50.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c77285640 1 -- start start 2023-10-03T19:15:50.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c77285640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c5c005180 0x7f2c70150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:50.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c77285640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c70071a30 0x7f2c701e6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:50.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c77285640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2c70145d00 0x7f2c701e6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:50.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c77285640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c701e5d80 con 0x7f2c5c005180 2023-10-03T19:15:50.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c77285640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c70151210 con 0x7f2c70071a30 2023-10-03T19:15:50.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c77285640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7014a5d0 con 0x7f2c70145d00 2023-10-03T19:15:50.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c75021640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c5c005180 0x7f2c70150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:50.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c75021640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c5c005180 0x7f2c70150cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37750/0 (socket says 172.21.15.45:37750) 2023-10-03T19:15:50.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c75021640 1 -- 172.21.15.45:0/1917752912 learned_addr learned my addr 172.21.15.45:0/1917752912 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:50.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c74820640 1 --2- 172.21.15.45:0/1917752912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c70071a30 0x7f2c701e6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:50.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c75822640 1 --2- 172.21.15.45:0/1917752912 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2c70145d00 0x7f2c701e6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:50.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c75021640 1 -- 172.21.15.45:0/1917752912 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2c70145d00 msgr2=0x7f2c701e6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:50.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c75021640 1 --2- 172.21.15.45:0/1917752912 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2c70145d00 0x7f2c701e6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:50.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c75021640 1 -- 172.21.15.45:0/1917752912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c70071a30 msgr2=0x7f2c701e6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:50.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c75021640 1 --2- 172.21.15.45:0/1917752912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c70071a30 0x7f2c701e6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:50.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c75021640 1 -- 172.21.15.45:0/1917752912 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c700baae0 con 0x7f2c5c005180 2023-10-03T19:15:50.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c75822640 1 --2- 172.21.15.45:0/1917752912 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2c70145d00 0x7f2c701e6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:15:50.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c74820640 1 --2- 172.21.15.45:0/1917752912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c70071a30 0x7f2c701e6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:15:50.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c75021640 1 --2- 172.21.15.45:0/1917752912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c5c005180 0x7f2c70150cd0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c009160 tx=0x7f2c6c011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:50.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c61ffb640 1 -- 172.21.15.45:0/1917752912 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c004220 con 0x7f2c5c005180 2023-10-03T19:15:50.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c61ffb640 1 -- 172.21.15.45:0/1917752912 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6c004380 con 0x7f2c5c005180 2023-10-03T19:15:50.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c61ffb640 1 -- 172.21.15.45:0/1917752912 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c015890 con 0x7f2c5c005180 2023-10-03T19:15:50.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c77285640 1 -- 172.21.15.45:0/1917752912 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c700ba950 con 0x7f2c5c005180 2023-10-03T19:15:50.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.455+0000 7f2c77285640 1 -- 172.21.15.45:0/1917752912 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c7014bf50 con 0x7f2c5c005180 2023-10-03T19:15:50.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.459+0000 7f2c77285640 1 -- 172.21.15.45:0/1917752912 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c7004de80 con 0x7f2c5c005180 2023-10-03T19:15:50.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.459+0000 7f2c61ffb640 1 -- 172.21.15.45:0/1917752912 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2c6c0159f0 con 0x7f2c5c005180 2023-10-03T19:15:50.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.459+0000 7f2c61ffb640 1 --2- 172.21.15.45:0/1917752912 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2c54066280 0x7f2c54068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:50.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.459+0000 7f2c61ffb640 1 -- 172.21.15.45:0/1917752912 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2c6c084200 con 0x7f2c5c005180 2023-10-03T19:15:50.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.459+0000 7f2c74820640 1 --2- 172.21.15.45:0/1917752912 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2c54066280 0x7f2c54068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:50.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.459+0000 7f2c74820640 1 --2- 172.21.15.45:0/1917752912 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2c54066280 0x7f2c54068730 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2c70146230 tx=0x7f2c64009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:50.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.463+0000 7f2c61ffb640 1 -- 172.21.15.45:0/1917752912 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2c6c051710 con 0x7f2c5c005180 2023-10-03T19:15:50.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.619+0000 7f2c77285640 1 -- 172.21.15.45:0/1917752912 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c700a29f0 con 0x7f2c5c005180 2023-10-03T19:15:50.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.623+0000 7f2c61ffb640 1 -- 172.21.15.45:0/1917752912 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+18303 (secure 0 0 0) 0x7f2c6c054d30 con 0x7f2c5c005180 2023-10-03T19:15:50.651 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:15:50.651 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":48,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:15:47.332569+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:15:44.458794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-03T19:15:45.219182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:15:50.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.623+0000 7f2c77285640 1 -- 172.21.15.45:0/1917752912 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2c54066280 msgr2=0x7f2c54068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:50.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.623+0000 7f2c77285640 1 --2- 172.21.15.45:0/1917752912 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2c54066280 0x7f2c54068730 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2c70146230 tx=0x7f2c64009040 comp rx=0 tx=0).stop 2023-10-03T19:15:50.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.623+0000 7f2c77285640 1 -- 172.21.15.45:0/1917752912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c5c005180 msgr2=0x7f2c70150cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:50.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.623+0000 7f2c77285640 1 --2- 172.21.15.45:0/1917752912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c5c005180 0x7f2c70150cd0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c009160 tx=0x7f2c6c011a60 comp rx=0 tx=0).stop 2023-10-03T19:15:50.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.623+0000 7f2c77285640 1 -- 172.21.15.45:0/1917752912 shutdown_connections 2023-10-03T19:15:50.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.623+0000 7f2c77285640 1 --2- 172.21.15.45:0/1917752912 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2c54066280 0x7f2c54068730 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:50.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.623+0000 7f2c77285640 1 --2- 172.21.15.45:0/1917752912 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2c70145d00 0x7f2c701e6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:50.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.623+0000 7f2c77285640 1 --2- 172.21.15.45:0/1917752912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c70071a30 0x7f2c701e6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:50.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.623+0000 7f2c77285640 1 --2- 172.21.15.45:0/1917752912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c5c005180 0x7f2c70150cd0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:50.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.623+0000 7f2c77285640 1 -- 172.21.15.45:0/1917752912 >> 172.21.15.45:0/1917752912 conn(0x7f2c700bcf50 msgr2=0x7f2c701483b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:50.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.623+0000 7f2c77285640 1 -- 172.21.15.45:0/1917752912 shutdown_connections 2023-10-03T19:15:50.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.623+0000 7f2c77285640 1 -- 172.21.15.45:0/1917752912 wait complete. 2023-10-03T19:15:50.662 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-03T19:15:50.662 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:15:50.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.783+0000 7fbfe7cfb640 1 Processor -- start 2023-10-03T19:15:50.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.787+0000 7fbfe7cfb640 1 -- start start 2023-10-03T19:15:50.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.787+0000 7fbfe7cfb640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbfe014f240 0x7fbfe01528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:50.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.787+0000 7fbfe7cfb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbfe00c2790 0x7fbfe00c0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:50.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.787+0000 7fbfe7cfb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbfe00bb1d0 0x7fbfe00c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:50.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.787+0000 7fbfe7cfb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe006b640 con 0x7fbfe00c2790 2023-10-03T19:15:50.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.787+0000 7fbfe7cfb640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe006b2d0 con 0x7fbfe014f240 2023-10-03T19:15:50.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.787+0000 7fbfe7cfb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe00c0fa0 con 0x7fbfe00bb1d0 2023-10-03T19:15:50.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.787+0000 7fbfe5296640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbfe00c2790 0x7fbfe00c0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:50.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.787+0000 7fbfe5296640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbfe00c2790 0x7fbfe00c0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37754/0 (socket says 172.21.15.45:37754) 2023-10-03T19:15:50.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.787+0000 7fbfe5296640 1 -- 172.21.15.45:0/2293670157 learned_addr learned my addr 172.21.15.45:0/2293670157 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:50.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.787+0000 7fbfe5a97640 1 --2- 172.21.15.45:0/2293670157 >> v2:172.21.15.79:3300/0 conn(0x7fbfe014f240 0x7fbfe01528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:50.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.787+0000 7fbfe6298640 1 --2- 172.21.15.45:0/2293670157 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbfe00bb1d0 0x7fbfe00c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:50.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.787+0000 7fbfe5296640 1 -- 172.21.15.45:0/2293670157 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbfe00bb1d0 msgr2=0x7fbfe00c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:50.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.787+0000 7fbfe5296640 1 --2- 172.21.15.45:0/2293670157 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbfe00bb1d0 0x7fbfe00c12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:50.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.787+0000 7fbfe5296640 1 -- 172.21.15.45:0/2293670157 >> v2:172.21.15.79:3300/0 conn(0x7fbfe014f240 msgr2=0x7fbfe01528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:50.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.787+0000 7fbfe5296640 1 --2- 172.21.15.45:0/2293670157 >> v2:172.21.15.79:3300/0 conn(0x7fbfe014f240 0x7fbfe01528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:50.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.787+0000 7fbfe5296640 1 -- 172.21.15.45:0/2293670157 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe00a3c60 con 0x7fbfe00c2790 2023-10-03T19:15:50.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.787+0000 7fbfe5296640 1 --2- 172.21.15.45:0/2293670157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfe00c2790 0x7fbfe00c0a60 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbfe00c47f0 tx=0x7fbfd001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0b6f0b09247014 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:50.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.787+0000 7fbfe4a95640 1 -- 172.21.15.45:0/2293670157 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd00a89b0 con 0x7fbfe00c2790 2023-10-03T19:15:50.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe4a95640 1 -- 172.21.15.45:0/2293670157 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd00a8b10 con 0x7fbfe00c2790 2023-10-03T19:15:50.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe4a95640 1 -- 172.21.15.45:0/2293670157 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd00a8ea0 con 0x7fbfe00c2790 2023-10-03T19:15:50.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe7cfb640 1 -- 172.21.15.45:0/2293670157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfe00c2790 msgr2=0x7fbfe00c0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:50.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe7cfb640 1 --2- 172.21.15.45:0/2293670157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfe00c2790 0x7fbfe00c0a60 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbfe00c47f0 tx=0x7fbfd001ecf0 comp rx=0 tx=0).stop 2023-10-03T19:15:50.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe7cfb640 1 -- 172.21.15.45:0/2293670157 shutdown_connections 2023-10-03T19:15:50.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe7cfb640 1 --2- 172.21.15.45:0/2293670157 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbfe00bb1d0 0x7fbfe00c12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:50.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe7cfb640 1 --2- 172.21.15.45:0/2293670157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfe00c2790 0x7fbfe00c0a60 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:50.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe7cfb640 1 --2- 172.21.15.45:0/2293670157 >> v2:172.21.15.79:3300/0 conn(0x7fbfe014f240 0x7fbfe01528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:50.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe7cfb640 1 -- 172.21.15.45:0/2293670157 >> 172.21.15.45:0/2293670157 conn(0x7fbfe00a64a0 msgr2=0x7fbfe00a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:50.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe7cfb640 1 -- 172.21.15.45:0/2293670157 shutdown_connections 2023-10-03T19:15:50.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe7cfb640 1 -- 172.21.15.45:0/2293670157 wait complete. 2023-10-03T19:15:50.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe7cfb640 1 Processor -- start 2023-10-03T19:15:50.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe7cfb640 1 -- start start 2023-10-03T19:15:50.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe7cfb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfe00bb1d0 0x7fbfe014abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:50.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe7cfb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbfe00c2790 0x7fbfe00c3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:50.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe7cfb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfe014f240 0x7fbfe01e7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:50.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe7cfb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe00bc3e0 con 0x7fbfe00bb1d0 2023-10-03T19:15:50.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe7cfb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe00c3aa0 con 0x7fbfe014f240 2023-10-03T19:15:50.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe7cfb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe01e7370 con 0x7fbfe00c2790 2023-10-03T19:15:50.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe5a97640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfe00bb1d0 0x7fbfe014abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:50.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe5a97640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfe00bb1d0 0x7fbfe014abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37760/0 (socket says 172.21.15.45:37760) 2023-10-03T19:15:50.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe5a97640 1 -- 172.21.15.45:0/1026297056 learned_addr learned my addr 172.21.15.45:0/1026297056 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:50.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe6298640 1 --2- 172.21.15.45:0/1026297056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfe014f240 0x7fbfe01e7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:50.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe5296640 1 --2- 172.21.15.45:0/1026297056 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbfe00c2790 0x7fbfe00c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:50.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe5a97640 1 -- 172.21.15.45:0/1026297056 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbfe00c2790 msgr2=0x7fbfe00c3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:50.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe5a97640 1 --2- 172.21.15.45:0/1026297056 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbfe00c2790 0x7fbfe00c3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:50.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe5a97640 1 -- 172.21.15.45:0/1026297056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfe014f240 msgr2=0x7fbfe01e7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:50.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe5a97640 1 --2- 172.21.15.45:0/1026297056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfe014f240 0x7fbfe01e7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:50.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe5a97640 1 -- 172.21.15.45:0/1026297056 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd0009480 con 0x7fbfe00bb1d0 2023-10-03T19:15:50.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe5a97640 1 --2- 172.21.15.45:0/1026297056 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfe00bb1d0 0x7fbfe014abe0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00d7d0 tx=0x7fbfdc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:50.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfd67fc640 1 -- 172.21.15.45:0/1026297056 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc00b6c0 con 0x7fbfe00bb1d0 2023-10-03T19:15:50.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfd67fc640 1 -- 172.21.15.45:0/1026297056 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfdc00b820 con 0x7fbfe00bb1d0 2023-10-03T19:15:50.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe7cfb640 1 -- 172.21.15.45:0/1026297056 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe00a3f40 con 0x7fbfe00bb1d0 2023-10-03T19:15:50.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfd67fc640 1 -- 172.21.15.45:0/1026297056 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc00bbd0 con 0x7fbfe00bb1d0 2023-10-03T19:15:50.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.791+0000 7fbfe7cfb640 1 -- 172.21.15.45:0/1026297056 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe014e740 con 0x7fbfe00bb1d0 2023-10-03T19:15:50.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.795+0000 7fbfe7cfb640 1 -- 172.21.15.45:0/1026297056 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe014f610 con 0x7fbfe00bb1d0 2023-10-03T19:15:50.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.795+0000 7fbfd67fc640 1 -- 172.21.15.45:0/1026297056 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbfdc00bd30 con 0x7fbfe00bb1d0 2023-10-03T19:15:50.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.795+0000 7fbfd67fc640 1 --2- 172.21.15.45:0/1026297056 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbfc4066280 0x7fbfc4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:50.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.795+0000 7fbfd67fc640 1 -- 172.21.15.45:0/1026297056 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbfdc084220 con 0x7fbfe00bb1d0 2023-10-03T19:15:50.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.795+0000 7fbfe5296640 1 --2- 172.21.15.45:0/1026297056 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbfc4066280 0x7fbfc4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:50.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.795+0000 7fbfe5296640 1 --2- 172.21.15.45:0/1026297056 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbfc4066280 0x7fbfc4068730 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbfd00b2000 tx=0x7fbfd00aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:50.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.799+0000 7fbfd67fc640 1 -- 172.21.15.45:0/1026297056 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbfdc055130 con 0x7fbfe00bb1d0 2023-10-03T19:15:50.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.951+0000 7fbfe7cfb640 1 -- 172.21.15.45:0/1026297056 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbfe01e71f0 con 0x7fbfc4066280 2023-10-03T19:15:50.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.975+0000 7fbfd67fc640 1 -- 172.21.15.45:0/1026297056 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309401 (secure 0 0 0) 0x7fbfd0004040 con 0x7fbfc4066280 2023-10-03T19:15:51.044 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:15:51.046 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:15:51.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.983+0000 7fbfe7cfb640 1 -- 172.21.15.45:0/1026297056 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbfc4066280 msgr2=0x7fbfc4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:51.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.983+0000 7fbfe7cfb640 1 --2- 172.21.15.45:0/1026297056 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbfc4066280 0x7fbfc4068730 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbfd00b2000 tx=0x7fbfd00aa070 comp rx=0 tx=0).stop 2023-10-03T19:15:51.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.983+0000 7fbfe7cfb640 1 -- 172.21.15.45:0/1026297056 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfe00bb1d0 msgr2=0x7fbfe014abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:51.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.983+0000 7fbfe7cfb640 1 --2- 172.21.15.45:0/1026297056 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfe00bb1d0 0x7fbfe014abe0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00d7d0 tx=0x7fbfdc00dc90 comp rx=0 tx=0).stop 2023-10-03T19:15:51.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.983+0000 7fbfe7cfb640 1 -- 172.21.15.45:0/1026297056 shutdown_connections 2023-10-03T19:15:51.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.983+0000 7fbfe7cfb640 1 --2- 172.21.15.45:0/1026297056 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbfc4066280 0x7fbfc4068730 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:51.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.983+0000 7fbfe7cfb640 1 --2- 172.21.15.45:0/1026297056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfe014f240 0x7fbfe01e7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:51.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.983+0000 7fbfe7cfb640 1 --2- 172.21.15.45:0/1026297056 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbfe00c2790 0x7fbfe00c3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:51.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.983+0000 7fbfe7cfb640 1 --2- 172.21.15.45:0/1026297056 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfe00bb1d0 0x7fbfe014abe0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:51.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.983+0000 7fbfe7cfb640 1 -- 172.21.15.45:0/1026297056 >> 172.21.15.45:0/1026297056 conn(0x7fbfe00a64a0 msgr2=0x7fbfe00a6870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:51.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.983+0000 7fbfe7cfb640 1 -- 172.21.15.45:0/1026297056 shutdown_connections 2023-10-03T19:15:51.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:50.983+0000 7fbfe7cfb640 1 -- 172.21.15.45:0/1026297056 wait complete. 2023-10-03T19:15:51.049 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2023-10-03T19:15:50.515242+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142,"ondisk_log_size":142,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":108,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":134148,"kb_used_data":4420,"kb_used_omap":0,"kb_used_meta":129664,"kb_avail":754840572,"statfs":{"total":773094113280,"available":772956745728,"internally_reserved":0,"allocated":4526080,"data_stored":3062284,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":132775936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":67,"apply_latency_ms":67,"commit_latency_ns":67000000,"apply_latency_ns":67000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.705945"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.395366+0000","last_change":"2023-10-03T19:15:46.394210+0000","last_active":"2023-10-03T19:15:46.395366+0000","last_peered":"2023-10-03T19:15:46.395366+0000","last_clean":"2023-10-03T19:15:46.395366+0000","last_became_active":"2023-10-03T19:15:46.393845+0000","last_became_peered":"2023-10-03T19:15:46.393845+0000","last_unstale":"2023-10-03T19:15:46.395366+0000","last_undegraded":"2023-10-03T19:15:46.395366+0000","last_fullsized":"2023-10-03T19:15:46.395366+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:15:31.305120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.404180+0000","last_change":"2023-10-03T19:15:46.398709+0000","last_active":"2023-10-03T19:15:46.404180+0000","last_peered":"2023-10-03T19:15:46.404180+0000","last_clean":"2023-10-03T19:15:46.404180+0000","last_became_active":"2023-10-03T19:15:46.397955+0000","last_became_peered":"2023-10-03T19:15:46.397955+0000","last_unstale":"2023-10-03T19:15:46.404180+0000","last_undegraded":"2023-10-03T19:15:46.404180+0000","last_fullsized":"2023-10-03T19:15:46.404180+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:16:53.957508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160021+0000","last_change":"2023-10-03T19:15:46.364679+0000","last_active":"2023-10-03T19:15:48.160021+0000","last_peered":"2023-10-03T19:15:48.160021+0000","last_clean":"2023-10-03T19:15:48.160021+0000","last_became_active":"2023-10-03T19:15:46.360555+0000","last_became_peered":"2023-10-03T19:15:46.360555+0000","last_unstale":"2023-10-03T19:15:48.160021+0000","last_undegraded":"2023-10-03T19:15:48.160021+0000","last_fullsized":"2023-10-03T19:15:48.160021+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:33:29.425810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.391750+0000","last_change":"2023-10-03T19:15:46.379223+0000","last_active":"2023-10-03T19:15:46.391750+0000","last_peered":"2023-10-03T19:15:46.391750+0000","last_clean":"2023-10-03T19:15:46.391750+0000","last_became_active":"2023-10-03T19:15:46.378548+0000","last_became_peered":"2023-10-03T19:15:46.378548+0000","last_unstale":"2023-10-03T19:15:46.391750+0000","last_undegraded":"2023-10-03T19:15:46.391750+0000","last_fullsized":"2023-10-03T19:15:46.391750+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:35:52.686944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.389092+0000","last_change":"2023-10-03T19:15:46.382245+0000","last_active":"2023-10-03T19:15:46.389092+0000","last_peered":"2023-10-03T19:15:46.389092+0000","last_clean":"2023-10-03T19:15:46.389092+0000","last_became_active":"2023-10-03T19:15:46.381558+0000","last_became_peered":"2023-10-03T19:15:46.381558+0000","last_unstale":"2023-10-03T19:15:46.389092+0000","last_undegraded":"2023-10-03T19:15:46.389092+0000","last_fullsized":"2023-10-03T19:15:46.389092+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:32:37.131879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.364981+0000","last_change":"2023-10-03T19:15:46.363085+0000","last_active":"2023-10-03T19:15:46.364981+0000","last_peered":"2023-10-03T19:15:46.364981+0000","last_clean":"2023-10-03T19:15:46.364981+0000","last_became_active":"2023-10-03T19:15:46.362532+0000","last_became_peered":"2023-10-03T19:15:46.362532+0000","last_unstale":"2023-10-03T19:15:46.364981+0000","last_undegraded":"2023-10-03T19:15:46.364981+0000","last_fullsized":"2023-10-03T19:15:46.364981+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:12:14.696723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158898+0000","last_change":"2023-10-03T19:15:46.364944+0000","last_active":"2023-10-03T19:15:48.158898+0000","last_peered":"2023-10-03T19:15:48.158898+0000","last_clean":"2023-10-03T19:15:48.158898+0000","last_became_active":"2023-10-03T19:15:46.364685+0000","last_became_peered":"2023-10-03T19:15:46.364685+0000","last_unstale":"2023-10-03T19:15:48.158898+0000","last_undegraded":"2023-10-03T19:15:48.158898+0000","last_fullsized":"2023-10-03T19:15:48.158898+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:39:43.145618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.824309+0000","last_change":"2023-10-03T19:15:45.824309+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.824309+0000","last_undegraded":"2023-10-03T19:15:45.824309+0000","last_fullsized":"2023-10-03T19:15:45.824309+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.824018+0000","last_change":"2023-10-03T19:15:45.824018+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.824018+0000","last_undegraded":"2023-10-03T19:15:45.824018+0000","last_fullsized":"2023-10-03T19:15:45.824018+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.363671+0000","last_change":"2023-10-03T19:15:46.362303+0000","last_active":"2023-10-03T19:15:46.363671+0000","last_peered":"2023-10-03T19:15:46.363671+0000","last_clean":"2023-10-03T19:15:46.363671+0000","last_became_active":"2023-10-03T19:15:46.362001+0000","last_became_peered":"2023-10-03T19:15:46.362001+0000","last_unstale":"2023-10-03T19:15:46.363671+0000","last_undegraded":"2023-10-03T19:15:46.363671+0000","last_fullsized":"2023-10-03T19:15:46.363671+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:36:05.401390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.368856+0000","last_change":"2023-10-03T19:15:46.367695+0000","last_active":"2023-10-03T19:15:46.368856+0000","last_peered":"2023-10-03T19:15:46.368856+0000","last_clean":"2023-10-03T19:15:46.368856+0000","last_became_active":"2023-10-03T19:15:46.367450+0000","last_became_peered":"2023-10-03T19:15:46.367450+0000","last_unstale":"2023-10-03T19:15:46.368856+0000","last_undegraded":"2023-10-03T19:15:46.368856+0000","last_fullsized":"2023-10-03T19:15:46.368856+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:27:40.278413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.821529+0000","last_change":"2023-10-03T19:15:45.821529+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.821529+0000","last_undegraded":"2023-10-03T19:15:45.821529+0000","last_fullsized":"2023-10-03T19:15:45.821529+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.367008+0000","last_change":"2023-10-03T19:15:46.365193+0000","last_active":"2023-10-03T19:15:46.367008+0000","last_peered":"2023-10-03T19:15:46.367008+0000","last_clean":"2023-10-03T19:15:46.367008+0000","last_became_active":"2023-10-03T19:15:46.364040+0000","last_became_peered":"2023-10-03T19:15:46.364040+0000","last_unstale":"2023-10-03T19:15:46.367008+0000","last_undegraded":"2023-10-03T19:15:46.367008+0000","last_fullsized":"2023-10-03T19:15:46.367008+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:50:01.514952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159667+0000","last_change":"2023-10-03T19:15:46.364760+0000","last_active":"2023-10-03T19:15:48.159667+0000","last_peered":"2023-10-03T19:15:48.159667+0000","last_clean":"2023-10-03T19:15:48.159667+0000","last_became_active":"2023-10-03T19:15:46.360362+0000","last_became_peered":"2023-10-03T19:15:46.360362+0000","last_unstale":"2023-10-03T19:15:48.159667+0000","last_undegraded":"2023-10-03T19:15:48.159667+0000","last_fullsized":"2023-10-03T19:15:48.159667+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:25:27.749340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.392013+0000","last_change":"2023-10-03T19:15:46.379695+0000","last_active":"2023-10-03T19:15:46.392013+0000","last_peered":"2023-10-03T19:15:46.392013+0000","last_clean":"2023-10-03T19:15:46.392013+0000","last_became_active":"2023-10-03T19:15:46.378968+0000","last_became_peered":"2023-10-03T19:15:46.378968+0000","last_unstale":"2023-10-03T19:15:46.392013+0000","last_undegraded":"2023-10-03T19:15:46.392013+0000","last_fullsized":"2023-10-03T19:15:46.392013+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:30:42.698489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.363698+0000","last_change":"2023-10-03T19:15:46.362453+0000","last_active":"2023-10-03T19:15:46.363698+0000","last_peered":"2023-10-03T19:15:46.363698+0000","last_clean":"2023-10-03T19:15:46.363698+0000","last_became_active":"2023-10-03T19:15:46.361895+0000","last_became_peered":"2023-10-03T19:15:46.361895+0000","last_unstale":"2023-10-03T19:15:46.363698+0000","last_undegraded":"2023-10-03T19:15:46.363698+0000","last_fullsized":"2023-10-03T19:15:46.363698+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:11:36.629198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160719+0000","last_change":"2023-10-03T19:15:46.400243+0000","last_active":"2023-10-03T19:15:48.160719+0000","last_peered":"2023-10-03T19:15:48.160719+0000","last_clean":"2023-10-03T19:15:48.160719+0000","last_became_active":"2023-10-03T19:15:46.399983+0000","last_became_peered":"2023-10-03T19:15:46.399983+0000","last_unstale":"2023-10-03T19:15:48.160719+0000","last_undegraded":"2023-10-03T19:15:48.160719+0000","last_fullsized":"2023-10-03T19:15:48.160719+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:53:20.933525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.404210+0000","last_change":"2023-10-03T19:15:46.399010+0000","last_active":"2023-10-03T19:15:46.404210+0000","last_peered":"2023-10-03T19:15:46.404210+0000","last_clean":"2023-10-03T19:15:46.404210+0000","last_became_active":"2023-10-03T19:15:46.397599+0000","last_became_peered":"2023-10-03T19:15:46.397599+0000","last_unstale":"2023-10-03T19:15:46.404210+0000","last_undegraded":"2023-10-03T19:15:46.404210+0000","last_fullsized":"2023-10-03T19:15:46.404210+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:41:36.252764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160430+0000","last_change":"2023-10-03T19:15:46.377306+0000","last_active":"2023-10-03T19:15:48.160430+0000","last_peered":"2023-10-03T19:15:48.160430+0000","last_clean":"2023-10-03T19:15:48.160430+0000","last_became_active":"2023-10-03T19:15:46.377041+0000","last_became_peered":"2023-10-03T19:15:46.377041+0000","last_unstale":"2023-10-03T19:15:48.160430+0000","last_undegraded":"2023-10-03T19:15:48.160430+0000","last_fullsized":"2023-10-03T19:15:48.160430+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:26:46.602249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.392879+0000","last_change":"2023-10-03T19:15:46.388939+0000","last_active":"2023-10-03T19:15:46.392879+0000","last_peered":"2023-10-03T19:15:46.392879+0000","last_clean":"2023-10-03T19:15:46.392879+0000","last_became_active":"2023-10-03T19:15:46.388201+0000","last_became_peered":"2023-10-03T19:15:46.388201+0000","last_unstale":"2023-10-03T19:15:46.392879+0000","last_undegraded":"2023-10-03T19:15:46.392879+0000","last_fullsized":"2023-10-03T19:15:46.392879+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:51:41.830735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.399238+0000","last_change":"2023-10-03T19:15:46.393014+0000","last_active":"2023-10-03T19:15:46.399238+0000","last_peered":"2023-10-03T19:15:46.399238+0000","last_clean":"2023-10-03T19:15:46.399238+0000","last_became_active":"2023-10-03T19:15:46.392401+0000","last_became_peered":"2023-10-03T19:15:46.392401+0000","last_unstale":"2023-10-03T19:15:46.399238+0000","last_undegraded":"2023-10-03T19:15:46.399238+0000","last_fullsized":"2023-10-03T19:15:46.399238+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:59:22.380642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.825371+0000","last_change":"2023-10-03T19:15:45.825371+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.825371+0000","last_undegraded":"2023-10-03T19:15:45.825371+0000","last_fullsized":"2023-10-03T19:15:45.825371+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.380160+0000","last_change":"2023-10-03T19:15:46.378934+0000","last_active":"2023-10-03T19:15:46.380160+0000","last_peered":"2023-10-03T19:15:46.380160+0000","last_clean":"2023-10-03T19:15:46.380160+0000","last_became_active":"2023-10-03T19:15:46.378611+0000","last_became_peered":"2023-10-03T19:15:46.378611+0000","last_unstale":"2023-10-03T19:15:46.380160+0000","last_undegraded":"2023-10-03T19:15:46.380160+0000","last_fullsized":"2023-10-03T19:15:46.380160+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:43:48.510914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158761+0000","last_change":"2023-10-03T19:15:46.360949+0000","last_active":"2023-10-03T19:15:48.158761+0000","last_peered":"2023-10-03T19:15:48.158761+0000","last_clean":"2023-10-03T19:15:48.158761+0000","last_became_active":"2023-10-03T19:15:46.360658+0000","last_became_peered":"2023-10-03T19:15:46.360658+0000","last_unstale":"2023-10-03T19:15:48.158761+0000","last_undegraded":"2023-10-03T19:15:48.158761+0000","last_fullsized":"2023-10-03T19:15:48.158761+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:03:34.243331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160900+0000","last_change":"2023-10-03T19:15:46.368683+0000","last_active":"2023-10-03T19:15:48.160900+0000","last_peered":"2023-10-03T19:15:48.160900+0000","last_clean":"2023-10-03T19:15:48.160900+0000","last_became_active":"2023-10-03T19:15:46.368390+0000","last_became_peered":"2023-10-03T19:15:46.368390+0000","last_unstale":"2023-10-03T19:15:48.160900+0000","last_undegraded":"2023-10-03T19:15:48.160900+0000","last_fullsized":"2023-10-03T19:15:48.160900+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:03:04.832859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.828249+0000","last_change":"2023-10-03T19:15:45.828249+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.828249+0000","last_undegraded":"2023-10-03T19:15:45.828249+0000","last_fullsized":"2023-10-03T19:15:45.828249+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.355757+0000","last_change":"2023-10-03T19:15:46.353768+0000","last_active":"2023-10-03T19:15:46.355757+0000","last_peered":"2023-10-03T19:15:46.355757+0000","last_clean":"2023-10-03T19:15:46.355757+0000","last_became_active":"2023-10-03T19:15:46.353516+0000","last_became_peered":"2023-10-03T19:15:46.353516+0000","last_unstale":"2023-10-03T19:15:46.355757+0000","last_undegraded":"2023-10-03T19:15:46.355757+0000","last_fullsized":"2023-10-03T19:15:46.355757+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:22:07.225725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.386197+0000","last_change":"2023-10-03T19:15:46.375987+0000","last_active":"2023-10-03T19:15:46.386197+0000","last_peered":"2023-10-03T19:15:46.386197+0000","last_clean":"2023-10-03T19:15:46.386197+0000","last_became_active":"2023-10-03T19:15:46.375284+0000","last_became_peered":"2023-10-03T19:15:46.375284+0000","last_unstale":"2023-10-03T19:15:46.386197+0000","last_undegraded":"2023-10-03T19:15:46.386197+0000","last_fullsized":"2023-10-03T19:15:46.386197+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:52:49.683952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159751+0000","last_change":"2023-10-03T19:15:46.374991+0000","last_active":"2023-10-03T19:15:48.159751+0000","last_peered":"2023-10-03T19:15:48.159751+0000","last_clean":"2023-10-03T19:15:48.159751+0000","last_became_active":"2023-10-03T19:15:46.374699+0000","last_became_peered":"2023-10-03T19:15:46.374699+0000","last_unstale":"2023-10-03T19:15:48.159751+0000","last_undegraded":"2023-10-03T19:15:48.159751+0000","last_fullsized":"2023-10-03T19:15:48.159751+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:38:41.035694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.395049+0000","last_change":"2023-10-03T19:15:46.380983+0000","last_active":"2023-10-03T19:15:46.395049+0000","last_peered":"2023-10-03T19:15:46.395049+0000","last_clean":"2023-10-03T19:15:46.395049+0000","last_became_active":"2023-10-03T19:15:46.380216+0000","last_became_peered":"2023-10-03T19:15:46.380216+0000","last_unstale":"2023-10-03T19:15:46.395049+0000","last_undegraded":"2023-10-03T19:15:46.395049+0000","last_fullsized":"2023-10-03T19:15:46.395049+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:18:04.258221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159168+0000","last_change":"2023-10-03T19:15:46.361191+0000","last_active":"2023-10-03T19:15:48.159168+0000","last_peered":"2023-10-03T19:15:48.159168+0000","last_clean":"2023-10-03T19:15:48.159168+0000","last_became_active":"2023-10-03T19:15:46.360817+0000","last_became_peered":"2023-10-03T19:15:46.360817+0000","last_unstale":"2023-10-03T19:15:48.159168+0000","last_undegraded":"2023-10-03T19:15:48.159168+0000","last_fullsized":"2023-10-03T19:15:48.159168+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:09:39.321340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.348033+0000","last_change":"2023-10-03T19:15:46.399112+0000","last_active":"2023-10-03T19:15:47.348033+0000","last_peered":"2023-10-03T19:15:47.348033+0000","last_clean":"2023-10-03T19:15:47.348033+0000","last_became_active":"2023-10-03T19:15:46.398515+0000","last_became_peered":"2023-10-03T19:15:46.398515+0000","last_unstale":"2023-10-03T19:15:47.348033+0000","last_undegraded":"2023-10-03T19:15:47.348033+0000","last_fullsized":"2023-10-03T19:15:47.348033+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:34:48.331811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.405692+0000","last_change":"2023-10-03T19:15:46.403169+0000","last_active":"2023-10-03T19:15:46.405692+0000","last_peered":"2023-10-03T19:15:46.405692+0000","last_clean":"2023-10-03T19:15:46.405692+0000","last_became_active":"2023-10-03T19:15:46.402567+0000","last_became_peered":"2023-10-03T19:15:46.402567+0000","last_unstale":"2023-10-03T19:15:46.405692+0000","last_undegraded":"2023-10-03T19:15:46.405692+0000","last_fullsized":"2023-10-03T19:15:46.405692+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:50:20.113157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"47'4","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.390701+0000","last_change":"2023-10-03T19:15:45.859549+0000","last_active":"2023-10-03T19:15:46.390701+0000","last_peered":"2023-10-03T19:15:46.390701+0000","last_clean":"2023-10-03T19:15:46.390701+0000","last_became_active":"2023-10-03T19:15:45.859068+0000","last_became_peered":"2023-10-03T19:15:45.859068+0000","last_unstale":"2023-10-03T19:15:46.390701+0000","last_undegraded":"2023-10-03T19:15:46.390701+0000","last_fullsized":"2023-10-03T19:15:46.390701+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:10:08.995883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.348456+0000","last_change":"2023-10-03T19:15:46.398012+0000","last_active":"2023-10-03T19:15:47.348456+0000","last_peered":"2023-10-03T19:15:47.348456+0000","last_clean":"2023-10-03T19:15:47.348456+0000","last_became_active":"2023-10-03T19:15:46.396826+0000","last_became_peered":"2023-10-03T19:15:46.396826+0000","last_unstale":"2023-10-03T19:15:47.348456+0000","last_undegraded":"2023-10-03T19:15:47.348456+0000","last_fullsized":"2023-10-03T19:15:47.348456+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:01:43.218107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.349020+0000","last_change":"2023-10-03T19:15:45.849183+0000","last_active":"2023-10-03T19:15:46.349020+0000","last_peered":"2023-10-03T19:15:46.349020+0000","last_clean":"2023-10-03T19:15:46.349020+0000","last_became_active":"2023-10-03T19:15:45.848159+0000","last_became_peered":"2023-10-03T19:15:45.848159+0000","last_unstale":"2023-10-03T19:15:46.349020+0000","last_undegraded":"2023-10-03T19:15:46.349020+0000","last_fullsized":"2023-10-03T19:15:46.349020+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:32:36.127920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.400338+0000","last_change":"2023-10-03T19:15:46.393166+0000","last_active":"2023-10-03T19:15:46.400338+0000","last_peered":"2023-10-03T19:15:46.400338+0000","last_clean":"2023-10-03T19:15:46.400338+0000","last_became_active":"2023-10-03T19:15:46.392621+0000","last_became_peered":"2023-10-03T19:15:46.392621+0000","last_unstale":"2023-10-03T19:15:46.400338+0000","last_undegraded":"2023-10-03T19:15:46.400338+0000","last_fullsized":"2023-10-03T19:15:46.400338+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:24:01.426498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.352266+0000","last_change":"2023-10-03T19:15:45.856473+0000","last_active":"2023-10-03T19:15:46.352266+0000","last_peered":"2023-10-03T19:15:46.352266+0000","last_clean":"2023-10-03T19:15:46.352266+0000","last_became_active":"2023-10-03T19:15:45.856139+0000","last_became_peered":"2023-10-03T19:15:45.856139+0000","last_unstale":"2023-10-03T19:15:46.352266+0000","last_undegraded":"2023-10-03T19:15:46.352266+0000","last_fullsized":"2023-10-03T19:15:46.352266+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:52:53.713262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.827899+0000","last_change":"2023-10-03T19:15:45.827899+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.827899+0000","last_undegraded":"2023-10-03T19:15:45.827899+0000","last_fullsized":"2023-10-03T19:15:45.827899+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349975+0000","last_change":"2023-10-03T19:15:45.853261+0000","last_active":"2023-10-03T19:15:47.349975+0000","last_peered":"2023-10-03T19:15:47.349975+0000","last_clean":"2023-10-03T19:15:47.349975+0000","last_became_active":"2023-10-03T19:15:45.852517+0000","last_became_peered":"2023-10-03T19:15:45.852517+0000","last_unstale":"2023-10-03T19:15:47.349975+0000","last_undegraded":"2023-10-03T19:15:47.349975+0000","last_fullsized":"2023-10-03T19:15:47.349975+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:44:19.861675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.389003+0000","last_change":"2023-10-03T19:15:46.378648+0000","last_active":"2023-10-03T19:15:46.389003+0000","last_peered":"2023-10-03T19:15:46.389003+0000","last_clean":"2023-10-03T19:15:46.389003+0000","last_became_active":"2023-10-03T19:15:46.377900+0000","last_became_peered":"2023-10-03T19:15:46.377900+0000","last_unstale":"2023-10-03T19:15:46.389003+0000","last_undegraded":"2023-10-03T19:15:46.389003+0000","last_fullsized":"2023-10-03T19:15:46.389003+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:36:05.401390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159827+0000","last_change":"2023-10-03T19:15:45.842290+0000","last_active":"2023-10-03T19:15:48.159827+0000","last_peered":"2023-10-03T19:15:48.159827+0000","last_clean":"2023-10-03T19:15:48.159827+0000","last_became_active":"2023-10-03T19:15:45.841848+0000","last_became_peered":"2023-10-03T19:15:45.841848+0000","last_unstale":"2023-10-03T19:15:48.159827+0000","last_undegraded":"2023-10-03T19:15:48.159827+0000","last_fullsized":"2023-10-03T19:15:48.159827+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:14:42.878422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.395303+0000","last_change":"2023-10-03T19:15:46.385410+0000","last_active":"2023-10-03T19:15:46.395303+0000","last_peered":"2023-10-03T19:15:46.395303+0000","last_clean":"2023-10-03T19:15:46.395303+0000","last_became_active":"2023-10-03T19:15:46.381382+0000","last_became_peered":"2023-10-03T19:15:46.381382+0000","last_unstale":"2023-10-03T19:15:46.395303+0000","last_undegraded":"2023-10-03T19:15:46.395303+0000","last_fullsized":"2023-10-03T19:15:46.395303+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:28:43.600596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.378445+0000","last_change":"2023-10-03T19:15:45.861708+0000","last_active":"2023-10-03T19:15:46.378445+0000","last_peered":"2023-10-03T19:15:46.378445+0000","last_clean":"2023-10-03T19:15:46.378445+0000","last_became_active":"2023-10-03T19:15:45.861138+0000","last_became_peered":"2023-10-03T19:15:45.861138+0000","last_unstale":"2023-10-03T19:15:46.378445+0000","last_undegraded":"2023-10-03T19:15:46.378445+0000","last_fullsized":"2023-10-03T19:15:46.378445+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:52:53.713262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.827316+0000","last_change":"2023-10-03T19:15:45.827316+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.827316+0000","last_undegraded":"2023-10-03T19:15:45.827316+0000","last_fullsized":"2023-10-03T19:15:45.827316+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.369697+0000","last_change":"2023-10-03T19:15:45.854212+0000","last_active":"2023-10-03T19:15:46.369697+0000","last_peered":"2023-10-03T19:15:46.369697+0000","last_clean":"2023-10-03T19:15:46.369697+0000","last_became_active":"2023-10-03T19:15:45.851309+0000","last_became_peered":"2023-10-03T19:15:45.851309+0000","last_unstale":"2023-10-03T19:15:46.369697+0000","last_undegraded":"2023-10-03T19:15:46.369697+0000","last_fullsized":"2023-10-03T19:15:46.369697+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:27:18.462340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.391923+0000","last_change":"2023-10-03T19:15:46.379625+0000","last_active":"2023-10-03T19:15:46.391923+0000","last_peered":"2023-10-03T19:15:46.391923+0000","last_clean":"2023-10-03T19:15:46.391923+0000","last_became_active":"2023-10-03T19:15:46.378821+0000","last_became_peered":"2023-10-03T19:15:46.378821+0000","last_unstale":"2023-10-03T19:15:46.391923+0000","last_undegraded":"2023-10-03T19:15:46.391923+0000","last_fullsized":"2023-10-03T19:15:46.391923+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:01:43.816803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158940+0000","last_change":"2023-10-03T19:15:45.858316+0000","last_active":"2023-10-03T19:15:48.158940+0000","last_peered":"2023-10-03T19:15:48.158940+0000","last_clean":"2023-10-03T19:15:48.158940+0000","last_became_active":"2023-10-03T19:15:45.857799+0000","last_became_peered":"2023-10-03T19:15:45.857799+0000","last_unstale":"2023-10-03T19:15:48.158940+0000","last_undegraded":"2023-10-03T19:15:48.158940+0000","last_fullsized":"2023-10-03T19:15:48.158940+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:53:16.171067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.378239+0000","last_change":"2023-10-03T19:15:46.364379+0000","last_active":"2023-10-03T19:15:46.378239+0000","last_peered":"2023-10-03T19:15:46.378239+0000","last_clean":"2023-10-03T19:15:46.378239+0000","last_became_active":"2023-10-03T19:15:46.363462+0000","last_became_peered":"2023-10-03T19:15:46.363462+0000","last_unstale":"2023-10-03T19:15:46.378239+0000","last_undegraded":"2023-10-03T19:15:46.378239+0000","last_fullsized":"2023-10-03T19:15:46.378239+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:50:01.514952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.352386+0000","last_change":"2023-10-03T19:15:45.859177+0000","last_active":"2023-10-03T19:15:46.352386+0000","last_peered":"2023-10-03T19:15:46.352386+0000","last_clean":"2023-10-03T19:15:46.352386+0000","last_became_active":"2023-10-03T19:15:45.857999+0000","last_became_peered":"2023-10-03T19:15:45.857999+0000","last_unstale":"2023-10-03T19:15:46.352386+0000","last_undegraded":"2023-10-03T19:15:46.352386+0000","last_fullsized":"2023-10-03T19:15:46.352386+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:53:42.530765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.348113+0000","last_change":"2023-10-03T19:15:46.397614+0000","last_active":"2023-10-03T19:15:47.348113+0000","last_peered":"2023-10-03T19:15:47.348113+0000","last_clean":"2023-10-03T19:15:47.348113+0000","last_became_active":"2023-10-03T19:15:46.396040+0000","last_became_peered":"2023-10-03T19:15:46.396040+0000","last_unstale":"2023-10-03T19:15:47.348113+0000","last_undegraded":"2023-10-03T19:15:47.348113+0000","last_fullsized":"2023-10-03T19:15:47.348113+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:37:55.351113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.349729+0000","last_change":"2023-10-03T19:15:45.847050+0000","last_active":"2023-10-03T19:15:46.349729+0000","last_peered":"2023-10-03T19:15:46.349729+0000","last_clean":"2023-10-03T19:15:46.349729+0000","last_became_active":"2023-10-03T19:15:45.846253+0000","last_became_peered":"2023-10-03T19:15:45.846253+0000","last_unstale":"2023-10-03T19:15:46.349729+0000","last_undegraded":"2023-10-03T19:15:46.349729+0000","last_fullsized":"2023-10-03T19:15:46.349729+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:36:34.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159843+0000","last_change":"2023-10-03T19:15:46.375450+0000","last_active":"2023-10-03T19:15:48.159843+0000","last_peered":"2023-10-03T19:15:48.159843+0000","last_clean":"2023-10-03T19:15:48.159843+0000","last_became_active":"2023-10-03T19:15:46.375071+0000","last_became_peered":"2023-10-03T19:15:46.375071+0000","last_unstale":"2023-10-03T19:15:48.159843+0000","last_undegraded":"2023-10-03T19:15:48.159843+0000","last_fullsized":"2023-10-03T19:15:48.159843+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:54:49.165838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"47'3","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.391839+0000","last_change":"2023-10-03T19:15:45.860953+0000","last_active":"2023-10-03T19:15:46.391839+0000","last_peered":"2023-10-03T19:15:46.391839+0000","last_clean":"2023-10-03T19:15:46.391839+0000","last_became_active":"2023-10-03T19:15:45.859256+0000","last_became_peered":"2023-10-03T19:15:45.859256+0000","last_unstale":"2023-10-03T19:15:46.391839+0000","last_undegraded":"2023-10-03T19:15:46.391839+0000","last_fullsized":"2023-10-03T19:15:46.391839+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:26:04.423019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.378221+0000","last_change":"2023-10-03T19:15:46.365297+0000","last_active":"2023-10-03T19:15:46.378221+0000","last_peered":"2023-10-03T19:15:46.378221+0000","last_clean":"2023-10-03T19:15:46.378221+0000","last_became_active":"2023-10-03T19:15:46.363978+0000","last_became_peered":"2023-10-03T19:15:46.363978+0000","last_unstale":"2023-10-03T19:15:46.378221+0000","last_undegraded":"2023-10-03T19:15:46.378221+0000","last_fullsized":"2023-10-03T19:15:46.378221+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:07:21.108075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-03T19:15:45.848869+0000","last_change":"2023-10-03T19:15:45.845291+0000","last_active":"2023-10-03T19:15:45.848869+0000","last_peered":"2023-10-03T19:15:45.848869+0000","last_clean":"2023-10-03T19:15:45.848869+0000","last_became_active":"2023-10-03T19:15:45.845024+0000","last_became_peered":"2023-10-03T19:15:45.845024+0000","last_unstale":"2023-10-03T19:15:45.848869+0000","last_undegraded":"2023-10-03T19:15:45.848869+0000","last_fullsized":"2023-10-03T19:15:45.848869+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:11:35.625240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349625+0000","last_change":"2023-10-03T19:15:46.397165+0000","last_active":"2023-10-03T19:15:47.349625+0000","last_peered":"2023-10-03T19:15:47.349625+0000","last_clean":"2023-10-03T19:15:47.349625+0000","last_became_active":"2023-10-03T19:15:46.396350+0000","last_became_peered":"2023-10-03T19:15:46.396350+0000","last_unstale":"2023-10-03T19:15:47.349625+0000","last_undegraded":"2023-10-03T19:15:47.349625+0000","last_fullsized":"2023-10-03T19:15:47.349625+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:51:27.685465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160115+0000","last_change":"2023-10-03T19:15:45.855724+0000","last_active":"2023-10-03T19:15:48.160115+0000","last_peered":"2023-10-03T19:15:48.160115+0000","last_clean":"2023-10-03T19:15:48.160115+0000","last_became_active":"2023-10-03T19:15:45.855158+0000","last_became_peered":"2023-10-03T19:15:45.855158+0000","last_unstale":"2023-10-03T19:15:48.160115+0000","last_undegraded":"2023-10-03T19:15:48.160115+0000","last_fullsized":"2023-10-03T19:15:48.160115+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:35:35.283953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160510+0000","last_change":"2023-10-03T19:15:46.368523+0000","last_active":"2023-10-03T19:15:48.160510+0000","last_peered":"2023-10-03T19:15:48.160510+0000","last_clean":"2023-10-03T19:15:48.160510+0000","last_became_active":"2023-10-03T19:15:46.368208+0000","last_became_peered":"2023-10-03T19:15:46.368208+0000","last_unstale":"2023-10-03T19:15:48.160510+0000","last_undegraded":"2023-10-03T19:15:48.160510+0000","last_fullsized":"2023-10-03T19:15:48.160510+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:02:17.268261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.370213+0000","last_change":"2023-10-03T19:15:45.860845+0000","last_active":"2023-10-03T19:15:46.370213+0000","last_peered":"2023-10-03T19:15:46.370213+0000","last_clean":"2023-10-03T19:15:46.370213+0000","last_became_active":"2023-10-03T19:15:45.860209+0000","last_became_peered":"2023-10-03T19:15:45.860209+0000","last_unstale":"2023-10-03T19:15:46.370213+0000","last_undegraded":"2023-10-03T19:15:46.370213+0000","last_fullsized":"2023-10-03T19:15:46.370213+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:02:07.426742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.827762+0000","last_change":"2023-10-03T19:15:45.827762+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.827762+0000","last_undegraded":"2023-10-03T19:15:45.827762+0000","last_fullsized":"2023-10-03T19:15:45.827762+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.351885+0000","last_change":"2023-10-03T19:15:45.861050+0000","last_active":"2023-10-03T19:15:46.351885+0000","last_peered":"2023-10-03T19:15:46.351885+0000","last_clean":"2023-10-03T19:15:46.351885+0000","last_became_active":"2023-10-03T19:15:45.860266+0000","last_became_peered":"2023-10-03T19:15:45.860266+0000","last_unstale":"2023-10-03T19:15:46.351885+0000","last_undegraded":"2023-10-03T19:15:46.351885+0000","last_fullsized":"2023-10-03T19:15:46.351885+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:07:41.373754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160867+0000","last_change":"2023-10-03T19:15:46.394299+0000","last_active":"2023-10-03T19:15:48.160867+0000","last_peered":"2023-10-03T19:15:48.160867+0000","last_clean":"2023-10-03T19:15:48.160867+0000","last_became_active":"2023-10-03T19:15:46.394004+0000","last_became_peered":"2023-10-03T19:15:46.394004+0000","last_unstale":"2023-10-03T19:15:48.160867+0000","last_undegraded":"2023-10-03T19:15:48.160867+0000","last_fullsized":"2023-10-03T19:15:48.160867+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:18:54.415024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-03T19:15:45.852138+0000","last_change":"2023-10-03T19:15:45.848662+0000","last_active":"2023-10-03T19:15:45.852138+0000","last_peered":"2023-10-03T19:15:45.852138+0000","last_clean":"2023-10-03T19:15:45.852138+0000","last_became_active":"2023-10-03T19:15:45.848008+0000","last_became_peered":"2023-10-03T19:15:45.848008+0000","last_unstale":"2023-10-03T19:15:45.852138+0000","last_undegraded":"2023-10-03T19:15:45.852138+0000","last_fullsized":"2023-10-03T19:15:45.852138+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:37:41.991426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.823243+0000","last_change":"2023-10-03T19:15:45.823243+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.823243+0000","last_undegraded":"2023-10-03T19:15:45.823243+0000","last_fullsized":"2023-10-03T19:15:45.823243+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.161196+0000","last_change":"2023-10-03T19:15:45.849759+0000","last_active":"2023-10-03T19:15:48.161196+0000","last_peered":"2023-10-03T19:15:48.161196+0000","last_clean":"2023-10-03T19:15:48.161196+0000","last_became_active":"2023-10-03T19:15:45.849456+0000","last_became_peered":"2023-10-03T19:15:45.849456+0000","last_unstale":"2023-10-03T19:15:48.161196+0000","last_undegraded":"2023-10-03T19:15:48.161196+0000","last_fullsized":"2023-10-03T19:15:48.161196+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:04:10.067798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.351986+0000","last_change":"2023-10-03T19:15:46.350646+0000","last_active":"2023-10-03T19:15:46.351986+0000","last_peered":"2023-10-03T19:15:46.351986+0000","last_clean":"2023-10-03T19:15:46.351986+0000","last_became_active":"2023-10-03T19:15:46.350328+0000","last_became_peered":"2023-10-03T19:15:46.350328+0000","last_unstale":"2023-10-03T19:15:46.351986+0000","last_undegraded":"2023-10-03T19:15:46.351986+0000","last_fullsized":"2023-10-03T19:15:46.351986+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:04:53.999973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.394818+0000","last_change":"2023-10-03T19:15:45.836185+0000","last_active":"2023-10-03T19:15:46.394818+0000","last_peered":"2023-10-03T19:15:46.394818+0000","last_clean":"2023-10-03T19:15:46.394818+0000","last_became_active":"2023-10-03T19:15:45.835843+0000","last_became_peered":"2023-10-03T19:15:45.835843+0000","last_unstale":"2023-10-03T19:15:46.394818+0000","last_undegraded":"2023-10-03T19:15:46.394818+0000","last_fullsized":"2023-10-03T19:15:46.394818+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:06:03.946899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.385213+0000","last_change":"2023-10-03T19:15:46.367540+0000","last_active":"2023-10-03T19:15:46.385213+0000","last_peered":"2023-10-03T19:15:46.385213+0000","last_clean":"2023-10-03T19:15:46.385213+0000","last_became_active":"2023-10-03T19:15:46.366645+0000","last_became_peered":"2023-10-03T19:15:46.366645+0000","last_unstale":"2023-10-03T19:15:46.385213+0000","last_undegraded":"2023-10-03T19:15:46.385213+0000","last_fullsized":"2023-10-03T19:15:46.385213+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:08:24.560923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.380718+0000","last_change":"2023-10-03T19:15:45.849574+0000","last_active":"2023-10-03T19:15:46.380718+0000","last_peered":"2023-10-03T19:15:46.380718+0000","last_clean":"2023-10-03T19:15:46.380718+0000","last_became_active":"2023-10-03T19:15:45.848800+0000","last_became_peered":"2023-10-03T19:15:45.848800+0000","last_unstale":"2023-10-03T19:15:46.380718+0000","last_undegraded":"2023-10-03T19:15:46.380718+0000","last_fullsized":"2023-10-03T19:15:46.380718+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:00:19.836298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.395337+0000","last_change":"2023-10-03T19:15:46.394179+0000","last_active":"2023-10-03T19:15:46.395337+0000","last_peered":"2023-10-03T19:15:46.395337+0000","last_clean":"2023-10-03T19:15:46.395337+0000","last_became_active":"2023-10-03T19:15:46.393883+0000","last_became_peered":"2023-10-03T19:15:46.393883+0000","last_unstale":"2023-10-03T19:15:46.395337+0000","last_undegraded":"2023-10-03T19:15:46.395337+0000","last_fullsized":"2023-10-03T19:15:46.395337+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:37:42.995384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.370522+0000","last_change":"2023-10-03T19:15:45.859040+0000","last_active":"2023-10-03T19:15:46.370522+0000","last_peered":"2023-10-03T19:15:46.370522+0000","last_clean":"2023-10-03T19:15:46.370522+0000","last_became_active":"2023-10-03T19:15:45.858297+0000","last_became_peered":"2023-10-03T19:15:45.858297+0000","last_unstale":"2023-10-03T19:15:46.370522+0000","last_undegraded":"2023-10-03T19:15:46.370522+0000","last_fullsized":"2023-10-03T19:15:46.370522+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:58:37.048776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349962+0000","last_change":"2023-10-03T19:15:46.396843+0000","last_active":"2023-10-03T19:15:47.349962+0000","last_peered":"2023-10-03T19:15:47.349962+0000","last_clean":"2023-10-03T19:15:47.349962+0000","last_became_active":"2023-10-03T19:15:46.395999+0000","last_became_peered":"2023-10-03T19:15:46.395999+0000","last_unstale":"2023-10-03T19:15:47.349962+0000","last_undegraded":"2023-10-03T19:15:47.349962+0000","last_fullsized":"2023-10-03T19:15:47.349962+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:33:27.851221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.380703+0000","last_change":"2023-10-03T19:15:45.835409+0000","last_active":"2023-10-03T19:15:46.380703+0000","last_peered":"2023-10-03T19:15:46.380703+0000","last_clean":"2023-10-03T19:15:46.380703+0000","last_became_active":"2023-10-03T19:15:45.835194+0000","last_became_peered":"2023-10-03T19:15:45.835194+0000","last_unstale":"2023-10-03T19:15:46.380703+0000","last_undegraded":"2023-10-03T19:15:46.380703+0000","last_fullsized":"2023-10-03T19:15:46.380703+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:07:20.104117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.392807+0000","last_change":"2023-10-03T19:15:46.388333+0000","last_active":"2023-10-03T19:15:46.392807+0000","last_peered":"2023-10-03T19:15:46.392807+0000","last_clean":"2023-10-03T19:15:46.392807+0000","last_became_active":"2023-10-03T19:15:46.387577+0000","last_became_peered":"2023-10-03T19:15:46.387577+0000","last_unstale":"2023-10-03T19:15:46.392807+0000","last_undegraded":"2023-10-03T19:15:46.392807+0000","last_fullsized":"2023-10-03T19:15:46.392807+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:10:19.340333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-03T19:15:45.850843+0000","last_change":"2023-10-03T19:15:45.846961+0000","last_active":"2023-10-03T19:15:45.850843+0000","last_peered":"2023-10-03T19:15:45.850843+0000","last_clean":"2023-10-03T19:15:45.850843+0000","last_became_active":"2023-10-03T19:15:45.845959+0000","last_became_peered":"2023-10-03T19:15:45.845959+0000","last_unstale":"2023-10-03T19:15:45.850843+0000","last_undegraded":"2023-10-03T19:15:45.850843+0000","last_fullsized":"2023-10-03T19:15:45.850843+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:04:52.996015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160520+0000","last_change":"2023-10-03T19:15:46.375168+0000","last_active":"2023-10-03T19:15:48.160520+0000","last_peered":"2023-10-03T19:15:48.160520+0000","last_clean":"2023-10-03T19:15:48.160520+0000","last_became_active":"2023-10-03T19:15:46.374822+0000","last_became_peered":"2023-10-03T19:15:46.374822+0000","last_unstale":"2023-10-03T19:15:48.160520+0000","last_undegraded":"2023-10-03T19:15:48.160520+0000","last_fullsized":"2023-10-03T19:15:48.160520+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:04:50.606893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159333+0000","last_change":"2023-10-03T19:15:45.843525+0000","last_active":"2023-10-03T19:15:48.159333+0000","last_peered":"2023-10-03T19:15:48.159333+0000","last_clean":"2023-10-03T19:15:48.159333+0000","last_became_active":"2023-10-03T19:15:45.843111+0000","last_became_peered":"2023-10-03T19:15:45.843111+0000","last_unstale":"2023-10-03T19:15:48.159333+0000","last_undegraded":"2023-10-03T19:15:48.159333+0000","last_fullsized":"2023-10-03T19:15:48.159333+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:59:15.785799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.351998+0000","last_change":"2023-10-03T19:15:46.349592+0000","last_active":"2023-10-03T19:15:46.351998+0000","last_peered":"2023-10-03T19:15:46.351998+0000","last_clean":"2023-10-03T19:15:46.351998+0000","last_became_active":"2023-10-03T19:15:46.349264+0000","last_became_peered":"2023-10-03T19:15:46.349264+0000","last_unstale":"2023-10-03T19:15:46.351998+0000","last_undegraded":"2023-10-03T19:15:46.351998+0000","last_fullsized":"2023-10-03T19:15:46.351998+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:31:17.364939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.342355+0000","last_change":"2023-10-03T19:15:45.845501+0000","last_active":"2023-10-03T19:15:46.342355+0000","last_peered":"2023-10-03T19:15:46.342355+0000","last_clean":"2023-10-03T19:15:46.342355+0000","last_became_active":"2023-10-03T19:15:45.845069+0000","last_became_peered":"2023-10-03T19:15:45.845069+0000","last_unstale":"2023-10-03T19:15:46.342355+0000","last_undegraded":"2023-10-03T19:15:46.342355+0000","last_fullsized":"2023-10-03T19:15:46.342355+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:39:26.716817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.403923+0000","last_change":"2023-10-03T19:15:46.401220+0000","last_active":"2023-10-03T19:15:46.403923+0000","last_peered":"2023-10-03T19:15:46.403923+0000","last_clean":"2023-10-03T19:15:46.403923+0000","last_became_active":"2023-10-03T19:15:46.400309+0000","last_became_peered":"2023-10-03T19:15:46.400309+0000","last_unstale":"2023-10-03T19:15:46.403923+0000","last_undegraded":"2023-10-03T19:15:46.403923+0000","last_fullsized":"2023-10-03T19:15:46.403923+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:23:02.389649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"48'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.761698+0000","last_change":"2023-10-03T19:15:45.855576+0000","last_active":"2023-10-03T19:15:48.761698+0000","last_peered":"2023-10-03T19:15:48.761698+0000","last_clean":"2023-10-03T19:15:48.761698+0000","last_became_active":"2023-10-03T19:15:45.855189+0000","last_became_peered":"2023-10-03T19:15:45.855189+0000","last_unstale":"2023-10-03T19:15:48.761698+0000","last_undegraded":"2023-10-03T19:15:48.761698+0000","last_fullsized":"2023-10-03T19:15:48.761698+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:03:22.555251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":216,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.345374+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:15:46.345374+0000","last_peered":"2023-10-03T19:15:46.345374+0000","last_clean":"2023-10-03T19:15:46.345374+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:15:46.345374+0000","last_undegraded":"2023-10-03T19:15:46.345374+0000","last_fullsized":"2023-10-03T19:15:46.345374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:03:45.985767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349442+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:15:47.349442+0000","last_peered":"2023-10-03T19:15:47.349442+0000","last_clean":"2023-10-03T19:15:47.349442+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:15:47.349442+0000","last_undegraded":"2023-10-03T19:15:47.349442+0000","last_fullsized":"2023-10-03T19:15:47.349442+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:07:52.226240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.355815+0000","last_change":"2023-10-03T19:15:46.354378+0000","last_active":"2023-10-03T19:15:46.355815+0000","last_peered":"2023-10-03T19:15:46.355815+0000","last_clean":"2023-10-03T19:15:46.355815+0000","last_became_active":"2023-10-03T19:15:46.354096+0000","last_became_peered":"2023-10-03T19:15:46.354096+0000","last_unstale":"2023-10-03T19:15:46.355815+0000","last_undegraded":"2023-10-03T19:15:46.355815+0000","last_fullsized":"2023-10-03T19:15:46.355815+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:20:43.270219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.353013+0000","last_change":"2023-10-03T19:15:45.860418+0000","last_active":"2023-10-03T19:15:46.353013+0000","last_peered":"2023-10-03T19:15:46.353013+0000","last_clean":"2023-10-03T19:15:46.353013+0000","last_became_active":"2023-10-03T19:15:45.859327+0000","last_became_peered":"2023-10-03T19:15:45.859327+0000","last_unstale":"2023-10-03T19:15:46.353013+0000","last_undegraded":"2023-10-03T19:15:46.353013+0000","last_fullsized":"2023-10-03T19:15:46.353013+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:05:40.995560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.345054+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:15:46.345054+0000","last_peered":"2023-10-03T19:15:46.345054+0000","last_clean":"2023-10-03T19:15:46.345054+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:15:46.345054+0000","last_undegraded":"2023-10-03T19:15:46.345054+0000","last_fullsized":"2023-10-03T19:15:46.345054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:26:32.661519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.826755+0000","last_change":"2023-10-03T19:15:45.826755+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.826755+0000","last_undegraded":"2023-10-03T19:15:45.826755+0000","last_fullsized":"2023-10-03T19:15:45.826755+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160423+0000","last_change":"2023-10-03T19:15:45.850638+0000","last_active":"2023-10-03T19:15:48.160423+0000","last_peered":"2023-10-03T19:15:48.160423+0000","last_clean":"2023-10-03T19:15:48.160423+0000","last_became_active":"2023-10-03T19:15:45.850362+0000","last_became_peered":"2023-10-03T19:15:45.850362+0000","last_unstale":"2023-10-03T19:15:48.160423+0000","last_undegraded":"2023-10-03T19:15:48.160423+0000","last_fullsized":"2023-10-03T19:15:48.160423+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:59:04.384674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.343042+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:15:46.343042+0000","last_peered":"2023-10-03T19:15:46.343042+0000","last_clean":"2023-10-03T19:15:46.343042+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:15:46.343042+0000","last_undegraded":"2023-10-03T19:15:46.343042+0000","last_fullsized":"2023-10-03T19:15:46.343042+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:53:22.657236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.348353+0000","last_change":"2023-10-03T19:15:46.396444+0000","last_active":"2023-10-03T19:15:47.348353+0000","last_peered":"2023-10-03T19:15:47.348353+0000","last_clean":"2023-10-03T19:15:47.348353+0000","last_became_active":"2023-10-03T19:15:46.395657+0000","last_became_peered":"2023-10-03T19:15:46.395657+0000","last_unstale":"2023-10-03T19:15:47.348353+0000","last_undegraded":"2023-10-03T19:15:47.348353+0000","last_fullsized":"2023-10-03T19:15:47.348353+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:02:07.926380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.385928+0000","last_change":"2023-10-03T19:15:45.858616+0000","last_active":"2023-10-03T19:15:46.385928+0000","last_peered":"2023-10-03T19:15:46.385928+0000","last_clean":"2023-10-03T19:15:46.385928+0000","last_became_active":"2023-10-03T19:15:45.858088+0000","last_became_peered":"2023-10-03T19:15:45.858088+0000","last_unstale":"2023-10-03T19:15:46.385928+0000","last_undegraded":"2023-10-03T19:15:46.385928+0000","last_fullsized":"2023-10-03T19:15:46.385928+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:38:02.669888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.347923+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:15:47.347923+0000","last_peered":"2023-10-03T19:15:47.347923+0000","last_clean":"2023-10-03T19:15:47.347923+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:15:47.347923+0000","last_undegraded":"2023-10-03T19:15:47.347923+0000","last_fullsized":"2023-10-03T19:15:47.347923+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:46:54.785846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160288+0000","last_change":"2023-10-03T19:15:46.360983+0000","last_active":"2023-10-03T19:15:48.160288+0000","last_peered":"2023-10-03T19:15:48.160288+0000","last_clean":"2023-10-03T19:15:48.160288+0000","last_became_active":"2023-10-03T19:15:46.360549+0000","last_became_peered":"2023-10-03T19:15:46.360549+0000","last_unstale":"2023-10-03T19:15:48.160288+0000","last_undegraded":"2023-10-03T19:15:48.160288+0000","last_fullsized":"2023-10-03T19:15:48.160288+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:18:21.999198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.343867+0000","last_change":"2023-10-03T19:15:45.849036+0000","last_active":"2023-10-03T19:15:46.343867+0000","last_peered":"2023-10-03T19:15:46.343867+0000","last_clean":"2023-10-03T19:15:46.343867+0000","last_became_active":"2023-10-03T19:15:45.848308+0000","last_became_peered":"2023-10-03T19:15:45.848308+0000","last_unstale":"2023-10-03T19:15:46.343867+0000","last_undegraded":"2023-10-03T19:15:46.343867+0000","last_fullsized":"2023-10-03T19:15:46.343867+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:12:13.692765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":62,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.340199+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:15:46.340199+0000","last_peered":"2023-10-03T19:15:46.340199+0000","last_clean":"2023-10-03T19:15:46.340199+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:15:46.340199+0000","last_undegraded":"2023-10-03T19:15:46.340199+0000","last_fullsized":"2023-10-03T19:15:46.340199+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:05:01.061886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.823070+0000","last_change":"2023-10-03T19:15:45.823070+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.823070+0000","last_undegraded":"2023-10-03T19:15:45.823070+0000","last_fullsized":"2023-10-03T19:15:45.823070+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.348664+0000","last_change":"2023-10-03T19:15:45.834172+0000","last_active":"2023-10-03T19:15:47.348664+0000","last_peered":"2023-10-03T19:15:47.348664+0000","last_clean":"2023-10-03T19:15:47.348664+0000","last_became_active":"2023-10-03T19:15:45.833415+0000","last_became_peered":"2023-10-03T19:15:45.833415+0000","last_unstale":"2023-10-03T19:15:47.348664+0000","last_undegraded":"2023-10-03T19:15:47.348664+0000","last_fullsized":"2023-10-03T19:15:47.348664+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:41:46.377632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.353252+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:15:46.353252+0000","last_peered":"2023-10-03T19:15:46.353252+0000","last_clean":"2023-10-03T19:15:46.353252+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:15:46.353252+0000","last_undegraded":"2023-10-03T19:15:46.353252+0000","last_fullsized":"2023-10-03T19:15:46.353252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:45:00.349234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160091+0000","last_change":"2023-10-03T19:15:46.365576+0000","last_active":"2023-10-03T19:15:48.160091+0000","last_peered":"2023-10-03T19:15:48.160091+0000","last_clean":"2023-10-03T19:15:48.160091+0000","last_became_active":"2023-10-03T19:15:46.365249+0000","last_became_peered":"2023-10-03T19:15:46.365249+0000","last_unstale":"2023-10-03T19:15:48.160091+0000","last_undegraded":"2023-10-03T19:15:48.160091+0000","last_fullsized":"2023-10-03T19:15:48.160091+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:10:27.658304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-03T19:15:45.850894+0000","last_change":"2023-10-03T19:15:45.848356+0000","last_active":"2023-10-03T19:15:45.850894+0000","last_peered":"2023-10-03T19:15:45.850894+0000","last_clean":"2023-10-03T19:15:45.850894+0000","last_became_active":"2023-10-03T19:15:45.847882+0000","last_became_peered":"2023-10-03T19:15:45.847882+0000","last_unstale":"2023-10-03T19:15:45.850894+0000","last_undegraded":"2023-10-03T19:15:45.850894+0000","last_fullsized":"2023-10-03T19:15:45.850894+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:20:42.266260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":62,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.341745+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:15:46.341745+0000","last_peered":"2023-10-03T19:15:46.341745+0000","last_clean":"2023-10-03T19:15:46.341745+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:15:46.341745+0000","last_undegraded":"2023-10-03T19:15:46.341745+0000","last_fullsized":"2023-10-03T19:15:46.341745+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:33:11.676416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349987+0000","last_change":"2023-10-03T19:15:46.396416+0000","last_active":"2023-10-03T19:15:47.349987+0000","last_peered":"2023-10-03T19:15:47.349987+0000","last_clean":"2023-10-03T19:15:47.349987+0000","last_became_active":"2023-10-03T19:15:46.395693+0000","last_became_peered":"2023-10-03T19:15:46.395693+0000","last_unstale":"2023-10-03T19:15:47.349987+0000","last_undegraded":"2023-10-03T19:15:47.349987+0000","last_fullsized":"2023-10-03T19:15:47.349987+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:18:43.523711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-03T19:15:45.849652+0000","last_change":"2023-10-03T19:15:45.846558+0000","last_active":"2023-10-03T19:15:45.849652+0000","last_peered":"2023-10-03T19:15:45.849652+0000","last_clean":"2023-10-03T19:15:45.849652+0000","last_became_active":"2023-10-03T19:15:45.845284+0000","last_became_peered":"2023-10-03T19:15:45.845284+0000","last_unstale":"2023-10-03T19:15:45.849652+0000","last_undegraded":"2023-10-03T19:15:45.849652+0000","last_fullsized":"2023-10-03T19:15:45.849652+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:17:34.420808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.371863+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:15:46.371863+0000","last_peered":"2023-10-03T19:15:46.371863+0000","last_clean":"2023-10-03T19:15:46.371863+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:15:46.371863+0000","last_undegraded":"2023-10-03T19:15:46.371863+0000","last_fullsized":"2023-10-03T19:15:46.371863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:37:29.746184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25,"ondisk_log_size":25,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509484,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24228,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":23616,"kb_avail":94347612,"statfs":{"total":96636764160,"available":96611954688,"internally_reserved":0,"allocated":618496,"data_stored":825786,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":24182784},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.93799999999999994,"15min":0.95399999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2030000000000001,"5min":4.0469999999999997,"15min":4.0469999999999997},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82699999999999996,"15min":0.80200000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.05,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.82599999999999996}]},{"osd":1,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.97599999999999998,"15min":1.038},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.169,"5min":3.8239999999999998,"15min":3.8239999999999998},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.878,"15min":0.85699999999999998},"min":{"1min":0.66300000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1899999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.65800000000000003}]},{"osd":2,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":0.91400000000000003,"15min":0.86199999999999999},"min":{"1min":0.66100000000000003,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":6.0449999999999999,"5min":6.0449999999999999,"15min":6.0449999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.0129999999999999,"15min":1.0429999999999999},"min":{"1min":0.60599999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.252,"5min":3.98,"15min":3.98},"last":0.79400000000000004}]},{"osd":3,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":0.98699999999999999,"15min":0.94099999999999995},"min":{"1min":0.79200000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":6.125,"5min":6.125,"15min":6.125},"last":1.01},{"interface":"front","average":{"1min":0.96099999999999997,"5min":1.0900000000000001,"15min":1.1299999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.2070000000000001,"5min":3.9140000000000001,"15min":3.9140000000000001},"last":0.61899999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":1.0940000000000001,"15min":1.1799999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1970000000000001,"5min":5.1130000000000004,"15min":5.1130000000000004},"last":1.036},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.0429999999999999,"15min":1.0349999999999999},"min":{"1min":0.67500000000000004,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":6.3520000000000003,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":0.755}]},{"osd":5,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.198,"15min":1.2889999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2889999999999999,"5min":5.1859999999999999,"15min":5.1859999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.125,"15min":1.159},"min":{"1min":0.73299999999999998,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.2949999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":0.88300000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.099,"15min":1.1020000000000001},"min":{"1min":0.80800000000000005,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.349,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.2010000000000001,"15min":1.1930000000000001},"min":{"1min":0.88,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":6.1580000000000004,"5min":6.1580000000000004,"15min":6.1580000000000004},"last":1.077}]}]},{"osd":6,"up_from":15,"seq":64424509484,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13792,"kb_used_data":536,"kb_used_omap":0,"kb_used_meta":13248,"kb_avail":94358048,"statfs":{"total":96636764160,"available":96622641152,"internally_reserved":0,"allocated":548864,"data_stored":234782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13565952},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.82899999999999996,"15min":0.81699999999999995},"min":{"1min":0.55800000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.111,"5min":1.504,"15min":1.504},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.89400000000000002,"15min":0.88300000000000001},"min":{"1min":0.69399999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1739999999999999,"5min":1.839,"15min":1.839},"last":0.56699999999999995}]},{"osd":1,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.84799999999999998,"15min":0.83799999999999997},"min":{"1min":0.63600000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.117,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.88700000000000001,"15min":0.879},"min":{"1min":0.58899999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1479999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.80200000000000005}]},{"osd":2,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.89000000000000001,"15min":0.86499999999999999},"min":{"1min":0.745,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0940000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91700000000000004,"15min":0.92500000000000004},"min":{"1min":0.66300000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2250000000000001,"5min":1.546,"15min":1.546},"last":0.83799999999999997}]},{"osd":3,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97999999999999998,"15min":0.98599999999999999},"min":{"1min":0.64700000000000002,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1719999999999999,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.747},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90800000000000003,"15min":0.90900000000000003},"min":{"1min":0.68999999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0580000000000001,"5min":2.121,"15min":2.121},"last":0.69399999999999995}]},{"osd":4,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.999,"15min":1.0349999999999999},"min":{"1min":0.68500000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.147,"5min":1.95,"15min":1.95},"last":1.083},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.056,"15min":1.0980000000000001},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.216,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.90600000000000003}]},{"osd":5,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":1.004,"15min":1.03},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.153,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.008,"5min":1.0920000000000001,"15min":1.1240000000000001},"min":{"1min":0.68300000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.1879999999999999,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.123}]},{"osd":7,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.1060000000000001,"15min":1.1259999999999999},"min":{"1min":0.73299999999999998,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.234,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0820000000000001,"15min":1.1000000000000001},"min":{"1min":0.86199999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.194,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.004}]}]},{"osd":4,"up_from":15,"seq":64424509485,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14560,"kb_used_data":536,"kb_used_omap":0,"kb_used_meta":14016,"kb_avail":94357280,"statfs":{"total":96636764160,"available":96621854720,"internally_reserved":0,"allocated":548864,"data_stored":235876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14352384},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.81299999999999994,"15min":0.78300000000000003},"min":{"1min":0.57299999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1279999999999999,"5min":1.258,"15min":1.258},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.83999999999999997,"15min":0.82599999999999996},"min":{"1min":0.56000000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.1459999999999999,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.80800000000000005}]},{"osd":1,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.93000000000000005,"15min":0.93500000000000005},"min":{"1min":0.68200000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.175,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.879,"15min":0.85499999999999998},"min":{"1min":0.59999999999999998,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.276,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.91200000000000003}]},{"osd":2,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.93000000000000005,"15min":0.91400000000000003},"min":{"1min":0.71399999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1040000000000001,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.002,"5min":0.96799999999999997,"15min":0.94499999999999995},"min":{"1min":0.78100000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2190000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.78400000000000003}]},{"osd":3,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.88600000000000001,"15min":0.874},"min":{"1min":0.76000000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.129,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0609999999999999,"15min":1.071},"min":{"1min":0.85999999999999999,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.216,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.73599999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":1.026,"15min":1.0620000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2050000000000001,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.99299999999999999,"15min":1.0149999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.1499999999999999,"5min":1.635,"15min":1.635},"last":0.94399999999999995}]},{"osd":6,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.1399999999999999,"15min":1.204},"min":{"1min":0.74299999999999999,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.2529999999999999,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.1539999999999999,"15min":1.1950000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.288,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":1.0009999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0680000000000001,"15min":1.0900000000000001},"min":{"1min":0.755,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.202,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.2070000000000001,"15min":1.2350000000000001},"min":{"1min":0.88700000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3180000000000001,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.85599999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509485,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14052,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":13504,"kb_avail":94357788,"statfs":{"total":96636764160,"available":96622374912,"internally_reserved":0,"allocated":552960,"data_stored":235694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13828096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.56499999999999995,"15min":0.52800000000000002},"min":{"1min":0.36599999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.86499999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.65800000000000003,"15min":0.61699999999999999},"min":{"1min":0.496,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.034,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":1.177}]},{"osd":1,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.67600000000000005,"15min":0.621},"min":{"1min":0.56699999999999995,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1639999999999999,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.63200000000000001,"15min":0.58999999999999997},"min":{"1min":0.47899999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.70099999999999996}]},{"osd":3,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.67300000000000004,"15min":0.623},"min":{"1min":0.52900000000000003,"5min":0.224,"15min":0.224},"max":{"1min":1.0269999999999999,"5min":1.246,"15min":1.246},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.78200000000000003,"15min":0.72199999999999998},"min":{"1min":0.60599999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.93799999999999994}]},{"osd":4,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.878,"15min":0.84399999999999997},"min":{"1min":0.625,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.23,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.071,"5min":0.95499999999999996,"15min":0.91300000000000003},"min":{"1min":0.67000000000000004,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.347,"5min":1.399,"15min":1.399},"last":1.0529999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.90800000000000003,"15min":0.86199999999999999},"min":{"1min":0.70999999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.091,"5min":0.99099999999999999,"15min":0.93999999999999995},"min":{"1min":0.76200000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.2549999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.099}]},{"osd":6,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.93799999999999994,"15min":0.91300000000000003},"min":{"1min":0.82199999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.131},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.002,"15min":0.96399999999999997},"min":{"1min":0.68799999999999994,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3899999999999999,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.96299999999999997}]},{"osd":7,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.054,"15min":1.004},"min":{"1min":0.72299999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4179999999999999,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.272},{"interface":"front","average":{"1min":1.111,"5min":0.99099999999999999,"15min":0.95699999999999996},"min":{"1min":0.77800000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.98099999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509484,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13860,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":13312,"kb_avail":94357980,"statfs":{"total":96636764160,"available":96622571520,"internally_reserved":0,"allocated":552960,"data_stored":235454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13631488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.57599999999999996,"15min":0.54500000000000004},"min":{"1min":0.51400000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.58299999999999996,"15min":0.50900000000000001},"min":{"1min":0.503,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.0309999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.45600000000000002}]},{"osd":2,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.59099999999999997,"15min":0.54700000000000004},"min":{"1min":0.55200000000000005,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.88,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.71799999999999997,"15min":0.66200000000000003},"min":{"1min":0.72699999999999998,"5min":0.312,"15min":0.312},"max":{"1min":1.1439999999999999,"5min":1.169,"15min":1.169},"last":0.51000000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.68799999999999994,"15min":0.63100000000000001},"min":{"1min":0.59899999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.091,"5min":1.27,"15min":1.27},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.64300000000000002,"15min":0.57899999999999996},"min":{"1min":0.55600000000000005,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0549999999999999,"5min":1.27,"15min":1.27},"last":0.59699999999999998}]},{"osd":4,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.83399999999999996,"15min":0.79800000000000004},"min":{"1min":0.70399999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.143,"5min":1.202,"15min":1.202},"last":0.72099999999999997},{"interface":"front","average":{"1min":1.0349999999999999,"5min":0.91800000000000004,"15min":0.88800000000000001},"min":{"1min":0.84899999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.86799999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":0.91200000000000003,"15min":0.85799999999999998},"min":{"1min":0.72499999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.339,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.747},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.88900000000000001,"15min":0.84899999999999998},"min":{"1min":0.82499999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.284,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.83299999999999996}]},{"osd":6,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":0.96999999999999997,"15min":0.92200000000000004},"min":{"1min":0.96499999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2589999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.028,"5min":0.94099999999999995,"15min":0.89100000000000001},"min":{"1min":0.80400000000000005,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2270000000000001,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.88800000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":0.99099999999999999,"15min":0.93600000000000005},"min":{"1min":0.83399999999999996,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.95699999999999996,"15min":0.89900000000000002},"min":{"1min":0.85399999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3759999999999999,"5min":1.649,"15min":1.649},"last":0.95399999999999996}]}]},{"osd":3,"up_from":14,"seq":60129542188,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22980,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":22464,"kb_avail":94348860,"statfs":{"total":96636764160,"available":96613232640,"internally_reserved":0,"allocated":520192,"data_stored":221538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23003136},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.60899999999999999,"15min":0.57099999999999995},"min":{"1min":0.318,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.67100000000000004,"15min":0.64300000000000002},"min":{"1min":0.34999999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.198,"5min":1.236,"15min":1.236},"last":0.621}]},{"osd":1,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.65600000000000003,"15min":0.624},"min":{"1min":0.41999999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.95699999999999996,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.70099999999999996,"15min":0.66100000000000003},"min":{"1min":0.435,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.028,"5min":1.222,"15min":1.222},"last":1.006}]},{"osd":2,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.751,"15min":0.70699999999999996},"min":{"1min":0.45900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0740000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.67600000000000005,"15min":0.626},"min":{"1min":0.33600000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.0780000000000001,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":1.177}]},{"osd":4,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.93300000000000005,"15min":0.91100000000000003},"min":{"1min":0.70399999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.411,"5min":1.496,"15min":1.496},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.0620000000000001,"5min":0.95899999999999996,"15min":0.93200000000000005},"min":{"1min":0.754,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":1.1160000000000001}]},{"osd":5,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.90500000000000003,"15min":0.878},"min":{"1min":0.75,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.365,"5min":1.51,"15min":1.51},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.014,"15min":0.996},"min":{"1min":0.74099999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.0469999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.94699999999999995,"15min":0.92000000000000004},"min":{"1min":0.67200000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2450000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.091,"5min":1.024,"15min":0.98699999999999999},"min":{"1min":0.77600000000000002,"5min":0.625,"15min":0.625},"max":{"1min":1.323,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.147}]},{"osd":7,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.032,"15min":1.004},"min":{"1min":0.79100000000000004,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.4470000000000001,"5min":1.597,"15min":1.597},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.0489999999999999,"15min":1.0169999999999999},"min":{"1min":0.71799999999999997,"5min":0.623,"15min":0.623},"max":{"1min":1.377,"5min":1.708,"15min":1.708},"last":1.264}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15272,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":14720,"kb_avail":94356568,"statfs":{"total":96636764160,"available":96621125632,"internally_reserved":0,"allocated":557056,"data_stored":241947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15073280},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.84299999999999997,"15min":0.82099999999999995},"min":{"1min":0.55900000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2230000000000001,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.85899999999999999,"15min":0.85299999999999998},"min":{"1min":0.65700000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1499999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.86899999999999999}]},{"osd":1,"last update":"Tue Oct 3 19:15:28 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.85299999999999998,"15min":0.83399999999999996},"min":{"1min":0.628,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.93000000000000005,"15min":0.92900000000000005},"min":{"1min":0.58699999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1799999999999999,"5min":1.514,"15min":1.514},"last":0.76300000000000001}]},{"osd":2,"last update":"Tue Oct 3 19:15:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.91400000000000003,"15min":0.90000000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3280000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.90600000000000003,"15min":0.89600000000000002},"min":{"1min":0.60999999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1599999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.84299999999999997}]},{"osd":3,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.92300000000000004,"15min":0.92500000000000004},"min":{"1min":0.68899999999999995,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.149,"5min":1.304,"15min":1.304},"last":1.075},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.038,"15min":1.0289999999999999},"min":{"1min":0.89500000000000002,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.2490000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.91700000000000004}]},{"osd":4,"last update":"Tue Oct 3 19:15:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97399999999999998,"15min":0.97199999999999998},"min":{"1min":0.66400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.999,"5min":1.0149999999999999,"15min":1.0369999999999999},"min":{"1min":0.72099999999999997,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.335,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.63400000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:15:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.01,"15min":1.038},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.266,"5min":1.462,"15min":1.462},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.133,"15min":1.1419999999999999},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":0.81100000000000005}]},{"osd":7,"last update":"Tue Oct 3 19:15:28 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.079},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.381,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.129,"5min":1.1459999999999999,"15min":1.1539999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.357,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.1519999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15404,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":14784,"kb_avail":94356436,"statfs":{"total":96636764160,"available":96620990464,"internally_reserved":0,"allocated":626688,"data_stored":831207,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":15138816},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.61399999999999999,"15min":0.57999999999999996},"min":{"1min":0.47499999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.92800000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73399999999999999,"15min":0.71199999999999997},"min":{"1min":0.54900000000000004,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0800000000000001,"5min":1.27,"15min":1.27},"last":0.72899999999999998}]},{"osd":2,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.72499999999999998,"15min":0.71399999999999997},"min":{"1min":0.49199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.131,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70199999999999996,"15min":0.68999999999999995},"min":{"1min":0.44500000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.98199999999999998,"5min":1.548,"15min":1.548},"last":0.46800000000000003}]},{"osd":3,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.78300000000000003,"15min":0.72399999999999998},"min":{"1min":0.65900000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.75900000000000001,"15min":0.69599999999999995},"min":{"1min":0.51200000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.51000000000000001}]},{"osd":4,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.91200000000000003,"15min":0.90600000000000003},"min":{"1min":0.71299999999999997,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1539999999999999,"5min":1.355,"15min":1.355},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.048,"5min":1.034,"15min":1.022},"min":{"1min":0.82499999999999996,"5min":0.504,"15min":0.504},"max":{"1min":1.3140000000000001,"5min":1.508,"15min":1.508},"last":0.95599999999999996}]},{"osd":5,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0569999999999999,"15min":1.0449999999999999},"min":{"1min":0.85599999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.087,"5min":0.997,"15min":0.97399999999999998},"min":{"1min":0.82599999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.371,"5min":1.444,"15min":1.444},"last":0.93000000000000005}]},{"osd":6,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.034,"15min":1.014},"min":{"1min":0.77600000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.427,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.099,"5min":1.018,"15min":0.99199999999999999},"min":{"1min":0.83899999999999997,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.79700000000000004}]},{"osd":7,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.0660000000000001,"15min":1.036},"min":{"1min":0.90200000000000002,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.3919999999999999,"5min":1.407,"15min":1.407},"last":0.878},{"interface":"front","average":{"1min":1.149,"5min":1.0780000000000001,"15min":1.0600000000000001},"min":{"1min":0.78500000000000003,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.76300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:15:51.417 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:15:51.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5fbe23a640 1 Processor -- start 2023-10-03T19:15:51.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5fbe23a640 1 -- start start 2023-10-03T19:15:51.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5fbe23a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fb806d5b0 0x7f5fb814d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:51.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5fbe23a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb814d610 con 0x7f5fb80bb970 2023-10-03T19:15:51.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5fbe23a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb80a6870 con 0x7f5fb80a6140 2023-10-03T19:15:51.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5fbe23a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb806abb0 con 0x7f5fb806d5b0 2023-10-03T19:15:51.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5fb7fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5fb80bb970 0x7f5fb814ba70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50778/0 (socket says 172.21.15.45:50778) 2023-10-03T19:15:51.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5fb7fff640 1 -- 172.21.15.45:0/563745764 learned_addr learned my addr 172.21.15.45:0/563745764 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:15:51.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5fb77fe640 1 --2- 172.21.15.45:0/563745764 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fb806d5b0 0x7f5fb814d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:51.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5fb6ffd640 1 -- 172.21.15.45:0/563745764 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2906350741 0 0) 0x7f5fb814d610 con 0x7f5fb80bb970 2023-10-03T19:15:51.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5fb6ffd640 1 -- 172.21.15.45:0/563745764 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fa4003530 con 0x7f5fb80bb970 2023-10-03T19:15:51.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5fb6ffd640 1 -- 172.21.15.45:0/563745764 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2677979938 0 0) 0x7f5fa4003530 con 0x7f5fb80bb970 2023-10-03T19:15:51.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5fb6ffd640 1 -- 172.21.15.45:0/563745764 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fb806d5b0 msgr2=0x7f5fb814d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:51.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5fb6ffd640 1 --2- 172.21.15.45:0/563745764 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fb806d5b0 0x7f5fb814d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:51.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5fb6ffd640 1 -- 172.21.15.45:0/563745764 >> v1:172.21.15.79:6789/0 conn(0x7f5fb80a6140 legacy=0x7f5fb806d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:51.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5fb6ffd640 1 -- 172.21.15.45:0/563745764 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb80a6590 con 0x7f5fb80bb970 2023-10-03T19:15:51.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5fb6ffd640 1 -- 172.21.15.45:0/563745764 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f5fb0001680 con 0x7f5fb80bb970 2023-10-03T19:15:51.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5fb6ffd640 1 -- 172.21.15.45:0/563745764 >> v1:172.21.15.45:6789/0 conn(0x7f5fb80bb970 legacy=0x7f5fb814ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:51.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5fb6ffd640 1 --2- 172.21.15.45:0/563745764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fa40039b0 0x7f5fa4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:51.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5fb6ffd640 1 --2- 172.21.15.45:0/563745764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fa40047d0 0x7f5fa4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:51.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5fb6ffd640 1 --2- 172.21.15.45:0/563745764 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fb806d5b0 0x7f5fa4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:51.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5fb6ffd640 1 -- 172.21.15.45:0/563745764 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa400ba40 con 0x7f5fa40047d0 2023-10-03T19:15:51.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5fb6ffd640 1 -- 172.21.15.45:0/563745764 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa400bb80 con 0x7f5fa40039b0 2023-10-03T19:15:51.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5fb6ffd640 1 -- 172.21.15.45:0/563745764 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa400bd10 con 0x7f5fb806d5b0 2023-10-03T19:15:51.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5faeffd640 1 --2- 172.21.15.45:0/563745764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fa40047d0 0x7f5fa4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:51.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5fb77fe640 1 --2- 172.21.15.45:0/563745764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fa40039b0 0x7f5fa4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:51.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5fb7fff640 1 --2- 172.21.15.45:0/563745764 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fb806d5b0 0x7f5fa4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:51.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5faeffd640 1 -- 172.21.15.45:0/563745764 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fb806d5b0 msgr2=0x7f5fa4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:51.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5faeffd640 1 --2- 172.21.15.45:0/563745764 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fb806d5b0 0x7f5fa4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:51.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5faeffd640 1 -- 172.21.15.45:0/563745764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fa40039b0 msgr2=0x7f5fa4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:51.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5faeffd640 1 --2- 172.21.15.45:0/563745764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fa40039b0 0x7f5fa4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:51.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.551+0000 7f5faeffd640 1 -- 172.21.15.45:0/563745764 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa4003530 con 0x7f5fa40047d0 2023-10-03T19:15:51.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.555+0000 7f5faeffd640 1 --2- 172.21.15.45:0/563745764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fa40047d0 0x7f5fa4004c40 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0001750 tx=0x7f5fa001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a4b58708813b03 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:51.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.555+0000 7f5fb6ffd640 1 -- 172.21.15.45:0/563745764 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa00052d0 con 0x7f5fa40047d0 2023-10-03T19:15:51.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.555+0000 7f5fb6ffd640 1 -- 172.21.15.45:0/563745764 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa00a7050 con 0x7f5fa40047d0 2023-10-03T19:15:51.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.555+0000 7f5fb6ffd640 1 -- 172.21.15.45:0/563745764 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa0003600 con 0x7f5fa40047d0 2023-10-03T19:15:51.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.555+0000 7f5fbe23a640 1 -- 172.21.15.45:0/563745764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fa40047d0 msgr2=0x7f5fa4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:51.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.555+0000 7f5fbe23a640 1 --2- 172.21.15.45:0/563745764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fa40047d0 0x7f5fa4004c40 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0001750 tx=0x7f5fa001c3c0 comp rx=0 tx=0).stop 2023-10-03T19:15:51.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.555+0000 7f5fb7fff640 1 -- 172.21.15.45:0/563745764 reap_dead start 2023-10-03T19:15:51.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.555+0000 7f5fbe23a640 1 -- 172.21.15.45:0/563745764 shutdown_connections 2023-10-03T19:15:51.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.555+0000 7f5fbe23a640 1 -- 172.21.15.45:0/563745764 >> 172.21.15.45:0/563745764 conn(0x7f5fb80c1600 msgr2=0x7f5fb80c1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:51.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.555+0000 7f5fbe23a640 1 -- 172.21.15.45:0/563745764 shutdown_connections 2023-10-03T19:15:51.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.555+0000 7f5fbe23a640 1 -- 172.21.15.45:0/563745764 wait complete. 2023-10-03T19:15:51.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.555+0000 7f5fbe23a640 1 Processor -- start 2023-10-03T19:15:51.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.555+0000 7f5fbe23a640 1 -- start start 2023-10-03T19:15:51.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.559+0000 7f5fbe23a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fa40047d0 0x7f5fb81e1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:51.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.559+0000 7f5fbe23a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb81d5c30 0x7f5fb814abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:51.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.559+0000 7f5fbe23a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fb81d60d0 0x7f5fb8147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:51.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.559+0000 7f5fbe23a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb81455c0 con 0x7f5fb81d5c30 2023-10-03T19:15:51.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.559+0000 7f5fbe23a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb80b6800 con 0x7f5fb81d60d0 2023-10-03T19:15:51.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.559+0000 7f5fbe23a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb81e2080 con 0x7f5fa40047d0 2023-10-03T19:15:51.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.559+0000 7f5faeffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb81d5c30 0x7f5fb814abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:51.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.559+0000 7f5faeffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb81d5c30 0x7f5fb814abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37768/0 (socket says 172.21.15.45:37768) 2023-10-03T19:15:51.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.559+0000 7f5faeffd640 1 -- 172.21.15.45:0/1810022205 learned_addr learned my addr 172.21.15.45:0/1810022205 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:51.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.559+0000 7f5fb77fe640 1 --2- 172.21.15.45:0/1810022205 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fa40047d0 0x7f5fb81e1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:51.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.559+0000 7f5fb7fff640 1 --2- 172.21.15.45:0/1810022205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fb81d60d0 0x7f5fb8147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:51.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.559+0000 7f5faeffd640 1 -- 172.21.15.45:0/1810022205 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fa40047d0 msgr2=0x7f5fb81e1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:51.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.559+0000 7f5faeffd640 1 --2- 172.21.15.45:0/1810022205 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fa40047d0 0x7f5fb81e1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:51.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.559+0000 7f5faeffd640 1 -- 172.21.15.45:0/1810022205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fb81d60d0 msgr2=0x7f5fb8147ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:51.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.559+0000 7f5faeffd640 1 --2- 172.21.15.45:0/1810022205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fb81d60d0 0x7f5fb8147ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:51.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.559+0000 7f5faeffd640 1 -- 172.21.15.45:0/1810022205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb80a55c0 con 0x7f5fb81d5c30 2023-10-03T19:15:51.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.559+0000 7f5fb77fe640 1 --2- 172.21.15.45:0/1810022205 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fa40047d0 0x7f5fb81e1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:15:51.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.559+0000 7f5faeffd640 1 --2- 172.21.15.45:0/1810022205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb81d5c30 0x7f5fb814abf0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5fa001c8a0 tx=0x7f5fa4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:51.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.559+0000 7f5fb4ff9640 1 -- 172.21.15.45:0/1810022205 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa0000ee0 con 0x7f5fb81d5c30 2023-10-03T19:15:51.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.559+0000 7f5fb4ff9640 1 -- 172.21.15.45:0/1810022205 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa0007680 con 0x7f5fb81d5c30 2023-10-03T19:15:51.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.559+0000 7f5fb4ff9640 1 -- 172.21.15.45:0/1810022205 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa0006a20 con 0x7f5fb81d5c30 2023-10-03T19:15:51.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.559+0000 7f5fbe23a640 1 -- 172.21.15.45:0/1810022205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb806a410 con 0x7f5fb81d5c30 2023-10-03T19:15:51.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.559+0000 7f5fbe23a640 1 -- 172.21.15.45:0/1810022205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb806a6f0 con 0x7f5fb81d5c30 2023-10-03T19:15:51.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.559+0000 7f5fbe23a640 1 -- 172.21.15.45:0/1810022205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb8147800 con 0x7f5fb81d5c30 2023-10-03T19:15:51.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.559+0000 7f5fb4ff9640 1 -- 172.21.15.45:0/1810022205 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5fa0006b80 con 0x7f5fb81d5c30 2023-10-03T19:15:51.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.559+0000 7f5fb4ff9640 1 --2- 172.21.15.45:0/1810022205 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5f98066280 0x7f5f98068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:51.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.559+0000 7f5fb4ff9640 1 -- 172.21.15.45:0/1810022205 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5fa011e640 con 0x7f5fb81d5c30 2023-10-03T19:15:51.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.559+0000 7f5fb77fe640 1 --2- 172.21.15.45:0/1810022205 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5f98066280 0x7f5f98068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:51.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.563+0000 7f5fb77fe640 1 --2- 172.21.15.45:0/1810022205 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5f98066280 0x7f5f98068730 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5fa80074d0 tx=0x7f5fa800b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:51.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.563+0000 7f5fb4ff9640 1 -- 172.21.15.45:0/1810022205 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5fa00ebba0 con 0x7f5fb81d5c30 2023-10-03T19:15:51.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.715+0000 7f5fbe23a640 1 -- 172.21.15.45:0/1810022205 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5fb8147800 con 0x7f5f98066280 2023-10-03T19:15:51.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.739+0000 7f5fb4ff9640 1 -- 172.21.15.45:0/1810022205 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309401 (secure 0 0 0) 0x7f5fb8147800 con 0x7f5f98066280 2023-10-03T19:15:51.745 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:15:51.747 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:15:51.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.739+0000 7f5fbe23a640 1 -- 172.21.15.45:0/1810022205 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5f98066280 msgr2=0x7f5f98068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:51.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.739+0000 7f5fbe23a640 1 --2- 172.21.15.45:0/1810022205 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5f98066280 0x7f5f98068730 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5fa80074d0 tx=0x7f5fa800b040 comp rx=0 tx=0).stop 2023-10-03T19:15:51.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.739+0000 7f5fbe23a640 1 -- 172.21.15.45:0/1810022205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb81d5c30 msgr2=0x7f5fb814abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:51.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.739+0000 7f5fbe23a640 1 --2- 172.21.15.45:0/1810022205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb81d5c30 0x7f5fb814abf0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5fa001c8a0 tx=0x7f5fa4005800 comp rx=0 tx=0).stop 2023-10-03T19:15:51.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.739+0000 7f5fbe23a640 1 -- 172.21.15.45:0/1810022205 shutdown_connections 2023-10-03T19:15:51.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.739+0000 7f5fbe23a640 1 --2- 172.21.15.45:0/1810022205 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5f98066280 0x7f5f98068730 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:51.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.739+0000 7f5fbe23a640 1 --2- 172.21.15.45:0/1810022205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fb81d60d0 0x7f5fb8147ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:51.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.739+0000 7f5fbe23a640 1 --2- 172.21.15.45:0/1810022205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb81d5c30 0x7f5fb814abf0 secure :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5fa001c8a0 tx=0x7f5fa4005800 comp rx=0 tx=0).stop 2023-10-03T19:15:51.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.739+0000 7f5fbe23a640 1 --2- 172.21.15.45:0/1810022205 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fa40047d0 0x7f5fb81e1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:51.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.739+0000 7f5fbe23a640 1 -- 172.21.15.45:0/1810022205 >> 172.21.15.45:0/1810022205 conn(0x7f5fb80c1600 msgr2=0x7f5fb814b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:51.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.743+0000 7f5fbe23a640 1 -- 172.21.15.45:0/1810022205 shutdown_connections 2023-10-03T19:15:51.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:51.743+0000 7f5fbe23a640 1 -- 172.21.15.45:0/1810022205 wait complete. 2023-10-03T19:15:51.764 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2023-10-03T19:15:50.515242+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142,"ondisk_log_size":142,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":108,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":134148,"kb_used_data":4420,"kb_used_omap":0,"kb_used_meta":129664,"kb_avail":754840572,"statfs":{"total":773094113280,"available":772956745728,"internally_reserved":0,"allocated":4526080,"data_stored":3062284,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":132775936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":67,"apply_latency_ms":67,"commit_latency_ns":67000000,"apply_latency_ns":67000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.705945"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.395366+0000","last_change":"2023-10-03T19:15:46.394210+0000","last_active":"2023-10-03T19:15:46.395366+0000","last_peered":"2023-10-03T19:15:46.395366+0000","last_clean":"2023-10-03T19:15:46.395366+0000","last_became_active":"2023-10-03T19:15:46.393845+0000","last_became_peered":"2023-10-03T19:15:46.393845+0000","last_unstale":"2023-10-03T19:15:46.395366+0000","last_undegraded":"2023-10-03T19:15:46.395366+0000","last_fullsized":"2023-10-03T19:15:46.395366+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:15:31.305120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.404180+0000","last_change":"2023-10-03T19:15:46.398709+0000","last_active":"2023-10-03T19:15:46.404180+0000","last_peered":"2023-10-03T19:15:46.404180+0000","last_clean":"2023-10-03T19:15:46.404180+0000","last_became_active":"2023-10-03T19:15:46.397955+0000","last_became_peered":"2023-10-03T19:15:46.397955+0000","last_unstale":"2023-10-03T19:15:46.404180+0000","last_undegraded":"2023-10-03T19:15:46.404180+0000","last_fullsized":"2023-10-03T19:15:46.404180+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:16:53.957508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160021+0000","last_change":"2023-10-03T19:15:46.364679+0000","last_active":"2023-10-03T19:15:48.160021+0000","last_peered":"2023-10-03T19:15:48.160021+0000","last_clean":"2023-10-03T19:15:48.160021+0000","last_became_active":"2023-10-03T19:15:46.360555+0000","last_became_peered":"2023-10-03T19:15:46.360555+0000","last_unstale":"2023-10-03T19:15:48.160021+0000","last_undegraded":"2023-10-03T19:15:48.160021+0000","last_fullsized":"2023-10-03T19:15:48.160021+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:33:29.425810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.391750+0000","last_change":"2023-10-03T19:15:46.379223+0000","last_active":"2023-10-03T19:15:46.391750+0000","last_peered":"2023-10-03T19:15:46.391750+0000","last_clean":"2023-10-03T19:15:46.391750+0000","last_became_active":"2023-10-03T19:15:46.378548+0000","last_became_peered":"2023-10-03T19:15:46.378548+0000","last_unstale":"2023-10-03T19:15:46.391750+0000","last_undegraded":"2023-10-03T19:15:46.391750+0000","last_fullsized":"2023-10-03T19:15:46.391750+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:35:52.686944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.389092+0000","last_change":"2023-10-03T19:15:46.382245+0000","last_active":"2023-10-03T19:15:46.389092+0000","last_peered":"2023-10-03T19:15:46.389092+0000","last_clean":"2023-10-03T19:15:46.389092+0000","last_became_active":"2023-10-03T19:15:46.381558+0000","last_became_peered":"2023-10-03T19:15:46.381558+0000","last_unstale":"2023-10-03T19:15:46.389092+0000","last_undegraded":"2023-10-03T19:15:46.389092+0000","last_fullsized":"2023-10-03T19:15:46.389092+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:32:37.131879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.364981+0000","last_change":"2023-10-03T19:15:46.363085+0000","last_active":"2023-10-03T19:15:46.364981+0000","last_peered":"2023-10-03T19:15:46.364981+0000","last_clean":"2023-10-03T19:15:46.364981+0000","last_became_active":"2023-10-03T19:15:46.362532+0000","last_became_peered":"2023-10-03T19:15:46.362532+0000","last_unstale":"2023-10-03T19:15:46.364981+0000","last_undegraded":"2023-10-03T19:15:46.364981+0000","last_fullsized":"2023-10-03T19:15:46.364981+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:12:14.696723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158898+0000","last_change":"2023-10-03T19:15:46.364944+0000","last_active":"2023-10-03T19:15:48.158898+0000","last_peered":"2023-10-03T19:15:48.158898+0000","last_clean":"2023-10-03T19:15:48.158898+0000","last_became_active":"2023-10-03T19:15:46.364685+0000","last_became_peered":"2023-10-03T19:15:46.364685+0000","last_unstale":"2023-10-03T19:15:48.158898+0000","last_undegraded":"2023-10-03T19:15:48.158898+0000","last_fullsized":"2023-10-03T19:15:48.158898+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:39:43.145618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.824309+0000","last_change":"2023-10-03T19:15:45.824309+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.824309+0000","last_undegraded":"2023-10-03T19:15:45.824309+0000","last_fullsized":"2023-10-03T19:15:45.824309+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.824018+0000","last_change":"2023-10-03T19:15:45.824018+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.824018+0000","last_undegraded":"2023-10-03T19:15:45.824018+0000","last_fullsized":"2023-10-03T19:15:45.824018+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.363671+0000","last_change":"2023-10-03T19:15:46.362303+0000","last_active":"2023-10-03T19:15:46.363671+0000","last_peered":"2023-10-03T19:15:46.363671+0000","last_clean":"2023-10-03T19:15:46.363671+0000","last_became_active":"2023-10-03T19:15:46.362001+0000","last_became_peered":"2023-10-03T19:15:46.362001+0000","last_unstale":"2023-10-03T19:15:46.363671+0000","last_undegraded":"2023-10-03T19:15:46.363671+0000","last_fullsized":"2023-10-03T19:15:46.363671+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:36:05.401390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.368856+0000","last_change":"2023-10-03T19:15:46.367695+0000","last_active":"2023-10-03T19:15:46.368856+0000","last_peered":"2023-10-03T19:15:46.368856+0000","last_clean":"2023-10-03T19:15:46.368856+0000","last_became_active":"2023-10-03T19:15:46.367450+0000","last_became_peered":"2023-10-03T19:15:46.367450+0000","last_unstale":"2023-10-03T19:15:46.368856+0000","last_undegraded":"2023-10-03T19:15:46.368856+0000","last_fullsized":"2023-10-03T19:15:46.368856+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:27:40.278413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.821529+0000","last_change":"2023-10-03T19:15:45.821529+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.821529+0000","last_undegraded":"2023-10-03T19:15:45.821529+0000","last_fullsized":"2023-10-03T19:15:45.821529+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.367008+0000","last_change":"2023-10-03T19:15:46.365193+0000","last_active":"2023-10-03T19:15:46.367008+0000","last_peered":"2023-10-03T19:15:46.367008+0000","last_clean":"2023-10-03T19:15:46.367008+0000","last_became_active":"2023-10-03T19:15:46.364040+0000","last_became_peered":"2023-10-03T19:15:46.364040+0000","last_unstale":"2023-10-03T19:15:46.367008+0000","last_undegraded":"2023-10-03T19:15:46.367008+0000","last_fullsized":"2023-10-03T19:15:46.367008+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:50:01.514952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159667+0000","last_change":"2023-10-03T19:15:46.364760+0000","last_active":"2023-10-03T19:15:48.159667+0000","last_peered":"2023-10-03T19:15:48.159667+0000","last_clean":"2023-10-03T19:15:48.159667+0000","last_became_active":"2023-10-03T19:15:46.360362+0000","last_became_peered":"2023-10-03T19:15:46.360362+0000","last_unstale":"2023-10-03T19:15:48.159667+0000","last_undegraded":"2023-10-03T19:15:48.159667+0000","last_fullsized":"2023-10-03T19:15:48.159667+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:25:27.749340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.392013+0000","last_change":"2023-10-03T19:15:46.379695+0000","last_active":"2023-10-03T19:15:46.392013+0000","last_peered":"2023-10-03T19:15:46.392013+0000","last_clean":"2023-10-03T19:15:46.392013+0000","last_became_active":"2023-10-03T19:15:46.378968+0000","last_became_peered":"2023-10-03T19:15:46.378968+0000","last_unstale":"2023-10-03T19:15:46.392013+0000","last_undegraded":"2023-10-03T19:15:46.392013+0000","last_fullsized":"2023-10-03T19:15:46.392013+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:30:42.698489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.363698+0000","last_change":"2023-10-03T19:15:46.362453+0000","last_active":"2023-10-03T19:15:46.363698+0000","last_peered":"2023-10-03T19:15:46.363698+0000","last_clean":"2023-10-03T19:15:46.363698+0000","last_became_active":"2023-10-03T19:15:46.361895+0000","last_became_peered":"2023-10-03T19:15:46.361895+0000","last_unstale":"2023-10-03T19:15:46.363698+0000","last_undegraded":"2023-10-03T19:15:46.363698+0000","last_fullsized":"2023-10-03T19:15:46.363698+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:11:36.629198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160719+0000","last_change":"2023-10-03T19:15:46.400243+0000","last_active":"2023-10-03T19:15:48.160719+0000","last_peered":"2023-10-03T19:15:48.160719+0000","last_clean":"2023-10-03T19:15:48.160719+0000","last_became_active":"2023-10-03T19:15:46.399983+0000","last_became_peered":"2023-10-03T19:15:46.399983+0000","last_unstale":"2023-10-03T19:15:48.160719+0000","last_undegraded":"2023-10-03T19:15:48.160719+0000","last_fullsized":"2023-10-03T19:15:48.160719+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:53:20.933525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.404210+0000","last_change":"2023-10-03T19:15:46.399010+0000","last_active":"2023-10-03T19:15:46.404210+0000","last_peered":"2023-10-03T19:15:46.404210+0000","last_clean":"2023-10-03T19:15:46.404210+0000","last_became_active":"2023-10-03T19:15:46.397599+0000","last_became_peered":"2023-10-03T19:15:46.397599+0000","last_unstale":"2023-10-03T19:15:46.404210+0000","last_undegraded":"2023-10-03T19:15:46.404210+0000","last_fullsized":"2023-10-03T19:15:46.404210+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:41:36.252764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160430+0000","last_change":"2023-10-03T19:15:46.377306+0000","last_active":"2023-10-03T19:15:48.160430+0000","last_peered":"2023-10-03T19:15:48.160430+0000","last_clean":"2023-10-03T19:15:48.160430+0000","last_became_active":"2023-10-03T19:15:46.377041+0000","last_became_peered":"2023-10-03T19:15:46.377041+0000","last_unstale":"2023-10-03T19:15:48.160430+0000","last_undegraded":"2023-10-03T19:15:48.160430+0000","last_fullsized":"2023-10-03T19:15:48.160430+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:26:46.602249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.392879+0000","last_change":"2023-10-03T19:15:46.388939+0000","last_active":"2023-10-03T19:15:46.392879+0000","last_peered":"2023-10-03T19:15:46.392879+0000","last_clean":"2023-10-03T19:15:46.392879+0000","last_became_active":"2023-10-03T19:15:46.388201+0000","last_became_peered":"2023-10-03T19:15:46.388201+0000","last_unstale":"2023-10-03T19:15:46.392879+0000","last_undegraded":"2023-10-03T19:15:46.392879+0000","last_fullsized":"2023-10-03T19:15:46.392879+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:51:41.830735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.399238+0000","last_change":"2023-10-03T19:15:46.393014+0000","last_active":"2023-10-03T19:15:46.399238+0000","last_peered":"2023-10-03T19:15:46.399238+0000","last_clean":"2023-10-03T19:15:46.399238+0000","last_became_active":"2023-10-03T19:15:46.392401+0000","last_became_peered":"2023-10-03T19:15:46.392401+0000","last_unstale":"2023-10-03T19:15:46.399238+0000","last_undegraded":"2023-10-03T19:15:46.399238+0000","last_fullsized":"2023-10-03T19:15:46.399238+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:59:22.380642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.825371+0000","last_change":"2023-10-03T19:15:45.825371+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.825371+0000","last_undegraded":"2023-10-03T19:15:45.825371+0000","last_fullsized":"2023-10-03T19:15:45.825371+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.380160+0000","last_change":"2023-10-03T19:15:46.378934+0000","last_active":"2023-10-03T19:15:46.380160+0000","last_peered":"2023-10-03T19:15:46.380160+0000","last_clean":"2023-10-03T19:15:46.380160+0000","last_became_active":"2023-10-03T19:15:46.378611+0000","last_became_peered":"2023-10-03T19:15:46.378611+0000","last_unstale":"2023-10-03T19:15:46.380160+0000","last_undegraded":"2023-10-03T19:15:46.380160+0000","last_fullsized":"2023-10-03T19:15:46.380160+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:43:48.510914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158761+0000","last_change":"2023-10-03T19:15:46.360949+0000","last_active":"2023-10-03T19:15:48.158761+0000","last_peered":"2023-10-03T19:15:48.158761+0000","last_clean":"2023-10-03T19:15:48.158761+0000","last_became_active":"2023-10-03T19:15:46.360658+0000","last_became_peered":"2023-10-03T19:15:46.360658+0000","last_unstale":"2023-10-03T19:15:48.158761+0000","last_undegraded":"2023-10-03T19:15:48.158761+0000","last_fullsized":"2023-10-03T19:15:48.158761+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:03:34.243331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160900+0000","last_change":"2023-10-03T19:15:46.368683+0000","last_active":"2023-10-03T19:15:48.160900+0000","last_peered":"2023-10-03T19:15:48.160900+0000","last_clean":"2023-10-03T19:15:48.160900+0000","last_became_active":"2023-10-03T19:15:46.368390+0000","last_became_peered":"2023-10-03T19:15:46.368390+0000","last_unstale":"2023-10-03T19:15:48.160900+0000","last_undegraded":"2023-10-03T19:15:48.160900+0000","last_fullsized":"2023-10-03T19:15:48.160900+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:03:04.832859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.828249+0000","last_change":"2023-10-03T19:15:45.828249+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.828249+0000","last_undegraded":"2023-10-03T19:15:45.828249+0000","last_fullsized":"2023-10-03T19:15:45.828249+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.355757+0000","last_change":"2023-10-03T19:15:46.353768+0000","last_active":"2023-10-03T19:15:46.355757+0000","last_peered":"2023-10-03T19:15:46.355757+0000","last_clean":"2023-10-03T19:15:46.355757+0000","last_became_active":"2023-10-03T19:15:46.353516+0000","last_became_peered":"2023-10-03T19:15:46.353516+0000","last_unstale":"2023-10-03T19:15:46.355757+0000","last_undegraded":"2023-10-03T19:15:46.355757+0000","last_fullsized":"2023-10-03T19:15:46.355757+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:22:07.225725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.386197+0000","last_change":"2023-10-03T19:15:46.375987+0000","last_active":"2023-10-03T19:15:46.386197+0000","last_peered":"2023-10-03T19:15:46.386197+0000","last_clean":"2023-10-03T19:15:46.386197+0000","last_became_active":"2023-10-03T19:15:46.375284+0000","last_became_peered":"2023-10-03T19:15:46.375284+0000","last_unstale":"2023-10-03T19:15:46.386197+0000","last_undegraded":"2023-10-03T19:15:46.386197+0000","last_fullsized":"2023-10-03T19:15:46.386197+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:52:49.683952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159751+0000","last_change":"2023-10-03T19:15:46.374991+0000","last_active":"2023-10-03T19:15:48.159751+0000","last_peered":"2023-10-03T19:15:48.159751+0000","last_clean":"2023-10-03T19:15:48.159751+0000","last_became_active":"2023-10-03T19:15:46.374699+0000","last_became_peered":"2023-10-03T19:15:46.374699+0000","last_unstale":"2023-10-03T19:15:48.159751+0000","last_undegraded":"2023-10-03T19:15:48.159751+0000","last_fullsized":"2023-10-03T19:15:48.159751+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:38:41.035694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.395049+0000","last_change":"2023-10-03T19:15:46.380983+0000","last_active":"2023-10-03T19:15:46.395049+0000","last_peered":"2023-10-03T19:15:46.395049+0000","last_clean":"2023-10-03T19:15:46.395049+0000","last_became_active":"2023-10-03T19:15:46.380216+0000","last_became_peered":"2023-10-03T19:15:46.380216+0000","last_unstale":"2023-10-03T19:15:46.395049+0000","last_undegraded":"2023-10-03T19:15:46.395049+0000","last_fullsized":"2023-10-03T19:15:46.395049+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:18:04.258221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159168+0000","last_change":"2023-10-03T19:15:46.361191+0000","last_active":"2023-10-03T19:15:48.159168+0000","last_peered":"2023-10-03T19:15:48.159168+0000","last_clean":"2023-10-03T19:15:48.159168+0000","last_became_active":"2023-10-03T19:15:46.360817+0000","last_became_peered":"2023-10-03T19:15:46.360817+0000","last_unstale":"2023-10-03T19:15:48.159168+0000","last_undegraded":"2023-10-03T19:15:48.159168+0000","last_fullsized":"2023-10-03T19:15:48.159168+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:09:39.321340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.348033+0000","last_change":"2023-10-03T19:15:46.399112+0000","last_active":"2023-10-03T19:15:47.348033+0000","last_peered":"2023-10-03T19:15:47.348033+0000","last_clean":"2023-10-03T19:15:47.348033+0000","last_became_active":"2023-10-03T19:15:46.398515+0000","last_became_peered":"2023-10-03T19:15:46.398515+0000","last_unstale":"2023-10-03T19:15:47.348033+0000","last_undegraded":"2023-10-03T19:15:47.348033+0000","last_fullsized":"2023-10-03T19:15:47.348033+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:34:48.331811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.405692+0000","last_change":"2023-10-03T19:15:46.403169+0000","last_active":"2023-10-03T19:15:46.405692+0000","last_peered":"2023-10-03T19:15:46.405692+0000","last_clean":"2023-10-03T19:15:46.405692+0000","last_became_active":"2023-10-03T19:15:46.402567+0000","last_became_peered":"2023-10-03T19:15:46.402567+0000","last_unstale":"2023-10-03T19:15:46.405692+0000","last_undegraded":"2023-10-03T19:15:46.405692+0000","last_fullsized":"2023-10-03T19:15:46.405692+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:50:20.113157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"47'4","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.390701+0000","last_change":"2023-10-03T19:15:45.859549+0000","last_active":"2023-10-03T19:15:46.390701+0000","last_peered":"2023-10-03T19:15:46.390701+0000","last_clean":"2023-10-03T19:15:46.390701+0000","last_became_active":"2023-10-03T19:15:45.859068+0000","last_became_peered":"2023-10-03T19:15:45.859068+0000","last_unstale":"2023-10-03T19:15:46.390701+0000","last_undegraded":"2023-10-03T19:15:46.390701+0000","last_fullsized":"2023-10-03T19:15:46.390701+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:10:08.995883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.348456+0000","last_change":"2023-10-03T19:15:46.398012+0000","last_active":"2023-10-03T19:15:47.348456+0000","last_peered":"2023-10-03T19:15:47.348456+0000","last_clean":"2023-10-03T19:15:47.348456+0000","last_became_active":"2023-10-03T19:15:46.396826+0000","last_became_peered":"2023-10-03T19:15:46.396826+0000","last_unstale":"2023-10-03T19:15:47.348456+0000","last_undegraded":"2023-10-03T19:15:47.348456+0000","last_fullsized":"2023-10-03T19:15:47.348456+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:01:43.218107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.349020+0000","last_change":"2023-10-03T19:15:45.849183+0000","last_active":"2023-10-03T19:15:46.349020+0000","last_peered":"2023-10-03T19:15:46.349020+0000","last_clean":"2023-10-03T19:15:46.349020+0000","last_became_active":"2023-10-03T19:15:45.848159+0000","last_became_peered":"2023-10-03T19:15:45.848159+0000","last_unstale":"2023-10-03T19:15:46.349020+0000","last_undegraded":"2023-10-03T19:15:46.349020+0000","last_fullsized":"2023-10-03T19:15:46.349020+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:32:36.127920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.400338+0000","last_change":"2023-10-03T19:15:46.393166+0000","last_active":"2023-10-03T19:15:46.400338+0000","last_peered":"2023-10-03T19:15:46.400338+0000","last_clean":"2023-10-03T19:15:46.400338+0000","last_became_active":"2023-10-03T19:15:46.392621+0000","last_became_peered":"2023-10-03T19:15:46.392621+0000","last_unstale":"2023-10-03T19:15:46.400338+0000","last_undegraded":"2023-10-03T19:15:46.400338+0000","last_fullsized":"2023-10-03T19:15:46.400338+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:24:01.426498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.352266+0000","last_change":"2023-10-03T19:15:45.856473+0000","last_active":"2023-10-03T19:15:46.352266+0000","last_peered":"2023-10-03T19:15:46.352266+0000","last_clean":"2023-10-03T19:15:46.352266+0000","last_became_active":"2023-10-03T19:15:45.856139+0000","last_became_peered":"2023-10-03T19:15:45.856139+0000","last_unstale":"2023-10-03T19:15:46.352266+0000","last_undegraded":"2023-10-03T19:15:46.352266+0000","last_fullsized":"2023-10-03T19:15:46.352266+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:52:53.713262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.827899+0000","last_change":"2023-10-03T19:15:45.827899+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.827899+0000","last_undegraded":"2023-10-03T19:15:45.827899+0000","last_fullsized":"2023-10-03T19:15:45.827899+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349975+0000","last_change":"2023-10-03T19:15:45.853261+0000","last_active":"2023-10-03T19:15:47.349975+0000","last_peered":"2023-10-03T19:15:47.349975+0000","last_clean":"2023-10-03T19:15:47.349975+0000","last_became_active":"2023-10-03T19:15:45.852517+0000","last_became_peered":"2023-10-03T19:15:45.852517+0000","last_unstale":"2023-10-03T19:15:47.349975+0000","last_undegraded":"2023-10-03T19:15:47.349975+0000","last_fullsized":"2023-10-03T19:15:47.349975+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:44:19.861675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.389003+0000","last_change":"2023-10-03T19:15:46.378648+0000","last_active":"2023-10-03T19:15:46.389003+0000","last_peered":"2023-10-03T19:15:46.389003+0000","last_clean":"2023-10-03T19:15:46.389003+0000","last_became_active":"2023-10-03T19:15:46.377900+0000","last_became_peered":"2023-10-03T19:15:46.377900+0000","last_unstale":"2023-10-03T19:15:46.389003+0000","last_undegraded":"2023-10-03T19:15:46.389003+0000","last_fullsized":"2023-10-03T19:15:46.389003+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:36:05.401390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159827+0000","last_change":"2023-10-03T19:15:45.842290+0000","last_active":"2023-10-03T19:15:48.159827+0000","last_peered":"2023-10-03T19:15:48.159827+0000","last_clean":"2023-10-03T19:15:48.159827+0000","last_became_active":"2023-10-03T19:15:45.841848+0000","last_became_peered":"2023-10-03T19:15:45.841848+0000","last_unstale":"2023-10-03T19:15:48.159827+0000","last_undegraded":"2023-10-03T19:15:48.159827+0000","last_fullsized":"2023-10-03T19:15:48.159827+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:14:42.878422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.395303+0000","last_change":"2023-10-03T19:15:46.385410+0000","last_active":"2023-10-03T19:15:46.395303+0000","last_peered":"2023-10-03T19:15:46.395303+0000","last_clean":"2023-10-03T19:15:46.395303+0000","last_became_active":"2023-10-03T19:15:46.381382+0000","last_became_peered":"2023-10-03T19:15:46.381382+0000","last_unstale":"2023-10-03T19:15:46.395303+0000","last_undegraded":"2023-10-03T19:15:46.395303+0000","last_fullsized":"2023-10-03T19:15:46.395303+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:28:43.600596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.378445+0000","last_change":"2023-10-03T19:15:45.861708+0000","last_active":"2023-10-03T19:15:46.378445+0000","last_peered":"2023-10-03T19:15:46.378445+0000","last_clean":"2023-10-03T19:15:46.378445+0000","last_became_active":"2023-10-03T19:15:45.861138+0000","last_became_peered":"2023-10-03T19:15:45.861138+0000","last_unstale":"2023-10-03T19:15:46.378445+0000","last_undegraded":"2023-10-03T19:15:46.378445+0000","last_fullsized":"2023-10-03T19:15:46.378445+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:52:53.713262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.827316+0000","last_change":"2023-10-03T19:15:45.827316+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.827316+0000","last_undegraded":"2023-10-03T19:15:45.827316+0000","last_fullsized":"2023-10-03T19:15:45.827316+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.369697+0000","last_change":"2023-10-03T19:15:45.854212+0000","last_active":"2023-10-03T19:15:46.369697+0000","last_peered":"2023-10-03T19:15:46.369697+0000","last_clean":"2023-10-03T19:15:46.369697+0000","last_became_active":"2023-10-03T19:15:45.851309+0000","last_became_peered":"2023-10-03T19:15:45.851309+0000","last_unstale":"2023-10-03T19:15:46.369697+0000","last_undegraded":"2023-10-03T19:15:46.369697+0000","last_fullsized":"2023-10-03T19:15:46.369697+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:27:18.462340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.391923+0000","last_change":"2023-10-03T19:15:46.379625+0000","last_active":"2023-10-03T19:15:46.391923+0000","last_peered":"2023-10-03T19:15:46.391923+0000","last_clean":"2023-10-03T19:15:46.391923+0000","last_became_active":"2023-10-03T19:15:46.378821+0000","last_became_peered":"2023-10-03T19:15:46.378821+0000","last_unstale":"2023-10-03T19:15:46.391923+0000","last_undegraded":"2023-10-03T19:15:46.391923+0000","last_fullsized":"2023-10-03T19:15:46.391923+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:01:43.816803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158940+0000","last_change":"2023-10-03T19:15:45.858316+0000","last_active":"2023-10-03T19:15:48.158940+0000","last_peered":"2023-10-03T19:15:48.158940+0000","last_clean":"2023-10-03T19:15:48.158940+0000","last_became_active":"2023-10-03T19:15:45.857799+0000","last_became_peered":"2023-10-03T19:15:45.857799+0000","last_unstale":"2023-10-03T19:15:48.158940+0000","last_undegraded":"2023-10-03T19:15:48.158940+0000","last_fullsized":"2023-10-03T19:15:48.158940+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:53:16.171067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.378239+0000","last_change":"2023-10-03T19:15:46.364379+0000","last_active":"2023-10-03T19:15:46.378239+0000","last_peered":"2023-10-03T19:15:46.378239+0000","last_clean":"2023-10-03T19:15:46.378239+0000","last_became_active":"2023-10-03T19:15:46.363462+0000","last_became_peered":"2023-10-03T19:15:46.363462+0000","last_unstale":"2023-10-03T19:15:46.378239+0000","last_undegraded":"2023-10-03T19:15:46.378239+0000","last_fullsized":"2023-10-03T19:15:46.378239+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:50:01.514952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.352386+0000","last_change":"2023-10-03T19:15:45.859177+0000","last_active":"2023-10-03T19:15:46.352386+0000","last_peered":"2023-10-03T19:15:46.352386+0000","last_clean":"2023-10-03T19:15:46.352386+0000","last_became_active":"2023-10-03T19:15:45.857999+0000","last_became_peered":"2023-10-03T19:15:45.857999+0000","last_unstale":"2023-10-03T19:15:46.352386+0000","last_undegraded":"2023-10-03T19:15:46.352386+0000","last_fullsized":"2023-10-03T19:15:46.352386+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:53:42.530765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.348113+0000","last_change":"2023-10-03T19:15:46.397614+0000","last_active":"2023-10-03T19:15:47.348113+0000","last_peered":"2023-10-03T19:15:47.348113+0000","last_clean":"2023-10-03T19:15:47.348113+0000","last_became_active":"2023-10-03T19:15:46.396040+0000","last_became_peered":"2023-10-03T19:15:46.396040+0000","last_unstale":"2023-10-03T19:15:47.348113+0000","last_undegraded":"2023-10-03T19:15:47.348113+0000","last_fullsized":"2023-10-03T19:15:47.348113+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:37:55.351113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.349729+0000","last_change":"2023-10-03T19:15:45.847050+0000","last_active":"2023-10-03T19:15:46.349729+0000","last_peered":"2023-10-03T19:15:46.349729+0000","last_clean":"2023-10-03T19:15:46.349729+0000","last_became_active":"2023-10-03T19:15:45.846253+0000","last_became_peered":"2023-10-03T19:15:45.846253+0000","last_unstale":"2023-10-03T19:15:46.349729+0000","last_undegraded":"2023-10-03T19:15:46.349729+0000","last_fullsized":"2023-10-03T19:15:46.349729+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:36:34.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159843+0000","last_change":"2023-10-03T19:15:46.375450+0000","last_active":"2023-10-03T19:15:48.159843+0000","last_peered":"2023-10-03T19:15:48.159843+0000","last_clean":"2023-10-03T19:15:48.159843+0000","last_became_active":"2023-10-03T19:15:46.375071+0000","last_became_peered":"2023-10-03T19:15:46.375071+0000","last_unstale":"2023-10-03T19:15:48.159843+0000","last_undegraded":"2023-10-03T19:15:48.159843+0000","last_fullsized":"2023-10-03T19:15:48.159843+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:54:49.165838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"47'3","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.391839+0000","last_change":"2023-10-03T19:15:45.860953+0000","last_active":"2023-10-03T19:15:46.391839+0000","last_peered":"2023-10-03T19:15:46.391839+0000","last_clean":"2023-10-03T19:15:46.391839+0000","last_became_active":"2023-10-03T19:15:45.859256+0000","last_became_peered":"2023-10-03T19:15:45.859256+0000","last_unstale":"2023-10-03T19:15:46.391839+0000","last_undegraded":"2023-10-03T19:15:46.391839+0000","last_fullsized":"2023-10-03T19:15:46.391839+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:26:04.423019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.378221+0000","last_change":"2023-10-03T19:15:46.365297+0000","last_active":"2023-10-03T19:15:46.378221+0000","last_peered":"2023-10-03T19:15:46.378221+0000","last_clean":"2023-10-03T19:15:46.378221+0000","last_became_active":"2023-10-03T19:15:46.363978+0000","last_became_peered":"2023-10-03T19:15:46.363978+0000","last_unstale":"2023-10-03T19:15:46.378221+0000","last_undegraded":"2023-10-03T19:15:46.378221+0000","last_fullsized":"2023-10-03T19:15:46.378221+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:07:21.108075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-03T19:15:45.848869+0000","last_change":"2023-10-03T19:15:45.845291+0000","last_active":"2023-10-03T19:15:45.848869+0000","last_peered":"2023-10-03T19:15:45.848869+0000","last_clean":"2023-10-03T19:15:45.848869+0000","last_became_active":"2023-10-03T19:15:45.845024+0000","last_became_peered":"2023-10-03T19:15:45.845024+0000","last_unstale":"2023-10-03T19:15:45.848869+0000","last_undegraded":"2023-10-03T19:15:45.848869+0000","last_fullsized":"2023-10-03T19:15:45.848869+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:11:35.625240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349625+0000","last_change":"2023-10-03T19:15:46.397165+0000","last_active":"2023-10-03T19:15:47.349625+0000","last_peered":"2023-10-03T19:15:47.349625+0000","last_clean":"2023-10-03T19:15:47.349625+0000","last_became_active":"2023-10-03T19:15:46.396350+0000","last_became_peered":"2023-10-03T19:15:46.396350+0000","last_unstale":"2023-10-03T19:15:47.349625+0000","last_undegraded":"2023-10-03T19:15:47.349625+0000","last_fullsized":"2023-10-03T19:15:47.349625+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:51:27.685465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160115+0000","last_change":"2023-10-03T19:15:45.855724+0000","last_active":"2023-10-03T19:15:48.160115+0000","last_peered":"2023-10-03T19:15:48.160115+0000","last_clean":"2023-10-03T19:15:48.160115+0000","last_became_active":"2023-10-03T19:15:45.855158+0000","last_became_peered":"2023-10-03T19:15:45.855158+0000","last_unstale":"2023-10-03T19:15:48.160115+0000","last_undegraded":"2023-10-03T19:15:48.160115+0000","last_fullsized":"2023-10-03T19:15:48.160115+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:35:35.283953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160510+0000","last_change":"2023-10-03T19:15:46.368523+0000","last_active":"2023-10-03T19:15:48.160510+0000","last_peered":"2023-10-03T19:15:48.160510+0000","last_clean":"2023-10-03T19:15:48.160510+0000","last_became_active":"2023-10-03T19:15:46.368208+0000","last_became_peered":"2023-10-03T19:15:46.368208+0000","last_unstale":"2023-10-03T19:15:48.160510+0000","last_undegraded":"2023-10-03T19:15:48.160510+0000","last_fullsized":"2023-10-03T19:15:48.160510+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:02:17.268261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.370213+0000","last_change":"2023-10-03T19:15:45.860845+0000","last_active":"2023-10-03T19:15:46.370213+0000","last_peered":"2023-10-03T19:15:46.370213+0000","last_clean":"2023-10-03T19:15:46.370213+0000","last_became_active":"2023-10-03T19:15:45.860209+0000","last_became_peered":"2023-10-03T19:15:45.860209+0000","last_unstale":"2023-10-03T19:15:46.370213+0000","last_undegraded":"2023-10-03T19:15:46.370213+0000","last_fullsized":"2023-10-03T19:15:46.370213+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:02:07.426742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.827762+0000","last_change":"2023-10-03T19:15:45.827762+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.827762+0000","last_undegraded":"2023-10-03T19:15:45.827762+0000","last_fullsized":"2023-10-03T19:15:45.827762+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.351885+0000","last_change":"2023-10-03T19:15:45.861050+0000","last_active":"2023-10-03T19:15:46.351885+0000","last_peered":"2023-10-03T19:15:46.351885+0000","last_clean":"2023-10-03T19:15:46.351885+0000","last_became_active":"2023-10-03T19:15:45.860266+0000","last_became_peered":"2023-10-03T19:15:45.860266+0000","last_unstale":"2023-10-03T19:15:46.351885+0000","last_undegraded":"2023-10-03T19:15:46.351885+0000","last_fullsized":"2023-10-03T19:15:46.351885+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:07:41.373754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160867+0000","last_change":"2023-10-03T19:15:46.394299+0000","last_active":"2023-10-03T19:15:48.160867+0000","last_peered":"2023-10-03T19:15:48.160867+0000","last_clean":"2023-10-03T19:15:48.160867+0000","last_became_active":"2023-10-03T19:15:46.394004+0000","last_became_peered":"2023-10-03T19:15:46.394004+0000","last_unstale":"2023-10-03T19:15:48.160867+0000","last_undegraded":"2023-10-03T19:15:48.160867+0000","last_fullsized":"2023-10-03T19:15:48.160867+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:18:54.415024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-03T19:15:45.852138+0000","last_change":"2023-10-03T19:15:45.848662+0000","last_active":"2023-10-03T19:15:45.852138+0000","last_peered":"2023-10-03T19:15:45.852138+0000","last_clean":"2023-10-03T19:15:45.852138+0000","last_became_active":"2023-10-03T19:15:45.848008+0000","last_became_peered":"2023-10-03T19:15:45.848008+0000","last_unstale":"2023-10-03T19:15:45.852138+0000","last_undegraded":"2023-10-03T19:15:45.852138+0000","last_fullsized":"2023-10-03T19:15:45.852138+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:37:41.991426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.823243+0000","last_change":"2023-10-03T19:15:45.823243+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.823243+0000","last_undegraded":"2023-10-03T19:15:45.823243+0000","last_fullsized":"2023-10-03T19:15:45.823243+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.161196+0000","last_change":"2023-10-03T19:15:45.849759+0000","last_active":"2023-10-03T19:15:48.161196+0000","last_peered":"2023-10-03T19:15:48.161196+0000","last_clean":"2023-10-03T19:15:48.161196+0000","last_became_active":"2023-10-03T19:15:45.849456+0000","last_became_peered":"2023-10-03T19:15:45.849456+0000","last_unstale":"2023-10-03T19:15:48.161196+0000","last_undegraded":"2023-10-03T19:15:48.161196+0000","last_fullsized":"2023-10-03T19:15:48.161196+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:04:10.067798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.351986+0000","last_change":"2023-10-03T19:15:46.350646+0000","last_active":"2023-10-03T19:15:46.351986+0000","last_peered":"2023-10-03T19:15:46.351986+0000","last_clean":"2023-10-03T19:15:46.351986+0000","last_became_active":"2023-10-03T19:15:46.350328+0000","last_became_peered":"2023-10-03T19:15:46.350328+0000","last_unstale":"2023-10-03T19:15:46.351986+0000","last_undegraded":"2023-10-03T19:15:46.351986+0000","last_fullsized":"2023-10-03T19:15:46.351986+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:04:53.999973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.394818+0000","last_change":"2023-10-03T19:15:45.836185+0000","last_active":"2023-10-03T19:15:46.394818+0000","last_peered":"2023-10-03T19:15:46.394818+0000","last_clean":"2023-10-03T19:15:46.394818+0000","last_became_active":"2023-10-03T19:15:45.835843+0000","last_became_peered":"2023-10-03T19:15:45.835843+0000","last_unstale":"2023-10-03T19:15:46.394818+0000","last_undegraded":"2023-10-03T19:15:46.394818+0000","last_fullsized":"2023-10-03T19:15:46.394818+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:06:03.946899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.385213+0000","last_change":"2023-10-03T19:15:46.367540+0000","last_active":"2023-10-03T19:15:46.385213+0000","last_peered":"2023-10-03T19:15:46.385213+0000","last_clean":"2023-10-03T19:15:46.385213+0000","last_became_active":"2023-10-03T19:15:46.366645+0000","last_became_peered":"2023-10-03T19:15:46.366645+0000","last_unstale":"2023-10-03T19:15:46.385213+0000","last_undegraded":"2023-10-03T19:15:46.385213+0000","last_fullsized":"2023-10-03T19:15:46.385213+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:08:24.560923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.380718+0000","last_change":"2023-10-03T19:15:45.849574+0000","last_active":"2023-10-03T19:15:46.380718+0000","last_peered":"2023-10-03T19:15:46.380718+0000","last_clean":"2023-10-03T19:15:46.380718+0000","last_became_active":"2023-10-03T19:15:45.848800+0000","last_became_peered":"2023-10-03T19:15:45.848800+0000","last_unstale":"2023-10-03T19:15:46.380718+0000","last_undegraded":"2023-10-03T19:15:46.380718+0000","last_fullsized":"2023-10-03T19:15:46.380718+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:00:19.836298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.395337+0000","last_change":"2023-10-03T19:15:46.394179+0000","last_active":"2023-10-03T19:15:46.395337+0000","last_peered":"2023-10-03T19:15:46.395337+0000","last_clean":"2023-10-03T19:15:46.395337+0000","last_became_active":"2023-10-03T19:15:46.393883+0000","last_became_peered":"2023-10-03T19:15:46.393883+0000","last_unstale":"2023-10-03T19:15:46.395337+0000","last_undegraded":"2023-10-03T19:15:46.395337+0000","last_fullsized":"2023-10-03T19:15:46.395337+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:37:42.995384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.370522+0000","last_change":"2023-10-03T19:15:45.859040+0000","last_active":"2023-10-03T19:15:46.370522+0000","last_peered":"2023-10-03T19:15:46.370522+0000","last_clean":"2023-10-03T19:15:46.370522+0000","last_became_active":"2023-10-03T19:15:45.858297+0000","last_became_peered":"2023-10-03T19:15:45.858297+0000","last_unstale":"2023-10-03T19:15:46.370522+0000","last_undegraded":"2023-10-03T19:15:46.370522+0000","last_fullsized":"2023-10-03T19:15:46.370522+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:58:37.048776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349962+0000","last_change":"2023-10-03T19:15:46.396843+0000","last_active":"2023-10-03T19:15:47.349962+0000","last_peered":"2023-10-03T19:15:47.349962+0000","last_clean":"2023-10-03T19:15:47.349962+0000","last_became_active":"2023-10-03T19:15:46.395999+0000","last_became_peered":"2023-10-03T19:15:46.395999+0000","last_unstale":"2023-10-03T19:15:47.349962+0000","last_undegraded":"2023-10-03T19:15:47.349962+0000","last_fullsized":"2023-10-03T19:15:47.349962+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:33:27.851221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.380703+0000","last_change":"2023-10-03T19:15:45.835409+0000","last_active":"2023-10-03T19:15:46.380703+0000","last_peered":"2023-10-03T19:15:46.380703+0000","last_clean":"2023-10-03T19:15:46.380703+0000","last_became_active":"2023-10-03T19:15:45.835194+0000","last_became_peered":"2023-10-03T19:15:45.835194+0000","last_unstale":"2023-10-03T19:15:46.380703+0000","last_undegraded":"2023-10-03T19:15:46.380703+0000","last_fullsized":"2023-10-03T19:15:46.380703+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:07:20.104117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.392807+0000","last_change":"2023-10-03T19:15:46.388333+0000","last_active":"2023-10-03T19:15:46.392807+0000","last_peered":"2023-10-03T19:15:46.392807+0000","last_clean":"2023-10-03T19:15:46.392807+0000","last_became_active":"2023-10-03T19:15:46.387577+0000","last_became_peered":"2023-10-03T19:15:46.387577+0000","last_unstale":"2023-10-03T19:15:46.392807+0000","last_undegraded":"2023-10-03T19:15:46.392807+0000","last_fullsized":"2023-10-03T19:15:46.392807+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:10:19.340333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-03T19:15:45.850843+0000","last_change":"2023-10-03T19:15:45.846961+0000","last_active":"2023-10-03T19:15:45.850843+0000","last_peered":"2023-10-03T19:15:45.850843+0000","last_clean":"2023-10-03T19:15:45.850843+0000","last_became_active":"2023-10-03T19:15:45.845959+0000","last_became_peered":"2023-10-03T19:15:45.845959+0000","last_unstale":"2023-10-03T19:15:45.850843+0000","last_undegraded":"2023-10-03T19:15:45.850843+0000","last_fullsized":"2023-10-03T19:15:45.850843+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:04:52.996015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160520+0000","last_change":"2023-10-03T19:15:46.375168+0000","last_active":"2023-10-03T19:15:48.160520+0000","last_peered":"2023-10-03T19:15:48.160520+0000","last_clean":"2023-10-03T19:15:48.160520+0000","last_became_active":"2023-10-03T19:15:46.374822+0000","last_became_peered":"2023-10-03T19:15:46.374822+0000","last_unstale":"2023-10-03T19:15:48.160520+0000","last_undegraded":"2023-10-03T19:15:48.160520+0000","last_fullsized":"2023-10-03T19:15:48.160520+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:04:50.606893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159333+0000","last_change":"2023-10-03T19:15:45.843525+0000","last_active":"2023-10-03T19:15:48.159333+0000","last_peered":"2023-10-03T19:15:48.159333+0000","last_clean":"2023-10-03T19:15:48.159333+0000","last_became_active":"2023-10-03T19:15:45.843111+0000","last_became_peered":"2023-10-03T19:15:45.843111+0000","last_unstale":"2023-10-03T19:15:48.159333+0000","last_undegraded":"2023-10-03T19:15:48.159333+0000","last_fullsized":"2023-10-03T19:15:48.159333+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:59:15.785799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.351998+0000","last_change":"2023-10-03T19:15:46.349592+0000","last_active":"2023-10-03T19:15:46.351998+0000","last_peered":"2023-10-03T19:15:46.351998+0000","last_clean":"2023-10-03T19:15:46.351998+0000","last_became_active":"2023-10-03T19:15:46.349264+0000","last_became_peered":"2023-10-03T19:15:46.349264+0000","last_unstale":"2023-10-03T19:15:46.351998+0000","last_undegraded":"2023-10-03T19:15:46.351998+0000","last_fullsized":"2023-10-03T19:15:46.351998+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:31:17.364939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.342355+0000","last_change":"2023-10-03T19:15:45.845501+0000","last_active":"2023-10-03T19:15:46.342355+0000","last_peered":"2023-10-03T19:15:46.342355+0000","last_clean":"2023-10-03T19:15:46.342355+0000","last_became_active":"2023-10-03T19:15:45.845069+0000","last_became_peered":"2023-10-03T19:15:45.845069+0000","last_unstale":"2023-10-03T19:15:46.342355+0000","last_undegraded":"2023-10-03T19:15:46.342355+0000","last_fullsized":"2023-10-03T19:15:46.342355+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:39:26.716817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.403923+0000","last_change":"2023-10-03T19:15:46.401220+0000","last_active":"2023-10-03T19:15:46.403923+0000","last_peered":"2023-10-03T19:15:46.403923+0000","last_clean":"2023-10-03T19:15:46.403923+0000","last_became_active":"2023-10-03T19:15:46.400309+0000","last_became_peered":"2023-10-03T19:15:46.400309+0000","last_unstale":"2023-10-03T19:15:46.403923+0000","last_undegraded":"2023-10-03T19:15:46.403923+0000","last_fullsized":"2023-10-03T19:15:46.403923+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:23:02.389649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"48'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.761698+0000","last_change":"2023-10-03T19:15:45.855576+0000","last_active":"2023-10-03T19:15:48.761698+0000","last_peered":"2023-10-03T19:15:48.761698+0000","last_clean":"2023-10-03T19:15:48.761698+0000","last_became_active":"2023-10-03T19:15:45.855189+0000","last_became_peered":"2023-10-03T19:15:45.855189+0000","last_unstale":"2023-10-03T19:15:48.761698+0000","last_undegraded":"2023-10-03T19:15:48.761698+0000","last_fullsized":"2023-10-03T19:15:48.761698+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:03:22.555251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":216,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.345374+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:15:46.345374+0000","last_peered":"2023-10-03T19:15:46.345374+0000","last_clean":"2023-10-03T19:15:46.345374+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:15:46.345374+0000","last_undegraded":"2023-10-03T19:15:46.345374+0000","last_fullsized":"2023-10-03T19:15:46.345374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:03:45.985767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349442+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:15:47.349442+0000","last_peered":"2023-10-03T19:15:47.349442+0000","last_clean":"2023-10-03T19:15:47.349442+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:15:47.349442+0000","last_undegraded":"2023-10-03T19:15:47.349442+0000","last_fullsized":"2023-10-03T19:15:47.349442+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:07:52.226240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.355815+0000","last_change":"2023-10-03T19:15:46.354378+0000","last_active":"2023-10-03T19:15:46.355815+0000","last_peered":"2023-10-03T19:15:46.355815+0000","last_clean":"2023-10-03T19:15:46.355815+0000","last_became_active":"2023-10-03T19:15:46.354096+0000","last_became_peered":"2023-10-03T19:15:46.354096+0000","last_unstale":"2023-10-03T19:15:46.355815+0000","last_undegraded":"2023-10-03T19:15:46.355815+0000","last_fullsized":"2023-10-03T19:15:46.355815+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:20:43.270219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.353013+0000","last_change":"2023-10-03T19:15:45.860418+0000","last_active":"2023-10-03T19:15:46.353013+0000","last_peered":"2023-10-03T19:15:46.353013+0000","last_clean":"2023-10-03T19:15:46.353013+0000","last_became_active":"2023-10-03T19:15:45.859327+0000","last_became_peered":"2023-10-03T19:15:45.859327+0000","last_unstale":"2023-10-03T19:15:46.353013+0000","last_undegraded":"2023-10-03T19:15:46.353013+0000","last_fullsized":"2023-10-03T19:15:46.353013+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:05:40.995560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.345054+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:15:46.345054+0000","last_peered":"2023-10-03T19:15:46.345054+0000","last_clean":"2023-10-03T19:15:46.345054+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:15:46.345054+0000","last_undegraded":"2023-10-03T19:15:46.345054+0000","last_fullsized":"2023-10-03T19:15:46.345054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:26:32.661519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.826755+0000","last_change":"2023-10-03T19:15:45.826755+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.826755+0000","last_undegraded":"2023-10-03T19:15:45.826755+0000","last_fullsized":"2023-10-03T19:15:45.826755+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160423+0000","last_change":"2023-10-03T19:15:45.850638+0000","last_active":"2023-10-03T19:15:48.160423+0000","last_peered":"2023-10-03T19:15:48.160423+0000","last_clean":"2023-10-03T19:15:48.160423+0000","last_became_active":"2023-10-03T19:15:45.850362+0000","last_became_peered":"2023-10-03T19:15:45.850362+0000","last_unstale":"2023-10-03T19:15:48.160423+0000","last_undegraded":"2023-10-03T19:15:48.160423+0000","last_fullsized":"2023-10-03T19:15:48.160423+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:59:04.384674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.343042+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:15:46.343042+0000","last_peered":"2023-10-03T19:15:46.343042+0000","last_clean":"2023-10-03T19:15:46.343042+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:15:46.343042+0000","last_undegraded":"2023-10-03T19:15:46.343042+0000","last_fullsized":"2023-10-03T19:15:46.343042+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:53:22.657236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.348353+0000","last_change":"2023-10-03T19:15:46.396444+0000","last_active":"2023-10-03T19:15:47.348353+0000","last_peered":"2023-10-03T19:15:47.348353+0000","last_clean":"2023-10-03T19:15:47.348353+0000","last_became_active":"2023-10-03T19:15:46.395657+0000","last_became_peered":"2023-10-03T19:15:46.395657+0000","last_unstale":"2023-10-03T19:15:47.348353+0000","last_undegraded":"2023-10-03T19:15:47.348353+0000","last_fullsized":"2023-10-03T19:15:47.348353+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:02:07.926380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.385928+0000","last_change":"2023-10-03T19:15:45.858616+0000","last_active":"2023-10-03T19:15:46.385928+0000","last_peered":"2023-10-03T19:15:46.385928+0000","last_clean":"2023-10-03T19:15:46.385928+0000","last_became_active":"2023-10-03T19:15:45.858088+0000","last_became_peered":"2023-10-03T19:15:45.858088+0000","last_unstale":"2023-10-03T19:15:46.385928+0000","last_undegraded":"2023-10-03T19:15:46.385928+0000","last_fullsized":"2023-10-03T19:15:46.385928+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:38:02.669888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.347923+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:15:47.347923+0000","last_peered":"2023-10-03T19:15:47.347923+0000","last_clean":"2023-10-03T19:15:47.347923+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:15:47.347923+0000","last_undegraded":"2023-10-03T19:15:47.347923+0000","last_fullsized":"2023-10-03T19:15:47.347923+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:46:54.785846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160288+0000","last_change":"2023-10-03T19:15:46.360983+0000","last_active":"2023-10-03T19:15:48.160288+0000","last_peered":"2023-10-03T19:15:48.160288+0000","last_clean":"2023-10-03T19:15:48.160288+0000","last_became_active":"2023-10-03T19:15:46.360549+0000","last_became_peered":"2023-10-03T19:15:46.360549+0000","last_unstale":"2023-10-03T19:15:48.160288+0000","last_undegraded":"2023-10-03T19:15:48.160288+0000","last_fullsized":"2023-10-03T19:15:48.160288+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:18:21.999198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.343867+0000","last_change":"2023-10-03T19:15:45.849036+0000","last_active":"2023-10-03T19:15:46.343867+0000","last_peered":"2023-10-03T19:15:46.343867+0000","last_clean":"2023-10-03T19:15:46.343867+0000","last_became_active":"2023-10-03T19:15:45.848308+0000","last_became_peered":"2023-10-03T19:15:45.848308+0000","last_unstale":"2023-10-03T19:15:46.343867+0000","last_undegraded":"2023-10-03T19:15:46.343867+0000","last_fullsized":"2023-10-03T19:15:46.343867+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:12:13.692765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":62,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.340199+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:15:46.340199+0000","last_peered":"2023-10-03T19:15:46.340199+0000","last_clean":"2023-10-03T19:15:46.340199+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:15:46.340199+0000","last_undegraded":"2023-10-03T19:15:46.340199+0000","last_fullsized":"2023-10-03T19:15:46.340199+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:05:01.061886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.823070+0000","last_change":"2023-10-03T19:15:45.823070+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.823070+0000","last_undegraded":"2023-10-03T19:15:45.823070+0000","last_fullsized":"2023-10-03T19:15:45.823070+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.348664+0000","last_change":"2023-10-03T19:15:45.834172+0000","last_active":"2023-10-03T19:15:47.348664+0000","last_peered":"2023-10-03T19:15:47.348664+0000","last_clean":"2023-10-03T19:15:47.348664+0000","last_became_active":"2023-10-03T19:15:45.833415+0000","last_became_peered":"2023-10-03T19:15:45.833415+0000","last_unstale":"2023-10-03T19:15:47.348664+0000","last_undegraded":"2023-10-03T19:15:47.348664+0000","last_fullsized":"2023-10-03T19:15:47.348664+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:41:46.377632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.353252+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:15:46.353252+0000","last_peered":"2023-10-03T19:15:46.353252+0000","last_clean":"2023-10-03T19:15:46.353252+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:15:46.353252+0000","last_undegraded":"2023-10-03T19:15:46.353252+0000","last_fullsized":"2023-10-03T19:15:46.353252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:45:00.349234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160091+0000","last_change":"2023-10-03T19:15:46.365576+0000","last_active":"2023-10-03T19:15:48.160091+0000","last_peered":"2023-10-03T19:15:48.160091+0000","last_clean":"2023-10-03T19:15:48.160091+0000","last_became_active":"2023-10-03T19:15:46.365249+0000","last_became_peered":"2023-10-03T19:15:46.365249+0000","last_unstale":"2023-10-03T19:15:48.160091+0000","last_undegraded":"2023-10-03T19:15:48.160091+0000","last_fullsized":"2023-10-03T19:15:48.160091+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:10:27.658304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-03T19:15:45.850894+0000","last_change":"2023-10-03T19:15:45.848356+0000","last_active":"2023-10-03T19:15:45.850894+0000","last_peered":"2023-10-03T19:15:45.850894+0000","last_clean":"2023-10-03T19:15:45.850894+0000","last_became_active":"2023-10-03T19:15:45.847882+0000","last_became_peered":"2023-10-03T19:15:45.847882+0000","last_unstale":"2023-10-03T19:15:45.850894+0000","last_undegraded":"2023-10-03T19:15:45.850894+0000","last_fullsized":"2023-10-03T19:15:45.850894+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:20:42.266260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":62,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.341745+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:15:46.341745+0000","last_peered":"2023-10-03T19:15:46.341745+0000","last_clean":"2023-10-03T19:15:46.341745+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:15:46.341745+0000","last_undegraded":"2023-10-03T19:15:46.341745+0000","last_fullsized":"2023-10-03T19:15:46.341745+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:33:11.676416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349987+0000","last_change":"2023-10-03T19:15:46.396416+0000","last_active":"2023-10-03T19:15:47.349987+0000","last_peered":"2023-10-03T19:15:47.349987+0000","last_clean":"2023-10-03T19:15:47.349987+0000","last_became_active":"2023-10-03T19:15:46.395693+0000","last_became_peered":"2023-10-03T19:15:46.395693+0000","last_unstale":"2023-10-03T19:15:47.349987+0000","last_undegraded":"2023-10-03T19:15:47.349987+0000","last_fullsized":"2023-10-03T19:15:47.349987+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:18:43.523711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-03T19:15:45.849652+0000","last_change":"2023-10-03T19:15:45.846558+0000","last_active":"2023-10-03T19:15:45.849652+0000","last_peered":"2023-10-03T19:15:45.849652+0000","last_clean":"2023-10-03T19:15:45.849652+0000","last_became_active":"2023-10-03T19:15:45.845284+0000","last_became_peered":"2023-10-03T19:15:45.845284+0000","last_unstale":"2023-10-03T19:15:45.849652+0000","last_undegraded":"2023-10-03T19:15:45.849652+0000","last_fullsized":"2023-10-03T19:15:45.849652+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:17:34.420808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.371863+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:15:46.371863+0000","last_peered":"2023-10-03T19:15:46.371863+0000","last_clean":"2023-10-03T19:15:46.371863+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:15:46.371863+0000","last_undegraded":"2023-10-03T19:15:46.371863+0000","last_fullsized":"2023-10-03T19:15:46.371863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:37:29.746184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25,"ondisk_log_size":25,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509484,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24228,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":23616,"kb_avail":94347612,"statfs":{"total":96636764160,"available":96611954688,"internally_reserved":0,"allocated":618496,"data_stored":825786,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":24182784},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.93799999999999994,"15min":0.95399999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2030000000000001,"5min":4.0469999999999997,"15min":4.0469999999999997},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82699999999999996,"15min":0.80200000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.05,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.82599999999999996}]},{"osd":1,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.97599999999999998,"15min":1.038},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.169,"5min":3.8239999999999998,"15min":3.8239999999999998},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.878,"15min":0.85699999999999998},"min":{"1min":0.66300000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1899999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.65800000000000003}]},{"osd":2,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":0.91400000000000003,"15min":0.86199999999999999},"min":{"1min":0.66100000000000003,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":6.0449999999999999,"5min":6.0449999999999999,"15min":6.0449999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.0129999999999999,"15min":1.0429999999999999},"min":{"1min":0.60599999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.252,"5min":3.98,"15min":3.98},"last":0.79400000000000004}]},{"osd":3,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":0.98699999999999999,"15min":0.94099999999999995},"min":{"1min":0.79200000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":6.125,"5min":6.125,"15min":6.125},"last":1.01},{"interface":"front","average":{"1min":0.96099999999999997,"5min":1.0900000000000001,"15min":1.1299999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.2070000000000001,"5min":3.9140000000000001,"15min":3.9140000000000001},"last":0.61899999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":1.0940000000000001,"15min":1.1799999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1970000000000001,"5min":5.1130000000000004,"15min":5.1130000000000004},"last":1.036},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.0429999999999999,"15min":1.0349999999999999},"min":{"1min":0.67500000000000004,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":6.3520000000000003,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":0.755}]},{"osd":5,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.198,"15min":1.2889999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2889999999999999,"5min":5.1859999999999999,"15min":5.1859999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.125,"15min":1.159},"min":{"1min":0.73299999999999998,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.2949999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":0.88300000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.099,"15min":1.1020000000000001},"min":{"1min":0.80800000000000005,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.349,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.2010000000000001,"15min":1.1930000000000001},"min":{"1min":0.88,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":6.1580000000000004,"5min":6.1580000000000004,"15min":6.1580000000000004},"last":1.077}]}]},{"osd":6,"up_from":15,"seq":64424509484,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13792,"kb_used_data":536,"kb_used_omap":0,"kb_used_meta":13248,"kb_avail":94358048,"statfs":{"total":96636764160,"available":96622641152,"internally_reserved":0,"allocated":548864,"data_stored":234782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13565952},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.82899999999999996,"15min":0.81699999999999995},"min":{"1min":0.55800000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.111,"5min":1.504,"15min":1.504},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.89400000000000002,"15min":0.88300000000000001},"min":{"1min":0.69399999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1739999999999999,"5min":1.839,"15min":1.839},"last":0.56699999999999995}]},{"osd":1,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.84799999999999998,"15min":0.83799999999999997},"min":{"1min":0.63600000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.117,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.88700000000000001,"15min":0.879},"min":{"1min":0.58899999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1479999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.80200000000000005}]},{"osd":2,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.89000000000000001,"15min":0.86499999999999999},"min":{"1min":0.745,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0940000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91700000000000004,"15min":0.92500000000000004},"min":{"1min":0.66300000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2250000000000001,"5min":1.546,"15min":1.546},"last":0.83799999999999997}]},{"osd":3,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97999999999999998,"15min":0.98599999999999999},"min":{"1min":0.64700000000000002,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1719999999999999,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.747},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90800000000000003,"15min":0.90900000000000003},"min":{"1min":0.68999999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0580000000000001,"5min":2.121,"15min":2.121},"last":0.69399999999999995}]},{"osd":4,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.999,"15min":1.0349999999999999},"min":{"1min":0.68500000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.147,"5min":1.95,"15min":1.95},"last":1.083},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.056,"15min":1.0980000000000001},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.216,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.90600000000000003}]},{"osd":5,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":1.004,"15min":1.03},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.153,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.008,"5min":1.0920000000000001,"15min":1.1240000000000001},"min":{"1min":0.68300000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.1879999999999999,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.123}]},{"osd":7,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.1060000000000001,"15min":1.1259999999999999},"min":{"1min":0.73299999999999998,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.234,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0820000000000001,"15min":1.1000000000000001},"min":{"1min":0.86199999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.194,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.004}]}]},{"osd":4,"up_from":15,"seq":64424509485,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14560,"kb_used_data":536,"kb_used_omap":0,"kb_used_meta":14016,"kb_avail":94357280,"statfs":{"total":96636764160,"available":96621854720,"internally_reserved":0,"allocated":548864,"data_stored":235876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14352384},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.81299999999999994,"15min":0.78300000000000003},"min":{"1min":0.57299999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1279999999999999,"5min":1.258,"15min":1.258},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.83999999999999997,"15min":0.82599999999999996},"min":{"1min":0.56000000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.1459999999999999,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.80800000000000005}]},{"osd":1,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.93000000000000005,"15min":0.93500000000000005},"min":{"1min":0.68200000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.175,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.879,"15min":0.85499999999999998},"min":{"1min":0.59999999999999998,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.276,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.91200000000000003}]},{"osd":2,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.93000000000000005,"15min":0.91400000000000003},"min":{"1min":0.71399999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1040000000000001,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.002,"5min":0.96799999999999997,"15min":0.94499999999999995},"min":{"1min":0.78100000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2190000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.78400000000000003}]},{"osd":3,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.88600000000000001,"15min":0.874},"min":{"1min":0.76000000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.129,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0609999999999999,"15min":1.071},"min":{"1min":0.85999999999999999,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.216,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.73599999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":1.026,"15min":1.0620000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2050000000000001,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.99299999999999999,"15min":1.0149999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.1499999999999999,"5min":1.635,"15min":1.635},"last":0.94399999999999995}]},{"osd":6,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.1399999999999999,"15min":1.204},"min":{"1min":0.74299999999999999,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.2529999999999999,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.1539999999999999,"15min":1.1950000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.288,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":1.0009999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0680000000000001,"15min":1.0900000000000001},"min":{"1min":0.755,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.202,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.2070000000000001,"15min":1.2350000000000001},"min":{"1min":0.88700000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3180000000000001,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.85599999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509485,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14052,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":13504,"kb_avail":94357788,"statfs":{"total":96636764160,"available":96622374912,"internally_reserved":0,"allocated":552960,"data_stored":235694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13828096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.56499999999999995,"15min":0.52800000000000002},"min":{"1min":0.36599999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.86499999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.65800000000000003,"15min":0.61699999999999999},"min":{"1min":0.496,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.034,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":1.177}]},{"osd":1,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.67600000000000005,"15min":0.621},"min":{"1min":0.56699999999999995,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1639999999999999,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.63200000000000001,"15min":0.58999999999999997},"min":{"1min":0.47899999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.70099999999999996}]},{"osd":3,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.67300000000000004,"15min":0.623},"min":{"1min":0.52900000000000003,"5min":0.224,"15min":0.224},"max":{"1min":1.0269999999999999,"5min":1.246,"15min":1.246},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.78200000000000003,"15min":0.72199999999999998},"min":{"1min":0.60599999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.93799999999999994}]},{"osd":4,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.878,"15min":0.84399999999999997},"min":{"1min":0.625,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.23,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.071,"5min":0.95499999999999996,"15min":0.91300000000000003},"min":{"1min":0.67000000000000004,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.347,"5min":1.399,"15min":1.399},"last":1.0529999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.90800000000000003,"15min":0.86199999999999999},"min":{"1min":0.70999999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.091,"5min":0.99099999999999999,"15min":0.93999999999999995},"min":{"1min":0.76200000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.2549999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.099}]},{"osd":6,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.93799999999999994,"15min":0.91300000000000003},"min":{"1min":0.82199999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.131},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.002,"15min":0.96399999999999997},"min":{"1min":0.68799999999999994,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3899999999999999,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.96299999999999997}]},{"osd":7,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.054,"15min":1.004},"min":{"1min":0.72299999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4179999999999999,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.272},{"interface":"front","average":{"1min":1.111,"5min":0.99099999999999999,"15min":0.95699999999999996},"min":{"1min":0.77800000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.98099999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509484,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13860,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":13312,"kb_avail":94357980,"statfs":{"total":96636764160,"available":96622571520,"internally_reserved":0,"allocated":552960,"data_stored":235454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13631488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.57599999999999996,"15min":0.54500000000000004},"min":{"1min":0.51400000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.58299999999999996,"15min":0.50900000000000001},"min":{"1min":0.503,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.0309999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.45600000000000002}]},{"osd":2,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.59099999999999997,"15min":0.54700000000000004},"min":{"1min":0.55200000000000005,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.88,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.71799999999999997,"15min":0.66200000000000003},"min":{"1min":0.72699999999999998,"5min":0.312,"15min":0.312},"max":{"1min":1.1439999999999999,"5min":1.169,"15min":1.169},"last":0.51000000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.68799999999999994,"15min":0.63100000000000001},"min":{"1min":0.59899999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.091,"5min":1.27,"15min":1.27},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.64300000000000002,"15min":0.57899999999999996},"min":{"1min":0.55600000000000005,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0549999999999999,"5min":1.27,"15min":1.27},"last":0.59699999999999998}]},{"osd":4,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.83399999999999996,"15min":0.79800000000000004},"min":{"1min":0.70399999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.143,"5min":1.202,"15min":1.202},"last":0.72099999999999997},{"interface":"front","average":{"1min":1.0349999999999999,"5min":0.91800000000000004,"15min":0.88800000000000001},"min":{"1min":0.84899999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.86799999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":0.91200000000000003,"15min":0.85799999999999998},"min":{"1min":0.72499999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.339,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.747},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.88900000000000001,"15min":0.84899999999999998},"min":{"1min":0.82499999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.284,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.83299999999999996}]},{"osd":6,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":0.96999999999999997,"15min":0.92200000000000004},"min":{"1min":0.96499999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2589999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.028,"5min":0.94099999999999995,"15min":0.89100000000000001},"min":{"1min":0.80400000000000005,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2270000000000001,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.88800000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":0.99099999999999999,"15min":0.93600000000000005},"min":{"1min":0.83399999999999996,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.95699999999999996,"15min":0.89900000000000002},"min":{"1min":0.85399999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3759999999999999,"5min":1.649,"15min":1.649},"last":0.95399999999999996}]}]},{"osd":3,"up_from":14,"seq":60129542188,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22980,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":22464,"kb_avail":94348860,"statfs":{"total":96636764160,"available":96613232640,"internally_reserved":0,"allocated":520192,"data_stored":221538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23003136},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.60899999999999999,"15min":0.57099999999999995},"min":{"1min":0.318,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.67100000000000004,"15min":0.64300000000000002},"min":{"1min":0.34999999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.198,"5min":1.236,"15min":1.236},"last":0.621}]},{"osd":1,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.65600000000000003,"15min":0.624},"min":{"1min":0.41999999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.95699999999999996,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.70099999999999996,"15min":0.66100000000000003},"min":{"1min":0.435,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.028,"5min":1.222,"15min":1.222},"last":1.006}]},{"osd":2,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.751,"15min":0.70699999999999996},"min":{"1min":0.45900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0740000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.67600000000000005,"15min":0.626},"min":{"1min":0.33600000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.0780000000000001,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":1.177}]},{"osd":4,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.93300000000000005,"15min":0.91100000000000003},"min":{"1min":0.70399999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.411,"5min":1.496,"15min":1.496},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.0620000000000001,"5min":0.95899999999999996,"15min":0.93200000000000005},"min":{"1min":0.754,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":1.1160000000000001}]},{"osd":5,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.90500000000000003,"15min":0.878},"min":{"1min":0.75,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.365,"5min":1.51,"15min":1.51},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.014,"15min":0.996},"min":{"1min":0.74099999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.0469999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.94699999999999995,"15min":0.92000000000000004},"min":{"1min":0.67200000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2450000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.091,"5min":1.024,"15min":0.98699999999999999},"min":{"1min":0.77600000000000002,"5min":0.625,"15min":0.625},"max":{"1min":1.323,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.147}]},{"osd":7,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.032,"15min":1.004},"min":{"1min":0.79100000000000004,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.4470000000000001,"5min":1.597,"15min":1.597},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.0489999999999999,"15min":1.0169999999999999},"min":{"1min":0.71799999999999997,"5min":0.623,"15min":0.623},"max":{"1min":1.377,"5min":1.708,"15min":1.708},"last":1.264}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15272,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":14720,"kb_avail":94356568,"statfs":{"total":96636764160,"available":96621125632,"internally_reserved":0,"allocated":557056,"data_stored":241947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15073280},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.84299999999999997,"15min":0.82099999999999995},"min":{"1min":0.55900000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2230000000000001,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.85899999999999999,"15min":0.85299999999999998},"min":{"1min":0.65700000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1499999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.86899999999999999}]},{"osd":1,"last update":"Tue Oct 3 19:15:28 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.85299999999999998,"15min":0.83399999999999996},"min":{"1min":0.628,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.93000000000000005,"15min":0.92900000000000005},"min":{"1min":0.58699999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1799999999999999,"5min":1.514,"15min":1.514},"last":0.76300000000000001}]},{"osd":2,"last update":"Tue Oct 3 19:15:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.91400000000000003,"15min":0.90000000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3280000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.90600000000000003,"15min":0.89600000000000002},"min":{"1min":0.60999999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1599999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.84299999999999997}]},{"osd":3,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.92300000000000004,"15min":0.92500000000000004},"min":{"1min":0.68899999999999995,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.149,"5min":1.304,"15min":1.304},"last":1.075},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.038,"15min":1.0289999999999999},"min":{"1min":0.89500000000000002,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.2490000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.91700000000000004}]},{"osd":4,"last update":"Tue Oct 3 19:15:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97399999999999998,"15min":0.97199999999999998},"min":{"1min":0.66400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.999,"5min":1.0149999999999999,"15min":1.0369999999999999},"min":{"1min":0.72099999999999997,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.335,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.63400000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:15:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.01,"15min":1.038},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.266,"5min":1.462,"15min":1.462},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.133,"15min":1.1419999999999999},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":0.81100000000000005}]},{"osd":7,"last update":"Tue Oct 3 19:15:28 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.079},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.381,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.129,"5min":1.1459999999999999,"15min":1.1539999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.357,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.1519999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15404,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":14784,"kb_avail":94356436,"statfs":{"total":96636764160,"available":96620990464,"internally_reserved":0,"allocated":626688,"data_stored":831207,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":15138816},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.61399999999999999,"15min":0.57999999999999996},"min":{"1min":0.47499999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.92800000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73399999999999999,"15min":0.71199999999999997},"min":{"1min":0.54900000000000004,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0800000000000001,"5min":1.27,"15min":1.27},"last":0.72899999999999998}]},{"osd":2,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.72499999999999998,"15min":0.71399999999999997},"min":{"1min":0.49199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.131,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70199999999999996,"15min":0.68999999999999995},"min":{"1min":0.44500000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.98199999999999998,"5min":1.548,"15min":1.548},"last":0.46800000000000003}]},{"osd":3,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.78300000000000003,"15min":0.72399999999999998},"min":{"1min":0.65900000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.75900000000000001,"15min":0.69599999999999995},"min":{"1min":0.51200000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.51000000000000001}]},{"osd":4,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.91200000000000003,"15min":0.90600000000000003},"min":{"1min":0.71299999999999997,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1539999999999999,"5min":1.355,"15min":1.355},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.048,"5min":1.034,"15min":1.022},"min":{"1min":0.82499999999999996,"5min":0.504,"15min":0.504},"max":{"1min":1.3140000000000001,"5min":1.508,"15min":1.508},"last":0.95599999999999996}]},{"osd":5,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0569999999999999,"15min":1.0449999999999999},"min":{"1min":0.85599999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.087,"5min":0.997,"15min":0.97399999999999998},"min":{"1min":0.82599999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.371,"5min":1.444,"15min":1.444},"last":0.93000000000000005}]},{"osd":6,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.034,"15min":1.014},"min":{"1min":0.77600000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.427,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.099,"5min":1.018,"15min":0.99199999999999999},"min":{"1min":0.83899999999999997,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.79700000000000004}]},{"osd":7,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.0660000000000001,"15min":1.036},"min":{"1min":0.90200000000000002,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.3919999999999999,"5min":1.407,"15min":1.407},"last":0.878},{"interface":"front","average":{"1min":1.149,"5min":1.0780000000000001,"15min":1.0600000000000001},"min":{"1min":0.78500000000000003,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.76300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:15:52.071 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:15:52.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.203+0000 7f080d619640 1 Processor -- start 2023-10-03T19:15:52.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.203+0000 7f080d619640 1 -- start start 2023-10-03T19:15:52.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.203+0000 7f080d619640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f080806cd40 0x7f080814aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:52.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.203+0000 7f080d619640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08080bc430 con 0x7f08080a3670 2023-10-03T19:15:52.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.203+0000 7f080d619640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08080baf60 con 0x7f0808147ab0 2023-10-03T19:15:52.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.203+0000 7f080d619640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08080a5db0 con 0x7f080806cd40 2023-10-03T19:15:52.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.203+0000 7f08067fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f08080a3670 0x7f08080bbd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50782/0 (socket says 172.21.15.45:50782) 2023-10-03T19:15:52.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.203+0000 7f08067fc640 1 -- 172.21.15.45:0/2435809836 learned_addr learned my addr 172.21.15.45:0/2435809836 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:15:52.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.203+0000 7f0806ffd640 1 --2- 172.21.15.45:0/2435809836 >> v2:172.21.15.45:3300/0 conn(0x7f080806cd40 0x7f080814aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:52.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.203+0000 7f0805ffb640 1 -- 172.21.15.45:0/2435809836 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4199507790 0 0) 0x7f08080bc430 con 0x7f08080a3670 2023-10-03T19:15:52.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.203+0000 7f0805ffb640 1 -- 172.21.15.45:0/2435809836 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07f0003530 con 0x7f08080a3670 2023-10-03T19:15:52.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.203+0000 7f0806ffd640 1 -- 172.21.15.45:0/2435809836 >> v1:172.21.15.79:6789/0 conn(0x7f0808147ab0 legacy=0x7f08081553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:52.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.203+0000 7f0806ffd640 1 -- 172.21.15.45:0/2435809836 >> v1:172.21.15.45:6789/0 conn(0x7f08080a3670 legacy=0x7f08080bbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:52.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.203+0000 7f0806ffd640 1 -- 172.21.15.45:0/2435809836 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08080bb240 con 0x7f080806cd40 2023-10-03T19:15:52.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.207+0000 7f0806ffd640 1 --2- 172.21.15.45:0/2435809836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f080806cd40 0x7f080814aa50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f07f800a960 tx=0x7f07f8020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687a074324ff15c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:52.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.207+0000 7f0805ffb640 1 -- 172.21.15.45:0/2435809836 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f80a9e50 con 0x7f080806cd40 2023-10-03T19:15:52.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.207+0000 7f0805ffb640 1 -- 172.21.15.45:0/2435809836 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f80b1440 con 0x7f080806cd40 2023-10-03T19:15:52.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.207+0000 7f0805ffb640 1 -- 172.21.15.45:0/2435809836 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f80b17d0 con 0x7f080806cd40 2023-10-03T19:15:52.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.207+0000 7f080d619640 1 -- 172.21.15.45:0/2435809836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f080806cd40 msgr2=0x7f080814aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:52.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.207+0000 7f080d619640 1 --2- 172.21.15.45:0/2435809836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f080806cd40 0x7f080814aa50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f07f800a960 tx=0x7f07f8020040 comp rx=0 tx=0).stop 2023-10-03T19:15:52.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.207+0000 7f080d619640 1 -- 172.21.15.45:0/2435809836 shutdown_connections 2023-10-03T19:15:52.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.207+0000 7f080d619640 1 --2- 172.21.15.45:0/2435809836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f080806cd40 0x7f080814aa50 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:52.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.207+0000 7f080d619640 1 -- 172.21.15.45:0/2435809836 >> 172.21.15.45:0/2435809836 conn(0x7f08080bcf50 msgr2=0x7f08080bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:52.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.207+0000 7f080d619640 1 -- 172.21.15.45:0/2435809836 shutdown_connections 2023-10-03T19:15:52.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.207+0000 7f080d619640 1 -- 172.21.15.45:0/2435809836 wait complete. 2023-10-03T19:15:52.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.207+0000 7f080d619640 1 Processor -- start 2023-10-03T19:15:52.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.207+0000 7f080d619640 1 -- start start 2023-10-03T19:15:52.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.207+0000 7f080d619640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f080806cd40 0x7f08080717c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:52.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.207+0000 7f080d619640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08080a3670 0x7f080814ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:52.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.207+0000 7f080d619640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0808147ab0 0x7f080814d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:52.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.207+0000 7f080d619640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0808071d00 con 0x7f0808147ab0 2023-10-03T19:15:52.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.207+0000 7f080d619640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080814ef80 con 0x7f08080a3670 2023-10-03T19:15:52.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.207+0000 7f080d619640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080814dff0 con 0x7f080806cd40 2023-10-03T19:15:52.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.207+0000 7f08077fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0808147ab0 0x7f080814d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:52.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.207+0000 7f08077fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0808147ab0 0x7f080814d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37794/0 (socket says 172.21.15.45:37794) 2023-10-03T19:15:52.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.207+0000 7f08077fe640 1 -- 172.21.15.45:0/3966243161 learned_addr learned my addr 172.21.15.45:0/3966243161 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:52.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.207+0000 7f08067fc640 1 --2- 172.21.15.45:0/3966243161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08080a3670 0x7f080814ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:52.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.207+0000 7f0806ffd640 1 --2- 172.21.15.45:0/3966243161 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f080806cd40 0x7f08080717c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:52.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.207+0000 7f08077fe640 1 -- 172.21.15.45:0/3966243161 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f080806cd40 msgr2=0x7f08080717c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:52.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.207+0000 7f08077fe640 1 --2- 172.21.15.45:0/3966243161 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f080806cd40 0x7f08080717c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:52.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.207+0000 7f08077fe640 1 -- 172.21.15.45:0/3966243161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08080a3670 msgr2=0x7f080814ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:52.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.207+0000 7f08077fe640 1 --2- 172.21.15.45:0/3966243161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08080a3670 0x7f080814ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:52.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.207+0000 7f08077fe640 1 -- 172.21.15.45:0/3966243161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f800a5c0 con 0x7f0808147ab0 2023-10-03T19:15:52.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.207+0000 7f08077fe640 1 --2- 172.21.15.45:0/3966243161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0808147ab0 0x7f080814d3e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f080000c790 tx=0x7f080000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:52.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.211+0000 7f07ef7fe640 1 -- 172.21.15.45:0/3966243161 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080000cea0 con 0x7f0808147ab0 2023-10-03T19:15:52.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.211+0000 7f07ef7fe640 1 -- 172.21.15.45:0/3966243161 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0800003b80 con 0x7f0808147ab0 2023-10-03T19:15:52.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.211+0000 7f080d619640 1 -- 172.21.15.45:0/3966243161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08080bb800 con 0x7f0808147ab0 2023-10-03T19:15:52.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.211+0000 7f07ef7fe640 1 -- 172.21.15.45:0/3966243161 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080000a7f0 con 0x7f0808147ab0 2023-10-03T19:15:52.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.211+0000 7f080d619640 1 -- 172.21.15.45:0/3966243161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08080bb520 con 0x7f0808147ab0 2023-10-03T19:15:52.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.211+0000 7f080d619640 1 -- 172.21.15.45:0/3966243161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08080bcc90 con 0x7f0808147ab0 2023-10-03T19:15:52.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.211+0000 7f07ef7fe640 1 -- 172.21.15.45:0/3966243161 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f080000a950 con 0x7f0808147ab0 2023-10-03T19:15:52.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.211+0000 7f07ef7fe640 1 --2- 172.21.15.45:0/3966243161 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f07f4066280 0x7f07f4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:52.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.211+0000 7f07ef7fe640 1 -- 172.21.15.45:0/3966243161 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0800083b30 con 0x7f0808147ab0 2023-10-03T19:15:52.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.211+0000 7f0806ffd640 1 --2- 172.21.15.45:0/3966243161 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f07f4066280 0x7f07f4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:52.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.211+0000 7f0806ffd640 1 --2- 172.21.15.45:0/3966243161 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f07f4066280 0x7f07f4068730 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f07f80b3000 tx=0x7f07f80ab070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:52.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.215+0000 7f07ef7fe640 1 -- 172.21.15.45:0/3966243161 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0800050f20 con 0x7f0808147ab0 2023-10-03T19:15:52.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.367+0000 7f080d619640 1 -- 172.21.15.45:0/3966243161 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f080804de80 con 0x7f07f4066280 2023-10-03T19:15:52.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.391+0000 7f07ef7fe640 1 -- 172.21.15.45:0/3966243161 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309401 (secure 0 0 0) 0x7f080804de80 con 0x7f07f4066280 2023-10-03T19:15:52.440 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:15:52.442 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:15:52.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.395+0000 7f080d619640 1 -- 172.21.15.45:0/3966243161 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f07f4066280 msgr2=0x7f07f4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:52.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.395+0000 7f080d619640 1 --2- 172.21.15.45:0/3966243161 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f07f4066280 0x7f07f4068730 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f07f80b3000 tx=0x7f07f80ab070 comp rx=0 tx=0).stop 2023-10-03T19:15:52.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.395+0000 7f080d619640 1 -- 172.21.15.45:0/3966243161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0808147ab0 msgr2=0x7f080814d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:52.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.395+0000 7f080d619640 1 --2- 172.21.15.45:0/3966243161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0808147ab0 0x7f080814d3e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f080000c790 tx=0x7f080000cc50 comp rx=0 tx=0).stop 2023-10-03T19:15:52.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.395+0000 7f080d619640 1 -- 172.21.15.45:0/3966243161 shutdown_connections 2023-10-03T19:15:52.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.395+0000 7f080d619640 1 --2- 172.21.15.45:0/3966243161 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f07f4066280 0x7f07f4068730 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:52.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.395+0000 7f080d619640 1 --2- 172.21.15.45:0/3966243161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0808147ab0 0x7f080814d3e0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:52.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.395+0000 7f080d619640 1 --2- 172.21.15.45:0/3966243161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08080a3670 0x7f080814ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:52.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.395+0000 7f080d619640 1 --2- 172.21.15.45:0/3966243161 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f080806cd40 0x7f08080717c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:52.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.395+0000 7f080d619640 1 -- 172.21.15.45:0/3966243161 >> 172.21.15.45:0/3966243161 conn(0x7f08080bcf50 msgr2=0x7f08080678a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:52.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.395+0000 7f080d619640 1 -- 172.21.15.45:0/3966243161 shutdown_connections 2023-10-03T19:15:52.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.395+0000 7f080d619640 1 -- 172.21.15.45:0/3966243161 wait complete. 2023-10-03T19:15:52.445 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2023-10-03T19:15:50.515242+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142,"ondisk_log_size":142,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":108,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":134148,"kb_used_data":4420,"kb_used_omap":0,"kb_used_meta":129664,"kb_avail":754840572,"statfs":{"total":773094113280,"available":772956745728,"internally_reserved":0,"allocated":4526080,"data_stored":3062284,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":132775936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":67,"apply_latency_ms":67,"commit_latency_ns":67000000,"apply_latency_ns":67000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.705945"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.395366+0000","last_change":"2023-10-03T19:15:46.394210+0000","last_active":"2023-10-03T19:15:46.395366+0000","last_peered":"2023-10-03T19:15:46.395366+0000","last_clean":"2023-10-03T19:15:46.395366+0000","last_became_active":"2023-10-03T19:15:46.393845+0000","last_became_peered":"2023-10-03T19:15:46.393845+0000","last_unstale":"2023-10-03T19:15:46.395366+0000","last_undegraded":"2023-10-03T19:15:46.395366+0000","last_fullsized":"2023-10-03T19:15:46.395366+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:15:31.305120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.404180+0000","last_change":"2023-10-03T19:15:46.398709+0000","last_active":"2023-10-03T19:15:46.404180+0000","last_peered":"2023-10-03T19:15:46.404180+0000","last_clean":"2023-10-03T19:15:46.404180+0000","last_became_active":"2023-10-03T19:15:46.397955+0000","last_became_peered":"2023-10-03T19:15:46.397955+0000","last_unstale":"2023-10-03T19:15:46.404180+0000","last_undegraded":"2023-10-03T19:15:46.404180+0000","last_fullsized":"2023-10-03T19:15:46.404180+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:16:53.957508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160021+0000","last_change":"2023-10-03T19:15:46.364679+0000","last_active":"2023-10-03T19:15:48.160021+0000","last_peered":"2023-10-03T19:15:48.160021+0000","last_clean":"2023-10-03T19:15:48.160021+0000","last_became_active":"2023-10-03T19:15:46.360555+0000","last_became_peered":"2023-10-03T19:15:46.360555+0000","last_unstale":"2023-10-03T19:15:48.160021+0000","last_undegraded":"2023-10-03T19:15:48.160021+0000","last_fullsized":"2023-10-03T19:15:48.160021+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:33:29.425810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.391750+0000","last_change":"2023-10-03T19:15:46.379223+0000","last_active":"2023-10-03T19:15:46.391750+0000","last_peered":"2023-10-03T19:15:46.391750+0000","last_clean":"2023-10-03T19:15:46.391750+0000","last_became_active":"2023-10-03T19:15:46.378548+0000","last_became_peered":"2023-10-03T19:15:46.378548+0000","last_unstale":"2023-10-03T19:15:46.391750+0000","last_undegraded":"2023-10-03T19:15:46.391750+0000","last_fullsized":"2023-10-03T19:15:46.391750+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:35:52.686944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.389092+0000","last_change":"2023-10-03T19:15:46.382245+0000","last_active":"2023-10-03T19:15:46.389092+0000","last_peered":"2023-10-03T19:15:46.389092+0000","last_clean":"2023-10-03T19:15:46.389092+0000","last_became_active":"2023-10-03T19:15:46.381558+0000","last_became_peered":"2023-10-03T19:15:46.381558+0000","last_unstale":"2023-10-03T19:15:46.389092+0000","last_undegraded":"2023-10-03T19:15:46.389092+0000","last_fullsized":"2023-10-03T19:15:46.389092+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:32:37.131879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.364981+0000","last_change":"2023-10-03T19:15:46.363085+0000","last_active":"2023-10-03T19:15:46.364981+0000","last_peered":"2023-10-03T19:15:46.364981+0000","last_clean":"2023-10-03T19:15:46.364981+0000","last_became_active":"2023-10-03T19:15:46.362532+0000","last_became_peered":"2023-10-03T19:15:46.362532+0000","last_unstale":"2023-10-03T19:15:46.364981+0000","last_undegraded":"2023-10-03T19:15:46.364981+0000","last_fullsized":"2023-10-03T19:15:46.364981+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:12:14.696723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158898+0000","last_change":"2023-10-03T19:15:46.364944+0000","last_active":"2023-10-03T19:15:48.158898+0000","last_peered":"2023-10-03T19:15:48.158898+0000","last_clean":"2023-10-03T19:15:48.158898+0000","last_became_active":"2023-10-03T19:15:46.364685+0000","last_became_peered":"2023-10-03T19:15:46.364685+0000","last_unstale":"2023-10-03T19:15:48.158898+0000","last_undegraded":"2023-10-03T19:15:48.158898+0000","last_fullsized":"2023-10-03T19:15:48.158898+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:39:43.145618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.824309+0000","last_change":"2023-10-03T19:15:45.824309+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.824309+0000","last_undegraded":"2023-10-03T19:15:45.824309+0000","last_fullsized":"2023-10-03T19:15:45.824309+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.824018+0000","last_change":"2023-10-03T19:15:45.824018+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.824018+0000","last_undegraded":"2023-10-03T19:15:45.824018+0000","last_fullsized":"2023-10-03T19:15:45.824018+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.363671+0000","last_change":"2023-10-03T19:15:46.362303+0000","last_active":"2023-10-03T19:15:46.363671+0000","last_peered":"2023-10-03T19:15:46.363671+0000","last_clean":"2023-10-03T19:15:46.363671+0000","last_became_active":"2023-10-03T19:15:46.362001+0000","last_became_peered":"2023-10-03T19:15:46.362001+0000","last_unstale":"2023-10-03T19:15:46.363671+0000","last_undegraded":"2023-10-03T19:15:46.363671+0000","last_fullsized":"2023-10-03T19:15:46.363671+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:36:05.401390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.368856+0000","last_change":"2023-10-03T19:15:46.367695+0000","last_active":"2023-10-03T19:15:46.368856+0000","last_peered":"2023-10-03T19:15:46.368856+0000","last_clean":"2023-10-03T19:15:46.368856+0000","last_became_active":"2023-10-03T19:15:46.367450+0000","last_became_peered":"2023-10-03T19:15:46.367450+0000","last_unstale":"2023-10-03T19:15:46.368856+0000","last_undegraded":"2023-10-03T19:15:46.368856+0000","last_fullsized":"2023-10-03T19:15:46.368856+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:27:40.278413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.821529+0000","last_change":"2023-10-03T19:15:45.821529+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.821529+0000","last_undegraded":"2023-10-03T19:15:45.821529+0000","last_fullsized":"2023-10-03T19:15:45.821529+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.367008+0000","last_change":"2023-10-03T19:15:46.365193+0000","last_active":"2023-10-03T19:15:46.367008+0000","last_peered":"2023-10-03T19:15:46.367008+0000","last_clean":"2023-10-03T19:15:46.367008+0000","last_became_active":"2023-10-03T19:15:46.364040+0000","last_became_peered":"2023-10-03T19:15:46.364040+0000","last_unstale":"2023-10-03T19:15:46.367008+0000","last_undegraded":"2023-10-03T19:15:46.367008+0000","last_fullsized":"2023-10-03T19:15:46.367008+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:50:01.514952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159667+0000","last_change":"2023-10-03T19:15:46.364760+0000","last_active":"2023-10-03T19:15:48.159667+0000","last_peered":"2023-10-03T19:15:48.159667+0000","last_clean":"2023-10-03T19:15:48.159667+0000","last_became_active":"2023-10-03T19:15:46.360362+0000","last_became_peered":"2023-10-03T19:15:46.360362+0000","last_unstale":"2023-10-03T19:15:48.159667+0000","last_undegraded":"2023-10-03T19:15:48.159667+0000","last_fullsized":"2023-10-03T19:15:48.159667+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:25:27.749340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.392013+0000","last_change":"2023-10-03T19:15:46.379695+0000","last_active":"2023-10-03T19:15:46.392013+0000","last_peered":"2023-10-03T19:15:46.392013+0000","last_clean":"2023-10-03T19:15:46.392013+0000","last_became_active":"2023-10-03T19:15:46.378968+0000","last_became_peered":"2023-10-03T19:15:46.378968+0000","last_unstale":"2023-10-03T19:15:46.392013+0000","last_undegraded":"2023-10-03T19:15:46.392013+0000","last_fullsized":"2023-10-03T19:15:46.392013+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:30:42.698489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.363698+0000","last_change":"2023-10-03T19:15:46.362453+0000","last_active":"2023-10-03T19:15:46.363698+0000","last_peered":"2023-10-03T19:15:46.363698+0000","last_clean":"2023-10-03T19:15:46.363698+0000","last_became_active":"2023-10-03T19:15:46.361895+0000","last_became_peered":"2023-10-03T19:15:46.361895+0000","last_unstale":"2023-10-03T19:15:46.363698+0000","last_undegraded":"2023-10-03T19:15:46.363698+0000","last_fullsized":"2023-10-03T19:15:46.363698+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:11:36.629198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160719+0000","last_change":"2023-10-03T19:15:46.400243+0000","last_active":"2023-10-03T19:15:48.160719+0000","last_peered":"2023-10-03T19:15:48.160719+0000","last_clean":"2023-10-03T19:15:48.160719+0000","last_became_active":"2023-10-03T19:15:46.399983+0000","last_became_peered":"2023-10-03T19:15:46.399983+0000","last_unstale":"2023-10-03T19:15:48.160719+0000","last_undegraded":"2023-10-03T19:15:48.160719+0000","last_fullsized":"2023-10-03T19:15:48.160719+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:53:20.933525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.404210+0000","last_change":"2023-10-03T19:15:46.399010+0000","last_active":"2023-10-03T19:15:46.404210+0000","last_peered":"2023-10-03T19:15:46.404210+0000","last_clean":"2023-10-03T19:15:46.404210+0000","last_became_active":"2023-10-03T19:15:46.397599+0000","last_became_peered":"2023-10-03T19:15:46.397599+0000","last_unstale":"2023-10-03T19:15:46.404210+0000","last_undegraded":"2023-10-03T19:15:46.404210+0000","last_fullsized":"2023-10-03T19:15:46.404210+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:41:36.252764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160430+0000","last_change":"2023-10-03T19:15:46.377306+0000","last_active":"2023-10-03T19:15:48.160430+0000","last_peered":"2023-10-03T19:15:48.160430+0000","last_clean":"2023-10-03T19:15:48.160430+0000","last_became_active":"2023-10-03T19:15:46.377041+0000","last_became_peered":"2023-10-03T19:15:46.377041+0000","last_unstale":"2023-10-03T19:15:48.160430+0000","last_undegraded":"2023-10-03T19:15:48.160430+0000","last_fullsized":"2023-10-03T19:15:48.160430+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:26:46.602249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.392879+0000","last_change":"2023-10-03T19:15:46.388939+0000","last_active":"2023-10-03T19:15:46.392879+0000","last_peered":"2023-10-03T19:15:46.392879+0000","last_clean":"2023-10-03T19:15:46.392879+0000","last_became_active":"2023-10-03T19:15:46.388201+0000","last_became_peered":"2023-10-03T19:15:46.388201+0000","last_unstale":"2023-10-03T19:15:46.392879+0000","last_undegraded":"2023-10-03T19:15:46.392879+0000","last_fullsized":"2023-10-03T19:15:46.392879+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:51:41.830735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.399238+0000","last_change":"2023-10-03T19:15:46.393014+0000","last_active":"2023-10-03T19:15:46.399238+0000","last_peered":"2023-10-03T19:15:46.399238+0000","last_clean":"2023-10-03T19:15:46.399238+0000","last_became_active":"2023-10-03T19:15:46.392401+0000","last_became_peered":"2023-10-03T19:15:46.392401+0000","last_unstale":"2023-10-03T19:15:46.399238+0000","last_undegraded":"2023-10-03T19:15:46.399238+0000","last_fullsized":"2023-10-03T19:15:46.399238+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:59:22.380642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.825371+0000","last_change":"2023-10-03T19:15:45.825371+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.825371+0000","last_undegraded":"2023-10-03T19:15:45.825371+0000","last_fullsized":"2023-10-03T19:15:45.825371+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.380160+0000","last_change":"2023-10-03T19:15:46.378934+0000","last_active":"2023-10-03T19:15:46.380160+0000","last_peered":"2023-10-03T19:15:46.380160+0000","last_clean":"2023-10-03T19:15:46.380160+0000","last_became_active":"2023-10-03T19:15:46.378611+0000","last_became_peered":"2023-10-03T19:15:46.378611+0000","last_unstale":"2023-10-03T19:15:46.380160+0000","last_undegraded":"2023-10-03T19:15:46.380160+0000","last_fullsized":"2023-10-03T19:15:46.380160+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:43:48.510914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158761+0000","last_change":"2023-10-03T19:15:46.360949+0000","last_active":"2023-10-03T19:15:48.158761+0000","last_peered":"2023-10-03T19:15:48.158761+0000","last_clean":"2023-10-03T19:15:48.158761+0000","last_became_active":"2023-10-03T19:15:46.360658+0000","last_became_peered":"2023-10-03T19:15:46.360658+0000","last_unstale":"2023-10-03T19:15:48.158761+0000","last_undegraded":"2023-10-03T19:15:48.158761+0000","last_fullsized":"2023-10-03T19:15:48.158761+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:03:34.243331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160900+0000","last_change":"2023-10-03T19:15:46.368683+0000","last_active":"2023-10-03T19:15:48.160900+0000","last_peered":"2023-10-03T19:15:48.160900+0000","last_clean":"2023-10-03T19:15:48.160900+0000","last_became_active":"2023-10-03T19:15:46.368390+0000","last_became_peered":"2023-10-03T19:15:46.368390+0000","last_unstale":"2023-10-03T19:15:48.160900+0000","last_undegraded":"2023-10-03T19:15:48.160900+0000","last_fullsized":"2023-10-03T19:15:48.160900+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:03:04.832859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.828249+0000","last_change":"2023-10-03T19:15:45.828249+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.828249+0000","last_undegraded":"2023-10-03T19:15:45.828249+0000","last_fullsized":"2023-10-03T19:15:45.828249+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.355757+0000","last_change":"2023-10-03T19:15:46.353768+0000","last_active":"2023-10-03T19:15:46.355757+0000","last_peered":"2023-10-03T19:15:46.355757+0000","last_clean":"2023-10-03T19:15:46.355757+0000","last_became_active":"2023-10-03T19:15:46.353516+0000","last_became_peered":"2023-10-03T19:15:46.353516+0000","last_unstale":"2023-10-03T19:15:46.355757+0000","last_undegraded":"2023-10-03T19:15:46.355757+0000","last_fullsized":"2023-10-03T19:15:46.355757+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:22:07.225725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.386197+0000","last_change":"2023-10-03T19:15:46.375987+0000","last_active":"2023-10-03T19:15:46.386197+0000","last_peered":"2023-10-03T19:15:46.386197+0000","last_clean":"2023-10-03T19:15:46.386197+0000","last_became_active":"2023-10-03T19:15:46.375284+0000","last_became_peered":"2023-10-03T19:15:46.375284+0000","last_unstale":"2023-10-03T19:15:46.386197+0000","last_undegraded":"2023-10-03T19:15:46.386197+0000","last_fullsized":"2023-10-03T19:15:46.386197+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:52:49.683952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159751+0000","last_change":"2023-10-03T19:15:46.374991+0000","last_active":"2023-10-03T19:15:48.159751+0000","last_peered":"2023-10-03T19:15:48.159751+0000","last_clean":"2023-10-03T19:15:48.159751+0000","last_became_active":"2023-10-03T19:15:46.374699+0000","last_became_peered":"2023-10-03T19:15:46.374699+0000","last_unstale":"2023-10-03T19:15:48.159751+0000","last_undegraded":"2023-10-03T19:15:48.159751+0000","last_fullsized":"2023-10-03T19:15:48.159751+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:38:41.035694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.395049+0000","last_change":"2023-10-03T19:15:46.380983+0000","last_active":"2023-10-03T19:15:46.395049+0000","last_peered":"2023-10-03T19:15:46.395049+0000","last_clean":"2023-10-03T19:15:46.395049+0000","last_became_active":"2023-10-03T19:15:46.380216+0000","last_became_peered":"2023-10-03T19:15:46.380216+0000","last_unstale":"2023-10-03T19:15:46.395049+0000","last_undegraded":"2023-10-03T19:15:46.395049+0000","last_fullsized":"2023-10-03T19:15:46.395049+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:18:04.258221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159168+0000","last_change":"2023-10-03T19:15:46.361191+0000","last_active":"2023-10-03T19:15:48.159168+0000","last_peered":"2023-10-03T19:15:48.159168+0000","last_clean":"2023-10-03T19:15:48.159168+0000","last_became_active":"2023-10-03T19:15:46.360817+0000","last_became_peered":"2023-10-03T19:15:46.360817+0000","last_unstale":"2023-10-03T19:15:48.159168+0000","last_undegraded":"2023-10-03T19:15:48.159168+0000","last_fullsized":"2023-10-03T19:15:48.159168+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:09:39.321340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.348033+0000","last_change":"2023-10-03T19:15:46.399112+0000","last_active":"2023-10-03T19:15:47.348033+0000","last_peered":"2023-10-03T19:15:47.348033+0000","last_clean":"2023-10-03T19:15:47.348033+0000","last_became_active":"2023-10-03T19:15:46.398515+0000","last_became_peered":"2023-10-03T19:15:46.398515+0000","last_unstale":"2023-10-03T19:15:47.348033+0000","last_undegraded":"2023-10-03T19:15:47.348033+0000","last_fullsized":"2023-10-03T19:15:47.348033+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:34:48.331811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.405692+0000","last_change":"2023-10-03T19:15:46.403169+0000","last_active":"2023-10-03T19:15:46.405692+0000","last_peered":"2023-10-03T19:15:46.405692+0000","last_clean":"2023-10-03T19:15:46.405692+0000","last_became_active":"2023-10-03T19:15:46.402567+0000","last_became_peered":"2023-10-03T19:15:46.402567+0000","last_unstale":"2023-10-03T19:15:46.405692+0000","last_undegraded":"2023-10-03T19:15:46.405692+0000","last_fullsized":"2023-10-03T19:15:46.405692+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:50:20.113157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"47'4","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.390701+0000","last_change":"2023-10-03T19:15:45.859549+0000","last_active":"2023-10-03T19:15:46.390701+0000","last_peered":"2023-10-03T19:15:46.390701+0000","last_clean":"2023-10-03T19:15:46.390701+0000","last_became_active":"2023-10-03T19:15:45.859068+0000","last_became_peered":"2023-10-03T19:15:45.859068+0000","last_unstale":"2023-10-03T19:15:46.390701+0000","last_undegraded":"2023-10-03T19:15:46.390701+0000","last_fullsized":"2023-10-03T19:15:46.390701+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:10:08.995883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.348456+0000","last_change":"2023-10-03T19:15:46.398012+0000","last_active":"2023-10-03T19:15:47.348456+0000","last_peered":"2023-10-03T19:15:47.348456+0000","last_clean":"2023-10-03T19:15:47.348456+0000","last_became_active":"2023-10-03T19:15:46.396826+0000","last_became_peered":"2023-10-03T19:15:46.396826+0000","last_unstale":"2023-10-03T19:15:47.348456+0000","last_undegraded":"2023-10-03T19:15:47.348456+0000","last_fullsized":"2023-10-03T19:15:47.348456+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:01:43.218107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.349020+0000","last_change":"2023-10-03T19:15:45.849183+0000","last_active":"2023-10-03T19:15:46.349020+0000","last_peered":"2023-10-03T19:15:46.349020+0000","last_clean":"2023-10-03T19:15:46.349020+0000","last_became_active":"2023-10-03T19:15:45.848159+0000","last_became_peered":"2023-10-03T19:15:45.848159+0000","last_unstale":"2023-10-03T19:15:46.349020+0000","last_undegraded":"2023-10-03T19:15:46.349020+0000","last_fullsized":"2023-10-03T19:15:46.349020+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:32:36.127920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.400338+0000","last_change":"2023-10-03T19:15:46.393166+0000","last_active":"2023-10-03T19:15:46.400338+0000","last_peered":"2023-10-03T19:15:46.400338+0000","last_clean":"2023-10-03T19:15:46.400338+0000","last_became_active":"2023-10-03T19:15:46.392621+0000","last_became_peered":"2023-10-03T19:15:46.392621+0000","last_unstale":"2023-10-03T19:15:46.400338+0000","last_undegraded":"2023-10-03T19:15:46.400338+0000","last_fullsized":"2023-10-03T19:15:46.400338+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:24:01.426498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.352266+0000","last_change":"2023-10-03T19:15:45.856473+0000","last_active":"2023-10-03T19:15:46.352266+0000","last_peered":"2023-10-03T19:15:46.352266+0000","last_clean":"2023-10-03T19:15:46.352266+0000","last_became_active":"2023-10-03T19:15:45.856139+0000","last_became_peered":"2023-10-03T19:15:45.856139+0000","last_unstale":"2023-10-03T19:15:46.352266+0000","last_undegraded":"2023-10-03T19:15:46.352266+0000","last_fullsized":"2023-10-03T19:15:46.352266+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:52:53.713262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.827899+0000","last_change":"2023-10-03T19:15:45.827899+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.827899+0000","last_undegraded":"2023-10-03T19:15:45.827899+0000","last_fullsized":"2023-10-03T19:15:45.827899+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349975+0000","last_change":"2023-10-03T19:15:45.853261+0000","last_active":"2023-10-03T19:15:47.349975+0000","last_peered":"2023-10-03T19:15:47.349975+0000","last_clean":"2023-10-03T19:15:47.349975+0000","last_became_active":"2023-10-03T19:15:45.852517+0000","last_became_peered":"2023-10-03T19:15:45.852517+0000","last_unstale":"2023-10-03T19:15:47.349975+0000","last_undegraded":"2023-10-03T19:15:47.349975+0000","last_fullsized":"2023-10-03T19:15:47.349975+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:44:19.861675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.389003+0000","last_change":"2023-10-03T19:15:46.378648+0000","last_active":"2023-10-03T19:15:46.389003+0000","last_peered":"2023-10-03T19:15:46.389003+0000","last_clean":"2023-10-03T19:15:46.389003+0000","last_became_active":"2023-10-03T19:15:46.377900+0000","last_became_peered":"2023-10-03T19:15:46.377900+0000","last_unstale":"2023-10-03T19:15:46.389003+0000","last_undegraded":"2023-10-03T19:15:46.389003+0000","last_fullsized":"2023-10-03T19:15:46.389003+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:36:05.401390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159827+0000","last_change":"2023-10-03T19:15:45.842290+0000","last_active":"2023-10-03T19:15:48.159827+0000","last_peered":"2023-10-03T19:15:48.159827+0000","last_clean":"2023-10-03T19:15:48.159827+0000","last_became_active":"2023-10-03T19:15:45.841848+0000","last_became_peered":"2023-10-03T19:15:45.841848+0000","last_unstale":"2023-10-03T19:15:48.159827+0000","last_undegraded":"2023-10-03T19:15:48.159827+0000","last_fullsized":"2023-10-03T19:15:48.159827+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:14:42.878422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.395303+0000","last_change":"2023-10-03T19:15:46.385410+0000","last_active":"2023-10-03T19:15:46.395303+0000","last_peered":"2023-10-03T19:15:46.395303+0000","last_clean":"2023-10-03T19:15:46.395303+0000","last_became_active":"2023-10-03T19:15:46.381382+0000","last_became_peered":"2023-10-03T19:15:46.381382+0000","last_unstale":"2023-10-03T19:15:46.395303+0000","last_undegraded":"2023-10-03T19:15:46.395303+0000","last_fullsized":"2023-10-03T19:15:46.395303+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:28:43.600596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.378445+0000","last_change":"2023-10-03T19:15:45.861708+0000","last_active":"2023-10-03T19:15:46.378445+0000","last_peered":"2023-10-03T19:15:46.378445+0000","last_clean":"2023-10-03T19:15:46.378445+0000","last_became_active":"2023-10-03T19:15:45.861138+0000","last_became_peered":"2023-10-03T19:15:45.861138+0000","last_unstale":"2023-10-03T19:15:46.378445+0000","last_undegraded":"2023-10-03T19:15:46.378445+0000","last_fullsized":"2023-10-03T19:15:46.378445+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:52:53.713262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.827316+0000","last_change":"2023-10-03T19:15:45.827316+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.827316+0000","last_undegraded":"2023-10-03T19:15:45.827316+0000","last_fullsized":"2023-10-03T19:15:45.827316+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.369697+0000","last_change":"2023-10-03T19:15:45.854212+0000","last_active":"2023-10-03T19:15:46.369697+0000","last_peered":"2023-10-03T19:15:46.369697+0000","last_clean":"2023-10-03T19:15:46.369697+0000","last_became_active":"2023-10-03T19:15:45.851309+0000","last_became_peered":"2023-10-03T19:15:45.851309+0000","last_unstale":"2023-10-03T19:15:46.369697+0000","last_undegraded":"2023-10-03T19:15:46.369697+0000","last_fullsized":"2023-10-03T19:15:46.369697+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:27:18.462340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.391923+0000","last_change":"2023-10-03T19:15:46.379625+0000","last_active":"2023-10-03T19:15:46.391923+0000","last_peered":"2023-10-03T19:15:46.391923+0000","last_clean":"2023-10-03T19:15:46.391923+0000","last_became_active":"2023-10-03T19:15:46.378821+0000","last_became_peered":"2023-10-03T19:15:46.378821+0000","last_unstale":"2023-10-03T19:15:46.391923+0000","last_undegraded":"2023-10-03T19:15:46.391923+0000","last_fullsized":"2023-10-03T19:15:46.391923+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:01:43.816803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158940+0000","last_change":"2023-10-03T19:15:45.858316+0000","last_active":"2023-10-03T19:15:48.158940+0000","last_peered":"2023-10-03T19:15:48.158940+0000","last_clean":"2023-10-03T19:15:48.158940+0000","last_became_active":"2023-10-03T19:15:45.857799+0000","last_became_peered":"2023-10-03T19:15:45.857799+0000","last_unstale":"2023-10-03T19:15:48.158940+0000","last_undegraded":"2023-10-03T19:15:48.158940+0000","last_fullsized":"2023-10-03T19:15:48.158940+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:53:16.171067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.378239+0000","last_change":"2023-10-03T19:15:46.364379+0000","last_active":"2023-10-03T19:15:46.378239+0000","last_peered":"2023-10-03T19:15:46.378239+0000","last_clean":"2023-10-03T19:15:46.378239+0000","last_became_active":"2023-10-03T19:15:46.363462+0000","last_became_peered":"2023-10-03T19:15:46.363462+0000","last_unstale":"2023-10-03T19:15:46.378239+0000","last_undegraded":"2023-10-03T19:15:46.378239+0000","last_fullsized":"2023-10-03T19:15:46.378239+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:50:01.514952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.352386+0000","last_change":"2023-10-03T19:15:45.859177+0000","last_active":"2023-10-03T19:15:46.352386+0000","last_peered":"2023-10-03T19:15:46.352386+0000","last_clean":"2023-10-03T19:15:46.352386+0000","last_became_active":"2023-10-03T19:15:45.857999+0000","last_became_peered":"2023-10-03T19:15:45.857999+0000","last_unstale":"2023-10-03T19:15:46.352386+0000","last_undegraded":"2023-10-03T19:15:46.352386+0000","last_fullsized":"2023-10-03T19:15:46.352386+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:53:42.530765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.348113+0000","last_change":"2023-10-03T19:15:46.397614+0000","last_active":"2023-10-03T19:15:47.348113+0000","last_peered":"2023-10-03T19:15:47.348113+0000","last_clean":"2023-10-03T19:15:47.348113+0000","last_became_active":"2023-10-03T19:15:46.396040+0000","last_became_peered":"2023-10-03T19:15:46.396040+0000","last_unstale":"2023-10-03T19:15:47.348113+0000","last_undegraded":"2023-10-03T19:15:47.348113+0000","last_fullsized":"2023-10-03T19:15:47.348113+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:37:55.351113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.349729+0000","last_change":"2023-10-03T19:15:45.847050+0000","last_active":"2023-10-03T19:15:46.349729+0000","last_peered":"2023-10-03T19:15:46.349729+0000","last_clean":"2023-10-03T19:15:46.349729+0000","last_became_active":"2023-10-03T19:15:45.846253+0000","last_became_peered":"2023-10-03T19:15:45.846253+0000","last_unstale":"2023-10-03T19:15:46.349729+0000","last_undegraded":"2023-10-03T19:15:46.349729+0000","last_fullsized":"2023-10-03T19:15:46.349729+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:36:34.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159843+0000","last_change":"2023-10-03T19:15:46.375450+0000","last_active":"2023-10-03T19:15:48.159843+0000","last_peered":"2023-10-03T19:15:48.159843+0000","last_clean":"2023-10-03T19:15:48.159843+0000","last_became_active":"2023-10-03T19:15:46.375071+0000","last_became_peered":"2023-10-03T19:15:46.375071+0000","last_unstale":"2023-10-03T19:15:48.159843+0000","last_undegraded":"2023-10-03T19:15:48.159843+0000","last_fullsized":"2023-10-03T19:15:48.159843+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:54:49.165838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"47'3","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.391839+0000","last_change":"2023-10-03T19:15:45.860953+0000","last_active":"2023-10-03T19:15:46.391839+0000","last_peered":"2023-10-03T19:15:46.391839+0000","last_clean":"2023-10-03T19:15:46.391839+0000","last_became_active":"2023-10-03T19:15:45.859256+0000","last_became_peered":"2023-10-03T19:15:45.859256+0000","last_unstale":"2023-10-03T19:15:46.391839+0000","last_undegraded":"2023-10-03T19:15:46.391839+0000","last_fullsized":"2023-10-03T19:15:46.391839+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:26:04.423019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.378221+0000","last_change":"2023-10-03T19:15:46.365297+0000","last_active":"2023-10-03T19:15:46.378221+0000","last_peered":"2023-10-03T19:15:46.378221+0000","last_clean":"2023-10-03T19:15:46.378221+0000","last_became_active":"2023-10-03T19:15:46.363978+0000","last_became_peered":"2023-10-03T19:15:46.363978+0000","last_unstale":"2023-10-03T19:15:46.378221+0000","last_undegraded":"2023-10-03T19:15:46.378221+0000","last_fullsized":"2023-10-03T19:15:46.378221+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:07:21.108075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-03T19:15:45.848869+0000","last_change":"2023-10-03T19:15:45.845291+0000","last_active":"2023-10-03T19:15:45.848869+0000","last_peered":"2023-10-03T19:15:45.848869+0000","last_clean":"2023-10-03T19:15:45.848869+0000","last_became_active":"2023-10-03T19:15:45.845024+0000","last_became_peered":"2023-10-03T19:15:45.845024+0000","last_unstale":"2023-10-03T19:15:45.848869+0000","last_undegraded":"2023-10-03T19:15:45.848869+0000","last_fullsized":"2023-10-03T19:15:45.848869+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:11:35.625240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349625+0000","last_change":"2023-10-03T19:15:46.397165+0000","last_active":"2023-10-03T19:15:47.349625+0000","last_peered":"2023-10-03T19:15:47.349625+0000","last_clean":"2023-10-03T19:15:47.349625+0000","last_became_active":"2023-10-03T19:15:46.396350+0000","last_became_peered":"2023-10-03T19:15:46.396350+0000","last_unstale":"2023-10-03T19:15:47.349625+0000","last_undegraded":"2023-10-03T19:15:47.349625+0000","last_fullsized":"2023-10-03T19:15:47.349625+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:51:27.685465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160115+0000","last_change":"2023-10-03T19:15:45.855724+0000","last_active":"2023-10-03T19:15:48.160115+0000","last_peered":"2023-10-03T19:15:48.160115+0000","last_clean":"2023-10-03T19:15:48.160115+0000","last_became_active":"2023-10-03T19:15:45.855158+0000","last_became_peered":"2023-10-03T19:15:45.855158+0000","last_unstale":"2023-10-03T19:15:48.160115+0000","last_undegraded":"2023-10-03T19:15:48.160115+0000","last_fullsized":"2023-10-03T19:15:48.160115+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:35:35.283953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160510+0000","last_change":"2023-10-03T19:15:46.368523+0000","last_active":"2023-10-03T19:15:48.160510+0000","last_peered":"2023-10-03T19:15:48.160510+0000","last_clean":"2023-10-03T19:15:48.160510+0000","last_became_active":"2023-10-03T19:15:46.368208+0000","last_became_peered":"2023-10-03T19:15:46.368208+0000","last_unstale":"2023-10-03T19:15:48.160510+0000","last_undegraded":"2023-10-03T19:15:48.160510+0000","last_fullsized":"2023-10-03T19:15:48.160510+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:02:17.268261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.370213+0000","last_change":"2023-10-03T19:15:45.860845+0000","last_active":"2023-10-03T19:15:46.370213+0000","last_peered":"2023-10-03T19:15:46.370213+0000","last_clean":"2023-10-03T19:15:46.370213+0000","last_became_active":"2023-10-03T19:15:45.860209+0000","last_became_peered":"2023-10-03T19:15:45.860209+0000","last_unstale":"2023-10-03T19:15:46.370213+0000","last_undegraded":"2023-10-03T19:15:46.370213+0000","last_fullsized":"2023-10-03T19:15:46.370213+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:02:07.426742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.827762+0000","last_change":"2023-10-03T19:15:45.827762+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.827762+0000","last_undegraded":"2023-10-03T19:15:45.827762+0000","last_fullsized":"2023-10-03T19:15:45.827762+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.351885+0000","last_change":"2023-10-03T19:15:45.861050+0000","last_active":"2023-10-03T19:15:46.351885+0000","last_peered":"2023-10-03T19:15:46.351885+0000","last_clean":"2023-10-03T19:15:46.351885+0000","last_became_active":"2023-10-03T19:15:45.860266+0000","last_became_peered":"2023-10-03T19:15:45.860266+0000","last_unstale":"2023-10-03T19:15:46.351885+0000","last_undegraded":"2023-10-03T19:15:46.351885+0000","last_fullsized":"2023-10-03T19:15:46.351885+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:07:41.373754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160867+0000","last_change":"2023-10-03T19:15:46.394299+0000","last_active":"2023-10-03T19:15:48.160867+0000","last_peered":"2023-10-03T19:15:48.160867+0000","last_clean":"2023-10-03T19:15:48.160867+0000","last_became_active":"2023-10-03T19:15:46.394004+0000","last_became_peered":"2023-10-03T19:15:46.394004+0000","last_unstale":"2023-10-03T19:15:48.160867+0000","last_undegraded":"2023-10-03T19:15:48.160867+0000","last_fullsized":"2023-10-03T19:15:48.160867+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:18:54.415024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-03T19:15:45.852138+0000","last_change":"2023-10-03T19:15:45.848662+0000","last_active":"2023-10-03T19:15:45.852138+0000","last_peered":"2023-10-03T19:15:45.852138+0000","last_clean":"2023-10-03T19:15:45.852138+0000","last_became_active":"2023-10-03T19:15:45.848008+0000","last_became_peered":"2023-10-03T19:15:45.848008+0000","last_unstale":"2023-10-03T19:15:45.852138+0000","last_undegraded":"2023-10-03T19:15:45.852138+0000","last_fullsized":"2023-10-03T19:15:45.852138+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:37:41.991426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.823243+0000","last_change":"2023-10-03T19:15:45.823243+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.823243+0000","last_undegraded":"2023-10-03T19:15:45.823243+0000","last_fullsized":"2023-10-03T19:15:45.823243+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.161196+0000","last_change":"2023-10-03T19:15:45.849759+0000","last_active":"2023-10-03T19:15:48.161196+0000","last_peered":"2023-10-03T19:15:48.161196+0000","last_clean":"2023-10-03T19:15:48.161196+0000","last_became_active":"2023-10-03T19:15:45.849456+0000","last_became_peered":"2023-10-03T19:15:45.849456+0000","last_unstale":"2023-10-03T19:15:48.161196+0000","last_undegraded":"2023-10-03T19:15:48.161196+0000","last_fullsized":"2023-10-03T19:15:48.161196+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:04:10.067798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.351986+0000","last_change":"2023-10-03T19:15:46.350646+0000","last_active":"2023-10-03T19:15:46.351986+0000","last_peered":"2023-10-03T19:15:46.351986+0000","last_clean":"2023-10-03T19:15:46.351986+0000","last_became_active":"2023-10-03T19:15:46.350328+0000","last_became_peered":"2023-10-03T19:15:46.350328+0000","last_unstale":"2023-10-03T19:15:46.351986+0000","last_undegraded":"2023-10-03T19:15:46.351986+0000","last_fullsized":"2023-10-03T19:15:46.351986+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:04:53.999973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.394818+0000","last_change":"2023-10-03T19:15:45.836185+0000","last_active":"2023-10-03T19:15:46.394818+0000","last_peered":"2023-10-03T19:15:46.394818+0000","last_clean":"2023-10-03T19:15:46.394818+0000","last_became_active":"2023-10-03T19:15:45.835843+0000","last_became_peered":"2023-10-03T19:15:45.835843+0000","last_unstale":"2023-10-03T19:15:46.394818+0000","last_undegraded":"2023-10-03T19:15:46.394818+0000","last_fullsized":"2023-10-03T19:15:46.394818+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:06:03.946899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.385213+0000","last_change":"2023-10-03T19:15:46.367540+0000","last_active":"2023-10-03T19:15:46.385213+0000","last_peered":"2023-10-03T19:15:46.385213+0000","last_clean":"2023-10-03T19:15:46.385213+0000","last_became_active":"2023-10-03T19:15:46.366645+0000","last_became_peered":"2023-10-03T19:15:46.366645+0000","last_unstale":"2023-10-03T19:15:46.385213+0000","last_undegraded":"2023-10-03T19:15:46.385213+0000","last_fullsized":"2023-10-03T19:15:46.385213+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:08:24.560923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.380718+0000","last_change":"2023-10-03T19:15:45.849574+0000","last_active":"2023-10-03T19:15:46.380718+0000","last_peered":"2023-10-03T19:15:46.380718+0000","last_clean":"2023-10-03T19:15:46.380718+0000","last_became_active":"2023-10-03T19:15:45.848800+0000","last_became_peered":"2023-10-03T19:15:45.848800+0000","last_unstale":"2023-10-03T19:15:46.380718+0000","last_undegraded":"2023-10-03T19:15:46.380718+0000","last_fullsized":"2023-10-03T19:15:46.380718+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:00:19.836298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.395337+0000","last_change":"2023-10-03T19:15:46.394179+0000","last_active":"2023-10-03T19:15:46.395337+0000","last_peered":"2023-10-03T19:15:46.395337+0000","last_clean":"2023-10-03T19:15:46.395337+0000","last_became_active":"2023-10-03T19:15:46.393883+0000","last_became_peered":"2023-10-03T19:15:46.393883+0000","last_unstale":"2023-10-03T19:15:46.395337+0000","last_undegraded":"2023-10-03T19:15:46.395337+0000","last_fullsized":"2023-10-03T19:15:46.395337+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:37:42.995384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.370522+0000","last_change":"2023-10-03T19:15:45.859040+0000","last_active":"2023-10-03T19:15:46.370522+0000","last_peered":"2023-10-03T19:15:46.370522+0000","last_clean":"2023-10-03T19:15:46.370522+0000","last_became_active":"2023-10-03T19:15:45.858297+0000","last_became_peered":"2023-10-03T19:15:45.858297+0000","last_unstale":"2023-10-03T19:15:46.370522+0000","last_undegraded":"2023-10-03T19:15:46.370522+0000","last_fullsized":"2023-10-03T19:15:46.370522+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:58:37.048776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349962+0000","last_change":"2023-10-03T19:15:46.396843+0000","last_active":"2023-10-03T19:15:47.349962+0000","last_peered":"2023-10-03T19:15:47.349962+0000","last_clean":"2023-10-03T19:15:47.349962+0000","last_became_active":"2023-10-03T19:15:46.395999+0000","last_became_peered":"2023-10-03T19:15:46.395999+0000","last_unstale":"2023-10-03T19:15:47.349962+0000","last_undegraded":"2023-10-03T19:15:47.349962+0000","last_fullsized":"2023-10-03T19:15:47.349962+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:33:27.851221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.380703+0000","last_change":"2023-10-03T19:15:45.835409+0000","last_active":"2023-10-03T19:15:46.380703+0000","last_peered":"2023-10-03T19:15:46.380703+0000","last_clean":"2023-10-03T19:15:46.380703+0000","last_became_active":"2023-10-03T19:15:45.835194+0000","last_became_peered":"2023-10-03T19:15:45.835194+0000","last_unstale":"2023-10-03T19:15:46.380703+0000","last_undegraded":"2023-10-03T19:15:46.380703+0000","last_fullsized":"2023-10-03T19:15:46.380703+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:07:20.104117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.392807+0000","last_change":"2023-10-03T19:15:46.388333+0000","last_active":"2023-10-03T19:15:46.392807+0000","last_peered":"2023-10-03T19:15:46.392807+0000","last_clean":"2023-10-03T19:15:46.392807+0000","last_became_active":"2023-10-03T19:15:46.387577+0000","last_became_peered":"2023-10-03T19:15:46.387577+0000","last_unstale":"2023-10-03T19:15:46.392807+0000","last_undegraded":"2023-10-03T19:15:46.392807+0000","last_fullsized":"2023-10-03T19:15:46.392807+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:10:19.340333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-03T19:15:45.850843+0000","last_change":"2023-10-03T19:15:45.846961+0000","last_active":"2023-10-03T19:15:45.850843+0000","last_peered":"2023-10-03T19:15:45.850843+0000","last_clean":"2023-10-03T19:15:45.850843+0000","last_became_active":"2023-10-03T19:15:45.845959+0000","last_became_peered":"2023-10-03T19:15:45.845959+0000","last_unstale":"2023-10-03T19:15:45.850843+0000","last_undegraded":"2023-10-03T19:15:45.850843+0000","last_fullsized":"2023-10-03T19:15:45.850843+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:04:52.996015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160520+0000","last_change":"2023-10-03T19:15:46.375168+0000","last_active":"2023-10-03T19:15:48.160520+0000","last_peered":"2023-10-03T19:15:48.160520+0000","last_clean":"2023-10-03T19:15:48.160520+0000","last_became_active":"2023-10-03T19:15:46.374822+0000","last_became_peered":"2023-10-03T19:15:46.374822+0000","last_unstale":"2023-10-03T19:15:48.160520+0000","last_undegraded":"2023-10-03T19:15:48.160520+0000","last_fullsized":"2023-10-03T19:15:48.160520+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:04:50.606893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159333+0000","last_change":"2023-10-03T19:15:45.843525+0000","last_active":"2023-10-03T19:15:48.159333+0000","last_peered":"2023-10-03T19:15:48.159333+0000","last_clean":"2023-10-03T19:15:48.159333+0000","last_became_active":"2023-10-03T19:15:45.843111+0000","last_became_peered":"2023-10-03T19:15:45.843111+0000","last_unstale":"2023-10-03T19:15:48.159333+0000","last_undegraded":"2023-10-03T19:15:48.159333+0000","last_fullsized":"2023-10-03T19:15:48.159333+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:59:15.785799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.351998+0000","last_change":"2023-10-03T19:15:46.349592+0000","last_active":"2023-10-03T19:15:46.351998+0000","last_peered":"2023-10-03T19:15:46.351998+0000","last_clean":"2023-10-03T19:15:46.351998+0000","last_became_active":"2023-10-03T19:15:46.349264+0000","last_became_peered":"2023-10-03T19:15:46.349264+0000","last_unstale":"2023-10-03T19:15:46.351998+0000","last_undegraded":"2023-10-03T19:15:46.351998+0000","last_fullsized":"2023-10-03T19:15:46.351998+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:31:17.364939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.342355+0000","last_change":"2023-10-03T19:15:45.845501+0000","last_active":"2023-10-03T19:15:46.342355+0000","last_peered":"2023-10-03T19:15:46.342355+0000","last_clean":"2023-10-03T19:15:46.342355+0000","last_became_active":"2023-10-03T19:15:45.845069+0000","last_became_peered":"2023-10-03T19:15:45.845069+0000","last_unstale":"2023-10-03T19:15:46.342355+0000","last_undegraded":"2023-10-03T19:15:46.342355+0000","last_fullsized":"2023-10-03T19:15:46.342355+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:39:26.716817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.403923+0000","last_change":"2023-10-03T19:15:46.401220+0000","last_active":"2023-10-03T19:15:46.403923+0000","last_peered":"2023-10-03T19:15:46.403923+0000","last_clean":"2023-10-03T19:15:46.403923+0000","last_became_active":"2023-10-03T19:15:46.400309+0000","last_became_peered":"2023-10-03T19:15:46.400309+0000","last_unstale":"2023-10-03T19:15:46.403923+0000","last_undegraded":"2023-10-03T19:15:46.403923+0000","last_fullsized":"2023-10-03T19:15:46.403923+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:23:02.389649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"48'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.761698+0000","last_change":"2023-10-03T19:15:45.855576+0000","last_active":"2023-10-03T19:15:48.761698+0000","last_peered":"2023-10-03T19:15:48.761698+0000","last_clean":"2023-10-03T19:15:48.761698+0000","last_became_active":"2023-10-03T19:15:45.855189+0000","last_became_peered":"2023-10-03T19:15:45.855189+0000","last_unstale":"2023-10-03T19:15:48.761698+0000","last_undegraded":"2023-10-03T19:15:48.761698+0000","last_fullsized":"2023-10-03T19:15:48.761698+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:03:22.555251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":216,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.345374+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:15:46.345374+0000","last_peered":"2023-10-03T19:15:46.345374+0000","last_clean":"2023-10-03T19:15:46.345374+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:15:46.345374+0000","last_undegraded":"2023-10-03T19:15:46.345374+0000","last_fullsized":"2023-10-03T19:15:46.345374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:03:45.985767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349442+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:15:47.349442+0000","last_peered":"2023-10-03T19:15:47.349442+0000","last_clean":"2023-10-03T19:15:47.349442+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:15:47.349442+0000","last_undegraded":"2023-10-03T19:15:47.349442+0000","last_fullsized":"2023-10-03T19:15:47.349442+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:07:52.226240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.355815+0000","last_change":"2023-10-03T19:15:46.354378+0000","last_active":"2023-10-03T19:15:46.355815+0000","last_peered":"2023-10-03T19:15:46.355815+0000","last_clean":"2023-10-03T19:15:46.355815+0000","last_became_active":"2023-10-03T19:15:46.354096+0000","last_became_peered":"2023-10-03T19:15:46.354096+0000","last_unstale":"2023-10-03T19:15:46.355815+0000","last_undegraded":"2023-10-03T19:15:46.355815+0000","last_fullsized":"2023-10-03T19:15:46.355815+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:20:43.270219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.353013+0000","last_change":"2023-10-03T19:15:45.860418+0000","last_active":"2023-10-03T19:15:46.353013+0000","last_peered":"2023-10-03T19:15:46.353013+0000","last_clean":"2023-10-03T19:15:46.353013+0000","last_became_active":"2023-10-03T19:15:45.859327+0000","last_became_peered":"2023-10-03T19:15:45.859327+0000","last_unstale":"2023-10-03T19:15:46.353013+0000","last_undegraded":"2023-10-03T19:15:46.353013+0000","last_fullsized":"2023-10-03T19:15:46.353013+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:05:40.995560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.345054+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:15:46.345054+0000","last_peered":"2023-10-03T19:15:46.345054+0000","last_clean":"2023-10-03T19:15:46.345054+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:15:46.345054+0000","last_undegraded":"2023-10-03T19:15:46.345054+0000","last_fullsized":"2023-10-03T19:15:46.345054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:26:32.661519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.826755+0000","last_change":"2023-10-03T19:15:45.826755+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.826755+0000","last_undegraded":"2023-10-03T19:15:45.826755+0000","last_fullsized":"2023-10-03T19:15:45.826755+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160423+0000","last_change":"2023-10-03T19:15:45.850638+0000","last_active":"2023-10-03T19:15:48.160423+0000","last_peered":"2023-10-03T19:15:48.160423+0000","last_clean":"2023-10-03T19:15:48.160423+0000","last_became_active":"2023-10-03T19:15:45.850362+0000","last_became_peered":"2023-10-03T19:15:45.850362+0000","last_unstale":"2023-10-03T19:15:48.160423+0000","last_undegraded":"2023-10-03T19:15:48.160423+0000","last_fullsized":"2023-10-03T19:15:48.160423+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:59:04.384674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.343042+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:15:46.343042+0000","last_peered":"2023-10-03T19:15:46.343042+0000","last_clean":"2023-10-03T19:15:46.343042+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:15:46.343042+0000","last_undegraded":"2023-10-03T19:15:46.343042+0000","last_fullsized":"2023-10-03T19:15:46.343042+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:53:22.657236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.348353+0000","last_change":"2023-10-03T19:15:46.396444+0000","last_active":"2023-10-03T19:15:47.348353+0000","last_peered":"2023-10-03T19:15:47.348353+0000","last_clean":"2023-10-03T19:15:47.348353+0000","last_became_active":"2023-10-03T19:15:46.395657+0000","last_became_peered":"2023-10-03T19:15:46.395657+0000","last_unstale":"2023-10-03T19:15:47.348353+0000","last_undegraded":"2023-10-03T19:15:47.348353+0000","last_fullsized":"2023-10-03T19:15:47.348353+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:02:07.926380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.385928+0000","last_change":"2023-10-03T19:15:45.858616+0000","last_active":"2023-10-03T19:15:46.385928+0000","last_peered":"2023-10-03T19:15:46.385928+0000","last_clean":"2023-10-03T19:15:46.385928+0000","last_became_active":"2023-10-03T19:15:45.858088+0000","last_became_peered":"2023-10-03T19:15:45.858088+0000","last_unstale":"2023-10-03T19:15:46.385928+0000","last_undegraded":"2023-10-03T19:15:46.385928+0000","last_fullsized":"2023-10-03T19:15:46.385928+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:38:02.669888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.347923+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:15:47.347923+0000","last_peered":"2023-10-03T19:15:47.347923+0000","last_clean":"2023-10-03T19:15:47.347923+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:15:47.347923+0000","last_undegraded":"2023-10-03T19:15:47.347923+0000","last_fullsized":"2023-10-03T19:15:47.347923+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:46:54.785846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160288+0000","last_change":"2023-10-03T19:15:46.360983+0000","last_active":"2023-10-03T19:15:48.160288+0000","last_peered":"2023-10-03T19:15:48.160288+0000","last_clean":"2023-10-03T19:15:48.160288+0000","last_became_active":"2023-10-03T19:15:46.360549+0000","last_became_peered":"2023-10-03T19:15:46.360549+0000","last_unstale":"2023-10-03T19:15:48.160288+0000","last_undegraded":"2023-10-03T19:15:48.160288+0000","last_fullsized":"2023-10-03T19:15:48.160288+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:18:21.999198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.343867+0000","last_change":"2023-10-03T19:15:45.849036+0000","last_active":"2023-10-03T19:15:46.343867+0000","last_peered":"2023-10-03T19:15:46.343867+0000","last_clean":"2023-10-03T19:15:46.343867+0000","last_became_active":"2023-10-03T19:15:45.848308+0000","last_became_peered":"2023-10-03T19:15:45.848308+0000","last_unstale":"2023-10-03T19:15:46.343867+0000","last_undegraded":"2023-10-03T19:15:46.343867+0000","last_fullsized":"2023-10-03T19:15:46.343867+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:12:13.692765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":62,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.340199+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:15:46.340199+0000","last_peered":"2023-10-03T19:15:46.340199+0000","last_clean":"2023-10-03T19:15:46.340199+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:15:46.340199+0000","last_undegraded":"2023-10-03T19:15:46.340199+0000","last_fullsized":"2023-10-03T19:15:46.340199+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:05:01.061886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-10-03T19:15:45.823070+0000","last_change":"2023-10-03T19:15:45.823070+0000","last_active":"2023-10-03T19:15:45.804158+0000","last_peered":"2023-10-03T19:15:45.804158+0000","last_clean":"2023-10-03T19:15:45.804158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:15:45.823070+0000","last_undegraded":"2023-10-03T19:15:45.823070+0000","last_fullsized":"2023-10-03T19:15:45.823070+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.348664+0000","last_change":"2023-10-03T19:15:45.834172+0000","last_active":"2023-10-03T19:15:47.348664+0000","last_peered":"2023-10-03T19:15:47.348664+0000","last_clean":"2023-10-03T19:15:47.348664+0000","last_became_active":"2023-10-03T19:15:45.833415+0000","last_became_peered":"2023-10-03T19:15:45.833415+0000","last_unstale":"2023-10-03T19:15:47.348664+0000","last_undegraded":"2023-10-03T19:15:47.348664+0000","last_fullsized":"2023-10-03T19:15:47.348664+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:41:46.377632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.353252+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:15:46.353252+0000","last_peered":"2023-10-03T19:15:46.353252+0000","last_clean":"2023-10-03T19:15:46.353252+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:15:46.353252+0000","last_undegraded":"2023-10-03T19:15:46.353252+0000","last_fullsized":"2023-10-03T19:15:46.353252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:45:00.349234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160091+0000","last_change":"2023-10-03T19:15:46.365576+0000","last_active":"2023-10-03T19:15:48.160091+0000","last_peered":"2023-10-03T19:15:48.160091+0000","last_clean":"2023-10-03T19:15:48.160091+0000","last_became_active":"2023-10-03T19:15:46.365249+0000","last_became_peered":"2023-10-03T19:15:46.365249+0000","last_unstale":"2023-10-03T19:15:48.160091+0000","last_undegraded":"2023-10-03T19:15:48.160091+0000","last_fullsized":"2023-10-03T19:15:48.160091+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:10:27.658304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-03T19:15:45.850894+0000","last_change":"2023-10-03T19:15:45.848356+0000","last_active":"2023-10-03T19:15:45.850894+0000","last_peered":"2023-10-03T19:15:45.850894+0000","last_clean":"2023-10-03T19:15:45.850894+0000","last_became_active":"2023-10-03T19:15:45.847882+0000","last_became_peered":"2023-10-03T19:15:45.847882+0000","last_unstale":"2023-10-03T19:15:45.850894+0000","last_undegraded":"2023-10-03T19:15:45.850894+0000","last_fullsized":"2023-10-03T19:15:45.850894+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:20:42.266260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":62,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.341745+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:15:46.341745+0000","last_peered":"2023-10-03T19:15:46.341745+0000","last_clean":"2023-10-03T19:15:46.341745+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:15:46.341745+0000","last_undegraded":"2023-10-03T19:15:46.341745+0000","last_fullsized":"2023-10-03T19:15:46.341745+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:33:11.676416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349987+0000","last_change":"2023-10-03T19:15:46.396416+0000","last_active":"2023-10-03T19:15:47.349987+0000","last_peered":"2023-10-03T19:15:47.349987+0000","last_clean":"2023-10-03T19:15:47.349987+0000","last_became_active":"2023-10-03T19:15:46.395693+0000","last_became_peered":"2023-10-03T19:15:46.395693+0000","last_unstale":"2023-10-03T19:15:47.349987+0000","last_undegraded":"2023-10-03T19:15:47.349987+0000","last_fullsized":"2023-10-03T19:15:47.349987+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:18:43.523711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-03T19:15:45.849652+0000","last_change":"2023-10-03T19:15:45.846558+0000","last_active":"2023-10-03T19:15:45.849652+0000","last_peered":"2023-10-03T19:15:45.849652+0000","last_clean":"2023-10-03T19:15:45.849652+0000","last_became_active":"2023-10-03T19:15:45.845284+0000","last_became_peered":"2023-10-03T19:15:45.845284+0000","last_unstale":"2023-10-03T19:15:45.849652+0000","last_undegraded":"2023-10-03T19:15:45.849652+0000","last_fullsized":"2023-10-03T19:15:45.849652+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:17:34.420808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-03T19:15:46.371863+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:15:46.371863+0000","last_peered":"2023-10-03T19:15:46.371863+0000","last_clean":"2023-10-03T19:15:46.371863+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:15:46.371863+0000","last_undegraded":"2023-10-03T19:15:46.371863+0000","last_fullsized":"2023-10-03T19:15:46.371863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:37:29.746184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25,"ondisk_log_size":25,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509484,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24228,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":23616,"kb_avail":94347612,"statfs":{"total":96636764160,"available":96611954688,"internally_reserved":0,"allocated":618496,"data_stored":825786,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":24182784},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.93799999999999994,"15min":0.95399999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2030000000000001,"5min":4.0469999999999997,"15min":4.0469999999999997},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82699999999999996,"15min":0.80200000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.05,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.82599999999999996}]},{"osd":1,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.97599999999999998,"15min":1.038},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.169,"5min":3.8239999999999998,"15min":3.8239999999999998},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.878,"15min":0.85699999999999998},"min":{"1min":0.66300000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1899999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.65800000000000003}]},{"osd":2,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":0.91400000000000003,"15min":0.86199999999999999},"min":{"1min":0.66100000000000003,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":6.0449999999999999,"5min":6.0449999999999999,"15min":6.0449999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.0129999999999999,"15min":1.0429999999999999},"min":{"1min":0.60599999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.252,"5min":3.98,"15min":3.98},"last":0.79400000000000004}]},{"osd":3,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":0.98699999999999999,"15min":0.94099999999999995},"min":{"1min":0.79200000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":6.125,"5min":6.125,"15min":6.125},"last":1.01},{"interface":"front","average":{"1min":0.96099999999999997,"5min":1.0900000000000001,"15min":1.1299999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.2070000000000001,"5min":3.9140000000000001,"15min":3.9140000000000001},"last":0.61899999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":1.0940000000000001,"15min":1.1799999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1970000000000001,"5min":5.1130000000000004,"15min":5.1130000000000004},"last":1.036},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.0429999999999999,"15min":1.0349999999999999},"min":{"1min":0.67500000000000004,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":6.3520000000000003,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":0.755}]},{"osd":5,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.198,"15min":1.2889999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2889999999999999,"5min":5.1859999999999999,"15min":5.1859999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.125,"15min":1.159},"min":{"1min":0.73299999999999998,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.2949999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":0.88300000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.099,"15min":1.1020000000000001},"min":{"1min":0.80800000000000005,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.349,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.2010000000000001,"15min":1.1930000000000001},"min":{"1min":0.88,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":6.1580000000000004,"5min":6.1580000000000004,"15min":6.1580000000000004},"last":1.077}]}]},{"osd":6,"up_from":15,"seq":64424509484,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13792,"kb_used_data":536,"kb_used_omap":0,"kb_used_meta":13248,"kb_avail":94358048,"statfs":{"total":96636764160,"available":96622641152,"internally_reserved":0,"allocated":548864,"data_stored":234782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13565952},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.82899999999999996,"15min":0.81699999999999995},"min":{"1min":0.55800000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.111,"5min":1.504,"15min":1.504},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.89400000000000002,"15min":0.88300000000000001},"min":{"1min":0.69399999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1739999999999999,"5min":1.839,"15min":1.839},"last":0.56699999999999995}]},{"osd":1,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.84799999999999998,"15min":0.83799999999999997},"min":{"1min":0.63600000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.117,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.88700000000000001,"15min":0.879},"min":{"1min":0.58899999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1479999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.80200000000000005}]},{"osd":2,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.89000000000000001,"15min":0.86499999999999999},"min":{"1min":0.745,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0940000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91700000000000004,"15min":0.92500000000000004},"min":{"1min":0.66300000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2250000000000001,"5min":1.546,"15min":1.546},"last":0.83799999999999997}]},{"osd":3,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97999999999999998,"15min":0.98599999999999999},"min":{"1min":0.64700000000000002,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1719999999999999,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.747},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90800000000000003,"15min":0.90900000000000003},"min":{"1min":0.68999999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0580000000000001,"5min":2.121,"15min":2.121},"last":0.69399999999999995}]},{"osd":4,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.999,"15min":1.0349999999999999},"min":{"1min":0.68500000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.147,"5min":1.95,"15min":1.95},"last":1.083},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.056,"15min":1.0980000000000001},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.216,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.90600000000000003}]},{"osd":5,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":1.004,"15min":1.03},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.153,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.008,"5min":1.0920000000000001,"15min":1.1240000000000001},"min":{"1min":0.68300000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.1879999999999999,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.123}]},{"osd":7,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.1060000000000001,"15min":1.1259999999999999},"min":{"1min":0.73299999999999998,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.234,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0820000000000001,"15min":1.1000000000000001},"min":{"1min":0.86199999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.194,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.004}]}]},{"osd":4,"up_from":15,"seq":64424509485,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14560,"kb_used_data":536,"kb_used_omap":0,"kb_used_meta":14016,"kb_avail":94357280,"statfs":{"total":96636764160,"available":96621854720,"internally_reserved":0,"allocated":548864,"data_stored":235876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14352384},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.81299999999999994,"15min":0.78300000000000003},"min":{"1min":0.57299999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1279999999999999,"5min":1.258,"15min":1.258},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.83999999999999997,"15min":0.82599999999999996},"min":{"1min":0.56000000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.1459999999999999,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.80800000000000005}]},{"osd":1,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.93000000000000005,"15min":0.93500000000000005},"min":{"1min":0.68200000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.175,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.879,"15min":0.85499999999999998},"min":{"1min":0.59999999999999998,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.276,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.91200000000000003}]},{"osd":2,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.93000000000000005,"15min":0.91400000000000003},"min":{"1min":0.71399999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1040000000000001,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.002,"5min":0.96799999999999997,"15min":0.94499999999999995},"min":{"1min":0.78100000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2190000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.78400000000000003}]},{"osd":3,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.88600000000000001,"15min":0.874},"min":{"1min":0.76000000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.129,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0609999999999999,"15min":1.071},"min":{"1min":0.85999999999999999,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.216,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.73599999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":1.026,"15min":1.0620000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2050000000000001,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.99299999999999999,"15min":1.0149999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.1499999999999999,"5min":1.635,"15min":1.635},"last":0.94399999999999995}]},{"osd":6,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.1399999999999999,"15min":1.204},"min":{"1min":0.74299999999999999,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.2529999999999999,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.1539999999999999,"15min":1.1950000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.288,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":1.0009999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0680000000000001,"15min":1.0900000000000001},"min":{"1min":0.755,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.202,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.2070000000000001,"15min":1.2350000000000001},"min":{"1min":0.88700000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3180000000000001,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.85599999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509485,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14052,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":13504,"kb_avail":94357788,"statfs":{"total":96636764160,"available":96622374912,"internally_reserved":0,"allocated":552960,"data_stored":235694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13828096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.56499999999999995,"15min":0.52800000000000002},"min":{"1min":0.36599999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.86499999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.65800000000000003,"15min":0.61699999999999999},"min":{"1min":0.496,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.034,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":1.177}]},{"osd":1,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.67600000000000005,"15min":0.621},"min":{"1min":0.56699999999999995,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1639999999999999,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.63200000000000001,"15min":0.58999999999999997},"min":{"1min":0.47899999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.70099999999999996}]},{"osd":3,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.67300000000000004,"15min":0.623},"min":{"1min":0.52900000000000003,"5min":0.224,"15min":0.224},"max":{"1min":1.0269999999999999,"5min":1.246,"15min":1.246},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.78200000000000003,"15min":0.72199999999999998},"min":{"1min":0.60599999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.93799999999999994}]},{"osd":4,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.878,"15min":0.84399999999999997},"min":{"1min":0.625,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.23,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.071,"5min":0.95499999999999996,"15min":0.91300000000000003},"min":{"1min":0.67000000000000004,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.347,"5min":1.399,"15min":1.399},"last":1.0529999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.90800000000000003,"15min":0.86199999999999999},"min":{"1min":0.70999999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.091,"5min":0.99099999999999999,"15min":0.93999999999999995},"min":{"1min":0.76200000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.2549999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.099}]},{"osd":6,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.93799999999999994,"15min":0.91300000000000003},"min":{"1min":0.82199999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.131},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.002,"15min":0.96399999999999997},"min":{"1min":0.68799999999999994,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3899999999999999,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.96299999999999997}]},{"osd":7,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.054,"15min":1.004},"min":{"1min":0.72299999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4179999999999999,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.272},{"interface":"front","average":{"1min":1.111,"5min":0.99099999999999999,"15min":0.95699999999999996},"min":{"1min":0.77800000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.98099999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509484,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13860,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":13312,"kb_avail":94357980,"statfs":{"total":96636764160,"available":96622571520,"internally_reserved":0,"allocated":552960,"data_stored":235454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13631488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.57599999999999996,"15min":0.54500000000000004},"min":{"1min":0.51400000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.58299999999999996,"15min":0.50900000000000001},"min":{"1min":0.503,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.0309999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.45600000000000002}]},{"osd":2,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.59099999999999997,"15min":0.54700000000000004},"min":{"1min":0.55200000000000005,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.88,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.71799999999999997,"15min":0.66200000000000003},"min":{"1min":0.72699999999999998,"5min":0.312,"15min":0.312},"max":{"1min":1.1439999999999999,"5min":1.169,"15min":1.169},"last":0.51000000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.68799999999999994,"15min":0.63100000000000001},"min":{"1min":0.59899999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.091,"5min":1.27,"15min":1.27},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.64300000000000002,"15min":0.57899999999999996},"min":{"1min":0.55600000000000005,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0549999999999999,"5min":1.27,"15min":1.27},"last":0.59699999999999998}]},{"osd":4,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.83399999999999996,"15min":0.79800000000000004},"min":{"1min":0.70399999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.143,"5min":1.202,"15min":1.202},"last":0.72099999999999997},{"interface":"front","average":{"1min":1.0349999999999999,"5min":0.91800000000000004,"15min":0.88800000000000001},"min":{"1min":0.84899999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.86799999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":0.91200000000000003,"15min":0.85799999999999998},"min":{"1min":0.72499999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.339,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.747},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.88900000000000001,"15min":0.84899999999999998},"min":{"1min":0.82499999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.284,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.83299999999999996}]},{"osd":6,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":0.96999999999999997,"15min":0.92200000000000004},"min":{"1min":0.96499999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2589999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.028,"5min":0.94099999999999995,"15min":0.89100000000000001},"min":{"1min":0.80400000000000005,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2270000000000001,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.88800000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":0.99099999999999999,"15min":0.93600000000000005},"min":{"1min":0.83399999999999996,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.95699999999999996,"15min":0.89900000000000002},"min":{"1min":0.85399999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3759999999999999,"5min":1.649,"15min":1.649},"last":0.95399999999999996}]}]},{"osd":3,"up_from":14,"seq":60129542188,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22980,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":22464,"kb_avail":94348860,"statfs":{"total":96636764160,"available":96613232640,"internally_reserved":0,"allocated":520192,"data_stored":221538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23003136},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.60899999999999999,"15min":0.57099999999999995},"min":{"1min":0.318,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.67100000000000004,"15min":0.64300000000000002},"min":{"1min":0.34999999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.198,"5min":1.236,"15min":1.236},"last":0.621}]},{"osd":1,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.65600000000000003,"15min":0.624},"min":{"1min":0.41999999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.95699999999999996,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.70099999999999996,"15min":0.66100000000000003},"min":{"1min":0.435,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.028,"5min":1.222,"15min":1.222},"last":1.006}]},{"osd":2,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.751,"15min":0.70699999999999996},"min":{"1min":0.45900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0740000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.67600000000000005,"15min":0.626},"min":{"1min":0.33600000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.0780000000000001,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":1.177}]},{"osd":4,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.93300000000000005,"15min":0.91100000000000003},"min":{"1min":0.70399999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.411,"5min":1.496,"15min":1.496},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.0620000000000001,"5min":0.95899999999999996,"15min":0.93200000000000005},"min":{"1min":0.754,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":1.1160000000000001}]},{"osd":5,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.90500000000000003,"15min":0.878},"min":{"1min":0.75,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.365,"5min":1.51,"15min":1.51},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.014,"15min":0.996},"min":{"1min":0.74099999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.0469999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.94699999999999995,"15min":0.92000000000000004},"min":{"1min":0.67200000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2450000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.091,"5min":1.024,"15min":0.98699999999999999},"min":{"1min":0.77600000000000002,"5min":0.625,"15min":0.625},"max":{"1min":1.323,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.147}]},{"osd":7,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.032,"15min":1.004},"min":{"1min":0.79100000000000004,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.4470000000000001,"5min":1.597,"15min":1.597},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.0489999999999999,"15min":1.0169999999999999},"min":{"1min":0.71799999999999997,"5min":0.623,"15min":0.623},"max":{"1min":1.377,"5min":1.708,"15min":1.708},"last":1.264}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15272,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":14720,"kb_avail":94356568,"statfs":{"total":96636764160,"available":96621125632,"internally_reserved":0,"allocated":557056,"data_stored":241947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15073280},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.84299999999999997,"15min":0.82099999999999995},"min":{"1min":0.55900000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2230000000000001,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.85899999999999999,"15min":0.85299999999999998},"min":{"1min":0.65700000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1499999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.86899999999999999}]},{"osd":1,"last update":"Tue Oct 3 19:15:28 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.85299999999999998,"15min":0.83399999999999996},"min":{"1min":0.628,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.93000000000000005,"15min":0.92900000000000005},"min":{"1min":0.58699999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1799999999999999,"5min":1.514,"15min":1.514},"last":0.76300000000000001}]},{"osd":2,"last update":"Tue Oct 3 19:15:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.91400000000000003,"15min":0.90000000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3280000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.90600000000000003,"15min":0.89600000000000002},"min":{"1min":0.60999999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1599999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.84299999999999997}]},{"osd":3,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.92300000000000004,"15min":0.92500000000000004},"min":{"1min":0.68899999999999995,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.149,"5min":1.304,"15min":1.304},"last":1.075},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.038,"15min":1.0289999999999999},"min":{"1min":0.89500000000000002,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.2490000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.91700000000000004}]},{"osd":4,"last update":"Tue Oct 3 19:15:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97399999999999998,"15min":0.97199999999999998},"min":{"1min":0.66400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.999,"5min":1.0149999999999999,"15min":1.0369999999999999},"min":{"1min":0.72099999999999997,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.335,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.63400000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:15:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.01,"15min":1.038},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.266,"5min":1.462,"15min":1.462},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.133,"15min":1.1419999999999999},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":0.81100000000000005}]},{"osd":7,"last update":"Tue Oct 3 19:15:28 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.079},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.381,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.129,"5min":1.1459999999999999,"15min":1.1539999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.357,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.1519999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15404,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":14784,"kb_avail":94356436,"statfs":{"total":96636764160,"available":96620990464,"internally_reserved":0,"allocated":626688,"data_stored":831207,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":15138816},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.61399999999999999,"15min":0.57999999999999996},"min":{"1min":0.47499999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.92800000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73399999999999999,"15min":0.71199999999999997},"min":{"1min":0.54900000000000004,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0800000000000001,"5min":1.27,"15min":1.27},"last":0.72899999999999998}]},{"osd":2,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.72499999999999998,"15min":0.71399999999999997},"min":{"1min":0.49199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.131,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70199999999999996,"15min":0.68999999999999995},"min":{"1min":0.44500000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.98199999999999998,"5min":1.548,"15min":1.548},"last":0.46800000000000003}]},{"osd":3,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.78300000000000003,"15min":0.72399999999999998},"min":{"1min":0.65900000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.75900000000000001,"15min":0.69599999999999995},"min":{"1min":0.51200000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.51000000000000001}]},{"osd":4,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.91200000000000003,"15min":0.90600000000000003},"min":{"1min":0.71299999999999997,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1539999999999999,"5min":1.355,"15min":1.355},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.048,"5min":1.034,"15min":1.022},"min":{"1min":0.82499999999999996,"5min":0.504,"15min":0.504},"max":{"1min":1.3140000000000001,"5min":1.508,"15min":1.508},"last":0.95599999999999996}]},{"osd":5,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0569999999999999,"15min":1.0449999999999999},"min":{"1min":0.85599999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.087,"5min":0.997,"15min":0.97399999999999998},"min":{"1min":0.82599999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.371,"5min":1.444,"15min":1.444},"last":0.93000000000000005}]},{"osd":6,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.034,"15min":1.014},"min":{"1min":0.77600000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.427,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.099,"5min":1.018,"15min":0.99199999999999999},"min":{"1min":0.83899999999999997,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.79700000000000004}]},{"osd":7,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.0660000000000001,"15min":1.036},"min":{"1min":0.90200000000000002,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.3919999999999999,"5min":1.407,"15min":1.407},"last":0.878},{"interface":"front","average":{"1min":1.149,"5min":1.0780000000000001,"15min":1.0600000000000001},"min":{"1min":0.78500000000000003,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.76300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:15:52.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.38 is not active+clean 2023-10-03T19:15:52.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:15:45.824309+0000', 'last_change': '2023-10-03T19:15:45.824309+0000', 'last_active': '2023-10-03T19:15:45.804158+0000', 'last_peered': '2023-10-03T19:15:45.804158+0000', 'last_clean': '2023-10-03T19:15:45.804158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:15:45.824309+0000', 'last_undegraded': '2023-10-03T19:15:45.824309+0000', 'last_fullsized': '2023-10-03T19:15:45.824309+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'last_clean_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:15:52.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.37 is not active+clean 2023-10-03T19:15:52.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:15:45.824018+0000', 'last_change': '2023-10-03T19:15:45.824018+0000', 'last_active': '2023-10-03T19:15:45.804158+0000', 'last_peered': '2023-10-03T19:15:45.804158+0000', 'last_clean': '2023-10-03T19:15:45.804158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:15:45.824018+0000', 'last_undegraded': '2023-10-03T19:15:45.824018+0000', 'last_fullsized': '2023-10-03T19:15:45.824018+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'last_clean_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:15:52.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.34 is not active+clean 2023-10-03T19:15:52.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:15:45.821529+0000', 'last_change': '2023-10-03T19:15:45.821529+0000', 'last_active': '2023-10-03T19:15:45.804158+0000', 'last_peered': '2023-10-03T19:15:45.804158+0000', 'last_clean': '2023-10-03T19:15:45.804158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:15:45.821529+0000', 'last_undegraded': '2023-10-03T19:15:45.821529+0000', 'last_fullsized': '2023-10-03T19:15:45.821529+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'last_clean_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:15:52.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2a is not active+clean 2023-10-03T19:15:52.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:15:45.825371+0000', 'last_change': '2023-10-03T19:15:45.825371+0000', 'last_active': '2023-10-03T19:15:45.804158+0000', 'last_peered': '2023-10-03T19:15:45.804158+0000', 'last_clean': '2023-10-03T19:15:45.804158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:15:45.825371+0000', 'last_undegraded': '2023-10-03T19:15:45.825371+0000', 'last_fullsized': '2023-10-03T19:15:45.825371+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'last_clean_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:15:52.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.26 is not active+clean 2023-10-03T19:15:52.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:15:45.828249+0000', 'last_change': '2023-10-03T19:15:45.828249+0000', 'last_active': '2023-10-03T19:15:45.804158+0000', 'last_peered': '2023-10-03T19:15:45.804158+0000', 'last_clean': '2023-10-03T19:15:45.804158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:15:45.828249+0000', 'last_undegraded': '2023-10-03T19:15:45.828249+0000', 'last_fullsized': '2023-10-03T19:15:45.828249+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'last_clean_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:15:52.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2023-10-03T19:15:52.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:15:45.827899+0000', 'last_change': '2023-10-03T19:15:45.827899+0000', 'last_active': '2023-10-03T19:15:45.804158+0000', 'last_peered': '2023-10-03T19:15:45.804158+0000', 'last_clean': '2023-10-03T19:15:45.804158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:15:45.827899+0000', 'last_undegraded': '2023-10-03T19:15:45.827899+0000', 'last_fullsized': '2023-10-03T19:15:45.827899+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'last_clean_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:15:52.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2023-10-03T19:15:52.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:15:45.827316+0000', 'last_change': '2023-10-03T19:15:45.827316+0000', 'last_active': '2023-10-03T19:15:45.804158+0000', 'last_peered': '2023-10-03T19:15:45.804158+0000', 'last_clean': '2023-10-03T19:15:45.804158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:15:45.827316+0000', 'last_undegraded': '2023-10-03T19:15:45.827316+0000', 'last_fullsized': '2023-10-03T19:15:45.827316+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'last_clean_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:15:52.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2023-10-03T19:15:52.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:15:45.827762+0000', 'last_change': '2023-10-03T19:15:45.827762+0000', 'last_active': '2023-10-03T19:15:45.804158+0000', 'last_peered': '2023-10-03T19:15:45.804158+0000', 'last_clean': '2023-10-03T19:15:45.804158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:15:45.827762+0000', 'last_undegraded': '2023-10-03T19:15:45.827762+0000', 'last_fullsized': '2023-10-03T19:15:45.827762+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'last_clean_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:15:52.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2023-10-03T19:15:52.698 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:15:45.823243+0000', 'last_change': '2023-10-03T19:15:45.823243+0000', 'last_active': '2023-10-03T19:15:45.804158+0000', 'last_peered': '2023-10-03T19:15:45.804158+0000', 'last_clean': '2023-10-03T19:15:45.804158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:15:45.823243+0000', 'last_undegraded': '2023-10-03T19:15:45.823243+0000', 'last_fullsized': '2023-10-03T19:15:45.823243+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'last_clean_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:15:52.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2023-10-03T19:15:52.698 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:15:45.826755+0000', 'last_change': '2023-10-03T19:15:45.826755+0000', 'last_active': '2023-10-03T19:15:45.804158+0000', 'last_peered': '2023-10-03T19:15:45.804158+0000', 'last_clean': '2023-10-03T19:15:45.804158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:15:45.826755+0000', 'last_undegraded': '2023-10-03T19:15:45.826755+0000', 'last_fullsized': '2023-10-03T19:15:45.826755+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'last_clean_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:15:52.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2023-10-03T19:15:52.698 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:15:45.823070+0000', 'last_change': '2023-10-03T19:15:45.823070+0000', 'last_active': '2023-10-03T19:15:45.804158+0000', 'last_peered': '2023-10-03T19:15:45.804158+0000', 'last_clean': '2023-10-03T19:15:45.804158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:15:45.823070+0000', 'last_undegraded': '2023-10-03T19:15:45.823070+0000', 'last_fullsized': '2023-10-03T19:15:45.823070+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'last_clean_scrub_stamp': '2023-10-03T19:15:45.804158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:15:52.699 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-03T19:15:52.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.923+0000 7f41446be640 1 Processor -- start 2023-10-03T19:15:52.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.923+0000 7f41446be640 1 -- start start 2023-10-03T19:15:52.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.923+0000 7f41446be640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f413c06f170 0x7f413c150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:52.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.923+0000 7f41446be640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f413c06cac0 con 0x7f413c06d170 2023-10-03T19:15:52.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.923+0000 7f41446be640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f413c0720d0 con 0x7f413c0bc8b0 2023-10-03T19:15:52.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.923+0000 7f41446be640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f413c0a5ab0 con 0x7f413c06f170 2023-10-03T19:15:52.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.923+0000 7f414245a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f413c06f170 0x7f413c150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:52.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.923+0000 7f4142c5b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f413c06d170 0x7f413c156e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50796/0 (socket says 172.21.15.45:50796) 2023-10-03T19:15:52.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.923+0000 7f4142c5b640 1 -- 172.21.15.45:0/1962443986 learned_addr learned my addr 172.21.15.45:0/1962443986 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:15:52.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.923+0000 7f414245a640 1 -- 172.21.15.45:0/1962443986 >> v1:172.21.15.79:6789/0 conn(0x7f413c0bc8b0 legacy=0x7f413c14ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:52.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.923+0000 7f414245a640 1 -- 172.21.15.45:0/1962443986 >> v1:172.21.15.45:6789/0 conn(0x7f413c06d170 legacy=0x7f413c156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:52.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.923+0000 7f414245a640 1 -- 172.21.15.45:0/1962443986 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413c06cd00 con 0x7f413c06f170 2023-10-03T19:15:52.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.927+0000 7f414245a640 1 --2- 172.21.15.45:0/1962443986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f413c06f170 0x7f413c150190 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f41380097c0 tx=0x7f413801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b8a4934b971b369 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:52.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.927+0000 7f4141458640 1 -- 172.21.15.45:0/1962443986 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41380a8970 con 0x7f413c06f170 2023-10-03T19:15:52.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.927+0000 7f4141458640 1 -- 172.21.15.45:0/1962443986 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41380a8ad0 con 0x7f413c06f170 2023-10-03T19:15:52.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.927+0000 7f4141458640 1 -- 172.21.15.45:0/1962443986 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41380a8e60 con 0x7f413c06f170 2023-10-03T19:15:52.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.927+0000 7f41446be640 1 -- 172.21.15.45:0/1962443986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f413c06f170 msgr2=0x7f413c150190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:52.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.927+0000 7f41446be640 1 --2- 172.21.15.45:0/1962443986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f413c06f170 0x7f413c150190 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f41380097c0 tx=0x7f413801ec70 comp rx=0 tx=0).stop 2023-10-03T19:15:52.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.927+0000 7f41446be640 1 -- 172.21.15.45:0/1962443986 shutdown_connections 2023-10-03T19:15:52.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.927+0000 7f41446be640 1 --2- 172.21.15.45:0/1962443986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f413c06f170 0x7f413c150190 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:52.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.927+0000 7f41446be640 1 -- 172.21.15.45:0/1962443986 >> 172.21.15.45:0/1962443986 conn(0x7f413c0bcf50 msgr2=0x7f413c0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:52.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.927+0000 7f41446be640 1 -- 172.21.15.45:0/1962443986 shutdown_connections 2023-10-03T19:15:52.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.927+0000 7f41446be640 1 -- 172.21.15.45:0/1962443986 wait complete. 2023-10-03T19:15:52.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.927+0000 7f41446be640 1 Processor -- start 2023-10-03T19:15:52.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.927+0000 7f41446be640 1 -- start start 2023-10-03T19:15:52.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.927+0000 7f41446be640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f413c06d170 0x7f413c14a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:52.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.927+0000 7f41446be640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f413c06f170 0x7f413c0b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:52.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.927+0000 7f41446be640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f413c0bc8b0 0x7f413c149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:52.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.927+0000 7f41446be640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413c14b0f0 con 0x7f413c0bc8b0 2023-10-03T19:15:52.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.927+0000 7f41446be640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413c0b91d0 con 0x7f413c06d170 2023-10-03T19:15:52.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.927+0000 7f41446be640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f413c0b54e0 con 0x7f413c06f170 2023-10-03T19:15:52.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.927+0000 7f4142c5b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f413c0bc8b0 0x7f413c149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:52.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.927+0000 7f4142c5b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f413c0bc8b0 0x7f413c149470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37820/0 (socket says 172.21.15.45:37820) 2023-10-03T19:15:52.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.927+0000 7f4142c5b640 1 -- 172.21.15.45:0/1188006574 learned_addr learned my addr 172.21.15.45:0/1188006574 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:52.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.927+0000 7f414245a640 1 --2- 172.21.15.45:0/1188006574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f413c06d170 0x7f413c14a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:52.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.927+0000 7f4141c59640 1 --2- 172.21.15.45:0/1188006574 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f413c06f170 0x7f413c0b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:52.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.931+0000 7f4142c5b640 1 -- 172.21.15.45:0/1188006574 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f413c06f170 msgr2=0x7f413c0b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:52.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.931+0000 7f4142c5b640 1 --2- 172.21.15.45:0/1188006574 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f413c06f170 0x7f413c0b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:52.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.931+0000 7f4142c5b640 1 -- 172.21.15.45:0/1188006574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f413c06d170 msgr2=0x7f413c14a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:52.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.931+0000 7f4142c5b640 1 --2- 172.21.15.45:0/1188006574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f413c06d170 0x7f413c14a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:52.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.931+0000 7f4142c5b640 1 -- 172.21.15.45:0/1188006574 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4138009420 con 0x7f413c0bc8b0 2023-10-03T19:15:52.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.931+0000 7f4142c5b640 1 --2- 172.21.15.45:0/1188006574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f413c0bc8b0 0x7f413c149470 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f413400cbc0 tx=0x7f413400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:52.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.931+0000 7f4132ffd640 1 -- 172.21.15.45:0/1188006574 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413400ad40 con 0x7f413c0bc8b0 2023-10-03T19:15:52.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.931+0000 7f4132ffd640 1 -- 172.21.15.45:0/1188006574 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4134012400 con 0x7f413c0bc8b0 2023-10-03T19:15:52.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.931+0000 7f41446be640 1 -- 172.21.15.45:0/1188006574 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f413c14c4a0 con 0x7f413c0bc8b0 2023-10-03T19:15:52.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.931+0000 7f4132ffd640 1 -- 172.21.15.45:0/1188006574 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413400aea0 con 0x7f413c0bc8b0 2023-10-03T19:15:52.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.931+0000 7f41446be640 1 -- 172.21.15.45:0/1188006574 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f413c14fae0 con 0x7f413c0bc8b0 2023-10-03T19:15:52.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.931+0000 7f41446be640 1 -- 172.21.15.45:0/1188006574 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f413c06f540 con 0x7f413c0bc8b0 2023-10-03T19:15:52.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.931+0000 7f4132ffd640 1 -- 172.21.15.45:0/1188006574 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4134007070 con 0x7f413c0bc8b0 2023-10-03T19:15:52.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.931+0000 7f4132ffd640 1 --2- 172.21.15.45:0/1188006574 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4120066280 0x7f4120068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:52.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.931+0000 7f4132ffd640 1 -- 172.21.15.45:0/1188006574 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4134083930 con 0x7f413c0bc8b0 2023-10-03T19:15:52.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.931+0000 7f414245a640 1 --2- 172.21.15.45:0/1188006574 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4120066280 0x7f4120068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:52.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.931+0000 7f414245a640 1 --2- 172.21.15.45:0/1188006574 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4120066280 0x7f4120068730 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f41380b2000 tx=0x7f4138008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:52.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:52.935+0000 7f4132ffd640 1 -- 172.21.15.45:0/1188006574 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4134050ef0 con 0x7f413c0bc8b0 2023-10-03T19:15:53.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.147+0000 7f41446be640 1 -- 172.21.15.45:0/1188006574 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f413c06d660 con 0x7f413c0bc8b0 2023-10-03T19:15:53.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.147+0000 7f4132ffd640 1 -- 172.21.15.45:0/1188006574 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1014 (secure 0 0 0) 0x7f4134017410 con 0x7f413c0bc8b0 2023-10-03T19:15:53.154 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:15:53.154 INFO:teuthology.orchestra.run.smithi045.stdout:{"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":227,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":48,"num_osds":8,"num_up_osds":8,"osd_up_since":1696360341,"num_in_osds":8,"osd_in_since":1696360332,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592730,"bytes_used":137744384,"bytes_avail":772956368896,"bytes_total":773094113280,"write_bytes_sec":2139,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":23,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5514}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-10-03T19:14:26.484869+0000","services":{}},"progress_events":{}} 2023-10-03T19:15:53.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.147+0000 7f41446be640 1 -- 172.21.15.45:0/1188006574 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4120066280 msgr2=0x7f4120068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:53.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.147+0000 7f41446be640 1 --2- 172.21.15.45:0/1188006574 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4120066280 0x7f4120068730 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f41380b2000 tx=0x7f4138008040 comp rx=0 tx=0).stop 2023-10-03T19:15:53.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.147+0000 7f41446be640 1 -- 172.21.15.45:0/1188006574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f413c0bc8b0 msgr2=0x7f413c149470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:53.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.147+0000 7f41446be640 1 --2- 172.21.15.45:0/1188006574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f413c0bc8b0 0x7f413c149470 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f413400cbc0 tx=0x7f413400a430 comp rx=0 tx=0).stop 2023-10-03T19:15:53.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.147+0000 7f41446be640 1 -- 172.21.15.45:0/1188006574 shutdown_connections 2023-10-03T19:15:53.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.147+0000 7f41446be640 1 --2- 172.21.15.45:0/1188006574 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4120066280 0x7f4120068730 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:53.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.147+0000 7f41446be640 1 --2- 172.21.15.45:0/1188006574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f413c0bc8b0 0x7f413c149470 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:53.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.147+0000 7f41446be640 1 --2- 172.21.15.45:0/1188006574 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f413c06f170 0x7f413c0b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:53.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.147+0000 7f41446be640 1 --2- 172.21.15.45:0/1188006574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f413c06d170 0x7f413c14a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:53.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.147+0000 7f41446be640 1 -- 172.21.15.45:0/1188006574 >> 172.21.15.45:0/1188006574 conn(0x7f413c0bcf50 msgr2=0x7f413c070b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:53.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.147+0000 7f41446be640 1 -- 172.21.15.45:0/1188006574 shutdown_connections 2023-10-03T19:15:53.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.147+0000 7f41446be640 1 -- 172.21.15.45:0/1188006574 wait complete. 2023-10-03T19:15:53.169 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-03T19:15:53.173 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:15:53.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.291+0000 7f4ef065e640 1 Processor -- start 2023-10-03T19:15:53.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.291+0000 7f4ef065e640 1 -- start start 2023-10-03T19:15:53.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.295+0000 7f4ef065e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4ee8149e70 0x7f4ee814cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:53.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.295+0000 7f4ef065e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ee80a7100 0x7f4ee814d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:53.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.295+0000 7f4ef065e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee814c770 con 0x7f4ee80bf370 2023-10-03T19:15:53.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.295+0000 7f4ef065e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee814d680 con 0x7f4ee8149e70 2023-10-03T19:15:53.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.295+0000 7f4ef065e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee8150c00 con 0x7f4ee80a7100 2023-10-03T19:15:53.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.295+0000 7f4eee3fa640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4ee80bf370 0x7f4ee8149760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50812/0 (socket says 172.21.15.45:50812) 2023-10-03T19:15:53.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.295+0000 7f4eee3fa640 1 -- 172.21.15.45:0/2421763480 learned_addr learned my addr 172.21.15.45:0/2421763480 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:15:53.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.295+0000 7f4eedbf9640 1 --2- 172.21.15.45:0/2421763480 >> v2:172.21.15.79:3300/0 conn(0x7f4ee8149e70 0x7f4ee814cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:53.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.295+0000 7f4eeebfb640 1 --2- 172.21.15.45:0/2421763480 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ee80a7100 0x7f4ee814d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:53.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.295+0000 7f4eed3f8640 1 -- 172.21.15.45:0/2421763480 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 659066569 0 0) 0x7f4ee814c770 con 0x7f4ee80bf370 2023-10-03T19:15:53.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.295+0000 7f4eed3f8640 1 -- 172.21.15.45:0/2421763480 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ed4003530 con 0x7f4ee80bf370 2023-10-03T19:15:53.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.295+0000 7f4eedbf9640 1 -- 172.21.15.45:0/2421763480 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ee80a7100 msgr2=0x7f4ee814d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:53.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.295+0000 7f4eedbf9640 1 --2- 172.21.15.45:0/2421763480 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ee80a7100 0x7f4ee814d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:53.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.295+0000 7f4eedbf9640 1 -- 172.21.15.45:0/2421763480 >> v1:172.21.15.45:6789/0 conn(0x7f4ee80bf370 legacy=0x7f4ee8149760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:53.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.295+0000 7f4eedbf9640 1 -- 172.21.15.45:0/2421763480 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee806efe0 con 0x7f4ee8149e70 2023-10-03T19:15:53.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.295+0000 7f4eedbf9640 1 --2- 172.21.15.45:0/2421763480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ee8149e70 0x7f4ee814cc00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80097c0 tx=0x7f4ed801c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24cb27c39813320d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:53.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.295+0000 7f4eed3f8640 1 -- 172.21.15.45:0/2421763480 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed80ab600 con 0x7f4ee8149e70 2023-10-03T19:15:53.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.295+0000 7f4eed3f8640 1 -- 172.21.15.45:0/2421763480 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed80a7050 con 0x7f4ee8149e70 2023-10-03T19:15:53.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.295+0000 7f4eed3f8640 1 -- 172.21.15.45:0/2421763480 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed80ab980 con 0x7f4ee8149e70 2023-10-03T19:15:53.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.299+0000 7f4ef065e640 1 -- 172.21.15.45:0/2421763480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ee8149e70 msgr2=0x7f4ee814cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:53.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.299+0000 7f4ef065e640 1 --2- 172.21.15.45:0/2421763480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ee8149e70 0x7f4ee814cc00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80097c0 tx=0x7f4ed801c310 comp rx=0 tx=0).stop 2023-10-03T19:15:53.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.299+0000 7f4ef065e640 1 -- 172.21.15.45:0/2421763480 shutdown_connections 2023-10-03T19:15:53.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.299+0000 7f4ef065e640 1 --2- 172.21.15.45:0/2421763480 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ee80a7100 0x7f4ee814d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:53.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.299+0000 7f4ef065e640 1 --2- 172.21.15.45:0/2421763480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ee8149e70 0x7f4ee814cc00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:53.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.299+0000 7f4ef065e640 1 -- 172.21.15.45:0/2421763480 >> 172.21.15.45:0/2421763480 conn(0x7f4ee806bce0 msgr2=0x7f4ee806c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:53.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.299+0000 7f4ef065e640 1 -- 172.21.15.45:0/2421763480 shutdown_connections 2023-10-03T19:15:53.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.299+0000 7f4ef065e640 1 -- 172.21.15.45:0/2421763480 wait complete. 2023-10-03T19:15:53.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.299+0000 7f4ef065e640 1 Processor -- start 2023-10-03T19:15:53.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.299+0000 7f4ef065e640 1 -- start start 2023-10-03T19:15:53.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.299+0000 7f4ef065e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ee80a7100 0x7f4ee80b7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:53.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.299+0000 7f4ef065e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ee80bf370 0x7f4ee80c1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:53.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.299+0000 7f4ef065e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ee8149e70 0x7f4ee80c06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:53.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.299+0000 7f4ef065e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee81e73d0 con 0x7f4ee80bf370 2023-10-03T19:15:53.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.299+0000 7f4ef065e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee81e7900 con 0x7f4ee80a7100 2023-10-03T19:15:53.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.299+0000 7f4ef065e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee80b7da0 con 0x7f4ee8149e70 2023-10-03T19:15:53.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.299+0000 7f4eedbf9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ee80bf370 0x7f4ee80c1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:53.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.299+0000 7f4eedbf9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ee80bf370 0x7f4ee80c1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37828/0 (socket says 172.21.15.45:37828) 2023-10-03T19:15:53.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.299+0000 7f4eedbf9640 1 -- 172.21.15.45:0/1064893672 learned_addr learned my addr 172.21.15.45:0/1064893672 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:53.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.299+0000 7f4eee3fa640 1 --2- 172.21.15.45:0/1064893672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ee80a7100 0x7f4ee80b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:53.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.299+0000 7f4eeebfb640 1 --2- 172.21.15.45:0/1064893672 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ee8149e70 0x7f4ee80c06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:53.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.299+0000 7f4eedbf9640 1 -- 172.21.15.45:0/1064893672 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ee8149e70 msgr2=0x7f4ee80c06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:53.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.299+0000 7f4eedbf9640 1 --2- 172.21.15.45:0/1064893672 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ee8149e70 0x7f4ee80c06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:53.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.299+0000 7f4eedbf9640 1 -- 172.21.15.45:0/1064893672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ee80a7100 msgr2=0x7f4ee80b7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:53.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.299+0000 7f4eedbf9640 1 --2- 172.21.15.45:0/1064893672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ee80a7100 0x7f4ee80b7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:53.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.299+0000 7f4eedbf9640 1 -- 172.21.15.45:0/1064893672 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed8009420 con 0x7f4ee80bf370 2023-10-03T19:15:53.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.299+0000 7f4eeebfb640 1 --2- 172.21.15.45:0/1064893672 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ee8149e70 0x7f4ee80c06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:15:53.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.299+0000 7f4eedbf9640 1 --2- 172.21.15.45:0/1064893672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ee80bf370 0x7f4ee80c1660 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80ae040 tx=0x7f4ed801ab50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:53.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.303+0000 7f4edeffd640 1 -- 172.21.15.45:0/1064893672 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed80b7450 con 0x7f4ee80bf370 2023-10-03T19:15:53.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.303+0000 7f4edeffd640 1 -- 172.21.15.45:0/1064893672 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed80b75d0 con 0x7f4ee80bf370 2023-10-03T19:15:53.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.303+0000 7f4ef065e640 1 -- 172.21.15.45:0/1064893672 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee80bca70 con 0x7f4ee80bf370 2023-10-03T19:15:53.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.303+0000 7f4edeffd640 1 -- 172.21.15.45:0/1064893672 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed80b7980 con 0x7f4ee80bf370 2023-10-03T19:15:53.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.303+0000 7f4ef065e640 1 -- 172.21.15.45:0/1064893672 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee80bc8e0 con 0x7f4ee80bf370 2023-10-03T19:15:53.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.303+0000 7f4ef065e640 1 -- 172.21.15.45:0/1064893672 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee8150400 con 0x7f4ee80bf370 2023-10-03T19:15:53.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.303+0000 7f4edeffd640 1 -- 172.21.15.45:0/1064893672 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4ed80b7ae0 con 0x7f4ee80bf370 2023-10-03T19:15:53.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.303+0000 7f4edeffd640 1 --2- 172.21.15.45:0/1064893672 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4ecc0662b0 0x7f4ecc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:53.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.303+0000 7f4edeffd640 1 -- 172.21.15.45:0/1064893672 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4ed811e350 con 0x7f4ee80bf370 2023-10-03T19:15:53.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.303+0000 7f4eee3fa640 1 --2- 172.21.15.45:0/1064893672 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4ecc0662b0 0x7f4ecc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:53.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.303+0000 7f4eee3fa640 1 --2- 172.21.15.45:0/1064893672 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4ecc0662b0 0x7f4ecc068760 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4000fc0 tx=0x7f4ee4006a70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:53.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.307+0000 7f4edeffd640 1 -- 172.21.15.45:0/1064893672 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4ed80eb7c0 con 0x7f4ee80bf370 2023-10-03T19:15:53.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.455+0000 7f4ef065e640 1 -- 172.21.15.45:0/1064893672 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4ee804de80 con 0x7f4ecc0662b0 2023-10-03T19:15:53.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.479+0000 7f4edeffd640 1 -- 172.21.15.45:0/1064893672 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310251 (secure 0 0 0) 0x7f4ee804de80 con 0x7f4ecc0662b0 2023-10-03T19:15:53.569 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:15:53.571 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:15:53.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.483+0000 7f4ef065e640 1 -- 172.21.15.45:0/1064893672 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4ecc0662b0 msgr2=0x7f4ecc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:53.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.483+0000 7f4ef065e640 1 --2- 172.21.15.45:0/1064893672 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4ecc0662b0 0x7f4ecc068760 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4000fc0 tx=0x7f4ee4006a70 comp rx=0 tx=0).stop 2023-10-03T19:15:53.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.483+0000 7f4ef065e640 1 -- 172.21.15.45:0/1064893672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ee80bf370 msgr2=0x7f4ee80c1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:53.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.483+0000 7f4ef065e640 1 --2- 172.21.15.45:0/1064893672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ee80bf370 0x7f4ee80c1660 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80ae040 tx=0x7f4ed801ab50 comp rx=0 tx=0).stop 2023-10-03T19:15:53.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.483+0000 7f4ef065e640 1 -- 172.21.15.45:0/1064893672 shutdown_connections 2023-10-03T19:15:53.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.483+0000 7f4ef065e640 1 --2- 172.21.15.45:0/1064893672 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4ecc0662b0 0x7f4ecc068760 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:53.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.483+0000 7f4ef065e640 1 --2- 172.21.15.45:0/1064893672 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4ee8149e70 0x7f4ee80c06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:53.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.483+0000 7f4ef065e640 1 --2- 172.21.15.45:0/1064893672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ee80bf370 0x7f4ee80c1660 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:53.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.483+0000 7f4ef065e640 1 --2- 172.21.15.45:0/1064893672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ee80a7100 0x7f4ee80b7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:53.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.483+0000 7f4ef065e640 1 -- 172.21.15.45:0/1064893672 >> 172.21.15.45:0/1064893672 conn(0x7f4ee806bce0 msgr2=0x7f4ee8067930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:53.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.483+0000 7f4ef065e640 1 -- 172.21.15.45:0/1064893672 shutdown_connections 2023-10-03T19:15:53.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:53.483+0000 7f4ef065e640 1 -- 172.21.15.45:0/1064893672 wait complete. 2023-10-03T19:15:53.573 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2023-10-03T19:15:52.515965+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":201,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":134516,"kb_used_data":4532,"kb_used_omap":0,"kb_used_meta":129920,"kb_avail":754840204,"statfs":{"total":773094113280,"available":772956368896,"internally_reserved":0,"allocated":4640768,"data_stored":3117544,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":133038080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.701803"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.340966+0000","last_change":"2023-10-03T19:15:46.394210+0000","last_active":"2023-10-03T19:15:47.340966+0000","last_peered":"2023-10-03T19:15:47.340966+0000","last_clean":"2023-10-03T19:15:47.340966+0000","last_became_active":"2023-10-03T19:15:46.393845+0000","last_became_peered":"2023-10-03T19:15:46.393845+0000","last_unstale":"2023-10-03T19:15:47.340966+0000","last_undegraded":"2023-10-03T19:15:47.340966+0000","last_fullsized":"2023-10-03T19:15:47.340966+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:58:27.652930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159630+0000","last_change":"2023-10-03T19:15:46.398709+0000","last_active":"2023-10-03T19:15:48.159630+0000","last_peered":"2023-10-03T19:15:48.159630+0000","last_clean":"2023-10-03T19:15:48.159630+0000","last_became_active":"2023-10-03T19:15:46.397955+0000","last_became_peered":"2023-10-03T19:15:46.397955+0000","last_unstale":"2023-10-03T19:15:48.159630+0000","last_undegraded":"2023-10-03T19:15:48.159630+0000","last_fullsized":"2023-10-03T19:15:48.159630+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:04:13.574312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160021+0000","last_change":"2023-10-03T19:15:46.364679+0000","last_active":"2023-10-03T19:15:48.160021+0000","last_peered":"2023-10-03T19:15:48.160021+0000","last_clean":"2023-10-03T19:15:48.160021+0000","last_became_active":"2023-10-03T19:15:46.360555+0000","last_became_peered":"2023-10-03T19:15:46.360555+0000","last_unstale":"2023-10-03T19:15:48.160021+0000","last_undegraded":"2023-10-03T19:15:48.160021+0000","last_fullsized":"2023-10-03T19:15:48.160021+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:33:29.425810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159423+0000","last_change":"2023-10-03T19:15:46.379223+0000","last_active":"2023-10-03T19:15:48.159423+0000","last_peered":"2023-10-03T19:15:48.159423+0000","last_clean":"2023-10-03T19:15:48.159423+0000","last_became_active":"2023-10-03T19:15:46.378548+0000","last_became_peered":"2023-10-03T19:15:46.378548+0000","last_unstale":"2023-10-03T19:15:48.159423+0000","last_undegraded":"2023-10-03T19:15:48.159423+0000","last_fullsized":"2023-10-03T19:15:48.159423+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:50:28.636608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349017+0000","last_change":"2023-10-03T19:15:46.382245+0000","last_active":"2023-10-03T19:15:47.349017+0000","last_peered":"2023-10-03T19:15:47.349017+0000","last_clean":"2023-10-03T19:15:47.349017+0000","last_became_active":"2023-10-03T19:15:46.381558+0000","last_became_peered":"2023-10-03T19:15:46.381558+0000","last_unstale":"2023-10-03T19:15:47.349017+0000","last_undegraded":"2023-10-03T19:15:47.349017+0000","last_fullsized":"2023-10-03T19:15:47.349017+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:03:56.161089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.340274+0000","last_change":"2023-10-03T19:15:46.363085+0000","last_active":"2023-10-03T19:15:47.340274+0000","last_peered":"2023-10-03T19:15:47.340274+0000","last_clean":"2023-10-03T19:15:47.340274+0000","last_became_active":"2023-10-03T19:15:46.362532+0000","last_became_peered":"2023-10-03T19:15:46.362532+0000","last_unstale":"2023-10-03T19:15:47.340274+0000","last_undegraded":"2023-10-03T19:15:47.340274+0000","last_fullsized":"2023-10-03T19:15:47.340274+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:56:08.389510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158898+0000","last_change":"2023-10-03T19:15:46.364944+0000","last_active":"2023-10-03T19:15:48.158898+0000","last_peered":"2023-10-03T19:15:48.158898+0000","last_clean":"2023-10-03T19:15:48.158898+0000","last_became_active":"2023-10-03T19:15:46.364685+0000","last_became_peered":"2023-10-03T19:15:46.364685+0000","last_unstale":"2023-10-03T19:15:48.158898+0000","last_undegraded":"2023-10-03T19:15:48.158898+0000","last_fullsized":"2023-10-03T19:15:48.158898+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:39:43.145618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.156479+0000","last_change":"2023-10-03T19:15:46.353965+0000","last_active":"2023-10-03T19:15:48.156479+0000","last_peered":"2023-10-03T19:15:48.156479+0000","last_clean":"2023-10-03T19:15:48.156479+0000","last_became_active":"2023-10-03T19:15:46.353608+0000","last_became_peered":"2023-10-03T19:15:46.353608+0000","last_unstale":"2023-10-03T19:15:48.156479+0000","last_undegraded":"2023-10-03T19:15:48.156479+0000","last_fullsized":"2023-10-03T19:15:48.156479+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:21:29.369999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158164+0000","last_change":"2023-10-03T19:15:46.354277+0000","last_active":"2023-10-03T19:15:48.158164+0000","last_peered":"2023-10-03T19:15:48.158164+0000","last_clean":"2023-10-03T19:15:48.158164+0000","last_became_active":"2023-10-03T19:15:46.353658+0000","last_became_peered":"2023-10-03T19:15:46.353658+0000","last_unstale":"2023-10-03T19:15:48.158164+0000","last_undegraded":"2023-10-03T19:15:48.158164+0000","last_fullsized":"2023-10-03T19:15:48.158164+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:39:07.280049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.340998+0000","last_change":"2023-10-03T19:15:46.362303+0000","last_active":"2023-10-03T19:15:47.340998+0000","last_peered":"2023-10-03T19:15:47.340998+0000","last_clean":"2023-10-03T19:15:47.340998+0000","last_became_active":"2023-10-03T19:15:46.362001+0000","last_became_peered":"2023-10-03T19:15:46.362001+0000","last_unstale":"2023-10-03T19:15:47.340998+0000","last_undegraded":"2023-10-03T19:15:47.340998+0000","last_fullsized":"2023-10-03T19:15:47.340998+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:40:07.414352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.157870+0000","last_change":"2023-10-03T19:15:46.367695+0000","last_active":"2023-10-03T19:15:48.157870+0000","last_peered":"2023-10-03T19:15:48.157870+0000","last_clean":"2023-10-03T19:15:48.157870+0000","last_became_active":"2023-10-03T19:15:46.367450+0000","last_became_peered":"2023-10-03T19:15:46.367450+0000","last_unstale":"2023-10-03T19:15:48.157870+0000","last_undegraded":"2023-10-03T19:15:48.157870+0000","last_fullsized":"2023-10-03T19:15:48.157870+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:10:19.340333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.157796+0000","last_change":"2023-10-03T19:15:46.381309+0000","last_active":"2023-10-03T19:15:48.157796+0000","last_peered":"2023-10-03T19:15:48.157796+0000","last_clean":"2023-10-03T19:15:48.157796+0000","last_became_active":"2023-10-03T19:15:46.381054+0000","last_became_peered":"2023-10-03T19:15:46.381054+0000","last_unstale":"2023-10-03T19:15:48.157796+0000","last_undegraded":"2023-10-03T19:15:48.157796+0000","last_fullsized":"2023-10-03T19:15:48.157796+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:32:45.858483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.340342+0000","last_change":"2023-10-03T19:15:46.365193+0000","last_active":"2023-10-03T19:15:47.340342+0000","last_peered":"2023-10-03T19:15:47.340342+0000","last_clean":"2023-10-03T19:15:47.340342+0000","last_became_active":"2023-10-03T19:15:46.364040+0000","last_became_peered":"2023-10-03T19:15:46.364040+0000","last_unstale":"2023-10-03T19:15:47.340342+0000","last_undegraded":"2023-10-03T19:15:47.340342+0000","last_fullsized":"2023-10-03T19:15:47.340342+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:14:33.244198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159667+0000","last_change":"2023-10-03T19:15:46.364760+0000","last_active":"2023-10-03T19:15:48.159667+0000","last_peered":"2023-10-03T19:15:48.159667+0000","last_clean":"2023-10-03T19:15:48.159667+0000","last_became_active":"2023-10-03T19:15:46.360362+0000","last_became_peered":"2023-10-03T19:15:46.360362+0000","last_unstale":"2023-10-03T19:15:48.159667+0000","last_undegraded":"2023-10-03T19:15:48.159667+0000","last_fullsized":"2023-10-03T19:15:48.159667+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:25:27.749340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158876+0000","last_change":"2023-10-03T19:15:46.379695+0000","last_active":"2023-10-03T19:15:48.158876+0000","last_peered":"2023-10-03T19:15:48.158876+0000","last_clean":"2023-10-03T19:15:48.158876+0000","last_became_active":"2023-10-03T19:15:46.378968+0000","last_became_peered":"2023-10-03T19:15:46.378968+0000","last_unstale":"2023-10-03T19:15:48.158876+0000","last_undegraded":"2023-10-03T19:15:48.158876+0000","last_fullsized":"2023-10-03T19:15:48.158876+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:10:26.661897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.340046+0000","last_change":"2023-10-03T19:15:46.362453+0000","last_active":"2023-10-03T19:15:47.340046+0000","last_peered":"2023-10-03T19:15:47.340046+0000","last_clean":"2023-10-03T19:15:47.340046+0000","last_became_active":"2023-10-03T19:15:46.361895+0000","last_became_peered":"2023-10-03T19:15:46.361895+0000","last_unstale":"2023-10-03T19:15:47.340046+0000","last_undegraded":"2023-10-03T19:15:47.340046+0000","last_fullsized":"2023-10-03T19:15:47.340046+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:37:50.054950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160719+0000","last_change":"2023-10-03T19:15:46.400243+0000","last_active":"2023-10-03T19:15:48.160719+0000","last_peered":"2023-10-03T19:15:48.160719+0000","last_clean":"2023-10-03T19:15:48.160719+0000","last_became_active":"2023-10-03T19:15:46.399983+0000","last_became_peered":"2023-10-03T19:15:46.399983+0000","last_unstale":"2023-10-03T19:15:48.160719+0000","last_undegraded":"2023-10-03T19:15:48.160719+0000","last_fullsized":"2023-10-03T19:15:48.160719+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:53:20.933525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159755+0000","last_change":"2023-10-03T19:15:46.399010+0000","last_active":"2023-10-03T19:15:48.159755+0000","last_peered":"2023-10-03T19:15:48.159755+0000","last_clean":"2023-10-03T19:15:48.159755+0000","last_became_active":"2023-10-03T19:15:46.397599+0000","last_became_peered":"2023-10-03T19:15:46.397599+0000","last_unstale":"2023-10-03T19:15:48.159755+0000","last_undegraded":"2023-10-03T19:15:48.159755+0000","last_fullsized":"2023-10-03T19:15:48.159755+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:39:30.227606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160430+0000","last_change":"2023-10-03T19:15:46.377306+0000","last_active":"2023-10-03T19:15:48.160430+0000","last_peered":"2023-10-03T19:15:48.160430+0000","last_clean":"2023-10-03T19:15:48.160430+0000","last_became_active":"2023-10-03T19:15:46.377041+0000","last_became_peered":"2023-10-03T19:15:46.377041+0000","last_unstale":"2023-10-03T19:15:48.160430+0000","last_undegraded":"2023-10-03T19:15:48.160430+0000","last_fullsized":"2023-10-03T19:15:48.160430+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:26:46.602249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.930331+0000","last_change":"2023-10-03T19:15:46.388939+0000","last_active":"2023-10-03T19:15:47.930331+0000","last_peered":"2023-10-03T19:15:47.930331+0000","last_clean":"2023-10-03T19:15:47.930331+0000","last_became_active":"2023-10-03T19:15:46.388201+0000","last_became_peered":"2023-10-03T19:15:46.388201+0000","last_unstale":"2023-10-03T19:15:47.930331+0000","last_undegraded":"2023-10-03T19:15:47.930331+0000","last_fullsized":"2023-10-03T19:15:47.930331+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:50:16.014010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.930114+0000","last_change":"2023-10-03T19:15:46.393014+0000","last_active":"2023-10-03T19:15:47.930114+0000","last_peered":"2023-10-03T19:15:47.930114+0000","last_clean":"2023-10-03T19:15:47.930114+0000","last_became_active":"2023-10-03T19:15:46.392401+0000","last_became_peered":"2023-10-03T19:15:46.392401+0000","last_unstale":"2023-10-03T19:15:47.930114+0000","last_undegraded":"2023-10-03T19:15:47.930114+0000","last_fullsized":"2023-10-03T19:15:47.930114+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:32:59.029909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.156041+0000","last_change":"2023-10-03T19:15:46.350727+0000","last_active":"2023-10-03T19:15:48.156041+0000","last_peered":"2023-10-03T19:15:48.156041+0000","last_clean":"2023-10-03T19:15:48.156041+0000","last_became_active":"2023-10-03T19:15:46.350403+0000","last_became_peered":"2023-10-03T19:15:46.350403+0000","last_unstale":"2023-10-03T19:15:48.156041+0000","last_undegraded":"2023-10-03T19:15:48.156041+0000","last_fullsized":"2023-10-03T19:15:48.156041+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:43:56.113409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.157139+0000","last_change":"2023-10-03T19:15:46.378934+0000","last_active":"2023-10-03T19:15:48.157139+0000","last_peered":"2023-10-03T19:15:48.157139+0000","last_clean":"2023-10-03T19:15:48.157139+0000","last_became_active":"2023-10-03T19:15:46.378611+0000","last_became_peered":"2023-10-03T19:15:46.378611+0000","last_unstale":"2023-10-03T19:15:48.157139+0000","last_undegraded":"2023-10-03T19:15:48.157139+0000","last_fullsized":"2023-10-03T19:15:48.157139+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:51:41.830735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158761+0000","last_change":"2023-10-03T19:15:46.360949+0000","last_active":"2023-10-03T19:15:48.158761+0000","last_peered":"2023-10-03T19:15:48.158761+0000","last_clean":"2023-10-03T19:15:48.158761+0000","last_became_active":"2023-10-03T19:15:46.360658+0000","last_became_peered":"2023-10-03T19:15:46.360658+0000","last_unstale":"2023-10-03T19:15:48.158761+0000","last_undegraded":"2023-10-03T19:15:48.158761+0000","last_fullsized":"2023-10-03T19:15:48.158761+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:03:34.243331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160900+0000","last_change":"2023-10-03T19:15:46.368683+0000","last_active":"2023-10-03T19:15:48.160900+0000","last_peered":"2023-10-03T19:15:48.160900+0000","last_clean":"2023-10-03T19:15:48.160900+0000","last_became_active":"2023-10-03T19:15:46.368390+0000","last_became_peered":"2023-10-03T19:15:46.368390+0000","last_unstale":"2023-10-03T19:15:48.160900+0000","last_undegraded":"2023-10-03T19:15:48.160900+0000","last_fullsized":"2023-10-03T19:15:48.160900+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:03:04.832859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.157568+0000","last_change":"2023-10-03T19:15:46.361848+0000","last_active":"2023-10-03T19:15:48.157568+0000","last_peered":"2023-10-03T19:15:48.157568+0000","last_clean":"2023-10-03T19:15:48.157568+0000","last_became_active":"2023-10-03T19:15:46.361456+0000","last_became_peered":"2023-10-03T19:15:46.361456+0000","last_unstale":"2023-10-03T19:15:48.157568+0000","last_undegraded":"2023-10-03T19:15:48.157568+0000","last_fullsized":"2023-10-03T19:15:48.157568+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:54:18.477951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.340738+0000","last_change":"2023-10-03T19:15:46.353768+0000","last_active":"2023-10-03T19:15:47.340738+0000","last_peered":"2023-10-03T19:15:47.340738+0000","last_clean":"2023-10-03T19:15:47.340738+0000","last_became_active":"2023-10-03T19:15:46.353516+0000","last_became_peered":"2023-10-03T19:15:46.353516+0000","last_unstale":"2023-10-03T19:15:47.340738+0000","last_undegraded":"2023-10-03T19:15:47.340738+0000","last_fullsized":"2023-10-03T19:15:47.340738+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:43:56.113409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.930360+0000","last_change":"2023-10-03T19:15:46.375987+0000","last_active":"2023-10-03T19:15:47.930360+0000","last_peered":"2023-10-03T19:15:47.930360+0000","last_clean":"2023-10-03T19:15:47.930360+0000","last_became_active":"2023-10-03T19:15:46.375284+0000","last_became_peered":"2023-10-03T19:15:46.375284+0000","last_unstale":"2023-10-03T19:15:47.930360+0000","last_undegraded":"2023-10-03T19:15:47.930360+0000","last_fullsized":"2023-10-03T19:15:47.930360+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:20:33.840630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159751+0000","last_change":"2023-10-03T19:15:46.374991+0000","last_active":"2023-10-03T19:15:48.159751+0000","last_peered":"2023-10-03T19:15:48.159751+0000","last_clean":"2023-10-03T19:15:48.159751+0000","last_became_active":"2023-10-03T19:15:46.374699+0000","last_became_peered":"2023-10-03T19:15:46.374699+0000","last_unstale":"2023-10-03T19:15:48.159751+0000","last_undegraded":"2023-10-03T19:15:48.159751+0000","last_fullsized":"2023-10-03T19:15:48.159751+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:38:41.035694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159057+0000","last_change":"2023-10-03T19:15:46.380983+0000","last_active":"2023-10-03T19:15:48.159057+0000","last_peered":"2023-10-03T19:15:48.159057+0000","last_clean":"2023-10-03T19:15:48.159057+0000","last_became_active":"2023-10-03T19:15:46.380216+0000","last_became_peered":"2023-10-03T19:15:46.380216+0000","last_unstale":"2023-10-03T19:15:48.159057+0000","last_undegraded":"2023-10-03T19:15:48.159057+0000","last_fullsized":"2023-10-03T19:15:48.159057+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:49:49.641490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159168+0000","last_change":"2023-10-03T19:15:46.361191+0000","last_active":"2023-10-03T19:15:48.159168+0000","last_peered":"2023-10-03T19:15:48.159168+0000","last_clean":"2023-10-03T19:15:48.159168+0000","last_became_active":"2023-10-03T19:15:46.360817+0000","last_became_peered":"2023-10-03T19:15:46.360817+0000","last_unstale":"2023-10-03T19:15:48.159168+0000","last_undegraded":"2023-10-03T19:15:48.159168+0000","last_fullsized":"2023-10-03T19:15:48.159168+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:09:39.321340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.348033+0000","last_change":"2023-10-03T19:15:46.399112+0000","last_active":"2023-10-03T19:15:47.348033+0000","last_peered":"2023-10-03T19:15:47.348033+0000","last_clean":"2023-10-03T19:15:47.348033+0000","last_became_active":"2023-10-03T19:15:46.398515+0000","last_became_peered":"2023-10-03T19:15:46.398515+0000","last_unstale":"2023-10-03T19:15:47.348033+0000","last_undegraded":"2023-10-03T19:15:47.348033+0000","last_fullsized":"2023-10-03T19:15:47.348033+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:34:48.331811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158508+0000","last_change":"2023-10-03T19:15:46.403169+0000","last_active":"2023-10-03T19:15:48.158508+0000","last_peered":"2023-10-03T19:15:48.158508+0000","last_clean":"2023-10-03T19:15:48.158508+0000","last_became_active":"2023-10-03T19:15:46.402567+0000","last_became_peered":"2023-10-03T19:15:46.402567+0000","last_unstale":"2023-10-03T19:15:48.158508+0000","last_undegraded":"2023-10-03T19:15:48.158508+0000","last_fullsized":"2023-10-03T19:15:48.158508+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:26:28.165599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"47'4","reported_seq":17,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.930802+0000","last_change":"2023-10-03T19:15:45.859549+0000","last_active":"2023-10-03T19:15:47.930802+0000","last_peered":"2023-10-03T19:15:47.930802+0000","last_clean":"2023-10-03T19:15:47.930802+0000","last_became_active":"2023-10-03T19:15:45.859068+0000","last_became_peered":"2023-10-03T19:15:45.859068+0000","last_unstale":"2023-10-03T19:15:47.930802+0000","last_undegraded":"2023-10-03T19:15:47.930802+0000","last_fullsized":"2023-10-03T19:15:47.930802+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:56:16.032646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.348456+0000","last_change":"2023-10-03T19:15:46.398012+0000","last_active":"2023-10-03T19:15:47.348456+0000","last_peered":"2023-10-03T19:15:47.348456+0000","last_clean":"2023-10-03T19:15:47.348456+0000","last_became_active":"2023-10-03T19:15:46.396826+0000","last_became_peered":"2023-10-03T19:15:46.396826+0000","last_unstale":"2023-10-03T19:15:47.348456+0000","last_undegraded":"2023-10-03T19:15:47.348456+0000","last_fullsized":"2023-10-03T19:15:47.348456+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:01:43.218107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.341091+0000","last_change":"2023-10-03T19:15:45.849183+0000","last_active":"2023-10-03T19:15:47.341091+0000","last_peered":"2023-10-03T19:15:47.341091+0000","last_clean":"2023-10-03T19:15:47.341091+0000","last_became_active":"2023-10-03T19:15:45.848159+0000","last_became_peered":"2023-10-03T19:15:45.848159+0000","last_unstale":"2023-10-03T19:15:47.341091+0000","last_undegraded":"2023-10-03T19:15:47.341091+0000","last_fullsized":"2023-10-03T19:15:47.341091+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:43:36.658709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.930000+0000","last_change":"2023-10-03T19:15:46.393166+0000","last_active":"2023-10-03T19:15:47.930000+0000","last_peered":"2023-10-03T19:15:47.930000+0000","last_clean":"2023-10-03T19:15:47.930000+0000","last_became_active":"2023-10-03T19:15:46.392621+0000","last_became_peered":"2023-10-03T19:15:46.392621+0000","last_unstale":"2023-10-03T19:15:47.930000+0000","last_undegraded":"2023-10-03T19:15:47.930000+0000","last_fullsized":"2023-10-03T19:15:47.930000+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:53:34.113893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.340830+0000","last_change":"2023-10-03T19:15:45.856473+0000","last_active":"2023-10-03T19:15:47.340830+0000","last_peered":"2023-10-03T19:15:47.340830+0000","last_clean":"2023-10-03T19:15:47.340830+0000","last_became_active":"2023-10-03T19:15:45.856139+0000","last_became_peered":"2023-10-03T19:15:45.856139+0000","last_unstale":"2023-10-03T19:15:47.340830+0000","last_undegraded":"2023-10-03T19:15:47.340830+0000","last_fullsized":"2023-10-03T19:15:47.340830+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:27:43.264995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.156020+0000","last_change":"2023-10-03T19:15:46.358821+0000","last_active":"2023-10-03T19:15:48.156020+0000","last_peered":"2023-10-03T19:15:48.156020+0000","last_clean":"2023-10-03T19:15:48.156020+0000","last_became_active":"2023-10-03T19:15:46.358556+0000","last_became_peered":"2023-10-03T19:15:46.358556+0000","last_unstale":"2023-10-03T19:15:48.156020+0000","last_undegraded":"2023-10-03T19:15:48.156020+0000","last_fullsized":"2023-10-03T19:15:48.156020+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:51:25.080660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349975+0000","last_change":"2023-10-03T19:15:45.853261+0000","last_active":"2023-10-03T19:15:47.349975+0000","last_peered":"2023-10-03T19:15:47.349975+0000","last_clean":"2023-10-03T19:15:47.349975+0000","last_became_active":"2023-10-03T19:15:45.852517+0000","last_became_peered":"2023-10-03T19:15:45.852517+0000","last_unstale":"2023-10-03T19:15:47.349975+0000","last_undegraded":"2023-10-03T19:15:47.349975+0000","last_fullsized":"2023-10-03T19:15:47.349975+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:44:19.861675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349125+0000","last_change":"2023-10-03T19:15:46.378648+0000","last_active":"2023-10-03T19:15:47.349125+0000","last_peered":"2023-10-03T19:15:47.349125+0000","last_clean":"2023-10-03T19:15:47.349125+0000","last_became_active":"2023-10-03T19:15:46.377900+0000","last_became_peered":"2023-10-03T19:15:46.377900+0000","last_unstale":"2023-10-03T19:15:47.349125+0000","last_undegraded":"2023-10-03T19:15:47.349125+0000","last_fullsized":"2023-10-03T19:15:47.349125+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:51:25.080660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159827+0000","last_change":"2023-10-03T19:15:45.842290+0000","last_active":"2023-10-03T19:15:48.159827+0000","last_peered":"2023-10-03T19:15:48.159827+0000","last_clean":"2023-10-03T19:15:48.159827+0000","last_became_active":"2023-10-03T19:15:45.841848+0000","last_became_peered":"2023-10-03T19:15:45.841848+0000","last_unstale":"2023-10-03T19:15:48.159827+0000","last_undegraded":"2023-10-03T19:15:48.159827+0000","last_fullsized":"2023-10-03T19:15:48.159827+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:14:42.878422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159307+0000","last_change":"2023-10-03T19:15:46.385410+0000","last_active":"2023-10-03T19:15:48.159307+0000","last_peered":"2023-10-03T19:15:48.159307+0000","last_clean":"2023-10-03T19:15:48.159307+0000","last_became_active":"2023-10-03T19:15:46.381382+0000","last_became_peered":"2023-10-03T19:15:46.381382+0000","last_unstale":"2023-10-03T19:15:48.159307+0000","last_undegraded":"2023-10-03T19:15:48.159307+0000","last_fullsized":"2023-10-03T19:15:48.159307+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:09:40.009947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349310+0000","last_change":"2023-10-03T19:15:45.861708+0000","last_active":"2023-10-03T19:15:47.349310+0000","last_peered":"2023-10-03T19:15:47.349310+0000","last_clean":"2023-10-03T19:15:47.349310+0000","last_became_active":"2023-10-03T19:15:45.861138+0000","last_became_peered":"2023-10-03T19:15:45.861138+0000","last_unstale":"2023-10-03T19:15:47.349310+0000","last_undegraded":"2023-10-03T19:15:47.349310+0000","last_fullsized":"2023-10-03T19:15:47.349310+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:00:34.659474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158173+0000","last_change":"2023-10-03T19:15:46.358217+0000","last_active":"2023-10-03T19:15:48.158173+0000","last_peered":"2023-10-03T19:15:48.158173+0000","last_clean":"2023-10-03T19:15:48.158173+0000","last_became_active":"2023-10-03T19:15:46.357887+0000","last_became_peered":"2023-10-03T19:15:46.357887+0000","last_unstale":"2023-10-03T19:15:48.158173+0000","last_undegraded":"2023-10-03T19:15:48.158173+0000","last_fullsized":"2023-10-03T19:15:48.158173+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:03:39.727170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.930613+0000","last_change":"2023-10-03T19:15:45.854212+0000","last_active":"2023-10-03T19:15:47.930613+0000","last_peered":"2023-10-03T19:15:47.930613+0000","last_clean":"2023-10-03T19:15:47.930613+0000","last_became_active":"2023-10-03T19:15:45.851309+0000","last_became_peered":"2023-10-03T19:15:45.851309+0000","last_unstale":"2023-10-03T19:15:47.930613+0000","last_undegraded":"2023-10-03T19:15:47.930613+0000","last_fullsized":"2023-10-03T19:15:47.930613+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:33:04.393302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159796+0000","last_change":"2023-10-03T19:15:46.379625+0000","last_active":"2023-10-03T19:15:48.159796+0000","last_peered":"2023-10-03T19:15:48.159796+0000","last_clean":"2023-10-03T19:15:48.159796+0000","last_became_active":"2023-10-03T19:15:46.378821+0000","last_became_peered":"2023-10-03T19:15:46.378821+0000","last_unstale":"2023-10-03T19:15:48.159796+0000","last_undegraded":"2023-10-03T19:15:48.159796+0000","last_fullsized":"2023-10-03T19:15:48.159796+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:38:47.883311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158940+0000","last_change":"2023-10-03T19:15:45.858316+0000","last_active":"2023-10-03T19:15:48.158940+0000","last_peered":"2023-10-03T19:15:48.158940+0000","last_clean":"2023-10-03T19:15:48.158940+0000","last_became_active":"2023-10-03T19:15:45.857799+0000","last_became_peered":"2023-10-03T19:15:45.857799+0000","last_unstale":"2023-10-03T19:15:48.158940+0000","last_undegraded":"2023-10-03T19:15:48.158940+0000","last_fullsized":"2023-10-03T19:15:48.158940+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:53:16.171067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.347705+0000","last_change":"2023-10-03T19:15:46.364379+0000","last_active":"2023-10-03T19:15:47.347705+0000","last_peered":"2023-10-03T19:15:47.347705+0000","last_clean":"2023-10-03T19:15:47.347705+0000","last_became_active":"2023-10-03T19:15:46.363462+0000","last_became_peered":"2023-10-03T19:15:46.363462+0000","last_unstale":"2023-10-03T19:15:47.347705+0000","last_undegraded":"2023-10-03T19:15:47.347705+0000","last_fullsized":"2023-10-03T19:15:47.347705+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:56:08.389510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159572+0000","last_change":"2023-10-03T19:15:45.859177+0000","last_active":"2023-10-03T19:15:48.159572+0000","last_peered":"2023-10-03T19:15:48.159572+0000","last_clean":"2023-10-03T19:15:48.159572+0000","last_became_active":"2023-10-03T19:15:45.857999+0000","last_became_peered":"2023-10-03T19:15:45.857999+0000","last_unstale":"2023-10-03T19:15:48.159572+0000","last_undegraded":"2023-10-03T19:15:48.159572+0000","last_fullsized":"2023-10-03T19:15:48.159572+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:22:08.131191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.348113+0000","last_change":"2023-10-03T19:15:46.397614+0000","last_active":"2023-10-03T19:15:47.348113+0000","last_peered":"2023-10-03T19:15:47.348113+0000","last_clean":"2023-10-03T19:15:47.348113+0000","last_became_active":"2023-10-03T19:15:46.396040+0000","last_became_peered":"2023-10-03T19:15:46.396040+0000","last_unstale":"2023-10-03T19:15:47.348113+0000","last_undegraded":"2023-10-03T19:15:47.348113+0000","last_fullsized":"2023-10-03T19:15:47.348113+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:37:55.351113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.348649+0000","last_change":"2023-10-03T19:15:45.847050+0000","last_active":"2023-10-03T19:15:47.348649+0000","last_peered":"2023-10-03T19:15:47.348649+0000","last_clean":"2023-10-03T19:15:47.348649+0000","last_became_active":"2023-10-03T19:15:45.846253+0000","last_became_peered":"2023-10-03T19:15:45.846253+0000","last_unstale":"2023-10-03T19:15:47.348649+0000","last_undegraded":"2023-10-03T19:15:47.348649+0000","last_fullsized":"2023-10-03T19:15:47.348649+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:26:38.550548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159843+0000","last_change":"2023-10-03T19:15:46.375450+0000","last_active":"2023-10-03T19:15:48.159843+0000","last_peered":"2023-10-03T19:15:48.159843+0000","last_clean":"2023-10-03T19:15:48.159843+0000","last_became_active":"2023-10-03T19:15:46.375071+0000","last_became_peered":"2023-10-03T19:15:46.375071+0000","last_unstale":"2023-10-03T19:15:48.159843+0000","last_undegraded":"2023-10-03T19:15:48.159843+0000","last_fullsized":"2023-10-03T19:15:48.159843+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:54:49.165838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"47'3","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159474+0000","last_change":"2023-10-03T19:15:45.860953+0000","last_active":"2023-10-03T19:15:48.159474+0000","last_peered":"2023-10-03T19:15:48.159474+0000","last_clean":"2023-10-03T19:15:48.159474+0000","last_became_active":"2023-10-03T19:15:45.859256+0000","last_became_peered":"2023-10-03T19:15:45.859256+0000","last_unstale":"2023-10-03T19:15:48.159474+0000","last_undegraded":"2023-10-03T19:15:48.159474+0000","last_fullsized":"2023-10-03T19:15:48.159474+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:28:48.656360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349230+0000","last_change":"2023-10-03T19:15:46.365297+0000","last_active":"2023-10-03T19:15:47.349230+0000","last_peered":"2023-10-03T19:15:47.349230+0000","last_clean":"2023-10-03T19:15:47.349230+0000","last_became_active":"2023-10-03T19:15:46.363978+0000","last_became_peered":"2023-10-03T19:15:46.363978+0000","last_unstale":"2023-10-03T19:15:47.349230+0000","last_undegraded":"2023-10-03T19:15:47.349230+0000","last_fullsized":"2023-10-03T19:15:47.349230+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:43:56.113409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"47'6","reported_seq":19,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158080+0000","last_change":"2023-10-03T19:15:45.845291+0000","last_active":"2023-10-03T19:15:48.158080+0000","last_peered":"2023-10-03T19:15:48.158080+0000","last_clean":"2023-10-03T19:15:48.158080+0000","last_became_active":"2023-10-03T19:15:45.845024+0000","last_became_peered":"2023-10-03T19:15:45.845024+0000","last_unstale":"2023-10-03T19:15:48.158080+0000","last_undegraded":"2023-10-03T19:15:48.158080+0000","last_fullsized":"2023-10-03T19:15:48.158080+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:59:14.940033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349625+0000","last_change":"2023-10-03T19:15:46.397165+0000","last_active":"2023-10-03T19:15:47.349625+0000","last_peered":"2023-10-03T19:15:47.349625+0000","last_clean":"2023-10-03T19:15:47.349625+0000","last_became_active":"2023-10-03T19:15:46.396350+0000","last_became_peered":"2023-10-03T19:15:46.396350+0000","last_unstale":"2023-10-03T19:15:47.349625+0000","last_undegraded":"2023-10-03T19:15:47.349625+0000","last_fullsized":"2023-10-03T19:15:47.349625+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:51:27.685465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160115+0000","last_change":"2023-10-03T19:15:45.855724+0000","last_active":"2023-10-03T19:15:48.160115+0000","last_peered":"2023-10-03T19:15:48.160115+0000","last_clean":"2023-10-03T19:15:48.160115+0000","last_became_active":"2023-10-03T19:15:45.855158+0000","last_became_peered":"2023-10-03T19:15:45.855158+0000","last_unstale":"2023-10-03T19:15:48.160115+0000","last_undegraded":"2023-10-03T19:15:48.160115+0000","last_fullsized":"2023-10-03T19:15:48.160115+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:35:35.283953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160510+0000","last_change":"2023-10-03T19:15:46.368523+0000","last_active":"2023-10-03T19:15:48.160510+0000","last_peered":"2023-10-03T19:15:48.160510+0000","last_clean":"2023-10-03T19:15:48.160510+0000","last_became_active":"2023-10-03T19:15:46.368208+0000","last_became_peered":"2023-10-03T19:15:46.368208+0000","last_unstale":"2023-10-03T19:15:48.160510+0000","last_undegraded":"2023-10-03T19:15:48.160510+0000","last_fullsized":"2023-10-03T19:15:48.160510+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:02:17.268261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.930506+0000","last_change":"2023-10-03T19:15:45.860845+0000","last_active":"2023-10-03T19:15:47.930506+0000","last_peered":"2023-10-03T19:15:47.930506+0000","last_clean":"2023-10-03T19:15:47.930506+0000","last_became_active":"2023-10-03T19:15:45.860209+0000","last_became_peered":"2023-10-03T19:15:45.860209+0000","last_unstale":"2023-10-03T19:15:47.930506+0000","last_undegraded":"2023-10-03T19:15:47.930506+0000","last_fullsized":"2023-10-03T19:15:47.930506+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:11:54.664420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.157923+0000","last_change":"2023-10-03T19:15:46.377798+0000","last_active":"2023-10-03T19:15:48.157923+0000","last_peered":"2023-10-03T19:15:48.157923+0000","last_clean":"2023-10-03T19:15:48.157923+0000","last_became_active":"2023-10-03T19:15:46.377474+0000","last_became_peered":"2023-10-03T19:15:46.377474+0000","last_unstale":"2023-10-03T19:15:48.157923+0000","last_undegraded":"2023-10-03T19:15:48.157923+0000","last_fullsized":"2023-10-03T19:15:48.157923+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:03:54.226187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159103+0000","last_change":"2023-10-03T19:15:45.861050+0000","last_active":"2023-10-03T19:15:48.159103+0000","last_peered":"2023-10-03T19:15:48.159103+0000","last_clean":"2023-10-03T19:15:48.159103+0000","last_became_active":"2023-10-03T19:15:45.860266+0000","last_became_peered":"2023-10-03T19:15:45.860266+0000","last_unstale":"2023-10-03T19:15:48.159103+0000","last_undegraded":"2023-10-03T19:15:48.159103+0000","last_fullsized":"2023-10-03T19:15:48.159103+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:28:17.998844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160867+0000","last_change":"2023-10-03T19:15:46.394299+0000","last_active":"2023-10-03T19:15:48.160867+0000","last_peered":"2023-10-03T19:15:48.160867+0000","last_clean":"2023-10-03T19:15:48.160867+0000","last_became_active":"2023-10-03T19:15:46.394004+0000","last_became_peered":"2023-10-03T19:15:46.394004+0000","last_unstale":"2023-10-03T19:15:48.160867+0000","last_undegraded":"2023-10-03T19:15:48.160867+0000","last_fullsized":"2023-10-03T19:15:48.160867+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:18:54.415024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"47'8","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.157163+0000","last_change":"2023-10-03T19:15:45.848662+0000","last_active":"2023-10-03T19:15:48.157163+0000","last_peered":"2023-10-03T19:15:48.157163+0000","last_clean":"2023-10-03T19:15:48.157163+0000","last_became_active":"2023-10-03T19:15:45.848008+0000","last_became_peered":"2023-10-03T19:15:45.848008+0000","last_unstale":"2023-10-03T19:15:48.157163+0000","last_undegraded":"2023-10-03T19:15:48.157163+0000","last_fullsized":"2023-10-03T19:15:48.157163+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:43:36.658709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.156840+0000","last_change":"2023-10-03T19:15:46.399152+0000","last_active":"2023-10-03T19:15:48.156840+0000","last_peered":"2023-10-03T19:15:48.156840+0000","last_clean":"2023-10-03T19:15:48.156840+0000","last_became_active":"2023-10-03T19:15:46.398935+0000","last_became_peered":"2023-10-03T19:15:46.398935+0000","last_unstale":"2023-10-03T19:15:48.156840+0000","last_undegraded":"2023-10-03T19:15:48.156840+0000","last_fullsized":"2023-10-03T19:15:48.156840+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:58:27.652930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.161196+0000","last_change":"2023-10-03T19:15:45.849759+0000","last_active":"2023-10-03T19:15:48.161196+0000","last_peered":"2023-10-03T19:15:48.161196+0000","last_clean":"2023-10-03T19:15:48.161196+0000","last_became_active":"2023-10-03T19:15:45.849456+0000","last_became_peered":"2023-10-03T19:15:45.849456+0000","last_unstale":"2023-10-03T19:15:48.161196+0000","last_undegraded":"2023-10-03T19:15:48.161196+0000","last_fullsized":"2023-10-03T19:15:48.161196+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:04:10.067798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.340190+0000","last_change":"2023-10-03T19:15:46.350646+0000","last_active":"2023-10-03T19:15:47.340190+0000","last_peered":"2023-10-03T19:15:47.340190+0000","last_clean":"2023-10-03T19:15:47.340190+0000","last_became_active":"2023-10-03T19:15:46.350328+0000","last_became_peered":"2023-10-03T19:15:46.350328+0000","last_unstale":"2023-10-03T19:15:47.340190+0000","last_undegraded":"2023-10-03T19:15:47.340190+0000","last_fullsized":"2023-10-03T19:15:47.340190+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:51:25.080660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158967+0000","last_change":"2023-10-03T19:15:45.836185+0000","last_active":"2023-10-03T19:15:48.158967+0000","last_peered":"2023-10-03T19:15:48.158967+0000","last_clean":"2023-10-03T19:15:48.158967+0000","last_became_active":"2023-10-03T19:15:45.835843+0000","last_became_peered":"2023-10-03T19:15:45.835843+0000","last_unstale":"2023-10-03T19:15:48.158967+0000","last_undegraded":"2023-10-03T19:15:48.158967+0000","last_fullsized":"2023-10-03T19:15:48.158967+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:23:01.385691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.348966+0000","last_change":"2023-10-03T19:15:46.367540+0000","last_active":"2023-10-03T19:15:47.348966+0000","last_peered":"2023-10-03T19:15:47.348966+0000","last_clean":"2023-10-03T19:15:47.348966+0000","last_became_active":"2023-10-03T19:15:46.366645+0000","last_became_peered":"2023-10-03T19:15:46.366645+0000","last_unstale":"2023-10-03T19:15:47.348966+0000","last_undegraded":"2023-10-03T19:15:47.348966+0000","last_fullsized":"2023-10-03T19:15:47.348966+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:52:45.483362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.930813+0000","last_change":"2023-10-03T19:15:45.849574+0000","last_active":"2023-10-03T19:15:47.930813+0000","last_peered":"2023-10-03T19:15:47.930813+0000","last_clean":"2023-10-03T19:15:47.930813+0000","last_became_active":"2023-10-03T19:15:45.848800+0000","last_became_peered":"2023-10-03T19:15:45.848800+0000","last_unstale":"2023-10-03T19:15:47.930813+0000","last_undegraded":"2023-10-03T19:15:47.930813+0000","last_fullsized":"2023-10-03T19:15:47.930813+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:39:57.371155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.340502+0000","last_change":"2023-10-03T19:15:46.394179+0000","last_active":"2023-10-03T19:15:47.340502+0000","last_peered":"2023-10-03T19:15:47.340502+0000","last_clean":"2023-10-03T19:15:47.340502+0000","last_became_active":"2023-10-03T19:15:46.393883+0000","last_became_peered":"2023-10-03T19:15:46.393883+0000","last_unstale":"2023-10-03T19:15:47.340502+0000","last_undegraded":"2023-10-03T19:15:47.340502+0000","last_fullsized":"2023-10-03T19:15:47.340502+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:03:56.161089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.930779+0000","last_change":"2023-10-03T19:15:45.859040+0000","last_active":"2023-10-03T19:15:47.930779+0000","last_peered":"2023-10-03T19:15:47.930779+0000","last_clean":"2023-10-03T19:15:47.930779+0000","last_became_active":"2023-10-03T19:15:45.858297+0000","last_became_peered":"2023-10-03T19:15:45.858297+0000","last_unstale":"2023-10-03T19:15:47.930779+0000","last_undegraded":"2023-10-03T19:15:47.930779+0000","last_fullsized":"2023-10-03T19:15:47.930779+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:32:34.116009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349962+0000","last_change":"2023-10-03T19:15:46.396843+0000","last_active":"2023-10-03T19:15:47.349962+0000","last_peered":"2023-10-03T19:15:47.349962+0000","last_clean":"2023-10-03T19:15:47.349962+0000","last_became_active":"2023-10-03T19:15:46.395999+0000","last_became_peered":"2023-10-03T19:15:46.395999+0000","last_unstale":"2023-10-03T19:15:47.349962+0000","last_undegraded":"2023-10-03T19:15:47.349962+0000","last_fullsized":"2023-10-03T19:15:47.349962+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:33:27.851221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.340725+0000","last_change":"2023-10-03T19:15:45.835409+0000","last_active":"2023-10-03T19:15:47.340725+0000","last_peered":"2023-10-03T19:15:47.340725+0000","last_clean":"2023-10-03T19:15:47.340725+0000","last_became_active":"2023-10-03T19:15:45.835194+0000","last_became_peered":"2023-10-03T19:15:45.835194+0000","last_unstale":"2023-10-03T19:15:47.340725+0000","last_undegraded":"2023-10-03T19:15:47.340725+0000","last_fullsized":"2023-10-03T19:15:47.340725+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:00:34.659474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.930303+0000","last_change":"2023-10-03T19:15:46.388333+0000","last_active":"2023-10-03T19:15:47.930303+0000","last_peered":"2023-10-03T19:15:47.930303+0000","last_clean":"2023-10-03T19:15:47.930303+0000","last_became_active":"2023-10-03T19:15:46.387577+0000","last_became_peered":"2023-10-03T19:15:46.387577+0000","last_unstale":"2023-10-03T19:15:47.930303+0000","last_undegraded":"2023-10-03T19:15:47.930303+0000","last_fullsized":"2023-10-03T19:15:47.930303+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:05:53.275156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.156401+0000","last_change":"2023-10-03T19:15:45.846961+0000","last_active":"2023-10-03T19:15:48.156401+0000","last_peered":"2023-10-03T19:15:48.156401+0000","last_clean":"2023-10-03T19:15:48.156401+0000","last_became_active":"2023-10-03T19:15:45.845959+0000","last_became_peered":"2023-10-03T19:15:45.845959+0000","last_unstale":"2023-10-03T19:15:48.156401+0000","last_undegraded":"2023-10-03T19:15:48.156401+0000","last_fullsized":"2023-10-03T19:15:48.156401+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:00:34.659474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160520+0000","last_change":"2023-10-03T19:15:46.375168+0000","last_active":"2023-10-03T19:15:48.160520+0000","last_peered":"2023-10-03T19:15:48.160520+0000","last_clean":"2023-10-03T19:15:48.160520+0000","last_became_active":"2023-10-03T19:15:46.374822+0000","last_became_peered":"2023-10-03T19:15:46.374822+0000","last_unstale":"2023-10-03T19:15:48.160520+0000","last_undegraded":"2023-10-03T19:15:48.160520+0000","last_fullsized":"2023-10-03T19:15:48.160520+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:04:50.606893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159333+0000","last_change":"2023-10-03T19:15:45.843525+0000","last_active":"2023-10-03T19:15:48.159333+0000","last_peered":"2023-10-03T19:15:48.159333+0000","last_clean":"2023-10-03T19:15:48.159333+0000","last_became_active":"2023-10-03T19:15:45.843111+0000","last_became_peered":"2023-10-03T19:15:45.843111+0000","last_unstale":"2023-10-03T19:15:48.159333+0000","last_undegraded":"2023-10-03T19:15:48.159333+0000","last_fullsized":"2023-10-03T19:15:48.159333+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:59:15.785799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.340901+0000","last_change":"2023-10-03T19:15:46.349592+0000","last_active":"2023-10-03T19:15:47.340901+0000","last_peered":"2023-10-03T19:15:47.340901+0000","last_clean":"2023-10-03T19:15:47.340901+0000","last_became_active":"2023-10-03T19:15:46.349264+0000","last_became_peered":"2023-10-03T19:15:46.349264+0000","last_unstale":"2023-10-03T19:15:47.340901+0000","last_undegraded":"2023-10-03T19:15:47.340901+0000","last_fullsized":"2023-10-03T19:15:47.340901+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:21:29.369999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.156826+0000","last_change":"2023-10-03T19:15:45.845501+0000","last_active":"2023-10-03T19:15:48.156826+0000","last_peered":"2023-10-03T19:15:48.156826+0000","last_clean":"2023-10-03T19:15:48.156826+0000","last_became_active":"2023-10-03T19:15:45.845069+0000","last_became_peered":"2023-10-03T19:15:45.845069+0000","last_unstale":"2023-10-03T19:15:48.156826+0000","last_undegraded":"2023-10-03T19:15:48.156826+0000","last_fullsized":"2023-10-03T19:15:48.156826+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:52:48.679994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.930236+0000","last_change":"2023-10-03T19:15:46.401220+0000","last_active":"2023-10-03T19:15:47.930236+0000","last_peered":"2023-10-03T19:15:47.930236+0000","last_clean":"2023-10-03T19:15:47.930236+0000","last_became_active":"2023-10-03T19:15:46.400309+0000","last_became_peered":"2023-10-03T19:15:46.400309+0000","last_unstale":"2023-10-03T19:15:47.930236+0000","last_undegraded":"2023-10-03T19:15:47.930236+0000","last_fullsized":"2023-10-03T19:15:47.930236+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:26:19.898878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"48'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.761698+0000","last_change":"2023-10-03T19:15:45.855576+0000","last_active":"2023-10-03T19:15:48.761698+0000","last_peered":"2023-10-03T19:15:48.761698+0000","last_clean":"2023-10-03T19:15:48.761698+0000","last_became_active":"2023-10-03T19:15:45.855189+0000","last_became_peered":"2023-10-03T19:15:45.855189+0000","last_unstale":"2023-10-03T19:15:48.761698+0000","last_undegraded":"2023-10-03T19:15:48.761698+0000","last_fullsized":"2023-10-03T19:15:48.761698+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:03:22.555251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":218,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159250+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:15:48.159250+0000","last_peered":"2023-10-03T19:15:48.159250+0000","last_clean":"2023-10-03T19:15:48.159250+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:15:48.159250+0000","last_undegraded":"2023-10-03T19:15:48.159250+0000","last_fullsized":"2023-10-03T19:15:48.159250+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:06:03.840386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349442+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:15:47.349442+0000","last_peered":"2023-10-03T19:15:47.349442+0000","last_clean":"2023-10-03T19:15:47.349442+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:15:47.349442+0000","last_undegraded":"2023-10-03T19:15:47.349442+0000","last_fullsized":"2023-10-03T19:15:47.349442+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:07:52.226240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.340383+0000","last_change":"2023-10-03T19:15:46.354378+0000","last_active":"2023-10-03T19:15:47.340383+0000","last_peered":"2023-10-03T19:15:47.340383+0000","last_clean":"2023-10-03T19:15:47.340383+0000","last_became_active":"2023-10-03T19:15:46.354096+0000","last_became_peered":"2023-10-03T19:15:46.354096+0000","last_unstale":"2023-10-03T19:15:47.340383+0000","last_undegraded":"2023-10-03T19:15:47.340383+0000","last_fullsized":"2023-10-03T19:15:47.340383+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:26:39.554506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159655+0000","last_change":"2023-10-03T19:15:45.860418+0000","last_active":"2023-10-03T19:15:48.159655+0000","last_peered":"2023-10-03T19:15:48.159655+0000","last_clean":"2023-10-03T19:15:48.159655+0000","last_became_active":"2023-10-03T19:15:45.859327+0000","last_became_peered":"2023-10-03T19:15:45.859327+0000","last_unstale":"2023-10-03T19:15:48.159655+0000","last_undegraded":"2023-10-03T19:15:48.159655+0000","last_fullsized":"2023-10-03T19:15:48.159655+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:25:18.867250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158690+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:15:48.158690+0000","last_peered":"2023-10-03T19:15:48.158690+0000","last_clean":"2023-10-03T19:15:48.158690+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:15:48.158690+0000","last_undegraded":"2023-10-03T19:15:48.158690+0000","last_fullsized":"2023-10-03T19:15:48.158690+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:37:01.580773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.156409+0000","last_change":"2023-10-03T19:15:46.364340+0000","last_active":"2023-10-03T19:15:48.156409+0000","last_peered":"2023-10-03T19:15:48.156409+0000","last_clean":"2023-10-03T19:15:48.156409+0000","last_became_active":"2023-10-03T19:15:46.364068+0000","last_became_peered":"2023-10-03T19:15:46.364068+0000","last_unstale":"2023-10-03T19:15:48.156409+0000","last_undegraded":"2023-10-03T19:15:48.156409+0000","last_fullsized":"2023-10-03T19:15:48.156409+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:27:44.268953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160423+0000","last_change":"2023-10-03T19:15:45.850638+0000","last_active":"2023-10-03T19:15:48.160423+0000","last_peered":"2023-10-03T19:15:48.160423+0000","last_clean":"2023-10-03T19:15:48.160423+0000","last_became_active":"2023-10-03T19:15:45.850362+0000","last_became_peered":"2023-10-03T19:15:45.850362+0000","last_unstale":"2023-10-03T19:15:48.160423+0000","last_undegraded":"2023-10-03T19:15:48.160423+0000","last_fullsized":"2023-10-03T19:15:48.160423+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:59:04.384674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.157081+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:15:48.157081+0000","last_peered":"2023-10-03T19:15:48.157081+0000","last_clean":"2023-10-03T19:15:48.157081+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:15:48.157081+0000","last_undegraded":"2023-10-03T19:15:48.157081+0000","last_fullsized":"2023-10-03T19:15:48.157081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:20:37.927461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.348353+0000","last_change":"2023-10-03T19:15:46.396444+0000","last_active":"2023-10-03T19:15:47.348353+0000","last_peered":"2023-10-03T19:15:47.348353+0000","last_clean":"2023-10-03T19:15:47.348353+0000","last_became_active":"2023-10-03T19:15:46.395657+0000","last_became_peered":"2023-10-03T19:15:46.395657+0000","last_unstale":"2023-10-03T19:15:47.348353+0000","last_undegraded":"2023-10-03T19:15:47.348353+0000","last_fullsized":"2023-10-03T19:15:47.348353+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:02:07.926380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.930799+0000","last_change":"2023-10-03T19:15:45.858616+0000","last_active":"2023-10-03T19:15:47.930799+0000","last_peered":"2023-10-03T19:15:47.930799+0000","last_clean":"2023-10-03T19:15:47.930799+0000","last_became_active":"2023-10-03T19:15:45.858088+0000","last_became_peered":"2023-10-03T19:15:45.858088+0000","last_unstale":"2023-10-03T19:15:47.930799+0000","last_undegraded":"2023-10-03T19:15:47.930799+0000","last_fullsized":"2023-10-03T19:15:47.930799+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:44:58.867577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.347923+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:15:47.347923+0000","last_peered":"2023-10-03T19:15:47.347923+0000","last_clean":"2023-10-03T19:15:47.347923+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:15:47.347923+0000","last_undegraded":"2023-10-03T19:15:47.347923+0000","last_fullsized":"2023-10-03T19:15:47.347923+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:46:54.785846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160288+0000","last_change":"2023-10-03T19:15:46.360983+0000","last_active":"2023-10-03T19:15:48.160288+0000","last_peered":"2023-10-03T19:15:48.160288+0000","last_clean":"2023-10-03T19:15:48.160288+0000","last_became_active":"2023-10-03T19:15:46.360549+0000","last_became_peered":"2023-10-03T19:15:46.360549+0000","last_unstale":"2023-10-03T19:15:48.160288+0000","last_undegraded":"2023-10-03T19:15:48.160288+0000","last_fullsized":"2023-10-03T19:15:48.160288+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:18:21.999198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.347678+0000","last_change":"2023-10-03T19:15:45.849036+0000","last_active":"2023-10-03T19:15:47.347678+0000","last_peered":"2023-10-03T19:15:47.347678+0000","last_clean":"2023-10-03T19:15:47.347678+0000","last_became_active":"2023-10-03T19:15:45.848308+0000","last_became_peered":"2023-10-03T19:15:45.848308+0000","last_unstale":"2023-10-03T19:15:47.347678+0000","last_undegraded":"2023-10-03T19:15:47.347678+0000","last_fullsized":"2023-10-03T19:15:47.347678+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:14:32.240240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.340413+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:15:47.340413+0000","last_peered":"2023-10-03T19:15:47.340413+0000","last_clean":"2023-10-03T19:15:47.340413+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:15:47.340413+0000","last_undegraded":"2023-10-03T19:15:47.340413+0000","last_fullsized":"2023-10-03T19:15:47.340413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:49:21.984325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158360+0000","last_change":"2023-10-03T19:15:46.360964+0000","last_active":"2023-10-03T19:15:48.158360+0000","last_peered":"2023-10-03T19:15:48.158360+0000","last_clean":"2023-10-03T19:15:48.158360+0000","last_became_active":"2023-10-03T19:15:46.359049+0000","last_became_peered":"2023-10-03T19:15:46.359049+0000","last_unstale":"2023-10-03T19:15:48.158360+0000","last_undegraded":"2023-10-03T19:15:48.158360+0000","last_fullsized":"2023-10-03T19:15:48.158360+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:14:47.504752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.348664+0000","last_change":"2023-10-03T19:15:45.834172+0000","last_active":"2023-10-03T19:15:47.348664+0000","last_peered":"2023-10-03T19:15:47.348664+0000","last_clean":"2023-10-03T19:15:47.348664+0000","last_became_active":"2023-10-03T19:15:45.833415+0000","last_became_peered":"2023-10-03T19:15:45.833415+0000","last_unstale":"2023-10-03T19:15:47.348664+0000","last_undegraded":"2023-10-03T19:15:47.348664+0000","last_fullsized":"2023-10-03T19:15:47.348664+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:41:46.377632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159694+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:15:48.159694+0000","last_peered":"2023-10-03T19:15:48.159694+0000","last_clean":"2023-10-03T19:15:48.159694+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:15:48.159694+0000","last_undegraded":"2023-10-03T19:15:48.159694+0000","last_fullsized":"2023-10-03T19:15:48.159694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:48:06.089035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160091+0000","last_change":"2023-10-03T19:15:46.365576+0000","last_active":"2023-10-03T19:15:48.160091+0000","last_peered":"2023-10-03T19:15:48.160091+0000","last_clean":"2023-10-03T19:15:48.160091+0000","last_became_active":"2023-10-03T19:15:46.365249+0000","last_became_peered":"2023-10-03T19:15:46.365249+0000","last_unstale":"2023-10-03T19:15:48.160091+0000","last_undegraded":"2023-10-03T19:15:48.160091+0000","last_fullsized":"2023-10-03T19:15:48.160091+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:10:27.658304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.157494+0000","last_change":"2023-10-03T19:15:45.848356+0000","last_active":"2023-10-03T19:15:48.157494+0000","last_peered":"2023-10-03T19:15:48.157494+0000","last_clean":"2023-10-03T19:15:48.157494+0000","last_became_active":"2023-10-03T19:15:45.847882+0000","last_became_peered":"2023-10-03T19:15:45.847882+0000","last_unstale":"2023-10-03T19:15:48.157494+0000","last_undegraded":"2023-10-03T19:15:48.157494+0000","last_fullsized":"2023-10-03T19:15:48.157494+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:41:56.031002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.341281+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:15:47.341281+0000","last_peered":"2023-10-03T19:15:47.341281+0000","last_clean":"2023-10-03T19:15:47.341281+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:15:47.341281+0000","last_undegraded":"2023-10-03T19:15:47.341281+0000","last_fullsized":"2023-10-03T19:15:47.341281+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:38:33.535924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349987+0000","last_change":"2023-10-03T19:15:46.396416+0000","last_active":"2023-10-03T19:15:47.349987+0000","last_peered":"2023-10-03T19:15:47.349987+0000","last_clean":"2023-10-03T19:15:47.349987+0000","last_became_active":"2023-10-03T19:15:46.395693+0000","last_became_peered":"2023-10-03T19:15:46.395693+0000","last_unstale":"2023-10-03T19:15:47.349987+0000","last_undegraded":"2023-10-03T19:15:47.349987+0000","last_fullsized":"2023-10-03T19:15:47.349987+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:18:43.523711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.156700+0000","last_change":"2023-10-03T19:15:45.846558+0000","last_active":"2023-10-03T19:15:48.156700+0000","last_peered":"2023-10-03T19:15:48.156700+0000","last_clean":"2023-10-03T19:15:48.156700+0000","last_became_active":"2023-10-03T19:15:45.845284+0000","last_became_peered":"2023-10-03T19:15:45.845284+0000","last_unstale":"2023-10-03T19:15:48.156700+0000","last_undegraded":"2023-10-03T19:15:48.156700+0000","last_fullsized":"2023-10-03T19:15:48.156700+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:40:06.410394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.931033+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:15:47.931033+0000","last_peered":"2023-10-03T19:15:47.931033+0000","last_clean":"2023-10-03T19:15:47.931033+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:15:47.931033+0000","last_undegraded":"2023-10-03T19:15:47.931033+0000","last_fullsized":"2023-10-03T19:15:47.931033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:17:35.228192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509485,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24304,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":23680,"kb_avail":94347536,"statfs":{"total":96636764160,"available":96611876864,"internally_reserved":0,"allocated":630784,"data_stored":832439,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":24248320},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.93799999999999994,"15min":0.95399999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2030000000000001,"5min":4.0469999999999997,"15min":4.0469999999999997},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82699999999999996,"15min":0.80200000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.05,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.0800000000000001}]},{"osd":1,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.97599999999999998,"15min":1.038},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.169,"5min":3.8239999999999998,"15min":3.8239999999999998},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.878,"15min":0.85699999999999998},"min":{"1min":0.66300000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1899999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.874}]},{"osd":2,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":0.91400000000000003,"15min":0.86199999999999999},"min":{"1min":0.66100000000000003,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":6.0449999999999999,"5min":6.0449999999999999,"15min":6.0449999999999999},"last":1.212},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.0129999999999999,"15min":1.0429999999999999},"min":{"1min":0.60599999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.252,"5min":3.98,"15min":3.98},"last":0.93500000000000005}]},{"osd":3,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":0.98699999999999999,"15min":0.94099999999999995},"min":{"1min":0.79200000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":6.125,"5min":6.125,"15min":6.125},"last":1.1120000000000001},{"interface":"front","average":{"1min":0.96099999999999997,"5min":1.0900000000000001,"15min":1.1299999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.2070000000000001,"5min":3.9140000000000001,"15min":3.9140000000000001},"last":1.0449999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":1.0940000000000001,"15min":1.1799999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1970000000000001,"5min":5.1130000000000004,"15min":5.1130000000000004},"last":0.69599999999999995},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.0429999999999999,"15min":1.0349999999999999},"min":{"1min":0.67500000000000004,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":6.3520000000000003,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":0.998}]},{"osd":5,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.198,"15min":1.2889999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2889999999999999,"5min":5.1859999999999999,"15min":5.1859999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.125,"15min":1.159},"min":{"1min":0.73299999999999998,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.2949999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":0.97399999999999998}]},{"osd":6,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.099,"15min":1.1020000000000001},"min":{"1min":0.80800000000000005,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.349,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.2010000000000001,"15min":1.1930000000000001},"min":{"1min":0.88,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":6.1580000000000004,"5min":6.1580000000000004,"15min":6.1580000000000004},"last":0.83499999999999996}]}]},{"osd":6,"up_from":15,"seq":64424509485,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13804,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":13248,"kb_avail":94358036,"statfs":{"total":96636764160,"available":96622628864,"internally_reserved":0,"allocated":561152,"data_stored":241435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13565952},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.82899999999999996,"15min":0.81699999999999995},"min":{"1min":0.55800000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.111,"5min":1.504,"15min":1.504},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.89400000000000002,"15min":0.88300000000000001},"min":{"1min":0.69399999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1739999999999999,"5min":1.839,"15min":1.839},"last":1.03}]},{"osd":1,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.84799999999999998,"15min":0.83799999999999997},"min":{"1min":0.63600000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.117,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.88700000000000001,"15min":0.879},"min":{"1min":0.58899999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1479999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":1.1200000000000001}]},{"osd":2,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.89000000000000001,"15min":0.86499999999999999},"min":{"1min":0.745,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0940000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91700000000000004,"15min":0.92500000000000004},"min":{"1min":0.66300000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2250000000000001,"5min":1.546,"15min":1.546},"last":1.143}]},{"osd":3,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97999999999999998,"15min":0.98599999999999999},"min":{"1min":0.64700000000000002,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1719999999999999,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90800000000000003,"15min":0.90900000000000003},"min":{"1min":0.68999999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0580000000000001,"5min":2.121,"15min":2.121},"last":1.097}]},{"osd":4,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.999,"15min":1.0349999999999999},"min":{"1min":0.68500000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.147,"5min":1.95,"15min":1.95},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.056,"15min":1.0980000000000001},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.216,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.212}]},{"osd":5,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":1.004,"15min":1.03},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.153,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.008,"5min":1.0920000000000001,"15min":1.1240000000000001},"min":{"1min":0.68300000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.1879999999999999,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.0649999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.1060000000000001,"15min":1.1259999999999999},"min":{"1min":0.73299999999999998,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.234,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0820000000000001,"15min":1.1000000000000001},"min":{"1min":0.86199999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.194,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.1659999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509486,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14572,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":14016,"kb_avail":94357268,"statfs":{"total":96636764160,"available":96621842432,"internally_reserved":0,"allocated":561152,"data_stored":242529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14352384},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.81299999999999994,"15min":0.78300000000000003},"min":{"1min":0.57299999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1279999999999999,"5min":1.258,"15min":1.258},"last":1.2729999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.83999999999999997,"15min":0.82599999999999996},"min":{"1min":0.56000000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.1459999999999999,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.73999999999999999}]},{"osd":1,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.93000000000000005,"15min":0.93500000000000005},"min":{"1min":0.68200000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.175,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":1.002},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.879,"15min":0.85499999999999998},"min":{"1min":0.59999999999999998,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.276,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.86599999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.93000000000000005,"15min":0.91400000000000003},"min":{"1min":0.71399999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1040000000000001,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.171},{"interface":"front","average":{"1min":1.002,"5min":0.96799999999999997,"15min":0.94499999999999995},"min":{"1min":0.78100000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2190000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":1.0509999999999999}]},{"osd":3,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.88600000000000001,"15min":0.874},"min":{"1min":0.76000000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.129,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0609999999999999,"15min":1.071},"min":{"1min":0.85999999999999999,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.216,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":1.2509999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":1.026,"15min":1.0620000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2050000000000001,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.99299999999999999,"15min":1.0149999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.1499999999999999,"5min":1.635,"15min":1.635},"last":1.206}]},{"osd":6,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.1399999999999999,"15min":1.204},"min":{"1min":0.74299999999999999,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.2529999999999999,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.1539999999999999,"15min":1.1950000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.288,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":1.3640000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0680000000000001,"15min":1.0900000000000001},"min":{"1min":0.755,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.202,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.2070000000000001,"15min":1.2350000000000001},"min":{"1min":0.88700000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3180000000000001,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":1.3260000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14064,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":13504,"kb_avail":94357776,"statfs":{"total":96636764160,"available":96622362624,"internally_reserved":0,"allocated":565248,"data_stored":242347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13828096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.56499999999999995,"15min":0.52800000000000002},"min":{"1min":0.36599999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.86499999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.65800000000000003,"15min":0.61699999999999999},"min":{"1min":0.496,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.034,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.625}]},{"osd":1,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.67600000000000005,"15min":0.621},"min":{"1min":0.56699999999999995,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1639999999999999,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.63200000000000001,"15min":0.58999999999999997},"min":{"1min":0.47899999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.753}]},{"osd":3,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.67300000000000004,"15min":0.623},"min":{"1min":0.52900000000000003,"5min":0.224,"15min":0.224},"max":{"1min":1.0269999999999999,"5min":1.246,"15min":1.246},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.78200000000000003,"15min":0.72199999999999998},"min":{"1min":0.60599999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.85699999999999998}]},{"osd":4,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.878,"15min":0.84399999999999997},"min":{"1min":0.625,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.23,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.071,"5min":0.95499999999999996,"15min":0.91300000000000003},"min":{"1min":0.67000000000000004,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.347,"5min":1.399,"15min":1.399},"last":0.93700000000000006}]},{"osd":5,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.90800000000000003,"15min":0.86199999999999999},"min":{"1min":0.70999999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":1.325},{"interface":"front","average":{"1min":1.091,"5min":0.99099999999999999,"15min":0.93999999999999995},"min":{"1min":0.76200000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.2549999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.1950000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.93799999999999994,"15min":0.91300000000000003},"min":{"1min":0.82199999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.276},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.002,"15min":0.96399999999999997},"min":{"1min":0.68799999999999994,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3899999999999999,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.2290000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.054,"15min":1.004},"min":{"1min":0.72299999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4179999999999999,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.306},{"interface":"front","average":{"1min":1.111,"5min":0.99099999999999999,"15min":0.95699999999999996},"min":{"1min":0.77800000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.0940000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509485,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13872,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":13312,"kb_avail":94357968,"statfs":{"total":96636764160,"available":96622559232,"internally_reserved":0,"allocated":565248,"data_stored":242107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13631488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.57599999999999996,"15min":0.54500000000000004},"min":{"1min":0.51400000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.58299999999999996,"15min":0.50900000000000001},"min":{"1min":0.503,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.0309999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.51200000000000001}]},{"osd":2,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.59099999999999997,"15min":0.54700000000000004},"min":{"1min":0.55200000000000005,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.88,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.71799999999999997,"15min":0.66200000000000003},"min":{"1min":0.72699999999999998,"5min":0.312,"15min":0.312},"max":{"1min":1.1439999999999999,"5min":1.169,"15min":1.169},"last":0.68899999999999995}]},{"osd":3,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.68799999999999994,"15min":0.63100000000000001},"min":{"1min":0.59899999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.091,"5min":1.27,"15min":1.27},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.64300000000000002,"15min":0.57899999999999996},"min":{"1min":0.55600000000000005,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0549999999999999,"5min":1.27,"15min":1.27},"last":0.63200000000000001}]},{"osd":4,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.83399999999999996,"15min":0.79800000000000004},"min":{"1min":0.70399999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.143,"5min":1.202,"15min":1.202},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.0349999999999999,"5min":0.91800000000000004,"15min":0.88800000000000001},"min":{"1min":0.84899999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.93000000000000005}]},{"osd":5,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":0.91200000000000003,"15min":0.85799999999999998},"min":{"1min":0.72499999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.339,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.88900000000000001,"15min":0.84899999999999998},"min":{"1min":0.82499999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.284,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.85099999999999998}]},{"osd":6,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":0.96999999999999997,"15min":0.92200000000000004},"min":{"1min":0.96499999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2589999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.028,"5min":0.94099999999999995,"15min":0.89100000000000001},"min":{"1min":0.80400000000000005,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2270000000000001,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.879}]},{"osd":7,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":0.99099999999999999,"15min":0.93600000000000005},"min":{"1min":0.83399999999999996,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.95699999999999996,"15min":0.89900000000000002},"min":{"1min":0.85399999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3759999999999999,"5min":1.649,"15min":1.649},"last":0.90900000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542189,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23224,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":22656,"kb_avail":94348616,"statfs":{"total":96636764160,"available":96612982784,"internally_reserved":0,"allocated":573440,"data_stored":243533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23199744},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.60899999999999999,"15min":0.57099999999999995},"min":{"1min":0.318,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":1.2090000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.67100000000000004,"15min":0.64300000000000002},"min":{"1min":0.34999999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.198,"5min":1.236,"15min":1.236},"last":0.621}]},{"osd":1,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.65600000000000003,"15min":0.624},"min":{"1min":0.41999999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.95699999999999996,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.748},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.70099999999999996,"15min":0.66100000000000003},"min":{"1min":0.435,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.028,"5min":1.222,"15min":1.222},"last":0.93700000000000006}]},{"osd":2,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.751,"15min":0.70699999999999996},"min":{"1min":0.45900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0740000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.67600000000000005,"15min":0.626},"min":{"1min":0.33600000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.0780000000000001,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.997}]},{"osd":4,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.93300000000000005,"15min":0.91100000000000003},"min":{"1min":0.70399999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.411,"5min":1.496,"15min":1.496},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.0620000000000001,"5min":0.95899999999999996,"15min":0.93200000000000005},"min":{"1min":0.754,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":1.038}]},{"osd":5,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.90500000000000003,"15min":0.878},"min":{"1min":0.75,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.365,"5min":1.51,"15min":1.51},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.014,"15min":0.996},"min":{"1min":0.74099999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.075}]},{"osd":6,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.94699999999999995,"15min":0.92000000000000004},"min":{"1min":0.67200000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2450000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.024,"15min":0.98699999999999999},"min":{"1min":0.77600000000000002,"5min":0.625,"15min":0.625},"max":{"1min":1.323,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.272}]},{"osd":7,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.032,"15min":1.004},"min":{"1min":0.79100000000000004,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.4470000000000001,"5min":1.597,"15min":1.597},"last":1.127},{"interface":"front","average":{"1min":1.103,"5min":1.0489999999999999,"15min":1.0169999999999999},"min":{"1min":0.71799999999999997,"5min":0.623,"15min":0.623},"max":{"1min":1.377,"5min":1.708,"15min":1.708},"last":1.2450000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15272,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":14720,"kb_avail":94356568,"statfs":{"total":96636764160,"available":96621125632,"internally_reserved":0,"allocated":557056,"data_stored":241947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15073280},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.84299999999999997,"15min":0.82099999999999995},"min":{"1min":0.55900000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2230000000000001,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.85899999999999999,"15min":0.85299999999999998},"min":{"1min":0.65700000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1499999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.86899999999999999}]},{"osd":1,"last update":"Tue Oct 3 19:15:28 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.85299999999999998,"15min":0.83399999999999996},"min":{"1min":0.628,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.93000000000000005,"15min":0.92900000000000005},"min":{"1min":0.58699999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1799999999999999,"5min":1.514,"15min":1.514},"last":0.76300000000000001}]},{"osd":2,"last update":"Tue Oct 3 19:15:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.91400000000000003,"15min":0.90000000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3280000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.90600000000000003,"15min":0.89600000000000002},"min":{"1min":0.60999999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1599999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.84299999999999997}]},{"osd":3,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.92300000000000004,"15min":0.92500000000000004},"min":{"1min":0.68899999999999995,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.149,"5min":1.304,"15min":1.304},"last":1.075},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.038,"15min":1.0289999999999999},"min":{"1min":0.89500000000000002,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.2490000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.91700000000000004}]},{"osd":4,"last update":"Tue Oct 3 19:15:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97399999999999998,"15min":0.97199999999999998},"min":{"1min":0.66400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.999,"5min":1.0149999999999999,"15min":1.0369999999999999},"min":{"1min":0.72099999999999997,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.335,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.63400000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:15:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.01,"15min":1.038},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.266,"5min":1.462,"15min":1.462},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.133,"15min":1.1419999999999999},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":0.81100000000000005}]},{"osd":7,"last update":"Tue Oct 3 19:15:28 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.079},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.381,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.129,"5min":1.1459999999999999,"15min":1.1539999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.357,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.1519999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15404,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":14784,"kb_avail":94356436,"statfs":{"total":96636764160,"available":96620990464,"internally_reserved":0,"allocated":626688,"data_stored":831207,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":15138816},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.61399999999999999,"15min":0.57999999999999996},"min":{"1min":0.47499999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.92800000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73399999999999999,"15min":0.71199999999999997},"min":{"1min":0.54900000000000004,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0800000000000001,"5min":1.27,"15min":1.27},"last":0.72899999999999998}]},{"osd":2,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.72499999999999998,"15min":0.71399999999999997},"min":{"1min":0.49199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.131,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70199999999999996,"15min":0.68999999999999995},"min":{"1min":0.44500000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.98199999999999998,"5min":1.548,"15min":1.548},"last":0.46800000000000003}]},{"osd":3,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.78300000000000003,"15min":0.72399999999999998},"min":{"1min":0.65900000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.75900000000000001,"15min":0.69599999999999995},"min":{"1min":0.51200000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.51000000000000001}]},{"osd":4,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.91200000000000003,"15min":0.90600000000000003},"min":{"1min":0.71299999999999997,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1539999999999999,"5min":1.355,"15min":1.355},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.048,"5min":1.034,"15min":1.022},"min":{"1min":0.82499999999999996,"5min":0.504,"15min":0.504},"max":{"1min":1.3140000000000001,"5min":1.508,"15min":1.508},"last":0.95599999999999996}]},{"osd":5,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0569999999999999,"15min":1.0449999999999999},"min":{"1min":0.85599999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.087,"5min":0.997,"15min":0.97399999999999998},"min":{"1min":0.82599999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.371,"5min":1.444,"15min":1.444},"last":0.93000000000000005}]},{"osd":6,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.034,"15min":1.014},"min":{"1min":0.77600000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.427,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.099,"5min":1.018,"15min":0.99199999999999999},"min":{"1min":0.83899999999999997,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.79700000000000004}]},{"osd":7,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.0660000000000001,"15min":1.036},"min":{"1min":0.90200000000000002,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.3919999999999999,"5min":1.407,"15min":1.407},"last":0.878},{"interface":"front","average":{"1min":1.149,"5min":1.0780000000000001,"15min":1.0600000000000001},"min":{"1min":0.78500000000000003,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.76300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:15:56.766 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:15:56.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.891+0000 7f8104743640 1 Processor -- start 2023-10-03T19:15:56.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.895+0000 7f8104743640 1 -- start start 2023-10-03T19:15:56.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.895+0000 7f8104743640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f80fc14f240 0x7f80fc1528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:56.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.895+0000 7f8104743640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f80fc0c2790 0x7f80fc0c0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:56.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.895+0000 7f8104743640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f80fc0bb1d0 0x7f80fc0c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:56.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.895+0000 7f8104743640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80fc06b640 con 0x7f80fc0bb1d0 2023-10-03T19:15:56.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.895+0000 7f8104743640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80fc06b2d0 con 0x7f80fc14f240 2023-10-03T19:15:56.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.895+0000 7f8104743640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc0c0fa0 con 0x7f80fc0c2790 2023-10-03T19:15:56.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.895+0000 7f8102ce0640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f80fc0bb1d0 0x7f80fc0c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:56.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.895+0000 7f8102ce0640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f80fc0bb1d0 0x7f80fc0c12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48270/0 (socket says 172.21.15.45:48270) 2023-10-03T19:15:56.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.895+0000 7f8102ce0640 1 -- 172.21.15.45:0/2721622287 learned_addr learned my addr 172.21.15.45:0/2721622287 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:56.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.895+0000 7f8101cde640 1 --2- 172.21.15.45:0/2721622287 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f80fc0c2790 0x7f80fc0c0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:56.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.895+0000 7f81024df640 1 --2- 172.21.15.45:0/2721622287 >> v2:172.21.15.79:3300/0 conn(0x7f80fc14f240 0x7f80fc1528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:56.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.895+0000 7f8102ce0640 1 -- 172.21.15.45:0/2721622287 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f80fc0c2790 msgr2=0x7f80fc0c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:56.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.895+0000 7f8102ce0640 1 --2- 172.21.15.45:0/2721622287 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f80fc0c2790 0x7f80fc0c0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:56.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.895+0000 7f8102ce0640 1 -- 172.21.15.45:0/2721622287 >> v2:172.21.15.79:3300/0 conn(0x7f80fc14f240 msgr2=0x7f80fc1528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:56.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.895+0000 7f8102ce0640 1 --2- 172.21.15.45:0/2721622287 >> v2:172.21.15.79:3300/0 conn(0x7f80fc14f240 0x7f80fc1528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:56.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.895+0000 7f8102ce0640 1 -- 172.21.15.45:0/2721622287 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80fc0a3c60 con 0x7f80fc0bb1d0 2023-10-03T19:15:56.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f8102ce0640 1 --2- 172.21.15.45:0/2721622287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80fc0bb1d0 0x7f80fc0c12a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0c47f0 tx=0x7f80f401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ffad68b9a4d1185 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:56.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f81014dd640 1 -- 172.21.15.45:0/2721622287 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f40af400 con 0x7f80fc0bb1d0 2023-10-03T19:15:56.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f81014dd640 1 -- 172.21.15.45:0/2721622287 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f40ab050 con 0x7f80fc0bb1d0 2023-10-03T19:15:56.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f81014dd640 1 -- 172.21.15.45:0/2721622287 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f40af780 con 0x7f80fc0bb1d0 2023-10-03T19:15:56.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f8104743640 1 -- 172.21.15.45:0/2721622287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80fc0bb1d0 msgr2=0x7f80fc0c12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:56.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f8104743640 1 --2- 172.21.15.45:0/2721622287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80fc0bb1d0 0x7f80fc0c12a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0c47f0 tx=0x7f80f401f1c0 comp rx=0 tx=0).stop 2023-10-03T19:15:56.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f8104743640 1 -- 172.21.15.45:0/2721622287 shutdown_connections 2023-10-03T19:15:56.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f8104743640 1 --2- 172.21.15.45:0/2721622287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80fc0bb1d0 0x7f80fc0c12a0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:56.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f8104743640 1 --2- 172.21.15.45:0/2721622287 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f80fc0c2790 0x7f80fc0c0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:56.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f8104743640 1 --2- 172.21.15.45:0/2721622287 >> v2:172.21.15.79:3300/0 conn(0x7f80fc14f240 0x7f80fc1528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:56.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f8104743640 1 -- 172.21.15.45:0/2721622287 >> 172.21.15.45:0/2721622287 conn(0x7f80fc0a64a0 msgr2=0x7f80fc0a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:56.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f8104743640 1 -- 172.21.15.45:0/2721622287 shutdown_connections 2023-10-03T19:15:56.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f8104743640 1 -- 172.21.15.45:0/2721622287 wait complete. 2023-10-03T19:15:56.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f8104743640 1 Processor -- start 2023-10-03T19:15:56.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f8104743640 1 -- start start 2023-10-03T19:15:56.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f8104743640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80fc0bb1d0 0x7f80fc14c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:56.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f8104743640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80fc0c2790 0x7f80fc0c2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:56.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f8104743640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f80fc14f240 0x7f80fc1d9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:56.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f8104743640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc1d7ad0 con 0x7f80fc0bb1d0 2023-10-03T19:15:56.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f8104743640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc145bf0 con 0x7f80fc0c2790 2023-10-03T19:15:56.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f8104743640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc145e90 con 0x7f80fc14f240 2023-10-03T19:15:56.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f81024df640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80fc0bb1d0 0x7f80fc14c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:56.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f81024df640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80fc0bb1d0 0x7f80fc14c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48274/0 (socket says 172.21.15.45:48274) 2023-10-03T19:15:56.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f81024df640 1 -- 172.21.15.45:0/1659104941 learned_addr learned my addr 172.21.15.45:0/1659104941 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:56.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f8102ce0640 1 --2- 172.21.15.45:0/1659104941 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f80fc14f240 0x7f80fc1d9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:56.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f8101cde640 1 --2- 172.21.15.45:0/1659104941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80fc0c2790 0x7f80fc0c2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:56.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f81024df640 1 -- 172.21.15.45:0/1659104941 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f80fc14f240 msgr2=0x7f80fc1d9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:56.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f81024df640 1 --2- 172.21.15.45:0/1659104941 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f80fc14f240 0x7f80fc1d9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:56.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f81024df640 1 -- 172.21.15.45:0/1659104941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80fc0c2790 msgr2=0x7f80fc0c2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:56.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f81024df640 1 --2- 172.21.15.45:0/1659104941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80fc0c2790 0x7f80fc0c2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:56.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f81024df640 1 -- 172.21.15.45:0/1659104941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f4009b30 con 0x7f80fc0bb1d0 2023-10-03T19:15:56.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f81024df640 1 --2- 172.21.15.45:0/1659104941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80fc0bb1d0 0x7f80fc14c750 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f80f800d7d0 tx=0x7f80f800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:56.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f80f2ffd640 1 -- 172.21.15.45:0/1659104941 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f800b6c0 con 0x7f80fc0bb1d0 2023-10-03T19:15:56.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f80f2ffd640 1 -- 172.21.15.45:0/1659104941 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f800b820 con 0x7f80fc0bb1d0 2023-10-03T19:15:56.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f80f2ffd640 1 -- 172.21.15.45:0/1659104941 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f800bbd0 con 0x7f80fc0bb1d0 2023-10-03T19:15:56.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f8104743640 1 -- 172.21.15.45:0/1659104941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80fc0a3f40 con 0x7f80fc0bb1d0 2023-10-03T19:15:56.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.899+0000 7f8104743640 1 -- 172.21.15.45:0/1659104941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80fc14e740 con 0x7f80fc0bb1d0 2023-10-03T19:15:56.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.903+0000 7f8104743640 1 -- 172.21.15.45:0/1659104941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80fc14f610 con 0x7f80fc0bb1d0 2023-10-03T19:15:56.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.903+0000 7f80f2ffd640 1 -- 172.21.15.45:0/1659104941 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f80f800bd30 con 0x7f80fc0bb1d0 2023-10-03T19:15:56.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.903+0000 7f80f2ffd640 1 --2- 172.21.15.45:0/1659104941 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f80e00662b0 0x7f80e0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:56.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.903+0000 7f80f2ffd640 1 -- 172.21.15.45:0/1659104941 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f80f80841d0 con 0x7f80fc0bb1d0 2023-10-03T19:15:56.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.903+0000 7f8101cde640 1 --2- 172.21.15.45:0/1659104941 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f80e00662b0 0x7f80e0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:56.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.903+0000 7f8101cde640 1 --2- 172.21.15.45:0/1659104941 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f80e00662b0 0x7f80e0068760 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0ba340 tx=0x7f80ec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:56.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:56.907+0000 7f80f2ffd640 1 -- 172.21.15.45:0/1659104941 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f80f8051650 con 0x7f80fc0bb1d0 2023-10-03T19:15:57.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.059+0000 7f8104743640 1 -- 172.21.15.45:0/1659104941 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f80fc0bfa60 con 0x7f80e00662b0 2023-10-03T19:15:57.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.083+0000 7f80f2ffd640 1 -- 172.21.15.45:0/1659104941 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310219 (secure 0 0 0) 0x7f80fc0bfa60 con 0x7f80e00662b0 2023-10-03T19:15:57.089 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:15:57.092 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:15:57.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.087+0000 7f8104743640 1 -- 172.21.15.45:0/1659104941 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f80e00662b0 msgr2=0x7f80e0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:57.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.087+0000 7f8104743640 1 --2- 172.21.15.45:0/1659104941 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f80e00662b0 0x7f80e0068760 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0ba340 tx=0x7f80ec008040 comp rx=0 tx=0).stop 2023-10-03T19:15:57.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.087+0000 7f8104743640 1 -- 172.21.15.45:0/1659104941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80fc0bb1d0 msgr2=0x7f80fc14c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:57.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.087+0000 7f8104743640 1 --2- 172.21.15.45:0/1659104941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80fc0bb1d0 0x7f80fc14c750 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f80f800d7d0 tx=0x7f80f800dc90 comp rx=0 tx=0).stop 2023-10-03T19:15:57.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.087+0000 7f8104743640 1 -- 172.21.15.45:0/1659104941 shutdown_connections 2023-10-03T19:15:57.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.087+0000 7f8104743640 1 --2- 172.21.15.45:0/1659104941 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f80e00662b0 0x7f80e0068760 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:57.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.087+0000 7f8104743640 1 --2- 172.21.15.45:0/1659104941 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f80fc14f240 0x7f80fc1d9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:57.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.087+0000 7f8104743640 1 --2- 172.21.15.45:0/1659104941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80fc0c2790 0x7f80fc0c2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:57.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.087+0000 7f8104743640 1 --2- 172.21.15.45:0/1659104941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80fc0bb1d0 0x7f80fc14c750 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.087+0000 7f8104743640 1 -- 172.21.15.45:0/1659104941 >> 172.21.15.45:0/1659104941 conn(0x7f80fc0a64a0 msgr2=0x7f80fc14dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.087+0000 7f8104743640 1 -- 172.21.15.45:0/1659104941 shutdown_connections 2023-10-03T19:15:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.087+0000 7f8104743640 1 -- 172.21.15.45:0/1659104941 wait complete. 2023-10-03T19:15:57.109 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2023-10-03T19:15:56.517700+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":134516,"kb_used_data":4532,"kb_used_omap":0,"kb_used_meta":129920,"kb_avail":754840204,"statfs":{"total":773094113280,"available":772956368896,"internally_reserved":0,"allocated":4640768,"data_stored":3117544,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":133038080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003849"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.340966+0000","last_change":"2023-10-03T19:15:46.394210+0000","last_active":"2023-10-03T19:15:47.340966+0000","last_peered":"2023-10-03T19:15:47.340966+0000","last_clean":"2023-10-03T19:15:47.340966+0000","last_became_active":"2023-10-03T19:15:46.393845+0000","last_became_peered":"2023-10-03T19:15:46.393845+0000","last_unstale":"2023-10-03T19:15:47.340966+0000","last_undegraded":"2023-10-03T19:15:47.340966+0000","last_fullsized":"2023-10-03T19:15:47.340966+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:58:27.652930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159630+0000","last_change":"2023-10-03T19:15:46.398709+0000","last_active":"2023-10-03T19:15:48.159630+0000","last_peered":"2023-10-03T19:15:48.159630+0000","last_clean":"2023-10-03T19:15:48.159630+0000","last_became_active":"2023-10-03T19:15:46.397955+0000","last_became_peered":"2023-10-03T19:15:46.397955+0000","last_unstale":"2023-10-03T19:15:48.159630+0000","last_undegraded":"2023-10-03T19:15:48.159630+0000","last_fullsized":"2023-10-03T19:15:48.159630+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:04:13.574312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160021+0000","last_change":"2023-10-03T19:15:46.364679+0000","last_active":"2023-10-03T19:15:48.160021+0000","last_peered":"2023-10-03T19:15:48.160021+0000","last_clean":"2023-10-03T19:15:48.160021+0000","last_became_active":"2023-10-03T19:15:46.360555+0000","last_became_peered":"2023-10-03T19:15:46.360555+0000","last_unstale":"2023-10-03T19:15:48.160021+0000","last_undegraded":"2023-10-03T19:15:48.160021+0000","last_fullsized":"2023-10-03T19:15:48.160021+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:33:29.425810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159423+0000","last_change":"2023-10-03T19:15:46.379223+0000","last_active":"2023-10-03T19:15:48.159423+0000","last_peered":"2023-10-03T19:15:48.159423+0000","last_clean":"2023-10-03T19:15:48.159423+0000","last_became_active":"2023-10-03T19:15:46.378548+0000","last_became_peered":"2023-10-03T19:15:46.378548+0000","last_unstale":"2023-10-03T19:15:48.159423+0000","last_undegraded":"2023-10-03T19:15:48.159423+0000","last_fullsized":"2023-10-03T19:15:48.159423+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:50:28.636608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349017+0000","last_change":"2023-10-03T19:15:46.382245+0000","last_active":"2023-10-03T19:15:47.349017+0000","last_peered":"2023-10-03T19:15:47.349017+0000","last_clean":"2023-10-03T19:15:47.349017+0000","last_became_active":"2023-10-03T19:15:46.381558+0000","last_became_peered":"2023-10-03T19:15:46.381558+0000","last_unstale":"2023-10-03T19:15:47.349017+0000","last_undegraded":"2023-10-03T19:15:47.349017+0000","last_fullsized":"2023-10-03T19:15:47.349017+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:03:56.161089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.340274+0000","last_change":"2023-10-03T19:15:46.363085+0000","last_active":"2023-10-03T19:15:47.340274+0000","last_peered":"2023-10-03T19:15:47.340274+0000","last_clean":"2023-10-03T19:15:47.340274+0000","last_became_active":"2023-10-03T19:15:46.362532+0000","last_became_peered":"2023-10-03T19:15:46.362532+0000","last_unstale":"2023-10-03T19:15:47.340274+0000","last_undegraded":"2023-10-03T19:15:47.340274+0000","last_fullsized":"2023-10-03T19:15:47.340274+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:56:08.389510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158898+0000","last_change":"2023-10-03T19:15:46.364944+0000","last_active":"2023-10-03T19:15:48.158898+0000","last_peered":"2023-10-03T19:15:48.158898+0000","last_clean":"2023-10-03T19:15:48.158898+0000","last_became_active":"2023-10-03T19:15:46.364685+0000","last_became_peered":"2023-10-03T19:15:46.364685+0000","last_unstale":"2023-10-03T19:15:48.158898+0000","last_undegraded":"2023-10-03T19:15:48.158898+0000","last_fullsized":"2023-10-03T19:15:48.158898+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:39:43.145618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.156479+0000","last_change":"2023-10-03T19:15:46.353965+0000","last_active":"2023-10-03T19:15:48.156479+0000","last_peered":"2023-10-03T19:15:48.156479+0000","last_clean":"2023-10-03T19:15:48.156479+0000","last_became_active":"2023-10-03T19:15:46.353608+0000","last_became_peered":"2023-10-03T19:15:46.353608+0000","last_unstale":"2023-10-03T19:15:48.156479+0000","last_undegraded":"2023-10-03T19:15:48.156479+0000","last_fullsized":"2023-10-03T19:15:48.156479+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:21:29.369999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158164+0000","last_change":"2023-10-03T19:15:46.354277+0000","last_active":"2023-10-03T19:15:48.158164+0000","last_peered":"2023-10-03T19:15:48.158164+0000","last_clean":"2023-10-03T19:15:48.158164+0000","last_became_active":"2023-10-03T19:15:46.353658+0000","last_became_peered":"2023-10-03T19:15:46.353658+0000","last_unstale":"2023-10-03T19:15:48.158164+0000","last_undegraded":"2023-10-03T19:15:48.158164+0000","last_fullsized":"2023-10-03T19:15:48.158164+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:39:07.280049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.340998+0000","last_change":"2023-10-03T19:15:46.362303+0000","last_active":"2023-10-03T19:15:47.340998+0000","last_peered":"2023-10-03T19:15:47.340998+0000","last_clean":"2023-10-03T19:15:47.340998+0000","last_became_active":"2023-10-03T19:15:46.362001+0000","last_became_peered":"2023-10-03T19:15:46.362001+0000","last_unstale":"2023-10-03T19:15:47.340998+0000","last_undegraded":"2023-10-03T19:15:47.340998+0000","last_fullsized":"2023-10-03T19:15:47.340998+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:40:07.414352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.157870+0000","last_change":"2023-10-03T19:15:46.367695+0000","last_active":"2023-10-03T19:15:48.157870+0000","last_peered":"2023-10-03T19:15:48.157870+0000","last_clean":"2023-10-03T19:15:48.157870+0000","last_became_active":"2023-10-03T19:15:46.367450+0000","last_became_peered":"2023-10-03T19:15:46.367450+0000","last_unstale":"2023-10-03T19:15:48.157870+0000","last_undegraded":"2023-10-03T19:15:48.157870+0000","last_fullsized":"2023-10-03T19:15:48.157870+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:10:19.340333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.157796+0000","last_change":"2023-10-03T19:15:46.381309+0000","last_active":"2023-10-03T19:15:48.157796+0000","last_peered":"2023-10-03T19:15:48.157796+0000","last_clean":"2023-10-03T19:15:48.157796+0000","last_became_active":"2023-10-03T19:15:46.381054+0000","last_became_peered":"2023-10-03T19:15:46.381054+0000","last_unstale":"2023-10-03T19:15:48.157796+0000","last_undegraded":"2023-10-03T19:15:48.157796+0000","last_fullsized":"2023-10-03T19:15:48.157796+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:32:45.858483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.340342+0000","last_change":"2023-10-03T19:15:46.365193+0000","last_active":"2023-10-03T19:15:47.340342+0000","last_peered":"2023-10-03T19:15:47.340342+0000","last_clean":"2023-10-03T19:15:47.340342+0000","last_became_active":"2023-10-03T19:15:46.364040+0000","last_became_peered":"2023-10-03T19:15:46.364040+0000","last_unstale":"2023-10-03T19:15:47.340342+0000","last_undegraded":"2023-10-03T19:15:47.340342+0000","last_fullsized":"2023-10-03T19:15:47.340342+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:14:33.244198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159667+0000","last_change":"2023-10-03T19:15:46.364760+0000","last_active":"2023-10-03T19:15:48.159667+0000","last_peered":"2023-10-03T19:15:48.159667+0000","last_clean":"2023-10-03T19:15:48.159667+0000","last_became_active":"2023-10-03T19:15:46.360362+0000","last_became_peered":"2023-10-03T19:15:46.360362+0000","last_unstale":"2023-10-03T19:15:48.159667+0000","last_undegraded":"2023-10-03T19:15:48.159667+0000","last_fullsized":"2023-10-03T19:15:48.159667+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:25:27.749340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158876+0000","last_change":"2023-10-03T19:15:46.379695+0000","last_active":"2023-10-03T19:15:48.158876+0000","last_peered":"2023-10-03T19:15:48.158876+0000","last_clean":"2023-10-03T19:15:48.158876+0000","last_became_active":"2023-10-03T19:15:46.378968+0000","last_became_peered":"2023-10-03T19:15:46.378968+0000","last_unstale":"2023-10-03T19:15:48.158876+0000","last_undegraded":"2023-10-03T19:15:48.158876+0000","last_fullsized":"2023-10-03T19:15:48.158876+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:10:26.661897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.340046+0000","last_change":"2023-10-03T19:15:46.362453+0000","last_active":"2023-10-03T19:15:47.340046+0000","last_peered":"2023-10-03T19:15:47.340046+0000","last_clean":"2023-10-03T19:15:47.340046+0000","last_became_active":"2023-10-03T19:15:46.361895+0000","last_became_peered":"2023-10-03T19:15:46.361895+0000","last_unstale":"2023-10-03T19:15:47.340046+0000","last_undegraded":"2023-10-03T19:15:47.340046+0000","last_fullsized":"2023-10-03T19:15:47.340046+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:37:50.054950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160719+0000","last_change":"2023-10-03T19:15:46.400243+0000","last_active":"2023-10-03T19:15:48.160719+0000","last_peered":"2023-10-03T19:15:48.160719+0000","last_clean":"2023-10-03T19:15:48.160719+0000","last_became_active":"2023-10-03T19:15:46.399983+0000","last_became_peered":"2023-10-03T19:15:46.399983+0000","last_unstale":"2023-10-03T19:15:48.160719+0000","last_undegraded":"2023-10-03T19:15:48.160719+0000","last_fullsized":"2023-10-03T19:15:48.160719+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:53:20.933525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159755+0000","last_change":"2023-10-03T19:15:46.399010+0000","last_active":"2023-10-03T19:15:48.159755+0000","last_peered":"2023-10-03T19:15:48.159755+0000","last_clean":"2023-10-03T19:15:48.159755+0000","last_became_active":"2023-10-03T19:15:46.397599+0000","last_became_peered":"2023-10-03T19:15:46.397599+0000","last_unstale":"2023-10-03T19:15:48.159755+0000","last_undegraded":"2023-10-03T19:15:48.159755+0000","last_fullsized":"2023-10-03T19:15:48.159755+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:39:30.227606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160430+0000","last_change":"2023-10-03T19:15:46.377306+0000","last_active":"2023-10-03T19:15:48.160430+0000","last_peered":"2023-10-03T19:15:48.160430+0000","last_clean":"2023-10-03T19:15:48.160430+0000","last_became_active":"2023-10-03T19:15:46.377041+0000","last_became_peered":"2023-10-03T19:15:46.377041+0000","last_unstale":"2023-10-03T19:15:48.160430+0000","last_undegraded":"2023-10-03T19:15:48.160430+0000","last_fullsized":"2023-10-03T19:15:48.160430+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:26:46.602249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.930331+0000","last_change":"2023-10-03T19:15:46.388939+0000","last_active":"2023-10-03T19:15:47.930331+0000","last_peered":"2023-10-03T19:15:47.930331+0000","last_clean":"2023-10-03T19:15:47.930331+0000","last_became_active":"2023-10-03T19:15:46.388201+0000","last_became_peered":"2023-10-03T19:15:46.388201+0000","last_unstale":"2023-10-03T19:15:47.930331+0000","last_undegraded":"2023-10-03T19:15:47.930331+0000","last_fullsized":"2023-10-03T19:15:47.930331+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:50:16.014010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.930114+0000","last_change":"2023-10-03T19:15:46.393014+0000","last_active":"2023-10-03T19:15:47.930114+0000","last_peered":"2023-10-03T19:15:47.930114+0000","last_clean":"2023-10-03T19:15:47.930114+0000","last_became_active":"2023-10-03T19:15:46.392401+0000","last_became_peered":"2023-10-03T19:15:46.392401+0000","last_unstale":"2023-10-03T19:15:47.930114+0000","last_undegraded":"2023-10-03T19:15:47.930114+0000","last_fullsized":"2023-10-03T19:15:47.930114+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:32:59.029909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.156041+0000","last_change":"2023-10-03T19:15:46.350727+0000","last_active":"2023-10-03T19:15:48.156041+0000","last_peered":"2023-10-03T19:15:48.156041+0000","last_clean":"2023-10-03T19:15:48.156041+0000","last_became_active":"2023-10-03T19:15:46.350403+0000","last_became_peered":"2023-10-03T19:15:46.350403+0000","last_unstale":"2023-10-03T19:15:48.156041+0000","last_undegraded":"2023-10-03T19:15:48.156041+0000","last_fullsized":"2023-10-03T19:15:48.156041+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:43:56.113409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.157139+0000","last_change":"2023-10-03T19:15:46.378934+0000","last_active":"2023-10-03T19:15:48.157139+0000","last_peered":"2023-10-03T19:15:48.157139+0000","last_clean":"2023-10-03T19:15:48.157139+0000","last_became_active":"2023-10-03T19:15:46.378611+0000","last_became_peered":"2023-10-03T19:15:46.378611+0000","last_unstale":"2023-10-03T19:15:48.157139+0000","last_undegraded":"2023-10-03T19:15:48.157139+0000","last_fullsized":"2023-10-03T19:15:48.157139+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:51:41.830735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158761+0000","last_change":"2023-10-03T19:15:46.360949+0000","last_active":"2023-10-03T19:15:48.158761+0000","last_peered":"2023-10-03T19:15:48.158761+0000","last_clean":"2023-10-03T19:15:48.158761+0000","last_became_active":"2023-10-03T19:15:46.360658+0000","last_became_peered":"2023-10-03T19:15:46.360658+0000","last_unstale":"2023-10-03T19:15:48.158761+0000","last_undegraded":"2023-10-03T19:15:48.158761+0000","last_fullsized":"2023-10-03T19:15:48.158761+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:03:34.243331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160900+0000","last_change":"2023-10-03T19:15:46.368683+0000","last_active":"2023-10-03T19:15:48.160900+0000","last_peered":"2023-10-03T19:15:48.160900+0000","last_clean":"2023-10-03T19:15:48.160900+0000","last_became_active":"2023-10-03T19:15:46.368390+0000","last_became_peered":"2023-10-03T19:15:46.368390+0000","last_unstale":"2023-10-03T19:15:48.160900+0000","last_undegraded":"2023-10-03T19:15:48.160900+0000","last_fullsized":"2023-10-03T19:15:48.160900+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:03:04.832859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.157568+0000","last_change":"2023-10-03T19:15:46.361848+0000","last_active":"2023-10-03T19:15:48.157568+0000","last_peered":"2023-10-03T19:15:48.157568+0000","last_clean":"2023-10-03T19:15:48.157568+0000","last_became_active":"2023-10-03T19:15:46.361456+0000","last_became_peered":"2023-10-03T19:15:46.361456+0000","last_unstale":"2023-10-03T19:15:48.157568+0000","last_undegraded":"2023-10-03T19:15:48.157568+0000","last_fullsized":"2023-10-03T19:15:48.157568+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:54:18.477951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.340738+0000","last_change":"2023-10-03T19:15:46.353768+0000","last_active":"2023-10-03T19:15:47.340738+0000","last_peered":"2023-10-03T19:15:47.340738+0000","last_clean":"2023-10-03T19:15:47.340738+0000","last_became_active":"2023-10-03T19:15:46.353516+0000","last_became_peered":"2023-10-03T19:15:46.353516+0000","last_unstale":"2023-10-03T19:15:47.340738+0000","last_undegraded":"2023-10-03T19:15:47.340738+0000","last_fullsized":"2023-10-03T19:15:47.340738+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:43:56.113409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.930360+0000","last_change":"2023-10-03T19:15:46.375987+0000","last_active":"2023-10-03T19:15:47.930360+0000","last_peered":"2023-10-03T19:15:47.930360+0000","last_clean":"2023-10-03T19:15:47.930360+0000","last_became_active":"2023-10-03T19:15:46.375284+0000","last_became_peered":"2023-10-03T19:15:46.375284+0000","last_unstale":"2023-10-03T19:15:47.930360+0000","last_undegraded":"2023-10-03T19:15:47.930360+0000","last_fullsized":"2023-10-03T19:15:47.930360+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:20:33.840630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159751+0000","last_change":"2023-10-03T19:15:46.374991+0000","last_active":"2023-10-03T19:15:48.159751+0000","last_peered":"2023-10-03T19:15:48.159751+0000","last_clean":"2023-10-03T19:15:48.159751+0000","last_became_active":"2023-10-03T19:15:46.374699+0000","last_became_peered":"2023-10-03T19:15:46.374699+0000","last_unstale":"2023-10-03T19:15:48.159751+0000","last_undegraded":"2023-10-03T19:15:48.159751+0000","last_fullsized":"2023-10-03T19:15:48.159751+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:38:41.035694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159057+0000","last_change":"2023-10-03T19:15:46.380983+0000","last_active":"2023-10-03T19:15:48.159057+0000","last_peered":"2023-10-03T19:15:48.159057+0000","last_clean":"2023-10-03T19:15:48.159057+0000","last_became_active":"2023-10-03T19:15:46.380216+0000","last_became_peered":"2023-10-03T19:15:46.380216+0000","last_unstale":"2023-10-03T19:15:48.159057+0000","last_undegraded":"2023-10-03T19:15:48.159057+0000","last_fullsized":"2023-10-03T19:15:48.159057+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:49:49.641490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159168+0000","last_change":"2023-10-03T19:15:46.361191+0000","last_active":"2023-10-03T19:15:48.159168+0000","last_peered":"2023-10-03T19:15:48.159168+0000","last_clean":"2023-10-03T19:15:48.159168+0000","last_became_active":"2023-10-03T19:15:46.360817+0000","last_became_peered":"2023-10-03T19:15:46.360817+0000","last_unstale":"2023-10-03T19:15:48.159168+0000","last_undegraded":"2023-10-03T19:15:48.159168+0000","last_fullsized":"2023-10-03T19:15:48.159168+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:09:39.321340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.348033+0000","last_change":"2023-10-03T19:15:46.399112+0000","last_active":"2023-10-03T19:15:47.348033+0000","last_peered":"2023-10-03T19:15:47.348033+0000","last_clean":"2023-10-03T19:15:47.348033+0000","last_became_active":"2023-10-03T19:15:46.398515+0000","last_became_peered":"2023-10-03T19:15:46.398515+0000","last_unstale":"2023-10-03T19:15:47.348033+0000","last_undegraded":"2023-10-03T19:15:47.348033+0000","last_fullsized":"2023-10-03T19:15:47.348033+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:34:48.331811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158508+0000","last_change":"2023-10-03T19:15:46.403169+0000","last_active":"2023-10-03T19:15:48.158508+0000","last_peered":"2023-10-03T19:15:48.158508+0000","last_clean":"2023-10-03T19:15:48.158508+0000","last_became_active":"2023-10-03T19:15:46.402567+0000","last_became_peered":"2023-10-03T19:15:46.402567+0000","last_unstale":"2023-10-03T19:15:48.158508+0000","last_undegraded":"2023-10-03T19:15:48.158508+0000","last_fullsized":"2023-10-03T19:15:48.158508+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:26:28.165599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"47'4","reported_seq":17,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.930802+0000","last_change":"2023-10-03T19:15:45.859549+0000","last_active":"2023-10-03T19:15:47.930802+0000","last_peered":"2023-10-03T19:15:47.930802+0000","last_clean":"2023-10-03T19:15:47.930802+0000","last_became_active":"2023-10-03T19:15:45.859068+0000","last_became_peered":"2023-10-03T19:15:45.859068+0000","last_unstale":"2023-10-03T19:15:47.930802+0000","last_undegraded":"2023-10-03T19:15:47.930802+0000","last_fullsized":"2023-10-03T19:15:47.930802+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:56:16.032646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.348456+0000","last_change":"2023-10-03T19:15:46.398012+0000","last_active":"2023-10-03T19:15:47.348456+0000","last_peered":"2023-10-03T19:15:47.348456+0000","last_clean":"2023-10-03T19:15:47.348456+0000","last_became_active":"2023-10-03T19:15:46.396826+0000","last_became_peered":"2023-10-03T19:15:46.396826+0000","last_unstale":"2023-10-03T19:15:47.348456+0000","last_undegraded":"2023-10-03T19:15:47.348456+0000","last_fullsized":"2023-10-03T19:15:47.348456+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:01:43.218107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.341091+0000","last_change":"2023-10-03T19:15:45.849183+0000","last_active":"2023-10-03T19:15:47.341091+0000","last_peered":"2023-10-03T19:15:47.341091+0000","last_clean":"2023-10-03T19:15:47.341091+0000","last_became_active":"2023-10-03T19:15:45.848159+0000","last_became_peered":"2023-10-03T19:15:45.848159+0000","last_unstale":"2023-10-03T19:15:47.341091+0000","last_undegraded":"2023-10-03T19:15:47.341091+0000","last_fullsized":"2023-10-03T19:15:47.341091+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:43:36.658709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.930000+0000","last_change":"2023-10-03T19:15:46.393166+0000","last_active":"2023-10-03T19:15:47.930000+0000","last_peered":"2023-10-03T19:15:47.930000+0000","last_clean":"2023-10-03T19:15:47.930000+0000","last_became_active":"2023-10-03T19:15:46.392621+0000","last_became_peered":"2023-10-03T19:15:46.392621+0000","last_unstale":"2023-10-03T19:15:47.930000+0000","last_undegraded":"2023-10-03T19:15:47.930000+0000","last_fullsized":"2023-10-03T19:15:47.930000+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:53:34.113893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.340830+0000","last_change":"2023-10-03T19:15:45.856473+0000","last_active":"2023-10-03T19:15:47.340830+0000","last_peered":"2023-10-03T19:15:47.340830+0000","last_clean":"2023-10-03T19:15:47.340830+0000","last_became_active":"2023-10-03T19:15:45.856139+0000","last_became_peered":"2023-10-03T19:15:45.856139+0000","last_unstale":"2023-10-03T19:15:47.340830+0000","last_undegraded":"2023-10-03T19:15:47.340830+0000","last_fullsized":"2023-10-03T19:15:47.340830+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:27:43.264995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.156020+0000","last_change":"2023-10-03T19:15:46.358821+0000","last_active":"2023-10-03T19:15:48.156020+0000","last_peered":"2023-10-03T19:15:48.156020+0000","last_clean":"2023-10-03T19:15:48.156020+0000","last_became_active":"2023-10-03T19:15:46.358556+0000","last_became_peered":"2023-10-03T19:15:46.358556+0000","last_unstale":"2023-10-03T19:15:48.156020+0000","last_undegraded":"2023-10-03T19:15:48.156020+0000","last_fullsized":"2023-10-03T19:15:48.156020+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:51:25.080660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349975+0000","last_change":"2023-10-03T19:15:45.853261+0000","last_active":"2023-10-03T19:15:47.349975+0000","last_peered":"2023-10-03T19:15:47.349975+0000","last_clean":"2023-10-03T19:15:47.349975+0000","last_became_active":"2023-10-03T19:15:45.852517+0000","last_became_peered":"2023-10-03T19:15:45.852517+0000","last_unstale":"2023-10-03T19:15:47.349975+0000","last_undegraded":"2023-10-03T19:15:47.349975+0000","last_fullsized":"2023-10-03T19:15:47.349975+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:44:19.861675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349125+0000","last_change":"2023-10-03T19:15:46.378648+0000","last_active":"2023-10-03T19:15:47.349125+0000","last_peered":"2023-10-03T19:15:47.349125+0000","last_clean":"2023-10-03T19:15:47.349125+0000","last_became_active":"2023-10-03T19:15:46.377900+0000","last_became_peered":"2023-10-03T19:15:46.377900+0000","last_unstale":"2023-10-03T19:15:47.349125+0000","last_undegraded":"2023-10-03T19:15:47.349125+0000","last_fullsized":"2023-10-03T19:15:47.349125+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:51:25.080660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159827+0000","last_change":"2023-10-03T19:15:45.842290+0000","last_active":"2023-10-03T19:15:48.159827+0000","last_peered":"2023-10-03T19:15:48.159827+0000","last_clean":"2023-10-03T19:15:48.159827+0000","last_became_active":"2023-10-03T19:15:45.841848+0000","last_became_peered":"2023-10-03T19:15:45.841848+0000","last_unstale":"2023-10-03T19:15:48.159827+0000","last_undegraded":"2023-10-03T19:15:48.159827+0000","last_fullsized":"2023-10-03T19:15:48.159827+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:14:42.878422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159307+0000","last_change":"2023-10-03T19:15:46.385410+0000","last_active":"2023-10-03T19:15:48.159307+0000","last_peered":"2023-10-03T19:15:48.159307+0000","last_clean":"2023-10-03T19:15:48.159307+0000","last_became_active":"2023-10-03T19:15:46.381382+0000","last_became_peered":"2023-10-03T19:15:46.381382+0000","last_unstale":"2023-10-03T19:15:48.159307+0000","last_undegraded":"2023-10-03T19:15:48.159307+0000","last_fullsized":"2023-10-03T19:15:48.159307+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:09:40.009947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349310+0000","last_change":"2023-10-03T19:15:45.861708+0000","last_active":"2023-10-03T19:15:47.349310+0000","last_peered":"2023-10-03T19:15:47.349310+0000","last_clean":"2023-10-03T19:15:47.349310+0000","last_became_active":"2023-10-03T19:15:45.861138+0000","last_became_peered":"2023-10-03T19:15:45.861138+0000","last_unstale":"2023-10-03T19:15:47.349310+0000","last_undegraded":"2023-10-03T19:15:47.349310+0000","last_fullsized":"2023-10-03T19:15:47.349310+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:00:34.659474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158173+0000","last_change":"2023-10-03T19:15:46.358217+0000","last_active":"2023-10-03T19:15:48.158173+0000","last_peered":"2023-10-03T19:15:48.158173+0000","last_clean":"2023-10-03T19:15:48.158173+0000","last_became_active":"2023-10-03T19:15:46.357887+0000","last_became_peered":"2023-10-03T19:15:46.357887+0000","last_unstale":"2023-10-03T19:15:48.158173+0000","last_undegraded":"2023-10-03T19:15:48.158173+0000","last_fullsized":"2023-10-03T19:15:48.158173+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:03:39.727170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.930613+0000","last_change":"2023-10-03T19:15:45.854212+0000","last_active":"2023-10-03T19:15:47.930613+0000","last_peered":"2023-10-03T19:15:47.930613+0000","last_clean":"2023-10-03T19:15:47.930613+0000","last_became_active":"2023-10-03T19:15:45.851309+0000","last_became_peered":"2023-10-03T19:15:45.851309+0000","last_unstale":"2023-10-03T19:15:47.930613+0000","last_undegraded":"2023-10-03T19:15:47.930613+0000","last_fullsized":"2023-10-03T19:15:47.930613+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:33:04.393302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159796+0000","last_change":"2023-10-03T19:15:46.379625+0000","last_active":"2023-10-03T19:15:48.159796+0000","last_peered":"2023-10-03T19:15:48.159796+0000","last_clean":"2023-10-03T19:15:48.159796+0000","last_became_active":"2023-10-03T19:15:46.378821+0000","last_became_peered":"2023-10-03T19:15:46.378821+0000","last_unstale":"2023-10-03T19:15:48.159796+0000","last_undegraded":"2023-10-03T19:15:48.159796+0000","last_fullsized":"2023-10-03T19:15:48.159796+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:38:47.883311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158940+0000","last_change":"2023-10-03T19:15:45.858316+0000","last_active":"2023-10-03T19:15:48.158940+0000","last_peered":"2023-10-03T19:15:48.158940+0000","last_clean":"2023-10-03T19:15:48.158940+0000","last_became_active":"2023-10-03T19:15:45.857799+0000","last_became_peered":"2023-10-03T19:15:45.857799+0000","last_unstale":"2023-10-03T19:15:48.158940+0000","last_undegraded":"2023-10-03T19:15:48.158940+0000","last_fullsized":"2023-10-03T19:15:48.158940+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:53:16.171067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.347705+0000","last_change":"2023-10-03T19:15:46.364379+0000","last_active":"2023-10-03T19:15:47.347705+0000","last_peered":"2023-10-03T19:15:47.347705+0000","last_clean":"2023-10-03T19:15:47.347705+0000","last_became_active":"2023-10-03T19:15:46.363462+0000","last_became_peered":"2023-10-03T19:15:46.363462+0000","last_unstale":"2023-10-03T19:15:47.347705+0000","last_undegraded":"2023-10-03T19:15:47.347705+0000","last_fullsized":"2023-10-03T19:15:47.347705+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:56:08.389510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159572+0000","last_change":"2023-10-03T19:15:45.859177+0000","last_active":"2023-10-03T19:15:48.159572+0000","last_peered":"2023-10-03T19:15:48.159572+0000","last_clean":"2023-10-03T19:15:48.159572+0000","last_became_active":"2023-10-03T19:15:45.857999+0000","last_became_peered":"2023-10-03T19:15:45.857999+0000","last_unstale":"2023-10-03T19:15:48.159572+0000","last_undegraded":"2023-10-03T19:15:48.159572+0000","last_fullsized":"2023-10-03T19:15:48.159572+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:22:08.131191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.348113+0000","last_change":"2023-10-03T19:15:46.397614+0000","last_active":"2023-10-03T19:15:47.348113+0000","last_peered":"2023-10-03T19:15:47.348113+0000","last_clean":"2023-10-03T19:15:47.348113+0000","last_became_active":"2023-10-03T19:15:46.396040+0000","last_became_peered":"2023-10-03T19:15:46.396040+0000","last_unstale":"2023-10-03T19:15:47.348113+0000","last_undegraded":"2023-10-03T19:15:47.348113+0000","last_fullsized":"2023-10-03T19:15:47.348113+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:37:55.351113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.348649+0000","last_change":"2023-10-03T19:15:45.847050+0000","last_active":"2023-10-03T19:15:47.348649+0000","last_peered":"2023-10-03T19:15:47.348649+0000","last_clean":"2023-10-03T19:15:47.348649+0000","last_became_active":"2023-10-03T19:15:45.846253+0000","last_became_peered":"2023-10-03T19:15:45.846253+0000","last_unstale":"2023-10-03T19:15:47.348649+0000","last_undegraded":"2023-10-03T19:15:47.348649+0000","last_fullsized":"2023-10-03T19:15:47.348649+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:26:38.550548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159843+0000","last_change":"2023-10-03T19:15:46.375450+0000","last_active":"2023-10-03T19:15:48.159843+0000","last_peered":"2023-10-03T19:15:48.159843+0000","last_clean":"2023-10-03T19:15:48.159843+0000","last_became_active":"2023-10-03T19:15:46.375071+0000","last_became_peered":"2023-10-03T19:15:46.375071+0000","last_unstale":"2023-10-03T19:15:48.159843+0000","last_undegraded":"2023-10-03T19:15:48.159843+0000","last_fullsized":"2023-10-03T19:15:48.159843+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:54:49.165838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"47'3","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159474+0000","last_change":"2023-10-03T19:15:45.860953+0000","last_active":"2023-10-03T19:15:48.159474+0000","last_peered":"2023-10-03T19:15:48.159474+0000","last_clean":"2023-10-03T19:15:48.159474+0000","last_became_active":"2023-10-03T19:15:45.859256+0000","last_became_peered":"2023-10-03T19:15:45.859256+0000","last_unstale":"2023-10-03T19:15:48.159474+0000","last_undegraded":"2023-10-03T19:15:48.159474+0000","last_fullsized":"2023-10-03T19:15:48.159474+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:28:48.656360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349230+0000","last_change":"2023-10-03T19:15:46.365297+0000","last_active":"2023-10-03T19:15:47.349230+0000","last_peered":"2023-10-03T19:15:47.349230+0000","last_clean":"2023-10-03T19:15:47.349230+0000","last_became_active":"2023-10-03T19:15:46.363978+0000","last_became_peered":"2023-10-03T19:15:46.363978+0000","last_unstale":"2023-10-03T19:15:47.349230+0000","last_undegraded":"2023-10-03T19:15:47.349230+0000","last_fullsized":"2023-10-03T19:15:47.349230+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:43:56.113409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"47'6","reported_seq":19,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158080+0000","last_change":"2023-10-03T19:15:45.845291+0000","last_active":"2023-10-03T19:15:48.158080+0000","last_peered":"2023-10-03T19:15:48.158080+0000","last_clean":"2023-10-03T19:15:48.158080+0000","last_became_active":"2023-10-03T19:15:45.845024+0000","last_became_peered":"2023-10-03T19:15:45.845024+0000","last_unstale":"2023-10-03T19:15:48.158080+0000","last_undegraded":"2023-10-03T19:15:48.158080+0000","last_fullsized":"2023-10-03T19:15:48.158080+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:59:14.940033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349625+0000","last_change":"2023-10-03T19:15:46.397165+0000","last_active":"2023-10-03T19:15:47.349625+0000","last_peered":"2023-10-03T19:15:47.349625+0000","last_clean":"2023-10-03T19:15:47.349625+0000","last_became_active":"2023-10-03T19:15:46.396350+0000","last_became_peered":"2023-10-03T19:15:46.396350+0000","last_unstale":"2023-10-03T19:15:47.349625+0000","last_undegraded":"2023-10-03T19:15:47.349625+0000","last_fullsized":"2023-10-03T19:15:47.349625+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:51:27.685465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160115+0000","last_change":"2023-10-03T19:15:45.855724+0000","last_active":"2023-10-03T19:15:48.160115+0000","last_peered":"2023-10-03T19:15:48.160115+0000","last_clean":"2023-10-03T19:15:48.160115+0000","last_became_active":"2023-10-03T19:15:45.855158+0000","last_became_peered":"2023-10-03T19:15:45.855158+0000","last_unstale":"2023-10-03T19:15:48.160115+0000","last_undegraded":"2023-10-03T19:15:48.160115+0000","last_fullsized":"2023-10-03T19:15:48.160115+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:35:35.283953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160510+0000","last_change":"2023-10-03T19:15:46.368523+0000","last_active":"2023-10-03T19:15:48.160510+0000","last_peered":"2023-10-03T19:15:48.160510+0000","last_clean":"2023-10-03T19:15:48.160510+0000","last_became_active":"2023-10-03T19:15:46.368208+0000","last_became_peered":"2023-10-03T19:15:46.368208+0000","last_unstale":"2023-10-03T19:15:48.160510+0000","last_undegraded":"2023-10-03T19:15:48.160510+0000","last_fullsized":"2023-10-03T19:15:48.160510+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:02:17.268261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.930506+0000","last_change":"2023-10-03T19:15:45.860845+0000","last_active":"2023-10-03T19:15:47.930506+0000","last_peered":"2023-10-03T19:15:47.930506+0000","last_clean":"2023-10-03T19:15:47.930506+0000","last_became_active":"2023-10-03T19:15:45.860209+0000","last_became_peered":"2023-10-03T19:15:45.860209+0000","last_unstale":"2023-10-03T19:15:47.930506+0000","last_undegraded":"2023-10-03T19:15:47.930506+0000","last_fullsized":"2023-10-03T19:15:47.930506+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:11:54.664420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.157923+0000","last_change":"2023-10-03T19:15:46.377798+0000","last_active":"2023-10-03T19:15:48.157923+0000","last_peered":"2023-10-03T19:15:48.157923+0000","last_clean":"2023-10-03T19:15:48.157923+0000","last_became_active":"2023-10-03T19:15:46.377474+0000","last_became_peered":"2023-10-03T19:15:46.377474+0000","last_unstale":"2023-10-03T19:15:48.157923+0000","last_undegraded":"2023-10-03T19:15:48.157923+0000","last_fullsized":"2023-10-03T19:15:48.157923+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:03:54.226187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159103+0000","last_change":"2023-10-03T19:15:45.861050+0000","last_active":"2023-10-03T19:15:48.159103+0000","last_peered":"2023-10-03T19:15:48.159103+0000","last_clean":"2023-10-03T19:15:48.159103+0000","last_became_active":"2023-10-03T19:15:45.860266+0000","last_became_peered":"2023-10-03T19:15:45.860266+0000","last_unstale":"2023-10-03T19:15:48.159103+0000","last_undegraded":"2023-10-03T19:15:48.159103+0000","last_fullsized":"2023-10-03T19:15:48.159103+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:28:17.998844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160867+0000","last_change":"2023-10-03T19:15:46.394299+0000","last_active":"2023-10-03T19:15:48.160867+0000","last_peered":"2023-10-03T19:15:48.160867+0000","last_clean":"2023-10-03T19:15:48.160867+0000","last_became_active":"2023-10-03T19:15:46.394004+0000","last_became_peered":"2023-10-03T19:15:46.394004+0000","last_unstale":"2023-10-03T19:15:48.160867+0000","last_undegraded":"2023-10-03T19:15:48.160867+0000","last_fullsized":"2023-10-03T19:15:48.160867+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:18:54.415024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"47'8","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.157163+0000","last_change":"2023-10-03T19:15:45.848662+0000","last_active":"2023-10-03T19:15:48.157163+0000","last_peered":"2023-10-03T19:15:48.157163+0000","last_clean":"2023-10-03T19:15:48.157163+0000","last_became_active":"2023-10-03T19:15:45.848008+0000","last_became_peered":"2023-10-03T19:15:45.848008+0000","last_unstale":"2023-10-03T19:15:48.157163+0000","last_undegraded":"2023-10-03T19:15:48.157163+0000","last_fullsized":"2023-10-03T19:15:48.157163+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:43:36.658709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.156840+0000","last_change":"2023-10-03T19:15:46.399152+0000","last_active":"2023-10-03T19:15:48.156840+0000","last_peered":"2023-10-03T19:15:48.156840+0000","last_clean":"2023-10-03T19:15:48.156840+0000","last_became_active":"2023-10-03T19:15:46.398935+0000","last_became_peered":"2023-10-03T19:15:46.398935+0000","last_unstale":"2023-10-03T19:15:48.156840+0000","last_undegraded":"2023-10-03T19:15:48.156840+0000","last_fullsized":"2023-10-03T19:15:48.156840+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:58:27.652930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.161196+0000","last_change":"2023-10-03T19:15:45.849759+0000","last_active":"2023-10-03T19:15:48.161196+0000","last_peered":"2023-10-03T19:15:48.161196+0000","last_clean":"2023-10-03T19:15:48.161196+0000","last_became_active":"2023-10-03T19:15:45.849456+0000","last_became_peered":"2023-10-03T19:15:45.849456+0000","last_unstale":"2023-10-03T19:15:48.161196+0000","last_undegraded":"2023-10-03T19:15:48.161196+0000","last_fullsized":"2023-10-03T19:15:48.161196+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:04:10.067798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.340190+0000","last_change":"2023-10-03T19:15:46.350646+0000","last_active":"2023-10-03T19:15:47.340190+0000","last_peered":"2023-10-03T19:15:47.340190+0000","last_clean":"2023-10-03T19:15:47.340190+0000","last_became_active":"2023-10-03T19:15:46.350328+0000","last_became_peered":"2023-10-03T19:15:46.350328+0000","last_unstale":"2023-10-03T19:15:47.340190+0000","last_undegraded":"2023-10-03T19:15:47.340190+0000","last_fullsized":"2023-10-03T19:15:47.340190+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:51:25.080660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158967+0000","last_change":"2023-10-03T19:15:45.836185+0000","last_active":"2023-10-03T19:15:48.158967+0000","last_peered":"2023-10-03T19:15:48.158967+0000","last_clean":"2023-10-03T19:15:48.158967+0000","last_became_active":"2023-10-03T19:15:45.835843+0000","last_became_peered":"2023-10-03T19:15:45.835843+0000","last_unstale":"2023-10-03T19:15:48.158967+0000","last_undegraded":"2023-10-03T19:15:48.158967+0000","last_fullsized":"2023-10-03T19:15:48.158967+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:23:01.385691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.348966+0000","last_change":"2023-10-03T19:15:46.367540+0000","last_active":"2023-10-03T19:15:47.348966+0000","last_peered":"2023-10-03T19:15:47.348966+0000","last_clean":"2023-10-03T19:15:47.348966+0000","last_became_active":"2023-10-03T19:15:46.366645+0000","last_became_peered":"2023-10-03T19:15:46.366645+0000","last_unstale":"2023-10-03T19:15:47.348966+0000","last_undegraded":"2023-10-03T19:15:47.348966+0000","last_fullsized":"2023-10-03T19:15:47.348966+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:52:45.483362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.930813+0000","last_change":"2023-10-03T19:15:45.849574+0000","last_active":"2023-10-03T19:15:47.930813+0000","last_peered":"2023-10-03T19:15:47.930813+0000","last_clean":"2023-10-03T19:15:47.930813+0000","last_became_active":"2023-10-03T19:15:45.848800+0000","last_became_peered":"2023-10-03T19:15:45.848800+0000","last_unstale":"2023-10-03T19:15:47.930813+0000","last_undegraded":"2023-10-03T19:15:47.930813+0000","last_fullsized":"2023-10-03T19:15:47.930813+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:39:57.371155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.340502+0000","last_change":"2023-10-03T19:15:46.394179+0000","last_active":"2023-10-03T19:15:47.340502+0000","last_peered":"2023-10-03T19:15:47.340502+0000","last_clean":"2023-10-03T19:15:47.340502+0000","last_became_active":"2023-10-03T19:15:46.393883+0000","last_became_peered":"2023-10-03T19:15:46.393883+0000","last_unstale":"2023-10-03T19:15:47.340502+0000","last_undegraded":"2023-10-03T19:15:47.340502+0000","last_fullsized":"2023-10-03T19:15:47.340502+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:03:56.161089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.930779+0000","last_change":"2023-10-03T19:15:45.859040+0000","last_active":"2023-10-03T19:15:47.930779+0000","last_peered":"2023-10-03T19:15:47.930779+0000","last_clean":"2023-10-03T19:15:47.930779+0000","last_became_active":"2023-10-03T19:15:45.858297+0000","last_became_peered":"2023-10-03T19:15:45.858297+0000","last_unstale":"2023-10-03T19:15:47.930779+0000","last_undegraded":"2023-10-03T19:15:47.930779+0000","last_fullsized":"2023-10-03T19:15:47.930779+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:32:34.116009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349962+0000","last_change":"2023-10-03T19:15:46.396843+0000","last_active":"2023-10-03T19:15:47.349962+0000","last_peered":"2023-10-03T19:15:47.349962+0000","last_clean":"2023-10-03T19:15:47.349962+0000","last_became_active":"2023-10-03T19:15:46.395999+0000","last_became_peered":"2023-10-03T19:15:46.395999+0000","last_unstale":"2023-10-03T19:15:47.349962+0000","last_undegraded":"2023-10-03T19:15:47.349962+0000","last_fullsized":"2023-10-03T19:15:47.349962+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:33:27.851221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.340725+0000","last_change":"2023-10-03T19:15:45.835409+0000","last_active":"2023-10-03T19:15:47.340725+0000","last_peered":"2023-10-03T19:15:47.340725+0000","last_clean":"2023-10-03T19:15:47.340725+0000","last_became_active":"2023-10-03T19:15:45.835194+0000","last_became_peered":"2023-10-03T19:15:45.835194+0000","last_unstale":"2023-10-03T19:15:47.340725+0000","last_undegraded":"2023-10-03T19:15:47.340725+0000","last_fullsized":"2023-10-03T19:15:47.340725+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:00:34.659474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.930303+0000","last_change":"2023-10-03T19:15:46.388333+0000","last_active":"2023-10-03T19:15:47.930303+0000","last_peered":"2023-10-03T19:15:47.930303+0000","last_clean":"2023-10-03T19:15:47.930303+0000","last_became_active":"2023-10-03T19:15:46.387577+0000","last_became_peered":"2023-10-03T19:15:46.387577+0000","last_unstale":"2023-10-03T19:15:47.930303+0000","last_undegraded":"2023-10-03T19:15:47.930303+0000","last_fullsized":"2023-10-03T19:15:47.930303+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:05:53.275156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.156401+0000","last_change":"2023-10-03T19:15:45.846961+0000","last_active":"2023-10-03T19:15:48.156401+0000","last_peered":"2023-10-03T19:15:48.156401+0000","last_clean":"2023-10-03T19:15:48.156401+0000","last_became_active":"2023-10-03T19:15:45.845959+0000","last_became_peered":"2023-10-03T19:15:45.845959+0000","last_unstale":"2023-10-03T19:15:48.156401+0000","last_undegraded":"2023-10-03T19:15:48.156401+0000","last_fullsized":"2023-10-03T19:15:48.156401+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:00:34.659474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160520+0000","last_change":"2023-10-03T19:15:46.375168+0000","last_active":"2023-10-03T19:15:48.160520+0000","last_peered":"2023-10-03T19:15:48.160520+0000","last_clean":"2023-10-03T19:15:48.160520+0000","last_became_active":"2023-10-03T19:15:46.374822+0000","last_became_peered":"2023-10-03T19:15:46.374822+0000","last_unstale":"2023-10-03T19:15:48.160520+0000","last_undegraded":"2023-10-03T19:15:48.160520+0000","last_fullsized":"2023-10-03T19:15:48.160520+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:04:50.606893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159333+0000","last_change":"2023-10-03T19:15:45.843525+0000","last_active":"2023-10-03T19:15:48.159333+0000","last_peered":"2023-10-03T19:15:48.159333+0000","last_clean":"2023-10-03T19:15:48.159333+0000","last_became_active":"2023-10-03T19:15:45.843111+0000","last_became_peered":"2023-10-03T19:15:45.843111+0000","last_unstale":"2023-10-03T19:15:48.159333+0000","last_undegraded":"2023-10-03T19:15:48.159333+0000","last_fullsized":"2023-10-03T19:15:48.159333+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:59:15.785799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.340901+0000","last_change":"2023-10-03T19:15:46.349592+0000","last_active":"2023-10-03T19:15:47.340901+0000","last_peered":"2023-10-03T19:15:47.340901+0000","last_clean":"2023-10-03T19:15:47.340901+0000","last_became_active":"2023-10-03T19:15:46.349264+0000","last_became_peered":"2023-10-03T19:15:46.349264+0000","last_unstale":"2023-10-03T19:15:47.340901+0000","last_undegraded":"2023-10-03T19:15:47.340901+0000","last_fullsized":"2023-10-03T19:15:47.340901+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:21:29.369999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.156826+0000","last_change":"2023-10-03T19:15:45.845501+0000","last_active":"2023-10-03T19:15:48.156826+0000","last_peered":"2023-10-03T19:15:48.156826+0000","last_clean":"2023-10-03T19:15:48.156826+0000","last_became_active":"2023-10-03T19:15:45.845069+0000","last_became_peered":"2023-10-03T19:15:45.845069+0000","last_unstale":"2023-10-03T19:15:48.156826+0000","last_undegraded":"2023-10-03T19:15:48.156826+0000","last_fullsized":"2023-10-03T19:15:48.156826+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:52:48.679994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.930236+0000","last_change":"2023-10-03T19:15:46.401220+0000","last_active":"2023-10-03T19:15:47.930236+0000","last_peered":"2023-10-03T19:15:47.930236+0000","last_clean":"2023-10-03T19:15:47.930236+0000","last_became_active":"2023-10-03T19:15:46.400309+0000","last_became_peered":"2023-10-03T19:15:46.400309+0000","last_unstale":"2023-10-03T19:15:47.930236+0000","last_undegraded":"2023-10-03T19:15:47.930236+0000","last_fullsized":"2023-10-03T19:15:47.930236+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:26:19.898878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"48'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.761698+0000","last_change":"2023-10-03T19:15:45.855576+0000","last_active":"2023-10-03T19:15:48.761698+0000","last_peered":"2023-10-03T19:15:48.761698+0000","last_clean":"2023-10-03T19:15:48.761698+0000","last_became_active":"2023-10-03T19:15:45.855189+0000","last_became_peered":"2023-10-03T19:15:45.855189+0000","last_unstale":"2023-10-03T19:15:48.761698+0000","last_undegraded":"2023-10-03T19:15:48.761698+0000","last_fullsized":"2023-10-03T19:15:48.761698+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:03:22.555251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":218,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159250+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:15:48.159250+0000","last_peered":"2023-10-03T19:15:48.159250+0000","last_clean":"2023-10-03T19:15:48.159250+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:15:48.159250+0000","last_undegraded":"2023-10-03T19:15:48.159250+0000","last_fullsized":"2023-10-03T19:15:48.159250+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:06:03.840386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349442+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:15:47.349442+0000","last_peered":"2023-10-03T19:15:47.349442+0000","last_clean":"2023-10-03T19:15:47.349442+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:15:47.349442+0000","last_undegraded":"2023-10-03T19:15:47.349442+0000","last_fullsized":"2023-10-03T19:15:47.349442+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:07:52.226240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.340383+0000","last_change":"2023-10-03T19:15:46.354378+0000","last_active":"2023-10-03T19:15:47.340383+0000","last_peered":"2023-10-03T19:15:47.340383+0000","last_clean":"2023-10-03T19:15:47.340383+0000","last_became_active":"2023-10-03T19:15:46.354096+0000","last_became_peered":"2023-10-03T19:15:46.354096+0000","last_unstale":"2023-10-03T19:15:47.340383+0000","last_undegraded":"2023-10-03T19:15:47.340383+0000","last_fullsized":"2023-10-03T19:15:47.340383+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:26:39.554506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159655+0000","last_change":"2023-10-03T19:15:45.860418+0000","last_active":"2023-10-03T19:15:48.159655+0000","last_peered":"2023-10-03T19:15:48.159655+0000","last_clean":"2023-10-03T19:15:48.159655+0000","last_became_active":"2023-10-03T19:15:45.859327+0000","last_became_peered":"2023-10-03T19:15:45.859327+0000","last_unstale":"2023-10-03T19:15:48.159655+0000","last_undegraded":"2023-10-03T19:15:48.159655+0000","last_fullsized":"2023-10-03T19:15:48.159655+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:25:18.867250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158690+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:15:48.158690+0000","last_peered":"2023-10-03T19:15:48.158690+0000","last_clean":"2023-10-03T19:15:48.158690+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:15:48.158690+0000","last_undegraded":"2023-10-03T19:15:48.158690+0000","last_fullsized":"2023-10-03T19:15:48.158690+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:37:01.580773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.156409+0000","last_change":"2023-10-03T19:15:46.364340+0000","last_active":"2023-10-03T19:15:48.156409+0000","last_peered":"2023-10-03T19:15:48.156409+0000","last_clean":"2023-10-03T19:15:48.156409+0000","last_became_active":"2023-10-03T19:15:46.364068+0000","last_became_peered":"2023-10-03T19:15:46.364068+0000","last_unstale":"2023-10-03T19:15:48.156409+0000","last_undegraded":"2023-10-03T19:15:48.156409+0000","last_fullsized":"2023-10-03T19:15:48.156409+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:27:44.268953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160423+0000","last_change":"2023-10-03T19:15:45.850638+0000","last_active":"2023-10-03T19:15:48.160423+0000","last_peered":"2023-10-03T19:15:48.160423+0000","last_clean":"2023-10-03T19:15:48.160423+0000","last_became_active":"2023-10-03T19:15:45.850362+0000","last_became_peered":"2023-10-03T19:15:45.850362+0000","last_unstale":"2023-10-03T19:15:48.160423+0000","last_undegraded":"2023-10-03T19:15:48.160423+0000","last_fullsized":"2023-10-03T19:15:48.160423+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:59:04.384674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.157081+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:15:48.157081+0000","last_peered":"2023-10-03T19:15:48.157081+0000","last_clean":"2023-10-03T19:15:48.157081+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:15:48.157081+0000","last_undegraded":"2023-10-03T19:15:48.157081+0000","last_fullsized":"2023-10-03T19:15:48.157081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:20:37.927461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.348353+0000","last_change":"2023-10-03T19:15:46.396444+0000","last_active":"2023-10-03T19:15:47.348353+0000","last_peered":"2023-10-03T19:15:47.348353+0000","last_clean":"2023-10-03T19:15:47.348353+0000","last_became_active":"2023-10-03T19:15:46.395657+0000","last_became_peered":"2023-10-03T19:15:46.395657+0000","last_unstale":"2023-10-03T19:15:47.348353+0000","last_undegraded":"2023-10-03T19:15:47.348353+0000","last_fullsized":"2023-10-03T19:15:47.348353+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:02:07.926380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.930799+0000","last_change":"2023-10-03T19:15:45.858616+0000","last_active":"2023-10-03T19:15:47.930799+0000","last_peered":"2023-10-03T19:15:47.930799+0000","last_clean":"2023-10-03T19:15:47.930799+0000","last_became_active":"2023-10-03T19:15:45.858088+0000","last_became_peered":"2023-10-03T19:15:45.858088+0000","last_unstale":"2023-10-03T19:15:47.930799+0000","last_undegraded":"2023-10-03T19:15:47.930799+0000","last_fullsized":"2023-10-03T19:15:47.930799+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:44:58.867577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.347923+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:15:47.347923+0000","last_peered":"2023-10-03T19:15:47.347923+0000","last_clean":"2023-10-03T19:15:47.347923+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:15:47.347923+0000","last_undegraded":"2023-10-03T19:15:47.347923+0000","last_fullsized":"2023-10-03T19:15:47.347923+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:46:54.785846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160288+0000","last_change":"2023-10-03T19:15:46.360983+0000","last_active":"2023-10-03T19:15:48.160288+0000","last_peered":"2023-10-03T19:15:48.160288+0000","last_clean":"2023-10-03T19:15:48.160288+0000","last_became_active":"2023-10-03T19:15:46.360549+0000","last_became_peered":"2023-10-03T19:15:46.360549+0000","last_unstale":"2023-10-03T19:15:48.160288+0000","last_undegraded":"2023-10-03T19:15:48.160288+0000","last_fullsized":"2023-10-03T19:15:48.160288+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:18:21.999198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.347678+0000","last_change":"2023-10-03T19:15:45.849036+0000","last_active":"2023-10-03T19:15:47.347678+0000","last_peered":"2023-10-03T19:15:47.347678+0000","last_clean":"2023-10-03T19:15:47.347678+0000","last_became_active":"2023-10-03T19:15:45.848308+0000","last_became_peered":"2023-10-03T19:15:45.848308+0000","last_unstale":"2023-10-03T19:15:47.347678+0000","last_undegraded":"2023-10-03T19:15:47.347678+0000","last_fullsized":"2023-10-03T19:15:47.347678+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:14:32.240240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.340413+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:15:47.340413+0000","last_peered":"2023-10-03T19:15:47.340413+0000","last_clean":"2023-10-03T19:15:47.340413+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:15:47.340413+0000","last_undegraded":"2023-10-03T19:15:47.340413+0000","last_fullsized":"2023-10-03T19:15:47.340413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:49:21.984325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.158360+0000","last_change":"2023-10-03T19:15:46.360964+0000","last_active":"2023-10-03T19:15:48.158360+0000","last_peered":"2023-10-03T19:15:48.158360+0000","last_clean":"2023-10-03T19:15:48.158360+0000","last_became_active":"2023-10-03T19:15:46.359049+0000","last_became_peered":"2023-10-03T19:15:46.359049+0000","last_unstale":"2023-10-03T19:15:48.158360+0000","last_undegraded":"2023-10-03T19:15:48.158360+0000","last_fullsized":"2023-10-03T19:15:48.158360+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:14:47.504752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.348664+0000","last_change":"2023-10-03T19:15:45.834172+0000","last_active":"2023-10-03T19:15:47.348664+0000","last_peered":"2023-10-03T19:15:47.348664+0000","last_clean":"2023-10-03T19:15:47.348664+0000","last_became_active":"2023-10-03T19:15:45.833415+0000","last_became_peered":"2023-10-03T19:15:45.833415+0000","last_unstale":"2023-10-03T19:15:47.348664+0000","last_undegraded":"2023-10-03T19:15:47.348664+0000","last_fullsized":"2023-10-03T19:15:47.348664+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:41:46.377632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.159694+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:15:48.159694+0000","last_peered":"2023-10-03T19:15:48.159694+0000","last_clean":"2023-10-03T19:15:48.159694+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:15:48.159694+0000","last_undegraded":"2023-10-03T19:15:48.159694+0000","last_fullsized":"2023-10-03T19:15:48.159694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:48:06.089035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.160091+0000","last_change":"2023-10-03T19:15:46.365576+0000","last_active":"2023-10-03T19:15:48.160091+0000","last_peered":"2023-10-03T19:15:48.160091+0000","last_clean":"2023-10-03T19:15:48.160091+0000","last_became_active":"2023-10-03T19:15:46.365249+0000","last_became_peered":"2023-10-03T19:15:46.365249+0000","last_unstale":"2023-10-03T19:15:48.160091+0000","last_undegraded":"2023-10-03T19:15:48.160091+0000","last_fullsized":"2023-10-03T19:15:48.160091+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:10:27.658304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.157494+0000","last_change":"2023-10-03T19:15:45.848356+0000","last_active":"2023-10-03T19:15:48.157494+0000","last_peered":"2023-10-03T19:15:48.157494+0000","last_clean":"2023-10-03T19:15:48.157494+0000","last_became_active":"2023-10-03T19:15:45.847882+0000","last_became_peered":"2023-10-03T19:15:45.847882+0000","last_unstale":"2023-10-03T19:15:48.157494+0000","last_undegraded":"2023-10-03T19:15:48.157494+0000","last_fullsized":"2023-10-03T19:15:48.157494+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:41:56.031002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.341281+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:15:47.341281+0000","last_peered":"2023-10-03T19:15:47.341281+0000","last_clean":"2023-10-03T19:15:47.341281+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:15:47.341281+0000","last_undegraded":"2023-10-03T19:15:47.341281+0000","last_fullsized":"2023-10-03T19:15:47.341281+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:38:33.535924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.349987+0000","last_change":"2023-10-03T19:15:46.396416+0000","last_active":"2023-10-03T19:15:47.349987+0000","last_peered":"2023-10-03T19:15:47.349987+0000","last_clean":"2023-10-03T19:15:47.349987+0000","last_became_active":"2023-10-03T19:15:46.395693+0000","last_became_peered":"2023-10-03T19:15:46.395693+0000","last_unstale":"2023-10-03T19:15:47.349987+0000","last_undegraded":"2023-10-03T19:15:47.349987+0000","last_fullsized":"2023-10-03T19:15:47.349987+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:45.804158+0000","last_clean_scrub_stamp":"2023-10-03T19:15:45.804158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:18:43.523711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:48.156700+0000","last_change":"2023-10-03T19:15:45.846558+0000","last_active":"2023-10-03T19:15:48.156700+0000","last_peered":"2023-10-03T19:15:48.156700+0000","last_clean":"2023-10-03T19:15:48.156700+0000","last_became_active":"2023-10-03T19:15:45.845284+0000","last_became_peered":"2023-10-03T19:15:45.845284+0000","last_unstale":"2023-10-03T19:15:48.156700+0000","last_undegraded":"2023-10-03T19:15:48.156700+0000","last_fullsized":"2023-10-03T19:15:48.156700+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:15:44.800199+0000","last_clean_scrub_stamp":"2023-10-03T19:15:44.800199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:40:06.410394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-03T19:15:47.931033+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:15:47.931033+0000","last_peered":"2023-10-03T19:15:47.931033+0000","last_clean":"2023-10-03T19:15:47.931033+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:15:47.931033+0000","last_undegraded":"2023-10-03T19:15:47.931033+0000","last_fullsized":"2023-10-03T19:15:47.931033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:17:35.228192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509485,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24304,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":23680,"kb_avail":94347536,"statfs":{"total":96636764160,"available":96611876864,"internally_reserved":0,"allocated":630784,"data_stored":832439,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":24248320},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.93799999999999994,"15min":0.95399999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2030000000000001,"5min":4.0469999999999997,"15min":4.0469999999999997},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82699999999999996,"15min":0.80200000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.05,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.0800000000000001}]},{"osd":1,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.97599999999999998,"15min":1.038},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.169,"5min":3.8239999999999998,"15min":3.8239999999999998},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.878,"15min":0.85699999999999998},"min":{"1min":0.66300000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1899999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.874}]},{"osd":2,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":0.91400000000000003,"15min":0.86199999999999999},"min":{"1min":0.66100000000000003,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":6.0449999999999999,"5min":6.0449999999999999,"15min":6.0449999999999999},"last":1.212},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.0129999999999999,"15min":1.0429999999999999},"min":{"1min":0.60599999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.252,"5min":3.98,"15min":3.98},"last":0.93500000000000005}]},{"osd":3,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":0.98699999999999999,"15min":0.94099999999999995},"min":{"1min":0.79200000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":6.125,"5min":6.125,"15min":6.125},"last":1.1120000000000001},{"interface":"front","average":{"1min":0.96099999999999997,"5min":1.0900000000000001,"15min":1.1299999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.2070000000000001,"5min":3.9140000000000001,"15min":3.9140000000000001},"last":1.0449999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":1.0940000000000001,"15min":1.1799999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1970000000000001,"5min":5.1130000000000004,"15min":5.1130000000000004},"last":0.69599999999999995},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.0429999999999999,"15min":1.0349999999999999},"min":{"1min":0.67500000000000004,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":6.3520000000000003,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":0.998}]},{"osd":5,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.198,"15min":1.2889999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2889999999999999,"5min":5.1859999999999999,"15min":5.1859999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.125,"15min":1.159},"min":{"1min":0.73299999999999998,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.2949999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":0.97399999999999998}]},{"osd":6,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.099,"15min":1.1020000000000001},"min":{"1min":0.80800000000000005,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.349,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.2010000000000001,"15min":1.1930000000000001},"min":{"1min":0.88,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":6.1580000000000004,"5min":6.1580000000000004,"15min":6.1580000000000004},"last":0.83499999999999996}]}]},{"osd":6,"up_from":15,"seq":64424509485,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13804,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":13248,"kb_avail":94358036,"statfs":{"total":96636764160,"available":96622628864,"internally_reserved":0,"allocated":561152,"data_stored":241435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13565952},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.82899999999999996,"15min":0.81699999999999995},"min":{"1min":0.55800000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.111,"5min":1.504,"15min":1.504},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.89400000000000002,"15min":0.88300000000000001},"min":{"1min":0.69399999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1739999999999999,"5min":1.839,"15min":1.839},"last":1.03}]},{"osd":1,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.84799999999999998,"15min":0.83799999999999997},"min":{"1min":0.63600000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.117,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.88700000000000001,"15min":0.879},"min":{"1min":0.58899999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1479999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":1.1200000000000001}]},{"osd":2,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.89000000000000001,"15min":0.86499999999999999},"min":{"1min":0.745,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0940000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91700000000000004,"15min":0.92500000000000004},"min":{"1min":0.66300000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2250000000000001,"5min":1.546,"15min":1.546},"last":1.143}]},{"osd":3,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97999999999999998,"15min":0.98599999999999999},"min":{"1min":0.64700000000000002,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1719999999999999,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90800000000000003,"15min":0.90900000000000003},"min":{"1min":0.68999999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0580000000000001,"5min":2.121,"15min":2.121},"last":1.097}]},{"osd":4,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.999,"15min":1.0349999999999999},"min":{"1min":0.68500000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.147,"5min":1.95,"15min":1.95},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.056,"15min":1.0980000000000001},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.216,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.212}]},{"osd":5,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":1.004,"15min":1.03},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.153,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.008,"5min":1.0920000000000001,"15min":1.1240000000000001},"min":{"1min":0.68300000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.1879999999999999,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.0649999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:15:23 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.1060000000000001,"15min":1.1259999999999999},"min":{"1min":0.73299999999999998,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.234,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0820000000000001,"15min":1.1000000000000001},"min":{"1min":0.86199999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.194,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.1659999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509486,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14572,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":14016,"kb_avail":94357268,"statfs":{"total":96636764160,"available":96621842432,"internally_reserved":0,"allocated":561152,"data_stored":242529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14352384},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.81299999999999994,"15min":0.78300000000000003},"min":{"1min":0.57299999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1279999999999999,"5min":1.258,"15min":1.258},"last":1.2729999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.83999999999999997,"15min":0.82599999999999996},"min":{"1min":0.56000000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.1459999999999999,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.73999999999999999}]},{"osd":1,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.93000000000000005,"15min":0.93500000000000005},"min":{"1min":0.68200000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.175,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":1.002},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.879,"15min":0.85499999999999998},"min":{"1min":0.59999999999999998,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.276,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.86599999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.93000000000000005,"15min":0.91400000000000003},"min":{"1min":0.71399999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1040000000000001,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.171},{"interface":"front","average":{"1min":1.002,"5min":0.96799999999999997,"15min":0.94499999999999995},"min":{"1min":0.78100000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2190000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":1.0509999999999999}]},{"osd":3,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.88600000000000001,"15min":0.874},"min":{"1min":0.76000000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.129,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0609999999999999,"15min":1.071},"min":{"1min":0.85999999999999999,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.216,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":1.2509999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":1.026,"15min":1.0620000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2050000000000001,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.99299999999999999,"15min":1.0149999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.1499999999999999,"5min":1.635,"15min":1.635},"last":1.206}]},{"osd":6,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.1399999999999999,"15min":1.204},"min":{"1min":0.74299999999999999,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.2529999999999999,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.1539999999999999,"15min":1.1950000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.288,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":1.3640000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0680000000000001,"15min":1.0900000000000001},"min":{"1min":0.755,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.202,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.2070000000000001,"15min":1.2350000000000001},"min":{"1min":0.88700000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3180000000000001,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":1.3260000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14064,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":13504,"kb_avail":94357776,"statfs":{"total":96636764160,"available":96622362624,"internally_reserved":0,"allocated":565248,"data_stored":242347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13828096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.56499999999999995,"15min":0.52800000000000002},"min":{"1min":0.36599999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.86499999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.65800000000000003,"15min":0.61699999999999999},"min":{"1min":0.496,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.034,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.625}]},{"osd":1,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.67600000000000005,"15min":0.621},"min":{"1min":0.56699999999999995,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1639999999999999,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.63200000000000001,"15min":0.58999999999999997},"min":{"1min":0.47899999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.753}]},{"osd":3,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.67300000000000004,"15min":0.623},"min":{"1min":0.52900000000000003,"5min":0.224,"15min":0.224},"max":{"1min":1.0269999999999999,"5min":1.246,"15min":1.246},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.78200000000000003,"15min":0.72199999999999998},"min":{"1min":0.60599999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.85699999999999998}]},{"osd":4,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.878,"15min":0.84399999999999997},"min":{"1min":0.625,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.23,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.071,"5min":0.95499999999999996,"15min":0.91300000000000003},"min":{"1min":0.67000000000000004,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.347,"5min":1.399,"15min":1.399},"last":0.93700000000000006}]},{"osd":5,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.90800000000000003,"15min":0.86199999999999999},"min":{"1min":0.70999999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":1.325},{"interface":"front","average":{"1min":1.091,"5min":0.99099999999999999,"15min":0.93999999999999995},"min":{"1min":0.76200000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.2549999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.1950000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.93799999999999994,"15min":0.91300000000000003},"min":{"1min":0.82199999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.276},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.002,"15min":0.96399999999999997},"min":{"1min":0.68799999999999994,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3899999999999999,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.2290000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.054,"15min":1.004},"min":{"1min":0.72299999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4179999999999999,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.306},{"interface":"front","average":{"1min":1.111,"5min":0.99099999999999999,"15min":0.95699999999999996},"min":{"1min":0.77800000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.0940000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509485,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13872,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":13312,"kb_avail":94357968,"statfs":{"total":96636764160,"available":96622559232,"internally_reserved":0,"allocated":565248,"data_stored":242107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13631488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.57599999999999996,"15min":0.54500000000000004},"min":{"1min":0.51400000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.58299999999999996,"15min":0.50900000000000001},"min":{"1min":0.503,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.0309999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.51200000000000001}]},{"osd":2,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.59099999999999997,"15min":0.54700000000000004},"min":{"1min":0.55200000000000005,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.88,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.71799999999999997,"15min":0.66200000000000003},"min":{"1min":0.72699999999999998,"5min":0.312,"15min":0.312},"max":{"1min":1.1439999999999999,"5min":1.169,"15min":1.169},"last":0.68899999999999995}]},{"osd":3,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.68799999999999994,"15min":0.63100000000000001},"min":{"1min":0.59899999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.091,"5min":1.27,"15min":1.27},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.64300000000000002,"15min":0.57899999999999996},"min":{"1min":0.55600000000000005,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0549999999999999,"5min":1.27,"15min":1.27},"last":0.63200000000000001}]},{"osd":4,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.83399999999999996,"15min":0.79800000000000004},"min":{"1min":0.70399999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.143,"5min":1.202,"15min":1.202},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.0349999999999999,"5min":0.91800000000000004,"15min":0.88800000000000001},"min":{"1min":0.84899999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.93000000000000005}]},{"osd":5,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":0.91200000000000003,"15min":0.85799999999999998},"min":{"1min":0.72499999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.339,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.88900000000000001,"15min":0.84899999999999998},"min":{"1min":0.82499999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.284,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.85099999999999998}]},{"osd":6,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":0.96999999999999997,"15min":0.92200000000000004},"min":{"1min":0.96499999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2589999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.028,"5min":0.94099999999999995,"15min":0.89100000000000001},"min":{"1min":0.80400000000000005,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2270000000000001,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.879}]},{"osd":7,"last update":"Tue Oct 3 19:15:31 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":0.99099999999999999,"15min":0.93600000000000005},"min":{"1min":0.83399999999999996,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.95699999999999996,"15min":0.89900000000000002},"min":{"1min":0.85399999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3759999999999999,"5min":1.649,"15min":1.649},"last":0.90900000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542190,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23224,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":22656,"kb_avail":94348616,"statfs":{"total":96636764160,"available":96612982784,"internally_reserved":0,"allocated":573440,"data_stored":243533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23199744},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.60899999999999999,"15min":0.57099999999999995},"min":{"1min":0.318,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.497},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.67100000000000004,"15min":0.64300000000000002},"min":{"1min":0.34999999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.198,"5min":1.236,"15min":1.236},"last":0.38800000000000001}]},{"osd":1,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.65600000000000003,"15min":0.624},"min":{"1min":0.41999999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.95699999999999996,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.70099999999999996,"15min":0.66100000000000003},"min":{"1min":0.435,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.028,"5min":1.222,"15min":1.222},"last":0.53000000000000003}]},{"osd":2,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.751,"15min":0.70699999999999996},"min":{"1min":0.45900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0740000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.67600000000000005,"15min":0.626},"min":{"1min":0.33600000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.0780000000000001,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.46500000000000002}]},{"osd":4,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.93300000000000005,"15min":0.91100000000000003},"min":{"1min":0.70399999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.411,"5min":1.496,"15min":1.496},"last":0.58899999999999997},{"interface":"front","average":{"1min":1.0620000000000001,"5min":0.95899999999999996,"15min":0.93200000000000005},"min":{"1min":0.754,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.83799999999999997}]},{"osd":5,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.90500000000000003,"15min":0.878},"min":{"1min":0.75,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.365,"5min":1.51,"15min":1.51},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.014,"15min":0.996},"min":{"1min":0.74099999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.66300000000000003}]},{"osd":6,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.94699999999999995,"15min":0.92000000000000004},"min":{"1min":0.67200000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2450000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.024,"15min":0.98699999999999999},"min":{"1min":0.77600000000000002,"5min":0.625,"15min":0.625},"max":{"1min":1.323,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.70299999999999996}]},{"osd":7,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.032,"15min":1.004},"min":{"1min":0.79100000000000004,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.4470000000000001,"5min":1.597,"15min":1.597},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.103,"5min":1.0489999999999999,"15min":1.0169999999999999},"min":{"1min":0.71799999999999997,"5min":0.623,"15min":0.623},"max":{"1min":1.377,"5min":1.708,"15min":1.708},"last":0.72699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15272,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":14720,"kb_avail":94356568,"statfs":{"total":96636764160,"available":96621125632,"internally_reserved":0,"allocated":557056,"data_stored":241947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15073280},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.84299999999999997,"15min":0.82099999999999995},"min":{"1min":0.55900000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2230000000000001,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.167},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.85899999999999999,"15min":0.85299999999999998},"min":{"1min":0.65700000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1499999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.68300000000000005}]},{"osd":1,"last update":"Tue Oct 3 19:15:28 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.85299999999999998,"15min":0.83399999999999996},"min":{"1min":0.628,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.93000000000000005,"15min":0.92900000000000005},"min":{"1min":0.58699999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1799999999999999,"5min":1.514,"15min":1.514},"last":0.96099999999999997}]},{"osd":2,"last update":"Tue Oct 3 19:15:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.91400000000000003,"15min":0.90000000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3280000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.90600000000000003,"15min":0.89600000000000002},"min":{"1min":0.60999999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1599999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.90500000000000003}]},{"osd":3,"last update":"Tue Oct 3 19:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.92300000000000004,"15min":0.92500000000000004},"min":{"1min":0.68899999999999995,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.149,"5min":1.304,"15min":1.304},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.038,"15min":1.0289999999999999},"min":{"1min":0.89500000000000002,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.2490000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.0009999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:15:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97399999999999998,"15min":0.97199999999999998},"min":{"1min":0.66400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.999,"5min":1.0149999999999999,"15min":1.0369999999999999},"min":{"1min":0.72099999999999997,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.335,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.147}]},{"osd":6,"last update":"Tue Oct 3 19:15:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.01,"15min":1.038},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.266,"5min":1.462,"15min":1.462},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.133,"15min":1.1419999999999999},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":1.099}]},{"osd":7,"last update":"Tue Oct 3 19:15:28 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.079},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.381,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.129,"5min":1.1459999999999999,"15min":1.1539999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.357,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.2330000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15404,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":14784,"kb_avail":94356436,"statfs":{"total":96636764160,"available":96620990464,"internally_reserved":0,"allocated":626688,"data_stored":831207,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":15138816},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.61399999999999999,"15min":0.57999999999999996},"min":{"1min":0.47499999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.92800000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73399999999999999,"15min":0.71199999999999997},"min":{"1min":0.54900000000000004,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0800000000000001,"5min":1.27,"15min":1.27},"last":0.89300000000000002}]},{"osd":2,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.72499999999999998,"15min":0.71399999999999997},"min":{"1min":0.49199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.131,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70199999999999996,"15min":0.68999999999999995},"min":{"1min":0.44500000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.98199999999999998,"5min":1.548,"15min":1.548},"last":0.85999999999999999}]},{"osd":3,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.78300000000000003,"15min":0.72399999999999998},"min":{"1min":0.65900000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.75900000000000001,"15min":0.69599999999999995},"min":{"1min":0.51200000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.79300000000000004}]},{"osd":4,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.91200000000000003,"15min":0.90600000000000003},"min":{"1min":0.71299999999999997,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1539999999999999,"5min":1.355,"15min":1.355},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.048,"5min":1.034,"15min":1.022},"min":{"1min":0.82499999999999996,"5min":0.504,"15min":0.504},"max":{"1min":1.3140000000000001,"5min":1.508,"15min":1.508},"last":1.008}]},{"osd":5,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0569999999999999,"15min":1.0449999999999999},"min":{"1min":0.85599999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.161},{"interface":"front","average":{"1min":1.087,"5min":0.997,"15min":0.97399999999999998},"min":{"1min":0.82599999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.371,"5min":1.444,"15min":1.444},"last":1.044}]},{"osd":6,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.034,"15min":1.014},"min":{"1min":0.77600000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.427,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.119},{"interface":"front","average":{"1min":1.099,"5min":1.018,"15min":0.99199999999999999},"min":{"1min":0.83899999999999997,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.84199999999999997}]},{"osd":7,"last update":"Tue Oct 3 19:15:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.0660000000000001,"15min":1.036},"min":{"1min":0.90200000000000002,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.3919999999999999,"5min":1.407,"15min":1.407},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.149,"5min":1.0780000000000001,"15min":1.0600000000000001},"min":{"1min":0.78500000000000003,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.93600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:15:57.116 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-03T19:15:57.117 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-03T19:15:57.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.279+0000 7fa264f85640 1 Processor -- start 2023-10-03T19:15:57.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.279+0000 7fa264f85640 1 -- start start 2023-10-03T19:15:57.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.279+0000 7fa264f85640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2600712c0 0x7fa26006cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:57.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.279+0000 7fa264f85640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa2600a5d20 0x7fa2600a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:57.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.279+0000 7fa264f85640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2601507f0 con 0x7fa26006c3f0 2023-10-03T19:15:57.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.279+0000 7fa264f85640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2600bc250 con 0x7fa2600a5d20 2023-10-03T19:15:57.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.279+0000 7fa264f85640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26014cae0 con 0x7fa2600712c0 2023-10-03T19:15:57.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.283+0000 7fa25e59c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2600712c0 0x7fa26006cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:57.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.283+0000 7fa25ed9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa2600a5d20 0x7fa2600a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:57.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.283+0000 7fa25e59c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2600712c0 0x7fa26006cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:38974/0 (socket says 172.21.15.45:38974) 2023-10-03T19:15:57.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.283+0000 7fa25ed9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa2600a5d20 0x7fa2600a4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:48112/0 (socket says 172.21.15.45:48112) 2023-10-03T19:15:57.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.283+0000 7fa25e59c640 1 -- 172.21.15.45:0/963372892 learned_addr learned my addr 172.21.15.45:0/963372892 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:57.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.283+0000 7fa25ed9d640 1 -- 172.21.15.45:0/963372892 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2600712c0 msgr2=0x7fa26006cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:57.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.283+0000 7fa25ed9d640 1 --2- 172.21.15.45:0/963372892 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2600712c0 0x7fa26006cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:57.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.283+0000 7fa25ed9d640 1 -- 172.21.15.45:0/963372892 >> v1:172.21.15.79:6789/0 conn(0x7fa26006c3f0 legacy=0x7fa26014c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:57.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.283+0000 7fa25ed9d640 1 -- 172.21.15.45:0/963372892 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2600a5a40 con 0x7fa2600a5d20 2023-10-03T19:15:57.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.283+0000 7fa25e59c640 1 --2- 172.21.15.45:0/963372892 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2600712c0 0x7fa26006cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:15:57.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.283+0000 7fa25ed9d640 1 --2- 172.21.15.45:0/963372892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2600a5d20 0x7fa2600a4fb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa258009d90 tx=0x7fa25801c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36d43f90f5e24e74 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:57.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.283+0000 7fa25d59a640 1 -- 172.21.15.45:0/963372892 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2580a57d0 con 0x7fa2600a5d20 2023-10-03T19:15:57.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.283+0000 7fa25d59a640 1 -- 172.21.15.45:0/963372892 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2580a5930 con 0x7fa2600a5d20 2023-10-03T19:15:57.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.283+0000 7fa25d59a640 1 -- 172.21.15.45:0/963372892 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2580a5cc0 con 0x7fa2600a5d20 2023-10-03T19:15:57.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa264f85640 1 -- 172.21.15.45:0/963372892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2600a5d20 msgr2=0x7fa2600a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:57.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa264f85640 1 --2- 172.21.15.45:0/963372892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2600a5d20 0x7fa2600a4fb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa258009d90 tx=0x7fa25801c800 comp rx=0 tx=0).stop 2023-10-03T19:15:57.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa264f85640 1 -- 172.21.15.45:0/963372892 shutdown_connections 2023-10-03T19:15:57.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa264f85640 1 --2- 172.21.15.45:0/963372892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2600a5d20 0x7fa2600a4fb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:57.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa264f85640 1 --2- 172.21.15.45:0/963372892 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2600712c0 0x7fa26006cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:57.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa264f85640 1 -- 172.21.15.45:0/963372892 >> 172.21.15.45:0/963372892 conn(0x7fa2600a20d0 msgr2=0x7fa2600a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:57.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa264f85640 1 -- 172.21.15.45:0/963372892 shutdown_connections 2023-10-03T19:15:57.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa264f85640 1 -- 172.21.15.45:0/963372892 wait complete. 2023-10-03T19:15:57.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa264f85640 1 Processor -- start 2023-10-03T19:15:57.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa264f85640 1 -- start start 2023-10-03T19:15:57.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa264f85640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa26006c3f0 0x7fa26014bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:57.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa264f85640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2600712c0 0x7fa260148aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:57.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa264f85640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2600a5d20 0x7fa2601e7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:57.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa264f85640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26014c460 con 0x7fa2600712c0 2023-10-03T19:15:57.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa264f85640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2600ba240 con 0x7fa2600a5d20 2023-10-03T19:15:57.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa264f85640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26014c670 con 0x7fa26006c3f0 2023-10-03T19:15:57.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa25dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2600712c0 0x7fa260148aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:57.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa25dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2600712c0 0x7fa260148aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48290/0 (socket says 172.21.15.45:48290) 2023-10-03T19:15:57.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa25dd9b640 1 -- 172.21.15.45:0/1975661376 learned_addr learned my addr 172.21.15.45:0/1975661376 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:57.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa25ed9d640 1 --2- 172.21.15.45:0/1975661376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2600a5d20 0x7fa2601e7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:57.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa25e59c640 1 --2- 172.21.15.45:0/1975661376 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa26006c3f0 0x7fa26014bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:57.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa25dd9b640 1 -- 172.21.15.45:0/1975661376 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa26006c3f0 msgr2=0x7fa26014bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:57.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa25dd9b640 1 --2- 172.21.15.45:0/1975661376 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa26006c3f0 0x7fa26014bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:57.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa25dd9b640 1 -- 172.21.15.45:0/1975661376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2600a5d20 msgr2=0x7fa2601e7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:57.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa25dd9b640 1 --2- 172.21.15.45:0/1975661376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2600a5d20 0x7fa2601e7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:57.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa25dd9b640 1 -- 172.21.15.45:0/1975661376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2480094d0 con 0x7fa2600712c0 2023-10-03T19:15:57.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa25dd9b640 1 --2- 172.21.15.45:0/1975661376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2600712c0 0x7fa260148aa0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa25000c3c0 tx=0x7fa25000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:57.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa256ffd640 1 -- 172.21.15.45:0/1975661376 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2500052d0 con 0x7fa2600712c0 2023-10-03T19:15:57.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa256ffd640 1 -- 172.21.15.45:0/1975661376 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa250005430 con 0x7fa2600712c0 2023-10-03T19:15:57.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa264f85640 1 -- 172.21.15.45:0/1975661376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa258009a70 con 0x7fa2600712c0 2023-10-03T19:15:57.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa256ffd640 1 -- 172.21.15.45:0/1975661376 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa250003840 con 0x7fa2600712c0 2023-10-03T19:15:57.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.287+0000 7fa264f85640 1 -- 172.21.15.45:0/1975661376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa260071690 con 0x7fa2600712c0 2023-10-03T19:15:57.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.291+0000 7fa264f85640 1 -- 172.21.15.45:0/1975661376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2600a6120 con 0x7fa2600712c0 2023-10-03T19:15:57.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.291+0000 7fa256ffd640 1 -- 172.21.15.45:0/1975661376 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa2500039a0 con 0x7fa2600712c0 2023-10-03T19:15:57.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.291+0000 7fa256ffd640 1 --2- 172.21.15.45:0/1975661376 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa240066280 0x7fa240068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:57.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.291+0000 7fa256ffd640 1 -- 172.21.15.45:0/1975661376 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa2500831e0 con 0x7fa2600712c0 2023-10-03T19:15:57.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.291+0000 7fa25e59c640 1 --2- 172.21.15.45:0/1975661376 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa240066280 0x7fa240068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:57.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.291+0000 7fa25e59c640 1 --2- 172.21.15.45:0/1975661376 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa240066280 0x7fa240068730 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa248009c70 tx=0x7fa248008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:57.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.295+0000 7fa256ffd640 1 -- 172.21.15.45:0/1975661376 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa2500506f0 con 0x7fa2600712c0 2023-10-03T19:15:57.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.503+0000 7fa264f85640 1 -- 172.21.15.45:0/1975661376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa260071820 con 0x7fa2600712c0 2023-10-03T19:15:57.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.507+0000 7fa256ffd640 1 -- 172.21.15.45:0/1975661376 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7fa250053d10 con 0x7fa2600712c0 2023-10-03T19:15:57.514 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-10-03T19:15:57.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.511+0000 7fa264f85640 1 -- 172.21.15.45:0/1975661376 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa240066280 msgr2=0x7fa240068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:57.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.511+0000 7fa264f85640 1 --2- 172.21.15.45:0/1975661376 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa240066280 0x7fa240068730 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa248009c70 tx=0x7fa248008040 comp rx=0 tx=0).stop 2023-10-03T19:15:57.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.511+0000 7fa264f85640 1 -- 172.21.15.45:0/1975661376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2600712c0 msgr2=0x7fa260148aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:57.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.511+0000 7fa264f85640 1 --2- 172.21.15.45:0/1975661376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2600712c0 0x7fa260148aa0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa25000c3c0 tx=0x7fa25000c880 comp rx=0 tx=0).stop 2023-10-03T19:15:57.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.511+0000 7fa264f85640 1 -- 172.21.15.45:0/1975661376 shutdown_connections 2023-10-03T19:15:57.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.511+0000 7fa264f85640 1 --2- 172.21.15.45:0/1975661376 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa240066280 0x7fa240068730 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:57.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.511+0000 7fa264f85640 1 --2- 172.21.15.45:0/1975661376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2600a5d20 0x7fa2601e7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:57.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.511+0000 7fa264f85640 1 --2- 172.21.15.45:0/1975661376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2600712c0 0x7fa260148aa0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:57.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.511+0000 7fa264f85640 1 --2- 172.21.15.45:0/1975661376 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa26006c3f0 0x7fa26014bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:57.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.511+0000 7fa264f85640 1 -- 172.21.15.45:0/1975661376 >> 172.21.15.45:0/1975661376 conn(0x7fa2600a20d0 msgr2=0x7fa2600bf620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:57.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.511+0000 7fa264f85640 1 -- 172.21.15.45:0/1975661376 shutdown_connections 2023-10-03T19:15:57.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.511+0000 7fa264f85640 1 -- 172.21.15.45:0/1975661376 wait complete. 2023-10-03T19:15:57.534 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:15:57.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.655+0000 7fa67263c640 1 Processor -- start 2023-10-03T19:15:57.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.655+0000 7fa67263c640 1 -- start start 2023-10-03T19:15:57.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.659+0000 7fa67263c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa66c0c2790 0x7fa66c1528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:57.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.659+0000 7fa67263c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa66c0bb1d0 0x7fa66c0c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:57.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.659+0000 7fa67263c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66c06b2d0 con 0x7fa66c14f240 2023-10-03T19:15:57.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.659+0000 7fa67263c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa66c06b640 con 0x7fa66c0c2790 2023-10-03T19:15:57.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.659+0000 7fa67263c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c0a3c60 con 0x7fa66c0bb1d0 2023-10-03T19:15:57.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.659+0000 7fa670bd9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa66c0bb1d0 0x7fa66c0c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:57.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.659+0000 7fa66b7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa66c0c2790 0x7fa66c1528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:57.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.659+0000 7fa66bfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa66c14f240 0x7fa66c0c0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:55922/0 (socket says 172.21.15.45:55922) 2023-10-03T19:15:57.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.659+0000 7fa670bd9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa66c0bb1d0 0x7fa66c0c12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:38988/0 (socket says 172.21.15.45:38988) 2023-10-03T19:15:57.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.659+0000 7fa66bfff640 1 -- 172.21.15.45:0/884981841 learned_addr learned my addr 172.21.15.45:0/884981841 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:15:57.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.659+0000 7fa66b7fe640 1 -- 172.21.15.45:0/884981841 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa66c0bb1d0 msgr2=0x7fa66c0c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:57.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.659+0000 7fa66b7fe640 1 --2- 172.21.15.45:0/884981841 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa66c0bb1d0 0x7fa66c0c12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:57.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.659+0000 7fa66b7fe640 1 -- 172.21.15.45:0/884981841 >> v1:172.21.15.79:6789/0 conn(0x7fa66c14f240 legacy=0x7fa66c0c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:57.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.659+0000 7fa66b7fe640 1 -- 172.21.15.45:0/884981841 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c14e740 con 0x7fa66c0c2790 2023-10-03T19:15:57.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.659+0000 7fa670bd9640 1 --2- 172.21.15.45:0/884981841 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa66c0bb1d0 0x7fa66c0c12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:15:57.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.659+0000 7fa66b7fe640 1 --2- 172.21.15.45:0/884981841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa66c0c2790 0x7fa66c1528d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa6600097a0 tx=0x7fa66001ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb9f0d0a7fa9e85c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:57.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.659+0000 7fa66affd640 1 -- 172.21.15.45:0/884981841 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6600a8950 con 0x7fa66c0c2790 2023-10-03T19:15:57.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.659+0000 7fa66affd640 1 -- 172.21.15.45:0/884981841 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6600a8ab0 con 0x7fa66c0c2790 2023-10-03T19:15:57.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.659+0000 7fa66affd640 1 -- 172.21.15.45:0/884981841 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6600a8e40 con 0x7fa66c0c2790 2023-10-03T19:15:57.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa67263c640 1 -- 172.21.15.45:0/884981841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa66c0c2790 msgr2=0x7fa66c1528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:57.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa67263c640 1 --2- 172.21.15.45:0/884981841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa66c0c2790 0x7fa66c1528d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa6600097a0 tx=0x7fa66001ec50 comp rx=0 tx=0).stop 2023-10-03T19:15:57.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa67263c640 1 -- 172.21.15.45:0/884981841 shutdown_connections 2023-10-03T19:15:57.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa67263c640 1 --2- 172.21.15.45:0/884981841 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa66c0bb1d0 0x7fa66c0c12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:57.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa67263c640 1 --2- 172.21.15.45:0/884981841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa66c0c2790 0x7fa66c1528d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:57.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa67263c640 1 -- 172.21.15.45:0/884981841 >> 172.21.15.45:0/884981841 conn(0x7fa66c0a64a0 msgr2=0x7fa66c0a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:57.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa67263c640 1 -- 172.21.15.45:0/884981841 shutdown_connections 2023-10-03T19:15:57.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa67263c640 1 -- 172.21.15.45:0/884981841 wait complete. 2023-10-03T19:15:57.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa67263c640 1 Processor -- start 2023-10-03T19:15:57.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa67263c640 1 -- start start 2023-10-03T19:15:57.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa67263c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa66c0bb1d0 0x7fa66c1e7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:57.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa67263c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa66c0c2790 0x7fa66c14b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:57.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa67263c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa66c14f240 0x7fa66c1d9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:57.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa67263c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c150d60 con 0x7fa66c0bb1d0 2023-10-03T19:15:57.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa67263c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c151bf0 con 0x7fa66c14f240 2023-10-03T19:15:57.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa67263c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c1e8080 con 0x7fa66c0c2790 2023-10-03T19:15:57.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa66bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa66c0bb1d0 0x7fa66c1e7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:57.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa66bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa66c0bb1d0 0x7fa66c1e7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48304/0 (socket says 172.21.15.45:48304) 2023-10-03T19:15:57.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa66bfff640 1 -- 172.21.15.45:0/607071040 learned_addr learned my addr 172.21.15.45:0/607071040 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:57.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa66b7fe640 1 --2- 172.21.15.45:0/607071040 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa66c0c2790 0x7fa66c14b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:57.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa670bd9640 1 --2- 172.21.15.45:0/607071040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa66c14f240 0x7fa66c1d9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:57.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa66bfff640 1 -- 172.21.15.45:0/607071040 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa66c0c2790 msgr2=0x7fa66c14b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:57.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa66bfff640 1 --2- 172.21.15.45:0/607071040 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa66c0c2790 0x7fa66c14b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:57.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa66bfff640 1 -- 172.21.15.45:0/607071040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa66c14f240 msgr2=0x7fa66c1d9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:57.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa66bfff640 1 --2- 172.21.15.45:0/607071040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa66c14f240 0x7fa66c1d9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:57.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa66bfff640 1 -- 172.21.15.45:0/607071040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa664009420 con 0x7fa66c0bb1d0 2023-10-03T19:15:57.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa66bfff640 1 --2- 172.21.15.45:0/607071040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa66c0bb1d0 0x7fa66c1e7b40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa65c00ca50 tx=0x7fa65c00cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:57.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa668ff9640 1 -- 172.21.15.45:0/607071040 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c00ab50 con 0x7fa66c0bb1d0 2023-10-03T19:15:57.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa668ff9640 1 -- 172.21.15.45:0/607071040 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65c00acb0 con 0x7fa66c0bb1d0 2023-10-03T19:15:57.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa67263c640 1 -- 172.21.15.45:0/607071040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6600093b0 con 0x7fa66c0bb1d0 2023-10-03T19:15:57.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa668ff9640 1 -- 172.21.15.45:0/607071040 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c012600 con 0x7fa66c0bb1d0 2023-10-03T19:15:57.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.663+0000 7fa67263c640 1 -- 172.21.15.45:0/607071040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa66c14f610 con 0x7fa66c0bb1d0 2023-10-03T19:15:57.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.667+0000 7fa67263c640 1 -- 172.21.15.45:0/607071040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa66c0a3f40 con 0x7fa66c0bb1d0 2023-10-03T19:15:57.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.667+0000 7fa668ff9640 1 -- 172.21.15.45:0/607071040 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa65c01b3b0 con 0x7fa66c0bb1d0 2023-10-03T19:15:57.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.667+0000 7fa668ff9640 1 --2- 172.21.15.45:0/607071040 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa6580662b0 0x7fa658068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:57.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.667+0000 7fa668ff9640 1 -- 172.21.15.45:0/607071040 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa65c083b20 con 0x7fa66c0bb1d0 2023-10-03T19:15:57.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.667+0000 7fa66b7fe640 1 --2- 172.21.15.45:0/607071040 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa6580662b0 0x7fa658068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:57.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.667+0000 7fa66b7fe640 1 --2- 172.21.15.45:0/607071040 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa6580662b0 0x7fa658068760 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa6600b2000 tx=0x7fa6600aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:57.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.671+0000 7fa668ff9640 1 -- 172.21.15.45:0/607071040 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa65c050fb0 con 0x7fa66c0bb1d0 2023-10-03T19:15:57.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.859+0000 7fa67263c640 1 -- 172.21.15.45:0/607071040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa66c0bfa90 con 0x7fa66c0bb1d0 2023-10-03T19:15:57.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.859+0000 7fa668ff9640 1 -- 172.21.15.45:0/607071040 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+3914 (secure 0 0 0) 0x7fa65c0545d0 con 0x7fa66c0bb1d0 2023-10-03T19:15:57.866 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:15:57.866 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2315858323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2315858323},{"type":"v1","addr":"172.21.15.79:6835","nonce":2315858323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1525989510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1525989510},{"type":"v1","addr":"172.21.15.45:6834","nonce":1525989510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:15:46.329993+0000","modified":"2023-10-03T19:15:49.849869+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5514":{"gid":5514,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1319730866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1319730866},{"type":"v1","addr":"172.21.15.45:6835","nonce":1319730866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-10-03T19:15:57.866 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 23 2023-10-03T19:15:57.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.863+0000 7fa67263c640 1 -- 172.21.15.45:0/607071040 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa6580662b0 msgr2=0x7fa658068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:57.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.863+0000 7fa67263c640 1 --2- 172.21.15.45:0/607071040 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa6580662b0 0x7fa658068760 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa6600b2000 tx=0x7fa6600aa070 comp rx=0 tx=0).stop 2023-10-03T19:15:57.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.863+0000 7fa67263c640 1 -- 172.21.15.45:0/607071040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa66c0bb1d0 msgr2=0x7fa66c1e7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:57.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.863+0000 7fa67263c640 1 --2- 172.21.15.45:0/607071040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa66c0bb1d0 0x7fa66c1e7b40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa65c00ca50 tx=0x7fa65c00cf10 comp rx=0 tx=0).stop 2023-10-03T19:15:57.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.863+0000 7fa67263c640 1 -- 172.21.15.45:0/607071040 shutdown_connections 2023-10-03T19:15:57.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.863+0000 7fa67263c640 1 --2- 172.21.15.45:0/607071040 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa6580662b0 0x7fa658068760 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:57.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.863+0000 7fa67263c640 1 --2- 172.21.15.45:0/607071040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa66c14f240 0x7fa66c1d9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:57.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.863+0000 7fa67263c640 1 --2- 172.21.15.45:0/607071040 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa66c0c2790 0x7fa66c14b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:57.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.863+0000 7fa67263c640 1 --2- 172.21.15.45:0/607071040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa66c0bb1d0 0x7fa66c1e7b40 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:57.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.863+0000 7fa67263c640 1 -- 172.21.15.45:0/607071040 >> 172.21.15.45:0/607071040 conn(0x7fa66c0a64a0 msgr2=0x7fa66c0a6870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:57.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.863+0000 7fa67263c640 1 -- 172.21.15.45:0/607071040 shutdown_connections 2023-10-03T19:15:57.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:57.863+0000 7fa67263c640 1 -- 172.21.15.45:0/607071040 wait complete. 2023-10-03T19:15:58.187 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-03T19:15:46.329993+0000', 'modified': '2023-10-03T19:15:49.849869+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5514}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5514': {'gid': 5514, 'name': 'a', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6835/1319730866', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6833', 'nonce': 1319730866}, {'type': 'v1', 'addr': '172.21.15.45:6835', 'nonce': 1319730866}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-03T19:15:58.188 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-03T19:15:58.188 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-03T19:15:58.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.319+0000 7fbd5adc9640 1 Processor -- start 2023-10-03T19:15:58.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.319+0000 7fbd5adc9640 1 -- start start 2023-10-03T19:15:58.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.319+0000 7fbd5adc9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd54148b90 0x7fbd540bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:58.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.319+0000 7fbd5adc9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbd540bc4a0 0x7fbd5406c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:58.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.319+0000 7fbd5adc9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd5414b610 con 0x7fbd540bcb60 2023-10-03T19:15:58.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.319+0000 7fbd5adc9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd540a3670 con 0x7fbd540bc4a0 2023-10-03T19:15:58.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.319+0000 7fbd5adc9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5414b370 con 0x7fbd54148b90 2023-10-03T19:15:58.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.319+0000 7fbd53fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbd540bcb60 0x7fbd5406c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41502/0 (socket says 172.21.15.45:41502) 2023-10-03T19:15:58.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.319+0000 7fbd53fff640 1 -- 172.21.15.45:0/3914305399 learned_addr learned my addr 172.21.15.45:0/3914305399 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:15:58.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.319+0000 7fbd59366640 1 --2- 172.21.15.45:0/3914305399 >> v2:172.21.15.79:3300/0 conn(0x7fbd540bc4a0 0x7fbd5406c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:58.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.319+0000 7fbd537fe640 1 -- 172.21.15.45:0/3914305399 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4146551012 0 0) 0x7fbd5414b610 con 0x7fbd540bcb60 2023-10-03T19:15:58.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.319+0000 7fbd58b65640 1 --2- 172.21.15.45:0/3914305399 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd54148b90 0x7fbd540bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:58.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.319+0000 7fbd537fe640 1 -- 172.21.15.45:0/3914305399 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd3c003530 con 0x7fbd540bcb60 2023-10-03T19:15:58.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.319+0000 7fbd537fe640 1 -- 172.21.15.45:0/3914305399 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1805204608 0 0) 0x7fbd3c003530 con 0x7fbd540bcb60 2023-10-03T19:15:58.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.319+0000 7fbd537fe640 1 -- 172.21.15.45:0/3914305399 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd54148b90 msgr2=0x7fbd540bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:58.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.319+0000 7fbd537fe640 1 --2- 172.21.15.45:0/3914305399 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd54148b90 0x7fbd540bbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.319+0000 7fbd537fe640 1 -- 172.21.15.45:0/3914305399 >> v2:172.21.15.79:3300/0 conn(0x7fbd540bc4a0 msgr2=0x7fbd5406c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:58.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.319+0000 7fbd537fe640 1 --2- 172.21.15.45:0/3914305399 >> v2:172.21.15.79:3300/0 conn(0x7fbd540bc4a0 0x7fbd5406c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.319+0000 7fbd537fe640 1 -- 172.21.15.45:0/3914305399 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd540a5580 con 0x7fbd540bcb60 2023-10-03T19:15:58.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.319+0000 7fbd537fe640 1 -- 172.21.15.45:0/3914305399 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fbd48001680 con 0x7fbd540bcb60 2023-10-03T19:15:58.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.319+0000 7fbd537fe640 1 -- 172.21.15.45:0/3914305399 >> v1:172.21.15.45:6789/0 conn(0x7fbd540bcb60 legacy=0x7fbd5406c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:58.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.319+0000 7fbd537fe640 1 --2- 172.21.15.45:0/3914305399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd3c003980 0x7fbd3c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:58.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.319+0000 7fbd537fe640 1 --2- 172.21.15.45:0/3914305399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd3c0043b0 0x7fbd3c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:58.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.319+0000 7fbd537fe640 1 --2- 172.21.15.45:0/3914305399 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd54148b90 0x7fbd3c004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:58.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.319+0000 7fbd537fe640 1 -- 172.21.15.45:0/3914305399 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd540a3670 con 0x7fbd3c003980 2023-10-03T19:15:58.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.319+0000 7fbd537fe640 1 -- 172.21.15.45:0/3914305399 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5414b370 con 0x7fbd3c0043b0 2023-10-03T19:15:58.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.319+0000 7fbd537fe640 1 -- 172.21.15.45:0/3914305399 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3c00b990 con 0x7fbd54148b90 2023-10-03T19:15:58.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.319+0000 7fbd58b65640 1 --2- 172.21.15.45:0/3914305399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd3c003980 0x7fbd3c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:58.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.319+0000 7fbd53fff640 1 --2- 172.21.15.45:0/3914305399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd3c0043b0 0x7fbd3c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:58.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.319+0000 7fbd59366640 1 --2- 172.21.15.45:0/3914305399 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd54148b90 0x7fbd3c004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:58.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.323+0000 7fbd58b65640 1 -- 172.21.15.45:0/3914305399 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd54148b90 msgr2=0x7fbd3c004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:58.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.323+0000 7fbd58b65640 1 --2- 172.21.15.45:0/3914305399 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd54148b90 0x7fbd3c004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.323+0000 7fbd58b65640 1 -- 172.21.15.45:0/3914305399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd3c0043b0 msgr2=0x7fbd3c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:58.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.323+0000 7fbd58b65640 1 --2- 172.21.15.45:0/3914305399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd3c0043b0 0x7fbd3c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.323+0000 7fbd58b65640 1 -- 172.21.15.45:0/3914305399 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd3c003530 con 0x7fbd3c003980 2023-10-03T19:15:58.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.323+0000 7fbd58b65640 1 --2- 172.21.15.45:0/3914305399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd3c003980 0x7fbd3c003d90 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fbd44009ae0 tx=0x7fbd4401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a20d41e3a2ff15 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:58.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.323+0000 7fbd537fe640 1 -- 172.21.15.45:0/3914305399 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd440a5640 con 0x7fbd3c003980 2023-10-03T19:15:58.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.323+0000 7fbd537fe640 1 -- 172.21.15.45:0/3914305399 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd440a57a0 con 0x7fbd3c003980 2023-10-03T19:15:58.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.323+0000 7fbd537fe640 1 -- 172.21.15.45:0/3914305399 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd440a5b50 con 0x7fbd3c003980 2023-10-03T19:15:58.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.323+0000 7fbd5adc9640 1 -- 172.21.15.45:0/3914305399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd3c003980 msgr2=0x7fbd3c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:58.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.323+0000 7fbd5adc9640 1 --2- 172.21.15.45:0/3914305399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd3c003980 0x7fbd3c003d90 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fbd44009ae0 tx=0x7fbd4401ca50 comp rx=0 tx=0).stop 2023-10-03T19:15:58.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.323+0000 7fbd59366640 1 -- 172.21.15.45:0/3914305399 reap_dead start 2023-10-03T19:15:58.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.323+0000 7fbd5adc9640 1 -- 172.21.15.45:0/3914305399 shutdown_connections 2023-10-03T19:15:58.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.323+0000 7fbd5adc9640 1 -- 172.21.15.45:0/3914305399 >> 172.21.15.45:0/3914305399 conn(0x7fbd540bcf50 msgr2=0x7fbd540bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:58.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.323+0000 7fbd5adc9640 1 -- 172.21.15.45:0/3914305399 shutdown_connections 2023-10-03T19:15:58.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.323+0000 7fbd5adc9640 1 -- 172.21.15.45:0/3914305399 wait complete. 2023-10-03T19:15:58.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.327+0000 7fbd5adc9640 1 Processor -- start 2023-10-03T19:15:58.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.327+0000 7fbd5adc9640 1 -- start start 2023-10-03T19:15:58.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.327+0000 7fbd5adc9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd3c003980 0x7fbd540be700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:58.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.327+0000 7fbd5adc9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd540b9c00 0x7fbd541e6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:58.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.327+0000 7fbd5adc9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd541e6dd0 0x7fbd54142a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:58.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.327+0000 7fbd5adc9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd54070e80 con 0x7fbd540b9c00 2023-10-03T19:15:58.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.327+0000 7fbd5adc9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd540711b0 con 0x7fbd3c003980 2023-10-03T19:15:58.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.327+0000 7fbd5adc9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd540be1e0 con 0x7fbd541e6dd0 2023-10-03T19:15:58.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.327+0000 7fbd53fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd540b9c00 0x7fbd541e6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:58.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.327+0000 7fbd53fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd540b9c00 0x7fbd541e6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48308/0 (socket says 172.21.15.45:48308) 2023-10-03T19:15:58.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.327+0000 7fbd53fff640 1 -- 172.21.15.45:0/1438690465 learned_addr learned my addr 172.21.15.45:0/1438690465 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:58.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.327+0000 7fbd58b65640 1 --2- 172.21.15.45:0/1438690465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd3c003980 0x7fbd540be700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:58.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.327+0000 7fbd59366640 1 --2- 172.21.15.45:0/1438690465 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd541e6dd0 0x7fbd54142a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:58.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.327+0000 7fbd53fff640 1 -- 172.21.15.45:0/1438690465 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd541e6dd0 msgr2=0x7fbd54142a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:58.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.327+0000 7fbd53fff640 1 --2- 172.21.15.45:0/1438690465 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd541e6dd0 0x7fbd54142a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.327+0000 7fbd53fff640 1 -- 172.21.15.45:0/1438690465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd3c003980 msgr2=0x7fbd540be700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:58.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.327+0000 7fbd53fff640 1 --2- 172.21.15.45:0/1438690465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd3c003980 0x7fbd540be700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.327+0000 7fbd53fff640 1 -- 172.21.15.45:0/1438690465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd5406cee0 con 0x7fbd540b9c00 2023-10-03T19:15:58.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.327+0000 7fbd53fff640 1 --2- 172.21.15.45:0/1438690465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd540b9c00 0x7fbd541e6890 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fbd48000c10 tx=0x7fbd48012980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:58.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.327+0000 7fbd517fa640 1 -- 172.21.15.45:0/1438690465 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd48014810 con 0x7fbd540b9c00 2023-10-03T19:15:58.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.327+0000 7fbd517fa640 1 -- 172.21.15.45:0/1438690465 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd48014970 con 0x7fbd540b9c00 2023-10-03T19:15:58.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.327+0000 7fbd517fa640 1 -- 172.21.15.45:0/1438690465 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd48014d20 con 0x7fbd540b9c00 2023-10-03T19:15:58.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.327+0000 7fbd5adc9640 1 -- 172.21.15.45:0/1438690465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd540a5820 con 0x7fbd540b9c00 2023-10-03T19:15:58.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.327+0000 7fbd5adc9640 1 -- 172.21.15.45:0/1438690465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd54148f60 con 0x7fbd540b9c00 2023-10-03T19:15:58.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.327+0000 7fbd517fa640 1 -- 172.21.15.45:0/1438690465 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbd480153e0 con 0x7fbd540b9c00 2023-10-03T19:15:58.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.327+0000 7fbd517fa640 1 --2- 172.21.15.45:0/1438690465 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbd400662b0 0x7fbd40068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:58.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd517fa640 1 -- 172.21.15.45:0/1438690465 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbd48086620 con 0x7fbd540b9c00 2023-10-03T19:15:58.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd58b65640 1 --2- 172.21.15.45:0/1438690465 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbd400662b0 0x7fbd40068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:58.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd5deed000 1 Processor -- start 2023-10-03T19:15:58.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd5deed000 1 -- start start 2023-10-03T19:15:58.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd58b65640 1 --2- 172.21.15.45:0/1438690465 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbd400662b0 0x7fbd40068760 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbd440af000 tx=0x7fbd440046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:58.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd5deed000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c0c9d6a6f0 0x55c0c9d61ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:58.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd5deed000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0c9d62020 0x55c0c9d623f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:58.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd5deed000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c0c9d62930 0x55c0c9d62d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:58.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd5deed000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0c9c2c310 con 0x55c0c9d62930 2023-10-03T19:15:58.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd5deed000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0c9b66980 con 0x55c0c9d62020 2023-10-03T19:15:58.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd5deed000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c0c9bba040 con 0x55c0c9d6a6f0 2023-10-03T19:15:58.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd59366640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c0c9d62930 0x55c0c9d62d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:58.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd59366640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c0c9d62930 0x55c0c9d62d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48316/0 (socket says 172.21.15.45:48316) 2023-10-03T19:15:58.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd59366640 1 -- 172.21.15.45:0/1421885246 learned_addr learned my addr 172.21.15.45:0/1421885246 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:58.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd53fff640 1 --2- 172.21.15.45:0/1421885246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0c9d62020 0x55c0c9d623f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:58.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd58b65640 1 --2- 172.21.15.45:0/1421885246 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c0c9d6a6f0 0x55c0c9d61ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:58.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd59366640 1 -- 172.21.15.45:0/1421885246 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c0c9d6a6f0 msgr2=0x55c0c9d61ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:58.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd59366640 1 --2- 172.21.15.45:0/1421885246 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c0c9d6a6f0 0x55c0c9d61ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd59366640 1 -- 172.21.15.45:0/1421885246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0c9d62020 msgr2=0x55c0c9d623f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:58.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd59366640 1 --2- 172.21.15.45:0/1421885246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0c9d62020 0x55c0c9d623f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd59366640 1 -- 172.21.15.45:0/1421885246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0c9b780b0 con 0x55c0c9d62930 2023-10-03T19:15:58.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd59366640 1 --2- 172.21.15.45:0/1421885246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c0c9d62930 0x55c0c9d62d00 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fbd540bc970 tx=0x7fbd4c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d4a5ac9640e972 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:58.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd3a7fc640 1 -- 172.21.15.45:0/1421885246 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c00e040 con 0x55c0c9d62930 2023-10-03T19:15:58.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd3a7fc640 1 -- 172.21.15.45:0/1421885246 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4c003ba0 con 0x55c0c9d62930 2023-10-03T19:15:58.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd3a7fc640 1 -- 172.21.15.45:0/1421885246 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c012850 con 0x55c0c9d62930 2023-10-03T19:15:58.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd5deed000 1 -- 172.21.15.45:0/1421885246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c0c9d62930 msgr2=0x55c0c9d62d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:58.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd5deed000 1 --2- 172.21.15.45:0/1421885246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c0c9d62930 0x55c0c9d62d00 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fbd540bc970 tx=0x7fbd4c009750 comp rx=0 tx=0).stop 2023-10-03T19:15:58.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd5deed000 1 -- 172.21.15.45:0/1421885246 shutdown_connections 2023-10-03T19:15:58.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd5deed000 1 --2- 172.21.15.45:0/1421885246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c0c9d62930 0x55c0c9d62d00 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd5deed000 1 --2- 172.21.15.45:0/1421885246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0c9d62020 0x55c0c9d623f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd5deed000 1 --2- 172.21.15.45:0/1421885246 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c0c9d6a6f0 0x55c0c9d61ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd5deed000 1 -- 172.21.15.45:0/1421885246 >> 172.21.15.45:0/1421885246 conn(0x55c0c9d9c220 msgr2=0x55c0c9d9e600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:58.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd5deed000 1 -- 172.21.15.45:0/1421885246 shutdown_connections 2023-10-03T19:15:58.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd5deed000 1 -- 172.21.15.45:0/1421885246 wait complete. 2023-10-03T19:15:58.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd5deed000 1 -- start start 2023-10-03T19:15:58.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.331+0000 7fbd5deed000 1 Processor -- start 2023-10-03T19:15:58.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd5deed000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c0c9d62020 0x55c0c9d9b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:58.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd5deed000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c0c9d62930 0x55c0c9d9b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:58.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd5deed000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0c9d6a6f0 0x55c0c9da56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:58.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd5deed000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0c9bb30e0 con 0x55c0c9d62020 2023-10-03T19:15:58.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd5deed000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0c9b6fbd0 con 0x55c0c9d6a6f0 2023-10-03T19:15:58.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd5deed000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c0c9b6f870 con 0x55c0c9d62930 2023-10-03T19:15:58.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd5deed000 10 client.0 _ll_register_callbacks cb 0x55c0c9d4fc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T19:15:58.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd58b65640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c0c9d62020 0x55c0c9d9b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:58.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd58b65640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c0c9d62020 0x55c0c9d9b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48332/0 (socket says 172.21.15.45:48332) 2023-10-03T19:15:58.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd58b65640 1 -- 172.21.15.45:0/2494040517 learned_addr learned my addr 172.21.15.45:0/2494040517 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:58.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd59366640 1 --2- 172.21.15.45:0/2494040517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0c9d6a6f0 0x55c0c9da56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:58.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd53fff640 1 --2- 172.21.15.45:0/2494040517 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c0c9d62930 0x55c0c9d9b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:58.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd58b65640 1 -- 172.21.15.45:0/2494040517 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c0c9d62930 msgr2=0x55c0c9d9b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:58.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd58b65640 1 --2- 172.21.15.45:0/2494040517 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c0c9d62930 0x55c0c9d9b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd58b65640 1 -- 172.21.15.45:0/2494040517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0c9d6a6f0 msgr2=0x55c0c9da56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:58.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd58b65640 1 --2- 172.21.15.45:0/2494040517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0c9d6a6f0 0x55c0c9da56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd58b65640 1 -- 172.21.15.45:0/2494040517 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4c009ce0 con 0x55c0c9d62020 2023-10-03T19:15:58.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd53fff640 1 --2- 172.21.15.45:0/2494040517 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c0c9d62930 0x55c0c9d9b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:15:58.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd58b65640 1 --2- 172.21.15.45:0/2494040517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c0c9d62020 0x55c0c9d9b3b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fbd4401c880 tx=0x7fbd440197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a813f5d34c92c196 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:58.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd337fe640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-10-03T19:15:58.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd337fe640 1 -- 172.21.15.45:0/2494040517 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd44003820 con 0x55c0c9d62020 2023-10-03T19:15:58.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd337fe640 1 -- 172.21.15.45:0/2494040517 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbd4400f080 con 0x55c0c9d62020 2023-10-03T19:15:58.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd5deed000 1 -- 172.21.15.45:0/2494040517 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c0c9bae8b0 con 0x55c0c9d62020 2023-10-03T19:15:58.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd337fe640 1 -- 172.21.15.45:0/2494040517 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd44003980 con 0x55c0c9d62020 2023-10-03T19:15:58.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd5deed000 10 client.5676 fetch_fsmap learned FSMap version 23 2023-10-03T19:15:58.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd5deed000 1 -- 172.21.15.45:0/2494040517 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x55c0c98af890 con 0x55c0c9d62020 2023-10-03T19:15:58.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd337fe640 1 -- 172.21.15.45:0/2494040517 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c0c9bae8b0 con 0x55c0c9d62020 2023-10-03T19:15:58.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd337fe640 1 -- 172.21.15.45:0/2494040517 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 23) v1 ==== 2569+0+0 (secure 0 0 0) 0x7fbd440c0070 con 0x55c0c9d62020 2023-10-03T19:15:58.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd5deed000 10 client.5676 fetch_fsmap finished waiting for FSMap version 23 2023-10-03T19:15:58.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd5deed000 10 client.5676 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T19:15:58.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd5deed000 20 client.5676 populate_metadata read hostname 'smithi045' 2023-10-03T19:15:58.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd5deed000 1 --2- 172.21.15.45:0/2494040517 >> [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] conn(0x55c0c9da60e0 0x55c0c9da64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:58.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd5deed000 4 client.5676 mds_command: new command op to 5514 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-03T19:15:58.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd5deed000 1 -- 172.21.15.45:0/2494040517 --> [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c0c9be1f70 con 0x55c0c9da60e0 2023-10-03T19:15:58.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd53fff640 1 --2- 172.21.15.45:0/2494040517 >> [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] conn(0x55c0c9da60e0 0x55c0c9da64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:58.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd53fff640 1 --2- 172.21.15.45:0/2494040517 >> [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] conn(0x55c0c9da60e0 0x55c0c9da64b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6a2037652a04ee server_cookie=ac62dc64eb5e2236 in_seq=0 out_seq=0 2023-10-03T19:15:58.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd337fe640 10 client.5676 ms_handle_connect on v2:172.21.15.45:6833/1319730866 2023-10-03T19:15:58.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd337fe640 1 -- 172.21.15.45:0/2494040517 <== mds.0 v2:172.21.15.45:6833/1319730866 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c0c9be1f70 con 0x55c0c9da60e0 2023-10-03T19:15:58.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd337fe640 10 client.5676 handle_command_reply: tid=0 2023-10-03T19:15:58.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd5deed000 1 client.5676 shutdown 2023-10-03T19:15:58.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd5deed000 1 -- 172.21.15.45:0/2494040517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c0c9d62020 msgr2=0x55c0c9d9b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:58.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd5deed000 1 --2- 172.21.15.45:0/2494040517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c0c9d62020 0x55c0c9d9b3b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fbd4401c880 tx=0x7fbd440197f0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd5deed000 1 -- 172.21.15.45:0/2494040517 shutdown_connections 2023-10-03T19:15:58.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd5deed000 1 --2- 172.21.15.45:0/2494040517 >> [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] conn(0x55c0c9da60e0 0x55c0c9da64b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd5deed000 1 --2- 172.21.15.45:0/2494040517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0c9d6a6f0 0x55c0c9da56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd5deed000 1 --2- 172.21.15.45:0/2494040517 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c0c9d62930 0x55c0c9d9b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd5deed000 1 --2- 172.21.15.45:0/2494040517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c0c9d62020 0x55c0c9d9b3b0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd5deed000 1 -- 172.21.15.45:0/2494040517 >> 172.21.15.45:0/2494040517 conn(0x55c0c9d9c220 msgr2=0x55c0c9d9e600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:58.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd337fe640 0 client.5676 ms_handle_reset on v2:172.21.15.45:6833/1319730866 2023-10-03T19:15:58.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd5deed000 1 -- 172.21.15.45:0/2494040517 shutdown_connections 2023-10-03T19:15:58.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd5deed000 1 -- 172.21.15.45:0/2494040517 wait complete. 2023-10-03T19:15:58.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.335+0000 7fbd5deed000 20 client.5676 trim_cache size 0 max 16384 2023-10-03T19:15:58.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.351+0000 7fbd5deed000 1 Processor -- start 2023-10-03T19:15:58.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.351+0000 7fbd5deed000 1 -- start start 2023-10-03T19:15:58.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.351+0000 7fbd5deed000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0c9d62020 0x55c0c9db6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:58.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.351+0000 7fbd5deed000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c0c9d62930 0x55c0c9db3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:58.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.351+0000 7fbd5deed000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c0c9d6a6f0 0x55c0c9db41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:58.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.351+0000 7fbd5deed000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0c9870940 con 0x55c0c9d62930 2023-10-03T19:15:58.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.351+0000 7fbd5deed000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0c9bb04e0 con 0x55c0c9d62020 2023-10-03T19:15:58.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.351+0000 7fbd5deed000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c0c9c7d700 con 0x55c0c9d6a6f0 2023-10-03T19:15:58.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.351+0000 7fbd53fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c0c9d62930 0x55c0c9db3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:58.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.351+0000 7fbd53fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c0c9d62930 0x55c0c9db3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48342/0 (socket says 172.21.15.45:48342) 2023-10-03T19:15:58.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.351+0000 7fbd53fff640 1 -- 172.21.15.45:0/3992599512 learned_addr learned my addr 172.21.15.45:0/3992599512 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:58.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd58b65640 1 --2- 172.21.15.45:0/3992599512 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0c9d62020 0x55c0c9db6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:58.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd53fff640 1 -- 172.21.15.45:0/3992599512 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c0c9d6a6f0 msgr2=0x55c0c9db41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:58.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd53fff640 1 --2- 172.21.15.45:0/3992599512 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c0c9d6a6f0 0x55c0c9db41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd53fff640 1 -- 172.21.15.45:0/3992599512 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0c9d62020 msgr2=0x55c0c9db6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:58.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd53fff640 1 --2- 172.21.15.45:0/3992599512 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0c9d62020 0x55c0c9db6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd53fff640 1 -- 172.21.15.45:0/3992599512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0c9b78360 con 0x55c0c9d62930 2023-10-03T19:15:58.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd53fff640 1 --2- 172.21.15.45:0/3992599512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c0c9d62930 0x55c0c9db3c60 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fbd48005890 tx=0x7fbd48000ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f37409f6c1648e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:58.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd3affd640 1 -- 172.21.15.45:0/3992599512 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd48084a60 con 0x55c0c9d62930 2023-10-03T19:15:58.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd3affd640 1 -- 172.21.15.45:0/3992599512 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd48055af0 con 0x55c0c9d62930 2023-10-03T19:15:58.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd3affd640 1 -- 172.21.15.45:0/3992599512 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd48058b40 con 0x55c0c9d62930 2023-10-03T19:15:58.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd5deed000 1 -- 172.21.15.45:0/3992599512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c0c9d62930 msgr2=0x55c0c9db3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:58.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd5deed000 1 --2- 172.21.15.45:0/3992599512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c0c9d62930 0x55c0c9db3c60 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fbd48005890 tx=0x7fbd48000ff0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd5deed000 1 -- 172.21.15.45:0/3992599512 shutdown_connections 2023-10-03T19:15:58.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd5deed000 1 --2- 172.21.15.45:0/3992599512 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c0c9d6a6f0 0x55c0c9db41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd5deed000 1 --2- 172.21.15.45:0/3992599512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c0c9d62930 0x55c0c9db3c60 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd5deed000 1 --2- 172.21.15.45:0/3992599512 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0c9d62020 0x55c0c9db6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd5deed000 1 -- 172.21.15.45:0/3992599512 >> 172.21.15.45:0/3992599512 conn(0x55c0c9d9c220 msgr2=0x55c0c9d60af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:58.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd5deed000 1 -- 172.21.15.45:0/3992599512 shutdown_connections 2023-10-03T19:15:58.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd5deed000 1 -- 172.21.15.45:0/3992599512 wait complete. 2023-10-03T19:15:58.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd5deed000 1 -- start start 2023-10-03T19:15:58.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd5deed000 1 Processor -- start 2023-10-03T19:15:58.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd5deed000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0c9d62020 0x55c0c9dfc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:58.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd5deed000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c0c9d62930 0x55c0c9dfcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:58.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd5deed000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c0c9d6a6f0 0x55c0c9dfd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:58.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd5deed000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0c9bbb2d0 con 0x55c0c9d6a6f0 2023-10-03T19:15:58.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd5deed000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0c9c4eec0 con 0x55c0c9d62020 2023-10-03T19:15:58.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd5deed000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c0c9da58d0 con 0x55c0c9d62930 2023-10-03T19:15:58.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd5deed000 10 client.0 _ll_register_callbacks cb 0x55c0c9bb5260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T19:15:58.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd59366640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c0c9d6a6f0 0x55c0c9dfd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:58.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd59366640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c0c9d6a6f0 0x55c0c9dfd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48354/0 (socket says 172.21.15.45:48354) 2023-10-03T19:15:58.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd59366640 1 -- 172.21.15.45:0/2323615802 learned_addr learned my addr 172.21.15.45:0/2323615802 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:58.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd58b65640 1 --2- 172.21.15.45:0/2323615802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0c9d62020 0x55c0c9dfc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:58.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd53fff640 1 --2- 172.21.15.45:0/2323615802 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c0c9d62930 0x55c0c9dfcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:58.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd59366640 1 -- 172.21.15.45:0/2323615802 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c0c9d62930 msgr2=0x55c0c9dfcaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:58.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd59366640 1 --2- 172.21.15.45:0/2323615802 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c0c9d62930 0x55c0c9dfcaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd59366640 1 -- 172.21.15.45:0/2323615802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0c9d62020 msgr2=0x55c0c9dfc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:58.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd59366640 1 --2- 172.21.15.45:0/2323615802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0c9d62020 0x55c0c9dfc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd59366640 1 -- 172.21.15.45:0/2323615802 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd54148f60 con 0x55c0c9d6a6f0 2023-10-03T19:15:58.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd58b65640 1 --2- 172.21.15.45:0/2323615802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0c9d62020 0x55c0c9dfc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:15:58.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd59366640 1 --2- 172.21.15.45:0/2323615802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c0c9d6a6f0 0x55c0c9dfd030 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x55c0c9b7e3e0 tx=0x7fbd4c004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae73c9d5adcddbf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:58.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd337fe640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-10-03T19:15:58.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd337fe640 1 -- 172.21.15.45:0/2323615802 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c023040 con 0x55c0c9d6a6f0 2023-10-03T19:15:58.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd337fe640 1 -- 172.21.15.45:0/2323615802 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbd4c016650 con 0x55c0c9d6a6f0 2023-10-03T19:15:58.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd5deed000 1 -- 172.21.15.45:0/2323615802 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbd4c003ba0 con 0x55c0c9d6a6f0 2023-10-03T19:15:58.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd337fe640 1 -- 172.21.15.45:0/2323615802 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd4c00e040 con 0x55c0c9d6a6f0 2023-10-03T19:15:58.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd5deed000 10 client.5682 fetch_fsmap learned FSMap version 23 2023-10-03T19:15:58.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd5deed000 1 -- 172.21.15.45:0/2323615802 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x55c0c9b5dbe0 con 0x55c0c9d6a6f0 2023-10-03T19:15:58.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd337fe640 1 -- 172.21.15.45:0/2323615802 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4c003ba0 con 0x55c0c9d6a6f0 2023-10-03T19:15:58.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd337fe640 1 -- 172.21.15.45:0/2323615802 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 23) v1 ==== 2569+0+0 (secure 0 0 0) 0x7fbd4c014040 con 0x55c0c9d6a6f0 2023-10-03T19:15:58.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd5deed000 10 client.5682 fetch_fsmap finished waiting for FSMap version 23 2023-10-03T19:15:58.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd5deed000 10 client.5682 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T19:15:58.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd5deed000 20 client.5682 populate_metadata read hostname 'smithi045' 2023-10-03T19:15:58.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd5deed000 1 --2- 172.21.15.45:0/2323615802 >> [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] conn(0x55c0c9dfeb80 0x55c0c9dfef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:58.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd5deed000 4 client.5682 mds_command: new command op to 5514 tid=0[{"prefix": "status"}] 2023-10-03T19:15:58.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.355+0000 7fbd5deed000 1 -- 172.21.15.45:0/2323615802 --> [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c0c9bac0c0 con 0x55c0c9dfeb80 2023-10-03T19:15:58.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.359+0000 7fbd58b65640 1 --2- 172.21.15.45:0/2323615802 >> [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] conn(0x55c0c9dfeb80 0x55c0c9dfef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:58.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.359+0000 7fbd58b65640 1 --2- 172.21.15.45:0/2323615802 >> [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] conn(0x55c0c9dfeb80 0x55c0c9dfef50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dc8ff20b6a86537 server_cookie=7d33e46d3ee5d8d3 in_seq=0 out_seq=0 2023-10-03T19:15:58.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.359+0000 7fbd337fe640 10 client.5682 ms_handle_connect on v2:172.21.15.45:6833/1319730866 2023-10-03T19:15:58.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.359+0000 7fbd337fe640 1 -- 172.21.15.45:0/2323615802 <== mds.0 v2:172.21.15.45:6833/1319730866 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x55c0c9bac0c0 con 0x55c0c9dfeb80 2023-10-03T19:15:58.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.359+0000 7fbd337fe640 10 client.5682 handle_command_reply: tid=0 2023-10-03T19:15:58.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.359+0000 7fbd5deed000 1 client.5682 shutdown 2023-10-03T19:15:58.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.359+0000 7fbd5deed000 1 -- 172.21.15.45:0/2323615802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c0c9d6a6f0 msgr2=0x55c0c9dfd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:58.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.359+0000 7fbd5deed000 1 --2- 172.21.15.45:0/2323615802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c0c9d6a6f0 0x55c0c9dfd030 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x55c0c9b7e3e0 tx=0x7fbd4c004a50 comp rx=0 tx=0).stop 2023-10-03T19:15:58.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.359+0000 7fbd5deed000 1 -- 172.21.15.45:0/2323615802 shutdown_connections 2023-10-03T19:15:58.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.359+0000 7fbd5deed000 1 --2- 172.21.15.45:0/2323615802 >> [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] conn(0x55c0c9dfeb80 0x55c0c9dfef50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.359+0000 7fbd5deed000 1 --2- 172.21.15.45:0/2323615802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c0c9d6a6f0 0x55c0c9dfd030 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.359+0000 7fbd5deed000 1 --2- 172.21.15.45:0/2323615802 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c0c9d62930 0x55c0c9dfcaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.359+0000 7fbd337fe640 0 client.5682 ms_handle_reset on v2:172.21.15.45:6833/1319730866 2023-10-03T19:15:58.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.359+0000 7fbd5deed000 1 --2- 172.21.15.45:0/2323615802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c0c9d62020 0x55c0c9dfc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.359+0000 7fbd5deed000 1 -- 172.21.15.45:0/2323615802 >> 172.21.15.45:0/2323615802 conn(0x55c0c9d9c220 msgr2=0x55c0c9d60af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:58.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.359+0000 7fbd5deed000 1 -- 172.21.15.45:0/2323615802 shutdown_connections 2023-10-03T19:15:58.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.359+0000 7fbd5deed000 1 -- 172.21.15.45:0/2323615802 wait complete. 2023-10-03T19:15:58.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.359+0000 7fbd5deed000 20 client.5682 trim_cache size 0 max 16384 2023-10-03T19:15:58.371 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-03T19:15:58.371 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "58400977-12ba-4c73-bb3e-1589b2492669", 2023-10-03T19:15:58.371 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-10-03T19:15:58.371 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 5514, 2023-10-03T19:15:58.371 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-10-03T19:15:58.371 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-10-03T19:15:58.371 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-10-03T19:15:58.371 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 12.029907364, 2023-10-03T19:15:58.371 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 23, 2023-10-03T19:15:58.372 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 48, 2023-10-03T19:15:58.372 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 48, 2023-10-03T19:15:58.372 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 19.608021375 2023-10-03T19:15:58.372 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-03T19:15:58.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.359+0000 7fbd5adc9640 1 -- 172.21.15.45:0/1438690465 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbd400662b0 msgr2=0x7fbd40068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:58.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.359+0000 7fbd5adc9640 1 --2- 172.21.15.45:0/1438690465 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbd400662b0 0x7fbd40068760 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbd440af000 tx=0x7fbd440046d0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.359+0000 7fbd5adc9640 1 -- 172.21.15.45:0/1438690465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd540b9c00 msgr2=0x7fbd541e6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:58.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.359+0000 7fbd5adc9640 1 --2- 172.21.15.45:0/1438690465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd540b9c00 0x7fbd541e6890 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fbd48000c10 tx=0x7fbd48012980 comp rx=0 tx=0).stop 2023-10-03T19:15:58.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.359+0000 7fbd5adc9640 1 -- 172.21.15.45:0/1438690465 shutdown_connections 2023-10-03T19:15:58.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.359+0000 7fbd5adc9640 1 --2- 172.21.15.45:0/1438690465 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbd400662b0 0x7fbd40068760 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.359+0000 7fbd5adc9640 1 --2- 172.21.15.45:0/1438690465 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd541e6dd0 0x7fbd54142a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.359+0000 7fbd5adc9640 1 --2- 172.21.15.45:0/1438690465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd540b9c00 0x7fbd541e6890 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.359+0000 7fbd5adc9640 1 --2- 172.21.15.45:0/1438690465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd3c003980 0x7fbd540be700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.359+0000 7fbd5adc9640 1 -- 172.21.15.45:0/1438690465 >> 172.21.15.45:0/1438690465 conn(0x7fbd540bcf50 msgr2=0x7fbd541497c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:58.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.359+0000 7fbd5adc9640 1 -- 172.21.15.45:0/1438690465 shutdown_connections 2023-10-03T19:15:58.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.359+0000 7fbd5adc9640 1 -- 172.21.15.45:0/1438690465 wait complete. 2023-10-03T19:15:58.381 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-03T19:15:58.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.491+0000 7fa9070f0640 1 Processor -- start 2023-10-03T19:15:58.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.491+0000 7fa9070f0640 1 -- start start 2023-10-03T19:15:58.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.491+0000 7fa9070f0640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa9000b98f0 0x7fa9000b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:58.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.491+0000 7fa9070f0640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa9000bc810 0x7fa90006c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:58.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.491+0000 7fa9070f0640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9000ba550 con 0x7fa9000a2e20 2023-10-03T19:15:58.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.491+0000 7fa9070f0640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9001526d0 con 0x7fa9000bc810 2023-10-03T19:15:58.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.491+0000 7fa9070f0640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9001529b0 con 0x7fa9000b98f0 2023-10-03T19:15:58.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.491+0000 7fa90568d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa9000a2e20 0x7fa90006c7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41516/0 (socket says 172.21.15.45:41516) 2023-10-03T19:15:58.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.491+0000 7fa8fffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa9000bc810 0x7fa90006c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:58.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.491+0000 7fa90568d640 1 -- 172.21.15.45:0/2372684921 learned_addr learned my addr 172.21.15.45:0/2372684921 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:15:58.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.491+0000 7fa904e8c640 1 --2- 172.21.15.45:0/2372684921 >> v2:172.21.15.79:3300/0 conn(0x7fa9000b98f0 0x7fa9000b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:58.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.491+0000 7fa8ff7fe640 1 -- 172.21.15.45:0/2372684921 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4110961014 0 0) 0x7fa9000ba550 con 0x7fa9000a2e20 2023-10-03T19:15:58.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.491+0000 7fa8ff7fe640 1 -- 172.21.15.45:0/2372684921 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8f0003530 con 0x7fa9000a2e20 2023-10-03T19:15:58.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.491+0000 7fa8fffff640 1 -- 172.21.15.45:0/2372684921 >> v2:172.21.15.79:3300/0 conn(0x7fa9000b98f0 msgr2=0x7fa9000b9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:15:58.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.491+0000 7fa8fffff640 1 --2- 172.21.15.45:0/2372684921 >> v2:172.21.15.79:3300/0 conn(0x7fa9000b98f0 0x7fa9000b9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.491+0000 7fa8fffff640 1 -- 172.21.15.45:0/2372684921 >> v1:172.21.15.45:6789/0 conn(0x7fa9000a2e20 legacy=0x7fa90006c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:58.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.491+0000 7fa8fffff640 1 -- 172.21.15.45:0/2372684921 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa90006cee0 con 0x7fa9000bc810 2023-10-03T19:15:58.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.491+0000 7fa904e8c640 1 --2- 172.21.15.45:0/2372684921 >> v2:172.21.15.79:3300/0 conn(0x7fa9000b98f0 0x7fa9000b9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:15:58.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.495+0000 7fa8fffff640 1 --2- 172.21.15.45:0/2372684921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9000bc810 0x7fa90006c290 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa9000bad20 tx=0x7fa8f401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddfa4243ba4367d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:58.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.495+0000 7fa8ff7fe640 1 -- 172.21.15.45:0/2372684921 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f40a8950 con 0x7fa9000bc810 2023-10-03T19:15:58.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.495+0000 7fa8ff7fe640 1 -- 172.21.15.45:0/2372684921 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f40a8ab0 con 0x7fa9000bc810 2023-10-03T19:15:58.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.495+0000 7fa8ff7fe640 1 -- 172.21.15.45:0/2372684921 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f40a8e40 con 0x7fa9000bc810 2023-10-03T19:15:58.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.495+0000 7fa9070f0640 1 -- 172.21.15.45:0/2372684921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9000bc810 msgr2=0x7fa90006c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:58.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.495+0000 7fa9070f0640 1 --2- 172.21.15.45:0/2372684921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9000bc810 0x7fa90006c290 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa9000bad20 tx=0x7fa8f401ec50 comp rx=0 tx=0).stop 2023-10-03T19:15:58.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.495+0000 7fa9070f0640 1 -- 172.21.15.45:0/2372684921 shutdown_connections 2023-10-03T19:15:58.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.495+0000 7fa9070f0640 1 --2- 172.21.15.45:0/2372684921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9000bc810 0x7fa90006c290 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.495+0000 7fa9070f0640 1 --2- 172.21.15.45:0/2372684921 >> v2:172.21.15.79:3300/0 conn(0x7fa9000b98f0 0x7fa9000b9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.495+0000 7fa9070f0640 1 -- 172.21.15.45:0/2372684921 >> 172.21.15.45:0/2372684921 conn(0x7fa9000bcf50 msgr2=0x7fa9000bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:58.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.495+0000 7fa9070f0640 1 -- 172.21.15.45:0/2372684921 shutdown_connections 2023-10-03T19:15:58.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.495+0000 7fa9070f0640 1 -- 172.21.15.45:0/2372684921 wait complete. 2023-10-03T19:15:58.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.495+0000 7fa9070f0640 1 Processor -- start 2023-10-03T19:15:58.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.495+0000 7fa9070f0640 1 -- start start 2023-10-03T19:15:58.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.499+0000 7fa9070f0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9000a2e20 0x7fa90014a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:58.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.499+0000 7fa9070f0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9000b98f0 0x7fa900141240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:58.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.499+0000 7fa9070f0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa9000bc810 0x7fa9001e37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:58.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.499+0000 7fa9070f0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa900143d90 con 0x7fa9000a2e20 2023-10-03T19:15:58.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.499+0000 7fa9070f0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9001435d0 con 0x7fa9000b98f0 2023-10-03T19:15:58.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.499+0000 7fa9070f0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9001e78a0 con 0x7fa9000bc810 2023-10-03T19:15:58.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.499+0000 7fa904e8c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9000a2e20 0x7fa90014a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:58.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.499+0000 7fa904e8c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9000a2e20 0x7fa90014a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48374/0 (socket says 172.21.15.45:48374) 2023-10-03T19:15:58.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.499+0000 7fa904e8c640 1 -- 172.21.15.45:0/3625577993 learned_addr learned my addr 172.21.15.45:0/3625577993 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:15:58.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.499+0000 7fa8fffff640 1 --2- 172.21.15.45:0/3625577993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9000b98f0 0x7fa900141240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:58.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.499+0000 7fa90568d640 1 --2- 172.21.15.45:0/3625577993 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa9000bc810 0x7fa9001e37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:58.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.499+0000 7fa904e8c640 1 -- 172.21.15.45:0/3625577993 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa9000bc810 msgr2=0x7fa9001e37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:58.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.499+0000 7fa904e8c640 1 --2- 172.21.15.45:0/3625577993 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa9000bc810 0x7fa9001e37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.499+0000 7fa904e8c640 1 -- 172.21.15.45:0/3625577993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9000b98f0 msgr2=0x7fa900141240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:58.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.499+0000 7fa904e8c640 1 --2- 172.21.15.45:0/3625577993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9000b98f0 0x7fa900141240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.499+0000 7fa904e8c640 1 -- 172.21.15.45:0/3625577993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f4009420 con 0x7fa9000a2e20 2023-10-03T19:15:58.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.499+0000 7fa904e8c640 1 --2- 172.21.15.45:0/3625577993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9000a2e20 0x7fa90014a530 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec00e810 tx=0x7fa8ec00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:58.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.499+0000 7fa8fd7fa640 1 -- 172.21.15.45:0/3625577993 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec00c8d0 con 0x7fa9000a2e20 2023-10-03T19:15:58.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.499+0000 7fa8fd7fa640 1 -- 172.21.15.45:0/3625577993 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ec00ca30 con 0x7fa9000a2e20 2023-10-03T19:15:58.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.499+0000 7fa9070f0640 1 -- 172.21.15.45:0/3625577993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9000ba950 con 0x7fa9000a2e20 2023-10-03T19:15:58.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.499+0000 7fa8fd7fa640 1 -- 172.21.15.45:0/3625577993 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec00cde0 con 0x7fa9000a2e20 2023-10-03T19:15:58.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.499+0000 7fa9070f0640 1 -- 172.21.15.45:0/3625577993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9000ba200 con 0x7fa9000a2e20 2023-10-03T19:15:58.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.499+0000 7fa9070f0640 1 -- 172.21.15.45:0/3625577993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9000baae0 con 0x7fa9000a2e20 2023-10-03T19:15:58.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.499+0000 7fa8fd7fa640 1 -- 172.21.15.45:0/3625577993 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa8ec013410 con 0x7fa9000a2e20 2023-10-03T19:15:58.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.499+0000 7fa8fd7fa640 1 --2- 172.21.15.45:0/3625577993 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa8e4066280 0x7fa8e4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:15:58.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.499+0000 7fa8fd7fa640 1 -- 172.21.15.45:0/3625577993 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa8ec083c40 con 0x7fa9000a2e20 2023-10-03T19:15:58.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.503+0000 7fa8fffff640 1 --2- 172.21.15.45:0/3625577993 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa8e4066280 0x7fa8e4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:15:58.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.503+0000 7fa8fffff640 1 --2- 172.21.15.45:0/3625577993 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa8e4066280 0x7fa8e4068730 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40b2000 tx=0x7fa8f40aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:15:58.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.503+0000 7fa8fd7fa640 1 -- 172.21.15.45:0/3625577993 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa8ec051030 con 0x7fa9000a2e20 2023-10-03T19:15:58.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.687+0000 7fa9070f0640 1 -- 172.21.15.45:0/3625577993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa90004de80 con 0x7fa9000a2e20 2023-10-03T19:15:58.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.687+0000 7fa8fd7fa640 1 -- 172.21.15.45:0/3625577993 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa8ec021070 con 0x7fa9000a2e20 2023-10-03T19:15:58.694 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-03T19:15:58.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.691+0000 7fa9070f0640 1 -- 172.21.15.45:0/3625577993 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa8e4066280 msgr2=0x7fa8e4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:58.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.691+0000 7fa9070f0640 1 --2- 172.21.15.45:0/3625577993 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa8e4066280 0x7fa8e4068730 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40b2000 tx=0x7fa8f40aa070 comp rx=0 tx=0).stop 2023-10-03T19:15:58.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.691+0000 7fa9070f0640 1 -- 172.21.15.45:0/3625577993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9000a2e20 msgr2=0x7fa90014a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:15:58.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.691+0000 7fa9070f0640 1 --2- 172.21.15.45:0/3625577993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9000a2e20 0x7fa90014a530 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec00e810 tx=0x7fa8ec00ecd0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.691+0000 7fa9070f0640 1 -- 172.21.15.45:0/3625577993 shutdown_connections 2023-10-03T19:15:58.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.691+0000 7fa9070f0640 1 --2- 172.21.15.45:0/3625577993 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa8e4066280 0x7fa8e4068730 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.691+0000 7fa9070f0640 1 --2- 172.21.15.45:0/3625577993 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa9000bc810 0x7fa9001e37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.691+0000 7fa9070f0640 1 --2- 172.21.15.45:0/3625577993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9000b98f0 0x7fa900141240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.691+0000 7fa9070f0640 1 --2- 172.21.15.45:0/3625577993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9000a2e20 0x7fa90014a530 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:15:58.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.691+0000 7fa9070f0640 1 -- 172.21.15.45:0/3625577993 >> 172.21.15.45:0/3625577993 conn(0x7fa9000bcf50 msgr2=0x7fa9000c03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:15:58.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.691+0000 7fa9070f0640 1 -- 172.21.15.45:0/3625577993 shutdown_connections 2023-10-03T19:15:58.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:15:58.691+0000 7fa9070f0640 1 -- 172.21.15.45:0/3625577993 wait complete. 2023-10-03T19:15:58.713 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-03T19:15:58.713 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-03T19:15:58.713 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-10-03T19:15:58.713 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-03T19:15:58.713 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-03T19:15:58.713 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-03T19:15:58.713 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-03T19:15:58.714 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-03T19:15:58.714 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-03T19:15:58.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:15:58.714 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-10-03T19:15:58.725 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-03T19:15:58.725 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-03T19:15:58.725 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-10-03T19:15:58.725 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:15:58.725 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-10-03T19:15:58.726 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:15:58.726 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:15:58.726 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-10-03T19:15:58.726 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-10-03T19:15:58.726 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:15:58.726 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-10-03T19:15:58.726 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-10-03T19:15:58.726 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:15:58.726 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-10-03T19:15:58.726 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-03T19:15:58.727 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-10-03T19:15:58.727 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-03T19:15:58.727 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42224sec preferred_lft 42224sec 2023-10-03T19:15:58.727 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2023-10-03T19:15:58.727 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:15:58.727 INFO:teuthology.orchestra.run.smithi146.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-03T19:15:58.727 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 02:42:a6:2d:ab:3b brd ff:ff:ff:ff:ff:ff 2023-10-03T19:15:58.727 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-03T19:15:58.727 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:15:58.727 INFO:teuthology.orchestra.run.smithi146.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-03T19:15:58.727 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-03T19:15:58.728 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-03T19:15:58.728 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:15:58.728 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::5c3e:4eff:fee6:56da/64 scope link 2023-10-03T19:15:58.728 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:15:58.728 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-03T19:15:58.728 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T19:15:58.728 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-03T19:15:58.728 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:15:58.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:15:58.729 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-03T19:15:58.789 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T19:15:58.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:15:58.790 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-10-03T19:15:58.853 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-10-03T19:15:58.854 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-03T19:15:58.854 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-03T19:15:58.854 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-03T19:15:58.854 INFO:teuthology.orchestra.run.smithi146.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-03T19:15:58.854 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-03T19:15:58.854 INFO:teuthology.orchestra.run.smithi146.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:15:58.854 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:15:58.854 INFO:teuthology.orchestra.run.smithi146.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:15:58.854 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-03T19:15:58.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:15:58.855 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-03T19:15:58.855 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-03T19:15:58.855 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-03T19:15:58.855 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-03T19:15:58.855 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-03T19:15:58.855 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-03T19:15:58.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:15:58.943 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-10-03T19:15:58.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-03T19:15:58.998 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-03T19:15:58.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:15:58.998 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-10-03T19:15:59.055 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-03T19:15:59.056 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T19:15:59.056 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-03T19:15:59.103 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-03T19:15:59.103 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T19:15:59.103 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-03T19:15:59.151 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-03T19:15:59.209 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:15:59.209 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:15:59.266 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:15:59.267 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:15:59.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:15:59.267 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-03T19:15:59.314 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-03T19:15:59.315 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-03T19:15:59.361 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-03T19:15:59.376 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:15:59.376 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:15:59.430 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:15:59.431 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:15:59.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:15:59.431 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-03T19:15:59.436 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:2023-10-03T19:15:59.432+0000 7ff9c8c61580 -1 init, newargv = 0x560e9127a100 newargc=15 2023-10-03T19:15:59.436 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[33431]: starting ceph client 2023-10-03T19:15:59.445 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[33431]: starting fuse 2023-10-03T19:16:00.542 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-03T19:16:00.557 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:16:00.557 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:16:00.610 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:16:00.611 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:16:00.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:16:00.611 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-03T19:16:00.658 INFO:teuthology.orchestra.run.smithi146.stdout:45 2023-10-03T19:16:00.659 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-03T19:16:00.659 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-03T19:16:00.659 DEBUG:teuthology.orchestra.run.smithi146:> import glob 2023-10-03T19:16:00.659 DEBUG:teuthology.orchestra.run.smithi146:> import re 2023-10-03T19:16:00.659 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-03T19:16:00.659 DEBUG:teuthology.orchestra.run.smithi146:> import subprocess 2023-10-03T19:16:00.659 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:16:00.659 DEBUG:teuthology.orchestra.run.smithi146:> def _find_admin_socket(client_name): 2023-10-03T19:16:00.659 DEBUG:teuthology.orchestra.run.smithi146:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-03T19:16:00.659 DEBUG:teuthology.orchestra.run.smithi146:> files = glob.glob(asok_path) 2023-10-03T19:16:00.660 DEBUG:teuthology.orchestra.run.smithi146:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-03T19:16:00.660 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:16:00.660 DEBUG:teuthology.orchestra.run.smithi146:> # Given a non-glob path, it better be there 2023-10-03T19:16:00.660 DEBUG:teuthology.orchestra.run.smithi146:> if "*" not in asok_path: 2023-10-03T19:16:00.660 DEBUG:teuthology.orchestra.run.smithi146:> assert(len(files) == 1) 2023-10-03T19:16:00.660 DEBUG:teuthology.orchestra.run.smithi146:> return files[0] 2023-10-03T19:16:00.660 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:16:00.660 DEBUG:teuthology.orchestra.run.smithi146:> for f in files: 2023-10-03T19:16:00.660 DEBUG:teuthology.orchestra.run.smithi146:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-03T19:16:00.660 DEBUG:teuthology.orchestra.run.smithi146:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-03T19:16:00.660 DEBUG:teuthology.orchestra.run.smithi146:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-03T19:16:00.661 DEBUG:teuthology.orchestra.run.smithi146:> contents = proc_f.read() 2023-10-03T19:16:00.661 DEBUG:teuthology.orchestra.run.smithi146:> if mountpoint in contents: 2023-10-03T19:16:00.661 DEBUG:teuthology.orchestra.run.smithi146:> return f 2023-10-03T19:16:00.661 DEBUG:teuthology.orchestra.run.smithi146:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-03T19:16:00.661 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:16:00.661 DEBUG:teuthology.orchestra.run.smithi146:> print(_find_admin_socket("client.0")) 2023-10-03T19:16:00.661 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-03T19:16:00.779 INFO:teuthology.orchestra.run.smithi146.stdout:/var/run/ceph/ceph-client.0.33431.asok 2023-10-03T19:16:00.961 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.33431.asok 2023-10-03T19:16:00.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:16:00.961 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.33431.asok status 2023-10-03T19:16:01.117 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-03T19:16:01.118 INFO:teuthology.orchestra.run.smithi146.stdout: "metadata": { 2023-10-03T19:16:01.118 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_sha1": "05a43c8fb3988914c879a50970f9054a098e0612", 2023-10-03T19:16:01.118 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 18.0.0-3908-g05a43c8f (05a43c8fb3988914c879a50970f9054a098e0612) reef (dev)", 2023-10-03T19:16:01.118 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "0", 2023-10-03T19:16:01.118 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2023-10-03T19:16:01.118 INFO:teuthology.orchestra.run.smithi146.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-03T19:16:01.118 INFO:teuthology.orchestra.run.smithi146.stdout: "pid": "33431", 2023-10-03T19:16:01.118 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2023-10-03T19:16:01.118 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:16:01.118 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_count": 0, 2023-10-03T19:16:01.119 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_pinned_count": 0, 2023-10-03T19:16:01.119 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 5697, 2023-10-03T19:16:01.119 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": { 2023-10-03T19:16:01.119 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2023-10-03T19:16:01.119 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2023-10-03T19:16:01.119 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 5697 2023-10-03T19:16:01.119 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:16:01.119 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-03T19:16:01.119 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T19:16:01.119 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:0", 2023-10-03T19:16:01.120 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 3677171105 2023-10-03T19:16:01.120 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T19:16:01.120 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:16:01.120 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-03T19:16:01.120 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T19:16:01.120 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:0", 2023-10-03T19:16:01.120 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 3677171105 2023-10-03T19:16:01.120 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:16:01.120 INFO:teuthology.orchestra.run.smithi146.stdout: "inst_str": "client.5697 172.21.15.146:0/3677171105", 2023-10-03T19:16:01.120 INFO:teuthology.orchestra.run.smithi146.stdout: "addr_str": "172.21.15.146:0/3677171105", 2023-10-03T19:16:01.120 INFO:teuthology.orchestra.run.smithi146.stdout: "inode_count": 1, 2023-10-03T19:16:01.120 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_epoch": 23, 2023-10-03T19:16:01.121 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch": 48, 2023-10-03T19:16:01.121 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch_barrier": 0, 2023-10-03T19:16:01.121 INFO:teuthology.orchestra.run.smithi146.stdout: "blocklisted": false, 2023-10-03T19:16:01.121 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs" 2023-10-03T19:16:01.121 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-03T19:16:01.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:16:01.129 DEBUG:teuthology.orchestra.run.smithi146:> stat --file-system '--printf=%T 2023-10-03T19:16:01.129 DEBUG:teuthology.orchestra.run.smithi146:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-03T19:16:01.135 INFO:teuthology.orchestra.run.smithi146.stdout:fuseblk 2023-10-03T19:16:01.136 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-03T19:16:01.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:16:01.136 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-03T19:16:01.192 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:16:01.192 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:16:01.238 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-03T19:16:01.238 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-03T19:16:01.238 DEBUG:teuthology.orchestra.run.smithi146:> import uuid 2023-10-03T19:16:01.239 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:16:01.239 DEBUG:teuthology.orchestra.run.smithi146:> n = 1000 2023-10-03T19:16:01.239 DEBUG:teuthology.orchestra.run.smithi146:> create_hard_links = False 2023-10-03T19:16:01.239 DEBUG:teuthology.orchestra.run.smithi146:> if 0 > 0: 2023-10-03T19:16:01.239 DEBUG:teuthology.orchestra.run.smithi146:> create_hard_links = True 2023-10-03T19:16:01.239 DEBUG:teuthology.orchestra.run.smithi146:> path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2023-10-03T19:16:01.239 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:16:01.239 DEBUG:teuthology.orchestra.run.smithi146:> dpath = os.path.dirname(path) 2023-10-03T19:16:01.239 DEBUG:teuthology.orchestra.run.smithi146:> fnameprefix = os.path.basename(path) 2023-10-03T19:16:01.239 DEBUG:teuthology.orchestra.run.smithi146:> os.makedirs(dpath, exist_ok=True) 2023-10-03T19:16:01.239 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:16:01.239 DEBUG:teuthology.orchestra.run.smithi146:> try: 2023-10-03T19:16:01.240 DEBUG:teuthology.orchestra.run.smithi146:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-10-03T19:16:01.240 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:16:01.240 DEBUG:teuthology.orchestra.run.smithi146:> for i in range(n): 2023-10-03T19:16:01.240 DEBUG:teuthology.orchestra.run.smithi146:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-10-03T19:16:01.240 DEBUG:teuthology.orchestra.run.smithi146:> with open(fpath, '"'"'w'"'"') as f: 2023-10-03T19:16:01.240 DEBUG:teuthology.orchestra.run.smithi146:> f.write(f"{i}") 2023-10-03T19:16:01.240 DEBUG:teuthology.orchestra.run.smithi146:> if True: 2023-10-03T19:16:01.240 DEBUG:teuthology.orchestra.run.smithi146:> f.flush() 2023-10-03T19:16:01.240 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(f.fileno()) 2023-10-03T19:16:01.240 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2023-10-03T19:16:01.240 DEBUG:teuthology.orchestra.run.smithi146:> os.unlink(fpath) 2023-10-03T19:16:01.242 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2023-10-03T19:16:01.242 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(dirfd) 2023-10-03T19:16:01.242 DEBUG:teuthology.orchestra.run.smithi146:> if create_hard_links: 2023-10-03T19:16:01.242 DEBUG:teuthology.orchestra.run.smithi146:> for j in range(0): 2023-10-03T19:16:01.242 DEBUG:teuthology.orchestra.run.smithi146:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-10-03T19:16:01.243 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2023-10-03T19:16:01.243 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(dirfd) 2023-10-03T19:16:01.243 DEBUG:teuthology.orchestra.run.smithi146:> finally: 2023-10-03T19:16:01.243 DEBUG:teuthology.orchestra.run.smithi146:> os.close(dirfd) 2023-10-03T19:16:01.243 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-03T19:16:02.321 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:16:02.323 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:16:02.326 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:16:02.328 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:16:14.561 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:16:14.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.698+0000 7f7d936b2640 1 Processor -- start 2023-10-03T19:16:14.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.698+0000 7f7d936b2640 1 -- start start 2023-10-03T19:16:14.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.698+0000 7f7d936b2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d8c0bc8b0 0x7f7d8c14ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:14.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.698+0000 7f7d936b2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d8c06d170 0x7f7d8c14cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:14.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.698+0000 7f7d936b2640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d8c06cac0 con 0x7f7d8c06f170 2023-10-03T19:16:14.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.698+0000 7f7d936b2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d8c14d4f0 con 0x7f7d8c0bc8b0 2023-10-03T19:16:14.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.698+0000 7f7d936b2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c0720d0 con 0x7f7d8c06d170 2023-10-03T19:16:14.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.698+0000 7f7d90c4d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d8c0bc8b0 0x7f7d8c14ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:14.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.698+0000 7f7d90c4d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d8c0bc8b0 0x7f7d8c14ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48246/0 (socket says 172.21.15.45:48246) 2023-10-03T19:16:14.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.698+0000 7f7d90c4d640 1 -- 172.21.15.45:0/1349514798 learned_addr learned my addr 172.21.15.45:0/1349514798 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:14.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.698+0000 7f7d91c4f640 1 --2- 172.21.15.45:0/1349514798 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d8c06d170 0x7f7d8c14cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:14.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.698+0000 7f7d90c4d640 1 -- 172.21.15.45:0/1349514798 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d8c06d170 msgr2=0x7f7d8c14cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:14.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.698+0000 7f7d90c4d640 1 --2- 172.21.15.45:0/1349514798 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d8c06d170 0x7f7d8c14cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:14.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.698+0000 7f7d90c4d640 1 -- 172.21.15.45:0/1349514798 >> v1:172.21.15.79:6789/0 conn(0x7f7d8c06f170 legacy=0x7f7d8c150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:14.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.698+0000 7f7d90c4d640 1 -- 172.21.15.45:0/1349514798 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d8c0a5ab0 con 0x7f7d8c0bc8b0 2023-10-03T19:16:14.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.702+0000 7f7d90c4d640 1 --2- 172.21.15.45:0/1349514798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d8c0bc8b0 0x7f7d8c14ca70 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009870 tx=0x7f7d7c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a2998ccf938c766 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:14.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.702+0000 7f7d83fff640 1 -- 172.21.15.45:0/1349514798 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c0a89b0 con 0x7f7d8c0bc8b0 2023-10-03T19:16:14.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.702+0000 7f7d83fff640 1 -- 172.21.15.45:0/1349514798 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7c0a8b10 con 0x7f7d8c0bc8b0 2023-10-03T19:16:14.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.702+0000 7f7d83fff640 1 -- 172.21.15.45:0/1349514798 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c0a8ea0 con 0x7f7d8c0bc8b0 2023-10-03T19:16:14.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.702+0000 7f7d936b2640 1 -- 172.21.15.45:0/1349514798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d8c0bc8b0 msgr2=0x7f7d8c14ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:14.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.702+0000 7f7d936b2640 1 --2- 172.21.15.45:0/1349514798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d8c0bc8b0 0x7f7d8c14ca70 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009870 tx=0x7f7d7c01ecf0 comp rx=0 tx=0).stop 2023-10-03T19:16:14.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.702+0000 7f7d936b2640 1 -- 172.21.15.45:0/1349514798 shutdown_connections 2023-10-03T19:16:14.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.702+0000 7f7d936b2640 1 --2- 172.21.15.45:0/1349514798 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d8c06d170 0x7f7d8c14cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:14.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.702+0000 7f7d936b2640 1 --2- 172.21.15.45:0/1349514798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d8c0bc8b0 0x7f7d8c14ca70 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:14.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.702+0000 7f7d936b2640 1 -- 172.21.15.45:0/1349514798 >> 172.21.15.45:0/1349514798 conn(0x7f7d8c0bcf50 msgr2=0x7f7d8c0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:14.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.702+0000 7f7d936b2640 1 -- 172.21.15.45:0/1349514798 shutdown_connections 2023-10-03T19:16:14.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.702+0000 7f7d936b2640 1 -- 172.21.15.45:0/1349514798 wait complete. 2023-10-03T19:16:14.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.702+0000 7f7d936b2640 1 Processor -- start 2023-10-03T19:16:14.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.702+0000 7f7d936b2640 1 -- start start 2023-10-03T19:16:14.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.706+0000 7f7d936b2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d8c06d170 0x7f7d8c0b9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:14.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.706+0000 7f7d936b2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d8c06f170 0x7f7d8c1e4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:14.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.706+0000 7f7d936b2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d8c0bc8b0 0x7f7d8c1e4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:14.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.706+0000 7f7d936b2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c145a00 con 0x7f7d8c06f170 2023-10-03T19:16:14.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.706+0000 7f7d936b2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c1e3cf0 con 0x7f7d8c0bc8b0 2023-10-03T19:16:14.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.706+0000 7f7d936b2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c1e7a90 con 0x7f7d8c06d170 2023-10-03T19:16:14.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.706+0000 7f7d90c4d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d8c06f170 0x7f7d8c1e4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:14.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.706+0000 7f7d90c4d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d8c06f170 0x7f7d8c1e4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48260/0 (socket says 172.21.15.45:48260) 2023-10-03T19:16:14.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.706+0000 7f7d90c4d640 1 -- 172.21.15.45:0/1037104077 learned_addr learned my addr 172.21.15.45:0/1037104077 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:14.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.706+0000 7f7d91c4f640 1 --2- 172.21.15.45:0/1037104077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d8c0bc8b0 0x7f7d8c1e4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:14.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.706+0000 7f7d9144e640 1 --2- 172.21.15.45:0/1037104077 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d8c06d170 0x7f7d8c0b9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:14.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.706+0000 7f7d90c4d640 1 -- 172.21.15.45:0/1037104077 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d8c06d170 msgr2=0x7f7d8c0b9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:14.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.706+0000 7f7d90c4d640 1 --2- 172.21.15.45:0/1037104077 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d8c06d170 0x7f7d8c0b9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:14.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.706+0000 7f7d90c4d640 1 -- 172.21.15.45:0/1037104077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d8c0bc8b0 msgr2=0x7f7d8c1e4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:14.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.706+0000 7f7d90c4d640 1 --2- 172.21.15.45:0/1037104077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d8c0bc8b0 0x7f7d8c1e4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:14.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.706+0000 7f7d90c4d640 1 -- 172.21.15.45:0/1037104077 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7c0094d0 con 0x7f7d8c06f170 2023-10-03T19:16:14.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.706+0000 7f7d91c4f640 1 --2- 172.21.15.45:0/1037104077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d8c0bc8b0 0x7f7d8c1e4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:14.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.706+0000 7f7d90c4d640 1 --2- 172.21.15.45:0/1037104077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d8c06f170 0x7f7d8c1e4110 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c01d3a0 tx=0x7f7d7c01ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:14.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.706+0000 7f7d81ffb640 1 -- 172.21.15.45:0/1037104077 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c0ba600 con 0x7f7d8c06f170 2023-10-03T19:16:14.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.706+0000 7f7d81ffb640 1 -- 172.21.15.45:0/1037104077 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7c0ba760 con 0x7f7d8c06f170 2023-10-03T19:16:14.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.706+0000 7f7d936b2640 1 -- 172.21.15.45:0/1037104077 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d8c14fae0 con 0x7f7d8c06f170 2023-10-03T19:16:14.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.706+0000 7f7d81ffb640 1 -- 172.21.15.45:0/1037104077 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c0bab10 con 0x7f7d8c06f170 2023-10-03T19:16:14.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.706+0000 7f7d936b2640 1 -- 172.21.15.45:0/1037104077 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d8c06cd00 con 0x7f7d8c06f170 2023-10-03T19:16:14.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.706+0000 7f7d936b2640 1 -- 172.21.15.45:0/1037104077 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d8c14c4a0 con 0x7f7d8c06f170 2023-10-03T19:16:14.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.706+0000 7f7d81ffb640 1 -- 172.21.15.45:0/1037104077 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7d7c0bac70 con 0x7f7d8c06f170 2023-10-03T19:16:14.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.706+0000 7f7d81ffb640 1 --2- 172.21.15.45:0/1037104077 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7d700662b0 0x7f7d70068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:14.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.706+0000 7f7d81ffb640 1 -- 172.21.15.45:0/1037104077 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7d7c1221c0 con 0x7f7d8c06f170 2023-10-03T19:16:14.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.706+0000 7f7d9144e640 1 --2- 172.21.15.45:0/1037104077 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7d700662b0 0x7f7d70068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:14.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.710+0000 7f7d9144e640 1 --2- 172.21.15.45:0/1037104077 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7d700662b0 0x7f7d70068760 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7d88003d60 tx=0x7f7d88009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:14.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.710+0000 7f7d81ffb640 1 -- 172.21.15.45:0/1037104077 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7d7c0ef680 con 0x7f7d8c06f170 2023-10-03T19:16:14.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.898+0000 7f7d936b2640 1 -- 172.21.15.45:0/1037104077 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d8c06d660 con 0x7f7d8c06f170 2023-10-03T19:16:14.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.898+0000 7f7d81ffb640 1 -- 172.21.15.45:0/1037104077 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+3914 (secure 0 0 0) 0x7f7d7c0f2ca0 con 0x7f7d8c06f170 2023-10-03T19:16:14.906 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:16:14.906 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2315858323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2315858323},{"type":"v1","addr":"172.21.15.79:6835","nonce":2315858323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1525989510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1525989510},{"type":"v1","addr":"172.21.15.45:6834","nonce":1525989510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:15:46.329993+0000","modified":"2023-10-03T19:15:49.849869+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5514":{"gid":5514,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1319730866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1319730866},{"type":"v1","addr":"172.21.15.45:6835","nonce":1319730866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-10-03T19:16:14.906 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 23 2023-10-03T19:16:14.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.902+0000 7f7d936b2640 1 -- 172.21.15.45:0/1037104077 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7d700662b0 msgr2=0x7f7d70068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:14.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.902+0000 7f7d936b2640 1 --2- 172.21.15.45:0/1037104077 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7d700662b0 0x7f7d70068760 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7d88003d60 tx=0x7f7d88009040 comp rx=0 tx=0).stop 2023-10-03T19:16:14.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.902+0000 7f7d936b2640 1 -- 172.21.15.45:0/1037104077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d8c06f170 msgr2=0x7f7d8c1e4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:14.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.902+0000 7f7d936b2640 1 --2- 172.21.15.45:0/1037104077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d8c06f170 0x7f7d8c1e4110 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c01d3a0 tx=0x7f7d7c01ba90 comp rx=0 tx=0).stop 2023-10-03T19:16:14.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.902+0000 7f7d936b2640 1 -- 172.21.15.45:0/1037104077 shutdown_connections 2023-10-03T19:16:14.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.902+0000 7f7d936b2640 1 --2- 172.21.15.45:0/1037104077 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7d700662b0 0x7f7d70068760 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:14.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.902+0000 7f7d936b2640 1 --2- 172.21.15.45:0/1037104077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d8c0bc8b0 0x7f7d8c1e4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:14.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.902+0000 7f7d936b2640 1 --2- 172.21.15.45:0/1037104077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d8c06f170 0x7f7d8c1e4110 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:14.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.902+0000 7f7d936b2640 1 --2- 172.21.15.45:0/1037104077 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d8c06d170 0x7f7d8c0b9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:14.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.902+0000 7f7d936b2640 1 -- 172.21.15.45:0/1037104077 >> 172.21.15.45:0/1037104077 conn(0x7f7d8c0bcf50 msgr2=0x7f7d8c0bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:14.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.902+0000 7f7d936b2640 1 -- 172.21.15.45:0/1037104077 shutdown_connections 2023-10-03T19:16:14.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:14.902+0000 7f7d936b2640 1 -- 172.21.15.45:0/1037104077 wait complete. 2023-10-03T19:16:14.924 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2023-10-03T19:16:15.061 INFO:teuthology.orchestra.run.smithi045.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2023-10-03T19:16:15.061 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2023-10-03T19:16:15.062 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:16:15.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.174+0000 7f3901ae1640 1 Processor -- start 2023-10-03T19:16:15.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.174+0000 7f3901ae1640 1 -- start start 2023-10-03T19:16:15.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.174+0000 7f3901ae1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f38fc0a6f00 0x7f38fc0bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:15.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.174+0000 7f3901ae1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f38fc06f050 0x7f38fc0be010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:15.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.174+0000 7f3901ae1640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38fc14fd70 con 0x7f38fc0bed20 2023-10-03T19:16:15.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.174+0000 7f3901ae1640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38fc14d420 con 0x7f38fc06f050 2023-10-03T19:16:15.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.174+0000 7f3901ae1640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38fc146910 con 0x7f38fc0a6f00 2023-10-03T19:16:15.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.174+0000 7f38fbfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f38fc06f050 0x7f38fc0be010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:15.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.174+0000 7f38fbfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f38fc06f050 0x7f38fc0be010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48272/0 (socket says 172.21.15.45:48272) 2023-10-03T19:16:15.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.174+0000 7f38fbfff640 1 -- 172.21.15.45:0/1006579401 learned_addr learned my addr 172.21.15.45:0/1006579401 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:15.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.174+0000 7f38faffd640 1 --2- 172.21.15.45:0/1006579401 >> v2:172.21.15.79:3300/0 conn(0x7f38fc0a6f00 0x7f38fc0bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:15.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.174+0000 7f38fbfff640 1 -- 172.21.15.45:0/1006579401 >> v2:172.21.15.79:3300/0 conn(0x7f38fc0a6f00 msgr2=0x7f38fc0bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:15.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.174+0000 7f38fbfff640 1 --2- 172.21.15.45:0/1006579401 >> v2:172.21.15.79:3300/0 conn(0x7f38fc0a6f00 0x7f38fc0bf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.174+0000 7f38fbfff640 1 -- 172.21.15.45:0/1006579401 >> v1:172.21.15.79:6789/0 conn(0x7f38fc0bed20 legacy=0x7f38fc150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:15.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.174+0000 7f38fbfff640 1 -- 172.21.15.45:0/1006579401 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38fc06e9f0 con 0x7f38fc06f050 2023-10-03T19:16:15.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f38fbfff640 1 --2- 172.21.15.45:0/1006579401 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38fc06f050 0x7f38fc0be010 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f38fc0a5e80 tx=0x7f38f401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cbb62bd71b244df server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:15.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f38fa7fc640 1 -- 172.21.15.45:0/1006579401 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f40a5690 con 0x7f38fc06f050 2023-10-03T19:16:15.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f38fa7fc640 1 -- 172.21.15.45:0/1006579401 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f40a57f0 con 0x7f38fc06f050 2023-10-03T19:16:15.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f38fa7fc640 1 -- 172.21.15.45:0/1006579401 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f40a5b80 con 0x7f38fc06f050 2023-10-03T19:16:15.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f3901ae1640 1 -- 172.21.15.45:0/1006579401 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38fc06f050 msgr2=0x7f38fc0be010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:15.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f3901ae1640 1 --2- 172.21.15.45:0/1006579401 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38fc06f050 0x7f38fc0be010 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f38fc0a5e80 tx=0x7f38f401c9d0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f3901ae1640 1 -- 172.21.15.45:0/1006579401 shutdown_connections 2023-10-03T19:16:15.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f3901ae1640 1 --2- 172.21.15.45:0/1006579401 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38fc06f050 0x7f38fc0be010 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f3901ae1640 1 --2- 172.21.15.45:0/1006579401 >> v2:172.21.15.79:3300/0 conn(0x7f38fc0a6f00 0x7f38fc0bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f3901ae1640 1 -- 172.21.15.45:0/1006579401 >> 172.21.15.45:0/1006579401 conn(0x7f38fc06d990 msgr2=0x7f38fc06bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:15.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f3901ae1640 1 -- 172.21.15.45:0/1006579401 shutdown_connections 2023-10-03T19:16:15.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f3901ae1640 1 -- 172.21.15.45:0/1006579401 wait complete. 2023-10-03T19:16:15.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f3901ae1640 1 Processor -- start 2023-10-03T19:16:15.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f3901ae1640 1 -- start start 2023-10-03T19:16:15.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f3901ae1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38fc06f050 0x7f38fc156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:15.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f3901ae1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38fc0a6f00 0x7f38fc1e9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:15.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f3901ae1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38fc0bed20 0x7f38fc0c1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:15.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f3901ae1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38fc151270 con 0x7f38fc06f050 2023-10-03T19:16:15.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f3901ae1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38fc0c2a90 con 0x7f38fc0bed20 2023-10-03T19:16:15.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f3901ae1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38fc0c2740 con 0x7f38fc0a6f00 2023-10-03T19:16:15.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f38fb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38fc06f050 0x7f38fc156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:15.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f38fb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38fc06f050 0x7f38fc156cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48284/0 (socket says 172.21.15.45:48284) 2023-10-03T19:16:15.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f38fb7fe640 1 -- 172.21.15.45:0/683439467 learned_addr learned my addr 172.21.15.45:0/683439467 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:15.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f38fbfff640 1 --2- 172.21.15.45:0/683439467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38fc0bed20 0x7f38fc0c1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:15.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f38faffd640 1 --2- 172.21.15.45:0/683439467 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38fc0a6f00 0x7f38fc1e9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:15.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f38fb7fe640 1 -- 172.21.15.45:0/683439467 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38fc0a6f00 msgr2=0x7f38fc1e9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:15.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f38fb7fe640 1 --2- 172.21.15.45:0/683439467 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38fc0a6f00 0x7f38fc1e9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f38fb7fe640 1 -- 172.21.15.45:0/683439467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38fc0bed20 msgr2=0x7f38fc0c1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:15.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f38fb7fe640 1 --2- 172.21.15.45:0/683439467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38fc0bed20 0x7f38fc0c1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f38fb7fe640 1 -- 172.21.15.45:0/683439467 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f4009b30 con 0x7f38fc06f050 2023-10-03T19:16:15.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f38fbfff640 1 --2- 172.21.15.45:0/683439467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38fc0bed20 0x7f38fc0c1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:15.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f38faffd640 1 --2- 172.21.15.45:0/683439467 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38fc0a6f00 0x7f38fc1e9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:15.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f38fb7fe640 1 --2- 172.21.15.45:0/683439467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38fc06f050 0x7f38fc156cb0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f38ec00c500 tx=0x7f38ec00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:15.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f38e3fff640 1 -- 172.21.15.45:0/683439467 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec005220 con 0x7f38fc06f050 2023-10-03T19:16:15.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f38e3fff640 1 -- 172.21.15.45:0/683439467 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ec005380 con 0x7f38fc06f050 2023-10-03T19:16:15.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f38e3fff640 1 -- 172.21.15.45:0/683439467 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec007270 con 0x7f38fc06f050 2023-10-03T19:16:15.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.178+0000 7f3901ae1640 1 -- 172.21.15.45:0/683439467 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38fc0bf840 con 0x7f38fc06f050 2023-10-03T19:16:15.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.182+0000 7f3901ae1640 1 -- 172.21.15.45:0/683439467 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38fc14f9b0 con 0x7f38fc06f050 2023-10-03T19:16:15.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.182+0000 7f3901ae1640 1 -- 172.21.15.45:0/683439467 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38fc0bf9d0 con 0x7f38fc06f050 2023-10-03T19:16:15.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.182+0000 7f38e3fff640 1 -- 172.21.15.45:0/683439467 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f38ec0073d0 con 0x7f38fc06f050 2023-10-03T19:16:15.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.182+0000 7f38e3fff640 1 --2- 172.21.15.45:0/683439467 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f38e8066280 0x7f38e8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:15.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.182+0000 7f38e3fff640 1 -- 172.21.15.45:0/683439467 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f38ec083610 con 0x7f38fc06f050 2023-10-03T19:16:15.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.182+0000 7f38faffd640 1 --2- 172.21.15.45:0/683439467 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f38e8066280 0x7f38e8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:15.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.182+0000 7f38faffd640 1 --2- 172.21.15.45:0/683439467 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f38e8066280 0x7f38e8068730 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f38fc149980 tx=0x7f38f0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:15.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.186+0000 7f38e3fff640 1 -- 172.21.15.45:0/683439467 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f38ec050a60 con 0x7f38fc06f050 2023-10-03T19:16:15.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.374+0000 7f3901ae1640 1 -- 172.21.15.45:0/683439467 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38fc04de80 con 0x7f38fc06f050 2023-10-03T19:16:15.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.374+0000 7f38e3fff640 1 -- 172.21.15.45:0/683439467 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+3914 (secure 0 0 0) 0x7f38ec054080 con 0x7f38fc06f050 2023-10-03T19:16:15.382 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:16:15.382 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2315858323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2315858323},{"type":"v1","addr":"172.21.15.79:6835","nonce":2315858323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1525989510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1525989510},{"type":"v1","addr":"172.21.15.45:6834","nonce":1525989510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:15:46.329993+0000","modified":"2023-10-03T19:15:49.849869+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5514":{"gid":5514,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1319730866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1319730866},{"type":"v1","addr":"172.21.15.45:6835","nonce":1319730866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-10-03T19:16:15.382 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 23 2023-10-03T19:16:15.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.378+0000 7f3901ae1640 1 -- 172.21.15.45:0/683439467 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f38e8066280 msgr2=0x7f38e8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:15.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.378+0000 7f3901ae1640 1 --2- 172.21.15.45:0/683439467 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f38e8066280 0x7f38e8068730 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f38fc149980 tx=0x7f38f0008040 comp rx=0 tx=0).stop 2023-10-03T19:16:15.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.378+0000 7f3901ae1640 1 -- 172.21.15.45:0/683439467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38fc06f050 msgr2=0x7f38fc156cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:15.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.378+0000 7f3901ae1640 1 --2- 172.21.15.45:0/683439467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38fc06f050 0x7f38fc156cb0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f38ec00c500 tx=0x7f38ec00c9c0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.378+0000 7f3901ae1640 1 -- 172.21.15.45:0/683439467 shutdown_connections 2023-10-03T19:16:15.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.378+0000 7f3901ae1640 1 --2- 172.21.15.45:0/683439467 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f38e8066280 0x7f38e8068730 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.378+0000 7f3901ae1640 1 --2- 172.21.15.45:0/683439467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38fc0bed20 0x7f38fc0c1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.378+0000 7f3901ae1640 1 --2- 172.21.15.45:0/683439467 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38fc0a6f00 0x7f38fc1e9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.378+0000 7f3901ae1640 1 --2- 172.21.15.45:0/683439467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38fc06f050 0x7f38fc156cb0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.378+0000 7f3901ae1640 1 -- 172.21.15.45:0/683439467 >> 172.21.15.45:0/683439467 conn(0x7f38fc06d990 msgr2=0x7f38fc0bc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:15.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.378+0000 7f3901ae1640 1 -- 172.21.15.45:0/683439467 shutdown_connections 2023-10-03T19:16:15.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.378+0000 7f3901ae1640 1 -- 172.21.15.45:0/683439467 wait complete. 2023-10-03T19:16:15.400 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2023-10-03T19:16:15.539 INFO:teuthology.orchestra.run.smithi045.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2023-10-03T19:16:15.539 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2023-10-03T19:16:15.539 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-03T19:16:15.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:16:15.540 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 down 2023-10-03T19:16:15.556 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 cache drop 2023-10-03T19:16:15.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.674+0000 7f4fd1679640 1 Processor -- start 2023-10-03T19:16:15.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.674+0000 7f4fd1679640 1 -- start start 2023-10-03T19:16:15.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.674+0000 7f4fd1679640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4fcc06a0e0 0x7f4fcc14e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:15.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.674+0000 7f4fd1679640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4fcc14ec80 0x7f4fcc158f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:15.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.674+0000 7f4fd1679640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fcc0bdd50 con 0x7f4fcc0658f0 2023-10-03T19:16:15.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.674+0000 7f4fd1679640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fcc152710 con 0x7f4fcc14ec80 2023-10-03T19:16:15.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.674+0000 7f4fd1679640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc1529f0 con 0x7f4fcc06a0e0 2023-10-03T19:16:15.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.674+0000 7f4fca7fc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4fcc06a0e0 0x7f4fcc14e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:15.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.674+0000 7f4fcb7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4fcc14ec80 0x7f4fcc158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:15.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.674+0000 7f4fcaffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4fcc0658f0 0x7f4fcc14b8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:45014/0 (socket says 172.21.15.45:45014) 2023-10-03T19:16:15.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.674+0000 7f4fcaffd640 1 -- 172.21.15.45:0/2840968995 learned_addr learned my addr 172.21.15.45:0/2840968995 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:15.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.674+0000 7f4fcb7fe640 1 -- 172.21.15.45:0/2840968995 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4fcc06a0e0 msgr2=0x7f4fcc14e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:15.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.674+0000 7f4fcb7fe640 1 --2- 172.21.15.45:0/2840968995 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4fcc06a0e0 0x7f4fcc14e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.674+0000 7f4fcb7fe640 1 -- 172.21.15.45:0/2840968995 >> v1:172.21.15.79:6789/0 conn(0x7f4fcc0658f0 legacy=0x7f4fcc14b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:15.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.674+0000 7f4fcb7fe640 1 -- 172.21.15.45:0/2840968995 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fcc06acd0 con 0x7f4fcc14ec80 2023-10-03T19:16:15.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.678+0000 7f4fcb7fe640 1 --2- 172.21.15.45:0/2840968995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fcc14ec80 0x7f4fcc158f20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4fc4009d90 tx=0x7f4fc401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90b0fcd9e48f04fa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:15.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.678+0000 7f4fc9ffb640 1 -- 172.21.15.45:0/2840968995 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc40a5a00 con 0x7f4fcc14ec80 2023-10-03T19:16:15.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.678+0000 7f4fc9ffb640 1 -- 172.21.15.45:0/2840968995 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc40a5b60 con 0x7f4fcc14ec80 2023-10-03T19:16:15.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.678+0000 7f4fc9ffb640 1 -- 172.21.15.45:0/2840968995 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc40ad440 con 0x7f4fcc14ec80 2023-10-03T19:16:15.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.678+0000 7f4fd1679640 1 -- 172.21.15.45:0/2840968995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fcc14ec80 msgr2=0x7f4fcc158f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:15.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.678+0000 7f4fd1679640 1 --2- 172.21.15.45:0/2840968995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fcc14ec80 0x7f4fcc158f20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4fc4009d90 tx=0x7f4fc401c920 comp rx=0 tx=0).stop 2023-10-03T19:16:15.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.678+0000 7f4fd1679640 1 -- 172.21.15.45:0/2840968995 shutdown_connections 2023-10-03T19:16:15.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.678+0000 7f4fd1679640 1 --2- 172.21.15.45:0/2840968995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fcc14ec80 0x7f4fcc158f20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.678+0000 7f4fd1679640 1 --2- 172.21.15.45:0/2840968995 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4fcc06a0e0 0x7f4fcc14e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.678+0000 7f4fd1679640 1 -- 172.21.15.45:0/2840968995 >> 172.21.15.45:0/2840968995 conn(0x7f4fcc0c1510 msgr2=0x7f4fcc0c1910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:15.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.678+0000 7f4fd1679640 1 -- 172.21.15.45:0/2840968995 shutdown_connections 2023-10-03T19:16:15.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.678+0000 7f4fd1679640 1 -- 172.21.15.45:0/2840968995 wait complete. 2023-10-03T19:16:15.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.682+0000 7f4fd1679640 1 Processor -- start 2023-10-03T19:16:15.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.682+0000 7f4fd1679640 1 -- start start 2023-10-03T19:16:15.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.682+0000 7f4fd1679640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fcc0658f0 0x7f4fcc0a26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:15.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.682+0000 7f4fd1679640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4fcc06a0e0 0x7f4fcc1eaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:15.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.682+0000 7f4fd1679640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fcc14ec80 0x7f4fcc1eafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:15.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.682+0000 7f4fd1679640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc06e460 con 0x7f4fcc14ec80 2023-10-03T19:16:15.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.682+0000 7f4fd1679640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc071ed0 con 0x7f4fcc0658f0 2023-10-03T19:16:15.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.682+0000 7f4fd1679640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc072100 con 0x7f4fcc06a0e0 2023-10-03T19:16:15.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.682+0000 7f4fcb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fcc14ec80 0x7f4fcc1eafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:15.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.682+0000 7f4fcb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fcc14ec80 0x7f4fcc1eafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48294/0 (socket says 172.21.15.45:48294) 2023-10-03T19:16:15.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.682+0000 7f4fcb7fe640 1 -- 172.21.15.45:0/3176117382 learned_addr learned my addr 172.21.15.45:0/3176117382 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:15.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.682+0000 7f4fcaffd640 1 --2- 172.21.15.45:0/3176117382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fcc0658f0 0x7f4fcc0a26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:15.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.682+0000 7f4fca7fc640 1 --2- 172.21.15.45:0/3176117382 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4fcc06a0e0 0x7f4fcc1eaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:15.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.682+0000 7f4fcb7fe640 1 -- 172.21.15.45:0/3176117382 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4fcc06a0e0 msgr2=0x7f4fcc1eaaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:15.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.682+0000 7f4fcb7fe640 1 --2- 172.21.15.45:0/3176117382 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4fcc06a0e0 0x7f4fcc1eaaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.682+0000 7f4fcb7fe640 1 -- 172.21.15.45:0/3176117382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fcc0658f0 msgr2=0x7f4fcc0a26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:15.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.682+0000 7f4fcb7fe640 1 --2- 172.21.15.45:0/3176117382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fcc0658f0 0x7f4fcc0a26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.682+0000 7f4fcb7fe640 1 -- 172.21.15.45:0/3176117382 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc4009a70 con 0x7f4fcc14ec80 2023-10-03T19:16:15.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.682+0000 7f4fcaffd640 1 --2- 172.21.15.45:0/3176117382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fcc0658f0 0x7f4fcc0a26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:16:15.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.682+0000 7f4fcb7fe640 1 --2- 172.21.15.45:0/3176117382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fcc14ec80 0x7f4fcc1eafe0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f4fc40b0040 tx=0x7f4fc40196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:15.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.682+0000 7f4fb37fe640 1 -- 172.21.15.45:0/3176117382 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc40add90 con 0x7f4fcc14ec80 2023-10-03T19:16:15.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.682+0000 7f4fb37fe640 1 -- 172.21.15.45:0/3176117382 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc4009450 con 0x7f4fcc14ec80 2023-10-03T19:16:15.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.682+0000 7f4fb37fe640 1 -- 172.21.15.45:0/3176117382 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc40b9690 con 0x7f4fcc14ec80 2023-10-03T19:16:15.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.682+0000 7f4fd1679640 1 -- 172.21.15.45:0/3176117382 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fcc065e50 con 0x7f4fcc14ec80 2023-10-03T19:16:15.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.682+0000 7f4fd1679640 1 -- 172.21.15.45:0/3176117382 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fcc065cc0 con 0x7f4fcc14ec80 2023-10-03T19:16:15.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.686+0000 7f4fd479d000 1 Processor -- start 2023-10-03T19:16:15.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.686+0000 7f4fd479d000 1 -- start start 2023-10-03T19:16:15.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.686+0000 7f4fd479d000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5605e69c52f0 0x5605e69bc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:15.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.686+0000 7f4fd479d000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5605e69bca10 0x5605e69bcde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:15.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.686+0000 7f4fd479d000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605e69bd320 0x5605e69bd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:15.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.686+0000 7f4fd479d000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605e6886ac0 con 0x5605e69bca10 2023-10-03T19:16:15.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.686+0000 7f4fd479d000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605e67c0a70 con 0x5605e69bd320 2023-10-03T19:16:15.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.686+0000 7f4fd479d000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x5605e6814130 con 0x5605e69c52f0 2023-10-03T19:16:15.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.686+0000 7f4fcaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5605e69bca10 0x5605e69bcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:15.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.686+0000 7f4fcaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5605e69bca10 0x5605e69bcde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48302/0 (socket says 172.21.15.45:48302) 2023-10-03T19:16:15.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.686+0000 7f4fcaffd640 1 -- 172.21.15.45:0/1150660525 learned_addr learned my addr 172.21.15.45:0/1150660525 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:15.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.686+0000 7f4fca7fc640 1 --2- 172.21.15.45:0/1150660525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605e69bd320 0x5605e69bd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:15.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.686+0000 7f4fb37fe640 1 -- 172.21.15.45:0/3176117382 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4fc40b97f0 con 0x7f4fcc14ec80 2023-10-03T19:16:15.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.686+0000 7f4fca7fc640 1 --2- 172.21.15.45:0/1150660525 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5605e69c52f0 0x5605e69bc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:15.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.686+0000 7f4fcaffd640 1 -- 172.21.15.45:0/1150660525 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5605e69c52f0 msgr2=0x5605e69bc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:15.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.686+0000 7f4fcaffd640 1 --2- 172.21.15.45:0/1150660525 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5605e69c52f0 0x5605e69bc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.686+0000 7f4fcaffd640 1 -- 172.21.15.45:0/1150660525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605e69bd320 msgr2=0x5605e69bd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:15.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.686+0000 7f4fcaffd640 1 --2- 172.21.15.45:0/1150660525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605e69bd320 0x5605e69bd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.686+0000 7f4fcaffd640 1 -- 172.21.15.45:0/1150660525 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605e67d1fa0 con 0x5605e69bca10 2023-10-03T19:16:15.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.686+0000 7f4fca7fc640 1 --2- 172.21.15.45:0/1150660525 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5605e69c52f0 0x5605e69bc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:15.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.686+0000 7f4fcaffd640 1 --2- 172.21.15.45:0/1150660525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5605e69bca10 0x5605e69bcde0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc0016f0 tx=0x7f4fbc001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a912396732a70763 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:15.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.686+0000 7f4fb37fe640 1 --2- 172.21.15.45:0/3176117382 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4fb8066280 0x7f4fb8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:15.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.686+0000 7f4fb0ff9640 1 -- 172.21.15.45:0/1150660525 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc005ad0 con 0x5605e69bca10 2023-10-03T19:16:15.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.686+0000 7f4fb0ff9640 1 -- 172.21.15.45:0/1150660525 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fbc005c30 con 0x5605e69bca10 2023-10-03T19:16:15.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.686+0000 7f4fb37fe640 1 -- 172.21.15.45:0/3176117382 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4fc411f470 con 0x7f4fcc14ec80 2023-10-03T19:16:15.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.686+0000 7f4fb0ff9640 1 -- 172.21.15.45:0/1150660525 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc0070d0 con 0x5605e69bca10 2023-10-03T19:16:15.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.686+0000 7f4fca7fc640 1 --2- 172.21.15.45:0/3176117382 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4fb8066280 0x7f4fb8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:15.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.686+0000 7f4fd479d000 1 -- 172.21.15.45:0/1150660525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5605e69bca10 msgr2=0x5605e69bcde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:15.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.686+0000 7f4fd479d000 1 --2- 172.21.15.45:0/1150660525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5605e69bca10 0x5605e69bcde0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc0016f0 tx=0x7f4fbc001bb0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fd479d000 1 -- 172.21.15.45:0/1150660525 shutdown_connections 2023-10-03T19:16:15.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fd479d000 1 --2- 172.21.15.45:0/1150660525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605e69bd320 0x5605e69bd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fd479d000 1 --2- 172.21.15.45:0/1150660525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5605e69bca10 0x5605e69bcde0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fd479d000 1 --2- 172.21.15.45:0/1150660525 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5605e69c52f0 0x5605e69bc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fd479d000 1 -- 172.21.15.45:0/1150660525 >> 172.21.15.45:0/1150660525 conn(0x5605e69f67f0 msgr2=0x5605e69f8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:15.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fd479d000 1 -- 172.21.15.45:0/1150660525 shutdown_connections 2023-10-03T19:16:15.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fd479d000 1 -- 172.21.15.45:0/1150660525 wait complete. 2023-10-03T19:16:15.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fca7fc640 1 --2- 172.21.15.45:0/3176117382 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4fb8066280 0x7f4fb8068730 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc143430 tx=0x7f4fc00095f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:15.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fd479d000 1 -- start start 2023-10-03T19:16:15.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fd479d000 1 Processor -- start 2023-10-03T19:16:15.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fd479d000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5605e69bca10 0x5605e69c1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:15.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fd479d000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5605e69bd320 0x5605e69c20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:15.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fd479d000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605e69c52f0 0x5605e69c2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:15.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fd479d000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605e680d1d0 con 0x5605e69bca10 2023-10-03T19:16:15.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fd479d000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605e67aa920 con 0x5605e69c52f0 2023-10-03T19:16:15.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fd479d000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x5605e67aa5c0 con 0x5605e69bd320 2023-10-03T19:16:15.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fd479d000 10 client.0 _ll_register_callbacks cb 0x5605e69aa610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T19:16:15.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fcaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5605e69bca10 0x5605e69c1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:15.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fcaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5605e69bca10 0x5605e69c1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48310/0 (socket says 172.21.15.45:48310) 2023-10-03T19:16:15.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fcaffd640 1 -- 172.21.15.45:0/2616752731 learned_addr learned my addr 172.21.15.45:0/2616752731 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:15.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fcb7fe640 1 --2- 172.21.15.45:0/2616752731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605e69c52f0 0x5605e69c2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:15.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fca7fc640 1 --2- 172.21.15.45:0/2616752731 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5605e69bd320 0x5605e69c20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:15.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fcaffd640 1 -- 172.21.15.45:0/2616752731 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5605e69bd320 msgr2=0x5605e69c20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:15.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fcaffd640 1 --2- 172.21.15.45:0/2616752731 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5605e69bd320 0x5605e69c20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fcaffd640 1 -- 172.21.15.45:0/2616752731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605e69c52f0 msgr2=0x5605e69c2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:15.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fcaffd640 1 --2- 172.21.15.45:0/2616752731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605e69c52f0 0x5605e69c2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fcaffd640 1 -- 172.21.15.45:0/2616752731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fbc00f040 con 0x5605e69bca10 2023-10-03T19:16:15.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fca7fc640 1 --2- 172.21.15.45:0/2616752731 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5605e69bd320 0x5605e69c20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:15.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fcaffd640 1 --2- 172.21.15.45:0/2616752731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5605e69bca10 0x5605e69c1bb0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009010 tx=0x7f4fbc000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca903f925e5eccd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:15.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fa9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-10-03T19:16:15.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fa9ffb640 1 -- 172.21.15.45:0/2616752731 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc005e80 con 0x5605e69bca10 2023-10-03T19:16:15.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fa9ffb640 1 -- 172.21.15.45:0/2616752731 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4fbc0072e0 con 0x5605e69bca10 2023-10-03T19:16:15.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fd479d000 1 -- 172.21.15.45:0/2616752731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5605e67ca480 con 0x5605e69bca10 2023-10-03T19:16:15.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fa9ffb640 1 -- 172.21.15.45:0/2616752731 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4fbc001360 con 0x5605e69bca10 2023-10-03T19:16:15.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fd479d000 10 client.5718 fetch_fsmap learned FSMap version 23 2023-10-03T19:16:15.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fd479d000 1 -- 172.21.15.45:0/2616752731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x5605e662d9b0 con 0x5605e69bca10 2023-10-03T19:16:15.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fa9ffb640 1 -- 172.21.15.45:0/2616752731 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5605e67ca480 con 0x5605e69bca10 2023-10-03T19:16:15.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fa9ffb640 1 -- 172.21.15.45:0/2616752731 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 23) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f4fbc0074a0 con 0x5605e69bca10 2023-10-03T19:16:15.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fd479d000 10 client.5718 fetch_fsmap finished waiting for FSMap version 23 2023-10-03T19:16:15.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fd479d000 10 client.5718 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-10-03T19:16:15.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fd479d000 20 client.5718 populate_metadata read hostname 'smithi045' 2023-10-03T19:16:15.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fd479d000 1 --2- 172.21.15.45:0/2616752731 >> [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] conn(0x5605e69c3040 0x5605e6a0ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:15.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fd479d000 4 client.5718 mds_command: new command op to 5514 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-03T19:16:15.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fd479d000 1 -- 172.21.15.45:0/2616752731 --> [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5605e67d64b0 con 0x5605e69c3040 2023-10-03T19:16:15.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fca7fc640 1 --2- 172.21.15.45:0/2616752731 >> [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] conn(0x5605e69c3040 0x5605e6a0ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:15.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fa9ffb640 10 client.5718 ms_handle_connect on v2:172.21.15.45:6833/1319730866 2023-10-03T19:16:15.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.690+0000 7f4fca7fc640 1 --2- 172.21.15.45:0/2616752731 >> [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] conn(0x5605e69c3040 0x5605e6a0ce00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b917d90db4f9b319 server_cookie=c9b037dcf9899c41 in_seq=0 out_seq=0 2023-10-03T19:16:15.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.694+0000 7f4fa9ffb640 1 -- 172.21.15.45:0/2616752731 <== mds.0 v2:172.21.15.45:6833/1319730866 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5605e67d64b0 con 0x5605e69c3040 2023-10-03T19:16:15.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.694+0000 7f4fa9ffb640 10 client.5718 handle_command_reply: tid=0 2023-10-03T19:16:15.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.694+0000 7f4fd479d000 1 client.5718 shutdown 2023-10-03T19:16:15.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.694+0000 7f4fd479d000 1 -- 172.21.15.45:0/2616752731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5605e69bca10 msgr2=0x5605e69c1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:15.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.694+0000 7f4fd479d000 1 --2- 172.21.15.45:0/2616752731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5605e69bca10 0x5605e69c1bb0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009010 tx=0x7f4fbc000ee0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.694+0000 7f4fd479d000 1 -- 172.21.15.45:0/2616752731 shutdown_connections 2023-10-03T19:16:15.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.694+0000 7f4fd479d000 1 --2- 172.21.15.45:0/2616752731 >> [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] conn(0x5605e69c3040 0x5605e6a0ce00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.694+0000 7f4fd479d000 1 --2- 172.21.15.45:0/2616752731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605e69c52f0 0x5605e69c2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.694+0000 7f4fd479d000 1 --2- 172.21.15.45:0/2616752731 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5605e69bd320 0x5605e69c20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.694+0000 7f4fa9ffb640 0 client.5718 ms_handle_reset on v2:172.21.15.45:6833/1319730866 2023-10-03T19:16:15.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.694+0000 7f4fd479d000 1 --2- 172.21.15.45:0/2616752731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5605e69bca10 0x5605e69c1bb0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.694+0000 7f4fd479d000 1 -- 172.21.15.45:0/2616752731 >> 172.21.15.45:0/2616752731 conn(0x5605e69f67f0 msgr2=0x5605e69bbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:15.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.694+0000 7f4fd479d000 1 -- 172.21.15.45:0/2616752731 shutdown_connections 2023-10-03T19:16:15.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.694+0000 7f4fd479d000 1 -- 172.21.15.45:0/2616752731 wait complete. 2023-10-03T19:16:15.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.694+0000 7f4fd479d000 20 client.5718 trim_cache size 0 max 16384 2023-10-03T19:16:15.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.702+0000 7f4fd479d000 1 Processor -- start 2023-10-03T19:16:15.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.702+0000 7f4fd479d000 1 -- start start 2023-10-03T19:16:15.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.702+0000 7f4fd479d000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605e69bca10 0x5605e6a0ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:15.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.702+0000 7f4fd479d000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5605e69bd320 0x5605e6a58620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:15.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.702+0000 7f4fd479d000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5605e69c52f0 0x5605e6a5ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:15.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.702+0000 7f4fd479d000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605e69c46c0 con 0x5605e69bd320 2023-10-03T19:16:15.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.702+0000 7f4fd479d000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605e64caa40 con 0x5605e69bca10 2023-10-03T19:16:15.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.702+0000 7f4fd479d000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x5605e6882940 con 0x5605e69c52f0 2023-10-03T19:16:15.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.702+0000 7f4fca7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5605e69bd320 0x5605e6a58620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:15.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.702+0000 7f4fca7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5605e69bd320 0x5605e6a58620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48318/0 (socket says 172.21.15.45:48318) 2023-10-03T19:16:15.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.702+0000 7f4fca7fc640 1 -- 172.21.15.45:0/1838106181 learned_addr learned my addr 172.21.15.45:0/1838106181 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:15.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.702+0000 7f4fcaffd640 1 --2- 172.21.15.45:0/1838106181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605e69bca10 0x5605e6a0ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:15.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.702+0000 7f4fcb7fe640 1 --2- 172.21.15.45:0/1838106181 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5605e69c52f0 0x5605e6a5ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:15.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.702+0000 7f4fca7fc640 1 -- 172.21.15.45:0/1838106181 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5605e69c52f0 msgr2=0x5605e6a5ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:15.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.702+0000 7f4fca7fc640 1 --2- 172.21.15.45:0/1838106181 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5605e69c52f0 0x5605e6a5ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.702+0000 7f4fca7fc640 1 -- 172.21.15.45:0/1838106181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605e69bca10 msgr2=0x5605e6a0ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:15.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.702+0000 7f4fca7fc640 1 --2- 172.21.15.45:0/1838106181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605e69bca10 0x5605e6a0ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.702+0000 7f4fca7fc640 1 -- 172.21.15.45:0/1838106181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605e67d2250 con 0x5605e69bd320 2023-10-03T19:16:15.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.702+0000 7f4fcaffd640 1 --2- 172.21.15.45:0/1838106181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605e69bca10 0x5605e6a0ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:15.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.702+0000 7f4fca7fc640 1 --2- 172.21.15.45:0/1838106181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5605e69bd320 0x5605e6a58620 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc146390 tx=0x7f4fc0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=206e0b072f746996 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:15.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fb17fa640 1 -- 172.21.15.45:0/1838106181 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0026040 con 0x5605e69bd320 2023-10-03T19:16:15.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fb17fa640 1 -- 172.21.15.45:0/1838106181 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc00295f0 con 0x5605e69bd320 2023-10-03T19:16:15.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fb17fa640 1 -- 172.21.15.45:0/1838106181 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0029d90 con 0x5605e69bd320 2023-10-03T19:16:15.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fd479d000 1 -- 172.21.15.45:0/1838106181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5605e69bd320 msgr2=0x5605e6a58620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:15.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fd479d000 1 --2- 172.21.15.45:0/1838106181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5605e69bd320 0x5605e6a58620 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc146390 tx=0x7f4fc0016000 comp rx=0 tx=0).stop 2023-10-03T19:16:15.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fd479d000 1 -- 172.21.15.45:0/1838106181 shutdown_connections 2023-10-03T19:16:15.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fd479d000 1 --2- 172.21.15.45:0/1838106181 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5605e69c52f0 0x5605e6a5ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fd479d000 1 --2- 172.21.15.45:0/1838106181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5605e69bd320 0x5605e6a58620 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fd479d000 1 --2- 172.21.15.45:0/1838106181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605e69bca10 0x5605e6a0ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fd479d000 1 -- 172.21.15.45:0/1838106181 >> 172.21.15.45:0/1838106181 conn(0x5605e69f67f0 msgr2=0x5605e69bbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:15.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fd479d000 1 -- 172.21.15.45:0/1838106181 shutdown_connections 2023-10-03T19:16:15.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fd479d000 1 -- 172.21.15.45:0/1838106181 wait complete. 2023-10-03T19:16:15.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fd479d000 1 -- start start 2023-10-03T19:16:15.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fd479d000 1 Processor -- start 2023-10-03T19:16:15.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fd479d000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605e69bca10 0x5605e6a56ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:15.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fd479d000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5605e69bd320 0x5605e6a56ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:15.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fd479d000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5605e69c52f0 0x5605e6a57a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:15.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fd479d000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605e67943f0 con 0x5605e69bd320 2023-10-03T19:16:15.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fd479d000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605e6a117d0 con 0x5605e69bca10 2023-10-03T19:16:15.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fd479d000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x5605e67d0030 con 0x5605e69c52f0 2023-10-03T19:16:15.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fd479d000 10 client.0 _ll_register_callbacks cb 0x5605e67bb9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T19:16:15.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fca7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5605e69bd320 0x5605e6a56ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:15.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fca7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5605e69bd320 0x5605e6a56ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48330/0 (socket says 172.21.15.45:48330) 2023-10-03T19:16:15.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fca7fc640 1 -- 172.21.15.45:0/1314209352 learned_addr learned my addr 172.21.15.45:0/1314209352 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:15.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fcaffd640 1 --2- 172.21.15.45:0/1314209352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605e69bca10 0x5605e6a56ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:15.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fcb7fe640 1 --2- 172.21.15.45:0/1314209352 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5605e69c52f0 0x5605e6a57a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:15.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fca7fc640 1 -- 172.21.15.45:0/1314209352 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5605e69c52f0 msgr2=0x5605e6a57a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:15.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fca7fc640 1 --2- 172.21.15.45:0/1314209352 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5605e69c52f0 0x5605e6a57a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fca7fc640 1 -- 172.21.15.45:0/1314209352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605e69bca10 msgr2=0x5605e6a56ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:15.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fca7fc640 1 --2- 172.21.15.45:0/1314209352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605e69bca10 0x5605e6a56ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:15.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fca7fc640 1 -- 172.21.15.45:0/1314209352 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc00298d0 con 0x5605e69bd320 2023-10-03T19:16:15.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fcb7fe640 1 --2- 172.21.15.45:0/1314209352 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5605e69c52f0 0x5605e6a57a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:15.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fca7fc640 1 --2- 172.21.15.45:0/1314209352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5605e69bd320 0x5605e6a56ff0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc0c19c0 tx=0x7f4fc0009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a73d38ccafaa91 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:15.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fa9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-10-03T19:16:15.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fa9ffb640 1 -- 172.21.15.45:0/1314209352 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0004450 con 0x5605e69bd320 2023-10-03T19:16:15.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fa9ffb640 1 -- 172.21.15.45:0/1314209352 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4fc0003620 con 0x5605e69bd320 2023-10-03T19:16:15.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fd479d000 1 -- 172.21.15.45:0/1314209352 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5605e67dc4e0 con 0x5605e69bd320 2023-10-03T19:16:15.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fa9ffb640 1 -- 172.21.15.45:0/1314209352 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4fc0003820 con 0x5605e69bd320 2023-10-03T19:16:15.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fd479d000 10 client.5724 fetch_fsmap learned FSMap version 23 2023-10-03T19:16:15.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fd479d000 1 -- 172.21.15.45:0/1314209352 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x5605e67b7c50 con 0x5605e69bd320 2023-10-03T19:16:15.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fa9ffb640 1 -- 172.21.15.45:0/1314209352 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5605e67dc4e0 con 0x5605e69bd320 2023-10-03T19:16:15.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fa9ffb640 1 -- 172.21.15.45:0/1314209352 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 23) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f4fc0029050 con 0x5605e69bd320 2023-10-03T19:16:15.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fd479d000 10 client.5724 fetch_fsmap finished waiting for FSMap version 23 2023-10-03T19:16:15.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fd479d000 10 client.5724 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-10-03T19:16:15.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fd479d000 20 client.5724 populate_metadata read hostname 'smithi045' 2023-10-03T19:16:15.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fd479d000 1 --2- 172.21.15.45:0/1314209352 >> [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] conn(0x5605e6a57fa0 0x5605e6a58370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:15.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fd479d000 4 client.5724 mds_command: new command op to 5514 tid=0[{"prefix": "cache drop"}] 2023-10-03T19:16:15.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fd479d000 1 -- 172.21.15.45:0/1314209352 --> [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] -- command(tid 0: {"prefix": "cache drop"}) v1 -- 0x5605e68061b0 con 0x5605e6a57fa0 2023-10-03T19:16:15.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fcaffd640 1 --2- 172.21.15.45:0/1314209352 >> [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] conn(0x5605e6a57fa0 0x5605e6a58370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:15.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fcaffd640 1 --2- 172.21.15.45:0/1314209352 >> [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] conn(0x5605e6a57fa0 0x5605e6a58370 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdba2196170088cf server_cookie=c924e30a84db5f59 in_seq=0 out_seq=0 2023-10-03T19:16:15.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:15.706+0000 7f4fa9ffb640 10 client.5724 ms_handle_connect on v2:172.21.15.45:6833/1319730866 2023-10-03T19:16:27.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.002+0000 7f4fa9ffb640 1 -- 172.21.15.45:0/1314209352 <== mds.0 v2:172.21.15.45:6833/1319730866 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+380 (crc 0 0 0) 0x5605e68061b0 con 0x5605e6a57fa0 2023-10-03T19:16:27.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.002+0000 7f4fa9ffb640 10 client.5724 handle_command_reply: tid=0 2023-10-03T19:16:27.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.002+0000 7f4fd479d000 1 client.5724 shutdown 2023-10-03T19:16:27.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.002+0000 7f4fd479d000 1 -- 172.21.15.45:0/1314209352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5605e69bd320 msgr2=0x5605e6a56ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:27.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.002+0000 7f4fd479d000 1 --2- 172.21.15.45:0/1314209352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5605e69bd320 0x5605e6a56ff0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc0c19c0 tx=0x7f4fc0009190 comp rx=0 tx=0).stop 2023-10-03T19:16:27.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.002+0000 7f4fd479d000 1 -- 172.21.15.45:0/1314209352 shutdown_connections 2023-10-03T19:16:27.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.002+0000 7f4fd479d000 1 --2- 172.21.15.45:0/1314209352 >> [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] conn(0x5605e6a57fa0 0x5605e6a58370 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:27.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.002+0000 7f4fd479d000 1 --2- 172.21.15.45:0/1314209352 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5605e69c52f0 0x5605e6a57a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:27.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.002+0000 7f4fd479d000 1 --2- 172.21.15.45:0/1314209352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5605e69bd320 0x5605e6a56ff0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:27.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.002+0000 7f4fd479d000 1 --2- 172.21.15.45:0/1314209352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5605e69bca10 0x5605e6a56ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:27.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.002+0000 7f4fa9ffb640 0 client.5724 ms_handle_reset on v2:172.21.15.45:6833/1319730866 2023-10-03T19:16:27.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.002+0000 7f4fd479d000 1 -- 172.21.15.45:0/1314209352 >> 172.21.15.45:0/1314209352 conn(0x5605e69f67f0 msgr2=0x5605e6a06c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:27.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.002+0000 7f4fd479d000 1 -- 172.21.15.45:0/1314209352 shutdown_connections 2023-10-03T19:16:27.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.002+0000 7f4fd479d000 1 -- 172.21.15.45:0/1314209352 wait complete. 2023-10-03T19:16:27.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.002+0000 7f4fd479d000 20 client.5724 trim_cache size 0 max 16384 2023-10-03T19:16:27.009 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-03T19:16:27.009 INFO:teuthology.orchestra.run.smithi045.stdout: "client_recall": { 2023-10-03T19:16:27.010 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2023-10-03T19:16:27.010 INFO:teuthology.orchestra.run.smithi045.stdout: "message": "(0) Success", 2023-10-03T19:16:27.010 INFO:teuthology.orchestra.run.smithi045.stdout: "recalled": 220 2023-10-03T19:16:27.010 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:16:27.010 INFO:teuthology.orchestra.run.smithi045.stdout: "flush_journal": { 2023-10-03T19:16:27.010 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2023-10-03T19:16:27.010 INFO:teuthology.orchestra.run.smithi045.stdout: "message": "" 2023-10-03T19:16:27.010 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:16:27.010 INFO:teuthology.orchestra.run.smithi045.stdout: "trim_cache": { 2023-10-03T19:16:27.010 INFO:teuthology.orchestra.run.smithi045.stdout: "trimmed": 0 2023-10-03T19:16:27.010 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:16:27.011 INFO:teuthology.orchestra.run.smithi045.stdout: "cache": { 2023-10-03T19:16:27.011 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": { 2023-10-03T19:16:27.011 INFO:teuthology.orchestra.run.smithi045.stdout: "items": 20464, 2023-10-03T19:16:27.011 INFO:teuthology.orchestra.run.smithi045.stdout: "bytes": 3230856 2023-10-03T19:16:27.011 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:16:27.011 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:16:27.011 INFO:teuthology.orchestra.run.smithi045.stdout: "duration": 11.292135638 2023-10-03T19:16:27.011 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-03T19:16:27.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.002+0000 7f4fd1679640 1 -- 172.21.15.45:0/3176117382 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4fb8066280 msgr2=0x7f4fb8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:27.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.002+0000 7f4fd1679640 1 --2- 172.21.15.45:0/3176117382 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4fb8066280 0x7f4fb8068730 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc143430 tx=0x7f4fc00095f0 comp rx=0 tx=0).stop 2023-10-03T19:16:27.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.002+0000 7f4fd1679640 1 -- 172.21.15.45:0/3176117382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fcc14ec80 msgr2=0x7f4fcc1eafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:27.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.002+0000 7f4fd1679640 1 --2- 172.21.15.45:0/3176117382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fcc14ec80 0x7f4fcc1eafe0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f4fc40b0040 tx=0x7f4fc40196c0 comp rx=0 tx=0).stop 2023-10-03T19:16:27.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.002+0000 7f4fd1679640 1 -- 172.21.15.45:0/3176117382 shutdown_connections 2023-10-03T19:16:27.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.002+0000 7f4fd1679640 1 --2- 172.21.15.45:0/3176117382 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4fb8066280 0x7f4fb8068730 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:27.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.002+0000 7f4fd1679640 1 --2- 172.21.15.45:0/3176117382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fcc14ec80 0x7f4fcc1eafe0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:27.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.002+0000 7f4fd1679640 1 --2- 172.21.15.45:0/3176117382 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4fcc06a0e0 0x7f4fcc1eaaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:27.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.002+0000 7f4fd1679640 1 --2- 172.21.15.45:0/3176117382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fcc0658f0 0x7f4fcc0a26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:27.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.002+0000 7f4fd1679640 1 -- 172.21.15.45:0/3176117382 >> 172.21.15.45:0/3176117382 conn(0x7f4fcc0c1510 msgr2=0x7f4fcc1438d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:27.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.002+0000 7f4fd1679640 1 -- 172.21.15.45:0/3176117382 shutdown_connections 2023-10-03T19:16:27.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.002+0000 7f4fd1679640 1 -- 172.21.15.45:0/3176117382 wait complete. 2023-10-03T19:16:27.024 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-03T19:16:27.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:16:27.024 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-10-03T19:16:27.040 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-03T19:16:27.040 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:16:27.068 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:16:27.123 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:16:27.183 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:16:27.253 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-03T19:16:27.253 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:16:27.253 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:16:27.259 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:16:27.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.386+0000 7f6fb4da3640 1 Processor -- start 2023-10-03T19:16:27.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.386+0000 7f6fb4da3640 1 -- start start 2023-10-03T19:16:27.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.390+0000 7f6fb4da3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6fb006f170 0x7f6fb0150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:27.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.390+0000 7f6fb4da3640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6fb00bc8b0 0x7f6fb014ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:27.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.390+0000 7f6fb4da3640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb006cac0 con 0x7f6fb006d170 2023-10-03T19:16:27.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.390+0000 7f6fb4da3640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb00720d0 con 0x7f6fb006f170 2023-10-03T19:16:27.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.390+0000 7f6fb4da3640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb00a5ab0 con 0x7f6fb00bc8b0 2023-10-03T19:16:27.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.390+0000 7f6fae59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6fb006f170 0x7f6fb0150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:27.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.390+0000 7f6fae59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6fb006f170 0x7f6fb0150190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47686/0 (socket says 172.21.15.45:47686) 2023-10-03T19:16:27.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.390+0000 7f6fae59c640 1 -- 172.21.15.45:0/437571001 learned_addr learned my addr 172.21.15.45:0/437571001 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:27.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.390+0000 7f6fadd9b640 1 --2- 172.21.15.45:0/437571001 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6fb00bc8b0 0x7f6fb014ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:27.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.390+0000 7f6fae59c640 1 -- 172.21.15.45:0/437571001 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6fb00bc8b0 msgr2=0x7f6fb014ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:27.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.390+0000 7f6fae59c640 1 --2- 172.21.15.45:0/437571001 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6fb00bc8b0 0x7f6fb014ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:27.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.390+0000 7f6fae59c640 1 -- 172.21.15.45:0/437571001 >> v1:172.21.15.79:6789/0 conn(0x7f6fb006d170 legacy=0x7f6fb014cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:27.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.390+0000 7f6fae59c640 1 -- 172.21.15.45:0/437571001 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb006cd00 con 0x7f6fb006f170 2023-10-03T19:16:27.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.390+0000 7f6fae59c640 1 --2- 172.21.15.45:0/437571001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fb006f170 0x7f6fb0150190 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0009e50 tx=0x7f6fa001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b817f02976d37285 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:27.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.390+0000 7f6fad59a640 1 -- 172.21.15.45:0/437571001 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa00af400 con 0x7f6fb006f170 2023-10-03T19:16:27.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.390+0000 7f6fad59a640 1 -- 172.21.15.45:0/437571001 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa00ab050 con 0x7f6fb006f170 2023-10-03T19:16:27.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.390+0000 7f6fad59a640 1 -- 172.21.15.45:0/437571001 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa00af780 con 0x7f6fb006f170 2023-10-03T19:16:27.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.390+0000 7f6fb4da3640 1 -- 172.21.15.45:0/437571001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fb006f170 msgr2=0x7f6fb0150190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:27.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.390+0000 7f6fb4da3640 1 --2- 172.21.15.45:0/437571001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fb006f170 0x7f6fb0150190 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0009e50 tx=0x7f6fa001f1c0 comp rx=0 tx=0).stop 2023-10-03T19:16:27.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.390+0000 7f6fb4da3640 1 -- 172.21.15.45:0/437571001 shutdown_connections 2023-10-03T19:16:27.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.390+0000 7f6fb4da3640 1 --2- 172.21.15.45:0/437571001 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6fb00bc8b0 0x7f6fb014ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:27.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.390+0000 7f6fb4da3640 1 --2- 172.21.15.45:0/437571001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fb006f170 0x7f6fb0150190 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:27.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.390+0000 7f6fb4da3640 1 -- 172.21.15.45:0/437571001 >> 172.21.15.45:0/437571001 conn(0x7f6fb00bcf50 msgr2=0x7f6fb00bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:27.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.390+0000 7f6fb4da3640 1 -- 172.21.15.45:0/437571001 shutdown_connections 2023-10-03T19:16:27.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.390+0000 7f6fb4da3640 1 -- 172.21.15.45:0/437571001 wait complete. 2023-10-03T19:16:27.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.394+0000 7f6fb4da3640 1 Processor -- start 2023-10-03T19:16:27.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.394+0000 7f6fb4da3640 1 -- start start 2023-10-03T19:16:27.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.394+0000 7f6fb4da3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fb006d170 0x7f6fb0144d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:27.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.394+0000 7f6fb4da3640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6fb006f170 0x7f6fb01e6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:27.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.394+0000 7f6fb4da3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fb00bc8b0 0x7f6fb00c0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:27.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.394+0000 7f6fb4da3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb0144a80 con 0x7f6fb006d170 2023-10-03T19:16:27.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.394+0000 7f6fb4da3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb00a4cc0 con 0x7f6fb00bc8b0 2023-10-03T19:16:27.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.394+0000 7f6fb4da3640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb00a5030 con 0x7f6fb006f170 2023-10-03T19:16:27.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.394+0000 7f6fae59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fb006d170 0x7f6fb0144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:27.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.394+0000 7f6fae59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fb006d170 0x7f6fb0144d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47700/0 (socket says 172.21.15.45:47700) 2023-10-03T19:16:27.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.394+0000 7f6fae59c640 1 -- 172.21.15.45:0/1369568410 learned_addr learned my addr 172.21.15.45:0/1369568410 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:27.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.394+0000 7f6faed9d640 1 --2- 172.21.15.45:0/1369568410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fb00bc8b0 0x7f6fb00c0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:27.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.394+0000 7f6fadd9b640 1 --2- 172.21.15.45:0/1369568410 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6fb006f170 0x7f6fb01e6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:27.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.394+0000 7f6fae59c640 1 -- 172.21.15.45:0/1369568410 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6fb006f170 msgr2=0x7f6fb01e6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:27.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.394+0000 7f6fae59c640 1 --2- 172.21.15.45:0/1369568410 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6fb006f170 0x7f6fb01e6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:27.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.394+0000 7f6fae59c640 1 -- 172.21.15.45:0/1369568410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fb00bc8b0 msgr2=0x7f6fb00c0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:27.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.394+0000 7f6fae59c640 1 --2- 172.21.15.45:0/1369568410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fb00bc8b0 0x7f6fb00c0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:27.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.394+0000 7f6fae59c640 1 -- 172.21.15.45:0/1369568410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa0009b30 con 0x7f6fb006d170 2023-10-03T19:16:27.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.394+0000 7f6fae59c640 1 --2- 172.21.15.45:0/1369568410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fb006d170 0x7f6fb0144d60 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00b2040 tx=0x7f6fa001bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:27.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.394+0000 7f6f9effd640 1 -- 172.21.15.45:0/1369568410 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa00c0070 con 0x7f6fb006d170 2023-10-03T19:16:27.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.394+0000 7f6f9effd640 1 -- 172.21.15.45:0/1369568410 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa0009510 con 0x7f6fb006d170 2023-10-03T19:16:27.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.394+0000 7f6fb4da3640 1 -- 172.21.15.45:0/1369568410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb014c4a0 con 0x7f6fb006d170 2023-10-03T19:16:27.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.394+0000 7f6f9effd640 1 -- 172.21.15.45:0/1369568410 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa00afea0 con 0x7f6fb006d170 2023-10-03T19:16:27.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.394+0000 7f6fb4da3640 1 -- 172.21.15.45:0/1369568410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb014fae0 con 0x7f6fb006d170 2023-10-03T19:16:27.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.394+0000 7f6fb4da3640 1 -- 172.21.15.45:0/1369568410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb00a4e80 con 0x7f6fb006d170 2023-10-03T19:16:27.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.398+0000 7f6f9effd640 1 -- 172.21.15.45:0/1369568410 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6fa00b6040 con 0x7f6fb006d170 2023-10-03T19:16:27.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.398+0000 7f6f9effd640 1 --2- 172.21.15.45:0/1369568410 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6f90066280 0x7f6f90068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:27.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.398+0000 7f6f9effd640 1 -- 172.21.15.45:0/1369568410 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6fa0121790 con 0x7f6fb006d170 2023-10-03T19:16:27.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.398+0000 7f6fadd9b640 1 --2- 172.21.15.45:0/1369568410 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6f90066280 0x7f6f90068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:27.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.398+0000 7f6fadd9b640 1 --2- 172.21.15.45:0/1369568410 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6f90066280 0x7f6f90068730 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0071410 tx=0x7f6fa4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:27.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.402+0000 7f6f9effd640 1 -- 172.21.15.45:0/1369568410 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6fa00eec90 con 0x7f6fb006d170 2023-10-03T19:16:27.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.554+0000 7f6fb4da3640 1 -- 172.21.15.45:0/1369568410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fb006d660 con 0x7f6fb006d170 2023-10-03T19:16:27.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.558+0000 7f6f9effd640 1 -- 172.21.15.45:0/1369568410 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18399 (secure 0 0 0) 0x7f6fa00f22b0 con 0x7f6fb006d170 2023-10-03T19:16:27.565 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:16:27.565 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":50,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:16:13.667014+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:15:44.458794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-03T19:15:45.219182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.1d","mappings":[{"from":0,"to":6}]},{"pgid":"8.3d","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:16:27.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.562+0000 7f6fb4da3640 1 -- 172.21.15.45:0/1369568410 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6f90066280 msgr2=0x7f6f90068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:27.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.562+0000 7f6fb4da3640 1 --2- 172.21.15.45:0/1369568410 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6f90066280 0x7f6f90068730 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0071410 tx=0x7f6fa4008040 comp rx=0 tx=0).stop 2023-10-03T19:16:27.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.562+0000 7f6fb4da3640 1 -- 172.21.15.45:0/1369568410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fb006d170 msgr2=0x7f6fb0144d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:27.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.562+0000 7f6fb4da3640 1 --2- 172.21.15.45:0/1369568410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fb006d170 0x7f6fb0144d60 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00b2040 tx=0x7f6fa001bf60 comp rx=0 tx=0).stop 2023-10-03T19:16:27.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.562+0000 7f6fb4da3640 1 -- 172.21.15.45:0/1369568410 shutdown_connections 2023-10-03T19:16:27.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.562+0000 7f6fb4da3640 1 --2- 172.21.15.45:0/1369568410 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6f90066280 0x7f6f90068730 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:27.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.562+0000 7f6fb4da3640 1 --2- 172.21.15.45:0/1369568410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fb00bc8b0 0x7f6fb00c0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:27.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.562+0000 7f6fb4da3640 1 --2- 172.21.15.45:0/1369568410 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6fb006f170 0x7f6fb01e6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:27.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.562+0000 7f6fb4da3640 1 --2- 172.21.15.45:0/1369568410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fb006d170 0x7f6fb0144d60 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:27.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.562+0000 7f6fb4da3640 1 -- 172.21.15.45:0/1369568410 >> 172.21.15.45:0/1369568410 conn(0x7f6fb00bcf50 msgr2=0x7f6fb00bb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:27.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.562+0000 7f6fb4da3640 1 -- 172.21.15.45:0/1369568410 shutdown_connections 2023-10-03T19:16:27.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.562+0000 7f6fb4da3640 1 -- 172.21.15.45:0/1369568410 wait complete. 2023-10-03T19:16:27.584 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T19:15:44.458794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T19:15:45.219182+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:16:27.584 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:16:27.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.706+0000 7f8551dd2640 1 Processor -- start 2023-10-03T19:16:27.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.706+0000 7f8551dd2640 1 -- start start 2023-10-03T19:16:27.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.710+0000 7f8551dd2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f854c150340 0x7f854c153660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:27.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.710+0000 7f8551dd2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f854c156710 0x7f854c156b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:27.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.710+0000 7f8551dd2640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f854c153ba0 con 0x7f854c06c3d0 2023-10-03T19:16:27.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.710+0000 7f8551dd2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f854c1570b0 con 0x7f854c156710 2023-10-03T19:16:27.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.710+0000 7f8551dd2640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f854c156280 con 0x7f854c150340 2023-10-03T19:16:27.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.710+0000 7f854bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f854c156710 0x7f854c156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:27.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.710+0000 7f854bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f854c156710 0x7f854c156b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47704/0 (socket says 172.21.15.45:47704) 2023-10-03T19:16:27.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.710+0000 7f854bfff640 1 -- 172.21.15.45:0/10860248 learned_addr learned my addr 172.21.15.45:0/10860248 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:27.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.710+0000 7f854b7fe640 1 --2- 172.21.15.45:0/10860248 >> v2:172.21.15.79:3300/0 conn(0x7f854c150340 0x7f854c153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:27.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.710+0000 7f854bfff640 1 -- 172.21.15.45:0/10860248 >> v2:172.21.15.79:3300/0 conn(0x7f854c150340 msgr2=0x7f854c153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:27.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.710+0000 7f854bfff640 1 --2- 172.21.15.45:0/10860248 >> v2:172.21.15.79:3300/0 conn(0x7f854c150340 0x7f854c153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:27.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.710+0000 7f854bfff640 1 -- 172.21.15.45:0/10860248 >> v1:172.21.15.79:6789/0 conn(0x7f854c06c3d0 legacy=0x7f854c0a1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:27.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.710+0000 7f854bfff640 1 -- 172.21.15.45:0/10860248 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854c06d1f0 con 0x7f854c156710 2023-10-03T19:16:27.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.710+0000 7f854b7fe640 1 --2- 172.21.15.45:0/10860248 >> v2:172.21.15.79:3300/0 conn(0x7f854c150340 0x7f854c153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:16:27.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.714+0000 7f854bfff640 1 --2- 172.21.15.45:0/10860248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f854c156710 0x7f854c156b70 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f854c0a1c70 tx=0x7f854401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=863f5f313c0bb80 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:27.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.714+0000 7f854a7fc640 1 -- 172.21.15.45:0/10860248 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85440af400 con 0x7f854c156710 2023-10-03T19:16:27.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.714+0000 7f854a7fc640 1 -- 172.21.15.45:0/10860248 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85440ab050 con 0x7f854c156710 2023-10-03T19:16:27.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.714+0000 7f854a7fc640 1 -- 172.21.15.45:0/10860248 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85440af780 con 0x7f854c156710 2023-10-03T19:16:27.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.714+0000 7f8551dd2640 1 -- 172.21.15.45:0/10860248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f854c156710 msgr2=0x7f854c156b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:27.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.714+0000 7f8551dd2640 1 --2- 172.21.15.45:0/10860248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f854c156710 0x7f854c156b70 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f854c0a1c70 tx=0x7f854401f1c0 comp rx=0 tx=0).stop 2023-10-03T19:16:27.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.714+0000 7f8551dd2640 1 -- 172.21.15.45:0/10860248 shutdown_connections 2023-10-03T19:16:27.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.714+0000 7f8551dd2640 1 --2- 172.21.15.45:0/10860248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f854c156710 0x7f854c156b70 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:27.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.714+0000 7f8551dd2640 1 --2- 172.21.15.45:0/10860248 >> v2:172.21.15.79:3300/0 conn(0x7f854c150340 0x7f854c153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:27.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.714+0000 7f8551dd2640 1 -- 172.21.15.45:0/10860248 >> 172.21.15.45:0/10860248 conn(0x7f854c0a20d0 msgr2=0x7f854c0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:27.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.714+0000 7f8551dd2640 1 -- 172.21.15.45:0/10860248 shutdown_connections 2023-10-03T19:16:27.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.714+0000 7f8551dd2640 1 -- 172.21.15.45:0/10860248 wait complete. 2023-10-03T19:16:27.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.714+0000 7f8551dd2640 1 Processor -- start 2023-10-03T19:16:27.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.714+0000 7f8551dd2640 1 -- start start 2023-10-03T19:16:27.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.718+0000 7f8551dd2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f854c06c3d0 0x7f854c0be0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:27.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.718+0000 7f8551dd2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f854c150340 0x7f854c14f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:27.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.718+0000 7f8551dd2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f854c156710 0x7f854c1eb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:27.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.718+0000 7f8551dd2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854c145c40 con 0x7f854c156710 2023-10-03T19:16:27.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.718+0000 7f8551dd2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854c14aca0 con 0x7f854c06c3d0 2023-10-03T19:16:27.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.718+0000 7f8551dd2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854c145e10 con 0x7f854c150340 2023-10-03T19:16:27.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.718+0000 7f854bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f854c156710 0x7f854c1eb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:27.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.718+0000 7f854bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f854c156710 0x7f854c1eb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47712/0 (socket says 172.21.15.45:47712) 2023-10-03T19:16:27.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.718+0000 7f854bfff640 1 -- 172.21.15.45:0/2982232163 learned_addr learned my addr 172.21.15.45:0/2982232163 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:27.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.718+0000 7f854b7fe640 1 --2- 172.21.15.45:0/2982232163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f854c06c3d0 0x7f854c0be0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:27.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.718+0000 7f854affd640 1 --2- 172.21.15.45:0/2982232163 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f854c150340 0x7f854c14f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:27.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.718+0000 7f854bfff640 1 -- 172.21.15.45:0/2982232163 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f854c150340 msgr2=0x7f854c14f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:27.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.718+0000 7f854bfff640 1 --2- 172.21.15.45:0/2982232163 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f854c150340 0x7f854c14f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:27.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.718+0000 7f854bfff640 1 -- 172.21.15.45:0/2982232163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f854c06c3d0 msgr2=0x7f854c0be0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:27.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.718+0000 7f854bfff640 1 --2- 172.21.15.45:0/2982232163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f854c06c3d0 0x7f854c0be0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:27.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.718+0000 7f854bfff640 1 -- 172.21.15.45:0/2982232163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8544009b30 con 0x7f854c156710 2023-10-03T19:16:27.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.718+0000 7f854b7fe640 1 --2- 172.21.15.45:0/2982232163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f854c06c3d0 0x7f854c0be0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:16:27.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.718+0000 7f854bfff640 1 --2- 172.21.15.45:0/2982232163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f854c156710 0x7f854c1eb170 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f85440b2040 tx=0x7f854401bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:27.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.718+0000 7f8533fff640 1 -- 172.21.15.45:0/2982232163 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85440afdc0 con 0x7f854c156710 2023-10-03T19:16:27.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.718+0000 7f8533fff640 1 -- 172.21.15.45:0/2982232163 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8544009510 con 0x7f854c156710 2023-10-03T19:16:27.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.718+0000 7f8551dd2640 1 -- 172.21.15.45:0/2982232163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f854c0a1870 con 0x7f854c156710 2023-10-03T19:16:27.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.718+0000 7f8533fff640 1 -- 172.21.15.45:0/2982232163 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85440ba660 con 0x7f854c156710 2023-10-03T19:16:27.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.718+0000 7f8551dd2640 1 -- 172.21.15.45:0/2982232163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f854c06d490 con 0x7f854c156710 2023-10-03T19:16:27.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.718+0000 7f8551dd2640 1 -- 172.21.15.45:0/2982232163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f854c06d770 con 0x7f854c156710 2023-10-03T19:16:27.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.722+0000 7f8533fff640 1 -- 172.21.15.45:0/2982232163 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f85440b6040 con 0x7f854c156710 2023-10-03T19:16:27.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.722+0000 7f8533fff640 1 --2- 172.21.15.45:0/2982232163 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8538066280 0x7f8538068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:27.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.722+0000 7f8533fff640 1 -- 172.21.15.45:0/2982232163 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8544122030 con 0x7f854c156710 2023-10-03T19:16:27.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.722+0000 7f854b7fe640 1 --2- 172.21.15.45:0/2982232163 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8538066280 0x7f8538068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:27.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.722+0000 7f854b7fe640 1 --2- 172.21.15.45:0/2982232163 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8538066280 0x7f8538068730 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f853c009970 tx=0x7f853c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:27.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.726+0000 7f8533fff640 1 -- 172.21.15.45:0/2982232163 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f85440ef470 con 0x7f854c156710 2023-10-03T19:16:27.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.894+0000 7f8551dd2640 1 -- 172.21.15.45:0/2982232163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f854c04de80 con 0x7f854c156710 2023-10-03T19:16:27.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.894+0000 7f8533fff640 1 -- 172.21.15.45:0/2982232163 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7f85440f2a90 con 0x7f854c156710 2023-10-03T19:16:27.901 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:16:27.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.898+0000 7f8551dd2640 1 -- 172.21.15.45:0/2982232163 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8538066280 msgr2=0x7f8538068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:27.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.898+0000 7f8551dd2640 1 --2- 172.21.15.45:0/2982232163 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8538066280 0x7f8538068730 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f853c009970 tx=0x7f853c008040 comp rx=0 tx=0).stop 2023-10-03T19:16:27.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.898+0000 7f8551dd2640 1 -- 172.21.15.45:0/2982232163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f854c156710 msgr2=0x7f854c1eb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:27.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.898+0000 7f8551dd2640 1 --2- 172.21.15.45:0/2982232163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f854c156710 0x7f854c1eb170 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f85440b2040 tx=0x7f854401bf60 comp rx=0 tx=0).stop 2023-10-03T19:16:27.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.898+0000 7f8551dd2640 1 -- 172.21.15.45:0/2982232163 shutdown_connections 2023-10-03T19:16:27.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.898+0000 7f8551dd2640 1 --2- 172.21.15.45:0/2982232163 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8538066280 0x7f8538068730 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:27.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.898+0000 7f8551dd2640 1 --2- 172.21.15.45:0/2982232163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f854c156710 0x7f854c1eb170 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:27.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.898+0000 7f8551dd2640 1 --2- 172.21.15.45:0/2982232163 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f854c150340 0x7f854c14f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:27.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.898+0000 7f8551dd2640 1 --2- 172.21.15.45:0/2982232163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f854c06c3d0 0x7f854c0be0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:27.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.898+0000 7f8551dd2640 1 -- 172.21.15.45:0/2982232163 >> 172.21.15.45:0/2982232163 conn(0x7f854c0a20d0 msgr2=0x7f854c149eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:27.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.898+0000 7f8551dd2640 1 -- 172.21.15.45:0/2982232163 shutdown_connections 2023-10-03T19:16:27.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:27.898+0000 7f8551dd2640 1 -- 172.21.15.45:0/2982232163 wait complete. 2023-10-03T19:16:27.921 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:16:28.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.042+0000 7f0221de8640 1 Processor -- start 2023-10-03T19:16:28.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.042+0000 7f0221de8640 1 -- start start 2023-10-03T19:16:28.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.042+0000 7f0221de8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f021c148540 0x7f021c0bb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:28.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.042+0000 7f0221de8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f021c06d630 0x7f021c14e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:28.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.042+0000 7f0221de8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f021c0bb5a0 0x7f021c14eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:28.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.042+0000 7f0221de8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f021c14e550 con 0x7f021c0bb5a0 2023-10-03T19:16:28.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.042+0000 7f0221de8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f021c0bcf80 con 0x7f021c06d630 2023-10-03T19:16:28.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.042+0000 7f0221de8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0bd260 con 0x7f021c148540 2023-10-03T19:16:28.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.042+0000 7f021bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f021c0bb5a0 0x7f021c14eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:28.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.042+0000 7f021bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f021c0bb5a0 0x7f021c14eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47716/0 (socket says 172.21.15.45:47716) 2023-10-03T19:16:28.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.042+0000 7f021bfff640 1 -- 172.21.15.45:0/2950984761 learned_addr learned my addr 172.21.15.45:0/2950984761 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:28.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.042+0000 7f0213fff640 1 --2- 172.21.15.45:0/2950984761 >> v2:172.21.15.79:3300/0 conn(0x7f021c06d630 0x7f021c14e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:28.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.042+0000 7f021b7fe640 1 --2- 172.21.15.45:0/2950984761 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f021c148540 0x7f021c0bb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:28.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.042+0000 7f021bfff640 1 -- 172.21.15.45:0/2950984761 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f021c148540 msgr2=0x7f021c0bb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:28.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.042+0000 7f021bfff640 1 --2- 172.21.15.45:0/2950984761 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f021c148540 0x7f021c0bb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.042+0000 7f021bfff640 1 -- 172.21.15.45:0/2950984761 >> v2:172.21.15.79:3300/0 conn(0x7f021c06d630 msgr2=0x7f021c14e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:28.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.042+0000 7f021bfff640 1 --2- 172.21.15.45:0/2950984761 >> v2:172.21.15.79:3300/0 conn(0x7f021c06d630 0x7f021c14e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.042+0000 7f021bfff640 1 -- 172.21.15.45:0/2950984761 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c0bd540 con 0x7f021c0bb5a0 2023-10-03T19:16:28.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f021bfff640 1 --2- 172.21.15.45:0/2950984761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f021c0bb5a0 0x7f021c14eee0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f021c06ead0 tx=0x7f021401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4e1c8b85335a04 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:28.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f021affd640 1 -- 172.21.15.45:0/2950984761 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02140a56f0 con 0x7f021c0bb5a0 2023-10-03T19:16:28.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f021affd640 1 -- 172.21.15.45:0/2950984761 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02140a5850 con 0x7f021c0bb5a0 2023-10-03T19:16:28.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f021affd640 1 -- 172.21.15.45:0/2950984761 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02140a5be0 con 0x7f021c0bb5a0 2023-10-03T19:16:28.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f0221de8640 1 -- 172.21.15.45:0/2950984761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f021c0bb5a0 msgr2=0x7f021c14eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:28.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f0221de8640 1 --2- 172.21.15.45:0/2950984761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f021c0bb5a0 0x7f021c14eee0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f021c06ead0 tx=0x7f021401c940 comp rx=0 tx=0).stop 2023-10-03T19:16:28.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f0221de8640 1 -- 172.21.15.45:0/2950984761 shutdown_connections 2023-10-03T19:16:28.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f0221de8640 1 --2- 172.21.15.45:0/2950984761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f021c0bb5a0 0x7f021c14eee0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f0221de8640 1 --2- 172.21.15.45:0/2950984761 >> v2:172.21.15.79:3300/0 conn(0x7f021c06d630 0x7f021c14e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f0221de8640 1 --2- 172.21.15.45:0/2950984761 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f021c148540 0x7f021c0bb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f0221de8640 1 -- 172.21.15.45:0/2950984761 >> 172.21.15.45:0/2950984761 conn(0x7f021c0a20d0 msgr2=0x7f021c0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:28.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f0221de8640 1 -- 172.21.15.45:0/2950984761 shutdown_connections 2023-10-03T19:16:28.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f0221de8640 1 -- 172.21.15.45:0/2950984761 wait complete. 2023-10-03T19:16:28.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f0221de8640 1 Processor -- start 2023-10-03T19:16:28.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f0221de8640 1 -- start start 2023-10-03T19:16:28.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f0221de8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f021c06d630 0x7f021c151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:28.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f0221de8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f021c0bb5a0 0x7f021c1507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:28.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f0221de8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f021c148540 0x7f021c150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:28.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f0221de8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c14a120 con 0x7f021c148540 2023-10-03T19:16:28.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f0221de8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c1e72f0 con 0x7f021c06d630 2023-10-03T19:16:28.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f0221de8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c152320 con 0x7f021c0bb5a0 2023-10-03T19:16:28.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f021bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f021c148540 0x7f021c150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:28.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f021bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f021c148540 0x7f021c150d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47722/0 (socket says 172.21.15.45:47722) 2023-10-03T19:16:28.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f021bfff640 1 -- 172.21.15.45:0/2229846022 learned_addr learned my addr 172.21.15.45:0/2229846022 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:28.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f0213fff640 1 --2- 172.21.15.45:0/2229846022 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f021c0bb5a0 0x7f021c1507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:28.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f021b7fe640 1 --2- 172.21.15.45:0/2229846022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f021c06d630 0x7f021c151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:28.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f021bfff640 1 -- 172.21.15.45:0/2229846022 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f021c0bb5a0 msgr2=0x7f021c1507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:28.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f021bfff640 1 --2- 172.21.15.45:0/2229846022 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f021c0bb5a0 0x7f021c1507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f021bfff640 1 -- 172.21.15.45:0/2229846022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f021c06d630 msgr2=0x7f021c151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:28.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f021bfff640 1 --2- 172.21.15.45:0/2229846022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f021c06d630 0x7f021c151de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f021bfff640 1 -- 172.21.15.45:0/2229846022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0214009b30 con 0x7f021c148540 2023-10-03T19:16:28.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f021bfff640 1 --2- 172.21.15.45:0/2229846022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f021c148540 0x7f021c150d10 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f02140af040 tx=0x7f02140196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:28.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f0218ff9640 1 -- 172.21.15.45:0/2229846022 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02140b8670 con 0x7f021c148540 2023-10-03T19:16:28.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f0218ff9640 1 -- 172.21.15.45:0/2229846022 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02140b87d0 con 0x7f021c148540 2023-10-03T19:16:28.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.046+0000 7f0218ff9640 1 -- 172.21.15.45:0/2229846022 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02140b8b80 con 0x7f021c148540 2023-10-03T19:16:28.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.050+0000 7f0221de8640 1 -- 172.21.15.45:0/2229846022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021c0bdda0 con 0x7f021c148540 2023-10-03T19:16:28.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.050+0000 7f0221de8640 1 -- 172.21.15.45:0/2229846022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021c0bdc10 con 0x7f021c148540 2023-10-03T19:16:28.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.050+0000 7f0221de8640 1 -- 172.21.15.45:0/2229846022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021c0b9f60 con 0x7f021c148540 2023-10-03T19:16:28.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.050+0000 7f0218ff9640 1 -- 172.21.15.45:0/2229846022 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f02140b8ce0 con 0x7f021c148540 2023-10-03T19:16:28.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.050+0000 7f0218ff9640 1 --2- 172.21.15.45:0/2229846022 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f01fc0662b0 0x7f01fc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:28.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.050+0000 7f0218ff9640 1 -- 172.21.15.45:0/2229846022 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f021411f250 con 0x7f021c148540 2023-10-03T19:16:28.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.050+0000 7f021b7fe640 1 --2- 172.21.15.45:0/2229846022 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f01fc0662b0 0x7f01fc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:28.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.050+0000 7f021b7fe640 1 --2- 172.21.15.45:0/2229846022 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f01fc0662b0 0x7f01fc068760 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f020c00b930 tx=0x7f020c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:28.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.054+0000 7f0218ff9640 1 -- 172.21.15.45:0/2229846022 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f02140ec890 con 0x7f021c148540 2023-10-03T19:16:28.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.210+0000 7f0221de8640 1 -- 172.21.15.45:0/2229846022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f021c151250 con 0x7f021c148540 2023-10-03T19:16:28.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.210+0000 7f0218ff9640 1 -- 172.21.15.45:0/2229846022 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v50) v1 ==== 92+0+10 (secure 0 0 0) 0x7f02140efeb0 con 0x7f021c148540 2023-10-03T19:16:28.216 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:16:28.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.210+0000 7f0221de8640 1 -- 172.21.15.45:0/2229846022 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f01fc0662b0 msgr2=0x7f01fc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:28.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.210+0000 7f0221de8640 1 --2- 172.21.15.45:0/2229846022 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f01fc0662b0 0x7f01fc068760 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f020c00b930 tx=0x7f020c008040 comp rx=0 tx=0).stop 2023-10-03T19:16:28.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.210+0000 7f0221de8640 1 -- 172.21.15.45:0/2229846022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f021c148540 msgr2=0x7f021c150d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:28.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.210+0000 7f0221de8640 1 --2- 172.21.15.45:0/2229846022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f021c148540 0x7f021c150d10 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f02140af040 tx=0x7f02140196e0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.210+0000 7f0221de8640 1 -- 172.21.15.45:0/2229846022 shutdown_connections 2023-10-03T19:16:28.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.210+0000 7f0221de8640 1 --2- 172.21.15.45:0/2229846022 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f01fc0662b0 0x7f01fc068760 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.210+0000 7f0221de8640 1 --2- 172.21.15.45:0/2229846022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f021c148540 0x7f021c150d10 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.210+0000 7f0221de8640 1 --2- 172.21.15.45:0/2229846022 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f021c0bb5a0 0x7f021c1507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.210+0000 7f0221de8640 1 --2- 172.21.15.45:0/2229846022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f021c06d630 0x7f021c151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.210+0000 7f0221de8640 1 -- 172.21.15.45:0/2229846022 >> 172.21.15.45:0/2229846022 conn(0x7f021c0a20d0 msgr2=0x7f021c14e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:28.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.210+0000 7f0221de8640 1 -- 172.21.15.45:0/2229846022 shutdown_connections 2023-10-03T19:16:28.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.210+0000 7f0221de8640 1 -- 172.21.15.45:0/2229846022 wait complete. 2023-10-03T19:16:28.235 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T19:16:28.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc3a4b57640 1 Processor -- start 2023-10-03T19:16:28.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc3a4b57640 1 -- start start 2023-10-03T19:16:28.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc3a4b57640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc3a00712c0 0x7fc3a00bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:28.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc3a4b57640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a006c2d0 con 0x7fc3a006c760 2023-10-03T19:16:28.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc3a4b57640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a0150610 con 0x7fc3a006d560 2023-10-03T19:16:28.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc3a4b57640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a01508b0 con 0x7fc3a00712c0 2023-10-03T19:16:28.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc39ed9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc3a006c760 0x7fc3a00a5ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44902/0 (socket says 172.21.15.45:44902) 2023-10-03T19:16:28.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc39ed9d640 1 -- 172.21.15.45:0/646009745 learned_addr learned my addr 172.21.15.45:0/646009745 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:28.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc39e59c640 1 --2- 172.21.15.45:0/646009745 >> v2:172.21.15.79:3300/0 conn(0x7fc3a00712c0 0x7fc3a00bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:28.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc39d59a640 1 -- 172.21.15.45:0/646009745 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2300955606 0 0) 0x7fc3a006c2d0 con 0x7fc3a006c760 2023-10-03T19:16:28.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc39d59a640 1 -- 172.21.15.45:0/646009745 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc388003530 con 0x7fc3a006c760 2023-10-03T19:16:28.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc39d59a640 1 -- 172.21.15.45:0/646009745 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1830331052 0 0) 0x7fc388003530 con 0x7fc3a006c760 2023-10-03T19:16:28.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc39d59a640 1 -- 172.21.15.45:0/646009745 >> v2:172.21.15.79:3300/0 conn(0x7fc3a00712c0 msgr2=0x7fc3a00bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:28.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc39d59a640 1 --2- 172.21.15.45:0/646009745 >> v2:172.21.15.79:3300/0 conn(0x7fc3a00712c0 0x7fc3a00bcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc39d59a640 1 -- 172.21.15.45:0/646009745 >> v1:172.21.15.79:6789/0 conn(0x7fc3a006d560 legacy=0x7fc3a00a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:28.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc39d59a640 1 -- 172.21.15.45:0/646009745 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a006d2e0 con 0x7fc3a006c760 2023-10-03T19:16:28.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc39d59a640 1 -- 172.21.15.45:0/646009745 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fc398001a00 con 0x7fc3a006c760 2023-10-03T19:16:28.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc39d59a640 1 -- 172.21.15.45:0/646009745 >> v1:172.21.15.45:6789/0 conn(0x7fc3a006c760 legacy=0x7fc3a00a5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:28.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc39d59a640 1 --2- 172.21.15.45:0/646009745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc388003980 0x7fc388003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:28.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc39d59a640 1 --2- 172.21.15.45:0/646009745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3880047d0 0x7fc388004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:28.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc39d59a640 1 --2- 172.21.15.45:0/646009745 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc388005180 0x7fc38800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:28.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc39d59a640 1 -- 172.21.15.45:0/646009745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a01508b0 con 0x7fc388003980 2023-10-03T19:16:28.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc39d59a640 1 -- 172.21.15.45:0/646009745 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38800c000 con 0x7fc3880047d0 2023-10-03T19:16:28.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc39d59a640 1 -- 172.21.15.45:0/646009745 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc38800c1c0 con 0x7fc388005180 2023-10-03T19:16:28.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc39e59c640 1 --2- 172.21.15.45:0/646009745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc388003980 0x7fc388003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:28.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc39dd9b640 1 --2- 172.21.15.45:0/646009745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3880047d0 0x7fc388004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:28.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc39ed9d640 1 --2- 172.21.15.45:0/646009745 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc388005180 0x7fc38800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:28.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc39e59c640 1 -- 172.21.15.45:0/646009745 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc388005180 msgr2=0x7fc38800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:28.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc39e59c640 1 --2- 172.21.15.45:0/646009745 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc388005180 0x7fc38800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc39e59c640 1 -- 172.21.15.45:0/646009745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3880047d0 msgr2=0x7fc388004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:28.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc39e59c640 1 --2- 172.21.15.45:0/646009745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3880047d0 0x7fc388004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc39e59c640 1 -- 172.21.15.45:0/646009745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc388003530 con 0x7fc388003980 2023-10-03T19:16:28.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc39ed9d640 1 --2- 172.21.15.45:0/646009745 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc388005180 0x7fc38800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:28.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.354+0000 7fc39ed9d640 1 -- 172.21.15.45:0/646009745 reap_dead start 2023-10-03T19:16:28.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.358+0000 7fc39e59c640 1 --2- 172.21.15.45:0/646009745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc388003980 0x7fc388003d90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc390009ae0 tx=0x7fc39001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1014bcf742b1984 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:28.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.358+0000 7fc39d59a640 1 -- 172.21.15.45:0/646009745 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3900a6470 con 0x7fc388003980 2023-10-03T19:16:28.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.358+0000 7fc39d59a640 1 -- 172.21.15.45:0/646009745 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3900a65d0 con 0x7fc388003980 2023-10-03T19:16:28.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.358+0000 7fc39d59a640 1 -- 172.21.15.45:0/646009745 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3900a6980 con 0x7fc388003980 2023-10-03T19:16:28.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.358+0000 7fc3a4b57640 1 -- 172.21.15.45:0/646009745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc388003980 msgr2=0x7fc388003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:28.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.358+0000 7fc3a4b57640 1 --2- 172.21.15.45:0/646009745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc388003980 0x7fc388003d90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc390009ae0 tx=0x7fc39001ca50 comp rx=0 tx=0).stop 2023-10-03T19:16:28.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.358+0000 7fc3a4b57640 1 -- 172.21.15.45:0/646009745 shutdown_connections 2023-10-03T19:16:28.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.358+0000 7fc3a4b57640 1 --2- 172.21.15.45:0/646009745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc388003980 0x7fc388003d90 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.358+0000 7fc3a4b57640 1 -- 172.21.15.45:0/646009745 >> 172.21.15.45:0/646009745 conn(0x7fc3a00a20d0 msgr2=0x7fc3a00a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:28.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.358+0000 7fc3a4b57640 1 -- 172.21.15.45:0/646009745 shutdown_connections 2023-10-03T19:16:28.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.358+0000 7fc3a4b57640 1 -- 172.21.15.45:0/646009745 wait complete. 2023-10-03T19:16:28.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.358+0000 7fc3a4b57640 1 Processor -- start 2023-10-03T19:16:28.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.358+0000 7fc3a4b57640 1 -- start start 2023-10-03T19:16:28.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.358+0000 7fc3a4b57640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc388003980 0x7fc3a00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:28.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.358+0000 7fc3a4b57640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3a014dfa0 0x7fc3a00b6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:28.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.358+0000 7fc3a4b57640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3a00b73c0 0x7fc3a01e7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:28.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.358+0000 7fc3a4b57640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a00b6850 con 0x7fc3a014dfa0 2023-10-03T19:16:28.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.358+0000 7fc3a4b57640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a00b6260 con 0x7fc3a00b73c0 2023-10-03T19:16:28.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.358+0000 7fc3a4b57640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a00b54e0 con 0x7fc388003980 2023-10-03T19:16:28.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.362+0000 7fc39dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3a014dfa0 0x7fc3a00b6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:28.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.362+0000 7fc39dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3a014dfa0 0x7fc3a00b6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47742/0 (socket says 172.21.15.45:47742) 2023-10-03T19:16:28.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.362+0000 7fc39dd9b640 1 -- 172.21.15.45:0/3723370819 learned_addr learned my addr 172.21.15.45:0/3723370819 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:28.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.362+0000 7fc39ed9d640 1 --2- 172.21.15.45:0/3723370819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3a00b73c0 0x7fc3a01e7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:28.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.362+0000 7fc39e59c640 1 --2- 172.21.15.45:0/3723370819 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc388003980 0x7fc3a00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:28.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.362+0000 7fc39dd9b640 1 -- 172.21.15.45:0/3723370819 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc388003980 msgr2=0x7fc3a00b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:28.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.362+0000 7fc39dd9b640 1 --2- 172.21.15.45:0/3723370819 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc388003980 0x7fc3a00b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.362+0000 7fc39dd9b640 1 -- 172.21.15.45:0/3723370819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3a00b73c0 msgr2=0x7fc3a01e7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:28.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.362+0000 7fc39dd9b640 1 --2- 172.21.15.45:0/3723370819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3a00b73c0 0x7fc3a01e7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.362+0000 7fc39dd9b640 1 -- 172.21.15.45:0/3723370819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a00a5550 con 0x7fc3a014dfa0 2023-10-03T19:16:28.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.362+0000 7fc39dd9b640 1 --2- 172.21.15.45:0/3723370819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3a014dfa0 0x7fc3a00b6e80 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fc39400e4d0 tx=0x7fc39400e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:28.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.362+0000 7fc38effd640 1 -- 172.21.15.45:0/3723370819 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3940053a0 con 0x7fc3a014dfa0 2023-10-03T19:16:28.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.362+0000 7fc38effd640 1 -- 172.21.15.45:0/3723370819 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc394003600 con 0x7fc3a014dfa0 2023-10-03T19:16:28.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.362+0000 7fc38effd640 1 -- 172.21.15.45:0/3723370819 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc394003990 con 0x7fc3a014dfa0 2023-10-03T19:16:28.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.362+0000 7fc3a4b57640 1 -- 172.21.15.45:0/3723370819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a00a53c0 con 0x7fc3a014dfa0 2023-10-03T19:16:28.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.362+0000 7fc3a4b57640 1 -- 172.21.15.45:0/3723370819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a00a56e0 con 0x7fc3a014dfa0 2023-10-03T19:16:28.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.362+0000 7fc3a4b57640 1 -- 172.21.15.45:0/3723370819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a00b6990 con 0x7fc3a014dfa0 2023-10-03T19:16:28.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.362+0000 7fc38effd640 1 -- 172.21.15.45:0/3723370819 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc394003af0 con 0x7fc3a014dfa0 2023-10-03T19:16:28.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.362+0000 7fc38effd640 1 --2- 172.21.15.45:0/3723370819 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc3800662d0 0x7fc380068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:28.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.362+0000 7fc38effd640 1 -- 172.21.15.45:0/3723370819 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc394083970 con 0x7fc3a014dfa0 2023-10-03T19:16:28.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.362+0000 7fc39e59c640 1 --2- 172.21.15.45:0/3723370819 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc3800662d0 0x7fc380068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:28.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.366+0000 7fc39e59c640 1 --2- 172.21.15.45:0/3723370819 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc3800662d0 0x7fc380068780 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc3900ad000 tx=0x7fc3900046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:28.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.366+0000 7fc38effd640 1 -- 172.21.15.45:0/3723370819 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc3a00b6990 con 0x7fc3a014dfa0 2023-10-03T19:16:28.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.534+0000 7fc3a4b57640 1 -- 172.21.15.45:0/3723370819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc3a00b5670 con 0x7fc3a014dfa0 2023-10-03T19:16:28.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.534+0000 7fc38effd640 1 -- 172.21.15.45:0/3723370819 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc394050e90 con 0x7fc3a014dfa0 2023-10-03T19:16:28.542 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-03T19:16:28.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.538+0000 7fc3a4b57640 1 -- 172.21.15.45:0/3723370819 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc3800662d0 msgr2=0x7fc380068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:28.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.538+0000 7fc3a4b57640 1 --2- 172.21.15.45:0/3723370819 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc3800662d0 0x7fc380068780 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc3900ad000 tx=0x7fc3900046d0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.538+0000 7fc3a4b57640 1 -- 172.21.15.45:0/3723370819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3a014dfa0 msgr2=0x7fc3a00b6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:28.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.538+0000 7fc3a4b57640 1 --2- 172.21.15.45:0/3723370819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3a014dfa0 0x7fc3a00b6e80 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fc39400e4d0 tx=0x7fc39400e990 comp rx=0 tx=0).stop 2023-10-03T19:16:28.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.538+0000 7fc3a4b57640 1 -- 172.21.15.45:0/3723370819 shutdown_connections 2023-10-03T19:16:28.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.538+0000 7fc3a4b57640 1 --2- 172.21.15.45:0/3723370819 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc3800662d0 0x7fc380068780 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.538+0000 7fc3a4b57640 1 --2- 172.21.15.45:0/3723370819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3a00b73c0 0x7fc3a01e7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.538+0000 7fc3a4b57640 1 --2- 172.21.15.45:0/3723370819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3a014dfa0 0x7fc3a00b6e80 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.538+0000 7fc3a4b57640 1 --2- 172.21.15.45:0/3723370819 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc388003980 0x7fc3a00b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.538+0000 7fc3a4b57640 1 -- 172.21.15.45:0/3723370819 >> 172.21.15.45:0/3723370819 conn(0x7fc3a00a20d0 msgr2=0x7fc3a0149b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:28.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.538+0000 7fc3a4b57640 1 -- 172.21.15.45:0/3723370819 shutdown_connections 2023-10-03T19:16:28.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.538+0000 7fc3a4b57640 1 -- 172.21.15.45:0/3723370819 wait complete. 2023-10-03T19:16:28.561 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T19:16:28.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.686+0000 7f8af60ed640 1 Processor -- start 2023-10-03T19:16:28.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.686+0000 7f8af60ed640 1 -- start start 2023-10-03T19:16:28.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.686+0000 7f8af60ed640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8af006d560 0x7f8af00a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:28.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.686+0000 7f8af60ed640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8af006c760 0x7f8af00a5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:28.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.686+0000 7f8af60ed640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af006c2d0 con 0x7f8af00712c0 2023-10-03T19:16:28.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.686+0000 7f8af60ed640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af0150610 con 0x7f8af006c760 2023-10-03T19:16:28.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.686+0000 7f8af60ed640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af01508b0 con 0x7f8af006d560 2023-10-03T19:16:28.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.686+0000 7f8aeffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8af006c760 0x7f8af00a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:28.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.686+0000 7f8aeffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8af006c760 0x7f8af00a5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47758/0 (socket says 172.21.15.45:47758) 2023-10-03T19:16:28.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.686+0000 7f8aeffff640 1 -- 172.21.15.45:0/651513916 learned_addr learned my addr 172.21.15.45:0/651513916 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:28.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.686+0000 7f8aeeffd640 1 --2- 172.21.15.45:0/651513916 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8af006d560 0x7f8af00a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:28.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.686+0000 7f8aeffff640 1 -- 172.21.15.45:0/651513916 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8af006d560 msgr2=0x7f8af00a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:28.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.686+0000 7f8aeffff640 1 --2- 172.21.15.45:0/651513916 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8af006d560 0x7f8af00a53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.686+0000 7f8aeffff640 1 -- 172.21.15.45:0/651513916 >> v1:172.21.15.79:6789/0 conn(0x7f8af00712c0 legacy=0x7f8af00bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:28.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.686+0000 7f8aeffff640 1 -- 172.21.15.45:0/651513916 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af006d2e0 con 0x7f8af006c760 2023-10-03T19:16:28.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.690+0000 7f8aeffff640 1 --2- 172.21.15.45:0/651513916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af006c760 0x7f8af00a5900 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8009e50 tx=0x7f8ae801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8f63bb417f49d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:28.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.690+0000 7f8aee7fc640 1 -- 172.21.15.45:0/651513916 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae80a5810 con 0x7f8af006c760 2023-10-03T19:16:28.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.690+0000 7f8aee7fc640 1 -- 172.21.15.45:0/651513916 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae80a5970 con 0x7f8af006c760 2023-10-03T19:16:28.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.690+0000 7f8aee7fc640 1 -- 172.21.15.45:0/651513916 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae80a5d00 con 0x7f8af006c760 2023-10-03T19:16:28.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.690+0000 7f8af60ed640 1 -- 172.21.15.45:0/651513916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af006c760 msgr2=0x7f8af00a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:28.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.690+0000 7f8af60ed640 1 --2- 172.21.15.45:0/651513916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af006c760 0x7f8af00a5900 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8009e50 tx=0x7f8ae801ca10 comp rx=0 tx=0).stop 2023-10-03T19:16:28.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.690+0000 7f8af60ed640 1 -- 172.21.15.45:0/651513916 shutdown_connections 2023-10-03T19:16:28.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.690+0000 7f8af60ed640 1 --2- 172.21.15.45:0/651513916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af006c760 0x7f8af00a5900 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.690+0000 7f8af60ed640 1 --2- 172.21.15.45:0/651513916 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8af006d560 0x7f8af00a53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.690+0000 7f8af60ed640 1 -- 172.21.15.45:0/651513916 >> 172.21.15.45:0/651513916 conn(0x7f8af00a20d0 msgr2=0x7f8af00a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:28.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.690+0000 7f8af60ed640 1 -- 172.21.15.45:0/651513916 shutdown_connections 2023-10-03T19:16:28.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.690+0000 7f8af60ed640 1 -- 172.21.15.45:0/651513916 wait complete. 2023-10-03T19:16:28.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.690+0000 7f8af60ed640 1 Processor -- start 2023-10-03T19:16:28.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.690+0000 7f8af60ed640 1 -- start start 2023-10-03T19:16:28.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.690+0000 7f8af60ed640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af006c760 0x7f8af0150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:28.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.690+0000 7f8af60ed640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8af006d560 0x7f8af01e6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:28.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.690+0000 7f8af60ed640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8af00712c0 0x7f8af014d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:28.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.690+0000 7f8af60ed640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af0151660 con 0x7f8af006c760 2023-10-03T19:16:28.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.690+0000 7f8af60ed640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af01468a0 con 0x7f8af006d560 2023-10-03T19:16:28.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.690+0000 7f8af60ed640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af006ee50 con 0x7f8af00712c0 2023-10-03T19:16:28.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.690+0000 7f8aef7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af006c760 0x7f8af0150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:28.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.690+0000 7f8aef7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af006c760 0x7f8af0150c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47770/0 (socket says 172.21.15.45:47770) 2023-10-03T19:16:28.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.690+0000 7f8aef7fe640 1 -- 172.21.15.45:0/1938140872 learned_addr learned my addr 172.21.15.45:0/1938140872 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:28.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.690+0000 7f8aeeffd640 1 --2- 172.21.15.45:0/1938140872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8af006d560 0x7f8af01e6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:28.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.694+0000 7f8aeffff640 1 --2- 172.21.15.45:0/1938140872 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8af00712c0 0x7f8af014d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:28.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.694+0000 7f8aef7fe640 1 -- 172.21.15.45:0/1938140872 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8af00712c0 msgr2=0x7f8af014d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:28.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.694+0000 7f8aef7fe640 1 --2- 172.21.15.45:0/1938140872 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8af00712c0 0x7f8af014d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.694+0000 7f8aef7fe640 1 -- 172.21.15.45:0/1938140872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8af006d560 msgr2=0x7f8af01e6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:28.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.694+0000 7f8aef7fe640 1 --2- 172.21.15.45:0/1938140872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8af006d560 0x7f8af01e6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.694+0000 7f8aef7fe640 1 -- 172.21.15.45:0/1938140872 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae8009b30 con 0x7f8af006c760 2023-10-03T19:16:28.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.694+0000 7f8aeffff640 1 --2- 172.21.15.45:0/1938140872 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8af00712c0 0x7f8af014d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:28.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.694+0000 7f8aef7fe640 1 --2- 172.21.15.45:0/1938140872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af006c760 0x7f8af0150c20 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f8ae000c3c0 tx=0x7f8ae000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:28.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.694+0000 7f8ad7fff640 1 -- 172.21.15.45:0/1938140872 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae00052d0 con 0x7f8af006c760 2023-10-03T19:16:28.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.694+0000 7f8ad7fff640 1 -- 172.21.15.45:0/1938140872 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae0005430 con 0x7f8af006c760 2023-10-03T19:16:28.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.694+0000 7f8af60ed640 1 -- 172.21.15.45:0/1938140872 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af00bd460 con 0x7f8af006c760 2023-10-03T19:16:28.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.694+0000 7f8ad7fff640 1 -- 172.21.15.45:0/1938140872 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0003840 con 0x7f8af006c760 2023-10-03T19:16:28.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.694+0000 7f8af60ed640 1 -- 172.21.15.45:0/1938140872 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af00bd2d0 con 0x7f8af006c760 2023-10-03T19:16:28.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.694+0000 7f8af60ed640 1 -- 172.21.15.45:0/1938140872 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af01596f0 con 0x7f8af006c760 2023-10-03T19:16:28.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.694+0000 7f8ad7fff640 1 -- 172.21.15.45:0/1938140872 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8ae00039a0 con 0x7f8af006c760 2023-10-03T19:16:28.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.694+0000 7f8ad7fff640 1 --2- 172.21.15.45:0/1938140872 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8adc0662b0 0x7f8adc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:28.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.694+0000 7f8ad7fff640 1 -- 172.21.15.45:0/1938140872 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8ae0083220 con 0x7f8af006c760 2023-10-03T19:16:28.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.694+0000 7f8aeeffd640 1 --2- 172.21.15.45:0/1938140872 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8adc0662b0 0x7f8adc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:28.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.694+0000 7f8aeeffd640 1 --2- 172.21.15.45:0/1938140872 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8adc0662b0 0x7f8adc068760 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8af00bc2f0 tx=0x7f8ae4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:28.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.698+0000 7f8ad7fff640 1 -- 172.21.15.45:0/1938140872 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8ae00506f0 con 0x7f8af006c760 2023-10-03T19:16:28.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.854+0000 7f8af60ed640 1 -- 172.21.15.45:0/1938140872 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8af00bca30 con 0x7f8af006c760 2023-10-03T19:16:28.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.858+0000 7f8ad7fff640 1 -- 172.21.15.45:0/1938140872 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8ae0053d10 con 0x7f8af006c760 2023-10-03T19:16:28.863 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-03T19:16:28.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.858+0000 7f8af60ed640 1 -- 172.21.15.45:0/1938140872 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8adc0662b0 msgr2=0x7f8adc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:28.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.858+0000 7f8af60ed640 1 --2- 172.21.15.45:0/1938140872 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8adc0662b0 0x7f8adc068760 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8af00bc2f0 tx=0x7f8ae4008040 comp rx=0 tx=0).stop 2023-10-03T19:16:28.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.858+0000 7f8af60ed640 1 -- 172.21.15.45:0/1938140872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af006c760 msgr2=0x7f8af0150c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:28.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.858+0000 7f8af60ed640 1 --2- 172.21.15.45:0/1938140872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af006c760 0x7f8af0150c20 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f8ae000c3c0 tx=0x7f8ae000c880 comp rx=0 tx=0).stop 2023-10-03T19:16:28.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.858+0000 7f8af60ed640 1 -- 172.21.15.45:0/1938140872 shutdown_connections 2023-10-03T19:16:28.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.858+0000 7f8af60ed640 1 --2- 172.21.15.45:0/1938140872 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8adc0662b0 0x7f8adc068760 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.858+0000 7f8af60ed640 1 --2- 172.21.15.45:0/1938140872 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8af00712c0 0x7f8af014d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.858+0000 7f8af60ed640 1 --2- 172.21.15.45:0/1938140872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8af006d560 0x7f8af01e6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.858+0000 7f8af60ed640 1 --2- 172.21.15.45:0/1938140872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af006c760 0x7f8af0150c20 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:28.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.858+0000 7f8af60ed640 1 -- 172.21.15.45:0/1938140872 >> 172.21.15.45:0/1938140872 conn(0x7f8af00a20d0 msgr2=0x7f8af014ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:28.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.858+0000 7f8af60ed640 1 -- 172.21.15.45:0/1938140872 shutdown_connections 2023-10-03T19:16:28.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:28.858+0000 7f8af60ed640 1 -- 172.21.15.45:0/1938140872 wait complete. 2023-10-03T19:16:28.882 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-03T19:16:29.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f611b53a640 1 Processor -- start 2023-10-03T19:16:29.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f611b53a640 1 -- start start 2023-10-03T19:16:29.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f611b53a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f611406f170 0x7f6114150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:29.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f611b53a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f611406d170 0x7f611414d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:29.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f611b53a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f611406cac0 con 0x7f61140bc8b0 2023-10-03T19:16:29.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f611b53a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61140720d0 con 0x7f611406f170 2023-10-03T19:16:29.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f611b53a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61140a5ab0 con 0x7f611406d170 2023-10-03T19:16:29.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f6118ad5640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f61140bc8b0 0x7f611414ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44918/0 (socket says 172.21.15.45:44918) 2023-10-03T19:16:29.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f6118ad5640 1 -- 172.21.15.45:0/870557578 learned_addr learned my addr 172.21.15.45:0/870557578 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:29.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f61192d6640 1 --2- 172.21.15.45:0/870557578 >> v2:172.21.15.79:3300/0 conn(0x7f611406f170 0x7f6114150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:29.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f6119ad7640 1 --2- 172.21.15.45:0/870557578 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f611406d170 0x7f611414d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:29.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f6107fff640 1 -- 172.21.15.45:0/870557578 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2138971977 0 0) 0x7f6110001120 con 0x7f61140bc8b0 2023-10-03T19:16:29.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f6107fff640 1 -- 172.21.15.45:0/870557578 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6100003530 con 0x7f61140bc8b0 2023-10-03T19:16:29.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f6107fff640 1 -- 172.21.15.45:0/870557578 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 571932721 0 0) 0x7f6100003530 con 0x7f61140bc8b0 2023-10-03T19:16:29.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f6107fff640 1 -- 172.21.15.45:0/870557578 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f611406d170 msgr2=0x7f611414d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:29.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f6107fff640 1 --2- 172.21.15.45:0/870557578 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f611406d170 0x7f611414d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:29.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f6107fff640 1 -- 172.21.15.45:0/870557578 >> v2:172.21.15.79:3300/0 conn(0x7f611406f170 msgr2=0x7f6114150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:29.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f6107fff640 1 --2- 172.21.15.45:0/870557578 >> v2:172.21.15.79:3300/0 conn(0x7f611406f170 0x7f6114150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:29.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f6107fff640 1 -- 172.21.15.45:0/870557578 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611406cd00 con 0x7f61140bc8b0 2023-10-03T19:16:29.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f6107fff640 1 -- 172.21.15.45:0/870557578 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f6110001810 con 0x7f61140bc8b0 2023-10-03T19:16:29.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f6107fff640 1 -- 172.21.15.45:0/870557578 >> v1:172.21.15.45:6789/0 conn(0x7f61140bc8b0 legacy=0x7f611414ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:29.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f6107fff640 1 --2- 172.21.15.45:0/870557578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6100003980 0x7f6100003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:29.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f6107fff640 1 --2- 172.21.15.45:0/870557578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61000043b0 0x7f6100004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:29.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f6107fff640 1 --2- 172.21.15.45:0/870557578 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f611406d170 0x7f6100004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:29.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f6107fff640 1 -- 172.21.15.45:0/870557578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61140720d0 con 0x7f6100003980 2023-10-03T19:16:29.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f6107fff640 1 -- 172.21.15.45:0/870557578 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61140a5ab0 con 0x7f61000043b0 2023-10-03T19:16:29.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f6107fff640 1 -- 172.21.15.45:0/870557578 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610000b990 con 0x7f611406d170 2023-10-03T19:16:29.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f61192d6640 1 --2- 172.21.15.45:0/870557578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6100003980 0x7f6100003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:29.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f61192d6640 1 -- 172.21.15.45:0/870557578 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f611406d170 msgr2=0x7f6100004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:29.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f61192d6640 1 --2- 172.21.15.45:0/870557578 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f611406d170 0x7f6100004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:29.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f61192d6640 1 -- 172.21.15.45:0/870557578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61000043b0 msgr2=0x7f6100004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:29.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f61192d6640 1 --2- 172.21.15.45:0/870557578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61000043b0 0x7f6100004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:29.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.006+0000 7f61192d6640 1 -- 172.21.15.45:0/870557578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6100003530 con 0x7f6100003980 2023-10-03T19:16:29.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.010+0000 7f61192d6640 1 --2- 172.21.15.45:0/870557578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6100003980 0x7f6100003d90 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f6108009ae0 tx=0x7f610801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec639efd4f2b7264 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:29.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.010+0000 7f6107fff640 1 -- 172.21.15.45:0/870557578 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61080a5570 con 0x7f6100003980 2023-10-03T19:16:29.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.010+0000 7f6107fff640 1 -- 172.21.15.45:0/870557578 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61080a56d0 con 0x7f6100003980 2023-10-03T19:16:29.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.010+0000 7f6107fff640 1 -- 172.21.15.45:0/870557578 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61080a5a80 con 0x7f6100003980 2023-10-03T19:16:29.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.010+0000 7f611b53a640 1 -- 172.21.15.45:0/870557578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6100003980 msgr2=0x7f6100003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:29.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.010+0000 7f611b53a640 1 --2- 172.21.15.45:0/870557578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6100003980 0x7f6100003d90 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f6108009ae0 tx=0x7f610801ca50 comp rx=0 tx=0).stop 2023-10-03T19:16:29.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.010+0000 7f6119ad7640 1 -- 172.21.15.45:0/870557578 reap_dead start 2023-10-03T19:16:29.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.010+0000 7f611b53a640 1 -- 172.21.15.45:0/870557578 shutdown_connections 2023-10-03T19:16:29.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.010+0000 7f611b53a640 1 -- 172.21.15.45:0/870557578 >> 172.21.15.45:0/870557578 conn(0x7f61140bcf50 msgr2=0x7f61140bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:29.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.010+0000 7f611b53a640 1 -- 172.21.15.45:0/870557578 shutdown_connections 2023-10-03T19:16:29.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.010+0000 7f611b53a640 1 -- 172.21.15.45:0/870557578 wait complete. 2023-10-03T19:16:29.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.010+0000 7f611b53a640 1 Processor -- start 2023-10-03T19:16:29.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.010+0000 7f611b53a640 1 -- start start 2023-10-03T19:16:29.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.010+0000 7f611b53a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6100003980 0x7f611414f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:29.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.010+0000 7f611b53a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61141ea260 0x7f61141ea670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:29.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.010+0000 7f611b53a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f611413a1d0 0x7f611413a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:29.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.010+0000 7f611b53a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611414f570 con 0x7f61141ea260 2023-10-03T19:16:29.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.010+0000 7f611b53a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6114143d60 con 0x7f611413a1d0 2023-10-03T19:16:29.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.010+0000 7f611b53a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61141470b0 con 0x7f6100003980 2023-10-03T19:16:29.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.014+0000 7f6118ad5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61141ea260 0x7f61141ea670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:29.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.014+0000 7f6118ad5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61141ea260 0x7f61141ea670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47782/0 (socket says 172.21.15.45:47782) 2023-10-03T19:16:29.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.014+0000 7f6118ad5640 1 -- 172.21.15.45:0/888134542 learned_addr learned my addr 172.21.15.45:0/888134542 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:29.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.014+0000 7f61192d6640 1 --2- 172.21.15.45:0/888134542 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6100003980 0x7f611414f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:29.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.014+0000 7f6119ad7640 1 --2- 172.21.15.45:0/888134542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f611413a1d0 0x7f611413a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:29.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.014+0000 7f6118ad5640 1 -- 172.21.15.45:0/888134542 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6100003980 msgr2=0x7f611414f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:29.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.014+0000 7f6118ad5640 1 --2- 172.21.15.45:0/888134542 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6100003980 0x7f611414f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:29.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.014+0000 7f6118ad5640 1 -- 172.21.15.45:0/888134542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f611413a1d0 msgr2=0x7f611413a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:29.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.014+0000 7f6118ad5640 1 --2- 172.21.15.45:0/888134542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f611413a1d0 0x7f611413a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:29.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.014+0000 7f6118ad5640 1 -- 172.21.15.45:0/888134542 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611406f6d0 con 0x7f61141ea260 2023-10-03T19:16:29.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.014+0000 7f61192d6640 1 --2- 172.21.15.45:0/888134542 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6100003980 0x7f611414f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:29.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.014+0000 7f6118ad5640 1 --2- 172.21.15.45:0/888134542 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61141ea260 0x7f61141ea670 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f6110007fd0 tx=0x7f611000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:29.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.014+0000 7f6105ffb640 1 -- 172.21.15.45:0/888134542 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61100074e0 con 0x7f61141ea260 2023-10-03T19:16:29.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.014+0000 7f6105ffb640 1 -- 172.21.15.45:0/888134542 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6110007640 con 0x7f61141ea260 2023-10-03T19:16:29.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.014+0000 7f611b53a640 1 -- 172.21.15.45:0/888134542 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f611406f540 con 0x7f61141ea260 2023-10-03T19:16:29.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.014+0000 7f6105ffb640 1 -- 172.21.15.45:0/888134542 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6110004a10 con 0x7f61141ea260 2023-10-03T19:16:29.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.014+0000 7f611b53a640 1 -- 172.21.15.45:0/888134542 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6114157660 con 0x7f61141ea260 2023-10-03T19:16:29.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.014+0000 7f611b53a640 1 -- 172.21.15.45:0/888134542 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f611406d660 con 0x7f61141ea260 2023-10-03T19:16:29.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.014+0000 7f6105ffb640 1 -- 172.21.15.45:0/888134542 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6110004b70 con 0x7f61141ea260 2023-10-03T19:16:29.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.014+0000 7f6105ffb640 1 --2- 172.21.15.45:0/888134542 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f60f8066280 0x7f60f8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:29.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.014+0000 7f6105ffb640 1 -- 172.21.15.45:0/888134542 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6110083190 con 0x7f61141ea260 2023-10-03T19:16:29.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.014+0000 7f61192d6640 1 --2- 172.21.15.45:0/888134542 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f60f8066280 0x7f60f8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:29.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.018+0000 7f61192d6640 1 --2- 172.21.15.45:0/888134542 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f60f8066280 0x7f60f8068730 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f61080af000 tx=0x7f61080046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:29.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.018+0000 7f6105ffb640 1 -- 172.21.15.45:0/888134542 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6110050530 con 0x7f61141ea260 2023-10-03T19:16:29.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.186+0000 7f611b53a640 1 -- 172.21.15.45:0/888134542 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f611406cac0 con 0x7f61141ea260 2023-10-03T19:16:29.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.190+0000 7f6105ffb640 1 -- 172.21.15.45:0/888134542 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v50) v1 ==== 80+0+0 (secure 0 0 0) 0x7f611406cac0 con 0x7f61141ea260 2023-10-03T19:16:29.195 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-10-03T19:16:29.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.190+0000 7f611b53a640 1 -- 172.21.15.45:0/888134542 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f60f8066280 msgr2=0x7f60f8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:29.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.190+0000 7f611b53a640 1 --2- 172.21.15.45:0/888134542 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f60f8066280 0x7f60f8068730 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f61080af000 tx=0x7f61080046d0 comp rx=0 tx=0).stop 2023-10-03T19:16:29.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.190+0000 7f611b53a640 1 -- 172.21.15.45:0/888134542 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61141ea260 msgr2=0x7f61141ea670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:29.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.190+0000 7f611b53a640 1 --2- 172.21.15.45:0/888134542 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61141ea260 0x7f61141ea670 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f6110007fd0 tx=0x7f611000cc00 comp rx=0 tx=0).stop 2023-10-03T19:16:29.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.190+0000 7f611b53a640 1 -- 172.21.15.45:0/888134542 shutdown_connections 2023-10-03T19:16:29.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.190+0000 7f611b53a640 1 --2- 172.21.15.45:0/888134542 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f60f8066280 0x7f60f8068730 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:29.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.190+0000 7f611b53a640 1 --2- 172.21.15.45:0/888134542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f611413a1d0 0x7f611413a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:29.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.190+0000 7f611b53a640 1 --2- 172.21.15.45:0/888134542 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61141ea260 0x7f61141ea670 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:29.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.190+0000 7f611b53a640 1 --2- 172.21.15.45:0/888134542 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6100003980 0x7f611414f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:29.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.190+0000 7f611b53a640 1 -- 172.21.15.45:0/888134542 >> 172.21.15.45:0/888134542 conn(0x7f61140bcf50 msgr2=0x7f611414b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:29.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.190+0000 7f611b53a640 1 -- 172.21.15.45:0/888134542 shutdown_connections 2023-10-03T19:16:29.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.190+0000 7f611b53a640 1 -- 172.21.15.45:0/888134542 wait complete. 2023-10-03T19:16:29.214 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi146.front.sepia.ceph.com... 2023-10-03T19:16:29.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:16:29.214 DEBUG:teuthology.orchestra.run.smithi146:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-03T19:16:29.228 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[33431]: fuse finished with error 0 and tester_r 0 2023-10-03T19:16:29.229 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-03T19:16:29.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:16:29.229 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-03T19:16:29.392 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-03T19:16:29.392 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:16:29.398 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336540k,nr_inodes=4084135,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=22607 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-10-03T19:16:29.399 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2023-10-03T19:16:29.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:16:29.399 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-03T19:16:29.444 INFO:teuthology.orchestra.run.smithi172.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-03T19:16:29.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T19:16:29.445 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:16:29.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.562+0000 7f8dcfb9e640 1 Processor -- start 2023-10-03T19:16:29.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.562+0000 7f8dcfb9e640 1 -- start start 2023-10-03T19:16:29.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.562+0000 7f8dcfb9e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8dc80b98f0 0x7f8dc80b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:29.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.562+0000 7f8dcfb9e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8dc80bc810 0x7f8dc806c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:29.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.562+0000 7f8dcfb9e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc80ba550 con 0x7f8dc80a2e20 2023-10-03T19:16:29.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.562+0000 7f8dcfb9e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc81526d0 con 0x7f8dc80bc810 2023-10-03T19:16:29.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.562+0000 7f8dcfb9e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc81529b0 con 0x7f8dc80b98f0 2023-10-03T19:16:29.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.562+0000 7f8dcd139640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8dc80bc810 0x7f8dc806c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:29.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.562+0000 7f8dce13b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8dc80a2e20 0x7f8dc806c7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44930/0 (socket says 172.21.15.45:44930) 2023-10-03T19:16:29.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.562+0000 7f8dce13b640 1 -- 172.21.15.45:0/2919344259 learned_addr learned my addr 172.21.15.45:0/2919344259 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:29.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.562+0000 7f8dcd93a640 1 --2- 172.21.15.45:0/2919344259 >> v2:172.21.15.79:3300/0 conn(0x7f8dc80b98f0 0x7f8dc80b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:29.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.562+0000 7f8dcd139640 1 -- 172.21.15.45:0/2919344259 >> v2:172.21.15.79:3300/0 conn(0x7f8dc80b98f0 msgr2=0x7f8dc80b9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:29.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.562+0000 7f8dcd139640 1 --2- 172.21.15.45:0/2919344259 >> v2:172.21.15.79:3300/0 conn(0x7f8dc80b98f0 0x7f8dc80b9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:29.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.562+0000 7f8dcd139640 1 -- 172.21.15.45:0/2919344259 >> v1:172.21.15.45:6789/0 conn(0x7f8dc80a2e20 legacy=0x7f8dc806c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:29.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.562+0000 7f8dcc938640 1 -- 172.21.15.45:0/2919344259 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 578800694 0 0) 0x7f8dc80ba550 con 0x7f8dc80a2e20 2023-10-03T19:16:29.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.562+0000 7f8dcd139640 1 -- 172.21.15.45:0/2919344259 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc806cee0 con 0x7f8dc80bc810 2023-10-03T19:16:29.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.562+0000 7f8dcd93a640 1 --2- 172.21.15.45:0/2919344259 >> v2:172.21.15.79:3300/0 conn(0x7f8dc80b98f0 0x7f8dc80b9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:16:29.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.562+0000 7f8dcd139640 1 --2- 172.21.15.45:0/2919344259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc80bc810 0x7f8dc806c290 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8dc80bad20 tx=0x7f8db801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6b83f7079cdd55 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:29.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dcc938640 1 -- 172.21.15.45:0/2919344259 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db80a8950 con 0x7f8dc80bc810 2023-10-03T19:16:29.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dcc938640 1 -- 172.21.15.45:0/2919344259 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db80a8ab0 con 0x7f8dc80bc810 2023-10-03T19:16:29.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dcc938640 1 -- 172.21.15.45:0/2919344259 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db80a8e40 con 0x7f8dc80bc810 2023-10-03T19:16:29.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dcfb9e640 1 -- 172.21.15.45:0/2919344259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc80bc810 msgr2=0x7f8dc806c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:29.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dcfb9e640 1 --2- 172.21.15.45:0/2919344259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc80bc810 0x7f8dc806c290 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8dc80bad20 tx=0x7f8db801ec50 comp rx=0 tx=0).stop 2023-10-03T19:16:29.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dcfb9e640 1 -- 172.21.15.45:0/2919344259 shutdown_connections 2023-10-03T19:16:29.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dcfb9e640 1 --2- 172.21.15.45:0/2919344259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc80bc810 0x7f8dc806c290 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:29.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dcfb9e640 1 --2- 172.21.15.45:0/2919344259 >> v2:172.21.15.79:3300/0 conn(0x7f8dc80b98f0 0x7f8dc80b9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:29.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dcfb9e640 1 -- 172.21.15.45:0/2919344259 >> 172.21.15.45:0/2919344259 conn(0x7f8dc80bcf50 msgr2=0x7f8dc80bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:29.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dcfb9e640 1 -- 172.21.15.45:0/2919344259 shutdown_connections 2023-10-03T19:16:29.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dcfb9e640 1 -- 172.21.15.45:0/2919344259 wait complete. 2023-10-03T19:16:29.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dcfb9e640 1 Processor -- start 2023-10-03T19:16:29.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dcfb9e640 1 -- start start 2023-10-03T19:16:29.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dcfb9e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8dc80a2e20 0x7f8dc81e4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:29.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dcfb9e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8dc80b98f0 0x7f8dc81dadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:29.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dcfb9e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc80bc810 0x7f8dc81e7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:29.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dcfb9e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc8151410 con 0x7f8dc80bc810 2023-10-03T19:16:29.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dcfb9e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc81e4560 con 0x7f8dc80b98f0 2023-10-03T19:16:29.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dcfb9e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc81e47d0 con 0x7f8dc80a2e20 2023-10-03T19:16:29.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dce13b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc80bc810 0x7f8dc81e7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:29.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dce13b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc80bc810 0x7f8dc81e7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47790/0 (socket says 172.21.15.45:47790) 2023-10-03T19:16:29.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dce13b640 1 -- 172.21.15.45:0/2428113121 learned_addr learned my addr 172.21.15.45:0/2428113121 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:29.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dcd139640 1 --2- 172.21.15.45:0/2428113121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8dc80b98f0 0x7f8dc81dadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:29.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dce13b640 1 -- 172.21.15.45:0/2428113121 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8dc80a2e20 msgr2=0x7f8dc81e4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:29.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dce13b640 1 --2- 172.21.15.45:0/2428113121 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8dc80a2e20 0x7f8dc81e4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:29.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dce13b640 1 -- 172.21.15.45:0/2428113121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8dc80b98f0 msgr2=0x7f8dc81dadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:29.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dce13b640 1 --2- 172.21.15.45:0/2428113121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8dc80b98f0 0x7f8dc81dadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:29.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dce13b640 1 -- 172.21.15.45:0/2428113121 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db8009420 con 0x7f8dc80bc810 2023-10-03T19:16:29.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dce13b640 1 --2- 172.21.15.45:0/2428113121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc80bc810 0x7f8dc81e7120 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8dc000c3c0 tx=0x7f8dc000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:29.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dbe7fc640 1 -- 172.21.15.45:0/2428113121 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc00074e0 con 0x7f8dc80bc810 2023-10-03T19:16:29.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dbe7fc640 1 -- 172.21.15.45:0/2428113121 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc0007640 con 0x7f8dc80bc810 2023-10-03T19:16:29.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dcfb9e640 1 -- 172.21.15.45:0/2428113121 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc80ba950 con 0x7f8dc80bc810 2023-10-03T19:16:29.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dbe7fc640 1 -- 172.21.15.45:0/2428113121 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc0004a30 con 0x7f8dc80bc810 2023-10-03T19:16:29.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.566+0000 7f8dcfb9e640 1 -- 172.21.15.45:0/2428113121 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc80ba200 con 0x7f8dc80bc810 2023-10-03T19:16:29.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.570+0000 7f8dcfb9e640 1 -- 172.21.15.45:0/2428113121 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc80baae0 con 0x7f8dc80bc810 2023-10-03T19:16:29.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.570+0000 7f8dbe7fc640 1 -- 172.21.15.45:0/2428113121 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8dc0004b90 con 0x7f8dc80bc810 2023-10-03T19:16:29.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.570+0000 7f8dbe7fc640 1 --2- 172.21.15.45:0/2428113121 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8dac0662b0 0x7f8dac068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:29.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.570+0000 7f8dbe7fc640 1 -- 172.21.15.45:0/2428113121 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8dc0083b90 con 0x7f8dc80bc810 2023-10-03T19:16:29.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.570+0000 7f8dcd93a640 1 --2- 172.21.15.45:0/2428113121 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8dac0662b0 0x7f8dac068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:29.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.570+0000 7f8dcd93a640 1 --2- 172.21.15.45:0/2428113121 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8dac0662b0 0x7f8dac068760 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8dc40094c0 tx=0x7f8dc4009430 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:29.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.574+0000 7f8dbe7fc640 1 -- 172.21.15.45:0/2428113121 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8dc0050f30 con 0x7f8dc80bc810 2023-10-03T19:16:29.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.762+0000 7f8dcfb9e640 1 -- 172.21.15.45:0/2428113121 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8dc8151550 con 0x7f8dc80bc810 2023-10-03T19:16:29.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.762+0000 7f8dbe7fc640 1 -- 172.21.15.45:0/2428113121 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+3914 (secure 0 0 0) 0x7f8dc0054550 con 0x7f8dc80bc810 2023-10-03T19:16:29.771 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:16:29.771 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2315858323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2315858323},{"type":"v1","addr":"172.21.15.79:6835","nonce":2315858323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1525989510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1525989510},{"type":"v1","addr":"172.21.15.45:6834","nonce":1525989510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:15:46.329993+0000","modified":"2023-10-03T19:15:49.849869+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5514":{"gid":5514,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1319730866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1319730866},{"type":"v1","addr":"172.21.15.45:6835","nonce":1319730866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-10-03T19:16:29.771 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 23 2023-10-03T19:16:29.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.766+0000 7f8dcfb9e640 1 -- 172.21.15.45:0/2428113121 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8dac0662b0 msgr2=0x7f8dac068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:29.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.766+0000 7f8dcfb9e640 1 --2- 172.21.15.45:0/2428113121 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8dac0662b0 0x7f8dac068760 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8dc40094c0 tx=0x7f8dc4009430 comp rx=0 tx=0).stop 2023-10-03T19:16:29.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.766+0000 7f8dcfb9e640 1 -- 172.21.15.45:0/2428113121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc80bc810 msgr2=0x7f8dc81e7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:29.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.766+0000 7f8dcfb9e640 1 --2- 172.21.15.45:0/2428113121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc80bc810 0x7f8dc81e7120 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8dc000c3c0 tx=0x7f8dc000c880 comp rx=0 tx=0).stop 2023-10-03T19:16:29.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.766+0000 7f8dcfb9e640 1 -- 172.21.15.45:0/2428113121 shutdown_connections 2023-10-03T19:16:29.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.766+0000 7f8dcfb9e640 1 --2- 172.21.15.45:0/2428113121 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8dac0662b0 0x7f8dac068760 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:29.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.766+0000 7f8dcfb9e640 1 --2- 172.21.15.45:0/2428113121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc80bc810 0x7f8dc81e7120 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:29.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.766+0000 7f8dcfb9e640 1 --2- 172.21.15.45:0/2428113121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8dc80b98f0 0x7f8dc81dadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:29.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.766+0000 7f8dcfb9e640 1 --2- 172.21.15.45:0/2428113121 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8dc80a2e20 0x7f8dc81e4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:29.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.766+0000 7f8dcfb9e640 1 -- 172.21.15.45:0/2428113121 >> 172.21.15.45:0/2428113121 conn(0x7f8dc80bcf50 msgr2=0x7f8dc8144fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:29.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.766+0000 7f8dcfb9e640 1 -- 172.21.15.45:0/2428113121 shutdown_connections 2023-10-03T19:16:29.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.766+0000 7f8dcfb9e640 1 -- 172.21.15.45:0/2428113121 wait complete. 2023-10-03T19:16:29.789 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:16:29.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.910+0000 7f1703acd640 1 Processor -- start 2023-10-03T19:16:29.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.910+0000 7f1703acd640 1 -- start start 2023-10-03T19:16:29.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.910+0000 7f1703acd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f16fc148b90 0x7f16fc0bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:29.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.910+0000 7f1703acd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f16fc0bcb60 0x7f16fc06c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:29.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.910+0000 7f1703acd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16fc14b610 con 0x7f16fc0bc4a0 2023-10-03T19:16:29.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.910+0000 7f1703acd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16fc0a3670 con 0x7f16fc0bcb60 2023-10-03T19:16:29.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.910+0000 7f1703acd640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16fc14b370 con 0x7f16fc148b90 2023-10-03T19:16:29.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.914+0000 7f170206a640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f16fc0bc4a0 0x7f16fc06c7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44934/0 (socket says 172.21.15.45:44934) 2023-10-03T19:16:29.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.914+0000 7f1701068640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f16fc0bcb60 0x7f16fc06c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:29.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.914+0000 7f170206a640 1 -- 172.21.15.45:0/571309664 learned_addr learned my addr 172.21.15.45:0/571309664 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:29.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.914+0000 7f1701869640 1 --2- 172.21.15.45:0/571309664 >> v2:172.21.15.79:3300/0 conn(0x7f16fc148b90 0x7f16fc0bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:29.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.914+0000 7f1701068640 1 -- 172.21.15.45:0/571309664 >> v2:172.21.15.79:3300/0 conn(0x7f16fc148b90 msgr2=0x7f16fc0bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:29.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.914+0000 7f1701068640 1 --2- 172.21.15.45:0/571309664 >> v2:172.21.15.79:3300/0 conn(0x7f16fc148b90 0x7f16fc0bbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:29.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.914+0000 7f1701068640 1 -- 172.21.15.45:0/571309664 >> v1:172.21.15.45:6789/0 conn(0x7f16fc0bc4a0 legacy=0x7f16fc06c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:29.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.914+0000 7f1700867640 1 -- 172.21.15.45:0/571309664 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 764186896 0 0) 0x7f16fc14b610 con 0x7f16fc0bc4a0 2023-10-03T19:16:29.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.914+0000 7f1701068640 1 -- 172.21.15.45:0/571309664 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16fc0a5580 con 0x7f16fc0bcb60 2023-10-03T19:16:29.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.914+0000 7f1701068640 1 --2- 172.21.15.45:0/571309664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16fc0bcb60 0x7f16fc06c290 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f16fc06d660 tx=0x7f16f001ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be4d08d26dd0fab server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:29.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.914+0000 7f1700867640 1 -- 172.21.15.45:0/571309664 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f00a8950 con 0x7f16fc0bcb60 2023-10-03T19:16:29.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.914+0000 7f1700867640 1 -- 172.21.15.45:0/571309664 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f00a8ab0 con 0x7f16fc0bcb60 2023-10-03T19:16:29.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.914+0000 7f1700867640 1 -- 172.21.15.45:0/571309664 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f00a8e40 con 0x7f16fc0bcb60 2023-10-03T19:16:29.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.914+0000 7f1703acd640 1 -- 172.21.15.45:0/571309664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16fc0bcb60 msgr2=0x7f16fc06c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:29.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.914+0000 7f1703acd640 1 --2- 172.21.15.45:0/571309664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16fc0bcb60 0x7f16fc06c290 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f16fc06d660 tx=0x7f16f001ec50 comp rx=0 tx=0).stop 2023-10-03T19:16:29.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.914+0000 7f1703acd640 1 -- 172.21.15.45:0/571309664 shutdown_connections 2023-10-03T19:16:29.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.914+0000 7f1703acd640 1 --2- 172.21.15.45:0/571309664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16fc0bcb60 0x7f16fc06c290 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:29.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.914+0000 7f1703acd640 1 --2- 172.21.15.45:0/571309664 >> v2:172.21.15.79:3300/0 conn(0x7f16fc148b90 0x7f16fc0bbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:29.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.914+0000 7f1703acd640 1 -- 172.21.15.45:0/571309664 >> 172.21.15.45:0/571309664 conn(0x7f16fc0bcf50 msgr2=0x7f16fc0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:29.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.914+0000 7f1703acd640 1 -- 172.21.15.45:0/571309664 shutdown_connections 2023-10-03T19:16:29.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.914+0000 7f1703acd640 1 -- 172.21.15.45:0/571309664 wait complete. 2023-10-03T19:16:29.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.918+0000 7f1703acd640 1 Processor -- start 2023-10-03T19:16:29.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.918+0000 7f1703acd640 1 -- start start 2023-10-03T19:16:29.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.918+0000 7f1703acd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16fc0bc4a0 0x7f16fc1e1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:29.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.918+0000 7f1703acd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16fc0bcb60 0x7f16fc0b5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:29.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.918+0000 7f1703acd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16fc148b90 0x7f16fc144a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:29.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.918+0000 7f1703acd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc0b8600 con 0x7f16fc148b90 2023-10-03T19:16:29.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.918+0000 7f1703acd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc14d620 con 0x7f16fc0bc4a0 2023-10-03T19:16:29.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.918+0000 7f1703acd640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc1e2150 con 0x7f16fc0bcb60 2023-10-03T19:16:29.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.918+0000 7f170206a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16fc148b90 0x7f16fc144a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:29.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.918+0000 7f170206a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16fc148b90 0x7f16fc144a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47806/0 (socket says 172.21.15.45:47806) 2023-10-03T19:16:29.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.918+0000 7f170206a640 1 -- 172.21.15.45:0/4261146267 learned_addr learned my addr 172.21.15.45:0/4261146267 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:29.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.918+0000 7f1701869640 1 --2- 172.21.15.45:0/4261146267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16fc0bc4a0 0x7f16fc1e1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:29.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.918+0000 7f1701068640 1 --2- 172.21.15.45:0/4261146267 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16fc0bcb60 0x7f16fc0b5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:29.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.918+0000 7f170206a640 1 -- 172.21.15.45:0/4261146267 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16fc0bcb60 msgr2=0x7f16fc0b5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:29.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.918+0000 7f170206a640 1 --2- 172.21.15.45:0/4261146267 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16fc0bcb60 0x7f16fc0b5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:29.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.918+0000 7f170206a640 1 -- 172.21.15.45:0/4261146267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16fc0bc4a0 msgr2=0x7f16fc1e1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:29.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.918+0000 7f170206a640 1 --2- 172.21.15.45:0/4261146267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16fc0bc4a0 0x7f16fc1e1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:29.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.918+0000 7f170206a640 1 -- 172.21.15.45:0/4261146267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f0009420 con 0x7f16fc148b90 2023-10-03T19:16:29.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.918+0000 7f1701068640 1 --2- 172.21.15.45:0/4261146267 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16fc0bcb60 0x7f16fc0b5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:29.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.918+0000 7f1701869640 1 --2- 172.21.15.45:0/4261146267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16fc0bc4a0 0x7f16fc1e1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:29.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.918+0000 7f170206a640 1 --2- 172.21.15.45:0/4261146267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16fc148b90 0x7f16fc144a60 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f16f4001570 tx=0x7f16f400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:29.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.918+0000 7f16fa7fc640 1 -- 172.21.15.45:0/4261146267 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f400ce60 con 0x7f16fc148b90 2023-10-03T19:16:29.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.918+0000 7f16fa7fc640 1 -- 172.21.15.45:0/4261146267 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f400a5e0 con 0x7f16fc148b90 2023-10-03T19:16:29.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.918+0000 7f1703acd640 1 -- 172.21.15.45:0/4261146267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16fc06cee0 con 0x7f16fc148b90 2023-10-03T19:16:29.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.918+0000 7f16fa7fc640 1 -- 172.21.15.45:0/4261146267 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f400a950 con 0x7f16fc148b90 2023-10-03T19:16:29.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.918+0000 7f1703acd640 1 -- 172.21.15.45:0/4261146267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16fc0a5820 con 0x7f16fc148b90 2023-10-03T19:16:29.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.918+0000 7f1703acd640 1 -- 172.21.15.45:0/4261146267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16fc148f60 con 0x7f16fc148b90 2023-10-03T19:16:29.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.918+0000 7f16fa7fc640 1 -- 172.21.15.45:0/4261146267 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f16f400aab0 con 0x7f16fc148b90 2023-10-03T19:16:29.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.922+0000 7f16fa7fc640 1 --2- 172.21.15.45:0/4261146267 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f16e8066280 0x7f16e8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:29.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.922+0000 7f16fa7fc640 1 -- 172.21.15.45:0/4261146267 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f16f4083660 con 0x7f16fc148b90 2023-10-03T19:16:29.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.922+0000 7f1701869640 1 --2- 172.21.15.45:0/4261146267 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f16e8066280 0x7f16e8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:29.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.922+0000 7f1701869640 1 --2- 172.21.15.45:0/4261146267 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f16e8066280 0x7f16e8068730 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f16ec0097a0 tx=0x7f16ec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:29.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:29.926+0000 7f16fa7fc640 1 -- 172.21.15.45:0/4261146267 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f16f4050a90 con 0x7f16fc148b90 2023-10-03T19:16:30.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.078+0000 7f1703acd640 1 -- 172.21.15.45:0/4261146267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16fc14d790 con 0x7f16fc148b90 2023-10-03T19:16:30.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.082+0000 7f16fa7fc640 1 -- 172.21.15.45:0/4261146267 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18399 (secure 0 0 0) 0x7f16fc14d790 con 0x7f16fc148b90 2023-10-03T19:16:30.087 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:16:30.087 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":50,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:16:13.667014+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:15:44.458794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-03T19:15:45.219182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.1d","mappings":[{"from":0,"to":6}]},{"pgid":"8.3d","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:16:30.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.082+0000 7f1703acd640 1 -- 172.21.15.45:0/4261146267 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f16e8066280 msgr2=0x7f16e8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:30.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.082+0000 7f1703acd640 1 --2- 172.21.15.45:0/4261146267 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f16e8066280 0x7f16e8068730 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f16ec0097a0 tx=0x7f16ec008040 comp rx=0 tx=0).stop 2023-10-03T19:16:30.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.082+0000 7f1703acd640 1 -- 172.21.15.45:0/4261146267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16fc148b90 msgr2=0x7f16fc144a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.082+0000 7f1703acd640 1 --2- 172.21.15.45:0/4261146267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16fc148b90 0x7f16fc144a60 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f16f4001570 tx=0x7f16f400cc70 comp rx=0 tx=0).stop 2023-10-03T19:16:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.082+0000 7f1703acd640 1 -- 172.21.15.45:0/4261146267 shutdown_connections 2023-10-03T19:16:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.082+0000 7f1703acd640 1 --2- 172.21.15.45:0/4261146267 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f16e8066280 0x7f16e8068730 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.082+0000 7f1703acd640 1 --2- 172.21.15.45:0/4261146267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16fc148b90 0x7f16fc144a60 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.082+0000 7f1703acd640 1 --2- 172.21.15.45:0/4261146267 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16fc0bcb60 0x7f16fc0b5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.082+0000 7f1703acd640 1 --2- 172.21.15.45:0/4261146267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16fc0bc4a0 0x7f16fc1e1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.082+0000 7f1703acd640 1 -- 172.21.15.45:0/4261146267 >> 172.21.15.45:0/4261146267 conn(0x7f16fc0bcf50 msgr2=0x7f16fc0bba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.082+0000 7f1703acd640 1 -- 172.21.15.45:0/4261146267 shutdown_connections 2023-10-03T19:16:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.082+0000 7f1703acd640 1 -- 172.21.15.45:0/4261146267 wait complete. 2023-10-03T19:16:30.105 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T19:15:44.458794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T19:15:45.219182+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:16:30.106 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:16:30.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.218+0000 7fe2b0f32640 1 Processor -- start 2023-10-03T19:16:30.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.218+0000 7fe2b0f32640 1 -- start start 2023-10-03T19:16:30.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2b0f32640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe2ac0c07f0 0x7fe2ac0bd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:30.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2b0f32640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe2ac14fa20 0x7fe2ac14fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:30.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2b0f32640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2ac0c14c0 con 0x7fe2ac0c19b0 2023-10-03T19:16:30.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2b0f32640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2ac0be420 con 0x7fe2ac0c07f0 2023-10-03T19:16:30.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2b0f32640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac0a1f80 con 0x7fe2ac14fa20 2023-10-03T19:16:30.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2a3fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe2ac0c19b0 0x7fe2ac14bab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44936/0 (socket says 172.21.15.45:44936) 2023-10-03T19:16:30.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2a3fff640 1 -- 172.21.15.45:0/2694464430 learned_addr learned my addr 172.21.15.45:0/2694464430 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:30.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2aa59c640 1 --2- 172.21.15.45:0/2694464430 >> v2:172.21.15.79:3300/0 conn(0x7fe2ac0c07f0 0x7fe2ac0bd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:30.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2aad9d640 1 --2- 172.21.15.45:0/2694464430 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe2ac14fa20 0x7fe2ac14fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:30.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2a9d9b640 1 -- 172.21.15.45:0/2694464430 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886053761 0 0) 0x7fe2ac0c14c0 con 0x7fe2ac0c19b0 2023-10-03T19:16:30.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2a9d9b640 1 -- 172.21.15.45:0/2694464430 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe298003530 con 0x7fe2ac0c19b0 2023-10-03T19:16:30.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2a9d9b640 1 -- 172.21.15.45:0/2694464430 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2911580759 0 0) 0x7fe298003530 con 0x7fe2ac0c19b0 2023-10-03T19:16:30.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2a9d9b640 1 -- 172.21.15.45:0/2694464430 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe2ac14fa20 msgr2=0x7fe2ac14fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:30.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2a9d9b640 1 --2- 172.21.15.45:0/2694464430 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe2ac14fa20 0x7fe2ac14fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:30.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2a9d9b640 1 -- 172.21.15.45:0/2694464430 >> v2:172.21.15.79:3300/0 conn(0x7fe2ac0c07f0 msgr2=0x7fe2ac0bd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:30.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2a9d9b640 1 --2- 172.21.15.45:0/2694464430 >> v2:172.21.15.79:3300/0 conn(0x7fe2ac0c07f0 0x7fe2ac0bd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:30.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2a9d9b640 1 -- 172.21.15.45:0/2694464430 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ac0bd070 con 0x7fe2ac0c19b0 2023-10-03T19:16:30.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2a9d9b640 1 -- 172.21.15.45:0/2694464430 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fe294001680 con 0x7fe2ac0c19b0 2023-10-03T19:16:30.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2a9d9b640 1 -- 172.21.15.45:0/2694464430 >> v1:172.21.15.45:6789/0 conn(0x7fe2ac0c19b0 legacy=0x7fe2ac14bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:30.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2a9d9b640 1 --2- 172.21.15.45:0/2694464430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe298003980 0x7fe298003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:30.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2a9d9b640 1 --2- 172.21.15.45:0/2694464430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2980047d0 0x7fe298004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:30.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2a9d9b640 1 --2- 172.21.15.45:0/2694464430 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe2ac14fa20 0x7fe298005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:30.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2a9d9b640 1 -- 172.21.15.45:0/2694464430 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac0a1f80 con 0x7fe298003980 2023-10-03T19:16:30.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2a9d9b640 1 -- 172.21.15.45:0/2694464430 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29800b990 con 0x7fe2980047d0 2023-10-03T19:16:30.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2a9d9b640 1 -- 172.21.15.45:0/2694464430 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29800bb00 con 0x7fe2ac14fa20 2023-10-03T19:16:30.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2aa59c640 1 --2- 172.21.15.45:0/2694464430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe298003980 0x7fe298003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:30.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2a3fff640 1 --2- 172.21.15.45:0/2694464430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2980047d0 0x7fe298004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:30.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2aad9d640 1 --2- 172.21.15.45:0/2694464430 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe2ac14fa20 0x7fe298005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:30.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2aa59c640 1 -- 172.21.15.45:0/2694464430 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe2ac14fa20 msgr2=0x7fe298005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:30.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2aa59c640 1 --2- 172.21.15.45:0/2694464430 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe2ac14fa20 0x7fe298005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:30.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2aa59c640 1 -- 172.21.15.45:0/2694464430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2980047d0 msgr2=0x7fe298004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:30.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2aa59c640 1 --2- 172.21.15.45:0/2694464430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2980047d0 0x7fe298004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:30.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.222+0000 7fe2aa59c640 1 -- 172.21.15.45:0/2694464430 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe298003530 con 0x7fe298003980 2023-10-03T19:16:30.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.226+0000 7fe2aa59c640 1 --2- 172.21.15.45:0/2694464430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe298003980 0x7fe298003d90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe29c009ae0 tx=0x7fe29c01ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac6b2df4af924c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:30.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.226+0000 7fe2a9d9b640 1 -- 172.21.15.45:0/2694464430 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c0a5630 con 0x7fe298003980 2023-10-03T19:16:30.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.226+0000 7fe2a9d9b640 1 -- 172.21.15.45:0/2694464430 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29c0a5790 con 0x7fe298003980 2023-10-03T19:16:30.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.226+0000 7fe2a9d9b640 1 -- 172.21.15.45:0/2694464430 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c0a5940 con 0x7fe298003980 2023-10-03T19:16:30.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.226+0000 7fe2b0f32640 1 -- 172.21.15.45:0/2694464430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe298003980 msgr2=0x7fe298003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:30.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.226+0000 7fe2b0f32640 1 --2- 172.21.15.45:0/2694464430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe298003980 0x7fe298003d90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe29c009ae0 tx=0x7fe29c01ca60 comp rx=0 tx=0).stop 2023-10-03T19:16:30.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.226+0000 7fe2aad9d640 1 -- 172.21.15.45:0/2694464430 reap_dead start 2023-10-03T19:16:30.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.226+0000 7fe2b0f32640 1 -- 172.21.15.45:0/2694464430 shutdown_connections 2023-10-03T19:16:30.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.226+0000 7fe2b0f32640 1 -- 172.21.15.45:0/2694464430 >> 172.21.15.45:0/2694464430 conn(0x7fe2ac0a4260 msgr2=0x7fe2ac0a4660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:30.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.226+0000 7fe2b0f32640 1 -- 172.21.15.45:0/2694464430 shutdown_connections 2023-10-03T19:16:30.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.226+0000 7fe2b0f32640 1 -- 172.21.15.45:0/2694464430 wait complete. 2023-10-03T19:16:30.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.226+0000 7fe2b0f32640 1 Processor -- start 2023-10-03T19:16:30.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.226+0000 7fe2b0f32640 1 -- start start 2023-10-03T19:16:30.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.230+0000 7fe2b0f32640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe298003980 0x7fe2ac06e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:30.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.230+0000 7fe2b0f32640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe2ac14a7c0 0x7fe2ac1e6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:30.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.230+0000 7fe2b0f32640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2ac144e00 0x7fe2ac1e6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:30.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.230+0000 7fe2b0f32640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac14ac50 con 0x7fe2ac144e00 2023-10-03T19:16:30.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.230+0000 7fe2b0f32640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac06f6c0 con 0x7fe298003980 2023-10-03T19:16:30.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.230+0000 7fe2b0f32640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac1e6bd0 con 0x7fe2ac14a7c0 2023-10-03T19:16:30.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.230+0000 7fe2aad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2ac144e00 0x7fe2ac1e6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:30.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.230+0000 7fe2aad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2ac144e00 0x7fe2ac1e6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47816/0 (socket says 172.21.15.45:47816) 2023-10-03T19:16:30.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.230+0000 7fe2aad9d640 1 -- 172.21.15.45:0/1468066657 learned_addr learned my addr 172.21.15.45:0/1468066657 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:30.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.230+0000 7fe2aa59c640 1 --2- 172.21.15.45:0/1468066657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe298003980 0x7fe2ac06e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:30.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.230+0000 7fe2a3fff640 1 --2- 172.21.15.45:0/1468066657 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe2ac14a7c0 0x7fe2ac1e6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:30.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.230+0000 7fe2aad9d640 1 -- 172.21.15.45:0/1468066657 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe2ac14a7c0 msgr2=0x7fe2ac1e6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:30.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.230+0000 7fe2aad9d640 1 --2- 172.21.15.45:0/1468066657 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe2ac14a7c0 0x7fe2ac1e6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:30.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.230+0000 7fe2aad9d640 1 -- 172.21.15.45:0/1468066657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe298003980 msgr2=0x7fe2ac06e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:30.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.230+0000 7fe2aad9d640 1 --2- 172.21.15.45:0/1468066657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe298003980 0x7fe2ac06e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:30.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.230+0000 7fe2aad9d640 1 -- 172.21.15.45:0/1468066657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ac0c0d50 con 0x7fe2ac144e00 2023-10-03T19:16:30.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.230+0000 7fe2aad9d640 1 --2- 172.21.15.45:0/1468066657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2ac144e00 0x7fe2ac1e6690 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0c2600 tx=0x7fe2a4009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:30.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.230+0000 7fe2a2ffd640 1 -- 172.21.15.45:0/1468066657 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a400e070 con 0x7fe2ac144e00 2023-10-03T19:16:30.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.230+0000 7fe2a2ffd640 1 -- 172.21.15.45:0/1468066657 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a4003c70 con 0x7fe2ac144e00 2023-10-03T19:16:30.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.230+0000 7fe2a2ffd640 1 -- 172.21.15.45:0/1468066657 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4003e20 con 0x7fe2ac144e00 2023-10-03T19:16:30.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.230+0000 7fe2b0f32640 1 -- 172.21.15.45:0/1468066657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2ac0c0bc0 con 0x7fe2ac144e00 2023-10-03T19:16:30.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.230+0000 7fe2b0f32640 1 -- 172.21.15.45:0/1468066657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2ac14c1c0 con 0x7fe2ac144e00 2023-10-03T19:16:30.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.230+0000 7fe2b0f32640 1 -- 172.21.15.45:0/1468066657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2ac04de80 con 0x7fe2ac144e00 2023-10-03T19:16:30.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.230+0000 7fe2a2ffd640 1 -- 172.21.15.45:0/1468066657 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe2a4004030 con 0x7fe2ac144e00 2023-10-03T19:16:30.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.230+0000 7fe2a2ffd640 1 --2- 172.21.15.45:0/1468066657 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe28c0662b0 0x7fe28c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:30.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.230+0000 7fe2a2ffd640 1 -- 172.21.15.45:0/1468066657 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe2a4083b40 con 0x7fe2ac144e00 2023-10-03T19:16:30.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.230+0000 7fe2aa59c640 1 --2- 172.21.15.45:0/1468066657 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe28c0662b0 0x7fe28c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:30.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.234+0000 7fe2aa59c640 1 --2- 172.21.15.45:0/1468066657 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe28c0662b0 0x7fe28c068760 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe29c0af000 tx=0x7fe29c0046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:30.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.234+0000 7fe2a2ffd640 1 -- 172.21.15.45:0/1468066657 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe2a4051030 con 0x7fe2ac144e00 2023-10-03T19:16:30.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.390+0000 7fe2b0f32640 1 -- 172.21.15.45:0/1468066657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe2ac14cf10 con 0x7fe2ac144e00 2023-10-03T19:16:30.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.390+0000 7fe2a2ffd640 1 -- 172.21.15.45:0/1468066657 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe2a4058e60 con 0x7fe2ac144e00 2023-10-03T19:16:30.397 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:16:30.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.394+0000 7fe2b0f32640 1 -- 172.21.15.45:0/1468066657 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe28c0662b0 msgr2=0x7fe28c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:30.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.394+0000 7fe2b0f32640 1 --2- 172.21.15.45:0/1468066657 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe28c0662b0 0x7fe28c068760 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe29c0af000 tx=0x7fe29c0046d0 comp rx=0 tx=0).stop 2023-10-03T19:16:30.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.394+0000 7fe2b0f32640 1 -- 172.21.15.45:0/1468066657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2ac144e00 msgr2=0x7fe2ac1e6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:30.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.394+0000 7fe2b0f32640 1 --2- 172.21.15.45:0/1468066657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2ac144e00 0x7fe2ac1e6690 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0c2600 tx=0x7fe2a4009f50 comp rx=0 tx=0).stop 2023-10-03T19:16:30.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.394+0000 7fe2b0f32640 1 -- 172.21.15.45:0/1468066657 shutdown_connections 2023-10-03T19:16:30.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.394+0000 7fe2b0f32640 1 --2- 172.21.15.45:0/1468066657 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe28c0662b0 0x7fe28c068760 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:30.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.394+0000 7fe2b0f32640 1 --2- 172.21.15.45:0/1468066657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2ac144e00 0x7fe2ac1e6690 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:30.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.394+0000 7fe2b0f32640 1 --2- 172.21.15.45:0/1468066657 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe2ac14a7c0 0x7fe2ac1e6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:30.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.394+0000 7fe2b0f32640 1 --2- 172.21.15.45:0/1468066657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe298003980 0x7fe2ac06e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:30.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.394+0000 7fe2b0f32640 1 -- 172.21.15.45:0/1468066657 >> 172.21.15.45:0/1468066657 conn(0x7fe2ac0a4260 msgr2=0x7fe2ac0a2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:30.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.394+0000 7fe2b0f32640 1 -- 172.21.15.45:0/1468066657 shutdown_connections 2023-10-03T19:16:30.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.394+0000 7fe2b0f32640 1 -- 172.21.15.45:0/1468066657 wait complete. 2023-10-03T19:16:30.416 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:16:30.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.538+0000 7f96fa3e9640 1 Processor -- start 2023-10-03T19:16:30.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.538+0000 7f96fa3e9640 1 -- start start 2023-10-03T19:16:30.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.538+0000 7f96fa3e9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f96f406f880 0x7f96f40a5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:30.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.538+0000 7f96fa3e9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96f414f510 0x7f96f414b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:30.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.538+0000 7f96fa3e9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f414f080 con 0x7f96f40bd9f0 2023-10-03T19:16:30.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.538+0000 7f96fa3e9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f406f3e0 con 0x7f96f406f880 2023-10-03T19:16:30.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.538+0000 7f96fa3e9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f4070e90 con 0x7f96f414f510 2023-10-03T19:16:30.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.538+0000 7f96f3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f96f406f880 0x7f96f40a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:30.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.538+0000 7f96f3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f96f406f880 0x7f96f40a5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47818/0 (socket says 172.21.15.45:47818) 2023-10-03T19:16:30.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.538+0000 7f96f3fff640 1 -- 172.21.15.45:0/3578078696 learned_addr learned my addr 172.21.15.45:0/3578078696 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:30.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.538+0000 7f96f8986640 1 --1- 172.21.15.45:0/3578078696 >> v1:172.21.15.45:6789/0 conn(0x7f96f40bd9f0 0x7f96f40badc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44948/0 (socket says 172.21.15.45:44948) 2023-10-03T19:16:30.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.538+0000 7f96f3fff640 1 -- 172.21.15.45:0/3578078696 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96f414f510 msgr2=0x7f96f414b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:30.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.538+0000 7f96f37fe640 1 --2- 172.21.15.45:0/3578078696 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96f414f510 0x7f96f414b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:30.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.538+0000 7f96f3fff640 1 --2- 172.21.15.45:0/3578078696 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96f414f510 0x7f96f414b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:30.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.538+0000 7f96f3fff640 1 -- 172.21.15.45:0/3578078696 >> v1:172.21.15.45:6789/0 conn(0x7f96f40bd9f0 legacy=0x7f96f40badc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:30.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.538+0000 7f96f3fff640 1 -- 172.21.15.45:0/3578078696 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f414ea30 con 0x7f96f406f880 2023-10-03T19:16:30.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.538+0000 7f96f2ffd640 1 -- 172.21.15.45:0/3578078696 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359180692 0 0) 0x7f96f414f080 con 0x7f96f40bd9f0 2023-10-03T19:16:30.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.538+0000 7f96f37fe640 1 --2- 172.21.15.45:0/3578078696 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96f414f510 0x7f96f414b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:30.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96f3fff640 1 --2- 172.21.15.45:0/3578078696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96f406f880 0x7f96f40a5940 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f96e4009870 tx=0x7f96e401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92653f6a20f7c1a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:30.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96f2ffd640 1 -- 172.21.15.45:0/3578078696 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e40ab670 con 0x7f96f406f880 2023-10-03T19:16:30.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96f2ffd640 1 -- 172.21.15.45:0/3578078696 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e40ab7d0 con 0x7f96f406f880 2023-10-03T19:16:30.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96f2ffd640 1 -- 172.21.15.45:0/3578078696 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e40abb60 con 0x7f96f406f880 2023-10-03T19:16:30.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96fa3e9640 1 -- 172.21.15.45:0/3578078696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96f406f880 msgr2=0x7f96f40a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96fa3e9640 1 --2- 172.21.15.45:0/3578078696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96f406f880 0x7f96f40a5940 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f96e4009870 tx=0x7f96e401c510 comp rx=0 tx=0).stop 2023-10-03T19:16:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96fa3e9640 1 -- 172.21.15.45:0/3578078696 shutdown_connections 2023-10-03T19:16:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96fa3e9640 1 --2- 172.21.15.45:0/3578078696 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96f414f510 0x7f96f414b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96fa3e9640 1 --2- 172.21.15.45:0/3578078696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96f406f880 0x7f96f40a5940 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96fa3e9640 1 -- 172.21.15.45:0/3578078696 >> 172.21.15.45:0/3578078696 conn(0x7f96f40a20d0 msgr2=0x7f96f40a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96fa3e9640 1 -- 172.21.15.45:0/3578078696 shutdown_connections 2023-10-03T19:16:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96fa3e9640 1 -- 172.21.15.45:0/3578078696 wait complete. 2023-10-03T19:16:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96fa3e9640 1 Processor -- start 2023-10-03T19:16:30.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96fa3e9640 1 -- start start 2023-10-03T19:16:30.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96fa3e9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96f406f880 0x7f96f406c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:30.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96fa3e9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96f40bd9f0 0x7f96f4142450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:30.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96fa3e9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96f414f510 0x7f96f4142990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96fa3e9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f40ba330 con 0x7f96f40bd9f0 2023-10-03T19:16:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96fa3e9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f414ad40 con 0x7f96f414f510 2023-10-03T19:16:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96fa3e9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f4142ed0 con 0x7f96f406f880 2023-10-03T19:16:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96f37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96f40bd9f0 0x7f96f4142450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96f37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96f40bd9f0 0x7f96f4142450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47826/0 (socket says 172.21.15.45:47826) 2023-10-03T19:16:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96f37fe640 1 -- 172.21.15.45:0/1376595207 learned_addr learned my addr 172.21.15.45:0/1376595207 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96f3fff640 1 --2- 172.21.15.45:0/1376595207 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96f406f880 0x7f96f406c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96f8986640 1 --2- 172.21.15.45:0/1376595207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96f414f510 0x7f96f4142990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96f37fe640 1 -- 172.21.15.45:0/1376595207 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96f406f880 msgr2=0x7f96f406c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96f37fe640 1 --2- 172.21.15.45:0/1376595207 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96f406f880 0x7f96f406c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96f37fe640 1 -- 172.21.15.45:0/1376595207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96f414f510 msgr2=0x7f96f4142990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96f37fe640 1 --2- 172.21.15.45:0/1376595207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96f414f510 0x7f96f4142990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:30.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96f37fe640 1 -- 172.21.15.45:0/1376595207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e40094d0 con 0x7f96f40bd9f0 2023-10-03T19:16:30.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96f3fff640 1 --2- 172.21.15.45:0/1376595207 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96f406f880 0x7f96f406c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:30.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96f8986640 1 --2- 172.21.15.45:0/1376595207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96f414f510 0x7f96f4142990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:30.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96f37fe640 1 --2- 172.21.15.45:0/1376595207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96f40bd9f0 0x7f96f4142450 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f96e800c820 tx=0x7f96e800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:30.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96f0ff9640 1 -- 172.21.15.45:0/1376595207 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e8007a30 con 0x7f96f40bd9f0 2023-10-03T19:16:30.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96f0ff9640 1 -- 172.21.15.45:0/1376595207 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e8007b90 con 0x7f96f40bd9f0 2023-10-03T19:16:30.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.542+0000 7f96fa3e9640 1 -- 172.21.15.45:0/1376595207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f406fc50 con 0x7f96f40bd9f0 2023-10-03T19:16:30.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.546+0000 7f96f0ff9640 1 -- 172.21.15.45:0/1376595207 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e800ce10 con 0x7f96f40bd9f0 2023-10-03T19:16:30.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.546+0000 7f96fa3e9640 1 -- 172.21.15.45:0/1376595207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f414bc70 con 0x7f96f40bd9f0 2023-10-03T19:16:30.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.546+0000 7f96fa3e9640 1 -- 172.21.15.45:0/1376595207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f4070a40 con 0x7f96f40bd9f0 2023-10-03T19:16:30.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.546+0000 7f96f0ff9640 1 -- 172.21.15.45:0/1376595207 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f96e80113f0 con 0x7f96f40bd9f0 2023-10-03T19:16:30.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.546+0000 7f96f0ff9640 1 --2- 172.21.15.45:0/1376595207 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f96e0066280 0x7f96e0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:30.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.546+0000 7f96f0ff9640 1 -- 172.21.15.45:0/1376595207 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f96e8083e40 con 0x7f96f40bd9f0 2023-10-03T19:16:30.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.546+0000 7f96f3fff640 1 --2- 172.21.15.45:0/1376595207 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f96e0066280 0x7f96e0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:30.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.546+0000 7f96f3fff640 1 --2- 172.21.15.45:0/1376595207 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f96e0066280 0x7f96e0068730 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f96e40af000 tx=0x7f96e40a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:30.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.550+0000 7f96f0ff9640 1 -- 172.21.15.45:0/1376595207 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f96e8051310 con 0x7f96f40bd9f0 2023-10-03T19:16:30.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.702+0000 7f96fa3e9640 1 -- 172.21.15.45:0/1376595207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f96f404de80 con 0x7f96f40bd9f0 2023-10-03T19:16:30.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.706+0000 7f96f0ff9640 1 -- 172.21.15.45:0/1376595207 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v50) v1 ==== 92+0+10 (secure 0 0 0) 0x7f96e8054930 con 0x7f96f40bd9f0 2023-10-03T19:16:30.711 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:16:30.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.706+0000 7f96fa3e9640 1 -- 172.21.15.45:0/1376595207 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f96e0066280 msgr2=0x7f96e0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:30.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.706+0000 7f96fa3e9640 1 --2- 172.21.15.45:0/1376595207 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f96e0066280 0x7f96e0068730 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f96e40af000 tx=0x7f96e40a7000 comp rx=0 tx=0).stop 2023-10-03T19:16:30.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.706+0000 7f96fa3e9640 1 -- 172.21.15.45:0/1376595207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96f40bd9f0 msgr2=0x7f96f4142450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:30.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.706+0000 7f96fa3e9640 1 --2- 172.21.15.45:0/1376595207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96f40bd9f0 0x7f96f4142450 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f96e800c820 tx=0x7f96e800cce0 comp rx=0 tx=0).stop 2023-10-03T19:16:30.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.706+0000 7f96fa3e9640 1 -- 172.21.15.45:0/1376595207 shutdown_connections 2023-10-03T19:16:30.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.706+0000 7f96fa3e9640 1 --2- 172.21.15.45:0/1376595207 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f96e0066280 0x7f96e0068730 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:30.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.706+0000 7f96fa3e9640 1 --2- 172.21.15.45:0/1376595207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96f414f510 0x7f96f4142990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:30.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.706+0000 7f96fa3e9640 1 --2- 172.21.15.45:0/1376595207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96f40bd9f0 0x7f96f4142450 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:30.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.706+0000 7f96fa3e9640 1 --2- 172.21.15.45:0/1376595207 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f96f406f880 0x7f96f406c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:30.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.706+0000 7f96fa3e9640 1 -- 172.21.15.45:0/1376595207 >> 172.21.15.45:0/1376595207 conn(0x7f96f40a20d0 msgr2=0x7f96f40a33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:30.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.706+0000 7f96fa3e9640 1 -- 172.21.15.45:0/1376595207 shutdown_connections 2023-10-03T19:16:30.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.706+0000 7f96fa3e9640 1 -- 172.21.15.45:0/1376595207 wait complete. 2023-10-03T19:16:30.730 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T19:16:30.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.854+0000 7ff9796a4640 1 Processor -- start 2023-10-03T19:16:30.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.854+0000 7ff9796a4640 1 -- start start 2023-10-03T19:16:30.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.854+0000 7ff9796a4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff9740a5d00 0x7ff9741581d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:30.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.854+0000 7ff9796a4640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9740be820 con 0x7ff974150800 2023-10-03T19:16:30.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.854+0000 7ff9796a4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9740b5ea0 con 0x7ff9740bcff0 2023-10-03T19:16:30.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.854+0000 7ff9796a4640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9740a6800 con 0x7ff9740a5d00 2023-10-03T19:16:30.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.854+0000 7ff9737fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff9740a5d00 0x7ff9741581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:30.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.854+0000 7ff972ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff974150800 0x7ff9740a7ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44950/0 (socket says 172.21.15.45:44950) 2023-10-03T19:16:30.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.854+0000 7ff972ffd640 1 -- 172.21.15.45:0/3382447507 learned_addr learned my addr 172.21.15.45:0/3382447507 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:30.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.858+0000 7ff9737fe640 1 -- 172.21.15.45:0/3382447507 >> v1:172.21.15.79:6789/0 conn(0x7ff9740bcff0 legacy=0x7ff9740befa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:30.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.858+0000 7ff9737fe640 1 -- 172.21.15.45:0/3382447507 >> v1:172.21.15.45:6789/0 conn(0x7ff974150800 legacy=0x7ff9740a7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:30.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.858+0000 7ff9737fe640 1 -- 172.21.15.45:0/3382447507 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9740a5750 con 0x7ff9740a5d00 2023-10-03T19:16:30.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.858+0000 7ff9737fe640 1 --2- 172.21.15.45:0/3382447507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9740a5d00 0x7ff9741581d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff96c009d90 tx=0x7ff96c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f70587d23c1dc9de server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:30.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.858+0000 7ff971ffb640 1 -- 172.21.15.45:0/3382447507 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c0a59f0 con 0x7ff9740a5d00 2023-10-03T19:16:30.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.858+0000 7ff971ffb640 1 -- 172.21.15.45:0/3382447507 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96c0a5b50 con 0x7ff9740a5d00 2023-10-03T19:16:30.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.858+0000 7ff971ffb640 1 -- 172.21.15.45:0/3382447507 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c0ad440 con 0x7ff9740a5d00 2023-10-03T19:16:30.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.858+0000 7ff9796a4640 1 -- 172.21.15.45:0/3382447507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9740a5d00 msgr2=0x7ff9741581d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:30.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.858+0000 7ff9796a4640 1 --2- 172.21.15.45:0/3382447507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9740a5d00 0x7ff9741581d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff96c009d90 tx=0x7ff96c01c910 comp rx=0 tx=0).stop 2023-10-03T19:16:30.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.858+0000 7ff9796a4640 1 -- 172.21.15.45:0/3382447507 shutdown_connections 2023-10-03T19:16:30.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.858+0000 7ff9796a4640 1 --2- 172.21.15.45:0/3382447507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9740a5d00 0x7ff9741581d0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:30.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.858+0000 7ff9796a4640 1 -- 172.21.15.45:0/3382447507 >> 172.21.15.45:0/3382447507 conn(0x7ff974071060 msgr2=0x7ff974071460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:30.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.858+0000 7ff9796a4640 1 -- 172.21.15.45:0/3382447507 shutdown_connections 2023-10-03T19:16:30.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.858+0000 7ff9796a4640 1 -- 172.21.15.45:0/3382447507 wait complete. 2023-10-03T19:16:30.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.862+0000 7ff9796a4640 1 Processor -- start 2023-10-03T19:16:30.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.862+0000 7ff9796a4640 1 -- start start 2023-10-03T19:16:30.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.862+0000 7ff9796a4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9740a5d00 0x7ff97406b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:30.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.862+0000 7ff9796a4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9740bcff0 0x7ff974148080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:30.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.862+0000 7ff9796a4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff974150800 0x7ff9741e6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:30.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.862+0000 7ff9796a4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9741ea9e0 con 0x7ff9740a5d00 2023-10-03T19:16:30.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.862+0000 7ff9796a4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97414d0e0 con 0x7ff9740bcff0 2023-10-03T19:16:30.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.862+0000 7ff9796a4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9741485c0 con 0x7ff974150800 2023-10-03T19:16:30.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.862+0000 7ff972ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9740a5d00 0x7ff97406b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:30.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.862+0000 7ff972ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9740a5d00 0x7ff97406b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47848/0 (socket says 172.21.15.45:47848) 2023-10-03T19:16:30.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.862+0000 7ff972ffd640 1 -- 172.21.15.45:0/1768047475 learned_addr learned my addr 172.21.15.45:0/1768047475 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:30.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.862+0000 7ff9727fc640 1 --2- 172.21.15.45:0/1768047475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9740bcff0 0x7ff974148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:30.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.862+0000 7ff972ffd640 1 -- 172.21.15.45:0/1768047475 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff974150800 msgr2=0x7ff9741e6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:30.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.862+0000 7ff9737fe640 1 --2- 172.21.15.45:0/1768047475 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff974150800 0x7ff9741e6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:30.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.862+0000 7ff972ffd640 1 --2- 172.21.15.45:0/1768047475 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff974150800 0x7ff9741e6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:30.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.862+0000 7ff972ffd640 1 -- 172.21.15.45:0/1768047475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9740bcff0 msgr2=0x7ff974148080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:30.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.862+0000 7ff972ffd640 1 --2- 172.21.15.45:0/1768047475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9740bcff0 0x7ff974148080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:30.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.862+0000 7ff972ffd640 1 -- 172.21.15.45:0/1768047475 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c009a70 con 0x7ff9740a5d00 2023-10-03T19:16:30.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.862+0000 7ff9737fe640 1 --2- 172.21.15.45:0/1768047475 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff974150800 0x7ff9741e6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:30.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.862+0000 7ff9727fc640 1 --2- 172.21.15.45:0/1768047475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9740bcff0 0x7ff974148080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:30.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.862+0000 7ff972ffd640 1 --2- 172.21.15.45:0/1768047475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9740a5d00 0x7ff97406b590 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff96400c400 tx=0x7ff96400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:30.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.862+0000 7ff95b7fe640 1 -- 172.21.15.45:0/1768047475 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9640074e0 con 0x7ff9740a5d00 2023-10-03T19:16:30.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.862+0000 7ff95b7fe640 1 -- 172.21.15.45:0/1768047475 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff964007640 con 0x7ff9740a5d00 2023-10-03T19:16:30.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.862+0000 7ff9796a4640 1 -- 172.21.15.45:0/1768047475 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9740bf6b0 con 0x7ff9740a5d00 2023-10-03T19:16:30.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.862+0000 7ff95b7fe640 1 -- 172.21.15.45:0/1768047475 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9640059b0 con 0x7ff9740a5d00 2023-10-03T19:16:30.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.862+0000 7ff9796a4640 1 -- 172.21.15.45:0/1768047475 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff974071b70 con 0x7ff9740a5d00 2023-10-03T19:16:30.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.862+0000 7ff9796a4640 1 -- 172.21.15.45:0/1768047475 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9740bf840 con 0x7ff9740a5d00 2023-10-03T19:16:30.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.862+0000 7ff95b7fe640 1 -- 172.21.15.45:0/1768047475 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff964005b10 con 0x7ff9740a5d00 2023-10-03T19:16:30.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.862+0000 7ff95b7fe640 1 --2- 172.21.15.45:0/1768047475 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff960066280 0x7ff960068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:30.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.866+0000 7ff95b7fe640 1 -- 172.21.15.45:0/1768047475 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff964083260 con 0x7ff9740a5d00 2023-10-03T19:16:30.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.866+0000 7ff9727fc640 1 --2- 172.21.15.45:0/1768047475 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff960066280 0x7ff960068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:30.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.866+0000 7ff9727fc640 1 --2- 172.21.15.45:0/1768047475 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff960066280 0x7ff960068730 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff974071860 tx=0x7ff968009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:30.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:30.870+0000 7ff95b7fe640 1 -- 172.21.15.45:0/1768047475 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff9640506c0 con 0x7ff9740a5d00 2023-10-03T19:16:31.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.022+0000 7ff9796a4640 1 -- 172.21.15.45:0/1768047475 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff9740a5180 con 0x7ff9740a5d00 2023-10-03T19:16:31.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.022+0000 7ff95b7fe640 1 -- 172.21.15.45:0/1768047475 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff964017020 con 0x7ff9740a5d00 2023-10-03T19:16:31.029 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-03T19:16:31.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.026+0000 7ff9796a4640 1 -- 172.21.15.45:0/1768047475 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff960066280 msgr2=0x7ff960068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:31.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.026+0000 7ff9796a4640 1 --2- 172.21.15.45:0/1768047475 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff960066280 0x7ff960068730 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff974071860 tx=0x7ff968009040 comp rx=0 tx=0).stop 2023-10-03T19:16:31.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.026+0000 7ff9796a4640 1 -- 172.21.15.45:0/1768047475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9740a5d00 msgr2=0x7ff97406b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:31.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.026+0000 7ff9796a4640 1 --2- 172.21.15.45:0/1768047475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9740a5d00 0x7ff97406b590 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff96400c400 tx=0x7ff96400c8c0 comp rx=0 tx=0).stop 2023-10-03T19:16:31.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.026+0000 7ff9796a4640 1 -- 172.21.15.45:0/1768047475 shutdown_connections 2023-10-03T19:16:31.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.026+0000 7ff9796a4640 1 --2- 172.21.15.45:0/1768047475 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff960066280 0x7ff960068730 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:31.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.026+0000 7ff9796a4640 1 --2- 172.21.15.45:0/1768047475 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff974150800 0x7ff9741e6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:31.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.026+0000 7ff9796a4640 1 --2- 172.21.15.45:0/1768047475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9740bcff0 0x7ff974148080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:31.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.026+0000 7ff9796a4640 1 --2- 172.21.15.45:0/1768047475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9740a5d00 0x7ff97406b590 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:31.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.026+0000 7ff9796a4640 1 -- 172.21.15.45:0/1768047475 >> 172.21.15.45:0/1768047475 conn(0x7ff974071060 msgr2=0x7ff9740c2670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:31.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.026+0000 7ff9796a4640 1 -- 172.21.15.45:0/1768047475 shutdown_connections 2023-10-03T19:16:31.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.026+0000 7ff9796a4640 1 -- 172.21.15.45:0/1768047475 wait complete. 2023-10-03T19:16:31.048 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T19:16:31.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.174+0000 7f99d6b3f640 1 Processor -- start 2023-10-03T19:16:31.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.174+0000 7f99d6b3f640 1 -- start start 2023-10-03T19:16:31.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.174+0000 7f99d6b3f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f99d014f510 0x7f99d014b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:31.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.174+0000 7f99d6b3f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f99d00bd9f0 0x7f99d014b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:31.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.174+0000 7f99d6b3f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d014f080 con 0x7f99d006f880 2023-10-03T19:16:31.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.174+0000 7f99d6b3f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d006f3e0 con 0x7f99d014f510 2023-10-03T19:16:31.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.174+0000 7f99d6b3f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d0070e90 con 0x7f99d00bd9f0 2023-10-03T19:16:31.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.174+0000 7f99d48db640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f99d006f880 0x7f99d00a5940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44964/0 (socket says 172.21.15.45:44964) 2023-10-03T19:16:31.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.174+0000 7f99d48db640 1 -- 172.21.15.45:0/3197516610 learned_addr learned my addr 172.21.15.45:0/3197516610 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:31.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.174+0000 7f99cffff640 1 --2- 172.21.15.45:0/3197516610 >> v2:172.21.15.45:3300/0 conn(0x7f99d014f510 0x7f99d014b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:31.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.174+0000 7f99d50dc640 1 --2- 172.21.15.45:0/3197516610 >> v2:172.21.15.79:3300/0 conn(0x7f99d00bd9f0 0x7f99d014b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:31.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.174+0000 7f99cf7fe640 1 -- 172.21.15.45:0/3197516610 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 859175492 0 0) 0x7f99d014f080 con 0x7f99d006f880 2023-10-03T19:16:31.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.174+0000 7f99cf7fe640 1 -- 172.21.15.45:0/3197516610 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99bc005740 con 0x7f99d006f880 2023-10-03T19:16:31.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.174+0000 7f99cffff640 1 -- 172.21.15.45:0/3197516610 >> v2:172.21.15.79:3300/0 conn(0x7f99d00bd9f0 msgr2=0x7f99d014b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:31.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.174+0000 7f99cffff640 1 --2- 172.21.15.45:0/3197516610 >> v2:172.21.15.79:3300/0 conn(0x7f99d00bd9f0 0x7f99d014b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:31.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.174+0000 7f99cffff640 1 -- 172.21.15.45:0/3197516610 >> v1:172.21.15.45:6789/0 conn(0x7f99d006f880 legacy=0x7f99d00a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:31.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.174+0000 7f99cffff640 1 -- 172.21.15.45:0/3197516610 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d014ea30 con 0x7f99d014f510 2023-10-03T19:16:31.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.174+0000 7f99cffff640 1 --2- 172.21.15.45:0/3197516610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99d014f510 0x7f99d014b320 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f99d006ec00 tx=0x7f99b801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9d5fa3c3715f0b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:31.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99cf7fe640 1 -- 172.21.15.45:0/3197516610 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b80ab600 con 0x7f99d014f510 2023-10-03T19:16:31.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99cf7fe640 1 -- 172.21.15.45:0/3197516610 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b80a7050 con 0x7f99d014f510 2023-10-03T19:16:31.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99cf7fe640 1 -- 172.21.15.45:0/3197516610 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b80ab980 con 0x7f99d014f510 2023-10-03T19:16:31.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99d6b3f640 1 -- 172.21.15.45:0/3197516610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99d014f510 msgr2=0x7f99d014b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:31.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99d6b3f640 1 --2- 172.21.15.45:0/3197516610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99d014f510 0x7f99d014b320 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f99d006ec00 tx=0x7f99b801c430 comp rx=0 tx=0).stop 2023-10-03T19:16:31.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99d6b3f640 1 -- 172.21.15.45:0/3197516610 shutdown_connections 2023-10-03T19:16:31.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99d6b3f640 1 --2- 172.21.15.45:0/3197516610 >> v2:172.21.15.79:3300/0 conn(0x7f99d00bd9f0 0x7f99d014b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:31.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99d6b3f640 1 --2- 172.21.15.45:0/3197516610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99d014f510 0x7f99d014b320 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:31.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99d6b3f640 1 -- 172.21.15.45:0/3197516610 >> 172.21.15.45:0/3197516610 conn(0x7f99d00a20d0 msgr2=0x7f99d00a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:31.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99d6b3f640 1 -- 172.21.15.45:0/3197516610 shutdown_connections 2023-10-03T19:16:31.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99d6b3f640 1 -- 172.21.15.45:0/3197516610 wait complete. 2023-10-03T19:16:31.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99d6b3f640 1 Processor -- start 2023-10-03T19:16:31.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99d6b3f640 1 -- start start 2023-10-03T19:16:31.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99d6b3f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99d006f880 0x7f99d0149a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:31.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99d6b3f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f99d00bd9f0 0x7f99d00a45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:31.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99d6b3f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99d0148a00 0x7f99d0148e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:31.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99d6b3f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d00be080 con 0x7f99d0148a00 2023-10-03T19:16:31.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99d6b3f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d00b5550 con 0x7f99d006f880 2023-10-03T19:16:31.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99d6b3f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d00b6e90 con 0x7f99d00bd9f0 2023-10-03T19:16:31.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99d50dc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99d0148a00 0x7f99d0148e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:31.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99d50dc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99d0148a00 0x7f99d0148e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47866/0 (socket says 172.21.15.45:47866) 2023-10-03T19:16:31.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99d50dc640 1 -- 172.21.15.45:0/1647049494 learned_addr learned my addr 172.21.15.45:0/1647049494 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:31.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99d48db640 1 --2- 172.21.15.45:0/1647049494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99d006f880 0x7f99d0149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:31.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99cffff640 1 --2- 172.21.15.45:0/1647049494 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f99d00bd9f0 0x7f99d00a45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:31.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99d50dc640 1 -- 172.21.15.45:0/1647049494 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f99d00bd9f0 msgr2=0x7f99d00a45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:31.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99d50dc640 1 --2- 172.21.15.45:0/1647049494 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f99d00bd9f0 0x7f99d00a45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:31.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99d50dc640 1 -- 172.21.15.45:0/1647049494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99d006f880 msgr2=0x7f99d0149a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:31.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99d50dc640 1 --2- 172.21.15.45:0/1647049494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99d006f880 0x7f99d0149a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:31.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99d50dc640 1 -- 172.21.15.45:0/1647049494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b8009420 con 0x7f99d0148a00 2023-10-03T19:16:31.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99d48db640 1 --2- 172.21.15.45:0/1647049494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99d006f880 0x7f99d0149a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:31.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99d50dc640 1 --2- 172.21.15.45:0/1647049494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99d0148a00 0x7f99d0148e80 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f99c8007e70 tx=0x7f99c800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:31.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99cd7fa640 1 -- 172.21.15.45:0/1647049494 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c8014620 con 0x7f99d0148a00 2023-10-03T19:16:31.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99cd7fa640 1 -- 172.21.15.45:0/1647049494 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c80147a0 con 0x7f99d0148a00 2023-10-03T19:16:31.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99cd7fa640 1 -- 172.21.15.45:0/1647049494 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c8014b50 con 0x7f99d0148a00 2023-10-03T19:16:31.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.178+0000 7f99d6b3f640 1 -- 172.21.15.45:0/1647049494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d00a6050 con 0x7f99d0148a00 2023-10-03T19:16:31.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.182+0000 7f99d6b3f640 1 -- 172.21.15.45:0/1647049494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d006fc50 con 0x7f99d0148a00 2023-10-03T19:16:31.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.182+0000 7f99d6b3f640 1 -- 172.21.15.45:0/1647049494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d00a61e0 con 0x7f99d0148a00 2023-10-03T19:16:31.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.182+0000 7f99cd7fa640 1 -- 172.21.15.45:0/1647049494 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f99c8014cb0 con 0x7f99d0148a00 2023-10-03T19:16:31.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.182+0000 7f99cd7fa640 1 --2- 172.21.15.45:0/1647049494 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f99b0066280 0x7f99b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:31.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.182+0000 7f99cd7fa640 1 -- 172.21.15.45:0/1647049494 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f99c80847b0 con 0x7f99d0148a00 2023-10-03T19:16:31.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.182+0000 7f99d48db640 1 --2- 172.21.15.45:0/1647049494 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f99b0066280 0x7f99b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:31.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.182+0000 7f99d48db640 1 --2- 172.21.15.45:0/1647049494 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f99b0066280 0x7f99b0068730 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f99c00011f0 tx=0x7f99c0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:31.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.186+0000 7f99cd7fa640 1 -- 172.21.15.45:0/1647049494 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f99c8055670 con 0x7f99d0148a00 2023-10-03T19:16:31.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.342+0000 7f99d6b3f640 1 -- 172.21.15.45:0/1647049494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f99d00be1c0 con 0x7f99d0148a00 2023-10-03T19:16:31.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.342+0000 7f99cd7fa640 1 -- 172.21.15.45:0/1647049494 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) v1 ==== 100+0+11 (secure 0 0 0) 0x7f99d00be1c0 con 0x7f99d0148a00 2023-10-03T19:16:31.349 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-03T19:16:31.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.346+0000 7f99d6b3f640 1 -- 172.21.15.45:0/1647049494 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f99b0066280 msgr2=0x7f99b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:31.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.346+0000 7f99d6b3f640 1 --2- 172.21.15.45:0/1647049494 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f99b0066280 0x7f99b0068730 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f99c00011f0 tx=0x7f99c0009040 comp rx=0 tx=0).stop 2023-10-03T19:16:31.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.346+0000 7f99d6b3f640 1 -- 172.21.15.45:0/1647049494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99d0148a00 msgr2=0x7f99d0148e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:31.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.346+0000 7f99d6b3f640 1 --2- 172.21.15.45:0/1647049494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99d0148a00 0x7f99d0148e80 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f99c8007e70 tx=0x7f99c800e4b0 comp rx=0 tx=0).stop 2023-10-03T19:16:31.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.346+0000 7f99d6b3f640 1 -- 172.21.15.45:0/1647049494 shutdown_connections 2023-10-03T19:16:31.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.346+0000 7f99d6b3f640 1 --2- 172.21.15.45:0/1647049494 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f99b0066280 0x7f99b0068730 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:31.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.346+0000 7f99d6b3f640 1 --2- 172.21.15.45:0/1647049494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99d0148a00 0x7f99d0148e80 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:31.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.346+0000 7f99d6b3f640 1 --2- 172.21.15.45:0/1647049494 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f99d00bd9f0 0x7f99d00a45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:31.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.346+0000 7f99d6b3f640 1 --2- 172.21.15.45:0/1647049494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99d006f880 0x7f99d0149a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:31.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.346+0000 7f99d6b3f640 1 -- 172.21.15.45:0/1647049494 >> 172.21.15.45:0/1647049494 conn(0x7f99d00a20d0 msgr2=0x7f99d01553b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:31.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.346+0000 7f99d6b3f640 1 -- 172.21.15.45:0/1647049494 shutdown_connections 2023-10-03T19:16:31.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.346+0000 7f99d6b3f640 1 -- 172.21.15.45:0/1647049494 wait complete. 2023-10-03T19:16:31.369 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:16:31.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.486+0000 7f74dc326640 1 Processor -- start 2023-10-03T19:16:31.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.486+0000 7f74dc326640 1 -- start start 2023-10-03T19:16:31.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.490+0000 7f74dc326640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f74d40a6140 0x7f74d414d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:31.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.490+0000 7f74dc326640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f74d40bb970 0x7f74d414ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:31.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.490+0000 7f74dc326640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d414d610 con 0x7f74d406d5b0 2023-10-03T19:16:31.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.490+0000 7f74dc326640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d406abb0 con 0x7f74d40bb970 2023-10-03T19:16:31.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.490+0000 7f74dc326640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d40a6870 con 0x7f74d40a6140 2023-10-03T19:16:31.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.490+0000 7f74da0c2640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f74d406d5b0 0x7f74d406d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44976/0 (socket says 172.21.15.45:44976) 2023-10-03T19:16:31.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.490+0000 7f74da0c2640 1 -- 172.21.15.45:0/632927498 learned_addr learned my addr 172.21.15.45:0/632927498 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:31.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.490+0000 7f74da8c3640 1 --2- 172.21.15.45:0/632927498 >> v2:172.21.15.45:3300/0 conn(0x7f74d40bb970 0x7f74d414ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:31.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.490+0000 7f74d98c1640 1 --2- 172.21.15.45:0/632927498 >> v2:172.21.15.79:3300/0 conn(0x7f74d40a6140 0x7f74d414d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:31.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.490+0000 7f74d90c0640 1 -- 172.21.15.45:0/632927498 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240080854 0 0) 0x7f74d414d610 con 0x7f74d406d5b0 2023-10-03T19:16:31.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.490+0000 7f74d90c0640 1 -- 172.21.15.45:0/632927498 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74c0003530 con 0x7f74d406d5b0 2023-10-03T19:16:31.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.490+0000 7f74da8c3640 1 -- 172.21.15.45:0/632927498 >> v2:172.21.15.79:3300/0 conn(0x7f74d40a6140 msgr2=0x7f74d414d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:31.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.490+0000 7f74da8c3640 1 --2- 172.21.15.45:0/632927498 >> v2:172.21.15.79:3300/0 conn(0x7f74d40a6140 0x7f74d414d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:31.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.490+0000 7f74da8c3640 1 -- 172.21.15.45:0/632927498 >> v1:172.21.15.45:6789/0 conn(0x7f74d406d5b0 legacy=0x7f74d406d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:31.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.490+0000 7f74da8c3640 1 -- 172.21.15.45:0/632927498 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d40a6590 con 0x7f74d40bb970 2023-10-03T19:16:31.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.490+0000 7f74da8c3640 1 --2- 172.21.15.45:0/632927498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d40bb970 0x7f74d414ba70 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f74d406fdf0 tx=0x7f74cc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ac1841ac29e1ce server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:31.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.490+0000 7f74d90c0640 1 -- 172.21.15.45:0/632927498 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc0a58c0 con 0x7f74d40bb970 2023-10-03T19:16:31.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.490+0000 7f74d90c0640 1 -- 172.21.15.45:0/632927498 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74cc0a5a20 con 0x7f74d40bb970 2023-10-03T19:16:31.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.490+0000 7f74d90c0640 1 -- 172.21.15.45:0/632927498 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc0a5d90 con 0x7f74d40bb970 2023-10-03T19:16:31.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74dc326640 1 -- 172.21.15.45:0/632927498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d40bb970 msgr2=0x7f74d414ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:31.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74dc326640 1 --2- 172.21.15.45:0/632927498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d40bb970 0x7f74d414ba70 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f74d406fdf0 tx=0x7f74cc01c910 comp rx=0 tx=0).stop 2023-10-03T19:16:31.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74dc326640 1 -- 172.21.15.45:0/632927498 shutdown_connections 2023-10-03T19:16:31.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74dc326640 1 --2- 172.21.15.45:0/632927498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d40bb970 0x7f74d414ba70 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:31.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74dc326640 1 --2- 172.21.15.45:0/632927498 >> v2:172.21.15.79:3300/0 conn(0x7f74d40a6140 0x7f74d414d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:31.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74dc326640 1 -- 172.21.15.45:0/632927498 >> 172.21.15.45:0/632927498 conn(0x7f74d40c1600 msgr2=0x7f74d40c1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:31.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74dc326640 1 -- 172.21.15.45:0/632927498 shutdown_connections 2023-10-03T19:16:31.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74dc326640 1 -- 172.21.15.45:0/632927498 wait complete. 2023-10-03T19:16:31.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74dc326640 1 Processor -- start 2023-10-03T19:16:31.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74dc326640 1 -- start start 2023-10-03T19:16:31.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74dc326640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d406d5b0 0x7f74d40c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:31.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74dc326640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74d40a6140 0x7f74d41ea190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:31.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74dc326640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74d40bb970 0x7f74d413f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:31.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74dc326640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d4071910 con 0x7f74d406d5b0 2023-10-03T19:16:31.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74dc326640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d4071c80 con 0x7f74d40a6140 2023-10-03T19:16:31.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74dc326640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d4071670 con 0x7f74d40bb970 2023-10-03T19:16:31.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74da0c2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d406d5b0 0x7f74d40c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:31.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74da0c2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d406d5b0 0x7f74d40c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47894/0 (socket says 172.21.15.45:47894) 2023-10-03T19:16:31.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74da0c2640 1 -- 172.21.15.45:0/1065867071 learned_addr learned my addr 172.21.15.45:0/1065867071 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:31.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74d98c1640 1 --2- 172.21.15.45:0/1065867071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74d40a6140 0x7f74d41ea190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:31.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74da0c2640 1 -- 172.21.15.45:0/1065867071 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74d40bb970 msgr2=0x7f74d413f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:31.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74da0c2640 1 --2- 172.21.15.45:0/1065867071 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74d40bb970 0x7f74d413f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:31.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74da0c2640 1 -- 172.21.15.45:0/1065867071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74d40a6140 msgr2=0x7f74d41ea190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:31.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74da0c2640 1 --2- 172.21.15.45:0/1065867071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74d40a6140 0x7f74d41ea190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:31.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74da0c2640 1 -- 172.21.15.45:0/1065867071 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74cc009a70 con 0x7f74d406d5b0 2023-10-03T19:16:31.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74da0c2640 1 --2- 172.21.15.45:0/1065867071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d406d5b0 0x7f74d40c06d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f74d000c450 tx=0x7f74d000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:31.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74caffd640 1 -- 172.21.15.45:0/1065867071 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d0005cf0 con 0x7f74d406d5b0 2023-10-03T19:16:31.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74caffd640 1 -- 172.21.15.45:0/1065867071 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d0005e50 con 0x7f74d406d5b0 2023-10-03T19:16:31.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74dc326640 1 -- 172.21.15.45:0/1065867071 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d406e090 con 0x7f74d406d5b0 2023-10-03T19:16:31.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74caffd640 1 -- 172.21.15.45:0/1065867071 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d0007290 con 0x7f74d406d5b0 2023-10-03T19:16:31.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.494+0000 7f74dc326640 1 -- 172.21.15.45:0/1065867071 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d406a6f0 con 0x7f74d406d5b0 2023-10-03T19:16:31.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.498+0000 7f74dc326640 1 -- 172.21.15.45:0/1065867071 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d414c3c0 con 0x7f74d406d5b0 2023-10-03T19:16:31.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.498+0000 7f74caffd640 1 -- 172.21.15.45:0/1065867071 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f74d00073f0 con 0x7f74d406d5b0 2023-10-03T19:16:31.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.498+0000 7f74caffd640 1 --2- 172.21.15.45:0/1065867071 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f74b8066280 0x7f74b8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:31.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.498+0000 7f74caffd640 1 -- 172.21.15.45:0/1065867071 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f74d0083340 con 0x7f74d406d5b0 2023-10-03T19:16:31.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.498+0000 7f74d98c1640 1 --2- 172.21.15.45:0/1065867071 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f74b8066280 0x7f74b8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:31.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.498+0000 7f74d98c1640 1 --2- 172.21.15.45:0/1065867071 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f74b8066280 0x7f74b8068730 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f74d4148a90 tx=0x7f74c4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:31.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.502+0000 7f74caffd640 1 -- 172.21.15.45:0/1065867071 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f74d0050810 con 0x7f74d406d5b0 2023-10-03T19:16:31.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.694+0000 7f74dc326640 1 -- 172.21.15.45:0/1065867071 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74d404de80 con 0x7f74d406d5b0 2023-10-03T19:16:31.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.698+0000 7f74caffd640 1 -- 172.21.15.45:0/1065867071 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+3914 (secure 0 0 0) 0x7f74d0053e30 con 0x7f74d406d5b0 2023-10-03T19:16:31.703 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:16:31.704 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2315858323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2315858323},{"type":"v1","addr":"172.21.15.79:6835","nonce":2315858323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1525989510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1525989510},{"type":"v1","addr":"172.21.15.45:6834","nonce":1525989510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:15:46.329993+0000","modified":"2023-10-03T19:15:49.849869+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5514":{"gid":5514,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1319730866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1319730866},{"type":"v1","addr":"172.21.15.45:6835","nonce":1319730866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-10-03T19:16:31.704 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 23 2023-10-03T19:16:31.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.698+0000 7f74dc326640 1 -- 172.21.15.45:0/1065867071 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f74b8066280 msgr2=0x7f74b8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:31.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.698+0000 7f74dc326640 1 --2- 172.21.15.45:0/1065867071 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f74b8066280 0x7f74b8068730 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f74d4148a90 tx=0x7f74c4008040 comp rx=0 tx=0).stop 2023-10-03T19:16:31.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.698+0000 7f74dc326640 1 -- 172.21.15.45:0/1065867071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d406d5b0 msgr2=0x7f74d40c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:31.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.698+0000 7f74dc326640 1 --2- 172.21.15.45:0/1065867071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d406d5b0 0x7f74d40c06d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f74d000c450 tx=0x7f74d000c910 comp rx=0 tx=0).stop 2023-10-03T19:16:31.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.698+0000 7f74dc326640 1 -- 172.21.15.45:0/1065867071 shutdown_connections 2023-10-03T19:16:31.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.698+0000 7f74dc326640 1 --2- 172.21.15.45:0/1065867071 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f74b8066280 0x7f74b8068730 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:31.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.698+0000 7f74dc326640 1 --2- 172.21.15.45:0/1065867071 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74d40bb970 0x7f74d413f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:31.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.698+0000 7f74dc326640 1 --2- 172.21.15.45:0/1065867071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74d40a6140 0x7f74d41ea190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:31.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.698+0000 7f74dc326640 1 --2- 172.21.15.45:0/1065867071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d406d5b0 0x7f74d40c06d0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:31.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.698+0000 7f74dc326640 1 -- 172.21.15.45:0/1065867071 >> 172.21.15.45:0/1065867071 conn(0x7f74d40c1600 msgr2=0x7f74d406d980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:31.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.702+0000 7f74dc326640 1 -- 172.21.15.45:0/1065867071 shutdown_connections 2023-10-03T19:16:31.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.702+0000 7f74dc326640 1 -- 172.21.15.45:0/1065867071 wait complete. 2023-10-03T19:16:31.724 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:16:31.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.834+0000 7f4022331640 1 Processor -- start 2023-10-03T19:16:31.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.838+0000 7f4022331640 1 -- start start 2023-10-03T19:16:31.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.838+0000 7f4022331640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f401c06cd40 0x7f401c14aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:31.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.838+0000 7f4022331640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f401c0a3670 0x7f401c0bbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:31.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.838+0000 7f4022331640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f401c0baf60 con 0x7f401c147ab0 2023-10-03T19:16:31.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.838+0000 7f4022331640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f401c0a5db0 con 0x7f401c06cd40 2023-10-03T19:16:31.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.838+0000 7f4022331640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f401c0a3aa0 con 0x7f401c0a3670 2023-10-03T19:16:31.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.838+0000 7f401bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f401c06cd40 0x7f401c14aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:31.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.838+0000 7f401bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f401c06cd40 0x7f401c14aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47910/0 (socket says 172.21.15.45:47910) 2023-10-03T19:16:31.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.838+0000 7f401bfff640 1 -- 172.21.15.45:0/1328975958 learned_addr learned my addr 172.21.15.45:0/1328975958 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:31.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.838+0000 7f401b7fe640 1 --2- 172.21.15.45:0/1328975958 >> v2:172.21.15.79:3300/0 conn(0x7f401c0a3670 0x7f401c0bbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:31.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.838+0000 7f401bfff640 1 -- 172.21.15.45:0/1328975958 >> v2:172.21.15.79:3300/0 conn(0x7f401c0a3670 msgr2=0x7f401c0bbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:31.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.838+0000 7f401bfff640 1 --2- 172.21.15.45:0/1328975958 >> v2:172.21.15.79:3300/0 conn(0x7f401c0a3670 0x7f401c0bbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:31.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.838+0000 7f401bfff640 1 -- 172.21.15.45:0/1328975958 >> v1:172.21.15.79:6789/0 conn(0x7f401c147ab0 legacy=0x7f401c14e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:31.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.838+0000 7f401bfff640 1 -- 172.21.15.45:0/1328975958 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401c0bb240 con 0x7f401c06cd40 2023-10-03T19:16:31.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.838+0000 7f401b7fe640 1 --2- 172.21.15.45:0/1328975958 >> v2:172.21.15.79:3300/0 conn(0x7f401c0a3670 0x7f401c0bbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:16:31.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.842+0000 7f401bfff640 1 --2- 172.21.15.45:0/1328975958 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f401c06cd40 0x7f401c14aa50 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f401c0a5910 tx=0x7f400c021180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7008cb08e29b503 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:31.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.842+0000 7f401affd640 1 -- 172.21.15.45:0/1328975958 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c004030 con 0x7f401c06cd40 2023-10-03T19:16:31.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.842+0000 7f401affd640 1 -- 172.21.15.45:0/1328975958 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400c0ad030 con 0x7f401c06cd40 2023-10-03T19:16:31.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.842+0000 7f401affd640 1 -- 172.21.15.45:0/1328975958 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c004410 con 0x7f401c06cd40 2023-10-03T19:16:31.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.842+0000 7f4022331640 1 -- 172.21.15.45:0/1328975958 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f401c06cd40 msgr2=0x7f401c14aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:31.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.842+0000 7f4022331640 1 --2- 172.21.15.45:0/1328975958 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f401c06cd40 0x7f401c14aa50 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f401c0a5910 tx=0x7f400c021180 comp rx=0 tx=0).stop 2023-10-03T19:16:31.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.842+0000 7f4022331640 1 -- 172.21.15.45:0/1328975958 shutdown_connections 2023-10-03T19:16:31.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.842+0000 7f4022331640 1 --2- 172.21.15.45:0/1328975958 >> v2:172.21.15.79:3300/0 conn(0x7f401c0a3670 0x7f401c0bbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:31.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.842+0000 7f4022331640 1 --2- 172.21.15.45:0/1328975958 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f401c06cd40 0x7f401c14aa50 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:31.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.842+0000 7f4022331640 1 -- 172.21.15.45:0/1328975958 >> 172.21.15.45:0/1328975958 conn(0x7f401c0bcf50 msgr2=0x7f401c0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:31.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.842+0000 7f4022331640 1 -- 172.21.15.45:0/1328975958 shutdown_connections 2023-10-03T19:16:31.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.842+0000 7f4022331640 1 -- 172.21.15.45:0/1328975958 wait complete. 2023-10-03T19:16:31.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.842+0000 7f4022331640 1 Processor -- start 2023-10-03T19:16:31.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.842+0000 7f4022331640 1 -- start start 2023-10-03T19:16:31.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.842+0000 7f4022331640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f401c06cd40 0x7f401c0bf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:31.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.842+0000 7f4022331640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f401c0a3670 0x7f401c06f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:31.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.842+0000 7f4022331640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f401c147ab0 0x7f401c1e24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:31.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.842+0000 7f4022331640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c14cbb0 con 0x7f401c147ab0 2023-10-03T19:16:31.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.842+0000 7f4022331640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c0bf830 con 0x7f401c06cd40 2023-10-03T19:16:31.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.842+0000 7f4022331640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f401c14cdc0 con 0x7f401c0a3670 2023-10-03T19:16:31.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.842+0000 7f40208ce640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f401c147ab0 0x7f401c1e24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:31.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.842+0000 7f40208ce640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f401c147ab0 0x7f401c1e24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47920/0 (socket says 172.21.15.45:47920) 2023-10-03T19:16:31.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.842+0000 7f40208ce640 1 -- 172.21.15.45:0/1384709685 learned_addr learned my addr 172.21.15.45:0/1384709685 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:31.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.846+0000 7f401bfff640 1 --2- 172.21.15.45:0/1384709685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f401c06cd40 0x7f401c0bf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:31.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.846+0000 7f401b7fe640 1 --2- 172.21.15.45:0/1384709685 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f401c0a3670 0x7f401c06f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:31.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.846+0000 7f40208ce640 1 -- 172.21.15.45:0/1384709685 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f401c0a3670 msgr2=0x7f401c06f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:31.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.846+0000 7f40208ce640 1 --2- 172.21.15.45:0/1384709685 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f401c0a3670 0x7f401c06f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:31.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.846+0000 7f40208ce640 1 -- 172.21.15.45:0/1384709685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f401c06cd40 msgr2=0x7f401c0bf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:31.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.846+0000 7f40208ce640 1 --2- 172.21.15.45:0/1384709685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f401c06cd40 0x7f401c0bf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:31.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.846+0000 7f40208ce640 1 -- 172.21.15.45:0/1384709685 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400c00b780 con 0x7f401c147ab0 2023-10-03T19:16:31.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.846+0000 7f40208ce640 1 --2- 172.21.15.45:0/1384709685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f401c147ab0 0x7f401c1e24f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f401400c730 tx=0x7f401400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:31.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.846+0000 7f4018ff9640 1 -- 172.21.15.45:0/1384709685 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4014003b80 con 0x7f401c147ab0 2023-10-03T19:16:31.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.846+0000 7f4018ff9640 1 -- 172.21.15.45:0/1384709685 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4014003ce0 con 0x7f401c147ab0 2023-10-03T19:16:31.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.846+0000 7f4022331640 1 -- 172.21.15.45:0/1384709685 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f401c0bb800 con 0x7f401c147ab0 2023-10-03T19:16:31.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.846+0000 7f4018ff9640 1 -- 172.21.15.45:0/1384709685 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401400aa30 con 0x7f401c147ab0 2023-10-03T19:16:31.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.846+0000 7f4022331640 1 -- 172.21.15.45:0/1384709685 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f401c0bb520 con 0x7f401c147ab0 2023-10-03T19:16:31.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.846+0000 7f4022331640 1 -- 172.21.15.45:0/1384709685 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f401c0bcc90 con 0x7f401c147ab0 2023-10-03T19:16:31.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.846+0000 7f4018ff9640 1 -- 172.21.15.45:0/1384709685 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f401400ab90 con 0x7f401c147ab0 2023-10-03T19:16:31.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.846+0000 7f4018ff9640 1 --2- 172.21.15.45:0/1384709685 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f40080662b0 0x7f4008068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:31.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.846+0000 7f4018ff9640 1 -- 172.21.15.45:0/1384709685 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4014083b60 con 0x7f401c147ab0 2023-10-03T19:16:31.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.846+0000 7f401bfff640 1 --2- 172.21.15.45:0/1384709685 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f40080662b0 0x7f4008068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:31.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.846+0000 7f401bfff640 1 --2- 172.21.15.45:0/1384709685 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f40080662b0 0x7f4008068760 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f400c0b4000 tx=0x7f400c0ac000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:31.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:31.850+0000 7f4018ff9640 1 -- 172.21.15.45:0/1384709685 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4014050fa0 con 0x7f401c147ab0 2023-10-03T19:16:32.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.010+0000 7f4022331640 1 -- 172.21.15.45:0/1384709685 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f401c04de80 con 0x7f401c147ab0 2023-10-03T19:16:32.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.014+0000 7f4018ff9640 1 -- 172.21.15.45:0/1384709685 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18399 (secure 0 0 0) 0x7f40140545c0 con 0x7f401c147ab0 2023-10-03T19:16:32.020 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:16:32.020 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":50,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:16:13.667014+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:15:44.458794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-03T19:15:45.219182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.1d","mappings":[{"from":0,"to":6}]},{"pgid":"8.3d","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:16:32.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.014+0000 7f4022331640 1 -- 172.21.15.45:0/1384709685 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f40080662b0 msgr2=0x7f4008068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:32.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.014+0000 7f4022331640 1 --2- 172.21.15.45:0/1384709685 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f40080662b0 0x7f4008068760 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f400c0b4000 tx=0x7f400c0ac000 comp rx=0 tx=0).stop 2023-10-03T19:16:32.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.014+0000 7f4022331640 1 -- 172.21.15.45:0/1384709685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f401c147ab0 msgr2=0x7f401c1e24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:32.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.014+0000 7f4022331640 1 --2- 172.21.15.45:0/1384709685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f401c147ab0 0x7f401c1e24f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f401400c730 tx=0x7f401400cbf0 comp rx=0 tx=0).stop 2023-10-03T19:16:32.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.014+0000 7f4022331640 1 -- 172.21.15.45:0/1384709685 shutdown_connections 2023-10-03T19:16:32.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.014+0000 7f4022331640 1 --2- 172.21.15.45:0/1384709685 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f40080662b0 0x7f4008068760 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:32.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.014+0000 7f4022331640 1 --2- 172.21.15.45:0/1384709685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f401c147ab0 0x7f401c1e24f0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:32.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.014+0000 7f4022331640 1 --2- 172.21.15.45:0/1384709685 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f401c0a3670 0x7f401c06f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:32.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.014+0000 7f4022331640 1 --2- 172.21.15.45:0/1384709685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f401c06cd40 0x7f401c0bf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:32.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.014+0000 7f4022331640 1 -- 172.21.15.45:0/1384709685 >> 172.21.15.45:0/1384709685 conn(0x7f401c0bcf50 msgr2=0x7f401c0a3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:32.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.014+0000 7f4022331640 1 -- 172.21.15.45:0/1384709685 shutdown_connections 2023-10-03T19:16:32.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.014+0000 7f4022331640 1 -- 172.21.15.45:0/1384709685 wait complete. 2023-10-03T19:16:32.038 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-03T19:16:32.039 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:16:32.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.146+0000 7f5d7e7bf640 1 Processor -- start 2023-10-03T19:16:32.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.146+0000 7f5d7e7bf640 1 -- start start 2023-10-03T19:16:32.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.146+0000 7f5d7e7bf640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5d7806e100 0x7f5d78069bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:32.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.146+0000 7f5d7e7bf640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5d7806a170 0x7f5d781488f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:32.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.146+0000 7f5d7e7bf640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d7806b290 con 0x7f5d7806d5b0 2023-10-03T19:16:32.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.146+0000 7f5d7e7bf640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d7806a870 con 0x7f5d7806e100 2023-10-03T19:16:32.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.146+0000 7f5d7e7bf640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d7806a5d0 con 0x7f5d7806a170 2023-10-03T19:16:32.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.146+0000 7f5d777fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5d7806e100 0x7f5d78069bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:32.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.146+0000 7f5d777fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5d7806e100 0x7f5d78069bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47928/0 (socket says 172.21.15.45:47928) 2023-10-03T19:16:32.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.146+0000 7f5d777fe640 1 -- 172.21.15.45:0/955342399 learned_addr learned my addr 172.21.15.45:0/955342399 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:32.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.146+0000 7f5d777fe640 1 -- 172.21.15.45:0/955342399 >> v2:172.21.15.79:3300/0 conn(0x7f5d7806a170 msgr2=0x7f5d781488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:32.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.146+0000 7f5d7cd5c640 1 --2- 172.21.15.45:0/955342399 >> v2:172.21.15.79:3300/0 conn(0x7f5d7806a170 0x7f5d781488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:32.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.146+0000 7f5d777fe640 1 --2- 172.21.15.45:0/955342399 >> v2:172.21.15.79:3300/0 conn(0x7f5d7806a170 0x7f5d781488f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:32.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.146+0000 7f5d777fe640 1 -- 172.21.15.45:0/955342399 >> v1:172.21.15.79:6789/0 conn(0x7f5d7806d5b0 legacy=0x7f5d7814c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:32.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.146+0000 7f5d777fe640 1 -- 172.21.15.45:0/955342399 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d780a3f60 con 0x7f5d7806e100 2023-10-03T19:16:32.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.146+0000 7f5d7cd5c640 1 --2- 172.21.15.45:0/955342399 >> v2:172.21.15.79:3300/0 conn(0x7f5d7806a170 0x7f5d781488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:32.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d777fe640 1 --2- 172.21.15.45:0/955342399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d7806e100 0x7f5d78069bd0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5d78072a10 tx=0x7f5d6c01ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02dc351d8313434 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:32.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d76ffd640 1 -- 172.21.15.45:0/955342399 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c0a89b0 con 0x7f5d7806e100 2023-10-03T19:16:32.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d76ffd640 1 -- 172.21.15.45:0/955342399 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6c0a8b10 con 0x7f5d7806e100 2023-10-03T19:16:32.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d76ffd640 1 -- 172.21.15.45:0/955342399 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c0a8ea0 con 0x7f5d7806e100 2023-10-03T19:16:32.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d7e7bf640 1 -- 172.21.15.45:0/955342399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d7806e100 msgr2=0x7f5d78069bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:32.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d7e7bf640 1 --2- 172.21.15.45:0/955342399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d7806e100 0x7f5d78069bd0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5d78072a10 tx=0x7f5d6c01ecb0 comp rx=0 tx=0).stop 2023-10-03T19:16:32.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d7e7bf640 1 -- 172.21.15.45:0/955342399 shutdown_connections 2023-10-03T19:16:32.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d7e7bf640 1 --2- 172.21.15.45:0/955342399 >> v2:172.21.15.79:3300/0 conn(0x7f5d7806a170 0x7f5d781488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:32.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d7e7bf640 1 --2- 172.21.15.45:0/955342399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d7806e100 0x7f5d78069bd0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:32.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d7e7bf640 1 -- 172.21.15.45:0/955342399 >> 172.21.15.45:0/955342399 conn(0x7f5d780c1600 msgr2=0x7f5d780c1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:32.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d7e7bf640 1 -- 172.21.15.45:0/955342399 shutdown_connections 2023-10-03T19:16:32.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d7e7bf640 1 -- 172.21.15.45:0/955342399 wait complete. 2023-10-03T19:16:32.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d7e7bf640 1 Processor -- start 2023-10-03T19:16:32.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d7e7bf640 1 -- start start 2023-10-03T19:16:32.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d7e7bf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d7806a170 0x7f5d780713d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:32.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d7e7bf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d7806d5b0 0x7f5d78149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:32.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d7e7bf640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5d7806e100 0x7f5d7814a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:32.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d7e7bf640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d78071910 con 0x7f5d7806a170 2023-10-03T19:16:32.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d7e7bf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7814ca20 con 0x7f5d7806d5b0 2023-10-03T19:16:32.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d7e7bf640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d78149550 con 0x7f5d7806e100 2023-10-03T19:16:32.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d77fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d7806a170 0x7f5d780713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:32.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d77fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d7806a170 0x7f5d780713d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47940/0 (socket says 172.21.15.45:47940) 2023-10-03T19:16:32.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d77fff640 1 -- 172.21.15.45:0/2942636553 learned_addr learned my addr 172.21.15.45:0/2942636553 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:32.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d777fe640 1 --2- 172.21.15.45:0/2942636553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d7806d5b0 0x7f5d78149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:32.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d77fff640 1 -- 172.21.15.45:0/2942636553 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5d7806e100 msgr2=0x7f5d7814a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:32.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d7cd5c640 1 --2- 172.21.15.45:0/2942636553 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5d7806e100 0x7f5d7814a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:32.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d77fff640 1 --2- 172.21.15.45:0/2942636553 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5d7806e100 0x7f5d7814a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:32.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d77fff640 1 -- 172.21.15.45:0/2942636553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d7806d5b0 msgr2=0x7f5d78149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:32.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d77fff640 1 --2- 172.21.15.45:0/2942636553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d7806d5b0 0x7f5d78149dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:32.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d77fff640 1 -- 172.21.15.45:0/2942636553 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c0094d0 con 0x7f5d7806a170 2023-10-03T19:16:32.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d777fe640 1 --2- 172.21.15.45:0/2942636553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d7806d5b0 0x7f5d78149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:32.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d77fff640 1 --2- 172.21.15.45:0/2942636553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d7806a170 0x7f5d780713d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800b410 tx=0x7f5d6800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:32.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d74ff9640 1 -- 172.21.15.45:0/2942636553 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d68004020 con 0x7f5d7806a170 2023-10-03T19:16:32.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d74ff9640 1 -- 172.21.15.45:0/2942636553 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d68004180 con 0x7f5d7806a170 2023-10-03T19:16:32.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d74ff9640 1 -- 172.21.15.45:0/2942636553 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d68011630 con 0x7f5d7806a170 2023-10-03T19:16:32.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d7e7bf640 1 -- 172.21.15.45:0/2942636553 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d7806aa50 con 0x7f5d7806a170 2023-10-03T19:16:32.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.150+0000 7f5d7e7bf640 1 -- 172.21.15.45:0/2942636553 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d780bdc30 con 0x7f5d7806a170 2023-10-03T19:16:32.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.154+0000 7f5d7e7bf640 1 -- 172.21.15.45:0/2942636553 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d7806d980 con 0x7f5d7806a170 2023-10-03T19:16:32.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.154+0000 7f5d74ff9640 1 -- 172.21.15.45:0/2942636553 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5d68011790 con 0x7f5d7806a170 2023-10-03T19:16:32.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.154+0000 7f5d74ff9640 1 --2- 172.21.15.45:0/2942636553 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5d64066280 0x7f5d64068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:32.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.154+0000 7f5d74ff9640 1 -- 172.21.15.45:0/2942636553 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5d68083a90 con 0x7f5d7806a170 2023-10-03T19:16:32.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.154+0000 7f5d777fe640 1 --2- 172.21.15.45:0/2942636553 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5d64066280 0x7f5d64068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:32.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.154+0000 7f5d777fe640 1 --2- 172.21.15.45:0/2942636553 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5d64066280 0x7f5d64068730 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0b2000 tx=0x7f5d6c0aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:32.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.158+0000 7f5d74ff9640 1 -- 172.21.15.45:0/2942636553 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5d68050f60 con 0x7f5d7806a170 2023-10-03T19:16:32.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.342+0000 7f5d7e7bf640 1 -- 172.21.15.45:0/2942636553 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d7813bab0 con 0x7f5d7806a170 2023-10-03T19:16:32.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.342+0000 7f5d74ff9640 1 -- 172.21.15.45:0/2942636553 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+3914 (secure 0 0 0) 0x7f5d7813bab0 con 0x7f5d7806a170 2023-10-03T19:16:32.350 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:16:32.350 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2315858323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2315858323},{"type":"v1","addr":"172.21.15.79:6835","nonce":2315858323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1525989510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1525989510},{"type":"v1","addr":"172.21.15.45:6834","nonce":1525989510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:15:46.329993+0000","modified":"2023-10-03T19:15:49.849869+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5514":{"gid":5514,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1319730866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1319730866},{"type":"v1","addr":"172.21.15.45:6835","nonce":1319730866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-10-03T19:16:32.350 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 23 2023-10-03T19:16:32.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.346+0000 7f5d7e7bf640 1 -- 172.21.15.45:0/2942636553 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5d64066280 msgr2=0x7f5d64068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:32.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.346+0000 7f5d7e7bf640 1 --2- 172.21.15.45:0/2942636553 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5d64066280 0x7f5d64068730 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0b2000 tx=0x7f5d6c0aa070 comp rx=0 tx=0).stop 2023-10-03T19:16:32.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.346+0000 7f5d7e7bf640 1 -- 172.21.15.45:0/2942636553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d7806a170 msgr2=0x7f5d780713d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:32.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.346+0000 7f5d7e7bf640 1 --2- 172.21.15.45:0/2942636553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d7806a170 0x7f5d780713d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800b410 tx=0x7f5d6800b8d0 comp rx=0 tx=0).stop 2023-10-03T19:16:32.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.346+0000 7f5d7e7bf640 1 -- 172.21.15.45:0/2942636553 shutdown_connections 2023-10-03T19:16:32.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.346+0000 7f5d7e7bf640 1 --2- 172.21.15.45:0/2942636553 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5d64066280 0x7f5d64068730 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:32.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.346+0000 7f5d7e7bf640 1 --2- 172.21.15.45:0/2942636553 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5d7806e100 0x7f5d7814a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:32.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.346+0000 7f5d7e7bf640 1 --2- 172.21.15.45:0/2942636553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d7806d5b0 0x7f5d78149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:32.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.346+0000 7f5d7e7bf640 1 --2- 172.21.15.45:0/2942636553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d7806a170 0x7f5d780713d0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:32.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.346+0000 7f5d7e7bf640 1 -- 172.21.15.45:0/2942636553 >> 172.21.15.45:0/2942636553 conn(0x7f5d780c1600 msgr2=0x7f5d78065690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:32.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.346+0000 7f5d7e7bf640 1 -- 172.21.15.45:0/2942636553 shutdown_connections 2023-10-03T19:16:32.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.346+0000 7f5d7e7bf640 1 -- 172.21.15.45:0/2942636553 wait complete. 2023-10-03T19:16:32.368 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:16:32.441 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:16:32.443 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:16:32.445 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:16:32.448 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:16:32.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.482+0000 7f0e6109b640 1 Processor -- start 2023-10-03T19:16:32.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.482+0000 7f0e6109b640 1 -- start start 2023-10-03T19:16:32.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.486+0000 7f0e6109b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e5c06ef20 0x7f0e5c150690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:32.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.486+0000 7f0e6109b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e5c0a1bf0 con 0x7f0e5c0bd7c0 2023-10-03T19:16:32.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.486+0000 7f0e6109b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e5c06e150 con 0x7f0e5c149fe0 2023-10-03T19:16:32.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.486+0000 7f0e6109b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c14a3b0 con 0x7f0e5c06ef20 2023-10-03T19:16:32.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.486+0000 7f0e5a59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0e5c0bd7c0 0x7f0e5c0bf0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44992/0 (socket says 172.21.15.45:44992) 2023-10-03T19:16:32.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.486+0000 7f0e5a59c640 1 -- 172.21.15.45:0/315239610 learned_addr learned my addr 172.21.15.45:0/315239610 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:32.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.486+0000 7f0e5b59e640 1 --2- 172.21.15.45:0/315239610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e5c06ef20 0x7f0e5c150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:32.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.486+0000 7f0e59d9b640 1 -- 172.21.15.45:0/315239610 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 906237937 0 0) 0x7f0e5c0a1bf0 con 0x7f0e5c0bd7c0 2023-10-03T19:16:32.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.486+0000 7f0e59d9b640 1 -- 172.21.15.45:0/315239610 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e44003530 con 0x7f0e5c0bd7c0 2023-10-03T19:16:32.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.486+0000 7f0e59d9b640 1 -- 172.21.15.45:0/315239610 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170997705 0 0) 0x7f0e5c06e150 con 0x7f0e5c149fe0 2023-10-03T19:16:32.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.486+0000 7f0e59d9b640 1 -- 172.21.15.45:0/315239610 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e5c0a1bf0 con 0x7f0e5c149fe0 2023-10-03T19:16:32.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.486+0000 7f0e5b59e640 1 -- 172.21.15.45:0/315239610 >> v1:172.21.15.79:6789/0 conn(0x7f0e5c149fe0 legacy=0x7f0e5c0bd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:32.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.486+0000 7f0e5b59e640 1 -- 172.21.15.45:0/315239610 >> v1:172.21.15.45:6789/0 conn(0x7f0e5c0bd7c0 legacy=0x7f0e5c0bf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:32.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.486+0000 7f0e5b59e640 1 -- 172.21.15.45:0/315239610 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5c06f6a0 con 0x7f0e5c06ef20 2023-10-03T19:16:32.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.490+0000 7f0e5b59e640 1 --2- 172.21.15.45:0/315239610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e5c06ef20 0x7f0e5c150690 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0e54009dc0 tx=0x7f0e5401c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e0923965bdbb40f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:32.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.490+0000 7f0e59d9b640 1 -- 172.21.15.45:0/315239610 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e540a5a20 con 0x7f0e5c06ef20 2023-10-03T19:16:32.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.490+0000 7f0e59d9b640 1 -- 172.21.15.45:0/315239610 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e540a5b80 con 0x7f0e5c06ef20 2023-10-03T19:16:32.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.490+0000 7f0e59d9b640 1 -- 172.21.15.45:0/315239610 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e540ad440 con 0x7f0e5c06ef20 2023-10-03T19:16:32.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.490+0000 7f0e6109b640 1 -- 172.21.15.45:0/315239610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e5c06ef20 msgr2=0x7f0e5c150690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:32.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.490+0000 7f0e6109b640 1 --2- 172.21.15.45:0/315239610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e5c06ef20 0x7f0e5c150690 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0e54009dc0 tx=0x7f0e5401c940 comp rx=0 tx=0).stop 2023-10-03T19:16:32.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.490+0000 7f0e6109b640 1 -- 172.21.15.45:0/315239610 shutdown_connections 2023-10-03T19:16:32.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.490+0000 7f0e6109b640 1 --2- 172.21.15.45:0/315239610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e5c06ef20 0x7f0e5c150690 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:32.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.490+0000 7f0e6109b640 1 -- 172.21.15.45:0/315239610 >> 172.21.15.45:0/315239610 conn(0x7f0e5c0a4400 msgr2=0x7f0e5c0a47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:32.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.490+0000 7f0e6109b640 1 -- 172.21.15.45:0/315239610 shutdown_connections 2023-10-03T19:16:32.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.490+0000 7f0e6109b640 1 -- 172.21.15.45:0/315239610 wait complete. 2023-10-03T19:16:32.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.490+0000 7f0e6109b640 1 Processor -- start 2023-10-03T19:16:32.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.490+0000 7f0e6109b640 1 -- start start 2023-10-03T19:16:32.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.490+0000 7f0e6109b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e5c06ef20 0x7f0e5c06b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:32.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.490+0000 7f0e6109b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e5c0bd7c0 0x7f0e5c1ea4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:32.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.490+0000 7f0e6109b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e5c149fe0 0x7f0e5c157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:32.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.490+0000 7f0e6109b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c06ebd0 con 0x7f0e5c149fe0 2023-10-03T19:16:32.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.490+0000 7f0e6109b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c1e9a80 con 0x7f0e5c0bd7c0 2023-10-03T19:16:32.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.490+0000 7f0e6109b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c14af10 con 0x7f0e5c06ef20 2023-10-03T19:16:32.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.490+0000 7f0e5b59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e5c149fe0 0x7f0e5c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:32.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.490+0000 7f0e5b59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e5c149fe0 0x7f0e5c157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47952/0 (socket says 172.21.15.45:47952) 2023-10-03T19:16:32.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.490+0000 7f0e5b59e640 1 -- 172.21.15.45:0/1750021499 learned_addr learned my addr 172.21.15.45:0/1750021499 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:32.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.490+0000 7f0e5a59c640 1 --2- 172.21.15.45:0/1750021499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e5c0bd7c0 0x7f0e5c1ea4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:32.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.490+0000 7f0e5ad9d640 1 --2- 172.21.15.45:0/1750021499 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e5c06ef20 0x7f0e5c06b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:32.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.490+0000 7f0e5b59e640 1 -- 172.21.15.45:0/1750021499 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e5c06ef20 msgr2=0x7f0e5c06b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:32.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.490+0000 7f0e5b59e640 1 --2- 172.21.15.45:0/1750021499 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e5c06ef20 0x7f0e5c06b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:32.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.490+0000 7f0e5b59e640 1 -- 172.21.15.45:0/1750021499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e5c0bd7c0 msgr2=0x7f0e5c1ea4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:32.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.490+0000 7f0e5b59e640 1 --2- 172.21.15.45:0/1750021499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e5c0bd7c0 0x7f0e5c1ea4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:32.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.490+0000 7f0e5b59e640 1 -- 172.21.15.45:0/1750021499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e54009a70 con 0x7f0e5c149fe0 2023-10-03T19:16:32.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.490+0000 7f0e5a59c640 1 --2- 172.21.15.45:0/1750021499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e5c0bd7c0 0x7f0e5c1ea4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:16:32.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.494+0000 7f0e5b59e640 1 --2- 172.21.15.45:0/1750021499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e5c149fe0 0x7f0e5c157770 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0e54019550 tx=0x7f0e540196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:32.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.494+0000 7f0e437fe640 1 -- 172.21.15.45:0/1750021499 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e540aed30 con 0x7f0e5c149fe0 2023-10-03T19:16:32.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.494+0000 7f0e437fe640 1 -- 172.21.15.45:0/1750021499 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e540aee90 con 0x7f0e5c149fe0 2023-10-03T19:16:32.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.494+0000 7f0e437fe640 1 -- 172.21.15.45:0/1750021499 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e540b7610 con 0x7f0e5c149fe0 2023-10-03T19:16:32.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.494+0000 7f0e6109b640 1 -- 172.21.15.45:0/1750021499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e5c06f980 con 0x7f0e5c149fe0 2023-10-03T19:16:32.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.494+0000 7f0e6109b640 1 -- 172.21.15.45:0/1750021499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5c15a6e0 con 0x7f0e5c149fe0 2023-10-03T19:16:32.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.494+0000 7f0e6109b640 1 -- 172.21.15.45:0/1750021499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e5c06fb10 con 0x7f0e5c149fe0 2023-10-03T19:16:32.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.494+0000 7f0e437fe640 1 -- 172.21.15.45:0/1750021499 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0e540b4050 con 0x7f0e5c149fe0 2023-10-03T19:16:32.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.494+0000 7f0e437fe640 1 --2- 172.21.15.45:0/1750021499 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0e480662b0 0x7f0e48068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:32.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.494+0000 7f0e437fe640 1 -- 172.21.15.45:0/1750021499 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0e5411ee50 con 0x7f0e5c149fe0 2023-10-03T19:16:32.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.494+0000 7f0e5ad9d640 1 --2- 172.21.15.45:0/1750021499 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0e480662b0 0x7f0e48068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:32.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.494+0000 7f0e5ad9d640 1 --2- 172.21.15.45:0/1750021499 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0e480662b0 0x7f0e48068760 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c0011f0 tx=0x7f0e4c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:32.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.498+0000 7f0e437fe640 1 -- 172.21.15.45:0/1750021499 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0e5c06fb10 con 0x7f0e5c149fe0 2023-10-03T19:16:32.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.682+0000 7f0e6109b640 1 -- 172.21.15.45:0/1750021499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e5c06fb10 con 0x7f0e5c149fe0 2023-10-03T19:16:32.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.686+0000 7f0e437fe640 1 -- 172.21.15.45:0/1750021499 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+3914 (secure 0 0 0) 0x7f0e5c06fb10 con 0x7f0e5c149fe0 2023-10-03T19:16:32.691 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:16:32.691 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2315858323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2315858323},{"type":"v1","addr":"172.21.15.79:6835","nonce":2315858323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1525989510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1525989510},{"type":"v1","addr":"172.21.15.45:6834","nonce":1525989510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:15:46.329993+0000","modified":"2023-10-03T19:15:49.849869+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5514":{"gid":5514,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1319730866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1319730866},{"type":"v1","addr":"172.21.15.45:6835","nonce":1319730866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-10-03T19:16:32.692 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 23 2023-10-03T19:16:32.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.686+0000 7f0e6109b640 1 -- 172.21.15.45:0/1750021499 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0e480662b0 msgr2=0x7f0e48068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:32.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.686+0000 7f0e6109b640 1 --2- 172.21.15.45:0/1750021499 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0e480662b0 0x7f0e48068760 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c0011f0 tx=0x7f0e4c009040 comp rx=0 tx=0).stop 2023-10-03T19:16:32.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.686+0000 7f0e6109b640 1 -- 172.21.15.45:0/1750021499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e5c149fe0 msgr2=0x7f0e5c157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:32.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.686+0000 7f0e6109b640 1 --2- 172.21.15.45:0/1750021499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e5c149fe0 0x7f0e5c157770 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0e54019550 tx=0x7f0e540196e0 comp rx=0 tx=0).stop 2023-10-03T19:16:32.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.686+0000 7f0e6109b640 1 -- 172.21.15.45:0/1750021499 shutdown_connections 2023-10-03T19:16:32.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.686+0000 7f0e6109b640 1 --2- 172.21.15.45:0/1750021499 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0e480662b0 0x7f0e48068760 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:32.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.686+0000 7f0e6109b640 1 --2- 172.21.15.45:0/1750021499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e5c149fe0 0x7f0e5c157770 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:32.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.686+0000 7f0e6109b640 1 --2- 172.21.15.45:0/1750021499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e5c0bd7c0 0x7f0e5c1ea4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:32.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.686+0000 7f0e6109b640 1 --2- 172.21.15.45:0/1750021499 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0e5c06ef20 0x7f0e5c06b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:32.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.686+0000 7f0e6109b640 1 -- 172.21.15.45:0/1750021499 >> 172.21.15.45:0/1750021499 conn(0x7f0e5c0a4400 msgr2=0x7f0e5c0718e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:32.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.686+0000 7f0e6109b640 1 -- 172.21.15.45:0/1750021499 shutdown_connections 2023-10-03T19:16:32.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.686+0000 7f0e6109b640 1 -- 172.21.15.45:0/1750021499 wait complete. 2023-10-03T19:16:32.708 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:16:32.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.858+0000 7fa95ea82640 1 Processor -- start 2023-10-03T19:16:32.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.862+0000 7fa95ea82640 1 -- start start 2023-10-03T19:16:32.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.862+0000 7fa95ea82640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa9580bcb60 0x7fa95806c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:32.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.862+0000 7fa95ea82640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa95806c7d0 0x7fa958155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:32.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.862+0000 7fa95ea82640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa95814b610 con 0x7fa958148b90 2023-10-03T19:16:32.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.862+0000 7fa95ea82640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9580a3670 con 0x7fa9580bcb60 2023-10-03T19:16:32.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.862+0000 7fa95ea82640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa95814b370 con 0x7fa95806c7d0 2023-10-03T19:16:32.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.862+0000 7fa957fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa9580bcb60 0x7fa95806c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:32.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.862+0000 7fa95d01f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa95806c7d0 0x7fa958155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:32.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.862+0000 7fa95c81e640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa958148b90 0x7fa9580bbf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:57924/0 (socket says 172.21.15.45:57924) 2023-10-03T19:16:32.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.862+0000 7fa95c81e640 1 -- 172.21.15.45:0/1076758568 learned_addr learned my addr 172.21.15.45:0/1076758568 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:32.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.862+0000 7fa95d01f640 1 -- 172.21.15.45:0/1076758568 >> v2:172.21.15.79:3300/0 conn(0x7fa9580bcb60 msgr2=0x7fa95806c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:32.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.862+0000 7fa95d01f640 1 --2- 172.21.15.45:0/1076758568 >> v2:172.21.15.79:3300/0 conn(0x7fa9580bcb60 0x7fa95806c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:32.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.862+0000 7fa95d01f640 1 -- 172.21.15.45:0/1076758568 >> v1:172.21.15.79:6789/0 conn(0x7fa958148b90 legacy=0x7fa9580bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:32.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.862+0000 7fa95d01f640 1 -- 172.21.15.45:0/1076758568 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9580a5580 con 0x7fa95806c7d0 2023-10-03T19:16:32.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.862+0000 7fa957fff640 1 --2- 172.21.15.45:0/1076758568 >> v2:172.21.15.79:3300/0 conn(0x7fa9580bcb60 0x7fa95806c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:16:32.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.866+0000 7fa95d01f640 1 --2- 172.21.15.45:0/1076758568 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa95806c7d0 0x7fa958155cf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa9500097c0 tx=0x7fa95001ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b37040b2cf9111fe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:32.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.866+0000 7fa9577fe640 1 -- 172.21.15.45:0/1076758568 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9500a8970 con 0x7fa95806c7d0 2023-10-03T19:16:32.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.866+0000 7fa9577fe640 1 -- 172.21.15.45:0/1076758568 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9500a8ad0 con 0x7fa95806c7d0 2023-10-03T19:16:32.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.866+0000 7fa9577fe640 1 -- 172.21.15.45:0/1076758568 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9500a8e60 con 0x7fa95806c7d0 2023-10-03T19:16:32.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.866+0000 7fa95ea82640 1 -- 172.21.15.45:0/1076758568 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa95806c7d0 msgr2=0x7fa958155cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:32.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.866+0000 7fa95ea82640 1 --2- 172.21.15.45:0/1076758568 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa95806c7d0 0x7fa958155cf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa9500097c0 tx=0x7fa95001ec70 comp rx=0 tx=0).stop 2023-10-03T19:16:32.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.866+0000 7fa95ea82640 1 -- 172.21.15.45:0/1076758568 shutdown_connections 2023-10-03T19:16:32.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.866+0000 7fa95ea82640 1 --2- 172.21.15.45:0/1076758568 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa95806c7d0 0x7fa958155cf0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:32.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.866+0000 7fa95ea82640 1 --2- 172.21.15.45:0/1076758568 >> v2:172.21.15.79:3300/0 conn(0x7fa9580bcb60 0x7fa95806c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:32.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.866+0000 7fa95ea82640 1 -- 172.21.15.45:0/1076758568 >> 172.21.15.45:0/1076758568 conn(0x7fa9580bcf50 msgr2=0x7fa9580bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:32.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.866+0000 7fa95ea82640 1 -- 172.21.15.45:0/1076758568 shutdown_connections 2023-10-03T19:16:32.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.866+0000 7fa95ea82640 1 -- 172.21.15.45:0/1076758568 wait complete. 2023-10-03T19:16:32.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.866+0000 7fa95ea82640 1 Processor -- start 2023-10-03T19:16:32.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.866+0000 7fa95ea82640 1 -- start start 2023-10-03T19:16:32.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.866+0000 7fa95ea82640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa95806c7d0 0x7fa958141730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:32.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.866+0000 7fa95ea82640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9580bcb60 0x7fa9580bf420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:32.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.866+0000 7fa95ea82640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa958148b90 0x7fa95813ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:32.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.866+0000 7fa95ea82640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa95814dd80 con 0x7fa9580bcb60 2023-10-03T19:16:32.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.866+0000 7fa95ea82640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9581e4b90 con 0x7fa958148b90 2023-10-03T19:16:32.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.866+0000 7fa95ea82640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa958141c70 con 0x7fa95806c7d0 2023-10-03T19:16:32.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.866+0000 7fa957fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9580bcb60 0x7fa9580bf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:32.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.866+0000 7fa957fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9580bcb60 0x7fa9580bf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47962/0 (socket says 172.21.15.45:47962) 2023-10-03T19:16:32.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.866+0000 7fa957fff640 1 -- 172.21.15.45:0/833747762 learned_addr learned my addr 172.21.15.45:0/833747762 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:32.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.866+0000 7fa95d01f640 1 --2- 172.21.15.45:0/833747762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa958148b90 0x7fa95813ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:32.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.866+0000 7fa95c81e640 1 --2- 172.21.15.45:0/833747762 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa95806c7d0 0x7fa958141730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:32.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.866+0000 7fa957fff640 1 -- 172.21.15.45:0/833747762 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa95806c7d0 msgr2=0x7fa958141730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:32.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.866+0000 7fa957fff640 1 --2- 172.21.15.45:0/833747762 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa95806c7d0 0x7fa958141730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:32.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.866+0000 7fa957fff640 1 -- 172.21.15.45:0/833747762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa958148b90 msgr2=0x7fa95813ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:32.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.866+0000 7fa957fff640 1 --2- 172.21.15.45:0/833747762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa958148b90 0x7fa95813ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:32.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.866+0000 7fa957fff640 1 -- 172.21.15.45:0/833747762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94c009420 con 0x7fa9580bcb60 2023-10-03T19:16:32.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.870+0000 7fa957fff640 1 --2- 172.21.15.45:0/833747762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9580bcb60 0x7fa9580bf420 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa94c00ebe0 tx=0x7fa94c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:32.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.870+0000 7fa9557fa640 1 -- 172.21.15.45:0/833747762 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c00eee0 con 0x7fa9580bcb60 2023-10-03T19:16:32.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.870+0000 7fa9557fa640 1 -- 172.21.15.45:0/833747762 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94c00cc30 con 0x7fa9580bcb60 2023-10-03T19:16:32.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.870+0000 7fa9557fa640 1 -- 172.21.15.45:0/833747762 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c013470 con 0x7fa9580bcb60 2023-10-03T19:16:32.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.870+0000 7fa95ea82640 1 -- 172.21.15.45:0/833747762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa950009420 con 0x7fa9580bcb60 2023-10-03T19:16:32.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.870+0000 7fa95ea82640 1 -- 172.21.15.45:0/833747762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9580bc670 con 0x7fa9580bcb60 2023-10-03T19:16:32.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.870+0000 7fa95ea82640 1 -- 172.21.15.45:0/833747762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9580a5820 con 0x7fa9580bcb60 2023-10-03T19:16:32.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.870+0000 7fa9557fa640 1 -- 172.21.15.45:0/833747762 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa94c0135d0 con 0x7fa9580bcb60 2023-10-03T19:16:32.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.870+0000 7fa9557fa640 1 --2- 172.21.15.45:0/833747762 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa944066280 0x7fa944068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:32.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.870+0000 7fa9557fa640 1 -- 172.21.15.45:0/833747762 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa94c0843f0 con 0x7fa9580bcb60 2023-10-03T19:16:32.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.870+0000 7fa95c81e640 1 --2- 172.21.15.45:0/833747762 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa944066280 0x7fa944068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:32.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.870+0000 7fa95c81e640 1 --2- 172.21.15.45:0/833747762 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa944066280 0x7fa944068730 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa9480012f0 tx=0x7fa948009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:32.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:32.874+0000 7fa9557fa640 1 -- 172.21.15.45:0/833747762 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa94c0552c0 con 0x7fa9580bcb60 2023-10-03T19:16:33.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.026+0000 7fa95ea82640 1 -- 172.21.15.45:0/833747762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa958148f60 con 0x7fa9580bcb60 2023-10-03T19:16:33.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.026+0000 7fa9557fa640 1 -- 172.21.15.45:0/833747762 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18399 (secure 0 0 0) 0x7fa94c054e50 con 0x7fa9580bcb60 2023-10-03T19:16:33.032 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:16:33.032 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":50,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:16:13.667014+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:15:44.458794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-03T19:15:45.219182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.1d","mappings":[{"from":0,"to":6}]},{"pgid":"8.3d","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:16:33.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.026+0000 7fa95ea82640 1 -- 172.21.15.45:0/833747762 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa944066280 msgr2=0x7fa944068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:33.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.026+0000 7fa95ea82640 1 --2- 172.21.15.45:0/833747762 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa944066280 0x7fa944068730 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa9480012f0 tx=0x7fa948009040 comp rx=0 tx=0).stop 2023-10-03T19:16:33.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.026+0000 7fa95ea82640 1 -- 172.21.15.45:0/833747762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9580bcb60 msgr2=0x7fa9580bf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:33.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.026+0000 7fa95ea82640 1 --2- 172.21.15.45:0/833747762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9580bcb60 0x7fa9580bf420 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa94c00ebe0 tx=0x7fa94c00c520 comp rx=0 tx=0).stop 2023-10-03T19:16:33.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.026+0000 7fa95ea82640 1 -- 172.21.15.45:0/833747762 shutdown_connections 2023-10-03T19:16:33.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.026+0000 7fa95ea82640 1 --2- 172.21.15.45:0/833747762 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa944066280 0x7fa944068730 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:33.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.026+0000 7fa95ea82640 1 --2- 172.21.15.45:0/833747762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa958148b90 0x7fa95813ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:33.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.026+0000 7fa95ea82640 1 --2- 172.21.15.45:0/833747762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9580bcb60 0x7fa9580bf420 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:33.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.026+0000 7fa95ea82640 1 --2- 172.21.15.45:0/833747762 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa95806c7d0 0x7fa958141730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:33.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.026+0000 7fa95ea82640 1 -- 172.21.15.45:0/833747762 >> 172.21.15.45:0/833747762 conn(0x7fa9580bcf50 msgr2=0x7fa958149dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:33.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.026+0000 7fa95ea82640 1 -- 172.21.15.45:0/833747762 shutdown_connections 2023-10-03T19:16:33.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.026+0000 7fa95ea82640 1 -- 172.21.15.45:0/833747762 wait complete. 2023-10-03T19:16:33.050 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-03T19:16:33.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.158+0000 7fb6aea88640 1 Processor -- start 2023-10-03T19:16:33.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.158+0000 7fb6aea88640 1 -- start start 2023-10-03T19:16:33.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.158+0000 7fb6aea88640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb6a80bff30 0x7fb6a80bc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:33.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.158+0000 7fb6aea88640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6a80bd130 0x7fb6a80bf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:33.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.158+0000 7fb6aea88640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6a80bc0b0 con 0x7fb6a80bcb20 2023-10-03T19:16:33.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.158+0000 7fb6aea88640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6a80bf870 con 0x7fb6a80bff30 2023-10-03T19:16:33.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.158+0000 7fb6aea88640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a80bb740 con 0x7fb6a80bd130 2023-10-03T19:16:33.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.158+0000 7fb6ac824640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb6a80bff30 0x7fb6a80bc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:33.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.158+0000 7fb6a7fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb6a80bcb20 0x7fb6a80bec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:57940/0 (socket says 172.21.15.45:57940) 2023-10-03T19:16:33.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.158+0000 7fb6a7fff640 1 -- 172.21.15.45:0/1852131934 learned_addr learned my addr 172.21.15.45:0/1852131934 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:33.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.158+0000 7fb6ad025640 1 --2- 172.21.15.45:0/1852131934 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6a80bd130 0x7fb6a80bf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:33.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.158+0000 7fb6a77fe640 1 -- 172.21.15.45:0/1852131934 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3239612553 0 0) 0x7fb6a80bc0b0 con 0x7fb6a80bcb20 2023-10-03T19:16:33.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.158+0000 7fb6a77fe640 1 -- 172.21.15.45:0/1852131934 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb690003530 con 0x7fb6a80bcb20 2023-10-03T19:16:33.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.158+0000 7fb6ad025640 1 -- 172.21.15.45:0/1852131934 >> v2:172.21.15.79:3300/0 conn(0x7fb6a80bff30 msgr2=0x7fb6a80bc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:33.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.158+0000 7fb6ad025640 1 --2- 172.21.15.45:0/1852131934 >> v2:172.21.15.79:3300/0 conn(0x7fb6a80bff30 0x7fb6a80bc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:33.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.158+0000 7fb6ad025640 1 -- 172.21.15.45:0/1852131934 >> v1:172.21.15.79:6789/0 conn(0x7fb6a80bcb20 legacy=0x7fb6a80bec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:33.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.158+0000 7fb6ad025640 1 -- 172.21.15.45:0/1852131934 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a80bba20 con 0x7fb6a80bd130 2023-10-03T19:16:33.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.162+0000 7fb6ad025640 1 --2- 172.21.15.45:0/1852131934 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6a80bd130 0x7fb6a80bf330 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0009d90 tx=0x7fb6a001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f22133867afa82e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:33.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.162+0000 7fb6a77fe640 1 -- 172.21.15.45:0/1852131934 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a00a5a00 con 0x7fb6a80bd130 2023-10-03T19:16:33.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.162+0000 7fb6a77fe640 1 -- 172.21.15.45:0/1852131934 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a00a5b60 con 0x7fb6a80bd130 2023-10-03T19:16:33.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.162+0000 7fb6a77fe640 1 -- 172.21.15.45:0/1852131934 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a00ad440 con 0x7fb6a80bd130 2023-10-03T19:16:33.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.162+0000 7fb6aea88640 1 -- 172.21.15.45:0/1852131934 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6a80bd130 msgr2=0x7fb6a80bf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:33.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.162+0000 7fb6aea88640 1 --2- 172.21.15.45:0/1852131934 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6a80bd130 0x7fb6a80bf330 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0009d90 tx=0x7fb6a001c920 comp rx=0 tx=0).stop 2023-10-03T19:16:33.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.162+0000 7fb6aea88640 1 -- 172.21.15.45:0/1852131934 shutdown_connections 2023-10-03T19:16:33.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.162+0000 7fb6aea88640 1 --2- 172.21.15.45:0/1852131934 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6a80bd130 0x7fb6a80bf330 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:33.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.162+0000 7fb6aea88640 1 --2- 172.21.15.45:0/1852131934 >> v2:172.21.15.79:3300/0 conn(0x7fb6a80bff30 0x7fb6a80bc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:33.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.162+0000 7fb6aea88640 1 -- 172.21.15.45:0/1852131934 >> 172.21.15.45:0/1852131934 conn(0x7fb6a80c0d20 msgr2=0x7fb6a80c1120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:33.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.162+0000 7fb6aea88640 1 -- 172.21.15.45:0/1852131934 shutdown_connections 2023-10-03T19:16:33.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.162+0000 7fb6aea88640 1 -- 172.21.15.45:0/1852131934 wait complete. 2023-10-03T19:16:33.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.162+0000 7fb6aea88640 1 Processor -- start 2023-10-03T19:16:33.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.162+0000 7fb6aea88640 1 -- start start 2023-10-03T19:16:33.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.166+0000 7fb6aea88640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6a80bcb20 0x7fb6a80ba1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:33.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.166+0000 7fb6aea88640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6a80bd130 0x7fb6a8142300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:33.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.166+0000 7fb6aea88640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6a80bff30 0x7fb6a813ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:33.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.166+0000 7fb6aea88640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a8141f60 con 0x7fb6a80bd130 2023-10-03T19:16:33.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.166+0000 7fb6aea88640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a8150390 con 0x7fb6a80bff30 2023-10-03T19:16:33.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.166+0000 7fb6aea88640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a80b9840 con 0x7fb6a80bcb20 2023-10-03T19:16:33.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.166+0000 7fb6a7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6a80bd130 0x7fb6a8142300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:33.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.166+0000 7fb6a7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6a80bd130 0x7fb6a8142300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47970/0 (socket says 172.21.15.45:47970) 2023-10-03T19:16:33.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.166+0000 7fb6a7fff640 1 -- 172.21.15.45:0/762355244 learned_addr learned my addr 172.21.15.45:0/762355244 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:33.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.166+0000 7fb6ad025640 1 --2- 172.21.15.45:0/762355244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6a80bff30 0x7fb6a813ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:33.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.166+0000 7fb6ac824640 1 --2- 172.21.15.45:0/762355244 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6a80bcb20 0x7fb6a80ba1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:33.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.166+0000 7fb6a7fff640 1 -- 172.21.15.45:0/762355244 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6a80bcb20 msgr2=0x7fb6a80ba1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:33.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.166+0000 7fb6a7fff640 1 --2- 172.21.15.45:0/762355244 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6a80bcb20 0x7fb6a80ba1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:33.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.166+0000 7fb6a7fff640 1 -- 172.21.15.45:0/762355244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6a80bff30 msgr2=0x7fb6a813ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:33.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.166+0000 7fb6a7fff640 1 --2- 172.21.15.45:0/762355244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6a80bff30 0x7fb6a813ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:33.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.166+0000 7fb6a7fff640 1 -- 172.21.15.45:0/762355244 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a0009a70 con 0x7fb6a80bd130 2023-10-03T19:16:33.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.166+0000 7fb6ac824640 1 --2- 172.21.15.45:0/762355244 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6a80bcb20 0x7fb6a80ba1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:33.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.166+0000 7fb6ad025640 1 --2- 172.21.15.45:0/762355244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6a80bff30 0x7fb6a813ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:33.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.166+0000 7fb6a7fff640 1 --2- 172.21.15.45:0/762355244 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6a80bd130 0x7fb6a8142300 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fb69c00c3c0 tx=0x7fb69c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:33.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.166+0000 7fb6a57fa640 1 -- 172.21.15.45:0/762355244 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c005cf0 con 0x7fb6a80bd130 2023-10-03T19:16:33.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.166+0000 7fb6a57fa640 1 -- 172.21.15.45:0/762355244 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69c005e70 con 0x7fb6a80bd130 2023-10-03T19:16:33.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.166+0000 7fb6aea88640 1 -- 172.21.15.45:0/762355244 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a8159580 con 0x7fb6a80bd130 2023-10-03T19:16:33.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.166+0000 7fb6a57fa640 1 -- 172.21.15.45:0/762355244 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c0072f0 con 0x7fb6a80bd130 2023-10-03T19:16:33.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.166+0000 7fb6aea88640 1 -- 172.21.15.45:0/762355244 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a80bbd40 con 0x7fb6a80bd130 2023-10-03T19:16:33.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.166+0000 7fb6aea88640 1 -- 172.21.15.45:0/762355244 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a8159710 con 0x7fb6a80bd130 2023-10-03T19:16:33.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.166+0000 7fb6a57fa640 1 -- 172.21.15.45:0/762355244 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb69c007450 con 0x7fb6a80bd130 2023-10-03T19:16:33.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.166+0000 7fb6a57fa640 1 --2- 172.21.15.45:0/762355244 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb694066280 0x7fb694068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:33.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.166+0000 7fb6a57fa640 1 -- 172.21.15.45:0/762355244 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb69c0831f0 con 0x7fb6a80bd130 2023-10-03T19:16:33.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.166+0000 7fb6ac824640 1 --2- 172.21.15.45:0/762355244 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb694066280 0x7fb694068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:33.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.170+0000 7fb6ac824640 1 --2- 172.21.15.45:0/762355244 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb694066280 0x7fb694068730 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb698009ae0 tx=0x7fb698008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:33.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.170+0000 7fb6a57fa640 1 -- 172.21.15.45:0/762355244 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb69c050780 con 0x7fb6a80bd130 2023-10-03T19:16:33.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.354+0000 7fb6aea88640 1 -- 172.21.15.45:0/762355244 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb6a80b8440 con 0x7fb6a80bd130 2023-10-03T19:16:33.755 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-10-03T19:16:33.750+0000 7f00b6fb3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-03T19:16:33.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.766+0000 7fb6a57fa640 1 -- 172.21.15.45:0/762355244 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb6a80b8440 con 0x7fb6a80bd130 2023-10-03T19:16:33.773 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-03T19:16:33.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.770+0000 7fb6aea88640 1 -- 172.21.15.45:0/762355244 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb694066280 msgr2=0x7fb694068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:33.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.770+0000 7fb6aea88640 1 --2- 172.21.15.45:0/762355244 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb694066280 0x7fb694068730 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb698009ae0 tx=0x7fb698008040 comp rx=0 tx=0).stop 2023-10-03T19:16:33.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.770+0000 7fb6aea88640 1 -- 172.21.15.45:0/762355244 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6a80bd130 msgr2=0x7fb6a8142300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:33.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.770+0000 7fb6aea88640 1 --2- 172.21.15.45:0/762355244 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6a80bd130 0x7fb6a8142300 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fb69c00c3c0 tx=0x7fb69c00c880 comp rx=0 tx=0).stop 2023-10-03T19:16:33.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.770+0000 7fb6aea88640 1 -- 172.21.15.45:0/762355244 shutdown_connections 2023-10-03T19:16:33.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.770+0000 7fb6aea88640 1 --2- 172.21.15.45:0/762355244 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb694066280 0x7fb694068730 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:33.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.770+0000 7fb6aea88640 1 --2- 172.21.15.45:0/762355244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6a80bff30 0x7fb6a813ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:33.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.770+0000 7fb6aea88640 1 --2- 172.21.15.45:0/762355244 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6a80bd130 0x7fb6a8142300 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:33.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.770+0000 7fb6aea88640 1 --2- 172.21.15.45:0/762355244 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6a80bcb20 0x7fb6a80ba1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:33.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.770+0000 7fb6aea88640 1 -- 172.21.15.45:0/762355244 >> 172.21.15.45:0/762355244 conn(0x7fb6a80c0d20 msgr2=0x7fb6a814a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:33.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.770+0000 7fb6aea88640 1 -- 172.21.15.45:0/762355244 shutdown_connections 2023-10-03T19:16:33.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.770+0000 7fb6aea88640 1 -- 172.21.15.45:0/762355244 wait complete. 2023-10-03T19:16:33.795 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-03T19:16:33.803 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-03T19:16:33.762+0000 7f3ed53bd640 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-10-03T19:16:33.803 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-03T19:16:33.762+0000 7f3ed53bd640 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-10-03T19:16:33.836 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-10-03T19:16:33.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.926+0000 7fe723764640 1 Processor -- start 2023-10-03T19:16:33.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.926+0000 7fe723764640 1 -- start start 2023-10-03T19:16:33.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.926+0000 7fe723764640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe71c150800 0x7fe71c0a5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:33.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.926+0000 7fe723764640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe71c0befa0 0x7fe71c0bf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:33.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.926+0000 7fe723764640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe71c0be820 con 0x7fe71c0bcff0 2023-10-03T19:16:33.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.926+0000 7fe723764640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe71c0a6800 con 0x7fe71c150800 2023-10-03T19:16:33.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.926+0000 7fe723764640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe71c0b5ea0 con 0x7fe71c0befa0 2023-10-03T19:16:33.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.926+0000 7fe721500640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe71c150800 0x7fe71c0a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:33.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.926+0000 7fe721500640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe71c150800 0x7fe71c0a5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47978/0 (socket says 172.21.15.45:47978) 2023-10-03T19:16:33.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.926+0000 7fe721500640 1 -- 172.21.15.45:0/2901369693 learned_addr learned my addr 172.21.15.45:0/2901369693 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:33.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.926+0000 7fe721d01640 1 --2- 172.21.15.45:0/2901369693 >> v2:172.21.15.79:3300/0 conn(0x7fe71c0befa0 0x7fe71c0bf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:33.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.926+0000 7fe721500640 1 -- 172.21.15.45:0/2901369693 >> v2:172.21.15.79:3300/0 conn(0x7fe71c0befa0 msgr2=0x7fe71c0bf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:33.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.926+0000 7fe721500640 1 --2- 172.21.15.45:0/2901369693 >> v2:172.21.15.79:3300/0 conn(0x7fe71c0befa0 0x7fe71c0bf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:33.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.926+0000 7fe721500640 1 -- 172.21.15.45:0/2901369693 >> v1:172.21.15.79:6789/0 conn(0x7fe71c0bcff0 legacy=0x7fe71c0a7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:33.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.926+0000 7fe721500640 1 -- 172.21.15.45:0/2901369693 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71c0a5750 con 0x7fe71c150800 2023-10-03T19:16:33.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe721500640 1 --2- 172.21.15.45:0/2901369693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe71c150800 0x7fe71c0a5d00 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe71c070860 tx=0x7fe71801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668befc040243eee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:33.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe713fff640 1 -- 172.21.15.45:0/2901369693 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7180aa680 con 0x7fe71c150800 2023-10-03T19:16:33.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe713fff640 1 -- 172.21.15.45:0/2901369693 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7180aa7e0 con 0x7fe71c150800 2023-10-03T19:16:33.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe713fff640 1 -- 172.21.15.45:0/2901369693 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7180aab70 con 0x7fe71c150800 2023-10-03T19:16:33.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe723764640 1 -- 172.21.15.45:0/2901369693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe71c150800 msgr2=0x7fe71c0a5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:33.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe723764640 1 --2- 172.21.15.45:0/2901369693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe71c150800 0x7fe71c0a5d00 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe71c070860 tx=0x7fe71801c500 comp rx=0 tx=0).stop 2023-10-03T19:16:33.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe723764640 1 -- 172.21.15.45:0/2901369693 shutdown_connections 2023-10-03T19:16:33.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe723764640 1 --2- 172.21.15.45:0/2901369693 >> v2:172.21.15.79:3300/0 conn(0x7fe71c0befa0 0x7fe71c0bf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:33.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe723764640 1 --2- 172.21.15.45:0/2901369693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe71c150800 0x7fe71c0a5d00 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:33.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe723764640 1 -- 172.21.15.45:0/2901369693 >> 172.21.15.45:0/2901369693 conn(0x7fe71c071060 msgr2=0x7fe71c071460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:33.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe723764640 1 -- 172.21.15.45:0/2901369693 shutdown_connections 2023-10-03T19:16:33.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe723764640 1 -- 172.21.15.45:0/2901369693 wait complete. 2023-10-03T19:16:33.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe723764640 1 Processor -- start 2023-10-03T19:16:33.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe723764640 1 -- start start 2023-10-03T19:16:33.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe723764640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe71c0bcff0 0x7fe71c0bb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:33.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe723764640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe71c0befa0 0x7fe71c14da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:33.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe723764640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe71c150800 0x7fe71c146f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:33.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe723764640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c0bbb60 con 0x7fe71c150800 2023-10-03T19:16:33.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe723764640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c0b9740 con 0x7fe71c0bcff0 2023-10-03T19:16:33.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe723764640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c14ebc0 con 0x7fe71c0befa0 2023-10-03T19:16:33.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe721d01640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe71c150800 0x7fe71c146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:33.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe721d01640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe71c150800 0x7fe71c146f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47994/0 (socket says 172.21.15.45:47994) 2023-10-03T19:16:33.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe721d01640 1 -- 172.21.15.45:0/3048038810 learned_addr learned my addr 172.21.15.45:0/3048038810 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:33.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe721500640 1 --2- 172.21.15.45:0/3048038810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe71c0bcff0 0x7fe71c0bb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:33.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe720cff640 1 --2- 172.21.15.45:0/3048038810 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe71c0befa0 0x7fe71c14da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:33.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe721d01640 1 -- 172.21.15.45:0/3048038810 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe71c0befa0 msgr2=0x7fe71c14da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:33.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe721d01640 1 --2- 172.21.15.45:0/3048038810 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe71c0befa0 0x7fe71c14da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:33.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe721d01640 1 -- 172.21.15.45:0/3048038810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe71c0bcff0 msgr2=0x7fe71c0bb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:33.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe721d01640 1 --2- 172.21.15.45:0/3048038810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe71c0bcff0 0x7fe71c0bb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:33.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe721d01640 1 -- 172.21.15.45:0/3048038810 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe718009480 con 0x7fe71c150800 2023-10-03T19:16:33.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe721d01640 1 --2- 172.21.15.45:0/3048038810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe71c150800 0x7fe71c146f70 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe714007e70 tx=0x7fe71400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:33.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe711ffb640 1 -- 172.21.15.45:0/3048038810 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe714014620 con 0x7fe71c150800 2023-10-03T19:16:33.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe711ffb640 1 -- 172.21.15.45:0/3048038810 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7140147a0 con 0x7fe71c150800 2023-10-03T19:16:33.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe723764640 1 -- 172.21.15.45:0/3048038810 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe71c0bdaf0 con 0x7fe71c150800 2023-10-03T19:16:33.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe711ffb640 1 -- 172.21.15.45:0/3048038810 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe714014b50 con 0x7fe71c150800 2023-10-03T19:16:33.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.930+0000 7fe723764640 1 -- 172.21.15.45:0/3048038810 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe71c071b70 con 0x7fe71c150800 2023-10-03T19:16:33.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.934+0000 7fe723764640 1 -- 172.21.15.45:0/3048038810 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe71c0bdc80 con 0x7fe71c150800 2023-10-03T19:16:33.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.934+0000 7fe711ffb640 1 -- 172.21.15.45:0/3048038810 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe714014cb0 con 0x7fe71c150800 2023-10-03T19:16:33.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.934+0000 7fe711ffb640 1 --2- 172.21.15.45:0/3048038810 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe700066280 0x7fe700068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:33.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.934+0000 7fe711ffb640 1 -- 172.21.15.45:0/3048038810 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fe7140852a0 con 0x7fe71c150800 2023-10-03T19:16:33.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.934+0000 7fe721500640 1 --2- 172.21.15.45:0/3048038810 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe700066280 0x7fe700068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:33.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.934+0000 7fe721500640 1 --2- 172.21.15.45:0/3048038810 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe700066280 0x7fe700068730 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe7180ae000 tx=0x7fe7180a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:33.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:33.938+0000 7fe711ffb640 1 -- 172.21.15.45:0/3048038810 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe714056190 con 0x7fe71c150800 2023-10-03T19:16:34.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.122+0000 7fe723764640 1 -- 172.21.15.45:0/3048038810 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe71c1e84a0 con 0x7fe71c150800 2023-10-03T19:16:34.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.766+0000 7fe711ffb640 1 -- 172.21.15.45:0/3048038810 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe71c1e84a0 con 0x7fe71c150800 2023-10-03T19:16:34.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.770+0000 7fe723764640 1 -- 172.21.15.45:0/3048038810 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe700066280 msgr2=0x7fe700068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:34.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.770+0000 7fe723764640 1 --2- 172.21.15.45:0/3048038810 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe700066280 0x7fe700068730 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe7180ae000 tx=0x7fe7180a7000 comp rx=0 tx=0).stop 2023-10-03T19:16:34.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.770+0000 7fe723764640 1 -- 172.21.15.45:0/3048038810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe71c150800 msgr2=0x7fe71c146f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:34.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.770+0000 7fe723764640 1 --2- 172.21.15.45:0/3048038810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe71c150800 0x7fe71c146f70 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe714007e70 tx=0x7fe71400e4b0 comp rx=0 tx=0).stop 2023-10-03T19:16:34.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.770+0000 7fe723764640 1 -- 172.21.15.45:0/3048038810 shutdown_connections 2023-10-03T19:16:34.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.770+0000 7fe723764640 1 --2- 172.21.15.45:0/3048038810 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe700066280 0x7fe700068730 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:34.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.770+0000 7fe723764640 1 --2- 172.21.15.45:0/3048038810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe71c150800 0x7fe71c146f70 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:34.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.770+0000 7fe723764640 1 --2- 172.21.15.45:0/3048038810 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe71c0befa0 0x7fe71c14da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:34.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.770+0000 7fe723764640 1 --2- 172.21.15.45:0/3048038810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe71c0bcff0 0x7fe71c0bb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:34.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.770+0000 7fe723764640 1 -- 172.21.15.45:0/3048038810 >> 172.21.15.45:0/3048038810 conn(0x7fe71c071060 msgr2=0x7fe71c0c2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:34.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.770+0000 7fe723764640 1 -- 172.21.15.45:0/3048038810 shutdown_connections 2023-10-03T19:16:34.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.770+0000 7fe723764640 1 -- 172.21.15.45:0/3048038810 wait complete. 2023-10-03T19:16:34.799 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-03T19:16:34.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.978+0000 7f6e36072640 1 Processor -- start 2023-10-03T19:16:34.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.978+0000 7f6e36072640 1 -- start start 2023-10-03T19:16:34.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.978+0000 7f6e36072640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6e300bf1f0 0x7f6e300a9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:34.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.978+0000 7f6e36072640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6e300c2770 0x7f6e300a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:34.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.978+0000 7f6e36072640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e3006ac70 con 0x7f6e300c14e0 2023-10-03T19:16:34.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.978+0000 7f6e36072640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e3006aae0 con 0x7f6e300c2770 2023-10-03T19:16:34.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.978+0000 7f6e36072640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e300c3000 con 0x7f6e300bf1f0 2023-10-03T19:16:34.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.978+0000 7f6e2ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6e300c2770 0x7f6e300a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:34.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.978+0000 7f6e2ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6e300c2770 0x7f6e300a9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34476/0 (socket says 172.21.15.45:34476) 2023-10-03T19:16:34.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.978+0000 7f6e2ffff640 1 -- 172.21.15.45:0/1232303327 learned_addr learned my addr 172.21.15.45:0/1232303327 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:34.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.978+0000 7f6e2effd640 1 --2- 172.21.15.45:0/1232303327 >> v2:172.21.15.79:3300/0 conn(0x7f6e300bf1f0 0x7f6e300a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:34.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.978+0000 7f6e2ffff640 1 -- 172.21.15.45:0/1232303327 >> v2:172.21.15.79:3300/0 conn(0x7f6e300bf1f0 msgr2=0x7f6e300a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:34.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.978+0000 7f6e2ffff640 1 --2- 172.21.15.45:0/1232303327 >> v2:172.21.15.79:3300/0 conn(0x7f6e300bf1f0 0x7f6e300a9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:34.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.978+0000 7f6e2ffff640 1 -- 172.21.15.45:0/1232303327 >> v1:172.21.15.79:6789/0 conn(0x7f6e300c14e0 legacy=0x7f6e300c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:34.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.978+0000 7f6e2ffff640 1 -- 172.21.15.45:0/1232303327 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e300aa5f0 con 0x7f6e300c2770 2023-10-03T19:16:34.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.978+0000 7f6e2effd640 1 --2- 172.21.15.45:0/1232303327 >> v2:172.21.15.79:3300/0 conn(0x7f6e300bf1f0 0x7f6e300a9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:34.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.982+0000 7f6e2ffff640 1 --2- 172.21.15.45:0/1232303327 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e300c2770 0x7f6e300a9da0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f6e300c0110 tx=0x7f6e2801f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47dc330a73c83c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:34.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.982+0000 7f6e2e7fc640 1 -- 172.21.15.45:0/1232303327 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e280af400 con 0x7f6e300c2770 2023-10-03T19:16:34.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.982+0000 7f6e2e7fc640 1 -- 172.21.15.45:0/1232303327 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e280ab050 con 0x7f6e300c2770 2023-10-03T19:16:34.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.982+0000 7f6e2e7fc640 1 -- 172.21.15.45:0/1232303327 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e280af780 con 0x7f6e300c2770 2023-10-03T19:16:34.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.982+0000 7f6e36072640 1 -- 172.21.15.45:0/1232303327 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e300c2770 msgr2=0x7f6e300a9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:34.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.982+0000 7f6e36072640 1 --2- 172.21.15.45:0/1232303327 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e300c2770 0x7f6e300a9da0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f6e300c0110 tx=0x7f6e2801f180 comp rx=0 tx=0).stop 2023-10-03T19:16:34.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.982+0000 7f6e36072640 1 -- 172.21.15.45:0/1232303327 shutdown_connections 2023-10-03T19:16:34.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.982+0000 7f6e36072640 1 --2- 172.21.15.45:0/1232303327 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e300c2770 0x7f6e300a9da0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:34.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.982+0000 7f6e36072640 1 --2- 172.21.15.45:0/1232303327 >> v2:172.21.15.79:3300/0 conn(0x7f6e300bf1f0 0x7f6e300a9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:34.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.982+0000 7f6e36072640 1 -- 172.21.15.45:0/1232303327 >> 172.21.15.45:0/1232303327 conn(0x7f6e300a6440 msgr2=0x7f6e300a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:34.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.982+0000 7f6e36072640 1 -- 172.21.15.45:0/1232303327 shutdown_connections 2023-10-03T19:16:34.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.982+0000 7f6e36072640 1 -- 172.21.15.45:0/1232303327 wait complete. 2023-10-03T19:16:34.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.982+0000 7f6e36072640 1 Processor -- start 2023-10-03T19:16:34.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.982+0000 7f6e36072640 1 -- start start 2023-10-03T19:16:34.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.982+0000 7f6e36072640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e300bf1f0 0x7f6e300ba190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:34.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.982+0000 7f6e36072640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e300c14e0 0x7f6e300a3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:34.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.982+0000 7f6e36072640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e300c2770 0x7f6e300a3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:34.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.982+0000 7f6e36072640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3009aba0 con 0x7f6e300c2770 2023-10-03T19:16:34.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.982+0000 7f6e36072640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3014b3e0 con 0x7f6e300c14e0 2023-10-03T19:16:34.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.982+0000 7f6e36072640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e300bb080 con 0x7f6e300bf1f0 2023-10-03T19:16:34.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.982+0000 7f6e2ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e300c2770 0x7f6e300a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:34.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.982+0000 7f6e2ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e300c2770 0x7f6e300a3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34484/0 (socket says 172.21.15.45:34484) 2023-10-03T19:16:34.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.982+0000 7f6e2ffff640 1 -- 172.21.15.45:0/275281302 learned_addr learned my addr 172.21.15.45:0/275281302 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:34.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.982+0000 7f6e2effd640 1 --2- 172.21.15.45:0/275281302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e300c14e0 0x7f6e300a3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:34.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.982+0000 7f6e2f7fe640 1 --2- 172.21.15.45:0/275281302 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e300bf1f0 0x7f6e300ba190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:34.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.986+0000 7f6e2ffff640 1 -- 172.21.15.45:0/275281302 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e300bf1f0 msgr2=0x7f6e300ba190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:34.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.986+0000 7f6e2ffff640 1 --2- 172.21.15.45:0/275281302 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e300bf1f0 0x7f6e300ba190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:34.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.986+0000 7f6e2ffff640 1 -- 172.21.15.45:0/275281302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e300c14e0 msgr2=0x7f6e300a3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:34.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.986+0000 7f6e2ffff640 1 --2- 172.21.15.45:0/275281302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e300c14e0 0x7f6e300a3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:34.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.986+0000 7f6e2ffff640 1 -- 172.21.15.45:0/275281302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e28009b30 con 0x7f6e300c2770 2023-10-03T19:16:34.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.986+0000 7f6e2effd640 1 --2- 172.21.15.45:0/275281302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e300c14e0 0x7f6e300a3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:16:34.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.986+0000 7f6e2ffff640 1 --2- 172.21.15.45:0/275281302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e300c2770 0x7f6e300a3840 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6e280b2040 tx=0x7f6e2801bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:34.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.986+0000 7f6e27fff640 1 -- 172.21.15.45:0/275281302 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e280afd60 con 0x7f6e300c2770 2023-10-03T19:16:34.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.986+0000 7f6e27fff640 1 -- 172.21.15.45:0/275281302 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e28009510 con 0x7f6e300c2770 2023-10-03T19:16:34.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.986+0000 7f6e36072640 1 -- 172.21.15.45:0/275281302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e3014f530 con 0x7f6e300c2770 2023-10-03T19:16:34.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.986+0000 7f6e27fff640 1 -- 172.21.15.45:0/275281302 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e280ba660 con 0x7f6e300c2770 2023-10-03T19:16:34.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.986+0000 7f6e36072640 1 -- 172.21.15.45:0/275281302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e3014f250 con 0x7f6e300c2770 2023-10-03T19:16:34.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.986+0000 7f6e36072640 1 -- 172.21.15.45:0/275281302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e3006b0e0 con 0x7f6e300c2770 2023-10-03T19:16:34.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.986+0000 7f6e27fff640 1 -- 172.21.15.45:0/275281302 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6e280b6040 con 0x7f6e300c2770 2023-10-03T19:16:34.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.986+0000 7f6e27fff640 1 --2- 172.21.15.45:0/275281302 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6e10066280 0x7f6e10068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:34.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.986+0000 7f6e27fff640 1 -- 172.21.15.45:0/275281302 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f6e28122100 con 0x7f6e300c2770 2023-10-03T19:16:34.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.986+0000 7f6e2f7fe640 1 --2- 172.21.15.45:0/275281302 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6e10066280 0x7f6e10068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:34.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.986+0000 7f6e2f7fe640 1 --2- 172.21.15.45:0/275281302 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6e10066280 0x7f6e10068730 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6e20004e30 tx=0x7f6e20009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:34.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:34.990+0000 7f6e27fff640 1 -- 172.21.15.45:0/275281302 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6e280ef580 con 0x7f6e300c2770 2023-10-03T19:16:35.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:35.146+0000 7f6e36072640 1 -- 172.21.15.45:0/275281302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6e3004de80 con 0x7f6e300c2770 2023-10-03T19:16:35.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:35.866+0000 7f6e27fff640 1 -- 172.21.15.45:0/275281302 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v52) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6e280f2ba0 con 0x7f6e300c2770 2023-10-03T19:16:35.873 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-10-03T19:16:35.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:35.870+0000 7f6e36072640 1 -- 172.21.15.45:0/275281302 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6e10066280 msgr2=0x7f6e10068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:35.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:35.870+0000 7f6e36072640 1 --2- 172.21.15.45:0/275281302 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6e10066280 0x7f6e10068730 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6e20004e30 tx=0x7f6e20009040 comp rx=0 tx=0).stop 2023-10-03T19:16:35.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:35.870+0000 7f6e36072640 1 -- 172.21.15.45:0/275281302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e300c2770 msgr2=0x7f6e300a3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:35.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:35.870+0000 7f6e36072640 1 --2- 172.21.15.45:0/275281302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e300c2770 0x7f6e300a3840 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6e280b2040 tx=0x7f6e2801bf20 comp rx=0 tx=0).stop 2023-10-03T19:16:35.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:35.870+0000 7f6e36072640 1 -- 172.21.15.45:0/275281302 shutdown_connections 2023-10-03T19:16:35.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:35.870+0000 7f6e36072640 1 --2- 172.21.15.45:0/275281302 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6e10066280 0x7f6e10068730 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:35.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:35.870+0000 7f6e36072640 1 --2- 172.21.15.45:0/275281302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e300c2770 0x7f6e300a3840 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:35.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:35.870+0000 7f6e36072640 1 --2- 172.21.15.45:0/275281302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e300c14e0 0x7f6e300a3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:35.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:35.870+0000 7f6e36072640 1 --2- 172.21.15.45:0/275281302 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e300bf1f0 0x7f6e300ba190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:35.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:35.870+0000 7f6e36072640 1 -- 172.21.15.45:0/275281302 >> 172.21.15.45:0/275281302 conn(0x7f6e300a6440 msgr2=0x7f6e300a42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:35.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:35.870+0000 7f6e36072640 1 -- 172.21.15.45:0/275281302 shutdown_connections 2023-10-03T19:16:35.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:35.870+0000 7f6e36072640 1 -- 172.21.15.45:0/275281302 wait complete. 2023-10-03T19:16:35.899 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-03T19:16:36.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.034+0000 7f3a7919f640 1 Processor -- start 2023-10-03T19:16:36.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.034+0000 7f3a7919f640 1 -- start start 2023-10-03T19:16:36.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.034+0000 7f3a7919f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3a74144ab0 0x7f3a7406ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:36.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.034+0000 7f3a7919f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a7406d520 con 0x7f3a740badc0 2023-10-03T19:16:36.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.034+0000 7f3a7919f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a7406d770 con 0x7f3a740a2be0 2023-10-03T19:16:36.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.034+0000 7f3a7919f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a7414e6a0 con 0x7f3a74144ab0 2023-10-03T19:16:36.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.038+0000 7f3a7259c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3a740badc0 0x7f3a7406c1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40554/0 (socket says 172.21.15.45:40554) 2023-10-03T19:16:36.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.038+0000 7f3a7259c640 1 -- 172.21.15.45:0/3029763787 learned_addr learned my addr 172.21.15.45:0/3029763787 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:36.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.038+0000 7f3a71d9b640 1 -- 172.21.15.45:0/3029763787 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201405548 0 0) 0x7f3a7406d520 con 0x7f3a740badc0 2023-10-03T19:16:36.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.038+0000 7f3a71d9b640 1 -- 172.21.15.45:0/3029763787 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a5c003530 con 0x7f3a740badc0 2023-10-03T19:16:36.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.038+0000 7f3a72d9d640 1 --2- 172.21.15.45:0/3029763787 >> v2:172.21.15.79:3300/0 conn(0x7f3a74144ab0 0x7f3a7406ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:36.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.038+0000 7f3a71d9b640 1 -- 172.21.15.45:0/3029763787 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3257873298 0 0) 0x7f3a5c003530 con 0x7f3a740badc0 2023-10-03T19:16:36.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.038+0000 7f3a71d9b640 1 -- 172.21.15.45:0/3029763787 >> v2:172.21.15.79:3300/0 conn(0x7f3a74144ab0 msgr2=0x7f3a7406ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:36.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.038+0000 7f3a71d9b640 1 --2- 172.21.15.45:0/3029763787 >> v2:172.21.15.79:3300/0 conn(0x7f3a74144ab0 0x7f3a7406ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:36.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.038+0000 7f3a71d9b640 1 -- 172.21.15.45:0/3029763787 >> v1:172.21.15.79:6789/0 conn(0x7f3a740a2be0 legacy=0x7f3a74154f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T19:16:36.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.038+0000 7f3a71d9b640 1 -- 172.21.15.45:0/3029763787 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7414e980 con 0x7f3a740badc0 2023-10-03T19:16:36.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.038+0000 7f3a71d9b640 1 -- 172.21.15.45:0/3029763787 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f3a6c001a00 con 0x7f3a740badc0 2023-10-03T19:16:36.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.038+0000 7f3a71d9b640 1 -- 172.21.15.45:0/3029763787 >> v1:172.21.15.45:6789/0 conn(0x7f3a740badc0 legacy=0x7f3a7406c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:36.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.038+0000 7f3a71d9b640 1 --2- 172.21.15.45:0/3029763787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a5c003980 0x7f3a5c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:36.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.038+0000 7f3a71d9b640 1 --2- 172.21.15.45:0/3029763787 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a5c0047d0 0x7f3a5c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:36.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.038+0000 7f3a71d9b640 1 --2- 172.21.15.45:0/3029763787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a5c005180 0x7f3a5c00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:36.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.038+0000 7f3a71d9b640 1 -- 172.21.15.45:0/3029763787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7414e6a0 con 0x7f3a5c003980 2023-10-03T19:16:36.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.038+0000 7f3a71d9b640 1 -- 172.21.15.45:0/3029763787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c00e270 con 0x7f3a5c005180 2023-10-03T19:16:36.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.038+0000 7f3a71d9b640 1 -- 172.21.15.45:0/3029763787 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c00e430 con 0x7f3a5c0047d0 2023-10-03T19:16:36.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.038+0000 7f3a72d9d640 1 --2- 172.21.15.45:0/3029763787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a5c003980 0x7f3a5c003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:36.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.038+0000 7f3a72d9d640 1 -- 172.21.15.45:0/3029763787 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a5c0047d0 msgr2=0x7f3a5c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:36.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.038+0000 7f3a72d9d640 1 --2- 172.21.15.45:0/3029763787 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a5c0047d0 0x7f3a5c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:36.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.038+0000 7f3a72d9d640 1 -- 172.21.15.45:0/3029763787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a5c005180 msgr2=0x7f3a5c00dba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T19:16:36.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.038+0000 7f3a72d9d640 1 --2- 172.21.15.45:0/3029763787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a5c005180 0x7f3a5c00dba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:36.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.038+0000 7f3a72d9d640 1 -- 172.21.15.45:0/3029763787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7414e980 con 0x7f3a5c003980 2023-10-03T19:16:36.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.038+0000 7f3a7359e640 1 -- 172.21.15.45:0/3029763787 reap_dead start 2023-10-03T19:16:36.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.042+0000 7f3a72d9d640 1 --2- 172.21.15.45:0/3029763787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a5c003980 0x7f3a5c003d70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800b5c0 tx=0x7f3a68020ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2441915508532a0f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:36.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.042+0000 7f3a71d9b640 1 -- 172.21.15.45:0/3029763787 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a680a98a0 con 0x7f3a5c003980 2023-10-03T19:16:36.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.042+0000 7f3a71d9b640 1 -- 172.21.15.45:0/3029763787 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a680ad070 con 0x7f3a5c003980 2023-10-03T19:16:36.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.042+0000 7f3a71d9b640 1 -- 172.21.15.45:0/3029763787 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a680a9c40 con 0x7f3a5c003980 2023-10-03T19:16:36.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.042+0000 7f3a7919f640 1 -- 172.21.15.45:0/3029763787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a5c003980 msgr2=0x7f3a5c003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:36.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.042+0000 7f3a7919f640 1 --2- 172.21.15.45:0/3029763787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a5c003980 0x7f3a5c003d70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800b5c0 tx=0x7f3a68020ab0 comp rx=0 tx=0).stop 2023-10-03T19:16:36.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.042+0000 7f3a7919f640 1 -- 172.21.15.45:0/3029763787 shutdown_connections 2023-10-03T19:16:36.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.042+0000 7f3a7919f640 1 --2- 172.21.15.45:0/3029763787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a5c003980 0x7f3a5c003d70 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:36.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.042+0000 7f3a7919f640 1 -- 172.21.15.45:0/3029763787 >> 172.21.15.45:0/3029763787 conn(0x7f3a740a20d0 msgr2=0x7f3a740a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:36.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.042+0000 7f3a7919f640 1 -- 172.21.15.45:0/3029763787 shutdown_connections 2023-10-03T19:16:36.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.042+0000 7f3a7919f640 1 -- 172.21.15.45:0/3029763787 wait complete. 2023-10-03T19:16:36.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.042+0000 7f3a7919f640 1 Processor -- start 2023-10-03T19:16:36.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.046+0000 7f3a7919f640 1 -- start start 2023-10-03T19:16:36.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.046+0000 7f3a7919f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a5c003980 0x7f3a7414d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:36.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.046+0000 7f3a7919f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a740a5f00 0x7f3a741478a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:36.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.046+0000 7f3a7919f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a74147de0 0x7f3a741e2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:36.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.046+0000 7f3a7919f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a741471c0 con 0x7f3a740a5f00 2023-10-03T19:16:36.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.046+0000 7f3a7919f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7413b2d0 con 0x7f3a74147de0 2023-10-03T19:16:36.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.046+0000 7f3a7919f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7414d790 con 0x7f3a5c003980 2023-10-03T19:16:36.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.046+0000 7f3a7259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a740a5f00 0x7f3a741478a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:36.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.046+0000 7f3a7259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a740a5f00 0x7f3a741478a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34506/0 (socket says 172.21.15.45:34506) 2023-10-03T19:16:36.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.046+0000 7f3a7259c640 1 -- 172.21.15.45:0/2018137228 learned_addr learned my addr 172.21.15.45:0/2018137228 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:36.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.046+0000 7f3a7359e640 1 --2- 172.21.15.45:0/2018137228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a74147de0 0x7f3a741e2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:36.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.046+0000 7f3a72d9d640 1 --2- 172.21.15.45:0/2018137228 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a5c003980 0x7f3a7414d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:36.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.046+0000 7f3a7259c640 1 -- 172.21.15.45:0/2018137228 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a5c003980 msgr2=0x7f3a7414d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:36.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.046+0000 7f3a7259c640 1 --2- 172.21.15.45:0/2018137228 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a5c003980 0x7f3a7414d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:36.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.046+0000 7f3a7259c640 1 -- 172.21.15.45:0/2018137228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a74147de0 msgr2=0x7f3a741e2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:36.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.046+0000 7f3a7259c640 1 --2- 172.21.15.45:0/2018137228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a74147de0 0x7f3a741e2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:36.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.046+0000 7f3a7259c640 1 -- 172.21.15.45:0/2018137228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7406c340 con 0x7f3a740a5f00 2023-10-03T19:16:36.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.046+0000 7f3a7259c640 1 --2- 172.21.15.45:0/2018137228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a740a5f00 0x7f3a741478a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00cb70 tx=0x7f3a6c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:36.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.046+0000 7f3a5b7fe640 1 -- 172.21.15.45:0/2018137228 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c00ce50 con 0x7f3a740a5f00 2023-10-03T19:16:36.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.046+0000 7f3a5b7fe640 1 -- 172.21.15.45:0/2018137228 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6c00a5e0 con 0x7f3a740a5f00 2023-10-03T19:16:36.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.046+0000 7f3a7919f640 1 -- 172.21.15.45:0/2018137228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a7406c1b0 con 0x7f3a740a5f00 2023-10-03T19:16:36.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.046+0000 7f3a5b7fe640 1 -- 172.21.15.45:0/2018137228 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c00a990 con 0x7f3a740a5f00 2023-10-03T19:16:36.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.046+0000 7f3a7919f640 1 -- 172.21.15.45:0/2018137228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a7406c4d0 con 0x7f3a740a5f00 2023-10-03T19:16:36.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.046+0000 7f3a7919f640 1 -- 172.21.15.45:0/2018137228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a7404de80 con 0x7f3a740a5f00 2023-10-03T19:16:36.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.046+0000 7f3a5b7fe640 1 -- 172.21.15.45:0/2018137228 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3a6c00aaf0 con 0x7f3a740a5f00 2023-10-03T19:16:36.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.050+0000 7f3a5b7fe640 1 --2- 172.21.15.45:0/2018137228 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3a60066280 0x7f3a60068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:36.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.050+0000 7f3a5b7fe640 1 -- 172.21.15.45:0/2018137228 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f3a6c083260 con 0x7f3a740a5f00 2023-10-03T19:16:36.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.050+0000 7f3a72d9d640 1 --2- 172.21.15.45:0/2018137228 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3a60066280 0x7f3a60068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:36.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.050+0000 7f3a72d9d640 1 --2- 172.21.15.45:0/2018137228 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3a60066280 0x7f3a60068730 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3a680b4000 tx=0x7f3a680046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:36.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.054+0000 7f3a5b7fe640 1 -- 172.21.15.45:0/2018137228 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3a6c050890 con 0x7f3a740a5f00 2023-10-03T19:16:36.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.214+0000 7f3a7919f640 1 -- 172.21.15.45:0/2018137228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3a7406ff30 con 0x7f3a740a5f00 2023-10-03T19:16:36.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.878+0000 7f3a5b7fe640 1 -- 172.21.15.45:0/2018137228 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v53) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3a6c053eb0 con 0x7f3a740a5f00 2023-10-03T19:16:36.885 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-10-03T19:16:36.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.882+0000 7f3a7919f640 1 -- 172.21.15.45:0/2018137228 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3a60066280 msgr2=0x7f3a60068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:36.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.882+0000 7f3a7919f640 1 --2- 172.21.15.45:0/2018137228 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3a60066280 0x7f3a60068730 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3a680b4000 tx=0x7f3a680046d0 comp rx=0 tx=0).stop 2023-10-03T19:16:36.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.882+0000 7f3a7919f640 1 -- 172.21.15.45:0/2018137228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a740a5f00 msgr2=0x7f3a741478a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:36.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.882+0000 7f3a7919f640 1 --2- 172.21.15.45:0/2018137228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a740a5f00 0x7f3a741478a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00cb70 tx=0x7f3a6c00cc60 comp rx=0 tx=0).stop 2023-10-03T19:16:36.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.882+0000 7f3a7919f640 1 -- 172.21.15.45:0/2018137228 shutdown_connections 2023-10-03T19:16:36.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.882+0000 7f3a7919f640 1 --2- 172.21.15.45:0/2018137228 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3a60066280 0x7f3a60068730 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:36.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.882+0000 7f3a7919f640 1 --2- 172.21.15.45:0/2018137228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a74147de0 0x7f3a741e2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:36.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.882+0000 7f3a7919f640 1 --2- 172.21.15.45:0/2018137228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a740a5f00 0x7f3a741478a0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:36.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.882+0000 7f3a7919f640 1 --2- 172.21.15.45:0/2018137228 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a5c003980 0x7f3a7414d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:36.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.882+0000 7f3a7919f640 1 -- 172.21.15.45:0/2018137228 >> 172.21.15.45:0/2018137228 conn(0x7f3a740a20d0 msgr2=0x7f3a740bf0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:36.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.882+0000 7f3a7919f640 1 -- 172.21.15.45:0/2018137228 shutdown_connections 2023-10-03T19:16:36.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:36.882+0000 7f3a7919f640 1 -- 172.21.15.45:0/2018137228 wait complete. 2023-10-03T19:16:36.914 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-03T19:16:37.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.038+0000 7f594472a640 1 Processor -- start 2023-10-03T19:16:37.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.038+0000 7f594472a640 1 -- start start 2023-10-03T19:16:37.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.038+0000 7f594472a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f593c0712c0 0x7f593c0bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:37.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.038+0000 7f594472a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f593c06c760 0x7f593c0bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:37.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.038+0000 7f594472a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f593c06c2d0 con 0x7f593c06d560 2023-10-03T19:16:37.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.038+0000 7f594472a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f593c150610 con 0x7f593c0712c0 2023-10-03T19:16:37.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.038+0000 7f594472a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593c1508b0 con 0x7f593c06c760 2023-10-03T19:16:37.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.038+0000 7f5942cc7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f593c06c760 0x7f593c0bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:37.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.038+0000 7f59424c6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f593c0712c0 0x7f593c0bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:37.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.038+0000 7f59424c6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f593c0712c0 0x7f593c0bcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:37006/0 (socket says 172.21.15.45:37006) 2023-10-03T19:16:37.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.038+0000 7f59424c6640 1 -- 172.21.15.45:0/73283188 learned_addr learned my addr 172.21.15.45:0/73283188 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:37.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.042+0000 7f5942cc7640 1 -- 172.21.15.45:0/73283188 >> v2:172.21.15.79:3300/0 conn(0x7f593c0712c0 msgr2=0x7f593c0bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:37.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.042+0000 7f5942cc7640 1 --2- 172.21.15.45:0/73283188 >> v2:172.21.15.79:3300/0 conn(0x7f593c0712c0 0x7f593c0bcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:37.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.042+0000 7f5942cc7640 1 -- 172.21.15.45:0/73283188 >> v1:172.21.15.79:6789/0 conn(0x7f593c06d560 legacy=0x7f593c0a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:37.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.042+0000 7f5942cc7640 1 -- 172.21.15.45:0/73283188 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593c06d2e0 con 0x7f593c06c760 2023-10-03T19:16:37.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.042+0000 7f59424c6640 1 --2- 172.21.15.45:0/73283188 >> v2:172.21.15.79:3300/0 conn(0x7f593c0712c0 0x7f593c0bcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:16:37.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.042+0000 7f5942cc7640 1 --2- 172.21.15.45:0/73283188 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f593c06c760 0x7f593c0bd100 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5934009d90 tx=0x7f593401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=338c423fac7635d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:37.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.042+0000 7f59414c4640 1 -- 172.21.15.45:0/73283188 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59340a5950 con 0x7f593c06c760 2023-10-03T19:16:37.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.042+0000 7f59414c4640 1 -- 172.21.15.45:0/73283188 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59340a5ab0 con 0x7f593c06c760 2023-10-03T19:16:37.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.042+0000 7f59414c4640 1 -- 172.21.15.45:0/73283188 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59340a5e40 con 0x7f593c06c760 2023-10-03T19:16:37.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f594472a640 1 -- 172.21.15.45:0/73283188 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f593c06c760 msgr2=0x7f593c0bd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:37.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f594472a640 1 --2- 172.21.15.45:0/73283188 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f593c06c760 0x7f593c0bd100 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5934009d90 tx=0x7f593401c950 comp rx=0 tx=0).stop 2023-10-03T19:16:37.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f594472a640 1 -- 172.21.15.45:0/73283188 shutdown_connections 2023-10-03T19:16:37.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f594472a640 1 --2- 172.21.15.45:0/73283188 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f593c06c760 0x7f593c0bd100 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:37.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f594472a640 1 --2- 172.21.15.45:0/73283188 >> v2:172.21.15.79:3300/0 conn(0x7f593c0712c0 0x7f593c0bcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:37.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f594472a640 1 -- 172.21.15.45:0/73283188 >> 172.21.15.45:0/73283188 conn(0x7f593c0a20d0 msgr2=0x7f593c0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:37.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f594472a640 1 -- 172.21.15.45:0/73283188 shutdown_connections 2023-10-03T19:16:37.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f594472a640 1 -- 172.21.15.45:0/73283188 wait complete. 2023-10-03T19:16:37.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f594472a640 1 Processor -- start 2023-10-03T19:16:37.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f594472a640 1 -- start start 2023-10-03T19:16:37.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f594472a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f593c06c760 0x7f593c149b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:37.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f594472a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f593c06d560 0x7f593c144690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:37.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f594472a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f593c0712c0 0x7f593c144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:37.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f594472a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c145110 con 0x7f593c06c760 2023-10-03T19:16:37.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f594472a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c14b2b0 con 0x7f593c06d560 2023-10-03T19:16:37.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f594472a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593c14a0d0 con 0x7f593c0712c0 2023-10-03T19:16:37.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f59424c6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f593c06c760 0x7f593c149b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:37.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f5942cc7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f593c0712c0 0x7f593c144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:37.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f59424c6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f593c06c760 0x7f593c149b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34518/0 (socket says 172.21.15.45:34518) 2023-10-03T19:16:37.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f59424c6640 1 -- 172.21.15.45:0/171307549 learned_addr learned my addr 172.21.15.45:0/171307549 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:37.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f5941cc5640 1 --2- 172.21.15.45:0/171307549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f593c06d560 0x7f593c144690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:37.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f59424c6640 1 -- 172.21.15.45:0/171307549 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f593c0712c0 msgr2=0x7f593c144bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:37.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f59424c6640 1 --2- 172.21.15.45:0/171307549 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f593c0712c0 0x7f593c144bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:37.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f59424c6640 1 -- 172.21.15.45:0/171307549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f593c06d560 msgr2=0x7f593c144690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:37.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f59424c6640 1 --2- 172.21.15.45:0/171307549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f593c06d560 0x7f593c144690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:37.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f59424c6640 1 -- 172.21.15.45:0/171307549 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59380094d0 con 0x7f593c06c760 2023-10-03T19:16:37.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f59424c6640 1 --2- 172.21.15.45:0/171307549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f593c06c760 0x7f593c149b90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f593800ea00 tx=0x7f593800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:37.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f5932ffd640 1 -- 172.21.15.45:0/171307549 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593800ca60 con 0x7f593c06c760 2023-10-03T19:16:37.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f5932ffd640 1 -- 172.21.15.45:0/171307549 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593800cbc0 con 0x7f593c06c760 2023-10-03T19:16:37.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f594472a640 1 -- 172.21.15.45:0/171307549 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5934009a70 con 0x7f593c06c760 2023-10-03T19:16:37.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f5932ffd640 1 -- 172.21.15.45:0/171307549 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5938013470 con 0x7f593c06c760 2023-10-03T19:16:37.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.046+0000 7f594472a640 1 -- 172.21.15.45:0/171307549 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593c0a6070 con 0x7f593c06c760 2023-10-03T19:16:37.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.050+0000 7f594472a640 1 -- 172.21.15.45:0/171307549 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f593c0a5ee0 con 0x7f593c06c760 2023-10-03T19:16:37.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.050+0000 7f5932ffd640 1 -- 172.21.15.45:0/171307549 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f59380135d0 con 0x7f593c06c760 2023-10-03T19:16:37.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.050+0000 7f5932ffd640 1 --2- 172.21.15.45:0/171307549 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f59200662b0 0x7f5920068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:37.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.050+0000 7f5932ffd640 1 -- 172.21.15.45:0/171307549 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f5938083f80 con 0x7f593c06c760 2023-10-03T19:16:37.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.050+0000 7f5941cc5640 1 --2- 172.21.15.45:0/171307549 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f59200662b0 0x7f5920068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:37.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.050+0000 7f5941cc5640 1 --2- 172.21.15.45:0/171307549 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f59200662b0 0x7f5920068760 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f593c0be5b0 tx=0x7f592c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:37.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.054+0000 7f5932ffd640 1 -- 172.21.15.45:0/171307549 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f59380b46f0 con 0x7f593c06c760 2023-10-03T19:16:37.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.210+0000 7f594472a640 1 -- 172.21.15.45:0/171307549 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f593c0bca30 con 0x7f593c06c760 2023-10-03T19:16:37.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.214+0000 7f5932ffd640 1 -- 172.21.15.45:0/171307549 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5938051840 con 0x7f593c06c760 2023-10-03T19:16:37.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.218+0000 7f594472a640 1 -- 172.21.15.45:0/171307549 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f59200662b0 msgr2=0x7f5920068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:37.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.218+0000 7f594472a640 1 --2- 172.21.15.45:0/171307549 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f59200662b0 0x7f5920068760 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f593c0be5b0 tx=0x7f592c009040 comp rx=0 tx=0).stop 2023-10-03T19:16:37.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.218+0000 7f594472a640 1 -- 172.21.15.45:0/171307549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f593c06c760 msgr2=0x7f593c149b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:37.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.218+0000 7f594472a640 1 --2- 172.21.15.45:0/171307549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f593c06c760 0x7f593c149b90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f593800ea00 tx=0x7f593800eec0 comp rx=0 tx=0).stop 2023-10-03T19:16:37.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.218+0000 7f594472a640 1 -- 172.21.15.45:0/171307549 shutdown_connections 2023-10-03T19:16:37.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.218+0000 7f594472a640 1 --2- 172.21.15.45:0/171307549 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f59200662b0 0x7f5920068760 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:37.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.218+0000 7f594472a640 1 --2- 172.21.15.45:0/171307549 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f593c0712c0 0x7f593c144bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:37.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.218+0000 7f594472a640 1 --2- 172.21.15.45:0/171307549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f593c06d560 0x7f593c144690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:37.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.218+0000 7f594472a640 1 --2- 172.21.15.45:0/171307549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f593c06c760 0x7f593c149b90 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:37.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.218+0000 7f594472a640 1 -- 172.21.15.45:0/171307549 >> 172.21.15.45:0/171307549 conn(0x7f593c0a20d0 msgr2=0x7f593c0bacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:37.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.218+0000 7f594472a640 1 -- 172.21.15.45:0/171307549 shutdown_connections 2023-10-03T19:16:37.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.218+0000 7f594472a640 1 -- 172.21.15.45:0/171307549 wait complete. 2023-10-03T19:16:37.244 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead' 2023-10-03T19:16:37.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.358+0000 7f0a8c940640 1 Processor -- start 2023-10-03T19:16:37.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.358+0000 7f0a8c940640 1 -- start start 2023-10-03T19:16:37.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.358+0000 7f0a8c940640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0a88148b90 0x7f0a880bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:37.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.358+0000 7f0a8c940640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a8814b610 con 0x7f0a880bc4a0 2023-10-03T19:16:37.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.358+0000 7f0a8c940640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a880a5580 con 0x7f0a880bcb60 2023-10-03T19:16:37.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.358+0000 7f0a8c940640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a880a3670 con 0x7f0a88148b90 2023-10-03T19:16:37.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.358+0000 7f0a8659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0a88148b90 0x7f0a880bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:37.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.358+0000 7f0a86d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0a880bc4a0 0x7f0a8806c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40558/0 (socket says 172.21.15.45:40558) 2023-10-03T19:16:37.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.358+0000 7f0a86d9d640 1 -- 172.21.15.45:0/2969248909 learned_addr learned my addr 172.21.15.45:0/2969248909 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:37.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.358+0000 7f0a8659c640 1 -- 172.21.15.45:0/2969248909 >> v1:172.21.15.79:6789/0 conn(0x7f0a880bcb60 legacy=0x7f0a8806c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:37.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.358+0000 7f0a8659c640 1 -- 172.21.15.45:0/2969248909 >> v1:172.21.15.45:6789/0 conn(0x7f0a880bc4a0 legacy=0x7f0a8806c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:37.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.358+0000 7f0a8659c640 1 -- 172.21.15.45:0/2969248909 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a880a5820 con 0x7f0a88148b90 2023-10-03T19:16:37.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a8659c640 1 --2- 172.21.15.45:0/2969248909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a88148b90 0x7f0a880bbf60 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f0a780097c0 tx=0x7f0a7801e690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8acd89274c9dc66 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:37.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a85d9b640 1 -- 172.21.15.45:0/2969248909 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a780ae600 con 0x7f0a88148b90 2023-10-03T19:16:37.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a85d9b640 1 -- 172.21.15.45:0/2969248909 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a780aa050 con 0x7f0a88148b90 2023-10-03T19:16:37.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a85d9b640 1 -- 172.21.15.45:0/2969248909 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a780ae980 con 0x7f0a88148b90 2023-10-03T19:16:37.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a8c940640 1 -- 172.21.15.45:0/2969248909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a88148b90 msgr2=0x7f0a880bbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:37.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a8c940640 1 --2- 172.21.15.45:0/2969248909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a88148b90 0x7f0a880bbf60 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f0a780097c0 tx=0x7f0a7801e690 comp rx=0 tx=0).stop 2023-10-03T19:16:37.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a8c940640 1 -- 172.21.15.45:0/2969248909 shutdown_connections 2023-10-03T19:16:37.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a8c940640 1 --2- 172.21.15.45:0/2969248909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a88148b90 0x7f0a880bbf60 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:37.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a8c940640 1 -- 172.21.15.45:0/2969248909 >> 172.21.15.45:0/2969248909 conn(0x7f0a880bcf50 msgr2=0x7f0a880bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:37.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a8c940640 1 -- 172.21.15.45:0/2969248909 shutdown_connections 2023-10-03T19:16:37.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a8c940640 1 -- 172.21.15.45:0/2969248909 wait complete. 2023-10-03T19:16:37.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a8c940640 1 Processor -- start 2023-10-03T19:16:37.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a8c940640 1 -- start start 2023-10-03T19:16:37.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a8c940640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a880bc4a0 0x7f0a88147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:37.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a8c940640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0a880bcb60 0x7f0a8813f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:37.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a8c940640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a88148b90 0x7f0a8806fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:37.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a8c940640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8813f8a0 con 0x7f0a880bc4a0 2023-10-03T19:16:37.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a8c940640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a881466d0 con 0x7f0a88148b90 2023-10-03T19:16:37.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a8c940640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8813db10 con 0x7f0a880bcb60 2023-10-03T19:16:37.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a8659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a880bc4a0 0x7f0a88147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:37.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a8659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a880bc4a0 0x7f0a88147fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34530/0 (socket says 172.21.15.45:34530) 2023-10-03T19:16:37.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a8659c640 1 -- 172.21.15.45:0/2781807219 learned_addr learned my addr 172.21.15.45:0/2781807219 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:37.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a86d9d640 1 --2- 172.21.15.45:0/2781807219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a88148b90 0x7f0a8806fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:37.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a7dd9b640 1 --2- 172.21.15.45:0/2781807219 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0a880bcb60 0x7f0a8813f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:37.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a8659c640 1 -- 172.21.15.45:0/2781807219 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0a880bcb60 msgr2=0x7f0a8813f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:37.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a8659c640 1 --2- 172.21.15.45:0/2781807219 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0a880bcb60 0x7f0a8813f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:37.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a8659c640 1 -- 172.21.15.45:0/2781807219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a88148b90 msgr2=0x7f0a8806fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:37.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a8659c640 1 --2- 172.21.15.45:0/2781807219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a88148b90 0x7f0a8806fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:37.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a8659c640 1 -- 172.21.15.45:0/2781807219 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a78009420 con 0x7f0a880bc4a0 2023-10-03T19:16:37.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a8659c640 1 --2- 172.21.15.45:0/2781807219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a880bc4a0 0x7f0a88147fb0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0a7801c2c0 tx=0x7f0a7801ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:37.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a7f7fe640 1 -- 172.21.15.45:0/2781807219 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a780b9620 con 0x7f0a880bc4a0 2023-10-03T19:16:37.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a7f7fe640 1 -- 172.21.15.45:0/2781807219 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a780b9780 con 0x7f0a880bc4a0 2023-10-03T19:16:37.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a7f7fe640 1 -- 172.21.15.45:0/2781807219 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a780b9b30 con 0x7f0a880bc4a0 2023-10-03T19:16:37.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a8c940640 1 -- 172.21.15.45:0/2781807219 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a880bda30 con 0x7f0a880bc4a0 2023-10-03T19:16:37.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.362+0000 7f0a8c940640 1 -- 172.21.15.45:0/2781807219 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a880a3c30 con 0x7f0a880bc4a0 2023-10-03T19:16:37.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.366+0000 7f0a8c940640 1 -- 172.21.15.45:0/2781807219 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a880bdbc0 con 0x7f0a880bc4a0 2023-10-03T19:16:37.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.366+0000 7f0a7f7fe640 1 -- 172.21.15.45:0/2781807219 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0a780b5040 con 0x7f0a880bc4a0 2023-10-03T19:16:37.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.366+0000 7f0a7f7fe640 1 --2- 172.21.15.45:0/2781807219 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0a68066280 0x7f0a68068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:37.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.366+0000 7f0a7f7fe640 1 -- 172.21.15.45:0/2781807219 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0a7811ffe0 con 0x7f0a880bc4a0 2023-10-03T19:16:37.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.366+0000 7f0a7dd9b640 1 --2- 172.21.15.45:0/2781807219 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0a68066280 0x7f0a68068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:37.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.366+0000 7f0a7dd9b640 1 --2- 172.21.15.45:0/2781807219 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0a68066280 0x7f0a68068730 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0a88147700 tx=0x7f0a70009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:37.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.370+0000 7f0a7f7fe640 1 -- 172.21.15.45:0/2781807219 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0a780ed7f0 con 0x7f0a880bc4a0 2023-10-03T19:16:37.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.570+0000 7f0a8c940640 1 -- 172.21.15.45:0/2781807219 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]} v 0) v1 -- 0x7f0a88072150 con 0x7f0a880bc4a0 2023-10-03T19:16:37.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.886+0000 7f0a7f7fe640 1 -- 172.21.15.45:0/2781807219 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]}]=0 v195) v1 ==== 144+0+0 (secure 0 0 0) 0x7f0a780bd0d0 con 0x7f0a880bc4a0 2023-10-03T19:16:37.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.890+0000 7f0a8c940640 1 -- 172.21.15.45:0/2781807219 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0a68066280 msgr2=0x7f0a68068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:37.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.890+0000 7f0a8c940640 1 --2- 172.21.15.45:0/2781807219 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0a68066280 0x7f0a68068730 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0a88147700 tx=0x7f0a70009040 comp rx=0 tx=0).stop 2023-10-03T19:16:37.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.890+0000 7f0a8c940640 1 -- 172.21.15.45:0/2781807219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a880bc4a0 msgr2=0x7f0a88147fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:37.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.890+0000 7f0a8c940640 1 --2- 172.21.15.45:0/2781807219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a880bc4a0 0x7f0a88147fb0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0a7801c2c0 tx=0x7f0a7801ced0 comp rx=0 tx=0).stop 2023-10-03T19:16:37.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.890+0000 7f0a8c940640 1 -- 172.21.15.45:0/2781807219 shutdown_connections 2023-10-03T19:16:37.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.890+0000 7f0a8c940640 1 --2- 172.21.15.45:0/2781807219 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0a68066280 0x7f0a68068730 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:37.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.890+0000 7f0a8c940640 1 --2- 172.21.15.45:0/2781807219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a88148b90 0x7f0a8806fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:37.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.890+0000 7f0a8c940640 1 --2- 172.21.15.45:0/2781807219 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0a880bcb60 0x7f0a8813f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:37.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.890+0000 7f0a8c940640 1 --2- 172.21.15.45:0/2781807219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a880bc4a0 0x7f0a88147fb0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:37.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.890+0000 7f0a8c940640 1 -- 172.21.15.45:0/2781807219 >> 172.21.15.45:0/2781807219 conn(0x7f0a880bcf50 msgr2=0x7f0a880bf990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:37.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.890+0000 7f0a8c940640 1 -- 172.21.15.45:0/2781807219 shutdown_connections 2023-10-03T19:16:37.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:37.890+0000 7f0a8c940640 1 -- 172.21.15.45:0/2781807219 wait complete. 2023-10-03T19:16:37.918 INFO:tasks.cephfs_test_runner:Check drop cache command with non-responding client using tell ... ok 2023-10-03T19:16:37.918 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_dead_timeout (tasks.cephfs.test_misc.TestCacheDrop) Check drop cache command with non-responding client using tell 2023-10-03T19:16:37.918 INFO:tasks.cephfs_test_runner:test_drop_cache_command_dead_timeout (tasks.cephfs.test_misc.TestCacheDrop) 2023-10-03T19:16:37.918 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout' 2023-10-03T19:16:38.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.042+0000 7f810b0b3640 1 Processor -- start 2023-10-03T19:16:38.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.042+0000 7f810b0b3640 1 -- start start 2023-10-03T19:16:38.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.042+0000 7f810b0b3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f810406f170 0x7f8104150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:38.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.042+0000 7f810b0b3640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81040bc8b0 0x7f810414ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:38.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.042+0000 7f810b0b3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f810406d170 0x7f810414cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:38.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.042+0000 7f810b0b3640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810406cac0 con 0x7f810406f170 2023-10-03T19:16:38.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.042+0000 7f810b0b3640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810414d4f0 con 0x7f810406d170 2023-10-03T19:16:38.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.042+0000 7f810b0b3640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81040720d0 con 0x7f81040bc8b0 2023-10-03T19:16:38.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.042+0000 7f8108e4f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f810406f170 0x7f8104150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:38.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.042+0000 7f8108e4f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f810406f170 0x7f8104150190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34542/0 (socket says 172.21.15.45:34542) 2023-10-03T19:16:38.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.042+0000 7f8108e4f640 1 -- 172.21.15.45:0/2439136181 learned_addr learned my addr 172.21.15.45:0/2439136181 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:38.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.042+0000 7f8109650640 1 --2- 172.21.15.45:0/2439136181 >> v2:172.21.15.79:3300/0 conn(0x7f810406d170 0x7f810414cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:38.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.042+0000 7f8103fff640 1 --2- 172.21.15.45:0/2439136181 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81040bc8b0 0x7f810414ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:38.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.042+0000 7f8108e4f640 1 -- 172.21.15.45:0/2439136181 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81040bc8b0 msgr2=0x7f810414ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:38.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.042+0000 7f8108e4f640 1 --2- 172.21.15.45:0/2439136181 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81040bc8b0 0x7f810414ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:38.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.042+0000 7f8108e4f640 1 -- 172.21.15.45:0/2439136181 >> v2:172.21.15.79:3300/0 conn(0x7f810406d170 msgr2=0x7f810414cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:38.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.042+0000 7f8108e4f640 1 --2- 172.21.15.45:0/2439136181 >> v2:172.21.15.79:3300/0 conn(0x7f810406d170 0x7f810414cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:38.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.042+0000 7f8108e4f640 1 -- 172.21.15.45:0/2439136181 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81040a5ab0 con 0x7f810406f170 2023-10-03T19:16:38.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f8108e4f640 1 --2- 172.21.15.45:0/2439136181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f810406f170 0x7f8104150190 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f8104070560 tx=0x7f80f401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d37546e9233323be server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:38.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f81037fe640 1 -- 172.21.15.45:0/2439136181 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f40a89b0 con 0x7f810406f170 2023-10-03T19:16:38.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f81037fe640 1 -- 172.21.15.45:0/2439136181 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f40a8b10 con 0x7f810406f170 2023-10-03T19:16:38.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f81037fe640 1 -- 172.21.15.45:0/2439136181 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f40a8ea0 con 0x7f810406f170 2023-10-03T19:16:38.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f810b0b3640 1 -- 172.21.15.45:0/2439136181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f810406f170 msgr2=0x7f8104150190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:38.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f810b0b3640 1 --2- 172.21.15.45:0/2439136181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f810406f170 0x7f8104150190 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f8104070560 tx=0x7f80f401ecf0 comp rx=0 tx=0).stop 2023-10-03T19:16:38.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f810b0b3640 1 -- 172.21.15.45:0/2439136181 shutdown_connections 2023-10-03T19:16:38.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f810b0b3640 1 --2- 172.21.15.45:0/2439136181 >> v2:172.21.15.79:3300/0 conn(0x7f810406d170 0x7f810414cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:38.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f810b0b3640 1 --2- 172.21.15.45:0/2439136181 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81040bc8b0 0x7f810414ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:38.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f810b0b3640 1 --2- 172.21.15.45:0/2439136181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f810406f170 0x7f8104150190 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:38.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f810b0b3640 1 -- 172.21.15.45:0/2439136181 >> 172.21.15.45:0/2439136181 conn(0x7f81040bcf50 msgr2=0x7f81040bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:38.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f810b0b3640 1 -- 172.21.15.45:0/2439136181 shutdown_connections 2023-10-03T19:16:38.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f810b0b3640 1 -- 172.21.15.45:0/2439136181 wait complete. 2023-10-03T19:16:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f810b0b3640 1 Processor -- start 2023-10-03T19:16:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f810b0b3640 1 -- start start 2023-10-03T19:16:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f810b0b3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f810406d170 0x7f8104098ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f810b0b3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f810406f170 0x7f81040a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f810b0b3640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81040bc8b0 0x7f810409aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:38.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f810b0b3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810409c560 con 0x7f810406d170 2023-10-03T19:16:38.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f810b0b3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81041e4850 con 0x7f810406f170 2023-10-03T19:16:38.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f810b0b3640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81040993e0 con 0x7f81040bc8b0 2023-10-03T19:16:38.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f8108e4f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f810406d170 0x7f8104098ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:38.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f8108e4f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f810406d170 0x7f8104098ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34544/0 (socket says 172.21.15.45:34544) 2023-10-03T19:16:38.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f8108e4f640 1 -- 172.21.15.45:0/834159855 learned_addr learned my addr 172.21.15.45:0/834159855 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:38.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f8103fff640 1 --2- 172.21.15.45:0/834159855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f810406f170 0x7f81040a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:38.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f8108e4f640 1 -- 172.21.15.45:0/834159855 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81040bc8b0 msgr2=0x7f810409aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:38.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f8108e4f640 1 --2- 172.21.15.45:0/834159855 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81040bc8b0 0x7f810409aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:38.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f8108e4f640 1 -- 172.21.15.45:0/834159855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f810406f170 msgr2=0x7f81040a3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:38.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f8108e4f640 1 --2- 172.21.15.45:0/834159855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f810406f170 0x7f81040a3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:38.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f8108e4f640 1 -- 172.21.15.45:0/834159855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f40094d0 con 0x7f810406d170 2023-10-03T19:16:38.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f8103fff640 1 --2- 172.21.15.45:0/834159855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f810406f170 0x7f81040a3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:38.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f8108e4f640 1 --2- 172.21.15.45:0/834159855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f810406d170 0x7f8104098ea0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f80f401d3a0 tx=0x7f80f401ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:38.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f81017fa640 1 -- 172.21.15.45:0/834159855 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f40ba600 con 0x7f810406d170 2023-10-03T19:16:38.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f81017fa640 1 -- 172.21.15.45:0/834159855 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f40ba760 con 0x7f810406d170 2023-10-03T19:16:38.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f810b0b3640 1 -- 172.21.15.45:0/834159855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810414fae0 con 0x7f810406d170 2023-10-03T19:16:38.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f81017fa640 1 -- 172.21.15.45:0/834159855 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f40bab10 con 0x7f810406d170 2023-10-03T19:16:38.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.046+0000 7f810b0b3640 1 -- 172.21.15.45:0/834159855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810406cd00 con 0x7f810406d170 2023-10-03T19:16:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.050+0000 7f810b0b3640 1 -- 172.21.15.45:0/834159855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f810406d660 con 0x7f810406d170 2023-10-03T19:16:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.050+0000 7f81017fa640 1 -- 172.21.15.45:0/834159855 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f80f40bac70 con 0x7f810406d170 2023-10-03T19:16:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.050+0000 7f81017fa640 1 --2- 172.21.15.45:0/834159855 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f80f00662b0 0x7f80f0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.050+0000 7f81017fa640 1 -- 172.21.15.45:0/834159855 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f80f4122010 con 0x7f810406d170 2023-10-03T19:16:38.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.050+0000 7f8103fff640 1 --2- 172.21.15.45:0/834159855 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f80f00662b0 0x7f80f0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:38.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.050+0000 7f8103fff640 1 --2- 172.21.15.45:0/834159855 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f80f00662b0 0x7f80f0068760 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f80f8006fd0 tx=0x7f80f8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:38.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.054+0000 7f81017fa640 1 -- 172.21.15.45:0/834159855 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f80f40ef790 con 0x7f810406d170 2023-10-03T19:16:38.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.278+0000 7f810b0b3640 1 -- 172.21.15.45:0/834159855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]} v 0) v1 -- 0x7f810414c480 con 0x7f810406d170 2023-10-03T19:16:38.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.890+0000 7f81017fa640 1 -- 172.21.15.45:0/834159855 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]}]=0 v196) v1 ==== 155+0+0 (secure 0 0 0) 0x7f80f40f2db0 con 0x7f810406d170 2023-10-03T19:16:38.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.890+0000 7f810b0b3640 1 -- 172.21.15.45:0/834159855 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f80f00662b0 msgr2=0x7f80f0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:38.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.890+0000 7f810b0b3640 1 --2- 172.21.15.45:0/834159855 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f80f00662b0 0x7f80f0068760 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f80f8006fd0 tx=0x7f80f8008040 comp rx=0 tx=0).stop 2023-10-03T19:16:38.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.890+0000 7f810b0b3640 1 -- 172.21.15.45:0/834159855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f810406d170 msgr2=0x7f8104098ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:38.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.890+0000 7f810b0b3640 1 --2- 172.21.15.45:0/834159855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f810406d170 0x7f8104098ea0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f80f401d3a0 tx=0x7f80f401ba90 comp rx=0 tx=0).stop 2023-10-03T19:16:38.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.890+0000 7f810b0b3640 1 -- 172.21.15.45:0/834159855 shutdown_connections 2023-10-03T19:16:38.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.890+0000 7f810b0b3640 1 --2- 172.21.15.45:0/834159855 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f80f00662b0 0x7f80f0068760 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:38.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.890+0000 7f810b0b3640 1 --2- 172.21.15.45:0/834159855 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81040bc8b0 0x7f810409aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:38.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.890+0000 7f810b0b3640 1 --2- 172.21.15.45:0/834159855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f810406f170 0x7f81040a3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:38.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.890+0000 7f810b0b3640 1 --2- 172.21.15.45:0/834159855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f810406d170 0x7f8104098ea0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:38.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.890+0000 7f810b0b3640 1 -- 172.21.15.45:0/834159855 >> 172.21.15.45:0/834159855 conn(0x7f81040bcf50 msgr2=0x7f810414d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:38.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.890+0000 7f810b0b3640 1 -- 172.21.15.45:0/834159855 shutdown_connections 2023-10-03T19:16:38.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:38.894+0000 7f810b0b3640 1 -- 172.21.15.45:0/834159855 wait complete. 2023-10-03T19:16:38.922 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-03T19:16:39.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.050+0000 7fb2cedd0640 1 Processor -- start 2023-10-03T19:16:39.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.050+0000 7fb2cedd0640 1 -- start start 2023-10-03T19:16:39.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2cedd0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb2c80c14e0 0x7fb2c80c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:39.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2cedd0640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2c806ac70 con 0x7fb2c80bf1f0 2023-10-03T19:16:39.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2cedd0640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2c80c3000 con 0x7fb2c80c2770 2023-10-03T19:16:39.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2cedd0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c80aa5f0 con 0x7fb2c80c14e0 2023-10-03T19:16:39.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2c7fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb2c80bf1f0 0x7fb2c80a9860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40566/0 (socket says 172.21.15.45:40566) 2023-10-03T19:16:39.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2c7fff640 1 -- 172.21.15.45:0/2408059359 learned_addr learned my addr 172.21.15.45:0/2408059359 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:39.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2ccb6c640 1 --2- 172.21.15.45:0/2408059359 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb2c80c14e0 0x7fb2c80c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:39.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2c77fe640 1 -- 172.21.15.45:0/2408059359 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1723671995 0 0) 0x7fb2c806ac70 con 0x7fb2c80bf1f0 2023-10-03T19:16:39.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2c77fe640 1 -- 172.21.15.45:0/2408059359 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2b4003530 con 0x7fb2c80bf1f0 2023-10-03T19:16:39.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2c77fe640 1 -- 172.21.15.45:0/2408059359 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 313252766 0 0) 0x7fb2b4003530 con 0x7fb2c80bf1f0 2023-10-03T19:16:39.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2c77fe640 1 -- 172.21.15.45:0/2408059359 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb2c80c14e0 msgr2=0x7fb2c80c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:39.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2c77fe640 1 --2- 172.21.15.45:0/2408059359 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb2c80c14e0 0x7fb2c80c0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:39.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2c77fe640 1 -- 172.21.15.45:0/2408059359 >> v1:172.21.15.79:6789/0 conn(0x7fb2c80c2770 legacy=0x7fb2c8069ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:39.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2c77fe640 1 -- 172.21.15.45:0/2408059359 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c814f250 con 0x7fb2c80bf1f0 2023-10-03T19:16:39.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2c77fe640 1 -- 172.21.15.45:0/2408059359 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fb2b0001680 con 0x7fb2c80bf1f0 2023-10-03T19:16:39.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2ccb6c640 1 --2- 172.21.15.45:0/2408059359 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb2c80c14e0 0x7fb2c80c0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:16:39.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2c77fe640 1 -- 172.21.15.45:0/2408059359 >> v1:172.21.15.45:6789/0 conn(0x7fb2c80bf1f0 legacy=0x7fb2c80a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:39.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2c77fe640 1 --2- 172.21.15.45:0/2408059359 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb2c80c14e0 0x7fb2b40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:39.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2c77fe640 1 --2- 172.21.15.45:0/2408059359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b4003fa0 0x7fb2b40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:39.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2c77fe640 1 --2- 172.21.15.45:0/2408059359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2b4004d10 0x7fb2b4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:39.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2c77fe640 1 -- 172.21.15.45:0/2408059359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c80aa5f0 con 0x7fb2b4003fa0 2023-10-03T19:16:39.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2c77fe640 1 -- 172.21.15.45:0/2408059359 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b400bb60 con 0x7fb2b4004d10 2023-10-03T19:16:39.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2c77fe640 1 -- 172.21.15.45:0/2408059359 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b400bd20 con 0x7fb2c80c14e0 2023-10-03T19:16:39.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2c7fff640 1 --2- 172.21.15.45:0/2408059359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b4003fa0 0x7fb2b40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:39.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2ccb6c640 1 --2- 172.21.15.45:0/2408059359 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb2c80c14e0 0x7fb2b40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:39.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2cd36d640 1 --2- 172.21.15.45:0/2408059359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2b4004d10 0x7fb2b4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:39.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2c7fff640 1 -- 172.21.15.45:0/2408059359 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb2c80c14e0 msgr2=0x7fb2b40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:39.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2c7fff640 1 --2- 172.21.15.45:0/2408059359 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb2c80c14e0 0x7fb2b40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:39.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2c7fff640 1 -- 172.21.15.45:0/2408059359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2b4004d10 msgr2=0x7fb2b4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:39.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2c7fff640 1 --2- 172.21.15.45:0/2408059359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2b4004d10 0x7fb2b4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:39.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.054+0000 7fb2c7fff640 1 -- 172.21.15.45:0/2408059359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b4003530 con 0x7fb2b4003fa0 2023-10-03T19:16:39.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2c7fff640 1 --2- 172.21.15.45:0/2408059359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b4003fa0 0x7fb2b40047d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000c210 tx=0x7fb2b001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76086d98ee86ba8b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:39.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2c77fe640 1 -- 172.21.15.45:0/2408059359 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b00a5b20 con 0x7fb2b4003fa0 2023-10-03T19:16:39.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2c77fe640 1 -- 172.21.15.45:0/2408059359 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b00a5c80 con 0x7fb2b4003fa0 2023-10-03T19:16:39.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2c77fe640 1 -- 172.21.15.45:0/2408059359 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0005b20 con 0x7fb2b4003fa0 2023-10-03T19:16:39.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2cedd0640 1 -- 172.21.15.45:0/2408059359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b4003fa0 msgr2=0x7fb2b40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:39.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2cedd0640 1 --2- 172.21.15.45:0/2408059359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b4003fa0 0x7fb2b40047d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000c210 tx=0x7fb2b001cc20 comp rx=0 tx=0).stop 2023-10-03T19:16:39.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2cd36d640 1 -- 172.21.15.45:0/2408059359 reap_dead start 2023-10-03T19:16:39.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2cedd0640 1 -- 172.21.15.45:0/2408059359 shutdown_connections 2023-10-03T19:16:39.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2cedd0640 1 -- 172.21.15.45:0/2408059359 >> 172.21.15.45:0/2408059359 conn(0x7fb2c80a6440 msgr2=0x7fb2c80a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2cedd0640 1 -- 172.21.15.45:0/2408059359 shutdown_connections 2023-10-03T19:16:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2cedd0640 1 -- 172.21.15.45:0/2408059359 wait complete. 2023-10-03T19:16:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2cedd0640 1 Processor -- start 2023-10-03T19:16:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2cedd0640 1 -- start start 2023-10-03T19:16:39.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2cedd0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b4003fa0 0x7fb2c81e3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:39.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2cedd0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2c80bb940 0x7fb2c80ba720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:39.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2cedd0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb2c81e6a10 0x7fb2c81e6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:39.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2cedd0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c81e34a0 con 0x7fb2b4003fa0 2023-10-03T19:16:39.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2cedd0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c80be6c0 con 0x7fb2c80bb940 2023-10-03T19:16:39.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2cedd0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c81e3a20 con 0x7fb2c81e6a10 2023-10-03T19:16:39.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2ccb6c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b4003fa0 0x7fb2c81e3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:39.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2ccb6c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b4003fa0 0x7fb2c81e3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34570/0 (socket says 172.21.15.45:34570) 2023-10-03T19:16:39.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2ccb6c640 1 -- 172.21.15.45:0/1144013793 learned_addr learned my addr 172.21.15.45:0/1144013793 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:39.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2cd36d640 1 --2- 172.21.15.45:0/1144013793 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb2c81e6a10 0x7fb2c81e6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:39.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2c7fff640 1 --2- 172.21.15.45:0/1144013793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2c80bb940 0x7fb2c80ba720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:39.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2ccb6c640 1 -- 172.21.15.45:0/1144013793 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb2c81e6a10 msgr2=0x7fb2c81e6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:39.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2ccb6c640 1 --2- 172.21.15.45:0/1144013793 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb2c81e6a10 0x7fb2c81e6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:39.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2ccb6c640 1 -- 172.21.15.45:0/1144013793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2c80bb940 msgr2=0x7fb2c80ba720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:39.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2ccb6c640 1 --2- 172.21.15.45:0/1144013793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2c80bb940 0x7fb2c80ba720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:39.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2ccb6c640 1 -- 172.21.15.45:0/1144013793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c806b100 con 0x7fb2b4003fa0 2023-10-03T19:16:39.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2c7fff640 1 --2- 172.21.15.45:0/1144013793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2c80bb940 0x7fb2c80ba720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:39.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.058+0000 7fb2ccb6c640 1 --2- 172.21.15.45:0/1144013793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b4003fa0 0x7fb2c81e3eb0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb2c00046c0 tx=0x7fb2c0007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:39.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.062+0000 7fb2c57fa640 1 -- 172.21.15.45:0/1144013793 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c0014610 con 0x7fb2b4003fa0 2023-10-03T19:16:39.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.062+0000 7fb2c57fa640 1 -- 172.21.15.45:0/1144013793 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c000f050 con 0x7fb2b4003fa0 2023-10-03T19:16:39.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.062+0000 7fb2cedd0640 1 -- 172.21.15.45:0/1144013793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2c814f530 con 0x7fb2b4003fa0 2023-10-03T19:16:39.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.062+0000 7fb2c57fa640 1 -- 172.21.15.45:0/1144013793 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c0014990 con 0x7fb2b4003fa0 2023-10-03T19:16:39.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.062+0000 7fb2cedd0640 1 -- 172.21.15.45:0/1144013793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2c80c18b0 con 0x7fb2b4003fa0 2023-10-03T19:16:39.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.062+0000 7fb2cedd0640 1 -- 172.21.15.45:0/1144013793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2c804de80 con 0x7fb2b4003fa0 2023-10-03T19:16:39.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.062+0000 7fb2c57fa640 1 -- 172.21.15.45:0/1144013793 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb2c0014af0 con 0x7fb2b4003fa0 2023-10-03T19:16:39.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.062+0000 7fb2c57fa640 1 --2- 172.21.15.45:0/1144013793 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb2a8066280 0x7fb2a8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:39.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.062+0000 7fb2c57fa640 1 -- 172.21.15.45:0/1144013793 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb2c0084460 con 0x7fb2b4003fa0 2023-10-03T19:16:39.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.062+0000 7fb2c7fff640 1 --2- 172.21.15.45:0/1144013793 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb2a8066280 0x7fb2a8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:39.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.062+0000 7fb2c7fff640 1 --2- 172.21.15.45:0/1144013793 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb2a8066280 0x7fb2a8068730 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00ab000 tx=0x7fb2b00a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:39.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.066+0000 7fb2c57fa640 1 -- 172.21.15.45:0/1144013793 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb2c0051ad0 con 0x7fb2b4003fa0 2023-10-03T19:16:39.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.218+0000 7fb2cedd0640 1 -- 172.21.15.45:0/1144013793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb2c814e8c0 con 0x7fb2b4003fa0 2023-10-03T19:16:39.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.226+0000 7fb2c57fa640 1 -- 172.21.15.45:0/1144013793 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb2c00550f0 con 0x7fb2b4003fa0 2023-10-03T19:16:39.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.230+0000 7fb2cedd0640 1 -- 172.21.15.45:0/1144013793 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb2a8066280 msgr2=0x7fb2a8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:39.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.230+0000 7fb2cedd0640 1 --2- 172.21.15.45:0/1144013793 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb2a8066280 0x7fb2a8068730 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00ab000 tx=0x7fb2b00a7070 comp rx=0 tx=0).stop 2023-10-03T19:16:39.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.230+0000 7fb2cedd0640 1 -- 172.21.15.45:0/1144013793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b4003fa0 msgr2=0x7fb2c81e3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:39.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.230+0000 7fb2cedd0640 1 --2- 172.21.15.45:0/1144013793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b4003fa0 0x7fb2c81e3eb0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb2c00046c0 tx=0x7fb2c0007700 comp rx=0 tx=0).stop 2023-10-03T19:16:39.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.230+0000 7fb2cedd0640 1 -- 172.21.15.45:0/1144013793 shutdown_connections 2023-10-03T19:16:39.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.230+0000 7fb2cedd0640 1 --2- 172.21.15.45:0/1144013793 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb2a8066280 0x7fb2a8068730 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:39.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.230+0000 7fb2cedd0640 1 --2- 172.21.15.45:0/1144013793 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb2c81e6a10 0x7fb2c81e6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:39.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.230+0000 7fb2cedd0640 1 --2- 172.21.15.45:0/1144013793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2c80bb940 0x7fb2c80ba720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:39.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.230+0000 7fb2cedd0640 1 --2- 172.21.15.45:0/1144013793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b4003fa0 0x7fb2c81e3eb0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:39.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.230+0000 7fb2cedd0640 1 -- 172.21.15.45:0/1144013793 >> 172.21.15.45:0/1144013793 conn(0x7fb2c80a6440 msgr2=0x7fb2c814cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:39.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.230+0000 7fb2cedd0640 1 -- 172.21.15.45:0/1144013793 shutdown_connections 2023-10-03T19:16:39.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.230+0000 7fb2cedd0640 1 -- 172.21.15.45:0/1144013793 wait complete. 2023-10-03T19:16:39.252 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-03T19:16:39.252 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:16:39.308 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:16:39.355 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:16:39.408 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:16:39.457 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-03T19:16:39.457 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:16:39.457 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:16:39.463 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336540k,nr_inodes=4084135,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16206 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-10-03T19:16:39.463 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-03T19:16:39.463 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:16:39.469 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336540k,nr_inodes=4084135,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=22607 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-10-03T19:16:39.469 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-10-03T19:16:39.469 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:16:39.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.602+0000 7f24d209f640 1 Processor -- start 2023-10-03T19:16:39.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.602+0000 7f24d209f640 1 -- start start 2023-10-03T19:16:39.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.602+0000 7f24d209f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24cc0a6f00 0x7f24cc0bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:39.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.602+0000 7f24d209f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f24cc06f050 0x7f24cc0be010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:39.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.602+0000 7f24d209f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24cc14fd70 con 0x7f24cc0bed20 2023-10-03T19:16:39.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.602+0000 7f24d209f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24cc14d420 con 0x7f24cc06f050 2023-10-03T19:16:39.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.602+0000 7f24d209f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc146910 con 0x7f24cc0a6f00 2023-10-03T19:16:39.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.602+0000 7f24cbfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f24cc06f050 0x7f24cc0be010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:39.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.602+0000 7f24cbfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f24cc06f050 0x7f24cc0be010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34574/0 (socket says 172.21.15.45:34574) 2023-10-03T19:16:39.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.602+0000 7f24cbfff640 1 -- 172.21.15.45:0/45338228 learned_addr learned my addr 172.21.15.45:0/45338228 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:39.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.602+0000 7f24caffd640 1 --2- 172.21.15.45:0/45338228 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24cc0a6f00 0x7f24cc0bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:39.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.602+0000 7f24cbfff640 1 -- 172.21.15.45:0/45338228 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24cc0a6f00 msgr2=0x7f24cc0bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:39.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.602+0000 7f24cbfff640 1 --2- 172.21.15.45:0/45338228 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24cc0a6f00 0x7f24cc0bf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:39.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.602+0000 7f24cbfff640 1 -- 172.21.15.45:0/45338228 >> v1:172.21.15.79:6789/0 conn(0x7f24cc0bed20 legacy=0x7f24cc150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:39.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.602+0000 7f24cbfff640 1 -- 172.21.15.45:0/45338228 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24cc06e9f0 con 0x7f24cc06f050 2023-10-03T19:16:39.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.602+0000 7f24cbfff640 1 --2- 172.21.15.45:0/45338228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24cc06f050 0x7f24cc0be010 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f24c4009e50 tx=0x7f24c401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e8e9709ccc180 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:39.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24ca7fc640 1 -- 172.21.15.45:0/45338228 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c40a5640 con 0x7f24cc06f050 2023-10-03T19:16:39.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24ca7fc640 1 -- 172.21.15.45:0/45338228 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c40a57a0 con 0x7f24cc06f050 2023-10-03T19:16:39.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24ca7fc640 1 -- 172.21.15.45:0/45338228 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c40a5b30 con 0x7f24cc06f050 2023-10-03T19:16:39.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24d209f640 1 -- 172.21.15.45:0/45338228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24cc06f050 msgr2=0x7f24cc0be010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:39.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24d209f640 1 --2- 172.21.15.45:0/45338228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24cc06f050 0x7f24cc0be010 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f24c4009e50 tx=0x7f24c401c980 comp rx=0 tx=0).stop 2023-10-03T19:16:39.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24d209f640 1 -- 172.21.15.45:0/45338228 shutdown_connections 2023-10-03T19:16:39.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24d209f640 1 --2- 172.21.15.45:0/45338228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24cc06f050 0x7f24cc0be010 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:39.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24d209f640 1 --2- 172.21.15.45:0/45338228 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24cc0a6f00 0x7f24cc0bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:39.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24d209f640 1 -- 172.21.15.45:0/45338228 >> 172.21.15.45:0/45338228 conn(0x7f24cc06d990 msgr2=0x7f24cc06bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:39.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24d209f640 1 -- 172.21.15.45:0/45338228 shutdown_connections 2023-10-03T19:16:39.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24d209f640 1 -- 172.21.15.45:0/45338228 wait complete. 2023-10-03T19:16:39.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24d209f640 1 Processor -- start 2023-10-03T19:16:39.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24d209f640 1 -- start start 2023-10-03T19:16:39.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24d209f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24cc06f050 0x7f24cc1e4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:39.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24d209f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24cc0a6f00 0x7f24cc0b9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:39.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24d209f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24cc0bed20 0x7f24cc1e8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:39.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24d209f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc0ba6d0 con 0x7f24cc06f050 2023-10-03T19:16:39.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24d209f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc142bb0 con 0x7f24cc0a6f00 2023-10-03T19:16:39.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24d209f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc1e90e0 con 0x7f24cc0bed20 2023-10-03T19:16:39.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24cb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24cc06f050 0x7f24cc1e4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:39.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24cb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24cc06f050 0x7f24cc1e4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34578/0 (socket says 172.21.15.45:34578) 2023-10-03T19:16:39.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24cb7fe640 1 -- 172.21.15.45:0/1331625743 learned_addr learned my addr 172.21.15.45:0/1331625743 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:39.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24cbfff640 1 --2- 172.21.15.45:0/1331625743 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24cc0bed20 0x7f24cc1e8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:39.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24caffd640 1 --2- 172.21.15.45:0/1331625743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24cc0a6f00 0x7f24cc0b9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:39.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24cb7fe640 1 -- 172.21.15.45:0/1331625743 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24cc0bed20 msgr2=0x7f24cc1e8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:39.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24cb7fe640 1 --2- 172.21.15.45:0/1331625743 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24cc0bed20 0x7f24cc1e8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:39.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24cb7fe640 1 -- 172.21.15.45:0/1331625743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24cc0a6f00 msgr2=0x7f24cc0b9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:39.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24cb7fe640 1 --2- 172.21.15.45:0/1331625743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24cc0a6f00 0x7f24cc0b9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:39.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24cb7fe640 1 -- 172.21.15.45:0/1331625743 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c4009b30 con 0x7f24cc06f050 2023-10-03T19:16:39.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24cb7fe640 1 --2- 172.21.15.45:0/1331625743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24cc06f050 0x7f24cc1e4c20 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00c500 tx=0x7f24bc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:39.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24b3fff640 1 -- 172.21.15.45:0/1331625743 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc005220 con 0x7f24cc06f050 2023-10-03T19:16:39.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24b3fff640 1 -- 172.21.15.45:0/1331625743 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24bc005380 con 0x7f24cc06f050 2023-10-03T19:16:39.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24d209f640 1 -- 172.21.15.45:0/1331625743 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24cc0bf840 con 0x7f24cc06f050 2023-10-03T19:16:39.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24b3fff640 1 -- 172.21.15.45:0/1331625743 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc007270 con 0x7f24cc06f050 2023-10-03T19:16:39.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.606+0000 7f24d209f640 1 -- 172.21.15.45:0/1331625743 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24cc14f9b0 con 0x7f24cc06f050 2023-10-03T19:16:39.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.610+0000 7f24d209f640 1 -- 172.21.15.45:0/1331625743 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24cc0bf9d0 con 0x7f24cc06f050 2023-10-03T19:16:39.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.610+0000 7f24b3fff640 1 -- 172.21.15.45:0/1331625743 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f24bc0073d0 con 0x7f24cc06f050 2023-10-03T19:16:39.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.610+0000 7f24b3fff640 1 --2- 172.21.15.45:0/1331625743 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f24b80662b0 0x7f24b8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:39.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.610+0000 7f24b3fff640 1 -- 172.21.15.45:0/1331625743 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f24bc083180 con 0x7f24cc06f050 2023-10-03T19:16:39.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.610+0000 7f24caffd640 1 --2- 172.21.15.45:0/1331625743 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f24b80662b0 0x7f24b8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:39.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.610+0000 7f24caffd640 1 --2- 172.21.15.45:0/1331625743 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f24b80662b0 0x7f24b8068760 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f24cc1433e0 tx=0x7f24c0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:39.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.614+0000 7f24b3fff640 1 -- 172.21.15.45:0/1331625743 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f24bc0509c0 con 0x7f24cc06f050 2023-10-03T19:16:39.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.802+0000 7f24d209f640 1 -- 172.21.15.45:0/1331625743 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24cc04de80 con 0x7f24cc06f050 2023-10-03T19:16:39.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.802+0000 7f24b3fff640 1 -- 172.21.15.45:0/1331625743 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2772 (secure 0 0 0) 0x7f24bc053fe0 con 0x7f24cc06f050 2023-10-03T19:16:39.807 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:16:39.808 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2315858323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2315858323},{"type":"v1","addr":"172.21.15.79:6835","nonce":2315858323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1525989510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1525989510},{"type":"v1","addr":"172.21.15.45:6834","nonce":1525989510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2750808164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2750808164},{"type":"v1","addr":"172.21.15.45:6835","nonce":2750808164}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[]} 2023-10-03T19:16:39.808 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 25 2023-10-03T19:16:39.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.802+0000 7f24d209f640 1 -- 172.21.15.45:0/1331625743 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f24b80662b0 msgr2=0x7f24b8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:39.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.802+0000 7f24d209f640 1 --2- 172.21.15.45:0/1331625743 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f24b80662b0 0x7f24b8068760 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f24cc1433e0 tx=0x7f24c0008040 comp rx=0 tx=0).stop 2023-10-03T19:16:39.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.802+0000 7f24d209f640 1 -- 172.21.15.45:0/1331625743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24cc06f050 msgr2=0x7f24cc1e4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:39.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.802+0000 7f24d209f640 1 --2- 172.21.15.45:0/1331625743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24cc06f050 0x7f24cc1e4c20 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00c500 tx=0x7f24bc00c9c0 comp rx=0 tx=0).stop 2023-10-03T19:16:39.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.802+0000 7f24d209f640 1 -- 172.21.15.45:0/1331625743 shutdown_connections 2023-10-03T19:16:39.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.802+0000 7f24d209f640 1 --2- 172.21.15.45:0/1331625743 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f24b80662b0 0x7f24b8068760 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:39.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.802+0000 7f24d209f640 1 --2- 172.21.15.45:0/1331625743 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f24cc0bed20 0x7f24cc1e8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:39.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.802+0000 7f24d209f640 1 --2- 172.21.15.45:0/1331625743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24cc0a6f00 0x7f24cc0b9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:39.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.802+0000 7f24d209f640 1 --2- 172.21.15.45:0/1331625743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24cc06f050 0x7f24cc1e4c20 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:39.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.802+0000 7f24d209f640 1 -- 172.21.15.45:0/1331625743 >> 172.21.15.45:0/1331625743 conn(0x7f24cc06d990 msgr2=0x7f24cc14e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:39.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.802+0000 7f24d209f640 1 -- 172.21.15.45:0/1331625743 shutdown_connections 2023-10-03T19:16:39.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:39.802+0000 7f24d209f640 1 -- 172.21.15.45:0/1331625743 wait complete. 2023-10-03T19:16:39.827 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-03T19:16:39.827 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-03T19:16:39.828 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-03T19:16:39.828 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:16:39.828 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-03T19:16:39.828 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-03T19:16:39.828 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-03T19:16:39.828 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:16:39.829 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-03T19:16:39.829 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-03T19:16:39.829 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-03T19:16:39.829 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:16:39.838 INFO:tasks.ceph.mds.a:Stopped 2023-10-03T19:16:39.839 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-03T19:16:39.840 INFO:tasks.ceph.mds.c:Stopped 2023-10-03T19:16:39.841 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-03T19:16:39.842 INFO:tasks.ceph.mds.b:Stopped 2023-10-03T19:16:39.843 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-03T19:16:39.884 INFO:tasks.ceph.mds.a:Started 2023-10-03T19:16:40.392 DEBUG:teuthology.parallel:result is None 2023-10-03T19:16:40.393 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-10-03T19:16:40.394 INFO:tasks.ceph.mds.c:Started 2023-10-03T19:16:40.394 DEBUG:teuthology.parallel:result is None 2023-10-03T19:16:40.395 INFO:tasks.ceph.mds.b:Started 2023-10-03T19:16:40.395 DEBUG:teuthology.parallel:result is None 2023-10-03T19:16:40.395 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-03T19:16:40.470 INFO:tasks.ceph.mds.b.smithi079.stdout:starting mds.b at 2023-10-03T19:16:40.868 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-10-03T19:16:40.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.522+0000 7fcd34765640 1 Processor -- start 2023-10-03T19:16:40.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.522+0000 7fcd34765640 1 -- start start 2023-10-03T19:16:40.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.522+0000 7fcd34765640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd2c06aaf0 0x7fcd2c151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:40.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.522+0000 7fcd34765640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcd2c0bdbd0 0x7fcd2c152410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:40.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.522+0000 7fcd34765640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd2c06dbc0 con 0x7fcd2c06d350 2023-10-03T19:16:40.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.522+0000 7fcd34765640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd2c0bd980 con 0x7fcd2c0bdbd0 2023-10-03T19:16:40.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.522+0000 7fcd34765640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c0bd6a0 con 0x7fcd2c06aaf0 2023-10-03T19:16:40.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.522+0000 7fcd31d00640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcd2c0bdbd0 0x7fcd2c152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:40.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.522+0000 7fcd32501640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd2c06aaf0 0x7fcd2c151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:40.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.522+0000 7fcd32d02640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcd2c06d350 0x7fcd2c14bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:52036/0 (socket says 172.21.15.45:52036) 2023-10-03T19:16:40.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.522+0000 7fcd32d02640 1 -- 172.21.15.45:0/1029563218 learned_addr learned my addr 172.21.15.45:0/1029563218 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:40.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.522+0000 7fcd32501640 1 -- 172.21.15.45:0/1029563218 >> v2:172.21.15.79:3300/0 conn(0x7fcd2c0bdbd0 msgr2=0x7fcd2c152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:40.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.522+0000 7fcd32501640 1 --2- 172.21.15.45:0/1029563218 >> v2:172.21.15.79:3300/0 conn(0x7fcd2c0bdbd0 0x7fcd2c152410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:40.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.522+0000 7fcd32501640 1 -- 172.21.15.45:0/1029563218 >> v1:172.21.15.79:6789/0 conn(0x7fcd2c06d350 legacy=0x7fcd2c14bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:40.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.522+0000 7fcd32501640 1 -- 172.21.15.45:0/1029563218 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2c066140 con 0x7fcd2c06aaf0 2023-10-03T19:16:40.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.522+0000 7fcd31d00640 1 --2- 172.21.15.45:0/1029563218 >> v2:172.21.15.79:3300/0 conn(0x7fcd2c0bdbd0 0x7fcd2c152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:16:40.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.526+0000 7fcd32501640 1 --2- 172.21.15.45:0/1029563218 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd2c06aaf0 0x7fcd2c151ed0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c0097c0 tx=0x7fcd1c01ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7e3e1ff248890b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:40.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.526+0000 7fcd314ff640 1 -- 172.21.15.45:0/1029563218 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c0a8970 con 0x7fcd2c06aaf0 2023-10-03T19:16:40.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.526+0000 7fcd314ff640 1 -- 172.21.15.45:0/1029563218 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1c0a8ad0 con 0x7fcd2c06aaf0 2023-10-03T19:16:40.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.526+0000 7fcd314ff640 1 -- 172.21.15.45:0/1029563218 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c0a8e60 con 0x7fcd2c06aaf0 2023-10-03T19:16:40.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.526+0000 7fcd34765640 1 -- 172.21.15.45:0/1029563218 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd2c06aaf0 msgr2=0x7fcd2c151ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:40.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.526+0000 7fcd34765640 1 --2- 172.21.15.45:0/1029563218 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd2c06aaf0 0x7fcd2c151ed0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c0097c0 tx=0x7fcd1c01ec70 comp rx=0 tx=0).stop 2023-10-03T19:16:40.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.526+0000 7fcd34765640 1 -- 172.21.15.45:0/1029563218 shutdown_connections 2023-10-03T19:16:40.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.526+0000 7fcd34765640 1 --2- 172.21.15.45:0/1029563218 >> v2:172.21.15.79:3300/0 conn(0x7fcd2c0bdbd0 0x7fcd2c152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:40.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.526+0000 7fcd34765640 1 --2- 172.21.15.45:0/1029563218 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd2c06aaf0 0x7fcd2c151ed0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:41.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.526+0000 7fcd34765640 1 -- 172.21.15.45:0/1029563218 >> 172.21.15.45:0/1029563218 conn(0x7fcd2c0c1600 msgr2=0x7fcd2c0c1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:41.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.526+0000 7fcd34765640 1 -- 172.21.15.45:0/1029563218 shutdown_connections 2023-10-03T19:16:41.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.526+0000 7fcd34765640 1 -- 172.21.15.45:0/1029563218 wait complete. 2023-10-03T19:16:41.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.526+0000 7fcd34765640 1 Processor -- start 2023-10-03T19:16:41.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.526+0000 7fcd34765640 1 -- start start 2023-10-03T19:16:41.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.526+0000 7fcd34765640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd2c06aaf0 0x7fcd2c14c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:41.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.526+0000 7fcd34765640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd2c06d350 0x7fcd2c0716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:41.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.526+0000 7fcd34765640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd2c0bdbd0 0x7fcd2c14d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:41.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.526+0000 7fcd34765640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c14cf10 con 0x7fcd2c06d350 2023-10-03T19:16:41.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.526+0000 7fcd34765640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c0c1420 con 0x7fcd2c0bdbd0 2023-10-03T19:16:41.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.526+0000 7fcd34765640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c14e4d0 con 0x7fcd2c06aaf0 2023-10-03T19:16:41.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.526+0000 7fcd31d00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd2c06d350 0x7fcd2c0716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:41.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.526+0000 7fcd31d00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd2c06d350 0x7fcd2c0716a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34608/0 (socket says 172.21.15.45:34608) 2023-10-03T19:16:41.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.526+0000 7fcd32501640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd2c06aaf0 0x7fcd2c14c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:41.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.526+0000 7fcd31d00640 1 -- 172.21.15.45:0/3319654512 learned_addr learned my addr 172.21.15.45:0/3319654512 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:41.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.526+0000 7fcd32d02640 1 --2- 172.21.15.45:0/3319654512 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd2c0bdbd0 0x7fcd2c14d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:41.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.526+0000 7fcd31d00640 1 -- 172.21.15.45:0/3319654512 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd2c06aaf0 msgr2=0x7fcd2c14c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:41.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.526+0000 7fcd31d00640 1 --2- 172.21.15.45:0/3319654512 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd2c06aaf0 0x7fcd2c14c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:41.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.526+0000 7fcd31d00640 1 -- 172.21.15.45:0/3319654512 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd2c0bdbd0 msgr2=0x7fcd2c14d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:41.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.526+0000 7fcd31d00640 1 --2- 172.21.15.45:0/3319654512 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd2c0bdbd0 0x7fcd2c14d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:41.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.526+0000 7fcd31d00640 1 -- 172.21.15.45:0/3319654512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd20009a70 con 0x7fcd2c06d350 2023-10-03T19:16:41.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.530+0000 7fcd31d00640 1 --2- 172.21.15.45:0/3319654512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd2c06d350 0x7fcd2c0716a0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fcd20009ec0 tx=0x7fcd2000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:41.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.530+0000 7fcd2affd640 1 -- 172.21.15.45:0/3319654512 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd20014680 con 0x7fcd2c06d350 2023-10-03T19:16:41.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.530+0000 7fcd2affd640 1 -- 172.21.15.45:0/3319654512 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2000f040 con 0x7fcd2c06d350 2023-10-03T19:16:41.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.530+0000 7fcd34765640 1 -- 172.21.15.45:0/3319654512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd1c009420 con 0x7fcd2c06d350 2023-10-03T19:16:41.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.530+0000 7fcd2affd640 1 -- 172.21.15.45:0/3319654512 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd20014a00 con 0x7fcd2c06d350 2023-10-03T19:16:41.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.530+0000 7fcd34765640 1 -- 172.21.15.45:0/3319654512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2c06e010 con 0x7fcd2c06d350 2023-10-03T19:16:41.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.530+0000 7fcd34765640 1 -- 172.21.15.45:0/3319654512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd2c066420 con 0x7fcd2c06d350 2023-10-03T19:16:41.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.530+0000 7fcd2affd640 1 -- 172.21.15.45:0/3319654512 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcd20014b60 con 0x7fcd2c06d350 2023-10-03T19:16:41.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.530+0000 7fcd2affd640 1 --2- 172.21.15.45:0/3319654512 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcd18066280 0x7fcd18068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:41.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.530+0000 7fcd2affd640 1 -- 172.21.15.45:0/3319654512 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fcd200848d0 con 0x7fcd2c06d350 2023-10-03T19:16:41.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.530+0000 7fcd32501640 1 --2- 172.21.15.45:0/3319654512 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcd18066280 0x7fcd18068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:41.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.530+0000 7fcd32501640 1 --2- 172.21.15.45:0/3319654512 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcd18066280 0x7fcd18068730 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c0b2000 tx=0x7fcd1c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:41.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.534+0000 7fcd2affd640 1 -- 172.21.15.45:0/3319654512 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fcd20052100 con 0x7fcd2c06d350 2023-10-03T19:16:41.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:40.702+0000 7fcd34765640 1 -- 172.21.15.45:0/3319654512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fcd2c14c7b0 con 0x7fcd2c06d350 2023-10-03T19:16:41.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.626+0000 7fcd2affd640 1 -- 172.21.15.45:0/3319654512 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v57) v1 ==== 97+0+0 (secure 0 0 0) 0x7fcd20055720 con 0x7fcd2c06d350 2023-10-03T19:16:41.818 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-10-03T19:16:41.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.630+0000 7fcd34765640 1 -- 172.21.15.45:0/3319654512 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcd18066280 msgr2=0x7fcd18068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.630+0000 7fcd34765640 1 --2- 172.21.15.45:0/3319654512 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcd18066280 0x7fcd18068730 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c0b2000 tx=0x7fcd1c008040 comp rx=0 tx=0).stop 2023-10-03T19:16:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.630+0000 7fcd34765640 1 -- 172.21.15.45:0/3319654512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd2c06d350 msgr2=0x7fcd2c0716a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.630+0000 7fcd34765640 1 --2- 172.21.15.45:0/3319654512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd2c06d350 0x7fcd2c0716a0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fcd20009ec0 tx=0x7fcd2000c490 comp rx=0 tx=0).stop 2023-10-03T19:16:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.630+0000 7fcd34765640 1 -- 172.21.15.45:0/3319654512 shutdown_connections 2023-10-03T19:16:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.630+0000 7fcd34765640 1 --2- 172.21.15.45:0/3319654512 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcd18066280 0x7fcd18068730 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.630+0000 7fcd34765640 1 --2- 172.21.15.45:0/3319654512 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd2c0bdbd0 0x7fcd2c14d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.630+0000 7fcd34765640 1 --2- 172.21.15.45:0/3319654512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd2c06d350 0x7fcd2c0716a0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:41.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.630+0000 7fcd34765640 1 --2- 172.21.15.45:0/3319654512 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd2c06aaf0 0x7fcd2c14c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:41.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.630+0000 7fcd34765640 1 -- 172.21.15.45:0/3319654512 >> 172.21.15.45:0/3319654512 conn(0x7fcd2c0c1600 msgr2=0x7fcd2c0bcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:41.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.630+0000 7fcd34765640 1 -- 172.21.15.45:0/3319654512 shutdown_connections 2023-10-03T19:16:41.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.630+0000 7fcd34765640 1 -- 172.21.15.45:0/3319654512 wait complete. 2023-10-03T19:16:41.834 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-03T19:16:41.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.966+0000 7f7b16056640 1 Processor -- start 2023-10-03T19:16:41.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.966+0000 7f7b16056640 1 -- start start 2023-10-03T19:16:41.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.966+0000 7f7b16056640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7b100bcf70 0x7f7b1006ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:41.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.966+0000 7f7b16056640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b1014f290 0x7f7b10159190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:41.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.966+0000 7f7b16056640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b10069ad0 con 0x7f7b100bf6c0 2023-10-03T19:16:41.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.966+0000 7f7b16056640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b100bda90 con 0x7f7b100bcf70 2023-10-03T19:16:41.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.966+0000 7f7b16056640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b10069db0 con 0x7f7b1014f290 2023-10-03T19:16:41.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b0f7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7b100bf6c0 0x7f7b1006e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40588/0 (socket says 172.21.15.45:40588) 2023-10-03T19:16:41.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b0f7fe640 1 -- 172.21.15.45:0/3450777785 learned_addr learned my addr 172.21.15.45:0/3450777785 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:41.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b06ffd640 1 --2- 172.21.15.45:0/3450777785 >> v2:172.21.15.79:3300/0 conn(0x7f7b100bcf70 0x7f7b1006ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:41.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b0ffff640 1 --2- 172.21.15.45:0/3450777785 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b1014f290 0x7f7b10159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:41.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b0effd640 1 -- 172.21.15.45:0/3450777785 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 310524158 0 0) 0x7f7b10069ad0 con 0x7f7b100bf6c0 2023-10-03T19:16:41.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b0effd640 1 -- 172.21.15.45:0/3450777785 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7afc003530 con 0x7f7b100bf6c0 2023-10-03T19:16:41.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b0effd640 1 -- 172.21.15.45:0/3450777785 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1714975255 0 0) 0x7f7afc003530 con 0x7f7b100bf6c0 2023-10-03T19:16:41.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b0effd640 1 -- 172.21.15.45:0/3450777785 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b1014f290 msgr2=0x7f7b10159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:41.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b0effd640 1 --2- 172.21.15.45:0/3450777785 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b1014f290 0x7f7b10159190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:41.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b0effd640 1 -- 172.21.15.45:0/3450777785 >> v2:172.21.15.79:3300/0 conn(0x7f7b100bcf70 msgr2=0x7f7b1006ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:41.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b0effd640 1 --2- 172.21.15.45:0/3450777785 >> v2:172.21.15.79:3300/0 conn(0x7f7b100bcf70 0x7f7b1006ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:41.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b0effd640 1 -- 172.21.15.45:0/3450777785 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1014f710 con 0x7f7b100bf6c0 2023-10-03T19:16:41.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b0effd640 1 -- 172.21.15.45:0/3450777785 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f7b00001680 con 0x7f7b100bf6c0 2023-10-03T19:16:41.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b0effd640 1 -- 172.21.15.45:0/3450777785 >> v1:172.21.15.45:6789/0 conn(0x7f7b100bf6c0 legacy=0x7f7b1006e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:41.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b0effd640 1 --2- 172.21.15.45:0/3450777785 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b1014f290 0x7f7afc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:41.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b0effd640 1 --2- 172.21.15.45:0/3450777785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7afc003f00 0x7f7afc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:41.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b0effd640 1 --2- 172.21.15.45:0/3450777785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7afc004d10 0x7f7afc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:41.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b0effd640 1 -- 172.21.15.45:0/3450777785 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b10069db0 con 0x7f7afc003f00 2023-10-03T19:16:41.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b0effd640 1 -- 172.21.15.45:0/3450777785 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc00b990 con 0x7f7afc004d10 2023-10-03T19:16:41.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b0effd640 1 -- 172.21.15.45:0/3450777785 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc00bb00 con 0x7f7b1014f290 2023-10-03T19:16:41.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b06ffd640 1 --2- 172.21.15.45:0/3450777785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7afc003f00 0x7f7afc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:41.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b0f7fe640 1 --2- 172.21.15.45:0/3450777785 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b1014f290 0x7f7afc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:41.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b0ffff640 1 --2- 172.21.15.45:0/3450777785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7afc004d10 0x7f7afc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:41.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b06ffd640 1 -- 172.21.15.45:0/3450777785 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b1014f290 msgr2=0x7f7afc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:41.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b06ffd640 1 --2- 172.21.15.45:0/3450777785 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b1014f290 0x7f7afc003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:41.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b06ffd640 1 -- 172.21.15.45:0/3450777785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7afc004d10 msgr2=0x7f7afc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:41.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b06ffd640 1 --2- 172.21.15.45:0/3450777785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7afc004d10 0x7f7afc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:41.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b06ffd640 1 -- 172.21.15.45:0/3450777785 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7afc003530 con 0x7f7afc003f00 2023-10-03T19:16:41.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b0ffff640 1 --2- 172.21.15.45:0/3450777785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7afc004d10 0x7f7afc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:41.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b06ffd640 1 --2- 172.21.15.45:0/3450777785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7afc003f00 0x7f7afc0047d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7af8009ae0 tx=0x7f7af801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eedcb066fa1379ec server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:41.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b0effd640 1 -- 172.21.15.45:0/3450777785 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af80a5640 con 0x7f7afc003f00 2023-10-03T19:16:41.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b0effd640 1 -- 172.21.15.45:0/3450777785 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af80a57a0 con 0x7f7afc003f00 2023-10-03T19:16:41.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.970+0000 7f7b0effd640 1 -- 172.21.15.45:0/3450777785 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af80a5b50 con 0x7f7afc003f00 2023-10-03T19:16:41.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b16056640 1 -- 172.21.15.45:0/3450777785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7afc003f00 msgr2=0x7f7afc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:41.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b16056640 1 --2- 172.21.15.45:0/3450777785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7afc003f00 0x7f7afc0047d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7af8009ae0 tx=0x7f7af801ca30 comp rx=0 tx=0).stop 2023-10-03T19:16:41.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b0ffff640 1 -- 172.21.15.45:0/3450777785 reap_dead start 2023-10-03T19:16:41.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b16056640 1 -- 172.21.15.45:0/3450777785 shutdown_connections 2023-10-03T19:16:41.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b16056640 1 -- 172.21.15.45:0/3450777785 >> 172.21.15.45:0/3450777785 conn(0x7f7b10071060 msgr2=0x7f7b10071430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:41.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b16056640 1 -- 172.21.15.45:0/3450777785 shutdown_connections 2023-10-03T19:16:41.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b16056640 1 -- 172.21.15.45:0/3450777785 wait complete. 2023-10-03T19:16:41.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b16056640 1 Processor -- start 2023-10-03T19:16:41.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b16056640 1 -- start start 2023-10-03T19:16:41.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b16056640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7afc003f00 0x7f7b101470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:41.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b16056640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b100c2060 0x7f7b10147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:41.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b16056640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b10141780 0x7f7b10148050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:41.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b16056640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b10155ba0 con 0x7f7b100c2060 2023-10-03T19:16:41.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b16056640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b100c1af0 con 0x7f7afc003f00 2023-10-03T19:16:41.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b16056640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b10147610 con 0x7f7b10141780 2023-10-03T19:16:41.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b06ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b100c2060 0x7f7b10147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:41.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b06ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b100c2060 0x7f7b10147b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34636/0 (socket says 172.21.15.45:34636) 2023-10-03T19:16:41.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b06ffd640 1 -- 172.21.15.45:0/1651738871 learned_addr learned my addr 172.21.15.45:0/1651738871 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:41.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b0f7fe640 1 --2- 172.21.15.45:0/1651738871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7afc003f00 0x7f7b101470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:41.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b0ffff640 1 --2- 172.21.15.45:0/1651738871 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b10141780 0x7f7b10148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:41.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b06ffd640 1 -- 172.21.15.45:0/1651738871 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b10141780 msgr2=0x7f7b10148050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:41.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b06ffd640 1 --2- 172.21.15.45:0/1651738871 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b10141780 0x7f7b10148050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:41.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b06ffd640 1 -- 172.21.15.45:0/1651738871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7afc003f00 msgr2=0x7f7b101470d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:41.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b06ffd640 1 --2- 172.21.15.45:0/1651738871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7afc003f00 0x7f7b101470d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:41.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b06ffd640 1 -- 172.21.15.45:0/1651738871 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b100bd720 con 0x7f7b100c2060 2023-10-03T19:16:41.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b0ffff640 1 --2- 172.21.15.45:0/1651738871 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b10141780 0x7f7b10148050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:41.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b06ffd640 1 --2- 172.21.15.45:0/1651738871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b100c2060 0x7f7b10147b10 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7af8009a00 tx=0x7f7afc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:41.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b0cff9640 1 -- 172.21.15.45:0/1651738871 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af80a5640 con 0x7f7b100c2060 2023-10-03T19:16:41.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b0cff9640 1 -- 172.21.15.45:0/1651738871 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af8004020 con 0x7f7b100c2060 2023-10-03T19:16:41.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b16056640 1 -- 172.21.15.45:0/1651738871 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b1006ead0 con 0x7f7b100c2060 2023-10-03T19:16:41.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b0cff9640 1 -- 172.21.15.45:0/1651738871 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af80043b0 con 0x7f7b100c2060 2023-10-03T19:16:41.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.974+0000 7f7b16056640 1 -- 172.21.15.45:0/1651738871 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b1006b530 con 0x7f7b100c2060 2023-10-03T19:16:41.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.978+0000 7f7b16056640 1 -- 172.21.15.45:0/1651738871 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b10155ff0 con 0x7f7b100c2060 2023-10-03T19:16:41.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.978+0000 7f7b0cff9640 1 -- 172.21.15.45:0/1651738871 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7af80b4040 con 0x7f7b100c2060 2023-10-03T19:16:41.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.978+0000 7f7b0cff9640 1 --2- 172.21.15.45:0/1651738871 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7af00662b0 0x7f7af0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:41.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.978+0000 7f7b0cff9640 1 -- 172.21.15.45:0/1651738871 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7af811d910 con 0x7f7b100c2060 2023-10-03T19:16:41.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.978+0000 7f7b0f7fe640 1 --2- 172.21.15.45:0/1651738871 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7af00662b0 0x7f7af0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:41.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.978+0000 7f7b0f7fe640 1 --2- 172.21.15.45:0/1651738871 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7af00662b0 0x7f7af0068760 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7b00001ec0 tx=0x7f7b00009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:41.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:41.982+0000 7f7b0cff9640 1 -- 172.21.15.45:0/1651738871 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7af80eb220 con 0x7f7b100c2060 2023-10-03T19:16:42.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.190+0000 7f7b16056640 1 -- 172.21.15.45:0/1651738871 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7b10155ba0 con 0x7f7b100c2060 2023-10-03T19:16:42.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.190+0000 7f7b0cff9640 1 -- 172.21.15.45:0/1651738871 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+4440 (secure 0 0 0) 0x7f7af80ee840 con 0x7f7b100c2060 2023-10-03T19:16:42.475 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:16:42.475 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-03T19:16:42.475 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-10-03T19:16:42.475 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:16:42.476 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-10-03T19:16:42.476 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlfyzhExAABLhtkQEZuiLwovBSO0kuAA==", 2023-10-03T19:16:42.476 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:16:42.476 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:16:42.476 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-03T19:16:42.476 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-03T19:16:42.476 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:16:42.476 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:16:42.476 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:16:42.476 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:16:42.476 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-10-03T19:16:42.477 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlzM8pIBAAMie9jpxS/xt2cymMpyJmiQ==", 2023-10-03T19:16:42.477 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:16:42.477 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:16:42.477 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-03T19:16:42.477 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-03T19:16:42.477 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:16:42.477 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:16:42.477 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:16:42.477 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:16:42.477 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-10-03T19:16:42.478 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlAsGOHBAAIHprnd9orKMQjzkNQZz94A==", 2023-10-03T19:16:42.478 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:16:42.478 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:16:42.478 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-03T19:16:42.478 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-03T19:16:42.478 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:16:42.478 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:16:42.478 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:16:42.478 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:16:42.478 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-10-03T19:16:42.479 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBmZxxlb0zQLRAA3z+f4/jsLTLUmFg/WOD/Xg==", 2023-10-03T19:16:42.479 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:16:42.479 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:16:42.479 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:16:42.479 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:16:42.479 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:16:42.479 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:16:42.479 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:16:42.479 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-10-03T19:16:42.479 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBpZxxlTjtZNRAA3HFqXjGLO7JoX+GBegGfqw==", 2023-10-03T19:16:42.479 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:16:42.480 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:16:42.480 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:16:42.480 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:16:42.480 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:16:42.480 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:16:42.480 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:16:42.480 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-10-03T19:16:42.480 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBtZxxld6kUBBAATcGPrxBbPLswrUHihB7AgQ==", 2023-10-03T19:16:42.480 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:16:42.480 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:16:42.481 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:16:42.481 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:16:42.481 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:16:42.481 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:16:42.481 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:16:42.481 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-10-03T19:16:42.481 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBwZxxlWUL3DBAAk4TW6N5mpjjyP7QgQAIuDw==", 2023-10-03T19:16:42.481 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:16:42.481 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:16:42.481 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:16:42.482 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:16:42.482 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:16:42.482 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:16:42.482 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:16:42.482 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-10-03T19:16:42.482 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQB2ZxxlK3KNIhAAjhvxAU0shg+5PbJfq1LEog==", 2023-10-03T19:16:42.482 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:16:42.482 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:16:42.482 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:16:42.482 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:16:42.483 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:16:42.483 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:16:42.483 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:16:42.483 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-10-03T19:16:42.483 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQB5ZxxlRAxuKhAA5ma3eAt3kkukdhgZN4wwEg==", 2023-10-03T19:16:42.483 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:16:42.483 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:16:42.483 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:16:42.483 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:16:42.484 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:16:42.484 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:16:42.484 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:16:42.484 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-10-03T19:16:42.484 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQB8ZxxlkQqOMxAAuKGy7vJQLUDsqgjPVtWMWg==", 2023-10-03T19:16:42.484 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:16:42.484 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:16:42.484 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:16:42.485 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:16:42.485 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:16:42.485 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:16:42.485 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:16:42.485 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-10-03T19:16:42.485 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCAZxxl65r/ABAAeWtP7nMLVm5NBU4vWQ6ceg==", 2023-10-03T19:16:42.485 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:16:42.485 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:16:42.485 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:16:42.485 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:16:42.486 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:16:42.486 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:16:42.486 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:16:42.486 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-10-03T19:16:42.486 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlg5PgJRAAvvN5Xrw/ZW4rSdJ1/adnzA==", 2023-10-03T19:16:42.486 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:16:42.486 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:16:42.486 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow r", 2023-10-03T19:16:42.486 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-03T19:16:42.487 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:16:42.487 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:16:42.487 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:16:42.487 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-10-03T19:16:42.487 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlKkW+KRAALzVyQ+iTWuD5FMLDKXNVTg==", 2023-10-03T19:16:42.487 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:16:42.487 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:16:42.487 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-10-03T19:16:42.487 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-10-03T19:16:42.488 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-10-03T19:16:42.488 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:16:42.488 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:16:42.488 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:16:42.488 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-10-03T19:16:42.488 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBkZxxldHb4LxAAc/oJcXFjNgH5Wxwv04WHgw==", 2023-10-03T19:16:42.488 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:16:42.488 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-10-03T19:16:42.488 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-03T19:16:42.488 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-03T19:16:42.488 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:16:42.489 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:16:42.489 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:16:42.489 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:16:42.489 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-10-03T19:16:42.489 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxl4txNEBAAonNqY2PmtF0vZGFmvzxIKw==", 2023-10-03T19:16:42.489 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:16:42.489 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-10-03T19:16:42.489 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-10-03T19:16:42.489 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:16:42.489 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:16:42.582 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:16:42.582 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:16:42.582 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-10-03T19:16:42.582 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlUmKhDRAA7UKlGP9q9aKsk+J+nTxrUA==", 2023-10-03T19:16:42.582 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:16:42.582 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-10-03T19:16:42.583 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-10-03T19:16:42.583 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:16:42.583 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:16:42.583 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:16:42.583 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-10-03T19:16:42.583 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-03T19:16:42.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.190+0000 7f7b16056640 1 -- 172.21.15.45:0/1651738871 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7af00662b0 msgr2=0x7f7af0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:42.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.190+0000 7f7b16056640 1 --2- 172.21.15.45:0/1651738871 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7af00662b0 0x7f7af0068760 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7b00001ec0 tx=0x7f7b00009040 comp rx=0 tx=0).stop 2023-10-03T19:16:42.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.190+0000 7f7b16056640 1 -- 172.21.15.45:0/1651738871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b100c2060 msgr2=0x7f7b10147b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:42.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.190+0000 7f7b16056640 1 --2- 172.21.15.45:0/1651738871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b100c2060 0x7f7b10147b10 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7af8009a00 tx=0x7f7afc005800 comp rx=0 tx=0).stop 2023-10-03T19:16:42.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.190+0000 7f7b16056640 1 -- 172.21.15.45:0/1651738871 shutdown_connections 2023-10-03T19:16:42.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.190+0000 7f7b16056640 1 --2- 172.21.15.45:0/1651738871 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7af00662b0 0x7f7af0068760 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:42.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.190+0000 7f7b16056640 1 --2- 172.21.15.45:0/1651738871 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b10141780 0x7f7b10148050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:42.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.190+0000 7f7b16056640 1 --2- 172.21.15.45:0/1651738871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b100c2060 0x7f7b10147b10 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:42.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.190+0000 7f7b16056640 1 --2- 172.21.15.45:0/1651738871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7afc003f00 0x7f7b101470d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:42.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.190+0000 7f7b16056640 1 -- 172.21.15.45:0/1651738871 >> 172.21.15.45:0/1651738871 conn(0x7f7b10071060 msgr2=0x7f7b10071430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:42.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.190+0000 7f7b16056640 1 -- 172.21.15.45:0/1651738871 shutdown_connections 2023-10-03T19:16:42.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.190+0000 7f7b16056640 1 -- 172.21.15.45:0/1651738871 wait complete. 2023-10-03T19:16:42.586 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:16:42.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.714+0000 7fcf0fa4f640 1 Processor -- start 2023-10-03T19:16:42.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.714+0000 7fcf0fa4f640 1 -- start start 2023-10-03T19:16:42.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.718+0000 7fcf0fa4f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcf080bf370 0x7fcf08149760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:42.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.718+0000 7fcf0fa4f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcf080a7100 0x7fcf08149ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:42.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.718+0000 7fcf0fa4f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf0806f5f0 0x7fcf0814cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:42.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.718+0000 7fcf0fa4f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf080bebc0 con 0x7fcf080a7100 2023-10-03T19:16:42.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.718+0000 7fcf0fa4f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf0814c770 con 0x7fcf080bf370 2023-10-03T19:16:42.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.718+0000 7fcf0fa4f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0806efe0 con 0x7fcf0806f5f0 2023-10-03T19:16:42.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.718+0000 7fcf0cfea640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcf080a7100 0x7fcf08149ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:42.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.718+0000 7fcf0cfea640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcf080a7100 0x7fcf08149ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34646/0 (socket says 172.21.15.45:34646) 2023-10-03T19:16:42.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.718+0000 7fcf0cfea640 1 -- 172.21.15.45:0/1862431575 learned_addr learned my addr 172.21.15.45:0/1862431575 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:42.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.718+0000 7fcf0d7eb640 1 --2- 172.21.15.45:0/1862431575 >> v2:172.21.15.79:3300/0 conn(0x7fcf080bf370 0x7fcf08149760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:42.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.718+0000 7fcf0dfec640 1 --2- 172.21.15.45:0/1862431575 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf0806f5f0 0x7fcf0814cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:42.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.718+0000 7fcf0cfea640 1 -- 172.21.15.45:0/1862431575 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf0806f5f0 msgr2=0x7fcf0814cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:42.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.718+0000 7fcf0cfea640 1 --2- 172.21.15.45:0/1862431575 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf0806f5f0 0x7fcf0814cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:42.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.718+0000 7fcf0cfea640 1 -- 172.21.15.45:0/1862431575 >> v2:172.21.15.79:3300/0 conn(0x7fcf080bf370 msgr2=0x7fcf08149760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:42.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.718+0000 7fcf0cfea640 1 --2- 172.21.15.45:0/1862431575 >> v2:172.21.15.79:3300/0 conn(0x7fcf080bf370 0x7fcf08149760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:42.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.718+0000 7fcf0cfea640 1 -- 172.21.15.45:0/1862431575 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0806f2c0 con 0x7fcf080a7100 2023-10-03T19:16:42.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.718+0000 7fcf0cfea640 1 --2- 172.21.15.45:0/1862431575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf080a7100 0x7fcf08149ca0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fcf0806ebb0 tx=0x7fcef801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26997a1e31db5190 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:42.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcefffff640 1 -- 172.21.15.45:0/1862431575 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef80ab5f0 con 0x7fcf080a7100 2023-10-03T19:16:42.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcefffff640 1 -- 172.21.15.45:0/1862431575 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef80ab750 con 0x7fcf080a7100 2023-10-03T19:16:42.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcefffff640 1 -- 172.21.15.45:0/1862431575 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef80abae0 con 0x7fcf080a7100 2023-10-03T19:16:42.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcf0fa4f640 1 -- 172.21.15.45:0/1862431575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf080a7100 msgr2=0x7fcf08149ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:42.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcf0fa4f640 1 --2- 172.21.15.45:0/1862431575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf080a7100 0x7fcf08149ca0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fcf0806ebb0 tx=0x7fcef801c470 comp rx=0 tx=0).stop 2023-10-03T19:16:42.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcf0fa4f640 1 -- 172.21.15.45:0/1862431575 shutdown_connections 2023-10-03T19:16:42.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcf0fa4f640 1 --2- 172.21.15.45:0/1862431575 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf0806f5f0 0x7fcf0814cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:42.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcf0fa4f640 1 --2- 172.21.15.45:0/1862431575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf080a7100 0x7fcf08149ca0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:42.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcf0fa4f640 1 --2- 172.21.15.45:0/1862431575 >> v2:172.21.15.79:3300/0 conn(0x7fcf080bf370 0x7fcf08149760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:42.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcf0fa4f640 1 -- 172.21.15.45:0/1862431575 >> 172.21.15.45:0/1862431575 conn(0x7fcf0806bce0 msgr2=0x7fcf0806c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:42.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcf0fa4f640 1 -- 172.21.15.45:0/1862431575 shutdown_connections 2023-10-03T19:16:42.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcf0fa4f640 1 -- 172.21.15.45:0/1862431575 wait complete. 2023-10-03T19:16:42.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcf0fa4f640 1 Processor -- start 2023-10-03T19:16:42.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcf0fa4f640 1 -- start start 2023-10-03T19:16:42.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcf0fa4f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf0806f5f0 0x7fcf080bbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:42.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcf0fa4f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf080a7100 0x7fcf080a2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:42.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcf0fa4f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf080bf370 0x7fcf080a34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:42.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcf0fa4f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf08147120 con 0x7fcf080bf370 2023-10-03T19:16:42.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcf0fa4f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf081430b0 con 0x7fcf080a7100 2023-10-03T19:16:42.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcf0fa4f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf080bc1b0 con 0x7fcf0806f5f0 2023-10-03T19:16:42.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcf0dfec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf080bf370 0x7fcf080a34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:42.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcf0dfec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf080bf370 0x7fcf080a34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34658/0 (socket says 172.21.15.45:34658) 2023-10-03T19:16:42.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcf0dfec640 1 -- 172.21.15.45:0/897882380 learned_addr learned my addr 172.21.15.45:0/897882380 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:42.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcf0d7eb640 1 --2- 172.21.15.45:0/897882380 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf0806f5f0 0x7fcf080bbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:42.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcf0cfea640 1 --2- 172.21.15.45:0/897882380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf080a7100 0x7fcf080a2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:42.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcf0dfec640 1 -- 172.21.15.45:0/897882380 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf0806f5f0 msgr2=0x7fcf080bbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:42.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcf0dfec640 1 --2- 172.21.15.45:0/897882380 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf0806f5f0 0x7fcf080bbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:42.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcf0dfec640 1 -- 172.21.15.45:0/897882380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf080a7100 msgr2=0x7fcf080a2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:42.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcf0dfec640 1 --2- 172.21.15.45:0/897882380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf080a7100 0x7fcf080a2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:42.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcf0dfec640 1 -- 172.21.15.45:0/897882380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef80094d0 con 0x7fcf080bf370 2023-10-03T19:16:42.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcf0dfec640 1 --2- 172.21.15.45:0/897882380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf080bf370 0x7fcf080a34e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fcf00007e90 tx=0x7fcf0000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:42.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcefdffb640 1 -- 172.21.15.45:0/897882380 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf00014420 con 0x7fcf080bf370 2023-10-03T19:16:42.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcefdffb640 1 -- 172.21.15.45:0/897882380 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf000145a0 con 0x7fcf080bf370 2023-10-03T19:16:42.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcefdffb640 1 -- 172.21.15.45:0/897882380 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf00014950 con 0x7fcf080bf370 2023-10-03T19:16:42.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcf0fa4f640 1 -- 172.21.15.45:0/897882380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf080bf8d0 con 0x7fcf080bf370 2023-10-03T19:16:42.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.722+0000 7fcf0fa4f640 1 -- 172.21.15.45:0/897882380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf080bf740 con 0x7fcf080bf370 2023-10-03T19:16:42.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.726+0000 7fcf0fa4f640 1 -- 172.21.15.45:0/897882380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf08071930 con 0x7fcf080bf370 2023-10-03T19:16:42.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.726+0000 7fcefdffb640 1 -- 172.21.15.45:0/897882380 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcf00014ab0 con 0x7fcf080bf370 2023-10-03T19:16:42.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.726+0000 7fcefdffb640 1 --2- 172.21.15.45:0/897882380 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fceec0662b0 0x7fceec068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:42.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.726+0000 7fcefdffb640 1 -- 172.21.15.45:0/897882380 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcf00084350 con 0x7fcf080bf370 2023-10-03T19:16:42.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.726+0000 7fcf0d7eb640 1 --2- 172.21.15.45:0/897882380 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fceec0662b0 0x7fceec068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:42.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.726+0000 7fcf0d7eb640 1 --2- 172.21.15.45:0/897882380 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fceec0662b0 0x7fceec068760 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcf0400b930 tx=0x7fcf04008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:42.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.730+0000 7fcefdffb640 1 -- 172.21.15.45:0/897882380 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fcf00051a80 con 0x7fcf080bf370 2023-10-03T19:16:42.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.882+0000 7fcf0fa4f640 1 -- 172.21.15.45:0/897882380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf0804de80 con 0x7fcf080bf370 2023-10-03T19:16:42.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.886+0000 7fcefdffb640 1 -- 172.21.15.45:0/897882380 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+14591 (secure 0 0 0) 0x7fcf000550a0 con 0x7fcf080bf370 2023-10-03T19:16:42.890 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:16:42.891 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":57,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:16:41.623164+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:16:42.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.886+0000 7fcf0fa4f640 1 -- 172.21.15.45:0/897882380 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fceec0662b0 msgr2=0x7fceec068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:42.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.886+0000 7fcf0fa4f640 1 --2- 172.21.15.45:0/897882380 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fceec0662b0 0x7fceec068760 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcf0400b930 tx=0x7fcf04008040 comp rx=0 tx=0).stop 2023-10-03T19:16:42.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.886+0000 7fcf0fa4f640 1 -- 172.21.15.45:0/897882380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf080bf370 msgr2=0x7fcf080a34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:42.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.886+0000 7fcf0fa4f640 1 --2- 172.21.15.45:0/897882380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf080bf370 0x7fcf080a34e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fcf00007e90 tx=0x7fcf0000e4b0 comp rx=0 tx=0).stop 2023-10-03T19:16:42.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.886+0000 7fcf0fa4f640 1 -- 172.21.15.45:0/897882380 shutdown_connections 2023-10-03T19:16:42.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.886+0000 7fcf0fa4f640 1 --2- 172.21.15.45:0/897882380 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fceec0662b0 0x7fceec068760 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:42.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.886+0000 7fcf0fa4f640 1 --2- 172.21.15.45:0/897882380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf080bf370 0x7fcf080a34e0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:42.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.886+0000 7fcf0fa4f640 1 --2- 172.21.15.45:0/897882380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf080a7100 0x7fcf080a2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:42.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.886+0000 7fcf0fa4f640 1 --2- 172.21.15.45:0/897882380 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf0806f5f0 0x7fcf080bbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:42.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.886+0000 7fcf0fa4f640 1 -- 172.21.15.45:0/897882380 >> 172.21.15.45:0/897882380 conn(0x7fcf0806bce0 msgr2=0x7fcf08145660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:42.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.886+0000 7fcf0fa4f640 1 -- 172.21.15.45:0/897882380 shutdown_connections 2023-10-03T19:16:42.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:42.886+0000 7fcf0fa4f640 1 -- 172.21.15.45:0/897882380 wait complete. 2023-10-03T19:16:42.910 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:16:42.910 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:16:43.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.022+0000 7f9874310640 1 Processor -- start 2023-10-03T19:16:43.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.022+0000 7f9874310640 1 -- start start 2023-10-03T19:16:43.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.022+0000 7f9874310640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f986c0c07f0 0x7f986c0bd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:43.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.022+0000 7f9874310640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f986c14fa20 0x7f986c14fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:43.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.022+0000 7f9874310640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f986c0c14c0 con 0x7f986c0c19b0 2023-10-03T19:16:43.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.022+0000 7f9874310640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f986c0be420 con 0x7f986c14fa20 2023-10-03T19:16:43.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.022+0000 7f9874310640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986c0a1f80 con 0x7f986c0c07f0 2023-10-03T19:16:43.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.022+0000 7f98728ad640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f986c14fa20 0x7f986c14fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:43.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.022+0000 7f98728ad640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f986c14fa20 0x7f986c14fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34664/0 (socket says 172.21.15.45:34664) 2023-10-03T19:16:43.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.022+0000 7f98718ab640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f986c0c19b0 0x7f986c14bab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40598/0 (socket says 172.21.15.45:40598) 2023-10-03T19:16:43.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.022+0000 7f98728ad640 1 -- 172.21.15.45:0/543555970 learned_addr learned my addr 172.21.15.45:0/543555970 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:43.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.022+0000 7f98720ac640 1 --2- 172.21.15.45:0/543555970 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f986c0c07f0 0x7f986c0bd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:43.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.022+0000 7f98728ad640 1 -- 172.21.15.45:0/543555970 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f986c0c07f0 msgr2=0x7f986c0bd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:43.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.022+0000 7f98728ad640 1 --2- 172.21.15.45:0/543555970 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f986c0c07f0 0x7f986c0bd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.022+0000 7f98728ad640 1 -- 172.21.15.45:0/543555970 >> v1:172.21.15.45:6789/0 conn(0x7f986c0c19b0 legacy=0x7f986c14bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:43.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.022+0000 7f98728ad640 1 -- 172.21.15.45:0/543555970 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c0bd070 con 0x7f986c14fa20 2023-10-03T19:16:43.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.022+0000 7f98710aa640 1 -- 172.21.15.45:0/543555970 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2547382421 0 0) 0x7f986c0c14c0 con 0x7f986c0c19b0 2023-10-03T19:16:43.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f98728ad640 1 --2- 172.21.15.45:0/543555970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f986c14fa20 0x7f986c14fea0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f9864009e50 tx=0x7f986401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea149d4b36769aec server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:43.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f98710aa640 1 -- 172.21.15.45:0/543555970 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98640a5720 con 0x7f986c14fa20 2023-10-03T19:16:43.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f98710aa640 1 -- 172.21.15.45:0/543555970 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98640a5880 con 0x7f986c14fa20 2023-10-03T19:16:43.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f98710aa640 1 -- 172.21.15.45:0/543555970 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98640a5c10 con 0x7f986c14fa20 2023-10-03T19:16:43.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f9874310640 1 -- 172.21.15.45:0/543555970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f986c14fa20 msgr2=0x7f986c14fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:43.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f9874310640 1 --2- 172.21.15.45:0/543555970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f986c14fa20 0x7f986c14fea0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f9864009e50 tx=0x7f986401c950 comp rx=0 tx=0).stop 2023-10-03T19:16:43.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f9874310640 1 -- 172.21.15.45:0/543555970 shutdown_connections 2023-10-03T19:16:43.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f9874310640 1 --2- 172.21.15.45:0/543555970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f986c14fa20 0x7f986c14fea0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f9874310640 1 --2- 172.21.15.45:0/543555970 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f986c0c07f0 0x7f986c0bd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f9874310640 1 -- 172.21.15.45:0/543555970 >> 172.21.15.45:0/543555970 conn(0x7f986c0a4260 msgr2=0x7f986c0a4660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:43.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f9874310640 1 -- 172.21.15.45:0/543555970 shutdown_connections 2023-10-03T19:16:43.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f9874310640 1 -- 172.21.15.45:0/543555970 wait complete. 2023-10-03T19:16:43.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f9874310640 1 Processor -- start 2023-10-03T19:16:43.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f9874310640 1 -- start start 2023-10-03T19:16:43.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f9874310640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f986c0c07f0 0x7f986c145a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:43.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f9874310640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f986c0c19b0 0x7f986c0a72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:43.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f9874310640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f986c14fa20 0x7f986c148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:43.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f9874310640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c06f030 con 0x7f986c14fa20 2023-10-03T19:16:43.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f9874310640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c06d560 con 0x7f986c0c19b0 2023-10-03T19:16:43.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f9874310640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986c145fa0 con 0x7f986c0c07f0 2023-10-03T19:16:43.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f98728ad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f986c14fa20 0x7f986c148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:43.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f98728ad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f986c14fa20 0x7f986c148ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34666/0 (socket says 172.21.15.45:34666) 2023-10-03T19:16:43.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f98728ad640 1 -- 172.21.15.45:0/2190464740 learned_addr learned my addr 172.21.15.45:0/2190464740 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:43.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f98720ac640 1 --2- 172.21.15.45:0/2190464740 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f986c0c07f0 0x7f986c145a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:43.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f98718ab640 1 --2- 172.21.15.45:0/2190464740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f986c0c19b0 0x7f986c0a72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:43.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f98728ad640 1 -- 172.21.15.45:0/2190464740 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f986c0c07f0 msgr2=0x7f986c145a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:43.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f98728ad640 1 --2- 172.21.15.45:0/2190464740 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f986c0c07f0 0x7f986c145a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f98728ad640 1 -- 172.21.15.45:0/2190464740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f986c0c19b0 msgr2=0x7f986c0a72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:43.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f98728ad640 1 --2- 172.21.15.45:0/2190464740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f986c0c19b0 0x7f986c0a72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f98728ad640 1 -- 172.21.15.45:0/2190464740 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9864009b30 con 0x7f986c14fa20 2023-10-03T19:16:43.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f98720ac640 1 --2- 172.21.15.45:0/2190464740 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f986c0c07f0 0x7f986c145a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:43.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f98728ad640 1 --2- 172.21.15.45:0/2190464740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f986c14fa20 0x7f986c148ac0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9864009e50 tx=0x7f98640196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:43.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f9862ffd640 1 -- 172.21.15.45:0/2190464740 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98640b8670 con 0x7f986c14fa20 2023-10-03T19:16:43.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f9862ffd640 1 -- 172.21.15.45:0/2190464740 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98640b87d0 con 0x7f986c14fa20 2023-10-03T19:16:43.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f9874310640 1 -- 172.21.15.45:0/2190464740 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f986c0c0d50 con 0x7f986c14fa20 2023-10-03T19:16:43.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f9862ffd640 1 -- 172.21.15.45:0/2190464740 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98640b8b60 con 0x7f986c14fa20 2023-10-03T19:16:43.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.026+0000 7f9874310640 1 -- 172.21.15.45:0/2190464740 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f986c0c0bc0 con 0x7f986c14fa20 2023-10-03T19:16:43.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.030+0000 7f9874310640 1 -- 172.21.15.45:0/2190464740 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f986c14c1c0 con 0x7f986c14fa20 2023-10-03T19:16:43.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.030+0000 7f9862ffd640 1 -- 172.21.15.45:0/2190464740 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f98640b8cc0 con 0x7f986c14fa20 2023-10-03T19:16:43.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.030+0000 7f9862ffd640 1 --2- 172.21.15.45:0/2190464740 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9850066280 0x7f9850068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:43.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.030+0000 7f9862ffd640 1 -- 172.21.15.45:0/2190464740 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f986411efe0 con 0x7f986c14fa20 2023-10-03T19:16:43.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.030+0000 7f98720ac640 1 --2- 172.21.15.45:0/2190464740 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9850066280 0x7f9850068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:43.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.030+0000 7f98720ac640 1 --2- 172.21.15.45:0/2190464740 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9850066280 0x7f9850068730 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f98680097a0 tx=0x7f9868008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:43.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.034+0000 7f9862ffd640 1 -- 172.21.15.45:0/2190464740 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f98640ec8d0 con 0x7f986c14fa20 2023-10-03T19:16:43.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.190+0000 7f9874310640 1 -- 172.21.15.45:0/2190464740 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f986c1eaa40 con 0x7f986c14fa20 2023-10-03T19:16:43.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.190+0000 7f9862ffd640 1 -- 172.21.15.45:0/2190464740 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7f98640bc020 con 0x7f986c14fa20 2023-10-03T19:16:43.196 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:16:43.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.190+0000 7f9874310640 1 -- 172.21.15.45:0/2190464740 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9850066280 msgr2=0x7f9850068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:43.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.190+0000 7f9874310640 1 --2- 172.21.15.45:0/2190464740 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9850066280 0x7f9850068730 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f98680097a0 tx=0x7f9868008040 comp rx=0 tx=0).stop 2023-10-03T19:16:43.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.190+0000 7f9874310640 1 -- 172.21.15.45:0/2190464740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f986c14fa20 msgr2=0x7f986c148ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:43.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.190+0000 7f9874310640 1 --2- 172.21.15.45:0/2190464740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f986c14fa20 0x7f986c148ac0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9864009e50 tx=0x7f98640196f0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.190+0000 7f9874310640 1 -- 172.21.15.45:0/2190464740 shutdown_connections 2023-10-03T19:16:43.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.190+0000 7f9874310640 1 --2- 172.21.15.45:0/2190464740 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9850066280 0x7f9850068730 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.190+0000 7f9874310640 1 --2- 172.21.15.45:0/2190464740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f986c14fa20 0x7f986c148ac0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.190+0000 7f9874310640 1 --2- 172.21.15.45:0/2190464740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f986c0c19b0 0x7f986c0a72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.190+0000 7f9874310640 1 --2- 172.21.15.45:0/2190464740 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f986c0c07f0 0x7f986c145a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.190+0000 7f9874310640 1 -- 172.21.15.45:0/2190464740 >> 172.21.15.45:0/2190464740 conn(0x7f986c0a4260 msgr2=0x7f986c14cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:43.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.190+0000 7f9874310640 1 -- 172.21.15.45:0/2190464740 shutdown_connections 2023-10-03T19:16:43.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.190+0000 7f9874310640 1 -- 172.21.15.45:0/2190464740 wait complete. 2023-10-03T19:16:43.214 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:16:43.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faac6bdc640 1 Processor -- start 2023-10-03T19:16:43.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faac6bdc640 1 -- start start 2023-10-03T19:16:43.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faac6bdc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faac00c14e0 0x7faac00c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:43.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faac6bdc640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac006ac70 con 0x7faac00bf1f0 2023-10-03T19:16:43.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faac6bdc640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac00c3000 con 0x7faac00c2770 2023-10-03T19:16:43.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faac6bdc640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac00aa5f0 con 0x7faac00c14e0 2023-10-03T19:16:43.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faabffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7faac00bf1f0 0x7faac00a9860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40608/0 (socket says 172.21.15.45:40608) 2023-10-03T19:16:43.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faabffff640 1 -- 172.21.15.45:0/317011621 learned_addr learned my addr 172.21.15.45:0/317011621 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:43.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faac4978640 1 --2- 172.21.15.45:0/317011621 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faac00c14e0 0x7faac00c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:43.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faabf7fe640 1 -- 172.21.15.45:0/317011621 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2821324374 0 0) 0x7faac006ac70 con 0x7faac00bf1f0 2023-10-03T19:16:43.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faabf7fe640 1 -- 172.21.15.45:0/317011621 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaa8003530 con 0x7faac00bf1f0 2023-10-03T19:16:43.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faabf7fe640 1 -- 172.21.15.45:0/317011621 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1872764739 0 0) 0x7faaa8003530 con 0x7faac00bf1f0 2023-10-03T19:16:43.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faabf7fe640 1 -- 172.21.15.45:0/317011621 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faac00c14e0 msgr2=0x7faac00c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:43.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faabf7fe640 1 --2- 172.21.15.45:0/317011621 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faac00c14e0 0x7faac00c0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faabf7fe640 1 -- 172.21.15.45:0/317011621 >> v1:172.21.15.79:6789/0 conn(0x7faac00c2770 legacy=0x7faac0069ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:43.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faabf7fe640 1 -- 172.21.15.45:0/317011621 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac014f250 con 0x7faac00bf1f0 2023-10-03T19:16:43.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faabf7fe640 1 -- 172.21.15.45:0/317011621 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7faab4001680 con 0x7faac00bf1f0 2023-10-03T19:16:43.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faabf7fe640 1 -- 172.21.15.45:0/317011621 >> v1:172.21.15.45:6789/0 conn(0x7faac00bf1f0 legacy=0x7faac00a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:43.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faabf7fe640 1 --2- 172.21.15.45:0/317011621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa80039b0 0x7faaa8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:43.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faabf7fe640 1 --2- 172.21.15.45:0/317011621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faaa80047d0 0x7faaa8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:43.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faabf7fe640 1 --2- 172.21.15.45:0/317011621 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faac00c14e0 0x7faaa8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:43.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faabf7fe640 1 -- 172.21.15.45:0/317011621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac00aa5f0 con 0x7faaa80039b0 2023-10-03T19:16:43.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faabf7fe640 1 -- 172.21.15.45:0/317011621 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa800bad0 con 0x7faaa80047d0 2023-10-03T19:16:43.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faabf7fe640 1 -- 172.21.15.45:0/317011621 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa800bc60 con 0x7faac00c14e0 2023-10-03T19:16:43.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faac4978640 1 --2- 172.21.15.45:0/317011621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa80039b0 0x7faaa8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:43.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faabffff640 1 --2- 172.21.15.45:0/317011621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faaa80047d0 0x7faaa8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:43.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faac5179640 1 --2- 172.21.15.45:0/317011621 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faac00c14e0 0x7faaa8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faac4978640 1 -- 172.21.15.45:0/317011621 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faac00c14e0 msgr2=0x7faaa8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faac4978640 1 --2- 172.21.15.45:0/317011621 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faac00c14e0 0x7faaa8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faac4978640 1 -- 172.21.15.45:0/317011621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faaa80047d0 msgr2=0x7faaa8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faac4978640 1 --2- 172.21.15.45:0/317011621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faaa80047d0 0x7faaa8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faac4978640 1 -- 172.21.15.45:0/317011621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa8003530 con 0x7faaa80039b0 2023-10-03T19:16:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faabffff640 1 --2- 172.21.15.45:0/317011621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faaa80047d0 0x7faaa8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.338+0000 7faac5179640 1 --2- 172.21.15.45:0/317011621 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faac00c14e0 0x7faaa8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:43.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.342+0000 7faac4978640 1 --2- 172.21.15.45:0/317011621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa80039b0 0x7faaa8003dc0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7faab0009ae0 tx=0x7faab001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01c48aec16205f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:43.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.342+0000 7faabf7fe640 1 -- 172.21.15.45:0/317011621 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab00a5640 con 0x7faaa80039b0 2023-10-03T19:16:43.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.342+0000 7faabf7fe640 1 -- 172.21.15.45:0/317011621 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab4001d80 con 0x7faaa80039b0 2023-10-03T19:16:43.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.342+0000 7faabf7fe640 1 -- 172.21.15.45:0/317011621 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab00a59e0 con 0x7faaa80039b0 2023-10-03T19:16:43.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.342+0000 7faac6bdc640 1 -- 172.21.15.45:0/317011621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa80039b0 msgr2=0x7faaa8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:43.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.342+0000 7faac6bdc640 1 --2- 172.21.15.45:0/317011621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa80039b0 0x7faaa8003dc0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7faab0009ae0 tx=0x7faab001ca50 comp rx=0 tx=0).stop 2023-10-03T19:16:43.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.342+0000 7faac5179640 1 -- 172.21.15.45:0/317011621 reap_dead start 2023-10-03T19:16:43.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.342+0000 7faac6bdc640 1 -- 172.21.15.45:0/317011621 shutdown_connections 2023-10-03T19:16:43.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.342+0000 7faac6bdc640 1 -- 172.21.15.45:0/317011621 >> 172.21.15.45:0/317011621 conn(0x7faac00a6440 msgr2=0x7faac00a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:43.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.342+0000 7faac6bdc640 1 -- 172.21.15.45:0/317011621 shutdown_connections 2023-10-03T19:16:43.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.342+0000 7faac6bdc640 1 -- 172.21.15.45:0/317011621 wait complete. 2023-10-03T19:16:43.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.342+0000 7faac6bdc640 1 Processor -- start 2023-10-03T19:16:43.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.342+0000 7faac6bdc640 1 -- start start 2023-10-03T19:16:43.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.346+0000 7faac6bdc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faaa80039b0 0x7faac01e34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:43.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.346+0000 7faac6bdc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faac01e3a30 0x7faac00bdb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:43.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.346+0000 7faac6bdc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faac00be050 0x7faac00b9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:43.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.346+0000 7faac6bdc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac01d4f30 con 0x7faac01e3a30 2023-10-03T19:16:43.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.346+0000 7faac6bdc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac00a3aa0 con 0x7faac00be050 2023-10-03T19:16:43.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.346+0000 7faac6bdc640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac01e3ea0 con 0x7faaa80039b0 2023-10-03T19:16:43.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.346+0000 7faabffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faac01e3a30 0x7faac00bdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:43.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.346+0000 7faabffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faac01e3a30 0x7faac00bdb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34690/0 (socket says 172.21.15.45:34690) 2023-10-03T19:16:43.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.346+0000 7faabffff640 1 -- 172.21.15.45:0/434662668 learned_addr learned my addr 172.21.15.45:0/434662668 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:43.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.346+0000 7faac4978640 1 --2- 172.21.15.45:0/434662668 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faaa80039b0 0x7faac01e34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:43.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.346+0000 7faac5179640 1 --2- 172.21.15.45:0/434662668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faac00be050 0x7faac00b9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:43.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.346+0000 7faabffff640 1 -- 172.21.15.45:0/434662668 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faaa80039b0 msgr2=0x7faac01e34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:43.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.346+0000 7faabffff640 1 --2- 172.21.15.45:0/434662668 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faaa80039b0 0x7faac01e34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.346+0000 7faabffff640 1 -- 172.21.15.45:0/434662668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faac00be050 msgr2=0x7faac00b9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:43.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.346+0000 7faabffff640 1 --2- 172.21.15.45:0/434662668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faac00be050 0x7faac00b9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.346+0000 7faabffff640 1 -- 172.21.15.45:0/434662668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac006b100 con 0x7faac01e3a30 2023-10-03T19:16:43.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.346+0000 7faac5179640 1 --2- 172.21.15.45:0/434662668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faac00be050 0x7faac00b9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:43.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.346+0000 7faabffff640 1 --2- 172.21.15.45:0/434662668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faac01e3a30 0x7faac00bdb10 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7faab4010be0 tx=0x7faab400e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:43.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.346+0000 7faabd7fa640 1 -- 172.21.15.45:0/434662668 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab400ed60 con 0x7faac01e3a30 2023-10-03T19:16:43.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.346+0000 7faabd7fa640 1 -- 172.21.15.45:0/434662668 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab40143a0 con 0x7faac01e3a30 2023-10-03T19:16:43.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.346+0000 7faac6bdc640 1 -- 172.21.15.45:0/434662668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac014f530 con 0x7faac01e3a30 2023-10-03T19:16:43.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.346+0000 7faabd7fa640 1 -- 172.21.15.45:0/434662668 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab4014730 con 0x7faac01e3a30 2023-10-03T19:16:43.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.346+0000 7faac6bdc640 1 -- 172.21.15.45:0/434662668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac00c18b0 con 0x7faac01e3a30 2023-10-03T19:16:43.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.346+0000 7faac6bdc640 1 -- 172.21.15.45:0/434662668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac004de80 con 0x7faac01e3a30 2023-10-03T19:16:43.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.346+0000 7faabd7fa640 1 -- 172.21.15.45:0/434662668 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faab4014890 con 0x7faac01e3a30 2023-10-03T19:16:43.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.346+0000 7faabd7fa640 1 --2- 172.21.15.45:0/434662668 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7faaac066280 0x7faaac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:43.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.346+0000 7faabd7fa640 1 -- 172.21.15.45:0/434662668 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5210+0+0 (secure 0 0 0) 0x7faab4086a50 con 0x7faac01e3a30 2023-10-03T19:16:43.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.346+0000 7faac4978640 1 --2- 172.21.15.45:0/434662668 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7faaac066280 0x7faaac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:43.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.350+0000 7faac4978640 1 --2- 172.21.15.45:0/434662668 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7faaac066280 0x7faaac068730 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7faab00af000 tx=0x7faab00046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:43.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.350+0000 7faabd7fa640 1 -- 172.21.15.45:0/434662668 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7faab4054190 con 0x7faac01e3a30 2023-10-03T19:16:43.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.506+0000 7faac6bdc640 1 -- 172.21.15.45:0/434662668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faac00a4030 con 0x7faac01e3a30 2023-10-03T19:16:43.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.506+0000 7faabd7fa640 1 -- 172.21.15.45:0/434662668 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v57) v1 ==== 92+0+10 (secure 0 0 0) 0x7faab401b070 con 0x7faac01e3a30 2023-10-03T19:16:43.512 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:16:43.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.506+0000 7faac6bdc640 1 -- 172.21.15.45:0/434662668 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7faaac066280 msgr2=0x7faaac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:43.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.506+0000 7faac6bdc640 1 --2- 172.21.15.45:0/434662668 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7faaac066280 0x7faaac068730 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7faab00af000 tx=0x7faab00046d0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.506+0000 7faac6bdc640 1 -- 172.21.15.45:0/434662668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faac01e3a30 msgr2=0x7faac00bdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:43.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.506+0000 7faac6bdc640 1 --2- 172.21.15.45:0/434662668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faac01e3a30 0x7faac00bdb10 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7faab4010be0 tx=0x7faab400e4d0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.506+0000 7faac6bdc640 1 -- 172.21.15.45:0/434662668 shutdown_connections 2023-10-03T19:16:43.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.506+0000 7faac6bdc640 1 --2- 172.21.15.45:0/434662668 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7faaac066280 0x7faaac068730 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.506+0000 7faac6bdc640 1 --2- 172.21.15.45:0/434662668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faac00be050 0x7faac00b9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.506+0000 7faac6bdc640 1 --2- 172.21.15.45:0/434662668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faac01e3a30 0x7faac00bdb10 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.506+0000 7faac6bdc640 1 --2- 172.21.15.45:0/434662668 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faaa80039b0 0x7faac01e34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.506+0000 7faac6bdc640 1 -- 172.21.15.45:0/434662668 >> 172.21.15.45:0/434662668 conn(0x7faac00a6440 msgr2=0x7faac00a42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:43.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.506+0000 7faac6bdc640 1 -- 172.21.15.45:0/434662668 shutdown_connections 2023-10-03T19:16:43.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.506+0000 7faac6bdc640 1 -- 172.21.15.45:0/434662668 wait complete. 2023-10-03T19:16:43.531 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-03T19:16:43.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.642+0000 7fba3e779640 1 Processor -- start 2023-10-03T19:16:43.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.646+0000 7fba3e779640 1 -- start start 2023-10-03T19:16:43.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.646+0000 7fba3e779640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fba3806f170 0x7fba38150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:43.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.646+0000 7fba3e779640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fba3806d170 0x7fba3814d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:43.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.646+0000 7fba3e779640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba3806cac0 con 0x7fba380bc8b0 2023-10-03T19:16:43.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.646+0000 7fba3e779640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba380720d0 con 0x7fba3806d170 2023-10-03T19:16:43.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.646+0000 7fba3e779640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba380a5ab0 con 0x7fba3806f170 2023-10-03T19:16:43.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.646+0000 7fba3cd16640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fba3806d170 0x7fba3814d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:43.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.646+0000 7fba377fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fba380bc8b0 0x7fba3814ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40616/0 (socket says 172.21.15.45:40616) 2023-10-03T19:16:43.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.646+0000 7fba3cd16640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fba3806d170 0x7fba3814d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34694/0 (socket says 172.21.15.45:34694) 2023-10-03T19:16:43.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.646+0000 7fba377fe640 1 -- 172.21.15.45:0/1683025013 learned_addr learned my addr 172.21.15.45:0/1683025013 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:43.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.646+0000 7fba37fff640 1 --2- 172.21.15.45:0/1683025013 >> v2:172.21.15.79:3300/0 conn(0x7fba3806f170 0x7fba38150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:43.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.646+0000 7fba3cd16640 1 -- 172.21.15.45:0/1683025013 >> v2:172.21.15.79:3300/0 conn(0x7fba3806f170 msgr2=0x7fba38150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:43.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.646+0000 7fba3cd16640 1 --2- 172.21.15.45:0/1683025013 >> v2:172.21.15.79:3300/0 conn(0x7fba3806f170 0x7fba38150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.646+0000 7fba3cd16640 1 -- 172.21.15.45:0/1683025013 >> v1:172.21.15.45:6789/0 conn(0x7fba380bc8b0 legacy=0x7fba3814ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:43.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.646+0000 7fba36ffd640 1 -- 172.21.15.45:0/1683025013 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873473100 0 0) 0x7fba28001120 con 0x7fba380bc8b0 2023-10-03T19:16:43.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.646+0000 7fba3cd16640 1 -- 172.21.15.45:0/1683025013 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba3806cd00 con 0x7fba3806d170 2023-10-03T19:16:43.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.646+0000 7fba37fff640 1 --2- 172.21.15.45:0/1683025013 >> v2:172.21.15.79:3300/0 conn(0x7fba3806f170 0x7fba38150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:43.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.646+0000 7fba3cd16640 1 --2- 172.21.15.45:0/1683025013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba3806d170 0x7fba3814d180 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fba380bdf90 tx=0x7fba3001f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dbd1fad1fe2b9e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:43.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.646+0000 7fba36ffd640 1 -- 172.21.15.45:0/1683025013 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba300b0440 con 0x7fba3806d170 2023-10-03T19:16:43.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.646+0000 7fba36ffd640 1 -- 172.21.15.45:0/1683025013 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba300b05a0 con 0x7fba3806d170 2023-10-03T19:16:43.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.646+0000 7fba36ffd640 1 -- 172.21.15.45:0/1683025013 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba300b0930 con 0x7fba3806d170 2023-10-03T19:16:43.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.650+0000 7fba3e779640 1 -- 172.21.15.45:0/1683025013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba3806d170 msgr2=0x7fba3814d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:43.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.650+0000 7fba3e779640 1 --2- 172.21.15.45:0/1683025013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba3806d170 0x7fba3814d180 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fba380bdf90 tx=0x7fba3001f0f0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.650+0000 7fba3e779640 1 -- 172.21.15.45:0/1683025013 shutdown_connections 2023-10-03T19:16:43.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.650+0000 7fba3e779640 1 --2- 172.21.15.45:0/1683025013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba3806d170 0x7fba3814d180 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.650+0000 7fba3e779640 1 --2- 172.21.15.45:0/1683025013 >> v2:172.21.15.79:3300/0 conn(0x7fba3806f170 0x7fba38150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.650+0000 7fba3e779640 1 -- 172.21.15.45:0/1683025013 >> 172.21.15.45:0/1683025013 conn(0x7fba380bcf50 msgr2=0x7fba380bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:43.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.650+0000 7fba3e779640 1 -- 172.21.15.45:0/1683025013 shutdown_connections 2023-10-03T19:16:43.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.650+0000 7fba3e779640 1 -- 172.21.15.45:0/1683025013 wait complete. 2023-10-03T19:16:43.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.650+0000 7fba3e779640 1 Processor -- start 2023-10-03T19:16:43.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.650+0000 7fba3e779640 1 -- start start 2023-10-03T19:16:43.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.650+0000 7fba3e779640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fba3806d170 0x7fba381d70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:43.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.650+0000 7fba3e779640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba3806f170 0x7fba380c0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:43.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.650+0000 7fba3e779640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba380bc8b0 0x7fba381e5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:43.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.650+0000 7fba3e779640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba381d5480 con 0x7fba380bc8b0 2023-10-03T19:16:43.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.650+0000 7fba3e779640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba38142400 con 0x7fba3806f170 2023-10-03T19:16:43.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.650+0000 7fba3e779640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba381d5c20 con 0x7fba3806d170 2023-10-03T19:16:43.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.650+0000 7fba3cd16640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba380bc8b0 0x7fba381e5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:43.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.650+0000 7fba3cd16640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba380bc8b0 0x7fba381e5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34708/0 (socket says 172.21.15.45:34708) 2023-10-03T19:16:43.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.650+0000 7fba3cd16640 1 -- 172.21.15.45:0/2025826599 learned_addr learned my addr 172.21.15.45:0/2025826599 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:43.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.650+0000 7fba3cd16640 1 -- 172.21.15.45:0/2025826599 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fba3806d170 msgr2=0x7fba381d70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:43.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.650+0000 7fba3cd16640 1 --2- 172.21.15.45:0/2025826599 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fba3806d170 0x7fba381d70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.650+0000 7fba3cd16640 1 -- 172.21.15.45:0/2025826599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba3806f170 msgr2=0x7fba380c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:43.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.650+0000 7fba3cd16640 1 --2- 172.21.15.45:0/2025826599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba3806f170 0x7fba380c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.650+0000 7fba3cd16640 1 -- 172.21.15.45:0/2025826599 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba30009a70 con 0x7fba380bc8b0 2023-10-03T19:16:43.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.650+0000 7fba3cd16640 1 --2- 172.21.15.45:0/2025826599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba380bc8b0 0x7fba381e5580 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fba3001bd00 tx=0x7fba3001be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:43.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.650+0000 7fba34ff9640 1 -- 172.21.15.45:0/2025826599 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba300bc860 con 0x7fba380bc8b0 2023-10-03T19:16:43.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.650+0000 7fba34ff9640 1 -- 172.21.15.45:0/2025826599 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba300bc9e0 con 0x7fba380bc8b0 2023-10-03T19:16:43.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.650+0000 7fba3e779640 1 -- 172.21.15.45:0/2025826599 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba3814c4a0 con 0x7fba380bc8b0 2023-10-03T19:16:43.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.650+0000 7fba34ff9640 1 -- 172.21.15.45:0/2025826599 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba300bcd90 con 0x7fba380bc8b0 2023-10-03T19:16:43.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.650+0000 7fba3e779640 1 -- 172.21.15.45:0/2025826599 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba3814fae0 con 0x7fba380bc8b0 2023-10-03T19:16:43.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.654+0000 7fba3e779640 1 -- 172.21.15.45:0/2025826599 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba3806f540 con 0x7fba380bc8b0 2023-10-03T19:16:43.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.654+0000 7fba34ff9640 1 -- 172.21.15.45:0/2025826599 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fba300c7460 con 0x7fba380bc8b0 2023-10-03T19:16:43.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.654+0000 7fba34ff9640 1 --2- 172.21.15.45:0/2025826599 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fba18066280 0x7fba18068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:43.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.654+0000 7fba34ff9640 1 -- 172.21.15.45:0/2025826599 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fba30122720 con 0x7fba380bc8b0 2023-10-03T19:16:43.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.654+0000 7fba37fff640 1 --2- 172.21.15.45:0/2025826599 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fba18066280 0x7fba18068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:43.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.654+0000 7fba37fff640 1 --2- 172.21.15.45:0/2025826599 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fba18066280 0x7fba18068730 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fba2000a8d0 tx=0x7fba20008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:43.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.658+0000 7fba34ff9640 1 -- 172.21.15.45:0/2025826599 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fba300f0010 con 0x7fba380bc8b0 2023-10-03T19:16:43.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.814+0000 7fba3e779640 1 -- 172.21.15.45:0/2025826599 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fba3806d660 con 0x7fba380bc8b0 2023-10-03T19:16:43.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.814+0000 7fba34ff9640 1 -- 172.21.15.45:0/2025826599 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v57) v1 ==== 84+0+126 (secure 0 0 0) 0x7fba30009450 con 0x7fba380bc8b0 2023-10-03T19:16:43.820 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:16:43.820 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-10-03T19:16:43.820 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:16:43.820 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-10-03T19:16:43.821 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-10-03T19:16:43.821 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:16:43.821 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:16:43.821 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 2, 2023-10-03T19:16:43.821 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "rbd" 2023-10-03T19:16:43.821 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:16:43.821 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-10-03T19:16:43.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.814+0000 7fba3e779640 1 -- 172.21.15.45:0/2025826599 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fba18066280 msgr2=0x7fba18068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:43.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.814+0000 7fba3e779640 1 --2- 172.21.15.45:0/2025826599 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fba18066280 0x7fba18068730 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fba2000a8d0 tx=0x7fba20008040 comp rx=0 tx=0).stop 2023-10-03T19:16:43.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.814+0000 7fba3e779640 1 -- 172.21.15.45:0/2025826599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba380bc8b0 msgr2=0x7fba381e5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:43.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.814+0000 7fba3e779640 1 --2- 172.21.15.45:0/2025826599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba380bc8b0 0x7fba381e5580 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fba3001bd00 tx=0x7fba3001be90 comp rx=0 tx=0).stop 2023-10-03T19:16:43.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.814+0000 7fba3e779640 1 -- 172.21.15.45:0/2025826599 shutdown_connections 2023-10-03T19:16:43.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.814+0000 7fba3e779640 1 --2- 172.21.15.45:0/2025826599 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fba18066280 0x7fba18068730 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.814+0000 7fba3e779640 1 --2- 172.21.15.45:0/2025826599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba380bc8b0 0x7fba381e5580 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.814+0000 7fba3e779640 1 --2- 172.21.15.45:0/2025826599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba3806f170 0x7fba380c0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.814+0000 7fba3e779640 1 --2- 172.21.15.45:0/2025826599 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fba3806d170 0x7fba381d70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.814+0000 7fba3e779640 1 -- 172.21.15.45:0/2025826599 >> 172.21.15.45:0/2025826599 conn(0x7fba380bcf50 msgr2=0x7fba381d83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:43.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.814+0000 7fba3e779640 1 -- 172.21.15.45:0/2025826599 shutdown_connections 2023-10-03T19:16:43.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.814+0000 7fba3e779640 1 -- 172.21.15.45:0/2025826599 wait complete. 2023-10-03T19:16:43.837 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-03T19:16:43.837 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-03T19:16:43.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.958+0000 7f1bd71ab640 1 Processor -- start 2023-10-03T19:16:43.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.958+0000 7f1bd71ab640 1 -- start start 2023-10-03T19:16:43.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.958+0000 7f1bd71ab640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1bd00c14e0 0x7f1bd00c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:43.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.958+0000 7f1bd71ab640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1bd00bf1f0 0x7f1bd00a9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:43.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.958+0000 7f1bd71ab640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd006ac70 con 0x7f1bd00c2770 2023-10-03T19:16:43.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.958+0000 7f1bd71ab640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd006aae0 con 0x7f1bd00c14e0 2023-10-03T19:16:43.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.958+0000 7f1bd71ab640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd00c3000 con 0x7f1bd00bf1f0 2023-10-03T19:16:43.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.958+0000 7f1bd4f47640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1bd00c14e0 0x7f1bd00c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:43.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.958+0000 7f1bd4f47640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1bd00c14e0 0x7f1bd00c0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34724/0 (socket says 172.21.15.45:34724) 2023-10-03T19:16:43.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.958+0000 7f1bd4f47640 1 -- 172.21.15.45:0/4251471779 learned_addr learned my addr 172.21.15.45:0/4251471779 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:43.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.958+0000 7f1bcffff640 1 --2- 172.21.15.45:0/4251471779 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1bd00bf1f0 0x7f1bd00a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:43.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.958+0000 7f1bd4f47640 1 -- 172.21.15.45:0/4251471779 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1bd00bf1f0 msgr2=0x7f1bd00a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:43.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.958+0000 7f1bd4f47640 1 --2- 172.21.15.45:0/4251471779 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1bd00bf1f0 0x7f1bd00a9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.958+0000 7f1bd4f47640 1 -- 172.21.15.45:0/4251471779 >> v1:172.21.15.79:6789/0 conn(0x7f1bd00c2770 legacy=0x7f1bd00a9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:43.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.958+0000 7f1bd4f47640 1 -- 172.21.15.45:0/4251471779 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd00aa5f0 con 0x7f1bd00c14e0 2023-10-03T19:16:43.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.966+0000 7f1bd4f47640 1 --2- 172.21.15.45:0/4251471779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bd00c14e0 0x7f1bd00c0a40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8009870 tx=0x7f1bb801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d9f5f9d7e28102 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:43.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.966+0000 7f1bcf7fe640 1 -- 172.21.15.45:0/4251471779 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb80a8a30 con 0x7f1bd00c14e0 2023-10-03T19:16:43.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.966+0000 7f1bcf7fe640 1 -- 172.21.15.45:0/4251471779 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb80a8b90 con 0x7f1bd00c14e0 2023-10-03T19:16:43.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.966+0000 7f1bcf7fe640 1 -- 172.21.15.45:0/4251471779 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb80b0440 con 0x7f1bd00c14e0 2023-10-03T19:16:43.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.966+0000 7f1bd71ab640 1 -- 172.21.15.45:0/4251471779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bd00c14e0 msgr2=0x7f1bd00c0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:43.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.966+0000 7f1bd71ab640 1 --2- 172.21.15.45:0/4251471779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bd00c14e0 0x7f1bd00c0a40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8009870 tx=0x7f1bb801ed30 comp rx=0 tx=0).stop 2023-10-03T19:16:43.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.966+0000 7f1bd71ab640 1 -- 172.21.15.45:0/4251471779 shutdown_connections 2023-10-03T19:16:43.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.966+0000 7f1bd71ab640 1 --2- 172.21.15.45:0/4251471779 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1bd00bf1f0 0x7f1bd00a9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.966+0000 7f1bd71ab640 1 --2- 172.21.15.45:0/4251471779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bd00c14e0 0x7f1bd00c0a40 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.966+0000 7f1bd71ab640 1 -- 172.21.15.45:0/4251471779 >> 172.21.15.45:0/4251471779 conn(0x7f1bd00a6440 msgr2=0x7f1bd00a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:43.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.966+0000 7f1bd71ab640 1 -- 172.21.15.45:0/4251471779 shutdown_connections 2023-10-03T19:16:43.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.966+0000 7f1bd71ab640 1 -- 172.21.15.45:0/4251471779 wait complete. 2023-10-03T19:16:43.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.966+0000 7f1bd71ab640 1 Processor -- start 2023-10-03T19:16:43.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.966+0000 7f1bd71ab640 1 -- start start 2023-10-03T19:16:43.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.966+0000 7f1bd71ab640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bd00bf1f0 0x7f1bd00bdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:43.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.966+0000 7f1bd71ab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bd00c14e0 0x7f1bd00b9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:43.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.966+0000 7f1bd71ab640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1bd00c2770 0x7f1bd00b9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:43.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.966+0000 7f1bd71ab640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd00ba0f0 con 0x7f1bd00c14e0 2023-10-03T19:16:43.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.966+0000 7f1bd71ab640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd00be2b0 con 0x7f1bd00bf1f0 2023-10-03T19:16:43.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.966+0000 7f1bd71ab640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd01d4b90 con 0x7f1bd00c2770 2023-10-03T19:16:43.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.966+0000 7f1bcffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bd00c14e0 0x7f1bd00b9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.966+0000 7f1bcffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bd00c14e0 0x7f1bd00b9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34728/0 (socket says 172.21.15.45:34728) 2023-10-03T19:16:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.966+0000 7f1bcffff640 1 -- 172.21.15.45:0/2758874279 learned_addr learned my addr 172.21.15.45:0/2758874279 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.966+0000 7f1bd4f47640 1 --2- 172.21.15.45:0/2758874279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bd00bf1f0 0x7f1bd00bdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.966+0000 7f1bd5748640 1 --2- 172.21.15.45:0/2758874279 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1bd00c2770 0x7f1bd00b9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.970+0000 7f1bcffff640 1 -- 172.21.15.45:0/2758874279 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1bd00c2770 msgr2=0x7f1bd00b9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.970+0000 7f1bcffff640 1 --2- 172.21.15.45:0/2758874279 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1bd00c2770 0x7f1bd00b9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.970+0000 7f1bcffff640 1 -- 172.21.15.45:0/2758874279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bd00bf1f0 msgr2=0x7f1bd00bdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.970+0000 7f1bcffff640 1 --2- 172.21.15.45:0/2758874279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bd00bf1f0 0x7f1bd00bdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.970+0000 7f1bcffff640 1 -- 172.21.15.45:0/2758874279 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb80094d0 con 0x7f1bd00c14e0 2023-10-03T19:16:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.970+0000 7f1bd4f47640 1 --2- 172.21.15.45:0/2758874279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bd00bf1f0 0x7f1bd00bdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:16:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.970+0000 7f1bcffff640 1 --2- 172.21.15.45:0/2758874279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bd00c14e0 0x7f1bd00b9670 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000efc0 tx=0x7f1bc000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:43.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.970+0000 7f1bcd7fa640 1 -- 172.21.15.45:0/2758874279 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0009be0 con 0x7f1bd00c14e0 2023-10-03T19:16:43.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.970+0000 7f1bcd7fa640 1 -- 172.21.15.45:0/2758874279 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc000f040 con 0x7f1bd00c14e0 2023-10-03T19:16:43.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.970+0000 7f1bcd7fa640 1 -- 172.21.15.45:0/2758874279 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0014680 con 0x7f1bd00c14e0 2023-10-03T19:16:43.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.970+0000 7f1bd71ab640 1 -- 172.21.15.45:0/2758874279 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd014f530 con 0x7f1bd00c14e0 2023-10-03T19:16:43.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.970+0000 7f1bd71ab640 1 -- 172.21.15.45:0/2758874279 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd014f250 con 0x7f1bd00c14e0 2023-10-03T19:16:43.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.970+0000 7f1bd71ab640 1 -- 172.21.15.45:0/2758874279 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd006b0e0 con 0x7f1bd00c14e0 2023-10-03T19:16:43.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.970+0000 7f1bcd7fa640 1 -- 172.21.15.45:0/2758874279 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1bc00147e0 con 0x7f1bd00c14e0 2023-10-03T19:16:43.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.970+0000 7f1bcd7fa640 1 --2- 172.21.15.45:0/2758874279 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1bb00662b0 0x7f1bb0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:43.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.970+0000 7f1bcd7fa640 1 -- 172.21.15.45:0/2758874279 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1bc0084770 con 0x7f1bd00c14e0 2023-10-03T19:16:43.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.970+0000 7f1bd4f47640 1 --2- 172.21.15.45:0/2758874279 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1bb00662b0 0x7f1bb0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:43.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.970+0000 7f1bd4f47640 1 --2- 172.21.15.45:0/2758874279 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1bb00662b0 0x7f1bb0068760 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80b2000 tx=0x7f1bb8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:43.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:43.974+0000 7f1bcd7fa640 1 -- 172.21.15.45:0/2758874279 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1bc0055a60 con 0x7f1bd00c14e0 2023-10-03T19:16:44.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:44.130+0000 7f1bd71ab640 1 -- 172.21.15.45:0/2758874279 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1bd004de80 con 0x7f1bd00c14e0 2023-10-03T19:16:44.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:44.922+0000 7f1bcd7fa640 1 -- 172.21.15.45:0/2758874279 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v58) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1bc00555f0 con 0x7f1bd00c14e0 2023-10-03T19:16:44.929 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-10-03T19:16:44.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:44.930+0000 7f1bd71ab640 1 -- 172.21.15.45:0/2758874279 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1bb00662b0 msgr2=0x7f1bb0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:44.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:44.930+0000 7f1bd71ab640 1 --2- 172.21.15.45:0/2758874279 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1bb00662b0 0x7f1bb0068760 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80b2000 tx=0x7f1bb8008040 comp rx=0 tx=0).stop 2023-10-03T19:16:44.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:44.930+0000 7f1bd71ab640 1 -- 172.21.15.45:0/2758874279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bd00c14e0 msgr2=0x7f1bd00b9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:44.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:44.930+0000 7f1bd71ab640 1 --2- 172.21.15.45:0/2758874279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bd00c14e0 0x7f1bd00b9670 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000efc0 tx=0x7f1bc000c490 comp rx=0 tx=0).stop 2023-10-03T19:16:44.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:44.930+0000 7f1bd71ab640 1 -- 172.21.15.45:0/2758874279 shutdown_connections 2023-10-03T19:16:44.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:44.930+0000 7f1bd71ab640 1 --2- 172.21.15.45:0/2758874279 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1bb00662b0 0x7f1bb0068760 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:44.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:44.930+0000 7f1bd71ab640 1 --2- 172.21.15.45:0/2758874279 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1bd00c2770 0x7f1bd00b9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:44.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:44.930+0000 7f1bd71ab640 1 --2- 172.21.15.45:0/2758874279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bd00c14e0 0x7f1bd00b9670 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:44.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:44.930+0000 7f1bd71ab640 1 --2- 172.21.15.45:0/2758874279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bd00bf1f0 0x7f1bd00bdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:44.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:44.930+0000 7f1bd71ab640 1 -- 172.21.15.45:0/2758874279 >> 172.21.15.45:0/2758874279 conn(0x7f1bd00a6440 msgr2=0x7f1bd00c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:44.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:44.934+0000 7f1bd71ab640 1 -- 172.21.15.45:0/2758874279 shutdown_connections 2023-10-03T19:16:44.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:44.934+0000 7f1bd71ab640 1 -- 172.21.15.45:0/2758874279 wait complete. 2023-10-03T19:16:44.961 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-03T19:16:45.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.090+0000 7f0736016640 1 Processor -- start 2023-10-03T19:16:45.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.090+0000 7f0736016640 1 -- start start 2023-10-03T19:16:45.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.090+0000 7f0736016640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07300712c0 0x7f073006cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:45.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.090+0000 7f0736016640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f07300a5d20 0x7f07300a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:45.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.090+0000 7f0736016640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07301507f0 con 0x7f073006c3f0 2023-10-03T19:16:45.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.090+0000 7f0736016640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07300bc250 con 0x7f07300a5d20 2023-10-03T19:16:45.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.090+0000 7f0736016640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073014cae0 con 0x7f07300712c0 2023-10-03T19:16:45.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.090+0000 7f072ffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f07300a5d20 0x7f07300a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:45.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.090+0000 7f072f7fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07300712c0 0x7f073006cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:45.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.090+0000 7f072effd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f073006c3f0 0x7f073014c3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:37140/0 (socket says 172.21.15.45:37140) 2023-10-03T19:16:45.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.090+0000 7f072effd640 1 -- 172.21.15.45:0/1207632987 learned_addr learned my addr 172.21.15.45:0/1207632987 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:45.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.090+0000 7f072f7fe640 1 -- 172.21.15.45:0/1207632987 >> v2:172.21.15.79:3300/0 conn(0x7f07300a5d20 msgr2=0x7f07300a4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:45.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.090+0000 7f072f7fe640 1 --2- 172.21.15.45:0/1207632987 >> v2:172.21.15.79:3300/0 conn(0x7f07300a5d20 0x7f07300a4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:45.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.090+0000 7f072f7fe640 1 -- 172.21.15.45:0/1207632987 >> v1:172.21.15.79:6789/0 conn(0x7f073006c3f0 legacy=0x7f073014c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:45.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.090+0000 7f072f7fe640 1 -- 172.21.15.45:0/1207632987 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07300a5a40 con 0x7f07300712c0 2023-10-03T19:16:45.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.090+0000 7f072ffff640 1 --2- 172.21.15.45:0/1207632987 >> v2:172.21.15.79:3300/0 conn(0x7f07300a5d20 0x7f07300a4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:16:45.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.094+0000 7f072f7fe640 1 --2- 172.21.15.45:0/1207632987 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07300712c0 0x7f073006cc30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f07200097c0 tx=0x7f072001c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25b14fdca11f9533 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:45.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.094+0000 7f072e7fc640 1 -- 172.21.15.45:0/1207632987 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07200ab600 con 0x7f07300712c0 2023-10-03T19:16:45.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.094+0000 7f072e7fc640 1 -- 172.21.15.45:0/1207632987 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07200a7050 con 0x7f07300712c0 2023-10-03T19:16:45.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.094+0000 7f072e7fc640 1 -- 172.21.15.45:0/1207632987 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07200ab980 con 0x7f07300712c0 2023-10-03T19:16:45.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.094+0000 7f0736016640 1 -- 172.21.15.45:0/1207632987 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07300712c0 msgr2=0x7f073006cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:45.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.094+0000 7f0736016640 1 --2- 172.21.15.45:0/1207632987 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07300712c0 0x7f073006cc30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f07200097c0 tx=0x7f072001c330 comp rx=0 tx=0).stop 2023-10-03T19:16:45.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.094+0000 7f0736016640 1 -- 172.21.15.45:0/1207632987 shutdown_connections 2023-10-03T19:16:45.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.094+0000 7f0736016640 1 --2- 172.21.15.45:0/1207632987 >> v2:172.21.15.79:3300/0 conn(0x7f07300a5d20 0x7f07300a4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:45.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.094+0000 7f0736016640 1 --2- 172.21.15.45:0/1207632987 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07300712c0 0x7f073006cc30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:45.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.094+0000 7f0736016640 1 -- 172.21.15.45:0/1207632987 >> 172.21.15.45:0/1207632987 conn(0x7f07300a20d0 msgr2=0x7f07300a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:45.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.094+0000 7f0736016640 1 -- 172.21.15.45:0/1207632987 shutdown_connections 2023-10-03T19:16:45.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.094+0000 7f0736016640 1 -- 172.21.15.45:0/1207632987 wait complete. 2023-10-03T19:16:45.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.098+0000 7f0736016640 1 Processor -- start 2023-10-03T19:16:45.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.098+0000 7f0736016640 1 -- start start 2023-10-03T19:16:45.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.098+0000 7f0736016640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f073006c3f0 0x7f0730144350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:45.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.098+0000 7f0736016640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07300712c0 0x7f07300bd050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:45.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.098+0000 7f0736016640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07300a5d20 0x7f073014b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:45.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.098+0000 7f0736016640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073014d680 con 0x7f07300a5d20 2023-10-03T19:16:45.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.098+0000 7f0736016640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073014f670 con 0x7f07300712c0 2023-10-03T19:16:45.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.098+0000 7f0736016640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07300bd590 con 0x7f073006c3f0 2023-10-03T19:16:45.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.098+0000 7f072ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07300a5d20 0x7f073014b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:45.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.098+0000 7f072ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07300a5d20 0x7f073014b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36852/0 (socket says 172.21.15.45:36852) 2023-10-03T19:16:45.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.098+0000 7f072ffff640 1 -- 172.21.15.45:0/2749293155 learned_addr learned my addr 172.21.15.45:0/2749293155 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:45.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.098+0000 7f072f7fe640 1 --2- 172.21.15.45:0/2749293155 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f073006c3f0 0x7f0730144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:45.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.098+0000 7f072effd640 1 --2- 172.21.15.45:0/2749293155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07300712c0 0x7f07300bd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:45.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.098+0000 7f072ffff640 1 -- 172.21.15.45:0/2749293155 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f073006c3f0 msgr2=0x7f0730144350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:45.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.098+0000 7f072ffff640 1 --2- 172.21.15.45:0/2749293155 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f073006c3f0 0x7f0730144350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:45.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.098+0000 7f072ffff640 1 -- 172.21.15.45:0/2749293155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07300712c0 msgr2=0x7f07300bd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:45.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.098+0000 7f072ffff640 1 --2- 172.21.15.45:0/2749293155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07300712c0 0x7f07300bd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:45.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.098+0000 7f072ffff640 1 -- 172.21.15.45:0/2749293155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0728009a70 con 0x7f07300a5d20 2023-10-03T19:16:45.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.098+0000 7f072ffff640 1 --2- 172.21.15.45:0/2749293155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07300a5d20 0x7f073014b2b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f0728009e60 tx=0x7f072800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:45.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.098+0000 7f0717fff640 1 -- 172.21.15.45:0/2749293155 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0728009cd0 con 0x7f07300a5d20 2023-10-03T19:16:45.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.098+0000 7f0717fff640 1 -- 172.21.15.45:0/2749293155 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072800f040 con 0x7f07300a5d20 2023-10-03T19:16:45.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.098+0000 7f0717fff640 1 -- 172.21.15.45:0/2749293155 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07280039a0 con 0x7f07300a5d20 2023-10-03T19:16:45.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.098+0000 7f0736016640 1 -- 172.21.15.45:0/2749293155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0720009420 con 0x7f07300a5d20 2023-10-03T19:16:45.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.098+0000 7f0736016640 1 -- 172.21.15.45:0/2749293155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0730071690 con 0x7f07300a5d20 2023-10-03T19:16:45.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.098+0000 7f0736016640 1 -- 172.21.15.45:0/2749293155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07300a6120 con 0x7f07300a5d20 2023-10-03T19:16:45.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.102+0000 7f0717fff640 1 -- 172.21.15.45:0/2749293155 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0728014480 con 0x7f07300a5d20 2023-10-03T19:16:45.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.102+0000 7f0717fff640 1 --2- 172.21.15.45:0/2749293155 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f071c066280 0x7f071c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:45.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.102+0000 7f0717fff640 1 -- 172.21.15.45:0/2749293155 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f0728084730 con 0x7f07300a5d20 2023-10-03T19:16:45.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.102+0000 7f072f7fe640 1 --2- 172.21.15.45:0/2749293155 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f071c066280 0x7f071c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:45.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.102+0000 7f072f7fe640 1 --2- 172.21.15.45:0/2749293155 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f071c066280 0x7f071c068730 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f07200ad000 tx=0x7f07200a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:45.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.106+0000 7f0717fff640 1 -- 172.21.15.45:0/2749293155 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f07280557b0 con 0x7f07300a5d20 2023-10-03T19:16:45.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.262+0000 7f0736016640 1 -- 172.21.15.45:0/2749293155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0730071820 con 0x7f07300a5d20 2023-10-03T19:16:45.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.922+0000 7f0717fff640 1 -- 172.21.15.45:0/2749293155 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v59) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0728055340 con 0x7f07300a5d20 2023-10-03T19:16:45.932 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-10-03T19:16:45.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.938+0000 7f0736016640 1 -- 172.21.15.45:0/2749293155 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f071c066280 msgr2=0x7f071c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:45.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.938+0000 7f0736016640 1 --2- 172.21.15.45:0/2749293155 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f071c066280 0x7f071c068730 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f07200ad000 tx=0x7f07200a6000 comp rx=0 tx=0).stop 2023-10-03T19:16:45.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.938+0000 7f0736016640 1 -- 172.21.15.45:0/2749293155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07300a5d20 msgr2=0x7f073014b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:45.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.938+0000 7f0736016640 1 --2- 172.21.15.45:0/2749293155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07300a5d20 0x7f073014b2b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f0728009e60 tx=0x7f072800c490 comp rx=0 tx=0).stop 2023-10-03T19:16:45.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.938+0000 7f0736016640 1 -- 172.21.15.45:0/2749293155 shutdown_connections 2023-10-03T19:16:45.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.938+0000 7f0736016640 1 --2- 172.21.15.45:0/2749293155 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f071c066280 0x7f071c068730 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:45.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.938+0000 7f0736016640 1 --2- 172.21.15.45:0/2749293155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07300a5d20 0x7f073014b2b0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:45.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.938+0000 7f0736016640 1 --2- 172.21.15.45:0/2749293155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07300712c0 0x7f07300bd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:45.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.938+0000 7f0736016640 1 --2- 172.21.15.45:0/2749293155 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f073006c3f0 0x7f0730144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:45.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.938+0000 7f0736016640 1 -- 172.21.15.45:0/2749293155 >> 172.21.15.45:0/2749293155 conn(0x7f07300a20d0 msgr2=0x7f07300bf400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:45.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.938+0000 7f0736016640 1 -- 172.21.15.45:0/2749293155 shutdown_connections 2023-10-03T19:16:45.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:45.938+0000 7f0736016640 1 -- 172.21.15.45:0/2749293155 wait complete. 2023-10-03T19:16:45.971 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-03T19:16:46.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.086+0000 7ff25f31e640 1 Processor -- start 2023-10-03T19:16:46.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.086+0000 7ff25f31e640 1 -- start start 2023-10-03T19:16:46.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.086+0000 7ff25f31e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff2580c19b0 0x7ff2580bd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:46.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.086+0000 7ff25f31e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff25814fa20 0x7ff25814fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:46.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.086+0000 7ff25f31e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2580c14c0 con 0x7ff2580c07f0 2023-10-03T19:16:46.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.086+0000 7ff25f31e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2580be420 con 0x7ff2580c19b0 2023-10-03T19:16:46.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.086+0000 7ff25f31e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2580a1f80 con 0x7ff25814fa20 2023-10-03T19:16:46.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.086+0000 7ff25c8b9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff2580c19b0 0x7ff2580bd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:46.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.086+0000 7ff25c8b9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff2580c19b0 0x7ff2580bd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36858/0 (socket says 172.21.15.45:36858) 2023-10-03T19:16:46.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.086+0000 7ff25c8b9640 1 -- 172.21.15.45:0/2587756984 learned_addr learned my addr 172.21.15.45:0/2587756984 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:46.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.086+0000 7ff25d8bb640 1 --2- 172.21.15.45:0/2587756984 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff25814fa20 0x7ff25814fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:46.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.086+0000 7ff25c8b9640 1 -- 172.21.15.45:0/2587756984 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff25814fa20 msgr2=0x7ff25814fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:46.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.086+0000 7ff25c8b9640 1 --2- 172.21.15.45:0/2587756984 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff25814fa20 0x7ff25814fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:46.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.086+0000 7ff25c8b9640 1 -- 172.21.15.45:0/2587756984 >> v1:172.21.15.79:6789/0 conn(0x7ff2580c07f0 legacy=0x7ff25814bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:46.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.086+0000 7ff25c8b9640 1 -- 172.21.15.45:0/2587756984 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2580bd070 con 0x7ff2580c19b0 2023-10-03T19:16:46.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.086+0000 7ff25d8bb640 1 --2- 172.21.15.45:0/2587756984 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff25814fa20 0x7ff25814fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:46.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff25c8b9640 1 --2- 172.21.15.45:0/2587756984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2580c19b0 0x7ff2580bd640 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff24c0098a0 tx=0x7ff24c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=722086b5a2578e46 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:46.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff257fff640 1 -- 172.21.15.45:0/2587756984 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24c0ac640 con 0x7ff2580c19b0 2023-10-03T19:16:46.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff257fff640 1 -- 172.21.15.45:0/2587756984 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff24c0ac7a0 con 0x7ff2580c19b0 2023-10-03T19:16:46.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff257fff640 1 -- 172.21.15.45:0/2587756984 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24c0acb30 con 0x7ff2580c19b0 2023-10-03T19:16:46.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff25f31e640 1 -- 172.21.15.45:0/2587756984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2580c19b0 msgr2=0x7ff2580bd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:46.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff25f31e640 1 --2- 172.21.15.45:0/2587756984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2580c19b0 0x7ff2580bd640 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff24c0098a0 tx=0x7ff24c01c420 comp rx=0 tx=0).stop 2023-10-03T19:16:46.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff25f31e640 1 -- 172.21.15.45:0/2587756984 shutdown_connections 2023-10-03T19:16:46.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff25f31e640 1 --2- 172.21.15.45:0/2587756984 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff25814fa20 0x7ff25814fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:46.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff25f31e640 1 --2- 172.21.15.45:0/2587756984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2580c19b0 0x7ff2580bd640 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:46.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff25f31e640 1 -- 172.21.15.45:0/2587756984 >> 172.21.15.45:0/2587756984 conn(0x7ff2580a4260 msgr2=0x7ff2580a4660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:46.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff25f31e640 1 -- 172.21.15.45:0/2587756984 shutdown_connections 2023-10-03T19:16:46.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff25f31e640 1 -- 172.21.15.45:0/2587756984 wait complete. 2023-10-03T19:16:46.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff25f31e640 1 Processor -- start 2023-10-03T19:16:46.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff25f31e640 1 -- start start 2023-10-03T19:16:46.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff25f31e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2580c07f0 0x7ff258145710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:46.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff25f31e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2580c19b0 0x7ff2580bc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:46.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff25f31e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff25814fa20 0x7ff2580bca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:46.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff25f31e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff258140580 con 0x7ff2580c07f0 2023-10-03T19:16:46.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff25f31e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2581e5400 con 0x7ff2580c19b0 2023-10-03T19:16:46.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff25f31e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2581481c0 con 0x7ff25814fa20 2023-10-03T19:16:46.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff25d0ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2580c07f0 0x7ff258145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:46.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff25d0ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2580c07f0 0x7ff258145710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36866/0 (socket says 172.21.15.45:36866) 2023-10-03T19:16:46.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff25d0ba640 1 -- 172.21.15.45:0/2365913286 learned_addr learned my addr 172.21.15.45:0/2365913286 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:46.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff25c8b9640 1 --2- 172.21.15.45:0/2365913286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2580c19b0 0x7ff2580bc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:46.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff25d8bb640 1 --2- 172.21.15.45:0/2365913286 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff25814fa20 0x7ff2580bca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:46.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff25d0ba640 1 -- 172.21.15.45:0/2365913286 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff25814fa20 msgr2=0x7ff2580bca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:46.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff25d0ba640 1 --2- 172.21.15.45:0/2365913286 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff25814fa20 0x7ff2580bca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:46.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff25d0ba640 1 -- 172.21.15.45:0/2365913286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2580c19b0 msgr2=0x7ff2580bc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:46.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff25d0ba640 1 --2- 172.21.15.45:0/2365913286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2580c19b0 0x7ff2580bc520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:46.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff25d0ba640 1 -- 172.21.15.45:0/2365913286 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff24c0094d0 con 0x7ff2580c07f0 2023-10-03T19:16:46.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff25d0ba640 1 --2- 172.21.15.45:0/2365913286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2580c07f0 0x7ff258145710 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff24800bab0 tx=0x7ff24800bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:46.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.090+0000 7ff255ffb640 1 -- 172.21.15.45:0/2365913286 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24800cc60 con 0x7ff2580c07f0 2023-10-03T19:16:46.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.094+0000 7ff255ffb640 1 -- 172.21.15.45:0/2365913286 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff24800ce00 con 0x7ff2580c07f0 2023-10-03T19:16:46.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.094+0000 7ff255ffb640 1 -- 172.21.15.45:0/2365913286 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff248003bc0 con 0x7ff2580c07f0 2023-10-03T19:16:46.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.094+0000 7ff25f31e640 1 -- 172.21.15.45:0/2365913286 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2580c0d50 con 0x7ff2580c07f0 2023-10-03T19:16:46.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.094+0000 7ff25f31e640 1 -- 172.21.15.45:0/2365913286 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2580c0bc0 con 0x7ff2580c07f0 2023-10-03T19:16:46.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.094+0000 7ff25f31e640 1 -- 172.21.15.45:0/2365913286 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff25814c1c0 con 0x7ff2580c07f0 2023-10-03T19:16:46.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.094+0000 7ff255ffb640 1 -- 172.21.15.45:0/2365913286 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff248003d20 con 0x7ff2580c07f0 2023-10-03T19:16:46.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.094+0000 7ff255ffb640 1 --2- 172.21.15.45:0/2365913286 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff2440662b0 0x7ff244068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:46.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.094+0000 7ff255ffb640 1 -- 172.21.15.45:0/2365913286 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5962+0+0 (secure 0 0 0) 0x7ff248083a00 con 0x7ff2580c07f0 2023-10-03T19:16:46.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.094+0000 7ff25c8b9640 1 --2- 172.21.15.45:0/2365913286 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff2440662b0 0x7ff244068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:46.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.094+0000 7ff25c8b9640 1 --2- 172.21.15.45:0/2365913286 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff2440662b0 0x7ff244068760 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff24c0ae000 tx=0x7ff24c0a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:46.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.098+0000 7ff255ffb640 1 -- 172.21.15.45:0/2365913286 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff248051020 con 0x7ff2580c07f0 2023-10-03T19:16:46.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.290+0000 7ff25f31e640 1 -- 172.21.15.45:0/2365913286 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff25804de80 con 0x7ff2580c07f0 2023-10-03T19:16:46.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.298+0000 7ff255ffb640 1 -- 172.21.15.45:0/2365913286 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v27) v1 ==== 173+0+0 (secure 0 0 0) 0x7ff248054640 con 0x7ff2580c07f0 2023-10-03T19:16:46.306 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 9 and data pool 10 2023-10-03T19:16:46.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.306+0000 7ff25f31e640 1 -- 172.21.15.45:0/2365913286 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff2440662b0 msgr2=0x7ff244068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:46.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.306+0000 7ff25f31e640 1 --2- 172.21.15.45:0/2365913286 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff2440662b0 0x7ff244068760 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff24c0ae000 tx=0x7ff24c0a7000 comp rx=0 tx=0).stop 2023-10-03T19:16:46.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.306+0000 7ff25f31e640 1 -- 172.21.15.45:0/2365913286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2580c07f0 msgr2=0x7ff258145710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:46.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.306+0000 7ff25f31e640 1 --2- 172.21.15.45:0/2365913286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2580c07f0 0x7ff258145710 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff24800bab0 tx=0x7ff24800bf70 comp rx=0 tx=0).stop 2023-10-03T19:16:46.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.314+0000 7ff25f31e640 1 -- 172.21.15.45:0/2365913286 shutdown_connections 2023-10-03T19:16:46.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.314+0000 7ff25f31e640 1 --2- 172.21.15.45:0/2365913286 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff2440662b0 0x7ff244068760 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:46.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.314+0000 7ff25f31e640 1 --2- 172.21.15.45:0/2365913286 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff25814fa20 0x7ff2580bca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:46.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.314+0000 7ff25f31e640 1 --2- 172.21.15.45:0/2365913286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2580c19b0 0x7ff2580bc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:46.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.314+0000 7ff25f31e640 1 --2- 172.21.15.45:0/2365913286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2580c07f0 0x7ff258145710 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:46.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.314+0000 7ff25f31e640 1 -- 172.21.15.45:0/2365913286 >> 172.21.15.45:0/2365913286 conn(0x7ff2580a4260 msgr2=0x7ff25814ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:46.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.314+0000 7ff25f31e640 1 -- 172.21.15.45:0/2365913286 shutdown_connections 2023-10-03T19:16:46.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.314+0000 7ff25f31e640 1 -- 172.21.15.45:0/2365913286 wait complete. 2023-10-03T19:16:46.341 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:16:46.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.454+0000 7f08ae43b640 1 Processor -- start 2023-10-03T19:16:46.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.458+0000 7f08ae43b640 1 -- start start 2023-10-03T19:16:46.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.458+0000 7f08ae43b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f08a80c2790 0x7f08a81528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:46.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.458+0000 7f08ae43b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f08a80bb1d0 0x7f08a80c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:46.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.458+0000 7f08ae43b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a806b2d0 con 0x7f08a814f240 2023-10-03T19:16:46.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.458+0000 7f08ae43b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a806b640 con 0x7f08a80c2790 2023-10-03T19:16:46.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.458+0000 7f08ae43b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a80a3c60 con 0x7f08a80bb1d0 2023-10-03T19:16:46.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.458+0000 7f08a77fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f08a80c2790 0x7f08a81528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:46.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.458+0000 7f08a77fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f08a80c2790 0x7f08a81528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36876/0 (socket says 172.21.15.45:36876) 2023-10-03T19:16:46.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.458+0000 7f08a77fe640 1 -- 172.21.15.45:0/82891141 learned_addr learned my addr 172.21.15.45:0/82891141 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:46.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.458+0000 7f08ac9d8640 1 --2- 172.21.15.45:0/82891141 >> v2:172.21.15.79:3300/0 conn(0x7f08a80bb1d0 0x7f08a80c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:46.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.458+0000 7f08a77fe640 1 -- 172.21.15.45:0/82891141 >> v2:172.21.15.79:3300/0 conn(0x7f08a80bb1d0 msgr2=0x7f08a80c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:46.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.458+0000 7f08a77fe640 1 --2- 172.21.15.45:0/82891141 >> v2:172.21.15.79:3300/0 conn(0x7f08a80bb1d0 0x7f08a80c12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:46.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.458+0000 7f08a77fe640 1 -- 172.21.15.45:0/82891141 >> v1:172.21.15.79:6789/0 conn(0x7f08a814f240 legacy=0x7f08a80c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:46.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.458+0000 7f08a77fe640 1 -- 172.21.15.45:0/82891141 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a814e740 con 0x7f08a80c2790 2023-10-03T19:16:46.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.458+0000 7f08ac9d8640 1 --2- 172.21.15.45:0/82891141 >> v2:172.21.15.79:3300/0 conn(0x7f08a80bb1d0 0x7f08a80c12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:16:46.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.458+0000 7f08a77fe640 1 --2- 172.21.15.45:0/82891141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a80c2790 0x7f08a81528d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f08a80c1d60 tx=0x7f089001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b20e57f6cf45be6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:46.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.458+0000 7f08a6ffd640 1 -- 172.21.15.45:0/82891141 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08900a89f0 con 0x7f08a80c2790 2023-10-03T19:16:46.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08a6ffd640 1 -- 172.21.15.45:0/82891141 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08900a8b50 con 0x7f08a80c2790 2023-10-03T19:16:46.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08a6ffd640 1 -- 172.21.15.45:0/82891141 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08900b0440 con 0x7f08a80c2790 2023-10-03T19:16:46.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08ae43b640 1 -- 172.21.15.45:0/82891141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a80c2790 msgr2=0x7f08a81528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:46.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08ae43b640 1 --2- 172.21.15.45:0/82891141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a80c2790 0x7f08a81528d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f08a80c1d60 tx=0x7f089001ecf0 comp rx=0 tx=0).stop 2023-10-03T19:16:46.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08ae43b640 1 -- 172.21.15.45:0/82891141 shutdown_connections 2023-10-03T19:16:46.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08ae43b640 1 --2- 172.21.15.45:0/82891141 >> v2:172.21.15.79:3300/0 conn(0x7f08a80bb1d0 0x7f08a80c12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:46.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08ae43b640 1 --2- 172.21.15.45:0/82891141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a80c2790 0x7f08a81528d0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:46.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08ae43b640 1 -- 172.21.15.45:0/82891141 >> 172.21.15.45:0/82891141 conn(0x7f08a80a64a0 msgr2=0x7f08a80a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:46.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08ae43b640 1 -- 172.21.15.45:0/82891141 shutdown_connections 2023-10-03T19:16:46.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08ae43b640 1 -- 172.21.15.45:0/82891141 wait complete. 2023-10-03T19:16:46.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08ae43b640 1 Processor -- start 2023-10-03T19:16:46.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08ae43b640 1 -- start start 2023-10-03T19:16:46.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08ae43b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08a80bb1d0 0x7f08a81e4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:46.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08ae43b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08a80c2790 0x7f08a81dab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:46.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08ae43b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a814f240 0x7f08a814a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:46.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08ae43b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a8151100 con 0x7f08a814f240 2023-10-03T19:16:46.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08ae43b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a81db0c0 con 0x7f08a80c2790 2023-10-03T19:16:46.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08ae43b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a8149d00 con 0x7f08a80bb1d0 2023-10-03T19:16:46.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08ac9d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a814f240 0x7f08a814a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:46.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08ac9d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a814f240 0x7f08a814a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36882/0 (socket says 172.21.15.45:36882) 2023-10-03T19:16:46.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08ac9d8640 1 -- 172.21.15.45:0/3321756932 learned_addr learned my addr 172.21.15.45:0/3321756932 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:46.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08a77fe640 1 --2- 172.21.15.45:0/3321756932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08a80c2790 0x7f08a81dab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:46.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08a7fff640 1 --2- 172.21.15.45:0/3321756932 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08a80bb1d0 0x7f08a81e4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:46.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08ac9d8640 1 -- 172.21.15.45:0/3321756932 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08a80bb1d0 msgr2=0x7f08a81e4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:46.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08ac9d8640 1 --2- 172.21.15.45:0/3321756932 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08a80bb1d0 0x7f08a81e4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:46.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08ac9d8640 1 -- 172.21.15.45:0/3321756932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08a80c2790 msgr2=0x7f08a81dab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:46.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08ac9d8640 1 --2- 172.21.15.45:0/3321756932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08a80c2790 0x7f08a81dab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:46.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08ac9d8640 1 -- 172.21.15.45:0/3321756932 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0890009480 con 0x7f08a814f240 2023-10-03T19:16:46.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08ac9d8640 1 --2- 172.21.15.45:0/3321756932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a814f240 0x7f08a814a270 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f08a000e840 tx=0x7f08a000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:46.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08a4ff9640 1 -- 172.21.15.45:0/3321756932 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a000c6d0 con 0x7f08a814f240 2023-10-03T19:16:46.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08a4ff9640 1 -- 172.21.15.45:0/3321756932 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a000c830 con 0x7f08a814f240 2023-10-03T19:16:46.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08ae43b640 1 -- 172.21.15.45:0/3321756932 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a814f610 con 0x7f08a814f240 2023-10-03T19:16:46.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08a4ff9640 1 -- 172.21.15.45:0/3321756932 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a000cbe0 con 0x7f08a814f240 2023-10-03T19:16:46.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.462+0000 7f08ae43b640 1 -- 172.21.15.45:0/3321756932 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a80a3f40 con 0x7f08a814f240 2023-10-03T19:16:46.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.466+0000 7f08ae43b640 1 -- 172.21.15.45:0/3321756932 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a80bf360 con 0x7f08a814f240 2023-10-03T19:16:46.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.466+0000 7f08a4ff9640 1 -- 172.21.15.45:0/3321756932 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f08a000cd40 con 0x7f08a814f240 2023-10-03T19:16:46.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.466+0000 7f08a4ff9640 1 --2- 172.21.15.45:0/3321756932 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f08880662b0 0x7f0888068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:46.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.466+0000 7f08a4ff9640 1 -- 172.21.15.45:0/3321756932 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f08a0083b90 con 0x7f08a814f240 2023-10-03T19:16:46.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.466+0000 7f08a7fff640 1 --2- 172.21.15.45:0/3321756932 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f08880662b0 0x7f0888068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:46.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.466+0000 7f08a7fff640 1 --2- 172.21.15.45:0/3321756932 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f08880662b0 0x7f0888068760 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0898001340 tx=0x7f0898009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:46.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.470+0000 7f08a4ff9640 1 -- 172.21.15.45:0/3321756932 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f08a0050f70 con 0x7f08a814f240 2023-10-03T19:16:46.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.626+0000 7f08ae43b640 1 -- 172.21.15.45:0/3321756932 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08a81512b0 con 0x7f08a814f240 2023-10-03T19:16:46.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.630+0000 7f08a4ff9640 1 -- 172.21.15.45:0/3321756932 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+18258 (secure 0 0 0) 0x7f08a81512b0 con 0x7f08a814f240 2023-10-03T19:16:46.635 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:16:46.635 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":60,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:16:46.296395+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:16:44.176075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-03T19:16:45.307579+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:16:46.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.630+0000 7f08ae43b640 1 -- 172.21.15.45:0/3321756932 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f08880662b0 msgr2=0x7f0888068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:46.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.630+0000 7f08ae43b640 1 --2- 172.21.15.45:0/3321756932 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f08880662b0 0x7f0888068760 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0898001340 tx=0x7f0898009040 comp rx=0 tx=0).stop 2023-10-03T19:16:46.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.630+0000 7f08ae43b640 1 -- 172.21.15.45:0/3321756932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a814f240 msgr2=0x7f08a814a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:46.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.630+0000 7f08ae43b640 1 --2- 172.21.15.45:0/3321756932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a814f240 0x7f08a814a270 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f08a000e840 tx=0x7f08a000ed00 comp rx=0 tx=0).stop 2023-10-03T19:16:46.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.630+0000 7f08ae43b640 1 -- 172.21.15.45:0/3321756932 shutdown_connections 2023-10-03T19:16:46.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.630+0000 7f08ae43b640 1 --2- 172.21.15.45:0/3321756932 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f08880662b0 0x7f0888068760 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:46.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.630+0000 7f08ae43b640 1 --2- 172.21.15.45:0/3321756932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a814f240 0x7f08a814a270 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:46.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.630+0000 7f08ae43b640 1 --2- 172.21.15.45:0/3321756932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08a80c2790 0x7f08a81dab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:46.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.630+0000 7f08ae43b640 1 --2- 172.21.15.45:0/3321756932 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08a80bb1d0 0x7f08a81e4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:46.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.630+0000 7f08ae43b640 1 -- 172.21.15.45:0/3321756932 >> 172.21.15.45:0/3321756932 conn(0x7f08a80a64a0 msgr2=0x7f08a80a6870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:46.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.630+0000 7f08ae43b640 1 -- 172.21.15.45:0/3321756932 shutdown_connections 2023-10-03T19:16:46.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.630+0000 7f08ae43b640 1 -- 172.21.15.45:0/3321756932 wait complete. 2023-10-03T19:16:46.655 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:16:46.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.770+0000 7f40f1eb6640 1 Processor -- start 2023-10-03T19:16:46.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40f1eb6640 1 -- start start 2023-10-03T19:16:46.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40f1eb6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40ec06c9a0 0x7f40ec156d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:46.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40f1eb6640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40ec14b610 con 0x7f40ec148b90 2023-10-03T19:16:46.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40f1eb6640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40ec0a5580 con 0x7f40ec0bcb60 2023-10-03T19:16:46.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40f1eb6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec0a3670 con 0x7f40ec06c9a0 2023-10-03T19:16:46.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40eb7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f40ec148b90 0x7f40ec0bbf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55510/0 (socket says 172.21.15.45:55510) 2023-10-03T19:16:46.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40eb7fe640 1 -- 172.21.15.45:0/1930052014 learned_addr learned my addr 172.21.15.45:0/1930052014 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:46.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40ebfff640 1 --2- 172.21.15.45:0/1930052014 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40ec06c9a0 0x7f40ec156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:46.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40ea7fc640 1 -- 172.21.15.45:0/1930052014 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3379362137 0 0) 0x7f40ec14b610 con 0x7f40ec148b90 2023-10-03T19:16:46.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40ea7fc640 1 -- 172.21.15.45:0/1930052014 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40d8005740 con 0x7f40ec148b90 2023-10-03T19:16:46.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40ea7fc640 1 -- 172.21.15.45:0/1930052014 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2322619945 0 0) 0x7f40d8005740 con 0x7f40ec148b90 2023-10-03T19:16:46.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40ea7fc640 1 -- 172.21.15.45:0/1930052014 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40ec06c9a0 msgr2=0x7f40ec156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:46.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40ea7fc640 1 --2- 172.21.15.45:0/1930052014 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40ec06c9a0 0x7f40ec156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:46.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40ea7fc640 1 -- 172.21.15.45:0/1930052014 >> v1:172.21.15.79:6789/0 conn(0x7f40ec0bcb60 legacy=0x7f40ec06c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:46.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40ea7fc640 1 -- 172.21.15.45:0/1930052014 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ec0a5820 con 0x7f40ec148b90 2023-10-03T19:16:46.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40ea7fc640 1 -- 172.21.15.45:0/1930052014 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f40e4001a00 con 0x7f40ec148b90 2023-10-03T19:16:46.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40ea7fc640 1 -- 172.21.15.45:0/1930052014 >> v1:172.21.15.45:6789/0 conn(0x7f40ec148b90 legacy=0x7f40ec0bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:46.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40ea7fc640 1 --2- 172.21.15.45:0/1930052014 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40ec06c9a0 0x7f40d8005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:46.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40ea7fc640 1 --2- 172.21.15.45:0/1930052014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40d8006140 0x7f40d80069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:46.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40ea7fc640 1 --2- 172.21.15.45:0/1930052014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40d8006f20 0x7f40d8007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:46.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40ea7fc640 1 -- 172.21.15.45:0/1930052014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec0a3670 con 0x7f40d8006140 2023-10-03T19:16:46.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40ea7fc640 1 -- 172.21.15.45:0/1930052014 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d800dd10 con 0x7f40d8006f20 2023-10-03T19:16:46.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40ea7fc640 1 -- 172.21.15.45:0/1930052014 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d800ded0 con 0x7f40ec06c9a0 2023-10-03T19:16:46.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40eaffd640 1 --2- 172.21.15.45:0/1930052014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40d8006140 0x7f40d80069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:46.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40eb7fe640 1 --2- 172.21.15.45:0/1930052014 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40ec06c9a0 0x7f40d8005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:46.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40ebfff640 1 --2- 172.21.15.45:0/1930052014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40d8006f20 0x7f40d8007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:46.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40eaffd640 1 -- 172.21.15.45:0/1930052014 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40ec06c9a0 msgr2=0x7f40d8005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:46.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40eaffd640 1 --2- 172.21.15.45:0/1930052014 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40ec06c9a0 0x7f40d8005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:46.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40eaffd640 1 -- 172.21.15.45:0/1930052014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40d8006f20 msgr2=0x7f40d8007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:46.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40eaffd640 1 --2- 172.21.15.45:0/1930052014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40d8006f20 0x7f40d8007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:46.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.774+0000 7f40eaffd640 1 -- 172.21.15.45:0/1930052014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d8005740 con 0x7f40d8006140 2023-10-03T19:16:46.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.778+0000 7f40eaffd640 1 --2- 172.21.15.45:0/1930052014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40d8006140 0x7f40d80069e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f40d4001750 tx=0x7f40d401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c382d802787b04f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:46.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.778+0000 7f40ea7fc640 1 -- 172.21.15.45:0/1930052014 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d40052d0 con 0x7f40d8006140 2023-10-03T19:16:46.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.778+0000 7f40ea7fc640 1 -- 172.21.15.45:0/1930052014 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d40a7050 con 0x7f40d8006140 2023-10-03T19:16:46.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.778+0000 7f40ea7fc640 1 -- 172.21.15.45:0/1930052014 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d4003600 con 0x7f40d8006140 2023-10-03T19:16:46.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.778+0000 7f40f1eb6640 1 -- 172.21.15.45:0/1930052014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40d8006140 msgr2=0x7f40d80069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:46.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.778+0000 7f40f1eb6640 1 --2- 172.21.15.45:0/1930052014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40d8006140 0x7f40d80069e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f40d4001750 tx=0x7f40d401c3c0 comp rx=0 tx=0).stop 2023-10-03T19:16:46.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.778+0000 7f40ebfff640 1 -- 172.21.15.45:0/1930052014 reap_dead start 2023-10-03T19:16:46.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.778+0000 7f40f1eb6640 1 -- 172.21.15.45:0/1930052014 shutdown_connections 2023-10-03T19:16:46.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.778+0000 7f40f1eb6640 1 -- 172.21.15.45:0/1930052014 >> 172.21.15.45:0/1930052014 conn(0x7f40ec0bcf50 msgr2=0x7f40ec0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:46.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.778+0000 7f40f1eb6640 1 -- 172.21.15.45:0/1930052014 shutdown_connections 2023-10-03T19:16:46.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.778+0000 7f40f1eb6640 1 -- 172.21.15.45:0/1930052014 wait complete. 2023-10-03T19:16:46.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.778+0000 7f40f1eb6640 1 Processor -- start 2023-10-03T19:16:46.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.778+0000 7f40f1eb6640 1 -- start start 2023-10-03T19:16:46.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.778+0000 7f40f1eb6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40d8006140 0x7f40ec14ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:46.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.778+0000 7f40f1eb6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40ec14e570 0x7f40ec0b9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:46.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.778+0000 7f40f1eb6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40ec0704e0 0x7f40ec070930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:46.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.778+0000 7f40f1eb6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec14c760 con 0x7f40d8006140 2023-10-03T19:16:46.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.778+0000 7f40f1eb6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec14e980 con 0x7f40ec0704e0 2023-10-03T19:16:46.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.778+0000 7f40f1eb6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec0ba090 con 0x7f40ec14e570 2023-10-03T19:16:46.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.778+0000 7f40eb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40d8006140 0x7f40ec14ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:46.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.778+0000 7f40eb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40d8006140 0x7f40ec14ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36904/0 (socket says 172.21.15.45:36904) 2023-10-03T19:16:46.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.778+0000 7f40eb7fe640 1 -- 172.21.15.45:0/720673096 learned_addr learned my addr 172.21.15.45:0/720673096 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:46.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.778+0000 7f40ebfff640 1 --2- 172.21.15.45:0/720673096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40ec0704e0 0x7f40ec070930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:46.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.778+0000 7f40eaffd640 1 --2- 172.21.15.45:0/720673096 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40ec14e570 0x7f40ec0b9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:46.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.778+0000 7f40eb7fe640 1 -- 172.21.15.45:0/720673096 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40ec14e570 msgr2=0x7f40ec0b9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:46.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.778+0000 7f40eb7fe640 1 --2- 172.21.15.45:0/720673096 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40ec14e570 0x7f40ec0b9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:46.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.778+0000 7f40eb7fe640 1 -- 172.21.15.45:0/720673096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40ec0704e0 msgr2=0x7f40ec070930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:46.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.778+0000 7f40eb7fe640 1 --2- 172.21.15.45:0/720673096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40ec0704e0 0x7f40ec070930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:46.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.778+0000 7f40eb7fe640 1 -- 172.21.15.45:0/720673096 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ec148f60 con 0x7f40d8006140 2023-10-03T19:16:46.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.782+0000 7f40eb7fe640 1 --2- 172.21.15.45:0/720673096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40d8006140 0x7f40ec14ccb0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f40e4007ab0 tx=0x7f40e400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:46.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.782+0000 7f40e3fff640 1 -- 172.21.15.45:0/720673096 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e400edf0 con 0x7f40d8006140 2023-10-03T19:16:46.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.782+0000 7f40e3fff640 1 -- 172.21.15.45:0/720673096 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e4013420 con 0x7f40d8006140 2023-10-03T19:16:46.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.782+0000 7f40f1eb6640 1 -- 172.21.15.45:0/720673096 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40ec0bc670 con 0x7f40d8006140 2023-10-03T19:16:46.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.782+0000 7f40e3fff640 1 -- 172.21.15.45:0/720673096 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e40137d0 con 0x7f40d8006140 2023-10-03T19:16:46.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.782+0000 7f40f1eb6640 1 -- 172.21.15.45:0/720673096 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40ec0a3880 con 0x7f40d8006140 2023-10-03T19:16:46.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.782+0000 7f40f1eb6640 1 -- 172.21.15.45:0/720673096 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40ec04de80 con 0x7f40d8006140 2023-10-03T19:16:46.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.782+0000 7f40e3fff640 1 -- 172.21.15.45:0/720673096 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f40e4013930 con 0x7f40d8006140 2023-10-03T19:16:46.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.782+0000 7f40e3fff640 1 --2- 172.21.15.45:0/720673096 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f40cc066280 0x7f40cc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:46.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.782+0000 7f40e3fff640 1 -- 172.21.15.45:0/720673096 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f40e40843e0 con 0x7f40d8006140 2023-10-03T19:16:46.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.782+0000 7f40eaffd640 1 --2- 172.21.15.45:0/720673096 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f40cc066280 0x7f40cc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:46.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.782+0000 7f40eaffd640 1 --2- 172.21.15.45:0/720673096 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f40cc066280 0x7f40cc068730 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f40d8006960 tx=0x7f40d40011a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:46.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.786+0000 7f40e3fff640 1 -- 172.21.15.45:0/720673096 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f40e40518f0 con 0x7f40d8006140 2023-10-03T19:16:46.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.946+0000 7f40f1eb6640 1 -- 172.21.15.45:0/720673096 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40ec14e070 con 0x7f40d8006140 2023-10-03T19:16:46.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.950+0000 7f40e3fff640 1 -- 172.21.15.45:0/720673096 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+18258 (secure 0 0 0) 0x7f40e4054f10 con 0x7f40d8006140 2023-10-03T19:16:46.957 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:16:46.957 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":60,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:16:46.296395+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:16:44.176075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-03T19:16:45.307579+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:16:46.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.954+0000 7f40f1eb6640 1 -- 172.21.15.45:0/720673096 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f40cc066280 msgr2=0x7f40cc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:46.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.954+0000 7f40f1eb6640 1 --2- 172.21.15.45:0/720673096 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f40cc066280 0x7f40cc068730 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f40d8006960 tx=0x7f40d40011a0 comp rx=0 tx=0).stop 2023-10-03T19:16:46.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.954+0000 7f40f1eb6640 1 -- 172.21.15.45:0/720673096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40d8006140 msgr2=0x7f40ec14ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:46.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.954+0000 7f40f1eb6640 1 --2- 172.21.15.45:0/720673096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40d8006140 0x7f40ec14ccb0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f40e4007ab0 tx=0x7f40e400e530 comp rx=0 tx=0).stop 2023-10-03T19:16:46.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.954+0000 7f40f1eb6640 1 -- 172.21.15.45:0/720673096 shutdown_connections 2023-10-03T19:16:46.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.954+0000 7f40f1eb6640 1 --2- 172.21.15.45:0/720673096 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f40cc066280 0x7f40cc068730 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:46.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.954+0000 7f40f1eb6640 1 --2- 172.21.15.45:0/720673096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40ec0704e0 0x7f40ec070930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:46.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.954+0000 7f40f1eb6640 1 --2- 172.21.15.45:0/720673096 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40ec14e570 0x7f40ec0b9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:46.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.954+0000 7f40f1eb6640 1 --2- 172.21.15.45:0/720673096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40d8006140 0x7f40ec14ccb0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:46.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.954+0000 7f40f1eb6640 1 -- 172.21.15.45:0/720673096 >> 172.21.15.45:0/720673096 conn(0x7f40ec0bcf50 msgr2=0x7f40ec146ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:46.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.954+0000 7f40f1eb6640 1 -- 172.21.15.45:0/720673096 shutdown_connections 2023-10-03T19:16:46.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:46.954+0000 7f40f1eb6640 1 -- 172.21.15.45:0/720673096 wait complete. 2023-10-03T19:16:46.977 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-03T19:16:47.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.090+0000 7f899f9f1640 1 Processor -- start 2023-10-03T19:16:47.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.090+0000 7f899f9f1640 1 -- start start 2023-10-03T19:16:47.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.094+0000 7f899f9f1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f899806d560 0x7f89980a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:47.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.094+0000 7f899f9f1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f899806c760 0x7f89980a5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:47.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.094+0000 7f899f9f1640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f899806c2d0 con 0x7f89980712c0 2023-10-03T19:16:47.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.094+0000 7f899f9f1640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8998150610 con 0x7f899806d560 2023-10-03T19:16:47.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.094+0000 7f899f9f1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89981508b0 con 0x7f899806c760 2023-10-03T19:16:47.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.094+0000 7f899cf8c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f899806d560 0x7f89980a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:47.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.094+0000 7f899d78d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f89980712c0 0x7f89980bcbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55512/0 (socket says 172.21.15.45:55512) 2023-10-03T19:16:47.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.094+0000 7f899d78d640 1 -- 172.21.15.45:0/122362484 learned_addr learned my addr 172.21.15.45:0/122362484 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:47.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.094+0000 7f899cf8c640 1 -- 172.21.15.45:0/122362484 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f899806c760 msgr2=0x7f89980a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:47.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.094+0000 7f899cf8c640 1 --2- 172.21.15.45:0/122362484 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f899806c760 0x7f89980a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:47.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.094+0000 7f899cf8c640 1 -- 172.21.15.45:0/122362484 >> v1:172.21.15.45:6789/0 conn(0x7f89980712c0 legacy=0x7f89980bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:47.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.094+0000 7f899cf8c640 1 -- 172.21.15.45:0/122362484 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899806d2e0 con 0x7f899806d560 2023-10-03T19:16:47.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.094+0000 7f899cf8c640 1 --2- 172.21.15.45:0/122362484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f899806d560 0x7f89980a53c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f89940097c0 tx=0x7f899401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5455b7ce3dd72a4c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:47.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.094+0000 7f898ffff640 1 -- 172.21.15.45:0/122362484 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89940ac620 con 0x7f899806d560 2023-10-03T19:16:47.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.094+0000 7f898ffff640 1 -- 172.21.15.45:0/122362484 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89940ac780 con 0x7f899806d560 2023-10-03T19:16:47.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.094+0000 7f898ffff640 1 -- 172.21.15.45:0/122362484 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89940acb10 con 0x7f899806d560 2023-10-03T19:16:47.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.094+0000 7f899f9f1640 1 -- 172.21.15.45:0/122362484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f899806d560 msgr2=0x7f89980a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:47.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.094+0000 7f899f9f1640 1 --2- 172.21.15.45:0/122362484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f899806d560 0x7f89980a53c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f89940097c0 tx=0x7f899401c480 comp rx=0 tx=0).stop 2023-10-03T19:16:47.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.094+0000 7f899f9f1640 1 -- 172.21.15.45:0/122362484 shutdown_connections 2023-10-03T19:16:47.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.094+0000 7f899f9f1640 1 --2- 172.21.15.45:0/122362484 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f899806c760 0x7f89980a5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:47.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.094+0000 7f899f9f1640 1 --2- 172.21.15.45:0/122362484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f899806d560 0x7f89980a53c0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:47.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.094+0000 7f899f9f1640 1 -- 172.21.15.45:0/122362484 >> 172.21.15.45:0/122362484 conn(0x7f89980a20d0 msgr2=0x7f89980a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:47.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.094+0000 7f899f9f1640 1 -- 172.21.15.45:0/122362484 shutdown_connections 2023-10-03T19:16:47.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.094+0000 7f899f9f1640 1 -- 172.21.15.45:0/122362484 wait complete. 2023-10-03T19:16:47.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.098+0000 7f899f9f1640 1 Processor -- start 2023-10-03T19:16:47.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.098+0000 7f899f9f1640 1 -- start start 2023-10-03T19:16:47.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.098+0000 7f899f9f1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f899806c760 0x7f8998070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:47.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.098+0000 7f899f9f1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f899806d560 0x7f89981eb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:47.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.098+0000 7f899f9f1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89980712c0 0x7f89981e7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:47.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.098+0000 7f899f9f1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899814f9c0 con 0x7f899806d560 2023-10-03T19:16:47.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.098+0000 7f899f9f1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89981eb610 con 0x7f899806c760 2023-10-03T19:16:47.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.098+0000 7f899f9f1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899814eb70 con 0x7f89980712c0 2023-10-03T19:16:47.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.098+0000 7f899cf8c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f899806d560 0x7f89981eb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:47.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.098+0000 7f899cf8c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f899806d560 0x7f89981eb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36916/0 (socket says 172.21.15.45:36916) 2023-10-03T19:16:47.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.098+0000 7f899cf8c640 1 -- 172.21.15.45:0/1650696861 learned_addr learned my addr 172.21.15.45:0/1650696861 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:47.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.098+0000 7f899d78d640 1 --2- 172.21.15.45:0/1650696861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f899806c760 0x7f8998070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:47.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.098+0000 7f899df8e640 1 --2- 172.21.15.45:0/1650696861 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89980712c0 0x7f89981e7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:47.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.098+0000 7f899cf8c640 1 -- 172.21.15.45:0/1650696861 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89980712c0 msgr2=0x7f89981e7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:47.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.098+0000 7f899cf8c640 1 --2- 172.21.15.45:0/1650696861 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89980712c0 0x7f89981e7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:47.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.098+0000 7f899cf8c640 1 -- 172.21.15.45:0/1650696861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f899806c760 msgr2=0x7f8998070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:47.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.098+0000 7f899cf8c640 1 --2- 172.21.15.45:0/1650696861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f899806c760 0x7f8998070350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:47.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.098+0000 7f899cf8c640 1 -- 172.21.15.45:0/1650696861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8994009420 con 0x7f899806d560 2023-10-03T19:16:47.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.098+0000 7f899cf8c640 1 --2- 172.21.15.45:0/1650696861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f899806d560 0x7f89981eb0d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f899401a0b0 tx=0x7f8994019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:47.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.098+0000 7f898dffb640 1 -- 172.21.15.45:0/1650696861 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89940b5610 con 0x7f899806d560 2023-10-03T19:16:47.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.098+0000 7f898dffb640 1 -- 172.21.15.45:0/1650696861 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89940b5790 con 0x7f899806d560 2023-10-03T19:16:47.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.098+0000 7f899f9f1640 1 -- 172.21.15.45:0/1650696861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89980bd460 con 0x7f899806d560 2023-10-03T19:16:47.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.098+0000 7f898dffb640 1 -- 172.21.15.45:0/1650696861 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89940b5b40 con 0x7f899806d560 2023-10-03T19:16:47.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.098+0000 7f899f9f1640 1 -- 172.21.15.45:0/1650696861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89980bd2d0 con 0x7f899806d560 2023-10-03T19:16:47.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.098+0000 7f899f9f1640 1 -- 172.21.15.45:0/1650696861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89981596f0 con 0x7f899806d560 2023-10-03T19:16:47.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.098+0000 7f898dffb640 1 -- 172.21.15.45:0/1650696861 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f89940b3040 con 0x7f899806d560 2023-10-03T19:16:47.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.102+0000 7f898dffb640 1 --2- 172.21.15.45:0/1650696861 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f897c066280 0x7f897c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:47.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.102+0000 7f898dffb640 1 -- 172.21.15.45:0/1650696861 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f899411de10 con 0x7f899806d560 2023-10-03T19:16:47.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.102+0000 7f899d78d640 1 --2- 172.21.15.45:0/1650696861 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f897c066280 0x7f897c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:47.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.102+0000 7f899d78d640 1 --2- 172.21.15.45:0/1650696861 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f897c066280 0x7f897c068730 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8988005890 tx=0x7f8988009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:47.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.106+0000 7f898dffb640 1 -- 172.21.15.45:0/1650696861 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f89940eb200 con 0x7f899806d560 2023-10-03T19:16:47.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.290+0000 7f899f9f1640 1 -- 172.21.15.45:0/1650696861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f899804de80 con 0x7f899806d560 2023-10-03T19:16:47.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.298+0000 7f898dffb640 1 -- 172.21.15.45:0/1650696861 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v28) v1 ==== 118+0+0 (secure 0 0 0) 0x7f89940b1070 con 0x7f899806d560 2023-10-03T19:16:47.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.302+0000 7f899f9f1640 1 -- 172.21.15.45:0/1650696861 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f897c066280 msgr2=0x7f897c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:47.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.302+0000 7f899f9f1640 1 --2- 172.21.15.45:0/1650696861 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f897c066280 0x7f897c068730 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8988005890 tx=0x7f8988009040 comp rx=0 tx=0).stop 2023-10-03T19:16:47.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.302+0000 7f899f9f1640 1 -- 172.21.15.45:0/1650696861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f899806d560 msgr2=0x7f89981eb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:47.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.302+0000 7f899f9f1640 1 --2- 172.21.15.45:0/1650696861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f899806d560 0x7f89981eb0d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f899401a0b0 tx=0x7f8994019220 comp rx=0 tx=0).stop 2023-10-03T19:16:47.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.302+0000 7f899f9f1640 1 -- 172.21.15.45:0/1650696861 shutdown_connections 2023-10-03T19:16:47.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.302+0000 7f899f9f1640 1 --2- 172.21.15.45:0/1650696861 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f897c066280 0x7f897c068730 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:47.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.302+0000 7f899f9f1640 1 --2- 172.21.15.45:0/1650696861 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89980712c0 0x7f89981e7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:47.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.302+0000 7f899f9f1640 1 --2- 172.21.15.45:0/1650696861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f899806d560 0x7f89981eb0d0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:47.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.302+0000 7f899f9f1640 1 --2- 172.21.15.45:0/1650696861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f899806c760 0x7f8998070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:47.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.302+0000 7f899f9f1640 1 -- 172.21.15.45:0/1650696861 >> 172.21.15.45:0/1650696861 conn(0x7f89980a20d0 msgr2=0x7f8998145ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:47.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.302+0000 7f899f9f1640 1 -- 172.21.15.45:0/1650696861 shutdown_connections 2023-10-03T19:16:47.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.302+0000 7f899f9f1640 1 -- 172.21.15.45:0/1650696861 wait complete. 2023-10-03T19:16:47.326 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-03T19:16:47.326 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-03T19:16:47.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.442+0000 7f5b9ce21640 1 Processor -- start 2023-10-03T19:16:47.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.442+0000 7f5b9ce21640 1 -- start start 2023-10-03T19:16:47.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.446+0000 7f5b9ce21640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5b9806f880 0x7f5b980a5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:47.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.446+0000 7f5b9ce21640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5b9814f510 0x7f5b9814b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:47.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.446+0000 7f5b9ce21640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b9814f080 con 0x7f5b980bd9f0 2023-10-03T19:16:47.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.446+0000 7f5b9ce21640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b9806f3e0 con 0x7f5b9806f880 2023-10-03T19:16:47.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.446+0000 7f5b9ce21640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b98070e90 con 0x7f5b9814f510 2023-10-03T19:16:47.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.446+0000 7f5b9659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5b9806f880 0x7f5b980a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:47.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.446+0000 7f5b9659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5b9806f880 0x7f5b980a5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36926/0 (socket says 172.21.15.45:36926) 2023-10-03T19:16:47.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.446+0000 7f5b9659c640 1 -- 172.21.15.45:0/4234248665 learned_addr learned my addr 172.21.15.45:0/4234248665 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:47.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.446+0000 7f5b8ffff640 1 --2- 172.21.15.45:0/4234248665 >> v2:172.21.15.79:3300/0 conn(0x7f5b9814f510 0x7f5b9814b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:47.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.446+0000 7f5b9659c640 1 -- 172.21.15.45:0/4234248665 >> v2:172.21.15.79:3300/0 conn(0x7f5b9814f510 msgr2=0x7f5b9814b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:47.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.446+0000 7f5b9659c640 1 --2- 172.21.15.45:0/4234248665 >> v2:172.21.15.79:3300/0 conn(0x7f5b9814f510 0x7f5b9814b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:47.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.446+0000 7f5b9659c640 1 -- 172.21.15.45:0/4234248665 >> v1:172.21.15.79:6789/0 conn(0x7f5b980bd9f0 legacy=0x7f5b980badc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:47.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.446+0000 7f5b9659c640 1 -- 172.21.15.45:0/4234248665 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9814ea30 con 0x7f5b9806f880 2023-10-03T19:16:47.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.446+0000 7f5b8ffff640 1 --2- 172.21.15.45:0/4234248665 >> v2:172.21.15.79:3300/0 conn(0x7f5b9814f510 0x7f5b9814b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:47.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.446+0000 7f5b9659c640 1 --2- 172.21.15.45:0/4234248665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b9806f880 0x7f5b980a5940 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5b980712b0 tx=0x7f5b8801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21aa1c79c7e9e0c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:47.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.446+0000 7f5b95d9b640 1 -- 172.21.15.45:0/4234248665 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b880ab5f0 con 0x7f5b9806f880 2023-10-03T19:16:47.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.446+0000 7f5b95d9b640 1 -- 172.21.15.45:0/4234248665 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b880ab750 con 0x7f5b9806f880 2023-10-03T19:16:47.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.446+0000 7f5b95d9b640 1 -- 172.21.15.45:0/4234248665 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b880abae0 con 0x7f5b9806f880 2023-10-03T19:16:47.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.450+0000 7f5b9ce21640 1 -- 172.21.15.45:0/4234248665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b9806f880 msgr2=0x7f5b980a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:47.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.450+0000 7f5b9ce21640 1 --2- 172.21.15.45:0/4234248665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b9806f880 0x7f5b980a5940 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5b980712b0 tx=0x7f5b8801c490 comp rx=0 tx=0).stop 2023-10-03T19:16:47.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.450+0000 7f5b9ce21640 1 -- 172.21.15.45:0/4234248665 shutdown_connections 2023-10-03T19:16:47.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.450+0000 7f5b9ce21640 1 --2- 172.21.15.45:0/4234248665 >> v2:172.21.15.79:3300/0 conn(0x7f5b9814f510 0x7f5b9814b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:47.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.450+0000 7f5b9ce21640 1 --2- 172.21.15.45:0/4234248665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b9806f880 0x7f5b980a5940 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:47.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.450+0000 7f5b9ce21640 1 -- 172.21.15.45:0/4234248665 >> 172.21.15.45:0/4234248665 conn(0x7f5b980a20d0 msgr2=0x7f5b980a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:47.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.450+0000 7f5b9ce21640 1 -- 172.21.15.45:0/4234248665 shutdown_connections 2023-10-03T19:16:47.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.450+0000 7f5b9ce21640 1 -- 172.21.15.45:0/4234248665 wait complete. 2023-10-03T19:16:47.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.450+0000 7f5b9ce21640 1 Processor -- start 2023-10-03T19:16:47.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.450+0000 7f5b9ce21640 1 -- start start 2023-10-03T19:16:47.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.450+0000 7f5b9ce21640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b9806f880 0x7f5b98141470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:47.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.450+0000 7f5b9ce21640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b980bd9f0 0x7f5b98155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:47.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.450+0000 7f5b9ce21640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5b9814f510 0x7f5b981e86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:47.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.450+0000 7f5b9ce21640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b980b5bf0 con 0x7f5b9806f880 2023-10-03T19:16:47.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.450+0000 7f5b9ce21640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b981419b0 con 0x7f5b980bd9f0 2023-10-03T19:16:47.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.450+0000 7f5b9ce21640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b980bf290 con 0x7f5b9814f510 2023-10-03T19:16:47.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.450+0000 7f5b9659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b9806f880 0x7f5b98141470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:47.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.450+0000 7f5b9659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b9806f880 0x7f5b98141470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36938/0 (socket says 172.21.15.45:36938) 2023-10-03T19:16:47.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.450+0000 7f5b9659c640 1 -- 172.21.15.45:0/3230670851 learned_addr learned my addr 172.21.15.45:0/3230670851 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:47.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.450+0000 7f5b8ffff640 1 --2- 172.21.15.45:0/3230670851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b980bd9f0 0x7f5b98155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:47.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.450+0000 7f5b96d9d640 1 --2- 172.21.15.45:0/3230670851 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5b9814f510 0x7f5b981e86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:47.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.450+0000 7f5b9659c640 1 -- 172.21.15.45:0/3230670851 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5b9814f510 msgr2=0x7f5b981e86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:47.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.450+0000 7f5b9659c640 1 --2- 172.21.15.45:0/3230670851 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5b9814f510 0x7f5b981e86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:47.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.450+0000 7f5b9659c640 1 -- 172.21.15.45:0/3230670851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b980bd9f0 msgr2=0x7f5b98155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:47.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.450+0000 7f5b9659c640 1 --2- 172.21.15.45:0/3230670851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b980bd9f0 0x7f5b98155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:47.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.450+0000 7f5b9659c640 1 -- 172.21.15.45:0/3230670851 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b880094d0 con 0x7f5b9806f880 2023-10-03T19:16:47.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.450+0000 7f5b9659c640 1 --2- 172.21.15.45:0/3230670851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b9806f880 0x7f5b98141470 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5b880ad040 tx=0x7f5b8801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:47.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.450+0000 7f5b8effd640 1 -- 172.21.15.45:0/3230670851 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b880b4800 con 0x7f5b9806f880 2023-10-03T19:16:47.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.454+0000 7f5b8effd640 1 -- 172.21.15.45:0/3230670851 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b880b4980 con 0x7f5b9806f880 2023-10-03T19:16:47.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.454+0000 7f5b9ce21640 1 -- 172.21.15.45:0/3230670851 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b9806fc50 con 0x7f5b9806f880 2023-10-03T19:16:47.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.454+0000 7f5b8effd640 1 -- 172.21.15.45:0/3230670851 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b880b4d30 con 0x7f5b9806f880 2023-10-03T19:16:47.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.454+0000 7f5b9ce21640 1 -- 172.21.15.45:0/3230670851 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b9814bc70 con 0x7f5b9806f880 2023-10-03T19:16:47.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.454+0000 7f5b9ce21640 1 -- 172.21.15.45:0/3230670851 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b98070a40 con 0x7f5b9806f880 2023-10-03T19:16:47.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.454+0000 7f5b8effd640 1 -- 172.21.15.45:0/3230670851 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5b880c7390 con 0x7f5b9806f880 2023-10-03T19:16:47.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.454+0000 7f5b8effd640 1 --2- 172.21.15.45:0/3230670851 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5b78066280 0x7f5b78068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:47.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.454+0000 7f5b8effd640 1 -- 172.21.15.45:0/3230670851 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5b880a8050 con 0x7f5b9806f880 2023-10-03T19:16:47.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.454+0000 7f5b8ffff640 1 --2- 172.21.15.45:0/3230670851 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5b78066280 0x7f5b78068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:47.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.454+0000 7f5b8ffff640 1 --2- 172.21.15.45:0/3230670851 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5b78066280 0x7f5b78068730 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5b80006fd0 tx=0x7f5b80008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:47.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.458+0000 7f5b8effd640 1 -- 172.21.15.45:0/3230670851 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5b880ebbf0 con 0x7f5b9806f880 2023-10-03T19:16:47.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:47.650+0000 7f5b9ce21640 1 -- 172.21.15.45:0/3230670851 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5b980a5a40 con 0x7f5b9806f880 2023-10-03T19:16:48.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.314+0000 7f5b8effd640 1 -- 172.21.15.45:0/3230670851 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v29) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5b880ef210 con 0x7f5b9806f880 2023-10-03T19:16:48.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.314+0000 7f5b9ce21640 1 -- 172.21.15.45:0/3230670851 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5b78066280 msgr2=0x7f5b78068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:48.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.314+0000 7f5b9ce21640 1 --2- 172.21.15.45:0/3230670851 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5b78066280 0x7f5b78068730 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5b80006fd0 tx=0x7f5b80008040 comp rx=0 tx=0).stop 2023-10-03T19:16:48.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.314+0000 7f5b9ce21640 1 -- 172.21.15.45:0/3230670851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b9806f880 msgr2=0x7f5b98141470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:48.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.314+0000 7f5b9ce21640 1 --2- 172.21.15.45:0/3230670851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b9806f880 0x7f5b98141470 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5b880ad040 tx=0x7f5b8801acd0 comp rx=0 tx=0).stop 2023-10-03T19:16:48.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.314+0000 7f5b9ce21640 1 -- 172.21.15.45:0/3230670851 shutdown_connections 2023-10-03T19:16:48.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.314+0000 7f5b9ce21640 1 --2- 172.21.15.45:0/3230670851 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5b78066280 0x7f5b78068730 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:48.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.314+0000 7f5b9ce21640 1 --2- 172.21.15.45:0/3230670851 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5b9814f510 0x7f5b981e86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:48.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.314+0000 7f5b9ce21640 1 --2- 172.21.15.45:0/3230670851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b980bd9f0 0x7f5b98155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:48.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.314+0000 7f5b9ce21640 1 --2- 172.21.15.45:0/3230670851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b9806f880 0x7f5b98141470 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:48.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.314+0000 7f5b9ce21640 1 -- 172.21.15.45:0/3230670851 >> 172.21.15.45:0/3230670851 conn(0x7f5b980a20d0 msgr2=0x7f5b980bacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:48.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.314+0000 7f5b9ce21640 1 -- 172.21.15.45:0/3230670851 shutdown_connections 2023-10-03T19:16:48.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.314+0000 7f5b9ce21640 1 -- 172.21.15.45:0/3230670851 wait complete. 2023-10-03T19:16:48.342 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-03T19:16:48.342 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:16:48.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8f2075640 1 Processor -- start 2023-10-03T19:16:48.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8f2075640 1 -- start start 2023-10-03T19:16:48.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8f2075640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc8ec14f240 0x7fc8ec1528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:48.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8f2075640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc8ec0bb1d0 0x7fc8ec0c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:48.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8f2075640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8ec06b2d0 con 0x7fc8ec0c2790 2023-10-03T19:16:48.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8f2075640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8ec06b640 con 0x7fc8ec14f240 2023-10-03T19:16:48.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8f2075640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec0a3c60 con 0x7fc8ec0bb1d0 2023-10-03T19:16:48.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8eaffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc8ec0c2790 0x7fc8ec0c0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55522/0 (socket says 172.21.15.45:55522) 2023-10-03T19:16:48.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8eaffd640 1 -- 172.21.15.45:0/1487822313 learned_addr learned my addr 172.21.15.45:0/1487822313 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:48.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8eb7fe640 1 --2- 172.21.15.45:0/1487822313 >> v2:172.21.15.79:3300/0 conn(0x7fc8ec14f240 0x7fc8ec1528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:48.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8ebfff640 1 --2- 172.21.15.45:0/1487822313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc8ec0bb1d0 0x7fc8ec0c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:48.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8ea7fc640 1 -- 172.21.15.45:0/1487822313 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2563832383 0 0) 0x7fc8ec06b2d0 con 0x7fc8ec0c2790 2023-10-03T19:16:48.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8ea7fc640 1 -- 172.21.15.45:0/1487822313 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8d4003530 con 0x7fc8ec0c2790 2023-10-03T19:16:48.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8ea7fc640 1 -- 172.21.15.45:0/1487822313 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 249817544 0 0) 0x7fc8d4003530 con 0x7fc8ec0c2790 2023-10-03T19:16:48.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8ea7fc640 1 -- 172.21.15.45:0/1487822313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc8ec0bb1d0 msgr2=0x7fc8ec0c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:48.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8ea7fc640 1 --2- 172.21.15.45:0/1487822313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc8ec0bb1d0 0x7fc8ec0c12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:48.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8ea7fc640 1 -- 172.21.15.45:0/1487822313 >> v2:172.21.15.79:3300/0 conn(0x7fc8ec14f240 msgr2=0x7fc8ec1528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:48.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8ea7fc640 1 --2- 172.21.15.45:0/1487822313 >> v2:172.21.15.79:3300/0 conn(0x7fc8ec14f240 0x7fc8ec1528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:48.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8ea7fc640 1 -- 172.21.15.45:0/1487822313 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ec14e740 con 0x7fc8ec0c2790 2023-10-03T19:16:48.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8ea7fc640 1 -- 172.21.15.45:0/1487822313 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fc8e0001800 con 0x7fc8ec0c2790 2023-10-03T19:16:48.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8ea7fc640 1 -- 172.21.15.45:0/1487822313 >> v1:172.21.15.45:6789/0 conn(0x7fc8ec0c2790 legacy=0x7fc8ec0c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:48.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8ea7fc640 1 --2- 172.21.15.45:0/1487822313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8d4003980 0x7fc8d4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:48.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8ea7fc640 1 --2- 172.21.15.45:0/1487822313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc8ec0bb1d0 0x7fc8d40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:48.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8ea7fc640 1 --2- 172.21.15.45:0/1487822313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d4004d10 0x7fc8d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:48.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8ea7fc640 1 -- 172.21.15.45:0/1487822313 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec06b640 con 0x7fc8d4003980 2023-10-03T19:16:48.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8ea7fc640 1 -- 172.21.15.45:0/1487822313 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec0a3c60 con 0x7fc8d4004d10 2023-10-03T19:16:48.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8ea7fc640 1 -- 172.21.15.45:0/1487822313 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d400b9c0 con 0x7fc8ec0bb1d0 2023-10-03T19:16:48.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8eb7fe640 1 --2- 172.21.15.45:0/1487822313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8d4003980 0x7fc8d4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:48.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8eaffd640 1 --2- 172.21.15.45:0/1487822313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc8ec0bb1d0 0x7fc8d40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:48.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8ebfff640 1 --2- 172.21.15.45:0/1487822313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d4004d10 0x7fc8d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:48.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8eb7fe640 1 -- 172.21.15.45:0/1487822313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc8ec0bb1d0 msgr2=0x7fc8d40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:48.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8eb7fe640 1 --2- 172.21.15.45:0/1487822313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc8ec0bb1d0 0x7fc8d40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:48.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8eb7fe640 1 -- 172.21.15.45:0/1487822313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d4004d10 msgr2=0x7fc8d4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:48.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8eb7fe640 1 --2- 172.21.15.45:0/1487822313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d4004d10 0x7fc8d4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:48.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8eb7fe640 1 -- 172.21.15.45:0/1487822313 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d4003530 con 0x7fc8d4003980 2023-10-03T19:16:48.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.462+0000 7fc8ebfff640 1 --2- 172.21.15.45:0/1487822313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d4004d10 0x7fc8d4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:16:48.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.466+0000 7fc8eb7fe640 1 --2- 172.21.15.45:0/1487822313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8d4003980 0x7fc8d4003d90 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc00e170 tx=0x7fc8dc01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a54e398f50138716 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:48.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.466+0000 7fc8ea7fc640 1 -- 172.21.15.45:0/1487822313 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc0a5cf0 con 0x7fc8d4003980 2023-10-03T19:16:48.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.466+0000 7fc8ea7fc640 1 -- 172.21.15.45:0/1487822313 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8dc00f040 con 0x7fc8d4003980 2023-10-03T19:16:48.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.466+0000 7fc8ea7fc640 1 -- 172.21.15.45:0/1487822313 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc0ad680 con 0x7fc8d4003980 2023-10-03T19:16:48.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.466+0000 7fc8f2075640 1 -- 172.21.15.45:0/1487822313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8d4003980 msgr2=0x7fc8d4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:48.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.466+0000 7fc8f2075640 1 --2- 172.21.15.45:0/1487822313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8d4003980 0x7fc8d4003d90 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc00e170 tx=0x7fc8dc01cc80 comp rx=0 tx=0).stop 2023-10-03T19:16:48.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.466+0000 7fc8ebfff640 1 -- 172.21.15.45:0/1487822313 reap_dead start 2023-10-03T19:16:48.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.466+0000 7fc8f2075640 1 -- 172.21.15.45:0/1487822313 shutdown_connections 2023-10-03T19:16:48.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.466+0000 7fc8f2075640 1 -- 172.21.15.45:0/1487822313 >> 172.21.15.45:0/1487822313 conn(0x7fc8ec0a64a0 msgr2=0x7fc8ec0a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:48.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.466+0000 7fc8f2075640 1 -- 172.21.15.45:0/1487822313 shutdown_connections 2023-10-03T19:16:48.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.466+0000 7fc8f2075640 1 -- 172.21.15.45:0/1487822313 wait complete. 2023-10-03T19:16:48.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.470+0000 7fc8f2075640 1 Processor -- start 2023-10-03T19:16:48.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.470+0000 7fc8f2075640 1 -- start start 2023-10-03T19:16:48.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.470+0000 7fc8f2075640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8d4003980 0x7fc8ec147bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:48.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.470+0000 7fc8f2075640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc8ec14d510 0x7fc8ec146b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:48.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.470+0000 7fc8f2075640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8ec147070 0x7fc8ec0a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:48.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.470+0000 7fc8f2075640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec1d9180 con 0x7fc8d4003980 2023-10-03T19:16:48.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.470+0000 7fc8f2075640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec0a8690 con 0x7fc8ec147070 2023-10-03T19:16:48.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.470+0000 7fc8f2075640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec0a77a0 con 0x7fc8ec14d510 2023-10-03T19:16:48.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.470+0000 7fc8eb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8d4003980 0x7fc8ec147bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:48.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.470+0000 7fc8eb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8d4003980 0x7fc8ec147bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36950/0 (socket says 172.21.15.45:36950) 2023-10-03T19:16:48.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.470+0000 7fc8eb7fe640 1 -- 172.21.15.45:0/1000051329 learned_addr learned my addr 172.21.15.45:0/1000051329 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:48.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.470+0000 7fc8ebfff640 1 --2- 172.21.15.45:0/1000051329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8ec147070 0x7fc8ec0a9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:48.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.470+0000 7fc8eb7fe640 1 -- 172.21.15.45:0/1000051329 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc8ec14d510 msgr2=0x7fc8ec146b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:48.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.470+0000 7fc8eb7fe640 1 --2- 172.21.15.45:0/1000051329 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc8ec14d510 0x7fc8ec146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:48.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.470+0000 7fc8eb7fe640 1 -- 172.21.15.45:0/1000051329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8ec147070 msgr2=0x7fc8ec0a9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:48.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.470+0000 7fc8eb7fe640 1 --2- 172.21.15.45:0/1000051329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8ec147070 0x7fc8ec0a9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:48.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.470+0000 7fc8eb7fe640 1 -- 172.21.15.45:0/1000051329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ec14f610 con 0x7fc8d4003980 2023-10-03T19:16:48.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.470+0000 7fc8eb7fe640 1 --2- 172.21.15.45:0/1000051329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8d4003980 0x7fc8ec147bb0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc01c6f0 tx=0x7fc8dc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:48.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.470+0000 7fc8d3fff640 1 -- 172.21.15.45:0/1000051329 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc0ada10 con 0x7fc8d4003980 2023-10-03T19:16:48.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.470+0000 7fc8d3fff640 1 -- 172.21.15.45:0/1000051329 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8dc0adb70 con 0x7fc8d4003980 2023-10-03T19:16:48.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.470+0000 7fc8f2075640 1 -- 172.21.15.45:0/1000051329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8ec0a3f40 con 0x7fc8d4003980 2023-10-03T19:16:48.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.470+0000 7fc8d3fff640 1 -- 172.21.15.45:0/1000051329 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc0b6410 con 0x7fc8d4003980 2023-10-03T19:16:48.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.470+0000 7fc8f2075640 1 -- 172.21.15.45:0/1000051329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8ec0bf360 con 0x7fc8d4003980 2023-10-03T19:16:48.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.470+0000 7fc8f2075640 1 -- 172.21.15.45:0/1000051329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8ec1480f0 con 0x7fc8d4003980 2023-10-03T19:16:48.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.470+0000 7fc8d3fff640 1 -- 172.21.15.45:0/1000051329 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc8dc0b4040 con 0x7fc8d4003980 2023-10-03T19:16:48.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.474+0000 7fc8d3fff640 1 --2- 172.21.15.45:0/1000051329 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc8d8066280 0x7fc8d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:48.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.474+0000 7fc8d3fff640 1 -- 172.21.15.45:0/1000051329 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc8dc11e710 con 0x7fc8d4003980 2023-10-03T19:16:48.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.474+0000 7fc8eaffd640 1 --2- 172.21.15.45:0/1000051329 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc8d8066280 0x7fc8d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:48.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.474+0000 7fc8eaffd640 1 --2- 172.21.15.45:0/1000051329 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc8d8066280 0x7fc8d8068730 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0001d80 tx=0x7fc8e0001c30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:48.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.478+0000 7fc8d3fff640 1 -- 172.21.15.45:0/1000051329 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc8ec1480f0 con 0x7fc8d4003980 2023-10-03T19:16:48.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.662+0000 7fc8f2075640 1 -- 172.21.15.45:0/1000051329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8ec1480f0 con 0x7fc8d4003980 2023-10-03T19:16:48.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.666+0000 7fc8d3fff640 1 -- 172.21.15.45:0/1000051329 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+3915 (secure 0 0 0) 0x7fc8ec1480f0 con 0x7fc8d4003980 2023-10-03T19:16:48.670 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:16:48.671 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1808337334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1808337334},{"type":"v1","addr":"172.21.15.45:6835","nonce":1808337334}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5533,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3484102267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3484102267},{"type":"v1","addr":"172.21.15.79:6835","nonce":3484102267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:16:46.297139+0000","modified":"2023-10-03T19:16:48.310624+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5904},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5904":{"gid":5904,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6833/2572156585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2572156585},{"type":"v1","addr":"172.21.15.45:6833","nonce":2572156585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-10-03T19:16:48.671 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 29 2023-10-03T19:16:48.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.666+0000 7fc8f2075640 1 -- 172.21.15.45:0/1000051329 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc8d8066280 msgr2=0x7fc8d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:48.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.666+0000 7fc8f2075640 1 --2- 172.21.15.45:0/1000051329 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc8d8066280 0x7fc8d8068730 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0001d80 tx=0x7fc8e0001c30 comp rx=0 tx=0).stop 2023-10-03T19:16:48.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.666+0000 7fc8f2075640 1 -- 172.21.15.45:0/1000051329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8d4003980 msgr2=0x7fc8ec147bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:48.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.666+0000 7fc8f2075640 1 --2- 172.21.15.45:0/1000051329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8d4003980 0x7fc8ec147bb0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc01c6f0 tx=0x7fc8dc009750 comp rx=0 tx=0).stop 2023-10-03T19:16:48.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.666+0000 7fc8f2075640 1 -- 172.21.15.45:0/1000051329 shutdown_connections 2023-10-03T19:16:48.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.666+0000 7fc8f2075640 1 --2- 172.21.15.45:0/1000051329 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc8d8066280 0x7fc8d8068730 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:48.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.666+0000 7fc8f2075640 1 --2- 172.21.15.45:0/1000051329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8ec147070 0x7fc8ec0a9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:48.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.666+0000 7fc8f2075640 1 --2- 172.21.15.45:0/1000051329 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc8ec14d510 0x7fc8ec146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:48.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.666+0000 7fc8f2075640 1 --2- 172.21.15.45:0/1000051329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8d4003980 0x7fc8ec147bb0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:48.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.666+0000 7fc8f2075640 1 -- 172.21.15.45:0/1000051329 >> 172.21.15.45:0/1000051329 conn(0x7fc8ec0a64a0 msgr2=0x7fc8ec0a52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:48.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.666+0000 7fc8f2075640 1 -- 172.21.15.45:0/1000051329 shutdown_connections 2023-10-03T19:16:48.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.666+0000 7fc8f2075640 1 -- 172.21.15.45:0/1000051329 wait complete. 2023-10-03T19:16:48.688 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:16:48.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f16133cf640 1 Processor -- start 2023-10-03T19:16:48.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f16133cf640 1 -- start start 2023-10-03T19:16:48.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f16133cf640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f160c14f240 0x7f160c1528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:48.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f16133cf640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f160c0c2790 0x7f160c0c0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:48.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f16133cf640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f160c06b2d0 con 0x7f160c0bb1d0 2023-10-03T19:16:48.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f16133cf640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f160c06b640 con 0x7f160c14f240 2023-10-03T19:16:48.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f16133cf640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f160c0c0fa0 con 0x7f160c0c2790 2023-10-03T19:16:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f161196c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f160c0bb1d0 0x7f160c0c12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55524/0 (socket says 172.21.15.45:55524) 2023-10-03T19:16:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f161196c640 1 -- 172.21.15.45:0/1485981546 learned_addr learned my addr 172.21.15.45:0/1485981546 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f161116b640 1 --2- 172.21.15.45:0/1485981546 >> v2:172.21.15.79:3300/0 conn(0x7f160c14f240 0x7f160c1528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f161096a640 1 --2- 172.21.15.45:0/1485981546 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f160c0c2790 0x7f160c0c0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f1603fff640 1 -- 172.21.15.45:0/1485981546 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 559658827 0 0) 0x7f160c06b2d0 con 0x7f160c0bb1d0 2023-10-03T19:16:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f1603fff640 1 -- 172.21.15.45:0/1485981546 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15f8003530 con 0x7f160c0bb1d0 2023-10-03T19:16:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f1603fff640 1 -- 172.21.15.45:0/1485981546 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3542882353 0 0) 0x7f15f8003530 con 0x7f160c0bb1d0 2023-10-03T19:16:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f1603fff640 1 -- 172.21.15.45:0/1485981546 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f160c0c2790 msgr2=0x7f160c0c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f1603fff640 1 --2- 172.21.15.45:0/1485981546 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f160c0c2790 0x7f160c0c0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f1603fff640 1 -- 172.21.15.45:0/1485981546 >> v2:172.21.15.79:3300/0 conn(0x7f160c14f240 msgr2=0x7f160c1528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f1603fff640 1 --2- 172.21.15.45:0/1485981546 >> v2:172.21.15.79:3300/0 conn(0x7f160c14f240 0x7f160c1528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f1603fff640 1 -- 172.21.15.45:0/1485981546 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160c0a3c60 con 0x7f160c0bb1d0 2023-10-03T19:16:48.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f1603fff640 1 -- 172.21.15.45:0/1485981546 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f1604001a00 con 0x7f160c0bb1d0 2023-10-03T19:16:48.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f1603fff640 1 -- 172.21.15.45:0/1485981546 >> v1:172.21.15.45:6789/0 conn(0x7f160c0bb1d0 legacy=0x7f160c0c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:48.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f1603fff640 1 --2- 172.21.15.45:0/1485981546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15f8003980 0x7f15f8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:48.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f1603fff640 1 --2- 172.21.15.45:0/1485981546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15f80043b0 0x7f15f8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:48.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f1603fff640 1 --2- 172.21.15.45:0/1485981546 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f160c0c2790 0x7f15f8004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:48.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f1603fff640 1 -- 172.21.15.45:0/1485981546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c06b640 con 0x7f15f8003980 2023-10-03T19:16:48.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f1603fff640 1 -- 172.21.15.45:0/1485981546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c0c0fa0 con 0x7f15f80043b0 2023-10-03T19:16:48.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f1603fff640 1 -- 172.21.15.45:0/1485981546 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f800b990 con 0x7f160c0c2790 2023-10-03T19:16:48.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f161116b640 1 --2- 172.21.15.45:0/1485981546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15f8003980 0x7f15f8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:48.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f161196c640 1 --2- 172.21.15.45:0/1485981546 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f160c0c2790 0x7f15f8004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:48.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f161096a640 1 --2- 172.21.15.45:0/1485981546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15f80043b0 0x7f15f8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:48.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f161116b640 1 -- 172.21.15.45:0/1485981546 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f160c0c2790 msgr2=0x7f15f8004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:48.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f161116b640 1 --2- 172.21.15.45:0/1485981546 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f160c0c2790 0x7f15f8004f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:48.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f161116b640 1 -- 172.21.15.45:0/1485981546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15f80043b0 msgr2=0x7f15f8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:48.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f161116b640 1 --2- 172.21.15.45:0/1485981546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15f80043b0 0x7f15f8004870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:48.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.794+0000 7f161116b640 1 -- 172.21.15.45:0/1485981546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f8003530 con 0x7f15f8003980 2023-10-03T19:16:48.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.798+0000 7f161116b640 1 --2- 172.21.15.45:0/1485981546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15f8003980 0x7f15f8003d90 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1608009ac0 tx=0x7f160801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ace411a8b28ce server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:48.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.798+0000 7f1603fff640 1 -- 172.21.15.45:0/1485981546 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16080059a0 con 0x7f15f8003980 2023-10-03T19:16:48.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.798+0000 7f1603fff640 1 -- 172.21.15.45:0/1485981546 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1608005b00 con 0x7f15f8003980 2023-10-03T19:16:48.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.798+0000 7f1603fff640 1 -- 172.21.15.45:0/1485981546 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16080a5660 con 0x7f15f8003980 2023-10-03T19:16:48.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.798+0000 7f16133cf640 1 -- 172.21.15.45:0/1485981546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15f8003980 msgr2=0x7f15f8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:48.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.798+0000 7f16133cf640 1 --2- 172.21.15.45:0/1485981546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15f8003980 0x7f15f8003d90 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1608009ac0 tx=0x7f160801ca70 comp rx=0 tx=0).stop 2023-10-03T19:16:48.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.798+0000 7f161196c640 1 -- 172.21.15.45:0/1485981546 reap_dead start 2023-10-03T19:16:48.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.798+0000 7f16133cf640 1 -- 172.21.15.45:0/1485981546 shutdown_connections 2023-10-03T19:16:48.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.798+0000 7f16133cf640 1 -- 172.21.15.45:0/1485981546 >> 172.21.15.45:0/1485981546 conn(0x7f160c0a64a0 msgr2=0x7f160c0a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:48.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.798+0000 7f16133cf640 1 -- 172.21.15.45:0/1485981546 shutdown_connections 2023-10-03T19:16:48.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.798+0000 7f16133cf640 1 -- 172.21.15.45:0/1485981546 wait complete. 2023-10-03T19:16:48.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.798+0000 7f16133cf640 1 Processor -- start 2023-10-03T19:16:48.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.798+0000 7f16133cf640 1 -- start start 2023-10-03T19:16:48.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.798+0000 7f16133cf640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f15f8003980 0x7f160c14f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:48.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.798+0000 7f16133cf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f160c0a99b0 0x7f160c0c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:48.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.798+0000 7f16133cf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f160c0c4520 0x7f160c1e7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:48.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.798+0000 7f16133cf640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c1471b0 con 0x7f160c0a99b0 2023-10-03T19:16:48.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.798+0000 7f16133cf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c1473b0 con 0x7f160c0c4520 2023-10-03T19:16:48.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.798+0000 7f16133cf640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f160c146ed0 con 0x7f15f8003980 2023-10-03T19:16:48.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.798+0000 7f161096a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f160c0a99b0 0x7f160c0c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:48.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.798+0000 7f161096a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f160c0a99b0 0x7f160c0c3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36980/0 (socket says 172.21.15.45:36980) 2023-10-03T19:16:48.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.798+0000 7f161096a640 1 -- 172.21.15.45:0/2759839407 learned_addr learned my addr 172.21.15.45:0/2759839407 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:48.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.798+0000 7f161116b640 1 --2- 172.21.15.45:0/2759839407 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f15f8003980 0x7f160c14f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:48.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.798+0000 7f161196c640 1 --2- 172.21.15.45:0/2759839407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f160c0c4520 0x7f160c1e7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:48.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.798+0000 7f161096a640 1 -- 172.21.15.45:0/2759839407 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f15f8003980 msgr2=0x7f160c14f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:48.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.798+0000 7f161096a640 1 --2- 172.21.15.45:0/2759839407 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f15f8003980 0x7f160c14f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:48.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.798+0000 7f161096a640 1 -- 172.21.15.45:0/2759839407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f160c0c4520 msgr2=0x7f160c1e7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:48.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.798+0000 7f161096a640 1 --2- 172.21.15.45:0/2759839407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f160c0c4520 0x7f160c1e7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:48.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.798+0000 7f161096a640 1 -- 172.21.15.45:0/2759839407 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160c14e740 con 0x7f160c0a99b0 2023-10-03T19:16:48.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.802+0000 7f161096a640 1 --2- 172.21.15.45:0/2759839407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f160c0a99b0 0x7f160c0c3fe0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f15fc010860 tx=0x7f15fc010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:48.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.802+0000 7f1601ffb640 1 -- 172.21.15.45:0/2759839407 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc009610 con 0x7f160c0a99b0 2023-10-03T19:16:48.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.802+0000 7f1601ffb640 1 -- 172.21.15.45:0/2759839407 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15fc005ba0 con 0x7f160c0a99b0 2023-10-03T19:16:48.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.802+0000 7f16133cf640 1 -- 172.21.15.45:0/2759839407 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f160c0c19b0 con 0x7f160c0a99b0 2023-10-03T19:16:48.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.802+0000 7f1601ffb640 1 -- 172.21.15.45:0/2759839407 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc00e960 con 0x7f160c0a99b0 2023-10-03T19:16:48.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.802+0000 7f16133cf640 1 -- 172.21.15.45:0/2759839407 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f160c0a3f40 con 0x7f160c0a99b0 2023-10-03T19:16:48.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.802+0000 7f16133cf640 1 -- 172.21.15.45:0/2759839407 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f160c146d30 con 0x7f160c0a99b0 2023-10-03T19:16:48.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.802+0000 7f1601ffb640 1 -- 172.21.15.45:0/2759839407 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f15fc00eac0 con 0x7f160c0a99b0 2023-10-03T19:16:48.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.802+0000 7f1601ffb640 1 --2- 172.21.15.45:0/2759839407 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f15f0066280 0x7f15f0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:48.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.802+0000 7f1601ffb640 1 -- 172.21.15.45:0/2759839407 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f15fc083ff0 con 0x7f160c0a99b0 2023-10-03T19:16:48.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.802+0000 7f161116b640 1 --2- 172.21.15.45:0/2759839407 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f15f0066280 0x7f15f0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:48.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.802+0000 7f161116b640 1 --2- 172.21.15.45:0/2759839407 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f15f0066280 0x7f15f0068730 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f16080ae000 tx=0x7f16080046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:48.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.806+0000 7f1601ffb640 1 -- 172.21.15.45:0/2759839407 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f15fc0b46f0 con 0x7f160c0a99b0 2023-10-03T19:16:48.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.954+0000 7f16133cf640 1 -- 172.21.15.45:0/2759839407 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f160c04de80 con 0x7f160c0a99b0 2023-10-03T19:16:48.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.958+0000 7f1601ffb640 1 -- 172.21.15.45:0/2759839407 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+18245 (secure 0 0 0) 0x7f160c146d30 con 0x7f160c0a99b0 2023-10-03T19:16:48.964 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:16:48.964 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":61,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:16:47.301016+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:16:44.176075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-03T19:16:45.307579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:16:48.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.958+0000 7f16133cf640 1 -- 172.21.15.45:0/2759839407 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f15f0066280 msgr2=0x7f15f0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:48.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.958+0000 7f16133cf640 1 --2- 172.21.15.45:0/2759839407 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f15f0066280 0x7f15f0068730 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f16080ae000 tx=0x7f16080046d0 comp rx=0 tx=0).stop 2023-10-03T19:16:48.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.958+0000 7f16133cf640 1 -- 172.21.15.45:0/2759839407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f160c0a99b0 msgr2=0x7f160c0c3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:48.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.958+0000 7f16133cf640 1 --2- 172.21.15.45:0/2759839407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f160c0a99b0 0x7f160c0c3fe0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f15fc010860 tx=0x7f15fc010d20 comp rx=0 tx=0).stop 2023-10-03T19:16:48.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.958+0000 7f16133cf640 1 -- 172.21.15.45:0/2759839407 shutdown_connections 2023-10-03T19:16:48.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.958+0000 7f16133cf640 1 --2- 172.21.15.45:0/2759839407 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f15f0066280 0x7f15f0068730 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:48.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.958+0000 7f16133cf640 1 --2- 172.21.15.45:0/2759839407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f160c0c4520 0x7f160c1e7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:48.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.958+0000 7f16133cf640 1 --2- 172.21.15.45:0/2759839407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f160c0a99b0 0x7f160c0c3fe0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:48.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.958+0000 7f16133cf640 1 --2- 172.21.15.45:0/2759839407 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f15f8003980 0x7f160c14f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:48.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.958+0000 7f16133cf640 1 -- 172.21.15.45:0/2759839407 >> 172.21.15.45:0/2759839407 conn(0x7f160c0a64a0 msgr2=0x7f160c0a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:48.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.958+0000 7f16133cf640 1 -- 172.21.15.45:0/2759839407 shutdown_connections 2023-10-03T19:16:48.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:48.962+0000 7f16133cf640 1 -- 172.21.15.45:0/2759839407 wait complete. 2023-10-03T19:16:48.982 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-03T19:16:48.982 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:16:49.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.094+0000 7fbb53759640 1 Processor -- start 2023-10-03T19:16:49.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.094+0000 7fbb53759640 1 -- start start 2023-10-03T19:16:49.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.098+0000 7fbb53759640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb4c0bc8b0 0x7fbb4c14ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:49.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.098+0000 7fbb53759640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbb4c06d170 0x7fbb4c14cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:49.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.098+0000 7fbb53759640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb4c06cac0 con 0x7fbb4c06f170 2023-10-03T19:16:49.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.098+0000 7fbb53759640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb4c14d4f0 con 0x7fbb4c06d170 2023-10-03T19:16:49.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.098+0000 7fbb53759640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c0720d0 con 0x7fbb4c0bc8b0 2023-10-03T19:16:49.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.098+0000 7fbb51cf6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbb4c06d170 0x7fbb4c14cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:49.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.098+0000 7fbb51cf6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbb4c06d170 0x7fbb4c14cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36994/0 (socket says 172.21.15.45:36994) 2023-10-03T19:16:49.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.098+0000 7fbb51cf6640 1 -- 172.21.15.45:0/4248998959 learned_addr learned my addr 172.21.15.45:0/4248998959 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:49.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.098+0000 7fbb50cf4640 1 --2- 172.21.15.45:0/4248998959 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb4c0bc8b0 0x7fbb4c14ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:49.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.098+0000 7fbb51cf6640 1 -- 172.21.15.45:0/4248998959 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb4c0bc8b0 msgr2=0x7fbb4c14ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:49.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.098+0000 7fbb51cf6640 1 --2- 172.21.15.45:0/4248998959 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb4c0bc8b0 0x7fbb4c14ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:49.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.098+0000 7fbb51cf6640 1 -- 172.21.15.45:0/4248998959 >> v1:172.21.15.79:6789/0 conn(0x7fbb4c06f170 legacy=0x7fbb4c150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:49.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.098+0000 7fbb51cf6640 1 -- 172.21.15.45:0/4248998959 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb4c0a5ab0 con 0x7fbb4c06d170 2023-10-03T19:16:49.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.098+0000 7fbb51cf6640 1 --2- 172.21.15.45:0/4248998959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb4c06d170 0x7fbb4c14cfb0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fbb44009e50 tx=0x7fbb4401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=724036cae29b751e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:49.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.098+0000 7fbb43fff640 1 -- 172.21.15.45:0/4248998959 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb440af400 con 0x7fbb4c06d170 2023-10-03T19:16:49.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.098+0000 7fbb43fff640 1 -- 172.21.15.45:0/4248998959 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb440ab050 con 0x7fbb4c06d170 2023-10-03T19:16:49.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.098+0000 7fbb43fff640 1 -- 172.21.15.45:0/4248998959 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb440af780 con 0x7fbb4c06d170 2023-10-03T19:16:49.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb53759640 1 -- 172.21.15.45:0/4248998959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb4c06d170 msgr2=0x7fbb4c14cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:49.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb53759640 1 --2- 172.21.15.45:0/4248998959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb4c06d170 0x7fbb4c14cfb0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fbb44009e50 tx=0x7fbb4401f1c0 comp rx=0 tx=0).stop 2023-10-03T19:16:49.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb53759640 1 -- 172.21.15.45:0/4248998959 shutdown_connections 2023-10-03T19:16:49.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb53759640 1 --2- 172.21.15.45:0/4248998959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb4c06d170 0x7fbb4c14cfb0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:49.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb53759640 1 --2- 172.21.15.45:0/4248998959 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb4c0bc8b0 0x7fbb4c14ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:49.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb53759640 1 -- 172.21.15.45:0/4248998959 >> 172.21.15.45:0/4248998959 conn(0x7fbb4c0bcf50 msgr2=0x7fbb4c0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:49.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb53759640 1 -- 172.21.15.45:0/4248998959 shutdown_connections 2023-10-03T19:16:49.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb53759640 1 -- 172.21.15.45:0/4248998959 wait complete. 2023-10-03T19:16:49.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb53759640 1 Processor -- start 2023-10-03T19:16:49.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb53759640 1 -- start start 2023-10-03T19:16:49.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb53759640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb4c06d170 0x7fbb4c148600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:49.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb53759640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb4c06f170 0x7fbb4c13f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:49.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb53759640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb4c0bc8b0 0x7fbb4c145f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:49.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb53759640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c1e24a0 con 0x7fbb4c06f170 2023-10-03T19:16:49.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb53759640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c147280 con 0x7fbb4c0bc8b0 2023-10-03T19:16:49.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb53759640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c1e29c0 con 0x7fbb4c06d170 2023-10-03T19:16:49.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb50cf4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb4c06f170 0x7fbb4c13f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:49.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb50cf4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb4c06f170 0x7fbb4c13f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37008/0 (socket says 172.21.15.45:37008) 2023-10-03T19:16:49.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb50cf4640 1 -- 172.21.15.45:0/284151872 learned_addr learned my addr 172.21.15.45:0/284151872 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:49.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb514f5640 1 --2- 172.21.15.45:0/284151872 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb4c06d170 0x7fbb4c148600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:49.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb51cf6640 1 --2- 172.21.15.45:0/284151872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb4c0bc8b0 0x7fbb4c145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:49.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb50cf4640 1 -- 172.21.15.45:0/284151872 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb4c06d170 msgr2=0x7fbb4c148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:49.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb50cf4640 1 --2- 172.21.15.45:0/284151872 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb4c06d170 0x7fbb4c148600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:49.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb50cf4640 1 -- 172.21.15.45:0/284151872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb4c0bc8b0 msgr2=0x7fbb4c145f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:49.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb50cf4640 1 --2- 172.21.15.45:0/284151872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb4c0bc8b0 0x7fbb4c145f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:49.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb50cf4640 1 -- 172.21.15.45:0/284151872 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb44009b30 con 0x7fbb4c06f170 2023-10-03T19:16:49.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb50cf4640 1 --2- 172.21.15.45:0/284151872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb4c06f170 0x7fbb4c13f220 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c00d800 tx=0x7fbb3c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:49.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb41ffb640 1 -- 172.21.15.45:0/284151872 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c00b6c0 con 0x7fbb4c06f170 2023-10-03T19:16:49.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb41ffb640 1 -- 172.21.15.45:0/284151872 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3c00b820 con 0x7fbb4c06f170 2023-10-03T19:16:49.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb41ffb640 1 -- 172.21.15.45:0/284151872 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c00bb90 con 0x7fbb4c06f170 2023-10-03T19:16:49.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb53759640 1 -- 172.21.15.45:0/284151872 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb4c14fae0 con 0x7fbb4c06f170 2023-10-03T19:16:49.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.102+0000 7fbb53759640 1 -- 172.21.15.45:0/284151872 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb4c06cd00 con 0x7fbb4c06f170 2023-10-03T19:16:49.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.106+0000 7fbb53759640 1 -- 172.21.15.45:0/284151872 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb4c06d660 con 0x7fbb4c06f170 2023-10-03T19:16:49.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.106+0000 7fbb41ffb640 1 -- 172.21.15.45:0/284151872 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbb3c00bcf0 con 0x7fbb4c06f170 2023-10-03T19:16:49.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.106+0000 7fbb41ffb640 1 --2- 172.21.15.45:0/284151872 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbb300662b0 0x7fbb30068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:49.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.106+0000 7fbb41ffb640 1 -- 172.21.15.45:0/284151872 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbb3c084230 con 0x7fbb4c06f170 2023-10-03T19:16:49.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.106+0000 7fbb514f5640 1 --2- 172.21.15.45:0/284151872 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbb300662b0 0x7fbb30068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:49.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.106+0000 7fbb514f5640 1 --2- 172.21.15.45:0/284151872 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbb300662b0 0x7fbb30068760 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbb48004e30 tx=0x7fbb48009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:49.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.110+0000 7fbb41ffb640 1 -- 172.21.15.45:0/284151872 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbb3c051740 con 0x7fbb4c06f170 2023-10-03T19:16:49.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.262+0000 7fbb53759640 1 -- 172.21.15.45:0/284151872 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbb4c14c480 con 0x7fbb300662b0 2023-10-03T19:16:49.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.286+0000 7fbb41ffb640 1 -- 172.21.15.45:0/284151872 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306164 (secure 0 0 0) 0x7fbb4c14c480 con 0x7fbb300662b0 2023-10-03T19:16:49.293 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:16:49.295 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:16:49.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.290+0000 7fbb53759640 1 -- 172.21.15.45:0/284151872 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbb300662b0 msgr2=0x7fbb30068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:49.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.290+0000 7fbb53759640 1 --2- 172.21.15.45:0/284151872 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbb300662b0 0x7fbb30068760 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbb48004e30 tx=0x7fbb48009040 comp rx=0 tx=0).stop 2023-10-03T19:16:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.290+0000 7fbb53759640 1 -- 172.21.15.45:0/284151872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb4c06f170 msgr2=0x7fbb4c13f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.290+0000 7fbb53759640 1 --2- 172.21.15.45:0/284151872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb4c06f170 0x7fbb4c13f220 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c00d800 tx=0x7fbb3c00dcc0 comp rx=0 tx=0).stop 2023-10-03T19:16:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.290+0000 7fbb53759640 1 -- 172.21.15.45:0/284151872 shutdown_connections 2023-10-03T19:16:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.290+0000 7fbb53759640 1 --2- 172.21.15.45:0/284151872 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbb300662b0 0x7fbb30068760 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.290+0000 7fbb53759640 1 --2- 172.21.15.45:0/284151872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb4c0bc8b0 0x7fbb4c145f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.290+0000 7fbb53759640 1 --2- 172.21.15.45:0/284151872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb4c06f170 0x7fbb4c13f220 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.290+0000 7fbb53759640 1 --2- 172.21.15.45:0/284151872 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb4c06d170 0x7fbb4c148600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.290+0000 7fbb53759640 1 -- 172.21.15.45:0/284151872 >> 172.21.15.45:0/284151872 conn(0x7fbb4c0bcf50 msgr2=0x7fbb4c14e000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.290+0000 7fbb53759640 1 -- 172.21.15.45:0/284151872 shutdown_connections 2023-10-03T19:16:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.290+0000 7fbb53759640 1 -- 172.21.15.45:0/284151872 wait complete. 2023-10-03T19:16:49.314 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2023-10-03T19:16:48.536958+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592708,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":192,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":158,"acting":158,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":168080,"kb_used_data":5648,"kb_used_omap":0,"kb_used_meta":162368,"kb_avail":754806640,"statfs":{"total":773094113280,"available":772921999360,"internally_reserved":0,"allocated":5783552,"data_stored":3652930,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":166264832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2340,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001178"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.355678+0000","last_change":"2023-10-03T19:16:46.354281+0000","last_active":"2023-10-03T19:16:46.355678+0000","last_peered":"2023-10-03T19:16:46.355678+0000","last_clean":"2023-10-03T19:16:46.355678+0000","last_became_active":"2023-10-03T19:16:46.353863+0000","last_became_peered":"2023-10-03T19:16:46.353863+0000","last_unstale":"2023-10-03T19:16:46.355678+0000","last_undegraded":"2023-10-03T19:16:46.355678+0000","last_fullsized":"2023-10-03T19:16:46.355678+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:54:01.595268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.319995+0000","last_change":"2023-10-03T19:16:46.318712+0000","last_active":"2023-10-03T19:16:46.319995+0000","last_peered":"2023-10-03T19:16:46.319995+0000","last_clean":"2023-10-03T19:16:46.319995+0000","last_became_active":"2023-10-03T19:16:46.318367+0000","last_became_peered":"2023-10-03T19:16:46.318367+0000","last_unstale":"2023-10-03T19:16:46.319995+0000","last_undegraded":"2023-10-03T19:16:46.319995+0000","last_fullsized":"2023-10-03T19:16:46.319995+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:04:47.708070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381928+0000","last_change":"2023-10-03T19:16:46.372185+0000","last_active":"2023-10-03T19:16:46.381928+0000","last_peered":"2023-10-03T19:16:46.381928+0000","last_clean":"2023-10-03T19:16:46.381928+0000","last_became_active":"2023-10-03T19:16:46.371540+0000","last_became_peered":"2023-10-03T19:16:46.371540+0000","last_unstale":"2023-10-03T19:16:46.381928+0000","last_undegraded":"2023-10-03T19:16:46.381928+0000","last_fullsized":"2023-10-03T19:16:46.381928+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:25:23.195500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.374546+0000","last_change":"2023-10-03T19:16:46.355059+0000","last_active":"2023-10-03T19:16:46.374546+0000","last_peered":"2023-10-03T19:16:46.374546+0000","last_clean":"2023-10-03T19:16:46.374546+0000","last_became_active":"2023-10-03T19:16:46.347192+0000","last_became_peered":"2023-10-03T19:16:46.347192+0000","last_unstale":"2023-10-03T19:16:46.374546+0000","last_undegraded":"2023-10-03T19:16:46.374546+0000","last_fullsized":"2023-10-03T19:16:46.374546+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:42:11.101433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.382846+0000","last_change":"2023-10-03T19:16:46.376955+0000","last_active":"2023-10-03T19:16:46.382846+0000","last_peered":"2023-10-03T19:16:46.382846+0000","last_clean":"2023-10-03T19:16:46.382846+0000","last_became_active":"2023-10-03T19:16:46.376315+0000","last_became_peered":"2023-10-03T19:16:46.376315+0000","last_unstale":"2023-10-03T19:16:46.382846+0000","last_undegraded":"2023-10-03T19:16:46.382846+0000","last_fullsized":"2023-10-03T19:16:46.382846+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:39:49.540080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.348676+0000","last_change":"2023-10-03T19:16:46.348039+0000","last_active":"2023-10-03T19:16:46.348676+0000","last_peered":"2023-10-03T19:16:46.348676+0000","last_clean":"2023-10-03T19:16:46.348676+0000","last_became_active":"2023-10-03T19:16:46.347765+0000","last_became_peered":"2023-10-03T19:16:46.347765+0000","last_unstale":"2023-10-03T19:16:46.348676+0000","last_undegraded":"2023-10-03T19:16:46.348676+0000","last_fullsized":"2023-10-03T19:16:46.348676+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:05:13.691561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381879+0000","last_change":"2023-10-03T19:16:46.371593+0000","last_active":"2023-10-03T19:16:46.381879+0000","last_peered":"2023-10-03T19:16:46.381879+0000","last_clean":"2023-10-03T19:16:46.381879+0000","last_became_active":"2023-10-03T19:16:46.369346+0000","last_became_peered":"2023-10-03T19:16:46.369346+0000","last_unstale":"2023-10-03T19:16:46.381879+0000","last_undegraded":"2023-10-03T19:16:46.381879+0000","last_fullsized":"2023-10-03T19:16:46.381879+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:54:53.731901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381775+0000","last_change":"2023-10-03T19:16:46.370812+0000","last_active":"2023-10-03T19:16:46.381775+0000","last_peered":"2023-10-03T19:16:46.381775+0000","last_clean":"2023-10-03T19:16:46.381775+0000","last_became_active":"2023-10-03T19:16:46.368674+0000","last_became_peered":"2023-10-03T19:16:46.368674+0000","last_unstale":"2023-10-03T19:16:46.381775+0000","last_undegraded":"2023-10-03T19:16:46.381775+0000","last_fullsized":"2023-10-03T19:16:46.381775+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:30:05.766523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.379890+0000","last_change":"2023-10-03T19:16:46.363645+0000","last_active":"2023-10-03T19:16:46.379890+0000","last_peered":"2023-10-03T19:16:46.379890+0000","last_clean":"2023-10-03T19:16:46.379890+0000","last_became_active":"2023-10-03T19:16:46.363014+0000","last_became_peered":"2023-10-03T19:16:46.363014+0000","last_unstale":"2023-10-03T19:16:46.379890+0000","last_undegraded":"2023-10-03T19:16:46.379890+0000","last_fullsized":"2023-10-03T19:16:46.379890+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:20:40.295554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381783+0000","last_change":"2023-10-03T19:16:46.370866+0000","last_active":"2023-10-03T19:16:46.381783+0000","last_peered":"2023-10-03T19:16:46.381783+0000","last_clean":"2023-10-03T19:16:46.381783+0000","last_became_active":"2023-10-03T19:16:46.369194+0000","last_became_peered":"2023-10-03T19:16:46.369194+0000","last_unstale":"2023-10-03T19:16:46.381783+0000","last_undegraded":"2023-10-03T19:16:46.381783+0000","last_fullsized":"2023-10-03T19:16:46.381783+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:28:32.763091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381998+0000","last_change":"2023-10-03T19:16:46.371802+0000","last_active":"2023-10-03T19:16:46.381998+0000","last_peered":"2023-10-03T19:16:46.381998+0000","last_clean":"2023-10-03T19:16:46.381998+0000","last_became_active":"2023-10-03T19:16:46.371306+0000","last_became_peered":"2023-10-03T19:16:46.371306+0000","last_unstale":"2023-10-03T19:16:46.381998+0000","last_undegraded":"2023-10-03T19:16:46.381998+0000","last_fullsized":"2023-10-03T19:16:46.381998+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:43:09.345662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.322740+0000","last_change":"2023-10-03T19:16:46.321343+0000","last_active":"2023-10-03T19:16:46.322740+0000","last_peered":"2023-10-03T19:16:46.322740+0000","last_clean":"2023-10-03T19:16:46.322740+0000","last_became_active":"2023-10-03T19:16:46.321083+0000","last_became_peered":"2023-10-03T19:16:46.321083+0000","last_unstale":"2023-10-03T19:16:46.322740+0000","last_undegraded":"2023-10-03T19:16:46.322740+0000","last_fullsized":"2023-10-03T19:16:46.322740+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:51:28.753857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.347991+0000","last_change":"2023-10-03T19:16:46.346773+0000","last_active":"2023-10-03T19:16:46.347991+0000","last_peered":"2023-10-03T19:16:46.347991+0000","last_clean":"2023-10-03T19:16:46.347991+0000","last_became_active":"2023-10-03T19:16:46.346453+0000","last_became_peered":"2023-10-03T19:16:46.346453+0000","last_unstale":"2023-10-03T19:16:46.347991+0000","last_undegraded":"2023-10-03T19:16:46.347991+0000","last_fullsized":"2023-10-03T19:16:46.347991+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:40:18.437890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.374309+0000","last_change":"2023-10-03T19:16:46.349167+0000","last_active":"2023-10-03T19:16:46.374309+0000","last_peered":"2023-10-03T19:16:46.374309+0000","last_clean":"2023-10-03T19:16:46.374309+0000","last_became_active":"2023-10-03T19:16:46.348310+0000","last_became_peered":"2023-10-03T19:16:46.348310+0000","last_unstale":"2023-10-03T19:16:46.374309+0000","last_undegraded":"2023-10-03T19:16:46.374309+0000","last_fullsized":"2023-10-03T19:16:46.374309+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:39:42.294017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.378898+0000","last_change":"2023-10-03T19:16:46.364849+0000","last_active":"2023-10-03T19:16:46.378898+0000","last_peered":"2023-10-03T19:16:46.378898+0000","last_clean":"2023-10-03T19:16:46.378898+0000","last_became_active":"2023-10-03T19:16:46.362795+0000","last_became_peered":"2023-10-03T19:16:46.362795+0000","last_unstale":"2023-10-03T19:16:46.378898+0000","last_undegraded":"2023-10-03T19:16:46.378898+0000","last_fullsized":"2023-10-03T19:16:46.378898+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:11:48.396477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":3,"reported_epoch":60,"state":"creating+activating","last_fresh":"2023-10-03T19:16:46.303990+0000","last_change":"2023-10-03T19:16:46.303990+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:46.303990+0000","last_undegraded":"2023-10-03T19:16:46.303990+0000","last_fullsized":"2023-10-03T19:16:46.303990+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:04:47.708070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":3,"reported_epoch":60,"state":"creating+activating","last_fresh":"2023-10-03T19:16:46.304321+0000","last_change":"2023-10-03T19:16:46.304321+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:46.304321+0000","last_undegraded":"2023-10-03T19:16:46.304321+0000","last_fullsized":"2023-10-03T19:16:46.304321+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:59:33.879590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":3,"reported_epoch":60,"state":"creating+activating","last_fresh":"2023-10-03T19:16:46.303772+0000","last_change":"2023-10-03T19:16:46.303772+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:46.303772+0000","last_undegraded":"2023-10-03T19:16:46.303772+0000","last_fullsized":"2023-10-03T19:16:46.303772+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:35:51.612936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381818+0000","last_change":"2023-10-03T19:16:46.371106+0000","last_active":"2023-10-03T19:16:46.381818+0000","last_peered":"2023-10-03T19:16:46.381818+0000","last_clean":"2023-10-03T19:16:46.381818+0000","last_became_active":"2023-10-03T19:16:46.368784+0000","last_became_peered":"2023-10-03T19:16:46.368784+0000","last_unstale":"2023-10-03T19:16:46.381818+0000","last_undegraded":"2023-10-03T19:16:46.381818+0000","last_fullsized":"2023-10-03T19:16:46.381818+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:46:26.365305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.379936+0000","last_change":"2023-10-03T19:16:46.364524+0000","last_active":"2023-10-03T19:16:46.379936+0000","last_peered":"2023-10-03T19:16:46.379936+0000","last_clean":"2023-10-03T19:16:46.379936+0000","last_became_active":"2023-10-03T19:16:46.364031+0000","last_became_peered":"2023-10-03T19:16:46.364031+0000","last_unstale":"2023-10-03T19:16:46.379936+0000","last_undegraded":"2023-10-03T19:16:46.379936+0000","last_fullsized":"2023-10-03T19:16:46.379936+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:06:40.428254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.365969+0000","last_change":"2023-10-03T19:16:46.365391+0000","last_active":"2023-10-03T19:16:46.365969+0000","last_peered":"2023-10-03T19:16:46.365969+0000","last_clean":"2023-10-03T19:16:46.365969+0000","last_became_active":"2023-10-03T19:16:46.365114+0000","last_became_peered":"2023-10-03T19:16:46.365114+0000","last_unstale":"2023-10-03T19:16:46.365969+0000","last_undegraded":"2023-10-03T19:16:46.365969+0000","last_fullsized":"2023-10-03T19:16:46.365969+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:39:36.928666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.379484+0000","last_change":"2023-10-03T19:16:46.368881+0000","last_active":"2023-10-03T19:16:46.379484+0000","last_peered":"2023-10-03T19:16:46.379484+0000","last_clean":"2023-10-03T19:16:46.379484+0000","last_became_active":"2023-10-03T19:16:46.368277+0000","last_became_peered":"2023-10-03T19:16:46.368277+0000","last_unstale":"2023-10-03T19:16:46.379484+0000","last_undegraded":"2023-10-03T19:16:46.379484+0000","last_fullsized":"2023-10-03T19:16:46.379484+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:24:10.893825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.373833+0000","last_change":"2023-10-03T19:16:46.348251+0000","last_active":"2023-10-03T19:16:46.373833+0000","last_peered":"2023-10-03T19:16:46.373833+0000","last_clean":"2023-10-03T19:16:46.373833+0000","last_became_active":"2023-10-03T19:16:46.347396+0000","last_became_peered":"2023-10-03T19:16:46.347396+0000","last_unstale":"2023-10-03T19:16:46.373833+0000","last_undegraded":"2023-10-03T19:16:46.373833+0000","last_fullsized":"2023-10-03T19:16:46.373833+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:39:49.540080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.379004+0000","last_change":"2023-10-03T19:16:46.365538+0000","last_active":"2023-10-03T19:16:46.379004+0000","last_peered":"2023-10-03T19:16:46.379004+0000","last_clean":"2023-10-03T19:16:46.379004+0000","last_became_active":"2023-10-03T19:16:46.365018+0000","last_became_peered":"2023-10-03T19:16:46.365018+0000","last_unstale":"2023-10-03T19:16:46.379004+0000","last_undegraded":"2023-10-03T19:16:46.379004+0000","last_fullsized":"2023-10-03T19:16:46.379004+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:41:32.807340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"60'4","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.347934+0000","last_change":"2023-10-03T19:16:45.981820+0000","last_active":"2023-10-03T19:16:46.347934+0000","last_peered":"2023-10-03T19:16:46.347934+0000","last_clean":"2023-10-03T19:16:46.347934+0000","last_became_active":"2023-10-03T19:16:45.981370+0000","last_became_peered":"2023-10-03T19:16:45.981370+0000","last_unstale":"2023-10-03T19:16:46.347934+0000","last_undegraded":"2023-10-03T19:16:46.347934+0000","last_fullsized":"2023-10-03T19:16:46.347934+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:27:07.552881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.380668+0000","last_change":"2023-10-03T19:16:46.376884+0000","last_active":"2023-10-03T19:16:46.380668+0000","last_peered":"2023-10-03T19:16:46.380668+0000","last_clean":"2023-10-03T19:16:46.380668+0000","last_became_active":"2023-10-03T19:16:46.376443+0000","last_became_peered":"2023-10-03T19:16:46.376443+0000","last_unstale":"2023-10-03T19:16:46.380668+0000","last_undegraded":"2023-10-03T19:16:46.380668+0000","last_fullsized":"2023-10-03T19:16:46.380668+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:48:22.544505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381832+0000","last_change":"2023-10-03T19:16:46.371148+0000","last_active":"2023-10-03T19:16:46.381832+0000","last_peered":"2023-10-03T19:16:46.381832+0000","last_clean":"2023-10-03T19:16:46.381832+0000","last_became_active":"2023-10-03T19:16:46.368434+0000","last_became_peered":"2023-10-03T19:16:46.368434+0000","last_unstale":"2023-10-03T19:16:46.381832+0000","last_undegraded":"2023-10-03T19:16:46.381832+0000","last_fullsized":"2023-10-03T19:16:46.381832+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:36:18.321914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.320047+0000","last_change":"2023-10-03T19:16:46.315631+0000","last_active":"2023-10-03T19:16:46.320047+0000","last_peered":"2023-10-03T19:16:46.320047+0000","last_clean":"2023-10-03T19:16:46.320047+0000","last_became_active":"2023-10-03T19:16:46.315402+0000","last_became_peered":"2023-10-03T19:16:46.315402+0000","last_unstale":"2023-10-03T19:16:46.320047+0000","last_undegraded":"2023-10-03T19:16:46.320047+0000","last_fullsized":"2023-10-03T19:16:46.320047+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:23:09.252397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.303917+0000","last_change":"2023-10-03T19:16:45.941443+0000","last_active":"2023-10-03T19:16:46.303917+0000","last_peered":"2023-10-03T19:16:46.303917+0000","last_clean":"2023-10-03T19:16:46.303917+0000","last_became_active":"2023-10-03T19:16:45.940415+0000","last_became_peered":"2023-10-03T19:16:45.940415+0000","last_unstale":"2023-10-03T19:16:46.303917+0000","last_undegraded":"2023-10-03T19:16:46.303917+0000","last_fullsized":"2023-10-03T19:16:46.303917+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:39:35.917858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.348031+0000","last_change":"2023-10-03T19:16:46.346859+0000","last_active":"2023-10-03T19:16:46.348031+0000","last_peered":"2023-10-03T19:16:46.348031+0000","last_clean":"2023-10-03T19:16:46.348031+0000","last_became_active":"2023-10-03T19:16:46.346492+0000","last_became_peered":"2023-10-03T19:16:46.346492+0000","last_unstale":"2023-10-03T19:16:46.348031+0000","last_undegraded":"2023-10-03T19:16:46.348031+0000","last_fullsized":"2023-10-03T19:16:46.348031+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:59:33.879590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.303995+0000","last_change":"2023-10-03T19:16:45.947189+0000","last_active":"2023-10-03T19:16:46.303995+0000","last_peered":"2023-10-03T19:16:46.303995+0000","last_clean":"2023-10-03T19:16:46.303995+0000","last_became_active":"2023-10-03T19:16:45.946936+0000","last_became_peered":"2023-10-03T19:16:45.946936+0000","last_unstale":"2023-10-03T19:16:46.303995+0000","last_undegraded":"2023-10-03T19:16:46.303995+0000","last_fullsized":"2023-10-03T19:16:46.303995+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:14:23.283654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.379044+0000","last_change":"2023-10-03T19:16:46.365932+0000","last_active":"2023-10-03T19:16:46.379044+0000","last_peered":"2023-10-03T19:16:46.379044+0000","last_clean":"2023-10-03T19:16:46.379044+0000","last_became_active":"2023-10-03T19:16:46.362477+0000","last_became_peered":"2023-10-03T19:16:46.362477+0000","last_unstale":"2023-10-03T19:16:46.379044+0000","last_undegraded":"2023-10-03T19:16:46.379044+0000","last_fullsized":"2023-10-03T19:16:46.379044+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:47:38.571281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.303786+0000","last_change":"2023-10-03T19:16:45.963852+0000","last_active":"2023-10-03T19:16:46.303786+0000","last_peered":"2023-10-03T19:16:46.303786+0000","last_clean":"2023-10-03T19:16:46.303786+0000","last_became_active":"2023-10-03T19:16:45.963421+0000","last_became_peered":"2023-10-03T19:16:45.963421+0000","last_unstale":"2023-10-03T19:16:46.303786+0000","last_undegraded":"2023-10-03T19:16:46.303786+0000","last_fullsized":"2023-10-03T19:16:46.303786+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:40:17.427082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":3,"reported_epoch":60,"state":"creating+activating","last_fresh":"2023-10-03T19:16:46.303898+0000","last_change":"2023-10-03T19:16:46.303898+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:46.303898+0000","last_undegraded":"2023-10-03T19:16:46.303898+0000","last_fullsized":"2023-10-03T19:16:46.303898+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:54:01.595268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.338665+0000","last_change":"2023-10-03T19:16:45.985444+0000","last_active":"2023-10-03T19:16:46.338665+0000","last_peered":"2023-10-03T19:16:46.338665+0000","last_clean":"2023-10-03T19:16:46.338665+0000","last_became_active":"2023-10-03T19:16:45.984784+0000","last_became_peered":"2023-10-03T19:16:45.984784+0000","last_unstale":"2023-10-03T19:16:46.338665+0000","last_undegraded":"2023-10-03T19:16:46.338665+0000","last_fullsized":"2023-10-03T19:16:46.338665+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:55:43.921541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.319823+0000","last_change":"2023-10-03T19:16:46.317689+0000","last_active":"2023-10-03T19:16:46.319823+0000","last_peered":"2023-10-03T19:16:46.319823+0000","last_clean":"2023-10-03T19:16:46.319823+0000","last_became_active":"2023-10-03T19:16:46.317385+0000","last_became_peered":"2023-10-03T19:16:46.317385+0000","last_unstale":"2023-10-03T19:16:46.319823+0000","last_undegraded":"2023-10-03T19:16:46.319823+0000","last_fullsized":"2023-10-03T19:16:46.319823+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:13:34.942009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.334840+0000","last_change":"2023-10-03T19:16:45.986113+0000","last_active":"2023-10-03T19:16:46.334840+0000","last_peered":"2023-10-03T19:16:46.334840+0000","last_clean":"2023-10-03T19:16:46.334840+0000","last_became_active":"2023-10-03T19:16:45.985260+0000","last_became_peered":"2023-10-03T19:16:45.985260+0000","last_unstale":"2023-10-03T19:16:46.334840+0000","last_undegraded":"2023-10-03T19:16:46.334840+0000","last_fullsized":"2023-10-03T19:16:46.334840+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:50:36.723051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":3,"reported_epoch":60,"state":"creating+activating","last_fresh":"2023-10-03T19:16:46.303808+0000","last_change":"2023-10-03T19:16:46.303808+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:46.303808+0000","last_undegraded":"2023-10-03T19:16:46.303808+0000","last_fullsized":"2023-10-03T19:16:46.303808+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:13:34.942009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.319272+0000","last_change":"2023-10-03T19:16:45.963314+0000","last_active":"2023-10-03T19:16:46.319272+0000","last_peered":"2023-10-03T19:16:46.319272+0000","last_clean":"2023-10-03T19:16:46.319272+0000","last_became_active":"2023-10-03T19:16:45.962565+0000","last_became_peered":"2023-10-03T19:16:45.962565+0000","last_unstale":"2023-10-03T19:16:46.319272+0000","last_undegraded":"2023-10-03T19:16:46.319272+0000","last_fullsized":"2023-10-03T19:16:46.319272+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:38:40.745903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.382640+0000","last_change":"2023-10-03T19:16:46.369750+0000","last_active":"2023-10-03T19:16:46.382640+0000","last_peered":"2023-10-03T19:16:46.382640+0000","last_clean":"2023-10-03T19:16:46.382640+0000","last_became_active":"2023-10-03T19:16:46.368994+0000","last_became_peered":"2023-10-03T19:16:46.368994+0000","last_unstale":"2023-10-03T19:16:46.382640+0000","last_undegraded":"2023-10-03T19:16:46.382640+0000","last_fullsized":"2023-10-03T19:16:46.382640+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:39:42.294017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"60'3","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.372238+0000","last_change":"2023-10-03T19:16:45.986493+0000","last_active":"2023-10-03T19:16:46.372238+0000","last_peered":"2023-10-03T19:16:46.372238+0000","last_clean":"2023-10-03T19:16:46.372238+0000","last_became_active":"2023-10-03T19:16:45.985657+0000","last_became_peered":"2023-10-03T19:16:45.985657+0000","last_unstale":"2023-10-03T19:16:46.372238+0000","last_undegraded":"2023-10-03T19:16:46.372238+0000","last_fullsized":"2023-10-03T19:16:46.372238+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:17:49.085309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.373559+0000","last_change":"2023-10-03T19:16:46.349205+0000","last_active":"2023-10-03T19:16:46.373559+0000","last_peered":"2023-10-03T19:16:46.373559+0000","last_clean":"2023-10-03T19:16:46.373559+0000","last_became_active":"2023-10-03T19:16:46.348690+0000","last_became_peered":"2023-10-03T19:16:46.348690+0000","last_unstale":"2023-10-03T19:16:46.373559+0000","last_undegraded":"2023-10-03T19:16:46.373559+0000","last_fullsized":"2023-10-03T19:16:46.373559+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:26:38.764887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"60'6","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.377937+0000","last_change":"2023-10-03T19:16:45.967950+0000","last_active":"2023-10-03T19:16:46.377937+0000","last_peered":"2023-10-03T19:16:46.377937+0000","last_clean":"2023-10-03T19:16:46.377937+0000","last_became_active":"2023-10-03T19:16:45.967600+0000","last_became_peered":"2023-10-03T19:16:45.967600+0000","last_unstale":"2023-10-03T19:16:46.377937+0000","last_undegraded":"2023-10-03T19:16:46.377937+0000","last_fullsized":"2023-10-03T19:16:46.377937+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:20:31.279031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.376767+0000","last_change":"2023-10-03T19:16:46.356075+0000","last_active":"2023-10-03T19:16:46.376767+0000","last_peered":"2023-10-03T19:16:46.376767+0000","last_clean":"2023-10-03T19:16:46.376767+0000","last_became_active":"2023-10-03T19:16:46.355562+0000","last_became_peered":"2023-10-03T19:16:46.355562+0000","last_unstale":"2023-10-03T19:16:46.376767+0000","last_undegraded":"2023-10-03T19:16:46.376767+0000","last_fullsized":"2023-10-03T19:16:46.376767+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:47:38.571281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"60'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.373230+0000","last_change":"2023-10-03T19:16:45.987343+0000","last_active":"2023-10-03T19:16:46.373230+0000","last_peered":"2023-10-03T19:16:46.373230+0000","last_clean":"2023-10-03T19:16:46.373230+0000","last_became_active":"2023-10-03T19:16:45.986702+0000","last_became_peered":"2023-10-03T19:16:45.986702+0000","last_unstale":"2023-10-03T19:16:46.373230+0000","last_undegraded":"2023-10-03T19:16:46.373230+0000","last_fullsized":"2023-10-03T19:16:46.373230+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:12:08.318383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.382779+0000","last_change":"2023-10-03T19:16:46.376007+0000","last_active":"2023-10-03T19:16:46.382779+0000","last_peered":"2023-10-03T19:16:46.382779+0000","last_clean":"2023-10-03T19:16:46.382779+0000","last_became_active":"2023-10-03T19:16:46.375324+0000","last_became_peered":"2023-10-03T19:16:46.375324+0000","last_unstale":"2023-10-03T19:16:46.382779+0000","last_undegraded":"2023-10-03T19:16:46.382779+0000","last_fullsized":"2023-10-03T19:16:46.382779+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:26:38.764887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.330299+0000","last_change":"2023-10-03T19:16:45.987260+0000","last_active":"2023-10-03T19:16:46.330299+0000","last_peered":"2023-10-03T19:16:46.330299+0000","last_clean":"2023-10-03T19:16:46.330299+0000","last_became_active":"2023-10-03T19:16:45.984760+0000","last_became_peered":"2023-10-03T19:16:45.984760+0000","last_unstale":"2023-10-03T19:16:46.330299+0000","last_undegraded":"2023-10-03T19:16:46.330299+0000","last_fullsized":"2023-10-03T19:16:46.330299+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:07:06.884577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.344612+0000","last_change":"2023-10-03T19:16:46.343379+0000","last_active":"2023-10-03T19:16:46.344612+0000","last_peered":"2023-10-03T19:16:46.344612+0000","last_clean":"2023-10-03T19:16:46.344612+0000","last_became_active":"2023-10-03T19:16:46.343101+0000","last_became_peered":"2023-10-03T19:16:46.343101+0000","last_unstale":"2023-10-03T19:16:46.344612+0000","last_undegraded":"2023-10-03T19:16:46.344612+0000","last_fullsized":"2023-10-03T19:16:46.344612+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:27:11.167546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"60'8","reported_seq":19,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.379864+0000","last_change":"2023-10-03T19:16:45.985749+0000","last_active":"2023-10-03T19:16:46.379864+0000","last_peered":"2023-10-03T19:16:46.379864+0000","last_clean":"2023-10-03T19:16:46.379864+0000","last_became_active":"2023-10-03T19:16:45.985075+0000","last_became_peered":"2023-10-03T19:16:45.985075+0000","last_unstale":"2023-10-03T19:16:46.379864+0000","last_undegraded":"2023-10-03T19:16:46.379864+0000","last_fullsized":"2023-10-03T19:16:46.379864+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:11:47.385670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.319948+0000","last_change":"2023-10-03T19:16:46.315032+0000","last_active":"2023-10-03T19:16:46.319948+0000","last_peered":"2023-10-03T19:16:46.319948+0000","last_clean":"2023-10-03T19:16:46.319948+0000","last_became_active":"2023-10-03T19:16:46.314754+0000","last_became_peered":"2023-10-03T19:16:46.314754+0000","last_unstale":"2023-10-03T19:16:46.319948+0000","last_undegraded":"2023-10-03T19:16:46.319948+0000","last_fullsized":"2023-10-03T19:16:46.319948+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:29:49.777567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.382604+0000","last_change":"2023-10-03T19:16:46.368611+0000","last_active":"2023-10-03T19:16:46.382604+0000","last_peered":"2023-10-03T19:16:46.382604+0000","last_clean":"2023-10-03T19:16:46.382604+0000","last_became_active":"2023-10-03T19:16:46.367938+0000","last_became_peered":"2023-10-03T19:16:46.367938+0000","last_unstale":"2023-10-03T19:16:46.382604+0000","last_undegraded":"2023-10-03T19:16:46.382604+0000","last_fullsized":"2023-10-03T19:16:46.382604+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:52:34.746547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.313791+0000","last_change":"2023-10-03T19:16:45.967954+0000","last_active":"2023-10-03T19:16:46.313791+0000","last_peered":"2023-10-03T19:16:46.313791+0000","last_clean":"2023-10-03T19:16:46.313791+0000","last_became_active":"2023-10-03T19:16:45.967581+0000","last_became_peered":"2023-10-03T19:16:45.967581+0000","last_unstale":"2023-10-03T19:16:46.313791+0000","last_undegraded":"2023-10-03T19:16:46.313791+0000","last_fullsized":"2023-10-03T19:16:46.313791+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:45:37.045472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.378791+0000","last_change":"2023-10-03T19:16:46.362149+0000","last_active":"2023-10-03T19:16:46.378791+0000","last_peered":"2023-10-03T19:16:46.378791+0000","last_clean":"2023-10-03T19:16:46.378791+0000","last_became_active":"2023-10-03T19:16:46.361627+0000","last_became_peered":"2023-10-03T19:16:46.361627+0000","last_unstale":"2023-10-03T19:16:46.378791+0000","last_undegraded":"2023-10-03T19:16:46.378791+0000","last_fullsized":"2023-10-03T19:16:46.378791+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:28:53.885325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.333806+0000","last_change":"2023-10-03T19:16:45.986852+0000","last_active":"2023-10-03T19:16:46.333806+0000","last_peered":"2023-10-03T19:16:46.333806+0000","last_clean":"2023-10-03T19:16:46.333806+0000","last_became_active":"2023-10-03T19:16:45.985615+0000","last_became_peered":"2023-10-03T19:16:45.985615+0000","last_unstale":"2023-10-03T19:16:46.333806+0000","last_undegraded":"2023-10-03T19:16:46.333806+0000","last_fullsized":"2023-10-03T19:16:46.333806+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:31:27.554913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.374699+0000","last_change":"2023-10-03T19:16:46.355632+0000","last_active":"2023-10-03T19:16:46.374699+0000","last_peered":"2023-10-03T19:16:46.374699+0000","last_clean":"2023-10-03T19:16:46.374699+0000","last_became_active":"2023-10-03T19:16:46.355020+0000","last_became_peered":"2023-10-03T19:16:46.355020+0000","last_unstale":"2023-10-03T19:16:46.374699+0000","last_undegraded":"2023-10-03T19:16:46.374699+0000","last_fullsized":"2023-10-03T19:16:46.374699+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:52:34.746547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.304143+0000","last_change":"2023-10-03T19:16:45.944273+0000","last_active":"2023-10-03T19:16:46.304143+0000","last_peered":"2023-10-03T19:16:46.304143+0000","last_clean":"2023-10-03T19:16:46.304143+0000","last_became_active":"2023-10-03T19:16:45.943995+0000","last_became_peered":"2023-10-03T19:16:45.943995+0000","last_unstale":"2023-10-03T19:16:46.304143+0000","last_undegraded":"2023-10-03T19:16:46.304143+0000","last_fullsized":"2023-10-03T19:16:46.304143+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:56:23.017353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.343879+0000","last_change":"2023-10-03T19:16:46.342684+0000","last_active":"2023-10-03T19:16:46.343879+0000","last_peered":"2023-10-03T19:16:46.343879+0000","last_clean":"2023-10-03T19:16:46.343879+0000","last_became_active":"2023-10-03T19:16:46.342293+0000","last_became_peered":"2023-10-03T19:16:46.342293+0000","last_unstale":"2023-10-03T19:16:46.343879+0000","last_undegraded":"2023-10-03T19:16:46.343879+0000","last_fullsized":"2023-10-03T19:16:46.343879+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:14:24.294462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.303651+0000","last_change":"2023-10-03T19:16:45.964339+0000","last_active":"2023-10-03T19:16:46.303651+0000","last_peered":"2023-10-03T19:16:46.303651+0000","last_clean":"2023-10-03T19:16:46.303651+0000","last_became_active":"2023-10-03T19:16:45.963814+0000","last_became_peered":"2023-10-03T19:16:45.963814+0000","last_unstale":"2023-10-03T19:16:46.303651+0000","last_undegraded":"2023-10-03T19:16:46.303651+0000","last_fullsized":"2023-10-03T19:16:46.303651+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:34:29.129059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.355035+0000","last_change":"2023-10-03T19:16:46.354068+0000","last_active":"2023-10-03T19:16:46.355035+0000","last_peered":"2023-10-03T19:16:46.355035+0000","last_clean":"2023-10-03T19:16:46.355035+0000","last_became_active":"2023-10-03T19:16:46.353774+0000","last_became_peered":"2023-10-03T19:16:46.353774+0000","last_unstale":"2023-10-03T19:16:46.355035+0000","last_undegraded":"2023-10-03T19:16:46.355035+0000","last_fullsized":"2023-10-03T19:16:46.355035+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:10:40.127195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.312472+0000","last_change":"2023-10-03T19:16:45.972785+0000","last_active":"2023-10-03T19:16:46.312472+0000","last_peered":"2023-10-03T19:16:46.312472+0000","last_clean":"2023-10-03T19:16:46.312472+0000","last_became_active":"2023-10-03T19:16:45.972526+0000","last_became_peered":"2023-10-03T19:16:45.972526+0000","last_unstale":"2023-10-03T19:16:46.312472+0000","last_undegraded":"2023-10-03T19:16:46.312472+0000","last_fullsized":"2023-10-03T19:16:46.312472+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:56:23.017353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.382575+0000","last_change":"2023-10-03T19:16:46.368258+0000","last_active":"2023-10-03T19:16:46.382575+0000","last_peered":"2023-10-03T19:16:46.382575+0000","last_clean":"2023-10-03T19:16:46.382575+0000","last_became_active":"2023-10-03T19:16:46.367559+0000","last_became_peered":"2023-10-03T19:16:46.367559+0000","last_unstale":"2023-10-03T19:16:46.382575+0000","last_undegraded":"2023-10-03T19:16:46.382575+0000","last_fullsized":"2023-10-03T19:16:46.382575+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:42:11.101433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.303561+0000","last_change":"2023-10-03T19:16:45.940912+0000","last_active":"2023-10-03T19:16:46.303561+0000","last_peered":"2023-10-03T19:16:46.303561+0000","last_clean":"2023-10-03T19:16:46.303561+0000","last_became_active":"2023-10-03T19:16:45.940610+0000","last_became_peered":"2023-10-03T19:16:45.940610+0000","last_unstale":"2023-10-03T19:16:46.303561+0000","last_undegraded":"2023-10-03T19:16:46.303561+0000","last_fullsized":"2023-10-03T19:16:46.303561+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:59:41.638843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":243,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.328586+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:16:46.328586+0000","last_peered":"2023-10-03T19:16:46.328586+0000","last_clean":"2023-10-03T19:16:46.328586+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:16:46.328586+0000","last_undegraded":"2023-10-03T19:16:46.328586+0000","last_fullsized":"2023-10-03T19:16:46.328586+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:11:26.721249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":85,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-03T19:16:41.636037+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:16:41.636037+0000","last_peered":"2023-10-03T19:16:41.636037+0000","last_clean":"2023-10-03T19:16:41.636037+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:16:41.636037+0000","last_undegraded":"2023-10-03T19:16:41.636037+0000","last_fullsized":"2023-10-03T19:16:41.636037+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:56:34.954100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":91,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.328210+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:16:46.328210+0000","last_peered":"2023-10-03T19:16:46.328210+0000","last_clean":"2023-10-03T19:16:46.328210+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:16:46.328210+0000","last_undegraded":"2023-10-03T19:16:46.328210+0000","last_fullsized":"2023-10-03T19:16:46.328210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:55:03.497461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":89,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.308380+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:16:46.308380+0000","last_peered":"2023-10-03T19:16:46.308380+0000","last_clean":"2023-10-03T19:16:46.308380+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:16:46.308380+0000","last_undegraded":"2023-10-03T19:16:46.308380+0000","last_fullsized":"2023-10-03T19:16:46.308380+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:21:56.372171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.378783+0000","last_change":"2023-10-03T19:16:46.362051+0000","last_active":"2023-10-03T19:16:46.378783+0000","last_peered":"2023-10-03T19:16:46.378783+0000","last_clean":"2023-10-03T19:16:46.378783+0000","last_became_active":"2023-10-03T19:16:46.361490+0000","last_became_peered":"2023-10-03T19:16:46.361490+0000","last_unstale":"2023-10-03T19:16:46.378783+0000","last_undegraded":"2023-10-03T19:16:46.378783+0000","last_fullsized":"2023-10-03T19:16:46.378783+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:18:58.638268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":85,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-03T19:16:41.636026+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:16:41.636026+0000","last_peered":"2023-10-03T19:16:41.636026+0000","last_clean":"2023-10-03T19:16:41.636026+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:16:41.636026+0000","last_undegraded":"2023-10-03T19:16:41.636026+0000","last_fullsized":"2023-10-03T19:16:41.636026+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:22:01.296400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381693+0000","last_change":"2023-10-03T19:16:46.369329+0000","last_active":"2023-10-03T19:16:46.381693+0000","last_peered":"2023-10-03T19:16:46.381693+0000","last_clean":"2023-10-03T19:16:46.381693+0000","last_became_active":"2023-10-03T19:16:46.368233+0000","last_became_peered":"2023-10-03T19:16:46.368233+0000","last_unstale":"2023-10-03T19:16:46.381693+0000","last_undegraded":"2023-10-03T19:16:46.381693+0000","last_fullsized":"2023-10-03T19:16:46.381693+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:47:11.516626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":89,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.316693+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:16:46.316693+0000","last_peered":"2023-10-03T19:16:46.316693+0000","last_clean":"2023-10-03T19:16:46.316693+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:16:46.316693+0000","last_undegraded":"2023-10-03T19:16:46.316693+0000","last_fullsized":"2023-10-03T19:16:46.316693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:50:43.182186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.382825+0000","last_change":"2023-10-03T19:16:46.377006+0000","last_active":"2023-10-03T19:16:46.382825+0000","last_peered":"2023-10-03T19:16:46.382825+0000","last_clean":"2023-10-03T19:16:46.382825+0000","last_became_active":"2023-10-03T19:16:46.376427+0000","last_became_peered":"2023-10-03T19:16:46.376427+0000","last_unstale":"2023-10-03T19:16:46.382825+0000","last_undegraded":"2023-10-03T19:16:46.382825+0000","last_fullsized":"2023-10-03T19:16:46.382825+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:17:09.475416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"60'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.369510+0000","last_change":"2023-10-03T19:16:45.986459+0000","last_active":"2023-10-03T19:16:46.369510+0000","last_peered":"2023-10-03T19:16:46.369510+0000","last_clean":"2023-10-03T19:16:46.369510+0000","last_became_active":"2023-10-03T19:16:45.984797+0000","last_became_peered":"2023-10-03T19:16:45.984797+0000","last_unstale":"2023-10-03T19:16:46.369510+0000","last_undegraded":"2023-10-03T19:16:46.369510+0000","last_fullsized":"2023-10-03T19:16:46.369510+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:43:20.530235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.335522+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:16:46.335522+0000","last_peered":"2023-10-03T19:16:46.335522+0000","last_clean":"2023-10-03T19:16:46.335522+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:16:46.335522+0000","last_undegraded":"2023-10-03T19:16:46.335522+0000","last_fullsized":"2023-10-03T19:16:46.335522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:21:36.226307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.380050+0000","last_change":"2023-10-03T19:16:46.370333+0000","last_active":"2023-10-03T19:16:46.380050+0000","last_peered":"2023-10-03T19:16:46.380050+0000","last_clean":"2023-10-03T19:16:46.380050+0000","last_became_active":"2023-10-03T19:16:46.369709+0000","last_became_peered":"2023-10-03T19:16:46.369709+0000","last_unstale":"2023-10-03T19:16:46.380050+0000","last_undegraded":"2023-10-03T19:16:46.380050+0000","last_fullsized":"2023-10-03T19:16:46.380050+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:55:44.932349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"60'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.372385+0000","last_change":"2023-10-03T19:16:45.985981+0000","last_active":"2023-10-03T19:16:46.372385+0000","last_peered":"2023-10-03T19:16:46.372385+0000","last_clean":"2023-10-03T19:16:46.372385+0000","last_became_active":"2023-10-03T19:16:45.984863+0000","last_became_peered":"2023-10-03T19:16:45.984863+0000","last_unstale":"2023-10-03T19:16:46.372385+0000","last_undegraded":"2023-10-03T19:16:46.372385+0000","last_fullsized":"2023-10-03T19:16:46.372385+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:48:25.164498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":89,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.313818+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:16:46.313818+0000","last_peered":"2023-10-03T19:16:46.313818+0000","last_clean":"2023-10-03T19:16:46.313818+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:16:46.313818+0000","last_undegraded":"2023-10-03T19:16:46.313818+0000","last_fullsized":"2023-10-03T19:16:46.313818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:38:39.207017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.378847+0000","last_change":"2023-10-03T19:16:46.362431+0000","last_active":"2023-10-03T19:16:46.378847+0000","last_peered":"2023-10-03T19:16:46.378847+0000","last_clean":"2023-10-03T19:16:46.378847+0000","last_became_active":"2023-10-03T19:16:46.361629+0000","last_became_peered":"2023-10-03T19:16:46.361629+0000","last_unstale":"2023-10-03T19:16:46.378847+0000","last_undegraded":"2023-10-03T19:16:46.378847+0000","last_fullsized":"2023-10-03T19:16:46.378847+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:05:01.669511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.304042+0000","last_change":"2023-10-03T19:16:45.967790+0000","last_active":"2023-10-03T19:16:46.304042+0000","last_peered":"2023-10-03T19:16:46.304042+0000","last_clean":"2023-10-03T19:16:46.304042+0000","last_became_active":"2023-10-03T19:16:45.967432+0000","last_became_peered":"2023-10-03T19:16:45.967432+0000","last_unstale":"2023-10-03T19:16:46.304042+0000","last_undegraded":"2023-10-03T19:16:46.304042+0000","last_fullsized":"2023-10-03T19:16:46.304042+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:27:10.156738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":89,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.351775+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:16:46.351775+0000","last_peered":"2023-10-03T19:16:46.351775+0000","last_clean":"2023-10-03T19:16:46.351775+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:16:46.351775+0000","last_undegraded":"2023-10-03T19:16:46.351775+0000","last_fullsized":"2023-10-03T19:16:46.351775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:34:18.140425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":98,"acting":98,"num_store_stats":6},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2340,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":42,"acting":42,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509496,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25616,"kb_used_data":776,"kb_used_omap":0,"kb_used_meta":24832,"kb_avail":94346224,"statfs":{"total":96636764160,"available":96610533376,"internally_reserved":0,"allocated":794624,"data_stored":906715,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":25427968},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.90900000000000003,"15min":0.94499999999999995},"min":{"1min":0.52000000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.196,"5min":4.0469999999999997,"15min":4.0469999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.85799999999999998,"15min":0.81200000000000006},"min":{"1min":0.625,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2310000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.62}]},{"osd":1,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94399999999999995,"15min":1.0269999999999999},"min":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3200000000000001,"5min":3.8239999999999998,"15min":3.8239999999999998},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.873,"5min":0.88300000000000001,"15min":0.85899999999999999},"min":{"1min":0.65800000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.159,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.96499999999999997}]},{"osd":2,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.93600000000000005,"15min":0.87},"min":{"1min":0.71499999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.212,"5min":6.0449999999999999,"15min":6.0449999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0029999999999999,"15min":1.04},"min":{"1min":0.77400000000000002,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.5800000000000001,"5min":3.98,"15min":3.98},"last":0.93200000000000005}]},{"osd":3,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.996,"15min":0.94399999999999995},"min":{"1min":0.65300000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.26,"5min":6.125,"15min":6.125},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0700000000000001,"15min":1.123},"min":{"1min":0.61899999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.444,"5min":3.9140000000000001,"15min":3.9140000000000001},"last":1.091}]},{"osd":4,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":1.036,"15min":1.1599999999999999},"min":{"1min":0.55900000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.421,"5min":5.1130000000000004,"15min":5.1130000000000004},"last":1.056},{"interface":"front","average":{"1min":0.92500000000000004,"5min":1.022,"15min":1.028},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.385,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":1.006}]},{"osd":5,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.135,"15min":1.268},"min":{"1min":0.72499999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.27,"5min":5.1859999999999999,"15min":5.1859999999999999},"last":1.1919999999999999},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0840000000000001,"15min":1.1459999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.216,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.163}]},{"osd":6,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0920000000000001,"15min":1.1000000000000001},"min":{"1min":0.78900000000000003,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.3440000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.179,"15min":1.1850000000000001},"min":{"1min":0.81799999999999995,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.466,"5min":6.1580000000000004,"15min":6.1580000000000004},"last":1.1359999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509496,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14784,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":14080,"kb_avail":94357056,"statfs":{"total":96636764160,"available":96621625344,"internally_reserved":0,"allocated":712704,"data_stored":314441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14417920},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83499999999999996,"15min":0.81899999999999995},"min":{"1min":0.60499999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.139,"5min":1.504,"15min":1.504},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.89900000000000002,"15min":0.88500000000000001},"min":{"1min":0.56699999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.171,"5min":1.839,"15min":1.839},"last":0.61199999999999999}]},{"osd":1,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.85699999999999998,"15min":0.84099999999999997},"min":{"1min":0.53100000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.1859999999999999,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89000000000000001,"15min":0.88},"min":{"1min":0.59799999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.127,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":1.004}]},{"osd":2,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.91700000000000004,"15min":0.874},"min":{"1min":0.65800000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3600000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.745},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.92100000000000004,"15min":0.92600000000000005},"min":{"1min":0.63200000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3200000000000001,"5min":1.546,"15min":1.546},"last":0.78900000000000003}]},{"osd":3,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.96599999999999997,"15min":0.98199999999999998},"min":{"1min":0.70799999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.91800000000000004,"15min":0.91200000000000003},"min":{"1min":0.69399999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1870000000000001,"5min":2.121,"15min":2.121},"last":0.83799999999999997}]},{"osd":4,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.97299999999999998,"15min":1.026},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.286,"5min":1.95,"15min":1.95},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0329999999999999,"15min":1.091},"min":{"1min":0.65500000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.429,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.0389999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.97199999999999998,"15min":1.0189999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.1259999999999999,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.079,"5min":1.0800000000000001,"15min":1.1200000000000001},"min":{"1min":0.75700000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.524,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.1140000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.093,"15min":1.121},"min":{"1min":0.73699999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.3220000000000001,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.137},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.071,"15min":1.097},"min":{"1min":0.79600000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4350000000000001,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.0800000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509497,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15564,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":14848,"kb_avail":94356276,"statfs":{"total":96636764160,"available":96620826624,"internally_reserved":0,"allocated":724992,"data_stored":317135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15204352},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.83499999999999996,"15min":0.79000000000000004},"min":{"1min":0.54700000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.87},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.83899999999999997,"15min":0.82499999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.026,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.78500000000000003}]},{"osd":1,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.92000000000000004,"15min":0.93200000000000005},"min":{"1min":0.61399999999999999,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.117,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.89700000000000002,"15min":0.86099999999999999},"min":{"1min":0.68799999999999994,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1799999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.72899999999999998}]},{"osd":2,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.93899999999999995,"15min":0.91700000000000004},"min":{"1min":0.56200000000000006,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2390000000000001,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.96599999999999997,"15min":0.94399999999999995},"min":{"1min":0.78300000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.1359999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":1.0940000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.89400000000000002,"15min":0.877},"min":{"1min":0.69199999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.153,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.996,"5min":1.0449999999999999,"15min":1.0649999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3400000000000001,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":1.155}]},{"osd":5,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.99099999999999999,"15min":1.05},"min":{"1min":0.67100000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1819999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.022},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.98099999999999998,"15min":1.0109999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.387,"5min":1.635,"15min":1.635},"last":1.0569999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.0780000000000001,"15min":1.1839999999999999},"min":{"1min":0.71499999999999997,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.1120000000000001,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.1120000000000001,"15min":1.181},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.3640000000000001,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":1.276}]},{"osd":7,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0509999999999999,"15min":1.085},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.242,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.212},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.1759999999999999,"15min":1.2250000000000001},"min":{"1min":0.85599999999999998,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3260000000000001,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":1.52}]}]},{"osd":2,"up_from":15,"seq":64424509497,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25660,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":24960,"kb_avail":94346180,"statfs":{"total":96636764160,"available":96610488320,"internally_reserved":0,"allocated":708608,"data_stored":314407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25559040},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.60399999999999998,"15min":0.54100000000000004},"min":{"1min":0.47099999999999997,"5min":0.247,"15min":0.247},"max":{"1min":1.1020000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.69599999999999995,"15min":0.63},"min":{"1min":0.30299999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.2350000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.65400000000000003}]},{"osd":1,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71299999999999997,"15min":0.63300000000000001},"min":{"1min":0.48599999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1739999999999999,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.67400000000000004,"15min":0.60399999999999998},"min":{"1min":0.42599999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.76700000000000002}]},{"osd":3,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.71499999999999997,"15min":0.63700000000000001},"min":{"1min":0.40500000000000003,"5min":0.224,"15min":0.224},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.82199999999999995,"15min":0.73599999999999999},"min":{"1min":0.44600000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1419999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.91600000000000004}]},{"osd":4,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.91800000000000004,"15min":0.85799999999999998},"min":{"1min":0.63,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":1.274},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.98599999999999999,"15min":0.92400000000000004},"min":{"1min":0.71499999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":1.0149999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.94999999999999996,"15min":0.876},"min":{"1min":0.76600000000000001,"5min":0.432,"15min":0.432},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0249999999999999,"15min":0.95099999999999996},"min":{"1min":0.68100000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4239999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.0740000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.96399999999999997,"15min":0.92200000000000004},"min":{"1min":0.66300000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.302},{"interface":"front","average":{"1min":1.139,"5min":1.0409999999999999,"15min":0.97699999999999998},"min":{"1min":0.64800000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":1.3839999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.0920000000000001,"15min":1.0169999999999999},"min":{"1min":0.74199999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":1.117},{"interface":"front","average":{"1min":1.109,"5min":1.024,"15min":0.96799999999999997},"min":{"1min":0.71099999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.361}]}]},{"osd":1,"up_from":15,"seq":64424509496,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14876,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":14144,"kb_avail":94356964,"statfs":{"total":96636764160,"available":96621531136,"internally_reserved":0,"allocated":741376,"data_stored":317899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14483456},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58499999999999996,"15min":0.54800000000000004},"min":{"1min":0.35899999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.96899999999999997,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.628,"15min":0.52400000000000002},"min":{"1min":0.45200000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.93200000000000005}]},{"osd":2,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.63600000000000001,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.75800000000000001,"15min":0.67500000000000004},"min":{"1min":0.44700000000000001,"5min":0.312,"15min":0.312},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.99199999999999999}]},{"osd":3,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.72499999999999998,"15min":0.64300000000000002},"min":{"1min":0.41699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.2370000000000001,"5min":1.27,"15min":1.27},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.69699999999999995,"15min":0.59699999999999998},"min":{"1min":0.47699999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1830000000000001,"5min":1.27,"15min":1.27},"last":0.66400000000000003}]},{"osd":4,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.86199999999999999,"15min":0.80700000000000005},"min":{"1min":0.69099999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.073},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.93799999999999994,"15min":0.89400000000000002},"min":{"1min":0.65900000000000003,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.2430000000000001}]},{"osd":5,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.94299999999999995,"15min":0.86799999999999999},"min":{"1min":0.69899999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":1.038},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.92000000000000004,"15min":0.85899999999999999},"min":{"1min":0.80700000000000005,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3959999999999999,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.2150000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.99399999999999999,"15min":0.93000000000000005},"min":{"1min":0.68999999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":0.97999999999999998,"15min":0.90400000000000003},"min":{"1min":0.879,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.329,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.1140000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0269999999999999,"15min":0.94799999999999995},"min":{"1min":0.78500000000000003,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.99299999999999999,"15min":0.91100000000000003},"min":{"1min":0.71899999999999997,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5880000000000001,"5min":1.649,"15min":1.649},"last":1.288}]}]},{"osd":3,"up_from":14,"seq":60129542200,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33896,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":33216,"kb_avail":94337944,"statfs":{"total":96636764160,"available":96602054656,"internally_reserved":0,"allocated":688128,"data_stored":301823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":34013184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.627,"15min":0.57699999999999996},"min":{"1min":0.40200000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.2090000000000001,"5min":1.212,"15min":1.212},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68700000000000006,"15min":0.64800000000000002},"min":{"1min":0.32900000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.125,"5min":1.236,"15min":1.236},"last":0.57699999999999996}]},{"osd":1,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.69399999999999995,"15min":0.63700000000000001},"min":{"1min":0.51400000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0589999999999999,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.73599999999999999,"15min":0.67300000000000004},"min":{"1min":0.53000000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.2210000000000001,"5min":1.222,"15min":1.222},"last":0.70099999999999996}]},{"osd":2,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.77600000000000002,"15min":0.71599999999999997},"min":{"1min":0.44600000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.083,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.70999999999999996,"15min":0.63700000000000001},"min":{"1min":0.432,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.89400000000000002}]},{"osd":4,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.94299999999999995,"15min":0.91500000000000004},"min":{"1min":0.58899999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.131,"5min":1.496,"15min":1.496},"last":0.876},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.97799999999999998,"15min":0.93799999999999994},"min":{"1min":0.64100000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.486,"5min":1.546,"15min":1.546},"last":1.175}]},{"osd":5,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.91800000000000004,"15min":0.88200000000000001},"min":{"1min":0.68300000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3280000000000001,"5min":1.51,"15min":1.51},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.044,"5min":1.0249999999999999,"15min":1},"min":{"1min":0.66300000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.387,"5min":1.498,"15min":1.498},"last":0.84799999999999998}]},{"osd":6,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.95999999999999996,"15min":0.92400000000000004},"min":{"1min":0.60899999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1639999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.212},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.042,"15min":0.99299999999999999},"min":{"1min":0.70299999999999996,"5min":0.625,"15min":0.625},"max":{"1min":1.2969999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.0780000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0489999999999999,"15min":1.0089999999999999},"min":{"1min":0.68899999999999995,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.395,"5min":1.597,"15min":1.597},"last":1.026},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.0700000000000001,"15min":1.024},"min":{"1min":0.72699999999999998,"5min":0.623,"15min":0.623},"max":{"1min":1.6040000000000001,"5min":1.708,"15min":1.708},"last":1.1539999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16092,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":15424,"kb_avail":94355748,"statfs":{"total":96636764160,"available":96620285952,"internally_reserved":0,"allocated":675840,"data_stored":295653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15794176},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.85699999999999998,"15min":0.82599999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.1919999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85899999999999999,"15min":0.85299999999999998},"min":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.81000000000000005}]},{"osd":1,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.85299999999999998,"15min":0.83399999999999996},"min":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0920000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.873,"5min":0.91900000000000004,"15min":0.92500000000000004},"min":{"1min":0.59799999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.149,"5min":1.514,"15min":1.514},"last":1.133}]},{"osd":2,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.90800000000000003,"15min":0.89800000000000002},"min":{"1min":0.56299999999999994,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.234,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":1.101},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.90700000000000003,"15min":0.89700000000000002},"min":{"1min":0.66100000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1499999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.95499999999999996}]},{"osd":3,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.93200000000000005,"15min":0.92800000000000005},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.2629999999999999,"5min":1.304,"15min":1.304},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0369999999999999,"15min":1.0289999999999999},"min":{"1min":0.75,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.1679999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.96499999999999997,"15min":0.96899999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.29,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.995,"15min":1.0309999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.222,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.67300000000000004}]},{"osd":6,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.98899999999999999,"15min":1.0309999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2050000000000001,"5min":1.462,"15min":1.462},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.083,"5min":1.1200000000000001,"15min":1.1379999999999999},"min":{"1min":0.78200000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.3759999999999999,"5min":1.823,"15min":1.823},"last":0.91400000000000003}]},{"osd":7,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.0640000000000001,"15min":1.0760000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3280000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.05},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.141,"15min":1.1519999999999999},"min":{"1min":0.79100000000000004,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.399,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.87}]}]},{"osd":0,"up_from":13,"seq":55834574904,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21592,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":20864,"kb_avail":94350248,"statfs":{"total":96636764160,"available":96614653952,"internally_reserved":0,"allocated":737280,"data_stored":884857,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":21364736},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63100000000000001,"15min":0.58599999999999997},"min":{"1min":0.44400000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.75600000000000001,"15min":0.71899999999999997},"min":{"1min":0.5,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.1970000000000001,"5min":1.27,"15min":1.27},"last":0.752}]},{"osd":2,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.73799999999999999,"15min":0.71799999999999997},"min":{"1min":0.50800000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1299999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.3080000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.46800000000000003,"5min":0.315,"15min":0.315},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.68100000000000005}]},{"osd":3,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.82099999999999995,"15min":0.73699999999999999},"min":{"1min":0.59299999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.202,"5min":1.446,"15min":1.446},"last":1.163},{"interface":"front","average":{"1min":0.87,"5min":0.80000000000000004,"15min":0.70999999999999996},"min":{"1min":0.51000000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.304,"5min":1.375,"15min":1.375},"last":0.99299999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.93000000000000005,"15min":0.91200000000000003},"min":{"1min":0.70299999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.052,"15min":1.028},"min":{"1min":0.89200000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.349,"5min":1.508,"15min":1.508},"last":1.371}]},{"osd":5,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.073,"15min":1.0509999999999999},"min":{"1min":0.90400000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3129999999999999,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.0209999999999999,"15min":0.98199999999999998},"min":{"1min":0.77100000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.3959999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.0600000000000001,"15min":1.022},"min":{"1min":0.81200000000000006,"5min":0.623,"15min":0.623},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.04,"15min":0.999},"min":{"1min":0.755,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.448,"5min":1.637,"15min":1.637},"last":1.2170000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.0860000000000001,"15min":1.042},"min":{"1min":0.72799999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.488},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.089,"15min":1.0629999999999999},"min":{"1min":0.76300000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5940000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.091}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:16:49.321 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:16:49.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.474+0000 7f304a797640 1 Processor -- start 2023-10-03T19:16:49.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.474+0000 7f304a797640 1 -- start start 2023-10-03T19:16:49.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.478+0000 7f304a797640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f30440b98f0 0x7f30440b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:49.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.478+0000 7f304a797640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f30440bc810 0x7f304406c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:49.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.478+0000 7f304a797640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30440ba550 con 0x7f30440a2e20 2023-10-03T19:16:49.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.478+0000 7f304a797640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30441526d0 con 0x7f30440b98f0 2023-10-03T19:16:49.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.478+0000 7f304a797640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30441529b0 con 0x7f30440bc810 2023-10-03T19:16:49.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.478+0000 7f3043fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f30440b98f0 0x7f30440b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:49.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.478+0000 7f3043fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f30440b98f0 0x7f30440b9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37018/0 (socket says 172.21.15.45:37018) 2023-10-03T19:16:49.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.478+0000 7f3043fff640 1 -- 172.21.15.45:0/4048259874 learned_addr learned my addr 172.21.15.45:0/4048259874 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:49.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.478+0000 7f3043fff640 1 -- 172.21.15.45:0/4048259874 >> v2:172.21.15.79:3300/0 conn(0x7f30440bc810 msgr2=0x7f304406c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:49.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.478+0000 7f30437fe640 1 --2- 172.21.15.45:0/4048259874 >> v2:172.21.15.79:3300/0 conn(0x7f30440bc810 0x7f304406c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:49.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.478+0000 7f3043fff640 1 --2- 172.21.15.45:0/4048259874 >> v2:172.21.15.79:3300/0 conn(0x7f30440bc810 0x7f304406c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:49.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.478+0000 7f3043fff640 1 -- 172.21.15.45:0/4048259874 >> v1:172.21.15.79:6789/0 conn(0x7f30440a2e20 legacy=0x7f304406c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:49.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.478+0000 7f3043fff640 1 -- 172.21.15.45:0/4048259874 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304406cee0 con 0x7f30440b98f0 2023-10-03T19:16:49.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.478+0000 7f3043fff640 1 --2- 172.21.15.45:0/4048259874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30440b98f0 0x7f30440b9cc0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f30440665f0 tx=0x7f303c01f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651e78b7529639dd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:49.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.478+0000 7f3042ffd640 1 -- 172.21.15.45:0/4048259874 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c0af400 con 0x7f30440b98f0 2023-10-03T19:16:49.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.478+0000 7f3042ffd640 1 -- 172.21.15.45:0/4048259874 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303c0ab050 con 0x7f30440b98f0 2023-10-03T19:16:49.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.478+0000 7f3042ffd640 1 -- 172.21.15.45:0/4048259874 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c0af780 con 0x7f30440b98f0 2023-10-03T19:16:49.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.478+0000 7f304a797640 1 -- 172.21.15.45:0/4048259874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30440b98f0 msgr2=0x7f30440b9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:49.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.478+0000 7f304a797640 1 --2- 172.21.15.45:0/4048259874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30440b98f0 0x7f30440b9cc0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f30440665f0 tx=0x7f303c01f180 comp rx=0 tx=0).stop 2023-10-03T19:16:49.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f304a797640 1 -- 172.21.15.45:0/4048259874 shutdown_connections 2023-10-03T19:16:49.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f304a797640 1 --2- 172.21.15.45:0/4048259874 >> v2:172.21.15.79:3300/0 conn(0x7f30440bc810 0x7f304406c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:49.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f304a797640 1 --2- 172.21.15.45:0/4048259874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30440b98f0 0x7f30440b9cc0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:49.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f304a797640 1 -- 172.21.15.45:0/4048259874 >> 172.21.15.45:0/4048259874 conn(0x7f30440bcf50 msgr2=0x7f30440bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:49.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f304a797640 1 -- 172.21.15.45:0/4048259874 shutdown_connections 2023-10-03T19:16:49.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f304a797640 1 -- 172.21.15.45:0/4048259874 wait complete. 2023-10-03T19:16:49.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f304a797640 1 Processor -- start 2023-10-03T19:16:49.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f304a797640 1 -- start start 2023-10-03T19:16:49.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f304a797640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30440a2e20 0x7f30441e7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:49.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f304a797640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30440b98f0 0x7f304414ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:49.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f304a797640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30440bc810 0x7f30441e5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:49.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f304a797640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30441e8380 con 0x7f30440b98f0 2023-10-03T19:16:49.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f304a797640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304414b3d0 con 0x7f30440bc810 2023-10-03T19:16:49.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f304a797640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304413aa70 con 0x7f30440a2e20 2023-10-03T19:16:49.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f30437fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30440b98f0 0x7f304414ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:49.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f30437fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30440b98f0 0x7f304414ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37028/0 (socket says 172.21.15.45:37028) 2023-10-03T19:16:49.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f30437fe640 1 -- 172.21.15.45:0/2959558976 learned_addr learned my addr 172.21.15.45:0/2959558976 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:49.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f3048d34640 1 --2- 172.21.15.45:0/2959558976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30440bc810 0x7f30441e5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:49.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f3043fff640 1 --2- 172.21.15.45:0/2959558976 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30440a2e20 0x7f30441e7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:49.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f30437fe640 1 -- 172.21.15.45:0/2959558976 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30440a2e20 msgr2=0x7f30441e7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:49.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f30437fe640 1 --2- 172.21.15.45:0/2959558976 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30440a2e20 0x7f30441e7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:49.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f30437fe640 1 -- 172.21.15.45:0/2959558976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30440bc810 msgr2=0x7f30441e5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:49.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f30437fe640 1 --2- 172.21.15.45:0/2959558976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30440bc810 0x7f30441e5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:49.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f30437fe640 1 -- 172.21.15.45:0/2959558976 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303c009b30 con 0x7f30440b98f0 2023-10-03T19:16:49.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f3048d34640 1 --2- 172.21.15.45:0/2959558976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30440bc810 0x7f30441e5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:16:49.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f30437fe640 1 --2- 172.21.15.45:0/2959558976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30440b98f0 0x7f304414ae90 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f302c00c7f0 tx=0x7f302c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:49.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f3040ff9640 1 -- 172.21.15.45:0/2959558976 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c004220 con 0x7f30440b98f0 2023-10-03T19:16:49.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f3040ff9640 1 -- 172.21.15.45:0/2959558976 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c0043a0 con 0x7f30440b98f0 2023-10-03T19:16:49.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f304a797640 1 -- 172.21.15.45:0/2959558976 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30440ba950 con 0x7f30440b98f0 2023-10-03T19:16:49.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f3040ff9640 1 -- 172.21.15.45:0/2959558976 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c004510 con 0x7f30440b98f0 2023-10-03T19:16:49.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f304a797640 1 -- 172.21.15.45:0/2959558976 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30440ba200 con 0x7f30440b98f0 2023-10-03T19:16:49.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.482+0000 7f304a797640 1 -- 172.21.15.45:0/2959558976 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30440baae0 con 0x7f30440b98f0 2023-10-03T19:16:49.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.486+0000 7f3040ff9640 1 -- 172.21.15.45:0/2959558976 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f302c003a70 con 0x7f30440b98f0 2023-10-03T19:16:49.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.486+0000 7f3040ff9640 1 --2- 172.21.15.45:0/2959558976 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3024066280 0x7f3024068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:49.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.486+0000 7f3040ff9640 1 -- 172.21.15.45:0/2959558976 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f302c083cb0 con 0x7f30440b98f0 2023-10-03T19:16:49.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.486+0000 7f3043fff640 1 --2- 172.21.15.45:0/2959558976 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3024066280 0x7f3024068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:49.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.486+0000 7f3043fff640 1 --2- 172.21.15.45:0/2959558976 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3024066280 0x7f3024068730 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f303c0b1000 tx=0x7f303c0aa000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:49.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.490+0000 7f3040ff9640 1 -- 172.21.15.45:0/2959558976 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f302c051120 con 0x7f30440b98f0 2023-10-03T19:16:49.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.638+0000 7f304a797640 1 -- 172.21.15.45:0/2959558976 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f304413abe0 con 0x7f3024066280 2023-10-03T19:16:49.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.662+0000 7f3040ff9640 1 -- 172.21.15.45:0/2959558976 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306164 (secure 0 0 0) 0x7f304413abe0 con 0x7f3024066280 2023-10-03T19:16:49.667 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:16:49.670 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:16:49.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.666+0000 7f304a797640 1 -- 172.21.15.45:0/2959558976 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3024066280 msgr2=0x7f3024068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:49.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.666+0000 7f304a797640 1 --2- 172.21.15.45:0/2959558976 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3024066280 0x7f3024068730 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f303c0b1000 tx=0x7f303c0aa000 comp rx=0 tx=0).stop 2023-10-03T19:16:49.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.666+0000 7f304a797640 1 -- 172.21.15.45:0/2959558976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30440b98f0 msgr2=0x7f304414ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:49.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.666+0000 7f304a797640 1 --2- 172.21.15.45:0/2959558976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30440b98f0 0x7f304414ae90 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f302c00c7f0 tx=0x7f302c00ccb0 comp rx=0 tx=0).stop 2023-10-03T19:16:49.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.666+0000 7f304a797640 1 -- 172.21.15.45:0/2959558976 shutdown_connections 2023-10-03T19:16:49.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.666+0000 7f304a797640 1 --2- 172.21.15.45:0/2959558976 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3024066280 0x7f3024068730 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:49.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.666+0000 7f304a797640 1 --2- 172.21.15.45:0/2959558976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30440bc810 0x7f30441e5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:49.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.666+0000 7f304a797640 1 --2- 172.21.15.45:0/2959558976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30440b98f0 0x7f304414ae90 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:49.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.666+0000 7f304a797640 1 --2- 172.21.15.45:0/2959558976 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30440a2e20 0x7f30441e7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:49.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.666+0000 7f304a797640 1 -- 172.21.15.45:0/2959558976 >> 172.21.15.45:0/2959558976 conn(0x7f30440bcf50 msgr2=0x7f30440bb260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:49.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.666+0000 7f304a797640 1 -- 172.21.15.45:0/2959558976 shutdown_connections 2023-10-03T19:16:49.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.666+0000 7f304a797640 1 -- 172.21.15.45:0/2959558976 wait complete. 2023-10-03T19:16:49.687 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2023-10-03T19:16:48.536958+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592708,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":192,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":158,"acting":158,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":168080,"kb_used_data":5648,"kb_used_omap":0,"kb_used_meta":162368,"kb_avail":754806640,"statfs":{"total":773094113280,"available":772921999360,"internally_reserved":0,"allocated":5783552,"data_stored":3652930,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":166264832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2340,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001178"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.355678+0000","last_change":"2023-10-03T19:16:46.354281+0000","last_active":"2023-10-03T19:16:46.355678+0000","last_peered":"2023-10-03T19:16:46.355678+0000","last_clean":"2023-10-03T19:16:46.355678+0000","last_became_active":"2023-10-03T19:16:46.353863+0000","last_became_peered":"2023-10-03T19:16:46.353863+0000","last_unstale":"2023-10-03T19:16:46.355678+0000","last_undegraded":"2023-10-03T19:16:46.355678+0000","last_fullsized":"2023-10-03T19:16:46.355678+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:54:01.595268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.319995+0000","last_change":"2023-10-03T19:16:46.318712+0000","last_active":"2023-10-03T19:16:46.319995+0000","last_peered":"2023-10-03T19:16:46.319995+0000","last_clean":"2023-10-03T19:16:46.319995+0000","last_became_active":"2023-10-03T19:16:46.318367+0000","last_became_peered":"2023-10-03T19:16:46.318367+0000","last_unstale":"2023-10-03T19:16:46.319995+0000","last_undegraded":"2023-10-03T19:16:46.319995+0000","last_fullsized":"2023-10-03T19:16:46.319995+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:04:47.708070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381928+0000","last_change":"2023-10-03T19:16:46.372185+0000","last_active":"2023-10-03T19:16:46.381928+0000","last_peered":"2023-10-03T19:16:46.381928+0000","last_clean":"2023-10-03T19:16:46.381928+0000","last_became_active":"2023-10-03T19:16:46.371540+0000","last_became_peered":"2023-10-03T19:16:46.371540+0000","last_unstale":"2023-10-03T19:16:46.381928+0000","last_undegraded":"2023-10-03T19:16:46.381928+0000","last_fullsized":"2023-10-03T19:16:46.381928+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:25:23.195500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.374546+0000","last_change":"2023-10-03T19:16:46.355059+0000","last_active":"2023-10-03T19:16:46.374546+0000","last_peered":"2023-10-03T19:16:46.374546+0000","last_clean":"2023-10-03T19:16:46.374546+0000","last_became_active":"2023-10-03T19:16:46.347192+0000","last_became_peered":"2023-10-03T19:16:46.347192+0000","last_unstale":"2023-10-03T19:16:46.374546+0000","last_undegraded":"2023-10-03T19:16:46.374546+0000","last_fullsized":"2023-10-03T19:16:46.374546+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:42:11.101433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.382846+0000","last_change":"2023-10-03T19:16:46.376955+0000","last_active":"2023-10-03T19:16:46.382846+0000","last_peered":"2023-10-03T19:16:46.382846+0000","last_clean":"2023-10-03T19:16:46.382846+0000","last_became_active":"2023-10-03T19:16:46.376315+0000","last_became_peered":"2023-10-03T19:16:46.376315+0000","last_unstale":"2023-10-03T19:16:46.382846+0000","last_undegraded":"2023-10-03T19:16:46.382846+0000","last_fullsized":"2023-10-03T19:16:46.382846+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:39:49.540080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.348676+0000","last_change":"2023-10-03T19:16:46.348039+0000","last_active":"2023-10-03T19:16:46.348676+0000","last_peered":"2023-10-03T19:16:46.348676+0000","last_clean":"2023-10-03T19:16:46.348676+0000","last_became_active":"2023-10-03T19:16:46.347765+0000","last_became_peered":"2023-10-03T19:16:46.347765+0000","last_unstale":"2023-10-03T19:16:46.348676+0000","last_undegraded":"2023-10-03T19:16:46.348676+0000","last_fullsized":"2023-10-03T19:16:46.348676+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:05:13.691561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381879+0000","last_change":"2023-10-03T19:16:46.371593+0000","last_active":"2023-10-03T19:16:46.381879+0000","last_peered":"2023-10-03T19:16:46.381879+0000","last_clean":"2023-10-03T19:16:46.381879+0000","last_became_active":"2023-10-03T19:16:46.369346+0000","last_became_peered":"2023-10-03T19:16:46.369346+0000","last_unstale":"2023-10-03T19:16:46.381879+0000","last_undegraded":"2023-10-03T19:16:46.381879+0000","last_fullsized":"2023-10-03T19:16:46.381879+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:54:53.731901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381775+0000","last_change":"2023-10-03T19:16:46.370812+0000","last_active":"2023-10-03T19:16:46.381775+0000","last_peered":"2023-10-03T19:16:46.381775+0000","last_clean":"2023-10-03T19:16:46.381775+0000","last_became_active":"2023-10-03T19:16:46.368674+0000","last_became_peered":"2023-10-03T19:16:46.368674+0000","last_unstale":"2023-10-03T19:16:46.381775+0000","last_undegraded":"2023-10-03T19:16:46.381775+0000","last_fullsized":"2023-10-03T19:16:46.381775+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:30:05.766523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.379890+0000","last_change":"2023-10-03T19:16:46.363645+0000","last_active":"2023-10-03T19:16:46.379890+0000","last_peered":"2023-10-03T19:16:46.379890+0000","last_clean":"2023-10-03T19:16:46.379890+0000","last_became_active":"2023-10-03T19:16:46.363014+0000","last_became_peered":"2023-10-03T19:16:46.363014+0000","last_unstale":"2023-10-03T19:16:46.379890+0000","last_undegraded":"2023-10-03T19:16:46.379890+0000","last_fullsized":"2023-10-03T19:16:46.379890+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:20:40.295554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381783+0000","last_change":"2023-10-03T19:16:46.370866+0000","last_active":"2023-10-03T19:16:46.381783+0000","last_peered":"2023-10-03T19:16:46.381783+0000","last_clean":"2023-10-03T19:16:46.381783+0000","last_became_active":"2023-10-03T19:16:46.369194+0000","last_became_peered":"2023-10-03T19:16:46.369194+0000","last_unstale":"2023-10-03T19:16:46.381783+0000","last_undegraded":"2023-10-03T19:16:46.381783+0000","last_fullsized":"2023-10-03T19:16:46.381783+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:28:32.763091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381998+0000","last_change":"2023-10-03T19:16:46.371802+0000","last_active":"2023-10-03T19:16:46.381998+0000","last_peered":"2023-10-03T19:16:46.381998+0000","last_clean":"2023-10-03T19:16:46.381998+0000","last_became_active":"2023-10-03T19:16:46.371306+0000","last_became_peered":"2023-10-03T19:16:46.371306+0000","last_unstale":"2023-10-03T19:16:46.381998+0000","last_undegraded":"2023-10-03T19:16:46.381998+0000","last_fullsized":"2023-10-03T19:16:46.381998+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:43:09.345662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.322740+0000","last_change":"2023-10-03T19:16:46.321343+0000","last_active":"2023-10-03T19:16:46.322740+0000","last_peered":"2023-10-03T19:16:46.322740+0000","last_clean":"2023-10-03T19:16:46.322740+0000","last_became_active":"2023-10-03T19:16:46.321083+0000","last_became_peered":"2023-10-03T19:16:46.321083+0000","last_unstale":"2023-10-03T19:16:46.322740+0000","last_undegraded":"2023-10-03T19:16:46.322740+0000","last_fullsized":"2023-10-03T19:16:46.322740+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:51:28.753857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.347991+0000","last_change":"2023-10-03T19:16:46.346773+0000","last_active":"2023-10-03T19:16:46.347991+0000","last_peered":"2023-10-03T19:16:46.347991+0000","last_clean":"2023-10-03T19:16:46.347991+0000","last_became_active":"2023-10-03T19:16:46.346453+0000","last_became_peered":"2023-10-03T19:16:46.346453+0000","last_unstale":"2023-10-03T19:16:46.347991+0000","last_undegraded":"2023-10-03T19:16:46.347991+0000","last_fullsized":"2023-10-03T19:16:46.347991+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:40:18.437890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.374309+0000","last_change":"2023-10-03T19:16:46.349167+0000","last_active":"2023-10-03T19:16:46.374309+0000","last_peered":"2023-10-03T19:16:46.374309+0000","last_clean":"2023-10-03T19:16:46.374309+0000","last_became_active":"2023-10-03T19:16:46.348310+0000","last_became_peered":"2023-10-03T19:16:46.348310+0000","last_unstale":"2023-10-03T19:16:46.374309+0000","last_undegraded":"2023-10-03T19:16:46.374309+0000","last_fullsized":"2023-10-03T19:16:46.374309+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:39:42.294017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.378898+0000","last_change":"2023-10-03T19:16:46.364849+0000","last_active":"2023-10-03T19:16:46.378898+0000","last_peered":"2023-10-03T19:16:46.378898+0000","last_clean":"2023-10-03T19:16:46.378898+0000","last_became_active":"2023-10-03T19:16:46.362795+0000","last_became_peered":"2023-10-03T19:16:46.362795+0000","last_unstale":"2023-10-03T19:16:46.378898+0000","last_undegraded":"2023-10-03T19:16:46.378898+0000","last_fullsized":"2023-10-03T19:16:46.378898+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:11:48.396477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":3,"reported_epoch":60,"state":"creating+activating","last_fresh":"2023-10-03T19:16:46.303990+0000","last_change":"2023-10-03T19:16:46.303990+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:46.303990+0000","last_undegraded":"2023-10-03T19:16:46.303990+0000","last_fullsized":"2023-10-03T19:16:46.303990+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:04:47.708070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":3,"reported_epoch":60,"state":"creating+activating","last_fresh":"2023-10-03T19:16:46.304321+0000","last_change":"2023-10-03T19:16:46.304321+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:46.304321+0000","last_undegraded":"2023-10-03T19:16:46.304321+0000","last_fullsized":"2023-10-03T19:16:46.304321+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:59:33.879590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":3,"reported_epoch":60,"state":"creating+activating","last_fresh":"2023-10-03T19:16:46.303772+0000","last_change":"2023-10-03T19:16:46.303772+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:46.303772+0000","last_undegraded":"2023-10-03T19:16:46.303772+0000","last_fullsized":"2023-10-03T19:16:46.303772+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:35:51.612936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381818+0000","last_change":"2023-10-03T19:16:46.371106+0000","last_active":"2023-10-03T19:16:46.381818+0000","last_peered":"2023-10-03T19:16:46.381818+0000","last_clean":"2023-10-03T19:16:46.381818+0000","last_became_active":"2023-10-03T19:16:46.368784+0000","last_became_peered":"2023-10-03T19:16:46.368784+0000","last_unstale":"2023-10-03T19:16:46.381818+0000","last_undegraded":"2023-10-03T19:16:46.381818+0000","last_fullsized":"2023-10-03T19:16:46.381818+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:46:26.365305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.379936+0000","last_change":"2023-10-03T19:16:46.364524+0000","last_active":"2023-10-03T19:16:46.379936+0000","last_peered":"2023-10-03T19:16:46.379936+0000","last_clean":"2023-10-03T19:16:46.379936+0000","last_became_active":"2023-10-03T19:16:46.364031+0000","last_became_peered":"2023-10-03T19:16:46.364031+0000","last_unstale":"2023-10-03T19:16:46.379936+0000","last_undegraded":"2023-10-03T19:16:46.379936+0000","last_fullsized":"2023-10-03T19:16:46.379936+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:06:40.428254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.365969+0000","last_change":"2023-10-03T19:16:46.365391+0000","last_active":"2023-10-03T19:16:46.365969+0000","last_peered":"2023-10-03T19:16:46.365969+0000","last_clean":"2023-10-03T19:16:46.365969+0000","last_became_active":"2023-10-03T19:16:46.365114+0000","last_became_peered":"2023-10-03T19:16:46.365114+0000","last_unstale":"2023-10-03T19:16:46.365969+0000","last_undegraded":"2023-10-03T19:16:46.365969+0000","last_fullsized":"2023-10-03T19:16:46.365969+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:39:36.928666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.379484+0000","last_change":"2023-10-03T19:16:46.368881+0000","last_active":"2023-10-03T19:16:46.379484+0000","last_peered":"2023-10-03T19:16:46.379484+0000","last_clean":"2023-10-03T19:16:46.379484+0000","last_became_active":"2023-10-03T19:16:46.368277+0000","last_became_peered":"2023-10-03T19:16:46.368277+0000","last_unstale":"2023-10-03T19:16:46.379484+0000","last_undegraded":"2023-10-03T19:16:46.379484+0000","last_fullsized":"2023-10-03T19:16:46.379484+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:24:10.893825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.373833+0000","last_change":"2023-10-03T19:16:46.348251+0000","last_active":"2023-10-03T19:16:46.373833+0000","last_peered":"2023-10-03T19:16:46.373833+0000","last_clean":"2023-10-03T19:16:46.373833+0000","last_became_active":"2023-10-03T19:16:46.347396+0000","last_became_peered":"2023-10-03T19:16:46.347396+0000","last_unstale":"2023-10-03T19:16:46.373833+0000","last_undegraded":"2023-10-03T19:16:46.373833+0000","last_fullsized":"2023-10-03T19:16:46.373833+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:39:49.540080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.379004+0000","last_change":"2023-10-03T19:16:46.365538+0000","last_active":"2023-10-03T19:16:46.379004+0000","last_peered":"2023-10-03T19:16:46.379004+0000","last_clean":"2023-10-03T19:16:46.379004+0000","last_became_active":"2023-10-03T19:16:46.365018+0000","last_became_peered":"2023-10-03T19:16:46.365018+0000","last_unstale":"2023-10-03T19:16:46.379004+0000","last_undegraded":"2023-10-03T19:16:46.379004+0000","last_fullsized":"2023-10-03T19:16:46.379004+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:41:32.807340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"60'4","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.347934+0000","last_change":"2023-10-03T19:16:45.981820+0000","last_active":"2023-10-03T19:16:46.347934+0000","last_peered":"2023-10-03T19:16:46.347934+0000","last_clean":"2023-10-03T19:16:46.347934+0000","last_became_active":"2023-10-03T19:16:45.981370+0000","last_became_peered":"2023-10-03T19:16:45.981370+0000","last_unstale":"2023-10-03T19:16:46.347934+0000","last_undegraded":"2023-10-03T19:16:46.347934+0000","last_fullsized":"2023-10-03T19:16:46.347934+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:27:07.552881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.380668+0000","last_change":"2023-10-03T19:16:46.376884+0000","last_active":"2023-10-03T19:16:46.380668+0000","last_peered":"2023-10-03T19:16:46.380668+0000","last_clean":"2023-10-03T19:16:46.380668+0000","last_became_active":"2023-10-03T19:16:46.376443+0000","last_became_peered":"2023-10-03T19:16:46.376443+0000","last_unstale":"2023-10-03T19:16:46.380668+0000","last_undegraded":"2023-10-03T19:16:46.380668+0000","last_fullsized":"2023-10-03T19:16:46.380668+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:48:22.544505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381832+0000","last_change":"2023-10-03T19:16:46.371148+0000","last_active":"2023-10-03T19:16:46.381832+0000","last_peered":"2023-10-03T19:16:46.381832+0000","last_clean":"2023-10-03T19:16:46.381832+0000","last_became_active":"2023-10-03T19:16:46.368434+0000","last_became_peered":"2023-10-03T19:16:46.368434+0000","last_unstale":"2023-10-03T19:16:46.381832+0000","last_undegraded":"2023-10-03T19:16:46.381832+0000","last_fullsized":"2023-10-03T19:16:46.381832+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:36:18.321914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.320047+0000","last_change":"2023-10-03T19:16:46.315631+0000","last_active":"2023-10-03T19:16:46.320047+0000","last_peered":"2023-10-03T19:16:46.320047+0000","last_clean":"2023-10-03T19:16:46.320047+0000","last_became_active":"2023-10-03T19:16:46.315402+0000","last_became_peered":"2023-10-03T19:16:46.315402+0000","last_unstale":"2023-10-03T19:16:46.320047+0000","last_undegraded":"2023-10-03T19:16:46.320047+0000","last_fullsized":"2023-10-03T19:16:46.320047+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:23:09.252397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.303917+0000","last_change":"2023-10-03T19:16:45.941443+0000","last_active":"2023-10-03T19:16:46.303917+0000","last_peered":"2023-10-03T19:16:46.303917+0000","last_clean":"2023-10-03T19:16:46.303917+0000","last_became_active":"2023-10-03T19:16:45.940415+0000","last_became_peered":"2023-10-03T19:16:45.940415+0000","last_unstale":"2023-10-03T19:16:46.303917+0000","last_undegraded":"2023-10-03T19:16:46.303917+0000","last_fullsized":"2023-10-03T19:16:46.303917+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:39:35.917858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.348031+0000","last_change":"2023-10-03T19:16:46.346859+0000","last_active":"2023-10-03T19:16:46.348031+0000","last_peered":"2023-10-03T19:16:46.348031+0000","last_clean":"2023-10-03T19:16:46.348031+0000","last_became_active":"2023-10-03T19:16:46.346492+0000","last_became_peered":"2023-10-03T19:16:46.346492+0000","last_unstale":"2023-10-03T19:16:46.348031+0000","last_undegraded":"2023-10-03T19:16:46.348031+0000","last_fullsized":"2023-10-03T19:16:46.348031+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:59:33.879590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.303995+0000","last_change":"2023-10-03T19:16:45.947189+0000","last_active":"2023-10-03T19:16:46.303995+0000","last_peered":"2023-10-03T19:16:46.303995+0000","last_clean":"2023-10-03T19:16:46.303995+0000","last_became_active":"2023-10-03T19:16:45.946936+0000","last_became_peered":"2023-10-03T19:16:45.946936+0000","last_unstale":"2023-10-03T19:16:46.303995+0000","last_undegraded":"2023-10-03T19:16:46.303995+0000","last_fullsized":"2023-10-03T19:16:46.303995+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:14:23.283654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.379044+0000","last_change":"2023-10-03T19:16:46.365932+0000","last_active":"2023-10-03T19:16:46.379044+0000","last_peered":"2023-10-03T19:16:46.379044+0000","last_clean":"2023-10-03T19:16:46.379044+0000","last_became_active":"2023-10-03T19:16:46.362477+0000","last_became_peered":"2023-10-03T19:16:46.362477+0000","last_unstale":"2023-10-03T19:16:46.379044+0000","last_undegraded":"2023-10-03T19:16:46.379044+0000","last_fullsized":"2023-10-03T19:16:46.379044+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:47:38.571281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.303786+0000","last_change":"2023-10-03T19:16:45.963852+0000","last_active":"2023-10-03T19:16:46.303786+0000","last_peered":"2023-10-03T19:16:46.303786+0000","last_clean":"2023-10-03T19:16:46.303786+0000","last_became_active":"2023-10-03T19:16:45.963421+0000","last_became_peered":"2023-10-03T19:16:45.963421+0000","last_unstale":"2023-10-03T19:16:46.303786+0000","last_undegraded":"2023-10-03T19:16:46.303786+0000","last_fullsized":"2023-10-03T19:16:46.303786+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:40:17.427082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":3,"reported_epoch":60,"state":"creating+activating","last_fresh":"2023-10-03T19:16:46.303898+0000","last_change":"2023-10-03T19:16:46.303898+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:46.303898+0000","last_undegraded":"2023-10-03T19:16:46.303898+0000","last_fullsized":"2023-10-03T19:16:46.303898+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:54:01.595268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.338665+0000","last_change":"2023-10-03T19:16:45.985444+0000","last_active":"2023-10-03T19:16:46.338665+0000","last_peered":"2023-10-03T19:16:46.338665+0000","last_clean":"2023-10-03T19:16:46.338665+0000","last_became_active":"2023-10-03T19:16:45.984784+0000","last_became_peered":"2023-10-03T19:16:45.984784+0000","last_unstale":"2023-10-03T19:16:46.338665+0000","last_undegraded":"2023-10-03T19:16:46.338665+0000","last_fullsized":"2023-10-03T19:16:46.338665+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:55:43.921541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.319823+0000","last_change":"2023-10-03T19:16:46.317689+0000","last_active":"2023-10-03T19:16:46.319823+0000","last_peered":"2023-10-03T19:16:46.319823+0000","last_clean":"2023-10-03T19:16:46.319823+0000","last_became_active":"2023-10-03T19:16:46.317385+0000","last_became_peered":"2023-10-03T19:16:46.317385+0000","last_unstale":"2023-10-03T19:16:46.319823+0000","last_undegraded":"2023-10-03T19:16:46.319823+0000","last_fullsized":"2023-10-03T19:16:46.319823+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:13:34.942009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.334840+0000","last_change":"2023-10-03T19:16:45.986113+0000","last_active":"2023-10-03T19:16:46.334840+0000","last_peered":"2023-10-03T19:16:46.334840+0000","last_clean":"2023-10-03T19:16:46.334840+0000","last_became_active":"2023-10-03T19:16:45.985260+0000","last_became_peered":"2023-10-03T19:16:45.985260+0000","last_unstale":"2023-10-03T19:16:46.334840+0000","last_undegraded":"2023-10-03T19:16:46.334840+0000","last_fullsized":"2023-10-03T19:16:46.334840+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:50:36.723051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":3,"reported_epoch":60,"state":"creating+activating","last_fresh":"2023-10-03T19:16:46.303808+0000","last_change":"2023-10-03T19:16:46.303808+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:46.303808+0000","last_undegraded":"2023-10-03T19:16:46.303808+0000","last_fullsized":"2023-10-03T19:16:46.303808+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:13:34.942009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.319272+0000","last_change":"2023-10-03T19:16:45.963314+0000","last_active":"2023-10-03T19:16:46.319272+0000","last_peered":"2023-10-03T19:16:46.319272+0000","last_clean":"2023-10-03T19:16:46.319272+0000","last_became_active":"2023-10-03T19:16:45.962565+0000","last_became_peered":"2023-10-03T19:16:45.962565+0000","last_unstale":"2023-10-03T19:16:46.319272+0000","last_undegraded":"2023-10-03T19:16:46.319272+0000","last_fullsized":"2023-10-03T19:16:46.319272+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:38:40.745903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.382640+0000","last_change":"2023-10-03T19:16:46.369750+0000","last_active":"2023-10-03T19:16:46.382640+0000","last_peered":"2023-10-03T19:16:46.382640+0000","last_clean":"2023-10-03T19:16:46.382640+0000","last_became_active":"2023-10-03T19:16:46.368994+0000","last_became_peered":"2023-10-03T19:16:46.368994+0000","last_unstale":"2023-10-03T19:16:46.382640+0000","last_undegraded":"2023-10-03T19:16:46.382640+0000","last_fullsized":"2023-10-03T19:16:46.382640+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:39:42.294017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"60'3","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.372238+0000","last_change":"2023-10-03T19:16:45.986493+0000","last_active":"2023-10-03T19:16:46.372238+0000","last_peered":"2023-10-03T19:16:46.372238+0000","last_clean":"2023-10-03T19:16:46.372238+0000","last_became_active":"2023-10-03T19:16:45.985657+0000","last_became_peered":"2023-10-03T19:16:45.985657+0000","last_unstale":"2023-10-03T19:16:46.372238+0000","last_undegraded":"2023-10-03T19:16:46.372238+0000","last_fullsized":"2023-10-03T19:16:46.372238+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:17:49.085309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.373559+0000","last_change":"2023-10-03T19:16:46.349205+0000","last_active":"2023-10-03T19:16:46.373559+0000","last_peered":"2023-10-03T19:16:46.373559+0000","last_clean":"2023-10-03T19:16:46.373559+0000","last_became_active":"2023-10-03T19:16:46.348690+0000","last_became_peered":"2023-10-03T19:16:46.348690+0000","last_unstale":"2023-10-03T19:16:46.373559+0000","last_undegraded":"2023-10-03T19:16:46.373559+0000","last_fullsized":"2023-10-03T19:16:46.373559+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:26:38.764887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"60'6","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.377937+0000","last_change":"2023-10-03T19:16:45.967950+0000","last_active":"2023-10-03T19:16:46.377937+0000","last_peered":"2023-10-03T19:16:46.377937+0000","last_clean":"2023-10-03T19:16:46.377937+0000","last_became_active":"2023-10-03T19:16:45.967600+0000","last_became_peered":"2023-10-03T19:16:45.967600+0000","last_unstale":"2023-10-03T19:16:46.377937+0000","last_undegraded":"2023-10-03T19:16:46.377937+0000","last_fullsized":"2023-10-03T19:16:46.377937+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:20:31.279031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.376767+0000","last_change":"2023-10-03T19:16:46.356075+0000","last_active":"2023-10-03T19:16:46.376767+0000","last_peered":"2023-10-03T19:16:46.376767+0000","last_clean":"2023-10-03T19:16:46.376767+0000","last_became_active":"2023-10-03T19:16:46.355562+0000","last_became_peered":"2023-10-03T19:16:46.355562+0000","last_unstale":"2023-10-03T19:16:46.376767+0000","last_undegraded":"2023-10-03T19:16:46.376767+0000","last_fullsized":"2023-10-03T19:16:46.376767+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:47:38.571281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"60'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.373230+0000","last_change":"2023-10-03T19:16:45.987343+0000","last_active":"2023-10-03T19:16:46.373230+0000","last_peered":"2023-10-03T19:16:46.373230+0000","last_clean":"2023-10-03T19:16:46.373230+0000","last_became_active":"2023-10-03T19:16:45.986702+0000","last_became_peered":"2023-10-03T19:16:45.986702+0000","last_unstale":"2023-10-03T19:16:46.373230+0000","last_undegraded":"2023-10-03T19:16:46.373230+0000","last_fullsized":"2023-10-03T19:16:46.373230+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:12:08.318383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.382779+0000","last_change":"2023-10-03T19:16:46.376007+0000","last_active":"2023-10-03T19:16:46.382779+0000","last_peered":"2023-10-03T19:16:46.382779+0000","last_clean":"2023-10-03T19:16:46.382779+0000","last_became_active":"2023-10-03T19:16:46.375324+0000","last_became_peered":"2023-10-03T19:16:46.375324+0000","last_unstale":"2023-10-03T19:16:46.382779+0000","last_undegraded":"2023-10-03T19:16:46.382779+0000","last_fullsized":"2023-10-03T19:16:46.382779+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:26:38.764887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.330299+0000","last_change":"2023-10-03T19:16:45.987260+0000","last_active":"2023-10-03T19:16:46.330299+0000","last_peered":"2023-10-03T19:16:46.330299+0000","last_clean":"2023-10-03T19:16:46.330299+0000","last_became_active":"2023-10-03T19:16:45.984760+0000","last_became_peered":"2023-10-03T19:16:45.984760+0000","last_unstale":"2023-10-03T19:16:46.330299+0000","last_undegraded":"2023-10-03T19:16:46.330299+0000","last_fullsized":"2023-10-03T19:16:46.330299+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:07:06.884577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.344612+0000","last_change":"2023-10-03T19:16:46.343379+0000","last_active":"2023-10-03T19:16:46.344612+0000","last_peered":"2023-10-03T19:16:46.344612+0000","last_clean":"2023-10-03T19:16:46.344612+0000","last_became_active":"2023-10-03T19:16:46.343101+0000","last_became_peered":"2023-10-03T19:16:46.343101+0000","last_unstale":"2023-10-03T19:16:46.344612+0000","last_undegraded":"2023-10-03T19:16:46.344612+0000","last_fullsized":"2023-10-03T19:16:46.344612+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:27:11.167546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"60'8","reported_seq":19,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.379864+0000","last_change":"2023-10-03T19:16:45.985749+0000","last_active":"2023-10-03T19:16:46.379864+0000","last_peered":"2023-10-03T19:16:46.379864+0000","last_clean":"2023-10-03T19:16:46.379864+0000","last_became_active":"2023-10-03T19:16:45.985075+0000","last_became_peered":"2023-10-03T19:16:45.985075+0000","last_unstale":"2023-10-03T19:16:46.379864+0000","last_undegraded":"2023-10-03T19:16:46.379864+0000","last_fullsized":"2023-10-03T19:16:46.379864+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:11:47.385670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.319948+0000","last_change":"2023-10-03T19:16:46.315032+0000","last_active":"2023-10-03T19:16:46.319948+0000","last_peered":"2023-10-03T19:16:46.319948+0000","last_clean":"2023-10-03T19:16:46.319948+0000","last_became_active":"2023-10-03T19:16:46.314754+0000","last_became_peered":"2023-10-03T19:16:46.314754+0000","last_unstale":"2023-10-03T19:16:46.319948+0000","last_undegraded":"2023-10-03T19:16:46.319948+0000","last_fullsized":"2023-10-03T19:16:46.319948+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:29:49.777567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.382604+0000","last_change":"2023-10-03T19:16:46.368611+0000","last_active":"2023-10-03T19:16:46.382604+0000","last_peered":"2023-10-03T19:16:46.382604+0000","last_clean":"2023-10-03T19:16:46.382604+0000","last_became_active":"2023-10-03T19:16:46.367938+0000","last_became_peered":"2023-10-03T19:16:46.367938+0000","last_unstale":"2023-10-03T19:16:46.382604+0000","last_undegraded":"2023-10-03T19:16:46.382604+0000","last_fullsized":"2023-10-03T19:16:46.382604+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:52:34.746547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.313791+0000","last_change":"2023-10-03T19:16:45.967954+0000","last_active":"2023-10-03T19:16:46.313791+0000","last_peered":"2023-10-03T19:16:46.313791+0000","last_clean":"2023-10-03T19:16:46.313791+0000","last_became_active":"2023-10-03T19:16:45.967581+0000","last_became_peered":"2023-10-03T19:16:45.967581+0000","last_unstale":"2023-10-03T19:16:46.313791+0000","last_undegraded":"2023-10-03T19:16:46.313791+0000","last_fullsized":"2023-10-03T19:16:46.313791+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:45:37.045472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.378791+0000","last_change":"2023-10-03T19:16:46.362149+0000","last_active":"2023-10-03T19:16:46.378791+0000","last_peered":"2023-10-03T19:16:46.378791+0000","last_clean":"2023-10-03T19:16:46.378791+0000","last_became_active":"2023-10-03T19:16:46.361627+0000","last_became_peered":"2023-10-03T19:16:46.361627+0000","last_unstale":"2023-10-03T19:16:46.378791+0000","last_undegraded":"2023-10-03T19:16:46.378791+0000","last_fullsized":"2023-10-03T19:16:46.378791+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:28:53.885325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.333806+0000","last_change":"2023-10-03T19:16:45.986852+0000","last_active":"2023-10-03T19:16:46.333806+0000","last_peered":"2023-10-03T19:16:46.333806+0000","last_clean":"2023-10-03T19:16:46.333806+0000","last_became_active":"2023-10-03T19:16:45.985615+0000","last_became_peered":"2023-10-03T19:16:45.985615+0000","last_unstale":"2023-10-03T19:16:46.333806+0000","last_undegraded":"2023-10-03T19:16:46.333806+0000","last_fullsized":"2023-10-03T19:16:46.333806+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:31:27.554913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.374699+0000","last_change":"2023-10-03T19:16:46.355632+0000","last_active":"2023-10-03T19:16:46.374699+0000","last_peered":"2023-10-03T19:16:46.374699+0000","last_clean":"2023-10-03T19:16:46.374699+0000","last_became_active":"2023-10-03T19:16:46.355020+0000","last_became_peered":"2023-10-03T19:16:46.355020+0000","last_unstale":"2023-10-03T19:16:46.374699+0000","last_undegraded":"2023-10-03T19:16:46.374699+0000","last_fullsized":"2023-10-03T19:16:46.374699+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:52:34.746547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.304143+0000","last_change":"2023-10-03T19:16:45.944273+0000","last_active":"2023-10-03T19:16:46.304143+0000","last_peered":"2023-10-03T19:16:46.304143+0000","last_clean":"2023-10-03T19:16:46.304143+0000","last_became_active":"2023-10-03T19:16:45.943995+0000","last_became_peered":"2023-10-03T19:16:45.943995+0000","last_unstale":"2023-10-03T19:16:46.304143+0000","last_undegraded":"2023-10-03T19:16:46.304143+0000","last_fullsized":"2023-10-03T19:16:46.304143+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:56:23.017353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.343879+0000","last_change":"2023-10-03T19:16:46.342684+0000","last_active":"2023-10-03T19:16:46.343879+0000","last_peered":"2023-10-03T19:16:46.343879+0000","last_clean":"2023-10-03T19:16:46.343879+0000","last_became_active":"2023-10-03T19:16:46.342293+0000","last_became_peered":"2023-10-03T19:16:46.342293+0000","last_unstale":"2023-10-03T19:16:46.343879+0000","last_undegraded":"2023-10-03T19:16:46.343879+0000","last_fullsized":"2023-10-03T19:16:46.343879+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:14:24.294462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.303651+0000","last_change":"2023-10-03T19:16:45.964339+0000","last_active":"2023-10-03T19:16:46.303651+0000","last_peered":"2023-10-03T19:16:46.303651+0000","last_clean":"2023-10-03T19:16:46.303651+0000","last_became_active":"2023-10-03T19:16:45.963814+0000","last_became_peered":"2023-10-03T19:16:45.963814+0000","last_unstale":"2023-10-03T19:16:46.303651+0000","last_undegraded":"2023-10-03T19:16:46.303651+0000","last_fullsized":"2023-10-03T19:16:46.303651+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:34:29.129059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.355035+0000","last_change":"2023-10-03T19:16:46.354068+0000","last_active":"2023-10-03T19:16:46.355035+0000","last_peered":"2023-10-03T19:16:46.355035+0000","last_clean":"2023-10-03T19:16:46.355035+0000","last_became_active":"2023-10-03T19:16:46.353774+0000","last_became_peered":"2023-10-03T19:16:46.353774+0000","last_unstale":"2023-10-03T19:16:46.355035+0000","last_undegraded":"2023-10-03T19:16:46.355035+0000","last_fullsized":"2023-10-03T19:16:46.355035+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:10:40.127195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.312472+0000","last_change":"2023-10-03T19:16:45.972785+0000","last_active":"2023-10-03T19:16:46.312472+0000","last_peered":"2023-10-03T19:16:46.312472+0000","last_clean":"2023-10-03T19:16:46.312472+0000","last_became_active":"2023-10-03T19:16:45.972526+0000","last_became_peered":"2023-10-03T19:16:45.972526+0000","last_unstale":"2023-10-03T19:16:46.312472+0000","last_undegraded":"2023-10-03T19:16:46.312472+0000","last_fullsized":"2023-10-03T19:16:46.312472+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:56:23.017353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.382575+0000","last_change":"2023-10-03T19:16:46.368258+0000","last_active":"2023-10-03T19:16:46.382575+0000","last_peered":"2023-10-03T19:16:46.382575+0000","last_clean":"2023-10-03T19:16:46.382575+0000","last_became_active":"2023-10-03T19:16:46.367559+0000","last_became_peered":"2023-10-03T19:16:46.367559+0000","last_unstale":"2023-10-03T19:16:46.382575+0000","last_undegraded":"2023-10-03T19:16:46.382575+0000","last_fullsized":"2023-10-03T19:16:46.382575+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:42:11.101433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.303561+0000","last_change":"2023-10-03T19:16:45.940912+0000","last_active":"2023-10-03T19:16:46.303561+0000","last_peered":"2023-10-03T19:16:46.303561+0000","last_clean":"2023-10-03T19:16:46.303561+0000","last_became_active":"2023-10-03T19:16:45.940610+0000","last_became_peered":"2023-10-03T19:16:45.940610+0000","last_unstale":"2023-10-03T19:16:46.303561+0000","last_undegraded":"2023-10-03T19:16:46.303561+0000","last_fullsized":"2023-10-03T19:16:46.303561+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:59:41.638843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":243,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.328586+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:16:46.328586+0000","last_peered":"2023-10-03T19:16:46.328586+0000","last_clean":"2023-10-03T19:16:46.328586+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:16:46.328586+0000","last_undegraded":"2023-10-03T19:16:46.328586+0000","last_fullsized":"2023-10-03T19:16:46.328586+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:11:26.721249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":85,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-03T19:16:41.636037+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:16:41.636037+0000","last_peered":"2023-10-03T19:16:41.636037+0000","last_clean":"2023-10-03T19:16:41.636037+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:16:41.636037+0000","last_undegraded":"2023-10-03T19:16:41.636037+0000","last_fullsized":"2023-10-03T19:16:41.636037+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:56:34.954100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":91,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.328210+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:16:46.328210+0000","last_peered":"2023-10-03T19:16:46.328210+0000","last_clean":"2023-10-03T19:16:46.328210+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:16:46.328210+0000","last_undegraded":"2023-10-03T19:16:46.328210+0000","last_fullsized":"2023-10-03T19:16:46.328210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:55:03.497461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":89,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.308380+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:16:46.308380+0000","last_peered":"2023-10-03T19:16:46.308380+0000","last_clean":"2023-10-03T19:16:46.308380+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:16:46.308380+0000","last_undegraded":"2023-10-03T19:16:46.308380+0000","last_fullsized":"2023-10-03T19:16:46.308380+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:21:56.372171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.378783+0000","last_change":"2023-10-03T19:16:46.362051+0000","last_active":"2023-10-03T19:16:46.378783+0000","last_peered":"2023-10-03T19:16:46.378783+0000","last_clean":"2023-10-03T19:16:46.378783+0000","last_became_active":"2023-10-03T19:16:46.361490+0000","last_became_peered":"2023-10-03T19:16:46.361490+0000","last_unstale":"2023-10-03T19:16:46.378783+0000","last_undegraded":"2023-10-03T19:16:46.378783+0000","last_fullsized":"2023-10-03T19:16:46.378783+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:18:58.638268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":85,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-03T19:16:41.636026+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:16:41.636026+0000","last_peered":"2023-10-03T19:16:41.636026+0000","last_clean":"2023-10-03T19:16:41.636026+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:16:41.636026+0000","last_undegraded":"2023-10-03T19:16:41.636026+0000","last_fullsized":"2023-10-03T19:16:41.636026+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:22:01.296400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381693+0000","last_change":"2023-10-03T19:16:46.369329+0000","last_active":"2023-10-03T19:16:46.381693+0000","last_peered":"2023-10-03T19:16:46.381693+0000","last_clean":"2023-10-03T19:16:46.381693+0000","last_became_active":"2023-10-03T19:16:46.368233+0000","last_became_peered":"2023-10-03T19:16:46.368233+0000","last_unstale":"2023-10-03T19:16:46.381693+0000","last_undegraded":"2023-10-03T19:16:46.381693+0000","last_fullsized":"2023-10-03T19:16:46.381693+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:47:11.516626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":89,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.316693+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:16:46.316693+0000","last_peered":"2023-10-03T19:16:46.316693+0000","last_clean":"2023-10-03T19:16:46.316693+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:16:46.316693+0000","last_undegraded":"2023-10-03T19:16:46.316693+0000","last_fullsized":"2023-10-03T19:16:46.316693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:50:43.182186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.382825+0000","last_change":"2023-10-03T19:16:46.377006+0000","last_active":"2023-10-03T19:16:46.382825+0000","last_peered":"2023-10-03T19:16:46.382825+0000","last_clean":"2023-10-03T19:16:46.382825+0000","last_became_active":"2023-10-03T19:16:46.376427+0000","last_became_peered":"2023-10-03T19:16:46.376427+0000","last_unstale":"2023-10-03T19:16:46.382825+0000","last_undegraded":"2023-10-03T19:16:46.382825+0000","last_fullsized":"2023-10-03T19:16:46.382825+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:17:09.475416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"60'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.369510+0000","last_change":"2023-10-03T19:16:45.986459+0000","last_active":"2023-10-03T19:16:46.369510+0000","last_peered":"2023-10-03T19:16:46.369510+0000","last_clean":"2023-10-03T19:16:46.369510+0000","last_became_active":"2023-10-03T19:16:45.984797+0000","last_became_peered":"2023-10-03T19:16:45.984797+0000","last_unstale":"2023-10-03T19:16:46.369510+0000","last_undegraded":"2023-10-03T19:16:46.369510+0000","last_fullsized":"2023-10-03T19:16:46.369510+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:43:20.530235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.335522+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:16:46.335522+0000","last_peered":"2023-10-03T19:16:46.335522+0000","last_clean":"2023-10-03T19:16:46.335522+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:16:46.335522+0000","last_undegraded":"2023-10-03T19:16:46.335522+0000","last_fullsized":"2023-10-03T19:16:46.335522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:21:36.226307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.380050+0000","last_change":"2023-10-03T19:16:46.370333+0000","last_active":"2023-10-03T19:16:46.380050+0000","last_peered":"2023-10-03T19:16:46.380050+0000","last_clean":"2023-10-03T19:16:46.380050+0000","last_became_active":"2023-10-03T19:16:46.369709+0000","last_became_peered":"2023-10-03T19:16:46.369709+0000","last_unstale":"2023-10-03T19:16:46.380050+0000","last_undegraded":"2023-10-03T19:16:46.380050+0000","last_fullsized":"2023-10-03T19:16:46.380050+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:55:44.932349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"60'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.372385+0000","last_change":"2023-10-03T19:16:45.985981+0000","last_active":"2023-10-03T19:16:46.372385+0000","last_peered":"2023-10-03T19:16:46.372385+0000","last_clean":"2023-10-03T19:16:46.372385+0000","last_became_active":"2023-10-03T19:16:45.984863+0000","last_became_peered":"2023-10-03T19:16:45.984863+0000","last_unstale":"2023-10-03T19:16:46.372385+0000","last_undegraded":"2023-10-03T19:16:46.372385+0000","last_fullsized":"2023-10-03T19:16:46.372385+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:48:25.164498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":89,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.313818+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:16:46.313818+0000","last_peered":"2023-10-03T19:16:46.313818+0000","last_clean":"2023-10-03T19:16:46.313818+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:16:46.313818+0000","last_undegraded":"2023-10-03T19:16:46.313818+0000","last_fullsized":"2023-10-03T19:16:46.313818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:38:39.207017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.378847+0000","last_change":"2023-10-03T19:16:46.362431+0000","last_active":"2023-10-03T19:16:46.378847+0000","last_peered":"2023-10-03T19:16:46.378847+0000","last_clean":"2023-10-03T19:16:46.378847+0000","last_became_active":"2023-10-03T19:16:46.361629+0000","last_became_peered":"2023-10-03T19:16:46.361629+0000","last_unstale":"2023-10-03T19:16:46.378847+0000","last_undegraded":"2023-10-03T19:16:46.378847+0000","last_fullsized":"2023-10-03T19:16:46.378847+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:05:01.669511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.304042+0000","last_change":"2023-10-03T19:16:45.967790+0000","last_active":"2023-10-03T19:16:46.304042+0000","last_peered":"2023-10-03T19:16:46.304042+0000","last_clean":"2023-10-03T19:16:46.304042+0000","last_became_active":"2023-10-03T19:16:45.967432+0000","last_became_peered":"2023-10-03T19:16:45.967432+0000","last_unstale":"2023-10-03T19:16:46.304042+0000","last_undegraded":"2023-10-03T19:16:46.304042+0000","last_fullsized":"2023-10-03T19:16:46.304042+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:27:10.156738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":89,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.351775+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:16:46.351775+0000","last_peered":"2023-10-03T19:16:46.351775+0000","last_clean":"2023-10-03T19:16:46.351775+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:16:46.351775+0000","last_undegraded":"2023-10-03T19:16:46.351775+0000","last_fullsized":"2023-10-03T19:16:46.351775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:34:18.140425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":98,"acting":98,"num_store_stats":6},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2340,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":42,"acting":42,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509496,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25616,"kb_used_data":776,"kb_used_omap":0,"kb_used_meta":24832,"kb_avail":94346224,"statfs":{"total":96636764160,"available":96610533376,"internally_reserved":0,"allocated":794624,"data_stored":906715,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":25427968},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.90900000000000003,"15min":0.94499999999999995},"min":{"1min":0.52000000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.196,"5min":4.0469999999999997,"15min":4.0469999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.85799999999999998,"15min":0.81200000000000006},"min":{"1min":0.625,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2310000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.62}]},{"osd":1,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94399999999999995,"15min":1.0269999999999999},"min":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3200000000000001,"5min":3.8239999999999998,"15min":3.8239999999999998},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.873,"5min":0.88300000000000001,"15min":0.85899999999999999},"min":{"1min":0.65800000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.159,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.96499999999999997}]},{"osd":2,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.93600000000000005,"15min":0.87},"min":{"1min":0.71499999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.212,"5min":6.0449999999999999,"15min":6.0449999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0029999999999999,"15min":1.04},"min":{"1min":0.77400000000000002,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.5800000000000001,"5min":3.98,"15min":3.98},"last":0.93200000000000005}]},{"osd":3,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.996,"15min":0.94399999999999995},"min":{"1min":0.65300000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.26,"5min":6.125,"15min":6.125},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0700000000000001,"15min":1.123},"min":{"1min":0.61899999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.444,"5min":3.9140000000000001,"15min":3.9140000000000001},"last":1.091}]},{"osd":4,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":1.036,"15min":1.1599999999999999},"min":{"1min":0.55900000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.421,"5min":5.1130000000000004,"15min":5.1130000000000004},"last":1.056},{"interface":"front","average":{"1min":0.92500000000000004,"5min":1.022,"15min":1.028},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.385,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":1.006}]},{"osd":5,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.135,"15min":1.268},"min":{"1min":0.72499999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.27,"5min":5.1859999999999999,"15min":5.1859999999999999},"last":1.1919999999999999},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0840000000000001,"15min":1.1459999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.216,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.163}]},{"osd":6,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0920000000000001,"15min":1.1000000000000001},"min":{"1min":0.78900000000000003,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.3440000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.179,"15min":1.1850000000000001},"min":{"1min":0.81799999999999995,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.466,"5min":6.1580000000000004,"15min":6.1580000000000004},"last":1.1359999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509496,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14784,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":14080,"kb_avail":94357056,"statfs":{"total":96636764160,"available":96621625344,"internally_reserved":0,"allocated":712704,"data_stored":314441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14417920},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83499999999999996,"15min":0.81899999999999995},"min":{"1min":0.60499999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.139,"5min":1.504,"15min":1.504},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.89900000000000002,"15min":0.88500000000000001},"min":{"1min":0.56699999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.171,"5min":1.839,"15min":1.839},"last":0.61199999999999999}]},{"osd":1,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.85699999999999998,"15min":0.84099999999999997},"min":{"1min":0.53100000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.1859999999999999,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89000000000000001,"15min":0.88},"min":{"1min":0.59799999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.127,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":1.004}]},{"osd":2,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.91700000000000004,"15min":0.874},"min":{"1min":0.65800000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3600000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.745},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.92100000000000004,"15min":0.92600000000000005},"min":{"1min":0.63200000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3200000000000001,"5min":1.546,"15min":1.546},"last":0.78900000000000003}]},{"osd":3,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.96599999999999997,"15min":0.98199999999999998},"min":{"1min":0.70799999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.91800000000000004,"15min":0.91200000000000003},"min":{"1min":0.69399999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1870000000000001,"5min":2.121,"15min":2.121},"last":0.83799999999999997}]},{"osd":4,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.97299999999999998,"15min":1.026},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.286,"5min":1.95,"15min":1.95},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0329999999999999,"15min":1.091},"min":{"1min":0.65500000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.429,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.0389999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.97199999999999998,"15min":1.0189999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.1259999999999999,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.079,"5min":1.0800000000000001,"15min":1.1200000000000001},"min":{"1min":0.75700000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.524,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.1140000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.093,"15min":1.121},"min":{"1min":0.73699999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.3220000000000001,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.137},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.071,"15min":1.097},"min":{"1min":0.79600000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4350000000000001,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.0800000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509497,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15564,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":14848,"kb_avail":94356276,"statfs":{"total":96636764160,"available":96620826624,"internally_reserved":0,"allocated":724992,"data_stored":317135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15204352},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.83499999999999996,"15min":0.79000000000000004},"min":{"1min":0.54700000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.87},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.83899999999999997,"15min":0.82499999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.026,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.78500000000000003}]},{"osd":1,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.92000000000000004,"15min":0.93200000000000005},"min":{"1min":0.61399999999999999,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.117,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.89700000000000002,"15min":0.86099999999999999},"min":{"1min":0.68799999999999994,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1799999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.72899999999999998}]},{"osd":2,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.93899999999999995,"15min":0.91700000000000004},"min":{"1min":0.56200000000000006,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2390000000000001,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.96599999999999997,"15min":0.94399999999999995},"min":{"1min":0.78300000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.1359999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":1.0940000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.89400000000000002,"15min":0.877},"min":{"1min":0.69199999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.153,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.996,"5min":1.0449999999999999,"15min":1.0649999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3400000000000001,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":1.155}]},{"osd":5,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.99099999999999999,"15min":1.05},"min":{"1min":0.67100000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1819999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.022},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.98099999999999998,"15min":1.0109999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.387,"5min":1.635,"15min":1.635},"last":1.0569999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.0780000000000001,"15min":1.1839999999999999},"min":{"1min":0.71499999999999997,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.1120000000000001,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.1120000000000001,"15min":1.181},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.3640000000000001,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":1.276}]},{"osd":7,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0509999999999999,"15min":1.085},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.242,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.212},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.1759999999999999,"15min":1.2250000000000001},"min":{"1min":0.85599999999999998,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3260000000000001,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":1.52}]}]},{"osd":2,"up_from":15,"seq":64424509497,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25660,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":24960,"kb_avail":94346180,"statfs":{"total":96636764160,"available":96610488320,"internally_reserved":0,"allocated":708608,"data_stored":314407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25559040},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.60399999999999998,"15min":0.54100000000000004},"min":{"1min":0.47099999999999997,"5min":0.247,"15min":0.247},"max":{"1min":1.1020000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.69599999999999995,"15min":0.63},"min":{"1min":0.30299999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.2350000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.65400000000000003}]},{"osd":1,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71299999999999997,"15min":0.63300000000000001},"min":{"1min":0.48599999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1739999999999999,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.67400000000000004,"15min":0.60399999999999998},"min":{"1min":0.42599999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.76700000000000002}]},{"osd":3,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.71499999999999997,"15min":0.63700000000000001},"min":{"1min":0.40500000000000003,"5min":0.224,"15min":0.224},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.82199999999999995,"15min":0.73599999999999999},"min":{"1min":0.44600000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1419999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.91600000000000004}]},{"osd":4,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.91800000000000004,"15min":0.85799999999999998},"min":{"1min":0.63,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":1.274},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.98599999999999999,"15min":0.92400000000000004},"min":{"1min":0.71499999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":1.0149999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.94999999999999996,"15min":0.876},"min":{"1min":0.76600000000000001,"5min":0.432,"15min":0.432},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0249999999999999,"15min":0.95099999999999996},"min":{"1min":0.68100000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4239999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.0740000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.96399999999999997,"15min":0.92200000000000004},"min":{"1min":0.66300000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.302},{"interface":"front","average":{"1min":1.139,"5min":1.0409999999999999,"15min":0.97699999999999998},"min":{"1min":0.64800000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":1.3839999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.0920000000000001,"15min":1.0169999999999999},"min":{"1min":0.74199999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":1.117},{"interface":"front","average":{"1min":1.109,"5min":1.024,"15min":0.96799999999999997},"min":{"1min":0.71099999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.361}]}]},{"osd":1,"up_from":15,"seq":64424509496,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14876,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":14144,"kb_avail":94356964,"statfs":{"total":96636764160,"available":96621531136,"internally_reserved":0,"allocated":741376,"data_stored":317899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14483456},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58499999999999996,"15min":0.54800000000000004},"min":{"1min":0.35899999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.96899999999999997,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.628,"15min":0.52400000000000002},"min":{"1min":0.45200000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.93200000000000005}]},{"osd":2,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.63600000000000001,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.75800000000000001,"15min":0.67500000000000004},"min":{"1min":0.44700000000000001,"5min":0.312,"15min":0.312},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.99199999999999999}]},{"osd":3,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.72499999999999998,"15min":0.64300000000000002},"min":{"1min":0.41699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.2370000000000001,"5min":1.27,"15min":1.27},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.69699999999999995,"15min":0.59699999999999998},"min":{"1min":0.47699999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1830000000000001,"5min":1.27,"15min":1.27},"last":0.66400000000000003}]},{"osd":4,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.86199999999999999,"15min":0.80700000000000005},"min":{"1min":0.69099999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.073},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.93799999999999994,"15min":0.89400000000000002},"min":{"1min":0.65900000000000003,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.2430000000000001}]},{"osd":5,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.94299999999999995,"15min":0.86799999999999999},"min":{"1min":0.69899999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":1.038},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.92000000000000004,"15min":0.85899999999999999},"min":{"1min":0.80700000000000005,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3959999999999999,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.2150000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.99399999999999999,"15min":0.93000000000000005},"min":{"1min":0.68999999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":0.97999999999999998,"15min":0.90400000000000003},"min":{"1min":0.879,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.329,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.1140000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0269999999999999,"15min":0.94799999999999995},"min":{"1min":0.78500000000000003,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.99299999999999999,"15min":0.91100000000000003},"min":{"1min":0.71899999999999997,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5880000000000001,"5min":1.649,"15min":1.649},"last":1.288}]}]},{"osd":3,"up_from":14,"seq":60129542200,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33896,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":33216,"kb_avail":94337944,"statfs":{"total":96636764160,"available":96602054656,"internally_reserved":0,"allocated":688128,"data_stored":301823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":34013184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.627,"15min":0.57699999999999996},"min":{"1min":0.40200000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.2090000000000001,"5min":1.212,"15min":1.212},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68700000000000006,"15min":0.64800000000000002},"min":{"1min":0.32900000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.125,"5min":1.236,"15min":1.236},"last":0.57699999999999996}]},{"osd":1,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.69399999999999995,"15min":0.63700000000000001},"min":{"1min":0.51400000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0589999999999999,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.73599999999999999,"15min":0.67300000000000004},"min":{"1min":0.53000000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.2210000000000001,"5min":1.222,"15min":1.222},"last":0.70099999999999996}]},{"osd":2,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.77600000000000002,"15min":0.71599999999999997},"min":{"1min":0.44600000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.083,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.70999999999999996,"15min":0.63700000000000001},"min":{"1min":0.432,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.89400000000000002}]},{"osd":4,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.94299999999999995,"15min":0.91500000000000004},"min":{"1min":0.58899999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.131,"5min":1.496,"15min":1.496},"last":0.876},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.97799999999999998,"15min":0.93799999999999994},"min":{"1min":0.64100000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.486,"5min":1.546,"15min":1.546},"last":1.175}]},{"osd":5,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.91800000000000004,"15min":0.88200000000000001},"min":{"1min":0.68300000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3280000000000001,"5min":1.51,"15min":1.51},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.044,"5min":1.0249999999999999,"15min":1},"min":{"1min":0.66300000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.387,"5min":1.498,"15min":1.498},"last":0.84799999999999998}]},{"osd":6,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.95999999999999996,"15min":0.92400000000000004},"min":{"1min":0.60899999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1639999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.212},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.042,"15min":0.99299999999999999},"min":{"1min":0.70299999999999996,"5min":0.625,"15min":0.625},"max":{"1min":1.2969999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.0780000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0489999999999999,"15min":1.0089999999999999},"min":{"1min":0.68899999999999995,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.395,"5min":1.597,"15min":1.597},"last":1.026},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.0700000000000001,"15min":1.024},"min":{"1min":0.72699999999999998,"5min":0.623,"15min":0.623},"max":{"1min":1.6040000000000001,"5min":1.708,"15min":1.708},"last":1.1539999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16092,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":15424,"kb_avail":94355748,"statfs":{"total":96636764160,"available":96620285952,"internally_reserved":0,"allocated":675840,"data_stored":295653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15794176},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.85699999999999998,"15min":0.82599999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.1919999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85899999999999999,"15min":0.85299999999999998},"min":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.81000000000000005}]},{"osd":1,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.85299999999999998,"15min":0.83399999999999996},"min":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0920000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.873,"5min":0.91900000000000004,"15min":0.92500000000000004},"min":{"1min":0.59799999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.149,"5min":1.514,"15min":1.514},"last":1.133}]},{"osd":2,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.90800000000000003,"15min":0.89800000000000002},"min":{"1min":0.56299999999999994,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.234,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":1.101},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.90700000000000003,"15min":0.89700000000000002},"min":{"1min":0.66100000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1499999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.95499999999999996}]},{"osd":3,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.93200000000000005,"15min":0.92800000000000005},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.2629999999999999,"5min":1.304,"15min":1.304},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0369999999999999,"15min":1.0289999999999999},"min":{"1min":0.75,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.1679999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.96499999999999997,"15min":0.96899999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.29,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.995,"15min":1.0309999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.222,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.67300000000000004}]},{"osd":6,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.98899999999999999,"15min":1.0309999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2050000000000001,"5min":1.462,"15min":1.462},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.083,"5min":1.1200000000000001,"15min":1.1379999999999999},"min":{"1min":0.78200000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.3759999999999999,"5min":1.823,"15min":1.823},"last":0.91400000000000003}]},{"osd":7,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.0640000000000001,"15min":1.0760000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3280000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.05},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.141,"15min":1.1519999999999999},"min":{"1min":0.79100000000000004,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.399,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.87}]}]},{"osd":0,"up_from":13,"seq":55834574904,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21592,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":20864,"kb_avail":94350248,"statfs":{"total":96636764160,"available":96614653952,"internally_reserved":0,"allocated":737280,"data_stored":884857,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":21364736},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63100000000000001,"15min":0.58599999999999997},"min":{"1min":0.44400000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.75600000000000001,"15min":0.71899999999999997},"min":{"1min":0.5,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.1970000000000001,"5min":1.27,"15min":1.27},"last":0.752}]},{"osd":2,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.73799999999999999,"15min":0.71799999999999997},"min":{"1min":0.50800000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1299999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.3080000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.46800000000000003,"5min":0.315,"15min":0.315},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.68100000000000005}]},{"osd":3,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.82099999999999995,"15min":0.73699999999999999},"min":{"1min":0.59299999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.202,"5min":1.446,"15min":1.446},"last":1.163},{"interface":"front","average":{"1min":0.87,"5min":0.80000000000000004,"15min":0.70999999999999996},"min":{"1min":0.51000000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.304,"5min":1.375,"15min":1.375},"last":0.99299999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.93000000000000005,"15min":0.91200000000000003},"min":{"1min":0.70299999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.052,"15min":1.028},"min":{"1min":0.89200000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.349,"5min":1.508,"15min":1.508},"last":1.371}]},{"osd":5,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.073,"15min":1.0509999999999999},"min":{"1min":0.90400000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3129999999999999,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.0209999999999999,"15min":0.98199999999999998},"min":{"1min":0.77100000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.3959999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.0600000000000001,"15min":1.022},"min":{"1min":0.81200000000000006,"5min":0.623,"15min":0.623},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.04,"15min":0.999},"min":{"1min":0.755,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.448,"5min":1.637,"15min":1.637},"last":1.2170000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.0860000000000001,"15min":1.042},"min":{"1min":0.72799999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.488},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.089,"15min":1.0629999999999999},"min":{"1min":0.76300000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5940000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.091}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:16:49.693 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:16:49.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.846+0000 7f7f18379640 1 Processor -- start 2023-10-03T19:16:49.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.846+0000 7f7f18379640 1 -- start start 2023-10-03T19:16:49.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f18379640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f1014cf30 0x7f7f10150110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:49.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f18379640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f100bffa0 con 0x7f7f100c0fd0 2023-10-03T19:16:49.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f18379640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f100c0280 con 0x7f7f10149960 2023-10-03T19:16:49.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f18379640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1014d3d0 con 0x7f7f1014cf30 2023-10-03T19:16:49.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f15914640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7f100c0fd0 0x7f7f1014fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55536/0 (socket says 172.21.15.45:55536) 2023-10-03T19:16:49.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f15914640 1 -- 172.21.15.45:0/3695120920 learned_addr learned my addr 172.21.15.45:0/3695120920 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:49.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f16916640 1 --2- 172.21.15.45:0/3695120920 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f1014cf30 0x7f7f10150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:49.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f15113640 1 -- 172.21.15.45:0/3695120920 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1425549696 0 0) 0x7f7f100bffa0 con 0x7f7f100c0fd0 2023-10-03T19:16:49.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f15113640 1 -- 172.21.15.45:0/3695120920 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7efc003530 con 0x7f7f100c0fd0 2023-10-03T19:16:49.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f15113640 1 -- 172.21.15.45:0/3695120920 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1653366231 0 0) 0x7f7efc003530 con 0x7f7f100c0fd0 2023-10-03T19:16:49.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f15113640 1 -- 172.21.15.45:0/3695120920 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f1014cf30 msgr2=0x7f7f10150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:49.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f15113640 1 --2- 172.21.15.45:0/3695120920 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f1014cf30 0x7f7f10150110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:49.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f15113640 1 -- 172.21.15.45:0/3695120920 >> v1:172.21.15.79:6789/0 conn(0x7f7f10149960 legacy=0x7f7f1006aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:49.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f15113640 1 -- 172.21.15.45:0/3695120920 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f100c08d0 con 0x7f7f100c0fd0 2023-10-03T19:16:49.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f15113640 1 -- 172.21.15.45:0/3695120920 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f7f00001680 con 0x7f7f100c0fd0 2023-10-03T19:16:49.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f15113640 1 -- 172.21.15.45:0/3695120920 >> v1:172.21.15.45:6789/0 conn(0x7f7f100c0fd0 legacy=0x7f7f1014fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:49.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f15113640 1 --2- 172.21.15.45:0/3695120920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7efc0039b0 0x7f7efc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:49.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f15113640 1 --2- 172.21.15.45:0/3695120920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7efc0047d0 0x7f7efc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:49.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f15113640 1 --2- 172.21.15.45:0/3695120920 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f1014cf30 0x7f7efc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:49.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f15113640 1 -- 172.21.15.45:0/3695120920 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1014d3d0 con 0x7f7efc0039b0 2023-10-03T19:16:49.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f15113640 1 -- 172.21.15.45:0/3695120920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc00bad0 con 0x7f7efc0047d0 2023-10-03T19:16:49.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f15113640 1 -- 172.21.15.45:0/3695120920 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc00bc60 con 0x7f7f1014cf30 2023-10-03T19:16:49.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f16115640 1 --2- 172.21.15.45:0/3695120920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7efc0039b0 0x7f7efc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:49.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f16916640 1 --2- 172.21.15.45:0/3695120920 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f1014cf30 0x7f7efc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:49.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f15914640 1 --2- 172.21.15.45:0/3695120920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7efc0047d0 0x7f7efc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:49.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f16115640 1 -- 172.21.15.45:0/3695120920 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f1014cf30 msgr2=0x7f7efc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:49.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f16115640 1 --2- 172.21.15.45:0/3695120920 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f1014cf30 0x7f7efc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:49.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f16115640 1 -- 172.21.15.45:0/3695120920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7efc0047d0 msgr2=0x7f7efc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:49.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f16115640 1 --2- 172.21.15.45:0/3695120920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7efc0047d0 0x7f7efc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:49.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f16115640 1 -- 172.21.15.45:0/3695120920 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc003530 con 0x7f7efc0039b0 2023-10-03T19:16:49.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f16916640 1 --2- 172.21.15.45:0/3695120920 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f1014cf30 0x7f7efc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:49.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.850+0000 7f7f15914640 1 --2- 172.21.15.45:0/3695120920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7efc0047d0 0x7f7efc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:49.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f16115640 1 --2- 172.21.15.45:0/3695120920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7efc0039b0 0x7f7efc003dc0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c001780 tx=0x7f7f0c01c220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a47d96dfd09d90f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:49.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f15113640 1 -- 172.21.15.45:0/3695120920 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c0052d0 con 0x7f7efc0039b0 2023-10-03T19:16:49.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f15113640 1 -- 172.21.15.45:0/3695120920 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0c0a7050 con 0x7f7efc0039b0 2023-10-03T19:16:49.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f15113640 1 -- 172.21.15.45:0/3695120920 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c003600 con 0x7f7efc0039b0 2023-10-03T19:16:49.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f18379640 1 -- 172.21.15.45:0/3695120920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7efc0039b0 msgr2=0x7f7efc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:49.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f18379640 1 --2- 172.21.15.45:0/3695120920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7efc0039b0 0x7f7efc003dc0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c001780 tx=0x7f7f0c01c220 comp rx=0 tx=0).stop 2023-10-03T19:16:49.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f16916640 1 -- 172.21.15.45:0/3695120920 reap_dead start 2023-10-03T19:16:49.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f18379640 1 -- 172.21.15.45:0/3695120920 shutdown_connections 2023-10-03T19:16:49.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f18379640 1 -- 172.21.15.45:0/3695120920 >> 172.21.15.45:0/3695120920 conn(0x7f7f100c2200 msgr2=0x7f7f100bdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:49.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f18379640 1 -- 172.21.15.45:0/3695120920 shutdown_connections 2023-10-03T19:16:49.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f18379640 1 -- 172.21.15.45:0/3695120920 wait complete. 2023-10-03T19:16:49.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f18379640 1 Processor -- start 2023-10-03T19:16:49.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f18379640 1 -- start start 2023-10-03T19:16:49.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f18379640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f1006d8e0 0x7f7f1006ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:49.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f18379640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f100a4ec0 0x7f7f1006dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:49.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f18379640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f101e6e90 0x7f7f101479a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:49.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f18379640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1006c8f0 con 0x7f7f100a4ec0 2023-10-03T19:16:49.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f18379640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f100a61c0 con 0x7f7f1006d8e0 2023-10-03T19:16:49.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f18379640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1006e1f0 con 0x7f7f101e6e90 2023-10-03T19:16:49.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f15914640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f100a4ec0 0x7f7f1006dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:49.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f15914640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f100a4ec0 0x7f7f1006dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37052/0 (socket says 172.21.15.45:37052) 2023-10-03T19:16:49.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f15914640 1 -- 172.21.15.45:0/2183927190 learned_addr learned my addr 172.21.15.45:0/2183927190 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:49.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f16115640 1 --2- 172.21.15.45:0/2183927190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f1006d8e0 0x7f7f1006ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:49.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f15914640 1 -- 172.21.15.45:0/2183927190 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f101e6e90 msgr2=0x7f7f101479a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:49.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f16916640 1 --2- 172.21.15.45:0/2183927190 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f101e6e90 0x7f7f101479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:49.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f15914640 1 --2- 172.21.15.45:0/2183927190 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f101e6e90 0x7f7f101479a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:49.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f15914640 1 -- 172.21.15.45:0/2183927190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f1006d8e0 msgr2=0x7f7f1006ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:49.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f15914640 1 --2- 172.21.15.45:0/2183927190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f1006d8e0 0x7f7f1006ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:49.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f15914640 1 -- 172.21.15.45:0/2183927190 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1006b1f0 con 0x7f7f100a4ec0 2023-10-03T19:16:49.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f16115640 1 --2- 172.21.15.45:0/2183927190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f1006d8e0 0x7f7f1006ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:49.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f15914640 1 --2- 172.21.15.45:0/2183927190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f100a4ec0 0x7f7f1006dcb0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7f00010c30 tx=0x7f7f0000e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:49.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f06ffd640 1 -- 172.21.15.45:0/2183927190 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0000ed70 con 0x7f7f100a4ec0 2023-10-03T19:16:49.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f06ffd640 1 -- 172.21.15.45:0/2183927190 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f000143a0 con 0x7f7f100a4ec0 2023-10-03T19:16:49.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.854+0000 7f7f06ffd640 1 -- 172.21.15.45:0/2183927190 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f00014710 con 0x7f7f100a4ec0 2023-10-03T19:16:49.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.858+0000 7f7f18379640 1 -- 172.21.15.45:0/2183927190 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f100c0bb0 con 0x7f7f100a4ec0 2023-10-03T19:16:49.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.858+0000 7f7f18379640 1 -- 172.21.15.45:0/2183927190 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f10149d30 con 0x7f7f100a4ec0 2023-10-03T19:16:49.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.858+0000 7f7f18379640 1 -- 172.21.15.45:0/2183927190 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f1004de80 con 0x7f7f100a4ec0 2023-10-03T19:16:49.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.858+0000 7f7f06ffd640 1 -- 172.21.15.45:0/2183927190 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7f00014870 con 0x7f7f100a4ec0 2023-10-03T19:16:49.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.858+0000 7f7f06ffd640 1 --2- 172.21.15.45:0/2183927190 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7ef4066280 0x7f7ef4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:49.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.858+0000 7f7f06ffd640 1 -- 172.21.15.45:0/2183927190 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7f000868e0 con 0x7f7f100a4ec0 2023-10-03T19:16:49.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.858+0000 7f7f16115640 1 --2- 172.21.15.45:0/2183927190 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7ef4066280 0x7f7ef4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:49.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.858+0000 7f7f16115640 1 --2- 172.21.15.45:0/2183927190 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7ef4066280 0x7f7ef4068730 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c001750 tx=0x7f7f0c0011a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:49.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:49.862+0000 7f7f06ffd640 1 -- 172.21.15.45:0/2183927190 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7f00053df0 con 0x7f7f100a4ec0 2023-10-03T19:16:50.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.014+0000 7f7f18379640 1 -- 172.21.15.45:0/2183927190 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7f100bce00 con 0x7f7ef4066280 2023-10-03T19:16:50.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.054+0000 7f7f06ffd640 1 -- 172.21.15.45:0/2183927190 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306164 (secure 0 0 0) 0x7f7f100bce00 con 0x7f7ef4066280 2023-10-03T19:16:50.063 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:16:50.066 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:16:50.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.062+0000 7f7f18379640 1 -- 172.21.15.45:0/2183927190 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7ef4066280 msgr2=0x7f7ef4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:50.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.062+0000 7f7f18379640 1 --2- 172.21.15.45:0/2183927190 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7ef4066280 0x7f7ef4068730 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c001750 tx=0x7f7f0c0011a0 comp rx=0 tx=0).stop 2023-10-03T19:16:50.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.062+0000 7f7f18379640 1 -- 172.21.15.45:0/2183927190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f100a4ec0 msgr2=0x7f7f1006dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:50.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.062+0000 7f7f18379640 1 --2- 172.21.15.45:0/2183927190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f100a4ec0 0x7f7f1006dcb0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7f00010c30 tx=0x7f7f0000e4d0 comp rx=0 tx=0).stop 2023-10-03T19:16:50.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.062+0000 7f7f18379640 1 -- 172.21.15.45:0/2183927190 shutdown_connections 2023-10-03T19:16:50.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.062+0000 7f7f18379640 1 --2- 172.21.15.45:0/2183927190 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7ef4066280 0x7f7ef4068730 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:50.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.062+0000 7f7f18379640 1 --2- 172.21.15.45:0/2183927190 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f101e6e90 0x7f7f101479a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:50.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.062+0000 7f7f18379640 1 --2- 172.21.15.45:0/2183927190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f100a4ec0 0x7f7f1006dcb0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:50.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.062+0000 7f7f18379640 1 --2- 172.21.15.45:0/2183927190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f1006d8e0 0x7f7f1006ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:50.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.062+0000 7f7f18379640 1 -- 172.21.15.45:0/2183927190 >> 172.21.15.45:0/2183927190 conn(0x7f7f100c2200 msgr2=0x7f7f100bbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:50.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.062+0000 7f7f18379640 1 -- 172.21.15.45:0/2183927190 shutdown_connections 2023-10-03T19:16:50.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.062+0000 7f7f18379640 1 -- 172.21.15.45:0/2183927190 wait complete. 2023-10-03T19:16:50.085 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2023-10-03T19:16:48.536958+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592708,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":192,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":158,"acting":158,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":168080,"kb_used_data":5648,"kb_used_omap":0,"kb_used_meta":162368,"kb_avail":754806640,"statfs":{"total":773094113280,"available":772921999360,"internally_reserved":0,"allocated":5783552,"data_stored":3652930,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":166264832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2340,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001178"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.355678+0000","last_change":"2023-10-03T19:16:46.354281+0000","last_active":"2023-10-03T19:16:46.355678+0000","last_peered":"2023-10-03T19:16:46.355678+0000","last_clean":"2023-10-03T19:16:46.355678+0000","last_became_active":"2023-10-03T19:16:46.353863+0000","last_became_peered":"2023-10-03T19:16:46.353863+0000","last_unstale":"2023-10-03T19:16:46.355678+0000","last_undegraded":"2023-10-03T19:16:46.355678+0000","last_fullsized":"2023-10-03T19:16:46.355678+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:54:01.595268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.319995+0000","last_change":"2023-10-03T19:16:46.318712+0000","last_active":"2023-10-03T19:16:46.319995+0000","last_peered":"2023-10-03T19:16:46.319995+0000","last_clean":"2023-10-03T19:16:46.319995+0000","last_became_active":"2023-10-03T19:16:46.318367+0000","last_became_peered":"2023-10-03T19:16:46.318367+0000","last_unstale":"2023-10-03T19:16:46.319995+0000","last_undegraded":"2023-10-03T19:16:46.319995+0000","last_fullsized":"2023-10-03T19:16:46.319995+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:04:47.708070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381928+0000","last_change":"2023-10-03T19:16:46.372185+0000","last_active":"2023-10-03T19:16:46.381928+0000","last_peered":"2023-10-03T19:16:46.381928+0000","last_clean":"2023-10-03T19:16:46.381928+0000","last_became_active":"2023-10-03T19:16:46.371540+0000","last_became_peered":"2023-10-03T19:16:46.371540+0000","last_unstale":"2023-10-03T19:16:46.381928+0000","last_undegraded":"2023-10-03T19:16:46.381928+0000","last_fullsized":"2023-10-03T19:16:46.381928+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:25:23.195500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.374546+0000","last_change":"2023-10-03T19:16:46.355059+0000","last_active":"2023-10-03T19:16:46.374546+0000","last_peered":"2023-10-03T19:16:46.374546+0000","last_clean":"2023-10-03T19:16:46.374546+0000","last_became_active":"2023-10-03T19:16:46.347192+0000","last_became_peered":"2023-10-03T19:16:46.347192+0000","last_unstale":"2023-10-03T19:16:46.374546+0000","last_undegraded":"2023-10-03T19:16:46.374546+0000","last_fullsized":"2023-10-03T19:16:46.374546+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:42:11.101433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.382846+0000","last_change":"2023-10-03T19:16:46.376955+0000","last_active":"2023-10-03T19:16:46.382846+0000","last_peered":"2023-10-03T19:16:46.382846+0000","last_clean":"2023-10-03T19:16:46.382846+0000","last_became_active":"2023-10-03T19:16:46.376315+0000","last_became_peered":"2023-10-03T19:16:46.376315+0000","last_unstale":"2023-10-03T19:16:46.382846+0000","last_undegraded":"2023-10-03T19:16:46.382846+0000","last_fullsized":"2023-10-03T19:16:46.382846+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:39:49.540080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.348676+0000","last_change":"2023-10-03T19:16:46.348039+0000","last_active":"2023-10-03T19:16:46.348676+0000","last_peered":"2023-10-03T19:16:46.348676+0000","last_clean":"2023-10-03T19:16:46.348676+0000","last_became_active":"2023-10-03T19:16:46.347765+0000","last_became_peered":"2023-10-03T19:16:46.347765+0000","last_unstale":"2023-10-03T19:16:46.348676+0000","last_undegraded":"2023-10-03T19:16:46.348676+0000","last_fullsized":"2023-10-03T19:16:46.348676+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:05:13.691561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381879+0000","last_change":"2023-10-03T19:16:46.371593+0000","last_active":"2023-10-03T19:16:46.381879+0000","last_peered":"2023-10-03T19:16:46.381879+0000","last_clean":"2023-10-03T19:16:46.381879+0000","last_became_active":"2023-10-03T19:16:46.369346+0000","last_became_peered":"2023-10-03T19:16:46.369346+0000","last_unstale":"2023-10-03T19:16:46.381879+0000","last_undegraded":"2023-10-03T19:16:46.381879+0000","last_fullsized":"2023-10-03T19:16:46.381879+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:54:53.731901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381775+0000","last_change":"2023-10-03T19:16:46.370812+0000","last_active":"2023-10-03T19:16:46.381775+0000","last_peered":"2023-10-03T19:16:46.381775+0000","last_clean":"2023-10-03T19:16:46.381775+0000","last_became_active":"2023-10-03T19:16:46.368674+0000","last_became_peered":"2023-10-03T19:16:46.368674+0000","last_unstale":"2023-10-03T19:16:46.381775+0000","last_undegraded":"2023-10-03T19:16:46.381775+0000","last_fullsized":"2023-10-03T19:16:46.381775+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:30:05.766523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.379890+0000","last_change":"2023-10-03T19:16:46.363645+0000","last_active":"2023-10-03T19:16:46.379890+0000","last_peered":"2023-10-03T19:16:46.379890+0000","last_clean":"2023-10-03T19:16:46.379890+0000","last_became_active":"2023-10-03T19:16:46.363014+0000","last_became_peered":"2023-10-03T19:16:46.363014+0000","last_unstale":"2023-10-03T19:16:46.379890+0000","last_undegraded":"2023-10-03T19:16:46.379890+0000","last_fullsized":"2023-10-03T19:16:46.379890+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:20:40.295554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381783+0000","last_change":"2023-10-03T19:16:46.370866+0000","last_active":"2023-10-03T19:16:46.381783+0000","last_peered":"2023-10-03T19:16:46.381783+0000","last_clean":"2023-10-03T19:16:46.381783+0000","last_became_active":"2023-10-03T19:16:46.369194+0000","last_became_peered":"2023-10-03T19:16:46.369194+0000","last_unstale":"2023-10-03T19:16:46.381783+0000","last_undegraded":"2023-10-03T19:16:46.381783+0000","last_fullsized":"2023-10-03T19:16:46.381783+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:28:32.763091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381998+0000","last_change":"2023-10-03T19:16:46.371802+0000","last_active":"2023-10-03T19:16:46.381998+0000","last_peered":"2023-10-03T19:16:46.381998+0000","last_clean":"2023-10-03T19:16:46.381998+0000","last_became_active":"2023-10-03T19:16:46.371306+0000","last_became_peered":"2023-10-03T19:16:46.371306+0000","last_unstale":"2023-10-03T19:16:46.381998+0000","last_undegraded":"2023-10-03T19:16:46.381998+0000","last_fullsized":"2023-10-03T19:16:46.381998+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:43:09.345662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.322740+0000","last_change":"2023-10-03T19:16:46.321343+0000","last_active":"2023-10-03T19:16:46.322740+0000","last_peered":"2023-10-03T19:16:46.322740+0000","last_clean":"2023-10-03T19:16:46.322740+0000","last_became_active":"2023-10-03T19:16:46.321083+0000","last_became_peered":"2023-10-03T19:16:46.321083+0000","last_unstale":"2023-10-03T19:16:46.322740+0000","last_undegraded":"2023-10-03T19:16:46.322740+0000","last_fullsized":"2023-10-03T19:16:46.322740+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:51:28.753857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.347991+0000","last_change":"2023-10-03T19:16:46.346773+0000","last_active":"2023-10-03T19:16:46.347991+0000","last_peered":"2023-10-03T19:16:46.347991+0000","last_clean":"2023-10-03T19:16:46.347991+0000","last_became_active":"2023-10-03T19:16:46.346453+0000","last_became_peered":"2023-10-03T19:16:46.346453+0000","last_unstale":"2023-10-03T19:16:46.347991+0000","last_undegraded":"2023-10-03T19:16:46.347991+0000","last_fullsized":"2023-10-03T19:16:46.347991+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:40:18.437890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.374309+0000","last_change":"2023-10-03T19:16:46.349167+0000","last_active":"2023-10-03T19:16:46.374309+0000","last_peered":"2023-10-03T19:16:46.374309+0000","last_clean":"2023-10-03T19:16:46.374309+0000","last_became_active":"2023-10-03T19:16:46.348310+0000","last_became_peered":"2023-10-03T19:16:46.348310+0000","last_unstale":"2023-10-03T19:16:46.374309+0000","last_undegraded":"2023-10-03T19:16:46.374309+0000","last_fullsized":"2023-10-03T19:16:46.374309+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:39:42.294017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.378898+0000","last_change":"2023-10-03T19:16:46.364849+0000","last_active":"2023-10-03T19:16:46.378898+0000","last_peered":"2023-10-03T19:16:46.378898+0000","last_clean":"2023-10-03T19:16:46.378898+0000","last_became_active":"2023-10-03T19:16:46.362795+0000","last_became_peered":"2023-10-03T19:16:46.362795+0000","last_unstale":"2023-10-03T19:16:46.378898+0000","last_undegraded":"2023-10-03T19:16:46.378898+0000","last_fullsized":"2023-10-03T19:16:46.378898+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:11:48.396477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":3,"reported_epoch":60,"state":"creating+activating","last_fresh":"2023-10-03T19:16:46.303990+0000","last_change":"2023-10-03T19:16:46.303990+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:46.303990+0000","last_undegraded":"2023-10-03T19:16:46.303990+0000","last_fullsized":"2023-10-03T19:16:46.303990+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:04:47.708070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":3,"reported_epoch":60,"state":"creating+activating","last_fresh":"2023-10-03T19:16:46.304321+0000","last_change":"2023-10-03T19:16:46.304321+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:46.304321+0000","last_undegraded":"2023-10-03T19:16:46.304321+0000","last_fullsized":"2023-10-03T19:16:46.304321+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:59:33.879590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":3,"reported_epoch":60,"state":"creating+activating","last_fresh":"2023-10-03T19:16:46.303772+0000","last_change":"2023-10-03T19:16:46.303772+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:46.303772+0000","last_undegraded":"2023-10-03T19:16:46.303772+0000","last_fullsized":"2023-10-03T19:16:46.303772+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:35:51.612936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381818+0000","last_change":"2023-10-03T19:16:46.371106+0000","last_active":"2023-10-03T19:16:46.381818+0000","last_peered":"2023-10-03T19:16:46.381818+0000","last_clean":"2023-10-03T19:16:46.381818+0000","last_became_active":"2023-10-03T19:16:46.368784+0000","last_became_peered":"2023-10-03T19:16:46.368784+0000","last_unstale":"2023-10-03T19:16:46.381818+0000","last_undegraded":"2023-10-03T19:16:46.381818+0000","last_fullsized":"2023-10-03T19:16:46.381818+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:46:26.365305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.379936+0000","last_change":"2023-10-03T19:16:46.364524+0000","last_active":"2023-10-03T19:16:46.379936+0000","last_peered":"2023-10-03T19:16:46.379936+0000","last_clean":"2023-10-03T19:16:46.379936+0000","last_became_active":"2023-10-03T19:16:46.364031+0000","last_became_peered":"2023-10-03T19:16:46.364031+0000","last_unstale":"2023-10-03T19:16:46.379936+0000","last_undegraded":"2023-10-03T19:16:46.379936+0000","last_fullsized":"2023-10-03T19:16:46.379936+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:06:40.428254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.365969+0000","last_change":"2023-10-03T19:16:46.365391+0000","last_active":"2023-10-03T19:16:46.365969+0000","last_peered":"2023-10-03T19:16:46.365969+0000","last_clean":"2023-10-03T19:16:46.365969+0000","last_became_active":"2023-10-03T19:16:46.365114+0000","last_became_peered":"2023-10-03T19:16:46.365114+0000","last_unstale":"2023-10-03T19:16:46.365969+0000","last_undegraded":"2023-10-03T19:16:46.365969+0000","last_fullsized":"2023-10-03T19:16:46.365969+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:39:36.928666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.379484+0000","last_change":"2023-10-03T19:16:46.368881+0000","last_active":"2023-10-03T19:16:46.379484+0000","last_peered":"2023-10-03T19:16:46.379484+0000","last_clean":"2023-10-03T19:16:46.379484+0000","last_became_active":"2023-10-03T19:16:46.368277+0000","last_became_peered":"2023-10-03T19:16:46.368277+0000","last_unstale":"2023-10-03T19:16:46.379484+0000","last_undegraded":"2023-10-03T19:16:46.379484+0000","last_fullsized":"2023-10-03T19:16:46.379484+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:24:10.893825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.373833+0000","last_change":"2023-10-03T19:16:46.348251+0000","last_active":"2023-10-03T19:16:46.373833+0000","last_peered":"2023-10-03T19:16:46.373833+0000","last_clean":"2023-10-03T19:16:46.373833+0000","last_became_active":"2023-10-03T19:16:46.347396+0000","last_became_peered":"2023-10-03T19:16:46.347396+0000","last_unstale":"2023-10-03T19:16:46.373833+0000","last_undegraded":"2023-10-03T19:16:46.373833+0000","last_fullsized":"2023-10-03T19:16:46.373833+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:39:49.540080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.379004+0000","last_change":"2023-10-03T19:16:46.365538+0000","last_active":"2023-10-03T19:16:46.379004+0000","last_peered":"2023-10-03T19:16:46.379004+0000","last_clean":"2023-10-03T19:16:46.379004+0000","last_became_active":"2023-10-03T19:16:46.365018+0000","last_became_peered":"2023-10-03T19:16:46.365018+0000","last_unstale":"2023-10-03T19:16:46.379004+0000","last_undegraded":"2023-10-03T19:16:46.379004+0000","last_fullsized":"2023-10-03T19:16:46.379004+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:41:32.807340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"60'4","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.347934+0000","last_change":"2023-10-03T19:16:45.981820+0000","last_active":"2023-10-03T19:16:46.347934+0000","last_peered":"2023-10-03T19:16:46.347934+0000","last_clean":"2023-10-03T19:16:46.347934+0000","last_became_active":"2023-10-03T19:16:45.981370+0000","last_became_peered":"2023-10-03T19:16:45.981370+0000","last_unstale":"2023-10-03T19:16:46.347934+0000","last_undegraded":"2023-10-03T19:16:46.347934+0000","last_fullsized":"2023-10-03T19:16:46.347934+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:27:07.552881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.380668+0000","last_change":"2023-10-03T19:16:46.376884+0000","last_active":"2023-10-03T19:16:46.380668+0000","last_peered":"2023-10-03T19:16:46.380668+0000","last_clean":"2023-10-03T19:16:46.380668+0000","last_became_active":"2023-10-03T19:16:46.376443+0000","last_became_peered":"2023-10-03T19:16:46.376443+0000","last_unstale":"2023-10-03T19:16:46.380668+0000","last_undegraded":"2023-10-03T19:16:46.380668+0000","last_fullsized":"2023-10-03T19:16:46.380668+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:48:22.544505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381832+0000","last_change":"2023-10-03T19:16:46.371148+0000","last_active":"2023-10-03T19:16:46.381832+0000","last_peered":"2023-10-03T19:16:46.381832+0000","last_clean":"2023-10-03T19:16:46.381832+0000","last_became_active":"2023-10-03T19:16:46.368434+0000","last_became_peered":"2023-10-03T19:16:46.368434+0000","last_unstale":"2023-10-03T19:16:46.381832+0000","last_undegraded":"2023-10-03T19:16:46.381832+0000","last_fullsized":"2023-10-03T19:16:46.381832+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:36:18.321914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.320047+0000","last_change":"2023-10-03T19:16:46.315631+0000","last_active":"2023-10-03T19:16:46.320047+0000","last_peered":"2023-10-03T19:16:46.320047+0000","last_clean":"2023-10-03T19:16:46.320047+0000","last_became_active":"2023-10-03T19:16:46.315402+0000","last_became_peered":"2023-10-03T19:16:46.315402+0000","last_unstale":"2023-10-03T19:16:46.320047+0000","last_undegraded":"2023-10-03T19:16:46.320047+0000","last_fullsized":"2023-10-03T19:16:46.320047+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:23:09.252397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.303917+0000","last_change":"2023-10-03T19:16:45.941443+0000","last_active":"2023-10-03T19:16:46.303917+0000","last_peered":"2023-10-03T19:16:46.303917+0000","last_clean":"2023-10-03T19:16:46.303917+0000","last_became_active":"2023-10-03T19:16:45.940415+0000","last_became_peered":"2023-10-03T19:16:45.940415+0000","last_unstale":"2023-10-03T19:16:46.303917+0000","last_undegraded":"2023-10-03T19:16:46.303917+0000","last_fullsized":"2023-10-03T19:16:46.303917+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:39:35.917858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.348031+0000","last_change":"2023-10-03T19:16:46.346859+0000","last_active":"2023-10-03T19:16:46.348031+0000","last_peered":"2023-10-03T19:16:46.348031+0000","last_clean":"2023-10-03T19:16:46.348031+0000","last_became_active":"2023-10-03T19:16:46.346492+0000","last_became_peered":"2023-10-03T19:16:46.346492+0000","last_unstale":"2023-10-03T19:16:46.348031+0000","last_undegraded":"2023-10-03T19:16:46.348031+0000","last_fullsized":"2023-10-03T19:16:46.348031+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:59:33.879590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.303995+0000","last_change":"2023-10-03T19:16:45.947189+0000","last_active":"2023-10-03T19:16:46.303995+0000","last_peered":"2023-10-03T19:16:46.303995+0000","last_clean":"2023-10-03T19:16:46.303995+0000","last_became_active":"2023-10-03T19:16:45.946936+0000","last_became_peered":"2023-10-03T19:16:45.946936+0000","last_unstale":"2023-10-03T19:16:46.303995+0000","last_undegraded":"2023-10-03T19:16:46.303995+0000","last_fullsized":"2023-10-03T19:16:46.303995+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:14:23.283654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.379044+0000","last_change":"2023-10-03T19:16:46.365932+0000","last_active":"2023-10-03T19:16:46.379044+0000","last_peered":"2023-10-03T19:16:46.379044+0000","last_clean":"2023-10-03T19:16:46.379044+0000","last_became_active":"2023-10-03T19:16:46.362477+0000","last_became_peered":"2023-10-03T19:16:46.362477+0000","last_unstale":"2023-10-03T19:16:46.379044+0000","last_undegraded":"2023-10-03T19:16:46.379044+0000","last_fullsized":"2023-10-03T19:16:46.379044+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:47:38.571281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.303786+0000","last_change":"2023-10-03T19:16:45.963852+0000","last_active":"2023-10-03T19:16:46.303786+0000","last_peered":"2023-10-03T19:16:46.303786+0000","last_clean":"2023-10-03T19:16:46.303786+0000","last_became_active":"2023-10-03T19:16:45.963421+0000","last_became_peered":"2023-10-03T19:16:45.963421+0000","last_unstale":"2023-10-03T19:16:46.303786+0000","last_undegraded":"2023-10-03T19:16:46.303786+0000","last_fullsized":"2023-10-03T19:16:46.303786+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:40:17.427082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":3,"reported_epoch":60,"state":"creating+activating","last_fresh":"2023-10-03T19:16:46.303898+0000","last_change":"2023-10-03T19:16:46.303898+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:46.303898+0000","last_undegraded":"2023-10-03T19:16:46.303898+0000","last_fullsized":"2023-10-03T19:16:46.303898+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:54:01.595268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.338665+0000","last_change":"2023-10-03T19:16:45.985444+0000","last_active":"2023-10-03T19:16:46.338665+0000","last_peered":"2023-10-03T19:16:46.338665+0000","last_clean":"2023-10-03T19:16:46.338665+0000","last_became_active":"2023-10-03T19:16:45.984784+0000","last_became_peered":"2023-10-03T19:16:45.984784+0000","last_unstale":"2023-10-03T19:16:46.338665+0000","last_undegraded":"2023-10-03T19:16:46.338665+0000","last_fullsized":"2023-10-03T19:16:46.338665+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:55:43.921541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.319823+0000","last_change":"2023-10-03T19:16:46.317689+0000","last_active":"2023-10-03T19:16:46.319823+0000","last_peered":"2023-10-03T19:16:46.319823+0000","last_clean":"2023-10-03T19:16:46.319823+0000","last_became_active":"2023-10-03T19:16:46.317385+0000","last_became_peered":"2023-10-03T19:16:46.317385+0000","last_unstale":"2023-10-03T19:16:46.319823+0000","last_undegraded":"2023-10-03T19:16:46.319823+0000","last_fullsized":"2023-10-03T19:16:46.319823+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:13:34.942009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.334840+0000","last_change":"2023-10-03T19:16:45.986113+0000","last_active":"2023-10-03T19:16:46.334840+0000","last_peered":"2023-10-03T19:16:46.334840+0000","last_clean":"2023-10-03T19:16:46.334840+0000","last_became_active":"2023-10-03T19:16:45.985260+0000","last_became_peered":"2023-10-03T19:16:45.985260+0000","last_unstale":"2023-10-03T19:16:46.334840+0000","last_undegraded":"2023-10-03T19:16:46.334840+0000","last_fullsized":"2023-10-03T19:16:46.334840+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:50:36.723051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":3,"reported_epoch":60,"state":"creating+activating","last_fresh":"2023-10-03T19:16:46.303808+0000","last_change":"2023-10-03T19:16:46.303808+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:46.303808+0000","last_undegraded":"2023-10-03T19:16:46.303808+0000","last_fullsized":"2023-10-03T19:16:46.303808+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:13:34.942009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.319272+0000","last_change":"2023-10-03T19:16:45.963314+0000","last_active":"2023-10-03T19:16:46.319272+0000","last_peered":"2023-10-03T19:16:46.319272+0000","last_clean":"2023-10-03T19:16:46.319272+0000","last_became_active":"2023-10-03T19:16:45.962565+0000","last_became_peered":"2023-10-03T19:16:45.962565+0000","last_unstale":"2023-10-03T19:16:46.319272+0000","last_undegraded":"2023-10-03T19:16:46.319272+0000","last_fullsized":"2023-10-03T19:16:46.319272+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:38:40.745903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.382640+0000","last_change":"2023-10-03T19:16:46.369750+0000","last_active":"2023-10-03T19:16:46.382640+0000","last_peered":"2023-10-03T19:16:46.382640+0000","last_clean":"2023-10-03T19:16:46.382640+0000","last_became_active":"2023-10-03T19:16:46.368994+0000","last_became_peered":"2023-10-03T19:16:46.368994+0000","last_unstale":"2023-10-03T19:16:46.382640+0000","last_undegraded":"2023-10-03T19:16:46.382640+0000","last_fullsized":"2023-10-03T19:16:46.382640+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:39:42.294017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"60'3","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.372238+0000","last_change":"2023-10-03T19:16:45.986493+0000","last_active":"2023-10-03T19:16:46.372238+0000","last_peered":"2023-10-03T19:16:46.372238+0000","last_clean":"2023-10-03T19:16:46.372238+0000","last_became_active":"2023-10-03T19:16:45.985657+0000","last_became_peered":"2023-10-03T19:16:45.985657+0000","last_unstale":"2023-10-03T19:16:46.372238+0000","last_undegraded":"2023-10-03T19:16:46.372238+0000","last_fullsized":"2023-10-03T19:16:46.372238+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:17:49.085309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.373559+0000","last_change":"2023-10-03T19:16:46.349205+0000","last_active":"2023-10-03T19:16:46.373559+0000","last_peered":"2023-10-03T19:16:46.373559+0000","last_clean":"2023-10-03T19:16:46.373559+0000","last_became_active":"2023-10-03T19:16:46.348690+0000","last_became_peered":"2023-10-03T19:16:46.348690+0000","last_unstale":"2023-10-03T19:16:46.373559+0000","last_undegraded":"2023-10-03T19:16:46.373559+0000","last_fullsized":"2023-10-03T19:16:46.373559+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:26:38.764887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"60'6","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.377937+0000","last_change":"2023-10-03T19:16:45.967950+0000","last_active":"2023-10-03T19:16:46.377937+0000","last_peered":"2023-10-03T19:16:46.377937+0000","last_clean":"2023-10-03T19:16:46.377937+0000","last_became_active":"2023-10-03T19:16:45.967600+0000","last_became_peered":"2023-10-03T19:16:45.967600+0000","last_unstale":"2023-10-03T19:16:46.377937+0000","last_undegraded":"2023-10-03T19:16:46.377937+0000","last_fullsized":"2023-10-03T19:16:46.377937+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:20:31.279031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.376767+0000","last_change":"2023-10-03T19:16:46.356075+0000","last_active":"2023-10-03T19:16:46.376767+0000","last_peered":"2023-10-03T19:16:46.376767+0000","last_clean":"2023-10-03T19:16:46.376767+0000","last_became_active":"2023-10-03T19:16:46.355562+0000","last_became_peered":"2023-10-03T19:16:46.355562+0000","last_unstale":"2023-10-03T19:16:46.376767+0000","last_undegraded":"2023-10-03T19:16:46.376767+0000","last_fullsized":"2023-10-03T19:16:46.376767+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:47:38.571281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"60'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.373230+0000","last_change":"2023-10-03T19:16:45.987343+0000","last_active":"2023-10-03T19:16:46.373230+0000","last_peered":"2023-10-03T19:16:46.373230+0000","last_clean":"2023-10-03T19:16:46.373230+0000","last_became_active":"2023-10-03T19:16:45.986702+0000","last_became_peered":"2023-10-03T19:16:45.986702+0000","last_unstale":"2023-10-03T19:16:46.373230+0000","last_undegraded":"2023-10-03T19:16:46.373230+0000","last_fullsized":"2023-10-03T19:16:46.373230+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:12:08.318383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.382779+0000","last_change":"2023-10-03T19:16:46.376007+0000","last_active":"2023-10-03T19:16:46.382779+0000","last_peered":"2023-10-03T19:16:46.382779+0000","last_clean":"2023-10-03T19:16:46.382779+0000","last_became_active":"2023-10-03T19:16:46.375324+0000","last_became_peered":"2023-10-03T19:16:46.375324+0000","last_unstale":"2023-10-03T19:16:46.382779+0000","last_undegraded":"2023-10-03T19:16:46.382779+0000","last_fullsized":"2023-10-03T19:16:46.382779+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:26:38.764887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.330299+0000","last_change":"2023-10-03T19:16:45.987260+0000","last_active":"2023-10-03T19:16:46.330299+0000","last_peered":"2023-10-03T19:16:46.330299+0000","last_clean":"2023-10-03T19:16:46.330299+0000","last_became_active":"2023-10-03T19:16:45.984760+0000","last_became_peered":"2023-10-03T19:16:45.984760+0000","last_unstale":"2023-10-03T19:16:46.330299+0000","last_undegraded":"2023-10-03T19:16:46.330299+0000","last_fullsized":"2023-10-03T19:16:46.330299+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:07:06.884577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.344612+0000","last_change":"2023-10-03T19:16:46.343379+0000","last_active":"2023-10-03T19:16:46.344612+0000","last_peered":"2023-10-03T19:16:46.344612+0000","last_clean":"2023-10-03T19:16:46.344612+0000","last_became_active":"2023-10-03T19:16:46.343101+0000","last_became_peered":"2023-10-03T19:16:46.343101+0000","last_unstale":"2023-10-03T19:16:46.344612+0000","last_undegraded":"2023-10-03T19:16:46.344612+0000","last_fullsized":"2023-10-03T19:16:46.344612+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:27:11.167546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"60'8","reported_seq":19,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.379864+0000","last_change":"2023-10-03T19:16:45.985749+0000","last_active":"2023-10-03T19:16:46.379864+0000","last_peered":"2023-10-03T19:16:46.379864+0000","last_clean":"2023-10-03T19:16:46.379864+0000","last_became_active":"2023-10-03T19:16:45.985075+0000","last_became_peered":"2023-10-03T19:16:45.985075+0000","last_unstale":"2023-10-03T19:16:46.379864+0000","last_undegraded":"2023-10-03T19:16:46.379864+0000","last_fullsized":"2023-10-03T19:16:46.379864+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:11:47.385670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.319948+0000","last_change":"2023-10-03T19:16:46.315032+0000","last_active":"2023-10-03T19:16:46.319948+0000","last_peered":"2023-10-03T19:16:46.319948+0000","last_clean":"2023-10-03T19:16:46.319948+0000","last_became_active":"2023-10-03T19:16:46.314754+0000","last_became_peered":"2023-10-03T19:16:46.314754+0000","last_unstale":"2023-10-03T19:16:46.319948+0000","last_undegraded":"2023-10-03T19:16:46.319948+0000","last_fullsized":"2023-10-03T19:16:46.319948+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:29:49.777567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.382604+0000","last_change":"2023-10-03T19:16:46.368611+0000","last_active":"2023-10-03T19:16:46.382604+0000","last_peered":"2023-10-03T19:16:46.382604+0000","last_clean":"2023-10-03T19:16:46.382604+0000","last_became_active":"2023-10-03T19:16:46.367938+0000","last_became_peered":"2023-10-03T19:16:46.367938+0000","last_unstale":"2023-10-03T19:16:46.382604+0000","last_undegraded":"2023-10-03T19:16:46.382604+0000","last_fullsized":"2023-10-03T19:16:46.382604+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:52:34.746547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.313791+0000","last_change":"2023-10-03T19:16:45.967954+0000","last_active":"2023-10-03T19:16:46.313791+0000","last_peered":"2023-10-03T19:16:46.313791+0000","last_clean":"2023-10-03T19:16:46.313791+0000","last_became_active":"2023-10-03T19:16:45.967581+0000","last_became_peered":"2023-10-03T19:16:45.967581+0000","last_unstale":"2023-10-03T19:16:46.313791+0000","last_undegraded":"2023-10-03T19:16:46.313791+0000","last_fullsized":"2023-10-03T19:16:46.313791+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:45:37.045472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.378791+0000","last_change":"2023-10-03T19:16:46.362149+0000","last_active":"2023-10-03T19:16:46.378791+0000","last_peered":"2023-10-03T19:16:46.378791+0000","last_clean":"2023-10-03T19:16:46.378791+0000","last_became_active":"2023-10-03T19:16:46.361627+0000","last_became_peered":"2023-10-03T19:16:46.361627+0000","last_unstale":"2023-10-03T19:16:46.378791+0000","last_undegraded":"2023-10-03T19:16:46.378791+0000","last_fullsized":"2023-10-03T19:16:46.378791+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:28:53.885325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.333806+0000","last_change":"2023-10-03T19:16:45.986852+0000","last_active":"2023-10-03T19:16:46.333806+0000","last_peered":"2023-10-03T19:16:46.333806+0000","last_clean":"2023-10-03T19:16:46.333806+0000","last_became_active":"2023-10-03T19:16:45.985615+0000","last_became_peered":"2023-10-03T19:16:45.985615+0000","last_unstale":"2023-10-03T19:16:46.333806+0000","last_undegraded":"2023-10-03T19:16:46.333806+0000","last_fullsized":"2023-10-03T19:16:46.333806+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:31:27.554913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.374699+0000","last_change":"2023-10-03T19:16:46.355632+0000","last_active":"2023-10-03T19:16:46.374699+0000","last_peered":"2023-10-03T19:16:46.374699+0000","last_clean":"2023-10-03T19:16:46.374699+0000","last_became_active":"2023-10-03T19:16:46.355020+0000","last_became_peered":"2023-10-03T19:16:46.355020+0000","last_unstale":"2023-10-03T19:16:46.374699+0000","last_undegraded":"2023-10-03T19:16:46.374699+0000","last_fullsized":"2023-10-03T19:16:46.374699+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:52:34.746547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.304143+0000","last_change":"2023-10-03T19:16:45.944273+0000","last_active":"2023-10-03T19:16:46.304143+0000","last_peered":"2023-10-03T19:16:46.304143+0000","last_clean":"2023-10-03T19:16:46.304143+0000","last_became_active":"2023-10-03T19:16:45.943995+0000","last_became_peered":"2023-10-03T19:16:45.943995+0000","last_unstale":"2023-10-03T19:16:46.304143+0000","last_undegraded":"2023-10-03T19:16:46.304143+0000","last_fullsized":"2023-10-03T19:16:46.304143+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:56:23.017353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.343879+0000","last_change":"2023-10-03T19:16:46.342684+0000","last_active":"2023-10-03T19:16:46.343879+0000","last_peered":"2023-10-03T19:16:46.343879+0000","last_clean":"2023-10-03T19:16:46.343879+0000","last_became_active":"2023-10-03T19:16:46.342293+0000","last_became_peered":"2023-10-03T19:16:46.342293+0000","last_unstale":"2023-10-03T19:16:46.343879+0000","last_undegraded":"2023-10-03T19:16:46.343879+0000","last_fullsized":"2023-10-03T19:16:46.343879+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:14:24.294462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.303651+0000","last_change":"2023-10-03T19:16:45.964339+0000","last_active":"2023-10-03T19:16:46.303651+0000","last_peered":"2023-10-03T19:16:46.303651+0000","last_clean":"2023-10-03T19:16:46.303651+0000","last_became_active":"2023-10-03T19:16:45.963814+0000","last_became_peered":"2023-10-03T19:16:45.963814+0000","last_unstale":"2023-10-03T19:16:46.303651+0000","last_undegraded":"2023-10-03T19:16:46.303651+0000","last_fullsized":"2023-10-03T19:16:46.303651+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:34:29.129059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.355035+0000","last_change":"2023-10-03T19:16:46.354068+0000","last_active":"2023-10-03T19:16:46.355035+0000","last_peered":"2023-10-03T19:16:46.355035+0000","last_clean":"2023-10-03T19:16:46.355035+0000","last_became_active":"2023-10-03T19:16:46.353774+0000","last_became_peered":"2023-10-03T19:16:46.353774+0000","last_unstale":"2023-10-03T19:16:46.355035+0000","last_undegraded":"2023-10-03T19:16:46.355035+0000","last_fullsized":"2023-10-03T19:16:46.355035+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:10:40.127195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.312472+0000","last_change":"2023-10-03T19:16:45.972785+0000","last_active":"2023-10-03T19:16:46.312472+0000","last_peered":"2023-10-03T19:16:46.312472+0000","last_clean":"2023-10-03T19:16:46.312472+0000","last_became_active":"2023-10-03T19:16:45.972526+0000","last_became_peered":"2023-10-03T19:16:45.972526+0000","last_unstale":"2023-10-03T19:16:46.312472+0000","last_undegraded":"2023-10-03T19:16:46.312472+0000","last_fullsized":"2023-10-03T19:16:46.312472+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:56:23.017353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.382575+0000","last_change":"2023-10-03T19:16:46.368258+0000","last_active":"2023-10-03T19:16:46.382575+0000","last_peered":"2023-10-03T19:16:46.382575+0000","last_clean":"2023-10-03T19:16:46.382575+0000","last_became_active":"2023-10-03T19:16:46.367559+0000","last_became_peered":"2023-10-03T19:16:46.367559+0000","last_unstale":"2023-10-03T19:16:46.382575+0000","last_undegraded":"2023-10-03T19:16:46.382575+0000","last_fullsized":"2023-10-03T19:16:46.382575+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:42:11.101433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.303561+0000","last_change":"2023-10-03T19:16:45.940912+0000","last_active":"2023-10-03T19:16:46.303561+0000","last_peered":"2023-10-03T19:16:46.303561+0000","last_clean":"2023-10-03T19:16:46.303561+0000","last_became_active":"2023-10-03T19:16:45.940610+0000","last_became_peered":"2023-10-03T19:16:45.940610+0000","last_unstale":"2023-10-03T19:16:46.303561+0000","last_undegraded":"2023-10-03T19:16:46.303561+0000","last_fullsized":"2023-10-03T19:16:46.303561+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:59:41.638843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":243,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.328586+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:16:46.328586+0000","last_peered":"2023-10-03T19:16:46.328586+0000","last_clean":"2023-10-03T19:16:46.328586+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:16:46.328586+0000","last_undegraded":"2023-10-03T19:16:46.328586+0000","last_fullsized":"2023-10-03T19:16:46.328586+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:11:26.721249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":85,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-03T19:16:41.636037+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:16:41.636037+0000","last_peered":"2023-10-03T19:16:41.636037+0000","last_clean":"2023-10-03T19:16:41.636037+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:16:41.636037+0000","last_undegraded":"2023-10-03T19:16:41.636037+0000","last_fullsized":"2023-10-03T19:16:41.636037+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:56:34.954100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":91,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.328210+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:16:46.328210+0000","last_peered":"2023-10-03T19:16:46.328210+0000","last_clean":"2023-10-03T19:16:46.328210+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:16:46.328210+0000","last_undegraded":"2023-10-03T19:16:46.328210+0000","last_fullsized":"2023-10-03T19:16:46.328210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:55:03.497461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:45.921406+0000","last_change":"2023-10-03T19:16:45.921406+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:45.921406+0000","last_undegraded":"2023-10-03T19:16:45.921406+0000","last_fullsized":"2023-10-03T19:16:45.921406+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":89,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.308380+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:16:46.308380+0000","last_peered":"2023-10-03T19:16:46.308380+0000","last_clean":"2023-10-03T19:16:46.308380+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:16:46.308380+0000","last_undegraded":"2023-10-03T19:16:46.308380+0000","last_fullsized":"2023-10-03T19:16:46.308380+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:21:56.372171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.378783+0000","last_change":"2023-10-03T19:16:46.362051+0000","last_active":"2023-10-03T19:16:46.378783+0000","last_peered":"2023-10-03T19:16:46.378783+0000","last_clean":"2023-10-03T19:16:46.378783+0000","last_became_active":"2023-10-03T19:16:46.361490+0000","last_became_peered":"2023-10-03T19:16:46.361490+0000","last_unstale":"2023-10-03T19:16:46.378783+0000","last_undegraded":"2023-10-03T19:16:46.378783+0000","last_fullsized":"2023-10-03T19:16:46.378783+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:18:58.638268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":85,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-03T19:16:41.636026+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:16:41.636026+0000","last_peered":"2023-10-03T19:16:41.636026+0000","last_clean":"2023-10-03T19:16:41.636026+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:16:41.636026+0000","last_undegraded":"2023-10-03T19:16:41.636026+0000","last_fullsized":"2023-10-03T19:16:41.636026+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:22:01.296400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381693+0000","last_change":"2023-10-03T19:16:46.369329+0000","last_active":"2023-10-03T19:16:46.381693+0000","last_peered":"2023-10-03T19:16:46.381693+0000","last_clean":"2023-10-03T19:16:46.381693+0000","last_became_active":"2023-10-03T19:16:46.368233+0000","last_became_peered":"2023-10-03T19:16:46.368233+0000","last_unstale":"2023-10-03T19:16:46.381693+0000","last_undegraded":"2023-10-03T19:16:46.381693+0000","last_fullsized":"2023-10-03T19:16:46.381693+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:47:11.516626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:16:44.910598+0000","last_change":"2023-10-03T19:16:44.910598+0000","last_active":"2023-10-03T19:16:44.910598+0000","last_peered":"2023-10-03T19:16:44.910598+0000","last_clean":"2023-10-03T19:16:44.910598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:44.910598+0000","last_undegraded":"2023-10-03T19:16:44.910598+0000","last_fullsized":"2023-10-03T19:16:44.910598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":89,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.316693+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:16:46.316693+0000","last_peered":"2023-10-03T19:16:46.316693+0000","last_clean":"2023-10-03T19:16:46.316693+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:16:46.316693+0000","last_undegraded":"2023-10-03T19:16:46.316693+0000","last_fullsized":"2023-10-03T19:16:46.316693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:50:43.182186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.382825+0000","last_change":"2023-10-03T19:16:46.377006+0000","last_active":"2023-10-03T19:16:46.382825+0000","last_peered":"2023-10-03T19:16:46.382825+0000","last_clean":"2023-10-03T19:16:46.382825+0000","last_became_active":"2023-10-03T19:16:46.376427+0000","last_became_peered":"2023-10-03T19:16:46.376427+0000","last_unstale":"2023-10-03T19:16:46.382825+0000","last_undegraded":"2023-10-03T19:16:46.382825+0000","last_fullsized":"2023-10-03T19:16:46.382825+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:17:09.475416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"60'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.369510+0000","last_change":"2023-10-03T19:16:45.986459+0000","last_active":"2023-10-03T19:16:46.369510+0000","last_peered":"2023-10-03T19:16:46.369510+0000","last_clean":"2023-10-03T19:16:46.369510+0000","last_became_active":"2023-10-03T19:16:45.984797+0000","last_became_peered":"2023-10-03T19:16:45.984797+0000","last_unstale":"2023-10-03T19:16:46.369510+0000","last_undegraded":"2023-10-03T19:16:46.369510+0000","last_fullsized":"2023-10-03T19:16:46.369510+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:43:20.530235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.335522+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:16:46.335522+0000","last_peered":"2023-10-03T19:16:46.335522+0000","last_clean":"2023-10-03T19:16:46.335522+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:16:46.335522+0000","last_undegraded":"2023-10-03T19:16:46.335522+0000","last_fullsized":"2023-10-03T19:16:46.335522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:21:36.226307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.380050+0000","last_change":"2023-10-03T19:16:46.370333+0000","last_active":"2023-10-03T19:16:46.380050+0000","last_peered":"2023-10-03T19:16:46.380050+0000","last_clean":"2023-10-03T19:16:46.380050+0000","last_became_active":"2023-10-03T19:16:46.369709+0000","last_became_peered":"2023-10-03T19:16:46.369709+0000","last_unstale":"2023-10-03T19:16:46.380050+0000","last_undegraded":"2023-10-03T19:16:46.380050+0000","last_fullsized":"2023-10-03T19:16:46.380050+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:55:44.932349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"60'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.372385+0000","last_change":"2023-10-03T19:16:45.985981+0000","last_active":"2023-10-03T19:16:46.372385+0000","last_peered":"2023-10-03T19:16:46.372385+0000","last_clean":"2023-10-03T19:16:46.372385+0000","last_became_active":"2023-10-03T19:16:45.984863+0000","last_became_peered":"2023-10-03T19:16:45.984863+0000","last_unstale":"2023-10-03T19:16:46.372385+0000","last_undegraded":"2023-10-03T19:16:46.372385+0000","last_fullsized":"2023-10-03T19:16:46.372385+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:48:25.164498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":89,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.313818+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:16:46.313818+0000","last_peered":"2023-10-03T19:16:46.313818+0000","last_clean":"2023-10-03T19:16:46.313818+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:16:46.313818+0000","last_undegraded":"2023-10-03T19:16:46.313818+0000","last_fullsized":"2023-10-03T19:16:46.313818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:38:39.207017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.378847+0000","last_change":"2023-10-03T19:16:46.362431+0000","last_active":"2023-10-03T19:16:46.378847+0000","last_peered":"2023-10-03T19:16:46.378847+0000","last_clean":"2023-10-03T19:16:46.378847+0000","last_became_active":"2023-10-03T19:16:46.361629+0000","last_became_peered":"2023-10-03T19:16:46.361629+0000","last_unstale":"2023-10-03T19:16:46.378847+0000","last_undegraded":"2023-10-03T19:16:46.378847+0000","last_fullsized":"2023-10-03T19:16:46.378847+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:05:01.669511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.304042+0000","last_change":"2023-10-03T19:16:45.967790+0000","last_active":"2023-10-03T19:16:46.304042+0000","last_peered":"2023-10-03T19:16:46.304042+0000","last_clean":"2023-10-03T19:16:46.304042+0000","last_became_active":"2023-10-03T19:16:45.967432+0000","last_became_peered":"2023-10-03T19:16:45.967432+0000","last_unstale":"2023-10-03T19:16:46.304042+0000","last_undegraded":"2023-10-03T19:16:46.304042+0000","last_fullsized":"2023-10-03T19:16:46.304042+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:27:10.156738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":89,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.351775+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:16:46.351775+0000","last_peered":"2023-10-03T19:16:46.351775+0000","last_clean":"2023-10-03T19:16:46.351775+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:16:46.351775+0000","last_undegraded":"2023-10-03T19:16:46.351775+0000","last_fullsized":"2023-10-03T19:16:46.351775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:34:18.140425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":98,"acting":98,"num_store_stats":6},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2340,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":42,"acting":42,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509496,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25616,"kb_used_data":776,"kb_used_omap":0,"kb_used_meta":24832,"kb_avail":94346224,"statfs":{"total":96636764160,"available":96610533376,"internally_reserved":0,"allocated":794624,"data_stored":906715,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":25427968},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.90900000000000003,"15min":0.94499999999999995},"min":{"1min":0.52000000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.196,"5min":4.0469999999999997,"15min":4.0469999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.85799999999999998,"15min":0.81200000000000006},"min":{"1min":0.625,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2310000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.62}]},{"osd":1,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94399999999999995,"15min":1.0269999999999999},"min":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3200000000000001,"5min":3.8239999999999998,"15min":3.8239999999999998},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.873,"5min":0.88300000000000001,"15min":0.85899999999999999},"min":{"1min":0.65800000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.159,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.96499999999999997}]},{"osd":2,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.93600000000000005,"15min":0.87},"min":{"1min":0.71499999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.212,"5min":6.0449999999999999,"15min":6.0449999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0029999999999999,"15min":1.04},"min":{"1min":0.77400000000000002,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.5800000000000001,"5min":3.98,"15min":3.98},"last":0.93200000000000005}]},{"osd":3,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.996,"15min":0.94399999999999995},"min":{"1min":0.65300000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.26,"5min":6.125,"15min":6.125},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0700000000000001,"15min":1.123},"min":{"1min":0.61899999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.444,"5min":3.9140000000000001,"15min":3.9140000000000001},"last":1.091}]},{"osd":4,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":1.036,"15min":1.1599999999999999},"min":{"1min":0.55900000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.421,"5min":5.1130000000000004,"15min":5.1130000000000004},"last":1.056},{"interface":"front","average":{"1min":0.92500000000000004,"5min":1.022,"15min":1.028},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.385,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":1.006}]},{"osd":5,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.135,"15min":1.268},"min":{"1min":0.72499999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.27,"5min":5.1859999999999999,"15min":5.1859999999999999},"last":1.1919999999999999},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0840000000000001,"15min":1.1459999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.216,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.163}]},{"osd":6,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0920000000000001,"15min":1.1000000000000001},"min":{"1min":0.78900000000000003,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.3440000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.179,"15min":1.1850000000000001},"min":{"1min":0.81799999999999995,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.466,"5min":6.1580000000000004,"15min":6.1580000000000004},"last":1.1359999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509496,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14784,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":14080,"kb_avail":94357056,"statfs":{"total":96636764160,"available":96621625344,"internally_reserved":0,"allocated":712704,"data_stored":314441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14417920},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83499999999999996,"15min":0.81899999999999995},"min":{"1min":0.60499999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.139,"5min":1.504,"15min":1.504},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.89900000000000002,"15min":0.88500000000000001},"min":{"1min":0.56699999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.171,"5min":1.839,"15min":1.839},"last":0.61199999999999999}]},{"osd":1,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.85699999999999998,"15min":0.84099999999999997},"min":{"1min":0.53100000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.1859999999999999,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89000000000000001,"15min":0.88},"min":{"1min":0.59799999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.127,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":1.004}]},{"osd":2,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.91700000000000004,"15min":0.874},"min":{"1min":0.65800000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3600000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.745},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.92100000000000004,"15min":0.92600000000000005},"min":{"1min":0.63200000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3200000000000001,"5min":1.546,"15min":1.546},"last":0.78900000000000003}]},{"osd":3,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.96599999999999997,"15min":0.98199999999999998},"min":{"1min":0.70799999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.91800000000000004,"15min":0.91200000000000003},"min":{"1min":0.69399999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1870000000000001,"5min":2.121,"15min":2.121},"last":0.83799999999999997}]},{"osd":4,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.97299999999999998,"15min":1.026},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.286,"5min":1.95,"15min":1.95},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0329999999999999,"15min":1.091},"min":{"1min":0.65500000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.429,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.0389999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.97199999999999998,"15min":1.0189999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.1259999999999999,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.079,"5min":1.0800000000000001,"15min":1.1200000000000001},"min":{"1min":0.75700000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.524,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.1140000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.093,"15min":1.121},"min":{"1min":0.73699999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.3220000000000001,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.137},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.071,"15min":1.097},"min":{"1min":0.79600000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4350000000000001,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.0800000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509497,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15564,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":14848,"kb_avail":94356276,"statfs":{"total":96636764160,"available":96620826624,"internally_reserved":0,"allocated":724992,"data_stored":317135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15204352},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.83499999999999996,"15min":0.79000000000000004},"min":{"1min":0.54700000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.87},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.83899999999999997,"15min":0.82499999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.026,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.78500000000000003}]},{"osd":1,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.92000000000000004,"15min":0.93200000000000005},"min":{"1min":0.61399999999999999,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.117,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.89700000000000002,"15min":0.86099999999999999},"min":{"1min":0.68799999999999994,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1799999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.72899999999999998}]},{"osd":2,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.93899999999999995,"15min":0.91700000000000004},"min":{"1min":0.56200000000000006,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2390000000000001,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.96599999999999997,"15min":0.94399999999999995},"min":{"1min":0.78300000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.1359999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":1.0940000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.89400000000000002,"15min":0.877},"min":{"1min":0.69199999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.153,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.996,"5min":1.0449999999999999,"15min":1.0649999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3400000000000001,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":1.155}]},{"osd":5,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.99099999999999999,"15min":1.05},"min":{"1min":0.67100000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1819999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.022},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.98099999999999998,"15min":1.0109999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.387,"5min":1.635,"15min":1.635},"last":1.0569999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.0780000000000001,"15min":1.1839999999999999},"min":{"1min":0.71499999999999997,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.1120000000000001,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.1120000000000001,"15min":1.181},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.3640000000000001,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":1.276}]},{"osd":7,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0509999999999999,"15min":1.085},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.242,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.212},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.1759999999999999,"15min":1.2250000000000001},"min":{"1min":0.85599999999999998,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3260000000000001,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":1.52}]}]},{"osd":2,"up_from":15,"seq":64424509497,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25660,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":24960,"kb_avail":94346180,"statfs":{"total":96636764160,"available":96610488320,"internally_reserved":0,"allocated":708608,"data_stored":314407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25559040},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.60399999999999998,"15min":0.54100000000000004},"min":{"1min":0.47099999999999997,"5min":0.247,"15min":0.247},"max":{"1min":1.1020000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.69599999999999995,"15min":0.63},"min":{"1min":0.30299999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.2350000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.65400000000000003}]},{"osd":1,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71299999999999997,"15min":0.63300000000000001},"min":{"1min":0.48599999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1739999999999999,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.67400000000000004,"15min":0.60399999999999998},"min":{"1min":0.42599999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.76700000000000002}]},{"osd":3,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.71499999999999997,"15min":0.63700000000000001},"min":{"1min":0.40500000000000003,"5min":0.224,"15min":0.224},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.82199999999999995,"15min":0.73599999999999999},"min":{"1min":0.44600000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1419999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.91600000000000004}]},{"osd":4,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.91800000000000004,"15min":0.85799999999999998},"min":{"1min":0.63,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":1.274},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.98599999999999999,"15min":0.92400000000000004},"min":{"1min":0.71499999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":1.0149999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.94999999999999996,"15min":0.876},"min":{"1min":0.76600000000000001,"5min":0.432,"15min":0.432},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0249999999999999,"15min":0.95099999999999996},"min":{"1min":0.68100000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4239999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.0740000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.96399999999999997,"15min":0.92200000000000004},"min":{"1min":0.66300000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.302},{"interface":"front","average":{"1min":1.139,"5min":1.0409999999999999,"15min":0.97699999999999998},"min":{"1min":0.64800000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":1.3839999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.0920000000000001,"15min":1.0169999999999999},"min":{"1min":0.74199999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":1.117},{"interface":"front","average":{"1min":1.109,"5min":1.024,"15min":0.96799999999999997},"min":{"1min":0.71099999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.361}]}]},{"osd":1,"up_from":15,"seq":64424509496,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14876,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":14144,"kb_avail":94356964,"statfs":{"total":96636764160,"available":96621531136,"internally_reserved":0,"allocated":741376,"data_stored":317899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14483456},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58499999999999996,"15min":0.54800000000000004},"min":{"1min":0.35899999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.96899999999999997,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.628,"15min":0.52400000000000002},"min":{"1min":0.45200000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.93200000000000005}]},{"osd":2,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.63600000000000001,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.75800000000000001,"15min":0.67500000000000004},"min":{"1min":0.44700000000000001,"5min":0.312,"15min":0.312},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.99199999999999999}]},{"osd":3,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.72499999999999998,"15min":0.64300000000000002},"min":{"1min":0.41699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.2370000000000001,"5min":1.27,"15min":1.27},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.69699999999999995,"15min":0.59699999999999998},"min":{"1min":0.47699999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1830000000000001,"5min":1.27,"15min":1.27},"last":0.66400000000000003}]},{"osd":4,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.86199999999999999,"15min":0.80700000000000005},"min":{"1min":0.69099999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.073},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.93799999999999994,"15min":0.89400000000000002},"min":{"1min":0.65900000000000003,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.2430000000000001}]},{"osd":5,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.94299999999999995,"15min":0.86799999999999999},"min":{"1min":0.69899999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":1.038},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.92000000000000004,"15min":0.85899999999999999},"min":{"1min":0.80700000000000005,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3959999999999999,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.2150000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.99399999999999999,"15min":0.93000000000000005},"min":{"1min":0.68999999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":0.97999999999999998,"15min":0.90400000000000003},"min":{"1min":0.879,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.329,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.1140000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0269999999999999,"15min":0.94799999999999995},"min":{"1min":0.78500000000000003,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.99299999999999999,"15min":0.91100000000000003},"min":{"1min":0.71899999999999997,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5880000000000001,"5min":1.649,"15min":1.649},"last":1.288}]}]},{"osd":3,"up_from":14,"seq":60129542200,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33896,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":33216,"kb_avail":94337944,"statfs":{"total":96636764160,"available":96602054656,"internally_reserved":0,"allocated":688128,"data_stored":301823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":34013184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.627,"15min":0.57699999999999996},"min":{"1min":0.40200000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.2090000000000001,"5min":1.212,"15min":1.212},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68700000000000006,"15min":0.64800000000000002},"min":{"1min":0.32900000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.125,"5min":1.236,"15min":1.236},"last":0.57699999999999996}]},{"osd":1,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.69399999999999995,"15min":0.63700000000000001},"min":{"1min":0.51400000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0589999999999999,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.73599999999999999,"15min":0.67300000000000004},"min":{"1min":0.53000000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.2210000000000001,"5min":1.222,"15min":1.222},"last":0.70099999999999996}]},{"osd":2,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.77600000000000002,"15min":0.71599999999999997},"min":{"1min":0.44600000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.083,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.70999999999999996,"15min":0.63700000000000001},"min":{"1min":0.432,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.89400000000000002}]},{"osd":4,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.94299999999999995,"15min":0.91500000000000004},"min":{"1min":0.58899999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.131,"5min":1.496,"15min":1.496},"last":0.876},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.97799999999999998,"15min":0.93799999999999994},"min":{"1min":0.64100000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.486,"5min":1.546,"15min":1.546},"last":1.175}]},{"osd":5,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.91800000000000004,"15min":0.88200000000000001},"min":{"1min":0.68300000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3280000000000001,"5min":1.51,"15min":1.51},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.044,"5min":1.0249999999999999,"15min":1},"min":{"1min":0.66300000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.387,"5min":1.498,"15min":1.498},"last":0.84799999999999998}]},{"osd":6,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.95999999999999996,"15min":0.92400000000000004},"min":{"1min":0.60899999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1639999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.212},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.042,"15min":0.99299999999999999},"min":{"1min":0.70299999999999996,"5min":0.625,"15min":0.625},"max":{"1min":1.2969999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.0780000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0489999999999999,"15min":1.0089999999999999},"min":{"1min":0.68899999999999995,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.395,"5min":1.597,"15min":1.597},"last":1.026},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.0700000000000001,"15min":1.024},"min":{"1min":0.72699999999999998,"5min":0.623,"15min":0.623},"max":{"1min":1.6040000000000001,"5min":1.708,"15min":1.708},"last":1.1539999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16092,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":15424,"kb_avail":94355748,"statfs":{"total":96636764160,"available":96620285952,"internally_reserved":0,"allocated":675840,"data_stored":295653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15794176},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.85699999999999998,"15min":0.82599999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.1919999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85899999999999999,"15min":0.85299999999999998},"min":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.81000000000000005}]},{"osd":1,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.85299999999999998,"15min":0.83399999999999996},"min":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0920000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.873,"5min":0.91900000000000004,"15min":0.92500000000000004},"min":{"1min":0.59799999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.149,"5min":1.514,"15min":1.514},"last":1.133}]},{"osd":2,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.90800000000000003,"15min":0.89800000000000002},"min":{"1min":0.56299999999999994,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.234,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":1.101},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.90700000000000003,"15min":0.89700000000000002},"min":{"1min":0.66100000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1499999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.95499999999999996}]},{"osd":3,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.93200000000000005,"15min":0.92800000000000005},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.2629999999999999,"5min":1.304,"15min":1.304},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0369999999999999,"15min":1.0289999999999999},"min":{"1min":0.75,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.1679999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.96499999999999997,"15min":0.96899999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.29,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.995,"15min":1.0309999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.222,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.67300000000000004}]},{"osd":6,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.98899999999999999,"15min":1.0309999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2050000000000001,"5min":1.462,"15min":1.462},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.083,"5min":1.1200000000000001,"15min":1.1379999999999999},"min":{"1min":0.78200000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.3759999999999999,"5min":1.823,"15min":1.823},"last":0.91400000000000003}]},{"osd":7,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.0640000000000001,"15min":1.0760000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3280000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.05},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.141,"15min":1.1519999999999999},"min":{"1min":0.79100000000000004,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.399,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.87}]}]},{"osd":0,"up_from":13,"seq":55834574904,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21592,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":20864,"kb_avail":94350248,"statfs":{"total":96636764160,"available":96614653952,"internally_reserved":0,"allocated":737280,"data_stored":884857,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":21364736},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63100000000000001,"15min":0.58599999999999997},"min":{"1min":0.44400000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.75600000000000001,"15min":0.71899999999999997},"min":{"1min":0.5,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.1970000000000001,"5min":1.27,"15min":1.27},"last":0.752}]},{"osd":2,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.73799999999999999,"15min":0.71799999999999997},"min":{"1min":0.50800000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1299999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.3080000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.46800000000000003,"5min":0.315,"15min":0.315},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.68100000000000005}]},{"osd":3,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.82099999999999995,"15min":0.73699999999999999},"min":{"1min":0.59299999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.202,"5min":1.446,"15min":1.446},"last":1.163},{"interface":"front","average":{"1min":0.87,"5min":0.80000000000000004,"15min":0.70999999999999996},"min":{"1min":0.51000000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.304,"5min":1.375,"15min":1.375},"last":0.99299999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.93000000000000005,"15min":0.91200000000000003},"min":{"1min":0.70299999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.052,"15min":1.028},"min":{"1min":0.89200000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.349,"5min":1.508,"15min":1.508},"last":1.371}]},{"osd":5,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.073,"15min":1.0509999999999999},"min":{"1min":0.90400000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3129999999999999,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.0209999999999999,"15min":0.98199999999999998},"min":{"1min":0.77100000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.3959999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.0600000000000001,"15min":1.022},"min":{"1min":0.81200000000000006,"5min":0.623,"15min":0.623},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.04,"15min":0.999},"min":{"1min":0.755,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.448,"5min":1.637,"15min":1.637},"last":1.2170000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.0860000000000001,"15min":1.042},"min":{"1min":0.72799999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.488},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.089,"15min":1.0629999999999999},"min":{"1min":0.76300000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5940000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.091}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:16:50.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3a is not active+clean 2023-10-03T19:16:50.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T19:16:45.921406+0000', 'last_change': '2023-10-03T19:16:45.921406+0000', 'last_active': '2023-10-03T19:16:45.921406+0000', 'last_peered': '2023-10-03T19:16:45.921406+0000', 'last_clean': '2023-10-03T19:16:45.921406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:45.921406+0000', 'last_undegraded': '2023-10-03T19:16:45.921406+0000', 'last_fullsized': '2023-10-03T19:16:45.921406+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T19:16:50.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.38 is not active+clean 2023-10-03T19:16:50.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T19:16:45.921406+0000', 'last_change': '2023-10-03T19:16:45.921406+0000', 'last_active': '2023-10-03T19:16:45.921406+0000', 'last_peered': '2023-10-03T19:16:45.921406+0000', 'last_clean': '2023-10-03T19:16:45.921406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:45.921406+0000', 'last_undegraded': '2023-10-03T19:16:45.921406+0000', 'last_fullsized': '2023-10-03T19:16:45.921406+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T19:16:50.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.34 is not active+clean 2023-10-03T19:16:50.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T19:16:45.921406+0000', 'last_change': '2023-10-03T19:16:45.921406+0000', 'last_active': '2023-10-03T19:16:45.921406+0000', 'last_peered': '2023-10-03T19:16:45.921406+0000', 'last_clean': '2023-10-03T19:16:45.921406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:45.921406+0000', 'last_undegraded': '2023-10-03T19:16:45.921406+0000', 'last_fullsized': '2023-10-03T19:16:45.921406+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T19:16:50.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.33 is not active+clean 2023-10-03T19:16:50.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T19:16:45.921406+0000', 'last_change': '2023-10-03T19:16:45.921406+0000', 'last_active': '2023-10-03T19:16:45.921406+0000', 'last_peered': '2023-10-03T19:16:45.921406+0000', 'last_clean': '2023-10-03T19:16:45.921406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:45.921406+0000', 'last_undegraded': '2023-10-03T19:16:45.921406+0000', 'last_fullsized': '2023-10-03T19:16:45.921406+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T19:16:50.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2c is not active+clean 2023-10-03T19:16:50.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2c', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 60, 'state': 'creating+activating', 'last_fresh': '2023-10-03T19:16:46.303990+0000', 'last_change': '2023-10-03T19:16:46.303990+0000', 'last_active': '2023-10-03T19:16:45.921406+0000', 'last_peered': '2023-10-03T19:16:45.921406+0000', 'last_clean': '2023-10-03T19:16:45.921406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:46.303990+0000', 'last_undegraded': '2023-10-03T19:16:46.303990+0000', 'last_fullsized': '2023-10-03T19:16:46.303990+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-04T20:04:47.708070+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': ['3', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:16:50.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2b is not active+clean 2023-10-03T19:16:50.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T19:16:45.921406+0000', 'last_change': '2023-10-03T19:16:45.921406+0000', 'last_active': '2023-10-03T19:16:45.921406+0000', 'last_peered': '2023-10-03T19:16:45.921406+0000', 'last_clean': '2023-10-03T19:16:45.921406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:45.921406+0000', 'last_undegraded': '2023-10-03T19:16:45.921406+0000', 'last_fullsized': '2023-10-03T19:16:45.921406+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T19:16:50.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2a is not active+clean 2023-10-03T19:16:50.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2a', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 60, 'state': 'creating+activating', 'last_fresh': '2023-10-03T19:16:46.304321+0000', 'last_change': '2023-10-03T19:16:46.304321+0000', 'last_active': '2023-10-03T19:16:45.921406+0000', 'last_peered': '2023-10-03T19:16:45.921406+0000', 'last_clean': '2023-10-03T19:16:45.921406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:46.304321+0000', 'last_undegraded': '2023-10-03T19:16:46.304321+0000', 'last_fullsized': '2023-10-03T19:16:46.304321+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-04T23:59:33.879590+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': ['3', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:16:50.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.29 is not active+clean 2023-10-03T19:16:50.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.29', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 60, 'state': 'creating+activating', 'last_fresh': '2023-10-03T19:16:46.303772+0000', 'last_change': '2023-10-03T19:16:46.303772+0000', 'last_active': '2023-10-03T19:16:45.921406+0000', 'last_peered': '2023-10-03T19:16:45.921406+0000', 'last_clean': '2023-10-03T19:16:45.921406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:46.303772+0000', 'last_undegraded': '2023-10-03T19:16:46.303772+0000', 'last_fullsized': '2023-10-03T19:16:46.303772+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-04T21:35:51.612936+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': ['3', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:16:50.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.27 is not active+clean 2023-10-03T19:16:50.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T19:16:45.921406+0000', 'last_change': '2023-10-03T19:16:45.921406+0000', 'last_active': '2023-10-03T19:16:45.921406+0000', 'last_peered': '2023-10-03T19:16:45.921406+0000', 'last_clean': '2023-10-03T19:16:45.921406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:45.921406+0000', 'last_undegraded': '2023-10-03T19:16:45.921406+0000', 'last_fullsized': '2023-10-03T19:16:45.921406+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T19:16:50.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.26 is not active+clean 2023-10-03T19:16:50.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T19:16:45.921406+0000', 'last_change': '2023-10-03T19:16:45.921406+0000', 'last_active': '2023-10-03T19:16:45.921406+0000', 'last_peered': '2023-10-03T19:16:45.921406+0000', 'last_clean': '2023-10-03T19:16:45.921406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:45.921406+0000', 'last_undegraded': '2023-10-03T19:16:45.921406+0000', 'last_fullsized': '2023-10-03T19:16:45.921406+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T19:16:50.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.22 is not active+clean 2023-10-03T19:16:50.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T19:16:45.921406+0000', 'last_change': '2023-10-03T19:16:45.921406+0000', 'last_active': '2023-10-03T19:16:45.921406+0000', 'last_peered': '2023-10-03T19:16:45.921406+0000', 'last_clean': '2023-10-03T19:16:45.921406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:45.921406+0000', 'last_undegraded': '2023-10-03T19:16:45.921406+0000', 'last_fullsized': '2023-10-03T19:16:45.921406+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T19:16:50.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.20 is not active+clean 2023-10-03T19:16:50.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T19:16:45.921406+0000', 'last_change': '2023-10-03T19:16:45.921406+0000', 'last_active': '2023-10-03T19:16:45.921406+0000', 'last_peered': '2023-10-03T19:16:45.921406+0000', 'last_clean': '2023-10-03T19:16:45.921406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:45.921406+0000', 'last_undegraded': '2023-10-03T19:16:45.921406+0000', 'last_fullsized': '2023-10-03T19:16:45.921406+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T19:16:50.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2023-10-03T19:16:50.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T19:16:44.910598+0000', 'last_change': '2023-10-03T19:16:44.910598+0000', 'last_active': '2023-10-03T19:16:44.910598+0000', 'last_peered': '2023-10-03T19:16:44.910598+0000', 'last_clean': '2023-10-03T19:16:44.910598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:44.910598+0000', 'last_undegraded': '2023-10-03T19:16:44.910598+0000', 'last_fullsized': '2023-10-03T19:16:44.910598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T19:16:50.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2023-10-03T19:16:50.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T19:16:45.921406+0000', 'last_change': '2023-10-03T19:16:45.921406+0000', 'last_active': '2023-10-03T19:16:45.921406+0000', 'last_peered': '2023-10-03T19:16:45.921406+0000', 'last_clean': '2023-10-03T19:16:45.921406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:45.921406+0000', 'last_undegraded': '2023-10-03T19:16:45.921406+0000', 'last_fullsized': '2023-10-03T19:16:45.921406+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T19:16:50.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2023-10-03T19:16:50.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T19:16:44.910598+0000', 'last_change': '2023-10-03T19:16:44.910598+0000', 'last_active': '2023-10-03T19:16:44.910598+0000', 'last_peered': '2023-10-03T19:16:44.910598+0000', 'last_clean': '2023-10-03T19:16:44.910598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:44.910598+0000', 'last_undegraded': '2023-10-03T19:16:44.910598+0000', 'last_fullsized': '2023-10-03T19:16:44.910598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T19:16:50.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2023-10-03T19:16:50.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T19:16:44.910598+0000', 'last_change': '2023-10-03T19:16:44.910598+0000', 'last_active': '2023-10-03T19:16:44.910598+0000', 'last_peered': '2023-10-03T19:16:44.910598+0000', 'last_clean': '2023-10-03T19:16:44.910598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:44.910598+0000', 'last_undegraded': '2023-10-03T19:16:44.910598+0000', 'last_fullsized': '2023-10-03T19:16:44.910598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T19:16:50.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2023-10-03T19:16:50.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 60, 'state': 'creating+activating', 'last_fresh': '2023-10-03T19:16:46.303898+0000', 'last_change': '2023-10-03T19:16:46.303898+0000', 'last_active': '2023-10-03T19:16:45.921406+0000', 'last_peered': '2023-10-03T19:16:45.921406+0000', 'last_clean': '2023-10-03T19:16:45.921406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:46.303898+0000', 'last_undegraded': '2023-10-03T19:16:46.303898+0000', 'last_fullsized': '2023-10-03T19:16:46.303898+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-04T20:54:01.595268+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': ['3', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:16:50.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2023-10-03T19:16:50.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 60, 'state': 'creating+activating', 'last_fresh': '2023-10-03T19:16:46.303808+0000', 'last_change': '2023-10-03T19:16:46.303808+0000', 'last_active': '2023-10-03T19:16:45.921406+0000', 'last_peered': '2023-10-03T19:16:45.921406+0000', 'last_clean': '2023-10-03T19:16:45.921406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:46.303808+0000', 'last_undegraded': '2023-10-03T19:16:46.303808+0000', 'last_fullsized': '2023-10-03T19:16:46.303808+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-04T23:13:34.942009+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': ['3', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:16:50.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-10-03T19:16:50.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T19:16:45.921406+0000', 'last_change': '2023-10-03T19:16:45.921406+0000', 'last_active': '2023-10-03T19:16:45.921406+0000', 'last_peered': '2023-10-03T19:16:45.921406+0000', 'last_clean': '2023-10-03T19:16:45.921406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:45.921406+0000', 'last_undegraded': '2023-10-03T19:16:45.921406+0000', 'last_fullsized': '2023-10-03T19:16:45.921406+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T19:16:50.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2023-10-03T19:16:50.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T19:16:44.910598+0000', 'last_change': '2023-10-03T19:16:44.910598+0000', 'last_active': '2023-10-03T19:16:44.910598+0000', 'last_peered': '2023-10-03T19:16:44.910598+0000', 'last_clean': '2023-10-03T19:16:44.910598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:44.910598+0000', 'last_undegraded': '2023-10-03T19:16:44.910598+0000', 'last_fullsized': '2023-10-03T19:16:44.910598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T19:16:50.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2023-10-03T19:16:50.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T19:16:45.921406+0000', 'last_change': '2023-10-03T19:16:45.921406+0000', 'last_active': '2023-10-03T19:16:45.921406+0000', 'last_peered': '2023-10-03T19:16:45.921406+0000', 'last_clean': '2023-10-03T19:16:45.921406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:45.921406+0000', 'last_undegraded': '2023-10-03T19:16:45.921406+0000', 'last_fullsized': '2023-10-03T19:16:45.921406+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T19:16:50.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2023-10-03T19:16:50.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T19:16:44.910598+0000', 'last_change': '2023-10-03T19:16:44.910598+0000', 'last_active': '2023-10-03T19:16:44.910598+0000', 'last_peered': '2023-10-03T19:16:44.910598+0000', 'last_clean': '2023-10-03T19:16:44.910598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:44.910598+0000', 'last_undegraded': '2023-10-03T19:16:44.910598+0000', 'last_fullsized': '2023-10-03T19:16:44.910598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T19:16:50.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2023-10-03T19:16:50.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T19:16:44.910598+0000', 'last_change': '2023-10-03T19:16:44.910598+0000', 'last_active': '2023-10-03T19:16:44.910598+0000', 'last_peered': '2023-10-03T19:16:44.910598+0000', 'last_clean': '2023-10-03T19:16:44.910598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:44.910598+0000', 'last_undegraded': '2023-10-03T19:16:44.910598+0000', 'last_fullsized': '2023-10-03T19:16:44.910598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T19:16:50.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-10-03T19:16:50.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T19:16:45.921406+0000', 'last_change': '2023-10-03T19:16:45.921406+0000', 'last_active': '2023-10-03T19:16:45.921406+0000', 'last_peered': '2023-10-03T19:16:45.921406+0000', 'last_clean': '2023-10-03T19:16:45.921406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:45.921406+0000', 'last_undegraded': '2023-10-03T19:16:45.921406+0000', 'last_fullsized': '2023-10-03T19:16:45.921406+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T19:16:50.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2023-10-03T19:16:50.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T19:16:44.910598+0000', 'last_change': '2023-10-03T19:16:44.910598+0000', 'last_active': '2023-10-03T19:16:44.910598+0000', 'last_peered': '2023-10-03T19:16:44.910598+0000', 'last_clean': '2023-10-03T19:16:44.910598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:44.910598+0000', 'last_undegraded': '2023-10-03T19:16:44.910598+0000', 'last_fullsized': '2023-10-03T19:16:44.910598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T19:16:50.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2023-10-03T19:16:50.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T19:16:45.921406+0000', 'last_change': '2023-10-03T19:16:45.921406+0000', 'last_active': '2023-10-03T19:16:45.921406+0000', 'last_peered': '2023-10-03T19:16:45.921406+0000', 'last_clean': '2023-10-03T19:16:45.921406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:45.921406+0000', 'last_undegraded': '2023-10-03T19:16:45.921406+0000', 'last_fullsized': '2023-10-03T19:16:45.921406+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T19:16:50.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2023-10-03T19:16:50.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T19:16:44.910598+0000', 'last_change': '2023-10-03T19:16:44.910598+0000', 'last_active': '2023-10-03T19:16:44.910598+0000', 'last_peered': '2023-10-03T19:16:44.910598+0000', 'last_clean': '2023-10-03T19:16:44.910598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:44.910598+0000', 'last_undegraded': '2023-10-03T19:16:44.910598+0000', 'last_fullsized': '2023-10-03T19:16:44.910598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T19:16:50.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-10-03T19:16:50.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T19:16:45.921406+0000', 'last_change': '2023-10-03T19:16:45.921406+0000', 'last_active': '2023-10-03T19:16:45.921406+0000', 'last_peered': '2023-10-03T19:16:45.921406+0000', 'last_clean': '2023-10-03T19:16:45.921406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:45.921406+0000', 'last_undegraded': '2023-10-03T19:16:45.921406+0000', 'last_fullsized': '2023-10-03T19:16:45.921406+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:45.921406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T19:16:50.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2023-10-03T19:16:50.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T19:16:44.910598+0000', 'last_change': '2023-10-03T19:16:44.910598+0000', 'last_active': '2023-10-03T19:16:44.910598+0000', 'last_peered': '2023-10-03T19:16:44.910598+0000', 'last_clean': '2023-10-03T19:16:44.910598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:44.910598+0000', 'last_undegraded': '2023-10-03T19:16:44.910598+0000', 'last_fullsized': '2023-10-03T19:16:44.910598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T19:16:50.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2023-10-03T19:16:50.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T19:16:44.910598+0000', 'last_change': '2023-10-03T19:16:44.910598+0000', 'last_active': '2023-10-03T19:16:44.910598+0000', 'last_peered': '2023-10-03T19:16:44.910598+0000', 'last_clean': '2023-10-03T19:16:44.910598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:44.910598+0000', 'last_undegraded': '2023-10-03T19:16:44.910598+0000', 'last_fullsized': '2023-10-03T19:16:44.910598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T19:16:50.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2023-10-03T19:16:50.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T19:16:44.910598+0000', 'last_change': '2023-10-03T19:16:44.910598+0000', 'last_active': '2023-10-03T19:16:44.910598+0000', 'last_peered': '2023-10-03T19:16:44.910598+0000', 'last_clean': '2023-10-03T19:16:44.910598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:16:44.910598+0000', 'last_undegraded': '2023-10-03T19:16:44.910598+0000', 'last_fullsized': '2023-10-03T19:16:44.910598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'last_clean_scrub_stamp': '2023-10-03T19:16:44.910598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T19:16:50.099 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-03T19:16:50.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.250+0000 7f7796024640 1 Processor -- start 2023-10-03T19:16:50.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.250+0000 7f7796024640 1 -- start start 2023-10-03T19:16:50.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.250+0000 7f7796024640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f779006f170 0x7f7790150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:50.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.250+0000 7f7796024640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f779006d170 0x7f779014d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:50.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.250+0000 7f7796024640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f779006cac0 con 0x7f77900bc8b0 2023-10-03T19:16:50.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.250+0000 7f7796024640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77900720d0 con 0x7f779006d170 2023-10-03T19:16:50.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.250+0000 7f7796024640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77900a5ab0 con 0x7f779006f170 2023-10-03T19:16:50.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.250+0000 7f778ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f779006d170 0x7f779014d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:50.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.250+0000 7f778ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f779006d170 0x7f779014d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37064/0 (socket says 172.21.15.45:37064) 2023-10-03T19:16:50.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.250+0000 7f778ffff640 1 -- 172.21.15.45:0/3210644212 learned_addr learned my addr 172.21.15.45:0/3210644212 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:50.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.250+0000 7f778f7fe640 1 --2- 172.21.15.45:0/3210644212 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f779006f170 0x7f7790150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:50.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.250+0000 7f778ffff640 1 -- 172.21.15.45:0/3210644212 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f779006f170 msgr2=0x7f7790150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:50.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.250+0000 7f778ffff640 1 --2- 172.21.15.45:0/3210644212 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f779006f170 0x7f7790150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:50.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.250+0000 7f778ffff640 1 -- 172.21.15.45:0/3210644212 >> v1:172.21.15.79:6789/0 conn(0x7f77900bc8b0 legacy=0x7f779014ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:50.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.250+0000 7f778ffff640 1 -- 172.21.15.45:0/3210644212 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779006cd00 con 0x7f779006d170 2023-10-03T19:16:50.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.250+0000 7f778ffff640 1 --2- 172.21.15.45:0/3210644212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f779006d170 0x7f779014d180 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f7788009870 tx=0x7f778801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e83bfe35d4709c50 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:50.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.254+0000 7f778e7fc640 1 -- 172.21.15.45:0/3210644212 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77880ab650 con 0x7f779006d170 2023-10-03T19:16:50.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.254+0000 7f778e7fc640 1 -- 172.21.15.45:0/3210644212 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77880ab7b0 con 0x7f779006d170 2023-10-03T19:16:50.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.254+0000 7f778e7fc640 1 -- 172.21.15.45:0/3210644212 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77880abb40 con 0x7f779006d170 2023-10-03T19:16:50.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.254+0000 7f7796024640 1 -- 172.21.15.45:0/3210644212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f779006d170 msgr2=0x7f779014d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:50.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.254+0000 7f7796024640 1 --2- 172.21.15.45:0/3210644212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f779006d170 0x7f779014d180 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f7788009870 tx=0x7f778801c500 comp rx=0 tx=0).stop 2023-10-03T19:16:50.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.254+0000 7f7796024640 1 -- 172.21.15.45:0/3210644212 shutdown_connections 2023-10-03T19:16:50.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.254+0000 7f7796024640 1 --2- 172.21.15.45:0/3210644212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f779006d170 0x7f779014d180 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:50.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.254+0000 7f7796024640 1 --2- 172.21.15.45:0/3210644212 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f779006f170 0x7f7790150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:50.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.254+0000 7f7796024640 1 -- 172.21.15.45:0/3210644212 >> 172.21.15.45:0/3210644212 conn(0x7f77900bcf50 msgr2=0x7f77900bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:50.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.254+0000 7f7796024640 1 -- 172.21.15.45:0/3210644212 shutdown_connections 2023-10-03T19:16:50.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.254+0000 7f7796024640 1 -- 172.21.15.45:0/3210644212 wait complete. 2023-10-03T19:16:50.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.254+0000 7f7796024640 1 Processor -- start 2023-10-03T19:16:50.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.254+0000 7f7796024640 1 -- start start 2023-10-03T19:16:50.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.254+0000 7f7796024640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f779006d170 0x7f77900bedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:50.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.254+0000 7f7796024640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f779006f170 0x7f77901491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:50.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.254+0000 7f7796024640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77900bc8b0 0x7f7790070c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:50.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.254+0000 7f7796024640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77901e83a0 con 0x7f77900bc8b0 2023-10-03T19:16:50.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.254+0000 7f7796024640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779014b210 con 0x7f779006d170 2023-10-03T19:16:50.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.254+0000 7f7796024640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77900711c0 con 0x7f779006f170 2023-10-03T19:16:50.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.254+0000 7f778ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77900bc8b0 0x7f7790070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:50.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.254+0000 7f778ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77900bc8b0 0x7f7790070c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37074/0 (socket says 172.21.15.45:37074) 2023-10-03T19:16:50.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.254+0000 7f778effd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f779006f170 0x7f77901491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:50.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.254+0000 7f778ffff640 1 -- 172.21.15.45:0/1464303908 learned_addr learned my addr 172.21.15.45:0/1464303908 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:50.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.254+0000 7f778f7fe640 1 --2- 172.21.15.45:0/1464303908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f779006d170 0x7f77900bedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:50.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.254+0000 7f778ffff640 1 -- 172.21.15.45:0/1464303908 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f779006f170 msgr2=0x7f77901491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:50.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.254+0000 7f778ffff640 1 --2- 172.21.15.45:0/1464303908 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f779006f170 0x7f77901491d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:50.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.254+0000 7f778ffff640 1 -- 172.21.15.45:0/1464303908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f779006d170 msgr2=0x7f77900bedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:50.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.254+0000 7f778ffff640 1 --2- 172.21.15.45:0/1464303908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f779006d170 0x7f77900bedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:50.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.254+0000 7f778ffff640 1 -- 172.21.15.45:0/1464303908 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77880094d0 con 0x7f77900bc8b0 2023-10-03T19:16:50.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.254+0000 7f778ffff640 1 --2- 172.21.15.45:0/1464303908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77900bc8b0 0x7f7790070c80 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f77880ad040 tx=0x7f778801ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:50.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.258+0000 7f7787fff640 1 -- 172.21.15.45:0/1464303908 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77880b4800 con 0x7f77900bc8b0 2023-10-03T19:16:50.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.258+0000 7f7787fff640 1 -- 172.21.15.45:0/1464303908 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77880b4960 con 0x7f77900bc8b0 2023-10-03T19:16:50.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.258+0000 7f7796024640 1 -- 172.21.15.45:0/1464303908 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f779006f6d0 con 0x7f77900bc8b0 2023-10-03T19:16:50.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.258+0000 7f7787fff640 1 -- 172.21.15.45:0/1464303908 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77880b4d10 con 0x7f77900bc8b0 2023-10-03T19:16:50.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.258+0000 7f7796024640 1 -- 172.21.15.45:0/1464303908 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f779006f540 con 0x7f77900bc8b0 2023-10-03T19:16:50.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.258+0000 7f7796024640 1 -- 172.21.15.45:0/1464303908 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7790159670 con 0x7f77900bc8b0 2023-10-03T19:16:50.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.258+0000 7f7787fff640 1 -- 172.21.15.45:0/1464303908 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f77880b3380 con 0x7f77900bc8b0 2023-10-03T19:16:50.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.258+0000 7f7787fff640 1 --2- 172.21.15.45:0/1464303908 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7770066280 0x7f7770068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:50.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.258+0000 7f7787fff640 1 -- 172.21.15.45:0/1464303908 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f778811e4c0 con 0x7f77900bc8b0 2023-10-03T19:16:50.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.258+0000 7f778f7fe640 1 --2- 172.21.15.45:0/1464303908 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7770066280 0x7f7770068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:50.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.258+0000 7f778f7fe640 1 --2- 172.21.15.45:0/1464303908 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7770066280 0x7f7770068730 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7778007a60 tx=0x7f7778008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:50.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.262+0000 7f7787fff640 1 -- 172.21.15.45:0/1464303908 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f77880eba80 con 0x7f77900bc8b0 2023-10-03T19:16:50.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.474+0000 7f7796024640 1 -- 172.21.15.45:0/1464303908 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f779006d660 con 0x7f77900bc8b0 2023-10-03T19:16:50.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.478+0000 7f7787fff640 1 -- 172.21.15.45:0/1464303908 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1337 (secure 0 0 0) 0x7f77880ab610 con 0x7f77900bc8b0 2023-10-03T19:16:50.482 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:16:50.483 INFO:teuthology.orchestra.run.smithi045.stdout:{"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":284,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":61,"num_osds":8,"num_up_osds":8,"osd_up_since":1696360341,"num_in_osds":8,"osd_in_since":1696360332,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":74},{"state_name":"unknown","count":26},{"state_name":"creating+activating","count":5}],"num_pgs":105,"num_pools":4,"num_objects":18,"data_bytes":592708,"bytes_used":172113920,"bytes_avail":772921999360,"bytes_total":773094113280,"unknown_pgs_ratio":0.24761904776096344,"inactive_pgs_ratio":0.0476190485060215,"write_bytes_sec":3327,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":29,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":5904}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2023-10-03T19:16:40.534846+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-03T19:16:50.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.478+0000 7f7796024640 1 -- 172.21.15.45:0/1464303908 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7770066280 msgr2=0x7f7770068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:50.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.478+0000 7f7796024640 1 --2- 172.21.15.45:0/1464303908 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7770066280 0x7f7770068730 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7778007a60 tx=0x7f7778008040 comp rx=0 tx=0).stop 2023-10-03T19:16:50.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.478+0000 7f7796024640 1 -- 172.21.15.45:0/1464303908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77900bc8b0 msgr2=0x7f7790070c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:50.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.478+0000 7f7796024640 1 --2- 172.21.15.45:0/1464303908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77900bc8b0 0x7f7790070c80 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f77880ad040 tx=0x7f778801ad40 comp rx=0 tx=0).stop 2023-10-03T19:16:50.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.478+0000 7f7796024640 1 -- 172.21.15.45:0/1464303908 shutdown_connections 2023-10-03T19:16:50.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.478+0000 7f7796024640 1 --2- 172.21.15.45:0/1464303908 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7770066280 0x7f7770068730 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:50.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.478+0000 7f7796024640 1 --2- 172.21.15.45:0/1464303908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77900bc8b0 0x7f7790070c80 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:50.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.478+0000 7f7796024640 1 --2- 172.21.15.45:0/1464303908 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f779006f170 0x7f77901491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:50.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.478+0000 7f7796024640 1 --2- 172.21.15.45:0/1464303908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f779006d170 0x7f77900bedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:50.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.478+0000 7f7796024640 1 -- 172.21.15.45:0/1464303908 >> 172.21.15.45:0/1464303908 conn(0x7f77900bcf50 msgr2=0x7f7790144910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:50.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.478+0000 7f7796024640 1 -- 172.21.15.45:0/1464303908 shutdown_connections 2023-10-03T19:16:50.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.478+0000 7f7796024640 1 -- 172.21.15.45:0/1464303908 wait complete. 2023-10-03T19:16:50.501 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-03T19:16:50.501 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:16:50.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.618+0000 7f8ae07a4640 1 Processor -- start 2023-10-03T19:16:50.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.618+0000 7f8ae07a4640 1 -- start start 2023-10-03T19:16:50.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.622+0000 7f8ae07a4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8ad814f240 0x7f8ad81528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:50.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.622+0000 7f8ae07a4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ad80bb1d0 0x7f8ad80c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:50.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.622+0000 7f8ae07a4640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad806b2d0 con 0x7f8ad80c2790 2023-10-03T19:16:50.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.622+0000 7f8ae07a4640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad806b640 con 0x7f8ad814f240 2023-10-03T19:16:50.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.622+0000 7f8ae07a4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad80a3c60 con 0x7f8ad80bb1d0 2023-10-03T19:16:50.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.622+0000 7f8ade540640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8ad814f240 0x7f8ad81528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:50.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.622+0000 7f8addd3f640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8ad80c2790 0x7f8ad80c0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55550/0 (socket says 172.21.15.45:55550) 2023-10-03T19:16:50.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.622+0000 7f8addd3f640 1 -- 172.21.15.45:0/3050856468 learned_addr learned my addr 172.21.15.45:0/3050856468 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:50.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.622+0000 7f8aded41640 1 --2- 172.21.15.45:0/3050856468 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ad80bb1d0 0x7f8ad80c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:50.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.622+0000 7f8ade540640 1 -- 172.21.15.45:0/3050856468 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ad80bb1d0 msgr2=0x7f8ad80c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:50.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.622+0000 7f8ade540640 1 --2- 172.21.15.45:0/3050856468 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ad80bb1d0 0x7f8ad80c12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:50.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.622+0000 7f8ade540640 1 -- 172.21.15.45:0/3050856468 >> v1:172.21.15.45:6789/0 conn(0x7f8ad80c2790 legacy=0x7f8ad80c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:50.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.622+0000 7f8ade540640 1 -- 172.21.15.45:0/3050856468 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad814e740 con 0x7f8ad814f240 2023-10-03T19:16:50.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.622+0000 7f8ade540640 1 --2- 172.21.15.45:0/3050856468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ad814f240 0x7f8ad81528d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8009de0 tx=0x7f8ac801f170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23041568b62350ec server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:50.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.622+0000 7f8add53e640 1 -- 172.21.15.45:0/3050856468 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac80af600 con 0x7f8ad814f240 2023-10-03T19:16:50.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.622+0000 7f8add53e640 1 -- 172.21.15.45:0/3050856468 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac80ab050 con 0x7f8ad814f240 2023-10-03T19:16:50.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.622+0000 7f8add53e640 1 -- 172.21.15.45:0/3050856468 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac80af980 con 0x7f8ad814f240 2023-10-03T19:16:50.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.622+0000 7f8ae07a4640 1 -- 172.21.15.45:0/3050856468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ad814f240 msgr2=0x7f8ad81528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:50.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.622+0000 7f8ae07a4640 1 --2- 172.21.15.45:0/3050856468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ad814f240 0x7f8ad81528d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8009de0 tx=0x7f8ac801f170 comp rx=0 tx=0).stop 2023-10-03T19:16:50.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.622+0000 7f8ae07a4640 1 -- 172.21.15.45:0/3050856468 shutdown_connections 2023-10-03T19:16:50.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.622+0000 7f8ae07a4640 1 --2- 172.21.15.45:0/3050856468 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ad80bb1d0 0x7f8ad80c12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:50.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.622+0000 7f8ae07a4640 1 --2- 172.21.15.45:0/3050856468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ad814f240 0x7f8ad81528d0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:50.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.622+0000 7f8ae07a4640 1 -- 172.21.15.45:0/3050856468 >> 172.21.15.45:0/3050856468 conn(0x7f8ad80a64a0 msgr2=0x7f8ad80a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:50.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.622+0000 7f8ae07a4640 1 -- 172.21.15.45:0/3050856468 shutdown_connections 2023-10-03T19:16:50.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.622+0000 7f8ae07a4640 1 -- 172.21.15.45:0/3050856468 wait complete. 2023-10-03T19:16:50.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.626+0000 7f8ae07a4640 1 Processor -- start 2023-10-03T19:16:50.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.626+0000 7f8ae07a4640 1 -- start start 2023-10-03T19:16:50.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.626+0000 7f8ae07a4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ad80bb1d0 0x7f8ad8151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:50.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.626+0000 7f8ae07a4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ad80c2790 0x7f8ad81e42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:50.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.626+0000 7f8ae07a4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ad814f240 0x7f8ad814a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:50.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.626+0000 7f8ae07a4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad8151100 con 0x7f8ad80c2790 2023-10-03T19:16:50.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.626+0000 7f8ae07a4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad814fb70 con 0x7f8ad814f240 2023-10-03T19:16:50.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.626+0000 7f8ae07a4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad8150d90 con 0x7f8ad80bb1d0 2023-10-03T19:16:50.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.626+0000 7f8addd3f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ad80c2790 0x7f8ad81e42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:50.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.626+0000 7f8addd3f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ad80c2790 0x7f8ad81e42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37090/0 (socket says 172.21.15.45:37090) 2023-10-03T19:16:50.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.626+0000 7f8addd3f640 1 -- 172.21.15.45:0/2447833399 learned_addr learned my addr 172.21.15.45:0/2447833399 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:50.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.626+0000 7f8ade540640 1 --2- 172.21.15.45:0/2447833399 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ad80bb1d0 0x7f8ad8151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:50.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.626+0000 7f8aded41640 1 --2- 172.21.15.45:0/2447833399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ad814f240 0x7f8ad814a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:50.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.626+0000 7f8addd3f640 1 -- 172.21.15.45:0/2447833399 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ad80bb1d0 msgr2=0x7f8ad8151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:50.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.626+0000 7f8addd3f640 1 --2- 172.21.15.45:0/2447833399 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ad80bb1d0 0x7f8ad8151520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:50.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.626+0000 7f8addd3f640 1 -- 172.21.15.45:0/2447833399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ad814f240 msgr2=0x7f8ad814a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:50.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.626+0000 7f8addd3f640 1 --2- 172.21.15.45:0/2447833399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ad814f240 0x7f8ad814a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:50.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.626+0000 7f8addd3f640 1 -- 172.21.15.45:0/2447833399 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac8009a70 con 0x7f8ad80c2790 2023-10-03T19:16:50.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.626+0000 7f8aded41640 1 --2- 172.21.15.45:0/2447833399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ad814f240 0x7f8ad814a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:50.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.626+0000 7f8addd3f640 1 --2- 172.21.15.45:0/2447833399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ad80c2790 0x7f8ad81e42a0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f8acc00c500 tx=0x7f8acc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:50.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.626+0000 7f8ad6ffd640 1 -- 172.21.15.45:0/2447833399 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8acc007500 con 0x7f8ad80c2790 2023-10-03T19:16:50.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.626+0000 7f8ad6ffd640 1 -- 172.21.15.45:0/2447833399 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8acc007660 con 0x7f8ad80c2790 2023-10-03T19:16:50.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.626+0000 7f8ae07a4640 1 -- 172.21.15.45:0/2447833399 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad814f610 con 0x7f8ad80c2790 2023-10-03T19:16:50.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.626+0000 7f8ad6ffd640 1 -- 172.21.15.45:0/2447833399 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8acc0059b0 con 0x7f8ad80c2790 2023-10-03T19:16:50.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.626+0000 7f8ae07a4640 1 -- 172.21.15.45:0/2447833399 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad80a3f40 con 0x7f8ad80c2790 2023-10-03T19:16:50.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.626+0000 7f8ae07a4640 1 -- 172.21.15.45:0/2447833399 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad80bf360 con 0x7f8ad80c2790 2023-10-03T19:16:50.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.626+0000 7f8ad6ffd640 1 -- 172.21.15.45:0/2447833399 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8acc005b10 con 0x7f8ad80c2790 2023-10-03T19:16:50.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.630+0000 7f8ad6ffd640 1 --2- 172.21.15.45:0/2447833399 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8ac4066280 0x7f8ac4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:50.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.630+0000 7f8ad6ffd640 1 -- 172.21.15.45:0/2447833399 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8acc0831d0 con 0x7f8ad80c2790 2023-10-03T19:16:50.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.630+0000 7f8ade540640 1 --2- 172.21.15.45:0/2447833399 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8ac4066280 0x7f8ac4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:50.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.630+0000 7f8ade540640 1 --2- 172.21.15.45:0/2447833399 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8ac4066280 0x7f8ac4068730 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8ac80b1000 tx=0x7f8ac80aa000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:50.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.634+0000 7f8ad6ffd640 1 -- 172.21.15.45:0/2447833399 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8acc050790 con 0x7f8ad80c2790 2023-10-03T19:16:50.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.782+0000 7f8ae07a4640 1 -- 172.21.15.45:0/2447833399 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8ad80bfa90 con 0x7f8ac4066280 2023-10-03T19:16:50.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.810+0000 7f8ad6ffd640 1 -- 172.21.15.45:0/2447833399 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310152 (secure 0 0 0) 0x7f8ad80bfa90 con 0x7f8ac4066280 2023-10-03T19:16:50.815 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:16:50.817 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:16:50.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.810+0000 7f8ae07a4640 1 -- 172.21.15.45:0/2447833399 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8ac4066280 msgr2=0x7f8ac4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:50.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.810+0000 7f8ae07a4640 1 --2- 172.21.15.45:0/2447833399 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8ac4066280 0x7f8ac4068730 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8ac80b1000 tx=0x7f8ac80aa000 comp rx=0 tx=0).stop 2023-10-03T19:16:50.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.810+0000 7f8ae07a4640 1 -- 172.21.15.45:0/2447833399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ad80c2790 msgr2=0x7f8ad81e42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:50.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.810+0000 7f8ae07a4640 1 --2- 172.21.15.45:0/2447833399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ad80c2790 0x7f8ad81e42a0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f8acc00c500 tx=0x7f8acc00c9c0 comp rx=0 tx=0).stop 2023-10-03T19:16:50.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.810+0000 7f8ae07a4640 1 -- 172.21.15.45:0/2447833399 shutdown_connections 2023-10-03T19:16:50.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.810+0000 7f8ae07a4640 1 --2- 172.21.15.45:0/2447833399 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8ac4066280 0x7f8ac4068730 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:50.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.810+0000 7f8ae07a4640 1 --2- 172.21.15.45:0/2447833399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ad814f240 0x7f8ad814a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:50.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.810+0000 7f8ae07a4640 1 --2- 172.21.15.45:0/2447833399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ad80c2790 0x7f8ad81e42a0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:50.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.810+0000 7f8ae07a4640 1 --2- 172.21.15.45:0/2447833399 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8ad80bb1d0 0x7f8ad8151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:50.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.810+0000 7f8ae07a4640 1 -- 172.21.15.45:0/2447833399 >> 172.21.15.45:0/2447833399 conn(0x7f8ad80a64a0 msgr2=0x7f8ad814ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:50.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.810+0000 7f8ae07a4640 1 -- 172.21.15.45:0/2447833399 shutdown_connections 2023-10-03T19:16:50.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:50.810+0000 7f8ae07a4640 1 -- 172.21.15.45:0/2447833399 wait complete. 2023-10-03T19:16:50.834 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2023-10-03T19:16:50.537574+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":92,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":168424,"kb_used_data":5736,"kb_used_omap":0,"kb_used_meta":162624,"kb_avail":754806296,"statfs":{"total":773094113280,"available":772921647104,"internally_reserved":0,"allocated":5873664,"data_stored":3699441,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":166526976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":70,"apply_latency_ms":70,"commit_latency_ns":70000000,"apply_latency_ns":70000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.609480"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.355678+0000","last_change":"2023-10-03T19:16:46.354281+0000","last_active":"2023-10-03T19:16:46.355678+0000","last_peered":"2023-10-03T19:16:46.355678+0000","last_clean":"2023-10-03T19:16:46.355678+0000","last_became_active":"2023-10-03T19:16:46.353863+0000","last_became_peered":"2023-10-03T19:16:46.353863+0000","last_unstale":"2023-10-03T19:16:46.355678+0000","last_undegraded":"2023-10-03T19:16:46.355678+0000","last_fullsized":"2023-10-03T19:16:46.355678+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:54:01.595268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.319995+0000","last_change":"2023-10-03T19:16:46.318712+0000","last_active":"2023-10-03T19:16:46.319995+0000","last_peered":"2023-10-03T19:16:46.319995+0000","last_clean":"2023-10-03T19:16:46.319995+0000","last_became_active":"2023-10-03T19:16:46.318367+0000","last_became_peered":"2023-10-03T19:16:46.318367+0000","last_unstale":"2023-10-03T19:16:46.319995+0000","last_undegraded":"2023-10-03T19:16:46.319995+0000","last_fullsized":"2023-10-03T19:16:46.319995+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:04:47.708070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381928+0000","last_change":"2023-10-03T19:16:46.372185+0000","last_active":"2023-10-03T19:16:46.381928+0000","last_peered":"2023-10-03T19:16:46.381928+0000","last_clean":"2023-10-03T19:16:46.381928+0000","last_became_active":"2023-10-03T19:16:46.371540+0000","last_became_peered":"2023-10-03T19:16:46.371540+0000","last_unstale":"2023-10-03T19:16:46.381928+0000","last_undegraded":"2023-10-03T19:16:46.381928+0000","last_fullsized":"2023-10-03T19:16:46.381928+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:25:23.195500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.374546+0000","last_change":"2023-10-03T19:16:46.355059+0000","last_active":"2023-10-03T19:16:46.374546+0000","last_peered":"2023-10-03T19:16:46.374546+0000","last_clean":"2023-10-03T19:16:46.374546+0000","last_became_active":"2023-10-03T19:16:46.347192+0000","last_became_peered":"2023-10-03T19:16:46.347192+0000","last_unstale":"2023-10-03T19:16:46.374546+0000","last_undegraded":"2023-10-03T19:16:46.374546+0000","last_fullsized":"2023-10-03T19:16:46.374546+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:42:11.101433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.382846+0000","last_change":"2023-10-03T19:16:46.376955+0000","last_active":"2023-10-03T19:16:46.382846+0000","last_peered":"2023-10-03T19:16:46.382846+0000","last_clean":"2023-10-03T19:16:46.382846+0000","last_became_active":"2023-10-03T19:16:46.376315+0000","last_became_peered":"2023-10-03T19:16:46.376315+0000","last_unstale":"2023-10-03T19:16:46.382846+0000","last_undegraded":"2023-10-03T19:16:46.382846+0000","last_fullsized":"2023-10-03T19:16:46.382846+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:39:49.540080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.344242+0000","last_change":"2023-10-03T19:16:46.343431+0000","last_active":"2023-10-03T19:16:46.344242+0000","last_peered":"2023-10-03T19:16:46.344242+0000","last_clean":"2023-10-03T19:16:46.344242+0000","last_became_active":"2023-10-03T19:16:46.343126+0000","last_became_peered":"2023-10-03T19:16:46.343126+0000","last_unstale":"2023-10-03T19:16:46.344242+0000","last_undegraded":"2023-10-03T19:16:46.344242+0000","last_fullsized":"2023-10-03T19:16:46.344242+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:55:44.177948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.348676+0000","last_change":"2023-10-03T19:16:46.348039+0000","last_active":"2023-10-03T19:16:46.348676+0000","last_peered":"2023-10-03T19:16:46.348676+0000","last_clean":"2023-10-03T19:16:46.348676+0000","last_became_active":"2023-10-03T19:16:46.347765+0000","last_became_peered":"2023-10-03T19:16:46.347765+0000","last_unstale":"2023-10-03T19:16:46.348676+0000","last_undegraded":"2023-10-03T19:16:46.348676+0000","last_fullsized":"2023-10-03T19:16:46.348676+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:05:13.691561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.319138+0000","last_change":"2023-10-03T19:16:46.370731+0000","last_active":"2023-10-03T19:16:47.319138+0000","last_peered":"2023-10-03T19:16:47.319138+0000","last_clean":"2023-10-03T19:16:47.319138+0000","last_became_active":"2023-10-03T19:16:46.370160+0000","last_became_peered":"2023-10-03T19:16:46.370160+0000","last_unstale":"2023-10-03T19:16:47.319138+0000","last_undegraded":"2023-10-03T19:16:47.319138+0000","last_fullsized":"2023-10-03T19:16:47.319138+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:28:32.868908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381879+0000","last_change":"2023-10-03T19:16:46.371593+0000","last_active":"2023-10-03T19:16:46.381879+0000","last_peered":"2023-10-03T19:16:46.381879+0000","last_clean":"2023-10-03T19:16:46.381879+0000","last_became_active":"2023-10-03T19:16:46.369346+0000","last_became_peered":"2023-10-03T19:16:46.369346+0000","last_unstale":"2023-10-03T19:16:46.381879+0000","last_undegraded":"2023-10-03T19:16:46.381879+0000","last_fullsized":"2023-10-03T19:16:46.381879+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:54:53.731901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381775+0000","last_change":"2023-10-03T19:16:46.370812+0000","last_active":"2023-10-03T19:16:46.381775+0000","last_peered":"2023-10-03T19:16:46.381775+0000","last_clean":"2023-10-03T19:16:46.381775+0000","last_became_active":"2023-10-03T19:16:46.368674+0000","last_became_peered":"2023-10-03T19:16:46.368674+0000","last_unstale":"2023-10-03T19:16:46.381775+0000","last_undegraded":"2023-10-03T19:16:46.381775+0000","last_fullsized":"2023-10-03T19:16:46.381775+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:30:05.766523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.379890+0000","last_change":"2023-10-03T19:16:46.363645+0000","last_active":"2023-10-03T19:16:46.379890+0000","last_peered":"2023-10-03T19:16:46.379890+0000","last_clean":"2023-10-03T19:16:46.379890+0000","last_became_active":"2023-10-03T19:16:46.363014+0000","last_became_peered":"2023-10-03T19:16:46.363014+0000","last_unstale":"2023-10-03T19:16:46.379890+0000","last_undegraded":"2023-10-03T19:16:46.379890+0000","last_fullsized":"2023-10-03T19:16:46.379890+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:20:40.295554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.319756+0000","last_change":"2023-10-03T19:16:46.373672+0000","last_active":"2023-10-03T19:16:47.319756+0000","last_peered":"2023-10-03T19:16:47.319756+0000","last_clean":"2023-10-03T19:16:47.319756+0000","last_became_active":"2023-10-03T19:16:46.373256+0000","last_became_peered":"2023-10-03T19:16:46.373256+0000","last_unstale":"2023-10-03T19:16:47.319756+0000","last_undegraded":"2023-10-03T19:16:47.319756+0000","last_fullsized":"2023-10-03T19:16:47.319756+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:26:48.529992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.319954+0000","last_change":"2023-10-03T19:16:46.360994+0000","last_active":"2023-10-03T19:16:47.319954+0000","last_peered":"2023-10-03T19:16:47.319954+0000","last_clean":"2023-10-03T19:16:47.319954+0000","last_became_active":"2023-10-03T19:16:46.360424+0000","last_became_peered":"2023-10-03T19:16:46.360424+0000","last_unstale":"2023-10-03T19:16:47.319954+0000","last_undegraded":"2023-10-03T19:16:47.319954+0000","last_fullsized":"2023-10-03T19:16:47.319954+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:49:56.768979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381783+0000","last_change":"2023-10-03T19:16:46.370866+0000","last_active":"2023-10-03T19:16:46.381783+0000","last_peered":"2023-10-03T19:16:46.381783+0000","last_clean":"2023-10-03T19:16:46.381783+0000","last_became_active":"2023-10-03T19:16:46.369194+0000","last_became_peered":"2023-10-03T19:16:46.369194+0000","last_unstale":"2023-10-03T19:16:46.381783+0000","last_undegraded":"2023-10-03T19:16:46.381783+0000","last_fullsized":"2023-10-03T19:16:46.381783+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:28:32.763091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381998+0000","last_change":"2023-10-03T19:16:46.371802+0000","last_active":"2023-10-03T19:16:46.381998+0000","last_peered":"2023-10-03T19:16:46.381998+0000","last_clean":"2023-10-03T19:16:46.381998+0000","last_became_active":"2023-10-03T19:16:46.371306+0000","last_became_peered":"2023-10-03T19:16:46.371306+0000","last_unstale":"2023-10-03T19:16:46.381998+0000","last_undegraded":"2023-10-03T19:16:46.381998+0000","last_fullsized":"2023-10-03T19:16:46.381998+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:43:09.345662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.322740+0000","last_change":"2023-10-03T19:16:46.321343+0000","last_active":"2023-10-03T19:16:46.322740+0000","last_peered":"2023-10-03T19:16:46.322740+0000","last_clean":"2023-10-03T19:16:46.322740+0000","last_became_active":"2023-10-03T19:16:46.321083+0000","last_became_peered":"2023-10-03T19:16:46.321083+0000","last_unstale":"2023-10-03T19:16:46.322740+0000","last_undegraded":"2023-10-03T19:16:46.322740+0000","last_fullsized":"2023-10-03T19:16:46.322740+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:51:28.753857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.347991+0000","last_change":"2023-10-03T19:16:46.346773+0000","last_active":"2023-10-03T19:16:46.347991+0000","last_peered":"2023-10-03T19:16:46.347991+0000","last_clean":"2023-10-03T19:16:46.347991+0000","last_became_active":"2023-10-03T19:16:46.346453+0000","last_became_peered":"2023-10-03T19:16:46.346453+0000","last_unstale":"2023-10-03T19:16:46.347991+0000","last_undegraded":"2023-10-03T19:16:46.347991+0000","last_fullsized":"2023-10-03T19:16:46.347991+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:40:18.437890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.374309+0000","last_change":"2023-10-03T19:16:46.349167+0000","last_active":"2023-10-03T19:16:46.374309+0000","last_peered":"2023-10-03T19:16:46.374309+0000","last_clean":"2023-10-03T19:16:46.374309+0000","last_became_active":"2023-10-03T19:16:46.348310+0000","last_became_peered":"2023-10-03T19:16:46.348310+0000","last_unstale":"2023-10-03T19:16:46.374309+0000","last_undegraded":"2023-10-03T19:16:46.374309+0000","last_fullsized":"2023-10-03T19:16:46.374309+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:39:42.294017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.378898+0000","last_change":"2023-10-03T19:16:46.364849+0000","last_active":"2023-10-03T19:16:46.378898+0000","last_peered":"2023-10-03T19:16:46.378898+0000","last_clean":"2023-10-03T19:16:46.378898+0000","last_became_active":"2023-10-03T19:16:46.362795+0000","last_became_peered":"2023-10-03T19:16:46.362795+0000","last_unstale":"2023-10-03T19:16:46.378898+0000","last_undegraded":"2023-10-03T19:16:46.378898+0000","last_fullsized":"2023-10-03T19:16:46.378898+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:11:48.396477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":3,"reported_epoch":60,"state":"creating+activating","last_fresh":"2023-10-03T19:16:46.303990+0000","last_change":"2023-10-03T19:16:46.303990+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:46.303990+0000","last_undegraded":"2023-10-03T19:16:46.303990+0000","last_fullsized":"2023-10-03T19:16:46.303990+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:04:47.708070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.319860+0000","last_change":"2023-10-03T19:16:46.355895+0000","last_active":"2023-10-03T19:16:47.319860+0000","last_peered":"2023-10-03T19:16:47.319860+0000","last_clean":"2023-10-03T19:16:47.319860+0000","last_became_active":"2023-10-03T19:16:46.355499+0000","last_became_peered":"2023-10-03T19:16:46.355499+0000","last_unstale":"2023-10-03T19:16:47.319860+0000","last_undegraded":"2023-10-03T19:16:47.319860+0000","last_fullsized":"2023-10-03T19:16:47.319860+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:01:59.000737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":3,"reported_epoch":60,"state":"creating+activating","last_fresh":"2023-10-03T19:16:46.304321+0000","last_change":"2023-10-03T19:16:46.304321+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:46.304321+0000","last_undegraded":"2023-10-03T19:16:46.304321+0000","last_fullsized":"2023-10-03T19:16:46.304321+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:59:33.879590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":3,"reported_epoch":60,"state":"creating+activating","last_fresh":"2023-10-03T19:16:46.303772+0000","last_change":"2023-10-03T19:16:46.303772+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:46.303772+0000","last_undegraded":"2023-10-03T19:16:46.303772+0000","last_fullsized":"2023-10-03T19:16:46.303772+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:35:51.612936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381818+0000","last_change":"2023-10-03T19:16:46.371106+0000","last_active":"2023-10-03T19:16:46.381818+0000","last_peered":"2023-10-03T19:16:46.381818+0000","last_clean":"2023-10-03T19:16:46.381818+0000","last_became_active":"2023-10-03T19:16:46.368784+0000","last_became_peered":"2023-10-03T19:16:46.368784+0000","last_unstale":"2023-10-03T19:16:46.381818+0000","last_undegraded":"2023-10-03T19:16:46.381818+0000","last_fullsized":"2023-10-03T19:16:46.381818+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:46:26.365305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.320063+0000","last_change":"2023-10-03T19:16:46.331355+0000","last_active":"2023-10-03T19:16:47.320063+0000","last_peered":"2023-10-03T19:16:47.320063+0000","last_clean":"2023-10-03T19:16:47.320063+0000","last_became_active":"2023-10-03T19:16:46.330651+0000","last_became_peered":"2023-10-03T19:16:46.330651+0000","last_unstale":"2023-10-03T19:16:47.320063+0000","last_undegraded":"2023-10-03T19:16:47.320063+0000","last_fullsized":"2023-10-03T19:16:47.320063+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:53:57.650151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.320124+0000","last_change":"2023-10-03T19:16:46.355791+0000","last_active":"2023-10-03T19:16:47.320124+0000","last_peered":"2023-10-03T19:16:47.320124+0000","last_clean":"2023-10-03T19:16:47.320124+0000","last_became_active":"2023-10-03T19:16:46.355363+0000","last_became_peered":"2023-10-03T19:16:46.355363+0000","last_unstale":"2023-10-03T19:16:47.320124+0000","last_undegraded":"2023-10-03T19:16:47.320124+0000","last_fullsized":"2023-10-03T19:16:47.320124+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:51:27.990245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.379936+0000","last_change":"2023-10-03T19:16:46.364524+0000","last_active":"2023-10-03T19:16:46.379936+0000","last_peered":"2023-10-03T19:16:46.379936+0000","last_clean":"2023-10-03T19:16:46.379936+0000","last_became_active":"2023-10-03T19:16:46.364031+0000","last_became_peered":"2023-10-03T19:16:46.364031+0000","last_unstale":"2023-10-03T19:16:46.379936+0000","last_undegraded":"2023-10-03T19:16:46.379936+0000","last_fullsized":"2023-10-03T19:16:46.379936+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:06:40.428254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.365969+0000","last_change":"2023-10-03T19:16:46.365391+0000","last_active":"2023-10-03T19:16:46.365969+0000","last_peered":"2023-10-03T19:16:46.365969+0000","last_clean":"2023-10-03T19:16:46.365969+0000","last_became_active":"2023-10-03T19:16:46.365114+0000","last_became_peered":"2023-10-03T19:16:46.365114+0000","last_unstale":"2023-10-03T19:16:46.365969+0000","last_undegraded":"2023-10-03T19:16:46.365969+0000","last_fullsized":"2023-10-03T19:16:46.365969+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:39:36.928666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.379484+0000","last_change":"2023-10-03T19:16:46.368881+0000","last_active":"2023-10-03T19:16:46.379484+0000","last_peered":"2023-10-03T19:16:46.379484+0000","last_clean":"2023-10-03T19:16:46.379484+0000","last_became_active":"2023-10-03T19:16:46.368277+0000","last_became_peered":"2023-10-03T19:16:46.368277+0000","last_unstale":"2023-10-03T19:16:46.379484+0000","last_undegraded":"2023-10-03T19:16:46.379484+0000","last_fullsized":"2023-10-03T19:16:46.379484+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:24:10.893825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.319123+0000","last_change":"2023-10-03T19:16:46.375016+0000","last_active":"2023-10-03T19:16:47.319123+0000","last_peered":"2023-10-03T19:16:47.319123+0000","last_clean":"2023-10-03T19:16:47.319123+0000","last_became_active":"2023-10-03T19:16:46.373328+0000","last_became_peered":"2023-10-03T19:16:46.373328+0000","last_unstale":"2023-10-03T19:16:47.319123+0000","last_undegraded":"2023-10-03T19:16:47.319123+0000","last_fullsized":"2023-10-03T19:16:47.319123+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:19:38.440912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.373833+0000","last_change":"2023-10-03T19:16:46.348251+0000","last_active":"2023-10-03T19:16:46.373833+0000","last_peered":"2023-10-03T19:16:46.373833+0000","last_clean":"2023-10-03T19:16:46.373833+0000","last_became_active":"2023-10-03T19:16:46.347396+0000","last_became_peered":"2023-10-03T19:16:46.347396+0000","last_unstale":"2023-10-03T19:16:46.373833+0000","last_undegraded":"2023-10-03T19:16:46.373833+0000","last_fullsized":"2023-10-03T19:16:46.373833+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:39:49.540080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.321654+0000","last_change":"2023-10-03T19:16:46.320704+0000","last_active":"2023-10-03T19:16:46.321654+0000","last_peered":"2023-10-03T19:16:46.321654+0000","last_clean":"2023-10-03T19:16:46.321654+0000","last_became_active":"2023-10-03T19:16:46.320439+0000","last_became_peered":"2023-10-03T19:16:46.320439+0000","last_unstale":"2023-10-03T19:16:46.321654+0000","last_undegraded":"2023-10-03T19:16:46.321654+0000","last_fullsized":"2023-10-03T19:16:46.321654+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:10:04.090416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.379004+0000","last_change":"2023-10-03T19:16:46.365538+0000","last_active":"2023-10-03T19:16:46.379004+0000","last_peered":"2023-10-03T19:16:46.379004+0000","last_clean":"2023-10-03T19:16:46.379004+0000","last_became_active":"2023-10-03T19:16:46.365018+0000","last_became_peered":"2023-10-03T19:16:46.365018+0000","last_unstale":"2023-10-03T19:16:46.379004+0000","last_undegraded":"2023-10-03T19:16:46.379004+0000","last_fullsized":"2023-10-03T19:16:46.379004+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:41:32.807340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"60'4","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.347934+0000","last_change":"2023-10-03T19:16:45.981820+0000","last_active":"2023-10-03T19:16:46.347934+0000","last_peered":"2023-10-03T19:16:46.347934+0000","last_clean":"2023-10-03T19:16:46.347934+0000","last_became_active":"2023-10-03T19:16:45.981370+0000","last_became_peered":"2023-10-03T19:16:45.981370+0000","last_unstale":"2023-10-03T19:16:46.347934+0000","last_undegraded":"2023-10-03T19:16:46.347934+0000","last_fullsized":"2023-10-03T19:16:46.347934+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:27:07.552881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.380668+0000","last_change":"2023-10-03T19:16:46.376884+0000","last_active":"2023-10-03T19:16:46.380668+0000","last_peered":"2023-10-03T19:16:46.380668+0000","last_clean":"2023-10-03T19:16:46.380668+0000","last_became_active":"2023-10-03T19:16:46.376443+0000","last_became_peered":"2023-10-03T19:16:46.376443+0000","last_unstale":"2023-10-03T19:16:46.380668+0000","last_undegraded":"2023-10-03T19:16:46.380668+0000","last_fullsized":"2023-10-03T19:16:46.380668+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:48:22.544505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"60'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.321497+0000","last_change":"2023-10-03T19:16:45.981732+0000","last_active":"2023-10-03T19:16:46.321497+0000","last_peered":"2023-10-03T19:16:46.321497+0000","last_clean":"2023-10-03T19:16:46.321497+0000","last_became_active":"2023-10-03T19:16:45.981370+0000","last_became_peered":"2023-10-03T19:16:45.981370+0000","last_unstale":"2023-10-03T19:16:46.321497+0000","last_undegraded":"2023-10-03T19:16:46.321497+0000","last_fullsized":"2023-10-03T19:16:46.321497+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:18:52.620802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.318058+0000","last_change":"2023-10-03T19:16:46.314997+0000","last_active":"2023-10-03T19:16:46.318058+0000","last_peered":"2023-10-03T19:16:46.318058+0000","last_clean":"2023-10-03T19:16:46.318058+0000","last_became_active":"2023-10-03T19:16:46.314696+0000","last_became_peered":"2023-10-03T19:16:46.314696+0000","last_unstale":"2023-10-03T19:16:46.318058+0000","last_undegraded":"2023-10-03T19:16:46.318058+0000","last_fullsized":"2023-10-03T19:16:46.318058+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:44:55.670865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"60'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.356922+0000","last_change":"2023-10-03T19:16:45.962125+0000","last_active":"2023-10-03T19:16:46.356922+0000","last_peered":"2023-10-03T19:16:46.356922+0000","last_clean":"2023-10-03T19:16:46.356922+0000","last_became_active":"2023-10-03T19:16:45.961789+0000","last_became_peered":"2023-10-03T19:16:45.961789+0000","last_unstale":"2023-10-03T19:16:46.356922+0000","last_undegraded":"2023-10-03T19:16:46.356922+0000","last_fullsized":"2023-10-03T19:16:46.356922+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:26:23.901877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381832+0000","last_change":"2023-10-03T19:16:46.371148+0000","last_active":"2023-10-03T19:16:46.381832+0000","last_peered":"2023-10-03T19:16:46.381832+0000","last_clean":"2023-10-03T19:16:46.381832+0000","last_became_active":"2023-10-03T19:16:46.368434+0000","last_became_peered":"2023-10-03T19:16:46.368434+0000","last_unstale":"2023-10-03T19:16:46.381832+0000","last_undegraded":"2023-10-03T19:16:46.381832+0000","last_fullsized":"2023-10-03T19:16:46.381832+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:36:18.321914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"60'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.320217+0000","last_change":"2023-10-03T19:16:45.943694+0000","last_active":"2023-10-03T19:16:46.320217+0000","last_peered":"2023-10-03T19:16:46.320217+0000","last_clean":"2023-10-03T19:16:46.320217+0000","last_became_active":"2023-10-03T19:16:45.943381+0000","last_became_peered":"2023-10-03T19:16:45.943381+0000","last_unstale":"2023-10-03T19:16:46.320217+0000","last_undegraded":"2023-10-03T19:16:46.320217+0000","last_fullsized":"2023-10-03T19:16:46.320217+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:30:14.537183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.320047+0000","last_change":"2023-10-03T19:16:46.315631+0000","last_active":"2023-10-03T19:16:46.320047+0000","last_peered":"2023-10-03T19:16:46.320047+0000","last_clean":"2023-10-03T19:16:46.320047+0000","last_became_active":"2023-10-03T19:16:46.315402+0000","last_became_peered":"2023-10-03T19:16:46.315402+0000","last_unstale":"2023-10-03T19:16:46.320047+0000","last_undegraded":"2023-10-03T19:16:46.320047+0000","last_fullsized":"2023-10-03T19:16:46.320047+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:23:09.252397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.303917+0000","last_change":"2023-10-03T19:16:45.941443+0000","last_active":"2023-10-03T19:16:46.303917+0000","last_peered":"2023-10-03T19:16:46.303917+0000","last_clean":"2023-10-03T19:16:46.303917+0000","last_became_active":"2023-10-03T19:16:45.940415+0000","last_became_peered":"2023-10-03T19:16:45.940415+0000","last_unstale":"2023-10-03T19:16:46.303917+0000","last_undegraded":"2023-10-03T19:16:46.303917+0000","last_fullsized":"2023-10-03T19:16:46.303917+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:39:35.917858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.348031+0000","last_change":"2023-10-03T19:16:46.346859+0000","last_active":"2023-10-03T19:16:46.348031+0000","last_peered":"2023-10-03T19:16:46.348031+0000","last_clean":"2023-10-03T19:16:46.348031+0000","last_became_active":"2023-10-03T19:16:46.346492+0000","last_became_peered":"2023-10-03T19:16:46.346492+0000","last_unstale":"2023-10-03T19:16:46.348031+0000","last_undegraded":"2023-10-03T19:16:46.348031+0000","last_fullsized":"2023-10-03T19:16:46.348031+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:59:33.879590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.303995+0000","last_change":"2023-10-03T19:16:45.947189+0000","last_active":"2023-10-03T19:16:46.303995+0000","last_peered":"2023-10-03T19:16:46.303995+0000","last_clean":"2023-10-03T19:16:46.303995+0000","last_became_active":"2023-10-03T19:16:45.946936+0000","last_became_peered":"2023-10-03T19:16:45.946936+0000","last_unstale":"2023-10-03T19:16:46.303995+0000","last_undegraded":"2023-10-03T19:16:46.303995+0000","last_fullsized":"2023-10-03T19:16:46.303995+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:14:23.283654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.379044+0000","last_change":"2023-10-03T19:16:46.365932+0000","last_active":"2023-10-03T19:16:46.379044+0000","last_peered":"2023-10-03T19:16:46.379044+0000","last_clean":"2023-10-03T19:16:46.379044+0000","last_became_active":"2023-10-03T19:16:46.362477+0000","last_became_peered":"2023-10-03T19:16:46.362477+0000","last_unstale":"2023-10-03T19:16:46.379044+0000","last_undegraded":"2023-10-03T19:16:46.379044+0000","last_fullsized":"2023-10-03T19:16:46.379044+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:47:38.571281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.303786+0000","last_change":"2023-10-03T19:16:45.963852+0000","last_active":"2023-10-03T19:16:46.303786+0000","last_peered":"2023-10-03T19:16:46.303786+0000","last_clean":"2023-10-03T19:16:46.303786+0000","last_became_active":"2023-10-03T19:16:45.963421+0000","last_became_peered":"2023-10-03T19:16:45.963421+0000","last_unstale":"2023-10-03T19:16:46.303786+0000","last_undegraded":"2023-10-03T19:16:46.303786+0000","last_fullsized":"2023-10-03T19:16:46.303786+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:40:17.427082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":3,"reported_epoch":60,"state":"creating+activating","last_fresh":"2023-10-03T19:16:46.303898+0000","last_change":"2023-10-03T19:16:46.303898+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:46.303898+0000","last_undegraded":"2023-10-03T19:16:46.303898+0000","last_fullsized":"2023-10-03T19:16:46.303898+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:54:01.595268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.338665+0000","last_change":"2023-10-03T19:16:45.985444+0000","last_active":"2023-10-03T19:16:46.338665+0000","last_peered":"2023-10-03T19:16:46.338665+0000","last_clean":"2023-10-03T19:16:46.338665+0000","last_became_active":"2023-10-03T19:16:45.984784+0000","last_became_peered":"2023-10-03T19:16:45.984784+0000","last_unstale":"2023-10-03T19:16:46.338665+0000","last_undegraded":"2023-10-03T19:16:46.338665+0000","last_fullsized":"2023-10-03T19:16:46.338665+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:55:43.921541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.319823+0000","last_change":"2023-10-03T19:16:46.317689+0000","last_active":"2023-10-03T19:16:46.319823+0000","last_peered":"2023-10-03T19:16:46.319823+0000","last_clean":"2023-10-03T19:16:46.319823+0000","last_became_active":"2023-10-03T19:16:46.317385+0000","last_became_peered":"2023-10-03T19:16:46.317385+0000","last_unstale":"2023-10-03T19:16:46.319823+0000","last_undegraded":"2023-10-03T19:16:46.319823+0000","last_fullsized":"2023-10-03T19:16:46.319823+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:13:34.942009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.334840+0000","last_change":"2023-10-03T19:16:45.986113+0000","last_active":"2023-10-03T19:16:46.334840+0000","last_peered":"2023-10-03T19:16:46.334840+0000","last_clean":"2023-10-03T19:16:46.334840+0000","last_became_active":"2023-10-03T19:16:45.985260+0000","last_became_peered":"2023-10-03T19:16:45.985260+0000","last_unstale":"2023-10-03T19:16:46.334840+0000","last_undegraded":"2023-10-03T19:16:46.334840+0000","last_fullsized":"2023-10-03T19:16:46.334840+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:50:36.723051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":3,"reported_epoch":60,"state":"creating+activating","last_fresh":"2023-10-03T19:16:46.303808+0000","last_change":"2023-10-03T19:16:46.303808+0000","last_active":"2023-10-03T19:16:45.921406+0000","last_peered":"2023-10-03T19:16:45.921406+0000","last_clean":"2023-10-03T19:16:45.921406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:16:46.303808+0000","last_undegraded":"2023-10-03T19:16:46.303808+0000","last_fullsized":"2023-10-03T19:16:46.303808+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:13:34.942009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.319272+0000","last_change":"2023-10-03T19:16:45.963314+0000","last_active":"2023-10-03T19:16:46.319272+0000","last_peered":"2023-10-03T19:16:46.319272+0000","last_clean":"2023-10-03T19:16:46.319272+0000","last_became_active":"2023-10-03T19:16:45.962565+0000","last_became_peered":"2023-10-03T19:16:45.962565+0000","last_unstale":"2023-10-03T19:16:46.319272+0000","last_undegraded":"2023-10-03T19:16:46.319272+0000","last_fullsized":"2023-10-03T19:16:46.319272+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:38:40.745903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.382640+0000","last_change":"2023-10-03T19:16:46.369750+0000","last_active":"2023-10-03T19:16:46.382640+0000","last_peered":"2023-10-03T19:16:46.382640+0000","last_clean":"2023-10-03T19:16:46.382640+0000","last_became_active":"2023-10-03T19:16:46.368994+0000","last_became_peered":"2023-10-03T19:16:46.368994+0000","last_unstale":"2023-10-03T19:16:46.382640+0000","last_undegraded":"2023-10-03T19:16:46.382640+0000","last_fullsized":"2023-10-03T19:16:46.382640+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:39:42.294017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"60'3","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.372238+0000","last_change":"2023-10-03T19:16:45.986493+0000","last_active":"2023-10-03T19:16:46.372238+0000","last_peered":"2023-10-03T19:16:46.372238+0000","last_clean":"2023-10-03T19:16:46.372238+0000","last_became_active":"2023-10-03T19:16:45.985657+0000","last_became_peered":"2023-10-03T19:16:45.985657+0000","last_unstale":"2023-10-03T19:16:46.372238+0000","last_undegraded":"2023-10-03T19:16:46.372238+0000","last_fullsized":"2023-10-03T19:16:46.372238+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:17:49.085309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.373559+0000","last_change":"2023-10-03T19:16:46.349205+0000","last_active":"2023-10-03T19:16:46.373559+0000","last_peered":"2023-10-03T19:16:46.373559+0000","last_clean":"2023-10-03T19:16:46.373559+0000","last_became_active":"2023-10-03T19:16:46.348690+0000","last_became_peered":"2023-10-03T19:16:46.348690+0000","last_unstale":"2023-10-03T19:16:46.373559+0000","last_undegraded":"2023-10-03T19:16:46.373559+0000","last_fullsized":"2023-10-03T19:16:46.373559+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:26:38.764887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"60'6","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.377937+0000","last_change":"2023-10-03T19:16:45.967950+0000","last_active":"2023-10-03T19:16:46.377937+0000","last_peered":"2023-10-03T19:16:46.377937+0000","last_clean":"2023-10-03T19:16:46.377937+0000","last_became_active":"2023-10-03T19:16:45.967600+0000","last_became_peered":"2023-10-03T19:16:45.967600+0000","last_unstale":"2023-10-03T19:16:46.377937+0000","last_undegraded":"2023-10-03T19:16:46.377937+0000","last_fullsized":"2023-10-03T19:16:46.377937+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:20:31.279031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.376767+0000","last_change":"2023-10-03T19:16:46.356075+0000","last_active":"2023-10-03T19:16:46.376767+0000","last_peered":"2023-10-03T19:16:46.376767+0000","last_clean":"2023-10-03T19:16:46.376767+0000","last_became_active":"2023-10-03T19:16:46.355562+0000","last_became_peered":"2023-10-03T19:16:46.355562+0000","last_unstale":"2023-10-03T19:16:46.376767+0000","last_undegraded":"2023-10-03T19:16:46.376767+0000","last_fullsized":"2023-10-03T19:16:46.376767+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:47:38.571281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"60'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.373230+0000","last_change":"2023-10-03T19:16:45.987343+0000","last_active":"2023-10-03T19:16:46.373230+0000","last_peered":"2023-10-03T19:16:46.373230+0000","last_clean":"2023-10-03T19:16:46.373230+0000","last_became_active":"2023-10-03T19:16:45.986702+0000","last_became_peered":"2023-10-03T19:16:45.986702+0000","last_unstale":"2023-10-03T19:16:46.373230+0000","last_undegraded":"2023-10-03T19:16:46.373230+0000","last_fullsized":"2023-10-03T19:16:46.373230+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:12:08.318383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.319146+0000","last_change":"2023-10-03T19:16:46.356897+0000","last_active":"2023-10-03T19:16:47.319146+0000","last_peered":"2023-10-03T19:16:47.319146+0000","last_clean":"2023-10-03T19:16:47.319146+0000","last_became_active":"2023-10-03T19:16:46.356141+0000","last_became_peered":"2023-10-03T19:16:46.356141+0000","last_unstale":"2023-10-03T19:16:47.319146+0000","last_undegraded":"2023-10-03T19:16:47.319146+0000","last_fullsized":"2023-10-03T19:16:47.319146+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:58:53.485536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.319431+0000","last_change":"2023-10-03T19:16:45.954269+0000","last_active":"2023-10-03T19:16:47.319431+0000","last_peered":"2023-10-03T19:16:47.319431+0000","last_clean":"2023-10-03T19:16:47.319431+0000","last_became_active":"2023-10-03T19:16:45.951703+0000","last_became_peered":"2023-10-03T19:16:45.951703+0000","last_unstale":"2023-10-03T19:16:47.319431+0000","last_undegraded":"2023-10-03T19:16:47.319431+0000","last_fullsized":"2023-10-03T19:16:47.319431+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:13:25.094973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.382779+0000","last_change":"2023-10-03T19:16:46.376007+0000","last_active":"2023-10-03T19:16:46.382779+0000","last_peered":"2023-10-03T19:16:46.382779+0000","last_clean":"2023-10-03T19:16:46.382779+0000","last_became_active":"2023-10-03T19:16:46.375324+0000","last_became_peered":"2023-10-03T19:16:46.375324+0000","last_unstale":"2023-10-03T19:16:46.382779+0000","last_undegraded":"2023-10-03T19:16:46.382779+0000","last_fullsized":"2023-10-03T19:16:46.382779+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:26:38.764887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.330299+0000","last_change":"2023-10-03T19:16:45.987260+0000","last_active":"2023-10-03T19:16:46.330299+0000","last_peered":"2023-10-03T19:16:46.330299+0000","last_clean":"2023-10-03T19:16:46.330299+0000","last_became_active":"2023-10-03T19:16:45.984760+0000","last_became_peered":"2023-10-03T19:16:45.984760+0000","last_unstale":"2023-10-03T19:16:46.330299+0000","last_undegraded":"2023-10-03T19:16:46.330299+0000","last_fullsized":"2023-10-03T19:16:46.330299+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:07:06.884577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.344612+0000","last_change":"2023-10-03T19:16:46.343379+0000","last_active":"2023-10-03T19:16:46.344612+0000","last_peered":"2023-10-03T19:16:46.344612+0000","last_clean":"2023-10-03T19:16:46.344612+0000","last_became_active":"2023-10-03T19:16:46.343101+0000","last_became_peered":"2023-10-03T19:16:46.343101+0000","last_unstale":"2023-10-03T19:16:46.344612+0000","last_undegraded":"2023-10-03T19:16:46.344612+0000","last_fullsized":"2023-10-03T19:16:46.344612+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:27:11.167546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"60'8","reported_seq":19,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.379864+0000","last_change":"2023-10-03T19:16:45.985749+0000","last_active":"2023-10-03T19:16:46.379864+0000","last_peered":"2023-10-03T19:16:46.379864+0000","last_clean":"2023-10-03T19:16:46.379864+0000","last_became_active":"2023-10-03T19:16:45.985075+0000","last_became_peered":"2023-10-03T19:16:45.985075+0000","last_unstale":"2023-10-03T19:16:46.379864+0000","last_undegraded":"2023-10-03T19:16:46.379864+0000","last_fullsized":"2023-10-03T19:16:46.379864+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:11:47.385670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.355603+0000","last_change":"2023-10-03T19:16:46.354674+0000","last_active":"2023-10-03T19:16:46.355603+0000","last_peered":"2023-10-03T19:16:46.355603+0000","last_clean":"2023-10-03T19:16:46.355603+0000","last_became_active":"2023-10-03T19:16:46.354269+0000","last_became_peered":"2023-10-03T19:16:46.354269+0000","last_unstale":"2023-10-03T19:16:46.355603+0000","last_undegraded":"2023-10-03T19:16:46.355603+0000","last_fullsized":"2023-10-03T19:16:46.355603+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:08:45.168337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"60'2","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.321134+0000","last_change":"2023-10-03T19:16:45.987491+0000","last_active":"2023-10-03T19:16:47.321134+0000","last_peered":"2023-10-03T19:16:47.321134+0000","last_clean":"2023-10-03T19:16:47.321134+0000","last_became_active":"2023-10-03T19:16:45.986716+0000","last_became_peered":"2023-10-03T19:16:45.986716+0000","last_unstale":"2023-10-03T19:16:47.321134+0000","last_undegraded":"2023-10-03T19:16:47.321134+0000","last_fullsized":"2023-10-03T19:16:47.321134+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:34:10.585937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.319948+0000","last_change":"2023-10-03T19:16:46.315032+0000","last_active":"2023-10-03T19:16:46.319948+0000","last_peered":"2023-10-03T19:16:46.319948+0000","last_clean":"2023-10-03T19:16:46.319948+0000","last_became_active":"2023-10-03T19:16:46.314754+0000","last_became_peered":"2023-10-03T19:16:46.314754+0000","last_unstale":"2023-10-03T19:16:46.319948+0000","last_undegraded":"2023-10-03T19:16:46.319948+0000","last_fullsized":"2023-10-03T19:16:46.319948+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:29:49.777567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.320964+0000","last_change":"2023-10-03T19:16:45.962997+0000","last_active":"2023-10-03T19:16:47.320964+0000","last_peered":"2023-10-03T19:16:47.320964+0000","last_clean":"2023-10-03T19:16:47.320964+0000","last_became_active":"2023-10-03T19:16:45.962167+0000","last_became_peered":"2023-10-03T19:16:45.962167+0000","last_unstale":"2023-10-03T19:16:47.320964+0000","last_undegraded":"2023-10-03T19:16:47.320964+0000","last_fullsized":"2023-10-03T19:16:47.320964+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:48:15.715329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.320479+0000","last_change":"2023-10-03T19:16:46.352102+0000","last_active":"2023-10-03T19:16:47.320479+0000","last_peered":"2023-10-03T19:16:47.320479+0000","last_clean":"2023-10-03T19:16:47.320479+0000","last_became_active":"2023-10-03T19:16:46.351658+0000","last_became_peered":"2023-10-03T19:16:46.351658+0000","last_unstale":"2023-10-03T19:16:47.320479+0000","last_undegraded":"2023-10-03T19:16:47.320479+0000","last_fullsized":"2023-10-03T19:16:47.320479+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:06:15.737400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.308406+0000","last_change":"2023-10-03T19:16:45.962886+0000","last_active":"2023-10-03T19:16:46.308406+0000","last_peered":"2023-10-03T19:16:46.308406+0000","last_clean":"2023-10-03T19:16:46.308406+0000","last_became_active":"2023-10-03T19:16:45.962180+0000","last_became_peered":"2023-10-03T19:16:45.962180+0000","last_unstale":"2023-10-03T19:16:46.308406+0000","last_undegraded":"2023-10-03T19:16:46.308406+0000","last_fullsized":"2023-10-03T19:16:46.308406+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:00:57.559577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.382604+0000","last_change":"2023-10-03T19:16:46.368611+0000","last_active":"2023-10-03T19:16:46.382604+0000","last_peered":"2023-10-03T19:16:46.382604+0000","last_clean":"2023-10-03T19:16:46.382604+0000","last_became_active":"2023-10-03T19:16:46.367938+0000","last_became_peered":"2023-10-03T19:16:46.367938+0000","last_unstale":"2023-10-03T19:16:46.382604+0000","last_undegraded":"2023-10-03T19:16:46.382604+0000","last_fullsized":"2023-10-03T19:16:46.382604+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:52:34.746547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.313791+0000","last_change":"2023-10-03T19:16:45.967954+0000","last_active":"2023-10-03T19:16:46.313791+0000","last_peered":"2023-10-03T19:16:46.313791+0000","last_clean":"2023-10-03T19:16:46.313791+0000","last_became_active":"2023-10-03T19:16:45.967581+0000","last_became_peered":"2023-10-03T19:16:45.967581+0000","last_unstale":"2023-10-03T19:16:46.313791+0000","last_undegraded":"2023-10-03T19:16:46.313791+0000","last_fullsized":"2023-10-03T19:16:46.313791+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:45:37.045472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.378791+0000","last_change":"2023-10-03T19:16:46.362149+0000","last_active":"2023-10-03T19:16:46.378791+0000","last_peered":"2023-10-03T19:16:46.378791+0000","last_clean":"2023-10-03T19:16:46.378791+0000","last_became_active":"2023-10-03T19:16:46.361627+0000","last_became_peered":"2023-10-03T19:16:46.361627+0000","last_unstale":"2023-10-03T19:16:46.378791+0000","last_undegraded":"2023-10-03T19:16:46.378791+0000","last_fullsized":"2023-10-03T19:16:46.378791+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:28:53.885325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.333806+0000","last_change":"2023-10-03T19:16:45.986852+0000","last_active":"2023-10-03T19:16:46.333806+0000","last_peered":"2023-10-03T19:16:46.333806+0000","last_clean":"2023-10-03T19:16:46.333806+0000","last_became_active":"2023-10-03T19:16:45.985615+0000","last_became_peered":"2023-10-03T19:16:45.985615+0000","last_unstale":"2023-10-03T19:16:46.333806+0000","last_undegraded":"2023-10-03T19:16:46.333806+0000","last_fullsized":"2023-10-03T19:16:46.333806+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:31:27.554913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.374699+0000","last_change":"2023-10-03T19:16:46.355632+0000","last_active":"2023-10-03T19:16:46.374699+0000","last_peered":"2023-10-03T19:16:46.374699+0000","last_clean":"2023-10-03T19:16:46.374699+0000","last_became_active":"2023-10-03T19:16:46.355020+0000","last_became_peered":"2023-10-03T19:16:46.355020+0000","last_unstale":"2023-10-03T19:16:46.374699+0000","last_undegraded":"2023-10-03T19:16:46.374699+0000","last_fullsized":"2023-10-03T19:16:46.374699+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:52:34.746547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.304143+0000","last_change":"2023-10-03T19:16:45.944273+0000","last_active":"2023-10-03T19:16:46.304143+0000","last_peered":"2023-10-03T19:16:46.304143+0000","last_clean":"2023-10-03T19:16:46.304143+0000","last_became_active":"2023-10-03T19:16:45.943995+0000","last_became_peered":"2023-10-03T19:16:45.943995+0000","last_unstale":"2023-10-03T19:16:46.304143+0000","last_undegraded":"2023-10-03T19:16:46.304143+0000","last_fullsized":"2023-10-03T19:16:46.304143+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:56:23.017353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.343879+0000","last_change":"2023-10-03T19:16:46.342684+0000","last_active":"2023-10-03T19:16:46.343879+0000","last_peered":"2023-10-03T19:16:46.343879+0000","last_clean":"2023-10-03T19:16:46.343879+0000","last_became_active":"2023-10-03T19:16:46.342293+0000","last_became_peered":"2023-10-03T19:16:46.342293+0000","last_unstale":"2023-10-03T19:16:46.343879+0000","last_undegraded":"2023-10-03T19:16:46.343879+0000","last_fullsized":"2023-10-03T19:16:46.343879+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:14:24.294462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.303651+0000","last_change":"2023-10-03T19:16:45.964339+0000","last_active":"2023-10-03T19:16:46.303651+0000","last_peered":"2023-10-03T19:16:46.303651+0000","last_clean":"2023-10-03T19:16:46.303651+0000","last_became_active":"2023-10-03T19:16:45.963814+0000","last_became_peered":"2023-10-03T19:16:45.963814+0000","last_unstale":"2023-10-03T19:16:46.303651+0000","last_undegraded":"2023-10-03T19:16:46.303651+0000","last_fullsized":"2023-10-03T19:16:46.303651+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:34:29.129059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.355035+0000","last_change":"2023-10-03T19:16:46.354068+0000","last_active":"2023-10-03T19:16:46.355035+0000","last_peered":"2023-10-03T19:16:46.355035+0000","last_clean":"2023-10-03T19:16:46.355035+0000","last_became_active":"2023-10-03T19:16:46.353774+0000","last_became_peered":"2023-10-03T19:16:46.353774+0000","last_unstale":"2023-10-03T19:16:46.355035+0000","last_undegraded":"2023-10-03T19:16:46.355035+0000","last_fullsized":"2023-10-03T19:16:46.355035+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:10:40.127195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.312472+0000","last_change":"2023-10-03T19:16:45.972785+0000","last_active":"2023-10-03T19:16:46.312472+0000","last_peered":"2023-10-03T19:16:46.312472+0000","last_clean":"2023-10-03T19:16:46.312472+0000","last_became_active":"2023-10-03T19:16:45.972526+0000","last_became_peered":"2023-10-03T19:16:45.972526+0000","last_unstale":"2023-10-03T19:16:46.312472+0000","last_undegraded":"2023-10-03T19:16:46.312472+0000","last_fullsized":"2023-10-03T19:16:46.312472+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:56:23.017353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.382575+0000","last_change":"2023-10-03T19:16:46.368258+0000","last_active":"2023-10-03T19:16:46.382575+0000","last_peered":"2023-10-03T19:16:46.382575+0000","last_clean":"2023-10-03T19:16:46.382575+0000","last_became_active":"2023-10-03T19:16:46.367559+0000","last_became_peered":"2023-10-03T19:16:46.367559+0000","last_unstale":"2023-10-03T19:16:46.382575+0000","last_undegraded":"2023-10-03T19:16:46.382575+0000","last_fullsized":"2023-10-03T19:16:46.382575+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:42:11.101433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.303561+0000","last_change":"2023-10-03T19:16:45.940912+0000","last_active":"2023-10-03T19:16:46.303561+0000","last_peered":"2023-10-03T19:16:46.303561+0000","last_clean":"2023-10-03T19:16:46.303561+0000","last_became_active":"2023-10-03T19:16:45.940610+0000","last_became_peered":"2023-10-03T19:16:45.940610+0000","last_unstale":"2023-10-03T19:16:46.303561+0000","last_undegraded":"2023-10-03T19:16:46.303561+0000","last_fullsized":"2023-10-03T19:16:46.303561+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:59:41.638843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":243,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.328586+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:16:46.328586+0000","last_peered":"2023-10-03T19:16:46.328586+0000","last_clean":"2023-10-03T19:16:46.328586+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:16:46.328586+0000","last_undegraded":"2023-10-03T19:16:46.328586+0000","last_fullsized":"2023-10-03T19:16:46.328586+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:11:26.721249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.320073+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:16:47.320073+0000","last_peered":"2023-10-03T19:16:47.320073+0000","last_clean":"2023-10-03T19:16:47.320073+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:16:47.320073+0000","last_undegraded":"2023-10-03T19:16:47.320073+0000","last_fullsized":"2023-10-03T19:16:47.320073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:26:43.642312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.319262+0000","last_change":"2023-10-03T19:16:46.316571+0000","last_active":"2023-10-03T19:16:46.319262+0000","last_peered":"2023-10-03T19:16:46.319262+0000","last_clean":"2023-10-03T19:16:46.319262+0000","last_became_active":"2023-10-03T19:16:46.316239+0000","last_became_peered":"2023-10-03T19:16:46.316239+0000","last_unstale":"2023-10-03T19:16:46.319262+0000","last_undegraded":"2023-10-03T19:16:46.319262+0000","last_fullsized":"2023-10-03T19:16:46.319262+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:08:12.582559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"60'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.326562+0000","last_change":"2023-10-03T19:16:45.972887+0000","last_active":"2023-10-03T19:16:46.326562+0000","last_peered":"2023-10-03T19:16:46.326562+0000","last_clean":"2023-10-03T19:16:46.326562+0000","last_became_active":"2023-10-03T19:16:45.972559+0000","last_became_peered":"2023-10-03T19:16:45.972559+0000","last_unstale":"2023-10-03T19:16:46.326562+0000","last_undegraded":"2023-10-03T19:16:46.326562+0000","last_fullsized":"2023-10-03T19:16:46.326562+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:22:51.054619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":91,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.328210+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:16:46.328210+0000","last_peered":"2023-10-03T19:16:46.328210+0000","last_clean":"2023-10-03T19:16:46.328210+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:16:46.328210+0000","last_undegraded":"2023-10-03T19:16:46.328210+0000","last_fullsized":"2023-10-03T19:16:46.328210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:55:03.497461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.319143+0000","last_change":"2023-10-03T19:16:46.319004+0000","last_active":"2023-10-03T19:16:47.319143+0000","last_peered":"2023-10-03T19:16:47.319143+0000","last_clean":"2023-10-03T19:16:47.319143+0000","last_became_active":"2023-10-03T19:16:46.318336+0000","last_became_peered":"2023-10-03T19:16:46.318336+0000","last_unstale":"2023-10-03T19:16:47.319143+0000","last_undegraded":"2023-10-03T19:16:47.319143+0000","last_fullsized":"2023-10-03T19:16:47.319143+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:01:03.753920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.319742+0000","last_change":"2023-10-03T19:16:45.952405+0000","last_active":"2023-10-03T19:16:47.319742+0000","last_peered":"2023-10-03T19:16:47.319742+0000","last_clean":"2023-10-03T19:16:47.319742+0000","last_became_active":"2023-10-03T19:16:45.950673+0000","last_became_peered":"2023-10-03T19:16:45.950673+0000","last_unstale":"2023-10-03T19:16:47.319742+0000","last_undegraded":"2023-10-03T19:16:47.319742+0000","last_fullsized":"2023-10-03T19:16:47.319742+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:31:23.819097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":89,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.308380+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:16:46.308380+0000","last_peered":"2023-10-03T19:16:46.308380+0000","last_clean":"2023-10-03T19:16:46.308380+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:16:46.308380+0000","last_undegraded":"2023-10-03T19:16:46.308380+0000","last_fullsized":"2023-10-03T19:16:46.308380+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:21:56.372171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.378783+0000","last_change":"2023-10-03T19:16:46.362051+0000","last_active":"2023-10-03T19:16:46.378783+0000","last_peered":"2023-10-03T19:16:46.378783+0000","last_clean":"2023-10-03T19:16:46.378783+0000","last_became_active":"2023-10-03T19:16:46.361490+0000","last_became_peered":"2023-10-03T19:16:46.361490+0000","last_unstale":"2023-10-03T19:16:46.378783+0000","last_undegraded":"2023-10-03T19:16:46.378783+0000","last_fullsized":"2023-10-03T19:16:46.378783+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:18:58.638268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.308013+0000","last_change":"2023-10-03T19:16:45.981839+0000","last_active":"2023-10-03T19:16:46.308013+0000","last_peered":"2023-10-03T19:16:46.308013+0000","last_clean":"2023-10-03T19:16:46.308013+0000","last_became_active":"2023-10-03T19:16:45.981437+0000","last_became_peered":"2023-10-03T19:16:45.981437+0000","last_unstale":"2023-10-03T19:16:46.308013+0000","last_undegraded":"2023-10-03T19:16:46.308013+0000","last_fullsized":"2023-10-03T19:16:46.308013+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:22:49.705264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.319994+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:16:47.319994+0000","last_peered":"2023-10-03T19:16:47.319994+0000","last_clean":"2023-10-03T19:16:47.319994+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:16:47.319994+0000","last_undegraded":"2023-10-03T19:16:47.319994+0000","last_fullsized":"2023-10-03T19:16:47.319994+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:04:44.386638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.381693+0000","last_change":"2023-10-03T19:16:46.369329+0000","last_active":"2023-10-03T19:16:46.381693+0000","last_peered":"2023-10-03T19:16:46.381693+0000","last_clean":"2023-10-03T19:16:46.381693+0000","last_became_active":"2023-10-03T19:16:46.368233+0000","last_became_peered":"2023-10-03T19:16:46.368233+0000","last_unstale":"2023-10-03T19:16:46.381693+0000","last_undegraded":"2023-10-03T19:16:46.381693+0000","last_fullsized":"2023-10-03T19:16:46.381693+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:47:11.516626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"60'1","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.320383+0000","last_change":"2023-10-03T19:16:45.963091+0000","last_active":"2023-10-03T19:16:47.320383+0000","last_peered":"2023-10-03T19:16:47.320383+0000","last_clean":"2023-10-03T19:16:47.320383+0000","last_became_active":"2023-10-03T19:16:45.962361+0000","last_became_peered":"2023-10-03T19:16:45.962361+0000","last_unstale":"2023-10-03T19:16:47.320383+0000","last_undegraded":"2023-10-03T19:16:47.320383+0000","last_fullsized":"2023-10-03T19:16:47.320383+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:23:42.490777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":89,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.316693+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:16:46.316693+0000","last_peered":"2023-10-03T19:16:46.316693+0000","last_clean":"2023-10-03T19:16:46.316693+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:16:46.316693+0000","last_undegraded":"2023-10-03T19:16:46.316693+0000","last_fullsized":"2023-10-03T19:16:46.316693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:50:43.182186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.382825+0000","last_change":"2023-10-03T19:16:46.377006+0000","last_active":"2023-10-03T19:16:46.382825+0000","last_peered":"2023-10-03T19:16:46.382825+0000","last_clean":"2023-10-03T19:16:46.382825+0000","last_became_active":"2023-10-03T19:16:46.376427+0000","last_became_peered":"2023-10-03T19:16:46.376427+0000","last_unstale":"2023-10-03T19:16:46.382825+0000","last_undegraded":"2023-10-03T19:16:46.382825+0000","last_fullsized":"2023-10-03T19:16:46.382825+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:17:09.475416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"60'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.369510+0000","last_change":"2023-10-03T19:16:45.986459+0000","last_active":"2023-10-03T19:16:46.369510+0000","last_peered":"2023-10-03T19:16:46.369510+0000","last_clean":"2023-10-03T19:16:46.369510+0000","last_became_active":"2023-10-03T19:16:45.984797+0000","last_became_peered":"2023-10-03T19:16:45.984797+0000","last_unstale":"2023-10-03T19:16:46.369510+0000","last_undegraded":"2023-10-03T19:16:46.369510+0000","last_fullsized":"2023-10-03T19:16:46.369510+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:43:20.530235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.335522+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:16:46.335522+0000","last_peered":"2023-10-03T19:16:46.335522+0000","last_clean":"2023-10-03T19:16:46.335522+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:16:46.335522+0000","last_undegraded":"2023-10-03T19:16:46.335522+0000","last_fullsized":"2023-10-03T19:16:46.335522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:21:36.226307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.380050+0000","last_change":"2023-10-03T19:16:46.370333+0000","last_active":"2023-10-03T19:16:46.380050+0000","last_peered":"2023-10-03T19:16:46.380050+0000","last_clean":"2023-10-03T19:16:46.380050+0000","last_became_active":"2023-10-03T19:16:46.369709+0000","last_became_peered":"2023-10-03T19:16:46.369709+0000","last_unstale":"2023-10-03T19:16:46.380050+0000","last_undegraded":"2023-10-03T19:16:46.380050+0000","last_fullsized":"2023-10-03T19:16:46.380050+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:55:44.932349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"60'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.372385+0000","last_change":"2023-10-03T19:16:45.985981+0000","last_active":"2023-10-03T19:16:46.372385+0000","last_peered":"2023-10-03T19:16:46.372385+0000","last_clean":"2023-10-03T19:16:46.372385+0000","last_became_active":"2023-10-03T19:16:45.984863+0000","last_became_peered":"2023-10-03T19:16:45.984863+0000","last_unstale":"2023-10-03T19:16:46.372385+0000","last_undegraded":"2023-10-03T19:16:46.372385+0000","last_fullsized":"2023-10-03T19:16:46.372385+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:48:25.164498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":89,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.313818+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:16:46.313818+0000","last_peered":"2023-10-03T19:16:46.313818+0000","last_clean":"2023-10-03T19:16:46.313818+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:16:46.313818+0000","last_undegraded":"2023-10-03T19:16:46.313818+0000","last_fullsized":"2023-10-03T19:16:46.313818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:38:39.207017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.378847+0000","last_change":"2023-10-03T19:16:46.362431+0000","last_active":"2023-10-03T19:16:46.378847+0000","last_peered":"2023-10-03T19:16:46.378847+0000","last_clean":"2023-10-03T19:16:46.378847+0000","last_became_active":"2023-10-03T19:16:46.361629+0000","last_became_peered":"2023-10-03T19:16:46.361629+0000","last_unstale":"2023-10-03T19:16:46.378847+0000","last_undegraded":"2023-10-03T19:16:46.378847+0000","last_fullsized":"2023-10-03T19:16:46.378847+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:05:01.669511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.304042+0000","last_change":"2023-10-03T19:16:45.967790+0000","last_active":"2023-10-03T19:16:46.304042+0000","last_peered":"2023-10-03T19:16:46.304042+0000","last_clean":"2023-10-03T19:16:46.304042+0000","last_became_active":"2023-10-03T19:16:45.967432+0000","last_became_peered":"2023-10-03T19:16:45.967432+0000","last_unstale":"2023-10-03T19:16:46.304042+0000","last_undegraded":"2023-10-03T19:16:46.304042+0000","last_fullsized":"2023-10-03T19:16:46.304042+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:27:10.156738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":89,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.351775+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:16:46.351775+0000","last_peered":"2023-10-03T19:16:46.351775+0000","last_clean":"2023-10-03T19:16:46.351775+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:16:46.351775+0000","last_undegraded":"2023-10-03T19:16:46.351775+0000","last_fullsized":"2023-10-03T19:16:46.351775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:34:18.140425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509496,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25616,"kb_used_data":776,"kb_used_omap":0,"kb_used_meta":24832,"kb_avail":94346224,"statfs":{"total":96636764160,"available":96610533376,"internally_reserved":0,"allocated":794624,"data_stored":906715,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":25427968},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.90900000000000003,"15min":0.94499999999999995},"min":{"1min":0.52000000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.196,"5min":4.0469999999999997,"15min":4.0469999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.85799999999999998,"15min":0.81200000000000006},"min":{"1min":0.625,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2310000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.62}]},{"osd":1,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94399999999999995,"15min":1.0269999999999999},"min":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3200000000000001,"5min":3.8239999999999998,"15min":3.8239999999999998},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.873,"5min":0.88300000000000001,"15min":0.85899999999999999},"min":{"1min":0.65800000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.159,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.96499999999999997}]},{"osd":2,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.93600000000000005,"15min":0.87},"min":{"1min":0.71499999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.212,"5min":6.0449999999999999,"15min":6.0449999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0029999999999999,"15min":1.04},"min":{"1min":0.77400000000000002,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.5800000000000001,"5min":3.98,"15min":3.98},"last":0.93200000000000005}]},{"osd":3,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.996,"15min":0.94399999999999995},"min":{"1min":0.65300000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.26,"5min":6.125,"15min":6.125},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0700000000000001,"15min":1.123},"min":{"1min":0.61899999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.444,"5min":3.9140000000000001,"15min":3.9140000000000001},"last":1.091}]},{"osd":4,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":1.036,"15min":1.1599999999999999},"min":{"1min":0.55900000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.421,"5min":5.1130000000000004,"15min":5.1130000000000004},"last":1.056},{"interface":"front","average":{"1min":0.92500000000000004,"5min":1.022,"15min":1.028},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.385,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":1.006}]},{"osd":5,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.135,"15min":1.268},"min":{"1min":0.72499999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.27,"5min":5.1859999999999999,"15min":5.1859999999999999},"last":1.1919999999999999},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0840000000000001,"15min":1.1459999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.216,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.163}]},{"osd":6,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0920000000000001,"15min":1.1000000000000001},"min":{"1min":0.78900000000000003,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.3440000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.179,"15min":1.1850000000000001},"min":{"1min":0.81799999999999995,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.466,"5min":6.1580000000000004,"15min":6.1580000000000004},"last":1.1359999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509496,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14784,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":14080,"kb_avail":94357056,"statfs":{"total":96636764160,"available":96621625344,"internally_reserved":0,"allocated":712704,"data_stored":314441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14417920},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83499999999999996,"15min":0.81899999999999995},"min":{"1min":0.60499999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.139,"5min":1.504,"15min":1.504},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.89900000000000002,"15min":0.88500000000000001},"min":{"1min":0.56699999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.171,"5min":1.839,"15min":1.839},"last":0.61199999999999999}]},{"osd":1,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.85699999999999998,"15min":0.84099999999999997},"min":{"1min":0.53100000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.1859999999999999,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89000000000000001,"15min":0.88},"min":{"1min":0.59799999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.127,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":1.004}]},{"osd":2,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.91700000000000004,"15min":0.874},"min":{"1min":0.65800000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3600000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.745},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.92100000000000004,"15min":0.92600000000000005},"min":{"1min":0.63200000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3200000000000001,"5min":1.546,"15min":1.546},"last":0.78900000000000003}]},{"osd":3,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.96599999999999997,"15min":0.98199999999999998},"min":{"1min":0.70799999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.91800000000000004,"15min":0.91200000000000003},"min":{"1min":0.69399999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1870000000000001,"5min":2.121,"15min":2.121},"last":0.83799999999999997}]},{"osd":4,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.97299999999999998,"15min":1.026},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.286,"5min":1.95,"15min":1.95},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0329999999999999,"15min":1.091},"min":{"1min":0.65500000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.429,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.0389999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.97199999999999998,"15min":1.0189999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.1259999999999999,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.079,"5min":1.0800000000000001,"15min":1.1200000000000001},"min":{"1min":0.75700000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.524,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.1140000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.093,"15min":1.121},"min":{"1min":0.73699999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.3220000000000001,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.137},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.071,"15min":1.097},"min":{"1min":0.79600000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4350000000000001,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.0800000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509497,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15564,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":14848,"kb_avail":94356276,"statfs":{"total":96636764160,"available":96620826624,"internally_reserved":0,"allocated":724992,"data_stored":317135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15204352},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.83499999999999996,"15min":0.79000000000000004},"min":{"1min":0.54700000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.87},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.83899999999999997,"15min":0.82499999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.026,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.78500000000000003}]},{"osd":1,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.92000000000000004,"15min":0.93200000000000005},"min":{"1min":0.61399999999999999,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.117,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.89700000000000002,"15min":0.86099999999999999},"min":{"1min":0.68799999999999994,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1799999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.72899999999999998}]},{"osd":2,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.93899999999999995,"15min":0.91700000000000004},"min":{"1min":0.56200000000000006,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2390000000000001,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.96599999999999997,"15min":0.94399999999999995},"min":{"1min":0.78300000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.1359999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":1.0940000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.89400000000000002,"15min":0.877},"min":{"1min":0.69199999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.153,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.996,"5min":1.0449999999999999,"15min":1.0649999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3400000000000001,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":1.155}]},{"osd":5,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.99099999999999999,"15min":1.05},"min":{"1min":0.67100000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1819999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.022},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.98099999999999998,"15min":1.0109999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.387,"5min":1.635,"15min":1.635},"last":1.0569999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.0780000000000001,"15min":1.1839999999999999},"min":{"1min":0.71499999999999997,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.1120000000000001,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.1120000000000001,"15min":1.181},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.3640000000000001,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":1.276}]},{"osd":7,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0509999999999999,"15min":1.085},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.242,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.212},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.1759999999999999,"15min":1.2250000000000001},"min":{"1min":0.85599999999999998,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3260000000000001,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":1.52}]}]},{"osd":2,"up_from":15,"seq":64424509497,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25660,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":24960,"kb_avail":94346180,"statfs":{"total":96636764160,"available":96610488320,"internally_reserved":0,"allocated":708608,"data_stored":314407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25559040},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.60399999999999998,"15min":0.54100000000000004},"min":{"1min":0.47099999999999997,"5min":0.247,"15min":0.247},"max":{"1min":1.1020000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.69599999999999995,"15min":0.63},"min":{"1min":0.30299999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.2350000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.65400000000000003}]},{"osd":1,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71299999999999997,"15min":0.63300000000000001},"min":{"1min":0.48599999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1739999999999999,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.67400000000000004,"15min":0.60399999999999998},"min":{"1min":0.42599999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.76700000000000002}]},{"osd":3,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.71499999999999997,"15min":0.63700000000000001},"min":{"1min":0.40500000000000003,"5min":0.224,"15min":0.224},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.82199999999999995,"15min":0.73599999999999999},"min":{"1min":0.44600000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1419999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.91600000000000004}]},{"osd":4,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.91800000000000004,"15min":0.85799999999999998},"min":{"1min":0.63,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":1.274},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.98599999999999999,"15min":0.92400000000000004},"min":{"1min":0.71499999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":1.0149999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.94999999999999996,"15min":0.876},"min":{"1min":0.76600000000000001,"5min":0.432,"15min":0.432},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0249999999999999,"15min":0.95099999999999996},"min":{"1min":0.68100000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4239999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.0740000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.96399999999999997,"15min":0.92200000000000004},"min":{"1min":0.66300000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.302},{"interface":"front","average":{"1min":1.139,"5min":1.0409999999999999,"15min":0.97699999999999998},"min":{"1min":0.64800000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":1.3839999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.0920000000000001,"15min":1.0169999999999999},"min":{"1min":0.74199999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":1.117},{"interface":"front","average":{"1min":1.109,"5min":1.024,"15min":0.96799999999999997},"min":{"1min":0.71099999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.361}]}]},{"osd":1,"up_from":15,"seq":64424509496,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14876,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":14144,"kb_avail":94356964,"statfs":{"total":96636764160,"available":96621531136,"internally_reserved":0,"allocated":741376,"data_stored":317899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14483456},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58499999999999996,"15min":0.54800000000000004},"min":{"1min":0.35899999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.96899999999999997,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.628,"15min":0.52400000000000002},"min":{"1min":0.45200000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.93200000000000005}]},{"osd":2,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.63600000000000001,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.75800000000000001,"15min":0.67500000000000004},"min":{"1min":0.44700000000000001,"5min":0.312,"15min":0.312},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.99199999999999999}]},{"osd":3,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.72499999999999998,"15min":0.64300000000000002},"min":{"1min":0.41699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.2370000000000001,"5min":1.27,"15min":1.27},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.69699999999999995,"15min":0.59699999999999998},"min":{"1min":0.47699999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1830000000000001,"5min":1.27,"15min":1.27},"last":0.66400000000000003}]},{"osd":4,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.86199999999999999,"15min":0.80700000000000005},"min":{"1min":0.69099999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.073},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.93799999999999994,"15min":0.89400000000000002},"min":{"1min":0.65900000000000003,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.2430000000000001}]},{"osd":5,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.94299999999999995,"15min":0.86799999999999999},"min":{"1min":0.69899999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":1.038},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.92000000000000004,"15min":0.85899999999999999},"min":{"1min":0.80700000000000005,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3959999999999999,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.2150000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.99399999999999999,"15min":0.93000000000000005},"min":{"1min":0.68999999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":0.97999999999999998,"15min":0.90400000000000003},"min":{"1min":0.879,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.329,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.1140000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0269999999999999,"15min":0.94799999999999995},"min":{"1min":0.78500000000000003,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.99299999999999999,"15min":0.91100000000000003},"min":{"1min":0.71899999999999997,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5880000000000001,"5min":1.649,"15min":1.649},"last":1.288}]}]},{"osd":3,"up_from":14,"seq":60129542200,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33896,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":33216,"kb_avail":94337944,"statfs":{"total":96636764160,"available":96602054656,"internally_reserved":0,"allocated":688128,"data_stored":301823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":34013184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.627,"15min":0.57699999999999996},"min":{"1min":0.40200000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.2090000000000001,"5min":1.212,"15min":1.212},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68700000000000006,"15min":0.64800000000000002},"min":{"1min":0.32900000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.125,"5min":1.236,"15min":1.236},"last":0.57699999999999996}]},{"osd":1,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.69399999999999995,"15min":0.63700000000000001},"min":{"1min":0.51400000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0589999999999999,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.73599999999999999,"15min":0.67300000000000004},"min":{"1min":0.53000000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.2210000000000001,"5min":1.222,"15min":1.222},"last":0.70099999999999996}]},{"osd":2,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.77600000000000002,"15min":0.71599999999999997},"min":{"1min":0.44600000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.083,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.70999999999999996,"15min":0.63700000000000001},"min":{"1min":0.432,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.89400000000000002}]},{"osd":4,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.94299999999999995,"15min":0.91500000000000004},"min":{"1min":0.58899999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.131,"5min":1.496,"15min":1.496},"last":0.876},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.97799999999999998,"15min":0.93799999999999994},"min":{"1min":0.64100000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.486,"5min":1.546,"15min":1.546},"last":1.175}]},{"osd":5,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.91800000000000004,"15min":0.88200000000000001},"min":{"1min":0.68300000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3280000000000001,"5min":1.51,"15min":1.51},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.044,"5min":1.0249999999999999,"15min":1},"min":{"1min":0.66300000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.387,"5min":1.498,"15min":1.498},"last":0.84799999999999998}]},{"osd":6,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.95999999999999996,"15min":0.92400000000000004},"min":{"1min":0.60899999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1639999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.212},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.042,"15min":0.99299999999999999},"min":{"1min":0.70299999999999996,"5min":0.625,"15min":0.625},"max":{"1min":1.2969999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.0780000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0489999999999999,"15min":1.0089999999999999},"min":{"1min":0.68899999999999995,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.395,"5min":1.597,"15min":1.597},"last":1.026},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.0700000000000001,"15min":1.024},"min":{"1min":0.72699999999999998,"5min":0.623,"15min":0.623},"max":{"1min":1.6040000000000001,"5min":1.708,"15min":1.708},"last":1.1539999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574904,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16272,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":15552,"kb_avail":94355568,"statfs":{"total":96636764160,"available":96620101632,"internally_reserved":0,"allocated":729088,"data_stored":322246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15925248},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.85699999999999998,"15min":0.82599999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.1919999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85899999999999999,"15min":0.85299999999999998},"min":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.77600000000000002}]},{"osd":1,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.85299999999999998,"15min":0.83399999999999996},"min":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0920000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.748},{"interface":"front","average":{"1min":0.873,"5min":0.91900000000000004,"15min":0.92500000000000004},"min":{"1min":0.59799999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.149,"5min":1.514,"15min":1.514},"last":0.98399999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.90800000000000003,"15min":0.89800000000000002},"min":{"1min":0.56299999999999994,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.234,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.90700000000000003,"15min":0.89700000000000002},"min":{"1min":0.66100000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1499999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.81000000000000005}]},{"osd":3,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.93200000000000005,"15min":0.92800000000000005},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.2629999999999999,"5min":1.304,"15min":1.304},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0369999999999999,"15min":1.0289999999999999},"min":{"1min":0.75,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.95999999999999996}]},{"osd":4,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.96499999999999997,"15min":0.96899999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.29,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.995,"15min":1.0309999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.222,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.006}]},{"osd":6,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.98899999999999999,"15min":1.0309999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2050000000000001,"5min":1.462,"15min":1.462},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.083,"5min":1.1200000000000001,"15min":1.1379999999999999},"min":{"1min":0.78200000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.3759999999999999,"5min":1.823,"15min":1.823},"last":0.88300000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.0640000000000001,"15min":1.0760000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3280000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.141,"15min":1.1519999999999999},"min":{"1min":0.79100000000000004,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.399,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.92900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21756,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":20992,"kb_avail":94350084,"statfs":{"total":96636764160,"available":96614486016,"internally_reserved":0,"allocated":774144,"data_stored":904775,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":21495808},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63100000000000001,"15min":0.58599999999999997},"min":{"1min":0.44400000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.75600000000000001,"15min":0.71899999999999997},"min":{"1min":0.5,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.1970000000000001,"5min":1.27,"15min":1.27},"last":0.59699999999999998}]},{"osd":2,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.73799999999999999,"15min":0.71799999999999997},"min":{"1min":0.50800000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1299999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.46800000000000003,"5min":0.315,"15min":0.315},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.82599999999999996}]},{"osd":3,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.82099999999999995,"15min":0.73699999999999999},"min":{"1min":0.59299999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.202,"5min":1.446,"15min":1.446},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.87,"5min":0.80000000000000004,"15min":0.70999999999999996},"min":{"1min":0.51000000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.304,"5min":1.375,"15min":1.375},"last":0.65300000000000002}]},{"osd":4,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.93000000000000005,"15min":0.91200000000000003},"min":{"1min":0.70299999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.052,"15min":1.028},"min":{"1min":0.89200000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.349,"5min":1.508,"15min":1.508},"last":0.79000000000000004}]},{"osd":5,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.073,"15min":1.0509999999999999},"min":{"1min":0.90400000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3129999999999999,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.875},{"interface":"front","average":{"1min":1.081,"5min":1.0209999999999999,"15min":0.98199999999999998},"min":{"1min":0.77100000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.86599999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.0600000000000001,"15min":1.022},"min":{"1min":0.81200000000000006,"5min":0.623,"15min":0.623},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.04,"15min":0.999},"min":{"1min":0.755,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.448,"5min":1.637,"15min":1.637},"last":1.093}]},{"osd":7,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.0860000000000001,"15min":1.042},"min":{"1min":0.72799999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.089,"15min":1.0629999999999999},"min":{"1min":0.76300000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5940000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.0469999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:16:50.917 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-03T19:16:50.910+0000 7f0ab2965640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-03T19:16:53.842 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:16:53.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.970+0000 7f72a6f81640 1 Processor -- start 2023-10-03T19:16:53.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f72a6f81640 1 -- start start 2023-10-03T19:16:53.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f72a6f81640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72a00a9f60 0x7f72a00c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:53.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f72a6f81640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72a014f120 con 0x7f72a00c5530 2023-10-03T19:16:53.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f72a6f81640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72a014f650 con 0x7f72a00c5160 2023-10-03T19:16:53.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f72a6f81640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a00aa430 con 0x7f72a00a9f60 2023-10-03T19:16:53.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f729ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f72a00c5530 0x7f72a00a9850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55560/0 (socket says 172.21.15.45:55560) 2023-10-03T19:16:53.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f729ffff640 1 -- 172.21.15.45:0/662529508 learned_addr learned my addr 172.21.15.45:0/662529508 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:53.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f729f7fe640 1 -- 172.21.15.45:0/662529508 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2678954437 0 0) 0x7f72a014f120 con 0x7f72a00c5530 2023-10-03T19:16:53.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f72a551e640 1 --2- 172.21.15.45:0/662529508 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72a00a9f60 0x7f72a00c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:53.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f729f7fe640 1 -- 172.21.15.45:0/662529508 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7288003530 con 0x7f72a00c5530 2023-10-03T19:16:53.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f729f7fe640 1 -- 172.21.15.45:0/662529508 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2397711233 0 0) 0x7f7288003530 con 0x7f72a00c5530 2023-10-03T19:16:53.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f729f7fe640 1 -- 172.21.15.45:0/662529508 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72a00a9f60 msgr2=0x7f72a00c3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:53.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f729f7fe640 1 --2- 172.21.15.45:0/662529508 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72a00a9f60 0x7f72a00c3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:53.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f729f7fe640 1 -- 172.21.15.45:0/662529508 >> v1:172.21.15.79:6789/0 conn(0x7f72a00c5160 legacy=0x7f72a0069ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:53.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f729f7fe640 1 -- 172.21.15.45:0/662529508 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a014f370 con 0x7f72a00c5530 2023-10-03T19:16:53.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f729f7fe640 1 -- 172.21.15.45:0/662529508 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f7294001a00 con 0x7f72a00c5530 2023-10-03T19:16:53.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f729f7fe640 1 -- 172.21.15.45:0/662529508 >> v1:172.21.15.45:6789/0 conn(0x7f72a00c5530 legacy=0x7f72a00a9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:53.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f729f7fe640 1 --2- 172.21.15.45:0/662529508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72880039b0 0x7f7288003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:53.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f729f7fe640 1 --2- 172.21.15.45:0/662529508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72880047d0 0x7f7288004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:53.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f729f7fe640 1 --2- 172.21.15.45:0/662529508 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72a00a9f60 0x7f72880051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:53.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f729f7fe640 1 -- 172.21.15.45:0/662529508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a00aa430 con 0x7f72880047d0 2023-10-03T19:16:53.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f729f7fe640 1 -- 172.21.15.45:0/662529508 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728800ba90 con 0x7f72880039b0 2023-10-03T19:16:53.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f729f7fe640 1 -- 172.21.15.45:0/662529508 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728800bc50 con 0x7f72a00a9f60 2023-10-03T19:16:53.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f729ffff640 1 --2- 172.21.15.45:0/662529508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72880047d0 0x7f7288004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:53.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f72a551e640 1 --2- 172.21.15.45:0/662529508 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72a00a9f60 0x7f72880051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:53.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f72a4d1d640 1 --2- 172.21.15.45:0/662529508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72880039b0 0x7f7288003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:53.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f729ffff640 1 -- 172.21.15.45:0/662529508 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72a00a9f60 msgr2=0x7f72880051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:53.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f729ffff640 1 --2- 172.21.15.45:0/662529508 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72a00a9f60 0x7f72880051a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:53.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f729ffff640 1 -- 172.21.15.45:0/662529508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72880039b0 msgr2=0x7f7288003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:53.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f729ffff640 1 --2- 172.21.15.45:0/662529508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72880039b0 0x7f7288003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:53.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f729ffff640 1 -- 172.21.15.45:0/662529508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7288003530 con 0x7f72880047d0 2023-10-03T19:16:53.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.974+0000 7f72a4d1d640 1 --2- 172.21.15.45:0/662529508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72880039b0 0x7f7288003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:53.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.978+0000 7f729ffff640 1 --2- 172.21.15.45:0/662529508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72880047d0 0x7f7288004c40 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f729400a830 tx=0x7f729401d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98cd56f4bedcea1a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:53.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.978+0000 7f729f7fe640 1 -- 172.21.15.45:0/662529508 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a006b7a0 con 0x7f72880047d0 2023-10-03T19:16:53.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.978+0000 7f729f7fe640 1 -- 172.21.15.45:0/662529508 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72940a8070 con 0x7f72880047d0 2023-10-03T19:16:53.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.978+0000 7f729f7fe640 1 -- 172.21.15.45:0/662529508 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7294007550 con 0x7f72880047d0 2023-10-03T19:16:53.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.978+0000 7f72a6f81640 1 -- 172.21.15.45:0/662529508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72880047d0 msgr2=0x7f7288004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:53.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.978+0000 7f72a6f81640 1 --2- 172.21.15.45:0/662529508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72880047d0 0x7f7288004c40 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f729400a830 tx=0x7f729401d340 comp rx=0 tx=0).stop 2023-10-03T19:16:53.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.978+0000 7f72a551e640 1 -- 172.21.15.45:0/662529508 reap_dead start 2023-10-03T19:16:53.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.978+0000 7f72a6f81640 1 -- 172.21.15.45:0/662529508 shutdown_connections 2023-10-03T19:16:53.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.978+0000 7f72a6f81640 1 -- 172.21.15.45:0/662529508 >> 172.21.15.45:0/662529508 conn(0x7f72a00a7080 msgr2=0x7f72a00c4880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:53.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.978+0000 7f72a6f81640 1 -- 172.21.15.45:0/662529508 shutdown_connections 2023-10-03T19:16:53.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.978+0000 7f72a6f81640 1 -- 172.21.15.45:0/662529508 wait complete. 2023-10-03T19:16:53.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.978+0000 7f72a6f81640 1 Processor -- start 2023-10-03T19:16:53.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.978+0000 7f72a6f81640 1 -- start start 2023-10-03T19:16:53.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.978+0000 7f72a6f81640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72a00a4380 0x7f72a00a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:53.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.978+0000 7f72a6f81640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72a00ba400 0x7f72a0157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:53.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.978+0000 7f72a6f81640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72a0157990 0x7f72a00b8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:53.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.978+0000 7f72a6f81640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a014fd50 con 0x7f72a0157990 2023-10-03T19:16:53.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.978+0000 7f72a6f81640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a0152ab0 con 0x7f72a00ba400 2023-10-03T19:16:53.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.978+0000 7f72a6f81640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a00be150 con 0x7f72a00a4380 2023-10-03T19:16:53.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.978+0000 7f72a551e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72a0157990 0x7f72a00b8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:53.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.978+0000 7f72a551e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72a0157990 0x7f72a00b8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37096/0 (socket says 172.21.15.45:37096) 2023-10-03T19:16:53.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.978+0000 7f72a551e640 1 -- 172.21.15.45:0/1241310475 learned_addr learned my addr 172.21.15.45:0/1241310475 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:53.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.978+0000 7f72a4d1d640 1 --2- 172.21.15.45:0/1241310475 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72a00a4380 0x7f72a00a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:53.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.978+0000 7f729ffff640 1 --2- 172.21.15.45:0/1241310475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72a00ba400 0x7f72a0157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:53.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.978+0000 7f72a551e640 1 -- 172.21.15.45:0/1241310475 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72a00a4380 msgr2=0x7f72a00a4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:53.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.978+0000 7f72a551e640 1 --2- 172.21.15.45:0/1241310475 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72a00a4380 0x7f72a00a4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:53.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.978+0000 7f72a551e640 1 -- 172.21.15.45:0/1241310475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72a00ba400 msgr2=0x7f72a0157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:53.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.978+0000 7f72a551e640 1 --2- 172.21.15.45:0/1241310475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72a00ba400 0x7f72a0157450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:53.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.978+0000 7f72a551e640 1 -- 172.21.15.45:0/1241310475 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a00c4640 con 0x7f72a0157990 2023-10-03T19:16:53.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.982+0000 7f72a551e640 1 --2- 172.21.15.45:0/1241310475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72a0157990 0x7f72a00b8fa0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f72a0152cd0 tx=0x7f7298010580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:53.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.982+0000 7f729d7fa640 1 -- 172.21.15.45:0/1241310475 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7298010d40 con 0x7f72a0157990 2023-10-03T19:16:53.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.982+0000 7f729d7fa640 1 -- 172.21.15.45:0/1241310475 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7298010ea0 con 0x7f72a0157990 2023-10-03T19:16:53.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.982+0000 7f729d7fa640 1 -- 172.21.15.45:0/1241310475 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7298014630 con 0x7f72a0157990 2023-10-03T19:16:53.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.982+0000 7f72a6f81640 1 -- 172.21.15.45:0/1241310475 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72a00c44b0 con 0x7f72a0157990 2023-10-03T19:16:53.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.982+0000 7f72a6f81640 1 -- 172.21.15.45:0/1241310475 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72a00c0d30 con 0x7f72a0157990 2023-10-03T19:16:53.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.982+0000 7f729d7fa640 1 -- 172.21.15.45:0/1241310475 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7298014790 con 0x7f72a0157990 2023-10-03T19:16:53.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.982+0000 7f72a6f81640 1 -- 172.21.15.45:0/1241310475 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72a004de80 con 0x7f72a0157990 2023-10-03T19:16:53.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.982+0000 7f729d7fa640 1 --2- 172.21.15.45:0/1241310475 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f728c066280 0x7f728c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:53.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.982+0000 7f729d7fa640 1 -- 172.21.15.45:0/1241310475 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f72980835e0 con 0x7f72a0157990 2023-10-03T19:16:53.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.982+0000 7f72a4d1d640 1 --2- 172.21.15.45:0/1241310475 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f728c066280 0x7f728c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:53.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.982+0000 7f72a4d1d640 1 --2- 172.21.15.45:0/1241310475 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f728c066280 0x7f728c068730 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7290001640 tx=0x7f7290009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:53.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:53.986+0000 7f729d7fa640 1 -- 172.21.15.45:0/1241310475 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f72980544e0 con 0x7f72a0157990 2023-10-03T19:16:54.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.134+0000 7f72a6f81640 1 -- 172.21.15.45:0/1241310475 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f72a006b0b0 con 0x7f728c066280 2023-10-03T19:16:54.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.162+0000 7f729d7fa640 1 -- 172.21.15.45:0/1241310475 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310391 (secure 0 0 0) 0x7f72a006b0b0 con 0x7f728c066280 2023-10-03T19:16:54.167 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:16:54.169 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:16:54.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.162+0000 7f72a6f81640 1 -- 172.21.15.45:0/1241310475 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f728c066280 msgr2=0x7f728c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:54.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.162+0000 7f72a6f81640 1 --2- 172.21.15.45:0/1241310475 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f728c066280 0x7f728c068730 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7290001640 tx=0x7f7290009040 comp rx=0 tx=0).stop 2023-10-03T19:16:54.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.162+0000 7f72a6f81640 1 -- 172.21.15.45:0/1241310475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72a0157990 msgr2=0x7f72a00b8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:54.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.162+0000 7f72a6f81640 1 --2- 172.21.15.45:0/1241310475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72a0157990 0x7f72a00b8fa0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f72a0152cd0 tx=0x7f7298010580 comp rx=0 tx=0).stop 2023-10-03T19:16:54.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.162+0000 7f72a6f81640 1 -- 172.21.15.45:0/1241310475 shutdown_connections 2023-10-03T19:16:54.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.162+0000 7f72a6f81640 1 --2- 172.21.15.45:0/1241310475 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f728c066280 0x7f728c068730 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:54.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.162+0000 7f72a6f81640 1 --2- 172.21.15.45:0/1241310475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72a0157990 0x7f72a00b8fa0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:54.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.162+0000 7f72a6f81640 1 --2- 172.21.15.45:0/1241310475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72a00ba400 0x7f72a0157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:54.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.162+0000 7f72a6f81640 1 --2- 172.21.15.45:0/1241310475 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72a00a4380 0x7f72a00a4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:54.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.162+0000 7f72a6f81640 1 -- 172.21.15.45:0/1241310475 >> 172.21.15.45:0/1241310475 conn(0x7f72a00a7080 msgr2=0x7f72a0069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:54.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.162+0000 7f72a6f81640 1 -- 172.21.15.45:0/1241310475 shutdown_connections 2023-10-03T19:16:54.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.162+0000 7f72a6f81640 1 -- 172.21.15.45:0/1241310475 wait complete. 2023-10-03T19:16:54.185 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2023-10-03T19:16:52.538382+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":168776,"kb_used_data":5832,"kb_used_omap":0,"kb_used_meta":162880,"kb_avail":754805944,"statfs":{"total":773094113280,"available":772921286656,"internally_reserved":0,"allocated":5971968,"data_stored":3753107,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":166789120},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.606896"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.132875+0000","last_change":"2023-10-03T19:16:46.354281+0000","last_active":"2023-10-03T19:16:48.132875+0000","last_peered":"2023-10-03T19:16:48.132875+0000","last_clean":"2023-10-03T19:16:48.132875+0000","last_became_active":"2023-10-03T19:16:46.353863+0000","last_became_peered":"2023-10-03T19:16:46.353863+0000","last_unstale":"2023-10-03T19:16:48.132875+0000","last_undegraded":"2023-10-03T19:16:48.132875+0000","last_fullsized":"2023-10-03T19:16:48.132875+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:13:28.901763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.132635+0000","last_change":"2023-10-03T19:16:46.318712+0000","last_active":"2023-10-03T19:16:48.132635+0000","last_peered":"2023-10-03T19:16:48.132635+0000","last_clean":"2023-10-03T19:16:48.132635+0000","last_became_active":"2023-10-03T19:16:46.318367+0000","last_became_peered":"2023-10-03T19:16:46.318367+0000","last_unstale":"2023-10-03T19:16:48.132635+0000","last_undegraded":"2023-10-03T19:16:48.132635+0000","last_fullsized":"2023-10-03T19:16:48.132635+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:33:54.973374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.618474+0000","last_change":"2023-10-03T19:16:46.372185+0000","last_active":"2023-10-03T19:16:48.618474+0000","last_peered":"2023-10-03T19:16:48.618474+0000","last_clean":"2023-10-03T19:16:48.618474+0000","last_became_active":"2023-10-03T19:16:46.371540+0000","last_became_peered":"2023-10-03T19:16:46.371540+0000","last_unstale":"2023-10-03T19:16:48.618474+0000","last_undegraded":"2023-10-03T19:16:48.618474+0000","last_fullsized":"2023-10-03T19:16:48.618474+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:13:24.647669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.322037+0000","last_change":"2023-10-03T19:16:46.355059+0000","last_active":"2023-10-03T19:16:47.322037+0000","last_peered":"2023-10-03T19:16:47.322037+0000","last_clean":"2023-10-03T19:16:47.322037+0000","last_became_active":"2023-10-03T19:16:46.347192+0000","last_became_peered":"2023-10-03T19:16:46.347192+0000","last_unstale":"2023-10-03T19:16:47.322037+0000","last_undegraded":"2023-10-03T19:16:47.322037+0000","last_fullsized":"2023-10-03T19:16:47.322037+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:41:31.281174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:49.532542+0000","last_change":"2023-10-03T19:16:46.376955+0000","last_active":"2023-10-03T19:16:49.532542+0000","last_peered":"2023-10-03T19:16:49.532542+0000","last_clean":"2023-10-03T19:16:49.532542+0000","last_became_active":"2023-10-03T19:16:46.376315+0000","last_became_peered":"2023-10-03T19:16:46.376315+0000","last_unstale":"2023-10-03T19:16:49.532542+0000","last_undegraded":"2023-10-03T19:16:49.532542+0000","last_fullsized":"2023-10-03T19:16:49.532542+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:13:06.901195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.344242+0000","last_change":"2023-10-03T19:16:46.343431+0000","last_active":"2023-10-03T19:16:46.344242+0000","last_peered":"2023-10-03T19:16:46.344242+0000","last_clean":"2023-10-03T19:16:46.344242+0000","last_became_active":"2023-10-03T19:16:46.343126+0000","last_became_peered":"2023-10-03T19:16:46.343126+0000","last_unstale":"2023-10-03T19:16:46.344242+0000","last_undegraded":"2023-10-03T19:16:46.344242+0000","last_fullsized":"2023-10-03T19:16:46.344242+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:55:44.177948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.313494+0000","last_change":"2023-10-03T19:16:46.348039+0000","last_active":"2023-10-03T19:16:47.313494+0000","last_peered":"2023-10-03T19:16:47.313494+0000","last_clean":"2023-10-03T19:16:47.313494+0000","last_became_active":"2023-10-03T19:16:46.347765+0000","last_became_peered":"2023-10-03T19:16:46.347765+0000","last_unstale":"2023-10-03T19:16:47.313494+0000","last_undegraded":"2023-10-03T19:16:47.313494+0000","last_fullsized":"2023-10-03T19:16:47.313494+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:39:48.000560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.319138+0000","last_change":"2023-10-03T19:16:46.370731+0000","last_active":"2023-10-03T19:16:47.319138+0000","last_peered":"2023-10-03T19:16:47.319138+0000","last_clean":"2023-10-03T19:16:47.319138+0000","last_became_active":"2023-10-03T19:16:46.370160+0000","last_became_peered":"2023-10-03T19:16:46.370160+0000","last_unstale":"2023-10-03T19:16:47.319138+0000","last_undegraded":"2023-10-03T19:16:47.319138+0000","last_fullsized":"2023-10-03T19:16:47.319138+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:28:32.868908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.619083+0000","last_change":"2023-10-03T19:16:46.371593+0000","last_active":"2023-10-03T19:16:48.619083+0000","last_peered":"2023-10-03T19:16:48.619083+0000","last_clean":"2023-10-03T19:16:48.619083+0000","last_became_active":"2023-10-03T19:16:46.369346+0000","last_became_peered":"2023-10-03T19:16:46.369346+0000","last_unstale":"2023-10-03T19:16:48.619083+0000","last_undegraded":"2023-10-03T19:16:48.619083+0000","last_fullsized":"2023-10-03T19:16:48.619083+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:43:29.326111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.618310+0000","last_change":"2023-10-03T19:16:46.370812+0000","last_active":"2023-10-03T19:16:48.618310+0000","last_peered":"2023-10-03T19:16:48.618310+0000","last_clean":"2023-10-03T19:16:48.618310+0000","last_became_active":"2023-10-03T19:16:46.368674+0000","last_became_peered":"2023-10-03T19:16:46.368674+0000","last_unstale":"2023-10-03T19:16:48.618310+0000","last_undegraded":"2023-10-03T19:16:48.618310+0000","last_fullsized":"2023-10-03T19:16:48.618310+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:29:53.237601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.322282+0000","last_change":"2023-10-03T19:16:46.363645+0000","last_active":"2023-10-03T19:16:47.322282+0000","last_peered":"2023-10-03T19:16:47.322282+0000","last_clean":"2023-10-03T19:16:47.322282+0000","last_became_active":"2023-10-03T19:16:46.363014+0000","last_became_peered":"2023-10-03T19:16:46.363014+0000","last_unstale":"2023-10-03T19:16:47.322282+0000","last_undegraded":"2023-10-03T19:16:47.322282+0000","last_fullsized":"2023-10-03T19:16:47.322282+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:14:29.494445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.319756+0000","last_change":"2023-10-03T19:16:46.373672+0000","last_active":"2023-10-03T19:16:47.319756+0000","last_peered":"2023-10-03T19:16:47.319756+0000","last_clean":"2023-10-03T19:16:47.319756+0000","last_became_active":"2023-10-03T19:16:46.373256+0000","last_became_peered":"2023-10-03T19:16:46.373256+0000","last_unstale":"2023-10-03T19:16:47.319756+0000","last_undegraded":"2023-10-03T19:16:47.319756+0000","last_fullsized":"2023-10-03T19:16:47.319756+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:26:48.529992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.319954+0000","last_change":"2023-10-03T19:16:46.360994+0000","last_active":"2023-10-03T19:16:47.319954+0000","last_peered":"2023-10-03T19:16:47.319954+0000","last_clean":"2023-10-03T19:16:47.319954+0000","last_became_active":"2023-10-03T19:16:46.360424+0000","last_became_peered":"2023-10-03T19:16:46.360424+0000","last_unstale":"2023-10-03T19:16:47.319954+0000","last_undegraded":"2023-10-03T19:16:47.319954+0000","last_fullsized":"2023-10-03T19:16:47.319954+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:49:56.768979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.618539+0000","last_change":"2023-10-03T19:16:46.370866+0000","last_active":"2023-10-03T19:16:48.618539+0000","last_peered":"2023-10-03T19:16:48.618539+0000","last_clean":"2023-10-03T19:16:48.618539+0000","last_became_active":"2023-10-03T19:16:46.369194+0000","last_became_peered":"2023-10-03T19:16:46.369194+0000","last_unstale":"2023-10-03T19:16:48.618539+0000","last_undegraded":"2023-10-03T19:16:48.618539+0000","last_fullsized":"2023-10-03T19:16:48.618539+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:00:59.853356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.618105+0000","last_change":"2023-10-03T19:16:46.371802+0000","last_active":"2023-10-03T19:16:48.618105+0000","last_peered":"2023-10-03T19:16:48.618105+0000","last_clean":"2023-10-03T19:16:48.618105+0000","last_became_active":"2023-10-03T19:16:46.371306+0000","last_became_peered":"2023-10-03T19:16:46.371306+0000","last_unstale":"2023-10-03T19:16:48.618105+0000","last_undegraded":"2023-10-03T19:16:48.618105+0000","last_fullsized":"2023-10-03T19:16:48.618105+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:10:50.809321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.313532+0000","last_change":"2023-10-03T19:16:46.321343+0000","last_active":"2023-10-03T19:16:47.313532+0000","last_peered":"2023-10-03T19:16:47.313532+0000","last_clean":"2023-10-03T19:16:47.313532+0000","last_became_active":"2023-10-03T19:16:46.321083+0000","last_became_peered":"2023-10-03T19:16:46.321083+0000","last_unstale":"2023-10-03T19:16:47.313532+0000","last_undegraded":"2023-10-03T19:16:47.313532+0000","last_fullsized":"2023-10-03T19:16:47.313532+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:40:30.344855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.133155+0000","last_change":"2023-10-03T19:16:46.346773+0000","last_active":"2023-10-03T19:16:48.133155+0000","last_peered":"2023-10-03T19:16:48.133155+0000","last_clean":"2023-10-03T19:16:48.133155+0000","last_became_active":"2023-10-03T19:16:46.346453+0000","last_became_peered":"2023-10-03T19:16:46.346453+0000","last_unstale":"2023-10-03T19:16:48.133155+0000","last_undegraded":"2023-10-03T19:16:48.133155+0000","last_fullsized":"2023-10-03T19:16:48.133155+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:09:54.897658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.322513+0000","last_change":"2023-10-03T19:16:46.349167+0000","last_active":"2023-10-03T19:16:47.322513+0000","last_peered":"2023-10-03T19:16:47.322513+0000","last_clean":"2023-10-03T19:16:47.322513+0000","last_became_active":"2023-10-03T19:16:46.348310+0000","last_became_peered":"2023-10-03T19:16:46.348310+0000","last_unstale":"2023-10-03T19:16:47.322513+0000","last_undegraded":"2023-10-03T19:16:47.322513+0000","last_fullsized":"2023-10-03T19:16:47.322513+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:20:34.523477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:49.532817+0000","last_change":"2023-10-03T19:16:46.364849+0000","last_active":"2023-10-03T19:16:49.532817+0000","last_peered":"2023-10-03T19:16:49.532817+0000","last_clean":"2023-10-03T19:16:49.532817+0000","last_became_active":"2023-10-03T19:16:46.362795+0000","last_became_peered":"2023-10-03T19:16:46.362795+0000","last_unstale":"2023-10-03T19:16:49.532817+0000","last_undegraded":"2023-10-03T19:16:49.532817+0000","last_fullsized":"2023-10-03T19:16:49.532817+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:34:55.903738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.653001+0000","last_change":"2023-10-03T19:16:46.365208+0000","last_active":"2023-10-03T19:16:47.653001+0000","last_peered":"2023-10-03T19:16:47.653001+0000","last_clean":"2023-10-03T19:16:47.653001+0000","last_became_active":"2023-10-03T19:16:46.364918+0000","last_became_peered":"2023-10-03T19:16:46.364918+0000","last_unstale":"2023-10-03T19:16:47.653001+0000","last_undegraded":"2023-10-03T19:16:47.653001+0000","last_fullsized":"2023-10-03T19:16:47.653001+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:39:44.223431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.319860+0000","last_change":"2023-10-03T19:16:46.355895+0000","last_active":"2023-10-03T19:16:47.319860+0000","last_peered":"2023-10-03T19:16:47.319860+0000","last_clean":"2023-10-03T19:16:47.319860+0000","last_became_active":"2023-10-03T19:16:46.355499+0000","last_became_peered":"2023-10-03T19:16:46.355499+0000","last_unstale":"2023-10-03T19:16:47.319860+0000","last_undegraded":"2023-10-03T19:16:47.319860+0000","last_fullsized":"2023-10-03T19:16:47.319860+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:01:59.000737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.652740+0000","last_change":"2023-10-03T19:16:46.342786+0000","last_active":"2023-10-03T19:16:47.652740+0000","last_peered":"2023-10-03T19:16:47.652740+0000","last_clean":"2023-10-03T19:16:47.652740+0000","last_became_active":"2023-10-03T19:16:46.342522+0000","last_became_peered":"2023-10-03T19:16:46.342522+0000","last_unstale":"2023-10-03T19:16:47.652740+0000","last_undegraded":"2023-10-03T19:16:47.652740+0000","last_fullsized":"2023-10-03T19:16:47.652740+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:51:23.543569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.652807+0000","last_change":"2023-10-03T19:16:46.334274+0000","last_active":"2023-10-03T19:16:47.652807+0000","last_peered":"2023-10-03T19:16:47.652807+0000","last_clean":"2023-10-03T19:16:47.652807+0000","last_became_active":"2023-10-03T19:16:46.333935+0000","last_became_peered":"2023-10-03T19:16:46.333935+0000","last_unstale":"2023-10-03T19:16:47.652807+0000","last_undegraded":"2023-10-03T19:16:47.652807+0000","last_fullsized":"2023-10-03T19:16:47.652807+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:47:38.082021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.617875+0000","last_change":"2023-10-03T19:16:46.371106+0000","last_active":"2023-10-03T19:16:48.617875+0000","last_peered":"2023-10-03T19:16:48.617875+0000","last_clean":"2023-10-03T19:16:48.617875+0000","last_became_active":"2023-10-03T19:16:46.368784+0000","last_became_peered":"2023-10-03T19:16:46.368784+0000","last_unstale":"2023-10-03T19:16:48.617875+0000","last_undegraded":"2023-10-03T19:16:48.617875+0000","last_fullsized":"2023-10-03T19:16:48.617875+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:51:43.679257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.320063+0000","last_change":"2023-10-03T19:16:46.331355+0000","last_active":"2023-10-03T19:16:47.320063+0000","last_peered":"2023-10-03T19:16:47.320063+0000","last_clean":"2023-10-03T19:16:47.320063+0000","last_became_active":"2023-10-03T19:16:46.330651+0000","last_became_peered":"2023-10-03T19:16:46.330651+0000","last_unstale":"2023-10-03T19:16:47.320063+0000","last_undegraded":"2023-10-03T19:16:47.320063+0000","last_fullsized":"2023-10-03T19:16:47.320063+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:53:57.650151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.320124+0000","last_change":"2023-10-03T19:16:46.355791+0000","last_active":"2023-10-03T19:16:47.320124+0000","last_peered":"2023-10-03T19:16:47.320124+0000","last_clean":"2023-10-03T19:16:47.320124+0000","last_became_active":"2023-10-03T19:16:46.355363+0000","last_became_peered":"2023-10-03T19:16:46.355363+0000","last_unstale":"2023-10-03T19:16:47.320124+0000","last_undegraded":"2023-10-03T19:16:47.320124+0000","last_fullsized":"2023-10-03T19:16:47.320124+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:51:27.990245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.322336+0000","last_change":"2023-10-03T19:16:46.364524+0000","last_active":"2023-10-03T19:16:47.322336+0000","last_peered":"2023-10-03T19:16:47.322336+0000","last_clean":"2023-10-03T19:16:47.322336+0000","last_became_active":"2023-10-03T19:16:46.364031+0000","last_became_peered":"2023-10-03T19:16:46.364031+0000","last_unstale":"2023-10-03T19:16:47.322336+0000","last_undegraded":"2023-10-03T19:16:47.322336+0000","last_fullsized":"2023-10-03T19:16:47.322336+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:38:04.143951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.131991+0000","last_change":"2023-10-03T19:16:46.365391+0000","last_active":"2023-10-03T19:16:48.131991+0000","last_peered":"2023-10-03T19:16:48.131991+0000","last_clean":"2023-10-03T19:16:48.131991+0000","last_became_active":"2023-10-03T19:16:46.365114+0000","last_became_peered":"2023-10-03T19:16:46.365114+0000","last_unstale":"2023-10-03T19:16:48.131991+0000","last_undegraded":"2023-10-03T19:16:48.131991+0000","last_fullsized":"2023-10-03T19:16:48.131991+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:39:44.223431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.618975+0000","last_change":"2023-10-03T19:16:46.368881+0000","last_active":"2023-10-03T19:16:48.618975+0000","last_peered":"2023-10-03T19:16:48.618975+0000","last_clean":"2023-10-03T19:16:48.618975+0000","last_became_active":"2023-10-03T19:16:46.368277+0000","last_became_peered":"2023-10-03T19:16:46.368277+0000","last_unstale":"2023-10-03T19:16:48.618975+0000","last_undegraded":"2023-10-03T19:16:48.618975+0000","last_fullsized":"2023-10-03T19:16:48.618975+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:31:31.375257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.319123+0000","last_change":"2023-10-03T19:16:46.375016+0000","last_active":"2023-10-03T19:16:47.319123+0000","last_peered":"2023-10-03T19:16:47.319123+0000","last_clean":"2023-10-03T19:16:47.319123+0000","last_became_active":"2023-10-03T19:16:46.373328+0000","last_became_peered":"2023-10-03T19:16:46.373328+0000","last_unstale":"2023-10-03T19:16:47.319123+0000","last_undegraded":"2023-10-03T19:16:47.319123+0000","last_fullsized":"2023-10-03T19:16:47.319123+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:19:38.440912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.320479+0000","last_change":"2023-10-03T19:16:46.348251+0000","last_active":"2023-10-03T19:16:47.320479+0000","last_peered":"2023-10-03T19:16:47.320479+0000","last_clean":"2023-10-03T19:16:47.320479+0000","last_became_active":"2023-10-03T19:16:46.347396+0000","last_became_peered":"2023-10-03T19:16:46.347396+0000","last_unstale":"2023-10-03T19:16:47.320479+0000","last_undegraded":"2023-10-03T19:16:47.320479+0000","last_fullsized":"2023-10-03T19:16:47.320479+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:52:41.264223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.321654+0000","last_change":"2023-10-03T19:16:46.320704+0000","last_active":"2023-10-03T19:16:46.321654+0000","last_peered":"2023-10-03T19:16:46.321654+0000","last_clean":"2023-10-03T19:16:46.321654+0000","last_became_active":"2023-10-03T19:16:46.320439+0000","last_became_peered":"2023-10-03T19:16:46.320439+0000","last_unstale":"2023-10-03T19:16:46.321654+0000","last_undegraded":"2023-10-03T19:16:46.321654+0000","last_fullsized":"2023-10-03T19:16:46.321654+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:10:04.090416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:49.532599+0000","last_change":"2023-10-03T19:16:46.365538+0000","last_active":"2023-10-03T19:16:49.532599+0000","last_peered":"2023-10-03T19:16:49.532599+0000","last_clean":"2023-10-03T19:16:49.532599+0000","last_became_active":"2023-10-03T19:16:46.365018+0000","last_became_peered":"2023-10-03T19:16:46.365018+0000","last_unstale":"2023-10-03T19:16:49.532599+0000","last_undegraded":"2023-10-03T19:16:49.532599+0000","last_fullsized":"2023-10-03T19:16:49.532599+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:40:35.111323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"60'4","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.133230+0000","last_change":"2023-10-03T19:16:45.981820+0000","last_active":"2023-10-03T19:16:48.133230+0000","last_peered":"2023-10-03T19:16:48.133230+0000","last_clean":"2023-10-03T19:16:48.133230+0000","last_became_active":"2023-10-03T19:16:45.981370+0000","last_became_peered":"2023-10-03T19:16:45.981370+0000","last_unstale":"2023-10-03T19:16:48.133230+0000","last_undegraded":"2023-10-03T19:16:48.133230+0000","last_fullsized":"2023-10-03T19:16:48.133230+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:27:38.105290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.322675+0000","last_change":"2023-10-03T19:16:46.376884+0000","last_active":"2023-10-03T19:16:47.322675+0000","last_peered":"2023-10-03T19:16:47.322675+0000","last_clean":"2023-10-03T19:16:47.322675+0000","last_became_active":"2023-10-03T19:16:46.376443+0000","last_became_peered":"2023-10-03T19:16:46.376443+0000","last_unstale":"2023-10-03T19:16:47.322675+0000","last_undegraded":"2023-10-03T19:16:47.322675+0000","last_fullsized":"2023-10-03T19:16:47.322675+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:34:55.903738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"60'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.321497+0000","last_change":"2023-10-03T19:16:45.981732+0000","last_active":"2023-10-03T19:16:46.321497+0000","last_peered":"2023-10-03T19:16:46.321497+0000","last_clean":"2023-10-03T19:16:46.321497+0000","last_became_active":"2023-10-03T19:16:45.981370+0000","last_became_peered":"2023-10-03T19:16:45.981370+0000","last_unstale":"2023-10-03T19:16:46.321497+0000","last_undegraded":"2023-10-03T19:16:46.321497+0000","last_fullsized":"2023-10-03T19:16:46.321497+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:18:52.620802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.318058+0000","last_change":"2023-10-03T19:16:46.314997+0000","last_active":"2023-10-03T19:16:46.318058+0000","last_peered":"2023-10-03T19:16:46.318058+0000","last_clean":"2023-10-03T19:16:46.318058+0000","last_became_active":"2023-10-03T19:16:46.314696+0000","last_became_peered":"2023-10-03T19:16:46.314696+0000","last_unstale":"2023-10-03T19:16:46.318058+0000","last_undegraded":"2023-10-03T19:16:46.318058+0000","last_fullsized":"2023-10-03T19:16:46.318058+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:44:55.670865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"60'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.356922+0000","last_change":"2023-10-03T19:16:45.962125+0000","last_active":"2023-10-03T19:16:46.356922+0000","last_peered":"2023-10-03T19:16:46.356922+0000","last_clean":"2023-10-03T19:16:46.356922+0000","last_became_active":"2023-10-03T19:16:45.961789+0000","last_became_peered":"2023-10-03T19:16:45.961789+0000","last_unstale":"2023-10-03T19:16:46.356922+0000","last_undegraded":"2023-10-03T19:16:46.356922+0000","last_fullsized":"2023-10-03T19:16:46.356922+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:26:23.901877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.618794+0000","last_change":"2023-10-03T19:16:46.371148+0000","last_active":"2023-10-03T19:16:48.618794+0000","last_peered":"2023-10-03T19:16:48.618794+0000","last_clean":"2023-10-03T19:16:48.618794+0000","last_became_active":"2023-10-03T19:16:46.368434+0000","last_became_peered":"2023-10-03T19:16:46.368434+0000","last_unstale":"2023-10-03T19:16:48.618794+0000","last_undegraded":"2023-10-03T19:16:48.618794+0000","last_fullsized":"2023-10-03T19:16:48.618794+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:32:37.045249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"60'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.320217+0000","last_change":"2023-10-03T19:16:45.943694+0000","last_active":"2023-10-03T19:16:46.320217+0000","last_peered":"2023-10-03T19:16:46.320217+0000","last_clean":"2023-10-03T19:16:46.320217+0000","last_became_active":"2023-10-03T19:16:45.943381+0000","last_became_peered":"2023-10-03T19:16:45.943381+0000","last_unstale":"2023-10-03T19:16:46.320217+0000","last_undegraded":"2023-10-03T19:16:46.320217+0000","last_fullsized":"2023-10-03T19:16:46.320217+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:30:14.537183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.313738+0000","last_change":"2023-10-03T19:16:46.315631+0000","last_active":"2023-10-03T19:16:47.313738+0000","last_peered":"2023-10-03T19:16:47.313738+0000","last_clean":"2023-10-03T19:16:47.313738+0000","last_became_active":"2023-10-03T19:16:46.315402+0000","last_became_peered":"2023-10-03T19:16:46.315402+0000","last_unstale":"2023-10-03T19:16:47.313738+0000","last_undegraded":"2023-10-03T19:16:47.313738+0000","last_fullsized":"2023-10-03T19:16:47.313738+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:53:28.141314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"60'1","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.652881+0000","last_change":"2023-10-03T19:16:45.941443+0000","last_active":"2023-10-03T19:16:47.652881+0000","last_peered":"2023-10-03T19:16:47.652881+0000","last_clean":"2023-10-03T19:16:47.652881+0000","last_became_active":"2023-10-03T19:16:45.940415+0000","last_became_peered":"2023-10-03T19:16:45.940415+0000","last_unstale":"2023-10-03T19:16:47.652881+0000","last_undegraded":"2023-10-03T19:16:47.652881+0000","last_fullsized":"2023-10-03T19:16:47.652881+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:44:09.621775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.131850+0000","last_change":"2023-10-03T19:16:46.346859+0000","last_active":"2023-10-03T19:16:48.131850+0000","last_peered":"2023-10-03T19:16:48.131850+0000","last_clean":"2023-10-03T19:16:48.131850+0000","last_became_active":"2023-10-03T19:16:46.346492+0000","last_became_peered":"2023-10-03T19:16:46.346492+0000","last_unstale":"2023-10-03T19:16:48.131850+0000","last_undegraded":"2023-10-03T19:16:48.131850+0000","last_fullsized":"2023-10-03T19:16:48.131850+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:30:07.146231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"60'1","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.653134+0000","last_change":"2023-10-03T19:16:45.947189+0000","last_active":"2023-10-03T19:16:47.653134+0000","last_peered":"2023-10-03T19:16:47.653134+0000","last_clean":"2023-10-03T19:16:47.653134+0000","last_became_active":"2023-10-03T19:16:45.946936+0000","last_became_peered":"2023-10-03T19:16:45.946936+0000","last_unstale":"2023-10-03T19:16:47.653134+0000","last_undegraded":"2023-10-03T19:16:47.653134+0000","last_fullsized":"2023-10-03T19:16:47.653134+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:40:51.084957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:49.532036+0000","last_change":"2023-10-03T19:16:46.365932+0000","last_active":"2023-10-03T19:16:49.532036+0000","last_peered":"2023-10-03T19:16:49.532036+0000","last_clean":"2023-10-03T19:16:49.532036+0000","last_became_active":"2023-10-03T19:16:46.362477+0000","last_became_peered":"2023-10-03T19:16:46.362477+0000","last_unstale":"2023-10-03T19:16:49.532036+0000","last_undegraded":"2023-10-03T19:16:49.532036+0000","last_fullsized":"2023-10-03T19:16:49.532036+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:41:03.234709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.653197+0000","last_change":"2023-10-03T19:16:45.963852+0000","last_active":"2023-10-03T19:16:47.653197+0000","last_peered":"2023-10-03T19:16:47.653197+0000","last_clean":"2023-10-03T19:16:47.653197+0000","last_became_active":"2023-10-03T19:16:45.963421+0000","last_became_peered":"2023-10-03T19:16:45.963421+0000","last_unstale":"2023-10-03T19:16:47.653197+0000","last_undegraded":"2023-10-03T19:16:47.653197+0000","last_fullsized":"2023-10-03T19:16:47.653197+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:44:13.157882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.652633+0000","last_change":"2023-10-03T19:16:46.347062+0000","last_active":"2023-10-03T19:16:47.652633+0000","last_peered":"2023-10-03T19:16:47.652633+0000","last_clean":"2023-10-03T19:16:47.652633+0000","last_became_active":"2023-10-03T19:16:46.346716+0000","last_became_peered":"2023-10-03T19:16:46.346716+0000","last_unstale":"2023-10-03T19:16:47.652633+0000","last_undegraded":"2023-10-03T19:16:47.652633+0000","last_fullsized":"2023-10-03T19:16:47.652633+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:27:08.563689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:49.532348+0000","last_change":"2023-10-03T19:16:45.985444+0000","last_active":"2023-10-03T19:16:49.532348+0000","last_peered":"2023-10-03T19:16:49.532348+0000","last_clean":"2023-10-03T19:16:49.532348+0000","last_became_active":"2023-10-03T19:16:45.984784+0000","last_became_peered":"2023-10-03T19:16:45.984784+0000","last_unstale":"2023-10-03T19:16:49.532348+0000","last_undegraded":"2023-10-03T19:16:49.532348+0000","last_fullsized":"2023-10-03T19:16:49.532348+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:57:20.698858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.132874+0000","last_change":"2023-10-03T19:16:46.317689+0000","last_active":"2023-10-03T19:16:48.132874+0000","last_peered":"2023-10-03T19:16:48.132874+0000","last_clean":"2023-10-03T19:16:48.132874+0000","last_became_active":"2023-10-03T19:16:46.317385+0000","last_became_peered":"2023-10-03T19:16:46.317385+0000","last_unstale":"2023-10-03T19:16:48.132874+0000","last_undegraded":"2023-10-03T19:16:48.132874+0000","last_fullsized":"2023-10-03T19:16:48.132874+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:24:26.703065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.619325+0000","last_change":"2023-10-03T19:16:45.986113+0000","last_active":"2023-10-03T19:16:48.619325+0000","last_peered":"2023-10-03T19:16:48.619325+0000","last_clean":"2023-10-03T19:16:48.619325+0000","last_became_active":"2023-10-03T19:16:45.985260+0000","last_became_peered":"2023-10-03T19:16:45.985260+0000","last_unstale":"2023-10-03T19:16:48.619325+0000","last_undegraded":"2023-10-03T19:16:48.619325+0000","last_fullsized":"2023-10-03T19:16:48.619325+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:21:28.360157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.653370+0000","last_change":"2023-10-03T19:16:46.349358+0000","last_active":"2023-10-03T19:16:47.653370+0000","last_peered":"2023-10-03T19:16:47.653370+0000","last_clean":"2023-10-03T19:16:47.653370+0000","last_became_active":"2023-10-03T19:16:46.349068+0000","last_became_peered":"2023-10-03T19:16:46.349068+0000","last_unstale":"2023-10-03T19:16:47.653370+0000","last_undegraded":"2023-10-03T19:16:47.653370+0000","last_fullsized":"2023-10-03T19:16:47.653370+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:13:28.901763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.322813+0000","last_change":"2023-10-03T19:16:45.963314+0000","last_active":"2023-10-03T19:16:47.322813+0000","last_peered":"2023-10-03T19:16:47.322813+0000","last_clean":"2023-10-03T19:16:47.322813+0000","last_became_active":"2023-10-03T19:16:45.962565+0000","last_became_peered":"2023-10-03T19:16:45.962565+0000","last_unstale":"2023-10-03T19:16:47.322813+0000","last_undegraded":"2023-10-03T19:16:47.322813+0000","last_fullsized":"2023-10-03T19:16:47.322813+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:16:03.401374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:49.532588+0000","last_change":"2023-10-03T19:16:46.369750+0000","last_active":"2023-10-03T19:16:49.532588+0000","last_peered":"2023-10-03T19:16:49.532588+0000","last_clean":"2023-10-03T19:16:49.532588+0000","last_became_active":"2023-10-03T19:16:46.368994+0000","last_became_peered":"2023-10-03T19:16:46.368994+0000","last_unstale":"2023-10-03T19:16:49.532588+0000","last_undegraded":"2023-10-03T19:16:49.532588+0000","last_fullsized":"2023-10-03T19:16:49.532588+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:38:04.143951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"60'3","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.618974+0000","last_change":"2023-10-03T19:16:45.986493+0000","last_active":"2023-10-03T19:16:48.618974+0000","last_peered":"2023-10-03T19:16:48.618974+0000","last_clean":"2023-10-03T19:16:48.618974+0000","last_became_active":"2023-10-03T19:16:45.985657+0000","last_became_peered":"2023-10-03T19:16:45.985657+0000","last_unstale":"2023-10-03T19:16:48.618974+0000","last_undegraded":"2023-10-03T19:16:48.618974+0000","last_fullsized":"2023-10-03T19:16:48.618974+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:11:58.943533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.322694+0000","last_change":"2023-10-03T19:16:46.349205+0000","last_active":"2023-10-03T19:16:47.322694+0000","last_peered":"2023-10-03T19:16:47.322694+0000","last_clean":"2023-10-03T19:16:47.322694+0000","last_became_active":"2023-10-03T19:16:46.348690+0000","last_became_peered":"2023-10-03T19:16:46.348690+0000","last_unstale":"2023-10-03T19:16:47.322694+0000","last_undegraded":"2023-10-03T19:16:47.322694+0000","last_fullsized":"2023-10-03T19:16:47.322694+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:55:50.723569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"60'6","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.132810+0000","last_change":"2023-10-03T19:16:45.967950+0000","last_active":"2023-10-03T19:16:48.132810+0000","last_peered":"2023-10-03T19:16:48.132810+0000","last_clean":"2023-10-03T19:16:48.132810+0000","last_became_active":"2023-10-03T19:16:45.967600+0000","last_became_peered":"2023-10-03T19:16:45.967600+0000","last_unstale":"2023-10-03T19:16:48.132810+0000","last_undegraded":"2023-10-03T19:16:48.132810+0000","last_fullsized":"2023-10-03T19:16:48.132810+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:44:13.157882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.320767+0000","last_change":"2023-10-03T19:16:46.356075+0000","last_active":"2023-10-03T19:16:47.320767+0000","last_peered":"2023-10-03T19:16:47.320767+0000","last_clean":"2023-10-03T19:16:47.320767+0000","last_became_active":"2023-10-03T19:16:46.355562+0000","last_became_peered":"2023-10-03T19:16:46.355562+0000","last_unstale":"2023-10-03T19:16:47.320767+0000","last_undegraded":"2023-10-03T19:16:47.320767+0000","last_fullsized":"2023-10-03T19:16:47.320767+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:13:06.901195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"60'2","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.619245+0000","last_change":"2023-10-03T19:16:45.987343+0000","last_active":"2023-10-03T19:16:48.619245+0000","last_peered":"2023-10-03T19:16:48.619245+0000","last_clean":"2023-10-03T19:16:48.619245+0000","last_became_active":"2023-10-03T19:16:45.986702+0000","last_became_peered":"2023-10-03T19:16:45.986702+0000","last_unstale":"2023-10-03T19:16:48.619245+0000","last_undegraded":"2023-10-03T19:16:48.619245+0000","last_fullsized":"2023-10-03T19:16:48.619245+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:25:18.788650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.319146+0000","last_change":"2023-10-03T19:16:46.356897+0000","last_active":"2023-10-03T19:16:47.319146+0000","last_peered":"2023-10-03T19:16:47.319146+0000","last_clean":"2023-10-03T19:16:47.319146+0000","last_became_active":"2023-10-03T19:16:46.356141+0000","last_became_peered":"2023-10-03T19:16:46.356141+0000","last_unstale":"2023-10-03T19:16:47.319146+0000","last_undegraded":"2023-10-03T19:16:47.319146+0000","last_fullsized":"2023-10-03T19:16:47.319146+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:58:53.485536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.319431+0000","last_change":"2023-10-03T19:16:45.954269+0000","last_active":"2023-10-03T19:16:47.319431+0000","last_peered":"2023-10-03T19:16:47.319431+0000","last_clean":"2023-10-03T19:16:47.319431+0000","last_became_active":"2023-10-03T19:16:45.951703+0000","last_became_peered":"2023-10-03T19:16:45.951703+0000","last_unstale":"2023-10-03T19:16:47.319431+0000","last_undegraded":"2023-10-03T19:16:47.319431+0000","last_fullsized":"2023-10-03T19:16:47.319431+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:13:25.094973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:49.532167+0000","last_change":"2023-10-03T19:16:46.376007+0000","last_active":"2023-10-03T19:16:49.532167+0000","last_peered":"2023-10-03T19:16:49.532167+0000","last_clean":"2023-10-03T19:16:49.532167+0000","last_became_active":"2023-10-03T19:16:46.375324+0000","last_became_peered":"2023-10-03T19:16:46.375324+0000","last_unstale":"2023-10-03T19:16:49.532167+0000","last_undegraded":"2023-10-03T19:16:49.532167+0000","last_fullsized":"2023-10-03T19:16:49.532167+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:52:41.264223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.618673+0000","last_change":"2023-10-03T19:16:45.987260+0000","last_active":"2023-10-03T19:16:48.618673+0000","last_peered":"2023-10-03T19:16:48.618673+0000","last_clean":"2023-10-03T19:16:48.618673+0000","last_became_active":"2023-10-03T19:16:45.984760+0000","last_became_peered":"2023-10-03T19:16:45.984760+0000","last_unstale":"2023-10-03T19:16:48.618673+0000","last_undegraded":"2023-10-03T19:16:48.618673+0000","last_fullsized":"2023-10-03T19:16:48.618673+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:38:55.777234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.132301+0000","last_change":"2023-10-03T19:16:46.343379+0000","last_active":"2023-10-03T19:16:48.132301+0000","last_peered":"2023-10-03T19:16:48.132301+0000","last_clean":"2023-10-03T19:16:48.132301+0000","last_became_active":"2023-10-03T19:16:46.343101+0000","last_became_peered":"2023-10-03T19:16:46.343101+0000","last_unstale":"2023-10-03T19:16:48.132301+0000","last_undegraded":"2023-10-03T19:16:48.132301+0000","last_fullsized":"2023-10-03T19:16:48.132301+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:40:52.095764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"60'8","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.321111+0000","last_change":"2023-10-03T19:16:45.985749+0000","last_active":"2023-10-03T19:16:47.321111+0000","last_peered":"2023-10-03T19:16:47.321111+0000","last_clean":"2023-10-03T19:16:47.321111+0000","last_became_active":"2023-10-03T19:16:45.985075+0000","last_became_peered":"2023-10-03T19:16:45.985075+0000","last_unstale":"2023-10-03T19:16:47.321111+0000","last_undegraded":"2023-10-03T19:16:47.321111+0000","last_fullsized":"2023-10-03T19:16:47.321111+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:40:34.100515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.355603+0000","last_change":"2023-10-03T19:16:46.354674+0000","last_active":"2023-10-03T19:16:46.355603+0000","last_peered":"2023-10-03T19:16:46.355603+0000","last_clean":"2023-10-03T19:16:46.355603+0000","last_became_active":"2023-10-03T19:16:46.354269+0000","last_became_peered":"2023-10-03T19:16:46.354269+0000","last_unstale":"2023-10-03T19:16:46.355603+0000","last_undegraded":"2023-10-03T19:16:46.355603+0000","last_fullsized":"2023-10-03T19:16:46.355603+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:08:45.168337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"60'2","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.321134+0000","last_change":"2023-10-03T19:16:45.987491+0000","last_active":"2023-10-03T19:16:47.321134+0000","last_peered":"2023-10-03T19:16:47.321134+0000","last_clean":"2023-10-03T19:16:47.321134+0000","last_became_active":"2023-10-03T19:16:45.986716+0000","last_became_peered":"2023-10-03T19:16:45.986716+0000","last_unstale":"2023-10-03T19:16:47.321134+0000","last_undegraded":"2023-10-03T19:16:47.321134+0000","last_fullsized":"2023-10-03T19:16:47.321134+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:34:10.585937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.313779+0000","last_change":"2023-10-03T19:16:46.315032+0000","last_active":"2023-10-03T19:16:47.313779+0000","last_peered":"2023-10-03T19:16:47.313779+0000","last_clean":"2023-10-03T19:16:47.313779+0000","last_became_active":"2023-10-03T19:16:46.314754+0000","last_became_peered":"2023-10-03T19:16:46.314754+0000","last_unstale":"2023-10-03T19:16:47.313779+0000","last_undegraded":"2023-10-03T19:16:47.313779+0000","last_fullsized":"2023-10-03T19:16:47.313779+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:43:54.409015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.320964+0000","last_change":"2023-10-03T19:16:45.962997+0000","last_active":"2023-10-03T19:16:47.320964+0000","last_peered":"2023-10-03T19:16:47.320964+0000","last_clean":"2023-10-03T19:16:47.320964+0000","last_became_active":"2023-10-03T19:16:45.962167+0000","last_became_peered":"2023-10-03T19:16:45.962167+0000","last_unstale":"2023-10-03T19:16:47.320964+0000","last_undegraded":"2023-10-03T19:16:47.320964+0000","last_fullsized":"2023-10-03T19:16:47.320964+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:48:15.715329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.320479+0000","last_change":"2023-10-03T19:16:46.352102+0000","last_active":"2023-10-03T19:16:47.320479+0000","last_peered":"2023-10-03T19:16:47.320479+0000","last_clean":"2023-10-03T19:16:47.320479+0000","last_became_active":"2023-10-03T19:16:46.351658+0000","last_became_peered":"2023-10-03T19:16:46.351658+0000","last_unstale":"2023-10-03T19:16:47.320479+0000","last_undegraded":"2023-10-03T19:16:47.320479+0000","last_fullsized":"2023-10-03T19:16:47.320479+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:06:15.737400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.308406+0000","last_change":"2023-10-03T19:16:45.962886+0000","last_active":"2023-10-03T19:16:46.308406+0000","last_peered":"2023-10-03T19:16:46.308406+0000","last_clean":"2023-10-03T19:16:46.308406+0000","last_became_active":"2023-10-03T19:16:45.962180+0000","last_became_peered":"2023-10-03T19:16:45.962180+0000","last_unstale":"2023-10-03T19:16:46.308406+0000","last_undegraded":"2023-10-03T19:16:46.308406+0000","last_fullsized":"2023-10-03T19:16:46.308406+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:00:57.559577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:49.533002+0000","last_change":"2023-10-03T19:16:46.368611+0000","last_active":"2023-10-03T19:16:49.533002+0000","last_peered":"2023-10-03T19:16:49.533002+0000","last_clean":"2023-10-03T19:16:49.533002+0000","last_became_active":"2023-10-03T19:16:46.367938+0000","last_became_peered":"2023-10-03T19:16:46.367938+0000","last_unstale":"2023-10-03T19:16:49.533002+0000","last_undegraded":"2023-10-03T19:16:49.533002+0000","last_fullsized":"2023-10-03T19:16:49.533002+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:16:04.412181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.133227+0000","last_change":"2023-10-03T19:16:45.967954+0000","last_active":"2023-10-03T19:16:48.133227+0000","last_peered":"2023-10-03T19:16:48.133227+0000","last_clean":"2023-10-03T19:16:48.133227+0000","last_became_active":"2023-10-03T19:16:45.967581+0000","last_became_peered":"2023-10-03T19:16:45.967581+0000","last_unstale":"2023-10-03T19:16:48.133227+0000","last_undegraded":"2023-10-03T19:16:48.133227+0000","last_fullsized":"2023-10-03T19:16:48.133227+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:12:23.041332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:49.532036+0000","last_change":"2023-10-03T19:16:46.362149+0000","last_active":"2023-10-03T19:16:49.532036+0000","last_peered":"2023-10-03T19:16:49.532036+0000","last_clean":"2023-10-03T19:16:49.532036+0000","last_became_active":"2023-10-03T19:16:46.361627+0000","last_became_peered":"2023-10-03T19:16:46.361627+0000","last_unstale":"2023-10-03T19:16:49.532036+0000","last_undegraded":"2023-10-03T19:16:49.532036+0000","last_fullsized":"2023-10-03T19:16:49.532036+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:18:50.529919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.619328+0000","last_change":"2023-10-03T19:16:45.986852+0000","last_active":"2023-10-03T19:16:48.619328+0000","last_peered":"2023-10-03T19:16:48.619328+0000","last_clean":"2023-10-03T19:16:48.619328+0000","last_became_active":"2023-10-03T19:16:45.985615+0000","last_became_peered":"2023-10-03T19:16:45.985615+0000","last_unstale":"2023-10-03T19:16:48.619328+0000","last_undegraded":"2023-10-03T19:16:48.619328+0000","last_fullsized":"2023-10-03T19:16:48.619328+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:50:53.287702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.320881+0000","last_change":"2023-10-03T19:16:46.355632+0000","last_active":"2023-10-03T19:16:47.320881+0000","last_peered":"2023-10-03T19:16:47.320881+0000","last_clean":"2023-10-03T19:16:47.320881+0000","last_became_active":"2023-10-03T19:16:46.355020+0000","last_became_peered":"2023-10-03T19:16:46.355020+0000","last_unstale":"2023-10-03T19:16:47.320881+0000","last_undegraded":"2023-10-03T19:16:47.320881+0000","last_fullsized":"2023-10-03T19:16:47.320881+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:12:46.908741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.653165+0000","last_change":"2023-10-03T19:16:45.944273+0000","last_active":"2023-10-03T19:16:47.653165+0000","last_peered":"2023-10-03T19:16:47.653165+0000","last_clean":"2023-10-03T19:16:47.653165+0000","last_became_active":"2023-10-03T19:16:45.943995+0000","last_became_peered":"2023-10-03T19:16:45.943995+0000","last_unstale":"2023-10-03T19:16:47.653165+0000","last_undegraded":"2023-10-03T19:16:47.653165+0000","last_fullsized":"2023-10-03T19:16:47.653165+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:55:00.990011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.131961+0000","last_change":"2023-10-03T19:16:46.342684+0000","last_active":"2023-10-03T19:16:48.131961+0000","last_peered":"2023-10-03T19:16:48.131961+0000","last_clean":"2023-10-03T19:16:48.131961+0000","last_became_active":"2023-10-03T19:16:46.342293+0000","last_became_peered":"2023-10-03T19:16:46.342293+0000","last_unstale":"2023-10-03T19:16:48.131961+0000","last_undegraded":"2023-10-03T19:16:48.131961+0000","last_fullsized":"2023-10-03T19:16:48.131961+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:44:10.632582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.652853+0000","last_change":"2023-10-03T19:16:45.964339+0000","last_active":"2023-10-03T19:16:47.652853+0000","last_peered":"2023-10-03T19:16:47.652853+0000","last_clean":"2023-10-03T19:16:47.652853+0000","last_became_active":"2023-10-03T19:16:45.963814+0000","last_became_peered":"2023-10-03T19:16:45.963814+0000","last_unstale":"2023-10-03T19:16:47.652853+0000","last_undegraded":"2023-10-03T19:16:47.652853+0000","last_fullsized":"2023-10-03T19:16:47.652853+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:30:06.135424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.313923+0000","last_change":"2023-10-03T19:16:46.354068+0000","last_active":"2023-10-03T19:16:47.313923+0000","last_peered":"2023-10-03T19:16:47.313923+0000","last_clean":"2023-10-03T19:16:47.313923+0000","last_became_active":"2023-10-03T19:16:46.353774+0000","last_became_peered":"2023-10-03T19:16:46.353774+0000","last_unstale":"2023-10-03T19:16:47.313923+0000","last_undegraded":"2023-10-03T19:16:47.313923+0000","last_fullsized":"2023-10-03T19:16:47.313923+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:46:12.863079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.132019+0000","last_change":"2023-10-03T19:16:45.972785+0000","last_active":"2023-10-03T19:16:48.132019+0000","last_peered":"2023-10-03T19:16:48.132019+0000","last_clean":"2023-10-03T19:16:48.132019+0000","last_became_active":"2023-10-03T19:16:45.972526+0000","last_became_peered":"2023-10-03T19:16:45.972526+0000","last_unstale":"2023-10-03T19:16:48.132019+0000","last_undegraded":"2023-10-03T19:16:48.132019+0000","last_fullsized":"2023-10-03T19:16:48.132019+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:55:00.990011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:49.532852+0000","last_change":"2023-10-03T19:16:46.368258+0000","last_active":"2023-10-03T19:16:49.532852+0000","last_peered":"2023-10-03T19:16:49.532852+0000","last_clean":"2023-10-03T19:16:49.532852+0000","last_became_active":"2023-10-03T19:16:46.367559+0000","last_became_peered":"2023-10-03T19:16:46.367559+0000","last_unstale":"2023-10-03T19:16:49.532852+0000","last_undegraded":"2023-10-03T19:16:49.532852+0000","last_fullsized":"2023-10-03T19:16:49.532852+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:20:34.523477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.652590+0000","last_change":"2023-10-03T19:16:45.940912+0000","last_active":"2023-10-03T19:16:47.652590+0000","last_peered":"2023-10-03T19:16:47.652590+0000","last_clean":"2023-10-03T19:16:47.652590+0000","last_became_active":"2023-10-03T19:16:45.940610+0000","last_became_peered":"2023-10-03T19:16:45.940610+0000","last_unstale":"2023-10-03T19:16:47.652590+0000","last_undegraded":"2023-10-03T19:16:47.652590+0000","last_fullsized":"2023-10-03T19:16:47.652590+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:55:05.787664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":245,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.619130+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:16:48.619130+0000","last_peered":"2023-10-03T19:16:48.619130+0000","last_clean":"2023-10-03T19:16:48.619130+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:16:48.619130+0000","last_undegraded":"2023-10-03T19:16:48.619130+0000","last_fullsized":"2023-10-03T19:16:48.619130+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:46:39.136411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.320073+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:16:47.320073+0000","last_peered":"2023-10-03T19:16:47.320073+0000","last_clean":"2023-10-03T19:16:47.320073+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:16:47.320073+0000","last_undegraded":"2023-10-03T19:16:47.320073+0000","last_fullsized":"2023-10-03T19:16:47.320073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:26:43.642312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.319262+0000","last_change":"2023-10-03T19:16:46.316571+0000","last_active":"2023-10-03T19:16:46.319262+0000","last_peered":"2023-10-03T19:16:46.319262+0000","last_clean":"2023-10-03T19:16:46.319262+0000","last_became_active":"2023-10-03T19:16:46.316239+0000","last_became_peered":"2023-10-03T19:16:46.316239+0000","last_unstale":"2023-10-03T19:16:46.319262+0000","last_undegraded":"2023-10-03T19:16:46.319262+0000","last_fullsized":"2023-10-03T19:16:46.319262+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:08:12.582559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"60'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.326562+0000","last_change":"2023-10-03T19:16:45.972887+0000","last_active":"2023-10-03T19:16:46.326562+0000","last_peered":"2023-10-03T19:16:46.326562+0000","last_clean":"2023-10-03T19:16:46.326562+0000","last_became_active":"2023-10-03T19:16:45.972559+0000","last_became_peered":"2023-10-03T19:16:45.972559+0000","last_unstale":"2023-10-03T19:16:46.326562+0000","last_undegraded":"2023-10-03T19:16:46.326562+0000","last_fullsized":"2023-10-03T19:16:46.326562+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:22:51.054619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.618226+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:16:48.618226+0000","last_peered":"2023-10-03T19:16:48.618226+0000","last_clean":"2023-10-03T19:16:48.618226+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:16:48.618226+0000","last_undegraded":"2023-10-03T19:16:48.618226+0000","last_fullsized":"2023-10-03T19:16:48.618226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:03:15.124591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.319143+0000","last_change":"2023-10-03T19:16:46.319004+0000","last_active":"2023-10-03T19:16:47.319143+0000","last_peered":"2023-10-03T19:16:47.319143+0000","last_clean":"2023-10-03T19:16:47.319143+0000","last_became_active":"2023-10-03T19:16:46.318336+0000","last_became_peered":"2023-10-03T19:16:46.318336+0000","last_unstale":"2023-10-03T19:16:47.319143+0000","last_undegraded":"2023-10-03T19:16:47.319143+0000","last_fullsized":"2023-10-03T19:16:47.319143+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:01:03.753920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.319742+0000","last_change":"2023-10-03T19:16:45.952405+0000","last_active":"2023-10-03T19:16:47.319742+0000","last_peered":"2023-10-03T19:16:47.319742+0000","last_clean":"2023-10-03T19:16:47.319742+0000","last_became_active":"2023-10-03T19:16:45.950673+0000","last_became_peered":"2023-10-03T19:16:45.950673+0000","last_unstale":"2023-10-03T19:16:47.319742+0000","last_undegraded":"2023-10-03T19:16:47.319742+0000","last_fullsized":"2023-10-03T19:16:47.319742+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:31:23.819097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":91,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.313810+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:16:47.313810+0000","last_peered":"2023-10-03T19:16:47.313810+0000","last_clean":"2023-10-03T19:16:47.313810+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:16:47.313810+0000","last_undegraded":"2023-10-03T19:16:47.313810+0000","last_fullsized":"2023-10-03T19:16:47.313810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:50:21.278605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:49.532426+0000","last_change":"2023-10-03T19:16:46.362051+0000","last_active":"2023-10-03T19:16:49.532426+0000","last_peered":"2023-10-03T19:16:49.532426+0000","last_clean":"2023-10-03T19:16:49.532426+0000","last_became_active":"2023-10-03T19:16:46.361490+0000","last_became_peered":"2023-10-03T19:16:46.361490+0000","last_unstale":"2023-10-03T19:16:49.532426+0000","last_undegraded":"2023-10-03T19:16:49.532426+0000","last_fullsized":"2023-10-03T19:16:49.532426+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:41:31.281174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-03T19:16:46.308013+0000","last_change":"2023-10-03T19:16:45.981839+0000","last_active":"2023-10-03T19:16:46.308013+0000","last_peered":"2023-10-03T19:16:46.308013+0000","last_clean":"2023-10-03T19:16:46.308013+0000","last_became_active":"2023-10-03T19:16:45.981437+0000","last_became_peered":"2023-10-03T19:16:45.981437+0000","last_unstale":"2023-10-03T19:16:46.308013+0000","last_undegraded":"2023-10-03T19:16:46.308013+0000","last_fullsized":"2023-10-03T19:16:46.308013+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:22:49.705264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.319994+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:16:47.319994+0000","last_peered":"2023-10-03T19:16:47.319994+0000","last_clean":"2023-10-03T19:16:47.319994+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:16:47.319994+0000","last_undegraded":"2023-10-03T19:16:47.319994+0000","last_fullsized":"2023-10-03T19:16:47.319994+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:04:44.386638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.618436+0000","last_change":"2023-10-03T19:16:46.369329+0000","last_active":"2023-10-03T19:16:48.618436+0000","last_peered":"2023-10-03T19:16:48.618436+0000","last_clean":"2023-10-03T19:16:48.618436+0000","last_became_active":"2023-10-03T19:16:46.368233+0000","last_became_peered":"2023-10-03T19:16:46.368233+0000","last_unstale":"2023-10-03T19:16:48.618436+0000","last_undegraded":"2023-10-03T19:16:48.618436+0000","last_fullsized":"2023-10-03T19:16:48.618436+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:21:37.980362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"60'1","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.320383+0000","last_change":"2023-10-03T19:16:45.963091+0000","last_active":"2023-10-03T19:16:47.320383+0000","last_peered":"2023-10-03T19:16:47.320383+0000","last_clean":"2023-10-03T19:16:47.320383+0000","last_became_active":"2023-10-03T19:16:45.962361+0000","last_became_peered":"2023-10-03T19:16:45.962361+0000","last_unstale":"2023-10-03T19:16:47.320383+0000","last_undegraded":"2023-10-03T19:16:47.320383+0000","last_fullsized":"2023-10-03T19:16:47.320383+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:23:42.490777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":91,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.133183+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:16:48.133183+0000","last_peered":"2023-10-03T19:16:48.133183+0000","last_clean":"2023-10-03T19:16:48.133183+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:16:48.133183+0000","last_undegraded":"2023-10-03T19:16:48.133183+0000","last_fullsized":"2023-10-03T19:16:48.133183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:35:20.176259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:49.532808+0000","last_change":"2023-10-03T19:16:46.377006+0000","last_active":"2023-10-03T19:16:49.532808+0000","last_peered":"2023-10-03T19:16:49.532808+0000","last_clean":"2023-10-03T19:16:49.532808+0000","last_became_active":"2023-10-03T19:16:46.376427+0000","last_became_peered":"2023-10-03T19:16:46.376427+0000","last_unstale":"2023-10-03T19:16:49.532808+0000","last_undegraded":"2023-10-03T19:16:49.532808+0000","last_fullsized":"2023-10-03T19:16:49.532808+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:14:29.494445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"60'2","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.618826+0000","last_change":"2023-10-03T19:16:45.986459+0000","last_active":"2023-10-03T19:16:48.618826+0000","last_peered":"2023-10-03T19:16:48.618826+0000","last_clean":"2023-10-03T19:16:48.618826+0000","last_became_active":"2023-10-03T19:16:45.984797+0000","last_became_peered":"2023-10-03T19:16:45.984797+0000","last_unstale":"2023-10-03T19:16:48.618826+0000","last_undegraded":"2023-10-03T19:16:48.618826+0000","last_fullsized":"2023-10-03T19:16:48.618826+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:05:06.940214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.618946+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:16:48.618946+0000","last_peered":"2023-10-03T19:16:48.618946+0000","last_clean":"2023-10-03T19:16:48.618946+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:16:48.618946+0000","last_undegraded":"2023-10-03T19:16:48.618946+0000","last_fullsized":"2023-10-03T19:16:48.618946+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:27:18.868140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.322629+0000","last_change":"2023-10-03T19:16:46.370333+0000","last_active":"2023-10-03T19:16:47.322629+0000","last_peered":"2023-10-03T19:16:47.322629+0000","last_clean":"2023-10-03T19:16:47.322629+0000","last_became_active":"2023-10-03T19:16:46.369709+0000","last_became_peered":"2023-10-03T19:16:46.369709+0000","last_unstale":"2023-10-03T19:16:47.322629+0000","last_undegraded":"2023-10-03T19:16:47.322629+0000","last_fullsized":"2023-10-03T19:16:47.322629+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:57:21.709666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"60'1","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.618519+0000","last_change":"2023-10-03T19:16:45.985981+0000","last_active":"2023-10-03T19:16:48.618519+0000","last_peered":"2023-10-03T19:16:48.618519+0000","last_clean":"2023-10-03T19:16:48.618519+0000","last_became_active":"2023-10-03T19:16:45.984863+0000","last_became_peered":"2023-10-03T19:16:45.984863+0000","last_unstale":"2023-10-03T19:16:48.618519+0000","last_undegraded":"2023-10-03T19:16:48.618519+0000","last_fullsized":"2023-10-03T19:16:48.618519+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:35:26.496314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":91,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:48.132960+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:16:48.132960+0000","last_peered":"2023-10-03T19:16:48.132960+0000","last_clean":"2023-10-03T19:16:48.132960+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:16:48.132960+0000","last_undegraded":"2023-10-03T19:16:48.132960+0000","last_fullsized":"2023-10-03T19:16:48.132960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:25:03.707610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:49.532600+0000","last_change":"2023-10-03T19:16:46.362431+0000","last_active":"2023-10-03T19:16:49.532600+0000","last_peered":"2023-10-03T19:16:49.532600+0000","last_clean":"2023-10-03T19:16:49.532600+0000","last_became_active":"2023-10-03T19:16:46.361629+0000","last_became_peered":"2023-10-03T19:16:46.361629+0000","last_unstale":"2023-10-03T19:16:49.532600+0000","last_undegraded":"2023-10-03T19:16:49.532600+0000","last_fullsized":"2023-10-03T19:16:49.532600+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:45.921406+0000","last_clean_scrub_stamp":"2023-10-03T19:16:45.921406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:12:46.908741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:47.653152+0000","last_change":"2023-10-03T19:16:45.967790+0000","last_active":"2023-10-03T19:16:47.653152+0000","last_peered":"2023-10-03T19:16:47.653152+0000","last_clean":"2023-10-03T19:16:47.653152+0000","last_became_active":"2023-10-03T19:16:45.967432+0000","last_became_peered":"2023-10-03T19:16:45.967432+0000","last_unstale":"2023-10-03T19:16:47.653152+0000","last_undegraded":"2023-10-03T19:16:47.653152+0000","last_fullsized":"2023-10-03T19:16:47.653152+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:16:44.910598+0000","last_clean_scrub_stamp":"2023-10-03T19:16:44.910598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:33:53.962566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-03T19:16:49.532941+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:16:49.532941+0000","last_peered":"2023-10-03T19:16:49.532941+0000","last_clean":"2023-10-03T19:16:49.532941+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:16:49.532941+0000","last_undegraded":"2023-10-03T19:16:49.532941+0000","last_fullsized":"2023-10-03T19:16:49.532941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:51:27.107283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509497,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25692,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":24896,"kb_avail":94346148,"statfs":{"total":96636764160,"available":96610455552,"internally_reserved":0,"allocated":806912,"data_stored":913368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":25493504},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.90900000000000003,"15min":0.94499999999999995},"min":{"1min":0.52000000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.196,"5min":4.0469999999999997,"15min":4.0469999999999997},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.85799999999999998,"15min":0.81200000000000006},"min":{"1min":0.625,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2310000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.65500000000000003}]},{"osd":1,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94399999999999995,"15min":1.0269999999999999},"min":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3200000000000001,"5min":3.8239999999999998,"15min":3.8239999999999998},"last":0.75},{"interface":"front","average":{"1min":0.873,"5min":0.88300000000000001,"15min":0.85899999999999999},"min":{"1min":0.65800000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.159,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.55800000000000005}]},{"osd":2,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.93600000000000005,"15min":0.87},"min":{"1min":0.71499999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.212,"5min":6.0449999999999999,"15min":6.0449999999999999},"last":0.62},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0029999999999999,"15min":1.04},"min":{"1min":0.77400000000000002,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.5800000000000001,"5min":3.98,"15min":3.98},"last":0.92700000000000005}]},{"osd":3,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.996,"15min":0.94399999999999995},"min":{"1min":0.65300000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.26,"5min":6.125,"15min":6.125},"last":0.71899999999999997},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0700000000000001,"15min":1.123},"min":{"1min":0.61899999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.444,"5min":3.9140000000000001,"15min":3.9140000000000001},"last":1.0760000000000001}]},{"osd":4,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":1.036,"15min":1.1599999999999999},"min":{"1min":0.55900000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.421,"5min":5.1130000000000004,"15min":5.1130000000000004},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.92500000000000004,"5min":1.022,"15min":1.028},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.385,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":0.83999999999999997}]},{"osd":5,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.135,"15min":1.268},"min":{"1min":0.72499999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.27,"5min":5.1859999999999999,"15min":5.1859999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0840000000000001,"15min":1.1459999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.216,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":0.879}]},{"osd":6,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0920000000000001,"15min":1.1000000000000001},"min":{"1min":0.78900000000000003,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.3440000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.179,"15min":1.1850000000000001},"min":{"1min":0.81799999999999995,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.466,"5min":6.1580000000000004,"15min":6.1580000000000004},"last":0.90600000000000003}]}]},{"osd":6,"up_from":15,"seq":64424509497,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14860,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":14144,"kb_avail":94356980,"statfs":{"total":96636764160,"available":96621547520,"internally_reserved":0,"allocated":724992,"data_stored":321094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14483456},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83499999999999996,"15min":0.81899999999999995},"min":{"1min":0.60499999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.139,"5min":1.504,"15min":1.504},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.89900000000000002,"15min":0.88500000000000001},"min":{"1min":0.56699999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.171,"5min":1.839,"15min":1.839},"last":1.004}]},{"osd":1,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.85699999999999998,"15min":0.84099999999999997},"min":{"1min":0.53100000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.1859999999999999,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89000000000000001,"15min":0.88},"min":{"1min":0.59799999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.127,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.96499999999999997}]},{"osd":2,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.91700000000000004,"15min":0.874},"min":{"1min":0.65800000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3600000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.92100000000000004,"15min":0.92600000000000005},"min":{"1min":0.63200000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3200000000000001,"5min":1.546,"15min":1.546},"last":0.83099999999999996}]},{"osd":3,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.96599999999999997,"15min":0.98199999999999998},"min":{"1min":0.70799999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.073},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.91800000000000004,"15min":0.91200000000000003},"min":{"1min":0.69399999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1870000000000001,"5min":2.121,"15min":2.121},"last":0.90300000000000002}]},{"osd":4,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.97299999999999998,"15min":1.026},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.286,"5min":1.95,"15min":1.95},"last":0.87},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0329999999999999,"15min":1.091},"min":{"1min":0.65500000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.429,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.171}]},{"osd":5,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.97199999999999998,"15min":1.0189999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.1259999999999999,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.079,"5min":1.0800000000000001,"15min":1.1200000000000001},"min":{"1min":0.75700000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.524,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.0429999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.093,"15min":1.121},"min":{"1min":0.73699999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.3220000000000001,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.129},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.071,"15min":1.097},"min":{"1min":0.79600000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4350000000000001,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.194}]}]},{"osd":4,"up_from":15,"seq":64424509498,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15576,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":14848,"kb_avail":94356264,"statfs":{"total":96636764160,"available":96620814336,"internally_reserved":0,"allocated":737280,"data_stored":323788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15204352},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.83499999999999996,"15min":0.79000000000000004},"min":{"1min":0.54700000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.83899999999999997,"15min":0.82499999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.026,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.72399999999999998}]},{"osd":1,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.92000000000000004,"15min":0.93200000000000005},"min":{"1min":0.61399999999999999,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.117,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":1.2230000000000001},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.89700000000000002,"15min":0.86099999999999999},"min":{"1min":0.68799999999999994,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1799999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.77800000000000002}]},{"osd":2,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.93899999999999995,"15min":0.91700000000000004},"min":{"1min":0.56200000000000006,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2390000000000001,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.96599999999999997,"15min":0.94399999999999995},"min":{"1min":0.78300000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.1359999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.93899999999999995}]},{"osd":3,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.89400000000000002,"15min":0.877},"min":{"1min":0.69199999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.153,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.996,"5min":1.0449999999999999,"15min":1.0649999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3400000000000001,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":1.274}]},{"osd":5,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.99099999999999999,"15min":1.05},"min":{"1min":0.67100000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1819999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.98099999999999998,"15min":1.0109999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.387,"5min":1.635,"15min":1.635},"last":0.89900000000000002}]},{"osd":6,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.0780000000000001,"15min":1.1839999999999999},"min":{"1min":0.71499999999999997,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.1120000000000001,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.1120000000000001,"15min":1.181},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.3640000000000001,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":1.0549999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:16:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0509999999999999,"15min":1.085},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.242,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.022},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.1759999999999999,"15min":1.2250000000000001},"min":{"1min":0.85599999999999998,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3260000000000001,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":1.361}]}]},{"osd":2,"up_from":15,"seq":64424509498,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25672,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":24960,"kb_avail":94346168,"statfs":{"total":96636764160,"available":96610476032,"internally_reserved":0,"allocated":720896,"data_stored":321060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25559040},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.60399999999999998,"15min":0.54100000000000004},"min":{"1min":0.47099999999999997,"5min":0.247,"15min":0.247},"max":{"1min":1.1020000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.69599999999999995,"15min":0.63},"min":{"1min":0.30299999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.2350000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.70499999999999996}]},{"osd":1,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71299999999999997,"15min":0.63300000000000001},"min":{"1min":0.48599999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1739999999999999,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.67400000000000004,"15min":0.60399999999999998},"min":{"1min":0.42599999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.61599999999999999}]},{"osd":3,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.71499999999999997,"15min":0.63700000000000001},"min":{"1min":0.40500000000000003,"5min":0.224,"15min":0.224},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.82199999999999995,"15min":0.73599999999999999},"min":{"1min":0.44600000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1419999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.64900000000000002}]},{"osd":4,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.91800000000000004,"15min":0.85799999999999998},"min":{"1min":0.63,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.98599999999999999,"15min":0.92400000000000004},"min":{"1min":0.71499999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.76300000000000001}]},{"osd":5,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.94999999999999996,"15min":0.876},"min":{"1min":0.76600000000000001,"5min":0.432,"15min":0.432},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.331},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0249999999999999,"15min":0.95099999999999996},"min":{"1min":0.68100000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4239999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.0449999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.96399999999999997,"15min":0.92200000000000004},"min":{"1min":0.66300000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.101},{"interface":"front","average":{"1min":1.139,"5min":1.0409999999999999,"15min":0.97699999999999998},"min":{"1min":0.64800000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":1.4039999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:16:28 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.0920000000000001,"15min":1.0169999999999999},"min":{"1min":0.74199999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.109,"5min":1.024,"15min":0.96799999999999997},"min":{"1min":0.71099999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.2110000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509497,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14888,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":14144,"kb_avail":94356952,"statfs":{"total":96636764160,"available":96621518848,"internally_reserved":0,"allocated":753664,"data_stored":324552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14483456},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58499999999999996,"15min":0.54800000000000004},"min":{"1min":0.35899999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.96899999999999997,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.628,"15min":0.52400000000000002},"min":{"1min":0.45200000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.49199999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.63600000000000001,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.75800000000000001,"15min":0.67500000000000004},"min":{"1min":0.44700000000000001,"5min":0.312,"15min":0.312},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.748}]},{"osd":3,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.72499999999999998,"15min":0.64300000000000002},"min":{"1min":0.41699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.2370000000000001,"5min":1.27,"15min":1.27},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.69699999999999995,"15min":0.59699999999999998},"min":{"1min":0.47699999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1830000000000001,"5min":1.27,"15min":1.27},"last":1.0289999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.86199999999999999,"15min":0.80700000000000005},"min":{"1min":0.69099999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.05},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.93799999999999994,"15min":0.89400000000000002},"min":{"1min":0.65900000000000003,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.871}]},{"osd":5,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.94299999999999995,"15min":0.86799999999999999},"min":{"1min":0.69899999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.92000000000000004,"15min":0.85899999999999999},"min":{"1min":0.80700000000000005,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3959999999999999,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.98799999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.99399999999999999,"15min":0.93000000000000005},"min":{"1min":0.68999999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":0.97999999999999998,"15min":0.90400000000000003},"min":{"1min":0.879,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.329,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.1200000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0269999999999999,"15min":0.94799999999999995},"min":{"1min":0.78500000000000003,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.083},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.99299999999999999,"15min":0.91100000000000003},"min":{"1min":0.71899999999999997,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5880000000000001,"5min":1.649,"15min":1.649},"last":1.099}]}]},{"osd":3,"up_from":14,"seq":60129542201,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34060,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":33344,"kb_avail":94337780,"statfs":{"total":96636764160,"available":96601886720,"internally_reserved":0,"allocated":724992,"data_stored":322224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":34144256},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.627,"15min":0.57699999999999996},"min":{"1min":0.40200000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.2090000000000001,"5min":1.212,"15min":1.212},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68700000000000006,"15min":0.64800000000000002},"min":{"1min":0.32900000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.125,"5min":1.236,"15min":1.236},"last":0.95499999999999996}]},{"osd":1,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.69399999999999995,"15min":0.63700000000000001},"min":{"1min":0.51400000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0589999999999999,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.622},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.73599999999999999,"15min":0.67300000000000004},"min":{"1min":0.53000000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.2210000000000001,"5min":1.222,"15min":1.222},"last":0.84099999999999997}]},{"osd":2,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.77600000000000002,"15min":0.71599999999999997},"min":{"1min":0.44600000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.083,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.70999999999999996,"15min":0.63700000000000001},"min":{"1min":0.432,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.58899999999999997}]},{"osd":4,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.94299999999999995,"15min":0.91500000000000004},"min":{"1min":0.58899999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.131,"5min":1.496,"15min":1.496},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.97799999999999998,"15min":0.93799999999999994},"min":{"1min":0.64100000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.486,"5min":1.546,"15min":1.546},"last":1.1479999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.91800000000000004,"15min":0.88200000000000001},"min":{"1min":0.68300000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3280000000000001,"5min":1.51,"15min":1.51},"last":1.016},{"interface":"front","average":{"1min":1.044,"5min":1.0249999999999999,"15min":1},"min":{"1min":0.66300000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.387,"5min":1.498,"15min":1.498},"last":0.88500000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.95999999999999996,"15min":0.92400000000000004},"min":{"1min":0.60899999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1639999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.052},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.042,"15min":0.99299999999999999},"min":{"1min":0.70299999999999996,"5min":0.625,"15min":0.625},"max":{"1min":1.2969999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.93500000000000005}]},{"osd":7,"last update":"Tue Oct 3 19:16:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0489999999999999,"15min":1.0089999999999999},"min":{"1min":0.68899999999999995,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.395,"5min":1.597,"15min":1.597},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.0700000000000001,"15min":1.024},"min":{"1min":0.72699999999999998,"5min":0.623,"15min":0.623},"max":{"1min":1.6040000000000001,"5min":1.708,"15min":1.708},"last":1.129}]}]},{"osd":5,"up_from":13,"seq":55834574904,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16272,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":15552,"kb_avail":94355568,"statfs":{"total":96636764160,"available":96620101632,"internally_reserved":0,"allocated":729088,"data_stored":322246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15925248},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.85699999999999998,"15min":0.82599999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.1919999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85899999999999999,"15min":0.85299999999999998},"min":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.77600000000000002}]},{"osd":1,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.85299999999999998,"15min":0.83399999999999996},"min":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0920000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.748},{"interface":"front","average":{"1min":0.873,"5min":0.91900000000000004,"15min":0.92500000000000004},"min":{"1min":0.59799999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.149,"5min":1.514,"15min":1.514},"last":0.98399999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.90800000000000003,"15min":0.89800000000000002},"min":{"1min":0.56299999999999994,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.234,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.90700000000000003,"15min":0.89700000000000002},"min":{"1min":0.66100000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1499999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.81000000000000005}]},{"osd":3,"last update":"Tue Oct 3 19:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.93200000000000005,"15min":0.92800000000000005},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.2629999999999999,"5min":1.304,"15min":1.304},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0369999999999999,"15min":1.0289999999999999},"min":{"1min":0.75,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.95999999999999996}]},{"osd":4,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.96499999999999997,"15min":0.96899999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.29,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.995,"15min":1.0309999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.222,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.006}]},{"osd":6,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.98899999999999999,"15min":1.0309999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2050000000000001,"5min":1.462,"15min":1.462},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.083,"5min":1.1200000000000001,"15min":1.1379999999999999},"min":{"1min":0.78200000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.3759999999999999,"5min":1.823,"15min":1.823},"last":0.88300000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:16:32 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.0640000000000001,"15min":1.0760000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3280000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.141,"15min":1.1519999999999999},"min":{"1min":0.79100000000000004,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.399,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.92900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21756,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":20992,"kb_avail":94350084,"statfs":{"total":96636764160,"available":96614486016,"internally_reserved":0,"allocated":774144,"data_stored":904775,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":21495808},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63100000000000001,"15min":0.58599999999999997},"min":{"1min":0.44400000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.75600000000000001,"15min":0.71899999999999997},"min":{"1min":0.5,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.1970000000000001,"5min":1.27,"15min":1.27},"last":0.59699999999999998}]},{"osd":2,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.73799999999999999,"15min":0.71799999999999997},"min":{"1min":0.50800000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1299999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.46800000000000003,"5min":0.315,"15min":0.315},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.82599999999999996}]},{"osd":3,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.82099999999999995,"15min":0.73699999999999999},"min":{"1min":0.59299999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.202,"5min":1.446,"15min":1.446},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.87,"5min":0.80000000000000004,"15min":0.70999999999999996},"min":{"1min":0.51000000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.304,"5min":1.375,"15min":1.375},"last":0.65300000000000002}]},{"osd":4,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.93000000000000005,"15min":0.91200000000000003},"min":{"1min":0.70299999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.052,"15min":1.028},"min":{"1min":0.89200000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.349,"5min":1.508,"15min":1.508},"last":0.79000000000000004}]},{"osd":5,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.073,"15min":1.0509999999999999},"min":{"1min":0.90400000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3129999999999999,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.875},{"interface":"front","average":{"1min":1.081,"5min":1.0209999999999999,"15min":0.98199999999999998},"min":{"1min":0.77100000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.86599999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.0600000000000001,"15min":1.022},"min":{"1min":0.81200000000000006,"5min":0.623,"15min":0.623},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.04,"15min":0.999},"min":{"1min":0.755,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.448,"5min":1.637,"15min":1.637},"last":1.093}]},{"osd":7,"last update":"Tue Oct 3 19:16:30 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.0860000000000001,"15min":1.042},"min":{"1min":0.72799999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.089,"15min":1.0629999999999999},"min":{"1min":0.76300000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5940000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.0469999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:16:54.192 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-03T19:16:54.192 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-03T19:16:54.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.354+0000 7fb8effff640 1 Processor -- start 2023-10-03T19:16:54.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.354+0000 7fb8effff640 1 -- start start 2023-10-03T19:16:54.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.358+0000 7fb8effff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb8f006e930 0x7fb8f0157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:54.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.358+0000 7fb8effff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f00a71a0 con 0x7fb8f006f340 2023-10-03T19:16:54.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.358+0000 7fb8effff640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f00a7450 con 0x7fb8f00a4a60 2023-10-03T19:16:54.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.358+0000 7fb8effff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f0071650 con 0x7fb8f006e930 2023-10-03T19:16:54.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.358+0000 7fb8ef7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb8f006e930 0x7fb8f0157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:54.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.358+0000 7fb8ee7fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb8f006f340 0x7fb8f006e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55576/0 (socket says 172.21.15.45:55576) 2023-10-03T19:16:54.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.358+0000 7fb8ef7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb8f006e930 0x7fb8f0157bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37108/0 (socket says 172.21.15.45:37108) 2023-10-03T19:16:54.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.358+0000 7fb8ee7fc640 1 -- 172.21.15.45:0/1056111470 learned_addr learned my addr 172.21.15.45:0/1056111470 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:54.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.358+0000 7fb8ef7fe640 1 -- 172.21.15.45:0/1056111470 >> v1:172.21.15.79:6789/0 conn(0x7fb8f00a4a60 legacy=0x7fb8f014b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:54.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.358+0000 7fb8ef7fe640 1 -- 172.21.15.45:0/1056111470 >> v1:172.21.15.45:6789/0 conn(0x7fb8f006f340 legacy=0x7fb8f006e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:54.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.358+0000 7fb8ef7fe640 1 -- 172.21.15.45:0/1056111470 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f0071930 con 0x7fb8f006e930 2023-10-03T19:16:54.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.358+0000 7fb8ef7fe640 1 --2- 172.21.15.45:0/1056111470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f006e930 0x7fb8f0157bb0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8009d90 tx=0x7fb8e801f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1bae9f8e5c47e6a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:54.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.358+0000 7fb8edffb640 1 -- 172.21.15.45:0/1056111470 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e80af600 con 0x7fb8f006e930 2023-10-03T19:16:54.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.358+0000 7fb8edffb640 1 -- 172.21.15.45:0/1056111470 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e80ab050 con 0x7fb8f006e930 2023-10-03T19:16:54.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.358+0000 7fb8edffb640 1 -- 172.21.15.45:0/1056111470 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e80af980 con 0x7fb8f006e930 2023-10-03T19:16:54.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.358+0000 7fb8effff640 1 -- 172.21.15.45:0/1056111470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f006e930 msgr2=0x7fb8f0157bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:54.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.358+0000 7fb8effff640 1 --2- 172.21.15.45:0/1056111470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f006e930 0x7fb8f0157bb0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8009d90 tx=0x7fb8e801f130 comp rx=0 tx=0).stop 2023-10-03T19:16:54.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.358+0000 7fb8effff640 1 -- 172.21.15.45:0/1056111470 shutdown_connections 2023-10-03T19:16:54.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.358+0000 7fb8effff640 1 --2- 172.21.15.45:0/1056111470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f006e930 0x7fb8f0157bb0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:54.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.358+0000 7fb8effff640 1 -- 172.21.15.45:0/1056111470 >> 172.21.15.45:0/1056111470 conn(0x7fb8f006c910 msgr2=0x7fb8f00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:54.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.358+0000 7fb8effff640 1 -- 172.21.15.45:0/1056111470 shutdown_connections 2023-10-03T19:16:54.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.358+0000 7fb8effff640 1 -- 172.21.15.45:0/1056111470 wait complete. 2023-10-03T19:16:54.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.362+0000 7fb8effff640 1 Processor -- start 2023-10-03T19:16:54.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.362+0000 7fb8effff640 1 -- start start 2023-10-03T19:16:54.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.362+0000 7fb8effff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb8f006e930 0x7fb8f0149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:54.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.362+0000 7fb8effff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f006f340 0x7fb8f01464d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:54.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.362+0000 7fb8effff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8f00a4a60 0x7fb8f014e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:54.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.362+0000 7fb8effff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f01e42d0 con 0x7fb8f006f340 2023-10-03T19:16:54.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.362+0000 7fb8effff640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f006b520 con 0x7fb8f00a4a60 2023-10-03T19:16:54.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.362+0000 7fb8effff640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f014e090 con 0x7fb8f006e930 2023-10-03T19:16:54.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.362+0000 7fb8ee7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f006f340 0x7fb8f01464d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:54.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.362+0000 7fb8ee7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f006f340 0x7fb8f01464d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37124/0 (socket says 172.21.15.45:37124) 2023-10-03T19:16:54.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.362+0000 7fb8ee7fc640 1 -- 172.21.15.45:0/2259173264 learned_addr learned my addr 172.21.15.45:0/2259173264 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:54.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.362+0000 7fb8eeffd640 1 --2- 172.21.15.45:0/2259173264 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb8f006e930 0x7fb8f0149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:54.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.362+0000 7fb8ef7fe640 1 --2- 172.21.15.45:0/2259173264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8f00a4a60 0x7fb8f014e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:54.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.362+0000 7fb8ee7fc640 1 -- 172.21.15.45:0/2259173264 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb8f006e930 msgr2=0x7fb8f0149ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:54.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.362+0000 7fb8ee7fc640 1 --2- 172.21.15.45:0/2259173264 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb8f006e930 0x7fb8f0149ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:54.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.362+0000 7fb8ee7fc640 1 -- 172.21.15.45:0/2259173264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8f00a4a60 msgr2=0x7fb8f014e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:54.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.362+0000 7fb8ee7fc640 1 --2- 172.21.15.45:0/2259173264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8f00a4a60 0x7fb8f014e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:54.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.362+0000 7fb8ee7fc640 1 -- 172.21.15.45:0/2259173264 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e8009a70 con 0x7fb8f006f340 2023-10-03T19:16:54.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.362+0000 7fb8eeffd640 1 --2- 172.21.15.45:0/2259173264 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb8f006e930 0x7fb8f0149ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:54.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.362+0000 7fb8ee7fc640 1 --2- 172.21.15.45:0/2259173264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f006f340 0x7fb8f01464d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400c530 tx=0x7fb8e400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:54.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.362+0000 7fb8d77fe640 1 -- 172.21.15.45:0/2259173264 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4005cf0 con 0x7fb8f006f340 2023-10-03T19:16:54.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.362+0000 7fb8d77fe640 1 -- 172.21.15.45:0/2259173264 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e4005e50 con 0x7fb8f006f340 2023-10-03T19:16:54.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.362+0000 7fb8effff640 1 -- 172.21.15.45:0/2259173264 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f0070f40 con 0x7fb8f006f340 2023-10-03T19:16:54.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.362+0000 7fb8d77fe640 1 -- 172.21.15.45:0/2259173264 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4007270 con 0x7fb8f006f340 2023-10-03T19:16:54.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.362+0000 7fb8effff640 1 -- 172.21.15.45:0/2259173264 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f0071c10 con 0x7fb8f006f340 2023-10-03T19:16:54.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.362+0000 7fb8effff640 1 -- 172.21.15.45:0/2259173264 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f00bc8e0 con 0x7fb8f006f340 2023-10-03T19:16:54.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.366+0000 7fb8d77fe640 1 -- 172.21.15.45:0/2259173264 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb8e40073d0 con 0x7fb8f006f340 2023-10-03T19:16:54.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.366+0000 7fb8d77fe640 1 --2- 172.21.15.45:0/2259173264 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb8dc066280 0x7fb8dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:54.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.366+0000 7fb8d77fe640 1 -- 172.21.15.45:0/2259173264 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb8e40831f0 con 0x7fb8f006f340 2023-10-03T19:16:54.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.366+0000 7fb8eeffd640 1 --2- 172.21.15.45:0/2259173264 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb8dc066280 0x7fb8dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:54.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.366+0000 7fb8eeffd640 1 --2- 172.21.15.45:0/2259173264 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb8dc066280 0x7fb8dc068730 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0000f70 tx=0x7fb8e0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:54.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.370+0000 7fb8d77fe640 1 -- 172.21.15.45:0/2259173264 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb8e4050710 con 0x7fb8f006f340 2023-10-03T19:16:54.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.578+0000 7fb8effff640 1 -- 172.21.15.45:0/2259173264 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb8f01e4410 con 0x7fb8f006f340 2023-10-03T19:16:54.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.586+0000 7fb8d77fe640 1 -- 172.21.15.45:0/2259173264 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7fb8e4053d30 con 0x7fb8f006f340 2023-10-03T19:16:54.592 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-10-03T19:16:54.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.590+0000 7fb8effff640 1 -- 172.21.15.45:0/2259173264 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb8dc066280 msgr2=0x7fb8dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:54.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.590+0000 7fb8effff640 1 --2- 172.21.15.45:0/2259173264 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb8dc066280 0x7fb8dc068730 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0000f70 tx=0x7fb8e0009040 comp rx=0 tx=0).stop 2023-10-03T19:16:54.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.590+0000 7fb8effff640 1 -- 172.21.15.45:0/2259173264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f006f340 msgr2=0x7fb8f01464d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:54.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.590+0000 7fb8effff640 1 --2- 172.21.15.45:0/2259173264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f006f340 0x7fb8f01464d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400c530 tx=0x7fb8e400c9f0 comp rx=0 tx=0).stop 2023-10-03T19:16:54.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.590+0000 7fb8effff640 1 -- 172.21.15.45:0/2259173264 shutdown_connections 2023-10-03T19:16:54.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.590+0000 7fb8effff640 1 --2- 172.21.15.45:0/2259173264 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb8dc066280 0x7fb8dc068730 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:54.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.590+0000 7fb8effff640 1 --2- 172.21.15.45:0/2259173264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8f00a4a60 0x7fb8f014e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:54.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.590+0000 7fb8effff640 1 --2- 172.21.15.45:0/2259173264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f006f340 0x7fb8f01464d0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:54.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.590+0000 7fb8effff640 1 --2- 172.21.15.45:0/2259173264 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb8f006e930 0x7fb8f0149ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:54.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.590+0000 7fb8effff640 1 -- 172.21.15.45:0/2259173264 >> 172.21.15.45:0/2259173264 conn(0x7fb8f006c910 msgr2=0x7fb8f014be40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:54.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.590+0000 7fb8effff640 1 -- 172.21.15.45:0/2259173264 shutdown_connections 2023-10-03T19:16:54.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.590+0000 7fb8effff640 1 -- 172.21.15.45:0/2259173264 wait complete. 2023-10-03T19:16:54.612 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:16:54.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.730+0000 7fc08cf8f640 1 Processor -- start 2023-10-03T19:16:54.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.730+0000 7fc08cf8f640 1 -- start start 2023-10-03T19:16:54.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.730+0000 7fc08cf8f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc0880a9f60 0x7fc0880c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:54.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.730+0000 7fc08cf8f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc08814f120 con 0x7fc0880c5160 2023-10-03T19:16:54.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.730+0000 7fc08cf8f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc08814f650 con 0x7fc0880c5530 2023-10-03T19:16:54.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.730+0000 7fc08cf8f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0880aa430 con 0x7fc0880a9f60 2023-10-03T19:16:54.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.730+0000 7fc08659c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc0880c5160 0x7fc088069ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56646/0 (socket says 172.21.15.45:56646) 2023-10-03T19:16:54.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.730+0000 7fc08659c640 1 -- 172.21.15.45:0/1354924254 learned_addr learned my addr 172.21.15.45:0/1354924254 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:54.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.730+0000 7fc086d9d640 1 --2- 172.21.15.45:0/1354924254 >> v2:172.21.15.45:3300/0 conn(0x7fc0880a9f60 0x7fc0880c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:54.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.730+0000 7fc08559a640 1 -- 172.21.15.45:0/1354924254 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334943896 0 0) 0x7fc08814f120 con 0x7fc0880c5160 2023-10-03T19:16:54.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.730+0000 7fc08559a640 1 -- 172.21.15.45:0/1354924254 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc074003530 con 0x7fc0880c5160 2023-10-03T19:16:54.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.730+0000 7fc086d9d640 1 -- 172.21.15.45:0/1354924254 >> v1:172.21.15.79:6789/0 conn(0x7fc0880c5530 legacy=0x7fc0880a9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:54.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.730+0000 7fc08559a640 1 -- 172.21.15.45:0/1354924254 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3640204387 0 0) 0x7fc074003530 con 0x7fc0880c5160 2023-10-03T19:16:54.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.730+0000 7fc086d9d640 1 -- 172.21.15.45:0/1354924254 >> v1:172.21.15.45:6789/0 conn(0x7fc0880c5160 legacy=0x7fc088069ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:54.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.730+0000 7fc086d9d640 1 -- 172.21.15.45:0/1354924254 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08814f370 con 0x7fc0880a9f60 2023-10-03T19:16:54.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc086d9d640 1 --2- 172.21.15.45:0/1354924254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0880a9f60 0x7fc0880c3ca0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fc0800097a0 tx=0x7fc08001c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d9c074126ec0b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:54.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc08559a640 1 -- 172.21.15.45:0/1354924254 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08806b7a0 con 0x7fc0880a9f60 2023-10-03T19:16:54.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc08559a640 1 -- 172.21.15.45:0/1354924254 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0800a7050 con 0x7fc0880a9f60 2023-10-03T19:16:54.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc08559a640 1 -- 172.21.15.45:0/1354924254 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc078001a00 con 0x7fc0880a9f60 2023-10-03T19:16:54.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc08cf8f640 1 -- 172.21.15.45:0/1354924254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0880a9f60 msgr2=0x7fc0880c3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:54.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc08cf8f640 1 --2- 172.21.15.45:0/1354924254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0880a9f60 0x7fc0880c3ca0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fc0800097a0 tx=0x7fc08001c2f0 comp rx=0 tx=0).stop 2023-10-03T19:16:54.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc08cf8f640 1 -- 172.21.15.45:0/1354924254 shutdown_connections 2023-10-03T19:16:54.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc08cf8f640 1 --2- 172.21.15.45:0/1354924254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0880a9f60 0x7fc0880c3ca0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:54.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc08cf8f640 1 -- 172.21.15.45:0/1354924254 >> 172.21.15.45:0/1354924254 conn(0x7fc0880a7080 msgr2=0x7fc0880c4880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:54.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc08cf8f640 1 -- 172.21.15.45:0/1354924254 shutdown_connections 2023-10-03T19:16:54.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc08cf8f640 1 -- 172.21.15.45:0/1354924254 wait complete. 2023-10-03T19:16:54.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc08cf8f640 1 Processor -- start 2023-10-03T19:16:54.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc08cf8f640 1 -- start start 2023-10-03T19:16:54.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc08cf8f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0880a9f60 0x7fc0880bdd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:54.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc08cf8f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0880c5160 0x7fc088153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:54.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc08cf8f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0881ea6f0 0x7fc0881eab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:54.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc08cf8f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc088154870 con 0x7fc0880a9f60 2023-10-03T19:16:54.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc08cf8f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0880be2c0 con 0x7fc0880c5160 2023-10-03T19:16:54.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc08cf8f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc088152f10 con 0x7fc0881ea6f0 2023-10-03T19:16:54.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc08659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0880a9f60 0x7fc0880bdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:54.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc08659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0880a9f60 0x7fc0880bdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54230/0 (socket says 172.21.15.45:54230) 2023-10-03T19:16:54.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc08659c640 1 -- 172.21.15.45:0/2634359147 learned_addr learned my addr 172.21.15.45:0/2634359147 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:54.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc08659c640 1 -- 172.21.15.45:0/2634359147 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0881ea6f0 msgr2=0x7fc0881eab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:54.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc08659c640 1 --2- 172.21.15.45:0/2634359147 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0881ea6f0 0x7fc0881eab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:54.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc08659c640 1 -- 172.21.15.45:0/2634359147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0880c5160 msgr2=0x7fc088153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:54.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc08659c640 1 --2- 172.21.15.45:0/2634359147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0880c5160 0x7fc088153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:54.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc08659c640 1 -- 172.21.15.45:0/2634359147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc080009400 con 0x7fc0880a9f60 2023-10-03T19:16:54.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc08659c640 1 --2- 172.21.15.45:0/2634359147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0880a9f60 0x7fc0880bdd80 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc078002030 tx=0x7fc07800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:54.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc07effd640 1 -- 172.21.15.45:0/2634359147 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc078012400 con 0x7fc0880a9f60 2023-10-03T19:16:54.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc07effd640 1 -- 172.21.15.45:0/2634359147 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc078012580 con 0x7fc0880a9f60 2023-10-03T19:16:54.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc08cf8f640 1 -- 172.21.15.45:0/2634359147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0880c0ec0 con 0x7fc0880a9f60 2023-10-03T19:16:54.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc07effd640 1 -- 172.21.15.45:0/2634359147 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc078012930 con 0x7fc0880a9f60 2023-10-03T19:16:54.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.734+0000 7fc08cf8f640 1 -- 172.21.15.45:0/2634359147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0880c0d30 con 0x7fc0880a9f60 2023-10-03T19:16:54.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.738+0000 7fc08cf8f640 1 -- 172.21.15.45:0/2634359147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0880c1050 con 0x7fc0880a9f60 2023-10-03T19:16:54.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.738+0000 7fc07effd640 1 -- 172.21.15.45:0/2634359147 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc078012a90 con 0x7fc0880a9f60 2023-10-03T19:16:54.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.738+0000 7fc07effd640 1 --2- 172.21.15.45:0/2634359147 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc068066280 0x7fc068068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:54.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.738+0000 7fc07effd640 1 -- 172.21.15.45:0/2634359147 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc0780845b0 con 0x7fc0880a9f60 2023-10-03T19:16:54.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.738+0000 7fc085d9b640 1 --2- 172.21.15.45:0/2634359147 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc068066280 0x7fc068068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:54.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.738+0000 7fc085d9b640 1 --2- 172.21.15.45:0/2634359147 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc068066280 0x7fc068068730 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc070000f70 tx=0x7fc0700079c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:54.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.742+0000 7fc07effd640 1 -- 172.21.15.45:0/2634359147 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc078051a20 con 0x7fc0880a9f60 2023-10-03T19:16:54.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.926+0000 7fc08cf8f640 1 -- 172.21.15.45:0/2634359147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc08804de80 con 0x7fc0880a9f60 2023-10-03T19:16:54.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.930+0000 7fc07effd640 1 -- 172.21.15.45:0/2634359147 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+3915 (secure 0 0 0) 0x7fc078055040 con 0x7fc0880a9f60 2023-10-03T19:16:54.935 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:16:54.935 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1808337334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1808337334},{"type":"v1","addr":"172.21.15.45:6835","nonce":1808337334}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5533,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3484102267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3484102267},{"type":"v1","addr":"172.21.15.79:6835","nonce":3484102267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:16:46.297139+0000","modified":"2023-10-03T19:16:48.310624+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5904},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5904":{"gid":5904,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6833/2572156585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2572156585},{"type":"v1","addr":"172.21.15.45:6833","nonce":2572156585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-10-03T19:16:54.936 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 29 2023-10-03T19:16:54.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.930+0000 7fc08cf8f640 1 -- 172.21.15.45:0/2634359147 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc068066280 msgr2=0x7fc068068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:54.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.930+0000 7fc08cf8f640 1 --2- 172.21.15.45:0/2634359147 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc068066280 0x7fc068068730 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc070000f70 tx=0x7fc0700079c0 comp rx=0 tx=0).stop 2023-10-03T19:16:54.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.930+0000 7fc08cf8f640 1 -- 172.21.15.45:0/2634359147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0880a9f60 msgr2=0x7fc0880bdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:54.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.930+0000 7fc08cf8f640 1 --2- 172.21.15.45:0/2634359147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0880a9f60 0x7fc0880bdd80 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc078002030 tx=0x7fc07800a430 comp rx=0 tx=0).stop 2023-10-03T19:16:54.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.930+0000 7fc08cf8f640 1 -- 172.21.15.45:0/2634359147 shutdown_connections 2023-10-03T19:16:54.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.930+0000 7fc08cf8f640 1 --2- 172.21.15.45:0/2634359147 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc068066280 0x7fc068068730 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:54.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.930+0000 7fc08cf8f640 1 --2- 172.21.15.45:0/2634359147 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0881ea6f0 0x7fc0881eab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:54.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.930+0000 7fc08cf8f640 1 --2- 172.21.15.45:0/2634359147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0880c5160 0x7fc088153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:54.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.930+0000 7fc08cf8f640 1 --2- 172.21.15.45:0/2634359147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0880a9f60 0x7fc0880bdd80 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:54.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.930+0000 7fc08cf8f640 1 -- 172.21.15.45:0/2634359147 >> 172.21.15.45:0/2634359147 conn(0x7fc0880a7080 msgr2=0x7fc088069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:54.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.930+0000 7fc08cf8f640 1 -- 172.21.15.45:0/2634359147 shutdown_connections 2023-10-03T19:16:54.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:54.930+0000 7fc08cf8f640 1 -- 172.21.15.45:0/2634359147 wait complete. 2023-10-03T19:16:55.257 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-03T19:16:46.297139+0000', 'modified': '2023-10-03T19:16:48.310624+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5904}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5904': {'gid': 5904, 'name': 'a', 'rank': 0, 'incarnation': 27, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6833/2572156585', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6832', 'nonce': 2572156585}, {'type': 'v1', 'addr': '172.21.15.45:6833', 'nonce': 2572156585}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-03T19:16:55.257 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-03T19:16:55.257 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-03T19:16:55.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.390+0000 7fcf3a823640 1 Processor -- start 2023-10-03T19:16:55.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.390+0000 7fcf3a823640 1 -- start start 2023-10-03T19:16:55.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.390+0000 7fcf3a823640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcf3406d170 0x7fcf3414d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:55.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.390+0000 7fcf3a823640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf3406cac0 con 0x7fcf3406f170 2023-10-03T19:16:55.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.390+0000 7fcf3a823640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf340720d0 con 0x7fcf340bc8b0 2023-10-03T19:16:55.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.390+0000 7fcf3a823640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf340a5ab0 con 0x7fcf3406d170 2023-10-03T19:16:55.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.390+0000 7fcf33fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fcf3406f170 0x7fcf34150190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56656/0 (socket says 172.21.15.45:56656) 2023-10-03T19:16:55.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.390+0000 7fcf38dc0640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcf3406d170 0x7fcf3414d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:55.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.390+0000 7fcf33fff640 1 -- 172.21.15.45:0/1253490511 learned_addr learned my addr 172.21.15.45:0/1253490511 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:55.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.390+0000 7fcf32ffd640 1 -- 172.21.15.45:0/1253490511 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 373741520 0 0) 0x7fcf24001120 con 0x7fcf3406f170 2023-10-03T19:16:55.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.390+0000 7fcf32ffd640 1 -- 172.21.15.45:0/1253490511 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf1c003530 con 0x7fcf3406f170 2023-10-03T19:16:55.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.390+0000 7fcf38dc0640 1 -- 172.21.15.45:0/1253490511 >> v1:172.21.15.79:6789/0 conn(0x7fcf340bc8b0 legacy=0x7fcf3414ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:55.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.390+0000 7fcf38dc0640 1 -- 172.21.15.45:0/1253490511 >> v1:172.21.15.45:6789/0 conn(0x7fcf3406f170 legacy=0x7fcf34150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:55.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.390+0000 7fcf38dc0640 1 -- 172.21.15.45:0/1253490511 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3406cd00 con 0x7fcf3406d170 2023-10-03T19:16:55.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf38dc0640 1 --2- 172.21.15.45:0/1253490511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf3406d170 0x7fcf3414d180 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009d90 tx=0x7fcf2c01f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e714708c418847b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:55.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf32ffd640 1 -- 172.21.15.45:0/1253490511 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c0af600 con 0x7fcf3406d170 2023-10-03T19:16:55.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf32ffd640 1 -- 172.21.15.45:0/1253490511 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2c0ab050 con 0x7fcf3406d170 2023-10-03T19:16:55.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf32ffd640 1 -- 172.21.15.45:0/1253490511 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c0af980 con 0x7fcf3406d170 2023-10-03T19:16:55.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf3a823640 1 -- 172.21.15.45:0/1253490511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf3406d170 msgr2=0x7fcf3414d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:55.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf3a823640 1 --2- 172.21.15.45:0/1253490511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf3406d170 0x7fcf3414d180 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009d90 tx=0x7fcf2c01f130 comp rx=0 tx=0).stop 2023-10-03T19:16:55.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf3a823640 1 -- 172.21.15.45:0/1253490511 shutdown_connections 2023-10-03T19:16:55.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf3a823640 1 --2- 172.21.15.45:0/1253490511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf3406d170 0x7fcf3414d180 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf3a823640 1 -- 172.21.15.45:0/1253490511 >> 172.21.15.45:0/1253490511 conn(0x7fcf340bcf50 msgr2=0x7fcf340bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:55.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf3a823640 1 -- 172.21.15.45:0/1253490511 shutdown_connections 2023-10-03T19:16:55.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf3a823640 1 -- 172.21.15.45:0/1253490511 wait complete. 2023-10-03T19:16:55.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf3a823640 1 Processor -- start 2023-10-03T19:16:55.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf3a823640 1 -- start start 2023-10-03T19:16:55.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf3a823640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf3406d170 0x7fcf341e3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:55.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf3a823640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf3406f170 0x7fcf340bfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:55.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf3a823640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf340bc8b0 0x7fcf3414ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:55.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf3a823640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf341d6a40 con 0x7fcf3406d170 2023-10-03T19:16:55.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf3a823640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf340c1310 con 0x7fcf340bc8b0 2023-10-03T19:16:55.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf3a823640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3414f3c0 con 0x7fcf3406f170 2023-10-03T19:16:55.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf33fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf3406d170 0x7fcf341e3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:55.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf33fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf3406d170 0x7fcf341e3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54250/0 (socket says 172.21.15.45:54250) 2023-10-03T19:16:55.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf33fff640 1 -- 172.21.15.45:0/1978608106 learned_addr learned my addr 172.21.15.45:0/1978608106 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:55.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf38dc0640 1 --2- 172.21.15.45:0/1978608106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf340bc8b0 0x7fcf3414ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:55.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf337fe640 1 --2- 172.21.15.45:0/1978608106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf3406f170 0x7fcf340bfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:55.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf33fff640 1 -- 172.21.15.45:0/1978608106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf3406f170 msgr2=0x7fcf340bfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:55.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf33fff640 1 --2- 172.21.15.45:0/1978608106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf3406f170 0x7fcf340bfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf33fff640 1 -- 172.21.15.45:0/1978608106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf340bc8b0 msgr2=0x7fcf3414ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:55.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf33fff640 1 --2- 172.21.15.45:0/1978608106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf340bc8b0 0x7fcf3414ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf33fff640 1 -- 172.21.15.45:0/1978608106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c009a70 con 0x7fcf3406d170 2023-10-03T19:16:55.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf337fe640 1 --2- 172.21.15.45:0/1978608106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf3406f170 0x7fcf340bfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:55.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.394+0000 7fcf33fff640 1 --2- 172.21.15.45:0/1978608106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf3406d170 0x7fcf341e3f40 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fcf2400c4d0 tx=0x7fcf2400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:55.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.398+0000 7fcf30ff9640 1 -- 172.21.15.45:0/1978608106 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf24005cf0 con 0x7fcf3406d170 2023-10-03T19:16:55.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.398+0000 7fcf30ff9640 1 -- 172.21.15.45:0/1978608106 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf24005e50 con 0x7fcf3406d170 2023-10-03T19:16:55.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.398+0000 7fcf3a823640 1 -- 172.21.15.45:0/1978608106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf3414c4a0 con 0x7fcf3406d170 2023-10-03T19:16:55.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.398+0000 7fcf30ff9640 1 -- 172.21.15.45:0/1978608106 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf24007290 con 0x7fcf3406d170 2023-10-03T19:16:55.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.398+0000 7fcf3a823640 1 -- 172.21.15.45:0/1978608106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3414fae0 con 0x7fcf3406d170 2023-10-03T19:16:55.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.398+0000 7fcf30ff9640 1 -- 172.21.15.45:0/1978608106 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcf240073f0 con 0x7fcf3406d170 2023-10-03T19:16:55.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.398+0000 7fcf30ff9640 1 --2- 172.21.15.45:0/1978608106 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcf20066280 0x7fcf20068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:55.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.398+0000 7fcf30ff9640 1 -- 172.21.15.45:0/1978608106 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcf24083130 con 0x7fcf3406d170 2023-10-03T19:16:55.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.398+0000 7fcf337fe640 1 --2- 172.21.15.45:0/1978608106 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcf20066280 0x7fcf20068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:55.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.398+0000 7fcf3d947000 1 Processor -- start 2023-10-03T19:16:55.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.398+0000 7fcf3d947000 1 -- start start 2023-10-03T19:16:55.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.398+0000 7fcf337fe640 1 --2- 172.21.15.45:0/1978608106 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcf20066280 0x7fcf20068730 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcf341e0f40 tx=0x7fcf28009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:55.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.398+0000 7fcf3d947000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56332cdae6f0 0x56332cda5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:55.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.398+0000 7fcf3d947000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56332cda6020 0x56332cda63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:55.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf3d947000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332cda6930 0x56332cda6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:55.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf3d947000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332cc70310 con 0x56332cda6930 2023-10-03T19:16:55.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf3d947000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332cbaa980 con 0x56332cdae6f0 2023-10-03T19:16:55.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf3d947000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x56332cbfe040 con 0x56332cda6020 2023-10-03T19:16:55.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf38dc0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332cda6930 0x56332cda6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:55.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf38dc0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332cda6930 0x56332cda6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54266/0 (socket says 172.21.15.45:54266) 2023-10-03T19:16:55.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf38dc0640 1 -- 172.21.15.45:0/104227495 learned_addr learned my addr 172.21.15.45:0/104227495 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:55.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf33fff640 1 --2- 172.21.15.45:0/104227495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56332cdae6f0 0x56332cda5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:55.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf337fe640 1 --2- 172.21.15.45:0/104227495 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56332cda6020 0x56332cda63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:55.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf38dc0640 1 -- 172.21.15.45:0/104227495 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56332cda6020 msgr2=0x56332cda63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:55.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf38dc0640 1 --2- 172.21.15.45:0/104227495 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56332cda6020 0x56332cda63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf38dc0640 1 -- 172.21.15.45:0/104227495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56332cdae6f0 msgr2=0x56332cda5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:55.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf38dc0640 1 --2- 172.21.15.45:0/104227495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56332cdae6f0 0x56332cda5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf38dc0640 1 -- 172.21.15.45:0/104227495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56332cbbc0b0 con 0x56332cda6930 2023-10-03T19:16:55.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf33fff640 1 --2- 172.21.15.45:0/104227495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56332cdae6f0 0x56332cda5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:16:55.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf38dc0640 1 --2- 172.21.15.45:0/104227495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332cda6930 0x56332cda6d00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c01cd60 tx=0x7fcf2c004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e0ff485daeb050 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:55.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf19ffb640 1 -- 172.21.15.45:0/104227495 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c0af780 con 0x56332cda6930 2023-10-03T19:16:55.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf19ffb640 1 -- 172.21.15.45:0/104227495 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2c0af8e0 con 0x56332cda6930 2023-10-03T19:16:55.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf19ffb640 1 -- 172.21.15.45:0/104227495 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c0afc90 con 0x56332cda6930 2023-10-03T19:16:55.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf3d947000 1 -- 172.21.15.45:0/104227495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332cda6930 msgr2=0x56332cda6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:55.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf3d947000 1 --2- 172.21.15.45:0/104227495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332cda6930 0x56332cda6d00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c01cd60 tx=0x7fcf2c004ac0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf3d947000 1 -- 172.21.15.45:0/104227495 shutdown_connections 2023-10-03T19:16:55.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf3d947000 1 --2- 172.21.15.45:0/104227495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332cda6930 0x56332cda6d00 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf3d947000 1 --2- 172.21.15.45:0/104227495 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56332cda6020 0x56332cda63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf3d947000 1 --2- 172.21.15.45:0/104227495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56332cdae6f0 0x56332cda5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf3d947000 1 -- 172.21.15.45:0/104227495 >> 172.21.15.45:0/104227495 conn(0x56332cde0220 msgr2=0x56332cde2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:55.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf3d947000 1 -- 172.21.15.45:0/104227495 shutdown_connections 2023-10-03T19:16:55.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf3d947000 1 -- 172.21.15.45:0/104227495 wait complete. 2023-10-03T19:16:55.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf3d947000 1 -- start start 2023-10-03T19:16:55.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf3d947000 1 Processor -- start 2023-10-03T19:16:55.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf3d947000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332cda6020 0x56332cddf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:55.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf3d947000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56332cda6930 0x56332cddf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:55.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf3d947000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56332cdae6f0 0x56332cde96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:55.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf3d947000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332cbf70e0 con 0x56332cda6020 2023-10-03T19:16:55.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf3d947000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332cbb3bd0 con 0x56332cdae6f0 2023-10-03T19:16:55.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf3d947000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x56332cbb3870 con 0x56332cda6930 2023-10-03T19:16:55.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf3d947000 10 client.0 _ll_register_callbacks cb 0x56332cd93c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T19:16:55.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf33fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332cda6020 0x56332cddf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:55.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf33fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332cda6020 0x56332cddf3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54272/0 (socket says 172.21.15.45:54272) 2023-10-03T19:16:55.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf33fff640 1 -- 172.21.15.45:0/301954058 learned_addr learned my addr 172.21.15.45:0/301954058 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:55.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf38dc0640 1 --2- 172.21.15.45:0/301954058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56332cdae6f0 0x56332cde96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:55.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf337fe640 1 --2- 172.21.15.45:0/301954058 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56332cda6930 0x56332cddf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:55.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf33fff640 1 -- 172.21.15.45:0/301954058 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56332cda6930 msgr2=0x56332cddf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:55.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf33fff640 1 --2- 172.21.15.45:0/301954058 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56332cda6930 0x56332cddf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf33fff640 1 -- 172.21.15.45:0/301954058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56332cdae6f0 msgr2=0x56332cde96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:55.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf33fff640 1 --2- 172.21.15.45:0/301954058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56332cdae6f0 0x56332cde96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf33fff640 1 -- 172.21.15.45:0/301954058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3406cd00 con 0x56332cda6020 2023-10-03T19:16:55.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf33fff640 1 --2- 172.21.15.45:0/301954058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332cda6020 0x56332cddf3b0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fcf240815b0 tx=0x7fcf240526a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76b5ed28e8f44add server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:55.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf12ffd640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-10-03T19:16:55.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf12ffd640 1 -- 172.21.15.45:0/301954058 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2405c3c0 con 0x56332cda6020 2023-10-03T19:16:55.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf12ffd640 1 -- 172.21.15.45:0/301954058 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcf24013c10 con 0x56332cda6020 2023-10-03T19:16:55.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.402+0000 7fcf3d947000 1 -- 172.21.15.45:0/301954058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56332cbf28b0 con 0x56332cda6020 2023-10-03T19:16:55.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.406+0000 7fcf12ffd640 1 -- 172.21.15.45:0/301954058 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf24013dd0 con 0x56332cda6020 2023-10-03T19:16:55.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.406+0000 7fcf3d947000 10 client.6078 fetch_fsmap learned FSMap version 29 2023-10-03T19:16:55.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.406+0000 7fcf3d947000 1 -- 172.21.15.45:0/301954058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x56332c8f3890 con 0x56332cda6020 2023-10-03T19:16:55.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.406+0000 7fcf12ffd640 1 -- 172.21.15.45:0/301954058 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2407f070 con 0x56332cda6020 2023-10-03T19:16:55.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.406+0000 7fcf12ffd640 1 -- 172.21.15.45:0/301954058 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 29) v1 ==== 2569+0+0 (secure 0 0 0) 0x7fcf240500f0 con 0x56332cda6020 2023-10-03T19:16:55.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.406+0000 7fcf3d947000 10 client.6078 fetch_fsmap finished waiting for FSMap version 29 2023-10-03T19:16:55.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.406+0000 7fcf3d947000 10 client.6078 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T19:16:55.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.406+0000 7fcf3d947000 20 client.6078 populate_metadata read hostname 'smithi045' 2023-10-03T19:16:55.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.406+0000 7fcf3d947000 1 --2- 172.21.15.45:0/301954058 >> [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] conn(0x56332cdea0e0 0x56332cdea4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:55.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.406+0000 7fcf3d947000 4 client.6078 mds_command: new command op to 5904 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-03T19:16:55.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.406+0000 7fcf3d947000 1 -- 172.21.15.45:0/301954058 --> [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56332cc25f70 con 0x56332cdea0e0 2023-10-03T19:16:55.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.406+0000 7fcf337fe640 1 --2- 172.21.15.45:0/301954058 >> [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] conn(0x56332cdea0e0 0x56332cdea4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:55.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.406+0000 7fcf337fe640 1 --2- 172.21.15.45:0/301954058 >> [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] conn(0x56332cdea0e0 0x56332cdea4b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8965b03dc096c2c1 server_cookie=99fde0bd6d6658c7 in_seq=0 out_seq=0 2023-10-03T19:16:55.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.406+0000 7fcf12ffd640 10 client.6078 ms_handle_connect on v2:172.21.15.45:6832/2572156585 2023-10-03T19:16:55.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.406+0000 7fcf12ffd640 1 -- 172.21.15.45:0/301954058 <== mds.0 v2:172.21.15.45:6832/2572156585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56332cc25f70 con 0x56332cdea0e0 2023-10-03T19:16:55.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.406+0000 7fcf12ffd640 10 client.6078 handle_command_reply: tid=0 2023-10-03T19:16:55.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.406+0000 7fcf3d947000 1 client.6078 shutdown 2023-10-03T19:16:55.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.406+0000 7fcf3d947000 1 -- 172.21.15.45:0/301954058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332cda6020 msgr2=0x56332cddf3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:55.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.406+0000 7fcf3d947000 1 --2- 172.21.15.45:0/301954058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332cda6020 0x56332cddf3b0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fcf240815b0 tx=0x7fcf240526a0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.406+0000 7fcf3d947000 1 -- 172.21.15.45:0/301954058 shutdown_connections 2023-10-03T19:16:55.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.406+0000 7fcf3d947000 1 --2- 172.21.15.45:0/301954058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56332cdae6f0 0x56332cde96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.406+0000 7fcf3d947000 1 --2- 172.21.15.45:0/301954058 >> [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] conn(0x56332cdea0e0 0x56332cdea4b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.406+0000 7fcf3d947000 1 --2- 172.21.15.45:0/301954058 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56332cda6930 0x56332cddf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.406+0000 7fcf3d947000 1 --2- 172.21.15.45:0/301954058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332cda6020 0x56332cddf3b0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.406+0000 7fcf12ffd640 0 client.6078 ms_handle_reset on v2:172.21.15.45:6832/2572156585 2023-10-03T19:16:55.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.406+0000 7fcf3d947000 1 -- 172.21.15.45:0/301954058 >> 172.21.15.45:0/301954058 conn(0x56332cde0220 msgr2=0x56332cde2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:55.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.406+0000 7fcf3d947000 1 -- 172.21.15.45:0/301954058 shutdown_connections 2023-10-03T19:16:55.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.406+0000 7fcf3d947000 1 -- 172.21.15.45:0/301954058 wait complete. 2023-10-03T19:16:55.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.406+0000 7fcf3d947000 20 client.6078 trim_cache size 0 max 16384 2023-10-03T19:16:55.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.422+0000 7fcf3d947000 1 Processor -- start 2023-10-03T19:16:55.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.422+0000 7fcf3d947000 1 -- start start 2023-10-03T19:16:55.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.422+0000 7fcf3d947000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56332cda6020 0x56332cdfa330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:55.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.422+0000 7fcf3d947000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56332cda6930 0x56332cdf8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:55.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.422+0000 7fcf3d947000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332cdae6f0 0x56332cdf88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:55.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.422+0000 7fcf3d947000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332cde9ad0 con 0x56332cdae6f0 2023-10-03T19:16:55.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.422+0000 7fcf3d947000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332c8b4940 con 0x56332cda6930 2023-10-03T19:16:55.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.422+0000 7fcf3d947000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x56332cbf48f0 con 0x56332cda6020 2023-10-03T19:16:55.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.422+0000 7fcf38dc0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332cdae6f0 0x56332cdf88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:55.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.422+0000 7fcf38dc0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332cdae6f0 0x56332cdf88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54284/0 (socket says 172.21.15.45:54284) 2023-10-03T19:16:55.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.422+0000 7fcf38dc0640 1 -- 172.21.15.45:0/3280458296 learned_addr learned my addr 172.21.15.45:0/3280458296 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:55.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.422+0000 7fcf33fff640 1 --2- 172.21.15.45:0/3280458296 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56332cda6020 0x56332cdfa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:55.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.422+0000 7fcf337fe640 1 --2- 172.21.15.45:0/3280458296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56332cda6930 0x56332cdf8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:55.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.422+0000 7fcf38dc0640 1 -- 172.21.15.45:0/3280458296 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56332cda6020 msgr2=0x56332cdfa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:55.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.422+0000 7fcf38dc0640 1 --2- 172.21.15.45:0/3280458296 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56332cda6020 0x56332cdfa330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.422+0000 7fcf38dc0640 1 -- 172.21.15.45:0/3280458296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56332cda6930 msgr2=0x56332cdf8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:55.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.422+0000 7fcf38dc0640 1 --2- 172.21.15.45:0/3280458296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56332cda6930 0x56332cdf8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.422+0000 7fcf38dc0640 1 -- 172.21.15.45:0/3280458296 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56332cbbc360 con 0x56332cdae6f0 2023-10-03T19:16:55.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.422+0000 7fcf38dc0640 1 --2- 172.21.15.45:0/3280458296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332cdae6f0 0x56332cdf88b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009e80 tx=0x7fcf2c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53acc4dc18aed805 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:55.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.422+0000 7fcf1a7fc640 1 -- 172.21.15.45:0/3280458296 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c0c9070 con 0x56332cdae6f0 2023-10-03T19:16:55.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.422+0000 7fcf1a7fc640 1 -- 172.21.15.45:0/3280458296 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2c0a8a20 con 0x56332cdae6f0 2023-10-03T19:16:55.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.422+0000 7fcf1a7fc640 1 -- 172.21.15.45:0/3280458296 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c0afa50 con 0x56332cdae6f0 2023-10-03T19:16:55.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.422+0000 7fcf3d947000 1 -- 172.21.15.45:0/3280458296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332cdae6f0 msgr2=0x56332cdf88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:55.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.422+0000 7fcf3d947000 1 --2- 172.21.15.45:0/3280458296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332cdae6f0 0x56332cdf88b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009e80 tx=0x7fcf2c009750 comp rx=0 tx=0).stop 2023-10-03T19:16:55.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 1 -- 172.21.15.45:0/3280458296 shutdown_connections 2023-10-03T19:16:55.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 1 --2- 172.21.15.45:0/3280458296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332cdae6f0 0x56332cdf88b0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 1 --2- 172.21.15.45:0/3280458296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56332cda6930 0x56332cdf8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 1 --2- 172.21.15.45:0/3280458296 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56332cda6020 0x56332cdfa330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 1 -- 172.21.15.45:0/3280458296 >> 172.21.15.45:0/3280458296 conn(0x56332cde0220 msgr2=0x56332cdf6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:55.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 1 -- 172.21.15.45:0/3280458296 shutdown_connections 2023-10-03T19:16:55.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 1 -- 172.21.15.45:0/3280458296 wait complete. 2023-10-03T19:16:55.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 1 -- start start 2023-10-03T19:16:55.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 1 Processor -- start 2023-10-03T19:16:55.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56332cda6020 0x56332ce43d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:55.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332cda6930 0x56332ce40aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:55.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56332cdae6f0 0x56332ce40fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:55.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332cb9f710 con 0x56332cda6930 2023-10-03T19:16:55.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332cbf5f70 con 0x56332cdae6f0 2023-10-03T19:16:55.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x56332cbebc90 con 0x56332cda6020 2023-10-03T19:16:55.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 10 client.0 _ll_register_callbacks cb 0x56332cbf9260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T19:16:55.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf337fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332cda6930 0x56332ce40aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:55.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf337fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332cda6930 0x56332ce40aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54286/0 (socket says 172.21.15.45:54286) 2023-10-03T19:16:55.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf337fe640 1 -- 172.21.15.45:0/3033417819 learned_addr learned my addr 172.21.15.45:0/3033417819 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:55.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf33fff640 1 --2- 172.21.15.45:0/3033417819 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56332cda6020 0x56332ce43d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:55.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf38dc0640 1 --2- 172.21.15.45:0/3033417819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56332cdae6f0 0x56332ce40fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:55.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf337fe640 1 -- 172.21.15.45:0/3033417819 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56332cda6020 msgr2=0x56332ce43d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:55.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf337fe640 1 --2- 172.21.15.45:0/3033417819 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56332cda6020 0x56332ce43d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf337fe640 1 -- 172.21.15.45:0/3033417819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56332cdae6f0 msgr2=0x56332ce40fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:16:55.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf337fe640 1 --2- 172.21.15.45:0/3033417819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56332cdae6f0 0x56332ce40fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf337fe640 1 -- 172.21.15.45:0/3033417819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56332cbbc0b0 con 0x56332cda6930 2023-10-03T19:16:55.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf337fe640 1 --2- 172.21.15.45:0/3033417819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332cda6930 0x56332ce40aa0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fcf3414ab70 tx=0x7fcf28000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24a6f1fa066509 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:55.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf12ffd640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-10-03T19:16:55.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf12ffd640 1 -- 172.21.15.45:0/3033417819 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf28026e70 con 0x56332cda6930 2023-10-03T19:16:55.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf12ffd640 1 -- 172.21.15.45:0/3033417819 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcf2800dc30 con 0x56332cda6930 2023-10-03T19:16:55.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 1 -- 172.21.15.45:0/3033417819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcf2c0af8e0 con 0x56332cda6930 2023-10-03T19:16:55.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf12ffd640 1 -- 172.21.15.45:0/3033417819 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf2800ddf0 con 0x56332cda6930 2023-10-03T19:16:55.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 10 client.6084 fetch_fsmap learned FSMap version 29 2023-10-03T19:16:55.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 1 -- 172.21.15.45:0/3033417819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x56332cba1be0 con 0x56332cda6930 2023-10-03T19:16:55.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf12ffd640 1 -- 172.21.15.45:0/3033417819 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2c0af8e0 con 0x56332cda6930 2023-10-03T19:16:55.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf12ffd640 1 -- 172.21.15.45:0/3033417819 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 29) v1 ==== 2569+0+0 (secure 0 0 0) 0x7fcf28026110 con 0x56332cda6930 2023-10-03T19:16:55.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 10 client.6084 fetch_fsmap finished waiting for FSMap version 29 2023-10-03T19:16:55.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 10 client.6084 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T19:16:55.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 20 client.6084 populate_metadata read hostname 'smithi045' 2023-10-03T19:16:55.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 1 --2- 172.21.15.45:0/3033417819 >> [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] conn(0x56332ce41a50 0x56332ce41e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:55.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 4 client.6084 mds_command: new command op to 5904 tid=0[{"prefix": "status"}] 2023-10-03T19:16:55.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 1 -- 172.21.15.45:0/3033417819 --> [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56332cbf00c0 con 0x56332ce41a50 2023-10-03T19:16:55.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf33fff640 1 --2- 172.21.15.45:0/3033417819 >> [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] conn(0x56332ce41a50 0x56332ce41e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:55.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf12ffd640 10 client.6084 ms_handle_connect on v2:172.21.15.45:6832/2572156585 2023-10-03T19:16:55.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf33fff640 1 --2- 172.21.15.45:0/3033417819 >> [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] conn(0x56332ce41a50 0x56332ce41e20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5a8e26c6eb5dad server_cookie=19879113406d45fa in_seq=0 out_seq=0 2023-10-03T19:16:55.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf12ffd640 1 -- 172.21.15.45:0/3033417819 <== mds.0 v2:172.21.15.45:6832/2572156585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x56332cbf00c0 con 0x56332ce41a50 2023-10-03T19:16:55.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf12ffd640 10 client.6084 handle_command_reply: tid=0 2023-10-03T19:16:55.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 1 client.6084 shutdown 2023-10-03T19:16:55.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 1 -- 172.21.15.45:0/3033417819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332cda6930 msgr2=0x56332ce40aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:55.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 1 --2- 172.21.15.45:0/3033417819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332cda6930 0x56332ce40aa0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fcf3414ab70 tx=0x7fcf28000ee0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 1 -- 172.21.15.45:0/3033417819 shutdown_connections 2023-10-03T19:16:55.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 1 --2- 172.21.15.45:0/3033417819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56332cdae6f0 0x56332ce40fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 1 --2- 172.21.15.45:0/3033417819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332cda6930 0x56332ce40aa0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 1 --2- 172.21.15.45:0/3033417819 >> [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] conn(0x56332ce41a50 0x56332ce41e20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 1 --2- 172.21.15.45:0/3033417819 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56332cda6020 0x56332ce43d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 1 -- 172.21.15.45:0/3033417819 >> 172.21.15.45:0/3033417819 conn(0x56332cde0220 msgr2=0x56332cdf74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:55.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf12ffd640 0 client.6084 ms_handle_reset on v2:172.21.15.45:6832/2572156585 2023-10-03T19:16:55.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 1 -- 172.21.15.45:0/3033417819 shutdown_connections 2023-10-03T19:16:55.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 1 -- 172.21.15.45:0/3033417819 wait complete. 2023-10-03T19:16:55.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.426+0000 7fcf3d947000 20 client.6084 trim_cache size 0 max 16384 2023-10-03T19:16:55.441 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-03T19:16:55.441 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "58400977-12ba-4c73-bb3e-1589b2492669", 2023-10-03T19:16:55.441 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-10-03T19:16:55.441 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 5904, 2023-10-03T19:16:55.441 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-10-03T19:16:55.441 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-10-03T19:16:55.441 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-10-03T19:16:55.441 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 9.1329373629999999, 2023-10-03T19:16:55.441 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 29, 2023-10-03T19:16:55.442 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 61, 2023-10-03T19:16:55.442 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 61, 2023-10-03T19:16:55.442 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 15.482717534000001 2023-10-03T19:16:55.442 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-03T19:16:55.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.430+0000 7fcf3a823640 1 -- 172.21.15.45:0/1978608106 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcf20066280 msgr2=0x7fcf20068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:55.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.430+0000 7fcf3a823640 1 --2- 172.21.15.45:0/1978608106 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcf20066280 0x7fcf20068730 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcf341e0f40 tx=0x7fcf28009040 comp rx=0 tx=0).stop 2023-10-03T19:16:55.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.430+0000 7fcf3a823640 1 -- 172.21.15.45:0/1978608106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf3406d170 msgr2=0x7fcf341e3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:55.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.430+0000 7fcf3a823640 1 --2- 172.21.15.45:0/1978608106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf3406d170 0x7fcf341e3f40 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fcf2400c4d0 tx=0x7fcf2400c990 comp rx=0 tx=0).stop 2023-10-03T19:16:55.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.430+0000 7fcf3a823640 1 -- 172.21.15.45:0/1978608106 shutdown_connections 2023-10-03T19:16:55.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.430+0000 7fcf3a823640 1 --2- 172.21.15.45:0/1978608106 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcf20066280 0x7fcf20068730 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.430+0000 7fcf3a823640 1 --2- 172.21.15.45:0/1978608106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf340bc8b0 0x7fcf3414ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.430+0000 7fcf3a823640 1 --2- 172.21.15.45:0/1978608106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf3406f170 0x7fcf340bfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.430+0000 7fcf3a823640 1 --2- 172.21.15.45:0/1978608106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf3406d170 0x7fcf341e3f40 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.430+0000 7fcf3a823640 1 -- 172.21.15.45:0/1978608106 >> 172.21.15.45:0/1978608106 conn(0x7fcf340bcf50 msgr2=0x7fcf340bbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:55.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.430+0000 7fcf3a823640 1 -- 172.21.15.45:0/1978608106 shutdown_connections 2023-10-03T19:16:55.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.430+0000 7fcf3a823640 1 -- 172.21.15.45:0/1978608106 wait complete. 2023-10-03T19:16:55.451 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-03T19:16:55.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.562+0000 7f1ece63b640 1 Processor -- start 2023-10-03T19:16:55.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.562+0000 7f1ece63b640 1 -- start start 2023-10-03T19:16:55.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.562+0000 7f1ece63b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1ec8071380 0x7f1ec80bc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:55.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.562+0000 7f1ece63b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ec814f860 con 0x7f1ec80bcb80 2023-10-03T19:16:55.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.562+0000 7f1ece63b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ec80bd220 con 0x7f1ec8071750 2023-10-03T19:16:55.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.562+0000 7f1ece63b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ec8071cf0 con 0x7f1ec8071380 2023-10-03T19:16:55.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.562+0000 7f1ec7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1ec8071380 0x7f1ec80bc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:55.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.562+0000 7f1ebf7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1ec80bcb80 0x7f1ec8152850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56658/0 (socket says 172.21.15.45:56658) 2023-10-03T19:16:55.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.562+0000 7f1ebf7fe640 1 -- 172.21.15.45:0/531695201 learned_addr learned my addr 172.21.15.45:0/531695201 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:16:55.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.562+0000 7f1ec7fff640 1 -- 172.21.15.45:0/531695201 >> v1:172.21.15.79:6789/0 conn(0x7f1ec8071750 legacy=0x7f1ec814b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:55.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.562+0000 7f1ec7fff640 1 -- 172.21.15.45:0/531695201 >> v1:172.21.15.45:6789/0 conn(0x7f1ec80bcb80 legacy=0x7f1ec8152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:55.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.562+0000 7f1ec77fe640 1 -- 172.21.15.45:0/531695201 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 39269543 0 0) 0x7f1ec814f860 con 0x7f1ec80bcb80 2023-10-03T19:16:55.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.562+0000 7f1ec7fff640 1 -- 172.21.15.45:0/531695201 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec80a7b50 con 0x7f1ec8071380 2023-10-03T19:16:55.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.566+0000 7f1ec7fff640 1 --2- 172.21.15.45:0/531695201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ec8071380 0x7f1ec80bc4f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f1eb80097c0 tx=0x7f1eb801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad07c51cfe2f765 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:55.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.566+0000 7f1ec77fe640 1 -- 172.21.15.45:0/531695201 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb80a8050 con 0x7f1ec8071380 2023-10-03T19:16:55.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.566+0000 7f1ec77fe640 1 -- 172.21.15.45:0/531695201 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb80ac5f0 con 0x7f1ec8071380 2023-10-03T19:16:55.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.566+0000 7f1ec77fe640 1 -- 172.21.15.45:0/531695201 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb80ac980 con 0x7f1ec8071380 2023-10-03T19:16:55.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.566+0000 7f1ece63b640 1 -- 172.21.15.45:0/531695201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ec8071380 msgr2=0x7f1ec80bc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:55.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.566+0000 7f1ece63b640 1 --2- 172.21.15.45:0/531695201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ec8071380 0x7f1ec80bc4f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f1eb80097c0 tx=0x7f1eb801c480 comp rx=0 tx=0).stop 2023-10-03T19:16:55.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.566+0000 7f1ece63b640 1 -- 172.21.15.45:0/531695201 shutdown_connections 2023-10-03T19:16:55.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.566+0000 7f1ece63b640 1 --2- 172.21.15.45:0/531695201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ec8071380 0x7f1ec80bc4f0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.566+0000 7f1ece63b640 1 -- 172.21.15.45:0/531695201 >> 172.21.15.45:0/531695201 conn(0x7f1ec806bce0 msgr2=0x7f1ec806c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:55.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.566+0000 7f1ece63b640 1 -- 172.21.15.45:0/531695201 shutdown_connections 2023-10-03T19:16:55.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.566+0000 7f1ece63b640 1 -- 172.21.15.45:0/531695201 wait complete. 2023-10-03T19:16:55.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.566+0000 7f1ece63b640 1 Processor -- start 2023-10-03T19:16:55.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.566+0000 7f1ece63b640 1 -- start start 2023-10-03T19:16:55.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.570+0000 7f1ece63b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ec8071380 0x7f1ec81ea380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:55.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.570+0000 7f1ece63b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1ec8071750 0x7f1ec814d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:55.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.570+0000 7f1ece63b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ec80bcb80 0x7f1ec8146ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:55.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.570+0000 7f1ece63b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec80a52b0 con 0x7f1ec80bcb80 2023-10-03T19:16:55.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.570+0000 7f1ece63b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec81ead40 con 0x7f1ec8071380 2023-10-03T19:16:55.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.570+0000 7f1ece63b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec81eb020 con 0x7f1ec8071750 2023-10-03T19:16:55.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.570+0000 7f1eccbd8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ec80bcb80 0x7f1ec8146ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:55.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.570+0000 7f1eccbd8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ec80bcb80 0x7f1ec8146ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54302/0 (socket says 172.21.15.45:54302) 2023-10-03T19:16:55.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.570+0000 7f1eccbd8640 1 -- 172.21.15.45:0/1542412633 learned_addr learned my addr 172.21.15.45:0/1542412633 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:16:55.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.570+0000 7f1ec7fff640 1 --2- 172.21.15.45:0/1542412633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ec8071380 0x7f1ec81ea380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:55.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.570+0000 7f1ebf7fe640 1 --2- 172.21.15.45:0/1542412633 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1ec8071750 0x7f1ec814d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:55.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.570+0000 7f1eccbd8640 1 -- 172.21.15.45:0/1542412633 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1ec8071750 msgr2=0x7f1ec814d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:55.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.570+0000 7f1eccbd8640 1 --2- 172.21.15.45:0/1542412633 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1ec8071750 0x7f1ec814d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.570+0000 7f1eccbd8640 1 -- 172.21.15.45:0/1542412633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ec8071380 msgr2=0x7f1ec81ea380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:55.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.570+0000 7f1eccbd8640 1 --2- 172.21.15.45:0/1542412633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ec8071380 0x7f1ec81ea380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.570+0000 7f1eccbd8640 1 -- 172.21.15.45:0/1542412633 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb8009420 con 0x7f1ec80bcb80 2023-10-03T19:16:55.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.570+0000 7f1ec7fff640 1 --2- 172.21.15.45:0/1542412633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ec8071380 0x7f1ec81ea380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:16:55.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.570+0000 7f1eccbd8640 1 --2- 172.21.15.45:0/1542412633 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ec80bcb80 0x7f1ec8146ea0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f1ec000c770 tx=0x7f1ec000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:55.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.570+0000 7f1ec57fa640 1 -- 172.21.15.45:0/1542412633 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec0003b80 con 0x7f1ec80bcb80 2023-10-03T19:16:55.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.570+0000 7f1ec57fa640 1 -- 172.21.15.45:0/1542412633 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec0003ce0 con 0x7f1ec80bcb80 2023-10-03T19:16:55.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.570+0000 7f1ece63b640 1 -- 172.21.15.45:0/1542412633 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec814c240 con 0x7f1ec80bcb80 2023-10-03T19:16:55.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.570+0000 7f1ec57fa640 1 -- 172.21.15.45:0/1542412633 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec000aa90 con 0x7f1ec80bcb80 2023-10-03T19:16:55.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.570+0000 7f1ece63b640 1 -- 172.21.15.45:0/1542412633 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec814c0b0 con 0x7f1ec80bcb80 2023-10-03T19:16:55.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.570+0000 7f1ece63b640 1 -- 172.21.15.45:0/1542412633 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ec815ca00 con 0x7f1ec80bcb80 2023-10-03T19:16:55.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.570+0000 7f1ec57fa640 1 -- 172.21.15.45:0/1542412633 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1ec000abf0 con 0x7f1ec80bcb80 2023-10-03T19:16:55.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.570+0000 7f1ec57fa640 1 --2- 172.21.15.45:0/1542412633 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1ea80662b0 0x7f1ea8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:16:55.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.570+0000 7f1ec57fa640 1 -- 172.21.15.45:0/1542412633 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1ec0083bc0 con 0x7f1ec80bcb80 2023-10-03T19:16:55.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.570+0000 7f1ec7fff640 1 --2- 172.21.15.45:0/1542412633 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1ea80662b0 0x7f1ea8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:16:55.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.574+0000 7f1ec7fff640 1 --2- 172.21.15.45:0/1542412633 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1ea80662b0 0x7f1ea8068760 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1eb80ae000 tx=0x7f1eb8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:16:55.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.574+0000 7f1ec57fa640 1 -- 172.21.15.45:0/1542412633 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1ec0050f90 con 0x7f1ec80bcb80 2023-10-03T19:16:55.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.758+0000 7f1ece63b640 1 -- 172.21.15.45:0/1542412633 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1ec80a4f90 con 0x7f1ec80bcb80 2023-10-03T19:16:55.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.758+0000 7f1ec57fa640 1 -- 172.21.15.45:0/1542412633 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v29) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1ec00545b0 con 0x7f1ec80bcb80 2023-10-03T19:16:55.765 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-03T19:16:55.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.762+0000 7f1ece63b640 1 -- 172.21.15.45:0/1542412633 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1ea80662b0 msgr2=0x7f1ea8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:55.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.762+0000 7f1ece63b640 1 --2- 172.21.15.45:0/1542412633 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1ea80662b0 0x7f1ea8068760 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1eb80ae000 tx=0x7f1eb8008040 comp rx=0 tx=0).stop 2023-10-03T19:16:55.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.762+0000 7f1ece63b640 1 -- 172.21.15.45:0/1542412633 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ec80bcb80 msgr2=0x7f1ec8146ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:16:55.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.762+0000 7f1ece63b640 1 --2- 172.21.15.45:0/1542412633 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ec80bcb80 0x7f1ec8146ea0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f1ec000c770 tx=0x7f1ec000cc30 comp rx=0 tx=0).stop 2023-10-03T19:16:55.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.762+0000 7f1ece63b640 1 -- 172.21.15.45:0/1542412633 shutdown_connections 2023-10-03T19:16:55.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.762+0000 7f1ece63b640 1 --2- 172.21.15.45:0/1542412633 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1ea80662b0 0x7f1ea8068760 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.762+0000 7f1ece63b640 1 --2- 172.21.15.45:0/1542412633 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ec80bcb80 0x7f1ec8146ea0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.762+0000 7f1ece63b640 1 --2- 172.21.15.45:0/1542412633 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1ec8071750 0x7f1ec814d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.762+0000 7f1ece63b640 1 --2- 172.21.15.45:0/1542412633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ec8071380 0x7f1ec81ea380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:16:55.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.762+0000 7f1ece63b640 1 -- 172.21.15.45:0/1542412633 >> 172.21.15.45:0/1542412633 conn(0x7f1ec806bce0 msgr2=0x7f1ec806f030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:16:55.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.762+0000 7f1ece63b640 1 -- 172.21.15.45:0/1542412633 shutdown_connections 2023-10-03T19:16:55.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:16:55.762+0000 7f1ece63b640 1 -- 172.21.15.45:0/1542412633 wait complete. 2023-10-03T19:16:55.782 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-03T19:16:55.782 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-03T19:16:55.783 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-10-03T19:16:55.783 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-03T19:16:55.783 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-03T19:16:55.783 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-03T19:16:55.783 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-03T19:16:55.783 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-03T19:16:55.783 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-03T19:16:55.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:16:55.783 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-10-03T19:16:55.790 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-03T19:16:55.790 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-03T19:16:55.791 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-10-03T19:16:55.791 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:16:55.791 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-10-03T19:16:55.791 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:16:55.791 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:16:55.791 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-10-03T19:16:55.791 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-10-03T19:16:55.791 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:16:55.791 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-10-03T19:16:55.791 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-10-03T19:16:55.791 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:16:55.792 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-10-03T19:16:55.792 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-03T19:16:55.792 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-10-03T19:16:55.792 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-03T19:16:55.792 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42167sec preferred_lft 42167sec 2023-10-03T19:16:55.792 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2023-10-03T19:16:55.792 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:16:55.792 INFO:teuthology.orchestra.run.smithi146.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-03T19:16:55.792 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 02:42:a6:2d:ab:3b brd ff:ff:ff:ff:ff:ff 2023-10-03T19:16:55.792 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-03T19:16:55.792 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:16:55.793 INFO:teuthology.orchestra.run.smithi146.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-03T19:16:55.793 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-03T19:16:55.793 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-03T19:16:55.793 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:16:55.793 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::5c3e:4eff:fee6:56da/64 scope link 2023-10-03T19:16:55.793 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:16:55.793 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-03T19:16:55.793 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T19:16:55.793 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-03T19:16:55.793 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:16:55.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:16:55.794 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-03T19:16:55.846 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T19:16:55.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:16:55.848 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-10-03T19:16:55.897 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-10-03T19:16:55.898 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-03T19:16:55.898 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-03T19:16:55.898 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-03T19:16:55.898 INFO:teuthology.orchestra.run.smithi146.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-03T19:16:55.898 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-03T19:16:55.898 INFO:teuthology.orchestra.run.smithi146.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:16:55.898 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:16:55.898 INFO:teuthology.orchestra.run.smithi146.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:16:55.898 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-03T19:16:55.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:16:55.899 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-03T19:16:55.899 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-03T19:16:55.899 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-03T19:16:55.899 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-03T19:16:55.899 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-03T19:16:55.899 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-03T19:16:55.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:16:55.972 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-10-03T19:16:56.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-03T19:16:56.023 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-03T19:16:56.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:16:56.023 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-10-03T19:16:56.078 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-03T19:16:56.079 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T19:16:56.079 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-03T19:16:56.126 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-03T19:16:56.127 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T19:16:56.127 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-03T19:16:56.175 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-03T19:16:56.232 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:16:56.232 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:16:56.286 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:16:56.289 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:16:56.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:16:56.290 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-03T19:16:56.338 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-03T19:16:56.339 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-03T19:16:56.383 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-03T19:16:56.399 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:16:56.399 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:16:56.452 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:16:56.453 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:16:56.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:16:56.453 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-03T19:16:56.466 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:2023-10-03T19:16:56.459+0000 7fc31eed5580 -1 init, newargv = 0x5629613e3300 newargc=15 2023-10-03T19:16:56.466 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[33567]: starting ceph client 2023-10-03T19:16:56.475 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[33567]: starting fuse 2023-10-03T19:16:57.571 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-03T19:16:57.587 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:16:57.588 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:16:57.641 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:16:57.642 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:16:57.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:16:57.642 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-03T19:16:57.690 INFO:teuthology.orchestra.run.smithi146.stdout:45 2023-10-03T19:16:57.691 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-03T19:16:57.691 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-03T19:16:57.691 DEBUG:teuthology.orchestra.run.smithi146:> import glob 2023-10-03T19:16:57.691 DEBUG:teuthology.orchestra.run.smithi146:> import re 2023-10-03T19:16:57.691 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-03T19:16:57.692 DEBUG:teuthology.orchestra.run.smithi146:> import subprocess 2023-10-03T19:16:57.692 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:16:57.692 DEBUG:teuthology.orchestra.run.smithi146:> def _find_admin_socket(client_name): 2023-10-03T19:16:57.693 DEBUG:teuthology.orchestra.run.smithi146:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-03T19:16:57.693 DEBUG:teuthology.orchestra.run.smithi146:> files = glob.glob(asok_path) 2023-10-03T19:16:57.693 DEBUG:teuthology.orchestra.run.smithi146:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-03T19:16:57.693 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:16:57.693 DEBUG:teuthology.orchestra.run.smithi146:> # Given a non-glob path, it better be there 2023-10-03T19:16:57.694 DEBUG:teuthology.orchestra.run.smithi146:> if "*" not in asok_path: 2023-10-03T19:16:57.694 DEBUG:teuthology.orchestra.run.smithi146:> assert(len(files) == 1) 2023-10-03T19:16:57.694 DEBUG:teuthology.orchestra.run.smithi146:> return files[0] 2023-10-03T19:16:57.694 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:16:57.694 DEBUG:teuthology.orchestra.run.smithi146:> for f in files: 2023-10-03T19:16:57.694 DEBUG:teuthology.orchestra.run.smithi146:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-03T19:16:57.694 DEBUG:teuthology.orchestra.run.smithi146:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-03T19:16:57.694 DEBUG:teuthology.orchestra.run.smithi146:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-03T19:16:57.694 DEBUG:teuthology.orchestra.run.smithi146:> contents = proc_f.read() 2023-10-03T19:16:57.694 DEBUG:teuthology.orchestra.run.smithi146:> if mountpoint in contents: 2023-10-03T19:16:57.695 DEBUG:teuthology.orchestra.run.smithi146:> return f 2023-10-03T19:16:57.695 DEBUG:teuthology.orchestra.run.smithi146:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-03T19:16:57.695 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:16:57.695 DEBUG:teuthology.orchestra.run.smithi146:> print(_find_admin_socket("client.0")) 2023-10-03T19:16:57.695 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-03T19:16:57.810 INFO:teuthology.orchestra.run.smithi146.stdout:/var/run/ceph/ceph-client.0.33567.asok 2023-10-03T19:16:57.992 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.33567.asok 2023-10-03T19:16:57.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:16:57.992 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.33567.asok status 2023-10-03T19:16:58.145 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-03T19:16:58.145 INFO:teuthology.orchestra.run.smithi146.stdout: "metadata": { 2023-10-03T19:16:58.145 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_sha1": "05a43c8fb3988914c879a50970f9054a098e0612", 2023-10-03T19:16:58.145 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 18.0.0-3908-g05a43c8f (05a43c8fb3988914c879a50970f9054a098e0612) reef (dev)", 2023-10-03T19:16:58.145 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "0", 2023-10-03T19:16:58.145 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2023-10-03T19:16:58.145 INFO:teuthology.orchestra.run.smithi146.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-03T19:16:58.145 INFO:teuthology.orchestra.run.smithi146.stdout: "pid": "33567", 2023-10-03T19:16:58.146 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2023-10-03T19:16:58.146 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:16:58.146 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_count": 0, 2023-10-03T19:16:58.146 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_pinned_count": 0, 2023-10-03T19:16:58.146 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 6102, 2023-10-03T19:16:58.146 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": { 2023-10-03T19:16:58.146 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2023-10-03T19:16:58.146 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2023-10-03T19:16:58.146 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 6102 2023-10-03T19:16:58.147 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:16:58.147 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-03T19:16:58.147 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T19:16:58.147 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:0", 2023-10-03T19:16:58.147 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 2314684411 2023-10-03T19:16:58.147 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T19:16:58.147 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:16:58.147 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-03T19:16:58.147 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T19:16:58.148 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:0", 2023-10-03T19:16:58.148 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 2314684411 2023-10-03T19:16:58.148 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:16:58.148 INFO:teuthology.orchestra.run.smithi146.stdout: "inst_str": "client.6102 172.21.15.146:0/2314684411", 2023-10-03T19:16:58.148 INFO:teuthology.orchestra.run.smithi146.stdout: "addr_str": "172.21.15.146:0/2314684411", 2023-10-03T19:16:58.148 INFO:teuthology.orchestra.run.smithi146.stdout: "inode_count": 1, 2023-10-03T19:16:58.148 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_epoch": 29, 2023-10-03T19:16:58.148 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch": 61, 2023-10-03T19:16:58.148 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch_barrier": 0, 2023-10-03T19:16:58.148 INFO:teuthology.orchestra.run.smithi146.stdout: "blocklisted": false, 2023-10-03T19:16:58.149 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs" 2023-10-03T19:16:58.149 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-03T19:16:58.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:16:58.160 DEBUG:teuthology.orchestra.run.smithi146:> stat --file-system '--printf=%T 2023-10-03T19:16:58.160 DEBUG:teuthology.orchestra.run.smithi146:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-03T19:16:58.166 INFO:teuthology.orchestra.run.smithi146.stdout:fuseblk 2023-10-03T19:16:58.166 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-03T19:16:58.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:16:58.166 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-03T19:16:58.223 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:16:58.224 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:16:58.270 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-03T19:16:58.271 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-03T19:16:58.271 DEBUG:teuthology.orchestra.run.smithi146:> import uuid 2023-10-03T19:16:58.271 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:16:58.271 DEBUG:teuthology.orchestra.run.smithi146:> n = 1000 2023-10-03T19:16:58.271 DEBUG:teuthology.orchestra.run.smithi146:> create_hard_links = False 2023-10-03T19:16:58.271 DEBUG:teuthology.orchestra.run.smithi146:> if 0 > 0: 2023-10-03T19:16:58.271 DEBUG:teuthology.orchestra.run.smithi146:> create_hard_links = True 2023-10-03T19:16:58.271 DEBUG:teuthology.orchestra.run.smithi146:> path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2023-10-03T19:16:58.271 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:16:58.271 DEBUG:teuthology.orchestra.run.smithi146:> dpath = os.path.dirname(path) 2023-10-03T19:16:58.271 DEBUG:teuthology.orchestra.run.smithi146:> fnameprefix = os.path.basename(path) 2023-10-03T19:16:58.272 DEBUG:teuthology.orchestra.run.smithi146:> os.makedirs(dpath, exist_ok=True) 2023-10-03T19:16:58.272 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:16:58.272 DEBUG:teuthology.orchestra.run.smithi146:> try: 2023-10-03T19:16:58.272 DEBUG:teuthology.orchestra.run.smithi146:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-10-03T19:16:58.272 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:16:58.272 DEBUG:teuthology.orchestra.run.smithi146:> for i in range(n): 2023-10-03T19:16:58.272 DEBUG:teuthology.orchestra.run.smithi146:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-10-03T19:16:58.272 DEBUG:teuthology.orchestra.run.smithi146:> with open(fpath, '"'"'w'"'"') as f: 2023-10-03T19:16:58.272 DEBUG:teuthology.orchestra.run.smithi146:> f.write(f"{i}") 2023-10-03T19:16:58.272 DEBUG:teuthology.orchestra.run.smithi146:> if True: 2023-10-03T19:16:58.273 DEBUG:teuthology.orchestra.run.smithi146:> f.flush() 2023-10-03T19:16:58.273 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(f.fileno()) 2023-10-03T19:16:58.273 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2023-10-03T19:16:58.273 DEBUG:teuthology.orchestra.run.smithi146:> os.unlink(fpath) 2023-10-03T19:16:58.273 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2023-10-03T19:16:58.273 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(dirfd) 2023-10-03T19:16:58.273 DEBUG:teuthology.orchestra.run.smithi146:> if create_hard_links: 2023-10-03T19:16:58.273 DEBUG:teuthology.orchestra.run.smithi146:> for j in range(0): 2023-10-03T19:16:58.273 DEBUG:teuthology.orchestra.run.smithi146:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-10-03T19:16:58.273 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2023-10-03T19:16:58.273 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(dirfd) 2023-10-03T19:16:58.274 DEBUG:teuthology.orchestra.run.smithi146:> finally: 2023-10-03T19:16:58.274 DEBUG:teuthology.orchestra.run.smithi146:> os.close(dirfd) 2023-10-03T19:16:58.274 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-03T19:17:02.492 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:17:02.504 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:17:02.522 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:17:02.544 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:17:10.793 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:17:10.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.926+0000 7fc89e7bc640 1 Processor -- start 2023-10-03T19:17:10.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.926+0000 7fc89e7bc640 1 -- start start 2023-10-03T19:17:10.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.926+0000 7fc89e7bc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc89806f170 0x7fc898150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:10.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.926+0000 7fc89e7bc640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc89806cac0 con 0x7fc8980bc8b0 2023-10-03T19:17:10.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.926+0000 7fc89e7bc640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8980720d0 con 0x7fc89806d170 2023-10-03T19:17:10.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.926+0000 7fc89e7bc640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8980a5ab0 con 0x7fc89806f170 2023-10-03T19:17:10.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.926+0000 7fc897fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc89806f170 0x7fc898150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:10.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.926+0000 7fc8977fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc8980bc8b0 0x7fc89814ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59508/0 (socket says 172.21.15.45:59508) 2023-10-03T19:17:10.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.926+0000 7fc8977fe640 1 -- 172.21.15.45:0/3151282751 learned_addr learned my addr 172.21.15.45:0/3151282751 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:10.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.926+0000 7fc896ffd640 1 -- 172.21.15.45:0/3151282751 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 730480727 0 0) 0x7fc88c001120 con 0x7fc8980bc8b0 2023-10-03T19:17:10.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.926+0000 7fc896ffd640 1 -- 172.21.15.45:0/3151282751 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc880003530 con 0x7fc8980bc8b0 2023-10-03T19:17:10.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.926+0000 7fc897fff640 1 -- 172.21.15.45:0/3151282751 >> v1:172.21.15.79:6789/0 conn(0x7fc89806d170 legacy=0x7fc898156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:10.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.926+0000 7fc897fff640 1 -- 172.21.15.45:0/3151282751 >> v1:172.21.15.45:6789/0 conn(0x7fc8980bc8b0 legacy=0x7fc89814ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:10.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.926+0000 7fc897fff640 1 -- 172.21.15.45:0/3151282751 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc89806cd00 con 0x7fc89806f170 2023-10-03T19:17:10.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.930+0000 7fc897fff640 1 --2- 172.21.15.45:0/3151282751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc89806f170 0x7fc898150190 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fc8880097c0 tx=0x7fc88801ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e993c889a45a15f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:10.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.930+0000 7fc896ffd640 1 -- 172.21.15.45:0/3151282751 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8880a8930 con 0x7fc89806f170 2023-10-03T19:17:10.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.930+0000 7fc896ffd640 1 -- 172.21.15.45:0/3151282751 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8880a8a90 con 0x7fc89806f170 2023-10-03T19:17:10.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.930+0000 7fc896ffd640 1 -- 172.21.15.45:0/3151282751 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8880a8e20 con 0x7fc89806f170 2023-10-03T19:17:10.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.930+0000 7fc89e7bc640 1 -- 172.21.15.45:0/3151282751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc89806f170 msgr2=0x7fc898150190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:10.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.930+0000 7fc89e7bc640 1 --2- 172.21.15.45:0/3151282751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc89806f170 0x7fc898150190 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fc8880097c0 tx=0x7fc88801ec30 comp rx=0 tx=0).stop 2023-10-03T19:17:10.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.930+0000 7fc89e7bc640 1 -- 172.21.15.45:0/3151282751 shutdown_connections 2023-10-03T19:17:10.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.930+0000 7fc89e7bc640 1 --2- 172.21.15.45:0/3151282751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc89806f170 0x7fc898150190 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:10.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.930+0000 7fc89e7bc640 1 -- 172.21.15.45:0/3151282751 >> 172.21.15.45:0/3151282751 conn(0x7fc8980bcf50 msgr2=0x7fc8980bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:10.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.930+0000 7fc89e7bc640 1 -- 172.21.15.45:0/3151282751 shutdown_connections 2023-10-03T19:17:10.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.930+0000 7fc89e7bc640 1 -- 172.21.15.45:0/3151282751 wait complete. 2023-10-03T19:17:10.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.930+0000 7fc89e7bc640 1 Processor -- start 2023-10-03T19:17:10.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.930+0000 7fc89e7bc640 1 -- start start 2023-10-03T19:17:10.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.930+0000 7fc89e7bc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc89806d170 0x7fc8980c09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:10.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.930+0000 7fc89e7bc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc89806f170 0x7fc8981e6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:10.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.930+0000 7fc89e7bc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8980bc8b0 0x7fc8980b98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:10.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.930+0000 7fc89e7bc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8980a3670 con 0x7fc8980bc8b0 2023-10-03T19:17:10.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.930+0000 7fc89e7bc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc898142d90 con 0x7fc89806d170 2023-10-03T19:17:10.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.930+0000 7fc89e7bc640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8980a5640 con 0x7fc89806f170 2023-10-03T19:17:10.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.930+0000 7fc89cd59640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8980bc8b0 0x7fc8980b98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:10.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.930+0000 7fc89cd59640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8980bc8b0 0x7fc8980b98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34426/0 (socket says 172.21.15.45:34426) 2023-10-03T19:17:10.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.930+0000 7fc89cd59640 1 -- 172.21.15.45:0/2903748136 learned_addr learned my addr 172.21.15.45:0/2903748136 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:10.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.930+0000 7fc897fff640 1 --2- 172.21.15.45:0/2903748136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc89806d170 0x7fc8980c09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:10.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.930+0000 7fc8977fe640 1 --2- 172.21.15.45:0/2903748136 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc89806f170 0x7fc8981e6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:10.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.934+0000 7fc89cd59640 1 -- 172.21.15.45:0/2903748136 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc89806f170 msgr2=0x7fc8981e6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:10.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.934+0000 7fc89cd59640 1 --2- 172.21.15.45:0/2903748136 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc89806f170 0x7fc8981e6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:10.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.934+0000 7fc89cd59640 1 -- 172.21.15.45:0/2903748136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc89806d170 msgr2=0x7fc8980c09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:10.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.934+0000 7fc89cd59640 1 --2- 172.21.15.45:0/2903748136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc89806d170 0x7fc8980c09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:10.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.934+0000 7fc89cd59640 1 -- 172.21.15.45:0/2903748136 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc888009420 con 0x7fc8980bc8b0 2023-10-03T19:17:10.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.934+0000 7fc897fff640 1 --2- 172.21.15.45:0/2903748136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc89806d170 0x7fc8980c09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:17:10.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.934+0000 7fc8977fe640 1 --2- 172.21.15.45:0/2903748136 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc89806f170 0x7fc8981e6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:17:10.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.934+0000 7fc89cd59640 1 --2- 172.21.15.45:0/2903748136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8980bc8b0 0x7fc8980b98f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fc89000c780 tx=0x7fc89000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:10.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.934+0000 7fc894ff9640 1 -- 172.21.15.45:0/2903748136 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc890004b70 con 0x7fc8980bc8b0 2023-10-03T19:17:10.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.934+0000 7fc894ff9640 1 -- 172.21.15.45:0/2903748136 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89000ce90 con 0x7fc8980bc8b0 2023-10-03T19:17:10.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.934+0000 7fc89e7bc640 1 -- 172.21.15.45:0/2903748136 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc89814c4a0 con 0x7fc8980bc8b0 2023-10-03T19:17:10.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.934+0000 7fc894ff9640 1 -- 172.21.15.45:0/2903748136 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89000a850 con 0x7fc8980bc8b0 2023-10-03T19:17:10.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.934+0000 7fc89e7bc640 1 -- 172.21.15.45:0/2903748136 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc89814fae0 con 0x7fc8980bc8b0 2023-10-03T19:17:10.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.934+0000 7fc89e7bc640 1 -- 172.21.15.45:0/2903748136 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc89806f540 con 0x7fc8980bc8b0 2023-10-03T19:17:10.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.934+0000 7fc894ff9640 1 -- 172.21.15.45:0/2903748136 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc89000a9b0 con 0x7fc8980bc8b0 2023-10-03T19:17:10.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.934+0000 7fc894ff9640 1 --2- 172.21.15.45:0/2903748136 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc884066280 0x7fc884068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:10.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.934+0000 7fc894ff9640 1 -- 172.21.15.45:0/2903748136 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc890083fa0 con 0x7fc8980bc8b0 2023-10-03T19:17:10.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.934+0000 7fc897fff640 1 --2- 172.21.15.45:0/2903748136 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc884066280 0x7fc884068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:10.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.934+0000 7fc897fff640 1 --2- 172.21.15.45:0/2903748136 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc884066280 0x7fc884068730 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc8880b2000 tx=0x7fc888008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:10.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:10.938+0000 7fc894ff9640 1 -- 172.21.15.45:0/2903748136 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc8900b46f0 con 0x7fc8980bc8b0 2023-10-03T19:17:11.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.126+0000 7fc89e7bc640 1 -- 172.21.15.45:0/2903748136 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc89806d660 con 0x7fc8980bc8b0 2023-10-03T19:17:11.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.126+0000 7fc894ff9640 1 -- 172.21.15.45:0/2903748136 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+3915 (secure 0 0 0) 0x7fc890054e20 con 0x7fc8980bc8b0 2023-10-03T19:17:11.129 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:17:11.129 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1808337334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1808337334},{"type":"v1","addr":"172.21.15.45:6835","nonce":1808337334}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5533,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3484102267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3484102267},{"type":"v1","addr":"172.21.15.79:6835","nonce":3484102267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:16:46.297139+0000","modified":"2023-10-03T19:16:48.310624+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5904},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5904":{"gid":5904,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6833/2572156585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2572156585},{"type":"v1","addr":"172.21.15.45:6833","nonce":2572156585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-10-03T19:17:11.129 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 29 2023-10-03T19:17:11.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.130+0000 7fc89e7bc640 1 -- 172.21.15.45:0/2903748136 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc884066280 msgr2=0x7fc884068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:11.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.130+0000 7fc89e7bc640 1 --2- 172.21.15.45:0/2903748136 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc884066280 0x7fc884068730 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc8880b2000 tx=0x7fc888008040 comp rx=0 tx=0).stop 2023-10-03T19:17:11.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.130+0000 7fc89e7bc640 1 -- 172.21.15.45:0/2903748136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8980bc8b0 msgr2=0x7fc8980b98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:11.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.130+0000 7fc89e7bc640 1 --2- 172.21.15.45:0/2903748136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8980bc8b0 0x7fc8980b98f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fc89000c780 tx=0x7fc89000cc40 comp rx=0 tx=0).stop 2023-10-03T19:17:11.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.130+0000 7fc89e7bc640 1 -- 172.21.15.45:0/2903748136 shutdown_connections 2023-10-03T19:17:11.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.130+0000 7fc89e7bc640 1 --2- 172.21.15.45:0/2903748136 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc884066280 0x7fc884068730 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.130+0000 7fc89e7bc640 1 --2- 172.21.15.45:0/2903748136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8980bc8b0 0x7fc8980b98f0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.130+0000 7fc89e7bc640 1 --2- 172.21.15.45:0/2903748136 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc89806f170 0x7fc8981e6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.130+0000 7fc89e7bc640 1 --2- 172.21.15.45:0/2903748136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc89806d170 0x7fc8980c09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.130+0000 7fc89e7bc640 1 -- 172.21.15.45:0/2903748136 >> 172.21.15.45:0/2903748136 conn(0x7fc8980bcf50 msgr2=0x7fc89814f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:11.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.130+0000 7fc89e7bc640 1 -- 172.21.15.45:0/2903748136 shutdown_connections 2023-10-03T19:17:11.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.130+0000 7fc89e7bc640 1 -- 172.21.15.45:0/2903748136 wait complete. 2023-10-03T19:17:11.148 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2023-10-03T19:17:11.287 INFO:teuthology.orchestra.run.smithi045.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2023-10-03T19:17:11.287 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2023-10-03T19:17:11.287 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:17:11.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.410+0000 7fa6309ef640 1 Processor -- start 2023-10-03T19:17:11.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.410+0000 7fa6309ef640 1 -- start start 2023-10-03T19:17:11.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa6309ef640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa62c0bc8b0 0x7fa62c14ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:11.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa6309ef640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa62c06d170 0x7fa62c14cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:11.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa6309ef640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa62c06cac0 con 0x7fa62c06f170 2023-10-03T19:17:11.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa6309ef640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa62c14d4f0 con 0x7fa62c06d170 2023-10-03T19:17:11.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa6309ef640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c0720d0 con 0x7fa62c0bc8b0 2023-10-03T19:17:11.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa62a59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa62c06f170 0x7fa62c150190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59510/0 (socket says 172.21.15.45:59510) 2023-10-03T19:17:11.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa62a59c640 1 -- 172.21.15.45:0/164484249 learned_addr learned my addr 172.21.15.45:0/164484249 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:11.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa629d9b640 1 --2- 172.21.15.45:0/164484249 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa62c0bc8b0 0x7fa62c14ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:11.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa62ad9d640 1 --2- 172.21.15.45:0/164484249 >> v2:172.21.15.79:3300/0 conn(0x7fa62c06d170 0x7fa62c14cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:11.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa62959a640 1 -- 172.21.15.45:0/164484249 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4131306488 0 0) 0x7fa61c001120 con 0x7fa62c06f170 2023-10-03T19:17:11.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa62959a640 1 -- 172.21.15.45:0/164484249 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa614003530 con 0x7fa62c06f170 2023-10-03T19:17:11.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa62959a640 1 -- 172.21.15.45:0/164484249 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 305944832 0 0) 0x7fa614003530 con 0x7fa62c06f170 2023-10-03T19:17:11.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa62959a640 1 -- 172.21.15.45:0/164484249 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa62c0bc8b0 msgr2=0x7fa62c14ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:11.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa62959a640 1 --2- 172.21.15.45:0/164484249 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa62c0bc8b0 0x7fa62c14ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa62959a640 1 -- 172.21.15.45:0/164484249 >> v2:172.21.15.79:3300/0 conn(0x7fa62c06d170 msgr2=0x7fa62c14cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:11.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa62959a640 1 --2- 172.21.15.45:0/164484249 >> v2:172.21.15.79:3300/0 conn(0x7fa62c06d170 0x7fa62c14cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa62959a640 1 -- 172.21.15.45:0/164484249 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62c0a5ab0 con 0x7fa62c06f170 2023-10-03T19:17:11.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa62959a640 1 -- 172.21.15.45:0/164484249 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fa61c001810 con 0x7fa62c06f170 2023-10-03T19:17:11.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa62ad9d640 1 --2- 172.21.15.45:0/164484249 >> v2:172.21.15.79:3300/0 conn(0x7fa62c06d170 0x7fa62c14cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:17:11.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa62959a640 1 -- 172.21.15.45:0/164484249 >> v1:172.21.15.45:6789/0 conn(0x7fa62c06f170 legacy=0x7fa62c150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:11.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa62959a640 1 --2- 172.21.15.45:0/164484249 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa62c0bc8b0 0x7fa614003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:11.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa62959a640 1 --2- 172.21.15.45:0/164484249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa614003f00 0x7fa6140047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:11.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa62959a640 1 --2- 172.21.15.45:0/164484249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa614004d10 0x7fa614005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:11.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa62959a640 1 -- 172.21.15.45:0/164484249 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c14d4f0 con 0x7fa614003f00 2023-10-03T19:17:11.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa62959a640 1 -- 172.21.15.45:0/164484249 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c0720d0 con 0x7fa614004d10 2023-10-03T19:17:11.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa62959a640 1 -- 172.21.15.45:0/164484249 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61400b9c0 con 0x7fa62c0bc8b0 2023-10-03T19:17:11.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa629d9b640 1 --2- 172.21.15.45:0/164484249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa614003f00 0x7fa6140047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:11.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa62ad9d640 1 --2- 172.21.15.45:0/164484249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa614004d10 0x7fa614005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:11.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa62a59c640 1 --2- 172.21.15.45:0/164484249 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa62c0bc8b0 0x7fa614003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:11.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa629d9b640 1 -- 172.21.15.45:0/164484249 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa62c0bc8b0 msgr2=0x7fa614003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:11.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa629d9b640 1 --2- 172.21.15.45:0/164484249 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa62c0bc8b0 0x7fa614003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa629d9b640 1 -- 172.21.15.45:0/164484249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa614004d10 msgr2=0x7fa614005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:11.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa629d9b640 1 --2- 172.21.15.45:0/164484249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa614004d10 0x7fa614005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa629d9b640 1 -- 172.21.15.45:0/164484249 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa614003530 con 0x7fa614003f00 2023-10-03T19:17:11.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa62ad9d640 1 --2- 172.21.15.45:0/164484249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa614004d10 0x7fa614005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:11.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.414+0000 7fa62a59c640 1 --2- 172.21.15.45:0/164484249 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa62c0bc8b0 0x7fa614003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:11.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.418+0000 7fa629d9b640 1 --2- 172.21.15.45:0/164484249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa614003f00 0x7fa6140047d0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fa620009ae0 tx=0x7fa62001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac88eed771d00ef6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:11.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.418+0000 7fa62959a640 1 -- 172.21.15.45:0/164484249 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6200a5640 con 0x7fa614003f00 2023-10-03T19:17:11.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.418+0000 7fa62959a640 1 -- 172.21.15.45:0/164484249 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6200a57a0 con 0x7fa614003f00 2023-10-03T19:17:11.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.418+0000 7fa62959a640 1 -- 172.21.15.45:0/164484249 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6200a5b50 con 0x7fa614003f00 2023-10-03T19:17:11.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.418+0000 7fa6309ef640 1 -- 172.21.15.45:0/164484249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa614003f00 msgr2=0x7fa6140047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:11.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.418+0000 7fa6309ef640 1 --2- 172.21.15.45:0/164484249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa614003f00 0x7fa6140047d0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fa620009ae0 tx=0x7fa62001ca50 comp rx=0 tx=0).stop 2023-10-03T19:17:11.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.418+0000 7fa62ad9d640 1 -- 172.21.15.45:0/164484249 reap_dead start 2023-10-03T19:17:11.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.418+0000 7fa6309ef640 1 -- 172.21.15.45:0/164484249 shutdown_connections 2023-10-03T19:17:11.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.418+0000 7fa6309ef640 1 -- 172.21.15.45:0/164484249 >> 172.21.15.45:0/164484249 conn(0x7fa62c0bcf50 msgr2=0x7fa62c0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:11.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.418+0000 7fa6309ef640 1 -- 172.21.15.45:0/164484249 shutdown_connections 2023-10-03T19:17:11.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.418+0000 7fa6309ef640 1 -- 172.21.15.45:0/164484249 wait complete. 2023-10-03T19:17:11.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.418+0000 7fa6309ef640 1 Processor -- start 2023-10-03T19:17:11.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.418+0000 7fa6309ef640 1 -- start start 2023-10-03T19:17:11.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.418+0000 7fa6309ef640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa614003f00 0x7fa62c1438f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:11.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.418+0000 7fa6309ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa62c144c60 0x7fa62c0b9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:11.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.418+0000 7fa6309ef640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa62c1e3f90 0x7fa62c147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:11.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.418+0000 7fa6309ef640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c145670 con 0x7fa62c144c60 2023-10-03T19:17:11.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.418+0000 7fa6309ef640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c0ba090 con 0x7fa614003f00 2023-10-03T19:17:11.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.418+0000 7fa6309ef640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c1488f0 con 0x7fa62c1e3f90 2023-10-03T19:17:11.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.418+0000 7fa629d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa62c144c60 0x7fa62c0b9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:11.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.418+0000 7fa629d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa62c144c60 0x7fa62c0b9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34436/0 (socket says 172.21.15.45:34436) 2023-10-03T19:17:11.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.418+0000 7fa629d9b640 1 -- 172.21.15.45:0/2493669128 learned_addr learned my addr 172.21.15.45:0/2493669128 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:11.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.418+0000 7fa62ad9d640 1 --2- 172.21.15.45:0/2493669128 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa62c1e3f90 0x7fa62c147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:11.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.418+0000 7fa62a59c640 1 --2- 172.21.15.45:0/2493669128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa614003f00 0x7fa62c1438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:11.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.418+0000 7fa629d9b640 1 -- 172.21.15.45:0/2493669128 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa62c1e3f90 msgr2=0x7fa62c147bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:11.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.418+0000 7fa629d9b640 1 --2- 172.21.15.45:0/2493669128 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa62c1e3f90 0x7fa62c147bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.418+0000 7fa629d9b640 1 -- 172.21.15.45:0/2493669128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa614003f00 msgr2=0x7fa62c1438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:11.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.418+0000 7fa629d9b640 1 --2- 172.21.15.45:0/2493669128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa614003f00 0x7fa62c1438f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.418+0000 7fa629d9b640 1 -- 172.21.15.45:0/2493669128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62c14fae0 con 0x7fa62c144c60 2023-10-03T19:17:11.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.418+0000 7fa629d9b640 1 --2- 172.21.15.45:0/2493669128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa62c144c60 0x7fa62c0b9b50 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fa62001c880 tx=0x7fa614005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:11.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.422+0000 7fa61affd640 1 -- 172.21.15.45:0/2493669128 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa620004230 con 0x7fa62c144c60 2023-10-03T19:17:11.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.422+0000 7fa61affd640 1 -- 172.21.15.45:0/2493669128 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa620004390 con 0x7fa62c144c60 2023-10-03T19:17:11.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.422+0000 7fa6309ef640 1 -- 172.21.15.45:0/2493669128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa62c06cd00 con 0x7fa62c144c60 2023-10-03T19:17:11.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.422+0000 7fa61affd640 1 -- 172.21.15.45:0/2493669128 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6200ad850 con 0x7fa62c144c60 2023-10-03T19:17:11.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.422+0000 7fa6309ef640 1 -- 172.21.15.45:0/2493669128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa62c14c4a0 con 0x7fa62c144c60 2023-10-03T19:17:11.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.422+0000 7fa6309ef640 1 -- 172.21.15.45:0/2493669128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62c06d660 con 0x7fa62c144c60 2023-10-03T19:17:11.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.422+0000 7fa61affd640 1 -- 172.21.15.45:0/2493669128 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa6200b4040 con 0x7fa62c144c60 2023-10-03T19:17:11.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.422+0000 7fa61affd640 1 --2- 172.21.15.45:0/2493669128 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa60c0662b0 0x7fa60c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:11.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.422+0000 7fa61affd640 1 -- 172.21.15.45:0/2493669128 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa62011e080 con 0x7fa62c144c60 2023-10-03T19:17:11.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.422+0000 7fa62a59c640 1 --2- 172.21.15.45:0/2493669128 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa60c0662b0 0x7fa60c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:11.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.422+0000 7fa62a59c640 1 --2- 172.21.15.45:0/2493669128 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa60c0662b0 0x7fa60c068760 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0013a0 tx=0x7fa61c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:11.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.426+0000 7fa61affd640 1 -- 172.21.15.45:0/2493669128 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa6200eb500 con 0x7fa62c144c60 2023-10-03T19:17:11.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.614+0000 7fa6309ef640 1 -- 172.21.15.45:0/2493669128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa62c04de80 con 0x7fa62c144c60 2023-10-03T19:17:11.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.614+0000 7fa61affd640 1 -- 172.21.15.45:0/2493669128 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+3915 (secure 0 0 0) 0x7fa6200eeb20 con 0x7fa62c144c60 2023-10-03T19:17:11.615 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:17:11.615 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1808337334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1808337334},{"type":"v1","addr":"172.21.15.45:6835","nonce":1808337334}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5533,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3484102267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3484102267},{"type":"v1","addr":"172.21.15.79:6835","nonce":3484102267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:16:46.297139+0000","modified":"2023-10-03T19:16:48.310624+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5904},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5904":{"gid":5904,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6833/2572156585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2572156585},{"type":"v1","addr":"172.21.15.45:6833","nonce":2572156585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-10-03T19:17:11.615 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 29 2023-10-03T19:17:11.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.614+0000 7fa6309ef640 1 -- 172.21.15.45:0/2493669128 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa60c0662b0 msgr2=0x7fa60c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:11.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.614+0000 7fa6309ef640 1 --2- 172.21.15.45:0/2493669128 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa60c0662b0 0x7fa60c068760 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0013a0 tx=0x7fa61c009040 comp rx=0 tx=0).stop 2023-10-03T19:17:11.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.614+0000 7fa6309ef640 1 -- 172.21.15.45:0/2493669128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa62c144c60 msgr2=0x7fa62c0b9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:11.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.614+0000 7fa6309ef640 1 --2- 172.21.15.45:0/2493669128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa62c144c60 0x7fa62c0b9b50 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fa62001c880 tx=0x7fa614005800 comp rx=0 tx=0).stop 2023-10-03T19:17:11.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.614+0000 7fa6309ef640 1 -- 172.21.15.45:0/2493669128 shutdown_connections 2023-10-03T19:17:11.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.614+0000 7fa6309ef640 1 --2- 172.21.15.45:0/2493669128 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa60c0662b0 0x7fa60c068760 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.614+0000 7fa6309ef640 1 --2- 172.21.15.45:0/2493669128 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa62c1e3f90 0x7fa62c147bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.614+0000 7fa6309ef640 1 --2- 172.21.15.45:0/2493669128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa62c144c60 0x7fa62c0b9b50 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.614+0000 7fa6309ef640 1 --2- 172.21.15.45:0/2493669128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa614003f00 0x7fa62c1438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.614+0000 7fa6309ef640 1 -- 172.21.15.45:0/2493669128 >> 172.21.15.45:0/2493669128 conn(0x7fa62c0bcf50 msgr2=0x7fa62c14f020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:11.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.614+0000 7fa6309ef640 1 -- 172.21.15.45:0/2493669128 shutdown_connections 2023-10-03T19:17:11.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.614+0000 7fa6309ef640 1 -- 172.21.15.45:0/2493669128 wait complete. 2023-10-03T19:17:11.635 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2023-10-03T19:17:11.772 INFO:teuthology.orchestra.run.smithi045.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2023-10-03T19:17:11.772 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2023-10-03T19:17:11.772 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-03T19:17:11.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:17:11.773 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 down 2023-10-03T19:17:11.789 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 cache drop 5 2023-10-03T19:17:11.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.918+0000 7feaff9c8640 1 Processor -- start 2023-10-03T19:17:11.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.918+0000 7feaff9c8640 1 -- start start 2023-10-03T19:17:11.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.918+0000 7feaff9c8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaf80658f0 0x7feaf814bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:11.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.918+0000 7feaff9c8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feaf806ae30 0x7feaf806a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:11.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.918+0000 7feaff9c8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf806a720 con 0x7feaf814c0a0 2023-10-03T19:17:11.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.918+0000 7feaff9c8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf8151ca0 con 0x7feaf806ae30 2023-10-03T19:17:11.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.918+0000 7feaff9c8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf8151f40 con 0x7feaf80658f0 2023-10-03T19:17:11.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.918+0000 7feafd764640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaf80658f0 0x7feaf814bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:11.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.918+0000 7feafdf65640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feaf806ae30 0x7feaf806a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:11.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.918+0000 7feafd764640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaf80658f0 0x7feaf814bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:39308/0 (socket says 172.21.15.45:39308) 2023-10-03T19:17:11.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.918+0000 7feafd764640 1 -- 172.21.15.45:0/861259918 learned_addr learned my addr 172.21.15.45:0/861259918 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:11.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.918+0000 7feafd764640 1 -- 172.21.15.45:0/861259918 >> v2:172.21.15.79:3300/0 conn(0x7feaf806ae30 msgr2=0x7feaf806a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:11.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.918+0000 7feafd764640 1 --2- 172.21.15.45:0/861259918 >> v2:172.21.15.79:3300/0 conn(0x7feaf806ae30 0x7feaf806a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.918+0000 7feafd764640 1 -- 172.21.15.45:0/861259918 >> v1:172.21.15.79:6789/0 conn(0x7feaf814c0a0 legacy=0x7feaf8069ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:11.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.918+0000 7feafd764640 1 -- 172.21.15.45:0/861259918 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf8152220 con 0x7feaf80658f0 2023-10-03T19:17:11.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.922+0000 7feafd764640 1 --2- 172.21.15.45:0/861259918 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaf80658f0 0x7feaf814bb60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feaf4009870 tx=0x7feaf401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f8909003d39443d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:11.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.922+0000 7feaebfff640 1 -- 172.21.15.45:0/861259918 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf40ab620 con 0x7feaf80658f0 2023-10-03T19:17:11.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.922+0000 7feaebfff640 1 -- 172.21.15.45:0/861259918 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf40ab780 con 0x7feaf80658f0 2023-10-03T19:17:11.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.922+0000 7feaebfff640 1 -- 172.21.15.45:0/861259918 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf40abb10 con 0x7feaf80658f0 2023-10-03T19:17:11.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.922+0000 7feaff9c8640 1 -- 172.21.15.45:0/861259918 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaf80658f0 msgr2=0x7feaf814bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:11.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.922+0000 7feaff9c8640 1 --2- 172.21.15.45:0/861259918 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaf80658f0 0x7feaf814bb60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feaf4009870 tx=0x7feaf401c510 comp rx=0 tx=0).stop 2023-10-03T19:17:11.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.922+0000 7feaff9c8640 1 -- 172.21.15.45:0/861259918 shutdown_connections 2023-10-03T19:17:11.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.922+0000 7feaff9c8640 1 --2- 172.21.15.45:0/861259918 >> v2:172.21.15.79:3300/0 conn(0x7feaf806ae30 0x7feaf806a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.922+0000 7feaff9c8640 1 --2- 172.21.15.45:0/861259918 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaf80658f0 0x7feaf814bb60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.922+0000 7feaff9c8640 1 -- 172.21.15.45:0/861259918 >> 172.21.15.45:0/861259918 conn(0x7feaf80be190 msgr2=0x7feaf80be590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:11.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.922+0000 7feaff9c8640 1 -- 172.21.15.45:0/861259918 shutdown_connections 2023-10-03T19:17:11.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.922+0000 7feaff9c8640 1 -- 172.21.15.45:0/861259918 wait complete. 2023-10-03T19:17:11.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.922+0000 7feaff9c8640 1 Processor -- start 2023-10-03T19:17:11.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.922+0000 7feaff9c8640 1 -- start start 2023-10-03T19:17:11.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.926+0000 7feaff9c8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf80658f0 0x7feaf8146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:11.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.926+0000 7feaff9c8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaf806ae30 0x7feaf813f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:11.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.926+0000 7feaff9c8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaf814c0a0 0x7feaf813f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:11.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.926+0000 7feaff9c8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf80a6e40 con 0x7feaf814c0a0 2023-10-03T19:17:11.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.926+0000 7feaff9c8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf80c07c0 con 0x7feaf80658f0 2023-10-03T19:17:11.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.926+0000 7feaff9c8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf81585f0 con 0x7feaf806ae30 2023-10-03T19:17:11.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.926+0000 7feafdf65640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaf814c0a0 0x7feaf813f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:11.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.926+0000 7feafdf65640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaf814c0a0 0x7feaf813f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34438/0 (socket says 172.21.15.45:34438) 2023-10-03T19:17:11.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.926+0000 7feafdf65640 1 -- 172.21.15.45:0/3365626420 learned_addr learned my addr 172.21.15.45:0/3365626420 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:11.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.926+0000 7feafd764640 1 --2- 172.21.15.45:0/3365626420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf80658f0 0x7feaf8146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:11.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.926+0000 7feafcf63640 1 --2- 172.21.15.45:0/3365626420 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaf806ae30 0x7feaf813f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:11.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.926+0000 7feafdf65640 1 -- 172.21.15.45:0/3365626420 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaf806ae30 msgr2=0x7feaf813f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:11.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.926+0000 7feafdf65640 1 --2- 172.21.15.45:0/3365626420 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaf806ae30 0x7feaf813f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.926+0000 7feafdf65640 1 -- 172.21.15.45:0/3365626420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf80658f0 msgr2=0x7feaf8146f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:11.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.926+0000 7feafdf65640 1 --2- 172.21.15.45:0/3365626420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf80658f0 0x7feaf8146f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.926+0000 7feafdf65640 1 -- 172.21.15.45:0/3365626420 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf40094d0 con 0x7feaf814c0a0 2023-10-03T19:17:11.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.926+0000 7feafdf65640 1 --2- 172.21.15.45:0/3365626420 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaf814c0a0 0x7feaf813f9f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7feaf000e930 tx=0x7feaf000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:11.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.926+0000 7feae9ffb640 1 -- 172.21.15.45:0/3365626420 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf00096b0 con 0x7feaf814c0a0 2023-10-03T19:17:11.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.926+0000 7feae9ffb640 1 -- 172.21.15.45:0/3365626420 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf000c9a0 con 0x7feaf814c0a0 2023-10-03T19:17:11.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.926+0000 7feae9ffb640 1 -- 172.21.15.45:0/3365626420 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf000cd30 con 0x7feaf814c0a0 2023-10-03T19:17:11.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.926+0000 7feaff9c8640 1 -- 172.21.15.45:0/3365626420 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf8071c40 con 0x7feaf814c0a0 2023-10-03T19:17:11.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.926+0000 7feaff9c8640 1 -- 172.21.15.45:0/3365626420 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf806e4a0 con 0x7feaf814c0a0 2023-10-03T19:17:11.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.926+0000 7feae9ffb640 1 -- 172.21.15.45:0/3365626420 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7feaf0013470 con 0x7feaf814c0a0 2023-10-03T19:17:11.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feae9ffb640 1 --2- 172.21.15.45:0/3365626420 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7feadc066280 0x7feadc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:11.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feae9ffb640 1 -- 172.21.15.45:0/3365626420 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feaf00840f0 con 0x7feaf814c0a0 2023-10-03T19:17:11.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feafd764640 1 --2- 172.21.15.45:0/3365626420 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7feadc066280 0x7feadc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:11.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feb02aec000 1 Processor -- start 2023-10-03T19:17:11.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feb02aec000 1 -- start start 2023-10-03T19:17:11.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feafd764640 1 --2- 172.21.15.45:0/3365626420 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7feadc066280 0x7feadc068730 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7feaf40af000 tx=0x7feaf40a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:11.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feb02aec000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x564c26f52b40 0x564c26f18b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:11.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feb02aec000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c26f52f10 0x564c26f190c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:11.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feb02aec000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c26f19600 0x564c26f199d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:11.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feb02aec000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c26d22a60 con 0x564c26f19600 2023-10-03T19:17:11.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feb02aec000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c26d1dcc0 con 0x564c26f52f10 2023-10-03T19:17:11.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feb02aec000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x564c26d70e00 con 0x564c26f52b40 2023-10-03T19:17:11.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feafdf65640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c26f19600 0x564c26f199d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:11.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feafdf65640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c26f19600 0x564c26f199d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34448/0 (socket says 172.21.15.45:34448) 2023-10-03T19:17:11.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feafdf65640 1 -- 172.21.15.45:0/1463246667 learned_addr learned my addr 172.21.15.45:0/1463246667 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:11.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feafd764640 1 --2- 172.21.15.45:0/1463246667 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x564c26f52b40 0x564c26f18b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:11.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feafcf63640 1 --2- 172.21.15.45:0/1463246667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c26f52f10 0x564c26f190c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:11.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feafdf65640 1 -- 172.21.15.45:0/1463246667 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x564c26f52b40 msgr2=0x564c26f18b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:11.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feafdf65640 1 --2- 172.21.15.45:0/1463246667 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x564c26f52b40 0x564c26f18b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feafdf65640 1 -- 172.21.15.45:0/1463246667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c26f52f10 msgr2=0x564c26f190c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:11.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feafdf65640 1 --2- 172.21.15.45:0/1463246667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c26f52f10 0x564c26f190c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feafdf65640 1 -- 172.21.15.45:0/1463246667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c26d2ef30 con 0x564c26f19600 2023-10-03T19:17:11.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feafdf65640 1 --2- 172.21.15.45:0/1463246667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c26f19600 0x564c26f199d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7feaf00516c0 tx=0x7feaf00592c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c33596d0dd2b54 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:11.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feadaffd640 1 -- 172.21.15.45:0/1463246667 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf0080070 con 0x564c26f19600 2023-10-03T19:17:11.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feadaffd640 1 -- 172.21.15.45:0/1463246667 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf0053560 con 0x564c26f19600 2023-10-03T19:17:11.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feadaffd640 1 -- 172.21.15.45:0/1463246667 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf0050fb0 con 0x564c26f19600 2023-10-03T19:17:11.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feb02aec000 1 -- 172.21.15.45:0/1463246667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c26f19600 msgr2=0x564c26f199d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:11.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feb02aec000 1 --2- 172.21.15.45:0/1463246667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c26f19600 0x564c26f199d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7feaf00516c0 tx=0x7feaf00592c0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feb02aec000 1 -- 172.21.15.45:0/1463246667 shutdown_connections 2023-10-03T19:17:11.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feb02aec000 1 --2- 172.21.15.45:0/1463246667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c26f19600 0x564c26f199d0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feb02aec000 1 --2- 172.21.15.45:0/1463246667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c26f52f10 0x564c26f190c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feb02aec000 1 --2- 172.21.15.45:0/1463246667 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x564c26f52b40 0x564c26f18b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feb02aec000 1 -- 172.21.15.45:0/1463246667 >> 172.21.15.45:0/1463246667 conn(0x564c26d81820 msgr2=0x564c26f229b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:11.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feb02aec000 1 -- 172.21.15.45:0/1463246667 shutdown_connections 2023-10-03T19:17:11.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feb02aec000 1 -- 172.21.15.45:0/1463246667 wait complete. 2023-10-03T19:17:11.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feb02aec000 1 -- start start 2023-10-03T19:17:11.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.930+0000 7feb02aec000 1 Processor -- start 2023-10-03T19:17:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feb02aec000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x564c26f19600 0x564c26f51f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feb02aec000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c26f52b40 0x564c26f52460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feb02aec000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c26f52f10 0x564c26f5d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feb02aec000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c26d69ea0 con 0x564c26f52b40 2023-10-03T19:17:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feb02aec000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c26d26f40 con 0x564c26f52f10 2023-10-03T19:17:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feb02aec000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x564c26d26be0 con 0x564c26f19600 2023-10-03T19:17:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feb02aec000 10 client.0 _ll_register_callbacks cb 0x564c26f083c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T19:17:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feafcf63640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c26f52b40 0x564c26f52460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feafcf63640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c26f52b40 0x564c26f52460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34458/0 (socket says 172.21.15.45:34458) 2023-10-03T19:17:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feafcf63640 1 -- 172.21.15.45:0/1103244328 learned_addr learned my addr 172.21.15.45:0/1103244328 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feafdf65640 1 --2- 172.21.15.45:0/1103244328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c26f52f10 0x564c26f5d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:11.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feafd764640 1 --2- 172.21.15.45:0/1103244328 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x564c26f19600 0x564c26f51f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:11.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feafcf63640 1 -- 172.21.15.45:0/1103244328 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x564c26f19600 msgr2=0x564c26f51f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:11.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feafcf63640 1 --2- 172.21.15.45:0/1103244328 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x564c26f19600 0x564c26f51f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feafcf63640 1 -- 172.21.15.45:0/1103244328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c26f52f10 msgr2=0x564c26f5d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:11.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feafcf63640 1 --2- 172.21.15.45:0/1103244328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c26f52f10 0x564c26f5d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feafcf63640 1 -- 172.21.15.45:0/1103244328 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf806e4a0 con 0x564c26f52b40 2023-10-03T19:17:11.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feafcf63640 1 --2- 172.21.15.45:0/1103244328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c26f52b40 0x564c26f52460 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7feaec005920 tx=0x7feaec0018a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dbebafe12d4645c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:11.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7fead3fff640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-10-03T19:17:11.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7fead3fff640 1 -- 172.21.15.45:0/1103244328 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec002070 con 0x564c26f52b40 2023-10-03T19:17:11.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7fead3fff640 1 -- 172.21.15.45:0/1103244328 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feaec013570 con 0x564c26f52b40 2023-10-03T19:17:11.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feb02aec000 1 -- 172.21.15.45:0/1103244328 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564c26d725e0 con 0x564c26f52b40 2023-10-03T19:17:11.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7fead3fff640 1 -- 172.21.15.45:0/1103244328 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7feaec003d80 con 0x564c26f52b40 2023-10-03T19:17:11.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feb02aec000 10 client.6126 fetch_fsmap learned FSMap version 29 2023-10-03T19:17:11.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feb02aec000 1 -- 172.21.15.45:0/1103244328 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x564c26a66a80 con 0x564c26f52b40 2023-10-03T19:17:11.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7fead3fff640 1 -- 172.21.15.45:0/1103244328 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564c26d725e0 con 0x564c26f52b40 2023-10-03T19:17:11.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7fead3fff640 1 -- 172.21.15.45:0/1103244328 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 29) v1 ==== 2569+0+0 (secure 0 0 0) 0x7feaec006b60 con 0x564c26f52b40 2023-10-03T19:17:11.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feb02aec000 10 client.6126 fetch_fsmap finished waiting for FSMap version 29 2023-10-03T19:17:11.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feb02aec000 10 client.6126 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-10-03T19:17:11.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feb02aec000 20 client.6126 populate_metadata read hostname 'smithi045' 2023-10-03T19:17:11.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feb02aec000 1 --2- 172.21.15.45:0/1103244328 >> [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] conn(0x564c26f5e3d0 0x564c26f5e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:11.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feb02aec000 4 client.6126 mds_command: new command op to 5904 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-03T19:17:11.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feb02aec000 1 -- 172.21.15.45:0/1103244328 --> [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564c26d26650 con 0x564c26f5e3d0 2023-10-03T19:17:11.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feafd764640 1 --2- 172.21.15.45:0/1103244328 >> [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] conn(0x564c26f5e3d0 0x564c26f5e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:11.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7fead3fff640 10 client.6126 ms_handle_connect on v2:172.21.15.45:6832/2572156585 2023-10-03T19:17:11.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feafd764640 1 --2- 172.21.15.45:0/1103244328 >> [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] conn(0x564c26f5e3d0 0x564c26f5e7d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f2a0f7a8816d95d server_cookie=dac2fca583a92939 in_seq=0 out_seq=0 2023-10-03T19:17:11.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7fead3fff640 1 -- 172.21.15.45:0/1103244328 <== mds.0 v2:172.21.15.45:6832/2572156585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x564c26d26650 con 0x564c26f5e3d0 2023-10-03T19:17:11.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7fead3fff640 10 client.6126 handle_command_reply: tid=0 2023-10-03T19:17:11.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feb02aec000 1 client.6126 shutdown 2023-10-03T19:17:11.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feb02aec000 1 -- 172.21.15.45:0/1103244328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c26f52b40 msgr2=0x564c26f52460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:11.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feb02aec000 1 --2- 172.21.15.45:0/1103244328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c26f52b40 0x564c26f52460 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7feaec005920 tx=0x7feaec0018a0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feb02aec000 1 -- 172.21.15.45:0/1103244328 shutdown_connections 2023-10-03T19:17:11.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feb02aec000 1 --2- 172.21.15.45:0/1103244328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c26f52f10 0x564c26f5d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feb02aec000 1 --2- 172.21.15.45:0/1103244328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c26f52b40 0x564c26f52460 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feb02aec000 1 --2- 172.21.15.45:0/1103244328 >> [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] conn(0x564c26f5e3d0 0x564c26f5e7d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feb02aec000 1 --2- 172.21.15.45:0/1103244328 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x564c26f19600 0x564c26f51f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feb02aec000 1 -- 172.21.15.45:0/1103244328 >> 172.21.15.45:0/1103244328 conn(0x564c26d81820 msgr2=0x564c26f18b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:11.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7fead3fff640 0 client.6126 ms_handle_reset on v2:172.21.15.45:6832/2572156585 2023-10-03T19:17:11.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feb02aec000 1 -- 172.21.15.45:0/1103244328 shutdown_connections 2023-10-03T19:17:11.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feb02aec000 1 -- 172.21.15.45:0/1103244328 wait complete. 2023-10-03T19:17:11.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.934+0000 7feb02aec000 20 client.6126 trim_cache size 0 max 16384 2023-10-03T19:17:11.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.946+0000 7feb02aec000 1 Processor -- start 2023-10-03T19:17:11.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.946+0000 7feb02aec000 1 -- start start 2023-10-03T19:17:11.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.946+0000 7feb02aec000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c26f19600 0x564c26f6d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:11.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.946+0000 7feb02aec000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c26f52b40 0x564c26f6d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:11.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.946+0000 7feb02aec000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x564c26f52f10 0x564c26f6dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:11.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.946+0000 7feb02aec000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c26a27b30 con 0x564c26f19600 2023-10-03T19:17:11.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.946+0000 7feb02aec000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c26d6ca00 con 0x564c26f52b40 2023-10-03T19:17:11.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.946+0000 7feb02aec000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x564c26f6ef90 con 0x564c26f52f10 2023-10-03T19:17:11.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.946+0000 7feafd764640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c26f19600 0x564c26f6d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:11.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.946+0000 7feafd764640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c26f19600 0x564c26f6d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34464/0 (socket says 172.21.15.45:34464) 2023-10-03T19:17:11.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.946+0000 7feafd764640 1 -- 172.21.15.45:0/826031708 learned_addr learned my addr 172.21.15.45:0/826031708 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:11.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.946+0000 7feafd764640 1 -- 172.21.15.45:0/826031708 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x564c26f52f10 msgr2=0x564c26f6dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:11.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.946+0000 7feafd764640 1 --2- 172.21.15.45:0/826031708 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x564c26f52f10 0x564c26f6dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.946+0000 7feafd764640 1 -- 172.21.15.45:0/826031708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c26f52b40 msgr2=0x564c26f6d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:11.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.946+0000 7feafd764640 1 --2- 172.21.15.45:0/826031708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c26f52b40 0x564c26f6d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.946+0000 7feafd764640 1 -- 172.21.15.45:0/826031708 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c26d2f1e0 con 0x564c26f19600 2023-10-03T19:17:11.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.946+0000 7feafd764640 1 --2- 172.21.15.45:0/826031708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c26f19600 0x564c26f6d1e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7feaf40ab6d0 tx=0x7feaf4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fde8d3b589b0a83 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:11.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.946+0000 7feadb7fe640 1 -- 172.21.15.45:0/826031708 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf40ce070 con 0x564c26f19600 2023-10-03T19:17:11.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.946+0000 7feadb7fe640 1 -- 172.21.15.45:0/826031708 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf40c9460 con 0x564c26f19600 2023-10-03T19:17:11.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.946+0000 7feadb7fe640 1 -- 172.21.15.45:0/826031708 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf40c4040 con 0x564c26f19600 2023-10-03T19:17:11.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.946+0000 7feb02aec000 1 -- 172.21.15.45:0/826031708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c26f19600 msgr2=0x564c26f6d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:11.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.946+0000 7feb02aec000 1 --2- 172.21.15.45:0/826031708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c26f19600 0x564c26f6d1e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7feaf40ab6d0 tx=0x7feaf4004740 comp rx=0 tx=0).stop 2023-10-03T19:17:11.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.946+0000 7feb02aec000 1 -- 172.21.15.45:0/826031708 shutdown_connections 2023-10-03T19:17:11.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.946+0000 7feb02aec000 1 --2- 172.21.15.45:0/826031708 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x564c26f52f10 0x564c26f6dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.946+0000 7feb02aec000 1 --2- 172.21.15.45:0/826031708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c26f52b40 0x564c26f6d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.946+0000 7feb02aec000 1 --2- 172.21.15.45:0/826031708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c26f19600 0x564c26f6d1e0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.946+0000 7feb02aec000 1 -- 172.21.15.45:0/826031708 >> 172.21.15.45:0/826031708 conn(0x564c26d81820 msgr2=0x564c26f6bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:11.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.946+0000 7feb02aec000 1 -- 172.21.15.45:0/826031708 shutdown_connections 2023-10-03T19:17:11.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.946+0000 7feb02aec000 1 -- 172.21.15.45:0/826031708 wait complete. 2023-10-03T19:17:11.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feb02aec000 1 -- start start 2023-10-03T19:17:11.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feb02aec000 1 Processor -- start 2023-10-03T19:17:11.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feb02aec000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x564c26f19600 0x564c26f7d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:11.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feb02aec000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c26f52b40 0x564c26f7da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:11.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feb02aec000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c26f52f10 0x564c26f7df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:11.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feb02aec000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c26d676b0 con 0x564c26f52f10 2023-10-03T19:17:11.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feb02aec000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c26d085a0 con 0x564c26f52b40 2023-10-03T19:17:11.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feb02aec000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x564c26d394a0 con 0x564c26f19600 2023-10-03T19:17:11.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feb02aec000 10 client.0 _ll_register_callbacks cb 0x564c26e250e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T19:17:11.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feafdf65640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c26f52f10 0x564c26f7df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:11.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feafdf65640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c26f52f10 0x564c26f7df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34472/0 (socket says 172.21.15.45:34472) 2023-10-03T19:17:11.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feafdf65640 1 -- 172.21.15.45:0/142175685 learned_addr learned my addr 172.21.15.45:0/142175685 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:11.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feafcf63640 1 --2- 172.21.15.45:0/142175685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c26f52b40 0x564c26f7da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:11.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feafd764640 1 --2- 172.21.15.45:0/142175685 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x564c26f19600 0x564c26f7d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:11.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feafdf65640 1 -- 172.21.15.45:0/142175685 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x564c26f19600 msgr2=0x564c26f7d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:11.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feafdf65640 1 --2- 172.21.15.45:0/142175685 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x564c26f19600 0x564c26f7d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feafdf65640 1 -- 172.21.15.45:0/142175685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c26f52b40 msgr2=0x564c26f7da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:11.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feafdf65640 1 --2- 172.21.15.45:0/142175685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c26f52b40 0x564c26f7da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:11.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feafdf65640 1 -- 172.21.15.45:0/142175685 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf40ba070 con 0x564c26f52f10 2023-10-03T19:17:11.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feafdf65640 1 --2- 172.21.15.45:0/142175685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c26f52f10 0x564c26f7df50 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7feaf0054e70 tx=0x7feaf00822f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a631f67a9b94a693 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:11.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7fead3fff640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-10-03T19:17:11.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7fead3fff640 1 -- 172.21.15.45:0/142175685 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf0080040 con 0x564c26f52f10 2023-10-03T19:17:11.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7fead3fff640 1 -- 172.21.15.45:0/142175685 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feaf0050fb0 con 0x564c26f52f10 2023-10-03T19:17:11.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feb02aec000 1 -- 172.21.15.45:0/142175685 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564c26d6d140 con 0x564c26f52f10 2023-10-03T19:17:11.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7fead3fff640 1 -- 172.21.15.45:0/142175685 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7feaf000ce90 con 0x564c26f52f10 2023-10-03T19:17:11.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feb02aec000 10 client.6132 fetch_fsmap learned FSMap version 29 2023-10-03T19:17:11.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feb02aec000 1 -- 172.21.15.45:0/142175685 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x564c26d14a60 con 0x564c26f52f10 2023-10-03T19:17:11.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7fead3fff640 1 -- 172.21.15.45:0/142175685 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564c26d6d140 con 0x564c26f52f10 2023-10-03T19:17:11.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7fead3fff640 1 -- 172.21.15.45:0/142175685 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 29) v1 ==== 2569+0+0 (secure 0 0 0) 0x7feaf0011070 con 0x564c26f52f10 2023-10-03T19:17:11.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feb02aec000 10 client.6132 fetch_fsmap finished waiting for FSMap version 29 2023-10-03T19:17:11.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feb02aec000 10 client.6132 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-10-03T19:17:11.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feb02aec000 20 client.6132 populate_metadata read hostname 'smithi045' 2023-10-03T19:17:11.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feb02aec000 1 --2- 172.21.15.45:0/142175685 >> [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] conn(0x564c26f7e910 0x564c26fbf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:11.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feb02aec000 4 client.6132 mds_command: new command op to 5904 tid=0[{"prefix": "cache drop", "timeout": 5}] 2023-10-03T19:17:11.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feb02aec000 1 -- 172.21.15.45:0/142175685 --> [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] -- command(tid 0: {"prefix": "cache drop", "timeout": 5}) v1 -- 0x564c26d62e80 con 0x564c26f7e910 2023-10-03T19:17:11.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feafd764640 1 --2- 172.21.15.45:0/142175685 >> [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] conn(0x564c26f7e910 0x564c26fbf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:11.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7feafd764640 1 --2- 172.21.15.45:0/142175685 >> [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] conn(0x564c26f7e910 0x564c26fbf110 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c10c6e9d2a35a6e4 server_cookie=a4386230d28de928 in_seq=0 out_seq=0 2023-10-03T19:17:11.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:11.950+0000 7fead3fff640 10 client.6132 ms_handle_connect on v2:172.21.15.45:6832/2572156585 2023-10-03T19:17:17.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.222+0000 7fead3fff640 1 -- 172.21.15.45:0/142175685 <== mds.0 v2:172.21.15.45:6832/2572156585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+404 (crc 0 0 0) 0x564c26d62e80 con 0x564c26f7e910 2023-10-03T19:17:17.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.222+0000 7fead3fff640 10 client.6132 handle_command_reply: tid=0 2023-10-03T19:17:17.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.222+0000 7feb02aec000 1 client.6132 shutdown 2023-10-03T19:17:17.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.222+0000 7feb02aec000 1 -- 172.21.15.45:0/142175685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c26f52f10 msgr2=0x564c26f7df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:17.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.222+0000 7feb02aec000 1 --2- 172.21.15.45:0/142175685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c26f52f10 0x564c26f7df50 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7feaf0054e70 tx=0x7feaf00822f0 comp rx=0 tx=0).stop 2023-10-03T19:17:17.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.222+0000 7feb02aec000 1 -- 172.21.15.45:0/142175685 shutdown_connections 2023-10-03T19:17:17.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.222+0000 7feb02aec000 1 --2- 172.21.15.45:0/142175685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c26f52f10 0x564c26f7df50 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:17.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.222+0000 7feb02aec000 1 --2- 172.21.15.45:0/142175685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c26f52b40 0x564c26f7da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:17.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.222+0000 7feb02aec000 1 --2- 172.21.15.45:0/142175685 >> [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] conn(0x564c26f7e910 0x564c26fbf110 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:17.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.222+0000 7fead3fff640 0 client.6132 ms_handle_reset on v2:172.21.15.45:6832/2572156585 2023-10-03T19:17:17.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.222+0000 7feb02aec000 1 --2- 172.21.15.45:0/142175685 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x564c26f19600 0x564c26f7d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:17.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.222+0000 7feb02aec000 1 -- 172.21.15.45:0/142175685 >> 172.21.15.45:0/142175685 conn(0x564c26d81820 msgr2=0x564c26f6bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:17.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.222+0000 7feb02aec000 1 -- 172.21.15.45:0/142175685 shutdown_connections 2023-10-03T19:17:17.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.222+0000 7feb02aec000 1 -- 172.21.15.45:0/142175685 wait complete. 2023-10-03T19:17:17.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.222+0000 7feb02aec000 20 client.6132 trim_cache size 0 max 16384 2023-10-03T19:17:17.228 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-03T19:17:17.228 INFO:teuthology.orchestra.run.smithi045.stdout: "client_recall": { 2023-10-03T19:17:17.228 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": -110, 2023-10-03T19:17:17.228 INFO:teuthology.orchestra.run.smithi045.stdout: "message": "(110) Connection timed out", 2023-10-03T19:17:17.228 INFO:teuthology.orchestra.run.smithi045.stdout: "recalled": 120 2023-10-03T19:17:17.229 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:17:17.229 INFO:teuthology.orchestra.run.smithi045.stdout: "flush_journal": { 2023-10-03T19:17:17.229 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2023-10-03T19:17:17.229 INFO:teuthology.orchestra.run.smithi045.stdout: "message": "" 2023-10-03T19:17:17.229 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:17:17.229 INFO:teuthology.orchestra.run.smithi045.stdout: "trim_cache": { 2023-10-03T19:17:17.229 INFO:teuthology.orchestra.run.smithi045.stdout: "trimmed": 0 2023-10-03T19:17:17.229 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:17:17.229 INFO:teuthology.orchestra.run.smithi045.stdout: "cache": { 2023-10-03T19:17:17.229 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": { 2023-10-03T19:17:17.230 INFO:teuthology.orchestra.run.smithi045.stdout: "items": 20552, 2023-10-03T19:17:17.230 INFO:teuthology.orchestra.run.smithi045.stdout: "bytes": 3236488 2023-10-03T19:17:17.230 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:17:17.230 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:17:17.230 INFO:teuthology.orchestra.run.smithi045.stdout: "duration": 5.2720077339999998 2023-10-03T19:17:17.230 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-03T19:17:17.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.226+0000 7feaff9c8640 1 -- 172.21.15.45:0/3365626420 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7feadc066280 msgr2=0x7feadc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:17.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.226+0000 7feaff9c8640 1 --2- 172.21.15.45:0/3365626420 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7feadc066280 0x7feadc068730 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7feaf40af000 tx=0x7feaf40a7000 comp rx=0 tx=0).stop 2023-10-03T19:17:17.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.226+0000 7feaff9c8640 1 -- 172.21.15.45:0/3365626420 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaf814c0a0 msgr2=0x7feaf813f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:17.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.226+0000 7feaff9c8640 1 --2- 172.21.15.45:0/3365626420 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaf814c0a0 0x7feaf813f9f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7feaf000e930 tx=0x7feaf000edf0 comp rx=0 tx=0).stop 2023-10-03T19:17:17.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.226+0000 7feaff9c8640 1 -- 172.21.15.45:0/3365626420 shutdown_connections 2023-10-03T19:17:17.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.226+0000 7feaff9c8640 1 --2- 172.21.15.45:0/3365626420 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7feadc066280 0x7feadc068730 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:17.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.226+0000 7feaff9c8640 1 --2- 172.21.15.45:0/3365626420 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaf814c0a0 0x7feaf813f9f0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:17.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.226+0000 7feaff9c8640 1 --2- 172.21.15.45:0/3365626420 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaf806ae30 0x7feaf813f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:17.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.226+0000 7feaff9c8640 1 --2- 172.21.15.45:0/3365626420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf80658f0 0x7feaf8146f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:17.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.226+0000 7feaff9c8640 1 -- 172.21.15.45:0/3365626420 >> 172.21.15.45:0/3365626420 conn(0x7feaf80be190 msgr2=0x7feaf8067830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:17.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.226+0000 7feaff9c8640 1 -- 172.21.15.45:0/3365626420 shutdown_connections 2023-10-03T19:17:17.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.226+0000 7feaff9c8640 1 -- 172.21.15.45:0/3365626420 wait complete. 2023-10-03T19:17:17.246 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-03T19:17:17.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:17:17.246 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-10-03T19:17:17.261 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-03T19:17:17.261 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:17:17.295 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:17:17.354 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:17:17.399 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:17:17.476 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-03T19:17:17.477 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:17:17.477 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:17:17.483 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:17:17.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.614+0000 7fd286b54640 1 Processor -- start 2023-10-03T19:17:17.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.614+0000 7fd286b54640 1 -- start start 2023-10-03T19:17:17.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.618+0000 7fd286b54640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd280148b90 0x7fd2800bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:17.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.618+0000 7fd286b54640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd2800bc4a0 0x7fd28006c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:17.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.618+0000 7fd286b54640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd28014b610 con 0x7fd2800bcb60 2023-10-03T19:17:17.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.618+0000 7fd286b54640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2800a3670 con 0x7fd2800bc4a0 2023-10-03T19:17:17.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.618+0000 7fd286b54640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28014b370 con 0x7fd280148b90 2023-10-03T19:17:17.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.618+0000 7fd2850f1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd2800bc4a0 0x7fd28006c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:17.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.618+0000 7fd2850f1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd2800bc4a0 0x7fd28006c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39222/0 (socket says 172.21.15.45:39222) 2023-10-03T19:17:17.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.618+0000 7fd2850f1640 1 -- 172.21.15.45:0/716134881 learned_addr learned my addr 172.21.15.45:0/716134881 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:17.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.618+0000 7fd2848f0640 1 --2- 172.21.15.45:0/716134881 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd280148b90 0x7fd2800bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:17.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.618+0000 7fd2850f1640 1 -- 172.21.15.45:0/716134881 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd280148b90 msgr2=0x7fd2800bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:17.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.618+0000 7fd2850f1640 1 --2- 172.21.15.45:0/716134881 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd280148b90 0x7fd2800bbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:17.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.618+0000 7fd2850f1640 1 -- 172.21.15.45:0/716134881 >> v1:172.21.15.79:6789/0 conn(0x7fd2800bcb60 legacy=0x7fd28006c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:17.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.618+0000 7fd2850f1640 1 -- 172.21.15.45:0/716134881 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2800a5580 con 0x7fd2800bc4a0 2023-10-03T19:17:17.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.618+0000 7fd2850f1640 1 --2- 172.21.15.45:0/716134881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2800bc4a0 0x7fd28006c9a0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fd278009870 tx=0x7fd27801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a22a01245fa75a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:17.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.618+0000 7fd27f7fe640 1 -- 172.21.15.45:0/716134881 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2780a8a30 con 0x7fd2800bc4a0 2023-10-03T19:17:17.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.618+0000 7fd27f7fe640 1 -- 172.21.15.45:0/716134881 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2780a8b90 con 0x7fd2800bc4a0 2023-10-03T19:17:17.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.618+0000 7fd27f7fe640 1 -- 172.21.15.45:0/716134881 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2780b0440 con 0x7fd2800bc4a0 2023-10-03T19:17:17.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.622+0000 7fd286b54640 1 -- 172.21.15.45:0/716134881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2800bc4a0 msgr2=0x7fd28006c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:17.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.622+0000 7fd286b54640 1 --2- 172.21.15.45:0/716134881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2800bc4a0 0x7fd28006c9a0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fd278009870 tx=0x7fd27801ed30 comp rx=0 tx=0).stop 2023-10-03T19:17:17.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.622+0000 7fd286b54640 1 -- 172.21.15.45:0/716134881 shutdown_connections 2023-10-03T19:17:17.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.622+0000 7fd286b54640 1 --2- 172.21.15.45:0/716134881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2800bc4a0 0x7fd28006c9a0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:17.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.622+0000 7fd286b54640 1 --2- 172.21.15.45:0/716134881 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd280148b90 0x7fd2800bbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:17.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.622+0000 7fd286b54640 1 -- 172.21.15.45:0/716134881 >> 172.21.15.45:0/716134881 conn(0x7fd2800bcf50 msgr2=0x7fd2800bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:17.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.622+0000 7fd286b54640 1 -- 172.21.15.45:0/716134881 shutdown_connections 2023-10-03T19:17:17.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.622+0000 7fd286b54640 1 -- 172.21.15.45:0/716134881 wait complete. 2023-10-03T19:17:17.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.622+0000 7fd286b54640 1 Processor -- start 2023-10-03T19:17:17.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.622+0000 7fd286b54640 1 -- start start 2023-10-03T19:17:17.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.622+0000 7fd286b54640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2800bc4a0 0x7fd2800bd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:17.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.622+0000 7fd286b54640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd2800bcb60 0x7fd2800bf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:17.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.622+0000 7fd286b54640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd280148b90 0x7fd2800b9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:17.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.622+0000 7fd286b54640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28013d330 con 0x7fd280148b90 2023-10-03T19:17:17.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.622+0000 7fd286b54640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28014cea0 con 0x7fd2800bc4a0 2023-10-03T19:17:17.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.622+0000 7fd286b54640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28014f160 con 0x7fd2800bcb60 2023-10-03T19:17:17.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.622+0000 7fd2850f1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd280148b90 0x7fd2800b9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:17.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.626+0000 7fd2850f1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd280148b90 0x7fd2800b9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39236/0 (socket says 172.21.15.45:39236) 2023-10-03T19:17:17.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.626+0000 7fd2850f1640 1 -- 172.21.15.45:0/3586807919 learned_addr learned my addr 172.21.15.45:0/3586807919 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:17.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.626+0000 7fd2848f0640 1 --2- 172.21.15.45:0/3586807919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2800bc4a0 0x7fd2800bd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:17.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.626+0000 7fd27ffff640 1 --2- 172.21.15.45:0/3586807919 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd2800bcb60 0x7fd2800bf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:17.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.626+0000 7fd2850f1640 1 -- 172.21.15.45:0/3586807919 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd2800bcb60 msgr2=0x7fd2800bf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:17.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.626+0000 7fd2850f1640 1 --2- 172.21.15.45:0/3586807919 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd2800bcb60 0x7fd2800bf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:17.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.626+0000 7fd2850f1640 1 -- 172.21.15.45:0/3586807919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2800bc4a0 msgr2=0x7fd2800bd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:17.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.626+0000 7fd2850f1640 1 --2- 172.21.15.45:0/3586807919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2800bc4a0 0x7fd2800bd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:17.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.626+0000 7fd2850f1640 1 -- 172.21.15.45:0/3586807919 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2780094d0 con 0x7fd280148b90 2023-10-03T19:17:17.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.626+0000 7fd2850f1640 1 --2- 172.21.15.45:0/3586807919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd280148b90 0x7fd2800b9750 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd2780b3040 tx=0x7fd27801bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:17.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.626+0000 7fd27d7fa640 1 -- 172.21.15.45:0/3586807919 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2780ba600 con 0x7fd280148b90 2023-10-03T19:17:17.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.626+0000 7fd27d7fa640 1 -- 172.21.15.45:0/3586807919 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2780ba760 con 0x7fd280148b90 2023-10-03T19:17:17.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.626+0000 7fd286b54640 1 -- 172.21.15.45:0/3586807919 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd28006cee0 con 0x7fd280148b90 2023-10-03T19:17:17.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.626+0000 7fd27d7fa640 1 -- 172.21.15.45:0/3586807919 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2780baaf0 con 0x7fd280148b90 2023-10-03T19:17:17.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.626+0000 7fd286b54640 1 -- 172.21.15.45:0/3586807919 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2800a5820 con 0x7fd280148b90 2023-10-03T19:17:17.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.626+0000 7fd286b54640 1 -- 172.21.15.45:0/3586807919 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd280148f60 con 0x7fd280148b90 2023-10-03T19:17:17.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.626+0000 7fd27d7fa640 1 -- 172.21.15.45:0/3586807919 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd2780bac50 con 0x7fd280148b90 2023-10-03T19:17:17.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.626+0000 7fd27d7fa640 1 --2- 172.21.15.45:0/3586807919 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd26c0662b0 0x7fd26c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:17.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.626+0000 7fd27d7fa640 1 -- 172.21.15.45:0/3586807919 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fd278122b00 con 0x7fd280148b90 2023-10-03T19:17:17.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.626+0000 7fd2848f0640 1 --2- 172.21.15.45:0/3586807919 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd26c0662b0 0x7fd26c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:17.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.630+0000 7fd2848f0640 1 --2- 172.21.15.45:0/3586807919 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd26c0662b0 0x7fd26c068760 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd270009fd0 tx=0x7fd270009800 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:17.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.634+0000 7fd27d7fa640 1 -- 172.21.15.45:0/3586807919 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd2780f0230 con 0x7fd280148b90 2023-10-03T19:17:17.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.814+0000 7fd286b54640 1 -- 172.21.15.45:0/3586807919 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd28004de80 con 0x7fd280148b90 2023-10-03T19:17:17.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.818+0000 7fd27d7fa640 1 -- 172.21.15.45:0/3586807919 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+18484 (secure 0 0 0) 0x7fd2780f3850 con 0x7fd280148b90 2023-10-03T19:17:17.818 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:17:17.818 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":63,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:17:14.698087+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:16:44.176075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-03T19:16:45.307579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.d","mappings":[{"from":7,"to":2}]},{"pgid":"10.c","mappings":[{"from":7,"to":3}]},{"pgid":"10.10","mappings":[{"from":4,"to":3}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]},{"pgid":"10.37","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:17:17.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.818+0000 7fd286b54640 1 -- 172.21.15.45:0/3586807919 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd26c0662b0 msgr2=0x7fd26c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:17.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.818+0000 7fd286b54640 1 --2- 172.21.15.45:0/3586807919 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd26c0662b0 0x7fd26c068760 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd270009fd0 tx=0x7fd270009800 comp rx=0 tx=0).stop 2023-10-03T19:17:17.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.818+0000 7fd286b54640 1 -- 172.21.15.45:0/3586807919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd280148b90 msgr2=0x7fd2800b9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:17.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.818+0000 7fd286b54640 1 --2- 172.21.15.45:0/3586807919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd280148b90 0x7fd2800b9750 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd2780b3040 tx=0x7fd27801bad0 comp rx=0 tx=0).stop 2023-10-03T19:17:17.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.818+0000 7fd286b54640 1 -- 172.21.15.45:0/3586807919 shutdown_connections 2023-10-03T19:17:17.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.818+0000 7fd286b54640 1 --2- 172.21.15.45:0/3586807919 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd26c0662b0 0x7fd26c068760 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:17.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.818+0000 7fd286b54640 1 --2- 172.21.15.45:0/3586807919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd280148b90 0x7fd2800b9750 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:17.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.818+0000 7fd286b54640 1 --2- 172.21.15.45:0/3586807919 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd2800bcb60 0x7fd2800bf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:17.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.818+0000 7fd286b54640 1 --2- 172.21.15.45:0/3586807919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2800bc4a0 0x7fd2800bd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:17.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.818+0000 7fd286b54640 1 -- 172.21.15.45:0/3586807919 >> 172.21.15.45:0/3586807919 conn(0x7fd2800bcf50 msgr2=0x7fd2801491e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:17.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.818+0000 7fd286b54640 1 -- 172.21.15.45:0/3586807919 shutdown_connections 2023-10-03T19:17:17.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.818+0000 7fd286b54640 1 -- 172.21.15.45:0/3586807919 wait complete. 2023-10-03T19:17:17.837 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T19:16:44.176075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T19:16:45.307579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:17:17.837 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:17:17.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.966+0000 7fd7ad5e4640 1 Processor -- start 2023-10-03T19:17:17.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.966+0000 7fd7ad5e4640 1 -- start start 2023-10-03T19:17:17.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd7ad5e4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd7a806ca90 0x7fd7a80b6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:17.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd7ad5e4640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a814c8c0 con 0x7fd7a80bc800 2023-10-03T19:17:17.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd7ad5e4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a814cba0 con 0x7fd7a80bbb70 2023-10-03T19:17:17.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd7ad5e4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7a814d680 con 0x7fd7a806ca90 2023-10-03T19:17:17.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd79e7fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd7a80bc800 0x7fd7a806c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34544/0 (socket says 172.21.15.45:34544) 2023-10-03T19:17:17.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd79e7fc640 1 -- 172.21.15.45:0/681005450 learned_addr learned my addr 172.21.15.45:0/681005450 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:17.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd7a77fe640 1 --2- 172.21.15.45:0/681005450 >> v2:172.21.15.79:3300/0 conn(0x7fd7a806ca90 0x7fd7a80b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:17.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd7a67fc640 1 -- 172.21.15.45:0/681005450 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3484068590 0 0) 0x7fd7a814c8c0 con 0x7fd7a80bc800 2023-10-03T19:17:17.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd7a67fc640 1 -- 172.21.15.45:0/681005450 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd794003530 con 0x7fd7a80bc800 2023-10-03T19:17:17.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd7a67fc640 1 -- 172.21.15.45:0/681005450 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1206149373 0 0) 0x7fd794003530 con 0x7fd7a80bc800 2023-10-03T19:17:17.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd7a67fc640 1 -- 172.21.15.45:0/681005450 >> v2:172.21.15.79:3300/0 conn(0x7fd7a806ca90 msgr2=0x7fd7a80b6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:17.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd7a67fc640 1 --2- 172.21.15.45:0/681005450 >> v2:172.21.15.79:3300/0 conn(0x7fd7a806ca90 0x7fd7a80b6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:17.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd7a67fc640 1 -- 172.21.15.45:0/681005450 >> v1:172.21.15.79:6789/0 conn(0x7fd7a80bbb70 legacy=0x7fd7a8149b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:17.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd7a67fc640 1 -- 172.21.15.45:0/681005450 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a814ce80 con 0x7fd7a80bc800 2023-10-03T19:17:17.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd7a67fc640 1 -- 172.21.15.45:0/681005450 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fd790001680 con 0x7fd7a80bc800 2023-10-03T19:17:17.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd7a67fc640 1 -- 172.21.15.45:0/681005450 >> v1:172.21.15.45:6789/0 conn(0x7fd7a80bc800 legacy=0x7fd7a806c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:17.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd7a67fc640 1 --2- 172.21.15.45:0/681005450 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd794003980 0x7fd794003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:17.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd7a67fc640 1 --2- 172.21.15.45:0/681005450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7940047d0 0x7fd794004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:17.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd7a67fc640 1 --2- 172.21.15.45:0/681005450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd794005180 0x7fd79400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:17.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd7a67fc640 1 -- 172.21.15.45:0/681005450 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a814d680 con 0x7fd794005180 2023-10-03T19:17:17.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd7a67fc640 1 -- 172.21.15.45:0/681005450 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79400c090 con 0x7fd7940047d0 2023-10-03T19:17:17.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd7a67fc640 1 -- 172.21.15.45:0/681005450 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79400c250 con 0x7fd794003980 2023-10-03T19:17:17.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd7a77fe640 1 --2- 172.21.15.45:0/681005450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd794005180 0x7fd79400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:17.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd79e7fc640 1 --2- 172.21.15.45:0/681005450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7940047d0 0x7fd794004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:17.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd7a6ffd640 1 --2- 172.21.15.45:0/681005450 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd794003980 0x7fd794003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:17.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd7a77fe640 1 -- 172.21.15.45:0/681005450 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd794003980 msgr2=0x7fd794003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:17.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd7a77fe640 1 --2- 172.21.15.45:0/681005450 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd794003980 0x7fd794003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:17.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd7a77fe640 1 -- 172.21.15.45:0/681005450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7940047d0 msgr2=0x7fd794004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:17.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd7a77fe640 1 --2- 172.21.15.45:0/681005450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7940047d0 0x7fd794004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:17.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd7a77fe640 1 -- 172.21.15.45:0/681005450 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd794003530 con 0x7fd794005180 2023-10-03T19:17:17.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.970+0000 7fd7a6ffd640 1 --2- 172.21.15.45:0/681005450 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd794003980 0x7fd794003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:17.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7a77fe640 1 -- 172.21.15.45:0/681005450 reap_dead start 2023-10-03T19:17:17.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7a77fe640 1 --2- 172.21.15.45:0/681005450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd794005180 0x7fd79400b990 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009fc0 tx=0x7fd7a001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b627d7cb0bc1b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:17.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7a67fc640 1 -- 172.21.15.45:0/681005450 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0003ba0 con 0x7fd794005180 2023-10-03T19:17:17.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7a67fc640 1 -- 172.21.15.45:0/681005450 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a000f040 con 0x7fd794005180 2023-10-03T19:17:17.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7a67fc640 1 -- 172.21.15.45:0/681005450 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a00a59a0 con 0x7fd794005180 2023-10-03T19:17:17.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7ad5e4640 1 -- 172.21.15.45:0/681005450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd794005180 msgr2=0x7fd79400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:17.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7ad5e4640 1 --2- 172.21.15.45:0/681005450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd794005180 0x7fd79400b990 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009fc0 tx=0x7fd7a001cca0 comp rx=0 tx=0).stop 2023-10-03T19:17:17.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7ad5e4640 1 -- 172.21.15.45:0/681005450 shutdown_connections 2023-10-03T19:17:17.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7ad5e4640 1 --2- 172.21.15.45:0/681005450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd794005180 0x7fd79400b990 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:17.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7ad5e4640 1 -- 172.21.15.45:0/681005450 >> 172.21.15.45:0/681005450 conn(0x7fd7a80c0d00 msgr2=0x7fd7a80c1100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:17.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7ad5e4640 1 -- 172.21.15.45:0/681005450 shutdown_connections 2023-10-03T19:17:17.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7ad5e4640 1 -- 172.21.15.45:0/681005450 wait complete. 2023-10-03T19:17:17.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7ad5e4640 1 Processor -- start 2023-10-03T19:17:17.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7ad5e4640 1 -- start start 2023-10-03T19:17:17.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7ad5e4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd794005180 0x7fd7a80b83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:17.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7ad5e4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7a80b7d20 0x7fd7a80ba470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:17.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7ad5e4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd7a81e7160 0x7fd7a80b96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:17.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7ad5e4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a81e7d90 con 0x7fd794005180 2023-10-03T19:17:17.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7ad5e4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a80a6a00 con 0x7fd7a80b7d20 2023-10-03T19:17:17.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7ad5e4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a81e7a20 con 0x7fd7a81e7160 2023-10-03T19:17:17.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7a6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd794005180 0x7fd7a80b83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:17.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7a6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd794005180 0x7fd7a80b83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39248/0 (socket says 172.21.15.45:39248) 2023-10-03T19:17:17.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7a6ffd640 1 -- 172.21.15.45:0/4096905685 learned_addr learned my addr 172.21.15.45:0/4096905685 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:17.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd79e7fc640 1 --2- 172.21.15.45:0/4096905685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7a80b7d20 0x7fd7a80ba470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:17.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7a77fe640 1 --2- 172.21.15.45:0/4096905685 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd7a81e7160 0x7fd7a80b96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:17.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7a6ffd640 1 -- 172.21.15.45:0/4096905685 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd7a81e7160 msgr2=0x7fd7a80b96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:17.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7a6ffd640 1 --2- 172.21.15.45:0/4096905685 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd7a81e7160 0x7fd7a80b96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:17.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7a6ffd640 1 -- 172.21.15.45:0/4096905685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7a80b7d20 msgr2=0x7fd7a80ba470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:17.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7a6ffd640 1 --2- 172.21.15.45:0/4096905685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7a80b7d20 0x7fd7a80ba470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:17.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7a6ffd640 1 -- 172.21.15.45:0/4096905685 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a80bc320 con 0x7fd794005180 2023-10-03T19:17:17.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7a77fe640 1 --2- 172.21.15.45:0/4096905685 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd7a81e7160 0x7fd7a80b96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:17.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.974+0000 7fd7a6ffd640 1 --2- 172.21.15.45:0/4096905685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd794005180 0x7fd7a80b83e0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd79800d770 tx=0x7fd79800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:17.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.978+0000 7fd79ffff640 1 -- 172.21.15.45:0/4096905685 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd798005270 con 0x7fd794005180 2023-10-03T19:17:17.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.978+0000 7fd79ffff640 1 -- 172.21.15.45:0/4096905685 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7980053d0 con 0x7fd794005180 2023-10-03T19:17:17.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.978+0000 7fd7ad5e4640 1 -- 172.21.15.45:0/4096905685 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a814d160 con 0x7fd794005180 2023-10-03T19:17:17.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.978+0000 7fd79ffff640 1 -- 172.21.15.45:0/4096905685 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79800b8f0 con 0x7fd794005180 2023-10-03T19:17:17.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.978+0000 7fd7ad5e4640 1 -- 172.21.15.45:0/4096905685 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a80bbf40 con 0x7fd794005180 2023-10-03T19:17:17.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.978+0000 7fd7ad5e4640 1 -- 172.21.15.45:0/4096905685 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7a81e7be0 con 0x7fd794005180 2023-10-03T19:17:17.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.978+0000 7fd79ffff640 1 -- 172.21.15.45:0/4096905685 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd79800ba50 con 0x7fd794005180 2023-10-03T19:17:17.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.978+0000 7fd79ffff640 1 --2- 172.21.15.45:0/4096905685 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd788066280 0x7fd788068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:17.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.978+0000 7fd79ffff640 1 -- 172.21.15.45:0/4096905685 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fd798083c90 con 0x7fd794005180 2023-10-03T19:17:17.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.978+0000 7fd79e7fc640 1 --2- 172.21.15.45:0/4096905685 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd788066280 0x7fd788068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:17.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.978+0000 7fd79e7fc640 1 --2- 172.21.15.45:0/4096905685 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd788066280 0x7fd788068730 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd7a80c15b0 tx=0x7fd790009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:17.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:17.982+0000 7fd79ffff640 1 -- 172.21.15.45:0/4096905685 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd798051110 con 0x7fd794005180 2023-10-03T19:17:18.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.138+0000 7fd7ad5e4640 1 -- 172.21.15.45:0/4096905685 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd7a80b6c70 con 0x7fd794005180 2023-10-03T19:17:18.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.138+0000 7fd79ffff640 1 -- 172.21.15.45:0/4096905685 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v63) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd798054730 con 0x7fd794005180 2023-10-03T19:17:18.139 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:17:18.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.138+0000 7fd7ad5e4640 1 -- 172.21.15.45:0/4096905685 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd788066280 msgr2=0x7fd788068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:18.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.138+0000 7fd7ad5e4640 1 --2- 172.21.15.45:0/4096905685 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd788066280 0x7fd788068730 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd7a80c15b0 tx=0x7fd790009040 comp rx=0 tx=0).stop 2023-10-03T19:17:18.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.138+0000 7fd7ad5e4640 1 -- 172.21.15.45:0/4096905685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd794005180 msgr2=0x7fd7a80b83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:18.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.138+0000 7fd7ad5e4640 1 --2- 172.21.15.45:0/4096905685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd794005180 0x7fd7a80b83e0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd79800d770 tx=0x7fd79800dc30 comp rx=0 tx=0).stop 2023-10-03T19:17:18.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.138+0000 7fd7ad5e4640 1 -- 172.21.15.45:0/4096905685 shutdown_connections 2023-10-03T19:17:18.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.138+0000 7fd7ad5e4640 1 --2- 172.21.15.45:0/4096905685 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd788066280 0x7fd788068730 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:18.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.138+0000 7fd7ad5e4640 1 --2- 172.21.15.45:0/4096905685 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd7a81e7160 0x7fd7a80b96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:18.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.138+0000 7fd7ad5e4640 1 --2- 172.21.15.45:0/4096905685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7a80b7d20 0x7fd7a80ba470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:18.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.138+0000 7fd7ad5e4640 1 --2- 172.21.15.45:0/4096905685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd794005180 0x7fd7a80b83e0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:18.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.138+0000 7fd7ad5e4640 1 -- 172.21.15.45:0/4096905685 >> 172.21.15.45:0/4096905685 conn(0x7fd7a80c0d00 msgr2=0x7fd7a80c0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:18.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.138+0000 7fd7ad5e4640 1 -- 172.21.15.45:0/4096905685 shutdown_connections 2023-10-03T19:17:18.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.138+0000 7fd7ad5e4640 1 -- 172.21.15.45:0/4096905685 wait complete. 2023-10-03T19:17:18.159 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:17:18.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306c292640 1 Processor -- start 2023-10-03T19:17:18.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306c292640 1 -- start start 2023-10-03T19:17:18.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306c292640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30640712c0 0x7f30640bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:18.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306c292640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f306406c2d0 con 0x7f306406c760 2023-10-03T19:17:18.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306c292640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3064150610 con 0x7f306406d560 2023-10-03T19:17:18.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306c292640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30641508b0 con 0x7f30640712c0 2023-10-03T19:17:18.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306a82f640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f306406c760 0x7f30640a5ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34560/0 (socket says 172.21.15.45:34560) 2023-10-03T19:17:18.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306a82f640 1 -- 172.21.15.45:0/1265612281 learned_addr learned my addr 172.21.15.45:0/1265612281 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:18.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306a02e640 1 --2- 172.21.15.45:0/1265612281 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30640712c0 0x7f30640bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:18.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306902c640 1 -- 172.21.15.45:0/1265612281 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2362946430 0 0) 0x7f306406c2d0 con 0x7f306406c760 2023-10-03T19:17:18.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306902c640 1 -- 172.21.15.45:0/1265612281 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3050003530 con 0x7f306406c760 2023-10-03T19:17:18.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306902c640 1 -- 172.21.15.45:0/1265612281 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1169465081 0 0) 0x7f3050003530 con 0x7f306406c760 2023-10-03T19:17:18.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306902c640 1 -- 172.21.15.45:0/1265612281 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30640712c0 msgr2=0x7f30640bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:18.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306902c640 1 --2- 172.21.15.45:0/1265612281 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30640712c0 0x7f30640bcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:18.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306902c640 1 -- 172.21.15.45:0/1265612281 >> v1:172.21.15.79:6789/0 conn(0x7f306406d560 legacy=0x7f30640a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:18.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306902c640 1 -- 172.21.15.45:0/1265612281 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306406d2e0 con 0x7f306406c760 2023-10-03T19:17:18.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306902c640 1 -- 172.21.15.45:0/1265612281 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f305c001a00 con 0x7f306406c760 2023-10-03T19:17:18.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306902c640 1 -- 172.21.15.45:0/1265612281 >> v1:172.21.15.45:6789/0 conn(0x7f306406c760 legacy=0x7f30640a5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:18.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306902c640 1 --2- 172.21.15.45:0/1265612281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30500039b0 0x7f3050003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:18.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306902c640 1 --2- 172.21.15.45:0/1265612281 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30640712c0 0x7f30500047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:18.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306902c640 1 --2- 172.21.15.45:0/1265612281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3050004d10 0x7f3050005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:18.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306902c640 1 -- 172.21.15.45:0/1265612281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30641508b0 con 0x7f3050004d10 2023-10-03T19:17:18.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306902c640 1 -- 172.21.15.45:0/1265612281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305000b990 con 0x7f30500039b0 2023-10-03T19:17:18.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306902c640 1 -- 172.21.15.45:0/1265612281 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305000bb20 con 0x7f30640712c0 2023-10-03T19:17:18.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306a82f640 1 --2- 172.21.15.45:0/1265612281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3050004d10 0x7f3050005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:18.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306a02e640 1 --2- 172.21.15.45:0/1265612281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30500039b0 0x7f3050003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:18.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306982d640 1 --2- 172.21.15.45:0/1265612281 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30640712c0 0x7f30500047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:18.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306a82f640 1 -- 172.21.15.45:0/1265612281 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30640712c0 msgr2=0x7f30500047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:18.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306a82f640 1 --2- 172.21.15.45:0/1265612281 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30640712c0 0x7f30500047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:18.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306a82f640 1 -- 172.21.15.45:0/1265612281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30500039b0 msgr2=0x7f3050003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:18.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306a82f640 1 --2- 172.21.15.45:0/1265612281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30500039b0 0x7f3050003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:18.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306a82f640 1 -- 172.21.15.45:0/1265612281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3050003530 con 0x7f3050004d10 2023-10-03T19:17:18.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.282+0000 7f306982d640 1 --2- 172.21.15.45:0/1265612281 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30640712c0 0x7f30500047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:17:18.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.286+0000 7f306a82f640 1 --2- 172.21.15.45:0/1265612281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3050004d10 0x7f3050005180 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f306406cbc0 tx=0x7f305c01fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bfdaa1a25608297 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:18.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.286+0000 7f306902c640 1 -- 172.21.15.45:0/1265612281 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c0aa690 con 0x7f3050004d10 2023-10-03T19:17:18.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.286+0000 7f306902c640 1 -- 172.21.15.45:0/1265612281 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305c0aa810 con 0x7f3050004d10 2023-10-03T19:17:18.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.286+0000 7f306902c640 1 -- 172.21.15.45:0/1265612281 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c0aabc0 con 0x7f3050004d10 2023-10-03T19:17:18.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.286+0000 7f306c292640 1 -- 172.21.15.45:0/1265612281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3050004d10 msgr2=0x7f3050005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:18.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.286+0000 7f306c292640 1 --2- 172.21.15.45:0/1265612281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3050004d10 0x7f3050005180 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f306406cbc0 tx=0x7f305c01fa60 comp rx=0 tx=0).stop 2023-10-03T19:17:18.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.286+0000 7f306a82f640 1 -- 172.21.15.45:0/1265612281 reap_dead start 2023-10-03T19:17:18.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.286+0000 7f306c292640 1 -- 172.21.15.45:0/1265612281 shutdown_connections 2023-10-03T19:17:18.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.286+0000 7f306c292640 1 -- 172.21.15.45:0/1265612281 >> 172.21.15.45:0/1265612281 conn(0x7f30640a20d0 msgr2=0x7f30640a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:18.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.286+0000 7f306c292640 1 -- 172.21.15.45:0/1265612281 shutdown_connections 2023-10-03T19:17:18.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.286+0000 7f306c292640 1 -- 172.21.15.45:0/1265612281 wait complete. 2023-10-03T19:17:18.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.286+0000 7f306c292640 1 Processor -- start 2023-10-03T19:17:18.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.286+0000 7f306c292640 1 -- start start 2023-10-03T19:17:18.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.290+0000 7f306c292640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30640b9cd0 0x7f306414b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:18.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.290+0000 7f306c292640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30640ba0a0 0x7f306414b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:18.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.290+0000 7f306c292640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f306414c880 0x7f3064145860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:18.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.290+0000 7f306c292640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306414f3e0 con 0x7f306414c880 2023-10-03T19:17:18.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.290+0000 7f306c292640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306414bf30 con 0x7f30640ba0a0 2023-10-03T19:17:18.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.290+0000 7f306c292640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306414edb0 con 0x7f30640b9cd0 2023-10-03T19:17:18.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.290+0000 7f306a82f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f306414c880 0x7f3064145860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:18.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.290+0000 7f306a82f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f306414c880 0x7f3064145860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39258/0 (socket says 172.21.15.45:39258) 2023-10-03T19:17:18.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.290+0000 7f306a82f640 1 -- 172.21.15.45:0/101656263 learned_addr learned my addr 172.21.15.45:0/101656263 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:18.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.290+0000 7f306982d640 1 --2- 172.21.15.45:0/101656263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30640ba0a0 0x7f306414b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:18.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.290+0000 7f306a02e640 1 --2- 172.21.15.45:0/101656263 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30640b9cd0 0x7f306414b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:18.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.290+0000 7f306a82f640 1 -- 172.21.15.45:0/101656263 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30640b9cd0 msgr2=0x7f306414b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:18.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.290+0000 7f306a82f640 1 --2- 172.21.15.45:0/101656263 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30640b9cd0 0x7f306414b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:18.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.290+0000 7f306a82f640 1 -- 172.21.15.45:0/101656263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30640ba0a0 msgr2=0x7f306414b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:18.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.290+0000 7f306a82f640 1 --2- 172.21.15.45:0/101656263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30640ba0a0 0x7f306414b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:18.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.290+0000 7f306a82f640 1 -- 172.21.15.45:0/101656263 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3064071690 con 0x7f306414c880 2023-10-03T19:17:18.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.290+0000 7f306a82f640 1 --2- 172.21.15.45:0/101656263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f306414c880 0x7f3064145860 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f305c09c1a0 tx=0x7f305c01c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:18.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.290+0000 7f305affd640 1 -- 172.21.15.45:0/101656263 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c001210 con 0x7f306414c880 2023-10-03T19:17:18.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.290+0000 7f305affd640 1 -- 172.21.15.45:0/101656263 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305c0aa690 con 0x7f306414c880 2023-10-03T19:17:18.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.290+0000 7f306c292640 1 -- 172.21.15.45:0/101656263 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f306406cf40 con 0x7f306414c880 2023-10-03T19:17:18.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.290+0000 7f305affd640 1 -- 172.21.15.45:0/101656263 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c0019c0 con 0x7f306414c880 2023-10-03T19:17:18.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.290+0000 7f306c292640 1 -- 172.21.15.45:0/101656263 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3064071820 con 0x7f306414c880 2023-10-03T19:17:18.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.290+0000 7f306c292640 1 -- 172.21.15.45:0/101656263 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306404de80 con 0x7f306414c880 2023-10-03T19:17:18.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.290+0000 7f305affd640 1 -- 172.21.15.45:0/101656263 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f305c0ab470 con 0x7f306414c880 2023-10-03T19:17:18.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.290+0000 7f305affd640 1 --2- 172.21.15.45:0/101656263 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3048066280 0x7f3048068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:18.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.290+0000 7f305affd640 1 -- 172.21.15.45:0/101656263 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f305c121830 con 0x7f306414c880 2023-10-03T19:17:18.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.290+0000 7f306a02e640 1 --2- 172.21.15.45:0/101656263 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3048066280 0x7f3048068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:18.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.294+0000 7f306a02e640 1 --2- 172.21.15.45:0/101656263 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3048066280 0x7f3048068730 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3060009aa0 tx=0x7f3060008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:18.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.294+0000 7f305affd640 1 -- 172.21.15.45:0/101656263 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f305c0eecb0 con 0x7f306414c880 2023-10-03T19:17:18.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.450+0000 7f306c292640 1 -- 172.21.15.45:0/101656263 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f30640ba5a0 con 0x7f306414c880 2023-10-03T19:17:18.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.454+0000 7f305affd640 1 -- 172.21.15.45:0/101656263 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v63) v1 ==== 92+0+10 (secure 0 0 0) 0x7f305c0aae60 con 0x7f306414c880 2023-10-03T19:17:18.455 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:17:18.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.458+0000 7f306c292640 1 -- 172.21.15.45:0/101656263 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3048066280 msgr2=0x7f3048068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:18.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.458+0000 7f306c292640 1 --2- 172.21.15.45:0/101656263 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3048066280 0x7f3048068730 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3060009aa0 tx=0x7f3060008040 comp rx=0 tx=0).stop 2023-10-03T19:17:18.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.458+0000 7f306c292640 1 -- 172.21.15.45:0/101656263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f306414c880 msgr2=0x7f3064145860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:18.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.458+0000 7f306c292640 1 --2- 172.21.15.45:0/101656263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f306414c880 0x7f3064145860 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f305c09c1a0 tx=0x7f305c01c800 comp rx=0 tx=0).stop 2023-10-03T19:17:18.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.458+0000 7f306c292640 1 -- 172.21.15.45:0/101656263 shutdown_connections 2023-10-03T19:17:18.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.458+0000 7f306c292640 1 --2- 172.21.15.45:0/101656263 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3048066280 0x7f3048068730 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:18.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.458+0000 7f306c292640 1 --2- 172.21.15.45:0/101656263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f306414c880 0x7f3064145860 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:18.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.458+0000 7f306c292640 1 --2- 172.21.15.45:0/101656263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30640ba0a0 0x7f306414b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:18.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.458+0000 7f306c292640 1 --2- 172.21.15.45:0/101656263 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30640b9cd0 0x7f306414b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:18.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.458+0000 7f306c292640 1 -- 172.21.15.45:0/101656263 >> 172.21.15.45:0/101656263 conn(0x7f30640a20d0 msgr2=0x7f30640a5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:18.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.458+0000 7f306c292640 1 -- 172.21.15.45:0/101656263 shutdown_connections 2023-10-03T19:17:18.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.458+0000 7f306c292640 1 -- 172.21.15.45:0/101656263 wait complete. 2023-10-03T19:17:18.475 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T19:17:18.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.594+0000 7f8386fc8640 1 Processor -- start 2023-10-03T19:17:18.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.594+0000 7f8386fc8640 1 -- start start 2023-10-03T19:17:18.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.598+0000 7f8386fc8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f83800712c0 0x7f83800bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:18.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.598+0000 7f8386fc8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f838006d560 0x7f83800bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:18.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.598+0000 7f8386fc8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f838006c760 0x7f83800a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:18.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.598+0000 7f8386fc8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f838006c2d0 con 0x7f83800712c0 2023-10-03T19:17:18.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.598+0000 7f8386fc8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8380150610 con 0x7f838006d560 2023-10-03T19:17:18.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.598+0000 7f8386fc8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83801508b0 con 0x7f838006c760 2023-10-03T19:17:18.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.598+0000 7f8384d64640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f83800712c0 0x7f83800bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:18.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.598+0000 7f8384d64640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f83800712c0 0x7f83800bcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39270/0 (socket says 172.21.15.45:39270) 2023-10-03T19:17:18.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.598+0000 7f8384d64640 1 -- 172.21.15.45:0/998935000 learned_addr learned my addr 172.21.15.45:0/998935000 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:18.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.598+0000 7f837ffff640 1 --2- 172.21.15.45:0/998935000 >> v2:172.21.15.79:3300/0 conn(0x7f838006d560 0x7f83800bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:18.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.598+0000 7f8385565640 1 --2- 172.21.15.45:0/998935000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f838006c760 0x7f83800a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:18.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.598+0000 7f8384d64640 1 -- 172.21.15.45:0/998935000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f838006c760 msgr2=0x7f83800a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:18.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.598+0000 7f8384d64640 1 --2- 172.21.15.45:0/998935000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f838006c760 0x7f83800a53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:18.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.598+0000 7f8384d64640 1 -- 172.21.15.45:0/998935000 >> v2:172.21.15.79:3300/0 conn(0x7f838006d560 msgr2=0x7f83800bd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:18.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.598+0000 7f8384d64640 1 --2- 172.21.15.45:0/998935000 >> v2:172.21.15.79:3300/0 conn(0x7f838006d560 0x7f83800bd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:18.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.598+0000 7f8384d64640 1 -- 172.21.15.45:0/998935000 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838006d2e0 con 0x7f83800712c0 2023-10-03T19:17:18.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.598+0000 7f837ffff640 1 --2- 172.21.15.45:0/998935000 >> v2:172.21.15.79:3300/0 conn(0x7f838006d560 0x7f83800bd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:18.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.598+0000 7f8385565640 1 --2- 172.21.15.45:0/998935000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f838006c760 0x7f83800a53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:18.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.598+0000 7f8384d64640 1 --2- 172.21.15.45:0/998935000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83800712c0 0x7f83800bcbc0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f838006ba20 tx=0x7f837801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b1262c8dc136f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:18.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.598+0000 7f837f7fe640 1 -- 172.21.15.45:0/998935000 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83780a5790 con 0x7f83800712c0 2023-10-03T19:17:18.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.598+0000 7f837f7fe640 1 -- 172.21.15.45:0/998935000 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83780a58f0 con 0x7f83800712c0 2023-10-03T19:17:18.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.598+0000 7f837f7fe640 1 -- 172.21.15.45:0/998935000 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83780a5c80 con 0x7f83800712c0 2023-10-03T19:17:18.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.602+0000 7f8386fc8640 1 -- 172.21.15.45:0/998935000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83800712c0 msgr2=0x7f83800bcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:18.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.602+0000 7f8386fc8640 1 --2- 172.21.15.45:0/998935000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83800712c0 0x7f83800bcbc0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f838006ba20 tx=0x7f837801c9d0 comp rx=0 tx=0).stop 2023-10-03T19:17:18.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.602+0000 7f8386fc8640 1 -- 172.21.15.45:0/998935000 shutdown_connections 2023-10-03T19:17:18.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.602+0000 7f8386fc8640 1 --2- 172.21.15.45:0/998935000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f838006c760 0x7f83800a53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:18.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.602+0000 7f8386fc8640 1 --2- 172.21.15.45:0/998935000 >> v2:172.21.15.79:3300/0 conn(0x7f838006d560 0x7f83800bd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:18.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.602+0000 7f8386fc8640 1 --2- 172.21.15.45:0/998935000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83800712c0 0x7f83800bcbc0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:18.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.602+0000 7f8386fc8640 1 -- 172.21.15.45:0/998935000 >> 172.21.15.45:0/998935000 conn(0x7f83800a20d0 msgr2=0x7f83800a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:18.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.602+0000 7f8386fc8640 1 -- 172.21.15.45:0/998935000 shutdown_connections 2023-10-03T19:17:18.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.602+0000 7f8386fc8640 1 -- 172.21.15.45:0/998935000 wait complete. 2023-10-03T19:17:18.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.602+0000 7f8386fc8640 1 Processor -- start 2023-10-03T19:17:18.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.602+0000 7f8386fc8640 1 -- start start 2023-10-03T19:17:18.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.602+0000 7f8386fc8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f838006c760 0x7f8380070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:18.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.602+0000 7f8386fc8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f838006d560 0x7f83800b99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:18.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.602+0000 7f8386fc8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f83800712c0 0x7f8380143780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:18.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.602+0000 7f8386fc8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83800bfc40 con 0x7f838006d560 2023-10-03T19:17:18.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.602+0000 7f8386fc8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83800a1f80 con 0x7f838006c760 2023-10-03T19:17:18.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.602+0000 7f8386fc8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83801ea8c0 con 0x7f83800712c0 2023-10-03T19:17:18.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.602+0000 7f837ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f838006d560 0x7f83800b99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:18.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.602+0000 7f837ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f838006d560 0x7f83800b99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39274/0 (socket says 172.21.15.45:39274) 2023-10-03T19:17:18.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.602+0000 7f8384d64640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f838006c760 0x7f8380070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:18.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.602+0000 7f837ffff640 1 -- 172.21.15.45:0/3707518033 learned_addr learned my addr 172.21.15.45:0/3707518033 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:18.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.602+0000 7f8385565640 1 --2- 172.21.15.45:0/3707518033 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f83800712c0 0x7f8380143780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:18.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.602+0000 7f837ffff640 1 -- 172.21.15.45:0/3707518033 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f83800712c0 msgr2=0x7f8380143780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:18.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.602+0000 7f837ffff640 1 --2- 172.21.15.45:0/3707518033 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f83800712c0 0x7f8380143780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:18.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.602+0000 7f837ffff640 1 -- 172.21.15.45:0/3707518033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f838006c760 msgr2=0x7f8380070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:18.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.602+0000 7f837ffff640 1 --2- 172.21.15.45:0/3707518033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f838006c760 0x7f8380070620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:18.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.602+0000 7f837ffff640 1 -- 172.21.15.45:0/3707518033 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8378009b30 con 0x7f838006d560 2023-10-03T19:17:18.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.606+0000 7f837ffff640 1 --2- 172.21.15.45:0/3707518033 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f838006d560 0x7f83800b99b0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f837400c7c0 tx=0x7f837400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:18.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.606+0000 7f837d7fa640 1 -- 172.21.15.45:0/3707518033 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8374007a30 con 0x7f838006d560 2023-10-03T19:17:18.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.606+0000 7f837d7fa640 1 -- 172.21.15.45:0/3707518033 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8374007b90 con 0x7f838006d560 2023-10-03T19:17:18.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.606+0000 7f837d7fa640 1 -- 172.21.15.45:0/3707518033 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837400ce70 con 0x7f838006d560 2023-10-03T19:17:18.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.606+0000 7f8386fc8640 1 -- 172.21.15.45:0/3707518033 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f838014c780 con 0x7f838006d560 2023-10-03T19:17:18.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.606+0000 7f8386fc8640 1 -- 172.21.15.45:0/3707518033 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f838014c5f0 con 0x7f838006d560 2023-10-03T19:17:18.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.606+0000 7f8386fc8640 1 -- 172.21.15.45:0/3707518033 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f838014c910 con 0x7f838006d560 2023-10-03T19:17:18.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.606+0000 7f837d7fa640 1 -- 172.21.15.45:0/3707518033 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f83740113f0 con 0x7f838006d560 2023-10-03T19:17:18.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.606+0000 7f837d7fa640 1 --2- 172.21.15.45:0/3707518033 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f836c066280 0x7f836c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:18.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.606+0000 7f837d7fa640 1 -- 172.21.15.45:0/3707518033 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f83740841b0 con 0x7f838006d560 2023-10-03T19:17:18.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.606+0000 7f8384d64640 1 --2- 172.21.15.45:0/3707518033 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f836c066280 0x7f836c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:18.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.606+0000 7f8384d64640 1 --2- 172.21.15.45:0/3707518033 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f836c066280 0x7f836c068730 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f83780ae000 tx=0x7f83780a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:18.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.610+0000 7f837d7fa640 1 -- 172.21.15.45:0/3707518033 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8374051650 con 0x7f838006d560 2023-10-03T19:17:18.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.758+0000 7f8386fc8640 1 -- 172.21.15.45:0/3707518033 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f83800bca30 con 0x7f838006d560 2023-10-03T19:17:18.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.762+0000 7f837d7fa640 1 -- 172.21.15.45:0/3707518033 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v63) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8374054c70 con 0x7f838006d560 2023-10-03T19:17:18.762 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-03T19:17:18.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.762+0000 7f8386fc8640 1 -- 172.21.15.45:0/3707518033 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f836c066280 msgr2=0x7f836c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:18.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.762+0000 7f8386fc8640 1 --2- 172.21.15.45:0/3707518033 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f836c066280 0x7f836c068730 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f83780ae000 tx=0x7f83780a7070 comp rx=0 tx=0).stop 2023-10-03T19:17:18.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.762+0000 7f8386fc8640 1 -- 172.21.15.45:0/3707518033 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f838006d560 msgr2=0x7f83800b99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:18.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.762+0000 7f8386fc8640 1 --2- 172.21.15.45:0/3707518033 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f838006d560 0x7f83800b99b0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f837400c7c0 tx=0x7f837400cc80 comp rx=0 tx=0).stop 2023-10-03T19:17:18.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.762+0000 7f8386fc8640 1 -- 172.21.15.45:0/3707518033 shutdown_connections 2023-10-03T19:17:18.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.762+0000 7f8386fc8640 1 --2- 172.21.15.45:0/3707518033 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f836c066280 0x7f836c068730 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:18.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.762+0000 7f8386fc8640 1 --2- 172.21.15.45:0/3707518033 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f83800712c0 0x7f8380143780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:18.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.762+0000 7f8386fc8640 1 --2- 172.21.15.45:0/3707518033 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f838006d560 0x7f83800b99b0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:18.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.762+0000 7f8386fc8640 1 --2- 172.21.15.45:0/3707518033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f838006c760 0x7f8380070620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:18.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.762+0000 7f8386fc8640 1 -- 172.21.15.45:0/3707518033 >> 172.21.15.45:0/3707518033 conn(0x7f83800a20d0 msgr2=0x7f8380146e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:18.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.762+0000 7f8386fc8640 1 -- 172.21.15.45:0/3707518033 shutdown_connections 2023-10-03T19:17:18.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.762+0000 7f8386fc8640 1 -- 172.21.15.45:0/3707518033 wait complete. 2023-10-03T19:17:18.780 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T19:17:18.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a1bbd9640 1 Processor -- start 2023-10-03T19:17:18.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a1bbd9640 1 -- start start 2023-10-03T19:17:18.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a1bbd9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4a1414f510 0x7f4a1414b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:18.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a1bbd9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1414f080 con 0x7f4a140bd9f0 2023-10-03T19:17:18.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a1bbd9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a14070e90 con 0x7f4a1406f880 2023-10-03T19:17:18.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a1bbd9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1406f3e0 con 0x7f4a1414f510 2023-10-03T19:17:18.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a1a176640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4a140bd9f0 0x7f4a14155bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34574/0 (socket says 172.21.15.45:34574) 2023-10-03T19:17:18.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a1a176640 1 -- 172.21.15.45:0/2420841146 learned_addr learned my addr 172.21.15.45:0/2420841146 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:18.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a19174640 1 --2- 172.21.15.45:0/2420841146 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4a1414f510 0x7f4a1414b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:18.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a18973640 1 -- 172.21.15.45:0/2420841146 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3870500375 0 0) 0x7f4a1414f080 con 0x7f4a140bd9f0 2023-10-03T19:17:18.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a18973640 1 -- 172.21.15.45:0/2420841146 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a00005740 con 0x7f4a140bd9f0 2023-10-03T19:17:18.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a18973640 1 -- 172.21.15.45:0/2420841146 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 935986431 0 0) 0x7f4a00005740 con 0x7f4a140bd9f0 2023-10-03T19:17:18.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a18973640 1 -- 172.21.15.45:0/2420841146 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4a1414f510 msgr2=0x7f4a1414b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:18.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a18973640 1 --2- 172.21.15.45:0/2420841146 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4a1414f510 0x7f4a1414b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:18.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a18973640 1 -- 172.21.15.45:0/2420841146 >> v1:172.21.15.79:6789/0 conn(0x7f4a1406f880 legacy=0x7f4a140a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:18.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a18973640 1 -- 172.21.15.45:0/2420841146 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1414ea30 con 0x7f4a140bd9f0 2023-10-03T19:17:18.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a18973640 1 -- 172.21.15.45:0/2420841146 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f4a0c001a00 con 0x7f4a140bd9f0 2023-10-03T19:17:18.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a18973640 1 -- 172.21.15.45:0/2420841146 >> v1:172.21.15.45:6789/0 conn(0x7f4a140bd9f0 legacy=0x7f4a14155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:18.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a18973640 1 --2- 172.21.15.45:0/2420841146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a00005bc0 0x7f4a00005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:18.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a18973640 1 --2- 172.21.15.45:0/2420841146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a000069e0 0x7f4a00006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:18.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a18973640 1 --2- 172.21.15.45:0/2420841146 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4a1414f510 0x7f4a00007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:18.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a18973640 1 -- 172.21.15.45:0/2420841146 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1406f3e0 con 0x7f4a00005bc0 2023-10-03T19:17:18.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a18973640 1 -- 172.21.15.45:0/2420841146 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0000dc80 con 0x7f4a000069e0 2023-10-03T19:17:18.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a18973640 1 -- 172.21.15.45:0/2420841146 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0000de40 con 0x7f4a1414f510 2023-10-03T19:17:18.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a19975640 1 --2- 172.21.15.45:0/2420841146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a00005bc0 0x7f4a00005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:18.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a19975640 1 -- 172.21.15.45:0/2420841146 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4a1414f510 msgr2=0x7f4a00007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:18.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a19174640 1 --2- 172.21.15.45:0/2420841146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a000069e0 0x7f4a00006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:18.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a19975640 1 --2- 172.21.15.45:0/2420841146 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4a1414f510 0x7f4a00007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:18.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a19975640 1 -- 172.21.15.45:0/2420841146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a000069e0 msgr2=0x7f4a00006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:18.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a19975640 1 --2- 172.21.15.45:0/2420841146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a000069e0 0x7f4a00006e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:18.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.890+0000 7f4a19975640 1 -- 172.21.15.45:0/2420841146 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a00005740 con 0x7f4a00005bc0 2023-10-03T19:17:18.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.894+0000 7f4a19975640 1 --2- 172.21.15.45:0/2420841146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a00005bc0 0x7f4a00005fd0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f4a10001750 tx=0x7f4a1001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bca4e69ce9e39d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:18.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.894+0000 7f4a18973640 1 -- 172.21.15.45:0/2420841146 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a100052d0 con 0x7f4a00005bc0 2023-10-03T19:17:18.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.894+0000 7f4a18973640 1 -- 172.21.15.45:0/2420841146 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a100a7050 con 0x7f4a00005bc0 2023-10-03T19:17:18.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.894+0000 7f4a18973640 1 -- 172.21.15.45:0/2420841146 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10003600 con 0x7f4a00005bc0 2023-10-03T19:17:18.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.894+0000 7f4a1bbd9640 1 -- 172.21.15.45:0/2420841146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a00005bc0 msgr2=0x7f4a00005fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:18.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.894+0000 7f4a1bbd9640 1 --2- 172.21.15.45:0/2420841146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a00005bc0 0x7f4a00005fd0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f4a10001750 tx=0x7f4a1001c370 comp rx=0 tx=0).stop 2023-10-03T19:17:18.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.894+0000 7f4a1a176640 1 -- 172.21.15.45:0/2420841146 reap_dead start 2023-10-03T19:17:18.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.894+0000 7f4a1bbd9640 1 -- 172.21.15.45:0/2420841146 shutdown_connections 2023-10-03T19:17:18.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.894+0000 7f4a1bbd9640 1 -- 172.21.15.45:0/2420841146 >> 172.21.15.45:0/2420841146 conn(0x7f4a140a20d0 msgr2=0x7f4a140a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:18.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.894+0000 7f4a1bbd9640 1 -- 172.21.15.45:0/2420841146 shutdown_connections 2023-10-03T19:17:18.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.894+0000 7f4a1bbd9640 1 -- 172.21.15.45:0/2420841146 wait complete. 2023-10-03T19:17:18.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.894+0000 7f4a1bbd9640 1 Processor -- start 2023-10-03T19:17:18.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.894+0000 7f4a1bbd9640 1 -- start start 2023-10-03T19:17:18.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.894+0000 7f4a1bbd9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a00005bc0 0x7f4a141477a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:18.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.894+0000 7f4a1bbd9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a1413bcf0 0x7f4a1413c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:18.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.894+0000 7f4a1bbd9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4a1413c660 0x7f4a141e6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:18.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.894+0000 7f4a1bbd9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1414a6d0 con 0x7f4a00005bc0 2023-10-03T19:17:18.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.894+0000 7f4a1bbd9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a14147ce0 con 0x7f4a1413bcf0 2023-10-03T19:17:18.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.894+0000 7f4a1bbd9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1406ccc0 con 0x7f4a1413c660 2023-10-03T19:17:18.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.894+0000 7f4a19975640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a00005bc0 0x7f4a141477a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:18.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.894+0000 7f4a19975640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a00005bc0 0x7f4a141477a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39290/0 (socket says 172.21.15.45:39290) 2023-10-03T19:17:18.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.894+0000 7f4a19975640 1 -- 172.21.15.45:0/1519753135 learned_addr learned my addr 172.21.15.45:0/1519753135 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:18.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.894+0000 7f4a19174640 1 --2- 172.21.15.45:0/1519753135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a1413bcf0 0x7f4a1413c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:18.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.894+0000 7f4a1a176640 1 --2- 172.21.15.45:0/1519753135 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4a1413c660 0x7f4a141e6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:18.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.894+0000 7f4a19975640 1 -- 172.21.15.45:0/1519753135 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4a1413c660 msgr2=0x7f4a141e6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:18.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.894+0000 7f4a19975640 1 --2- 172.21.15.45:0/1519753135 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4a1413c660 0x7f4a141e6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:18.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.894+0000 7f4a19975640 1 -- 172.21.15.45:0/1519753135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a1413bcf0 msgr2=0x7f4a1413c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:18.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.894+0000 7f4a19975640 1 --2- 172.21.15.45:0/1519753135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a1413bcf0 0x7f4a1413c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:18.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.894+0000 7f4a19975640 1 -- 172.21.15.45:0/1519753135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a140a6050 con 0x7f4a00005bc0 2023-10-03T19:17:18.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.898+0000 7f4a19975640 1 --2- 172.21.15.45:0/1519753135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a00005bc0 0x7f4a141477a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4a10001750 tx=0x7f4a00007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:18.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.898+0000 7f4a0a7fc640 1 -- 172.21.15.45:0/1519753135 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10007180 con 0x7f4a00005bc0 2023-10-03T19:17:18.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.898+0000 7f4a0a7fc640 1 -- 172.21.15.45:0/1519753135 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a100072e0 con 0x7f4a00005bc0 2023-10-03T19:17:18.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.898+0000 7f4a1bbd9640 1 -- 172.21.15.45:0/1519753135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a1406fc50 con 0x7f4a00005bc0 2023-10-03T19:17:18.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.898+0000 7f4a0a7fc640 1 -- 172.21.15.45:0/1519753135 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10007670 con 0x7f4a00005bc0 2023-10-03T19:17:18.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.898+0000 7f4a1bbd9640 1 -- 172.21.15.45:0/1519753135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a140a61e0 con 0x7f4a00005bc0 2023-10-03T19:17:18.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.898+0000 7f4a1bbd9640 1 -- 172.21.15.45:0/1519753135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a1404de80 con 0x7f4a00005bc0 2023-10-03T19:17:18.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.898+0000 7f4a0a7fc640 1 -- 172.21.15.45:0/1519753135 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4a100067e0 con 0x7f4a00005bc0 2023-10-03T19:17:18.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.898+0000 7f4a0a7fc640 1 --2- 172.21.15.45:0/1519753135 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f49f8066280 0x7f49f8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:18.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.898+0000 7f4a0a7fc640 1 -- 172.21.15.45:0/1519753135 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f4a1011e130 con 0x7f4a00005bc0 2023-10-03T19:17:18.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.898+0000 7f4a19174640 1 --2- 172.21.15.45:0/1519753135 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f49f8066280 0x7f49f8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:18.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.898+0000 7f4a19174640 1 --2- 172.21.15.45:0/1519753135 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f49f8066280 0x7f49f8068730 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4a140ba5a0 tx=0x7f4a04008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:18.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:18.902+0000 7f4a0a7fc640 1 -- 172.21.15.45:0/1519753135 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4a100eefb0 con 0x7f4a00005bc0 2023-10-03T19:17:19.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.050+0000 7f4a1bbd9640 1 -- 172.21.15.45:0/1519753135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4a1413d140 con 0x7f4a00005bc0 2023-10-03T19:17:19.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.050+0000 7f4a0a7fc640 1 -- 172.21.15.45:0/1519753135 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v63) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4a100eeb40 con 0x7f4a00005bc0 2023-10-03T19:17:19.053 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-03T19:17:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.054+0000 7f4a1bbd9640 1 -- 172.21.15.45:0/1519753135 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f49f8066280 msgr2=0x7f49f8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.054+0000 7f4a1bbd9640 1 --2- 172.21.15.45:0/1519753135 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f49f8066280 0x7f49f8068730 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4a140ba5a0 tx=0x7f4a04008040 comp rx=0 tx=0).stop 2023-10-03T19:17:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.054+0000 7f4a1bbd9640 1 -- 172.21.15.45:0/1519753135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a00005bc0 msgr2=0x7f4a141477a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.054+0000 7f4a1bbd9640 1 --2- 172.21.15.45:0/1519753135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a00005bc0 0x7f4a141477a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4a10001750 tx=0x7f4a00007a10 comp rx=0 tx=0).stop 2023-10-03T19:17:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.054+0000 7f4a1bbd9640 1 -- 172.21.15.45:0/1519753135 shutdown_connections 2023-10-03T19:17:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.054+0000 7f4a1bbd9640 1 --2- 172.21.15.45:0/1519753135 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f49f8066280 0x7f49f8068730 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.054+0000 7f4a1bbd9640 1 --2- 172.21.15.45:0/1519753135 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4a1413c660 0x7f4a141e6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.054+0000 7f4a1bbd9640 1 --2- 172.21.15.45:0/1519753135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a1413bcf0 0x7f4a1413c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.054+0000 7f4a1bbd9640 1 --2- 172.21.15.45:0/1519753135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a00005bc0 0x7f4a141477a0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.054+0000 7f4a1bbd9640 1 -- 172.21.15.45:0/1519753135 >> 172.21.15.45:0/1519753135 conn(0x7f4a140a20d0 msgr2=0x7f4a14151240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:19.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.054+0000 7f4a1bbd9640 1 -- 172.21.15.45:0/1519753135 shutdown_connections 2023-10-03T19:17:19.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.054+0000 7f4a1bbd9640 1 -- 172.21.15.45:0/1519753135 wait complete. 2023-10-03T19:17:19.071 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-03T19:17:19.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd861eb2640 1 Processor -- start 2023-10-03T19:17:19.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd861eb2640 1 -- start start 2023-10-03T19:17:19.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd861eb2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd85c0a8320 0x7fd85c1504b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:19.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd861eb2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd85c06e450 0x7fd85c14c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:19.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd861eb2640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd85c0a86f0 con 0x7fd85c0bdf20 2023-10-03T19:17:19.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd861eb2640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd85c0bd9b0 con 0x7fd85c06e450 2023-10-03T19:17:19.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd861eb2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c1509f0 con 0x7fd85c0a8320 2023-10-03T19:17:19.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd85bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd85c0bdf20 0x7fd85c0bf0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34588/0 (socket says 172.21.15.45:34588) 2023-10-03T19:17:19.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd85bfff640 1 -- 172.21.15.45:0/1468977988 learned_addr learned my addr 172.21.15.45:0/1468977988 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:19.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd85b7fe640 1 --2- 172.21.15.45:0/1468977988 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd85c0a8320 0x7fd85c1504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:19.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd85affd640 1 --2- 172.21.15.45:0/1468977988 >> v2:172.21.15.79:3300/0 conn(0x7fd85c06e450 0x7fd85c14c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:19.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd85a7fc640 1 -- 172.21.15.45:0/1468977988 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1856766992 0 0) 0x7fd85c0a86f0 con 0x7fd85c0bdf20 2023-10-03T19:17:19.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd85a7fc640 1 -- 172.21.15.45:0/1468977988 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd844003530 con 0x7fd85c0bdf20 2023-10-03T19:17:19.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd85a7fc640 1 -- 172.21.15.45:0/1468977988 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3217260043 0 0) 0x7fd844003530 con 0x7fd85c0bdf20 2023-10-03T19:17:19.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd85a7fc640 1 -- 172.21.15.45:0/1468977988 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd85c0a8320 msgr2=0x7fd85c1504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd85a7fc640 1 --2- 172.21.15.45:0/1468977988 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd85c0a8320 0x7fd85c1504b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd85a7fc640 1 -- 172.21.15.45:0/1468977988 >> v2:172.21.15.79:3300/0 conn(0x7fd85c06e450 msgr2=0x7fd85c14c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd85a7fc640 1 --2- 172.21.15.45:0/1468977988 >> v2:172.21.15.79:3300/0 conn(0x7fd85c06e450 0x7fd85c14c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd85a7fc640 1 -- 172.21.15.45:0/1468977988 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85c0bd6d0 con 0x7fd85c0bdf20 2023-10-03T19:17:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd85a7fc640 1 -- 172.21.15.45:0/1468977988 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fd854001a00 con 0x7fd85c0bdf20 2023-10-03T19:17:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd85a7fc640 1 -- 172.21.15.45:0/1468977988 >> v1:172.21.15.45:6789/0 conn(0x7fd85c0bdf20 legacy=0x7fd85c0bf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd85a7fc640 1 --2- 172.21.15.45:0/1468977988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd844003980 0x7fd844003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd85a7fc640 1 --2- 172.21.15.45:0/1468977988 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd85c0a8320 0x7fd8440047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd85a7fc640 1 --2- 172.21.15.45:0/1468977988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd844004d10 0x7fd844005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd85a7fc640 1 -- 172.21.15.45:0/1468977988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c0bd9b0 con 0x7fd844004d10 2023-10-03T19:17:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd85a7fc640 1 -- 172.21.15.45:0/1468977988 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84400b990 con 0x7fd844003980 2023-10-03T19:17:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd85a7fc640 1 -- 172.21.15.45:0/1468977988 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84400bb00 con 0x7fd85c0a8320 2023-10-03T19:17:19.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd85bfff640 1 --2- 172.21.15.45:0/1468977988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd844004d10 0x7fd844005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:19.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd85b7fe640 1 --2- 172.21.15.45:0/1468977988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd844003980 0x7fd844003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:19.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd85bfff640 1 -- 172.21.15.45:0/1468977988 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd85c0a8320 msgr2=0x7fd8440047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:19.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd85bfff640 1 --2- 172.21.15.45:0/1468977988 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd85c0a8320 0x7fd8440047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:19.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd85bfff640 1 -- 172.21.15.45:0/1468977988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd844003980 msgr2=0x7fd844003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:19.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd85bfff640 1 --2- 172.21.15.45:0/1468977988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd844003980 0x7fd844003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:19.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.202+0000 7fd85bfff640 1 -- 172.21.15.45:0/1468977988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd844003530 con 0x7fd844004d10 2023-10-03T19:17:19.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.206+0000 7fd85bfff640 1 --2- 172.21.15.45:0/1468977988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd844004d10 0x7fd844005180 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fd85400a780 tx=0x7fd85401d220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e9cbc7ccdcfc77 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:19.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.206+0000 7fd85a7fc640 1 -- 172.21.15.45:0/1468977988 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8540ad630 con 0x7fd844004d10 2023-10-03T19:17:19.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.206+0000 7fd85a7fc640 1 -- 172.21.15.45:0/1468977988 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8540a8070 con 0x7fd844004d10 2023-10-03T19:17:19.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.206+0000 7fd85a7fc640 1 -- 172.21.15.45:0/1468977988 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8540ad9d0 con 0x7fd844004d10 2023-10-03T19:17:19.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.206+0000 7fd861eb2640 1 -- 172.21.15.45:0/1468977988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd844004d10 msgr2=0x7fd844005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:19.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.206+0000 7fd861eb2640 1 --2- 172.21.15.45:0/1468977988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd844004d10 0x7fd844005180 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fd85400a780 tx=0x7fd85401d220 comp rx=0 tx=0).stop 2023-10-03T19:17:19.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.206+0000 7fd85bfff640 1 -- 172.21.15.45:0/1468977988 reap_dead start 2023-10-03T19:17:19.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.206+0000 7fd861eb2640 1 -- 172.21.15.45:0/1468977988 shutdown_connections 2023-10-03T19:17:19.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.206+0000 7fd861eb2640 1 -- 172.21.15.45:0/1468977988 >> 172.21.15.45:0/1468977988 conn(0x7fd85c06bce0 msgr2=0x7fd85c06c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:19.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.206+0000 7fd861eb2640 1 -- 172.21.15.45:0/1468977988 shutdown_connections 2023-10-03T19:17:19.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.206+0000 7fd861eb2640 1 -- 172.21.15.45:0/1468977988 wait complete. 2023-10-03T19:17:19.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.206+0000 7fd861eb2640 1 Processor -- start 2023-10-03T19:17:19.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.206+0000 7fd861eb2640 1 -- start start 2023-10-03T19:17:19.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.210+0000 7fd861eb2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd85c0c26d0 0x7fd85c069ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:19.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.210+0000 7fd861eb2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd85c0bc8b0 0x7fd85c06a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:19.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.210+0000 7fd861eb2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd85c0a4740 0x7fd85c06a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:19.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.210+0000 7fd861eb2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c1e3a50 con 0x7fd85c0c26d0 2023-10-03T19:17:19.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.210+0000 7fd861eb2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c1e3f40 con 0x7fd85c0a4740 2023-10-03T19:17:19.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.210+0000 7fd861eb2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c0a4e30 con 0x7fd85c0bc8b0 2023-10-03T19:17:19.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.210+0000 7fd85b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd85c0c26d0 0x7fd85c069ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:19.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.210+0000 7fd85b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd85c0c26d0 0x7fd85c069ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39310/0 (socket says 172.21.15.45:39310) 2023-10-03T19:17:19.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.210+0000 7fd85b7fe640 1 -- 172.21.15.45:0/2206121434 learned_addr learned my addr 172.21.15.45:0/2206121434 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:19.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.210+0000 7fd85affd640 1 --2- 172.21.15.45:0/2206121434 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd85c0bc8b0 0x7fd85c06a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:19.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.210+0000 7fd85bfff640 1 --2- 172.21.15.45:0/2206121434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd85c0a4740 0x7fd85c06a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:19.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.210+0000 7fd85b7fe640 1 -- 172.21.15.45:0/2206121434 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd85c0bc8b0 msgr2=0x7fd85c06a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:19.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.210+0000 7fd85b7fe640 1 --2- 172.21.15.45:0/2206121434 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd85c0bc8b0 0x7fd85c06a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:19.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.210+0000 7fd85b7fe640 1 -- 172.21.15.45:0/2206121434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd85c0a4740 msgr2=0x7fd85c06a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:19.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.210+0000 7fd85b7fe640 1 --2- 172.21.15.45:0/2206121434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd85c0a4740 0x7fd85c06a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:19.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.210+0000 7fd85b7fe640 1 -- 172.21.15.45:0/2206121434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85c14ca70 con 0x7fd85c0c26d0 2023-10-03T19:17:19.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.210+0000 7fd85b7fe640 1 --2- 172.21.15.45:0/2206121434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd85c0c26d0 0x7fd85c069ad0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fd84c0116a0 tx=0x7fd84c011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:19.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.210+0000 7fd843fff640 1 -- 172.21.15.45:0/2206121434 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c00f9c0 con 0x7fd85c0c26d0 2023-10-03T19:17:19.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.210+0000 7fd843fff640 1 -- 172.21.15.45:0/2206121434 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84c00fb20 con 0x7fd85c0c26d0 2023-10-03T19:17:19.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.210+0000 7fd861eb2640 1 -- 172.21.15.45:0/2206121434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd85c0bd260 con 0x7fd85c0c26d0 2023-10-03T19:17:19.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.210+0000 7fd843fff640 1 -- 172.21.15.45:0/2206121434 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c00fed0 con 0x7fd85c0c26d0 2023-10-03T19:17:19.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.210+0000 7fd861eb2640 1 -- 172.21.15.45:0/2206121434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd85c0bf7c0 con 0x7fd85c0c26d0 2023-10-03T19:17:19.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.210+0000 7fd861eb2640 1 -- 172.21.15.45:0/2206121434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd85c04de80 con 0x7fd85c0c26d0 2023-10-03T19:17:19.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.210+0000 7fd843fff640 1 -- 172.21.15.45:0/2206121434 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd84c015460 con 0x7fd85c0c26d0 2023-10-03T19:17:19.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.210+0000 7fd843fff640 1 --2- 172.21.15.45:0/2206121434 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd8480662b0 0x7fd848068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:19.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.210+0000 7fd843fff640 1 -- 172.21.15.45:0/2206121434 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fd84c084690 con 0x7fd85c0c26d0 2023-10-03T19:17:19.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.214+0000 7fd85affd640 1 --2- 172.21.15.45:0/2206121434 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd8480662b0 0x7fd848068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:19.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.214+0000 7fd85affd640 1 --2- 172.21.15.45:0/2206121434 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd8480662b0 0x7fd848068760 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd8500047c0 tx=0x7fd850008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:19.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.218+0000 7fd843fff640 1 -- 172.21.15.45:0/2206121434 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd84c051a80 con 0x7fd85c0c26d0 2023-10-03T19:17:19.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.374+0000 7fd861eb2640 1 -- 172.21.15.45:0/2206121434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd85c0bfdc0 con 0x7fd85c0c26d0 2023-10-03T19:17:19.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.374+0000 7fd843fff640 1 -- 172.21.15.45:0/2206121434 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v63) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd84c0550a0 con 0x7fd85c0c26d0 2023-10-03T19:17:19.378 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-10-03T19:17:19.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.378+0000 7fd861eb2640 1 -- 172.21.15.45:0/2206121434 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd8480662b0 msgr2=0x7fd848068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:19.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.378+0000 7fd861eb2640 1 --2- 172.21.15.45:0/2206121434 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd8480662b0 0x7fd848068760 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd8500047c0 tx=0x7fd850008040 comp rx=0 tx=0).stop 2023-10-03T19:17:19.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.378+0000 7fd861eb2640 1 -- 172.21.15.45:0/2206121434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd85c0c26d0 msgr2=0x7fd85c069ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:19.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.378+0000 7fd861eb2640 1 --2- 172.21.15.45:0/2206121434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd85c0c26d0 0x7fd85c069ad0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fd84c0116a0 tx=0x7fd84c011b60 comp rx=0 tx=0).stop 2023-10-03T19:17:19.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.378+0000 7fd861eb2640 1 -- 172.21.15.45:0/2206121434 shutdown_connections 2023-10-03T19:17:19.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.378+0000 7fd861eb2640 1 --2- 172.21.15.45:0/2206121434 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd8480662b0 0x7fd848068760 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:19.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.378+0000 7fd861eb2640 1 --2- 172.21.15.45:0/2206121434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd85c0a4740 0x7fd85c06a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:19.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.378+0000 7fd861eb2640 1 --2- 172.21.15.45:0/2206121434 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd85c0bc8b0 0x7fd85c06a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:19.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.378+0000 7fd861eb2640 1 --2- 172.21.15.45:0/2206121434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd85c0c26d0 0x7fd85c069ad0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:19.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.378+0000 7fd861eb2640 1 -- 172.21.15.45:0/2206121434 >> 172.21.15.45:0/2206121434 conn(0x7fd85c06bce0 msgr2=0x7fd85c06c150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:19.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.378+0000 7fd861eb2640 1 -- 172.21.15.45:0/2206121434 shutdown_connections 2023-10-03T19:17:19.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.378+0000 7fd861eb2640 1 -- 172.21.15.45:0/2206121434 wait complete. 2023-10-03T19:17:19.395 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi146.front.sepia.ceph.com... 2023-10-03T19:17:19.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:17:19.395 DEBUG:teuthology.orchestra.run.smithi146:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-03T19:17:19.408 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[33567]: fuse finished with error 0 and tester_r 0 2023-10-03T19:17:19.409 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-03T19:17:19.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:17:19.410 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-03T19:17:19.575 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-03T19:17:19.576 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:17:19.581 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336540k,nr_inodes=4084135,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=22607 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-10-03T19:17:19.582 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2023-10-03T19:17:19.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:17:19.582 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-03T19:17:19.627 INFO:teuthology.orchestra.run.smithi172.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-03T19:17:19.628 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T19:17:19.628 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:17:19.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.746+0000 7ff95c126640 1 Processor -- start 2023-10-03T19:17:19.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.746+0000 7ff95c126640 1 -- start start 2023-10-03T19:17:19.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.746+0000 7ff95c126640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff95406f170 0x7ff954150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:19.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.746+0000 7ff95c126640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff9540bc8b0 0x7ff95414ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:19.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.746+0000 7ff95c126640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff95406d170 0x7ff95414cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:19.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.746+0000 7ff95c126640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff95406cac0 con 0x7ff95406d170 2023-10-03T19:17:19.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.746+0000 7ff95c126640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff95414d4f0 con 0x7ff9540bc8b0 2023-10-03T19:17:19.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.746+0000 7ff95c126640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9540720d0 con 0x7ff95406f170 2023-10-03T19:17:19.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.746+0000 7ff95a6c3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff95406d170 0x7ff95414cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:19.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.746+0000 7ff95a6c3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff95406d170 0x7ff95414cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39318/0 (socket says 172.21.15.45:39318) 2023-10-03T19:17:19.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.746+0000 7ff95a6c3640 1 -- 172.21.15.45:0/2482961350 learned_addr learned my addr 172.21.15.45:0/2482961350 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:19.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.746+0000 7ff959ec2640 1 --2- 172.21.15.45:0/2482961350 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff95406f170 0x7ff954150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:19.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.746+0000 7ff9596c1640 1 --2- 172.21.15.45:0/2482961350 >> v2:172.21.15.79:3300/0 conn(0x7ff9540bc8b0 0x7ff95414ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:19.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.746+0000 7ff95a6c3640 1 -- 172.21.15.45:0/2482961350 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff95406f170 msgr2=0x7ff954150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:19.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.746+0000 7ff95a6c3640 1 --2- 172.21.15.45:0/2482961350 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff95406f170 0x7ff954150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:19.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.746+0000 7ff95a6c3640 1 -- 172.21.15.45:0/2482961350 >> v2:172.21.15.79:3300/0 conn(0x7ff9540bc8b0 msgr2=0x7ff95414ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:19.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.746+0000 7ff95a6c3640 1 --2- 172.21.15.45:0/2482961350 >> v2:172.21.15.79:3300/0 conn(0x7ff9540bc8b0 0x7ff95414ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:19.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.746+0000 7ff95a6c3640 1 -- 172.21.15.45:0/2482961350 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9540a5ab0 con 0x7ff95406d170 2023-10-03T19:17:19.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff95a6c3640 1 --2- 172.21.15.45:0/2482961350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff95406d170 0x7ff95414cfb0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ff9540665f0 tx=0x7ff94c01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a462dd9d1bfe1c31 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:19.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff958ec0640 1 -- 172.21.15.45:0/2482961350 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c0af400 con 0x7ff95406d170 2023-10-03T19:17:19.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff958ec0640 1 -- 172.21.15.45:0/2482961350 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94c0ab050 con 0x7ff95406d170 2023-10-03T19:17:19.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff958ec0640 1 -- 172.21.15.45:0/2482961350 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c0af780 con 0x7ff95406d170 2023-10-03T19:17:19.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff95c126640 1 -- 172.21.15.45:0/2482961350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff95406d170 msgr2=0x7ff95414cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:19.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff95c126640 1 --2- 172.21.15.45:0/2482961350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff95406d170 0x7ff95414cfb0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ff9540665f0 tx=0x7ff94c01f1c0 comp rx=0 tx=0).stop 2023-10-03T19:17:19.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff95c126640 1 -- 172.21.15.45:0/2482961350 shutdown_connections 2023-10-03T19:17:19.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff95c126640 1 --2- 172.21.15.45:0/2482961350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff95406d170 0x7ff95414cfb0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:19.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff95c126640 1 --2- 172.21.15.45:0/2482961350 >> v2:172.21.15.79:3300/0 conn(0x7ff9540bc8b0 0x7ff95414ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:19.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff95c126640 1 --2- 172.21.15.45:0/2482961350 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff95406f170 0x7ff954150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:19.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff95c126640 1 -- 172.21.15.45:0/2482961350 >> 172.21.15.45:0/2482961350 conn(0x7ff9540bcf50 msgr2=0x7ff9540bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:19.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff95c126640 1 -- 172.21.15.45:0/2482961350 shutdown_connections 2023-10-03T19:17:19.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff95c126640 1 -- 172.21.15.45:0/2482961350 wait complete. 2023-10-03T19:17:19.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff95c126640 1 Processor -- start 2023-10-03T19:17:19.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff95c126640 1 -- start start 2023-10-03T19:17:19.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff95c126640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff95406d170 0x7ff954149b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:19.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff95c126640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff95406f170 0x7ff9541e52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:19.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff95c126640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff9540bc8b0 0x7ff9541484e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:19.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff95c126640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9540b7850 con 0x7ff95406f170 2023-10-03T19:17:19.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff95c126640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95409b330 con 0x7ff95406d170 2023-10-03T19:17:19.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff95c126640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95414a070 con 0x7ff9540bc8b0 2023-10-03T19:17:19.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff9596c1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff95406f170 0x7ff9541e52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:19.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff9596c1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff95406f170 0x7ff9541e52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39330/0 (socket says 172.21.15.45:39330) 2023-10-03T19:17:19.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff9596c1640 1 -- 172.21.15.45:0/710672640 learned_addr learned my addr 172.21.15.45:0/710672640 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:19.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff95a6c3640 1 --2- 172.21.15.45:0/710672640 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff9540bc8b0 0x7ff9541484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:19.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff959ec2640 1 --2- 172.21.15.45:0/710672640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff95406d170 0x7ff954149b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:19.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff9596c1640 1 -- 172.21.15.45:0/710672640 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff9540bc8b0 msgr2=0x7ff9541484e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:19.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff9596c1640 1 --2- 172.21.15.45:0/710672640 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff9540bc8b0 0x7ff9541484e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:19.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff9596c1640 1 -- 172.21.15.45:0/710672640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff95406d170 msgr2=0x7ff954149b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:19.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff9596c1640 1 --2- 172.21.15.45:0/710672640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff95406d170 0x7ff954149b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:19.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff9596c1640 1 -- 172.21.15.45:0/710672640 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c009b30 con 0x7ff95406f170 2023-10-03T19:17:19.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.750+0000 7ff95a6c3640 1 --2- 172.21.15.45:0/710672640 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff9540bc8b0 0x7ff9541484e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:19.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.754+0000 7ff9596c1640 1 --2- 172.21.15.45:0/710672640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff95406f170 0x7ff9541e52c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7ff94400d830 tx=0x7ff94400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:19.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.754+0000 7ff94a7fc640 1 -- 172.21.15.45:0/710672640 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94400b6c0 con 0x7ff95406f170 2023-10-03T19:17:19.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.754+0000 7ff94a7fc640 1 -- 172.21.15.45:0/710672640 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94400b820 con 0x7ff95406f170 2023-10-03T19:17:19.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.754+0000 7ff94a7fc640 1 -- 172.21.15.45:0/710672640 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94400bb90 con 0x7ff95406f170 2023-10-03T19:17:19.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.754+0000 7ff95c126640 1 -- 172.21.15.45:0/710672640 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff95414fae0 con 0x7ff95406f170 2023-10-03T19:17:19.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.754+0000 7ff95c126640 1 -- 172.21.15.45:0/710672640 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff95406cd00 con 0x7ff95406f170 2023-10-03T19:17:19.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.754+0000 7ff95c126640 1 -- 172.21.15.45:0/710672640 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff95414c4a0 con 0x7ff95406f170 2023-10-03T19:17:19.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.754+0000 7ff94a7fc640 1 -- 172.21.15.45:0/710672640 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff94401e460 con 0x7ff95406f170 2023-10-03T19:17:19.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.754+0000 7ff94a7fc640 1 --2- 172.21.15.45:0/710672640 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff938066280 0x7ff938068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:19.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.754+0000 7ff94a7fc640 1 -- 172.21.15.45:0/710672640 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7ff944084580 con 0x7ff95406f170 2023-10-03T19:17:19.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.754+0000 7ff959ec2640 1 --2- 172.21.15.45:0/710672640 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff938066280 0x7ff938068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:19.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.754+0000 7ff959ec2640 1 --2- 172.21.15.45:0/710672640 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff938066280 0x7ff938068730 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff950009710 tx=0x7ff950008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:19.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.758+0000 7ff94a7fc640 1 -- 172.21.15.45:0/710672640 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff944051970 con 0x7ff95406f170 2023-10-03T19:17:19.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.946+0000 7ff95c126640 1 -- 172.21.15.45:0/710672640 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff95406d660 con 0x7ff95406f170 2023-10-03T19:17:19.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.946+0000 7ff94a7fc640 1 -- 172.21.15.45:0/710672640 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+3915 (secure 0 0 0) 0x7ff944054f90 con 0x7ff95406f170 2023-10-03T19:17:19.949 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:17:19.949 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1808337334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1808337334},{"type":"v1","addr":"172.21.15.45:6835","nonce":1808337334}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5533,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3484102267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3484102267},{"type":"v1","addr":"172.21.15.79:6835","nonce":3484102267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:16:46.297139+0000","modified":"2023-10-03T19:16:48.310624+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5904},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5904":{"gid":5904,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6833/2572156585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2572156585},{"type":"v1","addr":"172.21.15.45:6833","nonce":2572156585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-10-03T19:17:19.950 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 29 2023-10-03T19:17:19.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.950+0000 7ff95c126640 1 -- 172.21.15.45:0/710672640 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff938066280 msgr2=0x7ff938068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:19.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.950+0000 7ff95c126640 1 --2- 172.21.15.45:0/710672640 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff938066280 0x7ff938068730 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff950009710 tx=0x7ff950008040 comp rx=0 tx=0).stop 2023-10-03T19:17:19.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.950+0000 7ff95c126640 1 -- 172.21.15.45:0/710672640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff95406f170 msgr2=0x7ff9541e52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:19.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.950+0000 7ff95c126640 1 --2- 172.21.15.45:0/710672640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff95406f170 0x7ff9541e52c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7ff94400d830 tx=0x7ff94400dcf0 comp rx=0 tx=0).stop 2023-10-03T19:17:19.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.950+0000 7ff95c126640 1 -- 172.21.15.45:0/710672640 shutdown_connections 2023-10-03T19:17:19.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.950+0000 7ff95c126640 1 --2- 172.21.15.45:0/710672640 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff938066280 0x7ff938068730 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:19.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.950+0000 7ff95c126640 1 --2- 172.21.15.45:0/710672640 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff9540bc8b0 0x7ff9541484e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:19.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.950+0000 7ff95c126640 1 --2- 172.21.15.45:0/710672640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff95406f170 0x7ff9541e52c0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:19.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.950+0000 7ff95c126640 1 --2- 172.21.15.45:0/710672640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff95406d170 0x7ff954149b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:19.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.950+0000 7ff95c126640 1 -- 172.21.15.45:0/710672640 >> 172.21.15.45:0/710672640 conn(0x7ff9540bcf50 msgr2=0x7ff9540bbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:19.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.950+0000 7ff95c126640 1 -- 172.21.15.45:0/710672640 shutdown_connections 2023-10-03T19:17:19.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:19.950+0000 7ff95c126640 1 -- 172.21.15.45:0/710672640 wait complete. 2023-10-03T19:17:19.968 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:17:20.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.094+0000 7f0ae219e640 1 Processor -- start 2023-10-03T19:17:20.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.094+0000 7f0ae219e640 1 -- start start 2023-10-03T19:17:20.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.094+0000 7f0ae219e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0adc148b90 0x7f0adc0bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:20.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.094+0000 7f0ae219e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0adc14b610 con 0x7f0adc0bc4a0 2023-10-03T19:17:20.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.094+0000 7f0ae219e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0adc0a5580 con 0x7f0adc0bcb60 2023-10-03T19:17:20.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.094+0000 7f0ae219e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0adc0a3670 con 0x7f0adc148b90 2023-10-03T19:17:20.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.094+0000 7f0adbfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0adc0bc4a0 0x7f0adc06c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34604/0 (socket says 172.21.15.45:34604) 2023-10-03T19:17:20.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.094+0000 7f0adbfff640 1 -- 172.21.15.45:0/3605675558 learned_addr learned my addr 172.21.15.45:0/3605675558 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:20.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.094+0000 7f0adb7fe640 1 --2- 172.21.15.45:0/3605675558 >> v2:172.21.15.45:3300/0 conn(0x7f0adc148b90 0x7f0adc0bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:20.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.094+0000 7f0adb7fe640 1 -- 172.21.15.45:0/3605675558 >> v1:172.21.15.79:6789/0 conn(0x7f0adc0bcb60 legacy=0x7f0adc06c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:20.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.094+0000 7f0adb7fe640 1 -- 172.21.15.45:0/3605675558 >> v1:172.21.15.45:6789/0 conn(0x7f0adc0bc4a0 legacy=0x7f0adc06c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:20.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.094+0000 7f0adb7fe640 1 -- 172.21.15.45:0/3605675558 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc0a5820 con 0x7f0adc148b90 2023-10-03T19:17:20.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.094+0000 7f0ada7fc640 1 -- 172.21.15.45:0/3605675558 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3446964024 0 0) 0x7f0adc14b610 con 0x7f0adc0bc4a0 2023-10-03T19:17:20.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0adb7fe640 1 --2- 172.21.15.45:0/3605675558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0adc148b90 0x7f0adc0bbf60 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f0acc0097c0 tx=0x7f0acc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11463321eaa0548 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:20.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0ada7fc640 1 -- 172.21.15.45:0/3605675558 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc0ab600 con 0x7f0adc148b90 2023-10-03T19:17:20.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0ada7fc640 1 -- 172.21.15.45:0/3605675558 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0acc0a7050 con 0x7f0adc148b90 2023-10-03T19:17:20.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0ada7fc640 1 -- 172.21.15.45:0/3605675558 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc0ab980 con 0x7f0adc148b90 2023-10-03T19:17:20.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0ae219e640 1 -- 172.21.15.45:0/3605675558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0adc148b90 msgr2=0x7f0adc0bbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:20.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0ae219e640 1 --2- 172.21.15.45:0/3605675558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0adc148b90 0x7f0adc0bbf60 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f0acc0097c0 tx=0x7f0acc01c440 comp rx=0 tx=0).stop 2023-10-03T19:17:20.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0ae219e640 1 -- 172.21.15.45:0/3605675558 shutdown_connections 2023-10-03T19:17:20.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0ae219e640 1 --2- 172.21.15.45:0/3605675558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0adc148b90 0x7f0adc0bbf60 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:20.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0ae219e640 1 -- 172.21.15.45:0/3605675558 >> 172.21.15.45:0/3605675558 conn(0x7f0adc0bcf50 msgr2=0x7f0adc0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:20.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0ae219e640 1 -- 172.21.15.45:0/3605675558 shutdown_connections 2023-10-03T19:17:20.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0ae219e640 1 -- 172.21.15.45:0/3605675558 wait complete. 2023-10-03T19:17:20.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0ae219e640 1 Processor -- start 2023-10-03T19:17:20.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0ae219e640 1 -- start start 2023-10-03T19:17:20.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0ae219e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0adc0bc4a0 0x7f0adc0b9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:20.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0ae219e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0adc0bcb60 0x7f0adc13c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:20.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0ae219e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0adc148b90 0x7f0adc13cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:20.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0ae219e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc14d4e0 con 0x7f0adc148b90 2023-10-03T19:17:20.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0ae219e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc06fb50 con 0x7f0adc0bc4a0 2023-10-03T19:17:20.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0ae219e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc14d050 con 0x7f0adc0bcb60 2023-10-03T19:17:20.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0adbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0adc148b90 0x7f0adc13cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:20.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0adbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0adc148b90 0x7f0adc13cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39350/0 (socket says 172.21.15.45:39350) 2023-10-03T19:17:20.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0adbfff640 1 -- 172.21.15.45:0/3626033963 learned_addr learned my addr 172.21.15.45:0/3626033963 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:20.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0adb7fe640 1 --2- 172.21.15.45:0/3626033963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0adc0bc4a0 0x7f0adc0b9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:20.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0adaffd640 1 --2- 172.21.15.45:0/3626033963 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0adc0bcb60 0x7f0adc13c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:20.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0adbfff640 1 -- 172.21.15.45:0/3626033963 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0adc0bcb60 msgr2=0x7f0adc13c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:20.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0adbfff640 1 --2- 172.21.15.45:0/3626033963 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0adc0bcb60 0x7f0adc13c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:20.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0adbfff640 1 -- 172.21.15.45:0/3626033963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0adc0bc4a0 msgr2=0x7f0adc0b9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:20.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0adbfff640 1 --2- 172.21.15.45:0/3626033963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0adc0bc4a0 0x7f0adc0b9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:20.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0adbfff640 1 -- 172.21.15.45:0/3626033963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0acc009420 con 0x7f0adc148b90 2023-10-03T19:17:20.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0adaffd640 1 --2- 172.21.15.45:0/3626033963 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0adc0bcb60 0x7f0adc13c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:20.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0adbfff640 1 --2- 172.21.15.45:0/3626033963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0adc148b90 0x7f0adc13cc80 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f0ad400c780 tx=0x7f0ad400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:20.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0ac3fff640 1 -- 172.21.15.45:0/3626033963 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad400ce90 con 0x7f0adc148b90 2023-10-03T19:17:20.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0ac3fff640 1 -- 172.21.15.45:0/3626033963 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad400a640 con 0x7f0adc148b90 2023-10-03T19:17:20.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0ae219e640 1 -- 172.21.15.45:0/3626033963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0adc0bda30 con 0x7f0adc148b90 2023-10-03T19:17:20.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0ac3fff640 1 -- 172.21.15.45:0/3626033963 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad400a9b0 con 0x7f0adc148b90 2023-10-03T19:17:20.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.098+0000 7f0ae219e640 1 -- 172.21.15.45:0/3626033963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0adc0a3c30 con 0x7f0adc148b90 2023-10-03T19:17:20.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.102+0000 7f0ae219e640 1 -- 172.21.15.45:0/3626033963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0adc0bdbc0 con 0x7f0adc148b90 2023-10-03T19:17:20.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.102+0000 7f0ac3fff640 1 -- 172.21.15.45:0/3626033963 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0ad400ab10 con 0x7f0adc148b90 2023-10-03T19:17:20.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.102+0000 7f0ac3fff640 1 --2- 172.21.15.45:0/3626033963 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0ac8066280 0x7f0ac8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:20.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.102+0000 7f0ac3fff640 1 -- 172.21.15.45:0/3626033963 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f0ad40832b0 con 0x7f0adc148b90 2023-10-03T19:17:20.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.102+0000 7f0adb7fe640 1 --2- 172.21.15.45:0/3626033963 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0ac8066280 0x7f0ac8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:20.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.102+0000 7f0adb7fe640 1 --2- 172.21.15.45:0/3626033963 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0ac8066280 0x7f0ac8068730 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0acc0ad000 tx=0x7f0acc0a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:20.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.106+0000 7f0ac3fff640 1 -- 172.21.15.45:0/3626033963 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0ad4050690 con 0x7f0adc148b90 2023-10-03T19:17:20.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.262+0000 7f0ae219e640 1 -- 172.21.15.45:0/3626033963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0adc06fcc0 con 0x7f0adc148b90 2023-10-03T19:17:20.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.266+0000 7f0ac3fff640 1 -- 172.21.15.45:0/3626033963 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+18484 (secure 0 0 0) 0x7f0ad4053cb0 con 0x7f0adc148b90 2023-10-03T19:17:20.268 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:17:20.268 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":63,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:17:14.698087+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:16:44.176075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-03T19:16:45.307579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.d","mappings":[{"from":7,"to":2}]},{"pgid":"10.c","mappings":[{"from":7,"to":3}]},{"pgid":"10.10","mappings":[{"from":4,"to":3}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]},{"pgid":"10.37","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:17:20.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.266+0000 7f0ae219e640 1 -- 172.21.15.45:0/3626033963 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0ac8066280 msgr2=0x7f0ac8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:20.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.266+0000 7f0ae219e640 1 --2- 172.21.15.45:0/3626033963 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0ac8066280 0x7f0ac8068730 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0acc0ad000 tx=0x7f0acc0a6000 comp rx=0 tx=0).stop 2023-10-03T19:17:20.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.266+0000 7f0ae219e640 1 -- 172.21.15.45:0/3626033963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0adc148b90 msgr2=0x7f0adc13cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:20.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.266+0000 7f0ae219e640 1 --2- 172.21.15.45:0/3626033963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0adc148b90 0x7f0adc13cc80 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f0ad400c780 tx=0x7f0ad400cc40 comp rx=0 tx=0).stop 2023-10-03T19:17:20.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.266+0000 7f0ae219e640 1 -- 172.21.15.45:0/3626033963 shutdown_connections 2023-10-03T19:17:20.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.266+0000 7f0ae219e640 1 --2- 172.21.15.45:0/3626033963 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0ac8066280 0x7f0ac8068730 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:20.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.266+0000 7f0ae219e640 1 --2- 172.21.15.45:0/3626033963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0adc148b90 0x7f0adc13cc80 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:20.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.266+0000 7f0ae219e640 1 --2- 172.21.15.45:0/3626033963 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0adc0bcb60 0x7f0adc13c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:20.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.266+0000 7f0ae219e640 1 --2- 172.21.15.45:0/3626033963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0adc0bc4a0 0x7f0adc0b9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:20.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.266+0000 7f0ae219e640 1 -- 172.21.15.45:0/3626033963 >> 172.21.15.45:0/3626033963 conn(0x7f0adc0bcf50 msgr2=0x7f0adc1403b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:20.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.266+0000 7f0ae219e640 1 -- 172.21.15.45:0/3626033963 shutdown_connections 2023-10-03T19:17:20.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.266+0000 7f0ae219e640 1 -- 172.21.15.45:0/3626033963 wait complete. 2023-10-03T19:17:20.286 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T19:16:44.176075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T19:16:45.307579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:17:20.287 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:17:20.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.406+0000 7f7901b76640 1 Processor -- start 2023-10-03T19:17:20.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.406+0000 7f7901b76640 1 -- start start 2023-10-03T19:17:20.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.410+0000 7f7901b76640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f78fc149c70 0x7f78fc0c13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:20.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.410+0000 7f7901b76640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f78fc0c1930 0x7f78fc0bcd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:20.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.410+0000 7f7901b76640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78fc0bbd90 con 0x7f78fc0bb0e0 2023-10-03T19:17:20.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.410+0000 7f7901b76640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78fc0b63e0 con 0x7f78fc149c70 2023-10-03T19:17:20.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.410+0000 7f7901b76640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc1504a0 con 0x7f78fc0c1930 2023-10-03T19:17:20.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.410+0000 7f78fb7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f78fc149c70 0x7f78fc0c13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:20.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.410+0000 7f78fbfff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f78fc0c1930 0x7f78fc0bcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:20.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.410+0000 7f78fb7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f78fc149c70 0x7f78fc0c13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:52182/0 (socket says 172.21.15.45:52182) 2023-10-03T19:17:20.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.410+0000 7f78fb7fe640 1 -- 172.21.15.45:0/3228000376 learned_addr learned my addr 172.21.15.45:0/3228000376 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:20.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.410+0000 7f78faffd640 1 --1- 172.21.15.45:0/3228000376 >> v1:172.21.15.79:6789/0 conn(0x7f78fc0bb0e0 0x7f78fc0bc610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:56372/0 (socket says 172.21.15.45:56372) 2023-10-03T19:17:20.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.410+0000 7f78fbfff640 1 -- 172.21.15.45:0/3228000376 >> v2:172.21.15.79:3300/0 conn(0x7f78fc149c70 msgr2=0x7f78fc0c13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:20.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.410+0000 7f78fbfff640 1 --2- 172.21.15.45:0/3228000376 >> v2:172.21.15.79:3300/0 conn(0x7f78fc149c70 0x7f78fc0c13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:20.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.410+0000 7f78fbfff640 1 -- 172.21.15.45:0/3228000376 >> v1:172.21.15.79:6789/0 conn(0x7f78fc0bb0e0 legacy=0x7f78fc0bc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:20.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.410+0000 7f78fbfff640 1 -- 172.21.15.45:0/3228000376 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78fc072980 con 0x7f78fc0c1930 2023-10-03T19:17:20.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.410+0000 7f78fbfff640 1 --2- 172.21.15.45:0/3228000376 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f78fc0c1930 0x7f78fc0bcd20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f78f4009d90 tx=0x7f78f401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b7457d518941271 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:20.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.410+0000 7f78fa7fc640 1 -- 172.21.15.45:0/3228000376 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f40a5920 con 0x7f78fc0c1930 2023-10-03T19:17:20.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.410+0000 7f78fa7fc640 1 -- 172.21.15.45:0/3228000376 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f40a5a80 con 0x7f78fc0c1930 2023-10-03T19:17:20.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.410+0000 7f78fa7fc640 1 -- 172.21.15.45:0/3228000376 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f40a5e10 con 0x7f78fc0c1930 2023-10-03T19:17:20.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f7901b76640 1 -- 172.21.15.45:0/3228000376 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f78fc0c1930 msgr2=0x7f78fc0bcd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:20.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f7901b76640 1 --2- 172.21.15.45:0/3228000376 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f78fc0c1930 0x7f78fc0bcd20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f78f4009d90 tx=0x7f78f401c950 comp rx=0 tx=0).stop 2023-10-03T19:17:20.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f7901b76640 1 -- 172.21.15.45:0/3228000376 shutdown_connections 2023-10-03T19:17:20.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f7901b76640 1 --2- 172.21.15.45:0/3228000376 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f78fc0c1930 0x7f78fc0bcd20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:20.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f7901b76640 1 --2- 172.21.15.45:0/3228000376 >> v2:172.21.15.79:3300/0 conn(0x7f78fc149c70 0x7f78fc0c13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:20.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f7901b76640 1 -- 172.21.15.45:0/3228000376 >> 172.21.15.45:0/3228000376 conn(0x7f78fc06a760 msgr2=0x7f78fc0c0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:20.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f7901b76640 1 -- 172.21.15.45:0/3228000376 shutdown_connections 2023-10-03T19:17:20.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f7901b76640 1 -- 172.21.15.45:0/3228000376 wait complete. 2023-10-03T19:17:20.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f7901b76640 1 Processor -- start 2023-10-03T19:17:20.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f7901b76640 1 -- start start 2023-10-03T19:17:20.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f7901b76640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f78fc0bb0e0 0x7f78fc0b8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:20.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f7901b76640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78fc0c1930 0x7f78fc145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:20.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f7901b76640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78fc149c70 0x7f78fc0ba1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:20.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f7901b76640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc0b7b30 con 0x7f78fc0c1930 2023-10-03T19:17:20.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f7901b76640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc146640 con 0x7f78fc149c70 2023-10-03T19:17:20.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f7901b76640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc146200 con 0x7f78fc0bb0e0 2023-10-03T19:17:20.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f78faffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78fc0c1930 0x7f78fc145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:20.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f78faffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78fc0c1930 0x7f78fc145cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39364/0 (socket says 172.21.15.45:39364) 2023-10-03T19:17:20.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f78faffd640 1 -- 172.21.15.45:0/1193774495 learned_addr learned my addr 172.21.15.45:0/1193774495 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:20.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f78fbfff640 1 --2- 172.21.15.45:0/1193774495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78fc149c70 0x7f78fc0ba1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:20.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f78fb7fe640 1 --2- 172.21.15.45:0/1193774495 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f78fc0bb0e0 0x7f78fc0b8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:20.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f78faffd640 1 -- 172.21.15.45:0/1193774495 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f78fc0bb0e0 msgr2=0x7f78fc0b8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:20.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f78faffd640 1 --2- 172.21.15.45:0/1193774495 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f78fc0bb0e0 0x7f78fc0b8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:20.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f78faffd640 1 -- 172.21.15.45:0/1193774495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78fc149c70 msgr2=0x7f78fc0ba1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:20.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f78faffd640 1 --2- 172.21.15.45:0/1193774495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78fc149c70 0x7f78fc0ba1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:20.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f78faffd640 1 -- 172.21.15.45:0/1193774495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f4009a70 con 0x7f78fc0c1930 2023-10-03T19:17:20.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f78faffd640 1 --2- 172.21.15.45:0/1193774495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78fc0c1930 0x7f78fc145cc0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f78f000c370 tx=0x7f78f000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:20.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f78e3fff640 1 -- 172.21.15.45:0/1193774495 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f00074e0 con 0x7f78fc0c1930 2023-10-03T19:17:20.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f78e3fff640 1 -- 172.21.15.45:0/1193774495 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f0007640 con 0x7f78fc0c1930 2023-10-03T19:17:20.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f7901b76640 1 -- 172.21.15.45:0/1193774495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78fc1596d0 con 0x7f78fc0c1930 2023-10-03T19:17:20.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f78e3fff640 1 -- 172.21.15.45:0/1193774495 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f0004a30 con 0x7f78fc0c1930 2023-10-03T19:17:20.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.414+0000 7f7901b76640 1 -- 172.21.15.45:0/1193774495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78fc159540 con 0x7f78fc0c1930 2023-10-03T19:17:20.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.418+0000 7f7901b76640 1 -- 172.21.15.45:0/1193774495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78fc159860 con 0x7f78fc0c1930 2023-10-03T19:17:20.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.418+0000 7f78e3fff640 1 -- 172.21.15.45:0/1193774495 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f78f0004b90 con 0x7f78fc0c1930 2023-10-03T19:17:20.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.418+0000 7f78e3fff640 1 --2- 172.21.15.45:0/1193774495 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f78e8066280 0x7f78e8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:20.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.418+0000 7f78e3fff640 1 -- 172.21.15.45:0/1193774495 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f78f00835c0 con 0x7f78fc0c1930 2023-10-03T19:17:20.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.418+0000 7f78fb7fe640 1 --2- 172.21.15.45:0/1193774495 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f78e8066280 0x7f78e8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:20.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.418+0000 7f78fb7fe640 1 --2- 172.21.15.45:0/1193774495 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f78e8066280 0x7f78e8068730 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f78ec009b50 tx=0x7f78ec009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:20.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.422+0000 7f78e3fff640 1 -- 172.21.15.45:0/1193774495 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f78f0050af0 con 0x7f78fc0c1930 2023-10-03T19:17:20.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.582+0000 7f7901b76640 1 -- 172.21.15.45:0/1193774495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f78fc04de80 con 0x7f78fc0c1930 2023-10-03T19:17:20.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.582+0000 7f78e3fff640 1 -- 172.21.15.45:0/1193774495 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v63) v1 ==== 93+0+10 (secure 0 0 0) 0x7f78f0054110 con 0x7f78fc0c1930 2023-10-03T19:17:20.584 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:17:20.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.586+0000 7f7901b76640 1 -- 172.21.15.45:0/1193774495 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f78e8066280 msgr2=0x7f78e8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:20.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.586+0000 7f7901b76640 1 --2- 172.21.15.45:0/1193774495 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f78e8066280 0x7f78e8068730 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f78ec009b50 tx=0x7f78ec009240 comp rx=0 tx=0).stop 2023-10-03T19:17:20.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.586+0000 7f7901b76640 1 -- 172.21.15.45:0/1193774495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78fc0c1930 msgr2=0x7f78fc145cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:20.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.586+0000 7f7901b76640 1 --2- 172.21.15.45:0/1193774495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78fc0c1930 0x7f78fc145cc0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f78f000c370 tx=0x7f78f000c830 comp rx=0 tx=0).stop 2023-10-03T19:17:20.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.586+0000 7f7901b76640 1 -- 172.21.15.45:0/1193774495 shutdown_connections 2023-10-03T19:17:20.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.586+0000 7f7901b76640 1 --2- 172.21.15.45:0/1193774495 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f78e8066280 0x7f78e8068730 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:20.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.586+0000 7f7901b76640 1 --2- 172.21.15.45:0/1193774495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78fc149c70 0x7f78fc0ba1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:20.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.586+0000 7f7901b76640 1 --2- 172.21.15.45:0/1193774495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78fc0c1930 0x7f78fc145cc0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:20.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.586+0000 7f7901b76640 1 --2- 172.21.15.45:0/1193774495 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f78fc0bb0e0 0x7f78fc0b8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:20.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.586+0000 7f7901b76640 1 -- 172.21.15.45:0/1193774495 >> 172.21.15.45:0/1193774495 conn(0x7f78fc06a760 msgr2=0x7f78fc06c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:20.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.586+0000 7f7901b76640 1 -- 172.21.15.45:0/1193774495 shutdown_connections 2023-10-03T19:17:20.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.586+0000 7f7901b76640 1 -- 172.21.15.45:0/1193774495 wait complete. 2023-10-03T19:17:20.603 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:17:20.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.730+0000 7f1bc23ff640 1 Processor -- start 2023-10-03T19:17:20.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.730+0000 7f1bc23ff640 1 -- start start 2023-10-03T19:17:20.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.730+0000 7f1bc23ff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1bbc0bbe70 0x7f1bbc0bd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:20.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.730+0000 7f1bc23ff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1bbc0c0520 0x7f1bbc0c09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:20.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.730+0000 7f1bc23ff640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bbc14bf10 con 0x7f1bbc148a40 2023-10-03T19:17:20.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.730+0000 7f1bc23ff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bbc06cba0 con 0x7f1bbc0c0520 2023-10-03T19:17:20.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.730+0000 7f1bc23ff640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bbc14bd20 con 0x7f1bbc0bbe70 2023-10-03T19:17:20.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.730+0000 7f1bc099c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1bbc0c0520 0x7f1bbc0c09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:20.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.730+0000 7f1bc099c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1bbc0c0520 0x7f1bbc0c09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39374/0 (socket says 172.21.15.45:39374) 2023-10-03T19:17:20.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.730+0000 7f1bc099c640 1 -- 172.21.15.45:0/3685575103 learned_addr learned my addr 172.21.15.45:0/3685575103 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:20.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.730+0000 7f1bbb7fe640 1 --2- 172.21.15.45:0/3685575103 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1bbc0bbe70 0x7f1bbc0bd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:20.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.730+0000 7f1bc099c640 1 -- 172.21.15.45:0/3685575103 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1bbc0bbe70 msgr2=0x7f1bbc0bd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:20.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.730+0000 7f1bc099c640 1 --2- 172.21.15.45:0/3685575103 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1bbc0bbe70 0x7f1bbc0bd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:20.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.730+0000 7f1bc099c640 1 -- 172.21.15.45:0/3685575103 >> v1:172.21.15.79:6789/0 conn(0x7f1bbc148a40 legacy=0x7f1bbc06dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:20.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.730+0000 7f1bc099c640 1 -- 172.21.15.45:0/3685575103 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bbc06e380 con 0x7f1bbc0c0520 2023-10-03T19:17:20.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.734+0000 7f1bc099c640 1 --2- 172.21.15.45:0/3685575103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bbc0c0520 0x7f1bbc0c09a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4009870 tx=0x7f1bb401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36fa3e117219a140 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:20.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.734+0000 7f1bbaffd640 1 -- 172.21.15.45:0/3685575103 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb40ab600 con 0x7f1bbc0c0520 2023-10-03T19:17:20.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.734+0000 7f1bbaffd640 1 -- 172.21.15.45:0/3685575103 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb40a7050 con 0x7f1bbc0c0520 2023-10-03T19:17:20.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.734+0000 7f1bbaffd640 1 -- 172.21.15.45:0/3685575103 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb40ab980 con 0x7f1bbc0c0520 2023-10-03T19:17:20.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bc23ff640 1 -- 172.21.15.45:0/3685575103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bbc0c0520 msgr2=0x7f1bbc0c09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:20.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bc23ff640 1 --2- 172.21.15.45:0/3685575103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bbc0c0520 0x7f1bbc0c09a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4009870 tx=0x7f1bb401c540 comp rx=0 tx=0).stop 2023-10-03T19:17:20.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bc23ff640 1 -- 172.21.15.45:0/3685575103 shutdown_connections 2023-10-03T19:17:20.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bc23ff640 1 --2- 172.21.15.45:0/3685575103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bbc0c0520 0x7f1bbc0c09a0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:20.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bc23ff640 1 --2- 172.21.15.45:0/3685575103 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1bbc0bbe70 0x7f1bbc0bd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:20.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bc23ff640 1 -- 172.21.15.45:0/3685575103 >> 172.21.15.45:0/3685575103 conn(0x7f1bbc0c14f0 msgr2=0x7f1bbc0c18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:20.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bc23ff640 1 -- 172.21.15.45:0/3685575103 shutdown_connections 2023-10-03T19:17:20.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bc23ff640 1 -- 172.21.15.45:0/3685575103 wait complete. 2023-10-03T19:17:20.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bc23ff640 1 Processor -- start 2023-10-03T19:17:20.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bc23ff640 1 -- start start 2023-10-03T19:17:20.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bc23ff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1bbc0bbe70 0x7f1bbc14f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:20.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bc23ff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bbc0c0520 0x7f1bbc1e5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:20.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bc23ff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bbc148a40 0x7f1bbc14cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:20.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bc23ff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bbc142160 con 0x7f1bbc0c0520 2023-10-03T19:17:20.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bc23ff640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bbc14cad0 con 0x7f1bbc148a40 2023-10-03T19:17:20.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bc23ff640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bbc14ade0 con 0x7f1bbc0bbe70 2023-10-03T19:17:20.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bbb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bbc0c0520 0x7f1bbc1e5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:20.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bbb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bbc0c0520 0x7f1bbc1e5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39386/0 (socket says 172.21.15.45:39386) 2023-10-03T19:17:20.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bbb7fe640 1 -- 172.21.15.45:0/3479470162 learned_addr learned my addr 172.21.15.45:0/3479470162 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:20.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bbbfff640 1 --2- 172.21.15.45:0/3479470162 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1bbc0bbe70 0x7f1bbc14f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:20.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bc099c640 1 --2- 172.21.15.45:0/3479470162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bbc148a40 0x7f1bbc14cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:20.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bbb7fe640 1 -- 172.21.15.45:0/3479470162 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1bbc0bbe70 msgr2=0x7f1bbc14f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:20.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bbb7fe640 1 --2- 172.21.15.45:0/3479470162 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1bbc0bbe70 0x7f1bbc14f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:20.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bbb7fe640 1 -- 172.21.15.45:0/3479470162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bbc148a40 msgr2=0x7f1bbc14cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:20.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bbb7fe640 1 --2- 172.21.15.45:0/3479470162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bbc148a40 0x7f1bbc14cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:20.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bbb7fe640 1 -- 172.21.15.45:0/3479470162 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb40094d0 con 0x7f1bbc0c0520 2023-10-03T19:17:20.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bc099c640 1 --2- 172.21.15.45:0/3479470162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bbc148a40 0x7f1bbc14cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:17:20.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bbb7fe640 1 --2- 172.21.15.45:0/3479470162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bbc0c0520 0x7f1bbc1e5c70 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f1ba400d830 tx=0x7f1ba400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:20.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bb8ff9640 1 -- 172.21.15.45:0/3479470162 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba400b6c0 con 0x7f1bbc0c0520 2023-10-03T19:17:20.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bb8ff9640 1 -- 172.21.15.45:0/3479470162 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba400b820 con 0x7f1bbc0c0520 2023-10-03T19:17:20.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bc23ff640 1 -- 172.21.15.45:0/3479470162 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bbc065690 con 0x7f1bbc0c0520 2023-10-03T19:17:20.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bb8ff9640 1 -- 172.21.15.45:0/3479470162 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba400bb90 con 0x7f1bbc0c0520 2023-10-03T19:17:20.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.738+0000 7f1bc23ff640 1 -- 172.21.15.45:0/3479470162 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bbc06d450 con 0x7f1bbc0c0520 2023-10-03T19:17:20.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.742+0000 7f1bc23ff640 1 -- 172.21.15.45:0/3479470162 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bbc065820 con 0x7f1bbc0c0520 2023-10-03T19:17:20.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.742+0000 7f1bb8ff9640 1 -- 172.21.15.45:0/3479470162 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1ba401e460 con 0x7f1bbc0c0520 2023-10-03T19:17:20.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.742+0000 7f1bb8ff9640 1 --2- 172.21.15.45:0/3479470162 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1b9c066280 0x7f1b9c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:20.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.742+0000 7f1bb8ff9640 1 -- 172.21.15.45:0/3479470162 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f1ba40845b0 con 0x7f1bbc0c0520 2023-10-03T19:17:20.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.742+0000 7f1bbbfff640 1 --2- 172.21.15.45:0/3479470162 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1b9c066280 0x7f1b9c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:20.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.742+0000 7f1bbbfff640 1 --2- 172.21.15.45:0/3479470162 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1b9c066280 0x7f1b9c068730 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc1e37f0 tx=0x7f1bac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:20.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.746+0000 7f1bb8ff9640 1 -- 172.21.15.45:0/3479470162 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1ba40518f0 con 0x7f1bbc0c0520 2023-10-03T19:17:20.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.902+0000 7f1bc23ff640 1 -- 172.21.15.45:0/3479470162 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1bbc04de80 con 0x7f1bbc0c0520 2023-10-03T19:17:20.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.902+0000 7f1bb8ff9640 1 -- 172.21.15.45:0/3479470162 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v63) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1ba4054f10 con 0x7f1bbc0c0520 2023-10-03T19:17:20.903 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:17:20.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.902+0000 7f1bc23ff640 1 -- 172.21.15.45:0/3479470162 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1b9c066280 msgr2=0x7f1b9c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:20.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.902+0000 7f1bc23ff640 1 --2- 172.21.15.45:0/3479470162 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1b9c066280 0x7f1b9c068730 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc1e37f0 tx=0x7f1bac009040 comp rx=0 tx=0).stop 2023-10-03T19:17:20.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.902+0000 7f1bc23ff640 1 -- 172.21.15.45:0/3479470162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bbc0c0520 msgr2=0x7f1bbc1e5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:20.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.902+0000 7f1bc23ff640 1 --2- 172.21.15.45:0/3479470162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bbc0c0520 0x7f1bbc1e5c70 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f1ba400d830 tx=0x7f1ba400dcf0 comp rx=0 tx=0).stop 2023-10-03T19:17:20.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.902+0000 7f1bc23ff640 1 -- 172.21.15.45:0/3479470162 shutdown_connections 2023-10-03T19:17:20.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.902+0000 7f1bc23ff640 1 --2- 172.21.15.45:0/3479470162 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1b9c066280 0x7f1b9c068730 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:20.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.902+0000 7f1bc23ff640 1 --2- 172.21.15.45:0/3479470162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bbc148a40 0x7f1bbc14cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:20.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.902+0000 7f1bc23ff640 1 --2- 172.21.15.45:0/3479470162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bbc0c0520 0x7f1bbc1e5c70 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:20.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.902+0000 7f1bc23ff640 1 --2- 172.21.15.45:0/3479470162 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1bbc0bbe70 0x7f1bbc14f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:20.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.902+0000 7f1bc23ff640 1 -- 172.21.15.45:0/3479470162 >> 172.21.15.45:0/3479470162 conn(0x7f1bbc0c14f0 msgr2=0x7f1bbc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:20.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.902+0000 7f1bc23ff640 1 -- 172.21.15.45:0/3479470162 shutdown_connections 2023-10-03T19:17:20.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:20.902+0000 7f1bc23ff640 1 -- 172.21.15.45:0/3479470162 wait complete. 2023-10-03T19:17:20.923 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T19:17:21.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.046+0000 7f0f72d27640 1 Processor -- start 2023-10-03T19:17:21.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.046+0000 7f0f72d27640 1 -- start start 2023-10-03T19:17:21.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.046+0000 7f0f72d27640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0f6c148540 0x7f0f6c0bb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:21.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.046+0000 7f0f72d27640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f6c06d630 0x7f0f6c14e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:21.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.046+0000 7f0f72d27640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f6c0bcf80 con 0x7f0f6c0bb5a0 2023-10-03T19:17:21.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.046+0000 7f0f72d27640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6c152b50 con 0x7f0f6c148540 2023-10-03T19:17:21.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.046+0000 7f0f72d27640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c14e550 con 0x7f0f6c06d630 2023-10-03T19:17:21.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.046+0000 7f0f70ac3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0f6c148540 0x7f0f6c0bb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:21.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.046+0000 7f0f712c4640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0f6c0bb5a0 0x7f0f6c14eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34614/0 (socket says 172.21.15.45:34614) 2023-10-03T19:17:21.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.046+0000 7f0f712c4640 1 -- 172.21.15.45:0/1883221559 learned_addr learned my addr 172.21.15.45:0/1883221559 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:21.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.046+0000 7f0f6bfff640 1 --2- 172.21.15.45:0/1883221559 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f6c06d630 0x7f0f6c14e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:21.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.046+0000 7f0f70ac3640 1 -- 172.21.15.45:0/1883221559 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f6c06d630 msgr2=0x7f0f6c14e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:21.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.046+0000 7f0f70ac3640 1 --2- 172.21.15.45:0/1883221559 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f6c06d630 0x7f0f6c14e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:21.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.046+0000 7f0f70ac3640 1 -- 172.21.15.45:0/1883221559 >> v1:172.21.15.45:6789/0 conn(0x7f0f6c0bb5a0 legacy=0x7f0f6c14eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:21.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.046+0000 7f0f6b7fe640 1 -- 172.21.15.45:0/1883221559 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1506194681 0 0) 0x7f0f6c0bcf80 con 0x7f0f6c0bb5a0 2023-10-03T19:17:21.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.046+0000 7f0f70ac3640 1 -- 172.21.15.45:0/1883221559 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6c0bd260 con 0x7f0f6c148540 2023-10-03T19:17:21.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.050+0000 7f0f70ac3640 1 --2- 172.21.15.45:0/1883221559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f6c148540 0x7f0f6c0bb060 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0097c0 tx=0x7f0f5c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9bc64eaf81c283a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:21.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.050+0000 7f0f6b7fe640 1 -- 172.21.15.45:0/1883221559 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c0ad680 con 0x7f0f6c148540 2023-10-03T19:17:21.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.050+0000 7f0f6b7fe640 1 -- 172.21.15.45:0/1883221559 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5c0ad7e0 con 0x7f0f6c148540 2023-10-03T19:17:21.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.050+0000 7f0f6b7fe640 1 -- 172.21.15.45:0/1883221559 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c0adb70 con 0x7f0f6c148540 2023-10-03T19:17:21.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.050+0000 7f0f72d27640 1 -- 172.21.15.45:0/1883221559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f6c148540 msgr2=0x7f0f6c0bb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:21.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.050+0000 7f0f72d27640 1 --2- 172.21.15.45:0/1883221559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f6c148540 0x7f0f6c0bb060 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0097c0 tx=0x7f0f5c01c450 comp rx=0 tx=0).stop 2023-10-03T19:17:21.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.050+0000 7f0f72d27640 1 -- 172.21.15.45:0/1883221559 shutdown_connections 2023-10-03T19:17:21.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.050+0000 7f0f72d27640 1 --2- 172.21.15.45:0/1883221559 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f6c06d630 0x7f0f6c14e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:21.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.050+0000 7f0f72d27640 1 --2- 172.21.15.45:0/1883221559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f6c148540 0x7f0f6c0bb060 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:21.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.050+0000 7f0f72d27640 1 -- 172.21.15.45:0/1883221559 >> 172.21.15.45:0/1883221559 conn(0x7f0f6c0a20d0 msgr2=0x7f0f6c0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:21.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.050+0000 7f0f72d27640 1 -- 172.21.15.45:0/1883221559 shutdown_connections 2023-10-03T19:17:21.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.050+0000 7f0f72d27640 1 -- 172.21.15.45:0/1883221559 wait complete. 2023-10-03T19:17:21.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.050+0000 7f0f72d27640 1 Processor -- start 2023-10-03T19:17:21.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.050+0000 7f0f72d27640 1 -- start start 2023-10-03T19:17:21.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.050+0000 7f0f72d27640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f6c06d630 0x7f0f6c0a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:21.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.050+0000 7f0f72d27640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f6c0bb5a0 0x7f0f6c147270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:21.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.050+0000 7f0f72d27640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f6c148540 0x7f0f6c1477b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:21.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.050+0000 7f0f72d27640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c14ac80 con 0x7f0f6c0bb5a0 2023-10-03T19:17:21.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.050+0000 7f0f72d27640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c14a960 con 0x7f0f6c148540 2023-10-03T19:17:21.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.050+0000 7f0f72d27640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c0a49e0 con 0x7f0f6c06d630 2023-10-03T19:17:21.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.050+0000 7f0f6bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f6c0bb5a0 0x7f0f6c147270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:21.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.050+0000 7f0f6bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f6c0bb5a0 0x7f0f6c147270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39406/0 (socket says 172.21.15.45:39406) 2023-10-03T19:17:21.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.050+0000 7f0f6bfff640 1 -- 172.21.15.45:0/3261486383 learned_addr learned my addr 172.21.15.45:0/3261486383 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:21.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.050+0000 7f0f70ac3640 1 --2- 172.21.15.45:0/3261486383 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f6c06d630 0x7f0f6c0a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:21.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.050+0000 7f0f712c4640 1 --2- 172.21.15.45:0/3261486383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f6c148540 0x7f0f6c1477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:21.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.054+0000 7f0f6bfff640 1 -- 172.21.15.45:0/3261486383 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f6c06d630 msgr2=0x7f0f6c0a5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:21.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.054+0000 7f0f6bfff640 1 --2- 172.21.15.45:0/3261486383 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f6c06d630 0x7f0f6c0a5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:21.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.054+0000 7f0f6bfff640 1 -- 172.21.15.45:0/3261486383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f6c148540 msgr2=0x7f0f6c1477b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:21.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.054+0000 7f0f6bfff640 1 --2- 172.21.15.45:0/3261486383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f6c148540 0x7f0f6c1477b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:21.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.054+0000 7f0f6bfff640 1 -- 172.21.15.45:0/3261486383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5c009420 con 0x7f0f6c0bb5a0 2023-10-03T19:17:21.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.054+0000 7f0f6bfff640 1 --2- 172.21.15.45:0/3261486383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f6c0bb5a0 0x7f0f6c147270 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000d7d0 tx=0x7f0f6000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:21.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.054+0000 7f0f697fa640 1 -- 172.21.15.45:0/3261486383 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6000b6c0 con 0x7f0f6c0bb5a0 2023-10-03T19:17:21.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.054+0000 7f0f697fa640 1 -- 172.21.15.45:0/3261486383 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6000b820 con 0x7f0f6c0bb5a0 2023-10-03T19:17:21.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.054+0000 7f0f72d27640 1 -- 172.21.15.45:0/3261486383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f6c0bdda0 con 0x7f0f6c0bb5a0 2023-10-03T19:17:21.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.054+0000 7f0f697fa640 1 -- 172.21.15.45:0/3261486383 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6000bbd0 con 0x7f0f6c0bb5a0 2023-10-03T19:17:21.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.054+0000 7f0f72d27640 1 -- 172.21.15.45:0/3261486383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f6c0bdc10 con 0x7f0f6c0bb5a0 2023-10-03T19:17:21.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.054+0000 7f0f72d27640 1 -- 172.21.15.45:0/3261486383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f6c152350 con 0x7f0f6c0bb5a0 2023-10-03T19:17:21.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.054+0000 7f0f697fa640 1 -- 172.21.15.45:0/3261486383 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0f6000bd30 con 0x7f0f6c0bb5a0 2023-10-03T19:17:21.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.054+0000 7f0f697fa640 1 --2- 172.21.15.45:0/3261486383 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0f58066280 0x7f0f58068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:21.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.054+0000 7f0f697fa640 1 -- 172.21.15.45:0/3261486383 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f0f60084270 con 0x7f0f6c0bb5a0 2023-10-03T19:17:21.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.054+0000 7f0f70ac3640 1 --2- 172.21.15.45:0/3261486383 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0f58066280 0x7f0f58068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:21.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.054+0000 7f0f70ac3640 1 --2- 172.21.15.45:0/3261486383 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0f58066280 0x7f0f58068730 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0af000 tx=0x7f0f5c0a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:21.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.058+0000 7f0f697fa640 1 -- 172.21.15.45:0/3261486383 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0f600516f0 con 0x7f0f6c0bb5a0 2023-10-03T19:17:21.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.210+0000 7f0f72d27640 1 -- 172.21.15.45:0/3261486383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0f6c04de80 con 0x7f0f6c0bb5a0 2023-10-03T19:17:21.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.214+0000 7f0f697fa640 1 -- 172.21.15.45:0/3261486383 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v63) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0f60054d10 con 0x7f0f6c0bb5a0 2023-10-03T19:17:21.214 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-03T19:17:21.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.214+0000 7f0f72d27640 1 -- 172.21.15.45:0/3261486383 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0f58066280 msgr2=0x7f0f58068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:21.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.214+0000 7f0f72d27640 1 --2- 172.21.15.45:0/3261486383 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0f58066280 0x7f0f58068730 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0af000 tx=0x7f0f5c0a7000 comp rx=0 tx=0).stop 2023-10-03T19:17:21.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.214+0000 7f0f72d27640 1 -- 172.21.15.45:0/3261486383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f6c0bb5a0 msgr2=0x7f0f6c147270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:21.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.214+0000 7f0f72d27640 1 --2- 172.21.15.45:0/3261486383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f6c0bb5a0 0x7f0f6c147270 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000d7d0 tx=0x7f0f6000dc90 comp rx=0 tx=0).stop 2023-10-03T19:17:21.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.214+0000 7f0f72d27640 1 -- 172.21.15.45:0/3261486383 shutdown_connections 2023-10-03T19:17:21.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.214+0000 7f0f72d27640 1 --2- 172.21.15.45:0/3261486383 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0f58066280 0x7f0f58068730 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:21.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.214+0000 7f0f72d27640 1 --2- 172.21.15.45:0/3261486383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f6c148540 0x7f0f6c1477b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:21.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.214+0000 7f0f72d27640 1 --2- 172.21.15.45:0/3261486383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f6c0bb5a0 0x7f0f6c147270 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:21.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.214+0000 7f0f72d27640 1 --2- 172.21.15.45:0/3261486383 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f6c06d630 0x7f0f6c0a5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:21.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.214+0000 7f0f72d27640 1 -- 172.21.15.45:0/3261486383 >> 172.21.15.45:0/3261486383 conn(0x7f0f6c0a20d0 msgr2=0x7f0f6c1596f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:21.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.214+0000 7f0f72d27640 1 -- 172.21.15.45:0/3261486383 shutdown_connections 2023-10-03T19:17:21.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.214+0000 7f0f72d27640 1 -- 172.21.15.45:0/3261486383 wait complete. 2023-10-03T19:17:21.234 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T19:17:21.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.358+0000 7f903e3af640 1 Processor -- start 2023-10-03T19:17:21.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.358+0000 7f903e3af640 1 -- start start 2023-10-03T19:17:21.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.358+0000 7f903e3af640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f903806a3e0 0x7f90380c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:21.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.358+0000 7f903e3af640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f90380a3f80 0x7f90380c1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:21.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.358+0000 7f903e3af640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90380c2a50 con 0x7f90380bf1f0 2023-10-03T19:17:21.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.358+0000 7f903e3af640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90380c2c80 con 0x7f903806a3e0 2023-10-03T19:17:21.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.358+0000 7f903e3af640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90380c0f80 con 0x7f90380a3f80 2023-10-03T19:17:21.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.358+0000 7f9037fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f903806a3e0 0x7f90380c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:21.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.358+0000 7f9037fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f903806a3e0 0x7f90380c0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39416/0 (socket says 172.21.15.45:39416) 2023-10-03T19:17:21.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.358+0000 7f9037fff640 1 -- 172.21.15.45:0/3268652298 learned_addr learned my addr 172.21.15.45:0/3268652298 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:21.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.358+0000 7f903c94c640 1 --1- 172.21.15.45:0/3268652298 >> v1:172.21.15.45:6789/0 conn(0x7f90380bf1f0 0x7f90380a30b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34616/0 (socket says 172.21.15.45:34616) 2023-10-03T19:17:21.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.358+0000 7f90377fe640 1 --2- 172.21.15.45:0/3268652298 >> v2:172.21.15.79:3300/0 conn(0x7f90380a3f80 0x7f90380c1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:21.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.358+0000 7f9037fff640 1 -- 172.21.15.45:0/3268652298 >> v2:172.21.15.79:3300/0 conn(0x7f90380a3f80 msgr2=0x7f90380c1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:21.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.358+0000 7f9037fff640 1 --2- 172.21.15.45:0/3268652298 >> v2:172.21.15.79:3300/0 conn(0x7f90380a3f80 0x7f90380c1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:21.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.358+0000 7f9037fff640 1 -- 172.21.15.45:0/3268652298 >> v1:172.21.15.45:6789/0 conn(0x7f90380bf1f0 legacy=0x7f90380a30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:21.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.358+0000 7f9037fff640 1 -- 172.21.15.45:0/3268652298 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90380bec10 con 0x7f903806a3e0 2023-10-03T19:17:21.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.358+0000 7f9037fff640 1 --2- 172.21.15.45:0/3268652298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f903806a3e0 0x7f90380c0a40 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f903808a8d0 tx=0x7f902c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c1e267b6e6aad78 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:21.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f9036ffd640 1 -- 172.21.15.45:0/3268652298 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c0aa430 con 0x7f903806a3e0 2023-10-03T19:17:21.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f9036ffd640 1 -- 172.21.15.45:0/3268652298 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902c0aa590 con 0x7f903806a3e0 2023-10-03T19:17:21.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f9036ffd640 1 -- 172.21.15.45:0/3268652298 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c0aa920 con 0x7f903806a3e0 2023-10-03T19:17:21.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f903e3af640 1 -- 172.21.15.45:0/3268652298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f903806a3e0 msgr2=0x7f90380c0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:21.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f903e3af640 1 --2- 172.21.15.45:0/3268652298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f903806a3e0 0x7f90380c0a40 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f903808a8d0 tx=0x7f902c01c4d0 comp rx=0 tx=0).stop 2023-10-03T19:17:21.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f903e3af640 1 -- 172.21.15.45:0/3268652298 shutdown_connections 2023-10-03T19:17:21.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f903e3af640 1 --2- 172.21.15.45:0/3268652298 >> v2:172.21.15.79:3300/0 conn(0x7f90380a3f80 0x7f90380c1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:21.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f903e3af640 1 --2- 172.21.15.45:0/3268652298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f903806a3e0 0x7f90380c0a40 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:21.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f903e3af640 1 -- 172.21.15.45:0/3268652298 >> 172.21.15.45:0/3268652298 conn(0x7f90380a6440 msgr2=0x7f90380a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:21.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f903e3af640 1 -- 172.21.15.45:0/3268652298 shutdown_connections 2023-10-03T19:17:21.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f903e3af640 1 -- 172.21.15.45:0/3268652298 wait complete. 2023-10-03T19:17:21.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f903e3af640 1 Processor -- start 2023-10-03T19:17:21.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f903e3af640 1 -- start start 2023-10-03T19:17:21.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f903e3af640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f903806a3e0 0x7f903814ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:21.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f903e3af640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90380a3f80 0x7f903814dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:21.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f903e3af640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90380bf1f0 0x7f903814e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:21.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f903e3af640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903814bf80 con 0x7f90380bf1f0 2023-10-03T19:17:21.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f903e3af640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90380bdfb0 con 0x7f90380a3f80 2023-10-03T19:17:21.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f903e3af640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90380be290 con 0x7f903806a3e0 2023-10-03T19:17:21.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f903c94c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90380bf1f0 0x7f903814e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:21.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f903c94c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90380bf1f0 0x7f903814e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39432/0 (socket says 172.21.15.45:39432) 2023-10-03T19:17:21.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f903c94c640 1 -- 172.21.15.45:0/3616664416 learned_addr learned my addr 172.21.15.45:0/3616664416 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:21.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f9037fff640 1 --2- 172.21.15.45:0/3616664416 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f903806a3e0 0x7f903814ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:21.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f90377fe640 1 --2- 172.21.15.45:0/3616664416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90380a3f80 0x7f903814dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:21.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f903c94c640 1 -- 172.21.15.45:0/3616664416 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f903806a3e0 msgr2=0x7f903814ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:21.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f903c94c640 1 --2- 172.21.15.45:0/3616664416 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f903806a3e0 0x7f903814ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:21.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f903c94c640 1 -- 172.21.15.45:0/3616664416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90380a3f80 msgr2=0x7f903814dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:21.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f903c94c640 1 --2- 172.21.15.45:0/3616664416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90380a3f80 0x7f903814dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:21.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f903c94c640 1 -- 172.21.15.45:0/3616664416 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f902c0094d0 con 0x7f90380bf1f0 2023-10-03T19:17:21.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f903c94c640 1 --2- 172.21.15.45:0/3616664416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90380bf1f0 0x7f903814e4f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f903000c7a0 tx=0x7f903000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:21.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f9034ff9640 1 -- 172.21.15.45:0/3616664416 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903000a640 con 0x7f90380bf1f0 2023-10-03T19:17:21.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f9034ff9640 1 -- 172.21.15.45:0/3616664416 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903000a7a0 con 0x7f90380bf1f0 2023-10-03T19:17:21.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f903e3af640 1 -- 172.21.15.45:0/3616664416 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9038069ad0 con 0x7f90380bf1f0 2023-10-03T19:17:21.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f9034ff9640 1 -- 172.21.15.45:0/3616664416 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903000ab10 con 0x7f90380bf1f0 2023-10-03T19:17:21.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.362+0000 7f903e3af640 1 -- 172.21.15.45:0/3616664416 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90380c2e90 con 0x7f90380bf1f0 2023-10-03T19:17:21.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.366+0000 7f903e3af640 1 -- 172.21.15.45:0/3616664416 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9038153760 con 0x7f90380bf1f0 2023-10-03T19:17:21.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.366+0000 7f9034ff9640 1 -- 172.21.15.45:0/3616664416 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f903000ac70 con 0x7f90380bf1f0 2023-10-03T19:17:21.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.366+0000 7f9034ff9640 1 --2- 172.21.15.45:0/3616664416 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9024066280 0x7f9024068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:21.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.366+0000 7f9034ff9640 1 -- 172.21.15.45:0/3616664416 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f90300834c0 con 0x7f90380bf1f0 2023-10-03T19:17:21.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.366+0000 7f9037fff640 1 --2- 172.21.15.45:0/3616664416 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9024066280 0x7f9024068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:21.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.366+0000 7f9037fff640 1 --2- 172.21.15.45:0/3616664416 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9024066280 0x7f9024068730 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f902c0ae000 tx=0x7f902c0a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:21.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.370+0000 7f9034ff9640 1 -- 172.21.15.45:0/3616664416 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9030050960 con 0x7f90380bf1f0 2023-10-03T19:17:21.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.526+0000 7f903e3af640 1 -- 172.21.15.45:0/3616664416 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f90380be770 con 0x7f90380bf1f0 2023-10-03T19:17:21.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.526+0000 7f9034ff9640 1 -- 172.21.15.45:0/3616664416 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v63) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9030053f80 con 0x7f90380bf1f0 2023-10-03T19:17:21.528 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-03T19:17:21.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.526+0000 7f903e3af640 1 -- 172.21.15.45:0/3616664416 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9024066280 msgr2=0x7f9024068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:21.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.526+0000 7f903e3af640 1 --2- 172.21.15.45:0/3616664416 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9024066280 0x7f9024068730 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f902c0ae000 tx=0x7f902c0a7000 comp rx=0 tx=0).stop 2023-10-03T19:17:21.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.526+0000 7f903e3af640 1 -- 172.21.15.45:0/3616664416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90380bf1f0 msgr2=0x7f903814e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:21.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.526+0000 7f903e3af640 1 --2- 172.21.15.45:0/3616664416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90380bf1f0 0x7f903814e4f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f903000c7a0 tx=0x7f903000cc60 comp rx=0 tx=0).stop 2023-10-03T19:17:21.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.530+0000 7f903e3af640 1 -- 172.21.15.45:0/3616664416 shutdown_connections 2023-10-03T19:17:21.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.530+0000 7f903e3af640 1 --2- 172.21.15.45:0/3616664416 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9024066280 0x7f9024068730 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:21.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.530+0000 7f903e3af640 1 --2- 172.21.15.45:0/3616664416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90380bf1f0 0x7f903814e4f0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:21.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.530+0000 7f903e3af640 1 --2- 172.21.15.45:0/3616664416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90380a3f80 0x7f903814dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:21.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.530+0000 7f903e3af640 1 --2- 172.21.15.45:0/3616664416 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f903806a3e0 0x7f903814ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:21.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.530+0000 7f903e3af640 1 -- 172.21.15.45:0/3616664416 >> 172.21.15.45:0/3616664416 conn(0x7f90380a6440 msgr2=0x7f90380c31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:21.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.530+0000 7f903e3af640 1 -- 172.21.15.45:0/3616664416 shutdown_connections 2023-10-03T19:17:21.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.530+0000 7f903e3af640 1 -- 172.21.15.45:0/3616664416 wait complete. 2023-10-03T19:17:21.547 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:17:21.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.670+0000 7feab1911640 1 Processor -- start 2023-10-03T19:17:21.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.670+0000 7feab1911640 1 -- start start 2023-10-03T19:17:21.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.674+0000 7feab1911640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7feaac1481c0 0x7feaac0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:21.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.674+0000 7feab1911640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaac0bc430 con 0x7feaac14aa50 2023-10-03T19:17:21.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.674+0000 7feab1911640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaac0baf60 con 0x7feaac06cd40 2023-10-03T19:17:21.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.674+0000 7feab1911640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaac0a5db0 con 0x7feaac1481c0 2023-10-03T19:17:21.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.674+0000 7feaab7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7feaac1481c0 0x7feaac0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:21.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.674+0000 7feaab7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7feaac1481c0 0x7feaac0a3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39448/0 (socket says 172.21.15.45:39448) 2023-10-03T19:17:21.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.674+0000 7feaa3fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7feaac14aa50 0x7feaac147ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34630/0 (socket says 172.21.15.45:34630) 2023-10-03T19:17:21.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.674+0000 7feaab7fe640 1 -- 172.21.15.45:0/1660523713 learned_addr learned my addr 172.21.15.45:0/1660523713 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:21.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.674+0000 7feaab7fe640 1 -- 172.21.15.45:0/1660523713 >> v1:172.21.15.79:6789/0 conn(0x7feaac06cd40 legacy=0x7feaac0bbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:21.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.674+0000 7feaab7fe640 1 -- 172.21.15.45:0/1660523713 >> v1:172.21.15.45:6789/0 conn(0x7feaac14aa50 legacy=0x7feaac147ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:21.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.674+0000 7feaab7fe640 1 -- 172.21.15.45:0/1660523713 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac0bb240 con 0x7feaac1481c0 2023-10-03T19:17:21.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.674+0000 7feaaa7fc640 1 -- 172.21.15.45:0/1660523713 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916790731 0 0) 0x7feaac0bc430 con 0x7feaac14aa50 2023-10-03T19:17:21.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.674+0000 7feaab7fe640 1 --2- 172.21.15.45:0/1660523713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaac1481c0 0x7feaac0a3670 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7feaa400af60 tx=0x7feaa40202d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e598d59b93800f18 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:21.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.674+0000 7feaaa7fc640 1 -- 172.21.15.45:0/1660523713 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa400a2d0 con 0x7feaac1481c0 2023-10-03T19:17:21.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.674+0000 7feaaa7fc640 1 -- 172.21.15.45:0/1660523713 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa40ac050 con 0x7feaac1481c0 2023-10-03T19:17:21.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.674+0000 7feaaa7fc640 1 -- 172.21.15.45:0/1660523713 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa4008720 con 0x7feaac1481c0 2023-10-03T19:17:21.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.674+0000 7feab1911640 1 -- 172.21.15.45:0/1660523713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaac1481c0 msgr2=0x7feaac0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:21.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.674+0000 7feab1911640 1 --2- 172.21.15.45:0/1660523713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaac1481c0 0x7feaac0a3670 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7feaa400af60 tx=0x7feaa40202d0 comp rx=0 tx=0).stop 2023-10-03T19:17:21.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.674+0000 7feab1911640 1 -- 172.21.15.45:0/1660523713 shutdown_connections 2023-10-03T19:17:21.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.674+0000 7feab1911640 1 --2- 172.21.15.45:0/1660523713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaac1481c0 0x7feaac0a3670 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:21.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.674+0000 7feab1911640 1 -- 172.21.15.45:0/1660523713 >> 172.21.15.45:0/1660523713 conn(0x7feaac0bcf50 msgr2=0x7feaac0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:21.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.674+0000 7feab1911640 1 -- 172.21.15.45:0/1660523713 shutdown_connections 2023-10-03T19:17:21.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.674+0000 7feab1911640 1 -- 172.21.15.45:0/1660523713 wait complete. 2023-10-03T19:17:21.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.678+0000 7feab1911640 1 Processor -- start 2023-10-03T19:17:21.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.678+0000 7feab1911640 1 -- start start 2023-10-03T19:17:21.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.678+0000 7feab1911640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaac06cd40 0x7feaac1d3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:21.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.678+0000 7feab1911640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaac1481c0 0x7feaac0b9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:21.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.678+0000 7feab1911640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaac14aa50 0x7feaac070c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:21.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.678+0000 7feab1911640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac0c00e0 con 0x7feaac1481c0 2023-10-03T19:17:21.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.678+0000 7feab1911640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac0bfc50 con 0x7feaac06cd40 2023-10-03T19:17:21.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.678+0000 7feab1911640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaac0ba090 con 0x7feaac14aa50 2023-10-03T19:17:21.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.678+0000 7feaa3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaac1481c0 0x7feaac0b9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:21.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.678+0000 7feaa3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaac1481c0 0x7feaac0b9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39462/0 (socket says 172.21.15.45:39462) 2023-10-03T19:17:21.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.678+0000 7feaa3fff640 1 -- 172.21.15.45:0/3474209072 learned_addr learned my addr 172.21.15.45:0/3474209072 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:21.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.678+0000 7feaab7fe640 1 --2- 172.21.15.45:0/3474209072 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaac14aa50 0x7feaac070c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:21.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.678+0000 7feaa3fff640 1 -- 172.21.15.45:0/3474209072 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaac14aa50 msgr2=0x7feaac070c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:21.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.678+0000 7feaa3fff640 1 --2- 172.21.15.45:0/3474209072 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaac14aa50 0x7feaac070c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:21.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.678+0000 7feaa3fff640 1 -- 172.21.15.45:0/3474209072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaac06cd40 msgr2=0x7feaac1d3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:21.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.678+0000 7feaaaffd640 1 --2- 172.21.15.45:0/3474209072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaac06cd40 0x7feaac1d3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:21.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.678+0000 7feaa3fff640 1 --2- 172.21.15.45:0/3474209072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaac06cd40 0x7feaac1d3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:21.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.678+0000 7feaa3fff640 1 -- 172.21.15.45:0/3474209072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa400ac40 con 0x7feaac1481c0 2023-10-03T19:17:21.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.678+0000 7feaa3fff640 1 --2- 172.21.15.45:0/3474209072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaac1481c0 0x7feaac0b9b50 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fea9400c4b0 tx=0x7fea9400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:21.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.678+0000 7feaa8ff9640 1 -- 172.21.15.45:0/3474209072 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea940074e0 con 0x7feaac1481c0 2023-10-03T19:17:21.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.678+0000 7feaa8ff9640 1 -- 172.21.15.45:0/3474209072 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea94007660 con 0x7feaac1481c0 2023-10-03T19:17:21.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.678+0000 7feab1911640 1 -- 172.21.15.45:0/3474209072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaac0bb800 con 0x7feaac1481c0 2023-10-03T19:17:21.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.678+0000 7feaa8ff9640 1 -- 172.21.15.45:0/3474209072 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea94004a30 con 0x7feaac1481c0 2023-10-03T19:17:21.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.678+0000 7feab1911640 1 -- 172.21.15.45:0/3474209072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaac0bb520 con 0x7feaac1481c0 2023-10-03T19:17:21.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.678+0000 7feab1911640 1 -- 172.21.15.45:0/3474209072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaac0bcc90 con 0x7feaac1481c0 2023-10-03T19:17:21.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.682+0000 7feaa8ff9640 1 -- 172.21.15.45:0/3474209072 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fea94004b90 con 0x7feaac1481c0 2023-10-03T19:17:21.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.682+0000 7feaa8ff9640 1 --2- 172.21.15.45:0/3474209072 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fea8c066280 0x7fea8c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:21.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.682+0000 7feaa8ff9640 1 -- 172.21.15.45:0/3474209072 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fea94083130 con 0x7feaac1481c0 2023-10-03T19:17:21.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.682+0000 7feaaaffd640 1 --2- 172.21.15.45:0/3474209072 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fea8c066280 0x7fea8c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:21.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.682+0000 7feaaaffd640 1 --2- 172.21.15.45:0/3474209072 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fea8c066280 0x7fea8c068730 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fea9c007fd0 tx=0x7fea9c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:21.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.686+0000 7feaa8ff9640 1 -- 172.21.15.45:0/3474209072 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fea94050690 con 0x7feaac1481c0 2023-10-03T19:17:21.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.874+0000 7feab1911640 1 -- 172.21.15.45:0/3474209072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feaac04de80 con 0x7feaac1481c0 2023-10-03T19:17:21.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.874+0000 7feaa8ff9640 1 -- 172.21.15.45:0/3474209072 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+3915 (secure 0 0 0) 0x7fea94053cb0 con 0x7feaac1481c0 2023-10-03T19:17:21.875 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:17:21.876 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1808337334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1808337334},{"type":"v1","addr":"172.21.15.45:6835","nonce":1808337334}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5533,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3484102267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3484102267},{"type":"v1","addr":"172.21.15.79:6835","nonce":3484102267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:16:46.297139+0000","modified":"2023-10-03T19:16:48.310624+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5904},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5904":{"gid":5904,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6833/2572156585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2572156585},{"type":"v1","addr":"172.21.15.45:6833","nonce":2572156585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-10-03T19:17:21.876 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 29 2023-10-03T19:17:21.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.874+0000 7feab1911640 1 -- 172.21.15.45:0/3474209072 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fea8c066280 msgr2=0x7fea8c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:21.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.874+0000 7feab1911640 1 --2- 172.21.15.45:0/3474209072 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fea8c066280 0x7fea8c068730 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fea9c007fd0 tx=0x7fea9c009040 comp rx=0 tx=0).stop 2023-10-03T19:17:21.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.874+0000 7feab1911640 1 -- 172.21.15.45:0/3474209072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaac1481c0 msgr2=0x7feaac0b9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:21.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.874+0000 7feab1911640 1 --2- 172.21.15.45:0/3474209072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaac1481c0 0x7feaac0b9b50 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fea9400c4b0 tx=0x7fea9400c970 comp rx=0 tx=0).stop 2023-10-03T19:17:21.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.874+0000 7feab1911640 1 -- 172.21.15.45:0/3474209072 shutdown_connections 2023-10-03T19:17:21.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.874+0000 7feab1911640 1 --2- 172.21.15.45:0/3474209072 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fea8c066280 0x7fea8c068730 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:21.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.874+0000 7feab1911640 1 --2- 172.21.15.45:0/3474209072 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feaac14aa50 0x7feaac070c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:21.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.874+0000 7feab1911640 1 --2- 172.21.15.45:0/3474209072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaac1481c0 0x7feaac0b9b50 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:21.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.874+0000 7feab1911640 1 --2- 172.21.15.45:0/3474209072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaac06cd40 0x7feaac1d3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:21.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.874+0000 7feab1911640 1 -- 172.21.15.45:0/3474209072 >> 172.21.15.45:0/3474209072 conn(0x7feaac0bcf50 msgr2=0x7feaac067930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:21.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.874+0000 7feab1911640 1 -- 172.21.15.45:0/3474209072 shutdown_connections 2023-10-03T19:17:21.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:21.874+0000 7feab1911640 1 -- 172.21.15.45:0/3474209072 wait complete. 2023-10-03T19:17:21.894 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:17:22.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.014+0000 7f3b7fbb8640 1 Processor -- start 2023-10-03T19:17:22.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.014+0000 7f3b7fbb8640 1 -- start start 2023-10-03T19:17:22.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.018+0000 7f3b7fbb8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3b780bcb60 0x7f3b7806c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:22.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.018+0000 7f3b7fbb8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3b7806c7d0 0x7f3b78155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:22.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.018+0000 7f3b7fbb8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b7814b610 con 0x7f3b78148b90 2023-10-03T19:17:22.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.018+0000 7f3b7fbb8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b780a3670 con 0x7f3b7806c7d0 2023-10-03T19:17:22.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.018+0000 7f3b7fbb8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7814b370 con 0x7f3b780bcb60 2023-10-03T19:17:22.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.018+0000 7f3b7d954640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3b78148b90 0x7f3b780bbf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34638/0 (socket says 172.21.15.45:34638) 2023-10-03T19:17:22.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.018+0000 7f3b7d954640 1 -- 172.21.15.45:0/1371142510 learned_addr learned my addr 172.21.15.45:0/1371142510 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:22.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.018+0000 7f3b7e155640 1 --2- 172.21.15.45:0/1371142510 >> v2:172.21.15.45:3300/0 conn(0x7f3b7806c7d0 0x7f3b78155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:22.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.018+0000 7f3b7d153640 1 --2- 172.21.15.45:0/1371142510 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3b780bcb60 0x7f3b7806c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:22.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.018+0000 7f3b7c952640 1 -- 172.21.15.45:0/1371142510 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 245773190 0 0) 0x7f3b7814b610 con 0x7f3b78148b90 2023-10-03T19:17:22.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.018+0000 7f3b7c952640 1 -- 172.21.15.45:0/1371142510 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b60003530 con 0x7f3b78148b90 2023-10-03T19:17:22.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.018+0000 7f3b7e155640 1 -- 172.21.15.45:0/1371142510 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3b780bcb60 msgr2=0x7f3b7806c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:22.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.018+0000 7f3b7e155640 1 --2- 172.21.15.45:0/1371142510 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3b780bcb60 0x7f3b7806c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.018+0000 7f3b7e155640 1 -- 172.21.15.45:0/1371142510 >> v1:172.21.15.45:6789/0 conn(0x7f3b78148b90 legacy=0x7f3b780bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:22.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.018+0000 7f3b7e155640 1 -- 172.21.15.45:0/1371142510 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b780a5580 con 0x7f3b7806c7d0 2023-10-03T19:17:22.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.018+0000 7f3b7e155640 1 --2- 172.21.15.45:0/1371142510 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b7806c7d0 0x7f3b78155cf0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f3b700097c0 tx=0x7f3b7001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a785cbf7e40f96b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:22.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.018+0000 7f3b7c952640 1 -- 172.21.15.45:0/1371142510 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b700a8970 con 0x7f3b7806c7d0 2023-10-03T19:17:22.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.018+0000 7f3b7c952640 1 -- 172.21.15.45:0/1371142510 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b700a8ad0 con 0x7f3b7806c7d0 2023-10-03T19:17:22.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.018+0000 7f3b7c952640 1 -- 172.21.15.45:0/1371142510 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b700a8e60 con 0x7f3b7806c7d0 2023-10-03T19:17:22.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b7fbb8640 1 -- 172.21.15.45:0/1371142510 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b7806c7d0 msgr2=0x7f3b78155cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:22.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b7fbb8640 1 --2- 172.21.15.45:0/1371142510 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b7806c7d0 0x7f3b78155cf0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f3b700097c0 tx=0x7f3b7001ec70 comp rx=0 tx=0).stop 2023-10-03T19:17:22.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b7fbb8640 1 -- 172.21.15.45:0/1371142510 shutdown_connections 2023-10-03T19:17:22.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b7fbb8640 1 --2- 172.21.15.45:0/1371142510 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b7806c7d0 0x7f3b78155cf0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b7fbb8640 1 --2- 172.21.15.45:0/1371142510 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3b780bcb60 0x7f3b7806c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b7fbb8640 1 -- 172.21.15.45:0/1371142510 >> 172.21.15.45:0/1371142510 conn(0x7f3b780bcf50 msgr2=0x7f3b780bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:22.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b7fbb8640 1 -- 172.21.15.45:0/1371142510 shutdown_connections 2023-10-03T19:17:22.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b7fbb8640 1 -- 172.21.15.45:0/1371142510 wait complete. 2023-10-03T19:17:22.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b7fbb8640 1 Processor -- start 2023-10-03T19:17:22.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b7fbb8640 1 -- start start 2023-10-03T19:17:22.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b7fbb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b7806c7d0 0x7f3b78142040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:22.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b7fbb8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3b780bcb60 0x7f3b7814e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:22.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b7fbb8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b78148b90 0x7f3b781e1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:22.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b7fbb8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7814eda0 con 0x7f3b78148b90 2023-10-03T19:17:22.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b7fbb8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7806c4e0 con 0x7f3b7806c7d0 2023-10-03T19:17:22.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b7fbb8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7814eff0 con 0x7f3b780bcb60 2023-10-03T19:17:22.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b7e155640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b78148b90 0x7f3b781e1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:22.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b7e155640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b78148b90 0x7f3b781e1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39490/0 (socket says 172.21.15.45:39490) 2023-10-03T19:17:22.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b7e155640 1 -- 172.21.15.45:0/1143848417 learned_addr learned my addr 172.21.15.45:0/1143848417 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:22.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b7e155640 1 -- 172.21.15.45:0/1143848417 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3b780bcb60 msgr2=0x7f3b7814e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:22.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b7e155640 1 --2- 172.21.15.45:0/1143848417 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3b780bcb60 0x7f3b7814e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b7e155640 1 -- 172.21.15.45:0/1143848417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b7806c7d0 msgr2=0x7f3b78142040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:22.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b7e155640 1 --2- 172.21.15.45:0/1143848417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b7806c7d0 0x7f3b78142040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b7e155640 1 -- 172.21.15.45:0/1143848417 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b70009420 con 0x7f3b78148b90 2023-10-03T19:17:22.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b7e155640 1 --2- 172.21.15.45:0/1143848417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b78148b90 0x7f3b781e1760 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f3b7001c8a0 tx=0x7f3b7001ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:22.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b767fc640 1 -- 172.21.15.45:0/1143848417 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b700b0cc0 con 0x7f3b78148b90 2023-10-03T19:17:22.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b767fc640 1 -- 172.21.15.45:0/1143848417 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b700b0e20 con 0x7f3b78148b90 2023-10-03T19:17:22.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b7fbb8640 1 -- 172.21.15.45:0/1143848417 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b780bc670 con 0x7f3b78148b90 2023-10-03T19:17:22.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b767fc640 1 -- 172.21.15.45:0/1143848417 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b700b9670 con 0x7f3b78148b90 2023-10-03T19:17:22.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b7fbb8640 1 -- 172.21.15.45:0/1143848417 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b780a5820 con 0x7f3b78148b90 2023-10-03T19:17:22.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.022+0000 7f3b7fbb8640 1 -- 172.21.15.45:0/1143848417 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b78148f60 con 0x7f3b78148b90 2023-10-03T19:17:22.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.026+0000 7f3b767fc640 1 -- 172.21.15.45:0/1143848417 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3b700b7040 con 0x7f3b78148b90 2023-10-03T19:17:22.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.026+0000 7f3b767fc640 1 --2- 172.21.15.45:0/1143848417 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3b64066280 0x7f3b64068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:22.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.026+0000 7f3b767fc640 1 -- 172.21.15.45:0/1143848417 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f3b70122340 con 0x7f3b78148b90 2023-10-03T19:17:22.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.026+0000 7f3b7d954640 1 --2- 172.21.15.45:0/1143848417 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3b64066280 0x7f3b64068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:22.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.026+0000 7f3b7d954640 1 --2- 172.21.15.45:0/1143848417 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3b64066280 0x7f3b64068730 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3b68002010 tx=0x7f3b68001600 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.030+0000 7f3b767fc640 1 -- 172.21.15.45:0/1143848417 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3b700ef710 con 0x7f3b78148b90 2023-10-03T19:17:22.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.178+0000 7f3b7fbb8640 1 -- 172.21.15.45:0/1143848417 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b7804de80 con 0x7f3b78148b90 2023-10-03T19:17:22.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.178+0000 7f3b767fc640 1 -- 172.21.15.45:0/1143848417 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+18484 (secure 0 0 0) 0x7f3b700f2d30 con 0x7f3b78148b90 2023-10-03T19:17:22.182 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:17:22.182 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":63,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:17:14.698087+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:16:44.176075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-03T19:16:45.307579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.d","mappings":[{"from":7,"to":2}]},{"pgid":"10.c","mappings":[{"from":7,"to":3}]},{"pgid":"10.10","mappings":[{"from":4,"to":3}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]},{"pgid":"10.37","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:17:22.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.182+0000 7f3b7fbb8640 1 -- 172.21.15.45:0/1143848417 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3b64066280 msgr2=0x7f3b64068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:22.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.182+0000 7f3b7fbb8640 1 --2- 172.21.15.45:0/1143848417 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3b64066280 0x7f3b64068730 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3b68002010 tx=0x7f3b68001600 comp rx=0 tx=0).stop 2023-10-03T19:17:22.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.182+0000 7f3b7fbb8640 1 -- 172.21.15.45:0/1143848417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b78148b90 msgr2=0x7f3b781e1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:22.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.182+0000 7f3b7fbb8640 1 --2- 172.21.15.45:0/1143848417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b78148b90 0x7f3b781e1760 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f3b7001c8a0 tx=0x7f3b7001ba10 comp rx=0 tx=0).stop 2023-10-03T19:17:22.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.182+0000 7f3b7fbb8640 1 -- 172.21.15.45:0/1143848417 shutdown_connections 2023-10-03T19:17:22.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.182+0000 7f3b7fbb8640 1 --2- 172.21.15.45:0/1143848417 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3b64066280 0x7f3b64068730 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.182+0000 7f3b7fbb8640 1 --2- 172.21.15.45:0/1143848417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b78148b90 0x7f3b781e1760 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.182+0000 7f3b7fbb8640 1 --2- 172.21.15.45:0/1143848417 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3b780bcb60 0x7f3b7814e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.182+0000 7f3b7fbb8640 1 --2- 172.21.15.45:0/1143848417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b7806c7d0 0x7f3b78142040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.182+0000 7f3b7fbb8640 1 -- 172.21.15.45:0/1143848417 >> 172.21.15.45:0/1143848417 conn(0x7f3b780bcf50 msgr2=0x7f3b780bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:22.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.182+0000 7f3b7fbb8640 1 -- 172.21.15.45:0/1143848417 shutdown_connections 2023-10-03T19:17:22.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.182+0000 7f3b7fbb8640 1 -- 172.21.15.45:0/1143848417 wait complete. 2023-10-03T19:17:22.201 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-03T19:17:22.201 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:17:22.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.314+0000 7fc5702f7640 1 Processor -- start 2023-10-03T19:17:22.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.314+0000 7fc5702f7640 1 -- start start 2023-10-03T19:17:22.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.314+0000 7fc5702f7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc568070a30 0x7fc568069fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:22.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.314+0000 7fc5702f7640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5680bd700 con 0x7fc5680658f0 2023-10-03T19:17:22.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.314+0000 7fc5702f7640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5680bdcc0 con 0x7fc568069ad0 2023-10-03T19:17:22.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.314+0000 7fc5702f7640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc568070e30 con 0x7fc568070a30 2023-10-03T19:17:22.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56e093640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc5680658f0 0x7fc56814bad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34640/0 (socket says 172.21.15.45:34640) 2023-10-03T19:17:22.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56e093640 1 -- 172.21.15.45:0/3271445881 learned_addr learned my addr 172.21.15.45:0/3271445881 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:22.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56e894640 1 --2- 172.21.15.45:0/3271445881 >> v2:172.21.15.79:3300/0 conn(0x7fc568070a30 0x7fc568069fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:22.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56d091640 1 -- 172.21.15.45:0/3271445881 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1784726686 0 0) 0x7fc5680bd700 con 0x7fc5680658f0 2023-10-03T19:17:22.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56d091640 1 -- 172.21.15.45:0/3271445881 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc554003530 con 0x7fc5680658f0 2023-10-03T19:17:22.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56d091640 1 -- 172.21.15.45:0/3271445881 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4206282892 0 0) 0x7fc554003530 con 0x7fc5680658f0 2023-10-03T19:17:22.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56d091640 1 -- 172.21.15.45:0/3271445881 >> v2:172.21.15.79:3300/0 conn(0x7fc568070a30 msgr2=0x7fc568069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:22.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56d091640 1 --2- 172.21.15.45:0/3271445881 >> v2:172.21.15.79:3300/0 conn(0x7fc568070a30 0x7fc568069fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56d091640 1 -- 172.21.15.45:0/3271445881 >> v1:172.21.15.79:6789/0 conn(0x7fc568069ad0 legacy=0x7fc568157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:22.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56d091640 1 -- 172.21.15.45:0/3271445881 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56814f740 con 0x7fc5680658f0 2023-10-03T19:17:22.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56d091640 1 -- 172.21.15.45:0/3271445881 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fc564001680 con 0x7fc5680658f0 2023-10-03T19:17:22.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56d091640 1 -- 172.21.15.45:0/3271445881 >> v1:172.21.15.45:6789/0 conn(0x7fc5680658f0 legacy=0x7fc56814bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:22.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56d091640 1 --2- 172.21.15.45:0/3271445881 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc554003980 0x7fc554003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:22.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56d091640 1 --2- 172.21.15.45:0/3271445881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5540047d0 0x7fc554004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:22.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56d091640 1 --2- 172.21.15.45:0/3271445881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc554005180 0x7fc55400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:22.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56d091640 1 -- 172.21.15.45:0/3271445881 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc568070e30 con 0x7fc554005180 2023-10-03T19:17:22.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56d091640 1 -- 172.21.15.45:0/3271445881 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55400c000 con 0x7fc5540047d0 2023-10-03T19:17:22.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56d091640 1 -- 172.21.15.45:0/3271445881 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc55400c1c0 con 0x7fc554003980 2023-10-03T19:17:22.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56e894640 1 --2- 172.21.15.45:0/3271445881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc554005180 0x7fc55400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:22.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56e093640 1 --2- 172.21.15.45:0/3271445881 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc554003980 0x7fc554003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:22.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56d892640 1 --2- 172.21.15.45:0/3271445881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5540047d0 0x7fc554004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:22.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56e894640 1 -- 172.21.15.45:0/3271445881 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc554003980 msgr2=0x7fc554003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:22.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56e894640 1 --2- 172.21.15.45:0/3271445881 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc554003980 0x7fc554003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56e894640 1 -- 172.21.15.45:0/3271445881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5540047d0 msgr2=0x7fc554004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:22.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56e894640 1 --2- 172.21.15.45:0/3271445881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5540047d0 0x7fc554004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56e894640 1 -- 172.21.15.45:0/3271445881 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc554003530 con 0x7fc554005180 2023-10-03T19:17:22.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56d892640 1 --2- 172.21.15.45:0/3271445881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5540047d0 0x7fc554004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:22.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56e894640 1 -- 172.21.15.45:0/3271445881 reap_dead start 2023-10-03T19:17:22.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56e894640 1 --2- 172.21.15.45:0/3271445881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc554005180 0x7fc55400b990 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fc560009fc0 tx=0x7fc56001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d008b3ff16a2ea97 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:22.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56d091640 1 -- 172.21.15.45:0/3271445881 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5600a5cb0 con 0x7fc554005180 2023-10-03T19:17:22.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56d091640 1 -- 172.21.15.45:0/3271445881 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56000f040 con 0x7fc554005180 2023-10-03T19:17:22.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc56d091640 1 -- 172.21.15.45:0/3271445881 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc560003be0 con 0x7fc554005180 2023-10-03T19:17:22.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc5702f7640 1 -- 172.21.15.45:0/3271445881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc554005180 msgr2=0x7fc55400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:22.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.318+0000 7fc5702f7640 1 --2- 172.21.15.45:0/3271445881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc554005180 0x7fc55400b990 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fc560009fc0 tx=0x7fc56001cca0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.322+0000 7fc5702f7640 1 -- 172.21.15.45:0/3271445881 shutdown_connections 2023-10-03T19:17:22.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.322+0000 7fc5702f7640 1 --2- 172.21.15.45:0/3271445881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc554005180 0x7fc55400b990 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.322+0000 7fc5702f7640 1 -- 172.21.15.45:0/3271445881 >> 172.21.15.45:0/3271445881 conn(0x7fc5680bed00 msgr2=0x7fc56806d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:22.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.322+0000 7fc5702f7640 1 -- 172.21.15.45:0/3271445881 shutdown_connections 2023-10-03T19:17:22.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.322+0000 7fc5702f7640 1 -- 172.21.15.45:0/3271445881 wait complete. 2023-10-03T19:17:22.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.322+0000 7fc5702f7640 1 Processor -- start 2023-10-03T19:17:22.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.322+0000 7fc5702f7640 1 -- start start 2023-10-03T19:17:22.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.322+0000 7fc5702f7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc554005180 0x7fc5680a55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:22.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.322+0000 7fc5702f7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc568070230 0x7fc5680c07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:22.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.322+0000 7fc5702f7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc568151dc0 0x7fc5681507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:22.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.322+0000 7fc5702f7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5680c0d10 con 0x7fc554005180 2023-10-03T19:17:22.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.322+0000 7fc5702f7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5681daa60 con 0x7fc568070230 2023-10-03T19:17:22.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.322+0000 7fc5702f7640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5681dad40 con 0x7fc568151dc0 2023-10-03T19:17:22.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.322+0000 7fc56e093640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc554005180 0x7fc5680a55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:22.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.322+0000 7fc56e093640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc554005180 0x7fc5680a55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39512/0 (socket says 172.21.15.45:39512) 2023-10-03T19:17:22.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.322+0000 7fc56e093640 1 -- 172.21.15.45:0/956507874 learned_addr learned my addr 172.21.15.45:0/956507874 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:22.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.322+0000 7fc56d892640 1 --2- 172.21.15.45:0/956507874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc568070230 0x7fc5680c07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:22.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.322+0000 7fc56e894640 1 --2- 172.21.15.45:0/956507874 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc568151dc0 0x7fc5681507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:22.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.322+0000 7fc56e093640 1 -- 172.21.15.45:0/956507874 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc568151dc0 msgr2=0x7fc5681507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:22.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.322+0000 7fc56e093640 1 --2- 172.21.15.45:0/956507874 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc568151dc0 0x7fc5681507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.322+0000 7fc56e093640 1 -- 172.21.15.45:0/956507874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc568070230 msgr2=0x7fc5680c07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:22.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.322+0000 7fc56e093640 1 --2- 172.21.15.45:0/956507874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc568070230 0x7fc5680c07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.322+0000 7fc56e093640 1 -- 172.21.15.45:0/956507874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5680a3ff0 con 0x7fc554005180 2023-10-03T19:17:22.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.322+0000 7fc56e093640 1 --2- 172.21.15.45:0/956507874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc554005180 0x7fc5680a55d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fc564007fd0 tx=0x7fc56400db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:22.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.322+0000 7fc55effd640 1 -- 172.21.15.45:0/956507874 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5640072d0 con 0x7fc554005180 2023-10-03T19:17:22.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.322+0000 7fc55effd640 1 -- 172.21.15.45:0/956507874 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc564007430 con 0x7fc554005180 2023-10-03T19:17:22.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.322+0000 7fc5702f7640 1 -- 172.21.15.45:0/956507874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc568065cc0 con 0x7fc554005180 2023-10-03T19:17:22.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.322+0000 7fc55effd640 1 -- 172.21.15.45:0/956507874 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5640047f0 con 0x7fc554005180 2023-10-03T19:17:22.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.322+0000 7fc5702f7640 1 -- 172.21.15.45:0/956507874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5681db020 con 0x7fc554005180 2023-10-03T19:17:22.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.322+0000 7fc5702f7640 1 -- 172.21.15.45:0/956507874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5680a4180 con 0x7fc554005180 2023-10-03T19:17:22.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.326+0000 7fc55effd640 1 -- 172.21.15.45:0/956507874 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc564004950 con 0x7fc554005180 2023-10-03T19:17:22.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.326+0000 7fc55effd640 1 --2- 172.21.15.45:0/956507874 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc54c066280 0x7fc54c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:22.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.326+0000 7fc55effd640 1 -- 172.21.15.45:0/956507874 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fc5640835d0 con 0x7fc554005180 2023-10-03T19:17:22.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.326+0000 7fc56d892640 1 --2- 172.21.15.45:0/956507874 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc54c066280 0x7fc54c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:22.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.326+0000 7fc56d892640 1 --2- 172.21.15.45:0/956507874 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc54c066280 0x7fc54c068730 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc56814b640 tx=0x7fc558009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:22.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.330+0000 7fc55effd640 1 -- 172.21.15.45:0/956507874 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc5680a4180 con 0x7fc554005180 2023-10-03T19:17:22.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.506+0000 7fc5702f7640 1 -- 172.21.15.45:0/956507874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5680a4180 con 0x7fc554005180 2023-10-03T19:17:22.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.510+0000 7fc55effd640 1 -- 172.21.15.45:0/956507874 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+3915 (secure 0 0 0) 0x7fc5680a4180 con 0x7fc554005180 2023-10-03T19:17:22.510 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:17:22.510 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1808337334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1808337334},{"type":"v1","addr":"172.21.15.45:6835","nonce":1808337334}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5533,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3484102267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3484102267},{"type":"v1","addr":"172.21.15.79:6835","nonce":3484102267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:16:46.297139+0000","modified":"2023-10-03T19:16:48.310624+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5904},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5904":{"gid":5904,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6833/2572156585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2572156585},{"type":"v1","addr":"172.21.15.45:6833","nonce":2572156585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-10-03T19:17:22.511 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 29 2023-10-03T19:17:22.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.510+0000 7fc5702f7640 1 -- 172.21.15.45:0/956507874 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc54c066280 msgr2=0x7fc54c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:22.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.510+0000 7fc5702f7640 1 --2- 172.21.15.45:0/956507874 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc54c066280 0x7fc54c068730 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc56814b640 tx=0x7fc558009040 comp rx=0 tx=0).stop 2023-10-03T19:17:22.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.510+0000 7fc5702f7640 1 -- 172.21.15.45:0/956507874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc554005180 msgr2=0x7fc5680a55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:22.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.510+0000 7fc5702f7640 1 --2- 172.21.15.45:0/956507874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc554005180 0x7fc5680a55d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fc564007fd0 tx=0x7fc56400db40 comp rx=0 tx=0).stop 2023-10-03T19:17:22.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.510+0000 7fc5702f7640 1 -- 172.21.15.45:0/956507874 shutdown_connections 2023-10-03T19:17:22.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.510+0000 7fc5702f7640 1 --2- 172.21.15.45:0/956507874 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc54c066280 0x7fc54c068730 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.510+0000 7fc5702f7640 1 --2- 172.21.15.45:0/956507874 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc568151dc0 0x7fc5681507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.510+0000 7fc5702f7640 1 --2- 172.21.15.45:0/956507874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc568070230 0x7fc5680c07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.510+0000 7fc5702f7640 1 --2- 172.21.15.45:0/956507874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc554005180 0x7fc5680a55d0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.510+0000 7fc5702f7640 1 -- 172.21.15.45:0/956507874 >> 172.21.15.45:0/956507874 conn(0x7fc5680bed00 msgr2=0x7fc56814aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:22.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.510+0000 7fc5702f7640 1 -- 172.21.15.45:0/956507874 shutdown_connections 2023-10-03T19:17:22.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.510+0000 7fc5702f7640 1 -- 172.21.15.45:0/956507874 wait complete. 2023-10-03T19:17:22.528 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:17:22.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb8592640 1 Processor -- start 2023-10-03T19:17:22.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb8592640 1 -- start start 2023-10-03T19:17:22.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb8592640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7bb00bcb60 0x7f7bb006c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:22.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb8592640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bb014b610 con 0x7f7bb0148b90 2023-10-03T19:17:22.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb8592640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bb00a5580 con 0x7f7bb006c7d0 2023-10-03T19:17:22.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb8592640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb00a3670 con 0x7f7bb00bcb60 2023-10-03T19:17:22.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb632e640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7bb0148b90 0x7f7bb00bbf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34642/0 (socket says 172.21.15.45:34642) 2023-10-03T19:17:22.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb632e640 1 -- 172.21.15.45:0/4188712414 learned_addr learned my addr 172.21.15.45:0/4188712414 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:22.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb5b2d640 1 --2- 172.21.15.45:0/4188712414 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7bb00bcb60 0x7f7bb006c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:22.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb532c640 1 -- 172.21.15.45:0/4188712414 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1861279843 0 0) 0x7f7bb014b610 con 0x7f7bb0148b90 2023-10-03T19:17:22.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb532c640 1 -- 172.21.15.45:0/4188712414 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b9c003530 con 0x7f7bb0148b90 2023-10-03T19:17:22.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb532c640 1 -- 172.21.15.45:0/4188712414 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2798579969 0 0) 0x7f7b9c003530 con 0x7f7bb0148b90 2023-10-03T19:17:22.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb532c640 1 -- 172.21.15.45:0/4188712414 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7bb00bcb60 msgr2=0x7f7bb006c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:22.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb532c640 1 --2- 172.21.15.45:0/4188712414 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7bb00bcb60 0x7f7bb006c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb532c640 1 -- 172.21.15.45:0/4188712414 >> v1:172.21.15.79:6789/0 conn(0x7f7bb006c7d0 legacy=0x7f7bb0155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:22.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb532c640 1 -- 172.21.15.45:0/4188712414 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb00a5820 con 0x7f7bb0148b90 2023-10-03T19:17:22.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb532c640 1 -- 172.21.15.45:0/4188712414 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f7bac001680 con 0x7f7bb0148b90 2023-10-03T19:17:22.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb532c640 1 -- 172.21.15.45:0/4188712414 >> v1:172.21.15.45:6789/0 conn(0x7f7bb0148b90 legacy=0x7f7bb00bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:22.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb532c640 1 --2- 172.21.15.45:0/4188712414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b9c0039b0 0x7f7b9c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:22.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb532c640 1 --2- 172.21.15.45:0/4188712414 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7bb00bcb60 0x7f7b9c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:22.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb532c640 1 --2- 172.21.15.45:0/4188712414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b9c004d10 0x7f7b9c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:22.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb532c640 1 -- 172.21.15.45:0/4188712414 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb00a3670 con 0x7f7b9c0039b0 2023-10-03T19:17:22.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb532c640 1 -- 172.21.15.45:0/4188712414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c00bad0 con 0x7f7b9c004d10 2023-10-03T19:17:22.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb532c640 1 -- 172.21.15.45:0/4188712414 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c00bc60 con 0x7f7bb00bcb60 2023-10-03T19:17:22.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb632e640 1 --2- 172.21.15.45:0/4188712414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b9c0039b0 0x7f7b9c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:22.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb5b2d640 1 --2- 172.21.15.45:0/4188712414 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7bb00bcb60 0x7f7b9c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:22.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb632e640 1 -- 172.21.15.45:0/4188712414 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7bb00bcb60 msgr2=0x7f7b9c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:22.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb632e640 1 --2- 172.21.15.45:0/4188712414 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7bb00bcb60 0x7f7b9c0047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb632e640 1 -- 172.21.15.45:0/4188712414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b9c004d10 msgr2=0x7f7b9c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:22.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb632e640 1 --2- 172.21.15.45:0/4188712414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b9c004d10 0x7f7b9c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.638+0000 7f7bb632e640 1 -- 172.21.15.45:0/4188712414 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9c003530 con 0x7f7b9c0039b0 2023-10-03T19:17:22.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.642+0000 7f7bb632e640 1 --2- 172.21.15.45:0/4188712414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b9c0039b0 0x7f7b9c003dc0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f7bac00c240 tx=0x7f7bac01f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42347bfafe9e9210 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.642+0000 7f7bb532c640 1 -- 172.21.15.45:0/4188712414 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac005ae0 con 0x7f7b9c0039b0 2023-10-03T19:17:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.642+0000 7f7bb532c640 1 -- 172.21.15.45:0/4188712414 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bac0ab070 con 0x7f7b9c0039b0 2023-10-03T19:17:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.642+0000 7f7bb532c640 1 -- 172.21.15.45:0/4188712414 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac007070 con 0x7f7b9c0039b0 2023-10-03T19:17:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.642+0000 7f7bb8592640 1 -- 172.21.15.45:0/4188712414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b9c0039b0 msgr2=0x7f7b9c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.642+0000 7f7bb8592640 1 --2- 172.21.15.45:0/4188712414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b9c0039b0 0x7f7b9c003dc0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f7bac00c240 tx=0x7f7bac01f3b0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.642+0000 7f7bb6b2f640 1 -- 172.21.15.45:0/4188712414 reap_dead start 2023-10-03T19:17:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.642+0000 7f7bb8592640 1 -- 172.21.15.45:0/4188712414 shutdown_connections 2023-10-03T19:17:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.642+0000 7f7bb8592640 1 -- 172.21.15.45:0/4188712414 >> 172.21.15.45:0/4188712414 conn(0x7f7bb00bcf50 msgr2=0x7f7bb00bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.642+0000 7f7bb8592640 1 -- 172.21.15.45:0/4188712414 shutdown_connections 2023-10-03T19:17:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.642+0000 7f7bb8592640 1 -- 172.21.15.45:0/4188712414 wait complete. 2023-10-03T19:17:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.642+0000 7f7bb8592640 1 Processor -- start 2023-10-03T19:17:22.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.642+0000 7f7bb8592640 1 -- start start 2023-10-03T19:17:22.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.642+0000 7f7bb8592640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b9c0039b0 0x7f7bb00b98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:22.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.642+0000 7f7bb8592640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bb00b9e30 0x7f7bb006f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:22.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.642+0000 7f7bb8592640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bb0070b90 0x7f7bb006fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:22.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.642+0000 7f7bb8592640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb014f0a0 con 0x7f7bb00b9e30 2023-10-03T19:17:22.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.642+0000 7f7bb8592640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb00be2a0 con 0x7f7bb0070b90 2023-10-03T19:17:22.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.642+0000 7f7bb8592640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb013e010 con 0x7f7b9c0039b0 2023-10-03T19:17:22.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.642+0000 7f7bb5b2d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bb00b9e30 0x7f7bb006f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:22.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.642+0000 7f7bb5b2d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bb00b9e30 0x7f7bb006f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39536/0 (socket says 172.21.15.45:39536) 2023-10-03T19:17:22.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.642+0000 7f7bb5b2d640 1 -- 172.21.15.45:0/3927158270 learned_addr learned my addr 172.21.15.45:0/3927158270 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:22.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.642+0000 7f7bb632e640 1 --2- 172.21.15.45:0/3927158270 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b9c0039b0 0x7f7bb00b98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:22.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.642+0000 7f7bb6b2f640 1 --2- 172.21.15.45:0/3927158270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bb0070b90 0x7f7bb006fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:22.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.642+0000 7f7bb5b2d640 1 -- 172.21.15.45:0/3927158270 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b9c0039b0 msgr2=0x7f7bb00b98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:22.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.642+0000 7f7bb5b2d640 1 --2- 172.21.15.45:0/3927158270 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b9c0039b0 0x7f7bb00b98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.642+0000 7f7bb5b2d640 1 -- 172.21.15.45:0/3927158270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bb0070b90 msgr2=0x7f7bb006fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:22.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.642+0000 7f7bb5b2d640 1 --2- 172.21.15.45:0/3927158270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bb0070b90 0x7f7bb006fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.642+0000 7f7bb5b2d640 1 -- 172.21.15.45:0/3927158270 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb0148f60 con 0x7f7bb00b9e30 2023-10-03T19:17:22.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.642+0000 7f7bb5b2d640 1 --2- 172.21.15.45:0/3927158270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bb00b9e30 0x7f7bb006f910 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0010890 tx=0x7f7ba0010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:22.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.646+0000 7f7ba6ffd640 1 -- 172.21.15.45:0/3927158270 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0009630 con 0x7f7bb00b9e30 2023-10-03T19:17:22.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.646+0000 7f7ba6ffd640 1 -- 172.21.15.45:0/3927158270 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba000eb60 con 0x7f7bb00b9e30 2023-10-03T19:17:22.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.646+0000 7f7bb8592640 1 -- 172.21.15.45:0/3927158270 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb00bc670 con 0x7f7bb00b9e30 2023-10-03T19:17:22.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.646+0000 7f7ba6ffd640 1 -- 172.21.15.45:0/3927158270 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba001c400 con 0x7f7bb00b9e30 2023-10-03T19:17:22.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.646+0000 7f7bb8592640 1 -- 172.21.15.45:0/3927158270 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb00a3880 con 0x7f7bb00b9e30 2023-10-03T19:17:22.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.646+0000 7f7bb8592640 1 -- 172.21.15.45:0/3927158270 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb004de80 con 0x7f7bb00b9e30 2023-10-03T19:17:22.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.646+0000 7f7ba6ffd640 1 -- 172.21.15.45:0/3927158270 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7ba001c560 con 0x7f7bb00b9e30 2023-10-03T19:17:22.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.646+0000 7f7ba6ffd640 1 --2- 172.21.15.45:0/3927158270 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7b94066280 0x7f7b94068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:22.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.646+0000 7f7ba6ffd640 1 -- 172.21.15.45:0/3927158270 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f7ba0084220 con 0x7f7bb00b9e30 2023-10-03T19:17:22.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.646+0000 7f7bb632e640 1 --2- 172.21.15.45:0/3927158270 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7b94066280 0x7f7b94068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:22.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.646+0000 7f7bb632e640 1 --2- 172.21.15.45:0/3927158270 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7b94066280 0x7f7b94068730 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7bac0af000 tx=0x7f7bac0aa000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:22.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.650+0000 7f7ba6ffd640 1 -- 172.21.15.45:0/3927158270 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7ba00516a0 con 0x7f7bb00b9e30 2023-10-03T19:17:22.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.838+0000 7f7bb8592640 1 -- 172.21.15.45:0/3927158270 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7bb00bfeb0 con 0x7f7bb00b9e30 2023-10-03T19:17:22.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.838+0000 7f7ba6ffd640 1 -- 172.21.15.45:0/3927158270 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+3915 (secure 0 0 0) 0x7f7ba0054cc0 con 0x7f7bb00b9e30 2023-10-03T19:17:22.841 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:17:22.841 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1808337334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1808337334},{"type":"v1","addr":"172.21.15.45:6835","nonce":1808337334}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5533,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3484102267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3484102267},{"type":"v1","addr":"172.21.15.79:6835","nonce":3484102267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:16:46.297139+0000","modified":"2023-10-03T19:16:48.310624+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5904},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5904":{"gid":5904,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6833/2572156585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2572156585},{"type":"v1","addr":"172.21.15.45:6833","nonce":2572156585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-10-03T19:17:22.841 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 29 2023-10-03T19:17:22.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.842+0000 7f7bb8592640 1 -- 172.21.15.45:0/3927158270 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7b94066280 msgr2=0x7f7b94068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:22.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.842+0000 7f7bb8592640 1 --2- 172.21.15.45:0/3927158270 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7b94066280 0x7f7b94068730 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7bac0af000 tx=0x7f7bac0aa000 comp rx=0 tx=0).stop 2023-10-03T19:17:22.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.842+0000 7f7bb8592640 1 -- 172.21.15.45:0/3927158270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bb00b9e30 msgr2=0x7f7bb006f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:22.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.842+0000 7f7bb8592640 1 --2- 172.21.15.45:0/3927158270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bb00b9e30 0x7f7bb006f910 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0010890 tx=0x7f7ba0010d50 comp rx=0 tx=0).stop 2023-10-03T19:17:22.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.842+0000 7f7bb8592640 1 -- 172.21.15.45:0/3927158270 shutdown_connections 2023-10-03T19:17:22.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.842+0000 7f7bb8592640 1 --2- 172.21.15.45:0/3927158270 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7b94066280 0x7f7b94068730 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.842+0000 7f7bb8592640 1 --2- 172.21.15.45:0/3927158270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bb0070b90 0x7f7bb006fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.842+0000 7f7bb8592640 1 --2- 172.21.15.45:0/3927158270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bb00b9e30 0x7f7bb006f910 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.842+0000 7f7bb8592640 1 --2- 172.21.15.45:0/3927158270 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b9c0039b0 0x7f7bb00b98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.842+0000 7f7bb8592640 1 -- 172.21.15.45:0/3927158270 >> 172.21.15.45:0/3927158270 conn(0x7f7bb00bcf50 msgr2=0x7f7bb00bf390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:22.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.842+0000 7f7bb8592640 1 -- 172.21.15.45:0/3927158270 shutdown_connections 2023-10-03T19:17:22.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.842+0000 7f7bb8592640 1 -- 172.21.15.45:0/3927158270 wait complete. 2023-10-03T19:17:22.860 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:17:22.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe0672ae640 1 Processor -- start 2023-10-03T19:17:22.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe0672ae640 1 -- start start 2023-10-03T19:17:22.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe0672ae640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0600bc8b0 0x7fe06014ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:22.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe0672ae640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe06006cac0 con 0x7fe06006f170 2023-10-03T19:17:22.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe0672ae640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0600720d0 con 0x7fe06006d170 2023-10-03T19:17:22.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe0672ae640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0600a5ab0 con 0x7fe0600bc8b0 2023-10-03T19:17:22.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe06504a640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe06006f170 0x7fe060150190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34658/0 (socket says 172.21.15.45:34658) 2023-10-03T19:17:22.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe06504a640 1 -- 172.21.15.45:0/23183866 learned_addr learned my addr 172.21.15.45:0/23183866 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:22.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe064849640 1 --2- 172.21.15.45:0/23183866 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0600bc8b0 0x7fe06014ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:22.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe053fff640 1 -- 172.21.15.45:0/23183866 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2337976943 0 0) 0x7fe05c001120 con 0x7fe06006f170 2023-10-03T19:17:22.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe053fff640 1 -- 172.21.15.45:0/23183866 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe04c003530 con 0x7fe06006f170 2023-10-03T19:17:22.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe053fff640 1 -- 172.21.15.45:0/23183866 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2309918851 0 0) 0x7fe04c003530 con 0x7fe06006f170 2023-10-03T19:17:22.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe053fff640 1 -- 172.21.15.45:0/23183866 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0600bc8b0 msgr2=0x7fe06014ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:22.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe053fff640 1 --2- 172.21.15.45:0/23183866 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0600bc8b0 0x7fe06014ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe053fff640 1 -- 172.21.15.45:0/23183866 >> v1:172.21.15.79:6789/0 conn(0x7fe06006d170 legacy=0x7fe06014cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:22.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe053fff640 1 -- 172.21.15.45:0/23183866 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe06006cd00 con 0x7fe06006f170 2023-10-03T19:17:22.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe053fff640 1 -- 172.21.15.45:0/23183866 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fe05c001810 con 0x7fe06006f170 2023-10-03T19:17:22.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe053fff640 1 -- 172.21.15.45:0/23183866 >> v1:172.21.15.45:6789/0 conn(0x7fe06006f170 legacy=0x7fe060150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:22.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe053fff640 1 --2- 172.21.15.45:0/23183866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe04c0039b0 0x7fe04c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:22.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe053fff640 1 --2- 172.21.15.45:0/23183866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe04c004350 0x7fe04c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:22.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe053fff640 1 --2- 172.21.15.45:0/23183866 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0600bc8b0 0x7fe04c005070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:22.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe053fff640 1 -- 172.21.15.45:0/23183866 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0600a5ab0 con 0x7fe04c004350 2023-10-03T19:17:22.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe053fff640 1 -- 172.21.15.45:0/23183866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c00b990 con 0x7fe04c0039b0 2023-10-03T19:17:22.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe053fff640 1 -- 172.21.15.45:0/23183866 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c00bb20 con 0x7fe0600bc8b0 2023-10-03T19:17:22.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe064849640 1 --2- 172.21.15.45:0/23183866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe04c004350 0x7fe04c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:22.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe06584b640 1 --2- 172.21.15.45:0/23183866 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0600bc8b0 0x7fe04c005070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:22.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe06504a640 1 --2- 172.21.15.45:0/23183866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe04c0039b0 0x7fe04c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:22.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe064849640 1 -- 172.21.15.45:0/23183866 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0600bc8b0 msgr2=0x7fe04c005070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:22.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe064849640 1 --2- 172.21.15.45:0/23183866 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0600bc8b0 0x7fe04c005070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe064849640 1 -- 172.21.15.45:0/23183866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe04c0039b0 msgr2=0x7fe04c003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:22.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe064849640 1 --2- 172.21.15.45:0/23183866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe04c0039b0 0x7fe04c003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.986+0000 7fe064849640 1 -- 172.21.15.45:0/23183866 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c003530 con 0x7fe04c004350 2023-10-03T19:17:22.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.990+0000 7fe064849640 1 --2- 172.21.15.45:0/23183866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe04c004350 0x7fe04c004810 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fe054009ae0 tx=0x7fe05401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=199f7d3a052f3cb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:22.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.990+0000 7fe053fff640 1 -- 172.21.15.45:0/23183866 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0540a5640 con 0x7fe04c004350 2023-10-03T19:17:22.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.990+0000 7fe053fff640 1 -- 172.21.15.45:0/23183866 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0540a57a0 con 0x7fe04c004350 2023-10-03T19:17:22.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.990+0000 7fe053fff640 1 -- 172.21.15.45:0/23183866 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0540a5b50 con 0x7fe04c004350 2023-10-03T19:17:22.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.990+0000 7fe0672ae640 1 -- 172.21.15.45:0/23183866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe04c004350 msgr2=0x7fe04c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:22.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.990+0000 7fe0672ae640 1 --2- 172.21.15.45:0/23183866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe04c004350 0x7fe04c004810 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fe054009ae0 tx=0x7fe05401ca50 comp rx=0 tx=0).stop 2023-10-03T19:17:22.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.990+0000 7fe06584b640 1 -- 172.21.15.45:0/23183866 reap_dead start 2023-10-03T19:17:22.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.990+0000 7fe0672ae640 1 -- 172.21.15.45:0/23183866 shutdown_connections 2023-10-03T19:17:22.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.990+0000 7fe0672ae640 1 -- 172.21.15.45:0/23183866 >> 172.21.15.45:0/23183866 conn(0x7fe0600bcf50 msgr2=0x7fe0600bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:22.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.990+0000 7fe0672ae640 1 -- 172.21.15.45:0/23183866 shutdown_connections 2023-10-03T19:17:22.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.990+0000 7fe0672ae640 1 -- 172.21.15.45:0/23183866 wait complete. 2023-10-03T19:17:22.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.990+0000 7fe0672ae640 1 Processor -- start 2023-10-03T19:17:22.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.990+0000 7fe0672ae640 1 -- start start 2023-10-03T19:17:22.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.990+0000 7fe0672ae640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe04c004350 0x7fe0600b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:22.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.990+0000 7fe0672ae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0600bbca0 0x7fe0601e1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:22.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.990+0000 7fe0672ae640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0601e1f80 0x7fe0601e4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:22.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.990+0000 7fe0672ae640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe060147b50 con 0x7fe0600bbca0 2023-10-03T19:17:22.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.990+0000 7fe0672ae640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe060147660 con 0x7fe0601e1f80 2023-10-03T19:17:22.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.990+0000 7fe0672ae640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0601e15f0 con 0x7fe04c004350 2023-10-03T19:17:22.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.990+0000 7fe064849640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0600bbca0 0x7fe0601e1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:22.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.990+0000 7fe064849640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0600bbca0 0x7fe0601e1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39554/0 (socket says 172.21.15.45:39554) 2023-10-03T19:17:22.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.990+0000 7fe064849640 1 -- 172.21.15.45:0/3387693537 learned_addr learned my addr 172.21.15.45:0/3387693537 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:22.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.994+0000 7fe06504a640 1 --2- 172.21.15.45:0/3387693537 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe04c004350 0x7fe0600b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:22.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.994+0000 7fe06584b640 1 --2- 172.21.15.45:0/3387693537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0601e1f80 0x7fe0601e4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:22.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.994+0000 7fe064849640 1 -- 172.21.15.45:0/3387693537 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe04c004350 msgr2=0x7fe0600b7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:22.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.994+0000 7fe064849640 1 --2- 172.21.15.45:0/3387693537 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe04c004350 0x7fe0600b7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.994+0000 7fe064849640 1 -- 172.21.15.45:0/3387693537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0601e1f80 msgr2=0x7fe0601e4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:22.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.994+0000 7fe064849640 1 --2- 172.21.15.45:0/3387693537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0601e1f80 0x7fe0601e4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:22.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.994+0000 7fe064849640 1 -- 172.21.15.45:0/3387693537 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe06014c4a0 con 0x7fe0600bbca0 2023-10-03T19:17:22.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.994+0000 7fe06504a640 1 --2- 172.21.15.45:0/3387693537 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe04c004350 0x7fe0600b7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:17:22.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.994+0000 7fe064849640 1 --2- 172.21.15.45:0/3387693537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0600bbca0 0x7fe0601e1a40 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fe054009ae0 tx=0x7fe04c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:22.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.994+0000 7fe051ffb640 1 -- 172.21.15.45:0/3387693537 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe054004230 con 0x7fe0600bbca0 2023-10-03T19:17:22.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.994+0000 7fe051ffb640 1 -- 172.21.15.45:0/3387693537 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe054004390 con 0x7fe0600bbca0 2023-10-03T19:17:22.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.994+0000 7fe0672ae640 1 -- 172.21.15.45:0/3387693537 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe06014fae0 con 0x7fe0600bbca0 2023-10-03T19:17:22.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.994+0000 7fe051ffb640 1 -- 172.21.15.45:0/3387693537 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0540ad850 con 0x7fe0600bbca0 2023-10-03T19:17:22.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.994+0000 7fe0672ae640 1 -- 172.21.15.45:0/3387693537 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe06006f540 con 0x7fe0600bbca0 2023-10-03T19:17:22.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.994+0000 7fe0672ae640 1 -- 172.21.15.45:0/3387693537 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe06006d660 con 0x7fe0600bbca0 2023-10-03T19:17:22.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.994+0000 7fe051ffb640 1 -- 172.21.15.45:0/3387693537 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe0540b4040 con 0x7fe0600bbca0 2023-10-03T19:17:22.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.994+0000 7fe051ffb640 1 --2- 172.21.15.45:0/3387693537 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe044066280 0x7fe044068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:22.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.994+0000 7fe051ffb640 1 -- 172.21.15.45:0/3387693537 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fe05411dd20 con 0x7fe0600bbca0 2023-10-03T19:17:22.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.994+0000 7fe06504a640 1 --2- 172.21.15.45:0/3387693537 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe044066280 0x7fe044068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:22.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.994+0000 7fe06504a640 1 --2- 172.21.15.45:0/3387693537 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe044066280 0x7fe044068730 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe05c005320 tx=0x7fe05c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:23.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:22.998+0000 7fe051ffb640 1 -- 172.21.15.45:0/3387693537 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe0540eb240 con 0x7fe0600bbca0 2023-10-03T19:17:23.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.146+0000 7fe0672ae640 1 -- 172.21.15.45:0/3387693537 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe06004de80 con 0x7fe0600bbca0 2023-10-03T19:17:23.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.150+0000 7fe051ffb640 1 -- 172.21.15.45:0/3387693537 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+18484 (secure 0 0 0) 0x7fe0540c0090 con 0x7fe0600bbca0 2023-10-03T19:17:23.151 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:17:23.152 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":63,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:17:14.698087+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:16:44.176075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-03T19:16:45.307579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.d","mappings":[{"from":7,"to":2}]},{"pgid":"10.c","mappings":[{"from":7,"to":3}]},{"pgid":"10.10","mappings":[{"from":4,"to":3}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]},{"pgid":"10.37","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:17:23.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.150+0000 7fe0672ae640 1 -- 172.21.15.45:0/3387693537 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe044066280 msgr2=0x7fe044068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:23.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.150+0000 7fe0672ae640 1 --2- 172.21.15.45:0/3387693537 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe044066280 0x7fe044068730 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe05c005320 tx=0x7fe05c009040 comp rx=0 tx=0).stop 2023-10-03T19:17:23.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.150+0000 7fe0672ae640 1 -- 172.21.15.45:0/3387693537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0600bbca0 msgr2=0x7fe0601e1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:23.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.150+0000 7fe0672ae640 1 --2- 172.21.15.45:0/3387693537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0600bbca0 0x7fe0601e1a40 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fe054009ae0 tx=0x7fe04c005800 comp rx=0 tx=0).stop 2023-10-03T19:17:23.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.154+0000 7fe0672ae640 1 -- 172.21.15.45:0/3387693537 shutdown_connections 2023-10-03T19:17:23.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.154+0000 7fe0672ae640 1 --2- 172.21.15.45:0/3387693537 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe044066280 0x7fe044068730 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:23.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.154+0000 7fe0672ae640 1 --2- 172.21.15.45:0/3387693537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0601e1f80 0x7fe0601e4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:23.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.154+0000 7fe0672ae640 1 --2- 172.21.15.45:0/3387693537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0600bbca0 0x7fe0601e1a40 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:23.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.154+0000 7fe0672ae640 1 --2- 172.21.15.45:0/3387693537 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe04c004350 0x7fe0600b7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:23.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.154+0000 7fe0672ae640 1 -- 172.21.15.45:0/3387693537 >> 172.21.15.45:0/3387693537 conn(0x7fe0600bcf50 msgr2=0x7fe060070990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:23.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.154+0000 7fe0672ae640 1 -- 172.21.15.45:0/3387693537 shutdown_connections 2023-10-03T19:17:23.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.154+0000 7fe0672ae640 1 -- 172.21.15.45:0/3387693537 wait complete. 2023-10-03T19:17:23.170 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-03T19:17:23.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.290+0000 7f1245f4d640 1 Processor -- start 2023-10-03T19:17:23.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.290+0000 7f1245f4d640 1 -- start start 2023-10-03T19:17:23.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.290+0000 7f1245f4d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f124014f240 0x7f12401528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:23.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.290+0000 7f1245f4d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f124006b2d0 con 0x7f12400c2790 2023-10-03T19:17:23.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.290+0000 7f1245f4d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12400a3c60 con 0x7f12400bb1d0 2023-10-03T19:17:23.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.290+0000 7f1245f4d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f124006b640 con 0x7f124014f240 2023-10-03T19:17:23.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.290+0000 7f123f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f124014f240 0x7f12401528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:23.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.290+0000 7f1237fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f12400c2790 0x7f12400c0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34674/0 (socket says 172.21.15.45:34674) 2023-10-03T19:17:23.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.290+0000 7f123f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f124014f240 0x7f12401528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39568/0 (socket says 172.21.15.45:39568) 2023-10-03T19:17:23.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.290+0000 7f1237fff640 1 -- 172.21.15.45:0/3401591381 learned_addr learned my addr 172.21.15.45:0/3401591381 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:23.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.294+0000 7f123f7fe640 1 -- 172.21.15.45:0/3401591381 >> v1:172.21.15.79:6789/0 conn(0x7f12400bb1d0 legacy=0x7f12400c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:23.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.294+0000 7f123f7fe640 1 -- 172.21.15.45:0/3401591381 >> v1:172.21.15.45:6789/0 conn(0x7f12400c2790 legacy=0x7f12400c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:23.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.294+0000 7f123effd640 1 -- 172.21.15.45:0/3401591381 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3562929086 0 0) 0x7f124006b2d0 con 0x7f12400c2790 2023-10-03T19:17:23.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.294+0000 7f123f7fe640 1 -- 172.21.15.45:0/3401591381 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12400c19b0 con 0x7f124014f240 2023-10-03T19:17:23.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.294+0000 7f123f7fe640 1 --2- 172.21.15.45:0/3401591381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f124014f240 0x7f12401528d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f12300097a0 tx=0x7f123001ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7df140d6dc211e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:23.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.294+0000 7f123effd640 1 -- 172.21.15.45:0/3401591381 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12300a8910 con 0x7f124014f240 2023-10-03T19:17:23.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.294+0000 7f123effd640 1 -- 172.21.15.45:0/3401591381 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12300a8a70 con 0x7f124014f240 2023-10-03T19:17:23.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.294+0000 7f123effd640 1 -- 172.21.15.45:0/3401591381 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12300a8e00 con 0x7f124014f240 2023-10-03T19:17:23.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.294+0000 7f1245f4d640 1 -- 172.21.15.45:0/3401591381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f124014f240 msgr2=0x7f12401528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:23.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.294+0000 7f1245f4d640 1 --2- 172.21.15.45:0/3401591381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f124014f240 0x7f12401528d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f12300097a0 tx=0x7f123001ec10 comp rx=0 tx=0).stop 2023-10-03T19:17:23.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.294+0000 7f1245f4d640 1 -- 172.21.15.45:0/3401591381 shutdown_connections 2023-10-03T19:17:23.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.294+0000 7f1245f4d640 1 --2- 172.21.15.45:0/3401591381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f124014f240 0x7f12401528d0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:23.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.294+0000 7f1245f4d640 1 -- 172.21.15.45:0/3401591381 >> 172.21.15.45:0/3401591381 conn(0x7f12400a64a0 msgr2=0x7f12400a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:23.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.294+0000 7f1245f4d640 1 -- 172.21.15.45:0/3401591381 shutdown_connections 2023-10-03T19:17:23.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.294+0000 7f1245f4d640 1 -- 172.21.15.45:0/3401591381 wait complete. 2023-10-03T19:17:23.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.298+0000 7f1245f4d640 1 Processor -- start 2023-10-03T19:17:23.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.298+0000 7f1245f4d640 1 -- start start 2023-10-03T19:17:23.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.298+0000 7f1245f4d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f12400bb1d0 0x7f12400c3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:23.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.298+0000 7f1245f4d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12400c2790 0x7f12400bdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:23.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.298+0000 7f1245f4d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f124014f240 0x7f12400be2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:23.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.298+0000 7f1245f4d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124014b510 con 0x7f124014f240 2023-10-03T19:17:23.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.298+0000 7f1245f4d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12400be820 con 0x7f12400c2790 2023-10-03T19:17:23.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.298+0000 7f1245f4d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12400c39b0 con 0x7f12400bb1d0 2023-10-03T19:17:23.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.298+0000 7f123ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f124014f240 0x7f12400be2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:23.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.298+0000 7f123ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f124014f240 0x7f12400be2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39576/0 (socket says 172.21.15.45:39576) 2023-10-03T19:17:23.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.298+0000 7f123ffff640 1 -- 172.21.15.45:0/3567597242 learned_addr learned my addr 172.21.15.45:0/3567597242 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:23.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.298+0000 7f123f7fe640 1 --2- 172.21.15.45:0/3567597242 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f12400bb1d0 0x7f12400c3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:23.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.298+0000 7f1237fff640 1 --2- 172.21.15.45:0/3567597242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12400c2790 0x7f12400bdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:23.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.298+0000 7f123ffff640 1 -- 172.21.15.45:0/3567597242 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f12400bb1d0 msgr2=0x7f12400c3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:23.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.298+0000 7f123ffff640 1 --2- 172.21.15.45:0/3567597242 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f12400bb1d0 0x7f12400c3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:23.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.298+0000 7f123ffff640 1 -- 172.21.15.45:0/3567597242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12400c2790 msgr2=0x7f12400bdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:23.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.298+0000 7f123ffff640 1 --2- 172.21.15.45:0/3567597242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12400c2790 0x7f12400bdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:23.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.298+0000 7f123ffff640 1 -- 172.21.15.45:0/3567597242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12300093b0 con 0x7f124014f240 2023-10-03T19:17:23.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.298+0000 7f1237fff640 1 --2- 172.21.15.45:0/3567597242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12400c2790 0x7f12400bdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:23.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.298+0000 7f123f7fe640 1 --2- 172.21.15.45:0/3567597242 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f12400bb1d0 0x7f12400c3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:23.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.298+0000 7f123ffff640 1 --2- 172.21.15.45:0/3567597242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f124014f240 0x7f12400be2e0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f123800c7b0 tx=0x7f123800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:23.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.298+0000 7f123cff9640 1 -- 172.21.15.45:0/3567597242 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1238004b70 con 0x7f124014f240 2023-10-03T19:17:23.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.298+0000 7f123cff9640 1 -- 172.21.15.45:0/3567597242 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1238004cd0 con 0x7f124014f240 2023-10-03T19:17:23.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.298+0000 7f1245f4d640 1 -- 172.21.15.45:0/3567597242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12400a3f40 con 0x7f124014f240 2023-10-03T19:17:23.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.298+0000 7f123cff9640 1 -- 172.21.15.45:0/3567597242 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123800aa90 con 0x7f124014f240 2023-10-03T19:17:23.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.298+0000 7f1245f4d640 1 -- 172.21.15.45:0/3567597242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f124014e740 con 0x7f124014f240 2023-10-03T19:17:23.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.298+0000 7f1245f4d640 1 -- 172.21.15.45:0/3567597242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f124014f610 con 0x7f124014f240 2023-10-03T19:17:23.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.298+0000 7f123cff9640 1 -- 172.21.15.45:0/3567597242 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f123800abf0 con 0x7f124014f240 2023-10-03T19:17:23.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.298+0000 7f123cff9640 1 --2- 172.21.15.45:0/3567597242 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f12200662b0 0x7f1220068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:23.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.298+0000 7f123cff9640 1 -- 172.21.15.45:0/3567597242 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f1238083f20 con 0x7f124014f240 2023-10-03T19:17:23.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.302+0000 7f123f7fe640 1 --2- 172.21.15.45:0/3567597242 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f12200662b0 0x7f1220068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:23.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.302+0000 7f123f7fe640 1 --2- 172.21.15.45:0/3567597242 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f12200662b0 0x7f1220068760 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f12300b2000 tx=0x7f1230008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:23.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.302+0000 7f123cff9640 1 -- 172.21.15.45:0/3567597242 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1238051310 con 0x7f124014f240 2023-10-03T19:17:23.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.494+0000 7f1245f4d640 1 -- 172.21.15.45:0/3567597242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f12400bdac0 con 0x7f124014f240 2023-10-03T19:17:23.748 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-10-03T19:17:23.746+0000 7f00b6fb3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-03T19:17:23.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.762+0000 7f123cff9640 1 -- 172.21.15.45:0/3567597242 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v30) v1 ==== 161+0+0 (secure 0 0 0) 0x7f12400bdac0 con 0x7f124014f240 2023-10-03T19:17:23.762 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-03T19:17:23.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.762+0000 7f1245f4d640 1 -- 172.21.15.45:0/3567597242 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f12200662b0 msgr2=0x7f1220068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:23.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.762+0000 7f1245f4d640 1 --2- 172.21.15.45:0/3567597242 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f12200662b0 0x7f1220068760 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f12300b2000 tx=0x7f1230008040 comp rx=0 tx=0).stop 2023-10-03T19:17:23.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.762+0000 7f1245f4d640 1 -- 172.21.15.45:0/3567597242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f124014f240 msgr2=0x7f12400be2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:23.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.762+0000 7f1245f4d640 1 --2- 172.21.15.45:0/3567597242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f124014f240 0x7f12400be2e0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f123800c7b0 tx=0x7f123800cc70 comp rx=0 tx=0).stop 2023-10-03T19:17:23.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.762+0000 7f1245f4d640 1 -- 172.21.15.45:0/3567597242 shutdown_connections 2023-10-03T19:17:23.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.762+0000 7f1245f4d640 1 --2- 172.21.15.45:0/3567597242 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f12200662b0 0x7f1220068760 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:23.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.762+0000 7f1245f4d640 1 --2- 172.21.15.45:0/3567597242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f124014f240 0x7f12400be2e0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:23.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.762+0000 7f1245f4d640 1 --2- 172.21.15.45:0/3567597242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12400c2790 0x7f12400bdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:23.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.762+0000 7f1245f4d640 1 --2- 172.21.15.45:0/3567597242 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f12400bb1d0 0x7f12400c3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:23.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.762+0000 7f1245f4d640 1 -- 172.21.15.45:0/3567597242 >> 172.21.15.45:0/3567597242 conn(0x7f12400a64a0 msgr2=0x7f12400a46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:23.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.762+0000 7f1245f4d640 1 -- 172.21.15.45:0/3567597242 shutdown_connections 2023-10-03T19:17:23.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.762+0000 7f1245f4d640 1 -- 172.21.15.45:0/3567597242 wait complete. 2023-10-03T19:17:23.784 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-03T19:17:23.806 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-10-03T19:17:23.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.902+0000 7fa363b33640 1 Processor -- start 2023-10-03T19:17:23.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.902+0000 7fa363b33640 1 -- start start 2023-10-03T19:17:23.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.906+0000 7fa363b33640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa35c0712c0 0x7fa35c0bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:23.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.906+0000 7fa363b33640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa35c06c760 0x7fa35c0bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:23.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.906+0000 7fa363b33640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa35c06c2d0 con 0x7fa35c06d560 2023-10-03T19:17:23.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.906+0000 7fa363b33640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa35c150610 con 0x7fa35c06c760 2023-10-03T19:17:23.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.906+0000 7fa363b33640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c1508b0 con 0x7fa35c0712c0 2023-10-03T19:17:23.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.906+0000 7fa3620d0640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa35c06c760 0x7fa35c0bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:23.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.906+0000 7fa3620d0640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa35c06c760 0x7fa35c0bd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39606/0 (socket says 172.21.15.45:39606) 2023-10-03T19:17:23.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.906+0000 7fa3620d0640 1 -- 172.21.15.45:0/109799086 learned_addr learned my addr 172.21.15.45:0/109799086 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:23.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.906+0000 7fa3618cf640 1 --2- 172.21.15.45:0/109799086 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa35c0712c0 0x7fa35c0bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:23.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.906+0000 7fa3620d0640 1 -- 172.21.15.45:0/109799086 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa35c0712c0 msgr2=0x7fa35c0bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:23.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.906+0000 7fa3620d0640 1 --2- 172.21.15.45:0/109799086 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa35c0712c0 0x7fa35c0bcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:23.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.906+0000 7fa3620d0640 1 -- 172.21.15.45:0/109799086 >> v1:172.21.15.79:6789/0 conn(0x7fa35c06d560 legacy=0x7fa35c0a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:23.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.906+0000 7fa3620d0640 1 -- 172.21.15.45:0/109799086 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35c06d2e0 con 0x7fa35c06c760 2023-10-03T19:17:23.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.906+0000 7fa3620d0640 1 --2- 172.21.15.45:0/109799086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa35c06c760 0x7fa35c0bd100 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa354009e50 tx=0x7fa35401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b77dcbf4e9be1d3a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:23.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.906+0000 7fa3608cd640 1 -- 172.21.15.45:0/109799086 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3540a5810 con 0x7fa35c06c760 2023-10-03T19:17:23.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.906+0000 7fa3608cd640 1 -- 172.21.15.45:0/109799086 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3540a5970 con 0x7fa35c06c760 2023-10-03T19:17:23.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.906+0000 7fa3608cd640 1 -- 172.21.15.45:0/109799086 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3540a5d00 con 0x7fa35c06c760 2023-10-03T19:17:23.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa363b33640 1 -- 172.21.15.45:0/109799086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa35c06c760 msgr2=0x7fa35c0bd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:23.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa363b33640 1 --2- 172.21.15.45:0/109799086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa35c06c760 0x7fa35c0bd100 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa354009e50 tx=0x7fa35401ca10 comp rx=0 tx=0).stop 2023-10-03T19:17:23.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa363b33640 1 -- 172.21.15.45:0/109799086 shutdown_connections 2023-10-03T19:17:23.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa363b33640 1 --2- 172.21.15.45:0/109799086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa35c06c760 0x7fa35c0bd100 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:23.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa363b33640 1 --2- 172.21.15.45:0/109799086 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa35c0712c0 0x7fa35c0bcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:23.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa363b33640 1 -- 172.21.15.45:0/109799086 >> 172.21.15.45:0/109799086 conn(0x7fa35c0a20d0 msgr2=0x7fa35c0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:23.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa363b33640 1 -- 172.21.15.45:0/109799086 shutdown_connections 2023-10-03T19:17:23.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa363b33640 1 -- 172.21.15.45:0/109799086 wait complete. 2023-10-03T19:17:23.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa363b33640 1 Processor -- start 2023-10-03T19:17:23.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa363b33640 1 -- start start 2023-10-03T19:17:23.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa363b33640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa35c06c760 0x7fa35c1e6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:23.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa363b33640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa35c06d560 0x7fa35c0b99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:23.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa363b33640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa35c0712c0 0x7fa35c0705e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:23.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa363b33640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c149040 con 0x7fa35c06c760 2023-10-03T19:17:23.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa363b33640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c1488d0 con 0x7fa35c06d560 2023-10-03T19:17:23.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa363b33640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c0b9ef0 con 0x7fa35c0712c0 2023-10-03T19:17:23.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa3618cf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa35c06c760 0x7fa35c1e6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:23.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa3618cf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa35c06c760 0x7fa35c1e6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39616/0 (socket says 172.21.15.45:39616) 2023-10-03T19:17:23.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa3618cf640 1 -- 172.21.15.45:0/2047201034 learned_addr learned my addr 172.21.15.45:0/2047201034 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:23.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa3610ce640 1 --2- 172.21.15.45:0/2047201034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa35c06d560 0x7fa35c0b99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:23.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa3620d0640 1 --2- 172.21.15.45:0/2047201034 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa35c0712c0 0x7fa35c0705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:23.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa3618cf640 1 -- 172.21.15.45:0/2047201034 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa35c0712c0 msgr2=0x7fa35c0705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:23.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa3618cf640 1 --2- 172.21.15.45:0/2047201034 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa35c0712c0 0x7fa35c0705e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:23.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa3618cf640 1 -- 172.21.15.45:0/2047201034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa35c06d560 msgr2=0x7fa35c0b99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:23.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa3618cf640 1 --2- 172.21.15.45:0/2047201034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa35c06d560 0x7fa35c0b99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:23.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa3618cf640 1 -- 172.21.15.45:0/2047201034 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa354009b30 con 0x7fa35c06c760 2023-10-03T19:17:23.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa3610ce640 1 --2- 172.21.15.45:0/2047201034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa35c06d560 0x7fa35c0b99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:23.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa3618cf640 1 --2- 172.21.15.45:0/2047201034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa35c06c760 0x7fa35c1e6cc0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fa35800d830 tx=0x7fa35800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:23.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa3527fc640 1 -- 172.21.15.45:0/2047201034 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35800b6c0 con 0x7fa35c06c760 2023-10-03T19:17:23.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa3527fc640 1 -- 172.21.15.45:0/2047201034 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35800b820 con 0x7fa35c06c760 2023-10-03T19:17:23.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa363b33640 1 -- 172.21.15.45:0/2047201034 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa35c0a6070 con 0x7fa35c06c760 2023-10-03T19:17:23.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa3527fc640 1 -- 172.21.15.45:0/2047201034 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35800bb90 con 0x7fa35c06c760 2023-10-03T19:17:23.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.910+0000 7fa363b33640 1 -- 172.21.15.45:0/2047201034 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa35c0a5ee0 con 0x7fa35c06c760 2023-10-03T19:17:23.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.914+0000 7fa363b33640 1 -- 172.21.15.45:0/2047201034 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa35c1596f0 con 0x7fa35c06c760 2023-10-03T19:17:23.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.914+0000 7fa3527fc640 1 -- 172.21.15.45:0/2047201034 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa35800bcf0 con 0x7fa35c06c760 2023-10-03T19:17:23.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.914+0000 7fa3527fc640 1 --2- 172.21.15.45:0/2047201034 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa340066280 0x7fa340068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:23.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.914+0000 7fa3527fc640 1 -- 172.21.15.45:0/2047201034 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fa3580842d0 con 0x7fa35c06c760 2023-10-03T19:17:23.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.914+0000 7fa3610ce640 1 --2- 172.21.15.45:0/2047201034 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa340066280 0x7fa340068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:23.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.914+0000 7fa3610ce640 1 --2- 172.21.15.45:0/2047201034 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa340066280 0x7fa340068730 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa35c1e4b00 tx=0x7fa34c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:23.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:23.918+0000 7fa3527fc640 1 -- 172.21.15.45:0/2047201034 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa358055180 con 0x7fa35c06c760 2023-10-03T19:17:24.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.102+0000 7fa363b33640 1 -- 172.21.15.45:0/2047201034 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa35c0bca30 con 0x7fa35c06c760 2023-10-03T19:17:24.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.762+0000 7fa3527fc640 1 -- 172.21.15.45:0/2047201034 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v31) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa358054d10 con 0x7fa35c06c760 2023-10-03T19:17:24.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.766+0000 7fa363b33640 1 -- 172.21.15.45:0/2047201034 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa340066280 msgr2=0x7fa340068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:24.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.766+0000 7fa363b33640 1 --2- 172.21.15.45:0/2047201034 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa340066280 0x7fa340068730 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa35c1e4b00 tx=0x7fa34c009040 comp rx=0 tx=0).stop 2023-10-03T19:17:24.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.766+0000 7fa363b33640 1 -- 172.21.15.45:0/2047201034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa35c06c760 msgr2=0x7fa35c1e6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:24.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.766+0000 7fa363b33640 1 --2- 172.21.15.45:0/2047201034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa35c06c760 0x7fa35c1e6cc0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fa35800d830 tx=0x7fa35800dcf0 comp rx=0 tx=0).stop 2023-10-03T19:17:24.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.766+0000 7fa363b33640 1 -- 172.21.15.45:0/2047201034 shutdown_connections 2023-10-03T19:17:24.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.766+0000 7fa363b33640 1 --2- 172.21.15.45:0/2047201034 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa340066280 0x7fa340068730 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:24.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.766+0000 7fa363b33640 1 --2- 172.21.15.45:0/2047201034 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa35c0712c0 0x7fa35c0705e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:24.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.766+0000 7fa363b33640 1 --2- 172.21.15.45:0/2047201034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa35c06d560 0x7fa35c0b99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:24.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.766+0000 7fa363b33640 1 --2- 172.21.15.45:0/2047201034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa35c06c760 0x7fa35c1e6cc0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:24.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.766+0000 7fa363b33640 1 -- 172.21.15.45:0/2047201034 >> 172.21.15.45:0/2047201034 conn(0x7fa35c0a20d0 msgr2=0x7fa35c0bcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:24.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.766+0000 7fa363b33640 1 -- 172.21.15.45:0/2047201034 shutdown_connections 2023-10-03T19:17:24.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.766+0000 7fa363b33640 1 -- 172.21.15.45:0/2047201034 wait complete. 2023-10-03T19:17:24.789 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-03T19:17:24.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.958+0000 7f1f3e9d1640 1 Processor -- start 2023-10-03T19:17:24.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.958+0000 7f1f3e9d1640 1 -- start start 2023-10-03T19:17:24.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f3e9d1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1f3814f510 0x7f1f3814b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:24.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f3e9d1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1f380bd9f0 0x7f1f3814b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:24.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f3e9d1640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3814f080 con 0x7f1f3806f880 2023-10-03T19:17:24.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f3e9d1640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3806f3e0 con 0x7f1f3814f510 2023-10-03T19:17:24.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f3e9d1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f38070e90 con 0x7f1f380bd9f0 2023-10-03T19:17:24.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f37fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1f3806f880 0x7f1f380a5940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48998/0 (socket says 172.21.15.45:48998) 2023-10-03T19:17:24.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f37fff640 1 -- 172.21.15.45:0/358541869 learned_addr learned my addr 172.21.15.45:0/358541869 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:24.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f377fe640 1 --2- 172.21.15.45:0/358541869 >> v2:172.21.15.79:3300/0 conn(0x7f1f3814f510 0x7f1f3814b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:24.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f3cf6e640 1 --2- 172.21.15.45:0/358541869 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1f380bd9f0 0x7f1f3814b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:24.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f36ffd640 1 -- 172.21.15.45:0/358541869 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524035258 0 0) 0x7f1f3814f080 con 0x7f1f3806f880 2023-10-03T19:17:24.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f36ffd640 1 -- 172.21.15.45:0/358541869 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f20003530 con 0x7f1f3806f880 2023-10-03T19:17:24.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f36ffd640 1 -- 172.21.15.45:0/358541869 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 350931791 0 0) 0x7f1f20003530 con 0x7f1f3806f880 2023-10-03T19:17:24.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f36ffd640 1 -- 172.21.15.45:0/358541869 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1f380bd9f0 msgr2=0x7f1f3814b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:24.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f36ffd640 1 --2- 172.21.15.45:0/358541869 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1f380bd9f0 0x7f1f3814b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:24.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f36ffd640 1 -- 172.21.15.45:0/358541869 >> v2:172.21.15.79:3300/0 conn(0x7f1f3814f510 msgr2=0x7f1f3814b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:24.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f36ffd640 1 --2- 172.21.15.45:0/358541869 >> v2:172.21.15.79:3300/0 conn(0x7f1f3814f510 0x7f1f3814b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:24.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f36ffd640 1 -- 172.21.15.45:0/358541869 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3814ea30 con 0x7f1f3806f880 2023-10-03T19:17:24.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f36ffd640 1 -- 172.21.15.45:0/358541869 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f1f28001680 con 0x7f1f3806f880 2023-10-03T19:17:24.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f36ffd640 1 -- 172.21.15.45:0/358541869 >> v1:172.21.15.45:6789/0 conn(0x7f1f3806f880 legacy=0x7f1f380a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:24.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f36ffd640 1 --2- 172.21.15.45:0/358541869 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1f380bd9f0 0x7f1f20003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:24.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f36ffd640 1 --2- 172.21.15.45:0/358541869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f20003f00 0x7f1f200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:24.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f36ffd640 1 --2- 172.21.15.45:0/358541869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f20004d10 0x7f1f20005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:24.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f36ffd640 1 -- 172.21.15.45:0/358541869 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3806f3e0 con 0x7f1f20003f00 2023-10-03T19:17:24.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f36ffd640 1 -- 172.21.15.45:0/358541869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f38070e90 con 0x7f1f20004d10 2023-10-03T19:17:24.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f36ffd640 1 -- 172.21.15.45:0/358541869 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2000dba0 con 0x7f1f380bd9f0 2023-10-03T19:17:24.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f377fe640 1 --2- 172.21.15.45:0/358541869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f20003f00 0x7f1f200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:24.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f37fff640 1 --2- 172.21.15.45:0/358541869 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1f380bd9f0 0x7f1f20003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:24.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f3cf6e640 1 --2- 172.21.15.45:0/358541869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f20004d10 0x7f1f20005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:24.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f377fe640 1 -- 172.21.15.45:0/358541869 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1f380bd9f0 msgr2=0x7f1f20003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:24.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f377fe640 1 --2- 172.21.15.45:0/358541869 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1f380bd9f0 0x7f1f20003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:24.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f377fe640 1 -- 172.21.15.45:0/358541869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f20004d10 msgr2=0x7f1f20005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:24.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f377fe640 1 --2- 172.21.15.45:0/358541869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f20004d10 0x7f1f20005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:24.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.962+0000 7f1f377fe640 1 -- 172.21.15.45:0/358541869 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f20003530 con 0x7f1f20003f00 2023-10-03T19:17:24.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f377fe640 1 --2- 172.21.15.45:0/358541869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f20003f00 0x7f1f200047d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c009ae0 tx=0x7f1f2c01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a472bcd23fd3eec server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:24.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f36ffd640 1 -- 172.21.15.45:0/358541869 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c0a5570 con 0x7f1f20003f00 2023-10-03T19:17:24.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f36ffd640 1 -- 172.21.15.45:0/358541869 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2c0a56d0 con 0x7f1f20003f00 2023-10-03T19:17:24.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f36ffd640 1 -- 172.21.15.45:0/358541869 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c0a5a80 con 0x7f1f20003f00 2023-10-03T19:17:24.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f3e9d1640 1 -- 172.21.15.45:0/358541869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f20003f00 msgr2=0x7f1f200047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:24.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f3e9d1640 1 --2- 172.21.15.45:0/358541869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f20003f00 0x7f1f200047d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c009ae0 tx=0x7f1f2c01ca90 comp rx=0 tx=0).stop 2023-10-03T19:17:24.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f3cf6e640 1 -- 172.21.15.45:0/358541869 reap_dead start 2023-10-03T19:17:24.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f3e9d1640 1 -- 172.21.15.45:0/358541869 shutdown_connections 2023-10-03T19:17:24.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f3e9d1640 1 -- 172.21.15.45:0/358541869 >> 172.21.15.45:0/358541869 conn(0x7f1f380a20d0 msgr2=0x7f1f380a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:24.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f3e9d1640 1 -- 172.21.15.45:0/358541869 shutdown_connections 2023-10-03T19:17:24.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f3e9d1640 1 -- 172.21.15.45:0/358541869 wait complete. 2023-10-03T19:17:24.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f3e9d1640 1 Processor -- start 2023-10-03T19:17:24.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f3e9d1640 1 -- start start 2023-10-03T19:17:24.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f3e9d1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f380a4d50 0x7f1f3814daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:24.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f3e9d1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1f3813f4a0 0x7f1f381dfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:24.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f3e9d1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f3814e030 0x7f1f381e00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:24.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f3e9d1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f381e3b40 con 0x7f1f3814e030 2023-10-03T19:17:24.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f3e9d1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f381e2b70 con 0x7f1f380a4d50 2023-10-03T19:17:24.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f3e9d1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f380bff50 con 0x7f1f3813f4a0 2023-10-03T19:17:24.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f3cf6e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f3814e030 0x7f1f381e00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:24.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f3cf6e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f3814e030 0x7f1f381e00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59538/0 (socket says 172.21.15.45:59538) 2023-10-03T19:17:24.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f3cf6e640 1 -- 172.21.15.45:0/1863328370 learned_addr learned my addr 172.21.15.45:0/1863328370 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:24.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f377fe640 1 --2- 172.21.15.45:0/1863328370 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1f3813f4a0 0x7f1f381dfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:24.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f37fff640 1 --2- 172.21.15.45:0/1863328370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f380a4d50 0x7f1f3814daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:24.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f3cf6e640 1 -- 172.21.15.45:0/1863328370 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1f3813f4a0 msgr2=0x7f1f381dfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:24.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f3cf6e640 1 --2- 172.21.15.45:0/1863328370 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1f3813f4a0 0x7f1f381dfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:24.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f3cf6e640 1 -- 172.21.15.45:0/1863328370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f380a4d50 msgr2=0x7f1f3814daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:24.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f3cf6e640 1 --2- 172.21.15.45:0/1863328370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f380a4d50 0x7f1f3814daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:24.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f3cf6e640 1 -- 172.21.15.45:0/1863328370 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3806f070 con 0x7f1f3814e030 2023-10-03T19:17:24.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f377fe640 1 --2- 172.21.15.45:0/1863328370 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1f3813f4a0 0x7f1f381dfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:24.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f37fff640 1 --2- 172.21.15.45:0/1863328370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f380a4d50 0x7f1f3814daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:24.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f3cf6e640 1 --2- 172.21.15.45:0/1863328370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f3814e030 0x7f1f381e00f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f1f3806ba20 tx=0x7f1f30007cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:24.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f34ff9640 1 -- 172.21.15.45:0/1863328370 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3000e070 con 0x7f1f3814e030 2023-10-03T19:17:24.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f34ff9640 1 -- 172.21.15.45:0/1863328370 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f30003c70 con 0x7f1f3814e030 2023-10-03T19:17:24.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.966+0000 7f1f3e9d1640 1 -- 172.21.15.45:0/1863328370 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f3814ed10 con 0x7f1f3814e030 2023-10-03T19:17:24.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.970+0000 7f1f34ff9640 1 -- 172.21.15.45:0/1863328370 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f30003e00 con 0x7f1f3814e030 2023-10-03T19:17:24.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.970+0000 7f1f3e9d1640 1 -- 172.21.15.45:0/1863328370 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3806fc50 con 0x7f1f3814e030 2023-10-03T19:17:24.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.970+0000 7f1f3e9d1640 1 -- 172.21.15.45:0/1863328370 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3804de80 con 0x7f1f3814e030 2023-10-03T19:17:24.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.970+0000 7f1f34ff9640 1 -- 172.21.15.45:0/1863328370 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1f30004030 con 0x7f1f3814e030 2023-10-03T19:17:24.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.970+0000 7f1f34ff9640 1 --2- 172.21.15.45:0/1863328370 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1f24066280 0x7f1f24068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:24.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.970+0000 7f1f34ff9640 1 -- 172.21.15.45:0/1863328370 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f1f30083a40 con 0x7f1f3814e030 2023-10-03T19:17:24.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.970+0000 7f1f37fff640 1 --2- 172.21.15.45:0/1863328370 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1f24066280 0x7f1f24068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:24.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.970+0000 7f1f37fff640 1 --2- 172.21.15.45:0/1863328370 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1f24066280 0x7f1f24068730 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1f28001830 tx=0x7f1f28001160 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:24.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:24.974+0000 7f1f34ff9640 1 -- 172.21.15.45:0/1863328370 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1f30085e60 con 0x7f1f3814e030 2023-10-03T19:17:25.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:25.130+0000 7f1f3e9d1640 1 -- 172.21.15.45:0/1863328370 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1f3806ee50 con 0x7f1f3814e030 2023-10-03T19:17:25.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:25.846+0000 7f1f34ff9640 1 -- 172.21.15.45:0/1863328370 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v65) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1f300548f0 con 0x7f1f3814e030 2023-10-03T19:17:25.848 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-10-03T19:17:25.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:25.850+0000 7f1f3e9d1640 1 -- 172.21.15.45:0/1863328370 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1f24066280 msgr2=0x7f1f24068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:25.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:25.850+0000 7f1f3e9d1640 1 --2- 172.21.15.45:0/1863328370 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1f24066280 0x7f1f24068730 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1f28001830 tx=0x7f1f28001160 comp rx=0 tx=0).stop 2023-10-03T19:17:25.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:25.850+0000 7f1f3e9d1640 1 -- 172.21.15.45:0/1863328370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f3814e030 msgr2=0x7f1f381e00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:25.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:25.850+0000 7f1f3e9d1640 1 --2- 172.21.15.45:0/1863328370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f3814e030 0x7f1f381e00f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f1f3806ba20 tx=0x7f1f30007cd0 comp rx=0 tx=0).stop 2023-10-03T19:17:25.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:25.850+0000 7f1f3e9d1640 1 -- 172.21.15.45:0/1863328370 shutdown_connections 2023-10-03T19:17:25.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:25.850+0000 7f1f3e9d1640 1 --2- 172.21.15.45:0/1863328370 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1f24066280 0x7f1f24068730 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:25.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:25.850+0000 7f1f3e9d1640 1 --2- 172.21.15.45:0/1863328370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f3814e030 0x7f1f381e00f0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:25.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:25.850+0000 7f1f3e9d1640 1 --2- 172.21.15.45:0/1863328370 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1f3813f4a0 0x7f1f381dfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:25.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:25.850+0000 7f1f3e9d1640 1 --2- 172.21.15.45:0/1863328370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f380a4d50 0x7f1f3814daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:25.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:25.850+0000 7f1f3e9d1640 1 -- 172.21.15.45:0/1863328370 >> 172.21.15.45:0/1863328370 conn(0x7f1f380a20d0 msgr2=0x7f1f380a2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:25.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:25.850+0000 7f1f3e9d1640 1 -- 172.21.15.45:0/1863328370 shutdown_connections 2023-10-03T19:17:25.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:25.850+0000 7f1f3e9d1640 1 -- 172.21.15.45:0/1863328370 wait complete. 2023-10-03T19:17:25.873 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-03T19:17:26.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.002+0000 7fac0499f640 1 Processor -- start 2023-10-03T19:17:26.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.002+0000 7fac0499f640 1 -- start start 2023-10-03T19:17:26.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.002+0000 7fac0499f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fac000c14e0 0x7fac000c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:26.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.002+0000 7fac0499f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fac000bf1f0 0x7fac000a9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:26.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.002+0000 7fac0499f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0006ac70 con 0x7fac000c2770 2023-10-03T19:17:26.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.002+0000 7fac0499f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac0006aae0 con 0x7fac000bf1f0 2023-10-03T19:17:26.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.002+0000 7fac0499f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac000c3000 con 0x7fac000c14e0 2023-10-03T19:17:26.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.002+0000 7fabf7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fac000bf1f0 0x7fac000a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:26.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.002+0000 7fabf7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fac000bf1f0 0x7fac000a9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59542/0 (socket says 172.21.15.45:59542) 2023-10-03T19:17:26.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.002+0000 7fabf7fff640 1 -- 172.21.15.45:0/1901629862 learned_addr learned my addr 172.21.15.45:0/1901629862 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:26.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.002+0000 7fabfe59c640 1 --2- 172.21.15.45:0/1901629862 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fac000c14e0 0x7fac000c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:26.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.006+0000 7fabf7fff640 1 -- 172.21.15.45:0/1901629862 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fac000c14e0 msgr2=0x7fac000c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:26.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.006+0000 7fabf7fff640 1 --2- 172.21.15.45:0/1901629862 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fac000c14e0 0x7fac000c0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:26.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.006+0000 7fabf7fff640 1 -- 172.21.15.45:0/1901629862 >> v1:172.21.15.79:6789/0 conn(0x7fac000c2770 legacy=0x7fac000a9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:26.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.006+0000 7fabf7fff640 1 -- 172.21.15.45:0/1901629862 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac000aa5f0 con 0x7fac000bf1f0 2023-10-03T19:17:26.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.006+0000 7fabf7fff640 1 --2- 172.21.15.45:0/1901629862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac000bf1f0 0x7fac000a9860 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fabe8009870 tx=0x7fabe801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7cdc84baefe37d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:26.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.006+0000 7fabfdd9b640 1 -- 172.21.15.45:0/1901629862 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe80a8a30 con 0x7fac000bf1f0 2023-10-03T19:17:26.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.006+0000 7fabfdd9b640 1 -- 172.21.15.45:0/1901629862 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe80a8b90 con 0x7fac000bf1f0 2023-10-03T19:17:26.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.006+0000 7fabfdd9b640 1 -- 172.21.15.45:0/1901629862 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe80b0440 con 0x7fac000bf1f0 2023-10-03T19:17:26.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.006+0000 7fac0499f640 1 -- 172.21.15.45:0/1901629862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac000bf1f0 msgr2=0x7fac000a9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:26.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.006+0000 7fac0499f640 1 --2- 172.21.15.45:0/1901629862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac000bf1f0 0x7fac000a9860 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fabe8009870 tx=0x7fabe801ed30 comp rx=0 tx=0).stop 2023-10-03T19:17:26.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.006+0000 7fac0499f640 1 -- 172.21.15.45:0/1901629862 shutdown_connections 2023-10-03T19:17:26.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.006+0000 7fac0499f640 1 --2- 172.21.15.45:0/1901629862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac000bf1f0 0x7fac000a9860 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:26.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.006+0000 7fac0499f640 1 --2- 172.21.15.45:0/1901629862 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fac000c14e0 0x7fac000c0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:26.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.006+0000 7fac0499f640 1 -- 172.21.15.45:0/1901629862 >> 172.21.15.45:0/1901629862 conn(0x7fac000a6440 msgr2=0x7fac000a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:26.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.006+0000 7fac0499f640 1 -- 172.21.15.45:0/1901629862 shutdown_connections 2023-10-03T19:17:26.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.006+0000 7fac0499f640 1 -- 172.21.15.45:0/1901629862 wait complete. 2023-10-03T19:17:26.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.010+0000 7fac0499f640 1 Processor -- start 2023-10-03T19:17:26.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.010+0000 7fac0499f640 1 -- start start 2023-10-03T19:17:26.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.010+0000 7fac0499f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac000bf1f0 0x7fac001e4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:26.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.010+0000 7fac0499f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fac000c14e0 0x7fac000bdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:26.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.010+0000 7fac0499f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac000c2770 0x7fac001d48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:26.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.010+0000 7fac0499f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac001d7d30 con 0x7fac000c2770 2023-10-03T19:17:26.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.010+0000 7fac0499f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac000be2b0 con 0x7fac000bf1f0 2023-10-03T19:17:26.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.010+0000 7fac0499f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac001e3540 con 0x7fac000c14e0 2023-10-03T19:17:26.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.010+0000 7fabfed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac000c2770 0x7fac001d48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:26.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.010+0000 7fabfed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac000c2770 0x7fac001d48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59558/0 (socket says 172.21.15.45:59558) 2023-10-03T19:17:26.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.010+0000 7fabfed9d640 1 -- 172.21.15.45:0/130987772 learned_addr learned my addr 172.21.15.45:0/130987772 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:26.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.010+0000 7fabfe59c640 1 --2- 172.21.15.45:0/130987772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac000bf1f0 0x7fac001e4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:26.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.010+0000 7fabf7fff640 1 --2- 172.21.15.45:0/130987772 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fac000c14e0 0x7fac000bdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:26.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.010+0000 7fabfed9d640 1 -- 172.21.15.45:0/130987772 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fac000c14e0 msgr2=0x7fac000bdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:26.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.010+0000 7fabfed9d640 1 --2- 172.21.15.45:0/130987772 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fac000c14e0 0x7fac000bdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:26.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.010+0000 7fabfed9d640 1 -- 172.21.15.45:0/130987772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac000bf1f0 msgr2=0x7fac001e4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:26.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.010+0000 7fabfed9d640 1 --2- 172.21.15.45:0/130987772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac000bf1f0 0x7fac001e4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:26.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.010+0000 7fabfed9d640 1 -- 172.21.15.45:0/130987772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe80094d0 con 0x7fac000c2770 2023-10-03T19:17:26.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.010+0000 7fabfed9d640 1 --2- 172.21.15.45:0/130987772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac000c2770 0x7fac001d48b0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fabf800c730 tx=0x7fabf800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:26.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.010+0000 7fabf6ffd640 1 -- 172.21.15.45:0/130987772 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf8003b80 con 0x7fac000c2770 2023-10-03T19:17:26.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.010+0000 7fabf6ffd640 1 -- 172.21.15.45:0/130987772 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf8003ce0 con 0x7fac000c2770 2023-10-03T19:17:26.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.010+0000 7fac0499f640 1 -- 172.21.15.45:0/130987772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac0014f530 con 0x7fac000c2770 2023-10-03T19:17:26.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.010+0000 7fabf6ffd640 1 -- 172.21.15.45:0/130987772 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf8005310 con 0x7fac000c2770 2023-10-03T19:17:26.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.010+0000 7fac0499f640 1 -- 172.21.15.45:0/130987772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac0014f250 con 0x7fac000c2770 2023-10-03T19:17:26.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.010+0000 7fac0499f640 1 -- 172.21.15.45:0/130987772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac0006b100 con 0x7fac000c2770 2023-10-03T19:17:26.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.014+0000 7fabf6ffd640 1 -- 172.21.15.45:0/130987772 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fabf8005680 con 0x7fac000c2770 2023-10-03T19:17:26.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.014+0000 7fabf6ffd640 1 --2- 172.21.15.45:0/130987772 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fabe00662b0 0x7fabe0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:26.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.014+0000 7fabf6ffd640 1 -- 172.21.15.45:0/130987772 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5826+0+0 (secure 0 0 0) 0x7fabf8083c00 con 0x7fac000c2770 2023-10-03T19:17:26.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.014+0000 7fabfe59c640 1 --2- 172.21.15.45:0/130987772 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fabe00662b0 0x7fabe0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:26.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.014+0000 7fabfe59c640 1 --2- 172.21.15.45:0/130987772 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fabe00662b0 0x7fabe0068760 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fabf000b9d0 tx=0x7fabf0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:26.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.018+0000 7fabf6ffd640 1 -- 172.21.15.45:0/130987772 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fabf808a080 con 0x7fac000c2770 2023-10-03T19:17:26.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.186+0000 7fac0499f640 1 -- 172.21.15.45:0/130987772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fac0004de80 con 0x7fac000c2770 2023-10-03T19:17:26.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.850+0000 7fabf6ffd640 1 -- 172.21.15.45:0/130987772 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v66) v1 ==== 169+0+0 (secure 0 0 0) 0x7fabf8051160 con 0x7fac000c2770 2023-10-03T19:17:26.854 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-10-03T19:17:26.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.858+0000 7fac0499f640 1 -- 172.21.15.45:0/130987772 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fabe00662b0 msgr2=0x7fabe0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:26.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.858+0000 7fac0499f640 1 --2- 172.21.15.45:0/130987772 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fabe00662b0 0x7fabe0068760 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fabf000b9d0 tx=0x7fabf0008040 comp rx=0 tx=0).stop 2023-10-03T19:17:26.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.858+0000 7fac0499f640 1 -- 172.21.15.45:0/130987772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac000c2770 msgr2=0x7fac001d48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:26.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.858+0000 7fac0499f640 1 --2- 172.21.15.45:0/130987772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac000c2770 0x7fac001d48b0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fabf800c730 tx=0x7fabf800cbf0 comp rx=0 tx=0).stop 2023-10-03T19:17:26.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.858+0000 7fac0499f640 1 -- 172.21.15.45:0/130987772 shutdown_connections 2023-10-03T19:17:26.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.858+0000 7fac0499f640 1 --2- 172.21.15.45:0/130987772 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fabe00662b0 0x7fabe0068760 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:26.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.858+0000 7fac0499f640 1 --2- 172.21.15.45:0/130987772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac000c2770 0x7fac001d48b0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:26.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.858+0000 7fac0499f640 1 --2- 172.21.15.45:0/130987772 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fac000c14e0 0x7fac000bdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:26.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.858+0000 7fac0499f640 1 --2- 172.21.15.45:0/130987772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac000bf1f0 0x7fac001e4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:26.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.858+0000 7fac0499f640 1 -- 172.21.15.45:0/130987772 >> 172.21.15.45:0/130987772 conn(0x7fac000a6440 msgr2=0x7fac000c39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:26.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.858+0000 7fac0499f640 1 -- 172.21.15.45:0/130987772 shutdown_connections 2023-10-03T19:17:26.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:26.858+0000 7fac0499f640 1 -- 172.21.15.45:0/130987772 wait complete. 2023-10-03T19:17:26.883 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-03T19:17:27.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.006+0000 7ffb6d27d640 1 Processor -- start 2023-10-03T19:17:27.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.006+0000 7ffb6d27d640 1 -- start start 2023-10-03T19:17:27.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.006+0000 7ffb6d27d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb68070df0 0x7ffb6806aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:27.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.006+0000 7ffb6d27d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffb68070140 0x7ffb6814c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:27.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.006+0000 7ffb6d27d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb680a11d0 con 0x7ffb681500f0 2023-10-03T19:17:27.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.006+0000 7ffb6d27d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb68069f70 con 0x7ffb68070140 2023-10-03T19:17:27.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.006+0000 7ffb6d27d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6806a460 con 0x7ffb68070df0 2023-10-03T19:17:27.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.006+0000 7ffb677fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffb68070140 0x7ffb6814c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:27.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.006+0000 7ffb66ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ffb681500f0 0x7ffb680a3570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49014/0 (socket says 172.21.15.45:49014) 2023-10-03T19:17:27.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.006+0000 7ffb66ffd640 1 -- 172.21.15.45:0/3035461216 learned_addr learned my addr 172.21.15.45:0/3035461216 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:27.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.006+0000 7ffb5e7fc640 1 --2- 172.21.15.45:0/3035461216 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb68070df0 0x7ffb6806aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:27.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.006+0000 7ffb677fe640 1 -- 172.21.15.45:0/3035461216 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb68070df0 msgr2=0x7ffb6806aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:27.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.006+0000 7ffb677fe640 1 --2- 172.21.15.45:0/3035461216 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb68070df0 0x7ffb6806aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:27.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.006+0000 7ffb677fe640 1 -- 172.21.15.45:0/3035461216 >> v1:172.21.15.45:6789/0 conn(0x7ffb681500f0 legacy=0x7ffb680a3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:27.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.006+0000 7ffb677fe640 1 -- 172.21.15.45:0/3035461216 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb681504c0 con 0x7ffb68070140 2023-10-03T19:17:27.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.006+0000 7ffb667fc640 1 -- 172.21.15.45:0/3035461216 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2762231634 0 0) 0x7ffb680a11d0 con 0x7ffb681500f0 2023-10-03T19:17:27.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb677fe640 1 --2- 172.21.15.45:0/3035461216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb68070140 0x7ffb6814c6f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009d90 tx=0x7ffb6001f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aceda6e6191caf0e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:27.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb667fc640 1 -- 172.21.15.45:0/3035461216 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb600af600 con 0x7ffb68070140 2023-10-03T19:17:27.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb667fc640 1 -- 172.21.15.45:0/3035461216 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb600ab050 con 0x7ffb68070140 2023-10-03T19:17:27.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb667fc640 1 -- 172.21.15.45:0/3035461216 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb600af980 con 0x7ffb68070140 2023-10-03T19:17:27.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb6d27d640 1 -- 172.21.15.45:0/3035461216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb68070140 msgr2=0x7ffb6814c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:27.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb6d27d640 1 --2- 172.21.15.45:0/3035461216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb68070140 0x7ffb6814c6f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009d90 tx=0x7ffb6001f130 comp rx=0 tx=0).stop 2023-10-03T19:17:27.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb6d27d640 1 -- 172.21.15.45:0/3035461216 shutdown_connections 2023-10-03T19:17:27.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb6d27d640 1 --2- 172.21.15.45:0/3035461216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb68070140 0x7ffb6814c6f0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:27.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb6d27d640 1 --2- 172.21.15.45:0/3035461216 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb68070df0 0x7ffb6806aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:27.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb6d27d640 1 -- 172.21.15.45:0/3035461216 >> 172.21.15.45:0/3035461216 conn(0x7ffb680be190 msgr2=0x7ffb680be590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:27.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb6d27d640 1 -- 172.21.15.45:0/3035461216 shutdown_connections 2023-10-03T19:17:27.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb6d27d640 1 -- 172.21.15.45:0/3035461216 wait complete. 2023-10-03T19:17:27.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb6d27d640 1 Processor -- start 2023-10-03T19:17:27.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb6d27d640 1 -- start start 2023-10-03T19:17:27.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb6d27d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb68070140 0x7ffb680c0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:27.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb6d27d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb68070df0 0x7ffb68145a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:27.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb6d27d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb681500f0 0x7ffb68145fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:27.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb6d27d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb680a7280 con 0x7ffb681500f0 2023-10-03T19:17:27.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb6d27d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb680a6670 con 0x7ffb68070140 2023-10-03T19:17:27.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb6d27d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb680a6950 con 0x7ffb68070df0 2023-10-03T19:17:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb677fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb681500f0 0x7ffb68145fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb677fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb681500f0 0x7ffb68145fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59572/0 (socket says 172.21.15.45:59572) 2023-10-03T19:17:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb677fe640 1 -- 172.21.15.45:0/78430823 learned_addr learned my addr 172.21.15.45:0/78430823 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb66ffd640 1 --2- 172.21.15.45:0/78430823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb68070140 0x7ffb680c0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb5e7fc640 1 --2- 172.21.15.45:0/78430823 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb68070df0 0x7ffb68145a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb677fe640 1 -- 172.21.15.45:0/78430823 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb68070df0 msgr2=0x7ffb68145a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb677fe640 1 --2- 172.21.15.45:0/78430823 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb68070df0 0x7ffb68145a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb677fe640 1 -- 172.21.15.45:0/78430823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb68070140 msgr2=0x7ffb680c0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb677fe640 1 --2- 172.21.15.45:0/78430823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb68070140 0x7ffb680c0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb677fe640 1 -- 172.21.15.45:0/78430823 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb60009a70 con 0x7ffb681500f0 2023-10-03T19:17:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb5e7fc640 1 --2- 172.21.15.45:0/78430823 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb68070df0 0x7ffb68145a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:27.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb677fe640 1 --2- 172.21.15.45:0/78430823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb681500f0 0x7ffb68145fa0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ffb600b2040 tx=0x7ffb6001bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:27.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb5ffff640 1 -- 172.21.15.45:0/78430823 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb600ba680 con 0x7ffb681500f0 2023-10-03T19:17:27.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb5ffff640 1 -- 172.21.15.45:0/78430823 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb600ba7e0 con 0x7ffb681500f0 2023-10-03T19:17:27.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.010+0000 7ffb6d27d640 1 -- 172.21.15.45:0/78430823 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb68150780 con 0x7ffb681500f0 2023-10-03T19:17:27.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.014+0000 7ffb5ffff640 1 -- 172.21.15.45:0/78430823 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb600bab90 con 0x7ffb681500f0 2023-10-03T19:17:27.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.014+0000 7ffb6d27d640 1 -- 172.21.15.45:0/78430823 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb6806a180 con 0x7ffb681500f0 2023-10-03T19:17:27.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.014+0000 7ffb6d27d640 1 -- 172.21.15.45:0/78430823 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb68150a60 con 0x7ffb681500f0 2023-10-03T19:17:27.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.014+0000 7ffb5ffff640 1 -- 172.21.15.45:0/78430823 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffb600b6040 con 0x7ffb681500f0 2023-10-03T19:17:27.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.014+0000 7ffb5ffff640 1 --2- 172.21.15.45:0/78430823 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ffb48066280 0x7ffb48068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:27.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.014+0000 7ffb5ffff640 1 -- 172.21.15.45:0/78430823 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ffb60122580 con 0x7ffb681500f0 2023-10-03T19:17:27.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.014+0000 7ffb66ffd640 1 --2- 172.21.15.45:0/78430823 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ffb48066280 0x7ffb48068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:27.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.014+0000 7ffb66ffd640 1 --2- 172.21.15.45:0/78430823 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ffb48066280 0x7ffb48068730 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ffb58000f70 tx=0x7ffb58007c10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:27.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.018+0000 7ffb5ffff640 1 -- 172.21.15.45:0/78430823 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ffb600efc70 con 0x7ffb681500f0 2023-10-03T19:17:27.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.178+0000 7ffb6d27d640 1 -- 172.21.15.45:0/78430823 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ffb6804de80 con 0x7ffb681500f0 2023-10-03T19:17:27.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.182+0000 7ffb5ffff640 1 -- 172.21.15.45:0/78430823 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7ffb600b40a0 con 0x7ffb681500f0 2023-10-03T19:17:27.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.182+0000 7ffb6d27d640 1 -- 172.21.15.45:0/78430823 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ffb48066280 msgr2=0x7ffb48068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:27.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.182+0000 7ffb6d27d640 1 --2- 172.21.15.45:0/78430823 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ffb48066280 0x7ffb48068730 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ffb58000f70 tx=0x7ffb58007c10 comp rx=0 tx=0).stop 2023-10-03T19:17:27.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.186+0000 7ffb6d27d640 1 -- 172.21.15.45:0/78430823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb681500f0 msgr2=0x7ffb68145fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:27.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.186+0000 7ffb6d27d640 1 --2- 172.21.15.45:0/78430823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb681500f0 0x7ffb68145fa0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ffb600b2040 tx=0x7ffb6001bed0 comp rx=0 tx=0).stop 2023-10-03T19:17:27.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.186+0000 7ffb6d27d640 1 -- 172.21.15.45:0/78430823 shutdown_connections 2023-10-03T19:17:27.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.186+0000 7ffb6d27d640 1 --2- 172.21.15.45:0/78430823 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ffb48066280 0x7ffb48068730 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:27.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.186+0000 7ffb6d27d640 1 --2- 172.21.15.45:0/78430823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb681500f0 0x7ffb68145fa0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:27.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.186+0000 7ffb6d27d640 1 --2- 172.21.15.45:0/78430823 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb68070df0 0x7ffb68145a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:27.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.186+0000 7ffb6d27d640 1 --2- 172.21.15.45:0/78430823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb68070140 0x7ffb680c0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:27.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.186+0000 7ffb6d27d640 1 -- 172.21.15.45:0/78430823 >> 172.21.15.45:0/78430823 conn(0x7ffb680be190 msgr2=0x7ffb680be560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:27.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.186+0000 7ffb6d27d640 1 -- 172.21.15.45:0/78430823 shutdown_connections 2023-10-03T19:17:27.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.186+0000 7ffb6d27d640 1 -- 172.21.15.45:0/78430823 wait complete. 2023-10-03T19:17:27.207 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout' 2023-10-03T19:17:27.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f6305221640 1 Processor -- start 2023-10-03T19:17:27.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f6305221640 1 -- start start 2023-10-03T19:17:27.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f6305221640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6300149e70 0x7f630014cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:27.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f6305221640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f630014c770 con 0x7f63000a7100 2023-10-03T19:17:27.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f6305221640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f630006efe0 con 0x7f63000bf370 2023-10-03T19:17:27.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f6305221640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63000bebc0 con 0x7f6300149e70 2023-10-03T19:17:27.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f62ff59e640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f63000a7100 0x7f630014fbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49018/0 (socket says 172.21.15.45:49018) 2023-10-03T19:17:27.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f62ff59e640 1 -- 172.21.15.45:0/413966363 learned_addr learned my addr 172.21.15.45:0/413966363 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:27.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f62fe59c640 1 --2- 172.21.15.45:0/413966363 >> v2:172.21.15.79:3300/0 conn(0x7f6300149e70 0x7f630014cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:27.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f62fdd9b640 1 -- 172.21.15.45:0/413966363 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3141622057 0 0) 0x7f630014c770 con 0x7f63000a7100 2023-10-03T19:17:27.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f62fdd9b640 1 -- 172.21.15.45:0/413966363 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62ec003530 con 0x7f63000a7100 2023-10-03T19:17:27.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f62fdd9b640 1 -- 172.21.15.45:0/413966363 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1464936758 0 0) 0x7f62ec003530 con 0x7f63000a7100 2023-10-03T19:17:27.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f62fdd9b640 1 -- 172.21.15.45:0/413966363 >> v2:172.21.15.79:3300/0 conn(0x7f6300149e70 msgr2=0x7f630014cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:27.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f62fdd9b640 1 --2- 172.21.15.45:0/413966363 >> v2:172.21.15.79:3300/0 conn(0x7f6300149e70 0x7f630014cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:27.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f62fdd9b640 1 -- 172.21.15.45:0/413966363 >> v1:172.21.15.79:6789/0 conn(0x7f63000bf370 legacy=0x7f6300149760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:27.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f62fdd9b640 1 -- 172.21.15.45:0/413966363 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630006f2c0 con 0x7f63000a7100 2023-10-03T19:17:27.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f62fdd9b640 1 -- 172.21.15.45:0/413966363 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f62f8001a00 con 0x7f63000a7100 2023-10-03T19:17:27.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f62fdd9b640 1 -- 172.21.15.45:0/413966363 >> v1:172.21.15.45:6789/0 conn(0x7f63000a7100 legacy=0x7f630014fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:27.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f62fdd9b640 1 --2- 172.21.15.45:0/413966363 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f62ec003980 0x7f62ec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:27.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f62fdd9b640 1 --2- 172.21.15.45:0/413966363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62ec0047d0 0x7f62ec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:27.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f62fdd9b640 1 --2- 172.21.15.45:0/413966363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62ec005180 0x7f62ec00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:27.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f62fdd9b640 1 -- 172.21.15.45:0/413966363 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63000bebc0 con 0x7f62ec0047d0 2023-10-03T19:17:27.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f62fdd9b640 1 -- 172.21.15.45:0/413966363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec00c090 con 0x7f62ec005180 2023-10-03T19:17:27.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f62fdd9b640 1 -- 172.21.15.45:0/413966363 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec00c250 con 0x7f62ec003980 2023-10-03T19:17:27.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f62fe59c640 1 --2- 172.21.15.45:0/413966363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62ec0047d0 0x7f62ec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:27.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f62fed9d640 1 --2- 172.21.15.45:0/413966363 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f62ec003980 0x7f62ec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:27.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f62fe59c640 1 -- 172.21.15.45:0/413966363 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f62ec003980 msgr2=0x7f62ec003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:27.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f62fe59c640 1 --2- 172.21.15.45:0/413966363 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f62ec003980 0x7f62ec003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:27.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f62fe59c640 1 -- 172.21.15.45:0/413966363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62ec005180 msgr2=0x7f62ec00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:27.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f62fe59c640 1 --2- 172.21.15.45:0/413966363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62ec005180 0x7f62ec00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:27.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f62fe59c640 1 -- 172.21.15.45:0/413966363 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ec003530 con 0x7f62ec0047d0 2023-10-03T19:17:27.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.338+0000 7f62ff59e640 1 -- 172.21.15.45:0/413966363 reap_dead start 2023-10-03T19:17:27.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.342+0000 7f62fe59c640 1 --2- 172.21.15.45:0/413966363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62ec0047d0 0x7f62ec004c40 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f63000a1f50 tx=0x7f62f001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4412363b7f056c1f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:27.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.342+0000 7f62fdd9b640 1 -- 172.21.15.45:0/413966363 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f00a5620 con 0x7f62ec0047d0 2023-10-03T19:17:27.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.342+0000 7f62fdd9b640 1 -- 172.21.15.45:0/413966363 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f00a5780 con 0x7f62ec0047d0 2023-10-03T19:17:27.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.342+0000 7f62fdd9b640 1 -- 172.21.15.45:0/413966363 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f00a5b30 con 0x7f62ec0047d0 2023-10-03T19:17:27.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.342+0000 7f6305221640 1 -- 172.21.15.45:0/413966363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62ec0047d0 msgr2=0x7f62ec004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:27.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.342+0000 7f6305221640 1 --2- 172.21.15.45:0/413966363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62ec0047d0 0x7f62ec004c40 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f63000a1f50 tx=0x7f62f001ca30 comp rx=0 tx=0).stop 2023-10-03T19:17:27.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.342+0000 7f6305221640 1 -- 172.21.15.45:0/413966363 shutdown_connections 2023-10-03T19:17:27.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.342+0000 7f6305221640 1 --2- 172.21.15.45:0/413966363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62ec0047d0 0x7f62ec004c40 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:27.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.342+0000 7f6305221640 1 -- 172.21.15.45:0/413966363 >> 172.21.15.45:0/413966363 conn(0x7f630006bce0 msgr2=0x7f630006c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:27.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.342+0000 7f6305221640 1 -- 172.21.15.45:0/413966363 shutdown_connections 2023-10-03T19:17:27.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.342+0000 7f6305221640 1 -- 172.21.15.45:0/413966363 wait complete. 2023-10-03T19:17:27.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.342+0000 7f6305221640 1 Processor -- start 2023-10-03T19:17:27.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.342+0000 7f6305221640 1 -- start start 2023-10-03T19:17:27.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.342+0000 7f6305221640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62ec0047d0 0x7f63001d8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:27.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.342+0000 7f6305221640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f630014ed20 0x7f630014ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:27.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.342+0000 7f6305221640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6300150470 0x7f6300142910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:27.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.342+0000 7f6305221640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630014fae0 con 0x7f62ec0047d0 2023-10-03T19:17:27.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.342+0000 7f6305221640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63001e94a0 con 0x7f630014ed20 2023-10-03T19:17:27.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.342+0000 7f6305221640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63001508f0 con 0x7f6300150470 2023-10-03T19:17:27.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.346+0000 7f62fed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62ec0047d0 0x7f63001d8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:27.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.346+0000 7f62fed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62ec0047d0 0x7f63001d8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59596/0 (socket says 172.21.15.45:59596) 2023-10-03T19:17:27.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.346+0000 7f62fed9d640 1 -- 172.21.15.45:0/579073040 learned_addr learned my addr 172.21.15.45:0/579073040 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:27.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.346+0000 7f62ff59e640 1 --2- 172.21.15.45:0/579073040 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6300150470 0x7f6300142910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:27.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.346+0000 7f62fe59c640 1 --2- 172.21.15.45:0/579073040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f630014ed20 0x7f630014ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:27.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.346+0000 7f62fed9d640 1 -- 172.21.15.45:0/579073040 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6300150470 msgr2=0x7f6300142910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:27.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.346+0000 7f62fed9d640 1 --2- 172.21.15.45:0/579073040 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6300150470 0x7f6300142910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:27.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.346+0000 7f62fed9d640 1 -- 172.21.15.45:0/579073040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f630014ed20 msgr2=0x7f630014ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:27.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.346+0000 7f62fed9d640 1 --2- 172.21.15.45:0/579073040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f630014ed20 0x7f630014ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:27.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.346+0000 7f62fed9d640 1 -- 172.21.15.45:0/579073040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630014d3f0 con 0x7f62ec0047d0 2023-10-03T19:17:27.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.346+0000 7f62ff59e640 1 --2- 172.21.15.45:0/579073040 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6300150470 0x7f6300142910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:27.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.346+0000 7f62fed9d640 1 --2- 172.21.15.45:0/579073040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62ec0047d0 0x7f63001d8ee0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f62e800d4a0 tx=0x7f62e800d590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:27.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.346+0000 7f62f77fe640 1 -- 172.21.15.45:0/579073040 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e800b070 con 0x7f62ec0047d0 2023-10-03T19:17:27.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.346+0000 7f62f77fe640 1 -- 172.21.15.45:0/579073040 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e80052d0 con 0x7f62ec0047d0 2023-10-03T19:17:27.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.346+0000 7f6305221640 1 -- 172.21.15.45:0/579073040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6300149b70 con 0x7f62ec0047d0 2023-10-03T19:17:27.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.346+0000 7f62f77fe640 1 -- 172.21.15.45:0/579073040 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e8003620 con 0x7f62ec0047d0 2023-10-03T19:17:27.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.346+0000 7f6305221640 1 -- 172.21.15.45:0/579073040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f630014d580 con 0x7f62ec0047d0 2023-10-03T19:17:27.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.346+0000 7f6305221640 1 -- 172.21.15.45:0/579073040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f630004de80 con 0x7f62ec0047d0 2023-10-03T19:17:27.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.346+0000 7f62f77fe640 1 -- 172.21.15.45:0/579073040 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f62e8003780 con 0x7f62ec0047d0 2023-10-03T19:17:27.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.346+0000 7f62f77fe640 1 --2- 172.21.15.45:0/579073040 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f62e00662b0 0x7f62e0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:27.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.346+0000 7f62f77fe640 1 -- 172.21.15.45:0/579073040 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f62e8082eb0 con 0x7f62ec0047d0 2023-10-03T19:17:27.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.346+0000 7f62fe59c640 1 --2- 172.21.15.45:0/579073040 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f62e00662b0 0x7f62e0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:27.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.350+0000 7f62fe59c640 1 --2- 172.21.15.45:0/579073040 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f62e00662b0 0x7f62e0068760 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f62f00af000 tx=0x7f62f00046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:27.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.350+0000 7f62f77fe640 1 -- 172.21.15.45:0/579073040 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f62e80506e0 con 0x7f62ec0047d0 2023-10-03T19:17:27.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.574+0000 7f6305221640 1 -- 172.21.15.45:0/579073040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]} v 0) v1 -- 0x7f6300148da0 con 0x7f62ec0047d0 2023-10-03T19:17:27.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.866+0000 7f62f77fe640 1 -- 172.21.15.45:0/579073040 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]}]=0 v234) v1 ==== 152+0+0 (secure 0 0 0) 0x7f62e8053d00 con 0x7f62ec0047d0 2023-10-03T19:17:27.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.870+0000 7f6305221640 1 -- 172.21.15.45:0/579073040 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f62e00662b0 msgr2=0x7f62e0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:27.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.870+0000 7f6305221640 1 --2- 172.21.15.45:0/579073040 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f62e00662b0 0x7f62e0068760 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f62f00af000 tx=0x7f62f00046d0 comp rx=0 tx=0).stop 2023-10-03T19:17:27.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.870+0000 7f6305221640 1 -- 172.21.15.45:0/579073040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62ec0047d0 msgr2=0x7f63001d8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:27.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.870+0000 7f6305221640 1 --2- 172.21.15.45:0/579073040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62ec0047d0 0x7f63001d8ee0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f62e800d4a0 tx=0x7f62e800d590 comp rx=0 tx=0).stop 2023-10-03T19:17:27.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.870+0000 7f6305221640 1 -- 172.21.15.45:0/579073040 shutdown_connections 2023-10-03T19:17:27.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.870+0000 7f6305221640 1 --2- 172.21.15.45:0/579073040 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f62e00662b0 0x7f62e0068760 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:27.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.870+0000 7f6305221640 1 --2- 172.21.15.45:0/579073040 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6300150470 0x7f6300142910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:27.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.870+0000 7f6305221640 1 --2- 172.21.15.45:0/579073040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f630014ed20 0x7f630014ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:27.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.870+0000 7f6305221640 1 --2- 172.21.15.45:0/579073040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62ec0047d0 0x7f63001d8ee0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:27.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.870+0000 7f6305221640 1 -- 172.21.15.45:0/579073040 >> 172.21.15.45:0/579073040 conn(0x7f630006bce0 msgr2=0x7f63000c2700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:27.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.870+0000 7f6305221640 1 -- 172.21.15.45:0/579073040 shutdown_connections 2023-10-03T19:17:27.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:27.870+0000 7f6305221640 1 -- 172.21.15.45:0/579073040 wait complete. 2023-10-03T19:17:27.895 INFO:tasks.cephfs_test_runner:Check drop cache command with non-responding client using tell ... ok 2023-10-03T19:17:27.895 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_timeout (tasks.cephfs.test_misc.TestCacheDrop) Basic test for checking drop cache command. 2023-10-03T19:17:27.895 INFO:tasks.cephfs_test_runner:test_drop_cache_command_timeout (tasks.cephfs.test_misc.TestCacheDrop) 2023-10-03T19:17:27.895 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout' 2023-10-03T19:17:28.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.022+0000 7ff46caf4640 1 Processor -- start 2023-10-03T19:17:28.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.022+0000 7ff46caf4640 1 -- start start 2023-10-03T19:17:28.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.022+0000 7ff46caf4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff46806d5b0 0x7ff4680a5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:28.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.022+0000 7ff46caf4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff46806a340 0x7ff46814b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:28.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.022+0000 7ff46caf4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4680a6360 con 0x7ff46806d980 2023-10-03T19:17:28.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.022+0000 7ff46caf4640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff46806a7d0 con 0x7ff46806d5b0 2023-10-03T19:17:28.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.022+0000 7ff46caf4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4680a59a0 con 0x7ff46806a340 2023-10-03T19:17:28.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.022+0000 7ff46659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff46806d5b0 0x7ff4680a5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:28.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.022+0000 7ff46659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff46806d5b0 0x7ff4680a5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59602/0 (socket says 172.21.15.45:59602) 2023-10-03T19:17:28.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.022+0000 7ff46659c640 1 -- 172.21.15.45:0/64239000 learned_addr learned my addr 172.21.15.45:0/64239000 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:28.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.022+0000 7ff466d9d640 1 --2- 172.21.15.45:0/64239000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff46806a340 0x7ff46814b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:28.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.022+0000 7ff46659c640 1 -- 172.21.15.45:0/64239000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff46806a340 msgr2=0x7ff46814b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:28.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.022+0000 7ff46659c640 1 --2- 172.21.15.45:0/64239000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff46806a340 0x7ff46814b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:28.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.022+0000 7ff46659c640 1 -- 172.21.15.45:0/64239000 >> v1:172.21.15.79:6789/0 conn(0x7ff46806d980 legacy=0x7ff46814d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:28.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.022+0000 7ff46659c640 1 -- 172.21.15.45:0/64239000 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46806de00 con 0x7ff46806d5b0 2023-10-03T19:17:28.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.022+0000 7ff466d9d640 1 --2- 172.21.15.45:0/64239000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff46806a340 0x7ff46814b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:28.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff46659c640 1 --2- 172.21.15.45:0/64239000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff46806d5b0 0x7ff4680a5e20 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7ff458009870 tx=0x7ff45801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a301a043737d50c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:28.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff465d9b640 1 -- 172.21.15.45:0/64239000 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4580a8a30 con 0x7ff46806d5b0 2023-10-03T19:17:28.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff465d9b640 1 -- 172.21.15.45:0/64239000 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4580a8b90 con 0x7ff46806d5b0 2023-10-03T19:17:28.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff465d9b640 1 -- 172.21.15.45:0/64239000 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4580b0440 con 0x7ff46806d5b0 2023-10-03T19:17:28.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff46caf4640 1 -- 172.21.15.45:0/64239000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff46806d5b0 msgr2=0x7ff4680a5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:28.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff46caf4640 1 --2- 172.21.15.45:0/64239000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff46806d5b0 0x7ff4680a5e20 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7ff458009870 tx=0x7ff45801ed30 comp rx=0 tx=0).stop 2023-10-03T19:17:28.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff46caf4640 1 -- 172.21.15.45:0/64239000 shutdown_connections 2023-10-03T19:17:28.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff46caf4640 1 --2- 172.21.15.45:0/64239000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff46806a340 0x7ff46814b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:28.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff46caf4640 1 --2- 172.21.15.45:0/64239000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff46806d5b0 0x7ff4680a5e20 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:28.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff46caf4640 1 -- 172.21.15.45:0/64239000 >> 172.21.15.45:0/64239000 conn(0x7ff4680c1600 msgr2=0x7ff4680c1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:28.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff46caf4640 1 -- 172.21.15.45:0/64239000 shutdown_connections 2023-10-03T19:17:28.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff46caf4640 1 -- 172.21.15.45:0/64239000 wait complete. 2023-10-03T19:17:28.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff46caf4640 1 Processor -- start 2023-10-03T19:17:28.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff46caf4640 1 -- start start 2023-10-03T19:17:28.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff46caf4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff46806a340 0x7ff4680babd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:28.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff46caf4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff46806d5b0 0x7ff4681e3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:28.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff46caf4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff4681d4250 0x7ff4681e3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:28.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff46caf4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff468098bf0 con 0x7ff46806d5b0 2023-10-03T19:17:28.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff46caf4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4681e7a20 con 0x7ff46806a340 2023-10-03T19:17:28.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff46caf4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4680bb110 con 0x7ff4681d4250 2023-10-03T19:17:28.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff45ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff46806d5b0 0x7ff4681e3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:28.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff45ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff46806d5b0 0x7ff4681e3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59616/0 (socket says 172.21.15.45:59616) 2023-10-03T19:17:28.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff45ffff640 1 -- 172.21.15.45:0/1581478951 learned_addr learned my addr 172.21.15.45:0/1581478951 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:28.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff466d9d640 1 --2- 172.21.15.45:0/1581478951 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff4681d4250 0x7ff4681e3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:28.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff46659c640 1 --2- 172.21.15.45:0/1581478951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff46806a340 0x7ff4680babd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:28.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff45ffff640 1 -- 172.21.15.45:0/1581478951 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff4681d4250 msgr2=0x7ff4681e3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:28.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff45ffff640 1 --2- 172.21.15.45:0/1581478951 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff4681d4250 0x7ff4681e3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:28.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff45ffff640 1 -- 172.21.15.45:0/1581478951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff46806a340 msgr2=0x7ff4680babd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:28.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff45ffff640 1 --2- 172.21.15.45:0/1581478951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff46806a340 0x7ff4680babd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:28.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff45ffff640 1 -- 172.21.15.45:0/1581478951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4580094d0 con 0x7ff46806d5b0 2023-10-03T19:17:28.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff45ffff640 1 --2- 172.21.15.45:0/1581478951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff46806d5b0 0x7ff4681e3850 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7ff45000c3c0 tx=0x7ff45000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:28.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff45effd640 1 -- 172.21.15.45:0/1581478951 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4500052d0 con 0x7ff46806d5b0 2023-10-03T19:17:28.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff45effd640 1 -- 172.21.15.45:0/1581478951 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff450005430 con 0x7ff46806d5b0 2023-10-03T19:17:28.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff46caf4640 1 -- 172.21.15.45:0/1581478951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4680bbb30 con 0x7ff46806d5b0 2023-10-03T19:17:28.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff45effd640 1 -- 172.21.15.45:0/1581478951 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450003820 con 0x7ff46806d5b0 2023-10-03T19:17:28.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.026+0000 7ff46caf4640 1 -- 172.21.15.45:0/1581478951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4680a56c0 con 0x7ff46806d5b0 2023-10-03T19:17:28.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.030+0000 7ff46caf4640 1 -- 172.21.15.45:0/1581478951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4680bbcc0 con 0x7ff46806d5b0 2023-10-03T19:17:28.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.030+0000 7ff45effd640 1 -- 172.21.15.45:0/1581478951 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff450003980 con 0x7ff46806d5b0 2023-10-03T19:17:28.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.030+0000 7ff45effd640 1 --2- 172.21.15.45:0/1581478951 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff4480662b0 0x7ff448068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:28.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.030+0000 7ff45effd640 1 -- 172.21.15.45:0/1581478951 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ff450082f30 con 0x7ff46806d5b0 2023-10-03T19:17:28.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.030+0000 7ff46659c640 1 --2- 172.21.15.45:0/1581478951 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff4480662b0 0x7ff448068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:28.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.030+0000 7ff46659c640 1 --2- 172.21.15.45:0/1581478951 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff4480662b0 0x7ff448068760 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff4580b2000 tx=0x7ff458008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:28.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.034+0000 7ff45effd640 1 -- 172.21.15.45:0/1581478951 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff4500506b0 con 0x7ff46806d5b0 2023-10-03T19:17:28.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.246+0000 7ff46caf4640 1 -- 172.21.15.45:0/1581478951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]} v 0) v1 -- 0x7ff46804de80 con 0x7ff46806d5b0 2023-10-03T19:17:28.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.878+0000 7ff45effd640 1 -- 172.21.15.45:0/1581478951 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]}]=0 v235) v1 ==== 150+0+0 (secure 0 0 0) 0x7ff450053cd0 con 0x7ff46806d5b0 2023-10-03T19:17:28.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.882+0000 7ff46caf4640 1 -- 172.21.15.45:0/1581478951 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff4480662b0 msgr2=0x7ff448068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:28.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.882+0000 7ff46caf4640 1 --2- 172.21.15.45:0/1581478951 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff4480662b0 0x7ff448068760 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff4580b2000 tx=0x7ff458008040 comp rx=0 tx=0).stop 2023-10-03T19:17:28.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.882+0000 7ff46caf4640 1 -- 172.21.15.45:0/1581478951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff46806d5b0 msgr2=0x7ff4681e3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:28.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.882+0000 7ff46caf4640 1 --2- 172.21.15.45:0/1581478951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff46806d5b0 0x7ff4681e3850 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7ff45000c3c0 tx=0x7ff45000c880 comp rx=0 tx=0).stop 2023-10-03T19:17:28.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.882+0000 7ff46caf4640 1 -- 172.21.15.45:0/1581478951 shutdown_connections 2023-10-03T19:17:28.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.882+0000 7ff46caf4640 1 --2- 172.21.15.45:0/1581478951 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff4480662b0 0x7ff448068760 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:28.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.882+0000 7ff46caf4640 1 --2- 172.21.15.45:0/1581478951 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff4681d4250 0x7ff4681e3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:28.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.882+0000 7ff46caf4640 1 --2- 172.21.15.45:0/1581478951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff46806d5b0 0x7ff4681e3850 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:28.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.882+0000 7ff46caf4640 1 --2- 172.21.15.45:0/1581478951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff46806a340 0x7ff4680babd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:28.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.882+0000 7ff46caf4640 1 -- 172.21.15.45:0/1581478951 >> 172.21.15.45:0/1581478951 conn(0x7ff4680c1600 msgr2=0x7ff4681d9800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:28.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.882+0000 7ff46caf4640 1 -- 172.21.15.45:0/1581478951 shutdown_connections 2023-10-03T19:17:28.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:28.882+0000 7ff46caf4640 1 -- 172.21.15.45:0/1581478951 wait complete. 2023-10-03T19:17:28.905 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-03T19:17:29.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.034+0000 7f9938da5640 1 Processor -- start 2023-10-03T19:17:29.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.034+0000 7f9938da5640 1 -- start start 2023-10-03T19:17:29.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.034+0000 7f9938da5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f993406d560 0x7f99340a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:29.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.034+0000 7f9938da5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f993406c760 0x7f99340a5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:29.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.034+0000 7f9938da5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f993406c2d0 con 0x7f99340712c0 2023-10-03T19:17:29.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.034+0000 7f9938da5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9934150610 con 0x7f993406d560 2023-10-03T19:17:29.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.034+0000 7f9938da5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99341508b0 con 0x7f993406c760 2023-10-03T19:17:29.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.034+0000 7f9931d9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f993406d560 0x7f99340a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:29.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.034+0000 7f993259c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f99340712c0 0x7f99340bcbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49028/0 (socket says 172.21.15.45:49028) 2023-10-03T19:17:29.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.034+0000 7f993259c640 1 -- 172.21.15.45:0/2498119104 learned_addr learned my addr 172.21.15.45:0/2498119104 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:29.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.034+0000 7f9931d9b640 1 -- 172.21.15.45:0/2498119104 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f993406c760 msgr2=0x7f99340a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:29.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.034+0000 7f9932d9d640 1 --2- 172.21.15.45:0/2498119104 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f993406c760 0x7f99340a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:29.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.034+0000 7f993159a640 1 -- 172.21.15.45:0/2498119104 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302665426 0 0) 0x7f993406c2d0 con 0x7f99340712c0 2023-10-03T19:17:29.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.034+0000 7f9931d9b640 1 --2- 172.21.15.45:0/2498119104 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f993406c760 0x7f99340a5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:29.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.034+0000 7f9931d9b640 1 -- 172.21.15.45:0/2498119104 >> v1:172.21.15.45:6789/0 conn(0x7f99340712c0 legacy=0x7f99340bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:29.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.034+0000 7f9931d9b640 1 -- 172.21.15.45:0/2498119104 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993406d2e0 con 0x7f993406d560 2023-10-03T19:17:29.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.034+0000 7f9932d9d640 1 --2- 172.21.15.45:0/2498119104 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f993406c760 0x7f99340a5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:29.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9931d9b640 1 --2- 172.21.15.45:0/2498119104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f993406d560 0x7f99340a53c0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f99280097c0 tx=0x7f992801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56bbe65ab93286df server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:29.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f993159a640 1 -- 172.21.15.45:0/2498119104 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99280ac620 con 0x7f993406d560 2023-10-03T19:17:29.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f993159a640 1 -- 172.21.15.45:0/2498119104 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99280ac780 con 0x7f993406d560 2023-10-03T19:17:29.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f993159a640 1 -- 172.21.15.45:0/2498119104 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99280acb10 con 0x7f993406d560 2023-10-03T19:17:29.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9938da5640 1 -- 172.21.15.45:0/2498119104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f993406d560 msgr2=0x7f99340a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:29.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9938da5640 1 --2- 172.21.15.45:0/2498119104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f993406d560 0x7f99340a53c0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f99280097c0 tx=0x7f992801c480 comp rx=0 tx=0).stop 2023-10-03T19:17:29.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9938da5640 1 -- 172.21.15.45:0/2498119104 shutdown_connections 2023-10-03T19:17:29.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9938da5640 1 --2- 172.21.15.45:0/2498119104 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f993406c760 0x7f99340a5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:29.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9938da5640 1 --2- 172.21.15.45:0/2498119104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f993406d560 0x7f99340a53c0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:29.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9938da5640 1 -- 172.21.15.45:0/2498119104 >> 172.21.15.45:0/2498119104 conn(0x7f99340a20d0 msgr2=0x7f99340a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:29.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9938da5640 1 -- 172.21.15.45:0/2498119104 shutdown_connections 2023-10-03T19:17:29.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9938da5640 1 -- 172.21.15.45:0/2498119104 wait complete. 2023-10-03T19:17:29.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9938da5640 1 Processor -- start 2023-10-03T19:17:29.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9938da5640 1 -- start start 2023-10-03T19:17:29.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9938da5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f993406c760 0x7f99340b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:29.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9938da5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f993406d560 0x7f9934143c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:29.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9938da5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99340712c0 0x7f99341441a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:29.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9938da5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99340b93f0 con 0x7f99340712c0 2023-10-03T19:17:29.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9938da5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99340ba100 con 0x7f993406c760 2023-10-03T19:17:29.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9938da5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993414b550 con 0x7f993406d560 2023-10-03T19:17:29.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9932d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99340712c0 0x7f99341441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:29.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9932d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99340712c0 0x7f99341441a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59638/0 (socket says 172.21.15.45:59638) 2023-10-03T19:17:29.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9932d9d640 1 -- 172.21.15.45:0/317460736 learned_addr learned my addr 172.21.15.45:0/317460736 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:29.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f993259c640 1 --2- 172.21.15.45:0/317460736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f993406c760 0x7f99340b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:29.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9931d9b640 1 --2- 172.21.15.45:0/317460736 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f993406d560 0x7f9934143c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:29.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9932d9d640 1 -- 172.21.15.45:0/317460736 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f993406d560 msgr2=0x7f9934143c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:29.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9932d9d640 1 --2- 172.21.15.45:0/317460736 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f993406d560 0x7f9934143c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:29.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9932d9d640 1 -- 172.21.15.45:0/317460736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f993406c760 msgr2=0x7f99340b5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:29.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9932d9d640 1 --2- 172.21.15.45:0/317460736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f993406c760 0x7f99340b5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:29.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9932d9d640 1 -- 172.21.15.45:0/317460736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9928009420 con 0x7f99340712c0 2023-10-03T19:17:29.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f993259c640 1 --2- 172.21.15.45:0/317460736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f993406c760 0x7f99340b5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:29.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9932d9d640 1 --2- 172.21.15.45:0/317460736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99340712c0 0x7f99341441a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f992c00cd80 tx=0x7f992c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:29.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9922ffd640 1 -- 172.21.15.45:0/317460736 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c00f680 con 0x7f99340712c0 2023-10-03T19:17:29.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9922ffd640 1 -- 172.21.15.45:0/317460736 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992c00f800 con 0x7f99340712c0 2023-10-03T19:17:29.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9938da5640 1 -- 172.21.15.45:0/317460736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99340bd460 con 0x7f99340712c0 2023-10-03T19:17:29.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9922ffd640 1 -- 172.21.15.45:0/317460736 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c00fbb0 con 0x7f99340712c0 2023-10-03T19:17:29.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.038+0000 7f9938da5640 1 -- 172.21.15.45:0/317460736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99340bd2d0 con 0x7f99340712c0 2023-10-03T19:17:29.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.042+0000 7f9938da5640 1 -- 172.21.15.45:0/317460736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99341596f0 con 0x7f99340712c0 2023-10-03T19:17:29.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.042+0000 7f9922ffd640 1 -- 172.21.15.45:0/317460736 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f992c00b040 con 0x7f99340712c0 2023-10-03T19:17:29.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.042+0000 7f9922ffd640 1 --2- 172.21.15.45:0/317460736 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9914066280 0x7f9914068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:29.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.042+0000 7f9922ffd640 1 -- 172.21.15.45:0/317460736 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f992c0843c0 con 0x7f99340712c0 2023-10-03T19:17:29.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.042+0000 7f993259c640 1 --2- 172.21.15.45:0/317460736 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9914066280 0x7f9914068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:29.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.042+0000 7f993259c640 1 --2- 172.21.15.45:0/317460736 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9914066280 0x7f9914068730 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9924007fd0 tx=0x7f9924009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:29.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.046+0000 7f9922ffd640 1 -- 172.21.15.45:0/317460736 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f992c051b40 con 0x7f99340712c0 2023-10-03T19:17:29.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.202+0000 7f9938da5640 1 -- 172.21.15.45:0/317460736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f99340bca30 con 0x7f99340712c0 2023-10-03T19:17:29.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.206+0000 7f9922ffd640 1 -- 172.21.15.45:0/317460736 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f992c055160 con 0x7f99340712c0 2023-10-03T19:17:29.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.210+0000 7f9938da5640 1 -- 172.21.15.45:0/317460736 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9914066280 msgr2=0x7f9914068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:29.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.210+0000 7f9938da5640 1 --2- 172.21.15.45:0/317460736 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9914066280 0x7f9914068730 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9924007fd0 tx=0x7f9924009040 comp rx=0 tx=0).stop 2023-10-03T19:17:29.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.210+0000 7f9938da5640 1 -- 172.21.15.45:0/317460736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99340712c0 msgr2=0x7f99341441a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:29.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.210+0000 7f9938da5640 1 --2- 172.21.15.45:0/317460736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99340712c0 0x7f99341441a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f992c00cd80 tx=0x7f992c00a650 comp rx=0 tx=0).stop 2023-10-03T19:17:29.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.210+0000 7f9938da5640 1 -- 172.21.15.45:0/317460736 shutdown_connections 2023-10-03T19:17:29.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.210+0000 7f9938da5640 1 --2- 172.21.15.45:0/317460736 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9914066280 0x7f9914068730 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:29.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.210+0000 7f9938da5640 1 --2- 172.21.15.45:0/317460736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99340712c0 0x7f99341441a0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:29.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.210+0000 7f9938da5640 1 --2- 172.21.15.45:0/317460736 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f993406d560 0x7f9934143c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:29.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.210+0000 7f9938da5640 1 --2- 172.21.15.45:0/317460736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f993406c760 0x7f99340b5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:29.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.210+0000 7f9938da5640 1 -- 172.21.15.45:0/317460736 >> 172.21.15.45:0/317460736 conn(0x7f99340a20d0 msgr2=0x7f99340bfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:29.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.210+0000 7f9938da5640 1 -- 172.21.15.45:0/317460736 shutdown_connections 2023-10-03T19:17:29.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.210+0000 7f9938da5640 1 -- 172.21.15.45:0/317460736 wait complete. 2023-10-03T19:17:29.228 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-03T19:17:29.228 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:17:29.280 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:17:29.343 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:17:29.400 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:17:29.444 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-03T19:17:29.445 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:17:29.445 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:17:29.451 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336540k,nr_inodes=4084135,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16206 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-10-03T19:17:29.452 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-03T19:17:29.452 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:17:29.502 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336540k,nr_inodes=4084135,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=22607 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-10-03T19:17:29.502 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-10-03T19:17:29.502 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:17:29.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.630+0000 7f4cdcbbd640 1 Processor -- start 2023-10-03T19:17:29.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.630+0000 7f4cdcbbd640 1 -- start start 2023-10-03T19:17:29.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.634+0000 7f4cdcbbd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4cd814f240 0x7f4cd81528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:29.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.634+0000 7f4cdcbbd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4cd80c2790 0x7f4cd80c0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:29.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.634+0000 7f4cdcbbd640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cd806b2d0 con 0x7f4cd80bb1d0 2023-10-03T19:17:29.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.634+0000 7f4cdcbbd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cd806b640 con 0x7f4cd814f240 2023-10-03T19:17:29.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.634+0000 7f4cdcbbd640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd80c0fa0 con 0x7f4cd80c2790 2023-10-03T19:17:29.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.634+0000 7f4cd659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4cd814f240 0x7f4cd81528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:29.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.634+0000 7f4cd659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4cd814f240 0x7f4cd81528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59650/0 (socket says 172.21.15.45:59650) 2023-10-03T19:17:29.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.634+0000 7f4cd659c640 1 -- 172.21.15.45:0/7555098 learned_addr learned my addr 172.21.15.45:0/7555098 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:29.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.634+0000 7f4cd659c640 1 -- 172.21.15.45:0/7555098 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4cd80c2790 msgr2=0x7f4cd80c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:29.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.634+0000 7f4cd5d9b640 1 --2- 172.21.15.45:0/7555098 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4cd80c2790 0x7f4cd80c0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:29.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.634+0000 7f4cd659c640 1 --2- 172.21.15.45:0/7555098 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4cd80c2790 0x7f4cd80c0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:29.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.634+0000 7f4cd659c640 1 -- 172.21.15.45:0/7555098 >> v1:172.21.15.79:6789/0 conn(0x7f4cd80bb1d0 legacy=0x7f4cd80c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:29.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.634+0000 7f4cd659c640 1 -- 172.21.15.45:0/7555098 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd80a3c60 con 0x7f4cd814f240 2023-10-03T19:17:29.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.634+0000 7f4cd659c640 1 --2- 172.21.15.45:0/7555098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd814f240 0x7f4cd81528d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc006fd0 tx=0x7f4ccc01ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce178a0d9e7f2e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:29.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.634+0000 7f4cd559a640 1 -- 172.21.15.45:0/7555098 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc0a8990 con 0x7f4cd814f240 2023-10-03T19:17:29.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.634+0000 7f4cd559a640 1 -- 172.21.15.45:0/7555098 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ccc0a8af0 con 0x7f4cd814f240 2023-10-03T19:17:29.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.634+0000 7f4cd559a640 1 -- 172.21.15.45:0/7555098 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc0a8e80 con 0x7f4cd814f240 2023-10-03T19:17:29.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cdcbbd640 1 -- 172.21.15.45:0/7555098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd814f240 msgr2=0x7f4cd81528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:29.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cdcbbd640 1 --2- 172.21.15.45:0/7555098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd814f240 0x7f4cd81528d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc006fd0 tx=0x7f4ccc01ecd0 comp rx=0 tx=0).stop 2023-10-03T19:17:29.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cdcbbd640 1 -- 172.21.15.45:0/7555098 shutdown_connections 2023-10-03T19:17:29.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cdcbbd640 1 --2- 172.21.15.45:0/7555098 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4cd80c2790 0x7f4cd80c0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:29.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cdcbbd640 1 --2- 172.21.15.45:0/7555098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd814f240 0x7f4cd81528d0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:29.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cdcbbd640 1 -- 172.21.15.45:0/7555098 >> 172.21.15.45:0/7555098 conn(0x7f4cd80a64a0 msgr2=0x7f4cd80a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:29.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cdcbbd640 1 -- 172.21.15.45:0/7555098 shutdown_connections 2023-10-03T19:17:29.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cdcbbd640 1 -- 172.21.15.45:0/7555098 wait complete. 2023-10-03T19:17:29.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cdcbbd640 1 Processor -- start 2023-10-03T19:17:29.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cdcbbd640 1 -- start start 2023-10-03T19:17:29.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cdcbbd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4cd80bb1d0 0x7f4cd80be380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:29.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cdcbbd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4cd80c2790 0x7f4cd8150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:29.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cdcbbd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd814f240 0x7f4cd8151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:29.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cdcbbd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd81e45c0 con 0x7f4cd814f240 2023-10-03T19:17:29.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cdcbbd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd8149730 con 0x7f4cd80c2790 2023-10-03T19:17:29.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cdcbbd640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd8148cb0 con 0x7f4cd80bb1d0 2023-10-03T19:17:29.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cd6d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd814f240 0x7f4cd8151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:29.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cd6d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd814f240 0x7f4cd8151080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59658/0 (socket says 172.21.15.45:59658) 2023-10-03T19:17:29.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cd6d9d640 1 -- 172.21.15.45:0/3704136829 learned_addr learned my addr 172.21.15.45:0/3704136829 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:29.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cd659c640 1 --2- 172.21.15.45:0/3704136829 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4cd80bb1d0 0x7f4cd80be380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:29.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cd5d9b640 1 --2- 172.21.15.45:0/3704136829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4cd80c2790 0x7f4cd8150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:29.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cd6d9d640 1 -- 172.21.15.45:0/3704136829 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4cd80bb1d0 msgr2=0x7f4cd80be380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:29.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cd6d9d640 1 --2- 172.21.15.45:0/3704136829 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4cd80bb1d0 0x7f4cd80be380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:29.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cd6d9d640 1 -- 172.21.15.45:0/3704136829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4cd80c2790 msgr2=0x7f4cd8150b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:29.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cd6d9d640 1 --2- 172.21.15.45:0/3704136829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4cd80c2790 0x7f4cd8150b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:29.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cd6d9d640 1 -- 172.21.15.45:0/3704136829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ccc009480 con 0x7f4cd814f240 2023-10-03T19:17:29.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cd6d9d640 1 --2- 172.21.15.45:0/3704136829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd814f240 0x7f4cd8151080 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f4cd000c780 tx=0x7f4cd000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:29.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cc6ffd640 1 -- 172.21.15.45:0/3704136829 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd0004b70 con 0x7f4cd814f240 2023-10-03T19:17:29.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cc6ffd640 1 -- 172.21.15.45:0/3704136829 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd000ce90 con 0x7f4cd814f240 2023-10-03T19:17:29.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cc6ffd640 1 -- 172.21.15.45:0/3704136829 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd000a850 con 0x7f4cd814f240 2023-10-03T19:17:29.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cdcbbd640 1 -- 172.21.15.45:0/3704136829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cd814e740 con 0x7f4cd814f240 2023-10-03T19:17:29.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.638+0000 7f4cdcbbd640 1 -- 172.21.15.45:0/3704136829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cd80c19b0 con 0x7f4cd814f240 2023-10-03T19:17:29.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.642+0000 7f4cdcbbd640 1 -- 172.21.15.45:0/3704136829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cd80a3f40 con 0x7f4cd814f240 2023-10-03T19:17:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.642+0000 7f4cc6ffd640 1 -- 172.21.15.45:0/3704136829 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4cd000a9b0 con 0x7f4cd814f240 2023-10-03T19:17:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.642+0000 7f4cc6ffd640 1 --2- 172.21.15.45:0/3704136829 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4cb80662b0 0x7f4cb8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:29.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.642+0000 7f4cc6ffd640 1 -- 172.21.15.45:0/3704136829 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f4cd0083c90 con 0x7f4cd814f240 2023-10-03T19:17:29.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.642+0000 7f4cd659c640 1 --2- 172.21.15.45:0/3704136829 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4cb80662b0 0x7f4cb8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:29.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.642+0000 7f4cd659c640 1 --2- 172.21.15.45:0/3704136829 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4cb80662b0 0x7f4cb8068760 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc0b2000 tx=0x7f4ccc0aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:29.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.646+0000 7f4cc6ffd640 1 -- 172.21.15.45:0/3704136829 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4cd0054e10 con 0x7f4cd814f240 2023-10-03T19:17:29.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.834+0000 7f4cdcbbd640 1 -- 172.21.15.45:0/3704136829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4cd80bfa90 con 0x7f4cd814f240 2023-10-03T19:17:29.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.834+0000 7f4cc6ffd640 1 -- 172.21.15.45:0/3704136829 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+2760 (secure 0 0 0) 0x7f4cd00549a0 con 0x7f4cd814f240 2023-10-03T19:17:29.836 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:17:29.836 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":31,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1808337334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1808337334},{"type":"v1","addr":"172.21.15.45:6835","nonce":1808337334}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5533,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3484102267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3484102267},{"type":"v1","addr":"172.21.15.79:6835","nonce":3484102267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/452625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":452625},{"type":"v1","addr":"172.21.15.45:6833","nonce":452625}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[]} 2023-10-03T19:17:29.837 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 31 2023-10-03T19:17:29.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.834+0000 7f4cdcbbd640 1 -- 172.21.15.45:0/3704136829 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4cb80662b0 msgr2=0x7f4cb8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:29.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.834+0000 7f4cdcbbd640 1 --2- 172.21.15.45:0/3704136829 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4cb80662b0 0x7f4cb8068760 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc0b2000 tx=0x7f4ccc0aa070 comp rx=0 tx=0).stop 2023-10-03T19:17:29.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.834+0000 7f4cdcbbd640 1 -- 172.21.15.45:0/3704136829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd814f240 msgr2=0x7f4cd8151080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:29.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.834+0000 7f4cdcbbd640 1 --2- 172.21.15.45:0/3704136829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd814f240 0x7f4cd8151080 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f4cd000c780 tx=0x7f4cd000cc40 comp rx=0 tx=0).stop 2023-10-03T19:17:29.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.834+0000 7f4cdcbbd640 1 -- 172.21.15.45:0/3704136829 shutdown_connections 2023-10-03T19:17:29.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.834+0000 7f4cdcbbd640 1 --2- 172.21.15.45:0/3704136829 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4cb80662b0 0x7f4cb8068760 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:29.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.834+0000 7f4cdcbbd640 1 --2- 172.21.15.45:0/3704136829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd814f240 0x7f4cd8151080 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:29.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.834+0000 7f4cdcbbd640 1 --2- 172.21.15.45:0/3704136829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4cd80c2790 0x7f4cd8150b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:29.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.834+0000 7f4cdcbbd640 1 --2- 172.21.15.45:0/3704136829 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4cd80bb1d0 0x7f4cd80be380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:29.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.834+0000 7f4cdcbbd640 1 -- 172.21.15.45:0/3704136829 >> 172.21.15.45:0/3704136829 conn(0x7f4cd80a64a0 msgr2=0x7f4cd80ba5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:29.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.834+0000 7f4cdcbbd640 1 -- 172.21.15.45:0/3704136829 shutdown_connections 2023-10-03T19:17:29.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:29.834+0000 7f4cdcbbd640 1 -- 172.21.15.45:0/3704136829 wait complete. 2023-10-03T19:17:29.853 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-03T19:17:29.853 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-03T19:17:29.853 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-03T19:17:29.853 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:17:29.854 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-03T19:17:29.854 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-03T19:17:29.854 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-03T19:17:29.854 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:17:29.854 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-03T19:17:29.854 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-03T19:17:29.855 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-03T19:17:29.855 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:17:29.868 INFO:tasks.ceph.mds.b:Stopped 2023-10-03T19:17:29.868 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-03T19:17:29.874 INFO:tasks.ceph.mds.c:Stopped 2023-10-03T19:17:29.874 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-03T19:17:29.881 INFO:tasks.ceph.mds.a:Stopped 2023-10-03T19:17:29.881 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-03T19:17:29.927 INFO:tasks.ceph.mds.b:Started 2023-10-03T19:17:29.928 DEBUG:teuthology.parallel:result is None 2023-10-03T19:17:29.932 INFO:tasks.ceph.mds.c:Started 2023-10-03T19:17:29.932 DEBUG:teuthology.parallel:result is None 2023-10-03T19:17:29.938 INFO:tasks.ceph.mds.a:Started 2023-10-03T19:17:29.939 DEBUG:teuthology.parallel:result is None 2023-10-03T19:17:29.939 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-03T19:17:29.998 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-10-03T19:17:29.998 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-10-03T19:17:30.002 INFO:tasks.ceph.mds.b.smithi079.stdout:starting mds.b at 2023-10-03T19:17:30.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.074+0000 7f2f9eb92640 1 Processor -- start 2023-10-03T19:17:30.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.078+0000 7f2f9eb92640 1 -- start start 2023-10-03T19:17:30.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.078+0000 7f2f9eb92640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2f980be170 0x7f2f9814bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:30.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.078+0000 7f2f9eb92640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f9806d360 con 0x7f2f9814c010 2023-10-03T19:17:30.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.078+0000 7f2f9eb92640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f9806d0c0 con 0x7f2f98070bd0 2023-10-03T19:17:30.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.078+0000 7f2f9eb92640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f9814c450 con 0x7f2f980be170 2023-10-03T19:17:30.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.078+0000 7f2f9d12f640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2f9814c010 0x7f2f98152640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49060/0 (socket says 172.21.15.45:49060) 2023-10-03T19:17:30.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.078+0000 7f2f9d12f640 1 -- 172.21.15.45:0/145959296 learned_addr learned my addr 172.21.15.45:0/145959296 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:30.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.078+0000 7f2f9c92e640 1 --2- 172.21.15.45:0/145959296 >> v2:172.21.15.79:3300/0 conn(0x7f2f980be170 0x7f2f9814bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:30.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.078+0000 7f2f977fe640 1 -- 172.21.15.45:0/145959296 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2495916733 0 0) 0x7f2f9806d360 con 0x7f2f9814c010 2023-10-03T19:17:30.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.078+0000 7f2f977fe640 1 -- 172.21.15.45:0/145959296 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f80003530 con 0x7f2f9814c010 2023-10-03T19:17:30.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.078+0000 7f2f977fe640 1 -- 172.21.15.45:0/145959296 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3799432676 0 0) 0x7f2f80003530 con 0x7f2f9814c010 2023-10-03T19:17:30.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.078+0000 7f2f977fe640 1 -- 172.21.15.45:0/145959296 >> v2:172.21.15.79:3300/0 conn(0x7f2f980be170 msgr2=0x7f2f9814bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:30.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.078+0000 7f2f977fe640 1 --2- 172.21.15.45:0/145959296 >> v2:172.21.15.79:3300/0 conn(0x7f2f980be170 0x7f2f9814bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:30.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.078+0000 7f2f977fe640 1 -- 172.21.15.45:0/145959296 >> v1:172.21.15.79:6789/0 conn(0x7f2f98070bd0 legacy=0x7f2f98151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:30.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.078+0000 7f2f977fe640 1 -- 172.21.15.45:0/145959296 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f980bb000 con 0x7f2f9814c010 2023-10-03T19:17:30.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.078+0000 7f2f977fe640 1 -- 172.21.15.45:0/145959296 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f2f88001680 con 0x7f2f9814c010 2023-10-03T19:17:30.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.078+0000 7f2f977fe640 1 -- 172.21.15.45:0/145959296 >> v1:172.21.15.45:6789/0 conn(0x7f2f9814c010 legacy=0x7f2f98152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:30.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.078+0000 7f2f977fe640 1 --2- 172.21.15.45:0/145959296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f80003980 0x7f2f80003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:30.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.078+0000 7f2f977fe640 1 --2- 172.21.15.45:0/145959296 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2f800047d0 0x7f2f80004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:30.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.078+0000 7f2f977fe640 1 --2- 172.21.15.45:0/145959296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f800052a0 0x7f2f8000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:30.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.078+0000 7f2f977fe640 1 -- 172.21.15.45:0/145959296 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9814c450 con 0x7f2f800052a0 2023-10-03T19:17:30.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.078+0000 7f2f977fe640 1 -- 172.21.15.45:0/145959296 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8000c1d0 con 0x7f2f80003980 2023-10-03T19:17:30.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.078+0000 7f2f977fe640 1 -- 172.21.15.45:0/145959296 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8000c390 con 0x7f2f800047d0 2023-10-03T19:17:30.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.078+0000 7f2f9d12f640 1 --2- 172.21.15.45:0/145959296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f800052a0 0x7f2f8000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:30.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.078+0000 7f2f9d12f640 1 -- 172.21.15.45:0/145959296 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2f800047d0 msgr2=0x7f2f80004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:30.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.078+0000 7f2f9d12f640 1 --2- 172.21.15.45:0/145959296 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2f800047d0 0x7f2f80004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:30.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.078+0000 7f2f9d12f640 1 -- 172.21.15.45:0/145959296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f80003980 msgr2=0x7f2f80003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:30.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.078+0000 7f2f9d12f640 1 --2- 172.21.15.45:0/145959296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f80003980 0x7f2f80003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:30.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.078+0000 7f2f9d12f640 1 -- 172.21.15.45:0/145959296 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f80003530 con 0x7f2f800052a0 2023-10-03T19:17:30.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.078+0000 7f2f9d12f640 1 -- 172.21.15.45:0/145959296 reap_dead start 2023-10-03T19:17:30.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f9d12f640 1 --2- 172.21.15.45:0/145959296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f800052a0 0x7f2f8000b990 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800c1c0 tx=0x7f2f8801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3165a6304b6d917d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:30.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f977fe640 1 -- 172.21.15.45:0/145959296 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88005ae0 con 0x7f2f800052a0 2023-10-03T19:17:30.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f977fe640 1 -- 172.21.15.45:0/145959296 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f88005c60 con 0x7f2f800052a0 2023-10-03T19:17:30.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f977fe640 1 -- 172.21.15.45:0/145959296 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f880a57b0 con 0x7f2f800052a0 2023-10-03T19:17:30.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f9eb92640 1 -- 172.21.15.45:0/145959296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f800052a0 msgr2=0x7f2f8000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:30.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f9eb92640 1 --2- 172.21.15.45:0/145959296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f800052a0 0x7f2f8000b990 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800c1c0 tx=0x7f2f8801cc20 comp rx=0 tx=0).stop 2023-10-03T19:17:30.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f9eb92640 1 -- 172.21.15.45:0/145959296 shutdown_connections 2023-10-03T19:17:30.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f9eb92640 1 --2- 172.21.15.45:0/145959296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f800052a0 0x7f2f8000b990 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:30.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f9eb92640 1 -- 172.21.15.45:0/145959296 >> 172.21.15.45:0/145959296 conn(0x7f2f980c1a10 msgr2=0x7f2f980bd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:30.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f9eb92640 1 -- 172.21.15.45:0/145959296 shutdown_connections 2023-10-03T19:17:30.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f9eb92640 1 -- 172.21.15.45:0/145959296 wait complete. 2023-10-03T19:17:30.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f9eb92640 1 Processor -- start 2023-10-03T19:17:30.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f9eb92640 1 -- start start 2023-10-03T19:17:30.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f9eb92640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2f800052a0 0x7f2f9813c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:30.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f9eb92640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f9813c6f0 0x7f2f98149c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:30.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f9eb92640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f9814a1c0 0x7f2f9814a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:30.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f9eb92640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f980c0a90 con 0x7f2f9814a1c0 2023-10-03T19:17:30.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f9eb92640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f981370c0 con 0x7f2f9813c6f0 2023-10-03T19:17:30.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f9eb92640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9813a230 con 0x7f2f800052a0 2023-10-03T19:17:30.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f9d12f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f9814a1c0 0x7f2f9814a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:30.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f9d12f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f9814a1c0 0x7f2f9814a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59722/0 (socket says 172.21.15.45:59722) 2023-10-03T19:17:30.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f9d12f640 1 -- 172.21.15.45:0/698763277 learned_addr learned my addr 172.21.15.45:0/698763277 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:30.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f97fff640 1 --2- 172.21.15.45:0/698763277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f9813c6f0 0x7f2f98149c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:30.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f9c92e640 1 --2- 172.21.15.45:0/698763277 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2f800052a0 0x7f2f9813c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:30.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f9d12f640 1 -- 172.21.15.45:0/698763277 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2f800052a0 msgr2=0x7f2f9813c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:30.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f9d12f640 1 --2- 172.21.15.45:0/698763277 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2f800052a0 0x7f2f9813c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:30.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f9d12f640 1 -- 172.21.15.45:0/698763277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f9813c6f0 msgr2=0x7f2f98149c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:30.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f9d12f640 1 --2- 172.21.15.45:0/698763277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f9813c6f0 0x7f2f98149c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:30.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f9d12f640 1 -- 172.21.15.45:0/698763277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f980be6d0 con 0x7f2f9814a1c0 2023-10-03T19:17:30.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f97fff640 1 --2- 172.21.15.45:0/698763277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f9813c6f0 0x7f2f98149c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:30.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f9d12f640 1 --2- 172.21.15.45:0/698763277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f9814a1c0 0x7f2f9814a9b0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f2f8801ca50 tx=0x7f2f80005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:30.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f957fa640 1 -- 172.21.15.45:0/698763277 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88000ee0 con 0x7f2f9814a1c0 2023-10-03T19:17:30.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f957fa640 1 -- 172.21.15.45:0/698763277 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f88001440 con 0x7f2f9814a1c0 2023-10-03T19:17:30.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f9eb92640 1 -- 172.21.15.45:0/698763277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f980be540 con 0x7f2f9814a1c0 2023-10-03T19:17:30.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f957fa640 1 -- 172.21.15.45:0/698763277 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f880a57b0 con 0x7f2f9814a1c0 2023-10-03T19:17:30.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.082+0000 7f2f9eb92640 1 -- 172.21.15.45:0/698763277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f98071280 con 0x7f2f9814a1c0 2023-10-03T19:17:30.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.086+0000 7f2f9eb92640 1 -- 172.21.15.45:0/698763277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f9806cf30 con 0x7f2f9814a1c0 2023-10-03T19:17:30.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.086+0000 7f2f957fa640 1 -- 172.21.15.45:0/698763277 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2f880a5930 con 0x7f2f9814a1c0 2023-10-03T19:17:30.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.086+0000 7f2f957fa640 1 --2- 172.21.15.45:0/698763277 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2f84066280 0x7f2f84068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:30.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.086+0000 7f2f957fa640 1 -- 172.21.15.45:0/698763277 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f2f8811ce60 con 0x7f2f9814a1c0 2023-10-03T19:17:30.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.086+0000 7f2f9c92e640 1 --2- 172.21.15.45:0/698763277 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2f84066280 0x7f2f84068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:30.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.086+0000 7f2f9c92e640 1 --2- 172.21.15.45:0/698763277 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2f84066280 0x7f2f84068730 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2f90004b40 tx=0x7f2f9000b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:30.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.090+0000 7f2f957fa640 1 -- 172.21.15.45:0/698763277 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2f880ea670 con 0x7f2f9814a1c0 2023-10-03T19:17:30.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:30.254+0000 7f2f9eb92640 1 -- 172.21.15.45:0/698763277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2f9804de80 con 0x7f2f9814a1c0 2023-10-03T19:17:31.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.050+0000 7f2f957fa640 1 -- 172.21.15.45:0/698763277 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v70) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2f88007cf0 con 0x7f2f9814a1c0 2023-10-03T19:17:31.077 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-10-03T19:17:31.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.054+0000 7f2f9eb92640 1 -- 172.21.15.45:0/698763277 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2f84066280 msgr2=0x7f2f84068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:31.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.054+0000 7f2f9eb92640 1 --2- 172.21.15.45:0/698763277 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2f84066280 0x7f2f84068730 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2f90004b40 tx=0x7f2f9000b040 comp rx=0 tx=0).stop 2023-10-03T19:17:31.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.054+0000 7f2f9eb92640 1 -- 172.21.15.45:0/698763277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f9814a1c0 msgr2=0x7f2f9814a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:31.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.054+0000 7f2f9eb92640 1 --2- 172.21.15.45:0/698763277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f9814a1c0 0x7f2f9814a9b0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f2f8801ca50 tx=0x7f2f80005800 comp rx=0 tx=0).stop 2023-10-03T19:17:31.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.054+0000 7f2f9eb92640 1 -- 172.21.15.45:0/698763277 shutdown_connections 2023-10-03T19:17:31.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.054+0000 7f2f9eb92640 1 --2- 172.21.15.45:0/698763277 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2f84066280 0x7f2f84068730 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:31.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.054+0000 7f2f9eb92640 1 --2- 172.21.15.45:0/698763277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f9814a1c0 0x7f2f9814a9b0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:31.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.054+0000 7f2f9eb92640 1 --2- 172.21.15.45:0/698763277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f9813c6f0 0x7f2f98149c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:31.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.054+0000 7f2f9eb92640 1 --2- 172.21.15.45:0/698763277 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2f800052a0 0x7f2f9813c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:31.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.054+0000 7f2f9eb92640 1 -- 172.21.15.45:0/698763277 >> 172.21.15.45:0/698763277 conn(0x7f2f980c1a10 msgr2=0x7f2f98151f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:31.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.054+0000 7f2f9eb92640 1 -- 172.21.15.45:0/698763277 shutdown_connections 2023-10-03T19:17:31.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.054+0000 7f2f9eb92640 1 -- 172.21.15.45:0/698763277 wait complete. 2023-10-03T19:17:31.080 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-03T19:17:31.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.206+0000 7f8682369640 1 Processor -- start 2023-10-03T19:17:31.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.210+0000 7f8682369640 1 -- start start 2023-10-03T19:17:31.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.210+0000 7f8682369640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f867c0b98f0 0x7f867c0b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:31.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.210+0000 7f8682369640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f867c0a2e20 0x7f867c06c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:31.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.210+0000 7f8682369640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f867c0ba550 con 0x7f867c0bc810 2023-10-03T19:17:31.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.210+0000 7f8682369640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867c1526d0 con 0x7f867c0a2e20 2023-10-03T19:17:31.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.210+0000 7f8682369640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867c1529b0 con 0x7f867c0b98f0 2023-10-03T19:17:31.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.210+0000 7f8680906640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f867c0a2e20 0x7f867c06c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:31.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.210+0000 7f8680906640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f867c0a2e20 0x7f867c06c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59732/0 (socket says 172.21.15.45:59732) 2023-10-03T19:17:31.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.210+0000 7f8680906640 1 -- 172.21.15.45:0/3136902321 learned_addr learned my addr 172.21.15.45:0/3136902321 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:31.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.210+0000 7f867bfff640 1 --2- 172.21.15.45:0/3136902321 >> v2:172.21.15.79:3300/0 conn(0x7f867c0b98f0 0x7f867c0b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:31.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.210+0000 7f8680906640 1 -- 172.21.15.45:0/3136902321 >> v2:172.21.15.79:3300/0 conn(0x7f867c0b98f0 msgr2=0x7f867c0b9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:31.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.210+0000 7f8680906640 1 --2- 172.21.15.45:0/3136902321 >> v2:172.21.15.79:3300/0 conn(0x7f867c0b98f0 0x7f867c0b9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:31.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.210+0000 7f8680906640 1 -- 172.21.15.45:0/3136902321 >> v1:172.21.15.79:6789/0 conn(0x7f867c0bc810 legacy=0x7f867c06c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:31.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.210+0000 7f8680906640 1 -- 172.21.15.45:0/3136902321 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c06cee0 con 0x7f867c0a2e20 2023-10-03T19:17:31.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.210+0000 7f8680906640 1 --2- 172.21.15.45:0/3136902321 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f867c0a2e20 0x7f867c06c9a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f867c0bad20 tx=0x7f867401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a4c136f67f0ff8a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:31.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.210+0000 7f867affd640 1 -- 172.21.15.45:0/3136902321 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86740af400 con 0x7f867c0a2e20 2023-10-03T19:17:31.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.210+0000 7f867affd640 1 -- 172.21.15.45:0/3136902321 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86740ab050 con 0x7f867c0a2e20 2023-10-03T19:17:31.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.210+0000 7f867affd640 1 -- 172.21.15.45:0/3136902321 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86740af780 con 0x7f867c0a2e20 2023-10-03T19:17:31.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f8682369640 1 -- 172.21.15.45:0/3136902321 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f867c0a2e20 msgr2=0x7f867c06c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:31.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f8682369640 1 --2- 172.21.15.45:0/3136902321 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f867c0a2e20 0x7f867c06c9a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f867c0bad20 tx=0x7f867401f1c0 comp rx=0 tx=0).stop 2023-10-03T19:17:31.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f8682369640 1 -- 172.21.15.45:0/3136902321 shutdown_connections 2023-10-03T19:17:31.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f8682369640 1 --2- 172.21.15.45:0/3136902321 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f867c0a2e20 0x7f867c06c9a0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:31.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f8682369640 1 --2- 172.21.15.45:0/3136902321 >> v2:172.21.15.79:3300/0 conn(0x7f867c0b98f0 0x7f867c0b9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:31.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f8682369640 1 -- 172.21.15.45:0/3136902321 >> 172.21.15.45:0/3136902321 conn(0x7f867c0bcf50 msgr2=0x7f867c0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:31.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f8682369640 1 -- 172.21.15.45:0/3136902321 shutdown_connections 2023-10-03T19:17:31.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f8682369640 1 -- 172.21.15.45:0/3136902321 wait complete. 2023-10-03T19:17:31.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f8682369640 1 Processor -- start 2023-10-03T19:17:31.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f8682369640 1 -- start start 2023-10-03T19:17:31.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f8682369640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f867c0a2e20 0x7f867c0bf380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:31.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f8682369640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f867c0b98f0 0x7f867c143de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:31.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f8682369640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f867c0bc810 0x7f867c13a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:31.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f8682369640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c13bc60 con 0x7f867c0bc810 2023-10-03T19:17:31.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f8682369640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c141dd0 con 0x7f867c0a2e20 2023-10-03T19:17:31.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f8682369640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867c141940 con 0x7f867c0b98f0 2023-10-03T19:17:31.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f8680906640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f867c0bc810 0x7f867c13a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:31.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f8680906640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f867c0bc810 0x7f867c13a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59736/0 (socket says 172.21.15.45:59736) 2023-10-03T19:17:31.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f8680906640 1 -- 172.21.15.45:0/1855141096 learned_addr learned my addr 172.21.15.45:0/1855141096 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:31.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f867bfff640 1 --2- 172.21.15.45:0/1855141096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f867c0a2e20 0x7f867c0bf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:31.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f867b7fe640 1 --2- 172.21.15.45:0/1855141096 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f867c0b98f0 0x7f867c143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:31.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f8680906640 1 -- 172.21.15.45:0/1855141096 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f867c0b98f0 msgr2=0x7f867c143de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:31.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f8680906640 1 --2- 172.21.15.45:0/1855141096 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f867c0b98f0 0x7f867c143de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:31.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f8680906640 1 -- 172.21.15.45:0/1855141096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f867c0a2e20 msgr2=0x7f867c0bf380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:31.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f8680906640 1 --2- 172.21.15.45:0/1855141096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f867c0a2e20 0x7f867c0bf380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:31.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f8680906640 1 -- 172.21.15.45:0/1855141096 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8674009b30 con 0x7f867c0bc810 2023-10-03T19:17:31.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f867b7fe640 1 --2- 172.21.15.45:0/1855141096 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f867c0b98f0 0x7f867c143de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:31.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f8680906640 1 --2- 172.21.15.45:0/1855141096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f867c0bc810 0x7f867c13a720 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f867401cdf0 tx=0x7f867401bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:31.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f8678ff9640 1 -- 172.21.15.45:0/1855141096 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86740afd60 con 0x7f867c0bc810 2023-10-03T19:17:31.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f8678ff9640 1 -- 172.21.15.45:0/1855141096 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8674009510 con 0x7f867c0bc810 2023-10-03T19:17:31.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f8682369640 1 -- 172.21.15.45:0/1855141096 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867c0ba950 con 0x7f867c0bc810 2023-10-03T19:17:31.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f8678ff9640 1 -- 172.21.15.45:0/1855141096 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86740ba680 con 0x7f867c0bc810 2023-10-03T19:17:31.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.214+0000 7f8682369640 1 -- 172.21.15.45:0/1855141096 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867c0ba200 con 0x7f867c0bc810 2023-10-03T19:17:31.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.218+0000 7f8682369640 1 -- 172.21.15.45:0/1855141096 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867c0baae0 con 0x7f867c0bc810 2023-10-03T19:17:31.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.218+0000 7f8678ff9640 1 -- 172.21.15.45:0/1855141096 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f86740b6040 con 0x7f867c0bc810 2023-10-03T19:17:31.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.218+0000 7f8678ff9640 1 --2- 172.21.15.45:0/1855141096 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8668066280 0x7f8668068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:31.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.218+0000 7f8678ff9640 1 -- 172.21.15.45:0/1855141096 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8674121bd0 con 0x7f867c0bc810 2023-10-03T19:17:31.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.218+0000 7f867bfff640 1 --2- 172.21.15.45:0/1855141096 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8668066280 0x7f8668068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:31.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.218+0000 7f867bfff640 1 --2- 172.21.15.45:0/1855141096 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8668066280 0x7f8668068730 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f867000b9d0 tx=0x7f8670008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:31.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.222+0000 7f8678ff9640 1 -- 172.21.15.45:0/1855141096 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f86740ef420 con 0x7f867c0bc810 2023-10-03T19:17:31.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.426+0000 7f8682369640 1 -- 172.21.15.45:0/1855141096 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f867c14fec0 con 0x7f867c0bc810 2023-10-03T19:17:31.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.426+0000 7f8678ff9640 1 -- 172.21.15.45:0/1855141096 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+4440 (secure 0 0 0) 0x7f86740f2a40 con 0x7f867c0bc810 2023-10-03T19:17:31.568 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:17:31.568 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-03T19:17:31.568 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-10-03T19:17:31.568 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:17:31.568 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-10-03T19:17:31.568 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlfyzhExAABLhtkQEZuiLwovBSO0kuAA==", 2023-10-03T19:17:31.568 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:17:31.568 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:17:31.569 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-03T19:17:31.569 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-03T19:17:31.569 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:17:31.569 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:17:31.569 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:17:31.569 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:17:31.569 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-10-03T19:17:31.569 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlzM8pIBAAMie9jpxS/xt2cymMpyJmiQ==", 2023-10-03T19:17:31.569 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:17:31.569 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:17:31.569 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-03T19:17:31.569 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-03T19:17:31.570 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:17:31.570 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:17:31.570 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:17:31.570 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:17:31.570 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-10-03T19:17:31.570 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlAsGOHBAAIHprnd9orKMQjzkNQZz94A==", 2023-10-03T19:17:31.570 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:17:31.570 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:17:31.570 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-03T19:17:31.570 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-03T19:17:31.570 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:17:31.571 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:17:31.571 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:17:31.571 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:17:31.571 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-10-03T19:17:31.571 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBmZxxlb0zQLRAA3z+f4/jsLTLUmFg/WOD/Xg==", 2023-10-03T19:17:31.571 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:17:31.635 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:17:31.635 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:17:31.635 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:17:31.636 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:17:31.636 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:17:31.636 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:17:31.636 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-10-03T19:17:31.636 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBpZxxlTjtZNRAA3HFqXjGLO7JoX+GBegGfqw==", 2023-10-03T19:17:31.636 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:17:31.636 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:17:31.636 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:17:31.636 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:17:31.636 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:17:31.636 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:17:31.637 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:17:31.637 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-10-03T19:17:31.637 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBtZxxld6kUBBAATcGPrxBbPLswrUHihB7AgQ==", 2023-10-03T19:17:31.637 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:17:31.637 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:17:31.637 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:17:31.637 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:17:31.637 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:17:31.637 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:17:31.637 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:17:31.637 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-10-03T19:17:31.638 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBwZxxlWUL3DBAAk4TW6N5mpjjyP7QgQAIuDw==", 2023-10-03T19:17:31.638 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:17:31.638 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:17:31.638 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:17:31.638 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:17:31.638 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:17:31.638 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:17:31.638 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:17:31.638 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-10-03T19:17:31.638 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQB2ZxxlK3KNIhAAjhvxAU0shg+5PbJfq1LEog==", 2023-10-03T19:17:31.638 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:17:31.638 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:17:31.639 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:17:31.639 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:17:31.639 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:17:31.639 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:17:31.639 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:17:31.639 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-10-03T19:17:31.639 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQB5ZxxlRAxuKhAA5ma3eAt3kkukdhgZN4wwEg==", 2023-10-03T19:17:31.639 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:17:31.639 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:17:31.639 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:17:31.639 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:17:31.640 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:17:31.640 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:17:31.640 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:17:31.640 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-10-03T19:17:31.640 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQB8ZxxlkQqOMxAAuKGy7vJQLUDsqgjPVtWMWg==", 2023-10-03T19:17:31.640 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:17:31.640 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:17:31.640 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:17:31.640 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:17:31.640 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:17:31.640 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:17:31.641 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:17:31.641 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-10-03T19:17:31.641 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCAZxxl65r/ABAAeWtP7nMLVm5NBU4vWQ6ceg==", 2023-10-03T19:17:31.641 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:17:31.641 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:17:31.641 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:17:31.641 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:17:31.641 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:17:31.641 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:17:31.641 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:17:31.641 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-10-03T19:17:31.641 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlg5PgJRAAvvN5Xrw/ZW4rSdJ1/adnzA==", 2023-10-03T19:17:31.642 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:17:31.642 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:17:31.642 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow r", 2023-10-03T19:17:31.642 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-03T19:17:31.642 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:17:31.642 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:17:31.642 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:17:31.642 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-10-03T19:17:31.676 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlKkW+KRAALzVyQ+iTWuD5FMLDKXNVTg==", 2023-10-03T19:17:31.676 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:17:31.676 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:17:31.676 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-10-03T19:17:31.676 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-10-03T19:17:31.676 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-10-03T19:17:31.676 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:17:31.676 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:17:31.676 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:17:31.676 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-10-03T19:17:31.676 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBkZxxldHb4LxAAc/oJcXFjNgH5Wxwv04WHgw==", 2023-10-03T19:17:31.677 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:17:31.677 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-10-03T19:17:31.677 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-03T19:17:31.677 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-03T19:17:31.677 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:17:31.677 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:17:31.677 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:17:31.677 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:17:31.677 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-10-03T19:17:31.677 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxl4txNEBAAonNqY2PmtF0vZGFmvzxIKw==", 2023-10-03T19:17:31.677 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:17:31.677 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-10-03T19:17:31.678 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-10-03T19:17:31.678 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:17:31.678 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:17:31.678 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:17:31.678 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:17:31.678 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-10-03T19:17:31.678 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlUmKhDRAA7UKlGP9q9aKsk+J+nTxrUA==", 2023-10-03T19:17:31.678 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:17:31.678 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-10-03T19:17:31.678 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-10-03T19:17:31.678 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:17:31.678 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:17:31.679 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:17:31.679 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-10-03T19:17:31.679 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-03T19:17:31.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.430+0000 7f8682369640 1 -- 172.21.15.45:0/1855141096 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8668066280 msgr2=0x7f8668068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:31.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.430+0000 7f8682369640 1 --2- 172.21.15.45:0/1855141096 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8668066280 0x7f8668068730 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f867000b9d0 tx=0x7f8670008040 comp rx=0 tx=0).stop 2023-10-03T19:17:31.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.430+0000 7f8682369640 1 -- 172.21.15.45:0/1855141096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f867c0bc810 msgr2=0x7f867c13a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:31.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.430+0000 7f8682369640 1 --2- 172.21.15.45:0/1855141096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f867c0bc810 0x7f867c13a720 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f867401cdf0 tx=0x7f867401bf60 comp rx=0 tx=0).stop 2023-10-03T19:17:31.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.430+0000 7f8682369640 1 -- 172.21.15.45:0/1855141096 shutdown_connections 2023-10-03T19:17:31.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.430+0000 7f8682369640 1 --2- 172.21.15.45:0/1855141096 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8668066280 0x7f8668068730 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:31.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.430+0000 7f8682369640 1 --2- 172.21.15.45:0/1855141096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f867c0bc810 0x7f867c13a720 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:31.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.430+0000 7f8682369640 1 --2- 172.21.15.45:0/1855141096 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f867c0b98f0 0x7f867c143de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:31.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.430+0000 7f8682369640 1 --2- 172.21.15.45:0/1855141096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f867c0a2e20 0x7f867c0bf380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:31.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.430+0000 7f8682369640 1 -- 172.21.15.45:0/1855141096 >> 172.21.15.45:0/1855141096 conn(0x7f867c0bcf50 msgr2=0x7f867c0bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:31.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.430+0000 7f8682369640 1 -- 172.21.15.45:0/1855141096 shutdown_connections 2023-10-03T19:17:31.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.430+0000 7f8682369640 1 -- 172.21.15.45:0/1855141096 wait complete. 2023-10-03T19:17:31.682 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:17:31.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.818+0000 7ff46ced9640 1 Processor -- start 2023-10-03T19:17:31.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.818+0000 7ff46ced9640 1 -- start start 2023-10-03T19:17:31.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.818+0000 7ff46ced9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff4680bcff0 0x7ff46814efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:31.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.818+0000 7ff46ced9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff4680bad00 0x7ff46814b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:31.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.818+0000 7ff46ced9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff46814f510 con 0x7ff46806c3c0 2023-10-03T19:17:31.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.818+0000 7ff46ced9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff468151a90 con 0x7ff4680bcff0 2023-10-03T19:17:31.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.818+0000 7ff46ced9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff46806cf30 con 0x7ff4680bad00 2023-10-03T19:17:31.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.818+0000 7ff46659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff4680bcff0 0x7ff46814efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:31.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.818+0000 7ff466d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff46806c3c0 0x7ff4681521a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49076/0 (socket says 172.21.15.45:49076) 2023-10-03T19:17:31.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.818+0000 7ff466d9d640 1 -- 172.21.15.45:0/659748666 learned_addr learned my addr 172.21.15.45:0/659748666 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:31.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.818+0000 7ff465d9b640 1 --2- 172.21.15.45:0/659748666 >> v2:172.21.15.79:3300/0 conn(0x7ff4680bad00 0x7ff46814b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:31.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.818+0000 7ff46659c640 1 -- 172.21.15.45:0/659748666 >> v2:172.21.15.79:3300/0 conn(0x7ff4680bad00 msgr2=0x7ff46814b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:31.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.818+0000 7ff46659c640 1 --2- 172.21.15.45:0/659748666 >> v2:172.21.15.79:3300/0 conn(0x7ff4680bad00 0x7ff46814b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:31.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.818+0000 7ff46659c640 1 -- 172.21.15.45:0/659748666 >> v1:172.21.15.45:6789/0 conn(0x7ff46806c3c0 legacy=0x7ff4681521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:31.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.818+0000 7ff46659c640 1 -- 172.21.15.45:0/659748666 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46806d210 con 0x7ff4680bcff0 2023-10-03T19:17:31.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.822+0000 7ff46659c640 1 --2- 172.21.15.45:0/659748666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4680bcff0 0x7ff46814efd0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ff4680babd0 tx=0x7ff45801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac581029e1bce81d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:31.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.822+0000 7ff46559a640 1 -- 172.21.15.45:0/659748666 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4580ab680 con 0x7ff4680bcff0 2023-10-03T19:17:31.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.822+0000 7ff46559a640 1 -- 172.21.15.45:0/659748666 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4580ab7e0 con 0x7ff4680bcff0 2023-10-03T19:17:31.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.822+0000 7ff46559a640 1 -- 172.21.15.45:0/659748666 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4580abb70 con 0x7ff4680bcff0 2023-10-03T19:17:31.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.822+0000 7ff46ced9640 1 -- 172.21.15.45:0/659748666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4680bcff0 msgr2=0x7ff46814efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:31.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.822+0000 7ff46ced9640 1 --2- 172.21.15.45:0/659748666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4680bcff0 0x7ff46814efd0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ff4680babd0 tx=0x7ff45801c460 comp rx=0 tx=0).stop 2023-10-03T19:17:31.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.822+0000 7ff46ced9640 1 -- 172.21.15.45:0/659748666 shutdown_connections 2023-10-03T19:17:31.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.822+0000 7ff46ced9640 1 --2- 172.21.15.45:0/659748666 >> v2:172.21.15.79:3300/0 conn(0x7ff4680bad00 0x7ff46814b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:31.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.822+0000 7ff46ced9640 1 --2- 172.21.15.45:0/659748666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4680bcff0 0x7ff46814efd0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:31.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.822+0000 7ff46ced9640 1 -- 172.21.15.45:0/659748666 >> 172.21.15.45:0/659748666 conn(0x7ff468065a90 msgr2=0x7ff468069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:31.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.822+0000 7ff46ced9640 1 -- 172.21.15.45:0/659748666 shutdown_connections 2023-10-03T19:17:31.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.822+0000 7ff46ced9640 1 -- 172.21.15.45:0/659748666 wait complete. 2023-10-03T19:17:31.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.822+0000 7ff46ced9640 1 Processor -- start 2023-10-03T19:17:31.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.822+0000 7ff46ced9640 1 -- start start 2023-10-03T19:17:31.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.826+0000 7ff46ced9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff46806c3c0 0x7ff46814f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:31.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.826+0000 7ff46ced9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4680bad00 0x7ff468143f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:31.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.826+0000 7ff46ced9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff4680bcff0 0x7ff46813a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:31.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.826+0000 7ff46ced9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46813d460 con 0x7ff4680bad00 2023-10-03T19:17:31.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.826+0000 7ff46ced9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff468150e50 con 0x7ff46806c3c0 2023-10-03T19:17:31.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.826+0000 7ff46ced9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff468151340 con 0x7ff4680bcff0 2023-10-03T19:17:31.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.826+0000 7ff465d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4680bad00 0x7ff468143f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:31.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.826+0000 7ff465d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4680bad00 0x7ff468143f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59744/0 (socket says 172.21.15.45:59744) 2023-10-03T19:17:31.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.826+0000 7ff465d9b640 1 -- 172.21.15.45:0/1781257627 learned_addr learned my addr 172.21.15.45:0/1781257627 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:31.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.826+0000 7ff46659c640 1 --2- 172.21.15.45:0/1781257627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff46806c3c0 0x7ff46814f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:31.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.826+0000 7ff466d9d640 1 --2- 172.21.15.45:0/1781257627 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff4680bcff0 0x7ff46813a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:31.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.826+0000 7ff465d9b640 1 -- 172.21.15.45:0/1781257627 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff4680bcff0 msgr2=0x7ff46813a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:31.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.826+0000 7ff465d9b640 1 --2- 172.21.15.45:0/1781257627 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff4680bcff0 0x7ff46813a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:31.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.826+0000 7ff465d9b640 1 -- 172.21.15.45:0/1781257627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff46806c3c0 msgr2=0x7ff46814f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:31.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.826+0000 7ff465d9b640 1 --2- 172.21.15.45:0/1781257627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff46806c3c0 0x7ff46814f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:31.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.826+0000 7ff465d9b640 1 -- 172.21.15.45:0/1781257627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff458009420 con 0x7ff4680bad00 2023-10-03T19:17:31.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.826+0000 7ff466d9d640 1 --2- 172.21.15.45:0/1781257627 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff4680bcff0 0x7ff46813a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:31.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.826+0000 7ff46659c640 1 --2- 172.21.15.45:0/1781257627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff46806c3c0 0x7ff46814f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:17:31.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.826+0000 7ff465d9b640 1 --2- 172.21.15.45:0/1781257627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4680bad00 0x7ff468143f50 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7ff45c00e930 tx=0x7ff45c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:31.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.826+0000 7ff456ffd640 1 -- 172.21.15.45:0/1781257627 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c009690 con 0x7ff4680bad00 2023-10-03T19:17:31.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.826+0000 7ff456ffd640 1 -- 172.21.15.45:0/1781257627 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45c00c9a0 con 0x7ff4680bad00 2023-10-03T19:17:31.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.826+0000 7ff46ced9640 1 -- 172.21.15.45:0/1781257627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff468152a40 con 0x7ff4680bad00 2023-10-03T19:17:31.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.826+0000 7ff456ffd640 1 -- 172.21.15.45:0/1781257627 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c00cd10 con 0x7ff4680bad00 2023-10-03T19:17:31.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.826+0000 7ff46ced9640 1 -- 172.21.15.45:0/1781257627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4681528b0 con 0x7ff4680bad00 2023-10-03T19:17:31.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.826+0000 7ff46ced9640 1 -- 172.21.15.45:0/1781257627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff46815b690 con 0x7ff4680bad00 2023-10-03T19:17:31.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.826+0000 7ff456ffd640 1 -- 172.21.15.45:0/1781257627 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff45c013470 con 0x7ff4680bad00 2023-10-03T19:17:31.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.826+0000 7ff456ffd640 1 --2- 172.21.15.45:0/1781257627 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff448066280 0x7ff448068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:31.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.826+0000 7ff456ffd640 1 -- 172.21.15.45:0/1781257627 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff45c083ba0 con 0x7ff4680bad00 2023-10-03T19:17:31.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.826+0000 7ff46659c640 1 --2- 172.21.15.45:0/1781257627 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff448066280 0x7ff448068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:31.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.830+0000 7ff46659c640 1 --2- 172.21.15.45:0/1781257627 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff448066280 0x7ff448068730 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff4580af000 tx=0x7ff4580a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:31.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.830+0000 7ff456ffd640 1 -- 172.21.15.45:0/1781257627 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff45c051430 con 0x7ff4680bad00 2023-10-03T19:17:31.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.990+0000 7ff46ced9640 1 -- 172.21.15.45:0/1781257627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff468144490 con 0x7ff4680bad00 2023-10-03T19:17:31.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.994+0000 7ff456ffd640 1 -- 172.21.15.45:0/1781257627 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+14592 (secure 0 0 0) 0x7ff45c017090 con 0x7ff4680bad00 2023-10-03T19:17:31.995 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:17:31.995 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":70,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:17:31.036541+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:17:31.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.994+0000 7ff46ced9640 1 -- 172.21.15.45:0/1781257627 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff448066280 msgr2=0x7ff448068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:31.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.994+0000 7ff46ced9640 1 --2- 172.21.15.45:0/1781257627 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff448066280 0x7ff448068730 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff4580af000 tx=0x7ff4580a7000 comp rx=0 tx=0).stop 2023-10-03T19:17:31.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.994+0000 7ff46ced9640 1 -- 172.21.15.45:0/1781257627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4680bad00 msgr2=0x7ff468143f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:31.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.994+0000 7ff46ced9640 1 --2- 172.21.15.45:0/1781257627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4680bad00 0x7ff468143f50 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7ff45c00e930 tx=0x7ff45c00edf0 comp rx=0 tx=0).stop 2023-10-03T19:17:31.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.994+0000 7ff46ced9640 1 -- 172.21.15.45:0/1781257627 shutdown_connections 2023-10-03T19:17:31.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.994+0000 7ff46ced9640 1 --2- 172.21.15.45:0/1781257627 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff448066280 0x7ff448068730 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:31.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.994+0000 7ff46ced9640 1 --2- 172.21.15.45:0/1781257627 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff4680bcff0 0x7ff46813a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:31.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.994+0000 7ff46ced9640 1 --2- 172.21.15.45:0/1781257627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4680bad00 0x7ff468143f50 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:31.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.994+0000 7ff46ced9640 1 --2- 172.21.15.45:0/1781257627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff46806c3c0 0x7ff46814f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:31.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.994+0000 7ff46ced9640 1 -- 172.21.15.45:0/1781257627 >> 172.21.15.45:0/1781257627 conn(0x7ff468065a90 msgr2=0x7ff46814cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:31.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.994+0000 7ff46ced9640 1 -- 172.21.15.45:0/1781257627 shutdown_connections 2023-10-03T19:17:31.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:31.994+0000 7ff46ced9640 1 -- 172.21.15.45:0/1781257627 wait complete. 2023-10-03T19:17:32.015 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:17:32.025 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:17:32.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.150+0000 7f2998b86640 1 Processor -- start 2023-10-03T19:17:32.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.150+0000 7f2998b86640 1 -- start start 2023-10-03T19:17:32.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f2998b86640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f299414f510 0x7f299414b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:32.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f2998b86640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f299414f080 con 0x7f29940bd9f0 2023-10-03T19:17:32.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f2998b86640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2994070e90 con 0x7f299406f880 2023-10-03T19:17:32.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f2998b86640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f299406f3e0 con 0x7f299414f510 2023-10-03T19:17:32.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f2992d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f29940bd9f0 0x7f2994155bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49082/0 (socket says 172.21.15.45:49082) 2023-10-03T19:17:32.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f2992d9d640 1 -- 172.21.15.45:0/275768710 learned_addr learned my addr 172.21.15.45:0/275768710 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:32.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f2991d9b640 1 --2- 172.21.15.45:0/275768710 >> v2:172.21.15.79:3300/0 conn(0x7f299414f510 0x7f299414b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:32.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f299159a640 1 -- 172.21.15.45:0/275768710 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 884470170 0 0) 0x7f299414f080 con 0x7f29940bd9f0 2023-10-03T19:17:32.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f299159a640 1 -- 172.21.15.45:0/275768710 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2980003530 con 0x7f29940bd9f0 2023-10-03T19:17:32.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f299159a640 1 -- 172.21.15.45:0/275768710 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1789941900 0 0) 0x7f2980003530 con 0x7f29940bd9f0 2023-10-03T19:17:32.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f299159a640 1 -- 172.21.15.45:0/275768710 >> v2:172.21.15.79:3300/0 conn(0x7f299414f510 msgr2=0x7f299414b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:32.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f299159a640 1 --2- 172.21.15.45:0/275768710 >> v2:172.21.15.79:3300/0 conn(0x7f299414f510 0x7f299414b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:32.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f299159a640 1 -- 172.21.15.45:0/275768710 >> v1:172.21.15.79:6789/0 conn(0x7f299406f880 legacy=0x7f29940a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:32.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f299159a640 1 -- 172.21.15.45:0/275768710 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299414ea30 con 0x7f29940bd9f0 2023-10-03T19:17:32.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f299159a640 1 -- 172.21.15.45:0/275768710 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f298c001680 con 0x7f29940bd9f0 2023-10-03T19:17:32.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f2991d9b640 1 --2- 172.21.15.45:0/275768710 >> v2:172.21.15.79:3300/0 conn(0x7f299414f510 0x7f299414b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:17:32.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f299159a640 1 -- 172.21.15.45:0/275768710 >> v1:172.21.15.45:6789/0 conn(0x7f29940bd9f0 legacy=0x7f2994155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:32.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f299159a640 1 --2- 172.21.15.45:0/275768710 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2980003980 0x7f2980003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:32.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f299159a640 1 --2- 172.21.15.45:0/275768710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29800047d0 0x7f2980004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:32.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f299159a640 1 --2- 172.21.15.45:0/275768710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2980005180 0x7f298000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:32.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f299159a640 1 -- 172.21.15.45:0/275768710 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299406f3e0 con 0x7f2980005180 2023-10-03T19:17:32.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f299159a640 1 -- 172.21.15.45:0/275768710 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298000c000 con 0x7f29800047d0 2023-10-03T19:17:32.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f299159a640 1 -- 172.21.15.45:0/275768710 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298000c1c0 con 0x7f2980003980 2023-10-03T19:17:32.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f2992d9d640 1 --2- 172.21.15.45:0/275768710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2980005180 0x7f298000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:32.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f2991d9b640 1 --2- 172.21.15.45:0/275768710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29800047d0 0x7f2980004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:32.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f299259c640 1 --2- 172.21.15.45:0/275768710 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2980003980 0x7f2980003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:32.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f2992d9d640 1 -- 172.21.15.45:0/275768710 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2980003980 msgr2=0x7f2980003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:32.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f2992d9d640 1 --2- 172.21.15.45:0/275768710 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2980003980 0x7f2980003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:32.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f2992d9d640 1 -- 172.21.15.45:0/275768710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29800047d0 msgr2=0x7f2980004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:32.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f2992d9d640 1 --2- 172.21.15.45:0/275768710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29800047d0 0x7f2980004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:32.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.154+0000 7f2992d9d640 1 -- 172.21.15.45:0/275768710 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2980003530 con 0x7f2980005180 2023-10-03T19:17:32.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f2992d9d640 1 -- 172.21.15.45:0/275768710 reap_dead start 2023-10-03T19:17:32.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f2992d9d640 1 --2- 172.21.15.45:0/275768710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2980005180 0x7f298000b990 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f298c00c240 tx=0x7f298c01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a533ebdf552d50 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:32.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f299159a640 1 -- 172.21.15.45:0/275768710 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c0a5b40 con 0x7f2980005180 2023-10-03T19:17:32.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f299159a640 1 -- 172.21.15.45:0/275768710 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c0a5ce0 con 0x7f2980005180 2023-10-03T19:17:32.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f299159a640 1 -- 172.21.15.45:0/275768710 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c005b20 con 0x7f2980005180 2023-10-03T19:17:32.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f2998b86640 1 -- 172.21.15.45:0/275768710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2980005180 msgr2=0x7f298000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:32.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f2998b86640 1 --2- 172.21.15.45:0/275768710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2980005180 0x7f298000b990 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f298c00c240 tx=0x7f298c01cc40 comp rx=0 tx=0).stop 2023-10-03T19:17:32.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f2998b86640 1 -- 172.21.15.45:0/275768710 shutdown_connections 2023-10-03T19:17:32.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f2998b86640 1 --2- 172.21.15.45:0/275768710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2980005180 0x7f298000b990 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:32.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f2998b86640 1 -- 172.21.15.45:0/275768710 >> 172.21.15.45:0/275768710 conn(0x7f29940a20d0 msgr2=0x7f29940a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:32.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f2998b86640 1 -- 172.21.15.45:0/275768710 shutdown_connections 2023-10-03T19:17:32.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f2998b86640 1 -- 172.21.15.45:0/275768710 wait complete. 2023-10-03T19:17:32.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f2998b86640 1 Processor -- start 2023-10-03T19:17:32.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f2998b86640 1 -- start start 2023-10-03T19:17:32.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f2998b86640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2980005180 0x7f29941477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:32.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f2998b86640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29941409d0 0x7f299413f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:32.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f2998b86640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29940bf900 0x7f299413feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:32.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f2998b86640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29941403f0 con 0x7f29940bf900 2023-10-03T19:17:32.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f2998b86640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29941d8cb0 con 0x7f29941409d0 2023-10-03T19:17:32.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f2998b86640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29940bf530 con 0x7f2980005180 2023-10-03T19:17:32.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f2992d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29940bf900 0x7f299413feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:32.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f2992d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29940bf900 0x7f299413feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59770/0 (socket says 172.21.15.45:59770) 2023-10-03T19:17:32.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f2992d9d640 1 -- 172.21.15.45:0/365954376 learned_addr learned my addr 172.21.15.45:0/365954376 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:32.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f2991d9b640 1 --2- 172.21.15.45:0/365954376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29941409d0 0x7f299413f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:32.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f299259c640 1 --2- 172.21.15.45:0/365954376 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2980005180 0x7f29941477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:32.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f2992d9d640 1 -- 172.21.15.45:0/365954376 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2980005180 msgr2=0x7f29941477f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:32.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f2992d9d640 1 --2- 172.21.15.45:0/365954376 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2980005180 0x7f29941477f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:32.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f2992d9d640 1 -- 172.21.15.45:0/365954376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29941409d0 msgr2=0x7f299413f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:32.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f2992d9d640 1 --2- 172.21.15.45:0/365954376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29941409d0 0x7f299413f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:32.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f2992d9d640 1 -- 172.21.15.45:0/365954376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299406f070 con 0x7f29940bf900 2023-10-03T19:17:32.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f2992d9d640 1 --2- 172.21.15.45:0/365954376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29940bf900 0x7f299413feb0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f298c01d4e0 tx=0x7f2980005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:32.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f298affd640 1 -- 172.21.15.45:0/365954376 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c001680 con 0x7f29940bf900 2023-10-03T19:17:32.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f298affd640 1 -- 172.21.15.45:0/365954376 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c000ee0 con 0x7f29940bf900 2023-10-03T19:17:32.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.158+0000 7f2998b86640 1 -- 172.21.15.45:0/365954376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299414ed10 con 0x7f29940bf900 2023-10-03T19:17:32.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.162+0000 7f298affd640 1 -- 172.21.15.45:0/365954376 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c0072c0 con 0x7f29940bf900 2023-10-03T19:17:32.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.162+0000 7f2998b86640 1 -- 172.21.15.45:0/365954376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299406fc50 con 0x7f29940bf900 2023-10-03T19:17:32.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.162+0000 7f2998b86640 1 -- 172.21.15.45:0/365954376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299404de80 con 0x7f29940bf900 2023-10-03T19:17:32.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.162+0000 7f298affd640 1 -- 172.21.15.45:0/365954376 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f298c007420 con 0x7f29940bf900 2023-10-03T19:17:32.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.162+0000 7f298affd640 1 --2- 172.21.15.45:0/365954376 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f29740662b0 0x7f2974068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:32.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.162+0000 7f298affd640 1 -- 172.21.15.45:0/365954376 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f298c11d600 con 0x7f29940bf900 2023-10-03T19:17:32.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.162+0000 7f299259c640 1 --2- 172.21.15.45:0/365954376 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f29740662b0 0x7f2974068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:32.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.162+0000 7f299259c640 1 --2- 172.21.15.45:0/365954376 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f29740662b0 0x7f2974068760 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2984000f90 tx=0x7f2984009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:32.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.166+0000 7f298affd640 1 -- 172.21.15.45:0/365954376 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f298c0ead40 con 0x7f29940bf900 2023-10-03T19:17:32.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.318+0000 7f2998b86640 1 -- 172.21.15.45:0/365954376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f299404de80 con 0x7f29940bf900 2023-10-03T19:17:32.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.318+0000 7f298affd640 1 -- 172.21.15.45:0/365954376 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) v1 ==== 93+0+10 (secure 0 0 0) 0x7f298c0076d0 con 0x7f29940bf900 2023-10-03T19:17:32.332 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:17:32.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.322+0000 7f2998b86640 1 -- 172.21.15.45:0/365954376 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f29740662b0 msgr2=0x7f2974068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:32.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.322+0000 7f2998b86640 1 --2- 172.21.15.45:0/365954376 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f29740662b0 0x7f2974068760 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2984000f90 tx=0x7f2984009040 comp rx=0 tx=0).stop 2023-10-03T19:17:32.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.322+0000 7f2998b86640 1 -- 172.21.15.45:0/365954376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29940bf900 msgr2=0x7f299413feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:32.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.322+0000 7f2998b86640 1 --2- 172.21.15.45:0/365954376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29940bf900 0x7f299413feb0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f298c01d4e0 tx=0x7f2980005800 comp rx=0 tx=0).stop 2023-10-03T19:17:32.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.322+0000 7f2998b86640 1 -- 172.21.15.45:0/365954376 shutdown_connections 2023-10-03T19:17:32.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.322+0000 7f2998b86640 1 --2- 172.21.15.45:0/365954376 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f29740662b0 0x7f2974068760 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:32.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.322+0000 7f2998b86640 1 --2- 172.21.15.45:0/365954376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29940bf900 0x7f299413feb0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:32.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.322+0000 7f2998b86640 1 --2- 172.21.15.45:0/365954376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29941409d0 0x7f299413f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:32.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.322+0000 7f2998b86640 1 --2- 172.21.15.45:0/365954376 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2980005180 0x7f29941477f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:32.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.322+0000 7f2998b86640 1 -- 172.21.15.45:0/365954376 >> 172.21.15.45:0/365954376 conn(0x7f29940a20d0 msgr2=0x7f29940a24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:32.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.322+0000 7f2998b86640 1 -- 172.21.15.45:0/365954376 shutdown_connections 2023-10-03T19:17:32.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.322+0000 7f2998b86640 1 -- 172.21.15.45:0/365954376 wait complete. 2023-10-03T19:17:32.340 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:17:32.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.470+0000 7f49ca3b8640 1 Processor -- start 2023-10-03T19:17:32.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.470+0000 7f49ca3b8640 1 -- start start 2023-10-03T19:17:32.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49ca3b8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f49c414f510 0x7f49c414b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:32.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49ca3b8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c414f080 con 0x7f49c406f880 2023-10-03T19:17:32.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49ca3b8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c4070e90 con 0x7f49c40bd9f0 2023-10-03T19:17:32.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49ca3b8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c406f3e0 con 0x7f49c414f510 2023-10-03T19:17:32.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49c3fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f49c406f880 0x7f49c40a5940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49098/0 (socket says 172.21.15.45:49098) 2023-10-03T19:17:32.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49c3fff640 1 -- 172.21.15.45:0/1836205631 learned_addr learned my addr 172.21.15.45:0/1836205631 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:32.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49c37fe640 1 --2- 172.21.15.45:0/1836205631 >> v2:172.21.15.79:3300/0 conn(0x7f49c414f510 0x7f49c414b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:32.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49c2ffd640 1 -- 172.21.15.45:0/1836205631 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 135303006 0 0) 0x7f49c414f080 con 0x7f49c406f880 2023-10-03T19:17:32.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49c2ffd640 1 -- 172.21.15.45:0/1836205631 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49ac003530 con 0x7f49c406f880 2023-10-03T19:17:32.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49c2ffd640 1 -- 172.21.15.45:0/1836205631 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3836235286 0 0) 0x7f49ac003530 con 0x7f49c406f880 2023-10-03T19:17:32.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49c2ffd640 1 -- 172.21.15.45:0/1836205631 >> v2:172.21.15.79:3300/0 conn(0x7f49c414f510 msgr2=0x7f49c414b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:32.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49c2ffd640 1 --2- 172.21.15.45:0/1836205631 >> v2:172.21.15.79:3300/0 conn(0x7f49c414f510 0x7f49c414b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:32.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49c2ffd640 1 -- 172.21.15.45:0/1836205631 >> v1:172.21.15.79:6789/0 conn(0x7f49c40bd9f0 legacy=0x7f49c4155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:32.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49c2ffd640 1 -- 172.21.15.45:0/1836205631 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c414ea30 con 0x7f49c406f880 2023-10-03T19:17:32.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49c2ffd640 1 -- 172.21.15.45:0/1836205631 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f49b4001680 con 0x7f49c406f880 2023-10-03T19:17:32.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49c2ffd640 1 -- 172.21.15.45:0/1836205631 >> v1:172.21.15.45:6789/0 conn(0x7f49c406f880 legacy=0x7f49c40a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:32.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49c2ffd640 1 --2- 172.21.15.45:0/1836205631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49ac003980 0x7f49ac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:32.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49c2ffd640 1 --2- 172.21.15.45:0/1836205631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49ac0047d0 0x7f49ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:32.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49c2ffd640 1 --2- 172.21.15.45:0/1836205631 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49ac005180 0x7f49ac00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:32.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49c2ffd640 1 -- 172.21.15.45:0/1836205631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c406f3e0 con 0x7f49ac003980 2023-10-03T19:17:32.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49c2ffd640 1 -- 172.21.15.45:0/1836205631 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac00c000 con 0x7f49ac0047d0 2023-10-03T19:17:32.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49c2ffd640 1 -- 172.21.15.45:0/1836205631 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac00c1c0 con 0x7f49ac005180 2023-10-03T19:17:32.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49c37fe640 1 --2- 172.21.15.45:0/1836205631 >> v2:172.21.15.79:3300/0 conn(0x7f49c414f510 0x7f49c414b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:17:32.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49c8955640 1 --2- 172.21.15.45:0/1836205631 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49ac005180 0x7f49ac00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:32.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49c3fff640 1 --2- 172.21.15.45:0/1836205631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49ac003980 0x7f49ac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:32.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49c37fe640 1 --2- 172.21.15.45:0/1836205631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49ac0047d0 0x7f49ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:32.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49c8955640 1 -- 172.21.15.45:0/1836205631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49ac0047d0 msgr2=0x7f49ac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:32.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49c8955640 1 --2- 172.21.15.45:0/1836205631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49ac0047d0 0x7f49ac004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:32.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49c8955640 1 -- 172.21.15.45:0/1836205631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49ac003980 msgr2=0x7f49ac003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:32.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49c8955640 1 --2- 172.21.15.45:0/1836205631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49ac003980 0x7f49ac003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:32.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.474+0000 7f49c8955640 1 -- 172.21.15.45:0/1836205631 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ac003530 con 0x7f49ac005180 2023-10-03T19:17:32.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.478+0000 7f49c8955640 1 -- 172.21.15.45:0/1836205631 reap_dead start 2023-10-03T19:17:32.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.478+0000 7f49c8955640 1 --2- 172.21.15.45:0/1836205631 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49ac005180 0x7f49ac00b990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f49bc001e70 tx=0x7f49bc01c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a4926bb87f887e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:32.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.478+0000 7f49c2ffd640 1 -- 172.21.15.45:0/1836205631 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc003b80 con 0x7f49ac005180 2023-10-03T19:17:32.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.478+0000 7f49c2ffd640 1 -- 172.21.15.45:0/1836205631 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49bc003d20 con 0x7f49ac005180 2023-10-03T19:17:32.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.478+0000 7f49c2ffd640 1 -- 172.21.15.45:0/1836205631 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc005310 con 0x7f49ac005180 2023-10-03T19:17:32.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.478+0000 7f49ca3b8640 1 -- 172.21.15.45:0/1836205631 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49ac005180 msgr2=0x7f49ac00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:32.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.478+0000 7f49ca3b8640 1 --2- 172.21.15.45:0/1836205631 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49ac005180 0x7f49ac00b990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f49bc001e70 tx=0x7f49bc01c730 comp rx=0 tx=0).stop 2023-10-03T19:17:32.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.478+0000 7f49ca3b8640 1 -- 172.21.15.45:0/1836205631 shutdown_connections 2023-10-03T19:17:32.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.478+0000 7f49ca3b8640 1 --2- 172.21.15.45:0/1836205631 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49ac005180 0x7f49ac00b990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:32.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.478+0000 7f49ca3b8640 1 -- 172.21.15.45:0/1836205631 >> 172.21.15.45:0/1836205631 conn(0x7f49c40a20d0 msgr2=0x7f49c40a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:32.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.478+0000 7f49ca3b8640 1 -- 172.21.15.45:0/1836205631 shutdown_connections 2023-10-03T19:17:32.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.478+0000 7f49ca3b8640 1 -- 172.21.15.45:0/1836205631 wait complete. 2023-10-03T19:17:32.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.478+0000 7f49ca3b8640 1 Processor -- start 2023-10-03T19:17:32.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.478+0000 7f49ca3b8640 1 -- start start 2023-10-03T19:17:32.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.478+0000 7f49ca3b8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49ac005180 0x7f49c414d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:32.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.482+0000 7f49ca3b8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49c40bc7d0 0x7f49c414dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:32.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.482+0000 7f49ca3b8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49c414e100 0x7f49c41448c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:32.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.482+0000 7f49ca3b8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c4145930 con 0x7f49c40bc7d0 2023-10-03T19:17:32.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.482+0000 7f49ca3b8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c414e5a0 con 0x7f49ac005180 2023-10-03T19:17:32.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.482+0000 7f49ca3b8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c414d5d0 con 0x7f49c414e100 2023-10-03T19:17:32.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.482+0000 7f49c37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49c40bc7d0 0x7f49c414dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:32.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.482+0000 7f49c37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49c40bc7d0 0x7f49c414dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59788/0 (socket says 172.21.15.45:59788) 2023-10-03T19:17:32.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.482+0000 7f49c37fe640 1 -- 172.21.15.45:0/2493815487 learned_addr learned my addr 172.21.15.45:0/2493815487 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:32.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.482+0000 7f49c3fff640 1 --2- 172.21.15.45:0/2493815487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49ac005180 0x7f49c414d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:32.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.482+0000 7f49c8955640 1 --2- 172.21.15.45:0/2493815487 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49c414e100 0x7f49c41448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:32.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.482+0000 7f49c37fe640 1 -- 172.21.15.45:0/2493815487 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49c414e100 msgr2=0x7f49c41448c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:32.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.482+0000 7f49c37fe640 1 --2- 172.21.15.45:0/2493815487 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49c414e100 0x7f49c41448c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:32.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.482+0000 7f49c37fe640 1 -- 172.21.15.45:0/2493815487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49ac005180 msgr2=0x7f49c414d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:32.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.482+0000 7f49c37fe640 1 --2- 172.21.15.45:0/2493815487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49ac005180 0x7f49c414d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:32.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.482+0000 7f49c37fe640 1 -- 172.21.15.45:0/2493815487 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c4070a40 con 0x7f49c40bc7d0 2023-10-03T19:17:32.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.482+0000 7f49c37fe640 1 --2- 172.21.15.45:0/2493815487 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49c40bc7d0 0x7f49c414dbc0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f49b8011cd0 tx=0x7f49b800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:32.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.482+0000 7f49c0ff9640 1 -- 172.21.15.45:0/2493815487 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b8011d00 con 0x7f49c40bc7d0 2023-10-03T19:17:32.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.482+0000 7f49c0ff9640 1 -- 172.21.15.45:0/2493815487 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b8011e60 con 0x7f49c40bc7d0 2023-10-03T19:17:32.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.482+0000 7f49ca3b8640 1 -- 172.21.15.45:0/2493815487 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c406fc50 con 0x7f49c40bc7d0 2023-10-03T19:17:32.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.482+0000 7f49c0ff9640 1 -- 172.21.15.45:0/2493815487 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b8004240 con 0x7f49c40bc7d0 2023-10-03T19:17:32.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.482+0000 7f49ca3b8640 1 -- 172.21.15.45:0/2493815487 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c4070bd0 con 0x7f49c40bc7d0 2023-10-03T19:17:32.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.482+0000 7f49ca3b8640 1 -- 172.21.15.45:0/2493815487 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c40b7e80 con 0x7f49c40bc7d0 2023-10-03T19:17:32.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.482+0000 7f49c0ff9640 1 -- 172.21.15.45:0/2493815487 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f49b80043a0 con 0x7f49c40bc7d0 2023-10-03T19:17:32.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.482+0000 7f49c0ff9640 1 --2- 172.21.15.45:0/2493815487 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f49b00662b0 0x7f49b0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:32.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.482+0000 7f49c0ff9640 1 -- 172.21.15.45:0/2493815487 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f49b8083fd0 con 0x7f49c40bc7d0 2023-10-03T19:17:32.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.482+0000 7f49c3fff640 1 --2- 172.21.15.45:0/2493815487 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f49b00662b0 0x7f49b0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:32.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.486+0000 7f49c3fff640 1 --2- 172.21.15.45:0/2493815487 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f49b00662b0 0x7f49b0068760 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f49b4007e30 tx=0x7f49b4001580 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:32.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.486+0000 7f49c0ff9640 1 -- 172.21.15.45:0/2493815487 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f49c40b7e80 con 0x7f49c40bc7d0 2023-10-03T19:17:32.740 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:17:32.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.634+0000 7f49ca3b8640 1 -- 172.21.15.45:0/2493815487 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f49c40b7e80 con 0x7f49c40bc7d0 2023-10-03T19:17:32.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.634+0000 7f49c0ff9640 1 -- 172.21.15.45:0/2493815487 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v70) v1 ==== 92+0+10 (secure 0 0 0) 0x7f49c40b7e80 con 0x7f49c40bc7d0 2023-10-03T19:17:32.741 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:17:32.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.638+0000 7f49ca3b8640 1 -- 172.21.15.45:0/2493815487 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f49b00662b0 msgr2=0x7f49b0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:32.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.638+0000 7f49ca3b8640 1 --2- 172.21.15.45:0/2493815487 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f49b00662b0 0x7f49b0068760 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f49b4007e30 tx=0x7f49b4001580 comp rx=0 tx=0).stop 2023-10-03T19:17:32.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.638+0000 7f49ca3b8640 1 -- 172.21.15.45:0/2493815487 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49c40bc7d0 msgr2=0x7f49c414dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:32.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.638+0000 7f49ca3b8640 1 --2- 172.21.15.45:0/2493815487 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49c40bc7d0 0x7f49c414dbc0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f49b8011cd0 tx=0x7f49b800f610 comp rx=0 tx=0).stop 2023-10-03T19:17:32.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.638+0000 7f49ca3b8640 1 -- 172.21.15.45:0/2493815487 shutdown_connections 2023-10-03T19:17:32.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.638+0000 7f49ca3b8640 1 --2- 172.21.15.45:0/2493815487 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f49b00662b0 0x7f49b0068760 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:32.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.638+0000 7f49ca3b8640 1 --2- 172.21.15.45:0/2493815487 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49c414e100 0x7f49c41448c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:32.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.638+0000 7f49ca3b8640 1 --2- 172.21.15.45:0/2493815487 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49c40bc7d0 0x7f49c414dbc0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:32.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.638+0000 7f49ca3b8640 1 --2- 172.21.15.45:0/2493815487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49ac005180 0x7f49c414d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:32.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.638+0000 7f49ca3b8640 1 -- 172.21.15.45:0/2493815487 >> 172.21.15.45:0/2493815487 conn(0x7f49c40a20d0 msgr2=0x7f49c40a24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:32.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.638+0000 7f49ca3b8640 1 -- 172.21.15.45:0/2493815487 shutdown_connections 2023-10-03T19:17:32.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.638+0000 7f49ca3b8640 1 -- 172.21.15.45:0/2493815487 wait complete. 2023-10-03T19:17:32.783 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-03T19:17:32.787 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:17:32.790 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:17:32.808 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:17:32.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.898+0000 7f9579152640 1 Processor -- start 2023-10-03T19:17:32.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.898+0000 7f9579152640 1 -- start start 2023-10-03T19:17:32.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.898+0000 7f9579152640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f95740bd3b0 0x7f95740bc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:32.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.898+0000 7f9579152640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f95740bc220 0x7f957414e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:32.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.898+0000 7f9579152640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9574148540 con 0x7f9574148170 2023-10-03T19:17:32.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.898+0000 7f9579152640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f957414baf0 con 0x7f95740bc220 2023-10-03T19:17:32.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.898+0000 7f9579152640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f957406f730 con 0x7f95740bd3b0 2023-10-03T19:17:32.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.898+0000 7f957359e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f95740bc220 0x7f957414e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:32.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.898+0000 7f9572d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9574148170 0x7f957414e050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49100/0 (socket says 172.21.15.45:49100) 2023-10-03T19:17:32.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.898+0000 7f9572d9d640 1 -- 172.21.15.45:0/1679495123 learned_addr learned my addr 172.21.15.45:0/1679495123 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:32.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.898+0000 7f957259c640 1 --2- 172.21.15.45:0/1679495123 >> v2:172.21.15.79:3300/0 conn(0x7f95740bd3b0 0x7f95740bc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:32.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.898+0000 7f957359e640 1 -- 172.21.15.45:0/1679495123 >> v2:172.21.15.79:3300/0 conn(0x7f95740bd3b0 msgr2=0x7f95740bc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:32.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.898+0000 7f957359e640 1 --2- 172.21.15.45:0/1679495123 >> v2:172.21.15.79:3300/0 conn(0x7f95740bd3b0 0x7f95740bc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:32.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.898+0000 7f957359e640 1 -- 172.21.15.45:0/1679495123 >> v1:172.21.15.45:6789/0 conn(0x7f9574148170 legacy=0x7f957414e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:32.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.898+0000 7f957359e640 1 -- 172.21.15.45:0/1679495123 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9574070690 con 0x7f95740bc220 2023-10-03T19:17:32.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.902+0000 7f957359e640 1 --2- 172.21.15.45:0/1679495123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95740bc220 0x7f957414e760 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f95740c1940 tx=0x7f956c01c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a43bc99191706e36 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:32.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.902+0000 7f9571d9b640 1 -- 172.21.15.45:0/1679495123 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956c0a5890 con 0x7f95740bc220 2023-10-03T19:17:32.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.902+0000 7f9571d9b640 1 -- 172.21.15.45:0/1679495123 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956c0a59f0 con 0x7f95740bc220 2023-10-03T19:17:32.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.902+0000 7f9571d9b640 1 -- 172.21.15.45:0/1679495123 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956c0a5d80 con 0x7f95740bc220 2023-10-03T19:17:32.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.902+0000 7f9579152640 1 -- 172.21.15.45:0/1679495123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95740bc220 msgr2=0x7f957414e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:32.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.902+0000 7f9579152640 1 --2- 172.21.15.45:0/1679495123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95740bc220 0x7f957414e760 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f95740c1940 tx=0x7f956c01c830 comp rx=0 tx=0).stop 2023-10-03T19:17:32.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.902+0000 7f9579152640 1 -- 172.21.15.45:0/1679495123 shutdown_connections 2023-10-03T19:17:32.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.902+0000 7f9579152640 1 --2- 172.21.15.45:0/1679495123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95740bc220 0x7f957414e760 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:32.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.902+0000 7f9579152640 1 --2- 172.21.15.45:0/1679495123 >> v2:172.21.15.79:3300/0 conn(0x7f95740bd3b0 0x7f95740bc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:32.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.902+0000 7f9579152640 1 -- 172.21.15.45:0/1679495123 >> 172.21.15.45:0/1679495123 conn(0x7f95740c0d20 msgr2=0x7f95740c1120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:32.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.902+0000 7f9579152640 1 -- 172.21.15.45:0/1679495123 shutdown_connections 2023-10-03T19:17:32.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.902+0000 7f9579152640 1 -- 172.21.15.45:0/1679495123 wait complete. 2023-10-03T19:17:32.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.902+0000 7f9579152640 1 Processor -- start 2023-10-03T19:17:32.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.902+0000 7f9579152640 1 -- start start 2023-10-03T19:17:32.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.906+0000 7f9579152640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95740bc220 0x7f95740beb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:32.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.906+0000 7f9579152640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95740bd3b0 0x7f9574148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:32.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.906+0000 7f9579152640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9574148170 0x7f95741e71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:32.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.906+0000 7f9579152640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957413ce60 con 0x7f9574148170 2023-10-03T19:17:32.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.906+0000 7f9579152640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95740ba760 con 0x7f95740bc220 2023-10-03T19:17:32.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.906+0000 7f9579152640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9574149bd0 con 0x7f95740bd3b0 2023-10-03T19:17:32.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.906+0000 7f957359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9574148170 0x7f95741e71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:32.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.906+0000 7f957359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9574148170 0x7f95741e71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59806/0 (socket says 172.21.15.45:59806) 2023-10-03T19:17:32.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.906+0000 7f957359e640 1 -- 172.21.15.45:0/2111725337 learned_addr learned my addr 172.21.15.45:0/2111725337 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:32.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.906+0000 7f9572d9d640 1 --2- 172.21.15.45:0/2111725337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95740bc220 0x7f95740beb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:32.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.906+0000 7f957259c640 1 --2- 172.21.15.45:0/2111725337 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95740bd3b0 0x7f9574148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:32.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.906+0000 7f957359e640 1 -- 172.21.15.45:0/2111725337 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95740bd3b0 msgr2=0x7f9574148b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:32.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.906+0000 7f957359e640 1 --2- 172.21.15.45:0/2111725337 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95740bd3b0 0x7f9574148b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:32.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.906+0000 7f957359e640 1 -- 172.21.15.45:0/2111725337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95740bc220 msgr2=0x7f95740beb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:32.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.906+0000 7f957359e640 1 --2- 172.21.15.45:0/2111725337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95740bc220 0x7f95740beb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:32.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.906+0000 7f957359e640 1 -- 172.21.15.45:0/2111725337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f956c009a70 con 0x7f9574148170 2023-10-03T19:17:32.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.906+0000 7f957359e640 1 --2- 172.21.15.45:0/2111725337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9574148170 0x7f95741e71d0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f956c01aee0 tx=0x7f956c0195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:32.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.906+0000 7f955b7fe640 1 -- 172.21.15.45:0/2111725337 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956c0adc00 con 0x7f9574148170 2023-10-03T19:17:32.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.906+0000 7f955b7fe640 1 -- 172.21.15.45:0/2111725337 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956c0add60 con 0x7f9574148170 2023-10-03T19:17:32.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.906+0000 7f9579152640 1 -- 172.21.15.45:0/2111725337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f957406fd20 con 0x7f9574148170 2023-10-03T19:17:32.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.906+0000 7f955b7fe640 1 -- 172.21.15.45:0/2111725337 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956c0b9690 con 0x7f9574148170 2023-10-03T19:17:32.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.906+0000 7f9579152640 1 -- 172.21.15.45:0/2111725337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f957406f9d0 con 0x7f9574148170 2023-10-03T19:17:32.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.906+0000 7f9579152640 1 -- 172.21.15.45:0/2111725337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9574071920 con 0x7f9574148170 2023-10-03T19:17:32.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.910+0000 7f955b7fe640 1 -- 172.21.15.45:0/2111725337 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f956c0b97f0 con 0x7f9574148170 2023-10-03T19:17:32.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.910+0000 7f955b7fe640 1 --2- 172.21.15.45:0/2111725337 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9560066280 0x7f9560068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:32.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.910+0000 7f955b7fe640 1 -- 172.21.15.45:0/2111725337 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f956c11f270 con 0x7f9574148170 2023-10-03T19:17:32.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.910+0000 7f9572d9d640 1 --2- 172.21.15.45:0/2111725337 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9560066280 0x7f9560068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:32.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.910+0000 7f9572d9d640 1 --2- 172.21.15.45:0/2111725337 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9560066280 0x7f9560068730 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9564009fd0 tx=0x7f956400b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:32.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:32.914+0000 7f955b7fe640 1 -- 172.21.15.45:0/2111725337 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f956c0ecbf0 con 0x7f9574148170 2023-10-03T19:17:33.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.070+0000 7f9579152640 1 -- 172.21.15.45:0/2111725337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9574071920 con 0x7f9574148170 2023-10-03T19:17:33.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.070+0000 7f955b7fe640 1 -- 172.21.15.45:0/2111725337 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v70) v1 ==== 84+0+126 (secure 0 0 0) 0x7f956c0f0210 con 0x7f9574148170 2023-10-03T19:17:33.101 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:17:33.101 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-10-03T19:17:33.101 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:17:33.102 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-10-03T19:17:33.102 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-10-03T19:17:33.102 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:17:33.102 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:17:33.102 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 2, 2023-10-03T19:17:33.102 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "rbd" 2023-10-03T19:17:33.102 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:17:33.102 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-10-03T19:17:33.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.070+0000 7f9579152640 1 -- 172.21.15.45:0/2111725337 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9560066280 msgr2=0x7f9560068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:33.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.070+0000 7f9579152640 1 --2- 172.21.15.45:0/2111725337 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9560066280 0x7f9560068730 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9564009fd0 tx=0x7f956400b040 comp rx=0 tx=0).stop 2023-10-03T19:17:33.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.070+0000 7f9579152640 1 -- 172.21.15.45:0/2111725337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9574148170 msgr2=0x7f95741e71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:33.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.070+0000 7f9579152640 1 --2- 172.21.15.45:0/2111725337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9574148170 0x7f95741e71d0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f956c01aee0 tx=0x7f956c0195d0 comp rx=0 tx=0).stop 2023-10-03T19:17:33.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.070+0000 7f9579152640 1 -- 172.21.15.45:0/2111725337 shutdown_connections 2023-10-03T19:17:33.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.070+0000 7f9579152640 1 --2- 172.21.15.45:0/2111725337 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9560066280 0x7f9560068730 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:33.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.070+0000 7f9579152640 1 --2- 172.21.15.45:0/2111725337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9574148170 0x7f95741e71d0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:33.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.070+0000 7f9579152640 1 --2- 172.21.15.45:0/2111725337 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95740bd3b0 0x7f9574148b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:33.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.070+0000 7f9579152640 1 --2- 172.21.15.45:0/2111725337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95740bc220 0x7f95740beb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:33.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.070+0000 7f9579152640 1 -- 172.21.15.45:0/2111725337 >> 172.21.15.45:0/2111725337 conn(0x7f95740c0d20 msgr2=0x7f95740bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:33.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.070+0000 7f9579152640 1 -- 172.21.15.45:0/2111725337 shutdown_connections 2023-10-03T19:17:33.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.070+0000 7f9579152640 1 -- 172.21.15.45:0/2111725337 wait complete. 2023-10-03T19:17:33.105 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-03T19:17:33.105 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-03T19:17:33.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.274+0000 7fa6886ac640 1 Processor -- start 2023-10-03T19:17:33.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.274+0000 7fa6886ac640 1 -- start start 2023-10-03T19:17:33.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.274+0000 7fa6886ac640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa680065690 0x7fa680065ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:33.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.274+0000 7fa6886ac640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6800c0290 con 0x7fa680149ec0 2023-10-03T19:17:33.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.274+0000 7fa6886ac640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6800c0f00 con 0x7fa6800bf3f0 2023-10-03T19:17:33.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.274+0000 7fa6886ac640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6800c1390 con 0x7fa680065690 2023-10-03T19:17:33.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.274+0000 7fa686448640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa680149ec0 0x7fa6800bbe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49114/0 (socket says 172.21.15.45:49114) 2023-10-03T19:17:33.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.274+0000 7fa686448640 1 -- 172.21.15.45:0/3164083117 learned_addr learned my addr 172.21.15.45:0/3164083117 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:33.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.274+0000 7fa686c49640 1 --2- 172.21.15.45:0/3164083117 >> v2:172.21.15.45:3300/0 conn(0x7fa680065690 0x7fa680065ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:33.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.278+0000 7fa685446640 1 -- 172.21.15.45:0/3164083117 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1952338098 0 0) 0x7fa6800c0290 con 0x7fa680149ec0 2023-10-03T19:17:33.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.278+0000 7fa685446640 1 -- 172.21.15.45:0/3164083117 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa66c003530 con 0x7fa680149ec0 2023-10-03T19:17:33.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.278+0000 7fa686c49640 1 -- 172.21.15.45:0/3164083117 >> v1:172.21.15.79:6789/0 conn(0x7fa6800bf3f0 legacy=0x7fa6800c04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:33.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.278+0000 7fa686c49640 1 -- 172.21.15.45:0/3164083117 >> v1:172.21.15.45:6789/0 conn(0x7fa680149ec0 legacy=0x7fa6800bbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:33.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.278+0000 7fa686c49640 1 -- 172.21.15.45:0/3164083117 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68014d080 con 0x7fa680065690 2023-10-03T19:17:33.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.278+0000 7fa686c49640 1 --2- 172.21.15.45:0/3164083117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa680065690 0x7fa680065ad0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fa678009d90 tx=0x7fa67801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac16f879ffccfefa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:33.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.278+0000 7fa685446640 1 -- 172.21.15.45:0/3164083117 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6780a5810 con 0x7fa680065690 2023-10-03T19:17:33.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.278+0000 7fa685446640 1 -- 172.21.15.45:0/3164083117 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6780a5970 con 0x7fa680065690 2023-10-03T19:17:33.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.278+0000 7fa685446640 1 -- 172.21.15.45:0/3164083117 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6780a5d00 con 0x7fa680065690 2023-10-03T19:17:33.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.278+0000 7fa6886ac640 1 -- 172.21.15.45:0/3164083117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa680065690 msgr2=0x7fa680065ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:33.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.278+0000 7fa6886ac640 1 --2- 172.21.15.45:0/3164083117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa680065690 0x7fa680065ad0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fa678009d90 tx=0x7fa67801c950 comp rx=0 tx=0).stop 2023-10-03T19:17:33.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.278+0000 7fa6886ac640 1 -- 172.21.15.45:0/3164083117 shutdown_connections 2023-10-03T19:17:33.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.278+0000 7fa6886ac640 1 --2- 172.21.15.45:0/3164083117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa680065690 0x7fa680065ad0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:33.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.278+0000 7fa6886ac640 1 -- 172.21.15.45:0/3164083117 >> 172.21.15.45:0/3164083117 conn(0x7fa6800c14f0 msgr2=0x7fa6800c18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:33.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.278+0000 7fa6886ac640 1 -- 172.21.15.45:0/3164083117 shutdown_connections 2023-10-03T19:17:33.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.278+0000 7fa6886ac640 1 -- 172.21.15.45:0/3164083117 wait complete. 2023-10-03T19:17:33.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.282+0000 7fa6886ac640 1 Processor -- start 2023-10-03T19:17:33.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.282+0000 7fa6886ac640 1 -- start start 2023-10-03T19:17:33.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.282+0000 7fa6886ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa680065690 0x7fa6800a58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:33.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.282+0000 7fa6886ac640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa6800bf3f0 0x7fa6801e4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:33.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.282+0000 7fa6886ac640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa680149ec0 0x7fa6801e5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:33.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.282+0000 7fa6886ac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68014c7d0 con 0x7fa680065690 2023-10-03T19:17:33.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.282+0000 7fa6886ac640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6801e8d40 con 0x7fa680149ec0 2023-10-03T19:17:33.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.282+0000 7fa6886ac640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6800a62c0 con 0x7fa6800bf3f0 2023-10-03T19:17:33.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.282+0000 7fa686448640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa680065690 0x7fa6800a58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:33.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.282+0000 7fa686448640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa680065690 0x7fa6800a58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59820/0 (socket says 172.21.15.45:59820) 2023-10-03T19:17:33.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.282+0000 7fa686448640 1 -- 172.21.15.45:0/3569761225 learned_addr learned my addr 172.21.15.45:0/3569761225 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:33.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.282+0000 7fa685c47640 1 --2- 172.21.15.45:0/3569761225 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa6800bf3f0 0x7fa6801e4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:33.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.282+0000 7fa686c49640 1 --2- 172.21.15.45:0/3569761225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa680149ec0 0x7fa6801e5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:33.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.282+0000 7fa686448640 1 -- 172.21.15.45:0/3569761225 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa6800bf3f0 msgr2=0x7fa6801e4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:33.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.282+0000 7fa686448640 1 --2- 172.21.15.45:0/3569761225 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa6800bf3f0 0x7fa6801e4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:33.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.282+0000 7fa686448640 1 -- 172.21.15.45:0/3569761225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa680149ec0 msgr2=0x7fa6801e5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:33.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.282+0000 7fa686448640 1 --2- 172.21.15.45:0/3569761225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa680149ec0 0x7fa6801e5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:33.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.282+0000 7fa686448640 1 -- 172.21.15.45:0/3569761225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa678009a70 con 0x7fa680065690 2023-10-03T19:17:33.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.282+0000 7fa686c49640 1 --2- 172.21.15.45:0/3569761225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa680149ec0 0x7fa6801e5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:33.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.282+0000 7fa686448640 1 --2- 172.21.15.45:0/3569761225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa680065690 0x7fa6800a58c0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fa67c00c420 tx=0x7fa67c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:33.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.282+0000 7fa676ffd640 1 -- 172.21.15.45:0/3569761225 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c005cf0 con 0x7fa680065690 2023-10-03T19:17:33.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.282+0000 7fa676ffd640 1 -- 172.21.15.45:0/3569761225 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67c005e50 con 0x7fa680065690 2023-10-03T19:17:33.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.282+0000 7fa676ffd640 1 -- 172.21.15.45:0/3569761225 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c0072d0 con 0x7fa680065690 2023-10-03T19:17:33.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.282+0000 7fa6886ac640 1 -- 172.21.15.45:0/3569761225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa68015a730 con 0x7fa680065690 2023-10-03T19:17:33.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.282+0000 7fa6886ac640 1 -- 172.21.15.45:0/3569761225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa68015a5a0 con 0x7fa680065690 2023-10-03T19:17:33.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.282+0000 7fa6886ac640 1 -- 172.21.15.45:0/3569761225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa68015a8c0 con 0x7fa680065690 2023-10-03T19:17:33.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.282+0000 7fa676ffd640 1 -- 172.21.15.45:0/3569761225 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa67c007430 con 0x7fa680065690 2023-10-03T19:17:33.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.286+0000 7fa676ffd640 1 --2- 172.21.15.45:0/3569761225 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa6640662b0 0x7fa664068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:33.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.286+0000 7fa676ffd640 1 -- 172.21.15.45:0/3569761225 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa67c082f50 con 0x7fa680065690 2023-10-03T19:17:33.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.286+0000 7fa685c47640 1 --2- 172.21.15.45:0/3569761225 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa6640662b0 0x7fa664068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:33.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.286+0000 7fa685c47640 1 --2- 172.21.15.45:0/3569761225 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa6640662b0 0x7fa664068760 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa680065cd0 tx=0x7fa670009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:33.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.290+0000 7fa676ffd640 1 -- 172.21.15.45:0/3569761225 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa67c050730 con 0x7fa680065690 2023-10-03T19:17:33.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.442+0000 7fa6886ac640 1 -- 172.21.15.45:0/3569761225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa6801e8830 con 0x7fa680065690 2023-10-03T19:17:33.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.926+0000 7fa676ffd640 1 -- 172.21.15.45:0/3569761225 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v71) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa6801e8830 con 0x7fa680065690 2023-10-03T19:17:33.968 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-10-03T19:17:33.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.930+0000 7fa6886ac640 1 -- 172.21.15.45:0/3569761225 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa6640662b0 msgr2=0x7fa664068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:33.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.930+0000 7fa6886ac640 1 --2- 172.21.15.45:0/3569761225 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa6640662b0 0x7fa664068760 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa680065cd0 tx=0x7fa670009040 comp rx=0 tx=0).stop 2023-10-03T19:17:33.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.930+0000 7fa6886ac640 1 -- 172.21.15.45:0/3569761225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa680065690 msgr2=0x7fa6800a58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:33.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.930+0000 7fa6886ac640 1 --2- 172.21.15.45:0/3569761225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa680065690 0x7fa6800a58c0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fa67c00c420 tx=0x7fa67c00c8e0 comp rx=0 tx=0).stop 2023-10-03T19:17:33.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.930+0000 7fa6886ac640 1 -- 172.21.15.45:0/3569761225 shutdown_connections 2023-10-03T19:17:33.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.930+0000 7fa6886ac640 1 --2- 172.21.15.45:0/3569761225 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa6640662b0 0x7fa664068760 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:33.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.930+0000 7fa6886ac640 1 --2- 172.21.15.45:0/3569761225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa680149ec0 0x7fa6801e5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:33.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.930+0000 7fa6886ac640 1 --2- 172.21.15.45:0/3569761225 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa6800bf3f0 0x7fa6801e4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:33.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.930+0000 7fa6886ac640 1 --2- 172.21.15.45:0/3569761225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa680065690 0x7fa6800a58c0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:33.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.930+0000 7fa6886ac640 1 -- 172.21.15.45:0/3569761225 >> 172.21.15.45:0/3569761225 conn(0x7fa6800c14f0 msgr2=0x7fa6800bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:33.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.930+0000 7fa6886ac640 1 -- 172.21.15.45:0/3569761225 shutdown_connections 2023-10-03T19:17:33.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:33.930+0000 7fa6886ac640 1 -- 172.21.15.45:0/3569761225 wait complete. 2023-10-03T19:17:33.971 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-03T19:17:34.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.106+0000 7fa3b089c640 1 Processor -- start 2023-10-03T19:17:34.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.106+0000 7fa3b089c640 1 -- start start 2023-10-03T19:17:34.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.110+0000 7fa3b089c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa3ac06ee50 0x7fa3ac14ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:34.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.110+0000 7fa3b089c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3ac148330 0x7fa3ac14b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:34.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.110+0000 7fa3b089c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3ac06cd20 con 0x7fa3ac0bc520 2023-10-03T19:17:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.110+0000 7fa3b089c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ac06d5f0 con 0x7fa3ac06ee50 2023-10-03T19:17:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.110+0000 7fa3b089c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac06d2e0 con 0x7fa3ac148330 2023-10-03T19:17:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.110+0000 7fa3aad9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3ac148330 0x7fa3ac14b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.110+0000 7fa3a9d9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa3ac06ee50 0x7fa3ac14ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.110+0000 7fa3aad9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3ac148330 0x7fa3ac14b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:59794/0 (socket says 172.21.15.45:59794) 2023-10-03T19:17:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.110+0000 7fa3aad9d640 1 -- 172.21.15.45:0/645364260 learned_addr learned my addr 172.21.15.45:0/645364260 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.110+0000 7fa3aad9d640 1 -- 172.21.15.45:0/645364260 >> v2:172.21.15.79:3300/0 conn(0x7fa3ac06ee50 msgr2=0x7fa3ac14ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.110+0000 7fa3aad9d640 1 --2- 172.21.15.45:0/645364260 >> v2:172.21.15.79:3300/0 conn(0x7fa3ac06ee50 0x7fa3ac14ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.110+0000 7fa3aad9d640 1 -- 172.21.15.45:0/645364260 >> v1:172.21.15.79:6789/0 conn(0x7fa3ac0bc520 legacy=0x7fa3ac147c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.110+0000 7fa3aad9d640 1 -- 172.21.15.45:0/645364260 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ac06f310 con 0x7fa3ac148330 2023-10-03T19:17:34.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.114+0000 7fa3aad9d640 1 --2- 172.21.15.45:0/645364260 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3ac148330 0x7fa3ac14b040 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400aa10 tx=0x7fa3a4020100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffcf630a91a51ab7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:34.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.114+0000 7fa3a959a640 1 -- 172.21.15.45:0/645364260 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a40b0600 con 0x7fa3ac148330 2023-10-03T19:17:34.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.114+0000 7fa3a959a640 1 -- 172.21.15.45:0/645364260 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a40ac050 con 0x7fa3ac148330 2023-10-03T19:17:34.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.114+0000 7fa3a959a640 1 -- 172.21.15.45:0/645364260 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a40b0980 con 0x7fa3ac148330 2023-10-03T19:17:34.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.114+0000 7fa3b089c640 1 -- 172.21.15.45:0/645364260 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3ac148330 msgr2=0x7fa3ac14b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:34.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.114+0000 7fa3b089c640 1 --2- 172.21.15.45:0/645364260 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3ac148330 0x7fa3ac14b040 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400aa10 tx=0x7fa3a4020100 comp rx=0 tx=0).stop 2023-10-03T19:17:34.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.114+0000 7fa3b089c640 1 -- 172.21.15.45:0/645364260 shutdown_connections 2023-10-03T19:17:34.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.114+0000 7fa3b089c640 1 --2- 172.21.15.45:0/645364260 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3ac148330 0x7fa3ac14b040 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:34.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.114+0000 7fa3b089c640 1 --2- 172.21.15.45:0/645364260 >> v2:172.21.15.79:3300/0 conn(0x7fa3ac06ee50 0x7fa3ac14ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:34.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.114+0000 7fa3b089c640 1 -- 172.21.15.45:0/645364260 >> 172.21.15.45:0/645364260 conn(0x7fa3ac0a20d0 msgr2=0x7fa3ac0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:34.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.114+0000 7fa3b089c640 1 -- 172.21.15.45:0/645364260 shutdown_connections 2023-10-03T19:17:34.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.114+0000 7fa3b089c640 1 -- 172.21.15.45:0/645364260 wait complete. 2023-10-03T19:17:34.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.114+0000 7fa3b089c640 1 Processor -- start 2023-10-03T19:17:34.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.114+0000 7fa3b089c640 1 -- start start 2023-10-03T19:17:34.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.114+0000 7fa3b089c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3ac06ee50 0x7fa3ac0bfd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:34.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.114+0000 7fa3b089c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3ac0bc520 0x7fa3ac0be380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:34.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.114+0000 7fa3b089c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3ac148330 0x7fa3ac1d62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:34.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.114+0000 7fa3b089c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac14ac30 con 0x7fa3ac148330 2023-10-03T19:17:34.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.114+0000 7fa3b089c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac0bf9a0 con 0x7fa3ac0bc520 2023-10-03T19:17:34.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.114+0000 7fa3b089c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac0beec0 con 0x7fa3ac06ee50 2023-10-03T19:17:34.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.114+0000 7fa3aad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3ac148330 0x7fa3ac1d62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:34.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.114+0000 7fa3aad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3ac148330 0x7fa3ac1d62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59822/0 (socket says 172.21.15.45:59822) 2023-10-03T19:17:34.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.114+0000 7fa3aad9d640 1 -- 172.21.15.45:0/1787635363 learned_addr learned my addr 172.21.15.45:0/1787635363 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:34.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.114+0000 7fa3a9d9b640 1 --2- 172.21.15.45:0/1787635363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3ac0bc520 0x7fa3ac0be380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:34.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.114+0000 7fa3aa59c640 1 --2- 172.21.15.45:0/1787635363 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3ac06ee50 0x7fa3ac0bfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:34.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.118+0000 7fa3aad9d640 1 -- 172.21.15.45:0/1787635363 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3ac06ee50 msgr2=0x7fa3ac0bfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:34.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.118+0000 7fa3aad9d640 1 --2- 172.21.15.45:0/1787635363 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3ac06ee50 0x7fa3ac0bfd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:34.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.118+0000 7fa3aad9d640 1 -- 172.21.15.45:0/1787635363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3ac0bc520 msgr2=0x7fa3ac0be380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:34.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.118+0000 7fa3aad9d640 1 --2- 172.21.15.45:0/1787635363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3ac0bc520 0x7fa3ac0be380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:34.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.118+0000 7fa3aad9d640 1 -- 172.21.15.45:0/1787635363 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a400a670 con 0x7fa3ac148330 2023-10-03T19:17:34.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.118+0000 7fa3aad9d640 1 --2- 172.21.15.45:0/1787635363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3ac148330 0x7fa3ac1d62b0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400a1c0 tx=0x7fa3a401cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:34.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.118+0000 7fa39affd640 1 -- 172.21.15.45:0/1787635363 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a40b9430 con 0x7fa3ac148330 2023-10-03T19:17:34.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.118+0000 7fa39affd640 1 -- 172.21.15.45:0/1787635363 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a40b95b0 con 0x7fa3ac148330 2023-10-03T19:17:34.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.118+0000 7fa3b089c640 1 -- 172.21.15.45:0/1787635363 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ac0bca80 con 0x7fa3ac148330 2023-10-03T19:17:34.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.118+0000 7fa39affd640 1 -- 172.21.15.45:0/1787635363 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a40b9960 con 0x7fa3ac148330 2023-10-03T19:17:34.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.118+0000 7fa3b089c640 1 -- 172.21.15.45:0/1787635363 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ac0bc8f0 con 0x7fa3ac148330 2023-10-03T19:17:34.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.118+0000 7fa3b089c640 1 -- 172.21.15.45:0/1787635363 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ac0ba6c0 con 0x7fa3ac148330 2023-10-03T19:17:34.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.118+0000 7fa39affd640 1 -- 172.21.15.45:0/1787635363 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa3a40b7040 con 0x7fa3ac148330 2023-10-03T19:17:34.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.118+0000 7fa39affd640 1 --2- 172.21.15.45:0/1787635363 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa38c066280 0x7fa38c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:34.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.118+0000 7fa39affd640 1 -- 172.21.15.45:0/1787635363 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fa3a41220c0 con 0x7fa3ac148330 2023-10-03T19:17:34.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.118+0000 7fa3aa59c640 1 --2- 172.21.15.45:0/1787635363 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa38c066280 0x7fa38c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:34.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.118+0000 7fa3aa59c640 1 --2- 172.21.15.45:0/1787635363 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa38c066280 0x7fa38c068730 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa39c001ea0 tx=0x7fa39c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:34.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.122+0000 7fa39affd640 1 -- 172.21.15.45:0/1787635363 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa3a40ef940 con 0x7fa3ac148330 2023-10-03T19:17:34.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.278+0000 7fa3b089c640 1 -- 172.21.15.45:0/1787635363 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa3ac070120 con 0x7fa3ac148330 2023-10-03T19:17:34.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.946+0000 7fa39affd640 1 -- 172.21.15.45:0/1787635363 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v72) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa3a40f2f60 con 0x7fa3ac148330 2023-10-03T19:17:34.980 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-10-03T19:17:34.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.958+0000 7fa3b089c640 1 -- 172.21.15.45:0/1787635363 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa38c066280 msgr2=0x7fa38c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:34.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.958+0000 7fa3b089c640 1 --2- 172.21.15.45:0/1787635363 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa38c066280 0x7fa38c068730 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa39c001ea0 tx=0x7fa39c009040 comp rx=0 tx=0).stop 2023-10-03T19:17:34.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.958+0000 7fa3b089c640 1 -- 172.21.15.45:0/1787635363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3ac148330 msgr2=0x7fa3ac1d62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:34.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.958+0000 7fa3b089c640 1 --2- 172.21.15.45:0/1787635363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3ac148330 0x7fa3ac1d62b0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400a1c0 tx=0x7fa3a401cea0 comp rx=0 tx=0).stop 2023-10-03T19:17:34.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.962+0000 7fa3b089c640 1 -- 172.21.15.45:0/1787635363 shutdown_connections 2023-10-03T19:17:34.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.962+0000 7fa3b089c640 1 --2- 172.21.15.45:0/1787635363 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa38c066280 0x7fa38c068730 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:34.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.962+0000 7fa3b089c640 1 --2- 172.21.15.45:0/1787635363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3ac148330 0x7fa3ac1d62b0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:34.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.962+0000 7fa3b089c640 1 --2- 172.21.15.45:0/1787635363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3ac0bc520 0x7fa3ac0be380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:34.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.962+0000 7fa3b089c640 1 --2- 172.21.15.45:0/1787635363 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3ac06ee50 0x7fa3ac0bfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:34.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.962+0000 7fa3b089c640 1 -- 172.21.15.45:0/1787635363 >> 172.21.15.45:0/1787635363 conn(0x7fa3ac0a20d0 msgr2=0x7fa3ac0b9750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:34.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.966+0000 7fa3b089c640 1 -- 172.21.15.45:0/1787635363 shutdown_connections 2023-10-03T19:17:34.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:34.966+0000 7fa3b089c640 1 -- 172.21.15.45:0/1787635363 wait complete. 2023-10-03T19:17:34.995 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-03T19:17:35.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec4a62a640 1 Processor -- start 2023-10-03T19:17:35.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec4a62a640 1 -- start start 2023-10-03T19:17:35.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec4a62a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fec4414f510 0x7fec4414b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:35.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec4a62a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec4414f080 con 0x7fec440bd9f0 2023-10-03T19:17:35.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec4a62a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec44070e90 con 0x7fec4406f880 2023-10-03T19:17:35.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec4a62a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec4406f3e0 con 0x7fec4414f510 2023-10-03T19:17:35.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec48bc7640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fec440bd9f0 0x7fec44155bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35050/0 (socket says 172.21.15.45:35050) 2023-10-03T19:17:35.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec48bc7640 1 -- 172.21.15.45:0/995265271 learned_addr learned my addr 172.21.15.45:0/995265271 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:35.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec437fe640 1 --2- 172.21.15.45:0/995265271 >> v2:172.21.15.79:3300/0 conn(0x7fec4414f510 0x7fec4414b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec42ffd640 1 -- 172.21.15.45:0/995265271 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725863057 0 0) 0x7fec4414f080 con 0x7fec440bd9f0 2023-10-03T19:17:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec42ffd640 1 -- 172.21.15.45:0/995265271 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec2c003530 con 0x7fec440bd9f0 2023-10-03T19:17:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec42ffd640 1 -- 172.21.15.45:0/995265271 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4178768553 0 0) 0x7fec2c003530 con 0x7fec440bd9f0 2023-10-03T19:17:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec42ffd640 1 -- 172.21.15.45:0/995265271 >> v2:172.21.15.79:3300/0 conn(0x7fec4414f510 msgr2=0x7fec4414b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec42ffd640 1 --2- 172.21.15.45:0/995265271 >> v2:172.21.15.79:3300/0 conn(0x7fec4414f510 0x7fec4414b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec42ffd640 1 -- 172.21.15.45:0/995265271 >> v1:172.21.15.79:6789/0 conn(0x7fec4406f880 legacy=0x7fec440a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec42ffd640 1 -- 172.21.15.45:0/995265271 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4414ea30 con 0x7fec440bd9f0 2023-10-03T19:17:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec42ffd640 1 -- 172.21.15.45:0/995265271 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fec3c001a00 con 0x7fec440bd9f0 2023-10-03T19:17:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec42ffd640 1 -- 172.21.15.45:0/995265271 >> v1:172.21.15.45:6789/0 conn(0x7fec440bd9f0 legacy=0x7fec44155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec42ffd640 1 --2- 172.21.15.45:0/995265271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec2c003980 0x7fec2c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec42ffd640 1 --2- 172.21.15.45:0/995265271 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fec2c0047d0 0x7fec2c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec42ffd640 1 --2- 172.21.15.45:0/995265271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec2c005180 0x7fec2c00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec42ffd640 1 -- 172.21.15.45:0/995265271 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4406f3e0 con 0x7fec2c005180 2023-10-03T19:17:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec42ffd640 1 -- 172.21.15.45:0/995265271 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c00e210 con 0x7fec2c003980 2023-10-03T19:17:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec42ffd640 1 -- 172.21.15.45:0/995265271 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c00e3d0 con 0x7fec2c0047d0 2023-10-03T19:17:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec48bc7640 1 --2- 172.21.15.45:0/995265271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec2c005180 0x7fec2c00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec43fff640 1 --2- 172.21.15.45:0/995265271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec2c003980 0x7fec2c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec437fe640 1 --2- 172.21.15.45:0/995265271 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fec2c0047d0 0x7fec2c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec48bc7640 1 -- 172.21.15.45:0/995265271 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fec2c0047d0 msgr2=0x7fec2c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec48bc7640 1 --2- 172.21.15.45:0/995265271 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fec2c0047d0 0x7fec2c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:35.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec48bc7640 1 -- 172.21.15.45:0/995265271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec2c003980 msgr2=0x7fec2c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:35.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec48bc7640 1 --2- 172.21.15.45:0/995265271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec2c003980 0x7fec2c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:35.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec48bc7640 1 -- 172.21.15.45:0/995265271 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2c003530 con 0x7fec2c005180 2023-10-03T19:17:35.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec43fff640 1 --2- 172.21.15.45:0/995265271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec2c003980 0x7fec2c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:35.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.294+0000 7fec437fe640 1 --2- 172.21.15.45:0/995265271 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fec2c0047d0 0x7fec2c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:35.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec48bc7640 1 -- 172.21.15.45:0/995265271 reap_dead start 2023-10-03T19:17:35.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec48bc7640 1 --2- 172.21.15.45:0/995265271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec2c005180 0x7fec2c00dba0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fec3c00a830 tx=0x7fec3c01d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcf876ad04904828 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:35.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec42ffd640 1 -- 172.21.15.45:0/995265271 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c0072d0 con 0x7fec2c005180 2023-10-03T19:17:35.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec42ffd640 1 -- 172.21.15.45:0/995265271 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3c0a8070 con 0x7fec2c005180 2023-10-03T19:17:35.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec42ffd640 1 -- 172.21.15.45:0/995265271 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c007650 con 0x7fec2c005180 2023-10-03T19:17:35.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec4a62a640 1 -- 172.21.15.45:0/995265271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec2c005180 msgr2=0x7fec2c00dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:35.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec4a62a640 1 --2- 172.21.15.45:0/995265271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec2c005180 0x7fec2c00dba0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fec3c00a830 tx=0x7fec3c01d340 comp rx=0 tx=0).stop 2023-10-03T19:17:35.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec4a62a640 1 -- 172.21.15.45:0/995265271 shutdown_connections 2023-10-03T19:17:35.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec4a62a640 1 --2- 172.21.15.45:0/995265271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec2c005180 0x7fec2c00dba0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:35.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec4a62a640 1 -- 172.21.15.45:0/995265271 >> 172.21.15.45:0/995265271 conn(0x7fec440a20d0 msgr2=0x7fec440a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:35.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec4a62a640 1 -- 172.21.15.45:0/995265271 shutdown_connections 2023-10-03T19:17:35.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec4a62a640 1 -- 172.21.15.45:0/995265271 wait complete. 2023-10-03T19:17:35.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec4a62a640 1 Processor -- start 2023-10-03T19:17:35.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec4a62a640 1 -- start start 2023-10-03T19:17:35.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec4a62a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fec2c005180 0x7fec44149650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:35.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec4a62a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec441489e0 0x7fec4414d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:35.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec4a62a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec440bfe80 0x7fec440bea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:35.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec4a62a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec44146eb0 con 0x7fec440bfe80 2023-10-03T19:17:35.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec4a62a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec44147280 con 0x7fec441489e0 2023-10-03T19:17:35.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec4a62a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec441422c0 con 0x7fec2c005180 2023-10-03T19:17:35.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec48bc7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec440bfe80 0x7fec440bea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:35.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec48bc7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec440bfe80 0x7fec440bea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34826/0 (socket says 172.21.15.45:34826) 2023-10-03T19:17:35.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec48bc7640 1 -- 172.21.15.45:0/4167434413 learned_addr learned my addr 172.21.15.45:0/4167434413 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:35.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec43fff640 1 --2- 172.21.15.45:0/4167434413 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fec2c005180 0x7fec44149650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:35.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec437fe640 1 --2- 172.21.15.45:0/4167434413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec441489e0 0x7fec4414d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:35.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec48bc7640 1 -- 172.21.15.45:0/4167434413 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fec2c005180 msgr2=0x7fec44149650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:35.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec48bc7640 1 --2- 172.21.15.45:0/4167434413 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fec2c005180 0x7fec44149650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:35.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec48bc7640 1 -- 172.21.15.45:0/4167434413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec441489e0 msgr2=0x7fec4414d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:35.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec48bc7640 1 --2- 172.21.15.45:0/4167434413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec441489e0 0x7fec4414d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:35.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec48bc7640 1 -- 172.21.15.45:0/4167434413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4406f070 con 0x7fec440bfe80 2023-10-03T19:17:35.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.298+0000 7fec48bc7640 1 --2- 172.21.15.45:0/4167434413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec440bfe80 0x7fec440bea20 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fec3c007040 tx=0x7fec2c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:35.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.302+0000 7fec40ff9640 1 -- 172.21.15.45:0/4167434413 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c004d70 con 0x7fec440bfe80 2023-10-03T19:17:35.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.302+0000 7fec40ff9640 1 -- 172.21.15.45:0/4167434413 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3c0b8460 con 0x7fec440bfe80 2023-10-03T19:17:35.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.302+0000 7fec4a62a640 1 -- 172.21.15.45:0/4167434413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec4414ed10 con 0x7fec440bfe80 2023-10-03T19:17:35.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.302+0000 7fec40ff9640 1 -- 172.21.15.45:0/4167434413 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c0b8810 con 0x7fec440bfe80 2023-10-03T19:17:35.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.302+0000 7fec4a62a640 1 -- 172.21.15.45:0/4167434413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec4406fc50 con 0x7fec440bfe80 2023-10-03T19:17:35.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.302+0000 7fec4a62a640 1 -- 172.21.15.45:0/4167434413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec440bfba0 con 0x7fec440bfe80 2023-10-03T19:17:35.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.302+0000 7fec40ff9640 1 -- 172.21.15.45:0/4167434413 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fec3c0aa070 con 0x7fec440bfe80 2023-10-03T19:17:35.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.302+0000 7fec40ff9640 1 --2- 172.21.15.45:0/4167434413 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fec30066280 0x7fec30068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:35.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.302+0000 7fec40ff9640 1 -- 172.21.15.45:0/4167434413 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fec3c11d960 con 0x7fec440bfe80 2023-10-03T19:17:35.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.302+0000 7fec43fff640 1 --2- 172.21.15.45:0/4167434413 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fec30066280 0x7fec30068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:35.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.302+0000 7fec43fff640 1 --2- 172.21.15.45:0/4167434413 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fec30066280 0x7fec30068730 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fec34007fd0 tx=0x7fec34009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:35.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.306+0000 7fec40ff9640 1 -- 172.21.15.45:0/4167434413 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fec3c0eafb0 con 0x7fec440bfe80 2023-10-03T19:17:35.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.494+0000 7fec4a62a640 1 -- 172.21.15.45:0/4167434413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fec44142430 con 0x7fec440bfe80 2023-10-03T19:17:35.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.506+0000 7fec40ff9640 1 -- 172.21.15.45:0/4167434413 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v33) v1 ==== 174+0+0 (secure 0 0 0) 0x7fec3c0ee5d0 con 0x7fec440bfe80 2023-10-03T19:17:35.521 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 11 and data pool 12 2023-10-03T19:17:35.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.510+0000 7fec4a62a640 1 -- 172.21.15.45:0/4167434413 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fec30066280 msgr2=0x7fec30068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:35.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.510+0000 7fec4a62a640 1 --2- 172.21.15.45:0/4167434413 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fec30066280 0x7fec30068730 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fec34007fd0 tx=0x7fec34009040 comp rx=0 tx=0).stop 2023-10-03T19:17:35.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.510+0000 7fec4a62a640 1 -- 172.21.15.45:0/4167434413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec440bfe80 msgr2=0x7fec440bea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:35.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.510+0000 7fec4a62a640 1 --2- 172.21.15.45:0/4167434413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec440bfe80 0x7fec440bea20 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fec3c007040 tx=0x7fec2c005800 comp rx=0 tx=0).stop 2023-10-03T19:17:35.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.522+0000 7fec4a62a640 1 -- 172.21.15.45:0/4167434413 shutdown_connections 2023-10-03T19:17:35.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.522+0000 7fec4a62a640 1 --2- 172.21.15.45:0/4167434413 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fec30066280 0x7fec30068730 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:35.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.522+0000 7fec4a62a640 1 --2- 172.21.15.45:0/4167434413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec440bfe80 0x7fec440bea20 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:35.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.522+0000 7fec4a62a640 1 --2- 172.21.15.45:0/4167434413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec441489e0 0x7fec4414d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:35.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.522+0000 7fec4a62a640 1 --2- 172.21.15.45:0/4167434413 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fec2c005180 0x7fec44149650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:35.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.522+0000 7fec4a62a640 1 -- 172.21.15.45:0/4167434413 >> 172.21.15.45:0/4167434413 conn(0x7fec440a20d0 msgr2=0x7fec4406cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:35.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.530+0000 7fec4a62a640 1 -- 172.21.15.45:0/4167434413 shutdown_connections 2023-10-03T19:17:35.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.530+0000 7fec4a62a640 1 -- 172.21.15.45:0/4167434413 wait complete. 2023-10-03T19:17:35.556 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:17:35.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.670+0000 7f3f643e8640 1 Processor -- start 2023-10-03T19:17:35.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.670+0000 7f3f643e8640 1 -- start start 2023-10-03T19:17:35.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.670+0000 7f3f643e8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3f5c06cd40 0x7f3f5c14aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:35.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.670+0000 7f3f643e8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f5c147ab0 0x7f3f5c147f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:35.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.670+0000 7f3f643e8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5c0bc430 con 0x7f3f5c0a3670 2023-10-03T19:17:35.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.670+0000 7f3f643e8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f5c0a5db0 con 0x7f3f5c06cd40 2023-10-03T19:17:35.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.670+0000 7f3f643e8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c148470 con 0x7f3f5c147ab0 2023-10-03T19:17:35.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.670+0000 7f3f62184640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3f5c06cd40 0x7f3f5c14aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:35.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.670+0000 7f3f62184640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3f5c06cd40 0x7f3f5c14aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34836/0 (socket says 172.21.15.45:34836) 2023-10-03T19:17:35.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.670+0000 7f3f62184640 1 -- 172.21.15.45:0/3320488195 learned_addr learned my addr 172.21.15.45:0/3320488195 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:35.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.674+0000 7f3f62985640 1 --2- 172.21.15.45:0/3320488195 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f5c147ab0 0x7f3f5c147f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:35.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.674+0000 7f3f62184640 1 -- 172.21.15.45:0/3320488195 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f5c147ab0 msgr2=0x7f3f5c147f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:35.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.674+0000 7f3f62184640 1 --2- 172.21.15.45:0/3320488195 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f5c147ab0 0x7f3f5c147f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:35.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.674+0000 7f3f62184640 1 -- 172.21.15.45:0/3320488195 >> v1:172.21.15.79:6789/0 conn(0x7f3f5c0a3670 legacy=0x7f3f5c0bbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:35.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.674+0000 7f3f62184640 1 -- 172.21.15.45:0/3320488195 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5c0baf60 con 0x7f3f5c06cd40 2023-10-03T19:17:35.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.674+0000 7f3f62184640 1 --2- 172.21.15.45:0/3320488195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f5c06cd40 0x7f3f5c14aa50 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f3f58009870 tx=0x7f3f5801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c295d894ed4d1f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:35.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.674+0000 7f3f61182640 1 -- 172.21.15.45:0/3320488195 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f580a89b0 con 0x7f3f5c06cd40 2023-10-03T19:17:35.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.674+0000 7f3f61182640 1 -- 172.21.15.45:0/3320488195 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f580a8b10 con 0x7f3f5c06cd40 2023-10-03T19:17:35.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.674+0000 7f3f61182640 1 -- 172.21.15.45:0/3320488195 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f580a8ea0 con 0x7f3f5c06cd40 2023-10-03T19:17:35.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.674+0000 7f3f643e8640 1 -- 172.21.15.45:0/3320488195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f5c06cd40 msgr2=0x7f3f5c14aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:35.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.674+0000 7f3f643e8640 1 --2- 172.21.15.45:0/3320488195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f5c06cd40 0x7f3f5c14aa50 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f3f58009870 tx=0x7f3f5801ecf0 comp rx=0 tx=0).stop 2023-10-03T19:17:35.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.674+0000 7f3f643e8640 1 -- 172.21.15.45:0/3320488195 shutdown_connections 2023-10-03T19:17:35.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.674+0000 7f3f643e8640 1 --2- 172.21.15.45:0/3320488195 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f5c147ab0 0x7f3f5c147f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:35.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.674+0000 7f3f643e8640 1 --2- 172.21.15.45:0/3320488195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f5c06cd40 0x7f3f5c14aa50 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:35.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.674+0000 7f3f643e8640 1 -- 172.21.15.45:0/3320488195 >> 172.21.15.45:0/3320488195 conn(0x7f3f5c0bcf50 msgr2=0x7f3f5c0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:35.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.674+0000 7f3f643e8640 1 -- 172.21.15.45:0/3320488195 shutdown_connections 2023-10-03T19:17:35.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.674+0000 7f3f643e8640 1 -- 172.21.15.45:0/3320488195 wait complete. 2023-10-03T19:17:35.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.678+0000 7f3f643e8640 1 Processor -- start 2023-10-03T19:17:35.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.678+0000 7f3f643e8640 1 -- start start 2023-10-03T19:17:35.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.678+0000 7f3f643e8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f5c06cd40 0x7f3f5c149b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:35.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.678+0000 7f3f643e8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f5c0a3670 0x7f3f5c1e4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:35.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.678+0000 7f3f643e8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f5c147ab0 0x7f3f5c13c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:35.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.678+0000 7f3f643e8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c14cef0 con 0x7f3f5c147ab0 2023-10-03T19:17:35.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.678+0000 7f3f643e8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c071aa0 con 0x7f3f5c06cd40 2023-10-03T19:17:35.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.678+0000 7f3f643e8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c14a0b0 con 0x7f3f5c0a3670 2023-10-03T19:17:35.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.678+0000 7f3f62985640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f5c147ab0 0x7f3f5c13c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:35.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.678+0000 7f3f62985640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f5c147ab0 0x7f3f5c13c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34852/0 (socket says 172.21.15.45:34852) 2023-10-03T19:17:35.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.678+0000 7f3f62985640 1 -- 172.21.15.45:0/201218118 learned_addr learned my addr 172.21.15.45:0/201218118 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:35.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.678+0000 7f3f62184640 1 --2- 172.21.15.45:0/201218118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f5c06cd40 0x7f3f5c149b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:35.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.678+0000 7f3f61983640 1 --2- 172.21.15.45:0/201218118 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f5c0a3670 0x7f3f5c1e4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:35.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.678+0000 7f3f62985640 1 -- 172.21.15.45:0/201218118 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f5c0a3670 msgr2=0x7f3f5c1e4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:35.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.678+0000 7f3f62985640 1 --2- 172.21.15.45:0/201218118 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f5c0a3670 0x7f3f5c1e4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:35.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.678+0000 7f3f62985640 1 -- 172.21.15.45:0/201218118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f5c06cd40 msgr2=0x7f3f5c149b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:35.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.678+0000 7f3f62985640 1 --2- 172.21.15.45:0/201218118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f5c06cd40 0x7f3f5c149b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:35.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.678+0000 7f3f62985640 1 -- 172.21.15.45:0/201218118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f580094d0 con 0x7f3f5c147ab0 2023-10-03T19:17:35.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.678+0000 7f3f62985640 1 --2- 172.21.15.45:0/201218118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f5c147ab0 0x7f3f5c13c5b0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f3f5400cc30 tx=0x7f3f5400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:35.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.678+0000 7f3f52ffd640 1 -- 172.21.15.45:0/201218118 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5400ce40 con 0x7f3f5c147ab0 2023-10-03T19:17:35.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.678+0000 7f3f52ffd640 1 -- 172.21.15.45:0/201218118 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f540039a0 con 0x7f3f5c147ab0 2023-10-03T19:17:35.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.678+0000 7f3f52ffd640 1 -- 172.21.15.45:0/201218118 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f54003d30 con 0x7f3f5c147ab0 2023-10-03T19:17:35.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.678+0000 7f3f643e8640 1 -- 172.21.15.45:0/201218118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f5c0bb520 con 0x7f3f5c147ab0 2023-10-03T19:17:35.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.678+0000 7f3f643e8640 1 -- 172.21.15.45:0/201218118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5c0bb240 con 0x7f3f5c147ab0 2023-10-03T19:17:35.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.678+0000 7f3f643e8640 1 -- 172.21.15.45:0/201218118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f5c0bb800 con 0x7f3f5c147ab0 2023-10-03T19:17:35.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.678+0000 7f3f52ffd640 1 -- 172.21.15.45:0/201218118 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3f54003e90 con 0x7f3f5c147ab0 2023-10-03T19:17:35.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.682+0000 7f3f52ffd640 1 --2- 172.21.15.45:0/201218118 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3f40066280 0x7f3f40068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:35.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.682+0000 7f3f52ffd640 1 -- 172.21.15.45:0/201218118 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3f54084620 con 0x7f3f5c147ab0 2023-10-03T19:17:35.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.682+0000 7f3f62184640 1 --2- 172.21.15.45:0/201218118 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3f40066280 0x7f3f40068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:35.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.682+0000 7f3f62184640 1 --2- 172.21.15.45:0/201218118 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3f40066280 0x7f3f40068730 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3f580b2000 tx=0x7f3f58008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:35.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.686+0000 7f3f52ffd640 1 -- 172.21.15.45:0/201218118 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3f540519f0 con 0x7f3f5c147ab0 2023-10-03T19:17:35.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.842+0000 7f3f643e8640 1 -- 172.21.15.45:0/201218118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f5c04de80 con 0x7f3f5c147ab0 2023-10-03T19:17:35.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.842+0000 7f3f52ffd640 1 -- 172.21.15.45:0/201218118 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+18319 (secure 0 0 0) 0x7f3f5401d070 con 0x7f3f5c147ab0 2023-10-03T19:17:35.999 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:17:35.999 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":73,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:17:35.496280+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:17:33.484274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-03T19:17:34.320341+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:17:36.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.846+0000 7f3f643e8640 1 -- 172.21.15.45:0/201218118 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3f40066280 msgr2=0x7f3f40068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:36.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.846+0000 7f3f643e8640 1 --2- 172.21.15.45:0/201218118 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3f40066280 0x7f3f40068730 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3f580b2000 tx=0x7f3f58008040 comp rx=0 tx=0).stop 2023-10-03T19:17:36.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.846+0000 7f3f643e8640 1 -- 172.21.15.45:0/201218118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f5c147ab0 msgr2=0x7f3f5c13c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:36.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.846+0000 7f3f643e8640 1 --2- 172.21.15.45:0/201218118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f5c147ab0 0x7f3f5c13c5b0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f3f5400cc30 tx=0x7f3f5400a5c0 comp rx=0 tx=0).stop 2023-10-03T19:17:36.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.846+0000 7f3f643e8640 1 -- 172.21.15.45:0/201218118 shutdown_connections 2023-10-03T19:17:36.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.846+0000 7f3f643e8640 1 --2- 172.21.15.45:0/201218118 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3f40066280 0x7f3f40068730 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:36.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.846+0000 7f3f643e8640 1 --2- 172.21.15.45:0/201218118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f5c147ab0 0x7f3f5c13c5b0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:36.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.846+0000 7f3f643e8640 1 --2- 172.21.15.45:0/201218118 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f5c0a3670 0x7f3f5c1e4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:36.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.846+0000 7f3f643e8640 1 --2- 172.21.15.45:0/201218118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f5c06cd40 0x7f3f5c149b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:36.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.846+0000 7f3f643e8640 1 -- 172.21.15.45:0/201218118 >> 172.21.15.45:0/201218118 conn(0x7f3f5c0bcf50 msgr2=0x7f3f5c0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:36.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.846+0000 7f3f643e8640 1 -- 172.21.15.45:0/201218118 shutdown_connections 2023-10-03T19:17:36.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:35.846+0000 7f3f643e8640 1 -- 172.21.15.45:0/201218118 wait complete. 2023-10-03T19:17:36.067 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:17:36.068 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-03T19:17:35.902+0000 7f5ab1721640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-03T19:17:36.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.198+0000 7f10e0f43640 1 Processor -- start 2023-10-03T19:17:36.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.198+0000 7f10e0f43640 1 -- start start 2023-10-03T19:17:36.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.202+0000 7f10e0f43640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f10dc06f170 0x7f10dc150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:36.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.202+0000 7f10e0f43640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f10dc0bc8b0 0x7f10dc14ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:36.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.202+0000 7f10e0f43640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f10dc06d170 0x7f10dc14cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:36.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.202+0000 7f10e0f43640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10dc06cac0 con 0x7f10dc0bc8b0 2023-10-03T19:17:36.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.202+0000 7f10e0f43640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10dc14d4f0 con 0x7f10dc06f170 2023-10-03T19:17:36.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.202+0000 7f10e0f43640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc0720d0 con 0x7f10dc06d170 2023-10-03T19:17:36.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.202+0000 7f10d9d9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f10dc0bc8b0 0x7f10dc14ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:36.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.202+0000 7f10d9d9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f10dc0bc8b0 0x7f10dc14ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34858/0 (socket says 172.21.15.45:34858) 2023-10-03T19:17:36.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.202+0000 7f10d9d9b640 1 -- 172.21.15.45:0/1800880887 learned_addr learned my addr 172.21.15.45:0/1800880887 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:36.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.202+0000 7f10da59c640 1 --2- 172.21.15.45:0/1800880887 >> v2:172.21.15.79:3300/0 conn(0x7f10dc06f170 0x7f10dc150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:36.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.202+0000 7f10dad9d640 1 --2- 172.21.15.45:0/1800880887 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f10dc06d170 0x7f10dc14cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:36.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.202+0000 7f10d9d9b640 1 -- 172.21.15.45:0/1800880887 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f10dc06d170 msgr2=0x7f10dc14cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:36.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.202+0000 7f10d9d9b640 1 --2- 172.21.15.45:0/1800880887 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f10dc06d170 0x7f10dc14cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:36.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.202+0000 7f10d9d9b640 1 -- 172.21.15.45:0/1800880887 >> v2:172.21.15.79:3300/0 conn(0x7f10dc06f170 msgr2=0x7f10dc150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:36.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.202+0000 7f10d9d9b640 1 --2- 172.21.15.45:0/1800880887 >> v2:172.21.15.79:3300/0 conn(0x7f10dc06f170 0x7f10dc150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:36.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.202+0000 7f10d9d9b640 1 -- 172.21.15.45:0/1800880887 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10dc0a5ab0 con 0x7f10dc0bc8b0 2023-10-03T19:17:36.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.202+0000 7f10da59c640 1 --2- 172.21.15.45:0/1800880887 >> v2:172.21.15.79:3300/0 conn(0x7f10dc06f170 0x7f10dc150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:17:36.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.202+0000 7f10d9d9b640 1 --2- 172.21.15.45:0/1800880887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10dc0bc8b0 0x7f10dc14ca70 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0bdf90 tx=0x7f10d001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc8b679e5658f85 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:36.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.202+0000 7f10d959a640 1 -- 172.21.15.45:0/1800880887 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d00a89b0 con 0x7f10dc0bc8b0 2023-10-03T19:17:36.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.202+0000 7f10d959a640 1 -- 172.21.15.45:0/1800880887 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d00a8b10 con 0x7f10dc0bc8b0 2023-10-03T19:17:36.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.202+0000 7f10d959a640 1 -- 172.21.15.45:0/1800880887 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d00a8ea0 con 0x7f10dc0bc8b0 2023-10-03T19:17:36.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.202+0000 7f10e0f43640 1 -- 172.21.15.45:0/1800880887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10dc0bc8b0 msgr2=0x7f10dc14ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:36.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.202+0000 7f10e0f43640 1 --2- 172.21.15.45:0/1800880887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10dc0bc8b0 0x7f10dc14ca70 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0bdf90 tx=0x7f10d001ecf0 comp rx=0 tx=0).stop 2023-10-03T19:17:36.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.202+0000 7f10e0f43640 1 -- 172.21.15.45:0/1800880887 shutdown_connections 2023-10-03T19:17:36.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.202+0000 7f10e0f43640 1 --2- 172.21.15.45:0/1800880887 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f10dc06d170 0x7f10dc14cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:36.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.206+0000 7f10e0f43640 1 --2- 172.21.15.45:0/1800880887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10dc0bc8b0 0x7f10dc14ca70 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:36.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.206+0000 7f10e0f43640 1 --2- 172.21.15.45:0/1800880887 >> v2:172.21.15.79:3300/0 conn(0x7f10dc06f170 0x7f10dc150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:36.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.206+0000 7f10e0f43640 1 -- 172.21.15.45:0/1800880887 >> 172.21.15.45:0/1800880887 conn(0x7f10dc0bcf50 msgr2=0x7f10dc0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:36.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.206+0000 7f10e0f43640 1 -- 172.21.15.45:0/1800880887 shutdown_connections 2023-10-03T19:17:36.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.206+0000 7f10e0f43640 1 -- 172.21.15.45:0/1800880887 wait complete. 2023-10-03T19:17:36.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.206+0000 7f10e0f43640 1 Processor -- start 2023-10-03T19:17:36.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.206+0000 7f10e0f43640 1 -- start start 2023-10-03T19:17:36.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.206+0000 7f10e0f43640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f10dc06d170 0x7f10dc145400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:36.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.206+0000 7f10e0f43640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10dc06f170 0x7f10dc0b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:36.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.206+0000 7f10e0f43640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10dc0bc8b0 0x7f10dc0a39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:36.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.206+0000 7f10e0f43640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc1e4560 con 0x7f10dc0bc8b0 2023-10-03T19:17:36.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.206+0000 7f10e0f43640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc1e4a90 con 0x7f10dc06f170 2023-10-03T19:17:36.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.206+0000 7f10e0f43640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc143430 con 0x7f10dc06d170 2023-10-03T19:17:36.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.206+0000 7f10dad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10dc0bc8b0 0x7f10dc0a39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:36.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.206+0000 7f10dad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10dc0bc8b0 0x7f10dc0a39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34874/0 (socket says 172.21.15.45:34874) 2023-10-03T19:17:36.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.206+0000 7f10dad9d640 1 -- 172.21.15.45:0/1170064377 learned_addr learned my addr 172.21.15.45:0/1170064377 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:36.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.206+0000 7f10da59c640 1 --2- 172.21.15.45:0/1170064377 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f10dc06d170 0x7f10dc145400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:36.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.206+0000 7f10d9d9b640 1 --2- 172.21.15.45:0/1170064377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10dc06f170 0x7f10dc0b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:36.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.206+0000 7f10dad9d640 1 -- 172.21.15.45:0/1170064377 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f10dc06d170 msgr2=0x7f10dc145400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:36.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.206+0000 7f10dad9d640 1 --2- 172.21.15.45:0/1170064377 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f10dc06d170 0x7f10dc145400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:36.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.206+0000 7f10dad9d640 1 -- 172.21.15.45:0/1170064377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10dc06f170 msgr2=0x7f10dc0b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:36.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.206+0000 7f10dad9d640 1 --2- 172.21.15.45:0/1170064377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10dc06f170 0x7f10dc0b9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:36.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.206+0000 7f10dad9d640 1 -- 172.21.15.45:0/1170064377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d00094d0 con 0x7f10dc0bc8b0 2023-10-03T19:17:36.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.206+0000 7f10dad9d640 1 --2- 172.21.15.45:0/1170064377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10dc0bc8b0 0x7f10dc0a39a0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f10d4007d20 tx=0x7f10d400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:36.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.206+0000 7f10caffd640 1 -- 172.21.15.45:0/1170064377 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d4014420 con 0x7f10dc0bc8b0 2023-10-03T19:17:36.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.206+0000 7f10caffd640 1 -- 172.21.15.45:0/1170064377 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d40145a0 con 0x7f10dc0bc8b0 2023-10-03T19:17:36.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.206+0000 7f10e0f43640 1 -- 172.21.15.45:0/1170064377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10dc14fae0 con 0x7f10dc0bc8b0 2023-10-03T19:17:36.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.206+0000 7f10caffd640 1 -- 172.21.15.45:0/1170064377 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d4014950 con 0x7f10dc0bc8b0 2023-10-03T19:17:36.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.206+0000 7f10e0f43640 1 -- 172.21.15.45:0/1170064377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10dc06cd00 con 0x7f10dc0bc8b0 2023-10-03T19:17:36.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.206+0000 7f10e0f43640 1 -- 172.21.15.45:0/1170064377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10dc06d660 con 0x7f10dc0bc8b0 2023-10-03T19:17:36.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.210+0000 7f10caffd640 1 -- 172.21.15.45:0/1170064377 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f10d4014ab0 con 0x7f10dc0bc8b0 2023-10-03T19:17:36.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.210+0000 7f10caffd640 1 --2- 172.21.15.45:0/1170064377 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f10bc0662b0 0x7f10bc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:36.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.210+0000 7f10caffd640 1 -- 172.21.15.45:0/1170064377 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f10d40845d0 con 0x7f10dc0bc8b0 2023-10-03T19:17:36.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.210+0000 7f10da59c640 1 --2- 172.21.15.45:0/1170064377 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f10bc0662b0 0x7f10bc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:36.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.210+0000 7f10da59c640 1 --2- 172.21.15.45:0/1170064377 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f10bc0662b0 0x7f10bc068760 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f10cc00c900 tx=0x7f10cc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:36.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.214+0000 7f10caffd640 1 -- 172.21.15.45:0/1170064377 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f10d4051a50 con 0x7f10dc0bc8b0 2023-10-03T19:17:36.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.366+0000 7f10e0f43640 1 -- 172.21.15.45:0/1170064377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10dc14c480 con 0x7f10dc0bc8b0 2023-10-03T19:17:36.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.370+0000 7f10caffd640 1 -- 172.21.15.45:0/1170064377 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+18319 (secure 0 0 0) 0x7f10d4055070 con 0x7f10dc0bc8b0 2023-10-03T19:17:36.547 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:17:36.547 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":73,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:17:35.496280+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:17:33.484274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-03T19:17:34.320341+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:17:36.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.370+0000 7f10e0f43640 1 -- 172.21.15.45:0/1170064377 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f10bc0662b0 msgr2=0x7f10bc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:36.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.370+0000 7f10e0f43640 1 --2- 172.21.15.45:0/1170064377 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f10bc0662b0 0x7f10bc068760 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f10cc00c900 tx=0x7f10cc008040 comp rx=0 tx=0).stop 2023-10-03T19:17:36.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.370+0000 7f10e0f43640 1 -- 172.21.15.45:0/1170064377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10dc0bc8b0 msgr2=0x7f10dc0a39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:36.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.370+0000 7f10e0f43640 1 --2- 172.21.15.45:0/1170064377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10dc0bc8b0 0x7f10dc0a39a0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f10d4007d20 tx=0x7f10d400e4b0 comp rx=0 tx=0).stop 2023-10-03T19:17:36.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.370+0000 7f10e0f43640 1 -- 172.21.15.45:0/1170064377 shutdown_connections 2023-10-03T19:17:36.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.370+0000 7f10e0f43640 1 --2- 172.21.15.45:0/1170064377 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f10bc0662b0 0x7f10bc068760 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:36.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.370+0000 7f10e0f43640 1 --2- 172.21.15.45:0/1170064377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10dc0bc8b0 0x7f10dc0a39a0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:36.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.370+0000 7f10e0f43640 1 --2- 172.21.15.45:0/1170064377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10dc06f170 0x7f10dc0b9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:36.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.370+0000 7f10e0f43640 1 --2- 172.21.15.45:0/1170064377 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f10dc06d170 0x7f10dc145400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:36.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.370+0000 7f10e0f43640 1 -- 172.21.15.45:0/1170064377 >> 172.21.15.45:0/1170064377 conn(0x7f10dc0bcf50 msgr2=0x7f10dc0bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:36.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.370+0000 7f10e0f43640 1 -- 172.21.15.45:0/1170064377 shutdown_connections 2023-10-03T19:17:36.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.370+0000 7f10e0f43640 1 -- 172.21.15.45:0/1170064377 wait complete. 2023-10-03T19:17:36.550 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-03T19:17:36.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b5e7fc640 1 Processor -- start 2023-10-03T19:17:36.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b5e7fc640 1 -- start start 2023-10-03T19:17:36.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b5e7fc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b5806c1b0 0x7f4b5814f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:36.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b5e7fc640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b580bcf80 con 0x7f4b5806d630 2023-10-03T19:17:36.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b5e7fc640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b580bd260 con 0x7f4b58148540 2023-10-03T19:17:36.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b5e7fc640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b58152b50 con 0x7f4b5806c1b0 2023-10-03T19:17:36.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b577fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4b5806d630 0x7f4b5814e9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35066/0 (socket says 172.21.15.45:35066) 2023-10-03T19:17:36.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b577fe640 1 -- 172.21.15.45:0/3957272250 learned_addr learned my addr 172.21.15.45:0/3957272250 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:36.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b5cd99640 1 --2- 172.21.15.45:0/3957272250 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b5806c1b0 0x7f4b5814f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:36.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b56ffd640 1 -- 172.21.15.45:0/3957272250 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263715965 0 0) 0x7f4b580bcf80 con 0x7f4b5806d630 2023-10-03T19:17:36.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b56ffd640 1 -- 172.21.15.45:0/3957272250 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b40003530 con 0x7f4b5806d630 2023-10-03T19:17:36.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b56ffd640 1 -- 172.21.15.45:0/3957272250 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 59143591 0 0) 0x7f4b40003530 con 0x7f4b5806d630 2023-10-03T19:17:36.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b56ffd640 1 -- 172.21.15.45:0/3957272250 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b5806c1b0 msgr2=0x7f4b5814f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:36.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b56ffd640 1 --2- 172.21.15.45:0/3957272250 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b5806c1b0 0x7f4b5814f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:36.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b56ffd640 1 -- 172.21.15.45:0/3957272250 >> v1:172.21.15.79:6789/0 conn(0x7f4b58148540 legacy=0x7f4b580bb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:36.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b56ffd640 1 -- 172.21.15.45:0/3957272250 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b580bd540 con 0x7f4b5806d630 2023-10-03T19:17:36.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b56ffd640 1 -- 172.21.15.45:0/3957272250 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f4b4c001680 con 0x7f4b5806d630 2023-10-03T19:17:36.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b56ffd640 1 -- 172.21.15.45:0/3957272250 >> v1:172.21.15.45:6789/0 conn(0x7f4b5806d630 legacy=0x7f4b5814e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:36.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b56ffd640 1 --2- 172.21.15.45:0/3957272250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b400039b0 0x7f4b40003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:36.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b56ffd640 1 --2- 172.21.15.45:0/3957272250 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b5806c1b0 0x7f4b400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:36.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b56ffd640 1 --2- 172.21.15.45:0/3957272250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b40004d10 0x7f4b40005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:36.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b56ffd640 1 -- 172.21.15.45:0/3957272250 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b58152b50 con 0x7f4b400039b0 2023-10-03T19:17:36.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b56ffd640 1 -- 172.21.15.45:0/3957272250 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4000ba40 con 0x7f4b40004d10 2023-10-03T19:17:36.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b56ffd640 1 -- 172.21.15.45:0/3957272250 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4000bbd0 con 0x7f4b5806c1b0 2023-10-03T19:17:36.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b57fff640 1 --2- 172.21.15.45:0/3957272250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b400039b0 0x7f4b40003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:36.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b5cd99640 1 --2- 172.21.15.45:0/3957272250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b40004d10 0x7f4b40005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:36.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b577fe640 1 --2- 172.21.15.45:0/3957272250 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b5806c1b0 0x7f4b400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:36.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b57fff640 1 -- 172.21.15.45:0/3957272250 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b5806c1b0 msgr2=0x7f4b400047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:36.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b57fff640 1 --2- 172.21.15.45:0/3957272250 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b5806c1b0 0x7f4b400047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:36.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b57fff640 1 -- 172.21.15.45:0/3957272250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b40004d10 msgr2=0x7f4b40005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:36.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b57fff640 1 --2- 172.21.15.45:0/3957272250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b40004d10 0x7f4b40005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:36.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b57fff640 1 -- 172.21.15.45:0/3957272250 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b40003530 con 0x7f4b400039b0 2023-10-03T19:17:36.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.690+0000 7f4b5cd99640 1 --2- 172.21.15.45:0/3957272250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b40004d10 0x7f4b40005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:36.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.694+0000 7f4b57fff640 1 --2- 172.21.15.45:0/3957272250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b400039b0 0x7f4b40003dc0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f4b48001780 tx=0x7f4b4801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d306d0ef7cef566 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:36.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.694+0000 7f4b56ffd640 1 -- 172.21.15.45:0/3957272250 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b480052d0 con 0x7f4b400039b0 2023-10-03T19:17:36.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.694+0000 7f4b56ffd640 1 -- 172.21.15.45:0/3957272250 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b480a7050 con 0x7f4b400039b0 2023-10-03T19:17:36.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.694+0000 7f4b56ffd640 1 -- 172.21.15.45:0/3957272250 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b48003600 con 0x7f4b400039b0 2023-10-03T19:17:36.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.694+0000 7f4b5e7fc640 1 -- 172.21.15.45:0/3957272250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b400039b0 msgr2=0x7f4b40003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:36.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.694+0000 7f4b5e7fc640 1 --2- 172.21.15.45:0/3957272250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b400039b0 0x7f4b40003dc0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f4b48001780 tx=0x7f4b4801c400 comp rx=0 tx=0).stop 2023-10-03T19:17:36.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.694+0000 7f4b5cd99640 1 -- 172.21.15.45:0/3957272250 reap_dead start 2023-10-03T19:17:36.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.694+0000 7f4b5e7fc640 1 -- 172.21.15.45:0/3957272250 shutdown_connections 2023-10-03T19:17:36.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.694+0000 7f4b5e7fc640 1 -- 172.21.15.45:0/3957272250 >> 172.21.15.45:0/3957272250 conn(0x7f4b580a20d0 msgr2=0x7f4b580a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:36.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.694+0000 7f4b5e7fc640 1 -- 172.21.15.45:0/3957272250 shutdown_connections 2023-10-03T19:17:36.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.694+0000 7f4b5e7fc640 1 -- 172.21.15.45:0/3957272250 wait complete. 2023-10-03T19:17:36.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.694+0000 7f4b5e7fc640 1 Processor -- start 2023-10-03T19:17:36.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.694+0000 7f4b5e7fc640 1 -- start start 2023-10-03T19:17:36.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.698+0000 7f4b5e7fc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b400039b0 0x7f4b580bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:36.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.698+0000 7f4b5e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b5814ab60 0x7f4b580a5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:36.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.698+0000 7f4b5e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b580a5ff0 0x7f4b58150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:36.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.698+0000 7f4b5e7fc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b58146080 con 0x7f4b5814ab60 2023-10-03T19:17:36.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.698+0000 7f4b5e7fc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b58152420 con 0x7f4b580a5ff0 2023-10-03T19:17:36.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.698+0000 7f4b5e7fc640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b58145bf0 con 0x7f4b400039b0 2023-10-03T19:17:36.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.698+0000 7f4b577fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b5814ab60 0x7f4b580a5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:36.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.698+0000 7f4b577fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b5814ab60 0x7f4b580a5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34898/0 (socket says 172.21.15.45:34898) 2023-10-03T19:17:36.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.698+0000 7f4b577fe640 1 -- 172.21.15.45:0/350159094 learned_addr learned my addr 172.21.15.45:0/350159094 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:36.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.698+0000 7f4b57fff640 1 --2- 172.21.15.45:0/350159094 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b400039b0 0x7f4b580bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:36.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.698+0000 7f4b5cd99640 1 --2- 172.21.15.45:0/350159094 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b580a5ff0 0x7f4b58150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:36.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.698+0000 7f4b577fe640 1 -- 172.21.15.45:0/350159094 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b400039b0 msgr2=0x7f4b580bfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:36.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.698+0000 7f4b577fe640 1 --2- 172.21.15.45:0/350159094 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b400039b0 0x7f4b580bfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:36.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.698+0000 7f4b577fe640 1 -- 172.21.15.45:0/350159094 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b580a5ff0 msgr2=0x7f4b58150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:36.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.698+0000 7f4b577fe640 1 --2- 172.21.15.45:0/350159094 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b580a5ff0 0x7f4b58150c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:36.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.698+0000 7f4b577fe640 1 -- 172.21.15.45:0/350159094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b580bdda0 con 0x7f4b5814ab60 2023-10-03T19:17:36.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.698+0000 7f4b577fe640 1 --2- 172.21.15.45:0/350159094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b5814ab60 0x7f4b580a5ab0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00d7a0 tx=0x7f4b4c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:36.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.698+0000 7f4b54ff9640 1 -- 172.21.15.45:0/350159094 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c0072d0 con 0x7f4b5814ab60 2023-10-03T19:17:36.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.698+0000 7f4b54ff9640 1 -- 172.21.15.45:0/350159094 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4c007430 con 0x7f4b5814ab60 2023-10-03T19:17:36.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.698+0000 7f4b5e7fc640 1 -- 172.21.15.45:0/350159094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b580bdc10 con 0x7f4b5814ab60 2023-10-03T19:17:36.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.698+0000 7f4b54ff9640 1 -- 172.21.15.45:0/350159094 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c0047f0 con 0x7f4b5814ab60 2023-10-03T19:17:36.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.698+0000 7f4b5e7fc640 1 -- 172.21.15.45:0/350159094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5815a6f0 con 0x7f4b5814ab60 2023-10-03T19:17:36.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.698+0000 7f4b5e7fc640 1 -- 172.21.15.45:0/350159094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b58145e30 con 0x7f4b5814ab60 2023-10-03T19:17:36.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.698+0000 7f4b54ff9640 1 -- 172.21.15.45:0/350159094 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4b4c004950 con 0x7f4b5814ab60 2023-10-03T19:17:36.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.698+0000 7f4b54ff9640 1 --2- 172.21.15.45:0/350159094 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4b440662b0 0x7f4b44068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:36.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.698+0000 7f4b54ff9640 1 -- 172.21.15.45:0/350159094 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4b4c0837f0 con 0x7f4b5814ab60 2023-10-03T19:17:36.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.698+0000 7f4b57fff640 1 --2- 172.21.15.45:0/350159094 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4b440662b0 0x7f4b44068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:36.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.702+0000 7f4b57fff640 1 --2- 172.21.15.45:0/350159094 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4b440662b0 0x7f4b44068760 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4b48001750 tx=0x7f4b480011a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:36.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.702+0000 7f4b54ff9640 1 -- 172.21.15.45:0/350159094 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4b58145e30 con 0x7f4b5814ab60 2023-10-03T19:17:36.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:36.894+0000 7f4b5e7fc640 1 -- 172.21.15.45:0/350159094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4b581e71f0 con 0x7f4b5814ab60 2023-10-03T19:17:37.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.510+0000 7f4b54ff9640 1 -- 172.21.15.45:0/350159094 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v35) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4b581e71f0 con 0x7f4b5814ab60 2023-10-03T19:17:37.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.514+0000 7f4b5e7fc640 1 -- 172.21.15.45:0/350159094 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4b440662b0 msgr2=0x7f4b44068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:37.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.514+0000 7f4b5e7fc640 1 --2- 172.21.15.45:0/350159094 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4b440662b0 0x7f4b44068760 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4b48001750 tx=0x7f4b480011a0 comp rx=0 tx=0).stop 2023-10-03T19:17:37.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.514+0000 7f4b5e7fc640 1 -- 172.21.15.45:0/350159094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b5814ab60 msgr2=0x7f4b580a5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:37.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.514+0000 7f4b5e7fc640 1 --2- 172.21.15.45:0/350159094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b5814ab60 0x7f4b580a5ab0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00d7a0 tx=0x7f4b4c00dc60 comp rx=0 tx=0).stop 2023-10-03T19:17:37.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.514+0000 7f4b5e7fc640 1 -- 172.21.15.45:0/350159094 shutdown_connections 2023-10-03T19:17:37.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.514+0000 7f4b5e7fc640 1 --2- 172.21.15.45:0/350159094 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4b440662b0 0x7f4b44068760 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:37.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.514+0000 7f4b5e7fc640 1 --2- 172.21.15.45:0/350159094 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b580a5ff0 0x7f4b58150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:37.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.514+0000 7f4b5e7fc640 1 --2- 172.21.15.45:0/350159094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b5814ab60 0x7f4b580a5ab0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:37.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.514+0000 7f4b5e7fc640 1 --2- 172.21.15.45:0/350159094 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b400039b0 0x7f4b580bfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:37.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.514+0000 7f4b5e7fc640 1 -- 172.21.15.45:0/350159094 >> 172.21.15.45:0/350159094 conn(0x7f4b580a20d0 msgr2=0x7f4b58147a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:37.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.514+0000 7f4b5e7fc640 1 -- 172.21.15.45:0/350159094 shutdown_connections 2023-10-03T19:17:37.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.514+0000 7f4b5e7fc640 1 -- 172.21.15.45:0/350159094 wait complete. 2023-10-03T19:17:37.541 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-03T19:17:37.541 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-03T19:17:37.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.674+0000 7f602b1a5640 1 Processor -- start 2023-10-03T19:17:37.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.674+0000 7f602b1a5640 1 -- start start 2023-10-03T19:17:37.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.674+0000 7f602b1a5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f60240c07f0 0x7f60240bd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:37.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.674+0000 7f602b1a5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f602414fa20 0x7f602414fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:37.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.674+0000 7f602b1a5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60240c14c0 con 0x7f60240c19b0 2023-10-03T19:17:37.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.674+0000 7f602b1a5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60240be420 con 0x7f602414fa20 2023-10-03T19:17:37.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.674+0000 7f602b1a5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60240a1f80 con 0x7f60240c07f0 2023-10-03T19:17:37.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.674+0000 7f6023fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f60240c19b0 0x7f602414bab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35082/0 (socket says 172.21.15.45:35082) 2023-10-03T19:17:37.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.674+0000 7f6023fff640 1 -- 172.21.15.45:0/700512966 learned_addr learned my addr 172.21.15.45:0/700512966 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:37.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.674+0000 7f6029742640 1 --2- 172.21.15.45:0/700512966 >> v2:172.21.15.45:3300/0 conn(0x7f602414fa20 0x7f602414fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:37.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.674+0000 7f6028f41640 1 --2- 172.21.15.45:0/700512966 >> v2:172.21.15.79:3300/0 conn(0x7f60240c07f0 0x7f60240bd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:37.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.674+0000 7f60237fe640 1 -- 172.21.15.45:0/700512966 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2625314475 0 0) 0x7f60240c14c0 con 0x7f60240c19b0 2023-10-03T19:17:37.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.674+0000 7f60237fe640 1 -- 172.21.15.45:0/700512966 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f600c003530 con 0x7f60240c19b0 2023-10-03T19:17:37.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.674+0000 7f6029742640 1 -- 172.21.15.45:0/700512966 >> v2:172.21.15.79:3300/0 conn(0x7f60240c07f0 msgr2=0x7f60240bd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:37.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.674+0000 7f6029742640 1 --2- 172.21.15.45:0/700512966 >> v2:172.21.15.79:3300/0 conn(0x7f60240c07f0 0x7f60240bd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:37.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.674+0000 7f6029742640 1 -- 172.21.15.45:0/700512966 >> v1:172.21.15.45:6789/0 conn(0x7f60240c19b0 legacy=0x7f602414bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:37.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.674+0000 7f6029742640 1 -- 172.21.15.45:0/700512966 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60240bd070 con 0x7f602414fa20 2023-10-03T19:17:37.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.674+0000 7f6028f41640 1 --2- 172.21.15.45:0/700512966 >> v2:172.21.15.79:3300/0 conn(0x7f60240c07f0 0x7f60240bd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:17:37.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f6029742640 1 --2- 172.21.15.45:0/700512966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f602414fa20 0x7f602414fe60 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f601c009d90 tx=0x7f601c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a521448fc1b5f68d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:37.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f60237fe640 1 -- 172.21.15.45:0/700512966 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c0a5910 con 0x7f602414fa20 2023-10-03T19:17:37.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f60237fe640 1 -- 172.21.15.45:0/700512966 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601c0a5a70 con 0x7f602414fa20 2023-10-03T19:17:37.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f60237fe640 1 -- 172.21.15.45:0/700512966 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c0a5e00 con 0x7f602414fa20 2023-10-03T19:17:37.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f602b1a5640 1 -- 172.21.15.45:0/700512966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f602414fa20 msgr2=0x7f602414fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:37.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f602b1a5640 1 --2- 172.21.15.45:0/700512966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f602414fa20 0x7f602414fe60 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f601c009d90 tx=0x7f601c01c850 comp rx=0 tx=0).stop 2023-10-03T19:17:37.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f602b1a5640 1 -- 172.21.15.45:0/700512966 shutdown_connections 2023-10-03T19:17:37.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f602b1a5640 1 --2- 172.21.15.45:0/700512966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f602414fa20 0x7f602414fe60 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:37.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f602b1a5640 1 --2- 172.21.15.45:0/700512966 >> v2:172.21.15.79:3300/0 conn(0x7f60240c07f0 0x7f60240bd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:37.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f602b1a5640 1 -- 172.21.15.45:0/700512966 >> 172.21.15.45:0/700512966 conn(0x7f60240a4260 msgr2=0x7f60240a4660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:37.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f602b1a5640 1 -- 172.21.15.45:0/700512966 shutdown_connections 2023-10-03T19:17:37.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f602b1a5640 1 -- 172.21.15.45:0/700512966 wait complete. 2023-10-03T19:17:37.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f602b1a5640 1 Processor -- start 2023-10-03T19:17:37.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f602b1a5640 1 -- start start 2023-10-03T19:17:37.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f602b1a5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f60240c07f0 0x7f60240bbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:37.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f602b1a5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60240c19b0 0x7f60241ea620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:37.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f602b1a5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f602414fa20 0x7f60241e66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:37.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f602b1a5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602406bb00 con 0x7f60240c19b0 2023-10-03T19:17:37.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f602b1a5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60240a72b0 con 0x7f602414fa20 2023-10-03T19:17:37.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f602b1a5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6024148e20 con 0x7f60240c07f0 2023-10-03T19:17:37.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f6023fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60240c19b0 0x7f60241ea620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:37.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f6023fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60240c19b0 0x7f60241ea620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34916/0 (socket says 172.21.15.45:34916) 2023-10-03T19:17:37.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f6023fff640 1 -- 172.21.15.45:0/1188329774 learned_addr learned my addr 172.21.15.45:0/1188329774 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:37.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f6029742640 1 --2- 172.21.15.45:0/1188329774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f602414fa20 0x7f60241e66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:37.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f6023fff640 1 -- 172.21.15.45:0/1188329774 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f60240c07f0 msgr2=0x7f60240bbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:37.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f6028f41640 1 --2- 172.21.15.45:0/1188329774 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f60240c07f0 0x7f60240bbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:37.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f6023fff640 1 --2- 172.21.15.45:0/1188329774 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f60240c07f0 0x7f60240bbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:37.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f6023fff640 1 -- 172.21.15.45:0/1188329774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f602414fa20 msgr2=0x7f60241e66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:37.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f6023fff640 1 --2- 172.21.15.45:0/1188329774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f602414fa20 0x7f60241e66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:37.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f6023fff640 1 -- 172.21.15.45:0/1188329774 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601c009a70 con 0x7f60240c19b0 2023-10-03T19:17:37.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f6029742640 1 --2- 172.21.15.45:0/1188329774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f602414fa20 0x7f60241e66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:37.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f6028f41640 1 --2- 172.21.15.45:0/1188329774 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f60240c07f0 0x7f60240bbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:37.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f6023fff640 1 --2- 172.21.15.45:0/1188329774 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60240c19b0 0x7f60241ea620 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f601800c500 tx=0x7f601800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:37.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.678+0000 7f60217fa640 1 -- 172.21.15.45:0/1188329774 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018005cf0 con 0x7f60240c19b0 2023-10-03T19:17:37.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.682+0000 7f60217fa640 1 -- 172.21.15.45:0/1188329774 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6018005e50 con 0x7f60240c19b0 2023-10-03T19:17:37.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.682+0000 7f60217fa640 1 -- 172.21.15.45:0/1188329774 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60180072f0 con 0x7f60240c19b0 2023-10-03T19:17:37.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.682+0000 7f602b1a5640 1 -- 172.21.15.45:0/1188329774 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60240c0d50 con 0x7f60240c19b0 2023-10-03T19:17:37.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.682+0000 7f602b1a5640 1 -- 172.21.15.45:0/1188329774 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60240c0bc0 con 0x7f60240c19b0 2023-10-03T19:17:37.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.682+0000 7f602b1a5640 1 -- 172.21.15.45:0/1188329774 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602414c1c0 con 0x7f60240c19b0 2023-10-03T19:17:37.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.682+0000 7f60217fa640 1 -- 172.21.15.45:0/1188329774 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6018007450 con 0x7f60240c19b0 2023-10-03T19:17:37.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.682+0000 7f60217fa640 1 --2- 172.21.15.45:0/1188329774 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6010066280 0x7f6010068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:37.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.682+0000 7f60217fa640 1 -- 172.21.15.45:0/1188329774 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f60180831e0 con 0x7f60240c19b0 2023-10-03T19:17:37.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.682+0000 7f6028f41640 1 --2- 172.21.15.45:0/1188329774 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6010066280 0x7f6010068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:37.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.682+0000 7f6028f41640 1 --2- 172.21.15.45:0/1188329774 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6010066280 0x7f6010068730 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6014009980 tx=0x7f6014008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:37.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.686+0000 7f60217fa640 1 -- 172.21.15.45:0/1188329774 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f60180507a0 con 0x7f60240c19b0 2023-10-03T19:17:37.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:37.878+0000 7f602b1a5640 1 -- 172.21.15.45:0/1188329774 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f602404def0 con 0x7f60240c19b0 2023-10-03T19:17:38.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:38.526+0000 7f60217fa640 1 -- 172.21.15.45:0/1188329774 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v36) v1 ==== 122+0+0 (secure 0 0 0) 0x7f602404def0 con 0x7f60240c19b0 2023-10-03T19:17:39.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:38.530+0000 7f602b1a5640 1 -- 172.21.15.45:0/1188329774 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6010066280 msgr2=0x7f6010068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:39.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:38.530+0000 7f602b1a5640 1 --2- 172.21.15.45:0/1188329774 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6010066280 0x7f6010068730 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6014009980 tx=0x7f6014008040 comp rx=0 tx=0).stop 2023-10-03T19:17:39.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:38.530+0000 7f602b1a5640 1 -- 172.21.15.45:0/1188329774 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60240c19b0 msgr2=0x7f60241ea620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:39.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:38.530+0000 7f602b1a5640 1 --2- 172.21.15.45:0/1188329774 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60240c19b0 0x7f60241ea620 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f601800c500 tx=0x7f601800c9c0 comp rx=0 tx=0).stop 2023-10-03T19:17:39.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:38.530+0000 7f602b1a5640 1 -- 172.21.15.45:0/1188329774 shutdown_connections 2023-10-03T19:17:39.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:38.530+0000 7f602b1a5640 1 --2- 172.21.15.45:0/1188329774 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6010066280 0x7f6010068730 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:39.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:38.530+0000 7f602b1a5640 1 --2- 172.21.15.45:0/1188329774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f602414fa20 0x7f60241e66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:39.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:38.530+0000 7f602b1a5640 1 --2- 172.21.15.45:0/1188329774 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60240c19b0 0x7f60241ea620 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:39.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:38.530+0000 7f602b1a5640 1 --2- 172.21.15.45:0/1188329774 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f60240c07f0 0x7f60240bbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:39.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:38.530+0000 7f602b1a5640 1 -- 172.21.15.45:0/1188329774 >> 172.21.15.45:0/1188329774 conn(0x7f60240a4260 msgr2=0x7f60240a4630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:39.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:38.530+0000 7f602b1a5640 1 -- 172.21.15.45:0/1188329774 shutdown_connections 2023-10-03T19:17:39.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:38.530+0000 7f602b1a5640 1 -- 172.21.15.45:0/1188329774 wait complete. 2023-10-03T19:17:39.481 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-03T19:17:39.481 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:17:39.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.618+0000 7fb688aa1640 1 Processor -- start 2023-10-03T19:17:39.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.618+0000 7fb688aa1640 1 -- start start 2023-10-03T19:17:39.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.618+0000 7fb688aa1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6840bcb60 0x7fb68406c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:39.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.618+0000 7fb688aa1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb68406c7d0 0x7fb684155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:39.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.618+0000 7fb688aa1640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb68414b610 con 0x7fb684148b90 2023-10-03T19:17:39.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.618+0000 7fb688aa1640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6840a3670 con 0x7fb68406c7d0 2023-10-03T19:17:39.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.618+0000 7fb688aa1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68414b370 con 0x7fb6840bcb60 2023-10-03T19:17:39.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.618+0000 7fb682d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb68406c7d0 0x7fb684155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:39.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.618+0000 7fb682d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb68406c7d0 0x7fb684155cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34928/0 (socket says 172.21.15.45:34928) 2023-10-03T19:17:39.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.618+0000 7fb682d9d640 1 -- 172.21.15.45:0/1900046666 learned_addr learned my addr 172.21.15.45:0/1900046666 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:39.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.618+0000 7fb67bfff640 1 --2- 172.21.15.45:0/1900046666 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6840bcb60 0x7fb68406c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:39.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.618+0000 7fb682d9d640 1 -- 172.21.15.45:0/1900046666 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6840bcb60 msgr2=0x7fb68406c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:39.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.618+0000 7fb682d9d640 1 --2- 172.21.15.45:0/1900046666 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6840bcb60 0x7fb68406c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:39.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.618+0000 7fb682d9d640 1 -- 172.21.15.45:0/1900046666 >> v1:172.21.15.79:6789/0 conn(0x7fb684148b90 legacy=0x7fb6840bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:39.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.618+0000 7fb682d9d640 1 -- 172.21.15.45:0/1900046666 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6840a5580 con 0x7fb68406c7d0 2023-10-03T19:17:39.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.622+0000 7fb682d9d640 1 --2- 172.21.15.45:0/1900046666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb68406c7d0 0x7fb684155cf0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fb67c009e50 tx=0x7fb67c01f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f4a7b29c88fd28b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:39.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.622+0000 7fb681d9b640 1 -- 172.21.15.45:0/1900046666 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c0af400 con 0x7fb68406c7d0 2023-10-03T19:17:39.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.622+0000 7fb681d9b640 1 -- 172.21.15.45:0/1900046666 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67c0ab050 con 0x7fb68406c7d0 2023-10-03T19:17:39.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.622+0000 7fb681d9b640 1 -- 172.21.15.45:0/1900046666 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c0af780 con 0x7fb68406c7d0 2023-10-03T19:17:39.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.622+0000 7fb688aa1640 1 -- 172.21.15.45:0/1900046666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb68406c7d0 msgr2=0x7fb684155cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:39.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.622+0000 7fb688aa1640 1 --2- 172.21.15.45:0/1900046666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb68406c7d0 0x7fb684155cf0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fb67c009e50 tx=0x7fb67c01f1f0 comp rx=0 tx=0).stop 2023-10-03T19:17:39.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.622+0000 7fb688aa1640 1 -- 172.21.15.45:0/1900046666 shutdown_connections 2023-10-03T19:17:39.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.622+0000 7fb688aa1640 1 --2- 172.21.15.45:0/1900046666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb68406c7d0 0x7fb684155cf0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:39.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.622+0000 7fb688aa1640 1 --2- 172.21.15.45:0/1900046666 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6840bcb60 0x7fb68406c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:39.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.622+0000 7fb688aa1640 1 -- 172.21.15.45:0/1900046666 >> 172.21.15.45:0/1900046666 conn(0x7fb6840bcf50 msgr2=0x7fb6840bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:39.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.622+0000 7fb688aa1640 1 -- 172.21.15.45:0/1900046666 shutdown_connections 2023-10-03T19:17:39.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.622+0000 7fb688aa1640 1 -- 172.21.15.45:0/1900046666 wait complete. 2023-10-03T19:17:39.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.622+0000 7fb688aa1640 1 Processor -- start 2023-10-03T19:17:39.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.622+0000 7fb688aa1640 1 -- start start 2023-10-03T19:17:39.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.626+0000 7fb688aa1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb68406c7d0 0x7fb684147d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:39.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.626+0000 7fb688aa1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6840bcb60 0x7fb684152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:39.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.626+0000 7fb688aa1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb684148b90 0x7fb6841e3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:39.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.626+0000 7fb688aa1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb684145660 con 0x7fb684148b90 2023-10-03T19:17:39.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.626+0000 7fb688aa1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68414df60 con 0x7fb6840bcb60 2023-10-03T19:17:39.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.626+0000 7fb688aa1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb684152750 con 0x7fb68406c7d0 2023-10-03T19:17:39.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.626+0000 7fb682d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb684148b90 0x7fb6841e3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:39.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.626+0000 7fb682d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb684148b90 0x7fb6841e3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34938/0 (socket says 172.21.15.45:34938) 2023-10-03T19:17:39.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.626+0000 7fb682d9d640 1 -- 172.21.15.45:0/3634563391 learned_addr learned my addr 172.21.15.45:0/3634563391 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:39.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.626+0000 7fb68259c640 1 --2- 172.21.15.45:0/3634563391 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb68406c7d0 0x7fb684147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:39.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.626+0000 7fb67bfff640 1 --2- 172.21.15.45:0/3634563391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6840bcb60 0x7fb684152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:39.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.626+0000 7fb682d9d640 1 -- 172.21.15.45:0/3634563391 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb68406c7d0 msgr2=0x7fb684147d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:39.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.626+0000 7fb682d9d640 1 --2- 172.21.15.45:0/3634563391 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb68406c7d0 0x7fb684147d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:40.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.626+0000 7fb682d9d640 1 -- 172.21.15.45:0/3634563391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6840bcb60 msgr2=0x7fb684152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:40.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.626+0000 7fb682d9d640 1 --2- 172.21.15.45:0/3634563391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6840bcb60 0x7fb684152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:40.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.626+0000 7fb682d9d640 1 -- 172.21.15.45:0/3634563391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67c009b30 con 0x7fb684148b90 2023-10-03T19:17:40.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.626+0000 7fb682d9d640 1 --2- 172.21.15.45:0/3634563391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb684148b90 0x7fb6841e3580 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fb67c01ce20 tx=0x7fb67c01bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:40.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.626+0000 7fb67affd640 1 -- 172.21.15.45:0/3634563391 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c0afde0 con 0x7fb684148b90 2023-10-03T19:17:40.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.626+0000 7fb67affd640 1 -- 172.21.15.45:0/3634563391 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67c009510 con 0x7fb684148b90 2023-10-03T19:17:40.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.626+0000 7fb688aa1640 1 -- 172.21.15.45:0/3634563391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6840bc670 con 0x7fb684148b90 2023-10-03T19:17:40.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.626+0000 7fb67affd640 1 -- 172.21.15.45:0/3634563391 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c0ba680 con 0x7fb684148b90 2023-10-03T19:17:40.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.626+0000 7fb688aa1640 1 -- 172.21.15.45:0/3634563391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6840a5820 con 0x7fb684148b90 2023-10-03T19:17:40.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.626+0000 7fb688aa1640 1 -- 172.21.15.45:0/3634563391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb684148f60 con 0x7fb684148b90 2023-10-03T19:17:40.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.626+0000 7fb67affd640 1 -- 172.21.15.45:0/3634563391 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb67c0b6040 con 0x7fb684148b90 2023-10-03T19:17:40.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.630+0000 7fb67affd640 1 --2- 172.21.15.45:0/3634563391 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb664066280 0x7fb664068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:40.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.630+0000 7fb67affd640 1 -- 172.21.15.45:0/3634563391 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb67c122a30 con 0x7fb684148b90 2023-10-03T19:17:40.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.630+0000 7fb68259c640 1 --2- 172.21.15.45:0/3634563391 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb664066280 0x7fb664068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:40.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.630+0000 7fb68259c640 1 --2- 172.21.15.45:0/3634563391 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb664066280 0x7fb664068730 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb674000f70 tx=0x7fb674009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:40.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.630+0000 7fb67affd640 1 -- 172.21.15.45:0/3634563391 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb67c0f0100 con 0x7fb684148b90 2023-10-03T19:17:40.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.818+0000 7fb688aa1640 1 -- 172.21.15.45:0/3634563391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb68404de80 con 0x7fb684148b90 2023-10-03T19:17:40.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.818+0000 7fb67affd640 1 -- 172.21.15.45:0/3634563391 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+3913 (secure 0 0 0) 0x7fb67c0f3720 con 0x7fb684148b90 2023-10-03T19:17:40.089 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:17:40.089 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/250992108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":250992108},{"type":"v1","addr":"172.21.15.79:6835","nonce":250992108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6339,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3153040546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3153040546},{"type":"v1","addr":"172.21.15.45:6834","nonce":3153040546}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:17:35.497011+0000","modified":"2023-10-03T19:17:38.516672+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6342},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6342":{"gid":6342,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/2939002026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2939002026},{"type":"v1","addr":"172.21.15.45:6835","nonce":2939002026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-10-03T19:17:40.090 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 36 2023-10-03T19:17:40.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.818+0000 7fb688aa1640 1 -- 172.21.15.45:0/3634563391 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb664066280 msgr2=0x7fb664068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:40.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.818+0000 7fb688aa1640 1 --2- 172.21.15.45:0/3634563391 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb664066280 0x7fb664068730 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb674000f70 tx=0x7fb674009040 comp rx=0 tx=0).stop 2023-10-03T19:17:40.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.818+0000 7fb688aa1640 1 -- 172.21.15.45:0/3634563391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb684148b90 msgr2=0x7fb6841e3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:40.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.818+0000 7fb688aa1640 1 --2- 172.21.15.45:0/3634563391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb684148b90 0x7fb6841e3580 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fb67c01ce20 tx=0x7fb67c01bf90 comp rx=0 tx=0).stop 2023-10-03T19:17:40.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.818+0000 7fb688aa1640 1 -- 172.21.15.45:0/3634563391 shutdown_connections 2023-10-03T19:17:40.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.818+0000 7fb688aa1640 1 --2- 172.21.15.45:0/3634563391 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb664066280 0x7fb664068730 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:40.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.818+0000 7fb688aa1640 1 --2- 172.21.15.45:0/3634563391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb684148b90 0x7fb6841e3580 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:40.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.818+0000 7fb688aa1640 1 --2- 172.21.15.45:0/3634563391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6840bcb60 0x7fb684152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:40.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.818+0000 7fb688aa1640 1 --2- 172.21.15.45:0/3634563391 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb68406c7d0 0x7fb684147d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:40.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.818+0000 7fb688aa1640 1 -- 172.21.15.45:0/3634563391 >> 172.21.15.45:0/3634563391 conn(0x7fb6840bcf50 msgr2=0x7fb6840bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:40.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.818+0000 7fb688aa1640 1 -- 172.21.15.45:0/3634563391 shutdown_connections 2023-10-03T19:17:40.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:39.818+0000 7fb688aa1640 1 -- 172.21.15.45:0/3634563391 wait complete. 2023-10-03T19:17:40.092 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:17:40.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.218+0000 7f9213f32640 1 Processor -- start 2023-10-03T19:17:40.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.218+0000 7f9213f32640 1 -- start start 2023-10-03T19:17:40.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.222+0000 7f9213f32640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f920c06f170 0x7f920c150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:40.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.222+0000 7f9213f32640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f920c0bc8b0 0x7f920c14ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:40.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.222+0000 7f9213f32640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f920c06cac0 con 0x7f920c06d170 2023-10-03T19:17:40.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.222+0000 7f9213f32640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f920c0720d0 con 0x7f920c0bc8b0 2023-10-03T19:17:40.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.222+0000 7f9213f32640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f920c0a5ab0 con 0x7f920c06f170 2023-10-03T19:17:40.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.222+0000 7f92114cd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f920c0bc8b0 0x7f920c14ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:40.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.222+0000 7f92114cd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f920c0bc8b0 0x7f920c14ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34942/0 (socket says 172.21.15.45:34942) 2023-10-03T19:17:40.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.222+0000 7f92114cd640 1 -- 172.21.15.45:0/1899576564 learned_addr learned my addr 172.21.15.45:0/1899576564 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:40.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.222+0000 7f9211cce640 1 --2- 172.21.15.45:0/1899576564 >> v2:172.21.15.79:3300/0 conn(0x7f920c06f170 0x7f920c150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:40.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.222+0000 7f92114cd640 1 -- 172.21.15.45:0/1899576564 >> v2:172.21.15.79:3300/0 conn(0x7f920c06f170 msgr2=0x7f920c150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:40.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.222+0000 7f92114cd640 1 --2- 172.21.15.45:0/1899576564 >> v2:172.21.15.79:3300/0 conn(0x7f920c06f170 0x7f920c150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:40.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.222+0000 7f92114cd640 1 -- 172.21.15.45:0/1899576564 >> v1:172.21.15.79:6789/0 conn(0x7f920c06d170 legacy=0x7f920c14cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:40.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.222+0000 7f92114cd640 1 -- 172.21.15.45:0/1899576564 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f920c06cd00 con 0x7f920c0bc8b0 2023-10-03T19:17:40.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.222+0000 7f92114cd640 1 --2- 172.21.15.45:0/1899576564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f920c0bc8b0 0x7f920c14ca70 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f920c0bdf90 tx=0x7f91fc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33dace6774df58e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:40.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.222+0000 7f9210ccc640 1 -- 172.21.15.45:0/1899576564 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc0ac630 con 0x7f920c0bc8b0 2023-10-03T19:17:40.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.222+0000 7f9210ccc640 1 -- 172.21.15.45:0/1899576564 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91fc0ac790 con 0x7f920c0bc8b0 2023-10-03T19:17:40.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.222+0000 7f9210ccc640 1 -- 172.21.15.45:0/1899576564 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc0acb20 con 0x7f920c0bc8b0 2023-10-03T19:17:40.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.222+0000 7f9213f32640 1 -- 172.21.15.45:0/1899576564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f920c0bc8b0 msgr2=0x7f920c14ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:40.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.222+0000 7f9213f32640 1 --2- 172.21.15.45:0/1899576564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f920c0bc8b0 0x7f920c14ca70 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f920c0bdf90 tx=0x7f91fc01c480 comp rx=0 tx=0).stop 2023-10-03T19:17:40.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.222+0000 7f9213f32640 1 -- 172.21.15.45:0/1899576564 shutdown_connections 2023-10-03T19:17:40.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.222+0000 7f9213f32640 1 --2- 172.21.15.45:0/1899576564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f920c0bc8b0 0x7f920c14ca70 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:40.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.222+0000 7f9213f32640 1 --2- 172.21.15.45:0/1899576564 >> v2:172.21.15.79:3300/0 conn(0x7f920c06f170 0x7f920c150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:40.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.222+0000 7f9213f32640 1 -- 172.21.15.45:0/1899576564 >> 172.21.15.45:0/1899576564 conn(0x7f920c0bcf50 msgr2=0x7f920c0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:40.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.222+0000 7f9213f32640 1 -- 172.21.15.45:0/1899576564 shutdown_connections 2023-10-03T19:17:40.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.222+0000 7f9213f32640 1 -- 172.21.15.45:0/1899576564 wait complete. 2023-10-03T19:17:40.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.226+0000 7f9213f32640 1 Processor -- start 2023-10-03T19:17:40.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.226+0000 7f9213f32640 1 -- start start 2023-10-03T19:17:40.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.226+0000 7f9213f32640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f920c06d170 0x7f920c0b9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:40.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.226+0000 7f9213f32640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f920c06f170 0x7f920c143aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:40.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.226+0000 7f9213f32640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f920c0bc8b0 0x7f920c1429d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:40.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.226+0000 7f9213f32640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920c0bfcf0 con 0x7f920c0bc8b0 2023-10-03T19:17:40.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.226+0000 7f9213f32640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920c0ba090 con 0x7f920c06d170 2023-10-03T19:17:40.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.226+0000 7f9213f32640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920c0bff40 con 0x7f920c06f170 2023-10-03T19:17:40.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.226+0000 7f92124cf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f920c0bc8b0 0x7f920c1429d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:40.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.226+0000 7f92124cf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f920c0bc8b0 0x7f920c1429d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34946/0 (socket says 172.21.15.45:34946) 2023-10-03T19:17:40.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.226+0000 7f92124cf640 1 -- 172.21.15.45:0/352495520 learned_addr learned my addr 172.21.15.45:0/352495520 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:40.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.226+0000 7f9211cce640 1 --2- 172.21.15.45:0/352495520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f920c06d170 0x7f920c0b9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:40.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.226+0000 7f92114cd640 1 --2- 172.21.15.45:0/352495520 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f920c06f170 0x7f920c143aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:40.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.226+0000 7f92124cf640 1 -- 172.21.15.45:0/352495520 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f920c06f170 msgr2=0x7f920c143aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:40.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.226+0000 7f92124cf640 1 --2- 172.21.15.45:0/352495520 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f920c06f170 0x7f920c143aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:40.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.226+0000 7f92124cf640 1 -- 172.21.15.45:0/352495520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f920c06d170 msgr2=0x7f920c0b9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:40.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.226+0000 7f92124cf640 1 --2- 172.21.15.45:0/352495520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f920c06d170 0x7f920c0b9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:40.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.226+0000 7f92124cf640 1 -- 172.21.15.45:0/352495520 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc0094d0 con 0x7f920c0bc8b0 2023-10-03T19:17:40.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.226+0000 7f92124cf640 1 --2- 172.21.15.45:0/352495520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f920c0bc8b0 0x7f920c1429d0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f920400c3c0 tx=0x7f920400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:40.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.226+0000 7f92027fc640 1 -- 172.21.15.45:0/352495520 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9204011790 con 0x7f920c0bc8b0 2023-10-03T19:17:40.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.226+0000 7f92027fc640 1 -- 172.21.15.45:0/352495520 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92040118f0 con 0x7f920c0bc8b0 2023-10-03T19:17:40.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.226+0000 7f9213f32640 1 -- 172.21.15.45:0/352495520 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f920c06f6d0 con 0x7f920c0bc8b0 2023-10-03T19:17:40.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.226+0000 7f92027fc640 1 -- 172.21.15.45:0/352495520 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9204011ca0 con 0x7f920c0bc8b0 2023-10-03T19:17:40.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.226+0000 7f9213f32640 1 -- 172.21.15.45:0/352495520 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f920c06f540 con 0x7f920c0bc8b0 2023-10-03T19:17:40.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.226+0000 7f9213f32640 1 -- 172.21.15.45:0/352495520 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f920c159670 con 0x7f920c0bc8b0 2023-10-03T19:17:40.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.230+0000 7f92027fc640 1 -- 172.21.15.45:0/352495520 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f920401c460 con 0x7f920c0bc8b0 2023-10-03T19:17:40.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.230+0000 7f92027fc640 1 --2- 172.21.15.45:0/352495520 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f91f0066280 0x7f91f0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:40.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.230+0000 7f92027fc640 1 -- 172.21.15.45:0/352495520 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9204083ba0 con 0x7f920c0bc8b0 2023-10-03T19:17:40.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.230+0000 7f9211cce640 1 --2- 172.21.15.45:0/352495520 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f91f0066280 0x7f91f0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:40.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.230+0000 7f9211cce640 1 --2- 172.21.15.45:0/352495520 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f91f0066280 0x7f91f0068730 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9208003fd0 tx=0x7f92080039a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:40.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.234+0000 7f92027fc640 1 -- 172.21.15.45:0/352495520 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f92040510b0 con 0x7f920c0bc8b0 2023-10-03T19:17:40.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.386+0000 7f9213f32640 1 -- 172.21.15.45:0/352495520 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f920c06d660 con 0x7f920c0bc8b0 2023-10-03T19:17:40.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.386+0000 7f92027fc640 1 -- 172.21.15.45:0/352495520 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+18306 (secure 0 0 0) 0x7f92040546d0 con 0x7f920c0bc8b0 2023-10-03T19:17:40.412 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:17:40.413 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":74,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:17:36.500298+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:17:33.484274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-03T19:17:34.320341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:17:40.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.390+0000 7f9213f32640 1 -- 172.21.15.45:0/352495520 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f91f0066280 msgr2=0x7f91f0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:40.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.390+0000 7f9213f32640 1 --2- 172.21.15.45:0/352495520 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f91f0066280 0x7f91f0068730 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9208003fd0 tx=0x7f92080039a0 comp rx=0 tx=0).stop 2023-10-03T19:17:40.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.390+0000 7f9213f32640 1 -- 172.21.15.45:0/352495520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f920c0bc8b0 msgr2=0x7f920c1429d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:40.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.390+0000 7f9213f32640 1 --2- 172.21.15.45:0/352495520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f920c0bc8b0 0x7f920c1429d0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f920400c3c0 tx=0x7f920400c880 comp rx=0 tx=0).stop 2023-10-03T19:17:40.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.390+0000 7f9213f32640 1 -- 172.21.15.45:0/352495520 shutdown_connections 2023-10-03T19:17:40.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.390+0000 7f9213f32640 1 --2- 172.21.15.45:0/352495520 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f91f0066280 0x7f91f0068730 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:40.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.390+0000 7f9213f32640 1 --2- 172.21.15.45:0/352495520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f920c0bc8b0 0x7f920c1429d0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:40.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.390+0000 7f9213f32640 1 --2- 172.21.15.45:0/352495520 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f920c06f170 0x7f920c143aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:40.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.390+0000 7f9213f32640 1 --2- 172.21.15.45:0/352495520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f920c06d170 0x7f920c0b9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:40.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.390+0000 7f9213f32640 1 -- 172.21.15.45:0/352495520 >> 172.21.15.45:0/352495520 conn(0x7f920c0bcf50 msgr2=0x7f920c14e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:40.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.390+0000 7f9213f32640 1 -- 172.21.15.45:0/352495520 shutdown_connections 2023-10-03T19:17:40.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.390+0000 7f9213f32640 1 -- 172.21.15.45:0/352495520 wait complete. 2023-10-03T19:17:40.449 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-03T19:17:40.449 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:17:40.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.558+0000 7f0c48afc640 1 Processor -- start 2023-10-03T19:17:40.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.558+0000 7f0c48afc640 1 -- start start 2023-10-03T19:17:40.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c48afc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c4406d170 0x7f0c4414d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:40.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c48afc640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c4406cac0 con 0x7f0c440bc8b0 2023-10-03T19:17:40.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c48afc640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c440720d0 con 0x7f0c4406f170 2023-10-03T19:17:40.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c48afc640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c440a5ab0 con 0x7f0c4406d170 2023-10-03T19:17:40.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c41d9b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0c440bc8b0 0x7f0c4414ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35086/0 (socket says 172.21.15.45:35086) 2023-10-03T19:17:40.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c41d9b640 1 -- 172.21.15.45:0/505778889 learned_addr learned my addr 172.21.15.45:0/505778889 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:40.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c4159a640 1 -- 172.21.15.45:0/505778889 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2662817003 0 0) 0x7f0c34001120 con 0x7f0c440bc8b0 2023-10-03T19:17:40.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c42d9d640 1 --2- 172.21.15.45:0/505778889 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c4406d170 0x7f0c4414d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:40.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c4159a640 1 -- 172.21.15.45:0/505778889 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c2c003530 con 0x7f0c440bc8b0 2023-10-03T19:17:40.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c4159a640 1 -- 172.21.15.45:0/505778889 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2596465019 0 0) 0x7f0c2c003530 con 0x7f0c440bc8b0 2023-10-03T19:17:40.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c4159a640 1 -- 172.21.15.45:0/505778889 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c4406d170 msgr2=0x7f0c4414d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:40.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c4159a640 1 --2- 172.21.15.45:0/505778889 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c4406d170 0x7f0c4414d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:40.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c4159a640 1 -- 172.21.15.45:0/505778889 >> v1:172.21.15.79:6789/0 conn(0x7f0c4406f170 legacy=0x7f0c44150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:40.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c4159a640 1 -- 172.21.15.45:0/505778889 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4406cd00 con 0x7f0c440bc8b0 2023-10-03T19:17:40.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c4159a640 1 -- 172.21.15.45:0/505778889 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f0c34001810 con 0x7f0c440bc8b0 2023-10-03T19:17:40.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c4159a640 1 -- 172.21.15.45:0/505778889 >> v1:172.21.15.45:6789/0 conn(0x7f0c440bc8b0 legacy=0x7f0c4414ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:40.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c4159a640 1 --2- 172.21.15.45:0/505778889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c2c0039b0 0x7f0c2c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:40.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c4159a640 1 --2- 172.21.15.45:0/505778889 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c4406d170 0x7f0c2c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:40.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c4159a640 1 --2- 172.21.15.45:0/505778889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c2c004d10 0x7f0c2c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:40.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c4159a640 1 -- 172.21.15.45:0/505778889 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c440a5ab0 con 0x7f0c2c0039b0 2023-10-03T19:17:40.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c4159a640 1 -- 172.21.15.45:0/505778889 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c00bb30 con 0x7f0c2c004d10 2023-10-03T19:17:40.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c4159a640 1 -- 172.21.15.45:0/505778889 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c00bcf0 con 0x7f0c4406d170 2023-10-03T19:17:40.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c4259c640 1 --2- 172.21.15.45:0/505778889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c2c0039b0 0x7f0c2c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:40.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c41d9b640 1 --2- 172.21.15.45:0/505778889 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c4406d170 0x7f0c2c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:40.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c42d9d640 1 --2- 172.21.15.45:0/505778889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c2c004d10 0x7f0c2c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:40.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c4259c640 1 -- 172.21.15.45:0/505778889 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c4406d170 msgr2=0x7f0c2c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:40.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c4259c640 1 --2- 172.21.15.45:0/505778889 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c4406d170 0x7f0c2c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:40.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c4259c640 1 -- 172.21.15.45:0/505778889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c2c004d10 msgr2=0x7f0c2c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:40.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c4259c640 1 --2- 172.21.15.45:0/505778889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c2c004d10 0x7f0c2c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:40.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c4259c640 1 -- 172.21.15.45:0/505778889 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c2c003530 con 0x7f0c2c0039b0 2023-10-03T19:17:40.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c42d9d640 1 --2- 172.21.15.45:0/505778889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c2c004d10 0x7f0c2c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:40.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c4259c640 1 --2- 172.21.15.45:0/505778889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c2c0039b0 0x7f0c2c003dc0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f0c38001780 tx=0x7f0c3801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7abcb6de8c227df5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:40.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c4159a640 1 -- 172.21.15.45:0/505778889 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c380052d0 con 0x7f0c2c0039b0 2023-10-03T19:17:40.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c4159a640 1 -- 172.21.15.45:0/505778889 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c380a7050 con 0x7f0c2c0039b0 2023-10-03T19:17:40.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.562+0000 7f0c4159a640 1 -- 172.21.15.45:0/505778889 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c38003600 con 0x7f0c2c0039b0 2023-10-03T19:17:40.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c48afc640 1 -- 172.21.15.45:0/505778889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c2c0039b0 msgr2=0x7f0c2c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:40.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c48afc640 1 --2- 172.21.15.45:0/505778889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c2c0039b0 0x7f0c2c003dc0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f0c38001780 tx=0x7f0c3801c400 comp rx=0 tx=0).stop 2023-10-03T19:17:40.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c42d9d640 1 -- 172.21.15.45:0/505778889 reap_dead start 2023-10-03T19:17:40.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c48afc640 1 -- 172.21.15.45:0/505778889 shutdown_connections 2023-10-03T19:17:40.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c48afc640 1 -- 172.21.15.45:0/505778889 >> 172.21.15.45:0/505778889 conn(0x7f0c440bcf50 msgr2=0x7f0c440bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:40.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c48afc640 1 -- 172.21.15.45:0/505778889 shutdown_connections 2023-10-03T19:17:40.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c48afc640 1 -- 172.21.15.45:0/505778889 wait complete. 2023-10-03T19:17:40.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c48afc640 1 Processor -- start 2023-10-03T19:17:40.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c48afc640 1 -- start start 2023-10-03T19:17:40.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c48afc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c2c0039b0 0x7f0c440b9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:40.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c48afc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c440a3670 0x7f0c440a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:40.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c48afc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c440a3ad0 0x7f0c441e3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:40.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c48afc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c440b9a20 con 0x7f0c2c0039b0 2023-10-03T19:17:40.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c48afc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c440a5640 con 0x7f0c440a3ad0 2023-10-03T19:17:40.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c48afc640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c440a46a0 con 0x7f0c440a3670 2023-10-03T19:17:40.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c4259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c2c0039b0 0x7f0c440b9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:40.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c4259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c2c0039b0 0x7f0c440b9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34972/0 (socket says 172.21.15.45:34972) 2023-10-03T19:17:40.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c4259c640 1 -- 172.21.15.45:0/3396982079 learned_addr learned my addr 172.21.15.45:0/3396982079 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:40.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c41d9b640 1 --2- 172.21.15.45:0/3396982079 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c440a3670 0x7f0c440a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:40.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c42d9d640 1 --2- 172.21.15.45:0/3396982079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c440a3ad0 0x7f0c441e3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:40.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c4259c640 1 -- 172.21.15.45:0/3396982079 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c440a3670 msgr2=0x7f0c440a5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:40.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c4259c640 1 --2- 172.21.15.45:0/3396982079 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c440a3670 0x7f0c440a5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:40.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c4259c640 1 -- 172.21.15.45:0/3396982079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c440a3ad0 msgr2=0x7f0c441e3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:40.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c4259c640 1 --2- 172.21.15.45:0/3396982079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c440a3ad0 0x7f0c441e3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:40.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c4259c640 1 -- 172.21.15.45:0/3396982079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4414c4a0 con 0x7f0c2c0039b0 2023-10-03T19:17:40.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c42d9d640 1 --2- 172.21.15.45:0/3396982079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c440a3ad0 0x7f0c441e3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:40.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c4259c640 1 --2- 172.21.15.45:0/3396982079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c2c0039b0 0x7f0c440b9eb0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f0c38000c10 tx=0x7f0c2c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:40.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c32ffd640 1 -- 172.21.15.45:0/3396982079 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c38007680 con 0x7f0c2c0039b0 2023-10-03T19:17:40.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c32ffd640 1 -- 172.21.15.45:0/3396982079 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c380067e0 con 0x7f0c2c0039b0 2023-10-03T19:17:40.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c32ffd640 1 -- 172.21.15.45:0/3396982079 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c38006b90 con 0x7f0c2c0039b0 2023-10-03T19:17:40.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c48afc640 1 -- 172.21.15.45:0/3396982079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c4414fae0 con 0x7f0c2c0039b0 2023-10-03T19:17:40.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c48afc640 1 -- 172.21.15.45:0/3396982079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c4406f540 con 0x7f0c2c0039b0 2023-10-03T19:17:40.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.566+0000 7f0c48afc640 1 -- 172.21.15.45:0/3396982079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c4406d660 con 0x7f0c2c0039b0 2023-10-03T19:17:40.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.570+0000 7f0c32ffd640 1 -- 172.21.15.45:0/3396982079 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0c38006cf0 con 0x7f0c2c0039b0 2023-10-03T19:17:40.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.570+0000 7f0c32ffd640 1 --2- 172.21.15.45:0/3396982079 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0c240662b0 0x7f0c24068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:40.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.570+0000 7f0c32ffd640 1 -- 172.21.15.45:0/3396982079 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0c3811e580 con 0x7f0c2c0039b0 2023-10-03T19:17:40.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.570+0000 7f0c41d9b640 1 --2- 172.21.15.45:0/3396982079 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0c240662b0 0x7f0c24068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:40.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.570+0000 7f0c41d9b640 1 --2- 172.21.15.45:0/3396982079 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0c240662b0 0x7f0c24068760 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0c34001060 tx=0x7f0c34009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:40.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.574+0000 7f0c32ffd640 1 -- 172.21.15.45:0/3396982079 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0c380ef400 con 0x7f0c2c0039b0 2023-10-03T19:17:40.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.722+0000 7f0c48afc640 1 -- 172.21.15.45:0/3396982079 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0c440a4810 con 0x7f0c240662b0 2023-10-03T19:17:40.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.750+0000 7f0c32ffd640 1 -- 172.21.15.45:0/3396982079 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310195 (secure 0 0 0) 0x7f0c440a4810 con 0x7f0c240662b0 2023-10-03T19:17:40.904 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:17:40.929 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:17:41.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.754+0000 7f0c48afc640 1 -- 172.21.15.45:0/3396982079 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0c240662b0 msgr2=0x7f0c24068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:41.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.754+0000 7f0c48afc640 1 --2- 172.21.15.45:0/3396982079 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0c240662b0 0x7f0c24068760 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0c34001060 tx=0x7f0c34009040 comp rx=0 tx=0).stop 2023-10-03T19:17:41.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.754+0000 7f0c48afc640 1 -- 172.21.15.45:0/3396982079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c2c0039b0 msgr2=0x7f0c440b9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:41.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.754+0000 7f0c48afc640 1 --2- 172.21.15.45:0/3396982079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c2c0039b0 0x7f0c440b9eb0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f0c38000c10 tx=0x7f0c2c005800 comp rx=0 tx=0).stop 2023-10-03T19:17:41.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.754+0000 7f0c48afc640 1 -- 172.21.15.45:0/3396982079 shutdown_connections 2023-10-03T19:17:41.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.754+0000 7f0c48afc640 1 --2- 172.21.15.45:0/3396982079 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0c240662b0 0x7f0c24068760 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:41.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.754+0000 7f0c48afc640 1 --2- 172.21.15.45:0/3396982079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c440a3ad0 0x7f0c441e3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:41.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.754+0000 7f0c48afc640 1 --2- 172.21.15.45:0/3396982079 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c440a3670 0x7f0c440a5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:41.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.754+0000 7f0c48afc640 1 --2- 172.21.15.45:0/3396982079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c2c0039b0 0x7f0c440b9eb0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:41.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.754+0000 7f0c48afc640 1 -- 172.21.15.45:0/3396982079 >> 172.21.15.45:0/3396982079 conn(0x7f0c440bcf50 msgr2=0x7f0c440712b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:41.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.754+0000 7f0c48afc640 1 -- 172.21.15.45:0/3396982079 shutdown_connections 2023-10-03T19:17:41.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:40.754+0000 7f0c48afc640 1 -- 172.21.15.45:0/3396982079 wait complete. 2023-10-03T19:17:41.093 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":229,"stamp":"2023-10-03T19:17:40.556048+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":111,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":211036,"kb_used_data":7132,"kb_used_omap":0,"kb_used_meta":203840,"kb_avail":754763684,"statfs":{"total":773094113280,"available":772878012416,"internally_reserved":0,"allocated":7303168,"data_stored":4394374,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":208732160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":67,"apply_latency_ms":67,"commit_latency_ns":67000000,"apply_latency_ns":67000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002026"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.592168+0000","last_change":"2023-10-03T19:17:35.574436+0000","last_active":"2023-10-03T19:17:36.592168+0000","last_peered":"2023-10-03T19:17:36.592168+0000","last_clean":"2023-10-03T19:17:36.592168+0000","last_became_active":"2023-10-03T19:17:35.573980+0000","last_became_peered":"2023-10-03T19:17:35.573980+0000","last_unstale":"2023-10-03T19:17:36.592168+0000","last_undegraded":"2023-10-03T19:17:36.592168+0000","last_fullsized":"2023-10-03T19:17:36.592168+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:36:40.458993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.509499+0000","last_change":"2023-10-03T19:17:35.530517+0000","last_active":"2023-10-03T19:17:36.509499+0000","last_peered":"2023-10-03T19:17:36.509499+0000","last_clean":"2023-10-03T19:17:36.509499+0000","last_became_active":"2023-10-03T19:17:35.530243+0000","last_became_peered":"2023-10-03T19:17:35.530243+0000","last_unstale":"2023-10-03T19:17:36.509499+0000","last_undegraded":"2023-10-03T19:17:36.509499+0000","last_fullsized":"2023-10-03T19:17:36.509499+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:00:06.581814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.541096+0000","last_change":"2023-10-03T19:17:35.525639+0000","last_active":"2023-10-03T19:17:36.541096+0000","last_peered":"2023-10-03T19:17:36.541096+0000","last_clean":"2023-10-03T19:17:36.541096+0000","last_became_active":"2023-10-03T19:17:35.525306+0000","last_became_peered":"2023-10-03T19:17:35.525306+0000","last_unstale":"2023-10-03T19:17:36.541096+0000","last_undegraded":"2023-10-03T19:17:36.541096+0000","last_fullsized":"2023-10-03T19:17:36.541096+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:12:57.883476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.514213+0000","last_change":"2023-10-03T19:17:35.562486+0000","last_active":"2023-10-03T19:17:36.514213+0000","last_peered":"2023-10-03T19:17:36.514213+0000","last_clean":"2023-10-03T19:17:36.514213+0000","last_became_active":"2023-10-03T19:17:35.561964+0000","last_became_peered":"2023-10-03T19:17:35.561964+0000","last_unstale":"2023-10-03T19:17:36.514213+0000","last_undegraded":"2023-10-03T19:17:36.514213+0000","last_fullsized":"2023-10-03T19:17:36.514213+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:03:22.966456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.586545+0000","last_change":"2023-10-03T19:17:35.557047+0000","last_active":"2023-10-03T19:17:36.586545+0000","last_peered":"2023-10-03T19:17:36.586545+0000","last_clean":"2023-10-03T19:17:36.586545+0000","last_became_active":"2023-10-03T19:17:35.556720+0000","last_became_peered":"2023-10-03T19:17:35.556720+0000","last_unstale":"2023-10-03T19:17:36.586545+0000","last_undegraded":"2023-10-03T19:17:36.586545+0000","last_fullsized":"2023-10-03T19:17:36.586545+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:25:15.704816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-03T19:17:35.558736+0000","last_change":"2023-10-03T19:17:35.557910+0000","last_active":"2023-10-03T19:17:35.558736+0000","last_peered":"2023-10-03T19:17:35.558736+0000","last_clean":"2023-10-03T19:17:35.558736+0000","last_became_active":"2023-10-03T19:17:35.557410+0000","last_became_peered":"2023-10-03T19:17:35.557410+0000","last_unstale":"2023-10-03T19:17:35.558736+0000","last_undegraded":"2023-10-03T19:17:35.558736+0000","last_fullsized":"2023-10-03T19:17:35.558736+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:20:49.213913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.592565+0000","last_change":"2023-10-03T19:17:35.529727+0000","last_active":"2023-10-03T19:17:36.592565+0000","last_peered":"2023-10-03T19:17:36.592565+0000","last_clean":"2023-10-03T19:17:36.592565+0000","last_became_active":"2023-10-03T19:17:35.528373+0000","last_became_peered":"2023-10-03T19:17:35.528373+0000","last_unstale":"2023-10-03T19:17:36.592565+0000","last_undegraded":"2023-10-03T19:17:36.592565+0000","last_fullsized":"2023-10-03T19:17:36.592565+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:24:55.429616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.586247+0000","last_change":"2023-10-03T19:17:35.557048+0000","last_active":"2023-10-03T19:17:36.586247+0000","last_peered":"2023-10-03T19:17:36.586247+0000","last_clean":"2023-10-03T19:17:36.586247+0000","last_became_active":"2023-10-03T19:17:35.556747+0000","last_became_peered":"2023-10-03T19:17:35.556747+0000","last_unstale":"2023-10-03T19:17:36.586247+0000","last_undegraded":"2023-10-03T19:17:36.586247+0000","last_fullsized":"2023-10-03T19:17:36.586247+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:41:41.097515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.516228+0000","last_change":"2023-10-03T19:17:35.572826+0000","last_active":"2023-10-03T19:17:36.516228+0000","last_peered":"2023-10-03T19:17:36.516228+0000","last_clean":"2023-10-03T19:17:36.516228+0000","last_became_active":"2023-10-03T19:17:35.571798+0000","last_became_peered":"2023-10-03T19:17:35.571798+0000","last_unstale":"2023-10-03T19:17:36.516228+0000","last_undegraded":"2023-10-03T19:17:36.516228+0000","last_fullsized":"2023-10-03T19:17:36.516228+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:22:18.372716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.514363+0000","last_change":"2023-10-03T19:17:35.538190+0000","last_active":"2023-10-03T19:17:36.514363+0000","last_peered":"2023-10-03T19:17:36.514363+0000","last_clean":"2023-10-03T19:17:36.514363+0000","last_became_active":"2023-10-03T19:17:35.537584+0000","last_became_peered":"2023-10-03T19:17:35.537584+0000","last_unstale":"2023-10-03T19:17:36.514363+0000","last_undegraded":"2023-10-03T19:17:36.514363+0000","last_fullsized":"2023-10-03T19:17:36.514363+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:44:14.258659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.509172+0000","last_change":"2023-10-03T19:17:35.523945+0000","last_active":"2023-10-03T19:17:36.509172+0000","last_peered":"2023-10-03T19:17:36.509172+0000","last_clean":"2023-10-03T19:17:36.509172+0000","last_became_active":"2023-10-03T19:17:35.523464+0000","last_became_peered":"2023-10-03T19:17:35.523464+0000","last_unstale":"2023-10-03T19:17:36.509172+0000","last_undegraded":"2023-10-03T19:17:36.509172+0000","last_fullsized":"2023-10-03T19:17:36.509172+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:49:40.130750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.514542+0000","last_change":"2023-10-03T19:17:35.544319+0000","last_active":"2023-10-03T19:17:36.514542+0000","last_peered":"2023-10-03T19:17:36.514542+0000","last_clean":"2023-10-03T19:17:36.514542+0000","last_became_active":"2023-10-03T19:17:35.543459+0000","last_became_peered":"2023-10-03T19:17:35.543459+0000","last_unstale":"2023-10-03T19:17:36.514542+0000","last_undegraded":"2023-10-03T19:17:36.514542+0000","last_fullsized":"2023-10-03T19:17:36.514542+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:07:13.726471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.587227+0000","last_change":"2023-10-03T19:17:35.528430+0000","last_active":"2023-10-03T19:17:36.587227+0000","last_peered":"2023-10-03T19:17:36.587227+0000","last_clean":"2023-10-03T19:17:36.587227+0000","last_became_active":"2023-10-03T19:17:35.527901+0000","last_became_peered":"2023-10-03T19:17:35.527901+0000","last_unstale":"2023-10-03T19:17:36.587227+0000","last_undegraded":"2023-10-03T19:17:36.587227+0000","last_fullsized":"2023-10-03T19:17:36.587227+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:25:17.138452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-03T19:17:35.558722+0000","last_change":"2023-10-03T19:17:35.557763+0000","last_active":"2023-10-03T19:17:35.558722+0000","last_peered":"2023-10-03T19:17:35.558722+0000","last_clean":"2023-10-03T19:17:35.558722+0000","last_became_active":"2023-10-03T19:17:35.557050+0000","last_became_peered":"2023-10-03T19:17:35.557050+0000","last_unstale":"2023-10-03T19:17:35.558722+0000","last_undegraded":"2023-10-03T19:17:35.558722+0000","last_fullsized":"2023-10-03T19:17:35.558722+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:30:39.387465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.508523+0000","last_change":"2023-10-03T19:17:35.519539+0000","last_active":"2023-10-03T19:17:36.508523+0000","last_peered":"2023-10-03T19:17:36.508523+0000","last_clean":"2023-10-03T19:17:36.508523+0000","last_became_active":"2023-10-03T19:17:35.519279+0000","last_became_peered":"2023-10-03T19:17:35.519279+0000","last_unstale":"2023-10-03T19:17:36.508523+0000","last_undegraded":"2023-10-03T19:17:36.508523+0000","last_fullsized":"2023-10-03T19:17:36.508523+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:14:38.471340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.591551+0000","last_change":"2023-10-03T19:17:35.566481+0000","last_active":"2023-10-03T19:17:36.591551+0000","last_peered":"2023-10-03T19:17:36.591551+0000","last_clean":"2023-10-03T19:17:36.591551+0000","last_became_active":"2023-10-03T19:17:35.565937+0000","last_became_peered":"2023-10-03T19:17:35.565937+0000","last_unstale":"2023-10-03T19:17:36.591551+0000","last_undegraded":"2023-10-03T19:17:36.591551+0000","last_fullsized":"2023-10-03T19:17:36.591551+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:17:09.857761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.587133+0000","last_change":"2023-10-03T19:17:35.534279+0000","last_active":"2023-10-03T19:17:36.587133+0000","last_peered":"2023-10-03T19:17:36.587133+0000","last_clean":"2023-10-03T19:17:36.587133+0000","last_became_active":"2023-10-03T19:17:35.533985+0000","last_became_peered":"2023-10-03T19:17:35.533985+0000","last_unstale":"2023-10-03T19:17:36.587133+0000","last_undegraded":"2023-10-03T19:17:36.587133+0000","last_fullsized":"2023-10-03T19:17:36.587133+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:59:38.485845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.540839+0000","last_change":"2023-10-03T19:17:35.569760+0000","last_active":"2023-10-03T19:17:36.540839+0000","last_peered":"2023-10-03T19:17:36.540839+0000","last_clean":"2023-10-03T19:17:36.540839+0000","last_became_active":"2023-10-03T19:17:35.569452+0000","last_became_peered":"2023-10-03T19:17:35.569452+0000","last_unstale":"2023-10-03T19:17:36.540839+0000","last_undegraded":"2023-10-03T19:17:36.540839+0000","last_fullsized":"2023-10-03T19:17:36.540839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:14:04.728465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-03T19:17:35.527050+0000","last_change":"2023-10-03T19:17:35.522436+0000","last_active":"2023-10-03T19:17:35.527050+0000","last_peered":"2023-10-03T19:17:35.527050+0000","last_clean":"2023-10-03T19:17:35.527050+0000","last_became_active":"2023-10-03T19:17:35.522169+0000","last_became_peered":"2023-10-03T19:17:35.522169+0000","last_unstale":"2023-10-03T19:17:35.527050+0000","last_undegraded":"2023-10-03T19:17:35.527050+0000","last_fullsized":"2023-10-03T19:17:35.527050+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:10:23.787856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.586259+0000","last_change":"2023-10-03T19:17:35.520184+0000","last_active":"2023-10-03T19:17:36.586259+0000","last_peered":"2023-10-03T19:17:36.586259+0000","last_clean":"2023-10-03T19:17:36.586259+0000","last_became_active":"2023-10-03T19:17:35.519879+0000","last_became_peered":"2023-10-03T19:17:35.519879+0000","last_unstale":"2023-10-03T19:17:36.586259+0000","last_undegraded":"2023-10-03T19:17:36.586259+0000","last_fullsized":"2023-10-03T19:17:36.586259+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:34:43.975125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.515782+0000","last_change":"2023-10-03T19:17:35.559274+0000","last_active":"2023-10-03T19:17:36.515782+0000","last_peered":"2023-10-03T19:17:36.515782+0000","last_clean":"2023-10-03T19:17:36.515782+0000","last_became_active":"2023-10-03T19:17:35.558599+0000","last_became_peered":"2023-10-03T19:17:35.558599+0000","last_unstale":"2023-10-03T19:17:36.515782+0000","last_undegraded":"2023-10-03T19:17:36.515782+0000","last_fullsized":"2023-10-03T19:17:36.515782+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:51:52.777516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.586003+0000","last_change":"2023-10-03T19:17:35.526489+0000","last_active":"2023-10-03T19:17:36.586003+0000","last_peered":"2023-10-03T19:17:36.586003+0000","last_clean":"2023-10-03T19:17:36.586003+0000","last_became_active":"2023-10-03T19:17:35.526170+0000","last_became_peered":"2023-10-03T19:17:35.526170+0000","last_unstale":"2023-10-03T19:17:36.586003+0000","last_undegraded":"2023-10-03T19:17:36.586003+0000","last_fullsized":"2023-10-03T19:17:36.586003+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:40:33.225182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.514580+0000","last_change":"2023-10-03T19:17:35.572413+0000","last_active":"2023-10-03T19:17:36.514580+0000","last_peered":"2023-10-03T19:17:36.514580+0000","last_clean":"2023-10-03T19:17:36.514580+0000","last_became_active":"2023-10-03T19:17:35.571505+0000","last_became_peered":"2023-10-03T19:17:35.571505+0000","last_unstale":"2023-10-03T19:17:36.514580+0000","last_undegraded":"2023-10-03T19:17:36.514580+0000","last_fullsized":"2023-10-03T19:17:36.514580+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:32:20.377008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.508337+0000","last_change":"2023-10-03T19:17:35.527455+0000","last_active":"2023-10-03T19:17:36.508337+0000","last_peered":"2023-10-03T19:17:36.508337+0000","last_clean":"2023-10-03T19:17:36.508337+0000","last_became_active":"2023-10-03T19:17:35.527141+0000","last_became_peered":"2023-10-03T19:17:35.527141+0000","last_unstale":"2023-10-03T19:17:36.508337+0000","last_undegraded":"2023-10-03T19:17:36.508337+0000","last_fullsized":"2023-10-03T19:17:36.508337+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:15:28.355234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.508992+0000","last_change":"2023-10-03T19:17:35.527106+0000","last_active":"2023-10-03T19:17:36.508992+0000","last_peered":"2023-10-03T19:17:36.508992+0000","last_clean":"2023-10-03T19:17:36.508992+0000","last_became_active":"2023-10-03T19:17:35.526749+0000","last_became_peered":"2023-10-03T19:17:35.526749+0000","last_unstale":"2023-10-03T19:17:36.508992+0000","last_undegraded":"2023-10-03T19:17:36.508992+0000","last_fullsized":"2023-10-03T19:17:36.508992+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:32:56.032540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.514704+0000","last_change":"2023-10-03T19:17:35.535251+0000","last_active":"2023-10-03T19:17:36.514704+0000","last_peered":"2023-10-03T19:17:36.514704+0000","last_clean":"2023-10-03T19:17:36.514704+0000","last_became_active":"2023-10-03T19:17:35.534543+0000","last_became_peered":"2023-10-03T19:17:35.534543+0000","last_unstale":"2023-10-03T19:17:36.514704+0000","last_undegraded":"2023-10-03T19:17:36.514704+0000","last_fullsized":"2023-10-03T19:17:36.514704+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:58:08.955116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.591810+0000","last_change":"2023-10-03T19:17:35.566766+0000","last_active":"2023-10-03T19:17:36.591810+0000","last_peered":"2023-10-03T19:17:36.591810+0000","last_clean":"2023-10-03T19:17:36.591810+0000","last_became_active":"2023-10-03T19:17:35.566026+0000","last_became_peered":"2023-10-03T19:17:35.566026+0000","last_unstale":"2023-10-03T19:17:36.591810+0000","last_undegraded":"2023-10-03T19:17:36.591810+0000","last_fullsized":"2023-10-03T19:17:36.591810+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:15:17.694256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.586469+0000","last_change":"2023-10-03T19:17:35.540835+0000","last_active":"2023-10-03T19:17:36.586469+0000","last_peered":"2023-10-03T19:17:36.586469+0000","last_clean":"2023-10-03T19:17:36.586469+0000","last_became_active":"2023-10-03T19:17:35.540571+0000","last_became_peered":"2023-10-03T19:17:35.540571+0000","last_unstale":"2023-10-03T19:17:36.586469+0000","last_undegraded":"2023-10-03T19:17:36.586469+0000","last_fullsized":"2023-10-03T19:17:36.586469+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:14:17.903514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.508829+0000","last_change":"2023-10-03T19:17:35.535726+0000","last_active":"2023-10-03T19:17:36.508829+0000","last_peered":"2023-10-03T19:17:36.508829+0000","last_clean":"2023-10-03T19:17:36.508829+0000","last_became_active":"2023-10-03T19:17:35.535458+0000","last_became_peered":"2023-10-03T19:17:35.535458+0000","last_unstale":"2023-10-03T19:17:36.508829+0000","last_undegraded":"2023-10-03T19:17:36.508829+0000","last_fullsized":"2023-10-03T19:17:36.508829+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:22:03.650059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.590862+0000","last_change":"2023-10-03T19:17:35.558458+0000","last_active":"2023-10-03T19:17:36.590862+0000","last_peered":"2023-10-03T19:17:36.590862+0000","last_clean":"2023-10-03T19:17:36.590862+0000","last_became_active":"2023-10-03T19:17:35.557755+0000","last_became_peered":"2023-10-03T19:17:35.557755+0000","last_unstale":"2023-10-03T19:17:36.590862+0000","last_undegraded":"2023-10-03T19:17:36.590862+0000","last_fullsized":"2023-10-03T19:17:36.590862+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:55:44.430806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.540417+0000","last_change":"2023-10-03T19:17:35.523702+0000","last_active":"2023-10-03T19:17:36.540417+0000","last_peered":"2023-10-03T19:17:36.540417+0000","last_clean":"2023-10-03T19:17:36.540417+0000","last_became_active":"2023-10-03T19:17:35.523395+0000","last_became_peered":"2023-10-03T19:17:35.523395+0000","last_unstale":"2023-10-03T19:17:36.540417+0000","last_undegraded":"2023-10-03T19:17:36.540417+0000","last_fullsized":"2023-10-03T19:17:36.540417+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:59:00.302947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.591405+0000","last_change":"2023-10-03T19:17:35.572812+0000","last_active":"2023-10-03T19:17:36.591405+0000","last_peered":"2023-10-03T19:17:36.591405+0000","last_clean":"2023-10-03T19:17:36.591405+0000","last_became_active":"2023-10-03T19:17:35.572360+0000","last_became_peered":"2023-10-03T19:17:35.572360+0000","last_unstale":"2023-10-03T19:17:36.591405+0000","last_undegraded":"2023-10-03T19:17:36.591405+0000","last_fullsized":"2023-10-03T19:17:36.591405+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:23:25.047485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.540395+0000","last_change":"2023-10-03T19:17:35.559355+0000","last_active":"2023-10-03T19:17:36.540395+0000","last_peered":"2023-10-03T19:17:36.540395+0000","last_clean":"2023-10-03T19:17:36.540395+0000","last_became_active":"2023-10-03T19:17:35.559089+0000","last_became_peered":"2023-10-03T19:17:35.559089+0000","last_unstale":"2023-10-03T19:17:36.540395+0000","last_undegraded":"2023-10-03T19:17:36.540395+0000","last_fullsized":"2023-10-03T19:17:36.540395+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:53:34.801440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"73'4","reported_seq":17,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.587177+0000","last_change":"2023-10-03T19:17:34.968998+0000","last_active":"2023-10-03T19:17:36.587177+0000","last_peered":"2023-10-03T19:17:36.587177+0000","last_clean":"2023-10-03T19:17:36.587177+0000","last_became_active":"2023-10-03T19:17:34.968529+0000","last_became_peered":"2023-10-03T19:17:34.968529+0000","last_unstale":"2023-10-03T19:17:36.587177+0000","last_undegraded":"2023-10-03T19:17:36.587177+0000","last_fullsized":"2023-10-03T19:17:36.587177+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:36:44.555220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.509352+0000","last_change":"2023-10-03T19:17:35.539694+0000","last_active":"2023-10-03T19:17:36.509352+0000","last_peered":"2023-10-03T19:17:36.509352+0000","last_clean":"2023-10-03T19:17:36.509352+0000","last_became_active":"2023-10-03T19:17:35.539487+0000","last_became_peered":"2023-10-03T19:17:35.539487+0000","last_unstale":"2023-10-03T19:17:36.509352+0000","last_undegraded":"2023-10-03T19:17:36.509352+0000","last_fullsized":"2023-10-03T19:17:36.509352+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:43:46.361603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"73'1","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.592310+0000","last_change":"2023-10-03T19:17:34.993568+0000","last_active":"2023-10-03T19:17:36.592310+0000","last_peered":"2023-10-03T19:17:36.592310+0000","last_clean":"2023-10-03T19:17:36.592310+0000","last_became_active":"2023-10-03T19:17:34.992990+0000","last_became_peered":"2023-10-03T19:17:34.992990+0000","last_unstale":"2023-10-03T19:17:36.592310+0000","last_undegraded":"2023-10-03T19:17:36.592310+0000","last_fullsized":"2023-10-03T19:17:36.592310+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:58:43.548189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.515447+0000","last_change":"2023-10-03T19:17:35.560592+0000","last_active":"2023-10-03T19:17:36.515447+0000","last_peered":"2023-10-03T19:17:36.515447+0000","last_clean":"2023-10-03T19:17:36.515447+0000","last_became_active":"2023-10-03T19:17:35.559050+0000","last_became_peered":"2023-10-03T19:17:35.559050+0000","last_unstale":"2023-10-03T19:17:36.515447+0000","last_undegraded":"2023-10-03T19:17:36.515447+0000","last_fullsized":"2023-10-03T19:17:36.515447+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:44:18.327862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"73'2","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.592172+0000","last_change":"2023-10-03T19:17:34.990843+0000","last_active":"2023-10-03T19:17:36.592172+0000","last_peered":"2023-10-03T19:17:36.592172+0000","last_clean":"2023-10-03T19:17:36.592172+0000","last_became_active":"2023-10-03T19:17:34.990162+0000","last_became_peered":"2023-10-03T19:17:34.990162+0000","last_unstale":"2023-10-03T19:17:36.592172+0000","last_undegraded":"2023-10-03T19:17:36.592172+0000","last_fullsized":"2023-10-03T19:17:36.592172+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:57:28.654749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.516124+0000","last_change":"2023-10-03T19:17:35.558957+0000","last_active":"2023-10-03T19:17:36.516124+0000","last_peered":"2023-10-03T19:17:36.516124+0000","last_clean":"2023-10-03T19:17:36.516124+0000","last_became_active":"2023-10-03T19:17:35.557955+0000","last_became_peered":"2023-10-03T19:17:35.557955+0000","last_unstale":"2023-10-03T19:17:36.516124+0000","last_undegraded":"2023-10-03T19:17:36.516124+0000","last_fullsized":"2023-10-03T19:17:36.516124+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:51:43.300261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"73'2","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.590749+0000","last_change":"2023-10-03T19:17:34.981697+0000","last_active":"2023-10-03T19:17:36.590749+0000","last_peered":"2023-10-03T19:17:36.590749+0000","last_clean":"2023-10-03T19:17:36.590749+0000","last_became_active":"2023-10-03T19:17:34.980986+0000","last_became_peered":"2023-10-03T19:17:34.980986+0000","last_unstale":"2023-10-03T19:17:36.590749+0000","last_undegraded":"2023-10-03T19:17:36.590749+0000","last_fullsized":"2023-10-03T19:17:36.590749+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:23:31.911249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.508968+0000","last_change":"2023-10-03T19:17:35.519870+0000","last_active":"2023-10-03T19:17:36.508968+0000","last_peered":"2023-10-03T19:17:36.508968+0000","last_clean":"2023-10-03T19:17:36.508968+0000","last_became_active":"2023-10-03T19:17:35.518115+0000","last_became_peered":"2023-10-03T19:17:35.518115+0000","last_unstale":"2023-10-03T19:17:36.508968+0000","last_undegraded":"2023-10-03T19:17:36.508968+0000","last_fullsized":"2023-10-03T19:17:36.508968+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:38:59.364154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"73'1","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.516291+0000","last_change":"2023-10-03T19:17:34.979595+0000","last_active":"2023-10-03T19:17:36.516291+0000","last_peered":"2023-10-03T19:17:36.516291+0000","last_clean":"2023-10-03T19:17:36.516291+0000","last_became_active":"2023-10-03T19:17:34.978851+0000","last_became_peered":"2023-10-03T19:17:34.978851+0000","last_unstale":"2023-10-03T19:17:36.516291+0000","last_undegraded":"2023-10-03T19:17:36.516291+0000","last_fullsized":"2023-10-03T19:17:36.516291+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:21:31.193839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.509352+0000","last_change":"2023-10-03T19:17:35.523768+0000","last_active":"2023-10-03T19:17:36.509352+0000","last_peered":"2023-10-03T19:17:36.509352+0000","last_clean":"2023-10-03T19:17:36.509352+0000","last_became_active":"2023-10-03T19:17:35.523181+0000","last_became_peered":"2023-10-03T19:17:35.523181+0000","last_unstale":"2023-10-03T19:17:36.509352+0000","last_undegraded":"2023-10-03T19:17:36.509352+0000","last_fullsized":"2023-10-03T19:17:36.509352+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:42:04.040389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"73'1","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.515104+0000","last_change":"2023-10-03T19:17:34.983006+0000","last_active":"2023-10-03T19:17:36.515104+0000","last_peered":"2023-10-03T19:17:36.515104+0000","last_clean":"2023-10-03T19:17:36.515104+0000","last_became_active":"2023-10-03T19:17:34.982265+0000","last_became_peered":"2023-10-03T19:17:34.982265+0000","last_unstale":"2023-10-03T19:17:36.515104+0000","last_undegraded":"2023-10-03T19:17:36.515104+0000","last_fullsized":"2023-10-03T19:17:36.515104+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:06:10.612883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.516521+0000","last_change":"2023-10-03T19:17:35.571824+0000","last_active":"2023-10-03T19:17:36.516521+0000","last_peered":"2023-10-03T19:17:36.516521+0000","last_clean":"2023-10-03T19:17:36.516521+0000","last_became_active":"2023-10-03T19:17:35.571266+0000","last_became_peered":"2023-10-03T19:17:35.571266+0000","last_unstale":"2023-10-03T19:17:36.516521+0000","last_undegraded":"2023-10-03T19:17:36.516521+0000","last_fullsized":"2023-10-03T19:17:36.516521+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:18:18.919878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.508784+0000","last_change":"2023-10-03T19:17:34.970988+0000","last_active":"2023-10-03T19:17:36.508784+0000","last_peered":"2023-10-03T19:17:36.508784+0000","last_clean":"2023-10-03T19:17:36.508784+0000","last_became_active":"2023-10-03T19:17:34.970575+0000","last_became_peered":"2023-10-03T19:17:34.970575+0000","last_unstale":"2023-10-03T19:17:36.508784+0000","last_undegraded":"2023-10-03T19:17:36.508784+0000","last_fullsized":"2023-10-03T19:17:36.508784+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:19:56.282554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.591001+0000","last_change":"2023-10-03T19:17:35.524093+0000","last_active":"2023-10-03T19:17:36.591001+0000","last_peered":"2023-10-03T19:17:36.591001+0000","last_clean":"2023-10-03T19:17:36.591001+0000","last_became_active":"2023-10-03T19:17:35.523296+0000","last_became_peered":"2023-10-03T19:17:35.523296+0000","last_unstale":"2023-10-03T19:17:36.591001+0000","last_undegraded":"2023-10-03T19:17:36.591001+0000","last_fullsized":"2023-10-03T19:17:36.591001+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:15:55.315434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.586420+0000","last_change":"2023-10-03T19:17:34.987519+0000","last_active":"2023-10-03T19:17:36.586420+0000","last_peered":"2023-10-03T19:17:36.586420+0000","last_clean":"2023-10-03T19:17:36.586420+0000","last_became_active":"2023-10-03T19:17:34.987220+0000","last_became_peered":"2023-10-03T19:17:34.987220+0000","last_unstale":"2023-10-03T19:17:36.586420+0000","last_undegraded":"2023-10-03T19:17:36.586420+0000","last_fullsized":"2023-10-03T19:17:36.586420+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:45:02.155286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.508336+0000","last_change":"2023-10-03T19:17:35.548253+0000","last_active":"2023-10-03T19:17:36.508336+0000","last_peered":"2023-10-03T19:17:36.508336+0000","last_clean":"2023-10-03T19:17:36.508336+0000","last_became_active":"2023-10-03T19:17:35.547119+0000","last_became_peered":"2023-10-03T19:17:35.547119+0000","last_unstale":"2023-10-03T19:17:36.508336+0000","last_undegraded":"2023-10-03T19:17:36.508336+0000","last_fullsized":"2023-10-03T19:17:36.508336+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:52:06.365823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.592142+0000","last_change":"2023-10-03T19:17:34.994675+0000","last_active":"2023-10-03T19:17:36.592142+0000","last_peered":"2023-10-03T19:17:36.592142+0000","last_clean":"2023-10-03T19:17:36.592142+0000","last_became_active":"2023-10-03T19:17:34.994014+0000","last_became_peered":"2023-10-03T19:17:34.994014+0000","last_unstale":"2023-10-03T19:17:36.592142+0000","last_undegraded":"2023-10-03T19:17:36.592142+0000","last_fullsized":"2023-10-03T19:17:36.592142+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:00:23.194879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.515534+0000","last_change":"2023-10-03T19:17:35.574919+0000","last_active":"2023-10-03T19:17:36.515534+0000","last_peered":"2023-10-03T19:17:36.515534+0000","last_clean":"2023-10-03T19:17:36.515534+0000","last_became_active":"2023-10-03T19:17:35.572469+0000","last_became_peered":"2023-10-03T19:17:35.572469+0000","last_unstale":"2023-10-03T19:17:36.515534+0000","last_undegraded":"2023-10-03T19:17:36.515534+0000","last_fullsized":"2023-10-03T19:17:36.515534+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:46:22.473033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.514926+0000","last_change":"2023-10-03T19:17:34.983598+0000","last_active":"2023-10-03T19:17:36.514926+0000","last_peered":"2023-10-03T19:17:36.514926+0000","last_clean":"2023-10-03T19:17:36.514926+0000","last_became_active":"2023-10-03T19:17:34.982807+0000","last_became_peered":"2023-10-03T19:17:34.982807+0000","last_unstale":"2023-10-03T19:17:36.514926+0000","last_undegraded":"2023-10-03T19:17:36.514926+0000","last_fullsized":"2023-10-03T19:17:36.514926+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:46:00.220125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-03T19:17:35.526201+0000","last_change":"2023-10-03T19:17:35.519463+0000","last_active":"2023-10-03T19:17:35.526201+0000","last_peered":"2023-10-03T19:17:35.526201+0000","last_clean":"2023-10-03T19:17:35.526201+0000","last_became_active":"2023-10-03T19:17:35.518872+0000","last_became_peered":"2023-10-03T19:17:35.518872+0000","last_unstale":"2023-10-03T19:17:35.526201+0000","last_undegraded":"2023-10-03T19:17:35.526201+0000","last_fullsized":"2023-10-03T19:17:35.526201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:21:14.582919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"73'3","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.586950+0000","last_change":"2023-10-03T19:17:34.972880+0000","last_active":"2023-10-03T19:17:36.586950+0000","last_peered":"2023-10-03T19:17:36.586950+0000","last_clean":"2023-10-03T19:17:36.586950+0000","last_became_active":"2023-10-03T19:17:34.972082+0000","last_became_peered":"2023-10-03T19:17:34.972082+0000","last_unstale":"2023-10-03T19:17:36.586950+0000","last_undegraded":"2023-10-03T19:17:36.586950+0000","last_fullsized":"2023-10-03T19:17:36.586950+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:10:42.884254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.540873+0000","last_change":"2023-10-03T19:17:35.523673+0000","last_active":"2023-10-03T19:17:36.540873+0000","last_peered":"2023-10-03T19:17:36.540873+0000","last_clean":"2023-10-03T19:17:36.540873+0000","last_became_active":"2023-10-03T19:17:35.523341+0000","last_became_peered":"2023-10-03T19:17:35.523341+0000","last_unstale":"2023-10-03T19:17:36.540873+0000","last_undegraded":"2023-10-03T19:17:36.540873+0000","last_fullsized":"2023-10-03T19:17:36.540873+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:20:09.018778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"73'6","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.591092+0000","last_change":"2023-10-03T19:17:34.992230+0000","last_active":"2023-10-03T19:17:36.591092+0000","last_peered":"2023-10-03T19:17:36.591092+0000","last_clean":"2023-10-03T19:17:36.591092+0000","last_became_active":"2023-10-03T19:17:34.991636+0000","last_became_peered":"2023-10-03T19:17:34.991636+0000","last_unstale":"2023-10-03T19:17:36.591092+0000","last_undegraded":"2023-10-03T19:17:36.591092+0000","last_fullsized":"2023-10-03T19:17:36.591092+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:01:54.050262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.514870+0000","last_change":"2023-10-03T19:17:35.542559+0000","last_active":"2023-10-03T19:17:36.514870+0000","last_peered":"2023-10-03T19:17:36.514870+0000","last_clean":"2023-10-03T19:17:36.514870+0000","last_became_active":"2023-10-03T19:17:35.541822+0000","last_became_peered":"2023-10-03T19:17:35.541822+0000","last_unstale":"2023-10-03T19:17:36.514870+0000","last_undegraded":"2023-10-03T19:17:36.514870+0000","last_fullsized":"2023-10-03T19:17:36.514870+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:55:16.939500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"73'2","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.513597+0000","last_change":"2023-10-03T19:17:34.984310+0000","last_active":"2023-10-03T19:17:36.513597+0000","last_peered":"2023-10-03T19:17:36.513597+0000","last_clean":"2023-10-03T19:17:36.513597+0000","last_became_active":"2023-10-03T19:17:34.983598+0000","last_became_peered":"2023-10-03T19:17:34.983598+0000","last_unstale":"2023-10-03T19:17:36.513597+0000","last_undegraded":"2023-10-03T19:17:36.513597+0000","last_fullsized":"2023-10-03T19:17:36.513597+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:12:03.918571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.590456+0000","last_change":"2023-10-03T19:17:35.527552+0000","last_active":"2023-10-03T19:17:36.590456+0000","last_peered":"2023-10-03T19:17:36.590456+0000","last_clean":"2023-10-03T19:17:36.590456+0000","last_became_active":"2023-10-03T19:17:35.526536+0000","last_became_peered":"2023-10-03T19:17:35.526536+0000","last_unstale":"2023-10-03T19:17:36.590456+0000","last_undegraded":"2023-10-03T19:17:36.590456+0000","last_fullsized":"2023-10-03T19:17:36.590456+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:49:15.072045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.591174+0000","last_change":"2023-10-03T19:17:34.985937+0000","last_active":"2023-10-03T19:17:36.591174+0000","last_peered":"2023-10-03T19:17:36.591174+0000","last_clean":"2023-10-03T19:17:36.591174+0000","last_became_active":"2023-10-03T19:17:34.985121+0000","last_became_peered":"2023-10-03T19:17:34.985121+0000","last_unstale":"2023-10-03T19:17:36.591174+0000","last_undegraded":"2023-10-03T19:17:36.591174+0000","last_fullsized":"2023-10-03T19:17:36.591174+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:23:23.735338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.590764+0000","last_change":"2023-10-03T19:17:35.573678+0000","last_active":"2023-10-03T19:17:36.590764+0000","last_peered":"2023-10-03T19:17:36.590764+0000","last_clean":"2023-10-03T19:17:36.590764+0000","last_became_active":"2023-10-03T19:17:35.573281+0000","last_became_peered":"2023-10-03T19:17:35.573281+0000","last_unstale":"2023-10-03T19:17:36.590764+0000","last_undegraded":"2023-10-03T19:17:36.590764+0000","last_fullsized":"2023-10-03T19:17:36.590764+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:11:58.029618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.586952+0000","last_change":"2023-10-03T19:17:34.971508+0000","last_active":"2023-10-03T19:17:36.586952+0000","last_peered":"2023-10-03T19:17:36.586952+0000","last_clean":"2023-10-03T19:17:36.586952+0000","last_became_active":"2023-10-03T19:17:34.970573+0000","last_became_peered":"2023-10-03T19:17:34.970573+0000","last_unstale":"2023-10-03T19:17:36.586952+0000","last_undegraded":"2023-10-03T19:17:36.586952+0000","last_fullsized":"2023-10-03T19:17:36.586952+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:40:31.779140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.591183+0000","last_change":"2023-10-03T19:17:35.530725+0000","last_active":"2023-10-03T19:17:36.591183+0000","last_peered":"2023-10-03T19:17:36.591183+0000","last_clean":"2023-10-03T19:17:36.591183+0000","last_became_active":"2023-10-03T19:17:35.530029+0000","last_became_peered":"2023-10-03T19:17:35.530029+0000","last_unstale":"2023-10-03T19:17:36.591183+0000","last_undegraded":"2023-10-03T19:17:36.591183+0000","last_fullsized":"2023-10-03T19:17:36.591183+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:34:35.245586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"73'8","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.508658+0000","last_change":"2023-10-03T19:17:34.978823+0000","last_active":"2023-10-03T19:17:36.508658+0000","last_peered":"2023-10-03T19:17:36.508658+0000","last_clean":"2023-10-03T19:17:36.508658+0000","last_became_active":"2023-10-03T19:17:34.978368+0000","last_became_peered":"2023-10-03T19:17:34.978368+0000","last_unstale":"2023-10-03T19:17:36.508658+0000","last_undegraded":"2023-10-03T19:17:36.508658+0000","last_fullsized":"2023-10-03T19:17:36.508658+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:07:26.851905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.515038+0000","last_change":"2023-10-03T19:17:35.561595+0000","last_active":"2023-10-03T19:17:36.515038+0000","last_peered":"2023-10-03T19:17:36.515038+0000","last_clean":"2023-10-03T19:17:36.515038+0000","last_became_active":"2023-10-03T19:17:35.560931+0000","last_became_peered":"2023-10-03T19:17:35.560931+0000","last_unstale":"2023-10-03T19:17:36.515038+0000","last_undegraded":"2023-10-03T19:17:36.515038+0000","last_fullsized":"2023-10-03T19:17:36.515038+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:12:48.956092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"73'2","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.513994+0000","last_change":"2023-10-03T19:17:34.983172+0000","last_active":"2023-10-03T19:17:36.513994+0000","last_peered":"2023-10-03T19:17:36.513994+0000","last_clean":"2023-10-03T19:17:36.513994+0000","last_became_active":"2023-10-03T19:17:34.982492+0000","last_became_peered":"2023-10-03T19:17:34.982492+0000","last_unstale":"2023-10-03T19:17:36.513994+0000","last_undegraded":"2023-10-03T19:17:36.513994+0000","last_fullsized":"2023-10-03T19:17:36.513994+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:16:58.045471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.590521+0000","last_change":"2023-10-03T19:17:35.540981+0000","last_active":"2023-10-03T19:17:36.590521+0000","last_peered":"2023-10-03T19:17:36.590521+0000","last_clean":"2023-10-03T19:17:36.590521+0000","last_became_active":"2023-10-03T19:17:35.540286+0000","last_became_peered":"2023-10-03T19:17:35.540286+0000","last_unstale":"2023-10-03T19:17:36.590521+0000","last_undegraded":"2023-10-03T19:17:36.590521+0000","last_fullsized":"2023-10-03T19:17:36.590521+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:27:02.691573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.509731+0000","last_change":"2023-10-03T19:17:34.966792+0000","last_active":"2023-10-03T19:17:36.509731+0000","last_peered":"2023-10-03T19:17:36.509731+0000","last_clean":"2023-10-03T19:17:36.509731+0000","last_became_active":"2023-10-03T19:17:34.966475+0000","last_became_peered":"2023-10-03T19:17:34.966475+0000","last_unstale":"2023-10-03T19:17:36.509731+0000","last_undegraded":"2023-10-03T19:17:36.509731+0000","last_fullsized":"2023-10-03T19:17:36.509731+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:06:06.750947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.515808+0000","last_change":"2023-10-03T19:17:35.560040+0000","last_active":"2023-10-03T19:17:36.515808+0000","last_peered":"2023-10-03T19:17:36.515808+0000","last_clean":"2023-10-03T19:17:36.515808+0000","last_became_active":"2023-10-03T19:17:35.558233+0000","last_became_peered":"2023-10-03T19:17:35.558233+0000","last_unstale":"2023-10-03T19:17:36.515808+0000","last_undegraded":"2023-10-03T19:17:36.515808+0000","last_fullsized":"2023-10-03T19:17:36.515808+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:26:08.801209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.592888+0000","last_change":"2023-10-03T19:17:34.991792+0000","last_active":"2023-10-03T19:17:36.592888+0000","last_peered":"2023-10-03T19:17:36.592888+0000","last_clean":"2023-10-03T19:17:36.592888+0000","last_became_active":"2023-10-03T19:17:34.991144+0000","last_became_peered":"2023-10-03T19:17:34.991144+0000","last_unstale":"2023-10-03T19:17:36.592888+0000","last_undegraded":"2023-10-03T19:17:36.592888+0000","last_fullsized":"2023-10-03T19:17:36.592888+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:31:17.349964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.509205+0000","last_change":"2023-10-03T19:17:35.557074+0000","last_active":"2023-10-03T19:17:36.509205+0000","last_peered":"2023-10-03T19:17:36.509205+0000","last_clean":"2023-10-03T19:17:36.509205+0000","last_became_active":"2023-10-03T19:17:35.556801+0000","last_became_peered":"2023-10-03T19:17:35.556801+0000","last_unstale":"2023-10-03T19:17:36.509205+0000","last_undegraded":"2023-10-03T19:17:36.509205+0000","last_fullsized":"2023-10-03T19:17:36.509205+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:10:41.284763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.591738+0000","last_change":"2023-10-03T19:17:34.992854+0000","last_active":"2023-10-03T19:17:36.591738+0000","last_peered":"2023-10-03T19:17:36.591738+0000","last_clean":"2023-10-03T19:17:36.591738+0000","last_became_active":"2023-10-03T19:17:34.992183+0000","last_became_peered":"2023-10-03T19:17:34.992183+0000","last_unstale":"2023-10-03T19:17:36.591738+0000","last_undegraded":"2023-10-03T19:17:36.591738+0000","last_fullsized":"2023-10-03T19:17:36.591738+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:27:29.761838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.590495+0000","last_change":"2023-10-03T19:17:35.539169+0000","last_active":"2023-10-03T19:17:36.590495+0000","last_peered":"2023-10-03T19:17:36.590495+0000","last_clean":"2023-10-03T19:17:36.590495+0000","last_became_active":"2023-10-03T19:17:35.538563+0000","last_became_peered":"2023-10-03T19:17:35.538563+0000","last_unstale":"2023-10-03T19:17:36.590495+0000","last_undegraded":"2023-10-03T19:17:36.590495+0000","last_fullsized":"2023-10-03T19:17:36.590495+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:03:24.151546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.591097+0000","last_change":"2023-10-03T19:17:34.981348+0000","last_active":"2023-10-03T19:17:36.591097+0000","last_peered":"2023-10-03T19:17:36.591097+0000","last_clean":"2023-10-03T19:17:36.591097+0000","last_became_active":"2023-10-03T19:17:34.980568+0000","last_became_peered":"2023-10-03T19:17:34.980568+0000","last_unstale":"2023-10-03T19:17:36.591097+0000","last_undegraded":"2023-10-03T19:17:36.591097+0000","last_fullsized":"2023-10-03T19:17:36.591097+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:11:06.620842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.590807+0000","last_change":"2023-10-03T19:17:35.529960+0000","last_active":"2023-10-03T19:17:36.590807+0000","last_peered":"2023-10-03T19:17:36.590807+0000","last_clean":"2023-10-03T19:17:36.590807+0000","last_became_active":"2023-10-03T19:17:35.527563+0000","last_became_peered":"2023-10-03T19:17:35.527563+0000","last_unstale":"2023-10-03T19:17:36.590807+0000","last_undegraded":"2023-10-03T19:17:36.590807+0000","last_fullsized":"2023-10-03T19:17:36.590807+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:01:11.068696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.586161+0000","last_change":"2023-10-03T19:17:34.972038+0000","last_active":"2023-10-03T19:17:36.586161+0000","last_peered":"2023-10-03T19:17:36.586161+0000","last_clean":"2023-10-03T19:17:36.586161+0000","last_became_active":"2023-10-03T19:17:34.971250+0000","last_became_peered":"2023-10-03T19:17:34.971250+0000","last_unstale":"2023-10-03T19:17:36.586161+0000","last_undegraded":"2023-10-03T19:17:36.586161+0000","last_fullsized":"2023-10-03T19:17:36.586161+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:55:49.987415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.541071+0000","last_change":"2023-10-03T19:17:35.531236+0000","last_active":"2023-10-03T19:17:36.541071+0000","last_peered":"2023-10-03T19:17:36.541071+0000","last_clean":"2023-10-03T19:17:36.541071+0000","last_became_active":"2023-10-03T19:17:35.530969+0000","last_became_peered":"2023-10-03T19:17:35.530969+0000","last_unstale":"2023-10-03T19:17:36.541071+0000","last_undegraded":"2023-10-03T19:17:36.541071+0000","last_fullsized":"2023-10-03T19:17:36.541071+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:17:19.019240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.590878+0000","last_change":"2023-10-03T19:17:34.981384+0000","last_active":"2023-10-03T19:17:36.590878+0000","last_peered":"2023-10-03T19:17:36.590878+0000","last_clean":"2023-10-03T19:17:36.590878+0000","last_became_active":"2023-10-03T19:17:34.980632+0000","last_became_peered":"2023-10-03T19:17:34.980632+0000","last_unstale":"2023-10-03T19:17:36.590878+0000","last_undegraded":"2023-10-03T19:17:36.590878+0000","last_fullsized":"2023-10-03T19:17:36.590878+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:28:15.360808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.541255+0000","last_change":"2023-10-03T19:17:35.547532+0000","last_active":"2023-10-03T19:17:36.541255+0000","last_peered":"2023-10-03T19:17:36.541255+0000","last_clean":"2023-10-03T19:17:36.541255+0000","last_became_active":"2023-10-03T19:17:35.547235+0000","last_became_peered":"2023-10-03T19:17:35.547235+0000","last_unstale":"2023-10-03T19:17:36.541255+0000","last_undegraded":"2023-10-03T19:17:36.541255+0000","last_fullsized":"2023-10-03T19:17:36.541255+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:10:20.454121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.540291+0000","last_change":"2023-10-03T19:17:34.956109+0000","last_active":"2023-10-03T19:17:36.540291+0000","last_peered":"2023-10-03T19:17:36.540291+0000","last_clean":"2023-10-03T19:17:36.540291+0000","last_became_active":"2023-10-03T19:17:34.953243+0000","last_became_peered":"2023-10-03T19:17:34.953243+0000","last_unstale":"2023-10-03T19:17:36.540291+0000","last_undegraded":"2023-10-03T19:17:36.540291+0000","last_fullsized":"2023-10-03T19:17:36.540291+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:04:06.426725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.592547+0000","last_change":"2023-10-03T19:17:35.564737+0000","last_active":"2023-10-03T19:17:36.592547+0000","last_peered":"2023-10-03T19:17:36.592547+0000","last_clean":"2023-10-03T19:17:36.592547+0000","last_became_active":"2023-10-03T19:17:35.564216+0000","last_became_peered":"2023-10-03T19:17:35.564216+0000","last_unstale":"2023-10-03T19:17:36.592547+0000","last_undegraded":"2023-10-03T19:17:36.592547+0000","last_fullsized":"2023-10-03T19:17:36.592547+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:55:52.219904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-03T19:17:35.511433+0000","last_change":"2023-10-03T19:17:34.987385+0000","last_active":"2023-10-03T19:17:35.511433+0000","last_peered":"2023-10-03T19:17:35.511433+0000","last_clean":"2023-10-03T19:17:35.511433+0000","last_became_active":"2023-10-03T19:17:34.986923+0000","last_became_peered":"2023-10-03T19:17:34.986923+0000","last_unstale":"2023-10-03T19:17:35.511433+0000","last_undegraded":"2023-10-03T19:17:35.511433+0000","last_fullsized":"2023-10-03T19:17:35.511433+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:30:15.967193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":269,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.591791+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:17:36.591791+0000","last_peered":"2023-10-03T19:17:36.591791+0000","last_clean":"2023-10-03T19:17:36.591791+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:17:36.591791+0000","last_undegraded":"2023-10-03T19:17:36.591791+0000","last_fullsized":"2023-10-03T19:17:36.591791+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:21:38.816278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":117,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.515290+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:17:36.515290+0000","last_peered":"2023-10-03T19:17:36.515290+0000","last_clean":"2023-10-03T19:17:36.515290+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:17:36.515290+0000","last_undegraded":"2023-10-03T19:17:36.515290+0000","last_fullsized":"2023-10-03T19:17:36.515290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:03:59.302429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.509555+0000","last_change":"2023-10-03T19:17:35.569621+0000","last_active":"2023-10-03T19:17:36.509555+0000","last_peered":"2023-10-03T19:17:36.509555+0000","last_clean":"2023-10-03T19:17:36.509555+0000","last_became_active":"2023-10-03T19:17:35.569273+0000","last_became_peered":"2023-10-03T19:17:35.569273+0000","last_unstale":"2023-10-03T19:17:36.509555+0000","last_undegraded":"2023-10-03T19:17:36.509555+0000","last_fullsized":"2023-10-03T19:17:36.509555+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:56:28.279085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-03T19:17:35.508516+0000","last_change":"2023-10-03T19:17:34.987328+0000","last_active":"2023-10-03T19:17:35.508516+0000","last_peered":"2023-10-03T19:17:35.508516+0000","last_clean":"2023-10-03T19:17:35.508516+0000","last_became_active":"2023-10-03T19:17:34.986860+0000","last_became_peered":"2023-10-03T19:17:34.986860+0000","last_unstale":"2023-10-03T19:17:35.508516+0000","last_undegraded":"2023-10-03T19:17:35.508516+0000","last_fullsized":"2023-10-03T19:17:35.508516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:38:03.835027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":117,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.591656+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:17:36.591656+0000","last_peered":"2023-10-03T19:17:36.591656+0000","last_clean":"2023-10-03T19:17:36.591656+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:17:36.591656+0000","last_undegraded":"2023-10-03T19:17:36.591656+0000","last_fullsized":"2023-10-03T19:17:36.591656+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:17:13.546628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.591346+0000","last_change":"2023-10-03T19:17:35.535353+0000","last_active":"2023-10-03T19:17:36.591346+0000","last_peered":"2023-10-03T19:17:36.591346+0000","last_clean":"2023-10-03T19:17:36.591346+0000","last_became_active":"2023-10-03T19:17:35.534638+0000","last_became_peered":"2023-10-03T19:17:35.534638+0000","last_unstale":"2023-10-03T19:17:36.591346+0000","last_undegraded":"2023-10-03T19:17:36.591346+0000","last_fullsized":"2023-10-03T19:17:36.591346+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:11:16.336231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-03T19:17:35.508741+0000","last_change":"2023-10-03T19:17:34.987217+0000","last_active":"2023-10-03T19:17:35.508741+0000","last_peered":"2023-10-03T19:17:35.508741+0000","last_clean":"2023-10-03T19:17:35.508741+0000","last_became_active":"2023-10-03T19:17:34.986805+0000","last_became_peered":"2023-10-03T19:17:34.986805+0000","last_unstale":"2023-10-03T19:17:35.508741+0000","last_undegraded":"2023-10-03T19:17:35.508741+0000","last_fullsized":"2023-10-03T19:17:35.508741+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:38:42.623813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":115,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.587019+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:17:36.587019+0000","last_peered":"2023-10-03T19:17:36.587019+0000","last_clean":"2023-10-03T19:17:36.587019+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:17:36.587019+0000","last_undegraded":"2023-10-03T19:17:36.587019+0000","last_fullsized":"2023-10-03T19:17:36.587019+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:08:00.435854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.509229+0000","last_change":"2023-10-03T19:17:35.541433+0000","last_active":"2023-10-03T19:17:36.509229+0000","last_peered":"2023-10-03T19:17:36.509229+0000","last_clean":"2023-10-03T19:17:36.509229+0000","last_became_active":"2023-10-03T19:17:35.541149+0000","last_became_peered":"2023-10-03T19:17:35.541149+0000","last_unstale":"2023-10-03T19:17:36.509229+0000","last_undegraded":"2023-10-03T19:17:36.509229+0000","last_fullsized":"2023-10-03T19:17:36.509229+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:51:31.787300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"73'2","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-03T19:17:35.526787+0000","last_change":"2023-10-03T19:17:34.962338+0000","last_active":"2023-10-03T19:17:35.526787+0000","last_peered":"2023-10-03T19:17:35.526787+0000","last_clean":"2023-10-03T19:17:35.526787+0000","last_became_active":"2023-10-03T19:17:34.962075+0000","last_became_peered":"2023-10-03T19:17:34.962075+0000","last_unstale":"2023-10-03T19:17:35.526787+0000","last_undegraded":"2023-10-03T19:17:35.526787+0000","last_fullsized":"2023-10-03T19:17:35.526787+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:16:20.775927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":117,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.513656+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:17:36.513656+0000","last_peered":"2023-10-03T19:17:36.513656+0000","last_clean":"2023-10-03T19:17:36.513656+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:17:36.513656+0000","last_undegraded":"2023-10-03T19:17:36.513656+0000","last_fullsized":"2023-10-03T19:17:36.513656+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:19:49.048391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.585742+0000","last_change":"2023-10-03T19:17:35.532610+0000","last_active":"2023-10-03T19:17:36.585742+0000","last_peered":"2023-10-03T19:17:36.585742+0000","last_clean":"2023-10-03T19:17:36.585742+0000","last_became_active":"2023-10-03T19:17:35.530780+0000","last_became_peered":"2023-10-03T19:17:35.530780+0000","last_unstale":"2023-10-03T19:17:36.585742+0000","last_undegraded":"2023-10-03T19:17:36.585742+0000","last_fullsized":"2023-10-03T19:17:36.585742+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:44:59.634334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"73'1","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.587121+0000","last_change":"2023-10-03T19:17:34.988633+0000","last_active":"2023-10-03T19:17:36.587121+0000","last_peered":"2023-10-03T19:17:36.587121+0000","last_clean":"2023-10-03T19:17:36.587121+0000","last_became_active":"2023-10-03T19:17:34.988248+0000","last_became_peered":"2023-10-03T19:17:34.988248+0000","last_unstale":"2023-10-03T19:17:36.587121+0000","last_undegraded":"2023-10-03T19:17:36.587121+0000","last_fullsized":"2023-10-03T19:17:36.587121+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:28:27.102694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":115,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.540697+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:17:36.540697+0000","last_peered":"2023-10-03T19:17:36.540697+0000","last_clean":"2023-10-03T19:17:36.540697+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:17:36.540697+0000","last_undegraded":"2023-10-03T19:17:36.540697+0000","last_fullsized":"2023-10-03T19:17:36.540697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:15:38.947914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-03T19:17:35.528543+0000","last_change":"2023-10-03T19:17:35.526532+0000","last_active":"2023-10-03T19:17:35.528543+0000","last_peered":"2023-10-03T19:17:35.528543+0000","last_clean":"2023-10-03T19:17:35.528543+0000","last_became_active":"2023-10-03T19:17:35.525993+0000","last_became_peered":"2023-10-03T19:17:35.525993+0000","last_unstale":"2023-10-03T19:17:35.528543+0000","last_undegraded":"2023-10-03T19:17:35.528543+0000","last_fullsized":"2023-10-03T19:17:35.528543+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:07:03.811328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.540475+0000","last_change":"2023-10-03T19:17:34.972068+0000","last_active":"2023-10-03T19:17:36.540475+0000","last_peered":"2023-10-03T19:17:36.540475+0000","last_clean":"2023-10-03T19:17:36.540475+0000","last_became_active":"2023-10-03T19:17:34.971604+0000","last_became_peered":"2023-10-03T19:17:34.971604+0000","last_unstale":"2023-10-03T19:17:36.540475+0000","last_undegraded":"2023-10-03T19:17:36.540475+0000","last_fullsized":"2023-10-03T19:17:36.540475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:17:10.891033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":117,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.592744+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:17:36.592744+0000","last_peered":"2023-10-03T19:17:36.592744+0000","last_clean":"2023-10-03T19:17:36.592744+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:17:36.592744+0000","last_undegraded":"2023-10-03T19:17:36.592744+0000","last_fullsized":"2023-10-03T19:17:36.592744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:14:48.702198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-03T19:17:35.526121+0000","last_change":"2023-10-03T19:17:35.518292+0000","last_active":"2023-10-03T19:17:35.526121+0000","last_peered":"2023-10-03T19:17:35.526121+0000","last_clean":"2023-10-03T19:17:35.526121+0000","last_became_active":"2023-10-03T19:17:35.517978+0000","last_became_peered":"2023-10-03T19:17:35.517978+0000","last_unstale":"2023-10-03T19:17:35.526121+0000","last_undegraded":"2023-10-03T19:17:35.526121+0000","last_fullsized":"2023-10-03T19:17:35.526121+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:21:48.943972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"73'1","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.592482+0000","last_change":"2023-10-03T19:17:34.991315+0000","last_active":"2023-10-03T19:17:36.592482+0000","last_peered":"2023-10-03T19:17:36.592482+0000","last_clean":"2023-10-03T19:17:36.592482+0000","last_became_active":"2023-10-03T19:17:34.990035+0000","last_became_peered":"2023-10-03T19:17:34.990035+0000","last_unstale":"2023-10-03T19:17:36.592482+0000","last_undegraded":"2023-10-03T19:17:36.592482+0000","last_fullsized":"2023-10-03T19:17:36.592482+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:20:54.119868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":115,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.541205+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:17:36.541205+0000","last_peered":"2023-10-03T19:17:36.541205+0000","last_clean":"2023-10-03T19:17:36.541205+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:17:36.541205+0000","last_undegraded":"2023-10-03T19:17:36.541205+0000","last_fullsized":"2023-10-03T19:17:36.541205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:24:48.460375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.586900+0000","last_change":"2023-10-03T19:17:35.537768+0000","last_active":"2023-10-03T19:17:36.586900+0000","last_peered":"2023-10-03T19:17:36.586900+0000","last_clean":"2023-10-03T19:17:36.586900+0000","last_became_active":"2023-10-03T19:17:35.537529+0000","last_became_peered":"2023-10-03T19:17:35.537529+0000","last_unstale":"2023-10-03T19:17:36.586900+0000","last_undegraded":"2023-10-03T19:17:36.586900+0000","last_fullsized":"2023-10-03T19:17:36.586900+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:30:16.325646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"73'2","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.516553+0000","last_change":"2023-10-03T19:17:34.972327+0000","last_active":"2023-10-03T19:17:36.516553+0000","last_peered":"2023-10-03T19:17:36.516553+0000","last_clean":"2023-10-03T19:17:36.516553+0000","last_became_active":"2023-10-03T19:17:34.971524+0000","last_became_peered":"2023-10-03T19:17:34.971524+0000","last_unstale":"2023-10-03T19:17:36.516553+0000","last_undegraded":"2023-10-03T19:17:36.516553+0000","last_fullsized":"2023-10-03T19:17:36.516553+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:00:25.168056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":115,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.591447+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:17:36.591447+0000","last_peered":"2023-10-03T19:17:36.591447+0000","last_clean":"2023-10-03T19:17:36.591447+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:17:36.591447+0000","last_undegraded":"2023-10-03T19:17:36.591447+0000","last_fullsized":"2023-10-03T19:17:36.591447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:22:38.090487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509506,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":26496,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":962560,"data_stored":993604,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27131904},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.87,"15min":0.93200000000000005},"min":{"1min":0.503,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1399999999999999,"5min":4.0469999999999997,"15min":4.0469999999999997},"last":1.206},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.85499999999999998,"15min":0.81100000000000005},"min":{"1min":0.55100000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1699999999999999,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.97299999999999998}]},{"osd":1,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.90000000000000002,"15min":1.012},"min":{"1min":0.59999999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.194,"5min":3.8239999999999998,"15min":3.8239999999999998},"last":1.006},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.88600000000000001,"15min":0.85999999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2609999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.72599999999999998}]},{"osd":2,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.94099999999999995,"15min":0.871},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.236,"5min":6.0449999999999999,"15min":6.0449999999999999},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.96899999999999997,"15min":1.0289999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2949999999999999,"5min":3.98,"15min":3.98},"last":1.1000000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0249999999999999,"15min":0.95399999999999996},"min":{"1min":0.64700000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":3.3940000000000001,"5min":6.125,"15min":6.125},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.038,"15min":1.1120000000000001},"min":{"1min":0.77800000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1259999999999999,"5min":3.9140000000000001,"15min":3.9140000000000001},"last":0.88}]},{"osd":4,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.96799999999999997,"15min":1.1379999999999999},"min":{"1min":0.63800000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1160000000000001,"5min":5.1130000000000004,"15min":5.1130000000000004},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.012,"5min":1.018,"15min":1.0269999999999999},"min":{"1min":0.67900000000000005,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.3380000000000001,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":0.93700000000000006}]},{"osd":5,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.0680000000000001,"15min":1.246},"min":{"1min":0.69499999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2250000000000001,"5min":5.1859999999999999,"15min":5.1859999999999999},"last":1.155},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.0449999999999999,"15min":1.133},"min":{"1min":0.82199999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.163,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.1279999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.085,"15min":1.097},"min":{"1min":0.75700000000000001,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.2190000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.105,"5min":1.1619999999999999,"15min":1.1799999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.3999999999999999,"5min":6.1580000000000004,"15min":6.1580000000000004},"last":0.78700000000000003}]}]},{"osd":6,"up_from":15,"seq":64424509506,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15928,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":15040,"kb_avail":94355912,"statfs":{"total":96636764160,"available":96620453888,"internally_reserved":0,"allocated":901120,"data_stored":403614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15400960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:17:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.84399999999999997,"15min":0.82199999999999995},"min":{"1min":0.45400000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3340000000000001,"5min":1.504,"15min":1.504},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.89000000000000001,"15min":0.88200000000000001},"min":{"1min":0.58099999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1950000000000001,"5min":1.839,"15min":1.839},"last":0.88800000000000001}]},{"osd":1,"last update":"Tue Oct 3 19:17:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.85999999999999999,"15min":0.84199999999999997},"min":{"1min":0.53900000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.27,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.90000000000000002,"15min":0.88400000000000001},"min":{"1min":0.58199999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1879999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.98499999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:17:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.93000000000000005,"15min":0.878},"min":{"1min":0.66100000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1890000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.91400000000000003,"15min":0.92400000000000004},"min":{"1min":0.60199999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.369,"5min":1.546,"15min":1.546},"last":0.79500000000000004}]},{"osd":3,"last update":"Tue Oct 3 19:17:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95899999999999996,"15min":0.97899999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1859999999999999,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.90500000000000003,"15min":0.90800000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.206,"5min":2.121,"15min":2.121},"last":0.91100000000000003}]},{"osd":4,"last update":"Tue Oct 3 19:17:29 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.94899999999999995,"15min":1.018},"min":{"1min":0.64900000000000002,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.28,"5min":1.95,"15min":1.95},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0069999999999999,"15min":1.0820000000000001},"min":{"1min":0.68999999999999995,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2989999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.67400000000000004}]},{"osd":5,"last update":"Tue Oct 3 19:17:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.94399999999999995,"15min":1.01},"min":{"1min":0.65100000000000002,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.276,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0669999999999999,"15min":1.1160000000000001},"min":{"1min":0.70699999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.3420000000000001,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.83599999999999997}]},{"osd":7,"last update":"Tue Oct 3 19:17:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0740000000000001,"15min":1.115},"min":{"1min":0.81200000000000006,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.3049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.014},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.05,"15min":1.0900000000000001},"min":{"1min":0.70199999999999996,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3420000000000001,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":0.95199999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509507,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26360,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":25472,"kb_avail":94345480,"statfs":{"total":96636764160,"available":96609771520,"internally_reserved":0,"allocated":901120,"data_stored":398229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":26083328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:17:24 2023","interfaces":[{"interface":"back","average":{"1min":1.804,"5min":1.0429999999999999,"15min":0.85899999999999999},"min":{"1min":0.63900000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":17.686,"5min":17.686,"15min":17.686},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.665,"5min":1.0089999999999999,"15min":0.88200000000000001},"min":{"1min":0.56399999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":16.925999999999998,"5min":16.925999999999998,"15min":16.925999999999998},"last":0.76000000000000001}]},{"osd":1,"last update":"Tue Oct 3 19:17:24 2023","interfaces":[{"interface":"back","average":{"1min":1.726,"5min":1.077,"15min":0.98399999999999999},"min":{"1min":0.68899999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":16.640999999999998,"5min":16.640999999999998,"15min":16.640999999999998},"last":1.143},{"interface":"front","average":{"1min":1.78,"5min":1.0840000000000001,"15min":0.92400000000000004},"min":{"1min":0.63100000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":17.59,"5min":17.59,"15min":17.59},"last":1.018}]},{"osd":2,"last update":"Tue Oct 3 19:17:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.0209999999999999,"15min":0.94399999999999995},"min":{"1min":0.63500000000000001,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":8.5630000000000006,"5min":8.5630000000000006,"15min":8.5630000000000006},"last":0.874},{"interface":"front","average":{"1min":1.839,"5min":1.147,"15min":1.0049999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":17.734000000000002,"5min":17.734000000000002,"15min":17.734000000000002},"last":0.80000000000000004}]},{"osd":3,"last update":"Tue Oct 3 19:17:24 2023","interfaces":[{"interface":"back","average":{"1min":1.6890000000000001,"5min":1.0580000000000001,"15min":0.93200000000000005},"min":{"1min":0.64800000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":16.98,"5min":16.98,"15min":16.98},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.823,"5min":1.194,"15min":1.115},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":16.434000000000001,"5min":16.434000000000001,"15min":16.434000000000001},"last":1.05}]},{"osd":5,"last update":"Tue Oct 3 19:17:24 2023","interfaces":[{"interface":"back","average":{"1min":1.839,"5min":1.143,"15min":1.101},"min":{"1min":0.622,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":17.782,"5min":17.782,"15min":17.782},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.97599999999999998,"15min":1.01},"min":{"1min":0.81000000000000005,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.627,"5min":1.635,"15min":1.635},"last":0.94799999999999995}]},{"osd":6,"last update":"Tue Oct 3 19:17:24 2023","interfaces":[{"interface":"back","average":{"1min":2.9100000000000001,"5min":1.413,"15min":1.2949999999999999},"min":{"1min":0.68400000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":36.106000000000002,"5min":36.106000000000002,"15min":36.106000000000002},"last":1.236},{"interface":"front","average":{"1min":2.0059999999999998,"5min":1.27,"15min":1.234},"min":{"1min":0.70799999999999996,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":17.646999999999998,"5min":17.646999999999998,"15min":17.646999999999998},"last":1.173}]},{"osd":7,"last update":"Tue Oct 3 19:17:24 2023","interfaces":[{"interface":"back","average":{"1min":1.897,"5min":1.21,"15min":1.1379999999999999},"min":{"1min":0.78400000000000003,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":17.042000000000002,"5min":17.042000000000002,"15min":17.042000000000002},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.9730000000000001,"5min":1.321,"15min":1.2729999999999999},"min":{"1min":0.78800000000000003,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":16.32,"5min":16.32,"15min":16.32},"last":1.3140000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509507,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30968,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":30080,"kb_avail":94340872,"statfs":{"total":96636764160,"available":96605052928,"internally_reserved":0,"allocated":901120,"data_stored":402792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30801920},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61899999999999999,"15min":0.54600000000000004},"min":{"1min":0.32200000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.87,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.71699999999999997,"15min":0.63700000000000001},"min":{"1min":0.34699999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.137,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.436}]},{"osd":1,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73899999999999999,"15min":0.64200000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.68799999999999994,"15min":0.60899999999999999},"min":{"1min":0.34799999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.92900000000000005,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.56599999999999995}]},{"osd":3,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73299999999999998,"15min":0.64300000000000002},"min":{"1min":0.28899999999999998,"5min":0.224,"15min":0.224},"max":{"1min":1.323,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.84399999999999997,"15min":0.74299999999999999},"min":{"1min":0.45600000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.51900000000000002}]},{"osd":4,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.93000000000000005,"15min":0.86199999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.4550000000000001,"5min":1.718,"15min":1.718},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0089999999999999,"15min":0.93100000000000005},"min":{"1min":0.67900000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.70699999999999996}]},{"osd":5,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.98699999999999999,"15min":0.88900000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.0780000000000001,"15min":0.96899999999999997},"min":{"1min":0.57599999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":3.4849999999999999,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.63}]},{"osd":6,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.97999999999999998,"15min":0.92700000000000005},"min":{"1min":0.60099999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.0740000000000001,"15min":0.98799999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.85799999999999998}]},{"osd":7,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1180000000000001,"15min":1.026},"min":{"1min":0.63100000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4670000000000001,"5min":1.76,"15min":1.76},"last":0.72599999999999998},{"interface":"front","average":{"1min":1.038,"5min":1.044,"15min":0.97499999999999998},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.494,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.81399999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509506,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25016,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":24128,"kb_avail":94346824,"statfs":{"total":96636764160,"available":96611147776,"internally_reserved":0,"allocated":901120,"data_stored":403326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24707072},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59299999999999997,"15min":0.55100000000000005},"min":{"1min":0.30499999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.77100000000000002,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.67900000000000005,"15min":0.54100000000000004},"min":{"1min":0.27200000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.0580000000000001}]},{"osd":2,"last update":"Tue Oct 3 19:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.66900000000000004,"15min":0.57299999999999995},"min":{"1min":0.34799999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.93600000000000005,"5min":1.506,"15min":1.506},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.68500000000000005},"min":{"1min":0.41299999999999998,"5min":0.312,"15min":0.312},"max":{"1min":1.252,"5min":1.365,"15min":1.365},"last":0.95699999999999996}]},{"osd":3,"last update":"Tue Oct 3 19:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.75700000000000001,"15min":0.65400000000000003},"min":{"1min":0.36599999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.75,"15min":0.61399999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.2310000000000001,"5min":1.27,"15min":1.27},"last":0.79000000000000004}]},{"osd":4,"last update":"Tue Oct 3 19:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.88800000000000001,"15min":0.81599999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.292,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.292},{"interface":"front","average":{"1min":1.04,"5min":0.97199999999999998,"15min":0.90600000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.131}]},{"osd":5,"last update":"Tue Oct 3 19:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.97399999999999998,"15min":0.878},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.111},{"interface":"front","average":{"1min":1.03,"5min":0.95999999999999996,"15min":0.872},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.256,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.0269999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:17:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.032,"15min":0.94199999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.518,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.248},{"interface":"front","average":{"1min":1.077,"5min":1.022,"15min":0.91800000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.92000000000000004}]},{"osd":7,"last update":"Tue Oct 3 19:17:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.073,"15min":0.96299999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":1.006},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0369999999999999,"15min":0.92600000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4430000000000001,"5min":1.649,"15min":1.649},"last":1.1719999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542210,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35944,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":35072,"kb_avail":94335896,"statfs":{"total":96636764160,"available":96599957504,"internally_reserved":0,"allocated":884736,"data_stored":397143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35913728},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63700000000000001,"15min":0.58099999999999996},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.1779999999999999,"5min":1.212,"15min":1.212},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.69499999999999995,"15min":0.65100000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.65500000000000003}]},{"osd":1,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.69799999999999995,"15min":0.63800000000000001},"min":{"1min":0.29499999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0880000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.754,"15min":0.67900000000000005},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.1599999999999999,"5min":1.222,"15min":1.222},"last":0.747}]},{"osd":2,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.78600000000000003,"15min":0.71899999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73399999999999999,"15min":0.64500000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.55300000000000005}]},{"osd":4,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.93100000000000005,"15min":0.91100000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3169999999999999,"5min":1.496,"15min":1.496},"last":0.72699999999999998},{"interface":"front","average":{"1min":1.04,"5min":1.002,"15min":0.94599999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.538,"5min":1.546,"15min":1.546},"last":0.96399999999999997}]},{"osd":5,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92900000000000005,"15min":0.88600000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.014},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.026,"15min":1},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.419,"5min":1.498,"15min":1.498},"last":0.81100000000000005}]},{"osd":6,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.96799999999999997,"15min":0.92700000000000005},"min":{"1min":0.56999999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.046,"15min":0.99399999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.4970000000000001,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.875}]},{"osd":7,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0649999999999999,"15min":1.0149999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0800000000000001,"15min":1.0269999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.526,"5min":1.708,"15min":1.708},"last":0.93600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574914,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21556,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":20672,"kb_avail":94350284,"statfs":{"total":96636764160,"available":96614690816,"internally_reserved":0,"allocated":897024,"data_stored":403248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21168128},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.88,"15min":0.83399999999999996},"min":{"1min":0.58499999999999996,"5min":0.437,"15min":0.437},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.85399999999999998,"15min":0.85199999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0389999999999999,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.081}]},{"osd":1,"last update":"Tue Oct 3 19:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86099999999999999,"15min":0.83699999999999997},"min":{"1min":0.59099999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.70699999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.159,"5min":1.514,"15min":1.514},"last":0.79900000000000004}]},{"osd":2,"last update":"Tue Oct 3 19:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91200000000000003,"15min":0.89900000000000002},"min":{"1min":0.63400000000000001,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.351,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":1.149},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90900000000000003,"15min":0.89700000000000002},"min":{"1min":0.57099999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0880000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.0369999999999999}]},{"osd":3,"last update":"Tue Oct 3 19:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.92800000000000005,"15min":0.92700000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0389999999999999,"15min":1.0289999999999999},"min":{"1min":0.83599999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.222,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.2749999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.67500000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.3180000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.1919999999999999},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.97999999999999998,"15min":1.026},"min":{"1min":0.67300000000000004,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.2689999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.76000000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:17:35 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.98399999999999999,"15min":1.03},"min":{"1min":0.64600000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2909999999999999,"5min":1.462,"15min":1.462},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.107,"15min":1.133},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.4159999999999999,"5min":1.823,"15min":1.823},"last":1.2350000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:17:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0609999999999999,"15min":1.075},"min":{"1min":0.84699999999999998,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.2589999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.159,"5min":1.1419999999999999,"15min":1.1519999999999999},"min":{"1min":0.87,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.413,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.1080000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574915,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":26880,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":954368,"data_stored":992418,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27525120},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63900000000000001,"15min":0.58899999999999997},"min":{"1min":0.39600000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.871,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.72199999999999998},"min":{"1min":0.37,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.1279999999999999,"5min":1.27,"15min":1.27},"last":0.70399999999999996}]},{"osd":2,"last update":"Tue Oct 3 19:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.751,"15min":0.72299999999999998},"min":{"1min":0.47299999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3080000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72499999999999998,"15min":0.69699999999999995},"min":{"1min":0.33800000000000002,"5min":0.315,"15min":0.315},"max":{"1min":1.04,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.59699999999999998}]},{"osd":3,"last update":"Tue Oct 3 19:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.85699999999999998,"15min":0.749},"min":{"1min":0.51500000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.409,"5min":1.446,"15min":1.446},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.81200000000000006,"15min":0.71399999999999997},"min":{"1min":0.41999999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.103,"5min":1.375,"15min":1.375},"last":0.68300000000000005}]},{"osd":4,"last update":"Tue Oct 3 19:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.92000000000000004,"15min":0.90800000000000003},"min":{"1min":0.65400000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3520000000000001,"5min":1.52,"15min":1.52},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.046,"15min":1.026},"min":{"1min":0.65200000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.393,"5min":1.508,"15min":1.508},"last":1.008}]},{"osd":5,"last update":"Tue Oct 3 19:17:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0720000000000001,"15min":1.05},"min":{"1min":0.68999999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4359999999999999,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.052},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.0229999999999999,"15min":0.98299999999999998},"min":{"1min":0.68600000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3959999999999999,"5min":1.837,"15min":1.837},"last":0.76000000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.052,"15min":1.02},"min":{"1min":0.66800000000000004,"5min":0.623,"15min":0.623},"max":{"1min":1.26,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.05,"15min":1.002},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4750000000000001,"5min":1.637,"15min":1.637},"last":1.024}]},{"osd":7,"last update":"Tue Oct 3 19:17:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.097,"15min":1.046},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.488,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.083,"15min":1.0609999999999999},"min":{"1min":0.68799999999999994,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3400000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.93999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:17:41.262 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:17:41.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.402+0000 7f75f5e36640 1 Processor -- start 2023-10-03T19:17:41.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75f5e36640 1 -- start start 2023-10-03T19:17:41.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75f5e36640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f75f00bf370 0x7f75f0149760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:41.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75f5e36640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f014c770 con 0x7f75f014d310 2023-10-03T19:17:41.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75f5e36640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f006efe0 con 0x7f75f00a7100 2023-10-03T19:17:41.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75f5e36640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f00bebc0 con 0x7f75f00bf370 2023-10-03T19:17:41.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75effff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f75f014d310 0x7f75f014fbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35100/0 (socket says 172.21.15.45:35100) 2023-10-03T19:17:41.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75effff640 1 -- 172.21.15.45:0/4119566075 learned_addr learned my addr 172.21.15.45:0/4119566075 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:41.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75ef7fe640 1 --2- 172.21.15.45:0/4119566075 >> v2:172.21.15.79:3300/0 conn(0x7f75f00bf370 0x7f75f0149760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:41.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75ee7fc640 1 -- 172.21.15.45:0/4119566075 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2292556745 0 0) 0x7f75f014c770 con 0x7f75f014d310 2023-10-03T19:17:41.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75ee7fc640 1 -- 172.21.15.45:0/4119566075 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75dc003530 con 0x7f75f014d310 2023-10-03T19:17:41.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75ee7fc640 1 -- 172.21.15.45:0/4119566075 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1099564592 0 0) 0x7f75dc003530 con 0x7f75f014d310 2023-10-03T19:17:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75ee7fc640 1 -- 172.21.15.45:0/4119566075 >> v2:172.21.15.79:3300/0 conn(0x7f75f00bf370 msgr2=0x7f75f0149760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75ee7fc640 1 --2- 172.21.15.45:0/4119566075 >> v2:172.21.15.79:3300/0 conn(0x7f75f00bf370 0x7f75f0149760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75ee7fc640 1 -- 172.21.15.45:0/4119566075 >> v1:172.21.15.79:6789/0 conn(0x7f75f00a7100 legacy=0x7f75f014cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75ee7fc640 1 -- 172.21.15.45:0/4119566075 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f006f2c0 con 0x7f75f014d310 2023-10-03T19:17:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75ee7fc640 1 -- 172.21.15.45:0/4119566075 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f75e8001680 con 0x7f75f014d310 2023-10-03T19:17:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75ee7fc640 1 -- 172.21.15.45:0/4119566075 >> v1:172.21.15.45:6789/0 conn(0x7f75f014d310 legacy=0x7f75f014fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75ee7fc640 1 --2- 172.21.15.45:0/4119566075 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75dc003980 0x7f75dc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75ee7fc640 1 --2- 172.21.15.45:0/4119566075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75dc0047d0 0x7f75dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75ee7fc640 1 --2- 172.21.15.45:0/4119566075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75dc005180 0x7f75dc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75ee7fc640 1 -- 172.21.15.45:0/4119566075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f00bebc0 con 0x7f75dc0047d0 2023-10-03T19:17:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75ee7fc640 1 -- 172.21.15.45:0/4119566075 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc00c090 con 0x7f75dc005180 2023-10-03T19:17:41.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75ee7fc640 1 -- 172.21.15.45:0/4119566075 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc00c250 con 0x7f75dc003980 2023-10-03T19:17:41.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75eeffd640 1 --2- 172.21.15.45:0/4119566075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75dc0047d0 0x7f75dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:41.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75ef7fe640 1 --2- 172.21.15.45:0/4119566075 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75dc003980 0x7f75dc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:41.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75effff640 1 --2- 172.21.15.45:0/4119566075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75dc005180 0x7f75dc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:41.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75eeffd640 1 -- 172.21.15.45:0/4119566075 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75dc003980 msgr2=0x7f75dc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:41.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75eeffd640 1 --2- 172.21.15.45:0/4119566075 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75dc003980 0x7f75dc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:41.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75eeffd640 1 -- 172.21.15.45:0/4119566075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75dc005180 msgr2=0x7f75dc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:41.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75eeffd640 1 --2- 172.21.15.45:0/4119566075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75dc005180 0x7f75dc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:41.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75eeffd640 1 -- 172.21.15.45:0/4119566075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75dc003530 con 0x7f75dc0047d0 2023-10-03T19:17:41.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.406+0000 7f75effff640 1 -- 172.21.15.45:0/4119566075 reap_dead start 2023-10-03T19:17:41.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75eeffd640 1 --2- 172.21.15.45:0/4119566075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75dc0047d0 0x7f75dc004c40 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f75d8001a50 tx=0x7f75d8020b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97a8c3cb3323a05 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:41.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75ee7fc640 1 -- 172.21.15.45:0/4119566075 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d8003b80 con 0x7f75dc0047d0 2023-10-03T19:17:41.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75ee7fc640 1 -- 172.21.15.45:0/4119566075 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d8003ce0 con 0x7f75dc0047d0 2023-10-03T19:17:41.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75ee7fc640 1 -- 172.21.15.45:0/4119566075 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d80a99a0 con 0x7f75dc0047d0 2023-10-03T19:17:41.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75f5e36640 1 -- 172.21.15.45:0/4119566075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75dc0047d0 msgr2=0x7f75dc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:41.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75f5e36640 1 --2- 172.21.15.45:0/4119566075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75dc0047d0 0x7f75dc004c40 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f75d8001a50 tx=0x7f75d8020b70 comp rx=0 tx=0).stop 2023-10-03T19:17:41.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75f5e36640 1 -- 172.21.15.45:0/4119566075 shutdown_connections 2023-10-03T19:17:41.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75f5e36640 1 --2- 172.21.15.45:0/4119566075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75dc0047d0 0x7f75dc004c40 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:41.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75f5e36640 1 -- 172.21.15.45:0/4119566075 >> 172.21.15.45:0/4119566075 conn(0x7f75f006bce0 msgr2=0x7f75f006c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:41.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75f5e36640 1 -- 172.21.15.45:0/4119566075 shutdown_connections 2023-10-03T19:17:41.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75f5e36640 1 -- 172.21.15.45:0/4119566075 wait complete. 2023-10-03T19:17:41.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75f5e36640 1 Processor -- start 2023-10-03T19:17:41.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75f5e36640 1 -- start start 2023-10-03T19:17:41.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75f5e36640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75dc0047d0 0x7f75f00b86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:41.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75f5e36640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75f00a4500 0x7f75f01e2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:41.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75f5e36640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75f00b8ed0 0x7f75f00a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:41.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75f5e36640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f00b96d0 con 0x7f75f00b8ed0 2023-10-03T19:17:41.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75f5e36640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f00a49c0 con 0x7f75dc0047d0 2023-10-03T19:17:41.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75f5e36640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f00a4c60 con 0x7f75f00a4500 2023-10-03T19:17:41.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75effff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75f00b8ed0 0x7f75f00a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:41.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75effff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75f00b8ed0 0x7f75f00a1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35000/0 (socket says 172.21.15.45:35000) 2023-10-03T19:17:41.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75effff640 1 -- 172.21.15.45:0/819656133 learned_addr learned my addr 172.21.15.45:0/819656133 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:41.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75ef7fe640 1 --2- 172.21.15.45:0/819656133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75dc0047d0 0x7f75f00b86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:41.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75eeffd640 1 --2- 172.21.15.45:0/819656133 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75f00a4500 0x7f75f01e2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:41.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75effff640 1 -- 172.21.15.45:0/819656133 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75f00a4500 msgr2=0x7f75f01e2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:41.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75effff640 1 --2- 172.21.15.45:0/819656133 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75f00a4500 0x7f75f01e2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:41.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75effff640 1 -- 172.21.15.45:0/819656133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75dc0047d0 msgr2=0x7f75f00b86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:41.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75effff640 1 --2- 172.21.15.45:0/819656133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75dc0047d0 0x7f75f00b86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:41.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75effff640 1 -- 172.21.15.45:0/819656133 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f014d180 con 0x7f75f00b8ed0 2023-10-03T19:17:41.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75eeffd640 1 --2- 172.21.15.45:0/819656133 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75f00a4500 0x7f75f01e2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:41.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.410+0000 7f75effff640 1 --2- 172.21.15.45:0/819656133 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75f00b8ed0 0x7f75f00a1f80 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f75f00a5420 tx=0x7f75e800e7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:41.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.414+0000 7f75e7fff640 1 -- 172.21.15.45:0/819656133 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e800ec60 con 0x7f75f00b8ed0 2023-10-03T19:17:41.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.414+0000 7f75e7fff640 1 -- 172.21.15.45:0/819656133 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e800ede0 con 0x7f75f00b8ed0 2023-10-03T19:17:41.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.414+0000 7f75f5e36640 1 -- 172.21.15.45:0/819656133 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f014cff0 con 0x7f75f00b8ed0 2023-10-03T19:17:41.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.414+0000 7f75e7fff640 1 -- 172.21.15.45:0/819656133 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e80146c0 con 0x7f75f00b8ed0 2023-10-03T19:17:41.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.414+0000 7f75f5e36640 1 -- 172.21.15.45:0/819656133 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f0149f70 con 0x7f75f00b8ed0 2023-10-03T19:17:41.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.414+0000 7f75f5e36640 1 -- 172.21.15.45:0/819656133 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f004de80 con 0x7f75f00b8ed0 2023-10-03T19:17:41.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.414+0000 7f75e7fff640 1 -- 172.21.15.45:0/819656133 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f75e801d3b0 con 0x7f75f00b8ed0 2023-10-03T19:17:41.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.414+0000 7f75e7fff640 1 --2- 172.21.15.45:0/819656133 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f75d0066280 0x7f75d0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:41.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.414+0000 7f75e7fff640 1 -- 172.21.15.45:0/819656133 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f75e8082d30 con 0x7f75f00b8ed0 2023-10-03T19:17:41.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.414+0000 7f75ef7fe640 1 --2- 172.21.15.45:0/819656133 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f75d0066280 0x7f75d0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:41.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.414+0000 7f75ef7fe640 1 --2- 172.21.15.45:0/819656133 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f75d0066280 0x7f75d0068730 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f75e0009ab0 tx=0x7f75e0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:41.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.418+0000 7f75e7fff640 1 -- 172.21.15.45:0/819656133 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f75e8050300 con 0x7f75f00b8ed0 2023-10-03T19:17:41.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.570+0000 7f75f5e36640 1 -- 172.21.15.45:0/819656133 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f75f00b8430 con 0x7f75d0066280 2023-10-03T19:17:41.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.594+0000 7f75e7fff640 1 -- 172.21.15.45:0/819656133 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310195 (secure 0 0 0) 0x7f75f00b8430 con 0x7f75d0066280 2023-10-03T19:17:41.597 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:17:41.752 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:17:41.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.598+0000 7f75f5e36640 1 -- 172.21.15.45:0/819656133 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f75d0066280 msgr2=0x7f75d0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:41.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.598+0000 7f75f5e36640 1 --2- 172.21.15.45:0/819656133 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f75d0066280 0x7f75d0068730 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f75e0009ab0 tx=0x7f75e0008040 comp rx=0 tx=0).stop 2023-10-03T19:17:41.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.598+0000 7f75f5e36640 1 -- 172.21.15.45:0/819656133 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75f00b8ed0 msgr2=0x7f75f00a1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:41.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.598+0000 7f75f5e36640 1 --2- 172.21.15.45:0/819656133 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75f00b8ed0 0x7f75f00a1f80 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f75f00a5420 tx=0x7f75e800e7c0 comp rx=0 tx=0).stop 2023-10-03T19:17:41.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.598+0000 7f75f5e36640 1 -- 172.21.15.45:0/819656133 shutdown_connections 2023-10-03T19:17:41.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.598+0000 7f75f5e36640 1 --2- 172.21.15.45:0/819656133 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f75d0066280 0x7f75d0068730 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:41.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.598+0000 7f75f5e36640 1 --2- 172.21.15.45:0/819656133 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75f00b8ed0 0x7f75f00a1f80 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:41.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.598+0000 7f75f5e36640 1 --2- 172.21.15.45:0/819656133 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75f00a4500 0x7f75f01e2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:41.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.598+0000 7f75f5e36640 1 --2- 172.21.15.45:0/819656133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75dc0047d0 0x7f75f00b86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:41.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.598+0000 7f75f5e36640 1 -- 172.21.15.45:0/819656133 >> 172.21.15.45:0/819656133 conn(0x7f75f006bce0 msgr2=0x7f75f014b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:41.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.598+0000 7f75f5e36640 1 -- 172.21.15.45:0/819656133 shutdown_connections 2023-10-03T19:17:41.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:41.598+0000 7f75f5e36640 1 -- 172.21.15.45:0/819656133 wait complete. 2023-10-03T19:17:41.764 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":229,"stamp":"2023-10-03T19:17:40.556048+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":111,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":211036,"kb_used_data":7132,"kb_used_omap":0,"kb_used_meta":203840,"kb_avail":754763684,"statfs":{"total":773094113280,"available":772878012416,"internally_reserved":0,"allocated":7303168,"data_stored":4394374,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":208732160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":67,"apply_latency_ms":67,"commit_latency_ns":67000000,"apply_latency_ns":67000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002026"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.592168+0000","last_change":"2023-10-03T19:17:35.574436+0000","last_active":"2023-10-03T19:17:36.592168+0000","last_peered":"2023-10-03T19:17:36.592168+0000","last_clean":"2023-10-03T19:17:36.592168+0000","last_became_active":"2023-10-03T19:17:35.573980+0000","last_became_peered":"2023-10-03T19:17:35.573980+0000","last_unstale":"2023-10-03T19:17:36.592168+0000","last_undegraded":"2023-10-03T19:17:36.592168+0000","last_fullsized":"2023-10-03T19:17:36.592168+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:36:40.458993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.509499+0000","last_change":"2023-10-03T19:17:35.530517+0000","last_active":"2023-10-03T19:17:36.509499+0000","last_peered":"2023-10-03T19:17:36.509499+0000","last_clean":"2023-10-03T19:17:36.509499+0000","last_became_active":"2023-10-03T19:17:35.530243+0000","last_became_peered":"2023-10-03T19:17:35.530243+0000","last_unstale":"2023-10-03T19:17:36.509499+0000","last_undegraded":"2023-10-03T19:17:36.509499+0000","last_fullsized":"2023-10-03T19:17:36.509499+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:00:06.581814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.541096+0000","last_change":"2023-10-03T19:17:35.525639+0000","last_active":"2023-10-03T19:17:36.541096+0000","last_peered":"2023-10-03T19:17:36.541096+0000","last_clean":"2023-10-03T19:17:36.541096+0000","last_became_active":"2023-10-03T19:17:35.525306+0000","last_became_peered":"2023-10-03T19:17:35.525306+0000","last_unstale":"2023-10-03T19:17:36.541096+0000","last_undegraded":"2023-10-03T19:17:36.541096+0000","last_fullsized":"2023-10-03T19:17:36.541096+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:12:57.883476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.514213+0000","last_change":"2023-10-03T19:17:35.562486+0000","last_active":"2023-10-03T19:17:36.514213+0000","last_peered":"2023-10-03T19:17:36.514213+0000","last_clean":"2023-10-03T19:17:36.514213+0000","last_became_active":"2023-10-03T19:17:35.561964+0000","last_became_peered":"2023-10-03T19:17:35.561964+0000","last_unstale":"2023-10-03T19:17:36.514213+0000","last_undegraded":"2023-10-03T19:17:36.514213+0000","last_fullsized":"2023-10-03T19:17:36.514213+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:03:22.966456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.586545+0000","last_change":"2023-10-03T19:17:35.557047+0000","last_active":"2023-10-03T19:17:36.586545+0000","last_peered":"2023-10-03T19:17:36.586545+0000","last_clean":"2023-10-03T19:17:36.586545+0000","last_became_active":"2023-10-03T19:17:35.556720+0000","last_became_peered":"2023-10-03T19:17:35.556720+0000","last_unstale":"2023-10-03T19:17:36.586545+0000","last_undegraded":"2023-10-03T19:17:36.586545+0000","last_fullsized":"2023-10-03T19:17:36.586545+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:25:15.704816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-03T19:17:35.558736+0000","last_change":"2023-10-03T19:17:35.557910+0000","last_active":"2023-10-03T19:17:35.558736+0000","last_peered":"2023-10-03T19:17:35.558736+0000","last_clean":"2023-10-03T19:17:35.558736+0000","last_became_active":"2023-10-03T19:17:35.557410+0000","last_became_peered":"2023-10-03T19:17:35.557410+0000","last_unstale":"2023-10-03T19:17:35.558736+0000","last_undegraded":"2023-10-03T19:17:35.558736+0000","last_fullsized":"2023-10-03T19:17:35.558736+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:20:49.213913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.592565+0000","last_change":"2023-10-03T19:17:35.529727+0000","last_active":"2023-10-03T19:17:36.592565+0000","last_peered":"2023-10-03T19:17:36.592565+0000","last_clean":"2023-10-03T19:17:36.592565+0000","last_became_active":"2023-10-03T19:17:35.528373+0000","last_became_peered":"2023-10-03T19:17:35.528373+0000","last_unstale":"2023-10-03T19:17:36.592565+0000","last_undegraded":"2023-10-03T19:17:36.592565+0000","last_fullsized":"2023-10-03T19:17:36.592565+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:24:55.429616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.586247+0000","last_change":"2023-10-03T19:17:35.557048+0000","last_active":"2023-10-03T19:17:36.586247+0000","last_peered":"2023-10-03T19:17:36.586247+0000","last_clean":"2023-10-03T19:17:36.586247+0000","last_became_active":"2023-10-03T19:17:35.556747+0000","last_became_peered":"2023-10-03T19:17:35.556747+0000","last_unstale":"2023-10-03T19:17:36.586247+0000","last_undegraded":"2023-10-03T19:17:36.586247+0000","last_fullsized":"2023-10-03T19:17:36.586247+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:41:41.097515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.516228+0000","last_change":"2023-10-03T19:17:35.572826+0000","last_active":"2023-10-03T19:17:36.516228+0000","last_peered":"2023-10-03T19:17:36.516228+0000","last_clean":"2023-10-03T19:17:36.516228+0000","last_became_active":"2023-10-03T19:17:35.571798+0000","last_became_peered":"2023-10-03T19:17:35.571798+0000","last_unstale":"2023-10-03T19:17:36.516228+0000","last_undegraded":"2023-10-03T19:17:36.516228+0000","last_fullsized":"2023-10-03T19:17:36.516228+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:22:18.372716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.514363+0000","last_change":"2023-10-03T19:17:35.538190+0000","last_active":"2023-10-03T19:17:36.514363+0000","last_peered":"2023-10-03T19:17:36.514363+0000","last_clean":"2023-10-03T19:17:36.514363+0000","last_became_active":"2023-10-03T19:17:35.537584+0000","last_became_peered":"2023-10-03T19:17:35.537584+0000","last_unstale":"2023-10-03T19:17:36.514363+0000","last_undegraded":"2023-10-03T19:17:36.514363+0000","last_fullsized":"2023-10-03T19:17:36.514363+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:44:14.258659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.509172+0000","last_change":"2023-10-03T19:17:35.523945+0000","last_active":"2023-10-03T19:17:36.509172+0000","last_peered":"2023-10-03T19:17:36.509172+0000","last_clean":"2023-10-03T19:17:36.509172+0000","last_became_active":"2023-10-03T19:17:35.523464+0000","last_became_peered":"2023-10-03T19:17:35.523464+0000","last_unstale":"2023-10-03T19:17:36.509172+0000","last_undegraded":"2023-10-03T19:17:36.509172+0000","last_fullsized":"2023-10-03T19:17:36.509172+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:49:40.130750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.514542+0000","last_change":"2023-10-03T19:17:35.544319+0000","last_active":"2023-10-03T19:17:36.514542+0000","last_peered":"2023-10-03T19:17:36.514542+0000","last_clean":"2023-10-03T19:17:36.514542+0000","last_became_active":"2023-10-03T19:17:35.543459+0000","last_became_peered":"2023-10-03T19:17:35.543459+0000","last_unstale":"2023-10-03T19:17:36.514542+0000","last_undegraded":"2023-10-03T19:17:36.514542+0000","last_fullsized":"2023-10-03T19:17:36.514542+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:07:13.726471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.587227+0000","last_change":"2023-10-03T19:17:35.528430+0000","last_active":"2023-10-03T19:17:36.587227+0000","last_peered":"2023-10-03T19:17:36.587227+0000","last_clean":"2023-10-03T19:17:36.587227+0000","last_became_active":"2023-10-03T19:17:35.527901+0000","last_became_peered":"2023-10-03T19:17:35.527901+0000","last_unstale":"2023-10-03T19:17:36.587227+0000","last_undegraded":"2023-10-03T19:17:36.587227+0000","last_fullsized":"2023-10-03T19:17:36.587227+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:25:17.138452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-03T19:17:35.558722+0000","last_change":"2023-10-03T19:17:35.557763+0000","last_active":"2023-10-03T19:17:35.558722+0000","last_peered":"2023-10-03T19:17:35.558722+0000","last_clean":"2023-10-03T19:17:35.558722+0000","last_became_active":"2023-10-03T19:17:35.557050+0000","last_became_peered":"2023-10-03T19:17:35.557050+0000","last_unstale":"2023-10-03T19:17:35.558722+0000","last_undegraded":"2023-10-03T19:17:35.558722+0000","last_fullsized":"2023-10-03T19:17:35.558722+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:30:39.387465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.508523+0000","last_change":"2023-10-03T19:17:35.519539+0000","last_active":"2023-10-03T19:17:36.508523+0000","last_peered":"2023-10-03T19:17:36.508523+0000","last_clean":"2023-10-03T19:17:36.508523+0000","last_became_active":"2023-10-03T19:17:35.519279+0000","last_became_peered":"2023-10-03T19:17:35.519279+0000","last_unstale":"2023-10-03T19:17:36.508523+0000","last_undegraded":"2023-10-03T19:17:36.508523+0000","last_fullsized":"2023-10-03T19:17:36.508523+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:14:38.471340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.591551+0000","last_change":"2023-10-03T19:17:35.566481+0000","last_active":"2023-10-03T19:17:36.591551+0000","last_peered":"2023-10-03T19:17:36.591551+0000","last_clean":"2023-10-03T19:17:36.591551+0000","last_became_active":"2023-10-03T19:17:35.565937+0000","last_became_peered":"2023-10-03T19:17:35.565937+0000","last_unstale":"2023-10-03T19:17:36.591551+0000","last_undegraded":"2023-10-03T19:17:36.591551+0000","last_fullsized":"2023-10-03T19:17:36.591551+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:17:09.857761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.587133+0000","last_change":"2023-10-03T19:17:35.534279+0000","last_active":"2023-10-03T19:17:36.587133+0000","last_peered":"2023-10-03T19:17:36.587133+0000","last_clean":"2023-10-03T19:17:36.587133+0000","last_became_active":"2023-10-03T19:17:35.533985+0000","last_became_peered":"2023-10-03T19:17:35.533985+0000","last_unstale":"2023-10-03T19:17:36.587133+0000","last_undegraded":"2023-10-03T19:17:36.587133+0000","last_fullsized":"2023-10-03T19:17:36.587133+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:59:38.485845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.540839+0000","last_change":"2023-10-03T19:17:35.569760+0000","last_active":"2023-10-03T19:17:36.540839+0000","last_peered":"2023-10-03T19:17:36.540839+0000","last_clean":"2023-10-03T19:17:36.540839+0000","last_became_active":"2023-10-03T19:17:35.569452+0000","last_became_peered":"2023-10-03T19:17:35.569452+0000","last_unstale":"2023-10-03T19:17:36.540839+0000","last_undegraded":"2023-10-03T19:17:36.540839+0000","last_fullsized":"2023-10-03T19:17:36.540839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:14:04.728465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-03T19:17:35.527050+0000","last_change":"2023-10-03T19:17:35.522436+0000","last_active":"2023-10-03T19:17:35.527050+0000","last_peered":"2023-10-03T19:17:35.527050+0000","last_clean":"2023-10-03T19:17:35.527050+0000","last_became_active":"2023-10-03T19:17:35.522169+0000","last_became_peered":"2023-10-03T19:17:35.522169+0000","last_unstale":"2023-10-03T19:17:35.527050+0000","last_undegraded":"2023-10-03T19:17:35.527050+0000","last_fullsized":"2023-10-03T19:17:35.527050+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:10:23.787856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.586259+0000","last_change":"2023-10-03T19:17:35.520184+0000","last_active":"2023-10-03T19:17:36.586259+0000","last_peered":"2023-10-03T19:17:36.586259+0000","last_clean":"2023-10-03T19:17:36.586259+0000","last_became_active":"2023-10-03T19:17:35.519879+0000","last_became_peered":"2023-10-03T19:17:35.519879+0000","last_unstale":"2023-10-03T19:17:36.586259+0000","last_undegraded":"2023-10-03T19:17:36.586259+0000","last_fullsized":"2023-10-03T19:17:36.586259+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:34:43.975125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.515782+0000","last_change":"2023-10-03T19:17:35.559274+0000","last_active":"2023-10-03T19:17:36.515782+0000","last_peered":"2023-10-03T19:17:36.515782+0000","last_clean":"2023-10-03T19:17:36.515782+0000","last_became_active":"2023-10-03T19:17:35.558599+0000","last_became_peered":"2023-10-03T19:17:35.558599+0000","last_unstale":"2023-10-03T19:17:36.515782+0000","last_undegraded":"2023-10-03T19:17:36.515782+0000","last_fullsized":"2023-10-03T19:17:36.515782+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:51:52.777516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.586003+0000","last_change":"2023-10-03T19:17:35.526489+0000","last_active":"2023-10-03T19:17:36.586003+0000","last_peered":"2023-10-03T19:17:36.586003+0000","last_clean":"2023-10-03T19:17:36.586003+0000","last_became_active":"2023-10-03T19:17:35.526170+0000","last_became_peered":"2023-10-03T19:17:35.526170+0000","last_unstale":"2023-10-03T19:17:36.586003+0000","last_undegraded":"2023-10-03T19:17:36.586003+0000","last_fullsized":"2023-10-03T19:17:36.586003+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:40:33.225182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.514580+0000","last_change":"2023-10-03T19:17:35.572413+0000","last_active":"2023-10-03T19:17:36.514580+0000","last_peered":"2023-10-03T19:17:36.514580+0000","last_clean":"2023-10-03T19:17:36.514580+0000","last_became_active":"2023-10-03T19:17:35.571505+0000","last_became_peered":"2023-10-03T19:17:35.571505+0000","last_unstale":"2023-10-03T19:17:36.514580+0000","last_undegraded":"2023-10-03T19:17:36.514580+0000","last_fullsized":"2023-10-03T19:17:36.514580+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:32:20.377008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.508337+0000","last_change":"2023-10-03T19:17:35.527455+0000","last_active":"2023-10-03T19:17:36.508337+0000","last_peered":"2023-10-03T19:17:36.508337+0000","last_clean":"2023-10-03T19:17:36.508337+0000","last_became_active":"2023-10-03T19:17:35.527141+0000","last_became_peered":"2023-10-03T19:17:35.527141+0000","last_unstale":"2023-10-03T19:17:36.508337+0000","last_undegraded":"2023-10-03T19:17:36.508337+0000","last_fullsized":"2023-10-03T19:17:36.508337+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:15:28.355234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.508992+0000","last_change":"2023-10-03T19:17:35.527106+0000","last_active":"2023-10-03T19:17:36.508992+0000","last_peered":"2023-10-03T19:17:36.508992+0000","last_clean":"2023-10-03T19:17:36.508992+0000","last_became_active":"2023-10-03T19:17:35.526749+0000","last_became_peered":"2023-10-03T19:17:35.526749+0000","last_unstale":"2023-10-03T19:17:36.508992+0000","last_undegraded":"2023-10-03T19:17:36.508992+0000","last_fullsized":"2023-10-03T19:17:36.508992+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:32:56.032540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.514704+0000","last_change":"2023-10-03T19:17:35.535251+0000","last_active":"2023-10-03T19:17:36.514704+0000","last_peered":"2023-10-03T19:17:36.514704+0000","last_clean":"2023-10-03T19:17:36.514704+0000","last_became_active":"2023-10-03T19:17:35.534543+0000","last_became_peered":"2023-10-03T19:17:35.534543+0000","last_unstale":"2023-10-03T19:17:36.514704+0000","last_undegraded":"2023-10-03T19:17:36.514704+0000","last_fullsized":"2023-10-03T19:17:36.514704+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:58:08.955116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.591810+0000","last_change":"2023-10-03T19:17:35.566766+0000","last_active":"2023-10-03T19:17:36.591810+0000","last_peered":"2023-10-03T19:17:36.591810+0000","last_clean":"2023-10-03T19:17:36.591810+0000","last_became_active":"2023-10-03T19:17:35.566026+0000","last_became_peered":"2023-10-03T19:17:35.566026+0000","last_unstale":"2023-10-03T19:17:36.591810+0000","last_undegraded":"2023-10-03T19:17:36.591810+0000","last_fullsized":"2023-10-03T19:17:36.591810+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:15:17.694256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.586469+0000","last_change":"2023-10-03T19:17:35.540835+0000","last_active":"2023-10-03T19:17:36.586469+0000","last_peered":"2023-10-03T19:17:36.586469+0000","last_clean":"2023-10-03T19:17:36.586469+0000","last_became_active":"2023-10-03T19:17:35.540571+0000","last_became_peered":"2023-10-03T19:17:35.540571+0000","last_unstale":"2023-10-03T19:17:36.586469+0000","last_undegraded":"2023-10-03T19:17:36.586469+0000","last_fullsized":"2023-10-03T19:17:36.586469+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:14:17.903514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.508829+0000","last_change":"2023-10-03T19:17:35.535726+0000","last_active":"2023-10-03T19:17:36.508829+0000","last_peered":"2023-10-03T19:17:36.508829+0000","last_clean":"2023-10-03T19:17:36.508829+0000","last_became_active":"2023-10-03T19:17:35.535458+0000","last_became_peered":"2023-10-03T19:17:35.535458+0000","last_unstale":"2023-10-03T19:17:36.508829+0000","last_undegraded":"2023-10-03T19:17:36.508829+0000","last_fullsized":"2023-10-03T19:17:36.508829+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:22:03.650059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.590862+0000","last_change":"2023-10-03T19:17:35.558458+0000","last_active":"2023-10-03T19:17:36.590862+0000","last_peered":"2023-10-03T19:17:36.590862+0000","last_clean":"2023-10-03T19:17:36.590862+0000","last_became_active":"2023-10-03T19:17:35.557755+0000","last_became_peered":"2023-10-03T19:17:35.557755+0000","last_unstale":"2023-10-03T19:17:36.590862+0000","last_undegraded":"2023-10-03T19:17:36.590862+0000","last_fullsized":"2023-10-03T19:17:36.590862+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:55:44.430806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.540417+0000","last_change":"2023-10-03T19:17:35.523702+0000","last_active":"2023-10-03T19:17:36.540417+0000","last_peered":"2023-10-03T19:17:36.540417+0000","last_clean":"2023-10-03T19:17:36.540417+0000","last_became_active":"2023-10-03T19:17:35.523395+0000","last_became_peered":"2023-10-03T19:17:35.523395+0000","last_unstale":"2023-10-03T19:17:36.540417+0000","last_undegraded":"2023-10-03T19:17:36.540417+0000","last_fullsized":"2023-10-03T19:17:36.540417+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:59:00.302947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.591405+0000","last_change":"2023-10-03T19:17:35.572812+0000","last_active":"2023-10-03T19:17:36.591405+0000","last_peered":"2023-10-03T19:17:36.591405+0000","last_clean":"2023-10-03T19:17:36.591405+0000","last_became_active":"2023-10-03T19:17:35.572360+0000","last_became_peered":"2023-10-03T19:17:35.572360+0000","last_unstale":"2023-10-03T19:17:36.591405+0000","last_undegraded":"2023-10-03T19:17:36.591405+0000","last_fullsized":"2023-10-03T19:17:36.591405+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:23:25.047485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.540395+0000","last_change":"2023-10-03T19:17:35.559355+0000","last_active":"2023-10-03T19:17:36.540395+0000","last_peered":"2023-10-03T19:17:36.540395+0000","last_clean":"2023-10-03T19:17:36.540395+0000","last_became_active":"2023-10-03T19:17:35.559089+0000","last_became_peered":"2023-10-03T19:17:35.559089+0000","last_unstale":"2023-10-03T19:17:36.540395+0000","last_undegraded":"2023-10-03T19:17:36.540395+0000","last_fullsized":"2023-10-03T19:17:36.540395+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:53:34.801440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"73'4","reported_seq":17,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.587177+0000","last_change":"2023-10-03T19:17:34.968998+0000","last_active":"2023-10-03T19:17:36.587177+0000","last_peered":"2023-10-03T19:17:36.587177+0000","last_clean":"2023-10-03T19:17:36.587177+0000","last_became_active":"2023-10-03T19:17:34.968529+0000","last_became_peered":"2023-10-03T19:17:34.968529+0000","last_unstale":"2023-10-03T19:17:36.587177+0000","last_undegraded":"2023-10-03T19:17:36.587177+0000","last_fullsized":"2023-10-03T19:17:36.587177+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:36:44.555220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.509352+0000","last_change":"2023-10-03T19:17:35.539694+0000","last_active":"2023-10-03T19:17:36.509352+0000","last_peered":"2023-10-03T19:17:36.509352+0000","last_clean":"2023-10-03T19:17:36.509352+0000","last_became_active":"2023-10-03T19:17:35.539487+0000","last_became_peered":"2023-10-03T19:17:35.539487+0000","last_unstale":"2023-10-03T19:17:36.509352+0000","last_undegraded":"2023-10-03T19:17:36.509352+0000","last_fullsized":"2023-10-03T19:17:36.509352+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:43:46.361603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"73'1","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.592310+0000","last_change":"2023-10-03T19:17:34.993568+0000","last_active":"2023-10-03T19:17:36.592310+0000","last_peered":"2023-10-03T19:17:36.592310+0000","last_clean":"2023-10-03T19:17:36.592310+0000","last_became_active":"2023-10-03T19:17:34.992990+0000","last_became_peered":"2023-10-03T19:17:34.992990+0000","last_unstale":"2023-10-03T19:17:36.592310+0000","last_undegraded":"2023-10-03T19:17:36.592310+0000","last_fullsized":"2023-10-03T19:17:36.592310+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:58:43.548189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.515447+0000","last_change":"2023-10-03T19:17:35.560592+0000","last_active":"2023-10-03T19:17:36.515447+0000","last_peered":"2023-10-03T19:17:36.515447+0000","last_clean":"2023-10-03T19:17:36.515447+0000","last_became_active":"2023-10-03T19:17:35.559050+0000","last_became_peered":"2023-10-03T19:17:35.559050+0000","last_unstale":"2023-10-03T19:17:36.515447+0000","last_undegraded":"2023-10-03T19:17:36.515447+0000","last_fullsized":"2023-10-03T19:17:36.515447+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:44:18.327862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"73'2","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.592172+0000","last_change":"2023-10-03T19:17:34.990843+0000","last_active":"2023-10-03T19:17:36.592172+0000","last_peered":"2023-10-03T19:17:36.592172+0000","last_clean":"2023-10-03T19:17:36.592172+0000","last_became_active":"2023-10-03T19:17:34.990162+0000","last_became_peered":"2023-10-03T19:17:34.990162+0000","last_unstale":"2023-10-03T19:17:36.592172+0000","last_undegraded":"2023-10-03T19:17:36.592172+0000","last_fullsized":"2023-10-03T19:17:36.592172+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:57:28.654749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.516124+0000","last_change":"2023-10-03T19:17:35.558957+0000","last_active":"2023-10-03T19:17:36.516124+0000","last_peered":"2023-10-03T19:17:36.516124+0000","last_clean":"2023-10-03T19:17:36.516124+0000","last_became_active":"2023-10-03T19:17:35.557955+0000","last_became_peered":"2023-10-03T19:17:35.557955+0000","last_unstale":"2023-10-03T19:17:36.516124+0000","last_undegraded":"2023-10-03T19:17:36.516124+0000","last_fullsized":"2023-10-03T19:17:36.516124+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:51:43.300261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"73'2","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.590749+0000","last_change":"2023-10-03T19:17:34.981697+0000","last_active":"2023-10-03T19:17:36.590749+0000","last_peered":"2023-10-03T19:17:36.590749+0000","last_clean":"2023-10-03T19:17:36.590749+0000","last_became_active":"2023-10-03T19:17:34.980986+0000","last_became_peered":"2023-10-03T19:17:34.980986+0000","last_unstale":"2023-10-03T19:17:36.590749+0000","last_undegraded":"2023-10-03T19:17:36.590749+0000","last_fullsized":"2023-10-03T19:17:36.590749+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:23:31.911249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.508968+0000","last_change":"2023-10-03T19:17:35.519870+0000","last_active":"2023-10-03T19:17:36.508968+0000","last_peered":"2023-10-03T19:17:36.508968+0000","last_clean":"2023-10-03T19:17:36.508968+0000","last_became_active":"2023-10-03T19:17:35.518115+0000","last_became_peered":"2023-10-03T19:17:35.518115+0000","last_unstale":"2023-10-03T19:17:36.508968+0000","last_undegraded":"2023-10-03T19:17:36.508968+0000","last_fullsized":"2023-10-03T19:17:36.508968+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:38:59.364154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"73'1","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.516291+0000","last_change":"2023-10-03T19:17:34.979595+0000","last_active":"2023-10-03T19:17:36.516291+0000","last_peered":"2023-10-03T19:17:36.516291+0000","last_clean":"2023-10-03T19:17:36.516291+0000","last_became_active":"2023-10-03T19:17:34.978851+0000","last_became_peered":"2023-10-03T19:17:34.978851+0000","last_unstale":"2023-10-03T19:17:36.516291+0000","last_undegraded":"2023-10-03T19:17:36.516291+0000","last_fullsized":"2023-10-03T19:17:36.516291+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:21:31.193839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.509352+0000","last_change":"2023-10-03T19:17:35.523768+0000","last_active":"2023-10-03T19:17:36.509352+0000","last_peered":"2023-10-03T19:17:36.509352+0000","last_clean":"2023-10-03T19:17:36.509352+0000","last_became_active":"2023-10-03T19:17:35.523181+0000","last_became_peered":"2023-10-03T19:17:35.523181+0000","last_unstale":"2023-10-03T19:17:36.509352+0000","last_undegraded":"2023-10-03T19:17:36.509352+0000","last_fullsized":"2023-10-03T19:17:36.509352+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:42:04.040389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"73'1","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.515104+0000","last_change":"2023-10-03T19:17:34.983006+0000","last_active":"2023-10-03T19:17:36.515104+0000","last_peered":"2023-10-03T19:17:36.515104+0000","last_clean":"2023-10-03T19:17:36.515104+0000","last_became_active":"2023-10-03T19:17:34.982265+0000","last_became_peered":"2023-10-03T19:17:34.982265+0000","last_unstale":"2023-10-03T19:17:36.515104+0000","last_undegraded":"2023-10-03T19:17:36.515104+0000","last_fullsized":"2023-10-03T19:17:36.515104+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:06:10.612883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.516521+0000","last_change":"2023-10-03T19:17:35.571824+0000","last_active":"2023-10-03T19:17:36.516521+0000","last_peered":"2023-10-03T19:17:36.516521+0000","last_clean":"2023-10-03T19:17:36.516521+0000","last_became_active":"2023-10-03T19:17:35.571266+0000","last_became_peered":"2023-10-03T19:17:35.571266+0000","last_unstale":"2023-10-03T19:17:36.516521+0000","last_undegraded":"2023-10-03T19:17:36.516521+0000","last_fullsized":"2023-10-03T19:17:36.516521+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:18:18.919878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.508784+0000","last_change":"2023-10-03T19:17:34.970988+0000","last_active":"2023-10-03T19:17:36.508784+0000","last_peered":"2023-10-03T19:17:36.508784+0000","last_clean":"2023-10-03T19:17:36.508784+0000","last_became_active":"2023-10-03T19:17:34.970575+0000","last_became_peered":"2023-10-03T19:17:34.970575+0000","last_unstale":"2023-10-03T19:17:36.508784+0000","last_undegraded":"2023-10-03T19:17:36.508784+0000","last_fullsized":"2023-10-03T19:17:36.508784+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:19:56.282554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.591001+0000","last_change":"2023-10-03T19:17:35.524093+0000","last_active":"2023-10-03T19:17:36.591001+0000","last_peered":"2023-10-03T19:17:36.591001+0000","last_clean":"2023-10-03T19:17:36.591001+0000","last_became_active":"2023-10-03T19:17:35.523296+0000","last_became_peered":"2023-10-03T19:17:35.523296+0000","last_unstale":"2023-10-03T19:17:36.591001+0000","last_undegraded":"2023-10-03T19:17:36.591001+0000","last_fullsized":"2023-10-03T19:17:36.591001+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:15:55.315434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.586420+0000","last_change":"2023-10-03T19:17:34.987519+0000","last_active":"2023-10-03T19:17:36.586420+0000","last_peered":"2023-10-03T19:17:36.586420+0000","last_clean":"2023-10-03T19:17:36.586420+0000","last_became_active":"2023-10-03T19:17:34.987220+0000","last_became_peered":"2023-10-03T19:17:34.987220+0000","last_unstale":"2023-10-03T19:17:36.586420+0000","last_undegraded":"2023-10-03T19:17:36.586420+0000","last_fullsized":"2023-10-03T19:17:36.586420+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:45:02.155286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.508336+0000","last_change":"2023-10-03T19:17:35.548253+0000","last_active":"2023-10-03T19:17:36.508336+0000","last_peered":"2023-10-03T19:17:36.508336+0000","last_clean":"2023-10-03T19:17:36.508336+0000","last_became_active":"2023-10-03T19:17:35.547119+0000","last_became_peered":"2023-10-03T19:17:35.547119+0000","last_unstale":"2023-10-03T19:17:36.508336+0000","last_undegraded":"2023-10-03T19:17:36.508336+0000","last_fullsized":"2023-10-03T19:17:36.508336+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:52:06.365823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.592142+0000","last_change":"2023-10-03T19:17:34.994675+0000","last_active":"2023-10-03T19:17:36.592142+0000","last_peered":"2023-10-03T19:17:36.592142+0000","last_clean":"2023-10-03T19:17:36.592142+0000","last_became_active":"2023-10-03T19:17:34.994014+0000","last_became_peered":"2023-10-03T19:17:34.994014+0000","last_unstale":"2023-10-03T19:17:36.592142+0000","last_undegraded":"2023-10-03T19:17:36.592142+0000","last_fullsized":"2023-10-03T19:17:36.592142+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:00:23.194879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.515534+0000","last_change":"2023-10-03T19:17:35.574919+0000","last_active":"2023-10-03T19:17:36.515534+0000","last_peered":"2023-10-03T19:17:36.515534+0000","last_clean":"2023-10-03T19:17:36.515534+0000","last_became_active":"2023-10-03T19:17:35.572469+0000","last_became_peered":"2023-10-03T19:17:35.572469+0000","last_unstale":"2023-10-03T19:17:36.515534+0000","last_undegraded":"2023-10-03T19:17:36.515534+0000","last_fullsized":"2023-10-03T19:17:36.515534+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:46:22.473033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.514926+0000","last_change":"2023-10-03T19:17:34.983598+0000","last_active":"2023-10-03T19:17:36.514926+0000","last_peered":"2023-10-03T19:17:36.514926+0000","last_clean":"2023-10-03T19:17:36.514926+0000","last_became_active":"2023-10-03T19:17:34.982807+0000","last_became_peered":"2023-10-03T19:17:34.982807+0000","last_unstale":"2023-10-03T19:17:36.514926+0000","last_undegraded":"2023-10-03T19:17:36.514926+0000","last_fullsized":"2023-10-03T19:17:36.514926+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:46:00.220125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-03T19:17:35.526201+0000","last_change":"2023-10-03T19:17:35.519463+0000","last_active":"2023-10-03T19:17:35.526201+0000","last_peered":"2023-10-03T19:17:35.526201+0000","last_clean":"2023-10-03T19:17:35.526201+0000","last_became_active":"2023-10-03T19:17:35.518872+0000","last_became_peered":"2023-10-03T19:17:35.518872+0000","last_unstale":"2023-10-03T19:17:35.526201+0000","last_undegraded":"2023-10-03T19:17:35.526201+0000","last_fullsized":"2023-10-03T19:17:35.526201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:21:14.582919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"73'3","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.586950+0000","last_change":"2023-10-03T19:17:34.972880+0000","last_active":"2023-10-03T19:17:36.586950+0000","last_peered":"2023-10-03T19:17:36.586950+0000","last_clean":"2023-10-03T19:17:36.586950+0000","last_became_active":"2023-10-03T19:17:34.972082+0000","last_became_peered":"2023-10-03T19:17:34.972082+0000","last_unstale":"2023-10-03T19:17:36.586950+0000","last_undegraded":"2023-10-03T19:17:36.586950+0000","last_fullsized":"2023-10-03T19:17:36.586950+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:10:42.884254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.540873+0000","last_change":"2023-10-03T19:17:35.523673+0000","last_active":"2023-10-03T19:17:36.540873+0000","last_peered":"2023-10-03T19:17:36.540873+0000","last_clean":"2023-10-03T19:17:36.540873+0000","last_became_active":"2023-10-03T19:17:35.523341+0000","last_became_peered":"2023-10-03T19:17:35.523341+0000","last_unstale":"2023-10-03T19:17:36.540873+0000","last_undegraded":"2023-10-03T19:17:36.540873+0000","last_fullsized":"2023-10-03T19:17:36.540873+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:20:09.018778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"73'6","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.591092+0000","last_change":"2023-10-03T19:17:34.992230+0000","last_active":"2023-10-03T19:17:36.591092+0000","last_peered":"2023-10-03T19:17:36.591092+0000","last_clean":"2023-10-03T19:17:36.591092+0000","last_became_active":"2023-10-03T19:17:34.991636+0000","last_became_peered":"2023-10-03T19:17:34.991636+0000","last_unstale":"2023-10-03T19:17:36.591092+0000","last_undegraded":"2023-10-03T19:17:36.591092+0000","last_fullsized":"2023-10-03T19:17:36.591092+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:01:54.050262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.514870+0000","last_change":"2023-10-03T19:17:35.542559+0000","last_active":"2023-10-03T19:17:36.514870+0000","last_peered":"2023-10-03T19:17:36.514870+0000","last_clean":"2023-10-03T19:17:36.514870+0000","last_became_active":"2023-10-03T19:17:35.541822+0000","last_became_peered":"2023-10-03T19:17:35.541822+0000","last_unstale":"2023-10-03T19:17:36.514870+0000","last_undegraded":"2023-10-03T19:17:36.514870+0000","last_fullsized":"2023-10-03T19:17:36.514870+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:55:16.939500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"73'2","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.513597+0000","last_change":"2023-10-03T19:17:34.984310+0000","last_active":"2023-10-03T19:17:36.513597+0000","last_peered":"2023-10-03T19:17:36.513597+0000","last_clean":"2023-10-03T19:17:36.513597+0000","last_became_active":"2023-10-03T19:17:34.983598+0000","last_became_peered":"2023-10-03T19:17:34.983598+0000","last_unstale":"2023-10-03T19:17:36.513597+0000","last_undegraded":"2023-10-03T19:17:36.513597+0000","last_fullsized":"2023-10-03T19:17:36.513597+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:12:03.918571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.590456+0000","last_change":"2023-10-03T19:17:35.527552+0000","last_active":"2023-10-03T19:17:36.590456+0000","last_peered":"2023-10-03T19:17:36.590456+0000","last_clean":"2023-10-03T19:17:36.590456+0000","last_became_active":"2023-10-03T19:17:35.526536+0000","last_became_peered":"2023-10-03T19:17:35.526536+0000","last_unstale":"2023-10-03T19:17:36.590456+0000","last_undegraded":"2023-10-03T19:17:36.590456+0000","last_fullsized":"2023-10-03T19:17:36.590456+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:49:15.072045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.591174+0000","last_change":"2023-10-03T19:17:34.985937+0000","last_active":"2023-10-03T19:17:36.591174+0000","last_peered":"2023-10-03T19:17:36.591174+0000","last_clean":"2023-10-03T19:17:36.591174+0000","last_became_active":"2023-10-03T19:17:34.985121+0000","last_became_peered":"2023-10-03T19:17:34.985121+0000","last_unstale":"2023-10-03T19:17:36.591174+0000","last_undegraded":"2023-10-03T19:17:36.591174+0000","last_fullsized":"2023-10-03T19:17:36.591174+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:23:23.735338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.590764+0000","last_change":"2023-10-03T19:17:35.573678+0000","last_active":"2023-10-03T19:17:36.590764+0000","last_peered":"2023-10-03T19:17:36.590764+0000","last_clean":"2023-10-03T19:17:36.590764+0000","last_became_active":"2023-10-03T19:17:35.573281+0000","last_became_peered":"2023-10-03T19:17:35.573281+0000","last_unstale":"2023-10-03T19:17:36.590764+0000","last_undegraded":"2023-10-03T19:17:36.590764+0000","last_fullsized":"2023-10-03T19:17:36.590764+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:11:58.029618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.586952+0000","last_change":"2023-10-03T19:17:34.971508+0000","last_active":"2023-10-03T19:17:36.586952+0000","last_peered":"2023-10-03T19:17:36.586952+0000","last_clean":"2023-10-03T19:17:36.586952+0000","last_became_active":"2023-10-03T19:17:34.970573+0000","last_became_peered":"2023-10-03T19:17:34.970573+0000","last_unstale":"2023-10-03T19:17:36.586952+0000","last_undegraded":"2023-10-03T19:17:36.586952+0000","last_fullsized":"2023-10-03T19:17:36.586952+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:40:31.779140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.591183+0000","last_change":"2023-10-03T19:17:35.530725+0000","last_active":"2023-10-03T19:17:36.591183+0000","last_peered":"2023-10-03T19:17:36.591183+0000","last_clean":"2023-10-03T19:17:36.591183+0000","last_became_active":"2023-10-03T19:17:35.530029+0000","last_became_peered":"2023-10-03T19:17:35.530029+0000","last_unstale":"2023-10-03T19:17:36.591183+0000","last_undegraded":"2023-10-03T19:17:36.591183+0000","last_fullsized":"2023-10-03T19:17:36.591183+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:34:35.245586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"73'8","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.508658+0000","last_change":"2023-10-03T19:17:34.978823+0000","last_active":"2023-10-03T19:17:36.508658+0000","last_peered":"2023-10-03T19:17:36.508658+0000","last_clean":"2023-10-03T19:17:36.508658+0000","last_became_active":"2023-10-03T19:17:34.978368+0000","last_became_peered":"2023-10-03T19:17:34.978368+0000","last_unstale":"2023-10-03T19:17:36.508658+0000","last_undegraded":"2023-10-03T19:17:36.508658+0000","last_fullsized":"2023-10-03T19:17:36.508658+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:07:26.851905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.515038+0000","last_change":"2023-10-03T19:17:35.561595+0000","last_active":"2023-10-03T19:17:36.515038+0000","last_peered":"2023-10-03T19:17:36.515038+0000","last_clean":"2023-10-03T19:17:36.515038+0000","last_became_active":"2023-10-03T19:17:35.560931+0000","last_became_peered":"2023-10-03T19:17:35.560931+0000","last_unstale":"2023-10-03T19:17:36.515038+0000","last_undegraded":"2023-10-03T19:17:36.515038+0000","last_fullsized":"2023-10-03T19:17:36.515038+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:12:48.956092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"73'2","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.513994+0000","last_change":"2023-10-03T19:17:34.983172+0000","last_active":"2023-10-03T19:17:36.513994+0000","last_peered":"2023-10-03T19:17:36.513994+0000","last_clean":"2023-10-03T19:17:36.513994+0000","last_became_active":"2023-10-03T19:17:34.982492+0000","last_became_peered":"2023-10-03T19:17:34.982492+0000","last_unstale":"2023-10-03T19:17:36.513994+0000","last_undegraded":"2023-10-03T19:17:36.513994+0000","last_fullsized":"2023-10-03T19:17:36.513994+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:16:58.045471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.590521+0000","last_change":"2023-10-03T19:17:35.540981+0000","last_active":"2023-10-03T19:17:36.590521+0000","last_peered":"2023-10-03T19:17:36.590521+0000","last_clean":"2023-10-03T19:17:36.590521+0000","last_became_active":"2023-10-03T19:17:35.540286+0000","last_became_peered":"2023-10-03T19:17:35.540286+0000","last_unstale":"2023-10-03T19:17:36.590521+0000","last_undegraded":"2023-10-03T19:17:36.590521+0000","last_fullsized":"2023-10-03T19:17:36.590521+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:27:02.691573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.509731+0000","last_change":"2023-10-03T19:17:34.966792+0000","last_active":"2023-10-03T19:17:36.509731+0000","last_peered":"2023-10-03T19:17:36.509731+0000","last_clean":"2023-10-03T19:17:36.509731+0000","last_became_active":"2023-10-03T19:17:34.966475+0000","last_became_peered":"2023-10-03T19:17:34.966475+0000","last_unstale":"2023-10-03T19:17:36.509731+0000","last_undegraded":"2023-10-03T19:17:36.509731+0000","last_fullsized":"2023-10-03T19:17:36.509731+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:06:06.750947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.515808+0000","last_change":"2023-10-03T19:17:35.560040+0000","last_active":"2023-10-03T19:17:36.515808+0000","last_peered":"2023-10-03T19:17:36.515808+0000","last_clean":"2023-10-03T19:17:36.515808+0000","last_became_active":"2023-10-03T19:17:35.558233+0000","last_became_peered":"2023-10-03T19:17:35.558233+0000","last_unstale":"2023-10-03T19:17:36.515808+0000","last_undegraded":"2023-10-03T19:17:36.515808+0000","last_fullsized":"2023-10-03T19:17:36.515808+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:26:08.801209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.592888+0000","last_change":"2023-10-03T19:17:34.991792+0000","last_active":"2023-10-03T19:17:36.592888+0000","last_peered":"2023-10-03T19:17:36.592888+0000","last_clean":"2023-10-03T19:17:36.592888+0000","last_became_active":"2023-10-03T19:17:34.991144+0000","last_became_peered":"2023-10-03T19:17:34.991144+0000","last_unstale":"2023-10-03T19:17:36.592888+0000","last_undegraded":"2023-10-03T19:17:36.592888+0000","last_fullsized":"2023-10-03T19:17:36.592888+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:31:17.349964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.509205+0000","last_change":"2023-10-03T19:17:35.557074+0000","last_active":"2023-10-03T19:17:36.509205+0000","last_peered":"2023-10-03T19:17:36.509205+0000","last_clean":"2023-10-03T19:17:36.509205+0000","last_became_active":"2023-10-03T19:17:35.556801+0000","last_became_peered":"2023-10-03T19:17:35.556801+0000","last_unstale":"2023-10-03T19:17:36.509205+0000","last_undegraded":"2023-10-03T19:17:36.509205+0000","last_fullsized":"2023-10-03T19:17:36.509205+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:10:41.284763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.591738+0000","last_change":"2023-10-03T19:17:34.992854+0000","last_active":"2023-10-03T19:17:36.591738+0000","last_peered":"2023-10-03T19:17:36.591738+0000","last_clean":"2023-10-03T19:17:36.591738+0000","last_became_active":"2023-10-03T19:17:34.992183+0000","last_became_peered":"2023-10-03T19:17:34.992183+0000","last_unstale":"2023-10-03T19:17:36.591738+0000","last_undegraded":"2023-10-03T19:17:36.591738+0000","last_fullsized":"2023-10-03T19:17:36.591738+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:27:29.761838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.590495+0000","last_change":"2023-10-03T19:17:35.539169+0000","last_active":"2023-10-03T19:17:36.590495+0000","last_peered":"2023-10-03T19:17:36.590495+0000","last_clean":"2023-10-03T19:17:36.590495+0000","last_became_active":"2023-10-03T19:17:35.538563+0000","last_became_peered":"2023-10-03T19:17:35.538563+0000","last_unstale":"2023-10-03T19:17:36.590495+0000","last_undegraded":"2023-10-03T19:17:36.590495+0000","last_fullsized":"2023-10-03T19:17:36.590495+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:03:24.151546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.591097+0000","last_change":"2023-10-03T19:17:34.981348+0000","last_active":"2023-10-03T19:17:36.591097+0000","last_peered":"2023-10-03T19:17:36.591097+0000","last_clean":"2023-10-03T19:17:36.591097+0000","last_became_active":"2023-10-03T19:17:34.980568+0000","last_became_peered":"2023-10-03T19:17:34.980568+0000","last_unstale":"2023-10-03T19:17:36.591097+0000","last_undegraded":"2023-10-03T19:17:36.591097+0000","last_fullsized":"2023-10-03T19:17:36.591097+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:11:06.620842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.590807+0000","last_change":"2023-10-03T19:17:35.529960+0000","last_active":"2023-10-03T19:17:36.590807+0000","last_peered":"2023-10-03T19:17:36.590807+0000","last_clean":"2023-10-03T19:17:36.590807+0000","last_became_active":"2023-10-03T19:17:35.527563+0000","last_became_peered":"2023-10-03T19:17:35.527563+0000","last_unstale":"2023-10-03T19:17:36.590807+0000","last_undegraded":"2023-10-03T19:17:36.590807+0000","last_fullsized":"2023-10-03T19:17:36.590807+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:01:11.068696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.586161+0000","last_change":"2023-10-03T19:17:34.972038+0000","last_active":"2023-10-03T19:17:36.586161+0000","last_peered":"2023-10-03T19:17:36.586161+0000","last_clean":"2023-10-03T19:17:36.586161+0000","last_became_active":"2023-10-03T19:17:34.971250+0000","last_became_peered":"2023-10-03T19:17:34.971250+0000","last_unstale":"2023-10-03T19:17:36.586161+0000","last_undegraded":"2023-10-03T19:17:36.586161+0000","last_fullsized":"2023-10-03T19:17:36.586161+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:55:49.987415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.541071+0000","last_change":"2023-10-03T19:17:35.531236+0000","last_active":"2023-10-03T19:17:36.541071+0000","last_peered":"2023-10-03T19:17:36.541071+0000","last_clean":"2023-10-03T19:17:36.541071+0000","last_became_active":"2023-10-03T19:17:35.530969+0000","last_became_peered":"2023-10-03T19:17:35.530969+0000","last_unstale":"2023-10-03T19:17:36.541071+0000","last_undegraded":"2023-10-03T19:17:36.541071+0000","last_fullsized":"2023-10-03T19:17:36.541071+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:17:19.019240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.590878+0000","last_change":"2023-10-03T19:17:34.981384+0000","last_active":"2023-10-03T19:17:36.590878+0000","last_peered":"2023-10-03T19:17:36.590878+0000","last_clean":"2023-10-03T19:17:36.590878+0000","last_became_active":"2023-10-03T19:17:34.980632+0000","last_became_peered":"2023-10-03T19:17:34.980632+0000","last_unstale":"2023-10-03T19:17:36.590878+0000","last_undegraded":"2023-10-03T19:17:36.590878+0000","last_fullsized":"2023-10-03T19:17:36.590878+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:28:15.360808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.541255+0000","last_change":"2023-10-03T19:17:35.547532+0000","last_active":"2023-10-03T19:17:36.541255+0000","last_peered":"2023-10-03T19:17:36.541255+0000","last_clean":"2023-10-03T19:17:36.541255+0000","last_became_active":"2023-10-03T19:17:35.547235+0000","last_became_peered":"2023-10-03T19:17:35.547235+0000","last_unstale":"2023-10-03T19:17:36.541255+0000","last_undegraded":"2023-10-03T19:17:36.541255+0000","last_fullsized":"2023-10-03T19:17:36.541255+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:10:20.454121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.540291+0000","last_change":"2023-10-03T19:17:34.956109+0000","last_active":"2023-10-03T19:17:36.540291+0000","last_peered":"2023-10-03T19:17:36.540291+0000","last_clean":"2023-10-03T19:17:36.540291+0000","last_became_active":"2023-10-03T19:17:34.953243+0000","last_became_peered":"2023-10-03T19:17:34.953243+0000","last_unstale":"2023-10-03T19:17:36.540291+0000","last_undegraded":"2023-10-03T19:17:36.540291+0000","last_fullsized":"2023-10-03T19:17:36.540291+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:04:06.426725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.592547+0000","last_change":"2023-10-03T19:17:35.564737+0000","last_active":"2023-10-03T19:17:36.592547+0000","last_peered":"2023-10-03T19:17:36.592547+0000","last_clean":"2023-10-03T19:17:36.592547+0000","last_became_active":"2023-10-03T19:17:35.564216+0000","last_became_peered":"2023-10-03T19:17:35.564216+0000","last_unstale":"2023-10-03T19:17:36.592547+0000","last_undegraded":"2023-10-03T19:17:36.592547+0000","last_fullsized":"2023-10-03T19:17:36.592547+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:55:52.219904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-03T19:17:35.511433+0000","last_change":"2023-10-03T19:17:34.987385+0000","last_active":"2023-10-03T19:17:35.511433+0000","last_peered":"2023-10-03T19:17:35.511433+0000","last_clean":"2023-10-03T19:17:35.511433+0000","last_became_active":"2023-10-03T19:17:34.986923+0000","last_became_peered":"2023-10-03T19:17:34.986923+0000","last_unstale":"2023-10-03T19:17:35.511433+0000","last_undegraded":"2023-10-03T19:17:35.511433+0000","last_fullsized":"2023-10-03T19:17:35.511433+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:30:15.967193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":269,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.591791+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:17:36.591791+0000","last_peered":"2023-10-03T19:17:36.591791+0000","last_clean":"2023-10-03T19:17:36.591791+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:17:36.591791+0000","last_undegraded":"2023-10-03T19:17:36.591791+0000","last_fullsized":"2023-10-03T19:17:36.591791+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:21:38.816278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":117,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.515290+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:17:36.515290+0000","last_peered":"2023-10-03T19:17:36.515290+0000","last_clean":"2023-10-03T19:17:36.515290+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:17:36.515290+0000","last_undegraded":"2023-10-03T19:17:36.515290+0000","last_fullsized":"2023-10-03T19:17:36.515290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:03:59.302429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.509555+0000","last_change":"2023-10-03T19:17:35.569621+0000","last_active":"2023-10-03T19:17:36.509555+0000","last_peered":"2023-10-03T19:17:36.509555+0000","last_clean":"2023-10-03T19:17:36.509555+0000","last_became_active":"2023-10-03T19:17:35.569273+0000","last_became_peered":"2023-10-03T19:17:35.569273+0000","last_unstale":"2023-10-03T19:17:36.509555+0000","last_undegraded":"2023-10-03T19:17:36.509555+0000","last_fullsized":"2023-10-03T19:17:36.509555+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:56:28.279085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-03T19:17:35.508516+0000","last_change":"2023-10-03T19:17:34.987328+0000","last_active":"2023-10-03T19:17:35.508516+0000","last_peered":"2023-10-03T19:17:35.508516+0000","last_clean":"2023-10-03T19:17:35.508516+0000","last_became_active":"2023-10-03T19:17:34.986860+0000","last_became_peered":"2023-10-03T19:17:34.986860+0000","last_unstale":"2023-10-03T19:17:35.508516+0000","last_undegraded":"2023-10-03T19:17:35.508516+0000","last_fullsized":"2023-10-03T19:17:35.508516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:38:03.835027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":117,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.591656+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:17:36.591656+0000","last_peered":"2023-10-03T19:17:36.591656+0000","last_clean":"2023-10-03T19:17:36.591656+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:17:36.591656+0000","last_undegraded":"2023-10-03T19:17:36.591656+0000","last_fullsized":"2023-10-03T19:17:36.591656+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:17:13.546628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.591346+0000","last_change":"2023-10-03T19:17:35.535353+0000","last_active":"2023-10-03T19:17:36.591346+0000","last_peered":"2023-10-03T19:17:36.591346+0000","last_clean":"2023-10-03T19:17:36.591346+0000","last_became_active":"2023-10-03T19:17:35.534638+0000","last_became_peered":"2023-10-03T19:17:35.534638+0000","last_unstale":"2023-10-03T19:17:36.591346+0000","last_undegraded":"2023-10-03T19:17:36.591346+0000","last_fullsized":"2023-10-03T19:17:36.591346+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:11:16.336231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-03T19:17:35.508741+0000","last_change":"2023-10-03T19:17:34.987217+0000","last_active":"2023-10-03T19:17:35.508741+0000","last_peered":"2023-10-03T19:17:35.508741+0000","last_clean":"2023-10-03T19:17:35.508741+0000","last_became_active":"2023-10-03T19:17:34.986805+0000","last_became_peered":"2023-10-03T19:17:34.986805+0000","last_unstale":"2023-10-03T19:17:35.508741+0000","last_undegraded":"2023-10-03T19:17:35.508741+0000","last_fullsized":"2023-10-03T19:17:35.508741+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:38:42.623813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":115,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.587019+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:17:36.587019+0000","last_peered":"2023-10-03T19:17:36.587019+0000","last_clean":"2023-10-03T19:17:36.587019+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:17:36.587019+0000","last_undegraded":"2023-10-03T19:17:36.587019+0000","last_fullsized":"2023-10-03T19:17:36.587019+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:08:00.435854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.509229+0000","last_change":"2023-10-03T19:17:35.541433+0000","last_active":"2023-10-03T19:17:36.509229+0000","last_peered":"2023-10-03T19:17:36.509229+0000","last_clean":"2023-10-03T19:17:36.509229+0000","last_became_active":"2023-10-03T19:17:35.541149+0000","last_became_peered":"2023-10-03T19:17:35.541149+0000","last_unstale":"2023-10-03T19:17:36.509229+0000","last_undegraded":"2023-10-03T19:17:36.509229+0000","last_fullsized":"2023-10-03T19:17:36.509229+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:51:31.787300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"73'2","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-03T19:17:35.526787+0000","last_change":"2023-10-03T19:17:34.962338+0000","last_active":"2023-10-03T19:17:35.526787+0000","last_peered":"2023-10-03T19:17:35.526787+0000","last_clean":"2023-10-03T19:17:35.526787+0000","last_became_active":"2023-10-03T19:17:34.962075+0000","last_became_peered":"2023-10-03T19:17:34.962075+0000","last_unstale":"2023-10-03T19:17:35.526787+0000","last_undegraded":"2023-10-03T19:17:35.526787+0000","last_fullsized":"2023-10-03T19:17:35.526787+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:16:20.775927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":117,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.513656+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:17:36.513656+0000","last_peered":"2023-10-03T19:17:36.513656+0000","last_clean":"2023-10-03T19:17:36.513656+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:17:36.513656+0000","last_undegraded":"2023-10-03T19:17:36.513656+0000","last_fullsized":"2023-10-03T19:17:36.513656+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:19:49.048391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.585742+0000","last_change":"2023-10-03T19:17:35.532610+0000","last_active":"2023-10-03T19:17:36.585742+0000","last_peered":"2023-10-03T19:17:36.585742+0000","last_clean":"2023-10-03T19:17:36.585742+0000","last_became_active":"2023-10-03T19:17:35.530780+0000","last_became_peered":"2023-10-03T19:17:35.530780+0000","last_unstale":"2023-10-03T19:17:36.585742+0000","last_undegraded":"2023-10-03T19:17:36.585742+0000","last_fullsized":"2023-10-03T19:17:36.585742+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:44:59.634334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"73'1","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.587121+0000","last_change":"2023-10-03T19:17:34.988633+0000","last_active":"2023-10-03T19:17:36.587121+0000","last_peered":"2023-10-03T19:17:36.587121+0000","last_clean":"2023-10-03T19:17:36.587121+0000","last_became_active":"2023-10-03T19:17:34.988248+0000","last_became_peered":"2023-10-03T19:17:34.988248+0000","last_unstale":"2023-10-03T19:17:36.587121+0000","last_undegraded":"2023-10-03T19:17:36.587121+0000","last_fullsized":"2023-10-03T19:17:36.587121+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:28:27.102694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":115,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.540697+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:17:36.540697+0000","last_peered":"2023-10-03T19:17:36.540697+0000","last_clean":"2023-10-03T19:17:36.540697+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:17:36.540697+0000","last_undegraded":"2023-10-03T19:17:36.540697+0000","last_fullsized":"2023-10-03T19:17:36.540697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:15:38.947914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-03T19:17:35.528543+0000","last_change":"2023-10-03T19:17:35.526532+0000","last_active":"2023-10-03T19:17:35.528543+0000","last_peered":"2023-10-03T19:17:35.528543+0000","last_clean":"2023-10-03T19:17:35.528543+0000","last_became_active":"2023-10-03T19:17:35.525993+0000","last_became_peered":"2023-10-03T19:17:35.525993+0000","last_unstale":"2023-10-03T19:17:35.528543+0000","last_undegraded":"2023-10-03T19:17:35.528543+0000","last_fullsized":"2023-10-03T19:17:35.528543+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:07:03.811328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.540475+0000","last_change":"2023-10-03T19:17:34.972068+0000","last_active":"2023-10-03T19:17:36.540475+0000","last_peered":"2023-10-03T19:17:36.540475+0000","last_clean":"2023-10-03T19:17:36.540475+0000","last_became_active":"2023-10-03T19:17:34.971604+0000","last_became_peered":"2023-10-03T19:17:34.971604+0000","last_unstale":"2023-10-03T19:17:36.540475+0000","last_undegraded":"2023-10-03T19:17:36.540475+0000","last_fullsized":"2023-10-03T19:17:36.540475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:17:10.891033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":117,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.592744+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:17:36.592744+0000","last_peered":"2023-10-03T19:17:36.592744+0000","last_clean":"2023-10-03T19:17:36.592744+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:17:36.592744+0000","last_undegraded":"2023-10-03T19:17:36.592744+0000","last_fullsized":"2023-10-03T19:17:36.592744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:14:48.702198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-03T19:17:35.526121+0000","last_change":"2023-10-03T19:17:35.518292+0000","last_active":"2023-10-03T19:17:35.526121+0000","last_peered":"2023-10-03T19:17:35.526121+0000","last_clean":"2023-10-03T19:17:35.526121+0000","last_became_active":"2023-10-03T19:17:35.517978+0000","last_became_peered":"2023-10-03T19:17:35.517978+0000","last_unstale":"2023-10-03T19:17:35.526121+0000","last_undegraded":"2023-10-03T19:17:35.526121+0000","last_fullsized":"2023-10-03T19:17:35.526121+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:21:48.943972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"73'1","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.592482+0000","last_change":"2023-10-03T19:17:34.991315+0000","last_active":"2023-10-03T19:17:36.592482+0000","last_peered":"2023-10-03T19:17:36.592482+0000","last_clean":"2023-10-03T19:17:36.592482+0000","last_became_active":"2023-10-03T19:17:34.990035+0000","last_became_peered":"2023-10-03T19:17:34.990035+0000","last_unstale":"2023-10-03T19:17:36.592482+0000","last_undegraded":"2023-10-03T19:17:36.592482+0000","last_fullsized":"2023-10-03T19:17:36.592482+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:20:54.119868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":115,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.541205+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:17:36.541205+0000","last_peered":"2023-10-03T19:17:36.541205+0000","last_clean":"2023-10-03T19:17:36.541205+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:17:36.541205+0000","last_undegraded":"2023-10-03T19:17:36.541205+0000","last_fullsized":"2023-10-03T19:17:36.541205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:24:48.460375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.586900+0000","last_change":"2023-10-03T19:17:35.537768+0000","last_active":"2023-10-03T19:17:36.586900+0000","last_peered":"2023-10-03T19:17:36.586900+0000","last_clean":"2023-10-03T19:17:36.586900+0000","last_became_active":"2023-10-03T19:17:35.537529+0000","last_became_peered":"2023-10-03T19:17:35.537529+0000","last_unstale":"2023-10-03T19:17:36.586900+0000","last_undegraded":"2023-10-03T19:17:36.586900+0000","last_fullsized":"2023-10-03T19:17:36.586900+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:34.923157+0000","last_clean_scrub_stamp":"2023-10-03T19:17:34.923157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:30:16.325646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"73'2","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.516553+0000","last_change":"2023-10-03T19:17:34.972327+0000","last_active":"2023-10-03T19:17:36.516553+0000","last_peered":"2023-10-03T19:17:36.516553+0000","last_clean":"2023-10-03T19:17:36.516553+0000","last_became_active":"2023-10-03T19:17:34.971524+0000","last_became_peered":"2023-10-03T19:17:34.971524+0000","last_unstale":"2023-10-03T19:17:36.516553+0000","last_undegraded":"2023-10-03T19:17:36.516553+0000","last_fullsized":"2023-10-03T19:17:36.516553+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:17:33.908002+0000","last_clean_scrub_stamp":"2023-10-03T19:17:33.908002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:00:25.168056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":115,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-03T19:17:36.591447+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:17:36.591447+0000","last_peered":"2023-10-03T19:17:36.591447+0000","last_clean":"2023-10-03T19:17:36.591447+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:17:36.591447+0000","last_undegraded":"2023-10-03T19:17:36.591447+0000","last_fullsized":"2023-10-03T19:17:36.591447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:22:38.090487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509506,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":26496,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":962560,"data_stored":993604,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27131904},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.87,"15min":0.93200000000000005},"min":{"1min":0.503,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1399999999999999,"5min":4.0469999999999997,"15min":4.0469999999999997},"last":1.206},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.85499999999999998,"15min":0.81100000000000005},"min":{"1min":0.55100000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1699999999999999,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.97299999999999998}]},{"osd":1,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.90000000000000002,"15min":1.012},"min":{"1min":0.59999999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.194,"5min":3.8239999999999998,"15min":3.8239999999999998},"last":1.006},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.88600000000000001,"15min":0.85999999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2609999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.72599999999999998}]},{"osd":2,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.94099999999999995,"15min":0.871},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.236,"5min":6.0449999999999999,"15min":6.0449999999999999},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.96899999999999997,"15min":1.0289999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2949999999999999,"5min":3.98,"15min":3.98},"last":1.1000000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0249999999999999,"15min":0.95399999999999996},"min":{"1min":0.64700000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":3.3940000000000001,"5min":6.125,"15min":6.125},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.038,"15min":1.1120000000000001},"min":{"1min":0.77800000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1259999999999999,"5min":3.9140000000000001,"15min":3.9140000000000001},"last":0.88}]},{"osd":4,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.96799999999999997,"15min":1.1379999999999999},"min":{"1min":0.63800000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1160000000000001,"5min":5.1130000000000004,"15min":5.1130000000000004},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.012,"5min":1.018,"15min":1.0269999999999999},"min":{"1min":0.67900000000000005,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.3380000000000001,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":0.93700000000000006}]},{"osd":5,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.0680000000000001,"15min":1.246},"min":{"1min":0.69499999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2250000000000001,"5min":5.1859999999999999,"15min":5.1859999999999999},"last":1.155},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.0449999999999999,"15min":1.133},"min":{"1min":0.82199999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.163,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.1279999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.085,"15min":1.097},"min":{"1min":0.75700000000000001,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.2190000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.105,"5min":1.1619999999999999,"15min":1.1799999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.3999999999999999,"5min":6.1580000000000004,"15min":6.1580000000000004},"last":0.78700000000000003}]}]},{"osd":6,"up_from":15,"seq":64424509506,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15928,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":15040,"kb_avail":94355912,"statfs":{"total":96636764160,"available":96620453888,"internally_reserved":0,"allocated":901120,"data_stored":403614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15400960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:17:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.84399999999999997,"15min":0.82199999999999995},"min":{"1min":0.45400000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3340000000000001,"5min":1.504,"15min":1.504},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.89000000000000001,"15min":0.88200000000000001},"min":{"1min":0.58099999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1950000000000001,"5min":1.839,"15min":1.839},"last":0.88800000000000001}]},{"osd":1,"last update":"Tue Oct 3 19:17:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.85999999999999999,"15min":0.84199999999999997},"min":{"1min":0.53900000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.27,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.90000000000000002,"15min":0.88400000000000001},"min":{"1min":0.58199999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1879999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.98499999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:17:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.93000000000000005,"15min":0.878},"min":{"1min":0.66100000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1890000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.91400000000000003,"15min":0.92400000000000004},"min":{"1min":0.60199999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.369,"5min":1.546,"15min":1.546},"last":0.79500000000000004}]},{"osd":3,"last update":"Tue Oct 3 19:17:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95899999999999996,"15min":0.97899999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1859999999999999,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.90500000000000003,"15min":0.90800000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.206,"5min":2.121,"15min":2.121},"last":0.91100000000000003}]},{"osd":4,"last update":"Tue Oct 3 19:17:29 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.94899999999999995,"15min":1.018},"min":{"1min":0.64900000000000002,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.28,"5min":1.95,"15min":1.95},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0069999999999999,"15min":1.0820000000000001},"min":{"1min":0.68999999999999995,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2989999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.67400000000000004}]},{"osd":5,"last update":"Tue Oct 3 19:17:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.94399999999999995,"15min":1.01},"min":{"1min":0.65100000000000002,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.276,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0669999999999999,"15min":1.1160000000000001},"min":{"1min":0.70699999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.3420000000000001,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.83599999999999997}]},{"osd":7,"last update":"Tue Oct 3 19:17:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0740000000000001,"15min":1.115},"min":{"1min":0.81200000000000006,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.3049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.014},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.05,"15min":1.0900000000000001},"min":{"1min":0.70199999999999996,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3420000000000001,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":0.95199999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509507,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26360,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":25472,"kb_avail":94345480,"statfs":{"total":96636764160,"available":96609771520,"internally_reserved":0,"allocated":901120,"data_stored":398229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":26083328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:17:24 2023","interfaces":[{"interface":"back","average":{"1min":1.804,"5min":1.0429999999999999,"15min":0.85899999999999999},"min":{"1min":0.63900000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":17.686,"5min":17.686,"15min":17.686},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.665,"5min":1.0089999999999999,"15min":0.88200000000000001},"min":{"1min":0.56399999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":16.925999999999998,"5min":16.925999999999998,"15min":16.925999999999998},"last":0.76000000000000001}]},{"osd":1,"last update":"Tue Oct 3 19:17:24 2023","interfaces":[{"interface":"back","average":{"1min":1.726,"5min":1.077,"15min":0.98399999999999999},"min":{"1min":0.68899999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":16.640999999999998,"5min":16.640999999999998,"15min":16.640999999999998},"last":1.143},{"interface":"front","average":{"1min":1.78,"5min":1.0840000000000001,"15min":0.92400000000000004},"min":{"1min":0.63100000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":17.59,"5min":17.59,"15min":17.59},"last":1.018}]},{"osd":2,"last update":"Tue Oct 3 19:17:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.0209999999999999,"15min":0.94399999999999995},"min":{"1min":0.63500000000000001,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":8.5630000000000006,"5min":8.5630000000000006,"15min":8.5630000000000006},"last":0.874},{"interface":"front","average":{"1min":1.839,"5min":1.147,"15min":1.0049999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":17.734000000000002,"5min":17.734000000000002,"15min":17.734000000000002},"last":0.80000000000000004}]},{"osd":3,"last update":"Tue Oct 3 19:17:24 2023","interfaces":[{"interface":"back","average":{"1min":1.6890000000000001,"5min":1.0580000000000001,"15min":0.93200000000000005},"min":{"1min":0.64800000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":16.98,"5min":16.98,"15min":16.98},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.823,"5min":1.194,"15min":1.115},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":16.434000000000001,"5min":16.434000000000001,"15min":16.434000000000001},"last":1.05}]},{"osd":5,"last update":"Tue Oct 3 19:17:24 2023","interfaces":[{"interface":"back","average":{"1min":1.839,"5min":1.143,"15min":1.101},"min":{"1min":0.622,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":17.782,"5min":17.782,"15min":17.782},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.97599999999999998,"15min":1.01},"min":{"1min":0.81000000000000005,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.627,"5min":1.635,"15min":1.635},"last":0.94799999999999995}]},{"osd":6,"last update":"Tue Oct 3 19:17:24 2023","interfaces":[{"interface":"back","average":{"1min":2.9100000000000001,"5min":1.413,"15min":1.2949999999999999},"min":{"1min":0.68400000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":36.106000000000002,"5min":36.106000000000002,"15min":36.106000000000002},"last":1.236},{"interface":"front","average":{"1min":2.0059999999999998,"5min":1.27,"15min":1.234},"min":{"1min":0.70799999999999996,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":17.646999999999998,"5min":17.646999999999998,"15min":17.646999999999998},"last":1.173}]},{"osd":7,"last update":"Tue Oct 3 19:17:24 2023","interfaces":[{"interface":"back","average":{"1min":1.897,"5min":1.21,"15min":1.1379999999999999},"min":{"1min":0.78400000000000003,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":17.042000000000002,"5min":17.042000000000002,"15min":17.042000000000002},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.9730000000000001,"5min":1.321,"15min":1.2729999999999999},"min":{"1min":0.78800000000000003,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":16.32,"5min":16.32,"15min":16.32},"last":1.3140000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509507,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30968,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":30080,"kb_avail":94340872,"statfs":{"total":96636764160,"available":96605052928,"internally_reserved":0,"allocated":901120,"data_stored":402792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30801920},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61899999999999999,"15min":0.54600000000000004},"min":{"1min":0.32200000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.87,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.71699999999999997,"15min":0.63700000000000001},"min":{"1min":0.34699999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.137,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.436}]},{"osd":1,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73899999999999999,"15min":0.64200000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.68799999999999994,"15min":0.60899999999999999},"min":{"1min":0.34799999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.92900000000000005,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.56599999999999995}]},{"osd":3,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73299999999999998,"15min":0.64300000000000002},"min":{"1min":0.28899999999999998,"5min":0.224,"15min":0.224},"max":{"1min":1.323,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.84399999999999997,"15min":0.74299999999999999},"min":{"1min":0.45600000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.51900000000000002}]},{"osd":4,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.93000000000000005,"15min":0.86199999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.4550000000000001,"5min":1.718,"15min":1.718},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0089999999999999,"15min":0.93100000000000005},"min":{"1min":0.67900000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.70699999999999996}]},{"osd":5,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.98699999999999999,"15min":0.88900000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.0780000000000001,"15min":0.96899999999999997},"min":{"1min":0.57599999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":3.4849999999999999,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.63}]},{"osd":6,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.97999999999999998,"15min":0.92700000000000005},"min":{"1min":0.60099999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.0740000000000001,"15min":0.98799999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.85799999999999998}]},{"osd":7,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1180000000000001,"15min":1.026},"min":{"1min":0.63100000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4670000000000001,"5min":1.76,"15min":1.76},"last":0.72599999999999998},{"interface":"front","average":{"1min":1.038,"5min":1.044,"15min":0.97499999999999998},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.494,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.81399999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509506,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25016,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":24128,"kb_avail":94346824,"statfs":{"total":96636764160,"available":96611147776,"internally_reserved":0,"allocated":901120,"data_stored":403326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24707072},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59299999999999997,"15min":0.55100000000000005},"min":{"1min":0.30499999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.77100000000000002,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.67900000000000005,"15min":0.54100000000000004},"min":{"1min":0.27200000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.0580000000000001}]},{"osd":2,"last update":"Tue Oct 3 19:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.66900000000000004,"15min":0.57299999999999995},"min":{"1min":0.34799999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.93600000000000005,"5min":1.506,"15min":1.506},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.68500000000000005},"min":{"1min":0.41299999999999998,"5min":0.312,"15min":0.312},"max":{"1min":1.252,"5min":1.365,"15min":1.365},"last":0.95699999999999996}]},{"osd":3,"last update":"Tue Oct 3 19:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.75700000000000001,"15min":0.65400000000000003},"min":{"1min":0.36599999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.75,"15min":0.61399999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.2310000000000001,"5min":1.27,"15min":1.27},"last":0.79000000000000004}]},{"osd":4,"last update":"Tue Oct 3 19:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.88800000000000001,"15min":0.81599999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.292,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.292},{"interface":"front","average":{"1min":1.04,"5min":0.97199999999999998,"15min":0.90600000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.131}]},{"osd":5,"last update":"Tue Oct 3 19:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.97399999999999998,"15min":0.878},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.111},{"interface":"front","average":{"1min":1.03,"5min":0.95999999999999996,"15min":0.872},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.256,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.0269999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:17:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.032,"15min":0.94199999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.518,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.248},{"interface":"front","average":{"1min":1.077,"5min":1.022,"15min":0.91800000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.92000000000000004}]},{"osd":7,"last update":"Tue Oct 3 19:17:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.073,"15min":0.96299999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":1.006},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0369999999999999,"15min":0.92600000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4430000000000001,"5min":1.649,"15min":1.649},"last":1.1719999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542210,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35944,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":35072,"kb_avail":94335896,"statfs":{"total":96636764160,"available":96599957504,"internally_reserved":0,"allocated":884736,"data_stored":397143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35913728},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63700000000000001,"15min":0.58099999999999996},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.1779999999999999,"5min":1.212,"15min":1.212},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.69499999999999995,"15min":0.65100000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.65500000000000003}]},{"osd":1,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.69799999999999995,"15min":0.63800000000000001},"min":{"1min":0.29499999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0880000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.754,"15min":0.67900000000000005},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.1599999999999999,"5min":1.222,"15min":1.222},"last":0.747}]},{"osd":2,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.78600000000000003,"15min":0.71899999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73399999999999999,"15min":0.64500000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.55300000000000005}]},{"osd":4,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.93100000000000005,"15min":0.91100000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3169999999999999,"5min":1.496,"15min":1.496},"last":0.72699999999999998},{"interface":"front","average":{"1min":1.04,"5min":1.002,"15min":0.94599999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.538,"5min":1.546,"15min":1.546},"last":0.96399999999999997}]},{"osd":5,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92900000000000005,"15min":0.88600000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.014},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.026,"15min":1},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.419,"5min":1.498,"15min":1.498},"last":0.81100000000000005}]},{"osd":6,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.96799999999999997,"15min":0.92700000000000005},"min":{"1min":0.56999999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.046,"15min":0.99399999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.4970000000000001,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.875}]},{"osd":7,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0649999999999999,"15min":1.0149999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0800000000000001,"15min":1.0269999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.526,"5min":1.708,"15min":1.708},"last":0.93600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574914,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21556,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":20672,"kb_avail":94350284,"statfs":{"total":96636764160,"available":96614690816,"internally_reserved":0,"allocated":897024,"data_stored":403248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21168128},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.88,"15min":0.83399999999999996},"min":{"1min":0.58499999999999996,"5min":0.437,"15min":0.437},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.85399999999999998,"15min":0.85199999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0389999999999999,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.081}]},{"osd":1,"last update":"Tue Oct 3 19:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86099999999999999,"15min":0.83699999999999997},"min":{"1min":0.59099999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.70699999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.159,"5min":1.514,"15min":1.514},"last":0.79900000000000004}]},{"osd":2,"last update":"Tue Oct 3 19:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91200000000000003,"15min":0.89900000000000002},"min":{"1min":0.63400000000000001,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.351,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":1.149},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90900000000000003,"15min":0.89700000000000002},"min":{"1min":0.57099999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0880000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.0369999999999999}]},{"osd":3,"last update":"Tue Oct 3 19:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.92800000000000005,"15min":0.92700000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0389999999999999,"15min":1.0289999999999999},"min":{"1min":0.83599999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.222,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.2749999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.67500000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.3180000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.1919999999999999},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.97999999999999998,"15min":1.026},"min":{"1min":0.67300000000000004,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.2689999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.76000000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:17:35 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.98399999999999999,"15min":1.03},"min":{"1min":0.64600000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2909999999999999,"5min":1.462,"15min":1.462},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.107,"15min":1.133},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.4159999999999999,"5min":1.823,"15min":1.823},"last":1.2350000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:17:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0609999999999999,"15min":1.075},"min":{"1min":0.84699999999999998,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.2589999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.159,"5min":1.1419999999999999,"15min":1.1519999999999999},"min":{"1min":0.87,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.413,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.1080000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574915,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":26880,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":954368,"data_stored":992418,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27525120},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63900000000000001,"15min":0.58899999999999997},"min":{"1min":0.39600000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.871,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.72199999999999998},"min":{"1min":0.37,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.1279999999999999,"5min":1.27,"15min":1.27},"last":0.70399999999999996}]},{"osd":2,"last update":"Tue Oct 3 19:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.751,"15min":0.72299999999999998},"min":{"1min":0.47299999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3080000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72499999999999998,"15min":0.69699999999999995},"min":{"1min":0.33800000000000002,"5min":0.315,"15min":0.315},"max":{"1min":1.04,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.59699999999999998}]},{"osd":3,"last update":"Tue Oct 3 19:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.85699999999999998,"15min":0.749},"min":{"1min":0.51500000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.409,"5min":1.446,"15min":1.446},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.81200000000000006,"15min":0.71399999999999997},"min":{"1min":0.41999999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.103,"5min":1.375,"15min":1.375},"last":0.68300000000000005}]},{"osd":4,"last update":"Tue Oct 3 19:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.92000000000000004,"15min":0.90800000000000003},"min":{"1min":0.65400000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3520000000000001,"5min":1.52,"15min":1.52},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.046,"15min":1.026},"min":{"1min":0.65200000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.393,"5min":1.508,"15min":1.508},"last":1.008}]},{"osd":5,"last update":"Tue Oct 3 19:17:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0720000000000001,"15min":1.05},"min":{"1min":0.68999999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4359999999999999,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.052},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.0229999999999999,"15min":0.98299999999999998},"min":{"1min":0.68600000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3959999999999999,"5min":1.837,"15min":1.837},"last":0.76000000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.052,"15min":1.02},"min":{"1min":0.66800000000000004,"5min":0.623,"15min":0.623},"max":{"1min":1.26,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.05,"15min":1.002},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4750000000000001,"5min":1.637,"15min":1.637},"last":1.024}]},{"osd":7,"last update":"Tue Oct 3 19:17:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.097,"15min":1.046},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.488,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.083,"15min":1.0609999999999999},"min":{"1min":0.68799999999999994,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3400000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.93999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:17:41.934 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-03T19:17:41.990 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-03T19:17:42.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.130+0000 7f2088349640 1 Processor -- start 2023-10-03T19:17:42.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.130+0000 7f2088349640 1 -- start start 2023-10-03T19:17:42.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.130+0000 7f2088349640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f20800712c0 0x7f208006cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:42.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.130+0000 7f2088349640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f208006c3f0 0x7f20800a5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:42.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.130+0000 7f2088349640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20800a6260 con 0x7f208014c3d0 2023-10-03T19:17:42.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.130+0000 7f2088349640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20800bc250 con 0x7f20800712c0 2023-10-03T19:17:42.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.130+0000 7f2088349640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20801507f0 con 0x7f208006c3f0 2023-10-03T19:17:42.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.130+0000 7f20860e5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f20800712c0 0x7f208006cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:42.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.130+0000 7f20860e5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f20800712c0 0x7f208006cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35002/0 (socket says 172.21.15.45:35002) 2023-10-03T19:17:42.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.130+0000 7f20860e5640 1 -- 172.21.15.45:0/2639446782 learned_addr learned my addr 172.21.15.45:0/2639446782 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:42.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.130+0000 7f20858e4640 1 --2- 172.21.15.45:0/2639446782 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f208006c3f0 0x7f20800a5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:42.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.130+0000 7f20860e5640 1 -- 172.21.15.45:0/2639446782 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f208006c3f0 msgr2=0x7f20800a5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.134+0000 7f20860e5640 1 --2- 172.21.15.45:0/2639446782 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f208006c3f0 0x7f20800a5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.134+0000 7f20860e5640 1 -- 172.21.15.45:0/2639446782 >> v1:172.21.15.79:6789/0 conn(0x7f208014c3d0 legacy=0x7f20800a4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.134+0000 7f20860e5640 1 -- 172.21.15.45:0/2639446782 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20800a5a40 con 0x7f20800712c0 2023-10-03T19:17:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.134+0000 7f20858e4640 1 --2- 172.21.15.45:0/2639446782 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f208006c3f0 0x7f20800a5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.134+0000 7f20860e5640 1 --2- 172.21.15.45:0/2639446782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20800712c0 0x7f208006cc30 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f2078009e50 tx=0x7f207801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b72dfceb7bba67a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.134+0000 7f20850e3640 1 -- 172.21.15.45:0/2639446782 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20780a5780 con 0x7f20800712c0 2023-10-03T19:17:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.134+0000 7f20850e3640 1 -- 172.21.15.45:0/2639446782 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20780a58e0 con 0x7f20800712c0 2023-10-03T19:17:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.134+0000 7f20850e3640 1 -- 172.21.15.45:0/2639446782 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20780a5c70 con 0x7f20800712c0 2023-10-03T19:17:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.134+0000 7f2088349640 1 -- 172.21.15.45:0/2639446782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20800712c0 msgr2=0x7f208006cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.134+0000 7f2088349640 1 --2- 172.21.15.45:0/2639446782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20800712c0 0x7f208006cc30 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f2078009e50 tx=0x7f207801c8c0 comp rx=0 tx=0).stop 2023-10-03T19:17:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.134+0000 7f2088349640 1 -- 172.21.15.45:0/2639446782 shutdown_connections 2023-10-03T19:17:42.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.134+0000 7f2088349640 1 --2- 172.21.15.45:0/2639446782 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f208006c3f0 0x7f20800a5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:42.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.134+0000 7f2088349640 1 --2- 172.21.15.45:0/2639446782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20800712c0 0x7f208006cc30 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:42.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.134+0000 7f2088349640 1 -- 172.21.15.45:0/2639446782 >> 172.21.15.45:0/2639446782 conn(0x7f20800a20d0 msgr2=0x7f20800a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:42.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.134+0000 7f2088349640 1 -- 172.21.15.45:0/2639446782 shutdown_connections 2023-10-03T19:17:42.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.134+0000 7f2088349640 1 -- 172.21.15.45:0/2639446782 wait complete. 2023-10-03T19:17:42.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.138+0000 7f2088349640 1 Processor -- start 2023-10-03T19:17:42.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.138+0000 7f2088349640 1 -- start start 2023-10-03T19:17:42.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.138+0000 7f2088349640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f208006c3f0 0x7f20800bf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:42.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.138+0000 7f2088349640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20800712c0 0x7f20801e66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.138+0000 7f2088349640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f208014c3d0 0x7f20801e6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.138+0000 7f2088349640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2080146da0 con 0x7f208014c3d0 2023-10-03T19:17:42.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.138+0000 7f2088349640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20801ea450 con 0x7f20800712c0 2023-10-03T19:17:42.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.138+0000 7f2088349640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208014fad0 con 0x7f208006c3f0 2023-10-03T19:17:42.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.138+0000 7f20868e6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f208014c3d0 0x7f20801e6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:42.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.138+0000 7f20868e6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f208014c3d0 0x7f20801e6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35012/0 (socket says 172.21.15.45:35012) 2023-10-03T19:17:42.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.138+0000 7f20868e6640 1 -- 172.21.15.45:0/3464340798 learned_addr learned my addr 172.21.15.45:0/3464340798 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:42.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.138+0000 7f20858e4640 1 --2- 172.21.15.45:0/3464340798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20800712c0 0x7f20801e66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:42.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.138+0000 7f20860e5640 1 --2- 172.21.15.45:0/3464340798 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f208006c3f0 0x7f20800bf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:42.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.138+0000 7f20868e6640 1 -- 172.21.15.45:0/3464340798 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f208006c3f0 msgr2=0x7f20800bf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:42.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.138+0000 7f20868e6640 1 --2- 172.21.15.45:0/3464340798 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f208006c3f0 0x7f20800bf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:42.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.138+0000 7f20868e6640 1 -- 172.21.15.45:0/3464340798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20800712c0 msgr2=0x7f20801e66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:42.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.138+0000 7f20868e6640 1 --2- 172.21.15.45:0/3464340798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20800712c0 0x7f20801e66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:42.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.138+0000 7f20868e6640 1 -- 172.21.15.45:0/3464340798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2078009b30 con 0x7f208014c3d0 2023-10-03T19:17:42.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.138+0000 7f20868e6640 1 --2- 172.21.15.45:0/3464340798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f208014c3d0 0x7f20801e6c30 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f207c00c340 tx=0x7f207c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:42.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.138+0000 7f2076ffd640 1 -- 172.21.15.45:0/3464340798 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207c005220 con 0x7f208014c3d0 2023-10-03T19:17:42.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.138+0000 7f2076ffd640 1 -- 172.21.15.45:0/3464340798 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207c005380 con 0x7f208014c3d0 2023-10-03T19:17:42.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.138+0000 7f2076ffd640 1 -- 172.21.15.45:0/3464340798 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207c007270 con 0x7f208014c3d0 2023-10-03T19:17:42.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.138+0000 7f2088349640 1 -- 172.21.15.45:0/3464340798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2080071690 con 0x7f208014c3d0 2023-10-03T19:17:42.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.138+0000 7f2088349640 1 -- 172.21.15.45:0/3464340798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20800a56c0 con 0x7f208014c3d0 2023-10-03T19:17:42.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.138+0000 7f2088349640 1 -- 172.21.15.45:0/3464340798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2080071820 con 0x7f208014c3d0 2023-10-03T19:17:42.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.142+0000 7f2076ffd640 1 -- 172.21.15.45:0/3464340798 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f207c0073d0 con 0x7f208014c3d0 2023-10-03T19:17:42.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.142+0000 7f2076ffd640 1 --2- 172.21.15.45:0/3464340798 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2064066300 0x7f20640687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:42.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.142+0000 7f2076ffd640 1 -- 172.21.15.45:0/3464340798 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f207c082e00 con 0x7f208014c3d0 2023-10-03T19:17:42.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.142+0000 7f20860e5640 1 --2- 172.21.15.45:0/3464340798 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2064066300 0x7f20640687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:42.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.142+0000 7f20860e5640 1 --2- 172.21.15.45:0/3464340798 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2064066300 0x7f20640687b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f20780ae000 tx=0x7f20780a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:42.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.146+0000 7f2076ffd640 1 -- 172.21.15.45:0/3464340798 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f207c0503f0 con 0x7f208014c3d0 2023-10-03T19:17:42.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.354+0000 7f2088349640 1 -- 172.21.15.45:0/3464340798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f20800a6260 con 0x7f208014c3d0 2023-10-03T19:17:42.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.362+0000 7f2076ffd640 1 -- 172.21.15.45:0/3464340798 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f20800a6260 con 0x7f208014c3d0 2023-10-03T19:17:42.363 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-10-03T19:17:42.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.362+0000 7f2088349640 1 -- 172.21.15.45:0/3464340798 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2064066300 msgr2=0x7f20640687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:42.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.362+0000 7f2088349640 1 --2- 172.21.15.45:0/3464340798 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2064066300 0x7f20640687b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f20780ae000 tx=0x7f20780a7070 comp rx=0 tx=0).stop 2023-10-03T19:17:42.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.362+0000 7f2088349640 1 -- 172.21.15.45:0/3464340798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f208014c3d0 msgr2=0x7f20801e6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:42.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.362+0000 7f2088349640 1 --2- 172.21.15.45:0/3464340798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f208014c3d0 0x7f20801e6c30 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f207c00c340 tx=0x7f207c00c800 comp rx=0 tx=0).stop 2023-10-03T19:17:42.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.362+0000 7f2088349640 1 -- 172.21.15.45:0/3464340798 shutdown_connections 2023-10-03T19:17:42.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.362+0000 7f2088349640 1 --2- 172.21.15.45:0/3464340798 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2064066300 0x7f20640687b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:42.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.362+0000 7f2088349640 1 --2- 172.21.15.45:0/3464340798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f208014c3d0 0x7f20801e6c30 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:42.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.362+0000 7f2088349640 1 --2- 172.21.15.45:0/3464340798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20800712c0 0x7f20801e66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:42.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.362+0000 7f2088349640 1 --2- 172.21.15.45:0/3464340798 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f208006c3f0 0x7f20800bf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:42.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.362+0000 7f2088349640 1 -- 172.21.15.45:0/3464340798 >> 172.21.15.45:0/3464340798 conn(0x7f20800a20d0 msgr2=0x7f208014cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:42.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.362+0000 7f2088349640 1 -- 172.21.15.45:0/3464340798 shutdown_connections 2023-10-03T19:17:42.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.362+0000 7f2088349640 1 -- 172.21.15.45:0/3464340798 wait complete. 2023-10-03T19:17:42.383 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:17:42.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.502+0000 7fcfb3dd6640 1 Processor -- start 2023-10-03T19:17:42.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.502+0000 7fcfb3dd6640 1 -- start start 2023-10-03T19:17:42.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.506+0000 7fcfb3dd6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcfac148b90 0x7fcfac0bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:42.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.506+0000 7fcfb3dd6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcfac0bcb60 0x7fcfac06c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:42.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.506+0000 7fcfb3dd6640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfac14b610 con 0x7fcfac0bc4a0 2023-10-03T19:17:42.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.506+0000 7fcfb3dd6640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfac0a3670 con 0x7fcfac148b90 2023-10-03T19:17:42.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.506+0000 7fcfb3dd6640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfac14b370 con 0x7fcfac0bcb60 2023-10-03T19:17:42.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.506+0000 7fcfb1b72640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcfac148b90 0x7fcfac0bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:42.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.506+0000 7fcfb1b72640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcfac148b90 0x7fcfac0bbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35024/0 (socket says 172.21.15.45:35024) 2023-10-03T19:17:42.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.506+0000 7fcfb1b72640 1 -- 172.21.15.45:0/2942924378 learned_addr learned my addr 172.21.15.45:0/2942924378 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:42.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.506+0000 7fcfb1371640 1 --2- 172.21.15.45:0/2942924378 >> v2:172.21.15.79:3300/0 conn(0x7fcfac0bcb60 0x7fcfac06c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:42.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.506+0000 7fcfb1b72640 1 -- 172.21.15.45:0/2942924378 >> v2:172.21.15.79:3300/0 conn(0x7fcfac0bcb60 msgr2=0x7fcfac06c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:42.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.506+0000 7fcfb1b72640 1 --2- 172.21.15.45:0/2942924378 >> v2:172.21.15.79:3300/0 conn(0x7fcfac0bcb60 0x7fcfac06c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:42.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.506+0000 7fcfb1b72640 1 -- 172.21.15.45:0/2942924378 >> v1:172.21.15.79:6789/0 conn(0x7fcfac0bc4a0 legacy=0x7fcfac06c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:42.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.506+0000 7fcfb1b72640 1 -- 172.21.15.45:0/2942924378 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfac0a5580 con 0x7fcfac148b90 2023-10-03T19:17:42.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.506+0000 7fcfb1b72640 1 --2- 172.21.15.45:0/2942924378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfac148b90 0x7fcfac0bbf60 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fcfac06b210 tx=0x7fcfa801ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca1e8c6e0eef3cc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:42.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.506+0000 7fcfb0b70640 1 -- 172.21.15.45:0/2942924378 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa80a89b0 con 0x7fcfac148b90 2023-10-03T19:17:42.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.506+0000 7fcfb0b70640 1 -- 172.21.15.45:0/2942924378 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa80a8b10 con 0x7fcfac148b90 2023-10-03T19:17:42.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.506+0000 7fcfb0b70640 1 -- 172.21.15.45:0/2942924378 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa80a8ea0 con 0x7fcfac148b90 2023-10-03T19:17:42.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.506+0000 7fcfb3dd6640 1 -- 172.21.15.45:0/2942924378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfac148b90 msgr2=0x7fcfac0bbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:42.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.506+0000 7fcfb3dd6640 1 --2- 172.21.15.45:0/2942924378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfac148b90 0x7fcfac0bbf60 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fcfac06b210 tx=0x7fcfa801ecb0 comp rx=0 tx=0).stop 2023-10-03T19:17:42.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.506+0000 7fcfb3dd6640 1 -- 172.21.15.45:0/2942924378 shutdown_connections 2023-10-03T19:17:42.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.506+0000 7fcfb3dd6640 1 --2- 172.21.15.45:0/2942924378 >> v2:172.21.15.79:3300/0 conn(0x7fcfac0bcb60 0x7fcfac06c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:42.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.506+0000 7fcfb3dd6640 1 --2- 172.21.15.45:0/2942924378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfac148b90 0x7fcfac0bbf60 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:42.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.506+0000 7fcfb3dd6640 1 -- 172.21.15.45:0/2942924378 >> 172.21.15.45:0/2942924378 conn(0x7fcfac0bcf50 msgr2=0x7fcfac0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:42.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.510+0000 7fcfb3dd6640 1 -- 172.21.15.45:0/2942924378 shutdown_connections 2023-10-03T19:17:42.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.510+0000 7fcfb3dd6640 1 -- 172.21.15.45:0/2942924378 wait complete. 2023-10-03T19:17:42.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.510+0000 7fcfb3dd6640 1 Processor -- start 2023-10-03T19:17:42.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.510+0000 7fcfb3dd6640 1 -- start start 2023-10-03T19:17:42.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.510+0000 7fcfb3dd6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfac0bc4a0 0x7fcfac0b73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:42.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.510+0000 7fcfb3dd6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcfac0bcb60 0x7fcfac149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:42.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.510+0000 7fcfb3dd6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfac148b90 0x7fcfac145660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:42.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.510+0000 7fcfb3dd6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac0b7c30 con 0x7fcfac148b90 2023-10-03T19:17:42.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.510+0000 7fcfb3dd6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac0b78e0 con 0x7fcfac0bc4a0 2023-10-03T19:17:42.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.510+0000 7fcfb3dd6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac1e0eb0 con 0x7fcfac0bcb60 2023-10-03T19:17:42.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.510+0000 7fcfb2373640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfac148b90 0x7fcfac145660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:42.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.510+0000 7fcfb2373640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfac148b90 0x7fcfac145660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35036/0 (socket says 172.21.15.45:35036) 2023-10-03T19:17:42.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.510+0000 7fcfb2373640 1 -- 172.21.15.45:0/1218679344 learned_addr learned my addr 172.21.15.45:0/1218679344 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:42.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.510+0000 7fcfb1b72640 1 --2- 172.21.15.45:0/1218679344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfac0bc4a0 0x7fcfac0b73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:42.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.510+0000 7fcfb1371640 1 --2- 172.21.15.45:0/1218679344 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcfac0bcb60 0x7fcfac149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:42.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.510+0000 7fcfb2373640 1 -- 172.21.15.45:0/1218679344 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcfac0bcb60 msgr2=0x7fcfac149e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:42.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.510+0000 7fcfb2373640 1 --2- 172.21.15.45:0/1218679344 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcfac0bcb60 0x7fcfac149e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:42.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.510+0000 7fcfb2373640 1 -- 172.21.15.45:0/1218679344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfac0bc4a0 msgr2=0x7fcfac0b73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:42.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.510+0000 7fcfb2373640 1 --2- 172.21.15.45:0/1218679344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfac0bc4a0 0x7fcfac0b73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:42.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.510+0000 7fcfb2373640 1 -- 172.21.15.45:0/1218679344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa80094d0 con 0x7fcfac148b90 2023-10-03T19:17:42.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.510+0000 7fcfb1371640 1 --2- 172.21.15.45:0/1218679344 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcfac0bcb60 0x7fcfac149e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:42.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.510+0000 7fcfb2373640 1 --2- 172.21.15.45:0/1218679344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfac148b90 0x7fcfac145660 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400e9f0 tx=0x7fcfa400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:42.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.510+0000 7fcfa27fc640 1 -- 172.21.15.45:0/1218679344 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4005230 con 0x7fcfac148b90 2023-10-03T19:17:42.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.510+0000 7fcfa27fc640 1 -- 172.21.15.45:0/1218679344 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa4005390 con 0x7fcfac148b90 2023-10-03T19:17:42.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.510+0000 7fcfa27fc640 1 -- 172.21.15.45:0/1218679344 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4005780 con 0x7fcfac148b90 2023-10-03T19:17:42.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.510+0000 7fcfb3dd6640 1 -- 172.21.15.45:0/1218679344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfac06cee0 con 0x7fcfac148b90 2023-10-03T19:17:42.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.510+0000 7fcfb3dd6640 1 -- 172.21.15.45:0/1218679344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfac0a5820 con 0x7fcfac148b90 2023-10-03T19:17:42.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.514+0000 7fcfb3dd6640 1 -- 172.21.15.45:0/1218679344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfac148f60 con 0x7fcfac148b90 2023-10-03T19:17:42.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.514+0000 7fcfa27fc640 1 -- 172.21.15.45:0/1218679344 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcfa4004500 con 0x7fcfac148b90 2023-10-03T19:17:42.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.514+0000 7fcfa27fc640 1 --2- 172.21.15.45:0/1218679344 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcf90066280 0x7fcf90068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:42.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.514+0000 7fcfa27fc640 1 -- 172.21.15.45:0/1218679344 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcfa4086310 con 0x7fcfac148b90 2023-10-03T19:17:42.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.514+0000 7fcfb1b72640 1 --2- 172.21.15.45:0/1218679344 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcf90066280 0x7fcf90068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:42.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.514+0000 7fcfb1b72640 1 --2- 172.21.15.45:0/1218679344 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcf90066280 0x7fcf90068730 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fcfa80b2000 tx=0x7fcfa8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:42.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.518+0000 7fcfa27fc640 1 -- 172.21.15.45:0/1218679344 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fcfa4053790 con 0x7fcfac148b90 2023-10-03T19:17:42.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.706+0000 7fcfb3dd6640 1 -- 172.21.15.45:0/1218679344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcfac0b5590 con 0x7fcfac148b90 2023-10-03T19:17:42.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.706+0000 7fcfa27fc640 1 -- 172.21.15.45:0/1218679344 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+3913 (secure 0 0 0) 0x7fcfa4056db0 con 0x7fcfac148b90 2023-10-03T19:17:42.712 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:17:42.712 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/250992108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":250992108},{"type":"v1","addr":"172.21.15.79:6835","nonce":250992108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6339,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3153040546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3153040546},{"type":"v1","addr":"172.21.15.45:6834","nonce":3153040546}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:17:35.497011+0000","modified":"2023-10-03T19:17:38.516672+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6342},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6342":{"gid":6342,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/2939002026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2939002026},{"type":"v1","addr":"172.21.15.45:6835","nonce":2939002026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-10-03T19:17:42.713 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 36 2023-10-03T19:17:42.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.706+0000 7fcfb3dd6640 1 -- 172.21.15.45:0/1218679344 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcf90066280 msgr2=0x7fcf90068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:42.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.706+0000 7fcfb3dd6640 1 --2- 172.21.15.45:0/1218679344 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcf90066280 0x7fcf90068730 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fcfa80b2000 tx=0x7fcfa8009040 comp rx=0 tx=0).stop 2023-10-03T19:17:42.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.706+0000 7fcfb3dd6640 1 -- 172.21.15.45:0/1218679344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfac148b90 msgr2=0x7fcfac145660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:42.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.706+0000 7fcfb3dd6640 1 --2- 172.21.15.45:0/1218679344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfac148b90 0x7fcfac145660 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400e9f0 tx=0x7fcfa400eeb0 comp rx=0 tx=0).stop 2023-10-03T19:17:42.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.706+0000 7fcfb3dd6640 1 -- 172.21.15.45:0/1218679344 shutdown_connections 2023-10-03T19:17:42.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.706+0000 7fcfb3dd6640 1 --2- 172.21.15.45:0/1218679344 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcf90066280 0x7fcf90068730 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:42.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.706+0000 7fcfb3dd6640 1 --2- 172.21.15.45:0/1218679344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfac148b90 0x7fcfac145660 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:42.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.706+0000 7fcfb3dd6640 1 --2- 172.21.15.45:0/1218679344 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcfac0bcb60 0x7fcfac149e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:42.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.706+0000 7fcfb3dd6640 1 --2- 172.21.15.45:0/1218679344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfac0bc4a0 0x7fcfac0b73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:42.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.706+0000 7fcfb3dd6640 1 -- 172.21.15.45:0/1218679344 >> 172.21.15.45:0/1218679344 conn(0x7fcfac0bcf50 msgr2=0x7fcfac071920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:42.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.706+0000 7fcfb3dd6640 1 -- 172.21.15.45:0/1218679344 shutdown_connections 2023-10-03T19:17:42.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:42.706+0000 7fcfb3dd6640 1 -- 172.21.15.45:0/1218679344 wait complete. 2023-10-03T19:17:43.028 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-03T19:17:35.497011+0000', 'modified': '2023-10-03T19:17:38.516672+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6342}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6342': {'gid': 6342, 'name': 'a', 'rank': 0, 'incarnation': 33, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6835/2939002026', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6833', 'nonce': 2939002026}, {'type': 'v1', 'addr': '172.21.15.45:6835', 'nonce': 2939002026}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-03T19:17:43.097 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-03T19:17:43.097 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-03T19:17:43.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.230+0000 7ff6cacd0640 1 Processor -- start 2023-10-03T19:17:43.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.230+0000 7ff6cacd0640 1 -- start start 2023-10-03T19:17:43.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.230+0000 7ff6cacd0640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff6c40bcb80 0x7ff6c40bc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:43.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.230+0000 7ff6cacd0640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c414f860 con 0x7ff6c4071380 2023-10-03T19:17:43.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.230+0000 7ff6cacd0640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c40bd220 con 0x7ff6c4071750 2023-10-03T19:17:43.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.230+0000 7ff6cacd0640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c4071cf0 con 0x7ff6c40bcb80 2023-10-03T19:17:43.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.230+0000 7ff6c8a6c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff6c4071380 0x7ff6c4152850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35116/0 (socket says 172.21.15.45:35116) 2023-10-03T19:17:43.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.230+0000 7ff6c8a6c640 1 -- 172.21.15.45:0/2280219527 learned_addr learned my addr 172.21.15.45:0/2280219527 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:43.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6c3fff640 1 --2- 172.21.15.45:0/2280219527 >> v2:172.21.15.79:3300/0 conn(0x7ff6c40bcb80 0x7ff6c40bc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:43.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6c37fe640 1 -- 172.21.15.45:0/2280219527 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1139272846 0 0) 0x7ff6c414f860 con 0x7ff6c4071380 2023-10-03T19:17:43.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6c37fe640 1 -- 172.21.15.45:0/2280219527 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6b4003530 con 0x7ff6c4071380 2023-10-03T19:17:43.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6c37fe640 1 -- 172.21.15.45:0/2280219527 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2300624380 0 0) 0x7ff6b4003530 con 0x7ff6c4071380 2023-10-03T19:17:43.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6c37fe640 1 -- 172.21.15.45:0/2280219527 >> v2:172.21.15.79:3300/0 conn(0x7ff6c40bcb80 msgr2=0x7ff6c40bc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:43.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6c37fe640 1 --2- 172.21.15.45:0/2280219527 >> v2:172.21.15.79:3300/0 conn(0x7ff6c40bcb80 0x7ff6c40bc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6c37fe640 1 -- 172.21.15.45:0/2280219527 >> v1:172.21.15.79:6789/0 conn(0x7ff6c4071750 legacy=0x7ff6c414b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:43.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6c37fe640 1 -- 172.21.15.45:0/2280219527 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c40a7b50 con 0x7ff6c4071380 2023-10-03T19:17:43.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6c37fe640 1 -- 172.21.15.45:0/2280219527 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7ff6b8001680 con 0x7ff6c4071380 2023-10-03T19:17:43.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6c37fe640 1 -- 172.21.15.45:0/2280219527 >> v1:172.21.15.45:6789/0 conn(0x7ff6c4071380 legacy=0x7ff6c4152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:43.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6c37fe640 1 --2- 172.21.15.45:0/2280219527 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6b4003980 0x7ff6b4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:43.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6c37fe640 1 --2- 172.21.15.45:0/2280219527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6b40047d0 0x7ff6b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:43.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6c37fe640 1 --2- 172.21.15.45:0/2280219527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6b4005180 0x7ff6b400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:43.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6c37fe640 1 -- 172.21.15.45:0/2280219527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c4071cf0 con 0x7ff6b40047d0 2023-10-03T19:17:43.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6c37fe640 1 -- 172.21.15.45:0/2280219527 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b400c000 con 0x7ff6b4005180 2023-10-03T19:17:43.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6c37fe640 1 -- 172.21.15.45:0/2280219527 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b400c1c0 con 0x7ff6b4003980 2023-10-03T19:17:43.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6c3fff640 1 --2- 172.21.15.45:0/2280219527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6b40047d0 0x7ff6b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:43.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6c8a6c640 1 --2- 172.21.15.45:0/2280219527 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6b4003980 0x7ff6b4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:43.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6c3fff640 1 -- 172.21.15.45:0/2280219527 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6b4003980 msgr2=0x7ff6b4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:43.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6c3fff640 1 --2- 172.21.15.45:0/2280219527 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6b4003980 0x7ff6b4003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6c3fff640 1 -- 172.21.15.45:0/2280219527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6b4005180 msgr2=0x7ff6b400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:43.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6c3fff640 1 --2- 172.21.15.45:0/2280219527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6b4005180 0x7ff6b400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6c3fff640 1 -- 172.21.15.45:0/2280219527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b4003530 con 0x7ff6b40047d0 2023-10-03T19:17:43.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6c926d640 1 -- 172.21.15.45:0/2280219527 reap_dead start 2023-10-03T19:17:43.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6c3fff640 1 --2- 172.21.15.45:0/2280219527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6b40047d0 0x7ff6b4004c40 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0009ab0 tx=0x7ff6b001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ec24e2a125acf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:43.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6c37fe640 1 -- 172.21.15.45:0/2280219527 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b00a5580 con 0x7ff6b40047d0 2023-10-03T19:17:43.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6c37fe640 1 -- 172.21.15.45:0/2280219527 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b00a56e0 con 0x7ff6b40047d0 2023-10-03T19:17:43.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6c37fe640 1 -- 172.21.15.45:0/2280219527 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b00a5a90 con 0x7ff6b40047d0 2023-10-03T19:17:43.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6cacd0640 1 -- 172.21.15.45:0/2280219527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6b40047d0 msgr2=0x7ff6b4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:43.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6cacd0640 1 --2- 172.21.15.45:0/2280219527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6b40047d0 0x7ff6b4004c40 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0009ab0 tx=0x7ff6b001ca70 comp rx=0 tx=0).stop 2023-10-03T19:17:43.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6cacd0640 1 -- 172.21.15.45:0/2280219527 shutdown_connections 2023-10-03T19:17:43.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6cacd0640 1 --2- 172.21.15.45:0/2280219527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6b40047d0 0x7ff6b4004c40 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.234+0000 7ff6cacd0640 1 -- 172.21.15.45:0/2280219527 >> 172.21.15.45:0/2280219527 conn(0x7ff6c406bce0 msgr2=0x7ff6c406c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:43.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.238+0000 7ff6cacd0640 1 -- 172.21.15.45:0/2280219527 shutdown_connections 2023-10-03T19:17:43.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.238+0000 7ff6cacd0640 1 -- 172.21.15.45:0/2280219527 wait complete. 2023-10-03T19:17:43.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.238+0000 7ff6cacd0640 1 Processor -- start 2023-10-03T19:17:43.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.238+0000 7ff6cacd0640 1 -- start start 2023-10-03T19:17:43.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.238+0000 7ff6cacd0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6b40047d0 0x7ff6c40a66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:43.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.238+0000 7ff6cacd0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6c41e3960 0x7ff6c41512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:43.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.238+0000 7ff6cacd0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c40a6c20 0x7ff6c41e3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:43.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.238+0000 7ff6cacd0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c40a7370 con 0x7ff6c40a6c20 2023-10-03T19:17:43.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.238+0000 7ff6cacd0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c414f860 con 0x7ff6b40047d0 2023-10-03T19:17:43.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.238+0000 7ff6cacd0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c40a4c60 con 0x7ff6c41e3960 2023-10-03T19:17:43.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.238+0000 7ff6c926d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c40a6c20 0x7ff6c41e3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:43.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.238+0000 7ff6c926d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c40a6c20 0x7ff6c41e3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35042/0 (socket says 172.21.15.45:35042) 2023-10-03T19:17:43.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.238+0000 7ff6c926d640 1 -- 172.21.15.45:0/2233729681 learned_addr learned my addr 172.21.15.45:0/2233729681 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:43.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.238+0000 7ff6c8a6c640 1 --2- 172.21.15.45:0/2233729681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6b40047d0 0x7ff6c40a66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:43.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.238+0000 7ff6c3fff640 1 --2- 172.21.15.45:0/2233729681 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6c41e3960 0x7ff6c41512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:43.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.238+0000 7ff6c926d640 1 -- 172.21.15.45:0/2233729681 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6c41e3960 msgr2=0x7ff6c41512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:43.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.238+0000 7ff6c926d640 1 --2- 172.21.15.45:0/2233729681 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6c41e3960 0x7ff6c41512f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.238+0000 7ff6c926d640 1 -- 172.21.15.45:0/2233729681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6b40047d0 msgr2=0x7ff6c40a66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:43.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.238+0000 7ff6c926d640 1 --2- 172.21.15.45:0/2233729681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6b40047d0 0x7ff6c40a66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.238+0000 7ff6c926d640 1 -- 172.21.15.45:0/2233729681 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c40a1bf0 con 0x7ff6c40a6c20 2023-10-03T19:17:43.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.238+0000 7ff6c926d640 1 --2- 172.21.15.45:0/2233729681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c40a6c20 0x7ff6c41e3f60 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7ff6c40be4c0 tx=0x7ff6bc00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:43.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.238+0000 7ff6c17fa640 1 -- 172.21.15.45:0/2233729681 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc00cad0 con 0x7ff6c40a6c20 2023-10-03T19:17:43.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.238+0000 7ff6c17fa640 1 -- 172.21.15.45:0/2233729681 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6bc00cc50 con 0x7ff6c40a6c20 2023-10-03T19:17:43.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.238+0000 7ff6c17fa640 1 -- 172.21.15.45:0/2233729681 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc007070 con 0x7ff6c40a6c20 2023-10-03T19:17:43.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.238+0000 7ff6cacd0640 1 -- 172.21.15.45:0/2233729681 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c406b810 con 0x7ff6c40a6c20 2023-10-03T19:17:43.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.238+0000 7ff6cacd0640 1 -- 172.21.15.45:0/2233729681 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c40a1d80 con 0x7ff6c40a6c20 2023-10-03T19:17:43.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.242+0000 7ff6c17fa640 1 -- 172.21.15.45:0/2233729681 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff6bc0071d0 con 0x7ff6c40a6c20 2023-10-03T19:17:43.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.242+0000 7ff6c17fa640 1 --2- 172.21.15.45:0/2233729681 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff6a8066280 0x7ff6a8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:43.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.242+0000 7ff6c17fa640 1 -- 172.21.15.45:0/2233729681 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff6bc082340 con 0x7ff6c40a6c20 2023-10-03T19:17:43.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.242+0000 7ff6c8a6c640 1 --2- 172.21.15.45:0/2233729681 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff6a8066280 0x7ff6a8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:43.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.242+0000 7ff6cddf4000 1 Processor -- start 2023-10-03T19:17:43.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.242+0000 7ff6cddf4000 1 -- start start 2023-10-03T19:17:43.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.242+0000 7ff6c8a6c640 1 --2- 172.21.15.45:0/2233729681 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff6a8066280 0x7ff6a8068730 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff6b80017b0 tx=0x7ff6b8001600 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:43.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.242+0000 7ff6cddf4000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4d43aa6f0 0x55f4d43a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:43.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.242+0000 7ff6cddf4000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f4d43a2020 0x55f4d43a23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:43.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.242+0000 7ff6cddf4000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55f4d43a2930 0x55f4d43a2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:43.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.242+0000 7ff6cddf4000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4d426c310 con 0x55f4d43a2020 2023-10-03T19:17:43.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.242+0000 7ff6cddf4000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4d41a6980 con 0x55f4d43aa6f0 2023-10-03T19:17:43.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.242+0000 7ff6cddf4000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f4d41fa040 con 0x55f4d43a2930 2023-10-03T19:17:43.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.242+0000 7ff6c3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f4d43a2020 0x55f4d43a23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:43.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.242+0000 7ff6c3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f4d43a2020 0x55f4d43a23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35056/0 (socket says 172.21.15.45:35056) 2023-10-03T19:17:43.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.242+0000 7ff6c3fff640 1 -- 172.21.15.45:0/427618208 learned_addr learned my addr 172.21.15.45:0/427618208 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:43.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.242+0000 7ff6c926d640 1 --2- 172.21.15.45:0/427618208 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55f4d43a2930 0x55f4d43a2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:43.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.242+0000 7ff6c8a6c640 1 --2- 172.21.15.45:0/427618208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4d43aa6f0 0x55f4d43a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:43.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.242+0000 7ff6c3fff640 1 -- 172.21.15.45:0/427618208 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55f4d43a2930 msgr2=0x55f4d43a2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:43.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.242+0000 7ff6c3fff640 1 --2- 172.21.15.45:0/427618208 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55f4d43a2930 0x55f4d43a2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.242+0000 7ff6c3fff640 1 -- 172.21.15.45:0/427618208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4d43aa6f0 msgr2=0x55f4d43a1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:43.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.242+0000 7ff6c3fff640 1 --2- 172.21.15.45:0/427618208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4d43aa6f0 0x55f4d43a1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.242+0000 7ff6c3fff640 1 -- 172.21.15.45:0/427618208 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4d41b80b0 con 0x55f4d43a2020 2023-10-03T19:17:43.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.242+0000 7ff6c3fff640 1 --2- 172.21.15.45:0/427618208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f4d43a2020 0x55f4d43a23f0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0009ab0 tx=0x7ff6b00046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9519e6e95adc6d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:43.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.242+0000 7ff6ae7fc640 1 -- 172.21.15.45:0/427618208 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0004220 con 0x55f4d43a2020 2023-10-03T19:17:43.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.242+0000 7ff6ae7fc640 1 -- 172.21.15.45:0/427618208 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b0004380 con 0x55f4d43a2020 2023-10-03T19:17:43.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.242+0000 7ff6ae7fc640 1 -- 172.21.15.45:0/427618208 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b00a5a70 con 0x55f4d43a2020 2023-10-03T19:17:43.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.242+0000 7ff6cddf4000 1 -- 172.21.15.45:0/427618208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f4d43a2020 msgr2=0x55f4d43a23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:43.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.242+0000 7ff6cddf4000 1 --2- 172.21.15.45:0/427618208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f4d43a2020 0x55f4d43a23f0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0009ab0 tx=0x7ff6b00046d0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6cddf4000 1 -- 172.21.15.45:0/427618208 shutdown_connections 2023-10-03T19:17:43.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6cddf4000 1 --2- 172.21.15.45:0/427618208 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55f4d43a2930 0x55f4d43a2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6cddf4000 1 --2- 172.21.15.45:0/427618208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f4d43a2020 0x55f4d43a23f0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6cddf4000 1 --2- 172.21.15.45:0/427618208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4d43aa6f0 0x55f4d43a1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6cddf4000 1 -- 172.21.15.45:0/427618208 >> 172.21.15.45:0/427618208 conn(0x55f4d43dc220 msgr2=0x55f4d43de600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:43.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6cddf4000 1 -- 172.21.15.45:0/427618208 shutdown_connections 2023-10-03T19:17:43.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6cddf4000 1 -- 172.21.15.45:0/427618208 wait complete. 2023-10-03T19:17:43.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6cddf4000 1 -- start start 2023-10-03T19:17:43.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6cddf4000 1 Processor -- start 2023-10-03T19:17:43.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6cddf4000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4d43a2020 0x55f4d43db3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:43.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6cddf4000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f4d43a2930 0x55f4d43db8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:43.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6cddf4000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55f4d43aa6f0 0x55f4d43e56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:43.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6cddf4000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4d41f30e0 con 0x55f4d43a2930 2023-10-03T19:17:43.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6cddf4000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4d41afbd0 con 0x55f4d43a2020 2023-10-03T19:17:43.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6cddf4000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f4d41af870 con 0x55f4d43aa6f0 2023-10-03T19:17:43.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6cddf4000 10 client.0 _ll_register_callbacks cb 0x55f4d438fc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T19:17:43.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6c3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f4d43a2930 0x55f4d43db8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:43.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6c3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f4d43a2930 0x55f4d43db8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35064/0 (socket says 172.21.15.45:35064) 2023-10-03T19:17:43.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6c3fff640 1 -- 172.21.15.45:0/2837023668 learned_addr learned my addr 172.21.15.45:0/2837023668 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:43.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6c8a6c640 1 --2- 172.21.15.45:0/2837023668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4d43a2020 0x55f4d43db3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:43.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6c3fff640 1 -- 172.21.15.45:0/2837023668 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55f4d43aa6f0 msgr2=0x55f4d43e56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:43.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6c926d640 1 --2- 172.21.15.45:0/2837023668 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55f4d43aa6f0 0x55f4d43e56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:43.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6c3fff640 1 --2- 172.21.15.45:0/2837023668 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55f4d43aa6f0 0x55f4d43e56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6c3fff640 1 -- 172.21.15.45:0/2837023668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4d43a2020 msgr2=0x55f4d43db3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:43.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6c3fff640 1 --2- 172.21.15.45:0/2837023668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4d43a2020 0x55f4d43db3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6c3fff640 1 -- 172.21.15.45:0/2837023668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b4003530 con 0x55f4d43a2930 2023-10-03T19:17:43.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6c3fff640 1 --2- 172.21.15.45:0/2837023668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f4d43a2930 0x55f4d43db8f0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7ff6b00983a0 tx=0x7ff6b0019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0fca32530867e8d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:43.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-10-03T19:17:43.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6a37fe640 1 -- 172.21.15.45:0/2837023668 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b00a5a50 con 0x55f4d43a2930 2023-10-03T19:17:43.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6a37fe640 1 -- 172.21.15.45:0/2837023668 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff6b00a5bb0 con 0x55f4d43a2930 2023-10-03T19:17:43.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6cddf4000 1 -- 172.21.15.45:0/2837023668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f4d41ee8b0 con 0x55f4d43a2930 2023-10-03T19:17:43.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6a37fe640 1 -- 172.21.15.45:0/2837023668 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6b00044f0 con 0x55f4d43a2930 2023-10-03T19:17:43.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6cddf4000 10 client.6480 fetch_fsmap learned FSMap version 36 2023-10-03T19:17:43.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6cddf4000 1 -- 172.21.15.45:0/2837023668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x55f4d3eef890 con 0x55f4d43a2930 2023-10-03T19:17:43.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6a37fe640 1 -- 172.21.15.45:0/2837023668 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f4d41ee8b0 con 0x55f4d43a2930 2023-10-03T19:17:43.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6a37fe640 1 -- 172.21.15.45:0/2837023668 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 36) v1 ==== 2569+0+0 (secure 0 0 0) 0x7ff6b0003620 con 0x55f4d43a2930 2023-10-03T19:17:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6cddf4000 10 client.6480 fetch_fsmap finished waiting for FSMap version 36 2023-10-03T19:17:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6cddf4000 10 client.6480 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T19:17:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6cddf4000 20 client.6480 populate_metadata read hostname 'smithi045' 2023-10-03T19:17:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6cddf4000 1 --2- 172.21.15.45:0/2837023668 >> [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] conn(0x55f4d43e60e0 0x55f4d43e64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6cddf4000 4 client.6480 mds_command: new command op to 6342 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-03T19:17:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6cddf4000 1 -- 172.21.15.45:0/2837023668 --> [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f4d4221f70 con 0x55f4d43e60e0 2023-10-03T19:17:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6c8a6c640 1 --2- 172.21.15.45:0/2837023668 >> [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] conn(0x55f4d43e60e0 0x55f4d43e64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6c8a6c640 1 --2- 172.21.15.45:0/2837023668 >> [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] conn(0x55f4d43e60e0 0x55f4d43e64b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31afe99de16617f0 server_cookie=a342cbb3df8e710a in_seq=0 out_seq=0 2023-10-03T19:17:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6a37fe640 10 client.6480 ms_handle_connect on v2:172.21.15.45:6833/2939002026 2023-10-03T19:17:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6a37fe640 1 -- 172.21.15.45:0/2837023668 <== mds.0 v2:172.21.15.45:6833/2939002026 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f4d4221f70 con 0x55f4d43e60e0 2023-10-03T19:17:43.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6a37fe640 10 client.6480 handle_command_reply: tid=0 2023-10-03T19:17:43.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.246+0000 7ff6cddf4000 1 client.6480 shutdown 2023-10-03T19:17:43.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.250+0000 7ff6cddf4000 1 -- 172.21.15.45:0/2837023668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f4d43a2930 msgr2=0x55f4d43db8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:43.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.250+0000 7ff6cddf4000 1 --2- 172.21.15.45:0/2837023668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f4d43a2930 0x55f4d43db8f0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7ff6b00983a0 tx=0x7ff6b0019810 comp rx=0 tx=0).stop 2023-10-03T19:17:43.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.250+0000 7ff6cddf4000 1 -- 172.21.15.45:0/2837023668 shutdown_connections 2023-10-03T19:17:43.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.250+0000 7ff6cddf4000 1 --2- 172.21.15.45:0/2837023668 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55f4d43aa6f0 0x55f4d43e56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.250+0000 7ff6cddf4000 1 --2- 172.21.15.45:0/2837023668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f4d43a2930 0x55f4d43db8f0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.250+0000 7ff6cddf4000 1 --2- 172.21.15.45:0/2837023668 >> [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] conn(0x55f4d43e60e0 0x55f4d43e64b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.250+0000 7ff6cddf4000 1 --2- 172.21.15.45:0/2837023668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4d43a2020 0x55f4d43db3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.250+0000 7ff6a37fe640 0 client.6480 ms_handle_reset on v2:172.21.15.45:6833/2939002026 2023-10-03T19:17:43.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.250+0000 7ff6cddf4000 1 -- 172.21.15.45:0/2837023668 >> 172.21.15.45:0/2837023668 conn(0x55f4d43dc220 msgr2=0x55f4d43de600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:43.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.250+0000 7ff6cddf4000 1 -- 172.21.15.45:0/2837023668 shutdown_connections 2023-10-03T19:17:43.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.250+0000 7ff6cddf4000 1 -- 172.21.15.45:0/2837023668 wait complete. 2023-10-03T19:17:43.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.250+0000 7ff6cddf4000 20 client.6480 trim_cache size 0 max 16384 2023-10-03T19:17:43.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.262+0000 7ff6cddf4000 1 Processor -- start 2023-10-03T19:17:43.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.262+0000 7ff6cddf4000 1 -- start start 2023-10-03T19:17:43.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6cddf4000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f4d43a2020 0x55f4d43a1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:43.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6cddf4000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55f4d43a2930 0x55f4d43a1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:43.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6cddf4000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4d43aa6f0 0x55f4d43ea710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:43.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6cddf4000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4d3eb0940 con 0x55f4d43a2020 2023-10-03T19:17:43.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6cddf4000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4d41ad2f0 con 0x55f4d43aa6f0 2023-10-03T19:17:43.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6cddf4000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f4d41c2cd0 con 0x55f4d43a2930 2023-10-03T19:17:43.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6c8a6c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f4d43a2020 0x55f4d43a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:43.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6c8a6c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f4d43a2020 0x55f4d43a1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35068/0 (socket says 172.21.15.45:35068) 2023-10-03T19:17:43.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6c8a6c640 1 -- 172.21.15.45:0/3102765396 learned_addr learned my addr 172.21.15.45:0/3102765396 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:43.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6c926d640 1 --2- 172.21.15.45:0/3102765396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4d43aa6f0 0x55f4d43ea710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:43.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6c8a6c640 1 -- 172.21.15.45:0/3102765396 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55f4d43a2930 msgr2=0x55f4d43a1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:43.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6c8a6c640 1 --2- 172.21.15.45:0/3102765396 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55f4d43a2930 0x55f4d43a1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6c8a6c640 1 -- 172.21.15.45:0/3102765396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4d43aa6f0 msgr2=0x55f4d43ea710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:43.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6c8a6c640 1 --2- 172.21.15.45:0/3102765396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4d43aa6f0 0x55f4d43ea710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6c8a6c640 1 -- 172.21.15.45:0/3102765396 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4d41b8360 con 0x55f4d43a2020 2023-10-03T19:17:43.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6c926d640 1 --2- 172.21.15.45:0/3102765396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4d43aa6f0 0x55f4d43ea710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:43.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6c8a6c640 1 --2- 172.21.15.45:0/3102765396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f4d43a2020 0x55f4d43a1250 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8000f70 tx=0x7ff6b8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb0e7e7cfd34e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:43.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6aeffd640 1 -- 172.21.15.45:0/3102765396 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8029230 con 0x55f4d43a2020 2023-10-03T19:17:43.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6aeffd640 1 -- 172.21.15.45:0/3102765396 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b8029390 con 0x55f4d43a2020 2023-10-03T19:17:43.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6aeffd640 1 -- 172.21.15.45:0/3102765396 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8016570 con 0x55f4d43a2020 2023-10-03T19:17:43.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6cddf4000 1 -- 172.21.15.45:0/3102765396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f4d43a2020 msgr2=0x55f4d43a1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:43.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6cddf4000 1 --2- 172.21.15.45:0/3102765396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f4d43a2020 0x55f4d43a1250 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8000f70 tx=0x7ff6b8015000 comp rx=0 tx=0).stop 2023-10-03T19:17:43.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6cddf4000 1 -- 172.21.15.45:0/3102765396 shutdown_connections 2023-10-03T19:17:43.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6cddf4000 1 --2- 172.21.15.45:0/3102765396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4d43aa6f0 0x55f4d43ea710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6cddf4000 1 --2- 172.21.15.45:0/3102765396 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55f4d43a2930 0x55f4d43a1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6cddf4000 1 --2- 172.21.15.45:0/3102765396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f4d43a2020 0x55f4d43a1250 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6cddf4000 1 -- 172.21.15.45:0/3102765396 >> 172.21.15.45:0/3102765396 conn(0x55f4d43dc220 msgr2=0x55f4d43ee200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:43.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6cddf4000 1 -- 172.21.15.45:0/3102765396 shutdown_connections 2023-10-03T19:17:43.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6cddf4000 1 -- 172.21.15.45:0/3102765396 wait complete. 2023-10-03T19:17:43.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6cddf4000 1 -- start start 2023-10-03T19:17:43.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6cddf4000 1 Processor -- start 2023-10-03T19:17:43.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6cddf4000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4d43a2020 0x55f4d443c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:43.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6cddf4000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f4d43a2930 0x55f4d443d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:43.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6cddf4000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55f4d43aa6f0 0x55f4d443d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:43.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6cddf4000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4d43ecd70 con 0x55f4d43a2930 2023-10-03T19:17:43.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6cddf4000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4d43e57e0 con 0x55f4d43a2020 2023-10-03T19:17:43.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6cddf4000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f4d43e5240 con 0x55f4d43aa6f0 2023-10-03T19:17:43.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6cddf4000 10 client.0 _ll_register_callbacks cb 0x55f4d41f5260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T19:17:43.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6c3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f4d43a2930 0x55f4d443d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:43.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6c3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f4d43a2930 0x55f4d443d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35082/0 (socket says 172.21.15.45:35082) 2023-10-03T19:17:43.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6c3fff640 1 -- 172.21.15.45:0/3019576823 learned_addr learned my addr 172.21.15.45:0/3019576823 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:43.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6c8a6c640 1 --2- 172.21.15.45:0/3019576823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4d43a2020 0x55f4d443c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:43.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6c926d640 1 --2- 172.21.15.45:0/3019576823 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55f4d43aa6f0 0x55f4d443d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:43.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6c3fff640 1 -- 172.21.15.45:0/3019576823 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55f4d43aa6f0 msgr2=0x55f4d443d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:43.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6c3fff640 1 --2- 172.21.15.45:0/3019576823 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55f4d43aa6f0 0x55f4d443d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6c3fff640 1 -- 172.21.15.45:0/3019576823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4d43a2020 msgr2=0x55f4d443c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:43.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6c3fff640 1 --2- 172.21.15.45:0/3019576823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4d43a2020 0x55f4d443c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6c3fff640 1 -- 172.21.15.45:0/3019576823 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c40a7b50 con 0x55f4d43a2930 2023-10-03T19:17:43.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6c926d640 1 --2- 172.21.15.45:0/3019576823 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55f4d43aa6f0 0x55f4d443d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:43.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6c3fff640 1 --2- 172.21.15.45:0/3019576823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f4d43a2930 0x55f4d443d460 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0004710 tx=0x7ff6b4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10fb18dd664fe24 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:43.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-10-03T19:17:43.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6a37fe640 1 -- 172.21.15.45:0/3019576823 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b00a5580 con 0x55f4d43a2930 2023-10-03T19:17:43.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6a37fe640 1 -- 172.21.15.45:0/3019576823 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff6b0003b30 con 0x55f4d43a2930 2023-10-03T19:17:43.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6cddf4000 1 -- 172.21.15.45:0/3019576823 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff6b0004380 con 0x55f4d43a2930 2023-10-03T19:17:43.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6a37fe640 1 -- 172.21.15.45:0/3019576823 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6b00044f0 con 0x55f4d43a2930 2023-10-03T19:17:43.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.266+0000 7ff6cddf4000 10 client.6486 fetch_fsmap learned FSMap version 36 2023-10-03T19:17:43.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cddf4000 1 -- 172.21.15.45:0/3019576823 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x55f4d419dbe0 con 0x55f4d43a2930 2023-10-03T19:17:43.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6a37fe640 1 -- 172.21.15.45:0/3019576823 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b0004380 con 0x55f4d43a2930 2023-10-03T19:17:43.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6a37fe640 1 -- 172.21.15.45:0/3019576823 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 36) v1 ==== 2569+0+0 (secure 0 0 0) 0x7ff6b00adbb0 con 0x55f4d43a2930 2023-10-03T19:17:43.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cddf4000 10 client.6486 fetch_fsmap finished waiting for FSMap version 36 2023-10-03T19:17:43.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cddf4000 10 client.6486 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T19:17:43.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cddf4000 20 client.6486 populate_metadata read hostname 'smithi045' 2023-10-03T19:17:43.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cddf4000 1 --2- 172.21.15.45:0/3019576823 >> [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] conn(0x55f4d443ce10 0x55f4d443dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:43.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cddf4000 4 client.6486 mds_command: new command op to 6342 tid=0[{"prefix": "status"}] 2023-10-03T19:17:43.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cddf4000 1 -- 172.21.15.45:0/3019576823 --> [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f4d41ec0c0 con 0x55f4d443ce10 2023-10-03T19:17:43.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6c8a6c640 1 --2- 172.21.15.45:0/3019576823 >> [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] conn(0x55f4d443ce10 0x55f4d443dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:43.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6a37fe640 10 client.6486 ms_handle_connect on v2:172.21.15.45:6833/2939002026 2023-10-03T19:17:43.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6c8a6c640 1 --2- 172.21.15.45:0/3019576823 >> [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] conn(0x55f4d443ce10 0x55f4d443dee0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a9bece17b4a3aa1 server_cookie=f006d74462260fa5 in_seq=0 out_seq=0 2023-10-03T19:17:43.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6a37fe640 1 -- 172.21.15.45:0/3019576823 <== mds.0 v2:172.21.15.45:6833/2939002026 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55f4d41ec0c0 con 0x55f4d443ce10 2023-10-03T19:17:43.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6a37fe640 10 client.6486 handle_command_reply: tid=0 2023-10-03T19:17:43.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cddf4000 1 client.6486 shutdown 2023-10-03T19:17:43.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cddf4000 1 -- 172.21.15.45:0/3019576823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f4d43a2930 msgr2=0x55f4d443d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:43.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cddf4000 1 --2- 172.21.15.45:0/3019576823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f4d43a2930 0x55f4d443d460 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0004710 tx=0x7ff6b4005800 comp rx=0 tx=0).stop 2023-10-03T19:17:43.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cddf4000 1 -- 172.21.15.45:0/3019576823 shutdown_connections 2023-10-03T19:17:43.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cddf4000 1 --2- 172.21.15.45:0/3019576823 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55f4d43aa6f0 0x55f4d443d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cddf4000 1 --2- 172.21.15.45:0/3019576823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f4d43a2930 0x55f4d443d460 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cddf4000 1 --2- 172.21.15.45:0/3019576823 >> [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] conn(0x55f4d443ce10 0x55f4d443dee0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cddf4000 1 --2- 172.21.15.45:0/3019576823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4d43a2020 0x55f4d443c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6a37fe640 0 client.6486 ms_handle_reset on v2:172.21.15.45:6833/2939002026 2023-10-03T19:17:43.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cddf4000 1 -- 172.21.15.45:0/3019576823 >> 172.21.15.45:0/3019576823 conn(0x55f4d43dc220 msgr2=0x55f4d43a0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:43.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cddf4000 1 -- 172.21.15.45:0/3019576823 shutdown_connections 2023-10-03T19:17:43.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cddf4000 1 -- 172.21.15.45:0/3019576823 wait complete. 2023-10-03T19:17:43.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cddf4000 20 client.6486 trim_cache size 0 max 16384 2023-10-03T19:17:43.370 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-03T19:17:43.370 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "58400977-12ba-4c73-bb3e-1589b2492669", 2023-10-03T19:17:43.370 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-10-03T19:17:43.370 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 6342, 2023-10-03T19:17:43.370 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-10-03T19:17:43.370 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-10-03T19:17:43.370 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-10-03T19:17:43.371 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 7.7701540859999998, 2023-10-03T19:17:43.371 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 36, 2023-10-03T19:17:43.371 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 74, 2023-10-03T19:17:43.371 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 74, 2023-10-03T19:17:43.371 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 13.270326211 2023-10-03T19:17:43.371 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-03T19:17:43.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cacd0640 1 -- 172.21.15.45:0/2233729681 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff6a8066280 msgr2=0x7ff6a8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:43.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cacd0640 1 --2- 172.21.15.45:0/2233729681 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff6a8066280 0x7ff6a8068730 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff6b80017b0 tx=0x7ff6b8001600 comp rx=0 tx=0).stop 2023-10-03T19:17:43.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cacd0640 1 -- 172.21.15.45:0/2233729681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c40a6c20 msgr2=0x7ff6c41e3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:43.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cacd0640 1 --2- 172.21.15.45:0/2233729681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c40a6c20 0x7ff6c41e3f60 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7ff6c40be4c0 tx=0x7ff6bc00c7c0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cacd0640 1 -- 172.21.15.45:0/2233729681 shutdown_connections 2023-10-03T19:17:43.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cacd0640 1 --2- 172.21.15.45:0/2233729681 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff6a8066280 0x7ff6a8068730 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cacd0640 1 --2- 172.21.15.45:0/2233729681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c40a6c20 0x7ff6c41e3f60 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cacd0640 1 --2- 172.21.15.45:0/2233729681 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6c41e3960 0x7ff6c41512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cacd0640 1 --2- 172.21.15.45:0/2233729681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6b40047d0 0x7ff6c40a66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cacd0640 1 -- 172.21.15.45:0/2233729681 >> 172.21.15.45:0/2233729681 conn(0x7ff6c406bce0 msgr2=0x7ff6c4067830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:43.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cacd0640 1 -- 172.21.15.45:0/2233729681 shutdown_connections 2023-10-03T19:17:43.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.270+0000 7ff6cacd0640 1 -- 172.21.15.45:0/2233729681 wait complete. 2023-10-03T19:17:43.374 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-03T19:17:43.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.502+0000 7f546dd2a640 1 Processor -- start 2023-10-03T19:17:43.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.502+0000 7f546dd2a640 1 -- start start 2023-10-03T19:17:43.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.502+0000 7f546dd2a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f546806f170 0x7f5468150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:43.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.502+0000 7f546dd2a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f546806d170 0x7f546814d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:43.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.502+0000 7f546dd2a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f546806cac0 con 0x7f54680bc8b0 2023-10-03T19:17:43.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.502+0000 7f546dd2a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54680720d0 con 0x7f546806d170 2023-10-03T19:17:43.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.502+0000 7f546dd2a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54680a5ab0 con 0x7f546806f170 2023-10-03T19:17:43.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.502+0000 7f5467fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f546806d170 0x7f546814d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:43.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.502+0000 7f5466ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f54680bc8b0 0x7f546814ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35132/0 (socket says 172.21.15.45:35132) 2023-10-03T19:17:43.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.502+0000 7f5466ffd640 1 -- 172.21.15.45:0/3747055554 learned_addr learned my addr 172.21.15.45:0/3747055554 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:43.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.502+0000 7f54677fe640 1 --2- 172.21.15.45:0/3747055554 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f546806f170 0x7f5468150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:43.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.502+0000 7f5467fff640 1 -- 172.21.15.45:0/3747055554 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f546806f170 msgr2=0x7f5468150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:43.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.502+0000 7f5467fff640 1 --2- 172.21.15.45:0/3747055554 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f546806f170 0x7f5468150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.502+0000 7f5467fff640 1 -- 172.21.15.45:0/3747055554 >> v1:172.21.15.45:6789/0 conn(0x7f54680bc8b0 legacy=0x7f546814ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:43.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.502+0000 7f5467fff640 1 -- 172.21.15.45:0/3747055554 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546806cd00 con 0x7f546806d170 2023-10-03T19:17:43.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.502+0000 7f54667fc640 1 -- 172.21.15.45:0/3747055554 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3280727080 0 0) 0x7f545c001120 con 0x7f54680bc8b0 2023-10-03T19:17:43.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.502+0000 7f5467fff640 1 --2- 172.21.15.45:0/3747055554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f546806d170 0x7f546814d180 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f5460009d90 tx=0x7f546001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d58ee693db6afd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:43.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f54667fc640 1 -- 172.21.15.45:0/3747055554 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54600a5920 con 0x7f546806d170 2023-10-03T19:17:43.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f54667fc640 1 -- 172.21.15.45:0/3747055554 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54600a5a80 con 0x7f546806d170 2023-10-03T19:17:43.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f54667fc640 1 -- 172.21.15.45:0/3747055554 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54600a5e10 con 0x7f546806d170 2023-10-03T19:17:43.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f546dd2a640 1 -- 172.21.15.45:0/3747055554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f546806d170 msgr2=0x7f546814d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:43.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f546dd2a640 1 --2- 172.21.15.45:0/3747055554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f546806d170 0x7f546814d180 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f5460009d90 tx=0x7f546001c910 comp rx=0 tx=0).stop 2023-10-03T19:17:43.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f546dd2a640 1 -- 172.21.15.45:0/3747055554 shutdown_connections 2023-10-03T19:17:43.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f546dd2a640 1 --2- 172.21.15.45:0/3747055554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f546806d170 0x7f546814d180 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f546dd2a640 1 --2- 172.21.15.45:0/3747055554 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f546806f170 0x7f5468150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f546dd2a640 1 -- 172.21.15.45:0/3747055554 >> 172.21.15.45:0/3747055554 conn(0x7f54680bcf50 msgr2=0x7f54680bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:43.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f546dd2a640 1 -- 172.21.15.45:0/3747055554 shutdown_connections 2023-10-03T19:17:43.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f546dd2a640 1 -- 172.21.15.45:0/3747055554 wait complete. 2023-10-03T19:17:43.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f546dd2a640 1 Processor -- start 2023-10-03T19:17:43.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f546dd2a640 1 -- start start 2023-10-03T19:17:43.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f546dd2a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f546806d170 0x7f54680bffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:43.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f546dd2a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f546806f170 0x7f5468148680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:43.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f546dd2a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f54680bc8b0 0x7f54680b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:43.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f546dd2a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54681e8cd0 con 0x7f546806d170 2023-10-03T19:17:43.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f546dd2a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54680c0c10 con 0x7f546806f170 2023-10-03T19:17:43.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f546dd2a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54681e89c0 con 0x7f54680bc8b0 2023-10-03T19:17:43.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f54677fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f546806d170 0x7f54680bffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:43.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f54677fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f546806d170 0x7f54680bffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35104/0 (socket says 172.21.15.45:35104) 2023-10-03T19:17:43.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f54677fe640 1 -- 172.21.15.45:0/2400921408 learned_addr learned my addr 172.21.15.45:0/2400921408 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:43.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f5467fff640 1 --2- 172.21.15.45:0/2400921408 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f54680bc8b0 0x7f54680b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:43.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f5466ffd640 1 --2- 172.21.15.45:0/2400921408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f546806f170 0x7f5468148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:43.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f54677fe640 1 -- 172.21.15.45:0/2400921408 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f54680bc8b0 msgr2=0x7f54680b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:43.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f54677fe640 1 --2- 172.21.15.45:0/2400921408 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f54680bc8b0 0x7f54680b5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f54677fe640 1 -- 172.21.15.45:0/2400921408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f546806f170 msgr2=0x7f5468148680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:43.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f54677fe640 1 --2- 172.21.15.45:0/2400921408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f546806f170 0x7f5468148680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f54677fe640 1 -- 172.21.15.45:0/2400921408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5460009a70 con 0x7f546806d170 2023-10-03T19:17:43.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f5466ffd640 1 --2- 172.21.15.45:0/2400921408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f546806f170 0x7f5468148680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:43.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f54677fe640 1 --2- 172.21.15.45:0/2400921408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f546806d170 0x7f54680bffc0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f545800d830 tx=0x7f545800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:43.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f544ffff640 1 -- 172.21.15.45:0/2400921408 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545800b6c0 con 0x7f546806d170 2023-10-03T19:17:43.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f544ffff640 1 -- 172.21.15.45:0/2400921408 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545800b820 con 0x7f546806d170 2023-10-03T19:17:43.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f546dd2a640 1 -- 172.21.15.45:0/2400921408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f546806f6d0 con 0x7f546806d170 2023-10-03T19:17:43.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f544ffff640 1 -- 172.21.15.45:0/2400921408 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545800bb90 con 0x7f546806d170 2023-10-03T19:17:43.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.506+0000 7f546dd2a640 1 -- 172.21.15.45:0/2400921408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f546806f540 con 0x7f546806d170 2023-10-03T19:17:43.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.510+0000 7f546dd2a640 1 -- 172.21.15.45:0/2400921408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5468159670 con 0x7f546806d170 2023-10-03T19:17:43.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.510+0000 7f544ffff640 1 -- 172.21.15.45:0/2400921408 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f545801e460 con 0x7f546806d170 2023-10-03T19:17:43.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.510+0000 7f544ffff640 1 --2- 172.21.15.45:0/2400921408 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5454066280 0x7f5454068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:43.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.510+0000 7f544ffff640 1 -- 172.21.15.45:0/2400921408 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5458084e50 con 0x7f546806d170 2023-10-03T19:17:43.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.510+0000 7f5466ffd640 1 --2- 172.21.15.45:0/2400921408 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5454066280 0x7f5454068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:43.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.510+0000 7f5466ffd640 1 --2- 172.21.15.45:0/2400921408 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5454066280 0x7f5454068730 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f545c001380 tx=0x7f545c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:43.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.514+0000 7f544ffff640 1 -- 172.21.15.45:0/2400921408 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5458052440 con 0x7f546806d170 2023-10-03T19:17:43.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.702+0000 7f546dd2a640 1 -- 172.21.15.45:0/2400921408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f546806d660 con 0x7f546806d170 2023-10-03T19:17:43.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.702+0000 7f544ffff640 1 -- 172.21.15.45:0/2400921408 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5458055a60 con 0x7f546806d170 2023-10-03T19:17:43.703 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-03T19:17:43.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.702+0000 7f546dd2a640 1 -- 172.21.15.45:0/2400921408 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5454066280 msgr2=0x7f5454068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:43.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.702+0000 7f546dd2a640 1 --2- 172.21.15.45:0/2400921408 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5454066280 0x7f5454068730 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f545c001380 tx=0x7f545c009040 comp rx=0 tx=0).stop 2023-10-03T19:17:43.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.702+0000 7f546dd2a640 1 -- 172.21.15.45:0/2400921408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f546806d170 msgr2=0x7f54680bffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:43.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.702+0000 7f546dd2a640 1 --2- 172.21.15.45:0/2400921408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f546806d170 0x7f54680bffc0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f545800d830 tx=0x7f545800dcf0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.702+0000 7f546dd2a640 1 -- 172.21.15.45:0/2400921408 shutdown_connections 2023-10-03T19:17:43.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.702+0000 7f546dd2a640 1 --2- 172.21.15.45:0/2400921408 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5454066280 0x7f5454068730 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.702+0000 7f546dd2a640 1 --2- 172.21.15.45:0/2400921408 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f54680bc8b0 0x7f54680b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.702+0000 7f546dd2a640 1 --2- 172.21.15.45:0/2400921408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f546806f170 0x7f5468148680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.702+0000 7f546dd2a640 1 --2- 172.21.15.45:0/2400921408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f546806d170 0x7f54680bffc0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:43.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.702+0000 7f546dd2a640 1 -- 172.21.15.45:0/2400921408 >> 172.21.15.45:0/2400921408 conn(0x7f54680bcf50 msgr2=0x7f546814e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:43.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.702+0000 7f546dd2a640 1 -- 172.21.15.45:0/2400921408 shutdown_connections 2023-10-03T19:17:43.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:43.702+0000 7f546dd2a640 1 -- 172.21.15.45:0/2400921408 wait complete. 2023-10-03T19:17:43.721 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-03T19:17:43.721 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-03T19:17:43.721 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-10-03T19:17:43.722 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-03T19:17:43.722 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-03T19:17:43.722 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-03T19:17:43.722 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-03T19:17:43.722 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-03T19:17:43.722 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-03T19:17:43.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:17:43.722 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-10-03T19:17:43.729 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-03T19:17:43.729 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-03T19:17:43.729 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-10-03T19:17:43.729 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:17:43.729 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-10-03T19:17:43.729 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:17:43.729 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:17:43.729 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-10-03T19:17:43.729 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-10-03T19:17:43.729 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:17:43.729 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-10-03T19:17:43.730 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-10-03T19:17:43.730 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:17:43.730 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-10-03T19:17:43.730 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-03T19:17:43.730 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-10-03T19:17:43.730 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-03T19:17:43.730 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42119sec preferred_lft 42119sec 2023-10-03T19:17:43.730 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2023-10-03T19:17:43.730 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:17:43.730 INFO:teuthology.orchestra.run.smithi146.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-03T19:17:43.730 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 02:42:a6:2d:ab:3b brd ff:ff:ff:ff:ff:ff 2023-10-03T19:17:43.731 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-03T19:17:43.731 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:17:43.731 INFO:teuthology.orchestra.run.smithi146.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-03T19:17:43.731 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-03T19:17:43.731 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-03T19:17:43.731 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:17:43.731 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::5c3e:4eff:fee6:56da/64 scope link 2023-10-03T19:17:43.731 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:17:43.731 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-03T19:17:43.731 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T19:17:43.731 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-03T19:17:43.731 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:17:43.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:17:43.732 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-03T19:17:43.781 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T19:17:43.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:17:43.949 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-10-03T19:17:44.002 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-10-03T19:17:44.150 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-03T19:17:44.150 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-03T19:17:44.151 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-03T19:17:44.151 INFO:teuthology.orchestra.run.smithi146.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-03T19:17:44.151 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-03T19:17:44.151 INFO:teuthology.orchestra.run.smithi146.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:17:44.151 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:17:44.152 INFO:teuthology.orchestra.run.smithi146.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:17:44.152 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-03T19:17:44.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:17:44.152 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-03T19:17:44.152 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-03T19:17:44.152 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-03T19:17:44.152 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-03T19:17:44.152 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-03T19:17:44.152 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-03T19:17:44.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:17:44.318 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-10-03T19:17:44.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-03T19:17:44.340 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-03T19:17:44.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:17:44.340 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-10-03T19:17:44.379 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-03T19:17:44.382 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T19:17:44.382 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-03T19:17:44.426 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-03T19:17:44.540 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T19:17:44.540 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-03T19:17:44.546 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-03T19:17:44.603 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:17:44.877 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:17:44.890 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:17:44.891 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:17:44.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:17:44.892 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-03T19:17:44.938 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-03T19:17:44.947 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-03T19:17:44.983 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-03T19:17:45.064 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:17:45.084 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:17:45.085 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:2023-10-03T19:17:45.062+0000 7fa4e34ba580 -1 init, newargv = 0x560e2adf2560 newargc=15 2023-10-03T19:17:45.085 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[33693]: starting ceph client 2023-10-03T19:17:45.085 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[33693]: starting fuse 2023-10-03T19:17:45.094 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:17:45.104 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:17:45.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:17:45.105 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-03T19:17:45.153 INFO:teuthology.orchestra.run.smithi146.stdout:45 2023-10-03T19:17:45.154 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-03T19:17:45.154 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-03T19:17:45.154 DEBUG:teuthology.orchestra.run.smithi146:> import glob 2023-10-03T19:17:45.154 DEBUG:teuthology.orchestra.run.smithi146:> import re 2023-10-03T19:17:45.154 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-03T19:17:45.155 DEBUG:teuthology.orchestra.run.smithi146:> import subprocess 2023-10-03T19:17:45.155 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:17:45.155 DEBUG:teuthology.orchestra.run.smithi146:> def _find_admin_socket(client_name): 2023-10-03T19:17:45.155 DEBUG:teuthology.orchestra.run.smithi146:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-03T19:17:45.155 DEBUG:teuthology.orchestra.run.smithi146:> files = glob.glob(asok_path) 2023-10-03T19:17:45.155 DEBUG:teuthology.orchestra.run.smithi146:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-03T19:17:45.155 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:17:45.155 DEBUG:teuthology.orchestra.run.smithi146:> # Given a non-glob path, it better be there 2023-10-03T19:17:45.155 DEBUG:teuthology.orchestra.run.smithi146:> if "*" not in asok_path: 2023-10-03T19:17:45.155 DEBUG:teuthology.orchestra.run.smithi146:> assert(len(files) == 1) 2023-10-03T19:17:45.155 DEBUG:teuthology.orchestra.run.smithi146:> return files[0] 2023-10-03T19:17:45.155 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:17:45.155 DEBUG:teuthology.orchestra.run.smithi146:> for f in files: 2023-10-03T19:17:45.155 DEBUG:teuthology.orchestra.run.smithi146:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-03T19:17:45.156 DEBUG:teuthology.orchestra.run.smithi146:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-03T19:17:45.156 DEBUG:teuthology.orchestra.run.smithi146:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-03T19:17:45.156 DEBUG:teuthology.orchestra.run.smithi146:> contents = proc_f.read() 2023-10-03T19:17:45.156 DEBUG:teuthology.orchestra.run.smithi146:> if mountpoint in contents: 2023-10-03T19:17:45.156 DEBUG:teuthology.orchestra.run.smithi146:> return f 2023-10-03T19:17:45.156 DEBUG:teuthology.orchestra.run.smithi146:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-03T19:17:45.156 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:17:45.156 DEBUG:teuthology.orchestra.run.smithi146:> print(_find_admin_socket("client.0")) 2023-10-03T19:17:45.156 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-03T19:17:45.271 INFO:teuthology.orchestra.run.smithi146.stdout:/var/run/ceph/ceph-client.0.33693.asok 2023-10-03T19:17:45.454 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.33693.asok 2023-10-03T19:17:45.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:17:45.486 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.33693.asok status 2023-10-03T19:17:45.611 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-03T19:17:45.617 INFO:teuthology.orchestra.run.smithi146.stdout: "metadata": { 2023-10-03T19:17:45.617 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_sha1": "05a43c8fb3988914c879a50970f9054a098e0612", 2023-10-03T19:17:45.617 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 18.0.0-3908-g05a43c8f (05a43c8fb3988914c879a50970f9054a098e0612) reef (dev)", 2023-10-03T19:17:45.617 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "0", 2023-10-03T19:17:45.617 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2023-10-03T19:17:45.617 INFO:teuthology.orchestra.run.smithi146.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-03T19:17:45.617 INFO:teuthology.orchestra.run.smithi146.stdout: "pid": "33693", 2023-10-03T19:17:45.618 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2023-10-03T19:17:45.618 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:17:45.618 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_count": 0, 2023-10-03T19:17:45.618 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_pinned_count": 0, 2023-10-03T19:17:45.618 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 5929, 2023-10-03T19:17:45.618 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": { 2023-10-03T19:17:45.618 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2023-10-03T19:17:45.618 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2023-10-03T19:17:45.618 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 5929 2023-10-03T19:17:45.618 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:17:45.618 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-03T19:17:45.619 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T19:17:45.619 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:0", 2023-10-03T19:17:45.619 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 3047788495 2023-10-03T19:17:45.619 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T19:17:45.619 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:17:45.619 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-03T19:17:45.619 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T19:17:45.619 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:0", 2023-10-03T19:17:45.619 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 3047788495 2023-10-03T19:17:45.619 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:17:45.619 INFO:teuthology.orchestra.run.smithi146.stdout: "inst_str": "client.5929 172.21.15.146:0/3047788495", 2023-10-03T19:17:45.619 INFO:teuthology.orchestra.run.smithi146.stdout: "addr_str": "172.21.15.146:0/3047788495", 2023-10-03T19:17:45.619 INFO:teuthology.orchestra.run.smithi146.stdout: "inode_count": 1, 2023-10-03T19:17:45.620 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_epoch": 36, 2023-10-03T19:17:45.620 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch": 74, 2023-10-03T19:17:45.620 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch_barrier": 0, 2023-10-03T19:17:45.620 INFO:teuthology.orchestra.run.smithi146.stdout: "blocklisted": false, 2023-10-03T19:17:45.620 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs" 2023-10-03T19:17:45.620 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-03T19:17:45.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:17:45.626 DEBUG:teuthology.orchestra.run.smithi146:> stat --file-system '--printf=%T 2023-10-03T19:17:45.626 DEBUG:teuthology.orchestra.run.smithi146:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-03T19:17:45.632 INFO:teuthology.orchestra.run.smithi146.stdout:fuseblk 2023-10-03T19:17:45.639 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-03T19:17:45.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:17:45.640 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-03T19:17:45.685 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:17:45.685 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:17:45.730 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-03T19:17:45.731 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-03T19:17:45.731 DEBUG:teuthology.orchestra.run.smithi146:> import uuid 2023-10-03T19:17:45.731 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:17:45.731 DEBUG:teuthology.orchestra.run.smithi146:> n = 1000 2023-10-03T19:17:45.731 DEBUG:teuthology.orchestra.run.smithi146:> create_hard_links = False 2023-10-03T19:17:45.731 DEBUG:teuthology.orchestra.run.smithi146:> if 0 > 0: 2023-10-03T19:17:45.731 DEBUG:teuthology.orchestra.run.smithi146:> create_hard_links = True 2023-10-03T19:17:45.731 DEBUG:teuthology.orchestra.run.smithi146:> path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2023-10-03T19:17:45.732 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:17:45.732 DEBUG:teuthology.orchestra.run.smithi146:> dpath = os.path.dirname(path) 2023-10-03T19:17:45.732 DEBUG:teuthology.orchestra.run.smithi146:> fnameprefix = os.path.basename(path) 2023-10-03T19:17:45.732 DEBUG:teuthology.orchestra.run.smithi146:> os.makedirs(dpath, exist_ok=True) 2023-10-03T19:17:45.732 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:17:45.732 DEBUG:teuthology.orchestra.run.smithi146:> try: 2023-10-03T19:17:45.732 DEBUG:teuthology.orchestra.run.smithi146:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-10-03T19:17:45.732 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:17:45.732 DEBUG:teuthology.orchestra.run.smithi146:> for i in range(n): 2023-10-03T19:17:45.732 DEBUG:teuthology.orchestra.run.smithi146:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-10-03T19:17:45.732 DEBUG:teuthology.orchestra.run.smithi146:> with open(fpath, '"'"'w'"'"') as f: 2023-10-03T19:17:45.732 DEBUG:teuthology.orchestra.run.smithi146:> f.write(f"{i}") 2023-10-03T19:17:45.733 DEBUG:teuthology.orchestra.run.smithi146:> if True: 2023-10-03T19:17:45.733 DEBUG:teuthology.orchestra.run.smithi146:> f.flush() 2023-10-03T19:17:45.733 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(f.fileno()) 2023-10-03T19:17:45.733 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2023-10-03T19:17:45.733 DEBUG:teuthology.orchestra.run.smithi146:> os.unlink(fpath) 2023-10-03T19:17:45.733 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2023-10-03T19:17:45.733 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(dirfd) 2023-10-03T19:17:45.733 DEBUG:teuthology.orchestra.run.smithi146:> if create_hard_links: 2023-10-03T19:17:45.733 DEBUG:teuthology.orchestra.run.smithi146:> for j in range(0): 2023-10-03T19:17:45.733 DEBUG:teuthology.orchestra.run.smithi146:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-10-03T19:17:45.733 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2023-10-03T19:17:45.733 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(dirfd) 2023-10-03T19:17:45.733 DEBUG:teuthology.orchestra.run.smithi146:> finally: 2023-10-03T19:17:45.734 DEBUG:teuthology.orchestra.run.smithi146:> os.close(dirfd) 2023-10-03T19:17:45.734 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-03T19:17:58.444 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:17:58.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.577+0000 7efc361fa640 1 Processor -- start 2023-10-03T19:17:58.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.577+0000 7efc361fa640 1 -- start start 2023-10-03T19:17:58.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.577+0000 7efc361fa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efc300bed20 0x7efc300bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:58.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.577+0000 7efc361fa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc300a6f00 0x7efc30150200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:58.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.577+0000 7efc361fa640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc3014fd70 con 0x7efc30150740 2023-10-03T19:17:58.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.577+0000 7efc361fa640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc3014d420 con 0x7efc300bed20 2023-10-03T19:17:58.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.577+0000 7efc361fa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc30146910 con 0x7efc300a6f00 2023-10-03T19:17:58.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.577+0000 7efc2ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7efc30150740 0x7efc300be010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43286/0 (socket says 172.21.15.45:43286) 2023-10-03T19:17:58.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.577+0000 7efc2ffff640 1 -- 172.21.15.45:0/844607567 learned_addr learned my addr 172.21.15.45:0/844607567 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:58.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.577+0000 7efc2f7fe640 1 --2- 172.21.15.45:0/844607567 >> v2:172.21.15.45:3300/0 conn(0x7efc300bed20 0x7efc300bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:58.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.577+0000 7efc2effd640 1 --2- 172.21.15.45:0/844607567 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc300a6f00 0x7efc30150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:58.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.577+0000 7efc2e7fc640 1 -- 172.21.15.45:0/844607567 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1590259808 0 0) 0x7efc3014fd70 con 0x7efc30150740 2023-10-03T19:17:58.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.577+0000 7efc2e7fc640 1 -- 172.21.15.45:0/844607567 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc18003530 con 0x7efc30150740 2023-10-03T19:17:58.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.577+0000 7efc2f7fe640 1 -- 172.21.15.45:0/844607567 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc300a6f00 msgr2=0x7efc30150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:58.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.577+0000 7efc2f7fe640 1 --2- 172.21.15.45:0/844607567 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc300a6f00 0x7efc30150200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:58.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.577+0000 7efc2f7fe640 1 -- 172.21.15.45:0/844607567 >> v1:172.21.15.45:6789/0 conn(0x7efc30150740 legacy=0x7efc300be010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:58.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.577+0000 7efc2f7fe640 1 -- 172.21.15.45:0/844607567 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3006e9f0 con 0x7efc300bed20 2023-10-03T19:17:58.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.577+0000 7efc2effd640 1 --2- 172.21.15.45:0/844607567 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc300a6f00 0x7efc30150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:17:58.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.581+0000 7efc2f7fe640 1 --2- 172.21.15.45:0/844607567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc300bed20 0x7efc300bf0f0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7efc200097c0 tx=0x7efc2001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61befd8ffcf7a822 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:58.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.581+0000 7efc2e7fc640 1 -- 172.21.15.45:0/844607567 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc200ac640 con 0x7efc300bed20 2023-10-03T19:17:58.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.581+0000 7efc2e7fc640 1 -- 172.21.15.45:0/844607567 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc200ac7a0 con 0x7efc300bed20 2023-10-03T19:17:58.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.581+0000 7efc2e7fc640 1 -- 172.21.15.45:0/844607567 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc200acb30 con 0x7efc300bed20 2023-10-03T19:17:58.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.581+0000 7efc361fa640 1 -- 172.21.15.45:0/844607567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc300bed20 msgr2=0x7efc300bf0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:58.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.581+0000 7efc361fa640 1 --2- 172.21.15.45:0/844607567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc300bed20 0x7efc300bf0f0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7efc200097c0 tx=0x7efc2001c480 comp rx=0 tx=0).stop 2023-10-03T19:17:58.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.581+0000 7efc361fa640 1 -- 172.21.15.45:0/844607567 shutdown_connections 2023-10-03T19:17:58.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.581+0000 7efc361fa640 1 --2- 172.21.15.45:0/844607567 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc300a6f00 0x7efc30150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:58.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.581+0000 7efc361fa640 1 --2- 172.21.15.45:0/844607567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc300bed20 0x7efc300bf0f0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:58.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.581+0000 7efc361fa640 1 -- 172.21.15.45:0/844607567 >> 172.21.15.45:0/844607567 conn(0x7efc3006d990 msgr2=0x7efc3006bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:58.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.581+0000 7efc361fa640 1 -- 172.21.15.45:0/844607567 shutdown_connections 2023-10-03T19:17:58.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.581+0000 7efc361fa640 1 -- 172.21.15.45:0/844607567 wait complete. 2023-10-03T19:17:58.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.581+0000 7efc361fa640 1 Processor -- start 2023-10-03T19:17:58.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.581+0000 7efc361fa640 1 -- start start 2023-10-03T19:17:58.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.581+0000 7efc361fa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc300a6f00 0x7efc30148f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:58.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.581+0000 7efc361fa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc300bed20 0x7efc300b76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:58.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.581+0000 7efc361fa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc30150740 0x7efc300b7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:58.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.581+0000 7efc361fa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc301e8ac0 con 0x7efc30150740 2023-10-03T19:17:58.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.581+0000 7efc361fa640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc300bbfa0 con 0x7efc300a6f00 2023-10-03T19:17:58.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.581+0000 7efc361fa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc30145b80 con 0x7efc300bed20 2023-10-03T19:17:58.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.585+0000 7efc2ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc30150740 0x7efc300b7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:58.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.585+0000 7efc2ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc30150740 0x7efc300b7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32778/0 (socket says 172.21.15.45:32778) 2023-10-03T19:17:58.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.585+0000 7efc2ffff640 1 -- 172.21.15.45:0/457249964 learned_addr learned my addr 172.21.15.45:0/457249964 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:58.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.585+0000 7efc2effd640 1 --2- 172.21.15.45:0/457249964 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc300bed20 0x7efc300b76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:58.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.585+0000 7efc2f7fe640 1 --2- 172.21.15.45:0/457249964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc300a6f00 0x7efc30148f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:58.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.585+0000 7efc2ffff640 1 -- 172.21.15.45:0/457249964 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc300bed20 msgr2=0x7efc300b76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:58.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.585+0000 7efc2ffff640 1 --2- 172.21.15.45:0/457249964 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc300bed20 0x7efc300b76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:58.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.585+0000 7efc2ffff640 1 -- 172.21.15.45:0/457249964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc300a6f00 msgr2=0x7efc30148f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:58.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.585+0000 7efc2ffff640 1 --2- 172.21.15.45:0/457249964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc300a6f00 0x7efc30148f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:58.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.585+0000 7efc2ffff640 1 -- 172.21.15.45:0/457249964 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc20009420 con 0x7efc30150740 2023-10-03T19:17:58.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.585+0000 7efc2ffff640 1 --2- 172.21.15.45:0/457249964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc30150740 0x7efc300b7bf0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7efc2800ca70 tx=0x7efc2800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:58.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.585+0000 7efc17fff640 1 -- 172.21.15.45:0/457249964 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2800abd0 con 0x7efc30150740 2023-10-03T19:17:58.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.585+0000 7efc17fff640 1 -- 172.21.15.45:0/457249964 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2800ad30 con 0x7efc30150740 2023-10-03T19:17:58.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.585+0000 7efc361fa640 1 -- 172.21.15.45:0/457249964 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc300bf9d0 con 0x7efc30150740 2023-10-03T19:17:58.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.585+0000 7efc17fff640 1 -- 172.21.15.45:0/457249964 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc28012600 con 0x7efc30150740 2023-10-03T19:17:58.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.585+0000 7efc361fa640 1 -- 172.21.15.45:0/457249964 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc300bf840 con 0x7efc30150740 2023-10-03T19:17:58.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.585+0000 7efc361fa640 1 -- 172.21.15.45:0/457249964 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc300be720 con 0x7efc30150740 2023-10-03T19:17:58.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.585+0000 7efc17fff640 1 -- 172.21.15.45:0/457249964 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efc28007070 con 0x7efc30150740 2023-10-03T19:17:58.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.585+0000 7efc17fff640 1 --2- 172.21.15.45:0/457249964 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efc1c066280 0x7efc1c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:58.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.585+0000 7efc17fff640 1 -- 172.21.15.45:0/457249964 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efc28083ba0 con 0x7efc30150740 2023-10-03T19:17:58.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.585+0000 7efc2f7fe640 1 --2- 172.21.15.45:0/457249964 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efc1c066280 0x7efc1c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:58.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.585+0000 7efc2f7fe640 1 --2- 172.21.15.45:0/457249964 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efc1c066280 0x7efc1c068730 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efc200ae000 tx=0x7efc20008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:58.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.589+0000 7efc17fff640 1 -- 172.21.15.45:0/457249964 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7efc280510d0 con 0x7efc30150740 2023-10-03T19:17:58.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.777+0000 7efc361fa640 1 -- 172.21.15.45:0/457249964 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc300b7500 con 0x7efc30150740 2023-10-03T19:17:58.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.781+0000 7efc17fff640 1 -- 172.21.15.45:0/457249964 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+3913 (secure 0 0 0) 0x7efc28017090 con 0x7efc30150740 2023-10-03T19:17:58.782 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:17:58.782 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/250992108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":250992108},{"type":"v1","addr":"172.21.15.79:6835","nonce":250992108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6339,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3153040546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3153040546},{"type":"v1","addr":"172.21.15.45:6834","nonce":3153040546}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:17:35.497011+0000","modified":"2023-10-03T19:17:38.516672+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6342},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6342":{"gid":6342,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/2939002026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2939002026},{"type":"v1","addr":"172.21.15.45:6835","nonce":2939002026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-10-03T19:17:58.783 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 36 2023-10-03T19:17:58.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.781+0000 7efc361fa640 1 -- 172.21.15.45:0/457249964 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efc1c066280 msgr2=0x7efc1c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:58.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.781+0000 7efc361fa640 1 --2- 172.21.15.45:0/457249964 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efc1c066280 0x7efc1c068730 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efc200ae000 tx=0x7efc20008040 comp rx=0 tx=0).stop 2023-10-03T19:17:58.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.781+0000 7efc361fa640 1 -- 172.21.15.45:0/457249964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc30150740 msgr2=0x7efc300b7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:58.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.781+0000 7efc361fa640 1 --2- 172.21.15.45:0/457249964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc30150740 0x7efc300b7bf0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7efc2800ca70 tx=0x7efc2800cf30 comp rx=0 tx=0).stop 2023-10-03T19:17:58.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.781+0000 7efc361fa640 1 -- 172.21.15.45:0/457249964 shutdown_connections 2023-10-03T19:17:58.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.781+0000 7efc361fa640 1 --2- 172.21.15.45:0/457249964 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efc1c066280 0x7efc1c068730 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:58.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.781+0000 7efc361fa640 1 --2- 172.21.15.45:0/457249964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc30150740 0x7efc300b7bf0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:58.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.781+0000 7efc361fa640 1 --2- 172.21.15.45:0/457249964 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc300bed20 0x7efc300b76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:58.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.781+0000 7efc361fa640 1 --2- 172.21.15.45:0/457249964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc300a6f00 0x7efc30148f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:58.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.781+0000 7efc361fa640 1 -- 172.21.15.45:0/457249964 >> 172.21.15.45:0/457249964 conn(0x7efc3006d990 msgr2=0x7efc3014ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:58.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.781+0000 7efc361fa640 1 -- 172.21.15.45:0/457249964 shutdown_connections 2023-10-03T19:17:58.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:58.781+0000 7efc361fa640 1 -- 172.21.15.45:0/457249964 wait complete. 2023-10-03T19:17:58.801 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2023-10-03T19:17:58.938 INFO:teuthology.orchestra.run.smithi045.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2023-10-03T19:17:58.938 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2023-10-03T19:17:58.938 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:17:59.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.053+0000 7fed150c5640 1 Processor -- start 2023-10-03T19:17:59.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.053+0000 7fed150c5640 1 -- start start 2023-10-03T19:17:59.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed150c5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fed1006c9a0 0x7fed10156d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:59.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed150c5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed1014b610 con 0x7fed100bcb60 2023-10-03T19:17:59.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed150c5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed100a5580 con 0x7fed10148b90 2023-10-03T19:17:59.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed150c5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed100a3670 con 0x7fed1006c9a0 2023-10-03T19:17:59.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed0e59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fed100bcb60 0x7fed1006c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43290/0 (socket says 172.21.15.45:43290) 2023-10-03T19:17:59.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed0e59c640 1 -- 172.21.15.45:0/667521201 learned_addr learned my addr 172.21.15.45:0/667521201 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:17:59.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed0f59e640 1 --2- 172.21.15.45:0/667521201 >> v2:172.21.15.79:3300/0 conn(0x7fed1006c9a0 0x7fed10156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:59.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed0dd9b640 1 -- 172.21.15.45:0/667521201 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2139058147 0 0) 0x7fed1014b610 con 0x7fed100bcb60 2023-10-03T19:17:59.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed0dd9b640 1 -- 172.21.15.45:0/667521201 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecf8003530 con 0x7fed100bcb60 2023-10-03T19:17:59.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed0dd9b640 1 -- 172.21.15.45:0/667521201 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282405219 0 0) 0x7fed100a5580 con 0x7fed10148b90 2023-10-03T19:17:59.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed0dd9b640 1 -- 172.21.15.45:0/667521201 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed1014b610 con 0x7fed10148b90 2023-10-03T19:17:59.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed0dd9b640 1 -- 172.21.15.45:0/667521201 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3306950062 0 0) 0x7fecf8003530 con 0x7fed100bcb60 2023-10-03T19:17:59.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed0dd9b640 1 -- 172.21.15.45:0/667521201 >> v2:172.21.15.79:3300/0 conn(0x7fed1006c9a0 msgr2=0x7fed10156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:59.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed0dd9b640 1 --2- 172.21.15.45:0/667521201 >> v2:172.21.15.79:3300/0 conn(0x7fed1006c9a0 0x7fed10156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed0dd9b640 1 -- 172.21.15.45:0/667521201 >> v1:172.21.15.79:6789/0 conn(0x7fed10148b90 legacy=0x7fed100bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:59.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed0dd9b640 1 -- 172.21.15.45:0/667521201 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed100a5820 con 0x7fed100bcb60 2023-10-03T19:17:59.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed0dd9b640 1 -- 172.21.15.45:0/667521201 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fed04001680 con 0x7fed100bcb60 2023-10-03T19:17:59.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed0dd9b640 1 -- 172.21.15.45:0/667521201 >> v1:172.21.15.45:6789/0 conn(0x7fed100bcb60 legacy=0x7fed1006c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:59.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed0dd9b640 1 --2- 172.21.15.45:0/667521201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecf8003b60 0x7fecf8003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:59.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed0dd9b640 1 --2- 172.21.15.45:0/667521201 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fecf80047d0 0x7fecf8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:59.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed0dd9b640 1 --2- 172.21.15.45:0/667521201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecf8005180 0x7fecf800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:59.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed0dd9b640 1 -- 172.21.15.45:0/667521201 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed100a3670 con 0x7fecf8005180 2023-10-03T19:17:59.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed0dd9b640 1 -- 172.21.15.45:0/667521201 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf800bfb0 con 0x7fecf8003b60 2023-10-03T19:17:59.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed0dd9b640 1 -- 172.21.15.45:0/667521201 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf800c170 con 0x7fecf80047d0 2023-10-03T19:17:59.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed0f59e640 1 --2- 172.21.15.45:0/667521201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecf8005180 0x7fecf800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:59.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed0ed9d640 1 --2- 172.21.15.45:0/667521201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecf8003b60 0x7fecf8003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:59.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed0e59c640 1 --2- 172.21.15.45:0/667521201 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fecf80047d0 0x7fecf8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:59.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed0f59e640 1 -- 172.21.15.45:0/667521201 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fecf80047d0 msgr2=0x7fecf8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:59.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed0f59e640 1 --2- 172.21.15.45:0/667521201 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fecf80047d0 0x7fecf8004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed0f59e640 1 -- 172.21.15.45:0/667521201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecf8003b60 msgr2=0x7fecf8003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:59.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed0f59e640 1 --2- 172.21.15.45:0/667521201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecf8003b60 0x7fecf8003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.057+0000 7fed0f59e640 1 -- 172.21.15.45:0/667521201 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf8003530 con 0x7fecf8005180 2023-10-03T19:17:59.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed0f59e640 1 -- 172.21.15.45:0/667521201 reap_dead start 2023-10-03T19:17:59.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed0f59e640 1 --2- 172.21.15.45:0/667521201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecf8005180 0x7fecf800b990 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fed08009fc0 tx=0x7fed0801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d149996928e2123 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:59.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed0dd9b640 1 -- 172.21.15.45:0/667521201 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed080a5cb0 con 0x7fecf8005180 2023-10-03T19:17:59.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed0dd9b640 1 -- 172.21.15.45:0/667521201 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0800f040 con 0x7fecf8005180 2023-10-03T19:17:59.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed0dd9b640 1 -- 172.21.15.45:0/667521201 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed08003be0 con 0x7fecf8005180 2023-10-03T19:17:59.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed150c5640 1 -- 172.21.15.45:0/667521201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecf8005180 msgr2=0x7fecf800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:59.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed150c5640 1 --2- 172.21.15.45:0/667521201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecf8005180 0x7fecf800b990 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fed08009fc0 tx=0x7fed0801cca0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed150c5640 1 -- 172.21.15.45:0/667521201 shutdown_connections 2023-10-03T19:17:59.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed150c5640 1 --2- 172.21.15.45:0/667521201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecf8005180 0x7fecf800b990 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed150c5640 1 -- 172.21.15.45:0/667521201 >> 172.21.15.45:0/667521201 conn(0x7fed100bcf50 msgr2=0x7fed100bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:59.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed150c5640 1 -- 172.21.15.45:0/667521201 shutdown_connections 2023-10-03T19:17:59.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed150c5640 1 -- 172.21.15.45:0/667521201 wait complete. 2023-10-03T19:17:59.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed150c5640 1 Processor -- start 2023-10-03T19:17:59.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed150c5640 1 -- start start 2023-10-03T19:17:59.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed150c5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecf8005180 0x7fed10134170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:59.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed150c5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed101346b0 0x7fed100bf670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:59.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed150c5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed100bfbb0 0x7fed101e4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:59.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed150c5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1014aa70 con 0x7fecf8005180 2023-10-03T19:17:59.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed150c5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed10138c00 con 0x7fed100bfbb0 2023-10-03T19:17:59.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed150c5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed10138540 con 0x7fed101346b0 2023-10-03T19:17:59.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed0ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecf8005180 0x7fed10134170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:59.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed0ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecf8005180 0x7fed10134170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32798/0 (socket says 172.21.15.45:32798) 2023-10-03T19:17:59.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed0ed9d640 1 -- 172.21.15.45:0/1331415391 learned_addr learned my addr 172.21.15.45:0/1331415391 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:59.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed0f59e640 1 --2- 172.21.15.45:0/1331415391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed100bfbb0 0x7fed101e4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:59.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed0e59c640 1 --2- 172.21.15.45:0/1331415391 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed101346b0 0x7fed100bf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:59.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed0ed9d640 1 -- 172.21.15.45:0/1331415391 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed101346b0 msgr2=0x7fed100bf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:59.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed0ed9d640 1 --2- 172.21.15.45:0/1331415391 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed101346b0 0x7fed100bf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed0ed9d640 1 -- 172.21.15.45:0/1331415391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed100bfbb0 msgr2=0x7fed101e4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:59.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed0ed9d640 1 --2- 172.21.15.45:0/1331415391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed100bfbb0 0x7fed101e4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed0ed9d640 1 -- 172.21.15.45:0/1331415391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed100a3880 con 0x7fecf8005180 2023-10-03T19:17:59.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed0e59c640 1 --2- 172.21.15.45:0/1331415391 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed101346b0 0x7fed100bf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:59.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.061+0000 7fed0ed9d640 1 --2- 172.21.15.45:0/1331415391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecf8005180 0x7fed10134170 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fed0000e5a0 tx=0x7fed0000ea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:59.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.065+0000 7fecf77fe640 1 -- 172.21.15.45:0/1331415391 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed000052e0 con 0x7fecf8005180 2023-10-03T19:17:59.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.065+0000 7fecf77fe640 1 -- 172.21.15.45:0/1331415391 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed00005440 con 0x7fecf8005180 2023-10-03T19:17:59.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.065+0000 7fecf77fe640 1 -- 172.21.15.45:0/1331415391 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed00003840 con 0x7fecf8005180 2023-10-03T19:17:59.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.065+0000 7fed150c5640 1 -- 172.21.15.45:0/1331415391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed10148f60 con 0x7fecf8005180 2023-10-03T19:17:59.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.065+0000 7fed150c5640 1 -- 172.21.15.45:0/1331415391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed100a3c30 con 0x7fecf8005180 2023-10-03T19:17:59.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.065+0000 7fed150c5640 1 -- 172.21.15.45:0/1331415391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed101383a0 con 0x7fecf8005180 2023-10-03T19:17:59.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.065+0000 7fecf77fe640 1 -- 172.21.15.45:0/1331415391 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fed000039a0 con 0x7fecf8005180 2023-10-03T19:17:59.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.065+0000 7fecf77fe640 1 --2- 172.21.15.45:0/1331415391 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fecfc066280 0x7fecfc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:59.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.065+0000 7fecf77fe640 1 -- 172.21.15.45:0/1331415391 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fed00083cc0 con 0x7fecf8005180 2023-10-03T19:17:59.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.065+0000 7fed0e59c640 1 --2- 172.21.15.45:0/1331415391 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fecfc066280 0x7fecfc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:59.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.065+0000 7fed0e59c640 1 --2- 172.21.15.45:0/1331415391 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fecfc066280 0x7fecfc068730 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fed04000c10 tx=0x7fed04009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:59.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.069+0000 7fecf77fe640 1 -- 172.21.15.45:0/1331415391 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fed101383a0 con 0x7fecf8005180 2023-10-03T19:17:59.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.261+0000 7fed150c5640 1 -- 172.21.15.45:0/1331415391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed101383a0 con 0x7fecf8005180 2023-10-03T19:17:59.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.261+0000 7fecf77fe640 1 -- 172.21.15.45:0/1331415391 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+3913 (secure 0 0 0) 0x7fed101383a0 con 0x7fecf8005180 2023-10-03T19:17:59.263 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:17:59.263 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/250992108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":250992108},{"type":"v1","addr":"172.21.15.79:6835","nonce":250992108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6339,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3153040546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3153040546},{"type":"v1","addr":"172.21.15.45:6834","nonce":3153040546}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:17:35.497011+0000","modified":"2023-10-03T19:17:38.516672+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6342},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6342":{"gid":6342,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/2939002026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2939002026},{"type":"v1","addr":"172.21.15.45:6835","nonce":2939002026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-10-03T19:17:59.263 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 36 2023-10-03T19:17:59.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.261+0000 7fed150c5640 1 -- 172.21.15.45:0/1331415391 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fecfc066280 msgr2=0x7fecfc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:59.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.261+0000 7fed150c5640 1 --2- 172.21.15.45:0/1331415391 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fecfc066280 0x7fecfc068730 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fed04000c10 tx=0x7fed04009040 comp rx=0 tx=0).stop 2023-10-03T19:17:59.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.261+0000 7fed150c5640 1 -- 172.21.15.45:0/1331415391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecf8005180 msgr2=0x7fed10134170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:59.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.261+0000 7fed150c5640 1 --2- 172.21.15.45:0/1331415391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecf8005180 0x7fed10134170 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fed0000e5a0 tx=0x7fed0000ea60 comp rx=0 tx=0).stop 2023-10-03T19:17:59.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.261+0000 7fed150c5640 1 -- 172.21.15.45:0/1331415391 shutdown_connections 2023-10-03T19:17:59.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.261+0000 7fed150c5640 1 --2- 172.21.15.45:0/1331415391 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fecfc066280 0x7fecfc068730 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.261+0000 7fed150c5640 1 --2- 172.21.15.45:0/1331415391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed100bfbb0 0x7fed101e4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.261+0000 7fed150c5640 1 --2- 172.21.15.45:0/1331415391 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed101346b0 0x7fed100bf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.261+0000 7fed150c5640 1 --2- 172.21.15.45:0/1331415391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecf8005180 0x7fed10134170 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.261+0000 7fed150c5640 1 -- 172.21.15.45:0/1331415391 >> 172.21.15.45:0/1331415391 conn(0x7fed100bcf50 msgr2=0x7fed1013f260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:59.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.261+0000 7fed150c5640 1 -- 172.21.15.45:0/1331415391 shutdown_connections 2023-10-03T19:17:59.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.261+0000 7fed150c5640 1 -- 172.21.15.45:0/1331415391 wait complete. 2023-10-03T19:17:59.282 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2023-10-03T19:17:59.422 INFO:teuthology.orchestra.run.smithi045.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2023-10-03T19:17:59.423 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2023-10-03T19:17:59.423 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 cache drop 10 2023-10-03T19:17:59.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.545+0000 7f36af311640 1 Processor -- start 2023-10-03T19:17:59.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.545+0000 7f36af311640 1 -- start start 2023-10-03T19:17:59.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.545+0000 7f36af311640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f36a814f370 0x7f36a80ba140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:59.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.545+0000 7f36af311640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36a8070d80 0x7f36a81591b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:59.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.545+0000 7f36af311640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a80714d0 con 0x7f36a80ba680 2023-10-03T19:17:59.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.545+0000 7f36af311640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a80717b0 con 0x7f36a814f370 2023-10-03T19:17:59.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.545+0000 7f36af311640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a8151fa0 con 0x7f36a8070d80 2023-10-03T19:17:59.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.545+0000 7f36ad0ad640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f36a814f370 0x7f36a80ba140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:59.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.545+0000 7f36ad0ad640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f36a814f370 0x7f36a80ba140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32806/0 (socket says 172.21.15.45:32806) 2023-10-03T19:17:59.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.545+0000 7f36ad0ad640 1 -- 172.21.15.45:0/2969243026 learned_addr learned my addr 172.21.15.45:0/2969243026 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:59.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.545+0000 7f36ad8ae640 1 --2- 172.21.15.45:0/2969243026 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36a8070d80 0x7f36a81591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:59.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.545+0000 7f36ad0ad640 1 -- 172.21.15.45:0/2969243026 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36a8070d80 msgr2=0x7f36a81591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:59.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.545+0000 7f36ad0ad640 1 --2- 172.21.15.45:0/2969243026 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36a8070d80 0x7f36a81591b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.545+0000 7f36ad0ad640 1 -- 172.21.15.45:0/2969243026 >> v1:172.21.15.79:6789/0 conn(0x7f36a80ba680 legacy=0x7f36a81524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:59.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.545+0000 7f36ad0ad640 1 -- 172.21.15.45:0/2969243026 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a814f740 con 0x7f36a814f370 2023-10-03T19:17:59.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.545+0000 7f36ad8ae640 1 --2- 172.21.15.45:0/2969243026 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36a8070d80 0x7f36a81591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:17:59.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.549+0000 7f36ad0ad640 1 --2- 172.21.15.45:0/2969243026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36a814f370 0x7f36a80ba140 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f36a4009870 tx=0x7f36a401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9343fa84dadadc0c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:59.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.549+0000 7f369ffff640 1 -- 172.21.15.45:0/2969243026 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a40a8a30 con 0x7f36a814f370 2023-10-03T19:17:59.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.549+0000 7f369ffff640 1 -- 172.21.15.45:0/2969243026 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a40a8b90 con 0x7f36a814f370 2023-10-03T19:17:59.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.549+0000 7f369ffff640 1 -- 172.21.15.45:0/2969243026 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a40b0440 con 0x7f36a814f370 2023-10-03T19:17:59.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.549+0000 7f36af311640 1 -- 172.21.15.45:0/2969243026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36a814f370 msgr2=0x7f36a80ba140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:59.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.549+0000 7f36af311640 1 --2- 172.21.15.45:0/2969243026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36a814f370 0x7f36a80ba140 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f36a4009870 tx=0x7f36a401ed30 comp rx=0 tx=0).stop 2023-10-03T19:17:59.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.549+0000 7f36af311640 1 -- 172.21.15.45:0/2969243026 shutdown_connections 2023-10-03T19:17:59.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.549+0000 7f36af311640 1 --2- 172.21.15.45:0/2969243026 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36a8070d80 0x7f36a81591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.549+0000 7f36af311640 1 --2- 172.21.15.45:0/2969243026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36a814f370 0x7f36a80ba140 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.549+0000 7f36af311640 1 -- 172.21.15.45:0/2969243026 >> 172.21.15.45:0/2969243026 conn(0x7f36a80c0d00 msgr2=0x7f36a80c1100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:59.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.549+0000 7f36af311640 1 -- 172.21.15.45:0/2969243026 shutdown_connections 2023-10-03T19:17:59.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.549+0000 7f36af311640 1 -- 172.21.15.45:0/2969243026 wait complete. 2023-10-03T19:17:59.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.549+0000 7f36af311640 1 Processor -- start 2023-10-03T19:17:59.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.549+0000 7f36af311640 1 -- start start 2023-10-03T19:17:59.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.549+0000 7f36af311640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36a8070d80 0x7f36a81e4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:59.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.549+0000 7f36af311640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36a80ba680 0x7f36a80a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:59.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.549+0000 7f36af311640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36a814f370 0x7f36a8148ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:59.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.549+0000 7f36af311640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a814afa0 con 0x7f36a814f370 2023-10-03T19:17:59.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.549+0000 7f36af311640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a8143eb0 con 0x7f36a80ba680 2023-10-03T19:17:59.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.549+0000 7f36af311640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a81443c0 con 0x7f36a8070d80 2023-10-03T19:17:59.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.549+0000 7f36ad8ae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36a814f370 0x7f36a8148ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:59.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.549+0000 7f36ac8ac640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36a80ba680 0x7f36a80a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:59.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.549+0000 7f36ad0ad640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36a8070d80 0x7f36a81e4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:59.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.549+0000 7f36ad8ae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36a814f370 0x7f36a8148ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32810/0 (socket says 172.21.15.45:32810) 2023-10-03T19:17:59.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.549+0000 7f36ac8ac640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36a80ba680 0x7f36a80a63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:37380/0 (socket says 172.21.15.45:37380) 2023-10-03T19:17:59.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.549+0000 7f36ad0ad640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36a8070d80 0x7f36a81e4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:32954/0 (socket says 172.21.15.45:32954) 2023-10-03T19:17:59.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.549+0000 7f36ad8ae640 1 -- 172.21.15.45:0/218689581 learned_addr learned my addr 172.21.15.45:0/218689581 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:59.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.553+0000 7f36ad8ae640 1 -- 172.21.15.45:0/218689581 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36a8070d80 msgr2=0x7f36a81e4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:59.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.553+0000 7f36ad8ae640 1 --2- 172.21.15.45:0/218689581 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36a8070d80 0x7f36a81e4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.553+0000 7f36ad8ae640 1 -- 172.21.15.45:0/218689581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36a80ba680 msgr2=0x7f36a80a63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:59.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.553+0000 7f36ad8ae640 1 --2- 172.21.15.45:0/218689581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36a80ba680 0x7f36a80a63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.553+0000 7f36ad8ae640 1 -- 172.21.15.45:0/218689581 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a40094d0 con 0x7f36a814f370 2023-10-03T19:17:59.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.553+0000 7f36ad8ae640 1 --2- 172.21.15.45:0/218689581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36a814f370 0x7f36a8148ec0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f36a000cdb0 tx=0x7f36a000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:59.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.553+0000 7f369dffb640 1 -- 172.21.15.45:0/218689581 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a000f680 con 0x7f36a814f370 2023-10-03T19:17:59.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.553+0000 7f369dffb640 1 -- 172.21.15.45:0/218689581 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a000f800 con 0x7f36a814f370 2023-10-03T19:17:59.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.553+0000 7f369dffb640 1 -- 172.21.15.45:0/218689581 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a000fbb0 con 0x7f36a814f370 2023-10-03T19:17:59.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.553+0000 7f36af311640 1 -- 172.21.15.45:0/218689581 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a8152d60 con 0x7f36a814f370 2023-10-03T19:17:59.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.553+0000 7f36af311640 1 -- 172.21.15.45:0/218689581 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a8152bd0 con 0x7f36a814f370 2023-10-03T19:17:59.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.553+0000 7f369dffb640 1 -- 172.21.15.45:0/218689581 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f36a000b040 con 0x7f36a814f370 2023-10-03T19:17:59.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.553+0000 7f369dffb640 1 --2- 172.21.15.45:0/218689581 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f368c0662b0 0x7f368c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:59.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.553+0000 7f369dffb640 1 -- 172.21.15.45:0/218689581 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f36a0084670 con 0x7f36a814f370 2023-10-03T19:17:59.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.553+0000 7f36ad0ad640 1 --2- 172.21.15.45:0/218689581 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f368c0662b0 0x7f368c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:59.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36b2435000 1 Processor -- start 2023-10-03T19:17:59.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36b2435000 1 -- start start 2023-10-03T19:17:59.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36ad0ad640 1 --2- 172.21.15.45:0/218689581 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f368c0662b0 0x7f368c068760 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f36a40b2000 tx=0x7f36a4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:59.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36b2435000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7a75db40 0x558a7a723b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:59.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36b2435000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a7a75df10 0x558a7a7240c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:59.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36b2435000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x558a7a724600 0x558a7a7249d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:59.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36b2435000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7a52da60 con 0x558a7a75df10 2023-10-03T19:17:59.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36b2435000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7a528cc0 con 0x558a7a75db40 2023-10-03T19:17:59.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36b2435000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a7a57be00 con 0x558a7a724600 2023-10-03T19:17:59.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36ac8ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a7a75df10 0x558a7a7240c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:59.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36ac8ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a7a75df10 0x558a7a7240c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32812/0 (socket says 172.21.15.45:32812) 2023-10-03T19:17:59.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36ac8ac640 1 -- 172.21.15.45:0/508521849 learned_addr learned my addr 172.21.15.45:0/508521849 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:59.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36ad0ad640 1 --2- 172.21.15.45:0/508521849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7a75db40 0x558a7a723b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:59.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36ad8ae640 1 --2- 172.21.15.45:0/508521849 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x558a7a724600 0x558a7a7249d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:59.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36ac8ac640 1 -- 172.21.15.45:0/508521849 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x558a7a724600 msgr2=0x558a7a7249d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:59.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36ac8ac640 1 --2- 172.21.15.45:0/508521849 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x558a7a724600 0x558a7a7249d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36ac8ac640 1 -- 172.21.15.45:0/508521849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7a75db40 msgr2=0x558a7a723b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:59.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36ac8ac640 1 --2- 172.21.15.45:0/508521849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7a75db40 0x558a7a723b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36ac8ac640 1 -- 172.21.15.45:0/508521849 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a7a539f30 con 0x558a7a75df10 2023-10-03T19:17:59.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36ac8ac640 1 --2- 172.21.15.45:0/508521849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a7a75df10 0x558a7a7240c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f36980016a0 tx=0x7f3698007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824aabfbdf99ba63 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:59.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f368affd640 1 -- 172.21.15.45:0/508521849 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3698001d40 con 0x558a7a75df10 2023-10-03T19:17:59.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f368affd640 1 -- 172.21.15.45:0/508521849 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36980052e0 con 0x558a7a75df10 2023-10-03T19:17:59.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f368affd640 1 -- 172.21.15.45:0/508521849 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369800f7b0 con 0x558a7a75df10 2023-10-03T19:17:59.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36b2435000 1 -- 172.21.15.45:0/508521849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a7a75df10 msgr2=0x558a7a7240c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:59.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36b2435000 1 --2- 172.21.15.45:0/508521849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a7a75df10 0x558a7a7240c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f36980016a0 tx=0x7f3698007e40 comp rx=0 tx=0).stop 2023-10-03T19:17:59.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36b2435000 1 -- 172.21.15.45:0/508521849 shutdown_connections 2023-10-03T19:17:59.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36b2435000 1 --2- 172.21.15.45:0/508521849 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x558a7a724600 0x558a7a7249d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36b2435000 1 --2- 172.21.15.45:0/508521849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a7a75df10 0x558a7a7240c0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36b2435000 1 --2- 172.21.15.45:0/508521849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7a75db40 0x558a7a723b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36b2435000 1 -- 172.21.15.45:0/508521849 >> 172.21.15.45:0/508521849 conn(0x558a7a58c820 msgr2=0x558a7a72d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:59.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36b2435000 1 -- 172.21.15.45:0/508521849 shutdown_connections 2023-10-03T19:17:59.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36b2435000 1 -- 172.21.15.45:0/508521849 wait complete. 2023-10-03T19:17:59.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36b2435000 1 -- start start 2023-10-03T19:17:59.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.557+0000 7f36b2435000 1 Processor -- start 2023-10-03T19:17:59.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36b2435000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a7a724600 0x558a7a729270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:59.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36b2435000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7a75db40 0x558a7a7297b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:59.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36b2435000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x558a7a75df10 0x558a7a729cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:59.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36b2435000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7a574ea0 con 0x558a7a724600 2023-10-03T19:17:59.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36b2435000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7a531f40 con 0x558a7a75db40 2023-10-03T19:17:59.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36b2435000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a7a531be0 con 0x558a7a75df10 2023-10-03T19:17:59.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36b2435000 10 client.0 _ll_register_callbacks cb 0x558a7a7133c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T19:17:59.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36ad0ad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a7a724600 0x558a7a729270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:59.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36ad0ad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a7a724600 0x558a7a729270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32824/0 (socket says 172.21.15.45:32824) 2023-10-03T19:17:59.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36ad0ad640 1 -- 172.21.15.45:0/1720679260 learned_addr learned my addr 172.21.15.45:0/1720679260 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:59.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36ac8ac640 1 --2- 172.21.15.45:0/1720679260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7a75db40 0x558a7a7297b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:59.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36ad8ae640 1 --2- 172.21.15.45:0/1720679260 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x558a7a75df10 0x558a7a729cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:59.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36ad0ad640 1 -- 172.21.15.45:0/1720679260 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x558a7a75df10 msgr2=0x558a7a729cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:59.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36ad0ad640 1 --2- 172.21.15.45:0/1720679260 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x558a7a75df10 0x558a7a729cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36ad0ad640 1 -- 172.21.15.45:0/1720679260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7a75db40 msgr2=0x558a7a7297b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:59.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36ad0ad640 1 --2- 172.21.15.45:0/1720679260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7a75db40 0x558a7a7297b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36ad0ad640 1 -- 172.21.15.45:0/1720679260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a80714d0 con 0x558a7a724600 2023-10-03T19:17:59.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36ad0ad640 1 --2- 172.21.15.45:0/1720679260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a7a724600 0x558a7a729270 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f36a40090b0 tx=0x7f36a40046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=946496f6de566c28 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:59.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f3683fff640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-10-03T19:17:59.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f3683fff640 1 -- 172.21.15.45:0/1720679260 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a40ca070 con 0x558a7a724600 2023-10-03T19:17:59.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f3683fff640 1 -- 172.21.15.45:0/1720679260 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f36a40bb420 con 0x558a7a724600 2023-10-03T19:17:59.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36b2435000 1 -- 172.21.15.45:0/1720679260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a7a57d5e0 con 0x558a7a724600 2023-10-03T19:17:59.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f3683fff640 1 -- 172.21.15.45:0/1720679260 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36a40c0040 con 0x558a7a724600 2023-10-03T19:17:59.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36b2435000 10 client.6528 fetch_fsmap learned FSMap version 36 2023-10-03T19:17:59.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36b2435000 1 -- 172.21.15.45:0/1720679260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x558a7a271a80 con 0x558a7a724600 2023-10-03T19:17:59.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f3683fff640 1 -- 172.21.15.45:0/1720679260 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558a7a57d5e0 con 0x558a7a724600 2023-10-03T19:17:59.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f3683fff640 1 -- 172.21.15.45:0/1720679260 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 36) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f36a40c3030 con 0x558a7a724600 2023-10-03T19:17:59.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36b2435000 10 client.6528 fetch_fsmap finished waiting for FSMap version 36 2023-10-03T19:17:59.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36b2435000 10 client.6528 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2023-10-03T19:17:59.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36b2435000 20 client.6528 populate_metadata read hostname 'smithi045' 2023-10-03T19:17:59.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36b2435000 1 --2- 172.21.15.45:0/1720679260 >> [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] conn(0x558a7a773780 0x558a7a775b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:59.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36b2435000 4 client.6528 mds_command: new command op to 6342 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-03T19:17:59.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36b2435000 1 -- 172.21.15.45:0/1720679260 --> [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558a7a531650 con 0x558a7a773780 2023-10-03T19:17:59.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36ac8ac640 1 --2- 172.21.15.45:0/1720679260 >> [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] conn(0x558a7a773780 0x558a7a775b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:59.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f3683fff640 10 client.6528 ms_handle_connect on v2:172.21.15.45:6833/2939002026 2023-10-03T19:17:59.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36ac8ac640 1 --2- 172.21.15.45:0/1720679260 >> [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] conn(0x558a7a773780 0x558a7a775b60 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=929716d5b05e3c1f server_cookie=88b3c38181041fb3 in_seq=0 out_seq=0 2023-10-03T19:17:59.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f3683fff640 1 -- 172.21.15.45:0/1720679260 <== mds.0 v2:172.21.15.45:6833/2939002026 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x558a7a531650 con 0x558a7a773780 2023-10-03T19:17:59.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f3683fff640 10 client.6528 handle_command_reply: tid=0 2023-10-03T19:17:59.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36b2435000 1 client.6528 shutdown 2023-10-03T19:17:59.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36b2435000 1 -- 172.21.15.45:0/1720679260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a7a724600 msgr2=0x558a7a729270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:59.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36b2435000 1 --2- 172.21.15.45:0/1720679260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a7a724600 0x558a7a729270 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f36a40090b0 tx=0x7f36a40046d0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36b2435000 1 -- 172.21.15.45:0/1720679260 shutdown_connections 2023-10-03T19:17:59.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36b2435000 1 --2- 172.21.15.45:0/1720679260 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x558a7a75df10 0x558a7a729cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36b2435000 1 --2- 172.21.15.45:0/1720679260 >> [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] conn(0x558a7a773780 0x558a7a775b60 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36b2435000 1 --2- 172.21.15.45:0/1720679260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7a75db40 0x558a7a7297b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36b2435000 1 --2- 172.21.15.45:0/1720679260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a7a724600 0x558a7a729270 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f3683fff640 0 client.6528 ms_handle_reset on v2:172.21.15.45:6833/2939002026 2023-10-03T19:17:59.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36b2435000 1 -- 172.21.15.45:0/1720679260 >> 172.21.15.45:0/1720679260 conn(0x558a7a58c820 msgr2=0x558a7a723b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:59.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36b2435000 1 -- 172.21.15.45:0/1720679260 shutdown_connections 2023-10-03T19:17:59.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36b2435000 1 -- 172.21.15.45:0/1720679260 wait complete. 2023-10-03T19:17:59.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.561+0000 7f36b2435000 20 client.6528 trim_cache size 0 max 16384 2023-10-03T19:17:59.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.573+0000 7f36b2435000 1 Processor -- start 2023-10-03T19:17:59.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.573+0000 7f36b2435000 1 -- start start 2023-10-03T19:17:59.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.573+0000 7f36b2435000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7a724600 0x558a7a7259e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:59.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.573+0000 7f36b2435000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a7a75db40 0x558a7a7c1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:59.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.573+0000 7f36b2435000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x558a7a75df10 0x558a7a7c38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:59.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.573+0000 7f36b2435000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7a232b30 con 0x558a7a75db40 2023-10-03T19:17:59.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.573+0000 7f36b2435000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7a5444a0 con 0x558a7a724600 2023-10-03T19:17:59.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.573+0000 7f36b2435000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a7a72e2c0 con 0x558a7a75df10 2023-10-03T19:17:59.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.573+0000 7f36ac8ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a7a75db40 0x558a7a7c1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:59.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.573+0000 7f36ac8ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a7a75db40 0x558a7a7c1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32832/0 (socket says 172.21.15.45:32832) 2023-10-03T19:17:59.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.573+0000 7f36ac8ac640 1 -- 172.21.15.45:0/146322752 learned_addr learned my addr 172.21.15.45:0/146322752 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:59.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.573+0000 7f36ac8ac640 1 -- 172.21.15.45:0/146322752 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x558a7a75df10 msgr2=0x558a7a7c38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:59.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.573+0000 7f36ac8ac640 1 --2- 172.21.15.45:0/146322752 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x558a7a75df10 0x558a7a7c38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.573+0000 7f36ac8ac640 1 -- 172.21.15.45:0/146322752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7a724600 msgr2=0x558a7a7259e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:59.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.573+0000 7f36ac8ac640 1 --2- 172.21.15.45:0/146322752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7a724600 0x558a7a7259e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.573+0000 7f36ac8ac640 1 -- 172.21.15.45:0/146322752 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a7a53a1e0 con 0x558a7a75db40 2023-10-03T19:17:59.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.573+0000 7f36ac8ac640 1 --2- 172.21.15.45:0/146322752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a7a75db40 0x558a7a7c1380 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f3698001060 tx=0x7f3698005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ed5910272f1fc91 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:59.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.573+0000 7f368b7fe640 1 -- 172.21.15.45:0/146322752 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369802a070 con 0x558a7a75db40 2023-10-03T19:17:59.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.573+0000 7f368b7fe640 1 -- 172.21.15.45:0/146322752 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36980054a0 con 0x558a7a75db40 2023-10-03T19:17:59.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.573+0000 7f368b7fe640 1 -- 172.21.15.45:0/146322752 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3698025070 con 0x558a7a75db40 2023-10-03T19:17:59.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.573+0000 7f36b2435000 1 -- 172.21.15.45:0/146322752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a7a75db40 msgr2=0x558a7a7c1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:17:59.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.573+0000 7f36b2435000 1 --2- 172.21.15.45:0/146322752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a7a75db40 0x558a7a7c1380 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f3698001060 tx=0x7f3698005000 comp rx=0 tx=0).stop 2023-10-03T19:17:59.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.573+0000 7f36b2435000 1 -- 172.21.15.45:0/146322752 shutdown_connections 2023-10-03T19:17:59.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.573+0000 7f36b2435000 1 --2- 172.21.15.45:0/146322752 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x558a7a75df10 0x558a7a7c38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.573+0000 7f36b2435000 1 --2- 172.21.15.45:0/146322752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a7a75db40 0x558a7a7c1380 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.573+0000 7f36b2435000 1 --2- 172.21.15.45:0/146322752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7a724600 0x558a7a7259e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.573+0000 7f36b2435000 1 -- 172.21.15.45:0/146322752 >> 172.21.15.45:0/146322752 conn(0x558a7a58c820 msgr2=0x558a7a72caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:17:59.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.573+0000 7f36b2435000 1 -- 172.21.15.45:0/146322752 shutdown_connections 2023-10-03T19:17:59.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.573+0000 7f36b2435000 1 -- 172.21.15.45:0/146322752 wait complete. 2023-10-03T19:17:59.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36b2435000 1 -- start start 2023-10-03T19:17:59.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36b2435000 1 Processor -- start 2023-10-03T19:17:59.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36b2435000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7a724600 0x558a7a7c2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:59.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36b2435000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a7a75db40 0x558a7a7c2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:59.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36b2435000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x558a7a75df10 0x558a7a78a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:59.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36b2435000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7a5b9150 con 0x558a7a75db40 2023-10-03T19:17:59.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36b2435000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7a57d090 con 0x558a7a724600 2023-10-03T19:17:59.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36b2435000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a7a570810 con 0x558a7a75df10 2023-10-03T19:17:59.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36b2435000 10 client.0 _ll_register_callbacks cb 0x558a7a6300e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T19:17:59.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36ac8ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a7a75db40 0x558a7a7c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:59.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36ac8ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a7a75db40 0x558a7a7c2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32836/0 (socket says 172.21.15.45:32836) 2023-10-03T19:17:59.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36ac8ac640 1 -- 172.21.15.45:0/3512836594 learned_addr learned my addr 172.21.15.45:0/3512836594 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:17:59.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36ad0ad640 1 --2- 172.21.15.45:0/3512836594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7a724600 0x558a7a7c2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:59.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36ad8ae640 1 --2- 172.21.15.45:0/3512836594 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x558a7a75df10 0x558a7a78a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:59.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36ac8ac640 1 -- 172.21.15.45:0/3512836594 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x558a7a75df10 msgr2=0x558a7a78a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:59.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36ac8ac640 1 --2- 172.21.15.45:0/3512836594 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x558a7a75df10 0x558a7a78a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36ac8ac640 1 -- 172.21.15.45:0/3512836594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7a724600 msgr2=0x558a7a7c2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:17:59.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36ac8ac640 1 --2- 172.21.15.45:0/3512836594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7a724600 0x558a7a7c2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:17:59.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36ac8ac640 1 -- 172.21.15.45:0/3512836594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558a7a539f30 con 0x558a7a75db40 2023-10-03T19:17:59.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36ac8ac640 1 --2- 172.21.15.45:0/3512836594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a7a75db40 0x558a7a7c2680 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f3698001060 tx=0x7f3698000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c23b1067de7b0c23 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:17:59.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f3683fff640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-10-03T19:17:59.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f3683fff640 1 -- 172.21.15.45:0/3512836594 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3698025070 con 0x558a7a75db40 2023-10-03T19:17:59.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f3683fff640 1 -- 172.21.15.45:0/3512836594 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3698026460 con 0x558a7a75db40 2023-10-03T19:17:59.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36b2435000 1 -- 172.21.15.45:0/3512836594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a7a578140 con 0x558a7a75db40 2023-10-03T19:17:59.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f3683fff640 1 -- 172.21.15.45:0/3512836594 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f369802a040 con 0x558a7a75db40 2023-10-03T19:17:59.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36b2435000 10 client.6534 fetch_fsmap learned FSMap version 36 2023-10-03T19:17:59.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36b2435000 1 -- 172.21.15.45:0/3512836594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x558a7a51fa60 con 0x558a7a75db40 2023-10-03T19:17:59.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f3683fff640 1 -- 172.21.15.45:0/3512836594 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558a7a578140 con 0x558a7a75db40 2023-10-03T19:17:59.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f3683fff640 1 -- 172.21.15.45:0/3512836594 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 36) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f3698012070 con 0x558a7a75db40 2023-10-03T19:17:59.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36b2435000 10 client.6534 fetch_fsmap finished waiting for FSMap version 36 2023-10-03T19:17:59.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36b2435000 10 client.6534 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2023-10-03T19:17:59.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36b2435000 20 client.6534 populate_metadata read hostname 'smithi045' 2023-10-03T19:17:59.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36b2435000 1 --2- 172.21.15.45:0/3512836594 >> [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] conn(0x558a7a78aa50 0x558a7a78ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:17:59.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36b2435000 4 client.6534 mds_command: new command op to 6342 tid=0[{"prefix": "cache drop", "timeout": 10}] 2023-10-03T19:17:59.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36b2435000 1 -- 172.21.15.45:0/3512836594 --> [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] -- command(tid 0: {"prefix": "cache drop", "timeout": 10}) v1 -- 0x558a7a56de80 con 0x558a7a78aa50 2023-10-03T19:17:59.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36ad0ad640 1 --2- 172.21.15.45:0/3512836594 >> [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] conn(0x558a7a78aa50 0x558a7a78ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:17:59.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f3683fff640 10 client.6534 ms_handle_connect on v2:172.21.15.45:6833/2939002026 2023-10-03T19:17:59.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:17:59.577+0000 7f36ad0ad640 1 --2- 172.21.15.45:0/3512836594 >> [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] conn(0x558a7a78aa50 0x558a7a78ae20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebe629be77e850ad server_cookie=84281af1b963b169 in_seq=0 out_seq=0 2023-10-03T19:18:02.950 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:18:02.965 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:18:02.981 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:18:03.003 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:18:09.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:09.861+0000 7f3683fff640 1 -- 172.21.15.45:0/3512836594 <== mds.0 v2:172.21.15.45:6833/2939002026 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+400 (crc 0 0 0) 0x558a7a56de80 con 0x558a7a78aa50 2023-10-03T19:18:09.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:09.861+0000 7f3683fff640 10 client.6534 handle_command_reply: tid=0 2023-10-03T19:18:09.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:09.861+0000 7f36b2435000 1 client.6534 shutdown 2023-10-03T19:18:09.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:09.865+0000 7f36b2435000 1 -- 172.21.15.45:0/3512836594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a7a75db40 msgr2=0x558a7a7c2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:09.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:09.865+0000 7f36b2435000 1 --2- 172.21.15.45:0/3512836594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a7a75db40 0x558a7a7c2680 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f3698001060 tx=0x7f3698000ee0 comp rx=0 tx=0).stop 2023-10-03T19:18:09.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:09.865+0000 7f36b2435000 1 -- 172.21.15.45:0/3512836594 shutdown_connections 2023-10-03T19:18:09.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:09.865+0000 7f36b2435000 1 --2- 172.21.15.45:0/3512836594 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x558a7a75df10 0x558a7a78a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:09.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:09.865+0000 7f36b2435000 1 --2- 172.21.15.45:0/3512836594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558a7a75db40 0x558a7a7c2680 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:09.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:09.865+0000 7f36b2435000 1 --2- 172.21.15.45:0/3512836594 >> [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] conn(0x558a7a78aa50 0x558a7a78ae20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:09.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:09.865+0000 7f36b2435000 1 --2- 172.21.15.45:0/3512836594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7a724600 0x558a7a7c2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:09.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:09.865+0000 7f3683fff640 0 client.6534 ms_handle_reset on v2:172.21.15.45:6833/2939002026 2023-10-03T19:18:09.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:09.865+0000 7f36b2435000 1 -- 172.21.15.45:0/3512836594 >> 172.21.15.45:0/3512836594 conn(0x558a7a58c820 msgr2=0x558a7a7249d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:09.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:09.865+0000 7f36b2435000 1 -- 172.21.15.45:0/3512836594 shutdown_connections 2023-10-03T19:18:09.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:09.865+0000 7f36b2435000 1 -- 172.21.15.45:0/3512836594 wait complete. 2023-10-03T19:18:09.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:09.865+0000 7f36b2435000 20 client.6534 trim_cache size 0 max 16384 2023-10-03T19:18:09.868 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-03T19:18:09.868 INFO:teuthology.orchestra.run.smithi045.stdout: "client_recall": { 2023-10-03T19:18:09.868 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": -110, 2023-10-03T19:18:09.868 INFO:teuthology.orchestra.run.smithi045.stdout: "message": "(110) Connection timed out", 2023-10-03T19:18:09.868 INFO:teuthology.orchestra.run.smithi045.stdout: "recalled": 240 2023-10-03T19:18:09.868 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:18:09.869 INFO:teuthology.orchestra.run.smithi045.stdout: "flush_journal": { 2023-10-03T19:18:09.869 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2023-10-03T19:18:09.869 INFO:teuthology.orchestra.run.smithi045.stdout: "message": "" 2023-10-03T19:18:09.869 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:18:09.869 INFO:teuthology.orchestra.run.smithi045.stdout: "trim_cache": { 2023-10-03T19:18:09.869 INFO:teuthology.orchestra.run.smithi045.stdout: "trimmed": 100 2023-10-03T19:18:09.869 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:18:09.869 INFO:teuthology.orchestra.run.smithi045.stdout: "cache": { 2023-10-03T19:18:09.869 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": { 2023-10-03T19:18:09.869 INFO:teuthology.orchestra.run.smithi045.stdout: "items": 18240, 2023-10-03T19:18:09.869 INFO:teuthology.orchestra.run.smithi045.stdout: "bytes": 2900520 2023-10-03T19:18:09.870 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:18:09.870 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:18:09.870 INFO:teuthology.orchestra.run.smithi045.stdout: "duration": 10.284735589 2023-10-03T19:18:09.870 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-03T19:18:09.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:09.865+0000 7f36af311640 1 -- 172.21.15.45:0/218689581 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f368c0662b0 msgr2=0x7f368c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:09.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:09.865+0000 7f36af311640 1 --2- 172.21.15.45:0/218689581 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f368c0662b0 0x7f368c068760 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f36a40b2000 tx=0x7f36a4009040 comp rx=0 tx=0).stop 2023-10-03T19:18:09.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:09.865+0000 7f36af311640 1 -- 172.21.15.45:0/218689581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36a814f370 msgr2=0x7f36a8148ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:09.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:09.865+0000 7f36af311640 1 --2- 172.21.15.45:0/218689581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36a814f370 0x7f36a8148ec0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f36a000cdb0 tx=0x7f36a000a650 comp rx=0 tx=0).stop 2023-10-03T19:18:09.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:09.865+0000 7f36af311640 1 -- 172.21.15.45:0/218689581 shutdown_connections 2023-10-03T19:18:09.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:09.865+0000 7f36af311640 1 --2- 172.21.15.45:0/218689581 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f368c0662b0 0x7f368c068760 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:09.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:09.865+0000 7f36af311640 1 --2- 172.21.15.45:0/218689581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36a814f370 0x7f36a8148ec0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:09.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:09.865+0000 7f36af311640 1 --2- 172.21.15.45:0/218689581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36a80ba680 0x7f36a80a63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:09.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:09.865+0000 7f36af311640 1 --2- 172.21.15.45:0/218689581 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36a8070d80 0x7f36a81e4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:09.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:09.865+0000 7f36af311640 1 -- 172.21.15.45:0/218689581 >> 172.21.15.45:0/218689581 conn(0x7f36a80c0d00 msgr2=0x7f36a81483b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:09.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:09.865+0000 7f36af311640 1 -- 172.21.15.45:0/218689581 shutdown_connections 2023-10-03T19:18:09.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:09.865+0000 7f36af311640 1 -- 172.21.15.45:0/218689581 wait complete. 2023-10-03T19:18:09.886 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-03T19:18:09.886 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:18:09.927 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:18:09.970 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:18:10.015 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:18:10.090 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-03T19:18:10.090 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:18:10.090 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:18:10.096 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:18:10.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.225+0000 7fe09de72640 1 Processor -- start 2023-10-03T19:18:10.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe09de72640 1 -- start start 2023-10-03T19:18:10.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe09de72640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe0980bcb80 0x7fe0980bc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:10.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe09de72640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe098071750 0x7fe09814b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:10.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe09de72640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0980bd220 con 0x7fe098071380 2023-10-03T19:18:10.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe09de72640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe09814f860 con 0x7fe0980bcb80 2023-10-03T19:18:10.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe09de72640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe098071cf0 con 0x7fe098071750 2023-10-03T19:18:10.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe0977fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe098071380 0x7fe098152850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60950/0 (socket says 172.21.15.45:60950) 2023-10-03T19:18:10.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe0977fe640 1 -- 172.21.15.45:0/3129304528 learned_addr learned my addr 172.21.15.45:0/3129304528 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:18:10.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe097fff640 1 --2- 172.21.15.45:0/3129304528 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe098071750 0x7fe09814b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:10.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe096ffd640 1 --2- 172.21.15.45:0/3129304528 >> v2:172.21.15.79:3300/0 conn(0x7fe0980bcb80 0x7fe0980bc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:10.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe0967fc640 1 -- 172.21.15.45:0/3129304528 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2046548765 0 0) 0x7fe0980bd220 con 0x7fe098071380 2023-10-03T19:18:10.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe0967fc640 1 -- 172.21.15.45:0/3129304528 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe078003530 con 0x7fe098071380 2023-10-03T19:18:10.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe0967fc640 1 -- 172.21.15.45:0/3129304528 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2396595553 0 0) 0x7fe078003530 con 0x7fe098071380 2023-10-03T19:18:10.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe0967fc640 1 -- 172.21.15.45:0/3129304528 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe098071750 msgr2=0x7fe09814b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:10.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe0967fc640 1 --2- 172.21.15.45:0/3129304528 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe098071750 0x7fe09814b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:10.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe0967fc640 1 -- 172.21.15.45:0/3129304528 >> v2:172.21.15.79:3300/0 conn(0x7fe0980bcb80 msgr2=0x7fe0980bc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:10.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe0967fc640 1 --2- 172.21.15.45:0/3129304528 >> v2:172.21.15.79:3300/0 conn(0x7fe0980bcb80 0x7fe0980bc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:10.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe0967fc640 1 -- 172.21.15.45:0/3129304528 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0980a7b50 con 0x7fe098071380 2023-10-03T19:18:10.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe0967fc640 1 -- 172.21.15.45:0/3129304528 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fe0800016a0 con 0x7fe098071380 2023-10-03T19:18:10.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe0967fc640 1 -- 172.21.15.45:0/3129304528 >> v1:172.21.15.45:6789/0 conn(0x7fe098071380 legacy=0x7fe098152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:10.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe0967fc640 1 --2- 172.21.15.45:0/3129304528 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe098071750 0x7fe078003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:10.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe0967fc640 1 --2- 172.21.15.45:0/3129304528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe078003f00 0x7fe0780047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:10.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe0967fc640 1 --2- 172.21.15.45:0/3129304528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe078004d10 0x7fe078005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:10.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe0967fc640 1 -- 172.21.15.45:0/3129304528 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09814f860 con 0x7fe078003f00 2023-10-03T19:18:10.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe0967fc640 1 -- 172.21.15.45:0/3129304528 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe098071cf0 con 0x7fe078004d10 2023-10-03T19:18:10.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe0967fc640 1 -- 172.21.15.45:0/3129304528 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07800b990 con 0x7fe098071750 2023-10-03T19:18:10.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe096ffd640 1 --2- 172.21.15.45:0/3129304528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe078003f00 0x7fe0780047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:10.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe0977fe640 1 --2- 172.21.15.45:0/3129304528 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe098071750 0x7fe078003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:10.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe097fff640 1 --2- 172.21.15.45:0/3129304528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe078004d10 0x7fe078005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:10.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe096ffd640 1 -- 172.21.15.45:0/3129304528 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe098071750 msgr2=0x7fe078003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:10.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe096ffd640 1 --2- 172.21.15.45:0/3129304528 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe098071750 0x7fe078003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:10.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe096ffd640 1 -- 172.21.15.45:0/3129304528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe078004d10 msgr2=0x7fe078005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:10.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe096ffd640 1 --2- 172.21.15.45:0/3129304528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe078004d10 0x7fe078005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:10.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe096ffd640 1 -- 172.21.15.45:0/3129304528 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe078003530 con 0x7fe078003f00 2023-10-03T19:18:10.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.229+0000 7fe0977fe640 1 --2- 172.21.15.45:0/3129304528 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe098071750 0x7fe078003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:10.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe096ffd640 1 --2- 172.21.15.45:0/3129304528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe078003f00 0x7fe0780047d0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fe088009f90 tx=0x7fe08801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd4debd9b839dc73 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:10.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe0967fc640 1 -- 172.21.15.45:0/3129304528 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0880a5c70 con 0x7fe078003f00 2023-10-03T19:18:10.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe0967fc640 1 -- 172.21.15.45:0/3129304528 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08800f040 con 0x7fe078003f00 2023-10-03T19:18:10.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe0967fc640 1 -- 172.21.15.45:0/3129304528 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0880ad440 con 0x7fe078003f00 2023-10-03T19:18:10.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe09de72640 1 -- 172.21.15.45:0/3129304528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe078003f00 msgr2=0x7fe0780047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:10.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe09de72640 1 --2- 172.21.15.45:0/3129304528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe078003f00 0x7fe0780047d0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fe088009f90 tx=0x7fe08801cc60 comp rx=0 tx=0).stop 2023-10-03T19:18:10.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe097fff640 1 -- 172.21.15.45:0/3129304528 reap_dead start 2023-10-03T19:18:10.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe09de72640 1 -- 172.21.15.45:0/3129304528 shutdown_connections 2023-10-03T19:18:10.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe09de72640 1 -- 172.21.15.45:0/3129304528 >> 172.21.15.45:0/3129304528 conn(0x7fe09806bce0 msgr2=0x7fe09806c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:10.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe09de72640 1 -- 172.21.15.45:0/3129304528 shutdown_connections 2023-10-03T19:18:10.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe09de72640 1 -- 172.21.15.45:0/3129304528 wait complete. 2023-10-03T19:18:10.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe09de72640 1 Processor -- start 2023-10-03T19:18:10.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe09de72640 1 -- start start 2023-10-03T19:18:10.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe09de72640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0980a4200 0x7fe09814db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:10.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe09de72640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0980a45d0 0x7fe0980c22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:10.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe09de72640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0980c2830 0x7fe098146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:10.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe09de72640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09814e750 con 0x7fe0980c2830 2023-10-03T19:18:10.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe09de72640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0981e7b20 con 0x7fe0980a4200 2023-10-03T19:18:10.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe09de72640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0980c3220 con 0x7fe0980a45d0 2023-10-03T19:18:10.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe097fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0980c2830 0x7fe098146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:10.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe097fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0980c2830 0x7fe098146500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56928/0 (socket says 172.21.15.45:56928) 2023-10-03T19:18:10.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe097fff640 1 -- 172.21.15.45:0/1271706423 learned_addr learned my addr 172.21.15.45:0/1271706423 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:10.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe0977fe640 1 --2- 172.21.15.45:0/1271706423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0980a4200 0x7fe09814db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:10.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe096ffd640 1 --2- 172.21.15.45:0/1271706423 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0980a45d0 0x7fe0980c22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:10.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe097fff640 1 -- 172.21.15.45:0/1271706423 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0980a45d0 msgr2=0x7fe0980c22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:10.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe097fff640 1 --2- 172.21.15.45:0/1271706423 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0980a45d0 0x7fe0980c22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:10.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe097fff640 1 -- 172.21.15.45:0/1271706423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0980a4200 msgr2=0x7fe09814db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:10.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe097fff640 1 --2- 172.21.15.45:0/1271706423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0980a4200 0x7fe09814db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:10.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe097fff640 1 -- 172.21.15.45:0/1271706423 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0980a1bf0 con 0x7fe0980c2830 2023-10-03T19:18:10.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe0977fe640 1 --2- 172.21.15.45:0/1271706423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0980a4200 0x7fe09814db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:18:10.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe097fff640 1 --2- 172.21.15.45:0/1271706423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0980c2830 0x7fe098146500 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fe0980bbcb0 tx=0x7fe090010790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:10.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe08ffff640 1 -- 172.21.15.45:0/1271706423 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe090010e30 con 0x7fe0980c2830 2023-10-03T19:18:10.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe08ffff640 1 -- 172.21.15.45:0/1271706423 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe090004030 con 0x7fe0980c2830 2023-10-03T19:18:10.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe09de72640 1 -- 172.21.15.45:0/1271706423 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09806b810 con 0x7fe0980c2830 2023-10-03T19:18:10.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe08ffff640 1 -- 172.21.15.45:0/1271706423 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0900043e0 con 0x7fe0980c2830 2023-10-03T19:18:10.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.233+0000 7fe09de72640 1 -- 172.21.15.45:0/1271706423 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0980a1d80 con 0x7fe0980c2830 2023-10-03T19:18:10.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.237+0000 7fe09de72640 1 -- 172.21.15.45:0/1271706423 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0981e7c60 con 0x7fe0980c2830 2023-10-03T19:18:10.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.237+0000 7fe08ffff640 1 -- 172.21.15.45:0/1271706423 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe090003620 con 0x7fe0980c2830 2023-10-03T19:18:10.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.237+0000 7fe08ffff640 1 --2- 172.21.15.45:0/1271706423 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe07c066280 0x7fe07c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:10.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.237+0000 7fe08ffff640 1 -- 172.21.15.45:0/1271706423 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe090083430 con 0x7fe0980c2830 2023-10-03T19:18:10.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.237+0000 7fe0977fe640 1 --2- 172.21.15.45:0/1271706423 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe07c066280 0x7fe07c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:10.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.237+0000 7fe0977fe640 1 --2- 172.21.15.45:0/1271706423 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe07c066280 0x7fe07c068730 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe080001850 tx=0x7fe0800016a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:10.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.241+0000 7fe08ffff640 1 -- 172.21.15.45:0/1271706423 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe0981e7c60 con 0x7fe0980c2830 2023-10-03T19:18:10.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.397+0000 7fe09de72640 1 -- 172.21.15.45:0/1271706423 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0981e7c60 con 0x7fe0980c2830 2023-10-03T19:18:10.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.397+0000 7fe08ffff640 1 -- 172.21.15.45:0/1271706423 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+18306 (secure 0 0 0) 0x7fe0981e7c60 con 0x7fe0980c2830 2023-10-03T19:18:10.402 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:18:10.402 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":74,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:17:36.500298+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:17:33.484274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-03T19:17:34.320341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:18:10.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.401+0000 7fe09de72640 1 -- 172.21.15.45:0/1271706423 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe07c066280 msgr2=0x7fe07c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:10.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.401+0000 7fe09de72640 1 --2- 172.21.15.45:0/1271706423 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe07c066280 0x7fe07c068730 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe080001850 tx=0x7fe0800016a0 comp rx=0 tx=0).stop 2023-10-03T19:18:10.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.401+0000 7fe09de72640 1 -- 172.21.15.45:0/1271706423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0980c2830 msgr2=0x7fe098146500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:10.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.401+0000 7fe09de72640 1 --2- 172.21.15.45:0/1271706423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0980c2830 0x7fe098146500 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fe0980bbcb0 tx=0x7fe090010790 comp rx=0 tx=0).stop 2023-10-03T19:18:10.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.401+0000 7fe09de72640 1 -- 172.21.15.45:0/1271706423 shutdown_connections 2023-10-03T19:18:10.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.401+0000 7fe09de72640 1 --2- 172.21.15.45:0/1271706423 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe07c066280 0x7fe07c068730 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:10.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.401+0000 7fe09de72640 1 --2- 172.21.15.45:0/1271706423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0980c2830 0x7fe098146500 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:10.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.401+0000 7fe09de72640 1 --2- 172.21.15.45:0/1271706423 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0980a45d0 0x7fe0980c22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:10.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.401+0000 7fe09de72640 1 --2- 172.21.15.45:0/1271706423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0980a4200 0x7fe09814db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:10.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.401+0000 7fe09de72640 1 -- 172.21.15.45:0/1271706423 >> 172.21.15.45:0/1271706423 conn(0x7fe09806bce0 msgr2=0x7fe098069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:10.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.401+0000 7fe09de72640 1 -- 172.21.15.45:0/1271706423 shutdown_connections 2023-10-03T19:18:10.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.401+0000 7fe09de72640 1 -- 172.21.15.45:0/1271706423 wait complete. 2023-10-03T19:18:10.421 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T19:17:33.484274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T19:17:34.320341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:18:10.422 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:18:10.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.553+0000 7f923d4b4640 1 Processor -- start 2023-10-03T19:18:10.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.553+0000 7f923d4b4640 1 -- start start 2023-10-03T19:18:10.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.553+0000 7f923d4b4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f923806d560 0x7f92380a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:10.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.553+0000 7f923d4b4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f923806c760 0x7f92380a5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:10.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.553+0000 7f923d4b4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f923806c2d0 con 0x7f92380712c0 2023-10-03T19:18:10.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.553+0000 7f923d4b4640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9238150610 con 0x7f923806d560 2023-10-03T19:18:10.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.553+0000 7f923d4b4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92381508b0 con 0x7f923806c760 2023-10-03T19:18:10.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.553+0000 7f92367fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f923806d560 0x7f92380a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:10.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.553+0000 7f92367fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f923806d560 0x7f92380a53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56944/0 (socket says 172.21.15.45:56944) 2023-10-03T19:18:10.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.553+0000 7f92367fc640 1 -- 172.21.15.45:0/2027009124 learned_addr learned my addr 172.21.15.45:0/2027009124 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:10.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.553+0000 7f92377fe640 1 --2- 172.21.15.45:0/2027009124 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f923806c760 0x7f92380a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:10.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.553+0000 7f92367fc640 1 -- 172.21.15.45:0/2027009124 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f923806c760 msgr2=0x7f92380a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:10.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.553+0000 7f92367fc640 1 --2- 172.21.15.45:0/2027009124 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f923806c760 0x7f92380a5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:10.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.553+0000 7f92367fc640 1 -- 172.21.15.45:0/2027009124 >> v1:172.21.15.79:6789/0 conn(0x7f92380712c0 legacy=0x7f92380bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:10.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.553+0000 7f92367fc640 1 -- 172.21.15.45:0/2027009124 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923806d2e0 con 0x7f923806d560 2023-10-03T19:18:10.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.553+0000 7f92367fc640 1 --2- 172.21.15.45:0/2027009124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f923806d560 0x7f92380a53c0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f9228009870 tx=0x7f922801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9dcc2f83198512c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:10.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f9235ffb640 1 -- 172.21.15.45:0/2027009124 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92280ab600 con 0x7f923806d560 2023-10-03T19:18:10.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f9235ffb640 1 -- 172.21.15.45:0/2027009124 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92280ab760 con 0x7f923806d560 2023-10-03T19:18:10.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f9235ffb640 1 -- 172.21.15.45:0/2027009124 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92280abaf0 con 0x7f923806d560 2023-10-03T19:18:10.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f923d4b4640 1 -- 172.21.15.45:0/2027009124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f923806d560 msgr2=0x7f92380a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:10.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f923d4b4640 1 --2- 172.21.15.45:0/2027009124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f923806d560 0x7f92380a53c0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f9228009870 tx=0x7f922801c500 comp rx=0 tx=0).stop 2023-10-03T19:18:10.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f923d4b4640 1 -- 172.21.15.45:0/2027009124 shutdown_connections 2023-10-03T19:18:10.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f923d4b4640 1 --2- 172.21.15.45:0/2027009124 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f923806c760 0x7f92380a5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:10.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f923d4b4640 1 --2- 172.21.15.45:0/2027009124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f923806d560 0x7f92380a53c0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:10.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f923d4b4640 1 -- 172.21.15.45:0/2027009124 >> 172.21.15.45:0/2027009124 conn(0x7f92380a20d0 msgr2=0x7f92380a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:10.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f923d4b4640 1 -- 172.21.15.45:0/2027009124 shutdown_connections 2023-10-03T19:18:10.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f923d4b4640 1 -- 172.21.15.45:0/2027009124 wait complete. 2023-10-03T19:18:10.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f923d4b4640 1 Processor -- start 2023-10-03T19:18:10.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f923d4b4640 1 -- start start 2023-10-03T19:18:10.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f923d4b4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f923806c760 0x7f923814ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:10.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f923d4b4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f923806d560 0x7f92380b99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:10.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f923d4b4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92380712c0 0x7f92381ea2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:10.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f923d4b4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92380bb400 con 0x7f923806d560 2023-10-03T19:18:10.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f923d4b4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92380b9ef0 con 0x7f923806c760 2023-10-03T19:18:10.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f923d4b4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9238070aa0 con 0x7f92380712c0 2023-10-03T19:18:10.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f92367fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f923806d560 0x7f92380b99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:10.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f92367fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f923806d560 0x7f92380b99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56958/0 (socket says 172.21.15.45:56958) 2023-10-03T19:18:10.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f92367fc640 1 -- 172.21.15.45:0/2025194780 learned_addr learned my addr 172.21.15.45:0/2025194780 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:10.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f92367fc640 1 -- 172.21.15.45:0/2025194780 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92380712c0 msgr2=0x7f92381ea2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:10.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f92367fc640 1 --2- 172.21.15.45:0/2025194780 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92380712c0 0x7f92381ea2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:10.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f92367fc640 1 -- 172.21.15.45:0/2025194780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f923806c760 msgr2=0x7f923814ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:10.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f92367fc640 1 --2- 172.21.15.45:0/2025194780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f923806c760 0x7f923814ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:10.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f92367fc640 1 -- 172.21.15.45:0/2025194780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92280094d0 con 0x7f923806d560 2023-10-03T19:18:10.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f92367fc640 1 --2- 172.21.15.45:0/2025194780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f923806d560 0x7f92380b99b0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f922801cda0 tx=0x7f922801ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:10.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f921f7fe640 1 -- 172.21.15.45:0/2025194780 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92280b4800 con 0x7f923806d560 2023-10-03T19:18:10.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f921f7fe640 1 -- 172.21.15.45:0/2025194780 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92280b4980 con 0x7f923806d560 2023-10-03T19:18:10.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f923d4b4640 1 -- 172.21.15.45:0/2025194780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92380bd460 con 0x7f923806d560 2023-10-03T19:18:10.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f921f7fe640 1 -- 172.21.15.45:0/2025194780 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92280b4d30 con 0x7f923806d560 2023-10-03T19:18:10.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.557+0000 7f923d4b4640 1 -- 172.21.15.45:0/2025194780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92380bd2d0 con 0x7f923806d560 2023-10-03T19:18:10.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.561+0000 7f923d4b4640 1 -- 172.21.15.45:0/2025194780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92381596f0 con 0x7f923806d560 2023-10-03T19:18:10.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.561+0000 7f921f7fe640 1 -- 172.21.15.45:0/2025194780 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f92280b3380 con 0x7f923806d560 2023-10-03T19:18:10.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.561+0000 7f921f7fe640 1 --2- 172.21.15.45:0/2025194780 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9224066280 0x7f9224068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:10.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.561+0000 7f921f7fe640 1 -- 172.21.15.45:0/2025194780 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f922811df40 con 0x7f923806d560 2023-10-03T19:18:10.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.561+0000 7f9236ffd640 1 --2- 172.21.15.45:0/2025194780 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9224066280 0x7f9224068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:10.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.561+0000 7f9236ffd640 1 --2- 172.21.15.45:0/2025194780 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9224066280 0x7f9224068730 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f922c009670 tx=0x7f922c006bd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:10.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.565+0000 7f921f7fe640 1 -- 172.21.15.45:0/2025194780 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f92280eb460 con 0x7f923806d560 2023-10-03T19:18:10.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.717+0000 7f923d4b4640 1 -- 172.21.15.45:0/2025194780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f92380bca30 con 0x7f923806d560 2023-10-03T19:18:10.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.721+0000 7f921f7fe640 1 -- 172.21.15.45:0/2025194780 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) v1 ==== 93+0+10 (secure 0 0 0) 0x7f92280c40a0 con 0x7f923806d560 2023-10-03T19:18:10.722 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:18:10.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.721+0000 7f923d4b4640 1 -- 172.21.15.45:0/2025194780 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9224066280 msgr2=0x7f9224068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:10.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.721+0000 7f923d4b4640 1 --2- 172.21.15.45:0/2025194780 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9224066280 0x7f9224068730 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f922c009670 tx=0x7f922c006bd0 comp rx=0 tx=0).stop 2023-10-03T19:18:10.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.721+0000 7f923d4b4640 1 -- 172.21.15.45:0/2025194780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f923806d560 msgr2=0x7f92380b99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:10.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.721+0000 7f923d4b4640 1 --2- 172.21.15.45:0/2025194780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f923806d560 0x7f92380b99b0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f922801cda0 tx=0x7f922801ad40 comp rx=0 tx=0).stop 2023-10-03T19:18:10.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.721+0000 7f923d4b4640 1 -- 172.21.15.45:0/2025194780 shutdown_connections 2023-10-03T19:18:10.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.721+0000 7f923d4b4640 1 --2- 172.21.15.45:0/2025194780 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9224066280 0x7f9224068730 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:10.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.721+0000 7f923d4b4640 1 --2- 172.21.15.45:0/2025194780 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92380712c0 0x7f92381ea2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:10.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.721+0000 7f923d4b4640 1 --2- 172.21.15.45:0/2025194780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f923806d560 0x7f92380b99b0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:10.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.721+0000 7f923d4b4640 1 --2- 172.21.15.45:0/2025194780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f923806c760 0x7f923814ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:10.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.721+0000 7f923d4b4640 1 -- 172.21.15.45:0/2025194780 >> 172.21.15.45:0/2025194780 conn(0x7f92380a20d0 msgr2=0x7f92381468b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:10.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.721+0000 7f923d4b4640 1 -- 172.21.15.45:0/2025194780 shutdown_connections 2023-10-03T19:18:10.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.721+0000 7f923d4b4640 1 -- 172.21.15.45:0/2025194780 wait complete. 2023-10-03T19:18:10.742 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:18:10.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.861+0000 7f48832ad640 1 Processor -- start 2023-10-03T19:18:10.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.861+0000 7f48832ad640 1 -- start start 2023-10-03T19:18:10.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.861+0000 7f48832ad640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f487c06d560 0x7f487c0a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:10.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.861+0000 7f48832ad640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f487c06c760 0x7f487c0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:10.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.861+0000 7f48832ad640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f487c06c2d0 con 0x7f487c0712c0 2023-10-03T19:18:10.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.861+0000 7f48832ad640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f487c150610 con 0x7f487c06c760 2023-10-03T19:18:10.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.861+0000 7f48832ad640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f487c1508b0 con 0x7f487c06d560 2023-10-03T19:18:10.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.861+0000 7f488184a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f487c06c760 0x7f487c0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:10.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.861+0000 7f488184a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f487c06c760 0x7f487c0a5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56974/0 (socket says 172.21.15.45:56974) 2023-10-03T19:18:10.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.861+0000 7f488184a640 1 -- 172.21.15.45:0/1741261682 learned_addr learned my addr 172.21.15.45:0/1741261682 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:10.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.861+0000 7f4880848640 1 --2- 172.21.15.45:0/1741261682 >> v2:172.21.15.79:3300/0 conn(0x7f487c06d560 0x7f487c0a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:10.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.861+0000 7f488184a640 1 -- 172.21.15.45:0/1741261682 >> v2:172.21.15.79:3300/0 conn(0x7f487c06d560 msgr2=0x7f487c0a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:10.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.861+0000 7f488184a640 1 --2- 172.21.15.45:0/1741261682 >> v2:172.21.15.79:3300/0 conn(0x7f487c06d560 0x7f487c0a53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:10.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.861+0000 7f488184a640 1 -- 172.21.15.45:0/1741261682 >> v1:172.21.15.79:6789/0 conn(0x7f487c0712c0 legacy=0x7f487c0bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:10.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.861+0000 7f488184a640 1 -- 172.21.15.45:0/1741261682 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c06d2e0 con 0x7f487c06c760 2023-10-03T19:18:10.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f488184a640 1 --2- 172.21.15.45:0/1741261682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f487c06c760 0x7f487c0a5900 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f487c06ba20 tx=0x7f487401c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28cc828b71ebcbf9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:10.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f4873fff640 1 -- 172.21.15.45:0/1741261682 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48740a5790 con 0x7f487c06c760 2023-10-03T19:18:10.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f4873fff640 1 -- 172.21.15.45:0/1741261682 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48740a58f0 con 0x7f487c06c760 2023-10-03T19:18:10.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f4873fff640 1 -- 172.21.15.45:0/1741261682 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48740a5c80 con 0x7f487c06c760 2023-10-03T19:18:10.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f48832ad640 1 -- 172.21.15.45:0/1741261682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f487c06c760 msgr2=0x7f487c0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:10.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f48832ad640 1 --2- 172.21.15.45:0/1741261682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f487c06c760 0x7f487c0a5900 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f487c06ba20 tx=0x7f487401c990 comp rx=0 tx=0).stop 2023-10-03T19:18:10.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f48832ad640 1 -- 172.21.15.45:0/1741261682 shutdown_connections 2023-10-03T19:18:10.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f48832ad640 1 --2- 172.21.15.45:0/1741261682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f487c06c760 0x7f487c0a5900 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:10.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f48832ad640 1 --2- 172.21.15.45:0/1741261682 >> v2:172.21.15.79:3300/0 conn(0x7f487c06d560 0x7f487c0a53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:10.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f48832ad640 1 -- 172.21.15.45:0/1741261682 >> 172.21.15.45:0/1741261682 conn(0x7f487c0a20d0 msgr2=0x7f487c0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:10.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f48832ad640 1 -- 172.21.15.45:0/1741261682 shutdown_connections 2023-10-03T19:18:10.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f48832ad640 1 -- 172.21.15.45:0/1741261682 wait complete. 2023-10-03T19:18:10.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f48832ad640 1 Processor -- start 2023-10-03T19:18:10.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f48832ad640 1 -- start start 2023-10-03T19:18:10.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f48832ad640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f487c06c760 0x7f487c146a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:10.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f48832ad640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f487c06d560 0x7f487c1e4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:10.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f48832ad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f487c0712c0 0x7f487c0b9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:10.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f48832ad640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c0b8810 con 0x7f487c0712c0 2023-10-03T19:18:10.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f48832ad640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c1e5bd0 con 0x7f487c06d560 2023-10-03T19:18:10.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f48832ad640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487c1e5610 con 0x7f487c06c760 2023-10-03T19:18:10.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f488184a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f487c0712c0 0x7f487c0b9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:10.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f488184a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f487c0712c0 0x7f487c0b9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56976/0 (socket says 172.21.15.45:56976) 2023-10-03T19:18:10.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f488184a640 1 -- 172.21.15.45:0/3120353002 learned_addr learned my addr 172.21.15.45:0/3120353002 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:10.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f4881049640 1 --2- 172.21.15.45:0/3120353002 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f487c06c760 0x7f487c146a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:10.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f4880848640 1 --2- 172.21.15.45:0/3120353002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f487c06d560 0x7f487c1e4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:10.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f488184a640 1 -- 172.21.15.45:0/3120353002 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f487c06c760 msgr2=0x7f487c146a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:10.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f488184a640 1 --2- 172.21.15.45:0/3120353002 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f487c06c760 0x7f487c146a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:10.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f488184a640 1 -- 172.21.15.45:0/3120353002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f487c06d560 msgr2=0x7f487c1e4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:10.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f488184a640 1 --2- 172.21.15.45:0/3120353002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f487c06d560 0x7f487c1e4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:10.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f488184a640 1 -- 172.21.15.45:0/3120353002 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4874009b30 con 0x7f487c0712c0 2023-10-03T19:18:10.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.865+0000 7f488184a640 1 --2- 172.21.15.45:0/3120353002 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f487c0712c0 0x7f487c0b9970 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f487401a5c0 tx=0x7f4874019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:10.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.869+0000 7f4871ffb640 1 -- 172.21.15.45:0/3120353002 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48740b8670 con 0x7f487c0712c0 2023-10-03T19:18:10.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.869+0000 7f4871ffb640 1 -- 172.21.15.45:0/3120353002 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48740b87d0 con 0x7f487c0712c0 2023-10-03T19:18:10.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.869+0000 7f48832ad640 1 -- 172.21.15.45:0/3120353002 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f487c0bd460 con 0x7f487c0712c0 2023-10-03T19:18:10.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.869+0000 7f4871ffb640 1 -- 172.21.15.45:0/3120353002 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48740b8b60 con 0x7f487c0712c0 2023-10-03T19:18:10.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.869+0000 7f48832ad640 1 -- 172.21.15.45:0/3120353002 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487c0bd2d0 con 0x7f487c0712c0 2023-10-03T19:18:10.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.869+0000 7f48832ad640 1 -- 172.21.15.45:0/3120353002 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f487c1596f0 con 0x7f487c0712c0 2023-10-03T19:18:10.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.869+0000 7f4871ffb640 1 -- 172.21.15.45:0/3120353002 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f48740b8cc0 con 0x7f487c0712c0 2023-10-03T19:18:10.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.869+0000 7f4871ffb640 1 --2- 172.21.15.45:0/3120353002 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f48600662b0 0x7f4860068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:10.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.869+0000 7f4871ffb640 1 -- 172.21.15.45:0/3120353002 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f487411f5b0 con 0x7f487c0712c0 2023-10-03T19:18:10.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.869+0000 7f4881049640 1 --2- 172.21.15.45:0/3120353002 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f48600662b0 0x7f4860068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:10.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.869+0000 7f4881049640 1 --2- 172.21.15.45:0/3120353002 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f48600662b0 0x7f4860068760 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4878004e30 tx=0x7f4878009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:10.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:10.873+0000 7f4871ffb640 1 -- 172.21.15.45:0/3120353002 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f48740eccc0 con 0x7f487c0712c0 2023-10-03T19:18:11.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.025+0000 7f48832ad640 1 -- 172.21.15.45:0/3120353002 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f487c04de80 con 0x7f487c0712c0 2023-10-03T19:18:11.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.025+0000 7f4871ffb640 1 -- 172.21.15.45:0/3120353002 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v74) v1 ==== 92+0+10 (secure 0 0 0) 0x7f48740f02e0 con 0x7f487c0712c0 2023-10-03T19:18:11.029 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:18:11.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.029+0000 7f48832ad640 1 -- 172.21.15.45:0/3120353002 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f48600662b0 msgr2=0x7f4860068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:11.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.029+0000 7f48832ad640 1 --2- 172.21.15.45:0/3120353002 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f48600662b0 0x7f4860068760 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4878004e30 tx=0x7f4878009040 comp rx=0 tx=0).stop 2023-10-03T19:18:11.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.029+0000 7f48832ad640 1 -- 172.21.15.45:0/3120353002 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f487c0712c0 msgr2=0x7f487c0b9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:11.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.029+0000 7f48832ad640 1 --2- 172.21.15.45:0/3120353002 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f487c0712c0 0x7f487c0b9970 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f487401a5c0 tx=0x7f4874019730 comp rx=0 tx=0).stop 2023-10-03T19:18:11.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.029+0000 7f48832ad640 1 -- 172.21.15.45:0/3120353002 shutdown_connections 2023-10-03T19:18:11.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.029+0000 7f48832ad640 1 --2- 172.21.15.45:0/3120353002 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f48600662b0 0x7f4860068760 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.029+0000 7f48832ad640 1 --2- 172.21.15.45:0/3120353002 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f487c0712c0 0x7f487c0b9970 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.029+0000 7f48832ad640 1 --2- 172.21.15.45:0/3120353002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f487c06d560 0x7f487c1e4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.029+0000 7f48832ad640 1 --2- 172.21.15.45:0/3120353002 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f487c06c760 0x7f487c146a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.029+0000 7f48832ad640 1 -- 172.21.15.45:0/3120353002 >> 172.21.15.45:0/3120353002 conn(0x7f487c0a20d0 msgr2=0x7f487c0bb890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:11.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.029+0000 7f48832ad640 1 -- 172.21.15.45:0/3120353002 shutdown_connections 2023-10-03T19:18:11.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.029+0000 7f48832ad640 1 -- 172.21.15.45:0/3120353002 wait complete. 2023-10-03T19:18:11.049 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T19:18:11.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.177+0000 7fa82af06640 1 Processor -- start 2023-10-03T19:18:11.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.177+0000 7fa82af06640 1 -- start start 2023-10-03T19:18:11.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.177+0000 7fa82af06640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa82406f880 0x7fa8240a5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:11.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.177+0000 7fa82af06640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa82414ba30 0x7fa824155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:11.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.177+0000 7fa82af06640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa82414f080 con 0x7fa82414f510 2023-10-03T19:18:11.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.177+0000 7fa82af06640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa82406f3e0 con 0x7fa82406f880 2023-10-03T19:18:11.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.177+0000 7fa82af06640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa824070e90 con 0x7fa82414ba30 2023-10-03T19:18:11.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.177+0000 7fa828ca2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa82406f880 0x7fa8240a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:11.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.177+0000 7fa828ca2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa82406f880 0x7fa8240a5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56980/0 (socket says 172.21.15.45:56980) 2023-10-03T19:18:11.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.177+0000 7fa828ca2640 1 -- 172.21.15.45:0/2298664325 learned_addr learned my addr 172.21.15.45:0/2298664325 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:11.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.177+0000 7fa8294a3640 1 --2- 172.21.15.45:0/2298664325 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa82414ba30 0x7fa824155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:11.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.177+0000 7fa828ca2640 1 -- 172.21.15.45:0/2298664325 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa82414ba30 msgr2=0x7fa824155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:11.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.177+0000 7fa828ca2640 1 --2- 172.21.15.45:0/2298664325 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa82414ba30 0x7fa824155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.177+0000 7fa828ca2640 1 -- 172.21.15.45:0/2298664325 >> v1:172.21.15.79:6789/0 conn(0x7fa82414f510 legacy=0x7fa82414b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:11.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.177+0000 7fa828ca2640 1 -- 172.21.15.45:0/2298664325 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82414ea30 con 0x7fa82406f880 2023-10-03T19:18:11.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa828ca2640 1 --2- 172.21.15.45:0/2298664325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa82406f880 0x7fa8240a5940 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fa814009e50 tx=0x7fa81401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909a13cba4ad3b31 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:11.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa8237fe640 1 -- 172.21.15.45:0/2298664325 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8140a5810 con 0x7fa82406f880 2023-10-03T19:18:11.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa8237fe640 1 -- 172.21.15.45:0/2298664325 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8140a5970 con 0x7fa82406f880 2023-10-03T19:18:11.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa8237fe640 1 -- 172.21.15.45:0/2298664325 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8140a5d00 con 0x7fa82406f880 2023-10-03T19:18:11.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa82af06640 1 -- 172.21.15.45:0/2298664325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa82406f880 msgr2=0x7fa8240a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:11.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa82af06640 1 --2- 172.21.15.45:0/2298664325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa82406f880 0x7fa8240a5940 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fa814009e50 tx=0x7fa81401c9e0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa82af06640 1 -- 172.21.15.45:0/2298664325 shutdown_connections 2023-10-03T19:18:11.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa82af06640 1 --2- 172.21.15.45:0/2298664325 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa82414ba30 0x7fa824155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa82af06640 1 --2- 172.21.15.45:0/2298664325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa82406f880 0x7fa8240a5940 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa82af06640 1 -- 172.21.15.45:0/2298664325 >> 172.21.15.45:0/2298664325 conn(0x7fa8240a20d0 msgr2=0x7fa8240a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:11.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa82af06640 1 -- 172.21.15.45:0/2298664325 shutdown_connections 2023-10-03T19:18:11.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa82af06640 1 -- 172.21.15.45:0/2298664325 wait complete. 2023-10-03T19:18:11.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa82af06640 1 Processor -- start 2023-10-03T19:18:11.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa82af06640 1 -- start start 2023-10-03T19:18:11.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa82af06640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa82406f880 0x7fa824145a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:11.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa82af06640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa82414ba30 0x7fa824143e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:11.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa82af06640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa82414f510 0x7fa8240a33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:11.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa82af06640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8241453c0 con 0x7fa82414ba30 2023-10-03T19:18:11.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa82af06640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa824145fd0 con 0x7fa82414f510 2023-10-03T19:18:11.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa82af06640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8240a1d20 con 0x7fa82406f880 2023-10-03T19:18:11.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa823fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa82414ba30 0x7fa824143e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:11.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa823fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa82414ba30 0x7fa824143e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56994/0 (socket says 172.21.15.45:56994) 2023-10-03T19:18:11.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa823fff640 1 -- 172.21.15.45:0/1284614045 learned_addr learned my addr 172.21.15.45:0/1284614045 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:11.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa8294a3640 1 --2- 172.21.15.45:0/1284614045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa82414f510 0x7fa8240a33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:11.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa828ca2640 1 --2- 172.21.15.45:0/1284614045 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa82406f880 0x7fa824145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:11.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa823fff640 1 -- 172.21.15.45:0/1284614045 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa82406f880 msgr2=0x7fa824145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:11.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa823fff640 1 --2- 172.21.15.45:0/1284614045 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa82406f880 0x7fa824145a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa823fff640 1 -- 172.21.15.45:0/1284614045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa82414f510 msgr2=0x7fa8240a33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:11.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa823fff640 1 --2- 172.21.15.45:0/1284614045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa82414f510 0x7fa8240a33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa823fff640 1 -- 172.21.15.45:0/1284614045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa814009b30 con 0x7fa82414ba30 2023-10-03T19:18:11.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa823fff640 1 --2- 172.21.15.45:0/1284614045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa82414ba30 0x7fa824143e50 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fa81800c3c0 tx=0x7fa81800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:11.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa8217fa640 1 -- 172.21.15.45:0/1284614045 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8180052d0 con 0x7fa82414ba30 2023-10-03T19:18:11.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa8217fa640 1 -- 172.21.15.45:0/1284614045 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa818005430 con 0x7fa82414ba30 2023-10-03T19:18:11.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.181+0000 7fa8217fa640 1 -- 172.21.15.45:0/1284614045 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa818003840 con 0x7fa82414ba30 2023-10-03T19:18:11.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.185+0000 7fa82af06640 1 -- 172.21.15.45:0/1284614045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa824070a40 con 0x7fa82414ba30 2023-10-03T19:18:11.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.185+0000 7fa82af06640 1 -- 172.21.15.45:0/1284614045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa82406fc50 con 0x7fa82414ba30 2023-10-03T19:18:11.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.185+0000 7fa82af06640 1 -- 172.21.15.45:0/1284614045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa824070bd0 con 0x7fa82414ba30 2023-10-03T19:18:11.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.185+0000 7fa8217fa640 1 -- 172.21.15.45:0/1284614045 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa8180039a0 con 0x7fa82414ba30 2023-10-03T19:18:11.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.185+0000 7fa8217fa640 1 --2- 172.21.15.45:0/1284614045 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa810066280 0x7fa810068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:11.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.185+0000 7fa8217fa640 1 -- 172.21.15.45:0/1284614045 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa818083270 con 0x7fa82414ba30 2023-10-03T19:18:11.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.185+0000 7fa828ca2640 1 --2- 172.21.15.45:0/1284614045 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa810066280 0x7fa810068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:11.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.185+0000 7fa828ca2640 1 --2- 172.21.15.45:0/1284614045 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa810066280 0x7fa810068730 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa8140ae000 tx=0x7fa8140a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:11.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.189+0000 7fa8217fa640 1 -- 172.21.15.45:0/1284614045 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa8180506f0 con 0x7fa82414ba30 2023-10-03T19:18:11.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.341+0000 7fa82af06640 1 -- 172.21.15.45:0/1284614045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa8241450a0 con 0x7fa82414ba30 2023-10-03T19:18:11.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.341+0000 7fa8217fa640 1 -- 172.21.15.45:0/1284614045 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v74) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa818053d10 con 0x7fa82414ba30 2023-10-03T19:18:11.345 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-03T19:18:11.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.345+0000 7fa82af06640 1 -- 172.21.15.45:0/1284614045 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa810066280 msgr2=0x7fa810068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:11.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.345+0000 7fa82af06640 1 --2- 172.21.15.45:0/1284614045 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa810066280 0x7fa810068730 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa8140ae000 tx=0x7fa8140a7070 comp rx=0 tx=0).stop 2023-10-03T19:18:11.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.345+0000 7fa82af06640 1 -- 172.21.15.45:0/1284614045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa82414ba30 msgr2=0x7fa824143e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:11.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.345+0000 7fa82af06640 1 --2- 172.21.15.45:0/1284614045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa82414ba30 0x7fa824143e50 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fa81800c3c0 tx=0x7fa81800c880 comp rx=0 tx=0).stop 2023-10-03T19:18:11.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.345+0000 7fa82af06640 1 -- 172.21.15.45:0/1284614045 shutdown_connections 2023-10-03T19:18:11.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.345+0000 7fa82af06640 1 --2- 172.21.15.45:0/1284614045 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa810066280 0x7fa810068730 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.345+0000 7fa82af06640 1 --2- 172.21.15.45:0/1284614045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa82414f510 0x7fa8240a33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.345+0000 7fa82af06640 1 --2- 172.21.15.45:0/1284614045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa82414ba30 0x7fa824143e50 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.345+0000 7fa82af06640 1 --2- 172.21.15.45:0/1284614045 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa82406f880 0x7fa824145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.345+0000 7fa82af06640 1 -- 172.21.15.45:0/1284614045 >> 172.21.15.45:0/1284614045 conn(0x7fa8240a20d0 msgr2=0x7fa82414c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:11.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.345+0000 7fa82af06640 1 -- 172.21.15.45:0/1284614045 shutdown_connections 2023-10-03T19:18:11.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.345+0000 7fa82af06640 1 -- 172.21.15.45:0/1284614045 wait complete. 2023-10-03T19:18:11.363 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T19:18:11.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.477+0000 7fb86da84640 1 Processor -- start 2023-10-03T19:18:11.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.477+0000 7fb86da84640 1 -- start start 2023-10-03T19:18:11.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.481+0000 7fb86da84640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb86806f880 0x7fb8680a5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:11.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.481+0000 7fb86da84640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb86814f510 0x7fb86814b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:11.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.481+0000 7fb86da84640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb86814f080 con 0x7fb8680bd9f0 2023-10-03T19:18:11.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.481+0000 7fb86da84640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb86806f3e0 con 0x7fb86806f880 2023-10-03T19:18:11.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.481+0000 7fb86da84640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb868070e90 con 0x7fb86814f510 2023-10-03T19:18:11.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.481+0000 7fb8677fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb86806f880 0x7fb8680a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:11.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.481+0000 7fb8677fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb86806f880 0x7fb8680a5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57010/0 (socket says 172.21.15.45:57010) 2023-10-03T19:18:11.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.481+0000 7fb8677fe640 1 -- 172.21.15.45:0/921759245 learned_addr learned my addr 172.21.15.45:0/921759245 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:11.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.481+0000 7fb866ffd640 1 --2- 172.21.15.45:0/921759245 >> v2:172.21.15.79:3300/0 conn(0x7fb86814f510 0x7fb86814b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:11.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.481+0000 7fb8677fe640 1 -- 172.21.15.45:0/921759245 >> v2:172.21.15.79:3300/0 conn(0x7fb86814f510 msgr2=0x7fb86814b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:11.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.481+0000 7fb8677fe640 1 --2- 172.21.15.45:0/921759245 >> v2:172.21.15.79:3300/0 conn(0x7fb86814f510 0x7fb86814b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.481+0000 7fb8677fe640 1 -- 172.21.15.45:0/921759245 >> v1:172.21.15.79:6789/0 conn(0x7fb8680bd9f0 legacy=0x7fb8680badc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:11.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.481+0000 7fb8677fe640 1 -- 172.21.15.45:0/921759245 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86814ea30 con 0x7fb86806f880 2023-10-03T19:18:11.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.481+0000 7fb8677fe640 1 --2- 172.21.15.45:0/921759245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb86806f880 0x7fb8680a5940 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fb8680712b0 tx=0x7fb85801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be160018347353e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:11.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.481+0000 7fb8667fc640 1 -- 172.21.15.45:0/921759245 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8580a5780 con 0x7fb86806f880 2023-10-03T19:18:11.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.481+0000 7fb8667fc640 1 -- 172.21.15.45:0/921759245 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8580a58e0 con 0x7fb86806f880 2023-10-03T19:18:11.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.481+0000 7fb8667fc640 1 -- 172.21.15.45:0/921759245 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8580a5c70 con 0x7fb86806f880 2023-10-03T19:18:11.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.481+0000 7fb86da84640 1 -- 172.21.15.45:0/921759245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb86806f880 msgr2=0x7fb8680a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:11.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.481+0000 7fb86da84640 1 --2- 172.21.15.45:0/921759245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb86806f880 0x7fb8680a5940 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fb8680712b0 tx=0x7fb85801c960 comp rx=0 tx=0).stop 2023-10-03T19:18:11.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.481+0000 7fb86da84640 1 -- 172.21.15.45:0/921759245 shutdown_connections 2023-10-03T19:18:11.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.481+0000 7fb86da84640 1 --2- 172.21.15.45:0/921759245 >> v2:172.21.15.79:3300/0 conn(0x7fb86814f510 0x7fb86814b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.481+0000 7fb86da84640 1 --2- 172.21.15.45:0/921759245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb86806f880 0x7fb8680a5940 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.481+0000 7fb86da84640 1 -- 172.21.15.45:0/921759245 >> 172.21.15.45:0/921759245 conn(0x7fb8680a20d0 msgr2=0x7fb8680a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:11.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.481+0000 7fb86da84640 1 -- 172.21.15.45:0/921759245 shutdown_connections 2023-10-03T19:18:11.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.481+0000 7fb86da84640 1 -- 172.21.15.45:0/921759245 wait complete. 2023-10-03T19:18:11.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.485+0000 7fb86da84640 1 Processor -- start 2023-10-03T19:18:11.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.485+0000 7fb86da84640 1 -- start start 2023-10-03T19:18:11.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.485+0000 7fb86da84640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb86806f880 0x7fb86814d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:11.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.485+0000 7fb86da84640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8680bd9f0 0x7fb86814d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:11.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.485+0000 7fb86da84640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb86814f510 0x7fb86813f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:11.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.485+0000 7fb86da84640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8681406f0 con 0x7fb8680bd9f0 2023-10-03T19:18:11.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.485+0000 7fb86da84640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb868157460 con 0x7fb86814f510 2023-10-03T19:18:11.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.485+0000 7fb86da84640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8681490c0 con 0x7fb86806f880 2023-10-03T19:18:11.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.485+0000 7fb866ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8680bd9f0 0x7fb86814d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:11.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.485+0000 7fb866ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8680bd9f0 0x7fb86814d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57014/0 (socket says 172.21.15.45:57014) 2023-10-03T19:18:11.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.485+0000 7fb866ffd640 1 -- 172.21.15.45:0/3754708413 learned_addr learned my addr 172.21.15.45:0/3754708413 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:11.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.485+0000 7fb8677fe640 1 --2- 172.21.15.45:0/3754708413 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb86806f880 0x7fb86814d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:11.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.485+0000 7fb867fff640 1 --2- 172.21.15.45:0/3754708413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb86814f510 0x7fb86813f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:11.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.485+0000 7fb866ffd640 1 -- 172.21.15.45:0/3754708413 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb86806f880 msgr2=0x7fb86814d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:11.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.485+0000 7fb866ffd640 1 --2- 172.21.15.45:0/3754708413 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb86806f880 0x7fb86814d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.485+0000 7fb866ffd640 1 -- 172.21.15.45:0/3754708413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb86814f510 msgr2=0x7fb86813f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:11.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.485+0000 7fb866ffd640 1 --2- 172.21.15.45:0/3754708413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb86814f510 0x7fb86813f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.485+0000 7fb866ffd640 1 -- 172.21.15.45:0/3754708413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb858009b30 con 0x7fb8680bd9f0 2023-10-03T19:18:11.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.485+0000 7fb867fff640 1 --2- 172.21.15.45:0/3754708413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb86814f510 0x7fb86813f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:11.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.485+0000 7fb866ffd640 1 --2- 172.21.15.45:0/3754708413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8680bd9f0 0x7fb86814d6e0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fb85c00d5f0 tx=0x7fb85c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:11.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.485+0000 7fb84ffff640 1 -- 172.21.15.45:0/3754708413 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c0125f0 con 0x7fb8680bd9f0 2023-10-03T19:18:11.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.485+0000 7fb84ffff640 1 -- 172.21.15.45:0/3754708413 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c012750 con 0x7fb8680bd9f0 2023-10-03T19:18:11.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.485+0000 7fb84ffff640 1 -- 172.21.15.45:0/3754708413 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c012ae0 con 0x7fb8680bd9f0 2023-10-03T19:18:11.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.485+0000 7fb86da84640 1 -- 172.21.15.45:0/3754708413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb86806fc50 con 0x7fb8680bd9f0 2023-10-03T19:18:11.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.485+0000 7fb86da84640 1 -- 172.21.15.45:0/3754708413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86814bc70 con 0x7fb8680bd9f0 2023-10-03T19:18:11.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.485+0000 7fb86da84640 1 -- 172.21.15.45:0/3754708413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb868070a40 con 0x7fb8680bd9f0 2023-10-03T19:18:11.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.485+0000 7fb84ffff640 1 -- 172.21.15.45:0/3754708413 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb85c012c40 con 0x7fb8680bd9f0 2023-10-03T19:18:11.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.489+0000 7fb84ffff640 1 --2- 172.21.15.45:0/3754708413 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb854066280 0x7fb854068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:11.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.489+0000 7fb84ffff640 1 -- 172.21.15.45:0/3754708413 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb85c0841b0 con 0x7fb8680bd9f0 2023-10-03T19:18:11.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.489+0000 7fb8677fe640 1 --2- 172.21.15.45:0/3754708413 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb854066280 0x7fb854068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:11.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.489+0000 7fb8677fe640 1 --2- 172.21.15.45:0/3754708413 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb854066280 0x7fb854068730 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb8580ae000 tx=0x7fb8580a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:11.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.493+0000 7fb84ffff640 1 -- 172.21.15.45:0/3754708413 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb85c051620 con 0x7fb8680bd9f0 2023-10-03T19:18:11.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.645+0000 7fb86da84640 1 -- 172.21.15.45:0/3754708413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb86804de80 con 0x7fb8680bd9f0 2023-10-03T19:18:11.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.645+0000 7fb84ffff640 1 -- 172.21.15.45:0/3754708413 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v74) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb85c007380 con 0x7fb8680bd9f0 2023-10-03T19:18:11.648 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-03T19:18:11.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.649+0000 7fb86da84640 1 -- 172.21.15.45:0/3754708413 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb854066280 msgr2=0x7fb854068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:11.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.649+0000 7fb86da84640 1 --2- 172.21.15.45:0/3754708413 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb854066280 0x7fb854068730 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb8580ae000 tx=0x7fb8580a7070 comp rx=0 tx=0).stop 2023-10-03T19:18:11.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.649+0000 7fb86da84640 1 -- 172.21.15.45:0/3754708413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8680bd9f0 msgr2=0x7fb86814d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:11.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.649+0000 7fb86da84640 1 --2- 172.21.15.45:0/3754708413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8680bd9f0 0x7fb86814d6e0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fb85c00d5f0 tx=0x7fb85c00dab0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.649+0000 7fb86da84640 1 -- 172.21.15.45:0/3754708413 shutdown_connections 2023-10-03T19:18:11.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.649+0000 7fb86da84640 1 --2- 172.21.15.45:0/3754708413 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb854066280 0x7fb854068730 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.649+0000 7fb86da84640 1 --2- 172.21.15.45:0/3754708413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb86814f510 0x7fb86813f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.649+0000 7fb86da84640 1 --2- 172.21.15.45:0/3754708413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8680bd9f0 0x7fb86814d6e0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.649+0000 7fb86da84640 1 --2- 172.21.15.45:0/3754708413 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb86806f880 0x7fb86814d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.649+0000 7fb86da84640 1 -- 172.21.15.45:0/3754708413 >> 172.21.15.45:0/3754708413 conn(0x7fb8680a20d0 msgr2=0x7fb8680a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:11.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.649+0000 7fb86da84640 1 -- 172.21.15.45:0/3754708413 shutdown_connections 2023-10-03T19:18:11.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.649+0000 7fb86da84640 1 -- 172.21.15.45:0/3754708413 wait complete. 2023-10-03T19:18:11.668 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-03T19:18:11.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f310924e640 1 Processor -- start 2023-10-03T19:18:11.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f310924e640 1 -- start start 2023-10-03T19:18:11.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f310924e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31040bb1d0 0x7f31041528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f310924e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f310406b2d0 con 0x7f310414f240 2023-10-03T19:18:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f310924e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31040a3c60 con 0x7f31040c2790 2023-10-03T19:18:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f310924e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f310406b640 con 0x7f31040bb1d0 2023-10-03T19:18:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f3102d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f310414f240 0x7f31040c0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60954/0 (socket says 172.21.15.45:60954) 2023-10-03T19:18:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f3102d9d640 1 -- 172.21.15.45:0/2632200409 learned_addr learned my addr 172.21.15.45:0/2632200409 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:18:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f310359e640 1 --2- 172.21.15.45:0/2632200409 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31040bb1d0 0x7f31041528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f3101d9b640 1 -- 172.21.15.45:0/2632200409 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 355046368 0 0) 0x7f310406b2d0 con 0x7f310414f240 2023-10-03T19:18:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f3101d9b640 1 -- 172.21.15.45:0/2632200409 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30ec003530 con 0x7f310414f240 2023-10-03T19:18:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f3101d9b640 1 -- 172.21.15.45:0/2632200409 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 849448176 0 0) 0x7f30ec003530 con 0x7f310414f240 2023-10-03T19:18:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f3101d9b640 1 -- 172.21.15.45:0/2632200409 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31040bb1d0 msgr2=0x7f31041528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f3101d9b640 1 --2- 172.21.15.45:0/2632200409 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31040bb1d0 0x7f31041528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f3101d9b640 1 -- 172.21.15.45:0/2632200409 >> v1:172.21.15.79:6789/0 conn(0x7f31040c2790 legacy=0x7f31040c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:11.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f3101d9b640 1 -- 172.21.15.45:0/2632200409 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31040c19b0 con 0x7f310414f240 2023-10-03T19:18:11.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f3101d9b640 1 -- 172.21.15.45:0/2632200409 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f30fc001b80 con 0x7f310414f240 2023-10-03T19:18:11.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f310359e640 1 --2- 172.21.15.45:0/2632200409 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31040bb1d0 0x7f31041528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:18:11.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f3101d9b640 1 -- 172.21.15.45:0/2632200409 >> v1:172.21.15.45:6789/0 conn(0x7f310414f240 legacy=0x7f31040c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:11.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f3101d9b640 1 --2- 172.21.15.45:0/2632200409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30ec0039b0 0x7f30ec003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:11.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f3101d9b640 1 --2- 172.21.15.45:0/2632200409 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31040bb1d0 0x7f30ec0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:11.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f3101d9b640 1 --2- 172.21.15.45:0/2632200409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30ec004d10 0x7f30ec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:11.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f3101d9b640 1 -- 172.21.15.45:0/2632200409 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310406b640 con 0x7f30ec0039b0 2023-10-03T19:18:11.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f3101d9b640 1 -- 172.21.15.45:0/2632200409 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec00bb00 con 0x7f30ec004d10 2023-10-03T19:18:11.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f3101d9b640 1 -- 172.21.15.45:0/2632200409 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec00bcc0 con 0x7f31040bb1d0 2023-10-03T19:18:11.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f3102d9d640 1 --2- 172.21.15.45:0/2632200409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30ec0039b0 0x7f30ec003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:11.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f310259c640 1 --2- 172.21.15.45:0/2632200409 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31040bb1d0 0x7f30ec0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:11.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f310359e640 1 --2- 172.21.15.45:0/2632200409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30ec004d10 0x7f30ec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:11.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f3102d9d640 1 -- 172.21.15.45:0/2632200409 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31040bb1d0 msgr2=0x7f30ec0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:11.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f3102d9d640 1 --2- 172.21.15.45:0/2632200409 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31040bb1d0 0x7f30ec0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f3102d9d640 1 -- 172.21.15.45:0/2632200409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30ec004d10 msgr2=0x7f30ec005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:11.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f3102d9d640 1 --2- 172.21.15.45:0/2632200409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30ec004d10 0x7f30ec005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f3102d9d640 1 -- 172.21.15.45:0/2632200409 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ec003530 con 0x7f30ec0039b0 2023-10-03T19:18:11.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.805+0000 7f310359e640 1 --2- 172.21.15.45:0/2632200409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30ec004d10 0x7f30ec005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:11.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.809+0000 7f3102d9d640 1 --2- 172.21.15.45:0/2632200409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30ec0039b0 0x7f30ec003dc0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f30fc00c520 tx=0x7f30fc01f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5fb1f3a1bd2084 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:11.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.809+0000 7f3101d9b640 1 -- 172.21.15.45:0/2632200409 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30fc005d30 con 0x7f30ec0039b0 2023-10-03T19:18:11.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.809+0000 7f3101d9b640 1 -- 172.21.15.45:0/2632200409 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30fc0ac070 con 0x7f30ec0039b0 2023-10-03T19:18:11.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.809+0000 7f3101d9b640 1 -- 172.21.15.45:0/2632200409 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30fc007290 con 0x7f30ec0039b0 2023-10-03T19:18:11.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.809+0000 7f310924e640 1 -- 172.21.15.45:0/2632200409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30ec0039b0 msgr2=0x7f30ec003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:11.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.809+0000 7f310924e640 1 --2- 172.21.15.45:0/2632200409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30ec0039b0 0x7f30ec003dc0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f30fc00c520 tx=0x7f30fc01f720 comp rx=0 tx=0).stop 2023-10-03T19:18:11.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.809+0000 7f310359e640 1 -- 172.21.15.45:0/2632200409 reap_dead start 2023-10-03T19:18:11.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.809+0000 7f310924e640 1 -- 172.21.15.45:0/2632200409 shutdown_connections 2023-10-03T19:18:11.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.809+0000 7f310924e640 1 -- 172.21.15.45:0/2632200409 >> 172.21.15.45:0/2632200409 conn(0x7f31040a64a0 msgr2=0x7f31040a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:11.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.809+0000 7f310924e640 1 -- 172.21.15.45:0/2632200409 shutdown_connections 2023-10-03T19:18:11.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.809+0000 7f310924e640 1 -- 172.21.15.45:0/2632200409 wait complete. 2023-10-03T19:18:11.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.809+0000 7f310924e640 1 Processor -- start 2023-10-03T19:18:11.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.809+0000 7f310924e640 1 -- start start 2023-10-03T19:18:11.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.813+0000 7f310924e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30ec0039b0 0x7f31040bdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:11.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.813+0000 7f310924e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31040bbb30 0x7f3104148a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:11.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.813+0000 7f310924e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3104148fb0 0x7f31041e7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:11.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.813+0000 7f310924e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31041e4720 con 0x7f30ec0039b0 2023-10-03T19:18:11.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.813+0000 7f310924e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31040a8370 con 0x7f31040bbb30 2023-10-03T19:18:11.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.813+0000 7f310924e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31041e3d80 con 0x7f3104148fb0 2023-10-03T19:18:11.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.813+0000 7f3102d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30ec0039b0 0x7f31040bdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:11.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.813+0000 7f3102d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30ec0039b0 0x7f31040bdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57038/0 (socket says 172.21.15.45:57038) 2023-10-03T19:18:11.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.813+0000 7f3102d9d640 1 -- 172.21.15.45:0/3989009456 learned_addr learned my addr 172.21.15.45:0/3989009456 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:11.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.813+0000 7f310259c640 1 --2- 172.21.15.45:0/3989009456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31040bbb30 0x7f3104148a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:11.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.813+0000 7f310359e640 1 --2- 172.21.15.45:0/3989009456 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3104148fb0 0x7f31041e7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:11.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.813+0000 7f3102d9d640 1 -- 172.21.15.45:0/3989009456 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3104148fb0 msgr2=0x7f31041e7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:11.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.813+0000 7f3102d9d640 1 --2- 172.21.15.45:0/3989009456 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3104148fb0 0x7f31041e7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.813+0000 7f3102d9d640 1 -- 172.21.15.45:0/3989009456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31040bbb30 msgr2=0x7f3104148a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:11.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.813+0000 7f3102d9d640 1 --2- 172.21.15.45:0/3989009456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31040bbb30 0x7f3104148a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.813+0000 7f3102d9d640 1 -- 172.21.15.45:0/3989009456 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31040a3f40 con 0x7f30ec0039b0 2023-10-03T19:18:11.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.813+0000 7f310359e640 1 --2- 172.21.15.45:0/3989009456 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3104148fb0 0x7f31041e7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:11.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.813+0000 7f3102d9d640 1 --2- 172.21.15.45:0/3989009456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30ec0039b0 0x7f31040bdfd0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f30fc001280 tx=0x7f30ec005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:11.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.813+0000 7f30eb7fe640 1 -- 172.21.15.45:0/3989009456 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30fc0b7070 con 0x7f30ec0039b0 2023-10-03T19:18:11.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.813+0000 7f30eb7fe640 1 -- 172.21.15.45:0/3989009456 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30fc001940 con 0x7f30ec0039b0 2023-10-03T19:18:11.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.813+0000 7f310924e640 1 -- 172.21.15.45:0/3989009456 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f310414e740 con 0x7f30ec0039b0 2023-10-03T19:18:11.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.813+0000 7f30eb7fe640 1 -- 172.21.15.45:0/3989009456 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30fc007070 con 0x7f30ec0039b0 2023-10-03T19:18:11.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.813+0000 7f310924e640 1 -- 172.21.15.45:0/3989009456 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f310414f610 con 0x7f30ec0039b0 2023-10-03T19:18:11.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.813+0000 7f310924e640 1 -- 172.21.15.45:0/3989009456 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f310404de80 con 0x7f30ec0039b0 2023-10-03T19:18:11.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.813+0000 7f30eb7fe640 1 -- 172.21.15.45:0/3989009456 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f30fc0071d0 con 0x7f30ec0039b0 2023-10-03T19:18:11.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.813+0000 7f30eb7fe640 1 --2- 172.21.15.45:0/3989009456 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f30f0066280 0x7f30f0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:11.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.813+0000 7f30eb7fe640 1 -- 172.21.15.45:0/3989009456 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f30fc120ab0 con 0x7f30ec0039b0 2023-10-03T19:18:11.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.813+0000 7f310259c640 1 --2- 172.21.15.45:0/3989009456 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f30f0066280 0x7f30f0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:11.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.817+0000 7f310259c640 1 --2- 172.21.15.45:0/3989009456 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f30f0066280 0x7f30f0068730 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f30f8007fd0 tx=0x7f30f8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:11.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.817+0000 7f30eb7fe640 1 -- 172.21.15.45:0/3989009456 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f30fc0edf30 con 0x7f30ec0039b0 2023-10-03T19:18:11.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.985+0000 7f310924e640 1 -- 172.21.15.45:0/3989009456 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f31040c0280 con 0x7f30ec0039b0 2023-10-03T19:18:11.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.985+0000 7f30eb7fe640 1 -- 172.21.15.45:0/3989009456 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v74) v1 ==== 80+0+0 (secure 0 0 0) 0x7f30fc0f1550 con 0x7f30ec0039b0 2023-10-03T19:18:11.988 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-10-03T19:18:11.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.989+0000 7f310924e640 1 -- 172.21.15.45:0/3989009456 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f30f0066280 msgr2=0x7f30f0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:11.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.989+0000 7f310924e640 1 --2- 172.21.15.45:0/3989009456 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f30f0066280 0x7f30f0068730 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f30f8007fd0 tx=0x7f30f8009040 comp rx=0 tx=0).stop 2023-10-03T19:18:11.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.989+0000 7f310924e640 1 -- 172.21.15.45:0/3989009456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30ec0039b0 msgr2=0x7f31040bdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:11.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.989+0000 7f310924e640 1 --2- 172.21.15.45:0/3989009456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30ec0039b0 0x7f31040bdfd0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f30fc001280 tx=0x7f30ec005800 comp rx=0 tx=0).stop 2023-10-03T19:18:11.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.989+0000 7f310924e640 1 -- 172.21.15.45:0/3989009456 shutdown_connections 2023-10-03T19:18:11.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.989+0000 7f310924e640 1 --2- 172.21.15.45:0/3989009456 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f30f0066280 0x7f30f0068730 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.989+0000 7f310924e640 1 --2- 172.21.15.45:0/3989009456 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3104148fb0 0x7f31041e7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.989+0000 7f310924e640 1 --2- 172.21.15.45:0/3989009456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31040bbb30 0x7f3104148a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.989+0000 7f310924e640 1 --2- 172.21.15.45:0/3989009456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30ec0039b0 0x7f31040bdfd0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:11.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.989+0000 7f310924e640 1 -- 172.21.15.45:0/3989009456 >> 172.21.15.45:0/3989009456 conn(0x7f31040a64a0 msgr2=0x7f31041497a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:11.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.989+0000 7f310924e640 1 -- 172.21.15.45:0/3989009456 shutdown_connections 2023-10-03T19:18:11.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:11.989+0000 7f310924e640 1 -- 172.21.15.45:0/3989009456 wait complete. 2023-10-03T19:18:12.007 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi146.front.sepia.ceph.com... 2023-10-03T19:18:12.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:18:12.007 DEBUG:teuthology.orchestra.run.smithi146:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-03T19:18:12.020 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[33693]: fuse finished with error 0 and tester_r 0 2023-10-03T19:18:12.022 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-03T19:18:12.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:18:12.022 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-03T19:18:12.193 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-03T19:18:12.193 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:18:12.199 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336540k,nr_inodes=4084135,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=22607 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-10-03T19:18:12.199 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2023-10-03T19:18:12.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:18:12.199 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-03T19:18:12.246 INFO:teuthology.orchestra.run.smithi172.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-03T19:18:12.247 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T19:18:12.247 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:18:12.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.373+0000 7f3fb8b40640 1 Processor -- start 2023-10-03T19:18:12.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb8b40640 1 -- start start 2023-10-03T19:18:12.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb8b40640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3fb40bc8b0 0x7f3fb414ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:12.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb8b40640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3fb406d170 0x7f3fb414cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:12.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb8b40640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb406cac0 con 0x7f3fb406f170 2023-10-03T19:18:12.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb8b40640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb414d4f0 con 0x7f3fb40bc8b0 2023-10-03T19:18:12.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb8b40640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb40720d0 con 0x7f3fb406d170 2023-10-03T19:18:12.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb259c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3fb406f170 0x7f3fb4150190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60966/0 (socket says 172.21.15.45:60966) 2023-10-03T19:18:12.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb259c640 1 -- 172.21.15.45:0/3769253624 learned_addr learned my addr 172.21.15.45:0/3769253624 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:18:12.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb1d9b640 1 --2- 172.21.15.45:0/3769253624 >> v2:172.21.15.79:3300/0 conn(0x7f3fb40bc8b0 0x7f3fb414ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:12.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb2d9d640 1 --2- 172.21.15.45:0/3769253624 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3fb406d170 0x7f3fb414cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:12.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb159a640 1 -- 172.21.15.45:0/3769253624 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1183808112 0 0) 0x7f3fa40014a0 con 0x7f3fb406f170 2023-10-03T19:18:12.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb159a640 1 -- 172.21.15.45:0/3769253624 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fa0003530 con 0x7f3fb406f170 2023-10-03T19:18:12.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb159a640 1 -- 172.21.15.45:0/3769253624 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1923178777 0 0) 0x7f3fa0003530 con 0x7f3fb406f170 2023-10-03T19:18:12.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb159a640 1 -- 172.21.15.45:0/3769253624 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3fb406d170 msgr2=0x7f3fb414cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:12.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb159a640 1 --2- 172.21.15.45:0/3769253624 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3fb406d170 0x7f3fb414cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:12.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb159a640 1 -- 172.21.15.45:0/3769253624 >> v2:172.21.15.79:3300/0 conn(0x7f3fb40bc8b0 msgr2=0x7f3fb414ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:12.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb159a640 1 --2- 172.21.15.45:0/3769253624 >> v2:172.21.15.79:3300/0 conn(0x7f3fb40bc8b0 0x7f3fb414ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:12.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb159a640 1 -- 172.21.15.45:0/3769253624 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb40a5ab0 con 0x7f3fb406f170 2023-10-03T19:18:12.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb159a640 1 -- 172.21.15.45:0/3769253624 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f3fa4001b90 con 0x7f3fb406f170 2023-10-03T19:18:12.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb159a640 1 -- 172.21.15.45:0/3769253624 >> v1:172.21.15.45:6789/0 conn(0x7f3fb406f170 legacy=0x7f3fb4150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:12.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb159a640 1 --2- 172.21.15.45:0/3769253624 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3fb406d170 0x7f3fa0003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:12.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb159a640 1 --2- 172.21.15.45:0/3769253624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fa0003f00 0x7f3fa00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:12.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb159a640 1 --2- 172.21.15.45:0/3769253624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fa0004d10 0x7f3fa0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:12.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb159a640 1 -- 172.21.15.45:0/3769253624 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb414d4f0 con 0x7f3fa0003f00 2023-10-03T19:18:12.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb159a640 1 -- 172.21.15.45:0/3769253624 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb40720d0 con 0x7f3fa0004d10 2023-10-03T19:18:12.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb159a640 1 -- 172.21.15.45:0/3769253624 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa000b9c0 con 0x7f3fb406d170 2023-10-03T19:18:12.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb1d9b640 1 --2- 172.21.15.45:0/3769253624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fa0003f00 0x7f3fa00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:12.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb259c640 1 --2- 172.21.15.45:0/3769253624 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3fb406d170 0x7f3fa0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:12.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb2d9d640 1 --2- 172.21.15.45:0/3769253624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fa0004d10 0x7f3fa0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:12.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb1d9b640 1 -- 172.21.15.45:0/3769253624 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3fb406d170 msgr2=0x7f3fa0003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:12.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb1d9b640 1 --2- 172.21.15.45:0/3769253624 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3fb406d170 0x7f3fa0003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:12.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb1d9b640 1 -- 172.21.15.45:0/3769253624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fa0004d10 msgr2=0x7f3fa0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:12.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb1d9b640 1 --2- 172.21.15.45:0/3769253624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fa0004d10 0x7f3fa0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:12.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb1d9b640 1 -- 172.21.15.45:0/3769253624 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa0003530 con 0x7f3fa0003f00 2023-10-03T19:18:12.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.377+0000 7f3fb2d9d640 1 --2- 172.21.15.45:0/3769253624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fa0004d10 0x7f3fa0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:12.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.381+0000 7f3fb1d9b640 1 --2- 172.21.15.45:0/3769253624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fa0003f00 0x7f3fa00047d0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c009ae0 tx=0x7f3f9c01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba5d9c83c63a001 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:12.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.381+0000 7f3fb159a640 1 -- 172.21.15.45:0/3769253624 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c0a5680 con 0x7f3fa0003f00 2023-10-03T19:18:12.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.381+0000 7f3fb159a640 1 -- 172.21.15.45:0/3769253624 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9c0a57e0 con 0x7f3fa0003f00 2023-10-03T19:18:12.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.381+0000 7f3fb159a640 1 -- 172.21.15.45:0/3769253624 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c0a5b90 con 0x7f3fa0003f00 2023-10-03T19:18:12.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.381+0000 7f3fb8b40640 1 -- 172.21.15.45:0/3769253624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fa0003f00 msgr2=0x7f3fa00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:12.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.381+0000 7f3fb8b40640 1 --2- 172.21.15.45:0/3769253624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fa0003f00 0x7f3fa00047d0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c009ae0 tx=0x7f3f9c01ca90 comp rx=0 tx=0).stop 2023-10-03T19:18:12.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.381+0000 7f3fb2d9d640 1 -- 172.21.15.45:0/3769253624 reap_dead start 2023-10-03T19:18:12.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.381+0000 7f3fb8b40640 1 -- 172.21.15.45:0/3769253624 shutdown_connections 2023-10-03T19:18:12.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.381+0000 7f3fb8b40640 1 -- 172.21.15.45:0/3769253624 >> 172.21.15.45:0/3769253624 conn(0x7f3fb40bcf50 msgr2=0x7f3fb40bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:12.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.381+0000 7f3fb8b40640 1 -- 172.21.15.45:0/3769253624 shutdown_connections 2023-10-03T19:18:12.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.381+0000 7f3fb8b40640 1 -- 172.21.15.45:0/3769253624 wait complete. 2023-10-03T19:18:12.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.381+0000 7f3fb8b40640 1 Processor -- start 2023-10-03T19:18:12.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.381+0000 7f3fb8b40640 1 -- start start 2023-10-03T19:18:12.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.381+0000 7f3fb8b40640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3fa0003f00 0x7f3fb41e4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:12.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.381+0000 7f3fb8b40640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fb4141e00 0x7f3fb41e4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:12.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.381+0000 7f3fb8b40640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fb4141240 0x7f3fb41416b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:12.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.381+0000 7f3fb8b40640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb41e5790 con 0x7f3fb4141e00 2023-10-03T19:18:12.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.381+0000 7f3fb8b40640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb40ba5e0 con 0x7f3fb4141240 2023-10-03T19:18:12.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.381+0000 7f3fb8b40640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb4141bf0 con 0x7f3fa0003f00 2023-10-03T19:18:12.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.381+0000 7f3fb1d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fb4141e00 0x7f3fb41e4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:12.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.381+0000 7f3fb1d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fb4141e00 0x7f3fb41e4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57052/0 (socket says 172.21.15.45:57052) 2023-10-03T19:18:12.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.381+0000 7f3fb1d9b640 1 -- 172.21.15.45:0/995755306 learned_addr learned my addr 172.21.15.45:0/995755306 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:12.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.381+0000 7f3fb2d9d640 1 --2- 172.21.15.45:0/995755306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fb4141240 0x7f3fb41416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:12.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.381+0000 7f3fb259c640 1 --2- 172.21.15.45:0/995755306 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3fa0003f00 0x7f3fb41e4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:12.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.381+0000 7f3fb1d9b640 1 -- 172.21.15.45:0/995755306 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3fa0003f00 msgr2=0x7f3fb41e4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:12.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.381+0000 7f3fb1d9b640 1 --2- 172.21.15.45:0/995755306 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3fa0003f00 0x7f3fb41e4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:12.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.381+0000 7f3fb1d9b640 1 -- 172.21.15.45:0/995755306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fb4141240 msgr2=0x7f3fb41416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:12.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.381+0000 7f3fb1d9b640 1 --2- 172.21.15.45:0/995755306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fb4141240 0x7f3fb41416b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:12.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.381+0000 7f3fb1d9b640 1 -- 172.21.15.45:0/995755306 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb414fae0 con 0x7f3fb4141e00 2023-10-03T19:18:12.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.385+0000 7f3fb1d9b640 1 --2- 172.21.15.45:0/995755306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fb4141e00 0x7f3fb41e4db0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c009ae0 tx=0x7f3fa0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:12.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.385+0000 7f3faaffd640 1 -- 172.21.15.45:0/995755306 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c0be070 con 0x7f3fb4141e00 2023-10-03T19:18:12.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.385+0000 7f3faaffd640 1 -- 172.21.15.45:0/995755306 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9c004020 con 0x7f3fb4141e00 2023-10-03T19:18:12.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.385+0000 7f3fb8b40640 1 -- 172.21.15.45:0/995755306 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb406cd00 con 0x7f3fb4141e00 2023-10-03T19:18:12.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.385+0000 7f3faaffd640 1 -- 172.21.15.45:0/995755306 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c004390 con 0x7f3fb4141e00 2023-10-03T19:18:12.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.385+0000 7f3fb8b40640 1 -- 172.21.15.45:0/995755306 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb414c4a0 con 0x7f3fb4141e00 2023-10-03T19:18:12.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.385+0000 7f3fb8b40640 1 -- 172.21.15.45:0/995755306 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb406d660 con 0x7f3fb4141e00 2023-10-03T19:18:12.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.385+0000 7f3faaffd640 1 -- 172.21.15.45:0/995755306 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3f9c0b4040 con 0x7f3fb4141e00 2023-10-03T19:18:12.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.385+0000 7f3faaffd640 1 --2- 172.21.15.45:0/995755306 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3f94066280 0x7f3f94068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:12.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.385+0000 7f3faaffd640 1 -- 172.21.15.45:0/995755306 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3f9c11dcd0 con 0x7f3fb4141e00 2023-10-03T19:18:12.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.385+0000 7f3fb259c640 1 --2- 172.21.15.45:0/995755306 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3f94066280 0x7f3f94068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:12.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.385+0000 7f3fb259c640 1 --2- 172.21.15.45:0/995755306 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3f94066280 0x7f3f94068730 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4001ad0 tx=0x7f3fa4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:12.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.389+0000 7f3faaffd640 1 -- 172.21.15.45:0/995755306 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3f9c0eb270 con 0x7f3fb4141e00 2023-10-03T19:18:12.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.577+0000 7f3fb8b40640 1 -- 172.21.15.45:0/995755306 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3fb4148780 con 0x7f3fb4141e00 2023-10-03T19:18:12.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.577+0000 7f3faaffd640 1 -- 172.21.15.45:0/995755306 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+3913 (secure 0 0 0) 0x7f3f9c0ee890 con 0x7f3fb4141e00 2023-10-03T19:18:12.580 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:18:12.581 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/250992108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":250992108},{"type":"v1","addr":"172.21.15.79:6835","nonce":250992108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6339,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3153040546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3153040546},{"type":"v1","addr":"172.21.15.45:6834","nonce":3153040546}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:17:35.497011+0000","modified":"2023-10-03T19:17:38.516672+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6342},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6342":{"gid":6342,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/2939002026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2939002026},{"type":"v1","addr":"172.21.15.45:6835","nonce":2939002026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-10-03T19:18:12.581 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 36 2023-10-03T19:18:12.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.581+0000 7f3fb8b40640 1 -- 172.21.15.45:0/995755306 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3f94066280 msgr2=0x7f3f94068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:12.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.581+0000 7f3fb8b40640 1 --2- 172.21.15.45:0/995755306 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3f94066280 0x7f3f94068730 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4001ad0 tx=0x7f3fa4009040 comp rx=0 tx=0).stop 2023-10-03T19:18:12.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.581+0000 7f3fb8b40640 1 -- 172.21.15.45:0/995755306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fb4141e00 msgr2=0x7f3fb41e4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:12.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.581+0000 7f3fb8b40640 1 --2- 172.21.15.45:0/995755306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fb4141e00 0x7f3fb41e4db0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c009ae0 tx=0x7f3fa0005800 comp rx=0 tx=0).stop 2023-10-03T19:18:12.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.581+0000 7f3fb8b40640 1 -- 172.21.15.45:0/995755306 shutdown_connections 2023-10-03T19:18:12.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.581+0000 7f3fb8b40640 1 --2- 172.21.15.45:0/995755306 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3f94066280 0x7f3f94068730 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:12.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.581+0000 7f3fb8b40640 1 --2- 172.21.15.45:0/995755306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fb4141240 0x7f3fb41416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:12.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.581+0000 7f3fb8b40640 1 --2- 172.21.15.45:0/995755306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fb4141e00 0x7f3fb41e4db0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:12.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.581+0000 7f3fb8b40640 1 --2- 172.21.15.45:0/995755306 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3fa0003f00 0x7f3fb41e4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:12.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.581+0000 7f3fb8b40640 1 -- 172.21.15.45:0/995755306 >> 172.21.15.45:0/995755306 conn(0x7f3fb40bcf50 msgr2=0x7f3fb414ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:12.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.581+0000 7f3fb8b40640 1 -- 172.21.15.45:0/995755306 shutdown_connections 2023-10-03T19:18:12.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.581+0000 7f3fb8b40640 1 -- 172.21.15.45:0/995755306 wait complete. 2023-10-03T19:18:12.599 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:18:12.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.713+0000 7f9347830640 1 Processor -- start 2023-10-03T19:18:12.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.713+0000 7f9347830640 1 -- start start 2023-10-03T19:18:12.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.717+0000 7f9347830640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f93400b98f0 0x7f93400b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:12.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.717+0000 7f9347830640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f93400a2e20 0x7f934006c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:12.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.717+0000 7f9347830640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93400ba550 con 0x7f93400bc810 2023-10-03T19:18:12.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.717+0000 7f9347830640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93401526d0 con 0x7f93400b98f0 2023-10-03T19:18:12.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.717+0000 7f9347830640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93401529b0 con 0x7f93400a2e20 2023-10-03T19:18:12.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.717+0000 7f9344dcb640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f93400bc810 0x7f934006c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60974/0 (socket says 172.21.15.45:60974) 2023-10-03T19:18:12.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.717+0000 7f9344dcb640 1 -- 172.21.15.45:0/1019412574 learned_addr learned my addr 172.21.15.45:0/1019412574 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:18:12.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.717+0000 7f93455cc640 1 --2- 172.21.15.45:0/1019412574 >> v2:172.21.15.45:3300/0 conn(0x7f93400b98f0 0x7f93400b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:12.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.717+0000 7f9345dcd640 1 --2- 172.21.15.45:0/1019412574 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f93400a2e20 0x7f934006c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:12.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.717+0000 7f9333fff640 1 -- 172.21.15.45:0/1019412574 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655321957 0 0) 0x7f93400ba550 con 0x7f93400bc810 2023-10-03T19:18:12.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.717+0000 7f9333fff640 1 -- 172.21.15.45:0/1019412574 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f932c003530 con 0x7f93400bc810 2023-10-03T19:18:12.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.717+0000 7f93455cc640 1 -- 172.21.15.45:0/1019412574 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f93400a2e20 msgr2=0x7f934006c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:12.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.717+0000 7f93455cc640 1 --2- 172.21.15.45:0/1019412574 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f93400a2e20 0x7f934006c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:12.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.717+0000 7f93455cc640 1 -- 172.21.15.45:0/1019412574 >> v1:172.21.15.45:6789/0 conn(0x7f93400bc810 legacy=0x7f934006c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:12.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.717+0000 7f93455cc640 1 -- 172.21.15.45:0/1019412574 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934006cee0 con 0x7f93400b98f0 2023-10-03T19:18:12.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.717+0000 7f93455cc640 1 --2- 172.21.15.45:0/1019412574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93400b98f0 0x7f93400b9cc0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f933c009d90 tx=0x7f933c01f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b144dd2a7b1770cf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:12.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.717+0000 7f9333fff640 1 -- 172.21.15.45:0/1019412574 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c0af600 con 0x7f93400b98f0 2023-10-03T19:18:12.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.717+0000 7f9333fff640 1 -- 172.21.15.45:0/1019412574 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933c0ab050 con 0x7f93400b98f0 2023-10-03T19:18:12.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.717+0000 7f9333fff640 1 -- 172.21.15.45:0/1019412574 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c0af980 con 0x7f93400b98f0 2023-10-03T19:18:12.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f9347830640 1 -- 172.21.15.45:0/1019412574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93400b98f0 msgr2=0x7f93400b9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:12.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f9347830640 1 --2- 172.21.15.45:0/1019412574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93400b98f0 0x7f93400b9cc0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f933c009d90 tx=0x7f933c01f130 comp rx=0 tx=0).stop 2023-10-03T19:18:12.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f9347830640 1 -- 172.21.15.45:0/1019412574 shutdown_connections 2023-10-03T19:18:12.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f9347830640 1 --2- 172.21.15.45:0/1019412574 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f93400a2e20 0x7f934006c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:12.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f9347830640 1 --2- 172.21.15.45:0/1019412574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93400b98f0 0x7f93400b9cc0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:12.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f9347830640 1 -- 172.21.15.45:0/1019412574 >> 172.21.15.45:0/1019412574 conn(0x7f93400bcf50 msgr2=0x7f93400bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:12.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f9347830640 1 -- 172.21.15.45:0/1019412574 shutdown_connections 2023-10-03T19:18:12.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f9347830640 1 -- 172.21.15.45:0/1019412574 wait complete. 2023-10-03T19:18:12.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f9347830640 1 Processor -- start 2023-10-03T19:18:12.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f9347830640 1 -- start start 2023-10-03T19:18:12.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f9347830640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93400a2e20 0x7f9340149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:12.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f9347830640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93400b98f0 0x7f93401e4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:12.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f9347830640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f93400bc810 0x7f93401e45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:12.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f9347830640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934014b7a0 con 0x7f93400a2e20 2023-10-03T19:18:12.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f9347830640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934014a890 con 0x7f93400b98f0 2023-10-03T19:18:12.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f9347830640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934014a0a0 con 0x7f93400bc810 2023-10-03T19:18:12.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f93455cc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93400a2e20 0x7f9340149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:12.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f93455cc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93400a2e20 0x7f9340149b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57062/0 (socket says 172.21.15.45:57062) 2023-10-03T19:18:12.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f93455cc640 1 -- 172.21.15.45:0/4017694808 learned_addr learned my addr 172.21.15.45:0/4017694808 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:12.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f9344dcb640 1 --2- 172.21.15.45:0/4017694808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93400b98f0 0x7f93401e4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:12.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f9345dcd640 1 --2- 172.21.15.45:0/4017694808 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f93400bc810 0x7f93401e45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:12.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f93455cc640 1 -- 172.21.15.45:0/4017694808 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f93400bc810 msgr2=0x7f93401e45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:12.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f93455cc640 1 --2- 172.21.15.45:0/4017694808 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f93400bc810 0x7f93401e45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:12.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f93455cc640 1 -- 172.21.15.45:0/4017694808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93400b98f0 msgr2=0x7f93401e4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:12.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f93455cc640 1 --2- 172.21.15.45:0/4017694808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93400b98f0 0x7f93401e4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:12.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f93455cc640 1 -- 172.21.15.45:0/4017694808 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f933c009a70 con 0x7f93400a2e20 2023-10-03T19:18:12.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f93455cc640 1 --2- 172.21.15.45:0/4017694808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93400a2e20 0x7f9340149b60 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f933c0b2040 tx=0x7f933c01bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:12.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f9331ffb640 1 -- 172.21.15.45:0/4017694808 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c009450 con 0x7f93400a2e20 2023-10-03T19:18:12.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f9331ffb640 1 -- 172.21.15.45:0/4017694808 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933c0b9410 con 0x7f93400a2e20 2023-10-03T19:18:12.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f9347830640 1 -- 172.21.15.45:0/4017694808 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93400ba950 con 0x7f93400a2e20 2023-10-03T19:18:12.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f9331ffb640 1 -- 172.21.15.45:0/4017694808 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c0b97a0 con 0x7f93400a2e20 2023-10-03T19:18:12.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.721+0000 7f9347830640 1 -- 172.21.15.45:0/4017694808 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93400ba200 con 0x7f93400a2e20 2023-10-03T19:18:12.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.725+0000 7f9347830640 1 -- 172.21.15.45:0/4017694808 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93400baae0 con 0x7f93400a2e20 2023-10-03T19:18:12.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.725+0000 7f9331ffb640 1 -- 172.21.15.45:0/4017694808 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f933c0b6050 con 0x7f93400a2e20 2023-10-03T19:18:12.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.725+0000 7f9331ffb640 1 --2- 172.21.15.45:0/4017694808 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9324066280 0x7f9324068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:12.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.725+0000 7f9331ffb640 1 -- 172.21.15.45:0/4017694808 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f933c1221e0 con 0x7f93400a2e20 2023-10-03T19:18:12.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.725+0000 7f9344dcb640 1 --2- 172.21.15.45:0/4017694808 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9324066280 0x7f9324068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:12.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.725+0000 7f9344dcb640 1 --2- 172.21.15.45:0/4017694808 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9324066280 0x7f9324068730 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9340141aa0 tx=0x7f9334009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:12.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.729+0000 7f9331ffb640 1 -- 172.21.15.45:0/4017694808 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f933c0ef5d0 con 0x7f93400a2e20 2023-10-03T19:18:12.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.885+0000 7f9347830640 1 -- 172.21.15.45:0/4017694808 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f934004de80 con 0x7f93400a2e20 2023-10-03T19:18:12.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.889+0000 7f9331ffb640 1 -- 172.21.15.45:0/4017694808 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+18306 (secure 0 0 0) 0x7f933c0b4090 con 0x7f93400a2e20 2023-10-03T19:18:12.891 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:18:12.891 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":74,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:17:36.500298+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:17:33.484274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-03T19:17:34.320341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:18:12.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.889+0000 7f9347830640 1 -- 172.21.15.45:0/4017694808 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9324066280 msgr2=0x7f9324068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:12.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.889+0000 7f9347830640 1 --2- 172.21.15.45:0/4017694808 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9324066280 0x7f9324068730 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9340141aa0 tx=0x7f9334009040 comp rx=0 tx=0).stop 2023-10-03T19:18:12.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.889+0000 7f9347830640 1 -- 172.21.15.45:0/4017694808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93400a2e20 msgr2=0x7f9340149b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:12.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.889+0000 7f9347830640 1 --2- 172.21.15.45:0/4017694808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93400a2e20 0x7f9340149b60 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f933c0b2040 tx=0x7f933c01bed0 comp rx=0 tx=0).stop 2023-10-03T19:18:12.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.889+0000 7f9347830640 1 -- 172.21.15.45:0/4017694808 shutdown_connections 2023-10-03T19:18:12.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.889+0000 7f9347830640 1 --2- 172.21.15.45:0/4017694808 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9324066280 0x7f9324068730 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:12.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.889+0000 7f9347830640 1 --2- 172.21.15.45:0/4017694808 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f93400bc810 0x7f93401e45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:12.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.889+0000 7f9347830640 1 --2- 172.21.15.45:0/4017694808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93400b98f0 0x7f93401e4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:12.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.889+0000 7f9347830640 1 --2- 172.21.15.45:0/4017694808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93400a2e20 0x7f9340149b60 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:12.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.889+0000 7f9347830640 1 -- 172.21.15.45:0/4017694808 >> 172.21.15.45:0/4017694808 conn(0x7f93400bcf50 msgr2=0x7f93400a48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:12.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.889+0000 7f9347830640 1 -- 172.21.15.45:0/4017694808 shutdown_connections 2023-10-03T19:18:12.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:12.889+0000 7f9347830640 1 -- 172.21.15.45:0/4017694808 wait complete. 2023-10-03T19:18:12.910 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T19:17:33.484274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T19:17:34.320341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:18:12.911 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:18:13.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.037+0000 7f81fabb8640 1 Processor -- start 2023-10-03T19:18:13.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.037+0000 7f81fabb8640 1 -- start start 2023-10-03T19:18:13.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.041+0000 7f81fabb8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81f4070140 0x7f81f406aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:13.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.041+0000 7f81fabb8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f40a11d0 con 0x7f81f4070df0 2023-10-03T19:18:13.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.041+0000 7f81fabb8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f406a460 con 0x7f81f41500f0 2023-10-03T19:18:13.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.041+0000 7f81fabb8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f4069f70 con 0x7f81f4070140 2023-10-03T19:18:13.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.041+0000 7f81f3fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f81f4070df0 0x7f81f414c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60990/0 (socket says 172.21.15.45:60990) 2023-10-03T19:18:13.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.041+0000 7f81f3fff640 1 -- 172.21.15.45:0/4028868163 learned_addr learned my addr 172.21.15.45:0/4028868163 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:18:13.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.041+0000 7f81f9155640 1 --2- 172.21.15.45:0/4028868163 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81f4070140 0x7f81f406aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:13.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.041+0000 7f81f37fe640 1 -- 172.21.15.45:0/4028868163 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1884645952 0 0) 0x7f81f40a11d0 con 0x7f81f4070df0 2023-10-03T19:18:13.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.041+0000 7f81f37fe640 1 -- 172.21.15.45:0/4028868163 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81e0003530 con 0x7f81f4070df0 2023-10-03T19:18:13.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.041+0000 7f81f37fe640 1 -- 172.21.15.45:0/4028868163 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2197956116 0 0) 0x7f81e0003530 con 0x7f81f4070df0 2023-10-03T19:18:13.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.041+0000 7f81f37fe640 1 -- 172.21.15.45:0/4028868163 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81f4070140 msgr2=0x7f81f406aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:13.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.041+0000 7f81f37fe640 1 --2- 172.21.15.45:0/4028868163 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81f4070140 0x7f81f406aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.041+0000 7f81f37fe640 1 -- 172.21.15.45:0/4028868163 >> v1:172.21.15.79:6789/0 conn(0x7f81f41500f0 legacy=0x7f81f40a3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:13.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.041+0000 7f81f37fe640 1 -- 172.21.15.45:0/4028868163 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f41504c0 con 0x7f81f4070df0 2023-10-03T19:18:13.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.041+0000 7f81f37fe640 1 -- 172.21.15.45:0/4028868163 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f81dc001680 con 0x7f81f4070df0 2023-10-03T19:18:13.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.041+0000 7f81f37fe640 1 -- 172.21.15.45:0/4028868163 >> v1:172.21.15.45:6789/0 conn(0x7f81f4070df0 legacy=0x7f81f414c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:13.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.041+0000 7f81f37fe640 1 --2- 172.21.15.45:0/4028868163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81e00039b0 0x7f81e0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:13.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.041+0000 7f81f37fe640 1 --2- 172.21.15.45:0/4028868163 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81f4070140 0x7f81e00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:13.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.041+0000 7f81f37fe640 1 --2- 172.21.15.45:0/4028868163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81e0004d10 0x7f81e0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:13.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.041+0000 7f81f37fe640 1 -- 172.21.15.45:0/4028868163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f4069f70 con 0x7f81e00039b0 2023-10-03T19:18:13.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.041+0000 7f81f37fe640 1 -- 172.21.15.45:0/4028868163 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e000bad0 con 0x7f81e0004d10 2023-10-03T19:18:13.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.041+0000 7f81f37fe640 1 -- 172.21.15.45:0/4028868163 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e000bc60 con 0x7f81f4070140 2023-10-03T19:18:13.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.041+0000 7f81f8954640 1 --2- 172.21.15.45:0/4028868163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81e00039b0 0x7f81e0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:13.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.041+0000 7f81f3fff640 1 --2- 172.21.15.45:0/4028868163 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81f4070140 0x7f81e00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:13.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.041+0000 7f81f9155640 1 --2- 172.21.15.45:0/4028868163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81e0004d10 0x7f81e0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:13.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.041+0000 7f81f8954640 1 -- 172.21.15.45:0/4028868163 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81f4070140 msgr2=0x7f81e00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:13.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.041+0000 7f81f8954640 1 --2- 172.21.15.45:0/4028868163 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81f4070140 0x7f81e00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.041+0000 7f81f8954640 1 -- 172.21.15.45:0/4028868163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81e0004d10 msgr2=0x7f81e0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:13.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.041+0000 7f81f8954640 1 --2- 172.21.15.45:0/4028868163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81e0004d10 0x7f81e0005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.041+0000 7f81f8954640 1 -- 172.21.15.45:0/4028868163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e0003530 con 0x7f81e00039b0 2023-10-03T19:18:13.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81f8954640 1 --2- 172.21.15.45:0/4028868163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81e00039b0 0x7f81e0003dc0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f81e4001780 tx=0x7f81e401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca6959286b4a6ab server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:13.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81f37fe640 1 -- 172.21.15.45:0/4028868163 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e40052d0 con 0x7f81e00039b0 2023-10-03T19:18:13.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81f37fe640 1 -- 172.21.15.45:0/4028868163 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e40a7050 con 0x7f81e00039b0 2023-10-03T19:18:13.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81f37fe640 1 -- 172.21.15.45:0/4028868163 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4003600 con 0x7f81e00039b0 2023-10-03T19:18:13.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81fabb8640 1 -- 172.21.15.45:0/4028868163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81e00039b0 msgr2=0x7f81e0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:13.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81fabb8640 1 --2- 172.21.15.45:0/4028868163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81e00039b0 0x7f81e0003dc0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f81e4001780 tx=0x7f81e401c400 comp rx=0 tx=0).stop 2023-10-03T19:18:13.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81f9155640 1 -- 172.21.15.45:0/4028868163 reap_dead start 2023-10-03T19:18:13.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81fabb8640 1 -- 172.21.15.45:0/4028868163 shutdown_connections 2023-10-03T19:18:13.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81fabb8640 1 -- 172.21.15.45:0/4028868163 >> 172.21.15.45:0/4028868163 conn(0x7f81f40be190 msgr2=0x7f81f40be590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:13.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81fabb8640 1 -- 172.21.15.45:0/4028868163 shutdown_connections 2023-10-03T19:18:13.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81fabb8640 1 -- 172.21.15.45:0/4028868163 wait complete. 2023-10-03T19:18:13.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81fabb8640 1 Processor -- start 2023-10-03T19:18:13.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81fabb8640 1 -- start start 2023-10-03T19:18:13.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81fabb8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81e00039b0 0x7f81f414ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:13.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81fabb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81f41e7c50 0x7f81f41e0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:13.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81fabb8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81f40a6430 0x7f81f41e1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:13.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81fabb8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f40a6ca0 con 0x7f81e00039b0 2023-10-03T19:18:13.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81fabb8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f41e19d0 con 0x7f81f41e7c50 2023-10-03T19:18:13.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81fabb8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f40a4d70 con 0x7f81f40a6430 2023-10-03T19:18:13.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81f8954640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81e00039b0 0x7f81f414ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:13.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81f8954640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81e00039b0 0x7f81f414ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57072/0 (socket says 172.21.15.45:57072) 2023-10-03T19:18:13.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81f8954640 1 -- 172.21.15.45:0/3663916842 learned_addr learned my addr 172.21.15.45:0/3663916842 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:13.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81f3fff640 1 --2- 172.21.15.45:0/3663916842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81f41e7c50 0x7f81f41e0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:13.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81f9155640 1 --2- 172.21.15.45:0/3663916842 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81f40a6430 0x7f81f41e1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:13.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81f8954640 1 -- 172.21.15.45:0/3663916842 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81f40a6430 msgr2=0x7f81f41e1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:13.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81f8954640 1 --2- 172.21.15.45:0/3663916842 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81f40a6430 0x7f81f41e1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81f8954640 1 -- 172.21.15.45:0/3663916842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81f41e7c50 msgr2=0x7f81f41e0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:13.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81f8954640 1 --2- 172.21.15.45:0/3663916842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81f41e7c50 0x7f81f41e0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81f8954640 1 -- 172.21.15.45:0/3663916842 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f4150780 con 0x7f81e00039b0 2023-10-03T19:18:13.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81f9155640 1 --2- 172.21.15.45:0/3663916842 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81f40a6430 0x7f81f41e1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:18:13.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81f8954640 1 --2- 172.21.15.45:0/3663916842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81e00039b0 0x7f81f414ec80 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f81e4001780 tx=0x7f81e0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:13.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81f17fa640 1 -- 172.21.15.45:0/3663916842 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4000ee0 con 0x7f81e00039b0 2023-10-03T19:18:13.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.045+0000 7f81f17fa640 1 -- 172.21.15.45:0/3663916842 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e4007680 con 0x7f81e00039b0 2023-10-03T19:18:13.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.049+0000 7f81fabb8640 1 -- 172.21.15.45:0/3663916842 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f406a180 con 0x7f81e00039b0 2023-10-03T19:18:13.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.049+0000 7f81f17fa640 1 -- 172.21.15.45:0/3663916842 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e40069e0 con 0x7f81e00039b0 2023-10-03T19:18:13.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.049+0000 7f81fabb8640 1 -- 172.21.15.45:0/3663916842 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f4150a60 con 0x7f81e00039b0 2023-10-03T19:18:13.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.049+0000 7f81fabb8640 1 -- 172.21.15.45:0/3663916842 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f404de80 con 0x7f81e00039b0 2023-10-03T19:18:13.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.049+0000 7f81f17fa640 1 -- 172.21.15.45:0/3663916842 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f81e4006b40 con 0x7f81e00039b0 2023-10-03T19:18:13.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.049+0000 7f81f17fa640 1 --2- 172.21.15.45:0/3663916842 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f81d4066280 0x7f81d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:13.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.049+0000 7f81f17fa640 1 -- 172.21.15.45:0/3663916842 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f81e411e380 con 0x7f81e00039b0 2023-10-03T19:18:13.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.049+0000 7f81f3fff640 1 --2- 172.21.15.45:0/3663916842 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f81d4066280 0x7f81d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:13.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.049+0000 7f81f3fff640 1 --2- 172.21.15.45:0/3663916842 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f81d4066280 0x7f81d4068730 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f81f414d790 tx=0x7f81dc000f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:13.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.053+0000 7f81f17fa640 1 -- 172.21.15.45:0/3663916842 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f81e40eb890 con 0x7f81e00039b0 2023-10-03T19:18:13.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.209+0000 7f81fabb8640 1 -- 172.21.15.45:0/3663916842 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81f4069ad0 con 0x7f81e00039b0 2023-10-03T19:18:13.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.213+0000 7f81f17fa640 1 -- 172.21.15.45:0/3663916842 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) v1 ==== 93+0+10 (secure 0 0 0) 0x7f81e40eeeb0 con 0x7f81e00039b0 2023-10-03T19:18:13.215 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:18:13.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.213+0000 7f81fabb8640 1 -- 172.21.15.45:0/3663916842 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f81d4066280 msgr2=0x7f81d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:13.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.213+0000 7f81fabb8640 1 --2- 172.21.15.45:0/3663916842 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f81d4066280 0x7f81d4068730 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f81f414d790 tx=0x7f81dc000f90 comp rx=0 tx=0).stop 2023-10-03T19:18:13.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.213+0000 7f81fabb8640 1 -- 172.21.15.45:0/3663916842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81e00039b0 msgr2=0x7f81f414ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:13.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.213+0000 7f81fabb8640 1 --2- 172.21.15.45:0/3663916842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81e00039b0 0x7f81f414ec80 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f81e4001780 tx=0x7f81e0005800 comp rx=0 tx=0).stop 2023-10-03T19:18:13.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.213+0000 7f81fabb8640 1 -- 172.21.15.45:0/3663916842 shutdown_connections 2023-10-03T19:18:13.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.213+0000 7f81fabb8640 1 --2- 172.21.15.45:0/3663916842 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f81d4066280 0x7f81d4068730 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.213+0000 7f81fabb8640 1 --2- 172.21.15.45:0/3663916842 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81f40a6430 0x7f81f41e1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.213+0000 7f81fabb8640 1 --2- 172.21.15.45:0/3663916842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81f41e7c50 0x7f81f41e0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.213+0000 7f81fabb8640 1 --2- 172.21.15.45:0/3663916842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81e00039b0 0x7f81f414ec80 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.213+0000 7f81fabb8640 1 -- 172.21.15.45:0/3663916842 >> 172.21.15.45:0/3663916842 conn(0x7f81f40be190 msgr2=0x7f81f40b6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:13.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.213+0000 7f81fabb8640 1 -- 172.21.15.45:0/3663916842 shutdown_connections 2023-10-03T19:18:13.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.213+0000 7f81fabb8640 1 -- 172.21.15.45:0/3663916842 wait complete. 2023-10-03T19:18:13.233 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:18:13.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.361+0000 7fc2e595c640 1 Processor -- start 2023-10-03T19:18:13.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.361+0000 7fc2e595c640 1 -- start start 2023-10-03T19:18:13.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.361+0000 7fc2e595c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc2e00712c0 0x7fc2e00bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:13.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.361+0000 7fc2e595c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc2e006d560 0x7fc2e00bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:13.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.361+0000 7fc2e595c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc2e006c760 0x7fc2e00a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:13.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.361+0000 7fc2e595c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e006c2d0 con 0x7fc2e006c760 2023-10-03T19:18:13.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.361+0000 7fc2e595c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e0150610 con 0x7fc2e006d560 2023-10-03T19:18:13.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.361+0000 7fc2e595c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e01508b0 con 0x7fc2e00712c0 2023-10-03T19:18:13.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.361+0000 7fc2df7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc2e006c760 0x7fc2e00a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:13.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.361+0000 7fc2df7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc2e006c760 0x7fc2e00a53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57078/0 (socket says 172.21.15.45:57078) 2023-10-03T19:18:13.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.361+0000 7fc2df7fe640 1 -- 172.21.15.45:0/3975378388 learned_addr learned my addr 172.21.15.45:0/3975378388 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:13.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.361+0000 7fc2de7fc640 1 --2- 172.21.15.45:0/3975378388 >> v2:172.21.15.79:3300/0 conn(0x7fc2e006d560 0x7fc2e00bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:13.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.361+0000 7fc2deffd640 1 --2- 172.21.15.45:0/3975378388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc2e00712c0 0x7fc2e00bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:13.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.361+0000 7fc2df7fe640 1 -- 172.21.15.45:0/3975378388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc2e00712c0 msgr2=0x7fc2e00bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:13.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.361+0000 7fc2df7fe640 1 --2- 172.21.15.45:0/3975378388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc2e00712c0 0x7fc2e00bcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.361+0000 7fc2df7fe640 1 -- 172.21.15.45:0/3975378388 >> v2:172.21.15.79:3300/0 conn(0x7fc2e006d560 msgr2=0x7fc2e00bd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:13.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.361+0000 7fc2df7fe640 1 --2- 172.21.15.45:0/3975378388 >> v2:172.21.15.79:3300/0 conn(0x7fc2e006d560 0x7fc2e00bd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.361+0000 7fc2df7fe640 1 -- 172.21.15.45:0/3975378388 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e006d2e0 con 0x7fc2e006c760 2023-10-03T19:18:13.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2df7fe640 1 --2- 172.21.15.45:0/3975378388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2e006c760 0x7fc2e00a53c0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00bdf80 tx=0x7fc2d801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9b3318c403f7de server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:13.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2ddffb640 1 -- 172.21.15.45:0/3975378388 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d80ab600 con 0x7fc2e006c760 2023-10-03T19:18:13.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2ddffb640 1 -- 172.21.15.45:0/3975378388 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d80ab760 con 0x7fc2e006c760 2023-10-03T19:18:13.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2ddffb640 1 -- 172.21.15.45:0/3975378388 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d80abaf0 con 0x7fc2e006c760 2023-10-03T19:18:13.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2e595c640 1 -- 172.21.15.45:0/3975378388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2e006c760 msgr2=0x7fc2e00a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:13.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2e595c640 1 --2- 172.21.15.45:0/3975378388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2e006c760 0x7fc2e00a53c0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00bdf80 tx=0x7fc2d801c500 comp rx=0 tx=0).stop 2023-10-03T19:18:13.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2e595c640 1 -- 172.21.15.45:0/3975378388 shutdown_connections 2023-10-03T19:18:13.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2e595c640 1 --2- 172.21.15.45:0/3975378388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2e006c760 0x7fc2e00a53c0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2e595c640 1 --2- 172.21.15.45:0/3975378388 >> v2:172.21.15.79:3300/0 conn(0x7fc2e006d560 0x7fc2e00bd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2e595c640 1 --2- 172.21.15.45:0/3975378388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc2e00712c0 0x7fc2e00bcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2e595c640 1 -- 172.21.15.45:0/3975378388 >> 172.21.15.45:0/3975378388 conn(0x7fc2e00a20d0 msgr2=0x7fc2e00a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:13.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2e595c640 1 -- 172.21.15.45:0/3975378388 shutdown_connections 2023-10-03T19:18:13.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2e595c640 1 -- 172.21.15.45:0/3975378388 wait complete. 2023-10-03T19:18:13.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2e595c640 1 Processor -- start 2023-10-03T19:18:13.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2e595c640 1 -- start start 2023-10-03T19:18:13.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2e595c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2e006c760 0x7fc2e00b55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:13.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2e595c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc2e006d560 0x7fc2e01e4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:13.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2e595c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2e00712c0 0x7fc2e00b9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:13.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2e595c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e00b61b0 con 0x7fc2e006c760 2023-10-03T19:18:13.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2e595c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e00bee40 con 0x7fc2e00712c0 2023-10-03T19:18:13.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2e595c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e00be8b0 con 0x7fc2e006d560 2023-10-03T19:18:13.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2deffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2e006c760 0x7fc2e00b55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:13.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2deffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2e006c760 0x7fc2e00b55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57082/0 (socket says 172.21.15.45:57082) 2023-10-03T19:18:13.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2deffd640 1 -- 172.21.15.45:0/3580003936 learned_addr learned my addr 172.21.15.45:0/3580003936 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:13.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2df7fe640 1 --2- 172.21.15.45:0/3580003936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2e00712c0 0x7fc2e00b9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:13.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2de7fc640 1 --2- 172.21.15.45:0/3580003936 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc2e006d560 0x7fc2e01e4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:13.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2deffd640 1 -- 172.21.15.45:0/3580003936 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc2e006d560 msgr2=0x7fc2e01e4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:13.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2deffd640 1 --2- 172.21.15.45:0/3580003936 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc2e006d560 0x7fc2e01e4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2deffd640 1 -- 172.21.15.45:0/3580003936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2e00712c0 msgr2=0x7fc2e00b9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:13.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2deffd640 1 --2- 172.21.15.45:0/3580003936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2e00712c0 0x7fc2e00b9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.365+0000 7fc2deffd640 1 -- 172.21.15.45:0/3580003936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d80094d0 con 0x7fc2e006c760 2023-10-03T19:18:13.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.369+0000 7fc2deffd640 1 --2- 172.21.15.45:0/3580003936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2e006c760 0x7fc2e00b55a0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fc2d000d5f0 tx=0x7fc2d000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:13.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.369+0000 7fc2c7fff640 1 -- 172.21.15.45:0/3580003936 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d00125f0 con 0x7fc2e006c760 2023-10-03T19:18:13.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.369+0000 7fc2c7fff640 1 -- 172.21.15.45:0/3580003936 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d0012750 con 0x7fc2e006c760 2023-10-03T19:18:13.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.369+0000 7fc2e595c640 1 -- 172.21.15.45:0/3580003936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e014c780 con 0x7fc2e006c760 2023-10-03T19:18:13.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.369+0000 7fc2c7fff640 1 -- 172.21.15.45:0/3580003936 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0012ae0 con 0x7fc2e006c760 2023-10-03T19:18:13.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.369+0000 7fc2e595c640 1 -- 172.21.15.45:0/3580003936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e014c5f0 con 0x7fc2e006c760 2023-10-03T19:18:13.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.369+0000 7fc2e595c640 1 -- 172.21.15.45:0/3580003936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e014c910 con 0x7fc2e006c760 2023-10-03T19:18:13.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.369+0000 7fc2c7fff640 1 -- 172.21.15.45:0/3580003936 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc2d0012c40 con 0x7fc2e006c760 2023-10-03T19:18:13.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.369+0000 7fc2c7fff640 1 --2- 172.21.15.45:0/3580003936 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc2cc066280 0x7fc2cc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:13.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.369+0000 7fc2c7fff640 1 -- 172.21.15.45:0/3580003936 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc2d0084bd0 con 0x7fc2e006c760 2023-10-03T19:18:13.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.369+0000 7fc2de7fc640 1 --2- 172.21.15.45:0/3580003936 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc2cc066280 0x7fc2cc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:13.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.369+0000 7fc2de7fc640 1 --2- 172.21.15.45:0/3580003936 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc2cc066280 0x7fc2cc068730 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4003fd0 tx=0x7fc2d4003a00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:13.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.373+0000 7fc2c7fff640 1 -- 172.21.15.45:0/3580003936 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc2d0052130 con 0x7fc2e006c760 2023-10-03T19:18:13.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.529+0000 7fc2e595c640 1 -- 172.21.15.45:0/3580003936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc2e00bd1f0 con 0x7fc2e006c760 2023-10-03T19:18:13.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.529+0000 7fc2c7fff640 1 -- 172.21.15.45:0/3580003936 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v74) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc2d0055750 con 0x7fc2e006c760 2023-10-03T19:18:13.532 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:18:13.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.533+0000 7fc2e595c640 1 -- 172.21.15.45:0/3580003936 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc2cc066280 msgr2=0x7fc2cc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:13.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.533+0000 7fc2e595c640 1 --2- 172.21.15.45:0/3580003936 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc2cc066280 0x7fc2cc068730 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4003fd0 tx=0x7fc2d4003a00 comp rx=0 tx=0).stop 2023-10-03T19:18:13.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.533+0000 7fc2e595c640 1 -- 172.21.15.45:0/3580003936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2e006c760 msgr2=0x7fc2e00b55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:13.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.533+0000 7fc2e595c640 1 --2- 172.21.15.45:0/3580003936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2e006c760 0x7fc2e00b55a0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fc2d000d5f0 tx=0x7fc2d000dab0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.533+0000 7fc2e595c640 1 -- 172.21.15.45:0/3580003936 shutdown_connections 2023-10-03T19:18:13.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.533+0000 7fc2e595c640 1 --2- 172.21.15.45:0/3580003936 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc2cc066280 0x7fc2cc068730 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.533+0000 7fc2e595c640 1 --2- 172.21.15.45:0/3580003936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2e00712c0 0x7fc2e00b9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.533+0000 7fc2e595c640 1 --2- 172.21.15.45:0/3580003936 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc2e006d560 0x7fc2e01e4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.533+0000 7fc2e595c640 1 --2- 172.21.15.45:0/3580003936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2e006c760 0x7fc2e00b55a0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.533+0000 7fc2e595c640 1 -- 172.21.15.45:0/3580003936 >> 172.21.15.45:0/3580003936 conn(0x7fc2e00a20d0 msgr2=0x7fc2e00bbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:13.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.533+0000 7fc2e595c640 1 -- 172.21.15.45:0/3580003936 shutdown_connections 2023-10-03T19:18:13.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.533+0000 7fc2e595c640 1 -- 172.21.15.45:0/3580003936 wait complete. 2023-10-03T19:18:13.551 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T19:18:13.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.669+0000 7fd1ce0b0640 1 Processor -- start 2023-10-03T19:18:13.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.669+0000 7fd1ce0b0640 1 -- start start 2023-10-03T19:18:13.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.673+0000 7fd1ce0b0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1c814f510 0x7fd1c814b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:13.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.673+0000 7fd1ce0b0640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd1c80bd9f0 0x7fd1c814b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:13.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.673+0000 7fd1ce0b0640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c814f080 con 0x7fd1c806f880 2023-10-03T19:18:13.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.673+0000 7fd1ce0b0640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c806f3e0 con 0x7fd1c80bd9f0 2023-10-03T19:18:13.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.673+0000 7fd1ce0b0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c8070e90 con 0x7fd1c814f510 2023-10-03T19:18:13.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.673+0000 7fd1bffff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1c814f510 0x7fd1c814b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:13.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.673+0000 7fd1bffff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1c814f510 0x7fd1c814b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:49660/0 (socket says 172.21.15.45:49660) 2023-10-03T19:18:13.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.673+0000 7fd1bffff640 1 -- 172.21.15.45:0/2763779382 learned_addr learned my addr 172.21.15.45:0/2763779382 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:13.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.673+0000 7fd1c7fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd1c80bd9f0 0x7fd1c814b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:13.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.673+0000 7fd1bffff640 1 -- 172.21.15.45:0/2763779382 >> v2:172.21.15.79:3300/0 conn(0x7fd1c80bd9f0 msgr2=0x7fd1c814b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:13.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.673+0000 7fd1bffff640 1 --2- 172.21.15.45:0/2763779382 >> v2:172.21.15.79:3300/0 conn(0x7fd1c80bd9f0 0x7fd1c814b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.673+0000 7fd1bffff640 1 -- 172.21.15.45:0/2763779382 >> v1:172.21.15.79:6789/0 conn(0x7fd1c806f880 legacy=0x7fd1c80a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:13.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.673+0000 7fd1bffff640 1 -- 172.21.15.45:0/2763779382 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c814ea30 con 0x7fd1c814f510 2023-10-03T19:18:13.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.673+0000 7fd1bffff640 1 --2- 172.21.15.45:0/2763779382 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1c814f510 0x7fd1c814b320 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0009870 tx=0x7fd1b001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce05a6cf7201ca4c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:13.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.673+0000 7fd1c6ffd640 1 -- 172.21.15.45:0/2763779382 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b00ab670 con 0x7fd1c814f510 2023-10-03T19:18:13.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.677+0000 7fd1c6ffd640 1 -- 172.21.15.45:0/2763779382 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b00ab7d0 con 0x7fd1c814f510 2023-10-03T19:18:13.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.677+0000 7fd1c6ffd640 1 -- 172.21.15.45:0/2763779382 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b00abb60 con 0x7fd1c814f510 2023-10-03T19:18:13.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.677+0000 7fd1ce0b0640 1 -- 172.21.15.45:0/2763779382 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1c814f510 msgr2=0x7fd1c814b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:13.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.677+0000 7fd1ce0b0640 1 --2- 172.21.15.45:0/2763779382 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1c814f510 0x7fd1c814b320 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0009870 tx=0x7fd1b001c510 comp rx=0 tx=0).stop 2023-10-03T19:18:13.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.677+0000 7fd1ce0b0640 1 -- 172.21.15.45:0/2763779382 shutdown_connections 2023-10-03T19:18:13.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.677+0000 7fd1ce0b0640 1 --2- 172.21.15.45:0/2763779382 >> v2:172.21.15.79:3300/0 conn(0x7fd1c80bd9f0 0x7fd1c814b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.677+0000 7fd1ce0b0640 1 --2- 172.21.15.45:0/2763779382 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1c814f510 0x7fd1c814b320 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.677+0000 7fd1ce0b0640 1 -- 172.21.15.45:0/2763779382 >> 172.21.15.45:0/2763779382 conn(0x7fd1c80a20d0 msgr2=0x7fd1c80a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:13.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.677+0000 7fd1ce0b0640 1 -- 172.21.15.45:0/2763779382 shutdown_connections 2023-10-03T19:18:13.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.677+0000 7fd1ce0b0640 1 -- 172.21.15.45:0/2763779382 wait complete. 2023-10-03T19:18:13.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.677+0000 7fd1ce0b0640 1 Processor -- start 2023-10-03T19:18:13.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.677+0000 7fd1ce0b0640 1 -- start start 2023-10-03T19:18:13.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.677+0000 7fd1ce0b0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1c806f880 0x7fd1c81474c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:13.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.677+0000 7fd1ce0b0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1c80bd9f0 0x7fd1c80b9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:13.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.677+0000 7fd1ce0b0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1c814f510 0x7fd1c80bf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:13.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.677+0000 7fd1ce0b0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c80bf470 con 0x7fd1c80bd9f0 2023-10-03T19:18:13.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.677+0000 7fd1ce0b0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c80b9f50 con 0x7fd1c806f880 2023-10-03T19:18:13.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.677+0000 7fd1ce0b0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c81468c0 con 0x7fd1c814f510 2023-10-03T19:18:13.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.677+0000 7fd1bffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1c80bd9f0 0x7fd1c80b9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:13.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.677+0000 7fd1bffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1c80bd9f0 0x7fd1c80b9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57092/0 (socket says 172.21.15.45:57092) 2023-10-03T19:18:13.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.677+0000 7fd1bffff640 1 -- 172.21.15.45:0/1838346068 learned_addr learned my addr 172.21.15.45:0/1838346068 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:13.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.677+0000 7fd1c77fe640 1 --2- 172.21.15.45:0/1838346068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1c806f880 0x7fd1c81474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:13.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.677+0000 7fd1c7fff640 1 --2- 172.21.15.45:0/1838346068 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1c814f510 0x7fd1c80bf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:13.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.681+0000 7fd1bffff640 1 -- 172.21.15.45:0/1838346068 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1c814f510 msgr2=0x7fd1c80bf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:13.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.681+0000 7fd1bffff640 1 --2- 172.21.15.45:0/1838346068 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1c814f510 0x7fd1c80bf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.681+0000 7fd1bffff640 1 -- 172.21.15.45:0/1838346068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1c806f880 msgr2=0x7fd1c81474c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:13.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.681+0000 7fd1bffff640 1 --2- 172.21.15.45:0/1838346068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1c806f880 0x7fd1c81474c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.681+0000 7fd1bffff640 1 -- 172.21.15.45:0/1838346068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b00094d0 con 0x7fd1c80bd9f0 2023-10-03T19:18:13.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.681+0000 7fd1bffff640 1 --2- 172.21.15.45:0/1838346068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1c80bd9f0 0x7fd1c80b9a10 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fd1b001abc0 tx=0x7fd1b00192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:13.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.681+0000 7fd1c4ff9640 1 -- 172.21.15.45:0/1838346068 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b00b5810 con 0x7fd1c80bd9f0 2023-10-03T19:18:13.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.681+0000 7fd1c4ff9640 1 -- 172.21.15.45:0/1838346068 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b00b5970 con 0x7fd1c80bd9f0 2023-10-03T19:18:13.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.681+0000 7fd1c4ff9640 1 -- 172.21.15.45:0/1838346068 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b00b5d20 con 0x7fd1c80bd9f0 2023-10-03T19:18:13.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.681+0000 7fd1ce0b0640 1 -- 172.21.15.45:0/1838346068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c80a6050 con 0x7fd1c80bd9f0 2023-10-03T19:18:13.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.681+0000 7fd1ce0b0640 1 -- 172.21.15.45:0/1838346068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c806fc50 con 0x7fd1c80bd9f0 2023-10-03T19:18:13.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.681+0000 7fd1ce0b0640 1 -- 172.21.15.45:0/1838346068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c80a61e0 con 0x7fd1c80bd9f0 2023-10-03T19:18:13.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.681+0000 7fd1c4ff9640 1 -- 172.21.15.45:0/1838346068 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd1b00b4390 con 0x7fd1c80bd9f0 2023-10-03T19:18:13.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.681+0000 7fd1c4ff9640 1 --2- 172.21.15.45:0/1838346068 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd1a8066280 0x7fd1a8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:13.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.681+0000 7fd1c4ff9640 1 -- 172.21.15.45:0/1838346068 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd1b011e0b0 con 0x7fd1c80bd9f0 2023-10-03T19:18:13.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.681+0000 7fd1c77fe640 1 --2- 172.21.15.45:0/1838346068 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd1a8066280 0x7fd1a8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:13.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.685+0000 7fd1c77fe640 1 --2- 172.21.15.45:0/1838346068 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd1a8066280 0x7fd1a8068730 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8148b20 tx=0x7fd1b8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:13.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.685+0000 7fd1c4ff9640 1 -- 172.21.15.45:0/1838346068 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd1b00eb490 con 0x7fd1c80bd9f0 2023-10-03T19:18:13.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.841+0000 7fd1ce0b0640 1 -- 172.21.15.45:0/1838346068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd1c8142920 con 0x7fd1c80bd9f0 2023-10-03T19:18:13.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.841+0000 7fd1c4ff9640 1 -- 172.21.15.45:0/1838346068 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v74) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd1c8142920 con 0x7fd1c80bd9f0 2023-10-03T19:18:13.845 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-03T19:18:13.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.845+0000 7fd1ce0b0640 1 -- 172.21.15.45:0/1838346068 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd1a8066280 msgr2=0x7fd1a8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:13.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.845+0000 7fd1ce0b0640 1 --2- 172.21.15.45:0/1838346068 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd1a8066280 0x7fd1a8068730 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8148b20 tx=0x7fd1b8009040 comp rx=0 tx=0).stop 2023-10-03T19:18:13.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.845+0000 7fd1ce0b0640 1 -- 172.21.15.45:0/1838346068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1c80bd9f0 msgr2=0x7fd1c80b9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:13.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.845+0000 7fd1ce0b0640 1 --2- 172.21.15.45:0/1838346068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1c80bd9f0 0x7fd1c80b9a10 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fd1b001abc0 tx=0x7fd1b00192b0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.845+0000 7fd1ce0b0640 1 -- 172.21.15.45:0/1838346068 shutdown_connections 2023-10-03T19:18:13.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.845+0000 7fd1ce0b0640 1 --2- 172.21.15.45:0/1838346068 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd1a8066280 0x7fd1a8068730 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.845+0000 7fd1ce0b0640 1 --2- 172.21.15.45:0/1838346068 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1c814f510 0x7fd1c80bf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.845+0000 7fd1ce0b0640 1 --2- 172.21.15.45:0/1838346068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1c80bd9f0 0x7fd1c80b9a10 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.845+0000 7fd1ce0b0640 1 --2- 172.21.15.45:0/1838346068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1c806f880 0x7fd1c81474c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.845+0000 7fd1ce0b0640 1 -- 172.21.15.45:0/1838346068 >> 172.21.15.45:0/1838346068 conn(0x7fd1c80a20d0 msgr2=0x7fd1c80a24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:13.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.845+0000 7fd1ce0b0640 1 -- 172.21.15.45:0/1838346068 shutdown_connections 2023-10-03T19:18:13.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.845+0000 7fd1ce0b0640 1 -- 172.21.15.45:0/1838346068 wait complete. 2023-10-03T19:18:13.864 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T19:18:13.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.993+0000 7fc75f261640 1 Processor -- start 2023-10-03T19:18:13.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.993+0000 7fc75f261640 1 -- start start 2023-10-03T19:18:13.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.993+0000 7fc75f261640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc7580712c0 0x7fc7580bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:13.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.993+0000 7fc75f261640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc75806d560 0x7fc7580bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:13.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.993+0000 7fc75f261640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc75806c760 0x7fc7580a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:13.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.993+0000 7fc75f261640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc75806c2d0 con 0x7fc7580712c0 2023-10-03T19:18:13.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.993+0000 7fc75f261640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc758150610 con 0x7fc75806d560 2023-10-03T19:18:13.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.993+0000 7fc75f261640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7581508b0 con 0x7fc75806c760 2023-10-03T19:18:13.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.993+0000 7fc75cffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc7580712c0 0x7fc7580bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:13.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.993+0000 7fc75cffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc7580712c0 0x7fc7580bcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57096/0 (socket says 172.21.15.45:57096) 2023-10-03T19:18:13.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.993+0000 7fc75cffd640 1 -- 172.21.15.45:0/1131830223 learned_addr learned my addr 172.21.15.45:0/1131830223 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:13.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.993+0000 7fc757fff640 1 --2- 172.21.15.45:0/1131830223 >> v2:172.21.15.79:3300/0 conn(0x7fc75806d560 0x7fc7580bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:13.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.993+0000 7fc75d7fe640 1 --2- 172.21.15.45:0/1131830223 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc75806c760 0x7fc7580a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:13.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.993+0000 7fc75cffd640 1 -- 172.21.15.45:0/1131830223 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc75806c760 msgr2=0x7fc7580a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:13.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.993+0000 7fc75cffd640 1 --2- 172.21.15.45:0/1131830223 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc75806c760 0x7fc7580a53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.993+0000 7fc75cffd640 1 -- 172.21.15.45:0/1131830223 >> v2:172.21.15.79:3300/0 conn(0x7fc75806d560 msgr2=0x7fc7580bd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:13.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.993+0000 7fc75cffd640 1 --2- 172.21.15.45:0/1131830223 >> v2:172.21.15.79:3300/0 conn(0x7fc75806d560 0x7fc7580bd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:13.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.993+0000 7fc75cffd640 1 -- 172.21.15.45:0/1131830223 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75806d2e0 con 0x7fc7580712c0 2023-10-03T19:18:13.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.997+0000 7fc75cffd640 1 --2- 172.21.15.45:0/1131830223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7580712c0 0x7fc7580bcbc0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fc75806ba20 tx=0x7fc74801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b03381274b3044 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:13.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.997+0000 7fc7577fe640 1 -- 172.21.15.45:0/1131830223 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7480ab600 con 0x7fc7580712c0 2023-10-03T19:18:13.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.997+0000 7fc7577fe640 1 -- 172.21.15.45:0/1131830223 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7480ab760 con 0x7fc7580712c0 2023-10-03T19:18:13.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.997+0000 7fc7577fe640 1 -- 172.21.15.45:0/1131830223 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7480abaf0 con 0x7fc7580712c0 2023-10-03T19:18:13.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.997+0000 7fc75f261640 1 -- 172.21.15.45:0/1131830223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7580712c0 msgr2=0x7fc7580bcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:13.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.997+0000 7fc75f261640 1 --2- 172.21.15.45:0/1131830223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7580712c0 0x7fc7580bcbc0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fc75806ba20 tx=0x7fc74801c500 comp rx=0 tx=0).stop 2023-10-03T19:18:13.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.997+0000 7fc75f261640 1 -- 172.21.15.45:0/1131830223 shutdown_connections 2023-10-03T19:18:14.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.997+0000 7fc75f261640 1 --2- 172.21.15.45:0/1131830223 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc75806c760 0x7fc7580a53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.997+0000 7fc75f261640 1 --2- 172.21.15.45:0/1131830223 >> v2:172.21.15.79:3300/0 conn(0x7fc75806d560 0x7fc7580bd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.997+0000 7fc75f261640 1 --2- 172.21.15.45:0/1131830223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7580712c0 0x7fc7580bcbc0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.997+0000 7fc75f261640 1 -- 172.21.15.45:0/1131830223 >> 172.21.15.45:0/1131830223 conn(0x7fc7580a20d0 msgr2=0x7fc7580a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:14.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.997+0000 7fc75f261640 1 -- 172.21.15.45:0/1131830223 shutdown_connections 2023-10-03T19:18:14.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.997+0000 7fc75f261640 1 -- 172.21.15.45:0/1131830223 wait complete. 2023-10-03T19:18:14.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.997+0000 7fc75f261640 1 Processor -- start 2023-10-03T19:18:14.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.997+0000 7fc75f261640 1 -- start start 2023-10-03T19:18:14.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.997+0000 7fc75f261640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc75806c760 0x7fc75814eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:14.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.997+0000 7fc75f261640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc75806d560 0x7fc75813b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:14.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.997+0000 7fc75f261640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7580712c0 0x7fc75806fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:14.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.997+0000 7fc75f261640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75814fae0 con 0x7fc75806c760 2023-10-03T19:18:14.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.997+0000 7fc75f261640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc758145d90 con 0x7fc7580712c0 2023-10-03T19:18:14.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.997+0000 7fc75f261640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75814f1b0 con 0x7fc75806d560 2023-10-03T19:18:14.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.997+0000 7fc75cffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc75806c760 0x7fc75814eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:14.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.997+0000 7fc75cffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc75806c760 0x7fc75814eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57098/0 (socket says 172.21.15.45:57098) 2023-10-03T19:18:14.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.997+0000 7fc75cffd640 1 -- 172.21.15.45:0/1163860332 learned_addr learned my addr 172.21.15.45:0/1163860332 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:14.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.997+0000 7fc75cffd640 1 -- 172.21.15.45:0/1163860332 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc75806d560 msgr2=0x7fc75813b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:14.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.997+0000 7fc75cffd640 1 --2- 172.21.15.45:0/1163860332 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc75806d560 0x7fc75813b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.997+0000 7fc75cffd640 1 -- 172.21.15.45:0/1163860332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7580712c0 msgr2=0x7fc75806fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:14.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.997+0000 7fc75cffd640 1 --2- 172.21.15.45:0/1163860332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7580712c0 0x7fc75806fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.997+0000 7fc75cffd640 1 -- 172.21.15.45:0/1163860332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7480094d0 con 0x7fc75806c760 2023-10-03T19:18:14.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:13.997+0000 7fc75cffd640 1 --2- 172.21.15.45:0/1163860332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc75806c760 0x7fc75814eb90 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fc74801abb0 tx=0x7fc74801ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:14.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.001+0000 7fc7557fa640 1 -- 172.21.15.45:0/1163860332 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7480b4800 con 0x7fc75806c760 2023-10-03T19:18:14.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.001+0000 7fc7557fa640 1 -- 172.21.15.45:0/1163860332 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7480b4980 con 0x7fc75806c760 2023-10-03T19:18:14.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.001+0000 7fc75f261640 1 -- 172.21.15.45:0/1163860332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc75814c780 con 0x7fc75806c760 2023-10-03T19:18:14.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.001+0000 7fc7557fa640 1 -- 172.21.15.45:0/1163860332 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7480b4d30 con 0x7fc75806c760 2023-10-03T19:18:14.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.001+0000 7fc75f261640 1 -- 172.21.15.45:0/1163860332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc75814c5f0 con 0x7fc75806c760 2023-10-03T19:18:14.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.001+0000 7fc75f261640 1 -- 172.21.15.45:0/1163860332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc75814c910 con 0x7fc75806c760 2023-10-03T19:18:14.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.001+0000 7fc7557fa640 1 -- 172.21.15.45:0/1163860332 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc7480b3380 con 0x7fc75806c760 2023-10-03T19:18:14.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.001+0000 7fc7557fa640 1 --2- 172.21.15.45:0/1163860332 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc744066280 0x7fc744068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:14.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.001+0000 7fc7557fa640 1 -- 172.21.15.45:0/1163860332 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc74811d490 con 0x7fc75806c760 2023-10-03T19:18:14.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.001+0000 7fc757fff640 1 --2- 172.21.15.45:0/1163860332 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc744066280 0x7fc744068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:14.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.001+0000 7fc757fff640 1 --2- 172.21.15.45:0/1163860332 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc744066280 0x7fc744068730 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc7581494a0 tx=0x7fc74c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:14.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.005+0000 7fc7557fa640 1 -- 172.21.15.45:0/1163860332 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc7480ea910 con 0x7fc75806c760 2023-10-03T19:18:14.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.157+0000 7fc75f261640 1 -- 172.21.15.45:0/1163860332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc7580bd1f0 con 0x7fc75806c760 2023-10-03T19:18:14.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.161+0000 7fc7557fa640 1 -- 172.21.15.45:0/1163860332 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v74) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc7480edf30 con 0x7fc75806c760 2023-10-03T19:18:14.163 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-03T19:18:14.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.161+0000 7fc75f261640 1 -- 172.21.15.45:0/1163860332 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc744066280 msgr2=0x7fc744068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:14.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.161+0000 7fc75f261640 1 --2- 172.21.15.45:0/1163860332 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc744066280 0x7fc744068730 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc7581494a0 tx=0x7fc74c008040 comp rx=0 tx=0).stop 2023-10-03T19:18:14.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.161+0000 7fc75f261640 1 -- 172.21.15.45:0/1163860332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc75806c760 msgr2=0x7fc75814eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:14.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.161+0000 7fc75f261640 1 --2- 172.21.15.45:0/1163860332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc75806c760 0x7fc75814eb90 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fc74801abb0 tx=0x7fc74801ad40 comp rx=0 tx=0).stop 2023-10-03T19:18:14.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.161+0000 7fc75f261640 1 -- 172.21.15.45:0/1163860332 shutdown_connections 2023-10-03T19:18:14.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.161+0000 7fc75f261640 1 --2- 172.21.15.45:0/1163860332 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc744066280 0x7fc744068730 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.161+0000 7fc75f261640 1 --2- 172.21.15.45:0/1163860332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7580712c0 0x7fc75806fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.161+0000 7fc75f261640 1 --2- 172.21.15.45:0/1163860332 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc75806d560 0x7fc75813b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.161+0000 7fc75f261640 1 --2- 172.21.15.45:0/1163860332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc75806c760 0x7fc75814eb90 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.161+0000 7fc75f261640 1 -- 172.21.15.45:0/1163860332 >> 172.21.15.45:0/1163860332 conn(0x7fc7580a20d0 msgr2=0x7fc7580bacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:14.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.161+0000 7fc75f261640 1 -- 172.21.15.45:0/1163860332 shutdown_connections 2023-10-03T19:18:14.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.161+0000 7fc75f261640 1 -- 172.21.15.45:0/1163860332 wait complete. 2023-10-03T19:18:14.181 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:18:14.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.305+0000 7fb023601640 1 Processor -- start 2023-10-03T19:18:14.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.305+0000 7fb023601640 1 -- start start 2023-10-03T19:18:14.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.305+0000 7fb023601640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb01c0bf370 0x7fb01c149760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:14.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.305+0000 7fb023601640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb01c0a7100 0x7fb01c149ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:14.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.305+0000 7fb023601640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb01c14c770 con 0x7fb01c06f5f0 2023-10-03T19:18:14.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.305+0000 7fb023601640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb01c150c00 con 0x7fb01c0bf370 2023-10-03T19:18:14.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.305+0000 7fb023601640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb01c0bebc0 con 0x7fb01c0a7100 2023-10-03T19:18:14.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.305+0000 7fb02139d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb01c0bf370 0x7fb01c149760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:14.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.305+0000 7fb02139d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb01c0bf370 0x7fb01c149760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57106/0 (socket says 172.21.15.45:57106) 2023-10-03T19:18:14.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.305+0000 7fb02139d640 1 -- 172.21.15.45:0/1644919995 learned_addr learned my addr 172.21.15.45:0/1644919995 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:14.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.305+0000 7fb020b9c640 1 --2- 172.21.15.45:0/1644919995 >> v2:172.21.15.79:3300/0 conn(0x7fb01c0a7100 0x7fb01c149ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:14.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.305+0000 7fb02139d640 1 -- 172.21.15.45:0/1644919995 >> v2:172.21.15.79:3300/0 conn(0x7fb01c0a7100 msgr2=0x7fb01c149ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:14.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.305+0000 7fb02139d640 1 --2- 172.21.15.45:0/1644919995 >> v2:172.21.15.79:3300/0 conn(0x7fb01c0a7100 0x7fb01c149ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.305+0000 7fb02139d640 1 -- 172.21.15.45:0/1644919995 >> v1:172.21.15.79:6789/0 conn(0x7fb01c06f5f0 legacy=0x7fb01c14cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:14.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.305+0000 7fb02139d640 1 -- 172.21.15.45:0/1644919995 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c06efe0 con 0x7fb01c0bf370 2023-10-03T19:18:14.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.305+0000 7fb02139d640 1 --2- 172.21.15.45:0/1644919995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb01c0bf370 0x7fb01c149760 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0a5450 tx=0x7fb01801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb857292fe382ba0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:14.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb013fff640 1 -- 172.21.15.45:0/1644919995 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0180ab650 con 0x7fb01c0bf370 2023-10-03T19:18:14.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb013fff640 1 -- 172.21.15.45:0/1644919995 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0180ab7b0 con 0x7fb01c0bf370 2023-10-03T19:18:14.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb013fff640 1 -- 172.21.15.45:0/1644919995 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0180abb40 con 0x7fb01c0bf370 2023-10-03T19:18:14.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb023601640 1 -- 172.21.15.45:0/1644919995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb01c0bf370 msgr2=0x7fb01c149760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:14.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb023601640 1 --2- 172.21.15.45:0/1644919995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb01c0bf370 0x7fb01c149760 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0a5450 tx=0x7fb01801c430 comp rx=0 tx=0).stop 2023-10-03T19:18:14.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb023601640 1 -- 172.21.15.45:0/1644919995 shutdown_connections 2023-10-03T19:18:14.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb023601640 1 --2- 172.21.15.45:0/1644919995 >> v2:172.21.15.79:3300/0 conn(0x7fb01c0a7100 0x7fb01c149ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb023601640 1 --2- 172.21.15.45:0/1644919995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb01c0bf370 0x7fb01c149760 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb023601640 1 -- 172.21.15.45:0/1644919995 >> 172.21.15.45:0/1644919995 conn(0x7fb01c06bce0 msgr2=0x7fb01c06c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:14.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb023601640 1 -- 172.21.15.45:0/1644919995 shutdown_connections 2023-10-03T19:18:14.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb023601640 1 -- 172.21.15.45:0/1644919995 wait complete. 2023-10-03T19:18:14.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb023601640 1 Processor -- start 2023-10-03T19:18:14.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb023601640 1 -- start start 2023-10-03T19:18:14.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb023601640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb01c06f5f0 0x7fb01c0c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:14.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb023601640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb01c0a7100 0x7fb01c0c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:14.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb023601640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb01c0bf370 0x7fb01c142260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:14.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb023601640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c1465d0 con 0x7fb01c0bf370 2023-10-03T19:18:14.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb023601640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c0a1d60 con 0x7fb01c06f5f0 2023-10-03T19:18:14.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb023601640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c14db20 con 0x7fb01c0a7100 2023-10-03T19:18:14.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb021b9e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb01c0bf370 0x7fb01c142260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:14.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb021b9e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb01c0bf370 0x7fb01c142260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57108/0 (socket says 172.21.15.45:57108) 2023-10-03T19:18:14.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb021b9e640 1 -- 172.21.15.45:0/3163130912 learned_addr learned my addr 172.21.15.45:0/3163130912 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:14.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb02139d640 1 --2- 172.21.15.45:0/3163130912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb01c06f5f0 0x7fb01c0c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:14.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb020b9c640 1 --2- 172.21.15.45:0/3163130912 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb01c0a7100 0x7fb01c0c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:14.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb021b9e640 1 -- 172.21.15.45:0/3163130912 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb01c0a7100 msgr2=0x7fb01c0c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:14.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb021b9e640 1 --2- 172.21.15.45:0/3163130912 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb01c0a7100 0x7fb01c0c20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb021b9e640 1 -- 172.21.15.45:0/3163130912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb01c06f5f0 msgr2=0x7fb01c0c1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:14.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb021b9e640 1 --2- 172.21.15.45:0/3163130912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb01c06f5f0 0x7fb01c0c1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb021b9e640 1 -- 172.21.15.45:0/3163130912 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0180094d0 con 0x7fb01c0bf370 2023-10-03T19:18:14.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb021b9e640 1 --2- 172.21.15.45:0/3163130912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb01c0bf370 0x7fb01c142260 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fb01400c780 tx=0x7fb01400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:14.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb011ffb640 1 -- 172.21.15.45:0/3163130912 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb014004b70 con 0x7fb01c0bf370 2023-10-03T19:18:14.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb011ffb640 1 -- 172.21.15.45:0/3163130912 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01400ce90 con 0x7fb01c0bf370 2023-10-03T19:18:14.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb011ffb640 1 -- 172.21.15.45:0/3163130912 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01400a850 con 0x7fb01c0bf370 2023-10-03T19:18:14.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb023601640 1 -- 172.21.15.45:0/3163130912 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01c0bf8d0 con 0x7fb01c0bf370 2023-10-03T19:18:14.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.309+0000 7fb023601640 1 -- 172.21.15.45:0/3163130912 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01c0bf740 con 0x7fb01c0bf370 2023-10-03T19:18:14.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.313+0000 7fb023601640 1 -- 172.21.15.45:0/3163130912 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01c150400 con 0x7fb01c0bf370 2023-10-03T19:18:14.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.313+0000 7fb011ffb640 1 -- 172.21.15.45:0/3163130912 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb01400a9b0 con 0x7fb01c0bf370 2023-10-03T19:18:14.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.313+0000 7fb011ffb640 1 --2- 172.21.15.45:0/3163130912 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb000066280 0x7fb000068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:14.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.313+0000 7fb011ffb640 1 -- 172.21.15.45:0/3163130912 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb014083f60 con 0x7fb01c0bf370 2023-10-03T19:18:14.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.313+0000 7fb02139d640 1 --2- 172.21.15.45:0/3163130912 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb000066280 0x7fb000068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:14.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.313+0000 7fb02139d640 1 --2- 172.21.15.45:0/3163130912 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb000066280 0x7fb000068730 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb0180af000 tx=0x7fb0180a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:14.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.317+0000 7fb011ffb640 1 -- 172.21.15.45:0/3163130912 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb014054dd0 con 0x7fb01c0bf370 2023-10-03T19:18:14.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.505+0000 7fb023601640 1 -- 172.21.15.45:0/3163130912 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb01c146740 con 0x7fb01c0bf370 2023-10-03T19:18:14.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.505+0000 7fb011ffb640 1 -- 172.21.15.45:0/3163130912 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+3913 (secure 0 0 0) 0x7fb01c146740 con 0x7fb01c0bf370 2023-10-03T19:18:14.508 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:18:14.508 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/250992108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":250992108},{"type":"v1","addr":"172.21.15.79:6835","nonce":250992108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6339,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3153040546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3153040546},{"type":"v1","addr":"172.21.15.45:6834","nonce":3153040546}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:17:35.497011+0000","modified":"2023-10-03T19:17:38.516672+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6342},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6342":{"gid":6342,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/2939002026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2939002026},{"type":"v1","addr":"172.21.15.45:6835","nonce":2939002026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-10-03T19:18:14.508 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 36 2023-10-03T19:18:14.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.505+0000 7fb023601640 1 -- 172.21.15.45:0/3163130912 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb000066280 msgr2=0x7fb000068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:14.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.505+0000 7fb023601640 1 --2- 172.21.15.45:0/3163130912 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb000066280 0x7fb000068730 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb0180af000 tx=0x7fb0180a7000 comp rx=0 tx=0).stop 2023-10-03T19:18:14.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.505+0000 7fb023601640 1 -- 172.21.15.45:0/3163130912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb01c0bf370 msgr2=0x7fb01c142260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:14.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.505+0000 7fb023601640 1 --2- 172.21.15.45:0/3163130912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb01c0bf370 0x7fb01c142260 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fb01400c780 tx=0x7fb01400cc40 comp rx=0 tx=0).stop 2023-10-03T19:18:14.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.505+0000 7fb023601640 1 -- 172.21.15.45:0/3163130912 shutdown_connections 2023-10-03T19:18:14.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.505+0000 7fb023601640 1 --2- 172.21.15.45:0/3163130912 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb000066280 0x7fb000068730 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.505+0000 7fb023601640 1 --2- 172.21.15.45:0/3163130912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb01c0bf370 0x7fb01c142260 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.505+0000 7fb023601640 1 --2- 172.21.15.45:0/3163130912 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb01c0a7100 0x7fb01c0c20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.505+0000 7fb023601640 1 --2- 172.21.15.45:0/3163130912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb01c06f5f0 0x7fb01c0c1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.505+0000 7fb023601640 1 -- 172.21.15.45:0/3163130912 >> 172.21.15.45:0/3163130912 conn(0x7fb01c06bce0 msgr2=0x7fb01c157580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:14.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.505+0000 7fb023601640 1 -- 172.21.15.45:0/3163130912 shutdown_connections 2023-10-03T19:18:14.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.505+0000 7fb023601640 1 -- 172.21.15.45:0/3163130912 wait complete. 2023-10-03T19:18:14.525 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:18:14.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c7be9640 1 Processor -- start 2023-10-03T19:18:14.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c7be9640 1 -- start start 2023-10-03T19:18:14.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c7be9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21c00c1320 0x7f21c00c16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:14.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c7be9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f21c00aa370 0x7f21c00a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:14.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c7be9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c00c0a10 con 0x7f21c00c2810 2023-10-03T19:18:14.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c7be9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c00bf840 con 0x7f21c00aa370 2023-10-03T19:18:14.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c7be9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c00c11a0 con 0x7f21c00c1320 2023-10-03T19:18:14.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c5184640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f21c00c2810 0x7f21c00a39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39486/0 (socket says 172.21.15.45:39486) 2023-10-03T19:18:14.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c5184640 1 -- 172.21.15.45:0/1433761329 learned_addr learned my addr 172.21.15.45:0/1433761329 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:18:14.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c6186640 1 --2- 172.21.15.45:0/1433761329 >> v2:172.21.15.79:3300/0 conn(0x7f21c00aa370 0x7f21c00a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:14.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c5985640 1 --2- 172.21.15.45:0/1433761329 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21c00c1320 0x7f21c00c16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:14.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c4983640 1 -- 172.21.15.45:0/1433761329 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 352247636 0 0) 0x7f21c00c0a10 con 0x7f21c00c2810 2023-10-03T19:18:14.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c4983640 1 -- 172.21.15.45:0/1433761329 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21ac003530 con 0x7f21c00c2810 2023-10-03T19:18:14.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c4983640 1 -- 172.21.15.45:0/1433761329 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4133328437 0 0) 0x7f21ac003530 con 0x7f21c00c2810 2023-10-03T19:18:14.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c4983640 1 -- 172.21.15.45:0/1433761329 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21c00c1320 msgr2=0x7f21c00c16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:14.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c4983640 1 --2- 172.21.15.45:0/1433761329 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21c00c1320 0x7f21c00c16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c4983640 1 -- 172.21.15.45:0/1433761329 >> v2:172.21.15.79:3300/0 conn(0x7f21c00aa370 msgr2=0x7f21c00a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:14.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c4983640 1 --2- 172.21.15.45:0/1433761329 >> v2:172.21.15.79:3300/0 conn(0x7f21c00aa370 0x7f21c00a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c4983640 1 -- 172.21.15.45:0/1433761329 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c014f2f0 con 0x7f21c00c2810 2023-10-03T19:18:14.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c4983640 1 -- 172.21.15.45:0/1433761329 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f21b0001680 con 0x7f21c00c2810 2023-10-03T19:18:14.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c4983640 1 -- 172.21.15.45:0/1433761329 >> v1:172.21.15.45:6789/0 conn(0x7f21c00c2810 legacy=0x7f21c00a39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:14.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c4983640 1 --2- 172.21.15.45:0/1433761329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21ac0039b0 0x7f21ac003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:14.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c4983640 1 --2- 172.21.15.45:0/1433761329 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21c00c1320 0x7f21ac0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:14.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c4983640 1 --2- 172.21.15.45:0/1433761329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21ac004d10 0x7f21ac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:14.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c4983640 1 -- 172.21.15.45:0/1433761329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c00c11a0 con 0x7f21ac004d10 2023-10-03T19:18:14.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c4983640 1 -- 172.21.15.45:0/1433761329 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac00b990 con 0x7f21ac0039b0 2023-10-03T19:18:14.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c4983640 1 -- 172.21.15.45:0/1433761329 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac00bad0 con 0x7f21c00c1320 2023-10-03T19:18:14.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c6186640 1 --2- 172.21.15.45:0/1433761329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21ac004d10 0x7f21ac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:14.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c5985640 1 --2- 172.21.15.45:0/1433761329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21ac0039b0 0x7f21ac003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:14.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c5184640 1 --2- 172.21.15.45:0/1433761329 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21c00c1320 0x7f21ac0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:14.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c6186640 1 -- 172.21.15.45:0/1433761329 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21c00c1320 msgr2=0x7f21ac0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:14.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c6186640 1 --2- 172.21.15.45:0/1433761329 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21c00c1320 0x7f21ac0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c6186640 1 -- 172.21.15.45:0/1433761329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21ac0039b0 msgr2=0x7f21ac003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:14.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c6186640 1 --2- 172.21.15.45:0/1433761329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21ac0039b0 0x7f21ac003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c6186640 1 -- 172.21.15.45:0/1433761329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ac003530 con 0x7f21ac004d10 2023-10-03T19:18:14.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c5184640 1 --2- 172.21.15.45:0/1433761329 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21c00c1320 0x7f21ac0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:18:14.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.645+0000 7f21c5985640 1 --2- 172.21.15.45:0/1433761329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21ac0039b0 0x7f21ac003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:18:14.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.649+0000 7f21c6186640 1 --2- 172.21.15.45:0/1433761329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21ac004d10 0x7f21ac005180 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f21b8009fc0 tx=0x7f21b801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f4793486b454ae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:14.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.649+0000 7f21c4983640 1 -- 172.21.15.45:0/1433761329 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b80a5cb0 con 0x7f21ac004d10 2023-10-03T19:18:14.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.649+0000 7f21c4983640 1 -- 172.21.15.45:0/1433761329 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b800f040 con 0x7f21ac004d10 2023-10-03T19:18:14.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.649+0000 7f21c4983640 1 -- 172.21.15.45:0/1433761329 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b80ad680 con 0x7f21ac004d10 2023-10-03T19:18:14.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.649+0000 7f21c7be9640 1 -- 172.21.15.45:0/1433761329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21ac004d10 msgr2=0x7f21ac005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:14.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.649+0000 7f21c7be9640 1 --2- 172.21.15.45:0/1433761329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21ac004d10 0x7f21ac005180 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f21b8009fc0 tx=0x7f21b801cca0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.649+0000 7f21c6186640 1 -- 172.21.15.45:0/1433761329 reap_dead start 2023-10-03T19:18:14.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.649+0000 7f21c7be9640 1 -- 172.21.15.45:0/1433761329 shutdown_connections 2023-10-03T19:18:14.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.649+0000 7f21c7be9640 1 -- 172.21.15.45:0/1433761329 >> 172.21.15.45:0/1433761329 conn(0x7f21c00a64a0 msgr2=0x7f21c00a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:14.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.649+0000 7f21c7be9640 1 -- 172.21.15.45:0/1433761329 shutdown_connections 2023-10-03T19:18:14.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.649+0000 7f21c7be9640 1 -- 172.21.15.45:0/1433761329 wait complete. 2023-10-03T19:18:14.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.649+0000 7f21c7be9640 1 Processor -- start 2023-10-03T19:18:14.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.649+0000 7f21c7be9640 1 -- start start 2023-10-03T19:18:14.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.653+0000 7f21c7be9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c00a91c0 0x7f21c00be260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:14.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.653+0000 7f21c7be9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21c00bc010 0x7f21c01e3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:14.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.653+0000 7f21c7be9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21c01d84d0 0x7f21c01e6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:14.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.653+0000 7f21c7be9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c00bcf30 con 0x7f21c00bc010 2023-10-03T19:18:14.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.653+0000 7f21c7be9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c00bc4c0 con 0x7f21c00a91c0 2023-10-03T19:18:14.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.653+0000 7f21c7be9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c00a99c0 con 0x7f21c01d84d0 2023-10-03T19:18:14.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.653+0000 7f21c5184640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21c00bc010 0x7f21c01e3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:14.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.653+0000 7f21c5184640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21c00bc010 0x7f21c01e3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41006/0 (socket says 172.21.15.45:41006) 2023-10-03T19:18:14.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.653+0000 7f21c5184640 1 -- 172.21.15.45:0/1934859014 learned_addr learned my addr 172.21.15.45:0/1934859014 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:14.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.653+0000 7f21c5985640 1 --2- 172.21.15.45:0/1934859014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c00a91c0 0x7f21c00be260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:14.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.653+0000 7f21c6186640 1 --2- 172.21.15.45:0/1934859014 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21c01d84d0 0x7f21c01e6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:14.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.653+0000 7f21c5184640 1 -- 172.21.15.45:0/1934859014 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21c01d84d0 msgr2=0x7f21c01e6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:14.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.653+0000 7f21c5184640 1 --2- 172.21.15.45:0/1934859014 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21c01d84d0 0x7f21c01e6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.653+0000 7f21c5184640 1 -- 172.21.15.45:0/1934859014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c00a91c0 msgr2=0x7f21c00be260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:14.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.653+0000 7f21c5184640 1 --2- 172.21.15.45:0/1934859014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c00a91c0 0x7f21c00be260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.653+0000 7f21c5184640 1 -- 172.21.15.45:0/1934859014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c00c0c80 con 0x7f21c00bc010 2023-10-03T19:18:14.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.653+0000 7f21c5184640 1 --2- 172.21.15.45:0/1934859014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21c00bc010 0x7f21c01e3060 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f21b0001bc0 tx=0x7f21b0011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:14.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.653+0000 7f21b67fc640 1 -- 172.21.15.45:0/1934859014 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b000fb00 con 0x7f21c00bc010 2023-10-03T19:18:14.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.653+0000 7f21b67fc640 1 -- 172.21.15.45:0/1934859014 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b000fc60 con 0x7f21c00bc010 2023-10-03T19:18:14.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.653+0000 7f21c7be9640 1 -- 172.21.15.45:0/1934859014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c014f590 con 0x7f21c00bc010 2023-10-03T19:18:14.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.653+0000 7f21b67fc640 1 -- 172.21.15.45:0/1934859014 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b0015410 con 0x7f21c00bc010 2023-10-03T19:18:14.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.653+0000 7f21c7be9640 1 -- 172.21.15.45:0/1934859014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c00bf300 con 0x7f21c00bc010 2023-10-03T19:18:14.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.653+0000 7f21c7be9640 1 -- 172.21.15.45:0/1934859014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c004de80 con 0x7f21c00bc010 2023-10-03T19:18:14.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.653+0000 7f21b67fc640 1 -- 172.21.15.45:0/1934859014 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f21b0015570 con 0x7f21c00bc010 2023-10-03T19:18:14.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.653+0000 7f21b67fc640 1 --2- 172.21.15.45:0/1934859014 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f21a4066280 0x7f21a4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:14.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.653+0000 7f21b67fc640 1 -- 172.21.15.45:0/1934859014 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f21b00871e0 con 0x7f21c00bc010 2023-10-03T19:18:14.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.657+0000 7f21c5985640 1 --2- 172.21.15.45:0/1934859014 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f21a4066280 0x7f21a4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:14.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.657+0000 7f21c5985640 1 --2- 172.21.15.45:0/1934859014 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f21a4066280 0x7f21a4068730 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f21bc0099b0 tx=0x7f21bc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:14.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.657+0000 7f21b67fc640 1 -- 172.21.15.45:0/1934859014 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f21b00545c0 con 0x7f21c00bc010 2023-10-03T19:18:14.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.813+0000 7f21c7be9640 1 -- 172.21.15.45:0/1934859014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21c00be7a0 con 0x7f21c00bc010 2023-10-03T19:18:14.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.817+0000 7f21b67fc640 1 -- 172.21.15.45:0/1934859014 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+18306 (secure 0 0 0) 0x7f21b0057be0 con 0x7f21c00bc010 2023-10-03T19:18:14.820 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:18:14.820 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":74,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:17:36.500298+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:17:33.484274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-03T19:17:34.320341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:18:14.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.817+0000 7f21c7be9640 1 -- 172.21.15.45:0/1934859014 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f21a4066280 msgr2=0x7f21a4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:14.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.817+0000 7f21c7be9640 1 --2- 172.21.15.45:0/1934859014 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f21a4066280 0x7f21a4068730 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f21bc0099b0 tx=0x7f21bc008040 comp rx=0 tx=0).stop 2023-10-03T19:18:14.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.817+0000 7f21c7be9640 1 -- 172.21.15.45:0/1934859014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21c00bc010 msgr2=0x7f21c01e3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:14.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.817+0000 7f21c7be9640 1 --2- 172.21.15.45:0/1934859014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21c00bc010 0x7f21c01e3060 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f21b0001bc0 tx=0x7f21b0011d70 comp rx=0 tx=0).stop 2023-10-03T19:18:14.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.817+0000 7f21c7be9640 1 -- 172.21.15.45:0/1934859014 shutdown_connections 2023-10-03T19:18:14.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.817+0000 7f21c7be9640 1 --2- 172.21.15.45:0/1934859014 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f21a4066280 0x7f21a4068730 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.817+0000 7f21c7be9640 1 --2- 172.21.15.45:0/1934859014 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21c01d84d0 0x7f21c01e6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.817+0000 7f21c7be9640 1 --2- 172.21.15.45:0/1934859014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21c00bc010 0x7f21c01e3060 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.817+0000 7f21c7be9640 1 --2- 172.21.15.45:0/1934859014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c00a91c0 0x7f21c00be260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.817+0000 7f21c7be9640 1 -- 172.21.15.45:0/1934859014 >> 172.21.15.45:0/1934859014 conn(0x7f21c00a64a0 msgr2=0x7f21c014b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:14.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.817+0000 7f21c7be9640 1 -- 172.21.15.45:0/1934859014 shutdown_connections 2023-10-03T19:18:14.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.821+0000 7f21c7be9640 1 -- 172.21.15.45:0/1934859014 wait complete. 2023-10-03T19:18:14.837 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-03T19:18:14.837 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:18:14.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2c23de640 1 Processor -- start 2023-10-03T19:18:14.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2c23de640 1 -- start start 2023-10-03T19:18:14.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2c23de640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd2bc14f240 0x7fd2bc1528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:14.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2c23de640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd2bc0c2790 0x7fd2bc0c0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:14.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2c23de640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2bc06b2d0 con 0x7fd2bc0bb1d0 2023-10-03T19:18:14.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2c23de640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2bc06b640 con 0x7fd2bc0c2790 2023-10-03T19:18:14.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2c23de640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc0c0fa0 con 0x7fd2bc14f240 2023-10-03T19:18:14.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2c097b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd2bc0bb1d0 0x7fd2bc0c12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39496/0 (socket says 172.21.15.45:39496) 2023-10-03T19:18:14.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2c097b640 1 -- 172.21.15.45:0/3128988908 learned_addr learned my addr 172.21.15.45:0/3128988908 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:18:14.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2bbfff640 1 --2- 172.21.15.45:0/3128988908 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd2bc14f240 0x7fd2bc1528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:14.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2bb7fe640 1 -- 172.21.15.45:0/3128988908 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3230970574 0 0) 0x7fd2bc06b2d0 con 0x7fd2bc0bb1d0 2023-10-03T19:18:14.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2bb7fe640 1 -- 172.21.15.45:0/3128988908 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2a8003530 con 0x7fd2bc0bb1d0 2023-10-03T19:18:14.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2b37fe640 1 --2- 172.21.15.45:0/3128988908 >> v2:172.21.15.79:3300/0 conn(0x7fd2bc0c2790 0x7fd2bc0c0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:14.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2bb7fe640 1 -- 172.21.15.45:0/3128988908 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1272469576 0 0) 0x7fd2a8003530 con 0x7fd2bc0bb1d0 2023-10-03T19:18:14.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2bb7fe640 1 -- 172.21.15.45:0/3128988908 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd2bc14f240 msgr2=0x7fd2bc1528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:14.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2bb7fe640 1 --2- 172.21.15.45:0/3128988908 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd2bc14f240 0x7fd2bc1528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2bb7fe640 1 -- 172.21.15.45:0/3128988908 >> v2:172.21.15.79:3300/0 conn(0x7fd2bc0c2790 msgr2=0x7fd2bc0c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:14.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2bb7fe640 1 --2- 172.21.15.45:0/3128988908 >> v2:172.21.15.79:3300/0 conn(0x7fd2bc0c2790 0x7fd2bc0c0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2bb7fe640 1 -- 172.21.15.45:0/3128988908 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2bc0a3c60 con 0x7fd2bc0bb1d0 2023-10-03T19:18:14.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2bb7fe640 1 -- 172.21.15.45:0/3128988908 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fd2b4001a00 con 0x7fd2bc0bb1d0 2023-10-03T19:18:14.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2bb7fe640 1 -- 172.21.15.45:0/3128988908 >> v1:172.21.15.45:6789/0 conn(0x7fd2bc0bb1d0 legacy=0x7fd2bc0c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:14.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2bb7fe640 1 --2- 172.21.15.45:0/3128988908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2a8003980 0x7fd2a8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:14.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2bb7fe640 1 --2- 172.21.15.45:0/3128988908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2a80043b0 0x7fd2a8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:14.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2bb7fe640 1 --2- 172.21.15.45:0/3128988908 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd2bc14f240 0x7fd2a8004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:14.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2bb7fe640 1 -- 172.21.15.45:0/3128988908 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc06b640 con 0x7fd2a80043b0 2023-10-03T19:18:14.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2bb7fe640 1 -- 172.21.15.45:0/3128988908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc0c0fa0 con 0x7fd2a8003980 2023-10-03T19:18:14.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2bb7fe640 1 -- 172.21.15.45:0/3128988908 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a800ba10 con 0x7fd2bc14f240 2023-10-03T19:18:14.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2b37fe640 1 --2- 172.21.15.45:0/3128988908 >> v2:172.21.15.79:3300/0 conn(0x7fd2bc0c2790 0x7fd2bc0c0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:18:14.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2b37fe640 1 --2- 172.21.15.45:0/3128988908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2a80043b0 0x7fd2a8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:14.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2c097b640 1 --2- 172.21.15.45:0/3128988908 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd2bc14f240 0x7fd2a8004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:14.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2bbfff640 1 --2- 172.21.15.45:0/3128988908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2a8003980 0x7fd2a8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:14.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2b37fe640 1 -- 172.21.15.45:0/3128988908 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd2bc14f240 msgr2=0x7fd2a8004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:14.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2b37fe640 1 --2- 172.21.15.45:0/3128988908 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd2bc14f240 0x7fd2a8004ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2b37fe640 1 -- 172.21.15.45:0/3128988908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2a8003980 msgr2=0x7fd2a8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:14.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2b37fe640 1 --2- 172.21.15.45:0/3128988908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2a8003980 0x7fd2a8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2b37fe640 1 -- 172.21.15.45:0/3128988908 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a8003530 con 0x7fd2a80043b0 2023-10-03T19:18:14.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.949+0000 7fd2bbfff640 1 --2- 172.21.15.45:0/3128988908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2a8003980 0x7fd2a8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:14.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2b37fe640 1 --2- 172.21.15.45:0/3128988908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2a80043b0 0x7fd2a8004870 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fd2a40098a0 tx=0x7fd2a401c5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de51d52023d28ac server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:14.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2bb7fe640 1 -- 172.21.15.45:0/3128988908 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a40a8660 con 0x7fd2a80043b0 2023-10-03T19:18:14.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2bb7fe640 1 -- 172.21.15.45:0/3128988908 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a40a87c0 con 0x7fd2a80043b0 2023-10-03T19:18:14.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2bb7fe640 1 -- 172.21.15.45:0/3128988908 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a40a8b30 con 0x7fd2a80043b0 2023-10-03T19:18:14.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2c23de640 1 -- 172.21.15.45:0/3128988908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2a80043b0 msgr2=0x7fd2a8004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:14.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2c23de640 1 --2- 172.21.15.45:0/3128988908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2a80043b0 0x7fd2a8004870 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fd2a40098a0 tx=0x7fd2a401c5f0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2c097b640 1 -- 172.21.15.45:0/3128988908 reap_dead start 2023-10-03T19:18:14.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2c23de640 1 -- 172.21.15.45:0/3128988908 shutdown_connections 2023-10-03T19:18:14.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2c23de640 1 -- 172.21.15.45:0/3128988908 >> 172.21.15.45:0/3128988908 conn(0x7fd2bc0a64a0 msgr2=0x7fd2bc0a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:14.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2c23de640 1 -- 172.21.15.45:0/3128988908 shutdown_connections 2023-10-03T19:18:14.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2c23de640 1 -- 172.21.15.45:0/3128988908 wait complete. 2023-10-03T19:18:14.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2c23de640 1 Processor -- start 2023-10-03T19:18:14.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2c23de640 1 -- start start 2023-10-03T19:18:14.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2c23de640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2a80043b0 0x7fd2bc150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:14.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2c23de640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd2bc14bb00 0x7fd2bc0a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:14.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2c23de640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2bc0a5d20 0x7fd2bc144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:14.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2c23de640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc145db0 con 0x7fd2bc0a5d20 2023-10-03T19:18:14.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2c23de640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc0a58e0 con 0x7fd2a80043b0 2023-10-03T19:18:14.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2c23de640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc14bf30 con 0x7fd2bc14bb00 2023-10-03T19:18:14.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2c097b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2bc0a5d20 0x7fd2bc144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:14.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2c097b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2bc0a5d20 0x7fd2bc144ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41024/0 (socket says 172.21.15.45:41024) 2023-10-03T19:18:14.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2c097b640 1 -- 172.21.15.45:0/3521755819 learned_addr learned my addr 172.21.15.45:0/3521755819 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:14.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2bbfff640 1 --2- 172.21.15.45:0/3521755819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2a80043b0 0x7fd2bc150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:14.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2b37fe640 1 --2- 172.21.15.45:0/3521755819 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd2bc14bb00 0x7fd2bc0a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:14.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2c097b640 1 -- 172.21.15.45:0/3521755819 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd2bc14bb00 msgr2=0x7fd2bc0a53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:14.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2c097b640 1 --2- 172.21.15.45:0/3521755819 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd2bc14bb00 0x7fd2bc0a53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2c097b640 1 -- 172.21.15.45:0/3521755819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2a80043b0 msgr2=0x7fd2bc150e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:14.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2c097b640 1 --2- 172.21.15.45:0/3521755819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2a80043b0 0x7fd2bc150e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:14.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2c097b640 1 -- 172.21.15.45:0/3521755819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2bc14e740 con 0x7fd2bc0a5d20 2023-10-03T19:18:14.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2bbfff640 1 --2- 172.21.15.45:0/3521755819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2a80043b0 0x7fd2bc150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:18:14.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2c097b640 1 --2- 172.21.15.45:0/3521755819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2bc0a5d20 0x7fd2bc144ba0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc0c47f0 tx=0x7fd2b4007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:14.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2b97fa640 1 -- 172.21.15.45:0/3521755819 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b4010510 con 0x7fd2bc0a5d20 2023-10-03T19:18:14.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.953+0000 7fd2b97fa640 1 -- 172.21.15.45:0/3521755819 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b4010670 con 0x7fd2bc0a5d20 2023-10-03T19:18:14.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.957+0000 7fd2c23de640 1 -- 172.21.15.45:0/3521755819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2bc0c19b0 con 0x7fd2bc0a5d20 2023-10-03T19:18:14.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.957+0000 7fd2b97fa640 1 -- 172.21.15.45:0/3521755819 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b4010a20 con 0x7fd2bc0a5d20 2023-10-03T19:18:14.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.957+0000 7fd2c23de640 1 -- 172.21.15.45:0/3521755819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2bc0a3f40 con 0x7fd2bc0a5d20 2023-10-03T19:18:14.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.957+0000 7fd2c23de640 1 -- 172.21.15.45:0/3521755819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2bc04de80 con 0x7fd2bc0a5d20 2023-10-03T19:18:14.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.957+0000 7fd2b97fa640 1 -- 172.21.15.45:0/3521755819 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd2b4010b80 con 0x7fd2bc0a5d20 2023-10-03T19:18:14.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.957+0000 7fd2b97fa640 1 --2- 172.21.15.45:0/3521755819 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd29c066280 0x7fd29c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:14.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.957+0000 7fd2b97fa640 1 -- 172.21.15.45:0/3521755819 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd2b40835d0 con 0x7fd2bc0a5d20 2023-10-03T19:18:14.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.957+0000 7fd2bbfff640 1 --2- 172.21.15.45:0/3521755819 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd29c066280 0x7fd29c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:14.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.957+0000 7fd2bbfff640 1 --2- 172.21.15.45:0/3521755819 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd29c066280 0x7fd29c068730 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac009a60 tx=0x7fd2ac008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:14.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:14.961+0000 7fd2b97fa640 1 -- 172.21.15.45:0/3521755819 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd2b40544f0 con 0x7fd2bc0a5d20 2023-10-03T19:18:15.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.145+0000 7fd2c23de640 1 -- 172.21.15.45:0/3521755819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2bc0c0280 con 0x7fd2bc0a5d20 2023-10-03T19:18:15.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.145+0000 7fd2b97fa640 1 -- 172.21.15.45:0/3521755819 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+3913 (secure 0 0 0) 0x7fd2b4054080 con 0x7fd2bc0a5d20 2023-10-03T19:18:15.148 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:18:15.148 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/250992108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":250992108},{"type":"v1","addr":"172.21.15.79:6835","nonce":250992108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6339,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3153040546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3153040546},{"type":"v1","addr":"172.21.15.45:6834","nonce":3153040546}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:17:35.497011+0000","modified":"2023-10-03T19:17:38.516672+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6342},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6342":{"gid":6342,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/2939002026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2939002026},{"type":"v1","addr":"172.21.15.45:6835","nonce":2939002026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-10-03T19:18:15.148 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 36 2023-10-03T19:18:15.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.145+0000 7fd2c23de640 1 -- 172.21.15.45:0/3521755819 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd29c066280 msgr2=0x7fd29c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:15.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.145+0000 7fd2c23de640 1 --2- 172.21.15.45:0/3521755819 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd29c066280 0x7fd29c068730 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac009a60 tx=0x7fd2ac008040 comp rx=0 tx=0).stop 2023-10-03T19:18:15.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.145+0000 7fd2c23de640 1 -- 172.21.15.45:0/3521755819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2bc0a5d20 msgr2=0x7fd2bc144ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:15.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.145+0000 7fd2c23de640 1 --2- 172.21.15.45:0/3521755819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2bc0a5d20 0x7fd2bc144ba0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc0c47f0 tx=0x7fd2b4007a00 comp rx=0 tx=0).stop 2023-10-03T19:18:15.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.149+0000 7fd2c23de640 1 -- 172.21.15.45:0/3521755819 shutdown_connections 2023-10-03T19:18:15.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.149+0000 7fd2c23de640 1 --2- 172.21.15.45:0/3521755819 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd29c066280 0x7fd29c068730 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:15.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.149+0000 7fd2c23de640 1 --2- 172.21.15.45:0/3521755819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2bc0a5d20 0x7fd2bc144ba0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:15.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.149+0000 7fd2c23de640 1 --2- 172.21.15.45:0/3521755819 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd2bc14bb00 0x7fd2bc0a53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:15.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.149+0000 7fd2c23de640 1 --2- 172.21.15.45:0/3521755819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2a80043b0 0x7fd2bc150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:15.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.149+0000 7fd2c23de640 1 -- 172.21.15.45:0/3521755819 >> 172.21.15.45:0/3521755819 conn(0x7fd2bc0a64a0 msgr2=0x7fd2bc0a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:15.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.149+0000 7fd2c23de640 1 -- 172.21.15.45:0/3521755819 shutdown_connections 2023-10-03T19:18:15.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.149+0000 7fd2c23de640 1 -- 172.21.15.45:0/3521755819 wait complete. 2023-10-03T19:18:15.165 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:18:15.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd7c809640 1 Processor -- start 2023-10-03T19:18:15.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd7c809640 1 -- start start 2023-10-03T19:18:15.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd7c809640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbd780bff30 0x7fbd780bc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:15.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd7c809640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd780bc0b0 con 0x7fbd780bd130 2023-10-03T19:18:15.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd7c809640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd780bb740 con 0x7fbd780bcb20 2023-10-03T19:18:15.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd7c809640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd780bba20 con 0x7fbd780bff30 2023-10-03T19:18:15.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd76d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbd780bd130 0x7fbd78156d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39510/0 (socket says 172.21.15.45:39510) 2023-10-03T19:18:15.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd76d9d640 1 -- 172.21.15.45:0/367795695 learned_addr learned my addr 172.21.15.45:0/367795695 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:18:15.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd7659c640 1 --2- 172.21.15.45:0/367795695 >> v2:172.21.15.79:3300/0 conn(0x7fbd780bff30 0x7fbd780bc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:15.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd7559a640 1 -- 172.21.15.45:0/367795695 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3184751421 0 0) 0x7fbd780bc0b0 con 0x7fbd780bd130 2023-10-03T19:18:15.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd7559a640 1 -- 172.21.15.45:0/367795695 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd60003530 con 0x7fbd780bd130 2023-10-03T19:18:15.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd7559a640 1 -- 172.21.15.45:0/367795695 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1739656664 0 0) 0x7fbd60003530 con 0x7fbd780bd130 2023-10-03T19:18:15.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd7559a640 1 -- 172.21.15.45:0/367795695 >> v2:172.21.15.79:3300/0 conn(0x7fbd780bff30 msgr2=0x7fbd780bc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:15.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd7559a640 1 --2- 172.21.15.45:0/367795695 >> v2:172.21.15.79:3300/0 conn(0x7fbd780bff30 0x7fbd780bc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:15.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd7559a640 1 -- 172.21.15.45:0/367795695 >> v1:172.21.15.79:6789/0 conn(0x7fbd780bcb20 legacy=0x7fbd780bec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:15.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd7559a640 1 -- 172.21.15.45:0/367795695 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7814cfe0 con 0x7fbd780bd130 2023-10-03T19:18:15.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd7559a640 1 -- 172.21.15.45:0/367795695 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fbd70001680 con 0x7fbd780bd130 2023-10-03T19:18:15.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd7559a640 1 -- 172.21.15.45:0/367795695 >> v1:172.21.15.45:6789/0 conn(0x7fbd780bd130 legacy=0x7fbd78156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:15.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd7559a640 1 --2- 172.21.15.45:0/367795695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd60003980 0x7fbd60003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:15.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd7559a640 1 --2- 172.21.15.45:0/367795695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd600047d0 0x7fbd60004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:15.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd7559a640 1 --2- 172.21.15.45:0/367795695 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd60005180 0x7fbd6000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:15.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd7559a640 1 -- 172.21.15.45:0/367795695 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd780bba20 con 0x7fbd60003980 2023-10-03T19:18:15.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd7559a640 1 -- 172.21.15.45:0/367795695 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6000c000 con 0x7fbd600047d0 2023-10-03T19:18:15.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd7559a640 1 -- 172.21.15.45:0/367795695 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6000c1c0 con 0x7fbd60005180 2023-10-03T19:18:15.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd7659c640 1 --2- 172.21.15.45:0/367795695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd60003980 0x7fbd60003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:15.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd76d9d640 1 --2- 172.21.15.45:0/367795695 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd60005180 0x7fbd6000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:15.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd7659c640 1 -- 172.21.15.45:0/367795695 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd60005180 msgr2=0x7fbd6000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:15.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd7659c640 1 --2- 172.21.15.45:0/367795695 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd60005180 0x7fbd6000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:15.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd7659c640 1 -- 172.21.15.45:0/367795695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd600047d0 msgr2=0x7fbd60004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:15.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd7659c640 1 --2- 172.21.15.45:0/367795695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd600047d0 0x7fbd60004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:15.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd7659c640 1 -- 172.21.15.45:0/367795695 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd60003530 con 0x7fbd60003980 2023-10-03T19:18:15.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd76d9d640 1 --2- 172.21.15.45:0/367795695 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd60005180 0x7fbd6000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:15.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.285+0000 7fbd76d9d640 1 -- 172.21.15.45:0/367795695 reap_dead start 2023-10-03T19:18:15.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.289+0000 7fbd7659c640 1 --2- 172.21.15.45:0/367795695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd60003980 0x7fbd60003d90 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fbd68009fc0 tx=0x7fbd6801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a49de0fedfc7fb1c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:15.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.289+0000 7fbd7559a640 1 -- 172.21.15.45:0/367795695 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd680a5ad0 con 0x7fbd60003980 2023-10-03T19:18:15.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.289+0000 7fbd7559a640 1 -- 172.21.15.45:0/367795695 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6800f040 con 0x7fbd60003980 2023-10-03T19:18:15.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.289+0000 7fbd7559a640 1 -- 172.21.15.45:0/367795695 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd680a5e70 con 0x7fbd60003980 2023-10-03T19:18:15.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.289+0000 7fbd7c809640 1 -- 172.21.15.45:0/367795695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd60003980 msgr2=0x7fbd60003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:15.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.289+0000 7fbd7c809640 1 --2- 172.21.15.45:0/367795695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd60003980 0x7fbd60003d90 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fbd68009fc0 tx=0x7fbd6801cc60 comp rx=0 tx=0).stop 2023-10-03T19:18:15.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.289+0000 7fbd7c809640 1 -- 172.21.15.45:0/367795695 shutdown_connections 2023-10-03T19:18:15.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.289+0000 7fbd7c809640 1 --2- 172.21.15.45:0/367795695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd60003980 0x7fbd60003d90 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:15.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.289+0000 7fbd7c809640 1 -- 172.21.15.45:0/367795695 >> 172.21.15.45:0/367795695 conn(0x7fbd780c0d20 msgr2=0x7fbd780c1120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:15.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.289+0000 7fbd7c809640 1 -- 172.21.15.45:0/367795695 shutdown_connections 2023-10-03T19:18:15.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.289+0000 7fbd7c809640 1 -- 172.21.15.45:0/367795695 wait complete. 2023-10-03T19:18:15.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.289+0000 7fbd7c809640 1 Processor -- start 2023-10-03T19:18:15.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.289+0000 7fbd7c809640 1 -- start start 2023-10-03T19:18:15.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.289+0000 7fbd7c809640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd60003980 0x7fbd781e7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:15.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.289+0000 7fbd7c809640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd78146200 0x7fbd781dc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:15.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.293+0000 7fbd7c809640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd780b8a80 0x7fbd7806f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:15.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.293+0000 7fbd7c809640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd780bae40 con 0x7fbd780b8a80 2023-10-03T19:18:15.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.293+0000 7fbd7c809640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd781dc600 con 0x7fbd60003980 2023-10-03T19:18:15.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.293+0000 7fbd7c809640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd780baba0 con 0x7fbd78146200 2023-10-03T19:18:15.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.293+0000 7fbd76d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd780b8a80 0x7fbd7806f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:15.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.293+0000 7fbd76d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd780b8a80 0x7fbd7806f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41042/0 (socket says 172.21.15.45:41042) 2023-10-03T19:18:15.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.293+0000 7fbd76d9d640 1 -- 172.21.15.45:0/1489070739 learned_addr learned my addr 172.21.15.45:0/1489070739 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:15.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.293+0000 7fbd75d9b640 1 --2- 172.21.15.45:0/1489070739 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd78146200 0x7fbd781dc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:15.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.293+0000 7fbd7659c640 1 --2- 172.21.15.45:0/1489070739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd60003980 0x7fbd781e7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:15.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.293+0000 7fbd76d9d640 1 -- 172.21.15.45:0/1489070739 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd78146200 msgr2=0x7fbd781dc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:15.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.293+0000 7fbd76d9d640 1 --2- 172.21.15.45:0/1489070739 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd78146200 0x7fbd781dc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:15.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.293+0000 7fbd76d9d640 1 -- 172.21.15.45:0/1489070739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd60003980 msgr2=0x7fbd781e7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:15.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.293+0000 7fbd76d9d640 1 --2- 172.21.15.45:0/1489070739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd60003980 0x7fbd781e7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:15.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.293+0000 7fbd76d9d640 1 -- 172.21.15.45:0/1489070739 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd780bf5c0 con 0x7fbd780b8a80 2023-10-03T19:18:15.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.293+0000 7fbd7659c640 1 --2- 172.21.15.45:0/1489070739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd60003980 0x7fbd781e7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:15.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.293+0000 7fbd76d9d640 1 --2- 172.21.15.45:0/1489070739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd780b8a80 0x7fbd7806f730 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fbd780c0c00 tx=0x7fbd7000d830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:15.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.293+0000 7fbd66ffd640 1 -- 172.21.15.45:0/1489070739 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd70007030 con 0x7fbd780b8a80 2023-10-03T19:18:15.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.293+0000 7fbd66ffd640 1 -- 172.21.15.45:0/1489070739 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd700071b0 con 0x7fbd780b8a80 2023-10-03T19:18:15.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.293+0000 7fbd7c809640 1 -- 172.21.15.45:0/1489070739 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd780bf430 con 0x7fbd780b8a80 2023-10-03T19:18:15.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.293+0000 7fbd66ffd640 1 -- 172.21.15.45:0/1489070739 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd70007560 con 0x7fbd780b8a80 2023-10-03T19:18:15.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.293+0000 7fbd7c809640 1 -- 172.21.15.45:0/1489070739 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd780bf750 con 0x7fbd780b8a80 2023-10-03T19:18:15.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.293+0000 7fbd7c809640 1 -- 172.21.15.45:0/1489070739 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd78071630 con 0x7fbd780b8a80 2023-10-03T19:18:15.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.293+0000 7fbd66ffd640 1 -- 172.21.15.45:0/1489070739 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbd700047f0 con 0x7fbd780b8a80 2023-10-03T19:18:15.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.293+0000 7fbd66ffd640 1 --2- 172.21.15.45:0/1489070739 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbd58066280 0x7fbd58068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:15.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.293+0000 7fbd66ffd640 1 -- 172.21.15.45:0/1489070739 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbd70083010 con 0x7fbd780b8a80 2023-10-03T19:18:15.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.293+0000 7fbd7659c640 1 --2- 172.21.15.45:0/1489070739 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbd58066280 0x7fbd58068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:15.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.293+0000 7fbd7659c640 1 --2- 172.21.15.45:0/1489070739 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbd58066280 0x7fbd58068730 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbd680af000 tx=0x7fbd680a7040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:15.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.297+0000 7fbd66ffd640 1 -- 172.21.15.45:0/1489070739 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbd78071630 con 0x7fbd780b8a80 2023-10-03T19:18:15.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.481+0000 7fbd7c809640 1 -- 172.21.15.45:0/1489070739 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd78071630 con 0x7fbd780b8a80 2023-10-03T19:18:15.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.481+0000 7fbd66ffd640 1 -- 172.21.15.45:0/1489070739 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+3913 (secure 0 0 0) 0x7fbd78071630 con 0x7fbd780b8a80 2023-10-03T19:18:15.486 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:18:15.486 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/250992108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":250992108},{"type":"v1","addr":"172.21.15.79:6835","nonce":250992108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6339,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3153040546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3153040546},{"type":"v1","addr":"172.21.15.45:6834","nonce":3153040546}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:17:35.497011+0000","modified":"2023-10-03T19:17:38.516672+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6342},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6342":{"gid":6342,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/2939002026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2939002026},{"type":"v1","addr":"172.21.15.45:6835","nonce":2939002026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-10-03T19:18:15.486 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 36 2023-10-03T19:18:15.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.485+0000 7fbd7c809640 1 -- 172.21.15.45:0/1489070739 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbd58066280 msgr2=0x7fbd58068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:15.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.485+0000 7fbd7c809640 1 --2- 172.21.15.45:0/1489070739 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbd58066280 0x7fbd58068730 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbd680af000 tx=0x7fbd680a7040 comp rx=0 tx=0).stop 2023-10-03T19:18:15.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.485+0000 7fbd7c809640 1 -- 172.21.15.45:0/1489070739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd780b8a80 msgr2=0x7fbd7806f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:15.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.485+0000 7fbd7c809640 1 --2- 172.21.15.45:0/1489070739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd780b8a80 0x7fbd7806f730 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fbd780c0c00 tx=0x7fbd7000d830 comp rx=0 tx=0).stop 2023-10-03T19:18:15.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.485+0000 7fbd7c809640 1 -- 172.21.15.45:0/1489070739 shutdown_connections 2023-10-03T19:18:15.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.485+0000 7fbd7c809640 1 --2- 172.21.15.45:0/1489070739 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbd58066280 0x7fbd58068730 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:15.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.485+0000 7fbd7c809640 1 --2- 172.21.15.45:0/1489070739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd780b8a80 0x7fbd7806f730 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:15.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.485+0000 7fbd7c809640 1 --2- 172.21.15.45:0/1489070739 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd78146200 0x7fbd781dc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:15.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.485+0000 7fbd7c809640 1 --2- 172.21.15.45:0/1489070739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd60003980 0x7fbd781e7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:15.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.485+0000 7fbd7c809640 1 -- 172.21.15.45:0/1489070739 >> 172.21.15.45:0/1489070739 conn(0x7fbd780c0d20 msgr2=0x7fbd7806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:15.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.485+0000 7fbd7c809640 1 -- 172.21.15.45:0/1489070739 shutdown_connections 2023-10-03T19:18:15.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.485+0000 7fbd7c809640 1 -- 172.21.15.45:0/1489070739 wait complete. 2023-10-03T19:18:15.503 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:18:15.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57b54e8640 1 Processor -- start 2023-10-03T19:18:15.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57b54e8640 1 -- start start 2023-10-03T19:18:15.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57b54e8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57b014aa50 0x7f57b00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:15.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57b54e8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f57b0147ab0 0x7f57b0147f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:15.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57b54e8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b00bc430 con 0x7f57b006cd40 2023-10-03T19:18:15.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57b54e8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b00a5db0 con 0x7f57b0147ab0 2023-10-03T19:18:15.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57b54e8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b014ae80 con 0x7f57b014aa50 2023-10-03T19:18:15.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57aeffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f57b006cd40 0x7f57b00bbd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39514/0 (socket says 172.21.15.45:39514) 2023-10-03T19:18:15.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57aeffd640 1 -- 172.21.15.45:0/1655638858 learned_addr learned my addr 172.21.15.45:0/1655638858 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:18:15.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57a67fc640 1 --2- 172.21.15.45:0/1655638858 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57b014aa50 0x7f57b00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:15.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57af7fe640 1 --2- 172.21.15.45:0/1655638858 >> v2:172.21.15.79:3300/0 conn(0x7f57b0147ab0 0x7f57b0147f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:15.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57ae7fc640 1 -- 172.21.15.45:0/1655638858 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 806615468 0 0) 0x7f57b00bc430 con 0x7f57b006cd40 2023-10-03T19:18:15.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57ae7fc640 1 -- 172.21.15.45:0/1655638858 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f579c003530 con 0x7f57b006cd40 2023-10-03T19:18:15.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57ae7fc640 1 -- 172.21.15.45:0/1655638858 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1892296807 0 0) 0x7f579c003530 con 0x7f57b006cd40 2023-10-03T19:18:15.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57ae7fc640 1 -- 172.21.15.45:0/1655638858 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57b014aa50 msgr2=0x7f57b00a3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:15.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57ae7fc640 1 --2- 172.21.15.45:0/1655638858 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57b014aa50 0x7f57b00a3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:15.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57ae7fc640 1 -- 172.21.15.45:0/1655638858 >> v2:172.21.15.79:3300/0 conn(0x7f57b0147ab0 msgr2=0x7f57b0147f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:15.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57ae7fc640 1 --2- 172.21.15.45:0/1655638858 >> v2:172.21.15.79:3300/0 conn(0x7f57b0147ab0 0x7f57b0147f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:15.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57ae7fc640 1 -- 172.21.15.45:0/1655638858 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b00baf60 con 0x7f57b006cd40 2023-10-03T19:18:15.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57ae7fc640 1 -- 172.21.15.45:0/1655638858 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f57a0001680 con 0x7f57b006cd40 2023-10-03T19:18:15.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57ae7fc640 1 -- 172.21.15.45:0/1655638858 >> v1:172.21.15.45:6789/0 conn(0x7f57b006cd40 legacy=0x7f57b00bbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:15.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57ae7fc640 1 --2- 172.21.15.45:0/1655638858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f579c003980 0x7f579c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:15.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57ae7fc640 1 --2- 172.21.15.45:0/1655638858 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57b014aa50 0x7f579c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:15.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57ae7fc640 1 --2- 172.21.15.45:0/1655638858 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f579c004d10 0x7f579c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:15.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57ae7fc640 1 -- 172.21.15.45:0/1655638858 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c00b990 con 0x7f579c004d10 2023-10-03T19:18:15.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57ae7fc640 1 -- 172.21.15.45:0/1655638858 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c00bad0 con 0x7f579c003980 2023-10-03T19:18:15.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57ae7fc640 1 -- 172.21.15.45:0/1655638858 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579c00bc10 con 0x7f57b014aa50 2023-10-03T19:18:15.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57af7fe640 1 --2- 172.21.15.45:0/1655638858 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f579c004d10 0x7f579c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:15.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57a67fc640 1 --2- 172.21.15.45:0/1655638858 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57b014aa50 0x7f579c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:15.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57af7fe640 1 -- 172.21.15.45:0/1655638858 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57b014aa50 msgr2=0x7f579c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:15.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57af7fe640 1 --2- 172.21.15.45:0/1655638858 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57b014aa50 0x7f579c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:15.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57af7fe640 1 -- 172.21.15.45:0/1655638858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f579c003980 msgr2=0x7f579c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:15.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57af7fe640 1 --2- 172.21.15.45:0/1655638858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f579c003980 0x7f579c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:15.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.621+0000 7f57af7fe640 1 -- 172.21.15.45:0/1655638858 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579c003530 con 0x7f579c004d10 2023-10-03T19:18:15.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57af7fe640 1 --2- 172.21.15.45:0/1655638858 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f579c004d10 0x7f579c005180 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009fc0 tx=0x7f57a801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc195670d6919dcc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:15.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57ae7fc640 1 -- 172.21.15.45:0/1655638858 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a80a5cb0 con 0x7f579c004d10 2023-10-03T19:18:15.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57ae7fc640 1 -- 172.21.15.45:0/1655638858 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a800f040 con 0x7f579c004d10 2023-10-03T19:18:15.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57ae7fc640 1 -- 172.21.15.45:0/1655638858 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a80ad680 con 0x7f579c004d10 2023-10-03T19:18:15.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57b54e8640 1 -- 172.21.15.45:0/1655638858 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f579c004d10 msgr2=0x7f579c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:15.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57b54e8640 1 --2- 172.21.15.45:0/1655638858 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f579c004d10 0x7f579c005180 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009fc0 tx=0x7f57a801cca0 comp rx=0 tx=0).stop 2023-10-03T19:18:15.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57af7fe640 1 -- 172.21.15.45:0/1655638858 reap_dead start 2023-10-03T19:18:15.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57b54e8640 1 -- 172.21.15.45:0/1655638858 shutdown_connections 2023-10-03T19:18:15.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57b54e8640 1 -- 172.21.15.45:0/1655638858 >> 172.21.15.45:0/1655638858 conn(0x7f57b00bcf50 msgr2=0x7f57b00bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:15.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57b54e8640 1 -- 172.21.15.45:0/1655638858 shutdown_connections 2023-10-03T19:18:15.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57b54e8640 1 -- 172.21.15.45:0/1655638858 wait complete. 2023-10-03T19:18:15.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57b54e8640 1 Processor -- start 2023-10-03T19:18:15.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57b54e8640 1 -- start start 2023-10-03T19:18:15.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57b54e8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f579c004d10 0x7f57b01e45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:15.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57b54e8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57b01e4fc0 0x7f57b0071840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:15.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57b54e8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57b0071d80 0x7f57b013a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:15.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57b54e8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b00be230 con 0x7f579c004d10 2023-10-03T19:18:15.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57b54e8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b01e4b00 con 0x7f57b0071d80 2023-10-03T19:18:15.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57b54e8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b006f430 con 0x7f57b01e4fc0 2023-10-03T19:18:15.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57aeffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f579c004d10 0x7f57b01e45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:15.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57aeffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f579c004d10 0x7f57b01e45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41056/0 (socket says 172.21.15.45:41056) 2023-10-03T19:18:15.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57aeffd640 1 -- 172.21.15.45:0/866782454 learned_addr learned my addr 172.21.15.45:0/866782454 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:15.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57af7fe640 1 --2- 172.21.15.45:0/866782454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57b0071d80 0x7f57b013a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:15.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57a67fc640 1 --2- 172.21.15.45:0/866782454 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57b01e4fc0 0x7f57b0071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:15.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57aeffd640 1 -- 172.21.15.45:0/866782454 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57b01e4fc0 msgr2=0x7f57b0071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:15.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57aeffd640 1 --2- 172.21.15.45:0/866782454 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57b01e4fc0 0x7f57b0071840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:15.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57aeffd640 1 -- 172.21.15.45:0/866782454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57b0071d80 msgr2=0x7f57b013a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:15.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57aeffd640 1 --2- 172.21.15.45:0/866782454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57b0071d80 0x7f57b013a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:15.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57aeffd640 1 -- 172.21.15.45:0/866782454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b00bb520 con 0x7f579c004d10 2023-10-03T19:18:15.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57af7fe640 1 --2- 172.21.15.45:0/866782454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57b0071d80 0x7f57b013a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:15.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57aeffd640 1 --2- 172.21.15.45:0/866782454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f579c004d10 0x7f57b01e45c0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f57a000c770 tx=0x7f57a000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:15.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57a7fff640 1 -- 172.21.15.45:0/866782454 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a00074e0 con 0x7f579c004d10 2023-10-03T19:18:15.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57a7fff640 1 -- 172.21.15.45:0/866782454 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a0007660 con 0x7f579c004d10 2023-10-03T19:18:15.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57b54e8640 1 -- 172.21.15.45:0/866782454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b00bb240 con 0x7f579c004d10 2023-10-03T19:18:15.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57a7fff640 1 -- 172.21.15.45:0/866782454 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a0004a30 con 0x7f579c004d10 2023-10-03T19:18:15.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.625+0000 7f57b54e8640 1 -- 172.21.15.45:0/866782454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b00bb800 con 0x7f579c004d10 2023-10-03T19:18:15.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.629+0000 7f57b54e8640 1 -- 172.21.15.45:0/866782454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b01e4c40 con 0x7f579c004d10 2023-10-03T19:18:15.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.629+0000 7f57a7fff640 1 -- 172.21.15.45:0/866782454 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f57a0004b90 con 0x7f579c004d10 2023-10-03T19:18:15.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.629+0000 7f57a7fff640 1 --2- 172.21.15.45:0/866782454 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f57900662b0 0x7f5790068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:15.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.629+0000 7f57a7fff640 1 -- 172.21.15.45:0/866782454 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f57a00834b0 con 0x7f579c004d10 2023-10-03T19:18:15.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.629+0000 7f57a67fc640 1 --2- 172.21.15.45:0/866782454 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f57900662b0 0x7f5790068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:15.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.629+0000 7f57a67fc640 1 --2- 172.21.15.45:0/866782454 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f57900662b0 0x7f5790068760 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f57b0068020 tx=0x7f5798008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:15.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.633+0000 7f57a7fff640 1 -- 172.21.15.45:0/866782454 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f57a0050930 con 0x7f579c004d10 2023-10-03T19:18:15.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.781+0000 7f57b54e8640 1 -- 172.21.15.45:0/866782454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57b004de80 con 0x7f579c004d10 2023-10-03T19:18:15.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.785+0000 7f57a7fff640 1 -- 172.21.15.45:0/866782454 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+18306 (secure 0 0 0) 0x7f57a0053f50 con 0x7f579c004d10 2023-10-03T19:18:15.787 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:18:15.787 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":74,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:17:36.500298+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:17:33.484274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-03T19:17:34.320341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:18:15.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.785+0000 7f57b54e8640 1 -- 172.21.15.45:0/866782454 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f57900662b0 msgr2=0x7f5790068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:15.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.785+0000 7f57b54e8640 1 --2- 172.21.15.45:0/866782454 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f57900662b0 0x7f5790068760 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f57b0068020 tx=0x7f5798008040 comp rx=0 tx=0).stop 2023-10-03T19:18:15.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.785+0000 7f57b54e8640 1 -- 172.21.15.45:0/866782454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f579c004d10 msgr2=0x7f57b01e45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:15.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.785+0000 7f57b54e8640 1 --2- 172.21.15.45:0/866782454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f579c004d10 0x7f57b01e45c0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f57a000c770 tx=0x7f57a000cc30 comp rx=0 tx=0).stop 2023-10-03T19:18:15.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.785+0000 7f57b54e8640 1 -- 172.21.15.45:0/866782454 shutdown_connections 2023-10-03T19:18:15.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.785+0000 7f57b54e8640 1 --2- 172.21.15.45:0/866782454 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f57900662b0 0x7f5790068760 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:15.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.785+0000 7f57b54e8640 1 --2- 172.21.15.45:0/866782454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57b0071d80 0x7f57b013a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:15.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.785+0000 7f57b54e8640 1 --2- 172.21.15.45:0/866782454 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57b01e4fc0 0x7f57b0071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:15.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.785+0000 7f57b54e8640 1 --2- 172.21.15.45:0/866782454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f579c004d10 0x7f57b01e45c0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:15.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.785+0000 7f57b54e8640 1 -- 172.21.15.45:0/866782454 >> 172.21.15.45:0/866782454 conn(0x7f57b00bcf50 msgr2=0x7f57b00bbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:15.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.785+0000 7f57b54e8640 1 -- 172.21.15.45:0/866782454 shutdown_connections 2023-10-03T19:18:15.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.785+0000 7f57b54e8640 1 -- 172.21.15.45:0/866782454 wait complete. 2023-10-03T19:18:15.804 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-03T19:18:15.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.913+0000 7fa2068f8640 1 Processor -- start 2023-10-03T19:18:15.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.913+0000 7fa2068f8640 1 -- start start 2023-10-03T19:18:15.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.913+0000 7fa2068f8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa2000b98f0 0x7fa2000b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:15.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.913+0000 7fa2068f8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2000ba550 con 0x7fa2000a2e20 2023-10-03T19:18:15.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.913+0000 7fa2068f8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2001526d0 con 0x7fa2000bc810 2023-10-03T19:18:15.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.913+0000 7fa2068f8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2001529b0 con 0x7fa2000b98f0 2023-10-03T19:18:15.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.913+0000 7fa1fffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa2000b98f0 0x7fa2000b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:15.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.913+0000 7fa204e95640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa2000a2e20 0x7fa20006c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39524/0 (socket says 172.21.15.45:39524) 2023-10-03T19:18:15.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.913+0000 7fa204e95640 1 -- 172.21.15.45:0/1673058891 learned_addr learned my addr 172.21.15.45:0/1673058891 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:18:15.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.913+0000 7fa1feffd640 1 -- 172.21.15.45:0/1673058891 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1685101526 0 0) 0x7fa2000ba550 con 0x7fa2000a2e20 2023-10-03T19:18:15.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.913+0000 7fa1feffd640 1 -- 172.21.15.45:0/1673058891 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1e8003530 con 0x7fa2000a2e20 2023-10-03T19:18:15.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.913+0000 7fa1fffff640 1 -- 172.21.15.45:0/1673058891 >> v1:172.21.15.79:6789/0 conn(0x7fa2000bc810 legacy=0x7fa20006c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:15.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.913+0000 7fa1fffff640 1 -- 172.21.15.45:0/1673058891 >> v1:172.21.15.45:6789/0 conn(0x7fa2000a2e20 legacy=0x7fa20006c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:15.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.913+0000 7fa1fffff640 1 -- 172.21.15.45:0/1673058891 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2000ba200 con 0x7fa2000b98f0 2023-10-03T19:18:15.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.917+0000 7fa1fffff640 1 --2- 172.21.15.45:0/1673058891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2000b98f0 0x7fa2000b9cc0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fa1f00097c0 tx=0x7fa1f001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=919e421b13954db7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:15.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.917+0000 7fa1feffd640 1 -- 172.21.15.45:0/1673058891 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f00a8050 con 0x7fa2000b98f0 2023-10-03T19:18:15.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.917+0000 7fa1feffd640 1 -- 172.21.15.45:0/1673058891 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f00ac5f0 con 0x7fa2000b98f0 2023-10-03T19:18:15.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.917+0000 7fa1feffd640 1 -- 172.21.15.45:0/1673058891 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f00ac980 con 0x7fa2000b98f0 2023-10-03T19:18:15.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.917+0000 7fa2068f8640 1 -- 172.21.15.45:0/1673058891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2000b98f0 msgr2=0x7fa2000b9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:15.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.917+0000 7fa2068f8640 1 --2- 172.21.15.45:0/1673058891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2000b98f0 0x7fa2000b9cc0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fa1f00097c0 tx=0x7fa1f001c480 comp rx=0 tx=0).stop 2023-10-03T19:18:15.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.917+0000 7fa2068f8640 1 -- 172.21.15.45:0/1673058891 shutdown_connections 2023-10-03T19:18:15.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.917+0000 7fa2068f8640 1 --2- 172.21.15.45:0/1673058891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2000b98f0 0x7fa2000b9cc0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:15.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.917+0000 7fa2068f8640 1 -- 172.21.15.45:0/1673058891 >> 172.21.15.45:0/1673058891 conn(0x7fa2000bcf50 msgr2=0x7fa2000bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:15.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.917+0000 7fa2068f8640 1 -- 172.21.15.45:0/1673058891 shutdown_connections 2023-10-03T19:18:15.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.917+0000 7fa2068f8640 1 -- 172.21.15.45:0/1673058891 wait complete. 2023-10-03T19:18:15.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.917+0000 7fa2068f8640 1 Processor -- start 2023-10-03T19:18:15.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.917+0000 7fa2068f8640 1 -- start start 2023-10-03T19:18:15.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.921+0000 7fa2068f8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2000a2e20 0x7fa2001ea340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:15.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.921+0000 7fa2068f8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2000b98f0 0x7fa200150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:15.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.921+0000 7fa2068f8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2000bc810 0x7fa2001512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:15.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.921+0000 7fa2068f8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20014a520 con 0x7fa2000b98f0 2023-10-03T19:18:15.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.921+0000 7fa2068f8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20014b3f0 con 0x7fa2000a2e20 2023-10-03T19:18:15.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.921+0000 7fa2068f8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2001517f0 con 0x7fa2000bc810 2023-10-03T19:18:15.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.921+0000 7fa1ff7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2000b98f0 0x7fa200150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:15.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.921+0000 7fa1ff7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2000b98f0 0x7fa200150d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41068/0 (socket says 172.21.15.45:41068) 2023-10-03T19:18:15.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.921+0000 7fa1ff7fe640 1 -- 172.21.15.45:0/1780836798 learned_addr learned my addr 172.21.15.45:0/1780836798 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:15.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.921+0000 7fa1fffff640 1 --2- 172.21.15.45:0/1780836798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2000a2e20 0x7fa2001ea340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:15.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.921+0000 7fa1ff7fe640 1 -- 172.21.15.45:0/1780836798 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2000bc810 msgr2=0x7fa2001512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:15.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.921+0000 7fa1ff7fe640 1 --2- 172.21.15.45:0/1780836798 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2000bc810 0x7fa2001512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:15.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.921+0000 7fa1ff7fe640 1 -- 172.21.15.45:0/1780836798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2000a2e20 msgr2=0x7fa2001ea340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:15.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.921+0000 7fa1ff7fe640 1 --2- 172.21.15.45:0/1780836798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2000a2e20 0x7fa2001ea340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:15.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.921+0000 7fa1ff7fe640 1 -- 172.21.15.45:0/1780836798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f0009420 con 0x7fa2000b98f0 2023-10-03T19:18:15.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.921+0000 7fa1ff7fe640 1 --2- 172.21.15.45:0/1780836798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2000b98f0 0x7fa200150d70 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fa1f400c3f0 tx=0x7fa1f400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:15.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.921+0000 7fa1fcff9640 1 -- 172.21.15.45:0/1780836798 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f40052d0 con 0x7fa2000b98f0 2023-10-03T19:18:15.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.921+0000 7fa1fcff9640 1 -- 172.21.15.45:0/1780836798 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f4005430 con 0x7fa2000b98f0 2023-10-03T19:18:15.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.921+0000 7fa2068f8640 1 -- 172.21.15.45:0/1780836798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa20015c7e0 con 0x7fa2000b98f0 2023-10-03T19:18:15.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.921+0000 7fa1fcff9640 1 -- 172.21.15.45:0/1780836798 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4003840 con 0x7fa2000b98f0 2023-10-03T19:18:15.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.921+0000 7fa2068f8640 1 -- 172.21.15.45:0/1780836798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa20014c160 con 0x7fa2000b98f0 2023-10-03T19:18:15.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.921+0000 7fa2068f8640 1 -- 172.21.15.45:0/1780836798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa20015c970 con 0x7fa2000b98f0 2023-10-03T19:18:15.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.921+0000 7fa1fcff9640 1 -- 172.21.15.45:0/1780836798 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa1f40039a0 con 0x7fa2000b98f0 2023-10-03T19:18:15.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.921+0000 7fa1fcff9640 1 --2- 172.21.15.45:0/1780836798 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa1ec0662b0 0x7fa1ec068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:15.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.921+0000 7fa1fcff9640 1 -- 172.21.15.45:0/1780836798 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa1f40833c0 con 0x7fa2000b98f0 2023-10-03T19:18:15.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.921+0000 7fa1fffff640 1 --2- 172.21.15.45:0/1780836798 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa1ec0662b0 0x7fa1ec068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:15.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.925+0000 7fa1fffff640 1 --2- 172.21.15.45:0/1780836798 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa1ec0662b0 0x7fa1ec068760 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa1f00ae000 tx=0x7fa1f0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:15.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:15.925+0000 7fa1fcff9640 1 -- 172.21.15.45:0/1780836798 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa1f4050710 con 0x7fa2000b98f0 2023-10-03T19:18:16.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.113+0000 7fa2068f8640 1 -- 172.21.15.45:0/1780836798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa20004de80 con 0x7fa2000b98f0 2023-10-03T19:18:16.773 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-10-03T19:18:16.769+0000 7f00b6fb3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-03T19:18:16.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.785+0000 7fa1fcff9640 1 -- 172.21.15.45:0/1780836798 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa1f4053d30 con 0x7fa2000b98f0 2023-10-03T19:18:16.787 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-03T19:18:16.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.789+0000 7fa2068f8640 1 -- 172.21.15.45:0/1780836798 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa1ec0662b0 msgr2=0x7fa1ec068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:16.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.789+0000 7fa2068f8640 1 --2- 172.21.15.45:0/1780836798 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa1ec0662b0 0x7fa1ec068760 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa1f00ae000 tx=0x7fa1f0008040 comp rx=0 tx=0).stop 2023-10-03T19:18:16.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.789+0000 7fa2068f8640 1 -- 172.21.15.45:0/1780836798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2000b98f0 msgr2=0x7fa200150d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:16.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.789+0000 7fa2068f8640 1 --2- 172.21.15.45:0/1780836798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2000b98f0 0x7fa200150d70 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fa1f400c3f0 tx=0x7fa1f400c8b0 comp rx=0 tx=0).stop 2023-10-03T19:18:16.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.789+0000 7fa2068f8640 1 -- 172.21.15.45:0/1780836798 shutdown_connections 2023-10-03T19:18:16.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.789+0000 7fa2068f8640 1 --2- 172.21.15.45:0/1780836798 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa1ec0662b0 0x7fa1ec068760 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:16.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.789+0000 7fa2068f8640 1 --2- 172.21.15.45:0/1780836798 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2000bc810 0x7fa2001512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:16.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.789+0000 7fa2068f8640 1 --2- 172.21.15.45:0/1780836798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2000b98f0 0x7fa200150d70 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:16.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.789+0000 7fa2068f8640 1 --2- 172.21.15.45:0/1780836798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2000a2e20 0x7fa2001ea340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:16.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.789+0000 7fa2068f8640 1 -- 172.21.15.45:0/1780836798 >> 172.21.15.45:0/1780836798 conn(0x7fa2000bcf50 msgr2=0x7fa200140ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:16.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.789+0000 7fa2068f8640 1 -- 172.21.15.45:0/1780836798 shutdown_connections 2023-10-03T19:18:16.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.789+0000 7fa2068f8640 1 -- 172.21.15.45:0/1780836798 wait complete. 2023-10-03T19:18:16.812 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-03T19:18:16.843 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-10-03T19:18:16.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.933+0000 7f6686bf9640 1 Processor -- start 2023-10-03T19:18:16.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.933+0000 7f6686bf9640 1 -- start start 2023-10-03T19:18:16.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.933+0000 7f6686bf9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f668014f510 0x7f668014b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:16.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.933+0000 7f6686bf9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f66800bd9f0 0x7f668014b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:16.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.933+0000 7f6686bf9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f668014f080 con 0x7f668006f880 2023-10-03T19:18:16.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.933+0000 7f6686bf9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f668006f3e0 con 0x7f668014f510 2023-10-03T19:18:16.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.933+0000 7f6686bf9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6680070e90 con 0x7f66800bd9f0 2023-10-03T19:18:16.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.933+0000 7f667ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f668014f510 0x7f668014b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:16.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.933+0000 7f667ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f668014f510 0x7f668014b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41088/0 (socket says 172.21.15.45:41088) 2023-10-03T19:18:16.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.933+0000 7f667ffff640 1 -- 172.21.15.45:0/2739518113 learned_addr learned my addr 172.21.15.45:0/2739518113 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:16.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.933+0000 7f667ffff640 1 -- 172.21.15.45:0/2739518113 >> v2:172.21.15.79:3300/0 conn(0x7f66800bd9f0 msgr2=0x7f668014b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:16.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.933+0000 7f667ffff640 1 --2- 172.21.15.45:0/2739518113 >> v2:172.21.15.79:3300/0 conn(0x7f66800bd9f0 0x7f668014b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:16.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.933+0000 7f667ffff640 1 -- 172.21.15.45:0/2739518113 >> v1:172.21.15.79:6789/0 conn(0x7f668006f880 legacy=0x7f66800a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:16.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.933+0000 7f667ffff640 1 -- 172.21.15.45:0/2739518113 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668014ea30 con 0x7f668014f510 2023-10-03T19:18:16.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.937+0000 7f667ffff640 1 --2- 172.21.15.45:0/2739518113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f668014f510 0x7f668014b320 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f668006ec00 tx=0x7f666c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a1087245df0109f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:16.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.937+0000 7f667f7fe640 1 -- 172.21.15.45:0/2739518113 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c0ab5f0 con 0x7f668014f510 2023-10-03T19:18:16.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.937+0000 7f667f7fe640 1 -- 172.21.15.45:0/2739518113 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666c0ab750 con 0x7f668014f510 2023-10-03T19:18:16.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.937+0000 7f667f7fe640 1 -- 172.21.15.45:0/2739518113 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c0abae0 con 0x7f668014f510 2023-10-03T19:18:16.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.937+0000 7f6686bf9640 1 -- 172.21.15.45:0/2739518113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f668014f510 msgr2=0x7f668014b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:16.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.937+0000 7f6686bf9640 1 --2- 172.21.15.45:0/2739518113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f668014f510 0x7f668014b320 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f668006ec00 tx=0x7f666c01c490 comp rx=0 tx=0).stop 2023-10-03T19:18:16.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.937+0000 7f6686bf9640 1 -- 172.21.15.45:0/2739518113 shutdown_connections 2023-10-03T19:18:16.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.937+0000 7f6686bf9640 1 --2- 172.21.15.45:0/2739518113 >> v2:172.21.15.79:3300/0 conn(0x7f66800bd9f0 0x7f668014b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:16.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.937+0000 7f6686bf9640 1 --2- 172.21.15.45:0/2739518113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f668014f510 0x7f668014b320 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:16.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.937+0000 7f6686bf9640 1 -- 172.21.15.45:0/2739518113 >> 172.21.15.45:0/2739518113 conn(0x7f66800a20d0 msgr2=0x7f66800a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:16.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.937+0000 7f6686bf9640 1 -- 172.21.15.45:0/2739518113 shutdown_connections 2023-10-03T19:18:16.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.937+0000 7f6686bf9640 1 -- 172.21.15.45:0/2739518113 wait complete. 2023-10-03T19:18:16.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.937+0000 7f6686bf9640 1 Processor -- start 2023-10-03T19:18:16.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.937+0000 7f6686bf9640 1 -- start start 2023-10-03T19:18:16.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.941+0000 7f6686bf9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f668006f880 0x7f66801e9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:16.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.941+0000 7f6686bf9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66800bd9f0 0x7f668014aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:16.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.941+0000 7f6686bf9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f668014f510 0x7f66800a33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:16.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.941+0000 7f6686bf9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66800a4950 con 0x7f66800bd9f0 2023-10-03T19:18:16.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.941+0000 7f6686bf9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66800a4fe0 con 0x7f668014f510 2023-10-03T19:18:16.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.941+0000 7f6686bf9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668014af70 con 0x7f668006f880 2023-10-03T19:18:16.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.941+0000 7f667ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66800bd9f0 0x7f668014aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:16.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.941+0000 7f667ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66800bd9f0 0x7f668014aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41096/0 (socket says 172.21.15.45:41096) 2023-10-03T19:18:16.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.941+0000 7f667ffff640 1 -- 172.21.15.45:0/1930292554 learned_addr learned my addr 172.21.15.45:0/1930292554 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:16.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.941+0000 7f6685196640 1 --2- 172.21.15.45:0/1930292554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f668014f510 0x7f66800a33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:16.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.941+0000 7f6684995640 1 --2- 172.21.15.45:0/1930292554 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f668006f880 0x7f66801e9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:16.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.941+0000 7f667ffff640 1 -- 172.21.15.45:0/1930292554 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f668006f880 msgr2=0x7f66801e9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:16.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.941+0000 7f667ffff640 1 --2- 172.21.15.45:0/1930292554 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f668006f880 0x7f66801e9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:16.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.941+0000 7f667ffff640 1 -- 172.21.15.45:0/1930292554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f668014f510 msgr2=0x7f66800a33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:16.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.941+0000 7f667ffff640 1 --2- 172.21.15.45:0/1930292554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f668014f510 0x7f66800a33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:16.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.941+0000 7f667ffff640 1 -- 172.21.15.45:0/1930292554 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f666c0094d0 con 0x7f66800bd9f0 2023-10-03T19:18:16.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.941+0000 7f6685196640 1 --2- 172.21.15.45:0/1930292554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f668014f510 0x7f66800a33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:16.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.941+0000 7f667ffff640 1 --2- 172.21.15.45:0/1930292554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66800bd9f0 0x7f668014aa30 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f666c01a0c0 tx=0x7f666c01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:16.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.941+0000 7f667d7fa640 1 -- 172.21.15.45:0/1930292554 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c0b4800 con 0x7f66800bd9f0 2023-10-03T19:18:16.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.941+0000 7f667d7fa640 1 -- 172.21.15.45:0/1930292554 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666c0b4960 con 0x7f66800bd9f0 2023-10-03T19:18:16.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.941+0000 7f6686bf9640 1 -- 172.21.15.45:0/1930292554 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66800a6050 con 0x7f66800bd9f0 2023-10-03T19:18:16.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.941+0000 7f667d7fa640 1 -- 172.21.15.45:0/1930292554 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c0b4d10 con 0x7f66800bd9f0 2023-10-03T19:18:16.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.941+0000 7f6686bf9640 1 -- 172.21.15.45:0/1930292554 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f668006fc50 con 0x7f66800bd9f0 2023-10-03T19:18:16.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.941+0000 7f6686bf9640 1 -- 172.21.15.45:0/1930292554 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66800a61e0 con 0x7f66800bd9f0 2023-10-03T19:18:16.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.941+0000 7f667d7fa640 1 -- 172.21.15.45:0/1930292554 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f666c0b3380 con 0x7f66800bd9f0 2023-10-03T19:18:16.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.941+0000 7f667d7fa640 1 --2- 172.21.15.45:0/1930292554 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6664066280 0x7f6664068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:16.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.941+0000 7f667d7fa640 1 -- 172.21.15.45:0/1930292554 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f666c0a8050 con 0x7f66800bd9f0 2023-10-03T19:18:16.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.941+0000 7f6684995640 1 --2- 172.21.15.45:0/1930292554 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6664066280 0x7f6664068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:16.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.945+0000 7f6684995640 1 --2- 172.21.15.45:0/1930292554 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6664066280 0x7f6664068730 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f667400a790 tx=0x7f6674008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:16.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:16.945+0000 7f667d7fa640 1 -- 172.21.15.45:0/1930292554 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f666c0eb220 con 0x7f66800bd9f0 2023-10-03T19:18:17.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.137+0000 7f6686bf9640 1 -- 172.21.15.45:0/1930292554 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f668004de80 con 0x7f66800bd9f0 2023-10-03T19:18:17.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.789+0000 7f667d7fa640 1 -- 172.21.15.45:0/1930292554 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) v1 ==== 104+0+0 (secure 0 0 0) 0x7f666c0ee840 con 0x7f66800bd9f0 2023-10-03T19:18:17.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.793+0000 7f6686bf9640 1 -- 172.21.15.45:0/1930292554 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6664066280 msgr2=0x7f6664068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:17.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.793+0000 7f6686bf9640 1 --2- 172.21.15.45:0/1930292554 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6664066280 0x7f6664068730 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f667400a790 tx=0x7f6674008040 comp rx=0 tx=0).stop 2023-10-03T19:18:17.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.793+0000 7f6686bf9640 1 -- 172.21.15.45:0/1930292554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66800bd9f0 msgr2=0x7f668014aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:17.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.793+0000 7f6686bf9640 1 --2- 172.21.15.45:0/1930292554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66800bd9f0 0x7f668014aa30 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f666c01a0c0 tx=0x7f666c01acd0 comp rx=0 tx=0).stop 2023-10-03T19:18:17.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.793+0000 7f6686bf9640 1 -- 172.21.15.45:0/1930292554 shutdown_connections 2023-10-03T19:18:17.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.793+0000 7f6686bf9640 1 --2- 172.21.15.45:0/1930292554 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6664066280 0x7f6664068730 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:17.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.793+0000 7f6686bf9640 1 --2- 172.21.15.45:0/1930292554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f668014f510 0x7f66800a33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:17.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.793+0000 7f6686bf9640 1 --2- 172.21.15.45:0/1930292554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66800bd9f0 0x7f668014aa30 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:17.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.793+0000 7f6686bf9640 1 --2- 172.21.15.45:0/1930292554 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f668006f880 0x7f66801e9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:17.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.793+0000 7f6686bf9640 1 -- 172.21.15.45:0/1930292554 >> 172.21.15.45:0/1930292554 conn(0x7f66800a20d0 msgr2=0x7f668006ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:17.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.793+0000 7f6686bf9640 1 -- 172.21.15.45:0/1930292554 shutdown_connections 2023-10-03T19:18:17.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.793+0000 7f6686bf9640 1 -- 172.21.15.45:0/1930292554 wait complete. 2023-10-03T19:18:17.817 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-03T19:18:17.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.989+0000 7fa392509640 1 Processor -- start 2023-10-03T19:18:17.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.989+0000 7fa392509640 1 -- start start 2023-10-03T19:18:17.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.989+0000 7fa392509640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa38c0712c0 0x7fa38c0bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:17.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.989+0000 7fa392509640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa38c06c760 0x7fa38c0bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:17.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.989+0000 7fa392509640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa38c06c2d0 con 0x7fa38c06d560 2023-10-03T19:18:17.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.989+0000 7fa392509640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa38c150610 con 0x7fa38c06c760 2023-10-03T19:18:17.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.989+0000 7fa392509640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa38c1508b0 con 0x7fa38c0712c0 2023-10-03T19:18:17.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.993+0000 7fa38b7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa38c06d560 0x7fa38c0a53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39526/0 (socket says 172.21.15.45:39526) 2023-10-03T19:18:17.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.993+0000 7fa38b7fe640 1 -- 172.21.15.45:0/2450535822 learned_addr learned my addr 172.21.15.45:0/2450535822 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:18:17.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.993+0000 7fa390aa6640 1 --2- 172.21.15.45:0/2450535822 >> v2:172.21.15.45:3300/0 conn(0x7fa38c06c760 0x7fa38c0bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:17.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.993+0000 7fa38bfff640 1 --2- 172.21.15.45:0/2450535822 >> v2:172.21.15.79:3300/0 conn(0x7fa38c0712c0 0x7fa38c0bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:17.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.993+0000 7fa38affd640 1 -- 172.21.15.45:0/2450535822 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3831623053 0 0) 0x7fa38c06c2d0 con 0x7fa38c06d560 2023-10-03T19:18:17.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.993+0000 7fa38affd640 1 -- 172.21.15.45:0/2450535822 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa374003530 con 0x7fa38c06d560 2023-10-03T19:18:17.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.993+0000 7fa390aa6640 1 -- 172.21.15.45:0/2450535822 >> v2:172.21.15.79:3300/0 conn(0x7fa38c0712c0 msgr2=0x7fa38c0bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:17.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.993+0000 7fa390aa6640 1 --2- 172.21.15.45:0/2450535822 >> v2:172.21.15.79:3300/0 conn(0x7fa38c0712c0 0x7fa38c0bcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:17.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.993+0000 7fa390aa6640 1 -- 172.21.15.45:0/2450535822 >> v1:172.21.15.45:6789/0 conn(0x7fa38c06d560 legacy=0x7fa38c0a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:17.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.993+0000 7fa390aa6640 1 -- 172.21.15.45:0/2450535822 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38c06d2e0 con 0x7fa38c06c760 2023-10-03T19:18:17.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.993+0000 7fa38bfff640 1 --2- 172.21.15.45:0/2450535822 >> v2:172.21.15.79:3300/0 conn(0x7fa38c0712c0 0x7fa38c0bcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:18:17.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.993+0000 7fa390aa6640 1 --2- 172.21.15.45:0/2450535822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa38c06c760 0x7fa38c0bd100 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0a2fd0 tx=0x7fa38401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906936b6156b5248 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:17.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.993+0000 7fa38affd640 1 -- 172.21.15.45:0/2450535822 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3840a5910 con 0x7fa38c06c760 2023-10-03T19:18:17.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.993+0000 7fa38affd640 1 -- 172.21.15.45:0/2450535822 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3840a5a70 con 0x7fa38c06c760 2023-10-03T19:18:17.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.993+0000 7fa38affd640 1 -- 172.21.15.45:0/2450535822 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3840a5e00 con 0x7fa38c06c760 2023-10-03T19:18:17.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.993+0000 7fa392509640 1 -- 172.21.15.45:0/2450535822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa38c06c760 msgr2=0x7fa38c0bd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:17.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.993+0000 7fa392509640 1 --2- 172.21.15.45:0/2450535822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa38c06c760 0x7fa38c0bd100 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0a2fd0 tx=0x7fa38401c910 comp rx=0 tx=0).stop 2023-10-03T19:18:17.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.993+0000 7fa392509640 1 -- 172.21.15.45:0/2450535822 shutdown_connections 2023-10-03T19:18:17.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.993+0000 7fa392509640 1 --2- 172.21.15.45:0/2450535822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa38c06c760 0x7fa38c0bd100 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:17.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.993+0000 7fa392509640 1 --2- 172.21.15.45:0/2450535822 >> v2:172.21.15.79:3300/0 conn(0x7fa38c0712c0 0x7fa38c0bcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:17.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.993+0000 7fa392509640 1 -- 172.21.15.45:0/2450535822 >> 172.21.15.45:0/2450535822 conn(0x7fa38c0a20d0 msgr2=0x7fa38c0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:17.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.993+0000 7fa392509640 1 -- 172.21.15.45:0/2450535822 shutdown_connections 2023-10-03T19:18:17.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.993+0000 7fa392509640 1 -- 172.21.15.45:0/2450535822 wait complete. 2023-10-03T19:18:17.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.997+0000 7fa392509640 1 Processor -- start 2023-10-03T19:18:17.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.997+0000 7fa392509640 1 -- start start 2023-10-03T19:18:18.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.997+0000 7fa392509640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa38c06c760 0x7fa38c141a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:18.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.997+0000 7fa392509640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa38c06d560 0x7fa38c149900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:18.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.997+0000 7fa392509640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa38c0712c0 0x7fa38c13ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:18.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.997+0000 7fa392509640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c149e40 con 0x7fa38c06c760 2023-10-03T19:18:18.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.997+0000 7fa392509640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c13f990 con 0x7fa38c06d560 2023-10-03T19:18:18.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.997+0000 7fa392509640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c143400 con 0x7fa38c0712c0 2023-10-03T19:18:18.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.997+0000 7fa38bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa38c06c760 0x7fa38c141a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:18.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.997+0000 7fa38bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa38c06c760 0x7fa38c141a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41118/0 (socket says 172.21.15.45:41118) 2023-10-03T19:18:18.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.997+0000 7fa38bfff640 1 -- 172.21.15.45:0/4292177202 learned_addr learned my addr 172.21.15.45:0/4292177202 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:18.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.997+0000 7fa38b7fe640 1 --2- 172.21.15.45:0/4292177202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa38c06d560 0x7fa38c149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:18.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.997+0000 7fa390aa6640 1 --2- 172.21.15.45:0/4292177202 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa38c0712c0 0x7fa38c13ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:18.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.997+0000 7fa38bfff640 1 -- 172.21.15.45:0/4292177202 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa38c0712c0 msgr2=0x7fa38c13ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:18.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.997+0000 7fa38bfff640 1 --2- 172.21.15.45:0/4292177202 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa38c0712c0 0x7fa38c13ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:18.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.997+0000 7fa38bfff640 1 -- 172.21.15.45:0/4292177202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa38c06d560 msgr2=0x7fa38c149900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:18.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.997+0000 7fa38bfff640 1 --2- 172.21.15.45:0/4292177202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa38c06d560 0x7fa38c149900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:18.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.997+0000 7fa38bfff640 1 -- 172.21.15.45:0/4292177202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa384009a70 con 0x7fa38c06c760 2023-10-03T19:18:18.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.997+0000 7fa38b7fe640 1 --2- 172.21.15.45:0/4292177202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa38c06d560 0x7fa38c149900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:18.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.997+0000 7fa38bfff640 1 --2- 172.21.15.45:0/4292177202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa38c06c760 0x7fa38c141a80 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fa37c00d800 tx=0x7fa37c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:18.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.997+0000 7fa388ff9640 1 -- 172.21.15.45:0/4292177202 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c0096c0 con 0x7fa38c06c760 2023-10-03T19:18:18.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.997+0000 7fa388ff9640 1 -- 172.21.15.45:0/4292177202 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37c009820 con 0x7fa38c06c760 2023-10-03T19:18:18.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.997+0000 7fa388ff9640 1 -- 172.21.15.45:0/4292177202 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c009bd0 con 0x7fa38c06c760 2023-10-03T19:18:18.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.997+0000 7fa392509640 1 -- 172.21.15.45:0/4292177202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa38c0a6070 con 0x7fa38c06c760 2023-10-03T19:18:18.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:17.997+0000 7fa392509640 1 -- 172.21.15.45:0/4292177202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa38c0a5ee0 con 0x7fa38c06c760 2023-10-03T19:18:18.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.001+0000 7fa392509640 1 -- 172.21.15.45:0/4292177202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa38c1596f0 con 0x7fa38c06c760 2023-10-03T19:18:18.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.001+0000 7fa388ff9640 1 -- 172.21.15.45:0/4292177202 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa37c009d30 con 0x7fa38c06c760 2023-10-03T19:18:18.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.001+0000 7fa388ff9640 1 --2- 172.21.15.45:0/4292177202 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa378066280 0x7fa378068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:18.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.001+0000 7fa388ff9640 1 -- 172.21.15.45:0/4292177202 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fa37c084650 con 0x7fa38c06c760 2023-10-03T19:18:18.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.001+0000 7fa38b7fe640 1 --2- 172.21.15.45:0/4292177202 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa378066280 0x7fa378068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:18.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.001+0000 7fa38b7fe640 1 --2- 172.21.15.45:0/4292177202 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa378066280 0x7fa378068730 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0bb1c0 tx=0x7fa380009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:18.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.005+0000 7fa388ff9640 1 -- 172.21.15.45:0/4292177202 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa37c051940 con 0x7fa38c06c760 2023-10-03T19:18:18.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.157+0000 7fa392509640 1 -- 172.21.15.45:0/4292177202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa38c0bca30 con 0x7fa38c06c760 2023-10-03T19:18:18.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.797+0000 7fa388ff9640 1 -- 172.21.15.45:0/4292177202 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v76) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa37c054f60 con 0x7fa38c06c760 2023-10-03T19:18:18.802 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-10-03T19:18:18.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.801+0000 7fa392509640 1 -- 172.21.15.45:0/4292177202 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa378066280 msgr2=0x7fa378068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:18.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.801+0000 7fa392509640 1 --2- 172.21.15.45:0/4292177202 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa378066280 0x7fa378068730 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0bb1c0 tx=0x7fa380009040 comp rx=0 tx=0).stop 2023-10-03T19:18:18.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.801+0000 7fa392509640 1 -- 172.21.15.45:0/4292177202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa38c06c760 msgr2=0x7fa38c141a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:18.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.801+0000 7fa392509640 1 --2- 172.21.15.45:0/4292177202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa38c06c760 0x7fa38c141a80 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fa37c00d800 tx=0x7fa37c00dcc0 comp rx=0 tx=0).stop 2023-10-03T19:18:18.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.805+0000 7fa392509640 1 -- 172.21.15.45:0/4292177202 shutdown_connections 2023-10-03T19:18:18.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.805+0000 7fa392509640 1 --2- 172.21.15.45:0/4292177202 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa378066280 0x7fa378068730 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:18.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.805+0000 7fa392509640 1 --2- 172.21.15.45:0/4292177202 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa38c0712c0 0x7fa38c13ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:18.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.805+0000 7fa392509640 1 --2- 172.21.15.45:0/4292177202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa38c06d560 0x7fa38c149900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:18.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.805+0000 7fa392509640 1 --2- 172.21.15.45:0/4292177202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa38c06c760 0x7fa38c141a80 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:18.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.805+0000 7fa392509640 1 -- 172.21.15.45:0/4292177202 >> 172.21.15.45:0/4292177202 conn(0x7fa38c0a20d0 msgr2=0x7fa38c0a3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:18.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.805+0000 7fa392509640 1 -- 172.21.15.45:0/4292177202 shutdown_connections 2023-10-03T19:18:18.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.805+0000 7fa392509640 1 -- 172.21.15.45:0/4292177202 wait complete. 2023-10-03T19:18:18.832 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-03T19:18:18.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.961+0000 7ff0a2537640 1 Processor -- start 2023-10-03T19:18:18.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.961+0000 7ff0a2537640 1 -- start start 2023-10-03T19:18:18.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.961+0000 7ff0a2537640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff09c0c14e0 0x7ff09c0c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:18.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.961+0000 7ff0a2537640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09c06ac70 con 0x7ff09c0c2770 2023-10-03T19:18:18.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.961+0000 7ff0a2537640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09c0c3000 con 0x7ff09c0bf1f0 2023-10-03T19:18:18.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.961+0000 7ff0a2537640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff09c0aa5f0 con 0x7ff09c0c14e0 2023-10-03T19:18:18.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.961+0000 7ff0a0ad4640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff09c0c2770 0x7ff09c069ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39540/0 (socket says 172.21.15.45:39540) 2023-10-03T19:18:18.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.961+0000 7ff0a0ad4640 1 -- 172.21.15.45:0/101687464 learned_addr learned my addr 172.21.15.45:0/101687464 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:18:18.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.961+0000 7ff09bfff640 1 --2- 172.21.15.45:0/101687464 >> v2:172.21.15.79:3300/0 conn(0x7ff09c0c14e0 0x7ff09c0c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:18.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.961+0000 7ff09affd640 1 -- 172.21.15.45:0/101687464 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3005710856 0 0) 0x7ff09c06ac70 con 0x7ff09c0c2770 2023-10-03T19:18:18.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.961+0000 7ff09affd640 1 -- 172.21.15.45:0/101687464 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff088003530 con 0x7ff09c0c2770 2023-10-03T19:18:18.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.961+0000 7ff09affd640 1 -- 172.21.15.45:0/101687464 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2876445522 0 0) 0x7ff088003530 con 0x7ff09c0c2770 2023-10-03T19:18:18.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.961+0000 7ff09affd640 1 -- 172.21.15.45:0/101687464 >> v2:172.21.15.79:3300/0 conn(0x7ff09c0c14e0 msgr2=0x7ff09c0c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:18.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.961+0000 7ff09affd640 1 --2- 172.21.15.45:0/101687464 >> v2:172.21.15.79:3300/0 conn(0x7ff09c0c14e0 0x7ff09c0c0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:18.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.961+0000 7ff09affd640 1 -- 172.21.15.45:0/101687464 >> v1:172.21.15.79:6789/0 conn(0x7ff09c0bf1f0 legacy=0x7ff09c0a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:18.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.961+0000 7ff09affd640 1 -- 172.21.15.45:0/101687464 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09c14f250 con 0x7ff09c0c2770 2023-10-03T19:18:18.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.961+0000 7ff09affd640 1 -- 172.21.15.45:0/101687464 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7ff094001a00 con 0x7ff09c0c2770 2023-10-03T19:18:18.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.961+0000 7ff09affd640 1 -- 172.21.15.45:0/101687464 >> v1:172.21.15.45:6789/0 conn(0x7ff09c0c2770 legacy=0x7ff09c069ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:18.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.961+0000 7ff09affd640 1 --2- 172.21.15.45:0/101687464 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff088003980 0x7ff088003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:18.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.961+0000 7ff09affd640 1 --2- 172.21.15.45:0/101687464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0880047d0 0x7ff088004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:18.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.961+0000 7ff09affd640 1 --2- 172.21.15.45:0/101687464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff088005180 0x7ff08800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:18.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.961+0000 7ff09affd640 1 -- 172.21.15.45:0/101687464 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c0aa5f0 con 0x7ff088005180 2023-10-03T19:18:18.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.961+0000 7ff09affd640 1 -- 172.21.15.45:0/101687464 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08800bfe0 con 0x7ff0880047d0 2023-10-03T19:18:18.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.961+0000 7ff09affd640 1 -- 172.21.15.45:0/101687464 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff08800c1a0 con 0x7ff088003980 2023-10-03T19:18:18.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.961+0000 7ff0a0ad4640 1 --2- 172.21.15.45:0/101687464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff088005180 0x7ff08800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:18.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.961+0000 7ff0a0ad4640 1 -- 172.21.15.45:0/101687464 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff088003980 msgr2=0x7ff088003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:18.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.961+0000 7ff0a0ad4640 1 --2- 172.21.15.45:0/101687464 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff088003980 0x7ff088003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:18.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.961+0000 7ff0a0ad4640 1 -- 172.21.15.45:0/101687464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0880047d0 msgr2=0x7ff088004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:18.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.961+0000 7ff0a0ad4640 1 --2- 172.21.15.45:0/101687464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0880047d0 0x7ff088004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:18.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.961+0000 7ff0a0ad4640 1 -- 172.21.15.45:0/101687464 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff088003530 con 0x7ff088005180 2023-10-03T19:18:18.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.965+0000 7ff0a0ad4640 1 -- 172.21.15.45:0/101687464 reap_dead start 2023-10-03T19:18:18.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.965+0000 7ff0a0ad4640 1 --2- 172.21.15.45:0/101687464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff088005180 0x7ff08800b990 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7ff09400a800 tx=0x7ff09401d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6232ca88e05411ed server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:18.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.965+0000 7ff09affd640 1 -- 172.21.15.45:0/101687464 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0940072d0 con 0x7ff088005180 2023-10-03T19:18:18.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.965+0000 7ff09affd640 1 -- 172.21.15.45:0/101687464 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0940a8070 con 0x7ff088005180 2023-10-03T19:18:18.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.965+0000 7ff09affd640 1 -- 172.21.15.45:0/101687464 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff094007670 con 0x7ff088005180 2023-10-03T19:18:18.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.965+0000 7ff0a2537640 1 -- 172.21.15.45:0/101687464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff088005180 msgr2=0x7ff08800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:18.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.965+0000 7ff0a2537640 1 --2- 172.21.15.45:0/101687464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff088005180 0x7ff08800b990 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7ff09400a800 tx=0x7ff09401d300 comp rx=0 tx=0).stop 2023-10-03T19:18:18.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.965+0000 7ff0a2537640 1 -- 172.21.15.45:0/101687464 shutdown_connections 2023-10-03T19:18:18.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.965+0000 7ff0a2537640 1 --2- 172.21.15.45:0/101687464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff088005180 0x7ff08800b990 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:18.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.965+0000 7ff0a2537640 1 -- 172.21.15.45:0/101687464 >> 172.21.15.45:0/101687464 conn(0x7ff09c0a6440 msgr2=0x7ff09c0a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:18.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.965+0000 7ff0a2537640 1 -- 172.21.15.45:0/101687464 shutdown_connections 2023-10-03T19:18:18.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.965+0000 7ff0a2537640 1 -- 172.21.15.45:0/101687464 wait complete. 2023-10-03T19:18:18.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.965+0000 7ff0a2537640 1 Processor -- start 2023-10-03T19:18:18.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.965+0000 7ff0a2537640 1 -- start start 2023-10-03T19:18:18.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.969+0000 7ff0a2537640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff088005180 0x7ff09c1e6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:18.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.969+0000 7ff0a2537640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff09c14b7e0 0x7ff09c1e2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:18.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.969+0000 7ff0a2537640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff09c09ad80 0x7ff09c0bad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:18.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.969+0000 7ff0a2537640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c09d400 con 0x7ff088005180 2023-10-03T19:18:18.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.969+0000 7ff0a2537640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c1e6590 con 0x7ff09c09ad80 2023-10-03T19:18:18.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.969+0000 7ff0a2537640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c09d610 con 0x7ff09c14b7e0 2023-10-03T19:18:18.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.969+0000 7ff09bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff088005180 0x7ff09c1e6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:18.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.969+0000 7ff09bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff088005180 0x7ff09c1e6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41148/0 (socket says 172.21.15.45:41148) 2023-10-03T19:18:18.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.969+0000 7ff09bfff640 1 -- 172.21.15.45:0/426206671 learned_addr learned my addr 172.21.15.45:0/426206671 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:18.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.969+0000 7ff09b7fe640 1 --2- 172.21.15.45:0/426206671 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff09c14b7e0 0x7ff09c1e2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:18.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.969+0000 7ff0a0ad4640 1 --2- 172.21.15.45:0/426206671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff09c09ad80 0x7ff09c0bad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:18.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.969+0000 7ff09bfff640 1 -- 172.21.15.45:0/426206671 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff09c14b7e0 msgr2=0x7ff09c1e2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:18.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.969+0000 7ff09bfff640 1 --2- 172.21.15.45:0/426206671 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff09c14b7e0 0x7ff09c1e2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:18.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.969+0000 7ff09bfff640 1 -- 172.21.15.45:0/426206671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff09c09ad80 msgr2=0x7ff09c0bad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:18.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.969+0000 7ff09bfff640 1 --2- 172.21.15.45:0/426206671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff09c09ad80 0x7ff09c0bad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:18.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.969+0000 7ff09bfff640 1 -- 172.21.15.45:0/426206671 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09c06b100 con 0x7ff088005180 2023-10-03T19:18:18.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.969+0000 7ff0a0ad4640 1 --2- 172.21.15.45:0/426206671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff09c09ad80 0x7ff09c0bad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:18.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.969+0000 7ff09bfff640 1 --2- 172.21.15.45:0/426206671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff088005180 0x7ff09c1e6fe0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7ff08400e7c0 tx=0x7ff08400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:18.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.969+0000 7ff098ff9640 1 -- 172.21.15.45:0/426206671 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08400ee70 con 0x7ff088005180 2023-10-03T19:18:18.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.969+0000 7ff098ff9640 1 -- 172.21.15.45:0/426206671 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08400c940 con 0x7ff088005180 2023-10-03T19:18:18.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.969+0000 7ff0a2537640 1 -- 172.21.15.45:0/426206671 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff09c14f530 con 0x7ff088005180 2023-10-03T19:18:18.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.969+0000 7ff098ff9640 1 -- 172.21.15.45:0/426206671 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08400ccf0 con 0x7ff088005180 2023-10-03T19:18:18.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.969+0000 7ff0a2537640 1 -- 172.21.15.45:0/426206671 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff09c0c18b0 con 0x7ff088005180 2023-10-03T19:18:18.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.969+0000 7ff0a2537640 1 -- 172.21.15.45:0/426206671 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff09c04de80 con 0x7ff088005180 2023-10-03T19:18:18.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.969+0000 7ff098ff9640 1 -- 172.21.15.45:0/426206671 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff084013470 con 0x7ff088005180 2023-10-03T19:18:18.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.969+0000 7ff098ff9640 1 --2- 172.21.15.45:0/426206671 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff07c066280 0x7ff07c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:18.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.969+0000 7ff098ff9640 1 -- 172.21.15.45:0/426206671 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5710+0+0 (secure 0 0 0) 0x7ff084083b90 con 0x7ff088005180 2023-10-03T19:18:18.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.969+0000 7ff09b7fe640 1 --2- 172.21.15.45:0/426206671 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff07c066280 0x7ff07c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:18.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.973+0000 7ff09b7fe640 1 --2- 172.21.15.45:0/426206671 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff07c066280 0x7ff07c068730 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff09c0beb80 tx=0x7ff08c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:18.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:18.973+0000 7ff098ff9640 1 -- 172.21.15.45:0/426206671 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff084051200 con 0x7ff088005180 2023-10-03T19:18:19.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.129+0000 7ff0a2537640 1 -- 172.21.15.45:0/426206671 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff09c09e880 con 0x7ff088005180 2023-10-03T19:18:19.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.805+0000 7ff098ff9640 1 -- 172.21.15.45:0/426206671 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v77) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff0840170d0 con 0x7ff088005180 2023-10-03T19:18:19.810 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-10-03T19:18:19.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.813+0000 7ff0a2537640 1 -- 172.21.15.45:0/426206671 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff07c066280 msgr2=0x7ff07c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:19.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.813+0000 7ff0a2537640 1 --2- 172.21.15.45:0/426206671 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff07c066280 0x7ff07c068730 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff09c0beb80 tx=0x7ff08c009040 comp rx=0 tx=0).stop 2023-10-03T19:18:19.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.813+0000 7ff0a2537640 1 -- 172.21.15.45:0/426206671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff088005180 msgr2=0x7ff09c1e6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:19.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.813+0000 7ff0a2537640 1 --2- 172.21.15.45:0/426206671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff088005180 0x7ff09c1e6fe0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7ff08400e7c0 tx=0x7ff08400ec80 comp rx=0 tx=0).stop 2023-10-03T19:18:19.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.813+0000 7ff0a2537640 1 -- 172.21.15.45:0/426206671 shutdown_connections 2023-10-03T19:18:19.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.813+0000 7ff0a2537640 1 --2- 172.21.15.45:0/426206671 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff07c066280 0x7ff07c068730 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:19.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.813+0000 7ff0a2537640 1 --2- 172.21.15.45:0/426206671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff09c09ad80 0x7ff09c0bad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:19.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.813+0000 7ff0a2537640 1 --2- 172.21.15.45:0/426206671 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff09c14b7e0 0x7ff09c1e2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:19.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.813+0000 7ff0a2537640 1 --2- 172.21.15.45:0/426206671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff088005180 0x7ff09c1e6fe0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:19.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.813+0000 7ff0a2537640 1 -- 172.21.15.45:0/426206671 >> 172.21.15.45:0/426206671 conn(0x7ff09c0a6440 msgr2=0x7ff09c0a5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:19.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.813+0000 7ff0a2537640 1 -- 172.21.15.45:0/426206671 shutdown_connections 2023-10-03T19:18:19.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.813+0000 7ff0a2537640 1 -- 172.21.15.45:0/426206671 wait complete. 2023-10-03T19:18:19.843 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-03T19:18:19.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7fefff76b640 1 Processor -- start 2023-10-03T19:18:19.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7fefff76b640 1 -- start start 2023-10-03T19:18:19.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7fefff76b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feff80c14e0 0x7feff80c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:19.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7fefff76b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff806ac70 con 0x7feff80bf1f0 2023-10-03T19:18:19.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7fefff76b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff80c3000 con 0x7feff80c2770 2023-10-03T19:18:19.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7fefff76b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff80aa5f0 con 0x7feff80c14e0 2023-10-03T19:18:19.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7feffcd06640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7feff80bf1f0 0x7feff80a9860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39548/0 (socket says 172.21.15.45:39548) 2023-10-03T19:18:19.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7feffcd06640 1 -- 172.21.15.45:0/1295568948 learned_addr learned my addr 172.21.15.45:0/1295568948 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:18:19.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7feffd507640 1 --2- 172.21.15.45:0/1295568948 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feff80c14e0 0x7feff80c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:19.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7fefeffff640 1 -- 172.21.15.45:0/1295568948 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656480204 0 0) 0x7feff806ac70 con 0x7feff80bf1f0 2023-10-03T19:18:19.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7fefeffff640 1 -- 172.21.15.45:0/1295568948 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefe4003530 con 0x7feff80bf1f0 2023-10-03T19:18:19.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7fefeffff640 1 -- 172.21.15.45:0/1295568948 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2493240279 0 0) 0x7fefe4003530 con 0x7feff80bf1f0 2023-10-03T19:18:19.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7fefeffff640 1 -- 172.21.15.45:0/1295568948 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feff80c14e0 msgr2=0x7feff80c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:19.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7fefeffff640 1 --2- 172.21.15.45:0/1295568948 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feff80c14e0 0x7feff80c0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:19.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7fefeffff640 1 -- 172.21.15.45:0/1295568948 >> v1:172.21.15.79:6789/0 conn(0x7feff80c2770 legacy=0x7feff8069ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:19.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7fefeffff640 1 -- 172.21.15.45:0/1295568948 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff814f250 con 0x7feff80bf1f0 2023-10-03T19:18:19.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7fefeffff640 1 -- 172.21.15.45:0/1295568948 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fefe8001680 con 0x7feff80bf1f0 2023-10-03T19:18:19.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7fefeffff640 1 -- 172.21.15.45:0/1295568948 >> v1:172.21.15.45:6789/0 conn(0x7feff80bf1f0 legacy=0x7feff80a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:19.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7fefeffff640 1 --2- 172.21.15.45:0/1295568948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefe40039b0 0x7fefe4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:19.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7fefeffff640 1 --2- 172.21.15.45:0/1295568948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe40047d0 0x7fefe4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:19.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7fefeffff640 1 --2- 172.21.15.45:0/1295568948 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feff80c14e0 0x7fefe4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:19.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7fefeffff640 1 -- 172.21.15.45:0/1295568948 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff80aa5f0 con 0x7fefe40039b0 2023-10-03T19:18:19.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7fefeffff640 1 -- 172.21.15.45:0/1295568948 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe400bad0 con 0x7fefe40047d0 2023-10-03T19:18:19.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7fefeffff640 1 -- 172.21.15.45:0/1295568948 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe400bc60 con 0x7feff80c14e0 2023-10-03T19:18:19.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7feffd507640 1 --2- 172.21.15.45:0/1295568948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefe40039b0 0x7fefe4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:19.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7feffcd06640 1 --2- 172.21.15.45:0/1295568948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe40047d0 0x7fefe4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:19.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7feffdd08640 1 --2- 172.21.15.45:0/1295568948 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feff80c14e0 0x7fefe4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:19.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7feffd507640 1 -- 172.21.15.45:0/1295568948 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feff80c14e0 msgr2=0x7fefe4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:19.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7feffd507640 1 --2- 172.21.15.45:0/1295568948 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feff80c14e0 0x7fefe4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:19.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7feffd507640 1 -- 172.21.15.45:0/1295568948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe40047d0 msgr2=0x7fefe4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:19.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7feffd507640 1 --2- 172.21.15.45:0/1295568948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe40047d0 0x7fefe4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:19.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7feffd507640 1 -- 172.21.15.45:0/1295568948 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe4003530 con 0x7fefe40039b0 2023-10-03T19:18:19.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.973+0000 7feffdd08640 1 --2- 172.21.15.45:0/1295568948 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feff80c14e0 0x7fefe4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:19.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.977+0000 7feffd507640 1 --2- 172.21.15.45:0/1295568948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefe40039b0 0x7fefe4003dc0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7feff4009ae0 tx=0x7feff401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c210757c84ee86a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:19.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.977+0000 7fefeffff640 1 -- 172.21.15.45:0/1295568948 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff40a5530 con 0x7fefe40039b0 2023-10-03T19:18:19.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.977+0000 7fefeffff640 1 -- 172.21.15.45:0/1295568948 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff40a5690 con 0x7fefe40039b0 2023-10-03T19:18:19.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.977+0000 7fefeffff640 1 -- 172.21.15.45:0/1295568948 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff40a5a40 con 0x7fefe40039b0 2023-10-03T19:18:19.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.977+0000 7fefff76b640 1 -- 172.21.15.45:0/1295568948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefe40039b0 msgr2=0x7fefe4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:19.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.977+0000 7fefff76b640 1 --2- 172.21.15.45:0/1295568948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefe40039b0 0x7fefe4003dc0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7feff4009ae0 tx=0x7feff401ca50 comp rx=0 tx=0).stop 2023-10-03T19:18:19.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.977+0000 7feffdd08640 1 -- 172.21.15.45:0/1295568948 reap_dead start 2023-10-03T19:18:19.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.977+0000 7fefff76b640 1 -- 172.21.15.45:0/1295568948 shutdown_connections 2023-10-03T19:18:19.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.977+0000 7fefff76b640 1 -- 172.21.15.45:0/1295568948 >> 172.21.15.45:0/1295568948 conn(0x7feff80a6440 msgr2=0x7feff80a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:19.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.977+0000 7fefff76b640 1 -- 172.21.15.45:0/1295568948 shutdown_connections 2023-10-03T19:18:19.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.977+0000 7fefff76b640 1 -- 172.21.15.45:0/1295568948 wait complete. 2023-10-03T19:18:19.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.977+0000 7fefff76b640 1 Processor -- start 2023-10-03T19:18:19.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.977+0000 7fefff76b640 1 -- start start 2023-10-03T19:18:19.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.977+0000 7fefff76b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe40039b0 0x7feff80bd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:19.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.977+0000 7fefff76b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feff80b8c70 0x7feff814a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:19.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.977+0000 7fefff76b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feff814ac40 0x7feff81e7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:19.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.977+0000 7fefff76b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff81d4c30 con 0x7feff80b8c70 2023-10-03T19:18:19.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.977+0000 7fefff76b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff81d5d50 con 0x7fefe40039b0 2023-10-03T19:18:19.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.977+0000 7fefff76b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff814b690 con 0x7feff814ac40 2023-10-03T19:18:19.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.977+0000 7feffcd06640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feff80b8c70 0x7feff814a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:19.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.977+0000 7feffcd06640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feff80b8c70 0x7feff814a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41174/0 (socket says 172.21.15.45:41174) 2023-10-03T19:18:19.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.977+0000 7feffcd06640 1 -- 172.21.15.45:0/4011949587 learned_addr learned my addr 172.21.15.45:0/4011949587 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:19.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.977+0000 7feffd507640 1 --2- 172.21.15.45:0/4011949587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe40039b0 0x7feff80bd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:19.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.977+0000 7feffdd08640 1 --2- 172.21.15.45:0/4011949587 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feff814ac40 0x7feff81e7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:19.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.981+0000 7feffcd06640 1 -- 172.21.15.45:0/4011949587 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feff814ac40 msgr2=0x7feff81e7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:19.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.981+0000 7feffcd06640 1 --2- 172.21.15.45:0/4011949587 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feff814ac40 0x7feff81e7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:19.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.981+0000 7feffcd06640 1 -- 172.21.15.45:0/4011949587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe40039b0 msgr2=0x7feff80bd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:19.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.981+0000 7feffcd06640 1 --2- 172.21.15.45:0/4011949587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe40039b0 0x7feff80bd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:19.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.981+0000 7feffcd06640 1 -- 172.21.15.45:0/4011949587 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff806b100 con 0x7feff80b8c70 2023-10-03T19:18:19.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.981+0000 7feffd507640 1 --2- 172.21.15.45:0/4011949587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe40039b0 0x7feff80bd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:18:19.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.981+0000 7feffcd06640 1 --2- 172.21.15.45:0/4011949587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feff80b8c70 0x7feff814a700 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fefe8011810 tx=0x7fefe8011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:19.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.981+0000 7fefedffb640 1 -- 172.21.15.45:0/4011949587 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe800fb60 con 0x7feff80b8c70 2023-10-03T19:18:19.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.981+0000 7fefedffb640 1 -- 172.21.15.45:0/4011949587 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe800fcc0 con 0x7feff80b8c70 2023-10-03T19:18:19.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.981+0000 7fefff76b640 1 -- 172.21.15.45:0/4011949587 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff814f530 con 0x7feff80b8c70 2023-10-03T19:18:19.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.981+0000 7fefedffb640 1 -- 172.21.15.45:0/4011949587 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe8015650 con 0x7feff80b8c70 2023-10-03T19:18:19.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.981+0000 7fefff76b640 1 -- 172.21.15.45:0/4011949587 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff80c18b0 con 0x7feff80b8c70 2023-10-03T19:18:19.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.981+0000 7fefff76b640 1 -- 172.21.15.45:0/4011949587 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feff804de80 con 0x7feff80b8c70 2023-10-03T19:18:19.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.981+0000 7fefedffb640 1 -- 172.21.15.45:0/4011949587 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fefe80157b0 con 0x7feff80b8c70 2023-10-03T19:18:19.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.981+0000 7fefedffb640 1 --2- 172.21.15.45:0/4011949587 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fefdc066280 0x7fefdc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:19.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.981+0000 7fefedffb640 1 -- 172.21.15.45:0/4011949587 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fefe8086c90 con 0x7feff80b8c70 2023-10-03T19:18:19.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.981+0000 7feffd507640 1 --2- 172.21.15.45:0/4011949587 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fefdc066280 0x7fefdc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:19.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.981+0000 7feffd507640 1 --2- 172.21.15.45:0/4011949587 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fefdc066280 0x7fefdc068730 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7feff40af000 tx=0x7feff40046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:19.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:19.985+0000 7fefedffb640 1 -- 172.21.15.45:0/4011949587 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fefe80544a0 con 0x7feff80b8c70 2023-10-03T19:18:20.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.149+0000 7fefff76b640 1 -- 172.21.15.45:0/4011949587 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7feff814c9b0 con 0x7feff80b8c70 2023-10-03T19:18:20.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.157+0000 7fefedffb640 1 -- 172.21.15.45:0/4011949587 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7fefe8057ac0 con 0x7feff80b8c70 2023-10-03T19:18:20.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.161+0000 7fefff76b640 1 -- 172.21.15.45:0/4011949587 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fefdc066280 msgr2=0x7fefdc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:20.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.161+0000 7fefff76b640 1 --2- 172.21.15.45:0/4011949587 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fefdc066280 0x7fefdc068730 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7feff40af000 tx=0x7feff40046d0 comp rx=0 tx=0).stop 2023-10-03T19:18:20.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.161+0000 7fefff76b640 1 -- 172.21.15.45:0/4011949587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feff80b8c70 msgr2=0x7feff814a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:20.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.161+0000 7fefff76b640 1 --2- 172.21.15.45:0/4011949587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feff80b8c70 0x7feff814a700 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fefe8011810 tx=0x7fefe8011cd0 comp rx=0 tx=0).stop 2023-10-03T19:18:20.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.161+0000 7fefff76b640 1 -- 172.21.15.45:0/4011949587 shutdown_connections 2023-10-03T19:18:20.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.161+0000 7fefff76b640 1 --2- 172.21.15.45:0/4011949587 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fefdc066280 0x7fefdc068730 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:20.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.161+0000 7fefff76b640 1 --2- 172.21.15.45:0/4011949587 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feff814ac40 0x7feff81e7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:20.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.161+0000 7fefff76b640 1 --2- 172.21.15.45:0/4011949587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feff80b8c70 0x7feff814a700 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:20.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.161+0000 7fefff76b640 1 --2- 172.21.15.45:0/4011949587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe40039b0 0x7feff80bd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:20.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.161+0000 7fefff76b640 1 -- 172.21.15.45:0/4011949587 >> 172.21.15.45:0/4011949587 conn(0x7feff80a6440 msgr2=0x7feff80a5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:20.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.161+0000 7fefff76b640 1 -- 172.21.15.45:0/4011949587 shutdown_connections 2023-10-03T19:18:20.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.161+0000 7fefff76b640 1 -- 172.21.15.45:0/4011949587 wait complete. 2023-10-03T19:18:20.180 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout' 2023-10-03T19:18:20.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.309+0000 7fefec927640 1 Processor -- start 2023-10-03T19:18:20.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.309+0000 7fefec927640 1 -- start start 2023-10-03T19:18:20.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.313+0000 7fefec927640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fefe806e450 0x7fefe80bf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:20.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.313+0000 7fefec927640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fefe80bf5f0 0x7fefe8158f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:20.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.313+0000 7fefec927640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe80a6e60 con 0x7fefe814bf90 2023-10-03T19:18:20.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.313+0000 7fefec927640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe80bd810 con 0x7fefe806e450 2023-10-03T19:18:20.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.313+0000 7fefec927640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe806f070 con 0x7fefe80bf5f0 2023-10-03T19:18:20.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.313+0000 7fefe659c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fefe814bf90 0x7fefe806e960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39564/0 (socket says 172.21.15.45:39564) 2023-10-03T19:18:20.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.313+0000 7fefe659c640 1 -- 172.21.15.45:0/1784611394 learned_addr learned my addr 172.21.15.45:0/1784611394 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:18:20.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.313+0000 7fefdffff640 1 --2- 172.21.15.45:0/1784611394 >> v2:172.21.15.45:3300/0 conn(0x7fefe806e450 0x7fefe80bf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:20.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.313+0000 7fefe6d9d640 1 --2- 172.21.15.45:0/1784611394 >> v2:172.21.15.79:3300/0 conn(0x7fefe80bf5f0 0x7fefe8158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:20.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.313+0000 7fefdffff640 1 -- 172.21.15.45:0/1784611394 >> v2:172.21.15.79:3300/0 conn(0x7fefe80bf5f0 msgr2=0x7fefe8158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:20.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.313+0000 7fefdffff640 1 --2- 172.21.15.45:0/1784611394 >> v2:172.21.15.79:3300/0 conn(0x7fefe80bf5f0 0x7fefe8158f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:20.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.313+0000 7fefdffff640 1 -- 172.21.15.45:0/1784611394 >> v1:172.21.15.45:6789/0 conn(0x7fefe814bf90 legacy=0x7fefe806e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:20.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.313+0000 7fefdffff640 1 -- 172.21.15.45:0/1784611394 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe80be300 con 0x7fefe806e450 2023-10-03T19:18:20.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.313+0000 7fefdffff640 1 --2- 172.21.15.45:0/1784611394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefe806e450 0x7fefe80bf0b0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fefe80720c0 tx=0x7fefd001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0930348c531dc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:20.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.313+0000 7fefe5d9b640 1 -- 172.21.15.45:0/1784611394 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd00ab600 con 0x7fefe806e450 2023-10-03T19:18:20.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.313+0000 7fefe5d9b640 1 -- 172.21.15.45:0/1784611394 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd00a7050 con 0x7fefe806e450 2023-10-03T19:18:20.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.313+0000 7fefe5d9b640 1 -- 172.21.15.45:0/1784611394 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd00ab980 con 0x7fefe806e450 2023-10-03T19:18:20.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.313+0000 7fefec927640 1 -- 172.21.15.45:0/1784611394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefe806e450 msgr2=0x7fefe80bf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:20.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.313+0000 7fefec927640 1 --2- 172.21.15.45:0/1784611394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefe806e450 0x7fefe80bf0b0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fefe80720c0 tx=0x7fefd001c440 comp rx=0 tx=0).stop 2023-10-03T19:18:20.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.313+0000 7fefec927640 1 -- 172.21.15.45:0/1784611394 shutdown_connections 2023-10-03T19:18:20.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.313+0000 7fefec927640 1 --2- 172.21.15.45:0/1784611394 >> v2:172.21.15.79:3300/0 conn(0x7fefe80bf5f0 0x7fefe8158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:20.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.313+0000 7fefec927640 1 --2- 172.21.15.45:0/1784611394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefe806e450 0x7fefe80bf0b0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:20.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.313+0000 7fefec927640 1 -- 172.21.15.45:0/1784611394 >> 172.21.15.45:0/1784611394 conn(0x7fefe806bce0 msgr2=0x7fefe806c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:20.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.313+0000 7fefec927640 1 -- 172.21.15.45:0/1784611394 shutdown_connections 2023-10-03T19:18:20.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.313+0000 7fefec927640 1 -- 172.21.15.45:0/1784611394 wait complete. 2023-10-03T19:18:20.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.317+0000 7fefec927640 1 Processor -- start 2023-10-03T19:18:20.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.317+0000 7fefec927640 1 -- start start 2023-10-03T19:18:20.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.317+0000 7fefec927640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe806e450 0x7fefe8146990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:20.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.317+0000 7fefec927640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefe80bf5f0 0x7fefe80ba150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:20.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.317+0000 7fefec927640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefe814bf90 0x7fefe80bbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:20.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.317+0000 7fefec927640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe80bbbd0 con 0x7fefe80bf5f0 2023-10-03T19:18:20.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.317+0000 7fefec927640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe814cfd0 con 0x7fefe806e450 2023-10-03T19:18:20.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.317+0000 7fefec927640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe80bb580 con 0x7fefe814bf90 2023-10-03T19:18:20.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.317+0000 7fefdffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefe80bf5f0 0x7fefe80ba150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:20.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.317+0000 7fefdffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefe80bf5f0 0x7fefe80ba150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41192/0 (socket says 172.21.15.45:41192) 2023-10-03T19:18:20.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.317+0000 7fefdffff640 1 -- 172.21.15.45:0/2243344847 learned_addr learned my addr 172.21.15.45:0/2243344847 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:20.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.317+0000 7fefe659c640 1 --2- 172.21.15.45:0/2243344847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe806e450 0x7fefe8146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:20.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.317+0000 7fefdffff640 1 -- 172.21.15.45:0/2243344847 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefe814bf90 msgr2=0x7fefe80bbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:20.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.317+0000 7fefdffff640 1 --2- 172.21.15.45:0/2243344847 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefe814bf90 0x7fefe80bbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:20.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.317+0000 7fefdffff640 1 -- 172.21.15.45:0/2243344847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe806e450 msgr2=0x7fefe8146990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:20.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.317+0000 7fefdffff640 1 --2- 172.21.15.45:0/2243344847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe806e450 0x7fefe8146990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:20.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.317+0000 7fefdffff640 1 -- 172.21.15.45:0/2243344847 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd0009420 con 0x7fefe80bf5f0 2023-10-03T19:18:20.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.317+0000 7fefe659c640 1 --2- 172.21.15.45:0/2243344847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe806e450 0x7fefe8146990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:20.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.317+0000 7fefdffff640 1 --2- 172.21.15.45:0/2243344847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefe80bf5f0 0x7fefe80ba150 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fefd00ae040 tx=0x7fefd00191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:20.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.317+0000 7fefdeffd640 1 -- 172.21.15.45:0/2243344847 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd00b4840 con 0x7fefe80bf5f0 2023-10-03T19:18:20.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.317+0000 7fefdeffd640 1 -- 172.21.15.45:0/2243344847 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd00b49a0 con 0x7fefe80bf5f0 2023-10-03T19:18:20.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.317+0000 7fefec927640 1 -- 172.21.15.45:0/2243344847 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe80bdef0 con 0x7fefe80bf5f0 2023-10-03T19:18:20.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.317+0000 7fefdeffd640 1 -- 172.21.15.45:0/2243344847 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd00b4d50 con 0x7fefe80bf5f0 2023-10-03T19:18:20.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.317+0000 7fefec927640 1 -- 172.21.15.45:0/2243344847 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe80bd530 con 0x7fefe80bf5f0 2023-10-03T19:18:20.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.317+0000 7fefec927640 1 -- 172.21.15.45:0/2243344847 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe80be080 con 0x7fefe80bf5f0 2023-10-03T19:18:20.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.321+0000 7fefdeffd640 1 -- 172.21.15.45:0/2243344847 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fefd00b2040 con 0x7fefe80bf5f0 2023-10-03T19:18:20.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.321+0000 7fefdeffd640 1 --2- 172.21.15.45:0/2243344847 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fefc8066280 0x7fefc8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:20.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.321+0000 7fefdeffd640 1 -- 172.21.15.45:0/2243344847 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fefd011ddb0 con 0x7fefe80bf5f0 2023-10-03T19:18:20.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.321+0000 7fefe659c640 1 --2- 172.21.15.45:0/2243344847 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fefc8066280 0x7fefc8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:20.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.321+0000 7fefe659c640 1 --2- 172.21.15.45:0/2243344847 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fefc8066280 0x7fefc8068730 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fefd8005890 tx=0x7fefd8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:20.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.325+0000 7fefdeffd640 1 -- 172.21.15.45:0/2243344847 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fefd00eb5c0 con 0x7fefe80bf5f0 2023-10-03T19:18:20.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.537+0000 7fefec927640 1 -- 172.21.15.45:0/2243344847 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]} v 0) v1 -- 0x7fefe80bbd10 con 0x7fefe80bf5f0 2023-10-03T19:18:20.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.833+0000 7fefdeffd640 1 -- 172.21.15.45:0/2243344847 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]}]=0 v274) v1 ==== 147+0+0 (secure 0 0 0) 0x7fefe80bbd10 con 0x7fefe80bf5f0 2023-10-03T19:18:20.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.837+0000 7fefec927640 1 -- 172.21.15.45:0/2243344847 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fefc8066280 msgr2=0x7fefc8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:20.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.837+0000 7fefec927640 1 --2- 172.21.15.45:0/2243344847 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fefc8066280 0x7fefc8068730 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fefd8005890 tx=0x7fefd8009040 comp rx=0 tx=0).stop 2023-10-03T19:18:20.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.837+0000 7fefec927640 1 -- 172.21.15.45:0/2243344847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefe80bf5f0 msgr2=0x7fefe80ba150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:20.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.837+0000 7fefec927640 1 --2- 172.21.15.45:0/2243344847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefe80bf5f0 0x7fefe80ba150 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fefd00ae040 tx=0x7fefd00191e0 comp rx=0 tx=0).stop 2023-10-03T19:18:20.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.837+0000 7fefec927640 1 -- 172.21.15.45:0/2243344847 shutdown_connections 2023-10-03T19:18:20.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.837+0000 7fefec927640 1 --2- 172.21.15.45:0/2243344847 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fefc8066280 0x7fefc8068730 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:20.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.837+0000 7fefec927640 1 --2- 172.21.15.45:0/2243344847 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefe814bf90 0x7fefe80bbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:20.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.837+0000 7fefec927640 1 --2- 172.21.15.45:0/2243344847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefe80bf5f0 0x7fefe80ba150 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:20.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.837+0000 7fefec927640 1 --2- 172.21.15.45:0/2243344847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe806e450 0x7fefe8146990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:20.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.837+0000 7fefec927640 1 -- 172.21.15.45:0/2243344847 >> 172.21.15.45:0/2243344847 conn(0x7fefe806bce0 msgr2=0x7fefe814ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:20.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.837+0000 7fefec927640 1 -- 172.21.15.45:0/2243344847 shutdown_connections 2023-10-03T19:18:20.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.837+0000 7fefec927640 1 -- 172.21.15.45:0/2243344847 wait complete. 2023-10-03T19:18:20.864 INFO:tasks.cephfs_test_runner:Basic test for checking drop cache command. ... ok 2023-10-03T19:18:20.865 INFO:tasks.cephfs_test_runner:Starting test: test_cap_revoke_nonresponder (tasks.cephfs.test_misc.TestMisc) Check that a client is evicted if it has not responded to cap revoke 2023-10-03T19:18:20.865 INFO:tasks.cephfs_test_runner:test_cap_revoke_nonresponder (tasks.cephfs.test_misc.TestMisc) 2023-10-03T19:18:20.865 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder' 2023-10-03T19:18:20.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.989+0000 7f7985111640 1 Processor -- start 2023-10-03T19:18:20.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.989+0000 7f7985111640 1 -- start start 2023-10-03T19:18:20.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.989+0000 7f7985111640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79800c2790 0x7f79801528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:20.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.989+0000 7f7985111640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f79800bb1d0 0x7f79800c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:20.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.989+0000 7f7985111640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f798006b2d0 con 0x7f798014f240 2023-10-03T19:18:20.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.989+0000 7f7985111640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f798006b640 con 0x7f79800bb1d0 2023-10-03T19:18:20.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.989+0000 7f7985111640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79800a3c60 con 0x7f79800c2790 2023-10-03T19:18:20.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.989+0000 7f797f59e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f79800bb1d0 0x7f79800c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:20.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.989+0000 7f797ed9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f798014f240 0x7f79800c0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:43304/0 (socket says 172.21.15.45:43304) 2023-10-03T19:18:20.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.989+0000 7f797f59e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f79800bb1d0 0x7f79800c12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:33910/0 (socket says 172.21.15.45:33910) 2023-10-03T19:18:20.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.989+0000 7f797ed9d640 1 -- 172.21.15.45:0/1435115241 learned_addr learned my addr 172.21.15.45:0/1435115241 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:18:20.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.989+0000 7f7977fff640 1 --2- 172.21.15.45:0/1435115241 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79800c2790 0x7f79801528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:20.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.989+0000 7f797f59e640 1 -- 172.21.15.45:0/1435115241 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79800c2790 msgr2=0x7f79801528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:20.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.989+0000 7f797f59e640 1 --2- 172.21.15.45:0/1435115241 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79800c2790 0x7f79801528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:20.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.989+0000 7f797f59e640 1 -- 172.21.15.45:0/1435115241 >> v1:172.21.15.79:6789/0 conn(0x7f798014f240 legacy=0x7f79800c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:20.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.989+0000 7f797f59e640 1 -- 172.21.15.45:0/1435115241 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798014e740 con 0x7f79800bb1d0 2023-10-03T19:18:20.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.993+0000 7f797f59e640 1 --2- 172.21.15.45:0/1435115241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79800bb1d0 0x7f79800c12a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7978009d90 tx=0x7f797801f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff80c728c1282a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:20.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.993+0000 7f797e59c640 1 -- 172.21.15.45:0/1435115241 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79780af600 con 0x7f79800bb1d0 2023-10-03T19:18:20.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.993+0000 7f797e59c640 1 -- 172.21.15.45:0/1435115241 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79780ab050 con 0x7f79800bb1d0 2023-10-03T19:18:20.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.993+0000 7f797e59c640 1 -- 172.21.15.45:0/1435115241 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79780af980 con 0x7f79800bb1d0 2023-10-03T19:18:20.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.993+0000 7f7985111640 1 -- 172.21.15.45:0/1435115241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79800bb1d0 msgr2=0x7f79800c12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:20.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.993+0000 7f7985111640 1 --2- 172.21.15.45:0/1435115241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79800bb1d0 0x7f79800c12a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7978009d90 tx=0x7f797801f130 comp rx=0 tx=0).stop 2023-10-03T19:18:20.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.993+0000 7f7985111640 1 -- 172.21.15.45:0/1435115241 shutdown_connections 2023-10-03T19:18:20.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.993+0000 7f7985111640 1 --2- 172.21.15.45:0/1435115241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79800bb1d0 0x7f79800c12a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:20.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.993+0000 7f7985111640 1 --2- 172.21.15.45:0/1435115241 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79800c2790 0x7f79801528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:20.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.993+0000 7f7985111640 1 -- 172.21.15.45:0/1435115241 >> 172.21.15.45:0/1435115241 conn(0x7f79800a64a0 msgr2=0x7f79800a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:20.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.993+0000 7f7985111640 1 -- 172.21.15.45:0/1435115241 shutdown_connections 2023-10-03T19:18:20.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.993+0000 7f7985111640 1 -- 172.21.15.45:0/1435115241 wait complete. 2023-10-03T19:18:20.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.993+0000 7f7985111640 1 Processor -- start 2023-10-03T19:18:20.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.993+0000 7f7985111640 1 -- start start 2023-10-03T19:18:21.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.997+0000 7f7985111640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79800bb1d0 0x7f79800a4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:21.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.997+0000 7f7985111640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79800c2790 0x7f798014cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:21.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.997+0000 7f7985111640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f798014f240 0x7f798014fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:21.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.997+0000 7f7985111640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79801e7c50 con 0x7f79800bb1d0 2023-10-03T19:18:21.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.997+0000 7f7985111640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798014d280 con 0x7f798014f240 2023-10-03T19:18:21.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.997+0000 7f7985111640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7980150c60 con 0x7f79800c2790 2023-10-03T19:18:21.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.997+0000 7f797ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79800bb1d0 0x7f79800a4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:21.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.997+0000 7f797ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79800bb1d0 0x7f79800a4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41200/0 (socket says 172.21.15.45:41200) 2023-10-03T19:18:21.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.997+0000 7f797ed9d640 1 -- 172.21.15.45:0/1040097733 learned_addr learned my addr 172.21.15.45:0/1040097733 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:21.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.997+0000 7f797f59e640 1 --2- 172.21.15.45:0/1040097733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f798014f240 0x7f798014fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:21.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.997+0000 7f7977fff640 1 --2- 172.21.15.45:0/1040097733 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79800c2790 0x7f798014cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:21.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.997+0000 7f797ed9d640 1 -- 172.21.15.45:0/1040097733 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79800c2790 msgr2=0x7f798014cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:21.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.997+0000 7f797ed9d640 1 --2- 172.21.15.45:0/1040097733 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79800c2790 0x7f798014cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:21.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.997+0000 7f797ed9d640 1 -- 172.21.15.45:0/1040097733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f798014f240 msgr2=0x7f798014fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:21.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.997+0000 7f797ed9d640 1 --2- 172.21.15.45:0/1040097733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f798014f240 0x7f798014fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:21.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.997+0000 7f797ed9d640 1 -- 172.21.15.45:0/1040097733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7978009a70 con 0x7f79800bb1d0 2023-10-03T19:18:21.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.997+0000 7f7977fff640 1 --2- 172.21.15.45:0/1040097733 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79800c2790 0x7f798014cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:21.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.997+0000 7f797ed9d640 1 --2- 172.21.15.45:0/1040097733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79800bb1d0 0x7f79800a4e30 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f797000c480 tx=0x7f797000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:21.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.997+0000 7f79777fe640 1 -- 172.21.15.45:0/1040097733 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7970005d40 con 0x7f79800bb1d0 2023-10-03T19:18:21.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.997+0000 7f79777fe640 1 -- 172.21.15.45:0/1040097733 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79700070d0 con 0x7f79800bb1d0 2023-10-03T19:18:21.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.997+0000 7f79777fe640 1 -- 172.21.15.45:0/1040097733 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7970005ea0 con 0x7f79800bb1d0 2023-10-03T19:18:21.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.997+0000 7f7985111640 1 -- 172.21.15.45:0/1040097733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f798014f610 con 0x7f79800bb1d0 2023-10-03T19:18:21.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.997+0000 7f7985111640 1 -- 172.21.15.45:0/1040097733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79800a3f40 con 0x7f79800bb1d0 2023-10-03T19:18:21.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.997+0000 7f7985111640 1 -- 172.21.15.45:0/1040097733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79800bf360 con 0x7f79800bb1d0 2023-10-03T19:18:21.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:20.997+0000 7f79777fe640 1 -- 172.21.15.45:0/1040097733 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f79700074c0 con 0x7f79800bb1d0 2023-10-03T19:18:21.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.001+0000 7f79777fe640 1 --2- 172.21.15.45:0/1040097733 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7960066280 0x7f7960068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:21.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.001+0000 7f79777fe640 1 -- 172.21.15.45:0/1040097733 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f7970082b70 con 0x7f79800bb1d0 2023-10-03T19:18:21.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.001+0000 7f7977fff640 1 --2- 172.21.15.45:0/1040097733 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7960066280 0x7f7960068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:21.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.001+0000 7f7977fff640 1 --2- 172.21.15.45:0/1040097733 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7960066280 0x7f7960068730 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f798014a1d0 tx=0x7f7968008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:21.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.005+0000 7f79777fe640 1 -- 172.21.15.45:0/1040097733 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7970050300 con 0x7f79800bb1d0 2023-10-03T19:18:21.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.221+0000 7f7985111640 1 -- 172.21.15.45:0/1040097733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]} v 0) v1 -- 0x7f79800bfa90 con 0x7f79800bb1d0 2023-10-03T19:18:21.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.833+0000 7f79777fe640 1 -- 172.21.15.45:0/1040097733 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]}]=0 v275) v1 ==== 142+0+0 (secure 0 0 0) 0x7f7970053920 con 0x7f79800bb1d0 2023-10-03T19:18:21.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.837+0000 7f7985111640 1 -- 172.21.15.45:0/1040097733 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7960066280 msgr2=0x7f7960068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:21.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.837+0000 7f7985111640 1 --2- 172.21.15.45:0/1040097733 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7960066280 0x7f7960068730 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f798014a1d0 tx=0x7f7968008040 comp rx=0 tx=0).stop 2023-10-03T19:18:21.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.837+0000 7f7985111640 1 -- 172.21.15.45:0/1040097733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79800bb1d0 msgr2=0x7f79800a4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:21.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.837+0000 7f7985111640 1 --2- 172.21.15.45:0/1040097733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79800bb1d0 0x7f79800a4e30 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f797000c480 tx=0x7f797000c940 comp rx=0 tx=0).stop 2023-10-03T19:18:21.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.837+0000 7f7985111640 1 -- 172.21.15.45:0/1040097733 shutdown_connections 2023-10-03T19:18:21.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.837+0000 7f7985111640 1 --2- 172.21.15.45:0/1040097733 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7960066280 0x7f7960068730 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:21.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.837+0000 7f7985111640 1 --2- 172.21.15.45:0/1040097733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f798014f240 0x7f798014fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:21.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.837+0000 7f7985111640 1 --2- 172.21.15.45:0/1040097733 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79800c2790 0x7f798014cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:21.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.837+0000 7f7985111640 1 --2- 172.21.15.45:0/1040097733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79800bb1d0 0x7f79800a4e30 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:21.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.837+0000 7f7985111640 1 -- 172.21.15.45:0/1040097733 >> 172.21.15.45:0/1040097733 conn(0x7f79800a64a0 msgr2=0x7f79800c2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:21.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.837+0000 7f7985111640 1 -- 172.21.15.45:0/1040097733 shutdown_connections 2023-10-03T19:18:21.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.837+0000 7f7985111640 1 -- 172.21.15.45:0/1040097733 wait complete. 2023-10-03T19:18:21.860 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-03T19:18:21.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f913d3ad640 1 Processor -- start 2023-10-03T19:18:21.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f913d3ad640 1 -- start start 2023-10-03T19:18:22.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f913d3ad640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f913814f510 0x7f913814b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:22.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f913d3ad640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f91380bd9f0 0x7f913814b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:22.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f913d3ad640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f913814f080 con 0x7f913806f880 2023-10-03T19:18:22.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f913d3ad640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f913806f3e0 con 0x7f91380bd9f0 2023-10-03T19:18:22.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f913d3ad640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9138070e90 con 0x7f913814f510 2023-10-03T19:18:22.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f9136ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f913806f880 0x7f91380a5940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39574/0 (socket says 172.21.15.45:39574) 2023-10-03T19:18:22.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f9136ffd640 1 -- 172.21.15.45:0/2260913942 learned_addr learned my addr 172.21.15.45:0/2260913942 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:18:22.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f91377fe640 1 --2- 172.21.15.45:0/2260913942 >> v2:172.21.15.79:3300/0 conn(0x7f91380bd9f0 0x7f913814b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:22.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f91367fc640 1 --2- 172.21.15.45:0/2260913942 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f913814f510 0x7f913814b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:22.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f9135ffb640 1 -- 172.21.15.45:0/2260913942 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022997415 0 0) 0x7f913814f080 con 0x7f913806f880 2023-10-03T19:18:22.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f9135ffb640 1 -- 172.21.15.45:0/2260913942 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9120005740 con 0x7f913806f880 2023-10-03T19:18:22.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f9135ffb640 1 -- 172.21.15.45:0/2260913942 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 229473000 0 0) 0x7f9120005740 con 0x7f913806f880 2023-10-03T19:18:22.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f9135ffb640 1 -- 172.21.15.45:0/2260913942 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f913814f510 msgr2=0x7f913814b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:22.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f9135ffb640 1 --2- 172.21.15.45:0/2260913942 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f913814f510 0x7f913814b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:22.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f9135ffb640 1 -- 172.21.15.45:0/2260913942 >> v2:172.21.15.79:3300/0 conn(0x7f91380bd9f0 msgr2=0x7f913814b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:22.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f9135ffb640 1 --2- 172.21.15.45:0/2260913942 >> v2:172.21.15.79:3300/0 conn(0x7f91380bd9f0 0x7f913814b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:22.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f9135ffb640 1 -- 172.21.15.45:0/2260913942 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913814ea30 con 0x7f913806f880 2023-10-03T19:18:22.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f9135ffb640 1 -- 172.21.15.45:0/2260913942 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f9128001680 con 0x7f913806f880 2023-10-03T19:18:22.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f9135ffb640 1 -- 172.21.15.45:0/2260913942 >> v1:172.21.15.45:6789/0 conn(0x7f913806f880 legacy=0x7f91380a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:22.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f9135ffb640 1 --2- 172.21.15.45:0/2260913942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9120005b90 0x7f9120005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:22.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f9135ffb640 1 --2- 172.21.15.45:0/2260913942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91200065c0 0x7f9120006a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:22.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f9135ffb640 1 --2- 172.21.15.45:0/2260913942 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f913814f510 0x7f9120007150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:22.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f9135ffb640 1 -- 172.21.15.45:0/2260913942 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913806f3e0 con 0x7f9120005b90 2023-10-03T19:18:22.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f9135ffb640 1 -- 172.21.15.45:0/2260913942 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9138070e90 con 0x7f91200065c0 2023-10-03T19:18:22.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f9135ffb640 1 -- 172.21.15.45:0/2260913942 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f912000dba0 con 0x7f913814f510 2023-10-03T19:18:22.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f9136ffd640 1 --2- 172.21.15.45:0/2260913942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9120005b90 0x7f9120005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:22.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f91367fc640 1 --2- 172.21.15.45:0/2260913942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91200065c0 0x7f9120006a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:22.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f91377fe640 1 --2- 172.21.15.45:0/2260913942 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f913814f510 0x7f9120007150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:22.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f9136ffd640 1 -- 172.21.15.45:0/2260913942 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f913814f510 msgr2=0x7f9120007150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:22.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f9136ffd640 1 --2- 172.21.15.45:0/2260913942 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f913814f510 0x7f9120007150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:22.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f9136ffd640 1 -- 172.21.15.45:0/2260913942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91200065c0 msgr2=0x7f9120006a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:22.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f9136ffd640 1 --2- 172.21.15.45:0/2260913942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91200065c0 0x7f9120006a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:22.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:21.997+0000 7f9136ffd640 1 -- 172.21.15.45:0/2260913942 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9120005740 con 0x7f9120005b90 2023-10-03T19:18:22.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.001+0000 7f9136ffd640 1 --2- 172.21.15.45:0/2260913942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9120005b90 0x7f9120005fa0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f912800c210 tx=0x7f912801cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8720b6ddcd0a8aad server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:22.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.001+0000 7f9135ffb640 1 -- 172.21.15.45:0/2260913942 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91280058e0 con 0x7f9120005b90 2023-10-03T19:18:22.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.001+0000 7f9135ffb640 1 -- 172.21.15.45:0/2260913942 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9128005a40 con 0x7f9120005b90 2023-10-03T19:18:22.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.001+0000 7f9135ffb640 1 -- 172.21.15.45:0/2260913942 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9128005dd0 con 0x7f9120005b90 2023-10-03T19:18:22.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.001+0000 7f913d3ad640 1 -- 172.21.15.45:0/2260913942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9120005b90 msgr2=0x7f9120005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:22.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.001+0000 7f913d3ad640 1 --2- 172.21.15.45:0/2260913942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9120005b90 0x7f9120005fa0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f912800c210 tx=0x7f912801cc30 comp rx=0 tx=0).stop 2023-10-03T19:18:22.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.001+0000 7f91377fe640 1 -- 172.21.15.45:0/2260913942 reap_dead start 2023-10-03T19:18:22.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.001+0000 7f913d3ad640 1 -- 172.21.15.45:0/2260913942 shutdown_connections 2023-10-03T19:18:22.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.001+0000 7f913d3ad640 1 -- 172.21.15.45:0/2260913942 >> 172.21.15.45:0/2260913942 conn(0x7f91380a20d0 msgr2=0x7f91380a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:22.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.001+0000 7f913d3ad640 1 -- 172.21.15.45:0/2260913942 shutdown_connections 2023-10-03T19:18:22.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.001+0000 7f913d3ad640 1 -- 172.21.15.45:0/2260913942 wait complete. 2023-10-03T19:18:22.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.001+0000 7f913d3ad640 1 Processor -- start 2023-10-03T19:18:22.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.001+0000 7f913d3ad640 1 -- start start 2023-10-03T19:18:22.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.005+0000 7f913d3ad640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f91380b99b0 0x7f9138148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:22.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.005+0000 7f913d3ad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91380a3db0 0x7f91381ea200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:22.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.005+0000 7f913d3ad640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f913813fd50 0x7f91381401c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:22.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.005+0000 7f913d3ad640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91380a4340 con 0x7f91380a3db0 2023-10-03T19:18:22.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.005+0000 7f913d3ad640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9138149e60 con 0x7f913813fd50 2023-10-03T19:18:22.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.005+0000 7f913d3ad640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f913814a340 con 0x7f91380b99b0 2023-10-03T19:18:22.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.005+0000 7f91367fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91380a3db0 0x7f91381ea200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:22.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.005+0000 7f91367fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91380a3db0 0x7f91381ea200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41214/0 (socket says 172.21.15.45:41214) 2023-10-03T19:18:22.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.005+0000 7f91367fc640 1 -- 172.21.15.45:0/3389427171 learned_addr learned my addr 172.21.15.45:0/3389427171 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:22.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.005+0000 7f9136ffd640 1 --2- 172.21.15.45:0/3389427171 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f91380b99b0 0x7f9138148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:22.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.005+0000 7f91377fe640 1 --2- 172.21.15.45:0/3389427171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f913813fd50 0x7f91381401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:22.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.005+0000 7f91367fc640 1 -- 172.21.15.45:0/3389427171 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f91380b99b0 msgr2=0x7f9138148f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:22.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.005+0000 7f91367fc640 1 --2- 172.21.15.45:0/3389427171 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f91380b99b0 0x7f9138148f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:22.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.005+0000 7f91367fc640 1 -- 172.21.15.45:0/3389427171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f913813fd50 msgr2=0x7f91381401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:22.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.005+0000 7f91367fc640 1 --2- 172.21.15.45:0/3389427171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f913813fd50 0x7f91381401c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:22.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.005+0000 7f91367fc640 1 -- 172.21.15.45:0/3389427171 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91380a6050 con 0x7f91380a3db0 2023-10-03T19:18:22.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.005+0000 7f9136ffd640 1 --2- 172.21.15.45:0/3389427171 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f91380b99b0 0x7f9138148f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:18:22.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.005+0000 7f91377fe640 1 --2- 172.21.15.45:0/3389427171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f913813fd50 0x7f91381401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:18:22.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.005+0000 7f91367fc640 1 --2- 172.21.15.45:0/3389427171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91380a3db0 0x7f91381ea200 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f912c011560 tx=0x7f912c011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:22.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.005+0000 7f911f7fe640 1 -- 172.21.15.45:0/3389427171 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c015930 con 0x7f91380a3db0 2023-10-03T19:18:22.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.005+0000 7f911f7fe640 1 -- 172.21.15.45:0/3389427171 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912c015a90 con 0x7f91380a3db0 2023-10-03T19:18:22.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.005+0000 7f913d3ad640 1 -- 172.21.15.45:0/3389427171 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f913806fc50 con 0x7f91380a3db0 2023-10-03T19:18:22.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.005+0000 7f911f7fe640 1 -- 172.21.15.45:0/3389427171 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c015e60 con 0x7f91380a3db0 2023-10-03T19:18:22.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.005+0000 7f913d3ad640 1 -- 172.21.15.45:0/3389427171 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91380a61e0 con 0x7f91380a3db0 2023-10-03T19:18:22.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.005+0000 7f913d3ad640 1 -- 172.21.15.45:0/3389427171 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f913804de80 con 0x7f91380a3db0 2023-10-03T19:18:22.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.005+0000 7f911f7fe640 1 -- 172.21.15.45:0/3389427171 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f912c00f460 con 0x7f91380a3db0 2023-10-03T19:18:22.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.005+0000 7f911f7fe640 1 --2- 172.21.15.45:0/3389427171 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f91240662b0 0x7f9124068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:22.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.005+0000 7f911f7fe640 1 -- 172.21.15.45:0/3389427171 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f912c084190 con 0x7f91380a3db0 2023-10-03T19:18:22.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.005+0000 7f9136ffd640 1 --2- 172.21.15.45:0/3389427171 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f91240662b0 0x7f9124068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:22.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.009+0000 7f9136ffd640 1 --2- 172.21.15.45:0/3389427171 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f91240662b0 0x7f9124068760 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f91280aa000 tx=0x7f9128001a10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:22.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.009+0000 7f911f7fe640 1 -- 172.21.15.45:0/3389427171 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f912c055430 con 0x7f91380a3db0 2023-10-03T19:18:22.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.173+0000 7f913d3ad640 1 -- 172.21.15.45:0/3389427171 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f913806ee50 con 0x7f91380a3db0 2023-10-03T19:18:22.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.177+0000 7f911f7fe640 1 -- 172.21.15.45:0/3389427171 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f912c054fc0 con 0x7f91380a3db0 2023-10-03T19:18:22.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.181+0000 7f913d3ad640 1 -- 172.21.15.45:0/3389427171 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f91240662b0 msgr2=0x7f9124068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:22.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.181+0000 7f913d3ad640 1 --2- 172.21.15.45:0/3389427171 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f91240662b0 0x7f9124068760 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f91280aa000 tx=0x7f9128001a10 comp rx=0 tx=0).stop 2023-10-03T19:18:22.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.181+0000 7f913d3ad640 1 -- 172.21.15.45:0/3389427171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91380a3db0 msgr2=0x7f91381ea200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:22.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.181+0000 7f913d3ad640 1 --2- 172.21.15.45:0/3389427171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91380a3db0 0x7f91381ea200 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f912c011560 tx=0x7f912c011a20 comp rx=0 tx=0).stop 2023-10-03T19:18:22.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.181+0000 7f913d3ad640 1 -- 172.21.15.45:0/3389427171 shutdown_connections 2023-10-03T19:18:22.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.181+0000 7f913d3ad640 1 --2- 172.21.15.45:0/3389427171 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f91240662b0 0x7f9124068760 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:22.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.181+0000 7f913d3ad640 1 --2- 172.21.15.45:0/3389427171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f913813fd50 0x7f91381401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:22.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.181+0000 7f913d3ad640 1 --2- 172.21.15.45:0/3389427171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91380a3db0 0x7f91381ea200 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:22.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.181+0000 7f913d3ad640 1 --2- 172.21.15.45:0/3389427171 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f91380b99b0 0x7f9138148f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:22.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.181+0000 7f913d3ad640 1 -- 172.21.15.45:0/3389427171 >> 172.21.15.45:0/3389427171 conn(0x7f91380a20d0 msgr2=0x7f91380a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:22.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.181+0000 7f913d3ad640 1 -- 172.21.15.45:0/3389427171 shutdown_connections 2023-10-03T19:18:22.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.181+0000 7f913d3ad640 1 -- 172.21.15.45:0/3389427171 wait complete. 2023-10-03T19:18:22.201 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-03T19:18:22.201 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:18:22.239 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:18:22.278 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:18:22.339 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:18:22.387 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-03T19:18:22.387 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:18:22.387 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:18:22.393 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336540k,nr_inodes=4084135,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16206 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-10-03T19:18:22.393 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-03T19:18:22.393 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:18:22.399 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336540k,nr_inodes=4084135,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=22607 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-10-03T19:18:22.399 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-10-03T19:18:22.399 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:18:22.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.533+0000 7f75d9d74640 1 Processor -- start 2023-10-03T19:18:22.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.533+0000 7f75d9d74640 1 -- start start 2023-10-03T19:18:22.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.533+0000 7f75d9d74640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f75d406d0f0 0x7f75d4156820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:22.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.533+0000 7f75d9d74640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d40a1720 con 0x7f75d4150400 2023-10-03T19:18:22.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.533+0000 7f75d9d74640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d40a18d0 con 0x7f75d40bca80 2023-10-03T19:18:22.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.533+0000 7f75d9d74640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d40a2230 con 0x7f75d406d0f0 2023-10-03T19:18:22.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.533+0000 7f75d3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f75d406d0f0 0x7f75d4156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:22.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.533+0000 7f75d3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f75d406d0f0 0x7f75d4156820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41218/0 (socket says 172.21.15.45:41218) 2023-10-03T19:18:22.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.533+0000 7f75d3fff640 1 -- 172.21.15.45:0/799159346 learned_addr learned my addr 172.21.15.45:0/799159346 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:22.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.533+0000 7f75d3fff640 1 -- 172.21.15.45:0/799159346 >> v1:172.21.15.79:6789/0 conn(0x7f75d40bca80 legacy=0x7f75d4156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:22.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.533+0000 7f75d3fff640 1 -- 172.21.15.45:0/799159346 >> v1:172.21.15.45:6789/0 conn(0x7f75d4150400 legacy=0x7f75d406c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:22.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.533+0000 7f75d3fff640 1 -- 172.21.15.45:0/799159346 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d41507d0 con 0x7f75d406d0f0 2023-10-03T19:18:22.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.533+0000 7f75d27fc640 1 -- 172.21.15.45:0/799159346 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2745601738 0 0) 0x7f75d40a1720 con 0x7f75d4150400 2023-10-03T19:18:22.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.537+0000 7f75d3fff640 1 --2- 172.21.15.45:0/799159346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d406d0f0 0x7f75d4156820 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f75cc009870 tx=0x7f75cc01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a74ec317aaafe31 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:22.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.537+0000 7f75d27fc640 1 -- 172.21.15.45:0/799159346 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75cc0ac600 con 0x7f75d406d0f0 2023-10-03T19:18:22.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.537+0000 7f75d27fc640 1 -- 172.21.15.45:0/799159346 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75cc0a8050 con 0x7f75d406d0f0 2023-10-03T19:18:22.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.537+0000 7f75d27fc640 1 -- 172.21.15.45:0/799159346 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75cc0ac980 con 0x7f75d406d0f0 2023-10-03T19:18:22.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.537+0000 7f75d9d74640 1 -- 172.21.15.45:0/799159346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d406d0f0 msgr2=0x7f75d4156820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:22.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.537+0000 7f75d9d74640 1 --2- 172.21.15.45:0/799159346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d406d0f0 0x7f75d4156820 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f75cc009870 tx=0x7f75cc01c4b0 comp rx=0 tx=0).stop 2023-10-03T19:18:22.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.537+0000 7f75d9d74640 1 -- 172.21.15.45:0/799159346 shutdown_connections 2023-10-03T19:18:22.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.537+0000 7f75d9d74640 1 --2- 172.21.15.45:0/799159346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d406d0f0 0x7f75d4156820 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:22.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.537+0000 7f75d9d74640 1 -- 172.21.15.45:0/799159346 >> 172.21.15.45:0/799159346 conn(0x7f75d40bcf50 msgr2=0x7f75d40bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:22.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.537+0000 7f75d9d74640 1 -- 172.21.15.45:0/799159346 shutdown_connections 2023-10-03T19:18:22.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.537+0000 7f75d9d74640 1 -- 172.21.15.45:0/799159346 wait complete. 2023-10-03T19:18:22.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.537+0000 7f75d9d74640 1 Processor -- start 2023-10-03T19:18:22.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.537+0000 7f75d9d74640 1 -- start start 2023-10-03T19:18:22.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.537+0000 7f75d9d74640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75d406d0f0 0x7f75d413ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:22.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.537+0000 7f75d9d74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d40bca80 0x7f75d4148c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:22.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.537+0000 7f75d9d74640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75d4150400 0x7f75d40a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:22.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.537+0000 7f75d9d74640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d4148390 con 0x7f75d40bca80 2023-10-03T19:18:22.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.537+0000 7f75d9d74640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d414a150 con 0x7f75d4150400 2023-10-03T19:18:22.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.537+0000 7f75d9d74640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d41eb4f0 con 0x7f75d406d0f0 2023-10-03T19:18:22.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.537+0000 7f75d2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d40bca80 0x7f75d4148c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:22.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.537+0000 7f75d2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d40bca80 0x7f75d4148c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41234/0 (socket says 172.21.15.45:41234) 2023-10-03T19:18:22.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.537+0000 7f75d2ffd640 1 -- 172.21.15.45:0/2784497856 learned_addr learned my addr 172.21.15.45:0/2784497856 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:22.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.541+0000 7f75d3fff640 1 --2- 172.21.15.45:0/2784497856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75d4150400 0x7f75d40a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:22.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.541+0000 7f75d37fe640 1 --2- 172.21.15.45:0/2784497856 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75d406d0f0 0x7f75d413ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.541+0000 7f75d2ffd640 1 -- 172.21.15.45:0/2784497856 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75d406d0f0 msgr2=0x7f75d413ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.541+0000 7f75d2ffd640 1 --2- 172.21.15.45:0/2784497856 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75d406d0f0 0x7f75d413ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.541+0000 7f75d2ffd640 1 -- 172.21.15.45:0/2784497856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75d4150400 msgr2=0x7f75d40a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.541+0000 7f75d2ffd640 1 --2- 172.21.15.45:0/2784497856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75d4150400 0x7f75d40a4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.541+0000 7f75d2ffd640 1 -- 172.21.15.45:0/2784497856 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc0094d0 con 0x7f75d40bca80 2023-10-03T19:18:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.541+0000 7f75d37fe640 1 --2- 172.21.15.45:0/2784497856 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75d406d0f0 0x7f75d413ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.541+0000 7f75d2ffd640 1 --2- 172.21.15.45:0/2784497856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d40bca80 0x7f75d4148c40 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f75bc00c7f0 tx=0x7f75bc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.541+0000 7f75cbfff640 1 -- 172.21.15.45:0/2784497856 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc003b80 con 0x7f75d40bca80 2023-10-03T19:18:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.541+0000 7f75cbfff640 1 -- 172.21.15.45:0/2784497856 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75bc003ce0 con 0x7f75d40bca80 2023-10-03T19:18:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.541+0000 7f75cbfff640 1 -- 172.21.15.45:0/2784497856 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc00aa90 con 0x7f75d40bca80 2023-10-03T19:18:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.541+0000 7f75d9d74640 1 -- 172.21.15.45:0/2784497856 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d40a1b20 con 0x7f75d40bca80 2023-10-03T19:18:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.541+0000 7f75d9d74640 1 -- 172.21.15.45:0/2784497856 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d406c7f0 con 0x7f75d40bca80 2023-10-03T19:18:22.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.541+0000 7f75d9d74640 1 -- 172.21.15.45:0/2784497856 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d40bdbc0 con 0x7f75d40bca80 2023-10-03T19:18:22.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.541+0000 7f75cbfff640 1 -- 172.21.15.45:0/2784497856 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f75bc00abf0 con 0x7f75d40bca80 2023-10-03T19:18:22.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.541+0000 7f75cbfff640 1 --2- 172.21.15.45:0/2784497856 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f75b4066280 0x7f75b4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:22.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.541+0000 7f75cbfff640 1 -- 172.21.15.45:0/2784497856 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f75bc083940 con 0x7f75d40bca80 2023-10-03T19:18:22.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.541+0000 7f75d37fe640 1 --2- 172.21.15.45:0/2784497856 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f75b4066280 0x7f75b4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:22.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.541+0000 7f75d37fe640 1 --2- 172.21.15.45:0/2784497856 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f75b4066280 0x7f75b4068730 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f75c4000f70 tx=0x7f75c4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:22.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.545+0000 7f75cbfff640 1 -- 172.21.15.45:0/2784497856 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f75bc0510c0 con 0x7f75d40bca80 2023-10-03T19:18:22.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.737+0000 7f75d9d74640 1 -- 172.21.15.45:0/2784497856 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75d41eb6b0 con 0x7f75d40bca80 2023-10-03T19:18:22.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.737+0000 7f75cbfff640 1 -- 172.21.15.45:0/2784497856 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2769 (secure 0 0 0) 0x7f75bc0546e0 con 0x7f75d40bca80 2023-10-03T19:18:22.739 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:18:22.739 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":38,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/250992108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":250992108},{"type":"v1","addr":"172.21.15.79:6835","nonce":250992108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6339,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3153040546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3153040546},{"type":"v1","addr":"172.21.15.45:6834","nonce":3153040546}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6648,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2994389941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2994389941},{"type":"v1","addr":"172.21.15.45:6835","nonce":2994389941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[]} 2023-10-03T19:18:22.740 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 38 2023-10-03T19:18:22.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.737+0000 7f75d9d74640 1 -- 172.21.15.45:0/2784497856 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f75b4066280 msgr2=0x7f75b4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:22.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.737+0000 7f75d9d74640 1 --2- 172.21.15.45:0/2784497856 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f75b4066280 0x7f75b4068730 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f75c4000f70 tx=0x7f75c4009040 comp rx=0 tx=0).stop 2023-10-03T19:18:22.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.737+0000 7f75d9d74640 1 -- 172.21.15.45:0/2784497856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d40bca80 msgr2=0x7f75d4148c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:22.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.737+0000 7f75d9d74640 1 --2- 172.21.15.45:0/2784497856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d40bca80 0x7f75d4148c40 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f75bc00c7f0 tx=0x7f75bc00ccb0 comp rx=0 tx=0).stop 2023-10-03T19:18:22.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.737+0000 7f75d9d74640 1 -- 172.21.15.45:0/2784497856 shutdown_connections 2023-10-03T19:18:22.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.737+0000 7f75d9d74640 1 --2- 172.21.15.45:0/2784497856 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f75b4066280 0x7f75b4068730 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:22.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.737+0000 7f75d9d74640 1 --2- 172.21.15.45:0/2784497856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75d4150400 0x7f75d40a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:22.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.737+0000 7f75d9d74640 1 --2- 172.21.15.45:0/2784497856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d40bca80 0x7f75d4148c40 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:22.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.737+0000 7f75d9d74640 1 --2- 172.21.15.45:0/2784497856 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75d406d0f0 0x7f75d413ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:22.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.737+0000 7f75d9d74640 1 -- 172.21.15.45:0/2784497856 >> 172.21.15.45:0/2784497856 conn(0x7f75d40bcf50 msgr2=0x7f75d40bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:22.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.737+0000 7f75d9d74640 1 -- 172.21.15.45:0/2784497856 shutdown_connections 2023-10-03T19:18:22.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.737+0000 7f75d9d74640 1 -- 172.21.15.45:0/2784497856 wait complete. 2023-10-03T19:18:22.758 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-03T19:18:22.758 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-03T19:18:22.758 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-03T19:18:22.758 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:18:22.758 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-03T19:18:22.758 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-03T19:18:22.759 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-03T19:18:22.759 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:18:22.759 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-03T19:18:22.759 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-03T19:18:22.759 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-03T19:18:22.759 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:18:22.770 INFO:tasks.ceph.mds.a:Stopped 2023-10-03T19:18:22.770 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-03T19:18:22.771 INFO:tasks.ceph.mds.c:Stopped 2023-10-03T19:18:22.771 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-03T19:18:22.774 INFO:tasks.ceph.mds.b:Stopped 2023-10-03T19:18:22.774 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-03T19:18:22.815 INFO:tasks.ceph.mds.a:Started 2023-10-03T19:18:22.815 DEBUG:teuthology.parallel:result is None 2023-10-03T19:18:22.816 INFO:tasks.ceph.mds.c:Started 2023-10-03T19:18:22.816 DEBUG:teuthology.parallel:result is None 2023-10-03T19:18:22.818 INFO:tasks.ceph.mds.b:Started 2023-10-03T19:18:22.818 DEBUG:teuthology.parallel:result is None 2023-10-03T19:18:22.819 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-03T19:18:22.877 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-10-03T19:18:22.882 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-10-03T19:18:22.896 INFO:tasks.ceph.mds.b.smithi079.stdout:starting mds.b at 2023-10-03T19:18:22.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.929+0000 7ff4e0578640 1 Processor -- start 2023-10-03T19:18:22.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.929+0000 7ff4e0578640 1 -- start start 2023-10-03T19:18:22.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.929+0000 7ff4e0578640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff4d8148170 0x7ff4d80bc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:22.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.929+0000 7ff4e0578640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff4d80bd3b0 0x7ff4d814e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:22.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.929+0000 7ff4e0578640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d8148540 con 0x7ff4d80bc220 2023-10-03T19:18:22.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.929+0000 7ff4e0578640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d814baf0 con 0x7ff4d8148170 2023-10-03T19:18:22.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.929+0000 7ff4e0578640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d806f730 con 0x7ff4d80bd3b0 2023-10-03T19:18:22.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.929+0000 7ff4de314640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff4d8148170 0x7ff4d80bc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:22.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.929+0000 7ff4de314640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff4d8148170 0x7ff4d80bc9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41290/0 (socket says 172.21.15.45:41290) 2023-10-03T19:18:22.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.929+0000 7ff4de314640 1 -- 172.21.15.45:0/4059661712 learned_addr learned my addr 172.21.15.45:0/4059661712 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:22.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.929+0000 7ff4ddb13640 1 --2- 172.21.15.45:0/4059661712 >> v2:172.21.15.79:3300/0 conn(0x7ff4d80bd3b0 0x7ff4d814e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:22.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.929+0000 7ff4de314640 1 -- 172.21.15.45:0/4059661712 >> v2:172.21.15.79:3300/0 conn(0x7ff4d80bd3b0 msgr2=0x7ff4d814e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:22.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.929+0000 7ff4de314640 1 --2- 172.21.15.45:0/4059661712 >> v2:172.21.15.79:3300/0 conn(0x7ff4d80bd3b0 0x7ff4d814e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:22.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.929+0000 7ff4de314640 1 -- 172.21.15.45:0/4059661712 >> v1:172.21.15.79:6789/0 conn(0x7ff4d80bc220 legacy=0x7ff4d814e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:22.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.929+0000 7ff4de314640 1 -- 172.21.15.45:0/4059661712 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d8070690 con 0x7ff4d8148170 2023-10-03T19:18:22.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.929+0000 7ff4de314640 1 --2- 172.21.15.45:0/4059661712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d8148170 0x7ff4d80bc9d0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7ff4d80c1940 tx=0x7ff4d40202d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5e3b0b0b7776c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:22.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.929+0000 7ff4dd312640 1 -- 172.21.15.45:0/4059661712 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d40b0400 con 0x7ff4d8148170 2023-10-03T19:18:22.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.929+0000 7ff4dd312640 1 -- 172.21.15.45:0/4059661712 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d40ac050 con 0x7ff4d8148170 2023-10-03T19:18:22.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.929+0000 7ff4dd312640 1 -- 172.21.15.45:0/4059661712 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d40b0780 con 0x7ff4d8148170 2023-10-03T19:18:22.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4e0578640 1 -- 172.21.15.45:0/4059661712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d8148170 msgr2=0x7ff4d80bc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:22.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4e0578640 1 --2- 172.21.15.45:0/4059661712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d8148170 0x7ff4d80bc9d0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7ff4d80c1940 tx=0x7ff4d40202d0 comp rx=0 tx=0).stop 2023-10-03T19:18:22.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4e0578640 1 -- 172.21.15.45:0/4059661712 shutdown_connections 2023-10-03T19:18:22.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4e0578640 1 --2- 172.21.15.45:0/4059661712 >> v2:172.21.15.79:3300/0 conn(0x7ff4d80bd3b0 0x7ff4d814e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:22.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4e0578640 1 --2- 172.21.15.45:0/4059661712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d8148170 0x7ff4d80bc9d0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:22.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4e0578640 1 -- 172.21.15.45:0/4059661712 >> 172.21.15.45:0/4059661712 conn(0x7ff4d80c0d20 msgr2=0x7ff4d80c1120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:22.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4e0578640 1 -- 172.21.15.45:0/4059661712 shutdown_connections 2023-10-03T19:18:22.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4e0578640 1 -- 172.21.15.45:0/4059661712 wait complete. 2023-10-03T19:18:22.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4e0578640 1 Processor -- start 2023-10-03T19:18:22.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4e0578640 1 -- start start 2023-10-03T19:18:22.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4e0578640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4d80bc220 0x7ff4d81e7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:22.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4e0578640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff4d80bd3b0 0x7ff4d81e3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:22.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4e0578640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d8148170 0x7ff4d80ba4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:22.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4e0578640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d81d4c40 con 0x7ff4d8148170 2023-10-03T19:18:22.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4e0578640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d81e7fa0 con 0x7ff4d80bc220 2023-10-03T19:18:22.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4e0578640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d81e4050 con 0x7ff4d80bd3b0 2023-10-03T19:18:22.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4deb15640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d8148170 0x7ff4d80ba4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:22.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4deb15640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d8148170 0x7ff4d80ba4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41302/0 (socket says 172.21.15.45:41302) 2023-10-03T19:18:22.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4deb15640 1 -- 172.21.15.45:0/1212298247 learned_addr learned my addr 172.21.15.45:0/1212298247 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:22.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4ddb13640 1 --2- 172.21.15.45:0/1212298247 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff4d80bd3b0 0x7ff4d81e3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:22.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4de314640 1 --2- 172.21.15.45:0/1212298247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4d80bc220 0x7ff4d81e7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:22.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4deb15640 1 -- 172.21.15.45:0/1212298247 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff4d80bd3b0 msgr2=0x7ff4d81e3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:22.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4deb15640 1 --2- 172.21.15.45:0/1212298247 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff4d80bd3b0 0x7ff4d81e3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:22.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4deb15640 1 -- 172.21.15.45:0/1212298247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4d80bc220 msgr2=0x7ff4d81e7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:22.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4deb15640 1 --2- 172.21.15.45:0/1212298247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4d80bc220 0x7ff4d81e7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:22.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4deb15640 1 -- 172.21.15.45:0/1212298247 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d4009b30 con 0x7ff4d8148170 2023-10-03T19:18:22.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4deb15640 1 --2- 172.21.15.45:0/1212298247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d8148170 0x7ff4d80ba4d0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7ff4d000c460 tx=0x7ff4d000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:22.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4ceffd640 1 -- 172.21.15.45:0/1212298247 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0005220 con 0x7ff4d8148170 2023-10-03T19:18:22.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4ceffd640 1 -- 172.21.15.45:0/1212298247 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d0005380 con 0x7ff4d8148170 2023-10-03T19:18:22.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4e0578640 1 -- 172.21.15.45:0/1212298247 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d806fd20 con 0x7ff4d8148170 2023-10-03T19:18:22.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4ceffd640 1 -- 172.21.15.45:0/1212298247 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0007270 con 0x7ff4d8148170 2023-10-03T19:18:22.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.933+0000 7ff4e0578640 1 -- 172.21.15.45:0/1212298247 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d806f9d0 con 0x7ff4d8148170 2023-10-03T19:18:22.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.937+0000 7ff4e0578640 1 -- 172.21.15.45:0/1212298247 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d8071920 con 0x7ff4d8148170 2023-10-03T19:18:22.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.937+0000 7ff4ceffd640 1 -- 172.21.15.45:0/1212298247 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff4d00073d0 con 0x7ff4d8148170 2023-10-03T19:18:22.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.937+0000 7ff4ceffd640 1 --2- 172.21.15.45:0/1212298247 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff4bc066280 0x7ff4bc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:22.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.937+0000 7ff4ceffd640 1 -- 172.21.15.45:0/1212298247 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ff4d0082e60 con 0x7ff4d8148170 2023-10-03T19:18:22.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.937+0000 7ff4de314640 1 --2- 172.21.15.45:0/1212298247 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff4bc066280 0x7ff4bc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:22.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.937+0000 7ff4de314640 1 --2- 172.21.15.45:0/1212298247 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff4bc066280 0x7ff4bc068730 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff4d40b2000 tx=0x7ff4d40ab000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:22.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:22.941+0000 7ff4ceffd640 1 -- 172.21.15.45:0/1212298247 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff4d0050720 con 0x7ff4d8148170 2023-10-03T19:18:23.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:23.101+0000 7ff4e0578640 1 -- 172.21.15.45:0/1212298247 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff4d81d4db0 con 0x7ff4d8148170 2023-10-03T19:18:23.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:23.937+0000 7ff4ceffd640 1 -- 172.21.15.45:0/1212298247 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v81) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff4d81d4db0 con 0x7ff4d8148170 2023-10-03T19:18:23.940 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-10-03T19:18:23.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:23.941+0000 7ff4e0578640 1 -- 172.21.15.45:0/1212298247 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff4bc066280 msgr2=0x7ff4bc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:23.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:23.941+0000 7ff4e0578640 1 --2- 172.21.15.45:0/1212298247 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff4bc066280 0x7ff4bc068730 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff4d40b2000 tx=0x7ff4d40ab000 comp rx=0 tx=0).stop 2023-10-03T19:18:23.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:23.941+0000 7ff4e0578640 1 -- 172.21.15.45:0/1212298247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d8148170 msgr2=0x7ff4d80ba4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:23.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:23.941+0000 7ff4e0578640 1 --2- 172.21.15.45:0/1212298247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d8148170 0x7ff4d80ba4d0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7ff4d000c460 tx=0x7ff4d000c920 comp rx=0 tx=0).stop 2023-10-03T19:18:23.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:23.941+0000 7ff4e0578640 1 -- 172.21.15.45:0/1212298247 shutdown_connections 2023-10-03T19:18:23.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:23.941+0000 7ff4e0578640 1 --2- 172.21.15.45:0/1212298247 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff4bc066280 0x7ff4bc068730 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:23.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:23.941+0000 7ff4e0578640 1 --2- 172.21.15.45:0/1212298247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d8148170 0x7ff4d80ba4d0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:23.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:23.941+0000 7ff4e0578640 1 --2- 172.21.15.45:0/1212298247 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff4d80bd3b0 0x7ff4d81e3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:23.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:23.941+0000 7ff4e0578640 1 --2- 172.21.15.45:0/1212298247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4d80bc220 0x7ff4d81e7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:23.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:23.941+0000 7ff4e0578640 1 -- 172.21.15.45:0/1212298247 >> 172.21.15.45:0/1212298247 conn(0x7ff4d80c0d20 msgr2=0x7ff4d80c10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:23.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:23.941+0000 7ff4e0578640 1 -- 172.21.15.45:0/1212298247 shutdown_connections 2023-10-03T19:18:23.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:23.941+0000 7ff4e0578640 1 -- 172.21.15.45:0/1212298247 wait complete. 2023-10-03T19:18:23.966 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-03T19:18:24.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e4421640 1 Processor -- start 2023-10-03T19:18:24.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e4421640 1 -- start start 2023-10-03T19:18:24.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e4421640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f99dc06f170 0x7f99dc150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:24.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e4421640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99dc06cac0 con 0x7f99dc06d170 2023-10-03T19:18:24.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e4421640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99dc0720d0 con 0x7f99dc0bc8b0 2023-10-03T19:18:24.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e4421640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc0a5ab0 con 0x7f99dc06f170 2023-10-03T19:18:24.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e29be640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f99dc06d170 0x7f99dc156e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39606/0 (socket says 172.21.15.45:39606) 2023-10-03T19:18:24.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e29be640 1 -- 172.21.15.45:0/2324588292 learned_addr learned my addr 172.21.15.45:0/2324588292 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:18:24.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e21bd640 1 --2- 172.21.15.45:0/2324588292 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f99dc06f170 0x7f99dc150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:24.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e11bb640 1 -- 172.21.15.45:0/2324588292 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 310792947 0 0) 0x7f99d40014a0 con 0x7f99dc06d170 2023-10-03T19:18:24.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e11bb640 1 -- 172.21.15.45:0/2324588292 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99c8003530 con 0x7f99dc06d170 2023-10-03T19:18:24.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e11bb640 1 -- 172.21.15.45:0/2324588292 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1061841568 0 0) 0x7f99c8003530 con 0x7f99dc06d170 2023-10-03T19:18:24.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e11bb640 1 -- 172.21.15.45:0/2324588292 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f99dc06f170 msgr2=0x7f99dc150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:24.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e11bb640 1 --2- 172.21.15.45:0/2324588292 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f99dc06f170 0x7f99dc150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:24.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e11bb640 1 -- 172.21.15.45:0/2324588292 >> v1:172.21.15.79:6789/0 conn(0x7f99dc0bc8b0 legacy=0x7f99dc14ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:24.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e11bb640 1 -- 172.21.15.45:0/2324588292 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99dc06cd00 con 0x7f99dc06d170 2023-10-03T19:18:24.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e11bb640 1 -- 172.21.15.45:0/2324588292 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f99d4001b90 con 0x7f99dc06d170 2023-10-03T19:18:24.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e11bb640 1 -- 172.21.15.45:0/2324588292 >> v1:172.21.15.45:6789/0 conn(0x7f99dc06d170 legacy=0x7f99dc156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:24.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e11bb640 1 --2- 172.21.15.45:0/2324588292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c80039b0 0x7f99c8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:24.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e11bb640 1 --2- 172.21.15.45:0/2324588292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99c80047d0 0x7f99c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:24.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e11bb640 1 --2- 172.21.15.45:0/2324588292 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f99dc06f170 0x7f99c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:24.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e11bb640 1 -- 172.21.15.45:0/2324588292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc0a5ab0 con 0x7f99c80047d0 2023-10-03T19:18:24.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e11bb640 1 -- 172.21.15.45:0/2324588292 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c800ba40 con 0x7f99c80039b0 2023-10-03T19:18:24.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e11bb640 1 -- 172.21.15.45:0/2324588292 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c800bbd0 con 0x7f99dc06f170 2023-10-03T19:18:24.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e19bc640 1 --2- 172.21.15.45:0/2324588292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99c80047d0 0x7f99c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:24.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e21bd640 1 --2- 172.21.15.45:0/2324588292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c80039b0 0x7f99c8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:24.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e29be640 1 --2- 172.21.15.45:0/2324588292 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f99dc06f170 0x7f99c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:24.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e19bc640 1 -- 172.21.15.45:0/2324588292 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f99dc06f170 msgr2=0x7f99c8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:24.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e19bc640 1 --2- 172.21.15.45:0/2324588292 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f99dc06f170 0x7f99c8005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:24.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e19bc640 1 -- 172.21.15.45:0/2324588292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c80039b0 msgr2=0x7f99c8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:24.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e19bc640 1 --2- 172.21.15.45:0/2324588292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c80039b0 0x7f99c8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:24.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.089+0000 7f99e19bc640 1 -- 172.21.15.45:0/2324588292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c8003530 con 0x7f99c80047d0 2023-10-03T19:18:24.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.093+0000 7f99e19bc640 1 --2- 172.21.15.45:0/2324588292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99c80047d0 0x7f99c8004c40 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f99cc001780 tx=0x7f99cc01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d1b6dd9d325a4b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:24.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.093+0000 7f99e11bb640 1 -- 172.21.15.45:0/2324588292 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc0052d0 con 0x7f99c80047d0 2023-10-03T19:18:24.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.093+0000 7f99e11bb640 1 -- 172.21.15.45:0/2324588292 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99cc0a7050 con 0x7f99c80047d0 2023-10-03T19:18:24.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.093+0000 7f99e11bb640 1 -- 172.21.15.45:0/2324588292 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc003600 con 0x7f99c80047d0 2023-10-03T19:18:24.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.093+0000 7f99e4421640 1 -- 172.21.15.45:0/2324588292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99c80047d0 msgr2=0x7f99c8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:24.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.093+0000 7f99e4421640 1 --2- 172.21.15.45:0/2324588292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99c80047d0 0x7f99c8004c40 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f99cc001780 tx=0x7f99cc01c400 comp rx=0 tx=0).stop 2023-10-03T19:18:24.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.093+0000 7f99e29be640 1 -- 172.21.15.45:0/2324588292 reap_dead start 2023-10-03T19:18:24.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.093+0000 7f99e4421640 1 -- 172.21.15.45:0/2324588292 shutdown_connections 2023-10-03T19:18:24.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.093+0000 7f99e4421640 1 -- 172.21.15.45:0/2324588292 >> 172.21.15.45:0/2324588292 conn(0x7f99dc0bcf50 msgr2=0x7f99dc0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:24.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.093+0000 7f99e4421640 1 -- 172.21.15.45:0/2324588292 shutdown_connections 2023-10-03T19:18:24.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.093+0000 7f99e4421640 1 -- 172.21.15.45:0/2324588292 wait complete. 2023-10-03T19:18:24.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.093+0000 7f99e4421640 1 Processor -- start 2023-10-03T19:18:24.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.093+0000 7f99e4421640 1 -- start start 2023-10-03T19:18:24.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.093+0000 7f99e4421640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99dc14e5e0 0x7f99dc149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:24.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.093+0000 7f99e4421640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f99dc144e30 0x7f99dc0bf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:24.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.093+0000 7f99e4421640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99dc1e7c80 0x7f99dc0bfe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:24.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.093+0000 7f99e4421640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc0a4fd0 con 0x7f99dc1e7c80 2023-10-03T19:18:24.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.093+0000 7f99e4421640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc14a900 con 0x7f99dc14e5e0 2023-10-03T19:18:24.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.093+0000 7f99e4421640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc0a4d80 con 0x7f99dc144e30 2023-10-03T19:18:24.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.093+0000 7f99e29be640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99dc1e7c80 0x7f99dc0bfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:24.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.093+0000 7f99e29be640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99dc1e7c80 0x7f99dc0bfe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41322/0 (socket says 172.21.15.45:41322) 2023-10-03T19:18:24.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.093+0000 7f99e29be640 1 -- 172.21.15.45:0/2224370944 learned_addr learned my addr 172.21.15.45:0/2224370944 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:24.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.093+0000 7f99e19bc640 1 --2- 172.21.15.45:0/2224370944 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f99dc144e30 0x7f99dc0bf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:24.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.093+0000 7f99e21bd640 1 --2- 172.21.15.45:0/2224370944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99dc14e5e0 0x7f99dc149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:24.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.093+0000 7f99e29be640 1 -- 172.21.15.45:0/2224370944 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f99dc144e30 msgr2=0x7f99dc0bf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:24.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.093+0000 7f99e29be640 1 --2- 172.21.15.45:0/2224370944 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f99dc144e30 0x7f99dc0bf940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:24.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.093+0000 7f99e29be640 1 -- 172.21.15.45:0/2224370944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99dc14e5e0 msgr2=0x7f99dc149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:24.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.093+0000 7f99e29be640 1 --2- 172.21.15.45:0/2224370944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99dc14e5e0 0x7f99dc149fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:24.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.093+0000 7f99e29be640 1 -- 172.21.15.45:0/2224370944 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99dc14c4a0 con 0x7f99dc1e7c80 2023-10-03T19:18:24.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.093+0000 7f99e19bc640 1 --2- 172.21.15.45:0/2224370944 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f99dc144e30 0x7f99dc0bf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:24.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.097+0000 7f99e29be640 1 --2- 172.21.15.45:0/2224370944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99dc1e7c80 0x7f99dc0bfe80 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f99d4004bd0 tx=0x7f99d40108e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:24.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.097+0000 7f99d2ffd640 1 -- 172.21.15.45:0/2224370944 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d4015600 con 0x7f99dc1e7c80 2023-10-03T19:18:24.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.097+0000 7f99d2ffd640 1 -- 172.21.15.45:0/2224370944 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d4015780 con 0x7f99dc1e7c80 2023-10-03T19:18:24.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.097+0000 7f99e4421640 1 -- 172.21.15.45:0/2224370944 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99dc14fae0 con 0x7f99dc1e7c80 2023-10-03T19:18:24.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.097+0000 7f99d2ffd640 1 -- 172.21.15.45:0/2224370944 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d4015b70 con 0x7f99dc1e7c80 2023-10-03T19:18:24.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.097+0000 7f99e4421640 1 -- 172.21.15.45:0/2224370944 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99dc06f540 con 0x7f99dc1e7c80 2023-10-03T19:18:24.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.097+0000 7f99e4421640 1 -- 172.21.15.45:0/2224370944 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99dc06d660 con 0x7f99dc1e7c80 2023-10-03T19:18:24.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.097+0000 7f99d2ffd640 1 -- 172.21.15.45:0/2224370944 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f99d401e3b0 con 0x7f99dc1e7c80 2023-10-03T19:18:24.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.097+0000 7f99d2ffd640 1 --2- 172.21.15.45:0/2224370944 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f99c0066280 0x7f99c0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:24.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.097+0000 7f99d2ffd640 1 -- 172.21.15.45:0/2224370944 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f99d4085e10 con 0x7f99dc1e7c80 2023-10-03T19:18:24.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.097+0000 7f99e21bd640 1 --2- 172.21.15.45:0/2224370944 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f99c0066280 0x7f99c0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:24.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.097+0000 7f99e21bd640 1 --2- 172.21.15.45:0/2224370944 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f99c0066280 0x7f99c0068730 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f99d8009a30 tx=0x7f99d8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:24.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.105+0000 7f99d2ffd640 1 -- 172.21.15.45:0/2224370944 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f99d40535e0 con 0x7f99dc1e7c80 2023-10-03T19:18:24.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.309+0000 7f99e4421640 1 -- 172.21.15.45:0/2224370944 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f99dc06cac0 con 0x7f99dc1e7c80 2023-10-03T19:18:24.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.313+0000 7f99d2ffd640 1 -- 172.21.15.45:0/2224370944 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+4440 (secure 0 0 0) 0x7f99dc06cac0 con 0x7f99dc1e7c80 2023-10-03T19:18:24.314 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:18:24.314 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-03T19:18:24.314 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-10-03T19:18:24.314 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:18:24.315 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-10-03T19:18:24.315 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlfyzhExAABLhtkQEZuiLwovBSO0kuAA==", 2023-10-03T19:18:24.315 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:18:24.315 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:18:24.315 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-03T19:18:24.315 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-03T19:18:24.315 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:18:24.315 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:18:24.315 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:18:24.315 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:18:24.315 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-10-03T19:18:24.315 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlzM8pIBAAMie9jpxS/xt2cymMpyJmiQ==", 2023-10-03T19:18:24.315 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:18:24.316 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:18:24.316 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-03T19:18:24.316 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-03T19:18:24.316 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:18:24.316 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:18:24.316 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:18:24.316 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:18:24.316 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-10-03T19:18:24.316 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlAsGOHBAAIHprnd9orKMQjzkNQZz94A==", 2023-10-03T19:18:24.316 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:18:24.316 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:18:24.316 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-03T19:18:24.316 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-03T19:18:24.317 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:18:24.317 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:18:24.317 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:18:24.317 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:18:24.317 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-10-03T19:18:24.317 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBmZxxlb0zQLRAA3z+f4/jsLTLUmFg/WOD/Xg==", 2023-10-03T19:18:24.317 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:18:24.317 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:18:24.317 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:18:24.317 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:18:24.317 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:18:24.317 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:18:24.317 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:18:24.318 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-10-03T19:18:24.318 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBpZxxlTjtZNRAA3HFqXjGLO7JoX+GBegGfqw==", 2023-10-03T19:18:24.318 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:18:24.318 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:18:24.318 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:18:24.318 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:18:24.318 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:18:24.318 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:18:24.318 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:18:24.318 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-10-03T19:18:24.318 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBtZxxld6kUBBAATcGPrxBbPLswrUHihB7AgQ==", 2023-10-03T19:18:24.318 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:18:24.318 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:18:24.319 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:18:24.319 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:18:24.319 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:18:24.319 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:18:24.319 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:18:24.319 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-10-03T19:18:24.319 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBwZxxlWUL3DBAAk4TW6N5mpjjyP7QgQAIuDw==", 2023-10-03T19:18:24.319 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:18:24.319 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:18:24.319 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:18:24.319 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:18:24.319 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:18:24.320 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:18:24.320 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:18:24.320 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-10-03T19:18:24.320 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQB2ZxxlK3KNIhAAjhvxAU0shg+5PbJfq1LEog==", 2023-10-03T19:18:24.320 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:18:24.320 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:18:24.320 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:18:24.320 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:18:24.320 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:18:24.320 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:18:24.320 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:18:24.320 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-10-03T19:18:24.321 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQB5ZxxlRAxuKhAA5ma3eAt3kkukdhgZN4wwEg==", 2023-10-03T19:18:24.321 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:18:24.321 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:18:24.321 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:18:24.321 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:18:24.321 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:18:24.321 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:18:24.321 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:18:24.321 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-10-03T19:18:24.321 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQB8ZxxlkQqOMxAAuKGy7vJQLUDsqgjPVtWMWg==", 2023-10-03T19:18:24.321 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:18:24.321 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:18:24.321 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:18:24.321 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:18:24.322 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:18:24.322 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:18:24.322 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:18:24.322 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-10-03T19:18:24.322 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCAZxxl65r/ABAAeWtP7nMLVm5NBU4vWQ6ceg==", 2023-10-03T19:18:24.322 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:18:24.322 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:18:24.322 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:18:24.322 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:18:24.322 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:18:24.322 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:18:24.322 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:18:24.323 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-10-03T19:18:24.323 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlg5PgJRAAvvN5Xrw/ZW4rSdJ1/adnzA==", 2023-10-03T19:18:24.323 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:18:24.323 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:18:24.323 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow r", 2023-10-03T19:18:24.323 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-03T19:18:24.323 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:18:24.323 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:18:24.323 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:18:24.323 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-10-03T19:18:24.323 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlKkW+KRAALzVyQ+iTWuD5FMLDKXNVTg==", 2023-10-03T19:18:24.323 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:18:24.324 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:18:24.324 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-10-03T19:18:24.324 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-10-03T19:18:24.324 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-10-03T19:18:24.324 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:18:24.324 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:18:24.324 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:18:24.324 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-10-03T19:18:24.324 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBkZxxldHb4LxAAc/oJcXFjNgH5Wxwv04WHgw==", 2023-10-03T19:18:24.324 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:18:24.324 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-10-03T19:18:24.324 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-03T19:18:24.324 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-03T19:18:24.325 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:18:24.325 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:18:24.325 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:18:24.325 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:18:24.325 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-10-03T19:18:24.325 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxl4txNEBAAonNqY2PmtF0vZGFmvzxIKw==", 2023-10-03T19:18:24.325 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:18:24.325 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-10-03T19:18:24.325 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-10-03T19:18:24.325 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:18:24.325 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:18:24.325 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:18:24.325 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:18:24.326 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-10-03T19:18:24.326 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlUmKhDRAA7UKlGP9q9aKsk+J+nTxrUA==", 2023-10-03T19:18:24.326 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:18:24.326 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-10-03T19:18:24.326 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-10-03T19:18:24.326 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:18:24.326 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:18:24.326 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:18:24.326 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-10-03T19:18:24.326 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-03T19:18:24.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.313+0000 7f99e4421640 1 -- 172.21.15.45:0/2224370944 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f99c0066280 msgr2=0x7f99c0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:24.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.313+0000 7f99e4421640 1 --2- 172.21.15.45:0/2224370944 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f99c0066280 0x7f99c0068730 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f99d8009a30 tx=0x7f99d8008040 comp rx=0 tx=0).stop 2023-10-03T19:18:24.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.313+0000 7f99e4421640 1 -- 172.21.15.45:0/2224370944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99dc1e7c80 msgr2=0x7f99dc0bfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:24.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.313+0000 7f99e4421640 1 --2- 172.21.15.45:0/2224370944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99dc1e7c80 0x7f99dc0bfe80 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f99d4004bd0 tx=0x7f99d40108e0 comp rx=0 tx=0).stop 2023-10-03T19:18:24.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.313+0000 7f99e4421640 1 -- 172.21.15.45:0/2224370944 shutdown_connections 2023-10-03T19:18:24.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.313+0000 7f99e4421640 1 --2- 172.21.15.45:0/2224370944 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f99c0066280 0x7f99c0068730 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:24.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.313+0000 7f99e4421640 1 --2- 172.21.15.45:0/2224370944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99dc1e7c80 0x7f99dc0bfe80 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:24.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.313+0000 7f99e4421640 1 --2- 172.21.15.45:0/2224370944 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f99dc144e30 0x7f99dc0bf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:24.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.313+0000 7f99e4421640 1 --2- 172.21.15.45:0/2224370944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99dc14e5e0 0x7f99dc149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:24.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.313+0000 7f99e4421640 1 -- 172.21.15.45:0/2224370944 >> 172.21.15.45:0/2224370944 conn(0x7f99dc0bcf50 msgr2=0x7f99dc1d72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:24.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.313+0000 7f99e4421640 1 -- 172.21.15.45:0/2224370944 shutdown_connections 2023-10-03T19:18:24.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.313+0000 7f99e4421640 1 -- 172.21.15.45:0/2224370944 wait complete. 2023-10-03T19:18:24.332 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:18:24.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.453+0000 7f2dfabf4640 1 Processor -- start 2023-10-03T19:18:24.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.453+0000 7f2dfabf4640 1 -- start start 2023-10-03T19:18:24.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.453+0000 7f2dfabf4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2df40a6af0 0x7f2df4070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:24.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.453+0000 7f2dfabf4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2df41503e0 0x7f2df414b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:24.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.453+0000 7f2dfabf4640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df406a240 con 0x7f2df414be70 2023-10-03T19:18:24.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.453+0000 7f2dfabf4640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df40bc0f0 con 0x7f2df40a6af0 2023-10-03T19:18:24.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.453+0000 7f2dfabf4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df40a75e0 con 0x7f2df41503e0 2023-10-03T19:18:24.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.453+0000 7f2df9191640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2df414be70 0x7f2df4065690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39614/0 (socket says 172.21.15.45:39614) 2023-10-03T19:18:24.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.453+0000 7f2df9191640 1 -- 172.21.15.45:0/3099455232 learned_addr learned my addr 172.21.15.45:0/3099455232 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:18:24.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.453+0000 7f2df8990640 1 --2- 172.21.15.45:0/3099455232 >> v2:172.21.15.45:3300/0 conn(0x7f2df40a6af0 0x7f2df4070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:24.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.453+0000 7f2df3fff640 1 --2- 172.21.15.45:0/3099455232 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2df41503e0 0x7f2df414b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:24.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.453+0000 7f2df37fe640 1 -- 172.21.15.45:0/3099455232 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1850508044 0 0) 0x7f2df406a240 con 0x7f2df414be70 2023-10-03T19:18:24.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.453+0000 7f2df37fe640 1 -- 172.21.15.45:0/3099455232 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2de0003530 con 0x7f2df414be70 2023-10-03T19:18:24.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.453+0000 7f2df8990640 1 -- 172.21.15.45:0/3099455232 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2df41503e0 msgr2=0x7f2df414b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:24.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.453+0000 7f2df8990640 1 --2- 172.21.15.45:0/3099455232 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2df41503e0 0x7f2df414b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:24.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.453+0000 7f2df8990640 1 -- 172.21.15.45:0/3099455232 >> v1:172.21.15.45:6789/0 conn(0x7f2df414be70 legacy=0x7f2df4065690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:24.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.453+0000 7f2df8990640 1 -- 172.21.15.45:0/3099455232 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df4069db0 con 0x7f2df40a6af0 2023-10-03T19:18:24.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.457+0000 7f2df8990640 1 --2- 172.21.15.45:0/3099455232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2df40a6af0 0x7f2df4070b50 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f2de40097c0 tx=0x7f2de401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90642ac4ff0a868 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:24.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.457+0000 7f2df37fe640 1 -- 172.21.15.45:0/3099455232 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de40ab600 con 0x7f2df40a6af0 2023-10-03T19:18:24.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.457+0000 7f2df37fe640 1 -- 172.21.15.45:0/3099455232 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de40a7050 con 0x7f2df40a6af0 2023-10-03T19:18:24.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.457+0000 7f2df37fe640 1 -- 172.21.15.45:0/3099455232 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de40ab980 con 0x7f2df40a6af0 2023-10-03T19:18:24.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.457+0000 7f2dfabf4640 1 -- 172.21.15.45:0/3099455232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2df40a6af0 msgr2=0x7f2df4070b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:24.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.457+0000 7f2dfabf4640 1 --2- 172.21.15.45:0/3099455232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2df40a6af0 0x7f2df4070b50 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f2de40097c0 tx=0x7f2de401c480 comp rx=0 tx=0).stop 2023-10-03T19:18:24.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.457+0000 7f2dfabf4640 1 -- 172.21.15.45:0/3099455232 shutdown_connections 2023-10-03T19:18:24.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.457+0000 7f2dfabf4640 1 --2- 172.21.15.45:0/3099455232 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2df41503e0 0x7f2df414b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:24.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.457+0000 7f2dfabf4640 1 --2- 172.21.15.45:0/3099455232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2df40a6af0 0x7f2df4070b50 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:24.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.457+0000 7f2dfabf4640 1 -- 172.21.15.45:0/3099455232 >> 172.21.15.45:0/3099455232 conn(0x7f2df40bed00 msgr2=0x7f2df406d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:24.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.457+0000 7f2dfabf4640 1 -- 172.21.15.45:0/3099455232 shutdown_connections 2023-10-03T19:18:24.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.457+0000 7f2dfabf4640 1 -- 172.21.15.45:0/3099455232 wait complete. 2023-10-03T19:18:24.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.457+0000 7f2dfabf4640 1 Processor -- start 2023-10-03T19:18:24.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.457+0000 7f2dfabf4640 1 -- start start 2023-10-03T19:18:24.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.457+0000 7f2dfabf4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2df40a6af0 0x7f2df4147b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:24.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.457+0000 7f2dfabf4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2df414be70 0x7f2df40bab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:24.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.457+0000 7f2dfabf4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2df41503e0 0x7f2df414e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:24.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.457+0000 7f2dfabf4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df414e280 con 0x7f2df41503e0 2023-10-03T19:18:24.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.457+0000 7f2dfabf4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df4142550 con 0x7f2df414be70 2023-10-03T19:18:24.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.457+0000 7f2dfabf4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df4148060 con 0x7f2df40a6af0 2023-10-03T19:18:24.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.461+0000 7f2df9191640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2df41503e0 0x7f2df414e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:24.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.461+0000 7f2df9191640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2df41503e0 0x7f2df414e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41342/0 (socket says 172.21.15.45:41342) 2023-10-03T19:18:24.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.461+0000 7f2df9191640 1 -- 172.21.15.45:0/1797513223 learned_addr learned my addr 172.21.15.45:0/1797513223 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:24.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.461+0000 7f2df3fff640 1 --2- 172.21.15.45:0/1797513223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2df414be70 0x7f2df40bab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:24.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.461+0000 7f2df8990640 1 --2- 172.21.15.45:0/1797513223 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2df40a6af0 0x7f2df4147b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:24.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.461+0000 7f2df9191640 1 -- 172.21.15.45:0/1797513223 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2df40a6af0 msgr2=0x7f2df4147b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:24.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.461+0000 7f2df9191640 1 --2- 172.21.15.45:0/1797513223 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2df40a6af0 0x7f2df4147b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:24.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.461+0000 7f2df9191640 1 -- 172.21.15.45:0/1797513223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2df414be70 msgr2=0x7f2df40bab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:24.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.461+0000 7f2df9191640 1 --2- 172.21.15.45:0/1797513223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2df414be70 0x7f2df40bab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:24.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.461+0000 7f2df9191640 1 -- 172.21.15.45:0/1797513223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de4009420 con 0x7f2df41503e0 2023-10-03T19:18:24.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.461+0000 7f2df8990640 1 --2- 172.21.15.45:0/1797513223 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2df40a6af0 0x7f2df4147b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:24.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.461+0000 7f2df9191640 1 --2- 172.21.15.45:0/1797513223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2df41503e0 0x7f2df414e710 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00c450 tx=0x7f2dec00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:24.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.461+0000 7f2df17fa640 1 -- 172.21.15.45:0/1797513223 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec005cf0 con 0x7f2df41503e0 2023-10-03T19:18:24.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.461+0000 7f2df17fa640 1 -- 172.21.15.45:0/1797513223 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dec005e50 con 0x7f2df41503e0 2023-10-03T19:18:24.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.461+0000 7f2df17fa640 1 -- 172.21.15.45:0/1797513223 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec0072b0 con 0x7f2df41503e0 2023-10-03T19:18:24.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.461+0000 7f2dfabf4640 1 -- 172.21.15.45:0/1797513223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df40bdd60 con 0x7f2df41503e0 2023-10-03T19:18:24.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.461+0000 7f2dfabf4640 1 -- 172.21.15.45:0/1797513223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df406b010 con 0x7f2df41503e0 2023-10-03T19:18:24.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.461+0000 7f2dfabf4640 1 -- 172.21.15.45:0/1797513223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df414c270 con 0x7f2df41503e0 2023-10-03T19:18:24.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.461+0000 7f2df17fa640 1 -- 172.21.15.45:0/1797513223 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2dec007410 con 0x7f2df41503e0 2023-10-03T19:18:24.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.461+0000 7f2df17fa640 1 --2- 172.21.15.45:0/1797513223 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2dd4066280 0x7f2dd4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:24.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.461+0000 7f2df17fa640 1 -- 172.21.15.45:0/1797513223 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2dec082be0 con 0x7f2df41503e0 2023-10-03T19:18:24.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.461+0000 7f2df8990640 1 --2- 172.21.15.45:0/1797513223 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2dd4066280 0x7f2dd4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:24.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.461+0000 7f2df8990640 1 --2- 172.21.15.45:0/1797513223 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2dd4066280 0x7f2dd4068730 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2de40ad000 tx=0x7f2de4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:24.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.465+0000 7f2df17fa640 1 -- 172.21.15.45:0/1797513223 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2dec0503b0 con 0x7f2df41503e0 2023-10-03T19:18:24.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.621+0000 7f2dfabf4640 1 -- 172.21.15.45:0/1797513223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2df414e430 con 0x7f2df41503e0 2023-10-03T19:18:24.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.621+0000 7f2df17fa640 1 -- 172.21.15.45:0/1797513223 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+14592 (secure 0 0 0) 0x7f2df414e430 con 0x7f2df41503e0 2023-10-03T19:18:24.625 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:18:24.626 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":81,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:18:23.931005+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:18:24.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.625+0000 7f2dfabf4640 1 -- 172.21.15.45:0/1797513223 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2dd4066280 msgr2=0x7f2dd4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:24.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.625+0000 7f2dfabf4640 1 --2- 172.21.15.45:0/1797513223 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2dd4066280 0x7f2dd4068730 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2de40ad000 tx=0x7f2de4008040 comp rx=0 tx=0).stop 2023-10-03T19:18:24.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.625+0000 7f2dfabf4640 1 -- 172.21.15.45:0/1797513223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2df41503e0 msgr2=0x7f2df414e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:24.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.625+0000 7f2dfabf4640 1 --2- 172.21.15.45:0/1797513223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2df41503e0 0x7f2df414e710 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00c450 tx=0x7f2dec00c910 comp rx=0 tx=0).stop 2023-10-03T19:18:24.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.625+0000 7f2dfabf4640 1 -- 172.21.15.45:0/1797513223 shutdown_connections 2023-10-03T19:18:24.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.625+0000 7f2dfabf4640 1 --2- 172.21.15.45:0/1797513223 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2dd4066280 0x7f2dd4068730 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:24.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.625+0000 7f2dfabf4640 1 --2- 172.21.15.45:0/1797513223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2df41503e0 0x7f2df414e710 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:24.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.625+0000 7f2dfabf4640 1 --2- 172.21.15.45:0/1797513223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2df414be70 0x7f2df40bab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:24.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.625+0000 7f2dfabf4640 1 --2- 172.21.15.45:0/1797513223 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2df40a6af0 0x7f2df4147b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:24.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.625+0000 7f2dfabf4640 1 -- 172.21.15.45:0/1797513223 >> 172.21.15.45:0/1797513223 conn(0x7f2df40bed00 msgr2=0x7f2df40bc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:24.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.625+0000 7f2dfabf4640 1 -- 172.21.15.45:0/1797513223 shutdown_connections 2023-10-03T19:18:24.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.625+0000 7f2dfabf4640 1 -- 172.21.15.45:0/1797513223 wait complete. 2023-10-03T19:18:24.644 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:18:24.645 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:18:24.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.773+0000 7f3225b64640 1 Processor -- start 2023-10-03T19:18:24.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.773+0000 7f3225b64640 1 -- start start 2023-10-03T19:18:24.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.773+0000 7f3225b64640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3220150340 0x7f3220153660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:24.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.773+0000 7f3225b64640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3220156710 0x7f3220156b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:24.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.773+0000 7f3225b64640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3220153ba0 con 0x7f322006c3d0 2023-10-03T19:18:24.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.773+0000 7f3225b64640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32201570b0 con 0x7f3220150340 2023-10-03T19:18:24.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.773+0000 7f3225b64640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3220156280 con 0x7f3220156710 2023-10-03T19:18:24.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.773+0000 7f321f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3220150340 0x7f3220153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:24.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.773+0000 7f321effd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f322006c3d0 0x7f32200a1160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54712/0 (socket says 172.21.15.45:54712) 2023-10-03T19:18:24.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.773+0000 7f321effd640 1 -- 172.21.15.45:0/2779951179 learned_addr learned my addr 172.21.15.45:0/2779951179 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:18:24.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.773+0000 7f321ffff640 1 --2- 172.21.15.45:0/2779951179 >> v2:172.21.15.79:3300/0 conn(0x7f3220156710 0x7f3220156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:24.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.773+0000 7f321e7fc640 1 -- 172.21.15.45:0/2779951179 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3990449969 0 0) 0x7f3208001120 con 0x7f322006c3d0 2023-10-03T19:18:24.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.773+0000 7f321e7fc640 1 -- 172.21.15.45:0/2779951179 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f320c003530 con 0x7f322006c3d0 2023-10-03T19:18:24.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.773+0000 7f321f7fe640 1 -- 172.21.15.45:0/2779951179 >> v2:172.21.15.79:3300/0 conn(0x7f3220156710 msgr2=0x7f3220156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:24.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.773+0000 7f321f7fe640 1 --2- 172.21.15.45:0/2779951179 >> v2:172.21.15.79:3300/0 conn(0x7f3220156710 0x7f3220156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:24.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.773+0000 7f321f7fe640 1 -- 172.21.15.45:0/2779951179 >> v1:172.21.15.45:6789/0 conn(0x7f322006c3d0 legacy=0x7f32200a1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:24.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.773+0000 7f321f7fe640 1 -- 172.21.15.45:0/2779951179 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322006d1f0 con 0x7f3220150340 2023-10-03T19:18:24.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.777+0000 7f321f7fe640 1 --2- 172.21.15.45:0/2779951179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3220150340 0x7f3220153660 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f322006afd0 tx=0x7f321001ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fcc5f3985d0001a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:24.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.777+0000 7f321e7fc640 1 -- 172.21.15.45:0/2779951179 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32100a8950 con 0x7f3220150340 2023-10-03T19:18:24.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.777+0000 7f321e7fc640 1 -- 172.21.15.45:0/2779951179 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32100a8ab0 con 0x7f3220150340 2023-10-03T19:18:24.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.777+0000 7f321e7fc640 1 -- 172.21.15.45:0/2779951179 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32100a8e40 con 0x7f3220150340 2023-10-03T19:18:24.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.777+0000 7f3225b64640 1 -- 172.21.15.45:0/2779951179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3220150340 msgr2=0x7f3220153660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:24.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.777+0000 7f3225b64640 1 --2- 172.21.15.45:0/2779951179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3220150340 0x7f3220153660 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f322006afd0 tx=0x7f321001ec50 comp rx=0 tx=0).stop 2023-10-03T19:18:24.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.777+0000 7f3225b64640 1 -- 172.21.15.45:0/2779951179 shutdown_connections 2023-10-03T19:18:24.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.777+0000 7f3225b64640 1 --2- 172.21.15.45:0/2779951179 >> v2:172.21.15.79:3300/0 conn(0x7f3220156710 0x7f3220156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:24.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.777+0000 7f3225b64640 1 --2- 172.21.15.45:0/2779951179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3220150340 0x7f3220153660 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:24.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.777+0000 7f3225b64640 1 -- 172.21.15.45:0/2779951179 >> 172.21.15.45:0/2779951179 conn(0x7f32200a20d0 msgr2=0x7f32200a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:24.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.777+0000 7f3225b64640 1 -- 172.21.15.45:0/2779951179 shutdown_connections 2023-10-03T19:18:24.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.777+0000 7f3225b64640 1 -- 172.21.15.45:0/2779951179 wait complete. 2023-10-03T19:18:24.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.777+0000 7f3225b64640 1 Processor -- start 2023-10-03T19:18:24.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.777+0000 7f3225b64640 1 -- start start 2023-10-03T19:18:24.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.781+0000 7f3225b64640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f322006c3d0 0x7f3220071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:24.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.781+0000 7f3225b64640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3220150340 0x7f32200bf090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:24.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.781+0000 7f3225b64640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3220156710 0x7f32201495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:24.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.781+0000 7f3225b64640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322014c6e0 con 0x7f322006c3d0 2023-10-03T19:18:24.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.781+0000 7f3225b64640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32201e8cf0 con 0x7f3220156710 2023-10-03T19:18:24.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.781+0000 7f3225b64640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32200bf5d0 con 0x7f3220150340 2023-10-03T19:18:24.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.781+0000 7f321f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f322006c3d0 0x7f3220071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:24.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.781+0000 7f321f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f322006c3d0 0x7f3220071180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43672/0 (socket says 172.21.15.45:43672) 2023-10-03T19:18:24.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.781+0000 7f321f7fe640 1 -- 172.21.15.45:0/2111188911 learned_addr learned my addr 172.21.15.45:0/2111188911 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:24.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.781+0000 7f321ffff640 1 --2- 172.21.15.45:0/2111188911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3220156710 0x7f32201495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:24.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.781+0000 7f321f7fe640 1 -- 172.21.15.45:0/2111188911 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3220150340 msgr2=0x7f32200bf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:24.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.781+0000 7f321effd640 1 --2- 172.21.15.45:0/2111188911 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3220150340 0x7f32200bf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:24.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.781+0000 7f321f7fe640 1 --2- 172.21.15.45:0/2111188911 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3220150340 0x7f32200bf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:24.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.781+0000 7f321f7fe640 1 -- 172.21.15.45:0/2111188911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3220156710 msgr2=0x7f32201495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:24.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.781+0000 7f321f7fe640 1 --2- 172.21.15.45:0/2111188911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3220156710 0x7f32201495e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:24.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.781+0000 7f321f7fe640 1 -- 172.21.15.45:0/2111188911 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3210009420 con 0x7f322006c3d0 2023-10-03T19:18:24.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.781+0000 7f321ffff640 1 --2- 172.21.15.45:0/2111188911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3220156710 0x7f32201495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:24.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.781+0000 7f321f7fe640 1 --2- 172.21.15.45:0/2111188911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f322006c3d0 0x7f3220071180 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f32100b3040 tx=0x7f321001b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:24.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.781+0000 7f3217fff640 1 -- 172.21.15.45:0/2111188911 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32100b0dd0 con 0x7f322006c3d0 2023-10-03T19:18:24.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.781+0000 7f3217fff640 1 -- 172.21.15.45:0/2111188911 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32100b9430 con 0x7f322006c3d0 2023-10-03T19:18:24.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.781+0000 7f3225b64640 1 -- 172.21.15.45:0/2111188911 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32200a1870 con 0x7f322006c3d0 2023-10-03T19:18:24.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.781+0000 7f3217fff640 1 -- 172.21.15.45:0/2111188911 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32100b97e0 con 0x7f322006c3d0 2023-10-03T19:18:24.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.781+0000 7f3225b64640 1 -- 172.21.15.45:0/2111188911 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f322006d490 con 0x7f322006c3d0 2023-10-03T19:18:24.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.781+0000 7f3225b64640 1 -- 172.21.15.45:0/2111188911 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f322006d770 con 0x7f322006c3d0 2023-10-03T19:18:24.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.781+0000 7f3217fff640 1 -- 172.21.15.45:0/2111188911 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f32100b7040 con 0x7f322006c3d0 2023-10-03T19:18:24.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.781+0000 7f3217fff640 1 --2- 172.21.15.45:0/2111188911 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3200066280 0x7f3200068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:24.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.781+0000 7f3217fff640 1 -- 172.21.15.45:0/2111188911 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f32101214b0 con 0x7f322006c3d0 2023-10-03T19:18:24.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.781+0000 7f321effd640 1 --2- 172.21.15.45:0/2111188911 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3200066280 0x7f3200068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:24.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.785+0000 7f321effd640 1 --2- 172.21.15.45:0/2111188911 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3200066280 0x7f3200068730 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3208001280 tx=0x7f3208009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:24.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.785+0000 7f3217fff640 1 -- 172.21.15.45:0/2111188911 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f32100eed10 con 0x7f322006c3d0 2023-10-03T19:18:24.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.941+0000 7f3225b64640 1 -- 172.21.15.45:0/2111188911 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f322004de80 con 0x7f322006c3d0 2023-10-03T19:18:24.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.941+0000 7f3217fff640 1 -- 172.21.15.45:0/2111188911 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f32100f2330 con 0x7f322006c3d0 2023-10-03T19:18:24.944 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:18:24.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.945+0000 7f3225b64640 1 -- 172.21.15.45:0/2111188911 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3200066280 msgr2=0x7f3200068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:24.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.945+0000 7f3225b64640 1 --2- 172.21.15.45:0/2111188911 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3200066280 0x7f3200068730 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3208001280 tx=0x7f3208009040 comp rx=0 tx=0).stop 2023-10-03T19:18:24.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.945+0000 7f3225b64640 1 -- 172.21.15.45:0/2111188911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f322006c3d0 msgr2=0x7f3220071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:24.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.945+0000 7f3225b64640 1 --2- 172.21.15.45:0/2111188911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f322006c3d0 0x7f3220071180 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f32100b3040 tx=0x7f321001b9f0 comp rx=0 tx=0).stop 2023-10-03T19:18:24.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.945+0000 7f3225b64640 1 -- 172.21.15.45:0/2111188911 shutdown_connections 2023-10-03T19:18:24.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.945+0000 7f3225b64640 1 --2- 172.21.15.45:0/2111188911 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3200066280 0x7f3200068730 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:24.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.945+0000 7f3225b64640 1 --2- 172.21.15.45:0/2111188911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3220156710 0x7f32201495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:24.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.945+0000 7f3225b64640 1 --2- 172.21.15.45:0/2111188911 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3220150340 0x7f32200bf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:24.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.945+0000 7f3225b64640 1 --2- 172.21.15.45:0/2111188911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f322006c3d0 0x7f3220071180 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:24.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.945+0000 7f3225b64640 1 -- 172.21.15.45:0/2111188911 >> 172.21.15.45:0/2111188911 conn(0x7f32200a20d0 msgr2=0x7f32200bb550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:24.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.945+0000 7f3225b64640 1 -- 172.21.15.45:0/2111188911 shutdown_connections 2023-10-03T19:18:24.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:24.945+0000 7f3225b64640 1 -- 172.21.15.45:0/2111188911 wait complete. 2023-10-03T19:18:24.963 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:18:25.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d95e9640 1 Processor -- start 2023-10-03T19:18:25.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d95e9640 1 -- start start 2023-10-03T19:18:25.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d95e9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f73d406d560 0x7f73d40a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:25.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d95e9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d406c2d0 con 0x7f73d406c760 2023-10-03T19:18:25.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d95e9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d4150610 con 0x7f73d40712c0 2023-10-03T19:18:25.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d95e9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d41508b0 con 0x7f73d406d560 2023-10-03T19:18:25.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d37fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f73d406c760 0x7f73d40a5900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54722/0 (socket says 172.21.15.45:54722) 2023-10-03T19:18:25.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d37fe640 1 -- 172.21.15.45:0/4118582900 learned_addr learned my addr 172.21.15.45:0/4118582900 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:18:25.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d27fc640 1 --2- 172.21.15.45:0/4118582900 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f73d406d560 0x7f73d40a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:25.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d1ffb640 1 -- 172.21.15.45:0/4118582900 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2237604777 0 0) 0x7f73d406c2d0 con 0x7f73d406c760 2023-10-03T19:18:25.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d1ffb640 1 -- 172.21.15.45:0/4118582900 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73bc003530 con 0x7f73d406c760 2023-10-03T19:18:25.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d1ffb640 1 -- 172.21.15.45:0/4118582900 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2914482056 0 0) 0x7f73bc003530 con 0x7f73d406c760 2023-10-03T19:18:25.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d1ffb640 1 -- 172.21.15.45:0/4118582900 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f73d406d560 msgr2=0x7f73d40a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:25.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d1ffb640 1 --2- 172.21.15.45:0/4118582900 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f73d406d560 0x7f73d40a53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:25.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d1ffb640 1 -- 172.21.15.45:0/4118582900 >> v1:172.21.15.79:6789/0 conn(0x7f73d40712c0 legacy=0x7f73d40bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:25.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d1ffb640 1 -- 172.21.15.45:0/4118582900 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d406d2e0 con 0x7f73d406c760 2023-10-03T19:18:25.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d1ffb640 1 -- 172.21.15.45:0/4118582900 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f73cc001a00 con 0x7f73d406c760 2023-10-03T19:18:25.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d1ffb640 1 -- 172.21.15.45:0/4118582900 >> v1:172.21.15.45:6789/0 conn(0x7f73d406c760 legacy=0x7f73d40a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:25.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d1ffb640 1 --2- 172.21.15.45:0/4118582900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73bc0039b0 0x7f73bc003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:25.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d1ffb640 1 --2- 172.21.15.45:0/4118582900 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f73d406d560 0x7f73bc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:25.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d1ffb640 1 --2- 172.21.15.45:0/4118582900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73bc004d10 0x7f73bc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:25.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d1ffb640 1 -- 172.21.15.45:0/4118582900 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d41508b0 con 0x7f73bc004d10 2023-10-03T19:18:25.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d1ffb640 1 -- 172.21.15.45:0/4118582900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc00b990 con 0x7f73bc0039b0 2023-10-03T19:18:25.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d1ffb640 1 -- 172.21.15.45:0/4118582900 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc00bb20 con 0x7f73d406d560 2023-10-03T19:18:25.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d37fe640 1 --2- 172.21.15.45:0/4118582900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73bc004d10 0x7f73bc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:25.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d2ffd640 1 --2- 172.21.15.45:0/4118582900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73bc0039b0 0x7f73bc003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:25.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d27fc640 1 --2- 172.21.15.45:0/4118582900 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f73d406d560 0x7f73bc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:25.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d37fe640 1 -- 172.21.15.45:0/4118582900 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f73d406d560 msgr2=0x7f73bc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:25.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d37fe640 1 --2- 172.21.15.45:0/4118582900 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f73d406d560 0x7f73bc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:25.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d37fe640 1 -- 172.21.15.45:0/4118582900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73bc0039b0 msgr2=0x7f73bc003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:25.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d37fe640 1 --2- 172.21.15.45:0/4118582900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73bc0039b0 0x7f73bc003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:25.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.093+0000 7f73d37fe640 1 -- 172.21.15.45:0/4118582900 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73bc003530 con 0x7f73bc004d10 2023-10-03T19:18:25.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.097+0000 7f73d37fe640 1 --2- 172.21.15.45:0/4118582900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73bc004d10 0x7f73bc005180 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f73d406cbc0 tx=0x7f73cc01fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82174e8287ebca35 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:25.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.097+0000 7f73d1ffb640 1 -- 172.21.15.45:0/4118582900 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc0aa690 con 0x7f73bc004d10 2023-10-03T19:18:25.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.097+0000 7f73d1ffb640 1 -- 172.21.15.45:0/4118582900 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73cc0aa810 con 0x7f73bc004d10 2023-10-03T19:18:25.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.097+0000 7f73d1ffb640 1 -- 172.21.15.45:0/4118582900 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc0aabc0 con 0x7f73bc004d10 2023-10-03T19:18:25.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.097+0000 7f73d95e9640 1 -- 172.21.15.45:0/4118582900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73bc004d10 msgr2=0x7f73bc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:25.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.097+0000 7f73d95e9640 1 --2- 172.21.15.45:0/4118582900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73bc004d10 0x7f73bc005180 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f73d406cbc0 tx=0x7f73cc01fa60 comp rx=0 tx=0).stop 2023-10-03T19:18:25.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.097+0000 7f73d37fe640 1 -- 172.21.15.45:0/4118582900 reap_dead start 2023-10-03T19:18:25.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.097+0000 7f73d95e9640 1 -- 172.21.15.45:0/4118582900 shutdown_connections 2023-10-03T19:18:25.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.097+0000 7f73d95e9640 1 -- 172.21.15.45:0/4118582900 >> 172.21.15.45:0/4118582900 conn(0x7f73d40a20d0 msgr2=0x7f73d40a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:25.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.097+0000 7f73d95e9640 1 -- 172.21.15.45:0/4118582900 shutdown_connections 2023-10-03T19:18:25.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.097+0000 7f73d95e9640 1 -- 172.21.15.45:0/4118582900 wait complete. 2023-10-03T19:18:25.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.097+0000 7f73d95e9640 1 Processor -- start 2023-10-03T19:18:25.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.097+0000 7f73d95e9640 1 -- start start 2023-10-03T19:18:25.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.101+0000 7f73d95e9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f73d414eab0 0x7f73d41e1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:25.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.101+0000 7f73d95e9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73d414caa0 0x7f73d41e5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:25.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.101+0000 7f73d95e9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73d41e5a70 0x7f73d41debf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:25.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.101+0000 7f73d95e9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d41e2850 con 0x7f73d414caa0 2023-10-03T19:18:25.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.101+0000 7f73d95e9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d41e4dc0 con 0x7f73d41e5a70 2023-10-03T19:18:25.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.101+0000 7f73d95e9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d4142170 con 0x7f73d414eab0 2023-10-03T19:18:25.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.101+0000 7f73d27fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73d414caa0 0x7f73d41e5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:25.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.101+0000 7f73d27fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73d414caa0 0x7f73d41e5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43688/0 (socket says 172.21.15.45:43688) 2023-10-03T19:18:25.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.101+0000 7f73d27fc640 1 -- 172.21.15.45:0/255621485 learned_addr learned my addr 172.21.15.45:0/255621485 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:25.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.101+0000 7f73d2ffd640 1 --2- 172.21.15.45:0/255621485 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f73d414eab0 0x7f73d41e1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:25.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.101+0000 7f73d27fc640 1 -- 172.21.15.45:0/255621485 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f73d414eab0 msgr2=0x7f73d41e1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:25.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.101+0000 7f73d27fc640 1 --2- 172.21.15.45:0/255621485 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f73d414eab0 0x7f73d41e1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:25.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.101+0000 7f73d37fe640 1 --2- 172.21.15.45:0/255621485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73d41e5a70 0x7f73d41debf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:25.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.101+0000 7f73d27fc640 1 -- 172.21.15.45:0/255621485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73d41e5a70 msgr2=0x7f73d41debf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:25.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.101+0000 7f73d27fc640 1 --2- 172.21.15.45:0/255621485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73d41e5a70 0x7f73d41debf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:25.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.101+0000 7f73d27fc640 1 -- 172.21.15.45:0/255621485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d406cf40 con 0x7f73d414caa0 2023-10-03T19:18:25.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.101+0000 7f73d37fe640 1 --2- 172.21.15.45:0/255621485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73d41e5a70 0x7f73d41debf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:25.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.101+0000 7f73d27fc640 1 --2- 172.21.15.45:0/255621485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73d414caa0 0x7f73d41e5530 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f73c80115e0 tx=0x7f73c8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:25.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.101+0000 7f73bb7fe640 1 -- 172.21.15.45:0/255621485 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c8015870 con 0x7f73d414caa0 2023-10-03T19:18:25.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.101+0000 7f73bb7fe640 1 -- 172.21.15.45:0/255621485 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c80159d0 con 0x7f73d414caa0 2023-10-03T19:18:25.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.101+0000 7f73d95e9640 1 -- 172.21.15.45:0/255621485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73d40a6010 con 0x7f73d414caa0 2023-10-03T19:18:25.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.101+0000 7f73bb7fe640 1 -- 172.21.15.45:0/255621485 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c8015d40 con 0x7f73d414caa0 2023-10-03T19:18:25.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.101+0000 7f73d95e9640 1 -- 172.21.15.45:0/255621485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d4071690 con 0x7f73d414caa0 2023-10-03T19:18:25.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.101+0000 7f73d95e9640 1 -- 172.21.15.45:0/255621485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73d404de80 con 0x7f73d414caa0 2023-10-03T19:18:25.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.101+0000 7f73bb7fe640 1 -- 172.21.15.45:0/255621485 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f73c800f480 con 0x7f73d414caa0 2023-10-03T19:18:25.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.101+0000 7f73bb7fe640 1 --2- 172.21.15.45:0/255621485 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f73c0066280 0x7f73c0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:25.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.101+0000 7f73bb7fe640 1 -- 172.21.15.45:0/255621485 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f73c80842e0 con 0x7f73d414caa0 2023-10-03T19:18:25.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.101+0000 7f73d2ffd640 1 --2- 172.21.15.45:0/255621485 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f73c0066280 0x7f73c0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:25.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.105+0000 7f73d2ffd640 1 --2- 172.21.15.45:0/255621485 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f73c0066280 0x7f73c0068730 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f73c4000c10 tx=0x7f73c4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:25.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.105+0000 7f73bb7fe640 1 -- 172.21.15.45:0/255621485 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f73c8055540 con 0x7f73d414caa0 2023-10-03T19:18:25.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.261+0000 7f73d95e9640 1 -- 172.21.15.45:0/255621485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f73d40bda00 con 0x7f73d414caa0 2023-10-03T19:18:25.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.261+0000 7f73bb7fe640 1 -- 172.21.15.45:0/255621485 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v81) v1 ==== 92+0+10 (secure 0 0 0) 0x7f73c80550d0 con 0x7f73d414caa0 2023-10-03T19:18:25.266 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:18:25.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.265+0000 7f73d95e9640 1 -- 172.21.15.45:0/255621485 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f73c0066280 msgr2=0x7f73c0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:25.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.265+0000 7f73d95e9640 1 --2- 172.21.15.45:0/255621485 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f73c0066280 0x7f73c0068730 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f73c4000c10 tx=0x7f73c4009040 comp rx=0 tx=0).stop 2023-10-03T19:18:25.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.265+0000 7f73d95e9640 1 -- 172.21.15.45:0/255621485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73d414caa0 msgr2=0x7f73d41e5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:25.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.265+0000 7f73d95e9640 1 --2- 172.21.15.45:0/255621485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73d414caa0 0x7f73d41e5530 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f73c80115e0 tx=0x7f73c8011aa0 comp rx=0 tx=0).stop 2023-10-03T19:18:25.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.265+0000 7f73d95e9640 1 -- 172.21.15.45:0/255621485 shutdown_connections 2023-10-03T19:18:25.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.265+0000 7f73d95e9640 1 --2- 172.21.15.45:0/255621485 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f73c0066280 0x7f73c0068730 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:25.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.265+0000 7f73d95e9640 1 --2- 172.21.15.45:0/255621485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73d41e5a70 0x7f73d41debf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:25.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.265+0000 7f73d95e9640 1 --2- 172.21.15.45:0/255621485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73d414caa0 0x7f73d41e5530 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:25.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.265+0000 7f73d95e9640 1 --2- 172.21.15.45:0/255621485 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f73d414eab0 0x7f73d41e1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:25.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.265+0000 7f73d95e9640 1 -- 172.21.15.45:0/255621485 >> 172.21.15.45:0/255621485 conn(0x7f73d40a20d0 msgr2=0x7f73d40bfa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:25.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.265+0000 7f73d95e9640 1 -- 172.21.15.45:0/255621485 shutdown_connections 2023-10-03T19:18:25.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.265+0000 7f73d95e9640 1 -- 172.21.15.45:0/255621485 wait complete. 2023-10-03T19:18:25.285 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-03T19:18:25.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.401+0000 7f98a6438640 1 Processor -- start 2023-10-03T19:18:25.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.401+0000 7f98a6438640 1 -- start start 2023-10-03T19:18:25.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.401+0000 7f98a6438640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f98a006f170 0x7f98a0150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:25.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.401+0000 7f98a6438640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f98a00bc8b0 0x7f98a014ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:25.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.401+0000 7f98a6438640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98a006cac0 con 0x7f98a006d170 2023-10-03T19:18:25.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.401+0000 7f98a6438640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a00720d0 con 0x7f98a006f170 2023-10-03T19:18:25.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.401+0000 7f98a6438640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a00a5ab0 con 0x7f98a00bc8b0 2023-10-03T19:18:25.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.401+0000 7f989ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f98a006f170 0x7f98a0150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:25.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.401+0000 7f98a49d5640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f98a006d170 0x7f98a014cfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54724/0 (socket says 172.21.15.45:54724) 2023-10-03T19:18:25.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.401+0000 7f98a49d5640 1 -- 172.21.15.45:0/1737969435 learned_addr learned my addr 172.21.15.45:0/1737969435 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:18:25.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.401+0000 7f989f7fe640 1 --2- 172.21.15.45:0/1737969435 >> v2:172.21.15.79:3300/0 conn(0x7f98a00bc8b0 0x7f98a014ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:25.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.401+0000 7f989ffff640 1 -- 172.21.15.45:0/1737969435 >> v2:172.21.15.79:3300/0 conn(0x7f98a00bc8b0 msgr2=0x7f98a014ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:25.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.401+0000 7f989ffff640 1 --2- 172.21.15.45:0/1737969435 >> v2:172.21.15.79:3300/0 conn(0x7f98a00bc8b0 0x7f98a014ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:25.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.401+0000 7f989ffff640 1 -- 172.21.15.45:0/1737969435 >> v1:172.21.15.45:6789/0 conn(0x7f98a006d170 legacy=0x7f98a014cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:25.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.401+0000 7f989effd640 1 -- 172.21.15.45:0/1737969435 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276348825 0 0) 0x7f98980014a0 con 0x7f98a006d170 2023-10-03T19:18:25.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.401+0000 7f989ffff640 1 -- 172.21.15.45:0/1737969435 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a006cd00 con 0x7f98a006f170 2023-10-03T19:18:25.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.405+0000 7f989ffff640 1 --2- 172.21.15.45:0/1737969435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98a006f170 0x7f98a0150190 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f98a006e9c0 tx=0x7f989401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9bdb7e505f8e17 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:25.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.405+0000 7f989effd640 1 -- 172.21.15.45:0/1737969435 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98940ab600 con 0x7f98a006f170 2023-10-03T19:18:25.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.405+0000 7f989effd640 1 -- 172.21.15.45:0/1737969435 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98940a7050 con 0x7f98a006f170 2023-10-03T19:18:25.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.405+0000 7f989effd640 1 -- 172.21.15.45:0/1737969435 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98940ab980 con 0x7f98a006f170 2023-10-03T19:18:25.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.405+0000 7f98a6438640 1 -- 172.21.15.45:0/1737969435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98a006f170 msgr2=0x7f98a0150190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:25.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.405+0000 7f98a6438640 1 --2- 172.21.15.45:0/1737969435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98a006f170 0x7f98a0150190 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f98a006e9c0 tx=0x7f989401c420 comp rx=0 tx=0).stop 2023-10-03T19:18:25.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.405+0000 7f98a6438640 1 -- 172.21.15.45:0/1737969435 shutdown_connections 2023-10-03T19:18:25.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.405+0000 7f98a6438640 1 --2- 172.21.15.45:0/1737969435 >> v2:172.21.15.79:3300/0 conn(0x7f98a00bc8b0 0x7f98a014ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:25.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.405+0000 7f98a6438640 1 --2- 172.21.15.45:0/1737969435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98a006f170 0x7f98a0150190 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:25.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.405+0000 7f98a6438640 1 -- 172.21.15.45:0/1737969435 >> 172.21.15.45:0/1737969435 conn(0x7f98a00bcf50 msgr2=0x7f98a00bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:25.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.405+0000 7f98a6438640 1 -- 172.21.15.45:0/1737969435 shutdown_connections 2023-10-03T19:18:25.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.405+0000 7f98a6438640 1 -- 172.21.15.45:0/1737969435 wait complete. 2023-10-03T19:18:25.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.409+0000 7f98a6438640 1 Processor -- start 2023-10-03T19:18:25.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.409+0000 7f98a6438640 1 -- start start 2023-10-03T19:18:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.409+0000 7f98a6438640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98a006d170 0x7f98a01e49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.409+0000 7f98a6438640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98a006f170 0x7f98a0151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.409+0000 7f98a6438640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98a00bc8b0 0x7f98a01e5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.409+0000 7f98a6438640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a00b99c0 con 0x7f98a006f170 2023-10-03T19:18:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.409+0000 7f98a6438640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a00bfa60 con 0x7f98a00bc8b0 2023-10-03T19:18:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.409+0000 7f98a6438640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a01e8170 con 0x7f98a006d170 2023-10-03T19:18:25.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.409+0000 7f989f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98a006f170 0x7f98a0151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:25.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.409+0000 7f989f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98a006f170 0x7f98a0151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43712/0 (socket says 172.21.15.45:43712) 2023-10-03T19:18:25.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.409+0000 7f989f7fe640 1 -- 172.21.15.45:0/2834292623 learned_addr learned my addr 172.21.15.45:0/2834292623 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:25.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.409+0000 7f989ffff640 1 --2- 172.21.15.45:0/2834292623 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98a006d170 0x7f98a01e49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:25.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.409+0000 7f98a49d5640 1 --2- 172.21.15.45:0/2834292623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98a00bc8b0 0x7f98a01e5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:25.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.409+0000 7f989f7fe640 1 -- 172.21.15.45:0/2834292623 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98a006d170 msgr2=0x7f98a01e49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:25.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.409+0000 7f989f7fe640 1 --2- 172.21.15.45:0/2834292623 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98a006d170 0x7f98a01e49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:25.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.409+0000 7f989f7fe640 1 -- 172.21.15.45:0/2834292623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98a00bc8b0 msgr2=0x7f98a01e5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:25.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.409+0000 7f989f7fe640 1 --2- 172.21.15.45:0/2834292623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98a00bc8b0 0x7f98a01e5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:25.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.409+0000 7f989f7fe640 1 -- 172.21.15.45:0/2834292623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9894009420 con 0x7f98a006f170 2023-10-03T19:18:25.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.409+0000 7f989f7fe640 1 --2- 172.21.15.45:0/2834292623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98a006f170 0x7f98a0151c20 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f989000d800 tx=0x7f989000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:25.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.409+0000 7f989cff9640 1 -- 172.21.15.45:0/2834292623 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989000b660 con 0x7f98a006f170 2023-10-03T19:18:25.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.409+0000 7f989cff9640 1 -- 172.21.15.45:0/2834292623 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989000b7c0 con 0x7f98a006f170 2023-10-03T19:18:25.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.409+0000 7f989cff9640 1 -- 172.21.15.45:0/2834292623 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989000bb30 con 0x7f98a006f170 2023-10-03T19:18:25.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.409+0000 7f98a6438640 1 -- 172.21.15.45:0/2834292623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a006f6d0 con 0x7f98a006f170 2023-10-03T19:18:25.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.409+0000 7f98a6438640 1 -- 172.21.15.45:0/2834292623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a006f540 con 0x7f98a006f170 2023-10-03T19:18:25.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.409+0000 7f98a6438640 1 -- 172.21.15.45:0/2834292623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a0159670 con 0x7f98a006f170 2023-10-03T19:18:25.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.413+0000 7f989cff9640 1 -- 172.21.15.45:0/2834292623 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f989000bc90 con 0x7f98a006f170 2023-10-03T19:18:25.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.413+0000 7f989cff9640 1 --2- 172.21.15.45:0/2834292623 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f988c066280 0x7f988c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:25.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.413+0000 7f989cff9640 1 -- 172.21.15.45:0/2834292623 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9890084040 con 0x7f98a006f170 2023-10-03T19:18:25.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.413+0000 7f989ffff640 1 --2- 172.21.15.45:0/2834292623 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f988c066280 0x7f988c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:25.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.413+0000 7f989ffff640 1 --2- 172.21.15.45:0/2834292623 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f988c066280 0x7f988c068730 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f98940ad000 tx=0x7f9894008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:25.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.417+0000 7f989cff9640 1 -- 172.21.15.45:0/2834292623 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9890051780 con 0x7f98a006f170 2023-10-03T19:18:25.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.573+0000 7f98a6438640 1 -- 172.21.15.45:0/2834292623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f98a006d660 con 0x7f98a006f170 2023-10-03T19:18:25.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.573+0000 7f989cff9640 1 -- 172.21.15.45:0/2834292623 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) v1 ==== 84+0+126 (secure 0 0 0) 0x7f9890054da0 con 0x7f98a006f170 2023-10-03T19:18:25.578 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:18:25.578 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-10-03T19:18:25.578 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:18:25.578 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-10-03T19:18:25.578 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-10-03T19:18:25.578 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:18:25.578 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:18:25.578 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 2, 2023-10-03T19:18:25.578 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "rbd" 2023-10-03T19:18:25.578 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:18:25.578 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-10-03T19:18:25.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.577+0000 7f98a6438640 1 -- 172.21.15.45:0/2834292623 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f988c066280 msgr2=0x7f988c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:25.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.577+0000 7f98a6438640 1 --2- 172.21.15.45:0/2834292623 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f988c066280 0x7f988c068730 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f98940ad000 tx=0x7f9894008040 comp rx=0 tx=0).stop 2023-10-03T19:18:25.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.577+0000 7f98a6438640 1 -- 172.21.15.45:0/2834292623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98a006f170 msgr2=0x7f98a0151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:25.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.577+0000 7f98a6438640 1 --2- 172.21.15.45:0/2834292623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98a006f170 0x7f98a0151c20 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f989000d800 tx=0x7f989000dcc0 comp rx=0 tx=0).stop 2023-10-03T19:18:25.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.577+0000 7f98a6438640 1 -- 172.21.15.45:0/2834292623 shutdown_connections 2023-10-03T19:18:25.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.577+0000 7f98a6438640 1 --2- 172.21.15.45:0/2834292623 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f988c066280 0x7f988c068730 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:25.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.577+0000 7f98a6438640 1 --2- 172.21.15.45:0/2834292623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98a00bc8b0 0x7f98a01e5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:25.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.577+0000 7f98a6438640 1 --2- 172.21.15.45:0/2834292623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98a006f170 0x7f98a0151c20 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:25.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.577+0000 7f98a6438640 1 --2- 172.21.15.45:0/2834292623 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98a006d170 0x7f98a01e49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:25.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.577+0000 7f98a6438640 1 -- 172.21.15.45:0/2834292623 >> 172.21.15.45:0/2834292623 conn(0x7f98a00bcf50 msgr2=0x7f98a00c0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:25.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.577+0000 7f98a6438640 1 -- 172.21.15.45:0/2834292623 shutdown_connections 2023-10-03T19:18:25.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.577+0000 7f98a6438640 1 -- 172.21.15.45:0/2834292623 wait complete. 2023-10-03T19:18:25.596 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-03T19:18:25.596 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-03T19:18:25.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.725+0000 7f0abfc58640 1 Processor -- start 2023-10-03T19:18:25.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.725+0000 7f0abfc58640 1 -- start start 2023-10-03T19:18:25.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.725+0000 7f0abfc58640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ab80c14e0 0x7f0ab80c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:25.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.725+0000 7f0abfc58640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0ab80c2770 0x7f0ab80a9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:25.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.725+0000 7f0abfc58640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab806ac70 con 0x7f0ab80bf1f0 2023-10-03T19:18:25.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.725+0000 7f0abfc58640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab806aae0 con 0x7f0ab80c2770 2023-10-03T19:18:25.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.725+0000 7f0abfc58640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab80c3000 con 0x7f0ab80c14e0 2023-10-03T19:18:25.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.725+0000 7f0abe1f5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0ab80c2770 0x7f0ab80a9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:25.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.725+0000 7f0abd9f4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ab80c14e0 0x7f0ab80c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:25.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.725+0000 7f0abe1f5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0ab80c2770 0x7f0ab80a9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:51492/0 (socket says 172.21.15.45:51492) 2023-10-03T19:18:25.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.725+0000 7f0abe1f5640 1 -- 172.21.15.45:0/2550487980 learned_addr learned my addr 172.21.15.45:0/2550487980 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:25.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.725+0000 7f0abe1f5640 1 -- 172.21.15.45:0/2550487980 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ab80c14e0 msgr2=0x7f0ab80c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:25.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.725+0000 7f0abe1f5640 1 --2- 172.21.15.45:0/2550487980 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ab80c14e0 0x7f0ab80c0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:25.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.725+0000 7f0abe1f5640 1 -- 172.21.15.45:0/2550487980 >> v1:172.21.15.79:6789/0 conn(0x7f0ab80bf1f0 legacy=0x7f0ab80a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:25.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.725+0000 7f0abe1f5640 1 -- 172.21.15.45:0/2550487980 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab80aa5f0 con 0x7f0ab80c2770 2023-10-03T19:18:25.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.729+0000 7f0abe1f5640 1 --2- 172.21.15.45:0/2550487980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ab80c2770 0x7f0ab80a9f70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0009870 tx=0x7f0ab001ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=813280f3b09830f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:25.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.729+0000 7f0abc9f2640 1 -- 172.21.15.45:0/2550487980 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab00a8a30 con 0x7f0ab80c2770 2023-10-03T19:18:25.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.729+0000 7f0abc9f2640 1 -- 172.21.15.45:0/2550487980 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab00a8b90 con 0x7f0ab80c2770 2023-10-03T19:18:25.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.729+0000 7f0abc9f2640 1 -- 172.21.15.45:0/2550487980 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab00b0440 con 0x7f0ab80c2770 2023-10-03T19:18:25.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.729+0000 7f0abfc58640 1 -- 172.21.15.45:0/2550487980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ab80c2770 msgr2=0x7f0ab80a9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:25.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.729+0000 7f0abfc58640 1 --2- 172.21.15.45:0/2550487980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ab80c2770 0x7f0ab80a9f70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0009870 tx=0x7f0ab001ed30 comp rx=0 tx=0).stop 2023-10-03T19:18:25.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.729+0000 7f0abfc58640 1 -- 172.21.15.45:0/2550487980 shutdown_connections 2023-10-03T19:18:25.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.729+0000 7f0abfc58640 1 --2- 172.21.15.45:0/2550487980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ab80c2770 0x7f0ab80a9f70 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:25.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.729+0000 7f0abfc58640 1 --2- 172.21.15.45:0/2550487980 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ab80c14e0 0x7f0ab80c0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:25.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.729+0000 7f0abfc58640 1 -- 172.21.15.45:0/2550487980 >> 172.21.15.45:0/2550487980 conn(0x7f0ab80a6440 msgr2=0x7f0ab80a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:25.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.729+0000 7f0abfc58640 1 -- 172.21.15.45:0/2550487980 shutdown_connections 2023-10-03T19:18:25.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.729+0000 7f0abfc58640 1 -- 172.21.15.45:0/2550487980 wait complete. 2023-10-03T19:18:25.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.729+0000 7f0abfc58640 1 Processor -- start 2023-10-03T19:18:25.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.729+0000 7f0abfc58640 1 -- start start 2023-10-03T19:18:25.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.733+0000 7f0abfc58640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ab80bf1f0 0x7f0ab80bdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:25.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.733+0000 7f0abfc58640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ab80c14e0 0x7f0ab81e5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:25.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.733+0000 7f0abfc58640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ab80c2770 0x7f0ab81e5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:25.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.733+0000 7f0abfc58640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab80a5170 con 0x7f0ab80bf1f0 2023-10-03T19:18:25.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.733+0000 7f0abfc58640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab80a9990 con 0x7f0ab80c2770 2023-10-03T19:18:25.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.733+0000 7f0abfc58640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab81d5a00 con 0x7f0ab80c14e0 2023-10-03T19:18:25.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.733+0000 7f0abd9f4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ab80bf1f0 0x7f0ab80bdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:25.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.733+0000 7f0abd9f4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ab80bf1f0 0x7f0ab80bdce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43714/0 (socket says 172.21.15.45:43714) 2023-10-03T19:18:25.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.733+0000 7f0abd9f4640 1 -- 172.21.15.45:0/3325119943 learned_addr learned my addr 172.21.15.45:0/3325119943 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:25.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.733+0000 7f0abd1f3640 1 --2- 172.21.15.45:0/3325119943 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ab80c14e0 0x7f0ab81e5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:25.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.733+0000 7f0abe1f5640 1 --2- 172.21.15.45:0/3325119943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ab80c2770 0x7f0ab81e5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:25.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.733+0000 7f0abd9f4640 1 -- 172.21.15.45:0/3325119943 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ab80c14e0 msgr2=0x7f0ab81e5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:25.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.733+0000 7f0abd9f4640 1 --2- 172.21.15.45:0/3325119943 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ab80c14e0 0x7f0ab81e5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:25.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.733+0000 7f0abd9f4640 1 -- 172.21.15.45:0/3325119943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ab80c2770 msgr2=0x7f0ab81e5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:25.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.733+0000 7f0abd9f4640 1 --2- 172.21.15.45:0/3325119943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ab80c2770 0x7f0ab81e5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:25.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.733+0000 7f0abd9f4640 1 -- 172.21.15.45:0/3325119943 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab00094d0 con 0x7f0ab80bf1f0 2023-10-03T19:18:25.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.733+0000 7f0abd9f4640 1 --2- 172.21.15.45:0/3325119943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ab80bf1f0 0x7f0ab80bdce0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400e930 tx=0x7f0ab400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:25.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.733+0000 7f0aaa7fc640 1 -- 172.21.15.45:0/3325119943 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4009690 con 0x7f0ab80bf1f0 2023-10-03T19:18:25.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.733+0000 7f0aaa7fc640 1 -- 172.21.15.45:0/3325119943 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab400ca00 con 0x7f0ab80bf1f0 2023-10-03T19:18:25.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.733+0000 7f0aaa7fc640 1 -- 172.21.15.45:0/3325119943 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab400cd70 con 0x7f0ab80bf1f0 2023-10-03T19:18:25.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.733+0000 7f0abfc58640 1 -- 172.21.15.45:0/3325119943 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab814f530 con 0x7f0ab80bf1f0 2023-10-03T19:18:25.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.733+0000 7f0abfc58640 1 -- 172.21.15.45:0/3325119943 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab814f250 con 0x7f0ab80bf1f0 2023-10-03T19:18:25.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.733+0000 7f0abfc58640 1 -- 172.21.15.45:0/3325119943 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ab806b100 con 0x7f0ab80bf1f0 2023-10-03T19:18:25.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.733+0000 7f0aaa7fc640 1 -- 172.21.15.45:0/3325119943 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0ab4013470 con 0x7f0ab80bf1f0 2023-10-03T19:18:25.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.733+0000 7f0aaa7fc640 1 --2- 172.21.15.45:0/3325119943 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0a9c066280 0x7f0a9c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:25.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.733+0000 7f0aaa7fc640 1 -- 172.21.15.45:0/3325119943 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0ab4083b80 con 0x7f0ab80bf1f0 2023-10-03T19:18:25.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.733+0000 7f0abd1f3640 1 --2- 172.21.15.45:0/3325119943 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0a9c066280 0x7f0a9c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:25.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.737+0000 7f0abd1f3640 1 --2- 172.21.15.45:0/3325119943 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0a9c066280 0x7f0a9c068730 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0ab81db8f0 tx=0x7f0aac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:25.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.741+0000 7f0aaa7fc640 1 -- 172.21.15.45:0/3325119943 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0ab40514c0 con 0x7f0ab80bf1f0 2023-10-03T19:18:25.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:25.897+0000 7f0abfc58640 1 -- 172.21.15.45:0/3325119943 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0ab804de80 con 0x7f0ab80bf1f0 2023-10-03T19:18:26.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:26.865+0000 7f0aaa7fc640 1 -- 172.21.15.45:0/3325119943 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0ab40170b0 con 0x7f0ab80bf1f0 2023-10-03T19:18:26.868 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-10-03T19:18:26.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:26.869+0000 7f0abfc58640 1 -- 172.21.15.45:0/3325119943 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0a9c066280 msgr2=0x7f0a9c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:26.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:26.869+0000 7f0abfc58640 1 --2- 172.21.15.45:0/3325119943 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0a9c066280 0x7f0a9c068730 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0ab81db8f0 tx=0x7f0aac009040 comp rx=0 tx=0).stop 2023-10-03T19:18:26.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:26.869+0000 7f0abfc58640 1 -- 172.21.15.45:0/3325119943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ab80bf1f0 msgr2=0x7f0ab80bdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:26.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:26.869+0000 7f0abfc58640 1 --2- 172.21.15.45:0/3325119943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ab80bf1f0 0x7f0ab80bdce0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400e930 tx=0x7f0ab400edf0 comp rx=0 tx=0).stop 2023-10-03T19:18:26.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:26.869+0000 7f0abfc58640 1 -- 172.21.15.45:0/3325119943 shutdown_connections 2023-10-03T19:18:26.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:26.869+0000 7f0abfc58640 1 --2- 172.21.15.45:0/3325119943 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0a9c066280 0x7f0a9c068730 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:26.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:26.869+0000 7f0abfc58640 1 --2- 172.21.15.45:0/3325119943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ab80c2770 0x7f0ab81e5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:26.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:26.869+0000 7f0abfc58640 1 --2- 172.21.15.45:0/3325119943 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ab80c14e0 0x7f0ab81e5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:26.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:26.869+0000 7f0abfc58640 1 --2- 172.21.15.45:0/3325119943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ab80bf1f0 0x7f0ab80bdce0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:26.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:26.869+0000 7f0abfc58640 1 -- 172.21.15.45:0/3325119943 >> 172.21.15.45:0/3325119943 conn(0x7f0ab80a6440 msgr2=0x7f0ab80a5470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:26.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:26.869+0000 7f0abfc58640 1 -- 172.21.15.45:0/3325119943 shutdown_connections 2023-10-03T19:18:26.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:26.869+0000 7f0abfc58640 1 -- 172.21.15.45:0/3325119943 wait complete. 2023-10-03T19:18:26.896 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-03T19:18:27.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.029+0000 7f7087f63640 1 Processor -- start 2023-10-03T19:18:27.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.029+0000 7f7087f63640 1 -- start start 2023-10-03T19:18:27.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.029+0000 7f7087f63640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7080149fb0 0x7f708014fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:27.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.029+0000 7f7087f63640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f70800bd4a0 0x7f70800b7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:27.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.029+0000 7f7087f63640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70800bfa10 con 0x7f70800a4f40 2023-10-03T19:18:27.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.029+0000 7f7087f63640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70800c0000 con 0x7f70800bd4a0 2023-10-03T19:18:27.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.029+0000 7f7087f63640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70800b8fc0 con 0x7f7080149fb0 2023-10-03T19:18:27.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.029+0000 7f7086500640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f70800bd4a0 0x7f70800b7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:27.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.029+0000 7f7086500640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f70800bd4a0 0x7f70800b7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43720/0 (socket says 172.21.15.45:43720) 2023-10-03T19:18:27.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.029+0000 7f7086500640 1 -- 172.21.15.45:0/3645761457 learned_addr learned my addr 172.21.15.45:0/3645761457 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:27.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.029+0000 7f7085cff640 1 --2- 172.21.15.45:0/3645761457 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7080149fb0 0x7f708014fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:27.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.029+0000 7f7086500640 1 -- 172.21.15.45:0/3645761457 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7080149fb0 msgr2=0x7f708014fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:27.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.029+0000 7f7086500640 1 --2- 172.21.15.45:0/3645761457 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7080149fb0 0x7f708014fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:27.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.029+0000 7f7086500640 1 -- 172.21.15.45:0/3645761457 >> v1:172.21.15.79:6789/0 conn(0x7f70800a4f40 legacy=0x7f70800bf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:27.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.029+0000 7f7086500640 1 -- 172.21.15.45:0/3645761457 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70800be980 con 0x7f70800bd4a0 2023-10-03T19:18:27.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.033+0000 7f7086500640 1 --2- 172.21.15.45:0/3645761457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70800bd4a0 0x7f70800b7490 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f707c009870 tx=0x7f707c01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d1eedcd1ec3505 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:27.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.033+0000 7f7084cfd640 1 -- 172.21.15.45:0/3645761457 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c0a8a30 con 0x7f70800bd4a0 2023-10-03T19:18:27.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.033+0000 7f7084cfd640 1 -- 172.21.15.45:0/3645761457 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707c0a8b90 con 0x7f70800bd4a0 2023-10-03T19:18:27.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.033+0000 7f7084cfd640 1 -- 172.21.15.45:0/3645761457 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c0b0440 con 0x7f70800bd4a0 2023-10-03T19:18:27.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.033+0000 7f7087f63640 1 -- 172.21.15.45:0/3645761457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70800bd4a0 msgr2=0x7f70800b7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:27.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.033+0000 7f7087f63640 1 --2- 172.21.15.45:0/3645761457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70800bd4a0 0x7f70800b7490 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f707c009870 tx=0x7f707c01ed30 comp rx=0 tx=0).stop 2023-10-03T19:18:27.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.033+0000 7f7087f63640 1 -- 172.21.15.45:0/3645761457 shutdown_connections 2023-10-03T19:18:27.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.033+0000 7f7087f63640 1 --2- 172.21.15.45:0/3645761457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70800bd4a0 0x7f70800b7490 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:27.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.033+0000 7f7087f63640 1 --2- 172.21.15.45:0/3645761457 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7080149fb0 0x7f708014fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:27.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.033+0000 7f7087f63640 1 -- 172.21.15.45:0/3645761457 >> 172.21.15.45:0/3645761457 conn(0x7f7080071060 msgr2=0x7f7080071430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:27.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.033+0000 7f7087f63640 1 -- 172.21.15.45:0/3645761457 shutdown_connections 2023-10-03T19:18:27.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.033+0000 7f7087f63640 1 -- 172.21.15.45:0/3645761457 wait complete. 2023-10-03T19:18:27.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.033+0000 7f7087f63640 1 Processor -- start 2023-10-03T19:18:27.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.033+0000 7f7087f63640 1 -- start start 2023-10-03T19:18:27.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.033+0000 7f7087f63640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70800a4f40 0x7f70801490f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:27.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.033+0000 7f7087f63640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70800bd4a0 0x7f708014caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:27.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.033+0000 7f7087f63640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7080149fb0 0x7f70800a4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:27.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.033+0000 7f7087f63640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70800a8080 con 0x7f70800a4f40 2023-10-03T19:18:27.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.033+0000 7f7087f63640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70801e4a00 con 0x7f70800bd4a0 2023-10-03T19:18:27.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.033+0000 7f7087f63640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70800a72c0 con 0x7f7080149fb0 2023-10-03T19:18:27.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.037+0000 7f7085cff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70800a4f40 0x7f70801490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:27.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.037+0000 7f7085cff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70800a4f40 0x7f70801490f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43734/0 (socket says 172.21.15.45:43734) 2023-10-03T19:18:27.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.037+0000 7f7085cff640 1 -- 172.21.15.45:0/2781968238 learned_addr learned my addr 172.21.15.45:0/2781968238 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:27.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.037+0000 7f70854fe640 1 --2- 172.21.15.45:0/2781968238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70800bd4a0 0x7f708014caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:27.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.037+0000 7f7086500640 1 --2- 172.21.15.45:0/2781968238 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7080149fb0 0x7f70800a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:27.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.037+0000 7f7085cff640 1 -- 172.21.15.45:0/2781968238 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7080149fb0 msgr2=0x7f70800a4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:27.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.037+0000 7f7085cff640 1 --2- 172.21.15.45:0/2781968238 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7080149fb0 0x7f70800a4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:27.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.037+0000 7f7085cff640 1 -- 172.21.15.45:0/2781968238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70800bd4a0 msgr2=0x7f708014caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:27.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.037+0000 7f7085cff640 1 --2- 172.21.15.45:0/2781968238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70800bd4a0 0x7f708014caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:27.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.037+0000 7f7085cff640 1 -- 172.21.15.45:0/2781968238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f707c0094d0 con 0x7f70800a4f40 2023-10-03T19:18:27.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.037+0000 7f7086500640 1 --2- 172.21.15.45:0/2781968238 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7080149fb0 0x7f70800a4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:27.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.037+0000 7f70854fe640 1 --2- 172.21.15.45:0/2781968238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70800bd4a0 0x7f708014caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:18:27.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.037+0000 7f7085cff640 1 --2- 172.21.15.45:0/2781968238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70800a4f40 0x7f70801490f0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f7078009fc0 tx=0x7f707800e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:27.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.037+0000 7f70767fc640 1 -- 172.21.15.45:0/2781968238 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7078014620 con 0x7f70800a4f40 2023-10-03T19:18:27.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.037+0000 7f70767fc640 1 -- 172.21.15.45:0/2781968238 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7078014780 con 0x7f70800a4f40 2023-10-03T19:18:27.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.037+0000 7f7087f63640 1 -- 172.21.15.45:0/2781968238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70800bcf90 con 0x7f70800a4f40 2023-10-03T19:18:27.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.037+0000 7f70767fc640 1 -- 172.21.15.45:0/2781968238 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7078014b30 con 0x7f70800a4f40 2023-10-03T19:18:27.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.037+0000 7f7087f63640 1 -- 172.21.15.45:0/2781968238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70800b9230 con 0x7f70800a4f40 2023-10-03T19:18:27.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.037+0000 7f7087f63640 1 -- 172.21.15.45:0/2781968238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70800b79d0 con 0x7f70800a4f40 2023-10-03T19:18:27.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.037+0000 7f70767fc640 1 -- 172.21.15.45:0/2781968238 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7078006d50 con 0x7f70800a4f40 2023-10-03T19:18:27.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.037+0000 7f70767fc640 1 --2- 172.21.15.45:0/2781968238 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7064066280 0x7f7064068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:27.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.037+0000 7f70767fc640 1 -- 172.21.15.45:0/2781968238 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f7078084340 con 0x7f70800a4f40 2023-10-03T19:18:27.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.037+0000 7f70854fe640 1 --2- 172.21.15.45:0/2781968238 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7064066280 0x7f7064068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:27.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.041+0000 7f70854fe640 1 --2- 172.21.15.45:0/2781968238 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7064066280 0x7f7064068730 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f70801473d0 tx=0x7f7070009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:27.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.041+0000 7f70767fc640 1 -- 172.21.15.45:0/2781968238 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7078051990 con 0x7f70800a4f40 2023-10-03T19:18:27.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.197+0000 7f7087f63640 1 -- 172.21.15.45:0/2781968238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f708006f770 con 0x7f70800a4f40 2023-10-03T19:18:27.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.877+0000 7f70767fc640 1 -- 172.21.15.45:0/2781968238 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v83) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7078054fb0 con 0x7f70800a4f40 2023-10-03T19:18:27.887 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-10-03T19:18:27.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.901+0000 7f7087f63640 1 -- 172.21.15.45:0/2781968238 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7064066280 msgr2=0x7f7064068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:27.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.901+0000 7f7087f63640 1 --2- 172.21.15.45:0/2781968238 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7064066280 0x7f7064068730 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f70801473d0 tx=0x7f7070009040 comp rx=0 tx=0).stop 2023-10-03T19:18:27.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.901+0000 7f7087f63640 1 -- 172.21.15.45:0/2781968238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70800a4f40 msgr2=0x7f70801490f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:27.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.901+0000 7f7087f63640 1 --2- 172.21.15.45:0/2781968238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70800a4f40 0x7f70801490f0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f7078009fc0 tx=0x7f707800e570 comp rx=0 tx=0).stop 2023-10-03T19:18:27.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.901+0000 7f7087f63640 1 -- 172.21.15.45:0/2781968238 shutdown_connections 2023-10-03T19:18:27.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.901+0000 7f7087f63640 1 --2- 172.21.15.45:0/2781968238 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7064066280 0x7f7064068730 secure :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f70801473d0 tx=0x7f7070009040 comp rx=0 tx=0).stop 2023-10-03T19:18:27.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.901+0000 7f7087f63640 1 --2- 172.21.15.45:0/2781968238 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7080149fb0 0x7f70800a4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:27.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.901+0000 7f7087f63640 1 --2- 172.21.15.45:0/2781968238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70800bd4a0 0x7f708014caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:27.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.901+0000 7f7087f63640 1 --2- 172.21.15.45:0/2781968238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70800a4f40 0x7f70801490f0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:27.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.901+0000 7f7087f63640 1 -- 172.21.15.45:0/2781968238 >> 172.21.15.45:0/2781968238 conn(0x7f7080071060 msgr2=0x7f70800bda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:27.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.901+0000 7f7087f63640 1 -- 172.21.15.45:0/2781968238 shutdown_connections 2023-10-03T19:18:27.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:27.901+0000 7f7087f63640 1 -- 172.21.15.45:0/2781968238 wait complete. 2023-10-03T19:18:27.933 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-03T19:18:28.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.057+0000 7f16618a2640 1 Processor -- start 2023-10-03T19:18:28.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.057+0000 7f16618a2640 1 -- start start 2023-10-03T19:18:28.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.057+0000 7f16618a2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f165c06c410 0x7f165c0bc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:28.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.057+0000 7f16618a2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f165c06cc20 0x7f165c155390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:28.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.057+0000 7f16618a2640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f165c06f650 con 0x7f165c0bc860 2023-10-03T19:18:28.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.057+0000 7f16618a2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f165c06f3b0 con 0x7f165c06cc20 2023-10-03T19:18:28.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.057+0000 7f16618a2640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f165c14b680 con 0x7f165c06c410 2023-10-03T19:18:28.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.057+0000 7f165b7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f165c06cc20 0x7f165c155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:28.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.057+0000 7f1653fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f165c0bc860 0x7f165c147d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54738/0 (socket says 172.21.15.45:54738) 2023-10-03T19:18:28.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.057+0000 7f1653fff640 1 -- 172.21.15.45:0/1578723743 learned_addr learned my addr 172.21.15.45:0/1578723743 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:18:28.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.057+0000 7f165affd640 1 --2- 172.21.15.45:0/1578723743 >> v2:172.21.15.79:3300/0 conn(0x7f165c06c410 0x7f165c0bc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:28.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.057+0000 7f165b7fe640 1 -- 172.21.15.45:0/1578723743 >> v2:172.21.15.79:3300/0 conn(0x7f165c06c410 msgr2=0x7f165c0bc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:28.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.057+0000 7f165b7fe640 1 --2- 172.21.15.45:0/1578723743 >> v2:172.21.15.79:3300/0 conn(0x7f165c06c410 0x7f165c0bc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:28.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.057+0000 7f165b7fe640 1 -- 172.21.15.45:0/1578723743 >> v1:172.21.15.45:6789/0 conn(0x7f165c0bc860 legacy=0x7f165c147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:28.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.057+0000 7f165b7fe640 1 -- 172.21.15.45:0/1578723743 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165c14b960 con 0x7f165c06cc20 2023-10-03T19:18:28.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.057+0000 7f165a7fc640 1 -- 172.21.15.45:0/1578723743 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 437138246 0 0) 0x7f165c06f650 con 0x7f165c0bc860 2023-10-03T19:18:28.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.057+0000 7f165b7fe640 1 --2- 172.21.15.45:0/1578723743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165c06cc20 0x7f165c155390 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f165c06e960 tx=0x7f165401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db3652bc2a2ddf7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:28.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f165a7fc640 1 -- 172.21.15.45:0/1578723743 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16540a59f0 con 0x7f165c06cc20 2023-10-03T19:18:28.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f165a7fc640 1 -- 172.21.15.45:0/1578723743 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16540a5b50 con 0x7f165c06cc20 2023-10-03T19:18:28.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f165a7fc640 1 -- 172.21.15.45:0/1578723743 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16540ad440 con 0x7f165c06cc20 2023-10-03T19:18:28.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f16618a2640 1 -- 172.21.15.45:0/1578723743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165c06cc20 msgr2=0x7f165c155390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:28.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f16618a2640 1 --2- 172.21.15.45:0/1578723743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165c06cc20 0x7f165c155390 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f165c06e960 tx=0x7f165401c910 comp rx=0 tx=0).stop 2023-10-03T19:18:28.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f16618a2640 1 -- 172.21.15.45:0/1578723743 shutdown_connections 2023-10-03T19:18:28.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f16618a2640 1 --2- 172.21.15.45:0/1578723743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165c06cc20 0x7f165c155390 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:28.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f16618a2640 1 --2- 172.21.15.45:0/1578723743 >> v2:172.21.15.79:3300/0 conn(0x7f165c06c410 0x7f165c0bc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:28.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f16618a2640 1 -- 172.21.15.45:0/1578723743 >> 172.21.15.45:0/1578723743 conn(0x7f165c0a20d0 msgr2=0x7f165c0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:28.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f16618a2640 1 -- 172.21.15.45:0/1578723743 shutdown_connections 2023-10-03T19:18:28.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f16618a2640 1 -- 172.21.15.45:0/1578723743 wait complete. 2023-10-03T19:18:28.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f16618a2640 1 Processor -- start 2023-10-03T19:18:28.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f16618a2640 1 -- start start 2023-10-03T19:18:28.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f16618a2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165c06c410 0x7f165c148960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:28.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f16618a2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f165c06cc20 0x7f165c137390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:28.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f16618a2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f165c0bc860 0x7f165c0b99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:28.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f16618a2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165c0b9ef0 con 0x7f165c06c410 2023-10-03T19:18:28.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f16618a2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165c0bfae0 con 0x7f165c0bc860 2023-10-03T19:18:28.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f16618a2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165c139cb0 con 0x7f165c06cc20 2023-10-03T19:18:28.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f165affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165c06c410 0x7f165c148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:28.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f165affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165c06c410 0x7f165c148960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43754/0 (socket says 172.21.15.45:43754) 2023-10-03T19:18:28.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f165affd640 1 -- 172.21.15.45:0/577285945 learned_addr learned my addr 172.21.15.45:0/577285945 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:28.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f1653fff640 1 --2- 172.21.15.45:0/577285945 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f165c06cc20 0x7f165c137390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:28.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f165b7fe640 1 --2- 172.21.15.45:0/577285945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f165c0bc860 0x7f165c0b99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:28.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f165affd640 1 -- 172.21.15.45:0/577285945 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f165c06cc20 msgr2=0x7f165c137390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:28.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f165affd640 1 --2- 172.21.15.45:0/577285945 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f165c06cc20 0x7f165c137390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:28.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f165affd640 1 -- 172.21.15.45:0/577285945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f165c0bc860 msgr2=0x7f165c0b99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:28.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f165affd640 1 --2- 172.21.15.45:0/577285945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f165c0bc860 0x7f165c0b99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:28.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f165affd640 1 -- 172.21.15.45:0/577285945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1654009a70 con 0x7f165c06c410 2023-10-03T19:18:28.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f165b7fe640 1 --2- 172.21.15.45:0/577285945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f165c0bc860 0x7f165c0b99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:28.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f165affd640 1 --2- 172.21.15.45:0/577285945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165c06c410 0x7f165c148960 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f164c00d800 tx=0x7f164c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:28.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f1658ff9640 1 -- 172.21.15.45:0/577285945 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c00b6c0 con 0x7f165c06c410 2023-10-03T19:18:28.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f1658ff9640 1 -- 172.21.15.45:0/577285945 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164c00b820 con 0x7f165c06c410 2023-10-03T19:18:28.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f16618a2640 1 -- 172.21.15.45:0/577285945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f165c0ba850 con 0x7f165c06c410 2023-10-03T19:18:28.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f1658ff9640 1 -- 172.21.15.45:0/577285945 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c00bb90 con 0x7f165c06c410 2023-10-03T19:18:28.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.061+0000 7f16618a2640 1 -- 172.21.15.45:0/577285945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f165c0ba6c0 con 0x7f165c06c410 2023-10-03T19:18:28.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.065+0000 7f16618a2640 1 -- 172.21.15.45:0/577285945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f165c0bcec0 con 0x7f165c06c410 2023-10-03T19:18:28.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.065+0000 7f1658ff9640 1 -- 172.21.15.45:0/577285945 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f164c00bcf0 con 0x7f165c06c410 2023-10-03T19:18:28.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.065+0000 7f1658ff9640 1 --2- 172.21.15.45:0/577285945 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f163c066280 0x7f163c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:28.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.065+0000 7f1658ff9640 1 -- 172.21.15.45:0/577285945 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f164c084cf0 con 0x7f165c06c410 2023-10-03T19:18:28.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.065+0000 7f1653fff640 1 --2- 172.21.15.45:0/577285945 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f163c066280 0x7f163c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:28.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.065+0000 7f1653fff640 1 --2- 172.21.15.45:0/577285945 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f163c066280 0x7f163c068730 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f165c1476f0 tx=0x7f1644007c10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:28.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.069+0000 7f1658ff9640 1 -- 172.21.15.45:0/577285945 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f164c055d40 con 0x7f165c06c410 2023-10-03T19:18:28.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.257+0000 7f16618a2640 1 -- 172.21.15.45:0/577285945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f165c04de80 con 0x7f165c06c410 2023-10-03T19:18:28.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.269+0000 7f1658ff9640 1 -- 172.21.15.45:0/577285945 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v40) v1 ==== 174+0+0 (secure 0 0 0) 0x7f164c0558d0 con 0x7f165c06c410 2023-10-03T19:18:28.277 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 13 and data pool 14 2023-10-03T19:18:28.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.277+0000 7f16618a2640 1 -- 172.21.15.45:0/577285945 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f163c066280 msgr2=0x7f163c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:28.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.277+0000 7f16618a2640 1 --2- 172.21.15.45:0/577285945 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f163c066280 0x7f163c068730 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f165c1476f0 tx=0x7f1644007c10 comp rx=0 tx=0).stop 2023-10-03T19:18:28.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.277+0000 7f16618a2640 1 -- 172.21.15.45:0/577285945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165c06c410 msgr2=0x7f165c148960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:28.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.277+0000 7f16618a2640 1 --2- 172.21.15.45:0/577285945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165c06c410 0x7f165c148960 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f164c00d800 tx=0x7f164c00dcc0 comp rx=0 tx=0).stop 2023-10-03T19:18:28.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.277+0000 7f16618a2640 1 -- 172.21.15.45:0/577285945 shutdown_connections 2023-10-03T19:18:28.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.277+0000 7f16618a2640 1 --2- 172.21.15.45:0/577285945 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f163c066280 0x7f163c068730 secure :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f165c1476f0 tx=0x7f1644007c10 comp rx=0 tx=0).stop 2023-10-03T19:18:28.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.277+0000 7f16618a2640 1 --2- 172.21.15.45:0/577285945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f165c0bc860 0x7f165c0b99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:28.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.277+0000 7f16618a2640 1 --2- 172.21.15.45:0/577285945 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f165c06cc20 0x7f165c137390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:28.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.277+0000 7f16618a2640 1 --2- 172.21.15.45:0/577285945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165c06c410 0x7f165c148960 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:28.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.277+0000 7f16618a2640 1 -- 172.21.15.45:0/577285945 >> 172.21.15.45:0/577285945 conn(0x7f165c0a20d0 msgr2=0x7f165c13ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:28.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.301+0000 7f16618a2640 1 -- 172.21.15.45:0/577285945 shutdown_connections 2023-10-03T19:18:28.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.301+0000 7f16618a2640 1 -- 172.21.15.45:0/577285945 wait complete. 2023-10-03T19:18:28.327 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:18:28.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.437+0000 7f94cc146640 1 Processor -- start 2023-10-03T19:18:28.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.437+0000 7f94cc146640 1 -- start start 2023-10-03T19:18:28.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.437+0000 7f94cc146640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f94c414aa50 0x7f94c40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:28.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.437+0000 7f94cc146640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c40bc430 con 0x7f94c406cd40 2023-10-03T19:18:28.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.437+0000 7f94cc146640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c40baf60 con 0x7f94c4147ab0 2023-10-03T19:18:28.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.437+0000 7f94cc146640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c40a5db0 con 0x7f94c414aa50 2023-10-03T19:18:28.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.437+0000 7f94c9ee2640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f94c406cd40 0x7f94c40bbd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54740/0 (socket says 172.21.15.45:54740) 2023-10-03T19:18:28.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.437+0000 7f94c9ee2640 1 -- 172.21.15.45:0/970047399 learned_addr learned my addr 172.21.15.45:0/970047399 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:18:28.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.437+0000 7f94c96e1640 1 --2- 172.21.15.45:0/970047399 >> v2:172.21.15.45:3300/0 conn(0x7f94c414aa50 0x7f94c40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:28.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.441+0000 7f94c8ee0640 1 -- 172.21.15.45:0/970047399 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3878839999 0 0) 0x7f94c40bc430 con 0x7f94c406cd40 2023-10-03T19:18:28.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.441+0000 7f94c8ee0640 1 -- 172.21.15.45:0/970047399 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94b0003530 con 0x7f94c406cd40 2023-10-03T19:18:28.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.441+0000 7f94c96e1640 1 -- 172.21.15.45:0/970047399 >> v1:172.21.15.79:6789/0 conn(0x7f94c4147ab0 legacy=0x7f94c41553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:28.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.441+0000 7f94c96e1640 1 -- 172.21.15.45:0/970047399 >> v1:172.21.15.45:6789/0 conn(0x7f94c406cd40 legacy=0x7f94c40bbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:28.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.441+0000 7f94c96e1640 1 -- 172.21.15.45:0/970047399 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c40bb240 con 0x7f94c414aa50 2023-10-03T19:18:28.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.441+0000 7f94c96e1640 1 --2- 172.21.15.45:0/970047399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94c414aa50 0x7f94c40a3670 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f94b40097c0 tx=0x7f94b401ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe165ab4e2ff17e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:28.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.441+0000 7f94c8ee0640 1 -- 172.21.15.45:0/970047399 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b40a8930 con 0x7f94c414aa50 2023-10-03T19:18:28.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.441+0000 7f94c8ee0640 1 -- 172.21.15.45:0/970047399 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b40a8a90 con 0x7f94c414aa50 2023-10-03T19:18:28.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.441+0000 7f94c8ee0640 1 -- 172.21.15.45:0/970047399 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b40a8e20 con 0x7f94c414aa50 2023-10-03T19:18:28.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.441+0000 7f94cc146640 1 -- 172.21.15.45:0/970047399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94c414aa50 msgr2=0x7f94c40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:28.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.441+0000 7f94cc146640 1 --2- 172.21.15.45:0/970047399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94c414aa50 0x7f94c40a3670 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f94b40097c0 tx=0x7f94b401ec30 comp rx=0 tx=0).stop 2023-10-03T19:18:28.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.441+0000 7f94cc146640 1 -- 172.21.15.45:0/970047399 shutdown_connections 2023-10-03T19:18:28.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.441+0000 7f94cc146640 1 --2- 172.21.15.45:0/970047399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94c414aa50 0x7f94c40a3670 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:28.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.441+0000 7f94cc146640 1 -- 172.21.15.45:0/970047399 >> 172.21.15.45:0/970047399 conn(0x7f94c40bcf50 msgr2=0x7f94c40bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:28.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.441+0000 7f94cc146640 1 -- 172.21.15.45:0/970047399 shutdown_connections 2023-10-03T19:18:28.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.441+0000 7f94cc146640 1 -- 172.21.15.45:0/970047399 wait complete. 2023-10-03T19:18:28.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.445+0000 7f94cc146640 1 Processor -- start 2023-10-03T19:18:28.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.445+0000 7f94cc146640 1 -- start start 2023-10-03T19:18:28.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.445+0000 7f94cc146640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94c406cd40 0x7f94c4145470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:28.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.445+0000 7f94cc146640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f94c4147ab0 0x7f94c40be210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:28.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.445+0000 7f94cc146640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94c414aa50 0x7f94c41383e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:28.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.445+0000 7f94cc146640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c40beff0 con 0x7f94c414aa50 2023-10-03T19:18:28.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.445+0000 7f94cc146640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c414caf0 con 0x7f94c406cd40 2023-10-03T19:18:28.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.445+0000 7f94cc146640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c4159a60 con 0x7f94c4147ab0 2023-10-03T19:18:28.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.445+0000 7f94ca6e3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94c414aa50 0x7f94c41383e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:28.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.445+0000 7f94ca6e3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94c414aa50 0x7f94c41383e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43778/0 (socket says 172.21.15.45:43778) 2023-10-03T19:18:28.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.445+0000 7f94ca6e3640 1 -- 172.21.15.45:0/1953771461 learned_addr learned my addr 172.21.15.45:0/1953771461 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:28.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.445+0000 7f94c96e1640 1 --2- 172.21.15.45:0/1953771461 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f94c4147ab0 0x7f94c40be210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:28.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.445+0000 7f94c9ee2640 1 --2- 172.21.15.45:0/1953771461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94c406cd40 0x7f94c4145470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:28.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.445+0000 7f94ca6e3640 1 -- 172.21.15.45:0/1953771461 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f94c4147ab0 msgr2=0x7f94c40be210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:28.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.445+0000 7f94ca6e3640 1 --2- 172.21.15.45:0/1953771461 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f94c4147ab0 0x7f94c40be210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:28.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.445+0000 7f94ca6e3640 1 -- 172.21.15.45:0/1953771461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94c406cd40 msgr2=0x7f94c4145470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:28.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.445+0000 7f94ca6e3640 1 --2- 172.21.15.45:0/1953771461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94c406cd40 0x7f94c4145470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:28.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.445+0000 7f94ca6e3640 1 -- 172.21.15.45:0/1953771461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b4009420 con 0x7f94c414aa50 2023-10-03T19:18:28.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.445+0000 7f94ca6e3640 1 --2- 172.21.15.45:0/1953771461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94c414aa50 0x7f94c41383e0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f94bc00c780 tx=0x7f94bc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:28.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.445+0000 7f94ba7fc640 1 -- 172.21.15.45:0/1953771461 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc004b70 con 0x7f94c414aa50 2023-10-03T19:18:28.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.445+0000 7f94ba7fc640 1 -- 172.21.15.45:0/1953771461 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94bc00ce90 con 0x7f94c414aa50 2023-10-03T19:18:28.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.445+0000 7f94cc146640 1 -- 172.21.15.45:0/1953771461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c40bb800 con 0x7f94c414aa50 2023-10-03T19:18:28.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.445+0000 7f94ba7fc640 1 -- 172.21.15.45:0/1953771461 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc00a850 con 0x7f94c414aa50 2023-10-03T19:18:28.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.445+0000 7f94cc146640 1 -- 172.21.15.45:0/1953771461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c40bb520 con 0x7f94c414aa50 2023-10-03T19:18:28.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.449+0000 7f94cc146640 1 -- 172.21.15.45:0/1953771461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c40bcc90 con 0x7f94c414aa50 2023-10-03T19:18:28.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.449+0000 7f94ba7fc640 1 -- 172.21.15.45:0/1953771461 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f94bc00a9b0 con 0x7f94c414aa50 2023-10-03T19:18:28.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.449+0000 7f94ba7fc640 1 --2- 172.21.15.45:0/1953771461 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f94a8066280 0x7f94a8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:28.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.449+0000 7f94ba7fc640 1 -- 172.21.15.45:0/1953771461 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f94bc083ea0 con 0x7f94c414aa50 2023-10-03T19:18:28.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.449+0000 7f94c9ee2640 1 --2- 172.21.15.45:0/1953771461 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f94a8066280 0x7f94a8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:28.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.449+0000 7f94c9ee2640 1 --2- 172.21.15.45:0/1953771461 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f94a8066280 0x7f94a8068730 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f94c00011f0 tx=0x7f94c0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:28.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.453+0000 7f94ba7fc640 1 -- 172.21.15.45:0/1953771461 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f94bc054da0 con 0x7f94c414aa50 2023-10-03T19:18:28.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.609+0000 7f94cc146640 1 -- 172.21.15.45:0/1953771461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94c40bf130 con 0x7f94c414aa50 2023-10-03T19:18:28.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.613+0000 7f94ba7fc640 1 -- 172.21.15.45:0/1953771461 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+18259 (secure 0 0 0) 0x7f94bc054930 con 0x7f94c414aa50 2023-10-03T19:18:28.614 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:18:28.614 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":84,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:18:28.259868+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:18:25.942883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-10-03T19:18:27.242940+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:18:28.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.613+0000 7f94cc146640 1 -- 172.21.15.45:0/1953771461 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f94a8066280 msgr2=0x7f94a8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:28.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.613+0000 7f94cc146640 1 --2- 172.21.15.45:0/1953771461 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f94a8066280 0x7f94a8068730 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f94c00011f0 tx=0x7f94c0009040 comp rx=0 tx=0).stop 2023-10-03T19:18:28.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.613+0000 7f94cc146640 1 -- 172.21.15.45:0/1953771461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94c414aa50 msgr2=0x7f94c41383e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:28.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.613+0000 7f94cc146640 1 --2- 172.21.15.45:0/1953771461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94c414aa50 0x7f94c41383e0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f94bc00c780 tx=0x7f94bc00cc40 comp rx=0 tx=0).stop 2023-10-03T19:18:28.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.613+0000 7f94cc146640 1 -- 172.21.15.45:0/1953771461 shutdown_connections 2023-10-03T19:18:28.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.613+0000 7f94cc146640 1 --2- 172.21.15.45:0/1953771461 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f94a8066280 0x7f94a8068730 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:28.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.613+0000 7f94cc146640 1 --2- 172.21.15.45:0/1953771461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94c414aa50 0x7f94c41383e0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:28.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.613+0000 7f94cc146640 1 --2- 172.21.15.45:0/1953771461 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f94c4147ab0 0x7f94c40be210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:28.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.613+0000 7f94cc146640 1 --2- 172.21.15.45:0/1953771461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94c406cd40 0x7f94c4145470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:28.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.613+0000 7f94cc146640 1 -- 172.21.15.45:0/1953771461 >> 172.21.15.45:0/1953771461 conn(0x7f94c40bcf50 msgr2=0x7f94c4149130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:28.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.613+0000 7f94cc146640 1 -- 172.21.15.45:0/1953771461 shutdown_connections 2023-10-03T19:18:28.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.613+0000 7f94cc146640 1 -- 172.21.15.45:0/1953771461 wait complete. 2023-10-03T19:18:28.633 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:18:28.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.749+0000 7f5a54a72640 1 Processor -- start 2023-10-03T19:18:28.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.753+0000 7f5a54a72640 1 -- start start 2023-10-03T19:18:28.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.753+0000 7f5a54a72640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5a5006f170 0x7f5a50150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:28.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.753+0000 7f5a54a72640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5a5006d170 0x7f5a5014d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:28.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.753+0000 7f5a54a72640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a5006cac0 con 0x7f5a500bc8b0 2023-10-03T19:18:28.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.753+0000 7f5a54a72640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a500720d0 con 0x7f5a5006f170 2023-10-03T19:18:28.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.753+0000 7f5a54a72640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a500a5ab0 con 0x7f5a5006d170 2023-10-03T19:18:28.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.753+0000 7f5a4e59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5a5006f170 0x7f5a50150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:28.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.753+0000 7f5a4e59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5a5006f170 0x7f5a50150190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43790/0 (socket says 172.21.15.45:43790) 2023-10-03T19:18:28.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.753+0000 7f5a4e59c640 1 -- 172.21.15.45:0/84900162 learned_addr learned my addr 172.21.15.45:0/84900162 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:28.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.753+0000 7f5a4ed9d640 1 --2- 172.21.15.45:0/84900162 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5a5006d170 0x7f5a5014d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:28.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.753+0000 7f5a4e59c640 1 -- 172.21.15.45:0/84900162 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5a5006d170 msgr2=0x7f5a5014d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:28.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.753+0000 7f5a4e59c640 1 --2- 172.21.15.45:0/84900162 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5a5006d170 0x7f5a5014d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:28.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.753+0000 7f5a4e59c640 1 -- 172.21.15.45:0/84900162 >> v1:172.21.15.79:6789/0 conn(0x7f5a500bc8b0 legacy=0x7f5a5014ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:28.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.753+0000 7f5a4e59c640 1 -- 172.21.15.45:0/84900162 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a5006cd00 con 0x7f5a5006f170 2023-10-03T19:18:28.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.753+0000 7f5a4e59c640 1 --2- 172.21.15.45:0/84900162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a5006f170 0x7f5a50150190 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f5a40009870 tx=0x7f5a4001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c4f7803598c23a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:28.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.753+0000 7f5a4dd9b640 1 -- 172.21.15.45:0/84900162 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a400ac630 con 0x7f5a5006f170 2023-10-03T19:18:28.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.753+0000 7f5a4dd9b640 1 -- 172.21.15.45:0/84900162 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a400ac790 con 0x7f5a5006f170 2023-10-03T19:18:28.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.757+0000 7f5a4dd9b640 1 -- 172.21.15.45:0/84900162 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a400acb20 con 0x7f5a5006f170 2023-10-03T19:18:28.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.757+0000 7f5a54a72640 1 -- 172.21.15.45:0/84900162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a5006f170 msgr2=0x7f5a50150190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.757+0000 7f5a54a72640 1 --2- 172.21.15.45:0/84900162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a5006f170 0x7f5a50150190 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f5a40009870 tx=0x7f5a4001c4c0 comp rx=0 tx=0).stop 2023-10-03T19:18:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.757+0000 7f5a54a72640 1 -- 172.21.15.45:0/84900162 shutdown_connections 2023-10-03T19:18:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.757+0000 7f5a54a72640 1 --2- 172.21.15.45:0/84900162 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5a5006d170 0x7f5a5014d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.757+0000 7f5a54a72640 1 --2- 172.21.15.45:0/84900162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a5006f170 0x7f5a50150190 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.757+0000 7f5a54a72640 1 -- 172.21.15.45:0/84900162 >> 172.21.15.45:0/84900162 conn(0x7f5a500bcf50 msgr2=0x7f5a500bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.757+0000 7f5a54a72640 1 -- 172.21.15.45:0/84900162 shutdown_connections 2023-10-03T19:18:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.757+0000 7f5a54a72640 1 -- 172.21.15.45:0/84900162 wait complete. 2023-10-03T19:18:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.757+0000 7f5a54a72640 1 Processor -- start 2023-10-03T19:18:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.757+0000 7f5a54a72640 1 -- start start 2023-10-03T19:18:28.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.757+0000 7f5a54a72640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5a5006d170 0x7f5a500bf460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:28.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.757+0000 7f5a54a72640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a5006f170 0x7f5a50147200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:28.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.757+0000 7f5a54a72640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a500bc8b0 0x7f5a501429d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:28.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.757+0000 7f5a54a72640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5013f5e0 con 0x7f5a5006f170 2023-10-03T19:18:28.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.757+0000 7f5a54a72640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a500c0a90 con 0x7f5a500bc8b0 2023-10-03T19:18:28.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.757+0000 7f5a54a72640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a50144790 con 0x7f5a5006d170 2023-10-03T19:18:28.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.757+0000 7f5a47fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a5006f170 0x7f5a50147200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:28.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.757+0000 7f5a47fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a5006f170 0x7f5a50147200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43804/0 (socket says 172.21.15.45:43804) 2023-10-03T19:18:28.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.757+0000 7f5a47fff640 1 -- 172.21.15.45:0/1800904582 learned_addr learned my addr 172.21.15.45:0/1800904582 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:28.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.757+0000 7f5a4e59c640 1 --2- 172.21.15.45:0/1800904582 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5a5006d170 0x7f5a500bf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:28.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.757+0000 7f5a4ed9d640 1 --2- 172.21.15.45:0/1800904582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a500bc8b0 0x7f5a501429d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:28.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.757+0000 7f5a47fff640 1 -- 172.21.15.45:0/1800904582 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5a5006d170 msgr2=0x7f5a500bf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:28.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.757+0000 7f5a47fff640 1 --2- 172.21.15.45:0/1800904582 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5a5006d170 0x7f5a500bf460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:28.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.757+0000 7f5a47fff640 1 -- 172.21.15.45:0/1800904582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a500bc8b0 msgr2=0x7f5a501429d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:28.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.757+0000 7f5a47fff640 1 --2- 172.21.15.45:0/1800904582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a500bc8b0 0x7f5a501429d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:28.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.757+0000 7f5a47fff640 1 -- 172.21.15.45:0/1800904582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a400094d0 con 0x7f5a5006f170 2023-10-03T19:18:28.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.757+0000 7f5a4e59c640 1 --2- 172.21.15.45:0/1800904582 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5a5006d170 0x7f5a500bf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:28.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.761+0000 7f5a47fff640 1 --2- 172.21.15.45:0/1800904582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a5006f170 0x7f5a50147200 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800c480 tx=0x7f5a3800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:28.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.761+0000 7f5a46ffd640 1 -- 172.21.15.45:0/1800904582 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a38012830 con 0x7f5a5006f170 2023-10-03T19:18:28.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.761+0000 7f5a46ffd640 1 -- 172.21.15.45:0/1800904582 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a380129b0 con 0x7f5a5006f170 2023-10-03T19:18:28.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.761+0000 7f5a46ffd640 1 -- 172.21.15.45:0/1800904582 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a38012d60 con 0x7f5a5006f170 2023-10-03T19:18:28.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.761+0000 7f5a54a72640 1 -- 172.21.15.45:0/1800904582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a5006f6d0 con 0x7f5a5006f170 2023-10-03T19:18:28.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.761+0000 7f5a54a72640 1 -- 172.21.15.45:0/1800904582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a5006f540 con 0x7f5a5006f170 2023-10-03T19:18:28.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.761+0000 7f5a54a72640 1 -- 172.21.15.45:0/1800904582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a50159670 con 0x7f5a5006f170 2023-10-03T19:18:28.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.761+0000 7f5a46ffd640 1 -- 172.21.15.45:0/1800904582 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5a3801c460 con 0x7f5a5006f170 2023-10-03T19:18:28.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.761+0000 7f5a46ffd640 1 --2- 172.21.15.45:0/1800904582 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5a300662b0 0x7f5a30068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:28.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.761+0000 7f5a46ffd640 1 -- 172.21.15.45:0/1800904582 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5a38083c70 con 0x7f5a5006f170 2023-10-03T19:18:28.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.761+0000 7f5a4e59c640 1 --2- 172.21.15.45:0/1800904582 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5a300662b0 0x7f5a30068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:28.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.761+0000 7f5a4e59c640 1 --2- 172.21.15.45:0/1800904582 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5a300662b0 0x7f5a30068760 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5a400ae000 tx=0x7f5a40008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:28.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.765+0000 7f5a46ffd640 1 -- 172.21.15.45:0/1800904582 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5a380510e0 con 0x7f5a5006f170 2023-10-03T19:18:28.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.921+0000 7f5a54a72640 1 -- 172.21.15.45:0/1800904582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a5006d660 con 0x7f5a5006f170 2023-10-03T19:18:28.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.925+0000 7f5a46ffd640 1 -- 172.21.15.45:0/1800904582 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+18259 (secure 0 0 0) 0x7f5a38081770 con 0x7f5a5006f170 2023-10-03T19:18:28.927 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:18:28.927 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":84,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:18:28.259868+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:18:25.942883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-10-03T19:18:27.242940+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:18:28.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.925+0000 7f5a54a72640 1 -- 172.21.15.45:0/1800904582 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5a300662b0 msgr2=0x7f5a30068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:28.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.925+0000 7f5a54a72640 1 --2- 172.21.15.45:0/1800904582 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5a300662b0 0x7f5a30068760 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5a400ae000 tx=0x7f5a40008040 comp rx=0 tx=0).stop 2023-10-03T19:18:28.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.925+0000 7f5a54a72640 1 -- 172.21.15.45:0/1800904582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a5006f170 msgr2=0x7f5a50147200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:28.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.925+0000 7f5a54a72640 1 --2- 172.21.15.45:0/1800904582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a5006f170 0x7f5a50147200 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800c480 tx=0x7f5a3800c940 comp rx=0 tx=0).stop 2023-10-03T19:18:28.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.925+0000 7f5a54a72640 1 -- 172.21.15.45:0/1800904582 shutdown_connections 2023-10-03T19:18:28.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.925+0000 7f5a54a72640 1 --2- 172.21.15.45:0/1800904582 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5a300662b0 0x7f5a30068760 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:28.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.925+0000 7f5a54a72640 1 --2- 172.21.15.45:0/1800904582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a500bc8b0 0x7f5a501429d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:28.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.925+0000 7f5a54a72640 1 --2- 172.21.15.45:0/1800904582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a5006f170 0x7f5a50147200 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:28.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.925+0000 7f5a54a72640 1 --2- 172.21.15.45:0/1800904582 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5a5006d170 0x7f5a500bf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:28.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.925+0000 7f5a54a72640 1 -- 172.21.15.45:0/1800904582 >> 172.21.15.45:0/1800904582 conn(0x7f5a500bcf50 msgr2=0x7f5a50148070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:28.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.925+0000 7f5a54a72640 1 -- 172.21.15.45:0/1800904582 shutdown_connections 2023-10-03T19:18:28.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:28.925+0000 7f5a54a72640 1 -- 172.21.15.45:0/1800904582 wait complete. 2023-10-03T19:18:28.946 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-03T19:18:29.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.073+0000 7fbc309b7640 1 Processor -- start 2023-10-03T19:18:29.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.073+0000 7fbc309b7640 1 -- start start 2023-10-03T19:18:29.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.073+0000 7fbc309b7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbc2c06cc20 0x7fbc2c147d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:29.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.073+0000 7fbc309b7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbc2c06ee50 0x7fbc2c0bcec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:29.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.073+0000 7fbc309b7640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc2c06f650 con 0x7fbc2c06c410 2023-10-03T19:18:29.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.073+0000 7fbc309b7640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc2c06f3b0 con 0x7fbc2c06cc20 2023-10-03T19:18:29.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.073+0000 7fbc309b7640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc2c14b680 con 0x7fbc2c06ee50 2023-10-03T19:18:29.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.073+0000 7fbc29d9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbc2c06cc20 0x7fbc2c147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:29.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.073+0000 7fbc2a59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbc2c06c410 0x7fbc2c0bc320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54742/0 (socket says 172.21.15.45:54742) 2023-10-03T19:18:29.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.073+0000 7fbc2a59c640 1 -- 172.21.15.45:0/3040405689 learned_addr learned my addr 172.21.15.45:0/3040405689 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:18:29.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.073+0000 7fbc2ad9d640 1 --2- 172.21.15.45:0/3040405689 >> v2:172.21.15.79:3300/0 conn(0x7fbc2c06ee50 0x7fbc2c0bcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:29.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.073+0000 7fbc29d9b640 1 -- 172.21.15.45:0/3040405689 >> v2:172.21.15.79:3300/0 conn(0x7fbc2c06ee50 msgr2=0x7fbc2c0bcec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:29.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.073+0000 7fbc29d9b640 1 --2- 172.21.15.45:0/3040405689 >> v2:172.21.15.79:3300/0 conn(0x7fbc2c06ee50 0x7fbc2c0bcec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:29.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.073+0000 7fbc29d9b640 1 -- 172.21.15.45:0/3040405689 >> v1:172.21.15.45:6789/0 conn(0x7fbc2c06c410 legacy=0x7fbc2c0bc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:29.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.073+0000 7fbc2959a640 1 -- 172.21.15.45:0/3040405689 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2211892295 0 0) 0x7fbc2c06f650 con 0x7fbc2c06c410 2023-10-03T19:18:29.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.073+0000 7fbc29d9b640 1 -- 172.21.15.45:0/3040405689 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2c14b960 con 0x7fbc2c06cc20 2023-10-03T19:18:29.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.073+0000 7fbc29d9b640 1 --2- 172.21.15.45:0/3040405689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc2c06cc20 0x7fbc2c147d10 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c0097c0 tx=0x7fbc1c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce2323259127bd46 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:29.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.073+0000 7fbc2959a640 1 -- 172.21.15.45:0/3040405689 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c0ab660 con 0x7fbc2c06cc20 2023-10-03T19:18:29.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc2959a640 1 -- 172.21.15.45:0/3040405689 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1c0ab7c0 con 0x7fbc2c06cc20 2023-10-03T19:18:29.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc2959a640 1 -- 172.21.15.45:0/3040405689 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c0abb50 con 0x7fbc2c06cc20 2023-10-03T19:18:29.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc309b7640 1 -- 172.21.15.45:0/3040405689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc2c06cc20 msgr2=0x7fbc2c147d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:29.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc309b7640 1 --2- 172.21.15.45:0/3040405689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc2c06cc20 0x7fbc2c147d10 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c0097c0 tx=0x7fbc1c01c440 comp rx=0 tx=0).stop 2023-10-03T19:18:29.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc309b7640 1 -- 172.21.15.45:0/3040405689 shutdown_connections 2023-10-03T19:18:29.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc309b7640 1 --2- 172.21.15.45:0/3040405689 >> v2:172.21.15.79:3300/0 conn(0x7fbc2c06ee50 0x7fbc2c0bcec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:29.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc309b7640 1 --2- 172.21.15.45:0/3040405689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc2c06cc20 0x7fbc2c147d10 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:29.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc309b7640 1 -- 172.21.15.45:0/3040405689 >> 172.21.15.45:0/3040405689 conn(0x7fbc2c0a20d0 msgr2=0x7fbc2c0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:29.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc309b7640 1 -- 172.21.15.45:0/3040405689 shutdown_connections 2023-10-03T19:18:29.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc309b7640 1 -- 172.21.15.45:0/3040405689 wait complete. 2023-10-03T19:18:29.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc309b7640 1 Processor -- start 2023-10-03T19:18:29.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc309b7640 1 -- start start 2023-10-03T19:18:29.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc309b7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc2c06c410 0x7fbc2c145950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:29.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc309b7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc2c06cc20 0x7fbc2c13c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:29.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc309b7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc2c06ee50 0x7fbc2c141fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:29.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc309b7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c1e89c0 con 0x7fbc2c06c410 2023-10-03T19:18:29.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc309b7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c1e8ef0 con 0x7fbc2c06cc20 2023-10-03T19:18:29.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc309b7640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c143a10 con 0x7fbc2c06ee50 2023-10-03T19:18:29.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc2a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc2c06c410 0x7fbc2c145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:29.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc2a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc2c06c410 0x7fbc2c145950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43810/0 (socket says 172.21.15.45:43810) 2023-10-03T19:18:29.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc2a59c640 1 -- 172.21.15.45:0/2042728843 learned_addr learned my addr 172.21.15.45:0/2042728843 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:29.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc29d9b640 1 --2- 172.21.15.45:0/2042728843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc2c06cc20 0x7fbc2c13c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:29.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc2ad9d640 1 --2- 172.21.15.45:0/2042728843 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc2c06ee50 0x7fbc2c141fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:29.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc2a59c640 1 -- 172.21.15.45:0/2042728843 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc2c06ee50 msgr2=0x7fbc2c141fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:29.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc2a59c640 1 --2- 172.21.15.45:0/2042728843 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc2c06ee50 0x7fbc2c141fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:29.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc2a59c640 1 -- 172.21.15.45:0/2042728843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc2c06cc20 msgr2=0x7fbc2c13c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:29.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc2a59c640 1 --2- 172.21.15.45:0/2042728843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc2c06cc20 0x7fbc2c13c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:29.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc2a59c640 1 -- 172.21.15.45:0/2042728843 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc1c009420 con 0x7fbc2c06c410 2023-10-03T19:18:29.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc29d9b640 1 --2- 172.21.15.45:0/2042728843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc2c06cc20 0x7fbc2c13c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:29.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc2a59c640 1 --2- 172.21.15.45:0/2042728843 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc2c06c410 0x7fbc2c145950 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fbc2000c4e0 tx=0x7fbc2000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:29.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc1affd640 1 -- 172.21.15.45:0/2042728843 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc200074e0 con 0x7fbc2c06c410 2023-10-03T19:18:29.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc1affd640 1 -- 172.21.15.45:0/2042728843 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc20007660 con 0x7fbc2c06c410 2023-10-03T19:18:29.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc309b7640 1 -- 172.21.15.45:0/2042728843 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc2c0ba850 con 0x7fbc2c06c410 2023-10-03T19:18:29.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc1affd640 1 -- 172.21.15.45:0/2042728843 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc20004a30 con 0x7fbc2c06c410 2023-10-03T19:18:29.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.077+0000 7fbc309b7640 1 -- 172.21.15.45:0/2042728843 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc2c0ba6c0 con 0x7fbc2c06c410 2023-10-03T19:18:29.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.081+0000 7fbc309b7640 1 -- 172.21.15.45:0/2042728843 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc2c0bd400 con 0x7fbc2c06c410 2023-10-03T19:18:29.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.081+0000 7fbc1affd640 1 -- 172.21.15.45:0/2042728843 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbc20004b90 con 0x7fbc2c06c410 2023-10-03T19:18:29.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.081+0000 7fbc1affd640 1 --2- 172.21.15.45:0/2042728843 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbc0c066280 0x7fbc0c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:29.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.081+0000 7fbc1affd640 1 -- 172.21.15.45:0/2042728843 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbc200830e0 con 0x7fbc2c06c410 2023-10-03T19:18:29.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.081+0000 7fbc29d9b640 1 --2- 172.21.15.45:0/2042728843 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbc0c066280 0x7fbc0c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:29.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.081+0000 7fbc29d9b640 1 --2- 172.21.15.45:0/2042728843 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbc0c066280 0x7fbc0c068730 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c0af000 tx=0x7fbc1c004740 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:29.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.085+0000 7fbc1affd640 1 -- 172.21.15.45:0/2042728843 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbc20054080 con 0x7fbc2c06c410 2023-10-03T19:18:29.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:29.277+0000 7fbc309b7640 1 -- 172.21.15.45:0/2042728843 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbc2c04de80 con 0x7fbc2c06c410 2023-10-03T19:18:30.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.281+0000 7fbc1affd640 1 -- 172.21.15.45:0/2042728843 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v43) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbc20053c10 con 0x7fbc2c06c410 2023-10-03T19:18:30.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.281+0000 7fbc309b7640 1 -- 172.21.15.45:0/2042728843 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbc0c066280 msgr2=0x7fbc0c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:30.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.281+0000 7fbc309b7640 1 --2- 172.21.15.45:0/2042728843 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbc0c066280 0x7fbc0c068730 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c0af000 tx=0x7fbc1c004740 comp rx=0 tx=0).stop 2023-10-03T19:18:30.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.281+0000 7fbc309b7640 1 -- 172.21.15.45:0/2042728843 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc2c06c410 msgr2=0x7fbc2c145950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:30.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.281+0000 7fbc309b7640 1 --2- 172.21.15.45:0/2042728843 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc2c06c410 0x7fbc2c145950 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fbc2000c4e0 tx=0x7fbc2000c9a0 comp rx=0 tx=0).stop 2023-10-03T19:18:30.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.281+0000 7fbc309b7640 1 -- 172.21.15.45:0/2042728843 shutdown_connections 2023-10-03T19:18:30.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.281+0000 7fbc309b7640 1 --2- 172.21.15.45:0/2042728843 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbc0c066280 0x7fbc0c068730 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:30.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.281+0000 7fbc309b7640 1 --2- 172.21.15.45:0/2042728843 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc2c06ee50 0x7fbc2c141fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:30.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.281+0000 7fbc309b7640 1 --2- 172.21.15.45:0/2042728843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc2c06cc20 0x7fbc2c13c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:30.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.281+0000 7fbc309b7640 1 --2- 172.21.15.45:0/2042728843 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc2c06c410 0x7fbc2c145950 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:30.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.281+0000 7fbc309b7640 1 -- 172.21.15.45:0/2042728843 >> 172.21.15.45:0/2042728843 conn(0x7fbc2c0a20d0 msgr2=0x7fbc2c148d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:30.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.285+0000 7fbc309b7640 1 -- 172.21.15.45:0/2042728843 shutdown_connections 2023-10-03T19:18:30.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.285+0000 7fbc309b7640 1 -- 172.21.15.45:0/2042728843 wait complete. 2023-10-03T19:18:30.308 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-03T19:18:30.308 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-03T19:18:30.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006cfe0640 1 Processor -- start 2023-10-03T19:18:30.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006cfe0640 1 -- start start 2023-10-03T19:18:30.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006cfe0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f006806c3d0 0x7f0068153660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:30.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006cfe0640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0068156710 0x7f0068156b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:30.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006cfe0640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0068153ba0 con 0x7f0068150340 2023-10-03T19:18:30.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006cfe0640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00681570d0 con 0x7f0068156710 2023-10-03T19:18:30.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006cfe0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0068156280 con 0x7f006806c3d0 2023-10-03T19:18:30.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006659c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0068150340 0x7f00680a1160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54756/0 (socket says 172.21.15.45:54756) 2023-10-03T19:18:30.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006659c640 1 -- 172.21.15.45:0/2648746303 learned_addr learned my addr 172.21.15.45:0/2648746303 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:18:30.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f0065d9b640 1 --2- 172.21.15.45:0/2648746303 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f006806c3d0 0x7f0068153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:30.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f0066d9d640 1 --2- 172.21.15.45:0/2648746303 >> v2:172.21.15.79:3300/0 conn(0x7f0068156710 0x7f0068156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:30.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006559a640 1 -- 172.21.15.45:0/2648746303 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1952926315 0 0) 0x7f00580014a0 con 0x7f0068150340 2023-10-03T19:18:30.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006559a640 1 -- 172.21.15.45:0/2648746303 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0054003530 con 0x7f0068150340 2023-10-03T19:18:30.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006559a640 1 -- 172.21.15.45:0/2648746303 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3086565631 0 0) 0x7f0054003530 con 0x7f0068150340 2023-10-03T19:18:30.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006559a640 1 -- 172.21.15.45:0/2648746303 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f006806c3d0 msgr2=0x7f0068153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:30.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006559a640 1 --2- 172.21.15.45:0/2648746303 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f006806c3d0 0x7f0068153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:30.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006559a640 1 -- 172.21.15.45:0/2648746303 >> v2:172.21.15.79:3300/0 conn(0x7f0068156710 msgr2=0x7f0068156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:30.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006559a640 1 --2- 172.21.15.45:0/2648746303 >> v2:172.21.15.79:3300/0 conn(0x7f0068156710 0x7f0068156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:30.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006559a640 1 -- 172.21.15.45:0/2648746303 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006806d1f0 con 0x7f0068150340 2023-10-03T19:18:30.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006559a640 1 -- 172.21.15.45:0/2648746303 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f0058001b90 con 0x7f0068150340 2023-10-03T19:18:30.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006559a640 1 -- 172.21.15.45:0/2648746303 >> v1:172.21.15.45:6789/0 conn(0x7f0068150340 legacy=0x7f00680a1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:30.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006559a640 1 --2- 172.21.15.45:0/2648746303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0054003980 0x7f0054003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:30.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006559a640 1 --2- 172.21.15.45:0/2648746303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00540043b0 0x7f0054004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:30.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006559a640 1 --2- 172.21.15.45:0/2648746303 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f006806c3d0 0x7f0054004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:30.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006559a640 1 -- 172.21.15.45:0/2648746303 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0068156280 con 0x7f0054003980 2023-10-03T19:18:30.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006559a640 1 -- 172.21.15.45:0/2648746303 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005400b990 con 0x7f00540043b0 2023-10-03T19:18:30.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006559a640 1 -- 172.21.15.45:0/2648746303 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005400bad0 con 0x7f006806c3d0 2023-10-03T19:18:30.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006659c640 1 --2- 172.21.15.45:0/2648746303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0054003980 0x7f0054003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:30.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f0065d9b640 1 --2- 172.21.15.45:0/2648746303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00540043b0 0x7f0054004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:30.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f0066d9d640 1 --2- 172.21.15.45:0/2648746303 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f006806c3d0 0x7f0054004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:30.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006659c640 1 -- 172.21.15.45:0/2648746303 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f006806c3d0 msgr2=0x7f0054004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:30.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006659c640 1 --2- 172.21.15.45:0/2648746303 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f006806c3d0 0x7f0054004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:30.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006659c640 1 -- 172.21.15.45:0/2648746303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00540043b0 msgr2=0x7f0054004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:30.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006659c640 1 --2- 172.21.15.45:0/2648746303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00540043b0 0x7f0054004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:30.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f006659c640 1 -- 172.21.15.45:0/2648746303 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0054003530 con 0x7f0054003980 2023-10-03T19:18:30.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f0066d9d640 1 --2- 172.21.15.45:0/2648746303 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f006806c3d0 0x7f0054004f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:30.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.437+0000 7f0065d9b640 1 --2- 172.21.15.45:0/2648746303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00540043b0 0x7f0054004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:30.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.441+0000 7f006659c640 1 --2- 172.21.15.45:0/2648746303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0054003980 0x7f0054003d90 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f005800a830 tx=0x7f005801faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35308fe9b9af1180 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:30.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.441+0000 7f006559a640 1 -- 172.21.15.45:0/2648746303 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00580aa6d0 con 0x7f0054003980 2023-10-03T19:18:30.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.441+0000 7f006559a640 1 -- 172.21.15.45:0/2648746303 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00580aa830 con 0x7f0054003980 2023-10-03T19:18:30.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.441+0000 7f006559a640 1 -- 172.21.15.45:0/2648746303 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00580aac20 con 0x7f0054003980 2023-10-03T19:18:30.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.441+0000 7f006cfe0640 1 -- 172.21.15.45:0/2648746303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0054003980 msgr2=0x7f0054003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:30.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.441+0000 7f006cfe0640 1 --2- 172.21.15.45:0/2648746303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0054003980 0x7f0054003d90 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f005800a830 tx=0x7f005801faa0 comp rx=0 tx=0).stop 2023-10-03T19:18:30.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.441+0000 7f0066d9d640 1 -- 172.21.15.45:0/2648746303 reap_dead start 2023-10-03T19:18:30.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.441+0000 7f006cfe0640 1 -- 172.21.15.45:0/2648746303 shutdown_connections 2023-10-03T19:18:30.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.441+0000 7f006cfe0640 1 -- 172.21.15.45:0/2648746303 >> 172.21.15.45:0/2648746303 conn(0x7f00680a20d0 msgr2=0x7f00680a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:30.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.441+0000 7f006cfe0640 1 -- 172.21.15.45:0/2648746303 shutdown_connections 2023-10-03T19:18:30.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.441+0000 7f006cfe0640 1 -- 172.21.15.45:0/2648746303 wait complete. 2023-10-03T19:18:30.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.441+0000 7f006cfe0640 1 Processor -- start 2023-10-03T19:18:30.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.441+0000 7f006cfe0640 1 -- start start 2023-10-03T19:18:30.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.441+0000 7f006cfe0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0054003980 0x7f00681ebb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:30.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.441+0000 7f006cfe0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f00681e7bf0 0x7f006814b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:30.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.441+0000 7f006cfe0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f006814bc80 0x7f00680bf660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:30.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.441+0000 7f006cfe0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006814df40 con 0x7f0054003980 2023-10-03T19:18:30.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.441+0000 7f006cfe0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00680be010 con 0x7f006814bc80 2023-10-03T19:18:30.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.441+0000 7f006cfe0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f006814dca0 con 0x7f00681e7bf0 2023-10-03T19:18:30.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.441+0000 7f006659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0054003980 0x7f00681ebb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:30.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.441+0000 7f006659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0054003980 0x7f00681ebb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43836/0 (socket says 172.21.15.45:43836) 2023-10-03T19:18:30.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.445+0000 7f006659c640 1 -- 172.21.15.45:0/2914432262 learned_addr learned my addr 172.21.15.45:0/2914432262 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:30.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.445+0000 7f0065d9b640 1 --2- 172.21.15.45:0/2914432262 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f00681e7bf0 0x7f006814b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:30.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.445+0000 7f0066d9d640 1 --2- 172.21.15.45:0/2914432262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f006814bc80 0x7f00680bf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:30.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.445+0000 7f006659c640 1 -- 172.21.15.45:0/2914432262 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f00681e7bf0 msgr2=0x7f006814b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:30.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.445+0000 7f006659c640 1 --2- 172.21.15.45:0/2914432262 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f00681e7bf0 0x7f006814b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:30.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.445+0000 7f006659c640 1 -- 172.21.15.45:0/2914432262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f006814bc80 msgr2=0x7f00680bf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:30.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.445+0000 7f006659c640 1 --2- 172.21.15.45:0/2914432262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f006814bc80 0x7f00680bf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:30.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.445+0000 7f006659c640 1 -- 172.21.15.45:0/2914432262 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00680a1870 con 0x7f0054003980 2023-10-03T19:18:30.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.445+0000 7f0065d9b640 1 --2- 172.21.15.45:0/2914432262 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f00681e7bf0 0x7f006814b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:18:30.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.445+0000 7f0066d9d640 1 --2- 172.21.15.45:0/2914432262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f006814bc80 0x7f00680bf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:18:30.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.445+0000 7f006659c640 1 --2- 172.21.15.45:0/2914432262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0054003980 0x7f00681ebb00 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f005800a830 tx=0x7f0054005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:30.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.445+0000 7f005effd640 1 -- 172.21.15.45:0/2914432262 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00580aa4d0 con 0x7f0054003980 2023-10-03T19:18:30.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.445+0000 7f005effd640 1 -- 172.21.15.45:0/2914432262 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00580aa630 con 0x7f0054003980 2023-10-03T19:18:30.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.445+0000 7f006cfe0640 1 -- 172.21.15.45:0/2914432262 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f006806d490 con 0x7f0054003980 2023-10-03T19:18:30.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.445+0000 7f005effd640 1 -- 172.21.15.45:0/2914432262 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0058001ad0 con 0x7f0054003980 2023-10-03T19:18:30.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.445+0000 7f006cfe0640 1 -- 172.21.15.45:0/2914432262 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f006806d770 con 0x7f0054003980 2023-10-03T19:18:30.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.445+0000 7f006cfe0640 1 -- 172.21.15.45:0/2914432262 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f006804de80 con 0x7f0054003980 2023-10-03T19:18:30.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.445+0000 7f005effd640 1 -- 172.21.15.45:0/2914432262 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f00580070e0 con 0x7f0054003980 2023-10-03T19:18:30.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.445+0000 7f005effd640 1 --2- 172.21.15.45:0/2914432262 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f00480662b0 0x7f0048068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:30.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.445+0000 7f005effd640 1 -- 172.21.15.45:0/2914432262 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f00580b9070 con 0x7f0054003980 2023-10-03T19:18:30.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.445+0000 7f0065d9b640 1 --2- 172.21.15.45:0/2914432262 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f00480662b0 0x7f0048068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:30.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.449+0000 7f0065d9b640 1 --2- 172.21.15.45:0/2914432262 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f00480662b0 0x7f0048068760 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f00680bdda0 tx=0x7f0050008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:30.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.449+0000 7f005effd640 1 -- 172.21.15.45:0/2914432262 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f00580ee8b0 con 0x7f0054003980 2023-10-03T19:18:30.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:30.641+0000 7f006cfe0640 1 -- 172.21.15.45:0/2914432262 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0068153ba0 con 0x7f0054003980 2023-10-03T19:18:31.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.281+0000 7f005effd640 1 -- 172.21.15.45:0/2914432262 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v44) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0068153ba0 con 0x7f0054003980 2023-10-03T19:18:31.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.285+0000 7f006cfe0640 1 -- 172.21.15.45:0/2914432262 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f00480662b0 msgr2=0x7f0048068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:31.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.285+0000 7f006cfe0640 1 --2- 172.21.15.45:0/2914432262 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f00480662b0 0x7f0048068760 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f00680bdda0 tx=0x7f0050008040 comp rx=0 tx=0).stop 2023-10-03T19:18:31.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.285+0000 7f006cfe0640 1 -- 172.21.15.45:0/2914432262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0054003980 msgr2=0x7f00681ebb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:31.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.285+0000 7f006cfe0640 1 --2- 172.21.15.45:0/2914432262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0054003980 0x7f00681ebb00 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f005800a830 tx=0x7f0054005800 comp rx=0 tx=0).stop 2023-10-03T19:18:31.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.285+0000 7f006cfe0640 1 -- 172.21.15.45:0/2914432262 shutdown_connections 2023-10-03T19:18:31.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.285+0000 7f006cfe0640 1 --2- 172.21.15.45:0/2914432262 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f00480662b0 0x7f0048068760 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:31.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.285+0000 7f006cfe0640 1 --2- 172.21.15.45:0/2914432262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f006814bc80 0x7f00680bf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:31.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.285+0000 7f006cfe0640 1 --2- 172.21.15.45:0/2914432262 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f00681e7bf0 0x7f006814b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:31.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.285+0000 7f006cfe0640 1 --2- 172.21.15.45:0/2914432262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0054003980 0x7f00681ebb00 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:31.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.285+0000 7f006cfe0640 1 -- 172.21.15.45:0/2914432262 >> 172.21.15.45:0/2914432262 conn(0x7f00680a20d0 msgr2=0x7f0068151760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:31.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.289+0000 7f006cfe0640 1 -- 172.21.15.45:0/2914432262 shutdown_connections 2023-10-03T19:18:31.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.289+0000 7f006cfe0640 1 -- 172.21.15.45:0/2914432262 wait complete. 2023-10-03T19:18:31.312 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-03T19:18:31.313 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:18:31.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.441+0000 7ff12d06b640 1 Processor -- start 2023-10-03T19:18:31.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.441+0000 7ff12d06b640 1 -- start start 2023-10-03T19:18:31.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.441+0000 7ff12d06b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff1280bed20 0x7ff1280bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:31.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.441+0000 7ff12d06b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff1280a6f00 0x7ff128150200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:31.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.441+0000 7ff12d06b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff128150740 0x7ff1280be010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:31.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.441+0000 7ff12d06b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff12814fd70 con 0x7ff128150740 2023-10-03T19:18:31.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.441+0000 7ff12d06b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff128146910 con 0x7ff1280a6f00 2023-10-03T19:18:31.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.441+0000 7ff12d06b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12806e9f0 con 0x7ff1280bed20 2023-10-03T19:18:31.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.441+0000 7ff12759e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff128150740 0x7ff1280be010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:31.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.441+0000 7ff12759e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff128150740 0x7ff1280be010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43844/0 (socket says 172.21.15.45:43844) 2023-10-03T19:18:31.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.441+0000 7ff12759e640 1 -- 172.21.15.45:0/3492627063 learned_addr learned my addr 172.21.15.45:0/3492627063 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:31.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.441+0000 7ff126d9d640 1 --2- 172.21.15.45:0/3492627063 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff1280bed20 0x7ff1280bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:31.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.441+0000 7ff12659c640 1 --2- 172.21.15.45:0/3492627063 >> v2:172.21.15.79:3300/0 conn(0x7ff1280a6f00 0x7ff128150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:31.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.441+0000 7ff12759e640 1 -- 172.21.15.45:0/3492627063 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff1280bed20 msgr2=0x7ff1280bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:31.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.441+0000 7ff12759e640 1 --2- 172.21.15.45:0/3492627063 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff1280bed20 0x7ff1280bf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:31.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.441+0000 7ff12759e640 1 -- 172.21.15.45:0/3492627063 >> v2:172.21.15.79:3300/0 conn(0x7ff1280a6f00 msgr2=0x7ff128150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:31.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.441+0000 7ff12759e640 1 --2- 172.21.15.45:0/3492627063 >> v2:172.21.15.79:3300/0 conn(0x7ff1280a6f00 0x7ff128150200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:31.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.441+0000 7ff12759e640 1 -- 172.21.15.45:0/3492627063 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12806ec90 con 0x7ff128150740 2023-10-03T19:18:31.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.445+0000 7ff12759e640 1 --2- 172.21.15.45:0/3492627063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff128150740 0x7ff1280be010 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7ff12806e170 tx=0x7ff12001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f381968b3382b2bd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:31.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.445+0000 7ff125d9b640 1 -- 172.21.15.45:0/3492627063 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1200ab600 con 0x7ff128150740 2023-10-03T19:18:31.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.445+0000 7ff125d9b640 1 -- 172.21.15.45:0/3492627063 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1200a7050 con 0x7ff128150740 2023-10-03T19:18:31.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.445+0000 7ff125d9b640 1 -- 172.21.15.45:0/3492627063 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1200ab980 con 0x7ff128150740 2023-10-03T19:18:31.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.445+0000 7ff12d06b640 1 -- 172.21.15.45:0/3492627063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff128150740 msgr2=0x7ff1280be010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:31.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.445+0000 7ff12d06b640 1 --2- 172.21.15.45:0/3492627063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff128150740 0x7ff1280be010 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7ff12806e170 tx=0x7ff12001c500 comp rx=0 tx=0).stop 2023-10-03T19:18:31.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.445+0000 7ff12d06b640 1 -- 172.21.15.45:0/3492627063 shutdown_connections 2023-10-03T19:18:31.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.445+0000 7ff12d06b640 1 --2- 172.21.15.45:0/3492627063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff128150740 0x7ff1280be010 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:31.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.445+0000 7ff12d06b640 1 --2- 172.21.15.45:0/3492627063 >> v2:172.21.15.79:3300/0 conn(0x7ff1280a6f00 0x7ff128150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:31.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.445+0000 7ff12d06b640 1 --2- 172.21.15.45:0/3492627063 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff1280bed20 0x7ff1280bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:31.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.445+0000 7ff12d06b640 1 -- 172.21.15.45:0/3492627063 >> 172.21.15.45:0/3492627063 conn(0x7ff12806d990 msgr2=0x7ff12806bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:31.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.445+0000 7ff12d06b640 1 -- 172.21.15.45:0/3492627063 shutdown_connections 2023-10-03T19:18:31.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.445+0000 7ff12d06b640 1 -- 172.21.15.45:0/3492627063 wait complete. 2023-10-03T19:18:31.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.445+0000 7ff12d06b640 1 Processor -- start 2023-10-03T19:18:31.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.445+0000 7ff12d06b640 1 -- start start 2023-10-03T19:18:31.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.445+0000 7ff12d06b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff1280a6f00 0x7ff128145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:31.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.445+0000 7ff12d06b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1280bed20 0x7ff128148fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:31.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.445+0000 7ff12d06b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff128150740 0x7ff128149520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:31.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.445+0000 7ff12d06b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1280bc650 con 0x7ff1280bed20 2023-10-03T19:18:31.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.445+0000 7ff12d06b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1281460f0 con 0x7ff128150740 2023-10-03T19:18:31.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.445+0000 7ff12d06b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff128140820 con 0x7ff1280a6f00 2023-10-03T19:18:31.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.445+0000 7ff12659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1280bed20 0x7ff128148fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:31.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.449+0000 7ff12659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1280bed20 0x7ff128148fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43858/0 (socket says 172.21.15.45:43858) 2023-10-03T19:18:31.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.449+0000 7ff12659c640 1 -- 172.21.15.45:0/2004781374 learned_addr learned my addr 172.21.15.45:0/2004781374 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:31.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.449+0000 7ff12759e640 1 --2- 172.21.15.45:0/2004781374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff128150740 0x7ff128149520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:31.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.449+0000 7ff126d9d640 1 --2- 172.21.15.45:0/2004781374 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff1280a6f00 0x7ff128145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:31.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.449+0000 7ff12659c640 1 -- 172.21.15.45:0/2004781374 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff1280a6f00 msgr2=0x7ff128145bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:31.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.449+0000 7ff12659c640 1 --2- 172.21.15.45:0/2004781374 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff1280a6f00 0x7ff128145bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:31.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.449+0000 7ff12659c640 1 -- 172.21.15.45:0/2004781374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff128150740 msgr2=0x7ff128149520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:31.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.449+0000 7ff12659c640 1 --2- 172.21.15.45:0/2004781374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff128150740 0x7ff128149520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:31.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.449+0000 7ff12659c640 1 -- 172.21.15.45:0/2004781374 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1200094d0 con 0x7ff1280bed20 2023-10-03T19:18:31.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.449+0000 7ff12659c640 1 --2- 172.21.15.45:0/2004781374 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1280bed20 0x7ff128148fe0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7ff110007ef0 tx=0x7ff11000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:31.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.449+0000 7ff11f7fe640 1 -- 172.21.15.45:0/2004781374 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff110014620 con 0x7ff1280bed20 2023-10-03T19:18:31.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.449+0000 7ff11f7fe640 1 -- 172.21.15.45:0/2004781374 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff110014780 con 0x7ff1280bed20 2023-10-03T19:18:31.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.449+0000 7ff12d06b640 1 -- 172.21.15.45:0/2004781374 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff128071a70 con 0x7ff1280bed20 2023-10-03T19:18:31.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.449+0000 7ff11f7fe640 1 -- 172.21.15.45:0/2004781374 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff110014b30 con 0x7ff1280bed20 2023-10-03T19:18:31.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.449+0000 7ff12d06b640 1 -- 172.21.15.45:0/2004781374 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1280718e0 con 0x7ff1280bed20 2023-10-03T19:18:31.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.449+0000 7ff12d06b640 1 -- 172.21.15.45:0/2004781374 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff128071c00 con 0x7ff1280bed20 2023-10-03T19:18:31.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.449+0000 7ff11f7fe640 1 -- 172.21.15.45:0/2004781374 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff110014c90 con 0x7ff1280bed20 2023-10-03T19:18:31.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.449+0000 7ff11f7fe640 1 --2- 172.21.15.45:0/2004781374 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff1080662b0 0x7ff108068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:31.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.449+0000 7ff11f7fe640 1 -- 172.21.15.45:0/2004781374 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff1100846f0 con 0x7ff1280bed20 2023-10-03T19:18:31.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.449+0000 7ff126d9d640 1 --2- 172.21.15.45:0/2004781374 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff1080662b0 0x7ff108068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:31.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.449+0000 7ff126d9d640 1 --2- 172.21.15.45:0/2004781374 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff1080662b0 0x7ff108068760 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff11800b950 tx=0x7ff118008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:31.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.453+0000 7ff11f7fe640 1 -- 172.21.15.45:0/2004781374 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff110051b70 con 0x7ff1280bed20 2023-10-03T19:18:31.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.645+0000 7ff12d06b640 1 -- 172.21.15.45:0/2004781374 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff12804de80 con 0x7ff1280bed20 2023-10-03T19:18:31.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.645+0000 7ff11f7fe640 1 -- 172.21.15.45:0/2004781374 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+3910 (secure 0 0 0) 0x7ff110055190 con 0x7ff1280bed20 2023-10-03T19:18:31.647 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:18:31.647 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":44,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6094,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3237510777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3237510777},{"type":"v1","addr":"172.21.15.79:6835","nonce":3237510777}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6717,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/697890515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":697890515},{"type":"v1","addr":"172.21.15.45:6833","nonce":697890515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:18:28.260345+0000","modified":"2023-10-03T19:18:31.278054+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6720},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6720":{"gid":6720,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/125100321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":125100321},{"type":"v1","addr":"172.21.15.45:6835","nonce":125100321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-10-03T19:18:31.647 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 44 2023-10-03T19:18:31.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.645+0000 7ff12d06b640 1 -- 172.21.15.45:0/2004781374 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff1080662b0 msgr2=0x7ff108068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:31.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.645+0000 7ff12d06b640 1 --2- 172.21.15.45:0/2004781374 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff1080662b0 0x7ff108068760 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff11800b950 tx=0x7ff118008040 comp rx=0 tx=0).stop 2023-10-03T19:18:31.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.645+0000 7ff12d06b640 1 -- 172.21.15.45:0/2004781374 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1280bed20 msgr2=0x7ff128148fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:31.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.645+0000 7ff12d06b640 1 --2- 172.21.15.45:0/2004781374 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1280bed20 0x7ff128148fe0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7ff110007ef0 tx=0x7ff11000e4b0 comp rx=0 tx=0).stop 2023-10-03T19:18:31.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.645+0000 7ff12d06b640 1 -- 172.21.15.45:0/2004781374 shutdown_connections 2023-10-03T19:18:31.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.645+0000 7ff12d06b640 1 --2- 172.21.15.45:0/2004781374 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff1080662b0 0x7ff108068760 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:31.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.645+0000 7ff12d06b640 1 --2- 172.21.15.45:0/2004781374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff128150740 0x7ff128149520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:31.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.645+0000 7ff12d06b640 1 --2- 172.21.15.45:0/2004781374 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1280bed20 0x7ff128148fe0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:31.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.645+0000 7ff12d06b640 1 --2- 172.21.15.45:0/2004781374 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff1280a6f00 0x7ff128145bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:31.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.645+0000 7ff12d06b640 1 -- 172.21.15.45:0/2004781374 >> 172.21.15.45:0/2004781374 conn(0x7ff12806d990 msgr2=0x7ff1280c0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:31.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.645+0000 7ff12d06b640 1 -- 172.21.15.45:0/2004781374 shutdown_connections 2023-10-03T19:18:31.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.645+0000 7ff12d06b640 1 -- 172.21.15.45:0/2004781374 wait complete. 2023-10-03T19:18:31.666 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:18:31.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.789+0000 7ff7e99c7640 1 Processor -- start 2023-10-03T19:18:31.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.789+0000 7ff7e99c7640 1 -- start start 2023-10-03T19:18:31.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.789+0000 7ff7e99c7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7e406cd40 0x7ff7e414aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:31.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.789+0000 7ff7e99c7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff7e4147ab0 0x7ff7e4147f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:31.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.789+0000 7ff7e99c7640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e40bc430 con 0x7ff7e40a3670 2023-10-03T19:18:31.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.789+0000 7ff7e99c7640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7e40a5db0 con 0x7ff7e4147ab0 2023-10-03T19:18:31.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.789+0000 7ff7e99c7640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e4148470 con 0x7ff7e406cd40 2023-10-03T19:18:31.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.789+0000 7ff7e37fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff7e4147ab0 0x7ff7e4147f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:31.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.789+0000 7ff7e37fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff7e4147ab0 0x7ff7e4147f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43868/0 (socket says 172.21.15.45:43868) 2023-10-03T19:18:31.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.789+0000 7ff7e37fe640 1 -- 172.21.15.45:0/1062337539 learned_addr learned my addr 172.21.15.45:0/1062337539 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:31.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.789+0000 7ff7e2ffd640 1 --2- 172.21.15.45:0/1062337539 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7e406cd40 0x7ff7e414aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:31.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.789+0000 7ff7e37fe640 1 -- 172.21.15.45:0/1062337539 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7e406cd40 msgr2=0x7ff7e414aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:31.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.789+0000 7ff7e37fe640 1 --2- 172.21.15.45:0/1062337539 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7e406cd40 0x7ff7e414aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:31.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.789+0000 7ff7e37fe640 1 -- 172.21.15.45:0/1062337539 >> v1:172.21.15.79:6789/0 conn(0x7ff7e40a3670 legacy=0x7ff7e40bbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:31.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.789+0000 7ff7e37fe640 1 -- 172.21.15.45:0/1062337539 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e40baf60 con 0x7ff7e4147ab0 2023-10-03T19:18:31.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.789+0000 7ff7e37fe640 1 --2- 172.21.15.45:0/1062337539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7e4147ab0 0x7ff7e4147f30 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc009e50 tx=0x7ff7dc01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c2c6ee4c1afa65 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:31.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e1ffb640 1 -- 172.21.15.45:0/1062337539 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc0af400 con 0x7ff7e4147ab0 2023-10-03T19:18:31.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e1ffb640 1 -- 172.21.15.45:0/1062337539 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7dc0ab050 con 0x7ff7e4147ab0 2023-10-03T19:18:31.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e1ffb640 1 -- 172.21.15.45:0/1062337539 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc0af780 con 0x7ff7e4147ab0 2023-10-03T19:18:31.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e99c7640 1 -- 172.21.15.45:0/1062337539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7e4147ab0 msgr2=0x7ff7e4147f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:31.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e99c7640 1 --2- 172.21.15.45:0/1062337539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7e4147ab0 0x7ff7e4147f30 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc009e50 tx=0x7ff7dc01f1c0 comp rx=0 tx=0).stop 2023-10-03T19:18:31.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e99c7640 1 -- 172.21.15.45:0/1062337539 shutdown_connections 2023-10-03T19:18:31.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e99c7640 1 --2- 172.21.15.45:0/1062337539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7e4147ab0 0x7ff7e4147f30 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:31.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e99c7640 1 --2- 172.21.15.45:0/1062337539 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7e406cd40 0x7ff7e414aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:31.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e99c7640 1 -- 172.21.15.45:0/1062337539 >> 172.21.15.45:0/1062337539 conn(0x7ff7e40bcf50 msgr2=0x7ff7e40bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:31.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e99c7640 1 -- 172.21.15.45:0/1062337539 shutdown_connections 2023-10-03T19:18:31.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e99c7640 1 -- 172.21.15.45:0/1062337539 wait complete. 2023-10-03T19:18:31.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e99c7640 1 Processor -- start 2023-10-03T19:18:31.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e99c7640 1 -- start start 2023-10-03T19:18:31.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e99c7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7e406cd40 0x7ff7e40b98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:31.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e99c7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7e40a3670 0x7ff7e4071a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:31.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e99c7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7e4147ab0 0x7ff7e4149260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:31.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e99c7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e4148dd0 con 0x7ff7e4147ab0 2023-10-03T19:18:31.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e99c7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e414a7b0 con 0x7ff7e40a3670 2023-10-03T19:18:31.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e99c7640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e4071f60 con 0x7ff7e406cd40 2023-10-03T19:18:31.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7e4147ab0 0x7ff7e4149260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:31.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7e4147ab0 0x7ff7e4149260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43874/0 (socket says 172.21.15.45:43874) 2023-10-03T19:18:31.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e37fe640 1 -- 172.21.15.45:0/2552147718 learned_addr learned my addr 172.21.15.45:0/2552147718 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:31.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e37fe640 1 -- 172.21.15.45:0/2552147718 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7e406cd40 msgr2=0x7ff7e40b98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:31.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e2ffd640 1 --2- 172.21.15.45:0/2552147718 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7e406cd40 0x7ff7e40b98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:31.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e37fe640 1 --2- 172.21.15.45:0/2552147718 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7e406cd40 0x7ff7e40b98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:31.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e27fc640 1 --2- 172.21.15.45:0/2552147718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7e40a3670 0x7ff7e4071a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:31.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e37fe640 1 -- 172.21.15.45:0/2552147718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7e40a3670 msgr2=0x7ff7e4071a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:31.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e37fe640 1 --2- 172.21.15.45:0/2552147718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7e40a3670 0x7ff7e4071a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:31.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e37fe640 1 -- 172.21.15.45:0/2552147718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7dc009b30 con 0x7ff7e4147ab0 2023-10-03T19:18:31.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e37fe640 1 --2- 172.21.15.45:0/2552147718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7e4147ab0 0x7ff7e4149260 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc01d870 tx=0x7ff7dc01bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:31.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7dbfff640 1 -- 172.21.15.45:0/2552147718 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc007000 con 0x7ff7e4147ab0 2023-10-03T19:18:31.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7dbfff640 1 -- 172.21.15.45:0/2552147718 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7dc0b9610 con 0x7ff7e4147ab0 2023-10-03T19:18:31.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e99c7640 1 -- 172.21.15.45:0/2552147718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7e40bb520 con 0x7ff7e4147ab0 2023-10-03T19:18:31.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7dbfff640 1 -- 172.21.15.45:0/2552147718 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc0b99c0 con 0x7ff7e4147ab0 2023-10-03T19:18:31.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.793+0000 7ff7e99c7640 1 -- 172.21.15.45:0/2552147718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e40bb240 con 0x7ff7e4147ab0 2023-10-03T19:18:31.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.797+0000 7ff7e99c7640 1 -- 172.21.15.45:0/2552147718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e40bb800 con 0x7ff7e4147ab0 2023-10-03T19:18:31.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.797+0000 7ff7dbfff640 1 -- 172.21.15.45:0/2552147718 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff7dc0b6030 con 0x7ff7e4147ab0 2023-10-03T19:18:31.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.797+0000 7ff7dbfff640 1 --2- 172.21.15.45:0/2552147718 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff7c40662b0 0x7ff7c4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:31.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.797+0000 7ff7dbfff640 1 -- 172.21.15.45:0/2552147718 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff7dc122620 con 0x7ff7e4147ab0 2023-10-03T19:18:31.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.797+0000 7ff7e2ffd640 1 --2- 172.21.15.45:0/2552147718 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff7c40662b0 0x7ff7c4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:31.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.797+0000 7ff7e2ffd640 1 --2- 172.21.15.45:0/2552147718 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff7c40662b0 0x7ff7c4068760 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc009790 tx=0x7ff7cc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:31.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.801+0000 7ff7dbfff640 1 -- 172.21.15.45:0/2552147718 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff7dc0efc10 con 0x7ff7e4147ab0 2023-10-03T19:18:31.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.953+0000 7ff7e99c7640 1 -- 172.21.15.45:0/2552147718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7e4148f80 con 0x7ff7e4147ab0 2023-10-03T19:18:31.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.957+0000 7ff7dbfff640 1 -- 172.21.15.45:0/2552147718 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+18246 (secure 0 0 0) 0x7ff7e4148f80 con 0x7ff7e4147ab0 2023-10-03T19:18:31.959 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:18:31.960 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":85,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:18:29.264683+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:18:25.942883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-10-03T19:18:27.242940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:18:31.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.961+0000 7ff7e99c7640 1 -- 172.21.15.45:0/2552147718 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff7c40662b0 msgr2=0x7ff7c4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:31.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.961+0000 7ff7e99c7640 1 --2- 172.21.15.45:0/2552147718 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff7c40662b0 0x7ff7c4068760 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc009790 tx=0x7ff7cc008040 comp rx=0 tx=0).stop 2023-10-03T19:18:31.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.961+0000 7ff7e99c7640 1 -- 172.21.15.45:0/2552147718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7e4147ab0 msgr2=0x7ff7e4149260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:31.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.961+0000 7ff7e99c7640 1 --2- 172.21.15.45:0/2552147718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7e4147ab0 0x7ff7e4149260 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc01d870 tx=0x7ff7dc01bf60 comp rx=0 tx=0).stop 2023-10-03T19:18:31.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.961+0000 7ff7e99c7640 1 -- 172.21.15.45:0/2552147718 shutdown_connections 2023-10-03T19:18:31.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.961+0000 7ff7e99c7640 1 --2- 172.21.15.45:0/2552147718 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff7c40662b0 0x7ff7c4068760 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:31.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.961+0000 7ff7e99c7640 1 --2- 172.21.15.45:0/2552147718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7e4147ab0 0x7ff7e4149260 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:31.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.961+0000 7ff7e99c7640 1 --2- 172.21.15.45:0/2552147718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7e40a3670 0x7ff7e4071a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:31.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.961+0000 7ff7e99c7640 1 --2- 172.21.15.45:0/2552147718 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7e406cd40 0x7ff7e40b98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:31.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.961+0000 7ff7e99c7640 1 -- 172.21.15.45:0/2552147718 >> 172.21.15.45:0/2552147718 conn(0x7ff7e40bcf50 msgr2=0x7ff7e4145e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:31.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.961+0000 7ff7e99c7640 1 -- 172.21.15.45:0/2552147718 shutdown_connections 2023-10-03T19:18:31.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:31.961+0000 7ff7e99c7640 1 -- 172.21.15.45:0/2552147718 wait complete. 2023-10-03T19:18:31.978 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-03T19:18:31.979 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:18:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.097+0000 7f217acfd640 1 Processor -- start 2023-10-03T19:18:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.097+0000 7f217acfd640 1 -- start start 2023-10-03T19:18:32.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.097+0000 7f217acfd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f21740c0ee0 0x7f217414fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:32.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.097+0000 7f217acfd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2174071d70 0x7f2174071010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:32.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.097+0000 7f217acfd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2174071820 0x7f217406aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:32.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.097+0000 7f217acfd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21740bd710 con 0x7f2174071d70 2023-10-03T19:18:32.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.097+0000 7f217acfd640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21741501c0 con 0x7f21740c0ee0 2023-10-03T19:18:32.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.097+0000 7f217acfd640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2174070830 con 0x7f2174071820 2023-10-03T19:18:32.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.097+0000 7f2173fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2174071d70 0x7f2174071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:32.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.097+0000 7f2173fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2174071d70 0x7f2174071010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43890/0 (socket says 172.21.15.45:43890) 2023-10-03T19:18:32.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.097+0000 7f2173fff640 1 -- 172.21.15.45:0/3008678025 learned_addr learned my addr 172.21.15.45:0/3008678025 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:32.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.097+0000 7f2178a99640 1 --2- 172.21.15.45:0/3008678025 >> v2:172.21.15.79:3300/0 conn(0x7f21740c0ee0 0x7f217414fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:32.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.097+0000 7f217929a640 1 --2- 172.21.15.45:0/3008678025 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2174071820 0x7f217406aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:32.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.097+0000 7f2173fff640 1 -- 172.21.15.45:0/3008678025 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2174071820 msgr2=0x7f217406aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.097+0000 7f2173fff640 1 --2- 172.21.15.45:0/3008678025 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2174071820 0x7f217406aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.097+0000 7f2173fff640 1 -- 172.21.15.45:0/3008678025 >> v2:172.21.15.79:3300/0 conn(0x7f21740c0ee0 msgr2=0x7f217414fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.097+0000 7f2173fff640 1 --2- 172.21.15.45:0/3008678025 >> v2:172.21.15.79:3300/0 conn(0x7f21740c0ee0 0x7f217414fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.097+0000 7f2173fff640 1 -- 172.21.15.45:0/3008678025 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21740c00e0 con 0x7f2174071d70 2023-10-03T19:18:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.097+0000 7f2178a99640 1 --2- 172.21.15.45:0/3008678025 >> v2:172.21.15.79:3300/0 conn(0x7f21740c0ee0 0x7f217414fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:32.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.097+0000 7f2173fff640 1 --2- 172.21.15.45:0/3008678025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2174071d70 0x7f2174071010 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f2164009870 tx=0x7f216401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a5e823cfbf73955 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:32.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f21737fe640 1 -- 172.21.15.45:0/3008678025 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21640ac600 con 0x7f2174071d70 2023-10-03T19:18:32.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f21737fe640 1 -- 172.21.15.45:0/3008678025 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21640a8050 con 0x7f2174071d70 2023-10-03T19:18:32.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f21737fe640 1 -- 172.21.15.45:0/3008678025 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21640ac980 con 0x7f2174071d70 2023-10-03T19:18:32.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f217acfd640 1 -- 172.21.15.45:0/3008678025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2174071d70 msgr2=0x7f2174071010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:32.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f217acfd640 1 --2- 172.21.15.45:0/3008678025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2174071d70 0x7f2174071010 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f2164009870 tx=0x7f216401c4d0 comp rx=0 tx=0).stop 2023-10-03T19:18:32.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f217acfd640 1 -- 172.21.15.45:0/3008678025 shutdown_connections 2023-10-03T19:18:32.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f217acfd640 1 --2- 172.21.15.45:0/3008678025 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2174071820 0x7f217406aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:32.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f217acfd640 1 --2- 172.21.15.45:0/3008678025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2174071d70 0x7f2174071010 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:32.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f217acfd640 1 --2- 172.21.15.45:0/3008678025 >> v2:172.21.15.79:3300/0 conn(0x7f21740c0ee0 0x7f217414fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:32.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f217acfd640 1 -- 172.21.15.45:0/3008678025 >> 172.21.15.45:0/3008678025 conn(0x7f21740c2280 msgr2=0x7f21740be070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:32.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f217acfd640 1 -- 172.21.15.45:0/3008678025 shutdown_connections 2023-10-03T19:18:32.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f217acfd640 1 -- 172.21.15.45:0/3008678025 wait complete. 2023-10-03T19:18:32.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f217acfd640 1 Processor -- start 2023-10-03T19:18:32.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f217acfd640 1 -- start start 2023-10-03T19:18:32.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f217acfd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2174071820 0x7f2174144d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:32.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f217acfd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2174071d70 0x7f21740babc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:32.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f217acfd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21740c0ee0 0x7f21740bb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:32.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f217acfd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21740ba4c0 con 0x7f21740c0ee0 2023-10-03T19:18:32.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f217acfd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21740b91f0 con 0x7f2174071d70 2023-10-03T19:18:32.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f217acfd640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21741452b0 con 0x7f2174071820 2023-10-03T19:18:32.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f217929a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21740c0ee0 0x7f21740bb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:32.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f217929a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21740c0ee0 0x7f21740bb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43896/0 (socket says 172.21.15.45:43896) 2023-10-03T19:18:32.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f217929a640 1 -- 172.21.15.45:0/273077036 learned_addr learned my addr 172.21.15.45:0/273077036 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:32.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f2173fff640 1 --2- 172.21.15.45:0/273077036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2174071d70 0x7f21740babc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:32.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f2178a99640 1 --2- 172.21.15.45:0/273077036 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2174071820 0x7f2174144d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:32.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f217929a640 1 -- 172.21.15.45:0/273077036 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2174071820 msgr2=0x7f2174144d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:32.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f217929a640 1 --2- 172.21.15.45:0/273077036 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2174071820 0x7f2174144d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:32.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f217929a640 1 -- 172.21.15.45:0/273077036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2174071d70 msgr2=0x7f21740babc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:32.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f217929a640 1 --2- 172.21.15.45:0/273077036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2174071d70 0x7f21740babc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:32.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f217929a640 1 -- 172.21.15.45:0/273077036 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21640094d0 con 0x7f21740c0ee0 2023-10-03T19:18:32.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f217929a640 1 --2- 172.21.15.45:0/273077036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21740c0ee0 0x7f21740bb100 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f216c00cb80 tx=0x7f216c00a4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:32.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f21717fa640 1 -- 172.21.15.45:0/273077036 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c00ce70 con 0x7f21740c0ee0 2023-10-03T19:18:32.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f21717fa640 1 -- 172.21.15.45:0/273077036 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216c00abd0 con 0x7f21740c0ee0 2023-10-03T19:18:32.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f217acfd640 1 -- 172.21.15.45:0/273077036 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21740c08b0 con 0x7f21740c0ee0 2023-10-03T19:18:32.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f21717fa640 1 -- 172.21.15.45:0/273077036 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c011410 con 0x7f21740c0ee0 2023-10-03T19:18:32.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.101+0000 7f217acfd640 1 -- 172.21.15.45:0/273077036 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2174071550 con 0x7f21740c0ee0 2023-10-03T19:18:32.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.105+0000 7f217acfd640 1 -- 172.21.15.45:0/273077036 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21740c12b0 con 0x7f21740c0ee0 2023-10-03T19:18:32.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.105+0000 7f21717fa640 1 -- 172.21.15.45:0/273077036 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f216c011570 con 0x7f21740c0ee0 2023-10-03T19:18:32.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.105+0000 7f21717fa640 1 --2- 172.21.15.45:0/273077036 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2154066280 0x7f2154068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:32.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.105+0000 7f21717fa640 1 -- 172.21.15.45:0/273077036 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f216c083f40 con 0x7f21740c0ee0 2023-10-03T19:18:32.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.105+0000 7f2178a99640 1 --2- 172.21.15.45:0/273077036 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2154066280 0x7f2154068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:32.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.105+0000 7f2178a99640 1 --2- 172.21.15.45:0/273077036 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2154066280 0x7f2154068730 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f215c00a9a0 tx=0x7f215c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:32.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.109+0000 7f21717fa640 1 -- 172.21.15.45:0/273077036 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f216c0513c0 con 0x7f21740c0ee0 2023-10-03T19:18:32.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.261+0000 7f217acfd640 1 -- 172.21.15.45:0/273077036 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f21740a2d40 con 0x7f2154066280 2023-10-03T19:18:32.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.281+0000 7f21717fa640 1 -- 172.21.15.45:0/273077036 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+301621 (secure 0 0 0) 0x7f21740a2d40 con 0x7f2154066280 2023-10-03T19:18:32.288 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:18:32.290 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:18:32.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.285+0000 7f217acfd640 1 -- 172.21.15.45:0/273077036 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2154066280 msgr2=0x7f2154068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:32.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.285+0000 7f217acfd640 1 --2- 172.21.15.45:0/273077036 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2154066280 0x7f2154068730 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f215c00a9a0 tx=0x7f215c008040 comp rx=0 tx=0).stop 2023-10-03T19:18:32.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.285+0000 7f217acfd640 1 -- 172.21.15.45:0/273077036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21740c0ee0 msgr2=0x7f21740bb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:32.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.285+0000 7f217acfd640 1 --2- 172.21.15.45:0/273077036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21740c0ee0 0x7f21740bb100 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f216c00cb80 tx=0x7f216c00a4c0 comp rx=0 tx=0).stop 2023-10-03T19:18:32.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.285+0000 7f217acfd640 1 -- 172.21.15.45:0/273077036 shutdown_connections 2023-10-03T19:18:32.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.285+0000 7f217acfd640 1 --2- 172.21.15.45:0/273077036 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2154066280 0x7f2154068730 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:32.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.285+0000 7f217acfd640 1 --2- 172.21.15.45:0/273077036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21740c0ee0 0x7f21740bb100 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:32.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.285+0000 7f217acfd640 1 --2- 172.21.15.45:0/273077036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2174071d70 0x7f21740babc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:32.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.285+0000 7f217acfd640 1 --2- 172.21.15.45:0/273077036 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2174071820 0x7f2174144d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:32.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.285+0000 7f217acfd640 1 -- 172.21.15.45:0/273077036 >> 172.21.15.45:0/273077036 conn(0x7f21740c2280 msgr2=0x7f2174069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:32.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.285+0000 7f217acfd640 1 -- 172.21.15.45:0/273077036 shutdown_connections 2023-10-03T19:18:32.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.285+0000 7f217acfd640 1 -- 172.21.15.45:0/273077036 wait complete. 2023-10-03T19:18:32.307 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":265,"stamp":"2023-10-03T19:18:30.574698+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591932,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":166,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":118,"acting":118,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":53,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239308,"kb_used_data":7948,"kb_used_omap":0,"kb_used_meta":231296,"kb_avail":754735412,"statfs":{"total":773094113280,"available":772849061888,"internally_reserved":0,"allocated":8138752,"data_stored":4782826,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":236847104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,5],"upper_bound":64},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1564,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001058"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.289218+0000","last_change":"2023-10-03T19:18:28.328864+0000","last_active":"2023-10-03T19:18:29.289218+0000","last_peered":"2023-10-03T19:18:29.289218+0000","last_clean":"2023-10-03T19:18:29.289218+0000","last_became_active":"2023-10-03T19:18:28.328245+0000","last_became_peered":"2023-10-03T19:18:28.328245+0000","last_unstale":"2023-10-03T19:18:29.289218+0000","last_undegraded":"2023-10-03T19:18:29.289218+0000","last_fullsized":"2023-10-03T19:18:29.289218+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:58:34.901171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.311782+0000","last_change":"2023-10-03T19:18:28.306112+0000","last_active":"2023-10-03T19:18:28.311782+0000","last_peered":"2023-10-03T19:18:28.311782+0000","last_clean":"2023-10-03T19:18:28.311782+0000","last_became_active":"2023-10-03T19:18:28.305892+0000","last_became_peered":"2023-10-03T19:18:28.305892+0000","last_unstale":"2023-10-03T19:18:28.311782+0000","last_undegraded":"2023-10-03T19:18:28.311782+0000","last_fullsized":"2023-10-03T19:18:28.311782+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:47:42.538838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.311485+0000","last_change":"2023-10-03T19:18:28.300383+0000","last_active":"2023-10-03T19:18:28.311485+0000","last_peered":"2023-10-03T19:18:28.311485+0000","last_clean":"2023-10-03T19:18:28.311485+0000","last_became_active":"2023-10-03T19:18:28.299971+0000","last_became_peered":"2023-10-03T19:18:28.299971+0000","last_unstale":"2023-10-03T19:18:28.311485+0000","last_undegraded":"2023-10-03T19:18:28.311485+0000","last_fullsized":"2023-10-03T19:18:28.311485+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:42:49.365331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.307401+0000","last_change":"2023-10-03T19:18:28.295747+0000","last_active":"2023-10-03T19:18:28.307401+0000","last_peered":"2023-10-03T19:18:28.307401+0000","last_clean":"2023-10-03T19:18:28.307401+0000","last_became_active":"2023-10-03T19:18:28.295443+0000","last_became_peered":"2023-10-03T19:18:28.295443+0000","last_unstale":"2023-10-03T19:18:28.307401+0000","last_undegraded":"2023-10-03T19:18:28.307401+0000","last_fullsized":"2023-10-03T19:18:28.307401+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:07:12.490810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.288159+0000","last_change":"2023-10-03T19:18:28.328299+0000","last_active":"2023-10-03T19:18:29.288159+0000","last_peered":"2023-10-03T19:18:29.288159+0000","last_clean":"2023-10-03T19:18:29.288159+0000","last_became_active":"2023-10-03T19:18:28.327734+0000","last_became_peered":"2023-10-03T19:18:28.327734+0000","last_unstale":"2023-10-03T19:18:29.288159+0000","last_undegraded":"2023-10-03T19:18:29.288159+0000","last_fullsized":"2023-10-03T19:18:29.288159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:20:59.841863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.287749+0000","last_change":"2023-10-03T19:18:28.328658+0000","last_active":"2023-10-03T19:18:29.287749+0000","last_peered":"2023-10-03T19:18:29.287749+0000","last_clean":"2023-10-03T19:18:29.287749+0000","last_became_active":"2023-10-03T19:18:28.328085+0000","last_became_peered":"2023-10-03T19:18:28.328085+0000","last_unstale":"2023-10-03T19:18:29.287749+0000","last_undegraded":"2023-10-03T19:18:29.287749+0000","last_fullsized":"2023-10-03T19:18:29.287749+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:57:16.079812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.309571+0000","last_change":"2023-10-03T19:18:28.300052+0000","last_active":"2023-10-03T19:18:28.309571+0000","last_peered":"2023-10-03T19:18:28.309571+0000","last_clean":"2023-10-03T19:18:28.309571+0000","last_became_active":"2023-10-03T19:18:28.299408+0000","last_became_peered":"2023-10-03T19:18:28.299408+0000","last_unstale":"2023-10-03T19:18:28.309571+0000","last_undegraded":"2023-10-03T19:18:28.309571+0000","last_fullsized":"2023-10-03T19:18:28.309571+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:54:05.919812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.329082+0000","last_change":"2023-10-03T19:18:28.328085+0000","last_active":"2023-10-03T19:18:28.329082+0000","last_peered":"2023-10-03T19:18:28.329082+0000","last_clean":"2023-10-03T19:18:28.329082+0000","last_became_active":"2023-10-03T19:18:28.327778+0000","last_became_peered":"2023-10-03T19:18:28.327778+0000","last_unstale":"2023-10-03T19:18:28.329082+0000","last_undegraded":"2023-10-03T19:18:28.329082+0000","last_fullsized":"2023-10-03T19:18:28.329082+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:30:13.410494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-10-03T19:18:26.874638+0000","last_change":"2023-10-03T19:18:26.874638+0000","last_active":"2023-10-03T19:18:26.852089+0000","last_peered":"2023-10-03T19:18:26.852089+0000","last_clean":"2023-10-03T19:18:26.852089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:26.874638+0000","last_undegraded":"2023-10-03T19:18:26.874638+0000","last_fullsized":"2023-10-03T19:18:26.874638+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.310945+0000","last_change":"2023-10-03T19:18:28.299703+0000","last_active":"2023-10-03T19:18:28.310945+0000","last_peered":"2023-10-03T19:18:28.310945+0000","last_clean":"2023-10-03T19:18:28.310945+0000","last_became_active":"2023-10-03T19:18:28.296041+0000","last_became_peered":"2023-10-03T19:18:28.296041+0000","last_unstale":"2023-10-03T19:18:28.310945+0000","last_undegraded":"2023-10-03T19:18:28.310945+0000","last_fullsized":"2023-10-03T19:18:28.310945+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:13:27.385558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-10-03T19:18:26.879993+0000","last_change":"2023-10-03T19:18:26.879993+0000","last_active":"2023-10-03T19:18:26.852089+0000","last_peered":"2023-10-03T19:18:26.852089+0000","last_clean":"2023-10-03T19:18:26.852089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:26.879993+0000","last_undegraded":"2023-10-03T19:18:26.879993+0000","last_fullsized":"2023-10-03T19:18:26.879993+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-10-03T19:18:26.889701+0000","last_change":"2023-10-03T19:18:26.889701+0000","last_active":"2023-10-03T19:18:26.852089+0000","last_peered":"2023-10-03T19:18:26.852089+0000","last_clean":"2023-10-03T19:18:26.852089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:26.889701+0000","last_undegraded":"2023-10-03T19:18:26.889701+0000","last_fullsized":"2023-10-03T19:18:26.889701+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.315919+0000","last_change":"2023-10-03T19:18:28.314092+0000","last_active":"2023-10-03T19:18:28.315919+0000","last_peered":"2023-10-03T19:18:28.315919+0000","last_clean":"2023-10-03T19:18:28.315919+0000","last_became_active":"2023-10-03T19:18:28.313799+0000","last_became_peered":"2023-10-03T19:18:28.313799+0000","last_unstale":"2023-10-03T19:18:28.315919+0000","last_undegraded":"2023-10-03T19:18:28.315919+0000","last_fullsized":"2023-10-03T19:18:28.315919+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:16:00.929112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-10-03T19:18:26.877447+0000","last_change":"2023-10-03T19:18:26.877447+0000","last_active":"2023-10-03T19:18:26.852089+0000","last_peered":"2023-10-03T19:18:26.852089+0000","last_clean":"2023-10-03T19:18:26.852089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:26.877447+0000","last_undegraded":"2023-10-03T19:18:26.877447+0000","last_fullsized":"2023-10-03T19:18:26.877447+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-10-03T19:18:26.879542+0000","last_change":"2023-10-03T19:18:26.879542+0000","last_active":"2023-10-03T19:18:26.852089+0000","last_peered":"2023-10-03T19:18:26.852089+0000","last_clean":"2023-10-03T19:18:26.852089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:26.879542+0000","last_undegraded":"2023-10-03T19:18:26.879542+0000","last_fullsized":"2023-10-03T19:18:26.879542+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-10-03T19:18:26.876838+0000","last_change":"2023-10-03T19:18:26.876838+0000","last_active":"2023-10-03T19:18:26.852089+0000","last_peered":"2023-10-03T19:18:26.852089+0000","last_clean":"2023-10-03T19:18:26.852089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:26.876838+0000","last_undegraded":"2023-10-03T19:18:26.876838+0000","last_fullsized":"2023-10-03T19:18:26.876838+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.311803+0000","last_change":"2023-10-03T19:18:28.306569+0000","last_active":"2023-10-03T19:18:28.311803+0000","last_peered":"2023-10-03T19:18:28.311803+0000","last_clean":"2023-10-03T19:18:28.311803+0000","last_became_active":"2023-10-03T19:18:28.306279+0000","last_became_peered":"2023-10-03T19:18:28.306279+0000","last_unstale":"2023-10-03T19:18:28.311803+0000","last_undegraded":"2023-10-03T19:18:28.311803+0000","last_fullsized":"2023-10-03T19:18:28.311803+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:19:23.709654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:26.852089+0000","last_change":"2023-10-03T19:18:26.852089+0000","last_active":"2023-10-03T19:18:26.852089+0000","last_peered":"2023-10-03T19:18:26.852089+0000","last_clean":"2023-10-03T19:18:26.852089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:26.852089+0000","last_undegraded":"2023-10-03T19:18:26.852089+0000","last_fullsized":"2023-10-03T19:18:26.852089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-10-03T19:18:26.886206+0000","last_change":"2023-10-03T19:18:26.886206+0000","last_active":"2023-10-03T19:18:26.852089+0000","last_peered":"2023-10-03T19:18:26.852089+0000","last_clean":"2023-10-03T19:18:26.852089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:26.886206+0000","last_undegraded":"2023-10-03T19:18:26.886206+0000","last_fullsized":"2023-10-03T19:18:26.886206+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.288525+0000","last_change":"2023-10-03T19:18:27.911615+0000","last_active":"2023-10-03T19:18:29.288525+0000","last_peered":"2023-10-03T19:18:29.288525+0000","last_clean":"2023-10-03T19:18:29.288525+0000","last_became_active":"2023-10-03T19:18:27.910752+0000","last_became_peered":"2023-10-03T19:18:27.910752+0000","last_unstale":"2023-10-03T19:18:29.288525+0000","last_undegraded":"2023-10-03T19:18:29.288525+0000","last_fullsized":"2023-10-03T19:18:29.288525+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:39:47.312275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:26.852089+0000","last_change":"2023-10-03T19:18:26.852089+0000","last_active":"2023-10-03T19:18:26.852089+0000","last_peered":"2023-10-03T19:18:26.852089+0000","last_clean":"2023-10-03T19:18:26.852089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:26.852089+0000","last_undegraded":"2023-10-03T19:18:26.852089+0000","last_fullsized":"2023-10-03T19:18:26.852089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-10-03T19:18:26.881407+0000","last_change":"2023-10-03T19:18:26.881407+0000","last_active":"2023-10-03T19:18:26.852089+0000","last_peered":"2023-10-03T19:18:26.852089+0000","last_clean":"2023-10-03T19:18:26.852089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:26.881407+0000","last_undegraded":"2023-10-03T19:18:26.881407+0000","last_fullsized":"2023-10-03T19:18:26.881407+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"84'6","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.332033+0000","last_change":"2023-10-03T19:18:27.916171+0000","last_active":"2023-10-03T19:18:28.332033+0000","last_peered":"2023-10-03T19:18:28.332033+0000","last_clean":"2023-10-03T19:18:28.332033+0000","last_became_active":"2023-10-03T19:18:27.915765+0000","last_became_peered":"2023-10-03T19:18:27.915765+0000","last_unstale":"2023-10-03T19:18:28.332033+0000","last_undegraded":"2023-10-03T19:18:28.332033+0000","last_fullsized":"2023-10-03T19:18:28.332033+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:07:59.015939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-10-03T19:18:26.888526+0000","last_change":"2023-10-03T19:18:26.888526+0000","last_active":"2023-10-03T19:18:26.852089+0000","last_peered":"2023-10-03T19:18:26.852089+0000","last_clean":"2023-10-03T19:18:26.852089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:26.888526+0000","last_undegraded":"2023-10-03T19:18:26.888526+0000","last_fullsized":"2023-10-03T19:18:26.888526+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.290656+0000","last_change":"2023-10-03T19:18:27.906734+0000","last_active":"2023-10-03T19:18:28.290656+0000","last_peered":"2023-10-03T19:18:28.290656+0000","last_clean":"2023-10-03T19:18:28.290656+0000","last_became_active":"2023-10-03T19:18:27.906245+0000","last_became_peered":"2023-10-03T19:18:27.906245+0000","last_unstale":"2023-10-03T19:18:28.290656+0000","last_undegraded":"2023-10-03T19:18:28.290656+0000","last_fullsized":"2023-10-03T19:18:28.290656+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:33:11.428854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-10-03T19:18:26.876839+0000","last_change":"2023-10-03T19:18:26.876839+0000","last_active":"2023-10-03T19:18:26.852089+0000","last_peered":"2023-10-03T19:18:26.852089+0000","last_clean":"2023-10-03T19:18:26.852089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:26.876839+0000","last_undegraded":"2023-10-03T19:18:26.876839+0000","last_fullsized":"2023-10-03T19:18:26.876839+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-10-03T19:18:26.876821+0000","last_change":"2023-10-03T19:18:26.876821+0000","last_active":"2023-10-03T19:18:26.852089+0000","last_peered":"2023-10-03T19:18:26.852089+0000","last_clean":"2023-10-03T19:18:26.852089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:26.876821+0000","last_undegraded":"2023-10-03T19:18:26.876821+0000","last_fullsized":"2023-10-03T19:18:26.876821+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-10-03T19:18:26.885705+0000","last_change":"2023-10-03T19:18:26.885705+0000","last_active":"2023-10-03T19:18:26.852089+0000","last_peered":"2023-10-03T19:18:26.852089+0000","last_clean":"2023-10-03T19:18:26.852089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:26.885705+0000","last_undegraded":"2023-10-03T19:18:26.885705+0000","last_fullsized":"2023-10-03T19:18:26.885705+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.329091+0000","last_change":"2023-10-03T19:18:28.328052+0000","last_active":"2023-10-03T19:18:28.329091+0000","last_peered":"2023-10-03T19:18:28.329091+0000","last_clean":"2023-10-03T19:18:28.329091+0000","last_became_active":"2023-10-03T19:18:28.327708+0000","last_became_peered":"2023-10-03T19:18:28.327708+0000","last_unstale":"2023-10-03T19:18:28.329091+0000","last_undegraded":"2023-10-03T19:18:28.329091+0000","last_fullsized":"2023-10-03T19:18:28.329091+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:48:05.949581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-10-03T19:18:26.878917+0000","last_change":"2023-10-03T19:18:26.878917+0000","last_active":"2023-10-03T19:18:26.852089+0000","last_peered":"2023-10-03T19:18:26.852089+0000","last_clean":"2023-10-03T19:18:26.852089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:26.878917+0000","last_undegraded":"2023-10-03T19:18:26.878917+0000","last_fullsized":"2023-10-03T19:18:26.878917+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.307423+0000","last_change":"2023-10-03T19:18:28.295866+0000","last_active":"2023-10-03T19:18:28.307423+0000","last_peered":"2023-10-03T19:18:28.307423+0000","last_clean":"2023-10-03T19:18:28.307423+0000","last_became_active":"2023-10-03T19:18:28.295542+0000","last_became_peered":"2023-10-03T19:18:28.295542+0000","last_unstale":"2023-10-03T19:18:28.307423+0000","last_undegraded":"2023-10-03T19:18:28.307423+0000","last_fullsized":"2023-10-03T19:18:28.307423+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:10:22.532926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-10-03T19:18:26.878989+0000","last_change":"2023-10-03T19:18:26.878989+0000","last_active":"2023-10-03T19:18:26.852089+0000","last_peered":"2023-10-03T19:18:26.852089+0000","last_clean":"2023-10-03T19:18:26.852089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:26.878989+0000","last_undegraded":"2023-10-03T19:18:26.878989+0000","last_fullsized":"2023-10-03T19:18:26.878989+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.288344+0000","last_change":"2023-10-03T19:18:28.333940+0000","last_active":"2023-10-03T19:18:29.288344+0000","last_peered":"2023-10-03T19:18:29.288344+0000","last_clean":"2023-10-03T19:18:29.288344+0000","last_became_active":"2023-10-03T19:18:28.333172+0000","last_became_peered":"2023-10-03T19:18:28.333172+0000","last_unstale":"2023-10-03T19:18:29.288344+0000","last_undegraded":"2023-10-03T19:18:29.288344+0000","last_fullsized":"2023-10-03T19:18:29.288344+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:25:59.676571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-10-03T19:18:26.875687+0000","last_change":"2023-10-03T19:18:26.875687+0000","last_active":"2023-10-03T19:18:26.852089+0000","last_peered":"2023-10-03T19:18:26.852089+0000","last_clean":"2023-10-03T19:18:26.852089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:26.875687+0000","last_undegraded":"2023-10-03T19:18:26.875687+0000","last_fullsized":"2023-10-03T19:18:26.875687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.290898+0000","last_change":"2023-10-03T19:18:27.904288+0000","last_active":"2023-10-03T19:18:28.290898+0000","last_peered":"2023-10-03T19:18:28.290898+0000","last_clean":"2023-10-03T19:18:28.290898+0000","last_became_active":"2023-10-03T19:18:27.904010+0000","last_became_peered":"2023-10-03T19:18:27.904010+0000","last_unstale":"2023-10-03T19:18:28.290898+0000","last_undegraded":"2023-10-03T19:18:28.290898+0000","last_fullsized":"2023-10-03T19:18:28.290898+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:19:37.643789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.288852+0000","last_change":"2023-10-03T19:18:27.911380+0000","last_active":"2023-10-03T19:18:29.288852+0000","last_peered":"2023-10-03T19:18:29.288852+0000","last_clean":"2023-10-03T19:18:29.288852+0000","last_became_active":"2023-10-03T19:18:27.910631+0000","last_became_peered":"2023-10-03T19:18:27.910631+0000","last_unstale":"2023-10-03T19:18:29.288852+0000","last_undegraded":"2023-10-03T19:18:29.288852+0000","last_fullsized":"2023-10-03T19:18:29.288852+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:35:30.965063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-10-03T19:18:26.874600+0000","last_change":"2023-10-03T19:18:26.874600+0000","last_active":"2023-10-03T19:18:26.852089+0000","last_peered":"2023-10-03T19:18:26.852089+0000","last_clean":"2023-10-03T19:18:26.852089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:26.874600+0000","last_undegraded":"2023-10-03T19:18:26.874600+0000","last_fullsized":"2023-10-03T19:18:26.874600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.309377+0000","last_change":"2023-10-03T19:18:28.299048+0000","last_active":"2023-10-03T19:18:28.309377+0000","last_peered":"2023-10-03T19:18:28.309377+0000","last_clean":"2023-10-03T19:18:28.309377+0000","last_became_active":"2023-10-03T19:18:28.294610+0000","last_became_peered":"2023-10-03T19:18:28.294610+0000","last_unstale":"2023-10-03T19:18:28.309377+0000","last_undegraded":"2023-10-03T19:18:28.309377+0000","last_fullsized":"2023-10-03T19:18:28.309377+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:47:43.385105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-10-03T19:18:26.884180+0000","last_change":"2023-10-03T19:18:26.884180+0000","last_active":"2023-10-03T19:18:26.852089+0000","last_peered":"2023-10-03T19:18:26.852089+0000","last_clean":"2023-10-03T19:18:26.852089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:26.884180+0000","last_undegraded":"2023-10-03T19:18:26.884180+0000","last_fullsized":"2023-10-03T19:18:26.884180+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-10-03T19:18:26.876874+0000","last_change":"2023-10-03T19:18:26.876874+0000","last_active":"2023-10-03T19:18:26.852089+0000","last_peered":"2023-10-03T19:18:26.852089+0000","last_clean":"2023-10-03T19:18:26.852089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:26.876874+0000","last_undegraded":"2023-10-03T19:18:26.876874+0000","last_fullsized":"2023-10-03T19:18:26.876874+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":284,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-03T19:18:26.887078+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:18:26.887078+0000","last_peered":"2023-10-03T19:18:26.887078+0000","last_clean":"2023-10-03T19:18:26.887078+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:18:26.887078+0000","last_undegraded":"2023-10-03T19:18:26.887078+0000","last_fullsized":"2023-10-03T19:18:26.887078+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:19:06.354766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":137,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.287949+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:18:29.287949+0000","last_peered":"2023-10-03T19:18:29.287949+0000","last_clean":"2023-10-03T19:18:29.287949+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:18:29.287949+0000","last_undegraded":"2023-10-03T19:18:29.287949+0000","last_fullsized":"2023-10-03T19:18:29.287949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:38:40.158112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.329061+0000","last_change":"2023-10-03T19:18:28.328075+0000","last_active":"2023-10-03T19:18:28.329061+0000","last_peered":"2023-10-03T19:18:28.329061+0000","last_clean":"2023-10-03T19:18:28.329061+0000","last_became_active":"2023-10-03T19:18:28.327798+0000","last_became_peered":"2023-10-03T19:18:28.327798+0000","last_unstale":"2023-10-03T19:18:28.329061+0000","last_undegraded":"2023-10-03T19:18:28.329061+0000","last_fullsized":"2023-10-03T19:18:28.329061+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:45:59.256826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-10-03T19:18:26.875905+0000","last_change":"2023-10-03T19:18:26.875905+0000","last_active":"2023-10-03T19:18:26.852089+0000","last_peered":"2023-10-03T19:18:26.852089+0000","last_clean":"2023-10-03T19:18:26.852089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:26.875905+0000","last_undegraded":"2023-10-03T19:18:26.875905+0000","last_fullsized":"2023-10-03T19:18:26.875905+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":132,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-03T19:18:26.886948+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:18:26.886948+0000","last_peered":"2023-10-03T19:18:26.886948+0000","last_clean":"2023-10-03T19:18:26.886948+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:18:26.886948+0000","last_undegraded":"2023-10-03T19:18:26.886948+0000","last_fullsized":"2023-10-03T19:18:26.886948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:13:11.558136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-10-03T19:18:26.885676+0000","last_change":"2023-10-03T19:18:26.885676+0000","last_active":"2023-10-03T19:18:26.852089+0000","last_peered":"2023-10-03T19:18:26.852089+0000","last_clean":"2023-10-03T19:18:26.852089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:26.885676+0000","last_undegraded":"2023-10-03T19:18:26.885676+0000","last_fullsized":"2023-10-03T19:18:26.885676+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":129,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-03T19:18:26.875664+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:18:26.875664+0000","last_peered":"2023-10-03T19:18:26.875664+0000","last_clean":"2023-10-03T19:18:26.875664+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:18:26.875664+0000","last_undegraded":"2023-10-03T19:18:26.875664+0000","last_fullsized":"2023-10-03T19:18:26.875664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:06:03.718195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:18:27.862490+0000","last_change":"2023-10-03T19:18:27.862490+0000","last_active":"2023-10-03T19:18:27.862490+0000","last_peered":"2023-10-03T19:18:27.862490+0000","last_clean":"2023-10-03T19:18:27.862490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:27.862490+0000","last_undegraded":"2023-10-03T19:18:27.862490+0000","last_fullsized":"2023-10-03T19:18:27.862490+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-10-03T19:18:26.880223+0000","last_change":"2023-10-03T19:18:26.880223+0000","last_active":"2023-10-03T19:18:26.852089+0000","last_peered":"2023-10-03T19:18:26.852089+0000","last_clean":"2023-10-03T19:18:26.852089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:26.880223+0000","last_undegraded":"2023-10-03T19:18:26.880223+0000","last_fullsized":"2023-10-03T19:18:26.880223+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":137,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.288795+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:18:29.288795+0000","last_peered":"2023-10-03T19:18:29.288795+0000","last_clean":"2023-10-03T19:18:29.288795+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:18:29.288795+0000","last_undegraded":"2023-10-03T19:18:29.288795+0000","last_fullsized":"2023-10-03T19:18:29.288795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:16:51.487559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.311838+0000","last_change":"2023-10-03T19:18:28.305959+0000","last_active":"2023-10-03T19:18:28.311838+0000","last_peered":"2023-10-03T19:18:28.311838+0000","last_clean":"2023-10-03T19:18:28.311838+0000","last_became_active":"2023-10-03T19:18:28.305671+0000","last_became_peered":"2023-10-03T19:18:28.305671+0000","last_unstale":"2023-10-03T19:18:28.311838+0000","last_undegraded":"2023-10-03T19:18:28.311838+0000","last_fullsized":"2023-10-03T19:18:28.311838+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:24:55.603298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"84'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.287743+0000","last_change":"2023-10-03T19:18:27.921745+0000","last_active":"2023-10-03T19:18:29.287743+0000","last_peered":"2023-10-03T19:18:29.287743+0000","last_clean":"2023-10-03T19:18:29.287743+0000","last_became_active":"2023-10-03T19:18:27.914884+0000","last_became_peered":"2023-10-03T19:18:27.914884+0000","last_unstale":"2023-10-03T19:18:29.287743+0000","last_undegraded":"2023-10-03T19:18:29.287743+0000","last_fullsized":"2023-10-03T19:18:29.287743+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:33:51.571616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":127,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-03T19:18:26.877802+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:18:26.877802+0000","last_peered":"2023-10-03T19:18:26.877802+0000","last_clean":"2023-10-03T19:18:26.877802+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:18:26.877802+0000","last_undegraded":"2023-10-03T19:18:26.877802+0000","last_fullsized":"2023-10-03T19:18:26.877802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:53:31.945307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.288088+0000","last_change":"2023-10-03T19:18:28.328282+0000","last_active":"2023-10-03T19:18:29.288088+0000","last_peered":"2023-10-03T19:18:29.288088+0000","last_clean":"2023-10-03T19:18:29.288088+0000","last_became_active":"2023-10-03T19:18:28.327432+0000","last_became_peered":"2023-10-03T19:18:28.327432+0000","last_unstale":"2023-10-03T19:18:29.288088+0000","last_undegraded":"2023-10-03T19:18:29.288088+0000","last_fullsized":"2023-10-03T19:18:29.288088+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:00:19.571613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-10-03T19:18:26.874456+0000","last_change":"2023-10-03T19:18:26.874456+0000","last_active":"2023-10-03T19:18:26.852089+0000","last_peered":"2023-10-03T19:18:26.852089+0000","last_clean":"2023-10-03T19:18:26.852089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:26.874456+0000","last_undegraded":"2023-10-03T19:18:26.874456+0000","last_fullsized":"2023-10-03T19:18:26.874456+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":131,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-03T19:18:26.890408+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:18:26.890408+0000","last_peered":"2023-10-03T19:18:26.890408+0000","last_clean":"2023-10-03T19:18:26.890408+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:18:26.890408+0000","last_undegraded":"2023-10-03T19:18:26.890408+0000","last_fullsized":"2023-10-03T19:18:26.890408+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:03:01.558149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.288685+0000","last_change":"2023-10-03T19:18:28.328892+0000","last_active":"2023-10-03T19:18:29.288685+0000","last_peered":"2023-10-03T19:18:29.288685+0000","last_clean":"2023-10-03T19:18:29.288685+0000","last_became_active":"2023-10-03T19:18:28.327728+0000","last_became_peered":"2023-10-03T19:18:28.327728+0000","last_unstale":"2023-10-03T19:18:29.288685+0000","last_undegraded":"2023-10-03T19:18:29.288685+0000","last_fullsized":"2023-10-03T19:18:29.288685+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:10:17.456066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.288404+0000","last_change":"2023-10-03T19:18:27.922546+0000","last_active":"2023-10-03T19:18:29.288404+0000","last_peered":"2023-10-03T19:18:29.288404+0000","last_clean":"2023-10-03T19:18:29.288404+0000","last_became_active":"2023-10-03T19:18:27.921928+0000","last_became_peered":"2023-10-03T19:18:27.921928+0000","last_unstale":"2023-10-03T19:18:29.288404+0000","last_undegraded":"2023-10-03T19:18:29.288404+0000","last_fullsized":"2023-10-03T19:18:29.288404+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:54:40.203407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":127,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-03T19:18:26.877600+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:18:26.877600+0000","last_peered":"2023-10-03T19:18:26.877600+0000","last_clean":"2023-10-03T19:18:26.877600+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:18:26.877600+0000","last_undegraded":"2023-10-03T19:18:26.877600+0000","last_fullsized":"2023-10-03T19:18:26.877600+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:52:17.051867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.309461+0000","last_change":"2023-10-03T19:18:28.299842+0000","last_active":"2023-10-03T19:18:28.309461+0000","last_peered":"2023-10-03T19:18:28.309461+0000","last_clean":"2023-10-03T19:18:28.309461+0000","last_became_active":"2023-10-03T19:18:28.299535+0000","last_became_peered":"2023-10-03T19:18:28.299535+0000","last_unstale":"2023-10-03T19:18:28.309461+0000","last_undegraded":"2023-10-03T19:18:28.309461+0000","last_fullsized":"2023-10-03T19:18:28.309461+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:15:54.771062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-10-03T19:18:26.874457+0000","last_change":"2023-10-03T19:18:26.874457+0000","last_active":"2023-10-03T19:18:26.852089+0000","last_peered":"2023-10-03T19:18:26.852089+0000","last_clean":"2023-10-03T19:18:26.852089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:18:26.874457+0000","last_undegraded":"2023-10-03T19:18:26.874457+0000","last_fullsized":"2023-10-03T19:18:26.874457+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":127,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-03T19:18:26.884642+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:18:26.884642+0000","last_peered":"2023-10-03T19:18:26.884642+0000","last_clean":"2023-10-03T19:18:26.884642+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:18:26.884642+0000","last_undegraded":"2023-10-03T19:18:26.884642+0000","last_fullsized":"2023-10-03T19:18:26.884642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:28:29.646238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":1564,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":60,"acting":60,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":40,"acting":40,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509516,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33100,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":32064,"kb_avail":94338740,"statfs":{"total":96636764160,"available":96602869760,"internally_reserved":0,"allocated":1052672,"data_stored":1034258,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":32833536},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.87,"15min":0.93200000000000005},"min":{"1min":0.503,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1399999999999999,"5min":4.0469999999999997,"15min":4.0469999999999997},"last":1.044},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.85499999999999998,"15min":0.81100000000000005},"min":{"1min":0.55100000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1699999999999999,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.91400000000000003}]},{"osd":1,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.90000000000000002,"15min":1.012},"min":{"1min":0.59999999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.194,"5min":3.8239999999999998,"15min":3.8239999999999998},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.88600000000000001,"15min":0.85999999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2609999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.0700000000000001}]},{"osd":2,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.94099999999999995,"15min":0.871},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.236,"5min":6.0449999999999999,"15min":6.0449999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.96899999999999997,"15min":1.0289999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2949999999999999,"5min":3.98,"15min":3.98},"last":0.88}]},{"osd":3,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0249999999999999,"15min":0.95399999999999996},"min":{"1min":0.64700000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":3.3940000000000001,"5min":6.125,"15min":6.125},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.038,"15min":1.1120000000000001},"min":{"1min":0.77800000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1259999999999999,"5min":3.9140000000000001,"15min":3.9140000000000001},"last":0.71899999999999997}]},{"osd":4,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.96799999999999997,"15min":1.1379999999999999},"min":{"1min":0.63800000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1160000000000001,"5min":5.1130000000000004,"15min":5.1130000000000004},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.012,"5min":1.018,"15min":1.0269999999999999},"min":{"1min":0.67900000000000005,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.3380000000000001,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":0.97799999999999998}]},{"osd":5,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.0680000000000001,"15min":1.246},"min":{"1min":0.69499999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2250000000000001,"5min":5.1859999999999999,"15min":5.1859999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.0449999999999999,"15min":1.133},"min":{"1min":0.82199999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.163,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.1499999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.085,"15min":1.097},"min":{"1min":0.75700000000000001,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.2190000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.105,"5min":1.1619999999999999,"15min":1.1799999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.3999999999999999,"5min":6.1580000000000004,"15min":6.1580000000000004},"last":1.1859999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509516,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26260,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":25280,"kb_avail":94345580,"statfs":{"total":96636764160,"available":96609873920,"internally_reserved":0,"allocated":995328,"data_stored":448896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25886720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:17:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.84399999999999997,"15min":0.82199999999999995},"min":{"1min":0.45400000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3340000000000001,"5min":1.504,"15min":1.504},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.89000000000000001,"15min":0.88200000000000001},"min":{"1min":0.58099999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1950000000000001,"5min":1.839,"15min":1.839},"last":0.95199999999999996}]},{"osd":1,"last update":"Tue Oct 3 19:17:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.85999999999999999,"15min":0.84199999999999997},"min":{"1min":0.53900000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.27,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.90000000000000002,"15min":0.88400000000000001},"min":{"1min":0.58199999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1879999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.74099999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:17:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.93000000000000005,"15min":0.878},"min":{"1min":0.66100000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1890000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.91400000000000003,"15min":0.92400000000000004},"min":{"1min":0.60199999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.369,"5min":1.546,"15min":1.546},"last":0.80000000000000004}]},{"osd":3,"last update":"Tue Oct 3 19:17:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95899999999999996,"15min":0.97899999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1859999999999999,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.90500000000000003,"15min":0.90800000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.206,"5min":2.121,"15min":2.121},"last":0.88700000000000001}]},{"osd":4,"last update":"Tue Oct 3 19:17:29 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.94899999999999995,"15min":1.018},"min":{"1min":0.64900000000000002,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.28,"5min":1.95,"15min":1.95},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0069999999999999,"15min":1.0820000000000001},"min":{"1min":0.68999999999999995,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2989999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.032}]},{"osd":5,"last update":"Tue Oct 3 19:17:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.94399999999999995,"15min":1.01},"min":{"1min":0.65100000000000002,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.276,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0669999999999999,"15min":1.1160000000000001},"min":{"1min":0.70699999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.3420000000000001,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.997}]},{"osd":7,"last update":"Tue Oct 3 19:17:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0740000000000001,"15min":1.115},"min":{"1min":0.81200000000000006,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.3049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.125},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.05,"15min":1.0900000000000001},"min":{"1min":0.70199999999999996,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3420000000000001,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.0569999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41420,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":40448,"kb_avail":94330420,"statfs":{"total":96636764160,"available":96594350080,"internally_reserved":0,"allocated":987136,"data_stored":443890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":41418752},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":1.0669999999999999,"15min":0.86699999999999999},"min":{"1min":0.58699999999999997,"5min":0.54700000000000004,"15min":0.50600000000000001},"max":{"1min":1.2430000000000001,"5min":17.686,"15min":17.686},"last":1.1970000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":1.016,"15min":0.88400000000000001},"min":{"1min":0.52500000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0549999999999999,"5min":16.925999999999998,"15min":16.925999999999998},"last":0.90700000000000003}]},{"osd":1,"last update":"Tue Oct 3 19:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":1.0780000000000001,"15min":0.98399999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.7829999999999999,"5min":16.640999999999998,"15min":16.640999999999998},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.92100000000000004,"5min":1.1000000000000001,"15min":0.92900000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3100000000000001,"5min":17.59,"15min":17.59},"last":0.80500000000000005}]},{"osd":2,"last update":"Tue Oct 3 19:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.02,"15min":0.94399999999999995},"min":{"1min":0.64100000000000001,"5min":0.56200000000000006,"15min":0.53200000000000003},"max":{"1min":1.2310000000000001,"5min":8.5630000000000006,"15min":8.5630000000000006},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.016,"5min":1.163,"15min":1.01},"min":{"1min":0.80000000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.7450000000000001,"5min":17.734000000000002,"15min":17.734000000000002},"last":1.2470000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.073,"15min":0.93700000000000006},"min":{"1min":0.61499999999999999,"5min":0.55600000000000005,"15min":0.53900000000000003},"max":{"1min":1.2769999999999999,"5min":16.98,"15min":16.98},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.179,"15min":1.1100000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.5229999999999999,"5min":16.434000000000001,"15min":16.434000000000001},"last":0.85099999999999998}]},{"osd":5,"last update":"Tue Oct 3 19:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.129,"15min":1.0960000000000001},"min":{"1min":0.70399999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.8360000000000001,"5min":17.782,"15min":17.782},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.96799999999999997,"15min":1.0069999999999999},"min":{"1min":0.68100000000000005,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.72399999999999998}]},{"osd":6,"last update":"Tue Oct 3 19:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.391,"15min":1.288},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.9970000000000001,"5min":36.106000000000002,"15min":36.106000000000002},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.099,"5min":1.2470000000000001,"15min":1.226},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.8859999999999999,"5min":17.646999999999998,"15min":17.646999999999998},"last":1.119}]},{"osd":7,"last update":"Tue Oct 3 19:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.2070000000000001,"15min":1.137},"min":{"1min":0.77900000000000003,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.466,"5min":17.042000000000002,"15min":17.042000000000002},"last":1.153},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.3069999999999999,"15min":1.2689999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.63300000000000001},"max":{"1min":1.915,"5min":16.32,"15min":16.32},"last":1.085}]}]},{"osd":2,"up_from":15,"seq":64424509517,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31956,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":995328,"data_stored":448896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61899999999999999,"15min":0.54600000000000004},"min":{"1min":0.32200000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.87,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.71699999999999997,"15min":0.63700000000000001},"min":{"1min":0.34699999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.137,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.70899999999999996}]},{"osd":1,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73899999999999999,"15min":0.64200000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.68799999999999994,"15min":0.60899999999999999},"min":{"1min":0.34799999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.92900000000000005,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.54900000000000004}]},{"osd":3,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73299999999999998,"15min":0.64300000000000002},"min":{"1min":0.28899999999999998,"5min":0.224,"15min":0.224},"max":{"1min":1.323,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.84399999999999997,"15min":0.74299999999999999},"min":{"1min":0.45600000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.57599999999999996}]},{"osd":4,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.93000000000000005,"15min":0.86199999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.4550000000000001,"5min":1.718,"15min":1.718},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0089999999999999,"15min":0.93100000000000005},"min":{"1min":0.67900000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.754}]},{"osd":5,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.98699999999999999,"15min":0.88900000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":0.67500000000000004},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.0780000000000001,"15min":0.96899999999999997},"min":{"1min":0.57599999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":3.4849999999999999,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.88100000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.97999999999999998,"15min":0.92700000000000005},"min":{"1min":0.60099999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.0740000000000001,"15min":0.98799999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.92800000000000005}]},{"osd":7,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1180000000000001,"15min":1.026},"min":{"1min":0.63100000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4670000000000001,"5min":1.76,"15min":1.76},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.038,"5min":1.044,"15min":0.97499999999999998},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.494,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.86799999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509516,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29900,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":28928,"kb_avail":94341940,"statfs":{"total":96636764160,"available":96606146560,"internally_reserved":0,"allocated":987136,"data_stored":443890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29622272},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59299999999999997,"15min":0.55100000000000005},"min":{"1min":0.30499999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.77100000000000002,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.67900000000000005,"15min":0.54100000000000004},"min":{"1min":0.27200000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.80800000000000005}]},{"osd":2,"last update":"Tue Oct 3 19:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.66900000000000004,"15min":0.57299999999999995},"min":{"1min":0.34799999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.93600000000000005,"5min":1.506,"15min":1.506},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.68500000000000005},"min":{"1min":0.41299999999999998,"5min":0.312,"15min":0.312},"max":{"1min":1.252,"5min":1.365,"15min":1.365},"last":1.1870000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.75700000000000001,"15min":0.65400000000000003},"min":{"1min":0.36599999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.75,"15min":0.61399999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.2310000000000001,"5min":1.27,"15min":1.27},"last":1.232}]},{"osd":4,"last update":"Tue Oct 3 19:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.88800000000000001,"15min":0.81599999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.292,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.04,"5min":0.97199999999999998,"15min":0.90600000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.323}]},{"osd":5,"last update":"Tue Oct 3 19:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.97399999999999998,"15min":0.878},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.044},{"interface":"front","average":{"1min":1.03,"5min":0.95999999999999996,"15min":0.872},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.256,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.2849999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:17:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.032,"15min":0.94199999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.518,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.022,"15min":0.91800000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.4419999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:17:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.073,"15min":0.96299999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0369999999999999,"15min":0.92600000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4430000000000001,"5min":1.649,"15min":1.649},"last":1.4119999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542220,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24588,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":23616,"kb_avail":94347252,"statfs":{"total":96636764160,"available":96611586048,"internally_reserved":0,"allocated":987136,"data_stored":443890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24182784},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63700000000000001,"15min":0.58099999999999996},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.1779999999999999,"5min":1.212,"15min":1.212},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.69499999999999995,"15min":0.65100000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.68400000000000005}]},{"osd":1,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.69799999999999995,"15min":0.63800000000000001},"min":{"1min":0.29499999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0880000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.754,"15min":0.67900000000000005},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.1599999999999999,"5min":1.222,"15min":1.222},"last":1.075}]},{"osd":2,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.78600000000000003,"15min":0.71899999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73399999999999999,"15min":0.64500000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.94799999999999995}]},{"osd":4,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.93100000000000005,"15min":0.91100000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3169999999999999,"5min":1.496,"15min":1.496},"last":1.147},{"interface":"front","average":{"1min":1.04,"5min":1.002,"15min":0.94599999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.538,"5min":1.546,"15min":1.546},"last":0.90600000000000003}]},{"osd":5,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92900000000000005,"15min":0.88600000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.026,"15min":1},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.419,"5min":1.498,"15min":1.498},"last":1.2330000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.96799999999999997,"15min":0.92700000000000005},"min":{"1min":0.56999999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.046,"15min":0.99399999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.4970000000000001,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.292}]},{"osd":7,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0649999999999999,"15min":1.0149999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0800000000000001,"15min":1.0269999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.526,"5min":1.708,"15min":1.708},"last":1.109}]}]},{"osd":5,"up_from":13,"seq":55834574924,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22384,"kb_used_data":1000,"kb_used_omap":0,"kb_used_meta":21376,"kb_avail":94349456,"statfs":{"total":96636764160,"available":96613842944,"internally_reserved":0,"allocated":1024000,"data_stored":463816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21889024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.88,"15min":0.83399999999999996},"min":{"1min":0.58499999999999996,"5min":0.437,"15min":0.437},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.85399999999999998,"15min":0.85199999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0389999999999999,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.64500000000000002}]},{"osd":1,"last update":"Tue Oct 3 19:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86099999999999999,"15min":0.83699999999999997},"min":{"1min":0.59099999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.70699999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.159,"5min":1.514,"15min":1.514},"last":0.85499999999999998}]},{"osd":2,"last update":"Tue Oct 3 19:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91200000000000003,"15min":0.89900000000000002},"min":{"1min":0.63400000000000001,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.351,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90900000000000003,"15min":0.89700000000000002},"min":{"1min":0.57099999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0880000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.90600000000000003}]},{"osd":3,"last update":"Tue Oct 3 19:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.92800000000000005,"15min":0.92700000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.038},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0389999999999999,"15min":1.0289999999999999},"min":{"1min":0.83599999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.222,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.95699999999999996}]},{"osd":4,"last update":"Tue Oct 3 19:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.67500000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.3180000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.24},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.97999999999999998,"15min":1.026},"min":{"1min":0.67300000000000004,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.2689999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.0760000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:17:35 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.98399999999999999,"15min":1.03},"min":{"1min":0.64600000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2909999999999999,"5min":1.462,"15min":1.462},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.107,"15min":1.133},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.4159999999999999,"5min":1.823,"15min":1.823},"last":1.1639999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:17:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0609999999999999,"15min":1.075},"min":{"1min":0.84699999999999998,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.2589999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.159,"5min":1.1419999999999999,"15min":1.1519999999999999},"min":{"1min":0.87,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.413,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.1140000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574925,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29700,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":28608,"kb_avail":94342140,"statfs":{"total":96636764160,"available":96606351360,"internally_reserved":0,"allocated":1110016,"data_stored":1055290,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":29294592},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,5],"upper_bound":64},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63900000000000001,"15min":0.58899999999999997},"min":{"1min":0.39600000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.871,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":5.7480000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.72199999999999998},"min":{"1min":0.37,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.1279999999999999,"5min":1.27,"15min":1.27},"last":6.274}]},{"osd":2,"last update":"Tue Oct 3 19:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.751,"15min":0.72299999999999998},"min":{"1min":0.47299999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3080000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":6.1609999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72499999999999998,"15min":0.69699999999999995},"min":{"1min":0.33800000000000002,"5min":0.315,"15min":0.315},"max":{"1min":1.04,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.47699999999999998}]},{"osd":3,"last update":"Tue Oct 3 19:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.85699999999999998,"15min":0.749},"min":{"1min":0.51500000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.409,"5min":1.446,"15min":1.446},"last":2.3439999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.81200000000000006,"15min":0.71399999999999997},"min":{"1min":0.41999999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.103,"5min":1.375,"15min":1.375},"last":0.436}]},{"osd":4,"last update":"Tue Oct 3 19:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.92000000000000004,"15min":0.90800000000000003},"min":{"1min":0.65400000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3520000000000001,"5min":1.52,"15min":1.52},"last":8.1159999999999997},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.046,"15min":1.026},"min":{"1min":0.65200000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.393,"5min":1.508,"15min":1.508},"last":6.2320000000000002}]},{"osd":5,"last update":"Tue Oct 3 19:17:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0720000000000001,"15min":1.05},"min":{"1min":0.68999999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4359999999999999,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":17.420000000000002},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.0229999999999999,"15min":0.98299999999999998},"min":{"1min":0.68600000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3959999999999999,"5min":1.837,"15min":1.837},"last":17.643000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.052,"15min":1.02},"min":{"1min":0.66800000000000004,"5min":0.623,"15min":0.623},"max":{"1min":1.26,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":5.7220000000000004},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.05,"15min":1.002},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4750000000000001,"5min":1.637,"15min":1.637},"last":2.2290000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:17:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.097,"15min":1.046},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.488,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":5.7800000000000002},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.083,"15min":1.0609999999999999},"min":{"1min":0.68799999999999994,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3400000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.9810000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:18:32.313 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:18:32.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.477+0000 7f2349a41640 1 Processor -- start 2023-10-03T19:18:32.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.477+0000 7f2349a41640 1 -- start start 2023-10-03T19:18:32.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.477+0000 7f2349a41640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2344148b90 0x7f23440bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:32.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.477+0000 7f2349a41640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23440bc4a0 0x7f234406c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:32.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.477+0000 7f2349a41640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f234414b610 con 0x7f23440bcb60 2023-10-03T19:18:32.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.477+0000 7f2349a41640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23440a3670 con 0x7f2344148b90 2023-10-03T19:18:32.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.477+0000 7f2349a41640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f234414b370 con 0x7f23440bc4a0 2023-10-03T19:18:32.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.477+0000 7f2342ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2344148b90 0x7f23440bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:32.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.477+0000 7f23427fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f23440bcb60 0x7f234406c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54762/0 (socket says 172.21.15.45:54762) 2023-10-03T19:18:32.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.477+0000 7f23427fc640 1 -- 172.21.15.45:0/267278147 learned_addr learned my addr 172.21.15.45:0/267278147 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:18:32.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.477+0000 7f23437fe640 1 --2- 172.21.15.45:0/267278147 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23440bc4a0 0x7f234406c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:32.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.477+0000 7f2342ffd640 1 -- 172.21.15.45:0/267278147 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23440bc4a0 msgr2=0x7f234406c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:32.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.477+0000 7f2341ffb640 1 -- 172.21.15.45:0/267278147 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2505143705 0 0) 0x7f234414b610 con 0x7f23440bcb60 2023-10-03T19:18:32.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.477+0000 7f2342ffd640 1 --2- 172.21.15.45:0/267278147 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23440bc4a0 0x7f234406c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:32.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.477+0000 7f2342ffd640 1 -- 172.21.15.45:0/267278147 >> v1:172.21.15.45:6789/0 conn(0x7f23440bcb60 legacy=0x7f234406c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:32.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.477+0000 7f2342ffd640 1 -- 172.21.15.45:0/267278147 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23440a5580 con 0x7f2344148b90 2023-10-03T19:18:32.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.477+0000 7f23437fe640 1 --2- 172.21.15.45:0/267278147 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23440bc4a0 0x7f234406c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:32.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.481+0000 7f2342ffd640 1 --2- 172.21.15.45:0/267278147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2344148b90 0x7f23440bbf60 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f233c0097c0 tx=0x7f233c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb12686e7edff25 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:32.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.481+0000 7f2341ffb640 1 -- 172.21.15.45:0/267278147 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c0a8970 con 0x7f2344148b90 2023-10-03T19:18:32.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.481+0000 7f2341ffb640 1 -- 172.21.15.45:0/267278147 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c0a8ad0 con 0x7f2344148b90 2023-10-03T19:18:32.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.481+0000 7f2341ffb640 1 -- 172.21.15.45:0/267278147 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c0a8e60 con 0x7f2344148b90 2023-10-03T19:18:32.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.481+0000 7f2349a41640 1 -- 172.21.15.45:0/267278147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2344148b90 msgr2=0x7f23440bbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:32.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.481+0000 7f2349a41640 1 --2- 172.21.15.45:0/267278147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2344148b90 0x7f23440bbf60 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f233c0097c0 tx=0x7f233c01ec70 comp rx=0 tx=0).stop 2023-10-03T19:18:32.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.481+0000 7f2349a41640 1 -- 172.21.15.45:0/267278147 shutdown_connections 2023-10-03T19:18:32.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.481+0000 7f2349a41640 1 --2- 172.21.15.45:0/267278147 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23440bc4a0 0x7f234406c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:32.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.481+0000 7f2349a41640 1 --2- 172.21.15.45:0/267278147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2344148b90 0x7f23440bbf60 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:32.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.481+0000 7f2349a41640 1 -- 172.21.15.45:0/267278147 >> 172.21.15.45:0/267278147 conn(0x7f23440bcf50 msgr2=0x7f23440bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:32.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.481+0000 7f2349a41640 1 -- 172.21.15.45:0/267278147 shutdown_connections 2023-10-03T19:18:32.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.481+0000 7f2349a41640 1 -- 172.21.15.45:0/267278147 wait complete. 2023-10-03T19:18:32.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.481+0000 7f2349a41640 1 Processor -- start 2023-10-03T19:18:32.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.481+0000 7f2349a41640 1 -- start start 2023-10-03T19:18:32.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.481+0000 7f2349a41640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23440bc4a0 0x7f23441e5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:32.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.481+0000 7f2349a41640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23440bcb60 0x7f23440b9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:32.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.481+0000 7f2349a41640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2344148b90 0x7f23440b7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:32.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.481+0000 7f2349a41640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23440b8880 con 0x7f23440bc4a0 2023-10-03T19:18:32.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.481+0000 7f2349a41640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23441e56c0 con 0x7f23440bcb60 2023-10-03T19:18:32.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.481+0000 7f2349a41640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23440b6630 con 0x7f2344148b90 2023-10-03T19:18:32.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.485+0000 7f2342ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23440bc4a0 0x7f23441e5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:32.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.485+0000 7f2342ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23440bc4a0 0x7f23441e5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43908/0 (socket says 172.21.15.45:43908) 2023-10-03T19:18:32.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.485+0000 7f2342ffd640 1 -- 172.21.15.45:0/295051491 learned_addr learned my addr 172.21.15.45:0/295051491 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:32.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.485+0000 7f2342ffd640 1 -- 172.21.15.45:0/295051491 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2344148b90 msgr2=0x7f23440b7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:32.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.485+0000 7f2342ffd640 1 --2- 172.21.15.45:0/295051491 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2344148b90 0x7f23440b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:32.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.485+0000 7f2342ffd640 1 -- 172.21.15.45:0/295051491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23440bcb60 msgr2=0x7f23440b9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:32.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.485+0000 7f2342ffd640 1 --2- 172.21.15.45:0/295051491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23440bcb60 0x7f23440b9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:32.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.485+0000 7f2342ffd640 1 -- 172.21.15.45:0/295051491 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c009420 con 0x7f23440bc4a0 2023-10-03T19:18:32.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.485+0000 7f2342ffd640 1 --2- 172.21.15.45:0/295051491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23440bc4a0 0x7f23441e5180 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f233c0b3040 tx=0x7f233c01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:32.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.485+0000 7f232bfff640 1 -- 172.21.15.45:0/295051491 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c0b9630 con 0x7f23440bc4a0 2023-10-03T19:18:32.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.485+0000 7f232bfff640 1 -- 172.21.15.45:0/295051491 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c0b9790 con 0x7f23440bc4a0 2023-10-03T19:18:32.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.485+0000 7f2349a41640 1 -- 172.21.15.45:0/295051491 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f234406cee0 con 0x7f23440bc4a0 2023-10-03T19:18:32.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.485+0000 7f232bfff640 1 -- 172.21.15.45:0/295051491 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c0b9b40 con 0x7f23440bc4a0 2023-10-03T19:18:32.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.485+0000 7f2349a41640 1 -- 172.21.15.45:0/295051491 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23440a5820 con 0x7f23440bc4a0 2023-10-03T19:18:32.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.485+0000 7f2349a41640 1 -- 172.21.15.45:0/295051491 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2344148f60 con 0x7f23440bc4a0 2023-10-03T19:18:32.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.485+0000 7f232bfff640 1 -- 172.21.15.45:0/295051491 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f233c0b7040 con 0x7f23440bc4a0 2023-10-03T19:18:32.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.485+0000 7f232bfff640 1 --2- 172.21.15.45:0/295051491 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f23300662b0 0x7f2330068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:32.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.485+0000 7f232bfff640 1 -- 172.21.15.45:0/295051491 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f233c1225d0 con 0x7f23440bc4a0 2023-10-03T19:18:32.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.485+0000 7f23427fc640 1 --2- 172.21.15.45:0/295051491 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f23300662b0 0x7f2330068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:32.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.489+0000 7f23427fc640 1 --2- 172.21.15.45:0/295051491 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f23300662b0 0x7f2330068760 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2338001570 tx=0x7f2338007cb0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:32.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.489+0000 7f232bfff640 1 -- 172.21.15.45:0/295051491 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f233c0efb30 con 0x7f23440bc4a0 2023-10-03T19:18:32.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.637+0000 7f2349a41640 1 -- 172.21.15.45:0/295051491 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f234404de80 con 0x7f23300662b0 2023-10-03T19:18:32.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.661+0000 7f232bfff640 1 -- 172.21.15.45:0/295051491 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310242 (secure 0 0 0) 0x7f234404de80 con 0x7f23300662b0 2023-10-03T19:18:32.666 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:18:32.668 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:18:32.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.665+0000 7f2349a41640 1 -- 172.21.15.45:0/295051491 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f23300662b0 msgr2=0x7f2330068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:32.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.665+0000 7f2349a41640 1 --2- 172.21.15.45:0/295051491 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f23300662b0 0x7f2330068760 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2338001570 tx=0x7f2338007cb0 comp rx=0 tx=0).stop 2023-10-03T19:18:32.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.665+0000 7f2349a41640 1 -- 172.21.15.45:0/295051491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23440bc4a0 msgr2=0x7f23441e5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:32.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.665+0000 7f2349a41640 1 --2- 172.21.15.45:0/295051491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23440bc4a0 0x7f23441e5180 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f233c0b3040 tx=0x7f233c01ba10 comp rx=0 tx=0).stop 2023-10-03T19:18:32.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.665+0000 7f2349a41640 1 -- 172.21.15.45:0/295051491 shutdown_connections 2023-10-03T19:18:32.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.665+0000 7f2349a41640 1 --2- 172.21.15.45:0/295051491 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f23300662b0 0x7f2330068760 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:32.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.665+0000 7f2349a41640 1 --2- 172.21.15.45:0/295051491 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2344148b90 0x7f23440b7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:32.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.665+0000 7f2349a41640 1 --2- 172.21.15.45:0/295051491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23440bcb60 0x7f23440b9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:32.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.665+0000 7f2349a41640 1 --2- 172.21.15.45:0/295051491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23440bc4a0 0x7f23441e5180 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:32.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.665+0000 7f2349a41640 1 -- 172.21.15.45:0/295051491 >> 172.21.15.45:0/295051491 conn(0x7f23440bcf50 msgr2=0x7f2344147dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:32.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.665+0000 7f2349a41640 1 -- 172.21.15.45:0/295051491 shutdown_connections 2023-10-03T19:18:32.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.665+0000 7f2349a41640 1 -- 172.21.15.45:0/295051491 wait complete. 2023-10-03T19:18:32.682 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":266,"stamp":"2023-10-03T19:18:32.575381+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240572,"kb_used_data":8252,"kb_used_omap":0,"kb_used_meta":232256,"kb_avail":754734148,"statfs":{"total":773094113280,"available":772847767552,"internally_reserved":0,"allocated":8450048,"data_stored":4932414,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":237830144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,5],"upper_bound":64},"perf_stat":{"commit_latency_ms":79,"apply_latency_ms":79,"commit_latency_ns":79000000,"apply_latency_ns":79000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.706963"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.257874+0000","last_change":"2023-10-03T19:18:28.297227+0000","last_active":"2023-10-03T19:18:30.257874+0000","last_peered":"2023-10-03T19:18:30.257874+0000","last_clean":"2023-10-03T19:18:30.257874+0000","last_became_active":"2023-10-03T19:18:28.296796+0000","last_became_peered":"2023-10-03T19:18:28.296796+0000","last_unstale":"2023-10-03T19:18:30.257874+0000","last_undegraded":"2023-10-03T19:18:30.257874+0000","last_fullsized":"2023-10-03T19:18:30.257874+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:27:45.396716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.289218+0000","last_change":"2023-10-03T19:18:28.328864+0000","last_active":"2023-10-03T19:18:29.289218+0000","last_peered":"2023-10-03T19:18:29.289218+0000","last_clean":"2023-10-03T19:18:29.289218+0000","last_became_active":"2023-10-03T19:18:28.328245+0000","last_became_peered":"2023-10-03T19:18:28.328245+0000","last_unstale":"2023-10-03T19:18:29.289218+0000","last_undegraded":"2023-10-03T19:18:29.289218+0000","last_fullsized":"2023-10-03T19:18:29.289218+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:58:34.901171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.257234+0000","last_change":"2023-10-03T19:18:28.309308+0000","last_active":"2023-10-03T19:18:30.257234+0000","last_peered":"2023-10-03T19:18:30.257234+0000","last_clean":"2023-10-03T19:18:30.257234+0000","last_became_active":"2023-10-03T19:18:28.309066+0000","last_became_peered":"2023-10-03T19:18:28.309066+0000","last_unstale":"2023-10-03T19:18:30.257234+0000","last_undegraded":"2023-10-03T19:18:30.257234+0000","last_fullsized":"2023-10-03T19:18:30.257234+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:24:17.986818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.281909+0000","last_change":"2023-10-03T19:18:28.313309+0000","last_active":"2023-10-03T19:18:29.281909+0000","last_peered":"2023-10-03T19:18:29.281909+0000","last_clean":"2023-10-03T19:18:29.281909+0000","last_became_active":"2023-10-03T19:18:28.313069+0000","last_became_peered":"2023-10-03T19:18:28.313069+0000","last_unstale":"2023-10-03T19:18:29.281909+0000","last_undegraded":"2023-10-03T19:18:29.281909+0000","last_fullsized":"2023-10-03T19:18:29.281909+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:18:54.202789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.287296+0000","last_change":"2023-10-03T19:18:28.323490+0000","last_active":"2023-10-03T19:18:29.287296+0000","last_peered":"2023-10-03T19:18:29.287296+0000","last_clean":"2023-10-03T19:18:29.287296+0000","last_became_active":"2023-10-03T19:18:28.311540+0000","last_became_peered":"2023-10-03T19:18:28.311540+0000","last_unstale":"2023-10-03T19:18:29.287296+0000","last_undegraded":"2023-10-03T19:18:29.287296+0000","last_fullsized":"2023-10-03T19:18:29.287296+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:36:47.226369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.311782+0000","last_change":"2023-10-03T19:18:28.306112+0000","last_active":"2023-10-03T19:18:28.311782+0000","last_peered":"2023-10-03T19:18:28.311782+0000","last_clean":"2023-10-03T19:18:28.311782+0000","last_became_active":"2023-10-03T19:18:28.305892+0000","last_became_peered":"2023-10-03T19:18:28.305892+0000","last_unstale":"2023-10-03T19:18:28.311782+0000","last_undegraded":"2023-10-03T19:18:28.311782+0000","last_fullsized":"2023-10-03T19:18:28.311782+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:47:42.538838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.260606+0000","last_change":"2023-10-03T19:18:28.318112+0000","last_active":"2023-10-03T19:18:30.260606+0000","last_peered":"2023-10-03T19:18:30.260606+0000","last_clean":"2023-10-03T19:18:30.260606+0000","last_became_active":"2023-10-03T19:18:28.317176+0000","last_became_peered":"2023-10-03T19:18:28.317176+0000","last_unstale":"2023-10-03T19:18:30.260606+0000","last_undegraded":"2023-10-03T19:18:30.260606+0000","last_fullsized":"2023-10-03T19:18:30.260606+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:58:30.782183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.279405+0000","last_change":"2023-10-03T19:18:28.301940+0000","last_active":"2023-10-03T19:18:29.279405+0000","last_peered":"2023-10-03T19:18:29.279405+0000","last_clean":"2023-10-03T19:18:29.279405+0000","last_became_active":"2023-10-03T19:18:28.301455+0000","last_became_peered":"2023-10-03T19:18:28.301455+0000","last_unstale":"2023-10-03T19:18:29.279405+0000","last_undegraded":"2023-10-03T19:18:29.279405+0000","last_fullsized":"2023-10-03T19:18:29.279405+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:19:07.816939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.287561+0000","last_change":"2023-10-03T19:18:28.329964+0000","last_active":"2023-10-03T19:18:29.287561+0000","last_peered":"2023-10-03T19:18:29.287561+0000","last_clean":"2023-10-03T19:18:29.287561+0000","last_became_active":"2023-10-03T19:18:28.329472+0000","last_became_peered":"2023-10-03T19:18:28.329472+0000","last_unstale":"2023-10-03T19:18:29.287561+0000","last_undegraded":"2023-10-03T19:18:29.287561+0000","last_fullsized":"2023-10-03T19:18:29.287561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:58:23.451266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.260923+0000","last_change":"2023-10-03T19:18:28.291921+0000","last_active":"2023-10-03T19:18:30.260923+0000","last_peered":"2023-10-03T19:18:30.260923+0000","last_clean":"2023-10-03T19:18:30.260923+0000","last_became_active":"2023-10-03T19:18:28.291649+0000","last_became_peered":"2023-10-03T19:18:28.291649+0000","last_unstale":"2023-10-03T19:18:30.260923+0000","last_undegraded":"2023-10-03T19:18:30.260923+0000","last_fullsized":"2023-10-03T19:18:30.260923+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:27:56.183221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.289616+0000","last_change":"2023-10-03T19:18:28.313040+0000","last_active":"2023-10-03T19:18:29.289616+0000","last_peered":"2023-10-03T19:18:29.289616+0000","last_clean":"2023-10-03T19:18:29.289616+0000","last_became_active":"2023-10-03T19:18:28.312353+0000","last_became_peered":"2023-10-03T19:18:28.312353+0000","last_unstale":"2023-10-03T19:18:29.289616+0000","last_undegraded":"2023-10-03T19:18:29.289616+0000","last_fullsized":"2023-10-03T19:18:29.289616+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:41:14.386132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.260782+0000","last_change":"2023-10-03T19:18:28.282760+0000","last_active":"2023-10-03T19:18:30.260782+0000","last_peered":"2023-10-03T19:18:30.260782+0000","last_clean":"2023-10-03T19:18:30.260782+0000","last_became_active":"2023-10-03T19:18:28.282172+0000","last_became_peered":"2023-10-03T19:18:28.282172+0000","last_unstale":"2023-10-03T19:18:30.260782+0000","last_undegraded":"2023-10-03T19:18:30.260782+0000","last_fullsized":"2023-10-03T19:18:30.260782+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:02:19.857122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.279528+0000","last_change":"2023-10-03T19:18:28.314652+0000","last_active":"2023-10-03T19:18:29.279528+0000","last_peered":"2023-10-03T19:18:29.279528+0000","last_clean":"2023-10-03T19:18:29.279528+0000","last_became_active":"2023-10-03T19:18:28.314319+0000","last_became_peered":"2023-10-03T19:18:28.314319+0000","last_unstale":"2023-10-03T19:18:29.279528+0000","last_undegraded":"2023-10-03T19:18:29.279528+0000","last_fullsized":"2023-10-03T19:18:29.279528+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:50:27.189791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.289246+0000","last_change":"2023-10-03T19:18:28.304665+0000","last_active":"2023-10-03T19:18:29.289246+0000","last_peered":"2023-10-03T19:18:29.289246+0000","last_clean":"2023-10-03T19:18:29.289246+0000","last_became_active":"2023-10-03T19:18:28.303869+0000","last_became_peered":"2023-10-03T19:18:28.303869+0000","last_unstale":"2023-10-03T19:18:29.289246+0000","last_undegraded":"2023-10-03T19:18:29.289246+0000","last_fullsized":"2023-10-03T19:18:29.289246+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:32:49.385600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.282145+0000","last_change":"2023-10-03T19:18:28.288864+0000","last_active":"2023-10-03T19:18:29.282145+0000","last_peered":"2023-10-03T19:18:29.282145+0000","last_clean":"2023-10-03T19:18:29.282145+0000","last_became_active":"2023-10-03T19:18:28.288696+0000","last_became_peered":"2023-10-03T19:18:28.288696+0000","last_unstale":"2023-10-03T19:18:29.282145+0000","last_undegraded":"2023-10-03T19:18:29.282145+0000","last_fullsized":"2023-10-03T19:18:29.282145+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:32:04.554928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.311485+0000","last_change":"2023-10-03T19:18:28.300383+0000","last_active":"2023-10-03T19:18:28.311485+0000","last_peered":"2023-10-03T19:18:28.311485+0000","last_clean":"2023-10-03T19:18:28.311485+0000","last_became_active":"2023-10-03T19:18:28.299971+0000","last_became_peered":"2023-10-03T19:18:28.299971+0000","last_unstale":"2023-10-03T19:18:28.311485+0000","last_undegraded":"2023-10-03T19:18:28.311485+0000","last_fullsized":"2023-10-03T19:18:28.311485+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:42:49.365331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.307401+0000","last_change":"2023-10-03T19:18:28.295747+0000","last_active":"2023-10-03T19:18:28.307401+0000","last_peered":"2023-10-03T19:18:28.307401+0000","last_clean":"2023-10-03T19:18:28.307401+0000","last_became_active":"2023-10-03T19:18:28.295443+0000","last_became_peered":"2023-10-03T19:18:28.295443+0000","last_unstale":"2023-10-03T19:18:28.307401+0000","last_undegraded":"2023-10-03T19:18:28.307401+0000","last_fullsized":"2023-10-03T19:18:28.307401+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:07:12.490810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.257779+0000","last_change":"2023-10-03T19:18:28.326238+0000","last_active":"2023-10-03T19:18:30.257779+0000","last_peered":"2023-10-03T19:18:30.257779+0000","last_clean":"2023-10-03T19:18:30.257779+0000","last_became_active":"2023-10-03T19:18:28.325937+0000","last_became_peered":"2023-10-03T19:18:28.325937+0000","last_unstale":"2023-10-03T19:18:30.257779+0000","last_undegraded":"2023-10-03T19:18:30.257779+0000","last_fullsized":"2023-10-03T19:18:30.257779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:23:19.103997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.289537+0000","last_change":"2023-10-03T19:18:28.311805+0000","last_active":"2023-10-03T19:18:29.289537+0000","last_peered":"2023-10-03T19:18:29.289537+0000","last_clean":"2023-10-03T19:18:29.289537+0000","last_became_active":"2023-10-03T19:18:28.303024+0000","last_became_peered":"2023-10-03T19:18:28.303024+0000","last_unstale":"2023-10-03T19:18:29.289537+0000","last_undegraded":"2023-10-03T19:18:29.289537+0000","last_fullsized":"2023-10-03T19:18:29.289537+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:56:30.518163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.280169+0000","last_change":"2023-10-03T19:18:28.293980+0000","last_active":"2023-10-03T19:18:29.280169+0000","last_peered":"2023-10-03T19:18:29.280169+0000","last_clean":"2023-10-03T19:18:29.280169+0000","last_became_active":"2023-10-03T19:18:28.293173+0000","last_became_peered":"2023-10-03T19:18:28.293173+0000","last_unstale":"2023-10-03T19:18:29.280169+0000","last_undegraded":"2023-10-03T19:18:29.280169+0000","last_fullsized":"2023-10-03T19:18:29.280169+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:32:53.766768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.286744+0000","last_change":"2023-10-03T19:18:28.310816+0000","last_active":"2023-10-03T19:18:29.286744+0000","last_peered":"2023-10-03T19:18:29.286744+0000","last_clean":"2023-10-03T19:18:29.286744+0000","last_became_active":"2023-10-03T19:18:28.303941+0000","last_became_peered":"2023-10-03T19:18:28.303941+0000","last_unstale":"2023-10-03T19:18:29.286744+0000","last_undegraded":"2023-10-03T19:18:29.286744+0000","last_fullsized":"2023-10-03T19:18:29.286744+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:41:24.266071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.286338+0000","last_change":"2023-10-03T19:18:28.310978+0000","last_active":"2023-10-03T19:18:29.286338+0000","last_peered":"2023-10-03T19:18:29.286338+0000","last_clean":"2023-10-03T19:18:29.286338+0000","last_became_active":"2023-10-03T19:18:28.304159+0000","last_became_peered":"2023-10-03T19:18:28.304159+0000","last_unstale":"2023-10-03T19:18:29.286338+0000","last_undegraded":"2023-10-03T19:18:29.286338+0000","last_fullsized":"2023-10-03T19:18:29.286338+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:41:19.773763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.260764+0000","last_change":"2023-10-03T19:18:28.306946+0000","last_active":"2023-10-03T19:18:30.260764+0000","last_peered":"2023-10-03T19:18:30.260764+0000","last_clean":"2023-10-03T19:18:30.260764+0000","last_became_active":"2023-10-03T19:18:28.306116+0000","last_became_peered":"2023-10-03T19:18:28.306116+0000","last_unstale":"2023-10-03T19:18:30.260764+0000","last_undegraded":"2023-10-03T19:18:30.260764+0000","last_fullsized":"2023-10-03T19:18:30.260764+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:44:19.845993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.257360+0000","last_change":"2023-10-03T19:18:28.308905+0000","last_active":"2023-10-03T19:18:30.257360+0000","last_peered":"2023-10-03T19:18:30.257360+0000","last_clean":"2023-10-03T19:18:30.257360+0000","last_became_active":"2023-10-03T19:18:28.308593+0000","last_became_peered":"2023-10-03T19:18:28.308593+0000","last_unstale":"2023-10-03T19:18:30.257360+0000","last_undegraded":"2023-10-03T19:18:30.257360+0000","last_fullsized":"2023-10-03T19:18:30.257360+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:18:02.797094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.288159+0000","last_change":"2023-10-03T19:18:28.328299+0000","last_active":"2023-10-03T19:18:29.288159+0000","last_peered":"2023-10-03T19:18:29.288159+0000","last_clean":"2023-10-03T19:18:29.288159+0000","last_became_active":"2023-10-03T19:18:28.327734+0000","last_became_peered":"2023-10-03T19:18:28.327734+0000","last_unstale":"2023-10-03T19:18:29.288159+0000","last_undegraded":"2023-10-03T19:18:29.288159+0000","last_fullsized":"2023-10-03T19:18:29.288159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:20:59.841863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.287248+0000","last_change":"2023-10-03T19:18:28.303629+0000","last_active":"2023-10-03T19:18:29.287248+0000","last_peered":"2023-10-03T19:18:29.287248+0000","last_clean":"2023-10-03T19:18:29.287248+0000","last_became_active":"2023-10-03T19:18:28.302845+0000","last_became_peered":"2023-10-03T19:18:28.302845+0000","last_unstale":"2023-10-03T19:18:29.287248+0000","last_undegraded":"2023-10-03T19:18:29.287248+0000","last_fullsized":"2023-10-03T19:18:29.287248+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:45:57.296012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.260861+0000","last_change":"2023-10-03T19:18:28.302268+0000","last_active":"2023-10-03T19:18:30.260861+0000","last_peered":"2023-10-03T19:18:30.260861+0000","last_clean":"2023-10-03T19:18:30.260861+0000","last_became_active":"2023-10-03T19:18:28.301987+0000","last_became_peered":"2023-10-03T19:18:28.301987+0000","last_unstale":"2023-10-03T19:18:30.260861+0000","last_undegraded":"2023-10-03T19:18:30.260861+0000","last_fullsized":"2023-10-03T19:18:30.260861+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:14:46.067220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.280576+0000","last_change":"2023-10-03T19:18:28.308814+0000","last_active":"2023-10-03T19:18:29.280576+0000","last_peered":"2023-10-03T19:18:29.280576+0000","last_clean":"2023-10-03T19:18:29.280576+0000","last_became_active":"2023-10-03T19:18:28.308529+0000","last_became_peered":"2023-10-03T19:18:28.308529+0000","last_unstale":"2023-10-03T19:18:29.280576+0000","last_undegraded":"2023-10-03T19:18:29.280576+0000","last_fullsized":"2023-10-03T19:18:29.280576+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:44:46.372049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.261606+0000","last_change":"2023-10-03T19:18:28.318210+0000","last_active":"2023-10-03T19:18:30.261606+0000","last_peered":"2023-10-03T19:18:30.261606+0000","last_clean":"2023-10-03T19:18:30.261606+0000","last_became_active":"2023-10-03T19:18:28.317311+0000","last_became_peered":"2023-10-03T19:18:28.317311+0000","last_unstale":"2023-10-03T19:18:30.261606+0000","last_undegraded":"2023-10-03T19:18:30.261606+0000","last_fullsized":"2023-10-03T19:18:30.261606+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:34:10.130086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.286860+0000","last_change":"2023-10-03T19:18:28.330141+0000","last_active":"2023-10-03T19:18:29.286860+0000","last_peered":"2023-10-03T19:18:29.286860+0000","last_clean":"2023-10-03T19:18:29.286860+0000","last_became_active":"2023-10-03T19:18:28.329658+0000","last_became_peered":"2023-10-03T19:18:28.329658+0000","last_unstale":"2023-10-03T19:18:29.286860+0000","last_undegraded":"2023-10-03T19:18:29.286860+0000","last_fullsized":"2023-10-03T19:18:29.286860+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:44:36.416576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.287749+0000","last_change":"2023-10-03T19:18:28.328658+0000","last_active":"2023-10-03T19:18:29.287749+0000","last_peered":"2023-10-03T19:18:29.287749+0000","last_clean":"2023-10-03T19:18:29.287749+0000","last_became_active":"2023-10-03T19:18:28.328085+0000","last_became_peered":"2023-10-03T19:18:28.328085+0000","last_unstale":"2023-10-03T19:18:29.287749+0000","last_undegraded":"2023-10-03T19:18:29.287749+0000","last_fullsized":"2023-10-03T19:18:29.287749+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:57:16.079812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.309571+0000","last_change":"2023-10-03T19:18:28.300052+0000","last_active":"2023-10-03T19:18:28.309571+0000","last_peered":"2023-10-03T19:18:28.309571+0000","last_clean":"2023-10-03T19:18:28.309571+0000","last_became_active":"2023-10-03T19:18:28.299408+0000","last_became_peered":"2023-10-03T19:18:28.299408+0000","last_unstale":"2023-10-03T19:18:28.309571+0000","last_undegraded":"2023-10-03T19:18:28.309571+0000","last_fullsized":"2023-10-03T19:18:28.309571+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:54:05.919812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.329082+0000","last_change":"2023-10-03T19:18:28.328085+0000","last_active":"2023-10-03T19:18:28.329082+0000","last_peered":"2023-10-03T19:18:28.329082+0000","last_clean":"2023-10-03T19:18:28.329082+0000","last_became_active":"2023-10-03T19:18:28.327778+0000","last_became_peered":"2023-10-03T19:18:28.327778+0000","last_unstale":"2023-10-03T19:18:28.329082+0000","last_undegraded":"2023-10-03T19:18:28.329082+0000","last_fullsized":"2023-10-03T19:18:28.329082+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:30:13.410494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"84'4","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.262686+0000","last_change":"2023-10-03T19:18:27.917418+0000","last_active":"2023-10-03T19:18:30.262686+0000","last_peered":"2023-10-03T19:18:30.262686+0000","last_clean":"2023-10-03T19:18:30.262686+0000","last_became_active":"2023-10-03T19:18:27.916812+0000","last_became_peered":"2023-10-03T19:18:27.916812+0000","last_unstale":"2023-10-03T19:18:30.262686+0000","last_undegraded":"2023-10-03T19:18:30.262686+0000","last_fullsized":"2023-10-03T19:18:30.262686+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:26:39.506099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.310945+0000","last_change":"2023-10-03T19:18:28.299703+0000","last_active":"2023-10-03T19:18:28.310945+0000","last_peered":"2023-10-03T19:18:28.310945+0000","last_clean":"2023-10-03T19:18:28.310945+0000","last_became_active":"2023-10-03T19:18:28.296041+0000","last_became_peered":"2023-10-03T19:18:28.296041+0000","last_unstale":"2023-10-03T19:18:28.310945+0000","last_undegraded":"2023-10-03T19:18:28.310945+0000","last_fullsized":"2023-10-03T19:18:28.310945+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:13:27.385558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"84'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.287837+0000","last_change":"2023-10-03T19:18:27.918401+0000","last_active":"2023-10-03T19:18:29.287837+0000","last_peered":"2023-10-03T19:18:29.287837+0000","last_clean":"2023-10-03T19:18:29.287837+0000","last_became_active":"2023-10-03T19:18:27.917738+0000","last_became_peered":"2023-10-03T19:18:27.917738+0000","last_unstale":"2023-10-03T19:18:29.287837+0000","last_undegraded":"2023-10-03T19:18:29.287837+0000","last_fullsized":"2023-10-03T19:18:29.287837+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:07:06.800828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.260923+0000","last_change":"2023-10-03T19:18:28.317512+0000","last_active":"2023-10-03T19:18:30.260923+0000","last_peered":"2023-10-03T19:18:30.260923+0000","last_clean":"2023-10-03T19:18:30.260923+0000","last_became_active":"2023-10-03T19:18:28.316818+0000","last_became_peered":"2023-10-03T19:18:28.316818+0000","last_unstale":"2023-10-03T19:18:30.260923+0000","last_undegraded":"2023-10-03T19:18:30.260923+0000","last_fullsized":"2023-10-03T19:18:30.260923+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:26:03.007727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"84'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.260967+0000","last_change":"2023-10-03T19:18:27.908432+0000","last_active":"2023-10-03T19:18:30.260967+0000","last_peered":"2023-10-03T19:18:30.260967+0000","last_clean":"2023-10-03T19:18:30.260967+0000","last_became_active":"2023-10-03T19:18:27.907832+0000","last_became_peered":"2023-10-03T19:18:27.907832+0000","last_unstale":"2023-10-03T19:18:30.260967+0000","last_undegraded":"2023-10-03T19:18:30.260967+0000","last_fullsized":"2023-10-03T19:18:30.260967+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:01:28.080859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.315919+0000","last_change":"2023-10-03T19:18:28.314092+0000","last_active":"2023-10-03T19:18:28.315919+0000","last_peered":"2023-10-03T19:18:28.315919+0000","last_clean":"2023-10-03T19:18:28.315919+0000","last_became_active":"2023-10-03T19:18:28.313799+0000","last_became_peered":"2023-10-03T19:18:28.313799+0000","last_unstale":"2023-10-03T19:18:28.315919+0000","last_undegraded":"2023-10-03T19:18:28.315919+0000","last_fullsized":"2023-10-03T19:18:28.315919+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:16:00.929112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"84'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.262134+0000","last_change":"2023-10-03T19:18:27.918809+0000","last_active":"2023-10-03T19:18:30.262134+0000","last_peered":"2023-10-03T19:18:30.262134+0000","last_clean":"2023-10-03T19:18:30.262134+0000","last_became_active":"2023-10-03T19:18:27.918047+0000","last_became_peered":"2023-10-03T19:18:27.918047+0000","last_unstale":"2023-10-03T19:18:30.262134+0000","last_undegraded":"2023-10-03T19:18:30.262134+0000","last_fullsized":"2023-10-03T19:18:30.262134+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:43:15.777860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.279103+0000","last_change":"2023-10-03T19:18:28.289445+0000","last_active":"2023-10-03T19:18:29.279103+0000","last_peered":"2023-10-03T19:18:29.279103+0000","last_clean":"2023-10-03T19:18:29.279103+0000","last_became_active":"2023-10-03T19:18:28.289117+0000","last_became_peered":"2023-10-03T19:18:28.289117+0000","last_unstale":"2023-10-03T19:18:29.279103+0000","last_undegraded":"2023-10-03T19:18:29.279103+0000","last_fullsized":"2023-10-03T19:18:29.279103+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:05:04.925319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"84'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.287561+0000","last_change":"2023-10-03T19:18:27.905571+0000","last_active":"2023-10-03T19:18:29.287561+0000","last_peered":"2023-10-03T19:18:29.287561+0000","last_clean":"2023-10-03T19:18:29.287561+0000","last_became_active":"2023-10-03T19:18:27.904906+0000","last_became_peered":"2023-10-03T19:18:27.904906+0000","last_unstale":"2023-10-03T19:18:29.287561+0000","last_undegraded":"2023-10-03T19:18:29.287561+0000","last_fullsized":"2023-10-03T19:18:29.287561+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:13:58.462714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.261105+0000","last_change":"2023-10-03T19:18:28.307106+0000","last_active":"2023-10-03T19:18:30.261105+0000","last_peered":"2023-10-03T19:18:30.261105+0000","last_clean":"2023-10-03T19:18:30.261105+0000","last_became_active":"2023-10-03T19:18:28.306080+0000","last_became_peered":"2023-10-03T19:18:28.306080+0000","last_unstale":"2023-10-03T19:18:30.261105+0000","last_undegraded":"2023-10-03T19:18:30.261105+0000","last_fullsized":"2023-10-03T19:18:30.261105+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:58:03.983260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"84'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.279490+0000","last_change":"2023-10-03T19:18:27.903974+0000","last_active":"2023-10-03T19:18:29.279490+0000","last_peered":"2023-10-03T19:18:29.279490+0000","last_clean":"2023-10-03T19:18:29.279490+0000","last_became_active":"2023-10-03T19:18:27.903682+0000","last_became_peered":"2023-10-03T19:18:27.903682+0000","last_unstale":"2023-10-03T19:18:29.279490+0000","last_undegraded":"2023-10-03T19:18:29.279490+0000","last_fullsized":"2023-10-03T19:18:29.279490+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:00:16.446744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.311803+0000","last_change":"2023-10-03T19:18:28.306569+0000","last_active":"2023-10-03T19:18:28.311803+0000","last_peered":"2023-10-03T19:18:28.311803+0000","last_clean":"2023-10-03T19:18:28.311803+0000","last_became_active":"2023-10-03T19:18:28.306279+0000","last_became_peered":"2023-10-03T19:18:28.306279+0000","last_unstale":"2023-10-03T19:18:28.311803+0000","last_undegraded":"2023-10-03T19:18:28.311803+0000","last_fullsized":"2023-10-03T19:18:28.311803+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:19:23.709654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.257564+0000","last_change":"2023-10-03T19:18:27.889389+0000","last_active":"2023-10-03T19:18:30.257564+0000","last_peered":"2023-10-03T19:18:30.257564+0000","last_clean":"2023-10-03T19:18:30.257564+0000","last_became_active":"2023-10-03T19:18:27.888880+0000","last_became_peered":"2023-10-03T19:18:27.888880+0000","last_unstale":"2023-10-03T19:18:30.257564+0000","last_undegraded":"2023-10-03T19:18:30.257564+0000","last_fullsized":"2023-10-03T19:18:30.257564+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:28:22.705925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.279794+0000","last_change":"2023-10-03T19:18:28.313341+0000","last_active":"2023-10-03T19:18:29.279794+0000","last_peered":"2023-10-03T19:18:29.279794+0000","last_clean":"2023-10-03T19:18:29.279794+0000","last_became_active":"2023-10-03T19:18:28.313033+0000","last_became_peered":"2023-10-03T19:18:28.313033+0000","last_unstale":"2023-10-03T19:18:29.279794+0000","last_undegraded":"2023-10-03T19:18:29.279794+0000","last_fullsized":"2023-10-03T19:18:29.279794+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:28:44.486518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.260355+0000","last_change":"2023-10-03T19:18:27.918673+0000","last_active":"2023-10-03T19:18:30.260355+0000","last_peered":"2023-10-03T19:18:30.260355+0000","last_clean":"2023-10-03T19:18:30.260355+0000","last_became_active":"2023-10-03T19:18:27.918055+0000","last_became_peered":"2023-10-03T19:18:27.918055+0000","last_unstale":"2023-10-03T19:18:30.260355+0000","last_undegraded":"2023-10-03T19:18:30.260355+0000","last_fullsized":"2023-10-03T19:18:30.260355+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:35:22.744317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.287333+0000","last_change":"2023-10-03T19:18:28.302682+0000","last_active":"2023-10-03T19:18:29.287333+0000","last_peered":"2023-10-03T19:18:29.287333+0000","last_clean":"2023-10-03T19:18:29.287333+0000","last_became_active":"2023-10-03T19:18:28.301860+0000","last_became_peered":"2023-10-03T19:18:28.301860+0000","last_unstale":"2023-10-03T19:18:29.287333+0000","last_undegraded":"2023-10-03T19:18:29.287333+0000","last_fullsized":"2023-10-03T19:18:29.287333+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:37:21.947540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.288525+0000","last_change":"2023-10-03T19:18:27.911615+0000","last_active":"2023-10-03T19:18:29.288525+0000","last_peered":"2023-10-03T19:18:29.288525+0000","last_clean":"2023-10-03T19:18:29.288525+0000","last_became_active":"2023-10-03T19:18:27.910752+0000","last_became_peered":"2023-10-03T19:18:27.910752+0000","last_unstale":"2023-10-03T19:18:29.288525+0000","last_undegraded":"2023-10-03T19:18:29.288525+0000","last_fullsized":"2023-10-03T19:18:29.288525+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:39:47.312275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.260734+0000","last_change":"2023-10-03T19:18:28.333153+0000","last_active":"2023-10-03T19:18:30.260734+0000","last_peered":"2023-10-03T19:18:30.260734+0000","last_clean":"2023-10-03T19:18:30.260734+0000","last_became_active":"2023-10-03T19:18:28.332464+0000","last_became_peered":"2023-10-03T19:18:28.332464+0000","last_unstale":"2023-10-03T19:18:30.260734+0000","last_undegraded":"2023-10-03T19:18:30.260734+0000","last_fullsized":"2023-10-03T19:18:30.260734+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:20:42.127882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.258107+0000","last_change":"2023-10-03T19:18:27.902687+0000","last_active":"2023-10-03T19:18:30.258107+0000","last_peered":"2023-10-03T19:18:30.258107+0000","last_clean":"2023-10-03T19:18:30.258107+0000","last_became_active":"2023-10-03T19:18:27.902341+0000","last_became_peered":"2023-10-03T19:18:27.902341+0000","last_unstale":"2023-10-03T19:18:30.258107+0000","last_undegraded":"2023-10-03T19:18:30.258107+0000","last_fullsized":"2023-10-03T19:18:30.258107+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:01:16.138965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.257799+0000","last_change":"2023-10-03T19:18:28.302114+0000","last_active":"2023-10-03T19:18:30.257799+0000","last_peered":"2023-10-03T19:18:30.257799+0000","last_clean":"2023-10-03T19:18:30.257799+0000","last_became_active":"2023-10-03T19:18:28.301815+0000","last_became_peered":"2023-10-03T19:18:28.301815+0000","last_unstale":"2023-10-03T19:18:30.257799+0000","last_undegraded":"2023-10-03T19:18:30.257799+0000","last_fullsized":"2023-10-03T19:18:30.257799+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:16:10.633589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"84'3","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.289864+0000","last_change":"2023-10-03T19:18:27.917244+0000","last_active":"2023-10-03T19:18:29.289864+0000","last_peered":"2023-10-03T19:18:29.289864+0000","last_clean":"2023-10-03T19:18:29.289864+0000","last_became_active":"2023-10-03T19:18:27.916717+0000","last_became_peered":"2023-10-03T19:18:27.916717+0000","last_unstale":"2023-10-03T19:18:29.289864+0000","last_undegraded":"2023-10-03T19:18:29.289864+0000","last_fullsized":"2023-10-03T19:18:29.289864+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:20:11.974758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.279717+0000","last_change":"2023-10-03T19:18:28.326364+0000","last_active":"2023-10-03T19:18:29.279717+0000","last_peered":"2023-10-03T19:18:29.279717+0000","last_clean":"2023-10-03T19:18:29.279717+0000","last_became_active":"2023-10-03T19:18:28.326023+0000","last_became_peered":"2023-10-03T19:18:28.326023+0000","last_unstale":"2023-10-03T19:18:29.279717+0000","last_undegraded":"2023-10-03T19:18:29.279717+0000","last_fullsized":"2023-10-03T19:18:29.279717+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:27:30.673021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"84'6","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.332033+0000","last_change":"2023-10-03T19:18:27.916171+0000","last_active":"2023-10-03T19:18:28.332033+0000","last_peered":"2023-10-03T19:18:28.332033+0000","last_clean":"2023-10-03T19:18:28.332033+0000","last_became_active":"2023-10-03T19:18:27.915765+0000","last_became_peered":"2023-10-03T19:18:27.915765+0000","last_unstale":"2023-10-03T19:18:28.332033+0000","last_undegraded":"2023-10-03T19:18:28.332033+0000","last_fullsized":"2023-10-03T19:18:28.332033+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:07:59.015939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.279437+0000","last_change":"2023-10-03T19:18:28.314783+0000","last_active":"2023-10-03T19:18:29.279437+0000","last_peered":"2023-10-03T19:18:29.279437+0000","last_clean":"2023-10-03T19:18:29.279437+0000","last_became_active":"2023-10-03T19:18:28.314487+0000","last_became_peered":"2023-10-03T19:18:28.314487+0000","last_unstale":"2023-10-03T19:18:29.279437+0000","last_undegraded":"2023-10-03T19:18:29.279437+0000","last_fullsized":"2023-10-03T19:18:29.279437+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:24:10.461155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"84'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.261781+0000","last_change":"2023-10-03T19:18:27.915964+0000","last_active":"2023-10-03T19:18:30.261781+0000","last_peered":"2023-10-03T19:18:30.261781+0000","last_clean":"2023-10-03T19:18:30.261781+0000","last_became_active":"2023-10-03T19:18:27.915199+0000","last_became_peered":"2023-10-03T19:18:27.915199+0000","last_unstale":"2023-10-03T19:18:30.261781+0000","last_undegraded":"2023-10-03T19:18:30.261781+0000","last_fullsized":"2023-10-03T19:18:30.261781+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:01:52.516901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.286365+0000","last_change":"2023-10-03T19:18:28.324258+0000","last_active":"2023-10-03T19:18:29.286365+0000","last_peered":"2023-10-03T19:18:29.286365+0000","last_clean":"2023-10-03T19:18:29.286365+0000","last_became_active":"2023-10-03T19:18:28.323596+0000","last_became_peered":"2023-10-03T19:18:28.323596+0000","last_unstale":"2023-10-03T19:18:29.286365+0000","last_undegraded":"2023-10-03T19:18:29.286365+0000","last_fullsized":"2023-10-03T19:18:29.286365+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:46:13.199949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.290656+0000","last_change":"2023-10-03T19:18:27.906734+0000","last_active":"2023-10-03T19:18:28.290656+0000","last_peered":"2023-10-03T19:18:28.290656+0000","last_clean":"2023-10-03T19:18:28.290656+0000","last_became_active":"2023-10-03T19:18:27.906245+0000","last_became_peered":"2023-10-03T19:18:27.906245+0000","last_unstale":"2023-10-03T19:18:28.290656+0000","last_undegraded":"2023-10-03T19:18:28.290656+0000","last_fullsized":"2023-10-03T19:18:28.290656+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:33:11.428854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.258549+0000","last_change":"2023-10-03T19:18:28.292597+0000","last_active":"2023-10-03T19:18:30.258549+0000","last_peered":"2023-10-03T19:18:30.258549+0000","last_clean":"2023-10-03T19:18:30.258549+0000","last_became_active":"2023-10-03T19:18:28.292336+0000","last_became_peered":"2023-10-03T19:18:28.292336+0000","last_unstale":"2023-10-03T19:18:30.258549+0000","last_undegraded":"2023-10-03T19:18:30.258549+0000","last_fullsized":"2023-10-03T19:18:30.258549+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:21:42.153246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.279917+0000","last_change":"2023-10-03T19:18:27.914470+0000","last_active":"2023-10-03T19:18:29.279917+0000","last_peered":"2023-10-03T19:18:29.279917+0000","last_clean":"2023-10-03T19:18:29.279917+0000","last_became_active":"2023-10-03T19:18:27.914137+0000","last_became_peered":"2023-10-03T19:18:27.914137+0000","last_unstale":"2023-10-03T19:18:29.279917+0000","last_undegraded":"2023-10-03T19:18:29.279917+0000","last_fullsized":"2023-10-03T19:18:29.279917+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:02:42.843801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.260378+0000","last_change":"2023-10-03T19:18:28.321422+0000","last_active":"2023-10-03T19:18:30.260378+0000","last_peered":"2023-10-03T19:18:30.260378+0000","last_clean":"2023-10-03T19:18:30.260378+0000","last_became_active":"2023-10-03T19:18:28.321183+0000","last_became_peered":"2023-10-03T19:18:28.321183+0000","last_unstale":"2023-10-03T19:18:30.260378+0000","last_undegraded":"2023-10-03T19:18:30.260378+0000","last_fullsized":"2023-10-03T19:18:30.260378+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:17:14.730415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"84'8","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.279207+0000","last_change":"2023-10-03T19:18:27.904075+0000","last_active":"2023-10-03T19:18:29.279207+0000","last_peered":"2023-10-03T19:18:29.279207+0000","last_clean":"2023-10-03T19:18:29.279207+0000","last_became_active":"2023-10-03T19:18:27.903761+0000","last_became_peered":"2023-10-03T19:18:27.903761+0000","last_unstale":"2023-10-03T19:18:29.279207+0000","last_undegraded":"2023-10-03T19:18:29.279207+0000","last_fullsized":"2023-10-03T19:18:29.279207+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:10:31.432643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.262068+0000","last_change":"2023-10-03T19:18:28.308383+0000","last_active":"2023-10-03T19:18:30.262068+0000","last_peered":"2023-10-03T19:18:30.262068+0000","last_clean":"2023-10-03T19:18:30.262068+0000","last_became_active":"2023-10-03T19:18:28.307745+0000","last_became_peered":"2023-10-03T19:18:28.307745+0000","last_unstale":"2023-10-03T19:18:30.262068+0000","last_undegraded":"2023-10-03T19:18:30.262068+0000","last_fullsized":"2023-10-03T19:18:30.262068+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:24:15.434749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"84'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.261893+0000","last_change":"2023-10-03T19:18:27.925893+0000","last_active":"2023-10-03T19:18:30.261893+0000","last_peered":"2023-10-03T19:18:30.261893+0000","last_clean":"2023-10-03T19:18:30.261893+0000","last_became_active":"2023-10-03T19:18:27.925295+0000","last_became_peered":"2023-10-03T19:18:27.925295+0000","last_unstale":"2023-10-03T19:18:30.261893+0000","last_undegraded":"2023-10-03T19:18:30.261893+0000","last_fullsized":"2023-10-03T19:18:30.261893+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:18:26.132197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.329091+0000","last_change":"2023-10-03T19:18:28.328052+0000","last_active":"2023-10-03T19:18:28.329091+0000","last_peered":"2023-10-03T19:18:28.329091+0000","last_clean":"2023-10-03T19:18:28.329091+0000","last_became_active":"2023-10-03T19:18:28.327708+0000","last_became_peered":"2023-10-03T19:18:28.327708+0000","last_unstale":"2023-10-03T19:18:28.329091+0000","last_undegraded":"2023-10-03T19:18:28.329091+0000","last_fullsized":"2023-10-03T19:18:28.329091+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:48:05.949581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.288135+0000","last_change":"2023-10-03T19:18:27.925829+0000","last_active":"2023-10-03T19:18:29.288135+0000","last_peered":"2023-10-03T19:18:29.288135+0000","last_clean":"2023-10-03T19:18:29.288135+0000","last_became_active":"2023-10-03T19:18:27.925250+0000","last_became_peered":"2023-10-03T19:18:27.925250+0000","last_unstale":"2023-10-03T19:18:29.288135+0000","last_undegraded":"2023-10-03T19:18:29.288135+0000","last_fullsized":"2023-10-03T19:18:29.288135+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:34:34.193206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.307423+0000","last_change":"2023-10-03T19:18:28.295866+0000","last_active":"2023-10-03T19:18:28.307423+0000","last_peered":"2023-10-03T19:18:28.307423+0000","last_clean":"2023-10-03T19:18:28.307423+0000","last_became_active":"2023-10-03T19:18:28.295542+0000","last_became_peered":"2023-10-03T19:18:28.295542+0000","last_unstale":"2023-10-03T19:18:28.307423+0000","last_undegraded":"2023-10-03T19:18:28.307423+0000","last_fullsized":"2023-10-03T19:18:28.307423+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:10:22.532926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.290107+0000","last_change":"2023-10-03T19:18:27.915955+0000","last_active":"2023-10-03T19:18:29.290107+0000","last_peered":"2023-10-03T19:18:29.290107+0000","last_clean":"2023-10-03T19:18:29.290107+0000","last_became_active":"2023-10-03T19:18:27.915141+0000","last_became_peered":"2023-10-03T19:18:27.915141+0000","last_unstale":"2023-10-03T19:18:29.290107+0000","last_undegraded":"2023-10-03T19:18:29.290107+0000","last_fullsized":"2023-10-03T19:18:29.290107+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:01:09.377212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.288344+0000","last_change":"2023-10-03T19:18:28.333940+0000","last_active":"2023-10-03T19:18:29.288344+0000","last_peered":"2023-10-03T19:18:29.288344+0000","last_clean":"2023-10-03T19:18:29.288344+0000","last_became_active":"2023-10-03T19:18:28.333172+0000","last_became_peered":"2023-10-03T19:18:28.333172+0000","last_unstale":"2023-10-03T19:18:29.288344+0000","last_undegraded":"2023-10-03T19:18:29.288344+0000","last_fullsized":"2023-10-03T19:18:29.288344+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:25:59.676571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.262309+0000","last_change":"2023-10-03T19:18:27.917512+0000","last_active":"2023-10-03T19:18:30.262309+0000","last_peered":"2023-10-03T19:18:30.262309+0000","last_clean":"2023-10-03T19:18:30.262309+0000","last_became_active":"2023-10-03T19:18:27.916726+0000","last_became_peered":"2023-10-03T19:18:27.916726+0000","last_unstale":"2023-10-03T19:18:30.262309+0000","last_undegraded":"2023-10-03T19:18:30.262309+0000","last_fullsized":"2023-10-03T19:18:30.262309+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:12:54.373086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.258566+0000","last_change":"2023-10-03T19:18:28.300760+0000","last_active":"2023-10-03T19:18:30.258566+0000","last_peered":"2023-10-03T19:18:30.258566+0000","last_clean":"2023-10-03T19:18:30.258566+0000","last_became_active":"2023-10-03T19:18:28.300491+0000","last_became_peered":"2023-10-03T19:18:28.300491+0000","last_unstale":"2023-10-03T19:18:30.258566+0000","last_undegraded":"2023-10-03T19:18:30.258566+0000","last_fullsized":"2023-10-03T19:18:30.258566+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:07:56.750661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.290898+0000","last_change":"2023-10-03T19:18:27.904288+0000","last_active":"2023-10-03T19:18:28.290898+0000","last_peered":"2023-10-03T19:18:28.290898+0000","last_clean":"2023-10-03T19:18:28.290898+0000","last_became_active":"2023-10-03T19:18:27.904010+0000","last_became_peered":"2023-10-03T19:18:27.904010+0000","last_unstale":"2023-10-03T19:18:28.290898+0000","last_undegraded":"2023-10-03T19:18:28.290898+0000","last_fullsized":"2023-10-03T19:18:28.290898+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:19:37.643789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.257118+0000","last_change":"2023-10-03T19:18:28.292166+0000","last_active":"2023-10-03T19:18:30.257118+0000","last_peered":"2023-10-03T19:18:30.257118+0000","last_clean":"2023-10-03T19:18:30.257118+0000","last_became_active":"2023-10-03T19:18:28.291138+0000","last_became_peered":"2023-10-03T19:18:28.291138+0000","last_unstale":"2023-10-03T19:18:30.257118+0000","last_undegraded":"2023-10-03T19:18:30.257118+0000","last_fullsized":"2023-10-03T19:18:30.257118+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:24:17.689826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.288852+0000","last_change":"2023-10-03T19:18:27.911380+0000","last_active":"2023-10-03T19:18:29.288852+0000","last_peered":"2023-10-03T19:18:29.288852+0000","last_clean":"2023-10-03T19:18:29.288852+0000","last_became_active":"2023-10-03T19:18:27.910631+0000","last_became_peered":"2023-10-03T19:18:27.910631+0000","last_unstale":"2023-10-03T19:18:29.288852+0000","last_undegraded":"2023-10-03T19:18:29.288852+0000","last_fullsized":"2023-10-03T19:18:29.288852+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:35:30.965063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.260672+0000","last_change":"2023-10-03T19:18:28.304971+0000","last_active":"2023-10-03T19:18:30.260672+0000","last_peered":"2023-10-03T19:18:30.260672+0000","last_clean":"2023-10-03T19:18:30.260672+0000","last_became_active":"2023-10-03T19:18:28.304237+0000","last_became_peered":"2023-10-03T19:18:28.304237+0000","last_unstale":"2023-10-03T19:18:30.260672+0000","last_undegraded":"2023-10-03T19:18:30.260672+0000","last_fullsized":"2023-10-03T19:18:30.260672+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:28:51.092586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.261445+0000","last_change":"2023-10-03T19:18:27.917684+0000","last_active":"2023-10-03T19:18:30.261445+0000","last_peered":"2023-10-03T19:18:30.261445+0000","last_clean":"2023-10-03T19:18:30.261445+0000","last_became_active":"2023-10-03T19:18:27.917032+0000","last_became_peered":"2023-10-03T19:18:27.917032+0000","last_unstale":"2023-10-03T19:18:30.261445+0000","last_undegraded":"2023-10-03T19:18:30.261445+0000","last_fullsized":"2023-10-03T19:18:30.261445+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:47:44.167234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.309377+0000","last_change":"2023-10-03T19:18:28.299048+0000","last_active":"2023-10-03T19:18:28.309377+0000","last_peered":"2023-10-03T19:18:28.309377+0000","last_clean":"2023-10-03T19:18:28.309377+0000","last_became_active":"2023-10-03T19:18:28.294610+0000","last_became_peered":"2023-10-03T19:18:28.294610+0000","last_unstale":"2023-10-03T19:18:28.309377+0000","last_undegraded":"2023-10-03T19:18:28.309377+0000","last_fullsized":"2023-10-03T19:18:28.309377+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:47:43.385105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.260881+0000","last_change":"2023-10-03T19:18:27.908027+0000","last_active":"2023-10-03T19:18:30.260881+0000","last_peered":"2023-10-03T19:18:30.260881+0000","last_clean":"2023-10-03T19:18:30.260881+0000","last_became_active":"2023-10-03T19:18:27.907172+0000","last_became_peered":"2023-10-03T19:18:27.907172+0000","last_unstale":"2023-10-03T19:18:30.260881+0000","last_undegraded":"2023-10-03T19:18:30.260881+0000","last_fullsized":"2023-10-03T19:18:30.260881+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:42:34.649631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.261664+0000","last_change":"2023-10-03T19:18:28.319293+0000","last_active":"2023-10-03T19:18:30.261664+0000","last_peered":"2023-10-03T19:18:30.261664+0000","last_clean":"2023-10-03T19:18:30.261664+0000","last_became_active":"2023-10-03T19:18:28.318592+0000","last_became_peered":"2023-10-03T19:18:28.318592+0000","last_unstale":"2023-10-03T19:18:30.261664+0000","last_undegraded":"2023-10-03T19:18:30.261664+0000","last_fullsized":"2023-10-03T19:18:30.261664+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:23:55.577374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.280842+0000","last_change":"2023-10-03T19:18:27.907282+0000","last_active":"2023-10-03T19:18:29.280842+0000","last_peered":"2023-10-03T19:18:29.280842+0000","last_clean":"2023-10-03T19:18:29.280842+0000","last_became_active":"2023-10-03T19:18:27.907022+0000","last_became_peered":"2023-10-03T19:18:27.907022+0000","last_unstale":"2023-10-03T19:18:29.280842+0000","last_undegraded":"2023-10-03T19:18:29.280842+0000","last_fullsized":"2023-10-03T19:18:29.280842+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:24:13.861688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":290,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.261246+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:18:30.261246+0000","last_peered":"2023-10-03T19:18:30.261246+0000","last_clean":"2023-10-03T19:18:30.261246+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:18:30.261246+0000","last_undegraded":"2023-10-03T19:18:30.261246+0000","last_fullsized":"2023-10-03T19:18:30.261246+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:02:12.240334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":137,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.287949+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:18:29.287949+0000","last_peered":"2023-10-03T19:18:29.287949+0000","last_clean":"2023-10-03T19:18:29.287949+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:18:29.287949+0000","last_undegraded":"2023-10-03T19:18:29.287949+0000","last_fullsized":"2023-10-03T19:18:29.287949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:38:40.158112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.329061+0000","last_change":"2023-10-03T19:18:28.328075+0000","last_active":"2023-10-03T19:18:28.329061+0000","last_peered":"2023-10-03T19:18:28.329061+0000","last_clean":"2023-10-03T19:18:28.329061+0000","last_became_active":"2023-10-03T19:18:28.327798+0000","last_became_peered":"2023-10-03T19:18:28.327798+0000","last_unstale":"2023-10-03T19:18:28.329061+0000","last_undegraded":"2023-10-03T19:18:28.329061+0000","last_fullsized":"2023-10-03T19:18:28.329061+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:45:59.256826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"84'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.262765+0000","last_change":"2023-10-03T19:18:27.925272+0000","last_active":"2023-10-03T19:18:30.262765+0000","last_peered":"2023-10-03T19:18:30.262765+0000","last_clean":"2023-10-03T19:18:30.262765+0000","last_became_active":"2023-10-03T19:18:27.924784+0000","last_became_peered":"2023-10-03T19:18:27.924784+0000","last_unstale":"2023-10-03T19:18:30.262765+0000","last_undegraded":"2023-10-03T19:18:30.262765+0000","last_fullsized":"2023-10-03T19:18:30.262765+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:57:37.300970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":138,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.260952+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:18:30.260952+0000","last_peered":"2023-10-03T19:18:30.260952+0000","last_clean":"2023-10-03T19:18:30.260952+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:18:30.260952+0000","last_undegraded":"2023-10-03T19:18:30.260952+0000","last_fullsized":"2023-10-03T19:18:30.260952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:54:04.144028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.262187+0000","last_change":"2023-10-03T19:18:28.328928+0000","last_active":"2023-10-03T19:18:30.262187+0000","last_peered":"2023-10-03T19:18:30.262187+0000","last_clean":"2023-10-03T19:18:30.262187+0000","last_became_active":"2023-10-03T19:18:28.328324+0000","last_became_peered":"2023-10-03T19:18:28.328324+0000","last_unstale":"2023-10-03T19:18:30.262187+0000","last_undegraded":"2023-10-03T19:18:30.262187+0000","last_fullsized":"2023-10-03T19:18:30.262187+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:10:33.175403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"84'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.261176+0000","last_change":"2023-10-03T19:18:27.926890+0000","last_active":"2023-10-03T19:18:30.261176+0000","last_peered":"2023-10-03T19:18:30.261176+0000","last_clean":"2023-10-03T19:18:30.261176+0000","last_became_active":"2023-10-03T19:18:27.926253+0000","last_became_peered":"2023-10-03T19:18:27.926253+0000","last_unstale":"2023-10-03T19:18:30.261176+0000","last_undegraded":"2023-10-03T19:18:30.261176+0000","last_fullsized":"2023-10-03T19:18:30.261176+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:16:06.039366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.258311+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:18:30.258311+0000","last_peered":"2023-10-03T19:18:30.258311+0000","last_clean":"2023-10-03T19:18:30.258311+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:18:30.258311+0000","last_undegraded":"2023-10-03T19:18:30.258311+0000","last_fullsized":"2023-10-03T19:18:30.258311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:16:01.964883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.287599+0000","last_change":"2023-10-03T19:18:28.292080+0000","last_active":"2023-10-03T19:18:29.287599+0000","last_peered":"2023-10-03T19:18:29.287599+0000","last_clean":"2023-10-03T19:18:29.287599+0000","last_became_active":"2023-10-03T19:18:28.291057+0000","last_became_peered":"2023-10-03T19:18:28.291057+0000","last_unstale":"2023-10-03T19:18:29.287599+0000","last_undegraded":"2023-10-03T19:18:29.287599+0000","last_fullsized":"2023-10-03T19:18:29.287599+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:30:57.054613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"84'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.289861+0000","last_change":"2023-10-03T19:18:27.906512+0000","last_active":"2023-10-03T19:18:29.289861+0000","last_peered":"2023-10-03T19:18:29.289861+0000","last_clean":"2023-10-03T19:18:29.289861+0000","last_became_active":"2023-10-03T19:18:27.906152+0000","last_became_peered":"2023-10-03T19:18:27.906152+0000","last_unstale":"2023-10-03T19:18:29.289861+0000","last_undegraded":"2023-10-03T19:18:29.289861+0000","last_fullsized":"2023-10-03T19:18:29.289861+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:50:50.997001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":137,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.288795+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:18:29.288795+0000","last_peered":"2023-10-03T19:18:29.288795+0000","last_clean":"2023-10-03T19:18:29.288795+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:18:29.288795+0000","last_undegraded":"2023-10-03T19:18:29.288795+0000","last_fullsized":"2023-10-03T19:18:29.288795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:16:51.487559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.311838+0000","last_change":"2023-10-03T19:18:28.305959+0000","last_active":"2023-10-03T19:18:28.311838+0000","last_peered":"2023-10-03T19:18:28.311838+0000","last_clean":"2023-10-03T19:18:28.311838+0000","last_became_active":"2023-10-03T19:18:28.305671+0000","last_became_peered":"2023-10-03T19:18:28.305671+0000","last_unstale":"2023-10-03T19:18:28.311838+0000","last_undegraded":"2023-10-03T19:18:28.311838+0000","last_fullsized":"2023-10-03T19:18:28.311838+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:24:55.603298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"84'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.287743+0000","last_change":"2023-10-03T19:18:27.921745+0000","last_active":"2023-10-03T19:18:29.287743+0000","last_peered":"2023-10-03T19:18:29.287743+0000","last_clean":"2023-10-03T19:18:29.287743+0000","last_became_active":"2023-10-03T19:18:27.914884+0000","last_became_peered":"2023-10-03T19:18:27.914884+0000","last_unstale":"2023-10-03T19:18:29.287743+0000","last_undegraded":"2023-10-03T19:18:29.287743+0000","last_fullsized":"2023-10-03T19:18:29.287743+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:33:51.571616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.281199+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:18:29.281199+0000","last_peered":"2023-10-03T19:18:29.281199+0000","last_clean":"2023-10-03T19:18:29.281199+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:18:29.281199+0000","last_undegraded":"2023-10-03T19:18:29.281199+0000","last_fullsized":"2023-10-03T19:18:29.281199+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:36:45.061906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.288088+0000","last_change":"2023-10-03T19:18:28.328282+0000","last_active":"2023-10-03T19:18:29.288088+0000","last_peered":"2023-10-03T19:18:29.288088+0000","last_clean":"2023-10-03T19:18:29.288088+0000","last_became_active":"2023-10-03T19:18:28.327432+0000","last_became_peered":"2023-10-03T19:18:28.327432+0000","last_unstale":"2023-10-03T19:18:29.288088+0000","last_undegraded":"2023-10-03T19:18:29.288088+0000","last_fullsized":"2023-10-03T19:18:29.288088+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:00:19.571613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.258772+0000","last_change":"2023-10-03T19:18:27.904710+0000","last_active":"2023-10-03T19:18:30.258772+0000","last_peered":"2023-10-03T19:18:30.258772+0000","last_clean":"2023-10-03T19:18:30.258772+0000","last_became_active":"2023-10-03T19:18:27.903679+0000","last_became_peered":"2023-10-03T19:18:27.903679+0000","last_unstale":"2023-10-03T19:18:30.258772+0000","last_undegraded":"2023-10-03T19:18:30.258772+0000","last_fullsized":"2023-10-03T19:18:30.258772+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:31:08.911279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":137,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.261353+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:18:30.261353+0000","last_peered":"2023-10-03T19:18:30.261353+0000","last_clean":"2023-10-03T19:18:30.261353+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:18:30.261353+0000","last_undegraded":"2023-10-03T19:18:30.261353+0000","last_fullsized":"2023-10-03T19:18:30.261353+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:34:56.725402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.288685+0000","last_change":"2023-10-03T19:18:28.328892+0000","last_active":"2023-10-03T19:18:29.288685+0000","last_peered":"2023-10-03T19:18:29.288685+0000","last_clean":"2023-10-03T19:18:29.288685+0000","last_became_active":"2023-10-03T19:18:28.327728+0000","last_became_peered":"2023-10-03T19:18:28.327728+0000","last_unstale":"2023-10-03T19:18:29.288685+0000","last_undegraded":"2023-10-03T19:18:29.288685+0000","last_fullsized":"2023-10-03T19:18:29.288685+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:10:17.456066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.288404+0000","last_change":"2023-10-03T19:18:27.922546+0000","last_active":"2023-10-03T19:18:29.288404+0000","last_peered":"2023-10-03T19:18:29.288404+0000","last_clean":"2023-10-03T19:18:29.288404+0000","last_became_active":"2023-10-03T19:18:27.921928+0000","last_became_peered":"2023-10-03T19:18:27.921928+0000","last_unstale":"2023-10-03T19:18:29.288404+0000","last_undegraded":"2023-10-03T19:18:29.288404+0000","last_fullsized":"2023-10-03T19:18:29.288404+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:54:40.203407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":133,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:29.280077+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:18:29.280077+0000","last_peered":"2023-10-03T19:18:29.280077+0000","last_clean":"2023-10-03T19:18:29.280077+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:18:29.280077+0000","last_undegraded":"2023-10-03T19:18:29.280077+0000","last_fullsized":"2023-10-03T19:18:29.280077+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:35:08.557613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-03T19:18:28.309461+0000","last_change":"2023-10-03T19:18:28.299842+0000","last_active":"2023-10-03T19:18:28.309461+0000","last_peered":"2023-10-03T19:18:28.309461+0000","last_clean":"2023-10-03T19:18:28.309461+0000","last_became_active":"2023-10-03T19:18:28.299535+0000","last_became_peered":"2023-10-03T19:18:28.299535+0000","last_unstale":"2023-10-03T19:18:28.309461+0000","last_undegraded":"2023-10-03T19:18:28.309461+0000","last_fullsized":"2023-10-03T19:18:28.309461+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:27.862490+0000","last_clean_scrub_stamp":"2023-10-03T19:18:27.862490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:15:54.771062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.258432+0000","last_change":"2023-10-03T19:18:27.907628+0000","last_active":"2023-10-03T19:18:30.258432+0000","last_peered":"2023-10-03T19:18:30.258432+0000","last_clean":"2023-10-03T19:18:30.258432+0000","last_became_active":"2023-10-03T19:18:27.907206+0000","last_became_peered":"2023-10-03T19:18:27.907206+0000","last_unstale":"2023-10-03T19:18:30.258432+0000","last_undegraded":"2023-10-03T19:18:30.258432+0000","last_fullsized":"2023-10-03T19:18:30.258432+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:18:26.852089+0000","last_clean_scrub_stamp":"2023-10-03T19:18:26.852089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:11:15.716787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-03T19:18:30.262847+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:18:30.262847+0000","last_peered":"2023-10-03T19:18:30.262847+0000","last_clean":"2023-10-03T19:18:30.262847+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:18:30.262847+0000","last_undegraded":"2023-10-03T19:18:30.262847+0000","last_fullsized":"2023-10-03T19:18:30.262847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:44:52.481791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509517,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33348,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":32256,"kb_avail":94338492,"statfs":{"total":96636764160,"available":96602615808,"internally_reserved":0,"allocated":1110016,"data_stored":1060893,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":33030144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.87,"15min":0.93200000000000005},"min":{"1min":0.503,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1399999999999999,"5min":4.0469999999999997,"15min":4.0469999999999997},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.85499999999999998,"15min":0.81100000000000005},"min":{"1min":0.55100000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1699999999999999,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.59199999999999997}]},{"osd":1,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.90000000000000002,"15min":1.012},"min":{"1min":0.59999999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.194,"5min":3.8239999999999998,"15min":3.8239999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.88600000000000001,"15min":0.85999999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2609999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.70199999999999996}]},{"osd":2,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.94099999999999995,"15min":0.871},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.236,"5min":6.0449999999999999,"15min":6.0449999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.96899999999999997,"15min":1.0289999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2949999999999999,"5min":3.98,"15min":3.98},"last":0.56100000000000005}]},{"osd":3,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0249999999999999,"15min":0.95399999999999996},"min":{"1min":0.64700000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":3.3940000000000001,"5min":6.125,"15min":6.125},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.038,"15min":1.1120000000000001},"min":{"1min":0.77800000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1259999999999999,"5min":3.9140000000000001,"15min":3.9140000000000001},"last":0.65400000000000003}]},{"osd":4,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.96799999999999997,"15min":1.1379999999999999},"min":{"1min":0.63800000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1160000000000001,"5min":5.1130000000000004,"15min":5.1130000000000004},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.018,"15min":1.0269999999999999},"min":{"1min":0.67900000000000005,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.3380000000000001,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":0.629}]},{"osd":5,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.0680000000000001,"15min":1.246},"min":{"1min":0.69499999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2250000000000001,"5min":5.1859999999999999,"15min":5.1859999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.0449999999999999,"15min":1.133},"min":{"1min":0.82199999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.163,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.002}]},{"osd":6,"last update":"Tue Oct 3 19:17:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.085,"15min":1.097},"min":{"1min":0.75700000000000001,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.2190000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.105,"5min":1.1619999999999999,"15min":1.1799999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.3999999999999999,"5min":6.1580000000000004,"15min":6.1580000000000004},"last":0.72599999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509517,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26444,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":25408,"kb_avail":94345396,"statfs":{"total":96636764160,"available":96609685504,"internally_reserved":0,"allocated":1052672,"data_stored":471473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":26017792},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:17:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.84399999999999997,"15min":0.82199999999999995},"min":{"1min":0.45400000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3340000000000001,"5min":1.504,"15min":1.504},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.89000000000000001,"15min":0.88200000000000001},"min":{"1min":0.58099999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1950000000000001,"5min":1.839,"15min":1.839},"last":0.95199999999999996}]},{"osd":1,"last update":"Tue Oct 3 19:17:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.85999999999999999,"15min":0.84199999999999997},"min":{"1min":0.53900000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.27,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.90000000000000002,"15min":0.88400000000000001},"min":{"1min":0.58199999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1879999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.74099999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:17:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.93000000000000005,"15min":0.878},"min":{"1min":0.66100000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1890000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.91400000000000003,"15min":0.92400000000000004},"min":{"1min":0.60199999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.369,"5min":1.546,"15min":1.546},"last":0.80000000000000004}]},{"osd":3,"last update":"Tue Oct 3 19:17:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95899999999999996,"15min":0.97899999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1859999999999999,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.90500000000000003,"15min":0.90800000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.206,"5min":2.121,"15min":2.121},"last":0.88700000000000001}]},{"osd":4,"last update":"Tue Oct 3 19:17:29 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.94899999999999995,"15min":1.018},"min":{"1min":0.64900000000000002,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.28,"5min":1.95,"15min":1.95},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0069999999999999,"15min":1.0820000000000001},"min":{"1min":0.68999999999999995,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2989999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.032}]},{"osd":5,"last update":"Tue Oct 3 19:17:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.94399999999999995,"15min":1.01},"min":{"1min":0.65100000000000002,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.276,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0669999999999999,"15min":1.1160000000000001},"min":{"1min":0.70699999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.3420000000000001,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.997}]},{"osd":7,"last update":"Tue Oct 3 19:17:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0740000000000001,"15min":1.115},"min":{"1min":0.81200000000000006,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.3049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.125},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.05,"15min":1.0900000000000001},"min":{"1min":0.70199999999999996,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3420000000000001,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.0569999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509518,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41668,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":40640,"kb_avail":94330172,"statfs":{"total":96636764160,"available":96594096128,"internally_reserved":0,"allocated":1044480,"data_stored":470629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":41615360},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":1.0669999999999999,"15min":0.86699999999999999},"min":{"1min":0.58699999999999997,"5min":0.54700000000000004,"15min":0.50600000000000001},"max":{"1min":1.2430000000000001,"5min":17.686,"15min":17.686},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":1.016,"15min":0.88400000000000001},"min":{"1min":0.52500000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0549999999999999,"5min":16.925999999999998,"15min":16.925999999999998},"last":0.96199999999999997}]},{"osd":1,"last update":"Tue Oct 3 19:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":1.0780000000000001,"15min":0.98399999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.7829999999999999,"5min":16.640999999999998,"15min":16.640999999999998},"last":1.1299999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":1.1000000000000001,"15min":0.92900000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3100000000000001,"5min":17.59,"15min":17.59},"last":1.151}]},{"osd":2,"last update":"Tue Oct 3 19:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.02,"15min":0.94399999999999995},"min":{"1min":0.64100000000000001,"5min":0.56200000000000006,"15min":0.53200000000000003},"max":{"1min":1.2310000000000001,"5min":8.5630000000000006,"15min":8.5630000000000006},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.016,"5min":1.163,"15min":1.01},"min":{"1min":0.80000000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.7450000000000001,"5min":17.734000000000002,"15min":17.734000000000002},"last":0.63100000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.073,"15min":0.93700000000000006},"min":{"1min":0.61499999999999999,"5min":0.55600000000000005,"15min":0.53900000000000003},"max":{"1min":1.2769999999999999,"5min":16.98,"15min":16.98},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.002,"5min":1.179,"15min":1.1100000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.5229999999999999,"5min":16.434000000000001,"15min":16.434000000000001},"last":0.66900000000000004}]},{"osd":5,"last update":"Tue Oct 3 19:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.129,"15min":1.0960000000000001},"min":{"1min":0.70399999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.8360000000000001,"5min":17.782,"15min":17.782},"last":1.028},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.96799999999999997,"15min":1.0069999999999999},"min":{"1min":0.68100000000000005,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.0940000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.391,"15min":1.288},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.9970000000000001,"5min":36.106000000000002,"15min":36.106000000000002},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.099,"5min":1.2470000000000001,"15min":1.226},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.8859999999999999,"5min":17.646999999999998,"15min":17.646999999999998},"last":1.2250000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.2070000000000001,"15min":1.137},"min":{"1min":0.77900000000000003,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.466,"5min":17.042000000000002,"15min":17.042000000000002},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.3069999999999999,"15min":1.2689999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.63300000000000001},"max":{"1min":1.915,"5min":16.32,"15min":16.32},"last":1.25}]}]},{"osd":2,"up_from":15,"seq":64424509518,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32120,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":31104,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":1032192,"data_stored":469305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31850496},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:18:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":0.79100000000000004,"15min":0.60299999999999998},"min":{"1min":0.40699999999999997,"5min":0.30499999999999999,"15min":0.247},"max":{"1min":13.629,"5min":13.629,"15min":13.629},"last":0.48699999999999999},{"interface":"front","average":{"1min":3.0899999999999999,"5min":1.216,"15min":0.80300000000000005},"min":{"1min":0.436,"5min":0.30299999999999999,"15min":0.28999999999999998},"max":{"1min":40.439,"5min":40.439,"15min":40.439},"last":0.63200000000000001}]},{"osd":1,"last update":"Tue Oct 3 19:18:31 2023","interfaces":[{"interface":"back","average":{"1min":1.502,"5min":0.92100000000000004,"15min":0.70299999999999996},"min":{"1min":0.48199999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":14.074,"5min":14.074,"15min":14.074},"last":0.56799999999999995},{"interface":"front","average":{"1min":1.03,"5min":0.78000000000000003,"15min":0.64000000000000001},"min":{"1min":0.36199999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":7.0060000000000002,"5min":7.0060000000000002,"15min":7.0060000000000002},"last":0.52800000000000002}]},{"osd":3,"last update":"Tue Oct 3 19:18:31 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":0.91500000000000004,"15min":0.70399999999999996},"min":{"1min":0.47599999999999998,"5min":0.224,"15min":0.224},"max":{"1min":13.423999999999999,"5min":13.423999999999999,"15min":13.423999999999999},"last":0.75},{"interface":"front","average":{"1min":1.847,"5min":1.075,"15min":0.81999999999999995},"min":{"1min":0.51900000000000002,"5min":0.371,"15min":0.36399999999999999},"max":{"1min":18.568999999999999,"5min":18.568999999999999,"15min":18.568999999999999},"last":0.67600000000000005}]},{"osd":4,"last update":"Tue Oct 3 19:18:31 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":0.96699999999999997,"15min":0.874},"min":{"1min":0.61099999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.5109999999999999,"5min":1.718,"15min":1.718},"last":0.998},{"interface":"front","average":{"1min":2.5870000000000002,"5min":1.3480000000000001,"15min":1.044},"min":{"1min":0.69999999999999996,"5min":0.624,"15min":0.56899999999999995},"max":{"1min":28.667999999999999,"5min":28.667999999999999,"15min":28.667999999999999},"last":0.72199999999999998}]},{"osd":5,"last update":"Tue Oct 3 19:18:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.0649999999999999,"15min":0.91500000000000004},"min":{"1min":0.65100000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":5.4459999999999997,"5min":5.4459999999999997,"15min":5.4459999999999997},"last":0.878},{"interface":"front","average":{"1min":1.776,"5min":1.25,"15min":1.026},"min":{"1min":0.63,"5min":0.57599999999999996,"15min":0.52700000000000002},"max":{"1min":14.007,"5min":14.007,"15min":14.007},"last":0.78600000000000003}]},{"osd":6,"last update":"Tue Oct 3 19:18:31 2023","interfaces":[{"interface":"back","average":{"1min":1.5629999999999999,"5min":1.113,"15min":0.97099999999999997},"min":{"1min":0.69399999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":10.679,"5min":10.679,"15min":10.679},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.103,"15min":0.998},"min":{"1min":0.67300000000000004,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.4670000000000001,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.1679999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:18:31 2023","interfaces":[{"interface":"back","average":{"1min":2.101,"5min":1.3420000000000001,"15min":1.1000000000000001},"min":{"1min":0.71599999999999997,"5min":0.63100000000000001,"15min":0.56100000000000005},"max":{"1min":18.623000000000001,"5min":18.623000000000001,"15min":18.623000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.0960000000000001,"15min":0.99199999999999999},"min":{"1min":0.71099999999999997,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":4.2910000000000004,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":1.085}]}]},{"osd":1,"up_from":15,"seq":64424509517,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30144,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94341696,"statfs":{"total":96636764160,"available":96605896704,"internally_reserved":0,"allocated":1040384,"data_stored":470539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59299999999999997,"15min":0.55100000000000005},"min":{"1min":0.30499999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.77100000000000002,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.67900000000000005,"15min":0.54100000000000004},"min":{"1min":0.27200000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.41499999999999998}]},{"osd":2,"last update":"Tue Oct 3 19:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.66900000000000004,"15min":0.57299999999999995},"min":{"1min":0.34799999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.93600000000000005,"5min":1.506,"15min":1.506},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.68500000000000005},"min":{"1min":0.41299999999999998,"5min":0.312,"15min":0.312},"max":{"1min":1.252,"5min":1.365,"15min":1.365},"last":0.45500000000000002}]},{"osd":3,"last update":"Tue Oct 3 19:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.75700000000000001,"15min":0.65400000000000003},"min":{"1min":0.36599999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.75,"15min":0.61399999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.2310000000000001,"5min":1.27,"15min":1.27},"last":0.375}]},{"osd":4,"last update":"Tue Oct 3 19:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.88800000000000001,"15min":0.81599999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.292,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":1.04,"5min":0.97199999999999998,"15min":0.90600000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.58299999999999996}]},{"osd":5,"last update":"Tue Oct 3 19:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.97399999999999998,"15min":0.878},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":1.03,"5min":0.95999999999999996,"15min":0.872},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.256,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.65000000000000002}]},{"osd":6,"last update":"Tue Oct 3 19:17:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.032,"15min":0.94199999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.518,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.077,"5min":1.022,"15min":0.91800000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.66200000000000003}]},{"osd":7,"last update":"Tue Oct 3 19:17:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.073,"15min":0.96299999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0369999999999999,"15min":0.92600000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4430000000000001,"5min":1.649,"15min":1.649},"last":0.67700000000000005}]}]},{"osd":3,"up_from":14,"seq":60129542221,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24764,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":23744,"kb_avail":94347076,"statfs":{"total":96636764160,"available":96611405824,"internally_reserved":0,"allocated":1036288,"data_stored":470469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24313856},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.64500000000000002,"15min":0.58299999999999996},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.0409999999999999,"5min":1.212,"15min":1.212},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.69799999999999995,"15min":0.65200000000000002},"min":{"1min":0.26900000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.036,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.83999999999999997}]},{"osd":1,"last update":"Tue Oct 3 19:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.70699999999999996,"15min":0.64100000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.27000000000000002},"max":{"1min":1.054,"5min":1.1180000000000001,"15min":1.1890000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.76300000000000001,"15min":0.68200000000000005},"min":{"1min":0.35499999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.1599999999999999,"5min":1.2210000000000001,"15min":1.222},"last":0.627}]},{"osd":2,"last update":"Tue Oct 3 19:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.79700000000000004,"15min":0.72299999999999998},"min":{"1min":0.42599999999999999,"5min":0.317,"15min":0.317},"max":{"1min":1.024,"5min":1.23,"15min":1.23},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.751,"15min":0.65100000000000002},"min":{"1min":0.374,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.0309999999999999,"5min":1.671,"15min":1.671},"last":0.96199999999999997}]},{"osd":4,"last update":"Tue Oct 3 19:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.92700000000000005,"15min":0.90900000000000003},"min":{"1min":0.54900000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3049999999999999,"5min":1.411,"15min":1.496},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.0129999999999999,"15min":0.94999999999999996},"min":{"1min":0.57499999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.496,"5min":1.546,"15min":1.546},"last":1.089}]},{"osd":5,"last update":"Tue Oct 3 19:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.92400000000000004,"15min":0.88400000000000001},"min":{"1min":0.69699999999999995,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0940000000000001,"5min":1.581,"15min":1.581},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0289999999999999,"15min":1.0009999999999999},"min":{"1min":0.59299999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.298,"5min":1.498,"15min":1.498},"last":1.111}]},{"osd":6,"last update":"Tue Oct 3 19:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.96099999999999997,"15min":0.92500000000000004},"min":{"1min":0.628,"5min":0.56999999999999995,"15min":0.56699999999999995},"max":{"1min":1.081,"5min":1.347,"15min":1.347},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0629999999999999,"15min":1},"min":{"1min":0.623,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3560000000000001,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.0169999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:18:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.0740000000000001,"15min":1.018},"min":{"1min":0.72099999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3899999999999999,"5min":1.629,"15min":1.629},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.0669999999999999,"15min":1.0229999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1799999999999999,"5min":1.6040000000000001,"15min":1.708},"last":1.151}]}]},{"osd":5,"up_from":13,"seq":55834574924,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22384,"kb_used_data":1000,"kb_used_omap":0,"kb_used_meta":21376,"kb_avail":94349456,"statfs":{"total":96636764160,"available":96613842944,"internally_reserved":0,"allocated":1024000,"data_stored":463816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21889024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.88,"15min":0.83399999999999996},"min":{"1min":0.58499999999999996,"5min":0.437,"15min":0.437},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.85399999999999998,"15min":0.85199999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0389999999999999,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.64500000000000002}]},{"osd":1,"last update":"Tue Oct 3 19:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86099999999999999,"15min":0.83699999999999997},"min":{"1min":0.59099999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.70699999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.159,"5min":1.514,"15min":1.514},"last":0.85499999999999998}]},{"osd":2,"last update":"Tue Oct 3 19:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91200000000000003,"15min":0.89900000000000002},"min":{"1min":0.63400000000000001,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.351,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90900000000000003,"15min":0.89700000000000002},"min":{"1min":0.57099999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0880000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.90600000000000003}]},{"osd":3,"last update":"Tue Oct 3 19:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.92800000000000005,"15min":0.92700000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.038},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0389999999999999,"15min":1.0289999999999999},"min":{"1min":0.83599999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.222,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.95699999999999996}]},{"osd":4,"last update":"Tue Oct 3 19:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.67500000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.3180000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.24},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.97999999999999998,"15min":1.026},"min":{"1min":0.67300000000000004,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.2689999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.0760000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:17:35 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.98399999999999999,"15min":1.03},"min":{"1min":0.64600000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2909999999999999,"5min":1.462,"15min":1.462},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.107,"15min":1.133},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.4159999999999999,"5min":1.823,"15min":1.823},"last":1.1639999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:17:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0609999999999999,"15min":1.075},"min":{"1min":0.84699999999999998,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.2589999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.159,"5min":1.1419999999999999,"15min":1.1519999999999999},"min":{"1min":0.87,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.413,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.1140000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574925,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29700,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":28608,"kb_avail":94342140,"statfs":{"total":96636764160,"available":96606351360,"internally_reserved":0,"allocated":1110016,"data_stored":1055290,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":29294592},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,5],"upper_bound":64},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63900000000000001,"15min":0.58899999999999997},"min":{"1min":0.39600000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.871,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":5.7480000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.72199999999999998},"min":{"1min":0.37,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.1279999999999999,"5min":1.27,"15min":1.27},"last":6.274}]},{"osd":2,"last update":"Tue Oct 3 19:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.751,"15min":0.72299999999999998},"min":{"1min":0.47299999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3080000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":6.1609999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72499999999999998,"15min":0.69699999999999995},"min":{"1min":0.33800000000000002,"5min":0.315,"15min":0.315},"max":{"1min":1.04,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.47699999999999998}]},{"osd":3,"last update":"Tue Oct 3 19:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.85699999999999998,"15min":0.749},"min":{"1min":0.51500000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.409,"5min":1.446,"15min":1.446},"last":2.3439999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.81200000000000006,"15min":0.71399999999999997},"min":{"1min":0.41999999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.103,"5min":1.375,"15min":1.375},"last":0.436}]},{"osd":4,"last update":"Tue Oct 3 19:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.92000000000000004,"15min":0.90800000000000003},"min":{"1min":0.65400000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3520000000000001,"5min":1.52,"15min":1.52},"last":8.1159999999999997},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.046,"15min":1.026},"min":{"1min":0.65200000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.393,"5min":1.508,"15min":1.508},"last":6.2320000000000002}]},{"osd":5,"last update":"Tue Oct 3 19:17:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0720000000000001,"15min":1.05},"min":{"1min":0.68999999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4359999999999999,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":17.420000000000002},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.0229999999999999,"15min":0.98299999999999998},"min":{"1min":0.68600000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3959999999999999,"5min":1.837,"15min":1.837},"last":17.643000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.052,"15min":1.02},"min":{"1min":0.66800000000000004,"5min":0.623,"15min":0.623},"max":{"1min":1.26,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":5.7220000000000004},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.05,"15min":1.002},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4750000000000001,"5min":1.637,"15min":1.637},"last":2.2290000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:17:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.097,"15min":1.046},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.488,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":5.7800000000000002},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.083,"15min":1.0609999999999999},"min":{"1min":0.68799999999999994,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3400000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.9810000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:18:32.689 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-03T19:18:32.690 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-03T19:18:32.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.857+0000 7fbaef14b640 1 Processor -- start 2023-10-03T19:18:32.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.857+0000 7fbaef14b640 1 -- start start 2023-10-03T19:18:32.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.857+0000 7fbaef14b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbae8149a90 0x7fbae80bc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:32.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.857+0000 7fbaef14b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbae806bcd0 0x7fbae806c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:32.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.857+0000 7fbaef14b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae806c8c0 con 0x7fbae80bce50 2023-10-03T19:18:32.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.857+0000 7fbaef14b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae814d0f0 con 0x7fbae8149a90 2023-10-03T19:18:32.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.857+0000 7fbaef14b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae80bb680 con 0x7fbae806bcd0 2023-10-03T19:18:32.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.861+0000 7fbaecee7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbae8149a90 0x7fbae80bc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:32.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.861+0000 7fbae7fff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbae806bcd0 0x7fbae806c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:32.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.861+0000 7fbaecee7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbae8149a90 0x7fbae80bc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:51672/0 (socket says 172.21.15.45:51672) 2023-10-03T19:18:32.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.861+0000 7fbaecee7640 1 -- 172.21.15.45:0/242129200 learned_addr learned my addr 172.21.15.45:0/242129200 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:32.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.861+0000 7fbae7fff640 1 -- 172.21.15.45:0/242129200 >> v2:172.21.15.79:3300/0 conn(0x7fbae8149a90 msgr2=0x7fbae80bc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:32.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.861+0000 7fbae7fff640 1 --2- 172.21.15.45:0/242129200 >> v2:172.21.15.79:3300/0 conn(0x7fbae8149a90 0x7fbae80bc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:32.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.861+0000 7fbae7fff640 1 -- 172.21.15.45:0/242129200 >> v1:172.21.15.79:6789/0 conn(0x7fbae80bce50 legacy=0x7fbae80c1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:32.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.861+0000 7fbae7fff640 1 -- 172.21.15.45:0/242129200 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae80bb960 con 0x7fbae806bcd0 2023-10-03T19:18:32.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.861+0000 7fbae7fff640 1 --2- 172.21.15.45:0/242129200 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbae806bcd0 0x7fbae806c1e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbad40097c0 tx=0x7fbad401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f52f5ceb9c412c35 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:32.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.861+0000 7fbae77fe640 1 -- 172.21.15.45:0/242129200 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad40ab600 con 0x7fbae806bcd0 2023-10-03T19:18:32.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.861+0000 7fbae77fe640 1 -- 172.21.15.45:0/242129200 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad40a7050 con 0x7fbae806bcd0 2023-10-03T19:18:32.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.861+0000 7fbae77fe640 1 -- 172.21.15.45:0/242129200 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad40ab980 con 0x7fbae806bcd0 2023-10-03T19:18:32.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.861+0000 7fbaef14b640 1 -- 172.21.15.45:0/242129200 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbae806bcd0 msgr2=0x7fbae806c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:32.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.861+0000 7fbaef14b640 1 --2- 172.21.15.45:0/242129200 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbae806bcd0 0x7fbae806c1e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbad40097c0 tx=0x7fbad401c480 comp rx=0 tx=0).stop 2023-10-03T19:18:32.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.861+0000 7fbaef14b640 1 -- 172.21.15.45:0/242129200 shutdown_connections 2023-10-03T19:18:32.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.861+0000 7fbaef14b640 1 --2- 172.21.15.45:0/242129200 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbae806bcd0 0x7fbae806c1e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:32.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.861+0000 7fbaef14b640 1 --2- 172.21.15.45:0/242129200 >> v2:172.21.15.79:3300/0 conn(0x7fbae8149a90 0x7fbae80bc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:32.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.861+0000 7fbaef14b640 1 -- 172.21.15.45:0/242129200 >> 172.21.15.45:0/242129200 conn(0x7fbae806a720 msgr2=0x7fbae80c0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:32.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.861+0000 7fbaef14b640 1 -- 172.21.15.45:0/242129200 shutdown_connections 2023-10-03T19:18:32.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.861+0000 7fbaef14b640 1 -- 172.21.15.45:0/242129200 wait complete. 2023-10-03T19:18:32.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.865+0000 7fbaef14b640 1 Processor -- start 2023-10-03T19:18:32.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.865+0000 7fbaef14b640 1 -- start start 2023-10-03T19:18:32.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.865+0000 7fbaef14b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbae806bcd0 0x7fbae8148a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:32.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.865+0000 7fbaef14b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbae80bce50 0x7fbae8155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:32.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.865+0000 7fbaef14b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbae8149a90 0x7fbae813f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:32.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.865+0000 7fbaef14b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae8070a70 con 0x7fbae806bcd0 2023-10-03T19:18:32.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.865+0000 7fbaef14b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae81419d0 con 0x7fbae80bce50 2023-10-03T19:18:32.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.865+0000 7fbaef14b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae8070e90 con 0x7fbae8149a90 2023-10-03T19:18:32.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.865+0000 7fbaecee7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbae806bcd0 0x7fbae8148a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:32.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.865+0000 7fbaecee7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbae806bcd0 0x7fbae8148a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43920/0 (socket says 172.21.15.45:43920) 2023-10-03T19:18:32.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.865+0000 7fbaecee7640 1 -- 172.21.15.45:0/1402620848 learned_addr learned my addr 172.21.15.45:0/1402620848 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:32.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.865+0000 7fbae7fff640 1 --2- 172.21.15.45:0/1402620848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbae80bce50 0x7fbae8155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:32.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.865+0000 7fbaed6e8640 1 --2- 172.21.15.45:0/1402620848 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbae8149a90 0x7fbae813f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:32.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.865+0000 7fbaecee7640 1 -- 172.21.15.45:0/1402620848 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbae8149a90 msgr2=0x7fbae813f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:32.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.865+0000 7fbaecee7640 1 --2- 172.21.15.45:0/1402620848 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbae8149a90 0x7fbae813f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:32.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.865+0000 7fbaecee7640 1 -- 172.21.15.45:0/1402620848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbae80bce50 msgr2=0x7fbae8155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:32.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.865+0000 7fbaecee7640 1 --2- 172.21.15.45:0/1402620848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbae80bce50 0x7fbae8155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:32.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.865+0000 7fbaecee7640 1 -- 172.21.15.45:0/1402620848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad4009420 con 0x7fbae806bcd0 2023-10-03T19:18:32.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.865+0000 7fbaecee7640 1 --2- 172.21.15.45:0/1402620848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbae806bcd0 0x7fbae8148a20 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fbadc00e890 tx=0x7fbadc00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:32.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.865+0000 7fbae57fa640 1 -- 172.21.15.45:0/1402620848 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc009620 con 0x7fbae806bcd0 2023-10-03T19:18:32.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.865+0000 7fbae57fa640 1 -- 172.21.15.45:0/1402620848 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbadc00c940 con 0x7fbae806bcd0 2023-10-03T19:18:32.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.865+0000 7fbaef14b640 1 -- 172.21.15.45:0/1402620848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae814cd50 con 0x7fbae806bcd0 2023-10-03T19:18:32.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.865+0000 7fbae57fa640 1 -- 172.21.15.45:0/1402620848 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc00ccf0 con 0x7fbae806bcd0 2023-10-03T19:18:32.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.865+0000 7fbaef14b640 1 -- 172.21.15.45:0/1402620848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae8149e60 con 0x7fbae806bcd0 2023-10-03T19:18:32.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.869+0000 7fbaef14b640 1 -- 172.21.15.45:0/1402620848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae8159470 con 0x7fbae806bcd0 2023-10-03T19:18:32.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.869+0000 7fbae57fa640 1 -- 172.21.15.45:0/1402620848 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbadc013470 con 0x7fbae806bcd0 2023-10-03T19:18:32.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.869+0000 7fbae57fa640 1 --2- 172.21.15.45:0/1402620848 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbacc066280 0x7fbacc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:32.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.869+0000 7fbae57fa640 1 -- 172.21.15.45:0/1402620848 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbadc084320 con 0x7fbae806bcd0 2023-10-03T19:18:32.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.869+0000 7fbae7fff640 1 --2- 172.21.15.45:0/1402620848 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbacc066280 0x7fbacc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:32.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.869+0000 7fbae7fff640 1 --2- 172.21.15.45:0/1402620848 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbacc066280 0x7fbacc068730 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbad40ad000 tx=0x7fbad4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:32.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:32.873+0000 7fbae57fa640 1 -- 172.21.15.45:0/1402620848 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbadc051710 con 0x7fbae806bcd0 2023-10-03T19:18:33.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.081+0000 7fbaef14b640 1 -- 172.21.15.45:0/1402620848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fbae804de80 con 0x7fbae806bcd0 2023-10-03T19:18:33.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.089+0000 7fbae57fa640 1 -- 172.21.15.45:0/1402620848 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7fbadc054d30 con 0x7fbae806bcd0 2023-10-03T19:18:33.206 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-10-03T19:18:33.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.089+0000 7fbaef14b640 1 -- 172.21.15.45:0/1402620848 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbacc066280 msgr2=0x7fbacc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:33.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.089+0000 7fbaef14b640 1 --2- 172.21.15.45:0/1402620848 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbacc066280 0x7fbacc068730 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbad40ad000 tx=0x7fbad4008040 comp rx=0 tx=0).stop 2023-10-03T19:18:33.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.089+0000 7fbaef14b640 1 -- 172.21.15.45:0/1402620848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbae806bcd0 msgr2=0x7fbae8148a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:33.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.089+0000 7fbaef14b640 1 --2- 172.21.15.45:0/1402620848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbae806bcd0 0x7fbae8148a20 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fbadc00e890 tx=0x7fbadc00ed50 comp rx=0 tx=0).stop 2023-10-03T19:18:33.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.089+0000 7fbaef14b640 1 -- 172.21.15.45:0/1402620848 shutdown_connections 2023-10-03T19:18:33.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.089+0000 7fbaef14b640 1 --2- 172.21.15.45:0/1402620848 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbacc066280 0x7fbacc068730 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:33.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.089+0000 7fbaef14b640 1 --2- 172.21.15.45:0/1402620848 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbae8149a90 0x7fbae813f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:33.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.089+0000 7fbaef14b640 1 --2- 172.21.15.45:0/1402620848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbae80bce50 0x7fbae8155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:33.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.089+0000 7fbaef14b640 1 --2- 172.21.15.45:0/1402620848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbae806bcd0 0x7fbae8148a20 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:33.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.089+0000 7fbaef14b640 1 -- 172.21.15.45:0/1402620848 >> 172.21.15.45:0/1402620848 conn(0x7fbae806a720 msgr2=0x7fbae8156460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:33.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.089+0000 7fbaef14b640 1 -- 172.21.15.45:0/1402620848 shutdown_connections 2023-10-03T19:18:33.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.089+0000 7fbaef14b640 1 -- 172.21.15.45:0/1402620848 wait complete. 2023-10-03T19:18:33.209 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:18:33.291 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:18:33.294 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:18:33.297 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:18:33.300 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:18:33.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.333+0000 7f3fe6aa1640 1 Processor -- start 2023-10-03T19:18:33.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.337+0000 7f3fe6aa1640 1 -- start start 2023-10-03T19:18:33.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.337+0000 7f3fe6aa1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3fe00bed20 0x7f3fe00bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:33.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.337+0000 7f3fe6aa1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3fe00a6f00 0x7f3fe0150200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:33.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.337+0000 7f3fe6aa1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3fe0150740 0x7f3fe00be010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:33.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.337+0000 7f3fe6aa1640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe014fd70 con 0x7f3fe00bed20 2023-10-03T19:18:33.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.337+0000 7f3fe6aa1640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe0146910 con 0x7f3fe0150740 2023-10-03T19:18:33.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.337+0000 7f3fe6aa1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe006e9f0 con 0x7f3fe00a6f00 2023-10-03T19:18:33.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.337+0000 7f3fe483d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3fe00bed20 0x7f3fe00bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:33.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.337+0000 7f3fe483d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3fe00bed20 0x7f3fe00bf0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43928/0 (socket says 172.21.15.45:43928) 2023-10-03T19:18:33.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.337+0000 7f3fe483d640 1 -- 172.21.15.45:0/1095048123 learned_addr learned my addr 172.21.15.45:0/1095048123 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:33.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.337+0000 7f3fe483d640 1 -- 172.21.15.45:0/1095048123 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3fe00a6f00 msgr2=0x7f3fe0150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:33.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.337+0000 7f3fe483d640 1 --2- 172.21.15.45:0/1095048123 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3fe00a6f00 0x7f3fe0150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:33.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.337+0000 7f3fe483d640 1 -- 172.21.15.45:0/1095048123 >> v2:172.21.15.79:3300/0 conn(0x7f3fe0150740 msgr2=0x7f3fe00be010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:33.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.337+0000 7f3fe483d640 1 --2- 172.21.15.45:0/1095048123 >> v2:172.21.15.79:3300/0 conn(0x7f3fe0150740 0x7f3fe00be010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:33.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.337+0000 7f3fe483d640 1 -- 172.21.15.45:0/1095048123 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe006ec90 con 0x7f3fe00bed20 2023-10-03T19:18:33.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.337+0000 7f3fe483d640 1 --2- 172.21.15.45:0/1095048123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fe00bed20 0x7f3fe00bf0f0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f3fe00a5d60 tx=0x7f3fd401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5304df6b7dbdf354 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:33.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.337+0000 7f3fdf7fe640 1 -- 172.21.15.45:0/1095048123 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd40ab600 con 0x7f3fe00bed20 2023-10-03T19:18:33.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.337+0000 7f3fdf7fe640 1 -- 172.21.15.45:0/1095048123 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd40a7050 con 0x7f3fe00bed20 2023-10-03T19:18:33.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.337+0000 7f3fdf7fe640 1 -- 172.21.15.45:0/1095048123 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd40ab980 con 0x7f3fe00bed20 2023-10-03T19:18:33.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fe6aa1640 1 -- 172.21.15.45:0/1095048123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fe00bed20 msgr2=0x7f3fe00bf0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:33.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fe6aa1640 1 --2- 172.21.15.45:0/1095048123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fe00bed20 0x7f3fe00bf0f0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f3fe00a5d60 tx=0x7f3fd401c500 comp rx=0 tx=0).stop 2023-10-03T19:18:33.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fe6aa1640 1 -- 172.21.15.45:0/1095048123 shutdown_connections 2023-10-03T19:18:33.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fe6aa1640 1 --2- 172.21.15.45:0/1095048123 >> v2:172.21.15.79:3300/0 conn(0x7f3fe0150740 0x7f3fe00be010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:33.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fe6aa1640 1 --2- 172.21.15.45:0/1095048123 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3fe00a6f00 0x7f3fe0150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:33.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fe6aa1640 1 --2- 172.21.15.45:0/1095048123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fe00bed20 0x7f3fe00bf0f0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:33.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fe6aa1640 1 -- 172.21.15.45:0/1095048123 >> 172.21.15.45:0/1095048123 conn(0x7f3fe006d990 msgr2=0x7f3fe006bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:33.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fe6aa1640 1 -- 172.21.15.45:0/1095048123 shutdown_connections 2023-10-03T19:18:33.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fe6aa1640 1 -- 172.21.15.45:0/1095048123 wait complete. 2023-10-03T19:18:33.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fe6aa1640 1 Processor -- start 2023-10-03T19:18:33.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fe6aa1640 1 -- start start 2023-10-03T19:18:33.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fe6aa1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3fe00a6f00 0x7f3fe01481a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:33.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fe6aa1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fe00bed20 0x7f3fe00bbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:33.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fe6aa1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fe0150740 0x7f3fe0069ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:33.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fe6aa1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe01e7c60 con 0x7f3fe0150740 2023-10-03T19:18:33.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fe6aa1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe01495a0 con 0x7f3fe00bed20 2023-10-03T19:18:33.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fe6aa1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe01486e0 con 0x7f3fe00a6f00 2023-10-03T19:18:33.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fe503e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fe0150740 0x7f3fe0069ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:33.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fe503e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fe0150740 0x7f3fe0069ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43936/0 (socket says 172.21.15.45:43936) 2023-10-03T19:18:33.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fe503e640 1 -- 172.21.15.45:0/520610508 learned_addr learned my addr 172.21.15.45:0/520610508 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:33.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fdffff640 1 --2- 172.21.15.45:0/520610508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fe00bed20 0x7f3fe00bbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:33.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fe483d640 1 --2- 172.21.15.45:0/520610508 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3fe00a6f00 0x7f3fe01481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:33.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fe503e640 1 -- 172.21.15.45:0/520610508 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3fe00a6f00 msgr2=0x7f3fe01481a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:33.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fe503e640 1 --2- 172.21.15.45:0/520610508 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3fe00a6f00 0x7f3fe01481a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:33.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fe503e640 1 -- 172.21.15.45:0/520610508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fe00bed20 msgr2=0x7f3fe00bbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:33.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fe503e640 1 --2- 172.21.15.45:0/520610508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fe00bed20 0x7f3fe00bbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:33.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fe503e640 1 -- 172.21.15.45:0/520610508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd40094d0 con 0x7f3fe0150740 2023-10-03T19:18:33.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fe503e640 1 --2- 172.21.15.45:0/520610508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fe0150740 0x7f3fe0069ad0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800b9e0 tx=0x7f3fd800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:33.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fdd7fa640 1 -- 172.21.15.45:0/520610508 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd800cb20 con 0x7f3fe0150740 2023-10-03T19:18:33.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fdd7fa640 1 -- 172.21.15.45:0/520610508 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd800cca0 con 0x7f3fe0150740 2023-10-03T19:18:33.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fe6aa1640 1 -- 172.21.15.45:0/520610508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe0071a70 con 0x7f3fe0150740 2023-10-03T19:18:33.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fdd7fa640 1 -- 172.21.15.45:0/520610508 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8014680 con 0x7f3fe0150740 2023-10-03T19:18:33.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fe6aa1640 1 -- 172.21.15.45:0/520610508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe00718e0 con 0x7f3fe0150740 2023-10-03T19:18:33.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.341+0000 7f3fe6aa1640 1 -- 172.21.15.45:0/520610508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe0071c00 con 0x7f3fe0150740 2023-10-03T19:18:33.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.345+0000 7f3fdd7fa640 1 -- 172.21.15.45:0/520610508 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3fd801d3b0 con 0x7f3fe0150740 2023-10-03T19:18:33.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.345+0000 7f3fdd7fa640 1 --2- 172.21.15.45:0/520610508 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3fc40662b0 0x7f3fc4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:33.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.345+0000 7f3fdd7fa640 1 -- 172.21.15.45:0/520610508 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3fd8083f80 con 0x7f3fe0150740 2023-10-03T19:18:33.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.345+0000 7f3fe483d640 1 --2- 172.21.15.45:0/520610508 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3fc40662b0 0x7f3fc4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:33.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.345+0000 7f3fe483d640 1 --2- 172.21.15.45:0/520610508 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3fc40662b0 0x7f3fc4068760 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3fd40ad000 tx=0x7f3fd40a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:33.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.349+0000 7f3fdd7fa640 1 -- 172.21.15.45:0/520610508 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3fd8051510 con 0x7f3fe0150740 2023-10-03T19:18:33.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.537+0000 7f3fe6aa1640 1 -- 172.21.15.45:0/520610508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3fe006bce0 con 0x7f3fe0150740 2023-10-03T19:18:33.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.537+0000 7f3fdd7fa640 1 -- 172.21.15.45:0/520610508 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+3910 (secure 0 0 0) 0x7f3fd8019020 con 0x7f3fe0150740 2023-10-03T19:18:33.541 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:18:33.541 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":44,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6094,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3237510777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3237510777},{"type":"v1","addr":"172.21.15.79:6835","nonce":3237510777}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6717,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/697890515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":697890515},{"type":"v1","addr":"172.21.15.45:6833","nonce":697890515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:18:28.260345+0000","modified":"2023-10-03T19:18:31.278054+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6720},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6720":{"gid":6720,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/125100321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":125100321},{"type":"v1","addr":"172.21.15.45:6835","nonce":125100321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-10-03T19:18:33.541 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 44 2023-10-03T19:18:33.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.541+0000 7f3fe6aa1640 1 -- 172.21.15.45:0/520610508 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3fc40662b0 msgr2=0x7f3fc4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:33.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.541+0000 7f3fe6aa1640 1 --2- 172.21.15.45:0/520610508 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3fc40662b0 0x7f3fc4068760 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3fd40ad000 tx=0x7f3fd40a6000 comp rx=0 tx=0).stop 2023-10-03T19:18:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.541+0000 7f3fe6aa1640 1 -- 172.21.15.45:0/520610508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fe0150740 msgr2=0x7f3fe0069ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.541+0000 7f3fe6aa1640 1 --2- 172.21.15.45:0/520610508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fe0150740 0x7f3fe0069ad0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800b9e0 tx=0x7f3fd800bea0 comp rx=0 tx=0).stop 2023-10-03T19:18:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.541+0000 7f3fe6aa1640 1 -- 172.21.15.45:0/520610508 shutdown_connections 2023-10-03T19:18:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.541+0000 7f3fe6aa1640 1 --2- 172.21.15.45:0/520610508 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3fc40662b0 0x7f3fc4068760 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.541+0000 7f3fe6aa1640 1 --2- 172.21.15.45:0/520610508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fe0150740 0x7f3fe0069ad0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.541+0000 7f3fe6aa1640 1 --2- 172.21.15.45:0/520610508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fe00bed20 0x7f3fe00bbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.541+0000 7f3fe6aa1640 1 --2- 172.21.15.45:0/520610508 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3fe00a6f00 0x7f3fe01481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.541+0000 7f3fe6aa1640 1 -- 172.21.15.45:0/520610508 >> 172.21.15.45:0/520610508 conn(0x7f3fe006d990 msgr2=0x7f3fe00c1680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:33.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.541+0000 7f3fe6aa1640 1 -- 172.21.15.45:0/520610508 shutdown_connections 2023-10-03T19:18:33.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.541+0000 7f3fe6aa1640 1 -- 172.21.15.45:0/520610508 wait complete. 2023-10-03T19:18:33.855 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-10-03T19:18:33.853+0000 7faa965f4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-03T19:18:33.863 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 44, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-03T19:18:28.260345+0000', 'modified': '2023-10-03T19:18:31.278054+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6720}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6720': {'gid': 6720, 'name': 'c', 'rank': 0, 'incarnation': 40, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6835/125100321', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6834', 'nonce': 125100321}, {'type': 'v1', 'addr': '172.21.15.45:6835', 'nonce': 125100321}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-03T19:18:33.863 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-03T19:18:33.863 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-03T19:18:33.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.997+0000 7f46f033e640 1 Processor -- start 2023-10-03T19:18:33.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.997+0000 7f46f033e640 1 -- start start 2023-10-03T19:18:33.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.997+0000 7f46f033e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f46e814f240 0x7f46e81528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:33.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.997+0000 7f46f033e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e806b2d0 con 0x7f46e80c2790 2023-10-03T19:18:33.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.997+0000 7f46f033e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e80a3c60 con 0x7f46e80bb1d0 2023-10-03T19:18:33.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.997+0000 7f46f033e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e806b640 con 0x7f46e814f240 2023-10-03T19:18:33.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.997+0000 7f46ed8d9640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f46e80c2790 0x7f46e80c0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54778/0 (socket says 172.21.15.45:54778) 2023-10-03T19:18:33.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.997+0000 7f46ed8d9640 1 -- 172.21.15.45:0/2988082994 learned_addr learned my addr 172.21.15.45:0/2988082994 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:18:34.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.997+0000 7f46ee0da640 1 --2- 172.21.15.45:0/2988082994 >> v2:172.21.15.45:3300/0 conn(0x7f46e814f240 0x7f46e81528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:34.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.997+0000 7f46ed0d8640 1 -- 172.21.15.45:0/2988082994 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 758147391 0 0) 0x7f46e806b2d0 con 0x7f46e80c2790 2023-10-03T19:18:34.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.997+0000 7f46ed0d8640 1 -- 172.21.15.45:0/2988082994 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46d4003530 con 0x7f46e80c2790 2023-10-03T19:18:34.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.997+0000 7f46ee0da640 1 -- 172.21.15.45:0/2988082994 >> v1:172.21.15.79:6789/0 conn(0x7f46e80bb1d0 legacy=0x7f46e80c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:34.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.997+0000 7f46ee0da640 1 -- 172.21.15.45:0/2988082994 >> v1:172.21.15.45:6789/0 conn(0x7f46e80c2790 legacy=0x7f46e80c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:34.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:33.997+0000 7f46ee0da640 1 -- 172.21.15.45:0/2988082994 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e80c19b0 con 0x7f46e814f240 2023-10-03T19:18:34.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46ee0da640 1 --2- 172.21.15.45:0/2988082994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46e814f240 0x7f46e81528d0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f46e40097b0 tx=0x7f46e401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab5d8920663801dd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:34.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46ed0d8640 1 -- 172.21.15.45:0/2988082994 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e40a8970 con 0x7f46e814f240 2023-10-03T19:18:34.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46ed0d8640 1 -- 172.21.15.45:0/2988082994 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e40a8ad0 con 0x7f46e814f240 2023-10-03T19:18:34.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46ed0d8640 1 -- 172.21.15.45:0/2988082994 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e40a8e60 con 0x7f46e814f240 2023-10-03T19:18:34.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46f033e640 1 -- 172.21.15.45:0/2988082994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46e814f240 msgr2=0x7f46e81528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:34.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46f033e640 1 --2- 172.21.15.45:0/2988082994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46e814f240 0x7f46e81528d0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f46e40097b0 tx=0x7f46e401ec70 comp rx=0 tx=0).stop 2023-10-03T19:18:34.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46f033e640 1 -- 172.21.15.45:0/2988082994 shutdown_connections 2023-10-03T19:18:34.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46f033e640 1 --2- 172.21.15.45:0/2988082994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46e814f240 0x7f46e81528d0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46f033e640 1 -- 172.21.15.45:0/2988082994 >> 172.21.15.45:0/2988082994 conn(0x7f46e80a64a0 msgr2=0x7f46e80a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:34.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46f033e640 1 -- 172.21.15.45:0/2988082994 shutdown_connections 2023-10-03T19:18:34.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46f033e640 1 -- 172.21.15.45:0/2988082994 wait complete. 2023-10-03T19:18:34.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46f033e640 1 Processor -- start 2023-10-03T19:18:34.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46f033e640 1 -- start start 2023-10-03T19:18:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46f033e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46e80bb1d0 0x7f46e80c51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46f033e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46e80c2790 0x7f46e8151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46f033e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46e814f240 0x7f46e81518b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46f033e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e8150910 con 0x7f46e80c2790 2023-10-03T19:18:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46f033e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e80c4b00 con 0x7f46e814f240 2023-10-03T19:18:34.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46f033e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e80c5730 con 0x7f46e80bb1d0 2023-10-03T19:18:34.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46ed8d9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46e80c2790 0x7f46e8151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:34.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46ed8d9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46e80c2790 0x7f46e8151370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43948/0 (socket says 172.21.15.45:43948) 2023-10-03T19:18:34.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46ed8d9640 1 -- 172.21.15.45:0/2491196081 learned_addr learned my addr 172.21.15.45:0/2491196081 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:34.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46ee0da640 1 --2- 172.21.15.45:0/2491196081 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46e80bb1d0 0x7f46e80c51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:34.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46ee8db640 1 --2- 172.21.15.45:0/2491196081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46e814f240 0x7f46e81518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:34.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46ed8d9640 1 -- 172.21.15.45:0/2491196081 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46e80bb1d0 msgr2=0x7f46e80c51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:34.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46ed8d9640 1 --2- 172.21.15.45:0/2491196081 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46e80bb1d0 0x7f46e80c51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46ed8d9640 1 -- 172.21.15.45:0/2491196081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46e814f240 msgr2=0x7f46e81518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:34.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46ed8d9640 1 --2- 172.21.15.45:0/2491196081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46e814f240 0x7f46e81518b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46ed8d9640 1 -- 172.21.15.45:0/2491196081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e40093c0 con 0x7f46e80c2790 2023-10-03T19:18:34.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46ee0da640 1 --2- 172.21.15.45:0/2491196081 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46e80bb1d0 0x7f46e80c51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:34.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46ee8db640 1 --2- 172.21.15.45:0/2491196081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46e814f240 0x7f46e81518b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:34.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.001+0000 7f46ed8d9640 1 --2- 172.21.15.45:0/2491196081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46e80c2790 0x7f46e8151370 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f46d800c6b0 tx=0x7f46d800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:34.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.005+0000 7f46deffd640 1 -- 172.21.15.45:0/2491196081 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d8007270 con 0x7f46e80c2790 2023-10-03T19:18:34.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.005+0000 7f46deffd640 1 -- 172.21.15.45:0/2491196081 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d80073d0 con 0x7f46e80c2790 2023-10-03T19:18:34.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.005+0000 7f46f033e640 1 -- 172.21.15.45:0/2491196081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e80a3f40 con 0x7f46e80c2790 2023-10-03T19:18:34.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.005+0000 7f46deffd640 1 -- 172.21.15.45:0/2491196081 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d80057b0 con 0x7f46e80c2790 2023-10-03T19:18:34.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.005+0000 7f46f033e640 1 -- 172.21.15.45:0/2491196081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e814e740 con 0x7f46e80c2790 2023-10-03T19:18:34.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.005+0000 7f46deffd640 1 -- 172.21.15.45:0/2491196081 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f46d8005910 con 0x7f46e80c2790 2023-10-03T19:18:34.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.005+0000 7f46deffd640 1 --2- 172.21.15.45:0/2491196081 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f46cc066280 0x7f46cc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:34.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.005+0000 7f46deffd640 1 -- 172.21.15.45:0/2491196081 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f46d8083350 con 0x7f46e80c2790 2023-10-03T19:18:34.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.005+0000 7f46ee0da640 1 --2- 172.21.15.45:0/2491196081 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f46cc066280 0x7f46cc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:34.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.005+0000 7f46f3462000 1 Processor -- start 2023-10-03T19:18:34.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.005+0000 7f46f3462000 1 -- start start 2023-10-03T19:18:34.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.005+0000 7f46ee0da640 1 --2- 172.21.15.45:0/2491196081 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f46cc066280 0x7f46cc068730 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f46e40b2000 tx=0x7f46e40aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:34.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.005+0000 7f46f3462000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af5014a6f0 0x55af50141ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:34.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.005+0000 7f46f3462000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af50142020 0x55af501423f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:34.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.005+0000 7f46f3462000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55af50142930 0x55af50142d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:34.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.005+0000 7f46f3462000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af5000c310 con 0x55af5014a6f0 2023-10-03T19:18:34.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.005+0000 7f46f3462000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af4ff46980 con 0x55af50142020 2023-10-03T19:18:34.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.005+0000 7f46f3462000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55af4ff9a040 con 0x55af50142930 2023-10-03T19:18:34.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.005+0000 7f46ee0da640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af5014a6f0 0x55af50141ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:34.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.005+0000 7f46ee0da640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af5014a6f0 0x55af50141ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43962/0 (socket says 172.21.15.45:43962) 2023-10-03T19:18:34.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.005+0000 7f46ee0da640 1 -- 172.21.15.45:0/1373836552 learned_addr learned my addr 172.21.15.45:0/1373836552 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:34.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46ed8d9640 1 --2- 172.21.15.45:0/1373836552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af50142020 0x55af501423f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:34.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46ee8db640 1 --2- 172.21.15.45:0/1373836552 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55af50142930 0x55af50142d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:34.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46ee0da640 1 -- 172.21.15.45:0/1373836552 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55af50142930 msgr2=0x55af50142d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:34.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46ee0da640 1 --2- 172.21.15.45:0/1373836552 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55af50142930 0x55af50142d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46ee0da640 1 -- 172.21.15.45:0/1373836552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af50142020 msgr2=0x55af501423f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:34.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46ee0da640 1 --2- 172.21.15.45:0/1373836552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af50142020 0x55af501423f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46ee0da640 1 -- 172.21.15.45:0/1373836552 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af4ff580b0 con 0x55af5014a6f0 2023-10-03T19:18:34.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46ed8d9640 1 --2- 172.21.15.45:0/1373836552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af50142020 0x55af501423f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:34.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46ee0da640 1 --2- 172.21.15.45:0/1373836552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af5014a6f0 0x55af50141ae0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f46e4000c10 tx=0x7f46e4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e23cdcc68a951f14 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:34.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46cbfff640 1 -- 172.21.15.45:0/1373836552 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e40b0940 con 0x55af5014a6f0 2023-10-03T19:18:34.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46cbfff640 1 -- 172.21.15.45:0/1373836552 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e40b0aa0 con 0x55af5014a6f0 2023-10-03T19:18:34.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46cbfff640 1 -- 172.21.15.45:0/1373836552 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e40b0e10 con 0x55af5014a6f0 2023-10-03T19:18:34.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46f3462000 1 -- 172.21.15.45:0/1373836552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af5014a6f0 msgr2=0x55af50141ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:34.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46f3462000 1 --2- 172.21.15.45:0/1373836552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af5014a6f0 0x55af50141ae0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f46e4000c10 tx=0x7f46e4004740 comp rx=0 tx=0).stop 2023-10-03T19:18:34.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46f3462000 1 -- 172.21.15.45:0/1373836552 shutdown_connections 2023-10-03T19:18:34.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46f3462000 1 --2- 172.21.15.45:0/1373836552 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55af50142930 0x55af50142d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46f3462000 1 --2- 172.21.15.45:0/1373836552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af50142020 0x55af501423f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46f3462000 1 --2- 172.21.15.45:0/1373836552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af5014a6f0 0x55af50141ae0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46f3462000 1 -- 172.21.15.45:0/1373836552 >> 172.21.15.45:0/1373836552 conn(0x55af5017c220 msgr2=0x55af5017e600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:34.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46f3462000 1 -- 172.21.15.45:0/1373836552 shutdown_connections 2023-10-03T19:18:34.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46f3462000 1 -- 172.21.15.45:0/1373836552 wait complete. 2023-10-03T19:18:34.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46f3462000 1 -- start start 2023-10-03T19:18:34.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46f3462000 1 Processor -- start 2023-10-03T19:18:34.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46f3462000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af50142020 0x55af5017b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:34.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46f3462000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af50142930 0x55af5017b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:34.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46f3462000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55af5014a6f0 0x55af501856d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:34.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46f3462000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af4ff930e0 con 0x55af50142020 2023-10-03T19:18:34.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46f3462000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af4ff4fbd0 con 0x55af50142930 2023-10-03T19:18:34.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46f3462000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55af4ff4f870 con 0x55af5014a6f0 2023-10-03T19:18:34.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46f3462000 10 client.0 _ll_register_callbacks cb 0x55af5012fc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T19:18:34.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46ee0da640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af50142020 0x55af5017b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:34.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46ee0da640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af50142020 0x55af5017b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43966/0 (socket says 172.21.15.45:43966) 2023-10-03T19:18:34.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46ee0da640 1 -- 172.21.15.45:0/2112354238 learned_addr learned my addr 172.21.15.45:0/2112354238 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:34.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46ee0da640 1 -- 172.21.15.45:0/2112354238 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55af5014a6f0 msgr2=0x55af501856d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:34.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46ed8d9640 1 --2- 172.21.15.45:0/2112354238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af50142930 0x55af5017b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:34.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46ee8db640 1 --2- 172.21.15.45:0/2112354238 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55af5014a6f0 0x55af501856d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:34.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46ee0da640 1 --2- 172.21.15.45:0/2112354238 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55af5014a6f0 0x55af501856d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46ee0da640 1 -- 172.21.15.45:0/2112354238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af50142930 msgr2=0x55af5017b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:34.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46ee0da640 1 --2- 172.21.15.45:0/2112354238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af50142930 0x55af5017b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46ee0da640 1 -- 172.21.15.45:0/2112354238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e80c19b0 con 0x55af50142020 2023-10-03T19:18:34.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46ee0da640 1 --2- 172.21.15.45:0/2112354238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af50142020 0x55af5017b3b0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f46e401ecb0 tx=0x7f46e401d4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e814333f6e9acd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:34.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-10-03T19:18:34.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46c97fa640 1 -- 172.21.15.45:0/2112354238 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e4003620 con 0x55af50142020 2023-10-03T19:18:34.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46c97fa640 1 -- 172.21.15.45:0/2112354238 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f46e4003780 con 0x55af50142020 2023-10-03T19:18:34.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46f3462000 1 -- 172.21.15.45:0/2112354238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55af4ff8e8b0 con 0x55af50142020 2023-10-03T19:18:34.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46c97fa640 1 -- 172.21.15.45:0/2112354238 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46e4003940 con 0x55af50142020 2023-10-03T19:18:34.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46f3462000 10 client.6867 fetch_fsmap learned FSMap version 44 2023-10-03T19:18:34.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46f3462000 1 -- 172.21.15.45:0/2112354238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x55af4fc8f890 con 0x55af50142020 2023-10-03T19:18:34.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46c97fa640 1 -- 172.21.15.45:0/2112354238 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55af4ff8e8b0 con 0x55af50142020 2023-10-03T19:18:34.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.009+0000 7f46c97fa640 1 -- 172.21.15.45:0/2112354238 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 44) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f46e4003aa0 con 0x55af50142020 2023-10-03T19:18:34.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.013+0000 7f46f3462000 10 client.6867 fetch_fsmap finished waiting for FSMap version 44 2023-10-03T19:18:34.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.013+0000 7f46f3462000 10 client.6867 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-03T19:18:34.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.013+0000 7f46f3462000 20 client.6867 populate_metadata read hostname 'smithi045' 2023-10-03T19:18:34.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.013+0000 7f46f3462000 1 --2- 172.21.15.45:0/2112354238 >> [v2:172.21.15.45:6834/125100321,v1:172.21.15.45:6835/125100321] conn(0x55af501860e0 0x55af501864b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:34.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.013+0000 7f46f3462000 4 client.6867 mds_command: new command op to 6720 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-03T19:18:34.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.013+0000 7f46f3462000 1 -- 172.21.15.45:0/2112354238 --> [v2:172.21.15.45:6834/125100321,v1:172.21.15.45:6835/125100321] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55af4ffc1f70 con 0x55af501860e0 2023-10-03T19:18:34.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.013+0000 7f46ed8d9640 1 --2- 172.21.15.45:0/2112354238 >> [v2:172.21.15.45:6834/125100321,v1:172.21.15.45:6835/125100321] conn(0x55af501860e0 0x55af501864b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:34.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.013+0000 7f46ed8d9640 1 --2- 172.21.15.45:0/2112354238 >> [v2:172.21.15.45:6834/125100321,v1:172.21.15.45:6835/125100321] conn(0x55af501860e0 0x55af501864b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d48b424eb34ca73 server_cookie=27767bb5898e4ebe in_seq=0 out_seq=0 2023-10-03T19:18:34.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.013+0000 7f46c97fa640 10 client.6867 ms_handle_connect on v2:172.21.15.45:6834/125100321 2023-10-03T19:18:34.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.013+0000 7f46c97fa640 1 -- 172.21.15.45:0/2112354238 <== mds.0 v2:172.21.15.45:6834/125100321 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55af4ffc1f70 con 0x55af501860e0 2023-10-03T19:18:34.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.013+0000 7f46c97fa640 10 client.6867 handle_command_reply: tid=0 2023-10-03T19:18:34.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.013+0000 7f46f3462000 1 client.6867 shutdown 2023-10-03T19:18:34.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.013+0000 7f46f3462000 1 -- 172.21.15.45:0/2112354238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af50142020 msgr2=0x55af5017b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:34.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.013+0000 7f46f3462000 1 --2- 172.21.15.45:0/2112354238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af50142020 0x55af5017b3b0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f46e401ecb0 tx=0x7f46e401d4b0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.013+0000 7f46f3462000 1 -- 172.21.15.45:0/2112354238 shutdown_connections 2023-10-03T19:18:34.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.013+0000 7f46f3462000 1 --2- 172.21.15.45:0/2112354238 >> [v2:172.21.15.45:6834/125100321,v1:172.21.15.45:6835/125100321] conn(0x55af501860e0 0x55af501864b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.013+0000 7f46f3462000 1 --2- 172.21.15.45:0/2112354238 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55af5014a6f0 0x55af501856d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.013+0000 7f46f3462000 1 --2- 172.21.15.45:0/2112354238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af50142930 0x55af5017b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.013+0000 7f46c97fa640 0 client.6867 ms_handle_reset on v2:172.21.15.45:6834/125100321 2023-10-03T19:18:34.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.013+0000 7f46f3462000 1 --2- 172.21.15.45:0/2112354238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af50142020 0x55af5017b3b0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.013+0000 7f46f3462000 1 -- 172.21.15.45:0/2112354238 >> 172.21.15.45:0/2112354238 conn(0x55af5017c220 msgr2=0x55af5017e600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:34.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.013+0000 7f46f3462000 1 -- 172.21.15.45:0/2112354238 shutdown_connections 2023-10-03T19:18:34.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.013+0000 7f46f3462000 1 -- 172.21.15.45:0/2112354238 wait complete. 2023-10-03T19:18:34.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.013+0000 7f46f3462000 20 client.6867 trim_cache size 0 max 16384 2023-10-03T19:18:34.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46f3462000 1 Processor -- start 2023-10-03T19:18:34.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46f3462000 1 -- start start 2023-10-03T19:18:34.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46f3462000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af50142020 0x55af50195800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:34.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46f3462000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55af50142930 0x55af50195d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:34.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46f3462000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af5014a6f0 0x55af50193c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:34.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46f3462000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af4fc50940 con 0x55af50142020 2023-10-03T19:18:34.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46f3462000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af4ff4c560 con 0x55af5014a6f0 2023-10-03T19:18:34.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46f3462000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55af50148f60 con 0x55af50142930 2023-10-03T19:18:34.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46ee0da640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af50142020 0x55af50195800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:34.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46ee0da640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af50142020 0x55af50195800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43970/0 (socket says 172.21.15.45:43970) 2023-10-03T19:18:34.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46ee0da640 1 -- 172.21.15.45:0/2705730761 learned_addr learned my addr 172.21.15.45:0/2705730761 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:34.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46ee0da640 1 -- 172.21.15.45:0/2705730761 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55af50142930 msgr2=0x55af50195d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:34.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46ee0da640 1 --2- 172.21.15.45:0/2705730761 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55af50142930 0x55af50195d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46ee0da640 1 -- 172.21.15.45:0/2705730761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af5014a6f0 msgr2=0x55af50193c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:34.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46ee0da640 1 --2- 172.21.15.45:0/2705730761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af5014a6f0 0x55af50193c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46ee0da640 1 -- 172.21.15.45:0/2705730761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af4ff58360 con 0x55af50142020 2023-10-03T19:18:34.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46ee0da640 1 --2- 172.21.15.45:0/2705730761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af50142020 0x55af50195800 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f46e409b490 tx=0x7f46e40cc000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd83a34f24a1b311 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:34.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46dcff9640 1 -- 172.21.15.45:0/2705730761 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e4004370 con 0x55af50142020 2023-10-03T19:18:34.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46dcff9640 1 -- 172.21.15.45:0/2705730761 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e40044d0 con 0x55af50142020 2023-10-03T19:18:34.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46dcff9640 1 -- 172.21.15.45:0/2705730761 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e4003840 con 0x55af50142020 2023-10-03T19:18:34.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46f3462000 1 -- 172.21.15.45:0/2705730761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af50142020 msgr2=0x55af50195800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:34.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46f3462000 1 --2- 172.21.15.45:0/2705730761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af50142020 0x55af50195800 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f46e409b490 tx=0x7f46e40cc000 comp rx=0 tx=0).stop 2023-10-03T19:18:34.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46f3462000 1 -- 172.21.15.45:0/2705730761 shutdown_connections 2023-10-03T19:18:34.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46f3462000 1 --2- 172.21.15.45:0/2705730761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af5014a6f0 0x55af50193c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46f3462000 1 --2- 172.21.15.45:0/2705730761 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55af50142930 0x55af50195d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46f3462000 1 --2- 172.21.15.45:0/2705730761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af50142020 0x55af50195800 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46f3462000 1 -- 172.21.15.45:0/2705730761 >> 172.21.15.45:0/2705730761 conn(0x55af5017c220 msgr2=0x55af50196c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:34.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46f3462000 1 -- 172.21.15.45:0/2705730761 shutdown_connections 2023-10-03T19:18:34.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46f3462000 1 -- 172.21.15.45:0/2705730761 wait complete. 2023-10-03T19:18:34.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46f3462000 1 -- start start 2023-10-03T19:18:34.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.029+0000 7f46f3462000 1 Processor -- start 2023-10-03T19:18:34.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f3462000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55af50142020 0x55af501a8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:34.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f3462000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af50142930 0x55af501a87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:34.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f3462000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af5014a6f0 0x55af501a8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:34.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f3462000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af5017b6b0 con 0x55af50142930 2023-10-03T19:18:34.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f3462000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af4ff3b710 con 0x55af5014a6f0 2023-10-03T19:18:34.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f3462000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55af4ff62cd0 con 0x55af50142020 2023-10-03T19:18:34.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f3462000 10 client.0 _ll_register_callbacks cb 0x55af4ff95260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T19:18:34.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46ed8d9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af50142930 0x55af501a87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:34.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46ed8d9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af50142930 0x55af501a87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43978/0 (socket says 172.21.15.45:43978) 2023-10-03T19:18:34.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46ed8d9640 1 -- 172.21.15.45:0/4090495751 learned_addr learned my addr 172.21.15.45:0/4090495751 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:34.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46ee0da640 1 --2- 172.21.15.45:0/4090495751 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55af50142020 0x55af501a8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:34.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46ed8d9640 1 -- 172.21.15.45:0/4090495751 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55af50142020 msgr2=0x55af501a8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:34.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46ed8d9640 1 --2- 172.21.15.45:0/4090495751 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55af50142020 0x55af501a8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46ed8d9640 1 -- 172.21.15.45:0/4090495751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af5014a6f0 msgr2=0x55af501a8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:34.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46ed8d9640 1 --2- 172.21.15.45:0/4090495751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af5014a6f0 0x55af501a8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46ed8d9640 1 -- 172.21.15.45:0/4090495751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55af4fc8f890 con 0x55af50142930 2023-10-03T19:18:34.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46ee0da640 1 --2- 172.21.15.45:0/4090495751 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55af50142020 0x55af501a8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:34.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46ed8d9640 1 --2- 172.21.15.45:0/4090495751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af50142930 0x55af501a87b0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f46d8001010 tx=0x7f46d8007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7091fecd3f988b9e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:34.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-10-03T19:18:34.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46c97fa640 1 -- 172.21.15.45:0/4090495751 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d8083170 con 0x55af50142930 2023-10-03T19:18:34.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46c97fa640 1 -- 172.21.15.45:0/4090495751 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f46d8050ba0 con 0x55af50142930 2023-10-03T19:18:34.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f3462000 1 -- 172.21.15.45:0/4090495751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f46e40b0aa0 con 0x55af50142930 2023-10-03T19:18:34.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46c97fa640 1 -- 172.21.15.45:0/4090495751 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46d8050d80 con 0x55af50142930 2023-10-03T19:18:34.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f3462000 10 client.6873 fetch_fsmap learned FSMap version 44 2023-10-03T19:18:34.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f3462000 1 -- 172.21.15.45:0/4090495751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x55af4ff3dbe0 con 0x55af50142930 2023-10-03T19:18:34.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46c97fa640 1 -- 172.21.15.45:0/4090495751 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e40b0aa0 con 0x55af50142930 2023-10-03T19:18:34.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46c97fa640 1 -- 172.21.15.45:0/4090495751 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 44) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f46d8081250 con 0x55af50142930 2023-10-03T19:18:34.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f3462000 10 client.6873 fetch_fsmap finished waiting for FSMap version 44 2023-10-03T19:18:34.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f3462000 10 client.6873 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-03T19:18:34.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f3462000 20 client.6873 populate_metadata read hostname 'smithi045' 2023-10-03T19:18:34.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f3462000 1 --2- 172.21.15.45:0/4090495751 >> [v2:172.21.15.45:6834/125100321,v1:172.21.15.45:6835/125100321] conn(0x55af501e5ba0 0x55af501e7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:34.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f3462000 4 client.6873 mds_command: new command op to 6720 tid=0[{"prefix": "status"}] 2023-10-03T19:18:34.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f3462000 1 -- 172.21.15.45:0/4090495751 --> [v2:172.21.15.45:6834/125100321,v1:172.21.15.45:6835/125100321] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55af4ff8c0c0 con 0x55af501e5ba0 2023-10-03T19:18:34.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46ee0da640 1 --2- 172.21.15.45:0/4090495751 >> [v2:172.21.15.45:6834/125100321,v1:172.21.15.45:6835/125100321] conn(0x55af501e5ba0 0x55af501e7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:34.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46c97fa640 10 client.6873 ms_handle_connect on v2:172.21.15.45:6834/125100321 2023-10-03T19:18:34.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46ee0da640 1 --2- 172.21.15.45:0/4090495751 >> [v2:172.21.15.45:6834/125100321,v1:172.21.15.45:6835/125100321] conn(0x55af501e5ba0 0x55af501e7f80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7634b861a598f22d server_cookie=4bd47928256bd1f1 in_seq=0 out_seq=0 2023-10-03T19:18:34.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46c97fa640 1 -- 172.21.15.45:0/4090495751 <== mds.0 v2:172.21.15.45:6834/125100321 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55af4ff8c0c0 con 0x55af501e5ba0 2023-10-03T19:18:34.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46c97fa640 10 client.6873 handle_command_reply: tid=0 2023-10-03T19:18:34.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f3462000 1 client.6873 shutdown 2023-10-03T19:18:34.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f3462000 1 -- 172.21.15.45:0/4090495751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af50142930 msgr2=0x55af501a87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:34.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f3462000 1 --2- 172.21.15.45:0/4090495751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af50142930 0x55af501a87b0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f46d8001010 tx=0x7f46d8007f10 comp rx=0 tx=0).stop 2023-10-03T19:18:34.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f3462000 1 -- 172.21.15.45:0/4090495751 shutdown_connections 2023-10-03T19:18:34.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f3462000 1 --2- 172.21.15.45:0/4090495751 >> [v2:172.21.15.45:6834/125100321,v1:172.21.15.45:6835/125100321] conn(0x55af501e5ba0 0x55af501e7f80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f3462000 1 --2- 172.21.15.45:0/4090495751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af5014a6f0 0x55af501a8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f3462000 1 --2- 172.21.15.45:0/4090495751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af50142930 0x55af501a87b0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f3462000 1 --2- 172.21.15.45:0/4090495751 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55af50142020 0x55af501a8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46c97fa640 0 client.6873 ms_handle_reset on v2:172.21.15.45:6834/125100321 2023-10-03T19:18:34.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f3462000 1 -- 172.21.15.45:0/4090495751 >> 172.21.15.45:0/4090495751 conn(0x55af5017c220 msgr2=0x55af501950a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:34.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f3462000 1 -- 172.21.15.45:0/4090495751 shutdown_connections 2023-10-03T19:18:34.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f3462000 1 -- 172.21.15.45:0/4090495751 wait complete. 2023-10-03T19:18:34.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f3462000 20 client.6873 trim_cache size 0 max 16384 2023-10-03T19:18:34.043 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-03T19:18:34.043 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "58400977-12ba-4c73-bb3e-1589b2492669", 2023-10-03T19:18:34.043 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-10-03T19:18:34.043 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 6720, 2023-10-03T19:18:34.043 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-10-03T19:18:34.043 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-10-03T19:18:34.043 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-10-03T19:18:34.044 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 5.7719327629999997, 2023-10-03T19:18:34.044 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 44, 2023-10-03T19:18:34.044 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 85, 2023-10-03T19:18:34.044 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 85, 2023-10-03T19:18:34.044 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 11.152464885000001 2023-10-03T19:18:34.044 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-03T19:18:34.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f033e640 1 -- 172.21.15.45:0/2491196081 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f46cc066280 msgr2=0x7f46cc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:34.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f033e640 1 --2- 172.21.15.45:0/2491196081 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f46cc066280 0x7f46cc068730 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f46e40b2000 tx=0x7f46e40aa070 comp rx=0 tx=0).stop 2023-10-03T19:18:34.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f033e640 1 -- 172.21.15.45:0/2491196081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46e80c2790 msgr2=0x7f46e8151370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:34.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f033e640 1 --2- 172.21.15.45:0/2491196081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46e80c2790 0x7f46e8151370 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f46d800c6b0 tx=0x7f46d800cb70 comp rx=0 tx=0).stop 2023-10-03T19:18:34.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f033e640 1 -- 172.21.15.45:0/2491196081 shutdown_connections 2023-10-03T19:18:34.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f033e640 1 --2- 172.21.15.45:0/2491196081 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f46cc066280 0x7f46cc068730 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f033e640 1 --2- 172.21.15.45:0/2491196081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46e814f240 0x7f46e81518b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f033e640 1 --2- 172.21.15.45:0/2491196081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46e80c2790 0x7f46e8151370 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f033e640 1 --2- 172.21.15.45:0/2491196081 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46e80bb1d0 0x7f46e80c51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f033e640 1 -- 172.21.15.45:0/2491196081 >> 172.21.15.45:0/2491196081 conn(0x7f46e80a64a0 msgr2=0x7f46e80a6870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:34.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f033e640 1 -- 172.21.15.45:0/2491196081 shutdown_connections 2023-10-03T19:18:34.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.033+0000 7f46f033e640 1 -- 172.21.15.45:0/2491196081 wait complete. 2023-10-03T19:18:34.052 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-03T19:18:34.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.165+0000 7f99e90a3640 1 Processor -- start 2023-10-03T19:18:34.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.165+0000 7f99e90a3640 1 -- start start 2023-10-03T19:18:34.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.169+0000 7f99e90a3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f99e40a5780 0x7f99e406e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:34.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.169+0000 7f99e90a3640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e40665f0 con 0x7f99e40bdbb0 2023-10-03T19:18:34.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.169+0000 7f99e90a3640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e406d860 con 0x7f99e406d350 2023-10-03T19:18:34.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.169+0000 7f99e90a3640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e40bd9e0 con 0x7f99e40a5780 2023-10-03T19:18:34.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.169+0000 7f99e2d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f99e40a5780 0x7f99e406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:34.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.169+0000 7f99e359e640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f99e40bdbb0 0x7f99e414bd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54786/0 (socket says 172.21.15.45:54786) 2023-10-03T19:18:34.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.169+0000 7f99e359e640 1 -- 172.21.15.45:0/2546144311 learned_addr learned my addr 172.21.15.45:0/2546144311 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:18:34.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.169+0000 7f99e1d9b640 1 -- 172.21.15.45:0/2546144311 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2642421145 0 0) 0x7f99e40665f0 con 0x7f99e40bdbb0 2023-10-03T19:18:34.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.169+0000 7f99e1d9b640 1 -- 172.21.15.45:0/2546144311 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99cc003530 con 0x7f99e40bdbb0 2023-10-03T19:18:34.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.169+0000 7f99e2d9d640 1 -- 172.21.15.45:0/2546144311 >> v1:172.21.15.79:6789/0 conn(0x7f99e406d350 legacy=0x7f99e4065690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:34.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.169+0000 7f99e2d9d640 1 -- 172.21.15.45:0/2546144311 >> v1:172.21.15.45:6789/0 conn(0x7f99e40bdbb0 legacy=0x7f99e414bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:34.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.169+0000 7f99e2d9d640 1 -- 172.21.15.45:0/2546144311 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e406dab0 con 0x7f99e40a5780 2023-10-03T19:18:34.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e2d9d640 1 --2- 172.21.15.45:0/2546144311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99e40a5780 0x7f99e406e110 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f99d80097c0 tx=0x7f99d801ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be60c2d40baddf66 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:34.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e1d9b640 1 -- 172.21.15.45:0/2546144311 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d80a8930 con 0x7f99e40a5780 2023-10-03T19:18:34.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e1d9b640 1 -- 172.21.15.45:0/2546144311 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d80a8a90 con 0x7f99e40a5780 2023-10-03T19:18:34.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e1d9b640 1 -- 172.21.15.45:0/2546144311 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d80a8e20 con 0x7f99e40a5780 2023-10-03T19:18:34.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e90a3640 1 -- 172.21.15.45:0/2546144311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99e40a5780 msgr2=0x7f99e406e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:34.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e90a3640 1 --2- 172.21.15.45:0/2546144311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99e40a5780 0x7f99e406e110 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f99d80097c0 tx=0x7f99d801ec30 comp rx=0 tx=0).stop 2023-10-03T19:18:34.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e90a3640 1 -- 172.21.15.45:0/2546144311 shutdown_connections 2023-10-03T19:18:34.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e90a3640 1 --2- 172.21.15.45:0/2546144311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99e40a5780 0x7f99e406e110 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e90a3640 1 -- 172.21.15.45:0/2546144311 >> 172.21.15.45:0/2546144311 conn(0x7f99e40c1600 msgr2=0x7f99e40c1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:34.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e90a3640 1 -- 172.21.15.45:0/2546144311 shutdown_connections 2023-10-03T19:18:34.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e90a3640 1 -- 172.21.15.45:0/2546144311 wait complete. 2023-10-03T19:18:34.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e90a3640 1 Processor -- start 2023-10-03T19:18:34.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e90a3640 1 -- start start 2023-10-03T19:18:34.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e90a3640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f99e406d350 0x7f99e41436e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:34.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e90a3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99e40a5780 0x7f99e40c0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:34.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e90a3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99e40bdbb0 0x7f99e413f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:34.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e90a3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e41448a0 con 0x7f99e40bdbb0 2023-10-03T19:18:34.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e90a3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e4143f00 con 0x7f99e40a5780 2023-10-03T19:18:34.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e90a3640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e41441e0 con 0x7f99e406d350 2023-10-03T19:18:34.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99e40bdbb0 0x7f99e413f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:34.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99e40bdbb0 0x7f99e413f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43996/0 (socket says 172.21.15.45:43996) 2023-10-03T19:18:34.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e359e640 1 -- 172.21.15.45:0/1910683576 learned_addr learned my addr 172.21.15.45:0/1910683576 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:34.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e259c640 1 --2- 172.21.15.45:0/1910683576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99e40a5780 0x7f99e40c0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:34.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e2d9d640 1 --2- 172.21.15.45:0/1910683576 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f99e406d350 0x7f99e41436e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:34.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e359e640 1 -- 172.21.15.45:0/1910683576 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f99e406d350 msgr2=0x7f99e41436e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:34.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e359e640 1 --2- 172.21.15.45:0/1910683576 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f99e406d350 0x7f99e41436e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e359e640 1 -- 172.21.15.45:0/1910683576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99e40a5780 msgr2=0x7f99e40c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:34.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e359e640 1 --2- 172.21.15.45:0/1910683576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99e40a5780 0x7f99e40c0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e359e640 1 -- 172.21.15.45:0/1910683576 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d8009420 con 0x7f99e40bdbb0 2023-10-03T19:18:34.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e359e640 1 --2- 172.21.15.45:0/1910683576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99e40bdbb0 0x7f99e413f3a0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00caa0 tx=0x7f99dc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:34.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99cb7fe640 1 -- 172.21.15.45:0/1910683576 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99dc00ac00 con 0x7f99e40bdbb0 2023-10-03T19:18:34.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99cb7fe640 1 -- 172.21.15.45:0/1910683576 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99dc00ad60 con 0x7f99e40bdbb0 2023-10-03T19:18:34.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e90a3640 1 -- 172.21.15.45:0/1910683576 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e40a61d0 con 0x7f99e40bdbb0 2023-10-03T19:18:34.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99cb7fe640 1 -- 172.21.15.45:0/1910683576 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99dc012620 con 0x7f99e40bdbb0 2023-10-03T19:18:34.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.173+0000 7f99e90a3640 1 -- 172.21.15.45:0/1910683576 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e40bd700 con 0x7f99e40bdbb0 2023-10-03T19:18:34.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.177+0000 7f99e90a3640 1 -- 172.21.15.45:0/1910683576 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e414c480 con 0x7f99e40bdbb0 2023-10-03T19:18:34.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.177+0000 7f99cb7fe640 1 -- 172.21.15.45:0/1910683576 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f99dc007070 con 0x7f99e40bdbb0 2023-10-03T19:18:34.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.177+0000 7f99cb7fe640 1 --2- 172.21.15.45:0/1910683576 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f99d0066280 0x7f99d0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:34.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.177+0000 7f99cb7fe640 1 -- 172.21.15.45:0/1910683576 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f99dc083ce0 con 0x7f99e40bdbb0 2023-10-03T19:18:34.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.177+0000 7f99e2d9d640 1 --2- 172.21.15.45:0/1910683576 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f99d0066280 0x7f99d0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:34.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.177+0000 7f99e2d9d640 1 --2- 172.21.15.45:0/1910683576 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f99d0066280 0x7f99d0068730 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f99d80b2000 tx=0x7f99d8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:34.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.181+0000 7f99cb7fe640 1 -- 172.21.15.45:0/1910683576 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f99dc051160 con 0x7f99e40bdbb0 2023-10-03T19:18:34.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.369+0000 7f99e90a3640 1 -- 172.21.15.45:0/1910683576 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f99e404de80 con 0x7f99e40bdbb0 2023-10-03T19:18:34.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.369+0000 7f99cb7fe640 1 -- 172.21.15.45:0/1910683576 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v44) v1 ==== 53+0+73 (secure 0 0 0) 0x7f99dc017020 con 0x7f99e40bdbb0 2023-10-03T19:18:34.373 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-03T19:18:34.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.373+0000 7f99e90a3640 1 -- 172.21.15.45:0/1910683576 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f99d0066280 msgr2=0x7f99d0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:34.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.373+0000 7f99e90a3640 1 --2- 172.21.15.45:0/1910683576 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f99d0066280 0x7f99d0068730 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f99d80b2000 tx=0x7f99d8008040 comp rx=0 tx=0).stop 2023-10-03T19:18:34.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.373+0000 7f99e90a3640 1 -- 172.21.15.45:0/1910683576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99e40bdbb0 msgr2=0x7f99e413f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:34.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.373+0000 7f99e90a3640 1 --2- 172.21.15.45:0/1910683576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99e40bdbb0 0x7f99e413f3a0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00caa0 tx=0x7f99dc00cf60 comp rx=0 tx=0).stop 2023-10-03T19:18:34.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.373+0000 7f99e90a3640 1 -- 172.21.15.45:0/1910683576 shutdown_connections 2023-10-03T19:18:34.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.373+0000 7f99e90a3640 1 --2- 172.21.15.45:0/1910683576 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f99d0066280 0x7f99d0068730 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.373+0000 7f99e90a3640 1 --2- 172.21.15.45:0/1910683576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99e40bdbb0 0x7f99e413f3a0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.373+0000 7f99e90a3640 1 --2- 172.21.15.45:0/1910683576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99e40a5780 0x7f99e40c0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.373+0000 7f99e90a3640 1 --2- 172.21.15.45:0/1910683576 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f99e406d350 0x7f99e41436e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:34.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.373+0000 7f99e90a3640 1 -- 172.21.15.45:0/1910683576 >> 172.21.15.45:0/1910683576 conn(0x7f99e40c1600 msgr2=0x7f99e40bb610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:34.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.373+0000 7f99e90a3640 1 -- 172.21.15.45:0/1910683576 shutdown_connections 2023-10-03T19:18:34.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:34.373+0000 7f99e90a3640 1 -- 172.21.15.45:0/1910683576 wait complete. 2023-10-03T19:18:34.392 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-03T19:18:34.392 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-03T19:18:34.392 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-10-03T19:18:34.392 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-03T19:18:34.392 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-03T19:18:34.392 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-03T19:18:34.392 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-03T19:18:34.392 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-03T19:18:34.392 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-03T19:18:34.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:18:34.393 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-10-03T19:18:34.399 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-03T19:18:34.399 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-03T19:18:34.400 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-10-03T19:18:34.400 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:18:34.400 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-10-03T19:18:34.400 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:18:34.400 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:18:34.400 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-10-03T19:18:34.400 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-10-03T19:18:34.400 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:18:34.400 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-10-03T19:18:34.402 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-10-03T19:18:34.402 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:18:34.402 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-10-03T19:18:34.402 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-03T19:18:34.402 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-10-03T19:18:34.402 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-03T19:18:34.402 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42068sec preferred_lft 42068sec 2023-10-03T19:18:34.402 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2023-10-03T19:18:34.402 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:18:34.402 INFO:teuthology.orchestra.run.smithi146.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-03T19:18:34.402 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 02:42:a6:2d:ab:3b brd ff:ff:ff:ff:ff:ff 2023-10-03T19:18:34.403 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-03T19:18:34.403 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:18:34.403 INFO:teuthology.orchestra.run.smithi146.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-03T19:18:34.403 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-03T19:18:34.403 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-03T19:18:34.403 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:18:34.403 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::5c3e:4eff:fee6:56da/64 scope link 2023-10-03T19:18:34.403 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:18:34.403 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-03T19:18:34.403 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T19:18:34.403 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-03T19:18:34.403 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:18:34.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:18:34.404 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-03T19:18:34.457 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T19:18:34.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:18:34.459 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-10-03T19:18:34.513 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-10-03T19:18:34.513 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-03T19:18:34.513 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-03T19:18:34.514 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-03T19:18:34.514 INFO:teuthology.orchestra.run.smithi146.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-03T19:18:34.514 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-03T19:18:34.514 INFO:teuthology.orchestra.run.smithi146.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:18:34.514 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:18:34.514 INFO:teuthology.orchestra.run.smithi146.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:18:34.514 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-03T19:18:34.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:18:34.515 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-03T19:18:34.515 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-03T19:18:34.515 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-03T19:18:34.515 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-03T19:18:34.515 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-03T19:18:34.515 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-03T19:18:34.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:18:34.593 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-10-03T19:18:34.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-03T19:18:34.639 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-03T19:18:34.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:18:34.639 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-10-03T19:18:34.694 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-03T19:18:34.694 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T19:18:34.694 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-03T19:18:34.746 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-03T19:18:34.746 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T19:18:34.746 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-03T19:18:34.793 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-03T19:18:34.851 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:18:34.851 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:18:34.904 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:18:34.905 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:18:34.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:18:34.906 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-03T19:18:34.954 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-03T19:18:34.954 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-03T19:18:34.999 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-03T19:18:35.015 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:18:35.015 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:18:35.067 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:18:35.068 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:18:35.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:18:35.069 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-03T19:18:35.074 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:2023-10-03T19:18:35.070+0000 7f5fcad5d580 -1 init, newargv = 0x55b60fd6f330 newargc=15 2023-10-03T19:18:35.075 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[33814]: starting ceph client 2023-10-03T19:18:35.084 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[33814]: starting fuse 2023-10-03T19:18:36.180 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-03T19:18:36.195 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:18:36.195 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:18:36.248 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:18:36.249 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:18:36.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:18:36.250 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-03T19:18:36.298 INFO:teuthology.orchestra.run.smithi146.stdout:45 2023-10-03T19:18:36.298 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-03T19:18:36.298 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-03T19:18:36.298 DEBUG:teuthology.orchestra.run.smithi146:> import glob 2023-10-03T19:18:36.298 DEBUG:teuthology.orchestra.run.smithi146:> import re 2023-10-03T19:18:36.298 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-03T19:18:36.299 DEBUG:teuthology.orchestra.run.smithi146:> import subprocess 2023-10-03T19:18:36.299 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:18:36.299 DEBUG:teuthology.orchestra.run.smithi146:> def _find_admin_socket(client_name): 2023-10-03T19:18:36.299 DEBUG:teuthology.orchestra.run.smithi146:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-03T19:18:36.299 DEBUG:teuthology.orchestra.run.smithi146:> files = glob.glob(asok_path) 2023-10-03T19:18:36.299 DEBUG:teuthology.orchestra.run.smithi146:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-03T19:18:36.299 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:18:36.299 DEBUG:teuthology.orchestra.run.smithi146:> # Given a non-glob path, it better be there 2023-10-03T19:18:36.299 DEBUG:teuthology.orchestra.run.smithi146:> if "*" not in asok_path: 2023-10-03T19:18:36.299 DEBUG:teuthology.orchestra.run.smithi146:> assert(len(files) == 1) 2023-10-03T19:18:36.299 DEBUG:teuthology.orchestra.run.smithi146:> return files[0] 2023-10-03T19:18:36.299 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:18:36.299 DEBUG:teuthology.orchestra.run.smithi146:> for f in files: 2023-10-03T19:18:36.300 DEBUG:teuthology.orchestra.run.smithi146:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-03T19:18:36.300 DEBUG:teuthology.orchestra.run.smithi146:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-03T19:18:36.300 DEBUG:teuthology.orchestra.run.smithi146:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-03T19:18:36.300 DEBUG:teuthology.orchestra.run.smithi146:> contents = proc_f.read() 2023-10-03T19:18:36.300 DEBUG:teuthology.orchestra.run.smithi146:> if mountpoint in contents: 2023-10-03T19:18:36.300 DEBUG:teuthology.orchestra.run.smithi146:> return f 2023-10-03T19:18:36.300 DEBUG:teuthology.orchestra.run.smithi146:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-03T19:18:36.300 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:18:36.300 DEBUG:teuthology.orchestra.run.smithi146:> print(_find_admin_socket("client.0")) 2023-10-03T19:18:36.300 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-03T19:18:36.419 INFO:teuthology.orchestra.run.smithi146.stdout:/var/run/ceph/ceph-client.0.33814.asok 2023-10-03T19:18:36.601 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.33814.asok 2023-10-03T19:18:36.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:18:36.601 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.33814.asok status 2023-10-03T19:18:36.759 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-03T19:18:36.759 INFO:teuthology.orchestra.run.smithi146.stdout: "metadata": { 2023-10-03T19:18:36.759 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_sha1": "05a43c8fb3988914c879a50970f9054a098e0612", 2023-10-03T19:18:36.759 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 18.0.0-3908-g05a43c8f (05a43c8fb3988914c879a50970f9054a098e0612) reef (dev)", 2023-10-03T19:18:36.759 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "0", 2023-10-03T19:18:36.759 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2023-10-03T19:18:36.759 INFO:teuthology.orchestra.run.smithi146.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-03T19:18:36.759 INFO:teuthology.orchestra.run.smithi146.stdout: "pid": "33814", 2023-10-03T19:18:36.759 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2023-10-03T19:18:36.759 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:18:36.760 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_count": 0, 2023-10-03T19:18:36.760 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_pinned_count": 0, 2023-10-03T19:18:36.760 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 5624, 2023-10-03T19:18:36.760 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": { 2023-10-03T19:18:36.760 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2023-10-03T19:18:36.760 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2023-10-03T19:18:36.760 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 5624 2023-10-03T19:18:36.760 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:18:36.760 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-03T19:18:36.760 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T19:18:36.760 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:0", 2023-10-03T19:18:36.761 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 2938203609 2023-10-03T19:18:36.761 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T19:18:36.761 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:18:36.761 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-03T19:18:36.761 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T19:18:36.761 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:0", 2023-10-03T19:18:36.761 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 2938203609 2023-10-03T19:18:36.761 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:18:36.761 INFO:teuthology.orchestra.run.smithi146.stdout: "inst_str": "client.5624 172.21.15.146:0/2938203609", 2023-10-03T19:18:36.761 INFO:teuthology.orchestra.run.smithi146.stdout: "addr_str": "172.21.15.146:0/2938203609", 2023-10-03T19:18:36.761 INFO:teuthology.orchestra.run.smithi146.stdout: "inode_count": 1, 2023-10-03T19:18:36.762 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_epoch": 44, 2023-10-03T19:18:36.762 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch": 85, 2023-10-03T19:18:36.762 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch_barrier": 0, 2023-10-03T19:18:36.762 INFO:teuthology.orchestra.run.smithi146.stdout: "blocklisted": false, 2023-10-03T19:18:36.762 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs" 2023-10-03T19:18:36.762 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-03T19:18:36.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:18:36.772 DEBUG:teuthology.orchestra.run.smithi146:> stat --file-system '--printf=%T 2023-10-03T19:18:36.772 DEBUG:teuthology.orchestra.run.smithi146:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-03T19:18:36.779 INFO:teuthology.orchestra.run.smithi146.stdout:fuseblk 2023-10-03T19:18:36.779 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-03T19:18:36.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:18:36.779 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-03T19:18:36.833 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-03T19:18:36.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.965+0000 7fba5804f640 1 Processor -- start 2023-10-03T19:18:36.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.965+0000 7fba5804f640 1 -- start start 2023-10-03T19:18:36.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.965+0000 7fba5804f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fba50148b90 0x7fba500bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:36.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.965+0000 7fba5804f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fba500bcb60 0x7fba5006c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:36.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.965+0000 7fba5804f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fba500bc4a0 0x7fba5006c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:36.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.965+0000 7fba5804f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba500a3670 con 0x7fba500bcb60 2023-10-03T19:18:36.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.965+0000 7fba5804f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba5014b370 con 0x7fba50148b90 2023-10-03T19:18:36.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.965+0000 7fba5804f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5014b610 con 0x7fba500bc4a0 2023-10-03T19:18:36.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.965+0000 7fba555ea640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fba500bcb60 0x7fba5006c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:36.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.965+0000 7fba555ea640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fba500bcb60 0x7fba5006c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33836/0 (socket says 172.21.15.45:33836) 2023-10-03T19:18:36.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.965+0000 7fba555ea640 1 -- 172.21.15.45:0/3510615108 learned_addr learned my addr 172.21.15.45:0/3510615108 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:36.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.965+0000 7fba565ec640 1 --2- 172.21.15.45:0/3510615108 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fba500bc4a0 0x7fba5006c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:36.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.965+0000 7fba55deb640 1 --2- 172.21.15.45:0/3510615108 >> v2:172.21.15.79:3300/0 conn(0x7fba50148b90 0x7fba500bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:36.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.965+0000 7fba555ea640 1 -- 172.21.15.45:0/3510615108 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fba500bc4a0 msgr2=0x7fba5006c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:36.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.965+0000 7fba555ea640 1 --2- 172.21.15.45:0/3510615108 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fba500bc4a0 0x7fba5006c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:36.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.965+0000 7fba555ea640 1 -- 172.21.15.45:0/3510615108 >> v2:172.21.15.79:3300/0 conn(0x7fba50148b90 msgr2=0x7fba500bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:36.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.965+0000 7fba555ea640 1 --2- 172.21.15.45:0/3510615108 >> v2:172.21.15.79:3300/0 conn(0x7fba50148b90 0x7fba500bbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:36.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.965+0000 7fba555ea640 1 -- 172.21.15.45:0/3510615108 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba500a5580 con 0x7fba500bcb60 2023-10-03T19:18:36.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.965+0000 7fba555ea640 1 --2- 172.21.15.45:0/3510615108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba500bcb60 0x7fba5006c290 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fba5006d660 tx=0x7fba4001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f4338dcefbfd00 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:36.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba54de9640 1 -- 172.21.15.45:0/3510615108 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba400a89b0 con 0x7fba500bcb60 2023-10-03T19:18:36.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba54de9640 1 -- 172.21.15.45:0/3510615108 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba400a8b10 con 0x7fba500bcb60 2023-10-03T19:18:36.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba54de9640 1 -- 172.21.15.45:0/3510615108 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba400a8ea0 con 0x7fba500bcb60 2023-10-03T19:18:36.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba5804f640 1 -- 172.21.15.45:0/3510615108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba500bcb60 msgr2=0x7fba5006c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:36.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba5804f640 1 --2- 172.21.15.45:0/3510615108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba500bcb60 0x7fba5006c290 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fba5006d660 tx=0x7fba4001ecf0 comp rx=0 tx=0).stop 2023-10-03T19:18:36.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba5804f640 1 -- 172.21.15.45:0/3510615108 shutdown_connections 2023-10-03T19:18:36.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba5804f640 1 --2- 172.21.15.45:0/3510615108 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fba500bc4a0 0x7fba5006c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:36.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba5804f640 1 --2- 172.21.15.45:0/3510615108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba500bcb60 0x7fba5006c290 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:36.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba5804f640 1 --2- 172.21.15.45:0/3510615108 >> v2:172.21.15.79:3300/0 conn(0x7fba50148b90 0x7fba500bbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:36.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba5804f640 1 -- 172.21.15.45:0/3510615108 >> 172.21.15.45:0/3510615108 conn(0x7fba500bcf50 msgr2=0x7fba500bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:36.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba5804f640 1 -- 172.21.15.45:0/3510615108 shutdown_connections 2023-10-03T19:18:36.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba5804f640 1 -- 172.21.15.45:0/3510615108 wait complete. 2023-10-03T19:18:36.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba5804f640 1 Processor -- start 2023-10-03T19:18:36.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba5804f640 1 -- start start 2023-10-03T19:18:36.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba5804f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba500bc4a0 0x7fba500b98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:36.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba5804f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba500bcb60 0x7fba5013f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:36.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba5804f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fba50148b90 0x7fba5013f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:36.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba5804f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba501430b0 con 0x7fba500bcb60 2023-10-03T19:18:36.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba5804f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5014c7f0 con 0x7fba500bc4a0 2023-10-03T19:18:36.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba5804f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5014dcc0 con 0x7fba50148b90 2023-10-03T19:18:36.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba555ea640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba500bcb60 0x7fba5013f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:36.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba555ea640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba500bcb60 0x7fba5013f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33852/0 (socket says 172.21.15.45:33852) 2023-10-03T19:18:36.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba555ea640 1 -- 172.21.15.45:0/2380018287 learned_addr learned my addr 172.21.15.45:0/2380018287 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:36.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba565ec640 1 --2- 172.21.15.45:0/2380018287 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fba50148b90 0x7fba5013f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:36.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba55deb640 1 --2- 172.21.15.45:0/2380018287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba500bc4a0 0x7fba500b98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:36.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba555ea640 1 -- 172.21.15.45:0/2380018287 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fba50148b90 msgr2=0x7fba5013f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:36.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba555ea640 1 --2- 172.21.15.45:0/2380018287 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fba50148b90 0x7fba5013f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:36.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba555ea640 1 -- 172.21.15.45:0/2380018287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba500bc4a0 msgr2=0x7fba500b98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:36.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba555ea640 1 --2- 172.21.15.45:0/2380018287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba500bc4a0 0x7fba500b98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:36.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba555ea640 1 -- 172.21.15.45:0/2380018287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba400094d0 con 0x7fba500bcb60 2023-10-03T19:18:36.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba555ea640 1 --2- 172.21.15.45:0/2380018287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba500bcb60 0x7fba5013f220 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fba4001d3a0 tx=0x7fba4001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:36.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba467fc640 1 -- 172.21.15.45:0/2380018287 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba400a89b0 con 0x7fba500bcb60 2023-10-03T19:18:36.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba467fc640 1 -- 172.21.15.45:0/2380018287 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba400b9410 con 0x7fba500bcb60 2023-10-03T19:18:36.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba5804f640 1 -- 172.21.15.45:0/2380018287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba50148f60 con 0x7fba500bcb60 2023-10-03T19:18:36.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba467fc640 1 -- 172.21.15.45:0/2380018287 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba400b97e0 con 0x7fba500bcb60 2023-10-03T19:18:36.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.969+0000 7fba5804f640 1 -- 172.21.15.45:0/2380018287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba500a5820 con 0x7fba500bcb60 2023-10-03T19:18:36.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.973+0000 7fba5804f640 1 -- 172.21.15.45:0/2380018287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba500a3880 con 0x7fba500bcb60 2023-10-03T19:18:36.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.973+0000 7fba467fc640 1 -- 172.21.15.45:0/2380018287 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fba400b7040 con 0x7fba500bcb60 2023-10-03T19:18:36.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.973+0000 7fba467fc640 1 --2- 172.21.15.45:0/2380018287 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fba340662b0 0x7fba34068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:36.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.973+0000 7fba467fc640 1 -- 172.21.15.45:0/2380018287 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fba40121980 con 0x7fba500bcb60 2023-10-03T19:18:36.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.973+0000 7fba55deb640 1 --2- 172.21.15.45:0/2380018287 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fba340662b0 0x7fba34068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:36.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.973+0000 7fba55deb640 1 --2- 172.21.15.45:0/2380018287 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fba340662b0 0x7fba34068760 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fba4c009670 tx=0x7fba4c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:36.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:36.977+0000 7fba467fc640 1 -- 172.21.15.45:0/2380018287 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fba400eee00 con 0x7fba500bcb60 2023-10-03T19:18:37.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:37.169+0000 7fba5804f640 1 -- 172.21.15.45:0/2380018287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fba5014db20 con 0x7fba500bcb60 2023-10-03T19:18:37.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:37.169+0000 7fba467fc640 1 -- 172.21.15.45:0/2380018287 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v44) v1 ==== 53+0+73 (secure 0 0 0) 0x7fba5014db20 con 0x7fba500bcb60 2023-10-03T19:18:37.172 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-03T19:18:37.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:37.173+0000 7fba5804f640 1 -- 172.21.15.45:0/2380018287 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fba340662b0 msgr2=0x7fba34068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:37.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:37.173+0000 7fba5804f640 1 --2- 172.21.15.45:0/2380018287 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fba340662b0 0x7fba34068760 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fba4c009670 tx=0x7fba4c008040 comp rx=0 tx=0).stop 2023-10-03T19:18:37.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:37.173+0000 7fba5804f640 1 -- 172.21.15.45:0/2380018287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba500bcb60 msgr2=0x7fba5013f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:37.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:37.173+0000 7fba5804f640 1 --2- 172.21.15.45:0/2380018287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba500bcb60 0x7fba5013f220 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fba4001d3a0 tx=0x7fba4001ba90 comp rx=0 tx=0).stop 2023-10-03T19:18:37.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:37.173+0000 7fba5804f640 1 -- 172.21.15.45:0/2380018287 shutdown_connections 2023-10-03T19:18:37.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:37.173+0000 7fba5804f640 1 --2- 172.21.15.45:0/2380018287 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fba340662b0 0x7fba34068760 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:37.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:37.173+0000 7fba5804f640 1 --2- 172.21.15.45:0/2380018287 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fba50148b90 0x7fba5013f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:37.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:37.173+0000 7fba5804f640 1 --2- 172.21.15.45:0/2380018287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba500bcb60 0x7fba5013f220 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:37.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:37.173+0000 7fba5804f640 1 --2- 172.21.15.45:0/2380018287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba500bc4a0 0x7fba500b98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:37.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:37.173+0000 7fba5804f640 1 -- 172.21.15.45:0/2380018287 >> 172.21.15.45:0/2380018287 conn(0x7fba500bcf50 msgr2=0x7fba500bbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:37.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:37.173+0000 7fba5804f640 1 -- 172.21.15.45:0/2380018287 shutdown_connections 2023-10-03T19:18:37.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:37.173+0000 7fba5804f640 1 -- 172.21.15.45:0/2380018287 wait complete. 2023-10-03T19:18:37.192 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-03T19:18:37.192 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-03T19:18:37.192 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi172.front.sepia.ceph.com 2023-10-03T19:18:37.192 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-03T19:18:37.192 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-03T19:18:37.192 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-03T19:18:37.192 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-03T19:18:37.192 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-03T19:18:37.192 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-03T19:18:37.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:18:37.193 DEBUG:teuthology.orchestra.run.smithi172:> ip addr 2023-10-03T19:18:37.199 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-03T19:18:37.199 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-03T19:18:37.200 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2023-10-03T19:18:37.200 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:18:37.200 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2023-10-03T19:18:37.200 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:18:37.200 INFO:teuthology.orchestra.run.smithi172.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:18:37.200 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2c brd ff:ff:ff:ff:ff:ff 2023-10-03T19:18:37.200 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f0 2023-10-03T19:18:37.200 INFO:teuthology.orchestra.run.smithi172.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:18:37.200 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2d brd ff:ff:ff:ff:ff:ff 2023-10-03T19:18:37.200 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f1 2023-10-03T19:18:37.201 INFO:teuthology.orchestra.run.smithi172.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:18:37.201 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:90 brd ff:ff:ff:ff:ff:ff 2023-10-03T19:18:37.201 INFO:teuthology.orchestra.run.smithi172.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-03T19:18:37.201 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:91 brd ff:ff:ff:ff:ff:ff 2023-10-03T19:18:37.201 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.21.15.172/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-03T19:18:37.201 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft 42058sec preferred_lft 42058sec 2023-10-03T19:18:37.201 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::ec4:7aff:fe88:7f91/64 scope link 2023-10-03T19:18:37.201 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:18:37.201 INFO:teuthology.orchestra.run.smithi172.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-03T19:18:37.201 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 02:42:f8:ea:71:4e brd ff:ff:ff:ff:ff:ff 2023-10-03T19:18:37.201 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-03T19:18:37.201 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:18:37.202 INFO:teuthology.orchestra.run.smithi172.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-03T19:18:37.202 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-03T19:18:37.202 INFO:teuthology.orchestra.run.smithi172.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-03T19:18:37.202 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:18:37.202 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::7ce5:4fff:fe93:8871/64 scope link 2023-10-03T19:18:37.202 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:18:37.202 INFO:teuthology.orchestra.run.smithi172.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-03T19:18:37.202 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-03T19:18:37.202 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-03T19:18:37.202 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:18:37.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:18:37.203 DEBUG:teuthology.orchestra.run.smithi172:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-03T19:18:37.253 INFO:teuthology.orchestra.run.smithi172.stdout:1 2023-10-03T19:18:37.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:18:37.255 DEBUG:teuthology.orchestra.run.smithi172:> route 2023-10-03T19:18:37.304 INFO:teuthology.orchestra.run.smithi172.stdout:Kernel IP routing table 2023-10-03T19:18:37.304 INFO:teuthology.orchestra.run.smithi172.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-03T19:18:37.304 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-03T19:18:37.305 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-03T19:18:37.305 INFO:teuthology.orchestra.run.smithi172.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-03T19:18:37.305 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-03T19:18:37.305 INFO:teuthology.orchestra.run.smithi172.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:18:37.305 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:18:37.305 INFO:teuthology.orchestra.run.smithi172.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:18:37.305 INFO:teuthology.orchestra.run.smithi172.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-03T19:18:37.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:18:37.305 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-10-03T19:18:37.306 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-10-03T19:18:37.306 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-03T19:18:37.306 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-03T19:18:37.306 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-03T19:18:37.306 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-10-03T19:18:37.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:18:37.385 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2023-10-03T19:18:37.434 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-03T19:18:37.434 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-03T19:18:37.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:18:37.434 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set brx.0 up 2023-10-03T19:18:37.490 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-03T19:18:37.490 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T19:18:37.491 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-03T19:18:37.538 INFO:teuthology.orchestra.run.smithi172.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-03T19:18:37.538 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T19:18:37.538 DEBUG:teuthology.orchestra.run.smithi172:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-03T19:18:37.585 DEBUG:teuthology.orchestra.run.smithi172:> sudo modprobe fuse 2023-10-03T19:18:37.646 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:18:37.646 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:18:37.700 INFO:teuthology.orchestra.run.smithi172.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:18:37.701 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:18:37.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:18:37.702 DEBUG:teuthology.orchestra.run.smithi172:> ls /sys/fs/fuse/connections 2023-10-03T19:18:37.750 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-03T19:18:37.750 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-03T19:18:37.795 DEBUG:teuthology.orchestra.run.smithi172:> sudo modprobe fuse 2023-10-03T19:18:37.810 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:18:37.811 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:18:37.868 INFO:teuthology.orchestra.run.smithi172.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:18:37.869 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:18:37.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:18:37.870 DEBUG:teuthology.orchestra.run.smithi172:> ls /sys/fs/fuse/connections 2023-10-03T19:18:37.875 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi172.stderr:2023-10-03T19:18:37.872+0000 7fc0bfaa3580 -1 init, newargv = 0x563706cd2410 newargc=15 2023-10-03T19:18:37.875 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi172.stderr:ceph-fuse[33307]: starting ceph client 2023-10-03T19:18:37.885 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi172.stderr:ceph-fuse[33307]: starting fuse 2023-10-03T19:18:38.981 DEBUG:teuthology.orchestra.run.smithi172:> sudo modprobe fuse 2023-10-03T19:18:38.996 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:18:38.996 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:18:39.049 INFO:teuthology.orchestra.run.smithi172.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:18:39.050 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:18:39.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:18:39.051 DEBUG:teuthology.orchestra.run.smithi172:> ls /sys/fs/fuse/connections 2023-10-03T19:18:39.099 INFO:teuthology.orchestra.run.smithi172.stdout:45 2023-10-03T19:18:39.099 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-03T19:18:39.099 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-03T19:18:39.099 DEBUG:teuthology.orchestra.run.smithi172:> import glob 2023-10-03T19:18:39.099 DEBUG:teuthology.orchestra.run.smithi172:> import re 2023-10-03T19:18:39.100 DEBUG:teuthology.orchestra.run.smithi172:> import os 2023-10-03T19:18:39.100 DEBUG:teuthology.orchestra.run.smithi172:> import subprocess 2023-10-03T19:18:39.100 DEBUG:teuthology.orchestra.run.smithi172:> 2023-10-03T19:18:39.100 DEBUG:teuthology.orchestra.run.smithi172:> def _find_admin_socket(client_name): 2023-10-03T19:18:39.100 DEBUG:teuthology.orchestra.run.smithi172:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-03T19:18:39.100 DEBUG:teuthology.orchestra.run.smithi172:> files = glob.glob(asok_path) 2023-10-03T19:18:39.100 DEBUG:teuthology.orchestra.run.smithi172:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-03T19:18:39.100 DEBUG:teuthology.orchestra.run.smithi172:> 2023-10-03T19:18:39.100 DEBUG:teuthology.orchestra.run.smithi172:> # Given a non-glob path, it better be there 2023-10-03T19:18:39.100 DEBUG:teuthology.orchestra.run.smithi172:> if "*" not in asok_path: 2023-10-03T19:18:39.100 DEBUG:teuthology.orchestra.run.smithi172:> assert(len(files) == 1) 2023-10-03T19:18:39.100 DEBUG:teuthology.orchestra.run.smithi172:> return files[0] 2023-10-03T19:18:39.100 DEBUG:teuthology.orchestra.run.smithi172:> 2023-10-03T19:18:39.101 DEBUG:teuthology.orchestra.run.smithi172:> for f in files: 2023-10-03T19:18:39.101 DEBUG:teuthology.orchestra.run.smithi172:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-03T19:18:39.101 DEBUG:teuthology.orchestra.run.smithi172:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-03T19:18:39.101 DEBUG:teuthology.orchestra.run.smithi172:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-03T19:18:39.101 DEBUG:teuthology.orchestra.run.smithi172:> contents = proc_f.read() 2023-10-03T19:18:39.101 DEBUG:teuthology.orchestra.run.smithi172:> if mountpoint in contents: 2023-10-03T19:18:39.101 DEBUG:teuthology.orchestra.run.smithi172:> return f 2023-10-03T19:18:39.101 DEBUG:teuthology.orchestra.run.smithi172:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-03T19:18:39.101 DEBUG:teuthology.orchestra.run.smithi172:> 2023-10-03T19:18:39.101 DEBUG:teuthology.orchestra.run.smithi172:> print(_find_admin_socket("client.1")) 2023-10-03T19:18:39.101 DEBUG:teuthology.orchestra.run.smithi172:> ' 2023-10-03T19:18:39.218 INFO:teuthology.orchestra.run.smithi172.stdout:/var/run/ceph/ceph-client.1.33307.asok 2023-10-03T19:18:39.401 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.33307.asok 2023-10-03T19:18:39.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:18:39.401 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.33307.asok status 2023-10-03T19:18:39.551 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2023-10-03T19:18:39.551 INFO:teuthology.orchestra.run.smithi172.stdout: "metadata": { 2023-10-03T19:18:39.551 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_sha1": "05a43c8fb3988914c879a50970f9054a098e0612", 2023-10-03T19:18:39.551 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_version": "ceph version 18.0.0-3908-g05a43c8f (05a43c8fb3988914c879a50970f9054a098e0612) reef (dev)", 2023-10-03T19:18:39.551 INFO:teuthology.orchestra.run.smithi172.stdout: "entity_id": "1", 2023-10-03T19:18:39.551 INFO:teuthology.orchestra.run.smithi172.stdout: "hostname": "smithi172", 2023-10-03T19:18:39.551 INFO:teuthology.orchestra.run.smithi172.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-03T19:18:39.552 INFO:teuthology.orchestra.run.smithi172.stdout: "pid": "33307", 2023-10-03T19:18:39.552 INFO:teuthology.orchestra.run.smithi172.stdout: "root": "/" 2023-10-03T19:18:39.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-03T19:18:39.552 INFO:teuthology.orchestra.run.smithi172.stdout: "dentry_count": 0, 2023-10-03T19:18:39.552 INFO:teuthology.orchestra.run.smithi172.stdout: "dentry_pinned_count": 0, 2023-10-03T19:18:39.552 INFO:teuthology.orchestra.run.smithi172.stdout: "id": 6906, 2023-10-03T19:18:39.552 INFO:teuthology.orchestra.run.smithi172.stdout: "inst": { 2023-10-03T19:18:39.552 INFO:teuthology.orchestra.run.smithi172.stdout: "name": { 2023-10-03T19:18:39.552 INFO:teuthology.orchestra.run.smithi172.stdout: "type": "client", 2023-10-03T19:18:39.552 INFO:teuthology.orchestra.run.smithi172.stdout: "num": 6906 2023-10-03T19:18:39.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-03T19:18:39.552 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": { 2023-10-03T19:18:39.552 INFO:teuthology.orchestra.run.smithi172.stdout: "type": "v1", 2023-10-03T19:18:39.553 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": "172.21.15.172:0", 2023-10-03T19:18:39.553 INFO:teuthology.orchestra.run.smithi172.stdout: "nonce": 1691609954 2023-10-03T19:18:39.553 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-03T19:18:39.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-03T19:18:39.553 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": { 2023-10-03T19:18:39.553 INFO:teuthology.orchestra.run.smithi172.stdout: "type": "v1", 2023-10-03T19:18:39.553 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": "172.21.15.172:0", 2023-10-03T19:18:39.553 INFO:teuthology.orchestra.run.smithi172.stdout: "nonce": 1691609954 2023-10-03T19:18:39.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-03T19:18:39.553 INFO:teuthology.orchestra.run.smithi172.stdout: "inst_str": "client.6906 172.21.15.172:0/1691609954", 2023-10-03T19:18:39.553 INFO:teuthology.orchestra.run.smithi172.stdout: "addr_str": "172.21.15.172:0/1691609954", 2023-10-03T19:18:39.553 INFO:teuthology.orchestra.run.smithi172.stdout: "inode_count": 1, 2023-10-03T19:18:39.554 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_epoch": 44, 2023-10-03T19:18:39.554 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_epoch": 85, 2023-10-03T19:18:39.554 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_epoch_barrier": 0, 2023-10-03T19:18:39.554 INFO:teuthology.orchestra.run.smithi172.stdout: "blocklisted": false, 2023-10-03T19:18:39.554 INFO:teuthology.orchestra.run.smithi172.stdout: "fs_name": "cephfs" 2023-10-03T19:18:39.554 INFO:teuthology.orchestra.run.smithi172.stdout:} 2023-10-03T19:18:39.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:18:39.565 DEBUG:teuthology.orchestra.run.smithi172:> stat --file-system '--printf=%T 2023-10-03T19:18:39.565 DEBUG:teuthology.orchestra.run.smithi172:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-03T19:18:39.571 INFO:teuthology.orchestra.run.smithi172.stdout:fuseblk 2023-10-03T19:18:39.571 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-03T19:18:39.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:18:39.571 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-03T19:18:39.625 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:18:39.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0da17ed640 1 Processor -- start 2023-10-03T19:18:39.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0da17ed640 1 -- start start 2023-10-03T19:18:39.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0da17ed640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0d9c0bc8b0 0x7f0d9c14ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:39.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0da17ed640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d9c06cac0 con 0x7f0d9c06f170 2023-10-03T19:18:39.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0da17ed640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d9c0720d0 con 0x7f0d9c06d170 2023-10-03T19:18:39.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0da17ed640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d9c0a5ab0 con 0x7f0d9c0bc8b0 2023-10-03T19:18:39.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0d9affd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0d9c06f170 0x7f0d9c150190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60266/0 (socket says 172.21.15.45:60266) 2023-10-03T19:18:39.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0d9affd640 1 -- 172.21.15.45:0/742662782 learned_addr learned my addr 172.21.15.45:0/742662782 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:18:39.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0d9a7fc640 1 --2- 172.21.15.45:0/742662782 >> v2:172.21.15.79:3300/0 conn(0x7f0d9c0bc8b0 0x7f0d9c14ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:39.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0d99ffb640 1 -- 172.21.15.45:0/742662782 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 284126470 0 0) 0x7f0d8c001120 con 0x7f0d9c06f170 2023-10-03T19:18:39.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0d99ffb640 1 -- 172.21.15.45:0/742662782 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d84003530 con 0x7f0d9c06f170 2023-10-03T19:18:39.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0d99ffb640 1 -- 172.21.15.45:0/742662782 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4040861310 0 0) 0x7f0d84003530 con 0x7f0d9c06f170 2023-10-03T19:18:39.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0d99ffb640 1 -- 172.21.15.45:0/742662782 >> v2:172.21.15.79:3300/0 conn(0x7f0d9c0bc8b0 msgr2=0x7f0d9c14ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:39.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0d99ffb640 1 --2- 172.21.15.45:0/742662782 >> v2:172.21.15.79:3300/0 conn(0x7f0d9c0bc8b0 0x7f0d9c14ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:39.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0d99ffb640 1 -- 172.21.15.45:0/742662782 >> v1:172.21.15.79:6789/0 conn(0x7f0d9c06d170 legacy=0x7f0d9c14cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:39.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0d99ffb640 1 -- 172.21.15.45:0/742662782 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9c06cd00 con 0x7f0d9c06f170 2023-10-03T19:18:39.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0d99ffb640 1 -- 172.21.15.45:0/742662782 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f0d8c001810 con 0x7f0d9c06f170 2023-10-03T19:18:39.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0d9a7fc640 1 --2- 172.21.15.45:0/742662782 >> v2:172.21.15.79:3300/0 conn(0x7f0d9c0bc8b0 0x7f0d9c14ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:18:39.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0d99ffb640 1 -- 172.21.15.45:0/742662782 >> v1:172.21.15.45:6789/0 conn(0x7f0d9c06f170 legacy=0x7f0d9c150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:39.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0d99ffb640 1 --2- 172.21.15.45:0/742662782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d84003980 0x7f0d84003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:39.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0d99ffb640 1 --2- 172.21.15.45:0/742662782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d840047d0 0x7f0d84004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:39.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0d99ffb640 1 --2- 172.21.15.45:0/742662782 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d84005180 0x7f0d8400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:39.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0d99ffb640 1 -- 172.21.15.45:0/742662782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9c0a5ab0 con 0x7f0d840047d0 2023-10-03T19:18:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0d99ffb640 1 -- 172.21.15.45:0/742662782 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8400bfe0 con 0x7f0d84003980 2023-10-03T19:18:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0d99ffb640 1 -- 172.21.15.45:0/742662782 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8400c1a0 con 0x7f0d84005180 2023-10-03T19:18:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0d9a7fc640 1 --2- 172.21.15.45:0/742662782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d840047d0 0x7f0d84004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0d9affd640 1 --2- 172.21.15.45:0/742662782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d84003980 0x7f0d84003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0d9b7fe640 1 --2- 172.21.15.45:0/742662782 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d84005180 0x7f0d8400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0d9a7fc640 1 -- 172.21.15.45:0/742662782 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d84005180 msgr2=0x7f0d8400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0d9a7fc640 1 --2- 172.21.15.45:0/742662782 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d84005180 0x7f0d8400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0d9a7fc640 1 -- 172.21.15.45:0/742662782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d84003980 msgr2=0x7f0d84003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:18:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0d9a7fc640 1 --2- 172.21.15.45:0/742662782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d84003980 0x7f0d84003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0d9a7fc640 1 -- 172.21.15.45:0/742662782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d84003530 con 0x7f0d840047d0 2023-10-03T19:18:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.757+0000 7f0d9b7fe640 1 -- 172.21.15.45:0/742662782 reap_dead start 2023-10-03T19:18:39.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.761+0000 7f0d9a7fc640 1 --2- 172.21.15.45:0/742662782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d840047d0 0x7f0d84004c40 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f0d90009cb0 tx=0x7f0d9001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66884898e08cb6ff server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:39.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.761+0000 7f0d99ffb640 1 -- 172.21.15.45:0/742662782 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d900a58d0 con 0x7f0d840047d0 2023-10-03T19:18:39.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.761+0000 7f0d99ffb640 1 -- 172.21.15.45:0/742662782 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d900a5a30 con 0x7f0d840047d0 2023-10-03T19:18:39.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.761+0000 7f0d99ffb640 1 -- 172.21.15.45:0/742662782 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d900a5e20 con 0x7f0d840047d0 2023-10-03T19:18:39.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.761+0000 7f0da17ed640 1 -- 172.21.15.45:0/742662782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d840047d0 msgr2=0x7f0d84004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:39.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.761+0000 7f0da17ed640 1 --2- 172.21.15.45:0/742662782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d840047d0 0x7f0d84004c40 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f0d90009cb0 tx=0x7f0d9001cc10 comp rx=0 tx=0).stop 2023-10-03T19:18:39.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.761+0000 7f0da17ed640 1 -- 172.21.15.45:0/742662782 shutdown_connections 2023-10-03T19:18:39.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.761+0000 7f0da17ed640 1 --2- 172.21.15.45:0/742662782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d840047d0 0x7f0d84004c40 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:39.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.761+0000 7f0da17ed640 1 -- 172.21.15.45:0/742662782 >> 172.21.15.45:0/742662782 conn(0x7f0d9c0bcf50 msgr2=0x7f0d9c0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:39.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.761+0000 7f0da17ed640 1 -- 172.21.15.45:0/742662782 shutdown_connections 2023-10-03T19:18:39.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.761+0000 7f0da17ed640 1 -- 172.21.15.45:0/742662782 wait complete. 2023-10-03T19:18:39.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.761+0000 7f0da17ed640 1 Processor -- start 2023-10-03T19:18:39.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.761+0000 7f0da17ed640 1 -- start start 2023-10-03T19:18:39.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.765+0000 7f0da17ed640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d840047d0 0x7f0d9c14a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:39.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.765+0000 7f0da17ed640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d9c14e0d0 0x7f0d9c147020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:39.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.765+0000 7f0da17ed640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d9c1455a0 0x7f0d9c1e1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:39.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.765+0000 7f0da17ed640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9c0a2fc0 con 0x7f0d840047d0 2023-10-03T19:18:39.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.765+0000 7f0da17ed640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9c144400 con 0x7f0d9c14e0d0 2023-10-03T19:18:39.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.765+0000 7f0da17ed640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9c144e60 con 0x7f0d9c1455a0 2023-10-03T19:18:39.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.765+0000 7f0d9affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d840047d0 0x7f0d9c14a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:39.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.765+0000 7f0d9affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d840047d0 0x7f0d9c14a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33870/0 (socket says 172.21.15.45:33870) 2023-10-03T19:18:39.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.765+0000 7f0d9affd640 1 -- 172.21.15.45:0/4074513321 learned_addr learned my addr 172.21.15.45:0/4074513321 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:39.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.765+0000 7f0d9a7fc640 1 --2- 172.21.15.45:0/4074513321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d9c14e0d0 0x7f0d9c147020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:39.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.765+0000 7f0d9b7fe640 1 --2- 172.21.15.45:0/4074513321 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d9c1455a0 0x7f0d9c1e1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:39.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.765+0000 7f0d9affd640 1 -- 172.21.15.45:0/4074513321 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d9c1455a0 msgr2=0x7f0d9c1e1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:39.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.765+0000 7f0d9affd640 1 --2- 172.21.15.45:0/4074513321 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d9c1455a0 0x7f0d9c1e1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:39.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.765+0000 7f0d9affd640 1 -- 172.21.15.45:0/4074513321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d9c14e0d0 msgr2=0x7f0d9c147020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:39.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.765+0000 7f0d9affd640 1 --2- 172.21.15.45:0/4074513321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d9c14e0d0 0x7f0d9c147020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:39.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.765+0000 7f0d9affd640 1 -- 172.21.15.45:0/4074513321 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9c14c4a0 con 0x7f0d840047d0 2023-10-03T19:18:39.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.765+0000 7f0d9affd640 1 --2- 172.21.15.45:0/4074513321 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d840047d0 0x7f0d9c14a990 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c0072c0 tx=0x7f0d8c007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:39.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.765+0000 7f0d837fe640 1 -- 172.21.15.45:0/4074513321 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c00f960 con 0x7f0d840047d0 2023-10-03T19:18:39.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.765+0000 7f0d837fe640 1 -- 172.21.15.45:0/4074513321 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8c00fac0 con 0x7f0d840047d0 2023-10-03T19:18:39.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.765+0000 7f0da17ed640 1 -- 172.21.15.45:0/4074513321 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d9c14fae0 con 0x7f0d840047d0 2023-10-03T19:18:39.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.765+0000 7f0d837fe640 1 -- 172.21.15.45:0/4074513321 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c00fe70 con 0x7f0d840047d0 2023-10-03T19:18:39.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.765+0000 7f0da17ed640 1 -- 172.21.15.45:0/4074513321 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d9c06f540 con 0x7f0d840047d0 2023-10-03T19:18:39.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.765+0000 7f0da17ed640 1 -- 172.21.15.45:0/4074513321 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d9c06d660 con 0x7f0d840047d0 2023-10-03T19:18:39.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.765+0000 7f0d837fe640 1 -- 172.21.15.45:0/4074513321 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0d8c01d460 con 0x7f0d840047d0 2023-10-03T19:18:39.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.765+0000 7f0d837fe640 1 --2- 172.21.15.45:0/4074513321 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0d88066280 0x7f0d88068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:39.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.765+0000 7f0d837fe640 1 -- 172.21.15.45:0/4074513321 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0d8c083dd0 con 0x7f0d840047d0 2023-10-03T19:18:39.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.765+0000 7f0d9a7fc640 1 --2- 172.21.15.45:0/4074513321 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0d88066280 0x7f0d88068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:39.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.769+0000 7f0d9a7fc640 1 --2- 172.21.15.45:0/4074513321 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0d88066280 0x7f0d88068730 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0d900af000 tx=0x7f0d90008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:39.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.769+0000 7f0d837fe640 1 -- 172.21.15.45:0/4074513321 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0d8c051250 con 0x7f0d840047d0 2023-10-03T19:18:39.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.957+0000 7f0da17ed640 1 -- 172.21.15.45:0/4074513321 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d9c06cac0 con 0x7f0d840047d0 2023-10-03T19:18:39.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.957+0000 7f0d837fe640 1 -- 172.21.15.45:0/4074513321 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+3910 (secure 0 0 0) 0x7f0d9c06cac0 con 0x7f0d840047d0 2023-10-03T19:18:39.960 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:18:39.960 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":44,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6094,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3237510777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3237510777},{"type":"v1","addr":"172.21.15.79:6835","nonce":3237510777}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6717,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/697890515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":697890515},{"type":"v1","addr":"172.21.15.45:6833","nonce":697890515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:18:28.260345+0000","modified":"2023-10-03T19:18:31.278054+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6720},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6720":{"gid":6720,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/125100321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":125100321},{"type":"v1","addr":"172.21.15.45:6835","nonce":125100321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-10-03T19:18:39.961 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 44 2023-10-03T19:18:39.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.961+0000 7f0da17ed640 1 -- 172.21.15.45:0/4074513321 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0d88066280 msgr2=0x7f0d88068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:39.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.961+0000 7f0da17ed640 1 --2- 172.21.15.45:0/4074513321 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0d88066280 0x7f0d88068730 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0d900af000 tx=0x7f0d90008040 comp rx=0 tx=0).stop 2023-10-03T19:18:39.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.961+0000 7f0da17ed640 1 -- 172.21.15.45:0/4074513321 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d840047d0 msgr2=0x7f0d9c14a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:39.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.961+0000 7f0da17ed640 1 --2- 172.21.15.45:0/4074513321 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d840047d0 0x7f0d9c14a990 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c0072c0 tx=0x7f0d8c007780 comp rx=0 tx=0).stop 2023-10-03T19:18:39.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.961+0000 7f0da17ed640 1 -- 172.21.15.45:0/4074513321 shutdown_connections 2023-10-03T19:18:39.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.961+0000 7f0da17ed640 1 --2- 172.21.15.45:0/4074513321 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0d88066280 0x7f0d88068730 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:39.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.961+0000 7f0da17ed640 1 --2- 172.21.15.45:0/4074513321 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d9c1455a0 0x7f0d9c1e1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:39.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.961+0000 7f0da17ed640 1 --2- 172.21.15.45:0/4074513321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d9c14e0d0 0x7f0d9c147020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:39.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.961+0000 7f0da17ed640 1 --2- 172.21.15.45:0/4074513321 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d840047d0 0x7f0d9c14a990 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:39.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.961+0000 7f0da17ed640 1 -- 172.21.15.45:0/4074513321 >> 172.21.15.45:0/4074513321 conn(0x7f0d9c0bcf50 msgr2=0x7f0d9c070b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:39.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.961+0000 7f0da17ed640 1 -- 172.21.15.45:0/4074513321 shutdown_connections 2023-10-03T19:18:39.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:39.961+0000 7f0da17ed640 1 -- 172.21.15.45:0/4074513321 wait complete. 2023-10-03T19:18:39.979 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:18:40.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.093+0000 7f2fb7d5e640 1 Processor -- start 2023-10-03T19:18:40.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.093+0000 7f2fb7d5e640 1 -- start start 2023-10-03T19:18:40.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.097+0000 7f2fb7d5e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2fb006cd40 0x7f2fb014aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:40.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.097+0000 7f2fb7d5e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb00bc430 con 0x7f2fb0147ab0 2023-10-03T19:18:40.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.097+0000 7f2fb7d5e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb00baf60 con 0x7f2fb00a3670 2023-10-03T19:18:40.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.097+0000 7f2fb7d5e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb00a5db0 con 0x7f2fb006cd40 2023-10-03T19:18:40.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.097+0000 7f2fb5afa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2fb006cd40 0x7f2fb014aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:40.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.097+0000 7f2fb5afa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2fb006cd40 0x7f2fb014aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33878/0 (socket says 172.21.15.45:33878) 2023-10-03T19:18:40.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.097+0000 7f2fb62fb640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2fb0147ab0 0x7f2fb01553d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60274/0 (socket says 172.21.15.45:60274) 2023-10-03T19:18:40.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.097+0000 7f2fb5afa640 1 -- 172.21.15.45:0/1101513615 learned_addr learned my addr 172.21.15.45:0/1101513615 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:40.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.097+0000 7f2fb5afa640 1 -- 172.21.15.45:0/1101513615 >> v1:172.21.15.79:6789/0 conn(0x7f2fb00a3670 legacy=0x7f2fb00bbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:40.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.097+0000 7f2fb5afa640 1 -- 172.21.15.45:0/1101513615 >> v1:172.21.15.45:6789/0 conn(0x7f2fb0147ab0 legacy=0x7f2fb01553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:40.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.097+0000 7f2fb5afa640 1 -- 172.21.15.45:0/1101513615 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb00bb240 con 0x7f2fb006cd40 2023-10-03T19:18:40.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.097+0000 7f2fb5afa640 1 --2- 172.21.15.45:0/1101513615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fb006cd40 0x7f2fb014aa50 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009870 tx=0x7f2fac01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e1625c007b8cba9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:40.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.097+0000 7f2fb4af8640 1 -- 172.21.15.45:0/1101513615 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac0a8a30 con 0x7f2fb006cd40 2023-10-03T19:18:40.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.097+0000 7f2fb4af8640 1 -- 172.21.15.45:0/1101513615 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fac0a8b90 con 0x7f2fb006cd40 2023-10-03T19:18:40.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.097+0000 7f2fb4af8640 1 -- 172.21.15.45:0/1101513615 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac0b0440 con 0x7f2fb006cd40 2023-10-03T19:18:40.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fb7d5e640 1 -- 172.21.15.45:0/1101513615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fb006cd40 msgr2=0x7f2fb014aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:40.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fb7d5e640 1 --2- 172.21.15.45:0/1101513615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fb006cd40 0x7f2fb014aa50 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009870 tx=0x7f2fac01ed30 comp rx=0 tx=0).stop 2023-10-03T19:18:40.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fb7d5e640 1 -- 172.21.15.45:0/1101513615 shutdown_connections 2023-10-03T19:18:40.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fb7d5e640 1 --2- 172.21.15.45:0/1101513615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fb006cd40 0x7f2fb014aa50 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:40.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fb7d5e640 1 -- 172.21.15.45:0/1101513615 >> 172.21.15.45:0/1101513615 conn(0x7f2fb00bcf50 msgr2=0x7f2fb00bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:40.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fb7d5e640 1 -- 172.21.15.45:0/1101513615 shutdown_connections 2023-10-03T19:18:40.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fb7d5e640 1 -- 172.21.15.45:0/1101513615 wait complete. 2023-10-03T19:18:40.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fb7d5e640 1 Processor -- start 2023-10-03T19:18:40.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fb7d5e640 1 -- start start 2023-10-03T19:18:40.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fb7d5e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fb006cd40 0x7f2fb0143f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:40.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fb7d5e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fb00a3670 0x7f2fb0140560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:40.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fb7d5e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb0147ab0 0x7f2fb0140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:40.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fb7d5e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb0144e20 con 0x7f2fb00a3670 2023-10-03T19:18:40.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fb7d5e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb0144810 con 0x7f2fb0147ab0 2023-10-03T19:18:40.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fb7d5e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb0142750 con 0x7f2fb006cd40 2023-10-03T19:18:40.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fb52f9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fb00a3670 0x7f2fb0140560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:40.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fb52f9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fb00a3670 0x7f2fb0140560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33888/0 (socket says 172.21.15.45:33888) 2023-10-03T19:18:40.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fb52f9640 1 -- 172.21.15.45:0/828534146 learned_addr learned my addr 172.21.15.45:0/828534146 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:18:40.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fb62fb640 1 --2- 172.21.15.45:0/828534146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb0147ab0 0x7f2fb0140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:40.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fb5afa640 1 --2- 172.21.15.45:0/828534146 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fb006cd40 0x7f2fb0143f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:40.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fb52f9640 1 -- 172.21.15.45:0/828534146 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fb006cd40 msgr2=0x7f2fb0143f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:40.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fb52f9640 1 --2- 172.21.15.45:0/828534146 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fb006cd40 0x7f2fb0143f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:40.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fb52f9640 1 -- 172.21.15.45:0/828534146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb0147ab0 msgr2=0x7f2fb0140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:40.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fb52f9640 1 --2- 172.21.15.45:0/828534146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb0147ab0 0x7f2fb0140aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:40.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fb52f9640 1 -- 172.21.15.45:0/828534146 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fac0094d0 con 0x7f2fb00a3670 2023-10-03T19:18:40.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fb5afa640 1 --2- 172.21.15.45:0/828534146 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fb006cd40 0x7f2fb0143f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:18:40.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fb52f9640 1 --2- 172.21.15.45:0/828534146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fb00a3670 0x7f2fb0140560 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000c500 tx=0x7f2fa000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:40.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fa67fc640 1 -- 172.21.15.45:0/828534146 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0005220 con 0x7f2fb00a3670 2023-10-03T19:18:40.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fa67fc640 1 -- 172.21.15.45:0/828534146 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa0005380 con 0x7f2fb00a3670 2023-10-03T19:18:40.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fa67fc640 1 -- 172.21.15.45:0/828534146 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0007270 con 0x7f2fb00a3670 2023-10-03T19:18:40.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fb7d5e640 1 -- 172.21.15.45:0/828534146 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb00bb800 con 0x7f2fb00a3670 2023-10-03T19:18:40.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.101+0000 7f2fb7d5e640 1 -- 172.21.15.45:0/828534146 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb00bb520 con 0x7f2fb00a3670 2023-10-03T19:18:40.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.105+0000 7f2fb7d5e640 1 -- 172.21.15.45:0/828534146 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb00bcc90 con 0x7f2fb00a3670 2023-10-03T19:18:40.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.105+0000 7f2fa67fc640 1 -- 172.21.15.45:0/828534146 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2fa00073d0 con 0x7f2fb00a3670 2023-10-03T19:18:40.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.105+0000 7f2fa67fc640 1 --2- 172.21.15.45:0/828534146 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2f94066280 0x7f2f94068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:18:40.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.105+0000 7f2fa67fc640 1 -- 172.21.15.45:0/828534146 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2fa0083620 con 0x7f2fb00a3670 2023-10-03T19:18:40.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.105+0000 7f2fb5afa640 1 --2- 172.21.15.45:0/828534146 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2f94066280 0x7f2f94068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:18:40.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.105+0000 7f2fb5afa640 1 --2- 172.21.15.45:0/828534146 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2f94066280 0x7f2f94068730 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2fac0b2000 tx=0x7f2fac0aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:18:40.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.109+0000 7f2fa67fc640 1 -- 172.21.15.45:0/828534146 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2fa0050ab0 con 0x7f2fb00a3670 2023-10-03T19:18:40.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.289+0000 7f2fb7d5e640 1 -- 172.21.15.45:0/828534146 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2fb004de80 con 0x7f2fb00a3670 2023-10-03T19:18:40.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.289+0000 7f2fa67fc640 1 -- 172.21.15.45:0/828534146 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+3910 (secure 0 0 0) 0x7f2fa00540d0 con 0x7f2fb00a3670 2023-10-03T19:18:40.292 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:18:40.292 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":44,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6094,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3237510777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3237510777},{"type":"v1","addr":"172.21.15.79:6835","nonce":3237510777}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6717,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/697890515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":697890515},{"type":"v1","addr":"172.21.15.45:6833","nonce":697890515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:18:28.260345+0000","modified":"2023-10-03T19:18:31.278054+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6720},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6720":{"gid":6720,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/125100321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":125100321},{"type":"v1","addr":"172.21.15.45:6835","nonce":125100321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-10-03T19:18:40.293 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 44 2023-10-03T19:18:40.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.293+0000 7f2fb7d5e640 1 -- 172.21.15.45:0/828534146 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2f94066280 msgr2=0x7f2f94068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:40.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.293+0000 7f2fb7d5e640 1 --2- 172.21.15.45:0/828534146 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2f94066280 0x7f2f94068730 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2fac0b2000 tx=0x7f2fac0aa070 comp rx=0 tx=0).stop 2023-10-03T19:18:40.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.293+0000 7f2fb7d5e640 1 -- 172.21.15.45:0/828534146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fb00a3670 msgr2=0x7f2fb0140560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:18:40.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.293+0000 7f2fb7d5e640 1 --2- 172.21.15.45:0/828534146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fb00a3670 0x7f2fb0140560 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000c500 tx=0x7f2fa000c9c0 comp rx=0 tx=0).stop 2023-10-03T19:18:40.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.293+0000 7f2fb7d5e640 1 -- 172.21.15.45:0/828534146 shutdown_connections 2023-10-03T19:18:40.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.293+0000 7f2fb7d5e640 1 --2- 172.21.15.45:0/828534146 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2f94066280 0x7f2f94068730 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:40.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.293+0000 7f2fb7d5e640 1 --2- 172.21.15.45:0/828534146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb0147ab0 0x7f2fb0140aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:40.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.293+0000 7f2fb7d5e640 1 --2- 172.21.15.45:0/828534146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fb00a3670 0x7f2fb0140560 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:40.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.293+0000 7f2fb7d5e640 1 --2- 172.21.15.45:0/828534146 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fb006cd40 0x7f2fb0143f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:18:40.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.293+0000 7f2fb7d5e640 1 -- 172.21.15.45:0/828534146 >> 172.21.15.45:0/828534146 conn(0x7f2fb00bcf50 msgr2=0x7f2fb0067830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:18:40.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.293+0000 7f2fb7d5e640 1 -- 172.21.15.45:0/828534146 shutdown_connections 2023-10-03T19:18:40.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:18:40.293+0000 7f2fb7d5e640 1 -- 172.21.15.45:0/828534146 wait complete. 2023-10-03T19:18:40.310 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_cap_revoke_eviction_timeout 30.0 2023-10-03T19:18:40.445 INFO:teuthology.orchestra.run.smithi045.stdout:{"success":"mds_cap_revoke_eviction_timeout = '30.000000' "} 2023-10-03T19:18:40.445 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_cap_revoke_eviction_timeout = '30.000000' " } 2023-10-03T19:18:40.445 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:18:40.445 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:18:40.452 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-03T19:18:40.452 DEBUG:teuthology.orchestra.run.smithi146:> import time 2023-10-03T19:18:40.452 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:18:40.452 DEBUG:teuthology.orchestra.run.smithi146:> with open("/home/ubuntu/cephtest/mnt.0/background_file", '"'"'w'"'"') as f: 2023-10-03T19:18:40.452 DEBUG:teuthology.orchestra.run.smithi146:> f.write('"'"'content'"'"') 2023-10-03T19:18:40.452 DEBUG:teuthology.orchestra.run.smithi146:> f.flush() 2023-10-03T19:18:40.452 DEBUG:teuthology.orchestra.run.smithi146:> f.write('"'"'content2'"'"') 2023-10-03T19:18:40.452 DEBUG:teuthology.orchestra.run.smithi146:> while True: 2023-10-03T19:18:40.452 DEBUG:teuthology.orchestra.run.smithi146:> time.sleep(1) 2023-10-03T19:18:40.453 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-03T19:18:40.495 DEBUG:teuthology.orchestra.run.smithi146:> stat /home/ubuntu/cephtest/mnt.0/background_file 2023-10-03T19:18:40.502 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T19:18:40.502 INFO:teuthology.orchestra.run.smithi146.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/background_file': No such file or directory 2023-10-03T19:18:41.503 DEBUG:teuthology.orchestra.run.smithi146:> stat /home/ubuntu/cephtest/mnt.0/background_file 2023-10-03T19:18:41.511 INFO:teuthology.orchestra.run.smithi146.stdout: File: /home/ubuntu/cephtest/mnt.0/background_file 2023-10-03T19:18:41.511 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 1 IO Block: 4194304 regular file 2023-10-03T19:18:41.511 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 2dh/45d Inode: 1099511627776 Links: 1 2023-10-03T19:18:41.511 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0664/-rw-rw-r--) Uid: ( 1000/ ubuntu) Gid: ( 1271/ ubuntu) 2023-10-03T19:18:41.511 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2023-10-03 19:18:40.556613537 +0000 2023-10-03T19:18:41.511 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2023-10-03 19:18:40.569622357 +0000 2023-10-03T19:18:41.511 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2023-10-03 19:18:40.569622357 +0000 2023-10-03T19:18:41.511 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2023-10-03T19:18:41.511 DEBUG:tasks.cephfs.mount:File background_file became visible from 0 after 1s 2023-10-03T19:18:41.512 DEBUG:teuthology.orchestra.run.smithi172:> stat /home/ubuntu/cephtest/mnt.1/background_file 2023-10-03T19:18:41.533 INFO:teuthology.orchestra.run.smithi172.stdout: File: /home/ubuntu/cephtest/mnt.1/background_file 2023-10-03T19:18:41.533 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 1 IO Block: 4194304 regular file 2023-10-03T19:18:41.533 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 2dh/45d Inode: 1099511627776 Links: 1 2023-10-03T19:18:41.533 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0664/-rw-rw-r--) Uid: ( 1000/ ubuntu) Gid: ( 1271/ ubuntu) 2023-10-03T19:18:41.533 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2023-10-03 19:18:40.556613537 +0000 2023-10-03T19:18:41.533 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2023-10-03 19:18:40.569622357 +0000 2023-10-03T19:18:41.534 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2023-10-03 19:18:40.569622357 +0000 2023-10-03T19:18:41.534 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2023-10-03T19:18:41.534 DEBUG:tasks.cephfs.mount:File background_file became visible from 1 after 0s 2023-10-03T19:18:41.534 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-03T19:18:41.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:18:41.534 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 down 2023-10-03T19:18:41.567 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-03T19:18:41.567 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:18:41.586 DEBUG:teuthology.orchestra.run.smithi172:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-03T19:18:41.586 DEBUG:teuthology.orchestra.run.smithi172:> import os 2023-10-03T19:18:41.586 DEBUG:teuthology.orchestra.run.smithi172:> import time 2023-10-03T19:18:41.586 DEBUG:teuthology.orchestra.run.smithi172:> 2023-10-03T19:18:41.586 DEBUG:teuthology.orchestra.run.smithi172:> fd = os.open("/home/ubuntu/cephtest/mnt.1/background_file", os.O_RDWR | os.O_CREAT, 0o644) 2023-10-03T19:18:41.587 DEBUG:teuthology.orchestra.run.smithi172:> try: 2023-10-03T19:18:41.587 DEBUG:teuthology.orchestra.run.smithi172:> while True: 2023-10-03T19:18:41.587 DEBUG:teuthology.orchestra.run.smithi172:> os.write(fd, b'"'"'content'"'"') 2023-10-03T19:18:41.587 DEBUG:teuthology.orchestra.run.smithi172:> time.sleep(1) 2023-10-03T19:18:41.587 DEBUG:teuthology.orchestra.run.smithi172:> if not False: 2023-10-03T19:18:41.587 DEBUG:teuthology.orchestra.run.smithi172:> break 2023-10-03T19:18:41.587 DEBUG:teuthology.orchestra.run.smithi172:> except IOError as e: 2023-10-03T19:18:41.587 DEBUG:teuthology.orchestra.run.smithi172:> pass 2023-10-03T19:18:41.587 DEBUG:teuthology.orchestra.run.smithi172:> os.close(fd) 2023-10-03T19:18:41.587 DEBUG:teuthology.orchestra.run.smithi172:> ' 2023-10-03T19:19:03.412 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:19:03.414 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:19:03.417 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:19:03.420 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:19:18.941 INFO:tasks.cephfs.test_misc:cap_waiter waited 37.31064963340759s 2023-10-03T19:19:18.942 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:19:19.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.072+0000 7f9e9f8ad640 1 Processor -- start 2023-10-03T19:19:19.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.072+0000 7f9e9f8ad640 1 -- start start 2023-10-03T19:19:19.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.072+0000 7f9e9f8ad640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9e98148b90 0x7f9e980bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:19.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.072+0000 7f9e9f8ad640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9e980bcb60 0x7f9e9806c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:19.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.072+0000 7f9e9f8ad640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e9814b610 con 0x7f9e980bc4a0 2023-10-03T19:19:19.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.072+0000 7f9e9f8ad640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e980a3670 con 0x7f9e98148b90 2023-10-03T19:19:19.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.072+0000 7f9e9f8ad640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9814b370 con 0x7f9e980bcb60 2023-10-03T19:19:19.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.072+0000 7f9e9d649640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9e98148b90 0x7f9e980bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:19.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.072+0000 7f9e9ce48640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9e980bcb60 0x7f9e9806c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:19.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.072+0000 7f9e9d649640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9e98148b90 0x7f9e980bbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:52888/0 (socket says 172.21.15.45:52888) 2023-10-03T19:19:19.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.072+0000 7f9e9d649640 1 -- 172.21.15.45:0/12363346 learned_addr learned my addr 172.21.15.45:0/12363346 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:19.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.072+0000 7f9e9de4a640 1 --1- 172.21.15.45:0/12363346 >> v1:172.21.15.79:6789/0 conn(0x7f9e980bc4a0 0x7f9e9806c7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:59170/0 (socket says 172.21.15.45:59170) 2023-10-03T19:19:19.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.072+0000 7f9e9ce48640 1 -- 172.21.15.45:0/12363346 >> v2:172.21.15.79:3300/0 conn(0x7f9e98148b90 msgr2=0x7f9e980bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:19.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.072+0000 7f9e9ce48640 1 --2- 172.21.15.45:0/12363346 >> v2:172.21.15.79:3300/0 conn(0x7f9e98148b90 0x7f9e980bbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:19.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.072+0000 7f9e9ce48640 1 -- 172.21.15.45:0/12363346 >> v1:172.21.15.79:6789/0 conn(0x7f9e980bc4a0 legacy=0x7f9e9806c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:19.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.072+0000 7f9e9ce48640 1 -- 172.21.15.45:0/12363346 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e980a5580 con 0x7f9e980bcb60 2023-10-03T19:19:19.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.072+0000 7f9e8ffff640 1 -- 172.21.15.45:0/12363346 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3736364616 0 0) 0x7f9e9814b610 con 0x7f9e980bc4a0 2023-10-03T19:19:19.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.076+0000 7f9e9ce48640 1 --2- 172.21.15.45:0/12363346 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9e980bcb60 0x7f9e9806c290 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800ba60 tx=0x7f9e88021340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c4d8c649d440bf2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:19.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.076+0000 7f9e8ffff640 1 -- 172.21.15.45:0/12363346 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e880b1600 con 0x7f9e980bcb60 2023-10-03T19:19:19.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.076+0000 7f9e8ffff640 1 -- 172.21.15.45:0/12363346 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e880ad050 con 0x7f9e980bcb60 2023-10-03T19:19:19.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.076+0000 7f9e8ffff640 1 -- 172.21.15.45:0/12363346 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e880b1980 con 0x7f9e980bcb60 2023-10-03T19:19:19.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.076+0000 7f9e9f8ad640 1 -- 172.21.15.45:0/12363346 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9e980bcb60 msgr2=0x7f9e9806c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:19.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.076+0000 7f9e9f8ad640 1 --2- 172.21.15.45:0/12363346 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9e980bcb60 0x7f9e9806c290 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800ba60 tx=0x7f9e88021340 comp rx=0 tx=0).stop 2023-10-03T19:19:19.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.076+0000 7f9e9f8ad640 1 -- 172.21.15.45:0/12363346 shutdown_connections 2023-10-03T19:19:19.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.076+0000 7f9e9f8ad640 1 --2- 172.21.15.45:0/12363346 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9e980bcb60 0x7f9e9806c290 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:19.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.076+0000 7f9e9f8ad640 1 --2- 172.21.15.45:0/12363346 >> v2:172.21.15.79:3300/0 conn(0x7f9e98148b90 0x7f9e980bbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:19.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.076+0000 7f9e9f8ad640 1 -- 172.21.15.45:0/12363346 >> 172.21.15.45:0/12363346 conn(0x7f9e980bcf50 msgr2=0x7f9e980bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:19.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.076+0000 7f9e9f8ad640 1 -- 172.21.15.45:0/12363346 shutdown_connections 2023-10-03T19:19:19.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.076+0000 7f9e9f8ad640 1 -- 172.21.15.45:0/12363346 wait complete. 2023-10-03T19:19:19.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.076+0000 7f9e9f8ad640 1 Processor -- start 2023-10-03T19:19:19.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.076+0000 7f9e9f8ad640 1 -- start start 2023-10-03T19:19:19.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.076+0000 7f9e9f8ad640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e980bc4a0 0x7f9e980a4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:19.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.076+0000 7f9e9f8ad640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9e980bcb60 0x7f9e980bf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:19.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.076+0000 7f9e9f8ad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e98148b90 0x7f9e9813e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:19.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.076+0000 7f9e9f8ad640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e981e2e60 con 0x7f9e98148b90 2023-10-03T19:19:19.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.076+0000 7f9e9f8ad640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e980a4760 con 0x7f9e980bc4a0 2023-10-03T19:19:19.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.076+0000 7f9e9f8ad640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e981e2530 con 0x7f9e980bcb60 2023-10-03T19:19:19.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.076+0000 7f9e9de4a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e98148b90 0x7f9e9813e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:19.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.076+0000 7f9e9de4a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e98148b90 0x7f9e9813e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46204/0 (socket says 172.21.15.45:46204) 2023-10-03T19:19:19.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.076+0000 7f9e9de4a640 1 -- 172.21.15.45:0/557727421 learned_addr learned my addr 172.21.15.45:0/557727421 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:19.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.076+0000 7f9e9d649640 1 --2- 172.21.15.45:0/557727421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e980bc4a0 0x7f9e980a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:19.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.080+0000 7f9e9ce48640 1 --2- 172.21.15.45:0/557727421 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9e980bcb60 0x7f9e980bf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:19.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.080+0000 7f9e9de4a640 1 -- 172.21.15.45:0/557727421 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9e980bcb60 msgr2=0x7f9e980bf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:19.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.080+0000 7f9e9de4a640 1 --2- 172.21.15.45:0/557727421 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9e980bcb60 0x7f9e980bf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:19.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.080+0000 7f9e9de4a640 1 -- 172.21.15.45:0/557727421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e980bc4a0 msgr2=0x7f9e980a4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:19.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.080+0000 7f9e9de4a640 1 --2- 172.21.15.45:0/557727421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e980bc4a0 0x7f9e980a4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:19.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.080+0000 7f9e9de4a640 1 -- 172.21.15.45:0/557727421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8800b6c0 con 0x7f9e98148b90 2023-10-03T19:19:19.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.080+0000 7f9e9de4a640 1 --2- 172.21.15.45:0/557727421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e98148b90 0x7f9e9813e900 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f9e9000c7e0 tx=0x7f9e9000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:19.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.080+0000 7f9e8dffb640 1 -- 172.21.15.45:0/557727421 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9000a640 con 0x7f9e98148b90 2023-10-03T19:19:19.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.080+0000 7f9e8dffb640 1 -- 172.21.15.45:0/557727421 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9000a7a0 con 0x7f9e98148b90 2023-10-03T19:19:19.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.080+0000 7f9e9f8ad640 1 -- 172.21.15.45:0/557727421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e9806cee0 con 0x7f9e98148b90 2023-10-03T19:19:19.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.080+0000 7f9e8dffb640 1 -- 172.21.15.45:0/557727421 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9000ab50 con 0x7f9e98148b90 2023-10-03T19:19:19.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.080+0000 7f9e9f8ad640 1 -- 172.21.15.45:0/557727421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e980a5820 con 0x7f9e98148b90 2023-10-03T19:19:19.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.080+0000 7f9e9f8ad640 1 -- 172.21.15.45:0/557727421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e98148f60 con 0x7f9e98148b90 2023-10-03T19:19:19.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.080+0000 7f9e8dffb640 1 -- 172.21.15.45:0/557727421 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9e9000acb0 con 0x7f9e98148b90 2023-10-03T19:19:19.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.080+0000 7f9e8dffb640 1 --2- 172.21.15.45:0/557727421 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9e7c0662b0 0x7f9e7c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:19.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.080+0000 7f9e8dffb640 1 -- 172.21.15.45:0/557727421 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f9e90083640 con 0x7f9e98148b90 2023-10-03T19:19:19.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.080+0000 7f9e9d649640 1 --2- 172.21.15.45:0/557727421 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9e7c0662b0 0x7f9e7c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:19.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.080+0000 7f9e9d649640 1 --2- 172.21.15.45:0/557727421 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9e7c0662b0 0x7f9e7c068760 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9e94009ab0 tx=0x7f9e94009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:19.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.084+0000 7f9e8dffb640 1 -- 172.21.15.45:0/557727421 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9e90050ac0 con 0x7f9e98148b90 2023-10-03T19:19:19.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.240+0000 7f9e9f8ad640 1 -- 172.21.15.45:0/557727421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e981e3010 con 0x7f9e98148b90 2023-10-03T19:19:19.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.244+0000 7f9e8dffb640 1 -- 172.21.15.45:0/557727421 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+18501 (secure 0 0 0) 0x7f9e981e3010 con 0x7f9e98148b90 2023-10-03T19:19:19.247 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:19:19.247 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":87,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:19:14.804643+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:18:25.942883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-10-03T19:18:27.242940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.2","mappings":[{"from":1,"to":2}]},{"pgid":"14.26","mappings":[{"from":1,"to":7}]},{"pgid":"14.29","mappings":[{"from":1,"to":7}]},{"pgid":"14.32","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:0/2938203609":"2023-10-03T20:19:12.888501+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:19:19.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.244+0000 7f9e9f8ad640 1 -- 172.21.15.45:0/557727421 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9e7c0662b0 msgr2=0x7f9e7c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:19.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.244+0000 7f9e9f8ad640 1 --2- 172.21.15.45:0/557727421 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9e7c0662b0 0x7f9e7c068760 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9e94009ab0 tx=0x7f9e94009240 comp rx=0 tx=0).stop 2023-10-03T19:19:19.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.244+0000 7f9e9f8ad640 1 -- 172.21.15.45:0/557727421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e98148b90 msgr2=0x7f9e9813e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:19.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.244+0000 7f9e9f8ad640 1 --2- 172.21.15.45:0/557727421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e98148b90 0x7f9e9813e900 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f9e9000c7e0 tx=0x7f9e9000cca0 comp rx=0 tx=0).stop 2023-10-03T19:19:19.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.244+0000 7f9e9f8ad640 1 -- 172.21.15.45:0/557727421 shutdown_connections 2023-10-03T19:19:19.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.244+0000 7f9e9f8ad640 1 --2- 172.21.15.45:0/557727421 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9e7c0662b0 0x7f9e7c068760 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:19.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.244+0000 7f9e9f8ad640 1 --2- 172.21.15.45:0/557727421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e98148b90 0x7f9e9813e900 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:19.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.244+0000 7f9e9f8ad640 1 --2- 172.21.15.45:0/557727421 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9e980bcb60 0x7f9e980bf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:19.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.244+0000 7f9e9f8ad640 1 --2- 172.21.15.45:0/557727421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e980bc4a0 0x7f9e980a4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:19.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.248+0000 7f9e9f8ad640 1 -- 172.21.15.45:0/557727421 >> 172.21.15.45:0/557727421 conn(0x7f9e980bcf50 msgr2=0x7f9e9806c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:19.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.248+0000 7f9e9f8ad640 1 -- 172.21.15.45:0/557727421 shutdown_connections 2023-10-03T19:19:19.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.248+0000 7f9e9f8ad640 1 -- 172.21.15.45:0/557727421 wait complete. 2023-10-03T19:19:19.282 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-03T19:19:19.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:19.283 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-10-03T19:19:19.340 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-03T19:19:19.340 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:19:19.395 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:19:19.453 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:19:19.487 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:19:19.546 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-03T19:19:19.547 INFO:tasks.cephfs.mount:Terminating background process 2023-10-03T19:19:19.547 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:19:19.547 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:19:19.553 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:19:19.607 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:2023-10-03T19:19:19.601+0000 7f5fb4ff9640 -1 client.5624 I was blocklisted at osd epoch 87 2023-10-03T19:19:19.607 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:2023-10-03T19:19:19.601+0000 7f5fb4ff9640 -1 client.5624 remove_session_caps still has dirty data on 0x10000000000.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100664 size=7/4194304 nlink=1 btime=2023-10-03T19:18:40.556613+0000 mtime=2023-10-03T19:18:40.569622+0000 ctime=2023-10-03T19:18:40.569622+0000 change_attr=1 caps=- objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 7] parents=0x1.head["background_file"] 0x7f5fa800d7a0) 2023-10-03T19:19:19.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.692+0000 7fbc4cdcd640 1 Processor -- start 2023-10-03T19:19:19.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.692+0000 7fbc4cdcd640 1 -- start start 2023-10-03T19:19:19.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.692+0000 7fbc4cdcd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbc4806d170 0x7fbc4814d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:19.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.692+0000 7fbc4cdcd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc4806cac0 con 0x7fbc480bc8b0 2023-10-03T19:19:19.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.692+0000 7fbc4cdcd640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc480720d0 con 0x7fbc4806f170 2023-10-03T19:19:19.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.692+0000 7fbc4cdcd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc480a5ab0 con 0x7fbc4806d170 2023-10-03T19:19:19.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.692+0000 7fbc45d9b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbc480bc8b0 0x7fbc4814ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36900/0 (socket says 172.21.15.45:36900) 2023-10-03T19:19:19.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.692+0000 7fbc45d9b640 1 -- 172.21.15.45:0/2975348043 learned_addr learned my addr 172.21.15.45:0/2975348043 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:19.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.692+0000 7fbc46d9d640 1 --2- 172.21.15.45:0/2975348043 >> v2:172.21.15.45:3300/0 conn(0x7fbc4806d170 0x7fbc4814d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:19.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.692+0000 7fbc46d9d640 1 -- 172.21.15.45:0/2975348043 >> v1:172.21.15.79:6789/0 conn(0x7fbc4806f170 legacy=0x7fbc48150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:19.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.696+0000 7fbc46d9d640 1 -- 172.21.15.45:0/2975348043 >> v1:172.21.15.45:6789/0 conn(0x7fbc480bc8b0 legacy=0x7fbc4814ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:19.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.696+0000 7fbc46d9d640 1 -- 172.21.15.45:0/2975348043 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc4806cd00 con 0x7fbc4806d170 2023-10-03T19:19:19.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.696+0000 7fbc4559a640 1 -- 172.21.15.45:0/2975348043 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4170991831 0 0) 0x7fbc3c001120 con 0x7fbc480bc8b0 2023-10-03T19:19:19.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.696+0000 7fbc46d9d640 1 --2- 172.21.15.45:0/2975348043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc4806d170 0x7fbc4814d180 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fbc40009d90 tx=0x7fbc4001f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8fae970fdffac4f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:19.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.696+0000 7fbc4559a640 1 -- 172.21.15.45:0/2975348043 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc400af600 con 0x7fbc4806d170 2023-10-03T19:19:19.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.696+0000 7fbc4559a640 1 -- 172.21.15.45:0/2975348043 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc400ab050 con 0x7fbc4806d170 2023-10-03T19:19:19.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.696+0000 7fbc4559a640 1 -- 172.21.15.45:0/2975348043 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc400af980 con 0x7fbc4806d170 2023-10-03T19:19:19.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.696+0000 7fbc4cdcd640 1 -- 172.21.15.45:0/2975348043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc4806d170 msgr2=0x7fbc4814d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:19.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.696+0000 7fbc4cdcd640 1 --2- 172.21.15.45:0/2975348043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc4806d170 0x7fbc4814d180 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fbc40009d90 tx=0x7fbc4001f130 comp rx=0 tx=0).stop 2023-10-03T19:19:19.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.696+0000 7fbc4cdcd640 1 -- 172.21.15.45:0/2975348043 shutdown_connections 2023-10-03T19:19:19.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.696+0000 7fbc4cdcd640 1 --2- 172.21.15.45:0/2975348043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc4806d170 0x7fbc4814d180 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:19.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.696+0000 7fbc4cdcd640 1 -- 172.21.15.45:0/2975348043 >> 172.21.15.45:0/2975348043 conn(0x7fbc480bcf50 msgr2=0x7fbc480bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:19.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.696+0000 7fbc4cdcd640 1 -- 172.21.15.45:0/2975348043 shutdown_connections 2023-10-03T19:19:19.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.696+0000 7fbc4cdcd640 1 -- 172.21.15.45:0/2975348043 wait complete. 2023-10-03T19:19:19.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.700+0000 7fbc4cdcd640 1 Processor -- start 2023-10-03T19:19:19.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.700+0000 7fbc4cdcd640 1 -- start start 2023-10-03T19:19:19.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.700+0000 7fbc4cdcd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc4806d170 0x7fbc4814afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:19.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.700+0000 7fbc4cdcd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4806f170 0x7fbc481e3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:19.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.700+0000 7fbc4cdcd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc480bc8b0 0x7fbc481e40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:19.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.700+0000 7fbc4cdcd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc481d8030 con 0x7fbc480bc8b0 2023-10-03T19:19:19.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.700+0000 7fbc4cdcd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4814b510 con 0x7fbc4806f170 2023-10-03T19:19:19.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.700+0000 7fbc4cdcd640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc480ba110 con 0x7fbc4806d170 2023-10-03T19:19:19.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.700+0000 7fbc46d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc480bc8b0 0x7fbc481e40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:19.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.700+0000 7fbc46d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc480bc8b0 0x7fbc481e40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46212/0 (socket says 172.21.15.45:46212) 2023-10-03T19:19:19.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.700+0000 7fbc46d9d640 1 -- 172.21.15.45:0/2876117867 learned_addr learned my addr 172.21.15.45:0/2876117867 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:19.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.700+0000 7fbc45d9b640 1 --2- 172.21.15.45:0/2876117867 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4806f170 0x7fbc481e3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:19.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.700+0000 7fbc4659c640 1 --2- 172.21.15.45:0/2876117867 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc4806d170 0x7fbc4814afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:19.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.700+0000 7fbc46d9d640 1 -- 172.21.15.45:0/2876117867 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc4806d170 msgr2=0x7fbc4814afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:19.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.700+0000 7fbc46d9d640 1 --2- 172.21.15.45:0/2876117867 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc4806d170 0x7fbc4814afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:19.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.700+0000 7fbc46d9d640 1 -- 172.21.15.45:0/2876117867 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4806f170 msgr2=0x7fbc481e3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:19.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.700+0000 7fbc46d9d640 1 --2- 172.21.15.45:0/2876117867 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4806f170 0x7fbc481e3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:19.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.700+0000 7fbc46d9d640 1 -- 172.21.15.45:0/2876117867 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc40009a70 con 0x7fbc480bc8b0 2023-10-03T19:19:19.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.700+0000 7fbc46d9d640 1 --2- 172.21.15.45:0/2876117867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc480bc8b0 0x7fbc481e40b0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fbc4001cd60 tx=0x7fbc4001bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:19.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.700+0000 7fbc36ffd640 1 -- 172.21.15.45:0/2876117867 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc400b9410 con 0x7fbc480bc8b0 2023-10-03T19:19:19.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.700+0000 7fbc36ffd640 1 -- 172.21.15.45:0/2876117867 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc400b9570 con 0x7fbc480bc8b0 2023-10-03T19:19:19.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.700+0000 7fbc36ffd640 1 -- 172.21.15.45:0/2876117867 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc400b9900 con 0x7fbc480bc8b0 2023-10-03T19:19:19.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.700+0000 7fbc4cdcd640 1 -- 172.21.15.45:0/2876117867 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc4814c4a0 con 0x7fbc480bc8b0 2023-10-03T19:19:19.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.700+0000 7fbc4cdcd640 1 -- 172.21.15.45:0/2876117867 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4814fae0 con 0x7fbc480bc8b0 2023-10-03T19:19:19.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.700+0000 7fbc4cdcd640 1 -- 172.21.15.45:0/2876117867 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc4806f540 con 0x7fbc480bc8b0 2023-10-03T19:19:19.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.700+0000 7fbc36ffd640 1 -- 172.21.15.45:0/2876117867 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbc400b6050 con 0x7fbc480bc8b0 2023-10-03T19:19:19.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.700+0000 7fbc36ffd640 1 --2- 172.21.15.45:0/2876117867 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbc28066280 0x7fbc28068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:19.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.700+0000 7fbc36ffd640 1 -- 172.21.15.45:0/2876117867 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fbc40122350 con 0x7fbc480bc8b0 2023-10-03T19:19:19.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.704+0000 7fbc4659c640 1 --2- 172.21.15.45:0/2876117867 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbc28066280 0x7fbc28068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:19.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.704+0000 7fbc4659c640 1 --2- 172.21.15.45:0/2876117867 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbc28066280 0x7fbc28068730 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fbc38000f70 tx=0x7fbc38009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:19.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.704+0000 7fbc36ffd640 1 -- 172.21.15.45:0/2876117867 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbc400ef730 con 0x7fbc480bc8b0 2023-10-03T19:19:19.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.864+0000 7fbc4cdcd640 1 -- 172.21.15.45:0/2876117867 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc4806d660 con 0x7fbc480bc8b0 2023-10-03T19:19:19.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.864+0000 7fbc36ffd640 1 -- 172.21.15.45:0/2876117867 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+18501 (secure 0 0 0) 0x7fbc400f2d50 con 0x7fbc480bc8b0 2023-10-03T19:19:19.870 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:19:19.870 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":87,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:19:14.804643+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:18:25.942883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-10-03T19:18:27.242940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.2","mappings":[{"from":1,"to":2}]},{"pgid":"14.26","mappings":[{"from":1,"to":7}]},{"pgid":"14.29","mappings":[{"from":1,"to":7}]},{"pgid":"14.32","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:0/2938203609":"2023-10-03T20:19:12.888501+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:19:19.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.868+0000 7fbc4cdcd640 1 -- 172.21.15.45:0/2876117867 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbc28066280 msgr2=0x7fbc28068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:19.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.868+0000 7fbc4cdcd640 1 --2- 172.21.15.45:0/2876117867 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbc28066280 0x7fbc28068730 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fbc38000f70 tx=0x7fbc38009040 comp rx=0 tx=0).stop 2023-10-03T19:19:19.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.868+0000 7fbc4cdcd640 1 -- 172.21.15.45:0/2876117867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc480bc8b0 msgr2=0x7fbc481e40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:19.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.868+0000 7fbc4cdcd640 1 --2- 172.21.15.45:0/2876117867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc480bc8b0 0x7fbc481e40b0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fbc4001cd60 tx=0x7fbc4001bed0 comp rx=0 tx=0).stop 2023-10-03T19:19:19.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.868+0000 7fbc4cdcd640 1 -- 172.21.15.45:0/2876117867 shutdown_connections 2023-10-03T19:19:19.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.868+0000 7fbc4cdcd640 1 --2- 172.21.15.45:0/2876117867 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbc28066280 0x7fbc28068730 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:19.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.868+0000 7fbc4cdcd640 1 --2- 172.21.15.45:0/2876117867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc480bc8b0 0x7fbc481e40b0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:19.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.868+0000 7fbc4cdcd640 1 --2- 172.21.15.45:0/2876117867 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4806f170 0x7fbc481e3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:19.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.868+0000 7fbc4cdcd640 1 --2- 172.21.15.45:0/2876117867 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc4806d170 0x7fbc4814afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:19.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.868+0000 7fbc4cdcd640 1 -- 172.21.15.45:0/2876117867 >> 172.21.15.45:0/2876117867 conn(0x7fbc480bcf50 msgr2=0x7fbc480712b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:19.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.868+0000 7fbc4cdcd640 1 -- 172.21.15.45:0/2876117867 shutdown_connections 2023-10-03T19:19:19.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:19.868+0000 7fbc4cdcd640 1 -- 172.21.15.45:0/2876117867 wait complete. 2023-10-03T19:19:19.889 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T19:18:25.942883+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T19:18:27.242940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:19:19.889 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:19:20.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.020+0000 7f2605c86640 1 Processor -- start 2023-10-03T19:19:20.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.020+0000 7f2605c86640 1 -- start start 2023-10-03T19:19:20.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.020+0000 7f2605c86640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26000712c0 0x7f26000bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:20.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.020+0000 7f2605c86640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f260006d560 0x7f26000bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:20.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.020+0000 7f2605c86640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f260006c2d0 con 0x7f260006c760 2023-10-03T19:19:20.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.020+0000 7f2605c86640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2600150610 con 0x7f260006d560 2023-10-03T19:19:20.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.020+0000 7f2605c86640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26001508b0 con 0x7f26000712c0 2023-10-03T19:19:20.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.020+0000 7f25ff7fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26000712c0 0x7f26000bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:20.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.020+0000 7f25ff7fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26000712c0 0x7f26000bcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:35238/0 (socket says 172.21.15.45:35238) 2023-10-03T19:19:20.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.020+0000 7f25ff7fe640 1 -- 172.21.15.45:0/3398739109 learned_addr learned my addr 172.21.15.45:0/3398739109 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:20.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.020+0000 7f25f6ffd640 1 --2- 172.21.15.45:0/3398739109 >> v2:172.21.15.79:3300/0 conn(0x7f260006d560 0x7f26000bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:20.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.020+0000 7f25f6ffd640 1 -- 172.21.15.45:0/3398739109 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26000712c0 msgr2=0x7f26000bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:20.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.020+0000 7f25f6ffd640 1 --2- 172.21.15.45:0/3398739109 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26000712c0 0x7f26000bcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.020+0000 7f25f6ffd640 1 -- 172.21.15.45:0/3398739109 >> v1:172.21.15.79:6789/0 conn(0x7f260006c760 legacy=0x7f26000a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:20.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.020+0000 7f25f6ffd640 1 -- 172.21.15.45:0/3398739109 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260006d2e0 con 0x7f260006d560 2023-10-03T19:19:20.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.020+0000 7f25feffd640 1 -- 172.21.15.45:0/3398739109 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1560528858 0 0) 0x7f260006c2d0 con 0x7f260006c760 2023-10-03T19:19:20.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.020+0000 7f25ff7fe640 1 --2- 172.21.15.45:0/3398739109 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26000712c0 0x7f26000bcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:19:20.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.024+0000 7f25f6ffd640 1 --2- 172.21.15.45:0/3398739109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f260006d560 0x7f26000bd100 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f25e80097c0 tx=0x7f25e801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=469d36b65c7241a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:20.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.024+0000 7f25feffd640 1 -- 172.21.15.45:0/3398739109 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e80ac620 con 0x7f260006d560 2023-10-03T19:19:20.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.024+0000 7f25feffd640 1 -- 172.21.15.45:0/3398739109 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e80ac780 con 0x7f260006d560 2023-10-03T19:19:20.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.024+0000 7f25feffd640 1 -- 172.21.15.45:0/3398739109 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e80acb10 con 0x7f260006d560 2023-10-03T19:19:20.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.024+0000 7f2605c86640 1 -- 172.21.15.45:0/3398739109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f260006d560 msgr2=0x7f26000bd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:20.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.024+0000 7f2605c86640 1 --2- 172.21.15.45:0/3398739109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f260006d560 0x7f26000bd100 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f25e80097c0 tx=0x7f25e801c480 comp rx=0 tx=0).stop 2023-10-03T19:19:20.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.024+0000 7f2605c86640 1 -- 172.21.15.45:0/3398739109 shutdown_connections 2023-10-03T19:19:20.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.024+0000 7f2605c86640 1 --2- 172.21.15.45:0/3398739109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f260006d560 0x7f26000bd100 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.024+0000 7f2605c86640 1 --2- 172.21.15.45:0/3398739109 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26000712c0 0x7f26000bcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.024+0000 7f2605c86640 1 -- 172.21.15.45:0/3398739109 >> 172.21.15.45:0/3398739109 conn(0x7f26000a20d0 msgr2=0x7f26000a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:20.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.024+0000 7f2605c86640 1 -- 172.21.15.45:0/3398739109 shutdown_connections 2023-10-03T19:19:20.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.024+0000 7f2605c86640 1 -- 172.21.15.45:0/3398739109 wait complete. 2023-10-03T19:19:20.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.024+0000 7f2605c86640 1 Processor -- start 2023-10-03T19:19:20.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.028+0000 7f2605c86640 1 -- start start 2023-10-03T19:19:20.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.028+0000 7f2605c86640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f260006c760 0x7f2600146a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:20.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.028+0000 7f2605c86640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f260006d560 0x7f26000b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:20.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.028+0000 7f2605c86640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26000712c0 0x7f26001439b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:20.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.028+0000 7f2605c86640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26001e51c0 con 0x7f26000712c0 2023-10-03T19:19:20.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.028+0000 7f2605c86640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26000b6560 con 0x7f260006d560 2023-10-03T19:19:20.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.028+0000 7f2605c86640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26001e5650 con 0x7f260006c760 2023-10-03T19:19:20.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.028+0000 7f25fffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26000712c0 0x7f26001439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:20.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.028+0000 7f25fffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26000712c0 0x7f26001439b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46222/0 (socket says 172.21.15.45:46222) 2023-10-03T19:19:20.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.028+0000 7f25fffff640 1 -- 172.21.15.45:0/956792633 learned_addr learned my addr 172.21.15.45:0/956792633 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:20.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.028+0000 7f25f6ffd640 1 --2- 172.21.15.45:0/956792633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f260006d560 0x7f26000b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:20.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.028+0000 7f25ff7fe640 1 --2- 172.21.15.45:0/956792633 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f260006c760 0x7f2600146a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:20.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.028+0000 7f25fffff640 1 -- 172.21.15.45:0/956792633 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f260006c760 msgr2=0x7f2600146a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:20.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.028+0000 7f25fffff640 1 --2- 172.21.15.45:0/956792633 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f260006c760 0x7f2600146a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.028+0000 7f25fffff640 1 -- 172.21.15.45:0/956792633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f260006d560 msgr2=0x7f26000b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:20.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.028+0000 7f25fffff640 1 --2- 172.21.15.45:0/956792633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f260006d560 0x7f26000b6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.028+0000 7f25fffff640 1 -- 172.21.15.45:0/956792633 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f00094d0 con 0x7f26000712c0 2023-10-03T19:19:20.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.028+0000 7f25ff7fe640 1 --2- 172.21.15.45:0/956792633 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f260006c760 0x7f2600146a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:19:20.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.028+0000 7f25fffff640 1 --2- 172.21.15.45:0/956792633 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26000712c0 0x7f26001439b0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f25f800c750 tx=0x7f25f800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:20.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.028+0000 7f25fcff9640 1 -- 172.21.15.45:0/956792633 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f8003db0 con 0x7f26000712c0 2023-10-03T19:19:20.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.028+0000 7f25fcff9640 1 -- 172.21.15.45:0/956792633 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f800ce60 con 0x7f26000712c0 2023-10-03T19:19:20.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.028+0000 7f2605c86640 1 -- 172.21.15.45:0/956792633 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e8009420 con 0x7f26000712c0 2023-10-03T19:19:20.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.028+0000 7f25fcff9640 1 -- 172.21.15.45:0/956792633 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f80052b0 con 0x7f26000712c0 2023-10-03T19:19:20.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.028+0000 7f2605c86640 1 -- 172.21.15.45:0/956792633 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26000a6070 con 0x7f26000712c0 2023-10-03T19:19:20.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.028+0000 7f2605c86640 1 -- 172.21.15.45:0/956792633 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26000a5ee0 con 0x7f26000712c0 2023-10-03T19:19:20.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.028+0000 7f25fcff9640 1 -- 172.21.15.45:0/956792633 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f25f8005410 con 0x7f26000712c0 2023-10-03T19:19:20.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.032+0000 7f25fcff9640 1 --2- 172.21.15.45:0/956792633 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f25e0066280 0x7f25e0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:20.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.032+0000 7f25fcff9640 1 -- 172.21.15.45:0/956792633 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f25f8083bf0 con 0x7f26000712c0 2023-10-03T19:19:20.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.032+0000 7f25ff7fe640 1 --2- 172.21.15.45:0/956792633 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f25e0066280 0x7f25e0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:20.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.032+0000 7f25ff7fe640 1 --2- 172.21.15.45:0/956792633 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f25e0066280 0x7f25e0068730 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f25f0009c90 tx=0x7f25f0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:20.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.036+0000 7f25fcff9640 1 -- 172.21.15.45:0/956792633 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f25f8050f40 con 0x7f26000712c0 2023-10-03T19:19:20.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.188+0000 7f2605c86640 1 -- 172.21.15.45:0/956792633 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f26000bca30 con 0x7f26000712c0 2023-10-03T19:19:20.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.188+0000 7f25fcff9640 1 -- 172.21.15.45:0/956792633 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7f25f8054560 con 0x7f26000712c0 2023-10-03T19:19:20.191 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:19:20.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.188+0000 7f2605c86640 1 -- 172.21.15.45:0/956792633 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f25e0066280 msgr2=0x7f25e0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:20.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.188+0000 7f2605c86640 1 --2- 172.21.15.45:0/956792633 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f25e0066280 0x7f25e0068730 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f25f0009c90 tx=0x7f25f0008040 comp rx=0 tx=0).stop 2023-10-03T19:19:20.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.188+0000 7f2605c86640 1 -- 172.21.15.45:0/956792633 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26000712c0 msgr2=0x7f26001439b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:20.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.188+0000 7f2605c86640 1 --2- 172.21.15.45:0/956792633 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26000712c0 0x7f26001439b0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f25f800c750 tx=0x7f25f800cc10 comp rx=0 tx=0).stop 2023-10-03T19:19:20.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.188+0000 7f2605c86640 1 -- 172.21.15.45:0/956792633 shutdown_connections 2023-10-03T19:19:20.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.188+0000 7f2605c86640 1 --2- 172.21.15.45:0/956792633 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f25e0066280 0x7f25e0068730 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.188+0000 7f2605c86640 1 --2- 172.21.15.45:0/956792633 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26000712c0 0x7f26001439b0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.188+0000 7f2605c86640 1 --2- 172.21.15.45:0/956792633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f260006d560 0x7f26000b6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.188+0000 7f2605c86640 1 --2- 172.21.15.45:0/956792633 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f260006c760 0x7f2600146a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.188+0000 7f2605c86640 1 -- 172.21.15.45:0/956792633 >> 172.21.15.45:0/956792633 conn(0x7f26000a20d0 msgr2=0x7f26000be010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:20.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.188+0000 7f2605c86640 1 -- 172.21.15.45:0/956792633 shutdown_connections 2023-10-03T19:19:20.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.188+0000 7f2605c86640 1 -- 172.21.15.45:0/956792633 wait complete. 2023-10-03T19:19:20.209 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:19:20.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.328+0000 7f634572b640 1 Processor -- start 2023-10-03T19:19:20.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.328+0000 7f634572b640 1 -- start start 2023-10-03T19:19:20.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.332+0000 7f634572b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f63401498b0 0x7f6340071020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:20.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.332+0000 7f634572b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6340150530 0x7f6340156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:20.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.332+0000 7f634572b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63400a4c20 con 0x7f634014c270 2023-10-03T19:19:20.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.332+0000 7f634572b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63400a8080 con 0x7f6340150530 2023-10-03T19:19:20.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.332+0000 7f634572b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6340149c80 con 0x7f63401498b0 2023-10-03T19:19:20.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.332+0000 7f633f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6340150530 0x7f6340156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:20.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.332+0000 7f633f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6340150530 0x7f6340156bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46234/0 (socket says 172.21.15.45:46234) 2023-10-03T19:19:20.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.332+0000 7f633f7fe640 1 -- 172.21.15.45:0/144770782 learned_addr learned my addr 172.21.15.45:0/144770782 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:20.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.332+0000 7f633e7fc640 1 --1- 172.21.15.45:0/144770782 >> v1:172.21.15.45:6789/0 conn(0x7f634014c270 0x7f634014fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36910/0 (socket says 172.21.15.45:36910) 2023-10-03T19:19:20.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.332+0000 7f633effd640 1 --2- 172.21.15.45:0/144770782 >> v2:172.21.15.79:3300/0 conn(0x7f63401498b0 0x7f6340071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:20.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.332+0000 7f633f7fe640 1 -- 172.21.15.45:0/144770782 >> v2:172.21.15.79:3300/0 conn(0x7f63401498b0 msgr2=0x7f6340071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:20.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.332+0000 7f633f7fe640 1 --2- 172.21.15.45:0/144770782 >> v2:172.21.15.79:3300/0 conn(0x7f63401498b0 0x7f6340071020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.332+0000 7f633f7fe640 1 -- 172.21.15.45:0/144770782 >> v1:172.21.15.45:6789/0 conn(0x7f634014c270 legacy=0x7f634014fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:20.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.332+0000 7f633f7fe640 1 -- 172.21.15.45:0/144770782 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63400b7500 con 0x7f6340150530 2023-10-03T19:19:20.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.332+0000 7f633dffb640 1 -- 172.21.15.45:0/144770782 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 136054706 0 0) 0x7f63400a4c20 con 0x7f634014c270 2023-10-03T19:19:20.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.332+0000 7f633f7fe640 1 --2- 172.21.15.45:0/144770782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6340150530 0x7f6340156bf0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f6330009870 tx=0x7f633001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d30cd41e92687dc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:20.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.332+0000 7f633dffb640 1 -- 172.21.15.45:0/144770782 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63300a89f0 con 0x7f6340150530 2023-10-03T19:19:20.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.332+0000 7f633dffb640 1 -- 172.21.15.45:0/144770782 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63300a8b50 con 0x7f6340150530 2023-10-03T19:19:20.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.332+0000 7f633dffb640 1 -- 172.21.15.45:0/144770782 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63300b0440 con 0x7f6340150530 2023-10-03T19:19:20.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f634572b640 1 -- 172.21.15.45:0/144770782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6340150530 msgr2=0x7f6340156bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:20.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f634572b640 1 --2- 172.21.15.45:0/144770782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6340150530 0x7f6340156bf0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f6330009870 tx=0x7f633001ecf0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f634572b640 1 -- 172.21.15.45:0/144770782 shutdown_connections 2023-10-03T19:19:20.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f634572b640 1 --2- 172.21.15.45:0/144770782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6340150530 0x7f6340156bf0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f634572b640 1 --2- 172.21.15.45:0/144770782 >> v2:172.21.15.79:3300/0 conn(0x7f63401498b0 0x7f6340071020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f634572b640 1 -- 172.21.15.45:0/144770782 >> 172.21.15.45:0/144770782 conn(0x7f63400c25f0 msgr2=0x7f63400c29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:20.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f634572b640 1 -- 172.21.15.45:0/144770782 shutdown_connections 2023-10-03T19:19:20.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f634572b640 1 -- 172.21.15.45:0/144770782 wait complete. 2023-10-03T19:19:20.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f634572b640 1 Processor -- start 2023-10-03T19:19:20.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f634572b640 1 -- start start 2023-10-03T19:19:20.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f634572b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63401498b0 0x7f63401e40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:20.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f634572b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f634014c270 0x7f63400bf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:20.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f634572b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6340150530 0x7f63400a67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:20.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f634572b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63400a4570 con 0x7f63401498b0 2023-10-03T19:19:20.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f634572b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63400a7140 con 0x7f634014c270 2023-10-03T19:19:20.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f634572b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63400b96c0 con 0x7f6340150530 2023-10-03T19:19:20.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f633effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63401498b0 0x7f63401e40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:20.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f633effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63401498b0 0x7f63401e40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46248/0 (socket says 172.21.15.45:46248) 2023-10-03T19:19:20.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f633effd640 1 -- 172.21.15.45:0/269290316 learned_addr learned my addr 172.21.15.45:0/269290316 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:20.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f633e7fc640 1 --2- 172.21.15.45:0/269290316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f634014c270 0x7f63400bf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:20.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f633f7fe640 1 --2- 172.21.15.45:0/269290316 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6340150530 0x7f63400a67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:20.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f633effd640 1 -- 172.21.15.45:0/269290316 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6340150530 msgr2=0x7f63400a67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:20.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f633effd640 1 --2- 172.21.15.45:0/269290316 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6340150530 0x7f63400a67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f633effd640 1 -- 172.21.15.45:0/269290316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f634014c270 msgr2=0x7f63400bf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:20.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f633effd640 1 --2- 172.21.15.45:0/269290316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f634014c270 0x7f63400bf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f633effd640 1 -- 172.21.15.45:0/269290316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63300094d0 con 0x7f63401498b0 2023-10-03T19:19:20.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f633f7fe640 1 --2- 172.21.15.45:0/269290316 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6340150530 0x7f63400a67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:20.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f633effd640 1 --2- 172.21.15.45:0/269290316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63401498b0 0x7f63401e40b0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f632c007f50 tx=0x7f632c00e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:20.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f63377fe640 1 -- 172.21.15.45:0/269290316 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c014620 con 0x7f63401498b0 2023-10-03T19:19:20.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f63377fe640 1 -- 172.21.15.45:0/269290316 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632c014780 con 0x7f63401498b0 2023-10-03T19:19:20.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f634572b640 1 -- 172.21.15.45:0/269290316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63400a7da0 con 0x7f63401498b0 2023-10-03T19:19:20.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f63377fe640 1 -- 172.21.15.45:0/269290316 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c014b30 con 0x7f63401498b0 2023-10-03T19:19:20.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f634572b640 1 -- 172.21.15.45:0/269290316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63400a4e70 con 0x7f63401498b0 2023-10-03T19:19:20.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.336+0000 7f634572b640 1 -- 172.21.15.45:0/269290316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f634014f900 con 0x7f63401498b0 2023-10-03T19:19:20.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.340+0000 7f63377fe640 1 -- 172.21.15.45:0/269290316 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f632c014c90 con 0x7f63401498b0 2023-10-03T19:19:20.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.340+0000 7f63377fe640 1 --2- 172.21.15.45:0/269290316 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f63280662b0 0x7f6328068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:20.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.340+0000 7f63377fe640 1 -- 172.21.15.45:0/269290316 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f632c084710 con 0x7f63401498b0 2023-10-03T19:19:20.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.340+0000 7f633e7fc640 1 --2- 172.21.15.45:0/269290316 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f63280662b0 0x7f6328068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:20.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.340+0000 7f633e7fc640 1 --2- 172.21.15.45:0/269290316 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f63280662b0 0x7f6328068760 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f634014f300 tx=0x7f6338007b80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:20.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.344+0000 7f63377fe640 1 -- 172.21.15.45:0/269290316 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f632c051b80 con 0x7f63401498b0 2023-10-03T19:19:20.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.496+0000 7f634572b640 1 -- 172.21.15.45:0/269290316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f634004de80 con 0x7f63401498b0 2023-10-03T19:19:20.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.500+0000 7f63377fe640 1 -- 172.21.15.45:0/269290316 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v87) v1 ==== 92+0+10 (secure 0 0 0) 0x7f632c082e60 con 0x7f63401498b0 2023-10-03T19:19:20.502 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:19:20.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.500+0000 7f634572b640 1 -- 172.21.15.45:0/269290316 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f63280662b0 msgr2=0x7f6328068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:20.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.500+0000 7f634572b640 1 --2- 172.21.15.45:0/269290316 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f63280662b0 0x7f6328068760 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f634014f300 tx=0x7f6338007b80 comp rx=0 tx=0).stop 2023-10-03T19:19:20.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.500+0000 7f634572b640 1 -- 172.21.15.45:0/269290316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63401498b0 msgr2=0x7f63401e40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:20.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.500+0000 7f634572b640 1 --2- 172.21.15.45:0/269290316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63401498b0 0x7f63401e40b0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f632c007f50 tx=0x7f632c00e570 comp rx=0 tx=0).stop 2023-10-03T19:19:20.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.500+0000 7f634572b640 1 -- 172.21.15.45:0/269290316 shutdown_connections 2023-10-03T19:19:20.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.500+0000 7f634572b640 1 --2- 172.21.15.45:0/269290316 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f63280662b0 0x7f6328068760 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.500+0000 7f634572b640 1 --2- 172.21.15.45:0/269290316 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6340150530 0x7f63400a67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.500+0000 7f634572b640 1 --2- 172.21.15.45:0/269290316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f634014c270 0x7f63400bf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.500+0000 7f634572b640 1 --2- 172.21.15.45:0/269290316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63401498b0 0x7f63401e40b0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.500+0000 7f634572b640 1 -- 172.21.15.45:0/269290316 >> 172.21.15.45:0/269290316 conn(0x7f63400c25f0 msgr2=0x7f63400c29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:20.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.500+0000 7f634572b640 1 -- 172.21.15.45:0/269290316 shutdown_connections 2023-10-03T19:19:20.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.500+0000 7f634572b640 1 -- 172.21.15.45:0/269290316 wait complete. 2023-10-03T19:19:20.520 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T19:19:20.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.644+0000 7f55c36a2640 1 Processor -- start 2023-10-03T19:19:20.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.644+0000 7f55c36a2640 1 -- start start 2023-10-03T19:19:20.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.644+0000 7f55c36a2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f55bc0c14e0 0x7f55bc0c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:20.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.644+0000 7f55c36a2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55bc0bf1f0 0x7f55bc0a9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:20.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.644+0000 7f55c36a2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f55bc0c2770 0x7f55bc0a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:20.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.644+0000 7f55c36a2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55bc06ac70 con 0x7f55bc0c2770 2023-10-03T19:19:20.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.644+0000 7f55c36a2640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55bc0c3000 con 0x7f55bc0c14e0 2023-10-03T19:19:20.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.644+0000 7f55c36a2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc0aa5f0 con 0x7f55bc0bf1f0 2023-10-03T19:19:20.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.644+0000 7f55c1c3f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f55bc0c2770 0x7f55bc0a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:20.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.644+0000 7f55c1c3f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f55bc0c2770 0x7f55bc0a9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46258/0 (socket says 172.21.15.45:46258) 2023-10-03T19:19:20.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.644+0000 7f55c1c3f640 1 -- 172.21.15.45:0/2179878097 learned_addr learned my addr 172.21.15.45:0/2179878097 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:20.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.644+0000 7f55c143e640 1 --2- 172.21.15.45:0/2179878097 >> v2:172.21.15.79:3300/0 conn(0x7f55bc0c14e0 0x7f55bc0c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:20.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.644+0000 7f55c0c3d640 1 --2- 172.21.15.45:0/2179878097 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55bc0bf1f0 0x7f55bc0a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:20.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.644+0000 7f55c1c3f640 1 -- 172.21.15.45:0/2179878097 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55bc0bf1f0 msgr2=0x7f55bc0a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:20.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.644+0000 7f55c1c3f640 1 --2- 172.21.15.45:0/2179878097 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55bc0bf1f0 0x7f55bc0a9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.644+0000 7f55c1c3f640 1 -- 172.21.15.45:0/2179878097 >> v2:172.21.15.79:3300/0 conn(0x7f55bc0c14e0 msgr2=0x7f55bc0c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:20.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.644+0000 7f55c1c3f640 1 --2- 172.21.15.45:0/2179878097 >> v2:172.21.15.79:3300/0 conn(0x7f55bc0c14e0 0x7f55bc0c0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.644+0000 7f55c1c3f640 1 -- 172.21.15.45:0/2179878097 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55bc14f250 con 0x7f55bc0c2770 2023-10-03T19:19:20.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.644+0000 7f55c143e640 1 --2- 172.21.15.45:0/2179878097 >> v2:172.21.15.79:3300/0 conn(0x7f55bc0c14e0 0x7f55bc0c0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:19:20.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.648+0000 7f55c1c3f640 1 --2- 172.21.15.45:0/2179878097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55bc0c2770 0x7f55bc0a9da0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f55bc08aaa0 tx=0x7f55b401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=606048b6a10c135b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:20.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.648+0000 7f55affff640 1 -- 172.21.15.45:0/2179878097 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b40a89b0 con 0x7f55bc0c2770 2023-10-03T19:19:20.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.648+0000 7f55affff640 1 -- 172.21.15.45:0/2179878097 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b40a8b10 con 0x7f55bc0c2770 2023-10-03T19:19:20.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.648+0000 7f55affff640 1 -- 172.21.15.45:0/2179878097 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b40a8ea0 con 0x7f55bc0c2770 2023-10-03T19:19:20.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.648+0000 7f55c36a2640 1 -- 172.21.15.45:0/2179878097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55bc0c2770 msgr2=0x7f55bc0a9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:20.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.648+0000 7f55c36a2640 1 --2- 172.21.15.45:0/2179878097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55bc0c2770 0x7f55bc0a9da0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f55bc08aaa0 tx=0x7f55b401ecf0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.648+0000 7f55c36a2640 1 -- 172.21.15.45:0/2179878097 shutdown_connections 2023-10-03T19:19:20.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.648+0000 7f55c36a2640 1 --2- 172.21.15.45:0/2179878097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55bc0c2770 0x7f55bc0a9da0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.648+0000 7f55c36a2640 1 --2- 172.21.15.45:0/2179878097 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55bc0bf1f0 0x7f55bc0a9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.648+0000 7f55c36a2640 1 --2- 172.21.15.45:0/2179878097 >> v2:172.21.15.79:3300/0 conn(0x7f55bc0c14e0 0x7f55bc0c0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.648+0000 7f55c36a2640 1 -- 172.21.15.45:0/2179878097 >> 172.21.15.45:0/2179878097 conn(0x7f55bc0a6440 msgr2=0x7f55bc0a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:20.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.648+0000 7f55c36a2640 1 -- 172.21.15.45:0/2179878097 shutdown_connections 2023-10-03T19:19:20.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.648+0000 7f55c36a2640 1 -- 172.21.15.45:0/2179878097 wait complete. 2023-10-03T19:19:20.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.652+0000 7f55c36a2640 1 Processor -- start 2023-10-03T19:19:20.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.652+0000 7f55c36a2640 1 -- start start 2023-10-03T19:19:20.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.652+0000 7f55c36a2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55bc0bf1f0 0x7f55bc1d4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:20.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.652+0000 7f55c36a2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55bc0c14e0 0x7f55bc1d5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:20.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.652+0000 7f55c36a2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55bc0c2770 0x7f55bc14a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:20.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.652+0000 7f55c36a2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc1d6460 con 0x7f55bc0bf1f0 2023-10-03T19:19:20.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.652+0000 7f55c36a2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc0bb410 con 0x7f55bc0c2770 2023-10-03T19:19:20.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.652+0000 7f55c36a2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc14b570 con 0x7f55bc0c14e0 2023-10-03T19:19:20.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.652+0000 7f55c143e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55bc0bf1f0 0x7f55bc1d4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:20.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.652+0000 7f55c143e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55bc0bf1f0 0x7f55bc1d4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46266/0 (socket says 172.21.15.45:46266) 2023-10-03T19:19:20.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.652+0000 7f55c143e640 1 -- 172.21.15.45:0/376336464 learned_addr learned my addr 172.21.15.45:0/376336464 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:20.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.652+0000 7f55c1c3f640 1 --2- 172.21.15.45:0/376336464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55bc0c2770 0x7f55bc14a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:20.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.652+0000 7f55c0c3d640 1 --2- 172.21.15.45:0/376336464 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55bc0c14e0 0x7f55bc1d5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:20.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.652+0000 7f55c143e640 1 -- 172.21.15.45:0/376336464 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55bc0c14e0 msgr2=0x7f55bc1d5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:20.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.652+0000 7f55c143e640 1 --2- 172.21.15.45:0/376336464 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55bc0c14e0 0x7f55bc1d5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.652+0000 7f55c143e640 1 -- 172.21.15.45:0/376336464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55bc0c2770 msgr2=0x7f55bc14a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:20.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.652+0000 7f55c143e640 1 --2- 172.21.15.45:0/376336464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55bc0c2770 0x7f55bc14a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.652+0000 7f55c143e640 1 -- 172.21.15.45:0/376336464 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b40094d0 con 0x7f55bc0bf1f0 2023-10-03T19:19:20.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.652+0000 7f55c0c3d640 1 --2- 172.21.15.45:0/376336464 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55bc0c14e0 0x7f55bc1d5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:20.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.652+0000 7f55c1c3f640 1 --2- 172.21.15.45:0/376336464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55bc0c2770 0x7f55bc14a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:20.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.652+0000 7f55c143e640 1 --2- 172.21.15.45:0/376336464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55bc0bf1f0 0x7f55bc1d4b10 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f55b000e810 tx=0x7f55b000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:20.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.652+0000 7f55adffb640 1 -- 172.21.15.45:0/376336464 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b000c8d0 con 0x7f55bc0bf1f0 2023-10-03T19:19:20.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.652+0000 7f55adffb640 1 -- 172.21.15.45:0/376336464 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b000ca30 con 0x7f55bc0bf1f0 2023-10-03T19:19:20.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.652+0000 7f55c36a2640 1 -- 172.21.15.45:0/376336464 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55bc06b100 con 0x7f55bc0bf1f0 2023-10-03T19:19:20.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.652+0000 7f55adffb640 1 -- 172.21.15.45:0/376336464 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b000cdc0 con 0x7f55bc0bf1f0 2023-10-03T19:19:20.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.652+0000 7f55c36a2640 1 -- 172.21.15.45:0/376336464 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55bc14f530 con 0x7f55bc0bf1f0 2023-10-03T19:19:20.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.652+0000 7f55c36a2640 1 -- 172.21.15.45:0/376336464 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55bc0aa2e0 con 0x7f55bc0bf1f0 2023-10-03T19:19:20.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.652+0000 7f55adffb640 1 -- 172.21.15.45:0/376336464 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f55b0013410 con 0x7f55bc0bf1f0 2023-10-03T19:19:20.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.656+0000 7f55adffb640 1 --2- 172.21.15.45:0/376336464 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f55a0066280 0x7f55a0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:20.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.656+0000 7f55adffb640 1 -- 172.21.15.45:0/376336464 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f55b0083b30 con 0x7f55bc0bf1f0 2023-10-03T19:19:20.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.656+0000 7f55c0c3d640 1 --2- 172.21.15.45:0/376336464 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f55a0066280 0x7f55a0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:20.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.656+0000 7f55c0c3d640 1 --2- 172.21.15.45:0/376336464 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f55a0066280 0x7f55a0068730 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f55bc14e9a0 tx=0x7f55b800b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:20.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.660+0000 7f55adffb640 1 -- 172.21.15.45:0/376336464 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f55b0050fa0 con 0x7f55bc0bf1f0 2023-10-03T19:19:20.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.808+0000 7f55c36a2640 1 -- 172.21.15.45:0/376336464 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f55bc04de80 con 0x7f55bc0bf1f0 2023-10-03T19:19:20.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.808+0000 7f55adffb640 1 -- 172.21.15.45:0/376336464 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7f55b00545c0 con 0x7f55bc0bf1f0 2023-10-03T19:19:20.812 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-03T19:19:20.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.812+0000 7f55c36a2640 1 -- 172.21.15.45:0/376336464 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f55a0066280 msgr2=0x7f55a0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:20.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.812+0000 7f55c36a2640 1 --2- 172.21.15.45:0/376336464 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f55a0066280 0x7f55a0068730 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f55bc14e9a0 tx=0x7f55b800b040 comp rx=0 tx=0).stop 2023-10-03T19:19:20.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.812+0000 7f55c36a2640 1 -- 172.21.15.45:0/376336464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55bc0bf1f0 msgr2=0x7f55bc1d4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:20.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.812+0000 7f55c36a2640 1 --2- 172.21.15.45:0/376336464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55bc0bf1f0 0x7f55bc1d4b10 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f55b000e810 tx=0x7f55b000ecd0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.812+0000 7f55c36a2640 1 -- 172.21.15.45:0/376336464 shutdown_connections 2023-10-03T19:19:20.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.812+0000 7f55c36a2640 1 --2- 172.21.15.45:0/376336464 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f55a0066280 0x7f55a0068730 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.812+0000 7f55c36a2640 1 --2- 172.21.15.45:0/376336464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55bc0c2770 0x7f55bc14a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.812+0000 7f55c36a2640 1 --2- 172.21.15.45:0/376336464 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55bc0c14e0 0x7f55bc1d5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.812+0000 7f55c36a2640 1 --2- 172.21.15.45:0/376336464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55bc0bf1f0 0x7f55bc1d4b10 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.812+0000 7f55c36a2640 1 -- 172.21.15.45:0/376336464 >> 172.21.15.45:0/376336464 conn(0x7f55bc0a6440 msgr2=0x7f55bc0a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:20.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.812+0000 7f55c36a2640 1 -- 172.21.15.45:0/376336464 shutdown_connections 2023-10-03T19:19:20.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.812+0000 7f55c36a2640 1 -- 172.21.15.45:0/376336464 wait complete. 2023-10-03T19:19:20.830 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T19:19:20.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.944+0000 7f4bf13e5640 1 Processor -- start 2023-10-03T19:19:20.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.948+0000 7f4bf13e5640 1 -- start start 2023-10-03T19:19:20.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.948+0000 7f4bf13e5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4bec0bd860 0x7f4bec1527b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:20.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.948+0000 7f4bf13e5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4bec0bcff0 0x7f4bec152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:20.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.948+0000 7f4bf13e5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bec06a630 con 0x7f4bec069ad0 2023-10-03T19:19:20.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.948+0000 7f4bf13e5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bec0beb70 con 0x7f4bec0bd860 2023-10-03T19:19:20.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.948+0000 7f4bf13e5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec06b8d0 con 0x7f4bec0bcff0 2023-10-03T19:19:20.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.948+0000 7f4beaffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4bec0bd860 0x7f4bec1527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:20.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.948+0000 7f4beaffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4bec0bd860 0x7f4bec1527b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46280/0 (socket says 172.21.15.45:46280) 2023-10-03T19:19:20.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.948+0000 7f4beaffd640 1 -- 172.21.15.45:0/229662061 learned_addr learned my addr 172.21.15.45:0/229662061 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:20.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.948+0000 7f4bea7fc640 1 --2- 172.21.15.45:0/229662061 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4bec0bcff0 0x7f4bec152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:20.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.948+0000 7f4beaffd640 1 -- 172.21.15.45:0/229662061 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4bec0bcff0 msgr2=0x7f4bec152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:20.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.948+0000 7f4beaffd640 1 --2- 172.21.15.45:0/229662061 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4bec0bcff0 0x7f4bec152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.948+0000 7f4beaffd640 1 -- 172.21.15.45:0/229662061 >> v1:172.21.15.45:6789/0 conn(0x7f4bec069ad0 legacy=0x7f4bec069f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:20.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.948+0000 7f4beaffd640 1 -- 172.21.15.45:0/229662061 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bec06b560 con 0x7f4bec0bd860 2023-10-03T19:19:20.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4beaffd640 1 --2- 172.21.15.45:0/229662061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bec0bd860 0x7f4bec1527b0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc009ea0 tx=0x7f4bdc01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0194aa3d88a68d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:20.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4be9ffb640 1 -- 172.21.15.45:0/229662061 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc0a5900 con 0x7f4bec0bd860 2023-10-03T19:19:20.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4be9ffb640 1 -- 172.21.15.45:0/229662061 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bdc0a5a60 con 0x7f4bec0bd860 2023-10-03T19:19:20.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4be9ffb640 1 -- 172.21.15.45:0/229662061 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc0a5df0 con 0x7f4bec0bd860 2023-10-03T19:19:20.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4bf13e5640 1 -- 172.21.15.45:0/229662061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bec0bd860 msgr2=0x7f4bec1527b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:20.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4bf13e5640 1 --2- 172.21.15.45:0/229662061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bec0bd860 0x7f4bec1527b0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc009ea0 tx=0x7f4bdc01ca30 comp rx=0 tx=0).stop 2023-10-03T19:19:20.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4bf13e5640 1 -- 172.21.15.45:0/229662061 shutdown_connections 2023-10-03T19:19:20.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4bf13e5640 1 --2- 172.21.15.45:0/229662061 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4bec0bcff0 0x7f4bec152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4bf13e5640 1 --2- 172.21.15.45:0/229662061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bec0bd860 0x7f4bec1527b0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4bf13e5640 1 -- 172.21.15.45:0/229662061 >> 172.21.15.45:0/229662061 conn(0x7f4bec071060 msgr2=0x7f4bec071460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:20.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4bf13e5640 1 -- 172.21.15.45:0/229662061 shutdown_connections 2023-10-03T19:19:20.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4bf13e5640 1 -- 172.21.15.45:0/229662061 wait complete. 2023-10-03T19:19:20.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4bf13e5640 1 Processor -- start 2023-10-03T19:19:20.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4bf13e5640 1 -- start start 2023-10-03T19:19:20.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4bf13e5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4bec069ad0 0x7f4bec0b8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:20.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4bf13e5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bec0bcff0 0x7f4bec1519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:20.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4bf13e5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bec0bd860 0x7f4bec1501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:20.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4bf13e5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec0b86b0 con 0x7f4bec0bd860 2023-10-03T19:19:20.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4bf13e5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec0b61a0 con 0x7f4bec0bcff0 2023-10-03T19:19:20.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4bf13e5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec14b380 con 0x7f4bec069ad0 2023-10-03T19:19:20.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4beb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bec0bd860 0x7f4bec1501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:20.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4beb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bec0bd860 0x7f4bec1501e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46292/0 (socket says 172.21.15.45:46292) 2023-10-03T19:19:20.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4beb7fe640 1 -- 172.21.15.45:0/89823141 learned_addr learned my addr 172.21.15.45:0/89823141 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:20.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4beaffd640 1 --2- 172.21.15.45:0/89823141 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4bec069ad0 0x7f4bec0b8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:20.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4bea7fc640 1 --2- 172.21.15.45:0/89823141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bec0bcff0 0x7f4bec1519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:20.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4beb7fe640 1 -- 172.21.15.45:0/89823141 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4bec069ad0 msgr2=0x7f4bec0b8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:20.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4beb7fe640 1 --2- 172.21.15.45:0/89823141 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4bec069ad0 0x7f4bec0b8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4beb7fe640 1 -- 172.21.15.45:0/89823141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bec0bcff0 msgr2=0x7f4bec1519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:20.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4beb7fe640 1 --2- 172.21.15.45:0/89823141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bec0bcff0 0x7f4bec1519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:20.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4beb7fe640 1 -- 172.21.15.45:0/89823141 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bdc009b30 con 0x7f4bec0bd860 2023-10-03T19:19:20.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4beaffd640 1 --2- 172.21.15.45:0/89823141 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4bec069ad0 0x7f4bec0b8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:19:20.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.952+0000 7f4beb7fe640 1 --2- 172.21.15.45:0/89823141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bec0bd860 0x7f4bec1501e0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f4be400c460 tx=0x7f4be400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:20.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.956+0000 7f4bd37fe640 1 -- 172.21.15.45:0/89823141 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be4005220 con 0x7f4bec0bd860 2023-10-03T19:19:20.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.956+0000 7f4bd37fe640 1 -- 172.21.15.45:0/89823141 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be4005380 con 0x7f4bec0bd860 2023-10-03T19:19:20.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.956+0000 7f4bd37fe640 1 -- 172.21.15.45:0/89823141 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be4007270 con 0x7f4bec0bd860 2023-10-03T19:19:20.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.956+0000 7f4bf13e5640 1 -- 172.21.15.45:0/89823141 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bec0be800 con 0x7f4bec0bd860 2023-10-03T19:19:20.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.956+0000 7f4bf13e5640 1 -- 172.21.15.45:0/89823141 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bec1521a0 con 0x7f4bec0bd860 2023-10-03T19:19:20.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.956+0000 7f4bf13e5640 1 -- 172.21.15.45:0/89823141 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bec071b70 con 0x7f4bec0bd860 2023-10-03T19:19:20.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.956+0000 7f4bd37fe640 1 -- 172.21.15.45:0/89823141 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4be40073d0 con 0x7f4bec0bd860 2023-10-03T19:19:20.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.956+0000 7f4bd37fe640 1 --2- 172.21.15.45:0/89823141 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4bd8066280 0x7f4bd8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:20.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.956+0000 7f4bd37fe640 1 -- 172.21.15.45:0/89823141 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f4be4083720 con 0x7f4bec0bd860 2023-10-03T19:19:20.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.956+0000 7f4beaffd640 1 --2- 172.21.15.45:0/89823141 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4bd8066280 0x7f4bd8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:20.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.956+0000 7f4beaffd640 1 --2- 172.21.15.45:0/89823141 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4bd8066280 0x7f4bd8068730 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc0ae000 tx=0x7f4bdc0a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:20.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:20.960+0000 7f4bd37fe640 1 -- 172.21.15.45:0/89823141 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4be4050a60 con 0x7f4bec0bd860 2023-10-03T19:19:21.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.112+0000 7f4bf13e5640 1 -- 172.21.15.45:0/89823141 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4bec04de80 con 0x7f4bec0bd860 2023-10-03T19:19:21.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.116+0000 7f4bd37fe640 1 -- 172.21.15.45:0/89823141 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4be4054080 con 0x7f4bec0bd860 2023-10-03T19:19:21.118 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-03T19:19:21.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.116+0000 7f4bf13e5640 1 -- 172.21.15.45:0/89823141 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4bd8066280 msgr2=0x7f4bd8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:21.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.116+0000 7f4bf13e5640 1 --2- 172.21.15.45:0/89823141 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4bd8066280 0x7f4bd8068730 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc0ae000 tx=0x7f4bdc0a7070 comp rx=0 tx=0).stop 2023-10-03T19:19:21.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.116+0000 7f4bf13e5640 1 -- 172.21.15.45:0/89823141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bec0bd860 msgr2=0x7f4bec1501e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:21.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.116+0000 7f4bf13e5640 1 --2- 172.21.15.45:0/89823141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bec0bd860 0x7f4bec1501e0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f4be400c460 tx=0x7f4be400c920 comp rx=0 tx=0).stop 2023-10-03T19:19:21.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.116+0000 7f4bf13e5640 1 -- 172.21.15.45:0/89823141 shutdown_connections 2023-10-03T19:19:21.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.116+0000 7f4bf13e5640 1 --2- 172.21.15.45:0/89823141 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4bd8066280 0x7f4bd8068730 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:21.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.116+0000 7f4bf13e5640 1 --2- 172.21.15.45:0/89823141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bec0bd860 0x7f4bec1501e0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:21.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.116+0000 7f4bf13e5640 1 --2- 172.21.15.45:0/89823141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bec0bcff0 0x7f4bec1519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:21.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.116+0000 7f4bf13e5640 1 --2- 172.21.15.45:0/89823141 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4bec069ad0 0x7f4bec0b8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:21.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.116+0000 7f4bf13e5640 1 -- 172.21.15.45:0/89823141 >> 172.21.15.45:0/89823141 conn(0x7f4bec071060 msgr2=0x7f4bec0c25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:21.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.116+0000 7f4bf13e5640 1 -- 172.21.15.45:0/89823141 shutdown_connections 2023-10-03T19:19:21.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.116+0000 7f4bf13e5640 1 -- 172.21.15.45:0/89823141 wait complete. 2023-10-03T19:19:21.137 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-03T19:19:21.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.248+0000 7f8384577640 1 Processor -- start 2023-10-03T19:19:21.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.248+0000 7f8384577640 1 -- start start 2023-10-03T19:19:21.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.248+0000 7f8384577640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f837c06f170 0x7f837c150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:21.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.248+0000 7f8384577640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f837c0bc8b0 0x7f837c14ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:21.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.248+0000 7f8384577640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f837c06cac0 con 0x7f837c06d170 2023-10-03T19:19:21.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.248+0000 7f8384577640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f837c0720d0 con 0x7f837c06f170 2023-10-03T19:19:21.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.248+0000 7f8384577640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837c0a5ab0 con 0x7f837c0bc8b0 2023-10-03T19:19:21.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.248+0000 7f8382313640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f837c06f170 0x7f837c150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:21.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.248+0000 7f8382313640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f837c06f170 0x7f837c150190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46308/0 (socket says 172.21.15.45:46308) 2023-10-03T19:19:21.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.248+0000 7f8382313640 1 -- 172.21.15.45:0/3341898531 learned_addr learned my addr 172.21.15.45:0/3341898531 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:21.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.248+0000 7f8381b12640 1 --2- 172.21.15.45:0/3341898531 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f837c0bc8b0 0x7f837c14ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:21.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.248+0000 7f8382313640 1 -- 172.21.15.45:0/3341898531 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f837c0bc8b0 msgr2=0x7f837c14ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:21.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.248+0000 7f8382313640 1 --2- 172.21.15.45:0/3341898531 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f837c0bc8b0 0x7f837c14ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:21.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.248+0000 7f8382313640 1 -- 172.21.15.45:0/3341898531 >> v1:172.21.15.79:6789/0 conn(0x7f837c06d170 legacy=0x7f837c14cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:21.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.248+0000 7f8382313640 1 -- 172.21.15.45:0/3341898531 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c06cd00 con 0x7f837c06f170 2023-10-03T19:19:21.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.252+0000 7f8382313640 1 --2- 172.21.15.45:0/3341898531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f837c06f170 0x7f837c150190 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f8378009870 tx=0x7f837801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=679b13dece004c55 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:21.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.252+0000 7f8381311640 1 -- 172.21.15.45:0/3341898531 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83780a8a30 con 0x7f837c06f170 2023-10-03T19:19:21.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.252+0000 7f8381311640 1 -- 172.21.15.45:0/3341898531 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83780a8b90 con 0x7f837c06f170 2023-10-03T19:19:21.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.252+0000 7f8381311640 1 -- 172.21.15.45:0/3341898531 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83780b0440 con 0x7f837c06f170 2023-10-03T19:19:21.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.252+0000 7f8384577640 1 -- 172.21.15.45:0/3341898531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f837c06f170 msgr2=0x7f837c150190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:21.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.252+0000 7f8384577640 1 --2- 172.21.15.45:0/3341898531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f837c06f170 0x7f837c150190 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f8378009870 tx=0x7f837801ed30 comp rx=0 tx=0).stop 2023-10-03T19:19:21.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.252+0000 7f8384577640 1 -- 172.21.15.45:0/3341898531 shutdown_connections 2023-10-03T19:19:21.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.252+0000 7f8384577640 1 --2- 172.21.15.45:0/3341898531 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f837c0bc8b0 0x7f837c14ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:21.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.252+0000 7f8384577640 1 --2- 172.21.15.45:0/3341898531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f837c06f170 0x7f837c150190 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:21.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.252+0000 7f8384577640 1 -- 172.21.15.45:0/3341898531 >> 172.21.15.45:0/3341898531 conn(0x7f837c0bcf50 msgr2=0x7f837c0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:21.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.252+0000 7f8384577640 1 -- 172.21.15.45:0/3341898531 shutdown_connections 2023-10-03T19:19:21.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.252+0000 7f8384577640 1 -- 172.21.15.45:0/3341898531 wait complete. 2023-10-03T19:19:21.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.252+0000 7f8384577640 1 Processor -- start 2023-10-03T19:19:21.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.252+0000 7f8384577640 1 -- start start 2023-10-03T19:19:21.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.256+0000 7f8384577640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f837c06d170 0x7f837c149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:21.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.256+0000 7f8384577640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f837c0bc8b0 0x7f837c144270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:21.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.256+0000 7f8384577640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f837c149e60 0x7f837c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:21.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.256+0000 7f8384577640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c148620 con 0x7f837c0bc8b0 2023-10-03T19:19:21.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.256+0000 7f8384577640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c0a4940 con 0x7f837c149e60 2023-10-03T19:19:21.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.256+0000 7f8384577640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837c1e4650 con 0x7f837c06d170 2023-10-03T19:19:21.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.256+0000 7f8381b12640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f837c0bc8b0 0x7f837c144270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:21.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.256+0000 7f8381b12640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f837c0bc8b0 0x7f837c144270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46310/0 (socket says 172.21.15.45:46310) 2023-10-03T19:19:21.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.256+0000 7f8381b12640 1 -- 172.21.15.45:0/4182663994 learned_addr learned my addr 172.21.15.45:0/4182663994 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:21.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.256+0000 7f8382313640 1 --2- 172.21.15.45:0/4182663994 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f837c06d170 0x7f837c149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:21.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.256+0000 7f8382b14640 1 --2- 172.21.15.45:0/4182663994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f837c149e60 0x7f837c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:21.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.256+0000 7f8381b12640 1 -- 172.21.15.45:0/4182663994 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f837c06d170 msgr2=0x7f837c149920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:21.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.256+0000 7f8381b12640 1 --2- 172.21.15.45:0/4182663994 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f837c06d170 0x7f837c149920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:21.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.256+0000 7f8381b12640 1 -- 172.21.15.45:0/4182663994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f837c149e60 msgr2=0x7f837c0a3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:21.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.256+0000 7f8381b12640 1 --2- 172.21.15.45:0/4182663994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f837c149e60 0x7f837c0a3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:21.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.256+0000 7f8381b12640 1 -- 172.21.15.45:0/4182663994 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83780094d0 con 0x7f837c0bc8b0 2023-10-03T19:19:21.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.256+0000 7f8381b12640 1 --2- 172.21.15.45:0/4182663994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f837c0bc8b0 0x7f837c144270 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f836c00d5f0 tx=0x7f836c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:21.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.256+0000 7f8372ffd640 1 -- 172.21.15.45:0/4182663994 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c0125f0 con 0x7f837c0bc8b0 2023-10-03T19:19:21.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.256+0000 7f8372ffd640 1 -- 172.21.15.45:0/4182663994 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836c012750 con 0x7f837c0bc8b0 2023-10-03T19:19:21.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.256+0000 7f8372ffd640 1 -- 172.21.15.45:0/4182663994 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c012b00 con 0x7f837c0bc8b0 2023-10-03T19:19:21.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.256+0000 7f8384577640 1 -- 172.21.15.45:0/4182663994 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837c14c4a0 con 0x7f837c0bc8b0 2023-10-03T19:19:21.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.256+0000 7f8384577640 1 -- 172.21.15.45:0/4182663994 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837c14fae0 con 0x7f837c0bc8b0 2023-10-03T19:19:21.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.256+0000 7f8384577640 1 -- 172.21.15.45:0/4182663994 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f837c06f540 con 0x7f837c0bc8b0 2023-10-03T19:19:21.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.256+0000 7f8372ffd640 1 -- 172.21.15.45:0/4182663994 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f836c012c60 con 0x7f837c0bc8b0 2023-10-03T19:19:21.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.256+0000 7f8372ffd640 1 --2- 172.21.15.45:0/4182663994 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f83600662b0 0x7f8360068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:21.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.256+0000 7f8372ffd640 1 -- 172.21.15.45:0/4182663994 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f836c084390 con 0x7f837c0bc8b0 2023-10-03T19:19:21.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.256+0000 7f8382313640 1 --2- 172.21.15.45:0/4182663994 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f83600662b0 0x7f8360068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:21.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.256+0000 7f8382313640 1 --2- 172.21.15.45:0/4182663994 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f83600662b0 0x7f8360068760 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f83780b2000 tx=0x7f8378008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:21.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.260+0000 7f8372ffd640 1 -- 172.21.15.45:0/4182663994 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f836c0516e0 con 0x7f837c0bc8b0 2023-10-03T19:19:21.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.420+0000 7f8384577640 1 -- 172.21.15.45:0/4182663994 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f837c06d660 con 0x7f837c0bc8b0 2023-10-03T19:19:21.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.424+0000 7f8372ffd640 1 -- 172.21.15.45:0/4182663994 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v87) v1 ==== 80+0+59 (secure 0 0 0) 0x7f836c054d00 con 0x7f837c0bc8b0 2023-10-03T19:19:21.426 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.146:0/2938203609 2023-10-03T20:19:12.888501+0000 2023-10-03T19:19:21.426 INFO:teuthology.orchestra.run.smithi045.stderr:listed 1 entries 2023-10-03T19:19:21.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.424+0000 7f8384577640 1 -- 172.21.15.45:0/4182663994 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f83600662b0 msgr2=0x7f8360068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:21.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.424+0000 7f8384577640 1 --2- 172.21.15.45:0/4182663994 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f83600662b0 0x7f8360068760 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f83780b2000 tx=0x7f8378008040 comp rx=0 tx=0).stop 2023-10-03T19:19:21.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.424+0000 7f8384577640 1 -- 172.21.15.45:0/4182663994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f837c0bc8b0 msgr2=0x7f837c144270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:21.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.424+0000 7f8384577640 1 --2- 172.21.15.45:0/4182663994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f837c0bc8b0 0x7f837c144270 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f836c00d5f0 tx=0x7f836c00dab0 comp rx=0 tx=0).stop 2023-10-03T19:19:21.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.424+0000 7f8384577640 1 -- 172.21.15.45:0/4182663994 shutdown_connections 2023-10-03T19:19:21.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.424+0000 7f8384577640 1 --2- 172.21.15.45:0/4182663994 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f83600662b0 0x7f8360068760 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:21.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.424+0000 7f8384577640 1 --2- 172.21.15.45:0/4182663994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f837c149e60 0x7f837c0a3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:21.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.424+0000 7f8384577640 1 --2- 172.21.15.45:0/4182663994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f837c0bc8b0 0x7f837c144270 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:21.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.424+0000 7f8384577640 1 --2- 172.21.15.45:0/4182663994 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f837c06d170 0x7f837c149920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:21.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.424+0000 7f8384577640 1 -- 172.21.15.45:0/4182663994 >> 172.21.15.45:0/4182663994 conn(0x7f837c0bcf50 msgr2=0x7f837c0bf570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:21.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.424+0000 7f8384577640 1 -- 172.21.15.45:0/4182663994 shutdown_connections 2023-10-03T19:19:21.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.424+0000 7f8384577640 1 -- 172.21.15.45:0/4182663994 wait complete. 2023-10-03T19:19:21.443 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-10-03T19:19:21.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:21.443 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-10-03T19:19:21.467 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[33814]: fuse finished with error 0 and tester_r 0 2023-10-03T19:19:21.469 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-03T19:19:21.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:21.469 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-03T19:19:21.534 INFO:tasks.cephfs.mount:Terminating background process 2023-10-03T19:19:21.535 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-03T19:19:21.535 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:19:21.541 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:19:21.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.664+0000 7f3e3ba4e640 1 Processor -- start 2023-10-03T19:19:21.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.664+0000 7f3e3ba4e640 1 -- start start 2023-10-03T19:19:21.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.664+0000 7f3e3ba4e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3e340bcb60 0x7f3e3406c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:21.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.664+0000 7f3e3ba4e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e3414b610 con 0x7f3e34148b90 2023-10-03T19:19:21.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.664+0000 7f3e3ba4e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e340a5580 con 0x7f3e3406c7d0 2023-10-03T19:19:21.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.664+0000 7f3e3ba4e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e340a3670 con 0x7f3e340bcb60 2023-10-03T19:19:21.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.664+0000 7f3e38fe9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3e340bcb60 0x7f3e3406c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:21.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.664+0000 7f3e38fe9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3e340bcb60 0x7f3e3406c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46314/0 (socket says 172.21.15.45:46314) 2023-10-03T19:19:21.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.664+0000 7f3e38fe9640 1 -- 172.21.15.45:0/4057476655 learned_addr learned my addr 172.21.15.45:0/4057476655 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:21.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.664+0000 7f3e38fe9640 1 -- 172.21.15.45:0/4057476655 >> v1:172.21.15.79:6789/0 conn(0x7f3e3406c7d0 legacy=0x7f3e34155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:21.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.664+0000 7f3e38fe9640 1 -- 172.21.15.45:0/4057476655 >> v1:172.21.15.45:6789/0 conn(0x7f3e34148b90 legacy=0x7f3e340bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:21.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.664+0000 7f3e2bfff640 1 -- 172.21.15.45:0/4057476655 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 493378903 0 0) 0x7f3e3414b610 con 0x7f3e34148b90 2023-10-03T19:19:21.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.664+0000 7f3e38fe9640 1 -- 172.21.15.45:0/4057476655 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e340a5820 con 0x7f3e340bcb60 2023-10-03T19:19:21.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.668+0000 7f3e38fe9640 1 --2- 172.21.15.45:0/4057476655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e340bcb60 0x7f3e3406c290 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f3e24009870 tx=0x7f3e2401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4294e5c370dc8d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:21.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.668+0000 7f3e2bfff640 1 -- 172.21.15.45:0/4057476655 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e240a89f0 con 0x7f3e340bcb60 2023-10-03T19:19:21.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.668+0000 7f3e2bfff640 1 -- 172.21.15.45:0/4057476655 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e240a8b50 con 0x7f3e340bcb60 2023-10-03T19:19:21.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.668+0000 7f3e2bfff640 1 -- 172.21.15.45:0/4057476655 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e240b0440 con 0x7f3e340bcb60 2023-10-03T19:19:21.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.668+0000 7f3e3ba4e640 1 -- 172.21.15.45:0/4057476655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e340bcb60 msgr2=0x7f3e3406c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:21.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.668+0000 7f3e3ba4e640 1 --2- 172.21.15.45:0/4057476655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e340bcb60 0x7f3e3406c290 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f3e24009870 tx=0x7f3e2401ecf0 comp rx=0 tx=0).stop 2023-10-03T19:19:21.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.668+0000 7f3e3ba4e640 1 -- 172.21.15.45:0/4057476655 shutdown_connections 2023-10-03T19:19:21.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.668+0000 7f3e3ba4e640 1 --2- 172.21.15.45:0/4057476655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e340bcb60 0x7f3e3406c290 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:21.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.668+0000 7f3e3ba4e640 1 -- 172.21.15.45:0/4057476655 >> 172.21.15.45:0/4057476655 conn(0x7f3e340bcf50 msgr2=0x7f3e340bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:21.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.668+0000 7f3e3ba4e640 1 -- 172.21.15.45:0/4057476655 shutdown_connections 2023-10-03T19:19:21.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.668+0000 7f3e3ba4e640 1 -- 172.21.15.45:0/4057476655 wait complete. 2023-10-03T19:19:21.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.672+0000 7f3e3ba4e640 1 Processor -- start 2023-10-03T19:19:21.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.672+0000 7f3e3ba4e640 1 -- start start 2023-10-03T19:19:21.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.672+0000 7f3e3ba4e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e3406c7d0 0x7f3e340b5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:21.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.672+0000 7f3e3ba4e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e340bcb60 0x7f3e341e5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:21.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.672+0000 7f3e3ba4e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3e34148b90 0x7f3e340b9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:21.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.672+0000 7f3e3ba4e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e340b6770 con 0x7f3e3406c7d0 2023-10-03T19:19:21.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.672+0000 7f3e3ba4e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3414f2b0 con 0x7f3e340bcb60 2023-10-03T19:19:21.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.672+0000 7f3e3ba4e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e340b6420 con 0x7f3e34148b90 2023-10-03T19:19:21.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.672+0000 7f3e397ea640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e3406c7d0 0x7f3e340b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:21.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.672+0000 7f3e397ea640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e3406c7d0 0x7f3e340b5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46326/0 (socket says 172.21.15.45:46326) 2023-10-03T19:19:21.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.672+0000 7f3e397ea640 1 -- 172.21.15.45:0/1907914957 learned_addr learned my addr 172.21.15.45:0/1907914957 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:21.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.672+0000 7f3e38fe9640 1 --2- 172.21.15.45:0/1907914957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e340bcb60 0x7f3e341e5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:21.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.672+0000 7f3e39feb640 1 --2- 172.21.15.45:0/1907914957 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3e34148b90 0x7f3e340b9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:21.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.672+0000 7f3e397ea640 1 -- 172.21.15.45:0/1907914957 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3e34148b90 msgr2=0x7f3e340b9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:21.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.672+0000 7f3e397ea640 1 --2- 172.21.15.45:0/1907914957 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3e34148b90 0x7f3e340b9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:21.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.672+0000 7f3e397ea640 1 -- 172.21.15.45:0/1907914957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e340bcb60 msgr2=0x7f3e341e5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:21.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.672+0000 7f3e397ea640 1 --2- 172.21.15.45:0/1907914957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e340bcb60 0x7f3e341e5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:21.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.672+0000 7f3e397ea640 1 -- 172.21.15.45:0/1907914957 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e240094d0 con 0x7f3e3406c7d0 2023-10-03T19:19:21.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.672+0000 7f3e39feb640 1 --2- 172.21.15.45:0/1907914957 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3e34148b90 0x7f3e340b9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:21.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.672+0000 7f3e38fe9640 1 --2- 172.21.15.45:0/1907914957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e340bcb60 0x7f3e341e5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:21.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.672+0000 7f3e397ea640 1 --2- 172.21.15.45:0/1907914957 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e3406c7d0 0x7f3e340b5840 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f3e30001ec0 tx=0x7f3e3000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:21.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.672+0000 7f3e29ffb640 1 -- 172.21.15.45:0/1907914957 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e300054e0 con 0x7f3e3406c7d0 2023-10-03T19:19:21.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.672+0000 7f3e29ffb640 1 -- 172.21.15.45:0/1907914957 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e30003600 con 0x7f3e3406c7d0 2023-10-03T19:19:21.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.672+0000 7f3e29ffb640 1 -- 172.21.15.45:0/1907914957 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e300039b0 con 0x7f3e3406c7d0 2023-10-03T19:19:21.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.672+0000 7f3e3ba4e640 1 -- 172.21.15.45:0/1907914957 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e34148f60 con 0x7f3e3406c7d0 2023-10-03T19:19:21.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.672+0000 7f3e3ba4e640 1 -- 172.21.15.45:0/1907914957 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e340bc670 con 0x7f3e3406c7d0 2023-10-03T19:19:21.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.672+0000 7f3e3ba4e640 1 -- 172.21.15.45:0/1907914957 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e340a3880 con 0x7f3e3406c7d0 2023-10-03T19:19:21.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.672+0000 7f3e29ffb640 1 -- 172.21.15.45:0/1907914957 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3e30003b10 con 0x7f3e3406c7d0 2023-10-03T19:19:21.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.676+0000 7f3e29ffb640 1 --2- 172.21.15.45:0/1907914957 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3e18066280 0x7f3e18068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:21.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.676+0000 7f3e29ffb640 1 -- 172.21.15.45:0/1907914957 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f3e300833f0 con 0x7f3e3406c7d0 2023-10-03T19:19:21.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.676+0000 7f3e38fe9640 1 --2- 172.21.15.45:0/1907914957 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3e18066280 0x7f3e18068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:21.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.676+0000 7f3e38fe9640 1 --2- 172.21.15.45:0/1907914957 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3e18066280 0x7f3e18068730 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3e240b2000 tx=0x7f3e24008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:21.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.680+0000 7f3e29ffb640 1 -- 172.21.15.45:0/1907914957 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3e300507c0 con 0x7f3e3406c7d0 2023-10-03T19:19:21.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.840+0000 7f3e3ba4e640 1 -- 172.21.15.45:0/1907914957 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e340b68b0 con 0x7f3e3406c7d0 2023-10-03T19:19:21.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.840+0000 7f3e29ffb640 1 -- 172.21.15.45:0/1907914957 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+18501 (secure 0 0 0) 0x7f3e30053de0 con 0x7f3e3406c7d0 2023-10-03T19:19:21.844 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:19:21.845 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":87,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:19:14.804643+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:18:25.942883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-10-03T19:18:27.242940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.2","mappings":[{"from":1,"to":2}]},{"pgid":"14.26","mappings":[{"from":1,"to":7}]},{"pgid":"14.29","mappings":[{"from":1,"to":7}]},{"pgid":"14.32","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:0/2938203609":"2023-10-03T20:19:12.888501+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:19:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.844+0000 7f3e3ba4e640 1 -- 172.21.15.45:0/1907914957 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3e18066280 msgr2=0x7f3e18068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.844+0000 7f3e3ba4e640 1 --2- 172.21.15.45:0/1907914957 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3e18066280 0x7f3e18068730 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3e240b2000 tx=0x7f3e24008040 comp rx=0 tx=0).stop 2023-10-03T19:19:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.844+0000 7f3e3ba4e640 1 -- 172.21.15.45:0/1907914957 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e3406c7d0 msgr2=0x7f3e340b5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.844+0000 7f3e3ba4e640 1 --2- 172.21.15.45:0/1907914957 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e3406c7d0 0x7f3e340b5840 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f3e30001ec0 tx=0x7f3e3000c8e0 comp rx=0 tx=0).stop 2023-10-03T19:19:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.844+0000 7f3e3ba4e640 1 -- 172.21.15.45:0/1907914957 shutdown_connections 2023-10-03T19:19:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.844+0000 7f3e3ba4e640 1 --2- 172.21.15.45:0/1907914957 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3e18066280 0x7f3e18068730 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.844+0000 7f3e3ba4e640 1 --2- 172.21.15.45:0/1907914957 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3e34148b90 0x7f3e340b9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.844+0000 7f3e3ba4e640 1 --2- 172.21.15.45:0/1907914957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e340bcb60 0x7f3e341e5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.844+0000 7f3e3ba4e640 1 --2- 172.21.15.45:0/1907914957 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e3406c7d0 0x7f3e340b5840 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.844+0000 7f3e3ba4e640 1 -- 172.21.15.45:0/1907914957 >> 172.21.15.45:0/1907914957 conn(0x7f3e340bcf50 msgr2=0x7f3e340bf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:21.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.844+0000 7f3e3ba4e640 1 -- 172.21.15.45:0/1907914957 shutdown_connections 2023-10-03T19:19:21.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.844+0000 7f3e3ba4e640 1 -- 172.21.15.45:0/1907914957 wait complete. 2023-10-03T19:19:21.863 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T19:18:25.942883+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T19:18:27.242940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:19:21.864 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:19:21.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.984+0000 7f2702633640 1 Processor -- start 2023-10-03T19:19:21.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.984+0000 7f2702633640 1 -- start start 2023-10-03T19:19:21.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.984+0000 7f2702633640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26fc0712c0 0x7f26fc0bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:21.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.984+0000 7f2702633640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f26fc06d560 0x7f26fc0bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:21.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.984+0000 7f2702633640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f26fc06c760 0x7f26fc0a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:21.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.984+0000 7f2702633640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26fc06c2d0 con 0x7f26fc06d560 2023-10-03T19:19:21.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.984+0000 7f2702633640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26fc150610 con 0x7f26fc06c760 2023-10-03T19:19:21.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.984+0000 7f2702633640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc1508b0 con 0x7f26fc0712c0 2023-10-03T19:19:21.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.984+0000 7f26fb7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f26fc06d560 0x7f26fc0bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:21.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.984+0000 7f26fb7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f26fc06d560 0x7f26fc0bd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46340/0 (socket says 172.21.15.45:46340) 2023-10-03T19:19:21.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.984+0000 7f26fb7fe640 1 -- 172.21.15.45:0/431823964 learned_addr learned my addr 172.21.15.45:0/431823964 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:21.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.984+0000 7f26fbfff640 1 --2- 172.21.15.45:0/431823964 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26fc0712c0 0x7f26fc0bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:21.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.984+0000 7f2700bd0640 1 --2- 172.21.15.45:0/431823964 >> v2:172.21.15.79:3300/0 conn(0x7f26fc06c760 0x7f26fc0a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:21.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.984+0000 7f26fb7fe640 1 -- 172.21.15.45:0/431823964 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26fc0712c0 msgr2=0x7f26fc0bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:21.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.984+0000 7f26fb7fe640 1 --2- 172.21.15.45:0/431823964 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26fc0712c0 0x7f26fc0bcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:21.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.984+0000 7f26fb7fe640 1 -- 172.21.15.45:0/431823964 >> v2:172.21.15.79:3300/0 conn(0x7f26fc06c760 msgr2=0x7f26fc0a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:21.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.984+0000 7f26fb7fe640 1 --2- 172.21.15.45:0/431823964 >> v2:172.21.15.79:3300/0 conn(0x7f26fc06c760 0x7f26fc0a53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:21.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.984+0000 7f26fb7fe640 1 -- 172.21.15.45:0/431823964 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26fc06d2e0 con 0x7f26fc06d560 2023-10-03T19:19:21.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f26fb7fe640 1 --2- 172.21.15.45:0/431823964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26fc06d560 0x7f26fc0bd100 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f26fc06afd0 tx=0x7f26f001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=748321e7c84344d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:21.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f26faffd640 1 -- 172.21.15.45:0/431823964 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f00ab600 con 0x7f26fc06d560 2023-10-03T19:19:21.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f26faffd640 1 -- 172.21.15.45:0/431823964 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f00ab760 con 0x7f26fc06d560 2023-10-03T19:19:21.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f26faffd640 1 -- 172.21.15.45:0/431823964 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f00abaf0 con 0x7f26fc06d560 2023-10-03T19:19:21.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f2702633640 1 -- 172.21.15.45:0/431823964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26fc06d560 msgr2=0x7f26fc0bd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:21.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f2702633640 1 --2- 172.21.15.45:0/431823964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26fc06d560 0x7f26fc0bd100 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f26fc06afd0 tx=0x7f26f001c500 comp rx=0 tx=0).stop 2023-10-03T19:19:21.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f2702633640 1 -- 172.21.15.45:0/431823964 shutdown_connections 2023-10-03T19:19:21.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f2702633640 1 --2- 172.21.15.45:0/431823964 >> v2:172.21.15.79:3300/0 conn(0x7f26fc06c760 0x7f26fc0a53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:21.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f2702633640 1 --2- 172.21.15.45:0/431823964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26fc06d560 0x7f26fc0bd100 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:21.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f2702633640 1 --2- 172.21.15.45:0/431823964 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26fc0712c0 0x7f26fc0bcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:21.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f2702633640 1 -- 172.21.15.45:0/431823964 >> 172.21.15.45:0/431823964 conn(0x7f26fc0a20d0 msgr2=0x7f26fc0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:21.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f2702633640 1 -- 172.21.15.45:0/431823964 shutdown_connections 2023-10-03T19:19:21.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f2702633640 1 -- 172.21.15.45:0/431823964 wait complete. 2023-10-03T19:19:21.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f2702633640 1 Processor -- start 2023-10-03T19:19:21.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f2702633640 1 -- start start 2023-10-03T19:19:21.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f2702633640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26fc06c760 0x7f26fc144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:21.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f2702633640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26fc06d560 0x7f26fc141bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:21.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f2702633640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26fc0712c0 0x7f26fc1420f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:21.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f2702633640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc0c0250 con 0x7f26fc06c760 2023-10-03T19:19:21.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f2702633640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc0bfae0 con 0x7f26fc0712c0 2023-10-03T19:19:21.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f2702633640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc14e6e0 con 0x7f26fc06d560 2023-10-03T19:19:21.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f26fbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26fc06c760 0x7f26fc144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:21.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f26fbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26fc06c760 0x7f26fc144ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46356/0 (socket says 172.21.15.45:46356) 2023-10-03T19:19:21.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f26fbfff640 1 -- 172.21.15.45:0/392861665 learned_addr learned my addr 172.21.15.45:0/392861665 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:21.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f26fb7fe640 1 --2- 172.21.15.45:0/392861665 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26fc06d560 0x7f26fc141bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:21.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f2700bd0640 1 --2- 172.21.15.45:0/392861665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26fc0712c0 0x7f26fc1420f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:21.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f26fbfff640 1 -- 172.21.15.45:0/392861665 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26fc06d560 msgr2=0x7f26fc141bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:21.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f26fbfff640 1 --2- 172.21.15.45:0/392861665 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26fc06d560 0x7f26fc141bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:21.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f26fbfff640 1 -- 172.21.15.45:0/392861665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26fc0712c0 msgr2=0x7f26fc1420f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:21.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f26fbfff640 1 --2- 172.21.15.45:0/392861665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26fc0712c0 0x7f26fc1420f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:21.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f26fbfff640 1 -- 172.21.15.45:0/392861665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f00094d0 con 0x7f26fc06c760 2023-10-03T19:19:21.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f2700bd0640 1 --2- 172.21.15.45:0/392861665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26fc0712c0 0x7f26fc1420f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:21.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.988+0000 7f26fbfff640 1 --2- 172.21.15.45:0/392861665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26fc06c760 0x7f26fc144ef0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f26ec00e870 tx=0x7f26ec00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:21.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.992+0000 7f26f8ff9640 1 -- 172.21.15.45:0/392861665 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ec009510 con 0x7f26fc06c760 2023-10-03T19:19:21.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.992+0000 7f26f8ff9640 1 -- 172.21.15.45:0/392861665 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ec00eec0 con 0x7f26fc06c760 2023-10-03T19:19:21.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.992+0000 7f26f8ff9640 1 -- 172.21.15.45:0/392861665 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ec00cb40 con 0x7f26fc06c760 2023-10-03T19:19:21.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.992+0000 7f2702633640 1 -- 172.21.15.45:0/392861665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26fc14c780 con 0x7f26fc06c760 2023-10-03T19:19:21.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.992+0000 7f2702633640 1 -- 172.21.15.45:0/392861665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26fc14c5f0 con 0x7f26fc06c760 2023-10-03T19:19:21.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.992+0000 7f2702633640 1 -- 172.21.15.45:0/392861665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26fc14c910 con 0x7f26fc06c760 2023-10-03T19:19:21.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.992+0000 7f26f8ff9640 1 -- 172.21.15.45:0/392861665 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f26ec00cca0 con 0x7f26fc06c760 2023-10-03T19:19:21.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.992+0000 7f26f8ff9640 1 --2- 172.21.15.45:0/392861665 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f26e80662b0 0x7f26e8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:21.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.992+0000 7f26f8ff9640 1 -- 172.21.15.45:0/392861665 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f26ec083e90 con 0x7f26fc06c760 2023-10-03T19:19:21.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.992+0000 7f26fb7fe640 1 --2- 172.21.15.45:0/392861665 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f26e80662b0 0x7f26e8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:21.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.992+0000 7f26fb7fe640 1 --2- 172.21.15.45:0/392861665 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f26e80662b0 0x7f26e8068760 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f26f00af000 tx=0x7f26f00a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:21.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:21.996+0000 7f26f8ff9640 1 -- 172.21.15.45:0/392861665 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f26ec051270 con 0x7f26fc06c760 2023-10-03T19:19:22.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.148+0000 7f2702633640 1 -- 172.21.15.45:0/392861665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f26fc0bd1f0 con 0x7f26fc06c760 2023-10-03T19:19:22.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.148+0000 7f26f8ff9640 1 -- 172.21.15.45:0/392861665 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7f26ec0170a0 con 0x7f26fc06c760 2023-10-03T19:19:22.150 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:19:22.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.148+0000 7f2702633640 1 -- 172.21.15.45:0/392861665 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f26e80662b0 msgr2=0x7f26e8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:22.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.148+0000 7f2702633640 1 --2- 172.21.15.45:0/392861665 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f26e80662b0 0x7f26e8068760 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f26f00af000 tx=0x7f26f00a7000 comp rx=0 tx=0).stop 2023-10-03T19:19:22.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.148+0000 7f2702633640 1 -- 172.21.15.45:0/392861665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26fc06c760 msgr2=0x7f26fc144ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:22.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.148+0000 7f2702633640 1 --2- 172.21.15.45:0/392861665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26fc06c760 0x7f26fc144ef0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f26ec00e870 tx=0x7f26ec00ec70 comp rx=0 tx=0).stop 2023-10-03T19:19:22.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.148+0000 7f2702633640 1 -- 172.21.15.45:0/392861665 shutdown_connections 2023-10-03T19:19:22.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.148+0000 7f2702633640 1 --2- 172.21.15.45:0/392861665 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f26e80662b0 0x7f26e8068760 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:22.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.148+0000 7f2702633640 1 --2- 172.21.15.45:0/392861665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26fc0712c0 0x7f26fc1420f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:22.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.148+0000 7f2702633640 1 --2- 172.21.15.45:0/392861665 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f26fc06d560 0x7f26fc141bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:22.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.148+0000 7f2702633640 1 --2- 172.21.15.45:0/392861665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26fc06c760 0x7f26fc144ef0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:22.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.148+0000 7f2702633640 1 -- 172.21.15.45:0/392861665 >> 172.21.15.45:0/392861665 conn(0x7f26fc0a20d0 msgr2=0x7f26fc146700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:22.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.148+0000 7f2702633640 1 -- 172.21.15.45:0/392861665 shutdown_connections 2023-10-03T19:19:22.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.148+0000 7f2702633640 1 -- 172.21.15.45:0/392861665 wait complete. 2023-10-03T19:19:22.168 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:19:22.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2cd6c79640 1 Processor -- start 2023-10-03T19:19:22.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2cd6c79640 1 -- start start 2023-10-03T19:19:22.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2cd6c79640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cd00bbe70 0x7f2cd00bd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:22.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2cd6c79640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd014bf10 con 0x7f2cd0148a40 2023-10-03T19:19:22.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2cd6c79640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd006e380 con 0x7f2cd00c0520 2023-10-03T19:19:22.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2cd6c79640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd006cba0 con 0x7f2cd00bbe70 2023-10-03T19:19:22.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2cd4a15640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2cd0148a40 0x7f2cd006dc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36930/0 (socket says 172.21.15.45:36930) 2023-10-03T19:19:22.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2cd4a15640 1 -- 172.21.15.45:0/306394664 learned_addr learned my addr 172.21.15.45:0/306394664 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:22.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2ccffff640 1 --2- 172.21.15.45:0/306394664 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cd00bbe70 0x7f2cd00bd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:22.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2ccf7fe640 1 -- 172.21.15.45:0/306394664 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2213393417 0 0) 0x7f2cd014bf10 con 0x7f2cd0148a40 2023-10-03T19:19:22.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2ccf7fe640 1 -- 172.21.15.45:0/306394664 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cc0003530 con 0x7f2cd0148a40 2023-10-03T19:19:22.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2ccf7fe640 1 -- 172.21.15.45:0/306394664 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1388245707 0 0) 0x7f2cc0003530 con 0x7f2cd0148a40 2023-10-03T19:19:22.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2ccf7fe640 1 -- 172.21.15.45:0/306394664 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cd00bbe70 msgr2=0x7f2cd00bd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:22.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2ccf7fe640 1 --2- 172.21.15.45:0/306394664 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cd00bbe70 0x7f2cd00bd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:22.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2ccf7fe640 1 -- 172.21.15.45:0/306394664 >> v1:172.21.15.79:6789/0 conn(0x7f2cd00c0520 legacy=0x7f2cd00c09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:22.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2ccf7fe640 1 -- 172.21.15.45:0/306394664 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd014c1b0 con 0x7f2cd0148a40 2023-10-03T19:19:22.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2ccf7fe640 1 -- 172.21.15.45:0/306394664 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f2cc4001680 con 0x7f2cd0148a40 2023-10-03T19:19:22.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2ccf7fe640 1 -- 172.21.15.45:0/306394664 >> v1:172.21.15.45:6789/0 conn(0x7f2cd0148a40 legacy=0x7f2cd006dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:22.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2ccf7fe640 1 --2- 172.21.15.45:0/306394664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cc00039b0 0x7f2cc0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:22.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2ccf7fe640 1 --2- 172.21.15.45:0/306394664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2cc00047d0 0x7f2cc0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:22.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2ccf7fe640 1 --2- 172.21.15.45:0/306394664 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cd00bbe70 0x7f2cc0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:22.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2ccf7fe640 1 -- 172.21.15.45:0/306394664 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd006cba0 con 0x7f2cc00039b0 2023-10-03T19:19:22.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2ccf7fe640 1 -- 172.21.15.45:0/306394664 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc000ba40 con 0x7f2cc00047d0 2023-10-03T19:19:22.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2ccf7fe640 1 -- 172.21.15.45:0/306394664 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc000dde0 con 0x7f2cd00bbe70 2023-10-03T19:19:22.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2cd4a15640 1 --2- 172.21.15.45:0/306394664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cc00039b0 0x7f2cc0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:22.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2ccffff640 1 --2- 172.21.15.45:0/306394664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2cc00047d0 0x7f2cc0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:22.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2cd5216640 1 --2- 172.21.15.45:0/306394664 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cd00bbe70 0x7f2cc0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:22.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2cd4a15640 1 -- 172.21.15.45:0/306394664 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cd00bbe70 msgr2=0x7f2cc0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:22.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2cd4a15640 1 --2- 172.21.15.45:0/306394664 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cd00bbe70 0x7f2cc0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:22.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2cd4a15640 1 -- 172.21.15.45:0/306394664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2cc00047d0 msgr2=0x7f2cc0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:22.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2cd4a15640 1 --2- 172.21.15.45:0/306394664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2cc00047d0 0x7f2cc0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:22.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2cd4a15640 1 -- 172.21.15.45:0/306394664 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc0003530 con 0x7f2cc00039b0 2023-10-03T19:19:22.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.292+0000 7f2ccffff640 1 --2- 172.21.15.45:0/306394664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2cc00047d0 0x7f2cc0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:22.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.296+0000 7f2cd4a15640 1 --2- 172.21.15.45:0/306394664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cc00039b0 0x7f2cc0003dc0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f2cc400c1c0 tx=0x7f2cc401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6350f9d0a53f95e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:22.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.296+0000 7f2ccf7fe640 1 -- 172.21.15.45:0/306394664 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc4005ae0 con 0x7f2cc00039b0 2023-10-03T19:19:22.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.296+0000 7f2ccf7fe640 1 -- 172.21.15.45:0/306394664 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc4005c40 con 0x7f2cc00039b0 2023-10-03T19:19:22.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.296+0000 7f2ccf7fe640 1 -- 172.21.15.45:0/306394664 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc4007070 con 0x7f2cc00039b0 2023-10-03T19:19:22.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.296+0000 7f2cd6c79640 1 -- 172.21.15.45:0/306394664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cc00039b0 msgr2=0x7f2cc0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:22.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.296+0000 7f2cd6c79640 1 --2- 172.21.15.45:0/306394664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cc00039b0 0x7f2cc0003dc0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f2cc400c1c0 tx=0x7f2cc401cc20 comp rx=0 tx=0).stop 2023-10-03T19:19:22.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.296+0000 7f2cd5216640 1 -- 172.21.15.45:0/306394664 reap_dead start 2023-10-03T19:19:22.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.296+0000 7f2cd6c79640 1 -- 172.21.15.45:0/306394664 shutdown_connections 2023-10-03T19:19:22.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.296+0000 7f2cd6c79640 1 -- 172.21.15.45:0/306394664 >> 172.21.15.45:0/306394664 conn(0x7f2cd00c14f0 msgr2=0x7f2cd00c18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:22.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.296+0000 7f2cd6c79640 1 -- 172.21.15.45:0/306394664 shutdown_connections 2023-10-03T19:19:22.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.296+0000 7f2cd6c79640 1 -- 172.21.15.45:0/306394664 wait complete. 2023-10-03T19:19:22.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.296+0000 7f2cd6c79640 1 Processor -- start 2023-10-03T19:19:22.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.296+0000 7f2cd6c79640 1 -- start start 2023-10-03T19:19:22.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.296+0000 7f2cd6c79640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cc00039b0 0x7f2cd01e6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:22.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.296+0000 7f2cd6c79640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cd01449f0 0x7f2cd00a2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:22.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.296+0000 7f2cd6c79640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2cd014a960 0x7f2cd0143a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:22.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.296+0000 7f2cd6c79640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd01e7090 con 0x7f2cc00039b0 2023-10-03T19:19:22.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.296+0000 7f2cd6c79640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd00a29c0 con 0x7f2cd014a960 2023-10-03T19:19:22.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.296+0000 7f2cd6c79640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd0144ea0 con 0x7f2cd01449f0 2023-10-03T19:19:22.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.296+0000 7f2cd4a15640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cc00039b0 0x7f2cd01e6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:22.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.296+0000 7f2cd4a15640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cc00039b0 0x7f2cd01e6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46372/0 (socket says 172.21.15.45:46372) 2023-10-03T19:19:22.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.296+0000 7f2cd4a15640 1 -- 172.21.15.45:0/118012027 learned_addr learned my addr 172.21.15.45:0/118012027 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:22.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.296+0000 7f2ccffff640 1 --2- 172.21.15.45:0/118012027 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cd01449f0 0x7f2cd00a2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:22.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.296+0000 7f2cd5216640 1 --2- 172.21.15.45:0/118012027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2cd014a960 0x7f2cd0143a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:22.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.300+0000 7f2cd4a15640 1 -- 172.21.15.45:0/118012027 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cd01449f0 msgr2=0x7f2cd00a2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:22.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.300+0000 7f2cd4a15640 1 --2- 172.21.15.45:0/118012027 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cd01449f0 0x7f2cd00a2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:22.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.300+0000 7f2cd4a15640 1 -- 172.21.15.45:0/118012027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2cd014a960 msgr2=0x7f2cd0143a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:22.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.300+0000 7f2cd4a15640 1 --2- 172.21.15.45:0/118012027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2cd014a960 0x7f2cd0143a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:22.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.300+0000 7f2cd4a15640 1 -- 172.21.15.45:0/118012027 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd0065ea0 con 0x7f2cc00039b0 2023-10-03T19:19:22.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.300+0000 7f2cd4a15640 1 --2- 172.21.15.45:0/118012027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cc00039b0 0x7f2cd01e6b50 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f2cc401ca50 tx=0x7f2cc0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:22.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.300+0000 7f2ccd7fa640 1 -- 172.21.15.45:0/118012027 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc40b4070 con 0x7f2cc00039b0 2023-10-03T19:19:22.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.300+0000 7f2ccd7fa640 1 -- 172.21.15.45:0/118012027 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc4005e70 con 0x7f2cc00039b0 2023-10-03T19:19:22.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.300+0000 7f2ccd7fa640 1 -- 172.21.15.45:0/118012027 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc4001640 con 0x7f2cc00039b0 2023-10-03T19:19:22.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.300+0000 7f2cd6c79640 1 -- 172.21.15.45:0/118012027 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd00bd820 con 0x7f2cc00039b0 2023-10-03T19:19:22.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.300+0000 7f2cd6c79640 1 -- 172.21.15.45:0/118012027 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd0066030 con 0x7f2cc00039b0 2023-10-03T19:19:22.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.300+0000 7f2cd6c79640 1 -- 172.21.15.45:0/118012027 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd004de80 con 0x7f2cc00039b0 2023-10-03T19:19:22.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.300+0000 7f2ccd7fa640 1 -- 172.21.15.45:0/118012027 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2cc4007040 con 0x7f2cc00039b0 2023-10-03T19:19:22.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.300+0000 7f2ccd7fa640 1 --2- 172.21.15.45:0/118012027 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2cb40662b0 0x7f2cb4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:22.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.300+0000 7f2ccd7fa640 1 -- 172.21.15.45:0/118012027 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f2cc411d560 con 0x7f2cc00039b0 2023-10-03T19:19:22.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.300+0000 7f2ccffff640 1 --2- 172.21.15.45:0/118012027 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2cb40662b0 0x7f2cb4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:22.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.300+0000 7f2ccffff640 1 --2- 172.21.15.45:0/118012027 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2cb40662b0 0x7f2cb4068760 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2cd00a4740 tx=0x7f2cbc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:22.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.304+0000 7f2ccd7fa640 1 -- 172.21.15.45:0/118012027 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2cc40ea940 con 0x7f2cc00039b0 2023-10-03T19:19:22.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.452+0000 7f2cd6c79640 1 -- 172.21.15.45:0/118012027 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2cd00c0300 con 0x7f2cc00039b0 2023-10-03T19:19:22.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.452+0000 7f2ccd7fa640 1 -- 172.21.15.45:0/118012027 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v87) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2cc4007cf0 con 0x7f2cc00039b0 2023-10-03T19:19:22.457 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:19:22.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.456+0000 7f2cd6c79640 1 -- 172.21.15.45:0/118012027 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2cb40662b0 msgr2=0x7f2cb4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:22.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.456+0000 7f2cd6c79640 1 --2- 172.21.15.45:0/118012027 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2cb40662b0 0x7f2cb4068760 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2cd00a4740 tx=0x7f2cbc008040 comp rx=0 tx=0).stop 2023-10-03T19:19:22.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.456+0000 7f2cd6c79640 1 -- 172.21.15.45:0/118012027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cc00039b0 msgr2=0x7f2cd01e6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:22.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.456+0000 7f2cd6c79640 1 --2- 172.21.15.45:0/118012027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cc00039b0 0x7f2cd01e6b50 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f2cc401ca50 tx=0x7f2cc0005800 comp rx=0 tx=0).stop 2023-10-03T19:19:22.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.456+0000 7f2cd6c79640 1 -- 172.21.15.45:0/118012027 shutdown_connections 2023-10-03T19:19:22.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.456+0000 7f2cd6c79640 1 --2- 172.21.15.45:0/118012027 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2cb40662b0 0x7f2cb4068760 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:22.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.456+0000 7f2cd6c79640 1 --2- 172.21.15.45:0/118012027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2cd014a960 0x7f2cd0143a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:22.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.456+0000 7f2cd6c79640 1 --2- 172.21.15.45:0/118012027 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cd01449f0 0x7f2cd00a2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:22.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.456+0000 7f2cd6c79640 1 --2- 172.21.15.45:0/118012027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cc00039b0 0x7f2cd01e6b50 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:22.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.456+0000 7f2cd6c79640 1 -- 172.21.15.45:0/118012027 >> 172.21.15.45:0/118012027 conn(0x7f2cd00c14f0 msgr2=0x7f2cd00c18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:22.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.456+0000 7f2cd6c79640 1 -- 172.21.15.45:0/118012027 shutdown_connections 2023-10-03T19:19:22.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.456+0000 7f2cd6c79640 1 -- 172.21.15.45:0/118012027 wait complete. 2023-10-03T19:19:22.474 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T19:19:22.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.592+0000 7fcd3db38640 1 Processor -- start 2023-10-03T19:19:22.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.592+0000 7fcd3db38640 1 -- start start 2023-10-03T19:19:22.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.592+0000 7fcd3db38640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd3806d560 0x7fcd380a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:22.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.592+0000 7fcd3db38640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd3806c2d0 con 0x7fcd380712c0 2023-10-03T19:19:22.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.592+0000 7fcd3db38640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd38150610 con 0x7fcd3806c760 2023-10-03T19:19:22.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.592+0000 7fcd3db38640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd381508b0 con 0x7fcd3806d560 2023-10-03T19:19:22.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.592+0000 7fcd377fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fcd380712c0 0x7fcd380bcbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36932/0 (socket says 172.21.15.45:36932) 2023-10-03T19:19:22.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.592+0000 7fcd377fe640 1 -- 172.21.15.45:0/1045119824 learned_addr learned my addr 172.21.15.45:0/1045119824 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:22.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.592+0000 7fcd2effd640 1 --2- 172.21.15.45:0/1045119824 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd3806d560 0x7fcd380a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:22.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.592+0000 7fcd36ffd640 1 -- 172.21.15.45:0/1045119824 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4177585647 0 0) 0x7fcd3806c2d0 con 0x7fcd380712c0 2023-10-03T19:19:22.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.592+0000 7fcd36ffd640 1 -- 172.21.15.45:0/1045119824 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd24003530 con 0x7fcd380712c0 2023-10-03T19:19:22.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.592+0000 7fcd36ffd640 1 -- 172.21.15.45:0/1045119824 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2120801644 0 0) 0x7fcd24003530 con 0x7fcd380712c0 2023-10-03T19:19:22.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.592+0000 7fcd2effd640 1 -- 172.21.15.45:0/1045119824 >> v1:172.21.15.79:6789/0 conn(0x7fcd3806c760 legacy=0x7fcd380a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:22.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.592+0000 7fcd2effd640 1 -- 172.21.15.45:0/1045119824 >> v1:172.21.15.45:6789/0 conn(0x7fcd380712c0 legacy=0x7fcd380bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:22.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.592+0000 7fcd2effd640 1 -- 172.21.15.45:0/1045119824 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3806d2e0 con 0x7fcd3806d560 2023-10-03T19:19:22.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.596+0000 7fcd2effd640 1 --2- 172.21.15.45:0/1045119824 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd3806d560 0x7fcd380a53c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcd200097f0 tx=0x7fcd2001c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95f64a51613b956d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:22.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.596+0000 7fcd36ffd640 1 -- 172.21.15.45:0/1045119824 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd28001680 con 0x7fcd3806d560 2023-10-03T19:19:22.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.596+0000 7fcd36ffd640 1 -- 172.21.15.45:0/1045119824 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd200a7050 con 0x7fcd3806d560 2023-10-03T19:19:22.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.596+0000 7fcd36ffd640 1 -- 172.21.15.45:0/1045119824 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd200ab600 con 0x7fcd3806d560 2023-10-03T19:19:22.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.596+0000 7fcd3db38640 1 -- 172.21.15.45:0/1045119824 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd3806d560 msgr2=0x7fcd380a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:22.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.596+0000 7fcd3db38640 1 --2- 172.21.15.45:0/1045119824 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd3806d560 0x7fcd380a53c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcd200097f0 tx=0x7fcd2001c350 comp rx=0 tx=0).stop 2023-10-03T19:19:22.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.596+0000 7fcd3db38640 1 -- 172.21.15.45:0/1045119824 shutdown_connections 2023-10-03T19:19:22.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.596+0000 7fcd3db38640 1 --2- 172.21.15.45:0/1045119824 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd3806d560 0x7fcd380a53c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:22.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.596+0000 7fcd3db38640 1 -- 172.21.15.45:0/1045119824 >> 172.21.15.45:0/1045119824 conn(0x7fcd380a20d0 msgr2=0x7fcd380a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:22.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.596+0000 7fcd3db38640 1 -- 172.21.15.45:0/1045119824 shutdown_connections 2023-10-03T19:19:22.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.596+0000 7fcd3db38640 1 -- 172.21.15.45:0/1045119824 wait complete. 2023-10-03T19:19:22.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.596+0000 7fcd3db38640 1 Processor -- start 2023-10-03T19:19:22.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.596+0000 7fcd3db38640 1 -- start start 2023-10-03T19:19:22.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.600+0000 7fcd3db38640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd3806c760 0x7fcd380a3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:22.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.600+0000 7fcd3db38640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd3806d560 0x7fcd38145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:22.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.600+0000 7fcd3db38640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd380712c0 0x7fcd380b5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:22.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.600+0000 7fcd3db38640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd380b7e30 con 0x7fcd3806d560 2023-10-03T19:19:22.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.600+0000 7fcd3db38640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3814a140 con 0x7fcd3806c760 2023-10-03T19:19:22.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.600+0000 7fcd3db38640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd380a4320 con 0x7fcd380712c0 2023-10-03T19:19:22.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.600+0000 7fcd2effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd3806d560 0x7fcd38145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:22.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.600+0000 7fcd2effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd3806d560 0x7fcd38145610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46386/0 (socket says 172.21.15.45:46386) 2023-10-03T19:19:22.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.600+0000 7fcd2effd640 1 -- 172.21.15.45:0/3415210030 learned_addr learned my addr 172.21.15.45:0/3415210030 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:22.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.600+0000 7fcd377fe640 1 --2- 172.21.15.45:0/3415210030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd3806c760 0x7fcd380a3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:22.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.600+0000 7fcd37fff640 1 --2- 172.21.15.45:0/3415210030 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd380712c0 0x7fcd380b5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:22.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.600+0000 7fcd2effd640 1 -- 172.21.15.45:0/3415210030 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd380712c0 msgr2=0x7fcd380b5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:22.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.600+0000 7fcd2effd640 1 --2- 172.21.15.45:0/3415210030 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd380712c0 0x7fcd380b5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:22.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.600+0000 7fcd2effd640 1 -- 172.21.15.45:0/3415210030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd3806c760 msgr2=0x7fcd380a3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:22.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.600+0000 7fcd2effd640 1 --2- 172.21.15.45:0/3415210030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd3806c760 0x7fcd380a3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:22.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.600+0000 7fcd2effd640 1 -- 172.21.15.45:0/3415210030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd20009420 con 0x7fcd3806d560 2023-10-03T19:19:22.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.600+0000 7fcd37fff640 1 --2- 172.21.15.45:0/3415210030 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd380712c0 0x7fcd380b5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:19:22.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.600+0000 7fcd2effd640 1 --2- 172.21.15.45:0/3415210030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd3806d560 0x7fcd38145610 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fcd200097f0 tx=0x7fcd200190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:22.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.600+0000 7fcd34ff9640 1 -- 172.21.15.45:0/3415210030 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd200b4400 con 0x7fcd3806d560 2023-10-03T19:19:22.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.600+0000 7fcd34ff9640 1 -- 172.21.15.45:0/3415210030 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd200a4e90 con 0x7fcd3806d560 2023-10-03T19:19:22.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.600+0000 7fcd34ff9640 1 -- 172.21.15.45:0/3415210030 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd200b4760 con 0x7fcd3806d560 2023-10-03T19:19:22.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.600+0000 7fcd3db38640 1 -- 172.21.15.45:0/3415210030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd38071820 con 0x7fcd3806d560 2023-10-03T19:19:22.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.600+0000 7fcd3db38640 1 -- 172.21.15.45:0/3415210030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd38071690 con 0x7fcd3806d560 2023-10-03T19:19:22.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.600+0000 7fcd3db38640 1 -- 172.21.15.45:0/3415210030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd380bd2d0 con 0x7fcd3806d560 2023-10-03T19:19:22.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.600+0000 7fcd34ff9640 1 -- 172.21.15.45:0/3415210030 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcd200b2040 con 0x7fcd3806d560 2023-10-03T19:19:22.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.600+0000 7fcd34ff9640 1 --2- 172.21.15.45:0/3415210030 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcd18066280 0x7fcd18068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:22.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.600+0000 7fcd34ff9640 1 -- 172.21.15.45:0/3415210030 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fcd2011df50 con 0x7fcd3806d560 2023-10-03T19:19:22.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.604+0000 7fcd377fe640 1 --2- 172.21.15.45:0/3415210030 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcd18066280 0x7fcd18068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:22.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.604+0000 7fcd377fe640 1 --2- 172.21.15.45:0/3415210030 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcd18066280 0x7fcd18068730 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcd28005890 tx=0x7fcd28001db0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:22.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.604+0000 7fcd34ff9640 1 -- 172.21.15.45:0/3415210030 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fcd200eb470 con 0x7fcd3806d560 2023-10-03T19:19:22.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.760+0000 7fcd3db38640 1 -- 172.21.15.45:0/3415210030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcd3804de80 con 0x7fcd3806d560 2023-10-03T19:19:22.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.760+0000 7fcd34ff9640 1 -- 172.21.15.45:0/3415210030 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcd200b9020 con 0x7fcd3806d560 2023-10-03T19:19:22.762 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-03T19:19:22.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.760+0000 7fcd3db38640 1 -- 172.21.15.45:0/3415210030 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcd18066280 msgr2=0x7fcd18068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:22.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.760+0000 7fcd3db38640 1 --2- 172.21.15.45:0/3415210030 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcd18066280 0x7fcd18068730 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcd28005890 tx=0x7fcd28001db0 comp rx=0 tx=0).stop 2023-10-03T19:19:22.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.760+0000 7fcd3db38640 1 -- 172.21.15.45:0/3415210030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd3806d560 msgr2=0x7fcd38145610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:22.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.760+0000 7fcd3db38640 1 --2- 172.21.15.45:0/3415210030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd3806d560 0x7fcd38145610 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fcd200097f0 tx=0x7fcd200190f0 comp rx=0 tx=0).stop 2023-10-03T19:19:22.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.760+0000 7fcd3db38640 1 -- 172.21.15.45:0/3415210030 shutdown_connections 2023-10-03T19:19:22.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.760+0000 7fcd3db38640 1 --2- 172.21.15.45:0/3415210030 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcd18066280 0x7fcd18068730 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:22.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.760+0000 7fcd3db38640 1 --2- 172.21.15.45:0/3415210030 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcd380712c0 0x7fcd380b5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:22.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.760+0000 7fcd3db38640 1 --2- 172.21.15.45:0/3415210030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd3806d560 0x7fcd38145610 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:22.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.760+0000 7fcd3db38640 1 --2- 172.21.15.45:0/3415210030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd3806c760 0x7fcd380a3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:22.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.760+0000 7fcd3db38640 1 -- 172.21.15.45:0/3415210030 >> 172.21.15.45:0/3415210030 conn(0x7fcd380a20d0 msgr2=0x7fcd380bbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:22.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.760+0000 7fcd3db38640 1 -- 172.21.15.45:0/3415210030 shutdown_connections 2023-10-03T19:19:22.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.764+0000 7fcd3db38640 1 -- 172.21.15.45:0/3415210030 wait complete. 2023-10-03T19:19:22.784 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T19:19:22.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.904+0000 7f44d2f21640 1 Processor -- start 2023-10-03T19:19:22.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.904+0000 7f44d2f21640 1 -- start start 2023-10-03T19:19:22.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.904+0000 7f44d2f21640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f44cc0bd860 0x7f44cc1527b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:22.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.904+0000 7f44d2f21640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f44cc0bcff0 0x7f44cc152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:22.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.904+0000 7f44d2f21640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f44cc069ad0 0x7f44cc069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:22.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.904+0000 7f44d2f21640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44cc0beb70 con 0x7f44cc0bcff0 2023-10-03T19:19:22.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.904+0000 7f44d2f21640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44cc06b8d0 con 0x7f44cc0bd860 2023-10-03T19:19:22.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.904+0000 7f44d2f21640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc06b560 con 0x7f44cc069ad0 2023-10-03T19:19:22.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.904+0000 7f44cbfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f44cc0bcff0 0x7f44cc152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:22.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.904+0000 7f44cbfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f44cc0bcff0 0x7f44cc152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46390/0 (socket says 172.21.15.45:46390) 2023-10-03T19:19:22.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.904+0000 7f44cbfff640 1 -- 172.21.15.45:0/1732216791 learned_addr learned my addr 172.21.15.45:0/1732216791 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:22.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.904+0000 7f44d0cbd640 1 --2- 172.21.15.45:0/1732216791 >> v2:172.21.15.79:3300/0 conn(0x7f44cc0bd860 0x7f44cc1527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:22.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.904+0000 7f44d14be640 1 --2- 172.21.15.45:0/1732216791 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f44cc069ad0 0x7f44cc069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:22.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.904+0000 7f44cbfff640 1 -- 172.21.15.45:0/1732216791 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f44cc069ad0 msgr2=0x7f44cc069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:22.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.904+0000 7f44cbfff640 1 --2- 172.21.15.45:0/1732216791 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f44cc069ad0 0x7f44cc069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:22.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.904+0000 7f44cbfff640 1 -- 172.21.15.45:0/1732216791 >> v2:172.21.15.79:3300/0 conn(0x7f44cc0bd860 msgr2=0x7f44cc1527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:22.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.904+0000 7f44cbfff640 1 --2- 172.21.15.45:0/1732216791 >> v2:172.21.15.79:3300/0 conn(0x7f44cc0bd860 0x7f44cc1527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:22.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.904+0000 7f44cbfff640 1 -- 172.21.15.45:0/1732216791 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44cc0bfc90 con 0x7f44cc0bcff0 2023-10-03T19:19:22.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.908+0000 7f44cbfff640 1 --2- 172.21.15.45:0/1732216791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44cc0bcff0 0x7f44cc152cf0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0726a0 tx=0x7f44b801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5088a91b38a85b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:22.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.908+0000 7f44cb7fe640 1 -- 172.21.15.45:0/1732216791 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b80aa610 con 0x7f44cc0bcff0 2023-10-03T19:19:22.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.908+0000 7f44cb7fe640 1 -- 172.21.15.45:0/1732216791 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b80a6040 con 0x7f44cc0bcff0 2023-10-03T19:19:22.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.908+0000 7f44cb7fe640 1 -- 172.21.15.45:0/1732216791 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b80aa990 con 0x7f44cc0bcff0 2023-10-03T19:19:22.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.908+0000 7f44d2f21640 1 -- 172.21.15.45:0/1732216791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44cc0bcff0 msgr2=0x7f44cc152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:22.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.908+0000 7f44d2f21640 1 --2- 172.21.15.45:0/1732216791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44cc0bcff0 0x7f44cc152cf0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0726a0 tx=0x7f44b801c4d0 comp rx=0 tx=0).stop 2023-10-03T19:19:22.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.908+0000 7f44d2f21640 1 -- 172.21.15.45:0/1732216791 shutdown_connections 2023-10-03T19:19:22.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.908+0000 7f44d2f21640 1 --2- 172.21.15.45:0/1732216791 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f44cc069ad0 0x7f44cc069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:22.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.908+0000 7f44d2f21640 1 --2- 172.21.15.45:0/1732216791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44cc0bcff0 0x7f44cc152cf0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:22.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.908+0000 7f44d2f21640 1 --2- 172.21.15.45:0/1732216791 >> v2:172.21.15.79:3300/0 conn(0x7f44cc0bd860 0x7f44cc1527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:22.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.908+0000 7f44d2f21640 1 -- 172.21.15.45:0/1732216791 >> 172.21.15.45:0/1732216791 conn(0x7f44cc071060 msgr2=0x7f44cc071460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:22.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.908+0000 7f44d2f21640 1 -- 172.21.15.45:0/1732216791 shutdown_connections 2023-10-03T19:19:22.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.908+0000 7f44d2f21640 1 -- 172.21.15.45:0/1732216791 wait complete. 2023-10-03T19:19:22.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.908+0000 7f44d2f21640 1 Processor -- start 2023-10-03T19:19:22.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.908+0000 7f44d2f21640 1 -- start start 2023-10-03T19:19:22.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.908+0000 7f44d2f21640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44cc069ad0 0x7f44cc14fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:22.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.908+0000 7f44d2f21640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f44cc0bcff0 0x7f44cc0b9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:22.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.908+0000 7f44d2f21640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44cc0bd860 0x7f44cc0b9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:22.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.908+0000 7f44d2f21640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc0bb440 con 0x7f44cc069ad0 2023-10-03T19:19:22.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.908+0000 7f44d2f21640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc14b730 con 0x7f44cc0bd860 2023-10-03T19:19:22.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.908+0000 7f44d2f21640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc0bc2b0 con 0x7f44cc0bcff0 2023-10-03T19:19:22.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.908+0000 7f44d0cbd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44cc069ad0 0x7f44cc14fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:22.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.908+0000 7f44d0cbd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44cc069ad0 0x7f44cc14fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46400/0 (socket says 172.21.15.45:46400) 2023-10-03T19:19:22.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.908+0000 7f44d0cbd640 1 -- 172.21.15.45:0/399355254 learned_addr learned my addr 172.21.15.45:0/399355254 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:22.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.908+0000 7f44d14be640 1 --2- 172.21.15.45:0/399355254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44cc0bd860 0x7f44cc0b9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:22.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.908+0000 7f44cbfff640 1 --2- 172.21.15.45:0/399355254 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f44cc0bcff0 0x7f44cc0b9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:22.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.912+0000 7f44d0cbd640 1 -- 172.21.15.45:0/399355254 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f44cc0bcff0 msgr2=0x7f44cc0b9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:22.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.912+0000 7f44d0cbd640 1 --2- 172.21.15.45:0/399355254 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f44cc0bcff0 0x7f44cc0b9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:22.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.912+0000 7f44d0cbd640 1 -- 172.21.15.45:0/399355254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44cc0bd860 msgr2=0x7f44cc0b9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:22.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.912+0000 7f44d0cbd640 1 --2- 172.21.15.45:0/399355254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44cc0bd860 0x7f44cc0b9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:22.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.912+0000 7f44d0cbd640 1 -- 172.21.15.45:0/399355254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b80094d0 con 0x7f44cc069ad0 2023-10-03T19:19:22.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.912+0000 7f44d0cbd640 1 --2- 172.21.15.45:0/399355254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44cc069ad0 0x7f44cc14fa90 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f44c000d830 tx=0x7f44c000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:22.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.912+0000 7f44c97fa640 1 -- 172.21.15.45:0/399355254 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c0018070 con 0x7f44cc069ad0 2023-10-03T19:19:22.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.912+0000 7f44c97fa640 1 -- 172.21.15.45:0/399355254 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c00059a0 con 0x7f44cc069ad0 2023-10-03T19:19:22.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.912+0000 7f44d2f21640 1 -- 172.21.15.45:0/399355254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44cc071b70 con 0x7f44cc069ad0 2023-10-03T19:19:22.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.912+0000 7f44c97fa640 1 -- 172.21.15.45:0/399355254 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c0005b50 con 0x7f44cc069ad0 2023-10-03T19:19:22.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.912+0000 7f44d2f21640 1 -- 172.21.15.45:0/399355254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44cc0be800 con 0x7f44cc069ad0 2023-10-03T19:19:22.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.912+0000 7f44d2f21640 1 -- 172.21.15.45:0/399355254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44cc06a490 con 0x7f44cc069ad0 2023-10-03T19:19:22.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.912+0000 7f44c97fa640 1 -- 172.21.15.45:0/399355254 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f44c000b6c0 con 0x7f44cc069ad0 2023-10-03T19:19:22.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.912+0000 7f44c97fa640 1 --2- 172.21.15.45:0/399355254 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f44b0066280 0x7f44b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:22.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.912+0000 7f44c97fa640 1 -- 172.21.15.45:0/399355254 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f44c0083d70 con 0x7f44cc069ad0 2023-10-03T19:19:22.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.912+0000 7f44cbfff640 1 --2- 172.21.15.45:0/399355254 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f44b0066280 0x7f44b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:22.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.912+0000 7f44cbfff640 1 --2- 172.21.15.45:0/399355254 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f44b0066280 0x7f44b0068730 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f44b80ae000 tx=0x7f44b80b5040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:22.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:22.916+0000 7f44c97fa640 1 -- 172.21.15.45:0/399355254 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f44c0051200 con 0x7f44cc069ad0 2023-10-03T19:19:23.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.068+0000 7f44d2f21640 1 -- 172.21.15.45:0/399355254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f44cc04de80 con 0x7f44cc069ad0 2023-10-03T19:19:23.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.072+0000 7f44c97fa640 1 -- 172.21.15.45:0/399355254 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7f44c0054820 con 0x7f44cc069ad0 2023-10-03T19:19:23.074 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-03T19:19:23.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.072+0000 7f44d2f21640 1 -- 172.21.15.45:0/399355254 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f44b0066280 msgr2=0x7f44b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:23.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.072+0000 7f44d2f21640 1 --2- 172.21.15.45:0/399355254 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f44b0066280 0x7f44b0068730 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f44b80ae000 tx=0x7f44b80b5040 comp rx=0 tx=0).stop 2023-10-03T19:19:23.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.072+0000 7f44d2f21640 1 -- 172.21.15.45:0/399355254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44cc069ad0 msgr2=0x7f44cc14fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:23.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.072+0000 7f44d2f21640 1 --2- 172.21.15.45:0/399355254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44cc069ad0 0x7f44cc14fa90 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f44c000d830 tx=0x7f44c000dcf0 comp rx=0 tx=0).stop 2023-10-03T19:19:23.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.072+0000 7f44d2f21640 1 -- 172.21.15.45:0/399355254 shutdown_connections 2023-10-03T19:19:23.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.072+0000 7f44d2f21640 1 --2- 172.21.15.45:0/399355254 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f44b0066280 0x7f44b0068730 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:23.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.072+0000 7f44d2f21640 1 --2- 172.21.15.45:0/399355254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44cc0bd860 0x7f44cc0b9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:23.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.072+0000 7f44d2f21640 1 --2- 172.21.15.45:0/399355254 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f44cc0bcff0 0x7f44cc0b9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:23.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.072+0000 7f44d2f21640 1 --2- 172.21.15.45:0/399355254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44cc069ad0 0x7f44cc14fa90 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:23.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.072+0000 7f44d2f21640 1 -- 172.21.15.45:0/399355254 >> 172.21.15.45:0/399355254 conn(0x7f44cc071060 msgr2=0x7f44cc071430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:23.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.072+0000 7f44d2f21640 1 -- 172.21.15.45:0/399355254 shutdown_connections 2023-10-03T19:19:23.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.072+0000 7f44d2f21640 1 -- 172.21.15.45:0/399355254 wait complete. 2023-10-03T19:19:23.093 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-03T19:19:23.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.216+0000 7f5c50f97640 1 Processor -- start 2023-10-03T19:19:23.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.216+0000 7f5c50f97640 1 -- start start 2023-10-03T19:19:23.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.216+0000 7f5c50f97640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5c4c149960 0x7f5c4c14cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:23.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.216+0000 7f5c50f97640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5c4c0c0fd0 0x7f5c4c06aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:23.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.216+0000 7f5c50f97640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c4c0bffa0 con 0x7f5c4c06b020 2023-10-03T19:19:23.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.216+0000 7f5c50f97640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c4c0c0560 con 0x7f5c4c149960 2023-10-03T19:19:23.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.216+0000 7f5c50f97640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0c0280 con 0x7f5c4c0c0fd0 2023-10-03T19:19:23.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.216+0000 7f5c4a59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5c4c149960 0x7f5c4c14cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:23.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.216+0000 7f5c4ad9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5c4c06b020 0x7f5c4c14fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36948/0 (socket says 172.21.15.45:36948) 2023-10-03T19:19:23.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.216+0000 7f5c4ad9d640 1 -- 172.21.15.45:0/3788315471 learned_addr learned my addr 172.21.15.45:0/3788315471 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:23.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.216+0000 7f5c49d9b640 1 --2- 172.21.15.45:0/3788315471 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5c4c0c0fd0 0x7f5c4c06aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:23.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.216+0000 7f5c4a59c640 1 -- 172.21.15.45:0/3788315471 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5c4c0c0fd0 msgr2=0x7f5c4c06aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:23.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.216+0000 7f5c4a59c640 1 --2- 172.21.15.45:0/3788315471 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5c4c0c0fd0 0x7f5c4c06aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:23.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.216+0000 7f5c4a59c640 1 -- 172.21.15.45:0/3788315471 >> v1:172.21.15.45:6789/0 conn(0x7f5c4c06b020 legacy=0x7f5c4c14fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:23.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.216+0000 7f5c4a59c640 1 -- 172.21.15.45:0/3788315471 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4c0c08d0 con 0x7f5c4c149960 2023-10-03T19:19:23.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.216+0000 7f5c4959a640 1 -- 172.21.15.45:0/3788315471 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2749616811 0 0) 0x7f5c4c0bffa0 con 0x7f5c4c06b020 2023-10-03T19:19:23.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.220+0000 7f5c4a59c640 1 --2- 172.21.15.45:0/3788315471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c4c149960 0x7f5c4c14cf30 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0097c0 tx=0x7f5c3c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=def8b1323693854d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:23.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.220+0000 7f5c4959a640 1 -- 172.21.15.45:0/3788315471 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c0a8970 con 0x7f5c4c149960 2023-10-03T19:19:23.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.220+0000 7f5c4959a640 1 -- 172.21.15.45:0/3788315471 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3c0a8ad0 con 0x7f5c4c149960 2023-10-03T19:19:23.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.220+0000 7f5c4959a640 1 -- 172.21.15.45:0/3788315471 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c0a8e60 con 0x7f5c4c149960 2023-10-03T19:19:23.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.220+0000 7f5c50f97640 1 -- 172.21.15.45:0/3788315471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c4c149960 msgr2=0x7f5c4c14cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:23.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.220+0000 7f5c50f97640 1 --2- 172.21.15.45:0/3788315471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c4c149960 0x7f5c4c14cf30 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0097c0 tx=0x7f5c3c01ec70 comp rx=0 tx=0).stop 2023-10-03T19:19:23.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.220+0000 7f5c50f97640 1 -- 172.21.15.45:0/3788315471 shutdown_connections 2023-10-03T19:19:23.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.220+0000 7f5c50f97640 1 --2- 172.21.15.45:0/3788315471 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5c4c0c0fd0 0x7f5c4c06aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:23.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.220+0000 7f5c50f97640 1 --2- 172.21.15.45:0/3788315471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c4c149960 0x7f5c4c14cf30 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:23.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.220+0000 7f5c50f97640 1 -- 172.21.15.45:0/3788315471 >> 172.21.15.45:0/3788315471 conn(0x7f5c4c0c2200 msgr2=0x7f5c4c0bdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:23.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.220+0000 7f5c50f97640 1 -- 172.21.15.45:0/3788315471 shutdown_connections 2023-10-03T19:19:23.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.220+0000 7f5c50f97640 1 -- 172.21.15.45:0/3788315471 wait complete. 2023-10-03T19:19:23.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.220+0000 7f5c50f97640 1 Processor -- start 2023-10-03T19:19:23.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.220+0000 7f5c50f97640 1 -- start start 2023-10-03T19:19:23.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.224+0000 7f5c50f97640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c4c06b020 0x7f5c4c14b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:23.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.224+0000 7f5c50f97640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c4c0c0fd0 0x7f5c4c070e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:23.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.224+0000 7f5c50f97640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5c4c149960 0x7f5c4c1e3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:23.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.224+0000 7f5c50f97640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c1466d0 con 0x7f5c4c06b020 2023-10-03T19:19:23.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.224+0000 7f5c50f97640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0a7200 con 0x7f5c4c0c0fd0 2023-10-03T19:19:23.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.224+0000 7f5c50f97640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c14c3a0 con 0x7f5c4c149960 2023-10-03T19:19:23.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.224+0000 7f5c4a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c4c06b020 0x7f5c4c14b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:23.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.224+0000 7f5c4a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c4c06b020 0x7f5c4c14b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46414/0 (socket says 172.21.15.45:46414) 2023-10-03T19:19:23.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.224+0000 7f5c4a59c640 1 -- 172.21.15.45:0/1615222951 learned_addr learned my addr 172.21.15.45:0/1615222951 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:23.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.224+0000 7f5c4ad9d640 1 --2- 172.21.15.45:0/1615222951 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5c4c149960 0x7f5c4c1e3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:23.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.224+0000 7f5c49d9b640 1 --2- 172.21.15.45:0/1615222951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c4c0c0fd0 0x7f5c4c070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:23.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.224+0000 7f5c4a59c640 1 -- 172.21.15.45:0/1615222951 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5c4c149960 msgr2=0x7f5c4c1e3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:23.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.224+0000 7f5c4a59c640 1 --2- 172.21.15.45:0/1615222951 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5c4c149960 0x7f5c4c1e3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:23.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.224+0000 7f5c4a59c640 1 -- 172.21.15.45:0/1615222951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c4c0c0fd0 msgr2=0x7f5c4c070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:23.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.224+0000 7f5c4a59c640 1 --2- 172.21.15.45:0/1615222951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c4c0c0fd0 0x7f5c4c070e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:23.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.224+0000 7f5c4a59c640 1 -- 172.21.15.45:0/1615222951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3c009420 con 0x7f5c4c06b020 2023-10-03T19:19:23.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.224+0000 7f5c4ad9d640 1 --2- 172.21.15.45:0/1615222951 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5c4c149960 0x7f5c4c1e3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:19:23.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.224+0000 7f5c4a59c640 1 --2- 172.21.15.45:0/1615222951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c4c06b020 0x7f5c4c14b1f0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0b3040 tx=0x7f5c3c01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:23.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.224+0000 7f5c3affd640 1 -- 172.21.15.45:0/1615222951 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c0b9630 con 0x7f5c4c06b020 2023-10-03T19:19:23.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.224+0000 7f5c3affd640 1 -- 172.21.15.45:0/1615222951 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3c0b97b0 con 0x7f5c4c06b020 2023-10-03T19:19:23.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.224+0000 7f5c3affd640 1 -- 172.21.15.45:0/1615222951 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c0b9b60 con 0x7f5c4c06b020 2023-10-03T19:19:23.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.224+0000 7f5c50f97640 1 -- 172.21.15.45:0/1615222951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4c149d30 con 0x7f5c4c06b020 2023-10-03T19:19:23.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.224+0000 7f5c50f97640 1 -- 172.21.15.45:0/1615222951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c4c0c0bb0 con 0x7f5c4c06b020 2023-10-03T19:19:23.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.224+0000 7f5c50f97640 1 -- 172.21.15.45:0/1615222951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4c150110 con 0x7f5c4c06b020 2023-10-03T19:19:23.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.224+0000 7f5c3affd640 1 -- 172.21.15.45:0/1615222951 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5c3c0b7040 con 0x7f5c4c06b020 2023-10-03T19:19:23.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.224+0000 7f5c3affd640 1 --2- 172.21.15.45:0/1615222951 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5c2c0662b0 0x7f5c2c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:23.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.224+0000 7f5c3affd640 1 -- 172.21.15.45:0/1615222951 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f5c3c121bf0 con 0x7f5c4c06b020 2023-10-03T19:19:23.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.224+0000 7f5c49d9b640 1 --2- 172.21.15.45:0/1615222951 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5c2c0662b0 0x7f5c2c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:23.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.228+0000 7f5c49d9b640 1 --2- 172.21.15.45:0/1615222951 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5c2c0662b0 0x7f5c2c068760 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c0bf6c0 tx=0x7f5c40008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:23.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.228+0000 7f5c3affd640 1 -- 172.21.15.45:0/1615222951 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5c3c0ef060 con 0x7f5c4c06b020 2023-10-03T19:19:23.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.396+0000 7f5c50f97640 1 -- 172.21.15.45:0/1615222951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5c4c04de80 con 0x7f5c4c06b020 2023-10-03T19:19:23.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.396+0000 7f5c3affd640 1 -- 172.21.15.45:0/1615222951 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v87) v1 ==== 80+0+59 (secure 0 0 0) 0x7f5c3c0b5080 con 0x7f5c4c06b020 2023-10-03T19:19:23.400 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.146:0/2938203609 2023-10-03T20:19:12.888501+0000 2023-10-03T19:19:23.400 INFO:teuthology.orchestra.run.smithi045.stderr:listed 1 entries 2023-10-03T19:19:23.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.400+0000 7f5c50f97640 1 -- 172.21.15.45:0/1615222951 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5c2c0662b0 msgr2=0x7f5c2c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:23.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.400+0000 7f5c50f97640 1 --2- 172.21.15.45:0/1615222951 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5c2c0662b0 0x7f5c2c068760 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c0bf6c0 tx=0x7f5c40008040 comp rx=0 tx=0).stop 2023-10-03T19:19:23.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.400+0000 7f5c50f97640 1 -- 172.21.15.45:0/1615222951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c4c06b020 msgr2=0x7f5c4c14b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:23.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.400+0000 7f5c50f97640 1 --2- 172.21.15.45:0/1615222951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c4c06b020 0x7f5c4c14b1f0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0b3040 tx=0x7f5c3c01ba10 comp rx=0 tx=0).stop 2023-10-03T19:19:23.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.400+0000 7f5c50f97640 1 -- 172.21.15.45:0/1615222951 shutdown_connections 2023-10-03T19:19:23.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.400+0000 7f5c50f97640 1 --2- 172.21.15.45:0/1615222951 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5c2c0662b0 0x7f5c2c068760 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:23.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.400+0000 7f5c50f97640 1 --2- 172.21.15.45:0/1615222951 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5c4c149960 0x7f5c4c1e3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:23.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.400+0000 7f5c50f97640 1 --2- 172.21.15.45:0/1615222951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c4c0c0fd0 0x7f5c4c070e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:23.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.400+0000 7f5c50f97640 1 --2- 172.21.15.45:0/1615222951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c4c06b020 0x7f5c4c14b1f0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:23.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.400+0000 7f5c50f97640 1 -- 172.21.15.45:0/1615222951 >> 172.21.15.45:0/1615222951 conn(0x7f5c4c0c2200 msgr2=0x7f5c4c0b6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:23.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.400+0000 7f5c50f97640 1 -- 172.21.15.45:0/1615222951 shutdown_connections 2023-10-03T19:19:23.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.400+0000 7f5c50f97640 1 -- 172.21.15.45:0/1615222951 wait complete. 2023-10-03T19:19:23.419 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi172.front.sepia.ceph.com... 2023-10-03T19:19:23.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:23.419 DEBUG:teuthology.orchestra.run.smithi172:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-03T19:19:23.432 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi172.stderr:ceph-fuse[33307]: fuse finished with error 0 and tester_r 0 2023-10-03T19:19:23.433 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2023-10-03T19:19:23.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:23.434 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-03T19:19:23.528 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:19:23.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.660+0000 7f7d99d33640 1 Processor -- start 2023-10-03T19:19:23.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.660+0000 7f7d99d33640 1 -- start start 2023-10-03T19:19:23.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.660+0000 7f7d99d33640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d9414f240 0x7f7d941528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:23.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.660+0000 7f7d99d33640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7d940c2790 0x7f7d940c0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:23.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.660+0000 7f7d99d33640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d940bb1d0 0x7f7d940c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:23.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.660+0000 7f7d99d33640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d9406b640 con 0x7f7d9414f240 2023-10-03T19:19:23.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.660+0000 7f7d99d33640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d9406b2d0 con 0x7f7d940c2790 2023-10-03T19:19:23.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.660+0000 7f7d99d33640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d940c0fa0 con 0x7f7d940bb1d0 2023-10-03T19:19:23.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.660+0000 7f7d937fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d9414f240 0x7f7d941528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:23.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.660+0000 7f7d937fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d9414f240 0x7f7d941528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46426/0 (socket says 172.21.15.45:46426) 2023-10-03T19:19:23.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.660+0000 7f7d937fe640 1 -- 172.21.15.45:0/77760523 learned_addr learned my addr 172.21.15.45:0/77760523 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:23.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.660+0000 7f7d93fff640 1 --2- 172.21.15.45:0/77760523 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d940bb1d0 0x7f7d940c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:23.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.660+0000 7f7d92ffd640 1 --2- 172.21.15.45:0/77760523 >> v2:172.21.15.79:3300/0 conn(0x7f7d940c2790 0x7f7d940c0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:23.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.660+0000 7f7d937fe640 1 -- 172.21.15.45:0/77760523 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d940bb1d0 msgr2=0x7f7d940c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:23.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.660+0000 7f7d937fe640 1 --2- 172.21.15.45:0/77760523 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d940bb1d0 0x7f7d940c12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:23.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.660+0000 7f7d937fe640 1 -- 172.21.15.45:0/77760523 >> v2:172.21.15.79:3300/0 conn(0x7f7d940c2790 msgr2=0x7f7d940c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:23.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.660+0000 7f7d937fe640 1 --2- 172.21.15.45:0/77760523 >> v2:172.21.15.79:3300/0 conn(0x7f7d940c2790 0x7f7d940c0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:23.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.660+0000 7f7d937fe640 1 -- 172.21.15.45:0/77760523 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d940a3c60 con 0x7f7d9414f240 2023-10-03T19:19:23.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.664+0000 7f7d937fe640 1 --2- 172.21.15.45:0/77760523 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d9414f240 0x7f7d941528d0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f7d94089fd0 tx=0x7f7d8401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9814d2341d97c692 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:23.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.664+0000 7f7d927fc640 1 -- 172.21.15.45:0/77760523 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d840a89b0 con 0x7f7d9414f240 2023-10-03T19:19:23.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.664+0000 7f7d927fc640 1 -- 172.21.15.45:0/77760523 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d840a8b10 con 0x7f7d9414f240 2023-10-03T19:19:23.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.664+0000 7f7d927fc640 1 -- 172.21.15.45:0/77760523 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d840a8ea0 con 0x7f7d9414f240 2023-10-03T19:19:23.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.664+0000 7f7d99d33640 1 -- 172.21.15.45:0/77760523 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d9414f240 msgr2=0x7f7d941528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:23.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.664+0000 7f7d99d33640 1 --2- 172.21.15.45:0/77760523 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d9414f240 0x7f7d941528d0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f7d94089fd0 tx=0x7f7d8401ecf0 comp rx=0 tx=0).stop 2023-10-03T19:19:23.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.664+0000 7f7d99d33640 1 -- 172.21.15.45:0/77760523 shutdown_connections 2023-10-03T19:19:23.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.664+0000 7f7d99d33640 1 --2- 172.21.15.45:0/77760523 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d940bb1d0 0x7f7d940c12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:23.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.664+0000 7f7d99d33640 1 --2- 172.21.15.45:0/77760523 >> v2:172.21.15.79:3300/0 conn(0x7f7d940c2790 0x7f7d940c0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:23.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.664+0000 7f7d99d33640 1 --2- 172.21.15.45:0/77760523 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d9414f240 0x7f7d941528d0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:23.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.664+0000 7f7d99d33640 1 -- 172.21.15.45:0/77760523 >> 172.21.15.45:0/77760523 conn(0x7f7d940a64a0 msgr2=0x7f7d940a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:23.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.664+0000 7f7d99d33640 1 -- 172.21.15.45:0/77760523 shutdown_connections 2023-10-03T19:19:23.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.664+0000 7f7d99d33640 1 -- 172.21.15.45:0/77760523 wait complete. 2023-10-03T19:19:23.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.664+0000 7f7d99d33640 1 Processor -- start 2023-10-03T19:19:23.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.664+0000 7f7d99d33640 1 -- start start 2023-10-03T19:19:23.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.664+0000 7f7d99d33640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d940bb1d0 0x7f7d940aa170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:23.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.664+0000 7f7d99d33640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d940c2790 0x7f7d940a40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:23.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.664+0000 7f7d99d33640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d9414f240 0x7f7d9414d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:23.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.664+0000 7f7d99d33640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d940aa6b0 con 0x7f7d940c2790 2023-10-03T19:19:23.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.664+0000 7f7d99d33640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9414a460 con 0x7f7d940bb1d0 2023-10-03T19:19:23.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.668+0000 7f7d99d33640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d940a4610 con 0x7f7d9414f240 2023-10-03T19:19:23.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.668+0000 7f7d92ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d940c2790 0x7f7d940a40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:23.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.668+0000 7f7d92ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d940c2790 0x7f7d940a40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46434/0 (socket says 172.21.15.45:46434) 2023-10-03T19:19:23.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.668+0000 7f7d92ffd640 1 -- 172.21.15.45:0/4009531268 learned_addr learned my addr 172.21.15.45:0/4009531268 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:23.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.668+0000 7f7d93fff640 1 --2- 172.21.15.45:0/4009531268 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d9414f240 0x7f7d9414d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:23.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.668+0000 7f7d937fe640 1 --2- 172.21.15.45:0/4009531268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d940bb1d0 0x7f7d940aa170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:23.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.668+0000 7f7d92ffd640 1 -- 172.21.15.45:0/4009531268 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d9414f240 msgr2=0x7f7d9414d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:23.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.668+0000 7f7d92ffd640 1 --2- 172.21.15.45:0/4009531268 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d9414f240 0x7f7d9414d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:23.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.668+0000 7f7d92ffd640 1 -- 172.21.15.45:0/4009531268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d940bb1d0 msgr2=0x7f7d940aa170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:23.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.668+0000 7f7d92ffd640 1 --2- 172.21.15.45:0/4009531268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d940bb1d0 0x7f7d940aa170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:23.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.668+0000 7f7d92ffd640 1 -- 172.21.15.45:0/4009531268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d84009480 con 0x7f7d940c2790 2023-10-03T19:19:23.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.668+0000 7f7d93fff640 1 --2- 172.21.15.45:0/4009531268 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d9414f240 0x7f7d9414d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:19:23.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.668+0000 7f7d92ffd640 1 --2- 172.21.15.45:0/4009531268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d940c2790 0x7f7d940a40d0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f7d8800d800 tx=0x7f7d8800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:23.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.668+0000 7f7d7bfff640 1 -- 172.21.15.45:0/4009531268 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d88018070 con 0x7f7d940c2790 2023-10-03T19:19:23.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.668+0000 7f7d7bfff640 1 -- 172.21.15.45:0/4009531268 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d880059a0 con 0x7f7d940c2790 2023-10-03T19:19:23.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.668+0000 7f7d99d33640 1 -- 172.21.15.45:0/4009531268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d940a3f40 con 0x7f7d940c2790 2023-10-03T19:19:23.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.668+0000 7f7d7bfff640 1 -- 172.21.15.45:0/4009531268 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d88005b50 con 0x7f7d940c2790 2023-10-03T19:19:23.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.668+0000 7f7d99d33640 1 -- 172.21.15.45:0/4009531268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9414e740 con 0x7f7d940c2790 2023-10-03T19:19:23.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.668+0000 7f7d99d33640 1 -- 172.21.15.45:0/4009531268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d9414f610 con 0x7f7d940c2790 2023-10-03T19:19:23.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.668+0000 7f7d7bfff640 1 -- 172.21.15.45:0/4009531268 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7d88005cb0 con 0x7f7d940c2790 2023-10-03T19:19:23.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.668+0000 7f7d7bfff640 1 --2- 172.21.15.45:0/4009531268 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7d80066280 0x7f7d80068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:23.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.668+0000 7f7d7bfff640 1 -- 172.21.15.45:0/4009531268 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f7d88083cb0 con 0x7f7d940c2790 2023-10-03T19:19:23.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.668+0000 7f7d937fe640 1 --2- 172.21.15.45:0/4009531268 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7d80066280 0x7f7d80068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:23.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.672+0000 7f7d937fe640 1 --2- 172.21.15.45:0/4009531268 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7d80066280 0x7f7d80068730 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7d840b2000 tx=0x7f7d840aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:23.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.672+0000 7f7d7bfff640 1 -- 172.21.15.45:0/4009531268 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7d88054bd0 con 0x7f7d940c2790 2023-10-03T19:19:23.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.860+0000 7f7d99d33640 1 -- 172.21.15.45:0/4009531268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d940bfa90 con 0x7f7d940c2790 2023-10-03T19:19:23.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.860+0000 7f7d7bfff640 1 -- 172.21.15.45:0/4009531268 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+3910 (secure 0 0 0) 0x7f7d88007400 con 0x7f7d940c2790 2023-10-03T19:19:23.865 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:19:23.865 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":44,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6094,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3237510777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3237510777},{"type":"v1","addr":"172.21.15.79:6835","nonce":3237510777}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6717,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/697890515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":697890515},{"type":"v1","addr":"172.21.15.45:6833","nonce":697890515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:18:28.260345+0000","modified":"2023-10-03T19:18:31.278054+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6720},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6720":{"gid":6720,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/125100321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":125100321},{"type":"v1","addr":"172.21.15.45:6835","nonce":125100321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-10-03T19:19:23.865 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 44 2023-10-03T19:19:23.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.864+0000 7f7d99d33640 1 -- 172.21.15.45:0/4009531268 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7d80066280 msgr2=0x7f7d80068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:23.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.864+0000 7f7d99d33640 1 --2- 172.21.15.45:0/4009531268 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7d80066280 0x7f7d80068730 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7d840b2000 tx=0x7f7d840aa070 comp rx=0 tx=0).stop 2023-10-03T19:19:23.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.864+0000 7f7d99d33640 1 -- 172.21.15.45:0/4009531268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d940c2790 msgr2=0x7f7d940a40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:23.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.864+0000 7f7d99d33640 1 --2- 172.21.15.45:0/4009531268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d940c2790 0x7f7d940a40d0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f7d8800d800 tx=0x7f7d8800dcc0 comp rx=0 tx=0).stop 2023-10-03T19:19:23.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.864+0000 7f7d99d33640 1 -- 172.21.15.45:0/4009531268 shutdown_connections 2023-10-03T19:19:23.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.864+0000 7f7d99d33640 1 --2- 172.21.15.45:0/4009531268 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7d80066280 0x7f7d80068730 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:23.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.864+0000 7f7d99d33640 1 --2- 172.21.15.45:0/4009531268 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d9414f240 0x7f7d9414d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:23.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.864+0000 7f7d99d33640 1 --2- 172.21.15.45:0/4009531268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d940c2790 0x7f7d940a40d0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:23.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.864+0000 7f7d99d33640 1 --2- 172.21.15.45:0/4009531268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d940bb1d0 0x7f7d940aa170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:23.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.864+0000 7f7d99d33640 1 -- 172.21.15.45:0/4009531268 >> 172.21.15.45:0/4009531268 conn(0x7f7d940a64a0 msgr2=0x7f7d9414c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:23.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.864+0000 7f7d99d33640 1 -- 172.21.15.45:0/4009531268 shutdown_connections 2023-10-03T19:19:23.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:23.864+0000 7f7d99d33640 1 -- 172.21.15.45:0/4009531268 wait complete. 2023-10-03T19:19:23.883 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:19:24.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.004+0000 7fbd3b08d640 1 Processor -- start 2023-10-03T19:19:24.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.004+0000 7fbd3b08d640 1 -- start start 2023-10-03T19:19:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.008+0000 7fbd3b08d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbd34150800 0x7fbd3406a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.008+0000 7fbd3b08d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd340a6870 con 0x7fbd340bdb50 2023-10-03T19:19:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.008+0000 7fbd3b08d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd340a5930 con 0x7fbd3406d5b0 2023-10-03T19:19:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.008+0000 7fbd3b08d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd3406dde0 con 0x7fbd34150800 2023-10-03T19:19:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.008+0000 7fbd3962a640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbd340bdb50 0x7fbd3414bd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36954/0 (socket says 172.21.15.45:36954) 2023-10-03T19:19:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.008+0000 7fbd3962a640 1 -- 172.21.15.45:0/2736182413 learned_addr learned my addr 172.21.15.45:0/2736182413 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.008+0000 7fbd33fff640 1 --2- 172.21.15.45:0/2736182413 >> v2:172.21.15.45:3300/0 conn(0x7fbd34150800 0x7fbd3406a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.008+0000 7fbd337fe640 1 -- 172.21.15.45:0/2736182413 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2105053739 0 0) 0x7fbd340a6870 con 0x7fbd340bdb50 2023-10-03T19:19:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.008+0000 7fbd337fe640 1 -- 172.21.15.45:0/2736182413 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd1c003530 con 0x7fbd340bdb50 2023-10-03T19:19:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.008+0000 7fbd33fff640 1 -- 172.21.15.45:0/2736182413 >> v1:172.21.15.79:6789/0 conn(0x7fbd3406d5b0 legacy=0x7fbd340a5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.008+0000 7fbd33fff640 1 -- 172.21.15.45:0/2736182413 >> v1:172.21.15.45:6789/0 conn(0x7fbd340bdb50 legacy=0x7fbd3414bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:24.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.008+0000 7fbd33fff640 1 -- 172.21.15.45:0/2736182413 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd340a55c0 con 0x7fbd34150800 2023-10-03T19:19:24.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.008+0000 7fbd33fff640 1 --2- 172.21.15.45:0/2736182413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd34150800 0x7fbd3406a370 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fbd280097c0 tx=0x7fbd2801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59c2c1d79b7ef31c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:24.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.008+0000 7fbd337fe640 1 -- 172.21.15.45:0/2736182413 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd280a8970 con 0x7fbd34150800 2023-10-03T19:19:24.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.008+0000 7fbd337fe640 1 -- 172.21.15.45:0/2736182413 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd280a8ad0 con 0x7fbd34150800 2023-10-03T19:19:24.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.008+0000 7fbd337fe640 1 -- 172.21.15.45:0/2736182413 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd280a8e60 con 0x7fbd34150800 2023-10-03T19:19:24.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd3b08d640 1 -- 172.21.15.45:0/2736182413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd34150800 msgr2=0x7fbd3406a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:24.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd3b08d640 1 --2- 172.21.15.45:0/2736182413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd34150800 0x7fbd3406a370 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fbd280097c0 tx=0x7fbd2801ec70 comp rx=0 tx=0).stop 2023-10-03T19:19:24.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd3b08d640 1 -- 172.21.15.45:0/2736182413 shutdown_connections 2023-10-03T19:19:24.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd3b08d640 1 --2- 172.21.15.45:0/2736182413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd34150800 0x7fbd3406a370 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd3b08d640 1 -- 172.21.15.45:0/2736182413 >> 172.21.15.45:0/2736182413 conn(0x7fbd340c1600 msgr2=0x7fbd340c1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:24.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd3b08d640 1 -- 172.21.15.45:0/2736182413 shutdown_connections 2023-10-03T19:19:24.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd3b08d640 1 -- 172.21.15.45:0/2736182413 wait complete. 2023-10-03T19:19:24.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd3b08d640 1 Processor -- start 2023-10-03T19:19:24.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd3b08d640 1 -- start start 2023-10-03T19:19:24.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd3b08d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd3406d5b0 0x7fbd340b83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:24.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd3b08d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd340bdb50 0x7fbd340b9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:24.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd3b08d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd34150800 0x7fbd340b9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:24.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd3b08d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd341e4620 con 0x7fbd34150800 2023-10-03T19:19:24.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd3b08d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd340990b0 con 0x7fbd3406d5b0 2023-10-03T19:19:24.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd3b08d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd340b8910 con 0x7fbd340bdb50 2023-10-03T19:19:24.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd3962a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd34150800 0x7fbd340b9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:24.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd3962a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd34150800 0x7fbd340b9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46454/0 (socket says 172.21.15.45:46454) 2023-10-03T19:19:24.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd3962a640 1 -- 172.21.15.45:0/4084730115 learned_addr learned my addr 172.21.15.45:0/4084730115 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:24.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd33fff640 1 --2- 172.21.15.45:0/4084730115 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd340bdb50 0x7fbd340b9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:24.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd38e29640 1 --2- 172.21.15.45:0/4084730115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd3406d5b0 0x7fbd340b83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:24.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd3962a640 1 -- 172.21.15.45:0/4084730115 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd340bdb50 msgr2=0x7fbd340b9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:24.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd3962a640 1 --2- 172.21.15.45:0/4084730115 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd340bdb50 0x7fbd340b9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd3962a640 1 -- 172.21.15.45:0/4084730115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd3406d5b0 msgr2=0x7fbd340b83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:24.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd3962a640 1 --2- 172.21.15.45:0/4084730115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd3406d5b0 0x7fbd340b83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd3962a640 1 -- 172.21.15.45:0/4084730115 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd28009420 con 0x7fbd34150800 2023-10-03T19:19:24.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd3962a640 1 --2- 172.21.15.45:0/4084730115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd34150800 0x7fbd340b9540 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c00cad0 tx=0x7fbd2c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:24.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd317fa640 1 -- 172.21.15.45:0/4084730115 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c00ac30 con 0x7fbd34150800 2023-10-03T19:19:24.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd317fa640 1 -- 172.21.15.45:0/4084730115 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2c00ad90 con 0x7fbd34150800 2023-10-03T19:19:24.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd317fa640 1 -- 172.21.15.45:0/4084730115 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c012620 con 0x7fbd34150800 2023-10-03T19:19:24.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd3b08d640 1 -- 172.21.15.45:0/4084730115 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd3414c410 con 0x7fbd34150800 2023-10-03T19:19:24.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.012+0000 7fbd3b08d640 1 -- 172.21.15.45:0/4084730115 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd3406e0c0 con 0x7fbd34150800 2023-10-03T19:19:24.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.016+0000 7fbd3b08d640 1 -- 172.21.15.45:0/4084730115 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd34069ad0 con 0x7fbd34150800 2023-10-03T19:19:24.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.016+0000 7fbd317fa640 1 -- 172.21.15.45:0/4084730115 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbd2c007070 con 0x7fbd34150800 2023-10-03T19:19:24.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.016+0000 7fbd317fa640 1 --2- 172.21.15.45:0/4084730115 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbd20066280 0x7fbd20068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:24.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.016+0000 7fbd317fa640 1 -- 172.21.15.45:0/4084730115 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fbd2c083da0 con 0x7fbd34150800 2023-10-03T19:19:24.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.016+0000 7fbd38e29640 1 --2- 172.21.15.45:0/4084730115 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbd20066280 0x7fbd20068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:24.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.016+0000 7fbd38e29640 1 --2- 172.21.15.45:0/4084730115 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbd20066280 0x7fbd20068730 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fbd24000f70 tx=0x7fbd24009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:24.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.020+0000 7fbd317fa640 1 -- 172.21.15.45:0/4084730115 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbd2c051180 con 0x7fbd34150800 2023-10-03T19:19:24.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.176+0000 7fbd3b08d640 1 -- 172.21.15.45:0/4084730115 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd3404de80 con 0x7fbd34150800 2023-10-03T19:19:24.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.180+0000 7fbd317fa640 1 -- 172.21.15.45:0/4084730115 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+18501 (secure 0 0 0) 0x7fbd2c017020 con 0x7fbd34150800 2023-10-03T19:19:24.183 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:19:24.183 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":87,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:19:14.804643+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:18:25.942883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-10-03T19:18:27.242940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.2","mappings":[{"from":1,"to":2}]},{"pgid":"14.26","mappings":[{"from":1,"to":7}]},{"pgid":"14.29","mappings":[{"from":1,"to":7}]},{"pgid":"14.32","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:0/2938203609":"2023-10-03T20:19:12.888501+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:19:24.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.180+0000 7fbd3b08d640 1 -- 172.21.15.45:0/4084730115 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbd20066280 msgr2=0x7fbd20068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:24.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.180+0000 7fbd3b08d640 1 --2- 172.21.15.45:0/4084730115 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbd20066280 0x7fbd20068730 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fbd24000f70 tx=0x7fbd24009040 comp rx=0 tx=0).stop 2023-10-03T19:19:24.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.180+0000 7fbd3b08d640 1 -- 172.21.15.45:0/4084730115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd34150800 msgr2=0x7fbd340b9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:24.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.180+0000 7fbd3b08d640 1 --2- 172.21.15.45:0/4084730115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd34150800 0x7fbd340b9540 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c00cad0 tx=0x7fbd2c00cf90 comp rx=0 tx=0).stop 2023-10-03T19:19:24.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.180+0000 7fbd3b08d640 1 -- 172.21.15.45:0/4084730115 shutdown_connections 2023-10-03T19:19:24.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.180+0000 7fbd3b08d640 1 --2- 172.21.15.45:0/4084730115 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbd20066280 0x7fbd20068730 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.180+0000 7fbd3b08d640 1 --2- 172.21.15.45:0/4084730115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd34150800 0x7fbd340b9540 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.180+0000 7fbd3b08d640 1 --2- 172.21.15.45:0/4084730115 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd340bdb50 0x7fbd340b9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.180+0000 7fbd3b08d640 1 --2- 172.21.15.45:0/4084730115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd3406d5b0 0x7fbd340b83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.180+0000 7fbd3b08d640 1 -- 172.21.15.45:0/4084730115 >> 172.21.15.45:0/4084730115 conn(0x7fbd340c1600 msgr2=0x7fbd340a5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:24.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.180+0000 7fbd3b08d640 1 -- 172.21.15.45:0/4084730115 shutdown_connections 2023-10-03T19:19:24.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.180+0000 7fbd3b08d640 1 -- 172.21.15.45:0/4084730115 wait complete. 2023-10-03T19:19:24.202 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T19:18:25.942883+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T19:18:27.242940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:19:24.202 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:19:24.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.320+0000 7f9a09313640 1 Processor -- start 2023-10-03T19:19:24.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.320+0000 7f9a09313640 1 -- start start 2023-10-03T19:19:24.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.320+0000 7f9a09313640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9a040c07b0 0x7f9a040c0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:24.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.320+0000 7f9a09313640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9a040c1770 0x7f9a040bb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:24.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.320+0000 7f9a09313640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a040bc360 con 0x7f9a040bbed0 2023-10-03T19:19:24.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.320+0000 7f9a09313640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a040c1ed0 con 0x7f9a040c1770 2023-10-03T19:19:24.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.320+0000 7f9a09313640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a040c11b0 con 0x7f9a040c07b0 2023-10-03T19:19:24.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.320+0000 7f9a02ffd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9a040c07b0 0x7f9a040c0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:24.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.320+0000 7f9a02ffd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9a040c07b0 0x7f9a040c0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:35438/0 (socket says 172.21.15.45:35438) 2023-10-03T19:19:24.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.324+0000 7f9a02ffd640 1 -- 172.21.15.45:0/3014716737 learned_addr learned my addr 172.21.15.45:0/3014716737 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:24.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.324+0000 7f9a027fc640 1 --2- 172.21.15.45:0/3014716737 >> v2:172.21.15.79:3300/0 conn(0x7f9a040c1770 0x7f9a040bb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:24.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.324+0000 7f9a02ffd640 1 -- 172.21.15.45:0/3014716737 >> v2:172.21.15.79:3300/0 conn(0x7f9a040c1770 msgr2=0x7f9a040bb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:24.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.324+0000 7f9a02ffd640 1 --2- 172.21.15.45:0/3014716737 >> v2:172.21.15.79:3300/0 conn(0x7f9a040c1770 0x7f9a040bb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.324+0000 7f9a02ffd640 1 -- 172.21.15.45:0/3014716737 >> v1:172.21.15.79:6789/0 conn(0x7f9a040bbed0 legacy=0x7f9a0414b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:24.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.324+0000 7f9a02ffd640 1 -- 172.21.15.45:0/3014716737 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a041525e0 con 0x7f9a040c07b0 2023-10-03T19:19:24.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.324+0000 7f9a02ffd640 1 --2- 172.21.15.45:0/3014716737 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9a040c07b0 0x7f9a040c0b80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f99f4009e50 tx=0x7f99f401f1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb2be2da8fc9366f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:24.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.324+0000 7f9a01ffb640 1 -- 172.21.15.45:0/3014716737 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f40af400 con 0x7f9a040c07b0 2023-10-03T19:19:24.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.324+0000 7f9a01ffb640 1 -- 172.21.15.45:0/3014716737 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f40ab050 con 0x7f9a040c07b0 2023-10-03T19:19:24.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.324+0000 7f9a01ffb640 1 -- 172.21.15.45:0/3014716737 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f40af780 con 0x7f9a040c07b0 2023-10-03T19:19:24.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f9a09313640 1 -- 172.21.15.45:0/3014716737 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9a040c07b0 msgr2=0x7f9a040c0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:24.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f9a09313640 1 --2- 172.21.15.45:0/3014716737 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9a040c07b0 0x7f9a040c0b80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f99f4009e50 tx=0x7f99f401f1f0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f9a09313640 1 -- 172.21.15.45:0/3014716737 shutdown_connections 2023-10-03T19:19:24.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f9a09313640 1 --2- 172.21.15.45:0/3014716737 >> v2:172.21.15.79:3300/0 conn(0x7f9a040c1770 0x7f9a040bb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f9a09313640 1 --2- 172.21.15.45:0/3014716737 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9a040c07b0 0x7f9a040c0b80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f9a09313640 1 -- 172.21.15.45:0/3014716737 >> 172.21.15.45:0/3014716737 conn(0x7f9a040a4260 msgr2=0x7f9a040a4660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:24.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f9a09313640 1 -- 172.21.15.45:0/3014716737 shutdown_connections 2023-10-03T19:19:24.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f9a09313640 1 -- 172.21.15.45:0/3014716737 wait complete. 2023-10-03T19:19:24.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f9a09313640 1 Processor -- start 2023-10-03T19:19:24.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f9a09313640 1 -- start start 2023-10-03T19:19:24.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f9a09313640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a040bbed0 0x7f9a04150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:24.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f9a09313640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9a040c07b0 0x7f9a0406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:24.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f9a09313640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a040c1770 0x7f9a0406d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:24.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f9a09313640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a041e7410 con 0x7f9a040c1770 2023-10-03T19:19:24.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f9a09313640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0406f0d0 con 0x7f9a040bbed0 2023-10-03T19:19:24.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f9a09313640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a041e6d50 con 0x7f9a040c07b0 2023-10-03T19:19:24.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f9a037fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a040c1770 0x7f9a0406d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:24.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f9a037fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a040c1770 0x7f9a0406d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46462/0 (socket says 172.21.15.45:46462) 2023-10-03T19:19:24.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f9a037fe640 1 -- 172.21.15.45:0/3327374582 learned_addr learned my addr 172.21.15.45:0/3327374582 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:24.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f9a02ffd640 1 --2- 172.21.15.45:0/3327374582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a040bbed0 0x7f9a04150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:24.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f9a027fc640 1 --2- 172.21.15.45:0/3327374582 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9a040c07b0 0x7f9a0406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:24.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f9a037fe640 1 -- 172.21.15.45:0/3327374582 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9a040c07b0 msgr2=0x7f9a0406d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:24.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f9a037fe640 1 --2- 172.21.15.45:0/3327374582 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9a040c07b0 0x7f9a0406d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f9a037fe640 1 -- 172.21.15.45:0/3327374582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a040bbed0 msgr2=0x7f9a04150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:24.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f9a037fe640 1 --2- 172.21.15.45:0/3327374582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a040bbed0 0x7f9a04150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f9a037fe640 1 -- 172.21.15.45:0/3327374582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f4009b30 con 0x7f9a040c1770 2023-10-03T19:19:24.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f9a037fe640 1 --2- 172.21.15.45:0/3327374582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a040c1770 0x7f9a0406d890 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00c3c0 tx=0x7f99fc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:24.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f99fb7fe640 1 -- 172.21.15.45:0/3327374582 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc0052d0 con 0x7f9a040c1770 2023-10-03T19:19:24.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f99fb7fe640 1 -- 172.21.15.45:0/3327374582 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99fc005430 con 0x7f9a040c1770 2023-10-03T19:19:24.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f9a09313640 1 -- 172.21.15.45:0/3327374582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0414e540 con 0x7f9a040c1770 2023-10-03T19:19:24.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f99fb7fe640 1 -- 172.21.15.45:0/3327374582 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc003840 con 0x7f9a040c1770 2023-10-03T19:19:24.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.328+0000 7f9a09313640 1 -- 172.21.15.45:0/3327374582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a041528c0 con 0x7f9a040c1770 2023-10-03T19:19:24.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.332+0000 7f9a09313640 1 -- 172.21.15.45:0/3327374582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0414be70 con 0x7f9a040c1770 2023-10-03T19:19:24.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.332+0000 7f99fb7fe640 1 -- 172.21.15.45:0/3327374582 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f99fc0039a0 con 0x7f9a040c1770 2023-10-03T19:19:24.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.332+0000 7f99fb7fe640 1 --2- 172.21.15.45:0/3327374582 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f99e40662b0 0x7f99e4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:24.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.332+0000 7f99fb7fe640 1 -- 172.21.15.45:0/3327374582 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f99fc083220 con 0x7f9a040c1770 2023-10-03T19:19:24.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.332+0000 7f9a02ffd640 1 --2- 172.21.15.45:0/3327374582 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f99e40662b0 0x7f99e4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:24.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.332+0000 7f9a02ffd640 1 --2- 172.21.15.45:0/3327374582 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f99e40662b0 0x7f99e4068760 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f99f40b1000 tx=0x7f99f40aa000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:24.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.336+0000 7f99fb7fe640 1 -- 172.21.15.45:0/3327374582 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f99fc050690 con 0x7f9a040c1770 2023-10-03T19:19:24.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.488+0000 7f9a09313640 1 -- 172.21.15.45:0/3327374582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9a040bfe20 con 0x7f9a040c1770 2023-10-03T19:19:24.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.488+0000 7f99fb7fe640 1 -- 172.21.15.45:0/3327374582 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7f99fc053cb0 con 0x7f9a040c1770 2023-10-03T19:19:24.493 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:19:24.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.492+0000 7f9a09313640 1 -- 172.21.15.45:0/3327374582 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f99e40662b0 msgr2=0x7f99e4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:24.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.492+0000 7f9a09313640 1 --2- 172.21.15.45:0/3327374582 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f99e40662b0 0x7f99e4068760 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f99f40b1000 tx=0x7f99f40aa000 comp rx=0 tx=0).stop 2023-10-03T19:19:24.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.492+0000 7f9a09313640 1 -- 172.21.15.45:0/3327374582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a040c1770 msgr2=0x7f9a0406d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:24.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.492+0000 7f9a09313640 1 --2- 172.21.15.45:0/3327374582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a040c1770 0x7f9a0406d890 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00c3c0 tx=0x7f99fc00c880 comp rx=0 tx=0).stop 2023-10-03T19:19:24.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.492+0000 7f9a09313640 1 -- 172.21.15.45:0/3327374582 shutdown_connections 2023-10-03T19:19:24.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.492+0000 7f9a09313640 1 --2- 172.21.15.45:0/3327374582 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f99e40662b0 0x7f99e4068760 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.492+0000 7f9a09313640 1 --2- 172.21.15.45:0/3327374582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a040c1770 0x7f9a0406d890 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.492+0000 7f9a09313640 1 --2- 172.21.15.45:0/3327374582 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9a040c07b0 0x7f9a0406d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.492+0000 7f9a09313640 1 --2- 172.21.15.45:0/3327374582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a040bbed0 0x7f9a04150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.492+0000 7f9a09313640 1 -- 172.21.15.45:0/3327374582 >> 172.21.15.45:0/3327374582 conn(0x7f9a040a4260 msgr2=0x7f9a0414b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:24.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.492+0000 7f9a09313640 1 -- 172.21.15.45:0/3327374582 shutdown_connections 2023-10-03T19:19:24.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.492+0000 7f9a09313640 1 -- 172.21.15.45:0/3327374582 wait complete. 2023-10-03T19:19:24.512 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:19:24.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.640+0000 7f319b19f640 1 Processor -- start 2023-10-03T19:19:24.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.640+0000 7f319b19f640 1 -- start start 2023-10-03T19:19:24.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.640+0000 7f319b19f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31940bd860 0x7f31941527b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:24.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.640+0000 7f319b19f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31940bcff0 0x7f3194152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:24.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.640+0000 7f319b19f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3194069ad0 0x7f3194069f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:24.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.640+0000 7f319b19f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31940beb70 con 0x7f31940bd860 2023-10-03T19:19:24.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.640+0000 7f319b19f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f319406b8d0 con 0x7f3194069ad0 2023-10-03T19:19:24.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.640+0000 7f319b19f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319406b560 con 0x7f31940bcff0 2023-10-03T19:19:24.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.640+0000 7f3198f3b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31940bd860 0x7f31941527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:24.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.640+0000 7f3198f3b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31940bd860 0x7f31941527b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42360/0 (socket says 172.21.15.45:42360) 2023-10-03T19:19:24.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.640+0000 7f3198f3b640 1 -- 172.21.15.45:0/1776025776 learned_addr learned my addr 172.21.15.45:0/1776025776 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:24.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.640+0000 7f3193fff640 1 --2- 172.21.15.45:0/1776025776 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31940bcff0 0x7f3194152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:24.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.640+0000 7f319973c640 1 --2- 172.21.15.45:0/1776025776 >> v2:172.21.15.79:3300/0 conn(0x7f3194069ad0 0x7f3194069f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:24.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.640+0000 7f3198f3b640 1 -- 172.21.15.45:0/1776025776 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31940bcff0 msgr2=0x7f3194152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:24.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.640+0000 7f3198f3b640 1 --2- 172.21.15.45:0/1776025776 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31940bcff0 0x7f3194152cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.640+0000 7f3198f3b640 1 -- 172.21.15.45:0/1776025776 >> v2:172.21.15.79:3300/0 conn(0x7f3194069ad0 msgr2=0x7f3194069f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:24.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.640+0000 7f3198f3b640 1 --2- 172.21.15.45:0/1776025776 >> v2:172.21.15.79:3300/0 conn(0x7f3194069ad0 0x7f3194069f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.644+0000 7f3198f3b640 1 -- 172.21.15.45:0/1776025776 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31940bfc90 con 0x7f31940bd860 2023-10-03T19:19:24.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.644+0000 7f3193fff640 1 --2- 172.21.15.45:0/1776025776 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31940bcff0 0x7f3194152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:24.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.644+0000 7f3198f3b640 1 --2- 172.21.15.45:0/1776025776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31940bd860 0x7f31941527b0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f319406ac30 tx=0x7f318401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7ea3ff4a8afb7d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:24.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.644+0000 7f31937fe640 1 -- 172.21.15.45:0/1776025776 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31840aa610 con 0x7f31940bd860 2023-10-03T19:19:24.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.644+0000 7f31937fe640 1 -- 172.21.15.45:0/1776025776 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31840a6040 con 0x7f31940bd860 2023-10-03T19:19:24.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.644+0000 7f31937fe640 1 -- 172.21.15.45:0/1776025776 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31840aa990 con 0x7f31940bd860 2023-10-03T19:19:24.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.644+0000 7f319b19f640 1 -- 172.21.15.45:0/1776025776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31940bd860 msgr2=0x7f31941527b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:24.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.644+0000 7f319b19f640 1 --2- 172.21.15.45:0/1776025776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31940bd860 0x7f31941527b0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f319406ac30 tx=0x7f318401c4d0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.644+0000 7f319b19f640 1 -- 172.21.15.45:0/1776025776 shutdown_connections 2023-10-03T19:19:24.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.644+0000 7f319b19f640 1 --2- 172.21.15.45:0/1776025776 >> v2:172.21.15.79:3300/0 conn(0x7f3194069ad0 0x7f3194069f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.644+0000 7f319b19f640 1 --2- 172.21.15.45:0/1776025776 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31940bcff0 0x7f3194152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.644+0000 7f319b19f640 1 --2- 172.21.15.45:0/1776025776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31940bd860 0x7f31941527b0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.644+0000 7f319b19f640 1 -- 172.21.15.45:0/1776025776 >> 172.21.15.45:0/1776025776 conn(0x7f3194071060 msgr2=0x7f3194071460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:24.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.644+0000 7f319b19f640 1 -- 172.21.15.45:0/1776025776 shutdown_connections 2023-10-03T19:19:24.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.644+0000 7f319b19f640 1 -- 172.21.15.45:0/1776025776 wait complete. 2023-10-03T19:19:24.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.648+0000 7f319b19f640 1 Processor -- start 2023-10-03T19:19:24.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.648+0000 7f319b19f640 1 -- start start 2023-10-03T19:19:24.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.648+0000 7f319b19f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3194069ad0 0x7f31940b9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:24.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.648+0000 7f319b19f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31940bcff0 0x7f31941ea3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:24.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.648+0000 7f319b19f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31940bd860 0x7f31940a6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:24.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.648+0000 7f319b19f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31941ea920 con 0x7f3194069ad0 2023-10-03T19:19:24.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.648+0000 7f319b19f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31940a6b50 con 0x7f31940bd860 2023-10-03T19:19:24.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.648+0000 7f319b19f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31940b7380 con 0x7f31940bcff0 2023-10-03T19:19:24.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.648+0000 7f3198f3b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3194069ad0 0x7f31940b9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:24.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.648+0000 7f3198f3b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3194069ad0 0x7f31940b9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42376/0 (socket says 172.21.15.45:42376) 2023-10-03T19:19:24.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.648+0000 7f3198f3b640 1 -- 172.21.15.45:0/1885106371 learned_addr learned my addr 172.21.15.45:0/1885106371 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:24.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.648+0000 7f3193fff640 1 --2- 172.21.15.45:0/1885106371 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31940bcff0 0x7f31941ea3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:24.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.648+0000 7f319973c640 1 --2- 172.21.15.45:0/1885106371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31940bd860 0x7f31940a6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:24.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.648+0000 7f3198f3b640 1 -- 172.21.15.45:0/1885106371 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31940bcff0 msgr2=0x7f31941ea3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:24.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.648+0000 7f3198f3b640 1 --2- 172.21.15.45:0/1885106371 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31940bcff0 0x7f31941ea3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.648+0000 7f3198f3b640 1 -- 172.21.15.45:0/1885106371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31940bd860 msgr2=0x7f31940a6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:24.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.648+0000 7f3198f3b640 1 --2- 172.21.15.45:0/1885106371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31940bd860 0x7f31940a6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.648+0000 7f3198f3b640 1 -- 172.21.15.45:0/1885106371 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3184009470 con 0x7f3194069ad0 2023-10-03T19:19:24.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.648+0000 7f3198f3b640 1 --2- 172.21.15.45:0/1885106371 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3194069ad0 0x7f31940b9740 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f31840ac040 tx=0x7f318401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:24.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.648+0000 7f31917fa640 1 -- 172.21.15.45:0/1885106371 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31840aaea0 con 0x7f3194069ad0 2023-10-03T19:19:24.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.648+0000 7f31917fa640 1 -- 172.21.15.45:0/1885106371 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31840bd610 con 0x7f3194069ad0 2023-10-03T19:19:24.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.648+0000 7f319b19f640 1 -- 172.21.15.45:0/1885106371 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3194071b70 con 0x7f3194069ad0 2023-10-03T19:19:24.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.648+0000 7f31917fa640 1 -- 172.21.15.45:0/1885106371 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31840bd9c0 con 0x7f3194069ad0 2023-10-03T19:19:24.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.648+0000 7f319b19f640 1 -- 172.21.15.45:0/1885106371 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31940be800 con 0x7f3194069ad0 2023-10-03T19:19:24.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.648+0000 7f319b19f640 1 -- 172.21.15.45:0/1885106371 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31940bdc30 con 0x7f3194069ad0 2023-10-03T19:19:24.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.648+0000 7f31917fa640 1 -- 172.21.15.45:0/1885106371 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f31840b33f0 con 0x7f3194069ad0 2023-10-03T19:19:24.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.648+0000 7f31917fa640 1 --2- 172.21.15.45:0/1885106371 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3174066280 0x7f3174068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:24.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.648+0000 7f31917fa640 1 -- 172.21.15.45:0/1885106371 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f318411e6f0 con 0x7f3194069ad0 2023-10-03T19:19:24.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.652+0000 7f3193fff640 1 --2- 172.21.15.45:0/1885106371 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3174066280 0x7f3174068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:24.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.652+0000 7f3193fff640 1 --2- 172.21.15.45:0/1885106371 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3174066280 0x7f3174068730 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f317c0075b0 tx=0x7f317c007540 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:24.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.656+0000 7f31917fa640 1 -- 172.21.15.45:0/1885106371 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f31840eba40 con 0x7f3194069ad0 2023-10-03T19:19:24.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.804+0000 7f319b19f640 1 -- 172.21.15.45:0/1885106371 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f31940b77b0 con 0x7f3194069ad0 2023-10-03T19:19:24.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.804+0000 7f31917fa640 1 -- 172.21.15.45:0/1885106371 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v87) v1 ==== 92+0+10 (secure 0 0 0) 0x7f31940b77b0 con 0x7f3194069ad0 2023-10-03T19:19:24.809 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:19:24.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.808+0000 7f319b19f640 1 -- 172.21.15.45:0/1885106371 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3174066280 msgr2=0x7f3174068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:24.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.808+0000 7f319b19f640 1 --2- 172.21.15.45:0/1885106371 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3174066280 0x7f3174068730 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f317c0075b0 tx=0x7f317c007540 comp rx=0 tx=0).stop 2023-10-03T19:19:24.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.808+0000 7f319b19f640 1 -- 172.21.15.45:0/1885106371 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3194069ad0 msgr2=0x7f31940b9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:24.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.808+0000 7f319b19f640 1 --2- 172.21.15.45:0/1885106371 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3194069ad0 0x7f31940b9740 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f31840ac040 tx=0x7f318401ad10 comp rx=0 tx=0).stop 2023-10-03T19:19:24.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.808+0000 7f319b19f640 1 -- 172.21.15.45:0/1885106371 shutdown_connections 2023-10-03T19:19:24.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.808+0000 7f319b19f640 1 --2- 172.21.15.45:0/1885106371 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3174066280 0x7f3174068730 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.808+0000 7f319b19f640 1 --2- 172.21.15.45:0/1885106371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31940bd860 0x7f31940a6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.808+0000 7f319b19f640 1 --2- 172.21.15.45:0/1885106371 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31940bcff0 0x7f31941ea3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.808+0000 7f319b19f640 1 --2- 172.21.15.45:0/1885106371 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3194069ad0 0x7f31940b9740 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.808+0000 7f319b19f640 1 -- 172.21.15.45:0/1885106371 >> 172.21.15.45:0/1885106371 conn(0x7f3194071060 msgr2=0x7f3194071430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:24.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.808+0000 7f319b19f640 1 -- 172.21.15.45:0/1885106371 shutdown_connections 2023-10-03T19:19:24.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.808+0000 7f319b19f640 1 -- 172.21.15.45:0/1885106371 wait complete. 2023-10-03T19:19:24.827 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T19:19:24.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.940+0000 7f380e574640 1 Processor -- start 2023-10-03T19:19:24.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.940+0000 7f380e574640 1 -- start start 2023-10-03T19:19:24.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.940+0000 7f380e574640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f38080bb0e0 0x7f38080bc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:24.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.940+0000 7f380e574640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38080bb880 0x7f38080bcb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:24.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.940+0000 7f380e574640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38080bbd90 con 0x7f3808149c70 2023-10-03T19:19:24.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.940+0000 7f380e574640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38080b63e0 con 0x7f38080bb0e0 2023-10-03T19:19:24.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.940+0000 7f380e574640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38081504a0 con 0x7f38080bb880 2023-10-03T19:19:24.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.940+0000 7f380cb11640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38080bb880 0x7f38080bcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:24.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.940+0000 7f38077fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f38080bb0e0 0x7f38080bc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:24.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.940+0000 7f380cb11640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38080bb880 0x7f38080bcb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:47388/0 (socket says 172.21.15.45:47388) 2023-10-03T19:19:24.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.940+0000 7f380cb11640 1 -- 172.21.15.45:0/56246313 learned_addr learned my addr 172.21.15.45:0/56246313 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:24.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.940+0000 7f380cb11640 1 -- 172.21.15.45:0/56246313 >> v2:172.21.15.79:3300/0 conn(0x7f38080bb0e0 msgr2=0x7f38080bc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:24.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.940+0000 7f380cb11640 1 --2- 172.21.15.45:0/56246313 >> v2:172.21.15.79:3300/0 conn(0x7f38080bb0e0 0x7f38080bc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.940+0000 7f380cb11640 1 -- 172.21.15.45:0/56246313 >> v1:172.21.15.79:6789/0 conn(0x7f3808149c70 legacy=0x7f38080c13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:24.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.940+0000 7f380cb11640 1 -- 172.21.15.45:0/56246313 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3808072980 con 0x7f38080bb880 2023-10-03T19:19:24.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.944+0000 7f380cb11640 1 --2- 172.21.15.45:0/56246313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38080bb880 0x7f38080bcb50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f37f8009870 tx=0x7f37f801c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25a8e422cf904366 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:24.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.944+0000 7f3806ffd640 1 -- 172.21.15.45:0/56246313 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f80ab650 con 0x7f38080bb880 2023-10-03T19:19:24.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.944+0000 7f3806ffd640 1 -- 172.21.15.45:0/56246313 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f80ab7b0 con 0x7f38080bb880 2023-10-03T19:19:24.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.944+0000 7f3806ffd640 1 -- 172.21.15.45:0/56246313 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f80abb40 con 0x7f38080bb880 2023-10-03T19:19:24.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.944+0000 7f380e574640 1 -- 172.21.15.45:0/56246313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38080bb880 msgr2=0x7f38080bcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:24.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.944+0000 7f380e574640 1 --2- 172.21.15.45:0/56246313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38080bb880 0x7f38080bcb50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f37f8009870 tx=0x7f37f801c540 comp rx=0 tx=0).stop 2023-10-03T19:19:24.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.944+0000 7f380e574640 1 -- 172.21.15.45:0/56246313 shutdown_connections 2023-10-03T19:19:24.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.944+0000 7f380e574640 1 --2- 172.21.15.45:0/56246313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38080bb880 0x7f38080bcb50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.944+0000 7f380e574640 1 --2- 172.21.15.45:0/56246313 >> v2:172.21.15.79:3300/0 conn(0x7f38080bb0e0 0x7f38080bc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.944+0000 7f380e574640 1 -- 172.21.15.45:0/56246313 >> 172.21.15.45:0/56246313 conn(0x7f380806a760 msgr2=0x7f38080c0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:24.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.944+0000 7f380e574640 1 -- 172.21.15.45:0/56246313 shutdown_connections 2023-10-03T19:19:24.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.944+0000 7f380e574640 1 -- 172.21.15.45:0/56246313 wait complete. 2023-10-03T19:19:24.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.944+0000 7f380e574640 1 Processor -- start 2023-10-03T19:19:24.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.944+0000 7f380e574640 1 -- start start 2023-10-03T19:19:24.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.944+0000 7f380e574640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38080bb0e0 0x7f3808142f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:24.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.944+0000 7f380e574640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38080bb880 0x7f3808155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:24.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.944+0000 7f380e574640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3808149c70 0x7f3808141f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:24.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.944+0000 7f380e574640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38081434a0 con 0x7f38080bb0e0 2023-10-03T19:19:24.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.944+0000 7f380e574640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38081558a0 con 0x7f3808149c70 2023-10-03T19:19:24.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.944+0000 7f380e574640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f380814f8e0 con 0x7f38080bb880 2023-10-03T19:19:24.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.944+0000 7f3807fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38080bb0e0 0x7f3808142f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:24.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.944+0000 7f3807fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38080bb0e0 0x7f3808142f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42390/0 (socket says 172.21.15.45:42390) 2023-10-03T19:19:24.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.944+0000 7f3807fff640 1 -- 172.21.15.45:0/1885862544 learned_addr learned my addr 172.21.15.45:0/1885862544 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:24.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.948+0000 7f380cb11640 1 --2- 172.21.15.45:0/1885862544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3808149c70 0x7f3808141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:24.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.948+0000 7f38077fe640 1 --2- 172.21.15.45:0/1885862544 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38080bb880 0x7f3808155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:24.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.948+0000 7f3807fff640 1 -- 172.21.15.45:0/1885862544 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38080bb880 msgr2=0x7f3808155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:24.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.948+0000 7f3807fff640 1 --2- 172.21.15.45:0/1885862544 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38080bb880 0x7f3808155360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.948+0000 7f3807fff640 1 -- 172.21.15.45:0/1885862544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3808149c70 msgr2=0x7f3808141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:24.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.948+0000 7f3807fff640 1 --2- 172.21.15.45:0/1885862544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3808149c70 0x7f3808141f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:24.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.948+0000 7f3807fff640 1 -- 172.21.15.45:0/1885862544 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f80094d0 con 0x7f38080bb0e0 2023-10-03T19:19:24.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.948+0000 7f38077fe640 1 --2- 172.21.15.45:0/1885862544 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38080bb880 0x7f3808155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:24.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.948+0000 7f3807fff640 1 --2- 172.21.15.45:0/1885862544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38080bb0e0 0x7f3808142f60 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f380000c7a0 tx=0x7f380000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:24.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.948+0000 7f3804ff9640 1 -- 172.21.15.45:0/1885862544 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3800003b80 con 0x7f38080bb0e0 2023-10-03T19:19:24.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.948+0000 7f3804ff9640 1 -- 172.21.15.45:0/1885862544 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3800003ce0 con 0x7f38080bb0e0 2023-10-03T19:19:24.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.948+0000 7f380e574640 1 -- 172.21.15.45:0/1885862544 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3808159540 con 0x7f38080bb0e0 2023-10-03T19:19:24.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.948+0000 7f3804ff9640 1 -- 172.21.15.45:0/1885862544 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380000aa90 con 0x7f38080bb0e0 2023-10-03T19:19:24.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.948+0000 7f380e574640 1 -- 172.21.15.45:0/1885862544 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38080bd090 con 0x7f38080bb0e0 2023-10-03T19:19:24.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.948+0000 7f380e574640 1 -- 172.21.15.45:0/1885862544 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38081596d0 con 0x7f38080bb0e0 2023-10-03T19:19:24.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.948+0000 7f3804ff9640 1 -- 172.21.15.45:0/1885862544 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f380000abf0 con 0x7f38080bb0e0 2023-10-03T19:19:24.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.948+0000 7f3804ff9640 1 --2- 172.21.15.45:0/1885862544 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f37f40662b0 0x7f37f4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:24.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.948+0000 7f3804ff9640 1 -- 172.21.15.45:0/1885862544 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f3800083c10 con 0x7f38080bb0e0 2023-10-03T19:19:24.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.948+0000 7f38077fe640 1 --2- 172.21.15.45:0/1885862544 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f37f40662b0 0x7f37f4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:24.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.948+0000 7f38077fe640 1 --2- 172.21.15.45:0/1885862544 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f37f40662b0 0x7f37f4068760 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3808145c40 tx=0x7f37fc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:24.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:24.952+0000 7f3804ff9640 1 -- 172.21.15.45:0/1885862544 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3800050ff0 con 0x7f38080bb0e0 2023-10-03T19:19:25.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.100+0000 7f380e574640 1 -- 172.21.15.45:0/1885862544 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f380804de80 con 0x7f38080bb0e0 2023-10-03T19:19:25.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.100+0000 7f3804ff9640 1 -- 172.21.15.45:0/1885862544 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3800054610 con 0x7f38080bb0e0 2023-10-03T19:19:25.104 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-03T19:19:25.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.100+0000 7f380e574640 1 -- 172.21.15.45:0/1885862544 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f37f40662b0 msgr2=0x7f37f4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:25.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.100+0000 7f380e574640 1 --2- 172.21.15.45:0/1885862544 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f37f40662b0 0x7f37f4068760 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3808145c40 tx=0x7f37fc008040 comp rx=0 tx=0).stop 2023-10-03T19:19:25.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.100+0000 7f380e574640 1 -- 172.21.15.45:0/1885862544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38080bb0e0 msgr2=0x7f3808142f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:25.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.100+0000 7f380e574640 1 --2- 172.21.15.45:0/1885862544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38080bb0e0 0x7f3808142f60 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f380000c7a0 tx=0x7f380000cc60 comp rx=0 tx=0).stop 2023-10-03T19:19:25.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.100+0000 7f380e574640 1 -- 172.21.15.45:0/1885862544 shutdown_connections 2023-10-03T19:19:25.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.100+0000 7f380e574640 1 --2- 172.21.15.45:0/1885862544 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f37f40662b0 0x7f37f4068760 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:25.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.100+0000 7f380e574640 1 --2- 172.21.15.45:0/1885862544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3808149c70 0x7f3808141f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:25.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.100+0000 7f380e574640 1 --2- 172.21.15.45:0/1885862544 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f38080bb880 0x7f3808155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:25.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.100+0000 7f380e574640 1 --2- 172.21.15.45:0/1885862544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38080bb0e0 0x7f3808142f60 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:25.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.100+0000 7f380e574640 1 -- 172.21.15.45:0/1885862544 >> 172.21.15.45:0/1885862544 conn(0x7f380806a760 msgr2=0x7f38080c13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:25.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.100+0000 7f380e574640 1 -- 172.21.15.45:0/1885862544 shutdown_connections 2023-10-03T19:19:25.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.104+0000 7f380e574640 1 -- 172.21.15.45:0/1885862544 wait complete. 2023-10-03T19:19:25.121 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T19:19:25.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.240+0000 7f25a1652640 1 Processor -- start 2023-10-03T19:19:25.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.240+0000 7f25a1652640 1 -- start start 2023-10-03T19:19:25.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.240+0000 7f25a1652640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f259c0712c0 0x7f259c0bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:25.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.240+0000 7f25a1652640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f259c06c760 0x7f259c0bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:25.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.240+0000 7f25a1652640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f259c06c2d0 con 0x7f259c06d560 2023-10-03T19:19:25.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.240+0000 7f25a1652640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f259c150610 con 0x7f259c0712c0 2023-10-03T19:19:25.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.240+0000 7f25a1652640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f259c1508b0 con 0x7f259c06c760 2023-10-03T19:19:25.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.240+0000 7f259affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f259c0712c0 0x7f259c0bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:25.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.240+0000 7f259affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f259c0712c0 0x7f259c0bcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42406/0 (socket says 172.21.15.45:42406) 2023-10-03T19:19:25.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.240+0000 7f259affd640 1 -- 172.21.15.45:0/2429685841 learned_addr learned my addr 172.21.15.45:0/2429685841 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:25.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.240+0000 7f259b7fe640 1 --2- 172.21.15.45:0/2429685841 >> v2:172.21.15.79:3300/0 conn(0x7f259c06c760 0x7f259c0bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:25.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.240+0000 7f259affd640 1 -- 172.21.15.45:0/2429685841 >> v2:172.21.15.79:3300/0 conn(0x7f259c06c760 msgr2=0x7f259c0bd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:25.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.240+0000 7f259affd640 1 --2- 172.21.15.45:0/2429685841 >> v2:172.21.15.79:3300/0 conn(0x7f259c06c760 0x7f259c0bd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:25.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.240+0000 7f259affd640 1 -- 172.21.15.45:0/2429685841 >> v1:172.21.15.79:6789/0 conn(0x7f259c06d560 legacy=0x7f259c0a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:25.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.240+0000 7f259affd640 1 -- 172.21.15.45:0/2429685841 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259c06d2e0 con 0x7f259c0712c0 2023-10-03T19:19:25.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.244+0000 7f259affd640 1 --2- 172.21.15.45:0/2429685841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f259c0712c0 0x7f259c0bcbc0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f259c0c14e0 tx=0x7f258c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40363a6a4fcbda6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:25.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.244+0000 7f259a7fc640 1 -- 172.21.15.45:0/2429685841 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c0ab640 con 0x7f259c0712c0 2023-10-03T19:19:25.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.244+0000 7f259a7fc640 1 -- 172.21.15.45:0/2429685841 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258c0a7070 con 0x7f259c0712c0 2023-10-03T19:19:25.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.244+0000 7f259a7fc640 1 -- 172.21.15.45:0/2429685841 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c0ab9c0 con 0x7f259c0712c0 2023-10-03T19:19:25.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.244+0000 7f25a1652640 1 -- 172.21.15.45:0/2429685841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f259c0712c0 msgr2=0x7f259c0bcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:25.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.244+0000 7f25a1652640 1 --2- 172.21.15.45:0/2429685841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f259c0712c0 0x7f259c0bcbc0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f259c0c14e0 tx=0x7f258c01c500 comp rx=0 tx=0).stop 2023-10-03T19:19:25.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.244+0000 7f25a1652640 1 -- 172.21.15.45:0/2429685841 shutdown_connections 2023-10-03T19:19:25.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.244+0000 7f25a1652640 1 --2- 172.21.15.45:0/2429685841 >> v2:172.21.15.79:3300/0 conn(0x7f259c06c760 0x7f259c0bd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:25.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.244+0000 7f25a1652640 1 --2- 172.21.15.45:0/2429685841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f259c0712c0 0x7f259c0bcbc0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:25.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.244+0000 7f25a1652640 1 -- 172.21.15.45:0/2429685841 >> 172.21.15.45:0/2429685841 conn(0x7f259c0a20d0 msgr2=0x7f259c0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:25.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.244+0000 7f25a1652640 1 -- 172.21.15.45:0/2429685841 shutdown_connections 2023-10-03T19:19:25.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.244+0000 7f25a1652640 1 -- 172.21.15.45:0/2429685841 wait complete. 2023-10-03T19:19:25.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.248+0000 7f25a1652640 1 Processor -- start 2023-10-03T19:19:25.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.248+0000 7f25a1652640 1 -- start start 2023-10-03T19:19:25.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.248+0000 7f25a1652640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f259c06c760 0x7f259c0b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:25.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.248+0000 7f25a1652640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f259c06d560 0x7f259c14c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:25.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.248+0000 7f25a1652640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f259c0712c0 0x7f259c14ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:25.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.248+0000 7f25a1652640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c1e5710 con 0x7f259c06d560 2023-10-03T19:19:25.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.248+0000 7f25a1652640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c0b9b40 con 0x7f259c06c760 2023-10-03T19:19:25.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.248+0000 7f25a1652640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f259c0b9e20 con 0x7f259c0712c0 2023-10-03T19:19:25.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.248+0000 7f2593fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f259c06d560 0x7f259c14c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:25.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.248+0000 7f2593fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f259c06d560 0x7f259c14c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42410/0 (socket says 172.21.15.45:42410) 2023-10-03T19:19:25.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.248+0000 7f2593fff640 1 -- 172.21.15.45:0/451625756 learned_addr learned my addr 172.21.15.45:0/451625756 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:25.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.248+0000 7f259b7fe640 1 --2- 172.21.15.45:0/451625756 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f259c0712c0 0x7f259c14ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:25.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.248+0000 7f259affd640 1 --2- 172.21.15.45:0/451625756 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f259c06c760 0x7f259c0b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:25.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.248+0000 7f2593fff640 1 -- 172.21.15.45:0/451625756 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f259c0712c0 msgr2=0x7f259c14ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:25.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.248+0000 7f2593fff640 1 --2- 172.21.15.45:0/451625756 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f259c0712c0 0x7f259c14ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:25.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.248+0000 7f2593fff640 1 -- 172.21.15.45:0/451625756 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f259c06c760 msgr2=0x7f259c0b5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:25.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.248+0000 7f2593fff640 1 --2- 172.21.15.45:0/451625756 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f259c06c760 0x7f259c0b5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:25.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.248+0000 7f2593fff640 1 -- 172.21.15.45:0/451625756 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258c0094d0 con 0x7f259c06d560 2023-10-03T19:19:25.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.248+0000 7f2593fff640 1 --2- 172.21.15.45:0/451625756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f259c06d560 0x7f259c14c910 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f258400c500 tx=0x7f258400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:25.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.248+0000 7f25937fe640 1 -- 172.21.15.45:0/451625756 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2584005220 con 0x7f259c06d560 2023-10-03T19:19:25.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.248+0000 7f25937fe640 1 -- 172.21.15.45:0/451625756 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2584005380 con 0x7f259c06d560 2023-10-03T19:19:25.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.248+0000 7f25a1652640 1 -- 172.21.15.45:0/451625756 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f259c0a6070 con 0x7f259c06d560 2023-10-03T19:19:25.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.248+0000 7f25937fe640 1 -- 172.21.15.45:0/451625756 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2584007270 con 0x7f259c06d560 2023-10-03T19:19:25.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.248+0000 7f25a1652640 1 -- 172.21.15.45:0/451625756 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f259c0a5ee0 con 0x7f259c06d560 2023-10-03T19:19:25.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.248+0000 7f25a1652640 1 -- 172.21.15.45:0/451625756 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f259c1596f0 con 0x7f259c06d560 2023-10-03T19:19:25.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.248+0000 7f25937fe640 1 -- 172.21.15.45:0/451625756 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f25840073d0 con 0x7f259c06d560 2023-10-03T19:19:25.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.252+0000 7f25937fe640 1 --2- 172.21.15.45:0/451625756 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f257c066280 0x7f257c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:25.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.252+0000 7f25937fe640 1 -- 172.21.15.45:0/451625756 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f2584083730 con 0x7f259c06d560 2023-10-03T19:19:25.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.252+0000 7f259affd640 1 --2- 172.21.15.45:0/451625756 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f257c066280 0x7f257c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:25.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.252+0000 7f259affd640 1 --2- 172.21.15.45:0/451625756 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f257c066280 0x7f257c068730 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f258c0af000 tx=0x7f258c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:25.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.256+0000 7f25937fe640 1 -- 172.21.15.45:0/451625756 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2584050b20 con 0x7f259c06d560 2023-10-03T19:19:25.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.408+0000 7f25a1652640 1 -- 172.21.15.45:0/451625756 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f259c0bca30 con 0x7f259c06d560 2023-10-03T19:19:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.408+0000 7f25937fe640 1 -- 172.21.15.45:0/451625756 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2584054140 con 0x7f259c06d560 2023-10-03T19:19:25.412 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-03T19:19:25.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.412+0000 7f25a1652640 1 -- 172.21.15.45:0/451625756 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f257c066280 msgr2=0x7f257c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:25.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.412+0000 7f25a1652640 1 --2- 172.21.15.45:0/451625756 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f257c066280 0x7f257c068730 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f258c0af000 tx=0x7f258c008040 comp rx=0 tx=0).stop 2023-10-03T19:19:25.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.412+0000 7f25a1652640 1 -- 172.21.15.45:0/451625756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f259c06d560 msgr2=0x7f259c14c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:25.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.412+0000 7f25a1652640 1 --2- 172.21.15.45:0/451625756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f259c06d560 0x7f259c14c910 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f258400c500 tx=0x7f258400c9c0 comp rx=0 tx=0).stop 2023-10-03T19:19:25.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.412+0000 7f25a1652640 1 -- 172.21.15.45:0/451625756 shutdown_connections 2023-10-03T19:19:25.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.412+0000 7f25a1652640 1 --2- 172.21.15.45:0/451625756 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f257c066280 0x7f257c068730 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:25.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.412+0000 7f25a1652640 1 --2- 172.21.15.45:0/451625756 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f259c0712c0 0x7f259c14ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:25.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.412+0000 7f25a1652640 1 --2- 172.21.15.45:0/451625756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f259c06d560 0x7f259c14c910 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:25.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.412+0000 7f25a1652640 1 --2- 172.21.15.45:0/451625756 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f259c06c760 0x7f259c0b5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:25.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.412+0000 7f25a1652640 1 -- 172.21.15.45:0/451625756 >> 172.21.15.45:0/451625756 conn(0x7f259c0a20d0 msgr2=0x7f259c0a2880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:25.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.412+0000 7f25a1652640 1 -- 172.21.15.45:0/451625756 shutdown_connections 2023-10-03T19:19:25.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.412+0000 7f25a1652640 1 -- 172.21.15.45:0/451625756 wait complete. 2023-10-03T19:19:25.431 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:19:25.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70fd034640 1 Processor -- start 2023-10-03T19:19:25.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70fd034640 1 -- start start 2023-10-03T19:19:25.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70fd034640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f70f80bc8b0 0x7f70f814ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:25.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70fd034640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f806cac0 con 0x7f70f806f170 2023-10-03T19:19:25.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70fd034640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f80720d0 con 0x7f70f806d170 2023-10-03T19:19:25.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70fd034640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f80a5ab0 con 0x7f70f80bc8b0 2023-10-03T19:19:25.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70f6d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f70f806f170 0x7f70f8150190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51320/0 (socket says 172.21.15.45:51320) 2023-10-03T19:19:25.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70f6d9d640 1 -- 172.21.15.45:0/2540612960 learned_addr learned my addr 172.21.15.45:0/2540612960 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:25.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70f659c640 1 --2- 172.21.15.45:0/2540612960 >> v2:172.21.15.79:3300/0 conn(0x7f70f80bc8b0 0x7f70f814ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:25.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70f5d9b640 1 -- 172.21.15.45:0/2540612960 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 289447835 0 0) 0x7f70e8001120 con 0x7f70f806f170 2023-10-03T19:19:25.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70f5d9b640 1 -- 172.21.15.45:0/2540612960 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70e0003530 con 0x7f70f806f170 2023-10-03T19:19:25.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70f5d9b640 1 -- 172.21.15.45:0/2540612960 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 919747834 0 0) 0x7f70e0003530 con 0x7f70f806f170 2023-10-03T19:19:25.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70f5d9b640 1 -- 172.21.15.45:0/2540612960 >> v2:172.21.15.79:3300/0 conn(0x7f70f80bc8b0 msgr2=0x7f70f814ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:25.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70f5d9b640 1 --2- 172.21.15.45:0/2540612960 >> v2:172.21.15.79:3300/0 conn(0x7f70f80bc8b0 0x7f70f814ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:25.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70f5d9b640 1 -- 172.21.15.45:0/2540612960 >> v1:172.21.15.79:6789/0 conn(0x7f70f806d170 legacy=0x7f70f814cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:25.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70f5d9b640 1 -- 172.21.15.45:0/2540612960 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f806cd00 con 0x7f70f806f170 2023-10-03T19:19:25.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70f5d9b640 1 -- 172.21.15.45:0/2540612960 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f70e8001810 con 0x7f70f806f170 2023-10-03T19:19:25.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70f5d9b640 1 -- 172.21.15.45:0/2540612960 >> v1:172.21.15.45:6789/0 conn(0x7f70f806f170 legacy=0x7f70f8150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:25.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70f5d9b640 1 --2- 172.21.15.45:0/2540612960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70e0003980 0x7f70e0003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:25.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70f5d9b640 1 --2- 172.21.15.45:0/2540612960 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f70e0004370 0x7f70e0004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:25.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70f5d9b640 1 --2- 172.21.15.45:0/2540612960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70e0005030 0x7f70e000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:25.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70f5d9b640 1 -- 172.21.15.45:0/2540612960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f80a5ab0 con 0x7f70e0003980 2023-10-03T19:19:25.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70f5d9b640 1 -- 172.21.15.45:0/2540612960 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e000bed0 con 0x7f70e0005030 2023-10-03T19:19:25.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70f5d9b640 1 -- 172.21.15.45:0/2540612960 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e000c090 con 0x7f70e0004370 2023-10-03T19:19:25.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70f6d9d640 1 --2- 172.21.15.45:0/2540612960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70e0003980 0x7f70e0003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:25.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70f659c640 1 --2- 172.21.15.45:0/2540612960 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f70e0004370 0x7f70e0004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:25.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70f759e640 1 --2- 172.21.15.45:0/2540612960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70e0005030 0x7f70e000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:25.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70f6d9d640 1 -- 172.21.15.45:0/2540612960 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f70e0004370 msgr2=0x7f70e0004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:25.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70f6d9d640 1 --2- 172.21.15.45:0/2540612960 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f70e0004370 0x7f70e0004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:25.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70f6d9d640 1 -- 172.21.15.45:0/2540612960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70e0005030 msgr2=0x7f70e000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:25.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70f6d9d640 1 --2- 172.21.15.45:0/2540612960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70e0005030 0x7f70e000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:25.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70f6d9d640 1 -- 172.21.15.45:0/2540612960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e0003530 con 0x7f70e0003980 2023-10-03T19:19:25.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70f759e640 1 --2- 172.21.15.45:0/2540612960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70e0005030 0x7f70e000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:25.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.548+0000 7f70f759e640 1 -- 172.21.15.45:0/2540612960 reap_dead start 2023-10-03T19:19:25.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.552+0000 7f70f6d9d640 1 --2- 172.21.15.45:0/2540612960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70e0003980 0x7f70e0003d50 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f70e800c190 tx=0x7f70e801cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc90281cc6353dfe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:25.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.552+0000 7f70f5d9b640 1 -- 172.21.15.45:0/2540612960 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e8005ae0 con 0x7f70e0003980 2023-10-03T19:19:25.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.552+0000 7f70f5d9b640 1 -- 172.21.15.45:0/2540612960 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e8005c40 con 0x7f70e0003980 2023-10-03T19:19:25.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.552+0000 7f70f5d9b640 1 -- 172.21.15.45:0/2540612960 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e80a57b0 con 0x7f70e0003980 2023-10-03T19:19:25.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.552+0000 7f70fd034640 1 -- 172.21.15.45:0/2540612960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70e0003980 msgr2=0x7f70e0003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:25.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.552+0000 7f70fd034640 1 --2- 172.21.15.45:0/2540612960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70e0003980 0x7f70e0003d50 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f70e800c190 tx=0x7f70e801cbc0 comp rx=0 tx=0).stop 2023-10-03T19:19:25.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.552+0000 7f70fd034640 1 -- 172.21.15.45:0/2540612960 shutdown_connections 2023-10-03T19:19:25.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.552+0000 7f70fd034640 1 --2- 172.21.15.45:0/2540612960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70e0003980 0x7f70e0003d50 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:25.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.552+0000 7f70fd034640 1 -- 172.21.15.45:0/2540612960 >> 172.21.15.45:0/2540612960 conn(0x7f70f80bcf50 msgr2=0x7f70f80bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:25.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.552+0000 7f70fd034640 1 -- 172.21.15.45:0/2540612960 shutdown_connections 2023-10-03T19:19:25.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.552+0000 7f70fd034640 1 -- 172.21.15.45:0/2540612960 wait complete. 2023-10-03T19:19:25.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.552+0000 7f70fd034640 1 Processor -- start 2023-10-03T19:19:25.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.552+0000 7f70fd034640 1 -- start start 2023-10-03T19:19:25.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.556+0000 7f70fd034640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70e0003980 0x7f70f81d5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:25.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.556+0000 7f70fd034640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f70f8143510 0x7f70f8145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:25.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.556+0000 7f70fd034640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70f81463e0 0x7f70f81d6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:25.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.556+0000 7f70fd034640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f81d63e0 con 0x7f70f81463e0 2023-10-03T19:19:25.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.556+0000 7f70fd034640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f81447b0 con 0x7f70e0003980 2023-10-03T19:19:25.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.556+0000 7f70fd034640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f81d5fa0 con 0x7f70f8143510 2023-10-03T19:19:25.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.556+0000 7f70f759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70f81463e0 0x7f70f81d6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:25.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.556+0000 7f70f759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70f81463e0 0x7f70f81d6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42420/0 (socket says 172.21.15.45:42420) 2023-10-03T19:19:25.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.556+0000 7f70f759e640 1 -- 172.21.15.45:0/2510052949 learned_addr learned my addr 172.21.15.45:0/2510052949 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:25.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.556+0000 7f70f659c640 1 --2- 172.21.15.45:0/2510052949 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f70f8143510 0x7f70f8145ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:25.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.556+0000 7f70f6d9d640 1 --2- 172.21.15.45:0/2510052949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70e0003980 0x7f70f81d5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:25.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.556+0000 7f70f759e640 1 -- 172.21.15.45:0/2510052949 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f70f8143510 msgr2=0x7f70f8145ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:25.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.556+0000 7f70f759e640 1 --2- 172.21.15.45:0/2510052949 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f70f8143510 0x7f70f8145ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:25.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.556+0000 7f70f759e640 1 -- 172.21.15.45:0/2510052949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70e0003980 msgr2=0x7f70f81d5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:25.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.556+0000 7f70f759e640 1 --2- 172.21.15.45:0/2510052949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70e0003980 0x7f70f81d5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:25.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.556+0000 7f70f759e640 1 -- 172.21.15.45:0/2510052949 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f814c4a0 con 0x7f70f81463e0 2023-10-03T19:19:25.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.556+0000 7f70f6d9d640 1 --2- 172.21.15.45:0/2510052949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70e0003980 0x7f70f81d5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:19:25.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.556+0000 7f70f759e640 1 --2- 172.21.15.45:0/2510052949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70f81463e0 0x7f70f81d6e50 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f70f0007870 tx=0x7f70f0007960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:25.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.556+0000 7f70df7fe640 1 -- 172.21.15.45:0/2510052949 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f000e790 con 0x7f70f81463e0 2023-10-03T19:19:25.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.556+0000 7f70df7fe640 1 -- 172.21.15.45:0/2510052949 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f000e910 con 0x7f70f81463e0 2023-10-03T19:19:25.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.556+0000 7f70fd034640 1 -- 172.21.15.45:0/2510052949 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f814fae0 con 0x7f70f81463e0 2023-10-03T19:19:25.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.556+0000 7f70df7fe640 1 -- 172.21.15.45:0/2510052949 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f000ecc0 con 0x7f70f81463e0 2023-10-03T19:19:25.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.556+0000 7f70fd034640 1 -- 172.21.15.45:0/2510052949 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f806f540 con 0x7f70f81463e0 2023-10-03T19:19:25.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.556+0000 7f70fd034640 1 -- 172.21.15.45:0/2510052949 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f806d660 con 0x7f70f81463e0 2023-10-03T19:19:25.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.556+0000 7f70df7fe640 1 -- 172.21.15.45:0/2510052949 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f70f001e3b0 con 0x7f70f81463e0 2023-10-03T19:19:25.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.556+0000 7f70df7fe640 1 --2- 172.21.15.45:0/2510052949 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f70e4066280 0x7f70e4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:25.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.556+0000 7f70df7fe640 1 -- 172.21.15.45:0/2510052949 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f70f00865d0 con 0x7f70f81463e0 2023-10-03T19:19:25.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.556+0000 7f70f6d9d640 1 --2- 172.21.15.45:0/2510052949 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f70e4066280 0x7f70e4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:25.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.560+0000 7f70f6d9d640 1 --2- 172.21.15.45:0/2510052949 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f70e4066280 0x7f70e4068730 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f70e8005fd0 tx=0x7f70e80b1040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:25.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.560+0000 7f70df7fe640 1 -- 172.21.15.45:0/2510052949 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f70f0053a50 con 0x7f70f81463e0 2023-10-03T19:19:25.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.748+0000 7f70fd034640 1 -- 172.21.15.45:0/2510052949 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70f806aae0 con 0x7f70f81463e0 2023-10-03T19:19:25.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.752+0000 7f70df7fe640 1 -- 172.21.15.45:0/2510052949 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+3910 (secure 0 0 0) 0x7f70f0057070 con 0x7f70f81463e0 2023-10-03T19:19:25.754 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:19:25.754 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":44,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6094,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3237510777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3237510777},{"type":"v1","addr":"172.21.15.79:6835","nonce":3237510777}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6717,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/697890515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":697890515},{"type":"v1","addr":"172.21.15.45:6833","nonce":697890515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:18:28.260345+0000","modified":"2023-10-03T19:18:31.278054+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6720},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6720":{"gid":6720,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/125100321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":125100321},{"type":"v1","addr":"172.21.15.45:6835","nonce":125100321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-10-03T19:19:25.755 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 44 2023-10-03T19:19:25.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.752+0000 7f70fd034640 1 -- 172.21.15.45:0/2510052949 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f70e4066280 msgr2=0x7f70e4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:25.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.752+0000 7f70fd034640 1 --2- 172.21.15.45:0/2510052949 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f70e4066280 0x7f70e4068730 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f70e8005fd0 tx=0x7f70e80b1040 comp rx=0 tx=0).stop 2023-10-03T19:19:25.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.752+0000 7f70fd034640 1 -- 172.21.15.45:0/2510052949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70f81463e0 msgr2=0x7f70f81d6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:25.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.752+0000 7f70fd034640 1 --2- 172.21.15.45:0/2510052949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70f81463e0 0x7f70f81d6e50 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f70f0007870 tx=0x7f70f0007960 comp rx=0 tx=0).stop 2023-10-03T19:19:25.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.752+0000 7f70fd034640 1 -- 172.21.15.45:0/2510052949 shutdown_connections 2023-10-03T19:19:25.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.752+0000 7f70fd034640 1 --2- 172.21.15.45:0/2510052949 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f70e4066280 0x7f70e4068730 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:25.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.752+0000 7f70fd034640 1 --2- 172.21.15.45:0/2510052949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70f81463e0 0x7f70f81d6e50 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:25.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.752+0000 7f70fd034640 1 --2- 172.21.15.45:0/2510052949 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f70f8143510 0x7f70f8145ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:25.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.752+0000 7f70fd034640 1 --2- 172.21.15.45:0/2510052949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70e0003980 0x7f70f81d5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:25.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.752+0000 7f70fd034640 1 -- 172.21.15.45:0/2510052949 >> 172.21.15.45:0/2510052949 conn(0x7f70f80bcf50 msgr2=0x7f70f8070b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:25.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.752+0000 7f70fd034640 1 -- 172.21.15.45:0/2510052949 shutdown_connections 2023-10-03T19:19:25.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.752+0000 7f70fd034640 1 -- 172.21.15.45:0/2510052949 wait complete. 2023-10-03T19:19:25.771 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:19:25.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.876+0000 7f0c2ebf4640 1 Processor -- start 2023-10-03T19:19:25.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.876+0000 7f0c2ebf4640 1 -- start start 2023-10-03T19:19:25.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.880+0000 7f0c2ebf4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0c2814f240 0x7f0c281528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:25.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.880+0000 7f0c2ebf4640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c2806b2d0 con 0x7f0c280bb1d0 2023-10-03T19:19:25.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.880+0000 7f0c2ebf4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c280a3c60 con 0x7f0c280c2790 2023-10-03T19:19:25.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.880+0000 7f0c2ebf4640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c2806b640 con 0x7f0c2814f240 2023-10-03T19:19:25.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.880+0000 7f0c2c990640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0c2814f240 0x7f0c281528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:25.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.880+0000 7f0c2d191640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0c280bb1d0 0x7f0c280c12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51322/0 (socket says 172.21.15.45:51322) 2023-10-03T19:19:25.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.880+0000 7f0c2d191640 1 -- 172.21.15.45:0/794449007 learned_addr learned my addr 172.21.15.45:0/794449007 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:25.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.880+0000 7f0c2c990640 1 -- 172.21.15.45:0/794449007 >> v1:172.21.15.79:6789/0 conn(0x7f0c280c2790 legacy=0x7f0c280c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:25.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.880+0000 7f0c2c990640 1 -- 172.21.15.45:0/794449007 >> v1:172.21.15.45:6789/0 conn(0x7f0c280bb1d0 legacy=0x7f0c280c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:25.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.880+0000 7f0c2c990640 1 -- 172.21.15.45:0/794449007 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c280c19b0 con 0x7f0c2814f240 2023-10-03T19:19:25.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.880+0000 7f0c277fe640 1 -- 172.21.15.45:0/794449007 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1282706495 0 0) 0x7f0c2806b2d0 con 0x7f0c280bb1d0 2023-10-03T19:19:25.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.880+0000 7f0c2c990640 1 --2- 172.21.15.45:0/794449007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c2814f240 0x7f0c281528d0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f0c180097a0 tx=0x7f0c1801ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c1c189880b58411 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:25.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.880+0000 7f0c277fe640 1 -- 172.21.15.45:0/794449007 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c180a8910 con 0x7f0c2814f240 2023-10-03T19:19:25.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.880+0000 7f0c277fe640 1 -- 172.21.15.45:0/794449007 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c180a8a70 con 0x7f0c2814f240 2023-10-03T19:19:25.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.880+0000 7f0c277fe640 1 -- 172.21.15.45:0/794449007 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c180a8e00 con 0x7f0c2814f240 2023-10-03T19:19:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.880+0000 7f0c2ebf4640 1 -- 172.21.15.45:0/794449007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c2814f240 msgr2=0x7f0c281528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.880+0000 7f0c2ebf4640 1 --2- 172.21.15.45:0/794449007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c2814f240 0x7f0c281528d0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f0c180097a0 tx=0x7f0c1801ec10 comp rx=0 tx=0).stop 2023-10-03T19:19:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.880+0000 7f0c2ebf4640 1 -- 172.21.15.45:0/794449007 shutdown_connections 2023-10-03T19:19:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.880+0000 7f0c2ebf4640 1 --2- 172.21.15.45:0/794449007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c2814f240 0x7f0c281528d0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.880+0000 7f0c2ebf4640 1 -- 172.21.15.45:0/794449007 >> 172.21.15.45:0/794449007 conn(0x7f0c280a64a0 msgr2=0x7f0c280a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:25.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.880+0000 7f0c2ebf4640 1 -- 172.21.15.45:0/794449007 shutdown_connections 2023-10-03T19:19:25.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.880+0000 7f0c2ebf4640 1 -- 172.21.15.45:0/794449007 wait complete. 2023-10-03T19:19:25.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.884+0000 7f0c2ebf4640 1 Processor -- start 2023-10-03T19:19:25.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.884+0000 7f0c2ebf4640 1 -- start start 2023-10-03T19:19:25.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.884+0000 7f0c2ebf4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c280bb1d0 0x7f0c280a5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:25.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.884+0000 7f0c2ebf4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c280c2790 0x7f0c2814a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:25.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.884+0000 7f0c2ebf4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c2814f240 0x7f0c2814ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:25.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.884+0000 7f0c2ebf4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c280c3750 con 0x7f0c2814f240 2023-10-03T19:19:25.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.884+0000 7f0c2ebf4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c280a7d00 con 0x7f0c280bb1d0 2023-10-03T19:19:25.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.884+0000 7f0c2ebf4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c280a87a0 con 0x7f0c280c2790 2023-10-03T19:19:25.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.884+0000 7f0c2d191640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c2814f240 0x7f0c2814ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:25.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.884+0000 7f0c2d191640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c2814f240 0x7f0c2814ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42452/0 (socket says 172.21.15.45:42452) 2023-10-03T19:19:25.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.884+0000 7f0c2d191640 1 -- 172.21.15.45:0/2986180302 learned_addr learned my addr 172.21.15.45:0/2986180302 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:25.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.884+0000 7f0c2d191640 1 -- 172.21.15.45:0/2986180302 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c280c2790 msgr2=0x7f0c2814a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:25.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.884+0000 7f0c2d191640 1 --2- 172.21.15.45:0/2986180302 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c280c2790 0x7f0c2814a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:25.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.884+0000 7f0c2d191640 1 -- 172.21.15.45:0/2986180302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c280bb1d0 msgr2=0x7f0c280a5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:25.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.884+0000 7f0c2d191640 1 --2- 172.21.15.45:0/2986180302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c280bb1d0 0x7f0c280a5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:25.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.884+0000 7f0c2d191640 1 -- 172.21.15.45:0/2986180302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c180093b0 con 0x7f0c2814f240 2023-10-03T19:19:25.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.884+0000 7f0c2d191640 1 --2- 172.21.15.45:0/2986180302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c2814f240 0x7f0c2814ae00 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f0c2000c7d0 tx=0x7f0c2000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:25.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.884+0000 7f0c257fa640 1 -- 172.21.15.45:0/2986180302 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2000a640 con 0x7f0c2814f240 2023-10-03T19:19:25.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.884+0000 7f0c257fa640 1 -- 172.21.15.45:0/2986180302 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c2000a7a0 con 0x7f0c2814f240 2023-10-03T19:19:25.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.884+0000 7f0c2ebf4640 1 -- 172.21.15.45:0/2986180302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c280a3f40 con 0x7f0c2814f240 2023-10-03T19:19:25.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.884+0000 7f0c257fa640 1 -- 172.21.15.45:0/2986180302 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2000ab90 con 0x7f0c2814f240 2023-10-03T19:19:25.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.884+0000 7f0c2ebf4640 1 -- 172.21.15.45:0/2986180302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c2814e740 con 0x7f0c2814f240 2023-10-03T19:19:25.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.884+0000 7f0c2ebf4640 1 -- 172.21.15.45:0/2986180302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c2814f610 con 0x7f0c2814f240 2023-10-03T19:19:25.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.884+0000 7f0c257fa640 1 -- 172.21.15.45:0/2986180302 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0c2000acf0 con 0x7f0c2814f240 2023-10-03T19:19:25.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.884+0000 7f0c257fa640 1 --2- 172.21.15.45:0/2986180302 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0c14066280 0x7f0c14068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:25.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.888+0000 7f0c257fa640 1 -- 172.21.15.45:0/2986180302 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f0c20083670 con 0x7f0c2814f240 2023-10-03T19:19:25.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.888+0000 7f0c2c990640 1 --2- 172.21.15.45:0/2986180302 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0c14066280 0x7f0c14068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:25.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.888+0000 7f0c2c990640 1 --2- 172.21.15.45:0/2986180302 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0c14066280 0x7f0c14068730 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0c180b2000 tx=0x7f0c18008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:25.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:25.892+0000 7f0c257fa640 1 -- 172.21.15.45:0/2986180302 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0c20050a50 con 0x7f0c2814f240 2023-10-03T19:19:26.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.048+0000 7f0c2ebf4640 1 -- 172.21.15.45:0/2986180302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c280a7e40 con 0x7f0c2814f240 2023-10-03T19:19:26.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.048+0000 7f0c257fa640 1 -- 172.21.15.45:0/2986180302 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+18501 (secure 0 0 0) 0x7f0c280a7e40 con 0x7f0c2814f240 2023-10-03T19:19:26.052 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:19:26.052 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":87,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:19:14.804643+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:18:25.942883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-10-03T19:18:27.242940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.2","mappings":[{"from":1,"to":2}]},{"pgid":"14.26","mappings":[{"from":1,"to":7}]},{"pgid":"14.29","mappings":[{"from":1,"to":7}]},{"pgid":"14.32","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:0/2938203609":"2023-10-03T20:19:12.888501+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:19:26.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.052+0000 7f0c2ebf4640 1 -- 172.21.15.45:0/2986180302 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0c14066280 msgr2=0x7f0c14068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:26.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.052+0000 7f0c2ebf4640 1 --2- 172.21.15.45:0/2986180302 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0c14066280 0x7f0c14068730 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0c180b2000 tx=0x7f0c18008040 comp rx=0 tx=0).stop 2023-10-03T19:19:26.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.052+0000 7f0c2ebf4640 1 -- 172.21.15.45:0/2986180302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c2814f240 msgr2=0x7f0c2814ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:26.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.052+0000 7f0c2ebf4640 1 --2- 172.21.15.45:0/2986180302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c2814f240 0x7f0c2814ae00 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f0c2000c7d0 tx=0x7f0c2000cc90 comp rx=0 tx=0).stop 2023-10-03T19:19:26.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.052+0000 7f0c2ebf4640 1 -- 172.21.15.45:0/2986180302 shutdown_connections 2023-10-03T19:19:26.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.052+0000 7f0c2ebf4640 1 --2- 172.21.15.45:0/2986180302 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0c14066280 0x7f0c14068730 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.052+0000 7f0c2ebf4640 1 --2- 172.21.15.45:0/2986180302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c2814f240 0x7f0c2814ae00 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.052+0000 7f0c2ebf4640 1 --2- 172.21.15.45:0/2986180302 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c280c2790 0x7f0c2814a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.052+0000 7f0c2ebf4640 1 --2- 172.21.15.45:0/2986180302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c280bb1d0 0x7f0c280a5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.052+0000 7f0c2ebf4640 1 -- 172.21.15.45:0/2986180302 >> 172.21.15.45:0/2986180302 conn(0x7f0c280a64a0 msgr2=0x7f0c280c12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:26.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.052+0000 7f0c2ebf4640 1 -- 172.21.15.45:0/2986180302 shutdown_connections 2023-10-03T19:19:26.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.052+0000 7f0c2ebf4640 1 -- 172.21.15.45:0/2986180302 wait complete. 2023-10-03T19:19:26.070 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-03T19:19:26.071 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:19:26.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.184+0000 7fce38c13640 1 Processor -- start 2023-10-03T19:19:26.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.184+0000 7fce38c13640 1 -- start start 2023-10-03T19:19:26.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce38c13640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fce3406f170 0x7fce34150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:26.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce38c13640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce340bc8b0 0x7fce3414ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:26.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce38c13640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce3406cac0 con 0x7fce3406d170 2023-10-03T19:19:26.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce38c13640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce340720d0 con 0x7fce3406f170 2023-10-03T19:19:26.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce38c13640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce340a5ab0 con 0x7fce340bc8b0 2023-10-03T19:19:26.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce32d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fce3406d170 0x7fce3414cfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51336/0 (socket says 172.21.15.45:51336) 2023-10-03T19:19:26.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce32d9d640 1 -- 172.21.15.45:0/2798880910 learned_addr learned my addr 172.21.15.45:0/2798880910 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:26.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce2bfff640 1 --2- 172.21.15.45:0/2798880910 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce340bc8b0 0x7fce3414ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:26.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce3259c640 1 --2- 172.21.15.45:0/2798880910 >> v2:172.21.15.79:3300/0 conn(0x7fce3406f170 0x7fce34150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:26.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce31d9b640 1 -- 172.21.15.45:0/2798880910 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1182005895 0 0) 0x7fce2c0014a0 con 0x7fce3406d170 2023-10-03T19:19:26.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce31d9b640 1 -- 172.21.15.45:0/2798880910 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce20003530 con 0x7fce3406d170 2023-10-03T19:19:26.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce31d9b640 1 -- 172.21.15.45:0/2798880910 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3930334711 0 0) 0x7fce20003530 con 0x7fce3406d170 2023-10-03T19:19:26.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce31d9b640 1 -- 172.21.15.45:0/2798880910 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce340bc8b0 msgr2=0x7fce3414ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:26.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce31d9b640 1 --2- 172.21.15.45:0/2798880910 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce340bc8b0 0x7fce3414ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce31d9b640 1 -- 172.21.15.45:0/2798880910 >> v2:172.21.15.79:3300/0 conn(0x7fce3406f170 msgr2=0x7fce34150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:26.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce31d9b640 1 --2- 172.21.15.45:0/2798880910 >> v2:172.21.15.79:3300/0 conn(0x7fce3406f170 0x7fce34150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce31d9b640 1 -- 172.21.15.45:0/2798880910 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3406cd00 con 0x7fce3406d170 2023-10-03T19:19:26.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce31d9b640 1 -- 172.21.15.45:0/2798880910 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fce2c001b90 con 0x7fce3406d170 2023-10-03T19:19:26.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce31d9b640 1 -- 172.21.15.45:0/2798880910 >> v1:172.21.15.45:6789/0 conn(0x7fce3406d170 legacy=0x7fce3414cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:26.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce31d9b640 1 --2- 172.21.15.45:0/2798880910 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce340bc8b0 0x7fce20003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:26.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce31d9b640 1 --2- 172.21.15.45:0/2798880910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce20003f00 0x7fce200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:26.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce31d9b640 1 --2- 172.21.15.45:0/2798880910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce20004d10 0x7fce20005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:26.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce31d9b640 1 -- 172.21.15.45:0/2798880910 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce340720d0 con 0x7fce20004d10 2023-10-03T19:19:26.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce31d9b640 1 -- 172.21.15.45:0/2798880910 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce340a5ab0 con 0x7fce20003f00 2023-10-03T19:19:26.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce31d9b640 1 -- 172.21.15.45:0/2798880910 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce2000b9c0 con 0x7fce340bc8b0 2023-10-03T19:19:26.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce32d9d640 1 --2- 172.21.15.45:0/2798880910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce20004d10 0x7fce20005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:26.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce3259c640 1 --2- 172.21.15.45:0/2798880910 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce340bc8b0 0x7fce20003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:26.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce2bfff640 1 --2- 172.21.15.45:0/2798880910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce20003f00 0x7fce200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:26.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce32d9d640 1 -- 172.21.15.45:0/2798880910 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce340bc8b0 msgr2=0x7fce20003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:26.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce32d9d640 1 --2- 172.21.15.45:0/2798880910 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce340bc8b0 0x7fce20003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce32d9d640 1 -- 172.21.15.45:0/2798880910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce20003f00 msgr2=0x7fce200047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:26.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce32d9d640 1 --2- 172.21.15.45:0/2798880910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce20003f00 0x7fce200047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.188+0000 7fce32d9d640 1 -- 172.21.15.45:0/2798880910 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce20003530 con 0x7fce20004d10 2023-10-03T19:19:26.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce32d9d640 1 --2- 172.21.15.45:0/2798880910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce20004d10 0x7fce20005180 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fce2c00a830 tx=0x7fce2c01d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c6f2e3b9ccd76c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:26.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce31d9b640 1 -- 172.21.15.45:0/2798880910 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c0ad630 con 0x7fce20004d10 2023-10-03T19:19:26.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce31d9b640 1 -- 172.21.15.45:0/2798880910 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2c0a8070 con 0x7fce20004d10 2023-10-03T19:19:26.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce31d9b640 1 -- 172.21.15.45:0/2798880910 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c0ad9d0 con 0x7fce20004d10 2023-10-03T19:19:26.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce38c13640 1 -- 172.21.15.45:0/2798880910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce20004d10 msgr2=0x7fce20005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:26.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce38c13640 1 --2- 172.21.15.45:0/2798880910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce20004d10 0x7fce20005180 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fce2c00a830 tx=0x7fce2c01d340 comp rx=0 tx=0).stop 2023-10-03T19:19:26.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce32d9d640 1 -- 172.21.15.45:0/2798880910 reap_dead start 2023-10-03T19:19:26.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce38c13640 1 -- 172.21.15.45:0/2798880910 shutdown_connections 2023-10-03T19:19:26.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce38c13640 1 -- 172.21.15.45:0/2798880910 >> 172.21.15.45:0/2798880910 conn(0x7fce340bcf50 msgr2=0x7fce340bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:26.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce38c13640 1 -- 172.21.15.45:0/2798880910 shutdown_connections 2023-10-03T19:19:26.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce38c13640 1 -- 172.21.15.45:0/2798880910 wait complete. 2023-10-03T19:19:26.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce38c13640 1 Processor -- start 2023-10-03T19:19:26.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce38c13640 1 -- start start 2023-10-03T19:19:26.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce38c13640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce20004d10 0x7fce340c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:26.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce38c13640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce3413e200 0x7fce341e51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:26.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce38c13640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce341e5700 0x7fce3413cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:26.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce38c13640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3413dc70 con 0x7fce20004d10 2023-10-03T19:19:26.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce38c13640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce341d7c00 con 0x7fce341e5700 2023-10-03T19:19:26.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce38c13640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce340bf9a0 con 0x7fce3413e200 2023-10-03T19:19:26.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce3259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce20004d10 0x7fce340c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:26.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce3259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce20004d10 0x7fce340c0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42468/0 (socket says 172.21.15.45:42468) 2023-10-03T19:19:26.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce3259c640 1 -- 172.21.15.45:0/2737756363 learned_addr learned my addr 172.21.15.45:0/2737756363 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:26.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce2bfff640 1 --2- 172.21.15.45:0/2737756363 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce3413e200 0x7fce341e51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:26.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce32d9d640 1 --2- 172.21.15.45:0/2737756363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce341e5700 0x7fce3413cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:26.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce3259c640 1 -- 172.21.15.45:0/2737756363 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce3413e200 msgr2=0x7fce341e51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:26.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce3259c640 1 --2- 172.21.15.45:0/2737756363 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce3413e200 0x7fce341e51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce3259c640 1 -- 172.21.15.45:0/2737756363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce341e5700 msgr2=0x7fce3413cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:26.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce3259c640 1 --2- 172.21.15.45:0/2737756363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce341e5700 0x7fce3413cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce3259c640 1 -- 172.21.15.45:0/2737756363 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3414c4a0 con 0x7fce20004d10 2023-10-03T19:19:26.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce3259c640 1 --2- 172.21.15.45:0/2737756363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce20004d10 0x7fce340c0ae0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fce24011660 tx=0x7fce24011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:26.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce2affd640 1 -- 172.21.15.45:0/2737756363 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2400f960 con 0x7fce20004d10 2023-10-03T19:19:26.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce2affd640 1 -- 172.21.15.45:0/2737756363 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2400fac0 con 0x7fce20004d10 2023-10-03T19:19:26.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.192+0000 7fce2affd640 1 -- 172.21.15.45:0/2737756363 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2400fe30 con 0x7fce20004d10 2023-10-03T19:19:26.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.196+0000 7fce38c13640 1 -- 172.21.15.45:0/2737756363 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce3414fae0 con 0x7fce20004d10 2023-10-03T19:19:26.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.196+0000 7fce38c13640 1 -- 172.21.15.45:0/2737756363 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce3406f540 con 0x7fce20004d10 2023-10-03T19:19:26.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.196+0000 7fce38c13640 1 -- 172.21.15.45:0/2737756363 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce3406d660 con 0x7fce20004d10 2023-10-03T19:19:26.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.196+0000 7fce2affd640 1 -- 172.21.15.45:0/2737756363 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fce24015460 con 0x7fce20004d10 2023-10-03T19:19:26.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.196+0000 7fce2affd640 1 --2- 172.21.15.45:0/2737756363 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fce14066280 0x7fce14068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:26.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.196+0000 7fce2affd640 1 -- 172.21.15.45:0/2737756363 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fce240842c0 con 0x7fce20004d10 2023-10-03T19:19:26.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.196+0000 7fce2bfff640 1 --2- 172.21.15.45:0/2737756363 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fce14066280 0x7fce14068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:26.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.196+0000 7fce2bfff640 1 --2- 172.21.15.45:0/2737756363 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fce14066280 0x7fce14068730 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fce3413e040 tx=0x7fce1c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:26.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.200+0000 7fce2affd640 1 -- 172.21.15.45:0/2737756363 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fce24051740 con 0x7fce20004d10 2023-10-03T19:19:26.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.384+0000 7fce38c13640 1 -- 172.21.15.45:0/2737756363 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce3404de80 con 0x7fce20004d10 2023-10-03T19:19:26.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.388+0000 7fce2affd640 1 -- 172.21.15.45:0/2737756363 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+3910 (secure 0 0 0) 0x7fce24054d60 con 0x7fce20004d10 2023-10-03T19:19:26.390 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:19:26.390 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":44,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6094,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3237510777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3237510777},{"type":"v1","addr":"172.21.15.79:6835","nonce":3237510777}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6717,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/697890515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":697890515},{"type":"v1","addr":"172.21.15.45:6833","nonce":697890515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:18:28.260345+0000","modified":"2023-10-03T19:18:31.278054+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6720},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6720":{"gid":6720,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/125100321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":125100321},{"type":"v1","addr":"172.21.15.45:6835","nonce":125100321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-10-03T19:19:26.391 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 44 2023-10-03T19:19:26.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.388+0000 7fce38c13640 1 -- 172.21.15.45:0/2737756363 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fce14066280 msgr2=0x7fce14068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:26.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.388+0000 7fce38c13640 1 --2- 172.21.15.45:0/2737756363 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fce14066280 0x7fce14068730 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fce3413e040 tx=0x7fce1c008040 comp rx=0 tx=0).stop 2023-10-03T19:19:26.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.388+0000 7fce38c13640 1 -- 172.21.15.45:0/2737756363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce20004d10 msgr2=0x7fce340c0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:26.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.388+0000 7fce38c13640 1 --2- 172.21.15.45:0/2737756363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce20004d10 0x7fce340c0ae0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fce24011660 tx=0x7fce24011b20 comp rx=0 tx=0).stop 2023-10-03T19:19:26.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.388+0000 7fce38c13640 1 -- 172.21.15.45:0/2737756363 shutdown_connections 2023-10-03T19:19:26.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.388+0000 7fce38c13640 1 --2- 172.21.15.45:0/2737756363 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fce14066280 0x7fce14068730 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.388+0000 7fce38c13640 1 --2- 172.21.15.45:0/2737756363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce341e5700 0x7fce3413cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.388+0000 7fce38c13640 1 --2- 172.21.15.45:0/2737756363 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fce3413e200 0x7fce341e51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.388+0000 7fce38c13640 1 --2- 172.21.15.45:0/2737756363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce20004d10 0x7fce340c0ae0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.388+0000 7fce38c13640 1 -- 172.21.15.45:0/2737756363 >> 172.21.15.45:0/2737756363 conn(0x7fce340bcf50 msgr2=0x7fce34070ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:26.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.388+0000 7fce38c13640 1 -- 172.21.15.45:0/2737756363 shutdown_connections 2023-10-03T19:19:26.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.388+0000 7fce38c13640 1 -- 172.21.15.45:0/2737756363 wait complete. 2023-10-03T19:19:26.408 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:19:26.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.512+0000 7f9ad18db640 1 Processor -- start 2023-10-03T19:19:26.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.512+0000 7f9ad18db640 1 -- start start 2023-10-03T19:19:26.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.516+0000 7f9ad18db640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9acc14f240 0x7f9acc1528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:26.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.516+0000 7f9ad18db640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9acc0c2790 0x7f9acc0c0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:26.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.516+0000 7f9ad18db640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9acc0bb1d0 0x7f9acc0c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:26.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.516+0000 7f9ad18db640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9acc06b640 con 0x7f9acc14f240 2023-10-03T19:19:26.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.516+0000 7f9ad18db640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9acc06b2d0 con 0x7f9acc0bb1d0 2023-10-03T19:19:26.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.516+0000 7f9ad18db640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc0c0fa0 con 0x7f9acc0c2790 2023-10-03T19:19:26.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.516+0000 7f9acaffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9acc14f240 0x7f9acc1528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:26.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.516+0000 7f9acaffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9acc14f240 0x7f9acc1528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42484/0 (socket says 172.21.15.45:42484) 2023-10-03T19:19:26.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.516+0000 7f9acaffd640 1 -- 172.21.15.45:0/334000626 learned_addr learned my addr 172.21.15.45:0/334000626 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:26.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.516+0000 7f9aca7fc640 1 --2- 172.21.15.45:0/334000626 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9acc0c2790 0x7f9acc0c0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:26.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.516+0000 7f9acaffd640 1 -- 172.21.15.45:0/334000626 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9acc0c2790 msgr2=0x7f9acc0c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:26.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.516+0000 7f9acaffd640 1 --2- 172.21.15.45:0/334000626 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9acc0c2790 0x7f9acc0c0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.516+0000 7f9acaffd640 1 -- 172.21.15.45:0/334000626 >> v2:172.21.15.79:3300/0 conn(0x7f9acc0bb1d0 msgr2=0x7f9acc0c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:26.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.516+0000 7f9acb7fe640 1 --2- 172.21.15.45:0/334000626 >> v2:172.21.15.79:3300/0 conn(0x7f9acc0bb1d0 0x7f9acc0c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:26.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.516+0000 7f9acaffd640 1 --2- 172.21.15.45:0/334000626 >> v2:172.21.15.79:3300/0 conn(0x7f9acc0bb1d0 0x7f9acc0c12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.516+0000 7f9acaffd640 1 -- 172.21.15.45:0/334000626 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9acc0a3c60 con 0x7f9acc14f240 2023-10-03T19:19:26.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.516+0000 7f9aca7fc640 1 --2- 172.21.15.45:0/334000626 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9acc0c2790 0x7f9acc0c0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:26.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.516+0000 7f9acaffd640 1 --2- 172.21.15.45:0/334000626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9acc14f240 0x7f9acc1528d0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f9acc0c0680 tx=0x7f9abc01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c0111f9a4d3ca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:26.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.516+0000 7f9ac9ffb640 1 -- 172.21.15.45:0/334000626 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0a89b0 con 0x7f9acc14f240 2023-10-03T19:19:26.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.516+0000 7f9ac9ffb640 1 -- 172.21.15.45:0/334000626 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc0a8b10 con 0x7f9acc14f240 2023-10-03T19:19:26.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.516+0000 7f9ac9ffb640 1 -- 172.21.15.45:0/334000626 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0a8ea0 con 0x7f9acc14f240 2023-10-03T19:19:26.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.516+0000 7f9ad18db640 1 -- 172.21.15.45:0/334000626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9acc14f240 msgr2=0x7f9acc1528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:26.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.516+0000 7f9ad18db640 1 --2- 172.21.15.45:0/334000626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9acc14f240 0x7f9acc1528d0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f9acc0c0680 tx=0x7f9abc01ecf0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.516+0000 7f9ad18db640 1 -- 172.21.15.45:0/334000626 shutdown_connections 2023-10-03T19:19:26.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.516+0000 7f9ad18db640 1 --2- 172.21.15.45:0/334000626 >> v2:172.21.15.79:3300/0 conn(0x7f9acc0bb1d0 0x7f9acc0c12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.516+0000 7f9ad18db640 1 --2- 172.21.15.45:0/334000626 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9acc0c2790 0x7f9acc0c0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.516+0000 7f9ad18db640 1 --2- 172.21.15.45:0/334000626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9acc14f240 0x7f9acc1528d0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.516+0000 7f9ad18db640 1 -- 172.21.15.45:0/334000626 >> 172.21.15.45:0/334000626 conn(0x7f9acc0a64a0 msgr2=0x7f9acc0a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:26.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.516+0000 7f9ad18db640 1 -- 172.21.15.45:0/334000626 shutdown_connections 2023-10-03T19:19:26.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.516+0000 7f9ad18db640 1 -- 172.21.15.45:0/334000626 wait complete. 2023-10-03T19:19:26.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.520+0000 7f9ad18db640 1 Processor -- start 2023-10-03T19:19:26.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.520+0000 7f9ad18db640 1 -- start start 2023-10-03T19:19:26.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.520+0000 7f9ad18db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9acc0bb1d0 0x7f9acc14fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:26.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.520+0000 7f9ad18db640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9acc0c2790 0x7f9acc150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:26.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.520+0000 7f9ad18db640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9acc14f240 0x7f9acc1511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:26.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.520+0000 7f9ad18db640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc151830 con 0x7f9acc0bb1d0 2023-10-03T19:19:26.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.520+0000 7f9ad18db640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc151d20 con 0x7f9acc14f240 2023-10-03T19:19:26.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.520+0000 7f9ad18db640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc0bb960 con 0x7f9acc0c2790 2023-10-03T19:19:26.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.520+0000 7f9acaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9acc0bb1d0 0x7f9acc14fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:26.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.520+0000 7f9acaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9acc0bb1d0 0x7f9acc14fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42494/0 (socket says 172.21.15.45:42494) 2023-10-03T19:19:26.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.520+0000 7f9acaffd640 1 -- 172.21.15.45:0/2897414617 learned_addr learned my addr 172.21.15.45:0/2897414617 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:26.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.520+0000 7f9aca7fc640 1 --2- 172.21.15.45:0/2897414617 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9acc0c2790 0x7f9acc150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:26.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.520+0000 7f9acb7fe640 1 --2- 172.21.15.45:0/2897414617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9acc14f240 0x7f9acc1511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:26.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.520+0000 7f9acaffd640 1 -- 172.21.15.45:0/2897414617 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9acc0c2790 msgr2=0x7f9acc150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:26.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.520+0000 7f9acaffd640 1 --2- 172.21.15.45:0/2897414617 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9acc0c2790 0x7f9acc150c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.520+0000 7f9acaffd640 1 -- 172.21.15.45:0/2897414617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9acc14f240 msgr2=0x7f9acc1511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:26.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.520+0000 7f9acaffd640 1 --2- 172.21.15.45:0/2897414617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9acc14f240 0x7f9acc1511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.520+0000 7f9acaffd640 1 -- 172.21.15.45:0/2897414617 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9abc009480 con 0x7f9acc0bb1d0 2023-10-03T19:19:26.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.520+0000 7f9acaffd640 1 --2- 172.21.15.45:0/2897414617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9acc0bb1d0 0x7f9acc14fdf0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f9abc01d3a0 tx=0x7f9abc01ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:26.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.520+0000 7f9ab3fff640 1 -- 172.21.15.45:0/2897414617 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc005db0 con 0x7f9acc0bb1d0 2023-10-03T19:19:26.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.520+0000 7f9ab3fff640 1 -- 172.21.15.45:0/2897414617 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc006030 con 0x7f9acc0bb1d0 2023-10-03T19:19:26.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.520+0000 7f9ab3fff640 1 -- 172.21.15.45:0/2897414617 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0063e0 con 0x7f9acc0bb1d0 2023-10-03T19:19:26.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.520+0000 7f9ad18db640 1 -- 172.21.15.45:0/2897414617 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9acc0a3f40 con 0x7f9acc0bb1d0 2023-10-03T19:19:26.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.520+0000 7f9ad18db640 1 -- 172.21.15.45:0/2897414617 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9acc14e740 con 0x7f9acc0bb1d0 2023-10-03T19:19:26.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.524+0000 7f9ad18db640 1 -- 172.21.15.45:0/2897414617 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9acc14f610 con 0x7f9acc0bb1d0 2023-10-03T19:19:26.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.524+0000 7f9ab3fff640 1 -- 172.21.15.45:0/2897414617 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9abc0b7070 con 0x7f9acc0bb1d0 2023-10-03T19:19:26.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.524+0000 7f9ab3fff640 1 --2- 172.21.15.45:0/2897414617 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9ab8066280 0x7f9ab8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:26.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.524+0000 7f9ab3fff640 1 -- 172.21.15.45:0/2897414617 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f9abc120cd0 con 0x7f9acc0bb1d0 2023-10-03T19:19:26.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.524+0000 7f9aca7fc640 1 --2- 172.21.15.45:0/2897414617 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9ab8066280 0x7f9ab8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:26.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.524+0000 7f9aca7fc640 1 --2- 172.21.15.45:0/2897414617 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9ab8066280 0x7f9ab8068730 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9acc1e7ff0 tx=0x7f9ac0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:26.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.528+0000 7f9ab3fff640 1 -- 172.21.15.45:0/2897414617 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9abc0ee0b0 con 0x7f9acc0bb1d0 2023-10-03T19:19:26.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.708+0000 7f9ad18db640 1 -- 172.21.15.45:0/2897414617 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9acc0bfa60 con 0x7f9acc0bb1d0 2023-10-03T19:19:26.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.708+0000 7f9ab3fff640 1 -- 172.21.15.45:0/2897414617 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+3910 (secure 0 0 0) 0x7f9abc0f16d0 con 0x7f9acc0bb1d0 2023-10-03T19:19:26.711 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:19:26.711 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":44,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6094,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3237510777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3237510777},{"type":"v1","addr":"172.21.15.79:6835","nonce":3237510777}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6717,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/697890515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":697890515},{"type":"v1","addr":"172.21.15.45:6833","nonce":697890515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:18:28.260345+0000","modified":"2023-10-03T19:18:31.278054+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6720},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6720":{"gid":6720,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/125100321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":125100321},{"type":"v1","addr":"172.21.15.45:6835","nonce":125100321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-10-03T19:19:26.712 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 44 2023-10-03T19:19:26.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.708+0000 7f9ad18db640 1 -- 172.21.15.45:0/2897414617 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9ab8066280 msgr2=0x7f9ab8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:26.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.708+0000 7f9ad18db640 1 --2- 172.21.15.45:0/2897414617 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9ab8066280 0x7f9ab8068730 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9acc1e7ff0 tx=0x7f9ac0008040 comp rx=0 tx=0).stop 2023-10-03T19:19:26.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.708+0000 7f9ad18db640 1 -- 172.21.15.45:0/2897414617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9acc0bb1d0 msgr2=0x7f9acc14fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:26.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.708+0000 7f9ad18db640 1 --2- 172.21.15.45:0/2897414617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9acc0bb1d0 0x7f9acc14fdf0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f9abc01d3a0 tx=0x7f9abc01ba90 comp rx=0 tx=0).stop 2023-10-03T19:19:26.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.708+0000 7f9ad18db640 1 -- 172.21.15.45:0/2897414617 shutdown_connections 2023-10-03T19:19:26.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.708+0000 7f9ad18db640 1 --2- 172.21.15.45:0/2897414617 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9ab8066280 0x7f9ab8068730 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.708+0000 7f9ad18db640 1 --2- 172.21.15.45:0/2897414617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9acc14f240 0x7f9acc1511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.708+0000 7f9ad18db640 1 --2- 172.21.15.45:0/2897414617 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9acc0c2790 0x7f9acc150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.708+0000 7f9ad18db640 1 --2- 172.21.15.45:0/2897414617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9acc0bb1d0 0x7f9acc14fdf0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.708+0000 7f9ad18db640 1 -- 172.21.15.45:0/2897414617 >> 172.21.15.45:0/2897414617 conn(0x7f9acc0a64a0 msgr2=0x7f9acc14dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:26.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.712+0000 7f9ad18db640 1 -- 172.21.15.45:0/2897414617 shutdown_connections 2023-10-03T19:19:26.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.712+0000 7f9ad18db640 1 -- 172.21.15.45:0/2897414617 wait complete. 2023-10-03T19:19:26.729 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:19:26.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.840+0000 7f6824aef640 1 Processor -- start 2023-10-03T19:19:26.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.840+0000 7f6824aef640 1 -- start start 2023-10-03T19:19:26.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.840+0000 7f6824aef640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f682006cd40 0x7f682014aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:26.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.840+0000 7f6824aef640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f68200a3670 0x7f68200bbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:26.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.840+0000 7f6824aef640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68200baf60 con 0x7f6820147ab0 2023-10-03T19:19:26.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.840+0000 7f6824aef640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68200a5db0 con 0x7f682006cd40 2023-10-03T19:19:26.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.840+0000 7f6824aef640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68200a3aa0 con 0x7f68200a3670 2023-10-03T19:19:26.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.840+0000 7f681e59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f682006cd40 0x7f682014aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:26.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.840+0000 7f681e59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f682006cd40 0x7f682014aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42502/0 (socket says 172.21.15.45:42502) 2023-10-03T19:19:26.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.840+0000 7f681e59c640 1 -- 172.21.15.45:0/880091295 learned_addr learned my addr 172.21.15.45:0/880091295 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:26.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.840+0000 7f681e59c640 1 -- 172.21.15.45:0/880091295 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f68200a3670 msgr2=0x7f68200bbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:26.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.840+0000 7f681e59c640 1 --2- 172.21.15.45:0/880091295 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f68200a3670 0x7f68200bbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.840+0000 7f681e59c640 1 -- 172.21.15.45:0/880091295 >> v1:172.21.15.79:6789/0 conn(0x7f6820147ab0 legacy=0x7f682014e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:26.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.840+0000 7f681e59c640 1 -- 172.21.15.45:0/880091295 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68200bb240 con 0x7f682006cd40 2023-10-03T19:19:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.840+0000 7f681e59c640 1 --2- 172.21.15.45:0/880091295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f682006cd40 0x7f682014aa50 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f68100098a0 tx=0x7f681001ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=214f08b5124dc8c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.840+0000 7f681d59a640 1 -- 172.21.15.45:0/880091295 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68100a8990 con 0x7f682006cd40 2023-10-03T19:19:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.844+0000 7f681d59a640 1 -- 172.21.15.45:0/880091295 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68100a8af0 con 0x7f682006cd40 2023-10-03T19:19:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.844+0000 7f681d59a640 1 -- 172.21.15.45:0/880091295 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68100a8e80 con 0x7f682006cd40 2023-10-03T19:19:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.844+0000 7f6824aef640 1 -- 172.21.15.45:0/880091295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f682006cd40 msgr2=0x7f682014aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.844+0000 7f6824aef640 1 --2- 172.21.15.45:0/880091295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f682006cd40 0x7f682014aa50 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f68100098a0 tx=0x7f681001ecd0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.844+0000 7f6824aef640 1 -- 172.21.15.45:0/880091295 shutdown_connections 2023-10-03T19:19:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.844+0000 7f6824aef640 1 --2- 172.21.15.45:0/880091295 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f68200a3670 0x7f68200bbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.844+0000 7f6824aef640 1 --2- 172.21.15.45:0/880091295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f682006cd40 0x7f682014aa50 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.844+0000 7f6824aef640 1 -- 172.21.15.45:0/880091295 >> 172.21.15.45:0/880091295 conn(0x7f68200bcf50 msgr2=0x7f68200bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.844+0000 7f6824aef640 1 -- 172.21.15.45:0/880091295 shutdown_connections 2023-10-03T19:19:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.844+0000 7f6824aef640 1 -- 172.21.15.45:0/880091295 wait complete. 2023-10-03T19:19:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.844+0000 7f6824aef640 1 Processor -- start 2023-10-03T19:19:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.844+0000 7f6824aef640 1 -- start start 2023-10-03T19:19:26.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.844+0000 7f6824aef640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f682006cd40 0x7f68201e3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:26.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.844+0000 7f6824aef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68200a3670 0x7f68200b9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:26.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.844+0000 7f6824aef640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6820147ab0 0x7f68201e7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:26.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.844+0000 7f6824aef640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68201e3a70 con 0x7f68200a3670 2023-10-03T19:19:26.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.844+0000 7f6824aef640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68201e6eb0 con 0x7f682006cd40 2023-10-03T19:19:26.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.844+0000 7f6824aef640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68200ba090 con 0x7f6820147ab0 2023-10-03T19:19:26.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.844+0000 7f681dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68200a3670 0x7f68200b9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:26.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.844+0000 7f681dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68200a3670 0x7f68200b9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42516/0 (socket says 172.21.15.45:42516) 2023-10-03T19:19:26.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.844+0000 7f681dd9b640 1 -- 172.21.15.45:0/3111504392 learned_addr learned my addr 172.21.15.45:0/3111504392 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:26.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.844+0000 7f681ed9d640 1 --2- 172.21.15.45:0/3111504392 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6820147ab0 0x7f68201e7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:26.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.844+0000 7f681e59c640 1 --2- 172.21.15.45:0/3111504392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f682006cd40 0x7f68201e3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:26.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.844+0000 7f681dd9b640 1 -- 172.21.15.45:0/3111504392 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6820147ab0 msgr2=0x7f68201e7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:26.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.844+0000 7f681dd9b640 1 --2- 172.21.15.45:0/3111504392 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6820147ab0 0x7f68201e7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.844+0000 7f681dd9b640 1 -- 172.21.15.45:0/3111504392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f682006cd40 msgr2=0x7f68201e3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:26.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.844+0000 7f681dd9b640 1 --2- 172.21.15.45:0/3111504392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f682006cd40 0x7f68201e3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:26.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.844+0000 7f681dd9b640 1 -- 172.21.15.45:0/3111504392 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68100094d0 con 0x7f68200a3670 2023-10-03T19:19:26.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.844+0000 7f681dd9b640 1 --2- 172.21.15.45:0/3111504392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68200a3670 0x7f68200b9b50 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f681400b580 tx=0x7f681400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:26.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.844+0000 7f680effd640 1 -- 172.21.15.45:0/3111504392 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6814010870 con 0x7f68200a3670 2023-10-03T19:19:26.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.848+0000 7f680effd640 1 -- 172.21.15.45:0/3111504392 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68140109f0 con 0x7f68200a3670 2023-10-03T19:19:26.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.848+0000 7f680effd640 1 -- 172.21.15.45:0/3111504392 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6814010da0 con 0x7f68200a3670 2023-10-03T19:19:26.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.848+0000 7f6824aef640 1 -- 172.21.15.45:0/3111504392 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68200bb800 con 0x7f68200a3670 2023-10-03T19:19:26.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.848+0000 7f6824aef640 1 -- 172.21.15.45:0/3111504392 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68200bb520 con 0x7f68200a3670 2023-10-03T19:19:26.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.848+0000 7f6824aef640 1 -- 172.21.15.45:0/3111504392 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68200bcc90 con 0x7f68200a3670 2023-10-03T19:19:26.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.848+0000 7f680effd640 1 -- 172.21.15.45:0/3111504392 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f681400f3c0 con 0x7f68200a3670 2023-10-03T19:19:26.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.848+0000 7f680effd640 1 --2- 172.21.15.45:0/3111504392 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6800066280 0x7f6800068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:26.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.848+0000 7f680effd640 1 -- 172.21.15.45:0/3111504392 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f6814083dd0 con 0x7f68200a3670 2023-10-03T19:19:26.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.848+0000 7f681e59c640 1 --2- 172.21.15.45:0/3111504392 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6800066280 0x7f6800068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:26.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.848+0000 7f681e59c640 1 --2- 172.21.15.45:0/3111504392 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6800066280 0x7f6800068730 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f68100b2000 tx=0x7f6810008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:26.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:26.852+0000 7f680effd640 1 -- 172.21.15.45:0/3111504392 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f68140511c0 con 0x7f68200a3670 2023-10-03T19:19:27.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.000+0000 7f6824aef640 1 -- 172.21.15.45:0/3111504392 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68201e7060 con 0x7f68200a3670 2023-10-03T19:19:27.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.004+0000 7f680effd640 1 -- 172.21.15.45:0/3111504392 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+18501 (secure 0 0 0) 0x7f68201e7060 con 0x7f68200a3670 2023-10-03T19:19:27.008 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:19:27.008 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":87,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:19:14.804643+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:18:25.942883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-10-03T19:18:27.242940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.2","mappings":[{"from":1,"to":2}]},{"pgid":"14.26","mappings":[{"from":1,"to":7}]},{"pgid":"14.29","mappings":[{"from":1,"to":7}]},{"pgid":"14.32","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:0/2938203609":"2023-10-03T20:19:12.888501+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:19:27.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.008+0000 7f6824aef640 1 -- 172.21.15.45:0/3111504392 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6800066280 msgr2=0x7f6800068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:27.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.008+0000 7f6824aef640 1 --2- 172.21.15.45:0/3111504392 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6800066280 0x7f6800068730 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f68100b2000 tx=0x7f6810008040 comp rx=0 tx=0).stop 2023-10-03T19:19:27.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.008+0000 7f6824aef640 1 -- 172.21.15.45:0/3111504392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68200a3670 msgr2=0x7f68200b9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:27.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.008+0000 7f6824aef640 1 --2- 172.21.15.45:0/3111504392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68200a3670 0x7f68200b9b50 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f681400b580 tx=0x7f681400ba40 comp rx=0 tx=0).stop 2023-10-03T19:19:27.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.008+0000 7f6824aef640 1 -- 172.21.15.45:0/3111504392 shutdown_connections 2023-10-03T19:19:27.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.008+0000 7f6824aef640 1 --2- 172.21.15.45:0/3111504392 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6800066280 0x7f6800068730 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:27.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.008+0000 7f6824aef640 1 --2- 172.21.15.45:0/3111504392 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6820147ab0 0x7f68201e7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:27.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.008+0000 7f6824aef640 1 --2- 172.21.15.45:0/3111504392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68200a3670 0x7f68200b9b50 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:27.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.008+0000 7f6824aef640 1 --2- 172.21.15.45:0/3111504392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f682006cd40 0x7f68201e3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:27.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.008+0000 7f6824aef640 1 -- 172.21.15.45:0/3111504392 >> 172.21.15.45:0/3111504392 conn(0x7f68200bcf50 msgr2=0x7f68201467c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:27.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.008+0000 7f6824aef640 1 -- 172.21.15.45:0/3111504392 shutdown_connections 2023-10-03T19:19:27.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.008+0000 7f6824aef640 1 -- 172.21.15.45:0/3111504392 wait complete. 2023-10-03T19:19:27.026 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-03T19:19:27.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.148+0000 7fc43b4f2640 1 Processor -- start 2023-10-03T19:19:27.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.148+0000 7fc43b4f2640 1 -- start start 2023-10-03T19:19:27.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.148+0000 7fc43b4f2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc43414f240 0x7fc4341528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:27.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.148+0000 7fc43b4f2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc4340bb1d0 0x7fc4340c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:27.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.148+0000 7fc43b4f2640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc43406b2d0 con 0x7fc4340c2790 2023-10-03T19:19:27.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.148+0000 7fc43b4f2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc43406b640 con 0x7fc4340bb1d0 2023-10-03T19:19:27.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.148+0000 7fc43b4f2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4340a3c60 con 0x7fc43414f240 2023-10-03T19:19:27.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.148+0000 7fc439a8f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc4340bb1d0 0x7fc4340c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:27.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.148+0000 7fc439a8f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc4340bb1d0 0x7fc4340c12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42518/0 (socket says 172.21.15.45:42518) 2023-10-03T19:19:27.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.148+0000 7fc439a8f640 1 -- 172.21.15.45:0/1974378171 learned_addr learned my addr 172.21.15.45:0/1974378171 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:27.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.148+0000 7fc43928e640 1 --2- 172.21.15.45:0/1974378171 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc43414f240 0x7fc4341528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:27.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.148+0000 7fc439a8f640 1 -- 172.21.15.45:0/1974378171 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc43414f240 msgr2=0x7fc4341528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:27.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.148+0000 7fc439a8f640 1 --2- 172.21.15.45:0/1974378171 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc43414f240 0x7fc4341528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:27.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.148+0000 7fc439a8f640 1 -- 172.21.15.45:0/1974378171 >> v1:172.21.15.79:6789/0 conn(0x7fc4340c2790 legacy=0x7fc4340c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:27.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.148+0000 7fc439a8f640 1 -- 172.21.15.45:0/1974378171 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43414e740 con 0x7fc4340bb1d0 2023-10-03T19:19:27.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.152+0000 7fc439a8f640 1 --2- 172.21.15.45:0/1974378171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4340bb1d0 0x7fc4340c12a0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fc42c009870 tx=0x7fc42c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=701c2b57d2544aae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:27.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.152+0000 7fc433fff640 1 -- 172.21.15.45:0/1974378171 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c0a89b0 con 0x7fc4340bb1d0 2023-10-03T19:19:27.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.152+0000 7fc433fff640 1 -- 172.21.15.45:0/1974378171 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42c0a8b10 con 0x7fc4340bb1d0 2023-10-03T19:19:27.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.152+0000 7fc433fff640 1 -- 172.21.15.45:0/1974378171 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c0a8ea0 con 0x7fc4340bb1d0 2023-10-03T19:19:27.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.152+0000 7fc43b4f2640 1 -- 172.21.15.45:0/1974378171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4340bb1d0 msgr2=0x7fc4340c12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:27.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.152+0000 7fc43b4f2640 1 --2- 172.21.15.45:0/1974378171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4340bb1d0 0x7fc4340c12a0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fc42c009870 tx=0x7fc42c01ecf0 comp rx=0 tx=0).stop 2023-10-03T19:19:27.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.152+0000 7fc43b4f2640 1 -- 172.21.15.45:0/1974378171 shutdown_connections 2023-10-03T19:19:27.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.152+0000 7fc43b4f2640 1 --2- 172.21.15.45:0/1974378171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4340bb1d0 0x7fc4340c12a0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:27.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.152+0000 7fc43b4f2640 1 --2- 172.21.15.45:0/1974378171 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc43414f240 0x7fc4341528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:27.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.152+0000 7fc43b4f2640 1 -- 172.21.15.45:0/1974378171 >> 172.21.15.45:0/1974378171 conn(0x7fc4340a64a0 msgr2=0x7fc4340a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:27.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.152+0000 7fc43b4f2640 1 -- 172.21.15.45:0/1974378171 shutdown_connections 2023-10-03T19:19:27.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.152+0000 7fc43b4f2640 1 -- 172.21.15.45:0/1974378171 wait complete. 2023-10-03T19:19:27.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.152+0000 7fc43b4f2640 1 Processor -- start 2023-10-03T19:19:27.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.152+0000 7fc43b4f2640 1 -- start start 2023-10-03T19:19:27.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.152+0000 7fc43b4f2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc4340bb1d0 0x7fc434151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:27.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.152+0000 7fc43b4f2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4340c2790 0x7fc4341e7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:27.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.152+0000 7fc43b4f2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc43414f240 0x7fc43414aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:27.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.152+0000 7fc43b4f2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4340c4440 con 0x7fc4340c2790 2023-10-03T19:19:27.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.152+0000 7fc43b4f2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4341515b0 con 0x7fc43414f240 2023-10-03T19:19:27.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.152+0000 7fc43b4f2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43414be90 con 0x7fc4340bb1d0 2023-10-03T19:19:27.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.152+0000 7fc438a8d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4340c2790 0x7fc4341e7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:27.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.156+0000 7fc438a8d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4340c2790 0x7fc4341e7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42522/0 (socket says 172.21.15.45:42522) 2023-10-03T19:19:27.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.156+0000 7fc438a8d640 1 -- 172.21.15.45:0/3172353448 learned_addr learned my addr 172.21.15.45:0/3172353448 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:27.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.156+0000 7fc43928e640 1 --2- 172.21.15.45:0/3172353448 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc4340bb1d0 0x7fc434151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:27.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.156+0000 7fc439a8f640 1 --2- 172.21.15.45:0/3172353448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc43414f240 0x7fc43414aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:27.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.156+0000 7fc438a8d640 1 -- 172.21.15.45:0/3172353448 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc4340bb1d0 msgr2=0x7fc434151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:27.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.156+0000 7fc438a8d640 1 --2- 172.21.15.45:0/3172353448 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc4340bb1d0 0x7fc434151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:27.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.156+0000 7fc438a8d640 1 -- 172.21.15.45:0/3172353448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc43414f240 msgr2=0x7fc43414aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:27.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.156+0000 7fc438a8d640 1 --2- 172.21.15.45:0/3172353448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc43414f240 0x7fc43414aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:27.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.156+0000 7fc438a8d640 1 -- 172.21.15.45:0/3172353448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc42c0094d0 con 0x7fc4340c2790 2023-10-03T19:19:27.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.156+0000 7fc439a8f640 1 --2- 172.21.15.45:0/3172353448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc43414f240 0x7fc43414aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:27.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.156+0000 7fc438a8d640 1 --2- 172.21.15.45:0/3172353448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4340c2790 0x7fc4341e7340 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fc42800c7c0 tx=0x7fc42800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:27.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.156+0000 7fc431ffb640 1 -- 172.21.15.45:0/3172353448 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42800aa50 con 0x7fc4340c2790 2023-10-03T19:19:27.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.156+0000 7fc431ffb640 1 -- 172.21.15.45:0/3172353448 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42800abb0 con 0x7fc4340c2790 2023-10-03T19:19:27.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.156+0000 7fc431ffb640 1 -- 172.21.15.45:0/3172353448 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc428012420 con 0x7fc4340c2790 2023-10-03T19:19:27.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.156+0000 7fc43b4f2640 1 -- 172.21.15.45:0/3172353448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc43414f610 con 0x7fc4340c2790 2023-10-03T19:19:27.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.156+0000 7fc43b4f2640 1 -- 172.21.15.45:0/3172353448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4340a3f40 con 0x7fc4340c2790 2023-10-03T19:19:27.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.156+0000 7fc43b4f2640 1 -- 172.21.15.45:0/3172353448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4340bf360 con 0x7fc4340c2790 2023-10-03T19:19:27.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.156+0000 7fc431ffb640 1 -- 172.21.15.45:0/3172353448 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc428012580 con 0x7fc4340c2790 2023-10-03T19:19:27.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.156+0000 7fc431ffb640 1 --2- 172.21.15.45:0/3172353448 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc420066280 0x7fc420068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:27.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.156+0000 7fc431ffb640 1 -- 172.21.15.45:0/3172353448 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fc428084020 con 0x7fc4340c2790 2023-10-03T19:19:27.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.156+0000 7fc43928e640 1 --2- 172.21.15.45:0/3172353448 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc420066280 0x7fc420068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:27.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.156+0000 7fc43928e640 1 --2- 172.21.15.45:0/3172353448 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc420066280 0x7fc420068730 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc424006fd0 tx=0x7fc424008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:27.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.160+0000 7fc431ffb640 1 -- 172.21.15.45:0/3172353448 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc428051490 con 0x7fc4340c2790 2023-10-03T19:19:27.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.340+0000 7fc43b4f2640 1 -- 172.21.15.45:0/3172353448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc4340bfa90 con 0x7fc4340c2790 2023-10-03T19:19:27.871 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-10-03T19:19:27.868+0000 7f00b6fb3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-03T19:19:27.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.876+0000 7fc431ffb640 1 -- 172.21.15.45:0/3172353448 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v45) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc428054ab0 con 0x7fc4340c2790 2023-10-03T19:19:27.880 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-03T19:19:27.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.880+0000 7fc43b4f2640 1 -- 172.21.15.45:0/3172353448 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc420066280 msgr2=0x7fc420068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:27.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.880+0000 7fc43b4f2640 1 --2- 172.21.15.45:0/3172353448 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc420066280 0x7fc420068730 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc424006fd0 tx=0x7fc424008040 comp rx=0 tx=0).stop 2023-10-03T19:19:27.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.880+0000 7fc43b4f2640 1 -- 172.21.15.45:0/3172353448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4340c2790 msgr2=0x7fc4341e7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:27.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.880+0000 7fc43b4f2640 1 --2- 172.21.15.45:0/3172353448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4340c2790 0x7fc4341e7340 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fc42800c7c0 tx=0x7fc42800cc80 comp rx=0 tx=0).stop 2023-10-03T19:19:27.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.880+0000 7fc43b4f2640 1 -- 172.21.15.45:0/3172353448 shutdown_connections 2023-10-03T19:19:27.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.880+0000 7fc43b4f2640 1 --2- 172.21.15.45:0/3172353448 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc420066280 0x7fc420068730 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:27.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.880+0000 7fc43b4f2640 1 --2- 172.21.15.45:0/3172353448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc43414f240 0x7fc43414aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:27.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.880+0000 7fc43b4f2640 1 --2- 172.21.15.45:0/3172353448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4340c2790 0x7fc4341e7340 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:27.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.880+0000 7fc43b4f2640 1 --2- 172.21.15.45:0/3172353448 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc4340bb1d0 0x7fc434151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:27.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.880+0000 7fc43b4f2640 1 -- 172.21.15.45:0/3172353448 >> 172.21.15.45:0/3172353448 conn(0x7fc4340a64a0 msgr2=0x7fc43414ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:27.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.880+0000 7fc43b4f2640 1 -- 172.21.15.45:0/3172353448 shutdown_connections 2023-10-03T19:19:27.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:27.880+0000 7fc43b4f2640 1 -- 172.21.15.45:0/3172353448 wait complete. 2023-10-03T19:19:27.885 INFO:tasks.ceph.mds.c.smithi045.stderr: -3997> 2023-10-03T19:18:33.853+0000 7faa965f4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-03T19:19:27.905 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-03T19:19:27.923 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-10-03T19:19:28.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.040+0000 7f58e8f1f640 1 Processor -- start 2023-10-03T19:19:28.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.040+0000 7f58e8f1f640 1 -- start start 2023-10-03T19:19:28.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.044+0000 7f58e8f1f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f58e40c1770 0x7f58e40c0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:28.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.044+0000 7f58e8f1f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f58e40a1c80 0x7f58e414b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:28.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.044+0000 7f58e8f1f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58e40bc360 con 0x7f58e40c07b0 2023-10-03T19:19:28.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.044+0000 7f58e8f1f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58e40c1ed0 con 0x7f58e40a1c80 2023-10-03T19:19:28.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.044+0000 7f58e8f1f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e40c11b0 con 0x7f58e40c1770 2023-10-03T19:19:28.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.044+0000 7f58e2d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f58e40a1c80 0x7f58e414b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:28.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.044+0000 7f58e2d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f58e40a1c80 0x7f58e414b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42528/0 (socket says 172.21.15.45:42528) 2023-10-03T19:19:28.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.044+0000 7f58e2d9d640 1 -- 172.21.15.45:0/466703586 learned_addr learned my addr 172.21.15.45:0/466703586 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:28.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.044+0000 7f58e1d9b640 1 --2- 172.21.15.45:0/466703586 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f58e40c1770 0x7f58e40c0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:28.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.044+0000 7f58e2d9d640 1 -- 172.21.15.45:0/466703586 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f58e40c1770 msgr2=0x7f58e40c0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:28.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.044+0000 7f58e2d9d640 1 --2- 172.21.15.45:0/466703586 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f58e40c1770 0x7f58e40c0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:28.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.044+0000 7f58e2d9d640 1 -- 172.21.15.45:0/466703586 >> v1:172.21.15.79:6789/0 conn(0x7f58e40c07b0 legacy=0x7f58e40bb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:28.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.044+0000 7f58e2d9d640 1 -- 172.21.15.45:0/466703586 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e41525e0 con 0x7f58e40a1c80 2023-10-03T19:19:28.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.044+0000 7f58e2d9d640 1 --2- 172.21.15.45:0/466703586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58e40a1c80 0x7f58e414b760 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009e50 tx=0x7f58dc01f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=999b61e16a0318ca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:28.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.044+0000 7f58e159a640 1 -- 172.21.15.45:0/466703586 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc0af400 con 0x7f58e40a1c80 2023-10-03T19:19:28.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.044+0000 7f58e159a640 1 -- 172.21.15.45:0/466703586 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58dc0ab050 con 0x7f58e40a1c80 2023-10-03T19:19:28.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.044+0000 7f58e159a640 1 -- 172.21.15.45:0/466703586 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc0af780 con 0x7f58e40a1c80 2023-10-03T19:19:28.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.044+0000 7f58e8f1f640 1 -- 172.21.15.45:0/466703586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58e40a1c80 msgr2=0x7f58e414b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:28.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.044+0000 7f58e8f1f640 1 --2- 172.21.15.45:0/466703586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58e40a1c80 0x7f58e414b760 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009e50 tx=0x7f58dc01f1f0 comp rx=0 tx=0).stop 2023-10-03T19:19:28.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.044+0000 7f58e8f1f640 1 -- 172.21.15.45:0/466703586 shutdown_connections 2023-10-03T19:19:28.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.044+0000 7f58e8f1f640 1 --2- 172.21.15.45:0/466703586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58e40a1c80 0x7f58e414b760 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:28.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.044+0000 7f58e8f1f640 1 --2- 172.21.15.45:0/466703586 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f58e40c1770 0x7f58e40c0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:28.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.044+0000 7f58e8f1f640 1 -- 172.21.15.45:0/466703586 >> 172.21.15.45:0/466703586 conn(0x7f58e40a4260 msgr2=0x7f58e40a4660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:28.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.044+0000 7f58e8f1f640 1 -- 172.21.15.45:0/466703586 shutdown_connections 2023-10-03T19:19:28.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.044+0000 7f58e8f1f640 1 -- 172.21.15.45:0/466703586 wait complete. 2023-10-03T19:19:28.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.048+0000 7f58e8f1f640 1 Processor -- start 2023-10-03T19:19:28.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.048+0000 7f58e8f1f640 1 -- start start 2023-10-03T19:19:28.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.048+0000 7f58e8f1f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58e40a1c80 0x7f58e40a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:28.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.048+0000 7f58e8f1f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58e40c07b0 0x7f58e41e6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:28.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.048+0000 7f58e8f1f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f58e40c1770 0x7f58e4145be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:28.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.048+0000 7f58e8f1f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e4150870 con 0x7f58e40c07b0 2023-10-03T19:19:28.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.048+0000 7f58e8f1f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e406b2f0 con 0x7f58e40a1c80 2023-10-03T19:19:28.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.048+0000 7f58e8f1f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e40672d0 con 0x7f58e40c1770 2023-10-03T19:19:28.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.048+0000 7f58e1d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58e40c07b0 0x7f58e41e6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:28.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.048+0000 7f58e1d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58e40c07b0 0x7f58e41e6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42532/0 (socket says 172.21.15.45:42532) 2023-10-03T19:19:28.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.048+0000 7f58e1d9b640 1 -- 172.21.15.45:0/296434913 learned_addr learned my addr 172.21.15.45:0/296434913 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:28.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.048+0000 7f58e259c640 1 --2- 172.21.15.45:0/296434913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58e40a1c80 0x7f58e40a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:28.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.048+0000 7f58e2d9d640 1 --2- 172.21.15.45:0/296434913 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f58e40c1770 0x7f58e4145be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:28.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.048+0000 7f58e1d9b640 1 -- 172.21.15.45:0/296434913 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f58e40c1770 msgr2=0x7f58e4145be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:28.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.048+0000 7f58e1d9b640 1 --2- 172.21.15.45:0/296434913 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f58e40c1770 0x7f58e4145be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:28.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.048+0000 7f58e1d9b640 1 -- 172.21.15.45:0/296434913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58e40a1c80 msgr2=0x7f58e40a38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:28.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.048+0000 7f58e1d9b640 1 --2- 172.21.15.45:0/296434913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58e40a1c80 0x7f58e40a38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:28.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.048+0000 7f58e1d9b640 1 -- 172.21.15.45:0/296434913 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58dc009b30 con 0x7f58e40c07b0 2023-10-03T19:19:28.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.048+0000 7f58e259c640 1 --2- 172.21.15.45:0/296434913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58e40a1c80 0x7f58e40a38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:28.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.048+0000 7f58e1d9b640 1 --2- 172.21.15.45:0/296434913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58e40c07b0 0x7f58e41e6b60 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f58d800d800 tx=0x7f58d800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:28.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.048+0000 7f58d2ffd640 1 -- 172.21.15.45:0/296434913 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d800b6c0 con 0x7f58e40c07b0 2023-10-03T19:19:28.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.048+0000 7f58d2ffd640 1 -- 172.21.15.45:0/296434913 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d800b820 con 0x7f58e40c07b0 2023-10-03T19:19:28.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.048+0000 7f58d2ffd640 1 -- 172.21.15.45:0/296434913 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d800bb90 con 0x7f58e40c07b0 2023-10-03T19:19:28.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.048+0000 7f58e8f1f640 1 -- 172.21.15.45:0/296434913 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e40bc0a0 con 0x7f58e40c07b0 2023-10-03T19:19:28.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.048+0000 7f58e8f1f640 1 -- 172.21.15.45:0/296434913 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e41528c0 con 0x7f58e40c07b0 2023-10-03T19:19:28.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.048+0000 7f58e8f1f640 1 -- 172.21.15.45:0/296434913 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58e414e540 con 0x7f58e40c07b0 2023-10-03T19:19:28.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.052+0000 7f58d2ffd640 1 -- 172.21.15.45:0/296434913 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f58d800bcf0 con 0x7f58e40c07b0 2023-10-03T19:19:28.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.052+0000 7f58d2ffd640 1 --2- 172.21.15.45:0/296434913 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f58c4066280 0x7f58c4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:28.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.052+0000 7f58d2ffd640 1 -- 172.21.15.45:0/296434913 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f58d80843c0 con 0x7f58e40c07b0 2023-10-03T19:19:28.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.052+0000 7f58e259c640 1 --2- 172.21.15.45:0/296434913 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f58c4066280 0x7f58c4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:28.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.052+0000 7f58e259c640 1 --2- 172.21.15.45:0/296434913 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f58c4066280 0x7f58c4068730 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f58d4000f70 tx=0x7f58d4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:28.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.056+0000 7f58d2ffd640 1 -- 172.21.15.45:0/296434913 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f58d80551d0 con 0x7f58e40c07b0 2023-10-03T19:19:28.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.244+0000 7f58e8f1f640 1 -- 172.21.15.45:0/296434913 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f58e40bfe20 con 0x7f58e40c07b0 2023-10-03T19:19:28.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.888+0000 7f58d2ffd640 1 -- 172.21.15.45:0/296434913 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v46) v1 ==== 104+0+0 (secure 0 0 0) 0x7f58d8054d60 con 0x7f58e40c07b0 2023-10-03T19:19:28.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.892+0000 7f58e8f1f640 1 -- 172.21.15.45:0/296434913 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f58c4066280 msgr2=0x7f58c4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:28.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.892+0000 7f58e8f1f640 1 --2- 172.21.15.45:0/296434913 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f58c4066280 0x7f58c4068730 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f58d4000f70 tx=0x7f58d4009040 comp rx=0 tx=0).stop 2023-10-03T19:19:28.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.892+0000 7f58e8f1f640 1 -- 172.21.15.45:0/296434913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58e40c07b0 msgr2=0x7f58e41e6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:28.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.892+0000 7f58e8f1f640 1 --2- 172.21.15.45:0/296434913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58e40c07b0 0x7f58e41e6b60 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f58d800d800 tx=0x7f58d800dcc0 comp rx=0 tx=0).stop 2023-10-03T19:19:28.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.892+0000 7f58e8f1f640 1 -- 172.21.15.45:0/296434913 shutdown_connections 2023-10-03T19:19:28.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.892+0000 7f58e8f1f640 1 --2- 172.21.15.45:0/296434913 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f58c4066280 0x7f58c4068730 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:28.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.892+0000 7f58e8f1f640 1 --2- 172.21.15.45:0/296434913 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f58e40c1770 0x7f58e4145be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:28.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.892+0000 7f58e8f1f640 1 --2- 172.21.15.45:0/296434913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58e40c07b0 0x7f58e41e6b60 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:28.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.892+0000 7f58e8f1f640 1 --2- 172.21.15.45:0/296434913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58e40a1c80 0x7f58e40a38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:28.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.892+0000 7f58e8f1f640 1 -- 172.21.15.45:0/296434913 >> 172.21.15.45:0/296434913 conn(0x7f58e40a4260 msgr2=0x7f58e40a4630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:28.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.892+0000 7f58e8f1f640 1 -- 172.21.15.45:0/296434913 shutdown_connections 2023-10-03T19:19:28.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:28.892+0000 7f58e8f1f640 1 -- 172.21.15.45:0/296434913 wait complete. 2023-10-03T19:19:28.919 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-03T19:19:29.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b0a4a6640 1 Processor -- start 2023-10-03T19:19:29.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b0a4a6640 1 -- start start 2023-10-03T19:19:29.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b0a4a6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4b040a37d0 0x7f4b04070140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:29.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b0a4a6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b040bc770 0x7f4b0414ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:29.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b0a4a6640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b0406ae30 con 0x7f4b04070d50 2023-10-03T19:19:29.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b0a4a6640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b04071ac0 con 0x7f4b040a37d0 2023-10-03T19:19:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b0a4a6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0406a870 con 0x7f4b040bc770 2023-10-03T19:19:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b037fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4b04070d50 0x7f4b04150630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51352/0 (socket says 172.21.15.45:51352) 2023-10-03T19:19:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b037fe640 1 -- 172.21.15.45:0/794318941 learned_addr learned my addr 172.21.15.45:0/794318941 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b03fff640 1 --2- 172.21.15.45:0/794318941 >> v2:172.21.15.79:3300/0 conn(0x7f4b040a37d0 0x7f4b04070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b08a43640 1 --2- 172.21.15.45:0/794318941 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b040bc770 0x7f4b0414ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b02ffd640 1 -- 172.21.15.45:0/794318941 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130051851 0 0) 0x7f4b0406ae30 con 0x7f4b04070d50 2023-10-03T19:19:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b02ffd640 1 -- 172.21.15.45:0/794318941 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4af0003530 con 0x7f4b04070d50 2023-10-03T19:19:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b02ffd640 1 -- 172.21.15.45:0/794318941 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3086734609 0 0) 0x7f4af0003530 con 0x7f4b04070d50 2023-10-03T19:19:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b02ffd640 1 -- 172.21.15.45:0/794318941 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b040bc770 msgr2=0x7f4b0414ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b02ffd640 1 --2- 172.21.15.45:0/794318941 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b040bc770 0x7f4b0414ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b02ffd640 1 -- 172.21.15.45:0/794318941 >> v2:172.21.15.79:3300/0 conn(0x7f4b040a37d0 msgr2=0x7f4b04070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:29.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b02ffd640 1 --2- 172.21.15.45:0/794318941 >> v2:172.21.15.79:3300/0 conn(0x7f4b040a37d0 0x7f4b04070140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:29.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b02ffd640 1 -- 172.21.15.45:0/794318941 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0406ab50 con 0x7f4b04070d50 2023-10-03T19:19:29.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b02ffd640 1 -- 172.21.15.45:0/794318941 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f4af4001680 con 0x7f4b04070d50 2023-10-03T19:19:29.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b02ffd640 1 -- 172.21.15.45:0/794318941 >> v1:172.21.15.45:6789/0 conn(0x7f4b04070d50 legacy=0x7f4b04150630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:29.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b02ffd640 1 --2- 172.21.15.45:0/794318941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4af0003980 0x7f4af0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:29.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b02ffd640 1 --2- 172.21.15.45:0/794318941 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b040bc770 0x7f4af00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:29.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b02ffd640 1 --2- 172.21.15.45:0/794318941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4af0004d10 0x7f4af0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:29.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b02ffd640 1 -- 172.21.15.45:0/794318941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0406a870 con 0x7f4af0003980 2023-10-03T19:19:29.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b02ffd640 1 -- 172.21.15.45:0/794318941 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af000b990 con 0x7f4af0004d10 2023-10-03T19:19:29.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b02ffd640 1 -- 172.21.15.45:0/794318941 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af000bad0 con 0x7f4b040bc770 2023-10-03T19:19:29.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b03fff640 1 --2- 172.21.15.45:0/794318941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4af0003980 0x7f4af0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b037fe640 1 --2- 172.21.15.45:0/794318941 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b040bc770 0x7f4af00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b08a43640 1 --2- 172.21.15.45:0/794318941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4af0004d10 0x7f4af0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b03fff640 1 -- 172.21.15.45:0/794318941 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b040bc770 msgr2=0x7f4af00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b03fff640 1 --2- 172.21.15.45:0/794318941 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b040bc770 0x7f4af00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b03fff640 1 -- 172.21.15.45:0/794318941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4af0004d10 msgr2=0x7f4af0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b03fff640 1 --2- 172.21.15.45:0/794318941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4af0004d10 0x7f4af0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b03fff640 1 -- 172.21.15.45:0/794318941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af0003530 con 0x7f4af0003980 2023-10-03T19:19:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.092+0000 7f4b08a43640 1 --2- 172.21.15.45:0/794318941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4af0004d10 0x7f4af0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:29.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.096+0000 7f4b03fff640 1 --2- 172.21.15.45:0/794318941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4af0003980 0x7f4af0003d90 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f4aec009ae0 tx=0x7f4aec01c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=534f39e51f88473f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:29.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.096+0000 7f4b02ffd640 1 -- 172.21.15.45:0/794318941 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec0a9470 con 0x7f4af0003980 2023-10-03T19:19:29.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.096+0000 7f4b02ffd640 1 -- 172.21.15.45:0/794318941 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aec0a95d0 con 0x7f4af0003980 2023-10-03T19:19:29.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.096+0000 7f4b02ffd640 1 -- 172.21.15.45:0/794318941 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec0a9980 con 0x7f4af0003980 2023-10-03T19:19:29.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.096+0000 7f4b0a4a6640 1 -- 172.21.15.45:0/794318941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4af0003980 msgr2=0x7f4af0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:29.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.096+0000 7f4b0a4a6640 1 --2- 172.21.15.45:0/794318941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4af0003980 0x7f4af0003d90 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f4aec009ae0 tx=0x7f4aec01c820 comp rx=0 tx=0).stop 2023-10-03T19:19:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.096+0000 7f4b08a43640 1 -- 172.21.15.45:0/794318941 reap_dead start 2023-10-03T19:19:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.096+0000 7f4b0a4a6640 1 -- 172.21.15.45:0/794318941 shutdown_connections 2023-10-03T19:19:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.096+0000 7f4b0a4a6640 1 -- 172.21.15.45:0/794318941 >> 172.21.15.45:0/794318941 conn(0x7f4b040be190 msgr2=0x7f4b040be590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.096+0000 7f4b0a4a6640 1 -- 172.21.15.45:0/794318941 shutdown_connections 2023-10-03T19:19:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.096+0000 7f4b0a4a6640 1 -- 172.21.15.45:0/794318941 wait complete. 2023-10-03T19:19:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.100+0000 7f4b0a4a6640 1 Processor -- start 2023-10-03T19:19:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.100+0000 7f4b0a4a6640 1 -- start start 2023-10-03T19:19:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.100+0000 7f4b0a4a6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4af0003980 0x7f4b04145640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.100+0000 7f4b0a4a6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b040b7d10 0x7f4b041eabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.100+0000 7f4b0a4a6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b040a21a0 0x7f4b041e3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.100+0000 7f4b0a4a6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b041ea740 con 0x7f4b040a21a0 2023-10-03T19:19:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.100+0000 7f4b0a4a6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b04145b80 con 0x7f4b040b7d10 2023-10-03T19:19:29.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.100+0000 7f4b0a4a6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b041eb110 con 0x7f4af0003980 2023-10-03T19:19:29.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.100+0000 7f4b08a43640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b040a21a0 0x7f4b041e3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:29.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.100+0000 7f4b08a43640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b040a21a0 0x7f4b041e3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42548/0 (socket says 172.21.15.45:42548) 2023-10-03T19:19:29.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.100+0000 7f4b08a43640 1 -- 172.21.15.45:0/3927129011 learned_addr learned my addr 172.21.15.45:0/3927129011 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:29.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.100+0000 7f4b037fe640 1 --2- 172.21.15.45:0/3927129011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b040b7d10 0x7f4b041eabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:29.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.100+0000 7f4b03fff640 1 --2- 172.21.15.45:0/3927129011 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4af0003980 0x7f4b04145640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:29.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.100+0000 7f4b08a43640 1 -- 172.21.15.45:0/3927129011 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4af0003980 msgr2=0x7f4b04145640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:29.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.100+0000 7f4b08a43640 1 --2- 172.21.15.45:0/3927129011 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4af0003980 0x7f4b04145640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:29.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.100+0000 7f4b08a43640 1 -- 172.21.15.45:0/3927129011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b040b7d10 msgr2=0x7f4b041eabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:29.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.100+0000 7f4b08a43640 1 --2- 172.21.15.45:0/3927129011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b040b7d10 0x7f4b041eabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:29.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.100+0000 7f4b08a43640 1 -- 172.21.15.45:0/3927129011 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b040a3d30 con 0x7f4b040a21a0 2023-10-03T19:19:29.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.100+0000 7f4b03fff640 1 --2- 172.21.15.45:0/3927129011 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4af0003980 0x7f4b04145640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:19:29.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.100+0000 7f4b08a43640 1 --2- 172.21.15.45:0/3927129011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b040a21a0 0x7f4b041e3f80 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f4b0406d420 tx=0x7f4afc007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:29.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.100+0000 7f4b00ff9640 1 -- 172.21.15.45:0/3927129011 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc014760 con 0x7f4b040a21a0 2023-10-03T19:19:29.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.100+0000 7f4b00ff9640 1 -- 172.21.15.45:0/3927129011 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4afc011040 con 0x7f4b040a21a0 2023-10-03T19:19:29.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.100+0000 7f4b0a4a6640 1 -- 172.21.15.45:0/3927129011 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b040a3ba0 con 0x7f4b040a21a0 2023-10-03T19:19:29.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.100+0000 7f4b00ff9640 1 -- 172.21.15.45:0/3927129011 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc014ae0 con 0x7f4b040a21a0 2023-10-03T19:19:29.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.100+0000 7f4b0a4a6640 1 -- 172.21.15.45:0/3927129011 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b040bcb70 con 0x7f4b040a21a0 2023-10-03T19:19:29.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.100+0000 7f4b0a4a6640 1 -- 172.21.15.45:0/3927129011 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b0406d200 con 0x7f4b040a21a0 2023-10-03T19:19:29.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.100+0000 7f4b00ff9640 1 -- 172.21.15.45:0/3927129011 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4afc014c40 con 0x7f4b040a21a0 2023-10-03T19:19:29.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.100+0000 7f4b00ff9640 1 --2- 172.21.15.45:0/3927129011 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4ae40662b0 0x7f4ae4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:29.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.104+0000 7f4b00ff9640 1 -- 172.21.15.45:0/3927129011 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f4afc083830 con 0x7f4b040a21a0 2023-10-03T19:19:29.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.104+0000 7f4b03fff640 1 --2- 172.21.15.45:0/3927129011 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4ae40662b0 0x7f4ae4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:29.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.104+0000 7f4b03fff640 1 --2- 172.21.15.45:0/3927129011 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4ae40662b0 0x7f4ae4068760 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4aec0ae000 tx=0x7f4aec0b3040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:29.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.108+0000 7f4b00ff9640 1 -- 172.21.15.45:0/3927129011 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4afc050cf0 con 0x7f4b040a21a0 2023-10-03T19:19:29.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.260+0000 7f4b0a4a6640 1 -- 172.21.15.45:0/3927129011 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4b0404de80 con 0x7f4b040a21a0 2023-10-03T19:19:29.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.960+0000 7f4b00ff9640 1 -- 172.21.15.45:0/3927129011 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v89) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4afc054310 con 0x7f4b040a21a0 2023-10-03T19:19:29.962 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-10-03T19:19:29.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.960+0000 7f4b0a4a6640 1 -- 172.21.15.45:0/3927129011 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4ae40662b0 msgr2=0x7f4ae4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:29.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.960+0000 7f4b0a4a6640 1 --2- 172.21.15.45:0/3927129011 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4ae40662b0 0x7f4ae4068760 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4aec0ae000 tx=0x7f4aec0b3040 comp rx=0 tx=0).stop 2023-10-03T19:19:29.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.960+0000 7f4b0a4a6640 1 -- 172.21.15.45:0/3927129011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b040a21a0 msgr2=0x7f4b041e3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:29.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.960+0000 7f4b0a4a6640 1 --2- 172.21.15.45:0/3927129011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b040a21a0 0x7f4b041e3f80 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f4b0406d420 tx=0x7f4afc007f00 comp rx=0 tx=0).stop 2023-10-03T19:19:29.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.960+0000 7f4b0a4a6640 1 -- 172.21.15.45:0/3927129011 shutdown_connections 2023-10-03T19:19:29.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.960+0000 7f4b0a4a6640 1 --2- 172.21.15.45:0/3927129011 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4ae40662b0 0x7f4ae4068760 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:29.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.960+0000 7f4b0a4a6640 1 --2- 172.21.15.45:0/3927129011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b040a21a0 0x7f4b041e3f80 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:29.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.960+0000 7f4b0a4a6640 1 --2- 172.21.15.45:0/3927129011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b040b7d10 0x7f4b041eabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:29.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.960+0000 7f4b0a4a6640 1 --2- 172.21.15.45:0/3927129011 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4af0003980 0x7f4b04145640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:29.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.960+0000 7f4b0a4a6640 1 -- 172.21.15.45:0/3927129011 >> 172.21.15.45:0/3927129011 conn(0x7f4b040be190 msgr2=0x7f4b04149ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:29.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.960+0000 7f4b0a4a6640 1 -- 172.21.15.45:0/3927129011 shutdown_connections 2023-10-03T19:19:29.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:29.960+0000 7f4b0a4a6640 1 -- 172.21.15.45:0/3927129011 wait complete. 2023-10-03T19:19:29.991 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-03T19:19:30.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.116+0000 7f2b3b1ac640 1 Processor -- start 2023-10-03T19:19:30.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.116+0000 7f2b3b1ac640 1 -- start start 2023-10-03T19:19:30.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.120+0000 7f2b3b1ac640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2b3406f880 0x7f2b340a5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:30.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.120+0000 7f2b3b1ac640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2b3414f510 0x7f2b3414b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:30.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.120+0000 7f2b3b1ac640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b3414f080 con 0x7f2b340bd9f0 2023-10-03T19:19:30.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.120+0000 7f2b3b1ac640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b3406f3e0 con 0x7f2b3414f510 2023-10-03T19:19:30.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.120+0000 7f2b3b1ac640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b34070e90 con 0x7f2b3406f880 2023-10-03T19:19:30.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.120+0000 7f2b33fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2b3414f510 0x7f2b3414b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:30.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.120+0000 7f2b33fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2b3414f510 0x7f2b3414b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42550/0 (socket says 172.21.15.45:42550) 2023-10-03T19:19:30.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.120+0000 7f2b33fff640 1 -- 172.21.15.45:0/3003462546 learned_addr learned my addr 172.21.15.45:0/3003462546 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:30.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.120+0000 7f2b38f48640 1 --2- 172.21.15.45:0/3003462546 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2b3406f880 0x7f2b340a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:30.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.120+0000 7f2b33fff640 1 -- 172.21.15.45:0/3003462546 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2b3406f880 msgr2=0x7f2b340a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:30.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.120+0000 7f2b33fff640 1 --2- 172.21.15.45:0/3003462546 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2b3406f880 0x7f2b340a5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:30.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.120+0000 7f2b33fff640 1 -- 172.21.15.45:0/3003462546 >> v1:172.21.15.45:6789/0 conn(0x7f2b340bd9f0 legacy=0x7f2b340badc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:30.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.120+0000 7f2b33fff640 1 -- 172.21.15.45:0/3003462546 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3414ea30 con 0x7f2b3414f510 2023-10-03T19:19:30.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.120+0000 7f2b33fff640 1 --2- 172.21.15.45:0/3003462546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b3414f510 0x7f2b3414b320 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f2b28009870 tx=0x7f2b2801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db34dea56b3e567 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:30.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.120+0000 7f2b337fe640 1 -- 172.21.15.45:0/3003462546 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b280ab670 con 0x7f2b3414f510 2023-10-03T19:19:30.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.120+0000 7f2b337fe640 1 -- 172.21.15.45:0/3003462546 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b280ab7d0 con 0x7f2b3414f510 2023-10-03T19:19:30.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.120+0000 7f2b337fe640 1 -- 172.21.15.45:0/3003462546 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b280abb60 con 0x7f2b3414f510 2023-10-03T19:19:30.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b3b1ac640 1 -- 172.21.15.45:0/3003462546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b3414f510 msgr2=0x7f2b3414b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:30.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b3b1ac640 1 --2- 172.21.15.45:0/3003462546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b3414f510 0x7f2b3414b320 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f2b28009870 tx=0x7f2b2801c510 comp rx=0 tx=0).stop 2023-10-03T19:19:30.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b3b1ac640 1 -- 172.21.15.45:0/3003462546 shutdown_connections 2023-10-03T19:19:30.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b3b1ac640 1 --2- 172.21.15.45:0/3003462546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b3414f510 0x7f2b3414b320 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:30.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b3b1ac640 1 --2- 172.21.15.45:0/3003462546 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2b3406f880 0x7f2b340a5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:30.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b3b1ac640 1 -- 172.21.15.45:0/3003462546 >> 172.21.15.45:0/3003462546 conn(0x7f2b340a20d0 msgr2=0x7f2b340a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:30.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b3b1ac640 1 -- 172.21.15.45:0/3003462546 shutdown_connections 2023-10-03T19:19:30.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b3b1ac640 1 -- 172.21.15.45:0/3003462546 wait complete. 2023-10-03T19:19:30.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b3b1ac640 1 Processor -- start 2023-10-03T19:19:30.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b3b1ac640 1 -- start start 2023-10-03T19:19:30.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b3b1ac640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b3406f880 0x7f2b340bf460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:30.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b3b1ac640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2b340bd9f0 0x7f2b3414da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:30.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b3b1ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b3414f510 0x7f2b34145730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:30.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b3b1ac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b340bfbe0 con 0x7f2b3414f510 2023-10-03T19:19:30.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b3b1ac640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b340bf9a0 con 0x7f2b3406f880 2023-10-03T19:19:30.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b3b1ac640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b341e7d10 con 0x7f2b340bd9f0 2023-10-03T19:19:30.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b39749640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b3414f510 0x7f2b34145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:30.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b39749640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b3414f510 0x7f2b34145730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42560/0 (socket says 172.21.15.45:42560) 2023-10-03T19:19:30.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b39749640 1 -- 172.21.15.45:0/938375146 learned_addr learned my addr 172.21.15.45:0/938375146 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:30.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b33fff640 1 --2- 172.21.15.45:0/938375146 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2b340bd9f0 0x7f2b3414da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:30.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b38f48640 1 --2- 172.21.15.45:0/938375146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b3406f880 0x7f2b340bf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:30.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b39749640 1 -- 172.21.15.45:0/938375146 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2b340bd9f0 msgr2=0x7f2b3414da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:30.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b39749640 1 --2- 172.21.15.45:0/938375146 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2b340bd9f0 0x7f2b3414da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:30.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b39749640 1 -- 172.21.15.45:0/938375146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b3406f880 msgr2=0x7f2b340bf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:30.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b39749640 1 --2- 172.21.15.45:0/938375146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b3406f880 0x7f2b340bf460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:30.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b39749640 1 -- 172.21.15.45:0/938375146 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b280094d0 con 0x7f2b3414f510 2023-10-03T19:19:30.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b33fff640 1 --2- 172.21.15.45:0/938375146 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2b340bd9f0 0x7f2b3414da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:30.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b39749640 1 --2- 172.21.15.45:0/938375146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b3414f510 0x7f2b34145730 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400c430 tx=0x7f2b2400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:30.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b317fa640 1 -- 172.21.15.45:0/938375146 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b24005220 con 0x7f2b3414f510 2023-10-03T19:19:30.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b317fa640 1 -- 172.21.15.45:0/938375146 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b24005380 con 0x7f2b3414f510 2023-10-03T19:19:30.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b3b1ac640 1 -- 172.21.15.45:0/938375146 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b3406fc50 con 0x7f2b3414f510 2023-10-03T19:19:30.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b317fa640 1 -- 172.21.15.45:0/938375146 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b24007270 con 0x7f2b3414f510 2023-10-03T19:19:30.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.124+0000 7f2b3b1ac640 1 -- 172.21.15.45:0/938375146 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b3414bc70 con 0x7f2b3414f510 2023-10-03T19:19:30.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.128+0000 7f2b3b1ac640 1 -- 172.21.15.45:0/938375146 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b34070a40 con 0x7f2b3414f510 2023-10-03T19:19:30.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.128+0000 7f2b317fa640 1 -- 172.21.15.45:0/938375146 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2b240073d0 con 0x7f2b3414f510 2023-10-03T19:19:30.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.128+0000 7f2b317fa640 1 --2- 172.21.15.45:0/938375146 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2b200662b0 0x7f2b20068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:30.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.128+0000 7f2b317fa640 1 -- 172.21.15.45:0/938375146 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5869+0+0 (secure 0 0 0) 0x7f2b24083190 con 0x7f2b3414f510 2023-10-03T19:19:30.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.128+0000 7f2b38f48640 1 --2- 172.21.15.45:0/938375146 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2b200662b0 0x7f2b20068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:30.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.128+0000 7f2b38f48640 1 --2- 172.21.15.45:0/938375146 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2b200662b0 0x7f2b20068760 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c009f30 tx=0x7f2b2c00b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:30.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.132+0000 7f2b317fa640 1 -- 172.21.15.45:0/938375146 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2b240506d0 con 0x7f2b3414f510 2023-10-03T19:19:30.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.292+0000 7f2b3b1ac640 1 -- 172.21.15.45:0/938375146 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2b341e7ae0 con 0x7f2b3414f510 2023-10-03T19:19:30.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.960+0000 7f2b317fa640 1 -- 172.21.15.45:0/938375146 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v90) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2b341e7ae0 con 0x7f2b3414f510 2023-10-03T19:19:30.966 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-10-03T19:19:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.964+0000 7f2b3b1ac640 1 -- 172.21.15.45:0/938375146 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2b200662b0 msgr2=0x7f2b20068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.964+0000 7f2b3b1ac640 1 --2- 172.21.15.45:0/938375146 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2b200662b0 0x7f2b20068760 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c009f30 tx=0x7f2b2c00b040 comp rx=0 tx=0).stop 2023-10-03T19:19:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.964+0000 7f2b3b1ac640 1 -- 172.21.15.45:0/938375146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b3414f510 msgr2=0x7f2b34145730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.964+0000 7f2b3b1ac640 1 --2- 172.21.15.45:0/938375146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b3414f510 0x7f2b34145730 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400c430 tx=0x7f2b2400c8f0 comp rx=0 tx=0).stop 2023-10-03T19:19:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.964+0000 7f2b3b1ac640 1 -- 172.21.15.45:0/938375146 shutdown_connections 2023-10-03T19:19:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.964+0000 7f2b3b1ac640 1 --2- 172.21.15.45:0/938375146 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2b200662b0 0x7f2b20068760 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.964+0000 7f2b3b1ac640 1 --2- 172.21.15.45:0/938375146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b3414f510 0x7f2b34145730 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.964+0000 7f2b3b1ac640 1 --2- 172.21.15.45:0/938375146 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2b340bd9f0 0x7f2b3414da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.964+0000 7f2b3b1ac640 1 --2- 172.21.15.45:0/938375146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b3406f880 0x7f2b340bf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:30.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.964+0000 7f2b3b1ac640 1 -- 172.21.15.45:0/938375146 >> 172.21.15.45:0/938375146 conn(0x7f2b340a20d0 msgr2=0x7f2b34147940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:30.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.968+0000 7f2b3b1ac640 1 -- 172.21.15.45:0/938375146 shutdown_connections 2023-10-03T19:19:30.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:30.968+0000 7f2b3b1ac640 1 -- 172.21.15.45:0/938375146 wait complete. 2023-10-03T19:19:30.992 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-03T19:19:31.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.116+0000 7fa80d9b5640 1 Processor -- start 2023-10-03T19:19:31.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.120+0000 7fa80d9b5640 1 -- start start 2023-10-03T19:19:31.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.120+0000 7fa80d9b5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa8080c4400 0x7fa80806ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:31.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.120+0000 7fa80d9b5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa8080c0720 0x7fa808151d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:31.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.120+0000 7fa80d9b5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa80806aa00 con 0x7fa80806a4e0 2023-10-03T19:19:31.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.120+0000 7fa80d9b5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8080bf5c0 con 0x7fa8080c4400 2023-10-03T19:19:31.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.120+0000 7fa80d9b5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8081527a0 con 0x7fa8080c0720 2023-10-03T19:19:31.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.120+0000 7fa8077fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa80806a4e0 0x7fa80814e820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51378/0 (socket says 172.21.15.45:51378) 2023-10-03T19:19:31.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.120+0000 7fa8077fe640 1 -- 172.21.15.45:0/750743583 learned_addr learned my addr 172.21.15.45:0/750743583 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:31.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.120+0000 7fa806ffd640 1 --2- 172.21.15.45:0/750743583 >> v2:172.21.15.45:3300/0 conn(0x7fa8080c4400 0x7fa80806ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:31.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.120+0000 7fa7fe7fc640 1 --2- 172.21.15.45:0/750743583 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa8080c0720 0x7fa808151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:31.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.120+0000 7fa8067fc640 1 -- 172.21.15.45:0/750743583 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 762705398 0 0) 0x7fa80806aa00 con 0x7fa80806a4e0 2023-10-03T19:19:31.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.120+0000 7fa8067fc640 1 -- 172.21.15.45:0/750743583 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7f4003530 con 0x7fa80806a4e0 2023-10-03T19:19:31.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.120+0000 7fa806ffd640 1 -- 172.21.15.45:0/750743583 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa8080c0720 msgr2=0x7fa808151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:31.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.120+0000 7fa806ffd640 1 --2- 172.21.15.45:0/750743583 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa8080c0720 0x7fa808151d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:31.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.120+0000 7fa806ffd640 1 -- 172.21.15.45:0/750743583 >> v1:172.21.15.45:6789/0 conn(0x7fa80806a4e0 legacy=0x7fa80814e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:31.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.120+0000 7fa806ffd640 1 -- 172.21.15.45:0/750743583 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8080a3c40 con 0x7fa8080c4400 2023-10-03T19:19:31.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.124+0000 7fa806ffd640 1 --2- 172.21.15.45:0/750743583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8080c4400 0x7fa80806ac40 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fa7f80097c0 tx=0x7fa7f801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9915e264f32f88c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:31.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.124+0000 7fa8067fc640 1 -- 172.21.15.45:0/750743583 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8004230 con 0x7fa8080c4400 2023-10-03T19:19:31.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.124+0000 7fa8067fc640 1 -- 172.21.15.45:0/750743583 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f80a7050 con 0x7fa8080c4400 2023-10-03T19:19:31.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.124+0000 7fa8067fc640 1 -- 172.21.15.45:0/750743583 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8003620 con 0x7fa8080c4400 2023-10-03T19:19:31.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.124+0000 7fa80d9b5640 1 -- 172.21.15.45:0/750743583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8080c4400 msgr2=0x7fa80806ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:31.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.124+0000 7fa80d9b5640 1 --2- 172.21.15.45:0/750743583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8080c4400 0x7fa80806ac40 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fa7f80097c0 tx=0x7fa7f801c480 comp rx=0 tx=0).stop 2023-10-03T19:19:31.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.124+0000 7fa80d9b5640 1 -- 172.21.15.45:0/750743583 shutdown_connections 2023-10-03T19:19:31.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.124+0000 7fa80d9b5640 1 --2- 172.21.15.45:0/750743583 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa8080c0720 0x7fa808151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:31.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.124+0000 7fa80d9b5640 1 --2- 172.21.15.45:0/750743583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8080c4400 0x7fa80806ac40 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:31.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.124+0000 7fa80d9b5640 1 -- 172.21.15.45:0/750743583 >> 172.21.15.45:0/750743583 conn(0x7fa8080c47f0 msgr2=0x7fa8080c4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:31.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.124+0000 7fa80d9b5640 1 -- 172.21.15.45:0/750743583 shutdown_connections 2023-10-03T19:19:31.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.124+0000 7fa80d9b5640 1 -- 172.21.15.45:0/750743583 wait complete. 2023-10-03T19:19:31.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.124+0000 7fa80d9b5640 1 Processor -- start 2023-10-03T19:19:31.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.124+0000 7fa80d9b5640 1 -- start start 2023-10-03T19:19:31.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.124+0000 7fa80d9b5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa80806a4e0 0x7fa8080a5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:31.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.124+0000 7fa80d9b5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8080c0720 0x7fa8080b8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:31.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.124+0000 7fa80d9b5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa8080c4400 0x7fa808159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:31.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.124+0000 7fa80d9b5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8080a5a80 con 0x7fa80806a4e0 2023-10-03T19:19:31.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.124+0000 7fa80d9b5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa808159aa0 con 0x7fa8080c0720 2023-10-03T19:19:31.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.124+0000 7fa80d9b5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8080b91d0 con 0x7fa8080c4400 2023-10-03T19:19:31.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.124+0000 7fa806ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa80806a4e0 0x7fa8080a5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:31.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.124+0000 7fa806ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa80806a4e0 0x7fa8080a5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42574/0 (socket says 172.21.15.45:42574) 2023-10-03T19:19:31.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.124+0000 7fa806ffd640 1 -- 172.21.15.45:0/2925979655 learned_addr learned my addr 172.21.15.45:0/2925979655 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.124+0000 7fa8077fe640 1 --2- 172.21.15.45:0/2925979655 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa8080c4400 0x7fa808159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.124+0000 7fa806ffd640 1 -- 172.21.15.45:0/2925979655 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa8080c4400 msgr2=0x7fa808159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.124+0000 7fa806ffd640 1 --2- 172.21.15.45:0/2925979655 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa8080c4400 0x7fa808159560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.124+0000 7fa806ffd640 1 -- 172.21.15.45:0/2925979655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8080c0720 msgr2=0x7fa8080b8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.124+0000 7fa806ffd640 1 --2- 172.21.15.45:0/2925979655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8080c0720 0x7fa8080b8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.124+0000 7fa806ffd640 1 -- 172.21.15.45:0/2925979655 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f8009420 con 0x7fa80806a4e0 2023-10-03T19:19:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.128+0000 7fa806ffd640 1 --2- 172.21.15.45:0/2925979655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa80806a4e0 0x7fa8080a5f10 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fa7f80ae040 tx=0x7fa7f8019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.128+0000 7fa804ff9640 1 -- 172.21.15.45:0/2925979655 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8003af0 con 0x7fa80806a4e0 2023-10-03T19:19:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.128+0000 7fa804ff9640 1 -- 172.21.15.45:0/2925979655 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f8003c50 con 0x7fa80806a4e0 2023-10-03T19:19:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.128+0000 7fa80d9b5640 1 -- 172.21.15.45:0/2925979655 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8080be580 con 0x7fa80806a4e0 2023-10-03T19:19:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.128+0000 7fa804ff9640 1 -- 172.21.15.45:0/2925979655 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f80ab440 con 0x7fa80806a4e0 2023-10-03T19:19:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.128+0000 7fa80d9b5640 1 -- 172.21.15.45:0/2925979655 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa80806b180 con 0x7fa80806a4e0 2023-10-03T19:19:31.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.128+0000 7fa80d9b5640 1 -- 172.21.15.45:0/2925979655 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8080be710 con 0x7fa80806a4e0 2023-10-03T19:19:31.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.128+0000 7fa804ff9640 1 -- 172.21.15.45:0/2925979655 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa7f80b2040 con 0x7fa80806a4e0 2023-10-03T19:19:31.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.128+0000 7fa804ff9640 1 --2- 172.21.15.45:0/2925979655 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa7e8066280 0x7fa7e8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:31.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.128+0000 7fa804ff9640 1 -- 172.21.15.45:0/2925979655 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fa7f811e260 con 0x7fa80806a4e0 2023-10-03T19:19:31.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.128+0000 7fa7fe7fc640 1 --2- 172.21.15.45:0/2925979655 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa7e8066280 0x7fa7e8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:31.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.132+0000 7fa7fe7fc640 1 --2- 172.21.15.45:0/2925979655 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa7e8066280 0x7fa7e8068730 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa8080a58f0 tx=0x7fa7f0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:31.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.132+0000 7fa804ff9640 1 -- 172.21.15.45:0/2925979655 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa7f80eba20 con 0x7fa80806a4e0 2023-10-03T19:19:31.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.292+0000 7fa80d9b5640 1 -- 172.21.15.45:0/2925979655 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa8080be710 con 0x7fa80806a4e0 2023-10-03T19:19:31.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.296+0000 7fa804ff9640 1 -- 172.21.15.45:0/2925979655 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa8080be710 con 0x7fa80806a4e0 2023-10-03T19:19:31.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.300+0000 7fa80d9b5640 1 -- 172.21.15.45:0/2925979655 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa7e8066280 msgr2=0x7fa7e8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:31.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.300+0000 7fa80d9b5640 1 --2- 172.21.15.45:0/2925979655 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa7e8066280 0x7fa7e8068730 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa8080a58f0 tx=0x7fa7f0008040 comp rx=0 tx=0).stop 2023-10-03T19:19:31.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.300+0000 7fa80d9b5640 1 -- 172.21.15.45:0/2925979655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa80806a4e0 msgr2=0x7fa8080a5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:31.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.300+0000 7fa80d9b5640 1 --2- 172.21.15.45:0/2925979655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa80806a4e0 0x7fa8080a5f10 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fa7f80ae040 tx=0x7fa7f8019220 comp rx=0 tx=0).stop 2023-10-03T19:19:31.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.300+0000 7fa80d9b5640 1 -- 172.21.15.45:0/2925979655 shutdown_connections 2023-10-03T19:19:31.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.300+0000 7fa80d9b5640 1 --2- 172.21.15.45:0/2925979655 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa7e8066280 0x7fa7e8068730 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:31.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.300+0000 7fa80d9b5640 1 --2- 172.21.15.45:0/2925979655 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa8080c4400 0x7fa808159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:31.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.300+0000 7fa80d9b5640 1 --2- 172.21.15.45:0/2925979655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8080c0720 0x7fa8080b8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:31.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.300+0000 7fa80d9b5640 1 --2- 172.21.15.45:0/2925979655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa80806a4e0 0x7fa8080a5f10 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:31.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.300+0000 7fa80d9b5640 1 -- 172.21.15.45:0/2925979655 >> 172.21.15.45:0/2925979655 conn(0x7fa8080c47f0 msgr2=0x7fa8080bbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:31.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.300+0000 7fa80d9b5640 1 -- 172.21.15.45:0/2925979655 shutdown_connections 2023-10-03T19:19:31.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.300+0000 7fa80d9b5640 1 -- 172.21.15.45:0/2925979655 wait complete. 2023-10-03T19:19:31.321 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder' 2023-10-03T19:19:31.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.444+0000 7fd9ae224640 1 Processor -- start 2023-10-03T19:19:31.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.444+0000 7fd9ae224640 1 -- start start 2023-10-03T19:19:31.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.448+0000 7fd9ae224640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd9a80bc8b0 0x7fd9a814ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:31.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.448+0000 7fd9ae224640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd9a806d170 0x7fd9a814cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:31.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.448+0000 7fd9ae224640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a806cac0 con 0x7fd9a806f170 2023-10-03T19:19:31.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.448+0000 7fd9ae224640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9a814d4f0 con 0x7fd9a806d170 2023-10-03T19:19:31.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.448+0000 7fd9ae224640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9a80720d0 con 0x7fd9a80bc8b0 2023-10-03T19:19:31.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.448+0000 7fd9a7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd9a806d170 0x7fd9a814cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:31.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.448+0000 7fd9a7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd9a806d170 0x7fd9a814cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42576/0 (socket says 172.21.15.45:42576) 2023-10-03T19:19:31.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.448+0000 7fd9a7fff640 1 -- 172.21.15.45:0/3117606723 learned_addr learned my addr 172.21.15.45:0/3117606723 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:31.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.448+0000 7fd9a6ffd640 1 --2- 172.21.15.45:0/3117606723 >> v2:172.21.15.79:3300/0 conn(0x7fd9a80bc8b0 0x7fd9a814ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:31.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.448+0000 7fd9a7fff640 1 -- 172.21.15.45:0/3117606723 >> v2:172.21.15.79:3300/0 conn(0x7fd9a80bc8b0 msgr2=0x7fd9a814ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:31.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.448+0000 7fd9a7fff640 1 --2- 172.21.15.45:0/3117606723 >> v2:172.21.15.79:3300/0 conn(0x7fd9a80bc8b0 0x7fd9a814ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:31.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.448+0000 7fd9a7fff640 1 -- 172.21.15.45:0/3117606723 >> v1:172.21.15.79:6789/0 conn(0x7fd9a806f170 legacy=0x7fd9a8150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:31.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.448+0000 7fd9a7fff640 1 -- 172.21.15.45:0/3117606723 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a80a5ab0 con 0x7fd9a806d170 2023-10-03T19:19:31.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.448+0000 7fd9a7fff640 1 --2- 172.21.15.45:0/3117606723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9a806d170 0x7fd9a814cfb0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fd9a806e9c0 tx=0x7fd99801f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a729024e4e24f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:31.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.448+0000 7fd9a67fc640 1 -- 172.21.15.45:0/3117606723 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9980af400 con 0x7fd9a806d170 2023-10-03T19:19:31.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.448+0000 7fd9a67fc640 1 -- 172.21.15.45:0/3117606723 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9980ab050 con 0x7fd9a806d170 2023-10-03T19:19:31.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.448+0000 7fd9a67fc640 1 -- 172.21.15.45:0/3117606723 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9980af780 con 0x7fd9a806d170 2023-10-03T19:19:31.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd9ae224640 1 -- 172.21.15.45:0/3117606723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9a806d170 msgr2=0x7fd9a814cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:31.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd9ae224640 1 --2- 172.21.15.45:0/3117606723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9a806d170 0x7fd9a814cfb0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fd9a806e9c0 tx=0x7fd99801f180 comp rx=0 tx=0).stop 2023-10-03T19:19:31.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd9ae224640 1 -- 172.21.15.45:0/3117606723 shutdown_connections 2023-10-03T19:19:31.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd9ae224640 1 --2- 172.21.15.45:0/3117606723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9a806d170 0x7fd9a814cfb0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:31.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd9ae224640 1 --2- 172.21.15.45:0/3117606723 >> v2:172.21.15.79:3300/0 conn(0x7fd9a80bc8b0 0x7fd9a814ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:31.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd9ae224640 1 -- 172.21.15.45:0/3117606723 >> 172.21.15.45:0/3117606723 conn(0x7fd9a80bcf50 msgr2=0x7fd9a80bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:31.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd9ae224640 1 -- 172.21.15.45:0/3117606723 shutdown_connections 2023-10-03T19:19:31.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd9ae224640 1 -- 172.21.15.45:0/3117606723 wait complete. 2023-10-03T19:19:31.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd9ae224640 1 Processor -- start 2023-10-03T19:19:31.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd9ae224640 1 -- start start 2023-10-03T19:19:31.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd9ae224640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd9a806d170 0x7fd9a81460b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:31.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd9ae224640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9a806f170 0x7fd9a8146d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:31.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd9ae224640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9a80bc8b0 0x7fd9a8147290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:31.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd9ae224640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a81d53f0 con 0x7fd9a80bc8b0 2023-10-03T19:19:31.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd9ae224640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a81418b0 con 0x7fd9a806f170 2023-10-03T19:19:31.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd9ae224640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a81465f0 con 0x7fd9a806d170 2023-10-03T19:19:31.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd9a7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9a80bc8b0 0x7fd9a8147290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:31.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd9a7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9a80bc8b0 0x7fd9a8147290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42580/0 (socket says 172.21.15.45:42580) 2023-10-03T19:19:31.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd9a7fff640 1 -- 172.21.15.45:0/341036135 learned_addr learned my addr 172.21.15.45:0/341036135 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:31.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd9a6ffd640 1 --2- 172.21.15.45:0/341036135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9a806f170 0x7fd9a8146d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:31.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd9a77fe640 1 --2- 172.21.15.45:0/341036135 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd9a806d170 0x7fd9a81460b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:31.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd9a7fff640 1 -- 172.21.15.45:0/341036135 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd9a806d170 msgr2=0x7fd9a81460b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:31.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd9a7fff640 1 --2- 172.21.15.45:0/341036135 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd9a806d170 0x7fd9a81460b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:31.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd9a7fff640 1 -- 172.21.15.45:0/341036135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9a806f170 msgr2=0x7fd9a8146d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:31.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd9a7fff640 1 --2- 172.21.15.45:0/341036135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9a806f170 0x7fd9a8146d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:31.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd9a7fff640 1 -- 172.21.15.45:0/341036135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd998009b30 con 0x7fd9a80bc8b0 2023-10-03T19:19:31.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd9a7fff640 1 --2- 172.21.15.45:0/341036135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9a80bc8b0 0x7fd9a8147290 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fd99801cdb0 tx=0x7fd99801bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:31.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd99ffff640 1 -- 172.21.15.45:0/341036135 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9980afe00 con 0x7fd9a80bc8b0 2023-10-03T19:19:31.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd99ffff640 1 -- 172.21.15.45:0/341036135 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd998009510 con 0x7fd9a80bc8b0 2023-10-03T19:19:31.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd9ae224640 1 -- 172.21.15.45:0/341036135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a814fae0 con 0x7fd9a80bc8b0 2023-10-03T19:19:31.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd99ffff640 1 -- 172.21.15.45:0/341036135 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9980ba660 con 0x7fd9a80bc8b0 2023-10-03T19:19:31.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.452+0000 7fd9ae224640 1 -- 172.21.15.45:0/341036135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a806cd00 con 0x7fd9a80bc8b0 2023-10-03T19:19:31.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.456+0000 7fd9ae224640 1 -- 172.21.15.45:0/341036135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a806d660 con 0x7fd9a80bc8b0 2023-10-03T19:19:31.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.456+0000 7fd99ffff640 1 -- 172.21.15.45:0/341036135 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd9980b6040 con 0x7fd9a80bc8b0 2023-10-03T19:19:31.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.456+0000 7fd99ffff640 1 --2- 172.21.15.45:0/341036135 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd9880662b0 0x7fd988068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:31.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.456+0000 7fd99ffff640 1 -- 172.21.15.45:0/341036135 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fd9981219d0 con 0x7fd9a80bc8b0 2023-10-03T19:19:31.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.456+0000 7fd9a77fe640 1 --2- 172.21.15.45:0/341036135 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd9880662b0 0x7fd988068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:31.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.456+0000 7fd9a77fe640 1 --2- 172.21.15.45:0/341036135 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd9880662b0 0x7fd988068760 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fd9a000b810 tx=0x7fd9a0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:31.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.460+0000 7fd99ffff640 1 -- 172.21.15.45:0/341036135 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd9980ef1b0 con 0x7fd9a80bc8b0 2023-10-03T19:19:31.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.672+0000 7fd9ae224640 1 -- 172.21.15.45:0/341036135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]} v 0) v1 -- 0x7fd9a806cac0 con 0x7fd9a80bc8b0 2023-10-03T19:19:31.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.992+0000 7fd99ffff640 1 -- 172.21.15.45:0/341036135 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]}]=0 v324) v1 ==== 139+0+0 (secure 0 0 0) 0x7fd9a806cac0 con 0x7fd9a80bc8b0 2023-10-03T19:19:31.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.996+0000 7fd9ae224640 1 -- 172.21.15.45:0/341036135 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd9880662b0 msgr2=0x7fd988068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:31.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.996+0000 7fd9ae224640 1 --2- 172.21.15.45:0/341036135 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd9880662b0 0x7fd988068760 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fd9a000b810 tx=0x7fd9a0008040 comp rx=0 tx=0).stop 2023-10-03T19:19:31.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.996+0000 7fd9ae224640 1 -- 172.21.15.45:0/341036135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9a80bc8b0 msgr2=0x7fd9a8147290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:31.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.996+0000 7fd9ae224640 1 --2- 172.21.15.45:0/341036135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9a80bc8b0 0x7fd9a8147290 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fd99801cdb0 tx=0x7fd99801bf20 comp rx=0 tx=0).stop 2023-10-03T19:19:31.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.996+0000 7fd9ae224640 1 -- 172.21.15.45:0/341036135 shutdown_connections 2023-10-03T19:19:31.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.996+0000 7fd9ae224640 1 --2- 172.21.15.45:0/341036135 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd9880662b0 0x7fd988068760 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:31.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.996+0000 7fd9ae224640 1 --2- 172.21.15.45:0/341036135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9a80bc8b0 0x7fd9a8147290 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:31.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.996+0000 7fd9ae224640 1 --2- 172.21.15.45:0/341036135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9a806f170 0x7fd9a8146d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:31.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.996+0000 7fd9ae224640 1 --2- 172.21.15.45:0/341036135 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd9a806d170 0x7fd9a81460b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:31.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.996+0000 7fd9ae224640 1 -- 172.21.15.45:0/341036135 >> 172.21.15.45:0/341036135 conn(0x7fd9a80bcf50 msgr2=0x7fd9a814f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:31.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.996+0000 7fd9ae224640 1 -- 172.21.15.45:0/341036135 shutdown_connections 2023-10-03T19:19:31.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:31.996+0000 7fd9ae224640 1 -- 172.21.15.45:0/341036135 wait complete. 2023-10-03T19:19:32.017 INFO:tasks.cephfs_test_runner:Check that a client is evicted if it has not responded to cap revoke ... ok 2023-10-03T19:19:32.018 INFO:tasks.cephfs_test_runner:Starting test: test_dump_dir (tasks.cephfs.test_misc.TestMisc) 2023-10-03T19:19:32.018 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_dump_dir' 2023-10-03T19:19:32.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.144+0000 7fc269417640 1 Processor -- start 2023-10-03T19:19:32.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.144+0000 7fc269417640 1 -- start start 2023-10-03T19:19:32.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.144+0000 7fc269417640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc26406f170 0x7fc264150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:32.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.144+0000 7fc269417640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc26406cac0 con 0x7fc2640bc8b0 2023-10-03T19:19:32.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.144+0000 7fc269417640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2640720d0 con 0x7fc26406d170 2023-10-03T19:19:32.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.144+0000 7fc269417640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2640a5ab0 con 0x7fc26406f170 2023-10-03T19:19:32.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.144+0000 7fc2627fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc2640bc8b0 0x7fc26414ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51394/0 (socket says 172.21.15.45:51394) 2023-10-03T19:19:32.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.144+0000 7fc2627fc640 1 -- 172.21.15.45:0/3844913838 learned_addr learned my addr 172.21.15.45:0/3844913838 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:32.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.144+0000 7fc262ffd640 1 --2- 172.21.15.45:0/3844913838 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc26406f170 0x7fc264150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:32.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.144+0000 7fc261ffb640 1 -- 172.21.15.45:0/3844913838 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4235693416 0 0) 0x7fc258001120 con 0x7fc2640bc8b0 2023-10-03T19:19:32.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.144+0000 7fc261ffb640 1 -- 172.21.15.45:0/3844913838 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc24c003530 con 0x7fc2640bc8b0 2023-10-03T19:19:32.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.144+0000 7fc261ffb640 1 -- 172.21.15.45:0/3844913838 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 741097919 0 0) 0x7fc2640720d0 con 0x7fc26406d170 2023-10-03T19:19:32.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.144+0000 7fc261ffb640 1 -- 172.21.15.45:0/3844913838 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc258001120 con 0x7fc26406d170 2023-10-03T19:19:32.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.144+0000 7fc262ffd640 1 -- 172.21.15.45:0/3844913838 >> v1:172.21.15.79:6789/0 conn(0x7fc26406d170 legacy=0x7fc264156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:32.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.144+0000 7fc262ffd640 1 -- 172.21.15.45:0/3844913838 >> v1:172.21.15.45:6789/0 conn(0x7fc2640bc8b0 legacy=0x7fc26414ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:32.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.144+0000 7fc262ffd640 1 -- 172.21.15.45:0/3844913838 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26406cd00 con 0x7fc26406f170 2023-10-03T19:19:32.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.148+0000 7fc262ffd640 1 --2- 172.21.15.45:0/3844913838 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc26406f170 0x7fc264150190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc254009dc0 tx=0x7fc25401c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=863a6b3b31c48548 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:32.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.148+0000 7fc261ffb640 1 -- 172.21.15.45:0/3844913838 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2540a5940 con 0x7fc26406f170 2023-10-03T19:19:32.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.148+0000 7fc261ffb640 1 -- 172.21.15.45:0/3844913838 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2540a5aa0 con 0x7fc26406f170 2023-10-03T19:19:32.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.148+0000 7fc261ffb640 1 -- 172.21.15.45:0/3844913838 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2540a5e10 con 0x7fc26406f170 2023-10-03T19:19:32.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.148+0000 7fc269417640 1 -- 172.21.15.45:0/3844913838 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc26406f170 msgr2=0x7fc264150190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:32.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.148+0000 7fc269417640 1 --2- 172.21.15.45:0/3844913838 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc26406f170 0x7fc264150190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc254009dc0 tx=0x7fc25401c930 comp rx=0 tx=0).stop 2023-10-03T19:19:32.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.148+0000 7fc269417640 1 -- 172.21.15.45:0/3844913838 shutdown_connections 2023-10-03T19:19:32.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.148+0000 7fc269417640 1 --2- 172.21.15.45:0/3844913838 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc26406f170 0x7fc264150190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:32.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.148+0000 7fc269417640 1 -- 172.21.15.45:0/3844913838 >> 172.21.15.45:0/3844913838 conn(0x7fc2640bcf50 msgr2=0x7fc2640bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:32.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.148+0000 7fc269417640 1 -- 172.21.15.45:0/3844913838 shutdown_connections 2023-10-03T19:19:32.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.148+0000 7fc269417640 1 -- 172.21.15.45:0/3844913838 wait complete. 2023-10-03T19:19:32.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.148+0000 7fc269417640 1 Processor -- start 2023-10-03T19:19:32.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.148+0000 7fc269417640 1 -- start start 2023-10-03T19:19:32.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.148+0000 7fc269417640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc26406d170 0x7fc2641e7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:32.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.148+0000 7fc269417640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc26406f170 0x7fc2640c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:32.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.148+0000 7fc269417640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc2640bc8b0 0x7fc2640a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:32.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.148+0000 7fc269417640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2640a4f50 con 0x7fc26406d170 2023-10-03T19:19:32.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.148+0000 7fc269417640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2640c1100 con 0x7fc26406f170 2023-10-03T19:19:32.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.148+0000 7fc269417640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2641e7380 con 0x7fc2640bc8b0 2023-10-03T19:19:32.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.148+0000 7fc262ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc26406d170 0x7fc2641e7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:32.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.148+0000 7fc262ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc26406d170 0x7fc2641e7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42596/0 (socket says 172.21.15.45:42596) 2023-10-03T19:19:32.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.152+0000 7fc262ffd640 1 -- 172.21.15.45:0/86010928 learned_addr learned my addr 172.21.15.45:0/86010928 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:32.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.152+0000 7fc2637fe640 1 --2- 172.21.15.45:0/86010928 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc2640bc8b0 0x7fc2640a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:32.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.152+0000 7fc2627fc640 1 --2- 172.21.15.45:0/86010928 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc26406f170 0x7fc2640c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:32.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.152+0000 7fc262ffd640 1 -- 172.21.15.45:0/86010928 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc2640bc8b0 msgr2=0x7fc2640a3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:32.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.152+0000 7fc262ffd640 1 --2- 172.21.15.45:0/86010928 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc2640bc8b0 0x7fc2640a3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:32.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.152+0000 7fc262ffd640 1 -- 172.21.15.45:0/86010928 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc26406f170 msgr2=0x7fc2640c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:32.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.152+0000 7fc262ffd640 1 --2- 172.21.15.45:0/86010928 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc26406f170 0x7fc2640c0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:32.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.152+0000 7fc262ffd640 1 -- 172.21.15.45:0/86010928 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc254009a70 con 0x7fc26406d170 2023-10-03T19:19:32.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.152+0000 7fc2637fe640 1 --2- 172.21.15.45:0/86010928 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc2640bc8b0 0x7fc2640a3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:19:32.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.152+0000 7fc262ffd640 1 --2- 172.21.15.45:0/86010928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc26406d170 0x7fc2641e7e40 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fc25401a560 tx=0x7fc2540196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:32.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.152+0000 7fc24b7fe640 1 -- 172.21.15.45:0/86010928 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2540a58c0 con 0x7fc26406d170 2023-10-03T19:19:32.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.152+0000 7fc24b7fe640 1 -- 172.21.15.45:0/86010928 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc254003bb0 con 0x7fc26406d170 2023-10-03T19:19:32.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.152+0000 7fc269417640 1 -- 172.21.15.45:0/86010928 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc26406f6d0 con 0x7fc26406d170 2023-10-03T19:19:32.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.152+0000 7fc24b7fe640 1 -- 172.21.15.45:0/86010928 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc254004040 con 0x7fc26406d170 2023-10-03T19:19:32.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.152+0000 7fc269417640 1 -- 172.21.15.45:0/86010928 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc26406f540 con 0x7fc26406d170 2023-10-03T19:19:32.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.152+0000 7fc269417640 1 -- 172.21.15.45:0/86010928 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc26415ad90 con 0x7fc26406d170 2023-10-03T19:19:32.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.152+0000 7fc24b7fe640 1 -- 172.21.15.45:0/86010928 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc2540041a0 con 0x7fc26406d170 2023-10-03T19:19:32.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.152+0000 7fc24b7fe640 1 --2- 172.21.15.45:0/86010928 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc2500662b0 0x7fc250068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:32.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.152+0000 7fc24b7fe640 1 -- 172.21.15.45:0/86010928 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fc25411e880 con 0x7fc26406d170 2023-10-03T19:19:32.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.152+0000 7fc2627fc640 1 --2- 172.21.15.45:0/86010928 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc2500662b0 0x7fc250068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:32.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.152+0000 7fc2627fc640 1 --2- 172.21.15.45:0/86010928 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc2500662b0 0x7fc250068760 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc2640a5850 tx=0x7fc258009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:32.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.156+0000 7fc24b7fe640 1 -- 172.21.15.45:0/86010928 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc2540ec070 con 0x7fc26406d170 2023-10-03T19:19:32.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.372+0000 7fc269417640 1 -- 172.21.15.45:0/86010928 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_dir"]} v 0) v1 -- 0x7fc26406d660 con 0x7fc26406d170 2023-10-03T19:19:32.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:32.996+0000 7fc24b7fe640 1 -- 172.21.15.45:0/86010928 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_dir"]}]=0 v325) v1 ==== 127+0+0 (secure 0 0 0) 0x7fc2540ef690 con 0x7fc26406d170 2023-10-03T19:19:33.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.000+0000 7fc269417640 1 -- 172.21.15.45:0/86010928 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc2500662b0 msgr2=0x7fc250068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:33.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.000+0000 7fc269417640 1 --2- 172.21.15.45:0/86010928 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc2500662b0 0x7fc250068760 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc2640a5850 tx=0x7fc258009040 comp rx=0 tx=0).stop 2023-10-03T19:19:33.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.000+0000 7fc269417640 1 -- 172.21.15.45:0/86010928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc26406d170 msgr2=0x7fc2641e7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:33.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.000+0000 7fc269417640 1 --2- 172.21.15.45:0/86010928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc26406d170 0x7fc2641e7e40 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fc25401a560 tx=0x7fc2540196d0 comp rx=0 tx=0).stop 2023-10-03T19:19:33.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.000+0000 7fc269417640 1 -- 172.21.15.45:0/86010928 shutdown_connections 2023-10-03T19:19:33.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.000+0000 7fc269417640 1 --2- 172.21.15.45:0/86010928 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc2500662b0 0x7fc250068760 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:33.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.000+0000 7fc269417640 1 --2- 172.21.15.45:0/86010928 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc2640bc8b0 0x7fc2640a3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:33.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.000+0000 7fc269417640 1 --2- 172.21.15.45:0/86010928 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc26406f170 0x7fc2640c0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:33.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.000+0000 7fc269417640 1 --2- 172.21.15.45:0/86010928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc26406d170 0x7fc2641e7e40 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:33.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.000+0000 7fc269417640 1 -- 172.21.15.45:0/86010928 >> 172.21.15.45:0/86010928 conn(0x7fc2640bcf50 msgr2=0x7fc264148400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:33.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.000+0000 7fc269417640 1 -- 172.21.15.45:0/86010928 shutdown_connections 2023-10-03T19:19:33.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.000+0000 7fc269417640 1 -- 172.21.15.45:0/86010928 wait complete. 2023-10-03T19:19:33.022 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-03T19:19:33.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d77a59640 1 Processor -- start 2023-10-03T19:19:33.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d77a59640 1 -- start start 2023-10-03T19:19:33.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d77a59640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d700712c0 0x7f3d700bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:33.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d77a59640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d7006c2d0 con 0x7f3d7006c760 2023-10-03T19:19:33.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d77a59640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d70150610 con 0x7f3d7006d560 2023-10-03T19:19:33.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d77a59640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d701508b0 con 0x7f3d700712c0 2023-10-03T19:19:33.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d75ff6640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3d7006c760 0x7f3d700a5ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51406/0 (socket says 172.21.15.45:51406) 2023-10-03T19:19:33.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d75ff6640 1 -- 172.21.15.45:0/2445941669 learned_addr learned my addr 172.21.15.45:0/2445941669 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:33.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d757f5640 1 --2- 172.21.15.45:0/2445941669 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d700712c0 0x7f3d700bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:33.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d67fff640 1 -- 172.21.15.45:0/2445941669 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 222369338 0 0) 0x7f3d7006c2d0 con 0x7f3d7006c760 2023-10-03T19:19:33.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d67fff640 1 -- 172.21.15.45:0/2445941669 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d5c003530 con 0x7f3d7006c760 2023-10-03T19:19:33.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d67fff640 1 -- 172.21.15.45:0/2445941669 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3849850332 0 0) 0x7f3d5c003530 con 0x7f3d7006c760 2023-10-03T19:19:33.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d67fff640 1 -- 172.21.15.45:0/2445941669 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d700712c0 msgr2=0x7f3d700bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:33.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d67fff640 1 --2- 172.21.15.45:0/2445941669 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d700712c0 0x7f3d700bcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:33.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d67fff640 1 -- 172.21.15.45:0/2445941669 >> v1:172.21.15.79:6789/0 conn(0x7f3d7006d560 legacy=0x7f3d700a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:33.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d67fff640 1 -- 172.21.15.45:0/2445941669 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7006d2e0 con 0x7f3d7006c760 2023-10-03T19:19:33.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d67fff640 1 -- 172.21.15.45:0/2445941669 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f3d68001a00 con 0x7f3d7006c760 2023-10-03T19:19:33.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d67fff640 1 -- 172.21.15.45:0/2445941669 >> v1:172.21.15.45:6789/0 conn(0x7f3d7006c760 legacy=0x7f3d700a5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:33.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d67fff640 1 --2- 172.21.15.45:0/2445941669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d5c0039b0 0x7f3d5c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:33.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d67fff640 1 --2- 172.21.15.45:0/2445941669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d5c0047d0 0x7f3d5c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:33.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d67fff640 1 --2- 172.21.15.45:0/2445941669 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d700712c0 0x7f3d5c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:33.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d67fff640 1 -- 172.21.15.45:0/2445941669 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d701508b0 con 0x7f3d5c0047d0 2023-10-03T19:19:33.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d67fff640 1 -- 172.21.15.45:0/2445941669 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c00ba40 con 0x7f3d5c0039b0 2023-10-03T19:19:33.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d67fff640 1 -- 172.21.15.45:0/2445941669 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c00bbd0 con 0x7f3d700712c0 2023-10-03T19:19:33.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d74ff4640 1 --2- 172.21.15.45:0/2445941669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d5c0047d0 0x7f3d5c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:33.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d757f5640 1 --2- 172.21.15.45:0/2445941669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d5c0039b0 0x7f3d5c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:33.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d75ff6640 1 --2- 172.21.15.45:0/2445941669 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d700712c0 0x7f3d5c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:33.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d74ff4640 1 -- 172.21.15.45:0/2445941669 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d700712c0 msgr2=0x7f3d5c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:33.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d74ff4640 1 --2- 172.21.15.45:0/2445941669 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d700712c0 0x7f3d5c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:33.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d74ff4640 1 -- 172.21.15.45:0/2445941669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d5c0039b0 msgr2=0x7f3d5c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:33.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d74ff4640 1 --2- 172.21.15.45:0/2445941669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d5c0039b0 0x7f3d5c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:33.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d74ff4640 1 -- 172.21.15.45:0/2445941669 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5c003530 con 0x7f3d5c0047d0 2023-10-03T19:19:33.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.152+0000 7f3d757f5640 1 --2- 172.21.15.45:0/2445941669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d5c0039b0 0x7f3d5c003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:33.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.156+0000 7f3d74ff4640 1 --2- 172.21.15.45:0/2445941669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d5c0047d0 0x7f3d5c004c40 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f3d60001780 tx=0x7f3d6001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=748e51f285148766 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:33.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.156+0000 7f3d67fff640 1 -- 172.21.15.45:0/2445941669 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600052d0 con 0x7f3d5c0047d0 2023-10-03T19:19:33.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.156+0000 7f3d67fff640 1 -- 172.21.15.45:0/2445941669 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d600a7050 con 0x7f3d5c0047d0 2023-10-03T19:19:33.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.156+0000 7f3d67fff640 1 -- 172.21.15.45:0/2445941669 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d60003600 con 0x7f3d5c0047d0 2023-10-03T19:19:33.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.156+0000 7f3d77a59640 1 -- 172.21.15.45:0/2445941669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d5c0047d0 msgr2=0x7f3d5c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:33.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.156+0000 7f3d77a59640 1 --2- 172.21.15.45:0/2445941669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d5c0047d0 0x7f3d5c004c40 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f3d60001780 tx=0x7f3d6001c400 comp rx=0 tx=0).stop 2023-10-03T19:19:33.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.156+0000 7f3d75ff6640 1 -- 172.21.15.45:0/2445941669 reap_dead start 2023-10-03T19:19:33.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.156+0000 7f3d77a59640 1 -- 172.21.15.45:0/2445941669 shutdown_connections 2023-10-03T19:19:33.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.156+0000 7f3d77a59640 1 -- 172.21.15.45:0/2445941669 >> 172.21.15.45:0/2445941669 conn(0x7f3d700a20d0 msgr2=0x7f3d700a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:33.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.156+0000 7f3d77a59640 1 -- 172.21.15.45:0/2445941669 shutdown_connections 2023-10-03T19:19:33.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.156+0000 7f3d77a59640 1 -- 172.21.15.45:0/2445941669 wait complete. 2023-10-03T19:19:33.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.156+0000 7f3d77a59640 1 Processor -- start 2023-10-03T19:19:33.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.156+0000 7f3d77a59640 1 -- start start 2023-10-03T19:19:33.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.156+0000 7f3d77a59640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d5c0047d0 0x7f3d701ebfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:33.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.156+0000 7f3d77a59640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d70070c20 0x7f3d700a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:33.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.156+0000 7f3d77a59640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d7013fd80 0x7f3d70144420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:33.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.156+0000 7f3d77a59640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d700706a0 con 0x7f3d70070c20 2023-10-03T19:19:33.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.156+0000 7f3d77a59640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d701eb590 con 0x7f3d5c0047d0 2023-10-03T19:19:33.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.156+0000 7f3d77a59640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d701ebb50 con 0x7f3d7013fd80 2023-10-03T19:19:33.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.156+0000 7f3d74ff4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d70070c20 0x7f3d700a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:33.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.156+0000 7f3d74ff4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d70070c20 0x7f3d700a13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42606/0 (socket says 172.21.15.45:42606) 2023-10-03T19:19:33.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.156+0000 7f3d74ff4640 1 -- 172.21.15.45:0/3453553892 learned_addr learned my addr 172.21.15.45:0/3453553892 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:33.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.160+0000 7f3d757f5640 1 --2- 172.21.15.45:0/3453553892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d5c0047d0 0x7f3d701ebfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:33.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.160+0000 7f3d75ff6640 1 --2- 172.21.15.45:0/3453553892 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d7013fd80 0x7f3d70144420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:33.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.160+0000 7f3d74ff4640 1 -- 172.21.15.45:0/3453553892 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d7013fd80 msgr2=0x7f3d70144420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:33.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.160+0000 7f3d74ff4640 1 --2- 172.21.15.45:0/3453553892 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d7013fd80 0x7f3d70144420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:33.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.160+0000 7f3d74ff4640 1 -- 172.21.15.45:0/3453553892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d5c0047d0 msgr2=0x7f3d701ebfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:33.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.160+0000 7f3d74ff4640 1 --2- 172.21.15.45:0/3453553892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d5c0047d0 0x7f3d701ebfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:33.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.160+0000 7f3d74ff4640 1 -- 172.21.15.45:0/3453553892 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d70071690 con 0x7f3d70070c20 2023-10-03T19:19:33.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.160+0000 7f3d74ff4640 1 --2- 172.21.15.45:0/3453553892 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d70070c20 0x7f3d700a13c0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f3d60005040 tx=0x7f3d5c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:33.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.160+0000 7f3d65ffb640 1 -- 172.21.15.45:0/3453553892 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d60007250 con 0x7f3d70070c20 2023-10-03T19:19:33.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.160+0000 7f3d65ffb640 1 -- 172.21.15.45:0/3453553892 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d600073b0 con 0x7f3d70070c20 2023-10-03T19:19:33.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.160+0000 7f3d77a59640 1 -- 172.21.15.45:0/3453553892 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d7006cf40 con 0x7f3d70070c20 2023-10-03T19:19:33.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.160+0000 7f3d65ffb640 1 -- 172.21.15.45:0/3453553892 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600067e0 con 0x7f3d70070c20 2023-10-03T19:19:33.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.160+0000 7f3d77a59640 1 -- 172.21.15.45:0/3453553892 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d70071820 con 0x7f3d70070c20 2023-10-03T19:19:33.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.160+0000 7f3d77a59640 1 -- 172.21.15.45:0/3453553892 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d7004de80 con 0x7f3d70070c20 2023-10-03T19:19:33.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.160+0000 7f3d65ffb640 1 -- 172.21.15.45:0/3453553892 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3d60006940 con 0x7f3d70070c20 2023-10-03T19:19:33.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.160+0000 7f3d65ffb640 1 --2- 172.21.15.45:0/3453553892 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3d540662b0 0x7f3d54068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:33.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.160+0000 7f3d65ffb640 1 -- 172.21.15.45:0/3453553892 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f3d6011df00 con 0x7f3d70070c20 2023-10-03T19:19:33.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.160+0000 7f3d757f5640 1 --2- 172.21.15.45:0/3453553892 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3d540662b0 0x7f3d54068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:33.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.160+0000 7f3d757f5640 1 --2- 172.21.15.45:0/3453553892 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3d540662b0 0x7f3d54068760 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009c00 tx=0x7f3d6c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:33.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.164+0000 7f3d65ffb640 1 -- 172.21.15.45:0/3453553892 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3d600eb660 con 0x7f3d70070c20 2023-10-03T19:19:33.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.316+0000 7f3d77a59640 1 -- 172.21.15.45:0/3453553892 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3d701ebce0 con 0x7f3d70070c20 2023-10-03T19:19:33.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.324+0000 7f3d65ffb640 1 -- 172.21.15.45:0/3453553892 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3d600eec80 con 0x7f3d70070c20 2023-10-03T19:19:33.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.324+0000 7f3d77a59640 1 -- 172.21.15.45:0/3453553892 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3d540662b0 msgr2=0x7f3d54068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:33.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.324+0000 7f3d77a59640 1 --2- 172.21.15.45:0/3453553892 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3d540662b0 0x7f3d54068760 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009c00 tx=0x7f3d6c008040 comp rx=0 tx=0).stop 2023-10-03T19:19:33.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.324+0000 7f3d77a59640 1 -- 172.21.15.45:0/3453553892 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d70070c20 msgr2=0x7f3d700a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:33.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.324+0000 7f3d77a59640 1 --2- 172.21.15.45:0/3453553892 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d70070c20 0x7f3d700a13c0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f3d60005040 tx=0x7f3d5c005800 comp rx=0 tx=0).stop 2023-10-03T19:19:33.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.324+0000 7f3d77a59640 1 -- 172.21.15.45:0/3453553892 shutdown_connections 2023-10-03T19:19:33.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.324+0000 7f3d77a59640 1 --2- 172.21.15.45:0/3453553892 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3d540662b0 0x7f3d54068760 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:33.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.324+0000 7f3d77a59640 1 --2- 172.21.15.45:0/3453553892 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d7013fd80 0x7f3d70144420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:33.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.324+0000 7f3d77a59640 1 --2- 172.21.15.45:0/3453553892 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d70070c20 0x7f3d700a13c0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:33.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.324+0000 7f3d77a59640 1 --2- 172.21.15.45:0/3453553892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d5c0047d0 0x7f3d701ebfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:33.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.324+0000 7f3d77a59640 1 -- 172.21.15.45:0/3453553892 >> 172.21.15.45:0/3453553892 conn(0x7f3d700a20d0 msgr2=0x7f3d701488b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:33.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.328+0000 7f3d77a59640 1 -- 172.21.15.45:0/3453553892 shutdown_connections 2023-10-03T19:19:33.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.328+0000 7f3d77a59640 1 -- 172.21.15.45:0/3453553892 wait complete. 2023-10-03T19:19:33.346 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-03T19:19:33.347 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:19:33.385 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:19:33.429 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:19:33.479 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:19:33.495 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:19:33.497 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:19:33.500 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:19:33.502 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:19:33.523 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-03T19:19:33.523 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:19:33.523 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:19:33.549 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336540k,nr_inodes=4084135,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16206 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-10-03T19:19:33.549 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-03T19:19:33.550 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:19:33.570 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336540k,nr_inodes=4084135,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=22607 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-10-03T19:19:33.570 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-10-03T19:19:33.570 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:19:33.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.712+0000 7ff37f3cb640 1 Processor -- start 2023-10-03T19:19:33.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.712+0000 7ff37f3cb640 1 -- start start 2023-10-03T19:19:33.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff37f3cb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff3780bcb60 0x7ff37806c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:33.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff37f3cb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff37814b610 con 0x7ff378148b90 2023-10-03T19:19:33.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff37f3cb640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3780a5580 con 0x7ff37806c7d0 2023-10-03T19:19:33.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff37f3cb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3780a3670 con 0x7ff3780bcb60 2023-10-03T19:19:33.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff37d167640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff378148b90 0x7ff3780bbf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51408/0 (socket says 172.21.15.45:51408) 2023-10-03T19:19:33.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff37d167640 1 -- 172.21.15.45:0/448364395 learned_addr learned my addr 172.21.15.45:0/448364395 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:33.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff37c966640 1 --2- 172.21.15.45:0/448364395 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff3780bcb60 0x7ff37806c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:33.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff36ffff640 1 -- 172.21.15.45:0/448364395 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163747314 0 0) 0x7ff37814b610 con 0x7ff378148b90 2023-10-03T19:19:33.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff36ffff640 1 -- 172.21.15.45:0/448364395 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff364003530 con 0x7ff378148b90 2023-10-03T19:19:33.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff36ffff640 1 -- 172.21.15.45:0/448364395 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 96517254 0 0) 0x7ff364003530 con 0x7ff378148b90 2023-10-03T19:19:33.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff36ffff640 1 -- 172.21.15.45:0/448364395 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff3780bcb60 msgr2=0x7ff37806c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:33.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff36ffff640 1 --2- 172.21.15.45:0/448364395 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff3780bcb60 0x7ff37806c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:33.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff36ffff640 1 -- 172.21.15.45:0/448364395 >> v1:172.21.15.79:6789/0 conn(0x7ff37806c7d0 legacy=0x7ff378155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:33.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff36ffff640 1 -- 172.21.15.45:0/448364395 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3780a5820 con 0x7ff378148b90 2023-10-03T19:19:33.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff36ffff640 1 -- 172.21.15.45:0/448364395 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7ff370001a00 con 0x7ff378148b90 2023-10-03T19:19:33.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff36ffff640 1 -- 172.21.15.45:0/448364395 >> v1:172.21.15.45:6789/0 conn(0x7ff378148b90 legacy=0x7ff3780bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:33.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff36ffff640 1 --2- 172.21.15.45:0/448364395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3640039b0 0x7ff364003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:33.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff36ffff640 1 --2- 172.21.15.45:0/448364395 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff3780bcb60 0x7ff3640047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:33.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff36ffff640 1 --2- 172.21.15.45:0/448364395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff364004d10 0x7ff364005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:33.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff36ffff640 1 -- 172.21.15.45:0/448364395 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3780a3670 con 0x7ff3640039b0 2023-10-03T19:19:33.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff36ffff640 1 -- 172.21.15.45:0/448364395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36400bad0 con 0x7ff364004d10 2023-10-03T19:19:33.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff36ffff640 1 -- 172.21.15.45:0/448364395 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36400bc60 con 0x7ff3780bcb60 2023-10-03T19:19:33.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff37d167640 1 --2- 172.21.15.45:0/448364395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3640039b0 0x7ff364003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:33.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff37c966640 1 --2- 172.21.15.45:0/448364395 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff3780bcb60 0x7ff3640047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:33.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff37d968640 1 --2- 172.21.15.45:0/448364395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff364004d10 0x7ff364005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:33.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff37d167640 1 -- 172.21.15.45:0/448364395 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff3780bcb60 msgr2=0x7ff3640047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:33.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff37d167640 1 --2- 172.21.15.45:0/448364395 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff3780bcb60 0x7ff3640047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:33.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff37d167640 1 -- 172.21.15.45:0/448364395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff364004d10 msgr2=0x7ff364005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:33.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff37d167640 1 --2- 172.21.15.45:0/448364395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff364004d10 0x7ff364005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:33.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff37d167640 1 -- 172.21.15.45:0/448364395 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff364003530 con 0x7ff3640039b0 2023-10-03T19:19:33.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff37d167640 1 --2- 172.21.15.45:0/448364395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3640039b0 0x7ff364003dc0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7ff37000a830 tx=0x7ff37001faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=352033a555bd5822 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:33.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff36ffff640 1 -- 172.21.15.45:0/448364395 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3700aa6d0 con 0x7ff3640039b0 2023-10-03T19:19:33.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff36ffff640 1 -- 172.21.15.45:0/448364395 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3700aa850 con 0x7ff3640039b0 2023-10-03T19:19:33.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.716+0000 7ff36ffff640 1 -- 172.21.15.45:0/448364395 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3700aac00 con 0x7ff3640039b0 2023-10-03T19:19:33.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff37f3cb640 1 -- 172.21.15.45:0/448364395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3640039b0 msgr2=0x7ff364003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:33.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff37f3cb640 1 --2- 172.21.15.45:0/448364395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3640039b0 0x7ff364003dc0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7ff37000a830 tx=0x7ff37001faa0 comp rx=0 tx=0).stop 2023-10-03T19:19:33.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff37d968640 1 -- 172.21.15.45:0/448364395 reap_dead start 2023-10-03T19:19:33.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff37f3cb640 1 -- 172.21.15.45:0/448364395 shutdown_connections 2023-10-03T19:19:33.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff37f3cb640 1 -- 172.21.15.45:0/448364395 >> 172.21.15.45:0/448364395 conn(0x7ff3780bcf50 msgr2=0x7ff3780bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:33.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff37f3cb640 1 -- 172.21.15.45:0/448364395 shutdown_connections 2023-10-03T19:19:33.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff37f3cb640 1 -- 172.21.15.45:0/448364395 wait complete. 2023-10-03T19:19:33.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff37f3cb640 1 Processor -- start 2023-10-03T19:19:33.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff37f3cb640 1 -- start start 2023-10-03T19:19:33.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff37f3cb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3640039b0 0x7ff3781491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:33.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff37f3cb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff37814cd00 0x7ff378143ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:33.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff37f3cb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff3781e5540 0x7ff3781426a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:33.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff37f3cb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37814ca70 con 0x7ff3640039b0 2023-10-03T19:19:33.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff37f3cb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff378149720 con 0x7ff37814cd00 2023-10-03T19:19:33.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff37f3cb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff37814a140 con 0x7ff3781e5540 2023-10-03T19:19:33.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff37d167640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3640039b0 0x7ff3781491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:33.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff37d167640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3640039b0 0x7ff3781491e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42624/0 (socket says 172.21.15.45:42624) 2023-10-03T19:19:33.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff37d167640 1 -- 172.21.15.45:0/835695030 learned_addr learned my addr 172.21.15.45:0/835695030 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:33.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff37c966640 1 --2- 172.21.15.45:0/835695030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff37814cd00 0x7ff378143ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:33.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff37d968640 1 --2- 172.21.15.45:0/835695030 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff3781e5540 0x7ff3781426a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:33.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff37d167640 1 -- 172.21.15.45:0/835695030 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff3781e5540 msgr2=0x7ff3781426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:33.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff37d167640 1 --2- 172.21.15.45:0/835695030 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff3781e5540 0x7ff3781426a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:33.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff37d167640 1 -- 172.21.15.45:0/835695030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff37814cd00 msgr2=0x7ff378143ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:33.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff37d167640 1 --2- 172.21.15.45:0/835695030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff37814cd00 0x7ff378143ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:33.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff37d167640 1 -- 172.21.15.45:0/835695030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff378148f60 con 0x7ff3640039b0 2023-10-03T19:19:33.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff37d167640 1 --2- 172.21.15.45:0/835695030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3640039b0 0x7ff3781491e0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7ff37001f8d0 tx=0x7ff364005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:33.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff36dffb640 1 -- 172.21.15.45:0/835695030 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3700017c0 con 0x7ff3640039b0 2023-10-03T19:19:33.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff36dffb640 1 -- 172.21.15.45:0/835695030 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff370001920 con 0x7ff3640039b0 2023-10-03T19:19:33.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff37f3cb640 1 -- 172.21.15.45:0/835695030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3780bc670 con 0x7ff3640039b0 2023-10-03T19:19:33.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff36dffb640 1 -- 172.21.15.45:0/835695030 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3700aac00 con 0x7ff3640039b0 2023-10-03T19:19:33.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.720+0000 7ff37f3cb640 1 -- 172.21.15.45:0/835695030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3780a3880 con 0x7ff3640039b0 2023-10-03T19:19:33.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.724+0000 7ff37f3cb640 1 -- 172.21.15.45:0/835695030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff37804de80 con 0x7ff3640039b0 2023-10-03T19:19:33.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.724+0000 7ff36dffb640 1 -- 172.21.15.45:0/835695030 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff3700070d0 con 0x7ff3640039b0 2023-10-03T19:19:33.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.724+0000 7ff36dffb640 1 --2- 172.21.15.45:0/835695030 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff35c066280 0x7ff35c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:33.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.724+0000 7ff36dffb640 1 -- 172.21.15.45:0/835695030 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5339+0+0 (secure 0 0 0) 0x7ff3700b9070 con 0x7ff3640039b0 2023-10-03T19:19:33.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.724+0000 7ff37c966640 1 --2- 172.21.15.45:0/835695030 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff35c066280 0x7ff35c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:33.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.724+0000 7ff37c966640 1 --2- 172.21.15.45:0/835695030 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff35c066280 0x7ff35c068730 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff37814b3d0 tx=0x7ff368008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:33.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.728+0000 7ff36dffb640 1 -- 172.21.15.45:0/835695030 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff3700ee880 con 0x7ff3640039b0 2023-10-03T19:19:33.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.912+0000 7ff37f3cb640 1 -- 172.21.15.45:0/835695030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff37806cc70 con 0x7ff3640039b0 2023-10-03T19:19:33.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.916+0000 7ff36dffb640 1 -- 172.21.15.45:0/835695030 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+2769 (secure 0 0 0) 0x7ff3700f1ea0 con 0x7ff3640039b0 2023-10-03T19:19:33.918 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:19:33.918 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":46,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6094,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3237510777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3237510777},{"type":"v1","addr":"172.21.15.79:6835","nonce":3237510777}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6717,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/697890515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":697890515},{"type":"v1","addr":"172.21.15.45:6833","nonce":697890515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7086,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1163420335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1163420335},{"type":"v1","addr":"172.21.15.45:6835","nonce":1163420335}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[]} 2023-10-03T19:19:33.918 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 46 2023-10-03T19:19:33.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.916+0000 7ff37f3cb640 1 -- 172.21.15.45:0/835695030 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff35c066280 msgr2=0x7ff35c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:33.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.916+0000 7ff37f3cb640 1 --2- 172.21.15.45:0/835695030 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff35c066280 0x7ff35c068730 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff37814b3d0 tx=0x7ff368008040 comp rx=0 tx=0).stop 2023-10-03T19:19:33.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.916+0000 7ff37f3cb640 1 -- 172.21.15.45:0/835695030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3640039b0 msgr2=0x7ff3781491e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:33.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.916+0000 7ff37f3cb640 1 --2- 172.21.15.45:0/835695030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3640039b0 0x7ff3781491e0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7ff37001f8d0 tx=0x7ff364005800 comp rx=0 tx=0).stop 2023-10-03T19:19:33.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.916+0000 7ff37f3cb640 1 -- 172.21.15.45:0/835695030 shutdown_connections 2023-10-03T19:19:33.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.916+0000 7ff37f3cb640 1 --2- 172.21.15.45:0/835695030 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff35c066280 0x7ff35c068730 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:33.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.916+0000 7ff37f3cb640 1 --2- 172.21.15.45:0/835695030 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff3781e5540 0x7ff3781426a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:33.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.916+0000 7ff37f3cb640 1 --2- 172.21.15.45:0/835695030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff37814cd00 0x7ff378143ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:33.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.916+0000 7ff37f3cb640 1 --2- 172.21.15.45:0/835695030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3640039b0 0x7ff3781491e0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:33.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.916+0000 7ff37f3cb640 1 -- 172.21.15.45:0/835695030 >> 172.21.15.45:0/835695030 conn(0x7ff3780bcf50 msgr2=0x7ff3781447a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:33.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.916+0000 7ff37f3cb640 1 -- 172.21.15.45:0/835695030 shutdown_connections 2023-10-03T19:19:33.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:33.916+0000 7ff37f3cb640 1 -- 172.21.15.45:0/835695030 wait complete. 2023-10-03T19:19:33.936 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-03T19:19:33.936 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-03T19:19:33.937 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-03T19:19:33.937 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:19:33.937 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-03T19:19:33.937 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-03T19:19:33.937 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-03T19:19:33.937 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:19:33.938 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-03T19:19:33.938 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-03T19:19:33.938 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-03T19:19:33.938 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:19:33.949 INFO:tasks.ceph.mds.b:Stopped 2023-10-03T19:19:33.949 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-03T19:19:33.950 INFO:tasks.ceph.mds.c:Stopped 2023-10-03T19:19:33.950 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-03T19:19:33.951 INFO:tasks.ceph.mds.a:Stopped 2023-10-03T19:19:33.951 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-03T19:19:33.992 INFO:tasks.ceph.mds.b:Started 2023-10-03T19:19:33.993 DEBUG:teuthology.parallel:result is None 2023-10-03T19:19:33.999 INFO:tasks.ceph.mds.c:Started 2023-10-03T19:19:33.999 DEBUG:teuthology.parallel:result is None 2023-10-03T19:19:33.999 INFO:tasks.ceph.mds.a:Started 2023-10-03T19:19:34.000 DEBUG:teuthology.parallel:result is None 2023-10-03T19:19:34.000 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-03T19:19:34.059 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-10-03T19:19:34.065 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-10-03T19:19:34.067 INFO:tasks.ceph.mds.b.smithi079.stdout:starting mds.b at 2023-10-03T19:19:34.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.108+0000 7f3f6e909640 1 Processor -- start 2023-10-03T19:19:34.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.108+0000 7f3f6e909640 1 -- start start 2023-10-03T19:19:34.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.108+0000 7f3f6e909640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3f6814f240 0x7f3f681528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:34.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.108+0000 7f3f6e909640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3f680c2790 0x7f3f680c0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:34.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.108+0000 7f3f6e909640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f6806b2d0 con 0x7f3f680bb1d0 2023-10-03T19:19:34.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.108+0000 7f3f6e909640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f6806b640 con 0x7f3f6814f240 2023-10-03T19:19:34.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.108+0000 7f3f6e909640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f680c0fa0 con 0x7f3f680c2790 2023-10-03T19:19:34.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.108+0000 7f3f67fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3f6814f240 0x7f3f681528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:34.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.108+0000 7f3f6cea6640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3f680bb1d0 0x7f3f680c12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51434/0 (socket says 172.21.15.45:51434) 2023-10-03T19:19:34.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.108+0000 7f3f6cea6640 1 -- 172.21.15.45:0/1901961121 learned_addr learned my addr 172.21.15.45:0/1901961121 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:34.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.108+0000 7f3f5ffff640 1 --2- 172.21.15.45:0/1901961121 >> v2:172.21.15.79:3300/0 conn(0x7f3f680c2790 0x7f3f680c0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:34.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.112+0000 7f3f67fff640 1 -- 172.21.15.45:0/1901961121 >> v2:172.21.15.79:3300/0 conn(0x7f3f680c2790 msgr2=0x7f3f680c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:34.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.112+0000 7f3f67fff640 1 --2- 172.21.15.45:0/1901961121 >> v2:172.21.15.79:3300/0 conn(0x7f3f680c2790 0x7f3f680c0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:34.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.112+0000 7f3f67fff640 1 -- 172.21.15.45:0/1901961121 >> v1:172.21.15.45:6789/0 conn(0x7f3f680bb1d0 legacy=0x7f3f680c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:34.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.112+0000 7f3f67fff640 1 -- 172.21.15.45:0/1901961121 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f680a3c60 con 0x7f3f6814f240 2023-10-03T19:19:34.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.112+0000 7f3f677fe640 1 -- 172.21.15.45:0/1901961121 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2472525109 0 0) 0x7f3f6806b2d0 con 0x7f3f680bb1d0 2023-10-03T19:19:34.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.112+0000 7f3f67fff640 1 --2- 172.21.15.45:0/1901961121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f6814f240 0x7f3f681528d0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f3f68089fd0 tx=0x7f3f5801ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b6a922755ae8f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:34.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.112+0000 7f3f677fe640 1 -- 172.21.15.45:0/1901961121 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f580a8930 con 0x7f3f6814f240 2023-10-03T19:19:34.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.112+0000 7f3f677fe640 1 -- 172.21.15.45:0/1901961121 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f580a8a90 con 0x7f3f6814f240 2023-10-03T19:19:34.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.112+0000 7f3f677fe640 1 -- 172.21.15.45:0/1901961121 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f580a8e20 con 0x7f3f6814f240 2023-10-03T19:19:34.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f6e909640 1 -- 172.21.15.45:0/1901961121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f6814f240 msgr2=0x7f3f681528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:34.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f6e909640 1 --2- 172.21.15.45:0/1901961121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f6814f240 0x7f3f681528d0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f3f68089fd0 tx=0x7f3f5801ec30 comp rx=0 tx=0).stop 2023-10-03T19:19:34.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f6e909640 1 -- 172.21.15.45:0/1901961121 shutdown_connections 2023-10-03T19:19:34.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f6e909640 1 --2- 172.21.15.45:0/1901961121 >> v2:172.21.15.79:3300/0 conn(0x7f3f680c2790 0x7f3f680c0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:34.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f6e909640 1 --2- 172.21.15.45:0/1901961121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f6814f240 0x7f3f681528d0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:34.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f6e909640 1 -- 172.21.15.45:0/1901961121 >> 172.21.15.45:0/1901961121 conn(0x7f3f680a64a0 msgr2=0x7f3f680a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:34.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f6e909640 1 -- 172.21.15.45:0/1901961121 shutdown_connections 2023-10-03T19:19:34.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f6e909640 1 -- 172.21.15.45:0/1901961121 wait complete. 2023-10-03T19:19:34.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f6e909640 1 Processor -- start 2023-10-03T19:19:34.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f6e909640 1 -- start start 2023-10-03T19:19:34.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f6e909640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f680bb1d0 0x7f3f680bbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:34.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f6e909640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f680c2790 0x7f3f680a1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:34.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f6e909640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f6814f240 0x7f3f681e3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:34.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f6e909640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6814c260 con 0x7f3f680bb1d0 2023-10-03T19:19:34.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f6e909640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f681e7a60 con 0x7f3f680c2790 2023-10-03T19:19:34.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f6e909640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6814c510 con 0x7f3f6814f240 2023-10-03T19:19:34.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f67fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f680bb1d0 0x7f3f680bbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:34.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f67fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f680bb1d0 0x7f3f680bbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42690/0 (socket says 172.21.15.45:42690) 2023-10-03T19:19:34.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f67fff640 1 -- 172.21.15.45:0/2795061101 learned_addr learned my addr 172.21.15.45:0/2795061101 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:34.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f6cea6640 1 --2- 172.21.15.45:0/2795061101 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f6814f240 0x7f3f681e3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:34.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f5ffff640 1 --2- 172.21.15.45:0/2795061101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f680c2790 0x7f3f680a1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:34.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f67fff640 1 -- 172.21.15.45:0/2795061101 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f6814f240 msgr2=0x7f3f681e3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:34.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f67fff640 1 --2- 172.21.15.45:0/2795061101 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f6814f240 0x7f3f681e3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:34.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f67fff640 1 -- 172.21.15.45:0/2795061101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f680c2790 msgr2=0x7f3f680a1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:34.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f67fff640 1 --2- 172.21.15.45:0/2795061101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f680c2790 0x7f3f680a1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:34.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f67fff640 1 -- 172.21.15.45:0/2795061101 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f580093b0 con 0x7f3f680bb1d0 2023-10-03T19:19:34.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f5ffff640 1 --2- 172.21.15.45:0/2795061101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f680c2790 0x7f3f680a1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:19:34.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f6cea6640 1 --2- 172.21.15.45:0/2795061101 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f6814f240 0x7f3f681e3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:19:34.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f67fff640 1 --2- 172.21.15.45:0/2795061101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f680bb1d0 0x7f3f680bbdd0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f3f5801b840 tx=0x7f3f5801b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:34.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f657fa640 1 -- 172.21.15.45:0/2795061101 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f580b9630 con 0x7f3f680bb1d0 2023-10-03T19:19:34.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f657fa640 1 -- 172.21.15.45:0/2795061101 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f580b97b0 con 0x7f3f680bb1d0 2023-10-03T19:19:34.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f6e909640 1 -- 172.21.15.45:0/2795061101 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f6814e740 con 0x7f3f680bb1d0 2023-10-03T19:19:34.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f657fa640 1 -- 172.21.15.45:0/2795061101 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f580b9b60 con 0x7f3f680bb1d0 2023-10-03T19:19:34.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f6e909640 1 -- 172.21.15.45:0/2795061101 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f680c19b0 con 0x7f3f680bb1d0 2023-10-03T19:19:34.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f6e909640 1 -- 172.21.15.45:0/2795061101 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f680a3f40 con 0x7f3f680bb1d0 2023-10-03T19:19:34.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.116+0000 7f3f657fa640 1 -- 172.21.15.45:0/2795061101 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3f580b7040 con 0x7f3f680bb1d0 2023-10-03T19:19:34.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.120+0000 7f3f657fa640 1 --2- 172.21.15.45:0/2795061101 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3f480662b0 0x7f3f48068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:34.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.120+0000 7f3f657fa640 1 -- 172.21.15.45:0/2795061101 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f3f58121a40 con 0x7f3f680bb1d0 2023-10-03T19:19:34.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.120+0000 7f3f5ffff640 1 --2- 172.21.15.45:0/2795061101 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3f480662b0 0x7f3f48068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:34.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.120+0000 7f3f5ffff640 1 --2- 172.21.15.45:0/2795061101 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3f480662b0 0x7f3f48068760 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3f681e1ab0 tx=0x7f3f50008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:34.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.124+0000 7f3f657fa640 1 -- 172.21.15.45:0/2795061101 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3f580ef060 con 0x7f3f680bb1d0 2023-10-03T19:19:34.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:34.292+0000 7f3f6e909640 1 -- 172.21.15.45:0/2795061101 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f3f680bfa90 con 0x7f3f680bb1d0 2023-10-03T19:19:35.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.128+0000 7f3f657fa640 1 -- 172.21.15.45:0/2795061101 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v94) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3f580b5030 con 0x7f3f680bb1d0 2023-10-03T19:19:35.130 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-10-03T19:19:35.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.128+0000 7f3f6e909640 1 -- 172.21.15.45:0/2795061101 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3f480662b0 msgr2=0x7f3f48068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:35.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.128+0000 7f3f6e909640 1 --2- 172.21.15.45:0/2795061101 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3f480662b0 0x7f3f48068760 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3f681e1ab0 tx=0x7f3f50008040 comp rx=0 tx=0).stop 2023-10-03T19:19:35.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.128+0000 7f3f6e909640 1 -- 172.21.15.45:0/2795061101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f680bb1d0 msgr2=0x7f3f680bbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:35.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.128+0000 7f3f6e909640 1 --2- 172.21.15.45:0/2795061101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f680bb1d0 0x7f3f680bbdd0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f3f5801b840 tx=0x7f3f5801b9d0 comp rx=0 tx=0).stop 2023-10-03T19:19:35.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.128+0000 7f3f6e909640 1 -- 172.21.15.45:0/2795061101 shutdown_connections 2023-10-03T19:19:35.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.128+0000 7f3f6e909640 1 --2- 172.21.15.45:0/2795061101 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3f480662b0 0x7f3f48068760 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:35.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.128+0000 7f3f6e909640 1 --2- 172.21.15.45:0/2795061101 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f6814f240 0x7f3f681e3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:35.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.128+0000 7f3f6e909640 1 --2- 172.21.15.45:0/2795061101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f680c2790 0x7f3f680a1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:35.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.128+0000 7f3f6e909640 1 --2- 172.21.15.45:0/2795061101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f680bb1d0 0x7f3f680bbdd0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:35.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.128+0000 7f3f6e909640 1 -- 172.21.15.45:0/2795061101 >> 172.21.15.45:0/2795061101 conn(0x7f3f680a64a0 msgr2=0x7f3f680c12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:35.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.128+0000 7f3f6e909640 1 -- 172.21.15.45:0/2795061101 shutdown_connections 2023-10-03T19:19:35.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.132+0000 7f3f6e909640 1 -- 172.21.15.45:0/2795061101 wait complete. 2023-10-03T19:19:35.153 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-03T19:19:35.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.268+0000 7f7d5b248640 1 Processor -- start 2023-10-03T19:19:35.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.268+0000 7f7d5b248640 1 -- start start 2023-10-03T19:19:35.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.272+0000 7f7d5b248640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d540bed20 0x7f7d540bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:35.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.272+0000 7f7d5b248640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7d540a6f00 0x7f7d54150200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:35.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.272+0000 7f7d5b248640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d54150740 0x7f7d540be010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:35.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.272+0000 7f7d5b248640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d5414fd70 con 0x7f7d54150740 2023-10-03T19:19:35.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.272+0000 7f7d5b248640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d54146910 con 0x7f7d540a6f00 2023-10-03T19:19:35.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.272+0000 7f7d5b248640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5406e9f0 con 0x7f7d540bed20 2023-10-03T19:19:35.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.272+0000 7f7d597e5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d54150740 0x7f7d540be010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:35.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.272+0000 7f7d597e5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d54150740 0x7f7d540be010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47480/0 (socket says 172.21.15.45:47480) 2023-10-03T19:19:35.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.272+0000 7f7d597e5640 1 -- 172.21.15.45:0/3660541179 learned_addr learned my addr 172.21.15.45:0/3660541179 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:35.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.272+0000 7f7d53fff640 1 --2- 172.21.15.45:0/3660541179 >> v2:172.21.15.79:3300/0 conn(0x7f7d540a6f00 0x7f7d54150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:35.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.272+0000 7f7d58fe4640 1 --2- 172.21.15.45:0/3660541179 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d540bed20 0x7f7d540bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:35.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.272+0000 7f7d597e5640 1 -- 172.21.15.45:0/3660541179 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d540bed20 msgr2=0x7f7d540bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:35.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.272+0000 7f7d597e5640 1 --2- 172.21.15.45:0/3660541179 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d540bed20 0x7f7d540bf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:35.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.272+0000 7f7d597e5640 1 -- 172.21.15.45:0/3660541179 >> v2:172.21.15.79:3300/0 conn(0x7f7d540a6f00 msgr2=0x7f7d54150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:35.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.272+0000 7f7d597e5640 1 --2- 172.21.15.45:0/3660541179 >> v2:172.21.15.79:3300/0 conn(0x7f7d540a6f00 0x7f7d54150200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:35.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.272+0000 7f7d597e5640 1 -- 172.21.15.45:0/3660541179 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d5406ec90 con 0x7f7d54150740 2023-10-03T19:19:35.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.272+0000 7f7d58fe4640 1 --2- 172.21.15.45:0/3660541179 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d540bed20 0x7f7d540bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:35.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.272+0000 7f7d597e5640 1 --2- 172.21.15.45:0/3660541179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d54150740 0x7f7d540be010 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f7d5406e170 tx=0x7f7d4c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b968bfe632a0dcb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:35.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.272+0000 7f7d537fe640 1 -- 172.21.15.45:0/3660541179 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c0a5650 con 0x7f7d54150740 2023-10-03T19:19:35.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.272+0000 7f7d537fe640 1 -- 172.21.15.45:0/3660541179 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4c0a57b0 con 0x7f7d54150740 2023-10-03T19:19:35.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.272+0000 7f7d537fe640 1 -- 172.21.15.45:0/3660541179 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c0a5b40 con 0x7f7d54150740 2023-10-03T19:19:35.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d5b248640 1 -- 172.21.15.45:0/3660541179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d54150740 msgr2=0x7f7d540be010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:35.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d5b248640 1 --2- 172.21.15.45:0/3660541179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d54150740 0x7f7d540be010 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f7d5406e170 tx=0x7f7d4c01c9d0 comp rx=0 tx=0).stop 2023-10-03T19:19:35.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d5b248640 1 -- 172.21.15.45:0/3660541179 shutdown_connections 2023-10-03T19:19:35.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d5b248640 1 --2- 172.21.15.45:0/3660541179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d54150740 0x7f7d540be010 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:35.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d5b248640 1 --2- 172.21.15.45:0/3660541179 >> v2:172.21.15.79:3300/0 conn(0x7f7d540a6f00 0x7f7d54150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:35.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d5b248640 1 --2- 172.21.15.45:0/3660541179 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d540bed20 0x7f7d540bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:35.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d5b248640 1 -- 172.21.15.45:0/3660541179 >> 172.21.15.45:0/3660541179 conn(0x7f7d5406d990 msgr2=0x7f7d5406bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:35.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d5b248640 1 -- 172.21.15.45:0/3660541179 shutdown_connections 2023-10-03T19:19:35.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d5b248640 1 -- 172.21.15.45:0/3660541179 wait complete. 2023-10-03T19:19:35.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d5b248640 1 Processor -- start 2023-10-03T19:19:35.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d5b248640 1 -- start start 2023-10-03T19:19:35.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d5b248640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d540a6f00 0x7f7d541e9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:35.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d5b248640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d540bed20 0x7f7d541481c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:35.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d5b248640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d54150740 0x7f7d5414ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:35.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d5b248640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d54148bb0 con 0x7f7d54150740 2023-10-03T19:19:35.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d5b248640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d54148e00 con 0x7f7d540bed20 2023-10-03T19:19:35.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d5b248640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5414b780 con 0x7f7d540a6f00 2023-10-03T19:19:35.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d597e5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d54150740 0x7f7d5414ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:35.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d597e5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d54150740 0x7f7d5414ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47482/0 (socket says 172.21.15.45:47482) 2023-10-03T19:19:35.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d597e5640 1 -- 172.21.15.45:0/1406222242 learned_addr learned my addr 172.21.15.45:0/1406222242 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:35.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d53fff640 1 --2- 172.21.15.45:0/1406222242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d540bed20 0x7f7d541481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:35.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d58fe4640 1 --2- 172.21.15.45:0/1406222242 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d540a6f00 0x7f7d541e9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:35.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d597e5640 1 -- 172.21.15.45:0/1406222242 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d540a6f00 msgr2=0x7f7d541e9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:35.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d597e5640 1 --2- 172.21.15.45:0/1406222242 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d540a6f00 0x7f7d541e9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:35.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d597e5640 1 -- 172.21.15.45:0/1406222242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d540bed20 msgr2=0x7f7d541481c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:35.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d597e5640 1 --2- 172.21.15.45:0/1406222242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d540bed20 0x7f7d541481c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:35.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d597e5640 1 -- 172.21.15.45:0/1406222242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c009b30 con 0x7f7d54150740 2023-10-03T19:19:35.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d53fff640 1 --2- 172.21.15.45:0/1406222242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d540bed20 0x7f7d541481c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:19:35.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d597e5640 1 --2- 172.21.15.45:0/1406222242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d54150740 0x7f7d5414ac90 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c0af040 tx=0x7f7d4c019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:35.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d517fa640 1 -- 172.21.15.45:0/1406222242 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c0be070 con 0x7f7d54150740 2023-10-03T19:19:35.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d517fa640 1 -- 172.21.15.45:0/1406222242 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4c0b8440 con 0x7f7d54150740 2023-10-03T19:19:35.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d5b248640 1 -- 172.21.15.45:0/1406222242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d54071a70 con 0x7f7d54150740 2023-10-03T19:19:35.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d517fa640 1 -- 172.21.15.45:0/1406222242 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c0b8810 con 0x7f7d54150740 2023-10-03T19:19:35.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.276+0000 7f7d5b248640 1 -- 172.21.15.45:0/1406222242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d540718e0 con 0x7f7d54150740 2023-10-03T19:19:35.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.280+0000 7f7d5b248640 1 -- 172.21.15.45:0/1406222242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d54071c00 con 0x7f7d54150740 2023-10-03T19:19:35.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.280+0000 7f7d517fa640 1 -- 172.21.15.45:0/1406222242 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7d4c0b8970 con 0x7f7d54150740 2023-10-03T19:19:35.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.280+0000 7f7d517fa640 1 --2- 172.21.15.45:0/1406222242 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7d34066280 0x7f7d34068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:35.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.280+0000 7f7d517fa640 1 -- 172.21.15.45:0/1406222242 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7d4c11e260 con 0x7f7d54150740 2023-10-03T19:19:35.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.280+0000 7f7d58fe4640 1 --2- 172.21.15.45:0/1406222242 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7d34066280 0x7f7d34068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:35.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.280+0000 7f7d58fe4640 1 --2- 172.21.15.45:0/1406222242 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7d34066280 0x7f7d34068730 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c006fd0 tx=0x7f7d3c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:35.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.284+0000 7f7d517fa640 1 -- 172.21.15.45:0/1406222242 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7d4c0eb990 con 0x7f7d54150740 2023-10-03T19:19:35.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.500+0000 7f7d5b248640 1 -- 172.21.15.45:0/1406222242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7d54149070 con 0x7f7d54150740 2023-10-03T19:19:35.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.500+0000 7f7d517fa640 1 -- 172.21.15.45:0/1406222242 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+4440 (secure 0 0 0) 0x7f7d54149070 con 0x7f7d54150740 2023-10-03T19:19:35.505 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:19:35.505 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-03T19:19:35.506 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-10-03T19:19:35.506 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:19:35.506 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-10-03T19:19:35.506 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlfyzhExAABLhtkQEZuiLwovBSO0kuAA==", 2023-10-03T19:19:35.506 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:19:35.506 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:19:35.506 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-03T19:19:35.506 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-03T19:19:35.506 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:19:35.506 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:19:35.506 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:19:35.506 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:19:35.507 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-10-03T19:19:35.507 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlzM8pIBAAMie9jpxS/xt2cymMpyJmiQ==", 2023-10-03T19:19:35.507 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:19:35.507 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:19:35.507 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-03T19:19:35.507 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-03T19:19:35.507 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:19:35.507 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:19:35.507 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:19:35.507 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:19:35.507 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-10-03T19:19:35.507 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlAsGOHBAAIHprnd9orKMQjzkNQZz94A==", 2023-10-03T19:19:35.508 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:19:35.508 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:19:35.508 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-03T19:19:35.508 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-03T19:19:35.508 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:19:35.508 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:19:35.508 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:19:35.508 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:19:35.508 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-10-03T19:19:35.508 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBmZxxlb0zQLRAA3z+f4/jsLTLUmFg/WOD/Xg==", 2023-10-03T19:19:35.508 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:19:35.508 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:19:35.508 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:19:35.508 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:19:35.509 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:19:35.509 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:19:35.509 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:19:35.509 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-10-03T19:19:35.509 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBpZxxlTjtZNRAA3HFqXjGLO7JoX+GBegGfqw==", 2023-10-03T19:19:35.509 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:19:35.509 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:19:35.509 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:19:35.509 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:19:35.509 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:19:35.509 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:19:35.509 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:19:35.509 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-10-03T19:19:35.510 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBtZxxld6kUBBAATcGPrxBbPLswrUHihB7AgQ==", 2023-10-03T19:19:35.510 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:19:35.510 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:19:35.510 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:19:35.510 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:19:35.510 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:19:35.510 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:19:35.510 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:19:35.510 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-10-03T19:19:35.510 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBwZxxlWUL3DBAAk4TW6N5mpjjyP7QgQAIuDw==", 2023-10-03T19:19:35.510 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:19:35.510 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:19:35.510 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:19:35.511 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:19:35.511 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:19:35.511 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:19:35.511 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:19:35.511 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-10-03T19:19:35.511 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQB2ZxxlK3KNIhAAjhvxAU0shg+5PbJfq1LEog==", 2023-10-03T19:19:35.511 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:19:35.511 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:19:35.511 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:19:35.511 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:19:35.511 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:19:35.511 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:19:35.511 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:19:35.511 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-10-03T19:19:35.512 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQB5ZxxlRAxuKhAA5ma3eAt3kkukdhgZN4wwEg==", 2023-10-03T19:19:35.512 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:19:35.512 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:19:35.512 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:19:35.512 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:19:35.512 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:19:35.512 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:19:35.512 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:19:35.512 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-10-03T19:19:35.512 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQB8ZxxlkQqOMxAAuKGy7vJQLUDsqgjPVtWMWg==", 2023-10-03T19:19:35.512 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:19:35.512 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:19:35.512 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:19:35.513 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:19:35.513 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:19:35.513 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:19:35.513 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:19:35.513 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-10-03T19:19:35.513 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCAZxxl65r/ABAAeWtP7nMLVm5NBU4vWQ6ceg==", 2023-10-03T19:19:35.513 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:19:35.513 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:19:35.513 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:19:35.513 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:19:35.513 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:19:35.513 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:19:35.513 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:19:35.514 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-10-03T19:19:35.514 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlg5PgJRAAvvN5Xrw/ZW4rSdJ1/adnzA==", 2023-10-03T19:19:35.514 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:19:35.514 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:19:35.514 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow r", 2023-10-03T19:19:35.514 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-03T19:19:35.514 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:19:35.514 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:19:35.514 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:19:35.514 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-10-03T19:19:35.514 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlKkW+KRAALzVyQ+iTWuD5FMLDKXNVTg==", 2023-10-03T19:19:35.514 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:19:35.514 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:19:35.515 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-10-03T19:19:35.515 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-10-03T19:19:35.515 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-10-03T19:19:35.515 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:19:35.515 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:19:35.515 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:19:35.515 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-10-03T19:19:35.515 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBkZxxldHb4LxAAc/oJcXFjNgH5Wxwv04WHgw==", 2023-10-03T19:19:35.515 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:19:35.515 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-10-03T19:19:35.515 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-03T19:19:35.515 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-03T19:19:35.515 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:19:35.516 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:19:35.516 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:19:35.516 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:19:35.516 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-10-03T19:19:35.516 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxl4txNEBAAonNqY2PmtF0vZGFmvzxIKw==", 2023-10-03T19:19:35.516 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:19:35.517 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-10-03T19:19:35.517 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-10-03T19:19:35.517 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:19:35.517 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:19:35.517 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:19:35.517 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:19:35.518 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-10-03T19:19:35.518 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlUmKhDRAA7UKlGP9q9aKsk+J+nTxrUA==", 2023-10-03T19:19:35.518 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:19:35.518 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-10-03T19:19:35.518 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-10-03T19:19:35.518 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:19:35.518 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:19:35.519 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:19:35.519 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-10-03T19:19:35.519 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-03T19:19:35.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.504+0000 7f7d5b248640 1 -- 172.21.15.45:0/1406222242 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7d34066280 msgr2=0x7f7d34068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:35.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.504+0000 7f7d5b248640 1 --2- 172.21.15.45:0/1406222242 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7d34066280 0x7f7d34068730 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c006fd0 tx=0x7f7d3c008040 comp rx=0 tx=0).stop 2023-10-03T19:19:35.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.504+0000 7f7d5b248640 1 -- 172.21.15.45:0/1406222242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d54150740 msgr2=0x7f7d5414ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:35.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.504+0000 7f7d5b248640 1 --2- 172.21.15.45:0/1406222242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d54150740 0x7f7d5414ac90 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c0af040 tx=0x7f7d4c019770 comp rx=0 tx=0).stop 2023-10-03T19:19:35.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.504+0000 7f7d5b248640 1 -- 172.21.15.45:0/1406222242 shutdown_connections 2023-10-03T19:19:35.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.504+0000 7f7d5b248640 1 --2- 172.21.15.45:0/1406222242 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7d34066280 0x7f7d34068730 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:35.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.504+0000 7f7d5b248640 1 --2- 172.21.15.45:0/1406222242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d54150740 0x7f7d5414ac90 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:35.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.504+0000 7f7d5b248640 1 --2- 172.21.15.45:0/1406222242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d540bed20 0x7f7d541481c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:35.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.504+0000 7f7d5b248640 1 --2- 172.21.15.45:0/1406222242 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d540a6f00 0x7f7d541e9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:35.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.504+0000 7f7d5b248640 1 -- 172.21.15.45:0/1406222242 >> 172.21.15.45:0/1406222242 conn(0x7f7d5406d990 msgr2=0x7f7d5414e790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:35.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.504+0000 7f7d5b248640 1 -- 172.21.15.45:0/1406222242 shutdown_connections 2023-10-03T19:19:35.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.504+0000 7f7d5b248640 1 -- 172.21.15.45:0/1406222242 wait complete. 2023-10-03T19:19:35.524 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:19:35.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.652+0000 7fb73acf1640 1 Processor -- start 2023-10-03T19:19:35.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.652+0000 7fb73acf1640 1 -- start start 2023-10-03T19:19:35.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.652+0000 7fb73acf1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb7340c2790 0x7fb7341528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:35.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.652+0000 7fb73acf1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb7340bb1d0 0x7fb7340c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:35.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.652+0000 7fb73acf1640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb73406b2d0 con 0x7fb73414f240 2023-10-03T19:19:35.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.652+0000 7fb73acf1640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb73406b640 con 0x7fb7340bb1d0 2023-10-03T19:19:35.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.652+0000 7fb73acf1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7340a3c60 con 0x7fb7340c2790 2023-10-03T19:19:35.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.652+0000 7fb738a8d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb73414f240 0x7fb7340c0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39648/0 (socket says 172.21.15.45:39648) 2023-10-03T19:19:35.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.652+0000 7fb738a8d640 1 -- 172.21.15.45:0/3961587318 learned_addr learned my addr 172.21.15.45:0/3961587318 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:35.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.652+0000 7fb73928e640 1 --2- 172.21.15.45:0/3961587318 >> v2:172.21.15.45:3300/0 conn(0x7fb7340bb1d0 0x7fb7340c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:35.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.652+0000 7fb733fff640 1 --2- 172.21.15.45:0/3961587318 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb7340c2790 0x7fb7341528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:35.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.652+0000 7fb7337fe640 1 -- 172.21.15.45:0/3961587318 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507848105 0 0) 0x7fb73406b2d0 con 0x7fb73414f240 2023-10-03T19:19:35.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.652+0000 7fb7337fe640 1 -- 172.21.15.45:0/3961587318 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb724003530 con 0x7fb73414f240 2023-10-03T19:19:35.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.652+0000 7fb73928e640 1 -- 172.21.15.45:0/3961587318 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb7340c2790 msgr2=0x7fb7341528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:35.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.652+0000 7fb73928e640 1 --2- 172.21.15.45:0/3961587318 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb7340c2790 0x7fb7341528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:35.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.652+0000 7fb73928e640 1 -- 172.21.15.45:0/3961587318 >> v1:172.21.15.45:6789/0 conn(0x7fb73414f240 legacy=0x7fb7340c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:35.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.652+0000 7fb73928e640 1 -- 172.21.15.45:0/3961587318 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb73414e740 con 0x7fb7340bb1d0 2023-10-03T19:19:35.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb73928e640 1 --2- 172.21.15.45:0/3961587318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7340bb1d0 0x7fb7340c12a0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009d90 tx=0x7fb72c01f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31ed74aef191623 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:35.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb7337fe640 1 -- 172.21.15.45:0/3961587318 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c0af600 con 0x7fb7340bb1d0 2023-10-03T19:19:35.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb7337fe640 1 -- 172.21.15.45:0/3961587318 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72c0ab050 con 0x7fb7340bb1d0 2023-10-03T19:19:35.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb7337fe640 1 -- 172.21.15.45:0/3961587318 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c0af980 con 0x7fb7340bb1d0 2023-10-03T19:19:35.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb73acf1640 1 -- 172.21.15.45:0/3961587318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7340bb1d0 msgr2=0x7fb7340c12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:35.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb73acf1640 1 --2- 172.21.15.45:0/3961587318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7340bb1d0 0x7fb7340c12a0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009d90 tx=0x7fb72c01f130 comp rx=0 tx=0).stop 2023-10-03T19:19:35.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb73acf1640 1 -- 172.21.15.45:0/3961587318 shutdown_connections 2023-10-03T19:19:35.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb73acf1640 1 --2- 172.21.15.45:0/3961587318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7340bb1d0 0x7fb7340c12a0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:35.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb73acf1640 1 --2- 172.21.15.45:0/3961587318 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb7340c2790 0x7fb7341528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:35.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb73acf1640 1 -- 172.21.15.45:0/3961587318 >> 172.21.15.45:0/3961587318 conn(0x7fb7340a64a0 msgr2=0x7fb7340a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:35.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb73acf1640 1 -- 172.21.15.45:0/3961587318 shutdown_connections 2023-10-03T19:19:35.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb73acf1640 1 -- 172.21.15.45:0/3961587318 wait complete. 2023-10-03T19:19:35.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb73acf1640 1 Processor -- start 2023-10-03T19:19:35.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb73acf1640 1 -- start start 2023-10-03T19:19:35.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb73acf1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb7340bb1d0 0x7fb734151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:35.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb73acf1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7340c2790 0x7fb7341494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:35.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb73acf1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb73414f240 0x7fb734146780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:35.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb73acf1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7340be6b0 con 0x7fb73414f240 2023-10-03T19:19:35.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb73acf1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7341517c0 con 0x7fb7340c2790 2023-10-03T19:19:35.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb73acf1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb734147d00 con 0x7fb7340bb1d0 2023-10-03T19:19:35.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb73928e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb73414f240 0x7fb734146780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:35.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb73928e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb73414f240 0x7fb734146780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47502/0 (socket says 172.21.15.45:47502) 2023-10-03T19:19:35.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb73928e640 1 -- 172.21.15.45:0/3766436556 learned_addr learned my addr 172.21.15.45:0/3766436556 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:35.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb738a8d640 1 --2- 172.21.15.45:0/3766436556 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb7340bb1d0 0x7fb734151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:35.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb733fff640 1 --2- 172.21.15.45:0/3766436556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7340c2790 0x7fb7341494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:35.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb73928e640 1 -- 172.21.15.45:0/3766436556 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb7340bb1d0 msgr2=0x7fb734151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:35.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb73928e640 1 --2- 172.21.15.45:0/3766436556 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb7340bb1d0 0x7fb734151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:35.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb73928e640 1 -- 172.21.15.45:0/3766436556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7340c2790 msgr2=0x7fb7341494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:35.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb73928e640 1 --2- 172.21.15.45:0/3766436556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7340c2790 0x7fb7341494f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:35.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb73928e640 1 -- 172.21.15.45:0/3766436556 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72c009a70 con 0x7fb73414f240 2023-10-03T19:19:35.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb73928e640 1 --2- 172.21.15.45:0/3766436556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb73414f240 0x7fb734146780 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009d90 tx=0x7fb72c01bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:35.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb7317fa640 1 -- 172.21.15.45:0/3766436556 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c009450 con 0x7fb73414f240 2023-10-03T19:19:35.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb7317fa640 1 -- 172.21.15.45:0/3766436556 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72c0b9410 con 0x7fb73414f240 2023-10-03T19:19:35.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb73acf1640 1 -- 172.21.15.45:0/3766436556 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb73414f610 con 0x7fb73414f240 2023-10-03T19:19:35.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.656+0000 7fb7317fa640 1 -- 172.21.15.45:0/3766436556 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c0b97c0 con 0x7fb73414f240 2023-10-03T19:19:35.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.660+0000 7fb73acf1640 1 -- 172.21.15.45:0/3766436556 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7340a3f40 con 0x7fb73414f240 2023-10-03T19:19:35.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.660+0000 7fb73acf1640 1 -- 172.21.15.45:0/3766436556 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7340bf360 con 0x7fb73414f240 2023-10-03T19:19:35.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.660+0000 7fb7317fa640 1 -- 172.21.15.45:0/3766436556 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb72c0b6050 con 0x7fb73414f240 2023-10-03T19:19:35.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.660+0000 7fb7317fa640 1 --2- 172.21.15.45:0/3766436556 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb7180662b0 0x7fb718068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:35.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.660+0000 7fb7317fa640 1 -- 172.21.15.45:0/3766436556 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb72c121fd0 con 0x7fb73414f240 2023-10-03T19:19:35.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.660+0000 7fb738a8d640 1 --2- 172.21.15.45:0/3766436556 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb7180662b0 0x7fb718068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:35.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.660+0000 7fb738a8d640 1 --2- 172.21.15.45:0/3766436556 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb7180662b0 0x7fb718068760 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb720007fd0 tx=0x7fb720009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:35.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.664+0000 7fb7317fa640 1 -- 172.21.15.45:0/3766436556 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb72c0ef950 con 0x7fb73414f240 2023-10-03T19:19:35.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.824+0000 7fb73acf1640 1 -- 172.21.15.45:0/3766436556 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7340bfa60 con 0x7fb73414f240 2023-10-03T19:19:35.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.824+0000 7fb7317fa640 1 -- 172.21.15.45:0/3766436556 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+14592 (secure 0 0 0) 0x7fb72c0f2f70 con 0x7fb73414f240 2023-10-03T19:19:35.828 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:19:35.828 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":94,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:19:35.115489+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:19:35.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.828+0000 7fb73acf1640 1 -- 172.21.15.45:0/3766436556 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb7180662b0 msgr2=0x7fb718068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:35.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.828+0000 7fb73acf1640 1 --2- 172.21.15.45:0/3766436556 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb7180662b0 0x7fb718068760 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb720007fd0 tx=0x7fb720009040 comp rx=0 tx=0).stop 2023-10-03T19:19:35.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.828+0000 7fb73acf1640 1 -- 172.21.15.45:0/3766436556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb73414f240 msgr2=0x7fb734146780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:35.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.828+0000 7fb73acf1640 1 --2- 172.21.15.45:0/3766436556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb73414f240 0x7fb734146780 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009d90 tx=0x7fb72c01bed0 comp rx=0 tx=0).stop 2023-10-03T19:19:35.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.828+0000 7fb73acf1640 1 -- 172.21.15.45:0/3766436556 shutdown_connections 2023-10-03T19:19:35.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.828+0000 7fb73acf1640 1 --2- 172.21.15.45:0/3766436556 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb7180662b0 0x7fb718068760 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:35.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.828+0000 7fb73acf1640 1 --2- 172.21.15.45:0/3766436556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb73414f240 0x7fb734146780 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:35.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.828+0000 7fb73acf1640 1 --2- 172.21.15.45:0/3766436556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7340c2790 0x7fb7341494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:35.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.828+0000 7fb73acf1640 1 --2- 172.21.15.45:0/3766436556 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb7340bb1d0 0x7fb734151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:35.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.828+0000 7fb73acf1640 1 -- 172.21.15.45:0/3766436556 >> 172.21.15.45:0/3766436556 conn(0x7fb7340a64a0 msgr2=0x7fb7340ba0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:35.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.828+0000 7fb73acf1640 1 -- 172.21.15.45:0/3766436556 shutdown_connections 2023-10-03T19:19:35.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.828+0000 7fb73acf1640 1 -- 172.21.15.45:0/3766436556 wait complete. 2023-10-03T19:19:35.847 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:19:35.847 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:19:35.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.968+0000 7fa70ebfd640 1 Processor -- start 2023-10-03T19:19:35.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.968+0000 7fa70ebfd640 1 -- start start 2023-10-03T19:19:35.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.972+0000 7fa70ebfd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa70814ba30 0x7fa708156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:35.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.972+0000 7fa70ebfd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa70814f080 con 0x7fa70814f510 2023-10-03T19:19:35.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.972+0000 7fa70ebfd640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa708070e90 con 0x7fa70806f880 2023-10-03T19:19:35.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.972+0000 7fa70ebfd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa70806f3e0 con 0x7fa70814ba30 2023-10-03T19:19:35.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.972+0000 7fa707fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa70814f510 0x7fa70814b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39656/0 (socket says 172.21.15.45:39656) 2023-10-03T19:19:35.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.972+0000 7fa707fff640 1 -- 172.21.15.45:0/1336179954 learned_addr learned my addr 172.21.15.45:0/1336179954 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:35.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.972+0000 7fa70d19a640 1 --2- 172.21.15.45:0/1336179954 >> v2:172.21.15.45:3300/0 conn(0x7fa70814ba30 0x7fa708156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:35.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.972+0000 7fa7077fe640 1 -- 172.21.15.45:0/1336179954 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930403365 0 0) 0x7fa70814f080 con 0x7fa70814f510 2023-10-03T19:19:35.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.972+0000 7fa7077fe640 1 -- 172.21.15.45:0/1336179954 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6f0003530 con 0x7fa70814f510 2023-10-03T19:19:35.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.972+0000 7fa70d19a640 1 -- 172.21.15.45:0/1336179954 >> v1:172.21.15.79:6789/0 conn(0x7fa70806f880 legacy=0x7fa7080a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:35.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.972+0000 7fa70d19a640 1 -- 172.21.15.45:0/1336179954 >> v1:172.21.15.45:6789/0 conn(0x7fa70814f510 legacy=0x7fa70814b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:35.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.972+0000 7fa70d19a640 1 -- 172.21.15.45:0/1336179954 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa70814ea30 con 0x7fa70814ba30 2023-10-03T19:19:35.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.972+0000 7fa70d19a640 1 --2- 172.21.15.45:0/1336179954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa70814ba30 0x7fa708156bd0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fa7000097c0 tx=0x7fa70001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f331cbe0c7bcdda2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:35.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.972+0000 7fa7077fe640 1 -- 172.21.15.45:0/1336179954 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7000ac410 con 0x7fa70814ba30 2023-10-03T19:19:35.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.972+0000 7fa7077fe640 1 -- 172.21.15.45:0/1336179954 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7000ac570 con 0x7fa70814ba30 2023-10-03T19:19:35.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.972+0000 7fa7077fe640 1 -- 172.21.15.45:0/1336179954 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7000ac900 con 0x7fa70814ba30 2023-10-03T19:19:35.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa70ebfd640 1 -- 172.21.15.45:0/1336179954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa70814ba30 msgr2=0x7fa708156bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:35.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa70ebfd640 1 --2- 172.21.15.45:0/1336179954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa70814ba30 0x7fa708156bd0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fa7000097c0 tx=0x7fa70001c450 comp rx=0 tx=0).stop 2023-10-03T19:19:35.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa70ebfd640 1 -- 172.21.15.45:0/1336179954 shutdown_connections 2023-10-03T19:19:35.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa70ebfd640 1 --2- 172.21.15.45:0/1336179954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa70814ba30 0x7fa708156bd0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:35.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa70ebfd640 1 -- 172.21.15.45:0/1336179954 >> 172.21.15.45:0/1336179954 conn(0x7fa7080a20d0 msgr2=0x7fa7080a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:35.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa70ebfd640 1 -- 172.21.15.45:0/1336179954 shutdown_connections 2023-10-03T19:19:35.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa70ebfd640 1 -- 172.21.15.45:0/1336179954 wait complete. 2023-10-03T19:19:35.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa70ebfd640 1 Processor -- start 2023-10-03T19:19:35.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa70ebfd640 1 -- start start 2023-10-03T19:19:35.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa70ebfd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa70806f880 0x7fa7081411b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:35.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa70ebfd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa70814ba30 0x7fa7080be270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:35.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa70ebfd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa70814f510 0x7fa708143e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:35.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa70ebfd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7080a1eb0 con 0x7fa70814f510 2023-10-03T19:19:35.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa70ebfd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7081416f0 con 0x7fa70806f880 2023-10-03T19:19:35.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa70ebfd640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7080be7b0 con 0x7fa70814ba30 2023-10-03T19:19:35.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa70d19a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa70814f510 0x7fa708143e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:35.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa70d19a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa70814f510 0x7fa708143e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47522/0 (socket says 172.21.15.45:47522) 2023-10-03T19:19:35.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa70d19a640 1 -- 172.21.15.45:0/2831746774 learned_addr learned my addr 172.21.15.45:0/2831746774 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:35.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa707fff640 1 --2- 172.21.15.45:0/2831746774 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa70814ba30 0x7fa7080be270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:35.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa70c999640 1 --2- 172.21.15.45:0/2831746774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa70806f880 0x7fa7081411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:35.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa70d19a640 1 -- 172.21.15.45:0/2831746774 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa70814ba30 msgr2=0x7fa7080be270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:35.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa70d19a640 1 --2- 172.21.15.45:0/2831746774 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa70814ba30 0x7fa7080be270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:35.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa70d19a640 1 -- 172.21.15.45:0/2831746774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa70806f880 msgr2=0x7fa7081411b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:35.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa70d19a640 1 --2- 172.21.15.45:0/2831746774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa70806f880 0x7fa7081411b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:35.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa70d19a640 1 -- 172.21.15.45:0/2831746774 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa700009420 con 0x7fa70814f510 2023-10-03T19:19:35.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa707fff640 1 --2- 172.21.15.45:0/2831746774 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa70814ba30 0x7fa7080be270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:19:35.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa70c999640 1 --2- 172.21.15.45:0/2831746774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa70806f880 0x7fa7081411b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:19:35.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa70d19a640 1 --2- 172.21.15.45:0/2831746774 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa70814f510 0x7fa708143e50 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fa700019060 tx=0x7fa7000191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:35.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa7057fa640 1 -- 172.21.15.45:0/2831746774 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa700006e20 con 0x7fa70814f510 2023-10-03T19:19:35.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa7057fa640 1 -- 172.21.15.45:0/2831746774 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7000b5640 con 0x7fa70814f510 2023-10-03T19:19:35.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa70ebfd640 1 -- 172.21.15.45:0/2831746774 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7080a6050 con 0x7fa70814f510 2023-10-03T19:19:35.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa7057fa640 1 -- 172.21.15.45:0/2831746774 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7000b59d0 con 0x7fa70814f510 2023-10-03T19:19:35.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.976+0000 7fa70ebfd640 1 -- 172.21.15.45:0/2831746774 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa70806fc50 con 0x7fa70814f510 2023-10-03T19:19:35.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.980+0000 7fa70ebfd640 1 -- 172.21.15.45:0/2831746774 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7080a61e0 con 0x7fa70814f510 2023-10-03T19:19:35.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.980+0000 7fa7057fa640 1 -- 172.21.15.45:0/2831746774 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa7000b3040 con 0x7fa70814f510 2023-10-03T19:19:35.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.980+0000 7fa7057fa640 1 --2- 172.21.15.45:0/2831746774 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa6f4066280 0x7fa6f4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:35.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.980+0000 7fa7057fa640 1 -- 172.21.15.45:0/2831746774 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa70011daf0 con 0x7fa70814f510 2023-10-03T19:19:35.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.980+0000 7fa70c999640 1 --2- 172.21.15.45:0/2831746774 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa6f4066280 0x7fa6f4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:35.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.980+0000 7fa70c999640 1 --2- 172.21.15.45:0/2831746774 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa6f4066280 0x7fa6f4068730 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa6f80012f0 tx=0x7fa6f8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:35.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:35.984+0000 7fa7057fa640 1 -- 172.21.15.45:0/2831746774 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa7000eb350 con 0x7fa70814f510 2023-10-03T19:19:36.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.132+0000 7fa70ebfd640 1 -- 172.21.15.45:0/2831746774 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa70804de80 con 0x7fa70814f510 2023-10-03T19:19:36.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.132+0000 7fa7057fa640 1 -- 172.21.15.45:0/2831746774 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa7000b9020 con 0x7fa70814f510 2023-10-03T19:19:36.137 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:19:36.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.136+0000 7fa70ebfd640 1 -- 172.21.15.45:0/2831746774 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa6f4066280 msgr2=0x7fa6f4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:36.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.136+0000 7fa70ebfd640 1 --2- 172.21.15.45:0/2831746774 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa6f4066280 0x7fa6f4068730 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa6f80012f0 tx=0x7fa6f8009040 comp rx=0 tx=0).stop 2023-10-03T19:19:36.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.136+0000 7fa70ebfd640 1 -- 172.21.15.45:0/2831746774 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa70814f510 msgr2=0x7fa708143e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:36.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.136+0000 7fa70ebfd640 1 --2- 172.21.15.45:0/2831746774 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa70814f510 0x7fa708143e50 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fa700019060 tx=0x7fa7000191f0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.136+0000 7fa70ebfd640 1 -- 172.21.15.45:0/2831746774 shutdown_connections 2023-10-03T19:19:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.136+0000 7fa70ebfd640 1 --2- 172.21.15.45:0/2831746774 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa6f4066280 0x7fa6f4068730 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.136+0000 7fa70ebfd640 1 --2- 172.21.15.45:0/2831746774 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa70814f510 0x7fa708143e50 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.136+0000 7fa70ebfd640 1 --2- 172.21.15.45:0/2831746774 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa70814ba30 0x7fa7080be270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.136+0000 7fa70ebfd640 1 --2- 172.21.15.45:0/2831746774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa70806f880 0x7fa7081411b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.136+0000 7fa70ebfd640 1 -- 172.21.15.45:0/2831746774 >> 172.21.15.45:0/2831746774 conn(0x7fa7080a20d0 msgr2=0x7fa70814cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.136+0000 7fa70ebfd640 1 -- 172.21.15.45:0/2831746774 shutdown_connections 2023-10-03T19:19:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.136+0000 7fa70ebfd640 1 -- 172.21.15.45:0/2831746774 wait complete. 2023-10-03T19:19:36.155 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:19:36.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.268+0000 7f5f8c1d0640 1 Processor -- start 2023-10-03T19:19:36.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.272+0000 7f5f8c1d0640 1 -- start start 2023-10-03T19:19:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.272+0000 7f5f8c1d0640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5f840bf1f0 0x7f5f840a9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.272+0000 7f5f8c1d0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f840c2770 0x7f5f840a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.272+0000 7f5f8c1d0640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f8406ac70 con 0x7f5f840c14e0 2023-10-03T19:19:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.272+0000 7f5f8c1d0640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f8406aae0 con 0x7f5f840bf1f0 2023-10-03T19:19:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.272+0000 7f5f8c1d0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f840c3000 con 0x7f5f840c2770 2023-10-03T19:19:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.272+0000 7f5f89f6c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5f840c14e0 0x7f5f840c0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39664/0 (socket says 172.21.15.45:39664) 2023-10-03T19:19:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.272+0000 7f5f89f6c640 1 -- 172.21.15.45:0/201101148 learned_addr learned my addr 172.21.15.45:0/201101148 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.272+0000 7f5f8976b640 1 --2- 172.21.15.45:0/201101148 >> v2:172.21.15.45:3300/0 conn(0x7f5f840bf1f0 0x7f5f840a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.272+0000 7f5f88f6a640 1 -- 172.21.15.45:0/201101148 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3174339633 0 0) 0x7f5f8406ac70 con 0x7f5f840c14e0 2023-10-03T19:19:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.272+0000 7f5f8a76d640 1 --2- 172.21.15.45:0/201101148 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f840c2770 0x7f5f840a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.272+0000 7f5f88f6a640 1 -- 172.21.15.45:0/201101148 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f70003530 con 0x7f5f840c14e0 2023-10-03T19:19:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.272+0000 7f5f8976b640 1 -- 172.21.15.45:0/201101148 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f840c2770 msgr2=0x7f5f840a9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.272+0000 7f5f8976b640 1 --2- 172.21.15.45:0/201101148 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f840c2770 0x7f5f840a9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.272+0000 7f5f8976b640 1 -- 172.21.15.45:0/201101148 >> v1:172.21.15.45:6789/0 conn(0x7f5f840c14e0 legacy=0x7f5f840c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.272+0000 7f5f8976b640 1 -- 172.21.15.45:0/201101148 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f840aa5f0 con 0x7f5f840bf1f0 2023-10-03T19:19:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.272+0000 7f5f8976b640 1 --2- 172.21.15.45:0/201101148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f840bf1f0 0x7f5f840a9860 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f5f740097c0 tx=0x7f5f7401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7ef6139ea0d4b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.272+0000 7f5f88f6a640 1 -- 172.21.15.45:0/201101148 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f740a8970 con 0x7f5f840bf1f0 2023-10-03T19:19:36.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.272+0000 7f5f88f6a640 1 -- 172.21.15.45:0/201101148 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f740a8ad0 con 0x7f5f840bf1f0 2023-10-03T19:19:36.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.272+0000 7f5f88f6a640 1 -- 172.21.15.45:0/201101148 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f740a8e40 con 0x7f5f840bf1f0 2023-10-03T19:19:36.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f8c1d0640 1 -- 172.21.15.45:0/201101148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f840bf1f0 msgr2=0x7f5f840a9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:36.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f8c1d0640 1 --2- 172.21.15.45:0/201101148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f840bf1f0 0x7f5f840a9860 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f5f740097c0 tx=0x7f5f7401ec70 comp rx=0 tx=0).stop 2023-10-03T19:19:36.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f8c1d0640 1 -- 172.21.15.45:0/201101148 shutdown_connections 2023-10-03T19:19:36.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f8c1d0640 1 --2- 172.21.15.45:0/201101148 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f840c2770 0x7f5f840a9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f8c1d0640 1 --2- 172.21.15.45:0/201101148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f840bf1f0 0x7f5f840a9860 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f8c1d0640 1 -- 172.21.15.45:0/201101148 >> 172.21.15.45:0/201101148 conn(0x7f5f840a6440 msgr2=0x7f5f840a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:36.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f8c1d0640 1 -- 172.21.15.45:0/201101148 shutdown_connections 2023-10-03T19:19:36.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f8c1d0640 1 -- 172.21.15.45:0/201101148 wait complete. 2023-10-03T19:19:36.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f8c1d0640 1 Processor -- start 2023-10-03T19:19:36.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f8c1d0640 1 -- start start 2023-10-03T19:19:36.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f8c1d0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f840bf1f0 0x7f5f841e47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:36.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f8c1d0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f840c14e0 0x7f5f840bdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:36.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f8c1d0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f840c2770 0x7f5f841e3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:36.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f8c1d0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f841e37e0 con 0x7f5f840c2770 2023-10-03T19:19:36.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f8c1d0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f841e7230 con 0x7f5f840c14e0 2023-10-03T19:19:36.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f8c1d0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f840be2b0 con 0x7f5f840bf1f0 2023-10-03T19:19:36.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f8a76d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f840c2770 0x7f5f841e3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:36.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f8a76d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f840c2770 0x7f5f841e3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47540/0 (socket says 172.21.15.45:47540) 2023-10-03T19:19:36.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f8a76d640 1 -- 172.21.15.45:0/4140097576 learned_addr learned my addr 172.21.15.45:0/4140097576 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:36.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f89f6c640 1 --2- 172.21.15.45:0/4140097576 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f840bf1f0 0x7f5f841e47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:36.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f8976b640 1 --2- 172.21.15.45:0/4140097576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f840c14e0 0x7f5f840bdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:36.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f8a76d640 1 -- 172.21.15.45:0/4140097576 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f840bf1f0 msgr2=0x7f5f841e47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:36.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f8a76d640 1 --2- 172.21.15.45:0/4140097576 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f840bf1f0 0x7f5f841e47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f8a76d640 1 -- 172.21.15.45:0/4140097576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f840c14e0 msgr2=0x7f5f840bdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:36.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f8a76d640 1 --2- 172.21.15.45:0/4140097576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f840c14e0 0x7f5f840bdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f8a76d640 1 -- 172.21.15.45:0/4140097576 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f74009420 con 0x7f5f840c2770 2023-10-03T19:19:36.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f8a76d640 1 --2- 172.21.15.45:0/4140097576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f840c2770 0x7f5f841e3c00 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c007e70 tx=0x7f5f7c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:36.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f7a7fc640 1 -- 172.21.15.45:0/4140097576 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c014420 con 0x7f5f840c2770 2023-10-03T19:19:36.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f7a7fc640 1 -- 172.21.15.45:0/4140097576 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7c0145a0 con 0x7f5f840c2770 2023-10-03T19:19:36.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f8c1d0640 1 -- 172.21.15.45:0/4140097576 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f8414f530 con 0x7f5f840c2770 2023-10-03T19:19:36.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f7a7fc640 1 -- 172.21.15.45:0/4140097576 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c014950 con 0x7f5f840c2770 2023-10-03T19:19:36.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.276+0000 7f5f8c1d0640 1 -- 172.21.15.45:0/4140097576 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8414f250 con 0x7f5f840c2770 2023-10-03T19:19:36.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.280+0000 7f5f8c1d0640 1 -- 172.21.15.45:0/4140097576 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8406b100 con 0x7f5f840c2770 2023-10-03T19:19:36.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.280+0000 7f5f7a7fc640 1 -- 172.21.15.45:0/4140097576 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5f7c014ab0 con 0x7f5f840c2770 2023-10-03T19:19:36.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.280+0000 7f5f7a7fc640 1 --2- 172.21.15.45:0/4140097576 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5f68066280 0x7f5f68068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:36.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.280+0000 7f5f7a7fc640 1 -- 172.21.15.45:0/4140097576 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5f7c084340 con 0x7f5f840c2770 2023-10-03T19:19:36.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.280+0000 7f5f89f6c640 1 --2- 172.21.15.45:0/4140097576 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5f68066280 0x7f5f68068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:36.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.280+0000 7f5f89f6c640 1 --2- 172.21.15.45:0/4140097576 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5f68066280 0x7f5f68068730 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5f80005890 tx=0x7f5f80009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:36.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.284+0000 7f5f7a7fc640 1 -- 172.21.15.45:0/4140097576 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5f7c0555d0 con 0x7f5f840c2770 2023-10-03T19:19:36.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.428+0000 7f5f8c1d0640 1 -- 172.21.15.45:0/4140097576 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5f841e3920 con 0x7f5f840c2770 2023-10-03T19:19:36.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.432+0000 7f5f7a7fc640 1 -- 172.21.15.45:0/4140097576 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v94) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5f841e3920 con 0x7f5f840c2770 2023-10-03T19:19:36.434 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:19:36.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.432+0000 7f5f8c1d0640 1 -- 172.21.15.45:0/4140097576 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5f68066280 msgr2=0x7f5f68068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:36.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.432+0000 7f5f8c1d0640 1 --2- 172.21.15.45:0/4140097576 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5f68066280 0x7f5f68068730 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5f80005890 tx=0x7f5f80009040 comp rx=0 tx=0).stop 2023-10-03T19:19:36.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.432+0000 7f5f8c1d0640 1 -- 172.21.15.45:0/4140097576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f840c2770 msgr2=0x7f5f841e3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:36.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.432+0000 7f5f8c1d0640 1 --2- 172.21.15.45:0/4140097576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f840c2770 0x7f5f841e3c00 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c007e70 tx=0x7f5f7c00e4b0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.432+0000 7f5f8c1d0640 1 -- 172.21.15.45:0/4140097576 shutdown_connections 2023-10-03T19:19:36.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.432+0000 7f5f8c1d0640 1 --2- 172.21.15.45:0/4140097576 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5f68066280 0x7f5f68068730 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.432+0000 7f5f8c1d0640 1 --2- 172.21.15.45:0/4140097576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f840c2770 0x7f5f841e3c00 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.432+0000 7f5f8c1d0640 1 --2- 172.21.15.45:0/4140097576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f840c14e0 0x7f5f840bdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.432+0000 7f5f8c1d0640 1 --2- 172.21.15.45:0/4140097576 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f840bf1f0 0x7f5f841e47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.432+0000 7f5f8c1d0640 1 -- 172.21.15.45:0/4140097576 >> 172.21.15.45:0/4140097576 conn(0x7f5f840a6440 msgr2=0x7f5f840c50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:36.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.432+0000 7f5f8c1d0640 1 -- 172.21.15.45:0/4140097576 shutdown_connections 2023-10-03T19:19:36.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.432+0000 7f5f8c1d0640 1 -- 172.21.15.45:0/4140097576 wait complete. 2023-10-03T19:19:36.451 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-03T19:19:36.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.568+0000 7f2acaac2640 1 Processor -- start 2023-10-03T19:19:36.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.568+0000 7f2acaac2640 1 -- start start 2023-10-03T19:19:36.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.572+0000 7f2acaac2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2ac4148b90 0x7f2ac40bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:36.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.572+0000 7f2acaac2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2ac40bcb60 0x7f2ac406c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:36.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.572+0000 7f2acaac2640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac414b610 con 0x7f2ac40bc4a0 2023-10-03T19:19:36.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.572+0000 7f2acaac2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac40a3670 con 0x7f2ac40bcb60 2023-10-03T19:19:36.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.572+0000 7f2acaac2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac414b370 con 0x7f2ac4148b90 2023-10-03T19:19:36.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.572+0000 7f2ac3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2ac40bcb60 0x7f2ac406c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:36.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.572+0000 7f2ac905f640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2ac40bc4a0 0x7f2ac406c7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39674/0 (socket says 172.21.15.45:39674) 2023-10-03T19:19:36.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.572+0000 7f2ac905f640 1 -- 172.21.15.45:0/1435097192 learned_addr learned my addr 172.21.15.45:0/1435097192 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:36.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.572+0000 7f2ac885e640 1 --2- 172.21.15.45:0/1435097192 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2ac4148b90 0x7f2ac40bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:36.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.572+0000 7f2ac3fff640 1 -- 172.21.15.45:0/1435097192 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2ac4148b90 msgr2=0x7f2ac40bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:36.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.572+0000 7f2ac3fff640 1 --2- 172.21.15.45:0/1435097192 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2ac4148b90 0x7f2ac40bbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.572+0000 7f2ac3fff640 1 -- 172.21.15.45:0/1435097192 >> v1:172.21.15.45:6789/0 conn(0x7f2ac40bc4a0 legacy=0x7f2ac406c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:36.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.572+0000 7f2ac37fe640 1 -- 172.21.15.45:0/1435097192 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 356763 0 0) 0x7f2ac414b610 con 0x7f2ac40bc4a0 2023-10-03T19:19:36.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.572+0000 7f2ac3fff640 1 -- 172.21.15.45:0/1435097192 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac40a5580 con 0x7f2ac40bcb60 2023-10-03T19:19:36.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.572+0000 7f2ac3fff640 1 --2- 172.21.15.45:0/1435097192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ac40bcb60 0x7f2ac406c290 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f2ab80097c0 tx=0x7f2ab801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a2fdb2aaefdcef3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:36.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.572+0000 7f2ac37fe640 1 -- 172.21.15.45:0/1435097192 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab80a8970 con 0x7f2ac40bcb60 2023-10-03T19:19:36.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.572+0000 7f2ac37fe640 1 -- 172.21.15.45:0/1435097192 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab80a8ad0 con 0x7f2ac40bcb60 2023-10-03T19:19:36.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.572+0000 7f2ac37fe640 1 -- 172.21.15.45:0/1435097192 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab80a8e60 con 0x7f2ac40bcb60 2023-10-03T19:19:36.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.572+0000 7f2acaac2640 1 -- 172.21.15.45:0/1435097192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ac40bcb60 msgr2=0x7f2ac406c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:36.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.572+0000 7f2acaac2640 1 --2- 172.21.15.45:0/1435097192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ac40bcb60 0x7f2ac406c290 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f2ab80097c0 tx=0x7f2ab801ec70 comp rx=0 tx=0).stop 2023-10-03T19:19:36.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.572+0000 7f2acaac2640 1 -- 172.21.15.45:0/1435097192 shutdown_connections 2023-10-03T19:19:36.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.572+0000 7f2acaac2640 1 --2- 172.21.15.45:0/1435097192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ac40bcb60 0x7f2ac406c290 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.572+0000 7f2acaac2640 1 --2- 172.21.15.45:0/1435097192 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2ac4148b90 0x7f2ac40bbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.572+0000 7f2acaac2640 1 -- 172.21.15.45:0/1435097192 >> 172.21.15.45:0/1435097192 conn(0x7f2ac40bcf50 msgr2=0x7f2ac40bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:36.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.576+0000 7f2acaac2640 1 -- 172.21.15.45:0/1435097192 shutdown_connections 2023-10-03T19:19:36.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.576+0000 7f2acaac2640 1 -- 172.21.15.45:0/1435097192 wait complete. 2023-10-03T19:19:36.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.576+0000 7f2acaac2640 1 Processor -- start 2023-10-03T19:19:36.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.576+0000 7f2acaac2640 1 -- start start 2023-10-03T19:19:36.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.576+0000 7f2acaac2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ac40bc4a0 0x7f2ac40b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:36.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.576+0000 7f2acaac2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2ac40bcb60 0x7f2ac40b9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:36.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.576+0000 7f2acaac2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ac4148b90 0x7f2ac40b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:36.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.576+0000 7f2acaac2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac40b7dc0 con 0x7f2ac40bc4a0 2023-10-03T19:19:36.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.576+0000 7f2acaac2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac406ccd0 con 0x7f2ac4148b90 2023-10-03T19:19:36.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.576+0000 7f2acaac2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac40ba1f0 con 0x7f2ac40bcb60 2023-10-03T19:19:36.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.576+0000 7f2ac885e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ac40bc4a0 0x7f2ac40b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:36.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.576+0000 7f2ac885e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ac40bc4a0 0x7f2ac40b54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47566/0 (socket says 172.21.15.45:47566) 2023-10-03T19:19:36.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.576+0000 7f2ac885e640 1 -- 172.21.15.45:0/1355356001 learned_addr learned my addr 172.21.15.45:0/1355356001 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:36.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.576+0000 7f2ac3fff640 1 --2- 172.21.15.45:0/1355356001 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2ac40bcb60 0x7f2ac40b9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:36.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.576+0000 7f2ac905f640 1 --2- 172.21.15.45:0/1355356001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ac4148b90 0x7f2ac40b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:36.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.576+0000 7f2ac885e640 1 -- 172.21.15.45:0/1355356001 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2ac40bcb60 msgr2=0x7f2ac40b9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:36.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.576+0000 7f2ac885e640 1 --2- 172.21.15.45:0/1355356001 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2ac40bcb60 0x7f2ac40b9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.576+0000 7f2ac885e640 1 -- 172.21.15.45:0/1355356001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ac4148b90 msgr2=0x7f2ac40b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:36.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.576+0000 7f2ac885e640 1 --2- 172.21.15.45:0/1355356001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ac4148b90 0x7f2ac40b6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.576+0000 7f2ac885e640 1 -- 172.21.15.45:0/1355356001 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab8009420 con 0x7f2ac40bc4a0 2023-10-03T19:19:36.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.576+0000 7f2ac885e640 1 --2- 172.21.15.45:0/1355356001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ac40bc4a0 0x7f2ac40b54e0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f2ab400d5f0 tx=0x7f2ab400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:36.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.576+0000 7f2ac17fa640 1 -- 172.21.15.45:0/1355356001 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab40125f0 con 0x7f2ac40bc4a0 2023-10-03T19:19:36.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.576+0000 7f2ac17fa640 1 -- 172.21.15.45:0/1355356001 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab4012750 con 0x7f2ac40bc4a0 2023-10-03T19:19:36.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.576+0000 7f2acaac2640 1 -- 172.21.15.45:0/1355356001 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac406cee0 con 0x7f2ac40bc4a0 2023-10-03T19:19:36.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.576+0000 7f2ac17fa640 1 -- 172.21.15.45:0/1355356001 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4012ae0 con 0x7f2ac40bc4a0 2023-10-03T19:19:36.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.576+0000 7f2acaac2640 1 -- 172.21.15.45:0/1355356001 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac40a5820 con 0x7f2ac40bc4a0 2023-10-03T19:19:36.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.576+0000 7f2acaac2640 1 -- 172.21.15.45:0/1355356001 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac4148f60 con 0x7f2ac40bc4a0 2023-10-03T19:19:36.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.580+0000 7f2ac17fa640 1 -- 172.21.15.45:0/1355356001 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2ab4012c40 con 0x7f2ac40bc4a0 2023-10-03T19:19:36.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.580+0000 7f2ac17fa640 1 --2- 172.21.15.45:0/1355356001 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2ab0066280 0x7f2ab0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:36.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.580+0000 7f2ac17fa640 1 -- 172.21.15.45:0/1355356001 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2ab4083ec0 con 0x7f2ac40bc4a0 2023-10-03T19:19:36.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.580+0000 7f2ac3fff640 1 --2- 172.21.15.45:0/1355356001 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2ab0066280 0x7f2ab0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:36.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.580+0000 7f2ac3fff640 1 --2- 172.21.15.45:0/1355356001 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2ab0066280 0x7f2ab0068730 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2ab80b2000 tx=0x7f2ab80aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:36.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.584+0000 7f2ac17fa640 1 -- 172.21.15.45:0/1355356001 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2ab4051690 con 0x7f2ac40bc4a0 2023-10-03T19:19:36.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.740+0000 7f2acaac2640 1 -- 172.21.15.45:0/1355356001 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2ac40ba5b0 con 0x7f2ac40bc4a0 2023-10-03T19:19:36.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.740+0000 7f2ac17fa640 1 -- 172.21.15.45:0/1355356001 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v94) v1 ==== 84+0+126 (secure 0 0 0) 0x7f2ab4054cb0 con 0x7f2ac40bc4a0 2023-10-03T19:19:36.744 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:19:36.744 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-10-03T19:19:36.744 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:19:36.745 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-10-03T19:19:36.745 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-10-03T19:19:36.745 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:19:36.745 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:19:36.745 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 2, 2023-10-03T19:19:36.745 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "rbd" 2023-10-03T19:19:36.745 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:19:36.745 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-10-03T19:19:36.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.744+0000 7f2acaac2640 1 -- 172.21.15.45:0/1355356001 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2ab0066280 msgr2=0x7f2ab0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:36.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.744+0000 7f2acaac2640 1 --2- 172.21.15.45:0/1355356001 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2ab0066280 0x7f2ab0068730 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2ab80b2000 tx=0x7f2ab80aa070 comp rx=0 tx=0).stop 2023-10-03T19:19:36.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.744+0000 7f2acaac2640 1 -- 172.21.15.45:0/1355356001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ac40bc4a0 msgr2=0x7f2ac40b54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:36.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.744+0000 7f2acaac2640 1 --2- 172.21.15.45:0/1355356001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ac40bc4a0 0x7f2ac40b54e0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f2ab400d5f0 tx=0x7f2ab400dab0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.744+0000 7f2acaac2640 1 -- 172.21.15.45:0/1355356001 shutdown_connections 2023-10-03T19:19:36.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.744+0000 7f2acaac2640 1 --2- 172.21.15.45:0/1355356001 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2ab0066280 0x7f2ab0068730 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.744+0000 7f2acaac2640 1 --2- 172.21.15.45:0/1355356001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ac4148b90 0x7f2ac40b6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.744+0000 7f2acaac2640 1 --2- 172.21.15.45:0/1355356001 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2ac40bcb60 0x7f2ac40b9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.744+0000 7f2acaac2640 1 --2- 172.21.15.45:0/1355356001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ac40bc4a0 0x7f2ac40b54e0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.744+0000 7f2acaac2640 1 -- 172.21.15.45:0/1355356001 >> 172.21.15.45:0/1355356001 conn(0x7f2ac40bcf50 msgr2=0x7f2ac4147dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:36.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.744+0000 7f2acaac2640 1 -- 172.21.15.45:0/1355356001 shutdown_connections 2023-10-03T19:19:36.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.744+0000 7f2acaac2640 1 -- 172.21.15.45:0/1355356001 wait complete. 2023-10-03T19:19:36.764 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-03T19:19:36.764 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-03T19:19:36.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.892+0000 7f56a3b00640 1 Processor -- start 2023-10-03T19:19:36.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.892+0000 7f56a3b00640 1 -- start start 2023-10-03T19:19:36.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.892+0000 7f56a3b00640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f569c0bf1f0 0x7f569c0a9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:36.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.892+0000 7f56a3b00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f569c06ac70 con 0x7f569c0c14e0 2023-10-03T19:19:36.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.892+0000 7f56a3b00640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f569c0c3000 con 0x7f569c0c2770 2023-10-03T19:19:36.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.892+0000 7f56a3b00640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f569c06aae0 con 0x7f569c0bf1f0 2023-10-03T19:19:36.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.892+0000 7f56a189c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f569c0c14e0 0x7f569c0c0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39684/0 (socket says 172.21.15.45:39684) 2023-10-03T19:19:36.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.892+0000 7f56a189c640 1 -- 172.21.15.45:0/1632476971 learned_addr learned my addr 172.21.15.45:0/1632476971 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:36.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.892+0000 7f56a109b640 1 --2- 172.21.15.45:0/1632476971 >> v2:172.21.15.79:3300/0 conn(0x7f569c0bf1f0 0x7f569c0a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:36.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.892+0000 7f56a089a640 1 -- 172.21.15.45:0/1632476971 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 159319185 0 0) 0x7f569c06ac70 con 0x7f569c0c14e0 2023-10-03T19:19:36.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.892+0000 7f56a089a640 1 -- 172.21.15.45:0/1632476971 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5688003530 con 0x7f569c0c14e0 2023-10-03T19:19:36.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.892+0000 7f56a089a640 1 -- 172.21.15.45:0/1632476971 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1462391205 0 0) 0x7f5688003530 con 0x7f569c0c14e0 2023-10-03T19:19:36.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a089a640 1 -- 172.21.15.45:0/1632476971 >> v2:172.21.15.79:3300/0 conn(0x7f569c0bf1f0 msgr2=0x7f569c0a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:36.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a089a640 1 --2- 172.21.15.45:0/1632476971 >> v2:172.21.15.79:3300/0 conn(0x7f569c0bf1f0 0x7f569c0a9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a089a640 1 -- 172.21.15.45:0/1632476971 >> v1:172.21.15.79:6789/0 conn(0x7f569c0c2770 legacy=0x7f569c0a9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:36.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a089a640 1 -- 172.21.15.45:0/1632476971 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569c0aa5f0 con 0x7f569c0c14e0 2023-10-03T19:19:36.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a089a640 1 -- 172.21.15.45:0/1632476971 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f5698001680 con 0x7f569c0c14e0 2023-10-03T19:19:36.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a089a640 1 -- 172.21.15.45:0/1632476971 >> v1:172.21.15.45:6789/0 conn(0x7f569c0c14e0 legacy=0x7f569c0c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:36.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a089a640 1 --2- 172.21.15.45:0/1632476971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5688003980 0x7f5688003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:36.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a089a640 1 --2- 172.21.15.45:0/1632476971 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f56880047d0 0x7f5688004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:36.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a089a640 1 --2- 172.21.15.45:0/1632476971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5688005180 0x7f568800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:36.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a089a640 1 -- 172.21.15.45:0/1632476971 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568800bfb0 con 0x7f5688003980 2023-10-03T19:19:36.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a089a640 1 -- 172.21.15.45:0/1632476971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568800c120 con 0x7f5688005180 2023-10-03T19:19:36.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a089a640 1 -- 172.21.15.45:0/1632476971 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568800c2e0 con 0x7f56880047d0 2023-10-03T19:19:36.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a189c640 1 --2- 172.21.15.45:0/1632476971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5688003980 0x7f5688003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:36.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a109b640 1 --2- 172.21.15.45:0/1632476971 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f56880047d0 0x7f5688004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:36.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a209d640 1 --2- 172.21.15.45:0/1632476971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5688005180 0x7f568800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:36.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a189c640 1 -- 172.21.15.45:0/1632476971 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f56880047d0 msgr2=0x7f5688004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:36.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a189c640 1 --2- 172.21.15.45:0/1632476971 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f56880047d0 0x7f5688004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a189c640 1 -- 172.21.15.45:0/1632476971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5688005180 msgr2=0x7f568800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:36.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a189c640 1 --2- 172.21.15.45:0/1632476971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5688005180 0x7f568800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a189c640 1 -- 172.21.15.45:0/1632476971 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5688003530 con 0x7f5688003980 2023-10-03T19:19:36.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a209d640 1 --2- 172.21.15.45:0/1632476971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5688005180 0x7f568800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:19:36.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a209d640 1 -- 172.21.15.45:0/1632476971 reap_dead start 2023-10-03T19:19:36.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a189c640 1 --2- 172.21.15.45:0/1632476971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5688003980 0x7f5688003d90 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f569800c240 tx=0x7f569801f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=befb4c9eccdc540d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:36.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a089a640 1 -- 172.21.15.45:0/1632476971 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5698005ae0 con 0x7f5688003980 2023-10-03T19:19:36.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a089a640 1 -- 172.21.15.45:0/1632476971 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56980ab070 con 0x7f5688003980 2023-10-03T19:19:36.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a089a640 1 -- 172.21.15.45:0/1632476971 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5698007070 con 0x7f5688003980 2023-10-03T19:19:36.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a3b00640 1 -- 172.21.15.45:0/1632476971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5688003980 msgr2=0x7f5688003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:36.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a3b00640 1 --2- 172.21.15.45:0/1632476971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5688003980 0x7f5688003d90 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f569800c240 tx=0x7f569801f3b0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a3b00640 1 -- 172.21.15.45:0/1632476971 shutdown_connections 2023-10-03T19:19:36.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a3b00640 1 --2- 172.21.15.45:0/1632476971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5688003980 0x7f5688003d90 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a3b00640 1 -- 172.21.15.45:0/1632476971 >> 172.21.15.45:0/1632476971 conn(0x7f569c0a6440 msgr2=0x7f569c0a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:36.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a3b00640 1 -- 172.21.15.45:0/1632476971 shutdown_connections 2023-10-03T19:19:36.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.896+0000 7f56a3b00640 1 -- 172.21.15.45:0/1632476971 wait complete. 2023-10-03T19:19:36.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.900+0000 7f56a3b00640 1 Processor -- start 2023-10-03T19:19:36.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.900+0000 7f56a3b00640 1 -- start start 2023-10-03T19:19:36.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.900+0000 7f56a3b00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5688003980 0x7f569c1e7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:36.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.900+0000 7f56a3b00640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f569c09b810 0x7f569c09a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:36.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.900+0000 7f56a3b00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f569c09a7e0 0x7f569c1e0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:36.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.900+0000 7f56a3b00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c1e7ea0 con 0x7f5688003980 2023-10-03T19:19:36.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.900+0000 7f56a3b00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c09db30 con 0x7f569c09a7e0 2023-10-03T19:19:36.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.900+0000 7f56a3b00640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569c1e7ac0 con 0x7f569c09b810 2023-10-03T19:19:36.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.900+0000 7f56a189c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5688003980 0x7f569c1e7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:36.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.900+0000 7f56a189c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5688003980 0x7f569c1e7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47592/0 (socket says 172.21.15.45:47592) 2023-10-03T19:19:36.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.900+0000 7f56a189c640 1 -- 172.21.15.45:0/3826928526 learned_addr learned my addr 172.21.15.45:0/3826928526 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:36.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.900+0000 7f56a109b640 1 --2- 172.21.15.45:0/3826928526 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f569c09b810 0x7f569c09a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:36.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.900+0000 7f56a189c640 1 -- 172.21.15.45:0/3826928526 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f569c09b810 msgr2=0x7f569c09a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:36.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.900+0000 7f56a189c640 1 --2- 172.21.15.45:0/3826928526 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f569c09b810 0x7f569c09a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.900+0000 7f56a189c640 1 -- 172.21.15.45:0/3826928526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f569c09a7e0 msgr2=0x7f569c1e0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:36.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.900+0000 7f56a189c640 1 --2- 172.21.15.45:0/3826928526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f569c09a7e0 0x7f569c1e0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:36.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.900+0000 7f56a189c640 1 -- 172.21.15.45:0/3826928526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569c14f530 con 0x7f5688003980 2023-10-03T19:19:36.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.900+0000 7f56a109b640 1 --2- 172.21.15.45:0/3826928526 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f569c09b810 0x7f569c09a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:36.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.900+0000 7f56a189c640 1 --2- 172.21.15.45:0/3826928526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5688003980 0x7f569c1e7200 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f569801f1e0 tx=0x7f5688005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:36.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.900+0000 7f56927fc640 1 -- 172.21.15.45:0/3826928526 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5698004a70 con 0x7f5688003980 2023-10-03T19:19:36.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.900+0000 7f56927fc640 1 -- 172.21.15.45:0/3826928526 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5698004bd0 con 0x7f5688003980 2023-10-03T19:19:36.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.900+0000 7f56a3b00640 1 -- 172.21.15.45:0/3826928526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f569c14f250 con 0x7f5688003980 2023-10-03T19:19:36.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.900+0000 7f56927fc640 1 -- 172.21.15.45:0/3826928526 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5698007070 con 0x7f5688003980 2023-10-03T19:19:36.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.900+0000 7f56a3b00640 1 -- 172.21.15.45:0/3826928526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569c06b100 con 0x7f5688003980 2023-10-03T19:19:36.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.900+0000 7f56a3b00640 1 -- 172.21.15.45:0/3826928526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f569c09b660 con 0x7f5688003980 2023-10-03T19:19:36.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.904+0000 7f56927fc640 1 -- 172.21.15.45:0/3826928526 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f56980b9030 con 0x7f5688003980 2023-10-03T19:19:36.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.904+0000 7f56927fc640 1 --2- 172.21.15.45:0/3826928526 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f56800662b0 0x7f5680068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:36.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.904+0000 7f56927fc640 1 -- 172.21.15.45:0/3826928526 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f56980b7070 con 0x7f5688003980 2023-10-03T19:19:36.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.904+0000 7f56a109b640 1 --2- 172.21.15.45:0/3826928526 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f56800662b0 0x7f5680068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:36.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.904+0000 7f56a109b640 1 --2- 172.21.15.45:0/3826928526 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f56800662b0 0x7f5680068760 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f569c0bf5c0 tx=0x7f568c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:36.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:36.904+0000 7f56927fc640 1 -- 172.21.15.45:0/3826928526 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f56980f1f80 con 0x7f5688003980 2023-10-03T19:19:37.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:37.068+0000 7f56a3b00640 1 -- 172.21.15.45:0/3826928526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f569c1e7c80 con 0x7f5688003980 2023-10-03T19:19:38.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.036+0000 7f56927fc640 1 -- 172.21.15.45:0/3826928526 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v95) v1 ==== 138+0+0 (secure 0 0 0) 0x7f56980c1020 con 0x7f5688003980 2023-10-03T19:19:38.039 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-10-03T19:19:38.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.040+0000 7f56a3b00640 1 -- 172.21.15.45:0/3826928526 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f56800662b0 msgr2=0x7f5680068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:38.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.040+0000 7f56a3b00640 1 --2- 172.21.15.45:0/3826928526 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f56800662b0 0x7f5680068760 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f569c0bf5c0 tx=0x7f568c008040 comp rx=0 tx=0).stop 2023-10-03T19:19:38.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.040+0000 7f56a3b00640 1 -- 172.21.15.45:0/3826928526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5688003980 msgr2=0x7f569c1e7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:38.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.040+0000 7f56a3b00640 1 --2- 172.21.15.45:0/3826928526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5688003980 0x7f569c1e7200 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f569801f1e0 tx=0x7f5688005800 comp rx=0 tx=0).stop 2023-10-03T19:19:38.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.040+0000 7f56a3b00640 1 -- 172.21.15.45:0/3826928526 shutdown_connections 2023-10-03T19:19:38.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.040+0000 7f56a3b00640 1 --2- 172.21.15.45:0/3826928526 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f56800662b0 0x7f5680068760 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:38.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.040+0000 7f56a3b00640 1 --2- 172.21.15.45:0/3826928526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f569c09a7e0 0x7f569c1e0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:38.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.040+0000 7f56a3b00640 1 --2- 172.21.15.45:0/3826928526 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f569c09b810 0x7f569c09a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:38.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.040+0000 7f56a3b00640 1 --2- 172.21.15.45:0/3826928526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5688003980 0x7f569c1e7200 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:38.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.040+0000 7f56a3b00640 1 -- 172.21.15.45:0/3826928526 >> 172.21.15.45:0/3826928526 conn(0x7f569c0a6440 msgr2=0x7f569c069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:38.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.044+0000 7f56a3b00640 1 -- 172.21.15.45:0/3826928526 shutdown_connections 2023-10-03T19:19:38.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.044+0000 7f56a3b00640 1 -- 172.21.15.45:0/3826928526 wait complete. 2023-10-03T19:19:38.070 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-03T19:19:38.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.204+0000 7f668fccb640 1 Processor -- start 2023-10-03T19:19:38.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.204+0000 7f668fccb640 1 -- start start 2023-10-03T19:19:38.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.204+0000 7f668fccb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f66880be9c0 0x7f66880bcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:38.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.204+0000 7f668fccb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66880bd670 con 0x7f668814bf60 2023-10-03T19:19:38.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.204+0000 7f668fccb640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f668814c360 con 0x7f668814bb00 2023-10-03T19:19:38.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.204+0000 7f668fccb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66880bc9c0 con 0x7f66880be9c0 2023-10-03T19:19:38.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.204+0000 7f668da67640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f66880be9c0 0x7f66880bcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:38.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.204+0000 7f668e268640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f668814bf60 0x7f6688155c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39688/0 (socket says 172.21.15.45:39688) 2023-10-03T19:19:38.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.204+0000 7f668e268640 1 -- 172.21.15.45:0/1724390285 learned_addr learned my addr 172.21.15.45:0/1724390285 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:38.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.204+0000 7f668da67640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f66880be9c0 0x7f66880bcfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47596/0 (socket says 172.21.15.45:47596) 2023-10-03T19:19:38.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.204+0000 7f668da67640 1 -- 172.21.15.45:0/1724390285 >> v1:172.21.15.79:6789/0 conn(0x7f668814bb00 legacy=0x7f6688069ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:38.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.204+0000 7f668da67640 1 -- 172.21.15.45:0/1724390285 >> v1:172.21.15.45:6789/0 conn(0x7f668814bf60 legacy=0x7f6688155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:38.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.204+0000 7f668da67640 1 -- 172.21.15.45:0/1724390285 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66880a4120 con 0x7f66880be9c0 2023-10-03T19:19:38.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.208+0000 7f668da67640 1 --2- 172.21.15.45:0/1724390285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66880be9c0 0x7f66880bcfb0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f6680009d90 tx=0x7f6680021340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7101b74f8b4e67a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:38.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.208+0000 7f668ca65640 1 -- 172.21.15.45:0/1724390285 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66800b1600 con 0x7f66880be9c0 2023-10-03T19:19:38.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.208+0000 7f668ca65640 1 -- 172.21.15.45:0/1724390285 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66800ad050 con 0x7f66880be9c0 2023-10-03T19:19:38.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.208+0000 7f668ca65640 1 -- 172.21.15.45:0/1724390285 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66800b1980 con 0x7f66880be9c0 2023-10-03T19:19:38.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.208+0000 7f668fccb640 1 -- 172.21.15.45:0/1724390285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66880be9c0 msgr2=0x7f66880bcfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:38.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.208+0000 7f668fccb640 1 --2- 172.21.15.45:0/1724390285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66880be9c0 0x7f66880bcfb0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f6680009d90 tx=0x7f6680021340 comp rx=0 tx=0).stop 2023-10-03T19:19:38.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.208+0000 7f668fccb640 1 -- 172.21.15.45:0/1724390285 shutdown_connections 2023-10-03T19:19:38.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.208+0000 7f668fccb640 1 --2- 172.21.15.45:0/1724390285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66880be9c0 0x7f66880bcfb0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:38.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.208+0000 7f668fccb640 1 -- 172.21.15.45:0/1724390285 >> 172.21.15.45:0/1724390285 conn(0x7f66880c2200 msgr2=0x7f66880be050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:38.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.208+0000 7f668fccb640 1 -- 172.21.15.45:0/1724390285 shutdown_connections 2023-10-03T19:19:38.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.208+0000 7f668fccb640 1 -- 172.21.15.45:0/1724390285 wait complete. 2023-10-03T19:19:38.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.208+0000 7f668fccb640 1 Processor -- start 2023-10-03T19:19:38.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.208+0000 7f668fccb640 1 -- start start 2023-10-03T19:19:38.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.208+0000 7f668fccb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66880be9c0 0x7f66880bab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:38.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.208+0000 7f668fccb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f668814bb00 0x7f66881e3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:38.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.208+0000 7f668fccb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f668814bf60 0x7f66881e3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:38.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.208+0000 7f668fccb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6688098c80 con 0x7f66880be9c0 2023-10-03T19:19:38.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.208+0000 7f668fccb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66881e43b0 con 0x7f668814bb00 2023-10-03T19:19:38.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.208+0000 7f668fccb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668814ca20 con 0x7f668814bf60 2023-10-03T19:19:38.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.208+0000 7f668da67640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66880be9c0 0x7f66880bab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:38.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.208+0000 7f668da67640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66880be9c0 0x7f66880bab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47610/0 (socket says 172.21.15.45:47610) 2023-10-03T19:19:38.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.208+0000 7f668da67640 1 -- 172.21.15.45:0/2859067282 learned_addr learned my addr 172.21.15.45:0/2859067282 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:38.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.208+0000 7f668d266640 1 --2- 172.21.15.45:0/2859067282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f668814bb00 0x7f66881e3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:38.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.208+0000 7f668e268640 1 --2- 172.21.15.45:0/2859067282 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f668814bf60 0x7f66881e3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:38.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.212+0000 7f668da67640 1 -- 172.21.15.45:0/2859067282 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f668814bf60 msgr2=0x7f66881e3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:38.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.212+0000 7f668da67640 1 --2- 172.21.15.45:0/2859067282 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f668814bf60 0x7f66881e3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:38.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.212+0000 7f668da67640 1 -- 172.21.15.45:0/2859067282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f668814bb00 msgr2=0x7f66881e3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:38.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.212+0000 7f668da67640 1 --2- 172.21.15.45:0/2859067282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f668814bb00 0x7f66881e3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:38.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.212+0000 7f668da67640 1 -- 172.21.15.45:0/2859067282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6680009a70 con 0x7f66880be9c0 2023-10-03T19:19:38.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.212+0000 7f668d266640 1 --2- 172.21.15.45:0/2859067282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f668814bb00 0x7f66881e3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:19:38.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.212+0000 7f668da67640 1 --2- 172.21.15.45:0/2859067282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66880be9c0 0x7f66880bab60 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f668001df50 tx=0x7f668001e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:38.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.212+0000 7f66867fc640 1 -- 172.21.15.45:0/2859067282 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66800b1e20 con 0x7f66880be9c0 2023-10-03T19:19:38.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.212+0000 7f66867fc640 1 -- 172.21.15.45:0/2859067282 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66800bc470 con 0x7f66880be9c0 2023-10-03T19:19:38.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.212+0000 7f668fccb640 1 -- 172.21.15.45:0/2859067282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66880bc4a0 con 0x7f66880be9c0 2023-10-03T19:19:38.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.212+0000 7f66867fc640 1 -- 172.21.15.45:0/2859067282 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66800bc820 con 0x7f66880be9c0 2023-10-03T19:19:38.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.212+0000 7f668fccb640 1 -- 172.21.15.45:0/2859067282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66880a3e40 con 0x7f66880be9c0 2023-10-03T19:19:38.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.212+0000 7f668fccb640 1 -- 172.21.15.45:0/2859067282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6688071a90 con 0x7f66880be9c0 2023-10-03T19:19:38.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.212+0000 7f66867fc640 1 -- 172.21.15.45:0/2859067282 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f66800b8070 con 0x7f66880be9c0 2023-10-03T19:19:38.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.212+0000 7f66867fc640 1 --2- 172.21.15.45:0/2859067282 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6674066280 0x7f6674068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:38.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.212+0000 7f66867fc640 1 -- 172.21.15.45:0/2859067282 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f66800aae40 con 0x7f66880be9c0 2023-10-03T19:19:38.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.212+0000 7f668d266640 1 --2- 172.21.15.45:0/2859067282 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6674066280 0x7f6674068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:38.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.216+0000 7f668d266640 1 --2- 172.21.15.45:0/2859067282 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6674066280 0x7f6674068730 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f66880a67f0 tx=0x7f667c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:38.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.216+0000 7f66867fc640 1 -- 172.21.15.45:0/2859067282 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f66800efab0 con 0x7f66880be9c0 2023-10-03T19:19:38.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:38.372+0000 7f668fccb640 1 -- 172.21.15.45:0/2859067282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6688098ee0 con 0x7f66880be9c0 2023-10-03T19:19:39.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.052+0000 7f66867fc640 1 -- 172.21.15.45:0/2859067282 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v96) v1 ==== 170+0+0 (secure 0 0 0) 0x7f66800f30d0 con 0x7f66880be9c0 2023-10-03T19:19:39.054 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-10-03T19:19:39.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.064+0000 7f668fccb640 1 -- 172.21.15.45:0/2859067282 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6674066280 msgr2=0x7f6674068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:39.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.064+0000 7f668fccb640 1 --2- 172.21.15.45:0/2859067282 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6674066280 0x7f6674068730 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f66880a67f0 tx=0x7f667c009040 comp rx=0 tx=0).stop 2023-10-03T19:19:39.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.064+0000 7f668fccb640 1 -- 172.21.15.45:0/2859067282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66880be9c0 msgr2=0x7f66880bab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:39.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.064+0000 7f668fccb640 1 --2- 172.21.15.45:0/2859067282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66880be9c0 0x7f66880bab60 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f668001df50 tx=0x7f668001e0e0 comp rx=0 tx=0).stop 2023-10-03T19:19:39.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.068+0000 7f668fccb640 1 -- 172.21.15.45:0/2859067282 shutdown_connections 2023-10-03T19:19:39.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.068+0000 7f668fccb640 1 --2- 172.21.15.45:0/2859067282 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6674066280 0x7f6674068730 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:39.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.068+0000 7f668fccb640 1 --2- 172.21.15.45:0/2859067282 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f668814bf60 0x7f66881e3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:39.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.068+0000 7f668fccb640 1 --2- 172.21.15.45:0/2859067282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f668814bb00 0x7f66881e3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:39.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.068+0000 7f668fccb640 1 --2- 172.21.15.45:0/2859067282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66880be9c0 0x7f66880bab60 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:39.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.068+0000 7f668fccb640 1 -- 172.21.15.45:0/2859067282 >> 172.21.15.45:0/2859067282 conn(0x7f66880c2200 msgr2=0x7f66880c0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:39.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.068+0000 7f668fccb640 1 -- 172.21.15.45:0/2859067282 shutdown_connections 2023-10-03T19:19:39.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.068+0000 7f668fccb640 1 -- 172.21.15.45:0/2859067282 wait complete. 2023-10-03T19:19:39.099 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-03T19:19:39.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.212+0000 7f3f54731640 1 Processor -- start 2023-10-03T19:19:39.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.212+0000 7f3f54731640 1 -- start start 2023-10-03T19:19:39.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f54731640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f4c06ee50 0x7f3f4c1563a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:39.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f54731640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f4c06f650 con 0x7f3f4c06cc20 2023-10-03T19:19:39.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f54731640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f4c06f3b0 con 0x7f3f4c06c410 2023-10-03T19:19:39.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f54731640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c14b680 con 0x7f3f4c06ee50 2023-10-03T19:19:39.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f51ccc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3f4c06cc20 0x7f3f4c147d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39698/0 (socket says 172.21.15.45:39698) 2023-10-03T19:19:39.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f51ccc640 1 -- 172.21.15.45:0/965324896 learned_addr learned my addr 172.21.15.45:0/965324896 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:39.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f52cce640 1 --2- 172.21.15.45:0/965324896 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f4c06ee50 0x7f3f4c1563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:39.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f514cb640 1 -- 172.21.15.45:0/965324896 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3557160729 0 0) 0x7f3f4c06f650 con 0x7f3f4c06cc20 2023-10-03T19:19:39.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f514cb640 1 -- 172.21.15.45:0/965324896 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f38003530 con 0x7f3f4c06cc20 2023-10-03T19:19:39.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f514cb640 1 -- 172.21.15.45:0/965324896 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2696298154 0 0) 0x7f3f38003530 con 0x7f3f4c06cc20 2023-10-03T19:19:39.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f514cb640 1 -- 172.21.15.45:0/965324896 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f4c06ee50 msgr2=0x7f3f4c1563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:39.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f514cb640 1 --2- 172.21.15.45:0/965324896 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f4c06ee50 0x7f3f4c1563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:39.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f514cb640 1 -- 172.21.15.45:0/965324896 >> v1:172.21.15.79:6789/0 conn(0x7f3f4c06c410 legacy=0x7f3f4c0bc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:39.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f514cb640 1 -- 172.21.15.45:0/965324896 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4c14b960 con 0x7f3f4c06cc20 2023-10-03T19:19:39.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f514cb640 1 -- 172.21.15.45:0/965324896 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f3f3c001680 con 0x7f3f4c06cc20 2023-10-03T19:19:39.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f514cb640 1 -- 172.21.15.45:0/965324896 >> v1:172.21.15.45:6789/0 conn(0x7f3f4c06cc20 legacy=0x7f3f4c147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:39.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f514cb640 1 --2- 172.21.15.45:0/965324896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f380039b0 0x7f3f38003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:39.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f514cb640 1 --2- 172.21.15.45:0/965324896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f380047d0 0x7f3f38004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:39.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f514cb640 1 --2- 172.21.15.45:0/965324896 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f4c06ee50 0x7f3f38005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:39.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f514cb640 1 -- 172.21.15.45:0/965324896 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c14b680 con 0x7f3f380039b0 2023-10-03T19:19:39.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f514cb640 1 -- 172.21.15.45:0/965324896 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3800cb50 con 0x7f3f380047d0 2023-10-03T19:19:39.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f514cb640 1 -- 172.21.15.45:0/965324896 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f380059e0 con 0x7f3f4c06ee50 2023-10-03T19:19:39.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f524cd640 1 --2- 172.21.15.45:0/965324896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f380039b0 0x7f3f38003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:39.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f51ccc640 1 --2- 172.21.15.45:0/965324896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f380047d0 0x7f3f38004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:39.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f52cce640 1 --2- 172.21.15.45:0/965324896 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f4c06ee50 0x7f3f38005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:39.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f524cd640 1 -- 172.21.15.45:0/965324896 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f4c06ee50 msgr2=0x7f3f38005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:39.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f524cd640 1 --2- 172.21.15.45:0/965324896 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f4c06ee50 0x7f3f38005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:39.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f524cd640 1 -- 172.21.15.45:0/965324896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f380047d0 msgr2=0x7f3f38004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:39.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f524cd640 1 --2- 172.21.15.45:0/965324896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f380047d0 0x7f3f38004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:39.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f524cd640 1 -- 172.21.15.45:0/965324896 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f38003530 con 0x7f3f380039b0 2023-10-03T19:19:39.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f51ccc640 1 --2- 172.21.15.45:0/965324896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f380047d0 0x7f3f38004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:19:39.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f524cd640 1 --2- 172.21.15.45:0/965324896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f380039b0 0x7f3f38003dc0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f3f48001780 tx=0x7f3f4801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60355afe1cfdf25a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:39.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f514cb640 1 -- 172.21.15.45:0/965324896 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f480052d0 con 0x7f3f380039b0 2023-10-03T19:19:39.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f514cb640 1 -- 172.21.15.45:0/965324896 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f480a7050 con 0x7f3f380039b0 2023-10-03T19:19:39.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.216+0000 7f3f514cb640 1 -- 172.21.15.45:0/965324896 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f48003600 con 0x7f3f380039b0 2023-10-03T19:19:39.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f54731640 1 -- 172.21.15.45:0/965324896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f380039b0 msgr2=0x7f3f38003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:39.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f54731640 1 --2- 172.21.15.45:0/965324896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f380039b0 0x7f3f38003dc0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f3f48001780 tx=0x7f3f4801c400 comp rx=0 tx=0).stop 2023-10-03T19:19:39.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f52cce640 1 -- 172.21.15.45:0/965324896 reap_dead start 2023-10-03T19:19:39.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f54731640 1 -- 172.21.15.45:0/965324896 shutdown_connections 2023-10-03T19:19:39.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f54731640 1 -- 172.21.15.45:0/965324896 >> 172.21.15.45:0/965324896 conn(0x7f3f4c0a20d0 msgr2=0x7f3f4c0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:39.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f54731640 1 -- 172.21.15.45:0/965324896 shutdown_connections 2023-10-03T19:19:39.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f54731640 1 -- 172.21.15.45:0/965324896 wait complete. 2023-10-03T19:19:39.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f54731640 1 Processor -- start 2023-10-03T19:19:39.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f54731640 1 -- start start 2023-10-03T19:19:39.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f54731640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f380039b0 0x7f3f4c0bee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:39.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f54731640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f4c1e2780 0x7f3f4c0bf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:39.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f54731640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f4c139190 0x7f3f4c139a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:39.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f54731640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c1e2bb0 con 0x7f3f380039b0 2023-10-03T19:19:39.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f54731640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c0be0b0 con 0x7f3f4c139190 2023-10-03T19:19:39.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f54731640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c0be390 con 0x7f3f4c1e2780 2023-10-03T19:19:39.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f524cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f380039b0 0x7f3f4c0bee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:39.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f524cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f380039b0 0x7f3f4c0bee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47624/0 (socket says 172.21.15.45:47624) 2023-10-03T19:19:39.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f524cd640 1 -- 172.21.15.45:0/3288516903 learned_addr learned my addr 172.21.15.45:0/3288516903 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:39.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f51ccc640 1 --2- 172.21.15.45:0/3288516903 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f4c1e2780 0x7f3f4c0bf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:39.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f52cce640 1 --2- 172.21.15.45:0/3288516903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f4c139190 0x7f3f4c139a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:39.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f524cd640 1 -- 172.21.15.45:0/3288516903 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f4c1e2780 msgr2=0x7f3f4c0bf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:39.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f524cd640 1 --2- 172.21.15.45:0/3288516903 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f4c1e2780 0x7f3f4c0bf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:39.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f524cd640 1 -- 172.21.15.45:0/3288516903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f4c139190 msgr2=0x7f3f4c139a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:39.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f524cd640 1 --2- 172.21.15.45:0/3288516903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f4c139190 0x7f3f4c139a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:39.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f524cd640 1 -- 172.21.15.45:0/3288516903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4c06c970 con 0x7f3f380039b0 2023-10-03T19:19:39.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f524cd640 1 --2- 172.21.15.45:0/3288516903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f380039b0 0x7f3f4c0bee70 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f3f48005040 tx=0x7f3f38005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:39.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f42ffd640 1 -- 172.21.15.45:0/3288516903 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f48007180 con 0x7f3f380039b0 2023-10-03T19:19:39.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f42ffd640 1 -- 172.21.15.45:0/3288516903 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f480072e0 con 0x7f3f380039b0 2023-10-03T19:19:39.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f54731640 1 -- 172.21.15.45:0/3288516903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f4c06c7e0 con 0x7f3f380039b0 2023-10-03T19:19:39.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f42ffd640 1 -- 172.21.15.45:0/3288516903 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f48007670 con 0x7f3f380039b0 2023-10-03T19:19:39.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.220+0000 7f3f54731640 1 -- 172.21.15.45:0/3288516903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f4c0ba6c0 con 0x7f3f380039b0 2023-10-03T19:19:39.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.224+0000 7f3f54731640 1 -- 172.21.15.45:0/3288516903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f4c04de80 con 0x7f3f380039b0 2023-10-03T19:19:39.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.224+0000 7f3f42ffd640 1 -- 172.21.15.45:0/3288516903 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3f480067e0 con 0x7f3f380039b0 2023-10-03T19:19:39.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.224+0000 7f3f42ffd640 1 --2- 172.21.15.45:0/3288516903 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3f30066280 0x7f3f30068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:39.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.224+0000 7f3f42ffd640 1 -- 172.21.15.45:0/3288516903 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f3f4811e910 con 0x7f3f380039b0 2023-10-03T19:19:39.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.224+0000 7f3f51ccc640 1 --2- 172.21.15.45:0/3288516903 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3f30066280 0x7f3f30068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:39.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.224+0000 7f3f51ccc640 1 --2- 172.21.15.45:0/3288516903 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3f30066280 0x7f3f30068730 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c1e05c0 tx=0x7f3f3c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:39.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.228+0000 7f3f42ffd640 1 -- 172.21.15.45:0/3288516903 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3f480ef860 con 0x7f3f380039b0 2023-10-03T19:19:39.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.412+0000 7f3f54731640 1 -- 172.21.15.45:0/3288516903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3f4c14a0f0 con 0x7f3f380039b0 2023-10-03T19:19:39.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.424+0000 7f3f42ffd640 1 -- 172.21.15.45:0/3288516903 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v48) v1 ==== 174+0+0 (secure 0 0 0) 0x7f3f480ef3f0 con 0x7f3f380039b0 2023-10-03T19:19:39.438 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 15 and data pool 16 2023-10-03T19:19:39.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.440+0000 7f3f40ff9640 1 -- 172.21.15.45:0/3288516903 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3f30066280 msgr2=0x7f3f30068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:39.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.440+0000 7f3f40ff9640 1 --2- 172.21.15.45:0/3288516903 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3f30066280 0x7f3f30068730 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c1e05c0 tx=0x7f3f3c009040 comp rx=0 tx=0).stop 2023-10-03T19:19:39.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.440+0000 7f3f40ff9640 1 -- 172.21.15.45:0/3288516903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f380039b0 msgr2=0x7f3f4c0bee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:39.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.440+0000 7f3f40ff9640 1 --2- 172.21.15.45:0/3288516903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f380039b0 0x7f3f4c0bee70 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f3f48005040 tx=0x7f3f38005800 comp rx=0 tx=0).stop 2023-10-03T19:19:39.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.440+0000 7f3f40ff9640 1 -- 172.21.15.45:0/3288516903 shutdown_connections 2023-10-03T19:19:39.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.440+0000 7f3f40ff9640 1 --2- 172.21.15.45:0/3288516903 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3f30066280 0x7f3f30068730 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:39.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.440+0000 7f3f40ff9640 1 --2- 172.21.15.45:0/3288516903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f4c139190 0x7f3f4c139a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:39.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.440+0000 7f3f40ff9640 1 --2- 172.21.15.45:0/3288516903 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f4c1e2780 0x7f3f4c0bf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:39.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.440+0000 7f3f40ff9640 1 --2- 172.21.15.45:0/3288516903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f380039b0 0x7f3f4c0bee70 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:39.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.440+0000 7f3f40ff9640 1 -- 172.21.15.45:0/3288516903 >> 172.21.15.45:0/3288516903 conn(0x7f3f4c0a20d0 msgr2=0x7f3f4c0bacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:39.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.440+0000 7f3f40ff9640 1 -- 172.21.15.45:0/3288516903 shutdown_connections 2023-10-03T19:19:39.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.440+0000 7f3f40ff9640 1 -- 172.21.15.45:0/3288516903 wait complete. 2023-10-03T19:19:39.469 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:19:39.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.584+0000 7f0139234640 1 Processor -- start 2023-10-03T19:19:39.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.584+0000 7f0139234640 1 -- start start 2023-10-03T19:19:39.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.584+0000 7f0139234640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f01340be170 0x7f0134149990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:39.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.584+0000 7f0139234640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f01340b6320 0x7f0134149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:39.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.584+0000 7f0139234640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f013406dc30 con 0x7f013406bfb0 2023-10-03T19:19:39.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.584+0000 7f0139234640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01340b6ae0 con 0x7f01340be170 2023-10-03T19:19:39.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.584+0000 7f0139234640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f013414c690 con 0x7f01340b6320 2023-10-03T19:19:39.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.584+0000 7f0132d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f01340be170 0x7f0134149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:39.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.584+0000 7f0132d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f01340be170 0x7f0134149990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47632/0 (socket says 172.21.15.45:47632) 2023-10-03T19:19:39.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.584+0000 7f0132d9d640 1 -- 172.21.15.45:0/1728011230 learned_addr learned my addr 172.21.15.45:0/1728011230 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:39.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.584+0000 7f013359e640 1 --2- 172.21.15.45:0/1728011230 >> v2:172.21.15.79:3300/0 conn(0x7f01340b6320 0x7f0134149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:39.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.584+0000 7f0132d9d640 1 -- 172.21.15.45:0/1728011230 >> v2:172.21.15.79:3300/0 conn(0x7f01340b6320 msgr2=0x7f0134149ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:39.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.584+0000 7f0132d9d640 1 --2- 172.21.15.45:0/1728011230 >> v2:172.21.15.79:3300/0 conn(0x7f01340b6320 0x7f0134149ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:39.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.584+0000 7f0132d9d640 1 -- 172.21.15.45:0/1728011230 >> v1:172.21.15.79:6789/0 conn(0x7f013406bfb0 legacy=0x7f013414ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:39.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.584+0000 7f0132d9d640 1 -- 172.21.15.45:0/1728011230 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013406c560 con 0x7f01340be170 2023-10-03T19:19:39.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.584+0000 7f0132d9d640 1 --2- 172.21.15.45:0/1728011230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01340be170 0x7f0134149990 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f013406c3f0 tx=0x7f011c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934a14e2fc1c953e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:39.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.584+0000 7f013259c640 1 -- 172.21.15.45:0/1728011230 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c0ab650 con 0x7f01340be170 2023-10-03T19:19:39.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f013259c640 1 -- 172.21.15.45:0/1728011230 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011c0ab7b0 con 0x7f01340be170 2023-10-03T19:19:39.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f013259c640 1 -- 172.21.15.45:0/1728011230 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c0abb40 con 0x7f01340be170 2023-10-03T19:19:39.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f0139234640 1 -- 172.21.15.45:0/1728011230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01340be170 msgr2=0x7f0134149990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:39.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f0139234640 1 --2- 172.21.15.45:0/1728011230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01340be170 0x7f0134149990 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f013406c3f0 tx=0x7f011c01c490 comp rx=0 tx=0).stop 2023-10-03T19:19:39.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f0139234640 1 -- 172.21.15.45:0/1728011230 shutdown_connections 2023-10-03T19:19:39.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f0139234640 1 --2- 172.21.15.45:0/1728011230 >> v2:172.21.15.79:3300/0 conn(0x7f01340b6320 0x7f0134149ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:39.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f0139234640 1 --2- 172.21.15.45:0/1728011230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01340be170 0x7f0134149990 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:39.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f0139234640 1 -- 172.21.15.45:0/1728011230 >> 172.21.15.45:0/1728011230 conn(0x7f01340c1a10 msgr2=0x7f01340bd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:39.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f0139234640 1 -- 172.21.15.45:0/1728011230 shutdown_connections 2023-10-03T19:19:39.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f0139234640 1 -- 172.21.15.45:0/1728011230 wait complete. 2023-10-03T19:19:39.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f0139234640 1 Processor -- start 2023-10-03T19:19:39.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f0139234640 1 -- start start 2023-10-03T19:19:39.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f0139234640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f013406bfb0 0x7f01340c06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:39.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f0139234640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01340b6320 0x7f01340bce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:39.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f0139234640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01340be170 0x7f013406f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:39.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f0139234640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01341eab50 con 0x7f013406bfb0 2023-10-03T19:19:39.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f0139234640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0134156b60 con 0x7f01340be170 2023-10-03T19:19:39.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f0139234640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01340bd390 con 0x7f01340b6320 2023-10-03T19:19:39.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f0132d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f013406bfb0 0x7f01340c06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:39.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f0132d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f013406bfb0 0x7f01340c06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47638/0 (socket says 172.21.15.45:47638) 2023-10-03T19:19:39.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f0132d9d640 1 -- 172.21.15.45:0/3103501172 learned_addr learned my addr 172.21.15.45:0/3103501172 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:39.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f013359e640 1 --2- 172.21.15.45:0/3103501172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01340be170 0x7f013406f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:39.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f012bfff640 1 --2- 172.21.15.45:0/3103501172 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01340b6320 0x7f01340bce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:39.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f0132d9d640 1 -- 172.21.15.45:0/3103501172 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01340b6320 msgr2=0x7f01340bce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:39.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f0132d9d640 1 --2- 172.21.15.45:0/3103501172 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01340b6320 0x7f01340bce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:39.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f0132d9d640 1 -- 172.21.15.45:0/3103501172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01340be170 msgr2=0x7f013406f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:39.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f0132d9d640 1 --2- 172.21.15.45:0/3103501172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01340be170 0x7f013406f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:39.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f0132d9d640 1 -- 172.21.15.45:0/3103501172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f011c0094d0 con 0x7f013406bfb0 2023-10-03T19:19:39.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f0132d9d640 1 --2- 172.21.15.45:0/3103501172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f013406bfb0 0x7f01340c06b0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f011c0ad040 tx=0x7f011c01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:39.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f012b7fe640 1 -- 172.21.15.45:0/3103501172 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c0b48c0 con 0x7f013406bfb0 2023-10-03T19:19:39.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f012b7fe640 1 -- 172.21.15.45:0/3103501172 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011c0b4a20 con 0x7f013406bfb0 2023-10-03T19:19:39.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f0139234640 1 -- 172.21.15.45:0/3103501172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01340bb090 con 0x7f013406bfb0 2023-10-03T19:19:39.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f012b7fe640 1 -- 172.21.15.45:0/3103501172 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c0b4dd0 con 0x7f013406bfb0 2023-10-03T19:19:39.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.588+0000 7f0139234640 1 -- 172.21.15.45:0/3103501172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0134150a70 con 0x7f013406bfb0 2023-10-03T19:19:39.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.592+0000 7f0139234640 1 -- 172.21.15.45:0/3103501172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01340c0bf0 con 0x7f013406bfb0 2023-10-03T19:19:39.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.592+0000 7f012b7fe640 1 -- 172.21.15.45:0/3103501172 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f011c0b3380 con 0x7f013406bfb0 2023-10-03T19:19:39.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.592+0000 7f012b7fe640 1 --2- 172.21.15.45:0/3103501172 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0114066280 0x7f0114068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:39.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.592+0000 7f012b7fe640 1 -- 172.21.15.45:0/3103501172 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f011c11e750 con 0x7f013406bfb0 2023-10-03T19:19:39.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.592+0000 7f012bfff640 1 --2- 172.21.15.45:0/3103501172 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0114066280 0x7f0114068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:39.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.592+0000 7f012bfff640 1 --2- 172.21.15.45:0/3103501172 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0114066280 0x7f0114068730 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f01340bd650 tx=0x7f0124009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:39.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.596+0000 7f012b7fe640 1 -- 172.21.15.45:0/3103501172 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f011c0ebbf0 con 0x7f013406bfb0 2023-10-03T19:19:39.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.748+0000 7f0139234640 1 -- 172.21.15.45:0/3103501172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01340bb220 con 0x7f013406bfb0 2023-10-03T19:19:39.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.748+0000 7f012b7fe640 1 -- 172.21.15.45:0/3103501172 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+18247 (secure 0 0 0) 0x7f011c0ef210 con 0x7f013406bfb0 2023-10-03T19:19:39.752 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:19:39.753 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":97,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:19:39.419036+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:19:37.111278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-10-03T19:19:38.418651+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:19:39.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.752+0000 7f0139234640 1 -- 172.21.15.45:0/3103501172 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0114066280 msgr2=0x7f0114068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:39.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.752+0000 7f0139234640 1 --2- 172.21.15.45:0/3103501172 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0114066280 0x7f0114068730 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f01340bd650 tx=0x7f0124009040 comp rx=0 tx=0).stop 2023-10-03T19:19:39.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.752+0000 7f0139234640 1 -- 172.21.15.45:0/3103501172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f013406bfb0 msgr2=0x7f01340c06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:39.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.752+0000 7f0139234640 1 --2- 172.21.15.45:0/3103501172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f013406bfb0 0x7f01340c06b0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f011c0ad040 tx=0x7f011c01acd0 comp rx=0 tx=0).stop 2023-10-03T19:19:39.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.752+0000 7f0139234640 1 -- 172.21.15.45:0/3103501172 shutdown_connections 2023-10-03T19:19:39.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.752+0000 7f0139234640 1 --2- 172.21.15.45:0/3103501172 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0114066280 0x7f0114068730 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:39.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.752+0000 7f0139234640 1 --2- 172.21.15.45:0/3103501172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01340be170 0x7f013406f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:39.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.752+0000 7f0139234640 1 --2- 172.21.15.45:0/3103501172 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01340b6320 0x7f01340bce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:39.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.752+0000 7f0139234640 1 --2- 172.21.15.45:0/3103501172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f013406bfb0 0x7f01340c06b0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:39.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.752+0000 7f0139234640 1 -- 172.21.15.45:0/3103501172 >> 172.21.15.45:0/3103501172 conn(0x7f01340c1a10 msgr2=0x7f013414ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:39.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.752+0000 7f0139234640 1 -- 172.21.15.45:0/3103501172 shutdown_connections 2023-10-03T19:19:39.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.752+0000 7f0139234640 1 -- 172.21.15.45:0/3103501172 wait complete. 2023-10-03T19:19:39.770 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:19:39.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.892+0000 7f485352b640 1 Processor -- start 2023-10-03T19:19:39.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.892+0000 7f485352b640 1 -- start start 2023-10-03T19:19:39.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.892+0000 7f485352b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f484c06f170 0x7f484c150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:39.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.892+0000 7f485352b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f484c0bc8b0 0x7f484c14ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:39.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.892+0000 7f485352b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f484c06cac0 con 0x7f484c06d170 2023-10-03T19:19:39.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.892+0000 7f485352b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f484c0720d0 con 0x7f484c06f170 2023-10-03T19:19:39.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.892+0000 7f485352b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f484c0a5ab0 con 0x7f484c0bc8b0 2023-10-03T19:19:39.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.892+0000 7f48512c7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f484c06f170 0x7f484c150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:39.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.892+0000 7f48512c7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f484c06f170 0x7f484c150190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47652/0 (socket says 172.21.15.45:47652) 2023-10-03T19:19:39.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.892+0000 7f48512c7640 1 -- 172.21.15.45:0/537047156 learned_addr learned my addr 172.21.15.45:0/537047156 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:39.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.892+0000 7f4850ac6640 1 --2- 172.21.15.45:0/537047156 >> v2:172.21.15.79:3300/0 conn(0x7f484c0bc8b0 0x7f484c14ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:39.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.892+0000 7f48512c7640 1 -- 172.21.15.45:0/537047156 >> v2:172.21.15.79:3300/0 conn(0x7f484c0bc8b0 msgr2=0x7f484c14ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:39.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.892+0000 7f48512c7640 1 --2- 172.21.15.45:0/537047156 >> v2:172.21.15.79:3300/0 conn(0x7f484c0bc8b0 0x7f484c14ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:39.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.892+0000 7f48512c7640 1 -- 172.21.15.45:0/537047156 >> v1:172.21.15.79:6789/0 conn(0x7f484c06d170 legacy=0x7f484c14cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:39.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.892+0000 7f48512c7640 1 -- 172.21.15.45:0/537047156 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484c06cd00 con 0x7f484c06f170 2023-10-03T19:19:39.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.892+0000 7f48512c7640 1 --2- 172.21.15.45:0/537047156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f484c06f170 0x7f484c150190 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f484c06e9c0 tx=0x7f484801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c042746b969434 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:39.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f4843fff640 1 -- 172.21.15.45:0/537047156 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48480ac630 con 0x7f484c06f170 2023-10-03T19:19:39.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f4843fff640 1 -- 172.21.15.45:0/537047156 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48480ac790 con 0x7f484c06f170 2023-10-03T19:19:39.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f4843fff640 1 -- 172.21.15.45:0/537047156 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48480acb20 con 0x7f484c06f170 2023-10-03T19:19:39.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f485352b640 1 -- 172.21.15.45:0/537047156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f484c06f170 msgr2=0x7f484c150190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:39.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f485352b640 1 --2- 172.21.15.45:0/537047156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f484c06f170 0x7f484c150190 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f484c06e9c0 tx=0x7f484801c480 comp rx=0 tx=0).stop 2023-10-03T19:19:39.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f485352b640 1 -- 172.21.15.45:0/537047156 shutdown_connections 2023-10-03T19:19:39.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f485352b640 1 --2- 172.21.15.45:0/537047156 >> v2:172.21.15.79:3300/0 conn(0x7f484c0bc8b0 0x7f484c14ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:39.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f485352b640 1 --2- 172.21.15.45:0/537047156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f484c06f170 0x7f484c150190 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:39.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f485352b640 1 -- 172.21.15.45:0/537047156 >> 172.21.15.45:0/537047156 conn(0x7f484c0bcf50 msgr2=0x7f484c0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:39.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f485352b640 1 -- 172.21.15.45:0/537047156 shutdown_connections 2023-10-03T19:19:39.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f485352b640 1 -- 172.21.15.45:0/537047156 wait complete. 2023-10-03T19:19:39.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f485352b640 1 Processor -- start 2023-10-03T19:19:39.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f485352b640 1 -- start start 2023-10-03T19:19:39.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f485352b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f484c06d170 0x7f484c14aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:39.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f485352b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f484c06f170 0x7f484c1eadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:39.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f485352b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f484c0bc8b0 0x7f484c1494d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:39.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f485352b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484c1eb300 con 0x7f484c0bc8b0 2023-10-03T19:19:39.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f485352b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484c145000 con 0x7f484c06d170 2023-10-03T19:19:39.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f485352b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484c14a660 con 0x7f484c06f170 2023-10-03T19:19:39.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f4851ac8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f484c0bc8b0 0x7f484c1494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:39.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f4851ac8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f484c0bc8b0 0x7f484c1494d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47656/0 (socket says 172.21.15.45:47656) 2023-10-03T19:19:39.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f4851ac8640 1 -- 172.21.15.45:0/1165779478 learned_addr learned my addr 172.21.15.45:0/1165779478 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:39.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f48512c7640 1 --2- 172.21.15.45:0/1165779478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f484c06d170 0x7f484c14aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:39.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f4850ac6640 1 --2- 172.21.15.45:0/1165779478 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f484c06f170 0x7f484c1eadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:39.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f4851ac8640 1 -- 172.21.15.45:0/1165779478 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f484c06f170 msgr2=0x7f484c1eadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:39.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f4851ac8640 1 --2- 172.21.15.45:0/1165779478 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f484c06f170 0x7f484c1eadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:39.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f4851ac8640 1 -- 172.21.15.45:0/1165779478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f484c06d170 msgr2=0x7f484c14aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:39.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f4851ac8640 1 --2- 172.21.15.45:0/1165779478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f484c06d170 0x7f484c14aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:39.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f4851ac8640 1 -- 172.21.15.45:0/1165779478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48480094d0 con 0x7f484c0bc8b0 2023-10-03T19:19:39.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f48512c7640 1 --2- 172.21.15.45:0/1165779478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f484c06d170 0x7f484c14aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:39.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f4851ac8640 1 --2- 172.21.15.45:0/1165779478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f484c0bc8b0 0x7f484c1494d0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f484400b9a0 tx=0x7f484400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:39.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f4841ffb640 1 -- 172.21.15.45:0/1165779478 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484400cba0 con 0x7f484c0bc8b0 2023-10-03T19:19:39.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f4841ffb640 1 -- 172.21.15.45:0/1165779478 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484400cd00 con 0x7f484c0bc8b0 2023-10-03T19:19:39.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f485352b640 1 -- 172.21.15.45:0/1165779478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f484c06f6d0 con 0x7f484c0bc8b0 2023-10-03T19:19:39.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f4841ffb640 1 -- 172.21.15.45:0/1165779478 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4844014680 con 0x7f484c0bc8b0 2023-10-03T19:19:39.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.896+0000 7f485352b640 1 -- 172.21.15.45:0/1165779478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f484c06f540 con 0x7f484c0bc8b0 2023-10-03T19:19:39.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.900+0000 7f485352b640 1 -- 172.21.15.45:0/1165779478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f484c159670 con 0x7f484c0bc8b0 2023-10-03T19:19:39.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.900+0000 7f4841ffb640 1 -- 172.21.15.45:0/1165779478 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f484401d3b0 con 0x7f484c0bc8b0 2023-10-03T19:19:39.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.900+0000 7f4841ffb640 1 --2- 172.21.15.45:0/1165779478 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f48300662b0 0x7f4830068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:39.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.900+0000 7f4841ffb640 1 -- 172.21.15.45:0/1165779478 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4844083ae0 con 0x7f484c0bc8b0 2023-10-03T19:19:39.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.900+0000 7f48512c7640 1 --2- 172.21.15.45:0/1165779478 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f48300662b0 0x7f4830068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:39.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.900+0000 7f48512c7640 1 --2- 172.21.15.45:0/1165779478 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f48300662b0 0x7f4830068760 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f48480ae000 tx=0x7f4848008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:39.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:39.904+0000 7f4841ffb640 1 -- 172.21.15.45:0/1165779478 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4844050f50 con 0x7f484c0bc8b0 2023-10-03T19:19:40.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.052+0000 7f485352b640 1 -- 172.21.15.45:0/1165779478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f484c06d660 con 0x7f484c0bc8b0 2023-10-03T19:19:40.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.056+0000 7f4841ffb640 1 -- 172.21.15.45:0/1165779478 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+18247 (secure 0 0 0) 0x7f4844054570 con 0x7f484c0bc8b0 2023-10-03T19:19:40.059 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:19:40.059 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":97,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:19:39.419036+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:19:37.111278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-10-03T19:19:38.418651+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:19:40.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.056+0000 7f485352b640 1 -- 172.21.15.45:0/1165779478 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f48300662b0 msgr2=0x7f4830068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:40.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.056+0000 7f485352b640 1 --2- 172.21.15.45:0/1165779478 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f48300662b0 0x7f4830068760 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f48480ae000 tx=0x7f4848008040 comp rx=0 tx=0).stop 2023-10-03T19:19:40.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.056+0000 7f485352b640 1 -- 172.21.15.45:0/1165779478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f484c0bc8b0 msgr2=0x7f484c1494d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:40.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.056+0000 7f485352b640 1 --2- 172.21.15.45:0/1165779478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f484c0bc8b0 0x7f484c1494d0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f484400b9a0 tx=0x7f484400be60 comp rx=0 tx=0).stop 2023-10-03T19:19:40.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.056+0000 7f485352b640 1 -- 172.21.15.45:0/1165779478 shutdown_connections 2023-10-03T19:19:40.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.056+0000 7f485352b640 1 --2- 172.21.15.45:0/1165779478 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f48300662b0 0x7f4830068760 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:40.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.056+0000 7f485352b640 1 --2- 172.21.15.45:0/1165779478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f484c0bc8b0 0x7f484c1494d0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:40.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.056+0000 7f485352b640 1 --2- 172.21.15.45:0/1165779478 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f484c06f170 0x7f484c1eadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:40.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.056+0000 7f485352b640 1 --2- 172.21.15.45:0/1165779478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f484c06d170 0x7f484c14aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:40.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.056+0000 7f485352b640 1 -- 172.21.15.45:0/1165779478 >> 172.21.15.45:0/1165779478 conn(0x7f484c0bcf50 msgr2=0x7f484c0bc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:40.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.056+0000 7f485352b640 1 -- 172.21.15.45:0/1165779478 shutdown_connections 2023-10-03T19:19:40.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.056+0000 7f485352b640 1 -- 172.21.15.45:0/1165779478 wait complete. 2023-10-03T19:19:40.076 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-03T19:19:40.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.192+0000 7faae7c59640 1 Processor -- start 2023-10-03T19:19:40.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.192+0000 7faae7c59640 1 -- start start 2023-10-03T19:19:40.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.192+0000 7faae7c59640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faae00712c0 0x7faae00bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:40.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.192+0000 7faae7c59640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faae006c760 0x7faae00bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:40.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.192+0000 7faae7c59640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faae006c2d0 con 0x7faae006d560 2023-10-03T19:19:40.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.192+0000 7faae7c59640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae0150610 con 0x7faae00712c0 2023-10-03T19:19:40.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.192+0000 7faae7c59640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae01508b0 con 0x7faae006c760 2023-10-03T19:19:40.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.192+0000 7faae59f5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faae00712c0 0x7faae00bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:40.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.192+0000 7faae51f4640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7faae006d560 0x7faae00a53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39700/0 (socket says 172.21.15.45:39700) 2023-10-03T19:19:40.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.192+0000 7faae51f4640 1 -- 172.21.15.45:0/3055700257 learned_addr learned my addr 172.21.15.45:0/3055700257 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:40.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.192+0000 7faae61f6640 1 --2- 172.21.15.45:0/3055700257 >> v2:172.21.15.79:3300/0 conn(0x7faae006c760 0x7faae00bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:40.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.192+0000 7faae59f5640 1 -- 172.21.15.45:0/3055700257 >> v2:172.21.15.79:3300/0 conn(0x7faae006c760 msgr2=0x7faae00bd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:40.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.192+0000 7faae59f5640 1 --2- 172.21.15.45:0/3055700257 >> v2:172.21.15.79:3300/0 conn(0x7faae006c760 0x7faae00bd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:40.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.192+0000 7faae59f5640 1 -- 172.21.15.45:0/3055700257 >> v1:172.21.15.45:6789/0 conn(0x7faae006d560 legacy=0x7faae00a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:40.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.192+0000 7faae59f5640 1 -- 172.21.15.45:0/3055700257 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae006d2e0 con 0x7faae00712c0 2023-10-03T19:19:40.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.192+0000 7faae49f3640 1 -- 172.21.15.45:0/3055700257 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955933806 0 0) 0x7faae006c2d0 con 0x7faae006d560 2023-10-03T19:19:40.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.192+0000 7faae61f6640 1 --2- 172.21.15.45:0/3055700257 >> v2:172.21.15.79:3300/0 conn(0x7faae006c760 0x7faae00bd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:19:40.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.196+0000 7faae59f5640 1 --2- 172.21.15.45:0/3055700257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faae00712c0 0x7faae00bcbc0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7faae00c14e0 tx=0x7faad401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43958f3c9188a8e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.196+0000 7faae49f3640 1 -- 172.21.15.45:0/3055700257 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad40ac600 con 0x7faae00712c0 2023-10-03T19:19:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.196+0000 7faae49f3640 1 -- 172.21.15.45:0/3055700257 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad40a8050 con 0x7faae00712c0 2023-10-03T19:19:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.196+0000 7faae49f3640 1 -- 172.21.15.45:0/3055700257 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad40ac980 con 0x7faae00712c0 2023-10-03T19:19:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.196+0000 7faae7c59640 1 -- 172.21.15.45:0/3055700257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faae00712c0 msgr2=0x7faae00bcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.196+0000 7faae7c59640 1 --2- 172.21.15.45:0/3055700257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faae00712c0 0x7faae00bcbc0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7faae00c14e0 tx=0x7faad401c460 comp rx=0 tx=0).stop 2023-10-03T19:19:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.196+0000 7faae7c59640 1 -- 172.21.15.45:0/3055700257 shutdown_connections 2023-10-03T19:19:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.196+0000 7faae7c59640 1 --2- 172.21.15.45:0/3055700257 >> v2:172.21.15.79:3300/0 conn(0x7faae006c760 0x7faae00bd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.196+0000 7faae7c59640 1 --2- 172.21.15.45:0/3055700257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faae00712c0 0x7faae00bcbc0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.196+0000 7faae7c59640 1 -- 172.21.15.45:0/3055700257 >> 172.21.15.45:0/3055700257 conn(0x7faae00a20d0 msgr2=0x7faae00a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.196+0000 7faae7c59640 1 -- 172.21.15.45:0/3055700257 shutdown_connections 2023-10-03T19:19:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.196+0000 7faae7c59640 1 -- 172.21.15.45:0/3055700257 wait complete. 2023-10-03T19:19:40.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.196+0000 7faae7c59640 1 Processor -- start 2023-10-03T19:19:40.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.196+0000 7faae7c59640 1 -- start start 2023-10-03T19:19:40.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.196+0000 7faae7c59640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faae006c760 0x7faae014a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:40.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.196+0000 7faae7c59640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faae006d560 0x7faae0147b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:40.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.196+0000 7faae7c59640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faae00712c0 0x7faae014cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:40.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.196+0000 7faae7c59640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae006fff0 con 0x7faae006d560 2023-10-03T19:19:40.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.196+0000 7faae7c59640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae014b1c0 con 0x7faae006c760 2023-10-03T19:19:40.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.196+0000 7faae7c59640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae014b330 con 0x7faae00712c0 2023-10-03T19:19:40.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.196+0000 7faae51f4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faae006d560 0x7faae0147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:40.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.196+0000 7faae51f4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faae006d560 0x7faae0147b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47676/0 (socket says 172.21.15.45:47676) 2023-10-03T19:19:40.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.196+0000 7faae51f4640 1 -- 172.21.15.45:0/2051093575 learned_addr learned my addr 172.21.15.45:0/2051093575 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:40.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.196+0000 7faae61f6640 1 --2- 172.21.15.45:0/2051093575 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faae00712c0 0x7faae014cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:40.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.196+0000 7faae59f5640 1 --2- 172.21.15.45:0/2051093575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faae006c760 0x7faae014a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:40.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.200+0000 7faae51f4640 1 -- 172.21.15.45:0/2051093575 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faae00712c0 msgr2=0x7faae014cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:40.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.200+0000 7faae51f4640 1 --2- 172.21.15.45:0/2051093575 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faae00712c0 0x7faae014cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:40.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.200+0000 7faae51f4640 1 -- 172.21.15.45:0/2051093575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faae006c760 msgr2=0x7faae014a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:40.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.200+0000 7faae51f4640 1 --2- 172.21.15.45:0/2051093575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faae006c760 0x7faae014a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:40.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.200+0000 7faae51f4640 1 -- 172.21.15.45:0/2051093575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad4009420 con 0x7faae006d560 2023-10-03T19:19:40.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.200+0000 7faae61f6640 1 --2- 172.21.15.45:0/2051093575 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faae00712c0 0x7faae014cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:40.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.200+0000 7faae51f4640 1 --2- 172.21.15.45:0/2051093575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faae006d560 0x7faae0147b50 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7faadc00c520 tx=0x7faadc00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:40.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.200+0000 7faad27fc640 1 -- 172.21.15.45:0/2051093575 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faadc0074e0 con 0x7faae006d560 2023-10-03T19:19:40.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.200+0000 7faad27fc640 1 -- 172.21.15.45:0/2051093575 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faadc007640 con 0x7faae006d560 2023-10-03T19:19:40.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.200+0000 7faae7c59640 1 -- 172.21.15.45:0/2051093575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae00a6070 con 0x7faae006d560 2023-10-03T19:19:40.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.200+0000 7faad27fc640 1 -- 172.21.15.45:0/2051093575 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faadc0049f0 con 0x7faae006d560 2023-10-03T19:19:40.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.200+0000 7faae7c59640 1 -- 172.21.15.45:0/2051093575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae00a5ee0 con 0x7faae006d560 2023-10-03T19:19:40.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.200+0000 7faae7c59640 1 -- 172.21.15.45:0/2051093575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae01596f0 con 0x7faae006d560 2023-10-03T19:19:40.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.200+0000 7faad27fc640 1 -- 172.21.15.45:0/2051093575 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faadc004b50 con 0x7faae006d560 2023-10-03T19:19:40.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.200+0000 7faad27fc640 1 --2- 172.21.15.45:0/2051093575 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7faac4066280 0x7faac4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:40.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.200+0000 7faad27fc640 1 -- 172.21.15.45:0/2051093575 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faadc082e90 con 0x7faae006d560 2023-10-03T19:19:40.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.200+0000 7faae59f5640 1 --2- 172.21.15.45:0/2051093575 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7faac4066280 0x7faac4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:40.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.200+0000 7faae59f5640 1 --2- 172.21.15.45:0/2051093575 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7faac4066280 0x7faac4068730 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7faad40ae000 tx=0x7faad40a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:40.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.204+0000 7faad27fc640 1 -- 172.21.15.45:0/2051093575 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7faadc050450 con 0x7faae006d560 2023-10-03T19:19:40.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.392+0000 7faae7c59640 1 -- 172.21.15.45:0/2051093575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7faae00bca30 con 0x7faae006d560 2023-10-03T19:19:40.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.440+0000 7faad27fc640 1 -- 172.21.15.45:0/2051093575 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v49) v1 ==== 118+0+0 (secure 0 0 0) 0x7faadc018020 con 0x7faae006d560 2023-10-03T19:19:40.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.440+0000 7faae7c59640 1 -- 172.21.15.45:0/2051093575 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7faac4066280 msgr2=0x7faac4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:40.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.440+0000 7faae7c59640 1 --2- 172.21.15.45:0/2051093575 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7faac4066280 0x7faac4068730 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7faad40ae000 tx=0x7faad40a7000 comp rx=0 tx=0).stop 2023-10-03T19:19:40.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.440+0000 7faae7c59640 1 -- 172.21.15.45:0/2051093575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faae006d560 msgr2=0x7faae0147b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:40.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.440+0000 7faae7c59640 1 --2- 172.21.15.45:0/2051093575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faae006d560 0x7faae0147b50 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7faadc00c520 tx=0x7faadc00c9e0 comp rx=0 tx=0).stop 2023-10-03T19:19:40.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.440+0000 7faae7c59640 1 -- 172.21.15.45:0/2051093575 shutdown_connections 2023-10-03T19:19:40.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.440+0000 7faae7c59640 1 --2- 172.21.15.45:0/2051093575 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7faac4066280 0x7faac4068730 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:40.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.440+0000 7faae7c59640 1 --2- 172.21.15.45:0/2051093575 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faae00712c0 0x7faae014cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:40.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.440+0000 7faae7c59640 1 --2- 172.21.15.45:0/2051093575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faae006d560 0x7faae0147b50 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:40.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.440+0000 7faae7c59640 1 --2- 172.21.15.45:0/2051093575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faae006c760 0x7faae014a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:40.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.440+0000 7faae7c59640 1 -- 172.21.15.45:0/2051093575 >> 172.21.15.45:0/2051093575 conn(0x7faae00a20d0 msgr2=0x7faae00a53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:40.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.444+0000 7faae7c59640 1 -- 172.21.15.45:0/2051093575 shutdown_connections 2023-10-03T19:19:40.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.444+0000 7faae7c59640 1 -- 172.21.15.45:0/2051093575 wait complete. 2023-10-03T19:19:40.463 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-03T19:19:40.463 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-03T19:19:40.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.584+0000 7fbd1c982640 1 Processor -- start 2023-10-03T19:19:40.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.584+0000 7fbd1c982640 1 -- start start 2023-10-03T19:19:40.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.584+0000 7fbd1c982640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd1806f880 0x7fbd180a5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:40.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.584+0000 7fbd1c982640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbd1814f510 0x7fbd1814b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:40.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.584+0000 7fbd1c982640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd1814f080 con 0x7fbd180bd9f0 2023-10-03T19:19:40.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.584+0000 7fbd1c982640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd1806f3e0 con 0x7fbd1814f510 2023-10-03T19:19:40.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.584+0000 7fbd1c982640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd18070e90 con 0x7fbd1806f880 2023-10-03T19:19:40.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.584+0000 7fbd1659c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd1806f880 0x7fbd180a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:40.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.584+0000 7fbd15d9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbd1814f510 0x7fbd1814b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:40.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.584+0000 7fbd1659c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd1806f880 0x7fbd180a5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:54368/0 (socket says 172.21.15.45:54368) 2023-10-03T19:19:40.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.584+0000 7fbd1659c640 1 -- 172.21.15.45:0/1162141253 learned_addr learned my addr 172.21.15.45:0/1162141253 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:40.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.584+0000 7fbd1659c640 1 -- 172.21.15.45:0/1162141253 >> v2:172.21.15.79:3300/0 conn(0x7fbd1814f510 msgr2=0x7fbd1814b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:40.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.584+0000 7fbd1659c640 1 --2- 172.21.15.45:0/1162141253 >> v2:172.21.15.79:3300/0 conn(0x7fbd1814f510 0x7fbd1814b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:40.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.584+0000 7fbd1659c640 1 -- 172.21.15.45:0/1162141253 >> v1:172.21.15.79:6789/0 conn(0x7fbd180bd9f0 legacy=0x7fbd180badc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:40.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.584+0000 7fbd1659c640 1 -- 172.21.15.45:0/1162141253 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1814ea30 con 0x7fbd1806f880 2023-10-03T19:19:40.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.588+0000 7fbd1659c640 1 --2- 172.21.15.45:0/1162141253 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd1806f880 0x7fbd180a5940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbd08009870 tx=0x7fbd0801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d7c244f8c77cf06 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:40.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.588+0000 7fbd1559a640 1 -- 172.21.15.45:0/1162141253 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd080ab670 con 0x7fbd1806f880 2023-10-03T19:19:40.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.588+0000 7fbd1559a640 1 -- 172.21.15.45:0/1162141253 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd080ab7d0 con 0x7fbd1806f880 2023-10-03T19:19:40.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.588+0000 7fbd1559a640 1 -- 172.21.15.45:0/1162141253 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd080abb60 con 0x7fbd1806f880 2023-10-03T19:19:40.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.588+0000 7fbd1c982640 1 -- 172.21.15.45:0/1162141253 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd1806f880 msgr2=0x7fbd180a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:40.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.588+0000 7fbd1c982640 1 --2- 172.21.15.45:0/1162141253 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd1806f880 0x7fbd180a5940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbd08009870 tx=0x7fbd0801c510 comp rx=0 tx=0).stop 2023-10-03T19:19:40.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.588+0000 7fbd1c982640 1 -- 172.21.15.45:0/1162141253 shutdown_connections 2023-10-03T19:19:40.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.588+0000 7fbd1c982640 1 --2- 172.21.15.45:0/1162141253 >> v2:172.21.15.79:3300/0 conn(0x7fbd1814f510 0x7fbd1814b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:40.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.588+0000 7fbd1c982640 1 --2- 172.21.15.45:0/1162141253 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd1806f880 0x7fbd180a5940 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:40.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.588+0000 7fbd1c982640 1 -- 172.21.15.45:0/1162141253 >> 172.21.15.45:0/1162141253 conn(0x7fbd180a20d0 msgr2=0x7fbd180a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:40.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.588+0000 7fbd1c982640 1 -- 172.21.15.45:0/1162141253 shutdown_connections 2023-10-03T19:19:40.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.588+0000 7fbd1c982640 1 -- 172.21.15.45:0/1162141253 wait complete. 2023-10-03T19:19:40.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.588+0000 7fbd1c982640 1 Processor -- start 2023-10-03T19:19:40.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.588+0000 7fbd1c982640 1 -- start start 2023-10-03T19:19:40.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.588+0000 7fbd1c982640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd1806f880 0x7fbd1814d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:40.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.588+0000 7fbd1c982640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd180bd9f0 0x7fbd181467b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:40.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.588+0000 7fbd1c982640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd1814f510 0x7fbd18146cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:40.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.588+0000 7fbd1c982640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd18148090 con 0x7fbd1806f880 2023-10-03T19:19:40.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.588+0000 7fbd1c982640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd180a1bf0 con 0x7fbd1814f510 2023-10-03T19:19:40.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.588+0000 7fbd1c982640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1814e6a0 con 0x7fbd180bd9f0 2023-10-03T19:19:40.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.588+0000 7fbd1659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd1806f880 0x7fbd1814d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:40.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.588+0000 7fbd1659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd1806f880 0x7fbd1814d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47692/0 (socket says 172.21.15.45:47692) 2023-10-03T19:19:40.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.588+0000 7fbd1659c640 1 -- 172.21.15.45:0/826320553 learned_addr learned my addr 172.21.15.45:0/826320553 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:40.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.588+0000 7fbd16d9d640 1 --2- 172.21.15.45:0/826320553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd1814f510 0x7fbd18146cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:40.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.588+0000 7fbd15d9b640 1 --2- 172.21.15.45:0/826320553 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd180bd9f0 0x7fbd181467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:40.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.592+0000 7fbd1659c640 1 -- 172.21.15.45:0/826320553 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd180bd9f0 msgr2=0x7fbd181467b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:40.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.592+0000 7fbd1659c640 1 --2- 172.21.15.45:0/826320553 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd180bd9f0 0x7fbd181467b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:40.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.592+0000 7fbd1659c640 1 -- 172.21.15.45:0/826320553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd1814f510 msgr2=0x7fbd18146cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:40.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.592+0000 7fbd1659c640 1 --2- 172.21.15.45:0/826320553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd1814f510 0x7fbd18146cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:40.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.592+0000 7fbd1659c640 1 -- 172.21.15.45:0/826320553 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd080094d0 con 0x7fbd1806f880 2023-10-03T19:19:40.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.592+0000 7fbd16d9d640 1 --2- 172.21.15.45:0/826320553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd1814f510 0x7fbd18146cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:19:40.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.592+0000 7fbd1659c640 1 --2- 172.21.15.45:0/826320553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd1806f880 0x7fbd1814d6e0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fbd0801cdb0 tx=0x7fbd0801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:40.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.592+0000 7fbd06ffd640 1 -- 172.21.15.45:0/826320553 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd080ab670 con 0x7fbd1806f880 2023-10-03T19:19:40.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.592+0000 7fbd06ffd640 1 -- 172.21.15.45:0/826320553 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd080b4800 con 0x7fbd1806f880 2023-10-03T19:19:40.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.592+0000 7fbd1c982640 1 -- 172.21.15.45:0/826320553 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd1806fc50 con 0x7fbd1806f880 2023-10-03T19:19:40.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.592+0000 7fbd06ffd640 1 -- 172.21.15.45:0/826320553 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd080b4bb0 con 0x7fbd1806f880 2023-10-03T19:19:40.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.592+0000 7fbd1c982640 1 -- 172.21.15.45:0/826320553 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1814bc70 con 0x7fbd1806f880 2023-10-03T19:19:40.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.592+0000 7fbd1c982640 1 -- 172.21.15.45:0/826320553 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd18070a40 con 0x7fbd1806f880 2023-10-03T19:19:40.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.592+0000 7fbd06ffd640 1 -- 172.21.15.45:0/826320553 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbd080b4d10 con 0x7fbd1806f880 2023-10-03T19:19:40.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.592+0000 7fbd06ffd640 1 --2- 172.21.15.45:0/826320553 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbcf8066280 0x7fbcf8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:40.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.592+0000 7fbd06ffd640 1 -- 172.21.15.45:0/826320553 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbd0811de40 con 0x7fbd1806f880 2023-10-03T19:19:40.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.592+0000 7fbd15d9b640 1 --2- 172.21.15.45:0/826320553 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbcf8066280 0x7fbcf8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:40.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.592+0000 7fbd15d9b640 1 --2- 172.21.15.45:0/826320553 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbcf8066280 0x7fbcf8068730 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fbd180a3d90 tx=0x7fbd0c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:40.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.596+0000 7fbd06ffd640 1 -- 172.21.15.45:0/826320553 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbd080eb350 con 0x7fbd1806f880 2023-10-03T19:19:40.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:40.784+0000 7fbd1c982640 1 -- 172.21.15.45:0/826320553 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbd18072470 con 0x7fbd1806f880 2023-10-03T19:19:41.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.696+0000 7fbd06ffd640 1 -- 172.21.15.45:0/826320553 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v50) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbd080ee970 con 0x7fbd1806f880 2023-10-03T19:19:41.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.700+0000 7fbd1c982640 1 -- 172.21.15.45:0/826320553 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbcf8066280 msgr2=0x7fbcf8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:41.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.700+0000 7fbd1c982640 1 --2- 172.21.15.45:0/826320553 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbcf8066280 0x7fbcf8068730 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fbd180a3d90 tx=0x7fbd0c008040 comp rx=0 tx=0).stop 2023-10-03T19:19:41.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.700+0000 7fbd1c982640 1 -- 172.21.15.45:0/826320553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd1806f880 msgr2=0x7fbd1814d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:41.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.700+0000 7fbd1c982640 1 --2- 172.21.15.45:0/826320553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd1806f880 0x7fbd1814d6e0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fbd0801cdb0 tx=0x7fbd0801ad50 comp rx=0 tx=0).stop 2023-10-03T19:19:41.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.700+0000 7fbd1c982640 1 -- 172.21.15.45:0/826320553 shutdown_connections 2023-10-03T19:19:41.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.700+0000 7fbd1c982640 1 --2- 172.21.15.45:0/826320553 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbcf8066280 0x7fbcf8068730 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:41.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.700+0000 7fbd1c982640 1 --2- 172.21.15.45:0/826320553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd1814f510 0x7fbd18146cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:41.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.700+0000 7fbd1c982640 1 --2- 172.21.15.45:0/826320553 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd180bd9f0 0x7fbd181467b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:41.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.700+0000 7fbd1c982640 1 --2- 172.21.15.45:0/826320553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd1806f880 0x7fbd1814d6e0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:41.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.700+0000 7fbd1c982640 1 -- 172.21.15.45:0/826320553 >> 172.21.15.45:0/826320553 conn(0x7fbd180a20d0 msgr2=0x7fbd180bacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:41.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.700+0000 7fbd1c982640 1 -- 172.21.15.45:0/826320553 shutdown_connections 2023-10-03T19:19:41.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.700+0000 7fbd1c982640 1 -- 172.21.15.45:0/826320553 wait complete. 2023-10-03T19:19:41.722 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-03T19:19:41.722 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:19:41.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.844+0000 7f3d13be0640 1 Processor -- start 2023-10-03T19:19:41.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.844+0000 7f3d13be0640 1 -- start start 2023-10-03T19:19:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.844+0000 7f3d13be0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d0c0bc8b0 0x7f3d0c14ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.844+0000 7f3d13be0640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3d0c06d170 0x7f3d0c14cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.844+0000 7f3d13be0640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d0c06cac0 con 0x7f3d0c06f170 2023-10-03T19:19:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.844+0000 7f3d13be0640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d0c14d4f0 con 0x7f3d0c06d170 2023-10-03T19:19:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.844+0000 7f3d13be0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c0720d0 con 0x7f3d0c0bc8b0 2023-10-03T19:19:41.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.844+0000 7f3d1117b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d0c0bc8b0 0x7f3d0c14ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:41.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.844+0000 7f3d1217d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3d0c06d170 0x7f3d0c14cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:41.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.844+0000 7f3d1197c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3d0c06f170 0x7f3d0c150190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:43662/0 (socket says 172.21.15.45:43662) 2023-10-03T19:19:41.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.844+0000 7f3d1197c640 1 -- 172.21.15.45:0/2427999110 learned_addr learned my addr 172.21.15.45:0/2427999110 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:41.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.844+0000 7f3d1217d640 1 -- 172.21.15.45:0/2427999110 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d0c0bc8b0 msgr2=0x7f3d0c14ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:41.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.844+0000 7f3d1217d640 1 --2- 172.21.15.45:0/2427999110 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d0c0bc8b0 0x7f3d0c14ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:41.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.844+0000 7f3d1217d640 1 -- 172.21.15.45:0/2427999110 >> v1:172.21.15.79:6789/0 conn(0x7f3d0c06f170 legacy=0x7f3d0c150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:41.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.844+0000 7f3d1217d640 1 -- 172.21.15.45:0/2427999110 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c0a5ab0 con 0x7f3d0c06d170 2023-10-03T19:19:41.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.848+0000 7f3d1217d640 1 --2- 172.21.15.45:0/2427999110 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d0c06d170 0x7f3d0c14cfb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3d04009d90 tx=0x7f3d0401f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c10520586b0bb7ea server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:41.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.848+0000 7f3d1097a640 1 -- 172.21.15.45:0/2427999110 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d040af600 con 0x7f3d0c06d170 2023-10-03T19:19:41.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.848+0000 7f3d1097a640 1 -- 172.21.15.45:0/2427999110 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d040ab050 con 0x7f3d0c06d170 2023-10-03T19:19:41.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.848+0000 7f3d1097a640 1 -- 172.21.15.45:0/2427999110 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d040af980 con 0x7f3d0c06d170 2023-10-03T19:19:41.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.848+0000 7f3d13be0640 1 -- 172.21.15.45:0/2427999110 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d0c06d170 msgr2=0x7f3d0c14cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:41.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.848+0000 7f3d13be0640 1 --2- 172.21.15.45:0/2427999110 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d0c06d170 0x7f3d0c14cfb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3d04009d90 tx=0x7f3d0401f130 comp rx=0 tx=0).stop 2023-10-03T19:19:41.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.848+0000 7f3d13be0640 1 -- 172.21.15.45:0/2427999110 shutdown_connections 2023-10-03T19:19:41.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.848+0000 7f3d13be0640 1 --2- 172.21.15.45:0/2427999110 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d0c06d170 0x7f3d0c14cfb0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:41.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.848+0000 7f3d13be0640 1 --2- 172.21.15.45:0/2427999110 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d0c0bc8b0 0x7f3d0c14ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:41.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.848+0000 7f3d13be0640 1 -- 172.21.15.45:0/2427999110 >> 172.21.15.45:0/2427999110 conn(0x7f3d0c0bcf50 msgr2=0x7f3d0c0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:41.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.848+0000 7f3d13be0640 1 -- 172.21.15.45:0/2427999110 shutdown_connections 2023-10-03T19:19:41.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.848+0000 7f3d13be0640 1 -- 172.21.15.45:0/2427999110 wait complete. 2023-10-03T19:19:41.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.848+0000 7f3d13be0640 1 Processor -- start 2023-10-03T19:19:41.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.852+0000 7f3d13be0640 1 -- start start 2023-10-03T19:19:41.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.852+0000 7f3d13be0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d0c06d170 0x7f3d0c1d8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:41.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.852+0000 7f3d13be0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d0c06f170 0x7f3d0c141470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:41.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.852+0000 7f3d13be0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d0c0bc8b0 0x7f3d0c1419b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:41.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.852+0000 7f3d13be0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c144ee0 con 0x7f3d0c06f170 2023-10-03T19:19:41.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.852+0000 7f3d13be0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c0bb320 con 0x7f3d0c06d170 2023-10-03T19:19:41.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.852+0000 7f3d13be0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c141ef0 con 0x7f3d0c0bc8b0 2023-10-03T19:19:41.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.852+0000 7f3d1117b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d0c06f170 0x7f3d0c141470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:41.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.852+0000 7f3d1117b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d0c06f170 0x7f3d0c141470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47696/0 (socket says 172.21.15.45:47696) 2023-10-03T19:19:41.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.852+0000 7f3d1117b640 1 -- 172.21.15.45:0/3197915359 learned_addr learned my addr 172.21.15.45:0/3197915359 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:41.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.852+0000 7f3d1197c640 1 --2- 172.21.15.45:0/3197915359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d0c06d170 0x7f3d0c1d8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:41.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.852+0000 7f3d1217d640 1 --2- 172.21.15.45:0/3197915359 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d0c0bc8b0 0x7f3d0c1419b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:41.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.852+0000 7f3d1117b640 1 -- 172.21.15.45:0/3197915359 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d0c0bc8b0 msgr2=0x7f3d0c1419b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:41.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.852+0000 7f3d1117b640 1 --2- 172.21.15.45:0/3197915359 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d0c0bc8b0 0x7f3d0c1419b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:41.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.852+0000 7f3d1117b640 1 -- 172.21.15.45:0/3197915359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d0c06d170 msgr2=0x7f3d0c1d8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:41.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.852+0000 7f3d1117b640 1 --2- 172.21.15.45:0/3197915359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d0c06d170 0x7f3d0c1d8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:41.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.852+0000 7f3d1117b640 1 -- 172.21.15.45:0/3197915359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d04009a70 con 0x7f3d0c06f170 2023-10-03T19:19:41.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.852+0000 7f3d1117b640 1 --2- 172.21.15.45:0/3197915359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d0c06f170 0x7f3d0c141470 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f3d0000e960 tx=0x7f3d0000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:41.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.852+0000 7f3cfe7fc640 1 -- 172.21.15.45:0/3197915359 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d00009690 con 0x7f3d0c06f170 2023-10-03T19:19:41.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.852+0000 7f3cfe7fc640 1 -- 172.21.15.45:0/3197915359 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0000ca00 con 0x7f3d0c06f170 2023-10-03T19:19:41.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.852+0000 7f3cfe7fc640 1 -- 172.21.15.45:0/3197915359 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0000cd70 con 0x7f3d0c06f170 2023-10-03T19:19:41.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.852+0000 7f3d13be0640 1 -- 172.21.15.45:0/3197915359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d0c14fae0 con 0x7f3d0c06f170 2023-10-03T19:19:41.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.852+0000 7f3d13be0640 1 -- 172.21.15.45:0/3197915359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d0c06cd00 con 0x7f3d0c06f170 2023-10-03T19:19:41.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.852+0000 7f3d13be0640 1 -- 172.21.15.45:0/3197915359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d0c06d660 con 0x7f3d0c06f170 2023-10-03T19:19:41.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.852+0000 7f3cfe7fc640 1 -- 172.21.15.45:0/3197915359 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3d00013470 con 0x7f3d0c06f170 2023-10-03T19:19:41.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.852+0000 7f3cfe7fc640 1 --2- 172.21.15.45:0/3197915359 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3cf00662b0 0x7f3cf0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:41.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.852+0000 7f3cfe7fc640 1 -- 172.21.15.45:0/3197915359 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3d000845f0 con 0x7f3d0c06f170 2023-10-03T19:19:41.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.856+0000 7f3d1197c640 1 --2- 172.21.15.45:0/3197915359 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3cf00662b0 0x7f3cf0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:41.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.856+0000 7f3d1197c640 1 --2- 172.21.15.45:0/3197915359 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3cf00662b0 0x7f3cf0068760 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3d08005890 tx=0x7f3d08009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:41.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:41.856+0000 7f3cfe7fc640 1 -- 172.21.15.45:0/3197915359 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3d00051c00 con 0x7f3d0c06f170 2023-10-03T19:19:42.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.044+0000 7f3d13be0640 1 -- 172.21.15.45:0/3197915359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d0c14c480 con 0x7f3d0c06f170 2023-10-03T19:19:42.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.044+0000 7f3cfe7fc640 1 -- 172.21.15.45:0/3197915359 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+3916 (secure 0 0 0) 0x7f3d00055220 con 0x7f3d0c06f170 2023-10-03T19:19:42.048 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:19:42.048 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":50,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5795,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2000006019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2000006019},{"type":"v1","addr":"172.21.15.79:6835","nonce":2000006019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":7149,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/3326584899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3326584899},{"type":"v1","addr":"172.21.15.45:6833","nonce":3326584899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:19:39.419474+0000","modified":"2023-10-03T19:19:41.692109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7155},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7155":{"gid":7155,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3401546487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3401546487},{"type":"v1","addr":"172.21.15.45:6835","nonce":3401546487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-10-03T19:19:42.048 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 50 2023-10-03T19:19:42.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.048+0000 7f3d13be0640 1 -- 172.21.15.45:0/3197915359 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3cf00662b0 msgr2=0x7f3cf0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:42.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.048+0000 7f3d13be0640 1 --2- 172.21.15.45:0/3197915359 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3cf00662b0 0x7f3cf0068760 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3d08005890 tx=0x7f3d08009040 comp rx=0 tx=0).stop 2023-10-03T19:19:42.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.048+0000 7f3d13be0640 1 -- 172.21.15.45:0/3197915359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d0c06f170 msgr2=0x7f3d0c141470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:42.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.048+0000 7f3d13be0640 1 --2- 172.21.15.45:0/3197915359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d0c06f170 0x7f3d0c141470 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f3d0000e960 tx=0x7f3d0000ee20 comp rx=0 tx=0).stop 2023-10-03T19:19:42.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.048+0000 7f3d13be0640 1 -- 172.21.15.45:0/3197915359 shutdown_connections 2023-10-03T19:19:42.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.048+0000 7f3d13be0640 1 --2- 172.21.15.45:0/3197915359 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3cf00662b0 0x7f3cf0068760 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.048+0000 7f3d13be0640 1 --2- 172.21.15.45:0/3197915359 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3d0c0bc8b0 0x7f3d0c1419b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.048+0000 7f3d13be0640 1 --2- 172.21.15.45:0/3197915359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d0c06f170 0x7f3d0c141470 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.048+0000 7f3d13be0640 1 --2- 172.21.15.45:0/3197915359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d0c06d170 0x7f3d0c1d8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.048+0000 7f3d13be0640 1 -- 172.21.15.45:0/3197915359 >> 172.21.15.45:0/3197915359 conn(0x7f3d0c0bcf50 msgr2=0x7f3d0c14d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:42.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.048+0000 7f3d13be0640 1 -- 172.21.15.45:0/3197915359 shutdown_connections 2023-10-03T19:19:42.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.048+0000 7f3d13be0640 1 -- 172.21.15.45:0/3197915359 wait complete. 2023-10-03T19:19:42.068 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:19:42.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.176+0000 7fe40c035640 1 Processor -- start 2023-10-03T19:19:42.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.176+0000 7fe40c035640 1 -- start start 2023-10-03T19:19:42.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.176+0000 7fe40c035640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe404070c50 0x7fe40414cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:42.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.176+0000 7fe40c035640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe40406f810 0x7fe404149940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:42.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.176+0000 7fe40c035640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe40414d500 con 0x7fe4040bb210 2023-10-03T19:19:42.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.176+0000 7fe40c035640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4040b6980 con 0x7fe40406f810 2023-10-03T19:19:42.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.176+0000 7fe40c035640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe40406fff0 con 0x7fe404070c50 2023-10-03T19:19:42.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.176+0000 7fe40a5d2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe40406f810 0x7fe404149940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:42.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.176+0000 7fe40a5d2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe40406f810 0x7fe404149940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47712/0 (socket says 172.21.15.45:47712) 2023-10-03T19:19:42.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.176+0000 7fe40a5d2640 1 -- 172.21.15.45:0/1113478325 learned_addr learned my addr 172.21.15.45:0/1113478325 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:42.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.176+0000 7fe409dd1640 1 --2- 172.21.15.45:0/1113478325 >> v2:172.21.15.79:3300/0 conn(0x7fe404070c50 0x7fe40414cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:42.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.176+0000 7fe40a5d2640 1 -- 172.21.15.45:0/1113478325 >> v2:172.21.15.79:3300/0 conn(0x7fe404070c50 msgr2=0x7fe40414cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:42.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.176+0000 7fe40a5d2640 1 --2- 172.21.15.45:0/1113478325 >> v2:172.21.15.79:3300/0 conn(0x7fe404070c50 0x7fe40414cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.176+0000 7fe40a5d2640 1 -- 172.21.15.45:0/1113478325 >> v1:172.21.15.79:6789/0 conn(0x7fe4040bb210 legacy=0x7fe4040beca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:42.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.176+0000 7fe40a5d2640 1 -- 172.21.15.45:0/1113478325 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40406fd50 con 0x7fe40406f810 2023-10-03T19:19:42.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.176+0000 7fe409dd1640 1 --2- 172.21.15.45:0/1113478325 >> v2:172.21.15.79:3300/0 conn(0x7fe404070c50 0x7fe40414cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:42.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.180+0000 7fe40a5d2640 1 --2- 172.21.15.45:0/1113478325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe40406f810 0x7fe404149940 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fe4040c0cc0 tx=0x7fe3fc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b607a464877d6cd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:42.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.180+0000 7fe408dcf640 1 -- 172.21.15.45:0/1113478325 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc0ab650 con 0x7fe40406f810 2023-10-03T19:19:42.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.180+0000 7fe408dcf640 1 -- 172.21.15.45:0/1113478325 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3fc0ab7b0 con 0x7fe40406f810 2023-10-03T19:19:42.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.180+0000 7fe408dcf640 1 -- 172.21.15.45:0/1113478325 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc0abb40 con 0x7fe40406f810 2023-10-03T19:19:42.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.180+0000 7fe40c035640 1 -- 172.21.15.45:0/1113478325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe40406f810 msgr2=0x7fe404149940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:42.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.180+0000 7fe40c035640 1 --2- 172.21.15.45:0/1113478325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe40406f810 0x7fe404149940 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fe4040c0cc0 tx=0x7fe3fc01c430 comp rx=0 tx=0).stop 2023-10-03T19:19:42.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.180+0000 7fe40c035640 1 -- 172.21.15.45:0/1113478325 shutdown_connections 2023-10-03T19:19:42.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.180+0000 7fe40c035640 1 --2- 172.21.15.45:0/1113478325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe40406f810 0x7fe404149940 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.180+0000 7fe40c035640 1 --2- 172.21.15.45:0/1113478325 >> v2:172.21.15.79:3300/0 conn(0x7fe404070c50 0x7fe40414cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.180+0000 7fe40c035640 1 -- 172.21.15.45:0/1113478325 >> 172.21.15.45:0/1113478325 conn(0x7fe4040bd880 msgr2=0x7fe4040bdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:42.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.180+0000 7fe40c035640 1 -- 172.21.15.45:0/1113478325 shutdown_connections 2023-10-03T19:19:42.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.180+0000 7fe40c035640 1 -- 172.21.15.45:0/1113478325 wait complete. 2023-10-03T19:19:42.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.184+0000 7fe40c035640 1 Processor -- start 2023-10-03T19:19:42.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.184+0000 7fe40c035640 1 -- start start 2023-10-03T19:19:42.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.184+0000 7fe40c035640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe40406f810 0x7fe40414cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:42.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.184+0000 7fe40c035640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe404070c50 0x7fe4041401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:42.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.184+0000 7fe40c035640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe4040bb210 0x7fe4041420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:42.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.184+0000 7fe40c035640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe404143180 con 0x7fe404070c50 2023-10-03T19:19:42.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.184+0000 7fe40c035640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe404142ee0 con 0x7fe4040bb210 2023-10-03T19:19:42.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.184+0000 7fe40c035640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe40413b750 con 0x7fe40406f810 2023-10-03T19:19:42.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.184+0000 7fe4095d0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe404070c50 0x7fe4041401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:42.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.184+0000 7fe4095d0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe404070c50 0x7fe4041401b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47728/0 (socket says 172.21.15.45:47728) 2023-10-03T19:19:42.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.184+0000 7fe4095d0640 1 -- 172.21.15.45:0/857294494 learned_addr learned my addr 172.21.15.45:0/857294494 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:42.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.184+0000 7fe409dd1640 1 --2- 172.21.15.45:0/857294494 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe40406f810 0x7fe40414cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:42.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.184+0000 7fe40a5d2640 1 --2- 172.21.15.45:0/857294494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe4040bb210 0x7fe4041420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:42.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.184+0000 7fe4095d0640 1 -- 172.21.15.45:0/857294494 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe40406f810 msgr2=0x7fe40414cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:42.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.184+0000 7fe4095d0640 1 --2- 172.21.15.45:0/857294494 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe40406f810 0x7fe40414cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.184+0000 7fe4095d0640 1 -- 172.21.15.45:0/857294494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe4040bb210 msgr2=0x7fe4041420b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:42.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.184+0000 7fe4095d0640 1 --2- 172.21.15.45:0/857294494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe4040bb210 0x7fe4041420b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.184+0000 7fe4095d0640 1 -- 172.21.15.45:0/857294494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc0094d0 con 0x7fe404070c50 2023-10-03T19:19:42.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.184+0000 7fe4095d0640 1 --2- 172.21.15.45:0/857294494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe404070c50 0x7fe4041401b0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fe3f400b410 tx=0x7fe3f400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:42.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.184+0000 7fe3fa7fc640 1 -- 172.21.15.45:0/857294494 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f4004020 con 0x7fe404070c50 2023-10-03T19:19:42.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.184+0000 7fe3fa7fc640 1 -- 172.21.15.45:0/857294494 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f4004180 con 0x7fe404070c50 2023-10-03T19:19:42.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.184+0000 7fe3fa7fc640 1 -- 172.21.15.45:0/857294494 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f4011630 con 0x7fe404070c50 2023-10-03T19:19:42.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.184+0000 7fe40c035640 1 -- 172.21.15.45:0/857294494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4040b6590 con 0x7fe404070c50 2023-10-03T19:19:42.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.184+0000 7fe40c035640 1 -- 172.21.15.45:0/857294494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4040b6400 con 0x7fe404070c50 2023-10-03T19:19:42.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.184+0000 7fe40c035640 1 -- 172.21.15.45:0/857294494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe404159600 con 0x7fe404070c50 2023-10-03T19:19:42.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.188+0000 7fe3fa7fc640 1 -- 172.21.15.45:0/857294494 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe3f4011790 con 0x7fe404070c50 2023-10-03T19:19:42.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.188+0000 7fe3fa7fc640 1 --2- 172.21.15.45:0/857294494 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe3e80662b0 0x7fe3e8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:42.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.188+0000 7fe3fa7fc640 1 -- 172.21.15.45:0/857294494 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe3f4083a90 con 0x7fe404070c50 2023-10-03T19:19:42.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.188+0000 7fe409dd1640 1 --2- 172.21.15.45:0/857294494 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe3e80662b0 0x7fe3e8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:42.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.188+0000 7fe409dd1640 1 --2- 172.21.15.45:0/857294494 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe3e80662b0 0x7fe3e8068760 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe4000075b0 tx=0x7fe400007540 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:42.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.192+0000 7fe3fa7fc640 1 -- 172.21.15.45:0/857294494 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe3f4050f00 con 0x7fe404070c50 2023-10-03T19:19:42.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.348+0000 7fe40c035640 1 -- 172.21.15.45:0/857294494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe404138780 con 0x7fe404070c50 2023-10-03T19:19:42.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.352+0000 7fe3fa7fc640 1 -- 172.21.15.45:0/857294494 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+18234 (secure 0 0 0) 0x7fe404138780 con 0x7fe404070c50 2023-10-03T19:19:42.355 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:19:42.355 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":98,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:19:40.422617+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:19:37.111278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-10-03T19:19:38.418651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:19:42.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.352+0000 7fe40c035640 1 -- 172.21.15.45:0/857294494 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe3e80662b0 msgr2=0x7fe3e8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:42.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.352+0000 7fe40c035640 1 --2- 172.21.15.45:0/857294494 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe3e80662b0 0x7fe3e8068760 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe4000075b0 tx=0x7fe400007540 comp rx=0 tx=0).stop 2023-10-03T19:19:42.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.352+0000 7fe40c035640 1 -- 172.21.15.45:0/857294494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe404070c50 msgr2=0x7fe4041401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:42.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.352+0000 7fe40c035640 1 --2- 172.21.15.45:0/857294494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe404070c50 0x7fe4041401b0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fe3f400b410 tx=0x7fe3f400b8d0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.352+0000 7fe40c035640 1 -- 172.21.15.45:0/857294494 shutdown_connections 2023-10-03T19:19:42.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.352+0000 7fe40c035640 1 --2- 172.21.15.45:0/857294494 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe3e80662b0 0x7fe3e8068760 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.352+0000 7fe40c035640 1 --2- 172.21.15.45:0/857294494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe4040bb210 0x7fe4041420b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.352+0000 7fe40c035640 1 --2- 172.21.15.45:0/857294494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe404070c50 0x7fe4041401b0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.352+0000 7fe40c035640 1 --2- 172.21.15.45:0/857294494 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe40406f810 0x7fe40414cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.352+0000 7fe40c035640 1 -- 172.21.15.45:0/857294494 >> 172.21.15.45:0/857294494 conn(0x7fe4040bd880 msgr2=0x7fe4040bc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:42.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.352+0000 7fe40c035640 1 -- 172.21.15.45:0/857294494 shutdown_connections 2023-10-03T19:19:42.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.352+0000 7fe40c035640 1 -- 172.21.15.45:0/857294494 wait complete. 2023-10-03T19:19:42.374 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-03T19:19:42.374 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:19:42.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.488+0000 7f7302175640 1 Processor -- start 2023-10-03T19:19:42.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.488+0000 7f7302175640 1 -- start start 2023-10-03T19:19:42.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f7302175640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f72fc0bcb60 0x7f72fc06c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:42.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f7302175640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72fc14b610 con 0x7f72fc06c7d0 2023-10-03T19:19:42.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f7302175640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72fc0a5580 con 0x7f72fc148b90 2023-10-03T19:19:42.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f7302175640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72fc0a3670 con 0x7f72fc0bcb60 2023-10-03T19:19:42.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f72fbfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f72fc06c7d0 0x7f72fc155cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39714/0 (socket says 172.21.15.45:39714) 2023-10-03T19:19:42.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f72fbfff640 1 -- 172.21.15.45:0/4233209301 learned_addr learned my addr 172.21.15.45:0/4233209301 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:42.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f72faffd640 1 --2- 172.21.15.45:0/4233209301 >> v2:172.21.15.79:3300/0 conn(0x7f72fc0bcb60 0x7f72fc06c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:42.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f72fa7fc640 1 -- 172.21.15.45:0/4233209301 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834763670 0 0) 0x7f72fc14b610 con 0x7f72fc06c7d0 2023-10-03T19:19:42.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f72fa7fc640 1 -- 172.21.15.45:0/4233209301 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72e4003530 con 0x7f72fc06c7d0 2023-10-03T19:19:42.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f72fa7fc640 1 -- 172.21.15.45:0/4233209301 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 264682677 0 0) 0x7f72e4003530 con 0x7f72fc06c7d0 2023-10-03T19:19:42.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f72fa7fc640 1 -- 172.21.15.45:0/4233209301 >> v2:172.21.15.79:3300/0 conn(0x7f72fc0bcb60 msgr2=0x7f72fc06c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:42.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f72fa7fc640 1 --2- 172.21.15.45:0/4233209301 >> v2:172.21.15.79:3300/0 conn(0x7f72fc0bcb60 0x7f72fc06c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f72fa7fc640 1 -- 172.21.15.45:0/4233209301 >> v1:172.21.15.79:6789/0 conn(0x7f72fc148b90 legacy=0x7f72fc0bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:42.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f72fa7fc640 1 -- 172.21.15.45:0/4233209301 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc0a5820 con 0x7f72fc06c7d0 2023-10-03T19:19:42.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f72fa7fc640 1 -- 172.21.15.45:0/4233209301 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f72f4001a00 con 0x7f72fc06c7d0 2023-10-03T19:19:42.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f72fa7fc640 1 -- 172.21.15.45:0/4233209301 >> v1:172.21.15.45:6789/0 conn(0x7f72fc06c7d0 legacy=0x7f72fc155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:42.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f72fa7fc640 1 --2- 172.21.15.45:0/4233209301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72e4003980 0x7f72e4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:42.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f72fa7fc640 1 --2- 172.21.15.45:0/4233209301 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72e40047d0 0x7f72e4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:42.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f72fa7fc640 1 --2- 172.21.15.45:0/4233209301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72e4005180 0x7f72e400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:42.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f72fa7fc640 1 -- 172.21.15.45:0/4233209301 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc0a3670 con 0x7f72e4003980 2023-10-03T19:19:42.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f72fa7fc640 1 -- 172.21.15.45:0/4233209301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e400bfe0 con 0x7f72e4005180 2023-10-03T19:19:42.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f72fa7fc640 1 -- 172.21.15.45:0/4233209301 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e400c1a0 con 0x7f72e40047d0 2023-10-03T19:19:42.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f72fb7fe640 1 --2- 172.21.15.45:0/4233209301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72e4003980 0x7f72e4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:42.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f72fbfff640 1 --2- 172.21.15.45:0/4233209301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72e4005180 0x7f72e400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:42.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f72fb7fe640 1 -- 172.21.15.45:0/4233209301 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72e40047d0 msgr2=0x7f72e4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:42.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f72fb7fe640 1 --2- 172.21.15.45:0/4233209301 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72e40047d0 0x7f72e4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f72fb7fe640 1 -- 172.21.15.45:0/4233209301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72e4005180 msgr2=0x7f72e400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:42.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f72fb7fe640 1 --2- 172.21.15.45:0/4233209301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72e4005180 0x7f72e400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f72fb7fe640 1 -- 172.21.15.45:0/4233209301 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e4003530 con 0x7f72e4003980 2023-10-03T19:19:42.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f72fbfff640 1 -- 172.21.15.45:0/4233209301 reap_dead start 2023-10-03T19:19:42.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.492+0000 7f72fb7fe640 1 --2- 172.21.15.45:0/4233209301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72e4003980 0x7f72e4003d90 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f72ec001780 tx=0x7f72ec01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b216a75d1233bbbf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:42.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f72fa7fc640 1 -- 172.21.15.45:0/4233209301 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec0a4ea0 con 0x7f72e4003980 2023-10-03T19:19:42.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f72fa7fc640 1 -- 172.21.15.45:0/4233209301 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ec0a7050 con 0x7f72e4003980 2023-10-03T19:19:42.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f72fa7fc640 1 -- 172.21.15.45:0/4233209301 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec003600 con 0x7f72e4003980 2023-10-03T19:19:42.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f7302175640 1 -- 172.21.15.45:0/4233209301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72e4003980 msgr2=0x7f72e4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:42.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f7302175640 1 --2- 172.21.15.45:0/4233209301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72e4003980 0x7f72e4003d90 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f72ec001780 tx=0x7f72ec01c3e0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f7302175640 1 -- 172.21.15.45:0/4233209301 shutdown_connections 2023-10-03T19:19:42.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f7302175640 1 --2- 172.21.15.45:0/4233209301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72e4003980 0x7f72e4003d90 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f7302175640 1 -- 172.21.15.45:0/4233209301 >> 172.21.15.45:0/4233209301 conn(0x7f72fc0bcf50 msgr2=0x7f72fc0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:42.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f7302175640 1 -- 172.21.15.45:0/4233209301 shutdown_connections 2023-10-03T19:19:42.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f7302175640 1 -- 172.21.15.45:0/4233209301 wait complete. 2023-10-03T19:19:42.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f7302175640 1 Processor -- start 2023-10-03T19:19:42.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f7302175640 1 -- start start 2023-10-03T19:19:42.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f7302175640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72e4003980 0x7f72fc0b9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:42.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f7302175640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72fc0a2db0 0x7f72fc1e3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:42.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f7302175640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72fc1e41c0 0x7f72fc06fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:42.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f7302175640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc071ae0 con 0x7f72fc1e41c0 2023-10-03T19:19:42.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f7302175640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc0ba090 con 0x7f72fc0a2db0 2023-10-03T19:19:42.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f7302175640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc1e34a0 con 0x7f72e4003980 2023-10-03T19:19:42.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f72fbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72fc1e41c0 0x7f72fc06fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:42.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f72fbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72fc1e41c0 0x7f72fc06fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47744/0 (socket says 172.21.15.45:47744) 2023-10-03T19:19:42.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f72fbfff640 1 -- 172.21.15.45:0/900079155 learned_addr learned my addr 172.21.15.45:0/900079155 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:42.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f72faffd640 1 --2- 172.21.15.45:0/900079155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72fc0a2db0 0x7f72fc1e3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:42.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f72fb7fe640 1 --2- 172.21.15.45:0/900079155 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72e4003980 0x7f72fc0b9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:42.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f72fbfff640 1 -- 172.21.15.45:0/900079155 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72e4003980 msgr2=0x7f72fc0b9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:42.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f72fbfff640 1 --2- 172.21.15.45:0/900079155 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72e4003980 0x7f72fc0b9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f72fbfff640 1 -- 172.21.15.45:0/900079155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72fc0a2db0 msgr2=0x7f72fc1e3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:42.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f72fbfff640 1 --2- 172.21.15.45:0/900079155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72fc0a2db0 0x7f72fc1e3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f72fbfff640 1 -- 172.21.15.45:0/900079155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc0a3880 con 0x7f72fc1e41c0 2023-10-03T19:19:42.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f72faffd640 1 --2- 172.21.15.45:0/900079155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72fc0a2db0 0x7f72fc1e3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:42.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f72fbfff640 1 --2- 172.21.15.45:0/900079155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72fc1e41c0 0x7f72fc06fa50 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f72f4002240 tx=0x7f72f4011850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:42.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f72e3fff640 1 -- 172.21.15.45:0/900079155 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f4014370 con 0x7f72fc1e41c0 2023-10-03T19:19:42.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f72e3fff640 1 -- 172.21.15.45:0/900079155 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f40144f0 con 0x7f72fc1e41c0 2023-10-03T19:19:42.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f7302175640 1 -- 172.21.15.45:0/900079155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72fc148f60 con 0x7f72fc1e41c0 2023-10-03T19:19:42.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f72e3fff640 1 -- 172.21.15.45:0/900079155 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f40148a0 con 0x7f72fc1e41c0 2023-10-03T19:19:42.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.496+0000 7f7302175640 1 -- 172.21.15.45:0/900079155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72fc0a3c30 con 0x7f72fc1e41c0 2023-10-03T19:19:42.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.500+0000 7f7302175640 1 -- 172.21.15.45:0/900079155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72fc14d130 con 0x7f72fc1e41c0 2023-10-03T19:19:42.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.500+0000 7f72e3fff640 1 -- 172.21.15.45:0/900079155 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f72f4014a00 con 0x7f72fc1e41c0 2023-10-03T19:19:42.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.500+0000 7f72e3fff640 1 --2- 172.21.15.45:0/900079155 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f72e80662b0 0x7f72e8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:42.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.500+0000 7f72e3fff640 1 -- 172.21.15.45:0/900079155 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f72f4086180 con 0x7f72fc1e41c0 2023-10-03T19:19:42.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.500+0000 7f72fb7fe640 1 --2- 172.21.15.45:0/900079155 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f72e80662b0 0x7f72e8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:42.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.500+0000 7f72fb7fe640 1 --2- 172.21.15.45:0/900079155 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f72e80662b0 0x7f72e8068760 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f72ec001750 tx=0x7f72ec0011a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:42.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.504+0000 7f72e3fff640 1 -- 172.21.15.45:0/900079155 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f72fc14d130 con 0x7f72fc1e41c0 2023-10-03T19:19:42.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.656+0000 7f7302175640 1 -- 172.21.15.45:0/900079155 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f72fc14d130 con 0x7f72e80662b0 2023-10-03T19:19:42.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.680+0000 7f72e3fff640 1 -- 172.21.15.45:0/900079155 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308580 (secure 0 0 0) 0x7f72fc14d130 con 0x7f72e80662b0 2023-10-03T19:19:42.685 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:19:42.686 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:19:42.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.684+0000 7f7302175640 1 -- 172.21.15.45:0/900079155 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f72e80662b0 msgr2=0x7f72e8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:42.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.684+0000 7f7302175640 1 --2- 172.21.15.45:0/900079155 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f72e80662b0 0x7f72e8068760 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f72ec001750 tx=0x7f72ec0011a0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.684+0000 7f7302175640 1 -- 172.21.15.45:0/900079155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72fc1e41c0 msgr2=0x7f72fc06fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:42.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.684+0000 7f7302175640 1 --2- 172.21.15.45:0/900079155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72fc1e41c0 0x7f72fc06fa50 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f72f4002240 tx=0x7f72f4011850 comp rx=0 tx=0).stop 2023-10-03T19:19:42.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.684+0000 7f7302175640 1 -- 172.21.15.45:0/900079155 shutdown_connections 2023-10-03T19:19:42.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.684+0000 7f7302175640 1 --2- 172.21.15.45:0/900079155 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f72e80662b0 0x7f72e8068760 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.684+0000 7f7302175640 1 --2- 172.21.15.45:0/900079155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72fc1e41c0 0x7f72fc06fa50 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.684+0000 7f7302175640 1 --2- 172.21.15.45:0/900079155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72fc0a2db0 0x7f72fc1e3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.684+0000 7f7302175640 1 --2- 172.21.15.45:0/900079155 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72e4003980 0x7f72fc0b9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.684+0000 7f7302175640 1 -- 172.21.15.45:0/900079155 >> 172.21.15.45:0/900079155 conn(0x7f72fc0bcf50 msgr2=0x7f72fc06cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:42.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.684+0000 7f7302175640 1 -- 172.21.15.45:0/900079155 shutdown_connections 2023-10-03T19:19:42.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.684+0000 7f7302175640 1 -- 172.21.15.45:0/900079155 wait complete. 2023-10-03T19:19:42.704 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2023-10-03T19:19:42.600621+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":157,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244048,"kb_used_data":9488,"kb_used_omap":0,"kb_used_meta":234496,"kb_avail":754730672,"statfs":{"total":773094113280,"available":772844208128,"internally_reserved":0,"allocated":9715712,"data_stored":5546299,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":240123904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":69,"apply_latency_ms":69,"commit_latency_ns":69000000,"apply_latency_ns":69000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.559949"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.065677+0000","last_change":"2023-10-03T19:19:39.065677+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.065677+0000","last_undegraded":"2023-10-03T19:19:39.065677+0000","last_fullsized":"2023-10-03T19:19:39.065677+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678798+0000","last_change":"2023-10-03T19:19:39.501818+0000","last_active":"2023-10-03T19:19:40.678798+0000","last_peered":"2023-10-03T19:19:40.678798+0000","last_clean":"2023-10-03T19:19:40.678798+0000","last_became_active":"2023-10-03T19:19:39.501351+0000","last_became_peered":"2023-10-03T19:19:39.501351+0000","last_unstale":"2023-10-03T19:19:40.678798+0000","last_undegraded":"2023-10-03T19:19:40.678798+0000","last_fullsized":"2023-10-03T19:19:40.678798+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:35:21.301808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.062721+0000","last_change":"2023-10-03T19:19:39.062721+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.062721+0000","last_undegraded":"2023-10-03T19:19:39.062721+0000","last_fullsized":"2023-10-03T19:19:39.062721+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430029+0000","last_change":"2023-10-03T19:19:39.473749+0000","last_active":"2023-10-03T19:19:40.430029+0000","last_peered":"2023-10-03T19:19:40.430029+0000","last_clean":"2023-10-03T19:19:40.430029+0000","last_became_active":"2023-10-03T19:19:39.473432+0000","last_became_peered":"2023-10-03T19:19:39.473432+0000","last_unstale":"2023-10-03T19:19:40.430029+0000","last_undegraded":"2023-10-03T19:19:40.430029+0000","last_fullsized":"2023-10-03T19:19:40.430029+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:58:52.700889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175119+0000","last_change":"2023-10-03T19:19:39.473502+0000","last_active":"2023-10-03T19:19:41.175119+0000","last_peered":"2023-10-03T19:19:41.175119+0000","last_clean":"2023-10-03T19:19:41.175119+0000","last_became_active":"2023-10-03T19:19:39.473176+0000","last_became_peered":"2023-10-03T19:19:39.473176+0000","last_unstale":"2023-10-03T19:19:41.175119+0000","last_undegraded":"2023-10-03T19:19:41.175119+0000","last_fullsized":"2023-10-03T19:19:41.175119+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:47:23.957363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.677858+0000","last_change":"2023-10-03T19:19:39.491373+0000","last_active":"2023-10-03T19:19:40.677858+0000","last_peered":"2023-10-03T19:19:40.677858+0000","last_clean":"2023-10-03T19:19:40.677858+0000","last_became_active":"2023-10-03T19:19:39.490818+0000","last_became_peered":"2023-10-03T19:19:39.490818+0000","last_unstale":"2023-10-03T19:19:40.677858+0000","last_undegraded":"2023-10-03T19:19:40.677858+0000","last_fullsized":"2023-10-03T19:19:40.677858+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:59:41.953904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.677748+0000","last_change":"2023-10-03T19:19:39.497977+0000","last_active":"2023-10-03T19:19:40.677748+0000","last_peered":"2023-10-03T19:19:40.677748+0000","last_clean":"2023-10-03T19:19:40.677748+0000","last_became_active":"2023-10-03T19:19:39.497211+0000","last_became_peered":"2023-10-03T19:19:39.497211+0000","last_unstale":"2023-10-03T19:19:40.677748+0000","last_undegraded":"2023-10-03T19:19:40.677748+0000","last_fullsized":"2023-10-03T19:19:40.677748+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:15:08.226909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.172923+0000","last_change":"2023-10-03T19:19:39.450807+0000","last_active":"2023-10-03T19:19:41.172923+0000","last_peered":"2023-10-03T19:19:41.172923+0000","last_clean":"2023-10-03T19:19:41.172923+0000","last_became_active":"2023-10-03T19:19:39.450534+0000","last_became_peered":"2023-10-03T19:19:39.450534+0000","last_unstale":"2023-10-03T19:19:41.172923+0000","last_undegraded":"2023-10-03T19:19:41.172923+0000","last_fullsized":"2023-10-03T19:19:41.172923+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:15:38.079291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678801+0000","last_change":"2023-10-03T19:19:39.492468+0000","last_active":"2023-10-03T19:19:40.678801+0000","last_peered":"2023-10-03T19:19:40.678801+0000","last_clean":"2023-10-03T19:19:40.678801+0000","last_became_active":"2023-10-03T19:19:39.491727+0000","last_became_peered":"2023-10-03T19:19:39.491727+0000","last_unstale":"2023-10-03T19:19:40.678801+0000","last_undegraded":"2023-10-03T19:19:40.678801+0000","last_fullsized":"2023-10-03T19:19:40.678801+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:42:13.454493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176602+0000","last_change":"2023-10-03T19:19:39.498659+0000","last_active":"2023-10-03T19:19:41.176602+0000","last_peered":"2023-10-03T19:19:41.176602+0000","last_clean":"2023-10-03T19:19:41.176602+0000","last_became_active":"2023-10-03T19:19:39.498315+0000","last_became_peered":"2023-10-03T19:19:39.498315+0000","last_unstale":"2023-10-03T19:19:41.176602+0000","last_undegraded":"2023-10-03T19:19:41.176602+0000","last_fullsized":"2023-10-03T19:19:41.176602+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:34:42.126930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.067805+0000","last_change":"2023-10-03T19:19:39.067805+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.067805+0000","last_undegraded":"2023-10-03T19:19:39.067805+0000","last_fullsized":"2023-10-03T19:19:39.067805+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.440908+0000","last_change":"2023-10-03T19:19:39.455413+0000","last_active":"2023-10-03T19:19:40.440908+0000","last_peered":"2023-10-03T19:19:40.440908+0000","last_clean":"2023-10-03T19:19:40.440908+0000","last_became_active":"2023-10-03T19:19:39.454714+0000","last_became_peered":"2023-10-03T19:19:39.454714+0000","last_unstale":"2023-10-03T19:19:40.440908+0000","last_undegraded":"2023-10-03T19:19:40.440908+0000","last_fullsized":"2023-10-03T19:19:40.440908+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:27:14.179448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.429895+0000","last_change":"2023-10-03T19:19:39.466360+0000","last_active":"2023-10-03T19:19:40.429895+0000","last_peered":"2023-10-03T19:19:40.429895+0000","last_clean":"2023-10-03T19:19:40.429895+0000","last_became_active":"2023-10-03T19:19:39.466034+0000","last_became_peered":"2023-10-03T19:19:39.466034+0000","last_unstale":"2023-10-03T19:19:40.429895+0000","last_undegraded":"2023-10-03T19:19:40.429895+0000","last_fullsized":"2023-10-03T19:19:40.429895+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:17:57.802389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174860+0000","last_change":"2023-10-03T19:19:39.478735+0000","last_active":"2023-10-03T19:19:41.174860+0000","last_peered":"2023-10-03T19:19:41.174860+0000","last_clean":"2023-10-03T19:19:41.174860+0000","last_became_active":"2023-10-03T19:19:39.477842+0000","last_became_peered":"2023-10-03T19:19:39.477842+0000","last_unstale":"2023-10-03T19:19:41.174860+0000","last_undegraded":"2023-10-03T19:19:41.174860+0000","last_fullsized":"2023-10-03T19:19:41.174860+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:01:44.142532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174807+0000","last_change":"2023-10-03T19:19:39.493604+0000","last_active":"2023-10-03T19:19:41.174807+0000","last_peered":"2023-10-03T19:19:41.174807+0000","last_clean":"2023-10-03T19:19:41.174807+0000","last_became_active":"2023-10-03T19:19:39.488408+0000","last_became_peered":"2023-10-03T19:19:39.488408+0000","last_unstale":"2023-10-03T19:19:41.174807+0000","last_undegraded":"2023-10-03T19:19:41.174807+0000","last_fullsized":"2023-10-03T19:19:41.174807+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:54:40.452636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174925+0000","last_change":"2023-10-03T19:19:39.481769+0000","last_active":"2023-10-03T19:19:41.174925+0000","last_peered":"2023-10-03T19:19:41.174925+0000","last_clean":"2023-10-03T19:19:41.174925+0000","last_became_active":"2023-10-03T19:19:39.478997+0000","last_became_peered":"2023-10-03T19:19:39.478997+0000","last_unstale":"2023-10-03T19:19:41.174925+0000","last_undegraded":"2023-10-03T19:19:41.174925+0000","last_fullsized":"2023-10-03T19:19:41.174925+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:53:12.478710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.060759+0000","last_change":"2023-10-03T19:19:39.060759+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.060759+0000","last_undegraded":"2023-10-03T19:19:39.060759+0000","last_fullsized":"2023-10-03T19:19:39.060759+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.679023+0000","last_change":"2023-10-03T19:19:39.502839+0000","last_active":"2023-10-03T19:19:40.679023+0000","last_peered":"2023-10-03T19:19:40.679023+0000","last_clean":"2023-10-03T19:19:40.679023+0000","last_became_active":"2023-10-03T19:19:39.502343+0000","last_became_peered":"2023-10-03T19:19:39.502343+0000","last_unstale":"2023-10-03T19:19:40.679023+0000","last_undegraded":"2023-10-03T19:19:40.679023+0000","last_fullsized":"2023-10-03T19:19:40.679023+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:19:38.314320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.062240+0000","last_change":"2023-10-03T19:19:39.062240+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.062240+0000","last_undegraded":"2023-10-03T19:19:39.062240+0000","last_fullsized":"2023-10-03T19:19:39.062240+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.440839+0000","last_change":"2023-10-03T19:19:39.481255+0000","last_active":"2023-10-03T19:19:40.440839+0000","last_peered":"2023-10-03T19:19:40.440839+0000","last_clean":"2023-10-03T19:19:40.440839+0000","last_became_active":"2023-10-03T19:19:39.480541+0000","last_became_peered":"2023-10-03T19:19:39.480541+0000","last_unstale":"2023-10-03T19:19:40.440839+0000","last_undegraded":"2023-10-03T19:19:40.440839+0000","last_fullsized":"2023-10-03T19:19:40.440839+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:21:53.299603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173654+0000","last_change":"2023-10-03T19:19:39.467184+0000","last_active":"2023-10-03T19:19:41.173654+0000","last_peered":"2023-10-03T19:19:41.173654+0000","last_clean":"2023-10-03T19:19:41.173654+0000","last_became_active":"2023-10-03T19:19:39.466886+0000","last_became_peered":"2023-10-03T19:19:39.466886+0000","last_unstale":"2023-10-03T19:19:41.173654+0000","last_undegraded":"2023-10-03T19:19:41.173654+0000","last_fullsized":"2023-10-03T19:19:41.173654+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:22:29.033454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175260+0000","last_change":"2023-10-03T19:19:39.464591+0000","last_active":"2023-10-03T19:19:41.175260+0000","last_peered":"2023-10-03T19:19:41.175260+0000","last_clean":"2023-10-03T19:19:41.175260+0000","last_became_active":"2023-10-03T19:19:39.464263+0000","last_became_peered":"2023-10-03T19:19:39.464263+0000","last_unstale":"2023-10-03T19:19:41.175260+0000","last_undegraded":"2023-10-03T19:19:41.175260+0000","last_fullsized":"2023-10-03T19:19:41.175260+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:09:27.964791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.065582+0000","last_change":"2023-10-03T19:19:39.065582+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.065582+0000","last_undegraded":"2023-10-03T19:19:39.065582+0000","last_fullsized":"2023-10-03T19:19:39.065582+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174942+0000","last_change":"2023-10-03T19:19:39.439866+0000","last_active":"2023-10-03T19:19:41.174942+0000","last_peered":"2023-10-03T19:19:41.174942+0000","last_clean":"2023-10-03T19:19:41.174942+0000","last_became_active":"2023-10-03T19:19:39.439632+0000","last_became_peered":"2023-10-03T19:19:39.439632+0000","last_unstale":"2023-10-03T19:19:41.174942+0000","last_undegraded":"2023-10-03T19:19:41.174942+0000","last_fullsized":"2023-10-03T19:19:41.174942+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:15:44.398741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.441232+0000","last_change":"2023-10-03T19:19:39.470183+0000","last_active":"2023-10-03T19:19:40.441232+0000","last_peered":"2023-10-03T19:19:40.441232+0000","last_clean":"2023-10-03T19:19:40.441232+0000","last_became_active":"2023-10-03T19:19:39.469452+0000","last_became_peered":"2023-10-03T19:19:39.469452+0000","last_unstale":"2023-10-03T19:19:40.441232+0000","last_undegraded":"2023-10-03T19:19:40.441232+0000","last_fullsized":"2023-10-03T19:19:40.441232+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:01:20.873119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.441025+0000","last_change":"2023-10-03T19:19:39.503465+0000","last_active":"2023-10-03T19:19:40.441025+0000","last_peered":"2023-10-03T19:19:40.441025+0000","last_clean":"2023-10-03T19:19:40.441025+0000","last_became_active":"2023-10-03T19:19:39.503030+0000","last_became_peered":"2023-10-03T19:19:39.503030+0000","last_unstale":"2023-10-03T19:19:40.441025+0000","last_undegraded":"2023-10-03T19:19:40.441025+0000","last_fullsized":"2023-10-03T19:19:40.441025+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:43:46.831754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.066584+0000","last_change":"2023-10-03T19:19:39.066584+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.066584+0000","last_undegraded":"2023-10-03T19:19:39.066584+0000","last_fullsized":"2023-10-03T19:19:39.066584+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678338+0000","last_change":"2023-10-03T19:19:39.498786+0000","last_active":"2023-10-03T19:19:40.678338+0000","last_peered":"2023-10-03T19:19:40.678338+0000","last_clean":"2023-10-03T19:19:40.678338+0000","last_became_active":"2023-10-03T19:19:39.498287+0000","last_became_peered":"2023-10-03T19:19:39.498287+0000","last_unstale":"2023-10-03T19:19:40.678338+0000","last_undegraded":"2023-10-03T19:19:40.678338+0000","last_fullsized":"2023-10-03T19:19:40.678338+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:01:20.873119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173840+0000","last_change":"2023-10-03T19:19:39.474176+0000","last_active":"2023-10-03T19:19:41.173840+0000","last_peered":"2023-10-03T19:19:41.173840+0000","last_clean":"2023-10-03T19:19:41.173840+0000","last_became_active":"2023-10-03T19:19:39.473801+0000","last_became_peered":"2023-10-03T19:19:39.473801+0000","last_unstale":"2023-10-03T19:19:41.173840+0000","last_undegraded":"2023-10-03T19:19:41.173840+0000","last_fullsized":"2023-10-03T19:19:41.173840+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:16:06.684976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.440240+0000","last_change":"2023-10-03T19:19:39.453506+0000","last_active":"2023-10-03T19:19:40.440240+0000","last_peered":"2023-10-03T19:19:40.440240+0000","last_clean":"2023-10-03T19:19:40.440240+0000","last_became_active":"2023-10-03T19:19:39.452767+0000","last_became_peered":"2023-10-03T19:19:39.452767+0000","last_unstale":"2023-10-03T19:19:40.440240+0000","last_undegraded":"2023-10-03T19:19:40.440240+0000","last_fullsized":"2023-10-03T19:19:40.440240+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:58:52.700889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.677767+0000","last_change":"2023-10-03T19:19:39.501965+0000","last_active":"2023-10-03T19:19:40.677767+0000","last_peered":"2023-10-03T19:19:40.677767+0000","last_clean":"2023-10-03T19:19:40.677767+0000","last_became_active":"2023-10-03T19:19:39.501258+0000","last_became_peered":"2023-10-03T19:19:39.501258+0000","last_unstale":"2023-10-03T19:19:40.677767+0000","last_undegraded":"2023-10-03T19:19:40.677767+0000","last_fullsized":"2023-10-03T19:19:40.677767+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:36:34.926440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.172931+0000","last_change":"2023-10-03T19:19:39.476006+0000","last_active":"2023-10-03T19:19:41.172931+0000","last_peered":"2023-10-03T19:19:41.172931+0000","last_clean":"2023-10-03T19:19:41.172931+0000","last_became_active":"2023-10-03T19:19:39.475740+0000","last_became_peered":"2023-10-03T19:19:39.475740+0000","last_unstale":"2023-10-03T19:19:41.172931+0000","last_undegraded":"2023-10-03T19:19:41.172931+0000","last_fullsized":"2023-10-03T19:19:41.172931+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:38:59.311703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.057503+0000","last_change":"2023-10-03T19:19:39.057503+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.057503+0000","last_undegraded":"2023-10-03T19:19:39.057503+0000","last_fullsized":"2023-10-03T19:19:39.057503+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"97'4","reported_seq":17,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430274+0000","last_change":"2023-10-03T19:19:39.100745+0000","last_active":"2023-10-03T19:19:40.430274+0000","last_peered":"2023-10-03T19:19:40.430274+0000","last_clean":"2023-10-03T19:19:40.430274+0000","last_became_active":"2023-10-03T19:19:39.100413+0000","last_became_peered":"2023-10-03T19:19:39.100413+0000","last_unstale":"2023-10-03T19:19:40.430274+0000","last_undegraded":"2023-10-03T19:19:40.430274+0000","last_fullsized":"2023-10-03T19:19:40.430274+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:21:52.286906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173119+0000","last_change":"2023-10-03T19:19:39.450049+0000","last_active":"2023-10-03T19:19:41.173119+0000","last_peered":"2023-10-03T19:19:41.173119+0000","last_clean":"2023-10-03T19:19:41.173119+0000","last_became_active":"2023-10-03T19:19:39.449771+0000","last_became_peered":"2023-10-03T19:19:39.449771+0000","last_unstale":"2023-10-03T19:19:41.173119+0000","last_undegraded":"2023-10-03T19:19:41.173119+0000","last_fullsized":"2023-10-03T19:19:41.173119+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:14:44.212951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174434+0000","last_change":"2023-10-03T19:19:39.081942+0000","last_active":"2023-10-03T19:19:41.174434+0000","last_peered":"2023-10-03T19:19:41.174434+0000","last_clean":"2023-10-03T19:19:41.174434+0000","last_became_active":"2023-10-03T19:19:39.081434+0000","last_became_peered":"2023-10-03T19:19:39.081434+0000","last_unstale":"2023-10-03T19:19:41.174434+0000","last_undegraded":"2023-10-03T19:19:41.174434+0000","last_fullsized":"2023-10-03T19:19:41.174434+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:44:38.934350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.440288+0000","last_change":"2023-10-03T19:19:39.456943+0000","last_active":"2023-10-03T19:19:40.440288+0000","last_peered":"2023-10-03T19:19:40.440288+0000","last_clean":"2023-10-03T19:19:40.440288+0000","last_became_active":"2023-10-03T19:19:39.456206+0000","last_became_peered":"2023-10-03T19:19:39.456206+0000","last_unstale":"2023-10-03T19:19:40.440288+0000","last_undegraded":"2023-10-03T19:19:40.440288+0000","last_fullsized":"2023-10-03T19:19:40.440288+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:15:08.226909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.440781+0000","last_change":"2023-10-03T19:19:39.098618+0000","last_active":"2023-10-03T19:19:40.440781+0000","last_peered":"2023-10-03T19:19:40.440781+0000","last_clean":"2023-10-03T19:19:40.440781+0000","last_became_active":"2023-10-03T19:19:39.097892+0000","last_became_peered":"2023-10-03T19:19:39.097892+0000","last_unstale":"2023-10-03T19:19:40.440781+0000","last_undegraded":"2023-10-03T19:19:40.440781+0000","last_fullsized":"2023-10-03T19:19:40.440781+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:59:40.941206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.063100+0000","last_change":"2023-10-03T19:19:39.063100+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.063100+0000","last_undegraded":"2023-10-03T19:19:39.063100+0000","last_fullsized":"2023-10-03T19:19:39.063100+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176094+0000","last_change":"2023-10-03T19:19:39.084901+0000","last_active":"2023-10-03T19:19:41.176094+0000","last_peered":"2023-10-03T19:19:41.176094+0000","last_clean":"2023-10-03T19:19:41.176094+0000","last_became_active":"2023-10-03T19:19:39.084399+0000","last_became_peered":"2023-10-03T19:19:39.084399+0000","last_unstale":"2023-10-03T19:19:41.176094+0000","last_undegraded":"2023-10-03T19:19:41.176094+0000","last_fullsized":"2023-10-03T19:19:41.176094+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:37:52.382988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430110+0000","last_change":"2023-10-03T19:19:39.440443+0000","last_active":"2023-10-03T19:19:40.430110+0000","last_peered":"2023-10-03T19:19:40.430110+0000","last_clean":"2023-10-03T19:19:40.430110+0000","last_became_active":"2023-10-03T19:19:39.439566+0000","last_became_peered":"2023-10-03T19:19:39.439566+0000","last_unstale":"2023-10-03T19:19:40.430110+0000","last_undegraded":"2023-10-03T19:19:40.430110+0000","last_fullsized":"2023-10-03T19:19:40.430110+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:36:34.926440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175160+0000","last_change":"2023-10-03T19:19:39.105651+0000","last_active":"2023-10-03T19:19:41.175160+0000","last_peered":"2023-10-03T19:19:41.175160+0000","last_clean":"2023-10-03T19:19:41.175160+0000","last_became_active":"2023-10-03T19:19:39.105103+0000","last_became_peered":"2023-10-03T19:19:39.105103+0000","last_unstale":"2023-10-03T19:19:41.175160+0000","last_undegraded":"2023-10-03T19:19:41.175160+0000","last_fullsized":"2023-10-03T19:19:41.175160+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:01:43.169147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.057672+0000","last_change":"2023-10-03T19:19:39.057672+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.057672+0000","last_undegraded":"2023-10-03T19:19:39.057672+0000","last_fullsized":"2023-10-03T19:19:39.057672+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-03T19:19:39.107764+0000","last_change":"2023-10-03T19:19:39.097877+0000","last_active":"2023-10-03T19:19:39.107764+0000","last_peered":"2023-10-03T19:19:39.107764+0000","last_clean":"2023-10-03T19:19:39.107764+0000","last_became_active":"2023-10-03T19:19:39.097351+0000","last_became_peered":"2023-10-03T19:19:39.097351+0000","last_unstale":"2023-10-03T19:19:39.107764+0000","last_undegraded":"2023-10-03T19:19:39.107764+0000","last_fullsized":"2023-10-03T19:19:39.107764+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:28:16.875405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678996+0000","last_change":"2023-10-03T19:19:39.501897+0000","last_active":"2023-10-03T19:19:40.678996+0000","last_peered":"2023-10-03T19:19:40.678996+0000","last_clean":"2023-10-03T19:19:40.678996+0000","last_became_active":"2023-10-03T19:19:39.501378+0000","last_became_peered":"2023-10-03T19:19:39.501378+0000","last_unstale":"2023-10-03T19:19:40.678996+0000","last_undegraded":"2023-10-03T19:19:40.678996+0000","last_fullsized":"2023-10-03T19:19:40.678996+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:03:04.699024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.439627+0000","last_change":"2023-10-03T19:19:39.098321+0000","last_active":"2023-10-03T19:19:40.439627+0000","last_peered":"2023-10-03T19:19:40.439627+0000","last_clean":"2023-10-03T19:19:40.439627+0000","last_became_active":"2023-10-03T19:19:39.097705+0000","last_became_peered":"2023-10-03T19:19:39.097705+0000","last_unstale":"2023-10-03T19:19:40.439627+0000","last_undegraded":"2023-10-03T19:19:40.439627+0000","last_fullsized":"2023-10-03T19:19:40.439627+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:24:26.530146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430181+0000","last_change":"2023-10-03T19:19:39.443896+0000","last_active":"2023-10-03T19:19:40.430181+0000","last_peered":"2023-10-03T19:19:40.430181+0000","last_clean":"2023-10-03T19:19:40.430181+0000","last_became_active":"2023-10-03T19:19:39.443185+0000","last_became_peered":"2023-10-03T19:19:39.443185+0000","last_unstale":"2023-10-03T19:19:40.430181+0000","last_undegraded":"2023-10-03T19:19:40.430181+0000","last_fullsized":"2023-10-03T19:19:40.430181+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:59:41.953904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430269+0000","last_change":"2023-10-03T19:19:39.076525+0000","last_active":"2023-10-03T19:19:40.430269+0000","last_peered":"2023-10-03T19:19:40.430269+0000","last_clean":"2023-10-03T19:19:40.430269+0000","last_became_active":"2023-10-03T19:19:39.076125+0000","last_became_peered":"2023-10-03T19:19:39.076125+0000","last_unstale":"2023-10-03T19:19:40.430269+0000","last_undegraded":"2023-10-03T19:19:40.430269+0000","last_fullsized":"2023-10-03T19:19:40.430269+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:27:13.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.064978+0000","last_change":"2023-10-03T19:19:39.064978+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.064978+0000","last_undegraded":"2023-10-03T19:19:39.064978+0000","last_fullsized":"2023-10-03T19:19:39.064978+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.441233+0000","last_change":"2023-10-03T19:19:39.100517+0000","last_active":"2023-10-03T19:19:40.441233+0000","last_peered":"2023-10-03T19:19:40.441233+0000","last_clean":"2023-10-03T19:19:40.441233+0000","last_became_active":"2023-10-03T19:19:39.100003+0000","last_became_peered":"2023-10-03T19:19:39.100003+0000","last_unstale":"2023-10-03T19:19:40.441233+0000","last_undegraded":"2023-10-03T19:19:40.441233+0000","last_fullsized":"2023-10-03T19:19:40.441233+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:02:39.250284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175315+0000","last_change":"2023-10-03T19:19:39.445323+0000","last_active":"2023-10-03T19:19:41.175315+0000","last_peered":"2023-10-03T19:19:41.175315+0000","last_clean":"2023-10-03T19:19:41.175315+0000","last_became_active":"2023-10-03T19:19:39.445022+0000","last_became_peered":"2023-10-03T19:19:39.445022+0000","last_unstale":"2023-10-03T19:19:41.175315+0000","last_undegraded":"2023-10-03T19:19:41.175315+0000","last_fullsized":"2023-10-03T19:19:41.175315+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:14:23.979238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-03T19:19:39.077168+0000","last_change":"2023-10-03T19:19:39.075931+0000","last_active":"2023-10-03T19:19:39.077168+0000","last_peered":"2023-10-03T19:19:39.077168+0000","last_clean":"2023-10-03T19:19:39.077168+0000","last_became_active":"2023-10-03T19:19:39.075609+0000","last_became_peered":"2023-10-03T19:19:39.075609+0000","last_unstale":"2023-10-03T19:19:39.077168+0000","last_undegraded":"2023-10-03T19:19:39.077168+0000","last_fullsized":"2023-10-03T19:19:39.077168+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:28:50.042403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173596+0000","last_change":"2023-10-03T19:19:39.450085+0000","last_active":"2023-10-03T19:19:41.173596+0000","last_peered":"2023-10-03T19:19:41.173596+0000","last_clean":"2023-10-03T19:19:41.173596+0000","last_became_active":"2023-10-03T19:19:39.449720+0000","last_became_peered":"2023-10-03T19:19:39.449720+0000","last_unstale":"2023-10-03T19:19:41.173596+0000","last_undegraded":"2023-10-03T19:19:41.173596+0000","last_fullsized":"2023-10-03T19:19:41.173596+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:07:03.874445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"97'3","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175361+0000","last_change":"2023-10-03T19:19:39.083465+0000","last_active":"2023-10-03T19:19:41.175361+0000","last_peered":"2023-10-03T19:19:41.175361+0000","last_clean":"2023-10-03T19:19:41.175361+0000","last_became_active":"2023-10-03T19:19:39.082723+0000","last_became_peered":"2023-10-03T19:19:39.082723+0000","last_unstale":"2023-10-03T19:19:41.175361+0000","last_undegraded":"2023-10-03T19:19:41.175361+0000","last_fullsized":"2023-10-03T19:19:41.175361+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:45:27.547248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175742+0000","last_change":"2023-10-03T19:19:39.446159+0000","last_active":"2023-10-03T19:19:41.175742+0000","last_peered":"2023-10-03T19:19:41.175742+0000","last_clean":"2023-10-03T19:19:41.175742+0000","last_became_active":"2023-10-03T19:19:39.445909+0000","last_became_peered":"2023-10-03T19:19:39.445909+0000","last_unstale":"2023-10-03T19:19:41.175742+0000","last_undegraded":"2023-10-03T19:19:41.175742+0000","last_fullsized":"2023-10-03T19:19:41.175742+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:27:32.906536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"97'6","reported_seq":19,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678541+0000","last_change":"2023-10-03T19:19:39.092215+0000","last_active":"2023-10-03T19:19:40.678541+0000","last_peered":"2023-10-03T19:19:40.678541+0000","last_clean":"2023-10-03T19:19:40.678541+0000","last_became_active":"2023-10-03T19:19:39.085602+0000","last_became_peered":"2023-10-03T19:19:39.085602+0000","last_unstale":"2023-10-03T19:19:40.678541+0000","last_undegraded":"2023-10-03T19:19:40.678541+0000","last_fullsized":"2023-10-03T19:19:40.678541+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:02:39.250284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.064062+0000","last_change":"2023-10-03T19:19:39.064062+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.064062+0000","last_undegraded":"2023-10-03T19:19:39.064062+0000","last_fullsized":"2023-10-03T19:19:39.064062+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176071+0000","last_change":"2023-10-03T19:19:39.081438+0000","last_active":"2023-10-03T19:19:41.176071+0000","last_peered":"2023-10-03T19:19:41.176071+0000","last_clean":"2023-10-03T19:19:41.176071+0000","last_became_active":"2023-10-03T19:19:39.081161+0000","last_became_peered":"2023-10-03T19:19:39.081161+0000","last_unstale":"2023-10-03T19:19:41.176071+0000","last_undegraded":"2023-10-03T19:19:41.176071+0000","last_fullsized":"2023-10-03T19:19:41.176071+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:33:20.709972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678584+0000","last_change":"2023-10-03T19:19:39.492226+0000","last_active":"2023-10-03T19:19:40.678584+0000","last_peered":"2023-10-03T19:19:40.678584+0000","last_clean":"2023-10-03T19:19:40.678584+0000","last_became_active":"2023-10-03T19:19:39.491322+0000","last_became_peered":"2023-10-03T19:19:39.491322+0000","last_unstale":"2023-10-03T19:19:40.678584+0000","last_undegraded":"2023-10-03T19:19:40.678584+0000","last_fullsized":"2023-10-03T19:19:40.678584+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:17:18.221489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430104+0000","last_change":"2023-10-03T19:19:39.077931+0000","last_active":"2023-10-03T19:19:40.430104+0000","last_peered":"2023-10-03T19:19:40.430104+0000","last_clean":"2023-10-03T19:19:40.430104+0000","last_became_active":"2023-10-03T19:19:39.077342+0000","last_became_peered":"2023-10-03T19:19:39.077342+0000","last_unstale":"2023-10-03T19:19:40.430104+0000","last_undegraded":"2023-10-03T19:19:40.430104+0000","last_fullsized":"2023-10-03T19:19:40.430104+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:15:07.214211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174038+0000","last_change":"2023-10-03T19:19:39.476040+0000","last_active":"2023-10-03T19:19:41.174038+0000","last_peered":"2023-10-03T19:19:41.174038+0000","last_clean":"2023-10-03T19:19:41.174038+0000","last_became_active":"2023-10-03T19:19:39.475802+0000","last_became_peered":"2023-10-03T19:19:39.475802+0000","last_unstale":"2023-10-03T19:19:41.174038+0000","last_undegraded":"2023-10-03T19:19:41.174038+0000","last_fullsized":"2023-10-03T19:19:41.174038+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:49:54.029650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173284+0000","last_change":"2023-10-03T19:19:39.084666+0000","last_active":"2023-10-03T19:19:41.173284+0000","last_peered":"2023-10-03T19:19:41.173284+0000","last_clean":"2023-10-03T19:19:41.173284+0000","last_became_active":"2023-10-03T19:19:39.084383+0000","last_became_peered":"2023-10-03T19:19:39.084383+0000","last_unstale":"2023-10-03T19:19:41.173284+0000","last_undegraded":"2023-10-03T19:19:41.173284+0000","last_fullsized":"2023-10-03T19:19:41.173284+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:56:48.966597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.060292+0000","last_change":"2023-10-03T19:19:39.060292+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.060292+0000","last_undegraded":"2023-10-03T19:19:39.060292+0000","last_fullsized":"2023-10-03T19:19:39.060292+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"97'8","reported_seq":21,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.439804+0000","last_change":"2023-10-03T19:19:39.099722+0000","last_active":"2023-10-03T19:19:40.439804+0000","last_peered":"2023-10-03T19:19:40.439804+0000","last_clean":"2023-10-03T19:19:40.439804+0000","last_became_active":"2023-10-03T19:19:39.099110+0000","last_became_peered":"2023-10-03T19:19:39.099110+0000","last_unstale":"2023-10-03T19:19:40.439804+0000","last_undegraded":"2023-10-03T19:19:40.439804+0000","last_fullsized":"2023-10-03T19:19:40.439804+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:24:20.639774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.065787+0000","last_change":"2023-10-03T19:19:39.065787+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.065787+0000","last_undegraded":"2023-10-03T19:19:39.065787+0000","last_fullsized":"2023-10-03T19:19:39.065787+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176623+0000","last_change":"2023-10-03T19:19:39.078321+0000","last_active":"2023-10-03T19:19:41.176623+0000","last_peered":"2023-10-03T19:19:41.176623+0000","last_clean":"2023-10-03T19:19:41.176623+0000","last_became_active":"2023-10-03T19:19:39.078000+0000","last_became_peered":"2023-10-03T19:19:39.078000+0000","last_unstale":"2023-10-03T19:19:41.176623+0000","last_undegraded":"2023-10-03T19:19:41.176623+0000","last_fullsized":"2023-10-03T19:19:41.176623+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:42:42.684913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.439742+0000","last_change":"2023-10-03T19:19:39.453941+0000","last_active":"2023-10-03T19:19:40.439742+0000","last_peered":"2023-10-03T19:19:40.439742+0000","last_clean":"2023-10-03T19:19:40.439742+0000","last_became_active":"2023-10-03T19:19:39.453189+0000","last_became_peered":"2023-10-03T19:19:39.453189+0000","last_unstale":"2023-10-03T19:19:40.439742+0000","last_undegraded":"2023-10-03T19:19:40.439742+0000","last_fullsized":"2023-10-03T19:19:40.439742+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:17:57.802389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-03T19:19:39.096207+0000","last_change":"2023-10-03T19:19:39.095166+0000","last_active":"2023-10-03T19:19:39.096207+0000","last_peered":"2023-10-03T19:19:39.096207+0000","last_clean":"2023-10-03T19:19:39.096207+0000","last_became_active":"2023-10-03T19:19:39.094914+0000","last_became_peered":"2023-10-03T19:19:39.094914+0000","last_unstale":"2023-10-03T19:19:39.096207+0000","last_undegraded":"2023-10-03T19:19:39.096207+0000","last_fullsized":"2023-10-03T19:19:39.096207+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:07:54.333264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430357+0000","last_change":"2023-10-03T19:19:39.498605+0000","last_active":"2023-10-03T19:19:40.430357+0000","last_peered":"2023-10-03T19:19:40.430357+0000","last_clean":"2023-10-03T19:19:40.430357+0000","last_became_active":"2023-10-03T19:19:39.498286+0000","last_became_peered":"2023-10-03T19:19:39.498286+0000","last_unstale":"2023-10-03T19:19:40.430357+0000","last_undegraded":"2023-10-03T19:19:40.430357+0000","last_fullsized":"2023-10-03T19:19:40.430357+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:43:46.831754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678665+0000","last_change":"2023-10-03T19:19:39.093647+0000","last_active":"2023-10-03T19:19:40.678665+0000","last_peered":"2023-10-03T19:19:40.678665+0000","last_clean":"2023-10-03T19:19:40.678665+0000","last_became_active":"2023-10-03T19:19:39.093121+0000","last_became_peered":"2023-10-03T19:19:39.093121+0000","last_unstale":"2023-10-03T19:19:40.678665+0000","last_undegraded":"2023-10-03T19:19:40.678665+0000","last_fullsized":"2023-10-03T19:19:40.678665+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:09:28.979796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.064384+0000","last_change":"2023-10-03T19:19:39.064384+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.064384+0000","last_undegraded":"2023-10-03T19:19:39.064384+0000","last_fullsized":"2023-10-03T19:19:39.064384+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176007+0000","last_change":"2023-10-03T19:19:39.100292+0000","last_active":"2023-10-03T19:19:41.176007+0000","last_peered":"2023-10-03T19:19:41.176007+0000","last_clean":"2023-10-03T19:19:41.176007+0000","last_became_active":"2023-10-03T19:19:39.100004+0000","last_became_peered":"2023-10-03T19:19:39.100004+0000","last_unstale":"2023-10-03T19:19:41.176007+0000","last_undegraded":"2023-10-03T19:19:41.176007+0000","last_fullsized":"2023-10-03T19:19:41.176007+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:32:48.746616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174005+0000","last_change":"2023-10-03T19:19:39.450670+0000","last_active":"2023-10-03T19:19:41.174005+0000","last_peered":"2023-10-03T19:19:41.174005+0000","last_clean":"2023-10-03T19:19:41.174005+0000","last_became_active":"2023-10-03T19:19:39.450363+0000","last_became_peered":"2023-10-03T19:19:39.450363+0000","last_unstale":"2023-10-03T19:19:41.174005+0000","last_undegraded":"2023-10-03T19:19:41.174005+0000","last_fullsized":"2023-10-03T19:19:41.174005+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:38:52.937448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.440652+0000","last_change":"2023-10-03T19:19:39.093626+0000","last_active":"2023-10-03T19:19:40.440652+0000","last_peered":"2023-10-03T19:19:40.440652+0000","last_clean":"2023-10-03T19:19:40.440652+0000","last_became_active":"2023-10-03T19:19:39.093048+0000","last_became_peered":"2023-10-03T19:19:39.093048+0000","last_unstale":"2023-10-03T19:19:40.440652+0000","last_undegraded":"2023-10-03T19:19:40.440652+0000","last_fullsized":"2023-10-03T19:19:40.440652+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:36:33.913742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174002+0000","last_change":"2023-10-03T19:19:39.451443+0000","last_active":"2023-10-03T19:19:41.174002+0000","last_peered":"2023-10-03T19:19:41.174002+0000","last_clean":"2023-10-03T19:19:41.174002+0000","last_became_active":"2023-10-03T19:19:39.451178+0000","last_became_peered":"2023-10-03T19:19:39.451178+0000","last_unstale":"2023-10-03T19:19:41.174002+0000","last_undegraded":"2023-10-03T19:19:41.174002+0000","last_fullsized":"2023-10-03T19:19:41.174002+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:23:35.520091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173972+0000","last_change":"2023-10-03T19:19:39.085006+0000","last_active":"2023-10-03T19:19:41.173972+0000","last_peered":"2023-10-03T19:19:41.173972+0000","last_clean":"2023-10-03T19:19:41.173972+0000","last_became_active":"2023-10-03T19:19:39.084520+0000","last_became_peered":"2023-10-03T19:19:39.084520+0000","last_unstale":"2023-10-03T19:19:41.173972+0000","last_undegraded":"2023-10-03T19:19:41.173972+0000","last_fullsized":"2023-10-03T19:19:41.173972+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:32:44.644764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175389+0000","last_change":"2023-10-03T19:19:39.490667+0000","last_active":"2023-10-03T19:19:41.175389+0000","last_peered":"2023-10-03T19:19:41.175389+0000","last_clean":"2023-10-03T19:19:41.175389+0000","last_became_active":"2023-10-03T19:19:39.489883+0000","last_became_peered":"2023-10-03T19:19:39.489883+0000","last_unstale":"2023-10-03T19:19:41.175389+0000","last_undegraded":"2023-10-03T19:19:41.175389+0000","last_fullsized":"2023-10-03T19:19:41.175389+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:47:44.558983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678162+0000","last_change":"2023-10-03T19:19:39.093636+0000","last_active":"2023-10-03T19:19:40.678162+0000","last_peered":"2023-10-03T19:19:40.678162+0000","last_clean":"2023-10-03T19:19:40.678162+0000","last_became_active":"2023-10-03T19:19:39.093026+0000","last_became_peered":"2023-10-03T19:19:39.093026+0000","last_unstale":"2023-10-03T19:19:40.678162+0000","last_undegraded":"2023-10-03T19:19:40.678162+0000","last_fullsized":"2023-10-03T19:19:40.678162+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:43:45.819056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.067174+0000","last_change":"2023-10-03T19:19:39.067174+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.067174+0000","last_undegraded":"2023-10-03T19:19:39.067174+0000","last_fullsized":"2023-10-03T19:19:39.067174+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173694+0000","last_change":"2023-10-03T19:19:39.087025+0000","last_active":"2023-10-03T19:19:41.173694+0000","last_peered":"2023-10-03T19:19:41.173694+0000","last_clean":"2023-10-03T19:19:41.173694+0000","last_became_active":"2023-10-03T19:19:39.086598+0000","last_became_peered":"2023-10-03T19:19:39.086598+0000","last_unstale":"2023-10-03T19:19:41.173694+0000","last_undegraded":"2023-10-03T19:19:41.173694+0000","last_fullsized":"2023-10-03T19:19:41.173694+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:39:18.515681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.064555+0000","last_change":"2023-10-03T19:19:39.064555+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.064555+0000","last_undegraded":"2023-10-03T19:19:39.064555+0000","last_fullsized":"2023-10-03T19:19:39.064555+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174434+0000","last_change":"2023-10-03T19:19:39.077632+0000","last_active":"2023-10-03T19:19:41.174434+0000","last_peered":"2023-10-03T19:19:41.174434+0000","last_clean":"2023-10-03T19:19:41.174434+0000","last_became_active":"2023-10-03T19:19:39.077243+0000","last_became_peered":"2023-10-03T19:19:39.077243+0000","last_unstale":"2023-10-03T19:19:41.174434+0000","last_undegraded":"2023-10-03T19:19:41.174434+0000","last_fullsized":"2023-10-03T19:19:41.174434+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:11:33.305806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":316,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175066+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:19:41.175066+0000","last_peered":"2023-10-03T19:19:41.175066+0000","last_clean":"2023-10-03T19:19:41.175066+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:19:41.175066+0000","last_undegraded":"2023-10-03T19:19:41.175066+0000","last_fullsized":"2023-10-03T19:19:41.175066+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:01:58.556394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":156,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-03T19:19:39.078949+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:19:39.078949+0000","last_peered":"2023-10-03T19:19:39.078949+0000","last_clean":"2023-10-03T19:19:39.078949+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:19:39.078949+0000","last_undegraded":"2023-10-03T19:19:39.078949+0000","last_fullsized":"2023-10-03T19:19:39.078949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:51:45.180638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.677990+0000","last_change":"2023-10-03T19:19:39.490296+0000","last_active":"2023-10-03T19:19:40.677990+0000","last_peered":"2023-10-03T19:19:40.677990+0000","last_clean":"2023-10-03T19:19:40.677990+0000","last_became_active":"2023-10-03T19:19:39.489715+0000","last_became_peered":"2023-10-03T19:19:39.489715+0000","last_unstale":"2023-10-03T19:19:40.677990+0000","last_undegraded":"2023-10-03T19:19:40.677990+0000","last_fullsized":"2023-10-03T19:19:40.677990+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:21:53.299603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175437+0000","last_change":"2023-10-03T19:19:39.092502+0000","last_active":"2023-10-03T19:19:41.175437+0000","last_peered":"2023-10-03T19:19:41.175437+0000","last_clean":"2023-10-03T19:19:41.175437+0000","last_became_active":"2023-10-03T19:19:39.091671+0000","last_became_peered":"2023-10-03T19:19:39.091671+0000","last_unstale":"2023-10-03T19:19:41.175437+0000","last_undegraded":"2023-10-03T19:19:41.175437+0000","last_fullsized":"2023-10-03T19:19:41.175437+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:28:58.772881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":164,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174651+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:19:41.174651+0000","last_peered":"2023-10-03T19:19:41.174651+0000","last_clean":"2023-10-03T19:19:41.174651+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:19:41.174651+0000","last_undegraded":"2023-10-03T19:19:41.174651+0000","last_fullsized":"2023-10-03T19:19:41.174651+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:28:06.684655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175720+0000","last_change":"2023-10-03T19:19:39.474081+0000","last_active":"2023-10-03T19:19:41.175720+0000","last_peered":"2023-10-03T19:19:41.175720+0000","last_clean":"2023-10-03T19:19:41.175720+0000","last_became_active":"2023-10-03T19:19:39.473795+0000","last_became_peered":"2023-10-03T19:19:39.473795+0000","last_unstale":"2023-10-03T19:19:41.175720+0000","last_undegraded":"2023-10-03T19:19:41.175720+0000","last_fullsized":"2023-10-03T19:19:41.175720+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:50:56.639365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-03T19:19:39.107801+0000","last_change":"2023-10-03T19:19:39.097664+0000","last_active":"2023-10-03T19:19:39.107801+0000","last_peered":"2023-10-03T19:19:39.107801+0000","last_clean":"2023-10-03T19:19:39.107801+0000","last_became_active":"2023-10-03T19:19:39.097135+0000","last_became_peered":"2023-10-03T19:19:39.097135+0000","last_unstale":"2023-10-03T19:19:39.107801+0000","last_undegraded":"2023-10-03T19:19:39.107801+0000","last_fullsized":"2023-10-03T19:19:39.107801+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:07:06.406878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173371+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:19:41.173371+0000","last_peered":"2023-10-03T19:19:41.173371+0000","last_clean":"2023-10-03T19:19:41.173371+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:19:41.173371+0000","last_undegraded":"2023-10-03T19:19:41.173371+0000","last_fullsized":"2023-10-03T19:19:41.173371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:50:13.204633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173376+0000","last_change":"2023-10-03T19:19:39.445108+0000","last_active":"2023-10-03T19:19:41.173376+0000","last_peered":"2023-10-03T19:19:41.173376+0000","last_clean":"2023-10-03T19:19:41.173376+0000","last_became_active":"2023-10-03T19:19:39.443964+0000","last_became_peered":"2023-10-03T19:19:39.443964+0000","last_unstale":"2023-10-03T19:19:41.173376+0000","last_undegraded":"2023-10-03T19:19:41.173376+0000","last_fullsized":"2023-10-03T19:19:41.173376+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:50:29.706153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678974+0000","last_change":"2023-10-03T19:19:39.099820+0000","last_active":"2023-10-03T19:19:40.678974+0000","last_peered":"2023-10-03T19:19:40.678974+0000","last_clean":"2023-10-03T19:19:40.678974+0000","last_became_active":"2023-10-03T19:19:39.094297+0000","last_became_peered":"2023-10-03T19:19:39.094297+0000","last_unstale":"2023-10-03T19:19:40.678974+0000","last_undegraded":"2023-10-03T19:19:40.678974+0000","last_fullsized":"2023-10-03T19:19:40.678974+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:25:05.736398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":156,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-03T19:19:39.076080+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:19:39.076080+0000","last_peered":"2023-10-03T19:19:39.076080+0000","last_clean":"2023-10-03T19:19:39.076080+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:19:39.076080+0000","last_undegraded":"2023-10-03T19:19:39.076080+0000","last_fullsized":"2023-10-03T19:19:39.076080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:42:50.307434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.429963+0000","last_change":"2023-10-03T19:19:39.499012+0000","last_active":"2023-10-03T19:19:40.429963+0000","last_peered":"2023-10-03T19:19:40.429963+0000","last_clean":"2023-10-03T19:19:40.429963+0000","last_became_active":"2023-10-03T19:19:39.498726+0000","last_became_peered":"2023-10-03T19:19:39.498726+0000","last_unstale":"2023-10-03T19:19:40.429963+0000","last_undegraded":"2023-10-03T19:19:40.429963+0000","last_fullsized":"2023-10-03T19:19:40.429963+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:24:21.652472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678086+0000","last_change":"2023-10-03T19:19:39.090362+0000","last_active":"2023-10-03T19:19:40.678086+0000","last_peered":"2023-10-03T19:19:40.678086+0000","last_clean":"2023-10-03T19:19:40.678086+0000","last_became_active":"2023-10-03T19:19:39.089665+0000","last_became_peered":"2023-10-03T19:19:39.089665+0000","last_unstale":"2023-10-03T19:19:40.678086+0000","last_undegraded":"2023-10-03T19:19:40.678086+0000","last_fullsized":"2023-10-03T19:19:40.678086+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:27:13.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":156,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176195+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:19:41.176195+0000","last_peered":"2023-10-03T19:19:41.176195+0000","last_clean":"2023-10-03T19:19:41.176195+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:19:41.176195+0000","last_undegraded":"2023-10-03T19:19:41.176195+0000","last_fullsized":"2023-10-03T19:19:41.176195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:20:40.902125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174641+0000","last_change":"2023-10-03T19:19:39.451521+0000","last_active":"2023-10-03T19:19:41.174641+0000","last_peered":"2023-10-03T19:19:41.174641+0000","last_clean":"2023-10-03T19:19:41.174641+0000","last_became_active":"2023-10-03T19:19:39.451224+0000","last_became_peered":"2023-10-03T19:19:39.451224+0000","last_unstale":"2023-10-03T19:19:41.174641+0000","last_undegraded":"2023-10-03T19:19:41.174641+0000","last_fullsized":"2023-10-03T19:19:41.174641+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:50:20.369948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173326+0000","last_change":"2023-10-03T19:19:39.072003+0000","last_active":"2023-10-03T19:19:41.173326+0000","last_peered":"2023-10-03T19:19:41.173326+0000","last_clean":"2023-10-03T19:19:41.173326+0000","last_became_active":"2023-10-03T19:19:39.071324+0000","last_became_peered":"2023-10-03T19:19:39.071324+0000","last_unstale":"2023-10-03T19:19:41.173326+0000","last_undegraded":"2023-10-03T19:19:41.173326+0000","last_fullsized":"2023-10-03T19:19:41.173326+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:01:20.263082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":164,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175496+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:19:41.175496+0000","last_peered":"2023-10-03T19:19:41.175496+0000","last_clean":"2023-10-03T19:19:41.175496+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:19:41.175496+0000","last_undegraded":"2023-10-03T19:19:41.175496+0000","last_fullsized":"2023-10-03T19:19:41.175496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:44:47.179646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.061302+0000","last_change":"2023-10-03T19:19:39.061302+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.061302+0000","last_undegraded":"2023-10-03T19:19:39.061302+0000","last_fullsized":"2023-10-03T19:19:39.061302+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174033+0000","last_change":"2023-10-03T19:19:39.080203+0000","last_active":"2023-10-03T19:19:41.174033+0000","last_peered":"2023-10-03T19:19:41.174033+0000","last_clean":"2023-10-03T19:19:41.174033+0000","last_became_active":"2023-10-03T19:19:39.079875+0000","last_became_peered":"2023-10-03T19:19:39.079875+0000","last_unstale":"2023-10-03T19:19:41.174033+0000","last_undegraded":"2023-10-03T19:19:41.174033+0000","last_fullsized":"2023-10-03T19:19:41.174033+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:47:10.549041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":156,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176538+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:19:41.176538+0000","last_peered":"2023-10-03T19:19:41.176538+0000","last_clean":"2023-10-03T19:19:41.176538+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:19:41.176538+0000","last_undegraded":"2023-10-03T19:19:41.176538+0000","last_fullsized":"2023-10-03T19:19:41.176538+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:00:06.011070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.061790+0000","last_change":"2023-10-03T19:19:39.061790+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.061790+0000","last_undegraded":"2023-10-03T19:19:39.061790+0000","last_fullsized":"2023-10-03T19:19:39.061790+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173183+0000","last_change":"2023-10-03T19:19:39.073332+0000","last_active":"2023-10-03T19:19:41.173183+0000","last_peered":"2023-10-03T19:19:41.173183+0000","last_clean":"2023-10-03T19:19:41.173183+0000","last_became_active":"2023-10-03T19:19:39.072635+0000","last_became_peered":"2023-10-03T19:19:39.072635+0000","last_unstale":"2023-10-03T19:19:41.173183+0000","last_undegraded":"2023-10-03T19:19:41.173183+0000","last_fullsized":"2023-10-03T19:19:41.173183+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:58:24.112901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":156,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.679025+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:19:40.679025+0000","last_peered":"2023-10-03T19:19:40.679025+0000","last_clean":"2023-10-03T19:19:40.679025+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:19:40.679025+0000","last_undegraded":"2023-10-03T19:19:40.679025+0000","last_fullsized":"2023-10-03T19:19:40.679025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:11:45.085836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509531,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33704,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":32448,"kb_avail":94338136,"statfs":{"total":96636764160,"available":96602251264,"internally_reserved":0,"allocated":1277952,"data_stored":1142210,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":33226752},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.85899999999999999,"15min":0.92700000000000005},"min":{"1min":0.66300000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1950000000000001,"5min":1.206,"15min":4.0469999999999997},"last":2.1080000000000001},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.85299999999999998,"15min":0.82099999999999995},"min":{"1min":0.55200000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.177,"5min":1.2310000000000001,"15min":1.3420000000000001},"last":1.121}]},{"osd":1,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.86299999999999999,"15min":0.98599999999999999},"min":{"1min":0.61899999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1359999999999999,"5min":1.3200000000000001,"15min":3.8239999999999998},"last":2.298},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.89800000000000002,"15min":0.87},"min":{"1min":0.64500000000000002,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.034}]},{"osd":2,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.95899999999999996,"15min":0.88400000000000001},"min":{"1min":0.55300000000000005,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1719999999999999,"5min":6.0449999999999999,"15min":6.0449999999999999},"last":4.4779999999999998},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.94199999999999995,"15min":1.0109999999999999},"min":{"1min":0.69999999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.296,"5min":1.5800000000000001,"15min":3.98},"last":2.673}]},{"osd":3,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.034,"15min":0.95799999999999996},"min":{"1min":0.68500000000000005,"5min":0.63800000000000001,"15min":0.51100000000000001},"max":{"1min":1.232,"5min":6.125,"15min":6.125},"last":4.3650000000000002},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.97599999999999998,"15min":1.0840000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.175,"5min":1.444,"15min":3.9140000000000001},"last":1.593}]},{"osd":4,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.89800000000000002,"15min":1.0920000000000001},"min":{"1min":0.61599999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":5.1130000000000004},"last":2.4769999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.016,"15min":1.018},"min":{"1min":0.70699999999999996,"5min":0.629,"15min":0.629},"max":{"1min":1.214,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":12.196999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.006,"15min":1.2010000000000001},"min":{"1min":0.63700000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2470000000000001,"5min":1.349,"15min":5.1859999999999999},"last":2.581},{"interface":"front","average":{"1min":1.004,"5min":1.0209999999999999,"15min":1.115},"min":{"1min":0.69299999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.29,"5min":1.2949999999999999,"15min":2.0609999999999999},"last":1.6719999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0740000000000001,"15min":1.093},"min":{"1min":0.80000000000000004,"5min":0.75700000000000001,"15min":0.69399999999999995},"max":{"1min":1.3839999999999999,"5min":1.4890000000000001,"15min":1.5449999999999999},"last":1.7609999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.1459999999999999,"15min":1.167},"min":{"1min":0.77800000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.232,"5min":6.1580000000000004,"15min":6.1580000000000004},"last":4.5570000000000004}]}]},{"osd":6,"up_from":15,"seq":64424509531,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26992,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":25792,"kb_avail":94344848,"statfs":{"total":96636764160,"available":96609124352,"internally_reserved":0,"allocated":1220608,"data_stored":552686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":26411008},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.84599999999999997,"15min":0.82699999999999996},"min":{"1min":0.54100000000000004,"5min":0.45400000000000001,"15min":0.44600000000000001},"max":{"1min":1.234,"5min":1.3340000000000001,"15min":1.504},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.91100000000000003,"15min":0.88900000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.44600000000000001},"max":{"1min":1.1080000000000001,"5min":1.423,"15min":1.839},"last":1.2430000000000001}]},{"osd":1,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.86699999999999999,"15min":0.84699999999999998},"min":{"1min":0.56000000000000005,"5min":0.52100000000000002,"15min":0.504},"max":{"1min":1.1859999999999999,"5min":1.27,"15min":2.0150000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.88900000000000001,"15min":0.88200000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.161,"5min":1.448,"15min":1.448},"last":0.73599999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.93799999999999994,"15min":0.88900000000000001},"min":{"1min":0.66400000000000003,"5min":0.59199999999999997,"15min":0.51900000000000002},"max":{"1min":1.4430000000000001,"5min":1.528,"15min":1.528},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.92700000000000005,"15min":0.92500000000000004},"min":{"1min":0.60899999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1519999999999999,"5min":1.369,"15min":1.546},"last":0.96199999999999997}]},{"osd":3,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.96299999999999997,"15min":0.97899999999999998},"min":{"1min":0.68899999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.298,"5min":1.377,"15min":1.6990000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90700000000000003,"15min":0.90800000000000003},"min":{"1min":0.70199999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.143,"5min":1.206,"15min":2.121},"last":0.79600000000000004}]},{"osd":4,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.91600000000000004,"15min":0.998},"min":{"1min":0.67400000000000004,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.335,"5min":1.339,"15min":1.95},"last":1.075},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.995,"15min":1.0680000000000001},"min":{"1min":0.64400000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4490000000000001,"5min":1.504,"15min":1.7709999999999999},"last":1.1120000000000001}]},{"osd":5,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.90700000000000003,"15min":0.99199999999999999},"min":{"1min":0.624,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.226,"5min":1.3200000000000001,"15min":2.2570000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.048,"15min":1.103},"min":{"1min":0.71799999999999997,"5min":0.68300000000000005,"15min":0.68100000000000005},"max":{"1min":1.5009999999999999,"5min":1.524,"15min":2.0619999999999998},"last":1.2010000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.071,"15min":1.109},"min":{"1min":0.748,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.639,"5min":1.639,"15min":2.0049999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.044,"15min":1.0820000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.61899999999999999},"max":{"1min":1.3879999999999999,"5min":1.4350000000000001,"15min":2.4249999999999998},"last":1.151}]}]},{"osd":4,"up_from":15,"seq":64424509532,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42152,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":40960,"kb_avail":94329688,"statfs":{"total":96636764160,"available":96593600512,"internally_reserved":0,"allocated":1212416,"data_stored":551774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":41943040},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":1.0600000000000001,"15min":0.875},"min":{"1min":0.64200000000000002,"5min":0.54700000000000004,"15min":0.50600000000000001},"max":{"1min":1.0600000000000001,"5min":17.686,"15min":17.686},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.90100000000000002,"5min":1.02,"15min":0.89000000000000001},"min":{"1min":0.64000000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.28,"5min":16.925999999999998,"15min":16.925999999999998},"last":0.622}]},{"osd":1,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.085,"15min":0.98499999999999999},"min":{"1min":0.67700000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1759999999999999,"5min":16.640999999999998,"15min":16.640999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":1.089,"15min":0.93400000000000005},"min":{"1min":0.67300000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.151,"5min":17.59,"15min":17.59},"last":0.80700000000000005}]},{"osd":2,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.997,"15min":0.94299999999999995},"min":{"1min":0.70699999999999996,"5min":0.56200000000000006,"15min":0.53200000000000003},"max":{"1min":1.1180000000000001,"5min":8.5630000000000006,"15min":8.5630000000000006},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.93999999999999995,"5min":1.143,"15min":1.01},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.175,"5min":17.734000000000002,"15min":17.734000000000002},"last":0.88800000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.0880000000000001,"15min":0.94299999999999995},"min":{"1min":0.72499999999999998,"5min":0.61499999999999999,"15min":0.53900000000000003},"max":{"1min":1.242,"5min":16.98,"15min":16.98},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.997,"5min":1.161,"15min":1.105},"min":{"1min":0.66900000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2789999999999999,"5min":16.434000000000001,"15min":16.434000000000001},"last":0.82999999999999996}]},{"osd":5,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":1.1020000000000001,"15min":1.0820000000000001},"min":{"1min":0.624,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.143,"5min":17.782,"15min":17.782},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.96599999999999997,"15min":1.002},"min":{"1min":0.65700000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.264,"5min":1.708,"15min":1.708},"last":0.77000000000000002}]},{"osd":6,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.3859999999999999,"15min":1.27},"min":{"1min":0.66000000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.2250000000000001,"5min":36.106000000000002,"15min":36.106000000000002},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.2450000000000001,"15min":1.216},"min":{"1min":0.86099999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.2410000000000001,"5min":17.646999999999998,"15min":17.646999999999998},"last":0.97299999999999998}]},{"osd":7,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.226,"15min":1.1359999999999999},"min":{"1min":0.81200000000000006,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.421,"5min":17.042000000000002,"15min":17.042000000000002},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.3,"15min":1.262},"min":{"1min":0.83199999999999996,"5min":0.66400000000000003,"15min":0.63300000000000001},"max":{"1min":1.4670000000000001,"5min":16.32,"15min":16.32},"last":0.998}]}]},{"osd":2,"up_from":15,"seq":64424509532,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":31424,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1204224,"data_stored":550552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":32178176},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.79100000000000004,"15min":0.61299999999999999},"min":{"1min":0.47799999999999998,"5min":0.32200000000000001,"15min":0.247},"max":{"1min":0.98199999999999998,"5min":13.629,"15min":13.629},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":1.206,"15min":0.80900000000000005},"min":{"1min":0.34000000000000002,"5min":0.30299999999999999,"15min":0.28999999999999998},"max":{"1min":0.97199999999999998,"5min":40.439,"15min":40.439},"last":0.53200000000000003}]},{"osd":1,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.90200000000000002,"15min":0.71099999999999997},"min":{"1min":0.47899999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1,"5min":14.074,"15min":14.074},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.78500000000000003,"15min":0.64900000000000002},"min":{"1min":0.38800000000000001,"5min":0.34799999999999998,"15min":0.26400000000000001},"max":{"1min":1.1080000000000001,"5min":7.0060000000000002,"15min":7.0060000000000002},"last":0.44800000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.90000000000000002,"15min":0.71299999999999997},"min":{"1min":0.36699999999999999,"5min":0.28899999999999998,"15min":0.224},"max":{"1min":1.05,"5min":13.423999999999999,"15min":13.423999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.0649999999999999,"15min":0.82899999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.36399999999999999},"max":{"1min":1.1220000000000001,"5min":18.568999999999999,"15min":18.568999999999999},"last":0.56799999999999995}]},{"osd":4,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.94999999999999996,"15min":0.878},"min":{"1min":0.64200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.105,"5min":1.718,"15min":1.718},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.3380000000000001,"15min":1.05},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.22,"5min":28.667999999999999,"15min":28.667999999999999},"last":0.63}]},{"osd":5,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.0529999999999999,"15min":0.92100000000000004},"min":{"1min":0.67600000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.399,"5min":5.4459999999999997,"15min":5.4459999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.2230000000000001,"15min":1.0309999999999999},"min":{"1min":0.63300000000000001,"5min":0.57599999999999996,"15min":0.52700000000000002},"max":{"1min":1.4970000000000001,"5min":14.007,"15min":14.007},"last":0.70299999999999996}]},{"osd":6,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":1.1040000000000001,"15min":0.97099999999999997},"min":{"1min":0.65900000000000003,"5min":0.60099999999999998,"15min":0.49099999999999999},"max":{"1min":1.212,"5min":10.679,"15min":10.679},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.087,"15min":1.004},"min":{"1min":0.75600000000000001,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.325,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.88200000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.3240000000000001,"15min":1.1080000000000001},"min":{"1min":0.70299999999999996,"5min":0.63100000000000001,"15min":0.56100000000000005},"max":{"1min":1.415,"5min":18.623000000000001,"15min":18.623000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":1.002,"5min":1.0920000000000001,"15min":0.996},"min":{"1min":0.61699999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1850000000000001,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.84499999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509531,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30628,"kb_used_data":1180,"kb_used_omap":0,"kb_used_meta":29440,"kb_avail":94341212,"statfs":{"total":96636764160,"available":96605401088,"internally_reserved":0,"allocated":1208320,"data_stored":551716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30146560},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59199999999999997,"15min":0.55600000000000005},"min":{"1min":0.27900000000000003,"5min":0.27200000000000002,"15min":0.26900000000000002},"max":{"1min":0.92100000000000004,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70399999999999996,"15min":0.56799999999999995},"min":{"1min":0.41799999999999998,"5min":0.27200000000000002,"15min":0.22900000000000001},"max":{"1min":1.1899999999999999,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.41799999999999998}]},{"osd":2,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68300000000000005,"15min":0.58899999999999997},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.26200000000000001},"max":{"1min":0.879,"5min":1.506,"15min":1.506},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.82099999999999995,"15min":0.70599999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.312},"max":{"1min":1.1919999999999999,"5min":1.365,"15min":1.365},"last":0.82999999999999996}]},{"osd":3,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.76400000000000001,"15min":0.67300000000000004},"min":{"1min":0.36099999999999999,"5min":0.31,"15min":0.31},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.75700000000000001,"15min":0.63400000000000001},"min":{"1min":0.39100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.90700000000000003,"5min":1.232,"15min":1.27},"last":0.70899999999999996}]},{"osd":4,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.89000000000000001,"15min":0.82799999999999996},"min":{"1min":0.61199999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0860000000000001,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.98499999999999999,"15min":0.91400000000000003},"min":{"1min":0.69899999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3260000000000001,"5min":1.728,"15min":1.728},"last":1.0609999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.98999999999999999,"15min":0.89500000000000002},"min":{"1min":0.60299999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.28,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.117},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.96299999999999997,"15min":0.88500000000000001},"min":{"1min":0.77300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.198,"5min":1.3959999999999999,"15min":1.6080000000000001},"last":0.89200000000000002}]},{"osd":6,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0349999999999999,"15min":0.95399999999999996},"min":{"1min":0.59499999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2689999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.149},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0289999999999999,"15min":0.93400000000000005},"min":{"1min":0.66700000000000004,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3600000000000001,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.0229999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0669999999999999,"15min":0.97599999999999998},"min":{"1min":0.55100000000000005,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.292,"5min":1.673,"15min":1.673},"last":1.204},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0289999999999999,"15min":0.93999999999999995},"min":{"1min":0.67500000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4379999999999999,"5min":1.5880000000000001,"15min":1.649},"last":1.1719999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542235,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25176,"kb_used_data":1168,"kb_used_omap":0,"kb_used_meta":24000,"kb_avail":94346664,"statfs":{"total":96636764160,"available":96610983936,"internally_reserved":0,"allocated":1196032,"data_stored":545611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24576000},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.63200000000000001,"15min":0.58799999999999997},"min":{"1min":0.36399999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.96199999999999997,"5min":1.212,"15min":1.212},"last":0.221},{"interface":"front","average":{"1min":0.755,"5min":0.69999999999999996,"15min":0.66000000000000003},"min":{"1min":0.38900000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.5,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.33700000000000002}]},{"osd":1,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.70399999999999996,"15min":0.64800000000000002},"min":{"1min":0.42299999999999999,"5min":0.28599999999999998,"15min":0.27000000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76000000000000001,"15min":0.69099999999999995},"min":{"1min":0.34300000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.169,"5min":1.2210000000000001,"15min":1.222},"last":0.40300000000000002}]},{"osd":2,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.79400000000000004,"15min":0.73299999999999998},"min":{"1min":0.35999999999999999,"5min":0.317,"15min":0.317},"max":{"1min":1.1539999999999999,"5min":1.23,"15min":1.23},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73199999999999998,"15min":0.66000000000000003},"min":{"1min":0.371,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.05,"5min":1.671,"15min":1.671},"last":0.316}]},{"osd":4,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.92000000000000004,"15min":0.91200000000000003},"min":{"1min":0.63900000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2949999999999999,"5min":1.411,"15min":1.496},"last":0.58699999999999997},{"interface":"front","average":{"1min":1.006,"5min":1.018,"15min":0.95599999999999996},"min":{"1min":0.76400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3280000000000001,"5min":1.546,"15min":1.546},"last":0.44800000000000001}]},{"osd":5,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.91200000000000003,"15min":0.88700000000000001},"min":{"1min":0.63300000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.095,"5min":1.581,"15min":1.581},"last":0.50600000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.022,"15min":1.004},"min":{"1min":0.68100000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4179999999999999,"5min":1.498,"15min":1.498},"last":0.60699999999999998}]},{"osd":6,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.94599999999999995,"15min":0.92800000000000005},"min":{"1min":0.68799999999999994,"5min":0.56999999999999995,"15min":0.56699999999999995},"max":{"1min":1.212,"5min":1.347,"15min":1.347},"last":0.47799999999999998},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.05,"15min":1.006},"min":{"1min":0.80000000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.373,"5min":1.4970000000000001,"15min":1.5629999999999999},"last":0.56399999999999995}]},{"osd":7,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.083,"15min":1.0289999999999999},"min":{"1min":0.70599999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":1.109,"5min":1.0609999999999999,"15min":1.03},"min":{"1min":0.65300000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.659,"5min":1.659,"15min":1.708},"last":0.625}]}]},{"osd":5,"up_from":13,"seq":55834574938,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22716,"kb_used_data":1140,"kb_used_omap":0,"kb_used_meta":21568,"kb_avail":94349124,"statfs":{"total":96636764160,"available":96613502976,"internally_reserved":0,"allocated":1167360,"data_stored":531273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22085632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.85799999999999998,"15min":0.83399999999999996},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.181,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.89400000000000002,"15min":0.86599999999999999},"min":{"1min":0.78200000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.26,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.1990000000000001}]},{"osd":1,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.872,"15min":0.84499999999999997},"min":{"1min":0.505,"5min":0.501,"15min":0.501},"max":{"1min":1.044,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.91000000000000003,"15min":0.92300000000000004},"min":{"1min":0.63100000000000001,"5min":0.58699999999999997,"15min":0.57099999999999995},"max":{"1min":1.23,"5min":1.23,"15min":1.514},"last":1.127}]},{"osd":2,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.91000000000000003,"15min":0.90300000000000002},"min":{"1min":0.625,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2010000000000001,"5min":1.351,"15min":1.3700000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.999,"5min":0.93000000000000005,"15min":0.90600000000000003},"min":{"1min":0.82499999999999996,"5min":0.57099999999999995,"15min":0.53300000000000003},"max":{"1min":1.1819999999999999,"5min":1.1930000000000001,"15min":1.3320000000000001},"last":1.056}]},{"osd":3,"last update":"Tue Oct 3 19:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.93600000000000005,"15min":0.93100000000000005},"min":{"1min":0.67700000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2210000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.046,"5min":1.03,"15min":1.028},"min":{"1min":0.78700000000000003,"5min":0.65900000000000003,"15min":0.61199999999999999},"max":{"1min":1.3129999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.80400000000000005}]},{"osd":4,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.97499999999999998,"15min":0.97299999999999998},"min":{"1min":0.70699999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.2450000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96399999999999997,"15min":1.0129999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2749999999999999,"5min":1.335,"15min":1.7709999999999999},"last":0.73699999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.995,"15min":1.024},"min":{"1min":0.67000000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.204,"5min":1.546,"15min":1.546},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0880000000000001,"15min":1.1240000000000001},"min":{"1min":0.82499999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.3759999999999999,"5min":1.823,"15min":1.823},"last":0.93000000000000005}]},{"osd":7,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0569999999999999,"15min":1.071},"min":{"1min":0.68700000000000006,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.5680000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.119,"15min":1.143},"min":{"1min":0.86499999999999999,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.325,"5min":1.4179999999999999,"15min":1.9099999999999999},"last":1.012}]}]},{"osd":0,"up_from":13,"seq":55834574939,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30072,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":28864,"kb_avail":94341768,"statfs":{"total":96636764160,"available":96605970432,"internally_reserved":0,"allocated":1228800,"data_stored":1120477,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":29556736},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.69699999999999995,"15min":0.61399999999999999},"min":{"1min":0.502,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.92000000000000004,"5min":5.7480000000000002,"15min":5.7480000000000002},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.80900000000000005,"15min":0.746},"min":{"1min":0.54700000000000004,"5min":0.37,"15min":0.33000000000000002},"max":{"1min":1.0760000000000001,"5min":6.274,"15min":6.274},"last":0.84899999999999998}]},{"osd":2,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.81999999999999995,"15min":0.746},"min":{"1min":0.46700000000000003,"5min":0.36499999999999999,"15min":0.35399999999999998},"max":{"1min":0.97599999999999998,"5min":6.1609999999999996,"15min":6.1609999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71499999999999997,"15min":0.69899999999999995},"min":{"1min":0.44500000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.997,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.80200000000000005}]},{"osd":3,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.90800000000000003,"15min":0.78000000000000003},"min":{"1min":0.57499999999999996,"5min":0.41799999999999998,"15min":0.36799999999999999},"max":{"1min":1.1739999999999999,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82199999999999995,"15min":0.73199999999999998},"min":{"1min":0.53300000000000003,"5min":0.376,"15min":0.30299999999999999},"max":{"1min":1.0780000000000001,"5min":1.375,"15min":1.375},"last":0.93200000000000005}]},{"osd":4,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":1.0029999999999999,"15min":0.93600000000000005},"min":{"1min":0.71299999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.254,"5min":8.1159999999999997,"15min":8.1159999999999997},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.056,"5min":1.0860000000000001,"15min":1.0429999999999999},"min":{"1min":0.71199999999999997,"5min":0.57299999999999995,"15min":0.504},"max":{"1min":1.3440000000000001,"5min":6.2320000000000002,"15min":6.2320000000000002},"last":1.0960000000000001}]},{"osd":5,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.2549999999999999,"15min":1.1140000000000001},"min":{"1min":0.69199999999999995,"5min":0.59399999999999997,"15min":0.46899999999999997},"max":{"1min":1.4259999999999999,"5min":17.420000000000002,"15min":17.420000000000002},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.222,"15min":1.052},"min":{"1min":0.74299999999999999,"5min":0.59499999999999997,"15min":0.54300000000000004},"max":{"1min":1.371,"5min":17.643000000000001,"15min":17.643000000000001},"last":1.048}]},{"osd":6,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0880000000000001,"15min":1.038},"min":{"1min":0.77500000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3520000000000001,"5min":5.7220000000000004,"15min":5.7220000000000004},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0669999999999999,"15min":1.0129999999999999},"min":{"1min":0.877,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.417,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.1479999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.159,"15min":1.0740000000000001},"min":{"1min":0.81299999999999994,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3939999999999999,"5min":5.7800000000000002,"15min":5.7800000000000002},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.0920000000000001,"15min":1.0669999999999999},"min":{"1min":0.85699999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.343,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.21}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:19:42.711 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:19:42.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.864+0000 7f666112a640 1 Processor -- start 2023-10-03T19:19:42.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.864+0000 7f666112a640 1 -- start start 2023-10-03T19:19:42.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.868+0000 7f666112a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f665c14f240 0x7f665c1528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:42.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.868+0000 7f666112a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f665c0bb1d0 0x7f665c0c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:42.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.868+0000 7f666112a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f665c06b2d0 con 0x7f665c0c2790 2023-10-03T19:19:42.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.868+0000 7f666112a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f665c06b640 con 0x7f665c14f240 2023-10-03T19:19:42.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.868+0000 7f666112a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665c0a3c60 con 0x7f665c0bb1d0 2023-10-03T19:19:42.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.868+0000 7f665ad9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f665c14f240 0x7f665c1528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:42.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.868+0000 7f665b59e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f665c0bb1d0 0x7f665c0c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:42.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.868+0000 7f665ad9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f665c14f240 0x7f665c1528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:37314/0 (socket says 172.21.15.45:37314) 2023-10-03T19:19:42.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.868+0000 7f665a59c640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f665c0c2790 0x7f665c0c0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:43696/0 (socket says 172.21.15.45:43696) 2023-10-03T19:19:42.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.868+0000 7f665ad9d640 1 -- 172.21.15.45:0/1191654027 learned_addr learned my addr 172.21.15.45:0/1191654027 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:42.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.868+0000 7f665ad9d640 1 -- 172.21.15.45:0/1191654027 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f665c0bb1d0 msgr2=0x7f665c0c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:42.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.868+0000 7f665ad9d640 1 --2- 172.21.15.45:0/1191654027 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f665c0bb1d0 0x7f665c0c12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.868+0000 7f665ad9d640 1 -- 172.21.15.45:0/1191654027 >> v1:172.21.15.79:6789/0 conn(0x7f665c0c2790 legacy=0x7f665c0c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:42.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.868+0000 7f665ad9d640 1 -- 172.21.15.45:0/1191654027 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665c14e740 con 0x7f665c14f240 2023-10-03T19:19:42.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f665ad9d640 1 --2- 172.21.15.45:0/1191654027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f665c14f240 0x7f665c1528d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f664c006fd0 tx=0x7f664c01ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e440bd091b75fbde server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:42.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f6659d9b640 1 -- 172.21.15.45:0/1191654027 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664c0a8a10 con 0x7f665c14f240 2023-10-03T19:19:42.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f6659d9b640 1 -- 172.21.15.45:0/1191654027 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664c0a8b70 con 0x7f665c14f240 2023-10-03T19:19:42.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f6659d9b640 1 -- 172.21.15.45:0/1191654027 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664c0b0440 con 0x7f665c14f240 2023-10-03T19:19:42.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f666112a640 1 -- 172.21.15.45:0/1191654027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f665c14f240 msgr2=0x7f665c1528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:42.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f666112a640 1 --2- 172.21.15.45:0/1191654027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f665c14f240 0x7f665c1528d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f664c006fd0 tx=0x7f664c01ed10 comp rx=0 tx=0).stop 2023-10-03T19:19:42.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f666112a640 1 -- 172.21.15.45:0/1191654027 shutdown_connections 2023-10-03T19:19:42.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f666112a640 1 --2- 172.21.15.45:0/1191654027 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f665c0bb1d0 0x7f665c0c12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f666112a640 1 --2- 172.21.15.45:0/1191654027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f665c14f240 0x7f665c1528d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f666112a640 1 -- 172.21.15.45:0/1191654027 >> 172.21.15.45:0/1191654027 conn(0x7f665c0a64a0 msgr2=0x7f665c0a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:42.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f666112a640 1 -- 172.21.15.45:0/1191654027 shutdown_connections 2023-10-03T19:19:42.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f666112a640 1 -- 172.21.15.45:0/1191654027 wait complete. 2023-10-03T19:19:42.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f666112a640 1 Processor -- start 2023-10-03T19:19:42.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f666112a640 1 -- start start 2023-10-03T19:19:42.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f666112a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f665c0bb1d0 0x7f665c0a7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:42.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f666112a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f665c0c2790 0x7f665c147ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:42.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f666112a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f665c14f240 0x7f665c0bd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:42.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f666112a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665c0a98d0 con 0x7f665c0bb1d0 2023-10-03T19:19:42.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f666112a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665c0a8da0 con 0x7f665c14f240 2023-10-03T19:19:42.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f666112a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665c1481e0 con 0x7f665c0c2790 2023-10-03T19:19:42.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f665ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f665c0bb1d0 0x7f665c0a7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:42.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f665ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f665c0bb1d0 0x7f665c0a7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47752/0 (socket says 172.21.15.45:47752) 2023-10-03T19:19:42.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f665ad9d640 1 -- 172.21.15.45:0/2407267709 learned_addr learned my addr 172.21.15.45:0/2407267709 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:42.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f665b59e640 1 --2- 172.21.15.45:0/2407267709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f665c14f240 0x7f665c0bd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:42.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f665a59c640 1 --2- 172.21.15.45:0/2407267709 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f665c0c2790 0x7f665c147ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:42.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f665ad9d640 1 -- 172.21.15.45:0/2407267709 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f665c0c2790 msgr2=0x7f665c147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:42.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f665ad9d640 1 --2- 172.21.15.45:0/2407267709 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f665c0c2790 0x7f665c147ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f665ad9d640 1 -- 172.21.15.45:0/2407267709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f665c14f240 msgr2=0x7f665c0bd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:42.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f665ad9d640 1 --2- 172.21.15.45:0/2407267709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f665c14f240 0x7f665c0bd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:42.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f665ad9d640 1 -- 172.21.15.45:0/2407267709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f664c009480 con 0x7f665c0bb1d0 2023-10-03T19:19:42.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f665a59c640 1 --2- 172.21.15.45:0/2407267709 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f665c0c2790 0x7f665c147ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:19:42.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f665ad9d640 1 --2- 172.21.15.45:0/2407267709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f665c0bb1d0 0x7f665c0a7be0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f664c006fd0 tx=0x7f664c01bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:42.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f66437fe640 1 -- 172.21.15.45:0/2407267709 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664c0bd070 con 0x7f665c0bb1d0 2023-10-03T19:19:42.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f66437fe640 1 -- 172.21.15.45:0/2407267709 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664c004020 con 0x7f665c0bb1d0 2023-10-03T19:19:42.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f66437fe640 1 -- 172.21.15.45:0/2407267709 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664c004390 con 0x7f665c0bb1d0 2023-10-03T19:19:42.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.872+0000 7f666112a640 1 -- 172.21.15.45:0/2407267709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f665c14f610 con 0x7f665c0bb1d0 2023-10-03T19:19:42.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.876+0000 7f666112a640 1 -- 172.21.15.45:0/2407267709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f665c0a3f40 con 0x7f665c0bb1d0 2023-10-03T19:19:42.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.876+0000 7f666112a640 1 -- 172.21.15.45:0/2407267709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f665c0bf360 con 0x7f665c0bb1d0 2023-10-03T19:19:42.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.876+0000 7f66437fe640 1 -- 172.21.15.45:0/2407267709 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f664c0b7040 con 0x7f665c0bb1d0 2023-10-03T19:19:42.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.876+0000 7f66437fe640 1 --2- 172.21.15.45:0/2407267709 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6648066280 0x7f6648068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:42.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.876+0000 7f66437fe640 1 -- 172.21.15.45:0/2407267709 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f664c121aa0 con 0x7f665c0bb1d0 2023-10-03T19:19:42.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.876+0000 7f665a59c640 1 --2- 172.21.15.45:0/2407267709 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6648066280 0x7f6648068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:42.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.876+0000 7f665a59c640 1 --2- 172.21.15.45:0/2407267709 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6648066280 0x7f6648068730 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f665c1521b0 tx=0x7f6650007cd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:42.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:42.880+0000 7f66437fe640 1 -- 172.21.15.45:0/2407267709 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f664c0ef090 con 0x7f665c0bb1d0 2023-10-03T19:19:43.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.032+0000 7f666112a640 1 -- 172.21.15.45:0/2407267709 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f665c0bfa60 con 0x7f6648066280 2023-10-03T19:19:43.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.056+0000 7f66437fe640 1 -- 172.21.15.45:0/2407267709 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308580 (secure 0 0 0) 0x7f665c0bfa60 con 0x7f6648066280 2023-10-03T19:19:43.060 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:19:43.062 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:19:43.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.056+0000 7f666112a640 1 -- 172.21.15.45:0/2407267709 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6648066280 msgr2=0x7f6648068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:43.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.056+0000 7f666112a640 1 --2- 172.21.15.45:0/2407267709 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6648066280 0x7f6648068730 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f665c1521b0 tx=0x7f6650007cd0 comp rx=0 tx=0).stop 2023-10-03T19:19:43.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.056+0000 7f666112a640 1 -- 172.21.15.45:0/2407267709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f665c0bb1d0 msgr2=0x7f665c0a7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:43.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.056+0000 7f666112a640 1 --2- 172.21.15.45:0/2407267709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f665c0bb1d0 0x7f665c0a7be0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f664c006fd0 tx=0x7f664c01bab0 comp rx=0 tx=0).stop 2023-10-03T19:19:43.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.060+0000 7f666112a640 1 -- 172.21.15.45:0/2407267709 shutdown_connections 2023-10-03T19:19:43.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.060+0000 7f666112a640 1 --2- 172.21.15.45:0/2407267709 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6648066280 0x7f6648068730 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:43.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.060+0000 7f666112a640 1 --2- 172.21.15.45:0/2407267709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f665c14f240 0x7f665c0bd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:43.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.060+0000 7f666112a640 1 --2- 172.21.15.45:0/2407267709 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f665c0c2790 0x7f665c147ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:43.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.060+0000 7f666112a640 1 --2- 172.21.15.45:0/2407267709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f665c0bb1d0 0x7f665c0a7be0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:43.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.060+0000 7f666112a640 1 -- 172.21.15.45:0/2407267709 >> 172.21.15.45:0/2407267709 conn(0x7f665c0a64a0 msgr2=0x7f665c0a4380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:43.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.060+0000 7f666112a640 1 -- 172.21.15.45:0/2407267709 shutdown_connections 2023-10-03T19:19:43.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.060+0000 7f666112a640 1 -- 172.21.15.45:0/2407267709 wait complete. 2023-10-03T19:19:43.078 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2023-10-03T19:19:42.600621+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":157,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244048,"kb_used_data":9488,"kb_used_omap":0,"kb_used_meta":234496,"kb_avail":754730672,"statfs":{"total":773094113280,"available":772844208128,"internally_reserved":0,"allocated":9715712,"data_stored":5546299,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":240123904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":69,"apply_latency_ms":69,"commit_latency_ns":69000000,"apply_latency_ns":69000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.559949"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.065677+0000","last_change":"2023-10-03T19:19:39.065677+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.065677+0000","last_undegraded":"2023-10-03T19:19:39.065677+0000","last_fullsized":"2023-10-03T19:19:39.065677+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678798+0000","last_change":"2023-10-03T19:19:39.501818+0000","last_active":"2023-10-03T19:19:40.678798+0000","last_peered":"2023-10-03T19:19:40.678798+0000","last_clean":"2023-10-03T19:19:40.678798+0000","last_became_active":"2023-10-03T19:19:39.501351+0000","last_became_peered":"2023-10-03T19:19:39.501351+0000","last_unstale":"2023-10-03T19:19:40.678798+0000","last_undegraded":"2023-10-03T19:19:40.678798+0000","last_fullsized":"2023-10-03T19:19:40.678798+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:35:21.301808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.062721+0000","last_change":"2023-10-03T19:19:39.062721+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.062721+0000","last_undegraded":"2023-10-03T19:19:39.062721+0000","last_fullsized":"2023-10-03T19:19:39.062721+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430029+0000","last_change":"2023-10-03T19:19:39.473749+0000","last_active":"2023-10-03T19:19:40.430029+0000","last_peered":"2023-10-03T19:19:40.430029+0000","last_clean":"2023-10-03T19:19:40.430029+0000","last_became_active":"2023-10-03T19:19:39.473432+0000","last_became_peered":"2023-10-03T19:19:39.473432+0000","last_unstale":"2023-10-03T19:19:40.430029+0000","last_undegraded":"2023-10-03T19:19:40.430029+0000","last_fullsized":"2023-10-03T19:19:40.430029+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:58:52.700889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175119+0000","last_change":"2023-10-03T19:19:39.473502+0000","last_active":"2023-10-03T19:19:41.175119+0000","last_peered":"2023-10-03T19:19:41.175119+0000","last_clean":"2023-10-03T19:19:41.175119+0000","last_became_active":"2023-10-03T19:19:39.473176+0000","last_became_peered":"2023-10-03T19:19:39.473176+0000","last_unstale":"2023-10-03T19:19:41.175119+0000","last_undegraded":"2023-10-03T19:19:41.175119+0000","last_fullsized":"2023-10-03T19:19:41.175119+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:47:23.957363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.677858+0000","last_change":"2023-10-03T19:19:39.491373+0000","last_active":"2023-10-03T19:19:40.677858+0000","last_peered":"2023-10-03T19:19:40.677858+0000","last_clean":"2023-10-03T19:19:40.677858+0000","last_became_active":"2023-10-03T19:19:39.490818+0000","last_became_peered":"2023-10-03T19:19:39.490818+0000","last_unstale":"2023-10-03T19:19:40.677858+0000","last_undegraded":"2023-10-03T19:19:40.677858+0000","last_fullsized":"2023-10-03T19:19:40.677858+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:59:41.953904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.677748+0000","last_change":"2023-10-03T19:19:39.497977+0000","last_active":"2023-10-03T19:19:40.677748+0000","last_peered":"2023-10-03T19:19:40.677748+0000","last_clean":"2023-10-03T19:19:40.677748+0000","last_became_active":"2023-10-03T19:19:39.497211+0000","last_became_peered":"2023-10-03T19:19:39.497211+0000","last_unstale":"2023-10-03T19:19:40.677748+0000","last_undegraded":"2023-10-03T19:19:40.677748+0000","last_fullsized":"2023-10-03T19:19:40.677748+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:15:08.226909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.172923+0000","last_change":"2023-10-03T19:19:39.450807+0000","last_active":"2023-10-03T19:19:41.172923+0000","last_peered":"2023-10-03T19:19:41.172923+0000","last_clean":"2023-10-03T19:19:41.172923+0000","last_became_active":"2023-10-03T19:19:39.450534+0000","last_became_peered":"2023-10-03T19:19:39.450534+0000","last_unstale":"2023-10-03T19:19:41.172923+0000","last_undegraded":"2023-10-03T19:19:41.172923+0000","last_fullsized":"2023-10-03T19:19:41.172923+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:15:38.079291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678801+0000","last_change":"2023-10-03T19:19:39.492468+0000","last_active":"2023-10-03T19:19:40.678801+0000","last_peered":"2023-10-03T19:19:40.678801+0000","last_clean":"2023-10-03T19:19:40.678801+0000","last_became_active":"2023-10-03T19:19:39.491727+0000","last_became_peered":"2023-10-03T19:19:39.491727+0000","last_unstale":"2023-10-03T19:19:40.678801+0000","last_undegraded":"2023-10-03T19:19:40.678801+0000","last_fullsized":"2023-10-03T19:19:40.678801+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:42:13.454493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176602+0000","last_change":"2023-10-03T19:19:39.498659+0000","last_active":"2023-10-03T19:19:41.176602+0000","last_peered":"2023-10-03T19:19:41.176602+0000","last_clean":"2023-10-03T19:19:41.176602+0000","last_became_active":"2023-10-03T19:19:39.498315+0000","last_became_peered":"2023-10-03T19:19:39.498315+0000","last_unstale":"2023-10-03T19:19:41.176602+0000","last_undegraded":"2023-10-03T19:19:41.176602+0000","last_fullsized":"2023-10-03T19:19:41.176602+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:34:42.126930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.067805+0000","last_change":"2023-10-03T19:19:39.067805+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.067805+0000","last_undegraded":"2023-10-03T19:19:39.067805+0000","last_fullsized":"2023-10-03T19:19:39.067805+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.440908+0000","last_change":"2023-10-03T19:19:39.455413+0000","last_active":"2023-10-03T19:19:40.440908+0000","last_peered":"2023-10-03T19:19:40.440908+0000","last_clean":"2023-10-03T19:19:40.440908+0000","last_became_active":"2023-10-03T19:19:39.454714+0000","last_became_peered":"2023-10-03T19:19:39.454714+0000","last_unstale":"2023-10-03T19:19:40.440908+0000","last_undegraded":"2023-10-03T19:19:40.440908+0000","last_fullsized":"2023-10-03T19:19:40.440908+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:27:14.179448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.429895+0000","last_change":"2023-10-03T19:19:39.466360+0000","last_active":"2023-10-03T19:19:40.429895+0000","last_peered":"2023-10-03T19:19:40.429895+0000","last_clean":"2023-10-03T19:19:40.429895+0000","last_became_active":"2023-10-03T19:19:39.466034+0000","last_became_peered":"2023-10-03T19:19:39.466034+0000","last_unstale":"2023-10-03T19:19:40.429895+0000","last_undegraded":"2023-10-03T19:19:40.429895+0000","last_fullsized":"2023-10-03T19:19:40.429895+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:17:57.802389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174860+0000","last_change":"2023-10-03T19:19:39.478735+0000","last_active":"2023-10-03T19:19:41.174860+0000","last_peered":"2023-10-03T19:19:41.174860+0000","last_clean":"2023-10-03T19:19:41.174860+0000","last_became_active":"2023-10-03T19:19:39.477842+0000","last_became_peered":"2023-10-03T19:19:39.477842+0000","last_unstale":"2023-10-03T19:19:41.174860+0000","last_undegraded":"2023-10-03T19:19:41.174860+0000","last_fullsized":"2023-10-03T19:19:41.174860+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:01:44.142532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174807+0000","last_change":"2023-10-03T19:19:39.493604+0000","last_active":"2023-10-03T19:19:41.174807+0000","last_peered":"2023-10-03T19:19:41.174807+0000","last_clean":"2023-10-03T19:19:41.174807+0000","last_became_active":"2023-10-03T19:19:39.488408+0000","last_became_peered":"2023-10-03T19:19:39.488408+0000","last_unstale":"2023-10-03T19:19:41.174807+0000","last_undegraded":"2023-10-03T19:19:41.174807+0000","last_fullsized":"2023-10-03T19:19:41.174807+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:54:40.452636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174925+0000","last_change":"2023-10-03T19:19:39.481769+0000","last_active":"2023-10-03T19:19:41.174925+0000","last_peered":"2023-10-03T19:19:41.174925+0000","last_clean":"2023-10-03T19:19:41.174925+0000","last_became_active":"2023-10-03T19:19:39.478997+0000","last_became_peered":"2023-10-03T19:19:39.478997+0000","last_unstale":"2023-10-03T19:19:41.174925+0000","last_undegraded":"2023-10-03T19:19:41.174925+0000","last_fullsized":"2023-10-03T19:19:41.174925+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:53:12.478710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.060759+0000","last_change":"2023-10-03T19:19:39.060759+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.060759+0000","last_undegraded":"2023-10-03T19:19:39.060759+0000","last_fullsized":"2023-10-03T19:19:39.060759+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.679023+0000","last_change":"2023-10-03T19:19:39.502839+0000","last_active":"2023-10-03T19:19:40.679023+0000","last_peered":"2023-10-03T19:19:40.679023+0000","last_clean":"2023-10-03T19:19:40.679023+0000","last_became_active":"2023-10-03T19:19:39.502343+0000","last_became_peered":"2023-10-03T19:19:39.502343+0000","last_unstale":"2023-10-03T19:19:40.679023+0000","last_undegraded":"2023-10-03T19:19:40.679023+0000","last_fullsized":"2023-10-03T19:19:40.679023+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:19:38.314320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.062240+0000","last_change":"2023-10-03T19:19:39.062240+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.062240+0000","last_undegraded":"2023-10-03T19:19:39.062240+0000","last_fullsized":"2023-10-03T19:19:39.062240+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.440839+0000","last_change":"2023-10-03T19:19:39.481255+0000","last_active":"2023-10-03T19:19:40.440839+0000","last_peered":"2023-10-03T19:19:40.440839+0000","last_clean":"2023-10-03T19:19:40.440839+0000","last_became_active":"2023-10-03T19:19:39.480541+0000","last_became_peered":"2023-10-03T19:19:39.480541+0000","last_unstale":"2023-10-03T19:19:40.440839+0000","last_undegraded":"2023-10-03T19:19:40.440839+0000","last_fullsized":"2023-10-03T19:19:40.440839+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:21:53.299603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173654+0000","last_change":"2023-10-03T19:19:39.467184+0000","last_active":"2023-10-03T19:19:41.173654+0000","last_peered":"2023-10-03T19:19:41.173654+0000","last_clean":"2023-10-03T19:19:41.173654+0000","last_became_active":"2023-10-03T19:19:39.466886+0000","last_became_peered":"2023-10-03T19:19:39.466886+0000","last_unstale":"2023-10-03T19:19:41.173654+0000","last_undegraded":"2023-10-03T19:19:41.173654+0000","last_fullsized":"2023-10-03T19:19:41.173654+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:22:29.033454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175260+0000","last_change":"2023-10-03T19:19:39.464591+0000","last_active":"2023-10-03T19:19:41.175260+0000","last_peered":"2023-10-03T19:19:41.175260+0000","last_clean":"2023-10-03T19:19:41.175260+0000","last_became_active":"2023-10-03T19:19:39.464263+0000","last_became_peered":"2023-10-03T19:19:39.464263+0000","last_unstale":"2023-10-03T19:19:41.175260+0000","last_undegraded":"2023-10-03T19:19:41.175260+0000","last_fullsized":"2023-10-03T19:19:41.175260+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:09:27.964791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.065582+0000","last_change":"2023-10-03T19:19:39.065582+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.065582+0000","last_undegraded":"2023-10-03T19:19:39.065582+0000","last_fullsized":"2023-10-03T19:19:39.065582+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174942+0000","last_change":"2023-10-03T19:19:39.439866+0000","last_active":"2023-10-03T19:19:41.174942+0000","last_peered":"2023-10-03T19:19:41.174942+0000","last_clean":"2023-10-03T19:19:41.174942+0000","last_became_active":"2023-10-03T19:19:39.439632+0000","last_became_peered":"2023-10-03T19:19:39.439632+0000","last_unstale":"2023-10-03T19:19:41.174942+0000","last_undegraded":"2023-10-03T19:19:41.174942+0000","last_fullsized":"2023-10-03T19:19:41.174942+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:15:44.398741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.441232+0000","last_change":"2023-10-03T19:19:39.470183+0000","last_active":"2023-10-03T19:19:40.441232+0000","last_peered":"2023-10-03T19:19:40.441232+0000","last_clean":"2023-10-03T19:19:40.441232+0000","last_became_active":"2023-10-03T19:19:39.469452+0000","last_became_peered":"2023-10-03T19:19:39.469452+0000","last_unstale":"2023-10-03T19:19:40.441232+0000","last_undegraded":"2023-10-03T19:19:40.441232+0000","last_fullsized":"2023-10-03T19:19:40.441232+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:01:20.873119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.441025+0000","last_change":"2023-10-03T19:19:39.503465+0000","last_active":"2023-10-03T19:19:40.441025+0000","last_peered":"2023-10-03T19:19:40.441025+0000","last_clean":"2023-10-03T19:19:40.441025+0000","last_became_active":"2023-10-03T19:19:39.503030+0000","last_became_peered":"2023-10-03T19:19:39.503030+0000","last_unstale":"2023-10-03T19:19:40.441025+0000","last_undegraded":"2023-10-03T19:19:40.441025+0000","last_fullsized":"2023-10-03T19:19:40.441025+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:43:46.831754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.066584+0000","last_change":"2023-10-03T19:19:39.066584+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.066584+0000","last_undegraded":"2023-10-03T19:19:39.066584+0000","last_fullsized":"2023-10-03T19:19:39.066584+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678338+0000","last_change":"2023-10-03T19:19:39.498786+0000","last_active":"2023-10-03T19:19:40.678338+0000","last_peered":"2023-10-03T19:19:40.678338+0000","last_clean":"2023-10-03T19:19:40.678338+0000","last_became_active":"2023-10-03T19:19:39.498287+0000","last_became_peered":"2023-10-03T19:19:39.498287+0000","last_unstale":"2023-10-03T19:19:40.678338+0000","last_undegraded":"2023-10-03T19:19:40.678338+0000","last_fullsized":"2023-10-03T19:19:40.678338+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:01:20.873119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173840+0000","last_change":"2023-10-03T19:19:39.474176+0000","last_active":"2023-10-03T19:19:41.173840+0000","last_peered":"2023-10-03T19:19:41.173840+0000","last_clean":"2023-10-03T19:19:41.173840+0000","last_became_active":"2023-10-03T19:19:39.473801+0000","last_became_peered":"2023-10-03T19:19:39.473801+0000","last_unstale":"2023-10-03T19:19:41.173840+0000","last_undegraded":"2023-10-03T19:19:41.173840+0000","last_fullsized":"2023-10-03T19:19:41.173840+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:16:06.684976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.440240+0000","last_change":"2023-10-03T19:19:39.453506+0000","last_active":"2023-10-03T19:19:40.440240+0000","last_peered":"2023-10-03T19:19:40.440240+0000","last_clean":"2023-10-03T19:19:40.440240+0000","last_became_active":"2023-10-03T19:19:39.452767+0000","last_became_peered":"2023-10-03T19:19:39.452767+0000","last_unstale":"2023-10-03T19:19:40.440240+0000","last_undegraded":"2023-10-03T19:19:40.440240+0000","last_fullsized":"2023-10-03T19:19:40.440240+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:58:52.700889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.677767+0000","last_change":"2023-10-03T19:19:39.501965+0000","last_active":"2023-10-03T19:19:40.677767+0000","last_peered":"2023-10-03T19:19:40.677767+0000","last_clean":"2023-10-03T19:19:40.677767+0000","last_became_active":"2023-10-03T19:19:39.501258+0000","last_became_peered":"2023-10-03T19:19:39.501258+0000","last_unstale":"2023-10-03T19:19:40.677767+0000","last_undegraded":"2023-10-03T19:19:40.677767+0000","last_fullsized":"2023-10-03T19:19:40.677767+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:36:34.926440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.172931+0000","last_change":"2023-10-03T19:19:39.476006+0000","last_active":"2023-10-03T19:19:41.172931+0000","last_peered":"2023-10-03T19:19:41.172931+0000","last_clean":"2023-10-03T19:19:41.172931+0000","last_became_active":"2023-10-03T19:19:39.475740+0000","last_became_peered":"2023-10-03T19:19:39.475740+0000","last_unstale":"2023-10-03T19:19:41.172931+0000","last_undegraded":"2023-10-03T19:19:41.172931+0000","last_fullsized":"2023-10-03T19:19:41.172931+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:38:59.311703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.057503+0000","last_change":"2023-10-03T19:19:39.057503+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.057503+0000","last_undegraded":"2023-10-03T19:19:39.057503+0000","last_fullsized":"2023-10-03T19:19:39.057503+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"97'4","reported_seq":17,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430274+0000","last_change":"2023-10-03T19:19:39.100745+0000","last_active":"2023-10-03T19:19:40.430274+0000","last_peered":"2023-10-03T19:19:40.430274+0000","last_clean":"2023-10-03T19:19:40.430274+0000","last_became_active":"2023-10-03T19:19:39.100413+0000","last_became_peered":"2023-10-03T19:19:39.100413+0000","last_unstale":"2023-10-03T19:19:40.430274+0000","last_undegraded":"2023-10-03T19:19:40.430274+0000","last_fullsized":"2023-10-03T19:19:40.430274+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:21:52.286906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173119+0000","last_change":"2023-10-03T19:19:39.450049+0000","last_active":"2023-10-03T19:19:41.173119+0000","last_peered":"2023-10-03T19:19:41.173119+0000","last_clean":"2023-10-03T19:19:41.173119+0000","last_became_active":"2023-10-03T19:19:39.449771+0000","last_became_peered":"2023-10-03T19:19:39.449771+0000","last_unstale":"2023-10-03T19:19:41.173119+0000","last_undegraded":"2023-10-03T19:19:41.173119+0000","last_fullsized":"2023-10-03T19:19:41.173119+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:14:44.212951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174434+0000","last_change":"2023-10-03T19:19:39.081942+0000","last_active":"2023-10-03T19:19:41.174434+0000","last_peered":"2023-10-03T19:19:41.174434+0000","last_clean":"2023-10-03T19:19:41.174434+0000","last_became_active":"2023-10-03T19:19:39.081434+0000","last_became_peered":"2023-10-03T19:19:39.081434+0000","last_unstale":"2023-10-03T19:19:41.174434+0000","last_undegraded":"2023-10-03T19:19:41.174434+0000","last_fullsized":"2023-10-03T19:19:41.174434+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:44:38.934350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.440288+0000","last_change":"2023-10-03T19:19:39.456943+0000","last_active":"2023-10-03T19:19:40.440288+0000","last_peered":"2023-10-03T19:19:40.440288+0000","last_clean":"2023-10-03T19:19:40.440288+0000","last_became_active":"2023-10-03T19:19:39.456206+0000","last_became_peered":"2023-10-03T19:19:39.456206+0000","last_unstale":"2023-10-03T19:19:40.440288+0000","last_undegraded":"2023-10-03T19:19:40.440288+0000","last_fullsized":"2023-10-03T19:19:40.440288+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:15:08.226909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.440781+0000","last_change":"2023-10-03T19:19:39.098618+0000","last_active":"2023-10-03T19:19:40.440781+0000","last_peered":"2023-10-03T19:19:40.440781+0000","last_clean":"2023-10-03T19:19:40.440781+0000","last_became_active":"2023-10-03T19:19:39.097892+0000","last_became_peered":"2023-10-03T19:19:39.097892+0000","last_unstale":"2023-10-03T19:19:40.440781+0000","last_undegraded":"2023-10-03T19:19:40.440781+0000","last_fullsized":"2023-10-03T19:19:40.440781+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:59:40.941206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.063100+0000","last_change":"2023-10-03T19:19:39.063100+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.063100+0000","last_undegraded":"2023-10-03T19:19:39.063100+0000","last_fullsized":"2023-10-03T19:19:39.063100+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176094+0000","last_change":"2023-10-03T19:19:39.084901+0000","last_active":"2023-10-03T19:19:41.176094+0000","last_peered":"2023-10-03T19:19:41.176094+0000","last_clean":"2023-10-03T19:19:41.176094+0000","last_became_active":"2023-10-03T19:19:39.084399+0000","last_became_peered":"2023-10-03T19:19:39.084399+0000","last_unstale":"2023-10-03T19:19:41.176094+0000","last_undegraded":"2023-10-03T19:19:41.176094+0000","last_fullsized":"2023-10-03T19:19:41.176094+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:37:52.382988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430110+0000","last_change":"2023-10-03T19:19:39.440443+0000","last_active":"2023-10-03T19:19:40.430110+0000","last_peered":"2023-10-03T19:19:40.430110+0000","last_clean":"2023-10-03T19:19:40.430110+0000","last_became_active":"2023-10-03T19:19:39.439566+0000","last_became_peered":"2023-10-03T19:19:39.439566+0000","last_unstale":"2023-10-03T19:19:40.430110+0000","last_undegraded":"2023-10-03T19:19:40.430110+0000","last_fullsized":"2023-10-03T19:19:40.430110+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:36:34.926440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175160+0000","last_change":"2023-10-03T19:19:39.105651+0000","last_active":"2023-10-03T19:19:41.175160+0000","last_peered":"2023-10-03T19:19:41.175160+0000","last_clean":"2023-10-03T19:19:41.175160+0000","last_became_active":"2023-10-03T19:19:39.105103+0000","last_became_peered":"2023-10-03T19:19:39.105103+0000","last_unstale":"2023-10-03T19:19:41.175160+0000","last_undegraded":"2023-10-03T19:19:41.175160+0000","last_fullsized":"2023-10-03T19:19:41.175160+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:01:43.169147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.057672+0000","last_change":"2023-10-03T19:19:39.057672+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.057672+0000","last_undegraded":"2023-10-03T19:19:39.057672+0000","last_fullsized":"2023-10-03T19:19:39.057672+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-03T19:19:39.107764+0000","last_change":"2023-10-03T19:19:39.097877+0000","last_active":"2023-10-03T19:19:39.107764+0000","last_peered":"2023-10-03T19:19:39.107764+0000","last_clean":"2023-10-03T19:19:39.107764+0000","last_became_active":"2023-10-03T19:19:39.097351+0000","last_became_peered":"2023-10-03T19:19:39.097351+0000","last_unstale":"2023-10-03T19:19:39.107764+0000","last_undegraded":"2023-10-03T19:19:39.107764+0000","last_fullsized":"2023-10-03T19:19:39.107764+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:28:16.875405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678996+0000","last_change":"2023-10-03T19:19:39.501897+0000","last_active":"2023-10-03T19:19:40.678996+0000","last_peered":"2023-10-03T19:19:40.678996+0000","last_clean":"2023-10-03T19:19:40.678996+0000","last_became_active":"2023-10-03T19:19:39.501378+0000","last_became_peered":"2023-10-03T19:19:39.501378+0000","last_unstale":"2023-10-03T19:19:40.678996+0000","last_undegraded":"2023-10-03T19:19:40.678996+0000","last_fullsized":"2023-10-03T19:19:40.678996+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:03:04.699024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.439627+0000","last_change":"2023-10-03T19:19:39.098321+0000","last_active":"2023-10-03T19:19:40.439627+0000","last_peered":"2023-10-03T19:19:40.439627+0000","last_clean":"2023-10-03T19:19:40.439627+0000","last_became_active":"2023-10-03T19:19:39.097705+0000","last_became_peered":"2023-10-03T19:19:39.097705+0000","last_unstale":"2023-10-03T19:19:40.439627+0000","last_undegraded":"2023-10-03T19:19:40.439627+0000","last_fullsized":"2023-10-03T19:19:40.439627+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:24:26.530146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430181+0000","last_change":"2023-10-03T19:19:39.443896+0000","last_active":"2023-10-03T19:19:40.430181+0000","last_peered":"2023-10-03T19:19:40.430181+0000","last_clean":"2023-10-03T19:19:40.430181+0000","last_became_active":"2023-10-03T19:19:39.443185+0000","last_became_peered":"2023-10-03T19:19:39.443185+0000","last_unstale":"2023-10-03T19:19:40.430181+0000","last_undegraded":"2023-10-03T19:19:40.430181+0000","last_fullsized":"2023-10-03T19:19:40.430181+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:59:41.953904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430269+0000","last_change":"2023-10-03T19:19:39.076525+0000","last_active":"2023-10-03T19:19:40.430269+0000","last_peered":"2023-10-03T19:19:40.430269+0000","last_clean":"2023-10-03T19:19:40.430269+0000","last_became_active":"2023-10-03T19:19:39.076125+0000","last_became_peered":"2023-10-03T19:19:39.076125+0000","last_unstale":"2023-10-03T19:19:40.430269+0000","last_undegraded":"2023-10-03T19:19:40.430269+0000","last_fullsized":"2023-10-03T19:19:40.430269+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:27:13.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.064978+0000","last_change":"2023-10-03T19:19:39.064978+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.064978+0000","last_undegraded":"2023-10-03T19:19:39.064978+0000","last_fullsized":"2023-10-03T19:19:39.064978+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.441233+0000","last_change":"2023-10-03T19:19:39.100517+0000","last_active":"2023-10-03T19:19:40.441233+0000","last_peered":"2023-10-03T19:19:40.441233+0000","last_clean":"2023-10-03T19:19:40.441233+0000","last_became_active":"2023-10-03T19:19:39.100003+0000","last_became_peered":"2023-10-03T19:19:39.100003+0000","last_unstale":"2023-10-03T19:19:40.441233+0000","last_undegraded":"2023-10-03T19:19:40.441233+0000","last_fullsized":"2023-10-03T19:19:40.441233+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:02:39.250284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175315+0000","last_change":"2023-10-03T19:19:39.445323+0000","last_active":"2023-10-03T19:19:41.175315+0000","last_peered":"2023-10-03T19:19:41.175315+0000","last_clean":"2023-10-03T19:19:41.175315+0000","last_became_active":"2023-10-03T19:19:39.445022+0000","last_became_peered":"2023-10-03T19:19:39.445022+0000","last_unstale":"2023-10-03T19:19:41.175315+0000","last_undegraded":"2023-10-03T19:19:41.175315+0000","last_fullsized":"2023-10-03T19:19:41.175315+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:14:23.979238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-03T19:19:39.077168+0000","last_change":"2023-10-03T19:19:39.075931+0000","last_active":"2023-10-03T19:19:39.077168+0000","last_peered":"2023-10-03T19:19:39.077168+0000","last_clean":"2023-10-03T19:19:39.077168+0000","last_became_active":"2023-10-03T19:19:39.075609+0000","last_became_peered":"2023-10-03T19:19:39.075609+0000","last_unstale":"2023-10-03T19:19:39.077168+0000","last_undegraded":"2023-10-03T19:19:39.077168+0000","last_fullsized":"2023-10-03T19:19:39.077168+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:28:50.042403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173596+0000","last_change":"2023-10-03T19:19:39.450085+0000","last_active":"2023-10-03T19:19:41.173596+0000","last_peered":"2023-10-03T19:19:41.173596+0000","last_clean":"2023-10-03T19:19:41.173596+0000","last_became_active":"2023-10-03T19:19:39.449720+0000","last_became_peered":"2023-10-03T19:19:39.449720+0000","last_unstale":"2023-10-03T19:19:41.173596+0000","last_undegraded":"2023-10-03T19:19:41.173596+0000","last_fullsized":"2023-10-03T19:19:41.173596+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:07:03.874445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"97'3","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175361+0000","last_change":"2023-10-03T19:19:39.083465+0000","last_active":"2023-10-03T19:19:41.175361+0000","last_peered":"2023-10-03T19:19:41.175361+0000","last_clean":"2023-10-03T19:19:41.175361+0000","last_became_active":"2023-10-03T19:19:39.082723+0000","last_became_peered":"2023-10-03T19:19:39.082723+0000","last_unstale":"2023-10-03T19:19:41.175361+0000","last_undegraded":"2023-10-03T19:19:41.175361+0000","last_fullsized":"2023-10-03T19:19:41.175361+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:45:27.547248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175742+0000","last_change":"2023-10-03T19:19:39.446159+0000","last_active":"2023-10-03T19:19:41.175742+0000","last_peered":"2023-10-03T19:19:41.175742+0000","last_clean":"2023-10-03T19:19:41.175742+0000","last_became_active":"2023-10-03T19:19:39.445909+0000","last_became_peered":"2023-10-03T19:19:39.445909+0000","last_unstale":"2023-10-03T19:19:41.175742+0000","last_undegraded":"2023-10-03T19:19:41.175742+0000","last_fullsized":"2023-10-03T19:19:41.175742+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:27:32.906536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"97'6","reported_seq":19,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678541+0000","last_change":"2023-10-03T19:19:39.092215+0000","last_active":"2023-10-03T19:19:40.678541+0000","last_peered":"2023-10-03T19:19:40.678541+0000","last_clean":"2023-10-03T19:19:40.678541+0000","last_became_active":"2023-10-03T19:19:39.085602+0000","last_became_peered":"2023-10-03T19:19:39.085602+0000","last_unstale":"2023-10-03T19:19:40.678541+0000","last_undegraded":"2023-10-03T19:19:40.678541+0000","last_fullsized":"2023-10-03T19:19:40.678541+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:02:39.250284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.064062+0000","last_change":"2023-10-03T19:19:39.064062+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.064062+0000","last_undegraded":"2023-10-03T19:19:39.064062+0000","last_fullsized":"2023-10-03T19:19:39.064062+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176071+0000","last_change":"2023-10-03T19:19:39.081438+0000","last_active":"2023-10-03T19:19:41.176071+0000","last_peered":"2023-10-03T19:19:41.176071+0000","last_clean":"2023-10-03T19:19:41.176071+0000","last_became_active":"2023-10-03T19:19:39.081161+0000","last_became_peered":"2023-10-03T19:19:39.081161+0000","last_unstale":"2023-10-03T19:19:41.176071+0000","last_undegraded":"2023-10-03T19:19:41.176071+0000","last_fullsized":"2023-10-03T19:19:41.176071+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:33:20.709972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678584+0000","last_change":"2023-10-03T19:19:39.492226+0000","last_active":"2023-10-03T19:19:40.678584+0000","last_peered":"2023-10-03T19:19:40.678584+0000","last_clean":"2023-10-03T19:19:40.678584+0000","last_became_active":"2023-10-03T19:19:39.491322+0000","last_became_peered":"2023-10-03T19:19:39.491322+0000","last_unstale":"2023-10-03T19:19:40.678584+0000","last_undegraded":"2023-10-03T19:19:40.678584+0000","last_fullsized":"2023-10-03T19:19:40.678584+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:17:18.221489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430104+0000","last_change":"2023-10-03T19:19:39.077931+0000","last_active":"2023-10-03T19:19:40.430104+0000","last_peered":"2023-10-03T19:19:40.430104+0000","last_clean":"2023-10-03T19:19:40.430104+0000","last_became_active":"2023-10-03T19:19:39.077342+0000","last_became_peered":"2023-10-03T19:19:39.077342+0000","last_unstale":"2023-10-03T19:19:40.430104+0000","last_undegraded":"2023-10-03T19:19:40.430104+0000","last_fullsized":"2023-10-03T19:19:40.430104+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:15:07.214211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174038+0000","last_change":"2023-10-03T19:19:39.476040+0000","last_active":"2023-10-03T19:19:41.174038+0000","last_peered":"2023-10-03T19:19:41.174038+0000","last_clean":"2023-10-03T19:19:41.174038+0000","last_became_active":"2023-10-03T19:19:39.475802+0000","last_became_peered":"2023-10-03T19:19:39.475802+0000","last_unstale":"2023-10-03T19:19:41.174038+0000","last_undegraded":"2023-10-03T19:19:41.174038+0000","last_fullsized":"2023-10-03T19:19:41.174038+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:49:54.029650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173284+0000","last_change":"2023-10-03T19:19:39.084666+0000","last_active":"2023-10-03T19:19:41.173284+0000","last_peered":"2023-10-03T19:19:41.173284+0000","last_clean":"2023-10-03T19:19:41.173284+0000","last_became_active":"2023-10-03T19:19:39.084383+0000","last_became_peered":"2023-10-03T19:19:39.084383+0000","last_unstale":"2023-10-03T19:19:41.173284+0000","last_undegraded":"2023-10-03T19:19:41.173284+0000","last_fullsized":"2023-10-03T19:19:41.173284+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:56:48.966597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.060292+0000","last_change":"2023-10-03T19:19:39.060292+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.060292+0000","last_undegraded":"2023-10-03T19:19:39.060292+0000","last_fullsized":"2023-10-03T19:19:39.060292+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"97'8","reported_seq":21,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.439804+0000","last_change":"2023-10-03T19:19:39.099722+0000","last_active":"2023-10-03T19:19:40.439804+0000","last_peered":"2023-10-03T19:19:40.439804+0000","last_clean":"2023-10-03T19:19:40.439804+0000","last_became_active":"2023-10-03T19:19:39.099110+0000","last_became_peered":"2023-10-03T19:19:39.099110+0000","last_unstale":"2023-10-03T19:19:40.439804+0000","last_undegraded":"2023-10-03T19:19:40.439804+0000","last_fullsized":"2023-10-03T19:19:40.439804+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:24:20.639774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.065787+0000","last_change":"2023-10-03T19:19:39.065787+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.065787+0000","last_undegraded":"2023-10-03T19:19:39.065787+0000","last_fullsized":"2023-10-03T19:19:39.065787+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176623+0000","last_change":"2023-10-03T19:19:39.078321+0000","last_active":"2023-10-03T19:19:41.176623+0000","last_peered":"2023-10-03T19:19:41.176623+0000","last_clean":"2023-10-03T19:19:41.176623+0000","last_became_active":"2023-10-03T19:19:39.078000+0000","last_became_peered":"2023-10-03T19:19:39.078000+0000","last_unstale":"2023-10-03T19:19:41.176623+0000","last_undegraded":"2023-10-03T19:19:41.176623+0000","last_fullsized":"2023-10-03T19:19:41.176623+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:42:42.684913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.439742+0000","last_change":"2023-10-03T19:19:39.453941+0000","last_active":"2023-10-03T19:19:40.439742+0000","last_peered":"2023-10-03T19:19:40.439742+0000","last_clean":"2023-10-03T19:19:40.439742+0000","last_became_active":"2023-10-03T19:19:39.453189+0000","last_became_peered":"2023-10-03T19:19:39.453189+0000","last_unstale":"2023-10-03T19:19:40.439742+0000","last_undegraded":"2023-10-03T19:19:40.439742+0000","last_fullsized":"2023-10-03T19:19:40.439742+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:17:57.802389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-03T19:19:39.096207+0000","last_change":"2023-10-03T19:19:39.095166+0000","last_active":"2023-10-03T19:19:39.096207+0000","last_peered":"2023-10-03T19:19:39.096207+0000","last_clean":"2023-10-03T19:19:39.096207+0000","last_became_active":"2023-10-03T19:19:39.094914+0000","last_became_peered":"2023-10-03T19:19:39.094914+0000","last_unstale":"2023-10-03T19:19:39.096207+0000","last_undegraded":"2023-10-03T19:19:39.096207+0000","last_fullsized":"2023-10-03T19:19:39.096207+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:07:54.333264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430357+0000","last_change":"2023-10-03T19:19:39.498605+0000","last_active":"2023-10-03T19:19:40.430357+0000","last_peered":"2023-10-03T19:19:40.430357+0000","last_clean":"2023-10-03T19:19:40.430357+0000","last_became_active":"2023-10-03T19:19:39.498286+0000","last_became_peered":"2023-10-03T19:19:39.498286+0000","last_unstale":"2023-10-03T19:19:40.430357+0000","last_undegraded":"2023-10-03T19:19:40.430357+0000","last_fullsized":"2023-10-03T19:19:40.430357+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:43:46.831754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678665+0000","last_change":"2023-10-03T19:19:39.093647+0000","last_active":"2023-10-03T19:19:40.678665+0000","last_peered":"2023-10-03T19:19:40.678665+0000","last_clean":"2023-10-03T19:19:40.678665+0000","last_became_active":"2023-10-03T19:19:39.093121+0000","last_became_peered":"2023-10-03T19:19:39.093121+0000","last_unstale":"2023-10-03T19:19:40.678665+0000","last_undegraded":"2023-10-03T19:19:40.678665+0000","last_fullsized":"2023-10-03T19:19:40.678665+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:09:28.979796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.064384+0000","last_change":"2023-10-03T19:19:39.064384+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.064384+0000","last_undegraded":"2023-10-03T19:19:39.064384+0000","last_fullsized":"2023-10-03T19:19:39.064384+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176007+0000","last_change":"2023-10-03T19:19:39.100292+0000","last_active":"2023-10-03T19:19:41.176007+0000","last_peered":"2023-10-03T19:19:41.176007+0000","last_clean":"2023-10-03T19:19:41.176007+0000","last_became_active":"2023-10-03T19:19:39.100004+0000","last_became_peered":"2023-10-03T19:19:39.100004+0000","last_unstale":"2023-10-03T19:19:41.176007+0000","last_undegraded":"2023-10-03T19:19:41.176007+0000","last_fullsized":"2023-10-03T19:19:41.176007+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:32:48.746616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174005+0000","last_change":"2023-10-03T19:19:39.450670+0000","last_active":"2023-10-03T19:19:41.174005+0000","last_peered":"2023-10-03T19:19:41.174005+0000","last_clean":"2023-10-03T19:19:41.174005+0000","last_became_active":"2023-10-03T19:19:39.450363+0000","last_became_peered":"2023-10-03T19:19:39.450363+0000","last_unstale":"2023-10-03T19:19:41.174005+0000","last_undegraded":"2023-10-03T19:19:41.174005+0000","last_fullsized":"2023-10-03T19:19:41.174005+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:38:52.937448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.440652+0000","last_change":"2023-10-03T19:19:39.093626+0000","last_active":"2023-10-03T19:19:40.440652+0000","last_peered":"2023-10-03T19:19:40.440652+0000","last_clean":"2023-10-03T19:19:40.440652+0000","last_became_active":"2023-10-03T19:19:39.093048+0000","last_became_peered":"2023-10-03T19:19:39.093048+0000","last_unstale":"2023-10-03T19:19:40.440652+0000","last_undegraded":"2023-10-03T19:19:40.440652+0000","last_fullsized":"2023-10-03T19:19:40.440652+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:36:33.913742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174002+0000","last_change":"2023-10-03T19:19:39.451443+0000","last_active":"2023-10-03T19:19:41.174002+0000","last_peered":"2023-10-03T19:19:41.174002+0000","last_clean":"2023-10-03T19:19:41.174002+0000","last_became_active":"2023-10-03T19:19:39.451178+0000","last_became_peered":"2023-10-03T19:19:39.451178+0000","last_unstale":"2023-10-03T19:19:41.174002+0000","last_undegraded":"2023-10-03T19:19:41.174002+0000","last_fullsized":"2023-10-03T19:19:41.174002+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:23:35.520091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173972+0000","last_change":"2023-10-03T19:19:39.085006+0000","last_active":"2023-10-03T19:19:41.173972+0000","last_peered":"2023-10-03T19:19:41.173972+0000","last_clean":"2023-10-03T19:19:41.173972+0000","last_became_active":"2023-10-03T19:19:39.084520+0000","last_became_peered":"2023-10-03T19:19:39.084520+0000","last_unstale":"2023-10-03T19:19:41.173972+0000","last_undegraded":"2023-10-03T19:19:41.173972+0000","last_fullsized":"2023-10-03T19:19:41.173972+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:32:44.644764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175389+0000","last_change":"2023-10-03T19:19:39.490667+0000","last_active":"2023-10-03T19:19:41.175389+0000","last_peered":"2023-10-03T19:19:41.175389+0000","last_clean":"2023-10-03T19:19:41.175389+0000","last_became_active":"2023-10-03T19:19:39.489883+0000","last_became_peered":"2023-10-03T19:19:39.489883+0000","last_unstale":"2023-10-03T19:19:41.175389+0000","last_undegraded":"2023-10-03T19:19:41.175389+0000","last_fullsized":"2023-10-03T19:19:41.175389+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:47:44.558983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678162+0000","last_change":"2023-10-03T19:19:39.093636+0000","last_active":"2023-10-03T19:19:40.678162+0000","last_peered":"2023-10-03T19:19:40.678162+0000","last_clean":"2023-10-03T19:19:40.678162+0000","last_became_active":"2023-10-03T19:19:39.093026+0000","last_became_peered":"2023-10-03T19:19:39.093026+0000","last_unstale":"2023-10-03T19:19:40.678162+0000","last_undegraded":"2023-10-03T19:19:40.678162+0000","last_fullsized":"2023-10-03T19:19:40.678162+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:43:45.819056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.067174+0000","last_change":"2023-10-03T19:19:39.067174+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.067174+0000","last_undegraded":"2023-10-03T19:19:39.067174+0000","last_fullsized":"2023-10-03T19:19:39.067174+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173694+0000","last_change":"2023-10-03T19:19:39.087025+0000","last_active":"2023-10-03T19:19:41.173694+0000","last_peered":"2023-10-03T19:19:41.173694+0000","last_clean":"2023-10-03T19:19:41.173694+0000","last_became_active":"2023-10-03T19:19:39.086598+0000","last_became_peered":"2023-10-03T19:19:39.086598+0000","last_unstale":"2023-10-03T19:19:41.173694+0000","last_undegraded":"2023-10-03T19:19:41.173694+0000","last_fullsized":"2023-10-03T19:19:41.173694+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:39:18.515681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.064555+0000","last_change":"2023-10-03T19:19:39.064555+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.064555+0000","last_undegraded":"2023-10-03T19:19:39.064555+0000","last_fullsized":"2023-10-03T19:19:39.064555+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174434+0000","last_change":"2023-10-03T19:19:39.077632+0000","last_active":"2023-10-03T19:19:41.174434+0000","last_peered":"2023-10-03T19:19:41.174434+0000","last_clean":"2023-10-03T19:19:41.174434+0000","last_became_active":"2023-10-03T19:19:39.077243+0000","last_became_peered":"2023-10-03T19:19:39.077243+0000","last_unstale":"2023-10-03T19:19:41.174434+0000","last_undegraded":"2023-10-03T19:19:41.174434+0000","last_fullsized":"2023-10-03T19:19:41.174434+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:11:33.305806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":316,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175066+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:19:41.175066+0000","last_peered":"2023-10-03T19:19:41.175066+0000","last_clean":"2023-10-03T19:19:41.175066+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:19:41.175066+0000","last_undegraded":"2023-10-03T19:19:41.175066+0000","last_fullsized":"2023-10-03T19:19:41.175066+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:01:58.556394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":156,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-03T19:19:39.078949+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:19:39.078949+0000","last_peered":"2023-10-03T19:19:39.078949+0000","last_clean":"2023-10-03T19:19:39.078949+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:19:39.078949+0000","last_undegraded":"2023-10-03T19:19:39.078949+0000","last_fullsized":"2023-10-03T19:19:39.078949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:51:45.180638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.677990+0000","last_change":"2023-10-03T19:19:39.490296+0000","last_active":"2023-10-03T19:19:40.677990+0000","last_peered":"2023-10-03T19:19:40.677990+0000","last_clean":"2023-10-03T19:19:40.677990+0000","last_became_active":"2023-10-03T19:19:39.489715+0000","last_became_peered":"2023-10-03T19:19:39.489715+0000","last_unstale":"2023-10-03T19:19:40.677990+0000","last_undegraded":"2023-10-03T19:19:40.677990+0000","last_fullsized":"2023-10-03T19:19:40.677990+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:21:53.299603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175437+0000","last_change":"2023-10-03T19:19:39.092502+0000","last_active":"2023-10-03T19:19:41.175437+0000","last_peered":"2023-10-03T19:19:41.175437+0000","last_clean":"2023-10-03T19:19:41.175437+0000","last_became_active":"2023-10-03T19:19:39.091671+0000","last_became_peered":"2023-10-03T19:19:39.091671+0000","last_unstale":"2023-10-03T19:19:41.175437+0000","last_undegraded":"2023-10-03T19:19:41.175437+0000","last_fullsized":"2023-10-03T19:19:41.175437+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:28:58.772881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":164,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174651+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:19:41.174651+0000","last_peered":"2023-10-03T19:19:41.174651+0000","last_clean":"2023-10-03T19:19:41.174651+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:19:41.174651+0000","last_undegraded":"2023-10-03T19:19:41.174651+0000","last_fullsized":"2023-10-03T19:19:41.174651+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:28:06.684655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175720+0000","last_change":"2023-10-03T19:19:39.474081+0000","last_active":"2023-10-03T19:19:41.175720+0000","last_peered":"2023-10-03T19:19:41.175720+0000","last_clean":"2023-10-03T19:19:41.175720+0000","last_became_active":"2023-10-03T19:19:39.473795+0000","last_became_peered":"2023-10-03T19:19:39.473795+0000","last_unstale":"2023-10-03T19:19:41.175720+0000","last_undegraded":"2023-10-03T19:19:41.175720+0000","last_fullsized":"2023-10-03T19:19:41.175720+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:50:56.639365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-03T19:19:39.107801+0000","last_change":"2023-10-03T19:19:39.097664+0000","last_active":"2023-10-03T19:19:39.107801+0000","last_peered":"2023-10-03T19:19:39.107801+0000","last_clean":"2023-10-03T19:19:39.107801+0000","last_became_active":"2023-10-03T19:19:39.097135+0000","last_became_peered":"2023-10-03T19:19:39.097135+0000","last_unstale":"2023-10-03T19:19:39.107801+0000","last_undegraded":"2023-10-03T19:19:39.107801+0000","last_fullsized":"2023-10-03T19:19:39.107801+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:07:06.406878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173371+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:19:41.173371+0000","last_peered":"2023-10-03T19:19:41.173371+0000","last_clean":"2023-10-03T19:19:41.173371+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:19:41.173371+0000","last_undegraded":"2023-10-03T19:19:41.173371+0000","last_fullsized":"2023-10-03T19:19:41.173371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:50:13.204633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173376+0000","last_change":"2023-10-03T19:19:39.445108+0000","last_active":"2023-10-03T19:19:41.173376+0000","last_peered":"2023-10-03T19:19:41.173376+0000","last_clean":"2023-10-03T19:19:41.173376+0000","last_became_active":"2023-10-03T19:19:39.443964+0000","last_became_peered":"2023-10-03T19:19:39.443964+0000","last_unstale":"2023-10-03T19:19:41.173376+0000","last_undegraded":"2023-10-03T19:19:41.173376+0000","last_fullsized":"2023-10-03T19:19:41.173376+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:50:29.706153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678974+0000","last_change":"2023-10-03T19:19:39.099820+0000","last_active":"2023-10-03T19:19:40.678974+0000","last_peered":"2023-10-03T19:19:40.678974+0000","last_clean":"2023-10-03T19:19:40.678974+0000","last_became_active":"2023-10-03T19:19:39.094297+0000","last_became_peered":"2023-10-03T19:19:39.094297+0000","last_unstale":"2023-10-03T19:19:40.678974+0000","last_undegraded":"2023-10-03T19:19:40.678974+0000","last_fullsized":"2023-10-03T19:19:40.678974+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:25:05.736398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":156,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-03T19:19:39.076080+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:19:39.076080+0000","last_peered":"2023-10-03T19:19:39.076080+0000","last_clean":"2023-10-03T19:19:39.076080+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:19:39.076080+0000","last_undegraded":"2023-10-03T19:19:39.076080+0000","last_fullsized":"2023-10-03T19:19:39.076080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:42:50.307434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.429963+0000","last_change":"2023-10-03T19:19:39.499012+0000","last_active":"2023-10-03T19:19:40.429963+0000","last_peered":"2023-10-03T19:19:40.429963+0000","last_clean":"2023-10-03T19:19:40.429963+0000","last_became_active":"2023-10-03T19:19:39.498726+0000","last_became_peered":"2023-10-03T19:19:39.498726+0000","last_unstale":"2023-10-03T19:19:40.429963+0000","last_undegraded":"2023-10-03T19:19:40.429963+0000","last_fullsized":"2023-10-03T19:19:40.429963+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:24:21.652472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678086+0000","last_change":"2023-10-03T19:19:39.090362+0000","last_active":"2023-10-03T19:19:40.678086+0000","last_peered":"2023-10-03T19:19:40.678086+0000","last_clean":"2023-10-03T19:19:40.678086+0000","last_became_active":"2023-10-03T19:19:39.089665+0000","last_became_peered":"2023-10-03T19:19:39.089665+0000","last_unstale":"2023-10-03T19:19:40.678086+0000","last_undegraded":"2023-10-03T19:19:40.678086+0000","last_fullsized":"2023-10-03T19:19:40.678086+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:27:13.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":156,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176195+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:19:41.176195+0000","last_peered":"2023-10-03T19:19:41.176195+0000","last_clean":"2023-10-03T19:19:41.176195+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:19:41.176195+0000","last_undegraded":"2023-10-03T19:19:41.176195+0000","last_fullsized":"2023-10-03T19:19:41.176195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:20:40.902125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174641+0000","last_change":"2023-10-03T19:19:39.451521+0000","last_active":"2023-10-03T19:19:41.174641+0000","last_peered":"2023-10-03T19:19:41.174641+0000","last_clean":"2023-10-03T19:19:41.174641+0000","last_became_active":"2023-10-03T19:19:39.451224+0000","last_became_peered":"2023-10-03T19:19:39.451224+0000","last_unstale":"2023-10-03T19:19:41.174641+0000","last_undegraded":"2023-10-03T19:19:41.174641+0000","last_fullsized":"2023-10-03T19:19:41.174641+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:50:20.369948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173326+0000","last_change":"2023-10-03T19:19:39.072003+0000","last_active":"2023-10-03T19:19:41.173326+0000","last_peered":"2023-10-03T19:19:41.173326+0000","last_clean":"2023-10-03T19:19:41.173326+0000","last_became_active":"2023-10-03T19:19:39.071324+0000","last_became_peered":"2023-10-03T19:19:39.071324+0000","last_unstale":"2023-10-03T19:19:41.173326+0000","last_undegraded":"2023-10-03T19:19:41.173326+0000","last_fullsized":"2023-10-03T19:19:41.173326+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:01:20.263082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":164,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175496+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:19:41.175496+0000","last_peered":"2023-10-03T19:19:41.175496+0000","last_clean":"2023-10-03T19:19:41.175496+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:19:41.175496+0000","last_undegraded":"2023-10-03T19:19:41.175496+0000","last_fullsized":"2023-10-03T19:19:41.175496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:44:47.179646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.061302+0000","last_change":"2023-10-03T19:19:39.061302+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.061302+0000","last_undegraded":"2023-10-03T19:19:39.061302+0000","last_fullsized":"2023-10-03T19:19:39.061302+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174033+0000","last_change":"2023-10-03T19:19:39.080203+0000","last_active":"2023-10-03T19:19:41.174033+0000","last_peered":"2023-10-03T19:19:41.174033+0000","last_clean":"2023-10-03T19:19:41.174033+0000","last_became_active":"2023-10-03T19:19:39.079875+0000","last_became_peered":"2023-10-03T19:19:39.079875+0000","last_unstale":"2023-10-03T19:19:41.174033+0000","last_undegraded":"2023-10-03T19:19:41.174033+0000","last_fullsized":"2023-10-03T19:19:41.174033+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:47:10.549041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":156,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176538+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:19:41.176538+0000","last_peered":"2023-10-03T19:19:41.176538+0000","last_clean":"2023-10-03T19:19:41.176538+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:19:41.176538+0000","last_undegraded":"2023-10-03T19:19:41.176538+0000","last_fullsized":"2023-10-03T19:19:41.176538+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:00:06.011070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.061790+0000","last_change":"2023-10-03T19:19:39.061790+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.061790+0000","last_undegraded":"2023-10-03T19:19:39.061790+0000","last_fullsized":"2023-10-03T19:19:39.061790+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173183+0000","last_change":"2023-10-03T19:19:39.073332+0000","last_active":"2023-10-03T19:19:41.173183+0000","last_peered":"2023-10-03T19:19:41.173183+0000","last_clean":"2023-10-03T19:19:41.173183+0000","last_became_active":"2023-10-03T19:19:39.072635+0000","last_became_peered":"2023-10-03T19:19:39.072635+0000","last_unstale":"2023-10-03T19:19:41.173183+0000","last_undegraded":"2023-10-03T19:19:41.173183+0000","last_fullsized":"2023-10-03T19:19:41.173183+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:58:24.112901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":156,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.679025+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:19:40.679025+0000","last_peered":"2023-10-03T19:19:40.679025+0000","last_clean":"2023-10-03T19:19:40.679025+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:19:40.679025+0000","last_undegraded":"2023-10-03T19:19:40.679025+0000","last_fullsized":"2023-10-03T19:19:40.679025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:11:45.085836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509531,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33704,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":32448,"kb_avail":94338136,"statfs":{"total":96636764160,"available":96602251264,"internally_reserved":0,"allocated":1277952,"data_stored":1142210,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":33226752},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.85899999999999999,"15min":0.92700000000000005},"min":{"1min":0.66300000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1950000000000001,"5min":1.206,"15min":4.0469999999999997},"last":2.1080000000000001},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.85299999999999998,"15min":0.82099999999999995},"min":{"1min":0.55200000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.177,"5min":1.2310000000000001,"15min":1.3420000000000001},"last":1.121}]},{"osd":1,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.86299999999999999,"15min":0.98599999999999999},"min":{"1min":0.61899999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1359999999999999,"5min":1.3200000000000001,"15min":3.8239999999999998},"last":2.298},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.89800000000000002,"15min":0.87},"min":{"1min":0.64500000000000002,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.034}]},{"osd":2,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.95899999999999996,"15min":0.88400000000000001},"min":{"1min":0.55300000000000005,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1719999999999999,"5min":6.0449999999999999,"15min":6.0449999999999999},"last":4.4779999999999998},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.94199999999999995,"15min":1.0109999999999999},"min":{"1min":0.69999999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.296,"5min":1.5800000000000001,"15min":3.98},"last":2.673}]},{"osd":3,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.034,"15min":0.95799999999999996},"min":{"1min":0.68500000000000005,"5min":0.63800000000000001,"15min":0.51100000000000001},"max":{"1min":1.232,"5min":6.125,"15min":6.125},"last":4.3650000000000002},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.97599999999999998,"15min":1.0840000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.175,"5min":1.444,"15min":3.9140000000000001},"last":1.593}]},{"osd":4,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.89800000000000002,"15min":1.0920000000000001},"min":{"1min":0.61599999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":5.1130000000000004},"last":2.4769999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.016,"15min":1.018},"min":{"1min":0.70699999999999996,"5min":0.629,"15min":0.629},"max":{"1min":1.214,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":12.196999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.006,"15min":1.2010000000000001},"min":{"1min":0.63700000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2470000000000001,"5min":1.349,"15min":5.1859999999999999},"last":2.581},{"interface":"front","average":{"1min":1.004,"5min":1.0209999999999999,"15min":1.115},"min":{"1min":0.69299999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.29,"5min":1.2949999999999999,"15min":2.0609999999999999},"last":1.6719999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0740000000000001,"15min":1.093},"min":{"1min":0.80000000000000004,"5min":0.75700000000000001,"15min":0.69399999999999995},"max":{"1min":1.3839999999999999,"5min":1.4890000000000001,"15min":1.5449999999999999},"last":1.7609999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.1459999999999999,"15min":1.167},"min":{"1min":0.77800000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.232,"5min":6.1580000000000004,"15min":6.1580000000000004},"last":4.5570000000000004}]}]},{"osd":6,"up_from":15,"seq":64424509531,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26992,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":25792,"kb_avail":94344848,"statfs":{"total":96636764160,"available":96609124352,"internally_reserved":0,"allocated":1220608,"data_stored":552686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":26411008},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.84599999999999997,"15min":0.82699999999999996},"min":{"1min":0.54100000000000004,"5min":0.45400000000000001,"15min":0.44600000000000001},"max":{"1min":1.234,"5min":1.3340000000000001,"15min":1.504},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.91100000000000003,"15min":0.88900000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.44600000000000001},"max":{"1min":1.1080000000000001,"5min":1.423,"15min":1.839},"last":1.2430000000000001}]},{"osd":1,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.86699999999999999,"15min":0.84699999999999998},"min":{"1min":0.56000000000000005,"5min":0.52100000000000002,"15min":0.504},"max":{"1min":1.1859999999999999,"5min":1.27,"15min":2.0150000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.88900000000000001,"15min":0.88200000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.161,"5min":1.448,"15min":1.448},"last":0.73599999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.93799999999999994,"15min":0.88900000000000001},"min":{"1min":0.66400000000000003,"5min":0.59199999999999997,"15min":0.51900000000000002},"max":{"1min":1.4430000000000001,"5min":1.528,"15min":1.528},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.92700000000000005,"15min":0.92500000000000004},"min":{"1min":0.60899999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1519999999999999,"5min":1.369,"15min":1.546},"last":0.96199999999999997}]},{"osd":3,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.96299999999999997,"15min":0.97899999999999998},"min":{"1min":0.68899999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.298,"5min":1.377,"15min":1.6990000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90700000000000003,"15min":0.90800000000000003},"min":{"1min":0.70199999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.143,"5min":1.206,"15min":2.121},"last":0.79600000000000004}]},{"osd":4,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.91600000000000004,"15min":0.998},"min":{"1min":0.67400000000000004,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.335,"5min":1.339,"15min":1.95},"last":1.075},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.995,"15min":1.0680000000000001},"min":{"1min":0.64400000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4490000000000001,"5min":1.504,"15min":1.7709999999999999},"last":1.1120000000000001}]},{"osd":5,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.90700000000000003,"15min":0.99199999999999999},"min":{"1min":0.624,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.226,"5min":1.3200000000000001,"15min":2.2570000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.048,"15min":1.103},"min":{"1min":0.71799999999999997,"5min":0.68300000000000005,"15min":0.68100000000000005},"max":{"1min":1.5009999999999999,"5min":1.524,"15min":2.0619999999999998},"last":1.2010000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.071,"15min":1.109},"min":{"1min":0.748,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.639,"5min":1.639,"15min":2.0049999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.044,"15min":1.0820000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.61899999999999999},"max":{"1min":1.3879999999999999,"5min":1.4350000000000001,"15min":2.4249999999999998},"last":1.151}]}]},{"osd":4,"up_from":15,"seq":64424509532,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42152,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":40960,"kb_avail":94329688,"statfs":{"total":96636764160,"available":96593600512,"internally_reserved":0,"allocated":1212416,"data_stored":551774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":41943040},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":1.0600000000000001,"15min":0.875},"min":{"1min":0.64200000000000002,"5min":0.54700000000000004,"15min":0.50600000000000001},"max":{"1min":1.0600000000000001,"5min":17.686,"15min":17.686},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.90100000000000002,"5min":1.02,"15min":0.89000000000000001},"min":{"1min":0.64000000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.28,"5min":16.925999999999998,"15min":16.925999999999998},"last":0.622}]},{"osd":1,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.085,"15min":0.98499999999999999},"min":{"1min":0.67700000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1759999999999999,"5min":16.640999999999998,"15min":16.640999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":1.089,"15min":0.93400000000000005},"min":{"1min":0.67300000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.151,"5min":17.59,"15min":17.59},"last":0.80700000000000005}]},{"osd":2,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.997,"15min":0.94299999999999995},"min":{"1min":0.70699999999999996,"5min":0.56200000000000006,"15min":0.53200000000000003},"max":{"1min":1.1180000000000001,"5min":8.5630000000000006,"15min":8.5630000000000006},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.93999999999999995,"5min":1.143,"15min":1.01},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.175,"5min":17.734000000000002,"15min":17.734000000000002},"last":0.88800000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.0880000000000001,"15min":0.94299999999999995},"min":{"1min":0.72499999999999998,"5min":0.61499999999999999,"15min":0.53900000000000003},"max":{"1min":1.242,"5min":16.98,"15min":16.98},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.997,"5min":1.161,"15min":1.105},"min":{"1min":0.66900000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2789999999999999,"5min":16.434000000000001,"15min":16.434000000000001},"last":0.82999999999999996}]},{"osd":5,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":1.1020000000000001,"15min":1.0820000000000001},"min":{"1min":0.624,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.143,"5min":17.782,"15min":17.782},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.96599999999999997,"15min":1.002},"min":{"1min":0.65700000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.264,"5min":1.708,"15min":1.708},"last":0.77000000000000002}]},{"osd":6,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.3859999999999999,"15min":1.27},"min":{"1min":0.66000000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.2250000000000001,"5min":36.106000000000002,"15min":36.106000000000002},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.2450000000000001,"15min":1.216},"min":{"1min":0.86099999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.2410000000000001,"5min":17.646999999999998,"15min":17.646999999999998},"last":0.97299999999999998}]},{"osd":7,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.226,"15min":1.1359999999999999},"min":{"1min":0.81200000000000006,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.421,"5min":17.042000000000002,"15min":17.042000000000002},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.3,"15min":1.262},"min":{"1min":0.83199999999999996,"5min":0.66400000000000003,"15min":0.63300000000000001},"max":{"1min":1.4670000000000001,"5min":16.32,"15min":16.32},"last":0.998}]}]},{"osd":2,"up_from":15,"seq":64424509532,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":31424,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1204224,"data_stored":550552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":32178176},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.79100000000000004,"15min":0.61299999999999999},"min":{"1min":0.47799999999999998,"5min":0.32200000000000001,"15min":0.247},"max":{"1min":0.98199999999999998,"5min":13.629,"15min":13.629},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":1.206,"15min":0.80900000000000005},"min":{"1min":0.34000000000000002,"5min":0.30299999999999999,"15min":0.28999999999999998},"max":{"1min":0.97199999999999998,"5min":40.439,"15min":40.439},"last":0.53200000000000003}]},{"osd":1,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.90200000000000002,"15min":0.71099999999999997},"min":{"1min":0.47899999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1,"5min":14.074,"15min":14.074},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.78500000000000003,"15min":0.64900000000000002},"min":{"1min":0.38800000000000001,"5min":0.34799999999999998,"15min":0.26400000000000001},"max":{"1min":1.1080000000000001,"5min":7.0060000000000002,"15min":7.0060000000000002},"last":0.44800000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.90000000000000002,"15min":0.71299999999999997},"min":{"1min":0.36699999999999999,"5min":0.28899999999999998,"15min":0.224},"max":{"1min":1.05,"5min":13.423999999999999,"15min":13.423999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.0649999999999999,"15min":0.82899999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.36399999999999999},"max":{"1min":1.1220000000000001,"5min":18.568999999999999,"15min":18.568999999999999},"last":0.56799999999999995}]},{"osd":4,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.94999999999999996,"15min":0.878},"min":{"1min":0.64200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.105,"5min":1.718,"15min":1.718},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.3380000000000001,"15min":1.05},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.22,"5min":28.667999999999999,"15min":28.667999999999999},"last":0.63}]},{"osd":5,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.0529999999999999,"15min":0.92100000000000004},"min":{"1min":0.67600000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.399,"5min":5.4459999999999997,"15min":5.4459999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.2230000000000001,"15min":1.0309999999999999},"min":{"1min":0.63300000000000001,"5min":0.57599999999999996,"15min":0.52700000000000002},"max":{"1min":1.4970000000000001,"5min":14.007,"15min":14.007},"last":0.70299999999999996}]},{"osd":6,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":1.1040000000000001,"15min":0.97099999999999997},"min":{"1min":0.65900000000000003,"5min":0.60099999999999998,"15min":0.49099999999999999},"max":{"1min":1.212,"5min":10.679,"15min":10.679},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.087,"15min":1.004},"min":{"1min":0.75600000000000001,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.325,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.88200000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.3240000000000001,"15min":1.1080000000000001},"min":{"1min":0.70299999999999996,"5min":0.63100000000000001,"15min":0.56100000000000005},"max":{"1min":1.415,"5min":18.623000000000001,"15min":18.623000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":1.002,"5min":1.0920000000000001,"15min":0.996},"min":{"1min":0.61699999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1850000000000001,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.84499999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509531,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30628,"kb_used_data":1180,"kb_used_omap":0,"kb_used_meta":29440,"kb_avail":94341212,"statfs":{"total":96636764160,"available":96605401088,"internally_reserved":0,"allocated":1208320,"data_stored":551716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30146560},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59199999999999997,"15min":0.55600000000000005},"min":{"1min":0.27900000000000003,"5min":0.27200000000000002,"15min":0.26900000000000002},"max":{"1min":0.92100000000000004,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70399999999999996,"15min":0.56799999999999995},"min":{"1min":0.41799999999999998,"5min":0.27200000000000002,"15min":0.22900000000000001},"max":{"1min":1.1899999999999999,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.41799999999999998}]},{"osd":2,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68300000000000005,"15min":0.58899999999999997},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.26200000000000001},"max":{"1min":0.879,"5min":1.506,"15min":1.506},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.82099999999999995,"15min":0.70599999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.312},"max":{"1min":1.1919999999999999,"5min":1.365,"15min":1.365},"last":0.82999999999999996}]},{"osd":3,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.76400000000000001,"15min":0.67300000000000004},"min":{"1min":0.36099999999999999,"5min":0.31,"15min":0.31},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.75700000000000001,"15min":0.63400000000000001},"min":{"1min":0.39100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.90700000000000003,"5min":1.232,"15min":1.27},"last":0.70899999999999996}]},{"osd":4,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.89000000000000001,"15min":0.82799999999999996},"min":{"1min":0.61199999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0860000000000001,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.98499999999999999,"15min":0.91400000000000003},"min":{"1min":0.69899999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3260000000000001,"5min":1.728,"15min":1.728},"last":1.0609999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.98999999999999999,"15min":0.89500000000000002},"min":{"1min":0.60299999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.28,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.117},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.96299999999999997,"15min":0.88500000000000001},"min":{"1min":0.77300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.198,"5min":1.3959999999999999,"15min":1.6080000000000001},"last":0.89200000000000002}]},{"osd":6,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0349999999999999,"15min":0.95399999999999996},"min":{"1min":0.59499999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2689999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.149},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0289999999999999,"15min":0.93400000000000005},"min":{"1min":0.66700000000000004,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3600000000000001,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.0229999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0669999999999999,"15min":0.97599999999999998},"min":{"1min":0.55100000000000005,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.292,"5min":1.673,"15min":1.673},"last":1.204},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0289999999999999,"15min":0.93999999999999995},"min":{"1min":0.67500000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4379999999999999,"5min":1.5880000000000001,"15min":1.649},"last":1.1719999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542235,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25176,"kb_used_data":1168,"kb_used_omap":0,"kb_used_meta":24000,"kb_avail":94346664,"statfs":{"total":96636764160,"available":96610983936,"internally_reserved":0,"allocated":1196032,"data_stored":545611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24576000},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.63200000000000001,"15min":0.58799999999999997},"min":{"1min":0.36399999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.96199999999999997,"5min":1.212,"15min":1.212},"last":0.221},{"interface":"front","average":{"1min":0.755,"5min":0.69999999999999996,"15min":0.66000000000000003},"min":{"1min":0.38900000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.5,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.33700000000000002}]},{"osd":1,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.70399999999999996,"15min":0.64800000000000002},"min":{"1min":0.42299999999999999,"5min":0.28599999999999998,"15min":0.27000000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76000000000000001,"15min":0.69099999999999995},"min":{"1min":0.34300000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.169,"5min":1.2210000000000001,"15min":1.222},"last":0.40300000000000002}]},{"osd":2,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.79400000000000004,"15min":0.73299999999999998},"min":{"1min":0.35999999999999999,"5min":0.317,"15min":0.317},"max":{"1min":1.1539999999999999,"5min":1.23,"15min":1.23},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73199999999999998,"15min":0.66000000000000003},"min":{"1min":0.371,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.05,"5min":1.671,"15min":1.671},"last":0.316}]},{"osd":4,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.92000000000000004,"15min":0.91200000000000003},"min":{"1min":0.63900000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2949999999999999,"5min":1.411,"15min":1.496},"last":0.58699999999999997},{"interface":"front","average":{"1min":1.006,"5min":1.018,"15min":0.95599999999999996},"min":{"1min":0.76400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3280000000000001,"5min":1.546,"15min":1.546},"last":0.44800000000000001}]},{"osd":5,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.91200000000000003,"15min":0.88700000000000001},"min":{"1min":0.63300000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.095,"5min":1.581,"15min":1.581},"last":0.50600000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.022,"15min":1.004},"min":{"1min":0.68100000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4179999999999999,"5min":1.498,"15min":1.498},"last":0.60699999999999998}]},{"osd":6,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.94599999999999995,"15min":0.92800000000000005},"min":{"1min":0.68799999999999994,"5min":0.56999999999999995,"15min":0.56699999999999995},"max":{"1min":1.212,"5min":1.347,"15min":1.347},"last":0.47799999999999998},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.05,"15min":1.006},"min":{"1min":0.80000000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.373,"5min":1.4970000000000001,"15min":1.5629999999999999},"last":0.56399999999999995}]},{"osd":7,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.083,"15min":1.0289999999999999},"min":{"1min":0.70599999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":1.109,"5min":1.0609999999999999,"15min":1.03},"min":{"1min":0.65300000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.659,"5min":1.659,"15min":1.708},"last":0.625}]}]},{"osd":5,"up_from":13,"seq":55834574938,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22716,"kb_used_data":1140,"kb_used_omap":0,"kb_used_meta":21568,"kb_avail":94349124,"statfs":{"total":96636764160,"available":96613502976,"internally_reserved":0,"allocated":1167360,"data_stored":531273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22085632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.85799999999999998,"15min":0.83399999999999996},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.181,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.89400000000000002,"15min":0.86599999999999999},"min":{"1min":0.78200000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.26,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.1990000000000001}]},{"osd":1,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.872,"15min":0.84499999999999997},"min":{"1min":0.505,"5min":0.501,"15min":0.501},"max":{"1min":1.044,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.91000000000000003,"15min":0.92300000000000004},"min":{"1min":0.63100000000000001,"5min":0.58699999999999997,"15min":0.57099999999999995},"max":{"1min":1.23,"5min":1.23,"15min":1.514},"last":1.127}]},{"osd":2,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.91000000000000003,"15min":0.90300000000000002},"min":{"1min":0.625,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2010000000000001,"5min":1.351,"15min":1.3700000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.999,"5min":0.93000000000000005,"15min":0.90600000000000003},"min":{"1min":0.82499999999999996,"5min":0.57099999999999995,"15min":0.53300000000000003},"max":{"1min":1.1819999999999999,"5min":1.1930000000000001,"15min":1.3320000000000001},"last":1.056}]},{"osd":3,"last update":"Tue Oct 3 19:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.93600000000000005,"15min":0.93100000000000005},"min":{"1min":0.67700000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2210000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.046,"5min":1.03,"15min":1.028},"min":{"1min":0.78700000000000003,"5min":0.65900000000000003,"15min":0.61199999999999999},"max":{"1min":1.3129999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.80400000000000005}]},{"osd":4,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.97499999999999998,"15min":0.97299999999999998},"min":{"1min":0.70699999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.2450000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96399999999999997,"15min":1.0129999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2749999999999999,"5min":1.335,"15min":1.7709999999999999},"last":0.73699999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.995,"15min":1.024},"min":{"1min":0.67000000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.204,"5min":1.546,"15min":1.546},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0880000000000001,"15min":1.1240000000000001},"min":{"1min":0.82499999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.3759999999999999,"5min":1.823,"15min":1.823},"last":0.93000000000000005}]},{"osd":7,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0569999999999999,"15min":1.071},"min":{"1min":0.68700000000000006,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.5680000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.119,"15min":1.143},"min":{"1min":0.86499999999999999,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.325,"5min":1.4179999999999999,"15min":1.9099999999999999},"last":1.012}]}]},{"osd":0,"up_from":13,"seq":55834574939,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30072,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":28864,"kb_avail":94341768,"statfs":{"total":96636764160,"available":96605970432,"internally_reserved":0,"allocated":1228800,"data_stored":1120477,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":29556736},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.69699999999999995,"15min":0.61399999999999999},"min":{"1min":0.502,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.92000000000000004,"5min":5.7480000000000002,"15min":5.7480000000000002},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.80900000000000005,"15min":0.746},"min":{"1min":0.54700000000000004,"5min":0.37,"15min":0.33000000000000002},"max":{"1min":1.0760000000000001,"5min":6.274,"15min":6.274},"last":0.84899999999999998}]},{"osd":2,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.81999999999999995,"15min":0.746},"min":{"1min":0.46700000000000003,"5min":0.36499999999999999,"15min":0.35399999999999998},"max":{"1min":0.97599999999999998,"5min":6.1609999999999996,"15min":6.1609999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71499999999999997,"15min":0.69899999999999995},"min":{"1min":0.44500000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.997,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.80200000000000005}]},{"osd":3,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.90800000000000003,"15min":0.78000000000000003},"min":{"1min":0.57499999999999996,"5min":0.41799999999999998,"15min":0.36799999999999999},"max":{"1min":1.1739999999999999,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82199999999999995,"15min":0.73199999999999998},"min":{"1min":0.53300000000000003,"5min":0.376,"15min":0.30299999999999999},"max":{"1min":1.0780000000000001,"5min":1.375,"15min":1.375},"last":0.93200000000000005}]},{"osd":4,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":1.0029999999999999,"15min":0.93600000000000005},"min":{"1min":0.71299999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.254,"5min":8.1159999999999997,"15min":8.1159999999999997},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.056,"5min":1.0860000000000001,"15min":1.0429999999999999},"min":{"1min":0.71199999999999997,"5min":0.57299999999999995,"15min":0.504},"max":{"1min":1.3440000000000001,"5min":6.2320000000000002,"15min":6.2320000000000002},"last":1.0960000000000001}]},{"osd":5,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.2549999999999999,"15min":1.1140000000000001},"min":{"1min":0.69199999999999995,"5min":0.59399999999999997,"15min":0.46899999999999997},"max":{"1min":1.4259999999999999,"5min":17.420000000000002,"15min":17.420000000000002},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.222,"15min":1.052},"min":{"1min":0.74299999999999999,"5min":0.59499999999999997,"15min":0.54300000000000004},"max":{"1min":1.371,"5min":17.643000000000001,"15min":17.643000000000001},"last":1.048}]},{"osd":6,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0880000000000001,"15min":1.038},"min":{"1min":0.77500000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3520000000000001,"5min":5.7220000000000004,"15min":5.7220000000000004},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0669999999999999,"15min":1.0129999999999999},"min":{"1min":0.877,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.417,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.1479999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.159,"15min":1.0740000000000001},"min":{"1min":0.81299999999999994,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3939999999999999,"5min":5.7800000000000002,"15min":5.7800000000000002},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.0920000000000001,"15min":1.0669999999999999},"min":{"1min":0.85699999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.343,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.21}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:19:43.084 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:19:43.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.244+0000 7fa56e689640 1 Processor -- start 2023-10-03T19:19:43.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.244+0000 7fa56e689640 1 -- start start 2023-10-03T19:19:43.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.244+0000 7fa56e689640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa56806e640 0x7fa56806ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:43.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.244+0000 7fa56e689640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa56806e3f0 con 0x7fa56814e790 2023-10-03T19:19:43.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.244+0000 7fa56e689640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa56814f6c0 con 0x7fa56814f2f0 2023-10-03T19:19:43.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.244+0000 7fa56e689640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa56806e110 con 0x7fa56806e640 2023-10-03T19:19:43.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.244+0000 7fa5677fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa56806e640 0x7fa56806ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:43.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.244+0000 7fa5677fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa56806e640 0x7fa56806ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47768/0 (socket says 172.21.15.45:47768) 2023-10-03T19:19:43.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.244+0000 7fa5677fe640 1 -- 172.21.15.45:0/535277028 learned_addr learned my addr 172.21.15.45:0/535277028 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:43.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.244+0000 7fa56cc26640 1 --1- 172.21.15.45:0/535277028 >> v1:172.21.15.45:6789/0 conn(0x7fa56814e790 0x7fa568159030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39728/0 (socket says 172.21.15.45:39728) 2023-10-03T19:19:43.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.244+0000 7fa5677fe640 1 -- 172.21.15.45:0/535277028 >> v1:172.21.15.79:6789/0 conn(0x7fa56814f2f0 legacy=0x7fa5680c2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:43.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.244+0000 7fa5677fe640 1 -- 172.21.15.45:0/535277028 >> v1:172.21.15.45:6789/0 conn(0x7fa56814e790 legacy=0x7fa568159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:43.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.244+0000 7fa5677fe640 1 -- 172.21.15.45:0/535277028 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5680bbb20 con 0x7fa56806e640 2023-10-03T19:19:43.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa5677fe640 1 --2- 172.21.15.45:0/535277028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa56806e640 0x7fa56806ecb0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fa55c009870 tx=0x7fa55c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45de06244f5380ab server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:43.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa566ffd640 1 -- 172.21.15.45:0/535277028 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c0a9620 con 0x7fa56806e640 2023-10-03T19:19:43.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa566ffd640 1 -- 172.21.15.45:0/535277028 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c0a9780 con 0x7fa56806e640 2023-10-03T19:19:43.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa566ffd640 1 -- 172.21.15.45:0/535277028 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c0a9b10 con 0x7fa56806e640 2023-10-03T19:19:43.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa56e689640 1 -- 172.21.15.45:0/535277028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa56806e640 msgr2=0x7fa56806ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:43.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa56e689640 1 --2- 172.21.15.45:0/535277028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa56806e640 0x7fa56806ecb0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fa55c009870 tx=0x7fa55c01c540 comp rx=0 tx=0).stop 2023-10-03T19:19:43.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa56e689640 1 -- 172.21.15.45:0/535277028 shutdown_connections 2023-10-03T19:19:43.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa56e689640 1 --2- 172.21.15.45:0/535277028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa56806e640 0x7fa56806ecb0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:43.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa56e689640 1 -- 172.21.15.45:0/535277028 >> 172.21.15.45:0/535277028 conn(0x7fa5680a4400 msgr2=0x7fa5680a4800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:43.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa56e689640 1 -- 172.21.15.45:0/535277028 shutdown_connections 2023-10-03T19:19:43.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa56e689640 1 -- 172.21.15.45:0/535277028 wait complete. 2023-10-03T19:19:43.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa56e689640 1 Processor -- start 2023-10-03T19:19:43.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa56e689640 1 -- start start 2023-10-03T19:19:43.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa56e689640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa56806e640 0x7fa568150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:43.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa56e689640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa56814e790 0x7fa568143820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:43.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa56e689640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa56814f2f0 0x7fa568148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:43.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa56e689640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa568143100 con 0x7fa56814f2f0 2023-10-03T19:19:43.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa56e689640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa568151230 con 0x7fa56806e640 2023-10-03T19:19:43.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa56e689640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa568150f50 con 0x7fa56814e790 2023-10-03T19:19:43.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa56cc26640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa56814f2f0 0x7fa568148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:43.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa56cc26640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa56814f2f0 0x7fa568148170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47774/0 (socket says 172.21.15.45:47774) 2023-10-03T19:19:43.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa56cc26640 1 -- 172.21.15.45:0/4067079086 learned_addr learned my addr 172.21.15.45:0/4067079086 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:43.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa567fff640 1 --2- 172.21.15.45:0/4067079086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa56806e640 0x7fa568150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:43.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa5677fe640 1 --2- 172.21.15.45:0/4067079086 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa56814e790 0x7fa568143820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:43.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa56cc26640 1 -- 172.21.15.45:0/4067079086 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa56814e790 msgr2=0x7fa568143820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:43.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa56cc26640 1 --2- 172.21.15.45:0/4067079086 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa56814e790 0x7fa568143820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:43.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa56cc26640 1 -- 172.21.15.45:0/4067079086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa56806e640 msgr2=0x7fa568150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:43.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa56cc26640 1 --2- 172.21.15.45:0/4067079086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa56806e640 0x7fa568150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:43.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa56cc26640 1 -- 172.21.15.45:0/4067079086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c0094d0 con 0x7fa56814f2f0 2023-10-03T19:19:43.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa56cc26640 1 --2- 172.21.15.45:0/4067079086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa56814f2f0 0x7fa568148170 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fa56000c7d0 tx=0x7fa56000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:43.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa564ff9640 1 -- 172.21.15.45:0/4067079086 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56000a640 con 0x7fa56814f2f0 2023-10-03T19:19:43.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa564ff9640 1 -- 172.21.15.45:0/4067079086 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56000a7a0 con 0x7fa56814f2f0 2023-10-03T19:19:43.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa56e689640 1 -- 172.21.15.45:0/4067079086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5680bcc40 con 0x7fa56814f2f0 2023-10-03T19:19:43.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.248+0000 7fa564ff9640 1 -- 172.21.15.45:0/4067079086 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56000ab10 con 0x7fa56814f2f0 2023-10-03T19:19:43.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.252+0000 7fa56e689640 1 -- 172.21.15.45:0/4067079086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5680bbe00 con 0x7fa56814f2f0 2023-10-03T19:19:43.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.252+0000 7fa56e689640 1 -- 172.21.15.45:0/4067079086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56814eb90 con 0x7fa56814f2f0 2023-10-03T19:19:43.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.252+0000 7fa564ff9640 1 -- 172.21.15.45:0/4067079086 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa56000ac70 con 0x7fa56814f2f0 2023-10-03T19:19:43.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.252+0000 7fa564ff9640 1 --2- 172.21.15.45:0/4067079086 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa5540662b0 0x7fa554068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:43.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.252+0000 7fa564ff9640 1 -- 172.21.15.45:0/4067079086 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa560083520 con 0x7fa56814f2f0 2023-10-03T19:19:43.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.252+0000 7fa567fff640 1 --2- 172.21.15.45:0/4067079086 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa5540662b0 0x7fa554068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:43.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.252+0000 7fa567fff640 1 --2- 172.21.15.45:0/4067079086 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa5540662b0 0x7fa554068760 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa558000f70 tx=0x7fa558009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:43.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.256+0000 7fa564ff9640 1 -- 172.21.15.45:0/4067079086 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa5600509c0 con 0x7fa56814f2f0 2023-10-03T19:19:43.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.408+0000 7fa56e689640 1 -- 172.21.15.45:0/4067079086 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa5681510c0 con 0x7fa5540662b0 2023-10-03T19:19:43.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.432+0000 7fa564ff9640 1 -- 172.21.15.45:0/4067079086 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308580 (secure 0 0 0) 0x7fa5681510c0 con 0x7fa5540662b0 2023-10-03T19:19:43.437 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:19:43.439 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:19:43.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.436+0000 7fa56e689640 1 -- 172.21.15.45:0/4067079086 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa5540662b0 msgr2=0x7fa554068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:43.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.436+0000 7fa56e689640 1 --2- 172.21.15.45:0/4067079086 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa5540662b0 0x7fa554068760 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa558000f70 tx=0x7fa558009040 comp rx=0 tx=0).stop 2023-10-03T19:19:43.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.436+0000 7fa56e689640 1 -- 172.21.15.45:0/4067079086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa56814f2f0 msgr2=0x7fa568148170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:43.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.436+0000 7fa56e689640 1 --2- 172.21.15.45:0/4067079086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa56814f2f0 0x7fa568148170 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fa56000c7d0 tx=0x7fa56000cc90 comp rx=0 tx=0).stop 2023-10-03T19:19:43.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.436+0000 7fa56e689640 1 -- 172.21.15.45:0/4067079086 shutdown_connections 2023-10-03T19:19:43.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.436+0000 7fa56e689640 1 --2- 172.21.15.45:0/4067079086 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa5540662b0 0x7fa554068760 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:43.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.436+0000 7fa56e689640 1 --2- 172.21.15.45:0/4067079086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa56814f2f0 0x7fa568148170 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:43.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.436+0000 7fa56e689640 1 --2- 172.21.15.45:0/4067079086 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa56814e790 0x7fa568143820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:43.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.436+0000 7fa56e689640 1 --2- 172.21.15.45:0/4067079086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa56806e640 0x7fa568150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:43.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.436+0000 7fa56e689640 1 -- 172.21.15.45:0/4067079086 >> 172.21.15.45:0/4067079086 conn(0x7fa5680a4400 msgr2=0x7fa568145940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:43.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.436+0000 7fa56e689640 1 -- 172.21.15.45:0/4067079086 shutdown_connections 2023-10-03T19:19:43.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.436+0000 7fa56e689640 1 -- 172.21.15.45:0/4067079086 wait complete. 2023-10-03T19:19:43.456 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2023-10-03T19:19:42.600621+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":157,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244048,"kb_used_data":9488,"kb_used_omap":0,"kb_used_meta":234496,"kb_avail":754730672,"statfs":{"total":773094113280,"available":772844208128,"internally_reserved":0,"allocated":9715712,"data_stored":5546299,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":240123904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":69,"apply_latency_ms":69,"commit_latency_ns":69000000,"apply_latency_ns":69000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.559949"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.065677+0000","last_change":"2023-10-03T19:19:39.065677+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.065677+0000","last_undegraded":"2023-10-03T19:19:39.065677+0000","last_fullsized":"2023-10-03T19:19:39.065677+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678798+0000","last_change":"2023-10-03T19:19:39.501818+0000","last_active":"2023-10-03T19:19:40.678798+0000","last_peered":"2023-10-03T19:19:40.678798+0000","last_clean":"2023-10-03T19:19:40.678798+0000","last_became_active":"2023-10-03T19:19:39.501351+0000","last_became_peered":"2023-10-03T19:19:39.501351+0000","last_unstale":"2023-10-03T19:19:40.678798+0000","last_undegraded":"2023-10-03T19:19:40.678798+0000","last_fullsized":"2023-10-03T19:19:40.678798+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:35:21.301808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.062721+0000","last_change":"2023-10-03T19:19:39.062721+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.062721+0000","last_undegraded":"2023-10-03T19:19:39.062721+0000","last_fullsized":"2023-10-03T19:19:39.062721+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430029+0000","last_change":"2023-10-03T19:19:39.473749+0000","last_active":"2023-10-03T19:19:40.430029+0000","last_peered":"2023-10-03T19:19:40.430029+0000","last_clean":"2023-10-03T19:19:40.430029+0000","last_became_active":"2023-10-03T19:19:39.473432+0000","last_became_peered":"2023-10-03T19:19:39.473432+0000","last_unstale":"2023-10-03T19:19:40.430029+0000","last_undegraded":"2023-10-03T19:19:40.430029+0000","last_fullsized":"2023-10-03T19:19:40.430029+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:58:52.700889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175119+0000","last_change":"2023-10-03T19:19:39.473502+0000","last_active":"2023-10-03T19:19:41.175119+0000","last_peered":"2023-10-03T19:19:41.175119+0000","last_clean":"2023-10-03T19:19:41.175119+0000","last_became_active":"2023-10-03T19:19:39.473176+0000","last_became_peered":"2023-10-03T19:19:39.473176+0000","last_unstale":"2023-10-03T19:19:41.175119+0000","last_undegraded":"2023-10-03T19:19:41.175119+0000","last_fullsized":"2023-10-03T19:19:41.175119+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:47:23.957363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.677858+0000","last_change":"2023-10-03T19:19:39.491373+0000","last_active":"2023-10-03T19:19:40.677858+0000","last_peered":"2023-10-03T19:19:40.677858+0000","last_clean":"2023-10-03T19:19:40.677858+0000","last_became_active":"2023-10-03T19:19:39.490818+0000","last_became_peered":"2023-10-03T19:19:39.490818+0000","last_unstale":"2023-10-03T19:19:40.677858+0000","last_undegraded":"2023-10-03T19:19:40.677858+0000","last_fullsized":"2023-10-03T19:19:40.677858+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:59:41.953904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.677748+0000","last_change":"2023-10-03T19:19:39.497977+0000","last_active":"2023-10-03T19:19:40.677748+0000","last_peered":"2023-10-03T19:19:40.677748+0000","last_clean":"2023-10-03T19:19:40.677748+0000","last_became_active":"2023-10-03T19:19:39.497211+0000","last_became_peered":"2023-10-03T19:19:39.497211+0000","last_unstale":"2023-10-03T19:19:40.677748+0000","last_undegraded":"2023-10-03T19:19:40.677748+0000","last_fullsized":"2023-10-03T19:19:40.677748+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:15:08.226909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.172923+0000","last_change":"2023-10-03T19:19:39.450807+0000","last_active":"2023-10-03T19:19:41.172923+0000","last_peered":"2023-10-03T19:19:41.172923+0000","last_clean":"2023-10-03T19:19:41.172923+0000","last_became_active":"2023-10-03T19:19:39.450534+0000","last_became_peered":"2023-10-03T19:19:39.450534+0000","last_unstale":"2023-10-03T19:19:41.172923+0000","last_undegraded":"2023-10-03T19:19:41.172923+0000","last_fullsized":"2023-10-03T19:19:41.172923+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:15:38.079291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678801+0000","last_change":"2023-10-03T19:19:39.492468+0000","last_active":"2023-10-03T19:19:40.678801+0000","last_peered":"2023-10-03T19:19:40.678801+0000","last_clean":"2023-10-03T19:19:40.678801+0000","last_became_active":"2023-10-03T19:19:39.491727+0000","last_became_peered":"2023-10-03T19:19:39.491727+0000","last_unstale":"2023-10-03T19:19:40.678801+0000","last_undegraded":"2023-10-03T19:19:40.678801+0000","last_fullsized":"2023-10-03T19:19:40.678801+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:42:13.454493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176602+0000","last_change":"2023-10-03T19:19:39.498659+0000","last_active":"2023-10-03T19:19:41.176602+0000","last_peered":"2023-10-03T19:19:41.176602+0000","last_clean":"2023-10-03T19:19:41.176602+0000","last_became_active":"2023-10-03T19:19:39.498315+0000","last_became_peered":"2023-10-03T19:19:39.498315+0000","last_unstale":"2023-10-03T19:19:41.176602+0000","last_undegraded":"2023-10-03T19:19:41.176602+0000","last_fullsized":"2023-10-03T19:19:41.176602+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:34:42.126930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.067805+0000","last_change":"2023-10-03T19:19:39.067805+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.067805+0000","last_undegraded":"2023-10-03T19:19:39.067805+0000","last_fullsized":"2023-10-03T19:19:39.067805+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.440908+0000","last_change":"2023-10-03T19:19:39.455413+0000","last_active":"2023-10-03T19:19:40.440908+0000","last_peered":"2023-10-03T19:19:40.440908+0000","last_clean":"2023-10-03T19:19:40.440908+0000","last_became_active":"2023-10-03T19:19:39.454714+0000","last_became_peered":"2023-10-03T19:19:39.454714+0000","last_unstale":"2023-10-03T19:19:40.440908+0000","last_undegraded":"2023-10-03T19:19:40.440908+0000","last_fullsized":"2023-10-03T19:19:40.440908+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:27:14.179448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.429895+0000","last_change":"2023-10-03T19:19:39.466360+0000","last_active":"2023-10-03T19:19:40.429895+0000","last_peered":"2023-10-03T19:19:40.429895+0000","last_clean":"2023-10-03T19:19:40.429895+0000","last_became_active":"2023-10-03T19:19:39.466034+0000","last_became_peered":"2023-10-03T19:19:39.466034+0000","last_unstale":"2023-10-03T19:19:40.429895+0000","last_undegraded":"2023-10-03T19:19:40.429895+0000","last_fullsized":"2023-10-03T19:19:40.429895+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:17:57.802389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174860+0000","last_change":"2023-10-03T19:19:39.478735+0000","last_active":"2023-10-03T19:19:41.174860+0000","last_peered":"2023-10-03T19:19:41.174860+0000","last_clean":"2023-10-03T19:19:41.174860+0000","last_became_active":"2023-10-03T19:19:39.477842+0000","last_became_peered":"2023-10-03T19:19:39.477842+0000","last_unstale":"2023-10-03T19:19:41.174860+0000","last_undegraded":"2023-10-03T19:19:41.174860+0000","last_fullsized":"2023-10-03T19:19:41.174860+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:01:44.142532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174807+0000","last_change":"2023-10-03T19:19:39.493604+0000","last_active":"2023-10-03T19:19:41.174807+0000","last_peered":"2023-10-03T19:19:41.174807+0000","last_clean":"2023-10-03T19:19:41.174807+0000","last_became_active":"2023-10-03T19:19:39.488408+0000","last_became_peered":"2023-10-03T19:19:39.488408+0000","last_unstale":"2023-10-03T19:19:41.174807+0000","last_undegraded":"2023-10-03T19:19:41.174807+0000","last_fullsized":"2023-10-03T19:19:41.174807+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:54:40.452636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174925+0000","last_change":"2023-10-03T19:19:39.481769+0000","last_active":"2023-10-03T19:19:41.174925+0000","last_peered":"2023-10-03T19:19:41.174925+0000","last_clean":"2023-10-03T19:19:41.174925+0000","last_became_active":"2023-10-03T19:19:39.478997+0000","last_became_peered":"2023-10-03T19:19:39.478997+0000","last_unstale":"2023-10-03T19:19:41.174925+0000","last_undegraded":"2023-10-03T19:19:41.174925+0000","last_fullsized":"2023-10-03T19:19:41.174925+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:53:12.478710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.060759+0000","last_change":"2023-10-03T19:19:39.060759+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.060759+0000","last_undegraded":"2023-10-03T19:19:39.060759+0000","last_fullsized":"2023-10-03T19:19:39.060759+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.679023+0000","last_change":"2023-10-03T19:19:39.502839+0000","last_active":"2023-10-03T19:19:40.679023+0000","last_peered":"2023-10-03T19:19:40.679023+0000","last_clean":"2023-10-03T19:19:40.679023+0000","last_became_active":"2023-10-03T19:19:39.502343+0000","last_became_peered":"2023-10-03T19:19:39.502343+0000","last_unstale":"2023-10-03T19:19:40.679023+0000","last_undegraded":"2023-10-03T19:19:40.679023+0000","last_fullsized":"2023-10-03T19:19:40.679023+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:19:38.314320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.062240+0000","last_change":"2023-10-03T19:19:39.062240+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.062240+0000","last_undegraded":"2023-10-03T19:19:39.062240+0000","last_fullsized":"2023-10-03T19:19:39.062240+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.440839+0000","last_change":"2023-10-03T19:19:39.481255+0000","last_active":"2023-10-03T19:19:40.440839+0000","last_peered":"2023-10-03T19:19:40.440839+0000","last_clean":"2023-10-03T19:19:40.440839+0000","last_became_active":"2023-10-03T19:19:39.480541+0000","last_became_peered":"2023-10-03T19:19:39.480541+0000","last_unstale":"2023-10-03T19:19:40.440839+0000","last_undegraded":"2023-10-03T19:19:40.440839+0000","last_fullsized":"2023-10-03T19:19:40.440839+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:21:53.299603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173654+0000","last_change":"2023-10-03T19:19:39.467184+0000","last_active":"2023-10-03T19:19:41.173654+0000","last_peered":"2023-10-03T19:19:41.173654+0000","last_clean":"2023-10-03T19:19:41.173654+0000","last_became_active":"2023-10-03T19:19:39.466886+0000","last_became_peered":"2023-10-03T19:19:39.466886+0000","last_unstale":"2023-10-03T19:19:41.173654+0000","last_undegraded":"2023-10-03T19:19:41.173654+0000","last_fullsized":"2023-10-03T19:19:41.173654+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:22:29.033454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175260+0000","last_change":"2023-10-03T19:19:39.464591+0000","last_active":"2023-10-03T19:19:41.175260+0000","last_peered":"2023-10-03T19:19:41.175260+0000","last_clean":"2023-10-03T19:19:41.175260+0000","last_became_active":"2023-10-03T19:19:39.464263+0000","last_became_peered":"2023-10-03T19:19:39.464263+0000","last_unstale":"2023-10-03T19:19:41.175260+0000","last_undegraded":"2023-10-03T19:19:41.175260+0000","last_fullsized":"2023-10-03T19:19:41.175260+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:09:27.964791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.065582+0000","last_change":"2023-10-03T19:19:39.065582+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.065582+0000","last_undegraded":"2023-10-03T19:19:39.065582+0000","last_fullsized":"2023-10-03T19:19:39.065582+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174942+0000","last_change":"2023-10-03T19:19:39.439866+0000","last_active":"2023-10-03T19:19:41.174942+0000","last_peered":"2023-10-03T19:19:41.174942+0000","last_clean":"2023-10-03T19:19:41.174942+0000","last_became_active":"2023-10-03T19:19:39.439632+0000","last_became_peered":"2023-10-03T19:19:39.439632+0000","last_unstale":"2023-10-03T19:19:41.174942+0000","last_undegraded":"2023-10-03T19:19:41.174942+0000","last_fullsized":"2023-10-03T19:19:41.174942+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:15:44.398741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.441232+0000","last_change":"2023-10-03T19:19:39.470183+0000","last_active":"2023-10-03T19:19:40.441232+0000","last_peered":"2023-10-03T19:19:40.441232+0000","last_clean":"2023-10-03T19:19:40.441232+0000","last_became_active":"2023-10-03T19:19:39.469452+0000","last_became_peered":"2023-10-03T19:19:39.469452+0000","last_unstale":"2023-10-03T19:19:40.441232+0000","last_undegraded":"2023-10-03T19:19:40.441232+0000","last_fullsized":"2023-10-03T19:19:40.441232+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:01:20.873119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.441025+0000","last_change":"2023-10-03T19:19:39.503465+0000","last_active":"2023-10-03T19:19:40.441025+0000","last_peered":"2023-10-03T19:19:40.441025+0000","last_clean":"2023-10-03T19:19:40.441025+0000","last_became_active":"2023-10-03T19:19:39.503030+0000","last_became_peered":"2023-10-03T19:19:39.503030+0000","last_unstale":"2023-10-03T19:19:40.441025+0000","last_undegraded":"2023-10-03T19:19:40.441025+0000","last_fullsized":"2023-10-03T19:19:40.441025+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:43:46.831754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.066584+0000","last_change":"2023-10-03T19:19:39.066584+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.066584+0000","last_undegraded":"2023-10-03T19:19:39.066584+0000","last_fullsized":"2023-10-03T19:19:39.066584+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678338+0000","last_change":"2023-10-03T19:19:39.498786+0000","last_active":"2023-10-03T19:19:40.678338+0000","last_peered":"2023-10-03T19:19:40.678338+0000","last_clean":"2023-10-03T19:19:40.678338+0000","last_became_active":"2023-10-03T19:19:39.498287+0000","last_became_peered":"2023-10-03T19:19:39.498287+0000","last_unstale":"2023-10-03T19:19:40.678338+0000","last_undegraded":"2023-10-03T19:19:40.678338+0000","last_fullsized":"2023-10-03T19:19:40.678338+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:01:20.873119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173840+0000","last_change":"2023-10-03T19:19:39.474176+0000","last_active":"2023-10-03T19:19:41.173840+0000","last_peered":"2023-10-03T19:19:41.173840+0000","last_clean":"2023-10-03T19:19:41.173840+0000","last_became_active":"2023-10-03T19:19:39.473801+0000","last_became_peered":"2023-10-03T19:19:39.473801+0000","last_unstale":"2023-10-03T19:19:41.173840+0000","last_undegraded":"2023-10-03T19:19:41.173840+0000","last_fullsized":"2023-10-03T19:19:41.173840+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:16:06.684976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.440240+0000","last_change":"2023-10-03T19:19:39.453506+0000","last_active":"2023-10-03T19:19:40.440240+0000","last_peered":"2023-10-03T19:19:40.440240+0000","last_clean":"2023-10-03T19:19:40.440240+0000","last_became_active":"2023-10-03T19:19:39.452767+0000","last_became_peered":"2023-10-03T19:19:39.452767+0000","last_unstale":"2023-10-03T19:19:40.440240+0000","last_undegraded":"2023-10-03T19:19:40.440240+0000","last_fullsized":"2023-10-03T19:19:40.440240+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:58:52.700889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.677767+0000","last_change":"2023-10-03T19:19:39.501965+0000","last_active":"2023-10-03T19:19:40.677767+0000","last_peered":"2023-10-03T19:19:40.677767+0000","last_clean":"2023-10-03T19:19:40.677767+0000","last_became_active":"2023-10-03T19:19:39.501258+0000","last_became_peered":"2023-10-03T19:19:39.501258+0000","last_unstale":"2023-10-03T19:19:40.677767+0000","last_undegraded":"2023-10-03T19:19:40.677767+0000","last_fullsized":"2023-10-03T19:19:40.677767+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:36:34.926440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.172931+0000","last_change":"2023-10-03T19:19:39.476006+0000","last_active":"2023-10-03T19:19:41.172931+0000","last_peered":"2023-10-03T19:19:41.172931+0000","last_clean":"2023-10-03T19:19:41.172931+0000","last_became_active":"2023-10-03T19:19:39.475740+0000","last_became_peered":"2023-10-03T19:19:39.475740+0000","last_unstale":"2023-10-03T19:19:41.172931+0000","last_undegraded":"2023-10-03T19:19:41.172931+0000","last_fullsized":"2023-10-03T19:19:41.172931+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:38:59.311703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.057503+0000","last_change":"2023-10-03T19:19:39.057503+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.057503+0000","last_undegraded":"2023-10-03T19:19:39.057503+0000","last_fullsized":"2023-10-03T19:19:39.057503+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"97'4","reported_seq":17,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430274+0000","last_change":"2023-10-03T19:19:39.100745+0000","last_active":"2023-10-03T19:19:40.430274+0000","last_peered":"2023-10-03T19:19:40.430274+0000","last_clean":"2023-10-03T19:19:40.430274+0000","last_became_active":"2023-10-03T19:19:39.100413+0000","last_became_peered":"2023-10-03T19:19:39.100413+0000","last_unstale":"2023-10-03T19:19:40.430274+0000","last_undegraded":"2023-10-03T19:19:40.430274+0000","last_fullsized":"2023-10-03T19:19:40.430274+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:21:52.286906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173119+0000","last_change":"2023-10-03T19:19:39.450049+0000","last_active":"2023-10-03T19:19:41.173119+0000","last_peered":"2023-10-03T19:19:41.173119+0000","last_clean":"2023-10-03T19:19:41.173119+0000","last_became_active":"2023-10-03T19:19:39.449771+0000","last_became_peered":"2023-10-03T19:19:39.449771+0000","last_unstale":"2023-10-03T19:19:41.173119+0000","last_undegraded":"2023-10-03T19:19:41.173119+0000","last_fullsized":"2023-10-03T19:19:41.173119+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:14:44.212951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174434+0000","last_change":"2023-10-03T19:19:39.081942+0000","last_active":"2023-10-03T19:19:41.174434+0000","last_peered":"2023-10-03T19:19:41.174434+0000","last_clean":"2023-10-03T19:19:41.174434+0000","last_became_active":"2023-10-03T19:19:39.081434+0000","last_became_peered":"2023-10-03T19:19:39.081434+0000","last_unstale":"2023-10-03T19:19:41.174434+0000","last_undegraded":"2023-10-03T19:19:41.174434+0000","last_fullsized":"2023-10-03T19:19:41.174434+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:44:38.934350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.440288+0000","last_change":"2023-10-03T19:19:39.456943+0000","last_active":"2023-10-03T19:19:40.440288+0000","last_peered":"2023-10-03T19:19:40.440288+0000","last_clean":"2023-10-03T19:19:40.440288+0000","last_became_active":"2023-10-03T19:19:39.456206+0000","last_became_peered":"2023-10-03T19:19:39.456206+0000","last_unstale":"2023-10-03T19:19:40.440288+0000","last_undegraded":"2023-10-03T19:19:40.440288+0000","last_fullsized":"2023-10-03T19:19:40.440288+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:15:08.226909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.440781+0000","last_change":"2023-10-03T19:19:39.098618+0000","last_active":"2023-10-03T19:19:40.440781+0000","last_peered":"2023-10-03T19:19:40.440781+0000","last_clean":"2023-10-03T19:19:40.440781+0000","last_became_active":"2023-10-03T19:19:39.097892+0000","last_became_peered":"2023-10-03T19:19:39.097892+0000","last_unstale":"2023-10-03T19:19:40.440781+0000","last_undegraded":"2023-10-03T19:19:40.440781+0000","last_fullsized":"2023-10-03T19:19:40.440781+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:59:40.941206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.063100+0000","last_change":"2023-10-03T19:19:39.063100+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.063100+0000","last_undegraded":"2023-10-03T19:19:39.063100+0000","last_fullsized":"2023-10-03T19:19:39.063100+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176094+0000","last_change":"2023-10-03T19:19:39.084901+0000","last_active":"2023-10-03T19:19:41.176094+0000","last_peered":"2023-10-03T19:19:41.176094+0000","last_clean":"2023-10-03T19:19:41.176094+0000","last_became_active":"2023-10-03T19:19:39.084399+0000","last_became_peered":"2023-10-03T19:19:39.084399+0000","last_unstale":"2023-10-03T19:19:41.176094+0000","last_undegraded":"2023-10-03T19:19:41.176094+0000","last_fullsized":"2023-10-03T19:19:41.176094+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:37:52.382988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430110+0000","last_change":"2023-10-03T19:19:39.440443+0000","last_active":"2023-10-03T19:19:40.430110+0000","last_peered":"2023-10-03T19:19:40.430110+0000","last_clean":"2023-10-03T19:19:40.430110+0000","last_became_active":"2023-10-03T19:19:39.439566+0000","last_became_peered":"2023-10-03T19:19:39.439566+0000","last_unstale":"2023-10-03T19:19:40.430110+0000","last_undegraded":"2023-10-03T19:19:40.430110+0000","last_fullsized":"2023-10-03T19:19:40.430110+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:36:34.926440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175160+0000","last_change":"2023-10-03T19:19:39.105651+0000","last_active":"2023-10-03T19:19:41.175160+0000","last_peered":"2023-10-03T19:19:41.175160+0000","last_clean":"2023-10-03T19:19:41.175160+0000","last_became_active":"2023-10-03T19:19:39.105103+0000","last_became_peered":"2023-10-03T19:19:39.105103+0000","last_unstale":"2023-10-03T19:19:41.175160+0000","last_undegraded":"2023-10-03T19:19:41.175160+0000","last_fullsized":"2023-10-03T19:19:41.175160+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:01:43.169147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.057672+0000","last_change":"2023-10-03T19:19:39.057672+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.057672+0000","last_undegraded":"2023-10-03T19:19:39.057672+0000","last_fullsized":"2023-10-03T19:19:39.057672+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-03T19:19:39.107764+0000","last_change":"2023-10-03T19:19:39.097877+0000","last_active":"2023-10-03T19:19:39.107764+0000","last_peered":"2023-10-03T19:19:39.107764+0000","last_clean":"2023-10-03T19:19:39.107764+0000","last_became_active":"2023-10-03T19:19:39.097351+0000","last_became_peered":"2023-10-03T19:19:39.097351+0000","last_unstale":"2023-10-03T19:19:39.107764+0000","last_undegraded":"2023-10-03T19:19:39.107764+0000","last_fullsized":"2023-10-03T19:19:39.107764+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:28:16.875405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678996+0000","last_change":"2023-10-03T19:19:39.501897+0000","last_active":"2023-10-03T19:19:40.678996+0000","last_peered":"2023-10-03T19:19:40.678996+0000","last_clean":"2023-10-03T19:19:40.678996+0000","last_became_active":"2023-10-03T19:19:39.501378+0000","last_became_peered":"2023-10-03T19:19:39.501378+0000","last_unstale":"2023-10-03T19:19:40.678996+0000","last_undegraded":"2023-10-03T19:19:40.678996+0000","last_fullsized":"2023-10-03T19:19:40.678996+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:03:04.699024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.439627+0000","last_change":"2023-10-03T19:19:39.098321+0000","last_active":"2023-10-03T19:19:40.439627+0000","last_peered":"2023-10-03T19:19:40.439627+0000","last_clean":"2023-10-03T19:19:40.439627+0000","last_became_active":"2023-10-03T19:19:39.097705+0000","last_became_peered":"2023-10-03T19:19:39.097705+0000","last_unstale":"2023-10-03T19:19:40.439627+0000","last_undegraded":"2023-10-03T19:19:40.439627+0000","last_fullsized":"2023-10-03T19:19:40.439627+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:24:26.530146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430181+0000","last_change":"2023-10-03T19:19:39.443896+0000","last_active":"2023-10-03T19:19:40.430181+0000","last_peered":"2023-10-03T19:19:40.430181+0000","last_clean":"2023-10-03T19:19:40.430181+0000","last_became_active":"2023-10-03T19:19:39.443185+0000","last_became_peered":"2023-10-03T19:19:39.443185+0000","last_unstale":"2023-10-03T19:19:40.430181+0000","last_undegraded":"2023-10-03T19:19:40.430181+0000","last_fullsized":"2023-10-03T19:19:40.430181+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:59:41.953904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430269+0000","last_change":"2023-10-03T19:19:39.076525+0000","last_active":"2023-10-03T19:19:40.430269+0000","last_peered":"2023-10-03T19:19:40.430269+0000","last_clean":"2023-10-03T19:19:40.430269+0000","last_became_active":"2023-10-03T19:19:39.076125+0000","last_became_peered":"2023-10-03T19:19:39.076125+0000","last_unstale":"2023-10-03T19:19:40.430269+0000","last_undegraded":"2023-10-03T19:19:40.430269+0000","last_fullsized":"2023-10-03T19:19:40.430269+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:27:13.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.064978+0000","last_change":"2023-10-03T19:19:39.064978+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.064978+0000","last_undegraded":"2023-10-03T19:19:39.064978+0000","last_fullsized":"2023-10-03T19:19:39.064978+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.441233+0000","last_change":"2023-10-03T19:19:39.100517+0000","last_active":"2023-10-03T19:19:40.441233+0000","last_peered":"2023-10-03T19:19:40.441233+0000","last_clean":"2023-10-03T19:19:40.441233+0000","last_became_active":"2023-10-03T19:19:39.100003+0000","last_became_peered":"2023-10-03T19:19:39.100003+0000","last_unstale":"2023-10-03T19:19:40.441233+0000","last_undegraded":"2023-10-03T19:19:40.441233+0000","last_fullsized":"2023-10-03T19:19:40.441233+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:02:39.250284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175315+0000","last_change":"2023-10-03T19:19:39.445323+0000","last_active":"2023-10-03T19:19:41.175315+0000","last_peered":"2023-10-03T19:19:41.175315+0000","last_clean":"2023-10-03T19:19:41.175315+0000","last_became_active":"2023-10-03T19:19:39.445022+0000","last_became_peered":"2023-10-03T19:19:39.445022+0000","last_unstale":"2023-10-03T19:19:41.175315+0000","last_undegraded":"2023-10-03T19:19:41.175315+0000","last_fullsized":"2023-10-03T19:19:41.175315+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:14:23.979238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-03T19:19:39.077168+0000","last_change":"2023-10-03T19:19:39.075931+0000","last_active":"2023-10-03T19:19:39.077168+0000","last_peered":"2023-10-03T19:19:39.077168+0000","last_clean":"2023-10-03T19:19:39.077168+0000","last_became_active":"2023-10-03T19:19:39.075609+0000","last_became_peered":"2023-10-03T19:19:39.075609+0000","last_unstale":"2023-10-03T19:19:39.077168+0000","last_undegraded":"2023-10-03T19:19:39.077168+0000","last_fullsized":"2023-10-03T19:19:39.077168+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:28:50.042403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173596+0000","last_change":"2023-10-03T19:19:39.450085+0000","last_active":"2023-10-03T19:19:41.173596+0000","last_peered":"2023-10-03T19:19:41.173596+0000","last_clean":"2023-10-03T19:19:41.173596+0000","last_became_active":"2023-10-03T19:19:39.449720+0000","last_became_peered":"2023-10-03T19:19:39.449720+0000","last_unstale":"2023-10-03T19:19:41.173596+0000","last_undegraded":"2023-10-03T19:19:41.173596+0000","last_fullsized":"2023-10-03T19:19:41.173596+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:07:03.874445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"97'3","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175361+0000","last_change":"2023-10-03T19:19:39.083465+0000","last_active":"2023-10-03T19:19:41.175361+0000","last_peered":"2023-10-03T19:19:41.175361+0000","last_clean":"2023-10-03T19:19:41.175361+0000","last_became_active":"2023-10-03T19:19:39.082723+0000","last_became_peered":"2023-10-03T19:19:39.082723+0000","last_unstale":"2023-10-03T19:19:41.175361+0000","last_undegraded":"2023-10-03T19:19:41.175361+0000","last_fullsized":"2023-10-03T19:19:41.175361+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:45:27.547248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175742+0000","last_change":"2023-10-03T19:19:39.446159+0000","last_active":"2023-10-03T19:19:41.175742+0000","last_peered":"2023-10-03T19:19:41.175742+0000","last_clean":"2023-10-03T19:19:41.175742+0000","last_became_active":"2023-10-03T19:19:39.445909+0000","last_became_peered":"2023-10-03T19:19:39.445909+0000","last_unstale":"2023-10-03T19:19:41.175742+0000","last_undegraded":"2023-10-03T19:19:41.175742+0000","last_fullsized":"2023-10-03T19:19:41.175742+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:27:32.906536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"97'6","reported_seq":19,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678541+0000","last_change":"2023-10-03T19:19:39.092215+0000","last_active":"2023-10-03T19:19:40.678541+0000","last_peered":"2023-10-03T19:19:40.678541+0000","last_clean":"2023-10-03T19:19:40.678541+0000","last_became_active":"2023-10-03T19:19:39.085602+0000","last_became_peered":"2023-10-03T19:19:39.085602+0000","last_unstale":"2023-10-03T19:19:40.678541+0000","last_undegraded":"2023-10-03T19:19:40.678541+0000","last_fullsized":"2023-10-03T19:19:40.678541+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:02:39.250284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.064062+0000","last_change":"2023-10-03T19:19:39.064062+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.064062+0000","last_undegraded":"2023-10-03T19:19:39.064062+0000","last_fullsized":"2023-10-03T19:19:39.064062+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176071+0000","last_change":"2023-10-03T19:19:39.081438+0000","last_active":"2023-10-03T19:19:41.176071+0000","last_peered":"2023-10-03T19:19:41.176071+0000","last_clean":"2023-10-03T19:19:41.176071+0000","last_became_active":"2023-10-03T19:19:39.081161+0000","last_became_peered":"2023-10-03T19:19:39.081161+0000","last_unstale":"2023-10-03T19:19:41.176071+0000","last_undegraded":"2023-10-03T19:19:41.176071+0000","last_fullsized":"2023-10-03T19:19:41.176071+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:33:20.709972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678584+0000","last_change":"2023-10-03T19:19:39.492226+0000","last_active":"2023-10-03T19:19:40.678584+0000","last_peered":"2023-10-03T19:19:40.678584+0000","last_clean":"2023-10-03T19:19:40.678584+0000","last_became_active":"2023-10-03T19:19:39.491322+0000","last_became_peered":"2023-10-03T19:19:39.491322+0000","last_unstale":"2023-10-03T19:19:40.678584+0000","last_undegraded":"2023-10-03T19:19:40.678584+0000","last_fullsized":"2023-10-03T19:19:40.678584+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:17:18.221489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430104+0000","last_change":"2023-10-03T19:19:39.077931+0000","last_active":"2023-10-03T19:19:40.430104+0000","last_peered":"2023-10-03T19:19:40.430104+0000","last_clean":"2023-10-03T19:19:40.430104+0000","last_became_active":"2023-10-03T19:19:39.077342+0000","last_became_peered":"2023-10-03T19:19:39.077342+0000","last_unstale":"2023-10-03T19:19:40.430104+0000","last_undegraded":"2023-10-03T19:19:40.430104+0000","last_fullsized":"2023-10-03T19:19:40.430104+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:15:07.214211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174038+0000","last_change":"2023-10-03T19:19:39.476040+0000","last_active":"2023-10-03T19:19:41.174038+0000","last_peered":"2023-10-03T19:19:41.174038+0000","last_clean":"2023-10-03T19:19:41.174038+0000","last_became_active":"2023-10-03T19:19:39.475802+0000","last_became_peered":"2023-10-03T19:19:39.475802+0000","last_unstale":"2023-10-03T19:19:41.174038+0000","last_undegraded":"2023-10-03T19:19:41.174038+0000","last_fullsized":"2023-10-03T19:19:41.174038+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:49:54.029650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173284+0000","last_change":"2023-10-03T19:19:39.084666+0000","last_active":"2023-10-03T19:19:41.173284+0000","last_peered":"2023-10-03T19:19:41.173284+0000","last_clean":"2023-10-03T19:19:41.173284+0000","last_became_active":"2023-10-03T19:19:39.084383+0000","last_became_peered":"2023-10-03T19:19:39.084383+0000","last_unstale":"2023-10-03T19:19:41.173284+0000","last_undegraded":"2023-10-03T19:19:41.173284+0000","last_fullsized":"2023-10-03T19:19:41.173284+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:56:48.966597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.060292+0000","last_change":"2023-10-03T19:19:39.060292+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.060292+0000","last_undegraded":"2023-10-03T19:19:39.060292+0000","last_fullsized":"2023-10-03T19:19:39.060292+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"97'8","reported_seq":21,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.439804+0000","last_change":"2023-10-03T19:19:39.099722+0000","last_active":"2023-10-03T19:19:40.439804+0000","last_peered":"2023-10-03T19:19:40.439804+0000","last_clean":"2023-10-03T19:19:40.439804+0000","last_became_active":"2023-10-03T19:19:39.099110+0000","last_became_peered":"2023-10-03T19:19:39.099110+0000","last_unstale":"2023-10-03T19:19:40.439804+0000","last_undegraded":"2023-10-03T19:19:40.439804+0000","last_fullsized":"2023-10-03T19:19:40.439804+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:24:20.639774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.065787+0000","last_change":"2023-10-03T19:19:39.065787+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.065787+0000","last_undegraded":"2023-10-03T19:19:39.065787+0000","last_fullsized":"2023-10-03T19:19:39.065787+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176623+0000","last_change":"2023-10-03T19:19:39.078321+0000","last_active":"2023-10-03T19:19:41.176623+0000","last_peered":"2023-10-03T19:19:41.176623+0000","last_clean":"2023-10-03T19:19:41.176623+0000","last_became_active":"2023-10-03T19:19:39.078000+0000","last_became_peered":"2023-10-03T19:19:39.078000+0000","last_unstale":"2023-10-03T19:19:41.176623+0000","last_undegraded":"2023-10-03T19:19:41.176623+0000","last_fullsized":"2023-10-03T19:19:41.176623+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:42:42.684913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.439742+0000","last_change":"2023-10-03T19:19:39.453941+0000","last_active":"2023-10-03T19:19:40.439742+0000","last_peered":"2023-10-03T19:19:40.439742+0000","last_clean":"2023-10-03T19:19:40.439742+0000","last_became_active":"2023-10-03T19:19:39.453189+0000","last_became_peered":"2023-10-03T19:19:39.453189+0000","last_unstale":"2023-10-03T19:19:40.439742+0000","last_undegraded":"2023-10-03T19:19:40.439742+0000","last_fullsized":"2023-10-03T19:19:40.439742+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:17:57.802389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-03T19:19:39.096207+0000","last_change":"2023-10-03T19:19:39.095166+0000","last_active":"2023-10-03T19:19:39.096207+0000","last_peered":"2023-10-03T19:19:39.096207+0000","last_clean":"2023-10-03T19:19:39.096207+0000","last_became_active":"2023-10-03T19:19:39.094914+0000","last_became_peered":"2023-10-03T19:19:39.094914+0000","last_unstale":"2023-10-03T19:19:39.096207+0000","last_undegraded":"2023-10-03T19:19:39.096207+0000","last_fullsized":"2023-10-03T19:19:39.096207+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:07:54.333264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430357+0000","last_change":"2023-10-03T19:19:39.498605+0000","last_active":"2023-10-03T19:19:40.430357+0000","last_peered":"2023-10-03T19:19:40.430357+0000","last_clean":"2023-10-03T19:19:40.430357+0000","last_became_active":"2023-10-03T19:19:39.498286+0000","last_became_peered":"2023-10-03T19:19:39.498286+0000","last_unstale":"2023-10-03T19:19:40.430357+0000","last_undegraded":"2023-10-03T19:19:40.430357+0000","last_fullsized":"2023-10-03T19:19:40.430357+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:43:46.831754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678665+0000","last_change":"2023-10-03T19:19:39.093647+0000","last_active":"2023-10-03T19:19:40.678665+0000","last_peered":"2023-10-03T19:19:40.678665+0000","last_clean":"2023-10-03T19:19:40.678665+0000","last_became_active":"2023-10-03T19:19:39.093121+0000","last_became_peered":"2023-10-03T19:19:39.093121+0000","last_unstale":"2023-10-03T19:19:40.678665+0000","last_undegraded":"2023-10-03T19:19:40.678665+0000","last_fullsized":"2023-10-03T19:19:40.678665+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:09:28.979796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.064384+0000","last_change":"2023-10-03T19:19:39.064384+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.064384+0000","last_undegraded":"2023-10-03T19:19:39.064384+0000","last_fullsized":"2023-10-03T19:19:39.064384+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176007+0000","last_change":"2023-10-03T19:19:39.100292+0000","last_active":"2023-10-03T19:19:41.176007+0000","last_peered":"2023-10-03T19:19:41.176007+0000","last_clean":"2023-10-03T19:19:41.176007+0000","last_became_active":"2023-10-03T19:19:39.100004+0000","last_became_peered":"2023-10-03T19:19:39.100004+0000","last_unstale":"2023-10-03T19:19:41.176007+0000","last_undegraded":"2023-10-03T19:19:41.176007+0000","last_fullsized":"2023-10-03T19:19:41.176007+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:32:48.746616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174005+0000","last_change":"2023-10-03T19:19:39.450670+0000","last_active":"2023-10-03T19:19:41.174005+0000","last_peered":"2023-10-03T19:19:41.174005+0000","last_clean":"2023-10-03T19:19:41.174005+0000","last_became_active":"2023-10-03T19:19:39.450363+0000","last_became_peered":"2023-10-03T19:19:39.450363+0000","last_unstale":"2023-10-03T19:19:41.174005+0000","last_undegraded":"2023-10-03T19:19:41.174005+0000","last_fullsized":"2023-10-03T19:19:41.174005+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:38:52.937448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.440652+0000","last_change":"2023-10-03T19:19:39.093626+0000","last_active":"2023-10-03T19:19:40.440652+0000","last_peered":"2023-10-03T19:19:40.440652+0000","last_clean":"2023-10-03T19:19:40.440652+0000","last_became_active":"2023-10-03T19:19:39.093048+0000","last_became_peered":"2023-10-03T19:19:39.093048+0000","last_unstale":"2023-10-03T19:19:40.440652+0000","last_undegraded":"2023-10-03T19:19:40.440652+0000","last_fullsized":"2023-10-03T19:19:40.440652+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:36:33.913742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174002+0000","last_change":"2023-10-03T19:19:39.451443+0000","last_active":"2023-10-03T19:19:41.174002+0000","last_peered":"2023-10-03T19:19:41.174002+0000","last_clean":"2023-10-03T19:19:41.174002+0000","last_became_active":"2023-10-03T19:19:39.451178+0000","last_became_peered":"2023-10-03T19:19:39.451178+0000","last_unstale":"2023-10-03T19:19:41.174002+0000","last_undegraded":"2023-10-03T19:19:41.174002+0000","last_fullsized":"2023-10-03T19:19:41.174002+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:23:35.520091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173972+0000","last_change":"2023-10-03T19:19:39.085006+0000","last_active":"2023-10-03T19:19:41.173972+0000","last_peered":"2023-10-03T19:19:41.173972+0000","last_clean":"2023-10-03T19:19:41.173972+0000","last_became_active":"2023-10-03T19:19:39.084520+0000","last_became_peered":"2023-10-03T19:19:39.084520+0000","last_unstale":"2023-10-03T19:19:41.173972+0000","last_undegraded":"2023-10-03T19:19:41.173972+0000","last_fullsized":"2023-10-03T19:19:41.173972+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:32:44.644764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175389+0000","last_change":"2023-10-03T19:19:39.490667+0000","last_active":"2023-10-03T19:19:41.175389+0000","last_peered":"2023-10-03T19:19:41.175389+0000","last_clean":"2023-10-03T19:19:41.175389+0000","last_became_active":"2023-10-03T19:19:39.489883+0000","last_became_peered":"2023-10-03T19:19:39.489883+0000","last_unstale":"2023-10-03T19:19:41.175389+0000","last_undegraded":"2023-10-03T19:19:41.175389+0000","last_fullsized":"2023-10-03T19:19:41.175389+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:47:44.558983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678162+0000","last_change":"2023-10-03T19:19:39.093636+0000","last_active":"2023-10-03T19:19:40.678162+0000","last_peered":"2023-10-03T19:19:40.678162+0000","last_clean":"2023-10-03T19:19:40.678162+0000","last_became_active":"2023-10-03T19:19:39.093026+0000","last_became_peered":"2023-10-03T19:19:39.093026+0000","last_unstale":"2023-10-03T19:19:40.678162+0000","last_undegraded":"2023-10-03T19:19:40.678162+0000","last_fullsized":"2023-10-03T19:19:40.678162+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:43:45.819056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.067174+0000","last_change":"2023-10-03T19:19:39.067174+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.067174+0000","last_undegraded":"2023-10-03T19:19:39.067174+0000","last_fullsized":"2023-10-03T19:19:39.067174+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173694+0000","last_change":"2023-10-03T19:19:39.087025+0000","last_active":"2023-10-03T19:19:41.173694+0000","last_peered":"2023-10-03T19:19:41.173694+0000","last_clean":"2023-10-03T19:19:41.173694+0000","last_became_active":"2023-10-03T19:19:39.086598+0000","last_became_peered":"2023-10-03T19:19:39.086598+0000","last_unstale":"2023-10-03T19:19:41.173694+0000","last_undegraded":"2023-10-03T19:19:41.173694+0000","last_fullsized":"2023-10-03T19:19:41.173694+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:39:18.515681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.064555+0000","last_change":"2023-10-03T19:19:39.064555+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.064555+0000","last_undegraded":"2023-10-03T19:19:39.064555+0000","last_fullsized":"2023-10-03T19:19:39.064555+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174434+0000","last_change":"2023-10-03T19:19:39.077632+0000","last_active":"2023-10-03T19:19:41.174434+0000","last_peered":"2023-10-03T19:19:41.174434+0000","last_clean":"2023-10-03T19:19:41.174434+0000","last_became_active":"2023-10-03T19:19:39.077243+0000","last_became_peered":"2023-10-03T19:19:39.077243+0000","last_unstale":"2023-10-03T19:19:41.174434+0000","last_undegraded":"2023-10-03T19:19:41.174434+0000","last_fullsized":"2023-10-03T19:19:41.174434+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:11:33.305806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":316,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175066+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:19:41.175066+0000","last_peered":"2023-10-03T19:19:41.175066+0000","last_clean":"2023-10-03T19:19:41.175066+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:19:41.175066+0000","last_undegraded":"2023-10-03T19:19:41.175066+0000","last_fullsized":"2023-10-03T19:19:41.175066+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:01:58.556394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":156,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-03T19:19:39.078949+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:19:39.078949+0000","last_peered":"2023-10-03T19:19:39.078949+0000","last_clean":"2023-10-03T19:19:39.078949+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:19:39.078949+0000","last_undegraded":"2023-10-03T19:19:39.078949+0000","last_fullsized":"2023-10-03T19:19:39.078949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:51:45.180638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.677990+0000","last_change":"2023-10-03T19:19:39.490296+0000","last_active":"2023-10-03T19:19:40.677990+0000","last_peered":"2023-10-03T19:19:40.677990+0000","last_clean":"2023-10-03T19:19:40.677990+0000","last_became_active":"2023-10-03T19:19:39.489715+0000","last_became_peered":"2023-10-03T19:19:39.489715+0000","last_unstale":"2023-10-03T19:19:40.677990+0000","last_undegraded":"2023-10-03T19:19:40.677990+0000","last_fullsized":"2023-10-03T19:19:40.677990+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:21:53.299603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175437+0000","last_change":"2023-10-03T19:19:39.092502+0000","last_active":"2023-10-03T19:19:41.175437+0000","last_peered":"2023-10-03T19:19:41.175437+0000","last_clean":"2023-10-03T19:19:41.175437+0000","last_became_active":"2023-10-03T19:19:39.091671+0000","last_became_peered":"2023-10-03T19:19:39.091671+0000","last_unstale":"2023-10-03T19:19:41.175437+0000","last_undegraded":"2023-10-03T19:19:41.175437+0000","last_fullsized":"2023-10-03T19:19:41.175437+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:28:58.772881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":164,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174651+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:19:41.174651+0000","last_peered":"2023-10-03T19:19:41.174651+0000","last_clean":"2023-10-03T19:19:41.174651+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:19:41.174651+0000","last_undegraded":"2023-10-03T19:19:41.174651+0000","last_fullsized":"2023-10-03T19:19:41.174651+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:28:06.684655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175720+0000","last_change":"2023-10-03T19:19:39.474081+0000","last_active":"2023-10-03T19:19:41.175720+0000","last_peered":"2023-10-03T19:19:41.175720+0000","last_clean":"2023-10-03T19:19:41.175720+0000","last_became_active":"2023-10-03T19:19:39.473795+0000","last_became_peered":"2023-10-03T19:19:39.473795+0000","last_unstale":"2023-10-03T19:19:41.175720+0000","last_undegraded":"2023-10-03T19:19:41.175720+0000","last_fullsized":"2023-10-03T19:19:41.175720+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:50:56.639365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-03T19:19:39.107801+0000","last_change":"2023-10-03T19:19:39.097664+0000","last_active":"2023-10-03T19:19:39.107801+0000","last_peered":"2023-10-03T19:19:39.107801+0000","last_clean":"2023-10-03T19:19:39.107801+0000","last_became_active":"2023-10-03T19:19:39.097135+0000","last_became_peered":"2023-10-03T19:19:39.097135+0000","last_unstale":"2023-10-03T19:19:39.107801+0000","last_undegraded":"2023-10-03T19:19:39.107801+0000","last_fullsized":"2023-10-03T19:19:39.107801+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:07:06.406878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173371+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:19:41.173371+0000","last_peered":"2023-10-03T19:19:41.173371+0000","last_clean":"2023-10-03T19:19:41.173371+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:19:41.173371+0000","last_undegraded":"2023-10-03T19:19:41.173371+0000","last_fullsized":"2023-10-03T19:19:41.173371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:50:13.204633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173376+0000","last_change":"2023-10-03T19:19:39.445108+0000","last_active":"2023-10-03T19:19:41.173376+0000","last_peered":"2023-10-03T19:19:41.173376+0000","last_clean":"2023-10-03T19:19:41.173376+0000","last_became_active":"2023-10-03T19:19:39.443964+0000","last_became_peered":"2023-10-03T19:19:39.443964+0000","last_unstale":"2023-10-03T19:19:41.173376+0000","last_undegraded":"2023-10-03T19:19:41.173376+0000","last_fullsized":"2023-10-03T19:19:41.173376+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:50:29.706153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678974+0000","last_change":"2023-10-03T19:19:39.099820+0000","last_active":"2023-10-03T19:19:40.678974+0000","last_peered":"2023-10-03T19:19:40.678974+0000","last_clean":"2023-10-03T19:19:40.678974+0000","last_became_active":"2023-10-03T19:19:39.094297+0000","last_became_peered":"2023-10-03T19:19:39.094297+0000","last_unstale":"2023-10-03T19:19:40.678974+0000","last_undegraded":"2023-10-03T19:19:40.678974+0000","last_fullsized":"2023-10-03T19:19:40.678974+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:25:05.736398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":156,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-03T19:19:39.076080+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:19:39.076080+0000","last_peered":"2023-10-03T19:19:39.076080+0000","last_clean":"2023-10-03T19:19:39.076080+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:19:39.076080+0000","last_undegraded":"2023-10-03T19:19:39.076080+0000","last_fullsized":"2023-10-03T19:19:39.076080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:42:50.307434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.429963+0000","last_change":"2023-10-03T19:19:39.499012+0000","last_active":"2023-10-03T19:19:40.429963+0000","last_peered":"2023-10-03T19:19:40.429963+0000","last_clean":"2023-10-03T19:19:40.429963+0000","last_became_active":"2023-10-03T19:19:39.498726+0000","last_became_peered":"2023-10-03T19:19:39.498726+0000","last_unstale":"2023-10-03T19:19:40.429963+0000","last_undegraded":"2023-10-03T19:19:40.429963+0000","last_fullsized":"2023-10-03T19:19:40.429963+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:24:21.652472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678086+0000","last_change":"2023-10-03T19:19:39.090362+0000","last_active":"2023-10-03T19:19:40.678086+0000","last_peered":"2023-10-03T19:19:40.678086+0000","last_clean":"2023-10-03T19:19:40.678086+0000","last_became_active":"2023-10-03T19:19:39.089665+0000","last_became_peered":"2023-10-03T19:19:39.089665+0000","last_unstale":"2023-10-03T19:19:40.678086+0000","last_undegraded":"2023-10-03T19:19:40.678086+0000","last_fullsized":"2023-10-03T19:19:40.678086+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:27:13.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":156,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176195+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:19:41.176195+0000","last_peered":"2023-10-03T19:19:41.176195+0000","last_clean":"2023-10-03T19:19:41.176195+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:19:41.176195+0000","last_undegraded":"2023-10-03T19:19:41.176195+0000","last_fullsized":"2023-10-03T19:19:41.176195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:20:40.902125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174641+0000","last_change":"2023-10-03T19:19:39.451521+0000","last_active":"2023-10-03T19:19:41.174641+0000","last_peered":"2023-10-03T19:19:41.174641+0000","last_clean":"2023-10-03T19:19:41.174641+0000","last_became_active":"2023-10-03T19:19:39.451224+0000","last_became_peered":"2023-10-03T19:19:39.451224+0000","last_unstale":"2023-10-03T19:19:41.174641+0000","last_undegraded":"2023-10-03T19:19:41.174641+0000","last_fullsized":"2023-10-03T19:19:41.174641+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:50:20.369948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173326+0000","last_change":"2023-10-03T19:19:39.072003+0000","last_active":"2023-10-03T19:19:41.173326+0000","last_peered":"2023-10-03T19:19:41.173326+0000","last_clean":"2023-10-03T19:19:41.173326+0000","last_became_active":"2023-10-03T19:19:39.071324+0000","last_became_peered":"2023-10-03T19:19:39.071324+0000","last_unstale":"2023-10-03T19:19:41.173326+0000","last_undegraded":"2023-10-03T19:19:41.173326+0000","last_fullsized":"2023-10-03T19:19:41.173326+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:01:20.263082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":164,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175496+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:19:41.175496+0000","last_peered":"2023-10-03T19:19:41.175496+0000","last_clean":"2023-10-03T19:19:41.175496+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:19:41.175496+0000","last_undegraded":"2023-10-03T19:19:41.175496+0000","last_fullsized":"2023-10-03T19:19:41.175496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:44:47.179646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.061302+0000","last_change":"2023-10-03T19:19:39.061302+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.061302+0000","last_undegraded":"2023-10-03T19:19:39.061302+0000","last_fullsized":"2023-10-03T19:19:39.061302+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174033+0000","last_change":"2023-10-03T19:19:39.080203+0000","last_active":"2023-10-03T19:19:41.174033+0000","last_peered":"2023-10-03T19:19:41.174033+0000","last_clean":"2023-10-03T19:19:41.174033+0000","last_became_active":"2023-10-03T19:19:39.079875+0000","last_became_peered":"2023-10-03T19:19:39.079875+0000","last_unstale":"2023-10-03T19:19:41.174033+0000","last_undegraded":"2023-10-03T19:19:41.174033+0000","last_fullsized":"2023-10-03T19:19:41.174033+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:47:10.549041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":156,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176538+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:19:41.176538+0000","last_peered":"2023-10-03T19:19:41.176538+0000","last_clean":"2023-10-03T19:19:41.176538+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:19:41.176538+0000","last_undegraded":"2023-10-03T19:19:41.176538+0000","last_fullsized":"2023-10-03T19:19:41.176538+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:00:06.011070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.061790+0000","last_change":"2023-10-03T19:19:39.061790+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.061790+0000","last_undegraded":"2023-10-03T19:19:39.061790+0000","last_fullsized":"2023-10-03T19:19:39.061790+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173183+0000","last_change":"2023-10-03T19:19:39.073332+0000","last_active":"2023-10-03T19:19:41.173183+0000","last_peered":"2023-10-03T19:19:41.173183+0000","last_clean":"2023-10-03T19:19:41.173183+0000","last_became_active":"2023-10-03T19:19:39.072635+0000","last_became_peered":"2023-10-03T19:19:39.072635+0000","last_unstale":"2023-10-03T19:19:41.173183+0000","last_undegraded":"2023-10-03T19:19:41.173183+0000","last_fullsized":"2023-10-03T19:19:41.173183+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:58:24.112901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":156,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.679025+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:19:40.679025+0000","last_peered":"2023-10-03T19:19:40.679025+0000","last_clean":"2023-10-03T19:19:40.679025+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:19:40.679025+0000","last_undegraded":"2023-10-03T19:19:40.679025+0000","last_fullsized":"2023-10-03T19:19:40.679025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:11:45.085836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509531,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33704,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":32448,"kb_avail":94338136,"statfs":{"total":96636764160,"available":96602251264,"internally_reserved":0,"allocated":1277952,"data_stored":1142210,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":33226752},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.85899999999999999,"15min":0.92700000000000005},"min":{"1min":0.66300000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1950000000000001,"5min":1.206,"15min":4.0469999999999997},"last":2.1080000000000001},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.85299999999999998,"15min":0.82099999999999995},"min":{"1min":0.55200000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.177,"5min":1.2310000000000001,"15min":1.3420000000000001},"last":1.121}]},{"osd":1,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.86299999999999999,"15min":0.98599999999999999},"min":{"1min":0.61899999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1359999999999999,"5min":1.3200000000000001,"15min":3.8239999999999998},"last":2.298},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.89800000000000002,"15min":0.87},"min":{"1min":0.64500000000000002,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.034}]},{"osd":2,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.95899999999999996,"15min":0.88400000000000001},"min":{"1min":0.55300000000000005,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1719999999999999,"5min":6.0449999999999999,"15min":6.0449999999999999},"last":4.4779999999999998},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.94199999999999995,"15min":1.0109999999999999},"min":{"1min":0.69999999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.296,"5min":1.5800000000000001,"15min":3.98},"last":2.673}]},{"osd":3,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.034,"15min":0.95799999999999996},"min":{"1min":0.68500000000000005,"5min":0.63800000000000001,"15min":0.51100000000000001},"max":{"1min":1.232,"5min":6.125,"15min":6.125},"last":4.3650000000000002},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.97599999999999998,"15min":1.0840000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.175,"5min":1.444,"15min":3.9140000000000001},"last":1.593}]},{"osd":4,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.89800000000000002,"15min":1.0920000000000001},"min":{"1min":0.61599999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":5.1130000000000004},"last":2.4769999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.016,"15min":1.018},"min":{"1min":0.70699999999999996,"5min":0.629,"15min":0.629},"max":{"1min":1.214,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":12.196999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.006,"15min":1.2010000000000001},"min":{"1min":0.63700000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2470000000000001,"5min":1.349,"15min":5.1859999999999999},"last":2.581},{"interface":"front","average":{"1min":1.004,"5min":1.0209999999999999,"15min":1.115},"min":{"1min":0.69299999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.29,"5min":1.2949999999999999,"15min":2.0609999999999999},"last":1.6719999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0740000000000001,"15min":1.093},"min":{"1min":0.80000000000000004,"5min":0.75700000000000001,"15min":0.69399999999999995},"max":{"1min":1.3839999999999999,"5min":1.4890000000000001,"15min":1.5449999999999999},"last":1.7609999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.1459999999999999,"15min":1.167},"min":{"1min":0.77800000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.232,"5min":6.1580000000000004,"15min":6.1580000000000004},"last":4.5570000000000004}]}]},{"osd":6,"up_from":15,"seq":64424509531,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26992,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":25792,"kb_avail":94344848,"statfs":{"total":96636764160,"available":96609124352,"internally_reserved":0,"allocated":1220608,"data_stored":552686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":26411008},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.84599999999999997,"15min":0.82699999999999996},"min":{"1min":0.54100000000000004,"5min":0.45400000000000001,"15min":0.44600000000000001},"max":{"1min":1.234,"5min":1.3340000000000001,"15min":1.504},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.91100000000000003,"15min":0.88900000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.44600000000000001},"max":{"1min":1.1080000000000001,"5min":1.423,"15min":1.839},"last":1.2430000000000001}]},{"osd":1,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.86699999999999999,"15min":0.84699999999999998},"min":{"1min":0.56000000000000005,"5min":0.52100000000000002,"15min":0.504},"max":{"1min":1.1859999999999999,"5min":1.27,"15min":2.0150000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.88900000000000001,"15min":0.88200000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.161,"5min":1.448,"15min":1.448},"last":0.73599999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.93799999999999994,"15min":0.88900000000000001},"min":{"1min":0.66400000000000003,"5min":0.59199999999999997,"15min":0.51900000000000002},"max":{"1min":1.4430000000000001,"5min":1.528,"15min":1.528},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.92700000000000005,"15min":0.92500000000000004},"min":{"1min":0.60899999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1519999999999999,"5min":1.369,"15min":1.546},"last":0.96199999999999997}]},{"osd":3,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.96299999999999997,"15min":0.97899999999999998},"min":{"1min":0.68899999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.298,"5min":1.377,"15min":1.6990000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90700000000000003,"15min":0.90800000000000003},"min":{"1min":0.70199999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.143,"5min":1.206,"15min":2.121},"last":0.79600000000000004}]},{"osd":4,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.91600000000000004,"15min":0.998},"min":{"1min":0.67400000000000004,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.335,"5min":1.339,"15min":1.95},"last":1.075},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.995,"15min":1.0680000000000001},"min":{"1min":0.64400000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4490000000000001,"5min":1.504,"15min":1.7709999999999999},"last":1.1120000000000001}]},{"osd":5,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.90700000000000003,"15min":0.99199999999999999},"min":{"1min":0.624,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.226,"5min":1.3200000000000001,"15min":2.2570000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.048,"15min":1.103},"min":{"1min":0.71799999999999997,"5min":0.68300000000000005,"15min":0.68100000000000005},"max":{"1min":1.5009999999999999,"5min":1.524,"15min":2.0619999999999998},"last":1.2010000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.071,"15min":1.109},"min":{"1min":0.748,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.639,"5min":1.639,"15min":2.0049999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.044,"15min":1.0820000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.61899999999999999},"max":{"1min":1.3879999999999999,"5min":1.4350000000000001,"15min":2.4249999999999998},"last":1.151}]}]},{"osd":4,"up_from":15,"seq":64424509532,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42152,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":40960,"kb_avail":94329688,"statfs":{"total":96636764160,"available":96593600512,"internally_reserved":0,"allocated":1212416,"data_stored":551774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":41943040},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":1.0600000000000001,"15min":0.875},"min":{"1min":0.64200000000000002,"5min":0.54700000000000004,"15min":0.50600000000000001},"max":{"1min":1.0600000000000001,"5min":17.686,"15min":17.686},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.90100000000000002,"5min":1.02,"15min":0.89000000000000001},"min":{"1min":0.64000000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.28,"5min":16.925999999999998,"15min":16.925999999999998},"last":0.622}]},{"osd":1,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.085,"15min":0.98499999999999999},"min":{"1min":0.67700000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1759999999999999,"5min":16.640999999999998,"15min":16.640999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":1.089,"15min":0.93400000000000005},"min":{"1min":0.67300000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.151,"5min":17.59,"15min":17.59},"last":0.80700000000000005}]},{"osd":2,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.997,"15min":0.94299999999999995},"min":{"1min":0.70699999999999996,"5min":0.56200000000000006,"15min":0.53200000000000003},"max":{"1min":1.1180000000000001,"5min":8.5630000000000006,"15min":8.5630000000000006},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.93999999999999995,"5min":1.143,"15min":1.01},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.175,"5min":17.734000000000002,"15min":17.734000000000002},"last":0.88800000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.0880000000000001,"15min":0.94299999999999995},"min":{"1min":0.72499999999999998,"5min":0.61499999999999999,"15min":0.53900000000000003},"max":{"1min":1.242,"5min":16.98,"15min":16.98},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.997,"5min":1.161,"15min":1.105},"min":{"1min":0.66900000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2789999999999999,"5min":16.434000000000001,"15min":16.434000000000001},"last":0.82999999999999996}]},{"osd":5,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":1.1020000000000001,"15min":1.0820000000000001},"min":{"1min":0.624,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.143,"5min":17.782,"15min":17.782},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.96599999999999997,"15min":1.002},"min":{"1min":0.65700000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.264,"5min":1.708,"15min":1.708},"last":0.77000000000000002}]},{"osd":6,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.3859999999999999,"15min":1.27},"min":{"1min":0.66000000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.2250000000000001,"5min":36.106000000000002,"15min":36.106000000000002},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.2450000000000001,"15min":1.216},"min":{"1min":0.86099999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.2410000000000001,"5min":17.646999999999998,"15min":17.646999999999998},"last":0.97299999999999998}]},{"osd":7,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.226,"15min":1.1359999999999999},"min":{"1min":0.81200000000000006,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.421,"5min":17.042000000000002,"15min":17.042000000000002},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.3,"15min":1.262},"min":{"1min":0.83199999999999996,"5min":0.66400000000000003,"15min":0.63300000000000001},"max":{"1min":1.4670000000000001,"5min":16.32,"15min":16.32},"last":0.998}]}]},{"osd":2,"up_from":15,"seq":64424509532,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":31424,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1204224,"data_stored":550552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":32178176},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.79100000000000004,"15min":0.61299999999999999},"min":{"1min":0.47799999999999998,"5min":0.32200000000000001,"15min":0.247},"max":{"1min":0.98199999999999998,"5min":13.629,"15min":13.629},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":1.206,"15min":0.80900000000000005},"min":{"1min":0.34000000000000002,"5min":0.30299999999999999,"15min":0.28999999999999998},"max":{"1min":0.97199999999999998,"5min":40.439,"15min":40.439},"last":0.53200000000000003}]},{"osd":1,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.90200000000000002,"15min":0.71099999999999997},"min":{"1min":0.47899999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1,"5min":14.074,"15min":14.074},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.78500000000000003,"15min":0.64900000000000002},"min":{"1min":0.38800000000000001,"5min":0.34799999999999998,"15min":0.26400000000000001},"max":{"1min":1.1080000000000001,"5min":7.0060000000000002,"15min":7.0060000000000002},"last":0.44800000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.90000000000000002,"15min":0.71299999999999997},"min":{"1min":0.36699999999999999,"5min":0.28899999999999998,"15min":0.224},"max":{"1min":1.05,"5min":13.423999999999999,"15min":13.423999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.0649999999999999,"15min":0.82899999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.36399999999999999},"max":{"1min":1.1220000000000001,"5min":18.568999999999999,"15min":18.568999999999999},"last":0.56799999999999995}]},{"osd":4,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.94999999999999996,"15min":0.878},"min":{"1min":0.64200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.105,"5min":1.718,"15min":1.718},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.3380000000000001,"15min":1.05},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.22,"5min":28.667999999999999,"15min":28.667999999999999},"last":0.63}]},{"osd":5,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.0529999999999999,"15min":0.92100000000000004},"min":{"1min":0.67600000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.399,"5min":5.4459999999999997,"15min":5.4459999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.2230000000000001,"15min":1.0309999999999999},"min":{"1min":0.63300000000000001,"5min":0.57599999999999996,"15min":0.52700000000000002},"max":{"1min":1.4970000000000001,"5min":14.007,"15min":14.007},"last":0.70299999999999996}]},{"osd":6,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":1.1040000000000001,"15min":0.97099999999999997},"min":{"1min":0.65900000000000003,"5min":0.60099999999999998,"15min":0.49099999999999999},"max":{"1min":1.212,"5min":10.679,"15min":10.679},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.087,"15min":1.004},"min":{"1min":0.75600000000000001,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.325,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.88200000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.3240000000000001,"15min":1.1080000000000001},"min":{"1min":0.70299999999999996,"5min":0.63100000000000001,"15min":0.56100000000000005},"max":{"1min":1.415,"5min":18.623000000000001,"15min":18.623000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":1.002,"5min":1.0920000000000001,"15min":0.996},"min":{"1min":0.61699999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1850000000000001,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.84499999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509531,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30628,"kb_used_data":1180,"kb_used_omap":0,"kb_used_meta":29440,"kb_avail":94341212,"statfs":{"total":96636764160,"available":96605401088,"internally_reserved":0,"allocated":1208320,"data_stored":551716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30146560},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59199999999999997,"15min":0.55600000000000005},"min":{"1min":0.27900000000000003,"5min":0.27200000000000002,"15min":0.26900000000000002},"max":{"1min":0.92100000000000004,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70399999999999996,"15min":0.56799999999999995},"min":{"1min":0.41799999999999998,"5min":0.27200000000000002,"15min":0.22900000000000001},"max":{"1min":1.1899999999999999,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.41799999999999998}]},{"osd":2,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68300000000000005,"15min":0.58899999999999997},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.26200000000000001},"max":{"1min":0.879,"5min":1.506,"15min":1.506},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.82099999999999995,"15min":0.70599999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.312},"max":{"1min":1.1919999999999999,"5min":1.365,"15min":1.365},"last":0.82999999999999996}]},{"osd":3,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.76400000000000001,"15min":0.67300000000000004},"min":{"1min":0.36099999999999999,"5min":0.31,"15min":0.31},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.75700000000000001,"15min":0.63400000000000001},"min":{"1min":0.39100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.90700000000000003,"5min":1.232,"15min":1.27},"last":0.70899999999999996}]},{"osd":4,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.89000000000000001,"15min":0.82799999999999996},"min":{"1min":0.61199999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0860000000000001,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.98499999999999999,"15min":0.91400000000000003},"min":{"1min":0.69899999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3260000000000001,"5min":1.728,"15min":1.728},"last":1.0609999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.98999999999999999,"15min":0.89500000000000002},"min":{"1min":0.60299999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.28,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.117},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.96299999999999997,"15min":0.88500000000000001},"min":{"1min":0.77300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.198,"5min":1.3959999999999999,"15min":1.6080000000000001},"last":0.89200000000000002}]},{"osd":6,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0349999999999999,"15min":0.95399999999999996},"min":{"1min":0.59499999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2689999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.149},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0289999999999999,"15min":0.93400000000000005},"min":{"1min":0.66700000000000004,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3600000000000001,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.0229999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0669999999999999,"15min":0.97599999999999998},"min":{"1min":0.55100000000000005,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.292,"5min":1.673,"15min":1.673},"last":1.204},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0289999999999999,"15min":0.93999999999999995},"min":{"1min":0.67500000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4379999999999999,"5min":1.5880000000000001,"15min":1.649},"last":1.1719999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542235,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25176,"kb_used_data":1168,"kb_used_omap":0,"kb_used_meta":24000,"kb_avail":94346664,"statfs":{"total":96636764160,"available":96610983936,"internally_reserved":0,"allocated":1196032,"data_stored":545611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24576000},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.63200000000000001,"15min":0.58799999999999997},"min":{"1min":0.36399999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.96199999999999997,"5min":1.212,"15min":1.212},"last":0.221},{"interface":"front","average":{"1min":0.755,"5min":0.69999999999999996,"15min":0.66000000000000003},"min":{"1min":0.38900000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.5,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.33700000000000002}]},{"osd":1,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.70399999999999996,"15min":0.64800000000000002},"min":{"1min":0.42299999999999999,"5min":0.28599999999999998,"15min":0.27000000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76000000000000001,"15min":0.69099999999999995},"min":{"1min":0.34300000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.169,"5min":1.2210000000000001,"15min":1.222},"last":0.40300000000000002}]},{"osd":2,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.79400000000000004,"15min":0.73299999999999998},"min":{"1min":0.35999999999999999,"5min":0.317,"15min":0.317},"max":{"1min":1.1539999999999999,"5min":1.23,"15min":1.23},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73199999999999998,"15min":0.66000000000000003},"min":{"1min":0.371,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.05,"5min":1.671,"15min":1.671},"last":0.316}]},{"osd":4,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.92000000000000004,"15min":0.91200000000000003},"min":{"1min":0.63900000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2949999999999999,"5min":1.411,"15min":1.496},"last":0.58699999999999997},{"interface":"front","average":{"1min":1.006,"5min":1.018,"15min":0.95599999999999996},"min":{"1min":0.76400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3280000000000001,"5min":1.546,"15min":1.546},"last":0.44800000000000001}]},{"osd":5,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.91200000000000003,"15min":0.88700000000000001},"min":{"1min":0.63300000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.095,"5min":1.581,"15min":1.581},"last":0.50600000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.022,"15min":1.004},"min":{"1min":0.68100000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4179999999999999,"5min":1.498,"15min":1.498},"last":0.60699999999999998}]},{"osd":6,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.94599999999999995,"15min":0.92800000000000005},"min":{"1min":0.68799999999999994,"5min":0.56999999999999995,"15min":0.56699999999999995},"max":{"1min":1.212,"5min":1.347,"15min":1.347},"last":0.47799999999999998},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.05,"15min":1.006},"min":{"1min":0.80000000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.373,"5min":1.4970000000000001,"15min":1.5629999999999999},"last":0.56399999999999995}]},{"osd":7,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.083,"15min":1.0289999999999999},"min":{"1min":0.70599999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":1.109,"5min":1.0609999999999999,"15min":1.03},"min":{"1min":0.65300000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.659,"5min":1.659,"15min":1.708},"last":0.625}]}]},{"osd":5,"up_from":13,"seq":55834574938,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22716,"kb_used_data":1140,"kb_used_omap":0,"kb_used_meta":21568,"kb_avail":94349124,"statfs":{"total":96636764160,"available":96613502976,"internally_reserved":0,"allocated":1167360,"data_stored":531273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22085632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.85799999999999998,"15min":0.83399999999999996},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.181,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.89400000000000002,"15min":0.86599999999999999},"min":{"1min":0.78200000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.26,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.1990000000000001}]},{"osd":1,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.872,"15min":0.84499999999999997},"min":{"1min":0.505,"5min":0.501,"15min":0.501},"max":{"1min":1.044,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.91000000000000003,"15min":0.92300000000000004},"min":{"1min":0.63100000000000001,"5min":0.58699999999999997,"15min":0.57099999999999995},"max":{"1min":1.23,"5min":1.23,"15min":1.514},"last":1.127}]},{"osd":2,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.91000000000000003,"15min":0.90300000000000002},"min":{"1min":0.625,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2010000000000001,"5min":1.351,"15min":1.3700000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.999,"5min":0.93000000000000005,"15min":0.90600000000000003},"min":{"1min":0.82499999999999996,"5min":0.57099999999999995,"15min":0.53300000000000003},"max":{"1min":1.1819999999999999,"5min":1.1930000000000001,"15min":1.3320000000000001},"last":1.056}]},{"osd":3,"last update":"Tue Oct 3 19:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.93600000000000005,"15min":0.93100000000000005},"min":{"1min":0.67700000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2210000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.046,"5min":1.03,"15min":1.028},"min":{"1min":0.78700000000000003,"5min":0.65900000000000003,"15min":0.61199999999999999},"max":{"1min":1.3129999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.80400000000000005}]},{"osd":4,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.97499999999999998,"15min":0.97299999999999998},"min":{"1min":0.70699999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.2450000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96399999999999997,"15min":1.0129999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2749999999999999,"5min":1.335,"15min":1.7709999999999999},"last":0.73699999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.995,"15min":1.024},"min":{"1min":0.67000000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.204,"5min":1.546,"15min":1.546},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0880000000000001,"15min":1.1240000000000001},"min":{"1min":0.82499999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.3759999999999999,"5min":1.823,"15min":1.823},"last":0.93000000000000005}]},{"osd":7,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0569999999999999,"15min":1.071},"min":{"1min":0.68700000000000006,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.5680000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.119,"15min":1.143},"min":{"1min":0.86499999999999999,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.325,"5min":1.4179999999999999,"15min":1.9099999999999999},"last":1.012}]}]},{"osd":0,"up_from":13,"seq":55834574939,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30072,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":28864,"kb_avail":94341768,"statfs":{"total":96636764160,"available":96605970432,"internally_reserved":0,"allocated":1228800,"data_stored":1120477,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":29556736},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.69699999999999995,"15min":0.61399999999999999},"min":{"1min":0.502,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.92000000000000004,"5min":5.7480000000000002,"15min":5.7480000000000002},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.80900000000000005,"15min":0.746},"min":{"1min":0.54700000000000004,"5min":0.37,"15min":0.33000000000000002},"max":{"1min":1.0760000000000001,"5min":6.274,"15min":6.274},"last":0.84899999999999998}]},{"osd":2,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.81999999999999995,"15min":0.746},"min":{"1min":0.46700000000000003,"5min":0.36499999999999999,"15min":0.35399999999999998},"max":{"1min":0.97599999999999998,"5min":6.1609999999999996,"15min":6.1609999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71499999999999997,"15min":0.69899999999999995},"min":{"1min":0.44500000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.997,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.80200000000000005}]},{"osd":3,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.90800000000000003,"15min":0.78000000000000003},"min":{"1min":0.57499999999999996,"5min":0.41799999999999998,"15min":0.36799999999999999},"max":{"1min":1.1739999999999999,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82199999999999995,"15min":0.73199999999999998},"min":{"1min":0.53300000000000003,"5min":0.376,"15min":0.30299999999999999},"max":{"1min":1.0780000000000001,"5min":1.375,"15min":1.375},"last":0.93200000000000005}]},{"osd":4,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":1.0029999999999999,"15min":0.93600000000000005},"min":{"1min":0.71299999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.254,"5min":8.1159999999999997,"15min":8.1159999999999997},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.056,"5min":1.0860000000000001,"15min":1.0429999999999999},"min":{"1min":0.71199999999999997,"5min":0.57299999999999995,"15min":0.504},"max":{"1min":1.3440000000000001,"5min":6.2320000000000002,"15min":6.2320000000000002},"last":1.0960000000000001}]},{"osd":5,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.2549999999999999,"15min":1.1140000000000001},"min":{"1min":0.69199999999999995,"5min":0.59399999999999997,"15min":0.46899999999999997},"max":{"1min":1.4259999999999999,"5min":17.420000000000002,"15min":17.420000000000002},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.222,"15min":1.052},"min":{"1min":0.74299999999999999,"5min":0.59499999999999997,"15min":0.54300000000000004},"max":{"1min":1.371,"5min":17.643000000000001,"15min":17.643000000000001},"last":1.048}]},{"osd":6,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0880000000000001,"15min":1.038},"min":{"1min":0.77500000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3520000000000001,"5min":5.7220000000000004,"15min":5.7220000000000004},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0669999999999999,"15min":1.0129999999999999},"min":{"1min":0.877,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.417,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.1479999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.159,"15min":1.0740000000000001},"min":{"1min":0.81299999999999994,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3939999999999999,"5min":5.7800000000000002,"15min":5.7800000000000002},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.0920000000000001,"15min":1.0669999999999999},"min":{"1min":0.85699999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.343,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.21}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:19:43.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3f is not active+clean 2023-10-03T19:19:43.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:19:39.065677+0000', 'last_change': '2023-10-03T19:19:39.065677+0000', 'last_active': '2023-10-03T19:19:39.034212+0000', 'last_peered': '2023-10-03T19:19:39.034212+0000', 'last_clean': '2023-10-03T19:19:39.034212+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:19:39.065677+0000', 'last_undegraded': '2023-10-03T19:19:39.065677+0000', 'last_fullsized': '2023-10-03T19:19:39.065677+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_clean_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-03T19:19:43.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3d is not active+clean 2023-10-03T19:19:43.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:19:39.062721+0000', 'last_change': '2023-10-03T19:19:39.062721+0000', 'last_active': '2023-10-03T19:19:39.034212+0000', 'last_peered': '2023-10-03T19:19:39.034212+0000', 'last_clean': '2023-10-03T19:19:39.034212+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:19:39.062721+0000', 'last_undegraded': '2023-10-03T19:19:39.062721+0000', 'last_fullsized': '2023-10-03T19:19:39.062721+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_clean_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-03T19:19:43.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.35 is not active+clean 2023-10-03T19:19:43.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:19:39.067805+0000', 'last_change': '2023-10-03T19:19:39.067805+0000', 'last_active': '2023-10-03T19:19:39.034212+0000', 'last_peered': '2023-10-03T19:19:39.034212+0000', 'last_clean': '2023-10-03T19:19:39.034212+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:19:39.067805+0000', 'last_undegraded': '2023-10-03T19:19:39.067805+0000', 'last_fullsized': '2023-10-03T19:19:39.067805+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_clean_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-03T19:19:43.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2f is not active+clean 2023-10-03T19:19:43.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:19:39.060759+0000', 'last_change': '2023-10-03T19:19:39.060759+0000', 'last_active': '2023-10-03T19:19:39.034212+0000', 'last_peered': '2023-10-03T19:19:39.034212+0000', 'last_clean': '2023-10-03T19:19:39.034212+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:19:39.060759+0000', 'last_undegraded': '2023-10-03T19:19:39.060759+0000', 'last_fullsized': '2023-10-03T19:19:39.060759+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_clean_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-03T19:19:43.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2d is not active+clean 2023-10-03T19:19:43.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:19:39.062240+0000', 'last_change': '2023-10-03T19:19:39.062240+0000', 'last_active': '2023-10-03T19:19:39.034212+0000', 'last_peered': '2023-10-03T19:19:39.034212+0000', 'last_clean': '2023-10-03T19:19:39.034212+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:19:39.062240+0000', 'last_undegraded': '2023-10-03T19:19:39.062240+0000', 'last_fullsized': '2023-10-03T19:19:39.062240+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_clean_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-03T19:19:43.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.29 is not active+clean 2023-10-03T19:19:43.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:19:39.065582+0000', 'last_change': '2023-10-03T19:19:39.065582+0000', 'last_active': '2023-10-03T19:19:39.034212+0000', 'last_peered': '2023-10-03T19:19:39.034212+0000', 'last_clean': '2023-10-03T19:19:39.034212+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:19:39.065582+0000', 'last_undegraded': '2023-10-03T19:19:39.065582+0000', 'last_fullsized': '2023-10-03T19:19:39.065582+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_clean_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-03T19:19:43.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.25 is not active+clean 2023-10-03T19:19:43.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:19:39.066584+0000', 'last_change': '2023-10-03T19:19:39.066584+0000', 'last_active': '2023-10-03T19:19:39.034212+0000', 'last_peered': '2023-10-03T19:19:39.034212+0000', 'last_clean': '2023-10-03T19:19:39.034212+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:19:39.066584+0000', 'last_undegraded': '2023-10-03T19:19:39.066584+0000', 'last_fullsized': '2023-10-03T19:19:39.066584+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_clean_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-03T19:19:43.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.0 is not active+clean 2023-10-03T19:19:43.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:19:39.057503+0000', 'last_change': '2023-10-03T19:19:39.057503+0000', 'last_active': '2023-10-03T19:19:39.034212+0000', 'last_peered': '2023-10-03T19:19:39.034212+0000', 'last_clean': '2023-10-03T19:19:39.034212+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:19:39.057503+0000', 'last_undegraded': '2023-10-03T19:19:39.057503+0000', 'last_fullsized': '2023-10-03T19:19:39.057503+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_clean_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-03T19:19:43.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3 is not active+clean 2023-10-03T19:19:43.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:19:39.063100+0000', 'last_change': '2023-10-03T19:19:39.063100+0000', 'last_active': '2023-10-03T19:19:39.034212+0000', 'last_peered': '2023-10-03T19:19:39.034212+0000', 'last_clean': '2023-10-03T19:19:39.034212+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:19:39.063100+0000', 'last_undegraded': '2023-10-03T19:19:39.063100+0000', 'last_fullsized': '2023-10-03T19:19:39.063100+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_clean_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-03T19:19:43.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.5 is not active+clean 2023-10-03T19:19:43.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:19:39.057672+0000', 'last_change': '2023-10-03T19:19:39.057672+0000', 'last_active': '2023-10-03T19:19:39.034212+0000', 'last_peered': '2023-10-03T19:19:39.034212+0000', 'last_clean': '2023-10-03T19:19:39.034212+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:19:39.057672+0000', 'last_undegraded': '2023-10-03T19:19:39.057672+0000', 'last_fullsized': '2023-10-03T19:19:39.057672+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_clean_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-03T19:19:43.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.8 is not active+clean 2023-10-03T19:19:43.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:19:39.064978+0000', 'last_change': '2023-10-03T19:19:39.064978+0000', 'last_active': '2023-10-03T19:19:39.034212+0000', 'last_peered': '2023-10-03T19:19:39.034212+0000', 'last_clean': '2023-10-03T19:19:39.034212+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:19:39.064978+0000', 'last_undegraded': '2023-10-03T19:19:39.064978+0000', 'last_fullsized': '2023-10-03T19:19:39.064978+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_clean_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-03T19:19:43.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.c is not active+clean 2023-10-03T19:19:43.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:19:39.064062+0000', 'last_change': '2023-10-03T19:19:39.064062+0000', 'last_active': '2023-10-03T19:19:39.034212+0000', 'last_peered': '2023-10-03T19:19:39.034212+0000', 'last_clean': '2023-10-03T19:19:39.034212+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:19:39.064062+0000', 'last_undegraded': '2023-10-03T19:19:39.064062+0000', 'last_fullsized': '2023-10-03T19:19:39.064062+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_clean_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-03T19:19:43.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.f is not active+clean 2023-10-03T19:19:43.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:19:39.060292+0000', 'last_change': '2023-10-03T19:19:39.060292+0000', 'last_active': '2023-10-03T19:19:39.034212+0000', 'last_peered': '2023-10-03T19:19:39.034212+0000', 'last_clean': '2023-10-03T19:19:39.034212+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:19:39.060292+0000', 'last_undegraded': '2023-10-03T19:19:39.060292+0000', 'last_fullsized': '2023-10-03T19:19:39.060292+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_clean_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-03T19:19:43.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.18 is not active+clean 2023-10-03T19:19:43.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:19:39.065787+0000', 'last_change': '2023-10-03T19:19:39.065787+0000', 'last_active': '2023-10-03T19:19:39.034212+0000', 'last_peered': '2023-10-03T19:19:39.034212+0000', 'last_clean': '2023-10-03T19:19:39.034212+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:19:39.065787+0000', 'last_undegraded': '2023-10-03T19:19:39.065787+0000', 'last_fullsized': '2023-10-03T19:19:39.065787+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_clean_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-03T19:19:43.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1b is not active+clean 2023-10-03T19:19:43.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:19:39.064384+0000', 'last_change': '2023-10-03T19:19:39.064384+0000', 'last_active': '2023-10-03T19:19:39.034212+0000', 'last_peered': '2023-10-03T19:19:39.034212+0000', 'last_clean': '2023-10-03T19:19:39.034212+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:19:39.064384+0000', 'last_undegraded': '2023-10-03T19:19:39.064384+0000', 'last_fullsized': '2023-10-03T19:19:39.064384+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_clean_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-03T19:19:43.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1f is not active+clean 2023-10-03T19:19:43.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:19:39.067174+0000', 'last_change': '2023-10-03T19:19:39.067174+0000', 'last_active': '2023-10-03T19:19:39.034212+0000', 'last_peered': '2023-10-03T19:19:39.034212+0000', 'last_clean': '2023-10-03T19:19:39.034212+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:19:39.067174+0000', 'last_undegraded': '2023-10-03T19:19:39.067174+0000', 'last_fullsized': '2023-10-03T19:19:39.067174+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_clean_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-03T19:19:43.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.11 is not active+clean 2023-10-03T19:19:43.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:19:39.064555+0000', 'last_change': '2023-10-03T19:19:39.064555+0000', 'last_active': '2023-10-03T19:19:39.034212+0000', 'last_peered': '2023-10-03T19:19:39.034212+0000', 'last_clean': '2023-10-03T19:19:39.034212+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:19:39.064555+0000', 'last_undegraded': '2023-10-03T19:19:39.064555+0000', 'last_fullsized': '2023-10-03T19:19:39.064555+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_clean_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-03T19:19:43.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.14 is not active+clean 2023-10-03T19:19:43.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:19:39.061302+0000', 'last_change': '2023-10-03T19:19:39.061302+0000', 'last_active': '2023-10-03T19:19:39.034212+0000', 'last_peered': '2023-10-03T19:19:39.034212+0000', 'last_clean': '2023-10-03T19:19:39.034212+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:19:39.061302+0000', 'last_undegraded': '2023-10-03T19:19:39.061302+0000', 'last_fullsized': '2023-10-03T19:19:39.061302+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_clean_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-03T19:19:43.493 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.15 is not active+clean 2023-10-03T19:19:43.493 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-10-03T19:19:39.061790+0000', 'last_change': '2023-10-03T19:19:39.061790+0000', 'last_active': '2023-10-03T19:19:39.034212+0000', 'last_peered': '2023-10-03T19:19:39.034212+0000', 'last_clean': '2023-10-03T19:19:39.034212+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:19:39.061790+0000', 'last_undegraded': '2023-10-03T19:19:39.061790+0000', 'last_fullsized': '2023-10-03T19:19:39.061790+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'last_clean_scrub_stamp': '2023-10-03T19:19:39.034212+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-03T19:19:43.493 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-03T19:19:43.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.620+0000 7fd623c85640 1 Processor -- start 2023-10-03T19:19:43.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.620+0000 7fd623c85640 1 -- start start 2023-10-03T19:19:43.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.620+0000 7fd623c85640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd61c06f170 0x7fd61c150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:43.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.620+0000 7fd623c85640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd61c0bc8b0 0x7fd61c14ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:43.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.620+0000 7fd623c85640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd61c06cac0 con 0x7fd61c06d170 2023-10-03T19:19:43.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.620+0000 7fd623c85640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd61c0720d0 con 0x7fd61c06f170 2023-10-03T19:19:43.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.620+0000 7fd623c85640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c0a5ab0 con 0x7fd61c0bc8b0 2023-10-03T19:19:43.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.620+0000 7fd622222640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd61c06d170 0x7fd61c14cfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39738/0 (socket says 172.21.15.45:39738) 2023-10-03T19:19:43.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.620+0000 7fd622222640 1 -- 172.21.15.45:0/396434293 learned_addr learned my addr 172.21.15.45:0/396434293 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:43.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.620+0000 7fd621a21640 1 --2- 172.21.15.45:0/396434293 >> v2:172.21.15.79:3300/0 conn(0x7fd61c06f170 0x7fd61c150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:43.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.620+0000 7fd621220640 1 --2- 172.21.15.45:0/396434293 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd61c0bc8b0 0x7fd61c14ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.620+0000 7fd620a1f640 1 -- 172.21.15.45:0/396434293 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1098167989 0 0) 0x7fd614001120 con 0x7fd61c06d170 2023-10-03T19:19:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.620+0000 7fd620a1f640 1 -- 172.21.15.45:0/396434293 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd608003530 con 0x7fd61c06d170 2023-10-03T19:19:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd620a1f640 1 -- 172.21.15.45:0/396434293 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1614127481 0 0) 0x7fd608003530 con 0x7fd61c06d170 2023-10-03T19:19:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd620a1f640 1 -- 172.21.15.45:0/396434293 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd61c0bc8b0 msgr2=0x7fd61c14ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd620a1f640 1 --2- 172.21.15.45:0/396434293 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd61c0bc8b0 0x7fd61c14ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd620a1f640 1 -- 172.21.15.45:0/396434293 >> v2:172.21.15.79:3300/0 conn(0x7fd61c06f170 msgr2=0x7fd61c150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd620a1f640 1 --2- 172.21.15.45:0/396434293 >> v2:172.21.15.79:3300/0 conn(0x7fd61c06f170 0x7fd61c150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd620a1f640 1 -- 172.21.15.45:0/396434293 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61c06cd00 con 0x7fd61c06d170 2023-10-03T19:19:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd620a1f640 1 -- 172.21.15.45:0/396434293 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fd614001810 con 0x7fd61c06d170 2023-10-03T19:19:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd620a1f640 1 -- 172.21.15.45:0/396434293 >> v1:172.21.15.45:6789/0 conn(0x7fd61c06d170 legacy=0x7fd61c14cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd620a1f640 1 --2- 172.21.15.45:0/396434293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd608003980 0x7fd608003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd620a1f640 1 --2- 172.21.15.45:0/396434293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6080043b0 0x7fd608004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:43.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd620a1f640 1 --2- 172.21.15.45:0/396434293 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd61c0bc8b0 0x7fd608004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:43.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd620a1f640 1 -- 172.21.15.45:0/396434293 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c0720d0 con 0x7fd608003980 2023-10-03T19:19:43.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd620a1f640 1 -- 172.21.15.45:0/396434293 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c0a5ab0 con 0x7fd6080043b0 2023-10-03T19:19:43.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd620a1f640 1 -- 172.21.15.45:0/396434293 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60800b990 con 0x7fd61c0bc8b0 2023-10-03T19:19:43.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd621a21640 1 --2- 172.21.15.45:0/396434293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd608003980 0x7fd608003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:43.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd621a21640 1 -- 172.21.15.45:0/396434293 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd61c0bc8b0 msgr2=0x7fd608004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:43.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd621a21640 1 --2- 172.21.15.45:0/396434293 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd61c0bc8b0 0x7fd608004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:43.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd621a21640 1 -- 172.21.15.45:0/396434293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6080043b0 msgr2=0x7fd608004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:43.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd621220640 1 --2- 172.21.15.45:0/396434293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6080043b0 0x7fd608004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:43.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd621a21640 1 --2- 172.21.15.45:0/396434293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6080043b0 0x7fd608004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:43.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd621a21640 1 -- 172.21.15.45:0/396434293 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd608003530 con 0x7fd608003980 2023-10-03T19:19:43.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd621220640 1 --2- 172.21.15.45:0/396434293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6080043b0 0x7fd608004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:43.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd621a21640 1 --2- 172.21.15.45:0/396434293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd608003980 0x7fd608003d90 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fd60c009ae0 tx=0x7fd60c01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b566a173f451f66 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:43.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd620a1f640 1 -- 172.21.15.45:0/396434293 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c0a5680 con 0x7fd608003980 2023-10-03T19:19:43.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd620a1f640 1 -- 172.21.15.45:0/396434293 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60c0a57e0 con 0x7fd608003980 2023-10-03T19:19:43.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd620a1f640 1 -- 172.21.15.45:0/396434293 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c0a5b90 con 0x7fd608003980 2023-10-03T19:19:43.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd623c85640 1 -- 172.21.15.45:0/396434293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd608003980 msgr2=0x7fd608003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:43.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd623c85640 1 --2- 172.21.15.45:0/396434293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd608003980 0x7fd608003d90 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fd60c009ae0 tx=0x7fd60c01ca90 comp rx=0 tx=0).stop 2023-10-03T19:19:43.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd622222640 1 -- 172.21.15.45:0/396434293 reap_dead start 2023-10-03T19:19:43.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd623c85640 1 -- 172.21.15.45:0/396434293 shutdown_connections 2023-10-03T19:19:43.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd623c85640 1 -- 172.21.15.45:0/396434293 >> 172.21.15.45:0/396434293 conn(0x7fd61c0bcf50 msgr2=0x7fd61c0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:43.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd623c85640 1 -- 172.21.15.45:0/396434293 shutdown_connections 2023-10-03T19:19:43.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.624+0000 7fd623c85640 1 -- 172.21.15.45:0/396434293 wait complete. 2023-10-03T19:19:43.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.628+0000 7fd623c85640 1 Processor -- start 2023-10-03T19:19:43.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.628+0000 7fd623c85640 1 -- start start 2023-10-03T19:19:43.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.628+0000 7fd623c85640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd608003980 0x7fd61c0b98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:43.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.628+0000 7fd623c85640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd61c14a590 0x7fd61c0c0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:43.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.628+0000 7fd623c85640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd61c1446c0 0x7fd61c144b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:43.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.628+0000 7fd623c85640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c1e4890 con 0x7fd608003980 2023-10-03T19:19:43.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.628+0000 7fd623c85640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c14b390 con 0x7fd61c1446c0 2023-10-03T19:19:43.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.628+0000 7fd623c85640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c0a3670 con 0x7fd61c14a590 2023-10-03T19:19:43.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.628+0000 7fd621a21640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd608003980 0x7fd61c0b98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:43.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.628+0000 7fd621a21640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd608003980 0x7fd61c0b98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47792/0 (socket says 172.21.15.45:47792) 2023-10-03T19:19:43.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.628+0000 7fd621a21640 1 -- 172.21.15.45:0/242559784 learned_addr learned my addr 172.21.15.45:0/242559784 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:43.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.628+0000 7fd622222640 1 --2- 172.21.15.45:0/242559784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd61c1446c0 0x7fd61c144b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:43.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.628+0000 7fd621220640 1 --2- 172.21.15.45:0/242559784 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd61c14a590 0x7fd61c0c0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:43.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.628+0000 7fd621a21640 1 -- 172.21.15.45:0/242559784 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd61c14a590 msgr2=0x7fd61c0c0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:43.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.628+0000 7fd621a21640 1 --2- 172.21.15.45:0/242559784 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd61c14a590 0x7fd61c0c0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:43.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.628+0000 7fd621a21640 1 -- 172.21.15.45:0/242559784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd61c1446c0 msgr2=0x7fd61c144b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:43.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.628+0000 7fd621a21640 1 --2- 172.21.15.45:0/242559784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd61c1446c0 0x7fd61c144b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:43.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.628+0000 7fd621a21640 1 -- 172.21.15.45:0/242559784 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61c14c4a0 con 0x7fd608003980 2023-10-03T19:19:43.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.628+0000 7fd621220640 1 --2- 172.21.15.45:0/242559784 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd61c14a590 0x7fd61c0c0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:43.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.628+0000 7fd622222640 1 --2- 172.21.15.45:0/242559784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd61c1446c0 0x7fd61c144b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:43.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.628+0000 7fd621a21640 1 --2- 172.21.15.45:0/242559784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd608003980 0x7fd61c0b98f0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fd60c01c8c0 tx=0x7fd608005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:43.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.628+0000 7fd6127fc640 1 -- 172.21.15.45:0/242559784 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c0be070 con 0x7fd608003980 2023-10-03T19:19:43.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.628+0000 7fd6127fc640 1 -- 172.21.15.45:0/242559784 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60c004020 con 0x7fd608003980 2023-10-03T19:19:43.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.628+0000 7fd623c85640 1 -- 172.21.15.45:0/242559784 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd61c14fae0 con 0x7fd608003980 2023-10-03T19:19:43.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.628+0000 7fd6127fc640 1 -- 172.21.15.45:0/242559784 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c004390 con 0x7fd608003980 2023-10-03T19:19:43.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.628+0000 7fd623c85640 1 -- 172.21.15.45:0/242559784 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd61c06f540 con 0x7fd608003980 2023-10-03T19:19:43.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.628+0000 7fd623c85640 1 -- 172.21.15.45:0/242559784 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd61c06d660 con 0x7fd608003980 2023-10-03T19:19:43.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.628+0000 7fd6127fc640 1 -- 172.21.15.45:0/242559784 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd60c0b4040 con 0x7fd608003980 2023-10-03T19:19:43.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.632+0000 7fd6127fc640 1 --2- 172.21.15.45:0/242559784 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd6000662b0 0x7fd600068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:43.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.632+0000 7fd6127fc640 1 -- 172.21.15.45:0/242559784 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd60c11d530 con 0x7fd608003980 2023-10-03T19:19:43.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.632+0000 7fd621220640 1 --2- 172.21.15.45:0/242559784 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd6000662b0 0x7fd600068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:43.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.632+0000 7fd621220640 1 --2- 172.21.15.45:0/242559784 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd6000662b0 0x7fd600068760 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd61c14dc30 tx=0x7fd61800d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:43.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.636+0000 7fd6127fc640 1 -- 172.21.15.45:0/242559784 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd60c0ea9b0 con 0x7fd608003980 2023-10-03T19:19:43.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.840+0000 7fd623c85640 1 -- 172.21.15.45:0/242559784 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd61c04de80 con 0x7fd608003980 2023-10-03T19:19:43.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.844+0000 7fd6127fc640 1 -- 172.21.15.45:0/242559784 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1100 (secure 0 0 0) 0x7fd60c0edfd0 con 0x7fd608003980 2023-10-03T19:19:43.845 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:19:43.846 INFO:teuthology.orchestra.run.smithi045.stdout:{"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":458,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":98,"num_osds":8,"num_up_osds":8,"osd_up_since":1696360341,"num_in_osds":8,"osd_in_since":1696360332,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":86},{"state_name":"creating+peering","count":19}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592730,"bytes_used":249905152,"bytes_avail":772844208128,"bytes_total":773094113280,"inactive_pgs_ratio":0.18095238506793976,"write_bytes_sec":3143,"read_op_per_sec":0,"write_op_per_sec":9},"fsmap":{"epoch":50,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":7155}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2023-10-03T19:19:28.596810+0000","services":{}},"progress_events":{}} 2023-10-03T19:19:43.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.844+0000 7fd623c85640 1 -- 172.21.15.45:0/242559784 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd6000662b0 msgr2=0x7fd600068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:43.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.844+0000 7fd623c85640 1 --2- 172.21.15.45:0/242559784 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd6000662b0 0x7fd600068760 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd61c14dc30 tx=0x7fd61800d040 comp rx=0 tx=0).stop 2023-10-03T19:19:43.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.844+0000 7fd623c85640 1 -- 172.21.15.45:0/242559784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd608003980 msgr2=0x7fd61c0b98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:43.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.844+0000 7fd623c85640 1 --2- 172.21.15.45:0/242559784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd608003980 0x7fd61c0b98f0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fd60c01c8c0 tx=0x7fd608005800 comp rx=0 tx=0).stop 2023-10-03T19:19:43.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.844+0000 7fd623c85640 1 -- 172.21.15.45:0/242559784 shutdown_connections 2023-10-03T19:19:43.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.844+0000 7fd623c85640 1 --2- 172.21.15.45:0/242559784 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd6000662b0 0x7fd600068760 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:43.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.844+0000 7fd623c85640 1 --2- 172.21.15.45:0/242559784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd61c1446c0 0x7fd61c144b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:43.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.844+0000 7fd623c85640 1 --2- 172.21.15.45:0/242559784 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd61c14a590 0x7fd61c0c0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:43.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.844+0000 7fd623c85640 1 --2- 172.21.15.45:0/242559784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd608003980 0x7fd61c0b98f0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:43.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.844+0000 7fd623c85640 1 -- 172.21.15.45:0/242559784 >> 172.21.15.45:0/242559784 conn(0x7fd61c0bcf50 msgr2=0x7fd61c0bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:43.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.844+0000 7fd623c85640 1 -- 172.21.15.45:0/242559784 shutdown_connections 2023-10-03T19:19:43.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.844+0000 7fd623c85640 1 -- 172.21.15.45:0/242559784 wait complete. 2023-10-03T19:19:43.863 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-03T19:19:43.863 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:19:43.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.972+0000 7fa99392a640 1 Processor -- start 2023-10-03T19:19:43.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.972+0000 7fa99392a640 1 -- start start 2023-10-03T19:19:43.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.972+0000 7fa99392a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa98c149960 0x7fa98c14cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:43.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.972+0000 7fa99392a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa98c0c0fd0 0x7fa98c06aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:43.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.972+0000 7fa99392a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa98c0bffa0 con 0x7fa98c06b020 2023-10-03T19:19:43.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.972+0000 7fa99392a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa98c0c0560 con 0x7fa98c0c0fd0 2023-10-03T19:19:43.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.972+0000 7fa99392a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa98c0c0280 con 0x7fa98c149960 2023-10-03T19:19:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.972+0000 7fa990ec5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa98c0c0fd0 0x7fa98c06aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.972+0000 7fa990ec5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa98c0c0fd0 0x7fa98c06aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47794/0 (socket says 172.21.15.45:47794) 2023-10-03T19:19:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.972+0000 7fa990ec5640 1 -- 172.21.15.45:0/1761168327 learned_addr learned my addr 172.21.15.45:0/1761168327 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.972+0000 7fa991ec7640 1 --1- 172.21.15.45:0/1761168327 >> v1:172.21.15.45:6789/0 conn(0x7fa98c06b020 0x7fa98c14fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39750/0 (socket says 172.21.15.45:39750) 2023-10-03T19:19:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.972+0000 7fa9916c6640 1 --2- 172.21.15.45:0/1761168327 >> v2:172.21.15.79:3300/0 conn(0x7fa98c149960 0x7fa98c14cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.972+0000 7fa990ec5640 1 -- 172.21.15.45:0/1761168327 >> v2:172.21.15.79:3300/0 conn(0x7fa98c149960 msgr2=0x7fa98c14cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.972+0000 7fa990ec5640 1 --2- 172.21.15.45:0/1761168327 >> v2:172.21.15.79:3300/0 conn(0x7fa98c149960 0x7fa98c14cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.972+0000 7fa990ec5640 1 -- 172.21.15.45:0/1761168327 >> v1:172.21.15.45:6789/0 conn(0x7fa98c06b020 legacy=0x7fa98c14fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.972+0000 7fa990ec5640 1 -- 172.21.15.45:0/1761168327 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98c0c08d0 con 0x7fa98c0c0fd0 2023-10-03T19:19:43.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.972+0000 7fa990ec5640 1 --2- 172.21.15.45:0/1761168327 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa98c0c0fd0 0x7fa98c06aae0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fa98c0a77a0 tx=0x7fa97c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad2e40413a42949e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:43.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa983fff640 1 -- 172.21.15.45:0/1761168327 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c0ac620 con 0x7fa98c0c0fd0 2023-10-03T19:19:43.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa983fff640 1 -- 172.21.15.45:0/1761168327 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97c0ac780 con 0x7fa98c0c0fd0 2023-10-03T19:19:43.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa983fff640 1 -- 172.21.15.45:0/1761168327 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c0acb10 con 0x7fa98c0c0fd0 2023-10-03T19:19:43.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa99392a640 1 -- 172.21.15.45:0/1761168327 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa98c0c0fd0 msgr2=0x7fa98c06aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:43.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa99392a640 1 --2- 172.21.15.45:0/1761168327 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa98c0c0fd0 0x7fa98c06aae0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fa98c0a77a0 tx=0x7fa97c01c420 comp rx=0 tx=0).stop 2023-10-03T19:19:43.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa99392a640 1 -- 172.21.15.45:0/1761168327 shutdown_connections 2023-10-03T19:19:43.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa99392a640 1 --2- 172.21.15.45:0/1761168327 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa98c0c0fd0 0x7fa98c06aae0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:43.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa99392a640 1 --2- 172.21.15.45:0/1761168327 >> v2:172.21.15.79:3300/0 conn(0x7fa98c149960 0x7fa98c14cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:43.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa99392a640 1 -- 172.21.15.45:0/1761168327 >> 172.21.15.45:0/1761168327 conn(0x7fa98c0c2200 msgr2=0x7fa98c0bdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:43.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa99392a640 1 -- 172.21.15.45:0/1761168327 shutdown_connections 2023-10-03T19:19:43.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa99392a640 1 -- 172.21.15.45:0/1761168327 wait complete. 2023-10-03T19:19:43.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa99392a640 1 Processor -- start 2023-10-03T19:19:43.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa99392a640 1 -- start start 2023-10-03T19:19:43.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa99392a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa98c06b020 0x7fa98c0a4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:43.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa99392a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa98c0c0fd0 0x7fa98c147fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:43.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa99392a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa98c149960 0x7fa98c0a67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:43.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa99392a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c0a5930 con 0x7fa98c149960 2023-10-03T19:19:43.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa99392a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c148520 con 0x7fa98c06b020 2023-10-03T19:19:43.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa99392a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c0a4680 con 0x7fa98c0c0fd0 2023-10-03T19:19:43.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa991ec7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa98c149960 0x7fa98c0a67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:43.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa991ec7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa98c149960 0x7fa98c0a67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47806/0 (socket says 172.21.15.45:47806) 2023-10-03T19:19:43.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa991ec7640 1 -- 172.21.15.45:0/4070999088 learned_addr learned my addr 172.21.15.45:0/4070999088 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:43.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa9916c6640 1 --2- 172.21.15.45:0/4070999088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa98c06b020 0x7fa98c0a4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:43.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa990ec5640 1 --2- 172.21.15.45:0/4070999088 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa98c0c0fd0 0x7fa98c147fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:43.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa991ec7640 1 -- 172.21.15.45:0/4070999088 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa98c0c0fd0 msgr2=0x7fa98c147fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:43.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa991ec7640 1 --2- 172.21.15.45:0/4070999088 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa98c0c0fd0 0x7fa98c147fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:43.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa991ec7640 1 -- 172.21.15.45:0/4070999088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa98c06b020 msgr2=0x7fa98c0a4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:43.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa991ec7640 1 --2- 172.21.15.45:0/4070999088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa98c06b020 0x7fa98c0a4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:43.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa991ec7640 1 -- 172.21.15.45:0/4070999088 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa97c0094d0 con 0x7fa98c149960 2023-10-03T19:19:43.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa991ec7640 1 --2- 172.21.15.45:0/4070999088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa98c149960 0x7fa98c0a67b0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fa98400c3c0 tx=0x7fa98400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:43.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa981ffb640 1 -- 172.21.15.45:0/4070999088 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9840090d0 con 0x7fa98c149960 2023-10-03T19:19:43.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa981ffb640 1 -- 172.21.15.45:0/4070999088 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa984009230 con 0x7fa98c149960 2023-10-03T19:19:43.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa99392a640 1 -- 172.21.15.45:0/4070999088 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa98c149d30 con 0x7fa98c149960 2023-10-03T19:19:43.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa981ffb640 1 -- 172.21.15.45:0/4070999088 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9840095e0 con 0x7fa98c149960 2023-10-03T19:19:43.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.976+0000 7fa99392a640 1 -- 172.21.15.45:0/4070999088 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98c0c0bb0 con 0x7fa98c149960 2023-10-03T19:19:43.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.980+0000 7fa99392a640 1 -- 172.21.15.45:0/4070999088 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa98c150110 con 0x7fa98c149960 2023-10-03T19:19:43.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.980+0000 7fa981ffb640 1 -- 172.21.15.45:0/4070999088 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa984009740 con 0x7fa98c149960 2023-10-03T19:19:43.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.980+0000 7fa981ffb640 1 --2- 172.21.15.45:0/4070999088 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa970066280 0x7fa970068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:43.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.980+0000 7fa981ffb640 1 -- 172.21.15.45:0/4070999088 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa984086030 con 0x7fa98c149960 2023-10-03T19:19:43.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.980+0000 7fa9916c6640 1 --2- 172.21.15.45:0/4070999088 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa970066280 0x7fa970068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:43.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.980+0000 7fa9916c6640 1 --2- 172.21.15.45:0/4070999088 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa970066280 0x7fa970068730 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa98800b930 tx=0x7fa988008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:43.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:43.984+0000 7fa981ffb640 1 -- 172.21.15.45:0/4070999088 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa984053540 con 0x7fa98c149960 2023-10-03T19:19:44.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:44.136+0000 7fa99392a640 1 -- 172.21.15.45:0/4070999088 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa98c04de80 con 0x7fa970066280 2023-10-03T19:19:44.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:44.156+0000 7fa981ffb640 1 -- 172.21.15.45:0/4070999088 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308580 (secure 0 0 0) 0x7fa98c04de80 con 0x7fa970066280 2023-10-03T19:19:44.164 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:19:44.166 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:19:44.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:44.164+0000 7fa99392a640 1 -- 172.21.15.45:0/4070999088 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa970066280 msgr2=0x7fa970068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:44.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:44.164+0000 7fa99392a640 1 --2- 172.21.15.45:0/4070999088 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa970066280 0x7fa970068730 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa98800b930 tx=0x7fa988008040 comp rx=0 tx=0).stop 2023-10-03T19:19:44.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:44.164+0000 7fa99392a640 1 -- 172.21.15.45:0/4070999088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa98c149960 msgr2=0x7fa98c0a67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:44.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:44.164+0000 7fa99392a640 1 --2- 172.21.15.45:0/4070999088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa98c149960 0x7fa98c0a67b0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fa98400c3c0 tx=0x7fa98400c880 comp rx=0 tx=0).stop 2023-10-03T19:19:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:44.164+0000 7fa99392a640 1 -- 172.21.15.45:0/4070999088 shutdown_connections 2023-10-03T19:19:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:44.164+0000 7fa99392a640 1 --2- 172.21.15.45:0/4070999088 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa970066280 0x7fa970068730 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:44.164+0000 7fa99392a640 1 --2- 172.21.15.45:0/4070999088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa98c149960 0x7fa98c0a67b0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:44.164+0000 7fa99392a640 1 --2- 172.21.15.45:0/4070999088 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa98c0c0fd0 0x7fa98c147fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:44.164+0000 7fa99392a640 1 --2- 172.21.15.45:0/4070999088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa98c06b020 0x7fa98c0a4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:44.164+0000 7fa99392a640 1 -- 172.21.15.45:0/4070999088 >> 172.21.15.45:0/4070999088 conn(0x7fa98c0c2200 msgr2=0x7fa98c0bdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:44.164+0000 7fa99392a640 1 -- 172.21.15.45:0/4070999088 shutdown_connections 2023-10-03T19:19:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:44.164+0000 7fa99392a640 1 -- 172.21.15.45:0/4070999088 wait complete. 2023-10-03T19:19:44.184 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2023-10-03T19:19:42.600621+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":157,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244048,"kb_used_data":9488,"kb_used_omap":0,"kb_used_meta":234496,"kb_avail":754730672,"statfs":{"total":773094113280,"available":772844208128,"internally_reserved":0,"allocated":9715712,"data_stored":5546299,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":240123904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":69,"apply_latency_ms":69,"commit_latency_ns":69000000,"apply_latency_ns":69000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.559949"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.065677+0000","last_change":"2023-10-03T19:19:39.065677+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.065677+0000","last_undegraded":"2023-10-03T19:19:39.065677+0000","last_fullsized":"2023-10-03T19:19:39.065677+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678798+0000","last_change":"2023-10-03T19:19:39.501818+0000","last_active":"2023-10-03T19:19:40.678798+0000","last_peered":"2023-10-03T19:19:40.678798+0000","last_clean":"2023-10-03T19:19:40.678798+0000","last_became_active":"2023-10-03T19:19:39.501351+0000","last_became_peered":"2023-10-03T19:19:39.501351+0000","last_unstale":"2023-10-03T19:19:40.678798+0000","last_undegraded":"2023-10-03T19:19:40.678798+0000","last_fullsized":"2023-10-03T19:19:40.678798+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:35:21.301808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.062721+0000","last_change":"2023-10-03T19:19:39.062721+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.062721+0000","last_undegraded":"2023-10-03T19:19:39.062721+0000","last_fullsized":"2023-10-03T19:19:39.062721+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430029+0000","last_change":"2023-10-03T19:19:39.473749+0000","last_active":"2023-10-03T19:19:40.430029+0000","last_peered":"2023-10-03T19:19:40.430029+0000","last_clean":"2023-10-03T19:19:40.430029+0000","last_became_active":"2023-10-03T19:19:39.473432+0000","last_became_peered":"2023-10-03T19:19:39.473432+0000","last_unstale":"2023-10-03T19:19:40.430029+0000","last_undegraded":"2023-10-03T19:19:40.430029+0000","last_fullsized":"2023-10-03T19:19:40.430029+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:58:52.700889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175119+0000","last_change":"2023-10-03T19:19:39.473502+0000","last_active":"2023-10-03T19:19:41.175119+0000","last_peered":"2023-10-03T19:19:41.175119+0000","last_clean":"2023-10-03T19:19:41.175119+0000","last_became_active":"2023-10-03T19:19:39.473176+0000","last_became_peered":"2023-10-03T19:19:39.473176+0000","last_unstale":"2023-10-03T19:19:41.175119+0000","last_undegraded":"2023-10-03T19:19:41.175119+0000","last_fullsized":"2023-10-03T19:19:41.175119+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:47:23.957363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.677858+0000","last_change":"2023-10-03T19:19:39.491373+0000","last_active":"2023-10-03T19:19:40.677858+0000","last_peered":"2023-10-03T19:19:40.677858+0000","last_clean":"2023-10-03T19:19:40.677858+0000","last_became_active":"2023-10-03T19:19:39.490818+0000","last_became_peered":"2023-10-03T19:19:39.490818+0000","last_unstale":"2023-10-03T19:19:40.677858+0000","last_undegraded":"2023-10-03T19:19:40.677858+0000","last_fullsized":"2023-10-03T19:19:40.677858+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:59:41.953904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.677748+0000","last_change":"2023-10-03T19:19:39.497977+0000","last_active":"2023-10-03T19:19:40.677748+0000","last_peered":"2023-10-03T19:19:40.677748+0000","last_clean":"2023-10-03T19:19:40.677748+0000","last_became_active":"2023-10-03T19:19:39.497211+0000","last_became_peered":"2023-10-03T19:19:39.497211+0000","last_unstale":"2023-10-03T19:19:40.677748+0000","last_undegraded":"2023-10-03T19:19:40.677748+0000","last_fullsized":"2023-10-03T19:19:40.677748+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:15:08.226909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.172923+0000","last_change":"2023-10-03T19:19:39.450807+0000","last_active":"2023-10-03T19:19:41.172923+0000","last_peered":"2023-10-03T19:19:41.172923+0000","last_clean":"2023-10-03T19:19:41.172923+0000","last_became_active":"2023-10-03T19:19:39.450534+0000","last_became_peered":"2023-10-03T19:19:39.450534+0000","last_unstale":"2023-10-03T19:19:41.172923+0000","last_undegraded":"2023-10-03T19:19:41.172923+0000","last_fullsized":"2023-10-03T19:19:41.172923+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:15:38.079291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678801+0000","last_change":"2023-10-03T19:19:39.492468+0000","last_active":"2023-10-03T19:19:40.678801+0000","last_peered":"2023-10-03T19:19:40.678801+0000","last_clean":"2023-10-03T19:19:40.678801+0000","last_became_active":"2023-10-03T19:19:39.491727+0000","last_became_peered":"2023-10-03T19:19:39.491727+0000","last_unstale":"2023-10-03T19:19:40.678801+0000","last_undegraded":"2023-10-03T19:19:40.678801+0000","last_fullsized":"2023-10-03T19:19:40.678801+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:42:13.454493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176602+0000","last_change":"2023-10-03T19:19:39.498659+0000","last_active":"2023-10-03T19:19:41.176602+0000","last_peered":"2023-10-03T19:19:41.176602+0000","last_clean":"2023-10-03T19:19:41.176602+0000","last_became_active":"2023-10-03T19:19:39.498315+0000","last_became_peered":"2023-10-03T19:19:39.498315+0000","last_unstale":"2023-10-03T19:19:41.176602+0000","last_undegraded":"2023-10-03T19:19:41.176602+0000","last_fullsized":"2023-10-03T19:19:41.176602+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:34:42.126930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.067805+0000","last_change":"2023-10-03T19:19:39.067805+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.067805+0000","last_undegraded":"2023-10-03T19:19:39.067805+0000","last_fullsized":"2023-10-03T19:19:39.067805+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.440908+0000","last_change":"2023-10-03T19:19:39.455413+0000","last_active":"2023-10-03T19:19:40.440908+0000","last_peered":"2023-10-03T19:19:40.440908+0000","last_clean":"2023-10-03T19:19:40.440908+0000","last_became_active":"2023-10-03T19:19:39.454714+0000","last_became_peered":"2023-10-03T19:19:39.454714+0000","last_unstale":"2023-10-03T19:19:40.440908+0000","last_undegraded":"2023-10-03T19:19:40.440908+0000","last_fullsized":"2023-10-03T19:19:40.440908+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:27:14.179448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.429895+0000","last_change":"2023-10-03T19:19:39.466360+0000","last_active":"2023-10-03T19:19:40.429895+0000","last_peered":"2023-10-03T19:19:40.429895+0000","last_clean":"2023-10-03T19:19:40.429895+0000","last_became_active":"2023-10-03T19:19:39.466034+0000","last_became_peered":"2023-10-03T19:19:39.466034+0000","last_unstale":"2023-10-03T19:19:40.429895+0000","last_undegraded":"2023-10-03T19:19:40.429895+0000","last_fullsized":"2023-10-03T19:19:40.429895+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:17:57.802389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174860+0000","last_change":"2023-10-03T19:19:39.478735+0000","last_active":"2023-10-03T19:19:41.174860+0000","last_peered":"2023-10-03T19:19:41.174860+0000","last_clean":"2023-10-03T19:19:41.174860+0000","last_became_active":"2023-10-03T19:19:39.477842+0000","last_became_peered":"2023-10-03T19:19:39.477842+0000","last_unstale":"2023-10-03T19:19:41.174860+0000","last_undegraded":"2023-10-03T19:19:41.174860+0000","last_fullsized":"2023-10-03T19:19:41.174860+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:01:44.142532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174807+0000","last_change":"2023-10-03T19:19:39.493604+0000","last_active":"2023-10-03T19:19:41.174807+0000","last_peered":"2023-10-03T19:19:41.174807+0000","last_clean":"2023-10-03T19:19:41.174807+0000","last_became_active":"2023-10-03T19:19:39.488408+0000","last_became_peered":"2023-10-03T19:19:39.488408+0000","last_unstale":"2023-10-03T19:19:41.174807+0000","last_undegraded":"2023-10-03T19:19:41.174807+0000","last_fullsized":"2023-10-03T19:19:41.174807+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:54:40.452636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174925+0000","last_change":"2023-10-03T19:19:39.481769+0000","last_active":"2023-10-03T19:19:41.174925+0000","last_peered":"2023-10-03T19:19:41.174925+0000","last_clean":"2023-10-03T19:19:41.174925+0000","last_became_active":"2023-10-03T19:19:39.478997+0000","last_became_peered":"2023-10-03T19:19:39.478997+0000","last_unstale":"2023-10-03T19:19:41.174925+0000","last_undegraded":"2023-10-03T19:19:41.174925+0000","last_fullsized":"2023-10-03T19:19:41.174925+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:53:12.478710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.060759+0000","last_change":"2023-10-03T19:19:39.060759+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.060759+0000","last_undegraded":"2023-10-03T19:19:39.060759+0000","last_fullsized":"2023-10-03T19:19:39.060759+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.679023+0000","last_change":"2023-10-03T19:19:39.502839+0000","last_active":"2023-10-03T19:19:40.679023+0000","last_peered":"2023-10-03T19:19:40.679023+0000","last_clean":"2023-10-03T19:19:40.679023+0000","last_became_active":"2023-10-03T19:19:39.502343+0000","last_became_peered":"2023-10-03T19:19:39.502343+0000","last_unstale":"2023-10-03T19:19:40.679023+0000","last_undegraded":"2023-10-03T19:19:40.679023+0000","last_fullsized":"2023-10-03T19:19:40.679023+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:19:38.314320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.062240+0000","last_change":"2023-10-03T19:19:39.062240+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.062240+0000","last_undegraded":"2023-10-03T19:19:39.062240+0000","last_fullsized":"2023-10-03T19:19:39.062240+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.440839+0000","last_change":"2023-10-03T19:19:39.481255+0000","last_active":"2023-10-03T19:19:40.440839+0000","last_peered":"2023-10-03T19:19:40.440839+0000","last_clean":"2023-10-03T19:19:40.440839+0000","last_became_active":"2023-10-03T19:19:39.480541+0000","last_became_peered":"2023-10-03T19:19:39.480541+0000","last_unstale":"2023-10-03T19:19:40.440839+0000","last_undegraded":"2023-10-03T19:19:40.440839+0000","last_fullsized":"2023-10-03T19:19:40.440839+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:21:53.299603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173654+0000","last_change":"2023-10-03T19:19:39.467184+0000","last_active":"2023-10-03T19:19:41.173654+0000","last_peered":"2023-10-03T19:19:41.173654+0000","last_clean":"2023-10-03T19:19:41.173654+0000","last_became_active":"2023-10-03T19:19:39.466886+0000","last_became_peered":"2023-10-03T19:19:39.466886+0000","last_unstale":"2023-10-03T19:19:41.173654+0000","last_undegraded":"2023-10-03T19:19:41.173654+0000","last_fullsized":"2023-10-03T19:19:41.173654+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:22:29.033454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175260+0000","last_change":"2023-10-03T19:19:39.464591+0000","last_active":"2023-10-03T19:19:41.175260+0000","last_peered":"2023-10-03T19:19:41.175260+0000","last_clean":"2023-10-03T19:19:41.175260+0000","last_became_active":"2023-10-03T19:19:39.464263+0000","last_became_peered":"2023-10-03T19:19:39.464263+0000","last_unstale":"2023-10-03T19:19:41.175260+0000","last_undegraded":"2023-10-03T19:19:41.175260+0000","last_fullsized":"2023-10-03T19:19:41.175260+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:09:27.964791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.065582+0000","last_change":"2023-10-03T19:19:39.065582+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.065582+0000","last_undegraded":"2023-10-03T19:19:39.065582+0000","last_fullsized":"2023-10-03T19:19:39.065582+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174942+0000","last_change":"2023-10-03T19:19:39.439866+0000","last_active":"2023-10-03T19:19:41.174942+0000","last_peered":"2023-10-03T19:19:41.174942+0000","last_clean":"2023-10-03T19:19:41.174942+0000","last_became_active":"2023-10-03T19:19:39.439632+0000","last_became_peered":"2023-10-03T19:19:39.439632+0000","last_unstale":"2023-10-03T19:19:41.174942+0000","last_undegraded":"2023-10-03T19:19:41.174942+0000","last_fullsized":"2023-10-03T19:19:41.174942+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:15:44.398741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.441232+0000","last_change":"2023-10-03T19:19:39.470183+0000","last_active":"2023-10-03T19:19:40.441232+0000","last_peered":"2023-10-03T19:19:40.441232+0000","last_clean":"2023-10-03T19:19:40.441232+0000","last_became_active":"2023-10-03T19:19:39.469452+0000","last_became_peered":"2023-10-03T19:19:39.469452+0000","last_unstale":"2023-10-03T19:19:40.441232+0000","last_undegraded":"2023-10-03T19:19:40.441232+0000","last_fullsized":"2023-10-03T19:19:40.441232+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:01:20.873119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.441025+0000","last_change":"2023-10-03T19:19:39.503465+0000","last_active":"2023-10-03T19:19:40.441025+0000","last_peered":"2023-10-03T19:19:40.441025+0000","last_clean":"2023-10-03T19:19:40.441025+0000","last_became_active":"2023-10-03T19:19:39.503030+0000","last_became_peered":"2023-10-03T19:19:39.503030+0000","last_unstale":"2023-10-03T19:19:40.441025+0000","last_undegraded":"2023-10-03T19:19:40.441025+0000","last_fullsized":"2023-10-03T19:19:40.441025+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:43:46.831754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.066584+0000","last_change":"2023-10-03T19:19:39.066584+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.066584+0000","last_undegraded":"2023-10-03T19:19:39.066584+0000","last_fullsized":"2023-10-03T19:19:39.066584+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678338+0000","last_change":"2023-10-03T19:19:39.498786+0000","last_active":"2023-10-03T19:19:40.678338+0000","last_peered":"2023-10-03T19:19:40.678338+0000","last_clean":"2023-10-03T19:19:40.678338+0000","last_became_active":"2023-10-03T19:19:39.498287+0000","last_became_peered":"2023-10-03T19:19:39.498287+0000","last_unstale":"2023-10-03T19:19:40.678338+0000","last_undegraded":"2023-10-03T19:19:40.678338+0000","last_fullsized":"2023-10-03T19:19:40.678338+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:01:20.873119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173840+0000","last_change":"2023-10-03T19:19:39.474176+0000","last_active":"2023-10-03T19:19:41.173840+0000","last_peered":"2023-10-03T19:19:41.173840+0000","last_clean":"2023-10-03T19:19:41.173840+0000","last_became_active":"2023-10-03T19:19:39.473801+0000","last_became_peered":"2023-10-03T19:19:39.473801+0000","last_unstale":"2023-10-03T19:19:41.173840+0000","last_undegraded":"2023-10-03T19:19:41.173840+0000","last_fullsized":"2023-10-03T19:19:41.173840+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:16:06.684976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.440240+0000","last_change":"2023-10-03T19:19:39.453506+0000","last_active":"2023-10-03T19:19:40.440240+0000","last_peered":"2023-10-03T19:19:40.440240+0000","last_clean":"2023-10-03T19:19:40.440240+0000","last_became_active":"2023-10-03T19:19:39.452767+0000","last_became_peered":"2023-10-03T19:19:39.452767+0000","last_unstale":"2023-10-03T19:19:40.440240+0000","last_undegraded":"2023-10-03T19:19:40.440240+0000","last_fullsized":"2023-10-03T19:19:40.440240+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:58:52.700889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.677767+0000","last_change":"2023-10-03T19:19:39.501965+0000","last_active":"2023-10-03T19:19:40.677767+0000","last_peered":"2023-10-03T19:19:40.677767+0000","last_clean":"2023-10-03T19:19:40.677767+0000","last_became_active":"2023-10-03T19:19:39.501258+0000","last_became_peered":"2023-10-03T19:19:39.501258+0000","last_unstale":"2023-10-03T19:19:40.677767+0000","last_undegraded":"2023-10-03T19:19:40.677767+0000","last_fullsized":"2023-10-03T19:19:40.677767+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:36:34.926440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.172931+0000","last_change":"2023-10-03T19:19:39.476006+0000","last_active":"2023-10-03T19:19:41.172931+0000","last_peered":"2023-10-03T19:19:41.172931+0000","last_clean":"2023-10-03T19:19:41.172931+0000","last_became_active":"2023-10-03T19:19:39.475740+0000","last_became_peered":"2023-10-03T19:19:39.475740+0000","last_unstale":"2023-10-03T19:19:41.172931+0000","last_undegraded":"2023-10-03T19:19:41.172931+0000","last_fullsized":"2023-10-03T19:19:41.172931+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:38:59.311703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.057503+0000","last_change":"2023-10-03T19:19:39.057503+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.057503+0000","last_undegraded":"2023-10-03T19:19:39.057503+0000","last_fullsized":"2023-10-03T19:19:39.057503+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"97'4","reported_seq":17,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430274+0000","last_change":"2023-10-03T19:19:39.100745+0000","last_active":"2023-10-03T19:19:40.430274+0000","last_peered":"2023-10-03T19:19:40.430274+0000","last_clean":"2023-10-03T19:19:40.430274+0000","last_became_active":"2023-10-03T19:19:39.100413+0000","last_became_peered":"2023-10-03T19:19:39.100413+0000","last_unstale":"2023-10-03T19:19:40.430274+0000","last_undegraded":"2023-10-03T19:19:40.430274+0000","last_fullsized":"2023-10-03T19:19:40.430274+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:21:52.286906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173119+0000","last_change":"2023-10-03T19:19:39.450049+0000","last_active":"2023-10-03T19:19:41.173119+0000","last_peered":"2023-10-03T19:19:41.173119+0000","last_clean":"2023-10-03T19:19:41.173119+0000","last_became_active":"2023-10-03T19:19:39.449771+0000","last_became_peered":"2023-10-03T19:19:39.449771+0000","last_unstale":"2023-10-03T19:19:41.173119+0000","last_undegraded":"2023-10-03T19:19:41.173119+0000","last_fullsized":"2023-10-03T19:19:41.173119+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:14:44.212951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174434+0000","last_change":"2023-10-03T19:19:39.081942+0000","last_active":"2023-10-03T19:19:41.174434+0000","last_peered":"2023-10-03T19:19:41.174434+0000","last_clean":"2023-10-03T19:19:41.174434+0000","last_became_active":"2023-10-03T19:19:39.081434+0000","last_became_peered":"2023-10-03T19:19:39.081434+0000","last_unstale":"2023-10-03T19:19:41.174434+0000","last_undegraded":"2023-10-03T19:19:41.174434+0000","last_fullsized":"2023-10-03T19:19:41.174434+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:44:38.934350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.440288+0000","last_change":"2023-10-03T19:19:39.456943+0000","last_active":"2023-10-03T19:19:40.440288+0000","last_peered":"2023-10-03T19:19:40.440288+0000","last_clean":"2023-10-03T19:19:40.440288+0000","last_became_active":"2023-10-03T19:19:39.456206+0000","last_became_peered":"2023-10-03T19:19:39.456206+0000","last_unstale":"2023-10-03T19:19:40.440288+0000","last_undegraded":"2023-10-03T19:19:40.440288+0000","last_fullsized":"2023-10-03T19:19:40.440288+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:15:08.226909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.440781+0000","last_change":"2023-10-03T19:19:39.098618+0000","last_active":"2023-10-03T19:19:40.440781+0000","last_peered":"2023-10-03T19:19:40.440781+0000","last_clean":"2023-10-03T19:19:40.440781+0000","last_became_active":"2023-10-03T19:19:39.097892+0000","last_became_peered":"2023-10-03T19:19:39.097892+0000","last_unstale":"2023-10-03T19:19:40.440781+0000","last_undegraded":"2023-10-03T19:19:40.440781+0000","last_fullsized":"2023-10-03T19:19:40.440781+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:59:40.941206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.063100+0000","last_change":"2023-10-03T19:19:39.063100+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.063100+0000","last_undegraded":"2023-10-03T19:19:39.063100+0000","last_fullsized":"2023-10-03T19:19:39.063100+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176094+0000","last_change":"2023-10-03T19:19:39.084901+0000","last_active":"2023-10-03T19:19:41.176094+0000","last_peered":"2023-10-03T19:19:41.176094+0000","last_clean":"2023-10-03T19:19:41.176094+0000","last_became_active":"2023-10-03T19:19:39.084399+0000","last_became_peered":"2023-10-03T19:19:39.084399+0000","last_unstale":"2023-10-03T19:19:41.176094+0000","last_undegraded":"2023-10-03T19:19:41.176094+0000","last_fullsized":"2023-10-03T19:19:41.176094+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:37:52.382988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430110+0000","last_change":"2023-10-03T19:19:39.440443+0000","last_active":"2023-10-03T19:19:40.430110+0000","last_peered":"2023-10-03T19:19:40.430110+0000","last_clean":"2023-10-03T19:19:40.430110+0000","last_became_active":"2023-10-03T19:19:39.439566+0000","last_became_peered":"2023-10-03T19:19:39.439566+0000","last_unstale":"2023-10-03T19:19:40.430110+0000","last_undegraded":"2023-10-03T19:19:40.430110+0000","last_fullsized":"2023-10-03T19:19:40.430110+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:36:34.926440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175160+0000","last_change":"2023-10-03T19:19:39.105651+0000","last_active":"2023-10-03T19:19:41.175160+0000","last_peered":"2023-10-03T19:19:41.175160+0000","last_clean":"2023-10-03T19:19:41.175160+0000","last_became_active":"2023-10-03T19:19:39.105103+0000","last_became_peered":"2023-10-03T19:19:39.105103+0000","last_unstale":"2023-10-03T19:19:41.175160+0000","last_undegraded":"2023-10-03T19:19:41.175160+0000","last_fullsized":"2023-10-03T19:19:41.175160+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:01:43.169147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.057672+0000","last_change":"2023-10-03T19:19:39.057672+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.057672+0000","last_undegraded":"2023-10-03T19:19:39.057672+0000","last_fullsized":"2023-10-03T19:19:39.057672+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-03T19:19:39.107764+0000","last_change":"2023-10-03T19:19:39.097877+0000","last_active":"2023-10-03T19:19:39.107764+0000","last_peered":"2023-10-03T19:19:39.107764+0000","last_clean":"2023-10-03T19:19:39.107764+0000","last_became_active":"2023-10-03T19:19:39.097351+0000","last_became_peered":"2023-10-03T19:19:39.097351+0000","last_unstale":"2023-10-03T19:19:39.107764+0000","last_undegraded":"2023-10-03T19:19:39.107764+0000","last_fullsized":"2023-10-03T19:19:39.107764+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:28:16.875405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678996+0000","last_change":"2023-10-03T19:19:39.501897+0000","last_active":"2023-10-03T19:19:40.678996+0000","last_peered":"2023-10-03T19:19:40.678996+0000","last_clean":"2023-10-03T19:19:40.678996+0000","last_became_active":"2023-10-03T19:19:39.501378+0000","last_became_peered":"2023-10-03T19:19:39.501378+0000","last_unstale":"2023-10-03T19:19:40.678996+0000","last_undegraded":"2023-10-03T19:19:40.678996+0000","last_fullsized":"2023-10-03T19:19:40.678996+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:03:04.699024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.439627+0000","last_change":"2023-10-03T19:19:39.098321+0000","last_active":"2023-10-03T19:19:40.439627+0000","last_peered":"2023-10-03T19:19:40.439627+0000","last_clean":"2023-10-03T19:19:40.439627+0000","last_became_active":"2023-10-03T19:19:39.097705+0000","last_became_peered":"2023-10-03T19:19:39.097705+0000","last_unstale":"2023-10-03T19:19:40.439627+0000","last_undegraded":"2023-10-03T19:19:40.439627+0000","last_fullsized":"2023-10-03T19:19:40.439627+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:24:26.530146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430181+0000","last_change":"2023-10-03T19:19:39.443896+0000","last_active":"2023-10-03T19:19:40.430181+0000","last_peered":"2023-10-03T19:19:40.430181+0000","last_clean":"2023-10-03T19:19:40.430181+0000","last_became_active":"2023-10-03T19:19:39.443185+0000","last_became_peered":"2023-10-03T19:19:39.443185+0000","last_unstale":"2023-10-03T19:19:40.430181+0000","last_undegraded":"2023-10-03T19:19:40.430181+0000","last_fullsized":"2023-10-03T19:19:40.430181+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:59:41.953904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430269+0000","last_change":"2023-10-03T19:19:39.076525+0000","last_active":"2023-10-03T19:19:40.430269+0000","last_peered":"2023-10-03T19:19:40.430269+0000","last_clean":"2023-10-03T19:19:40.430269+0000","last_became_active":"2023-10-03T19:19:39.076125+0000","last_became_peered":"2023-10-03T19:19:39.076125+0000","last_unstale":"2023-10-03T19:19:40.430269+0000","last_undegraded":"2023-10-03T19:19:40.430269+0000","last_fullsized":"2023-10-03T19:19:40.430269+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:27:13.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.064978+0000","last_change":"2023-10-03T19:19:39.064978+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.064978+0000","last_undegraded":"2023-10-03T19:19:39.064978+0000","last_fullsized":"2023-10-03T19:19:39.064978+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.441233+0000","last_change":"2023-10-03T19:19:39.100517+0000","last_active":"2023-10-03T19:19:40.441233+0000","last_peered":"2023-10-03T19:19:40.441233+0000","last_clean":"2023-10-03T19:19:40.441233+0000","last_became_active":"2023-10-03T19:19:39.100003+0000","last_became_peered":"2023-10-03T19:19:39.100003+0000","last_unstale":"2023-10-03T19:19:40.441233+0000","last_undegraded":"2023-10-03T19:19:40.441233+0000","last_fullsized":"2023-10-03T19:19:40.441233+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:02:39.250284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175315+0000","last_change":"2023-10-03T19:19:39.445323+0000","last_active":"2023-10-03T19:19:41.175315+0000","last_peered":"2023-10-03T19:19:41.175315+0000","last_clean":"2023-10-03T19:19:41.175315+0000","last_became_active":"2023-10-03T19:19:39.445022+0000","last_became_peered":"2023-10-03T19:19:39.445022+0000","last_unstale":"2023-10-03T19:19:41.175315+0000","last_undegraded":"2023-10-03T19:19:41.175315+0000","last_fullsized":"2023-10-03T19:19:41.175315+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:14:23.979238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-03T19:19:39.077168+0000","last_change":"2023-10-03T19:19:39.075931+0000","last_active":"2023-10-03T19:19:39.077168+0000","last_peered":"2023-10-03T19:19:39.077168+0000","last_clean":"2023-10-03T19:19:39.077168+0000","last_became_active":"2023-10-03T19:19:39.075609+0000","last_became_peered":"2023-10-03T19:19:39.075609+0000","last_unstale":"2023-10-03T19:19:39.077168+0000","last_undegraded":"2023-10-03T19:19:39.077168+0000","last_fullsized":"2023-10-03T19:19:39.077168+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:28:50.042403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173596+0000","last_change":"2023-10-03T19:19:39.450085+0000","last_active":"2023-10-03T19:19:41.173596+0000","last_peered":"2023-10-03T19:19:41.173596+0000","last_clean":"2023-10-03T19:19:41.173596+0000","last_became_active":"2023-10-03T19:19:39.449720+0000","last_became_peered":"2023-10-03T19:19:39.449720+0000","last_unstale":"2023-10-03T19:19:41.173596+0000","last_undegraded":"2023-10-03T19:19:41.173596+0000","last_fullsized":"2023-10-03T19:19:41.173596+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:07:03.874445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"97'3","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175361+0000","last_change":"2023-10-03T19:19:39.083465+0000","last_active":"2023-10-03T19:19:41.175361+0000","last_peered":"2023-10-03T19:19:41.175361+0000","last_clean":"2023-10-03T19:19:41.175361+0000","last_became_active":"2023-10-03T19:19:39.082723+0000","last_became_peered":"2023-10-03T19:19:39.082723+0000","last_unstale":"2023-10-03T19:19:41.175361+0000","last_undegraded":"2023-10-03T19:19:41.175361+0000","last_fullsized":"2023-10-03T19:19:41.175361+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:45:27.547248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175742+0000","last_change":"2023-10-03T19:19:39.446159+0000","last_active":"2023-10-03T19:19:41.175742+0000","last_peered":"2023-10-03T19:19:41.175742+0000","last_clean":"2023-10-03T19:19:41.175742+0000","last_became_active":"2023-10-03T19:19:39.445909+0000","last_became_peered":"2023-10-03T19:19:39.445909+0000","last_unstale":"2023-10-03T19:19:41.175742+0000","last_undegraded":"2023-10-03T19:19:41.175742+0000","last_fullsized":"2023-10-03T19:19:41.175742+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:27:32.906536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"97'6","reported_seq":19,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678541+0000","last_change":"2023-10-03T19:19:39.092215+0000","last_active":"2023-10-03T19:19:40.678541+0000","last_peered":"2023-10-03T19:19:40.678541+0000","last_clean":"2023-10-03T19:19:40.678541+0000","last_became_active":"2023-10-03T19:19:39.085602+0000","last_became_peered":"2023-10-03T19:19:39.085602+0000","last_unstale":"2023-10-03T19:19:40.678541+0000","last_undegraded":"2023-10-03T19:19:40.678541+0000","last_fullsized":"2023-10-03T19:19:40.678541+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:02:39.250284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.064062+0000","last_change":"2023-10-03T19:19:39.064062+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.064062+0000","last_undegraded":"2023-10-03T19:19:39.064062+0000","last_fullsized":"2023-10-03T19:19:39.064062+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176071+0000","last_change":"2023-10-03T19:19:39.081438+0000","last_active":"2023-10-03T19:19:41.176071+0000","last_peered":"2023-10-03T19:19:41.176071+0000","last_clean":"2023-10-03T19:19:41.176071+0000","last_became_active":"2023-10-03T19:19:39.081161+0000","last_became_peered":"2023-10-03T19:19:39.081161+0000","last_unstale":"2023-10-03T19:19:41.176071+0000","last_undegraded":"2023-10-03T19:19:41.176071+0000","last_fullsized":"2023-10-03T19:19:41.176071+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:33:20.709972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678584+0000","last_change":"2023-10-03T19:19:39.492226+0000","last_active":"2023-10-03T19:19:40.678584+0000","last_peered":"2023-10-03T19:19:40.678584+0000","last_clean":"2023-10-03T19:19:40.678584+0000","last_became_active":"2023-10-03T19:19:39.491322+0000","last_became_peered":"2023-10-03T19:19:39.491322+0000","last_unstale":"2023-10-03T19:19:40.678584+0000","last_undegraded":"2023-10-03T19:19:40.678584+0000","last_fullsized":"2023-10-03T19:19:40.678584+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:17:18.221489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430104+0000","last_change":"2023-10-03T19:19:39.077931+0000","last_active":"2023-10-03T19:19:40.430104+0000","last_peered":"2023-10-03T19:19:40.430104+0000","last_clean":"2023-10-03T19:19:40.430104+0000","last_became_active":"2023-10-03T19:19:39.077342+0000","last_became_peered":"2023-10-03T19:19:39.077342+0000","last_unstale":"2023-10-03T19:19:40.430104+0000","last_undegraded":"2023-10-03T19:19:40.430104+0000","last_fullsized":"2023-10-03T19:19:40.430104+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:15:07.214211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174038+0000","last_change":"2023-10-03T19:19:39.476040+0000","last_active":"2023-10-03T19:19:41.174038+0000","last_peered":"2023-10-03T19:19:41.174038+0000","last_clean":"2023-10-03T19:19:41.174038+0000","last_became_active":"2023-10-03T19:19:39.475802+0000","last_became_peered":"2023-10-03T19:19:39.475802+0000","last_unstale":"2023-10-03T19:19:41.174038+0000","last_undegraded":"2023-10-03T19:19:41.174038+0000","last_fullsized":"2023-10-03T19:19:41.174038+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:49:54.029650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173284+0000","last_change":"2023-10-03T19:19:39.084666+0000","last_active":"2023-10-03T19:19:41.173284+0000","last_peered":"2023-10-03T19:19:41.173284+0000","last_clean":"2023-10-03T19:19:41.173284+0000","last_became_active":"2023-10-03T19:19:39.084383+0000","last_became_peered":"2023-10-03T19:19:39.084383+0000","last_unstale":"2023-10-03T19:19:41.173284+0000","last_undegraded":"2023-10-03T19:19:41.173284+0000","last_fullsized":"2023-10-03T19:19:41.173284+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:56:48.966597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.060292+0000","last_change":"2023-10-03T19:19:39.060292+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.060292+0000","last_undegraded":"2023-10-03T19:19:39.060292+0000","last_fullsized":"2023-10-03T19:19:39.060292+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"97'8","reported_seq":21,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.439804+0000","last_change":"2023-10-03T19:19:39.099722+0000","last_active":"2023-10-03T19:19:40.439804+0000","last_peered":"2023-10-03T19:19:40.439804+0000","last_clean":"2023-10-03T19:19:40.439804+0000","last_became_active":"2023-10-03T19:19:39.099110+0000","last_became_peered":"2023-10-03T19:19:39.099110+0000","last_unstale":"2023-10-03T19:19:40.439804+0000","last_undegraded":"2023-10-03T19:19:40.439804+0000","last_fullsized":"2023-10-03T19:19:40.439804+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:24:20.639774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.065787+0000","last_change":"2023-10-03T19:19:39.065787+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.065787+0000","last_undegraded":"2023-10-03T19:19:39.065787+0000","last_fullsized":"2023-10-03T19:19:39.065787+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176623+0000","last_change":"2023-10-03T19:19:39.078321+0000","last_active":"2023-10-03T19:19:41.176623+0000","last_peered":"2023-10-03T19:19:41.176623+0000","last_clean":"2023-10-03T19:19:41.176623+0000","last_became_active":"2023-10-03T19:19:39.078000+0000","last_became_peered":"2023-10-03T19:19:39.078000+0000","last_unstale":"2023-10-03T19:19:41.176623+0000","last_undegraded":"2023-10-03T19:19:41.176623+0000","last_fullsized":"2023-10-03T19:19:41.176623+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:42:42.684913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.439742+0000","last_change":"2023-10-03T19:19:39.453941+0000","last_active":"2023-10-03T19:19:40.439742+0000","last_peered":"2023-10-03T19:19:40.439742+0000","last_clean":"2023-10-03T19:19:40.439742+0000","last_became_active":"2023-10-03T19:19:39.453189+0000","last_became_peered":"2023-10-03T19:19:39.453189+0000","last_unstale":"2023-10-03T19:19:40.439742+0000","last_undegraded":"2023-10-03T19:19:40.439742+0000","last_fullsized":"2023-10-03T19:19:40.439742+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:17:57.802389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-03T19:19:39.096207+0000","last_change":"2023-10-03T19:19:39.095166+0000","last_active":"2023-10-03T19:19:39.096207+0000","last_peered":"2023-10-03T19:19:39.096207+0000","last_clean":"2023-10-03T19:19:39.096207+0000","last_became_active":"2023-10-03T19:19:39.094914+0000","last_became_peered":"2023-10-03T19:19:39.094914+0000","last_unstale":"2023-10-03T19:19:39.096207+0000","last_undegraded":"2023-10-03T19:19:39.096207+0000","last_fullsized":"2023-10-03T19:19:39.096207+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:07:54.333264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430357+0000","last_change":"2023-10-03T19:19:39.498605+0000","last_active":"2023-10-03T19:19:40.430357+0000","last_peered":"2023-10-03T19:19:40.430357+0000","last_clean":"2023-10-03T19:19:40.430357+0000","last_became_active":"2023-10-03T19:19:39.498286+0000","last_became_peered":"2023-10-03T19:19:39.498286+0000","last_unstale":"2023-10-03T19:19:40.430357+0000","last_undegraded":"2023-10-03T19:19:40.430357+0000","last_fullsized":"2023-10-03T19:19:40.430357+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:43:46.831754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678665+0000","last_change":"2023-10-03T19:19:39.093647+0000","last_active":"2023-10-03T19:19:40.678665+0000","last_peered":"2023-10-03T19:19:40.678665+0000","last_clean":"2023-10-03T19:19:40.678665+0000","last_became_active":"2023-10-03T19:19:39.093121+0000","last_became_peered":"2023-10-03T19:19:39.093121+0000","last_unstale":"2023-10-03T19:19:40.678665+0000","last_undegraded":"2023-10-03T19:19:40.678665+0000","last_fullsized":"2023-10-03T19:19:40.678665+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:09:28.979796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.064384+0000","last_change":"2023-10-03T19:19:39.064384+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.064384+0000","last_undegraded":"2023-10-03T19:19:39.064384+0000","last_fullsized":"2023-10-03T19:19:39.064384+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176007+0000","last_change":"2023-10-03T19:19:39.100292+0000","last_active":"2023-10-03T19:19:41.176007+0000","last_peered":"2023-10-03T19:19:41.176007+0000","last_clean":"2023-10-03T19:19:41.176007+0000","last_became_active":"2023-10-03T19:19:39.100004+0000","last_became_peered":"2023-10-03T19:19:39.100004+0000","last_unstale":"2023-10-03T19:19:41.176007+0000","last_undegraded":"2023-10-03T19:19:41.176007+0000","last_fullsized":"2023-10-03T19:19:41.176007+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:32:48.746616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174005+0000","last_change":"2023-10-03T19:19:39.450670+0000","last_active":"2023-10-03T19:19:41.174005+0000","last_peered":"2023-10-03T19:19:41.174005+0000","last_clean":"2023-10-03T19:19:41.174005+0000","last_became_active":"2023-10-03T19:19:39.450363+0000","last_became_peered":"2023-10-03T19:19:39.450363+0000","last_unstale":"2023-10-03T19:19:41.174005+0000","last_undegraded":"2023-10-03T19:19:41.174005+0000","last_fullsized":"2023-10-03T19:19:41.174005+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:38:52.937448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.440652+0000","last_change":"2023-10-03T19:19:39.093626+0000","last_active":"2023-10-03T19:19:40.440652+0000","last_peered":"2023-10-03T19:19:40.440652+0000","last_clean":"2023-10-03T19:19:40.440652+0000","last_became_active":"2023-10-03T19:19:39.093048+0000","last_became_peered":"2023-10-03T19:19:39.093048+0000","last_unstale":"2023-10-03T19:19:40.440652+0000","last_undegraded":"2023-10-03T19:19:40.440652+0000","last_fullsized":"2023-10-03T19:19:40.440652+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:36:33.913742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174002+0000","last_change":"2023-10-03T19:19:39.451443+0000","last_active":"2023-10-03T19:19:41.174002+0000","last_peered":"2023-10-03T19:19:41.174002+0000","last_clean":"2023-10-03T19:19:41.174002+0000","last_became_active":"2023-10-03T19:19:39.451178+0000","last_became_peered":"2023-10-03T19:19:39.451178+0000","last_unstale":"2023-10-03T19:19:41.174002+0000","last_undegraded":"2023-10-03T19:19:41.174002+0000","last_fullsized":"2023-10-03T19:19:41.174002+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:23:35.520091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173972+0000","last_change":"2023-10-03T19:19:39.085006+0000","last_active":"2023-10-03T19:19:41.173972+0000","last_peered":"2023-10-03T19:19:41.173972+0000","last_clean":"2023-10-03T19:19:41.173972+0000","last_became_active":"2023-10-03T19:19:39.084520+0000","last_became_peered":"2023-10-03T19:19:39.084520+0000","last_unstale":"2023-10-03T19:19:41.173972+0000","last_undegraded":"2023-10-03T19:19:41.173972+0000","last_fullsized":"2023-10-03T19:19:41.173972+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:32:44.644764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175389+0000","last_change":"2023-10-03T19:19:39.490667+0000","last_active":"2023-10-03T19:19:41.175389+0000","last_peered":"2023-10-03T19:19:41.175389+0000","last_clean":"2023-10-03T19:19:41.175389+0000","last_became_active":"2023-10-03T19:19:39.489883+0000","last_became_peered":"2023-10-03T19:19:39.489883+0000","last_unstale":"2023-10-03T19:19:41.175389+0000","last_undegraded":"2023-10-03T19:19:41.175389+0000","last_fullsized":"2023-10-03T19:19:41.175389+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:47:44.558983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678162+0000","last_change":"2023-10-03T19:19:39.093636+0000","last_active":"2023-10-03T19:19:40.678162+0000","last_peered":"2023-10-03T19:19:40.678162+0000","last_clean":"2023-10-03T19:19:40.678162+0000","last_became_active":"2023-10-03T19:19:39.093026+0000","last_became_peered":"2023-10-03T19:19:39.093026+0000","last_unstale":"2023-10-03T19:19:40.678162+0000","last_undegraded":"2023-10-03T19:19:40.678162+0000","last_fullsized":"2023-10-03T19:19:40.678162+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:43:45.819056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.067174+0000","last_change":"2023-10-03T19:19:39.067174+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.067174+0000","last_undegraded":"2023-10-03T19:19:39.067174+0000","last_fullsized":"2023-10-03T19:19:39.067174+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173694+0000","last_change":"2023-10-03T19:19:39.087025+0000","last_active":"2023-10-03T19:19:41.173694+0000","last_peered":"2023-10-03T19:19:41.173694+0000","last_clean":"2023-10-03T19:19:41.173694+0000","last_became_active":"2023-10-03T19:19:39.086598+0000","last_became_peered":"2023-10-03T19:19:39.086598+0000","last_unstale":"2023-10-03T19:19:41.173694+0000","last_undegraded":"2023-10-03T19:19:41.173694+0000","last_fullsized":"2023-10-03T19:19:41.173694+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:39:18.515681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.064555+0000","last_change":"2023-10-03T19:19:39.064555+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.064555+0000","last_undegraded":"2023-10-03T19:19:39.064555+0000","last_fullsized":"2023-10-03T19:19:39.064555+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174434+0000","last_change":"2023-10-03T19:19:39.077632+0000","last_active":"2023-10-03T19:19:41.174434+0000","last_peered":"2023-10-03T19:19:41.174434+0000","last_clean":"2023-10-03T19:19:41.174434+0000","last_became_active":"2023-10-03T19:19:39.077243+0000","last_became_peered":"2023-10-03T19:19:39.077243+0000","last_unstale":"2023-10-03T19:19:41.174434+0000","last_undegraded":"2023-10-03T19:19:41.174434+0000","last_fullsized":"2023-10-03T19:19:41.174434+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:11:33.305806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":316,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175066+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:19:41.175066+0000","last_peered":"2023-10-03T19:19:41.175066+0000","last_clean":"2023-10-03T19:19:41.175066+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:19:41.175066+0000","last_undegraded":"2023-10-03T19:19:41.175066+0000","last_fullsized":"2023-10-03T19:19:41.175066+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:01:58.556394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":156,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-03T19:19:39.078949+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:19:39.078949+0000","last_peered":"2023-10-03T19:19:39.078949+0000","last_clean":"2023-10-03T19:19:39.078949+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:19:39.078949+0000","last_undegraded":"2023-10-03T19:19:39.078949+0000","last_fullsized":"2023-10-03T19:19:39.078949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:51:45.180638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.677990+0000","last_change":"2023-10-03T19:19:39.490296+0000","last_active":"2023-10-03T19:19:40.677990+0000","last_peered":"2023-10-03T19:19:40.677990+0000","last_clean":"2023-10-03T19:19:40.677990+0000","last_became_active":"2023-10-03T19:19:39.489715+0000","last_became_peered":"2023-10-03T19:19:39.489715+0000","last_unstale":"2023-10-03T19:19:40.677990+0000","last_undegraded":"2023-10-03T19:19:40.677990+0000","last_fullsized":"2023-10-03T19:19:40.677990+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:21:53.299603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175437+0000","last_change":"2023-10-03T19:19:39.092502+0000","last_active":"2023-10-03T19:19:41.175437+0000","last_peered":"2023-10-03T19:19:41.175437+0000","last_clean":"2023-10-03T19:19:41.175437+0000","last_became_active":"2023-10-03T19:19:39.091671+0000","last_became_peered":"2023-10-03T19:19:39.091671+0000","last_unstale":"2023-10-03T19:19:41.175437+0000","last_undegraded":"2023-10-03T19:19:41.175437+0000","last_fullsized":"2023-10-03T19:19:41.175437+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:28:58.772881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":164,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174651+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:19:41.174651+0000","last_peered":"2023-10-03T19:19:41.174651+0000","last_clean":"2023-10-03T19:19:41.174651+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:19:41.174651+0000","last_undegraded":"2023-10-03T19:19:41.174651+0000","last_fullsized":"2023-10-03T19:19:41.174651+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:28:06.684655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175720+0000","last_change":"2023-10-03T19:19:39.474081+0000","last_active":"2023-10-03T19:19:41.175720+0000","last_peered":"2023-10-03T19:19:41.175720+0000","last_clean":"2023-10-03T19:19:41.175720+0000","last_became_active":"2023-10-03T19:19:39.473795+0000","last_became_peered":"2023-10-03T19:19:39.473795+0000","last_unstale":"2023-10-03T19:19:41.175720+0000","last_undegraded":"2023-10-03T19:19:41.175720+0000","last_fullsized":"2023-10-03T19:19:41.175720+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:50:56.639365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-03T19:19:39.107801+0000","last_change":"2023-10-03T19:19:39.097664+0000","last_active":"2023-10-03T19:19:39.107801+0000","last_peered":"2023-10-03T19:19:39.107801+0000","last_clean":"2023-10-03T19:19:39.107801+0000","last_became_active":"2023-10-03T19:19:39.097135+0000","last_became_peered":"2023-10-03T19:19:39.097135+0000","last_unstale":"2023-10-03T19:19:39.107801+0000","last_undegraded":"2023-10-03T19:19:39.107801+0000","last_fullsized":"2023-10-03T19:19:39.107801+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:07:06.406878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173371+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:19:41.173371+0000","last_peered":"2023-10-03T19:19:41.173371+0000","last_clean":"2023-10-03T19:19:41.173371+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:19:41.173371+0000","last_undegraded":"2023-10-03T19:19:41.173371+0000","last_fullsized":"2023-10-03T19:19:41.173371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:50:13.204633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173376+0000","last_change":"2023-10-03T19:19:39.445108+0000","last_active":"2023-10-03T19:19:41.173376+0000","last_peered":"2023-10-03T19:19:41.173376+0000","last_clean":"2023-10-03T19:19:41.173376+0000","last_became_active":"2023-10-03T19:19:39.443964+0000","last_became_peered":"2023-10-03T19:19:39.443964+0000","last_unstale":"2023-10-03T19:19:41.173376+0000","last_undegraded":"2023-10-03T19:19:41.173376+0000","last_fullsized":"2023-10-03T19:19:41.173376+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:50:29.706153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678974+0000","last_change":"2023-10-03T19:19:39.099820+0000","last_active":"2023-10-03T19:19:40.678974+0000","last_peered":"2023-10-03T19:19:40.678974+0000","last_clean":"2023-10-03T19:19:40.678974+0000","last_became_active":"2023-10-03T19:19:39.094297+0000","last_became_peered":"2023-10-03T19:19:39.094297+0000","last_unstale":"2023-10-03T19:19:40.678974+0000","last_undegraded":"2023-10-03T19:19:40.678974+0000","last_fullsized":"2023-10-03T19:19:40.678974+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:25:05.736398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":156,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-10-03T19:19:39.076080+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:19:39.076080+0000","last_peered":"2023-10-03T19:19:39.076080+0000","last_clean":"2023-10-03T19:19:39.076080+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:19:39.076080+0000","last_undegraded":"2023-10-03T19:19:39.076080+0000","last_fullsized":"2023-10-03T19:19:39.076080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:42:50.307434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.429963+0000","last_change":"2023-10-03T19:19:39.499012+0000","last_active":"2023-10-03T19:19:40.429963+0000","last_peered":"2023-10-03T19:19:40.429963+0000","last_clean":"2023-10-03T19:19:40.429963+0000","last_became_active":"2023-10-03T19:19:39.498726+0000","last_became_peered":"2023-10-03T19:19:39.498726+0000","last_unstale":"2023-10-03T19:19:40.429963+0000","last_undegraded":"2023-10-03T19:19:40.429963+0000","last_fullsized":"2023-10-03T19:19:40.429963+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:24:21.652472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678086+0000","last_change":"2023-10-03T19:19:39.090362+0000","last_active":"2023-10-03T19:19:40.678086+0000","last_peered":"2023-10-03T19:19:40.678086+0000","last_clean":"2023-10-03T19:19:40.678086+0000","last_became_active":"2023-10-03T19:19:39.089665+0000","last_became_peered":"2023-10-03T19:19:39.089665+0000","last_unstale":"2023-10-03T19:19:40.678086+0000","last_undegraded":"2023-10-03T19:19:40.678086+0000","last_fullsized":"2023-10-03T19:19:40.678086+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:27:13.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":156,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176195+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:19:41.176195+0000","last_peered":"2023-10-03T19:19:41.176195+0000","last_clean":"2023-10-03T19:19:41.176195+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:19:41.176195+0000","last_undegraded":"2023-10-03T19:19:41.176195+0000","last_fullsized":"2023-10-03T19:19:41.176195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:20:40.902125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174641+0000","last_change":"2023-10-03T19:19:39.451521+0000","last_active":"2023-10-03T19:19:41.174641+0000","last_peered":"2023-10-03T19:19:41.174641+0000","last_clean":"2023-10-03T19:19:41.174641+0000","last_became_active":"2023-10-03T19:19:39.451224+0000","last_became_peered":"2023-10-03T19:19:39.451224+0000","last_unstale":"2023-10-03T19:19:41.174641+0000","last_undegraded":"2023-10-03T19:19:41.174641+0000","last_fullsized":"2023-10-03T19:19:41.174641+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:50:20.369948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173326+0000","last_change":"2023-10-03T19:19:39.072003+0000","last_active":"2023-10-03T19:19:41.173326+0000","last_peered":"2023-10-03T19:19:41.173326+0000","last_clean":"2023-10-03T19:19:41.173326+0000","last_became_active":"2023-10-03T19:19:39.071324+0000","last_became_peered":"2023-10-03T19:19:39.071324+0000","last_unstale":"2023-10-03T19:19:41.173326+0000","last_undegraded":"2023-10-03T19:19:41.173326+0000","last_fullsized":"2023-10-03T19:19:41.173326+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:01:20.263082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":164,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175496+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:19:41.175496+0000","last_peered":"2023-10-03T19:19:41.175496+0000","last_clean":"2023-10-03T19:19:41.175496+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:19:41.175496+0000","last_undegraded":"2023-10-03T19:19:41.175496+0000","last_fullsized":"2023-10-03T19:19:41.175496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:44:47.179646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.061302+0000","last_change":"2023-10-03T19:19:39.061302+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.061302+0000","last_undegraded":"2023-10-03T19:19:39.061302+0000","last_fullsized":"2023-10-03T19:19:39.061302+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174033+0000","last_change":"2023-10-03T19:19:39.080203+0000","last_active":"2023-10-03T19:19:41.174033+0000","last_peered":"2023-10-03T19:19:41.174033+0000","last_clean":"2023-10-03T19:19:41.174033+0000","last_became_active":"2023-10-03T19:19:39.079875+0000","last_became_peered":"2023-10-03T19:19:39.079875+0000","last_unstale":"2023-10-03T19:19:41.174033+0000","last_undegraded":"2023-10-03T19:19:41.174033+0000","last_fullsized":"2023-10-03T19:19:41.174033+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:47:10.549041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":156,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176538+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:19:41.176538+0000","last_peered":"2023-10-03T19:19:41.176538+0000","last_clean":"2023-10-03T19:19:41.176538+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:19:41.176538+0000","last_undegraded":"2023-10-03T19:19:41.176538+0000","last_fullsized":"2023-10-03T19:19:41.176538+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:00:06.011070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-10-03T19:19:39.061790+0000","last_change":"2023-10-03T19:19:39.061790+0000","last_active":"2023-10-03T19:19:39.034212+0000","last_peered":"2023-10-03T19:19:39.034212+0000","last_clean":"2023-10-03T19:19:39.034212+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:19:39.061790+0000","last_undegraded":"2023-10-03T19:19:39.061790+0000","last_fullsized":"2023-10-03T19:19:39.061790+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173183+0000","last_change":"2023-10-03T19:19:39.073332+0000","last_active":"2023-10-03T19:19:41.173183+0000","last_peered":"2023-10-03T19:19:41.173183+0000","last_clean":"2023-10-03T19:19:41.173183+0000","last_became_active":"2023-10-03T19:19:39.072635+0000","last_became_peered":"2023-10-03T19:19:39.072635+0000","last_unstale":"2023-10-03T19:19:41.173183+0000","last_undegraded":"2023-10-03T19:19:41.173183+0000","last_fullsized":"2023-10-03T19:19:41.173183+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:58:24.112901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":156,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.679025+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:19:40.679025+0000","last_peered":"2023-10-03T19:19:40.679025+0000","last_clean":"2023-10-03T19:19:40.679025+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:19:40.679025+0000","last_undegraded":"2023-10-03T19:19:40.679025+0000","last_fullsized":"2023-10-03T19:19:40.679025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:11:45.085836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509531,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33704,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":32448,"kb_avail":94338136,"statfs":{"total":96636764160,"available":96602251264,"internally_reserved":0,"allocated":1277952,"data_stored":1142210,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":33226752},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.85899999999999999,"15min":0.92700000000000005},"min":{"1min":0.66300000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1950000000000001,"5min":1.206,"15min":4.0469999999999997},"last":2.1080000000000001},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.85299999999999998,"15min":0.82099999999999995},"min":{"1min":0.55200000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.177,"5min":1.2310000000000001,"15min":1.3420000000000001},"last":1.121}]},{"osd":1,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.86299999999999999,"15min":0.98599999999999999},"min":{"1min":0.61899999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1359999999999999,"5min":1.3200000000000001,"15min":3.8239999999999998},"last":2.298},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.89800000000000002,"15min":0.87},"min":{"1min":0.64500000000000002,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.034}]},{"osd":2,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.95899999999999996,"15min":0.88400000000000001},"min":{"1min":0.55300000000000005,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1719999999999999,"5min":6.0449999999999999,"15min":6.0449999999999999},"last":4.4779999999999998},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.94199999999999995,"15min":1.0109999999999999},"min":{"1min":0.69999999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.296,"5min":1.5800000000000001,"15min":3.98},"last":2.673}]},{"osd":3,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.034,"15min":0.95799999999999996},"min":{"1min":0.68500000000000005,"5min":0.63800000000000001,"15min":0.51100000000000001},"max":{"1min":1.232,"5min":6.125,"15min":6.125},"last":4.3650000000000002},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.97599999999999998,"15min":1.0840000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.175,"5min":1.444,"15min":3.9140000000000001},"last":1.593}]},{"osd":4,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.89800000000000002,"15min":1.0920000000000001},"min":{"1min":0.61599999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":5.1130000000000004},"last":2.4769999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.016,"15min":1.018},"min":{"1min":0.70699999999999996,"5min":0.629,"15min":0.629},"max":{"1min":1.214,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":12.196999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.006,"15min":1.2010000000000001},"min":{"1min":0.63700000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2470000000000001,"5min":1.349,"15min":5.1859999999999999},"last":2.581},{"interface":"front","average":{"1min":1.004,"5min":1.0209999999999999,"15min":1.115},"min":{"1min":0.69299999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.29,"5min":1.2949999999999999,"15min":2.0609999999999999},"last":1.6719999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0740000000000001,"15min":1.093},"min":{"1min":0.80000000000000004,"5min":0.75700000000000001,"15min":0.69399999999999995},"max":{"1min":1.3839999999999999,"5min":1.4890000000000001,"15min":1.5449999999999999},"last":1.7609999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.1459999999999999,"15min":1.167},"min":{"1min":0.77800000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.232,"5min":6.1580000000000004,"15min":6.1580000000000004},"last":4.5570000000000004}]}]},{"osd":6,"up_from":15,"seq":64424509531,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26992,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":25792,"kb_avail":94344848,"statfs":{"total":96636764160,"available":96609124352,"internally_reserved":0,"allocated":1220608,"data_stored":552686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":26411008},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.84599999999999997,"15min":0.82699999999999996},"min":{"1min":0.54100000000000004,"5min":0.45400000000000001,"15min":0.44600000000000001},"max":{"1min":1.234,"5min":1.3340000000000001,"15min":1.504},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.91100000000000003,"15min":0.88900000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.44600000000000001},"max":{"1min":1.1080000000000001,"5min":1.423,"15min":1.839},"last":1.2430000000000001}]},{"osd":1,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.86699999999999999,"15min":0.84699999999999998},"min":{"1min":0.56000000000000005,"5min":0.52100000000000002,"15min":0.504},"max":{"1min":1.1859999999999999,"5min":1.27,"15min":2.0150000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.88900000000000001,"15min":0.88200000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.161,"5min":1.448,"15min":1.448},"last":0.73599999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.93799999999999994,"15min":0.88900000000000001},"min":{"1min":0.66400000000000003,"5min":0.59199999999999997,"15min":0.51900000000000002},"max":{"1min":1.4430000000000001,"5min":1.528,"15min":1.528},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.92700000000000005,"15min":0.92500000000000004},"min":{"1min":0.60899999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1519999999999999,"5min":1.369,"15min":1.546},"last":0.96199999999999997}]},{"osd":3,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.96299999999999997,"15min":0.97899999999999998},"min":{"1min":0.68899999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.298,"5min":1.377,"15min":1.6990000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90700000000000003,"15min":0.90800000000000003},"min":{"1min":0.70199999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.143,"5min":1.206,"15min":2.121},"last":0.79600000000000004}]},{"osd":4,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.91600000000000004,"15min":0.998},"min":{"1min":0.67400000000000004,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.335,"5min":1.339,"15min":1.95},"last":1.075},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.995,"15min":1.0680000000000001},"min":{"1min":0.64400000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4490000000000001,"5min":1.504,"15min":1.7709999999999999},"last":1.1120000000000001}]},{"osd":5,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.90700000000000003,"15min":0.99199999999999999},"min":{"1min":0.624,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.226,"5min":1.3200000000000001,"15min":2.2570000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.048,"15min":1.103},"min":{"1min":0.71799999999999997,"5min":0.68300000000000005,"15min":0.68100000000000005},"max":{"1min":1.5009999999999999,"5min":1.524,"15min":2.0619999999999998},"last":1.2010000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.071,"15min":1.109},"min":{"1min":0.748,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.639,"5min":1.639,"15min":2.0049999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.044,"15min":1.0820000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.61899999999999999},"max":{"1min":1.3879999999999999,"5min":1.4350000000000001,"15min":2.4249999999999998},"last":1.151}]}]},{"osd":4,"up_from":15,"seq":64424509532,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42152,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":40960,"kb_avail":94329688,"statfs":{"total":96636764160,"available":96593600512,"internally_reserved":0,"allocated":1212416,"data_stored":551774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":41943040},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":1.0600000000000001,"15min":0.875},"min":{"1min":0.64200000000000002,"5min":0.54700000000000004,"15min":0.50600000000000001},"max":{"1min":1.0600000000000001,"5min":17.686,"15min":17.686},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.90100000000000002,"5min":1.02,"15min":0.89000000000000001},"min":{"1min":0.64000000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.28,"5min":16.925999999999998,"15min":16.925999999999998},"last":0.622}]},{"osd":1,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.085,"15min":0.98499999999999999},"min":{"1min":0.67700000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1759999999999999,"5min":16.640999999999998,"15min":16.640999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":1.089,"15min":0.93400000000000005},"min":{"1min":0.67300000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.151,"5min":17.59,"15min":17.59},"last":0.80700000000000005}]},{"osd":2,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.997,"15min":0.94299999999999995},"min":{"1min":0.70699999999999996,"5min":0.56200000000000006,"15min":0.53200000000000003},"max":{"1min":1.1180000000000001,"5min":8.5630000000000006,"15min":8.5630000000000006},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.93999999999999995,"5min":1.143,"15min":1.01},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.175,"5min":17.734000000000002,"15min":17.734000000000002},"last":0.88800000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.0880000000000001,"15min":0.94299999999999995},"min":{"1min":0.72499999999999998,"5min":0.61499999999999999,"15min":0.53900000000000003},"max":{"1min":1.242,"5min":16.98,"15min":16.98},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.997,"5min":1.161,"15min":1.105},"min":{"1min":0.66900000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2789999999999999,"5min":16.434000000000001,"15min":16.434000000000001},"last":0.82999999999999996}]},{"osd":5,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":1.1020000000000001,"15min":1.0820000000000001},"min":{"1min":0.624,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.143,"5min":17.782,"15min":17.782},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.96599999999999997,"15min":1.002},"min":{"1min":0.65700000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.264,"5min":1.708,"15min":1.708},"last":0.77000000000000002}]},{"osd":6,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.3859999999999999,"15min":1.27},"min":{"1min":0.66000000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.2250000000000001,"5min":36.106000000000002,"15min":36.106000000000002},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.2450000000000001,"15min":1.216},"min":{"1min":0.86099999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.2410000000000001,"5min":17.646999999999998,"15min":17.646999999999998},"last":0.97299999999999998}]},{"osd":7,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.226,"15min":1.1359999999999999},"min":{"1min":0.81200000000000006,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.421,"5min":17.042000000000002,"15min":17.042000000000002},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.3,"15min":1.262},"min":{"1min":0.83199999999999996,"5min":0.66400000000000003,"15min":0.63300000000000001},"max":{"1min":1.4670000000000001,"5min":16.32,"15min":16.32},"last":0.998}]}]},{"osd":2,"up_from":15,"seq":64424509532,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":31424,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1204224,"data_stored":550552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":32178176},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.79100000000000004,"15min":0.61299999999999999},"min":{"1min":0.47799999999999998,"5min":0.32200000000000001,"15min":0.247},"max":{"1min":0.98199999999999998,"5min":13.629,"15min":13.629},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":1.206,"15min":0.80900000000000005},"min":{"1min":0.34000000000000002,"5min":0.30299999999999999,"15min":0.28999999999999998},"max":{"1min":0.97199999999999998,"5min":40.439,"15min":40.439},"last":0.53200000000000003}]},{"osd":1,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.90200000000000002,"15min":0.71099999999999997},"min":{"1min":0.47899999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1,"5min":14.074,"15min":14.074},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.78500000000000003,"15min":0.64900000000000002},"min":{"1min":0.38800000000000001,"5min":0.34799999999999998,"15min":0.26400000000000001},"max":{"1min":1.1080000000000001,"5min":7.0060000000000002,"15min":7.0060000000000002},"last":0.44800000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.90000000000000002,"15min":0.71299999999999997},"min":{"1min":0.36699999999999999,"5min":0.28899999999999998,"15min":0.224},"max":{"1min":1.05,"5min":13.423999999999999,"15min":13.423999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.0649999999999999,"15min":0.82899999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.36399999999999999},"max":{"1min":1.1220000000000001,"5min":18.568999999999999,"15min":18.568999999999999},"last":0.56799999999999995}]},{"osd":4,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.94999999999999996,"15min":0.878},"min":{"1min":0.64200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.105,"5min":1.718,"15min":1.718},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.3380000000000001,"15min":1.05},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.22,"5min":28.667999999999999,"15min":28.667999999999999},"last":0.63}]},{"osd":5,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.0529999999999999,"15min":0.92100000000000004},"min":{"1min":0.67600000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.399,"5min":5.4459999999999997,"15min":5.4459999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.2230000000000001,"15min":1.0309999999999999},"min":{"1min":0.63300000000000001,"5min":0.57599999999999996,"15min":0.52700000000000002},"max":{"1min":1.4970000000000001,"5min":14.007,"15min":14.007},"last":0.70299999999999996}]},{"osd":6,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":1.1040000000000001,"15min":0.97099999999999997},"min":{"1min":0.65900000000000003,"5min":0.60099999999999998,"15min":0.49099999999999999},"max":{"1min":1.212,"5min":10.679,"15min":10.679},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.087,"15min":1.004},"min":{"1min":0.75600000000000001,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.325,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.88200000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.3240000000000001,"15min":1.1080000000000001},"min":{"1min":0.70299999999999996,"5min":0.63100000000000001,"15min":0.56100000000000005},"max":{"1min":1.415,"5min":18.623000000000001,"15min":18.623000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":1.002,"5min":1.0920000000000001,"15min":0.996},"min":{"1min":0.61699999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1850000000000001,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.84499999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509531,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30628,"kb_used_data":1180,"kb_used_omap":0,"kb_used_meta":29440,"kb_avail":94341212,"statfs":{"total":96636764160,"available":96605401088,"internally_reserved":0,"allocated":1208320,"data_stored":551716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30146560},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59199999999999997,"15min":0.55600000000000005},"min":{"1min":0.27900000000000003,"5min":0.27200000000000002,"15min":0.26900000000000002},"max":{"1min":0.92100000000000004,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70399999999999996,"15min":0.56799999999999995},"min":{"1min":0.41799999999999998,"5min":0.27200000000000002,"15min":0.22900000000000001},"max":{"1min":1.1899999999999999,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.41799999999999998}]},{"osd":2,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68300000000000005,"15min":0.58899999999999997},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.26200000000000001},"max":{"1min":0.879,"5min":1.506,"15min":1.506},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.82099999999999995,"15min":0.70599999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.312},"max":{"1min":1.1919999999999999,"5min":1.365,"15min":1.365},"last":0.82999999999999996}]},{"osd":3,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.76400000000000001,"15min":0.67300000000000004},"min":{"1min":0.36099999999999999,"5min":0.31,"15min":0.31},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.75700000000000001,"15min":0.63400000000000001},"min":{"1min":0.39100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.90700000000000003,"5min":1.232,"15min":1.27},"last":0.70899999999999996}]},{"osd":4,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.89000000000000001,"15min":0.82799999999999996},"min":{"1min":0.61199999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0860000000000001,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.98499999999999999,"15min":0.91400000000000003},"min":{"1min":0.69899999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3260000000000001,"5min":1.728,"15min":1.728},"last":1.0609999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.98999999999999999,"15min":0.89500000000000002},"min":{"1min":0.60299999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.28,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.117},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.96299999999999997,"15min":0.88500000000000001},"min":{"1min":0.77300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.198,"5min":1.3959999999999999,"15min":1.6080000000000001},"last":0.89200000000000002}]},{"osd":6,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0349999999999999,"15min":0.95399999999999996},"min":{"1min":0.59499999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2689999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.149},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0289999999999999,"15min":0.93400000000000005},"min":{"1min":0.66700000000000004,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3600000000000001,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.0229999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0669999999999999,"15min":0.97599999999999998},"min":{"1min":0.55100000000000005,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.292,"5min":1.673,"15min":1.673},"last":1.204},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0289999999999999,"15min":0.93999999999999995},"min":{"1min":0.67500000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4379999999999999,"5min":1.5880000000000001,"15min":1.649},"last":1.1719999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542235,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25176,"kb_used_data":1168,"kb_used_omap":0,"kb_used_meta":24000,"kb_avail":94346664,"statfs":{"total":96636764160,"available":96610983936,"internally_reserved":0,"allocated":1196032,"data_stored":545611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24576000},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.63200000000000001,"15min":0.58799999999999997},"min":{"1min":0.36399999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.96199999999999997,"5min":1.212,"15min":1.212},"last":0.221},{"interface":"front","average":{"1min":0.755,"5min":0.69999999999999996,"15min":0.66000000000000003},"min":{"1min":0.38900000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.5,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.33700000000000002}]},{"osd":1,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.70399999999999996,"15min":0.64800000000000002},"min":{"1min":0.42299999999999999,"5min":0.28599999999999998,"15min":0.27000000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76000000000000001,"15min":0.69099999999999995},"min":{"1min":0.34300000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.169,"5min":1.2210000000000001,"15min":1.222},"last":0.40300000000000002}]},{"osd":2,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.79400000000000004,"15min":0.73299999999999998},"min":{"1min":0.35999999999999999,"5min":0.317,"15min":0.317},"max":{"1min":1.1539999999999999,"5min":1.23,"15min":1.23},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73199999999999998,"15min":0.66000000000000003},"min":{"1min":0.371,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.05,"5min":1.671,"15min":1.671},"last":0.316}]},{"osd":4,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.92000000000000004,"15min":0.91200000000000003},"min":{"1min":0.63900000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2949999999999999,"5min":1.411,"15min":1.496},"last":0.58699999999999997},{"interface":"front","average":{"1min":1.006,"5min":1.018,"15min":0.95599999999999996},"min":{"1min":0.76400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3280000000000001,"5min":1.546,"15min":1.546},"last":0.44800000000000001}]},{"osd":5,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.91200000000000003,"15min":0.88700000000000001},"min":{"1min":0.63300000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.095,"5min":1.581,"15min":1.581},"last":0.50600000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.022,"15min":1.004},"min":{"1min":0.68100000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4179999999999999,"5min":1.498,"15min":1.498},"last":0.60699999999999998}]},{"osd":6,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.94599999999999995,"15min":0.92800000000000005},"min":{"1min":0.68799999999999994,"5min":0.56999999999999995,"15min":0.56699999999999995},"max":{"1min":1.212,"5min":1.347,"15min":1.347},"last":0.47799999999999998},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.05,"15min":1.006},"min":{"1min":0.80000000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.373,"5min":1.4970000000000001,"15min":1.5629999999999999},"last":0.56399999999999995}]},{"osd":7,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.083,"15min":1.0289999999999999},"min":{"1min":0.70599999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":1.109,"5min":1.0609999999999999,"15min":1.03},"min":{"1min":0.65300000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.659,"5min":1.659,"15min":1.708},"last":0.625}]}]},{"osd":5,"up_from":13,"seq":55834574938,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22716,"kb_used_data":1140,"kb_used_omap":0,"kb_used_meta":21568,"kb_avail":94349124,"statfs":{"total":96636764160,"available":96613502976,"internally_reserved":0,"allocated":1167360,"data_stored":531273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22085632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.85799999999999998,"15min":0.83399999999999996},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.181,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.89400000000000002,"15min":0.86599999999999999},"min":{"1min":0.78200000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.26,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.1990000000000001}]},{"osd":1,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.872,"15min":0.84499999999999997},"min":{"1min":0.505,"5min":0.501,"15min":0.501},"max":{"1min":1.044,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.91000000000000003,"15min":0.92300000000000004},"min":{"1min":0.63100000000000001,"5min":0.58699999999999997,"15min":0.57099999999999995},"max":{"1min":1.23,"5min":1.23,"15min":1.514},"last":1.127}]},{"osd":2,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.91000000000000003,"15min":0.90300000000000002},"min":{"1min":0.625,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2010000000000001,"5min":1.351,"15min":1.3700000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.999,"5min":0.93000000000000005,"15min":0.90600000000000003},"min":{"1min":0.82499999999999996,"5min":0.57099999999999995,"15min":0.53300000000000003},"max":{"1min":1.1819999999999999,"5min":1.1930000000000001,"15min":1.3320000000000001},"last":1.056}]},{"osd":3,"last update":"Tue Oct 3 19:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.93600000000000005,"15min":0.93100000000000005},"min":{"1min":0.67700000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2210000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.046,"5min":1.03,"15min":1.028},"min":{"1min":0.78700000000000003,"5min":0.65900000000000003,"15min":0.61199999999999999},"max":{"1min":1.3129999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.80400000000000005}]},{"osd":4,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.97499999999999998,"15min":0.97299999999999998},"min":{"1min":0.70699999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.2450000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96399999999999997,"15min":1.0129999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2749999999999999,"5min":1.335,"15min":1.7709999999999999},"last":0.73699999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.995,"15min":1.024},"min":{"1min":0.67000000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.204,"5min":1.546,"15min":1.546},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0880000000000001,"15min":1.1240000000000001},"min":{"1min":0.82499999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.3759999999999999,"5min":1.823,"15min":1.823},"last":0.93000000000000005}]},{"osd":7,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0569999999999999,"15min":1.071},"min":{"1min":0.68700000000000006,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.5680000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.119,"15min":1.143},"min":{"1min":0.86499999999999999,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.325,"5min":1.4179999999999999,"15min":1.9099999999999999},"last":1.012}]}]},{"osd":0,"up_from":13,"seq":55834574939,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30072,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":28864,"kb_avail":94341768,"statfs":{"total":96636764160,"available":96605970432,"internally_reserved":0,"allocated":1228800,"data_stored":1120477,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":29556736},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.69699999999999995,"15min":0.61399999999999999},"min":{"1min":0.502,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.92000000000000004,"5min":5.7480000000000002,"15min":5.7480000000000002},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.80900000000000005,"15min":0.746},"min":{"1min":0.54700000000000004,"5min":0.37,"15min":0.33000000000000002},"max":{"1min":1.0760000000000001,"5min":6.274,"15min":6.274},"last":0.84899999999999998}]},{"osd":2,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.81999999999999995,"15min":0.746},"min":{"1min":0.46700000000000003,"5min":0.36499999999999999,"15min":0.35399999999999998},"max":{"1min":0.97599999999999998,"5min":6.1609999999999996,"15min":6.1609999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71499999999999997,"15min":0.69899999999999995},"min":{"1min":0.44500000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.997,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.80200000000000005}]},{"osd":3,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.90800000000000003,"15min":0.78000000000000003},"min":{"1min":0.57499999999999996,"5min":0.41799999999999998,"15min":0.36799999999999999},"max":{"1min":1.1739999999999999,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82199999999999995,"15min":0.73199999999999998},"min":{"1min":0.53300000000000003,"5min":0.376,"15min":0.30299999999999999},"max":{"1min":1.0780000000000001,"5min":1.375,"15min":1.375},"last":0.93200000000000005}]},{"osd":4,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":1.0029999999999999,"15min":0.93600000000000005},"min":{"1min":0.71299999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.254,"5min":8.1159999999999997,"15min":8.1159999999999997},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.056,"5min":1.0860000000000001,"15min":1.0429999999999999},"min":{"1min":0.71199999999999997,"5min":0.57299999999999995,"15min":0.504},"max":{"1min":1.3440000000000001,"5min":6.2320000000000002,"15min":6.2320000000000002},"last":1.0960000000000001}]},{"osd":5,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.2549999999999999,"15min":1.1140000000000001},"min":{"1min":0.69199999999999995,"5min":0.59399999999999997,"15min":0.46899999999999997},"max":{"1min":1.4259999999999999,"5min":17.420000000000002,"15min":17.420000000000002},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.222,"15min":1.052},"min":{"1min":0.74299999999999999,"5min":0.59499999999999997,"15min":0.54300000000000004},"max":{"1min":1.371,"5min":17.643000000000001,"15min":17.643000000000001},"last":1.048}]},{"osd":6,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0880000000000001,"15min":1.038},"min":{"1min":0.77500000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3520000000000001,"5min":5.7220000000000004,"15min":5.7220000000000004},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0669999999999999,"15min":1.0129999999999999},"min":{"1min":0.877,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.417,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.1479999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.159,"15min":1.0740000000000001},"min":{"1min":0.81299999999999994,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3939999999999999,"5min":5.7800000000000002,"15min":5.7800000000000002},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.0920000000000001,"15min":1.0669999999999999},"min":{"1min":0.85699999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.343,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.21}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:19:45.022 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-03T19:19:45.016+0000 7fd1a2c6b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-03T19:19:47.191 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:19:47.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.324+0000 7f89dd346640 1 Processor -- start 2023-10-03T19:19:47.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.324+0000 7f89dd346640 1 -- start start 2023-10-03T19:19:47.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.324+0000 7f89dd346640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89d8151dd0 0x7f89d81521c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:47.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.324+0000 7f89dd346640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d8070d10 con 0x7f89d8152700 2023-10-03T19:19:47.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.324+0000 7f89dd346640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d80bcac0 con 0x7f89d814bbd0 2023-10-03T19:19:47.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.324+0000 7f89dd346640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d80bc7e0 con 0x7f89d8151dd0 2023-10-03T19:19:47.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.324+0000 7f89d77fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f89d8152700 0x7f89d8158ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35852/0 (socket says 172.21.15.45:35852) 2023-10-03T19:19:47.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.324+0000 7f89d77fe640 1 -- 172.21.15.45:0/2510137889 learned_addr learned my addr 172.21.15.45:0/2510137889 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:47.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.324+0000 7f89d67fc640 1 --2- 172.21.15.45:0/2510137889 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89d8151dd0 0x7f89d81521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:47.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.324+0000 7f89d5ffb640 1 -- 172.21.15.45:0/2510137889 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829967775 0 0) 0x7f89d8070d10 con 0x7f89d8152700 2023-10-03T19:19:47.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.324+0000 7f89d5ffb640 1 -- 172.21.15.45:0/2510137889 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89c0003530 con 0x7f89d8152700 2023-10-03T19:19:47.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.324+0000 7f89d5ffb640 1 -- 172.21.15.45:0/2510137889 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3584656139 0 0) 0x7f89c0003530 con 0x7f89d8152700 2023-10-03T19:19:47.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.324+0000 7f89d5ffb640 1 -- 172.21.15.45:0/2510137889 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89d8151dd0 msgr2=0x7f89d81521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:47.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.324+0000 7f89d5ffb640 1 --2- 172.21.15.45:0/2510137889 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89d8151dd0 0x7f89d81521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:47.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.324+0000 7f89d5ffb640 1 -- 172.21.15.45:0/2510137889 >> v1:172.21.15.79:6789/0 conn(0x7f89d814bbd0 legacy=0x7f89d80ba140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:47.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.324+0000 7f89d5ffb640 1 -- 172.21.15.45:0/2510137889 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d8071350 con 0x7f89d8152700 2023-10-03T19:19:47.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.324+0000 7f89d5ffb640 1 -- 172.21.15.45:0/2510137889 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f89c8001680 con 0x7f89d8152700 2023-10-03T19:19:47.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.324+0000 7f89d5ffb640 1 -- 172.21.15.45:0/2510137889 >> v1:172.21.15.45:6789/0 conn(0x7f89d8152700 legacy=0x7f89d8158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:47.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.324+0000 7f89d5ffb640 1 --2- 172.21.15.45:0/2510137889 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89d8151dd0 0x7f89c00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:47.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.324+0000 7f89d5ffb640 1 --2- 172.21.15.45:0/2510137889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89c0003f30 0x7f89c00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:47.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.324+0000 7f89d5ffb640 1 --2- 172.21.15.45:0/2510137889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89c0004d10 0x7f89c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:47.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.324+0000 7f89d5ffb640 1 -- 172.21.15.45:0/2510137889 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d80bc7e0 con 0x7f89c0003f30 2023-10-03T19:19:47.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.324+0000 7f89d5ffb640 1 -- 172.21.15.45:0/2510137889 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c000ba70 con 0x7f89c0004d10 2023-10-03T19:19:47.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.324+0000 7f89d5ffb640 1 -- 172.21.15.45:0/2510137889 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c000bc30 con 0x7f89d8151dd0 2023-10-03T19:19:47.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.324+0000 7f89d67fc640 1 --2- 172.21.15.45:0/2510137889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89c0003f30 0x7f89c00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:47.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.328+0000 7f89d6ffd640 1 --2- 172.21.15.45:0/2510137889 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89d8151dd0 0x7f89c00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:47.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.328+0000 7f89d77fe640 1 --2- 172.21.15.45:0/2510137889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89c0004d10 0x7f89c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:47.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.328+0000 7f89d67fc640 1 -- 172.21.15.45:0/2510137889 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89d8151dd0 msgr2=0x7f89c00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:47.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.328+0000 7f89d67fc640 1 --2- 172.21.15.45:0/2510137889 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89d8151dd0 0x7f89c00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:47.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.328+0000 7f89d67fc640 1 -- 172.21.15.45:0/2510137889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89c0004d10 msgr2=0x7f89c0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:47.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.328+0000 7f89d67fc640 1 --2- 172.21.15.45:0/2510137889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89c0004d10 0x7f89c0005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:47.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.328+0000 7f89d67fc640 1 -- 172.21.15.45:0/2510137889 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c0003530 con 0x7f89c0003f30 2023-10-03T19:19:47.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.328+0000 7f89d67fc640 1 --2- 172.21.15.45:0/2510137889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89c0003f30 0x7f89c00047d0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f89cc009f90 tx=0x7f89cc01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7b4ca7c7e07e42 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:47.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.328+0000 7f89d5ffb640 1 -- 172.21.15.45:0/2510137889 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc0a5c30 con 0x7f89c0003f30 2023-10-03T19:19:47.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.328+0000 7f89d5ffb640 1 -- 172.21.15.45:0/2510137889 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89cc00f040 con 0x7f89c0003f30 2023-10-03T19:19:47.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.328+0000 7f89d5ffb640 1 -- 172.21.15.45:0/2510137889 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc0ad440 con 0x7f89c0003f30 2023-10-03T19:19:47.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.328+0000 7f89dd346640 1 -- 172.21.15.45:0/2510137889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89c0003f30 msgr2=0x7f89c00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:47.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.328+0000 7f89dd346640 1 --2- 172.21.15.45:0/2510137889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89c0003f30 0x7f89c00047d0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f89cc009f90 tx=0x7f89cc01cc20 comp rx=0 tx=0).stop 2023-10-03T19:19:47.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.328+0000 7f89d77fe640 1 -- 172.21.15.45:0/2510137889 reap_dead start 2023-10-03T19:19:47.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.328+0000 7f89dd346640 1 -- 172.21.15.45:0/2510137889 shutdown_connections 2023-10-03T19:19:47.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.328+0000 7f89dd346640 1 -- 172.21.15.45:0/2510137889 >> 172.21.15.45:0/2510137889 conn(0x7f89d80c0d20 msgr2=0x7f89d80c1120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:47.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.328+0000 7f89dd346640 1 -- 172.21.15.45:0/2510137889 shutdown_connections 2023-10-03T19:19:47.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.328+0000 7f89dd346640 1 -- 172.21.15.45:0/2510137889 wait complete. 2023-10-03T19:19:47.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.332+0000 7f89dd346640 1 Processor -- start 2023-10-03T19:19:47.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.332+0000 7f89dd346640 1 -- start start 2023-10-03T19:19:47.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.332+0000 7f89dd346640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89c0003f30 0x7f89d8150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:47.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.332+0000 7f89dd346640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89d814d9d0 0x7f89d8142d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:47.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.332+0000 7f89dd346640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89d8143270 0x7f89d814f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:47.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.332+0000 7f89dd346640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d814ed20 con 0x7f89d814d9d0 2023-10-03T19:19:47.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.332+0000 7f89dd346640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d81436e0 con 0x7f89c0003f30 2023-10-03T19:19:47.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.332+0000 7f89dd346640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d81e38f0 con 0x7f89d8143270 2023-10-03T19:19:47.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.332+0000 7f89d67fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89d814d9d0 0x7f89d8142d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:47.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.332+0000 7f89d67fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89d814d9d0 0x7f89d8142d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34492/0 (socket says 172.21.15.45:34492) 2023-10-03T19:19:47.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.332+0000 7f89d67fc640 1 -- 172.21.15.45:0/3899298440 learned_addr learned my addr 172.21.15.45:0/3899298440 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:47.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.332+0000 7f89d6ffd640 1 --2- 172.21.15.45:0/3899298440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89c0003f30 0x7f89d8150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:47.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.332+0000 7f89d77fe640 1 --2- 172.21.15.45:0/3899298440 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89d8143270 0x7f89d814f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:47.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.332+0000 7f89d67fc640 1 -- 172.21.15.45:0/3899298440 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89d8143270 msgr2=0x7f89d814f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:47.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.332+0000 7f89d67fc640 1 --2- 172.21.15.45:0/3899298440 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89d8143270 0x7f89d814f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:47.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.332+0000 7f89d67fc640 1 -- 172.21.15.45:0/3899298440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89c0003f30 msgr2=0x7f89d8150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:47.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.332+0000 7f89d67fc640 1 --2- 172.21.15.45:0/3899298440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89c0003f30 0x7f89d8150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:47.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.332+0000 7f89d67fc640 1 -- 172.21.15.45:0/3899298440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d80ba850 con 0x7f89d814d9d0 2023-10-03T19:19:47.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.332+0000 7f89d67fc640 1 --2- 172.21.15.45:0/3899298440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89d814d9d0 0x7f89d8142d30 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f89cc01ca50 tx=0x7f89cc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:47.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.332+0000 7f89bf7fe640 1 -- 172.21.15.45:0/3899298440 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc0ad990 con 0x7f89d814d9d0 2023-10-03T19:19:47.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.332+0000 7f89bf7fe640 1 -- 172.21.15.45:0/3899298440 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89cc0adaf0 con 0x7f89d814d9d0 2023-10-03T19:19:47.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.332+0000 7f89dd346640 1 -- 172.21.15.45:0/3899298440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d8071900 con 0x7f89d814d9d0 2023-10-03T19:19:47.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.332+0000 7f89bf7fe640 1 -- 172.21.15.45:0/3899298440 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc0adea0 con 0x7f89d814d9d0 2023-10-03T19:19:47.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.332+0000 7f89dd346640 1 -- 172.21.15.45:0/3899298440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d80bb230 con 0x7f89d814d9d0 2023-10-03T19:19:47.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.332+0000 7f89dd346640 1 -- 172.21.15.45:0/3899298440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d804de80 con 0x7f89d814d9d0 2023-10-03T19:19:47.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.332+0000 7f89bf7fe640 1 -- 172.21.15.45:0/3899298440 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f89cc0b4040 con 0x7f89d814d9d0 2023-10-03T19:19:47.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.332+0000 7f89bf7fe640 1 --2- 172.21.15.45:0/3899298440 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f89c4066280 0x7f89c4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:47.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.336+0000 7f89bf7fe640 1 -- 172.21.15.45:0/3899298440 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f89cc11e5e0 con 0x7f89d814d9d0 2023-10-03T19:19:47.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.336+0000 7f89d6ffd640 1 --2- 172.21.15.45:0/3899298440 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f89c4066280 0x7f89c4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:47.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.336+0000 7f89d6ffd640 1 --2- 172.21.15.45:0/3899298440 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f89c4066280 0x7f89c4068730 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f89d0005490 tx=0x7f89d0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:47.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.340+0000 7f89bf7fe640 1 -- 172.21.15.45:0/3899298440 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f89cc0eb9d0 con 0x7f89d814d9d0 2023-10-03T19:19:47.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.492+0000 7f89dd346640 1 -- 172.21.15.45:0/3899298440 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f89d80bb010 con 0x7f89c4066280 2023-10-03T19:19:47.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.516+0000 7f89bf7fe640 1 -- 172.21.15.45:0/3899298440 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310139 (secure 0 0 0) 0x7f89d80bb010 con 0x7f89c4066280 2023-10-03T19:19:47.523 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:19:47.525 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:19:47.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.520+0000 7f89dd346640 1 -- 172.21.15.45:0/3899298440 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f89c4066280 msgr2=0x7f89c4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:47.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.520+0000 7f89dd346640 1 --2- 172.21.15.45:0/3899298440 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f89c4066280 0x7f89c4068730 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f89d0005490 tx=0x7f89d0009040 comp rx=0 tx=0).stop 2023-10-03T19:19:47.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.520+0000 7f89dd346640 1 -- 172.21.15.45:0/3899298440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89d814d9d0 msgr2=0x7f89d8142d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:47.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.520+0000 7f89dd346640 1 --2- 172.21.15.45:0/3899298440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89d814d9d0 0x7f89d8142d30 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f89cc01ca50 tx=0x7f89cc009750 comp rx=0 tx=0).stop 2023-10-03T19:19:47.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.520+0000 7f89dd346640 1 -- 172.21.15.45:0/3899298440 shutdown_connections 2023-10-03T19:19:47.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.520+0000 7f89dd346640 1 --2- 172.21.15.45:0/3899298440 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f89c4066280 0x7f89c4068730 secure :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f89d0005490 tx=0x7f89d0009040 comp rx=0 tx=0).stop 2023-10-03T19:19:47.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.520+0000 7f89dd346640 1 --2- 172.21.15.45:0/3899298440 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89d8143270 0x7f89d814f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:47.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.520+0000 7f89dd346640 1 --2- 172.21.15.45:0/3899298440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89d814d9d0 0x7f89d8142d30 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:47.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.520+0000 7f89dd346640 1 --2- 172.21.15.45:0/3899298440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89c0003f30 0x7f89d8150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:47.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.520+0000 7f89dd346640 1 -- 172.21.15.45:0/3899298440 >> 172.21.15.45:0/3899298440 conn(0x7f89d80c0d20 msgr2=0x7f89d80c1120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:47.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.520+0000 7f89dd346640 1 -- 172.21.15.45:0/3899298440 shutdown_connections 2023-10-03T19:19:47.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.520+0000 7f89dd346640 1 -- 172.21.15.45:0/3899298440 wait complete. 2023-10-03T19:19:47.542 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":316,"stamp":"2023-10-03T19:19:46.602083+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":204,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244404,"kb_used_data":9588,"kb_used_omap":0,"kb_used_meta":234752,"kb_avail":754730316,"statfs":{"total":773094113280,"available":772843843584,"internally_reserved":0,"allocated":9818112,"data_stored":5595424,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":240386048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":65,"apply_latency_ms":65,"commit_latency_ns":65000000,"apply_latency_ns":65000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.549107"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.172056+0000","last_change":"2023-10-03T19:19:39.440786+0000","last_active":"2023-10-03T19:19:41.172056+0000","last_peered":"2023-10-03T19:19:41.172056+0000","last_clean":"2023-10-03T19:19:41.172056+0000","last_became_active":"2023-10-03T19:19:39.440511+0000","last_became_peered":"2023-10-03T19:19:39.440511+0000","last_unstale":"2023-10-03T19:19:41.172056+0000","last_undegraded":"2023-10-03T19:19:41.172056+0000","last_fullsized":"2023-10-03T19:19:41.172056+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:19:02.736330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678798+0000","last_change":"2023-10-03T19:19:39.501818+0000","last_active":"2023-10-03T19:19:40.678798+0000","last_peered":"2023-10-03T19:19:40.678798+0000","last_clean":"2023-10-03T19:19:40.678798+0000","last_became_active":"2023-10-03T19:19:39.501351+0000","last_became_peered":"2023-10-03T19:19:39.501351+0000","last_unstale":"2023-10-03T19:19:40.678798+0000","last_undegraded":"2023-10-03T19:19:40.678798+0000","last_fullsized":"2023-10-03T19:19:40.678798+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:35:21.301808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.171786+0000","last_change":"2023-10-03T19:19:39.466463+0000","last_active":"2023-10-03T19:19:41.171786+0000","last_peered":"2023-10-03T19:19:41.171786+0000","last_clean":"2023-10-03T19:19:41.171786+0000","last_became_active":"2023-10-03T19:19:39.466131+0000","last_became_peered":"2023-10-03T19:19:39.466131+0000","last_unstale":"2023-10-03T19:19:41.171786+0000","last_undegraded":"2023-10-03T19:19:41.171786+0000","last_fullsized":"2023-10-03T19:19:41.171786+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:22:56.351847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430029+0000","last_change":"2023-10-03T19:19:39.473749+0000","last_active":"2023-10-03T19:19:40.430029+0000","last_peered":"2023-10-03T19:19:40.430029+0000","last_clean":"2023-10-03T19:19:40.430029+0000","last_became_active":"2023-10-03T19:19:39.473432+0000","last_became_peered":"2023-10-03T19:19:39.473432+0000","last_unstale":"2023-10-03T19:19:40.430029+0000","last_undegraded":"2023-10-03T19:19:40.430029+0000","last_fullsized":"2023-10-03T19:19:40.430029+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:58:52.700889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175119+0000","last_change":"2023-10-03T19:19:39.473502+0000","last_active":"2023-10-03T19:19:41.175119+0000","last_peered":"2023-10-03T19:19:41.175119+0000","last_clean":"2023-10-03T19:19:41.175119+0000","last_became_active":"2023-10-03T19:19:39.473176+0000","last_became_peered":"2023-10-03T19:19:39.473176+0000","last_unstale":"2023-10-03T19:19:41.175119+0000","last_undegraded":"2023-10-03T19:19:41.175119+0000","last_fullsized":"2023-10-03T19:19:41.175119+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:47:23.957363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.677858+0000","last_change":"2023-10-03T19:19:39.491373+0000","last_active":"2023-10-03T19:19:40.677858+0000","last_peered":"2023-10-03T19:19:40.677858+0000","last_clean":"2023-10-03T19:19:40.677858+0000","last_became_active":"2023-10-03T19:19:39.490818+0000","last_became_peered":"2023-10-03T19:19:39.490818+0000","last_unstale":"2023-10-03T19:19:40.677858+0000","last_undegraded":"2023-10-03T19:19:40.677858+0000","last_fullsized":"2023-10-03T19:19:40.677858+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:59:41.953904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.677748+0000","last_change":"2023-10-03T19:19:39.497977+0000","last_active":"2023-10-03T19:19:40.677748+0000","last_peered":"2023-10-03T19:19:40.677748+0000","last_clean":"2023-10-03T19:19:40.677748+0000","last_became_active":"2023-10-03T19:19:39.497211+0000","last_became_peered":"2023-10-03T19:19:39.497211+0000","last_unstale":"2023-10-03T19:19:40.677748+0000","last_undegraded":"2023-10-03T19:19:40.677748+0000","last_fullsized":"2023-10-03T19:19:40.677748+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:15:08.226909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.172923+0000","last_change":"2023-10-03T19:19:39.450807+0000","last_active":"2023-10-03T19:19:41.172923+0000","last_peered":"2023-10-03T19:19:41.172923+0000","last_clean":"2023-10-03T19:19:41.172923+0000","last_became_active":"2023-10-03T19:19:39.450534+0000","last_became_peered":"2023-10-03T19:19:39.450534+0000","last_unstale":"2023-10-03T19:19:41.172923+0000","last_undegraded":"2023-10-03T19:19:41.172923+0000","last_fullsized":"2023-10-03T19:19:41.172923+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:15:38.079291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678801+0000","last_change":"2023-10-03T19:19:39.492468+0000","last_active":"2023-10-03T19:19:40.678801+0000","last_peered":"2023-10-03T19:19:40.678801+0000","last_clean":"2023-10-03T19:19:40.678801+0000","last_became_active":"2023-10-03T19:19:39.491727+0000","last_became_peered":"2023-10-03T19:19:39.491727+0000","last_unstale":"2023-10-03T19:19:40.678801+0000","last_undegraded":"2023-10-03T19:19:40.678801+0000","last_fullsized":"2023-10-03T19:19:40.678801+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:42:13.454493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176602+0000","last_change":"2023-10-03T19:19:39.498659+0000","last_active":"2023-10-03T19:19:41.176602+0000","last_peered":"2023-10-03T19:19:41.176602+0000","last_clean":"2023-10-03T19:19:41.176602+0000","last_became_active":"2023-10-03T19:19:39.498315+0000","last_became_peered":"2023-10-03T19:19:39.498315+0000","last_unstale":"2023-10-03T19:19:41.176602+0000","last_undegraded":"2023-10-03T19:19:41.176602+0000","last_fullsized":"2023-10-03T19:19:41.176602+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:34:42.126930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.438136+0000","last_change":"2023-10-03T19:19:39.494006+0000","last_active":"2023-10-03T19:19:40.438136+0000","last_peered":"2023-10-03T19:19:40.438136+0000","last_clean":"2023-10-03T19:19:40.438136+0000","last_became_active":"2023-10-03T19:19:39.493302+0000","last_became_peered":"2023-10-03T19:19:39.493302+0000","last_unstale":"2023-10-03T19:19:40.438136+0000","last_undegraded":"2023-10-03T19:19:40.438136+0000","last_fullsized":"2023-10-03T19:19:40.438136+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:52:10.461256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.440908+0000","last_change":"2023-10-03T19:19:39.455413+0000","last_active":"2023-10-03T19:19:40.440908+0000","last_peered":"2023-10-03T19:19:40.440908+0000","last_clean":"2023-10-03T19:19:40.440908+0000","last_became_active":"2023-10-03T19:19:39.454714+0000","last_became_peered":"2023-10-03T19:19:39.454714+0000","last_unstale":"2023-10-03T19:19:40.440908+0000","last_undegraded":"2023-10-03T19:19:40.440908+0000","last_fullsized":"2023-10-03T19:19:40.440908+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:27:14.179448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.429895+0000","last_change":"2023-10-03T19:19:39.466360+0000","last_active":"2023-10-03T19:19:40.429895+0000","last_peered":"2023-10-03T19:19:40.429895+0000","last_clean":"2023-10-03T19:19:40.429895+0000","last_became_active":"2023-10-03T19:19:39.466034+0000","last_became_peered":"2023-10-03T19:19:39.466034+0000","last_unstale":"2023-10-03T19:19:40.429895+0000","last_undegraded":"2023-10-03T19:19:40.429895+0000","last_fullsized":"2023-10-03T19:19:40.429895+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:17:57.802389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174860+0000","last_change":"2023-10-03T19:19:39.478735+0000","last_active":"2023-10-03T19:19:41.174860+0000","last_peered":"2023-10-03T19:19:41.174860+0000","last_clean":"2023-10-03T19:19:41.174860+0000","last_became_active":"2023-10-03T19:19:39.477842+0000","last_became_peered":"2023-10-03T19:19:39.477842+0000","last_unstale":"2023-10-03T19:19:41.174860+0000","last_undegraded":"2023-10-03T19:19:41.174860+0000","last_fullsized":"2023-10-03T19:19:41.174860+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:01:44.142532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174807+0000","last_change":"2023-10-03T19:19:39.493604+0000","last_active":"2023-10-03T19:19:41.174807+0000","last_peered":"2023-10-03T19:19:41.174807+0000","last_clean":"2023-10-03T19:19:41.174807+0000","last_became_active":"2023-10-03T19:19:39.488408+0000","last_became_peered":"2023-10-03T19:19:39.488408+0000","last_unstale":"2023-10-03T19:19:41.174807+0000","last_undegraded":"2023-10-03T19:19:41.174807+0000","last_fullsized":"2023-10-03T19:19:41.174807+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:54:40.452636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174925+0000","last_change":"2023-10-03T19:19:39.481769+0000","last_active":"2023-10-03T19:19:41.174925+0000","last_peered":"2023-10-03T19:19:41.174925+0000","last_clean":"2023-10-03T19:19:41.174925+0000","last_became_active":"2023-10-03T19:19:39.478997+0000","last_became_peered":"2023-10-03T19:19:39.478997+0000","last_unstale":"2023-10-03T19:19:41.174925+0000","last_undegraded":"2023-10-03T19:19:41.174925+0000","last_fullsized":"2023-10-03T19:19:41.174925+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:53:12.478710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.172423+0000","last_change":"2023-10-03T19:19:39.440648+0000","last_active":"2023-10-03T19:19:41.172423+0000","last_peered":"2023-10-03T19:19:41.172423+0000","last_clean":"2023-10-03T19:19:41.172423+0000","last_became_active":"2023-10-03T19:19:39.440359+0000","last_became_peered":"2023-10-03T19:19:39.440359+0000","last_unstale":"2023-10-03T19:19:41.172423+0000","last_undegraded":"2023-10-03T19:19:41.172423+0000","last_fullsized":"2023-10-03T19:19:41.172423+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:22:25.990577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.679023+0000","last_change":"2023-10-03T19:19:39.502839+0000","last_active":"2023-10-03T19:19:40.679023+0000","last_peered":"2023-10-03T19:19:40.679023+0000","last_clean":"2023-10-03T19:19:40.679023+0000","last_became_active":"2023-10-03T19:19:39.502343+0000","last_became_peered":"2023-10-03T19:19:39.502343+0000","last_unstale":"2023-10-03T19:19:40.679023+0000","last_undegraded":"2023-10-03T19:19:40.679023+0000","last_fullsized":"2023-10-03T19:19:40.679023+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:19:38.314320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.171811+0000","last_change":"2023-10-03T19:19:39.498542+0000","last_active":"2023-10-03T19:19:41.171811+0000","last_peered":"2023-10-03T19:19:41.171811+0000","last_clean":"2023-10-03T19:19:41.171811+0000","last_became_active":"2023-10-03T19:19:39.498155+0000","last_became_peered":"2023-10-03T19:19:39.498155+0000","last_unstale":"2023-10-03T19:19:41.171811+0000","last_undegraded":"2023-10-03T19:19:41.171811+0000","last_fullsized":"2023-10-03T19:19:41.171811+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:33:52.700986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.440839+0000","last_change":"2023-10-03T19:19:39.481255+0000","last_active":"2023-10-03T19:19:40.440839+0000","last_peered":"2023-10-03T19:19:40.440839+0000","last_clean":"2023-10-03T19:19:40.440839+0000","last_became_active":"2023-10-03T19:19:39.480541+0000","last_became_peered":"2023-10-03T19:19:39.480541+0000","last_unstale":"2023-10-03T19:19:40.440839+0000","last_undegraded":"2023-10-03T19:19:40.440839+0000","last_fullsized":"2023-10-03T19:19:40.440839+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:21:53.299603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173654+0000","last_change":"2023-10-03T19:19:39.467184+0000","last_active":"2023-10-03T19:19:41.173654+0000","last_peered":"2023-10-03T19:19:41.173654+0000","last_clean":"2023-10-03T19:19:41.173654+0000","last_became_active":"2023-10-03T19:19:39.466886+0000","last_became_peered":"2023-10-03T19:19:39.466886+0000","last_unstale":"2023-10-03T19:19:41.173654+0000","last_undegraded":"2023-10-03T19:19:41.173654+0000","last_fullsized":"2023-10-03T19:19:41.173654+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:22:29.033454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175260+0000","last_change":"2023-10-03T19:19:39.464591+0000","last_active":"2023-10-03T19:19:41.175260+0000","last_peered":"2023-10-03T19:19:41.175260+0000","last_clean":"2023-10-03T19:19:41.175260+0000","last_became_active":"2023-10-03T19:19:39.464263+0000","last_became_peered":"2023-10-03T19:19:39.464263+0000","last_unstale":"2023-10-03T19:19:41.175260+0000","last_undegraded":"2023-10-03T19:19:41.175260+0000","last_fullsized":"2023-10-03T19:19:41.175260+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:09:27.964791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.171257+0000","last_change":"2023-10-03T19:19:39.466895+0000","last_active":"2023-10-03T19:19:41.171257+0000","last_peered":"2023-10-03T19:19:41.171257+0000","last_clean":"2023-10-03T19:19:41.171257+0000","last_became_active":"2023-10-03T19:19:39.466598+0000","last_became_peered":"2023-10-03T19:19:39.466598+0000","last_unstale":"2023-10-03T19:19:41.171257+0000","last_undegraded":"2023-10-03T19:19:41.171257+0000","last_fullsized":"2023-10-03T19:19:41.171257+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:01:45.571801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174942+0000","last_change":"2023-10-03T19:19:39.439866+0000","last_active":"2023-10-03T19:19:41.174942+0000","last_peered":"2023-10-03T19:19:41.174942+0000","last_clean":"2023-10-03T19:19:41.174942+0000","last_became_active":"2023-10-03T19:19:39.439632+0000","last_became_peered":"2023-10-03T19:19:39.439632+0000","last_unstale":"2023-10-03T19:19:41.174942+0000","last_undegraded":"2023-10-03T19:19:41.174942+0000","last_fullsized":"2023-10-03T19:19:41.174942+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:15:44.398741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.441232+0000","last_change":"2023-10-03T19:19:39.470183+0000","last_active":"2023-10-03T19:19:40.441232+0000","last_peered":"2023-10-03T19:19:40.441232+0000","last_clean":"2023-10-03T19:19:40.441232+0000","last_became_active":"2023-10-03T19:19:39.469452+0000","last_became_peered":"2023-10-03T19:19:39.469452+0000","last_unstale":"2023-10-03T19:19:40.441232+0000","last_undegraded":"2023-10-03T19:19:40.441232+0000","last_fullsized":"2023-10-03T19:19:40.441232+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:01:20.873119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.441025+0000","last_change":"2023-10-03T19:19:39.503465+0000","last_active":"2023-10-03T19:19:40.441025+0000","last_peered":"2023-10-03T19:19:40.441025+0000","last_clean":"2023-10-03T19:19:40.441025+0000","last_became_active":"2023-10-03T19:19:39.503030+0000","last_became_peered":"2023-10-03T19:19:39.503030+0000","last_unstale":"2023-10-03T19:19:40.441025+0000","last_undegraded":"2023-10-03T19:19:40.441025+0000","last_fullsized":"2023-10-03T19:19:40.441025+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:43:46.831754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.438377+0000","last_change":"2023-10-03T19:19:39.481937+0000","last_active":"2023-10-03T19:19:40.438377+0000","last_peered":"2023-10-03T19:19:40.438377+0000","last_clean":"2023-10-03T19:19:40.438377+0000","last_became_active":"2023-10-03T19:19:39.481270+0000","last_became_peered":"2023-10-03T19:19:39.481270+0000","last_unstale":"2023-10-03T19:19:40.438377+0000","last_undegraded":"2023-10-03T19:19:40.438377+0000","last_fullsized":"2023-10-03T19:19:40.438377+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:30:34.193878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678338+0000","last_change":"2023-10-03T19:19:39.498786+0000","last_active":"2023-10-03T19:19:40.678338+0000","last_peered":"2023-10-03T19:19:40.678338+0000","last_clean":"2023-10-03T19:19:40.678338+0000","last_became_active":"2023-10-03T19:19:39.498287+0000","last_became_peered":"2023-10-03T19:19:39.498287+0000","last_unstale":"2023-10-03T19:19:40.678338+0000","last_undegraded":"2023-10-03T19:19:40.678338+0000","last_fullsized":"2023-10-03T19:19:40.678338+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:01:20.873119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173840+0000","last_change":"2023-10-03T19:19:39.474176+0000","last_active":"2023-10-03T19:19:41.173840+0000","last_peered":"2023-10-03T19:19:41.173840+0000","last_clean":"2023-10-03T19:19:41.173840+0000","last_became_active":"2023-10-03T19:19:39.473801+0000","last_became_peered":"2023-10-03T19:19:39.473801+0000","last_unstale":"2023-10-03T19:19:41.173840+0000","last_undegraded":"2023-10-03T19:19:41.173840+0000","last_fullsized":"2023-10-03T19:19:41.173840+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:16:06.684976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.440240+0000","last_change":"2023-10-03T19:19:39.453506+0000","last_active":"2023-10-03T19:19:40.440240+0000","last_peered":"2023-10-03T19:19:40.440240+0000","last_clean":"2023-10-03T19:19:40.440240+0000","last_became_active":"2023-10-03T19:19:39.452767+0000","last_became_peered":"2023-10-03T19:19:39.452767+0000","last_unstale":"2023-10-03T19:19:40.440240+0000","last_undegraded":"2023-10-03T19:19:40.440240+0000","last_fullsized":"2023-10-03T19:19:40.440240+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:58:52.700889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.677767+0000","last_change":"2023-10-03T19:19:39.501965+0000","last_active":"2023-10-03T19:19:40.677767+0000","last_peered":"2023-10-03T19:19:40.677767+0000","last_clean":"2023-10-03T19:19:40.677767+0000","last_became_active":"2023-10-03T19:19:39.501258+0000","last_became_peered":"2023-10-03T19:19:39.501258+0000","last_unstale":"2023-10-03T19:19:40.677767+0000","last_undegraded":"2023-10-03T19:19:40.677767+0000","last_fullsized":"2023-10-03T19:19:40.677767+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:36:34.926440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.172931+0000","last_change":"2023-10-03T19:19:39.476006+0000","last_active":"2023-10-03T19:19:41.172931+0000","last_peered":"2023-10-03T19:19:41.172931+0000","last_clean":"2023-10-03T19:19:41.172931+0000","last_became_active":"2023-10-03T19:19:39.475740+0000","last_became_peered":"2023-10-03T19:19:39.475740+0000","last_unstale":"2023-10-03T19:19:41.172931+0000","last_undegraded":"2023-10-03T19:19:41.172931+0000","last_fullsized":"2023-10-03T19:19:41.172931+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:38:59.311703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.171259+0000","last_change":"2023-10-03T19:19:39.497559+0000","last_active":"2023-10-03T19:19:41.171259+0000","last_peered":"2023-10-03T19:19:41.171259+0000","last_clean":"2023-10-03T19:19:41.171259+0000","last_became_active":"2023-10-03T19:19:39.497260+0000","last_became_peered":"2023-10-03T19:19:39.497260+0000","last_unstale":"2023-10-03T19:19:41.171259+0000","last_undegraded":"2023-10-03T19:19:41.171259+0000","last_fullsized":"2023-10-03T19:19:41.171259+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:20:12.164636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"97'4","reported_seq":17,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430274+0000","last_change":"2023-10-03T19:19:39.100745+0000","last_active":"2023-10-03T19:19:40.430274+0000","last_peered":"2023-10-03T19:19:40.430274+0000","last_clean":"2023-10-03T19:19:40.430274+0000","last_became_active":"2023-10-03T19:19:39.100413+0000","last_became_peered":"2023-10-03T19:19:39.100413+0000","last_unstale":"2023-10-03T19:19:40.430274+0000","last_undegraded":"2023-10-03T19:19:40.430274+0000","last_fullsized":"2023-10-03T19:19:40.430274+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:21:52.286906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173119+0000","last_change":"2023-10-03T19:19:39.450049+0000","last_active":"2023-10-03T19:19:41.173119+0000","last_peered":"2023-10-03T19:19:41.173119+0000","last_clean":"2023-10-03T19:19:41.173119+0000","last_became_active":"2023-10-03T19:19:39.449771+0000","last_became_peered":"2023-10-03T19:19:39.449771+0000","last_unstale":"2023-10-03T19:19:41.173119+0000","last_undegraded":"2023-10-03T19:19:41.173119+0000","last_fullsized":"2023-10-03T19:19:41.173119+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:14:44.212951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174434+0000","last_change":"2023-10-03T19:19:39.081942+0000","last_active":"2023-10-03T19:19:41.174434+0000","last_peered":"2023-10-03T19:19:41.174434+0000","last_clean":"2023-10-03T19:19:41.174434+0000","last_became_active":"2023-10-03T19:19:39.081434+0000","last_became_peered":"2023-10-03T19:19:39.081434+0000","last_unstale":"2023-10-03T19:19:41.174434+0000","last_undegraded":"2023-10-03T19:19:41.174434+0000","last_fullsized":"2023-10-03T19:19:41.174434+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:44:38.934350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.440288+0000","last_change":"2023-10-03T19:19:39.456943+0000","last_active":"2023-10-03T19:19:40.440288+0000","last_peered":"2023-10-03T19:19:40.440288+0000","last_clean":"2023-10-03T19:19:40.440288+0000","last_became_active":"2023-10-03T19:19:39.456206+0000","last_became_peered":"2023-10-03T19:19:39.456206+0000","last_unstale":"2023-10-03T19:19:40.440288+0000","last_undegraded":"2023-10-03T19:19:40.440288+0000","last_fullsized":"2023-10-03T19:19:40.440288+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:15:08.226909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.440781+0000","last_change":"2023-10-03T19:19:39.098618+0000","last_active":"2023-10-03T19:19:40.440781+0000","last_peered":"2023-10-03T19:19:40.440781+0000","last_clean":"2023-10-03T19:19:40.440781+0000","last_became_active":"2023-10-03T19:19:39.097892+0000","last_became_peered":"2023-10-03T19:19:39.097892+0000","last_unstale":"2023-10-03T19:19:40.440781+0000","last_undegraded":"2023-10-03T19:19:40.440781+0000","last_fullsized":"2023-10-03T19:19:40.440781+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:59:40.941206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.438318+0000","last_change":"2023-10-03T19:19:39.478992+0000","last_active":"2023-10-03T19:19:40.438318+0000","last_peered":"2023-10-03T19:19:40.438318+0000","last_clean":"2023-10-03T19:19:40.438318+0000","last_became_active":"2023-10-03T19:19:39.478233+0000","last_became_peered":"2023-10-03T19:19:39.478233+0000","last_unstale":"2023-10-03T19:19:40.438318+0000","last_undegraded":"2023-10-03T19:19:40.438318+0000","last_fullsized":"2023-10-03T19:19:40.438318+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:30:25.441197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176094+0000","last_change":"2023-10-03T19:19:39.084901+0000","last_active":"2023-10-03T19:19:41.176094+0000","last_peered":"2023-10-03T19:19:41.176094+0000","last_clean":"2023-10-03T19:19:41.176094+0000","last_became_active":"2023-10-03T19:19:39.084399+0000","last_became_peered":"2023-10-03T19:19:39.084399+0000","last_unstale":"2023-10-03T19:19:41.176094+0000","last_undegraded":"2023-10-03T19:19:41.176094+0000","last_fullsized":"2023-10-03T19:19:41.176094+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:37:52.382988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430110+0000","last_change":"2023-10-03T19:19:39.440443+0000","last_active":"2023-10-03T19:19:40.430110+0000","last_peered":"2023-10-03T19:19:40.430110+0000","last_clean":"2023-10-03T19:19:40.430110+0000","last_became_active":"2023-10-03T19:19:39.439566+0000","last_became_peered":"2023-10-03T19:19:39.439566+0000","last_unstale":"2023-10-03T19:19:40.430110+0000","last_undegraded":"2023-10-03T19:19:40.430110+0000","last_fullsized":"2023-10-03T19:19:40.430110+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:36:34.926440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175160+0000","last_change":"2023-10-03T19:19:39.105651+0000","last_active":"2023-10-03T19:19:41.175160+0000","last_peered":"2023-10-03T19:19:41.175160+0000","last_clean":"2023-10-03T19:19:41.175160+0000","last_became_active":"2023-10-03T19:19:39.105103+0000","last_became_peered":"2023-10-03T19:19:39.105103+0000","last_unstale":"2023-10-03T19:19:41.175160+0000","last_undegraded":"2023-10-03T19:19:41.175160+0000","last_fullsized":"2023-10-03T19:19:41.175160+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:01:43.169147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.172240+0000","last_change":"2023-10-03T19:19:39.497566+0000","last_active":"2023-10-03T19:19:41.172240+0000","last_peered":"2023-10-03T19:19:41.172240+0000","last_clean":"2023-10-03T19:19:41.172240+0000","last_became_active":"2023-10-03T19:19:39.497250+0000","last_became_peered":"2023-10-03T19:19:39.497250+0000","last_unstale":"2023-10-03T19:19:41.172240+0000","last_undegraded":"2023-10-03T19:19:41.172240+0000","last_fullsized":"2023-10-03T19:19:41.172240+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:14:04.998930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.437654+0000","last_change":"2023-10-03T19:19:39.097877+0000","last_active":"2023-10-03T19:19:40.437654+0000","last_peered":"2023-10-03T19:19:40.437654+0000","last_clean":"2023-10-03T19:19:40.437654+0000","last_became_active":"2023-10-03T19:19:39.097351+0000","last_became_peered":"2023-10-03T19:19:39.097351+0000","last_unstale":"2023-10-03T19:19:40.437654+0000","last_undegraded":"2023-10-03T19:19:40.437654+0000","last_fullsized":"2023-10-03T19:19:40.437654+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:34:01.631188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678996+0000","last_change":"2023-10-03T19:19:39.501897+0000","last_active":"2023-10-03T19:19:40.678996+0000","last_peered":"2023-10-03T19:19:40.678996+0000","last_clean":"2023-10-03T19:19:40.678996+0000","last_became_active":"2023-10-03T19:19:39.501378+0000","last_became_peered":"2023-10-03T19:19:39.501378+0000","last_unstale":"2023-10-03T19:19:40.678996+0000","last_undegraded":"2023-10-03T19:19:40.678996+0000","last_fullsized":"2023-10-03T19:19:40.678996+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:03:04.699024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.439627+0000","last_change":"2023-10-03T19:19:39.098321+0000","last_active":"2023-10-03T19:19:40.439627+0000","last_peered":"2023-10-03T19:19:40.439627+0000","last_clean":"2023-10-03T19:19:40.439627+0000","last_became_active":"2023-10-03T19:19:39.097705+0000","last_became_peered":"2023-10-03T19:19:39.097705+0000","last_unstale":"2023-10-03T19:19:40.439627+0000","last_undegraded":"2023-10-03T19:19:40.439627+0000","last_fullsized":"2023-10-03T19:19:40.439627+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:24:26.530146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430181+0000","last_change":"2023-10-03T19:19:39.443896+0000","last_active":"2023-10-03T19:19:40.430181+0000","last_peered":"2023-10-03T19:19:40.430181+0000","last_clean":"2023-10-03T19:19:40.430181+0000","last_became_active":"2023-10-03T19:19:39.443185+0000","last_became_peered":"2023-10-03T19:19:39.443185+0000","last_unstale":"2023-10-03T19:19:40.430181+0000","last_undegraded":"2023-10-03T19:19:40.430181+0000","last_fullsized":"2023-10-03T19:19:40.430181+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:59:41.953904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430269+0000","last_change":"2023-10-03T19:19:39.076525+0000","last_active":"2023-10-03T19:19:40.430269+0000","last_peered":"2023-10-03T19:19:40.430269+0000","last_clean":"2023-10-03T19:19:40.430269+0000","last_became_active":"2023-10-03T19:19:39.076125+0000","last_became_peered":"2023-10-03T19:19:39.076125+0000","last_unstale":"2023-10-03T19:19:40.430269+0000","last_undegraded":"2023-10-03T19:19:40.430269+0000","last_fullsized":"2023-10-03T19:19:40.430269+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:27:13.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.171244+0000","last_change":"2023-10-03T19:19:39.497581+0000","last_active":"2023-10-03T19:19:41.171244+0000","last_peered":"2023-10-03T19:19:41.171244+0000","last_clean":"2023-10-03T19:19:41.171244+0000","last_became_active":"2023-10-03T19:19:39.497274+0000","last_became_peered":"2023-10-03T19:19:39.497274+0000","last_unstale":"2023-10-03T19:19:41.171244+0000","last_undegraded":"2023-10-03T19:19:41.171244+0000","last_fullsized":"2023-10-03T19:19:41.171244+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:54:01.904793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.441233+0000","last_change":"2023-10-03T19:19:39.100517+0000","last_active":"2023-10-03T19:19:40.441233+0000","last_peered":"2023-10-03T19:19:40.441233+0000","last_clean":"2023-10-03T19:19:40.441233+0000","last_became_active":"2023-10-03T19:19:39.100003+0000","last_became_peered":"2023-10-03T19:19:39.100003+0000","last_unstale":"2023-10-03T19:19:40.441233+0000","last_undegraded":"2023-10-03T19:19:40.441233+0000","last_fullsized":"2023-10-03T19:19:40.441233+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:02:39.250284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175315+0000","last_change":"2023-10-03T19:19:39.445323+0000","last_active":"2023-10-03T19:19:41.175315+0000","last_peered":"2023-10-03T19:19:41.175315+0000","last_clean":"2023-10-03T19:19:41.175315+0000","last_became_active":"2023-10-03T19:19:39.445022+0000","last_became_peered":"2023-10-03T19:19:39.445022+0000","last_unstale":"2023-10-03T19:19:41.175315+0000","last_undegraded":"2023-10-03T19:19:41.175315+0000","last_fullsized":"2023-10-03T19:19:41.175315+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:14:23.979238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.172339+0000","last_change":"2023-10-03T19:19:39.075931+0000","last_active":"2023-10-03T19:19:41.172339+0000","last_peered":"2023-10-03T19:19:41.172339+0000","last_clean":"2023-10-03T19:19:41.172339+0000","last_became_active":"2023-10-03T19:19:39.075609+0000","last_became_peered":"2023-10-03T19:19:39.075609+0000","last_unstale":"2023-10-03T19:19:41.172339+0000","last_undegraded":"2023-10-03T19:19:41.172339+0000","last_fullsized":"2023-10-03T19:19:41.172339+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:11:18.504212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173596+0000","last_change":"2023-10-03T19:19:39.450085+0000","last_active":"2023-10-03T19:19:41.173596+0000","last_peered":"2023-10-03T19:19:41.173596+0000","last_clean":"2023-10-03T19:19:41.173596+0000","last_became_active":"2023-10-03T19:19:39.449720+0000","last_became_peered":"2023-10-03T19:19:39.449720+0000","last_unstale":"2023-10-03T19:19:41.173596+0000","last_undegraded":"2023-10-03T19:19:41.173596+0000","last_fullsized":"2023-10-03T19:19:41.173596+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:07:03.874445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"97'3","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175361+0000","last_change":"2023-10-03T19:19:39.083465+0000","last_active":"2023-10-03T19:19:41.175361+0000","last_peered":"2023-10-03T19:19:41.175361+0000","last_clean":"2023-10-03T19:19:41.175361+0000","last_became_active":"2023-10-03T19:19:39.082723+0000","last_became_peered":"2023-10-03T19:19:39.082723+0000","last_unstale":"2023-10-03T19:19:41.175361+0000","last_undegraded":"2023-10-03T19:19:41.175361+0000","last_fullsized":"2023-10-03T19:19:41.175361+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:45:27.547248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175742+0000","last_change":"2023-10-03T19:19:39.446159+0000","last_active":"2023-10-03T19:19:41.175742+0000","last_peered":"2023-10-03T19:19:41.175742+0000","last_clean":"2023-10-03T19:19:41.175742+0000","last_became_active":"2023-10-03T19:19:39.445909+0000","last_became_peered":"2023-10-03T19:19:39.445909+0000","last_unstale":"2023-10-03T19:19:41.175742+0000","last_undegraded":"2023-10-03T19:19:41.175742+0000","last_fullsized":"2023-10-03T19:19:41.175742+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:27:32.906536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"97'6","reported_seq":19,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678541+0000","last_change":"2023-10-03T19:19:39.092215+0000","last_active":"2023-10-03T19:19:40.678541+0000","last_peered":"2023-10-03T19:19:40.678541+0000","last_clean":"2023-10-03T19:19:40.678541+0000","last_became_active":"2023-10-03T19:19:39.085602+0000","last_became_peered":"2023-10-03T19:19:39.085602+0000","last_unstale":"2023-10-03T19:19:40.678541+0000","last_undegraded":"2023-10-03T19:19:40.678541+0000","last_fullsized":"2023-10-03T19:19:40.678541+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:02:39.250284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.437932+0000","last_change":"2023-10-03T19:19:39.450795+0000","last_active":"2023-10-03T19:19:40.437932+0000","last_peered":"2023-10-03T19:19:40.437932+0000","last_clean":"2023-10-03T19:19:40.437932+0000","last_became_active":"2023-10-03T19:19:39.450013+0000","last_became_peered":"2023-10-03T19:19:39.450013+0000","last_unstale":"2023-10-03T19:19:40.437932+0000","last_undegraded":"2023-10-03T19:19:40.437932+0000","last_fullsized":"2023-10-03T19:19:40.437932+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:14:58.016231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176071+0000","last_change":"2023-10-03T19:19:39.081438+0000","last_active":"2023-10-03T19:19:41.176071+0000","last_peered":"2023-10-03T19:19:41.176071+0000","last_clean":"2023-10-03T19:19:41.176071+0000","last_became_active":"2023-10-03T19:19:39.081161+0000","last_became_peered":"2023-10-03T19:19:39.081161+0000","last_unstale":"2023-10-03T19:19:41.176071+0000","last_undegraded":"2023-10-03T19:19:41.176071+0000","last_fullsized":"2023-10-03T19:19:41.176071+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:33:20.709972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678584+0000","last_change":"2023-10-03T19:19:39.492226+0000","last_active":"2023-10-03T19:19:40.678584+0000","last_peered":"2023-10-03T19:19:40.678584+0000","last_clean":"2023-10-03T19:19:40.678584+0000","last_became_active":"2023-10-03T19:19:39.491322+0000","last_became_peered":"2023-10-03T19:19:39.491322+0000","last_unstale":"2023-10-03T19:19:40.678584+0000","last_undegraded":"2023-10-03T19:19:40.678584+0000","last_fullsized":"2023-10-03T19:19:40.678584+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:17:18.221489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430104+0000","last_change":"2023-10-03T19:19:39.077931+0000","last_active":"2023-10-03T19:19:40.430104+0000","last_peered":"2023-10-03T19:19:40.430104+0000","last_clean":"2023-10-03T19:19:40.430104+0000","last_became_active":"2023-10-03T19:19:39.077342+0000","last_became_peered":"2023-10-03T19:19:39.077342+0000","last_unstale":"2023-10-03T19:19:40.430104+0000","last_undegraded":"2023-10-03T19:19:40.430104+0000","last_fullsized":"2023-10-03T19:19:40.430104+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:15:07.214211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174038+0000","last_change":"2023-10-03T19:19:39.476040+0000","last_active":"2023-10-03T19:19:41.174038+0000","last_peered":"2023-10-03T19:19:41.174038+0000","last_clean":"2023-10-03T19:19:41.174038+0000","last_became_active":"2023-10-03T19:19:39.475802+0000","last_became_peered":"2023-10-03T19:19:39.475802+0000","last_unstale":"2023-10-03T19:19:41.174038+0000","last_undegraded":"2023-10-03T19:19:41.174038+0000","last_fullsized":"2023-10-03T19:19:41.174038+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:49:54.029650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173284+0000","last_change":"2023-10-03T19:19:39.084666+0000","last_active":"2023-10-03T19:19:41.173284+0000","last_peered":"2023-10-03T19:19:41.173284+0000","last_clean":"2023-10-03T19:19:41.173284+0000","last_became_active":"2023-10-03T19:19:39.084383+0000","last_became_peered":"2023-10-03T19:19:39.084383+0000","last_unstale":"2023-10-03T19:19:41.173284+0000","last_undegraded":"2023-10-03T19:19:41.173284+0000","last_fullsized":"2023-10-03T19:19:41.173284+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:56:48.966597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.172503+0000","last_change":"2023-10-03T19:19:39.466195+0000","last_active":"2023-10-03T19:19:41.172503+0000","last_peered":"2023-10-03T19:19:41.172503+0000","last_clean":"2023-10-03T19:19:41.172503+0000","last_became_active":"2023-10-03T19:19:39.465907+0000","last_became_peered":"2023-10-03T19:19:39.465907+0000","last_unstale":"2023-10-03T19:19:41.172503+0000","last_undegraded":"2023-10-03T19:19:41.172503+0000","last_fullsized":"2023-10-03T19:19:41.172503+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:23:17.019819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"97'8","reported_seq":21,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.439804+0000","last_change":"2023-10-03T19:19:39.099722+0000","last_active":"2023-10-03T19:19:40.439804+0000","last_peered":"2023-10-03T19:19:40.439804+0000","last_clean":"2023-10-03T19:19:40.439804+0000","last_became_active":"2023-10-03T19:19:39.099110+0000","last_became_peered":"2023-10-03T19:19:39.099110+0000","last_unstale":"2023-10-03T19:19:40.439804+0000","last_undegraded":"2023-10-03T19:19:40.439804+0000","last_fullsized":"2023-10-03T19:19:40.439804+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:24:20.639774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.170971+0000","last_change":"2023-10-03T19:19:39.440735+0000","last_active":"2023-10-03T19:19:41.170971+0000","last_peered":"2023-10-03T19:19:41.170971+0000","last_clean":"2023-10-03T19:19:41.170971+0000","last_became_active":"2023-10-03T19:19:39.440417+0000","last_became_peered":"2023-10-03T19:19:39.440417+0000","last_unstale":"2023-10-03T19:19:41.170971+0000","last_undegraded":"2023-10-03T19:19:41.170971+0000","last_fullsized":"2023-10-03T19:19:41.170971+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:50:23.055857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176623+0000","last_change":"2023-10-03T19:19:39.078321+0000","last_active":"2023-10-03T19:19:41.176623+0000","last_peered":"2023-10-03T19:19:41.176623+0000","last_clean":"2023-10-03T19:19:41.176623+0000","last_became_active":"2023-10-03T19:19:39.078000+0000","last_became_peered":"2023-10-03T19:19:39.078000+0000","last_unstale":"2023-10-03T19:19:41.176623+0000","last_undegraded":"2023-10-03T19:19:41.176623+0000","last_fullsized":"2023-10-03T19:19:41.176623+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:42:42.684913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.439742+0000","last_change":"2023-10-03T19:19:39.453941+0000","last_active":"2023-10-03T19:19:40.439742+0000","last_peered":"2023-10-03T19:19:40.439742+0000","last_clean":"2023-10-03T19:19:40.439742+0000","last_became_active":"2023-10-03T19:19:39.453189+0000","last_became_peered":"2023-10-03T19:19:39.453189+0000","last_unstale":"2023-10-03T19:19:40.439742+0000","last_undegraded":"2023-10-03T19:19:40.439742+0000","last_fullsized":"2023-10-03T19:19:40.439742+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:17:57.802389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"98'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.172006+0000","last_change":"2023-10-03T19:19:39.095166+0000","last_active":"2023-10-03T19:19:41.172006+0000","last_peered":"2023-10-03T19:19:41.172006+0000","last_clean":"2023-10-03T19:19:41.172006+0000","last_became_active":"2023-10-03T19:19:39.094914+0000","last_became_peered":"2023-10-03T19:19:39.094914+0000","last_unstale":"2023-10-03T19:19:41.172006+0000","last_undegraded":"2023-10-03T19:19:41.172006+0000","last_fullsized":"2023-10-03T19:19:41.172006+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:13:33.294532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.430357+0000","last_change":"2023-10-03T19:19:39.498605+0000","last_active":"2023-10-03T19:19:40.430357+0000","last_peered":"2023-10-03T19:19:40.430357+0000","last_clean":"2023-10-03T19:19:40.430357+0000","last_became_active":"2023-10-03T19:19:39.498286+0000","last_became_peered":"2023-10-03T19:19:39.498286+0000","last_unstale":"2023-10-03T19:19:40.430357+0000","last_undegraded":"2023-10-03T19:19:40.430357+0000","last_fullsized":"2023-10-03T19:19:40.430357+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:43:46.831754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678665+0000","last_change":"2023-10-03T19:19:39.093647+0000","last_active":"2023-10-03T19:19:40.678665+0000","last_peered":"2023-10-03T19:19:40.678665+0000","last_clean":"2023-10-03T19:19:40.678665+0000","last_became_active":"2023-10-03T19:19:39.093121+0000","last_became_peered":"2023-10-03T19:19:39.093121+0000","last_unstale":"2023-10-03T19:19:40.678665+0000","last_undegraded":"2023-10-03T19:19:40.678665+0000","last_fullsized":"2023-10-03T19:19:40.678665+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:09:28.979796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.438171+0000","last_change":"2023-10-03T19:19:39.469186+0000","last_active":"2023-10-03T19:19:40.438171+0000","last_peered":"2023-10-03T19:19:40.438171+0000","last_clean":"2023-10-03T19:19:40.438171+0000","last_became_active":"2023-10-03T19:19:39.468434+0000","last_became_peered":"2023-10-03T19:19:39.468434+0000","last_unstale":"2023-10-03T19:19:40.438171+0000","last_undegraded":"2023-10-03T19:19:40.438171+0000","last_fullsized":"2023-10-03T19:19:40.438171+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:16:47.421662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176007+0000","last_change":"2023-10-03T19:19:39.100292+0000","last_active":"2023-10-03T19:19:41.176007+0000","last_peered":"2023-10-03T19:19:41.176007+0000","last_clean":"2023-10-03T19:19:41.176007+0000","last_became_active":"2023-10-03T19:19:39.100004+0000","last_became_peered":"2023-10-03T19:19:39.100004+0000","last_unstale":"2023-10-03T19:19:41.176007+0000","last_undegraded":"2023-10-03T19:19:41.176007+0000","last_fullsized":"2023-10-03T19:19:41.176007+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:32:48.746616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174005+0000","last_change":"2023-10-03T19:19:39.450670+0000","last_active":"2023-10-03T19:19:41.174005+0000","last_peered":"2023-10-03T19:19:41.174005+0000","last_clean":"2023-10-03T19:19:41.174005+0000","last_became_active":"2023-10-03T19:19:39.450363+0000","last_became_peered":"2023-10-03T19:19:39.450363+0000","last_unstale":"2023-10-03T19:19:41.174005+0000","last_undegraded":"2023-10-03T19:19:41.174005+0000","last_fullsized":"2023-10-03T19:19:41.174005+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:38:52.937448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.440652+0000","last_change":"2023-10-03T19:19:39.093626+0000","last_active":"2023-10-03T19:19:40.440652+0000","last_peered":"2023-10-03T19:19:40.440652+0000","last_clean":"2023-10-03T19:19:40.440652+0000","last_became_active":"2023-10-03T19:19:39.093048+0000","last_became_peered":"2023-10-03T19:19:39.093048+0000","last_unstale":"2023-10-03T19:19:40.440652+0000","last_undegraded":"2023-10-03T19:19:40.440652+0000","last_fullsized":"2023-10-03T19:19:40.440652+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:36:33.913742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174002+0000","last_change":"2023-10-03T19:19:39.451443+0000","last_active":"2023-10-03T19:19:41.174002+0000","last_peered":"2023-10-03T19:19:41.174002+0000","last_clean":"2023-10-03T19:19:41.174002+0000","last_became_active":"2023-10-03T19:19:39.451178+0000","last_became_peered":"2023-10-03T19:19:39.451178+0000","last_unstale":"2023-10-03T19:19:41.174002+0000","last_undegraded":"2023-10-03T19:19:41.174002+0000","last_fullsized":"2023-10-03T19:19:41.174002+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:23:35.520091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173972+0000","last_change":"2023-10-03T19:19:39.085006+0000","last_active":"2023-10-03T19:19:41.173972+0000","last_peered":"2023-10-03T19:19:41.173972+0000","last_clean":"2023-10-03T19:19:41.173972+0000","last_became_active":"2023-10-03T19:19:39.084520+0000","last_became_peered":"2023-10-03T19:19:39.084520+0000","last_unstale":"2023-10-03T19:19:41.173972+0000","last_undegraded":"2023-10-03T19:19:41.173972+0000","last_fullsized":"2023-10-03T19:19:41.173972+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:32:44.644764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175389+0000","last_change":"2023-10-03T19:19:39.490667+0000","last_active":"2023-10-03T19:19:41.175389+0000","last_peered":"2023-10-03T19:19:41.175389+0000","last_clean":"2023-10-03T19:19:41.175389+0000","last_became_active":"2023-10-03T19:19:39.489883+0000","last_became_peered":"2023-10-03T19:19:39.489883+0000","last_unstale":"2023-10-03T19:19:41.175389+0000","last_undegraded":"2023-10-03T19:19:41.175389+0000","last_fullsized":"2023-10-03T19:19:41.175389+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:47:44.558983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678162+0000","last_change":"2023-10-03T19:19:39.093636+0000","last_active":"2023-10-03T19:19:40.678162+0000","last_peered":"2023-10-03T19:19:40.678162+0000","last_clean":"2023-10-03T19:19:40.678162+0000","last_became_active":"2023-10-03T19:19:39.093026+0000","last_became_peered":"2023-10-03T19:19:39.093026+0000","last_unstale":"2023-10-03T19:19:40.678162+0000","last_undegraded":"2023-10-03T19:19:40.678162+0000","last_fullsized":"2023-10-03T19:19:40.678162+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:43:45.819056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.439410+0000","last_change":"2023-10-03T19:19:39.482121+0000","last_active":"2023-10-03T19:19:40.439410+0000","last_peered":"2023-10-03T19:19:40.439410+0000","last_clean":"2023-10-03T19:19:40.439410+0000","last_became_active":"2023-10-03T19:19:39.481367+0000","last_became_peered":"2023-10-03T19:19:39.481367+0000","last_unstale":"2023-10-03T19:19:40.439410+0000","last_undegraded":"2023-10-03T19:19:40.439410+0000","last_fullsized":"2023-10-03T19:19:40.439410+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:03:16.287872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173694+0000","last_change":"2023-10-03T19:19:39.087025+0000","last_active":"2023-10-03T19:19:41.173694+0000","last_peered":"2023-10-03T19:19:41.173694+0000","last_clean":"2023-10-03T19:19:41.173694+0000","last_became_active":"2023-10-03T19:19:39.086598+0000","last_became_peered":"2023-10-03T19:19:39.086598+0000","last_unstale":"2023-10-03T19:19:41.173694+0000","last_undegraded":"2023-10-03T19:19:41.173694+0000","last_fullsized":"2023-10-03T19:19:41.173694+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:39:18.515681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.437780+0000","last_change":"2023-10-03T19:19:39.446998+0000","last_active":"2023-10-03T19:19:40.437780+0000","last_peered":"2023-10-03T19:19:40.437780+0000","last_clean":"2023-10-03T19:19:40.437780+0000","last_became_active":"2023-10-03T19:19:39.446247+0000","last_became_peered":"2023-10-03T19:19:39.446247+0000","last_unstale":"2023-10-03T19:19:40.437780+0000","last_undegraded":"2023-10-03T19:19:40.437780+0000","last_fullsized":"2023-10-03T19:19:40.437780+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:45:41.806499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174434+0000","last_change":"2023-10-03T19:19:39.077632+0000","last_active":"2023-10-03T19:19:41.174434+0000","last_peered":"2023-10-03T19:19:41.174434+0000","last_clean":"2023-10-03T19:19:41.174434+0000","last_became_active":"2023-10-03T19:19:39.077243+0000","last_became_peered":"2023-10-03T19:19:39.077243+0000","last_unstale":"2023-10-03T19:19:41.174434+0000","last_undegraded":"2023-10-03T19:19:41.174434+0000","last_fullsized":"2023-10-03T19:19:41.174434+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:11:33.305806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":316,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175066+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:19:41.175066+0000","last_peered":"2023-10-03T19:19:41.175066+0000","last_clean":"2023-10-03T19:19:41.175066+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:19:41.175066+0000","last_undegraded":"2023-10-03T19:19:41.175066+0000","last_fullsized":"2023-10-03T19:19:41.175066+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:01:58.556394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":160,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.438490+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:19:40.438490+0000","last_peered":"2023-10-03T19:19:40.438490+0000","last_clean":"2023-10-03T19:19:40.438490+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:19:40.438490+0000","last_undegraded":"2023-10-03T19:19:40.438490+0000","last_fullsized":"2023-10-03T19:19:40.438490+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:38:46.008633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.677990+0000","last_change":"2023-10-03T19:19:39.490296+0000","last_active":"2023-10-03T19:19:40.677990+0000","last_peered":"2023-10-03T19:19:40.677990+0000","last_clean":"2023-10-03T19:19:40.677990+0000","last_became_active":"2023-10-03T19:19:39.489715+0000","last_became_peered":"2023-10-03T19:19:39.489715+0000","last_unstale":"2023-10-03T19:19:40.677990+0000","last_undegraded":"2023-10-03T19:19:40.677990+0000","last_fullsized":"2023-10-03T19:19:40.677990+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:21:53.299603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175437+0000","last_change":"2023-10-03T19:19:39.092502+0000","last_active":"2023-10-03T19:19:41.175437+0000","last_peered":"2023-10-03T19:19:41.175437+0000","last_clean":"2023-10-03T19:19:41.175437+0000","last_became_active":"2023-10-03T19:19:39.091671+0000","last_became_peered":"2023-10-03T19:19:39.091671+0000","last_unstale":"2023-10-03T19:19:41.175437+0000","last_undegraded":"2023-10-03T19:19:41.175437+0000","last_fullsized":"2023-10-03T19:19:41.175437+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:28:58.772881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":164,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174651+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:19:41.174651+0000","last_peered":"2023-10-03T19:19:41.174651+0000","last_clean":"2023-10-03T19:19:41.174651+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:19:41.174651+0000","last_undegraded":"2023-10-03T19:19:41.174651+0000","last_fullsized":"2023-10-03T19:19:41.174651+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:28:06.684655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175720+0000","last_change":"2023-10-03T19:19:39.474081+0000","last_active":"2023-10-03T19:19:41.175720+0000","last_peered":"2023-10-03T19:19:41.175720+0000","last_clean":"2023-10-03T19:19:41.175720+0000","last_became_active":"2023-10-03T19:19:39.473795+0000","last_became_peered":"2023-10-03T19:19:39.473795+0000","last_unstale":"2023-10-03T19:19:41.175720+0000","last_undegraded":"2023-10-03T19:19:41.175720+0000","last_fullsized":"2023-10-03T19:19:41.175720+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:50:56.639365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.438265+0000","last_change":"2023-10-03T19:19:39.097664+0000","last_active":"2023-10-03T19:19:40.438265+0000","last_peered":"2023-10-03T19:19:40.438265+0000","last_clean":"2023-10-03T19:19:40.438265+0000","last_became_active":"2023-10-03T19:19:39.097135+0000","last_became_peered":"2023-10-03T19:19:39.097135+0000","last_unstale":"2023-10-03T19:19:40.438265+0000","last_undegraded":"2023-10-03T19:19:40.438265+0000","last_fullsized":"2023-10-03T19:19:40.438265+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:36:58.310785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173371+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:19:41.173371+0000","last_peered":"2023-10-03T19:19:41.173371+0000","last_clean":"2023-10-03T19:19:41.173371+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:19:41.173371+0000","last_undegraded":"2023-10-03T19:19:41.173371+0000","last_fullsized":"2023-10-03T19:19:41.173371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:50:13.204633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173376+0000","last_change":"2023-10-03T19:19:39.445108+0000","last_active":"2023-10-03T19:19:41.173376+0000","last_peered":"2023-10-03T19:19:41.173376+0000","last_clean":"2023-10-03T19:19:41.173376+0000","last_became_active":"2023-10-03T19:19:39.443964+0000","last_became_peered":"2023-10-03T19:19:39.443964+0000","last_unstale":"2023-10-03T19:19:41.173376+0000","last_undegraded":"2023-10-03T19:19:41.173376+0000","last_fullsized":"2023-10-03T19:19:41.173376+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:50:29.706153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678974+0000","last_change":"2023-10-03T19:19:39.099820+0000","last_active":"2023-10-03T19:19:40.678974+0000","last_peered":"2023-10-03T19:19:40.678974+0000","last_clean":"2023-10-03T19:19:40.678974+0000","last_became_active":"2023-10-03T19:19:39.094297+0000","last_became_peered":"2023-10-03T19:19:39.094297+0000","last_unstale":"2023-10-03T19:19:40.678974+0000","last_undegraded":"2023-10-03T19:19:40.678974+0000","last_fullsized":"2023-10-03T19:19:40.678974+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:25:05.736398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":160,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.437749+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:19:40.437749+0000","last_peered":"2023-10-03T19:19:40.437749+0000","last_clean":"2023-10-03T19:19:40.437749+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:19:40.437749+0000","last_undegraded":"2023-10-03T19:19:40.437749+0000","last_fullsized":"2023-10-03T19:19:40.437749+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:43:31.287893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.429963+0000","last_change":"2023-10-03T19:19:39.499012+0000","last_active":"2023-10-03T19:19:40.429963+0000","last_peered":"2023-10-03T19:19:40.429963+0000","last_clean":"2023-10-03T19:19:40.429963+0000","last_became_active":"2023-10-03T19:19:39.498726+0000","last_became_peered":"2023-10-03T19:19:39.498726+0000","last_unstale":"2023-10-03T19:19:40.429963+0000","last_undegraded":"2023-10-03T19:19:40.429963+0000","last_fullsized":"2023-10-03T19:19:40.429963+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:24:21.652472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.678086+0000","last_change":"2023-10-03T19:19:39.090362+0000","last_active":"2023-10-03T19:19:40.678086+0000","last_peered":"2023-10-03T19:19:40.678086+0000","last_clean":"2023-10-03T19:19:40.678086+0000","last_became_active":"2023-10-03T19:19:39.089665+0000","last_became_peered":"2023-10-03T19:19:39.089665+0000","last_unstale":"2023-10-03T19:19:40.678086+0000","last_undegraded":"2023-10-03T19:19:40.678086+0000","last_fullsized":"2023-10-03T19:19:40.678086+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:27:13.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":156,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176195+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:19:41.176195+0000","last_peered":"2023-10-03T19:19:41.176195+0000","last_clean":"2023-10-03T19:19:41.176195+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:19:41.176195+0000","last_undegraded":"2023-10-03T19:19:41.176195+0000","last_fullsized":"2023-10-03T19:19:41.176195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:20:40.902125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174641+0000","last_change":"2023-10-03T19:19:39.451521+0000","last_active":"2023-10-03T19:19:41.174641+0000","last_peered":"2023-10-03T19:19:41.174641+0000","last_clean":"2023-10-03T19:19:41.174641+0000","last_became_active":"2023-10-03T19:19:39.451224+0000","last_became_peered":"2023-10-03T19:19:39.451224+0000","last_unstale":"2023-10-03T19:19:41.174641+0000","last_undegraded":"2023-10-03T19:19:41.174641+0000","last_fullsized":"2023-10-03T19:19:41.174641+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:50:20.369948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173326+0000","last_change":"2023-10-03T19:19:39.072003+0000","last_active":"2023-10-03T19:19:41.173326+0000","last_peered":"2023-10-03T19:19:41.173326+0000","last_clean":"2023-10-03T19:19:41.173326+0000","last_became_active":"2023-10-03T19:19:39.071324+0000","last_became_peered":"2023-10-03T19:19:39.071324+0000","last_unstale":"2023-10-03T19:19:41.173326+0000","last_undegraded":"2023-10-03T19:19:41.173326+0000","last_fullsized":"2023-10-03T19:19:41.173326+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:01:20.263082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":164,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.175496+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:19:41.175496+0000","last_peered":"2023-10-03T19:19:41.175496+0000","last_clean":"2023-10-03T19:19:41.175496+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:19:41.175496+0000","last_undegraded":"2023-10-03T19:19:41.175496+0000","last_fullsized":"2023-10-03T19:19:41.175496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:44:47.179646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.171255+0000","last_change":"2023-10-03T19:19:39.443144+0000","last_active":"2023-10-03T19:19:41.171255+0000","last_peered":"2023-10-03T19:19:41.171255+0000","last_clean":"2023-10-03T19:19:41.171255+0000","last_became_active":"2023-10-03T19:19:39.442671+0000","last_became_peered":"2023-10-03T19:19:39.442671+0000","last_unstale":"2023-10-03T19:19:41.171255+0000","last_undegraded":"2023-10-03T19:19:41.171255+0000","last_fullsized":"2023-10-03T19:19:41.171255+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:46:01.717770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.174033+0000","last_change":"2023-10-03T19:19:39.080203+0000","last_active":"2023-10-03T19:19:41.174033+0000","last_peered":"2023-10-03T19:19:41.174033+0000","last_clean":"2023-10-03T19:19:41.174033+0000","last_became_active":"2023-10-03T19:19:39.079875+0000","last_became_peered":"2023-10-03T19:19:39.079875+0000","last_unstale":"2023-10-03T19:19:41.174033+0000","last_undegraded":"2023-10-03T19:19:41.174033+0000","last_fullsized":"2023-10-03T19:19:41.174033+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:47:10.549041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":156,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.176538+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:19:41.176538+0000","last_peered":"2023-10-03T19:19:41.176538+0000","last_clean":"2023-10-03T19:19:41.176538+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:19:41.176538+0000","last_undegraded":"2023-10-03T19:19:41.176538+0000","last_fullsized":"2023-10-03T19:19:41.176538+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:00:06.011070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.172230+0000","last_change":"2023-10-03T19:19:39.440190+0000","last_active":"2023-10-03T19:19:41.172230+0000","last_peered":"2023-10-03T19:19:41.172230+0000","last_clean":"2023-10-03T19:19:41.172230+0000","last_became_active":"2023-10-03T19:19:39.439885+0000","last_became_peered":"2023-10-03T19:19:39.439885+0000","last_unstale":"2023-10-03T19:19:41.172230+0000","last_undegraded":"2023-10-03T19:19:41.172230+0000","last_fullsized":"2023-10-03T19:19:41.172230+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:39.034212+0000","last_clean_scrub_stamp":"2023-10-03T19:19:39.034212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:20:35.651651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:41.173183+0000","last_change":"2023-10-03T19:19:39.073332+0000","last_active":"2023-10-03T19:19:41.173183+0000","last_peered":"2023-10-03T19:19:41.173183+0000","last_clean":"2023-10-03T19:19:41.173183+0000","last_became_active":"2023-10-03T19:19:39.072635+0000","last_became_peered":"2023-10-03T19:19:39.072635+0000","last_unstale":"2023-10-03T19:19:41.173183+0000","last_undegraded":"2023-10-03T19:19:41.173183+0000","last_fullsized":"2023-10-03T19:19:41.173183+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:19:38.021514+0000","last_clean_scrub_stamp":"2023-10-03T19:19:38.021514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:58:24.112901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":156,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-03T19:19:40.679025+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:19:40.679025+0000","last_peered":"2023-10-03T19:19:40.679025+0000","last_clean":"2023-10-03T19:19:40.679025+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:19:40.679025+0000","last_undegraded":"2023-10-03T19:19:40.679025+0000","last_fullsized":"2023-10-03T19:19:40.679025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:11:45.085836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509531,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33704,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":32448,"kb_avail":94338136,"statfs":{"total":96636764160,"available":96602251264,"internally_reserved":0,"allocated":1277952,"data_stored":1142210,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":33226752},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.85899999999999999,"15min":0.92700000000000005},"min":{"1min":0.66300000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1950000000000001,"5min":1.206,"15min":4.0469999999999997},"last":2.1080000000000001},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.85299999999999998,"15min":0.82099999999999995},"min":{"1min":0.55200000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.177,"5min":1.2310000000000001,"15min":1.3420000000000001},"last":1.121}]},{"osd":1,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.86299999999999999,"15min":0.98599999999999999},"min":{"1min":0.61899999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1359999999999999,"5min":1.3200000000000001,"15min":3.8239999999999998},"last":2.298},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.89800000000000002,"15min":0.87},"min":{"1min":0.64500000000000002,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.034}]},{"osd":2,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.95899999999999996,"15min":0.88400000000000001},"min":{"1min":0.55300000000000005,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1719999999999999,"5min":6.0449999999999999,"15min":6.0449999999999999},"last":4.4779999999999998},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.94199999999999995,"15min":1.0109999999999999},"min":{"1min":0.69999999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.296,"5min":1.5800000000000001,"15min":3.98},"last":2.673}]},{"osd":3,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.034,"15min":0.95799999999999996},"min":{"1min":0.68500000000000005,"5min":0.63800000000000001,"15min":0.51100000000000001},"max":{"1min":1.232,"5min":6.125,"15min":6.125},"last":4.3650000000000002},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.97599999999999998,"15min":1.0840000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.175,"5min":1.444,"15min":3.9140000000000001},"last":1.593}]},{"osd":4,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.89800000000000002,"15min":1.0920000000000001},"min":{"1min":0.61599999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":5.1130000000000004},"last":2.4769999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.016,"15min":1.018},"min":{"1min":0.70699999999999996,"5min":0.629,"15min":0.629},"max":{"1min":1.214,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":12.196999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.006,"15min":1.2010000000000001},"min":{"1min":0.63700000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2470000000000001,"5min":1.349,"15min":5.1859999999999999},"last":2.581},{"interface":"front","average":{"1min":1.004,"5min":1.0209999999999999,"15min":1.115},"min":{"1min":0.69299999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.29,"5min":1.2949999999999999,"15min":2.0609999999999999},"last":1.6719999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0740000000000001,"15min":1.093},"min":{"1min":0.80000000000000004,"5min":0.75700000000000001,"15min":0.69399999999999995},"max":{"1min":1.3839999999999999,"5min":1.4890000000000001,"15min":1.5449999999999999},"last":1.7609999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.1459999999999999,"15min":1.167},"min":{"1min":0.77800000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.232,"5min":6.1580000000000004,"15min":6.1580000000000004},"last":4.5570000000000004}]}]},{"osd":6,"up_from":15,"seq":64424509531,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26992,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":25792,"kb_avail":94344848,"statfs":{"total":96636764160,"available":96609124352,"internally_reserved":0,"allocated":1220608,"data_stored":552686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":26411008},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.84599999999999997,"15min":0.82699999999999996},"min":{"1min":0.54100000000000004,"5min":0.45400000000000001,"15min":0.44600000000000001},"max":{"1min":1.234,"5min":1.3340000000000001,"15min":1.504},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.91100000000000003,"15min":0.88900000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.44600000000000001},"max":{"1min":1.1080000000000001,"5min":1.423,"15min":1.839},"last":1.2430000000000001}]},{"osd":1,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.86699999999999999,"15min":0.84699999999999998},"min":{"1min":0.56000000000000005,"5min":0.52100000000000002,"15min":0.504},"max":{"1min":1.1859999999999999,"5min":1.27,"15min":2.0150000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.88900000000000001,"15min":0.88200000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.161,"5min":1.448,"15min":1.448},"last":0.73599999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.93799999999999994,"15min":0.88900000000000001},"min":{"1min":0.66400000000000003,"5min":0.59199999999999997,"15min":0.51900000000000002},"max":{"1min":1.4430000000000001,"5min":1.528,"15min":1.528},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.92700000000000005,"15min":0.92500000000000004},"min":{"1min":0.60899999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1519999999999999,"5min":1.369,"15min":1.546},"last":0.96199999999999997}]},{"osd":3,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.96299999999999997,"15min":0.97899999999999998},"min":{"1min":0.68899999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.298,"5min":1.377,"15min":1.6990000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90700000000000003,"15min":0.90800000000000003},"min":{"1min":0.70199999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.143,"5min":1.206,"15min":2.121},"last":0.79600000000000004}]},{"osd":4,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.91600000000000004,"15min":0.998},"min":{"1min":0.67400000000000004,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.335,"5min":1.339,"15min":1.95},"last":1.075},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.995,"15min":1.0680000000000001},"min":{"1min":0.64400000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4490000000000001,"5min":1.504,"15min":1.7709999999999999},"last":1.1120000000000001}]},{"osd":5,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.90700000000000003,"15min":0.99199999999999999},"min":{"1min":0.624,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.226,"5min":1.3200000000000001,"15min":2.2570000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.048,"15min":1.103},"min":{"1min":0.71799999999999997,"5min":0.68300000000000005,"15min":0.68100000000000005},"max":{"1min":1.5009999999999999,"5min":1.524,"15min":2.0619999999999998},"last":1.2010000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.071,"15min":1.109},"min":{"1min":0.748,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.639,"5min":1.639,"15min":2.0049999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.044,"15min":1.0820000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.61899999999999999},"max":{"1min":1.3879999999999999,"5min":1.4350000000000001,"15min":2.4249999999999998},"last":1.151}]}]},{"osd":4,"up_from":15,"seq":64424509532,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42152,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":40960,"kb_avail":94329688,"statfs":{"total":96636764160,"available":96593600512,"internally_reserved":0,"allocated":1212416,"data_stored":551774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":41943040},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":1.0600000000000001,"15min":0.875},"min":{"1min":0.64200000000000002,"5min":0.54700000000000004,"15min":0.50600000000000001},"max":{"1min":1.0600000000000001,"5min":17.686,"15min":17.686},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.90100000000000002,"5min":1.02,"15min":0.89000000000000001},"min":{"1min":0.64000000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.28,"5min":16.925999999999998,"15min":16.925999999999998},"last":0.622}]},{"osd":1,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.085,"15min":0.98499999999999999},"min":{"1min":0.67700000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1759999999999999,"5min":16.640999999999998,"15min":16.640999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":1.089,"15min":0.93400000000000005},"min":{"1min":0.67300000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.151,"5min":17.59,"15min":17.59},"last":0.80700000000000005}]},{"osd":2,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.997,"15min":0.94299999999999995},"min":{"1min":0.70699999999999996,"5min":0.56200000000000006,"15min":0.53200000000000003},"max":{"1min":1.1180000000000001,"5min":8.5630000000000006,"15min":8.5630000000000006},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.93999999999999995,"5min":1.143,"15min":1.01},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.175,"5min":17.734000000000002,"15min":17.734000000000002},"last":0.88800000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.0880000000000001,"15min":0.94299999999999995},"min":{"1min":0.72499999999999998,"5min":0.61499999999999999,"15min":0.53900000000000003},"max":{"1min":1.242,"5min":16.98,"15min":16.98},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.997,"5min":1.161,"15min":1.105},"min":{"1min":0.66900000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2789999999999999,"5min":16.434000000000001,"15min":16.434000000000001},"last":0.82999999999999996}]},{"osd":5,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":1.1020000000000001,"15min":1.0820000000000001},"min":{"1min":0.624,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.143,"5min":17.782,"15min":17.782},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.96599999999999997,"15min":1.002},"min":{"1min":0.65700000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.264,"5min":1.708,"15min":1.708},"last":0.77000000000000002}]},{"osd":6,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.3859999999999999,"15min":1.27},"min":{"1min":0.66000000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.2250000000000001,"5min":36.106000000000002,"15min":36.106000000000002},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.2450000000000001,"15min":1.216},"min":{"1min":0.86099999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.2410000000000001,"5min":17.646999999999998,"15min":17.646999999999998},"last":0.97299999999999998}]},{"osd":7,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.226,"15min":1.1359999999999999},"min":{"1min":0.81200000000000006,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.421,"5min":17.042000000000002,"15min":17.042000000000002},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.3,"15min":1.262},"min":{"1min":0.83199999999999996,"5min":0.66400000000000003,"15min":0.63300000000000001},"max":{"1min":1.4670000000000001,"5min":16.32,"15min":16.32},"last":0.998}]}]},{"osd":2,"up_from":15,"seq":64424509532,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":31424,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1204224,"data_stored":550552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":32178176},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.79100000000000004,"15min":0.61299999999999999},"min":{"1min":0.47799999999999998,"5min":0.32200000000000001,"15min":0.247},"max":{"1min":0.98199999999999998,"5min":13.629,"15min":13.629},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":1.206,"15min":0.80900000000000005},"min":{"1min":0.34000000000000002,"5min":0.30299999999999999,"15min":0.28999999999999998},"max":{"1min":0.97199999999999998,"5min":40.439,"15min":40.439},"last":0.53200000000000003}]},{"osd":1,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.90200000000000002,"15min":0.71099999999999997},"min":{"1min":0.47899999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1,"5min":14.074,"15min":14.074},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.78500000000000003,"15min":0.64900000000000002},"min":{"1min":0.38800000000000001,"5min":0.34799999999999998,"15min":0.26400000000000001},"max":{"1min":1.1080000000000001,"5min":7.0060000000000002,"15min":7.0060000000000002},"last":0.44800000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.90000000000000002,"15min":0.71299999999999997},"min":{"1min":0.36699999999999999,"5min":0.28899999999999998,"15min":0.224},"max":{"1min":1.05,"5min":13.423999999999999,"15min":13.423999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.0649999999999999,"15min":0.82899999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.36399999999999999},"max":{"1min":1.1220000000000001,"5min":18.568999999999999,"15min":18.568999999999999},"last":0.56799999999999995}]},{"osd":4,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.94999999999999996,"15min":0.878},"min":{"1min":0.64200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.105,"5min":1.718,"15min":1.718},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.3380000000000001,"15min":1.05},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.22,"5min":28.667999999999999,"15min":28.667999999999999},"last":0.63}]},{"osd":5,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.0529999999999999,"15min":0.92100000000000004},"min":{"1min":0.67600000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.399,"5min":5.4459999999999997,"15min":5.4459999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.2230000000000001,"15min":1.0309999999999999},"min":{"1min":0.63300000000000001,"5min":0.57599999999999996,"15min":0.52700000000000002},"max":{"1min":1.4970000000000001,"5min":14.007,"15min":14.007},"last":0.70299999999999996}]},{"osd":6,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":1.1040000000000001,"15min":0.97099999999999997},"min":{"1min":0.65900000000000003,"5min":0.60099999999999998,"15min":0.49099999999999999},"max":{"1min":1.212,"5min":10.679,"15min":10.679},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.087,"15min":1.004},"min":{"1min":0.75600000000000001,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.325,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.88200000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.3240000000000001,"15min":1.1080000000000001},"min":{"1min":0.70299999999999996,"5min":0.63100000000000001,"15min":0.56100000000000005},"max":{"1min":1.415,"5min":18.623000000000001,"15min":18.623000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":1.002,"5min":1.0920000000000001,"15min":0.996},"min":{"1min":0.61699999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1850000000000001,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.84499999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509531,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30628,"kb_used_data":1180,"kb_used_omap":0,"kb_used_meta":29440,"kb_avail":94341212,"statfs":{"total":96636764160,"available":96605401088,"internally_reserved":0,"allocated":1208320,"data_stored":551716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30146560},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59199999999999997,"15min":0.55600000000000005},"min":{"1min":0.27900000000000003,"5min":0.27200000000000002,"15min":0.26900000000000002},"max":{"1min":0.92100000000000004,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70399999999999996,"15min":0.56799999999999995},"min":{"1min":0.41799999999999998,"5min":0.27200000000000002,"15min":0.22900000000000001},"max":{"1min":1.1899999999999999,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.41799999999999998}]},{"osd":2,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68300000000000005,"15min":0.58899999999999997},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.26200000000000001},"max":{"1min":0.879,"5min":1.506,"15min":1.506},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.82099999999999995,"15min":0.70599999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.312},"max":{"1min":1.1919999999999999,"5min":1.365,"15min":1.365},"last":0.82999999999999996}]},{"osd":3,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.76400000000000001,"15min":0.67300000000000004},"min":{"1min":0.36099999999999999,"5min":0.31,"15min":0.31},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.75700000000000001,"15min":0.63400000000000001},"min":{"1min":0.39100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.90700000000000003,"5min":1.232,"15min":1.27},"last":0.70899999999999996}]},{"osd":4,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.89000000000000001,"15min":0.82799999999999996},"min":{"1min":0.61199999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0860000000000001,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.98499999999999999,"15min":0.91400000000000003},"min":{"1min":0.69899999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3260000000000001,"5min":1.728,"15min":1.728},"last":1.0609999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.98999999999999999,"15min":0.89500000000000002},"min":{"1min":0.60299999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.28,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.117},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.96299999999999997,"15min":0.88500000000000001},"min":{"1min":0.77300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.198,"5min":1.3959999999999999,"15min":1.6080000000000001},"last":0.89200000000000002}]},{"osd":6,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0349999999999999,"15min":0.95399999999999996},"min":{"1min":0.59499999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2689999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.149},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0289999999999999,"15min":0.93400000000000005},"min":{"1min":0.66700000000000004,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3600000000000001,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.0229999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0669999999999999,"15min":0.97599999999999998},"min":{"1min":0.55100000000000005,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.292,"5min":1.673,"15min":1.673},"last":1.204},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0289999999999999,"15min":0.93999999999999995},"min":{"1min":0.67500000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4379999999999999,"5min":1.5880000000000001,"15min":1.649},"last":1.1719999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542236,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25188,"kb_used_data":1180,"kb_used_omap":0,"kb_used_meta":24000,"kb_avail":94346652,"statfs":{"total":96636764160,"available":96610971648,"internally_reserved":0,"allocated":1208320,"data_stored":552264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24576000},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.63200000000000001,"15min":0.58799999999999997},"min":{"1min":0.36399999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.96199999999999997,"5min":1.212,"15min":1.212},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.69999999999999996,"15min":0.66000000000000003},"min":{"1min":0.38900000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.5,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.63800000000000001}]},{"osd":1,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.70399999999999996,"15min":0.64800000000000002},"min":{"1min":0.42299999999999999,"5min":0.28599999999999998,"15min":0.27000000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76000000000000001,"15min":0.69099999999999995},"min":{"1min":0.34300000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.169,"5min":1.2210000000000001,"15min":1.222},"last":0.96499999999999997}]},{"osd":2,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.79400000000000004,"15min":0.73299999999999998},"min":{"1min":0.35999999999999999,"5min":0.317,"15min":0.317},"max":{"1min":1.1539999999999999,"5min":1.23,"15min":1.23},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73199999999999998,"15min":0.66000000000000003},"min":{"1min":0.371,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.05,"5min":1.671,"15min":1.671},"last":0.97999999999999998}]},{"osd":4,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.92000000000000004,"15min":0.91200000000000003},"min":{"1min":0.63900000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2949999999999999,"5min":1.411,"15min":1.496},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.006,"5min":1.018,"15min":0.95599999999999996},"min":{"1min":0.76400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3280000000000001,"5min":1.546,"15min":1.546},"last":0.77500000000000002}]},{"osd":5,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.91200000000000003,"15min":0.88700000000000001},"min":{"1min":0.63300000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.095,"5min":1.581,"15min":1.581},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.022,"15min":1.004},"min":{"1min":0.68100000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4179999999999999,"5min":1.498,"15min":1.498},"last":0.81999999999999995}]},{"osd":6,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.94599999999999995,"15min":0.92800000000000005},"min":{"1min":0.68799999999999994,"5min":0.56999999999999995,"15min":0.56699999999999995},"max":{"1min":1.212,"5min":1.347,"15min":1.347},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.05,"15min":1.006},"min":{"1min":0.80000000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.373,"5min":1.4970000000000001,"15min":1.5629999999999999},"last":1.018}]},{"osd":7,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.083,"15min":1.0289999999999999},"min":{"1min":0.70599999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.109,"5min":1.0609999999999999,"15min":1.03},"min":{"1min":0.65300000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.659,"5min":1.659,"15min":1.708},"last":1.167}]}]},{"osd":5,"up_from":13,"seq":55834574939,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22880,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":21696,"kb_avail":94348960,"statfs":{"total":96636764160,"available":96613335040,"internally_reserved":0,"allocated":1204224,"data_stored":551682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22216704},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.85799999999999998,"15min":0.83399999999999996},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.181,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":1.024},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.89400000000000002,"15min":0.86599999999999999},"min":{"1min":0.78200000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.26,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.0469999999999999}]},{"osd":1,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.872,"15min":0.84499999999999997},"min":{"1min":0.505,"5min":0.501,"15min":0.501},"max":{"1min":1.044,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.91000000000000003,"15min":0.92300000000000004},"min":{"1min":0.63100000000000001,"5min":0.58699999999999997,"15min":0.57099999999999995},"max":{"1min":1.23,"5min":1.23,"15min":1.514},"last":0.86399999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.91000000000000003,"15min":0.90300000000000002},"min":{"1min":0.625,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2010000000000001,"5min":1.351,"15min":1.3700000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.999,"5min":0.93000000000000005,"15min":0.90600000000000003},"min":{"1min":0.82499999999999996,"5min":0.57099999999999995,"15min":0.53300000000000003},"max":{"1min":1.1819999999999999,"5min":1.1930000000000001,"15min":1.3320000000000001},"last":0.95699999999999996}]},{"osd":3,"last update":"Tue Oct 3 19:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.93600000000000005,"15min":0.93100000000000005},"min":{"1min":0.67700000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2210000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.046,"5min":1.03,"15min":1.028},"min":{"1min":0.78700000000000003,"5min":0.65900000000000003,"15min":0.61199999999999999},"max":{"1min":1.3129999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.77000000000000002}]},{"osd":4,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.97499999999999998,"15min":0.97299999999999998},"min":{"1min":0.70699999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.2450000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96399999999999997,"15min":1.0129999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2749999999999999,"5min":1.335,"15min":1.7709999999999999},"last":0.70699999999999996}]},{"osd":6,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.995,"15min":1.024},"min":{"1min":0.67000000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.204,"5min":1.546,"15min":1.546},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0880000000000001,"15min":1.1240000000000001},"min":{"1min":0.82499999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.3759999999999999,"5min":1.823,"15min":1.823},"last":0.996}]},{"osd":7,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0569999999999999,"15min":1.071},"min":{"1min":0.68700000000000006,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.5680000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.119,"15min":1.143},"min":{"1min":0.86499999999999999,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.325,"5min":1.4179999999999999,"15min":1.9099999999999999},"last":1.075}]}]},{"osd":0,"up_from":13,"seq":55834574940,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30252,"kb_used_data":1252,"kb_used_omap":0,"kb_used_meta":28992,"kb_avail":94341588,"statfs":{"total":96636764160,"available":96605786112,"internally_reserved":0,"allocated":1282048,"data_stored":1142540,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":29687808},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.69699999999999995,"15min":0.61399999999999999},"min":{"1min":0.502,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.92000000000000004,"5min":5.7480000000000002,"15min":5.7480000000000002},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.80900000000000005,"15min":0.746},"min":{"1min":0.54700000000000004,"5min":0.37,"15min":0.33000000000000002},"max":{"1min":1.0760000000000001,"5min":6.274,"15min":6.274},"last":0.93600000000000005}]},{"osd":2,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.81999999999999995,"15min":0.746},"min":{"1min":0.46700000000000003,"5min":0.36499999999999999,"15min":0.35399999999999998},"max":{"1min":0.97599999999999998,"5min":6.1609999999999996,"15min":6.1609999999999996},"last":0.879},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71499999999999997,"15min":0.69899999999999995},"min":{"1min":0.44500000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.997,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.61299999999999999}]},{"osd":3,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.90800000000000003,"15min":0.78000000000000003},"min":{"1min":0.57499999999999996,"5min":0.41799999999999998,"15min":0.36799999999999999},"max":{"1min":1.1739999999999999,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82199999999999995,"15min":0.73199999999999998},"min":{"1min":0.53300000000000003,"5min":0.376,"15min":0.30299999999999999},"max":{"1min":1.0780000000000001,"5min":1.375,"15min":1.375},"last":0.77300000000000002}]},{"osd":4,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":1.0029999999999999,"15min":0.93600000000000005},"min":{"1min":0.71299999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.254,"5min":8.1159999999999997,"15min":8.1159999999999997},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.056,"5min":1.0860000000000001,"15min":1.0429999999999999},"min":{"1min":0.71199999999999997,"5min":0.57299999999999995,"15min":0.504},"max":{"1min":1.3440000000000001,"5min":6.2320000000000002,"15min":6.2320000000000002},"last":1.0129999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.2549999999999999,"15min":1.1140000000000001},"min":{"1min":0.69199999999999995,"5min":0.59399999999999997,"15min":0.46899999999999997},"max":{"1min":1.4259999999999999,"5min":17.420000000000002,"15min":17.420000000000002},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.222,"15min":1.052},"min":{"1min":0.74299999999999999,"5min":0.59499999999999997,"15min":0.54300000000000004},"max":{"1min":1.371,"5min":17.643000000000001,"15min":17.643000000000001},"last":1.0369999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0880000000000001,"15min":1.038},"min":{"1min":0.77500000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3520000000000001,"5min":5.7220000000000004,"15min":5.7220000000000004},"last":1.115},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0669999999999999,"15min":1.0129999999999999},"min":{"1min":0.877,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.417,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.98799999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.159,"15min":1.0740000000000001},"min":{"1min":0.81299999999999994,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3939999999999999,"5min":5.7800000000000002,"15min":5.7800000000000002},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.091,"5min":1.0920000000000001,"15min":1.0669999999999999},"min":{"1min":0.85699999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.343,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.0880000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:19:47.548 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-03T19:19:47.548 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-03T19:19:47.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.716+0000 7f01bc8e9640 1 Processor -- start 2023-10-03T19:19:47.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.716+0000 7f01bc8e9640 1 -- start start 2023-10-03T19:19:47.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.716+0000 7f01bc8e9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01b80be9c0 0x7f01b80bd550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:47.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.716+0000 7f01bc8e9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01b814c490 con 0x7f01b80a5f60 2023-10-03T19:19:47.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.716+0000 7f01bc8e9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01b806af90 con 0x7f01b814c970 2023-10-03T19:19:47.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.716+0000 7f01bc8e9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b806acb0 con 0x7f01b80be9c0 2023-10-03T19:19:47.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.716+0000 7f01b5d9b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f01b80a5f60 0x7f01b8149620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35860/0 (socket says 172.21.15.45:35860) 2023-10-03T19:19:47.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.716+0000 7f01b5d9b640 1 -- 172.21.15.45:0/611557552 learned_addr learned my addr 172.21.15.45:0/611557552 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:47.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.716+0000 7f01b659c640 1 --2- 172.21.15.45:0/611557552 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01b80be9c0 0x7f01b80bd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:47.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.720+0000 7f01b559a640 1 -- 172.21.15.45:0/611557552 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 814458691 0 0) 0x7f01b814c490 con 0x7f01b80a5f60 2023-10-03T19:19:47.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.720+0000 7f01b559a640 1 -- 172.21.15.45:0/611557552 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01a4003530 con 0x7f01b80a5f60 2023-10-03T19:19:47.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.720+0000 7f01b559a640 1 -- 172.21.15.45:0/611557552 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 934303077 0 0) 0x7f01b806af90 con 0x7f01b814c970 2023-10-03T19:19:47.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.720+0000 7f01b559a640 1 -- 172.21.15.45:0/611557552 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01b814c490 con 0x7f01b814c970 2023-10-03T19:19:47.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.720+0000 7f01b559a640 1 -- 172.21.15.45:0/611557552 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1934503349 0 0) 0x7f01a4003530 con 0x7f01b80a5f60 2023-10-03T19:19:47.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.720+0000 7f01b659c640 1 -- 172.21.15.45:0/611557552 >> v1:172.21.15.79:6789/0 conn(0x7f01b814c970 legacy=0x7f01b814cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:47.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.720+0000 7f01b659c640 1 -- 172.21.15.45:0/611557552 >> v1:172.21.15.45:6789/0 conn(0x7f01b80a5f60 legacy=0x7f01b8149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:47.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.720+0000 7f01b659c640 1 -- 172.21.15.45:0/611557552 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b806a5c0 con 0x7f01b80be9c0 2023-10-03T19:19:47.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.720+0000 7f01b659c640 1 --2- 172.21.15.45:0/611557552 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01b80be9c0 0x7f01b80bd550 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f01b0009dc0 tx=0x7f01b001c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5065846f3048ffd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:47.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.720+0000 7f01b559a640 1 -- 172.21.15.45:0/611557552 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a0001680 con 0x7f01b80be9c0 2023-10-03T19:19:47.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.720+0000 7f01b559a640 1 -- 172.21.15.45:0/611557552 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b00a56c0 con 0x7f01b80be9c0 2023-10-03T19:19:47.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.720+0000 7f01b559a640 1 -- 172.21.15.45:0/611557552 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b00a5a30 con 0x7f01b80be9c0 2023-10-03T19:19:47.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.720+0000 7f01bc8e9640 1 -- 172.21.15.45:0/611557552 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01b80be9c0 msgr2=0x7f01b80bd550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:47.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.720+0000 7f01bc8e9640 1 --2- 172.21.15.45:0/611557552 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01b80be9c0 0x7f01b80bd550 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f01b0009dc0 tx=0x7f01b001c860 comp rx=0 tx=0).stop 2023-10-03T19:19:47.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.720+0000 7f01bc8e9640 1 -- 172.21.15.45:0/611557552 shutdown_connections 2023-10-03T19:19:47.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.720+0000 7f01bc8e9640 1 --2- 172.21.15.45:0/611557552 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01b80be9c0 0x7f01b80bd550 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:47.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.720+0000 7f01bc8e9640 1 -- 172.21.15.45:0/611557552 >> 172.21.15.45:0/611557552 conn(0x7f01b80c2240 msgr2=0x7f01b80be050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:47.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.720+0000 7f01bc8e9640 1 -- 172.21.15.45:0/611557552 shutdown_connections 2023-10-03T19:19:47.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.720+0000 7f01bc8e9640 1 -- 172.21.15.45:0/611557552 wait complete. 2023-10-03T19:19:47.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.724+0000 7f01bc8e9640 1 Processor -- start 2023-10-03T19:19:47.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.724+0000 7f01bc8e9640 1 -- start start 2023-10-03T19:19:47.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.724+0000 7f01bc8e9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01b80a5f60 0x7f01b814b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:47.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.724+0000 7f01bc8e9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01b80be9c0 0x7f01b806ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:47.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.724+0000 7f01bc8e9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01b814c970 0x7f01b81551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:47.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.724+0000 7f01bc8e9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b81e6f20 con 0x7f01b80be9c0 2023-10-03T19:19:47.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.724+0000 7f01bc8e9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b814bc20 con 0x7f01b814c970 2023-10-03T19:19:47.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.724+0000 7f01bc8e9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b81e68d0 con 0x7f01b80a5f60 2023-10-03T19:19:47.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.724+0000 7f01b5d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01b80be9c0 0x7f01b806ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:47.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.724+0000 7f01b5d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01b80be9c0 0x7f01b806ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34506/0 (socket says 172.21.15.45:34506) 2023-10-03T19:19:47.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.724+0000 7f01b5d9b640 1 -- 172.21.15.45:0/782028645 learned_addr learned my addr 172.21.15.45:0/782028645 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:47.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.724+0000 7f01b6d9d640 1 --2- 172.21.15.45:0/782028645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01b814c970 0x7f01b81551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:47.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.724+0000 7f01b659c640 1 --2- 172.21.15.45:0/782028645 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01b80a5f60 0x7f01b814b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:47.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.724+0000 7f01b5d9b640 1 -- 172.21.15.45:0/782028645 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01b80a5f60 msgr2=0x7f01b814b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:47.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.724+0000 7f01b5d9b640 1 --2- 172.21.15.45:0/782028645 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01b80a5f60 0x7f01b814b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:47.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.724+0000 7f01b5d9b640 1 -- 172.21.15.45:0/782028645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01b814c970 msgr2=0x7f01b81551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:47.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.724+0000 7f01b5d9b640 1 --2- 172.21.15.45:0/782028645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01b814c970 0x7f01b81551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:47.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.724+0000 7f01b5d9b640 1 -- 172.21.15.45:0/782028645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b0009a70 con 0x7f01b80be9c0 2023-10-03T19:19:47.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.724+0000 7f01b5d9b640 1 --2- 172.21.15.45:0/782028645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01b80be9c0 0x7f01b806ffa0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f01a000c520 tx=0x7f01a000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:47.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.724+0000 7f01aeffd640 1 -- 172.21.15.45:0/782028645 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a0005cf0 con 0x7f01b80be9c0 2023-10-03T19:19:47.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.724+0000 7f01aeffd640 1 -- 172.21.15.45:0/782028645 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a0005e50 con 0x7f01b80be9c0 2023-10-03T19:19:47.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.724+0000 7f01bc8e9640 1 -- 172.21.15.45:0/782028645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b8149ec0 con 0x7f01b80be9c0 2023-10-03T19:19:47.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.724+0000 7f01aeffd640 1 -- 172.21.15.45:0/782028645 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a0007270 con 0x7f01b80be9c0 2023-10-03T19:19:47.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.724+0000 7f01bc8e9640 1 -- 172.21.15.45:0/782028645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b8149d30 con 0x7f01b80be9c0 2023-10-03T19:19:47.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.728+0000 7f01bc8e9640 1 -- 172.21.15.45:0/782028645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01b815a620 con 0x7f01b80be9c0 2023-10-03T19:19:47.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.728+0000 7f01aeffd640 1 -- 172.21.15.45:0/782028645 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f01a00073f0 con 0x7f01b80be9c0 2023-10-03T19:19:47.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.728+0000 7f01aeffd640 1 --2- 172.21.15.45:0/782028645 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0198066280 0x7f0198068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:47.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.728+0000 7f01aeffd640 1 -- 172.21.15.45:0/782028645 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f01a0083280 con 0x7f01b80be9c0 2023-10-03T19:19:47.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.728+0000 7f01b659c640 1 --2- 172.21.15.45:0/782028645 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0198066280 0x7f0198068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:47.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.728+0000 7f01b659c640 1 --2- 172.21.15.45:0/782028645 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0198066280 0x7f0198068730 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f01b00af000 tx=0x7f01b00a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:47.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.732+0000 7f01aeffd640 1 -- 172.21.15.45:0/782028645 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f01a00507c0 con 0x7f01b80be9c0 2023-10-03T19:19:47.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.944+0000 7f01bc8e9640 1 -- 172.21.15.45:0/782028645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f01b806b3e0 con 0x7f01b80be9c0 2023-10-03T19:19:47.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.952+0000 7f01aeffd640 1 -- 172.21.15.45:0/782028645 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7f01a0053de0 con 0x7f01b80be9c0 2023-10-03T19:19:47.956 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-10-03T19:19:47.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.956+0000 7f01bc8e9640 1 -- 172.21.15.45:0/782028645 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0198066280 msgr2=0x7f0198068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:47.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.956+0000 7f01bc8e9640 1 --2- 172.21.15.45:0/782028645 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0198066280 0x7f0198068730 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f01b00af000 tx=0x7f01b00a7070 comp rx=0 tx=0).stop 2023-10-03T19:19:47.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.956+0000 7f01bc8e9640 1 -- 172.21.15.45:0/782028645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01b80be9c0 msgr2=0x7f01b806ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:47.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.956+0000 7f01bc8e9640 1 --2- 172.21.15.45:0/782028645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01b80be9c0 0x7f01b806ffa0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f01a000c520 tx=0x7f01a000c9e0 comp rx=0 tx=0).stop 2023-10-03T19:19:47.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.956+0000 7f01bc8e9640 1 -- 172.21.15.45:0/782028645 shutdown_connections 2023-10-03T19:19:47.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.956+0000 7f01bc8e9640 1 --2- 172.21.15.45:0/782028645 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0198066280 0x7f0198068730 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:47.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.956+0000 7f01bc8e9640 1 --2- 172.21.15.45:0/782028645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01b814c970 0x7f01b81551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:47.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.956+0000 7f01bc8e9640 1 --2- 172.21.15.45:0/782028645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01b80be9c0 0x7f01b806ffa0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:47.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.956+0000 7f01bc8e9640 1 --2- 172.21.15.45:0/782028645 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f01b80a5f60 0x7f01b814b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:47.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.956+0000 7f01bc8e9640 1 -- 172.21.15.45:0/782028645 >> 172.21.15.45:0/782028645 conn(0x7f01b80c2240 msgr2=0x7f01b8065f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:47.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.956+0000 7f01bc8e9640 1 -- 172.21.15.45:0/782028645 shutdown_connections 2023-10-03T19:19:47.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:47.956+0000 7f01bc8e9640 1 -- 172.21.15.45:0/782028645 wait complete. 2023-10-03T19:19:47.975 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:19:48.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.096+0000 7fb47493b640 1 Processor -- start 2023-10-03T19:19:48.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.096+0000 7fb47493b640 1 -- start start 2023-10-03T19:19:48.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.096+0000 7fb47493b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb4700b98f0 0x7fb4700b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:48.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.096+0000 7fb47493b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4700bc810 0x7fb47006c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:48.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.096+0000 7fb47493b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4700ba550 con 0x7fb4700a2e20 2023-10-03T19:19:48.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.096+0000 7fb47493b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4701526d0 con 0x7fb4700b98f0 2023-10-03T19:19:48.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.096+0000 7fb47493b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4701529b0 con 0x7fb4700bc810 2023-10-03T19:19:48.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.096+0000 7fb46dd9b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4700bc810 0x7fb47006c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:48.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.096+0000 7fb46e59c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb4700b98f0 0x7fb4700b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:48.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.096+0000 7fb46dd9b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4700bc810 0x7fb47006c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:40124/0 (socket says 172.21.15.45:40124) 2023-10-03T19:19:48.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.096+0000 7fb46dd9b640 1 -- 172.21.15.45:0/606029625 learned_addr learned my addr 172.21.15.45:0/606029625 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:48.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.096+0000 7fb46e59c640 1 -- 172.21.15.45:0/606029625 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4700bc810 msgr2=0x7fb47006c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:48.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.096+0000 7fb46e59c640 1 --2- 172.21.15.45:0/606029625 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4700bc810 0x7fb47006c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.096+0000 7fb46e59c640 1 -- 172.21.15.45:0/606029625 >> v1:172.21.15.79:6789/0 conn(0x7fb4700a2e20 legacy=0x7fb47006c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:48.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.096+0000 7fb46e59c640 1 -- 172.21.15.45:0/606029625 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47006cee0 con 0x7fb4700b98f0 2023-10-03T19:19:48.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.096+0000 7fb46dd9b640 1 --2- 172.21.15.45:0/606029625 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4700bc810 0x7fb47006c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:19:48.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.100+0000 7fb46e59c640 1 --2- 172.21.15.45:0/606029625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4700b98f0 0x7fb4700b9cc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb4640097c0 tx=0x7fb46401ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=caadb3c47936e4b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:48.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.100+0000 7fb46d59a640 1 -- 172.21.15.45:0/606029625 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4640a8970 con 0x7fb4700b98f0 2023-10-03T19:19:48.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.100+0000 7fb46d59a640 1 -- 172.21.15.45:0/606029625 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4640a8ad0 con 0x7fb4700b98f0 2023-10-03T19:19:48.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.100+0000 7fb46d59a640 1 -- 172.21.15.45:0/606029625 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4640a8e60 con 0x7fb4700b98f0 2023-10-03T19:19:48.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.100+0000 7fb47493b640 1 -- 172.21.15.45:0/606029625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4700b98f0 msgr2=0x7fb4700b9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:48.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.100+0000 7fb47493b640 1 --2- 172.21.15.45:0/606029625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4700b98f0 0x7fb4700b9cc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb4640097c0 tx=0x7fb46401ec70 comp rx=0 tx=0).stop 2023-10-03T19:19:48.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.100+0000 7fb47493b640 1 -- 172.21.15.45:0/606029625 shutdown_connections 2023-10-03T19:19:48.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.100+0000 7fb47493b640 1 --2- 172.21.15.45:0/606029625 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4700bc810 0x7fb47006c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.100+0000 7fb47493b640 1 --2- 172.21.15.45:0/606029625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4700b98f0 0x7fb4700b9cc0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.100+0000 7fb47493b640 1 -- 172.21.15.45:0/606029625 >> 172.21.15.45:0/606029625 conn(0x7fb4700bcf50 msgr2=0x7fb4700bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:48.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.100+0000 7fb47493b640 1 -- 172.21.15.45:0/606029625 shutdown_connections 2023-10-03T19:19:48.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.100+0000 7fb47493b640 1 -- 172.21.15.45:0/606029625 wait complete. 2023-10-03T19:19:48.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.100+0000 7fb47493b640 1 Processor -- start 2023-10-03T19:19:48.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.100+0000 7fb47493b640 1 -- start start 2023-10-03T19:19:48.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.104+0000 7fb47493b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4700a2e20 0x7fb470148e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:48.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.104+0000 7fb47493b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4700b98f0 0x7fb4701e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:48.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.104+0000 7fb47493b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4700bc810 0x7fb4701e7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:48.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.104+0000 7fb47493b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47013ed40 con 0x7fb4700b98f0 2023-10-03T19:19:48.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.104+0000 7fb47493b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4701e7450 con 0x7fb4700bc810 2023-10-03T19:19:48.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.104+0000 7fb47493b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb470149340 con 0x7fb4700a2e20 2023-10-03T19:19:48.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.104+0000 7fb46dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4700b98f0 0x7fb4701e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:48.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.104+0000 7fb46dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4700b98f0 0x7fb4701e78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34508/0 (socket says 172.21.15.45:34508) 2023-10-03T19:19:48.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.104+0000 7fb46dd9b640 1 -- 172.21.15.45:0/3321404560 learned_addr learned my addr 172.21.15.45:0/3321404560 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:48.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.104+0000 7fb46e59c640 1 --2- 172.21.15.45:0/3321404560 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4700a2e20 0x7fb470148e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:48.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.104+0000 7fb46ed9d640 1 --2- 172.21.15.45:0/3321404560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4700bc810 0x7fb4701e7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:48.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.104+0000 7fb46dd9b640 1 -- 172.21.15.45:0/3321404560 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4700a2e20 msgr2=0x7fb470148e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:48.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.104+0000 7fb46dd9b640 1 --2- 172.21.15.45:0/3321404560 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4700a2e20 0x7fb470148e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.104+0000 7fb46dd9b640 1 -- 172.21.15.45:0/3321404560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4700bc810 msgr2=0x7fb4701e7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:48.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.104+0000 7fb46dd9b640 1 --2- 172.21.15.45:0/3321404560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4700bc810 0x7fb4701e7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.104+0000 7fb46dd9b640 1 -- 172.21.15.45:0/3321404560 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4600094d0 con 0x7fb4700b98f0 2023-10-03T19:19:48.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.104+0000 7fb46ed9d640 1 --2- 172.21.15.45:0/3321404560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4700bc810 0x7fb4701e7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:19:48.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.104+0000 7fb46dd9b640 1 --2- 172.21.15.45:0/3321404560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4700b98f0 0x7fb4701e78e0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fb46000e960 tx=0x7fb46000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:48.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.104+0000 7fb45effd640 1 -- 172.21.15.45:0/3321404560 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46000c9a0 con 0x7fb4700b98f0 2023-10-03T19:19:48.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.104+0000 7fb45effd640 1 -- 172.21.15.45:0/3321404560 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46000cb00 con 0x7fb4700b98f0 2023-10-03T19:19:48.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.104+0000 7fb45effd640 1 -- 172.21.15.45:0/3321404560 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46000ce70 con 0x7fb4700b98f0 2023-10-03T19:19:48.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.104+0000 7fb47493b640 1 -- 172.21.15.45:0/3321404560 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb464009420 con 0x7fb4700b98f0 2023-10-03T19:19:48.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.104+0000 7fb47493b640 1 -- 172.21.15.45:0/3321404560 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4700ba950 con 0x7fb4700b98f0 2023-10-03T19:19:48.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.104+0000 7fb47493b640 1 -- 172.21.15.45:0/3321404560 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4700ba200 con 0x7fb4700b98f0 2023-10-03T19:19:48.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.104+0000 7fb45effd640 1 -- 172.21.15.45:0/3321404560 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb460013470 con 0x7fb4700b98f0 2023-10-03T19:19:48.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.104+0000 7fb45effd640 1 --2- 172.21.15.45:0/3321404560 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb450066280 0x7fb450068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:48.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.104+0000 7fb45effd640 1 -- 172.21.15.45:0/3321404560 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb4600841c0 con 0x7fb4700b98f0 2023-10-03T19:19:48.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.104+0000 7fb46e59c640 1 --2- 172.21.15.45:0/3321404560 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb450066280 0x7fb450068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:48.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.108+0000 7fb46e59c640 1 --2- 172.21.15.45:0/3321404560 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb450066280 0x7fb450068730 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb4640b2000 tx=0x7fb464008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:48.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.108+0000 7fb45effd640 1 -- 172.21.15.45:0/3321404560 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb460051780 con 0x7fb4700b98f0 2023-10-03T19:19:48.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.296+0000 7fb47493b640 1 -- 172.21.15.45:0/3321404560 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4700baae0 con 0x7fb4700b98f0 2023-10-03T19:19:48.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.296+0000 7fb45effd640 1 -- 172.21.15.45:0/3321404560 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+3916 (secure 0 0 0) 0x7fb460054da0 con 0x7fb4700b98f0 2023-10-03T19:19:48.299 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:19:48.300 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":50,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5795,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2000006019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2000006019},{"type":"v1","addr":"172.21.15.79:6835","nonce":2000006019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":7149,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/3326584899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3326584899},{"type":"v1","addr":"172.21.15.45:6833","nonce":3326584899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:19:39.419474+0000","modified":"2023-10-03T19:19:41.692109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7155},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7155":{"gid":7155,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3401546487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3401546487},{"type":"v1","addr":"172.21.15.45:6835","nonce":3401546487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-10-03T19:19:48.300 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 50 2023-10-03T19:19:48.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.296+0000 7fb47493b640 1 -- 172.21.15.45:0/3321404560 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb450066280 msgr2=0x7fb450068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:48.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.296+0000 7fb47493b640 1 --2- 172.21.15.45:0/3321404560 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb450066280 0x7fb450068730 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb4640b2000 tx=0x7fb464008040 comp rx=0 tx=0).stop 2023-10-03T19:19:48.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.296+0000 7fb47493b640 1 -- 172.21.15.45:0/3321404560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4700b98f0 msgr2=0x7fb4701e78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:48.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.296+0000 7fb47493b640 1 --2- 172.21.15.45:0/3321404560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4700b98f0 0x7fb4701e78e0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fb46000e960 tx=0x7fb46000ee20 comp rx=0 tx=0).stop 2023-10-03T19:19:48.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.300+0000 7fb47493b640 1 -- 172.21.15.45:0/3321404560 shutdown_connections 2023-10-03T19:19:48.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.300+0000 7fb47493b640 1 --2- 172.21.15.45:0/3321404560 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb450066280 0x7fb450068730 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.300+0000 7fb47493b640 1 --2- 172.21.15.45:0/3321404560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4700bc810 0x7fb4701e7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.300+0000 7fb47493b640 1 --2- 172.21.15.45:0/3321404560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4700b98f0 0x7fb4701e78e0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.300+0000 7fb47493b640 1 --2- 172.21.15.45:0/3321404560 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4700a2e20 0x7fb470148e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.300+0000 7fb47493b640 1 -- 172.21.15.45:0/3321404560 >> 172.21.15.45:0/3321404560 conn(0x7fb4700bcf50 msgr2=0x7fb470146540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:48.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.300+0000 7fb47493b640 1 -- 172.21.15.45:0/3321404560 shutdown_connections 2023-10-03T19:19:48.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.300+0000 7fb47493b640 1 -- 172.21.15.45:0/3321404560 wait complete. 2023-10-03T19:19:48.619 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 50, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-03T19:19:39.419474+0000', 'modified': '2023-10-03T19:19:41.692109+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7155}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7155': {'gid': 7155, 'name': 'a', 'rank': 0, 'incarnation': 48, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6835/3401546487', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6834', 'nonce': 3401546487}, {'type': 'v1', 'addr': '172.21.15.45:6835', 'nonce': 3401546487}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-03T19:19:48.619 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-03T19:19:48.620 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-03T19:19:48.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.748+0000 7f3eb0ee9640 1 Processor -- start 2023-10-03T19:19:48.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.748+0000 7f3eb0ee9640 1 -- start start 2023-10-03T19:19:48.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.752+0000 7f3eb0ee9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3eac06f170 0x7f3eac150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:48.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.752+0000 7f3eb0ee9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3eac0bc8b0 0x7f3eac14ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:48.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.752+0000 7f3eb0ee9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eac06cac0 con 0x7f3eac06d170 2023-10-03T19:19:48.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.752+0000 7f3eb0ee9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eac0720d0 con 0x7f3eac0bc8b0 2023-10-03T19:19:48.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.752+0000 7f3eb0ee9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac0a5ab0 con 0x7f3eac06f170 2023-10-03T19:19:48.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.752+0000 7f3ea9d9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3eac0bc8b0 0x7f3eac14ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:48.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.752+0000 7f3eaa59c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3eac06f170 0x7f3eac150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:48.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.752+0000 7f3eaad9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3eac06d170 0x7f3eac14cfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:53154/0 (socket says 172.21.15.45:53154) 2023-10-03T19:19:48.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.752+0000 7f3eaad9d640 1 -- 172.21.15.45:0/1237829564 learned_addr learned my addr 172.21.15.45:0/1237829564 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:48.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.752+0000 7f3ea9d9b640 1 -- 172.21.15.45:0/1237829564 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3eac06f170 msgr2=0x7f3eac150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:48.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.752+0000 7f3ea9d9b640 1 --2- 172.21.15.45:0/1237829564 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3eac06f170 0x7f3eac150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.752+0000 7f3ea9d9b640 1 -- 172.21.15.45:0/1237829564 >> v1:172.21.15.79:6789/0 conn(0x7f3eac06d170 legacy=0x7f3eac14cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:48.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.752+0000 7f3ea9d9b640 1 -- 172.21.15.45:0/1237829564 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac06cd00 con 0x7f3eac0bc8b0 2023-10-03T19:19:48.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.752+0000 7f3ea9d9b640 1 --2- 172.21.15.45:0/1237829564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3eac0bc8b0 0x7f3eac14ca70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3ea00097c0 tx=0x7f3ea001ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82369b951568892e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:48.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3ea959a640 1 -- 172.21.15.45:0/1237829564 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea00a8970 con 0x7f3eac0bc8b0 2023-10-03T19:19:48.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3ea959a640 1 -- 172.21.15.45:0/1237829564 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea00a8ad0 con 0x7f3eac0bc8b0 2023-10-03T19:19:48.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3ea959a640 1 -- 172.21.15.45:0/1237829564 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea00a8e60 con 0x7f3eac0bc8b0 2023-10-03T19:19:48.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3eb0ee9640 1 -- 172.21.15.45:0/1237829564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3eac0bc8b0 msgr2=0x7f3eac14ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:48.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3eb0ee9640 1 --2- 172.21.15.45:0/1237829564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3eac0bc8b0 0x7f3eac14ca70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3ea00097c0 tx=0x7f3ea001ec70 comp rx=0 tx=0).stop 2023-10-03T19:19:48.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3eb0ee9640 1 -- 172.21.15.45:0/1237829564 shutdown_connections 2023-10-03T19:19:48.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3eb0ee9640 1 --2- 172.21.15.45:0/1237829564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3eac0bc8b0 0x7f3eac14ca70 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3eb0ee9640 1 --2- 172.21.15.45:0/1237829564 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3eac06f170 0x7f3eac150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3eb0ee9640 1 -- 172.21.15.45:0/1237829564 >> 172.21.15.45:0/1237829564 conn(0x7f3eac0bcf50 msgr2=0x7f3eac0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:48.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3eb0ee9640 1 -- 172.21.15.45:0/1237829564 shutdown_connections 2023-10-03T19:19:48.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3eb0ee9640 1 -- 172.21.15.45:0/1237829564 wait complete. 2023-10-03T19:19:48.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3eb0ee9640 1 Processor -- start 2023-10-03T19:19:48.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3eb0ee9640 1 -- start start 2023-10-03T19:19:48.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3eb0ee9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3eac06d170 0x7f3eac145570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:48.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3eb0ee9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3eac06f170 0x7f3eac1e4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:48.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3eb0ee9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3eac0bc8b0 0x7f3eac142250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:48.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3eb0ee9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac0bbe30 con 0x7f3eac06f170 2023-10-03T19:19:48.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3eb0ee9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac145ab0 con 0x7f3eac06d170 2023-10-03T19:19:48.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3eb0ee9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac149d70 con 0x7f3eac0bc8b0 2023-10-03T19:19:48.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3ea9d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3eac06f170 0x7f3eac1e4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:48.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3ea9d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3eac06f170 0x7f3eac1e4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34524/0 (socket says 172.21.15.45:34524) 2023-10-03T19:19:48.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3ea9d9b640 1 -- 172.21.15.45:0/4188200848 learned_addr learned my addr 172.21.15.45:0/4188200848 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:48.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3eaad9d640 1 --2- 172.21.15.45:0/4188200848 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3eac0bc8b0 0x7f3eac142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:48.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3eaa59c640 1 --2- 172.21.15.45:0/4188200848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3eac06d170 0x7f3eac145570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:48.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3ea9d9b640 1 -- 172.21.15.45:0/4188200848 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3eac0bc8b0 msgr2=0x7f3eac142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:48.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3ea9d9b640 1 --2- 172.21.15.45:0/4188200848 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3eac0bc8b0 0x7f3eac142250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3ea9d9b640 1 -- 172.21.15.45:0/4188200848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3eac06d170 msgr2=0x7f3eac145570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:48.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3ea9d9b640 1 --2- 172.21.15.45:0/4188200848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3eac06d170 0x7f3eac145570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3ea9d9b640 1 -- 172.21.15.45:0/4188200848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea0009420 con 0x7f3eac06f170 2023-10-03T19:19:48.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3ea9d9b640 1 --2- 172.21.15.45:0/4188200848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3eac06f170 0x7f3eac1e4c70 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f3ea001c8a0 tx=0x7f3ea001ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:48.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3e9affd640 1 -- 172.21.15.45:0/4188200848 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea00b1e00 con 0x7f3eac06f170 2023-10-03T19:19:48.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3e9affd640 1 -- 172.21.15.45:0/4188200848 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea0006e20 con 0x7f3eac06f170 2023-10-03T19:19:48.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3eb0ee9640 1 -- 172.21.15.45:0/4188200848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eac14c4a0 con 0x7f3eac06f170 2023-10-03T19:19:48.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3e9affd640 1 -- 172.21.15.45:0/4188200848 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea00b9630 con 0x7f3eac06f170 2023-10-03T19:19:48.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.756+0000 7f3eb0ee9640 1 -- 172.21.15.45:0/4188200848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eac14fae0 con 0x7f3eac06f170 2023-10-03T19:19:48.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.760+0000 7f3e9affd640 1 -- 172.21.15.45:0/4188200848 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3ea00b7040 con 0x7f3eac06f170 2023-10-03T19:19:48.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.760+0000 7f3e9affd640 1 --2- 172.21.15.45:0/4188200848 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3e8c066280 0x7f3e8c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:48.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.760+0000 7f3e9affd640 1 -- 172.21.15.45:0/4188200848 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3ea0121710 con 0x7f3eac06f170 2023-10-03T19:19:48.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.760+0000 7f3eaa59c640 1 --2- 172.21.15.45:0/4188200848 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3e8c066280 0x7f3e8c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:48.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.760+0000 7f3eb400d000 1 Processor -- start 2023-10-03T19:19:48.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.760+0000 7f3eb400d000 1 -- start start 2023-10-03T19:19:48.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.760+0000 7f3eaa59c640 1 --2- 172.21.15.45:0/4188200848 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3e8c066280 0x7f3e8c068730 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c009b60 tx=0x7f3e9c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:48.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.760+0000 7f3eb400d000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557eeae93500 0x557eeaec43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:48.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.760+0000 7f3eb400d000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557eeaec48f0 0x557eeae8eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:48.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.760+0000 7f3eb400d000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557eeae8f430 0x557eeae8f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:48.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.760+0000 7f3eb400d000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557eead55310 con 0x557eeae93500 2023-10-03T19:19:48.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.760+0000 7f3eb400d000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x557eeac8f980 con 0x557eeaec48f0 2023-10-03T19:19:48.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.760+0000 7f3eb400d000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x557eeace3040 con 0x557eeae8f430 2023-10-03T19:19:48.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.760+0000 7f3eaa59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557eeae93500 0x557eeaec43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:48.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.760+0000 7f3eaa59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557eeae93500 0x557eeaec43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34526/0 (socket says 172.21.15.45:34526) 2023-10-03T19:19:48.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.760+0000 7f3eaa59c640 1 -- 172.21.15.45:0/1333396824 learned_addr learned my addr 172.21.15.45:0/1333396824 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:48.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.760+0000 7f3ea9d9b640 1 --2- 172.21.15.45:0/1333396824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557eeaec48f0 0x557eeae8eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:48.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.760+0000 7f3eaad9d640 1 --2- 172.21.15.45:0/1333396824 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557eeae8f430 0x557eeae8f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:48.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.760+0000 7f3eaa59c640 1 -- 172.21.15.45:0/1333396824 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557eeae8f430 msgr2=0x557eeae8f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:48.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.760+0000 7f3eaa59c640 1 --2- 172.21.15.45:0/1333396824 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557eeae8f430 0x557eeae8f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.760+0000 7f3eaa59c640 1 -- 172.21.15.45:0/1333396824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557eeaec48f0 msgr2=0x557eeae8eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:48.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.760+0000 7f3eaa59c640 1 --2- 172.21.15.45:0/1333396824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557eeaec48f0 0x557eeae8eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.760+0000 7f3eaa59c640 1 -- 172.21.15.45:0/1333396824 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557eeaca10b0 con 0x557eeae93500 2023-10-03T19:19:48.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eaa59c640 1 --2- 172.21.15.45:0/1333396824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557eeae93500 0x557eeaec43b0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c011ec0 tx=0x7f3e9c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=487893f82693fe9f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:48.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3e8bfff640 1 -- 172.21.15.45:0/1333396824 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c01c040 con 0x557eeae93500 2023-10-03T19:19:48.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3e8bfff640 1 -- 172.21.15.45:0/1333396824 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9c003830 con 0x557eeae93500 2023-10-03T19:19:48.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3e8bfff640 1 -- 172.21.15.45:0/1333396824 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c003ba0 con 0x557eeae93500 2023-10-03T19:19:48.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eb400d000 1 -- 172.21.15.45:0/1333396824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557eeae93500 msgr2=0x557eeaec43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:48.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eb400d000 1 --2- 172.21.15.45:0/1333396824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557eeae93500 0x557eeaec43b0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c011ec0 tx=0x7f3e9c014000 comp rx=0 tx=0).stop 2023-10-03T19:19:48.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eb400d000 1 -- 172.21.15.45:0/1333396824 shutdown_connections 2023-10-03T19:19:48.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eb400d000 1 --2- 172.21.15.45:0/1333396824 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557eeae8f430 0x557eeae8f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eb400d000 1 --2- 172.21.15.45:0/1333396824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557eeaec48f0 0x557eeae8eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eb400d000 1 --2- 172.21.15.45:0/1333396824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557eeae93500 0x557eeaec43b0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eb400d000 1 -- 172.21.15.45:0/1333396824 >> 172.21.15.45:0/1333396824 conn(0x557eeaec5220 msgr2=0x557eeaec7600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:48.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eb400d000 1 -- 172.21.15.45:0/1333396824 shutdown_connections 2023-10-03T19:19:48.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eb400d000 1 -- 172.21.15.45:0/1333396824 wait complete. 2023-10-03T19:19:48.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eb400d000 1 -- start start 2023-10-03T19:19:48.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eb400d000 1 Processor -- start 2023-10-03T19:19:48.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eb400d000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557eeae8f430 0x557eeae92e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:48.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eb400d000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557eeae93500 0x557eeaec8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:48.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eb400d000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557eeaec48f0 0x557eeaec89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:48.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eb400d000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557eeacdc0e0 con 0x557eeae8f430 2023-10-03T19:19:48.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eb400d000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x557eeac98bd0 con 0x557eeaec48f0 2023-10-03T19:19:48.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eb400d000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x557eeac98870 con 0x557eeae93500 2023-10-03T19:19:48.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eb400d000 10 client.0 _ll_register_callbacks cb 0x557eeae78c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T19:19:48.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eaa59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557eeae8f430 0x557eeae92e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:48.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eaa59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557eeae8f430 0x557eeae92e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34542/0 (socket says 172.21.15.45:34542) 2023-10-03T19:19:48.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eaa59c640 1 -- 172.21.15.45:0/502252409 learned_addr learned my addr 172.21.15.45:0/502252409 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:48.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eaad9d640 1 --2- 172.21.15.45:0/502252409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557eeaec48f0 0x557eeaec89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:48.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eaa59c640 1 -- 172.21.15.45:0/502252409 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557eeae93500 msgr2=0x557eeaec8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:48.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3ea9d9b640 1 --2- 172.21.15.45:0/502252409 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557eeae93500 0x557eeaec8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:48.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eaa59c640 1 --2- 172.21.15.45:0/502252409 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557eeae93500 0x557eeaec8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eaa59c640 1 -- 172.21.15.45:0/502252409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557eeaec48f0 msgr2=0x557eeaec89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:48.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eaa59c640 1 --2- 172.21.15.45:0/502252409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557eeaec48f0 0x557eeaec89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eaa59c640 1 -- 172.21.15.45:0/502252409 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e9c011ba0 con 0x557eeae8f430 2023-10-03T19:19:48.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3ea9d9b640 1 --2- 172.21.15.45:0/502252409 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557eeae93500 0x557eeaec8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:48.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eaa59c640 1 --2- 172.21.15.45:0/502252409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557eeae8f430 0x557eeae92e90 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c004410 tx=0x7f3e9c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abf0c12ee675a225 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:48.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3e897fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-10-03T19:19:48.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3e897fa640 1 -- 172.21.15.45:0/502252409 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c022a00 con 0x557eeae8f430 2023-10-03T19:19:48.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eb400d000 1 -- 172.21.15.45:0/502252409 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557eeacd78b0 con 0x557eeae8f430 2023-10-03T19:19:48.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3e897fa640 1 -- 172.21.15.45:0/502252409 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3e9c022b60 con 0x557eeae8f430 2023-10-03T19:19:48.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3e897fa640 1 -- 172.21.15.45:0/502252409 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e9c022d20 con 0x557eeae8f430 2023-10-03T19:19:48.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eb400d000 10 client.7317 fetch_fsmap learned FSMap version 50 2023-10-03T19:19:48.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eb400d000 1 -- 172.21.15.45:0/502252409 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x557eea9d8890 con 0x557eeae8f430 2023-10-03T19:19:48.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3e897fa640 1 -- 172.21.15.45:0/502252409 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557eeacd78b0 con 0x557eeae8f430 2023-10-03T19:19:48.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3e897fa640 1 -- 172.21.15.45:0/502252409 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 50) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f3e9c014440 con 0x557eeae8f430 2023-10-03T19:19:48.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eb400d000 10 client.7317 fetch_fsmap finished waiting for FSMap version 50 2023-10-03T19:19:48.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eb400d000 10 client.7317 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T19:19:48.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eb400d000 20 client.7317 populate_metadata read hostname 'smithi045' 2023-10-03T19:19:48.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eb400d000 1 --2- 172.21.15.45:0/502252409 >> [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] conn(0x557eeaec3500 0x557eeaec38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:48.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eb400d000 4 client.7317 mds_command: new command op to 7155 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-03T19:19:48.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3eb400d000 1 -- 172.21.15.45:0/502252409 --> [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557eead0af70 con 0x557eeaec3500 2023-10-03T19:19:48.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.764+0000 7f3ea9d9b640 1 --2- 172.21.15.45:0/502252409 >> [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] conn(0x557eeaec3500 0x557eeaec38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:48.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.768+0000 7f3e897fa640 10 client.7317 ms_handle_connect on v2:172.21.15.45:6834/3401546487 2023-10-03T19:19:48.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.768+0000 7f3ea9d9b640 1 --2- 172.21.15.45:0/502252409 >> [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] conn(0x557eeaec3500 0x557eeaec38d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2076ee35be46e090 server_cookie=59a29abb9e3050e3 in_seq=0 out_seq=0 2023-10-03T19:19:48.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.768+0000 7f3e897fa640 1 -- 172.21.15.45:0/502252409 <== mds.0 v2:172.21.15.45:6834/3401546487 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x557eead0af70 con 0x557eeaec3500 2023-10-03T19:19:48.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.768+0000 7f3e897fa640 10 client.7317 handle_command_reply: tid=0 2023-10-03T19:19:48.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.768+0000 7f3eb400d000 1 client.7317 shutdown 2023-10-03T19:19:48.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.768+0000 7f3eb400d000 1 -- 172.21.15.45:0/502252409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557eeae8f430 msgr2=0x557eeae92e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:48.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.768+0000 7f3eb400d000 1 --2- 172.21.15.45:0/502252409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557eeae8f430 0x557eeae92e90 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c004410 tx=0x7f3e9c004740 comp rx=0 tx=0).stop 2023-10-03T19:19:48.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.768+0000 7f3eb400d000 1 -- 172.21.15.45:0/502252409 shutdown_connections 2023-10-03T19:19:48.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.768+0000 7f3eb400d000 1 --2- 172.21.15.45:0/502252409 >> [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] conn(0x557eeaec3500 0x557eeaec38d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.768+0000 7f3eb400d000 1 --2- 172.21.15.45:0/502252409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557eeaec48f0 0x557eeaec89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.768+0000 7f3eb400d000 1 --2- 172.21.15.45:0/502252409 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557eeae93500 0x557eeaec8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.768+0000 7f3e897fa640 0 client.7317 ms_handle_reset on v2:172.21.15.45:6834/3401546487 2023-10-03T19:19:48.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.768+0000 7f3eb400d000 1 --2- 172.21.15.45:0/502252409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557eeae8f430 0x557eeae92e90 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.768+0000 7f3eb400d000 1 -- 172.21.15.45:0/502252409 >> 172.21.15.45:0/502252409 conn(0x557eeaec5220 msgr2=0x557eeae8a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:48.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.768+0000 7f3eb400d000 1 -- 172.21.15.45:0/502252409 shutdown_connections 2023-10-03T19:19:48.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.768+0000 7f3eb400d000 1 -- 172.21.15.45:0/502252409 wait complete. 2023-10-03T19:19:48.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.768+0000 7f3eb400d000 20 client.7317 trim_cache size 0 max 16384 2023-10-03T19:19:48.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3eb400d000 1 Processor -- start 2023-10-03T19:19:48.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3eb400d000 1 -- start start 2023-10-03T19:19:48.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3eb400d000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557eeae8f430 0x557eeae89240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:48.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3eb400d000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557eeae93500 0x557eeaee0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:48.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3eb400d000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557eeaec48f0 0x557eeaee0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:48.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3eb400d000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557eea999940 con 0x557eeaec48f0 2023-10-03T19:19:48.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3eb400d000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x557eeace00e0 con 0x557eeae8f430 2023-10-03T19:19:48.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3eb400d000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x557eeacd94e0 con 0x557eeae93500 2023-10-03T19:19:48.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3eaad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557eeaec48f0 0x557eeaee0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:48.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3eaad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557eeaec48f0 0x557eeaee0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34546/0 (socket says 172.21.15.45:34546) 2023-10-03T19:19:48.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3eaad9d640 1 -- 172.21.15.45:0/1224218761 learned_addr learned my addr 172.21.15.45:0/1224218761 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:48.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3eaa59c640 1 --2- 172.21.15.45:0/1224218761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557eeae8f430 0x557eeae89240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:48.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3eaad9d640 1 -- 172.21.15.45:0/1224218761 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557eeae93500 msgr2=0x557eeaee0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:48.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3eaad9d640 1 --2- 172.21.15.45:0/1224218761 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557eeae93500 0x557eeaee0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3eaad9d640 1 -- 172.21.15.45:0/1224218761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557eeae8f430 msgr2=0x557eeae89240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:48.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3eaad9d640 1 --2- 172.21.15.45:0/1224218761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557eeae8f430 0x557eeae89240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3eaad9d640 1 -- 172.21.15.45:0/1224218761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557eeaca1360 con 0x557eeaec48f0 2023-10-03T19:19:48.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3eaad9d640 1 --2- 172.21.15.45:0/1224218761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557eeaec48f0 0x557eeaee0fd0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4007190 tx=0x7f3ea4001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3232ba0cf7df258c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:48.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3e98ff9640 1 -- 172.21.15.45:0/1224218761 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4015680 con 0x557eeaec48f0 2023-10-03T19:19:48.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3e98ff9640 1 -- 172.21.15.45:0/1224218761 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea40157e0 con 0x557eeaec48f0 2023-10-03T19:19:48.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3e98ff9640 1 -- 172.21.15.45:0/1224218761 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4015b90 con 0x557eeaec48f0 2023-10-03T19:19:48.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3eb400d000 1 -- 172.21.15.45:0/1224218761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557eeaec48f0 msgr2=0x557eeaee0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:48.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3eb400d000 1 --2- 172.21.15.45:0/1224218761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557eeaec48f0 0x557eeaee0fd0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4007190 tx=0x7f3ea4001a00 comp rx=0 tx=0).stop 2023-10-03T19:19:48.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3eb400d000 1 -- 172.21.15.45:0/1224218761 shutdown_connections 2023-10-03T19:19:48.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3eb400d000 1 --2- 172.21.15.45:0/1224218761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557eeaec48f0 0x557eeaee0fd0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3eb400d000 1 --2- 172.21.15.45:0/1224218761 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557eeae93500 0x557eeaee0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3eb400d000 1 --2- 172.21.15.45:0/1224218761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557eeae8f430 0x557eeae89240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3eb400d000 1 -- 172.21.15.45:0/1224218761 >> 172.21.15.45:0/1224218761 conn(0x557eeaec5220 msgr2=0x557eeaec8820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:48.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3eb400d000 1 -- 172.21.15.45:0/1224218761 shutdown_connections 2023-10-03T19:19:48.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3eb400d000 1 -- 172.21.15.45:0/1224218761 wait complete. 2023-10-03T19:19:48.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3eb400d000 1 -- start start 2023-10-03T19:19:48.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.784+0000 7f3eb400d000 1 Processor -- start 2023-10-03T19:19:48.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb400d000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557eeae8f430 0x557eeaee3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:48.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb400d000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557eeae93500 0x557eeaef5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:48.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb400d000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557eeaec48f0 0x557eeaef5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:48.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb400d000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557eeaec2470 con 0x557eeae8f430 2023-10-03T19:19:48.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb400d000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x557eeae930c0 con 0x557eeae93500 2023-10-03T19:19:48.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb400d000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x557eeace42d0 con 0x557eeaec48f0 2023-10-03T19:19:48.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb400d000 10 client.0 _ll_register_callbacks cb 0x557eeacde260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T19:19:48.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eaa59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557eeae8f430 0x557eeaee3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:48.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eaa59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557eeae8f430 0x557eeaee3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34550/0 (socket says 172.21.15.45:34550) 2023-10-03T19:19:48.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eaa59c640 1 -- 172.21.15.45:0/3408065269 learned_addr learned my addr 172.21.15.45:0/3408065269 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:48.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3ea9d9b640 1 --2- 172.21.15.45:0/3408065269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557eeae93500 0x557eeaef5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:48.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eaad9d640 1 --2- 172.21.15.45:0/3408065269 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557eeaec48f0 0x557eeaef5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:48.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eaa59c640 1 -- 172.21.15.45:0/3408065269 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557eeaec48f0 msgr2=0x557eeaef5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:48.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eaa59c640 1 --2- 172.21.15.45:0/3408065269 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557eeaec48f0 0x557eeaef5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eaa59c640 1 -- 172.21.15.45:0/3408065269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557eeae93500 msgr2=0x557eeaef5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:48.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eaa59c640 1 --2- 172.21.15.45:0/3408065269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557eeae93500 0x557eeaef5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eaa59c640 1 -- 172.21.15.45:0/3408065269 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea4002060 con 0x557eeae8f430 2023-10-03T19:19:48.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eaa59c640 1 --2- 172.21.15.45:0/3408065269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557eeae8f430 0x557eeaee3800 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c0096c0 tx=0x7f3e9c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19743d4656f525a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:48.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3e897fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-10-03T19:19:48.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3e897fa640 1 -- 172.21.15.45:0/3408065269 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c022a00 con 0x557eeae8f430 2023-10-03T19:19:48.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3e897fa640 1 -- 172.21.15.45:0/3408065269 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3e9c014950 con 0x557eeae8f430 2023-10-03T19:19:48.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb400d000 1 -- 172.21.15.45:0/3408065269 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3e9c003830 con 0x557eeae8f430 2023-10-03T19:19:48.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3e897fa640 1 -- 172.21.15.45:0/3408065269 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e9c004440 con 0x557eeae8f430 2023-10-03T19:19:48.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb400d000 10 client.7323 fetch_fsmap learned FSMap version 50 2023-10-03T19:19:48.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb400d000 1 -- 172.21.15.45:0/3408065269 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x557eeac86be0 con 0x557eeae8f430 2023-10-03T19:19:48.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3e897fa640 1 -- 172.21.15.45:0/3408065269 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9c003830 con 0x557eeae8f430 2023-10-03T19:19:48.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3e897fa640 1 -- 172.21.15.45:0/3408065269 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 50) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f3e9c022b60 con 0x557eeae8f430 2023-10-03T19:19:48.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb400d000 10 client.7323 fetch_fsmap finished waiting for FSMap version 50 2023-10-03T19:19:48.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb400d000 10 client.7323 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T19:19:48.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb400d000 20 client.7323 populate_metadata read hostname 'smithi045' 2023-10-03T19:19:48.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb400d000 1 --2- 172.21.15.45:0/3408065269 >> [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] conn(0x557eeaef6490 0x557eeaf34dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:48.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb400d000 4 client.7323 mds_command: new command op to 7155 tid=0[{"prefix": "status"}] 2023-10-03T19:19:48.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb400d000 1 -- 172.21.15.45:0/3408065269 --> [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557eeacd50c0 con 0x557eeaef6490 2023-10-03T19:19:48.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3ea9d9b640 1 --2- 172.21.15.45:0/3408065269 >> [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] conn(0x557eeaef6490 0x557eeaf34dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:48.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3ea9d9b640 1 --2- 172.21.15.45:0/3408065269 >> [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] conn(0x557eeaef6490 0x557eeaf34dc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e59d2b77ccc9964 server_cookie=c74f996bd887b881 in_seq=0 out_seq=0 2023-10-03T19:19:48.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3e897fa640 10 client.7323 ms_handle_connect on v2:172.21.15.45:6834/3401546487 2023-10-03T19:19:48.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3e897fa640 1 -- 172.21.15.45:0/3408065269 <== mds.0 v2:172.21.15.45:6834/3401546487 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x557eeacd50c0 con 0x557eeaef6490 2023-10-03T19:19:48.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3e897fa640 10 client.7323 handle_command_reply: tid=0 2023-10-03T19:19:48.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb400d000 1 client.7323 shutdown 2023-10-03T19:19:48.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb400d000 1 -- 172.21.15.45:0/3408065269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557eeae8f430 msgr2=0x557eeaee3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:48.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb400d000 1 --2- 172.21.15.45:0/3408065269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557eeae8f430 0x557eeaee3800 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c0096c0 tx=0x7f3e9c018000 comp rx=0 tx=0).stop 2023-10-03T19:19:48.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb400d000 1 -- 172.21.15.45:0/3408065269 shutdown_connections 2023-10-03T19:19:48.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb400d000 1 --2- 172.21.15.45:0/3408065269 >> [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] conn(0x557eeaef6490 0x557eeaf34dc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb400d000 1 --2- 172.21.15.45:0/3408065269 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557eeaec48f0 0x557eeaef5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb400d000 1 --2- 172.21.15.45:0/3408065269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557eeae93500 0x557eeaef5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3e897fa640 0 client.7323 ms_handle_reset on v2:172.21.15.45:6834/3401546487 2023-10-03T19:19:48.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb400d000 1 --2- 172.21.15.45:0/3408065269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557eeae8f430 0x557eeaee3800 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb400d000 1 -- 172.21.15.45:0/3408065269 >> 172.21.15.45:0/3408065269 conn(0x557eeaec5220 msgr2=0x557eeaec7600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:48.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb400d000 1 -- 172.21.15.45:0/3408065269 shutdown_connections 2023-10-03T19:19:48.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb400d000 1 -- 172.21.15.45:0/3408065269 wait complete. 2023-10-03T19:19:48.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb400d000 20 client.7323 trim_cache size 0 max 16384 2023-10-03T19:19:48.912 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-03T19:19:48.913 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "58400977-12ba-4c73-bb3e-1589b2492669", 2023-10-03T19:19:48.913 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-10-03T19:19:48.913 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 7155, 2023-10-03T19:19:48.913 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-10-03T19:19:48.913 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-10-03T19:19:48.913 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-10-03T19:19:48.913 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 9.3689230430000006, 2023-10-03T19:19:48.913 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 50, 2023-10-03T19:19:48.913 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 98, 2023-10-03T19:19:48.913 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 98, 2023-10-03T19:19:48.913 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 14.724658643 2023-10-03T19:19:48.914 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-03T19:19:48.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb0ee9640 1 -- 172.21.15.45:0/4188200848 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3e8c066280 msgr2=0x7f3e8c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:48.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb0ee9640 1 --2- 172.21.15.45:0/4188200848 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3e8c066280 0x7f3e8c068730 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c009b60 tx=0x7f3e9c009190 comp rx=0 tx=0).stop 2023-10-03T19:19:48.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb0ee9640 1 -- 172.21.15.45:0/4188200848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3eac06f170 msgr2=0x7f3eac1e4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:48.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb0ee9640 1 --2- 172.21.15.45:0/4188200848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3eac06f170 0x7f3eac1e4c70 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f3ea001c8a0 tx=0x7f3ea001ba10 comp rx=0 tx=0).stop 2023-10-03T19:19:48.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb0ee9640 1 -- 172.21.15.45:0/4188200848 shutdown_connections 2023-10-03T19:19:48.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb0ee9640 1 --2- 172.21.15.45:0/4188200848 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3e8c066280 0x7f3e8c068730 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb0ee9640 1 --2- 172.21.15.45:0/4188200848 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3eac0bc8b0 0x7f3eac142250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb0ee9640 1 --2- 172.21.15.45:0/4188200848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3eac06f170 0x7f3eac1e4c70 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb0ee9640 1 --2- 172.21.15.45:0/4188200848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3eac06d170 0x7f3eac145570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:48.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb0ee9640 1 -- 172.21.15.45:0/4188200848 >> 172.21.15.45:0/4188200848 conn(0x7f3eac0bcf50 msgr2=0x7f3eac070a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:48.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb0ee9640 1 -- 172.21.15.45:0/4188200848 shutdown_connections 2023-10-03T19:19:48.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:48.788+0000 7f3eb0ee9640 1 -- 172.21.15.45:0/4188200848 wait complete. 2023-10-03T19:19:48.917 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-03T19:19:49.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.044+0000 7f5fb552d640 1 Processor -- start 2023-10-03T19:19:49.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.044+0000 7f5fb552d640 1 -- start start 2023-10-03T19:19:49.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.048+0000 7f5fb552d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5fb014f240 0x7f5fb01528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:49.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.048+0000 7f5fb552d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5fb00bb1d0 0x7f5fb00c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:49.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.048+0000 7f5fb552d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb006b2d0 con 0x7f5fb00c2790 2023-10-03T19:19:49.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.048+0000 7f5fb552d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb006b640 con 0x7f5fb014f240 2023-10-03T19:19:49.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.048+0000 7f5fb552d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb00a3c60 con 0x7f5fb00bb1d0 2023-10-03T19:19:49.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.048+0000 7f5faeffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5fb014f240 0x7f5fb01528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:49.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.048+0000 7f5faeffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5fb014f240 0x7f5fb01528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34562/0 (socket says 172.21.15.45:34562) 2023-10-03T19:19:49.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.048+0000 7f5faeffd640 1 -- 172.21.15.45:0/1288423827 learned_addr learned my addr 172.21.15.45:0/1288423827 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:49.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.048+0000 7f5faf7fe640 1 --2- 172.21.15.45:0/1288423827 >> v2:172.21.15.79:3300/0 conn(0x7f5fb00bb1d0 0x7f5fb00c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:49.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.048+0000 7f5faeffd640 1 -- 172.21.15.45:0/1288423827 >> v2:172.21.15.79:3300/0 conn(0x7f5fb00bb1d0 msgr2=0x7f5fb00c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:49.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.048+0000 7f5faeffd640 1 --2- 172.21.15.45:0/1288423827 >> v2:172.21.15.79:3300/0 conn(0x7f5fb00bb1d0 0x7f5fb00c12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:49.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.048+0000 7f5faeffd640 1 -- 172.21.15.45:0/1288423827 >> v1:172.21.15.79:6789/0 conn(0x7f5fb00c2790 legacy=0x7f5fb00c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:49.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.048+0000 7f5faeffd640 1 -- 172.21.15.45:0/1288423827 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb014e740 con 0x7f5fb014f240 2023-10-03T19:19:49.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.048+0000 7f5faeffd640 1 --2- 172.21.15.45:0/1288423827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb014f240 0x7f5fb01528d0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f5fb00c1d60 tx=0x7f5fa001f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea79b0a68c960647 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:49.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.048+0000 7f5fadffb640 1 -- 172.21.15.45:0/1288423827 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa00af400 con 0x7f5fb014f240 2023-10-03T19:19:49.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.048+0000 7f5fadffb640 1 -- 172.21.15.45:0/1288423827 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa00ab050 con 0x7f5fb014f240 2023-10-03T19:19:49.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.048+0000 7f5fadffb640 1 -- 172.21.15.45:0/1288423827 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa00af780 con 0x7f5fb014f240 2023-10-03T19:19:49.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.048+0000 7f5fb552d640 1 -- 172.21.15.45:0/1288423827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb014f240 msgr2=0x7f5fb01528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:49.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.048+0000 7f5fb552d640 1 --2- 172.21.15.45:0/1288423827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb014f240 0x7f5fb01528d0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f5fb00c1d60 tx=0x7f5fa001f1e0 comp rx=0 tx=0).stop 2023-10-03T19:19:49.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.048+0000 7f5fb552d640 1 -- 172.21.15.45:0/1288423827 shutdown_connections 2023-10-03T19:19:49.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.048+0000 7f5fb552d640 1 --2- 172.21.15.45:0/1288423827 >> v2:172.21.15.79:3300/0 conn(0x7f5fb00bb1d0 0x7f5fb00c12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:49.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.048+0000 7f5fb552d640 1 --2- 172.21.15.45:0/1288423827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb014f240 0x7f5fb01528d0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:49.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.048+0000 7f5fb552d640 1 -- 172.21.15.45:0/1288423827 >> 172.21.15.45:0/1288423827 conn(0x7f5fb00a64a0 msgr2=0x7f5fb00a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:49.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.048+0000 7f5fb552d640 1 -- 172.21.15.45:0/1288423827 shutdown_connections 2023-10-03T19:19:49.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.048+0000 7f5fb552d640 1 -- 172.21.15.45:0/1288423827 wait complete. 2023-10-03T19:19:49.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.052+0000 7f5fb552d640 1 Processor -- start 2023-10-03T19:19:49.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.052+0000 7f5fb552d640 1 -- start start 2023-10-03T19:19:49.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.052+0000 7f5fb552d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fb00bb1d0 0x7f5fb00c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:49.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.052+0000 7f5fb552d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fb00c2790 0x7f5fb014d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:49.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.052+0000 7f5fb552d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb014f240 0x7f5fb00c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:49.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.052+0000 7f5fb552d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00c57e0 con 0x7f5fb014f240 2023-10-03T19:19:49.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.052+0000 7f5fb552d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00c52f0 con 0x7f5fb00bb1d0 2023-10-03T19:19:49.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.052+0000 7f5fb552d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00c4f30 con 0x7f5fb00c2790 2023-10-03T19:19:49.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.052+0000 7f5faf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb014f240 0x7f5fb00c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:49.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.052+0000 7f5faf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb014f240 0x7f5fb00c2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34564/0 (socket says 172.21.15.45:34564) 2023-10-03T19:19:49.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.052+0000 7f5faf7fe640 1 -- 172.21.15.45:0/2413008950 learned_addr learned my addr 172.21.15.45:0/2413008950 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:49.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.052+0000 7f5faeffd640 1 --2- 172.21.15.45:0/2413008950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fb00bb1d0 0x7f5fb00c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:49.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.052+0000 7f5fae7fc640 1 --2- 172.21.15.45:0/2413008950 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fb00c2790 0x7f5fb014d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:49.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.052+0000 7f5faf7fe640 1 -- 172.21.15.45:0/2413008950 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fb00c2790 msgr2=0x7f5fb014d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:49.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.052+0000 7f5faf7fe640 1 --2- 172.21.15.45:0/2413008950 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fb00c2790 0x7f5fb014d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:49.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.052+0000 7f5faf7fe640 1 -- 172.21.15.45:0/2413008950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fb00bb1d0 msgr2=0x7f5fb00c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:49.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.052+0000 7f5faf7fe640 1 --2- 172.21.15.45:0/2413008950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fb00bb1d0 0x7f5fb00c49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:49.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.052+0000 7f5faf7fe640 1 -- 172.21.15.45:0/2413008950 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa0009b30 con 0x7f5fb014f240 2023-10-03T19:19:49.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.052+0000 7f5fae7fc640 1 --2- 172.21.15.45:0/2413008950 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fb00c2790 0x7f5fb014d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:49.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.052+0000 7f5faf7fe640 1 --2- 172.21.15.45:0/2413008950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb014f240 0x7f5fb00c2ed0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800d830 tx=0x7f5fa800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:49.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.052+0000 7f5f977fe640 1 -- 172.21.15.45:0/2413008950 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa800b6c0 con 0x7f5fb014f240 2023-10-03T19:19:49.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.052+0000 7f5f977fe640 1 -- 172.21.15.45:0/2413008950 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa800b820 con 0x7f5fb014f240 2023-10-03T19:19:49.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.052+0000 7f5fb552d640 1 -- 172.21.15.45:0/2413008950 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb014f610 con 0x7f5fb014f240 2023-10-03T19:19:49.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.052+0000 7f5f977fe640 1 -- 172.21.15.45:0/2413008950 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa800bbd0 con 0x7f5fb014f240 2023-10-03T19:19:49.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.052+0000 7f5fb552d640 1 -- 172.21.15.45:0/2413008950 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb00a3f40 con 0x7f5fb014f240 2023-10-03T19:19:49.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.052+0000 7f5fb552d640 1 -- 172.21.15.45:0/2413008950 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb00bf360 con 0x7f5fb014f240 2023-10-03T19:19:49.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.052+0000 7f5f977fe640 1 -- 172.21.15.45:0/2413008950 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5fa801e460 con 0x7f5fb014f240 2023-10-03T19:19:49.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.056+0000 7f5f977fe640 1 --2- 172.21.15.45:0/2413008950 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5f9c066280 0x7f5f9c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:49.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.056+0000 7f5f977fe640 1 -- 172.21.15.45:0/2413008950 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5fa8084590 con 0x7f5fb014f240 2023-10-03T19:19:49.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.056+0000 7f5faeffd640 1 --2- 172.21.15.45:0/2413008950 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5f9c066280 0x7f5f9c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.056+0000 7f5faeffd640 1 --2- 172.21.15.45:0/2413008950 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5f9c066280 0x7f5f9c068730 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5fa00b1000 tx=0x7f5fa00aa000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.060+0000 7f5f977fe640 1 -- 172.21.15.45:0/2413008950 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5fa80518e0 con 0x7f5fb014f240 2023-10-03T19:19:49.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.244+0000 7f5fb552d640 1 -- 172.21.15.45:0/2413008950 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5fb00bfa90 con 0x7f5fb014f240 2023-10-03T19:19:49.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.244+0000 7f5f977fe640 1 -- 172.21.15.45:0/2413008950 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v50) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5fa8054f00 con 0x7f5fb014f240 2023-10-03T19:19:49.248 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-03T19:19:49.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.248+0000 7f5fb552d640 1 -- 172.21.15.45:0/2413008950 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5f9c066280 msgr2=0x7f5f9c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:49.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.248+0000 7f5fb552d640 1 --2- 172.21.15.45:0/2413008950 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5f9c066280 0x7f5f9c068730 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5fa00b1000 tx=0x7f5fa00aa000 comp rx=0 tx=0).stop 2023-10-03T19:19:49.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.248+0000 7f5fb552d640 1 -- 172.21.15.45:0/2413008950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb014f240 msgr2=0x7f5fb00c2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:49.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.248+0000 7f5fb552d640 1 --2- 172.21.15.45:0/2413008950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb014f240 0x7f5fb00c2ed0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800d830 tx=0x7f5fa800dcf0 comp rx=0 tx=0).stop 2023-10-03T19:19:49.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.248+0000 7f5fb552d640 1 -- 172.21.15.45:0/2413008950 shutdown_connections 2023-10-03T19:19:49.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.248+0000 7f5fb552d640 1 --2- 172.21.15.45:0/2413008950 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5f9c066280 0x7f5f9c068730 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:49.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.248+0000 7f5fb552d640 1 --2- 172.21.15.45:0/2413008950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb014f240 0x7f5fb00c2ed0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:49.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.248+0000 7f5fb552d640 1 --2- 172.21.15.45:0/2413008950 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fb00c2790 0x7f5fb014d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:49.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.248+0000 7f5fb552d640 1 --2- 172.21.15.45:0/2413008950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fb00bb1d0 0x7f5fb00c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:49.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.248+0000 7f5fb552d640 1 -- 172.21.15.45:0/2413008950 >> 172.21.15.45:0/2413008950 conn(0x7f5fb00a64a0 msgr2=0x7f5fb00b9710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:49.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.248+0000 7f5fb552d640 1 -- 172.21.15.45:0/2413008950 shutdown_connections 2023-10-03T19:19:49.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:49.248+0000 7f5fb552d640 1 -- 172.21.15.45:0/2413008950 wait complete. 2023-10-03T19:19:49.266 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-03T19:19:49.281 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-03T19:19:49.281 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-10-03T19:19:49.281 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-03T19:19:49.282 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-03T19:19:49.282 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-03T19:19:49.282 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-03T19:19:49.282 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-03T19:19:49.282 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-03T19:19:49.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:49.282 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-10-03T19:19:49.289 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-03T19:19:49.289 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-03T19:19:49.289 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-10-03T19:19:49.289 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:19:49.289 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-10-03T19:19:49.289 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:19:49.289 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:19:49.289 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-10-03T19:19:49.289 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-10-03T19:19:49.290 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:19:49.290 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-10-03T19:19:49.290 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-10-03T19:19:49.290 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:19:49.290 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-10-03T19:19:49.290 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-03T19:19:49.290 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-10-03T19:19:49.290 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-03T19:19:49.290 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 41993sec preferred_lft 41993sec 2023-10-03T19:19:49.290 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2023-10-03T19:19:49.290 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:19:49.290 INFO:teuthology.orchestra.run.smithi146.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-03T19:19:49.291 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 02:42:a6:2d:ab:3b brd ff:ff:ff:ff:ff:ff 2023-10-03T19:19:49.291 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-03T19:19:49.291 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:19:49.291 INFO:teuthology.orchestra.run.smithi146.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-03T19:19:49.291 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-03T19:19:49.291 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-03T19:19:49.291 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:19:49.291 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::5c3e:4eff:fee6:56da/64 scope link 2023-10-03T19:19:49.291 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:19:49.291 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-03T19:19:49.291 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T19:19:49.291 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-03T19:19:49.291 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:19:49.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:49.292 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-03T19:19:49.345 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T19:19:49.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:49.370 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-10-03T19:19:49.420 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-10-03T19:19:49.435 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-03T19:19:49.436 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-03T19:19:49.436 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-03T19:19:49.436 INFO:teuthology.orchestra.run.smithi146.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-03T19:19:49.436 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-03T19:19:49.436 INFO:teuthology.orchestra.run.smithi146.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:19:49.436 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:19:49.436 INFO:teuthology.orchestra.run.smithi146.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:19:49.436 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-03T19:19:49.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:49.437 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-03T19:19:49.437 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-03T19:19:49.437 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-03T19:19:49.437 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-03T19:19:49.437 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-03T19:19:49.437 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-03T19:19:49.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:49.519 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-10-03T19:19:49.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-03T19:19:49.550 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-03T19:19:49.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:49.551 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-10-03T19:19:49.606 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-03T19:19:49.674 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T19:19:49.675 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-03T19:19:49.680 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-03T19:19:49.681 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T19:19:49.681 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-03T19:19:49.729 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-03T19:19:49.786 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:19:49.827 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:19:49.841 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:19:49.842 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:19:49.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:49.842 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-03T19:19:49.889 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-03T19:19:49.889 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-03T19:19:49.934 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-03T19:19:49.948 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:19:49.989 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:19:50.001 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:19:50.002 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:19:50.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:50.002 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-03T19:19:50.013 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:2023-10-03T19:19:50.005+0000 7f73a6fc1580 -1 init, newargv = 0x556f3bb681a0 newargc=15 2023-10-03T19:19:50.013 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[33931]: starting ceph client 2023-10-03T19:19:50.022 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[33931]: starting fuse 2023-10-03T19:19:51.118 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-03T19:19:51.150 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:19:51.150 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:19:51.203 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:19:51.244 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:19:51.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:51.244 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-03T19:19:51.294 INFO:teuthology.orchestra.run.smithi146.stdout:45 2023-10-03T19:19:51.298 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-03T19:19:51.298 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-03T19:19:51.298 DEBUG:teuthology.orchestra.run.smithi146:> import glob 2023-10-03T19:19:51.298 DEBUG:teuthology.orchestra.run.smithi146:> import re 2023-10-03T19:19:51.299 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-03T19:19:51.299 DEBUG:teuthology.orchestra.run.smithi146:> import subprocess 2023-10-03T19:19:51.299 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:19:51.299 DEBUG:teuthology.orchestra.run.smithi146:> def _find_admin_socket(client_name): 2023-10-03T19:19:51.299 DEBUG:teuthology.orchestra.run.smithi146:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-03T19:19:51.299 DEBUG:teuthology.orchestra.run.smithi146:> files = glob.glob(asok_path) 2023-10-03T19:19:51.299 DEBUG:teuthology.orchestra.run.smithi146:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-03T19:19:51.299 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:19:51.299 DEBUG:teuthology.orchestra.run.smithi146:> # Given a non-glob path, it better be there 2023-10-03T19:19:51.299 DEBUG:teuthology.orchestra.run.smithi146:> if "*" not in asok_path: 2023-10-03T19:19:51.299 DEBUG:teuthology.orchestra.run.smithi146:> assert(len(files) == 1) 2023-10-03T19:19:51.299 DEBUG:teuthology.orchestra.run.smithi146:> return files[0] 2023-10-03T19:19:51.300 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:19:51.300 DEBUG:teuthology.orchestra.run.smithi146:> for f in files: 2023-10-03T19:19:51.300 DEBUG:teuthology.orchestra.run.smithi146:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-03T19:19:51.300 DEBUG:teuthology.orchestra.run.smithi146:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-03T19:19:51.300 DEBUG:teuthology.orchestra.run.smithi146:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-03T19:19:51.300 DEBUG:teuthology.orchestra.run.smithi146:> contents = proc_f.read() 2023-10-03T19:19:51.300 DEBUG:teuthology.orchestra.run.smithi146:> if mountpoint in contents: 2023-10-03T19:19:51.300 DEBUG:teuthology.orchestra.run.smithi146:> return f 2023-10-03T19:19:51.300 DEBUG:teuthology.orchestra.run.smithi146:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-03T19:19:51.300 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:19:51.300 DEBUG:teuthology.orchestra.run.smithi146:> print(_find_admin_socket("client.0")) 2023-10-03T19:19:51.300 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-03T19:19:51.414 INFO:teuthology.orchestra.run.smithi146.stdout:/var/run/ceph/ceph-client.0.33931.asok 2023-10-03T19:19:51.597 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.33931.asok 2023-10-03T19:19:51.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:51.625 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.33931.asok status 2023-10-03T19:19:51.758 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-03T19:19:51.758 INFO:teuthology.orchestra.run.smithi146.stdout: "metadata": { 2023-10-03T19:19:51.758 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_sha1": "05a43c8fb3988914c879a50970f9054a098e0612", 2023-10-03T19:19:51.759 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 18.0.0-3908-g05a43c8f (05a43c8fb3988914c879a50970f9054a098e0612) reef (dev)", 2023-10-03T19:19:51.759 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "0", 2023-10-03T19:19:51.759 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2023-10-03T19:19:51.759 INFO:teuthology.orchestra.run.smithi146.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-03T19:19:51.759 INFO:teuthology.orchestra.run.smithi146.stdout: "pid": "33931", 2023-10-03T19:19:51.759 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2023-10-03T19:19:51.759 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:19:51.759 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_count": 0, 2023-10-03T19:19:51.759 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_pinned_count": 0, 2023-10-03T19:19:51.760 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 7335, 2023-10-03T19:19:51.760 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": { 2023-10-03T19:19:51.760 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2023-10-03T19:19:51.760 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2023-10-03T19:19:51.760 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 7335 2023-10-03T19:19:51.760 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:19:51.760 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-03T19:19:51.760 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T19:19:51.760 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:0", 2023-10-03T19:19:51.760 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 990159870 2023-10-03T19:19:51.761 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T19:19:51.761 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:19:51.761 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-03T19:19:51.761 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T19:19:51.761 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:0", 2023-10-03T19:19:51.761 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 990159870 2023-10-03T19:19:51.761 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:19:51.761 INFO:teuthology.orchestra.run.smithi146.stdout: "inst_str": "client.7335 172.21.15.146:0/990159870", 2023-10-03T19:19:51.761 INFO:teuthology.orchestra.run.smithi146.stdout: "addr_str": "172.21.15.146:0/990159870", 2023-10-03T19:19:51.761 INFO:teuthology.orchestra.run.smithi146.stdout: "inode_count": 1, 2023-10-03T19:19:51.762 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_epoch": 50, 2023-10-03T19:19:51.762 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch": 98, 2023-10-03T19:19:51.805 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch_barrier": 0, 2023-10-03T19:19:51.805 INFO:teuthology.orchestra.run.smithi146.stdout: "blocklisted": false, 2023-10-03T19:19:51.805 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs" 2023-10-03T19:19:51.805 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-03T19:19:51.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:51.806 DEBUG:teuthology.orchestra.run.smithi146:> stat --file-system '--printf=%T 2023-10-03T19:19:51.806 DEBUG:teuthology.orchestra.run.smithi146:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-03T19:19:51.813 INFO:teuthology.orchestra.run.smithi146.stdout:fuseblk 2023-10-03T19:19:51.813 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-03T19:19:51.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:51.813 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-03T19:19:51.870 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-03T19:19:52.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.228+0000 7fb8c1ee6640 1 Processor -- start 2023-10-03T19:19:52.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.228+0000 7fb8c1ee6640 1 -- start start 2023-10-03T19:19:52.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.228+0000 7fb8c1ee6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb8bc0bb1d0 0x7fb8bc1528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:52.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.228+0000 7fb8c1ee6640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8bc06b2d0 con 0x7fb8bc14f240 2023-10-03T19:19:52.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.228+0000 7fb8c1ee6640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8bc0a3c60 con 0x7fb8bc0c2790 2023-10-03T19:19:52.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.228+0000 7fb8c1ee6640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8bc06b640 con 0x7fb8bc0bb1d0 2023-10-03T19:19:52.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.228+0000 7fb8bb7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb8bc14f240 0x7fb8bc0c0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35872/0 (socket says 172.21.15.45:35872) 2023-10-03T19:19:52.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.228+0000 7fb8bb7fe640 1 -- 172.21.15.45:0/4124046092 learned_addr learned my addr 172.21.15.45:0/4124046092 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:52.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.228+0000 7fb8bbfff640 1 --2- 172.21.15.45:0/4124046092 >> v2:172.21.15.45:3300/0 conn(0x7fb8bc0bb1d0 0x7fb8bc1528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:52.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.228+0000 7fb8ba7fc640 1 -- 172.21.15.45:0/4124046092 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4069161033 0 0) 0x7fb8bc06b2d0 con 0x7fb8bc14f240 2023-10-03T19:19:52.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.228+0000 7fb8ba7fc640 1 -- 172.21.15.45:0/4124046092 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8a4003530 con 0x7fb8bc14f240 2023-10-03T19:19:52.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.228+0000 7fb8bbfff640 1 -- 172.21.15.45:0/4124046092 >> v1:172.21.15.79:6789/0 conn(0x7fb8bc0c2790 legacy=0x7fb8bc0c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:52.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.228+0000 7fb8bbfff640 1 -- 172.21.15.45:0/4124046092 >> v1:172.21.15.45:6789/0 conn(0x7fb8bc14f240 legacy=0x7fb8bc0c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:52.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.228+0000 7fb8bbfff640 1 -- 172.21.15.45:0/4124046092 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8bc0c19b0 con 0x7fb8bc0bb1d0 2023-10-03T19:19:52.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8bbfff640 1 --2- 172.21.15.45:0/4124046092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8bc0bb1d0 0x7fb8bc1528d0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4009d90 tx=0x7fb8b401f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b39b4efa646e405 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:52.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8ba7fc640 1 -- 172.21.15.45:0/4124046092 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b40af600 con 0x7fb8bc0bb1d0 2023-10-03T19:19:52.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8ba7fc640 1 -- 172.21.15.45:0/4124046092 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b40ab050 con 0x7fb8bc0bb1d0 2023-10-03T19:19:52.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8ba7fc640 1 -- 172.21.15.45:0/4124046092 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b40af980 con 0x7fb8bc0bb1d0 2023-10-03T19:19:52.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8c1ee6640 1 -- 172.21.15.45:0/4124046092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8bc0bb1d0 msgr2=0x7fb8bc1528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:52.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8c1ee6640 1 --2- 172.21.15.45:0/4124046092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8bc0bb1d0 0x7fb8bc1528d0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4009d90 tx=0x7fb8b401f130 comp rx=0 tx=0).stop 2023-10-03T19:19:52.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8c1ee6640 1 -- 172.21.15.45:0/4124046092 shutdown_connections 2023-10-03T19:19:52.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8c1ee6640 1 --2- 172.21.15.45:0/4124046092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8bc0bb1d0 0x7fb8bc1528d0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:52.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8c1ee6640 1 -- 172.21.15.45:0/4124046092 >> 172.21.15.45:0/4124046092 conn(0x7fb8bc0a64a0 msgr2=0x7fb8bc0a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:52.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8c1ee6640 1 -- 172.21.15.45:0/4124046092 shutdown_connections 2023-10-03T19:19:52.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8c1ee6640 1 -- 172.21.15.45:0/4124046092 wait complete. 2023-10-03T19:19:52.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8c1ee6640 1 Processor -- start 2023-10-03T19:19:52.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8c1ee6640 1 -- start start 2023-10-03T19:19:52.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8c1ee6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb8bc0bb1d0 0x7fb8bc14b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:52.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8c1ee6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8bc0c2790 0x7fb8bc1503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:52.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8c1ee6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8bc14f240 0x7fb8bc0c2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:52.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8c1ee6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc0a27a0 con 0x7fb8bc14f240 2023-10-03T19:19:52.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8c1ee6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc0a22a0 con 0x7fb8bc0c2790 2023-10-03T19:19:52.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8c1ee6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc0a2c80 con 0x7fb8bc0bb1d0 2023-10-03T19:19:52.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8bbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8bc14f240 0x7fb8bc0c2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:52.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8bbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8bc14f240 0x7fb8bc0c2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34584/0 (socket says 172.21.15.45:34584) 2023-10-03T19:19:52.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8bbfff640 1 -- 172.21.15.45:0/151196498 learned_addr learned my addr 172.21.15.45:0/151196498 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:52.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8bb7fe640 1 --2- 172.21.15.45:0/151196498 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb8bc0bb1d0 0x7fb8bc14b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:52.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8baffd640 1 --2- 172.21.15.45:0/151196498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8bc0c2790 0x7fb8bc1503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:52.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8bbfff640 1 -- 172.21.15.45:0/151196498 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb8bc0bb1d0 msgr2=0x7fb8bc14b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:52.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8bbfff640 1 --2- 172.21.15.45:0/151196498 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb8bc0bb1d0 0x7fb8bc14b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:52.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8bbfff640 1 -- 172.21.15.45:0/151196498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8bc0c2790 msgr2=0x7fb8bc1503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:52.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8bbfff640 1 --2- 172.21.15.45:0/151196498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8bc0c2790 0x7fb8bc1503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:52.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8bbfff640 1 -- 172.21.15.45:0/151196498 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b4009a70 con 0x7fb8bc14f240 2023-10-03T19:19:52.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8baffd640 1 --2- 172.21.15.45:0/151196498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8bc0c2790 0x7fb8bc1503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:52.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.232+0000 7fb8bb7fe640 1 --2- 172.21.15.45:0/151196498 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb8bc0bb1d0 0x7fb8bc14b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:52.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.236+0000 7fb8bbfff640 1 --2- 172.21.15.45:0/151196498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8bc14f240 0x7fb8bc0c2ee0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fb8b40b2040 tx=0x7fb8b401bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:52.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.236+0000 7fb8a3fff640 1 -- 172.21.15.45:0/151196498 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4009450 con 0x7fb8bc14f240 2023-10-03T19:19:52.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.236+0000 7fb8a3fff640 1 -- 172.21.15.45:0/151196498 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b40b9410 con 0x7fb8bc14f240 2023-10-03T19:19:52.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.236+0000 7fb8c1ee6640 1 -- 172.21.15.45:0/151196498 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8bc0a3f40 con 0x7fb8bc14f240 2023-10-03T19:19:52.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.236+0000 7fb8a3fff640 1 -- 172.21.15.45:0/151196498 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b40b97c0 con 0x7fb8bc14f240 2023-10-03T19:19:52.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.236+0000 7fb8c1ee6640 1 -- 172.21.15.45:0/151196498 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8bc14e740 con 0x7fb8bc14f240 2023-10-03T19:19:52.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.236+0000 7fb8c1ee6640 1 -- 172.21.15.45:0/151196498 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8bc14f610 con 0x7fb8bc14f240 2023-10-03T19:19:52.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.236+0000 7fb8a3fff640 1 -- 172.21.15.45:0/151196498 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb8b40b6050 con 0x7fb8bc14f240 2023-10-03T19:19:52.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.236+0000 7fb8a3fff640 1 --2- 172.21.15.45:0/151196498 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb8a8066280 0x7fb8a8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:52.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.236+0000 7fb8a3fff640 1 -- 172.21.15.45:0/151196498 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb8b4122210 con 0x7fb8bc14f240 2023-10-03T19:19:52.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.236+0000 7fb8bb7fe640 1 --2- 172.21.15.45:0/151196498 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb8a8066280 0x7fb8a8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:52.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.236+0000 7fb8bb7fe640 1 --2- 172.21.15.45:0/151196498 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb8a8066280 0x7fb8a8068730 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac0010f0 tx=0x7fb8ac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:52.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.240+0000 7fb8a3fff640 1 -- 172.21.15.45:0/151196498 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb8b40ef670 con 0x7fb8bc14f240 2023-10-03T19:19:52.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.432+0000 7fb8c1ee6640 1 -- 172.21.15.45:0/151196498 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb8bc04de80 con 0x7fb8bc14f240 2023-10-03T19:19:52.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.432+0000 7fb8a3fff640 1 -- 172.21.15.45:0/151196498 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v50) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb8b40f2c90 con 0x7fb8bc14f240 2023-10-03T19:19:52.453 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-03T19:19:52.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.432+0000 7fb8c1ee6640 1 -- 172.21.15.45:0/151196498 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb8a8066280 msgr2=0x7fb8a8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:52.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.432+0000 7fb8c1ee6640 1 --2- 172.21.15.45:0/151196498 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb8a8066280 0x7fb8a8068730 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac0010f0 tx=0x7fb8ac009040 comp rx=0 tx=0).stop 2023-10-03T19:19:52.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.432+0000 7fb8c1ee6640 1 -- 172.21.15.45:0/151196498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8bc14f240 msgr2=0x7fb8bc0c2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:52.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.432+0000 7fb8c1ee6640 1 --2- 172.21.15.45:0/151196498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8bc14f240 0x7fb8bc0c2ee0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fb8b40b2040 tx=0x7fb8b401bed0 comp rx=0 tx=0).stop 2023-10-03T19:19:52.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.432+0000 7fb8c1ee6640 1 -- 172.21.15.45:0/151196498 shutdown_connections 2023-10-03T19:19:52.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.432+0000 7fb8c1ee6640 1 --2- 172.21.15.45:0/151196498 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb8a8066280 0x7fb8a8068730 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:52.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.432+0000 7fb8c1ee6640 1 --2- 172.21.15.45:0/151196498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8bc14f240 0x7fb8bc0c2ee0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:52.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.432+0000 7fb8c1ee6640 1 --2- 172.21.15.45:0/151196498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8bc0c2790 0x7fb8bc1503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:52.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.432+0000 7fb8c1ee6640 1 --2- 172.21.15.45:0/151196498 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb8bc0bb1d0 0x7fb8bc14b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:52.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.432+0000 7fb8c1ee6640 1 -- 172.21.15.45:0/151196498 >> 172.21.15.45:0/151196498 conn(0x7fb8bc0a64a0 msgr2=0x7fb8bc0a6870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:52.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.432+0000 7fb8c1ee6640 1 -- 172.21.15.45:0/151196498 shutdown_connections 2023-10-03T19:19:52.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:52.432+0000 7fb8c1ee6640 1 -- 172.21.15.45:0/151196498 wait complete. 2023-10-03T19:19:52.456 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-03T19:19:52.456 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-03T19:19:52.456 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi172.front.sepia.ceph.com 2023-10-03T19:19:52.456 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-03T19:19:52.457 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-03T19:19:52.457 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-03T19:19:52.457 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-03T19:19:52.457 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-03T19:19:52.457 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-03T19:19:52.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:52.457 DEBUG:teuthology.orchestra.run.smithi172:> ip addr 2023-10-03T19:19:52.464 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-03T19:19:52.464 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-03T19:19:52.464 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2023-10-03T19:19:52.464 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:19:52.464 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2023-10-03T19:19:52.464 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:19:52.464 INFO:teuthology.orchestra.run.smithi172.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:19:52.465 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2c brd ff:ff:ff:ff:ff:ff 2023-10-03T19:19:52.465 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f0 2023-10-03T19:19:52.465 INFO:teuthology.orchestra.run.smithi172.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:19:52.465 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2d brd ff:ff:ff:ff:ff:ff 2023-10-03T19:19:52.465 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f1 2023-10-03T19:19:52.465 INFO:teuthology.orchestra.run.smithi172.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:19:52.465 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:90 brd ff:ff:ff:ff:ff:ff 2023-10-03T19:19:52.465 INFO:teuthology.orchestra.run.smithi172.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-03T19:19:52.465 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:91 brd ff:ff:ff:ff:ff:ff 2023-10-03T19:19:52.465 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.21.15.172/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-03T19:19:52.465 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft 41983sec preferred_lft 41983sec 2023-10-03T19:19:52.465 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::ec4:7aff:fe88:7f91/64 scope link 2023-10-03T19:19:52.465 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:19:52.466 INFO:teuthology.orchestra.run.smithi172.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-03T19:19:52.466 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 02:42:f8:ea:71:4e brd ff:ff:ff:ff:ff:ff 2023-10-03T19:19:52.466 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-03T19:19:52.466 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:19:52.466 INFO:teuthology.orchestra.run.smithi172.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-03T19:19:52.466 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-03T19:19:52.466 INFO:teuthology.orchestra.run.smithi172.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-03T19:19:52.466 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:19:52.466 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::7ce5:4fff:fe93:8871/64 scope link 2023-10-03T19:19:52.466 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:19:52.466 INFO:teuthology.orchestra.run.smithi172.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-03T19:19:52.467 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-03T19:19:52.467 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-03T19:19:52.467 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:19:52.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:52.467 DEBUG:teuthology.orchestra.run.smithi172:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-03T19:19:52.520 INFO:teuthology.orchestra.run.smithi172.stdout:1 2023-10-03T19:19:52.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:52.544 DEBUG:teuthology.orchestra.run.smithi172:> route 2023-10-03T19:19:52.595 INFO:teuthology.orchestra.run.smithi172.stdout:Kernel IP routing table 2023-10-03T19:19:52.595 INFO:teuthology.orchestra.run.smithi172.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-03T19:19:52.596 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-03T19:19:52.596 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-03T19:19:52.596 INFO:teuthology.orchestra.run.smithi172.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-03T19:19:52.596 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-03T19:19:52.596 INFO:teuthology.orchestra.run.smithi172.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:19:52.596 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:19:52.596 INFO:teuthology.orchestra.run.smithi172.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:19:52.596 INFO:teuthology.orchestra.run.smithi172.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-03T19:19:52.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:52.597 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-10-03T19:19:52.597 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-10-03T19:19:52.597 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-03T19:19:52.597 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-03T19:19:52.597 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-03T19:19:52.597 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-10-03T19:19:52.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:52.692 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2023-10-03T19:19:52.717 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-03T19:19:52.717 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-03T19:19:52.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:52.717 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set brx.0 up 2023-10-03T19:19:52.772 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-03T19:19:52.772 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T19:19:52.772 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-03T19:19:52.820 INFO:teuthology.orchestra.run.smithi172.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-03T19:19:52.845 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T19:19:52.845 DEBUG:teuthology.orchestra.run.smithi172:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-03T19:19:52.868 DEBUG:teuthology.orchestra.run.smithi172:> sudo modprobe fuse 2023-10-03T19:19:52.925 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:19:52.925 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:19:52.978 INFO:teuthology.orchestra.run.smithi172.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:19:53.014 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:19:53.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:53.015 DEBUG:teuthology.orchestra.run.smithi172:> ls /sys/fs/fuse/connections 2023-10-03T19:19:53.061 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-03T19:19:53.061 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-03T19:19:53.106 DEBUG:teuthology.orchestra.run.smithi172:> sudo modprobe fuse 2023-10-03T19:19:53.166 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:19:53.175 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:19:53.187 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi172.stderr:2023-10-03T19:19:53.187+0000 7f251d8ad580 -1 init, newargv = 0x5618225770f0 newargc=15 2023-10-03T19:19:53.229 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi172.stderr:ceph-fuse[33416]: starting ceph client 2023-10-03T19:19:53.229 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi172.stderr:ceph-fuse[33416]: starting fuse 2023-10-03T19:19:53.239 INFO:teuthology.orchestra.run.smithi172.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:19:53.240 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:19:53.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:53.240 DEBUG:teuthology.orchestra.run.smithi172:> ls /sys/fs/fuse/connections 2023-10-03T19:19:53.288 INFO:teuthology.orchestra.run.smithi172.stdout:45 2023-10-03T19:19:53.310 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-03T19:19:53.310 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-03T19:19:53.311 DEBUG:teuthology.orchestra.run.smithi172:> import glob 2023-10-03T19:19:53.311 DEBUG:teuthology.orchestra.run.smithi172:> import re 2023-10-03T19:19:53.311 DEBUG:teuthology.orchestra.run.smithi172:> import os 2023-10-03T19:19:53.311 DEBUG:teuthology.orchestra.run.smithi172:> import subprocess 2023-10-03T19:19:53.311 DEBUG:teuthology.orchestra.run.smithi172:> 2023-10-03T19:19:53.311 DEBUG:teuthology.orchestra.run.smithi172:> def _find_admin_socket(client_name): 2023-10-03T19:19:53.311 DEBUG:teuthology.orchestra.run.smithi172:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-03T19:19:53.311 DEBUG:teuthology.orchestra.run.smithi172:> files = glob.glob(asok_path) 2023-10-03T19:19:53.311 DEBUG:teuthology.orchestra.run.smithi172:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-03T19:19:53.311 DEBUG:teuthology.orchestra.run.smithi172:> 2023-10-03T19:19:53.311 DEBUG:teuthology.orchestra.run.smithi172:> # Given a non-glob path, it better be there 2023-10-03T19:19:53.311 DEBUG:teuthology.orchestra.run.smithi172:> if "*" not in asok_path: 2023-10-03T19:19:53.312 DEBUG:teuthology.orchestra.run.smithi172:> assert(len(files) == 1) 2023-10-03T19:19:53.312 DEBUG:teuthology.orchestra.run.smithi172:> return files[0] 2023-10-03T19:19:53.312 DEBUG:teuthology.orchestra.run.smithi172:> 2023-10-03T19:19:53.312 DEBUG:teuthology.orchestra.run.smithi172:> for f in files: 2023-10-03T19:19:53.312 DEBUG:teuthology.orchestra.run.smithi172:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-03T19:19:53.312 DEBUG:teuthology.orchestra.run.smithi172:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-03T19:19:53.312 DEBUG:teuthology.orchestra.run.smithi172:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-03T19:19:53.312 DEBUG:teuthology.orchestra.run.smithi172:> contents = proc_f.read() 2023-10-03T19:19:53.312 DEBUG:teuthology.orchestra.run.smithi172:> if mountpoint in contents: 2023-10-03T19:19:53.312 DEBUG:teuthology.orchestra.run.smithi172:> return f 2023-10-03T19:19:53.312 DEBUG:teuthology.orchestra.run.smithi172:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-03T19:19:53.312 DEBUG:teuthology.orchestra.run.smithi172:> 2023-10-03T19:19:53.312 DEBUG:teuthology.orchestra.run.smithi172:> print(_find_admin_socket("client.1")) 2023-10-03T19:19:53.313 DEBUG:teuthology.orchestra.run.smithi172:> ' 2023-10-03T19:19:53.405 INFO:teuthology.orchestra.run.smithi172.stdout:/var/run/ceph/ceph-client.1.33416.asok 2023-10-03T19:19:53.588 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.33416.asok 2023-10-03T19:19:53.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:53.619 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.33416.asok status 2023-10-03T19:19:53.745 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2023-10-03T19:19:53.773 INFO:teuthology.orchestra.run.smithi172.stdout: "metadata": { 2023-10-03T19:19:53.773 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_sha1": "05a43c8fb3988914c879a50970f9054a098e0612", 2023-10-03T19:19:53.773 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_version": "ceph version 18.0.0-3908-g05a43c8f (05a43c8fb3988914c879a50970f9054a098e0612) reef (dev)", 2023-10-03T19:19:53.773 INFO:teuthology.orchestra.run.smithi172.stdout: "entity_id": "1", 2023-10-03T19:19:53.773 INFO:teuthology.orchestra.run.smithi172.stdout: "hostname": "smithi172", 2023-10-03T19:19:53.774 INFO:teuthology.orchestra.run.smithi172.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-03T19:19:53.774 INFO:teuthology.orchestra.run.smithi172.stdout: "pid": "33416", 2023-10-03T19:19:53.774 INFO:teuthology.orchestra.run.smithi172.stdout: "root": "/" 2023-10-03T19:19:53.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-03T19:19:53.774 INFO:teuthology.orchestra.run.smithi172.stdout: "dentry_count": 0, 2023-10-03T19:19:53.774 INFO:teuthology.orchestra.run.smithi172.stdout: "dentry_pinned_count": 0, 2023-10-03T19:19:53.774 INFO:teuthology.orchestra.run.smithi172.stdout: "id": 7350, 2023-10-03T19:19:53.774 INFO:teuthology.orchestra.run.smithi172.stdout: "inst": { 2023-10-03T19:19:53.774 INFO:teuthology.orchestra.run.smithi172.stdout: "name": { 2023-10-03T19:19:53.774 INFO:teuthology.orchestra.run.smithi172.stdout: "type": "client", 2023-10-03T19:19:53.774 INFO:teuthology.orchestra.run.smithi172.stdout: "num": 7350 2023-10-03T19:19:53.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-03T19:19:53.775 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": { 2023-10-03T19:19:53.775 INFO:teuthology.orchestra.run.smithi172.stdout: "type": "v1", 2023-10-03T19:19:53.775 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": "172.21.15.172:0", 2023-10-03T19:19:53.775 INFO:teuthology.orchestra.run.smithi172.stdout: "nonce": 3138699255 2023-10-03T19:19:53.775 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-03T19:19:53.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-03T19:19:53.775 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": { 2023-10-03T19:19:53.775 INFO:teuthology.orchestra.run.smithi172.stdout: "type": "v1", 2023-10-03T19:19:53.775 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": "172.21.15.172:0", 2023-10-03T19:19:53.775 INFO:teuthology.orchestra.run.smithi172.stdout: "nonce": 3138699255 2023-10-03T19:19:53.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-03T19:19:53.776 INFO:teuthology.orchestra.run.smithi172.stdout: "inst_str": "client.7350 172.21.15.172:0/3138699255", 2023-10-03T19:19:53.776 INFO:teuthology.orchestra.run.smithi172.stdout: "addr_str": "172.21.15.172:0/3138699255", 2023-10-03T19:19:53.776 INFO:teuthology.orchestra.run.smithi172.stdout: "inode_count": 1, 2023-10-03T19:19:53.776 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_epoch": 50, 2023-10-03T19:19:53.776 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_epoch": 98, 2023-10-03T19:19:53.776 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_epoch_barrier": 0, 2023-10-03T19:19:53.776 INFO:teuthology.orchestra.run.smithi172.stdout: "blocklisted": false, 2023-10-03T19:19:53.776 INFO:teuthology.orchestra.run.smithi172.stdout: "fs_name": "cephfs" 2023-10-03T19:19:53.776 INFO:teuthology.orchestra.run.smithi172.stdout:} 2023-10-03T19:19:53.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:53.777 DEBUG:teuthology.orchestra.run.smithi172:> stat --file-system '--printf=%T 2023-10-03T19:19:53.778 DEBUG:teuthology.orchestra.run.smithi172:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-03T19:19:53.784 INFO:teuthology.orchestra.run.smithi172.stdout:fuseblk 2023-10-03T19:19:53.795 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-03T19:19:53.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:53.795 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-03T19:19:53.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:53.854 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p foo/bar) 2023-10-03T19:19:53.877 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:19:54.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.060+0000 7f7004032640 1 Processor -- start 2023-10-03T19:19:54.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.060+0000 7f7004032640 1 -- start start 2023-10-03T19:19:54.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.060+0000 7f7004032640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6ffc150400 0x7f6ffc06c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:54.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.060+0000 7f7004032640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6ffc06c620 0x7f6ffc156110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:54.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.060+0000 7f7004032640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ffc0a1720 con 0x7f6ffc0bca80 2023-10-03T19:19:54.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.060+0000 7f7004032640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ffc0a2230 con 0x7f6ffc150400 2023-10-03T19:19:54.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.060+0000 7f7004032640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc0a18d0 con 0x7f6ffc06c620 2023-10-03T19:19:54.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.060+0000 7f7001dce640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6ffc150400 0x7f6ffc06c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:54.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.060+0000 7f7001dce640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6ffc150400 0x7f6ffc06c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34598/0 (socket says 172.21.15.45:34598) 2023-10-03T19:19:54.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.060+0000 7f7001dce640 1 -- 172.21.15.45:0/2100618097 learned_addr learned my addr 172.21.15.45:0/2100618097 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:54.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.060+0000 7f70015cd640 1 --2- 172.21.15.45:0/2100618097 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6ffc06c620 0x7f6ffc156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:54.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.060+0000 7f7001dce640 1 -- 172.21.15.45:0/2100618097 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6ffc06c620 msgr2=0x7f6ffc156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:54.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.060+0000 7f7001dce640 1 --2- 172.21.15.45:0/2100618097 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6ffc06c620 0x7f6ffc156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:54.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.060+0000 7f7001dce640 1 -- 172.21.15.45:0/2100618097 >> v1:172.21.15.79:6789/0 conn(0x7f6ffc0bca80 legacy=0x7f6ffc156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:54.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.060+0000 7f7001dce640 1 -- 172.21.15.45:0/2100618097 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ffc1507d0 con 0x7f6ffc150400 2023-10-03T19:19:54.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f7001dce640 1 --2- 172.21.15.45:0/2100618097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ffc150400 0x7f6ffc06c0e0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8009870 tx=0x7f6ff801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb73f2e824d4503e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:54.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f7000dcc640 1 -- 172.21.15.45:0/2100618097 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff80ab600 con 0x7f6ffc150400 2023-10-03T19:19:54.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f7000dcc640 1 -- 172.21.15.45:0/2100618097 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff80a7050 con 0x7f6ffc150400 2023-10-03T19:19:54.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f7000dcc640 1 -- 172.21.15.45:0/2100618097 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff80ab980 con 0x7f6ffc150400 2023-10-03T19:19:54.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f7004032640 1 -- 172.21.15.45:0/2100618097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ffc150400 msgr2=0x7f6ffc06c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:54.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f7004032640 1 --2- 172.21.15.45:0/2100618097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ffc150400 0x7f6ffc06c0e0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8009870 tx=0x7f6ff801c470 comp rx=0 tx=0).stop 2023-10-03T19:19:54.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f7004032640 1 -- 172.21.15.45:0/2100618097 shutdown_connections 2023-10-03T19:19:54.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f7004032640 1 --2- 172.21.15.45:0/2100618097 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6ffc06c620 0x7f6ffc156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:54.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f7004032640 1 --2- 172.21.15.45:0/2100618097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ffc150400 0x7f6ffc06c0e0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:54.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f7004032640 1 -- 172.21.15.45:0/2100618097 >> 172.21.15.45:0/2100618097 conn(0x7f6ffc0bcf50 msgr2=0x7f6ffc0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:54.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f7004032640 1 -- 172.21.15.45:0/2100618097 shutdown_connections 2023-10-03T19:19:54.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f7004032640 1 -- 172.21.15.45:0/2100618097 wait complete. 2023-10-03T19:19:54.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f7004032640 1 Processor -- start 2023-10-03T19:19:54.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f7004032640 1 -- start start 2023-10-03T19:19:54.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f7004032640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6ffc06c620 0x7f6ffc1eebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:54.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f7004032640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ffc0bca80 0x7f6ffc14eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:54.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f7004032640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ffc150400 0x7f6ffc155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:54.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f7004032640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc1ef120 con 0x7f6ffc0bca80 2023-10-03T19:19:54.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f7004032640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc0a5650 con 0x7f6ffc150400 2023-10-03T19:19:54.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f7004032640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc1553a0 con 0x7f6ffc06c620 2023-10-03T19:19:54.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f70015cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ffc0bca80 0x7f6ffc14eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:54.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f70015cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ffc0bca80 0x7f6ffc14eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34614/0 (socket says 172.21.15.45:34614) 2023-10-03T19:19:54.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f70015cd640 1 -- 172.21.15.45:0/3705668994 learned_addr learned my addr 172.21.15.45:0/3705668994 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:54.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f70025cf640 1 --2- 172.21.15.45:0/3705668994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ffc150400 0x7f6ffc155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:54.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f7001dce640 1 --2- 172.21.15.45:0/3705668994 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6ffc06c620 0x7f6ffc1eebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:54.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f70015cd640 1 -- 172.21.15.45:0/3705668994 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6ffc06c620 msgr2=0x7f6ffc1eebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:54.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f70015cd640 1 --2- 172.21.15.45:0/3705668994 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6ffc06c620 0x7f6ffc1eebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:54.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f70015cd640 1 -- 172.21.15.45:0/3705668994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ffc150400 msgr2=0x7f6ffc155830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:54.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f70015cd640 1 --2- 172.21.15.45:0/3705668994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ffc150400 0x7f6ffc155830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:54.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f70015cd640 1 -- 172.21.15.45:0/3705668994 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff80094d0 con 0x7f6ffc0bca80 2023-10-03T19:19:54.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f70025cf640 1 --2- 172.21.15.45:0/3705668994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ffc150400 0x7f6ffc155830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:54.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f70015cd640 1 --2- 172.21.15.45:0/3705668994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ffc0bca80 0x7f6ffc14eee0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f6fec00d800 tx=0x7f6fec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:54.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f6ff27fc640 1 -- 172.21.15.45:0/3705668994 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec00b6c0 con 0x7f6ffc0bca80 2023-10-03T19:19:54.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f6ff27fc640 1 -- 172.21.15.45:0/3705668994 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fec00b820 con 0x7f6ffc0bca80 2023-10-03T19:19:54.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.064+0000 7f7004032640 1 -- 172.21.15.45:0/3705668994 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ffc0bdbc0 con 0x7f6ffc0bca80 2023-10-03T19:19:54.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.068+0000 7f6ff27fc640 1 -- 172.21.15.45:0/3705668994 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec00bbd0 con 0x7f6ffc0bca80 2023-10-03T19:19:54.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.068+0000 7f7004032640 1 -- 172.21.15.45:0/3705668994 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ffc0a1b20 con 0x7f6ffc0bca80 2023-10-03T19:19:54.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.068+0000 7f7004032640 1 -- 172.21.15.45:0/3705668994 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ffc15fc60 con 0x7f6ffc0bca80 2023-10-03T19:19:54.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.068+0000 7f6ff27fc640 1 -- 172.21.15.45:0/3705668994 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6fec00bd30 con 0x7f6ffc0bca80 2023-10-03T19:19:54.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.068+0000 7f6ff27fc640 1 --2- 172.21.15.45:0/3705668994 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6fe00662d0 0x7f6fe0068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:54.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.068+0000 7f6ff27fc640 1 -- 172.21.15.45:0/3705668994 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6fec084ce0 con 0x7f6ffc0bca80 2023-10-03T19:19:54.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.068+0000 7f7001dce640 1 --2- 172.21.15.45:0/3705668994 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6fe00662d0 0x7f6fe0068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:54.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.068+0000 7f7001dce640 1 --2- 172.21.15.45:0/3705668994 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6fe00662d0 0x7f6fe0068780 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80ad000 tx=0x7f6ff8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:54.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.072+0000 7f6ff27fc640 1 -- 172.21.15.45:0/3705668994 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6fec0522f0 con 0x7f6ffc0bca80 2023-10-03T19:19:54.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.260+0000 7f7004032640 1 -- 172.21.15.45:0/3705668994 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ffc04de80 con 0x7f6ffc0bca80 2023-10-03T19:19:54.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.260+0000 7f6ff27fc640 1 -- 172.21.15.45:0/3705668994 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+3916 (secure 0 0 0) 0x7f6fec055910 con 0x7f6ffc0bca80 2023-10-03T19:19:54.264 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:19:54.264 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":50,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5795,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2000006019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2000006019},{"type":"v1","addr":"172.21.15.79:6835","nonce":2000006019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":7149,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/3326584899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3326584899},{"type":"v1","addr":"172.21.15.45:6833","nonce":3326584899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:19:39.419474+0000","modified":"2023-10-03T19:19:41.692109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7155},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7155":{"gid":7155,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3401546487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3401546487},{"type":"v1","addr":"172.21.15.45:6835","nonce":3401546487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-10-03T19:19:54.264 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 50 2023-10-03T19:19:54.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.264+0000 7f7004032640 1 -- 172.21.15.45:0/3705668994 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6fe00662d0 msgr2=0x7f6fe0068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:54.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.264+0000 7f7004032640 1 --2- 172.21.15.45:0/3705668994 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6fe00662d0 0x7f6fe0068780 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80ad000 tx=0x7f6ff8008040 comp rx=0 tx=0).stop 2023-10-03T19:19:54.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.264+0000 7f7004032640 1 -- 172.21.15.45:0/3705668994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ffc0bca80 msgr2=0x7f6ffc14eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:54.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.264+0000 7f7004032640 1 --2- 172.21.15.45:0/3705668994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ffc0bca80 0x7f6ffc14eee0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f6fec00d800 tx=0x7f6fec00dcc0 comp rx=0 tx=0).stop 2023-10-03T19:19:54.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.264+0000 7f7004032640 1 -- 172.21.15.45:0/3705668994 shutdown_connections 2023-10-03T19:19:54.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.264+0000 7f7004032640 1 --2- 172.21.15.45:0/3705668994 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6fe00662d0 0x7f6fe0068780 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:54.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.264+0000 7f7004032640 1 --2- 172.21.15.45:0/3705668994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ffc150400 0x7f6ffc155830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:54.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.264+0000 7f7004032640 1 --2- 172.21.15.45:0/3705668994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ffc0bca80 0x7f6ffc14eee0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:54.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.264+0000 7f7004032640 1 --2- 172.21.15.45:0/3705668994 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6ffc06c620 0x7f6ffc1eebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:54.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.264+0000 7f7004032640 1 -- 172.21.15.45:0/3705668994 >> 172.21.15.45:0/3705668994 conn(0x7f6ffc0bcf50 msgr2=0x7f6ffc14c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:54.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.264+0000 7f7004032640 1 -- 172.21.15.45:0/3705668994 shutdown_connections 2023-10-03T19:19:54.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.264+0000 7f7004032640 1 -- 172.21.15.45:0/3705668994 wait complete. 2023-10-03T19:19:54.317 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump dir /foo 2023-10-03T19:19:54.450 INFO:teuthology.orchestra.run.smithi045.stdout:[{"path":"/foo","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"3","version":"3","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"dirty":1,"authpin":0},"nref":2}] 2023-10-03T19:19:54.475 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/foo", "pins": { "authpin": 0, "child": 1, "dirty": 1 }, "projected_version": "3", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "3" } ] 2023-10-03T19:19:54.475 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:19:54.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.588+0000 7fe04a49d640 1 Processor -- start 2023-10-03T19:19:54.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.588+0000 7fe04a49d640 1 -- start start 2023-10-03T19:19:54.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.588+0000 7fe04a49d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0440bed20 0x7fe0440bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:54.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.588+0000 7fe04a49d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe0440a6f00 0x7fe044150200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:54.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.588+0000 7fe04a49d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe04414fd70 con 0x7fe044150740 2023-10-03T19:19:54.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.588+0000 7fe04a49d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe04414d420 con 0x7fe0440a6f00 2023-10-03T19:19:54.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.588+0000 7fe04a49d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe044146910 con 0x7fe0440bed20 2023-10-03T19:19:54.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe048a3a640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe044150740 0x7fe0440be010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35888/0 (socket says 172.21.15.45:35888) 2023-10-03T19:19:54.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe048a3a640 1 -- 172.21.15.45:0/985349311 learned_addr learned my addr 172.21.15.45:0/985349311 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:54.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe0437fe640 1 --2- 172.21.15.45:0/985349311 >> v2:172.21.15.79:3300/0 conn(0x7fe0440a6f00 0x7fe044150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:54.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe042ffd640 1 -- 172.21.15.45:0/985349311 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782618514 0 0) 0x7fe04414fd70 con 0x7fe044150740 2023-10-03T19:19:54.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe043fff640 1 --2- 172.21.15.45:0/985349311 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0440bed20 0x7fe0440bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:54.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe042ffd640 1 -- 172.21.15.45:0/985349311 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe030003530 con 0x7fe044150740 2023-10-03T19:19:54.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe042ffd640 1 -- 172.21.15.45:0/985349311 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3673366723 0 0) 0x7fe030003530 con 0x7fe044150740 2023-10-03T19:19:54.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe042ffd640 1 -- 172.21.15.45:0/985349311 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0440bed20 msgr2=0x7fe0440bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:54.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe042ffd640 1 --2- 172.21.15.45:0/985349311 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0440bed20 0x7fe0440bf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:54.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe042ffd640 1 -- 172.21.15.45:0/985349311 >> v2:172.21.15.79:3300/0 conn(0x7fe0440a6f00 msgr2=0x7fe044150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:54.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe042ffd640 1 --2- 172.21.15.45:0/985349311 >> v2:172.21.15.79:3300/0 conn(0x7fe0440a6f00 0x7fe044150200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:54.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe042ffd640 1 -- 172.21.15.45:0/985349311 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04406e9f0 con 0x7fe044150740 2023-10-03T19:19:54.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe042ffd640 1 -- 172.21.15.45:0/985349311 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fe03c001680 con 0x7fe044150740 2023-10-03T19:19:54.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe042ffd640 1 -- 172.21.15.45:0/985349311 >> v1:172.21.15.45:6789/0 conn(0x7fe044150740 legacy=0x7fe0440be010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:54.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe042ffd640 1 --2- 172.21.15.45:0/985349311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe030003980 0x7fe030003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:54.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe042ffd640 1 --2- 172.21.15.45:0/985349311 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0300047d0 0x7fe030004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:54.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe042ffd640 1 --2- 172.21.15.45:0/985349311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe030005180 0x7fe03000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:54.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe042ffd640 1 -- 172.21.15.45:0/985349311 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04414d420 con 0x7fe030005180 2023-10-03T19:19:54.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe042ffd640 1 -- 172.21.15.45:0/985349311 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe044146910 con 0x7fe030003980 2023-10-03T19:19:54.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe042ffd640 1 -- 172.21.15.45:0/985349311 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03000bf80 con 0x7fe0300047d0 2023-10-03T19:19:54.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe043fff640 1 --2- 172.21.15.45:0/985349311 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0440bed20 0x7fe0440bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:19:54.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe0437fe640 1 --2- 172.21.15.45:0/985349311 >> v2:172.21.15.79:3300/0 conn(0x7fe0440a6f00 0x7fe044150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:19:54.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe048a3a640 1 --2- 172.21.15.45:0/985349311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe030005180 0x7fe03000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:54.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe0437fe640 1 --2- 172.21.15.45:0/985349311 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0300047d0 0x7fe030004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:54.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe048a3a640 1 -- 172.21.15.45:0/985349311 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0300047d0 msgr2=0x7fe030004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:54.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe043fff640 1 --2- 172.21.15.45:0/985349311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe030003980 0x7fe030003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:54.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe048a3a640 1 --2- 172.21.15.45:0/985349311 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0300047d0 0x7fe030004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:54.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe048a3a640 1 -- 172.21.15.45:0/985349311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe030003980 msgr2=0x7fe030003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:54.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe048a3a640 1 --2- 172.21.15.45:0/985349311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe030003980 0x7fe030003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:54.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe048a3a640 1 -- 172.21.15.45:0/985349311 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe030003530 con 0x7fe030005180 2023-10-03T19:19:54.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe0437fe640 1 --2- 172.21.15.45:0/985349311 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe0300047d0 0x7fe030004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:54.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe043fff640 1 --2- 172.21.15.45:0/985349311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe030003980 0x7fe030003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:54.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe048a3a640 1 --2- 172.21.15.45:0/985349311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe030005180 0x7fe03000b990 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fe0440a76d0 tx=0x7fe03c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366e063e0900430d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:54.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe042ffd640 1 -- 172.21.15.45:0/985349311 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c0a5920 con 0x7fe030005180 2023-10-03T19:19:54.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe042ffd640 1 -- 172.21.15.45:0/985349311 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03c0a5a80 con 0x7fe030005180 2023-10-03T19:19:54.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.592+0000 7fe042ffd640 1 -- 172.21.15.45:0/985349311 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c0a5e50 con 0x7fe030005180 2023-10-03T19:19:54.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe04a49d640 1 -- 172.21.15.45:0/985349311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe030005180 msgr2=0x7fe03000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:54.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe04a49d640 1 --2- 172.21.15.45:0/985349311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe030005180 0x7fe03000b990 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fe0440a76d0 tx=0x7fe03c01cc20 comp rx=0 tx=0).stop 2023-10-03T19:19:54.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe048a3a640 1 -- 172.21.15.45:0/985349311 reap_dead start 2023-10-03T19:19:54.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe04a49d640 1 -- 172.21.15.45:0/985349311 shutdown_connections 2023-10-03T19:19:54.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe04a49d640 1 -- 172.21.15.45:0/985349311 >> 172.21.15.45:0/985349311 conn(0x7fe04406d990 msgr2=0x7fe04406bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:54.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe04a49d640 1 -- 172.21.15.45:0/985349311 shutdown_connections 2023-10-03T19:19:54.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe04a49d640 1 -- 172.21.15.45:0/985349311 wait complete. 2023-10-03T19:19:54.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe04a49d640 1 Processor -- start 2023-10-03T19:19:54.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe04a49d640 1 -- start start 2023-10-03T19:19:54.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe04a49d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe044149fc0 0x7fe04414c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:54.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe04a49d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe044145e80 0x7fe04414a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:54.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe04a49d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe04414ae50 0x7fe044145470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:54.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe04a49d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0441e7130 con 0x7fe044149fc0 2023-10-03T19:19:54.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe04a49d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04414b7d0 con 0x7fe044145e80 2023-10-03T19:19:54.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe04a49d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0441e6800 con 0x7fe04414ae50 2023-10-03T19:19:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe043fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe044149fc0 0x7fe04414c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe043fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe044149fc0 0x7fe04414c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34642/0 (socket says 172.21.15.45:34642) 2023-10-03T19:19:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe043fff640 1 -- 172.21.15.45:0/170031453 learned_addr learned my addr 172.21.15.45:0/170031453 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe048a3a640 1 --2- 172.21.15.45:0/170031453 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe04414ae50 0x7fe044145470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe0437fe640 1 --2- 172.21.15.45:0/170031453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe044145e80 0x7fe04414a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe043fff640 1 -- 172.21.15.45:0/170031453 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe04414ae50 msgr2=0x7fe044145470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe043fff640 1 --2- 172.21.15.45:0/170031453 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe04414ae50 0x7fe044145470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe043fff640 1 -- 172.21.15.45:0/170031453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe044145e80 msgr2=0x7fe04414a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe043fff640 1 --2- 172.21.15.45:0/170031453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe044145e80 0x7fe04414a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe043fff640 1 -- 172.21.15.45:0/170031453 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0440bf840 con 0x7fe044149fc0 2023-10-03T19:19:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe043fff640 1 --2- 172.21.15.45:0/170031453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe044149fc0 0x7fe04414c6f0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fe02c00e560 tx=0x7fe02c00e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe040ff9640 1 -- 172.21.15.45:0/170031453 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c00c070 con 0x7fe044149fc0 2023-10-03T19:19:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe040ff9640 1 -- 172.21.15.45:0/170031453 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02c013410 con 0x7fe044149fc0 2023-10-03T19:19:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe04a49d640 1 -- 172.21.15.45:0/170031453 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe04414f9b0 con 0x7fe044149fc0 2023-10-03T19:19:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe040ff9640 1 -- 172.21.15.45:0/170031453 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c013780 con 0x7fe044149fc0 2023-10-03T19:19:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe04a49d640 1 -- 172.21.15.45:0/170031453 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0440bf9d0 con 0x7fe044149fc0 2023-10-03T19:19:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.596+0000 7fe04a49d640 1 -- 172.21.15.45:0/170031453 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe04404de80 con 0x7fe044149fc0 2023-10-03T19:19:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.600+0000 7fe040ff9640 1 -- 172.21.15.45:0/170031453 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe02c0138e0 con 0x7fe044149fc0 2023-10-03T19:19:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.600+0000 7fe040ff9640 1 --2- 172.21.15.45:0/170031453 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe024066280 0x7fe024068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.600+0000 7fe040ff9640 1 -- 172.21.15.45:0/170031453 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe02c083cb0 con 0x7fe044149fc0 2023-10-03T19:19:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.600+0000 7fe0437fe640 1 --2- 172.21.15.45:0/170031453 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe024066280 0x7fe024068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.600+0000 7fe0437fe640 1 --2- 172.21.15.45:0/170031453 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe024066280 0x7fe024068730 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe0340094c0 tx=0x7fe03400b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:54.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.604+0000 7fe040ff9640 1 -- 172.21.15.45:0/170031453 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe02c051220 con 0x7fe044149fc0 2023-10-03T19:19:54.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.788+0000 7fe04a49d640 1 -- 172.21.15.45:0/170031453 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe04406e6a0 con 0x7fe044149fc0 2023-10-03T19:19:54.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.788+0000 7fe040ff9640 1 -- 172.21.15.45:0/170031453 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+3916 (secure 0 0 0) 0x7fe02c054840 con 0x7fe044149fc0 2023-10-03T19:19:54.793 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:19:54.794 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":50,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5795,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2000006019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2000006019},{"type":"v1","addr":"172.21.15.79:6835","nonce":2000006019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":7149,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/3326584899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3326584899},{"type":"v1","addr":"172.21.15.45:6833","nonce":3326584899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:19:39.419474+0000","modified":"2023-10-03T19:19:41.692109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7155},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7155":{"gid":7155,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3401546487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3401546487},{"type":"v1","addr":"172.21.15.45:6835","nonce":3401546487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-10-03T19:19:54.794 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 50 2023-10-03T19:19:54.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.792+0000 7fe04a49d640 1 -- 172.21.15.45:0/170031453 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe024066280 msgr2=0x7fe024068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:54.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.792+0000 7fe04a49d640 1 --2- 172.21.15.45:0/170031453 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe024066280 0x7fe024068730 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe0340094c0 tx=0x7fe03400b040 comp rx=0 tx=0).stop 2023-10-03T19:19:54.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.792+0000 7fe04a49d640 1 -- 172.21.15.45:0/170031453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe044149fc0 msgr2=0x7fe04414c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:54.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.792+0000 7fe04a49d640 1 --2- 172.21.15.45:0/170031453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe044149fc0 0x7fe04414c6f0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fe02c00e560 tx=0x7fe02c00e650 comp rx=0 tx=0).stop 2023-10-03T19:19:54.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.792+0000 7fe04a49d640 1 -- 172.21.15.45:0/170031453 shutdown_connections 2023-10-03T19:19:54.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.792+0000 7fe04a49d640 1 --2- 172.21.15.45:0/170031453 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe024066280 0x7fe024068730 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:54.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.792+0000 7fe04a49d640 1 --2- 172.21.15.45:0/170031453 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe04414ae50 0x7fe044145470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:54.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.792+0000 7fe04a49d640 1 --2- 172.21.15.45:0/170031453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe044145e80 0x7fe04414a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:54.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.792+0000 7fe04a49d640 1 --2- 172.21.15.45:0/170031453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe044149fc0 0x7fe04414c6f0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:54.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.792+0000 7fe04a49d640 1 -- 172.21.15.45:0/170031453 >> 172.21.15.45:0/170031453 conn(0x7fe04406d990 msgr2=0x7fe04414e680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:54.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.792+0000 7fe04a49d640 1 -- 172.21.15.45:0/170031453 shutdown_connections 2023-10-03T19:19:54.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:54.792+0000 7fe04a49d640 1 -- 172.21.15.45:0/170031453 wait complete. 2023-10-03T19:19:54.813 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump dir /foo --dentry_dump 2023-10-03T19:19:54.990 INFO:teuthology.orchestra.run.smithi045.stdout:[{"path":"/foo","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"3","version":"3","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"dirty":1,"authpin":0},"nref":2,"dentries":[{"path":"foo/bar","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511627777,"remote_type":"","version":2,"projected_version":2,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]}]}] 2023-10-03T19:19:55.035 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dentries": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511627777, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "foo/bar", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 2, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} } } ], "dir_auth": "", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/foo", "pins": { "authpin": 0, "child": 1, "dirty": 1 }, "projected_version": "3", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "3" } ] 2023-10-03T19:19:55.035 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-03T19:19:55.037 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:19:55.071 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:19:55.137 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:19:55.247 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:19:55.314 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-03T19:19:55.358 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:19:55.358 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:19:55.364 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:19:55.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.496+0000 7f0d23079640 1 Processor -- start 2023-10-03T19:19:55.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.496+0000 7f0d23079640 1 -- start start 2023-10-03T19:19:55.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.496+0000 7f0d23079640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0d1c069ad0 0x7f0d1c070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:55.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.496+0000 7f0d23079640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d1c0bd700 con 0x7f0d1c0658f0 2023-10-03T19:19:55.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.496+0000 7f0d23079640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d1c0bdcc0 con 0x7f0d1c069fe0 2023-10-03T19:19:55.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.496+0000 7f0d23079640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d1c06a420 con 0x7f0d1c069ad0 2023-10-03T19:19:55.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.496+0000 7f0d1bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0d1c069ad0 0x7f0d1c070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:55.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.496+0000 7f0d1bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0d1c069ad0 0x7f0d1c070a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59676/0 (socket says 172.21.15.45:59676) 2023-10-03T19:19:55.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.496+0000 7f0d1bfff640 1 -- 172.21.15.45:0/811621051 learned_addr learned my addr 172.21.15.45:0/811621051 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:55.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.496+0000 7f0d20e15640 1 --1- 172.21.15.45:0/811621051 >> v1:172.21.15.45:6789/0 conn(0x7f0d1c0658f0 0x7f0d1c14bad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51538/0 (socket says 172.21.15.45:51538) 2023-10-03T19:19:55.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.496+0000 7f0d1bfff640 1 -- 172.21.15.45:0/811621051 >> v1:172.21.15.79:6789/0 conn(0x7f0d1c069fe0 legacy=0x7f0d1c159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:55.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.496+0000 7f0d1bfff640 1 -- 172.21.15.45:0/811621051 >> v1:172.21.15.45:6789/0 conn(0x7f0d1c0658f0 legacy=0x7f0d1c14bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:55.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.496+0000 7f0d1bfff640 1 -- 172.21.15.45:0/811621051 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d1c14f740 con 0x7f0d1c069ad0 2023-10-03T19:19:55.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.496+0000 7f0d1b7fe640 1 -- 172.21.15.45:0/811621051 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3324103311 0 0) 0x7f0d1c0bd700 con 0x7f0d1c0658f0 2023-10-03T19:19:55.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.500+0000 7f0d1bfff640 1 --2- 172.21.15.45:0/811621051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d1c069ad0 0x7f0d1c070a30 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f0d100098a0 tx=0x7f0d1001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dafbb6001b0b70a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:55.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.500+0000 7f0d1b7fe640 1 -- 172.21.15.45:0/811621051 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d100a7070 con 0x7f0d1c069ad0 2023-10-03T19:19:55.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.500+0000 7f0d1b7fe640 1 -- 172.21.15.45:0/811621051 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d100ab430 con 0x7f0d1c069ad0 2023-10-03T19:19:55.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.500+0000 7f0d1b7fe640 1 -- 172.21.15.45:0/811621051 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d100ab7c0 con 0x7f0d1c069ad0 2023-10-03T19:19:55.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.500+0000 7f0d23079640 1 -- 172.21.15.45:0/811621051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d1c069ad0 msgr2=0x7f0d1c070a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:55.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.500+0000 7f0d23079640 1 --2- 172.21.15.45:0/811621051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d1c069ad0 0x7f0d1c070a30 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f0d100098a0 tx=0x7f0d1001c520 comp rx=0 tx=0).stop 2023-10-03T19:19:55.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.500+0000 7f0d23079640 1 -- 172.21.15.45:0/811621051 shutdown_connections 2023-10-03T19:19:55.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.500+0000 7f0d23079640 1 --2- 172.21.15.45:0/811621051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d1c069ad0 0x7f0d1c070a30 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:55.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.500+0000 7f0d23079640 1 -- 172.21.15.45:0/811621051 >> 172.21.15.45:0/811621051 conn(0x7f0d1c0bed00 msgr2=0x7f0d1c06d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:55.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.500+0000 7f0d23079640 1 -- 172.21.15.45:0/811621051 shutdown_connections 2023-10-03T19:19:55.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.500+0000 7f0d23079640 1 -- 172.21.15.45:0/811621051 wait complete. 2023-10-03T19:19:55.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.504+0000 7f0d23079640 1 Processor -- start 2023-10-03T19:19:55.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.504+0000 7f0d23079640 1 -- start start 2023-10-03T19:19:55.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.504+0000 7f0d23079640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d1c0658f0 0x7f0d1c13c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:55.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.504+0000 7f0d23079640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d1c069ad0 0x7f0d1c0c0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:55.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.504+0000 7f0d23079640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d1c069fe0 0x7f0d1c144d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:55.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.504+0000 7f0d23079640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c13ca30 con 0x7f0d1c069fe0 2023-10-03T19:19:55.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.504+0000 7f0d23079640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c13f250 con 0x7f0d1c069ad0 2023-10-03T19:19:55.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.504+0000 7f0d23079640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c13edc0 con 0x7f0d1c0658f0 2023-10-03T19:19:55.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.504+0000 7f0d21616640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d1c069fe0 0x7f0d1c144d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:55.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.504+0000 7f0d21616640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d1c069fe0 0x7f0d1c144d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59690/0 (socket says 172.21.15.45:59690) 2023-10-03T19:19:55.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.504+0000 7f0d21616640 1 -- 172.21.15.45:0/397441837 learned_addr learned my addr 172.21.15.45:0/397441837 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:55.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.504+0000 7f0d1bfff640 1 --2- 172.21.15.45:0/397441837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d1c069ad0 0x7f0d1c0c0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:55.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.504+0000 7f0d20e15640 1 --2- 172.21.15.45:0/397441837 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d1c0658f0 0x7f0d1c13c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:55.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.504+0000 7f0d21616640 1 -- 172.21.15.45:0/397441837 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d1c0658f0 msgr2=0x7f0d1c13c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:55.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.504+0000 7f0d21616640 1 --2- 172.21.15.45:0/397441837 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d1c0658f0 0x7f0d1c13c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:55.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.504+0000 7f0d21616640 1 -- 172.21.15.45:0/397441837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d1c069ad0 msgr2=0x7f0d1c0c0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:55.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.504+0000 7f0d21616640 1 --2- 172.21.15.45:0/397441837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d1c069ad0 0x7f0d1c0c0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:55.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.504+0000 7f0d21616640 1 -- 172.21.15.45:0/397441837 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d100094d0 con 0x7f0d1c069fe0 2023-10-03T19:19:55.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.504+0000 7f0d21616640 1 --2- 172.21.15.45:0/397441837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d1c069fe0 0x7f0d1c144d30 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f0d1400c7d0 tx=0x7f0d1400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:55.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.504+0000 7f0d197fa640 1 -- 172.21.15.45:0/397441837 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d14003b80 con 0x7f0d1c069fe0 2023-10-03T19:19:55.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.504+0000 7f0d197fa640 1 -- 172.21.15.45:0/397441837 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d14003ce0 con 0x7f0d1c069fe0 2023-10-03T19:19:55.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.504+0000 7f0d23079640 1 -- 172.21.15.45:0/397441837 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d1c0a3ff0 con 0x7f0d1c069fe0 2023-10-03T19:19:55.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.504+0000 7f0d197fa640 1 -- 172.21.15.45:0/397441837 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1400aa30 con 0x7f0d1c069fe0 2023-10-03T19:19:55.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.504+0000 7f0d23079640 1 -- 172.21.15.45:0/397441837 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d1c065cc0 con 0x7f0d1c069fe0 2023-10-03T19:19:55.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.504+0000 7f0d23079640 1 -- 172.21.15.45:0/397441837 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d1c0a4180 con 0x7f0d1c069fe0 2023-10-03T19:19:55.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.504+0000 7f0d197fa640 1 -- 172.21.15.45:0/397441837 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0d1400ab90 con 0x7f0d1c069fe0 2023-10-03T19:19:55.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.508+0000 7f0d197fa640 1 --2- 172.21.15.45:0/397441837 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0d08066280 0x7f0d08068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:55.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.508+0000 7f0d197fa640 1 -- 172.21.15.45:0/397441837 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0d14083b70 con 0x7f0d1c069fe0 2023-10-03T19:19:55.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.508+0000 7f0d20e15640 1 --2- 172.21.15.45:0/397441837 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0d08066280 0x7f0d08068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:55.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.508+0000 7f0d20e15640 1 --2- 172.21.15.45:0/397441837 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0d08066280 0x7f0d08068730 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c000f70 tx=0x7f0d0c007d10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:55.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.512+0000 7f0d197fa640 1 -- 172.21.15.45:0/397441837 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0d1c0a4180 con 0x7f0d1c069fe0 2023-10-03T19:19:55.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.664+0000 7f0d23079640 1 -- 172.21.15.45:0/397441837 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d1c0a4180 con 0x7f0d1c069fe0 2023-10-03T19:19:55.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.668+0000 7f0d197fa640 1 -- 172.21.15.45:0/397441837 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+18234 (secure 0 0 0) 0x7f0d1c0a4180 con 0x7f0d1c069fe0 2023-10-03T19:19:55.680 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:19:55.680 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":98,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:19:40.422617+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:19:37.111278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-10-03T19:19:38.418651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:19:55.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.672+0000 7f0d23079640 1 -- 172.21.15.45:0/397441837 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0d08066280 msgr2=0x7f0d08068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:55.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.672+0000 7f0d23079640 1 --2- 172.21.15.45:0/397441837 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0d08066280 0x7f0d08068730 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c000f70 tx=0x7f0d0c007d10 comp rx=0 tx=0).stop 2023-10-03T19:19:55.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.672+0000 7f0d23079640 1 -- 172.21.15.45:0/397441837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d1c069fe0 msgr2=0x7f0d1c144d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:55.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.672+0000 7f0d23079640 1 --2- 172.21.15.45:0/397441837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d1c069fe0 0x7f0d1c144d30 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f0d1400c7d0 tx=0x7f0d1400cc90 comp rx=0 tx=0).stop 2023-10-03T19:19:55.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.672+0000 7f0d23079640 1 -- 172.21.15.45:0/397441837 shutdown_connections 2023-10-03T19:19:55.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.672+0000 7f0d23079640 1 --2- 172.21.15.45:0/397441837 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0d08066280 0x7f0d08068730 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:55.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.672+0000 7f0d23079640 1 --2- 172.21.15.45:0/397441837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d1c069fe0 0x7f0d1c144d30 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:55.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.672+0000 7f0d23079640 1 --2- 172.21.15.45:0/397441837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d1c069ad0 0x7f0d1c0c0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:55.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.672+0000 7f0d23079640 1 --2- 172.21.15.45:0/397441837 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d1c0658f0 0x7f0d1c13c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:55.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.672+0000 7f0d23079640 1 -- 172.21.15.45:0/397441837 >> 172.21.15.45:0/397441837 conn(0x7f0d1c0bed00 msgr2=0x7f0d1c14ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:55.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.672+0000 7f0d23079640 1 -- 172.21.15.45:0/397441837 shutdown_connections 2023-10-03T19:19:55.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.672+0000 7f0d23079640 1 -- 172.21.15.45:0/397441837 wait complete. 2023-10-03T19:19:55.692 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T19:19:37.111278+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T19:19:38.418651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:19:55.692 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:19:55.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.848+0000 7f9fef471640 1 Processor -- start 2023-10-03T19:19:56.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.848+0000 7f9fef471640 1 -- start start 2023-10-03T19:19:56.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.848+0000 7f9fef471640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9fe806f880 0x7f9fe80a5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:56.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.848+0000 7f9fef471640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe814f080 con 0x7f9fe814ba30 2023-10-03T19:19:56.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.848+0000 7f9fef471640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe8070e90 con 0x7f9fe814f510 2023-10-03T19:19:56.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.848+0000 7f9fef471640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe806f3e0 con 0x7f9fe806f880 2023-10-03T19:19:56.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.848+0000 7f9fed20d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9fe806f880 0x7f9fe80a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:56.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.848+0000 7f9fed20d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9fe806f880 0x7f9fe80a5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59706/0 (socket says 172.21.15.45:59706) 2023-10-03T19:19:56.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.848+0000 7f9fed20d640 1 -- 172.21.15.45:0/2249803503 learned_addr learned my addr 172.21.15.45:0/2249803503 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:56.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.848+0000 7f9fed20d640 1 -- 172.21.15.45:0/2249803503 >> v1:172.21.15.79:6789/0 conn(0x7f9fe814f510 legacy=0x7f9fe814b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:56.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.848+0000 7f9fed20d640 1 -- 172.21.15.45:0/2249803503 >> v1:172.21.15.45:6789/0 conn(0x7f9fe814ba30 legacy=0x7f9fe8155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:56.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.848+0000 7f9fdffff640 1 -- 172.21.15.45:0/2249803503 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3117621255 0 0) 0x7f9fe814f080 con 0x7f9fe814ba30 2023-10-03T19:19:56.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.848+0000 7f9fed20d640 1 -- 172.21.15.45:0/2249803503 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe814ea30 con 0x7f9fe806f880 2023-10-03T19:19:56.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.852+0000 7f9fed20d640 1 --2- 172.21.15.45:0/2249803503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fe806f880 0x7f9fe80a5940 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4009870 tx=0x7f9fe401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8593306fee57a4ef server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:56.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.852+0000 7f9fdffff640 1 -- 172.21.15.45:0/2249803503 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe40ab670 con 0x7f9fe806f880 2023-10-03T19:19:56.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.852+0000 7f9fdffff640 1 -- 172.21.15.45:0/2249803503 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe40ab7d0 con 0x7f9fe806f880 2023-10-03T19:19:56.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.852+0000 7f9fdffff640 1 -- 172.21.15.45:0/2249803503 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe40abb60 con 0x7f9fe806f880 2023-10-03T19:19:56.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.852+0000 7f9fef471640 1 -- 172.21.15.45:0/2249803503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fe806f880 msgr2=0x7f9fe80a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:56.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.852+0000 7f9fef471640 1 --2- 172.21.15.45:0/2249803503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fe806f880 0x7f9fe80a5940 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4009870 tx=0x7f9fe401c510 comp rx=0 tx=0).stop 2023-10-03T19:19:56.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.852+0000 7f9fef471640 1 -- 172.21.15.45:0/2249803503 shutdown_connections 2023-10-03T19:19:56.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.852+0000 7f9fef471640 1 --2- 172.21.15.45:0/2249803503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fe806f880 0x7f9fe80a5940 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.852+0000 7f9fef471640 1 -- 172.21.15.45:0/2249803503 >> 172.21.15.45:0/2249803503 conn(0x7f9fe80a20d0 msgr2=0x7f9fe80a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:56.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.852+0000 7f9fef471640 1 -- 172.21.15.45:0/2249803503 shutdown_connections 2023-10-03T19:19:56.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.852+0000 7f9fef471640 1 -- 172.21.15.45:0/2249803503 wait complete. 2023-10-03T19:19:56.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.852+0000 7f9fef471640 1 Processor -- start 2023-10-03T19:19:56.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.852+0000 7f9fef471640 1 -- start start 2023-10-03T19:19:56.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.852+0000 7f9fef471640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fe806f880 0x7f9fe81e61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:56.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.852+0000 7f9fef471640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fe814ba30 0x7f9fe81e6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:56.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.852+0000 7f9fef471640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fe814f510 0x7f9fe814a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:56.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.852+0000 7f9fef471640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe813e7a0 con 0x7f9fe806f880 2023-10-03T19:19:56.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.852+0000 7f9fef471640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe813ed20 con 0x7f9fe814f510 2023-10-03T19:19:56.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.852+0000 7f9fef471640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe81e6f60 con 0x7f9fe814ba30 2023-10-03T19:19:56.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.852+0000 7f9fed20d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fe806f880 0x7f9fe81e61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:56.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.852+0000 7f9fed20d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fe806f880 0x7f9fe81e61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59722/0 (socket says 172.21.15.45:59722) 2023-10-03T19:19:56.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.852+0000 7f9fed20d640 1 -- 172.21.15.45:0/2633239030 learned_addr learned my addr 172.21.15.45:0/2633239030 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:56.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.852+0000 7f9feca0c640 1 --2- 172.21.15.45:0/2633239030 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fe814ba30 0x7f9fe81e6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:56.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.852+0000 7f9feda0e640 1 --2- 172.21.15.45:0/2633239030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fe814f510 0x7f9fe814a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:56.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.852+0000 7f9fed20d640 1 -- 172.21.15.45:0/2633239030 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fe814ba30 msgr2=0x7f9fe81e6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:56.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.852+0000 7f9fed20d640 1 --2- 172.21.15.45:0/2633239030 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fe814ba30 0x7f9fe81e6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.852+0000 7f9fed20d640 1 -- 172.21.15.45:0/2633239030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fe814f510 msgr2=0x7f9fe814a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:56.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.852+0000 7f9fed20d640 1 --2- 172.21.15.45:0/2633239030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fe814f510 0x7f9fe814a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.852+0000 7f9fed20d640 1 -- 172.21.15.45:0/2633239030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe40094d0 con 0x7f9fe806f880 2023-10-03T19:19:56.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.856+0000 7f9fed20d640 1 --2- 172.21.15.45:0/2633239030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fe806f880 0x7f9fe81e61d0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f9fe40ad040 tx=0x7f9fe401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:56.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.856+0000 7f9fddffb640 1 -- 172.21.15.45:0/2633239030 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe40b48c0 con 0x7f9fe806f880 2023-10-03T19:19:56.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.856+0000 7f9fddffb640 1 -- 172.21.15.45:0/2633239030 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe40b4a40 con 0x7f9fe806f880 2023-10-03T19:19:56.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.856+0000 7f9fef471640 1 -- 172.21.15.45:0/2633239030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe8070a40 con 0x7f9fe806f880 2023-10-03T19:19:56.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.856+0000 7f9fddffb640 1 -- 172.21.15.45:0/2633239030 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe40b4df0 con 0x7f9fe806f880 2023-10-03T19:19:56.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.856+0000 7f9fef471640 1 -- 172.21.15.45:0/2633239030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe806fc50 con 0x7f9fe806f880 2023-10-03T19:19:56.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.856+0000 7f9fef471640 1 -- 172.21.15.45:0/2633239030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe8070bd0 con 0x7f9fe806f880 2023-10-03T19:19:56.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.856+0000 7f9fddffb640 1 -- 172.21.15.45:0/2633239030 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9fe40c7390 con 0x7f9fe806f880 2023-10-03T19:19:56.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.856+0000 7f9fddffb640 1 --2- 172.21.15.45:0/2633239030 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9fcc066280 0x7f9fcc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:56.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.856+0000 7f9fddffb640 1 -- 172.21.15.45:0/2633239030 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9fe411e910 con 0x7f9fe806f880 2023-10-03T19:19:56.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.856+0000 7f9feca0c640 1 --2- 172.21.15.45:0/2633239030 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9fcc066280 0x7f9fcc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:56.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.856+0000 7f9feca0c640 1 --2- 172.21.15.45:0/2633239030 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9fcc066280 0x7f9fcc068730 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8146230 tx=0x7f9fd8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:56.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:55.860+0000 7f9fddffb640 1 -- 172.21.15.45:0/2633239030 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9fe40ebd90 con 0x7f9fe806f880 2023-10-03T19:19:56.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.016+0000 7f9fef471640 1 -- 172.21.15.45:0/2633239030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9fe81e7120 con 0x7f9fe806f880 2023-10-03T19:19:56.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.016+0000 7f9fddffb640 1 -- 172.21.15.45:0/2633239030 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9fe40ef3b0 con 0x7f9fe806f880 2023-10-03T19:19:56.076 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:19:56.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.016+0000 7f9fef471640 1 -- 172.21.15.45:0/2633239030 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9fcc066280 msgr2=0x7f9fcc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:56.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.016+0000 7f9fef471640 1 --2- 172.21.15.45:0/2633239030 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9fcc066280 0x7f9fcc068730 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8146230 tx=0x7f9fd8009040 comp rx=0 tx=0).stop 2023-10-03T19:19:56.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.016+0000 7f9fef471640 1 -- 172.21.15.45:0/2633239030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fe806f880 msgr2=0x7f9fe81e61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:56.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.016+0000 7f9fef471640 1 --2- 172.21.15.45:0/2633239030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fe806f880 0x7f9fe81e61d0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f9fe40ad040 tx=0x7f9fe401ad50 comp rx=0 tx=0).stop 2023-10-03T19:19:56.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.016+0000 7f9fef471640 1 -- 172.21.15.45:0/2633239030 shutdown_connections 2023-10-03T19:19:56.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.016+0000 7f9fef471640 1 --2- 172.21.15.45:0/2633239030 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9fcc066280 0x7f9fcc068730 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.016+0000 7f9fef471640 1 --2- 172.21.15.45:0/2633239030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fe814f510 0x7f9fe814a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.016+0000 7f9fef471640 1 --2- 172.21.15.45:0/2633239030 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9fe814ba30 0x7f9fe81e6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.016+0000 7f9fef471640 1 --2- 172.21.15.45:0/2633239030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fe806f880 0x7f9fe81e61d0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.016+0000 7f9fef471640 1 -- 172.21.15.45:0/2633239030 >> 172.21.15.45:0/2633239030 conn(0x7f9fe80a20d0 msgr2=0x7f9fe80a24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:56.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.016+0000 7f9fef471640 1 -- 172.21.15.45:0/2633239030 shutdown_connections 2023-10-03T19:19:56.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.020+0000 7f9fef471640 1 -- 172.21.15.45:0/2633239030 wait complete. 2023-10-03T19:19:56.148 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:19:56.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.280+0000 7fd1f430a640 1 Processor -- start 2023-10-03T19:19:56.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.280+0000 7fd1f430a640 1 -- start start 2023-10-03T19:19:56.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.284+0000 7fd1f430a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1ec0c14e0 0x7fd1ec0c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:56.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.284+0000 7fd1f430a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd1ec0c2770 0x7fd1ec0a9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:56.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.284+0000 7fd1f430a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ec06ac70 con 0x7fd1ec0bf1f0 2023-10-03T19:19:56.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.284+0000 7fd1f430a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ec06aae0 con 0x7fd1ec0c2770 2023-10-03T19:19:56.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.284+0000 7fd1f430a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec0c3000 con 0x7fd1ec0c14e0 2023-10-03T19:19:56.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.284+0000 7fd1f28a7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd1ec0c2770 0x7fd1ec0a9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:56.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.284+0000 7fd1f28a7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd1ec0c2770 0x7fd1ec0a9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59726/0 (socket says 172.21.15.45:59726) 2023-10-03T19:19:56.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.284+0000 7fd1f28a7640 1 -- 172.21.15.45:0/474255911 learned_addr learned my addr 172.21.15.45:0/474255911 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:56.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.284+0000 7fd1f20a6640 1 --2- 172.21.15.45:0/474255911 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1ec0c14e0 0x7fd1ec0c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:56.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.284+0000 7fd1f28a7640 1 -- 172.21.15.45:0/474255911 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1ec0c14e0 msgr2=0x7fd1ec0c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:56.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.284+0000 7fd1f28a7640 1 --2- 172.21.15.45:0/474255911 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1ec0c14e0 0x7fd1ec0c0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.284+0000 7fd1f28a7640 1 -- 172.21.15.45:0/474255911 >> v1:172.21.15.79:6789/0 conn(0x7fd1ec0bf1f0 legacy=0x7fd1ec0a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:56.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.284+0000 7fd1f28a7640 1 -- 172.21.15.45:0/474255911 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec0aa5f0 con 0x7fd1ec0c2770 2023-10-03T19:19:56.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.284+0000 7fd1f28a7640 1 --2- 172.21.15.45:0/474255911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1ec0c2770 0x7fd1ec0a9f70 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4009e50 tx=0x7fd1e401f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4096c8d2d45b0d32 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:56.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.284+0000 7fd1f10a4640 1 -- 172.21.15.45:0/474255911 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e40af400 con 0x7fd1ec0c2770 2023-10-03T19:19:56.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.284+0000 7fd1f10a4640 1 -- 172.21.15.45:0/474255911 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e40ab050 con 0x7fd1ec0c2770 2023-10-03T19:19:56.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.284+0000 7fd1f10a4640 1 -- 172.21.15.45:0/474255911 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e40af780 con 0x7fd1ec0c2770 2023-10-03T19:19:56.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.284+0000 7fd1f430a640 1 -- 172.21.15.45:0/474255911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1ec0c2770 msgr2=0x7fd1ec0a9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:56.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.284+0000 7fd1f430a640 1 --2- 172.21.15.45:0/474255911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1ec0c2770 0x7fd1ec0a9f70 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4009e50 tx=0x7fd1e401f1f0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.284+0000 7fd1f430a640 1 -- 172.21.15.45:0/474255911 shutdown_connections 2023-10-03T19:19:56.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.284+0000 7fd1f430a640 1 --2- 172.21.15.45:0/474255911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1ec0c2770 0x7fd1ec0a9f70 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.284+0000 7fd1f430a640 1 --2- 172.21.15.45:0/474255911 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1ec0c14e0 0x7fd1ec0c0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.284+0000 7fd1f430a640 1 -- 172.21.15.45:0/474255911 >> 172.21.15.45:0/474255911 conn(0x7fd1ec0a6440 msgr2=0x7fd1ec0a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:56.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.284+0000 7fd1f430a640 1 -- 172.21.15.45:0/474255911 shutdown_connections 2023-10-03T19:19:56.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.288+0000 7fd1f430a640 1 -- 172.21.15.45:0/474255911 wait complete. 2023-10-03T19:19:56.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.288+0000 7fd1f430a640 1 Processor -- start 2023-10-03T19:19:56.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.288+0000 7fd1f430a640 1 -- start start 2023-10-03T19:19:56.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.288+0000 7fd1f430a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1ec0bf1f0 0x7fd1ec0be280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:56.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.288+0000 7fd1f430a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1ec0c14e0 0x7fd1ec0a3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:56.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.288+0000 7fd1f430a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1ec0c2770 0x7fd1ec0a38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:56.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.288+0000 7fd1f430a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec0bb040 con 0x7fd1ec0c14e0 2023-10-03T19:19:56.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.288+0000 7fd1f430a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec14b1b0 con 0x7fd1ec0bf1f0 2023-10-03T19:19:56.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.288+0000 7fd1f430a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec0be7c0 con 0x7fd1ec0c2770 2023-10-03T19:19:56.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.288+0000 7fd1f18a5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1ec0c14e0 0x7fd1ec0a3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:56.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.288+0000 7fd1f18a5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1ec0c14e0 0x7fd1ec0a3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59734/0 (socket says 172.21.15.45:59734) 2023-10-03T19:19:56.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.288+0000 7fd1f18a5640 1 -- 172.21.15.45:0/1825361817 learned_addr learned my addr 172.21.15.45:0/1825361817 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:56.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.288+0000 7fd1f20a6640 1 --2- 172.21.15.45:0/1825361817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1ec0bf1f0 0x7fd1ec0be280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:56.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.288+0000 7fd1f28a7640 1 --2- 172.21.15.45:0/1825361817 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1ec0c2770 0x7fd1ec0a38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:56.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.288+0000 7fd1f18a5640 1 -- 172.21.15.45:0/1825361817 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1ec0c2770 msgr2=0x7fd1ec0a38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:56.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.288+0000 7fd1f18a5640 1 --2- 172.21.15.45:0/1825361817 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1ec0c2770 0x7fd1ec0a38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.288+0000 7fd1f18a5640 1 -- 172.21.15.45:0/1825361817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1ec0bf1f0 msgr2=0x7fd1ec0be280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:56.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.288+0000 7fd1f18a5640 1 --2- 172.21.15.45:0/1825361817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1ec0bf1f0 0x7fd1ec0be280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.288+0000 7fd1f18a5640 1 -- 172.21.15.45:0/1825361817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e4009b30 con 0x7fd1ec0c14e0 2023-10-03T19:19:56.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.288+0000 7fd1f20a6640 1 --2- 172.21.15.45:0/1825361817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1ec0bf1f0 0x7fd1ec0be280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:19:56.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.288+0000 7fd1f18a5640 1 --2- 172.21.15.45:0/1825361817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1ec0c14e0 0x7fd1ec0a3390 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fd1d800c4d0 tx=0x7fd1d800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:56.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.288+0000 7fd1eaffd640 1 -- 172.21.15.45:0/1825361817 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d80052d0 con 0x7fd1ec0c14e0 2023-10-03T19:19:56.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.288+0000 7fd1eaffd640 1 -- 172.21.15.45:0/1825361817 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d8005430 con 0x7fd1ec0c14e0 2023-10-03T19:19:56.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.288+0000 7fd1eaffd640 1 -- 172.21.15.45:0/1825361817 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d8012830 con 0x7fd1ec0c14e0 2023-10-03T19:19:56.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.288+0000 7fd1f430a640 1 -- 172.21.15.45:0/1825361817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ec14f530 con 0x7fd1ec0c14e0 2023-10-03T19:19:56.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.288+0000 7fd1f430a640 1 -- 172.21.15.45:0/1825361817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ec14f250 con 0x7fd1ec0c14e0 2023-10-03T19:19:56.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.288+0000 7fd1f430a640 1 -- 172.21.15.45:0/1825361817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1ec06b100 con 0x7fd1ec0c14e0 2023-10-03T19:19:56.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.292+0000 7fd1eaffd640 1 -- 172.21.15.45:0/1825361817 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd1d8012990 con 0x7fd1ec0c14e0 2023-10-03T19:19:56.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.292+0000 7fd1eaffd640 1 --2- 172.21.15.45:0/1825361817 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd1d0066280 0x7fd1d0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:56.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.292+0000 7fd1eaffd640 1 -- 172.21.15.45:0/1825361817 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd1d8083900 con 0x7fd1ec0c14e0 2023-10-03T19:19:56.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.292+0000 7fd1f20a6640 1 --2- 172.21.15.45:0/1825361817 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd1d0066280 0x7fd1d0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:56.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.292+0000 7fd1f20a6640 1 --2- 172.21.15.45:0/1825361817 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd1d0066280 0x7fd1d0068730 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0007a70 tx=0x7fd1e0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:56.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.296+0000 7fd1eaffd640 1 -- 172.21.15.45:0/1825361817 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd1d8050ce0 con 0x7fd1ec0c14e0 2023-10-03T19:19:56.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.448+0000 7fd1f430a640 1 -- 172.21.15.45:0/1825361817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd1ec0a3e60 con 0x7fd1ec0c14e0 2023-10-03T19:19:56.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.452+0000 7fd1eaffd640 1 -- 172.21.15.45:0/1825361817 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v98) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd1d8054300 con 0x7fd1ec0c14e0 2023-10-03T19:19:56.483 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:19:56.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.452+0000 7fd1f430a640 1 -- 172.21.15.45:0/1825361817 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd1d0066280 msgr2=0x7fd1d0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:56.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.452+0000 7fd1f430a640 1 --2- 172.21.15.45:0/1825361817 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd1d0066280 0x7fd1d0068730 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0007a70 tx=0x7fd1e0008040 comp rx=0 tx=0).stop 2023-10-03T19:19:56.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.452+0000 7fd1f430a640 1 -- 172.21.15.45:0/1825361817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1ec0c14e0 msgr2=0x7fd1ec0a3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:56.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.452+0000 7fd1f430a640 1 --2- 172.21.15.45:0/1825361817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1ec0c14e0 0x7fd1ec0a3390 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fd1d800c4d0 tx=0x7fd1d800c990 comp rx=0 tx=0).stop 2023-10-03T19:19:56.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.452+0000 7fd1f430a640 1 -- 172.21.15.45:0/1825361817 shutdown_connections 2023-10-03T19:19:56.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.452+0000 7fd1f430a640 1 --2- 172.21.15.45:0/1825361817 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd1d0066280 0x7fd1d0068730 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.452+0000 7fd1f430a640 1 --2- 172.21.15.45:0/1825361817 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1ec0c2770 0x7fd1ec0a38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.452+0000 7fd1f430a640 1 --2- 172.21.15.45:0/1825361817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1ec0c14e0 0x7fd1ec0a3390 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.452+0000 7fd1f430a640 1 --2- 172.21.15.45:0/1825361817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1ec0bf1f0 0x7fd1ec0be280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.452+0000 7fd1f430a640 1 -- 172.21.15.45:0/1825361817 >> 172.21.15.45:0/1825361817 conn(0x7fd1ec0a6440 msgr2=0x7fd1ec0c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:56.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.452+0000 7fd1f430a640 1 -- 172.21.15.45:0/1825361817 shutdown_connections 2023-10-03T19:19:56.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.452+0000 7fd1f430a640 1 -- 172.21.15.45:0/1825361817 wait complete. 2023-10-03T19:19:56.485 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T19:19:56.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f9755efc640 1 Processor -- start 2023-10-03T19:19:56.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f9755efc640 1 -- start start 2023-10-03T19:19:56.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f9755efc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f975006c760 0x7f97500a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:56.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f9755efc640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f975006c2d0 con 0x7f975006d560 2023-10-03T19:19:56.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f9755efc640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9750150610 con 0x7f97500712c0 2023-10-03T19:19:56.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f9755efc640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97501508b0 con 0x7f975006c760 2023-10-03T19:19:56.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f974effd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f975006d560 0x7f97500a53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51552/0 (socket says 172.21.15.45:51552) 2023-10-03T19:19:56.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f974effd640 1 -- 172.21.15.45:0/378938670 learned_addr learned my addr 172.21.15.45:0/378938670 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:56.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f974e7fc640 1 -- 172.21.15.45:0/378938670 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3179896774 0 0) 0x7f975006c2d0 con 0x7f975006d560 2023-10-03T19:19:56.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f974ffff640 1 --2- 172.21.15.45:0/378938670 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f975006c760 0x7f97500a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:56.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f974e7fc640 1 -- 172.21.15.45:0/378938670 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9738003530 con 0x7f975006d560 2023-10-03T19:19:56.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f974e7fc640 1 -- 172.21.15.45:0/378938670 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3587044956 0 0) 0x7f9738003530 con 0x7f975006d560 2023-10-03T19:19:56.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f974e7fc640 1 -- 172.21.15.45:0/378938670 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f975006c760 msgr2=0x7f97500a5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:56.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f974e7fc640 1 --2- 172.21.15.45:0/378938670 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f975006c760 0x7f97500a5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f974e7fc640 1 -- 172.21.15.45:0/378938670 >> v1:172.21.15.79:6789/0 conn(0x7f97500712c0 legacy=0x7f97500bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:56.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f974e7fc640 1 -- 172.21.15.45:0/378938670 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975006d2e0 con 0x7f975006d560 2023-10-03T19:19:56.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f974e7fc640 1 -- 172.21.15.45:0/378938670 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f9744001680 con 0x7f975006d560 2023-10-03T19:19:56.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f974e7fc640 1 -- 172.21.15.45:0/378938670 >> v1:172.21.15.45:6789/0 conn(0x7f975006d560 legacy=0x7f97500a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:56.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f974e7fc640 1 --2- 172.21.15.45:0/378938670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97380039b0 0x7f9738003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:56.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f974e7fc640 1 --2- 172.21.15.45:0/378938670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97380047d0 0x7f9738004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:56.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f974e7fc640 1 --2- 172.21.15.45:0/378938670 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f975006c760 0x7f9738005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:56.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f974e7fc640 1 -- 172.21.15.45:0/378938670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97501508b0 con 0x7f97380039b0 2023-10-03T19:19:56.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f974e7fc640 1 -- 172.21.15.45:0/378938670 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973800ba40 con 0x7f97380047d0 2023-10-03T19:19:56.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f974e7fc640 1 -- 172.21.15.45:0/378938670 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973800bbd0 con 0x7f975006c760 2023-10-03T19:19:56.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f974f7fe640 1 --2- 172.21.15.45:0/378938670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97380039b0 0x7f9738003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:56.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f974effd640 1 --2- 172.21.15.45:0/378938670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97380047d0 0x7f9738004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:56.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f974ffff640 1 --2- 172.21.15.45:0/378938670 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f975006c760 0x7f9738005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:56.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f974f7fe640 1 -- 172.21.15.45:0/378938670 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f975006c760 msgr2=0x7f9738005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:56.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f974f7fe640 1 --2- 172.21.15.45:0/378938670 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f975006c760 0x7f9738005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f974f7fe640 1 -- 172.21.15.45:0/378938670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97380047d0 msgr2=0x7f9738004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:56.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f974f7fe640 1 --2- 172.21.15.45:0/378938670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97380047d0 0x7f9738004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.608+0000 7f974f7fe640 1 -- 172.21.15.45:0/378938670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9738003530 con 0x7f97380039b0 2023-10-03T19:19:56.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.612+0000 7f974f7fe640 1 --2- 172.21.15.45:0/378938670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97380039b0 0x7f9738003dc0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f9740001780 tx=0x7f974001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c292fe1a76885b3c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:56.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.612+0000 7f974e7fc640 1 -- 172.21.15.45:0/378938670 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97400052d0 con 0x7f97380039b0 2023-10-03T19:19:56.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.612+0000 7f974e7fc640 1 -- 172.21.15.45:0/378938670 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97400a7050 con 0x7f97380039b0 2023-10-03T19:19:56.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.612+0000 7f974e7fc640 1 -- 172.21.15.45:0/378938670 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9740003600 con 0x7f97380039b0 2023-10-03T19:19:56.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.612+0000 7f9755efc640 1 -- 172.21.15.45:0/378938670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97380039b0 msgr2=0x7f9738003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:56.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.612+0000 7f9755efc640 1 --2- 172.21.15.45:0/378938670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97380039b0 0x7f9738003dc0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f9740001780 tx=0x7f974001c400 comp rx=0 tx=0).stop 2023-10-03T19:19:56.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.612+0000 7f974ffff640 1 -- 172.21.15.45:0/378938670 reap_dead start 2023-10-03T19:19:56.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.612+0000 7f9755efc640 1 -- 172.21.15.45:0/378938670 shutdown_connections 2023-10-03T19:19:56.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.612+0000 7f9755efc640 1 -- 172.21.15.45:0/378938670 >> 172.21.15.45:0/378938670 conn(0x7f97500a20d0 msgr2=0x7f97500a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:56.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.612+0000 7f9755efc640 1 -- 172.21.15.45:0/378938670 shutdown_connections 2023-10-03T19:19:56.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.612+0000 7f9755efc640 1 -- 172.21.15.45:0/378938670 wait complete. 2023-10-03T19:19:56.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.612+0000 7f9755efc640 1 Processor -- start 2023-10-03T19:19:56.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.612+0000 7f9755efc640 1 -- start start 2023-10-03T19:19:56.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.612+0000 7f9755efc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97380039b0 0x7f975014ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:56.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.612+0000 7f9755efc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9750070780 0x7f9750155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:56.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.612+0000 7f9755efc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97501ea1e0 0x7f9750143820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:56.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.612+0000 7f9755efc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975006f820 con 0x7f97501ea1e0 2023-10-03T19:19:56.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.612+0000 7f9755efc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9750070bb0 con 0x7f97380039b0 2023-10-03T19:19:56.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.612+0000 7f9755efc640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975006f050 con 0x7f9750070780 2023-10-03T19:19:56.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.612+0000 7f974ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97501ea1e0 0x7f9750143820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:56.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.616+0000 7f974ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97501ea1e0 0x7f9750143820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59744/0 (socket says 172.21.15.45:59744) 2023-10-03T19:19:56.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.616+0000 7f974ffff640 1 -- 172.21.15.45:0/700716888 learned_addr learned my addr 172.21.15.45:0/700716888 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:56.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.616+0000 7f974f7fe640 1 --2- 172.21.15.45:0/700716888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97380039b0 0x7f975014ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:56.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.616+0000 7f974effd640 1 --2- 172.21.15.45:0/700716888 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9750070780 0x7f9750155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:56.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.616+0000 7f974ffff640 1 -- 172.21.15.45:0/700716888 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9750070780 msgr2=0x7f9750155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:56.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.616+0000 7f974ffff640 1 --2- 172.21.15.45:0/700716888 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9750070780 0x7f9750155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.616+0000 7f974ffff640 1 -- 172.21.15.45:0/700716888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97380039b0 msgr2=0x7f975014ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:56.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.616+0000 7f974ffff640 1 --2- 172.21.15.45:0/700716888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97380039b0 0x7f975014ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.616+0000 7f974ffff640 1 -- 172.21.15.45:0/700716888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97500bd460 con 0x7f97501ea1e0 2023-10-03T19:19:56.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.616+0000 7f974ffff640 1 --2- 172.21.15.45:0/700716888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97501ea1e0 0x7f9750143820 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f975006cbc0 tx=0x7f9748009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:56.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.616+0000 7f9737fff640 1 -- 172.21.15.45:0/700716888 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974800e070 con 0x7f97501ea1e0 2023-10-03T19:19:56.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.616+0000 7f9737fff640 1 -- 172.21.15.45:0/700716888 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9748003c70 con 0x7f97501ea1e0 2023-10-03T19:19:56.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.616+0000 7f9755efc640 1 -- 172.21.15.45:0/700716888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97500bd2d0 con 0x7f97501ea1e0 2023-10-03T19:19:56.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.616+0000 7f9737fff640 1 -- 172.21.15.45:0/700716888 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9748003e20 con 0x7f97501ea1e0 2023-10-03T19:19:56.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.616+0000 7f9755efc640 1 -- 172.21.15.45:0/700716888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97500a5ee0 con 0x7f97501ea1e0 2023-10-03T19:19:56.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.616+0000 7f9755efc640 1 -- 172.21.15.45:0/700716888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f975004de80 con 0x7f97501ea1e0 2023-10-03T19:19:56.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.616+0000 7f9737fff640 1 -- 172.21.15.45:0/700716888 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9748004030 con 0x7f97501ea1e0 2023-10-03T19:19:56.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.616+0000 7f9737fff640 1 --2- 172.21.15.45:0/700716888 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f973c0662b0 0x7f973c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:56.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.616+0000 7f9737fff640 1 -- 172.21.15.45:0/700716888 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9748083a90 con 0x7f97501ea1e0 2023-10-03T19:19:56.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.616+0000 7f974f7fe640 1 --2- 172.21.15.45:0/700716888 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f973c0662b0 0x7f973c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:56.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.620+0000 7f974f7fe640 1 --2- 172.21.15.45:0/700716888 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f973c0662b0 0x7f973c068760 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9740001750 tx=0x7f97400011a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:56.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.620+0000 7f9737fff640 1 -- 172.21.15.45:0/700716888 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9748050e70 con 0x7f97501ea1e0 2023-10-03T19:19:56.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.780+0000 7f9755efc640 1 -- 172.21.15.45:0/700716888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f975006b810 con 0x7f97501ea1e0 2023-10-03T19:19:56.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.780+0000 7f9737fff640 1 -- 172.21.15.45:0/700716888 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v98) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9748054490 con 0x7f97501ea1e0 2023-10-03T19:19:56.808 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-03T19:19:56.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.780+0000 7f9755efc640 1 -- 172.21.15.45:0/700716888 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f973c0662b0 msgr2=0x7f973c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:56.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.780+0000 7f9755efc640 1 --2- 172.21.15.45:0/700716888 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f973c0662b0 0x7f973c068760 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9740001750 tx=0x7f97400011a0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.780+0000 7f9755efc640 1 -- 172.21.15.45:0/700716888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97501ea1e0 msgr2=0x7f9750143820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:56.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.780+0000 7f9755efc640 1 --2- 172.21.15.45:0/700716888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97501ea1e0 0x7f9750143820 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f975006cbc0 tx=0x7f9748009f50 comp rx=0 tx=0).stop 2023-10-03T19:19:56.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.780+0000 7f9755efc640 1 -- 172.21.15.45:0/700716888 shutdown_connections 2023-10-03T19:19:56.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.780+0000 7f9755efc640 1 --2- 172.21.15.45:0/700716888 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f973c0662b0 0x7f973c068760 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.780+0000 7f9755efc640 1 --2- 172.21.15.45:0/700716888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97501ea1e0 0x7f9750143820 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.780+0000 7f9755efc640 1 --2- 172.21.15.45:0/700716888 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9750070780 0x7f9750155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.780+0000 7f9755efc640 1 --2- 172.21.15.45:0/700716888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97380039b0 0x7f975014ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.780+0000 7f9755efc640 1 -- 172.21.15.45:0/700716888 >> 172.21.15.45:0/700716888 conn(0x7f97500a20d0 msgr2=0x7f97500bbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:56.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.780+0000 7f9755efc640 1 -- 172.21.15.45:0/700716888 shutdown_connections 2023-10-03T19:19:56.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.780+0000 7f9755efc640 1 -- 172.21.15.45:0/700716888 wait complete. 2023-10-03T19:19:56.810 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T19:19:56.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.920+0000 7f2a02cdb640 1 Processor -- start 2023-10-03T19:19:56.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.920+0000 7f2a02cdb640 1 -- start start 2023-10-03T19:19:56.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.924+0000 7f2a02cdb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29fc0712c0 0x7f29fc0bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:56.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.924+0000 7f2a02cdb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f29fc06d560 0x7f29fc0bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:56.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.924+0000 7f2a02cdb640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f29fc06c760 0x7f29fc0a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:56.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.924+0000 7f2a02cdb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29fc06c2d0 con 0x7f29fc06d560 2023-10-03T19:19:56.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.924+0000 7f2a02cdb640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29fc150610 con 0x7f29fc06c760 2023-10-03T19:19:56.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.924+0000 7f2a02cdb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc1508b0 con 0x7f29fc0712c0 2023-10-03T19:19:56.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.924+0000 7f29fbfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f29fc06d560 0x7f29fc0bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:56.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.924+0000 7f29fbfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f29fc06d560 0x7f29fc0bd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59746/0 (socket says 172.21.15.45:59746) 2023-10-03T19:19:56.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.924+0000 7f29fbfff640 1 -- 172.21.15.45:0/1101033230 learned_addr learned my addr 172.21.15.45:0/1101033230 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:56.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.924+0000 7f2a01278640 1 --2- 172.21.15.45:0/1101033230 >> v2:172.21.15.79:3300/0 conn(0x7f29fc06c760 0x7f29fc0a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:56.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.924+0000 7f2a00a77640 1 --2- 172.21.15.45:0/1101033230 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29fc0712c0 0x7f29fc0bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:56.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.924+0000 7f29fbfff640 1 -- 172.21.15.45:0/1101033230 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29fc0712c0 msgr2=0x7f29fc0bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:56.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.924+0000 7f29fbfff640 1 --2- 172.21.15.45:0/1101033230 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29fc0712c0 0x7f29fc0bcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.924+0000 7f29fbfff640 1 -- 172.21.15.45:0/1101033230 >> v2:172.21.15.79:3300/0 conn(0x7f29fc06c760 msgr2=0x7f29fc0a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:56.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.924+0000 7f29fbfff640 1 --2- 172.21.15.45:0/1101033230 >> v2:172.21.15.79:3300/0 conn(0x7f29fc06c760 0x7f29fc0a53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.924+0000 7f29fbfff640 1 -- 172.21.15.45:0/1101033230 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29fc06d2e0 con 0x7f29fc06d560 2023-10-03T19:19:56.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.924+0000 7f29fbfff640 1 --2- 172.21.15.45:0/1101033230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29fc06d560 0x7f29fc0bd100 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f29fc06afd0 tx=0x7f29f001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2f60f0c24d6423a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:56.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.924+0000 7f29fb7fe640 1 -- 172.21.15.45:0/1101033230 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f00ab600 con 0x7f29fc06d560 2023-10-03T19:19:56.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.924+0000 7f29fb7fe640 1 -- 172.21.15.45:0/1101033230 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f00ab760 con 0x7f29fc06d560 2023-10-03T19:19:56.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.924+0000 7f29fb7fe640 1 -- 172.21.15.45:0/1101033230 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f00abaf0 con 0x7f29fc06d560 2023-10-03T19:19:56.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.924+0000 7f2a02cdb640 1 -- 172.21.15.45:0/1101033230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29fc06d560 msgr2=0x7f29fc0bd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:56.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.924+0000 7f2a02cdb640 1 --2- 172.21.15.45:0/1101033230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29fc06d560 0x7f29fc0bd100 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f29fc06afd0 tx=0x7f29f001c500 comp rx=0 tx=0).stop 2023-10-03T19:19:56.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.924+0000 7f2a02cdb640 1 -- 172.21.15.45:0/1101033230 shutdown_connections 2023-10-03T19:19:56.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.924+0000 7f2a02cdb640 1 --2- 172.21.15.45:0/1101033230 >> v2:172.21.15.79:3300/0 conn(0x7f29fc06c760 0x7f29fc0a53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.924+0000 7f2a02cdb640 1 --2- 172.21.15.45:0/1101033230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29fc06d560 0x7f29fc0bd100 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.924+0000 7f2a02cdb640 1 --2- 172.21.15.45:0/1101033230 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29fc0712c0 0x7f29fc0bcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.924+0000 7f2a02cdb640 1 -- 172.21.15.45:0/1101033230 >> 172.21.15.45:0/1101033230 conn(0x7f29fc0a20d0 msgr2=0x7f29fc0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:56.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.924+0000 7f2a02cdb640 1 -- 172.21.15.45:0/1101033230 shutdown_connections 2023-10-03T19:19:56.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.924+0000 7f2a02cdb640 1 -- 172.21.15.45:0/1101033230 wait complete. 2023-10-03T19:19:56.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.928+0000 7f2a02cdb640 1 Processor -- start 2023-10-03T19:19:56.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.928+0000 7f2a02cdb640 1 -- start start 2023-10-03T19:19:56.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.928+0000 7f2a02cdb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29fc06c760 0x7f29fc0709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:56.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.928+0000 7f2a02cdb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29fc06d560 0x7f29fc146de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:56.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.928+0000 7f2a02cdb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29fc0712c0 0x7f29fc0bfc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:56.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.928+0000 7f2a02cdb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc14f310 con 0x7f29fc06d560 2023-10-03T19:19:56.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.928+0000 7f2a02cdb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc147320 con 0x7f29fc06c760 2023-10-03T19:19:56.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.928+0000 7f2a02cdb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc0bf790 con 0x7f29fc0712c0 2023-10-03T19:19:56.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.928+0000 7f29fbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29fc06d560 0x7f29fc146de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:56.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.928+0000 7f29fbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29fc06d560 0x7f29fc146de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59762/0 (socket says 172.21.15.45:59762) 2023-10-03T19:19:56.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.928+0000 7f29fbfff640 1 -- 172.21.15.45:0/504169378 learned_addr learned my addr 172.21.15.45:0/504169378 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:56.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.928+0000 7f2a00a77640 1 --2- 172.21.15.45:0/504169378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29fc06c760 0x7f29fc0709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:56.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.928+0000 7f2a01278640 1 --2- 172.21.15.45:0/504169378 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29fc0712c0 0x7f29fc0bfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:56.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.928+0000 7f29fbfff640 1 -- 172.21.15.45:0/504169378 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29fc0712c0 msgr2=0x7f29fc0bfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:56.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.928+0000 7f29fbfff640 1 --2- 172.21.15.45:0/504169378 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29fc0712c0 0x7f29fc0bfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.928+0000 7f29fbfff640 1 -- 172.21.15.45:0/504169378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29fc06c760 msgr2=0x7f29fc0709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:56.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.928+0000 7f29fbfff640 1 --2- 172.21.15.45:0/504169378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29fc06c760 0x7f29fc0709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:56.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.928+0000 7f29fbfff640 1 -- 172.21.15.45:0/504169378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f00094d0 con 0x7f29fc06d560 2023-10-03T19:19:56.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.928+0000 7f2a00a77640 1 --2- 172.21.15.45:0/504169378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29fc06c760 0x7f29fc0709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:56.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.928+0000 7f29fbfff640 1 --2- 172.21.15.45:0/504169378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29fc06d560 0x7f29fc146de0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f29f001c9e0 tx=0x7f29f001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:56.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.928+0000 7f29f97fa640 1 -- 172.21.15.45:0/504169378 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f00ab600 con 0x7f29fc06d560 2023-10-03T19:19:56.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.928+0000 7f29f97fa640 1 -- 172.21.15.45:0/504169378 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f00b4820 con 0x7f29fc06d560 2023-10-03T19:19:56.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.928+0000 7f2a02cdb640 1 -- 172.21.15.45:0/504169378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29fc14c780 con 0x7f29fc06d560 2023-10-03T19:19:56.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.928+0000 7f29f97fa640 1 -- 172.21.15.45:0/504169378 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f00b4bd0 con 0x7f29fc06d560 2023-10-03T19:19:56.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.928+0000 7f2a02cdb640 1 -- 172.21.15.45:0/504169378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29fc14c5f0 con 0x7f29fc06d560 2023-10-03T19:19:56.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.928+0000 7f2a02cdb640 1 -- 172.21.15.45:0/504169378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29fc14c910 con 0x7f29fc06d560 2023-10-03T19:19:56.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.928+0000 7f29f97fa640 1 -- 172.21.15.45:0/504169378 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f29f00b4d30 con 0x7f29fc06d560 2023-10-03T19:19:56.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.932+0000 7f29f97fa640 1 --2- 172.21.15.45:0/504169378 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f29e80662b0 0x7f29e8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:56.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.932+0000 7f29f97fa640 1 -- 172.21.15.45:0/504169378 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f29f011d7c0 con 0x7f29fc06d560 2023-10-03T19:19:56.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.932+0000 7f2a00a77640 1 --2- 172.21.15.45:0/504169378 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f29e80662b0 0x7f29e8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:56.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.932+0000 7f2a00a77640 1 --2- 172.21.15.45:0/504169378 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f29e80662b0 0x7f29e8068760 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f29ec006fd0 tx=0x7f29ec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:56.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:56.936+0000 7f29f97fa640 1 -- 172.21.15.45:0/504169378 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f29f00eac40 con 0x7f29fc06d560 2023-10-03T19:19:57.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.088+0000 7f2a02cdb640 1 -- 172.21.15.45:0/504169378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f29fc0bca30 con 0x7f29fc06d560 2023-10-03T19:19:57.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.088+0000 7f29f97fa640 1 -- 172.21.15.45:0/504169378 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v98) v1 ==== 100+0+11 (secure 0 0 0) 0x7f29f00ee260 con 0x7f29fc06d560 2023-10-03T19:19:57.092 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-03T19:19:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.092+0000 7f2a02cdb640 1 -- 172.21.15.45:0/504169378 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f29e80662b0 msgr2=0x7f29e8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.092+0000 7f2a02cdb640 1 --2- 172.21.15.45:0/504169378 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f29e80662b0 0x7f29e8068760 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f29ec006fd0 tx=0x7f29ec008040 comp rx=0 tx=0).stop 2023-10-03T19:19:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.092+0000 7f2a02cdb640 1 -- 172.21.15.45:0/504169378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29fc06d560 msgr2=0x7f29fc146de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.092+0000 7f2a02cdb640 1 --2- 172.21.15.45:0/504169378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29fc06d560 0x7f29fc146de0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f29f001c9e0 tx=0x7f29f001ad40 comp rx=0 tx=0).stop 2023-10-03T19:19:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.092+0000 7f2a02cdb640 1 -- 172.21.15.45:0/504169378 shutdown_connections 2023-10-03T19:19:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.092+0000 7f2a02cdb640 1 --2- 172.21.15.45:0/504169378 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f29e80662b0 0x7f29e8068760 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.092+0000 7f2a02cdb640 1 --2- 172.21.15.45:0/504169378 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29fc0712c0 0x7f29fc0bfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.092+0000 7f2a02cdb640 1 --2- 172.21.15.45:0/504169378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29fc06d560 0x7f29fc146de0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.092+0000 7f2a02cdb640 1 --2- 172.21.15.45:0/504169378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29fc06c760 0x7f29fc0709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:57.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.092+0000 7f2a02cdb640 1 -- 172.21.15.45:0/504169378 >> 172.21.15.45:0/504169378 conn(0x7f29fc0a20d0 msgr2=0x7f29fc0bacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:57.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.092+0000 7f2a02cdb640 1 -- 172.21.15.45:0/504169378 shutdown_connections 2023-10-03T19:19:57.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.092+0000 7f2a02cdb640 1 -- 172.21.15.45:0/504169378 wait complete. 2023-10-03T19:19:57.111 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-03T19:19:57.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.236+0000 7f17ffcb0640 1 Processor -- start 2023-10-03T19:19:57.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.236+0000 7f17ffcb0640 1 -- start start 2023-10-03T19:19:57.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.236+0000 7f17ffcb0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17f8148b90 0x7f17f80bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:57.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.236+0000 7f17ffcb0640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f17f80bcb60 0x7f17f806c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:57.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.236+0000 7f17ffcb0640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17f814b610 con 0x7f17f80bc4a0 2023-10-03T19:19:57.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.236+0000 7f17ffcb0640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17f80a3670 con 0x7f17f80bcb60 2023-10-03T19:19:57.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.236+0000 7f17ffcb0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f814b370 con 0x7f17f8148b90 2023-10-03T19:19:57.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.236+0000 7f17fd24b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f17f80bcb60 0x7f17f806c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:57.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.236+0000 7f17fd24b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f17f80bcb60 0x7f17f806c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59766/0 (socket says 172.21.15.45:59766) 2023-10-03T19:19:57.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.236+0000 7f17fd24b640 1 -- 172.21.15.45:0/1453637003 learned_addr learned my addr 172.21.15.45:0/1453637003 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:57.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.236+0000 7f17fda4c640 1 --2- 172.21.15.45:0/1453637003 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17f8148b90 0x7f17f80bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:57.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.236+0000 7f17fd24b640 1 -- 172.21.15.45:0/1453637003 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17f8148b90 msgr2=0x7f17f80bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:57.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.236+0000 7f17fd24b640 1 --2- 172.21.15.45:0/1453637003 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17f8148b90 0x7f17f80bbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:57.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.236+0000 7f17fd24b640 1 -- 172.21.15.45:0/1453637003 >> v1:172.21.15.79:6789/0 conn(0x7f17f80bc4a0 legacy=0x7f17f806c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:57.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.236+0000 7f17fd24b640 1 -- 172.21.15.45:0/1453637003 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f80a5580 con 0x7f17f80bcb60 2023-10-03T19:19:57.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.240+0000 7f17fd24b640 1 --2- 172.21.15.45:0/1453637003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17f80bcb60 0x7f17f806c290 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009870 tx=0x7f17e801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf49e7fc3d1667f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:57.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.240+0000 7f17fca4a640 1 -- 172.21.15.45:0/1453637003 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e80a89b0 con 0x7f17f80bcb60 2023-10-03T19:19:57.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.240+0000 7f17fca4a640 1 -- 172.21.15.45:0/1453637003 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e80a8b10 con 0x7f17f80bcb60 2023-10-03T19:19:57.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.240+0000 7f17fca4a640 1 -- 172.21.15.45:0/1453637003 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e80a8ea0 con 0x7f17f80bcb60 2023-10-03T19:19:57.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.240+0000 7f17ffcb0640 1 -- 172.21.15.45:0/1453637003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17f80bcb60 msgr2=0x7f17f806c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:57.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.240+0000 7f17ffcb0640 1 --2- 172.21.15.45:0/1453637003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17f80bcb60 0x7f17f806c290 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009870 tx=0x7f17e801ecf0 comp rx=0 tx=0).stop 2023-10-03T19:19:57.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.240+0000 7f17ffcb0640 1 -- 172.21.15.45:0/1453637003 shutdown_connections 2023-10-03T19:19:57.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.240+0000 7f17ffcb0640 1 --2- 172.21.15.45:0/1453637003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17f80bcb60 0x7f17f806c290 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:57.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.240+0000 7f17ffcb0640 1 --2- 172.21.15.45:0/1453637003 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17f8148b90 0x7f17f80bbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:57.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.240+0000 7f17ffcb0640 1 -- 172.21.15.45:0/1453637003 >> 172.21.15.45:0/1453637003 conn(0x7f17f80bcf50 msgr2=0x7f17f80bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:57.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.240+0000 7f17ffcb0640 1 -- 172.21.15.45:0/1453637003 shutdown_connections 2023-10-03T19:19:57.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.240+0000 7f17ffcb0640 1 -- 172.21.15.45:0/1453637003 wait complete. 2023-10-03T19:19:57.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.240+0000 7f17ffcb0640 1 Processor -- start 2023-10-03T19:19:57.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.240+0000 7f17ffcb0640 1 -- start start 2023-10-03T19:19:57.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.240+0000 7f17ffcb0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17f80bc4a0 0x7f17f81d67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:57.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.240+0000 7f17ffcb0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17f80bcb60 0x7f17f814d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:57.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.240+0000 7f17ffcb0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17f8148b90 0x7f17f8145520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:57.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.240+0000 7f17ffcb0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f81d6360 con 0x7f17f80bc4a0 2023-10-03T19:19:57.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.240+0000 7f17ffcb0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f81d4fb0 con 0x7f17f80bcb60 2023-10-03T19:19:57.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.240+0000 7f17ffcb0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f81d49f0 con 0x7f17f8148b90 2023-10-03T19:19:57.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.240+0000 7f17fda4c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17f80bc4a0 0x7f17f81d67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:57.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.240+0000 7f17fda4c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17f80bc4a0 0x7f17f81d67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59776/0 (socket says 172.21.15.45:59776) 2023-10-03T19:19:57.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.240+0000 7f17fda4c640 1 -- 172.21.15.45:0/3639510065 learned_addr learned my addr 172.21.15.45:0/3639510065 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:57.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.244+0000 7f17fd24b640 1 --2- 172.21.15.45:0/3639510065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17f80bcb60 0x7f17f814d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:57.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.244+0000 7f17fda4c640 1 -- 172.21.15.45:0/3639510065 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17f8148b90 msgr2=0x7f17f8145520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:57.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.244+0000 7f17fe24d640 1 --2- 172.21.15.45:0/3639510065 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17f8148b90 0x7f17f8145520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:57.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.244+0000 7f17fda4c640 1 --2- 172.21.15.45:0/3639510065 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17f8148b90 0x7f17f8145520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:57.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.244+0000 7f17fda4c640 1 -- 172.21.15.45:0/3639510065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17f80bcb60 msgr2=0x7f17f814d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:57.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.244+0000 7f17fda4c640 1 --2- 172.21.15.45:0/3639510065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17f80bcb60 0x7f17f814d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:57.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.244+0000 7f17fda4c640 1 -- 172.21.15.45:0/3639510065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e80094d0 con 0x7f17f80bc4a0 2023-10-03T19:19:57.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.244+0000 7f17fd24b640 1 --2- 172.21.15.45:0/3639510065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17f80bcb60 0x7f17f814d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:57.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.244+0000 7f17fda4c640 1 --2- 172.21.15.45:0/3639510065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17f80bc4a0 0x7f17f81d67b0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f17f400c820 tx=0x7f17f400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:57.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.244+0000 7f17ee7fc640 1 -- 172.21.15.45:0/3639510065 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f4007a30 con 0x7f17f80bc4a0 2023-10-03T19:19:57.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.244+0000 7f17ee7fc640 1 -- 172.21.15.45:0/3639510065 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f4007b90 con 0x7f17f80bc4a0 2023-10-03T19:19:57.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.244+0000 7f17ee7fc640 1 -- 172.21.15.45:0/3639510065 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f400ce10 con 0x7f17f80bc4a0 2023-10-03T19:19:57.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.244+0000 7f17ffcb0640 1 -- 172.21.15.45:0/3639510065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f806cee0 con 0x7f17f80bc4a0 2023-10-03T19:19:57.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.244+0000 7f17ffcb0640 1 -- 172.21.15.45:0/3639510065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f80a5820 con 0x7f17f80bc4a0 2023-10-03T19:19:57.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.244+0000 7f17ffcb0640 1 -- 172.21.15.45:0/3639510065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f8148f60 con 0x7f17f80bc4a0 2023-10-03T19:19:57.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.244+0000 7f17ee7fc640 1 -- 172.21.15.45:0/3639510065 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f17f40113f0 con 0x7f17f80bc4a0 2023-10-03T19:19:57.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.244+0000 7f17ee7fc640 1 --2- 172.21.15.45:0/3639510065 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f17dc066280 0x7f17dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:57.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.244+0000 7f17ee7fc640 1 -- 172.21.15.45:0/3639510065 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f17f4083ea0 con 0x7f17f80bc4a0 2023-10-03T19:19:57.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.244+0000 7f17fd24b640 1 --2- 172.21.15.45:0/3639510065 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f17dc066280 0x7f17dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:57.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.244+0000 7f17fd24b640 1 --2- 172.21.15.45:0/3639510065 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f17dc066280 0x7f17dc068730 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f17e80b2000 tx=0x7f17e80aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:57.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.252+0000 7f17ee7fc640 1 -- 172.21.15.45:0/3639510065 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f17f4051290 con 0x7f17f80bc4a0 2023-10-03T19:19:57.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.412+0000 7f17ffcb0640 1 -- 172.21.15.45:0/3639510065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f17f80a3e30 con 0x7f17f80bc4a0 2023-10-03T19:19:57.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.412+0000 7f17ee7fc640 1 -- 172.21.15.45:0/3639510065 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v98) v1 ==== 80+0+0 (secure 0 0 0) 0x7f17f401f020 con 0x7f17f80bc4a0 2023-10-03T19:19:57.425 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-10-03T19:19:57.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.412+0000 7f17ffcb0640 1 -- 172.21.15.45:0/3639510065 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f17dc066280 msgr2=0x7f17dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:57.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.412+0000 7f17ffcb0640 1 --2- 172.21.15.45:0/3639510065 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f17dc066280 0x7f17dc068730 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f17e80b2000 tx=0x7f17e80aa070 comp rx=0 tx=0).stop 2023-10-03T19:19:57.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.412+0000 7f17ffcb0640 1 -- 172.21.15.45:0/3639510065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17f80bc4a0 msgr2=0x7f17f81d67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:57.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.412+0000 7f17ffcb0640 1 --2- 172.21.15.45:0/3639510065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17f80bc4a0 0x7f17f81d67b0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f17f400c820 tx=0x7f17f400cce0 comp rx=0 tx=0).stop 2023-10-03T19:19:57.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.412+0000 7f17ffcb0640 1 -- 172.21.15.45:0/3639510065 shutdown_connections 2023-10-03T19:19:57.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.412+0000 7f17ffcb0640 1 --2- 172.21.15.45:0/3639510065 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f17dc066280 0x7f17dc068730 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:57.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.412+0000 7f17ffcb0640 1 --2- 172.21.15.45:0/3639510065 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17f8148b90 0x7f17f8145520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:57.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.412+0000 7f17ffcb0640 1 --2- 172.21.15.45:0/3639510065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17f80bcb60 0x7f17f814d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:57.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.412+0000 7f17ffcb0640 1 --2- 172.21.15.45:0/3639510065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17f80bc4a0 0x7f17f81d67b0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:57.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.412+0000 7f17ffcb0640 1 -- 172.21.15.45:0/3639510065 >> 172.21.15.45:0/3639510065 conn(0x7f17f80bcf50 msgr2=0x7f17f80a4960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:57.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.412+0000 7f17ffcb0640 1 -- 172.21.15.45:0/3639510065 shutdown_connections 2023-10-03T19:19:57.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.412+0000 7f17ffcb0640 1 -- 172.21.15.45:0/3639510065 wait complete. 2023-10-03T19:19:57.431 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi146.front.sepia.ceph.com... 2023-10-03T19:19:57.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:57.431 DEBUG:teuthology.orchestra.run.smithi146:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-03T19:19:57.444 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[33931]: fuse finished with error 0 and tester_r 0 2023-10-03T19:19:57.445 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-03T19:19:57.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:57.446 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-03T19:19:57.614 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-03T19:19:57.658 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:19:57.664 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:19:57.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.788+0000 7fd30ed24640 1 Processor -- start 2023-10-03T19:19:57.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.788+0000 7fd30ed24640 1 -- start start 2023-10-03T19:19:57.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.792+0000 7fd30ed24640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd30806f170 0x7fd308150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:57.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.792+0000 7fd30ed24640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd30806d170 0x7fd30814d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:57.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.792+0000 7fd30ed24640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd30806cac0 con 0x7fd3080bc8b0 2023-10-03T19:19:57.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.792+0000 7fd30ed24640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3080720d0 con 0x7fd30806d170 2023-10-03T19:19:57.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.792+0000 7fd30ed24640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3080a5ab0 con 0x7fd30806f170 2023-10-03T19:19:57.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.792+0000 7fd30d2c1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd30806d170 0x7fd30814d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:57.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.792+0000 7fd30d2c1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd30806d170 0x7fd30814d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59784/0 (socket says 172.21.15.45:59784) 2023-10-03T19:19:57.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.792+0000 7fd30d2c1640 1 -- 172.21.15.45:0/142133053 learned_addr learned my addr 172.21.15.45:0/142133053 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:57.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.792+0000 7fd30cac0640 1 --2- 172.21.15.45:0/142133053 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd30806f170 0x7fd308150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:57.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.792+0000 7fd30d2c1640 1 -- 172.21.15.45:0/142133053 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd30806f170 msgr2=0x7fd308150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:57.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.792+0000 7fd30d2c1640 1 --2- 172.21.15.45:0/142133053 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd30806f170 0x7fd308150190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:57.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.792+0000 7fd30d2c1640 1 -- 172.21.15.45:0/142133053 >> v1:172.21.15.79:6789/0 conn(0x7fd3080bc8b0 legacy=0x7fd30814ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:57.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.792+0000 7fd30d2c1640 1 -- 172.21.15.45:0/142133053 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30806cd00 con 0x7fd30806d170 2023-10-03T19:19:57.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.792+0000 7fd30d2c1640 1 --2- 172.21.15.45:0/142133053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd30806d170 0x7fd30814d180 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fd300009e50 tx=0x7fd30001c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d89bc663d38ff395 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:57.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.792+0000 7fd3077fe640 1 -- 172.21.15.45:0/142133053 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3000a5760 con 0x7fd30806d170 2023-10-03T19:19:57.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.792+0000 7fd3077fe640 1 -- 172.21.15.45:0/142133053 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3000a58c0 con 0x7fd30806d170 2023-10-03T19:19:57.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.792+0000 7fd3077fe640 1 -- 172.21.15.45:0/142133053 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3000a5c50 con 0x7fd30806d170 2023-10-03T19:19:57.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.792+0000 7fd30ed24640 1 -- 172.21.15.45:0/142133053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd30806d170 msgr2=0x7fd30814d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:57.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.792+0000 7fd30ed24640 1 --2- 172.21.15.45:0/142133053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd30806d170 0x7fd30814d180 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fd300009e50 tx=0x7fd30001c990 comp rx=0 tx=0).stop 2023-10-03T19:19:57.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.792+0000 7fd30ed24640 1 -- 172.21.15.45:0/142133053 shutdown_connections 2023-10-03T19:19:57.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.792+0000 7fd30ed24640 1 --2- 172.21.15.45:0/142133053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd30806d170 0x7fd30814d180 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:57.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.792+0000 7fd30ed24640 1 --2- 172.21.15.45:0/142133053 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd30806f170 0x7fd308150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:57.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.792+0000 7fd30ed24640 1 -- 172.21.15.45:0/142133053 >> 172.21.15.45:0/142133053 conn(0x7fd3080bcf50 msgr2=0x7fd3080bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:57.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.792+0000 7fd30ed24640 1 -- 172.21.15.45:0/142133053 shutdown_connections 2023-10-03T19:19:57.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.792+0000 7fd30ed24640 1 -- 172.21.15.45:0/142133053 wait complete. 2023-10-03T19:19:57.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.796+0000 7fd30ed24640 1 Processor -- start 2023-10-03T19:19:57.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.796+0000 7fd30ed24640 1 -- start start 2023-10-03T19:19:57.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.796+0000 7fd30ed24640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd30806d170 0x7fd3081482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:57.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.796+0000 7fd30ed24640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd30806f170 0x7fd3080be040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:57.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.796+0000 7fd30ed24640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3080bc8b0 0x7fd3080be580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:57.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.796+0000 7fd30ed24640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30814b640 con 0x7fd30806d170 2023-10-03T19:19:57.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.796+0000 7fd30ed24640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3081e54f0 con 0x7fd3080bc8b0 2023-10-03T19:19:57.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.796+0000 7fd30ed24640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3081487f0 con 0x7fd30806f170 2023-10-03T19:19:57.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.796+0000 7fd30cac0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd30806d170 0x7fd3081482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:57.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.796+0000 7fd30cac0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd30806d170 0x7fd3081482b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59788/0 (socket says 172.21.15.45:59788) 2023-10-03T19:19:57.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.796+0000 7fd30cac0640 1 -- 172.21.15.45:0/3330797419 learned_addr learned my addr 172.21.15.45:0/3330797419 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:57.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.796+0000 7fd30d2c1640 1 --2- 172.21.15.45:0/3330797419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3080bc8b0 0x7fd3080be580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:57.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.796+0000 7fd307fff640 1 --2- 172.21.15.45:0/3330797419 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd30806f170 0x7fd3080be040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:57.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.796+0000 7fd30cac0640 1 -- 172.21.15.45:0/3330797419 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd30806f170 msgr2=0x7fd3080be040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:57.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.796+0000 7fd30cac0640 1 --2- 172.21.15.45:0/3330797419 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd30806f170 0x7fd3080be040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:57.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.796+0000 7fd30cac0640 1 -- 172.21.15.45:0/3330797419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3080bc8b0 msgr2=0x7fd3080be580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:57.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.796+0000 7fd30cac0640 1 --2- 172.21.15.45:0/3330797419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3080bc8b0 0x7fd3080be580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:57.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.796+0000 7fd30cac0640 1 -- 172.21.15.45:0/3330797419 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd300009b30 con 0x7fd30806d170 2023-10-03T19:19:57.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.796+0000 7fd30cac0640 1 --2- 172.21.15.45:0/3330797419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd30806d170 0x7fd3081482b0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800c820 tx=0x7fd2f800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:57.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.796+0000 7fd3057fa640 1 -- 172.21.15.45:0/3330797419 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8004220 con 0x7fd30806d170 2023-10-03T19:19:57.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.796+0000 7fd3057fa640 1 -- 172.21.15.45:0/3330797419 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f80043a0 con 0x7fd30806d170 2023-10-03T19:19:57.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.796+0000 7fd30ed24640 1 -- 172.21.15.45:0/3330797419 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd30806f6d0 con 0x7fd30806d170 2023-10-03T19:19:57.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.796+0000 7fd3057fa640 1 -- 172.21.15.45:0/3330797419 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8004510 con 0x7fd30806d170 2023-10-03T19:19:57.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.796+0000 7fd30ed24640 1 -- 172.21.15.45:0/3330797419 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd30806f540 con 0x7fd30806d170 2023-10-03T19:19:57.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.796+0000 7fd30ed24640 1 -- 172.21.15.45:0/3330797419 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd308159670 con 0x7fd30806d170 2023-10-03T19:19:57.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.796+0000 7fd3057fa640 1 -- 172.21.15.45:0/3330797419 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd2f8007a70 con 0x7fd30806d170 2023-10-03T19:19:57.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.800+0000 7fd3057fa640 1 --2- 172.21.15.45:0/3330797419 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd2f4066280 0x7fd2f4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:57.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.800+0000 7fd3057fa640 1 -- 172.21.15.45:0/3330797419 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd2f8083b10 con 0x7fd30806d170 2023-10-03T19:19:57.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.800+0000 7fd307fff640 1 --2- 172.21.15.45:0/3330797419 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd2f4066280 0x7fd2f4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:57.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.800+0000 7fd307fff640 1 --2- 172.21.15.45:0/3330797419 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd2f4066280 0x7fd2f4068730 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd30814ac20 tx=0x7fd2fc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:57.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.804+0000 7fd3057fa640 1 -- 172.21.15.45:0/3330797419 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd2f8050f90 con 0x7fd30806d170 2023-10-03T19:19:57.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.952+0000 7fd30ed24640 1 -- 172.21.15.45:0/3330797419 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd30806d660 con 0x7fd30806d170 2023-10-03T19:19:57.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.952+0000 7fd3057fa640 1 -- 172.21.15.45:0/3330797419 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+18234 (secure 0 0 0) 0x7fd2f801e090 con 0x7fd30806d170 2023-10-03T19:19:57.978 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:19:57.978 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":98,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:19:40.422617+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:19:37.111278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-10-03T19:19:38.418651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:19:57.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.956+0000 7fd30ed24640 1 -- 172.21.15.45:0/3330797419 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd2f4066280 msgr2=0x7fd2f4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:57.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.956+0000 7fd30ed24640 1 --2- 172.21.15.45:0/3330797419 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd2f4066280 0x7fd2f4068730 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd30814ac20 tx=0x7fd2fc009040 comp rx=0 tx=0).stop 2023-10-03T19:19:57.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.956+0000 7fd30ed24640 1 -- 172.21.15.45:0/3330797419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd30806d170 msgr2=0x7fd3081482b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:57.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.956+0000 7fd30ed24640 1 --2- 172.21.15.45:0/3330797419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd30806d170 0x7fd3081482b0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800c820 tx=0x7fd2f800cce0 comp rx=0 tx=0).stop 2023-10-03T19:19:57.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.956+0000 7fd30ed24640 1 -- 172.21.15.45:0/3330797419 shutdown_connections 2023-10-03T19:19:57.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.956+0000 7fd30ed24640 1 --2- 172.21.15.45:0/3330797419 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd2f4066280 0x7fd2f4068730 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:57.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.956+0000 7fd30ed24640 1 --2- 172.21.15.45:0/3330797419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3080bc8b0 0x7fd3080be580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:57.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.956+0000 7fd30ed24640 1 --2- 172.21.15.45:0/3330797419 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd30806f170 0x7fd3080be040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:57.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.956+0000 7fd30ed24640 1 --2- 172.21.15.45:0/3330797419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd30806d170 0x7fd3081482b0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:57.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.956+0000 7fd30ed24640 1 -- 172.21.15.45:0/3330797419 >> 172.21.15.45:0/3330797419 conn(0x7fd3080bcf50 msgr2=0x7fd3080c0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:57.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.956+0000 7fd30ed24640 1 -- 172.21.15.45:0/3330797419 shutdown_connections 2023-10-03T19:19:57.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:57.956+0000 7fd30ed24640 1 -- 172.21.15.45:0/3330797419 wait complete. 2023-10-03T19:19:57.981 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T19:19:37.111278+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T19:19:38.418651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:19:57.981 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:19:58.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.100+0000 7fd62d934640 1 Processor -- start 2023-10-03T19:19:58.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.100+0000 7fd62d934640 1 -- start start 2023-10-03T19:19:58.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.104+0000 7fd62d934640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd62806f880 0x7fd6280a5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:58.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.104+0000 7fd62d934640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd62814f510 0x7fd62814b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:58.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.104+0000 7fd62d934640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd62814f080 con 0x7fd6280bd9f0 2023-10-03T19:19:58.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.104+0000 7fd62d934640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd62806f3e0 con 0x7fd62814f510 2023-10-03T19:19:58.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.104+0000 7fd62d934640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd628070e90 con 0x7fd62806f880 2023-10-03T19:19:58.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.104+0000 7fd6267fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd62814f510 0x7fd62814b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:58.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.104+0000 7fd6277fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd6280bd9f0 0x7fd6280badc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51558/0 (socket says 172.21.15.45:51558) 2023-10-03T19:19:58.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.104+0000 7fd6277fe640 1 -- 172.21.15.45:0/270144417 learned_addr learned my addr 172.21.15.45:0/270144417 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:19:58.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.104+0000 7fd626ffd640 1 --2- 172.21.15.45:0/270144417 >> v2:172.21.15.79:3300/0 conn(0x7fd62806f880 0x7fd6280a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:58.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.104+0000 7fd6267fc640 1 -- 172.21.15.45:0/270144417 >> v2:172.21.15.79:3300/0 conn(0x7fd62806f880 msgr2=0x7fd6280a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:58.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.104+0000 7fd6267fc640 1 --2- 172.21.15.45:0/270144417 >> v2:172.21.15.79:3300/0 conn(0x7fd62806f880 0x7fd6280a5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:58.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.104+0000 7fd6267fc640 1 -- 172.21.15.45:0/270144417 >> v1:172.21.15.45:6789/0 conn(0x7fd6280bd9f0 legacy=0x7fd6280badc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:58.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.104+0000 7fd6267fc640 1 -- 172.21.15.45:0/270144417 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62814ea30 con 0x7fd62814f510 2023-10-03T19:19:58.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.104+0000 7fd6267fc640 1 --2- 172.21.15.45:0/270144417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd62814f510 0x7fd62814b320 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fd62806ead0 tx=0x7fd61001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50eb33543f426d87 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:58.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.104+0000 7fd625ffb640 1 -- 172.21.15.45:0/270144417 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6100a8050 con 0x7fd62814f510 2023-10-03T19:19:58.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.104+0000 7fd625ffb640 1 -- 172.21.15.45:0/270144417 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6100ac5f0 con 0x7fd62814f510 2023-10-03T19:19:58.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.104+0000 7fd625ffb640 1 -- 172.21.15.45:0/270144417 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6100ac980 con 0x7fd62814f510 2023-10-03T19:19:58.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.104+0000 7fd62d934640 1 -- 172.21.15.45:0/270144417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd62814f510 msgr2=0x7fd62814b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:58.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.104+0000 7fd62d934640 1 --2- 172.21.15.45:0/270144417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd62814f510 0x7fd62814b320 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fd62806ead0 tx=0x7fd61001c430 comp rx=0 tx=0).stop 2023-10-03T19:19:58.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.104+0000 7fd62d934640 1 -- 172.21.15.45:0/270144417 shutdown_connections 2023-10-03T19:19:58.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.104+0000 7fd62d934640 1 --2- 172.21.15.45:0/270144417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd62814f510 0x7fd62814b320 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:58.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.104+0000 7fd62d934640 1 --2- 172.21.15.45:0/270144417 >> v2:172.21.15.79:3300/0 conn(0x7fd62806f880 0x7fd6280a5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:58.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.104+0000 7fd62d934640 1 -- 172.21.15.45:0/270144417 >> 172.21.15.45:0/270144417 conn(0x7fd6280a20d0 msgr2=0x7fd6280a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:58.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.108+0000 7fd62d934640 1 -- 172.21.15.45:0/270144417 shutdown_connections 2023-10-03T19:19:58.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.108+0000 7fd62d934640 1 -- 172.21.15.45:0/270144417 wait complete. 2023-10-03T19:19:58.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.108+0000 7fd62d934640 1 Processor -- start 2023-10-03T19:19:58.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.108+0000 7fd62d934640 1 -- start start 2023-10-03T19:19:58.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.108+0000 7fd62d934640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd62806f880 0x7fd6280be270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:58.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.108+0000 7fd62d934640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6280bd9f0 0x7fd628140750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:58.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.108+0000 7fd62d934640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd62814f510 0x7fd628140c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:58.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.108+0000 7fd62d934640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd628142de0 con 0x7fd62806f880 2023-10-03T19:19:58.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.108+0000 7fd62d934640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6280be7b0 con 0x7fd6280bd9f0 2023-10-03T19:19:58.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.108+0000 7fd62d934640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd628142ab0 con 0x7fd62814f510 2023-10-03T19:19:58.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.108+0000 7fd626ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd62806f880 0x7fd6280be270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:58.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.108+0000 7fd626ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd62806f880 0x7fd6280be270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59806/0 (socket says 172.21.15.45:59806) 2023-10-03T19:19:58.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.108+0000 7fd626ffd640 1 -- 172.21.15.45:0/4192974508 learned_addr learned my addr 172.21.15.45:0/4192974508 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:58.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.108+0000 7fd6267fc640 1 --2- 172.21.15.45:0/4192974508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6280bd9f0 0x7fd628140750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:58.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.108+0000 7fd626ffd640 1 -- 172.21.15.45:0/4192974508 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd62814f510 msgr2=0x7fd628140c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:58.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.108+0000 7fd626ffd640 1 --2- 172.21.15.45:0/4192974508 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd62814f510 0x7fd628140c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:58.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.108+0000 7fd626ffd640 1 -- 172.21.15.45:0/4192974508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6280bd9f0 msgr2=0x7fd628140750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:58.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.108+0000 7fd626ffd640 1 --2- 172.21.15.45:0/4192974508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6280bd9f0 0x7fd628140750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:58.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.108+0000 7fd626ffd640 1 -- 172.21.15.45:0/4192974508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd610009420 con 0x7fd62806f880 2023-10-03T19:19:58.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.108+0000 7fd626ffd640 1 --2- 172.21.15.45:0/4192974508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd62806f880 0x7fd6280be270 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fd620007f20 tx=0x7fd62000e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:58.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.108+0000 7fd61ffff640 1 -- 172.21.15.45:0/4192974508 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd620014620 con 0x7fd62806f880 2023-10-03T19:19:58.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.108+0000 7fd61ffff640 1 -- 172.21.15.45:0/4192974508 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd620014780 con 0x7fd62806f880 2023-10-03T19:19:58.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.108+0000 7fd62d934640 1 -- 172.21.15.45:0/4192974508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd62806fc50 con 0x7fd62806f880 2023-10-03T19:19:58.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.108+0000 7fd61ffff640 1 -- 172.21.15.45:0/4192974508 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd620014b30 con 0x7fd62806f880 2023-10-03T19:19:58.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.108+0000 7fd62d934640 1 -- 172.21.15.45:0/4192974508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd62814bc70 con 0x7fd62806f880 2023-10-03T19:19:58.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.108+0000 7fd62d934640 1 -- 172.21.15.45:0/4192974508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd628070a40 con 0x7fd62806f880 2023-10-03T19:19:58.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.108+0000 7fd61ffff640 1 -- 172.21.15.45:0/4192974508 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd620014c90 con 0x7fd62806f880 2023-10-03T19:19:58.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.112+0000 7fd61ffff640 1 --2- 172.21.15.45:0/4192974508 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd608066280 0x7fd608068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:58.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.112+0000 7fd61ffff640 1 -- 172.21.15.45:0/4192974508 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd620084740 con 0x7fd62806f880 2023-10-03T19:19:58.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.112+0000 7fd6267fc640 1 --2- 172.21.15.45:0/4192974508 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd608066280 0x7fd608068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:58.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.112+0000 7fd6267fc640 1 --2- 172.21.15.45:0/4192974508 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd608066280 0x7fd608068730 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd6100ae000 tx=0x7fd6100a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:58.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.116+0000 7fd61ffff640 1 -- 172.21.15.45:0/4192974508 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd620051bc0 con 0x7fd62806f880 2023-10-03T19:19:58.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.268+0000 7fd62d934640 1 -- 172.21.15.45:0/4192974508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd62804de80 con 0x7fd62806f880 2023-10-03T19:19:58.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.268+0000 7fd61ffff640 1 -- 172.21.15.45:0/4192974508 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd6200551e0 con 0x7fd62806f880 2023-10-03T19:19:58.277 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:19:58.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.272+0000 7fd62d934640 1 -- 172.21.15.45:0/4192974508 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd608066280 msgr2=0x7fd608068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:58.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.272+0000 7fd62d934640 1 --2- 172.21.15.45:0/4192974508 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd608066280 0x7fd608068730 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd6100ae000 tx=0x7fd6100a7000 comp rx=0 tx=0).stop 2023-10-03T19:19:58.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.272+0000 7fd62d934640 1 -- 172.21.15.45:0/4192974508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd62806f880 msgr2=0x7fd6280be270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:58.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.272+0000 7fd62d934640 1 --2- 172.21.15.45:0/4192974508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd62806f880 0x7fd6280be270 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fd620007f20 tx=0x7fd62000e570 comp rx=0 tx=0).stop 2023-10-03T19:19:58.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.272+0000 7fd62d934640 1 -- 172.21.15.45:0/4192974508 shutdown_connections 2023-10-03T19:19:58.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.272+0000 7fd62d934640 1 --2- 172.21.15.45:0/4192974508 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd608066280 0x7fd608068730 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:58.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.272+0000 7fd62d934640 1 --2- 172.21.15.45:0/4192974508 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd62814f510 0x7fd628140c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:58.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.272+0000 7fd62d934640 1 --2- 172.21.15.45:0/4192974508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6280bd9f0 0x7fd628140750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:58.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.272+0000 7fd62d934640 1 --2- 172.21.15.45:0/4192974508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd62806f880 0x7fd6280be270 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:58.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.272+0000 7fd62d934640 1 -- 172.21.15.45:0/4192974508 >> 172.21.15.45:0/4192974508 conn(0x7fd6280a20d0 msgr2=0x7fd6280bacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:58.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.272+0000 7fd62d934640 1 -- 172.21.15.45:0/4192974508 shutdown_connections 2023-10-03T19:19:58.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.272+0000 7fd62d934640 1 -- 172.21.15.45:0/4192974508 wait complete. 2023-10-03T19:19:58.291 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:19:58.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.436+0000 7efd57216640 1 Processor -- start 2023-10-03T19:19:58.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.436+0000 7efd57216640 1 -- start start 2023-10-03T19:19:58.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.436+0000 7efd57216640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efd500712c0 0x7efd500bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:58.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.436+0000 7efd57216640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efd5006d560 0x7efd500bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:58.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.436+0000 7efd57216640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd5006c2d0 con 0x7efd5006c760 2023-10-03T19:19:58.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.436+0000 7efd57216640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd50150610 con 0x7efd500712c0 2023-10-03T19:19:58.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.436+0000 7efd57216640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd501508b0 con 0x7efd5006d560 2023-10-03T19:19:58.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.436+0000 7efd54fb2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efd500712c0 0x7efd500bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:58.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.436+0000 7efd54fb2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efd500712c0 0x7efd500bcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59814/0 (socket says 172.21.15.45:59814) 2023-10-03T19:19:58.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.436+0000 7efd54fb2640 1 -- 172.21.15.45:0/3201362653 learned_addr learned my addr 172.21.15.45:0/3201362653 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:58.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.436+0000 7efd4ffff640 1 --2- 172.21.15.45:0/3201362653 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efd5006d560 0x7efd500bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:58.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.436+0000 7efd54fb2640 1 -- 172.21.15.45:0/3201362653 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efd5006d560 msgr2=0x7efd500bd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:58.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.436+0000 7efd54fb2640 1 --2- 172.21.15.45:0/3201362653 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efd5006d560 0x7efd500bd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:58.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.436+0000 7efd54fb2640 1 -- 172.21.15.45:0/3201362653 >> v1:172.21.15.79:6789/0 conn(0x7efd5006c760 legacy=0x7efd500a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:58.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.436+0000 7efd54fb2640 1 -- 172.21.15.45:0/3201362653 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5006d2e0 con 0x7efd500712c0 2023-10-03T19:19:58.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.440+0000 7efd54fb2640 1 --2- 172.21.15.45:0/3201362653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd500712c0 0x7efd500bcbc0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7efd44009870 tx=0x7efd4401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3e56ea5c8178a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:58.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.440+0000 7efd4f7fe640 1 -- 172.21.15.45:0/3201362653 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd440ab680 con 0x7efd500712c0 2023-10-03T19:19:58.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.440+0000 7efd4f7fe640 1 -- 172.21.15.45:0/3201362653 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd440ab7e0 con 0x7efd500712c0 2023-10-03T19:19:58.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.440+0000 7efd4f7fe640 1 -- 172.21.15.45:0/3201362653 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd440abb70 con 0x7efd500712c0 2023-10-03T19:19:58.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.440+0000 7efd57216640 1 -- 172.21.15.45:0/3201362653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd500712c0 msgr2=0x7efd500bcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:58.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.440+0000 7efd57216640 1 --2- 172.21.15.45:0/3201362653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd500712c0 0x7efd500bcbc0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7efd44009870 tx=0x7efd4401c540 comp rx=0 tx=0).stop 2023-10-03T19:19:58.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.440+0000 7efd57216640 1 -- 172.21.15.45:0/3201362653 shutdown_connections 2023-10-03T19:19:58.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.440+0000 7efd57216640 1 --2- 172.21.15.45:0/3201362653 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efd5006d560 0x7efd500bd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:58.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.440+0000 7efd57216640 1 --2- 172.21.15.45:0/3201362653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd500712c0 0x7efd500bcbc0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:58.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.440+0000 7efd57216640 1 -- 172.21.15.45:0/3201362653 >> 172.21.15.45:0/3201362653 conn(0x7efd500a20d0 msgr2=0x7efd500a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:58.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.440+0000 7efd57216640 1 -- 172.21.15.45:0/3201362653 shutdown_connections 2023-10-03T19:19:58.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.440+0000 7efd57216640 1 -- 172.21.15.45:0/3201362653 wait complete. 2023-10-03T19:19:58.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.440+0000 7efd57216640 1 Processor -- start 2023-10-03T19:19:58.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.440+0000 7efd57216640 1 -- start start 2023-10-03T19:19:58.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.440+0000 7efd57216640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efd5006c760 0x7efd501e8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:58.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.440+0000 7efd57216640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5006d560 0x7efd50148bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:58.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.440+0000 7efd57216640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd500712c0 0x7efd5014ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:58.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.440+0000 7efd57216640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd50149a60 con 0x7efd500712c0 2023-10-03T19:19:58.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.440+0000 7efd57216640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5014d0b0 con 0x7efd5006d560 2023-10-03T19:19:58.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.440+0000 7efd57216640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd501e8c40 con 0x7efd5006c760 2023-10-03T19:19:58.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.440+0000 7efd557b3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd500712c0 0x7efd5014ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:58.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.440+0000 7efd557b3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd500712c0 0x7efd5014ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59822/0 (socket says 172.21.15.45:59822) 2023-10-03T19:19:58.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.440+0000 7efd557b3640 1 -- 172.21.15.45:0/3374883970 learned_addr learned my addr 172.21.15.45:0/3374883970 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:58.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.444+0000 7efd4ffff640 1 --2- 172.21.15.45:0/3374883970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5006d560 0x7efd50148bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:58.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.444+0000 7efd54fb2640 1 --2- 172.21.15.45:0/3374883970 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efd5006c760 0x7efd501e8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:58.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.444+0000 7efd557b3640 1 -- 172.21.15.45:0/3374883970 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efd5006c760 msgr2=0x7efd501e8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:58.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.444+0000 7efd557b3640 1 --2- 172.21.15.45:0/3374883970 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efd5006c760 0x7efd501e8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:58.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.444+0000 7efd557b3640 1 -- 172.21.15.45:0/3374883970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5006d560 msgr2=0x7efd50148bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:58.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.444+0000 7efd557b3640 1 --2- 172.21.15.45:0/3374883970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5006d560 0x7efd50148bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:58.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.444+0000 7efd557b3640 1 -- 172.21.15.45:0/3374883970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd440094d0 con 0x7efd500712c0 2023-10-03T19:19:58.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.444+0000 7efd4ffff640 1 --2- 172.21.15.45:0/3374883970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5006d560 0x7efd50148bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:58.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.444+0000 7efd54fb2640 1 --2- 172.21.15.45:0/3374883970 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efd5006c760 0x7efd501e8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:58.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.444+0000 7efd557b3640 1 --2- 172.21.15.45:0/3374883970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd500712c0 0x7efd5014ed40 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7efd4800c730 tx=0x7efd4800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:58.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.444+0000 7efd4d7fa640 1 -- 172.21.15.45:0/3374883970 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd48006d60 con 0x7efd500712c0 2023-10-03T19:19:58.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.444+0000 7efd4d7fa640 1 -- 172.21.15.45:0/3374883970 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4800ce40 con 0x7efd500712c0 2023-10-03T19:19:58.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.444+0000 7efd57216640 1 -- 172.21.15.45:0/3374883970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd500a6070 con 0x7efd500712c0 2023-10-03T19:19:58.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.444+0000 7efd4d7fa640 1 -- 172.21.15.45:0/3374883970 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd48003bc0 con 0x7efd500712c0 2023-10-03T19:19:58.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.444+0000 7efd57216640 1 -- 172.21.15.45:0/3374883970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd500a5ee0 con 0x7efd500712c0 2023-10-03T19:19:58.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.444+0000 7efd57216640 1 -- 172.21.15.45:0/3374883970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd501596f0 con 0x7efd500712c0 2023-10-03T19:19:58.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.444+0000 7efd4d7fa640 1 -- 172.21.15.45:0/3374883970 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efd48003d20 con 0x7efd500712c0 2023-10-03T19:19:58.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.444+0000 7efd4d7fa640 1 --2- 172.21.15.45:0/3374883970 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efd340662b0 0x7efd34068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:58.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.444+0000 7efd4d7fa640 1 -- 172.21.15.45:0/3374883970 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efd480837e0 con 0x7efd500712c0 2023-10-03T19:19:58.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.444+0000 7efd54fb2640 1 --2- 172.21.15.45:0/3374883970 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efd340662b0 0x7efd34068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:58.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.444+0000 7efd54fb2640 1 --2- 172.21.15.45:0/3374883970 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efd340662b0 0x7efd34068760 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7efd440af000 tx=0x7efd44008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:58.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.448+0000 7efd4d7fa640 1 -- 172.21.15.45:0/3374883970 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7efd48050cf0 con 0x7efd500712c0 2023-10-03T19:19:58.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.600+0000 7efd57216640 1 -- 172.21.15.45:0/3374883970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efd500bca30 con 0x7efd500712c0 2023-10-03T19:19:58.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.600+0000 7efd4d7fa640 1 -- 172.21.15.45:0/3374883970 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v98) v1 ==== 92+0+10 (secure 0 0 0) 0x7efd48054310 con 0x7efd500712c0 2023-10-03T19:19:58.860 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:19:58.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.604+0000 7efd57216640 1 -- 172.21.15.45:0/3374883970 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efd340662b0 msgr2=0x7efd34068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:58.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.604+0000 7efd57216640 1 --2- 172.21.15.45:0/3374883970 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efd340662b0 0x7efd34068760 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7efd440af000 tx=0x7efd44008040 comp rx=0 tx=0).stop 2023-10-03T19:19:58.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.604+0000 7efd57216640 1 -- 172.21.15.45:0/3374883970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd500712c0 msgr2=0x7efd5014ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:58.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.604+0000 7efd57216640 1 --2- 172.21.15.45:0/3374883970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd500712c0 0x7efd5014ed40 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7efd4800c730 tx=0x7efd4800cbf0 comp rx=0 tx=0).stop 2023-10-03T19:19:58.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.604+0000 7efd57216640 1 -- 172.21.15.45:0/3374883970 shutdown_connections 2023-10-03T19:19:58.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.604+0000 7efd57216640 1 --2- 172.21.15.45:0/3374883970 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efd340662b0 0x7efd34068760 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:58.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.604+0000 7efd57216640 1 --2- 172.21.15.45:0/3374883970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd500712c0 0x7efd5014ed40 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:58.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.604+0000 7efd57216640 1 --2- 172.21.15.45:0/3374883970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5006d560 0x7efd50148bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:58.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.604+0000 7efd57216640 1 --2- 172.21.15.45:0/3374883970 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efd5006c760 0x7efd501e8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:58.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.604+0000 7efd57216640 1 -- 172.21.15.45:0/3374883970 >> 172.21.15.45:0/3374883970 conn(0x7efd500a20d0 msgr2=0x7efd500bcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:58.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.604+0000 7efd57216640 1 -- 172.21.15.45:0/3374883970 shutdown_connections 2023-10-03T19:19:58.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:58.604+0000 7efd57216640 1 -- 172.21.15.45:0/3374883970 wait complete. 2023-10-03T19:19:58.863 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T19:19:59.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.000+0000 7fd0370d4640 1 Processor -- start 2023-10-03T19:19:59.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.000+0000 7fd0370d4640 1 -- start start 2023-10-03T19:19:59.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.000+0000 7fd0370d4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd030148470 0x7fd0300bc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:59.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.000+0000 7fd0370d4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd030148840 0x7fd030152100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:59.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.000+0000 7fd0370d4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd0300bc8a0 0x7fd030152640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:59.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.000+0000 7fd0370d4640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0300c1ed0 con 0x7fd030148840 2023-10-03T19:19:59.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.000+0000 7fd0370d4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0300bc160 con 0x7fd030148470 2023-10-03T19:19:59.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.000+0000 7fd0370d4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0300bbc70 con 0x7fd0300bc8a0 2023-10-03T19:19:59.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.000+0000 7fd02ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd030148840 0x7fd030152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:59.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.000+0000 7fd02ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd030148840 0x7fd030152100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59826/0 (socket says 172.21.15.45:59826) 2023-10-03T19:19:59.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.000+0000 7fd02ffff640 1 -- 172.21.15.45:0/1145128703 learned_addr learned my addr 172.21.15.45:0/1145128703 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:59.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.000+0000 7fd034e70640 1 --2- 172.21.15.45:0/1145128703 >> v2:172.21.15.79:3300/0 conn(0x7fd030148470 0x7fd0300bc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:59.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.000+0000 7fd035671640 1 --2- 172.21.15.45:0/1145128703 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd0300bc8a0 0x7fd030152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:59.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.000+0000 7fd02ffff640 1 -- 172.21.15.45:0/1145128703 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd0300bc8a0 msgr2=0x7fd030152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:59.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.000+0000 7fd02ffff640 1 --2- 172.21.15.45:0/1145128703 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd0300bc8a0 0x7fd030152640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.000+0000 7fd02ffff640 1 -- 172.21.15.45:0/1145128703 >> v2:172.21.15.79:3300/0 conn(0x7fd030148470 msgr2=0x7fd0300bc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:59.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.000+0000 7fd02ffff640 1 --2- 172.21.15.45:0/1145128703 >> v2:172.21.15.79:3300/0 conn(0x7fd030148470 0x7fd0300bc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.000+0000 7fd02ffff640 1 -- 172.21.15.45:0/1145128703 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd030151c20 con 0x7fd030148840 2023-10-03T19:19:59.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.000+0000 7fd034e70640 1 --2- 172.21.15.45:0/1145128703 >> v2:172.21.15.79:3300/0 conn(0x7fd030148470 0x7fd0300bc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:19:59.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd02ffff640 1 --2- 172.21.15.45:0/1145128703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd030148840 0x7fd030152100 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fd03006cc00 tx=0x7fd01c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3cfd7bdf581876 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:59.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd02f7fe640 1 -- 172.21.15.45:0/1145128703 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c0a89b0 con 0x7fd030148840 2023-10-03T19:19:59.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd02f7fe640 1 -- 172.21.15.45:0/1145128703 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01c0a8b10 con 0x7fd030148840 2023-10-03T19:19:59.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd02f7fe640 1 -- 172.21.15.45:0/1145128703 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c0a8ea0 con 0x7fd030148840 2023-10-03T19:19:59.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd0370d4640 1 -- 172.21.15.45:0/1145128703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd030148840 msgr2=0x7fd030152100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:59.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd0370d4640 1 --2- 172.21.15.45:0/1145128703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd030148840 0x7fd030152100 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fd03006cc00 tx=0x7fd01c01ecf0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd0370d4640 1 -- 172.21.15.45:0/1145128703 shutdown_connections 2023-10-03T19:19:59.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd0370d4640 1 --2- 172.21.15.45:0/1145128703 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd0300bc8a0 0x7fd030152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd0370d4640 1 --2- 172.21.15.45:0/1145128703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd030148840 0x7fd030152100 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd0370d4640 1 --2- 172.21.15.45:0/1145128703 >> v2:172.21.15.79:3300/0 conn(0x7fd030148470 0x7fd0300bc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd0370d4640 1 -- 172.21.15.45:0/1145128703 >> 172.21.15.45:0/1145128703 conn(0x7fd0300a4260 msgr2=0x7fd0300a4660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:59.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd0370d4640 1 -- 172.21.15.45:0/1145128703 shutdown_connections 2023-10-03T19:19:59.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd0370d4640 1 -- 172.21.15.45:0/1145128703 wait complete. 2023-10-03T19:19:59.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd0370d4640 1 Processor -- start 2023-10-03T19:19:59.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd0370d4640 1 -- start start 2023-10-03T19:19:59.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd0370d4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd0300bc8a0 0x7fd03006e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:59.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd0370d4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd030148470 0x7fd0300a6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:59.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd0370d4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd030148840 0x7fd03006ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:59.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd0370d4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03006d350 con 0x7fd030148470 2023-10-03T19:19:59.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd0370d4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0300a69d0 con 0x7fd030148840 2023-10-03T19:19:59.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd0370d4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0300a17e0 con 0x7fd0300bc8a0 2023-10-03T19:19:59.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd02ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd030148470 0x7fd0300a6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:59.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd02ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd030148470 0x7fd0300a6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59834/0 (socket says 172.21.15.45:59834) 2023-10-03T19:19:59.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd02ffff640 1 -- 172.21.15.45:0/1636868580 learned_addr learned my addr 172.21.15.45:0/1636868580 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:59.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd035671640 1 --2- 172.21.15.45:0/1636868580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd030148840 0x7fd03006ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:59.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd034e70640 1 --2- 172.21.15.45:0/1636868580 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd0300bc8a0 0x7fd03006e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:59.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd02ffff640 1 -- 172.21.15.45:0/1636868580 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd0300bc8a0 msgr2=0x7fd03006e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:59.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd02ffff640 1 --2- 172.21.15.45:0/1636868580 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd0300bc8a0 0x7fd03006e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd02ffff640 1 -- 172.21.15.45:0/1636868580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd030148840 msgr2=0x7fd03006ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:59.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd02ffff640 1 --2- 172.21.15.45:0/1636868580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd030148840 0x7fd03006ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd02ffff640 1 -- 172.21.15.45:0/1636868580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01c0094d0 con 0x7fd030148470 2023-10-03T19:19:59.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd035671640 1 --2- 172.21.15.45:0/1636868580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd030148840 0x7fd03006ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:19:59.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.004+0000 7fd02ffff640 1 --2- 172.21.15.45:0/1636868580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd030148470 0x7fd0300a6490 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fd01c0b3040 tx=0x7fd01c01ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:59.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.008+0000 7fd02d7fa640 1 -- 172.21.15.45:0/1636868580 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c0b9620 con 0x7fd030148470 2023-10-03T19:19:59.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.008+0000 7fd02d7fa640 1 -- 172.21.15.45:0/1636868580 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01c0b9780 con 0x7fd030148470 2023-10-03T19:19:59.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.008+0000 7fd0370d4640 1 -- 172.21.15.45:0/1636868580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd030071ad0 con 0x7fd030148470 2023-10-03T19:19:59.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.008+0000 7fd02d7fa640 1 -- 172.21.15.45:0/1636868580 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c0b9b30 con 0x7fd030148470 2023-10-03T19:19:59.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.008+0000 7fd0370d4640 1 -- 172.21.15.45:0/1636868580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0300bb990 con 0x7fd030148470 2023-10-03T19:19:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.008+0000 7fd0370d4640 1 -- 172.21.15.45:0/1636868580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd030071db0 con 0x7fd030148470 2023-10-03T19:19:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.008+0000 7fd02d7fa640 1 -- 172.21.15.45:0/1636868580 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd01c0b7070 con 0x7fd030148470 2023-10-03T19:19:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.008+0000 7fd02d7fa640 1 --2- 172.21.15.45:0/1636868580 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd0140662b0 0x7fd014068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.008+0000 7fd02d7fa640 1 -- 172.21.15.45:0/1636868580 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd01c121ce0 con 0x7fd030148470 2023-10-03T19:19:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.008+0000 7fd034e70640 1 --2- 172.21.15.45:0/1636868580 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd0140662b0 0x7fd014068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.008+0000 7fd034e70640 1 --2- 172.21.15.45:0/1636868580 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd0140662b0 0x7fd014068760 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fd02400c900 tx=0x7fd024008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:59.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.012+0000 7fd02d7fa640 1 -- 172.21.15.45:0/1636868580 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd01c0ef0d0 con 0x7fd030148470 2023-10-03T19:19:59.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.160+0000 7fd0370d4640 1 -- 172.21.15.45:0/1636868580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd030071db0 con 0x7fd030148470 2023-10-03T19:19:59.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.160+0000 7fd02d7fa640 1 -- 172.21.15.45:0/1636868580 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v98) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd01c0b5020 con 0x7fd030148470 2023-10-03T19:19:59.199 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-03T19:19:59.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.164+0000 7fd0370d4640 1 -- 172.21.15.45:0/1636868580 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd0140662b0 msgr2=0x7fd014068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:59.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.164+0000 7fd0370d4640 1 --2- 172.21.15.45:0/1636868580 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd0140662b0 0x7fd014068760 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fd02400c900 tx=0x7fd024008040 comp rx=0 tx=0).stop 2023-10-03T19:19:59.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.164+0000 7fd0370d4640 1 -- 172.21.15.45:0/1636868580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd030148470 msgr2=0x7fd0300a6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:59.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.164+0000 7fd0370d4640 1 --2- 172.21.15.45:0/1636868580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd030148470 0x7fd0300a6490 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fd01c0b3040 tx=0x7fd01c01ba90 comp rx=0 tx=0).stop 2023-10-03T19:19:59.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.164+0000 7fd0370d4640 1 -- 172.21.15.45:0/1636868580 shutdown_connections 2023-10-03T19:19:59.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.164+0000 7fd0370d4640 1 --2- 172.21.15.45:0/1636868580 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd0140662b0 0x7fd014068760 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.164+0000 7fd0370d4640 1 --2- 172.21.15.45:0/1636868580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd030148840 0x7fd03006ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.164+0000 7fd0370d4640 1 --2- 172.21.15.45:0/1636868580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd030148470 0x7fd0300a6490 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.164+0000 7fd0370d4640 1 --2- 172.21.15.45:0/1636868580 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd0300bc8a0 0x7fd03006e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.164+0000 7fd0370d4640 1 -- 172.21.15.45:0/1636868580 >> 172.21.15.45:0/1636868580 conn(0x7fd0300a4260 msgr2=0x7fd0300a4630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:59.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.164+0000 7fd0370d4640 1 -- 172.21.15.45:0/1636868580 shutdown_connections 2023-10-03T19:19:59.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.164+0000 7fd0370d4640 1 -- 172.21.15.45:0/1636868580 wait complete. 2023-10-03T19:19:59.202 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T19:19:59.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.324+0000 7f098d1f4640 1 Processor -- start 2023-10-03T19:19:59.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.324+0000 7f098d1f4640 1 -- start start 2023-10-03T19:19:59.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.328+0000 7f098d1f4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f09880712c0 0x7f09880bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:59.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.328+0000 7f098d1f4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f098806c760 0x7f09880bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:59.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.328+0000 7f098d1f4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098806c2d0 con 0x7f098806d560 2023-10-03T19:19:59.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.328+0000 7f098d1f4640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0988150610 con 0x7f09880712c0 2023-10-03T19:19:59.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.328+0000 7f098d1f4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09881508b0 con 0x7f098806c760 2023-10-03T19:19:59.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.328+0000 7f0986d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f09880712c0 0x7f09880bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:59.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.328+0000 7f0986d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f09880712c0 0x7f09880bcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59848/0 (socket says 172.21.15.45:59848) 2023-10-03T19:19:59.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.328+0000 7f0986d9d640 1 -- 172.21.15.45:0/3976346835 learned_addr learned my addr 172.21.15.45:0/3976346835 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:59.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.328+0000 7f0986d9d640 1 -- 172.21.15.45:0/3976346835 >> v2:172.21.15.79:3300/0 conn(0x7f098806c760 msgr2=0x7f09880bd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:59.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.328+0000 7f098759e640 1 --2- 172.21.15.45:0/3976346835 >> v2:172.21.15.79:3300/0 conn(0x7f098806c760 0x7f09880bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:59.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.328+0000 7f0986d9d640 1 --2- 172.21.15.45:0/3976346835 >> v2:172.21.15.79:3300/0 conn(0x7f098806c760 0x7f09880bd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.328+0000 7f0986d9d640 1 -- 172.21.15.45:0/3976346835 >> v1:172.21.15.79:6789/0 conn(0x7f098806d560 legacy=0x7f09880a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:59.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.328+0000 7f0986d9d640 1 -- 172.21.15.45:0/3976346835 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098806d2e0 con 0x7f09880712c0 2023-10-03T19:19:59.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.328+0000 7f0986d9d640 1 --2- 172.21.15.45:0/3976346835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09880712c0 0x7f09880bcbc0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f09880c14e0 tx=0x7f097801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff26a68f886bad7c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:59.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.328+0000 7f0985d9b640 1 -- 172.21.15.45:0/3976346835 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09780ab600 con 0x7f09880712c0 2023-10-03T19:19:59.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.328+0000 7f0985d9b640 1 -- 172.21.15.45:0/3976346835 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09780ab760 con 0x7f09880712c0 2023-10-03T19:19:59.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.328+0000 7f0985d9b640 1 -- 172.21.15.45:0/3976346835 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09780abaf0 con 0x7f09880712c0 2023-10-03T19:19:59.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.328+0000 7f098d1f4640 1 -- 172.21.15.45:0/3976346835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09880712c0 msgr2=0x7f09880bcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:59.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.328+0000 7f098d1f4640 1 --2- 172.21.15.45:0/3976346835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09880712c0 0x7f09880bcbc0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f09880c14e0 tx=0x7f097801c4c0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.328+0000 7f098d1f4640 1 -- 172.21.15.45:0/3976346835 shutdown_connections 2023-10-03T19:19:59.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.328+0000 7f098d1f4640 1 --2- 172.21.15.45:0/3976346835 >> v2:172.21.15.79:3300/0 conn(0x7f098806c760 0x7f09880bd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.328+0000 7f098d1f4640 1 --2- 172.21.15.45:0/3976346835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09880712c0 0x7f09880bcbc0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.328+0000 7f098d1f4640 1 -- 172.21.15.45:0/3976346835 >> 172.21.15.45:0/3976346835 conn(0x7f09880a20d0 msgr2=0x7f09880a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:59.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.328+0000 7f098d1f4640 1 -- 172.21.15.45:0/3976346835 shutdown_connections 2023-10-03T19:19:59.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.328+0000 7f098d1f4640 1 -- 172.21.15.45:0/3976346835 wait complete. 2023-10-03T19:19:59.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.332+0000 7f098d1f4640 1 Processor -- start 2023-10-03T19:19:59.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.332+0000 7f098d1f4640 1 -- start start 2023-10-03T19:19:59.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.332+0000 7f098d1f4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f098806c760 0x7f098814c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:59.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.332+0000 7f098d1f4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f098806d560 0x7f09881e8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:59.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.332+0000 7f098d1f4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09880712c0 0x7f09881e8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:59.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.332+0000 7f098d1f4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09880b89d0 con 0x7f098806c760 2023-10-03T19:19:59.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.332+0000 7f098d1f4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098814cdd0 con 0x7f09880712c0 2023-10-03T19:19:59.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.332+0000 7f098d1f4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09880b7220 con 0x7f098806d560 2023-10-03T19:19:59.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.332+0000 7f0986d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f098806c760 0x7f098814c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:59.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.332+0000 7f0986d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f098806c760 0x7f098814c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59860/0 (socket says 172.21.15.45:59860) 2023-10-03T19:19:59.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.332+0000 7f0986d9d640 1 -- 172.21.15.45:0/279470027 learned_addr learned my addr 172.21.15.45:0/279470027 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:59.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.332+0000 7f098759e640 1 --2- 172.21.15.45:0/279470027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09880712c0 0x7f09881e8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:59.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.332+0000 7f098659c640 1 --2- 172.21.15.45:0/279470027 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f098806d560 0x7f09881e8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:59.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.332+0000 7f0986d9d640 1 -- 172.21.15.45:0/279470027 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f098806d560 msgr2=0x7f09881e8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:59.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.332+0000 7f0986d9d640 1 --2- 172.21.15.45:0/279470027 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f098806d560 0x7f09881e8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.332+0000 7f0986d9d640 1 -- 172.21.15.45:0/279470027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09880712c0 msgr2=0x7f09881e8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:59.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.332+0000 7f0986d9d640 1 --2- 172.21.15.45:0/279470027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09880712c0 0x7f09881e8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.332+0000 7f0986d9d640 1 -- 172.21.15.45:0/279470027 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09780094d0 con 0x7f098806c760 2023-10-03T19:19:59.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.332+0000 7f098759e640 1 --2- 172.21.15.45:0/279470027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09880712c0 0x7f09881e8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:19:59.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.332+0000 7f0986d9d640 1 --2- 172.21.15.45:0/279470027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f098806c760 0x7f098814c890 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f097801cd60 tx=0x7f097801ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:59.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.332+0000 7f096f7fe640 1 -- 172.21.15.45:0/279470027 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09780b4800 con 0x7f098806c760 2023-10-03T19:19:59.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.332+0000 7f096f7fe640 1 -- 172.21.15.45:0/279470027 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09780b4960 con 0x7f098806c760 2023-10-03T19:19:59.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.332+0000 7f098d1f4640 1 -- 172.21.15.45:0/279470027 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09880a6070 con 0x7f098806c760 2023-10-03T19:19:59.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.332+0000 7f096f7fe640 1 -- 172.21.15.45:0/279470027 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09780b4cd0 con 0x7f098806c760 2023-10-03T19:19:59.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.332+0000 7f098d1f4640 1 -- 172.21.15.45:0/279470027 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09880a5ee0 con 0x7f098806c760 2023-10-03T19:19:59.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.332+0000 7f098d1f4640 1 -- 172.21.15.45:0/279470027 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09881596f0 con 0x7f098806c760 2023-10-03T19:19:59.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.336+0000 7f096f7fe640 1 -- 172.21.15.45:0/279470027 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f09780c7440 con 0x7f098806c760 2023-10-03T19:19:59.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.336+0000 7f096f7fe640 1 --2- 172.21.15.45:0/279470027 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f09740662b0 0x7f0974068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:59.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.336+0000 7f096f7fe640 1 -- 172.21.15.45:0/279470027 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f097811e870 con 0x7f098806c760 2023-10-03T19:19:59.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.336+0000 7f098659c640 1 --2- 172.21.15.45:0/279470027 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f09740662b0 0x7f0974068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:59.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.336+0000 7f098659c640 1 --2- 172.21.15.45:0/279470027 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f09740662b0 0x7f0974068760 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f098814db90 tx=0x7f097c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:59.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.340+0000 7f096f7fe640 1 -- 172.21.15.45:0/279470027 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f09780ebd80 con 0x7f098806c760 2023-10-03T19:19:59.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.492+0000 7f098d1f4640 1 -- 172.21.15.45:0/279470027 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f09880bca30 con 0x7f098806c760 2023-10-03T19:19:59.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.492+0000 7f096f7fe640 1 -- 172.21.15.45:0/279470027 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v98) v1 ==== 100+0+11 (secure 0 0 0) 0x7f09780ef3a0 con 0x7f098806c760 2023-10-03T19:19:59.496 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-03T19:19:59.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.496+0000 7f098d1f4640 1 -- 172.21.15.45:0/279470027 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f09740662b0 msgr2=0x7f0974068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:59.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.496+0000 7f098d1f4640 1 --2- 172.21.15.45:0/279470027 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f09740662b0 0x7f0974068760 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f098814db90 tx=0x7f097c009040 comp rx=0 tx=0).stop 2023-10-03T19:19:59.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.496+0000 7f098d1f4640 1 -- 172.21.15.45:0/279470027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f098806c760 msgr2=0x7f098814c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:59.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.496+0000 7f098d1f4640 1 --2- 172.21.15.45:0/279470027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f098806c760 0x7f098814c890 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f097801cd60 tx=0x7f097801ad00 comp rx=0 tx=0).stop 2023-10-03T19:19:59.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.496+0000 7f098d1f4640 1 -- 172.21.15.45:0/279470027 shutdown_connections 2023-10-03T19:19:59.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.496+0000 7f098d1f4640 1 --2- 172.21.15.45:0/279470027 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f09740662b0 0x7f0974068760 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.496+0000 7f098d1f4640 1 --2- 172.21.15.45:0/279470027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09880712c0 0x7f09881e8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.496+0000 7f098d1f4640 1 --2- 172.21.15.45:0/279470027 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f098806d560 0x7f09881e8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.496+0000 7f098d1f4640 1 --2- 172.21.15.45:0/279470027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f098806c760 0x7f098814c890 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.496+0000 7f098d1f4640 1 -- 172.21.15.45:0/279470027 >> 172.21.15.45:0/279470027 conn(0x7f09880a20d0 msgr2=0x7f09880bcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:59.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.496+0000 7f098d1f4640 1 -- 172.21.15.45:0/279470027 shutdown_connections 2023-10-03T19:19:59.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.496+0000 7f098d1f4640 1 -- 172.21.15.45:0/279470027 wait complete. 2023-10-03T19:19:59.516 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-03T19:19:59.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.632+0000 7f81113c4640 1 Processor -- start 2023-10-03T19:19:59.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.632+0000 7f81113c4640 1 -- start start 2023-10-03T19:19:59.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.632+0000 7f81113c4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f810c14bf90 0x7f810c06e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:59.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.632+0000 7f81113c4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f810c06e450 0x7f810c0bf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:59.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.632+0000 7f81113c4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810c0a6e60 con 0x7f810c0bf5f0 2023-10-03T19:19:59.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.632+0000 7f81113c4640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810c0bd810 con 0x7f810c14bf90 2023-10-03T19:19:59.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.632+0000 7f81113c4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810c0be300 con 0x7f810c06e450 2023-10-03T19:19:59.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.632+0000 7f810affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f810c14bf90 0x7f810c06e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:59.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.632+0000 7f810affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f810c14bf90 0x7f810c06e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59864/0 (socket says 172.21.15.45:59864) 2023-10-03T19:19:59.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.632+0000 7f810affd640 1 -- 172.21.15.45:0/2798960474 learned_addr learned my addr 172.21.15.45:0/2798960474 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:59.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.636+0000 7f810a7fc640 1 --2- 172.21.15.45:0/2798960474 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f810c06e450 0x7f810c0bf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:59.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.636+0000 7f810affd640 1 -- 172.21.15.45:0/2798960474 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f810c06e450 msgr2=0x7f810c0bf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:19:59.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.636+0000 7f810affd640 1 --2- 172.21.15.45:0/2798960474 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f810c06e450 0x7f810c0bf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.636+0000 7f810affd640 1 -- 172.21.15.45:0/2798960474 >> v1:172.21.15.79:6789/0 conn(0x7f810c0bf5f0 legacy=0x7f810c0710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:59.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.636+0000 7f810affd640 1 -- 172.21.15.45:0/2798960474 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c14c360 con 0x7f810c14bf90 2023-10-03T19:19:59.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.636+0000 7f810affd640 1 --2- 172.21.15.45:0/2798960474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f810c14bf90 0x7f810c06e960 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f80fc009870 tx=0x7f80fc01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46cc302af3ad3ca6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:59.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.636+0000 7f8109ffb640 1 -- 172.21.15.45:0/2798960474 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc0a7070 con 0x7f810c14bf90 2023-10-03T19:19:59.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.636+0000 7f8109ffb640 1 -- 172.21.15.45:0/2798960474 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80fc0ab430 con 0x7f810c14bf90 2023-10-03T19:19:59.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.636+0000 7f8109ffb640 1 -- 172.21.15.45:0/2798960474 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc0ab7c0 con 0x7f810c14bf90 2023-10-03T19:19:59.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.636+0000 7f81113c4640 1 -- 172.21.15.45:0/2798960474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f810c14bf90 msgr2=0x7f810c06e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:59.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.636+0000 7f81113c4640 1 --2- 172.21.15.45:0/2798960474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f810c14bf90 0x7f810c06e960 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f80fc009870 tx=0x7f80fc01c540 comp rx=0 tx=0).stop 2023-10-03T19:19:59.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.636+0000 7f81113c4640 1 -- 172.21.15.45:0/2798960474 shutdown_connections 2023-10-03T19:19:59.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.636+0000 7f81113c4640 1 --2- 172.21.15.45:0/2798960474 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f810c06e450 0x7f810c0bf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.636+0000 7f81113c4640 1 --2- 172.21.15.45:0/2798960474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f810c14bf90 0x7f810c06e960 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.636+0000 7f81113c4640 1 -- 172.21.15.45:0/2798960474 >> 172.21.15.45:0/2798960474 conn(0x7f810c06bce0 msgr2=0x7f810c06c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:59.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.636+0000 7f81113c4640 1 -- 172.21.15.45:0/2798960474 shutdown_connections 2023-10-03T19:19:59.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.636+0000 7f81113c4640 1 -- 172.21.15.45:0/2798960474 wait complete. 2023-10-03T19:19:59.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.640+0000 7f81113c4640 1 Processor -- start 2023-10-03T19:19:59.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.640+0000 7f81113c4640 1 -- start start 2023-10-03T19:19:59.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.640+0000 7f81113c4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f810c06e450 0x7f810c1e6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:59.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.640+0000 7f81113c4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f810c0bf5f0 0x7f810c14c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:59.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.640+0000 7f81113c4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f810c14bf90 0x7f810c159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:59.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.640+0000 7f81113c4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c151820 con 0x7f810c06e450 2023-10-03T19:19:59.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.640+0000 7f81113c4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c1e7260 con 0x7f810c0bf5f0 2023-10-03T19:19:59.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.640+0000 7f81113c4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810c14e710 con 0x7f810c14bf90 2023-10-03T19:19:59.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.640+0000 7f810affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f810c06e450 0x7f810c1e6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:59.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.640+0000 7f810affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f810c06e450 0x7f810c1e6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59880/0 (socket says 172.21.15.45:59880) 2023-10-03T19:19:59.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.640+0000 7f810affd640 1 -- 172.21.15.45:0/3343182582 learned_addr learned my addr 172.21.15.45:0/3343182582 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:19:59.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.640+0000 7f810a7fc640 1 --2- 172.21.15.45:0/3343182582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f810c0bf5f0 0x7f810c14c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:59.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.640+0000 7f810affd640 1 -- 172.21.15.45:0/3343182582 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f810c14bf90 msgr2=0x7f810c159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:59.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.640+0000 7f810affd640 1 --2- 172.21.15.45:0/3343182582 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f810c14bf90 0x7f810c159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.640+0000 7f810affd640 1 -- 172.21.15.45:0/3343182582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f810c0bf5f0 msgr2=0x7f810c14c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:59.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.640+0000 7f810affd640 1 --2- 172.21.15.45:0/3343182582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f810c0bf5f0 0x7f810c14c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.640+0000 7f810affd640 1 -- 172.21.15.45:0/3343182582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80fc0094d0 con 0x7f810c06e450 2023-10-03T19:19:59.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.640+0000 7f810affd640 1 --2- 172.21.15.45:0/3343182582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f810c06e450 0x7f810c1e6d20 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0ad040 tx=0x7f80fc0192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:59.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.640+0000 7f80f37fe640 1 -- 172.21.15.45:0/3343182582 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc0bc070 con 0x7f810c06e450 2023-10-03T19:19:59.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.640+0000 7f80f37fe640 1 -- 172.21.15.45:0/3343182582 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80fc0b4420 con 0x7f810c06e450 2023-10-03T19:19:59.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.640+0000 7f80f37fe640 1 -- 172.21.15.45:0/3343182582 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc0b47d0 con 0x7f810c06e450 2023-10-03T19:19:59.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.640+0000 7f81113c4640 1 -- 172.21.15.45:0/3343182582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810c06eea0 con 0x7f810c06e450 2023-10-03T19:19:59.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.640+0000 7f81113c4640 1 -- 172.21.15.45:0/3343182582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810c0bd530 con 0x7f810c06e450 2023-10-03T19:19:59.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.640+0000 7f81113c4640 1 -- 172.21.15.45:0/3343182582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f810c06f030 con 0x7f810c06e450 2023-10-03T19:19:59.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.640+0000 7f80f37fe640 1 -- 172.21.15.45:0/3343182582 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f80fc0b4930 con 0x7f810c06e450 2023-10-03T19:19:59.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.644+0000 7f80f37fe640 1 --2- 172.21.15.45:0/3343182582 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f80f8066280 0x7f80f8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:19:59.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.644+0000 7f80f37fe640 1 -- 172.21.15.45:0/3343182582 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f80fc11d630 con 0x7f810c06e450 2023-10-03T19:19:59.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.644+0000 7f810a7fc640 1 --2- 172.21.15.45:0/3343182582 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f80f8066280 0x7f80f8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:19:59.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.644+0000 7f810a7fc640 1 --2- 172.21.15.45:0/3343182582 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f80f8066280 0x7f80f8068730 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f810c0c2e60 tx=0x7f8100008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:19:59.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.648+0000 7f80f37fe640 1 -- 172.21.15.45:0/3343182582 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f810c06f030 con 0x7f810c06e450 2023-10-03T19:19:59.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.812+0000 7f81113c4640 1 -- 172.21.15.45:0/3343182582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f810c06f030 con 0x7f810c06e450 2023-10-03T19:19:59.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.812+0000 7f80f37fe640 1 -- 172.21.15.45:0/3343182582 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v98) v1 ==== 80+0+0 (secure 0 0 0) 0x7f810c06f030 con 0x7f810c06e450 2023-10-03T19:19:59.820 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-10-03T19:19:59.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.812+0000 7f81113c4640 1 -- 172.21.15.45:0/3343182582 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f80f8066280 msgr2=0x7f80f8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:59.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.812+0000 7f81113c4640 1 --2- 172.21.15.45:0/3343182582 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f80f8066280 0x7f80f8068730 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f810c0c2e60 tx=0x7f8100008040 comp rx=0 tx=0).stop 2023-10-03T19:19:59.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.812+0000 7f81113c4640 1 -- 172.21.15.45:0/3343182582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f810c06e450 msgr2=0x7f810c1e6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:19:59.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.812+0000 7f81113c4640 1 --2- 172.21.15.45:0/3343182582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f810c06e450 0x7f810c1e6d20 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0ad040 tx=0x7f80fc0192e0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.812+0000 7f81113c4640 1 -- 172.21.15.45:0/3343182582 shutdown_connections 2023-10-03T19:19:59.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.812+0000 7f81113c4640 1 --2- 172.21.15.45:0/3343182582 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f80f8066280 0x7f80f8068730 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.812+0000 7f81113c4640 1 --2- 172.21.15.45:0/3343182582 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f810c14bf90 0x7f810c159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.812+0000 7f81113c4640 1 --2- 172.21.15.45:0/3343182582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f810c0bf5f0 0x7f810c14c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.812+0000 7f81113c4640 1 --2- 172.21.15.45:0/3343182582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f810c06e450 0x7f810c1e6d20 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:19:59.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.812+0000 7f81113c4640 1 -- 172.21.15.45:0/3343182582 >> 172.21.15.45:0/3343182582 conn(0x7f810c06bce0 msgr2=0x7f810c149930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:19:59.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.816+0000 7f81113c4640 1 -- 172.21.15.45:0/3343182582 shutdown_connections 2023-10-03T19:19:59.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:19:59.816+0000 7f81113c4640 1 -- 172.21.15.45:0/3343182582 wait complete. 2023-10-03T19:19:59.833 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi172.front.sepia.ceph.com... 2023-10-03T19:19:59.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:59.835 DEBUG:teuthology.orchestra.run.smithi172:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-03T19:19:59.847 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi172.stderr:ceph-fuse[33416]: fuse finished with error 0 and tester_r 0 2023-10-03T19:19:59.849 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2023-10-03T19:19:59.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:19:59.902 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-03T19:19:59.990 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:20:00.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.108+0000 7f4bb1b2a640 1 Processor -- start 2023-10-03T19:20:00.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.108+0000 7f4bb1b2a640 1 -- start start 2023-10-03T19:20:00.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.108+0000 7f4bb1b2a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4bac071380 0x7f4bac0bc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:00.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.108+0000 7f4bb1b2a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4bac071750 0x7f4bac14b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:00.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.108+0000 7f4bb1b2a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bac0bd220 con 0x7f4bac0bcb80 2023-10-03T19:20:00.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.108+0000 7f4bb1b2a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bac14f860 con 0x7f4bac071750 2023-10-03T19:20:00.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.108+0000 7f4bb1b2a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac071cf0 con 0x7f4bac071380 2023-10-03T19:20:00.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.108+0000 7f4babfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4bac071750 0x7f4bac14b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:00.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.108+0000 7f4babfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4bac071750 0x7f4bac14b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59884/0 (socket says 172.21.15.45:59884) 2023-10-03T19:20:00.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.108+0000 7f4babfff640 1 -- 172.21.15.45:0/2364377733 learned_addr learned my addr 172.21.15.45:0/2364377733 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:00.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.108+0000 7f4bab7fe640 1 --2- 172.21.15.45:0/2364377733 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4bac071380 0x7f4bac0bc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:00.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.108+0000 7f4babfff640 1 -- 172.21.15.45:0/2364377733 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4bac071380 msgr2=0x7f4bac0bc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:00.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.108+0000 7f4babfff640 1 --2- 172.21.15.45:0/2364377733 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4bac071380 0x7f4bac0bc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:00.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.108+0000 7f4babfff640 1 -- 172.21.15.45:0/2364377733 >> v1:172.21.15.79:6789/0 conn(0x7f4bac0bcb80 legacy=0x7f4bac152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:00.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.108+0000 7f4babfff640 1 -- 172.21.15.45:0/2364377733 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac0a7b50 con 0x7f4bac071750 2023-10-03T19:20:00.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.108+0000 7f4bab7fe640 1 --2- 172.21.15.45:0/2364377733 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4bac071380 0x7f4bac0bc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:20:00.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4babfff640 1 --2- 172.21.15.45:0/2364377733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bac071750 0x7f4bac14b9a0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4009e50 tx=0x7f4ba401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a439ad85fc7a7061 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:00.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4baa7fc640 1 -- 172.21.15.45:0/2364377733 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba40a56e0 con 0x7f4bac071750 2023-10-03T19:20:00.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4baa7fc640 1 -- 172.21.15.45:0/2364377733 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba40a5840 con 0x7f4bac071750 2023-10-03T19:20:00.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4baa7fc640 1 -- 172.21.15.45:0/2364377733 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba40a5bd0 con 0x7f4bac071750 2023-10-03T19:20:00.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4bb1b2a640 1 -- 172.21.15.45:0/2364377733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bac071750 msgr2=0x7f4bac14b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:00.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4bb1b2a640 1 --2- 172.21.15.45:0/2364377733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bac071750 0x7f4bac14b9a0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4009e50 tx=0x7f4ba401ca10 comp rx=0 tx=0).stop 2023-10-03T19:20:00.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4bb1b2a640 1 -- 172.21.15.45:0/2364377733 shutdown_connections 2023-10-03T19:20:00.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4bb1b2a640 1 --2- 172.21.15.45:0/2364377733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bac071750 0x7f4bac14b9a0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:00.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4bb1b2a640 1 --2- 172.21.15.45:0/2364377733 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4bac071380 0x7f4bac0bc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:00.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4bb1b2a640 1 -- 172.21.15.45:0/2364377733 >> 172.21.15.45:0/2364377733 conn(0x7f4bac06bce0 msgr2=0x7f4bac06c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:00.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4bb1b2a640 1 -- 172.21.15.45:0/2364377733 shutdown_connections 2023-10-03T19:20:00.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4bb1b2a640 1 -- 172.21.15.45:0/2364377733 wait complete. 2023-10-03T19:20:00.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4bb1b2a640 1 Processor -- start 2023-10-03T19:20:00.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4bb1b2a640 1 -- start start 2023-10-03T19:20:00.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4bb1b2a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bac071380 0x7f4bac1eabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:00.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4bb1b2a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4bac071750 0x7f4bac1ea3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:00.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4bb1b2a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bac0bcb80 0x7f4bac149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:00.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4bb1b2a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac158eb0 con 0x7f4bac071380 2023-10-03T19:20:00.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4bb1b2a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac159150 con 0x7f4bac0bcb80 2023-10-03T19:20:00.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4bb1b2a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac153640 con 0x7f4bac071750 2023-10-03T19:20:00.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4bab7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bac071380 0x7f4bac1eabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:00.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4bab7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bac071380 0x7f4bac1eabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59894/0 (socket says 172.21.15.45:59894) 2023-10-03T19:20:00.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4bab7fe640 1 -- 172.21.15.45:0/382625813 learned_addr learned my addr 172.21.15.45:0/382625813 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:00.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4babfff640 1 --2- 172.21.15.45:0/382625813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bac0bcb80 0x7f4bac149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:00.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4baaffd640 1 --2- 172.21.15.45:0/382625813 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4bac071750 0x7f4bac1ea3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:00.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4bab7fe640 1 -- 172.21.15.45:0/382625813 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4bac071750 msgr2=0x7f4bac1ea3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:00.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4bab7fe640 1 --2- 172.21.15.45:0/382625813 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4bac071750 0x7f4bac1ea3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:00.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4bab7fe640 1 -- 172.21.15.45:0/382625813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bac0bcb80 msgr2=0x7f4bac149c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:00.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4bab7fe640 1 --2- 172.21.15.45:0/382625813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bac0bcb80 0x7f4bac149c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:00.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4bab7fe640 1 -- 172.21.15.45:0/382625813 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba4009b30 con 0x7f4bac071380 2023-10-03T19:20:00.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4baaffd640 1 --2- 172.21.15.45:0/382625813 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4bac071750 0x7f4bac1ea3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:00.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4babfff640 1 --2- 172.21.15.45:0/382625813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bac0bcb80 0x7f4bac149c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:00.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4bab7fe640 1 --2- 172.21.15.45:0/382625813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bac071380 0x7f4bac1eabf0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00e810 tx=0x7f4b9c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:00.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4b93fff640 1 -- 172.21.15.45:0/382625813 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c00c870 con 0x7f4bac071380 2023-10-03T19:20:00.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4b93fff640 1 -- 172.21.15.45:0/382625813 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c00c9d0 con 0x7f4bac071380 2023-10-03T19:20:00.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4b93fff640 1 -- 172.21.15.45:0/382625813 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c00cd60 con 0x7f4bac071380 2023-10-03T19:20:00.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4bb1b2a640 1 -- 172.21.15.45:0/382625813 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bac14f060 con 0x7f4bac071380 2023-10-03T19:20:00.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.112+0000 7f4bb1b2a640 1 -- 172.21.15.45:0/382625813 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bac0a1e00 con 0x7f4bac071380 2023-10-03T19:20:00.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.116+0000 7f4bb1b2a640 1 -- 172.21.15.45:0/382625813 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bac14f1f0 con 0x7f4bac071380 2023-10-03T19:20:00.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.116+0000 7f4b93fff640 1 -- 172.21.15.45:0/382625813 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4b9c013410 con 0x7f4bac071380 2023-10-03T19:20:00.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.116+0000 7f4b93fff640 1 --2- 172.21.15.45:0/382625813 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4b98066280 0x7f4b98068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:00.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.116+0000 7f4b93fff640 1 -- 172.21.15.45:0/382625813 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4b9c083c30 con 0x7f4bac071380 2023-10-03T19:20:00.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.116+0000 7f4baaffd640 1 --2- 172.21.15.45:0/382625813 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4b98066280 0x7f4b98068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:00.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.116+0000 7f4baaffd640 1 --2- 172.21.15.45:0/382625813 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4b98066280 0x7f4b98068730 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4bac1eb230 tx=0x7f4ba0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:00.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.120+0000 7f4b93fff640 1 -- 172.21.15.45:0/382625813 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4b9c050f80 con 0x7f4bac071380 2023-10-03T19:20:00.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.304+0000 7f4bb1b2a640 1 -- 172.21.15.45:0/382625813 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4bac04de80 con 0x7f4bac071380 2023-10-03T19:20:00.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.304+0000 7f4b93fff640 1 -- 172.21.15.45:0/382625813 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+3916 (secure 0 0 0) 0x7f4b9c021090 con 0x7f4bac071380 2023-10-03T19:20:00.308 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:20:00.364 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":50,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5795,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2000006019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2000006019},{"type":"v1","addr":"172.21.15.79:6835","nonce":2000006019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":7149,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/3326584899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3326584899},{"type":"v1","addr":"172.21.15.45:6833","nonce":3326584899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:19:39.419474+0000","modified":"2023-10-03T19:19:41.692109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7155},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7155":{"gid":7155,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3401546487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3401546487},{"type":"v1","addr":"172.21.15.45:6835","nonce":3401546487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-10-03T19:20:00.365 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 50 2023-10-03T19:20:00.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.308+0000 7f4bb1b2a640 1 -- 172.21.15.45:0/382625813 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4b98066280 msgr2=0x7f4b98068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:00.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.308+0000 7f4bb1b2a640 1 --2- 172.21.15.45:0/382625813 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4b98066280 0x7f4b98068730 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4bac1eb230 tx=0x7f4ba0009040 comp rx=0 tx=0).stop 2023-10-03T19:20:00.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.308+0000 7f4bb1b2a640 1 -- 172.21.15.45:0/382625813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bac071380 msgr2=0x7f4bac1eabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:00.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.308+0000 7f4bb1b2a640 1 --2- 172.21.15.45:0/382625813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bac071380 0x7f4bac1eabf0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00e810 tx=0x7f4b9c00ecd0 comp rx=0 tx=0).stop 2023-10-03T19:20:00.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.308+0000 7f4bb1b2a640 1 -- 172.21.15.45:0/382625813 shutdown_connections 2023-10-03T19:20:00.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.308+0000 7f4bb1b2a640 1 --2- 172.21.15.45:0/382625813 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4b98066280 0x7f4b98068730 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:00.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.308+0000 7f4bb1b2a640 1 --2- 172.21.15.45:0/382625813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bac0bcb80 0x7f4bac149c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:00.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.308+0000 7f4bb1b2a640 1 --2- 172.21.15.45:0/382625813 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4bac071750 0x7f4bac1ea3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:00.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.308+0000 7f4bb1b2a640 1 --2- 172.21.15.45:0/382625813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bac071380 0x7f4bac1eabf0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:00.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.308+0000 7f4bb1b2a640 1 -- 172.21.15.45:0/382625813 >> 172.21.15.45:0/382625813 conn(0x7f4bac06bce0 msgr2=0x7f4bac14ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:00.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.308+0000 7f4bb1b2a640 1 -- 172.21.15.45:0/382625813 shutdown_connections 2023-10-03T19:20:00.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.308+0000 7f4bb1b2a640 1 -- 172.21.15.45:0/382625813 wait complete. 2023-10-03T19:20:00.367 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:20:00.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.476+0000 7fb662613640 1 Processor -- start 2023-10-03T19:20:00.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.476+0000 7fb662613640 1 -- start start 2023-10-03T19:20:00.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.476+0000 7fb662613640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb65c0a3670 0x7fb65c06c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:00.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.476+0000 7fb662613640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb65c0bbd20 0x7fb65c147ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:00.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.476+0000 7fb662613640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb65c14ae20 con 0x7fb65c14aa50 2023-10-03T19:20:00.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.476+0000 7fb662613640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb65c0a5db0 con 0x7fb65c0a3670 2023-10-03T19:20:00.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.476+0000 7fb662613640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb65c0a3aa0 con 0x7fb65c0bbd20 2023-10-03T19:20:00.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.476+0000 7fb653fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb65c0a3670 0x7fb65c06c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:00.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.476+0000 7fb653fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb65c0a3670 0x7fb65c06c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59896/0 (socket says 172.21.15.45:59896) 2023-10-03T19:20:00.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.480+0000 7fb653fff640 1 -- 172.21.15.45:0/2253886025 learned_addr learned my addr 172.21.15.45:0/2253886025 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:00.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.480+0000 7fb660bb0640 1 --2- 172.21.15.45:0/2253886025 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb65c0bbd20 0x7fb65c147ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:00.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.480+0000 7fb653fff640 1 -- 172.21.15.45:0/2253886025 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb65c0bbd20 msgr2=0x7fb65c147ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:00.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.480+0000 7fb653fff640 1 --2- 172.21.15.45:0/2253886025 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb65c0bbd20 0x7fb65c147ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:00.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.480+0000 7fb653fff640 1 -- 172.21.15.45:0/2253886025 >> v1:172.21.15.79:6789/0 conn(0x7fb65c14aa50 legacy=0x7fb65c06cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:00.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.480+0000 7fb653fff640 1 -- 172.21.15.45:0/2253886025 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb65c0baf60 con 0x7fb65c0a3670 2023-10-03T19:20:00.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.480+0000 7fb653fff640 1 --2- 172.21.15.45:0/2253886025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb65c0a3670 0x7fb65c06c220 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fb64c0098a0 tx=0x7fb64c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ee77531dffb834 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:00.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.480+0000 7fb65b7fe640 1 -- 172.21.15.45:0/2253886025 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64c0a8a10 con 0x7fb65c0a3670 2023-10-03T19:20:00.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.480+0000 7fb65b7fe640 1 -- 172.21.15.45:0/2253886025 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64c0a8b70 con 0x7fb65c0a3670 2023-10-03T19:20:00.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.480+0000 7fb65b7fe640 1 -- 172.21.15.45:0/2253886025 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64c0b0440 con 0x7fb65c0a3670 2023-10-03T19:20:00.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.480+0000 7fb662613640 1 -- 172.21.15.45:0/2253886025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb65c0a3670 msgr2=0x7fb65c06c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:00.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.480+0000 7fb662613640 1 --2- 172.21.15.45:0/2253886025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb65c0a3670 0x7fb65c06c220 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fb64c0098a0 tx=0x7fb64c01ed10 comp rx=0 tx=0).stop 2023-10-03T19:20:00.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.480+0000 7fb662613640 1 -- 172.21.15.45:0/2253886025 shutdown_connections 2023-10-03T19:20:00.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.480+0000 7fb662613640 1 --2- 172.21.15.45:0/2253886025 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb65c0bbd20 0x7fb65c147ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:00.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.480+0000 7fb662613640 1 --2- 172.21.15.45:0/2253886025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb65c0a3670 0x7fb65c06c220 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:00.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.480+0000 7fb662613640 1 -- 172.21.15.45:0/2253886025 >> 172.21.15.45:0/2253886025 conn(0x7fb65c0bcf50 msgr2=0x7fb65c0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:00.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.480+0000 7fb662613640 1 -- 172.21.15.45:0/2253886025 shutdown_connections 2023-10-03T19:20:00.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.480+0000 7fb662613640 1 -- 172.21.15.45:0/2253886025 wait complete. 2023-10-03T19:20:00.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.484+0000 7fb662613640 1 Processor -- start 2023-10-03T19:20:00.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.484+0000 7fb662613640 1 -- start start 2023-10-03T19:20:00.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.484+0000 7fb662613640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb65c0a3670 0x7fb65c1d5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:00.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.484+0000 7fb662613640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb65c0bbd20 0x7fb65c14e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:00.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.484+0000 7fb662613640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb65c14aa50 0x7fb65c1d8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:00.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.484+0000 7fb662613640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65c144540 con 0x7fb65c0bbd20 2023-10-03T19:20:00.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.484+0000 7fb662613640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65c1d6b10 con 0x7fb65c0a3670 2023-10-03T19:20:00.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.484+0000 7fb662613640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb65c1d8100 con 0x7fb65c14aa50 2023-10-03T19:20:00.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.484+0000 7fb653fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb65c0bbd20 0x7fb65c14e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:00.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.484+0000 7fb653fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb65c0bbd20 0x7fb65c14e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59906/0 (socket says 172.21.15.45:59906) 2023-10-03T19:20:00.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.484+0000 7fb653fff640 1 -- 172.21.15.45:0/3435538051 learned_addr learned my addr 172.21.15.45:0/3435538051 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:00.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.484+0000 7fb65bfff640 1 --2- 172.21.15.45:0/3435538051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb65c0a3670 0x7fb65c1d5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:00.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.484+0000 7fb653fff640 1 -- 172.21.15.45:0/3435538051 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb65c14aa50 msgr2=0x7fb65c1d8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:00.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.484+0000 7fb660bb0640 1 --2- 172.21.15.45:0/3435538051 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb65c14aa50 0x7fb65c1d8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:00.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.484+0000 7fb653fff640 1 --2- 172.21.15.45:0/3435538051 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb65c14aa50 0x7fb65c1d8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:00.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.484+0000 7fb653fff640 1 -- 172.21.15.45:0/3435538051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb65c0a3670 msgr2=0x7fb65c1d5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:00.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.484+0000 7fb653fff640 1 --2- 172.21.15.45:0/3435538051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb65c0a3670 0x7fb65c1d5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:00.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.484+0000 7fb653fff640 1 -- 172.21.15.45:0/3435538051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb64c0094d0 con 0x7fb65c0bbd20 2023-10-03T19:20:00.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.484+0000 7fb65bfff640 1 --2- 172.21.15.45:0/3435538051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb65c0a3670 0x7fb65c1d5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:00.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.484+0000 7fb653fff640 1 --2- 172.21.15.45:0/3435538051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb65c0bbd20 0x7fb65c14e880 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fb64c0b3040 tx=0x7fb64c01bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:00.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.484+0000 7fb6597fa640 1 -- 172.21.15.45:0/3435538051 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64c0be070 con 0x7fb65c0bbd20 2023-10-03T19:20:00.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.484+0000 7fb6597fa640 1 -- 172.21.15.45:0/3435538051 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64c0ba400 con 0x7fb65c0bbd20 2023-10-03T19:20:00.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.484+0000 7fb662613640 1 -- 172.21.15.45:0/3435538051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb65c0bb520 con 0x7fb65c0bbd20 2023-10-03T19:20:00.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.484+0000 7fb6597fa640 1 -- 172.21.15.45:0/3435538051 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64c0ba7d0 con 0x7fb65c0bbd20 2023-10-03T19:20:00.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.484+0000 7fb662613640 1 -- 172.21.15.45:0/3435538051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb65c0bb240 con 0x7fb65c0bbd20 2023-10-03T19:20:00.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.484+0000 7fb662613640 1 -- 172.21.15.45:0/3435538051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb65c0bb800 con 0x7fb65c0bbd20 2023-10-03T19:20:00.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.484+0000 7fb6597fa640 1 -- 172.21.15.45:0/3435538051 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb64c0c3410 con 0x7fb65c0bbd20 2023-10-03T19:20:00.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.484+0000 7fb6597fa640 1 --2- 172.21.15.45:0/3435538051 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb63c0662b0 0x7fb63c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:00.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.484+0000 7fb6597fa640 1 -- 172.21.15.45:0/3435538051 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb64c121800 con 0x7fb65c0bbd20 2023-10-03T19:20:00.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.488+0000 7fb65bfff640 1 --2- 172.21.15.45:0/3435538051 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb63c0662b0 0x7fb63c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:00.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.488+0000 7fb65bfff640 1 --2- 172.21.15.45:0/3435538051 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb63c0662b0 0x7fb63c068760 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb644000f70 tx=0x7fb644009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:00.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.488+0000 7fb6597fa640 1 -- 172.21.15.45:0/3435538051 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb64c0eed10 con 0x7fb65c0bbd20 2023-10-03T19:20:00.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.640+0000 7fb662613640 1 -- 172.21.15.45:0/3435538051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb65c1d6c80 con 0x7fb65c0bbd20 2023-10-03T19:20:00.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.644+0000 7fb6597fa640 1 -- 172.21.15.45:0/3435538051 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+18234 (secure 0 0 0) 0x7fb65c1d6c80 con 0x7fb65c0bbd20 2023-10-03T19:20:00.677 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:20:00.677 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":98,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:19:40.422617+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:19:37.111278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-10-03T19:19:38.418651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:20:00.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.644+0000 7fb662613640 1 -- 172.21.15.45:0/3435538051 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb63c0662b0 msgr2=0x7fb63c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:00.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.644+0000 7fb662613640 1 --2- 172.21.15.45:0/3435538051 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb63c0662b0 0x7fb63c068760 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb644000f70 tx=0x7fb644009040 comp rx=0 tx=0).stop 2023-10-03T19:20:00.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.644+0000 7fb662613640 1 -- 172.21.15.45:0/3435538051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb65c0bbd20 msgr2=0x7fb65c14e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:00.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.644+0000 7fb662613640 1 --2- 172.21.15.45:0/3435538051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb65c0bbd20 0x7fb65c14e880 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fb64c0b3040 tx=0x7fb64c01bab0 comp rx=0 tx=0).stop 2023-10-03T19:20:00.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.644+0000 7fb662613640 1 -- 172.21.15.45:0/3435538051 shutdown_connections 2023-10-03T19:20:00.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.644+0000 7fb662613640 1 --2- 172.21.15.45:0/3435538051 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb63c0662b0 0x7fb63c068760 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:00.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.644+0000 7fb662613640 1 --2- 172.21.15.45:0/3435538051 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb65c14aa50 0x7fb65c1d8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:00.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.644+0000 7fb662613640 1 --2- 172.21.15.45:0/3435538051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb65c0bbd20 0x7fb65c14e880 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:00.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.644+0000 7fb662613640 1 --2- 172.21.15.45:0/3435538051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb65c0a3670 0x7fb65c1d5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:00.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.644+0000 7fb662613640 1 -- 172.21.15.45:0/3435538051 >> 172.21.15.45:0/3435538051 conn(0x7fb65c0bcf50 msgr2=0x7fb65c06cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:00.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.644+0000 7fb662613640 1 -- 172.21.15.45:0/3435538051 shutdown_connections 2023-10-03T19:20:00.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.644+0000 7fb662613640 1 -- 172.21.15.45:0/3435538051 wait complete. 2023-10-03T19:20:00.680 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T19:19:37.111278+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T19:19:38.418651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:20:00.728 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:20:00.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f53199ed640 1 Processor -- start 2023-10-03T19:20:00.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f53199ed640 1 -- start start 2023-10-03T19:20:00.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f53199ed640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f53140712c0 0x7f53140bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:00.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f53199ed640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f531406c2d0 con 0x7f531406d560 2023-10-03T19:20:00.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f53199ed640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5314150610 con 0x7f531406c760 2023-10-03T19:20:00.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f53199ed640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53141508b0 con 0x7f53140712c0 2023-10-03T19:20:00.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f53127fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f531406d560 0x7f53140a53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51564/0 (socket says 172.21.15.45:51564) 2023-10-03T19:20:00.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f53127fc640 1 -- 172.21.15.45:0/88060715 learned_addr learned my addr 172.21.15.45:0/88060715 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:20:00.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f5312ffd640 1 --2- 172.21.15.45:0/88060715 >> v2:172.21.15.79:3300/0 conn(0x7f53140712c0 0x7f53140bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:00.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f5311ffb640 1 -- 172.21.15.45:0/88060715 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1674075742 0 0) 0x7f531406c2d0 con 0x7f531406d560 2023-10-03T19:20:00.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f5311ffb640 1 -- 172.21.15.45:0/88060715 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52fc003530 con 0x7f531406d560 2023-10-03T19:20:00.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f5311ffb640 1 -- 172.21.15.45:0/88060715 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 540334457 0 0) 0x7f52fc003530 con 0x7f531406d560 2023-10-03T19:20:00.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f5311ffb640 1 -- 172.21.15.45:0/88060715 >> v2:172.21.15.79:3300/0 conn(0x7f53140712c0 msgr2=0x7f53140bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:00.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f5311ffb640 1 --2- 172.21.15.45:0/88060715 >> v2:172.21.15.79:3300/0 conn(0x7f53140712c0 0x7f53140bcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:00.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f5311ffb640 1 -- 172.21.15.45:0/88060715 >> v1:172.21.15.79:6789/0 conn(0x7f531406c760 legacy=0x7f53140a5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:00.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f5311ffb640 1 -- 172.21.15.45:0/88060715 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531406d2e0 con 0x7f531406d560 2023-10-03T19:20:00.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f5311ffb640 1 -- 172.21.15.45:0/88060715 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f5308001680 con 0x7f531406d560 2023-10-03T19:20:00.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f5311ffb640 1 -- 172.21.15.45:0/88060715 >> v1:172.21.15.45:6789/0 conn(0x7f531406d560 legacy=0x7f53140a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:00.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f5311ffb640 1 --2- 172.21.15.45:0/88060715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52fc003980 0x7f52fc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:00.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f5311ffb640 1 --2- 172.21.15.45:0/88060715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52fc0047d0 0x7f52fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:00.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f5311ffb640 1 --2- 172.21.15.45:0/88060715 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f52fc005180 0x7f52fc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:00.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f5311ffb640 1 -- 172.21.15.45:0/88060715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53141508b0 con 0x7f52fc0047d0 2023-10-03T19:20:00.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f5311ffb640 1 -- 172.21.15.45:0/88060715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc00c000 con 0x7f52fc003980 2023-10-03T19:20:00.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f5311ffb640 1 -- 172.21.15.45:0/88060715 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc00c1c0 con 0x7f52fc005180 2023-10-03T19:20:00.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f53127fc640 1 --2- 172.21.15.45:0/88060715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52fc0047d0 0x7f52fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:00.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f5312ffd640 1 --2- 172.21.15.45:0/88060715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52fc003980 0x7f52fc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:00.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f53137fe640 1 --2- 172.21.15.45:0/88060715 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f52fc005180 0x7f52fc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:00.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f53127fc640 1 -- 172.21.15.45:0/88060715 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f52fc005180 msgr2=0x7f52fc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:00.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f53127fc640 1 --2- 172.21.15.45:0/88060715 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f52fc005180 0x7f52fc00b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:00.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f53127fc640 1 -- 172.21.15.45:0/88060715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52fc003980 msgr2=0x7f52fc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:00.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f53127fc640 1 --2- 172.21.15.45:0/88060715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52fc003980 0x7f52fc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:00.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f53127fc640 1 -- 172.21.15.45:0/88060715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc003530 con 0x7f52fc0047d0 2023-10-03T19:20:00.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.856+0000 7f53137fe640 1 -- 172.21.15.45:0/88060715 reap_dead start 2023-10-03T19:20:00.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.860+0000 7f53127fc640 1 --2- 172.21.15.45:0/88060715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52fc0047d0 0x7f52fc004c40 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f530800c1c0 tx=0x7f530801f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e69d0a2b05a7b70 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:00.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.860+0000 7f5311ffb640 1 -- 172.21.15.45:0/88060715 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53080058e0 con 0x7f52fc0047d0 2023-10-03T19:20:00.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.860+0000 7f5311ffb640 1 -- 172.21.15.45:0/88060715 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5308005a40 con 0x7f52fc0047d0 2023-10-03T19:20:00.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.860+0000 7f5311ffb640 1 -- 172.21.15.45:0/88060715 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5308005e70 con 0x7f52fc0047d0 2023-10-03T19:20:00.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.860+0000 7f53199ed640 1 -- 172.21.15.45:0/88060715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52fc0047d0 msgr2=0x7f52fc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:00.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.860+0000 7f53199ed640 1 --2- 172.21.15.45:0/88060715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52fc0047d0 0x7f52fc004c40 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f530800c1c0 tx=0x7f530801f390 comp rx=0 tx=0).stop 2023-10-03T19:20:00.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.860+0000 7f53199ed640 1 -- 172.21.15.45:0/88060715 shutdown_connections 2023-10-03T19:20:00.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.860+0000 7f53199ed640 1 --2- 172.21.15.45:0/88060715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52fc0047d0 0x7f52fc004c40 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:00.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.860+0000 7f53199ed640 1 -- 172.21.15.45:0/88060715 >> 172.21.15.45:0/88060715 conn(0x7f53140a20d0 msgr2=0x7f53140a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:00.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.860+0000 7f53199ed640 1 -- 172.21.15.45:0/88060715 shutdown_connections 2023-10-03T19:20:00.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.860+0000 7f53199ed640 1 -- 172.21.15.45:0/88060715 wait complete. 2023-10-03T19:20:00.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.860+0000 7f53199ed640 1 Processor -- start 2023-10-03T19:20:00.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.860+0000 7f53199ed640 1 -- start start 2023-10-03T19:20:00.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.860+0000 7f53199ed640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f52fc0047d0 0x7f53141e4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:00.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.860+0000 7f53199ed640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5314144bc0 0x7f531414ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:00.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.860+0000 7f53199ed640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53140b9770 0x7f5314070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:00.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.860+0000 7f53199ed640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53140b8be0 con 0x7f53140b9770 2023-10-03T19:20:00.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.860+0000 7f53199ed640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53141e3be0 con 0x7f5314144bc0 2023-10-03T19:20:00.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.860+0000 7f53199ed640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531414f010 con 0x7f52fc0047d0 2023-10-03T19:20:00.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.860+0000 7f53137fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53140b9770 0x7f5314070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:00.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.860+0000 7f53137fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53140b9770 0x7f5314070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59914/0 (socket says 172.21.15.45:59914) 2023-10-03T19:20:00.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.860+0000 7f53137fe640 1 -- 172.21.15.45:0/755539476 learned_addr learned my addr 172.21.15.45:0/755539476 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:00.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.860+0000 7f5312ffd640 1 --2- 172.21.15.45:0/755539476 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f52fc0047d0 0x7f53141e4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:00.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.864+0000 7f53127fc640 1 --2- 172.21.15.45:0/755539476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5314144bc0 0x7f531414ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:00.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.864+0000 7f53137fe640 1 -- 172.21.15.45:0/755539476 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f52fc0047d0 msgr2=0x7f53141e4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:00.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.864+0000 7f53137fe640 1 --2- 172.21.15.45:0/755539476 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f52fc0047d0 0x7f53141e4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:00.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.864+0000 7f53137fe640 1 -- 172.21.15.45:0/755539476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5314144bc0 msgr2=0x7f531414ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:00.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.864+0000 7f53137fe640 1 --2- 172.21.15.45:0/755539476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5314144bc0 0x7f531414ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:00.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.864+0000 7f53137fe640 1 -- 172.21.15.45:0/755539476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5314071690 con 0x7f53140b9770 2023-10-03T19:20:00.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.864+0000 7f53137fe640 1 --2- 172.21.15.45:0/755539476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53140b9770 0x7f5314070290 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f531406cbc0 tx=0x7f530c00d830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:00.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.864+0000 7f52fbfff640 1 -- 172.21.15.45:0/755539476 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c00b070 con 0x7f53140b9770 2023-10-03T19:20:00.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.864+0000 7f52fbfff640 1 -- 172.21.15.45:0/755539476 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530c003980 con 0x7f53140b9770 2023-10-03T19:20:00.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.864+0000 7f53199ed640 1 -- 172.21.15.45:0/755539476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f531406cf40 con 0x7f53140b9770 2023-10-03T19:20:00.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.864+0000 7f52fbfff640 1 -- 172.21.15.45:0/755539476 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c003d10 con 0x7f53140b9770 2023-10-03T19:20:00.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.864+0000 7f53199ed640 1 -- 172.21.15.45:0/755539476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5314071820 con 0x7f53140b9770 2023-10-03T19:20:00.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.864+0000 7f53199ed640 1 -- 172.21.15.45:0/755539476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53141e3d20 con 0x7f53140b9770 2023-10-03T19:20:00.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.864+0000 7f52fbfff640 1 -- 172.21.15.45:0/755539476 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f530c0050d0 con 0x7f53140b9770 2023-10-03T19:20:00.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.864+0000 7f52fbfff640 1 --2- 172.21.15.45:0/755539476 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f53000662b0 0x7f5300068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.864+0000 7f52fbfff640 1 -- 172.21.15.45:0/755539476 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f530c082a60 con 0x7f53140b9770 2023-10-03T19:20:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.864+0000 7f5312ffd640 1 --2- 172.21.15.45:0/755539476 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f53000662b0 0x7f5300068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.864+0000 7f5312ffd640 1 --2- 172.21.15.45:0/755539476 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f53000662b0 0x7f5300068760 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5304009ab0 tx=0x7f5304008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:00.868+0000 7f52fbfff640 1 -- 172.21.15.45:0/755539476 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f53141e3d20 con 0x7f53140b9770 2023-10-03T19:20:01.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.024+0000 7f53199ed640 1 -- 172.21.15.45:0/755539476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f53141e3d20 con 0x7f53140b9770 2023-10-03T19:20:01.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.024+0000 7f52fbfff640 1 -- 172.21.15.45:0/755539476 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7f53141e3d20 con 0x7f53140b9770 2023-10-03T19:20:01.041 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:20:01.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.024+0000 7f53199ed640 1 -- 172.21.15.45:0/755539476 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f53000662b0 msgr2=0x7f5300068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:01.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.024+0000 7f53199ed640 1 --2- 172.21.15.45:0/755539476 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f53000662b0 0x7f5300068760 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5304009ab0 tx=0x7f5304008040 comp rx=0 tx=0).stop 2023-10-03T19:20:01.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.024+0000 7f53199ed640 1 -- 172.21.15.45:0/755539476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53140b9770 msgr2=0x7f5314070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:01.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.024+0000 7f53199ed640 1 --2- 172.21.15.45:0/755539476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53140b9770 0x7f5314070290 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f531406cbc0 tx=0x7f530c00d830 comp rx=0 tx=0).stop 2023-10-03T19:20:01.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.024+0000 7f53199ed640 1 -- 172.21.15.45:0/755539476 shutdown_connections 2023-10-03T19:20:01.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.024+0000 7f53199ed640 1 --2- 172.21.15.45:0/755539476 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f53000662b0 0x7f5300068760 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:01.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.024+0000 7f53199ed640 1 --2- 172.21.15.45:0/755539476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53140b9770 0x7f5314070290 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:01.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.024+0000 7f53199ed640 1 --2- 172.21.15.45:0/755539476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5314144bc0 0x7f531414ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:01.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.024+0000 7f53199ed640 1 --2- 172.21.15.45:0/755539476 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f52fc0047d0 0x7f53141e4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:01.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.024+0000 7f53199ed640 1 -- 172.21.15.45:0/755539476 >> 172.21.15.45:0/755539476 conn(0x7f53140a20d0 msgr2=0x7f53140be010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:01.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.024+0000 7f53199ed640 1 -- 172.21.15.45:0/755539476 shutdown_connections 2023-10-03T19:20:01.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.024+0000 7f53199ed640 1 -- 172.21.15.45:0/755539476 wait complete. 2023-10-03T19:20:01.045 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:20:01.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f584029d640 1 Processor -- start 2023-10-03T19:20:01.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f584029d640 1 -- start start 2023-10-03T19:20:01.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f584029d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f583814ba30 0x7f5838156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:01.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f584029d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f583814f080 con 0x7f583806f880 2023-10-03T19:20:01.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f584029d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5838070e90 con 0x7f583814f510 2023-10-03T19:20:01.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f584029d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583806f3e0 con 0x7f583814ba30 2023-10-03T19:20:01.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f583e039640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f583806f880 0x7f58380a5940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51576/0 (socket says 172.21.15.45:51576) 2023-10-03T19:20:01.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f583e039640 1 -- 172.21.15.45:0/1587263945 learned_addr learned my addr 172.21.15.45:0/1587263945 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:20:01.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f583e83a640 1 --2- 172.21.15.45:0/1587263945 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f583814ba30 0x7f5838156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:01.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f583d037640 1 -- 172.21.15.45:0/1587263945 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1277805578 0 0) 0x7f583814f080 con 0x7f583806f880 2023-10-03T19:20:01.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f583d037640 1 -- 172.21.15.45:0/1587263945 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5824005740 con 0x7f583806f880 2023-10-03T19:20:01.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f583d037640 1 -- 172.21.15.45:0/1587263945 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1613800133 0 0) 0x7f5824005740 con 0x7f583806f880 2023-10-03T19:20:01.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f583d037640 1 -- 172.21.15.45:0/1587263945 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f583814ba30 msgr2=0x7f5838156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:01.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f583d037640 1 --2- 172.21.15.45:0/1587263945 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f583814ba30 0x7f5838156bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:01.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f583d037640 1 -- 172.21.15.45:0/1587263945 >> v1:172.21.15.79:6789/0 conn(0x7f583814f510 legacy=0x7f583814b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:01.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f583d037640 1 -- 172.21.15.45:0/1587263945 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f583814ea30 con 0x7f583806f880 2023-10-03T19:20:01.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f583d037640 1 -- 172.21.15.45:0/1587263945 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f5834001680 con 0x7f583806f880 2023-10-03T19:20:01.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f583d037640 1 -- 172.21.15.45:0/1587263945 >> v1:172.21.15.45:6789/0 conn(0x7f583806f880 legacy=0x7f58380a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:01.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f583d037640 1 --2- 172.21.15.45:0/1587263945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5824005bc0 0x7f5824005f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:01.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f583d037640 1 --2- 172.21.15.45:0/1587263945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5824006560 0x7f5824006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:01.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f583d037640 1 --2- 172.21.15.45:0/1587263945 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f583814ba30 0x7f58240072b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:01.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f583d037640 1 -- 172.21.15.45:0/1587263945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583806f3e0 con 0x7f5824005bc0 2023-10-03T19:20:01.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f583d037640 1 -- 172.21.15.45:0/1587263945 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582400dba0 con 0x7f5824006560 2023-10-03T19:20:01.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f583d037640 1 -- 172.21.15.45:0/1587263945 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582400dd60 con 0x7f583814ba30 2023-10-03T19:20:01.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f583e039640 1 --2- 172.21.15.45:0/1587263945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5824005bc0 0x7f5824005f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:01.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f583d838640 1 --2- 172.21.15.45:0/1587263945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5824006560 0x7f5824006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:01.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f583e83a640 1 --2- 172.21.15.45:0/1587263945 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f583814ba30 0x7f58240072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:01.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f583e039640 1 -- 172.21.15.45:0/1587263945 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f583814ba30 msgr2=0x7f58240072b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:01.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f583e039640 1 --2- 172.21.15.45:0/1587263945 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f583814ba30 0x7f58240072b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:01.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f583e039640 1 -- 172.21.15.45:0/1587263945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5824006560 msgr2=0x7f5824006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:01.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f583e039640 1 --2- 172.21.15.45:0/1587263945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5824006560 0x7f5824006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:01.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.164+0000 7f583e039640 1 -- 172.21.15.45:0/1587263945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5824005740 con 0x7f5824005bc0 2023-10-03T19:20:01.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.168+0000 7f583e039640 1 --2- 172.21.15.45:0/1587263945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5824005bc0 0x7f5824005f90 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f583400c160 tx=0x7f583401cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b076216975416731 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:01.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.168+0000 7f583d037640 1 -- 172.21.15.45:0/1587263945 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834005ae0 con 0x7f5824005bc0 2023-10-03T19:20:01.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.168+0000 7f583d037640 1 -- 172.21.15.45:0/1587263945 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5834005c60 con 0x7f5824005bc0 2023-10-03T19:20:01.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.168+0000 7f583d037640 1 -- 172.21.15.45:0/1587263945 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58340a58c0 con 0x7f5824005bc0 2023-10-03T19:20:01.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.168+0000 7f584029d640 1 -- 172.21.15.45:0/1587263945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5824005bc0 msgr2=0x7f5824005f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:01.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.168+0000 7f584029d640 1 --2- 172.21.15.45:0/1587263945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5824005bc0 0x7f5824005f90 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f583400c160 tx=0x7f583401cbc0 comp rx=0 tx=0).stop 2023-10-03T19:20:01.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.168+0000 7f583e83a640 1 -- 172.21.15.45:0/1587263945 reap_dead start 2023-10-03T19:20:01.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.168+0000 7f584029d640 1 -- 172.21.15.45:0/1587263945 shutdown_connections 2023-10-03T19:20:01.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.168+0000 7f584029d640 1 -- 172.21.15.45:0/1587263945 >> 172.21.15.45:0/1587263945 conn(0x7f58380a20d0 msgr2=0x7f58380a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:01.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.168+0000 7f584029d640 1 -- 172.21.15.45:0/1587263945 shutdown_connections 2023-10-03T19:20:01.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.168+0000 7f584029d640 1 -- 172.21.15.45:0/1587263945 wait complete. 2023-10-03T19:20:01.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.168+0000 7f584029d640 1 Processor -- start 2023-10-03T19:20:01.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.168+0000 7f584029d640 1 -- start start 2023-10-03T19:20:01.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.168+0000 7f584029d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5824005bc0 0x7f58380b9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:01.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.168+0000 7f584029d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f58380ba1d0 0x7f58381e2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:01.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.168+0000 7f584029d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58380b7170 0x7f5838149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:01.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.168+0000 7f584029d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58380b5340 con 0x7f58380b7170 2023-10-03T19:20:01.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.168+0000 7f584029d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58380b5620 con 0x7f5824005bc0 2023-10-03T19:20:01.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.168+0000 7f584029d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5838147ca0 con 0x7f58380ba1d0 2023-10-03T19:20:01.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.168+0000 7f583e83a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58380b7170 0x7f5838149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:01.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.168+0000 7f583e83a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58380b7170 0x7f5838149670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59942/0 (socket says 172.21.15.45:59942) 2023-10-03T19:20:01.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.168+0000 7f583e83a640 1 -- 172.21.15.45:0/2751028014 learned_addr learned my addr 172.21.15.45:0/2751028014 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:01.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.168+0000 7f583e039640 1 --2- 172.21.15.45:0/2751028014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5824005bc0 0x7f58380b9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:01.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.168+0000 7f583d838640 1 --2- 172.21.15.45:0/2751028014 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f58380ba1d0 0x7f58381e2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:01.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.168+0000 7f583e83a640 1 -- 172.21.15.45:0/2751028014 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f58380ba1d0 msgr2=0x7f58381e2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:01.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.168+0000 7f583e83a640 1 --2- 172.21.15.45:0/2751028014 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f58380ba1d0 0x7f58381e2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:01.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.168+0000 7f583e83a640 1 -- 172.21.15.45:0/2751028014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5824005bc0 msgr2=0x7f58380b9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:01.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.168+0000 7f583e83a640 1 --2- 172.21.15.45:0/2751028014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5824005bc0 0x7f58380b9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:01.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.168+0000 7f583e83a640 1 -- 172.21.15.45:0/2751028014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f583806f070 con 0x7f58380b7170 2023-10-03T19:20:01.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.168+0000 7f583e83a640 1 --2- 172.21.15.45:0/2751028014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58380b7170 0x7f5838149670 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f583814f8e0 tx=0x7f5830009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:01.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.172+0000 7f582effd640 1 -- 172.21.15.45:0/2751028014 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583000e070 con 0x7f58380b7170 2023-10-03T19:20:01.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.172+0000 7f582effd640 1 -- 172.21.15.45:0/2751028014 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5830003c70 con 0x7f58380b7170 2023-10-03T19:20:01.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.172+0000 7f584029d640 1 -- 172.21.15.45:0/2751028014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f583814ed10 con 0x7f58380b7170 2023-10-03T19:20:01.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.172+0000 7f582effd640 1 -- 172.21.15.45:0/2751028014 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5830003e20 con 0x7f58380b7170 2023-10-03T19:20:01.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.172+0000 7f584029d640 1 -- 172.21.15.45:0/2751028014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f583806fc50 con 0x7f58380b7170 2023-10-03T19:20:01.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.172+0000 7f584029d640 1 -- 172.21.15.45:0/2751028014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f583804de80 con 0x7f58380b7170 2023-10-03T19:20:01.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.172+0000 7f582effd640 1 -- 172.21.15.45:0/2751028014 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5830004030 con 0x7f58380b7170 2023-10-03T19:20:01.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.172+0000 7f582effd640 1 --2- 172.21.15.45:0/2751028014 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f581c066280 0x7f581c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:01.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.172+0000 7f582effd640 1 -- 172.21.15.45:0/2751028014 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5830083bd0 con 0x7f58380b7170 2023-10-03T19:20:01.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.172+0000 7f583e039640 1 --2- 172.21.15.45:0/2751028014 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f581c066280 0x7f581c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:01.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.172+0000 7f583e039640 1 --2- 172.21.15.45:0/2751028014 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f581c066280 0x7f581c068730 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f58340ab000 tx=0x7f58340a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:01.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.176+0000 7f582effd640 1 -- 172.21.15.45:0/2751028014 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5830051050 con 0x7f58380b7170 2023-10-03T19:20:01.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.332+0000 7f584029d640 1 -- 172.21.15.45:0/2751028014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f583806ee50 con 0x7f58380b7170 2023-10-03T19:20:01.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.332+0000 7f582effd640 1 -- 172.21.15.45:0/2751028014 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v98) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5830054670 con 0x7f58380b7170 2023-10-03T19:20:01.340 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:20:01.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.336+0000 7f584029d640 1 -- 172.21.15.45:0/2751028014 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f581c066280 msgr2=0x7f581c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:01.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.336+0000 7f584029d640 1 --2- 172.21.15.45:0/2751028014 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f581c066280 0x7f581c068730 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f58340ab000 tx=0x7f58340a7070 comp rx=0 tx=0).stop 2023-10-03T19:20:01.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.336+0000 7f584029d640 1 -- 172.21.15.45:0/2751028014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58380b7170 msgr2=0x7f5838149670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:01.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.336+0000 7f584029d640 1 --2- 172.21.15.45:0/2751028014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58380b7170 0x7f5838149670 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f583814f8e0 tx=0x7f5830009f50 comp rx=0 tx=0).stop 2023-10-03T19:20:01.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.336+0000 7f584029d640 1 -- 172.21.15.45:0/2751028014 shutdown_connections 2023-10-03T19:20:01.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.336+0000 7f584029d640 1 --2- 172.21.15.45:0/2751028014 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f581c066280 0x7f581c068730 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:01.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.336+0000 7f584029d640 1 --2- 172.21.15.45:0/2751028014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58380b7170 0x7f5838149670 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:01.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.336+0000 7f584029d640 1 --2- 172.21.15.45:0/2751028014 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f58380ba1d0 0x7f58381e2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:01.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.336+0000 7f584029d640 1 --2- 172.21.15.45:0/2751028014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5824005bc0 0x7f58380b9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:01.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.336+0000 7f584029d640 1 -- 172.21.15.45:0/2751028014 >> 172.21.15.45:0/2751028014 conn(0x7f58380a20d0 msgr2=0x7f583814abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:01.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.336+0000 7f584029d640 1 -- 172.21.15.45:0/2751028014 shutdown_connections 2023-10-03T19:20:01.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.336+0000 7f584029d640 1 -- 172.21.15.45:0/2751028014 wait complete. 2023-10-03T19:20:01.355 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T19:20:01.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.496+0000 7f8dca1a9640 1 Processor -- start 2023-10-03T19:20:01.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.496+0000 7f8dca1a9640 1 -- start start 2023-10-03T19:20:01.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.496+0000 7f8dca1a9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8dc40c07f0 0x7f8dc40bd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:01.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.496+0000 7f8dca1a9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8dc40c19b0 0x7f8dc414bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:01.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.496+0000 7f8dca1a9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc40c14c0 con 0x7f8dc414bff0 2023-10-03T19:20:01.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.496+0000 7f8dca1a9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc40be420 con 0x7f8dc40c07f0 2023-10-03T19:20:01.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.496+0000 7f8dca1a9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc40a1f80 con 0x7f8dc40c19b0 2023-10-03T19:20:01.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.496+0000 7f8dc3fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8dc414bff0 0x7f8dc414fa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51578/0 (socket says 172.21.15.45:51578) 2023-10-03T19:20:01.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.496+0000 7f8dc3fff640 1 -- 172.21.15.45:0/716472064 learned_addr learned my addr 172.21.15.45:0/716472064 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:20:01.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.496+0000 7f8dc37fe640 1 --2- 172.21.15.45:0/716472064 >> v2:172.21.15.45:3300/0 conn(0x7f8dc40c07f0 0x7f8dc40bd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:01.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.496+0000 7f8dc27fc640 1 -- 172.21.15.45:0/716472064 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330123684 0 0) 0x7f8dc40c14c0 con 0x7f8dc414bff0 2023-10-03T19:20:01.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.496+0000 7f8dc27fc640 1 -- 172.21.15.45:0/716472064 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8db0003530 con 0x7f8dc414bff0 2023-10-03T19:20:01.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.496+0000 7f8dc2ffd640 1 --2- 172.21.15.45:0/716472064 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8dc40c19b0 0x7f8dc414bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:01.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.496+0000 7f8dc37fe640 1 -- 172.21.15.45:0/716472064 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8dc40c19b0 msgr2=0x7f8dc414bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:01.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.496+0000 7f8dc37fe640 1 --2- 172.21.15.45:0/716472064 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8dc40c19b0 0x7f8dc414bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:01.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.496+0000 7f8dc37fe640 1 -- 172.21.15.45:0/716472064 >> v1:172.21.15.45:6789/0 conn(0x7f8dc414bff0 legacy=0x7f8dc414fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:01.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.496+0000 7f8dc27fc640 1 -- 172.21.15.45:0/716472064 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1821116107 0 0) 0x7f8db0003530 con 0x7f8dc414bff0 2023-10-03T19:20:01.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.496+0000 7f8dc37fe640 1 -- 172.21.15.45:0/716472064 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc40bd070 con 0x7f8dc40c07f0 2023-10-03T19:20:01.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.496+0000 7f8dc2ffd640 1 --2- 172.21.15.45:0/716472064 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8dc40c19b0 0x7f8dc414bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:20:01.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.500+0000 7f8dc37fe640 1 --2- 172.21.15.45:0/716472064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc40c07f0 0x7f8dc40bd640 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc009d90 tx=0x7f8dbc01c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2abaf7460694fb5d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:01.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.500+0000 7f8dc27fc640 1 -- 172.21.15.45:0/716472064 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db4001680 con 0x7f8dc40c07f0 2023-10-03T19:20:01.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.500+0000 7f8dc27fc640 1 -- 172.21.15.45:0/716472064 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dbc0a64d0 con 0x7f8dc40c07f0 2023-10-03T19:20:01.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.500+0000 7f8dc27fc640 1 -- 172.21.15.45:0/716472064 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc0a6840 con 0x7f8dc40c07f0 2023-10-03T19:20:01.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.500+0000 7f8dca1a9640 1 -- 172.21.15.45:0/716472064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc40c07f0 msgr2=0x7f8dc40bd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:01.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.500+0000 7f8dca1a9640 1 --2- 172.21.15.45:0/716472064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc40c07f0 0x7f8dc40bd640 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc009d90 tx=0x7f8dbc01c7b0 comp rx=0 tx=0).stop 2023-10-03T19:20:01.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.500+0000 7f8dca1a9640 1 -- 172.21.15.45:0/716472064 shutdown_connections 2023-10-03T19:20:01.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.500+0000 7f8dca1a9640 1 --2- 172.21.15.45:0/716472064 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8dc40c19b0 0x7f8dc414bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:01.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.500+0000 7f8dca1a9640 1 --2- 172.21.15.45:0/716472064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc40c07f0 0x7f8dc40bd640 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:01.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.500+0000 7f8dca1a9640 1 -- 172.21.15.45:0/716472064 >> 172.21.15.45:0/716472064 conn(0x7f8dc40a4260 msgr2=0x7f8dc40a4660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:01.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.500+0000 7f8dca1a9640 1 -- 172.21.15.45:0/716472064 shutdown_connections 2023-10-03T19:20:01.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.500+0000 7f8dca1a9640 1 -- 172.21.15.45:0/716472064 wait complete. 2023-10-03T19:20:01.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.500+0000 7f8dca1a9640 1 Processor -- start 2023-10-03T19:20:01.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.500+0000 7f8dca1a9640 1 -- start start 2023-10-03T19:20:01.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.504+0000 7f8dca1a9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8dc40c07f0 0x7f8dc41478b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:01.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.504+0000 7f8dca1a9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc40c19b0 0x7f8dc414f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:01.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.504+0000 7f8dca1a9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8dc414bff0 0x7f8dc4144640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:01.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.504+0000 7f8dca1a9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc40b8ee0 con 0x7f8dc40c19b0 2023-10-03T19:20:01.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.504+0000 7f8dca1a9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc40ba080 con 0x7f8dc40c07f0 2023-10-03T19:20:01.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.504+0000 7f8dca1a9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc414fd90 con 0x7f8dc414bff0 2023-10-03T19:20:01.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.504+0000 7f8dc2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc40c19b0 0x7f8dc414f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:01.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.504+0000 7f8dc2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc40c19b0 0x7f8dc414f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59952/0 (socket says 172.21.15.45:59952) 2023-10-03T19:20:01.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.504+0000 7f8dc2ffd640 1 -- 172.21.15.45:0/2198317757 learned_addr learned my addr 172.21.15.45:0/2198317757 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:01.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.504+0000 7f8dc37fe640 1 --2- 172.21.15.45:0/2198317757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8dc40c07f0 0x7f8dc41478b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:01.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.504+0000 7f8dc2ffd640 1 -- 172.21.15.45:0/2198317757 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8dc414bff0 msgr2=0x7f8dc4144640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:01.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.504+0000 7f8dc2ffd640 1 --2- 172.21.15.45:0/2198317757 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8dc414bff0 0x7f8dc4144640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:01.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.504+0000 7f8dc2ffd640 1 -- 172.21.15.45:0/2198317757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8dc40c07f0 msgr2=0x7f8dc41478b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:01.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.504+0000 7f8dc2ffd640 1 --2- 172.21.15.45:0/2198317757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8dc40c07f0 0x7f8dc41478b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:01.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.504+0000 7f8dc2ffd640 1 -- 172.21.15.45:0/2198317757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dbc009a70 con 0x7f8dc40c19b0 2023-10-03T19:20:01.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.504+0000 7f8dc37fe640 1 --2- 172.21.15.45:0/2198317757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8dc40c07f0 0x7f8dc41478b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:01.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.504+0000 7f8dc2ffd640 1 --2- 172.21.15.45:0/2198317757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc40c19b0 0x7f8dc414f850 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f8dac00e840 tx=0x7f8dac00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:01.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.504+0000 7f8dbbfff640 1 -- 172.21.15.45:0/2198317757 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac00c8d0 con 0x7f8dc40c19b0 2023-10-03T19:20:01.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.504+0000 7f8dbbfff640 1 -- 172.21.15.45:0/2198317757 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dac00ca30 con 0x7f8dc40c19b0 2023-10-03T19:20:01.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.504+0000 7f8dbbfff640 1 -- 172.21.15.45:0/2198317757 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac00cde0 con 0x7f8dc40c19b0 2023-10-03T19:20:01.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.504+0000 7f8dca1a9640 1 -- 172.21.15.45:0/2198317757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc40c0d50 con 0x7f8dc40c19b0 2023-10-03T19:20:01.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.504+0000 7f8dca1a9640 1 -- 172.21.15.45:0/2198317757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc40c0bc0 con 0x7f8dc40c19b0 2023-10-03T19:20:01.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.504+0000 7f8dca1a9640 1 -- 172.21.15.45:0/2198317757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc4150540 con 0x7f8dc40c19b0 2023-10-03T19:20:01.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.504+0000 7f8dbbfff640 1 -- 172.21.15.45:0/2198317757 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8dac013410 con 0x7f8dc40c19b0 2023-10-03T19:20:01.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.504+0000 7f8dbbfff640 1 --2- 172.21.15.45:0/2198317757 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8da40662b0 0x7f8da4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:01.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.504+0000 7f8dbbfff640 1 -- 172.21.15.45:0/2198317757 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8dac083ba0 con 0x7f8dc40c19b0 2023-10-03T19:20:01.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.504+0000 7f8dc37fe640 1 --2- 172.21.15.45:0/2198317757 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8da40662b0 0x7f8da4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:01.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.504+0000 7f8dc37fe640 1 --2- 172.21.15.45:0/2198317757 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8da40662b0 0x7f8da4068760 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc0af000 tx=0x7f8dbc0a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:01.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.508+0000 7f8dbbfff640 1 -- 172.21.15.45:0/2198317757 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8dac051010 con 0x7f8dc40c19b0 2023-10-03T19:20:01.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.652+0000 7f8dca1a9640 1 -- 172.21.15.45:0/2198317757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8dc404de80 con 0x7f8dc40c19b0 2023-10-03T19:20:01.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.656+0000 7f8dbbfff640 1 -- 172.21.15.45:0/2198317757 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v98) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8dac054630 con 0x7f8dc40c19b0 2023-10-03T19:20:01.679 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-03T19:20:01.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.656+0000 7f8dca1a9640 1 -- 172.21.15.45:0/2198317757 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8da40662b0 msgr2=0x7f8da4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:01.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.656+0000 7f8dca1a9640 1 --2- 172.21.15.45:0/2198317757 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8da40662b0 0x7f8da4068760 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc0af000 tx=0x7f8dbc0a7000 comp rx=0 tx=0).stop 2023-10-03T19:20:01.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.656+0000 7f8dca1a9640 1 -- 172.21.15.45:0/2198317757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc40c19b0 msgr2=0x7f8dc414f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:01.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.656+0000 7f8dca1a9640 1 --2- 172.21.15.45:0/2198317757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc40c19b0 0x7f8dc414f850 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f8dac00e840 tx=0x7f8dac00ed00 comp rx=0 tx=0).stop 2023-10-03T19:20:01.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.656+0000 7f8dca1a9640 1 -- 172.21.15.45:0/2198317757 shutdown_connections 2023-10-03T19:20:01.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.656+0000 7f8dca1a9640 1 --2- 172.21.15.45:0/2198317757 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8da40662b0 0x7f8da4068760 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:01.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.656+0000 7f8dca1a9640 1 --2- 172.21.15.45:0/2198317757 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8dc414bff0 0x7f8dc4144640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:01.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.656+0000 7f8dca1a9640 1 --2- 172.21.15.45:0/2198317757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc40c19b0 0x7f8dc414f850 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:01.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.656+0000 7f8dca1a9640 1 --2- 172.21.15.45:0/2198317757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8dc40c07f0 0x7f8dc41478b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:01.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.656+0000 7f8dca1a9640 1 -- 172.21.15.45:0/2198317757 >> 172.21.15.45:0/2198317757 conn(0x7f8dc40a4260 msgr2=0x7f8dc40c2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:01.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.656+0000 7f8dca1a9640 1 -- 172.21.15.45:0/2198317757 shutdown_connections 2023-10-03T19:20:01.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:01.656+0000 7f8dca1a9640 1 -- 172.21.15.45:0/2198317757 wait complete. 2023-10-03T19:20:01.905 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T19:20:02.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.036+0000 7fc6b9f50640 1 Processor -- start 2023-10-03T19:20:02.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.036+0000 7fc6b9f50640 1 -- start start 2023-10-03T19:20:02.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b9f50640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc6b40c14e0 0x7fc6b40c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:02.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b9f50640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b406ac70 con 0x7fc6b40bf1f0 2023-10-03T19:20:02.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b9f50640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b40c3000 con 0x7fc6b40c2770 2023-10-03T19:20:02.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b9f50640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b40aa5f0 con 0x7fc6b40c14e0 2023-10-03T19:20:02.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b2ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc6b40bf1f0 0x7fc6b40a9860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51582/0 (socket says 172.21.15.45:51582) 2023-10-03T19:20:02.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b2ffd640 1 -- 172.21.15.45:0/3438936184 learned_addr learned my addr 172.21.15.45:0/3438936184 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:20:02.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b37fe640 1 --2- 172.21.15.45:0/3438936184 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc6b40c14e0 0x7fc6b40c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:02.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b27fc640 1 -- 172.21.15.45:0/3438936184 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 25970474 0 0) 0x7fc6b406ac70 con 0x7fc6b40bf1f0 2023-10-03T19:20:02.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b27fc640 1 -- 172.21.15.45:0/3438936184 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6a0003530 con 0x7fc6b40bf1f0 2023-10-03T19:20:02.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b27fc640 1 -- 172.21.15.45:0/3438936184 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 480275615 0 0) 0x7fc6a0003530 con 0x7fc6b40bf1f0 2023-10-03T19:20:02.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b27fc640 1 -- 172.21.15.45:0/3438936184 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc6b40c14e0 msgr2=0x7fc6b40c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:02.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b27fc640 1 --2- 172.21.15.45:0/3438936184 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc6b40c14e0 0x7fc6b40c0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:02.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b27fc640 1 -- 172.21.15.45:0/3438936184 >> v1:172.21.15.79:6789/0 conn(0x7fc6b40c2770 legacy=0x7fc6b4069ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:02.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b27fc640 1 -- 172.21.15.45:0/3438936184 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b414f250 con 0x7fc6b40bf1f0 2023-10-03T19:20:02.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b27fc640 1 -- 172.21.15.45:0/3438936184 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fc6a4001680 con 0x7fc6b40bf1f0 2023-10-03T19:20:02.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b27fc640 1 -- 172.21.15.45:0/3438936184 >> v1:172.21.15.45:6789/0 conn(0x7fc6b40bf1f0 legacy=0x7fc6b40a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:02.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b27fc640 1 --2- 172.21.15.45:0/3438936184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6a00039b0 0x7fc6a0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:02.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b27fc640 1 --2- 172.21.15.45:0/3438936184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6a00047d0 0x7fc6a0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:02.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b27fc640 1 --2- 172.21.15.45:0/3438936184 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc6b40c14e0 0x7fc6a0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:02.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b27fc640 1 -- 172.21.15.45:0/3438936184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b40aa5f0 con 0x7fc6a00047d0 2023-10-03T19:20:02.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b27fc640 1 -- 172.21.15.45:0/3438936184 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a000bad0 con 0x7fc6a00039b0 2023-10-03T19:20:02.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b27fc640 1 -- 172.21.15.45:0/3438936184 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a000bc60 con 0x7fc6b40c14e0 2023-10-03T19:20:02.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b2ffd640 1 --2- 172.21.15.45:0/3438936184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6a00047d0 0x7fc6a0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:02.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b37fe640 1 --2- 172.21.15.45:0/3438936184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6a00039b0 0x7fc6a0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:02.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b3fff640 1 --2- 172.21.15.45:0/3438936184 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc6b40c14e0 0x7fc6a0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:02.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b2ffd640 1 -- 172.21.15.45:0/3438936184 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc6b40c14e0 msgr2=0x7fc6a0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:02.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b2ffd640 1 --2- 172.21.15.45:0/3438936184 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc6b40c14e0 0x7fc6a0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:02.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b2ffd640 1 -- 172.21.15.45:0/3438936184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6a00039b0 msgr2=0x7fc6a0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:02.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b2ffd640 1 --2- 172.21.15.45:0/3438936184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6a00039b0 0x7fc6a0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:02.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b2ffd640 1 -- 172.21.15.45:0/3438936184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a0003530 con 0x7fc6a00047d0 2023-10-03T19:20:02.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b2ffd640 1 --2- 172.21.15.45:0/3438936184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6a00047d0 0x7fc6a0004c40 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4001060 tx=0x7fc6a401cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb1b8db6af7e6904 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:02.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.040+0000 7fc6b27fc640 1 -- 172.21.15.45:0/3438936184 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a40058e0 con 0x7fc6a00047d0 2023-10-03T19:20:02.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6b27fc640 1 -- 172.21.15.45:0/3438936184 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a4005a40 con 0x7fc6a00047d0 2023-10-03T19:20:02.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6b27fc640 1 -- 172.21.15.45:0/3438936184 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4005e30 con 0x7fc6a00047d0 2023-10-03T19:20:02.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6b9f50640 1 -- 172.21.15.45:0/3438936184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6a00047d0 msgr2=0x7fc6a0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:02.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6b9f50640 1 --2- 172.21.15.45:0/3438936184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6a00047d0 0x7fc6a0004c40 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4001060 tx=0x7fc6a401cbe0 comp rx=0 tx=0).stop 2023-10-03T19:20:02.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6b3fff640 1 -- 172.21.15.45:0/3438936184 reap_dead start 2023-10-03T19:20:02.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6b9f50640 1 -- 172.21.15.45:0/3438936184 shutdown_connections 2023-10-03T19:20:02.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6b9f50640 1 -- 172.21.15.45:0/3438936184 >> 172.21.15.45:0/3438936184 conn(0x7fc6b40a6440 msgr2=0x7fc6b40a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:02.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6b9f50640 1 -- 172.21.15.45:0/3438936184 shutdown_connections 2023-10-03T19:20:02.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6b9f50640 1 -- 172.21.15.45:0/3438936184 wait complete. 2023-10-03T19:20:02.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6b9f50640 1 Processor -- start 2023-10-03T19:20:02.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6b9f50640 1 -- start start 2023-10-03T19:20:02.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6b9f50640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6a00047d0 0x7fc6b40be310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:02.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6b9f50640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc6b40a9d60 0x7fc6b41e3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:02.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6b9f50640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6b4099890 0x7fc6b41e3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:02.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6b9f50640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b409a640 con 0x7fc6a00047d0 2023-10-03T19:20:02.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6b9f50640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b40b99a0 con 0x7fc6b4099890 2023-10-03T19:20:02.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6b9f50640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b40be850 con 0x7fc6b40a9d60 2023-10-03T19:20:02.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6b37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6a00047d0 0x7fc6b40be310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:02.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6b37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6a00047d0 0x7fc6b40be310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59968/0 (socket says 172.21.15.45:59968) 2023-10-03T19:20:02.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6b37fe640 1 -- 172.21.15.45:0/2212425312 learned_addr learned my addr 172.21.15.45:0/2212425312 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:02.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6b2ffd640 1 --2- 172.21.15.45:0/2212425312 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc6b40a9d60 0x7fc6b41e3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:02.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6b3fff640 1 --2- 172.21.15.45:0/2212425312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6b4099890 0x7fc6b41e3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:02.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6b37fe640 1 -- 172.21.15.45:0/2212425312 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc6b40a9d60 msgr2=0x7fc6b41e3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:02.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6b37fe640 1 --2- 172.21.15.45:0/2212425312 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc6b40a9d60 0x7fc6b41e3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:02.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6b37fe640 1 -- 172.21.15.45:0/2212425312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6b4099890 msgr2=0x7fc6b41e3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:02.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6b37fe640 1 --2- 172.21.15.45:0/2212425312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6b4099890 0x7fc6b41e3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:02.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6b37fe640 1 -- 172.21.15.45:0/2212425312 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b406b100 con 0x7fc6a00047d0 2023-10-03T19:20:02.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6b37fe640 1 --2- 172.21.15.45:0/2212425312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6a00047d0 0x7fc6b40be310 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fc69c0119d0 tx=0x7fc69c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:02.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6abfff640 1 -- 172.21.15.45:0/2212425312 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c00fb50 con 0x7fc6a00047d0 2023-10-03T19:20:02.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6abfff640 1 -- 172.21.15.45:0/2212425312 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69c00fcb0 con 0x7fc6a00047d0 2023-10-03T19:20:02.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6b9f50640 1 -- 172.21.15.45:0/2212425312 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b414f530 con 0x7fc6a00047d0 2023-10-03T19:20:02.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6abfff640 1 -- 172.21.15.45:0/2212425312 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c014440 con 0x7fc6a00047d0 2023-10-03T19:20:02.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.044+0000 7fc6b9f50640 1 -- 172.21.15.45:0/2212425312 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b40c18b0 con 0x7fc6a00047d0 2023-10-03T19:20:02.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.048+0000 7fc6b9f50640 1 -- 172.21.15.45:0/2212425312 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b404de80 con 0x7fc6a00047d0 2023-10-03T19:20:02.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.048+0000 7fc6abfff640 1 -- 172.21.15.45:0/2212425312 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc69c0145a0 con 0x7fc6a00047d0 2023-10-03T19:20:02.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.048+0000 7fc6abfff640 1 --2- 172.21.15.45:0/2212425312 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc694066280 0x7fc694068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:02.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.048+0000 7fc6abfff640 1 -- 172.21.15.45:0/2212425312 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc69c084690 con 0x7fc6a00047d0 2023-10-03T19:20:02.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.048+0000 7fc6b2ffd640 1 --2- 172.21.15.45:0/2212425312 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc694066280 0x7fc694068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:02.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.048+0000 7fc6b2ffd640 1 --2- 172.21.15.45:0/2212425312 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc694066280 0x7fc694068730 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc6a40aa000 tx=0x7fc6a4001a10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:02.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.052+0000 7fc6abfff640 1 -- 172.21.15.45:0/2212425312 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc69c051b40 con 0x7fc6a00047d0 2023-10-03T19:20:02.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.204+0000 7fc6b9f50640 1 -- 172.21.15.45:0/2212425312 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc6b40b8140 con 0x7fc6a00047d0 2023-10-03T19:20:02.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.204+0000 7fc6abfff640 1 -- 172.21.15.45:0/2212425312 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v98) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc69c055160 con 0x7fc6a00047d0 2023-10-03T19:20:02.218 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-03T19:20:02.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.208+0000 7fc6b9f50640 1 -- 172.21.15.45:0/2212425312 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc694066280 msgr2=0x7fc694068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:02.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.208+0000 7fc6b9f50640 1 --2- 172.21.15.45:0/2212425312 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc694066280 0x7fc694068730 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc6a40aa000 tx=0x7fc6a4001a10 comp rx=0 tx=0).stop 2023-10-03T19:20:02.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.208+0000 7fc6b9f50640 1 -- 172.21.15.45:0/2212425312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6a00047d0 msgr2=0x7fc6b40be310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:02.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.208+0000 7fc6b9f50640 1 --2- 172.21.15.45:0/2212425312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6a00047d0 0x7fc6b40be310 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fc69c0119d0 tx=0x7fc69c011e90 comp rx=0 tx=0).stop 2023-10-03T19:20:02.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.208+0000 7fc6b9f50640 1 -- 172.21.15.45:0/2212425312 shutdown_connections 2023-10-03T19:20:02.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.208+0000 7fc6b9f50640 1 --2- 172.21.15.45:0/2212425312 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc694066280 0x7fc694068730 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:02.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.208+0000 7fc6b9f50640 1 --2- 172.21.15.45:0/2212425312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6b4099890 0x7fc6b41e3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:02.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.208+0000 7fc6b9f50640 1 --2- 172.21.15.45:0/2212425312 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc6b40a9d60 0x7fc6b41e3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:02.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.208+0000 7fc6b9f50640 1 --2- 172.21.15.45:0/2212425312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6a00047d0 0x7fc6b40be310 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:02.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.208+0000 7fc6b9f50640 1 -- 172.21.15.45:0/2212425312 >> 172.21.15.45:0/2212425312 conn(0x7fc6b40a6440 msgr2=0x7fc6b40c0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:02.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.208+0000 7fc6b9f50640 1 -- 172.21.15.45:0/2212425312 shutdown_connections 2023-10-03T19:20:02.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.208+0000 7fc6b9f50640 1 -- 172.21.15.45:0/2212425312 wait complete. 2023-10-03T19:20:02.228 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:20:02.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.372+0000 7fee6f8a7640 1 Processor -- start 2023-10-03T19:20:02.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.372+0000 7fee6f8a7640 1 -- start start 2023-10-03T19:20:02.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.372+0000 7fee6f8a7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee680c2790 0x7fee681528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:02.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.372+0000 7fee6f8a7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fee680bb1d0 0x7fee680c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:02.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.372+0000 7fee6f8a7640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee6806b2d0 con 0x7fee6814f240 2023-10-03T19:20:02.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.372+0000 7fee6f8a7640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6806b640 con 0x7fee680bb1d0 2023-10-03T19:20:02.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.372+0000 7fee6f8a7640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee680a3c60 con 0x7fee680c2790 2023-10-03T19:20:02.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.372+0000 7fee6de44640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fee680bb1d0 0x7fee680c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:02.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.372+0000 7fee6d643640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fee6814f240 0x7fee680c0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51588/0 (socket says 172.21.15.45:51588) 2023-10-03T19:20:02.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.372+0000 7fee6de44640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fee680bb1d0 0x7fee680c12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59978/0 (socket says 172.21.15.45:59978) 2023-10-03T19:20:02.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.372+0000 7fee6d643640 1 -- 172.21.15.45:0/1434172028 learned_addr learned my addr 172.21.15.45:0/1434172028 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:20:02.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.372+0000 7fee6ce42640 1 --2- 172.21.15.45:0/1434172028 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee680c2790 0x7fee681528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:02.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.372+0000 7fee6de44640 1 -- 172.21.15.45:0/1434172028 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee680c2790 msgr2=0x7fee681528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:02.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.372+0000 7fee6de44640 1 --2- 172.21.15.45:0/1434172028 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee680c2790 0x7fee681528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:02.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.372+0000 7fee6de44640 1 -- 172.21.15.45:0/1434172028 >> v1:172.21.15.45:6789/0 conn(0x7fee6814f240 legacy=0x7fee680c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:02.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.372+0000 7fee6de44640 1 -- 172.21.15.45:0/1434172028 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6814e740 con 0x7fee680bb1d0 2023-10-03T19:20:02.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.372+0000 7fee6ce42640 1 --2- 172.21.15.45:0/1434172028 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee680c2790 0x7fee681528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:02.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.376+0000 7fee6de44640 1 --2- 172.21.15.45:0/1434172028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee680bb1d0 0x7fee680c12a0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fee580097c0 tx=0x7fee5801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88b460efd1fae01 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:02.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.376+0000 7fee67fff640 1 -- 172.21.15.45:0/1434172028 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee580a8970 con 0x7fee680bb1d0 2023-10-03T19:20:02.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.376+0000 7fee67fff640 1 -- 172.21.15.45:0/1434172028 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee580a8ad0 con 0x7fee680bb1d0 2023-10-03T19:20:02.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.376+0000 7fee67fff640 1 -- 172.21.15.45:0/1434172028 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee580a8e60 con 0x7fee680bb1d0 2023-10-03T19:20:02.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.376+0000 7fee6f8a7640 1 -- 172.21.15.45:0/1434172028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee680bb1d0 msgr2=0x7fee680c12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:02.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.376+0000 7fee6f8a7640 1 --2- 172.21.15.45:0/1434172028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee680bb1d0 0x7fee680c12a0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fee580097c0 tx=0x7fee5801ec70 comp rx=0 tx=0).stop 2023-10-03T19:20:02.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.376+0000 7fee6f8a7640 1 -- 172.21.15.45:0/1434172028 shutdown_connections 2023-10-03T19:20:02.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.376+0000 7fee6f8a7640 1 --2- 172.21.15.45:0/1434172028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee680bb1d0 0x7fee680c12a0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:02.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.376+0000 7fee6f8a7640 1 --2- 172.21.15.45:0/1434172028 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee680c2790 0x7fee681528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:02.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.376+0000 7fee6f8a7640 1 -- 172.21.15.45:0/1434172028 >> 172.21.15.45:0/1434172028 conn(0x7fee680a64a0 msgr2=0x7fee680a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:02.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.376+0000 7fee6f8a7640 1 -- 172.21.15.45:0/1434172028 shutdown_connections 2023-10-03T19:20:02.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.376+0000 7fee6f8a7640 1 -- 172.21.15.45:0/1434172028 wait complete. 2023-10-03T19:20:02.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.376+0000 7fee6f8a7640 1 Processor -- start 2023-10-03T19:20:02.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.376+0000 7fee6f8a7640 1 -- start start 2023-10-03T19:20:02.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.376+0000 7fee6f8a7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee680bb1d0 0x7fee68147680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:02.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.376+0000 7fee6f8a7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee680c2790 0x7fee680b9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:02.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.376+0000 7fee6f8a7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee6814f240 0x7fee681e3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:02.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.376+0000 7fee6f8a7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee681502d0 con 0x7fee6814f240 2023-10-03T19:20:02.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.376+0000 7fee6f8a7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee681e3840 con 0x7fee680bb1d0 2023-10-03T19:20:02.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.376+0000 7fee6f8a7640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee68149b30 con 0x7fee680c2790 2023-10-03T19:20:02.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.376+0000 7fee6de44640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee6814f240 0x7fee681e3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:02.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.376+0000 7fee6de44640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee6814f240 0x7fee681e3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59986/0 (socket says 172.21.15.45:59986) 2023-10-03T19:20:02.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.376+0000 7fee6de44640 1 -- 172.21.15.45:0/3745192148 learned_addr learned my addr 172.21.15.45:0/3745192148 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:02.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.376+0000 7fee6ce42640 1 --2- 172.21.15.45:0/3745192148 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee680c2790 0x7fee680b9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:02.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.380+0000 7fee6d643640 1 --2- 172.21.15.45:0/3745192148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee680bb1d0 0x7fee68147680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:02.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.380+0000 7fee6de44640 1 -- 172.21.15.45:0/3745192148 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee680c2790 msgr2=0x7fee680b9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:02.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.380+0000 7fee6de44640 1 --2- 172.21.15.45:0/3745192148 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee680c2790 0x7fee680b9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:02.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.380+0000 7fee6de44640 1 -- 172.21.15.45:0/3745192148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee680bb1d0 msgr2=0x7fee68147680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:02.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.380+0000 7fee6de44640 1 --2- 172.21.15.45:0/3745192148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee680bb1d0 0x7fee68147680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:02.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.380+0000 7fee6de44640 1 -- 172.21.15.45:0/3745192148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee58009420 con 0x7fee6814f240 2023-10-03T19:20:02.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.380+0000 7fee6de44640 1 --2- 172.21.15.45:0/3745192148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee6814f240 0x7fee681e3f70 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fee5801c8a0 tx=0x7fee5801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:02.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.380+0000 7fee65ffb640 1 -- 172.21.15.45:0/3745192148 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee580b9630 con 0x7fee6814f240 2023-10-03T19:20:02.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.380+0000 7fee65ffb640 1 -- 172.21.15.45:0/3745192148 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee580b9790 con 0x7fee6814f240 2023-10-03T19:20:02.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.380+0000 7fee6f8a7640 1 -- 172.21.15.45:0/3745192148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee6814f610 con 0x7fee6814f240 2023-10-03T19:20:02.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.380+0000 7fee65ffb640 1 -- 172.21.15.45:0/3745192148 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee580b9b40 con 0x7fee6814f240 2023-10-03T19:20:02.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.380+0000 7fee6f8a7640 1 -- 172.21.15.45:0/3745192148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee680a3f40 con 0x7fee6814f240 2023-10-03T19:20:02.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.380+0000 7fee6f8a7640 1 -- 172.21.15.45:0/3745192148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee680bf360 con 0x7fee6814f240 2023-10-03T19:20:02.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.380+0000 7fee65ffb640 1 -- 172.21.15.45:0/3745192148 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fee580b7040 con 0x7fee6814f240 2023-10-03T19:20:02.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.380+0000 7fee65ffb640 1 --2- 172.21.15.45:0/3745192148 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fee54066280 0x7fee54068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:02.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.380+0000 7fee65ffb640 1 -- 172.21.15.45:0/3745192148 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fee58121dd0 con 0x7fee6814f240 2023-10-03T19:20:02.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.380+0000 7fee6d643640 1 --2- 172.21.15.45:0/3745192148 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fee54066280 0x7fee54068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:02.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.380+0000 7fee6d643640 1 --2- 172.21.15.45:0/3745192148 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fee54066280 0x7fee54068730 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fee60001470 tx=0x7fee60009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:02.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.384+0000 7fee65ffb640 1 -- 172.21.15.45:0/3745192148 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fee580ef2e0 con 0x7fee6814f240 2023-10-03T19:20:02.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.572+0000 7fee6f8a7640 1 -- 172.21.15.45:0/3745192148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee680bfa60 con 0x7fee6814f240 2023-10-03T19:20:02.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.572+0000 7fee65ffb640 1 -- 172.21.15.45:0/3745192148 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+3916 (secure 0 0 0) 0x7fee58123090 con 0x7fee6814f240 2023-10-03T19:20:02.606 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:20:02.606 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":50,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5795,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2000006019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2000006019},{"type":"v1","addr":"172.21.15.79:6835","nonce":2000006019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":7149,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/3326584899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3326584899},{"type":"v1","addr":"172.21.15.45:6833","nonce":3326584899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:19:39.419474+0000","modified":"2023-10-03T19:19:41.692109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7155},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7155":{"gid":7155,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3401546487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3401546487},{"type":"v1","addr":"172.21.15.45:6835","nonce":3401546487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-10-03T19:20:02.607 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 50 2023-10-03T19:20:02.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.576+0000 7fee6f8a7640 1 -- 172.21.15.45:0/3745192148 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fee54066280 msgr2=0x7fee54068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:02.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.576+0000 7fee6f8a7640 1 --2- 172.21.15.45:0/3745192148 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fee54066280 0x7fee54068730 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fee60001470 tx=0x7fee60009040 comp rx=0 tx=0).stop 2023-10-03T19:20:02.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.576+0000 7fee6f8a7640 1 -- 172.21.15.45:0/3745192148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee6814f240 msgr2=0x7fee681e3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:02.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.576+0000 7fee6f8a7640 1 --2- 172.21.15.45:0/3745192148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee6814f240 0x7fee681e3f70 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fee5801c8a0 tx=0x7fee5801ba10 comp rx=0 tx=0).stop 2023-10-03T19:20:02.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.576+0000 7fee6f8a7640 1 -- 172.21.15.45:0/3745192148 shutdown_connections 2023-10-03T19:20:02.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.576+0000 7fee6f8a7640 1 --2- 172.21.15.45:0/3745192148 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fee54066280 0x7fee54068730 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:02.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.576+0000 7fee6f8a7640 1 --2- 172.21.15.45:0/3745192148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee6814f240 0x7fee681e3f70 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:02.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.576+0000 7fee6f8a7640 1 --2- 172.21.15.45:0/3745192148 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee680c2790 0x7fee680b9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:02.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.576+0000 7fee6f8a7640 1 --2- 172.21.15.45:0/3745192148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee680bb1d0 0x7fee68147680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:02.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.576+0000 7fee6f8a7640 1 -- 172.21.15.45:0/3745192148 >> 172.21.15.45:0/3745192148 conn(0x7fee680a64a0 msgr2=0x7fee680c39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:02.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.576+0000 7fee6f8a7640 1 -- 172.21.15.45:0/3745192148 shutdown_connections 2023-10-03T19:20:02.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.576+0000 7fee6f8a7640 1 -- 172.21.15.45:0/3745192148 wait complete. 2023-10-03T19:20:02.609 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:20:02.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe30b3c8640 1 Processor -- start 2023-10-03T19:20:02.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe30b3c8640 1 -- start start 2023-10-03T19:20:02.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe30b3c8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe30406d980 0x7fe3040a5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:02.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe30b3c8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3040a6360 con 0x7fe30406a340 2023-10-03T19:20:02.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe30b3c8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe30406a7d0 con 0x7fe30406d5b0 2023-10-03T19:20:02.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe30b3c8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3040a59a0 con 0x7fe30406d980 2023-10-03T19:20:02.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe309965640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe30406a340 0x7fe30414b5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51596/0 (socket says 172.21.15.45:51596) 2023-10-03T19:20:02.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe309965640 1 -- 172.21.15.45:0/749903315 learned_addr learned my addr 172.21.15.45:0/749903315 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:20:02.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe2fbfff640 1 -- 172.21.15.45:0/749903315 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 158253397 0 0) 0x7fe3040a6360 con 0x7fe30406a340 2023-10-03T19:20:02.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe308963640 1 --2- 172.21.15.45:0/749903315 >> v2:172.21.15.79:3300/0 conn(0x7fe30406d980 0x7fe3040a5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:02.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe2fbfff640 1 -- 172.21.15.45:0/749903315 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2f0003530 con 0x7fe30406a340 2023-10-03T19:20:02.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe2fbfff640 1 -- 172.21.15.45:0/749903315 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4210965860 0 0) 0x7fe2f0003530 con 0x7fe30406a340 2023-10-03T19:20:02.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe2fbfff640 1 -- 172.21.15.45:0/749903315 >> v2:172.21.15.79:3300/0 conn(0x7fe30406d980 msgr2=0x7fe3040a5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:02.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe2fbfff640 1 --2- 172.21.15.45:0/749903315 >> v2:172.21.15.79:3300/0 conn(0x7fe30406d980 0x7fe3040a5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:02.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe2fbfff640 1 -- 172.21.15.45:0/749903315 >> v1:172.21.15.79:6789/0 conn(0x7fe30406d5b0 legacy=0x7fe30414d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:02.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe2fbfff640 1 -- 172.21.15.45:0/749903315 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30406de00 con 0x7fe30406a340 2023-10-03T19:20:02.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe2fbfff640 1 -- 172.21.15.45:0/749903315 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fe2fc001a00 con 0x7fe30406a340 2023-10-03T19:20:02.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe2fbfff640 1 -- 172.21.15.45:0/749903315 >> v1:172.21.15.45:6789/0 conn(0x7fe30406a340 legacy=0x7fe30414b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:02.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe2fbfff640 1 --2- 172.21.15.45:0/749903315 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe2f0003980 0x7fe2f0003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:02.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe2fbfff640 1 --2- 172.21.15.45:0/749903315 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2f0004370 0x7fe2f0004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:02.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe2fbfff640 1 --2- 172.21.15.45:0/749903315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2f0005030 0x7fe2f000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:02.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe2fbfff640 1 -- 172.21.15.45:0/749903315 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3040a59a0 con 0x7fe2f0004370 2023-10-03T19:20:02.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe2fbfff640 1 -- 172.21.15.45:0/749903315 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f000bed0 con 0x7fe2f0005030 2023-10-03T19:20:02.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe2fbfff640 1 -- 172.21.15.45:0/749903315 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f000c090 con 0x7fe2f0003980 2023-10-03T19:20:02.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe308963640 1 --2- 172.21.15.45:0/749903315 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2f0004370 0x7fe2f0004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:02.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe309164640 1 --2- 172.21.15.45:0/749903315 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe2f0003980 0x7fe2f0003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:02.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe309965640 1 --2- 172.21.15.45:0/749903315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2f0005030 0x7fe2f000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:02.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe308963640 1 -- 172.21.15.45:0/749903315 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe2f0003980 msgr2=0x7fe2f0003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:02.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe308963640 1 --2- 172.21.15.45:0/749903315 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe2f0003980 0x7fe2f0003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:02.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe308963640 1 -- 172.21.15.45:0/749903315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2f0005030 msgr2=0x7fe2f000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:02.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe308963640 1 --2- 172.21.15.45:0/749903315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2f0005030 0x7fe2f000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:02.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe308963640 1 -- 172.21.15.45:0/749903315 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f0003530 con 0x7fe2f0004370 2023-10-03T19:20:02.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe309965640 1 --2- 172.21.15.45:0/749903315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2f0005030 0x7fe2f000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:02.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe309965640 1 -- 172.21.15.45:0/749903315 reap_dead start 2023-10-03T19:20:02.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.732+0000 7fe309164640 1 --2- 172.21.15.45:0/749903315 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe2f0003980 0x7fe2f0003d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:02.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.736+0000 7fe308963640 1 --2- 172.21.15.45:0/749903315 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2f0004370 0x7fe2f0004830 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4009ae0 tx=0x7fe2f401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3987cbe51e981f27 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:02.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.736+0000 7fe2fbfff640 1 -- 172.21.15.45:0/749903315 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f40a5640 con 0x7fe2f0004370 2023-10-03T19:20:02.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.736+0000 7fe2fbfff640 1 -- 172.21.15.45:0/749903315 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f40a57a0 con 0x7fe2f0004370 2023-10-03T19:20:02.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.736+0000 7fe2fbfff640 1 -- 172.21.15.45:0/749903315 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f40a5b50 con 0x7fe2f0004370 2023-10-03T19:20:02.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.736+0000 7fe30b3c8640 1 -- 172.21.15.45:0/749903315 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2f0004370 msgr2=0x7fe2f0004830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:02.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.736+0000 7fe30b3c8640 1 --2- 172.21.15.45:0/749903315 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2f0004370 0x7fe2f0004830 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4009ae0 tx=0x7fe2f401ca50 comp rx=0 tx=0).stop 2023-10-03T19:20:02.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.736+0000 7fe30b3c8640 1 -- 172.21.15.45:0/749903315 shutdown_connections 2023-10-03T19:20:02.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.736+0000 7fe30b3c8640 1 --2- 172.21.15.45:0/749903315 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2f0004370 0x7fe2f0004830 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:02.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.736+0000 7fe30b3c8640 1 -- 172.21.15.45:0/749903315 >> 172.21.15.45:0/749903315 conn(0x7fe3040c1600 msgr2=0x7fe3040c1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:02.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.736+0000 7fe30b3c8640 1 -- 172.21.15.45:0/749903315 shutdown_connections 2023-10-03T19:20:02.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.736+0000 7fe30b3c8640 1 -- 172.21.15.45:0/749903315 wait complete. 2023-10-03T19:20:02.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.736+0000 7fe30b3c8640 1 Processor -- start 2023-10-03T19:20:02.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.736+0000 7fe30b3c8640 1 -- start start 2023-10-03T19:20:02.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.736+0000 7fe30b3c8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2f0004370 0x7fe304143a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:02.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.736+0000 7fe30b3c8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3041455d0 0x7fe304147170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:02.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.736+0000 7fe30b3c8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3041476b0 0x7fe304142be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:02.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.736+0000 7fe30b3c8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3041483a0 con 0x7fe2f0004370 2023-10-03T19:20:02.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.736+0000 7fe30b3c8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3041480a0 con 0x7fe3041455d0 2023-10-03T19:20:02.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.736+0000 7fe30b3c8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe304143fd0 con 0x7fe3041476b0 2023-10-03T19:20:02.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.736+0000 7fe309164640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2f0004370 0x7fe304143a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:02.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.736+0000 7fe309164640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2f0004370 0x7fe304143a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60006/0 (socket says 172.21.15.45:60006) 2023-10-03T19:20:02.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.736+0000 7fe309164640 1 -- 172.21.15.45:0/2459406937 learned_addr learned my addr 172.21.15.45:0/2459406937 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:02.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.740+0000 7fe308963640 1 --2- 172.21.15.45:0/2459406937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3041455d0 0x7fe304147170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:02.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.740+0000 7fe309965640 1 --2- 172.21.15.45:0/2459406937 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3041476b0 0x7fe304142be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:02.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.740+0000 7fe309164640 1 -- 172.21.15.45:0/2459406937 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3041476b0 msgr2=0x7fe304142be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:02.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.740+0000 7fe309164640 1 --2- 172.21.15.45:0/2459406937 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3041476b0 0x7fe304142be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:02.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.740+0000 7fe309164640 1 -- 172.21.15.45:0/2459406937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3041455d0 msgr2=0x7fe304147170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:02.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.740+0000 7fe309164640 1 --2- 172.21.15.45:0/2459406937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3041455d0 0x7fe304147170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:02.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.740+0000 7fe309164640 1 -- 172.21.15.45:0/2459406937 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3040bbb30 con 0x7fe2f0004370 2023-10-03T19:20:02.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.740+0000 7fe309164640 1 --2- 172.21.15.45:0/2459406937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2f0004370 0x7fe304143a90 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fe30000d5f0 tx=0x7fe30000d6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:02.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.740+0000 7fe2f9ffb640 1 -- 172.21.15.45:0/2459406937 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30000b070 con 0x7fe2f0004370 2023-10-03T19:20:02.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.740+0000 7fe2f9ffb640 1 -- 172.21.15.45:0/2459406937 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3000054e0 con 0x7fe2f0004370 2023-10-03T19:20:02.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.740+0000 7fe2f9ffb640 1 -- 172.21.15.45:0/2459406937 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe300003860 con 0x7fe2f0004370 2023-10-03T19:20:02.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.740+0000 7fe30b3c8640 1 -- 172.21.15.45:0/2459406937 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3040a56c0 con 0x7fe2f0004370 2023-10-03T19:20:02.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.740+0000 7fe30b3c8640 1 -- 172.21.15.45:0/2459406937 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3040bbcc0 con 0x7fe2f0004370 2023-10-03T19:20:02.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.740+0000 7fe30b3c8640 1 -- 172.21.15.45:0/2459406937 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe30404de80 con 0x7fe2f0004370 2023-10-03T19:20:02.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.740+0000 7fe2f9ffb640 1 -- 172.21.15.45:0/2459406937 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe3000039c0 con 0x7fe2f0004370 2023-10-03T19:20:02.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.740+0000 7fe2f9ffb640 1 --2- 172.21.15.45:0/2459406937 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe2e80662b0 0x7fe2e8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:02.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.740+0000 7fe2f9ffb640 1 -- 172.21.15.45:0/2459406937 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe300083130 con 0x7fe2f0004370 2023-10-03T19:20:02.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.740+0000 7fe308963640 1 --2- 172.21.15.45:0/2459406937 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe2e80662b0 0x7fe2e8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:02.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.740+0000 7fe308963640 1 --2- 172.21.15.45:0/2459406937 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe2e80662b0 0x7fe2e8068760 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4009ae0 tx=0x7fe2f40a7040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:02.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.744+0000 7fe2f9ffb640 1 -- 172.21.15.45:0/2459406937 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe300050540 con 0x7fe2f0004370 2023-10-03T19:20:02.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.900+0000 7fe30b3c8640 1 -- 172.21.15.45:0/2459406937 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe304067830 con 0x7fe2f0004370 2023-10-03T19:20:02.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.900+0000 7fe2f9ffb640 1 -- 172.21.15.45:0/2459406937 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+18234 (secure 0 0 0) 0x7fe300053b60 con 0x7fe2f0004370 2023-10-03T19:20:02.906 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:20:02.907 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":98,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:19:40.422617+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:19:37.111278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-10-03T19:19:38.418651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:20:02.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.900+0000 7fe30b3c8640 1 -- 172.21.15.45:0/2459406937 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe2e80662b0 msgr2=0x7fe2e8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:02.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.900+0000 7fe30b3c8640 1 --2- 172.21.15.45:0/2459406937 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe2e80662b0 0x7fe2e8068760 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4009ae0 tx=0x7fe2f40a7040 comp rx=0 tx=0).stop 2023-10-03T19:20:02.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.900+0000 7fe30b3c8640 1 -- 172.21.15.45:0/2459406937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2f0004370 msgr2=0x7fe304143a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:02.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.900+0000 7fe30b3c8640 1 --2- 172.21.15.45:0/2459406937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2f0004370 0x7fe304143a90 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fe30000d5f0 tx=0x7fe30000d6e0 comp rx=0 tx=0).stop 2023-10-03T19:20:02.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.900+0000 7fe30b3c8640 1 -- 172.21.15.45:0/2459406937 shutdown_connections 2023-10-03T19:20:02.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.900+0000 7fe30b3c8640 1 --2- 172.21.15.45:0/2459406937 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe2e80662b0 0x7fe2e8068760 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:02.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.900+0000 7fe30b3c8640 1 --2- 172.21.15.45:0/2459406937 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3041476b0 0x7fe304142be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:02.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.900+0000 7fe30b3c8640 1 --2- 172.21.15.45:0/2459406937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3041455d0 0x7fe304147170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:02.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.900+0000 7fe30b3c8640 1 --2- 172.21.15.45:0/2459406937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2f0004370 0x7fe304143a90 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:02.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.900+0000 7fe30b3c8640 1 -- 172.21.15.45:0/2459406937 >> 172.21.15.45:0/2459406937 conn(0x7fe3040c1600 msgr2=0x7fe30414cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:02.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.904+0000 7fe30b3c8640 1 -- 172.21.15.45:0/2459406937 shutdown_connections 2023-10-03T19:20:02.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:02.904+0000 7fe30b3c8640 1 -- 172.21.15.45:0/2459406937 wait complete. 2023-10-03T19:20:02.921 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-03T19:20:02.933 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:20:03.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.052+0000 7f94b0fba640 1 Processor -- start 2023-10-03T19:20:03.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.052+0000 7f94b0fba640 1 -- start start 2023-10-03T19:20:03.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94b0fba640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f94ac0bcfb0 0x7f94ac152460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:03.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94b0fba640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ac0c0fd0 con 0x7f94ac14bb80 2023-10-03T19:20:03.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94b0fba640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ac14bf50 con 0x7f94ac0bc900 2023-10-03T19:20:03.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94b0fba640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94ac0bce20 con 0x7f94ac0bcfb0 2023-10-03T19:20:03.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94aa59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f94ac14bb80 0x7f94ac0be700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51610/0 (socket says 172.21.15.45:51610) 2023-10-03T19:20:03.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94aa59c640 1 -- 172.21.15.45:0/2602792737 learned_addr learned my addr 172.21.15.45:0/2602792737 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:20:03.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94aad9d640 1 --2- 172.21.15.45:0/2602792737 >> v2:172.21.15.79:3300/0 conn(0x7f94ac0bcfb0 0x7f94ac152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:03.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94a959a640 1 -- 172.21.15.45:0/2602792737 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2605109798 0 0) 0x7f94ac0c0fd0 con 0x7f94ac14bb80 2023-10-03T19:20:03.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94a959a640 1 -- 172.21.15.45:0/2602792737 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9494003530 con 0x7f94ac14bb80 2023-10-03T19:20:03.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94a959a640 1 -- 172.21.15.45:0/2602792737 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2967936098 0 0) 0x7f9494003530 con 0x7f94ac14bb80 2023-10-03T19:20:03.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94a959a640 1 -- 172.21.15.45:0/2602792737 >> v2:172.21.15.79:3300/0 conn(0x7f94ac0bcfb0 msgr2=0x7f94ac152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:03.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94a959a640 1 --2- 172.21.15.45:0/2602792737 >> v2:172.21.15.79:3300/0 conn(0x7f94ac0bcfb0 0x7f94ac152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:03.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94a959a640 1 -- 172.21.15.45:0/2602792737 >> v1:172.21.15.79:6789/0 conn(0x7f94ac0bc900 legacy=0x7f94ac151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:03.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94a959a640 1 -- 172.21.15.45:0/2602792737 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ac0c0980 con 0x7f94ac14bb80 2023-10-03T19:20:03.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94a959a640 1 -- 172.21.15.45:0/2602792737 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f949c001680 con 0x7f94ac14bb80 2023-10-03T19:20:03.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94a959a640 1 -- 172.21.15.45:0/2602792737 >> v1:172.21.15.45:6789/0 conn(0x7f94ac14bb80 legacy=0x7f94ac0be700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:03.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94a959a640 1 --2- 172.21.15.45:0/2602792737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9494003980 0x7f9494003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:03.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94a959a640 1 --2- 172.21.15.45:0/2602792737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94940047d0 0x7f9494004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:03.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94a959a640 1 --2- 172.21.15.45:0/2602792737 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9494005180 0x7f949400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:03.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94a959a640 1 -- 172.21.15.45:0/2602792737 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac0bce20 con 0x7f9494003980 2023-10-03T19:20:03.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94a959a640 1 -- 172.21.15.45:0/2602792737 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949400bfe0 con 0x7f94940047d0 2023-10-03T19:20:03.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94a959a640 1 -- 172.21.15.45:0/2602792737 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f949400c1a0 con 0x7f9494005180 2023-10-03T19:20:03.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94aa59c640 1 --2- 172.21.15.45:0/2602792737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9494003980 0x7f9494003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:03.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94a9d9b640 1 --2- 172.21.15.45:0/2602792737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94940047d0 0x7f9494004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:03.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94aa59c640 1 -- 172.21.15.45:0/2602792737 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9494005180 msgr2=0x7f949400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:03.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94aa59c640 1 --2- 172.21.15.45:0/2602792737 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9494005180 0x7f949400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:03.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94aa59c640 1 -- 172.21.15.45:0/2602792737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94940047d0 msgr2=0x7f9494004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:03.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94aa59c640 1 --2- 172.21.15.45:0/2602792737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94940047d0 0x7f9494004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:03.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94aad9d640 1 -- 172.21.15.45:0/2602792737 reap_dead start 2023-10-03T19:20:03.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94aa59c640 1 -- 172.21.15.45:0/2602792737 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9494003530 con 0x7f9494003980 2023-10-03T19:20:03.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.056+0000 7f94a9d9b640 1 --2- 172.21.15.45:0/2602792737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94940047d0 0x7f9494004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:03.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94aa59c640 1 --2- 172.21.15.45:0/2602792737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9494003980 0x7f9494003d90 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f949c00c240 tx=0x7f949c01f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a12dc2d904ce0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:03.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94a959a640 1 -- 172.21.15.45:0/2602792737 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c005ae0 con 0x7f9494003980 2023-10-03T19:20:03.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94a959a640 1 -- 172.21.15.45:0/2602792737 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949c0ab070 con 0x7f9494003980 2023-10-03T19:20:03.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94a959a640 1 -- 172.21.15.45:0/2602792737 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c007070 con 0x7f9494003980 2023-10-03T19:20:03.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94b0fba640 1 -- 172.21.15.45:0/2602792737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9494003980 msgr2=0x7f9494003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:03.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94b0fba640 1 --2- 172.21.15.45:0/2602792737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9494003980 0x7f9494003d90 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f949c00c240 tx=0x7f949c01f370 comp rx=0 tx=0).stop 2023-10-03T19:20:03.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94b0fba640 1 -- 172.21.15.45:0/2602792737 shutdown_connections 2023-10-03T19:20:03.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94b0fba640 1 --2- 172.21.15.45:0/2602792737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9494003980 0x7f9494003d90 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:03.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94b0fba640 1 -- 172.21.15.45:0/2602792737 >> 172.21.15.45:0/2602792737 conn(0x7f94ac0c2200 msgr2=0x7f94ac0bdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:03.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94b0fba640 1 -- 172.21.15.45:0/2602792737 shutdown_connections 2023-10-03T19:20:03.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94b0fba640 1 -- 172.21.15.45:0/2602792737 wait complete. 2023-10-03T19:20:03.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94b0fba640 1 Processor -- start 2023-10-03T19:20:03.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94b0fba640 1 -- start start 2023-10-03T19:20:03.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94b0fba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9494003980 0x7f94ac146600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:03.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94b0fba640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f94ac0b8640 0x7f94ac1e0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:03.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94b0fba640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94ac1e1150 0x7f94ac142790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:03.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94b0fba640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac1e4260 con 0x7f9494003980 2023-10-03T19:20:03.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94b0fba640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac1444b0 con 0x7f94ac1e1150 2023-10-03T19:20:03.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94b0fba640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac144700 con 0x7f94ac0b8640 2023-10-03T19:20:03.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94aa59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9494003980 0x7f94ac146600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:03.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94aa59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9494003980 0x7f94ac146600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60034/0 (socket says 172.21.15.45:60034) 2023-10-03T19:20:03.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94aa59c640 1 -- 172.21.15.45:0/721809715 learned_addr learned my addr 172.21.15.45:0/721809715 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:03.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94a9d9b640 1 --2- 172.21.15.45:0/721809715 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f94ac0b8640 0x7f94ac1e0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:03.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94aad9d640 1 --2- 172.21.15.45:0/721809715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94ac1e1150 0x7f94ac142790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:03.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94aa59c640 1 -- 172.21.15.45:0/721809715 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f94ac0b8640 msgr2=0x7f94ac1e0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:03.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94aa59c640 1 --2- 172.21.15.45:0/721809715 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f94ac0b8640 0x7f94ac1e0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:03.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94aa59c640 1 -- 172.21.15.45:0/721809715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94ac1e1150 msgr2=0x7f94ac142790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:03.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94aa59c640 1 --2- 172.21.15.45:0/721809715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94ac1e1150 0x7f94ac142790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:03.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94aa59c640 1 -- 172.21.15.45:0/721809715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ac0c03f0 con 0x7f9494003980 2023-10-03T19:20:03.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94aa59c640 1 --2- 172.21.15.45:0/721809715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9494003980 0x7f94ac146600 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f949c01f1a0 tx=0x7f9494005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:03.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f949affd640 1 -- 172.21.15.45:0/721809715 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c001680 con 0x7f9494003980 2023-10-03T19:20:03.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f949affd640 1 -- 172.21.15.45:0/721809715 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949c007070 con 0x7f9494003980 2023-10-03T19:20:03.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94b0fba640 1 -- 172.21.15.45:0/721809715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94ac0c0c60 con 0x7f9494003980 2023-10-03T19:20:03.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f949affd640 1 -- 172.21.15.45:0/721809715 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c007400 con 0x7f9494003980 2023-10-03T19:20:03.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.060+0000 7f94b0fba640 1 -- 172.21.15.45:0/721809715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94ac0c0580 con 0x7f9494003980 2023-10-03T19:20:03.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.064+0000 7f94b0fba640 1 -- 172.21.15.45:0/721809715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94ac1e1520 con 0x7f9494003980 2023-10-03T19:20:03.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.064+0000 7f949affd640 1 -- 172.21.15.45:0/721809715 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f949c0b9030 con 0x7f9494003980 2023-10-03T19:20:03.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.064+0000 7f949affd640 1 --2- 172.21.15.45:0/721809715 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f948c066280 0x7f948c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:03.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.064+0000 7f949affd640 1 -- 172.21.15.45:0/721809715 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f949c0b7070 con 0x7f9494003980 2023-10-03T19:20:03.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.064+0000 7f94a9d9b640 1 --2- 172.21.15.45:0/721809715 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f948c066280 0x7f948c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:03.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.064+0000 7f94a9d9b640 1 --2- 172.21.15.45:0/721809715 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f948c066280 0x7f948c068730 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f94a0007fd0 tx=0x7f94a0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:03.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.068+0000 7f949affd640 1 -- 172.21.15.45:0/721809715 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f94ac1e1520 con 0x7f9494003980 2023-10-03T19:20:03.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.256+0000 7f94b0fba640 1 -- 172.21.15.45:0/721809715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94ac1e1520 con 0x7f9494003980 2023-10-03T19:20:03.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.256+0000 7f949affd640 1 -- 172.21.15.45:0/721809715 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+3916 (secure 0 0 0) 0x7f94ac1e1520 con 0x7f9494003980 2023-10-03T19:20:03.259 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:20:03.260 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":50,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5795,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2000006019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2000006019},{"type":"v1","addr":"172.21.15.79:6835","nonce":2000006019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":7149,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/3326584899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3326584899},{"type":"v1","addr":"172.21.15.45:6833","nonce":3326584899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:19:39.419474+0000","modified":"2023-10-03T19:19:41.692109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7155},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7155":{"gid":7155,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3401546487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3401546487},{"type":"v1","addr":"172.21.15.45:6835","nonce":3401546487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-10-03T19:20:03.260 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 50 2023-10-03T19:20:03.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.256+0000 7f94b0fba640 1 -- 172.21.15.45:0/721809715 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f948c066280 msgr2=0x7f948c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:03.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.256+0000 7f94b0fba640 1 --2- 172.21.15.45:0/721809715 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f948c066280 0x7f948c068730 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f94a0007fd0 tx=0x7f94a0009040 comp rx=0 tx=0).stop 2023-10-03T19:20:03.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.256+0000 7f94b0fba640 1 -- 172.21.15.45:0/721809715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9494003980 msgr2=0x7f94ac146600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:03.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.256+0000 7f94b0fba640 1 --2- 172.21.15.45:0/721809715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9494003980 0x7f94ac146600 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f949c01f1a0 tx=0x7f9494005800 comp rx=0 tx=0).stop 2023-10-03T19:20:03.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.260+0000 7f94b0fba640 1 -- 172.21.15.45:0/721809715 shutdown_connections 2023-10-03T19:20:03.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.260+0000 7f94b0fba640 1 --2- 172.21.15.45:0/721809715 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f948c066280 0x7f948c068730 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:03.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.260+0000 7f94b0fba640 1 --2- 172.21.15.45:0/721809715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94ac1e1150 0x7f94ac142790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:03.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.260+0000 7f94b0fba640 1 --2- 172.21.15.45:0/721809715 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f94ac0b8640 0x7f94ac1e0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:03.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.260+0000 7f94b0fba640 1 --2- 172.21.15.45:0/721809715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9494003980 0x7f94ac146600 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:03.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.260+0000 7f94b0fba640 1 -- 172.21.15.45:0/721809715 >> 172.21.15.45:0/721809715 conn(0x7f94ac0c2200 msgr2=0x7f94ac14acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:03.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.260+0000 7f94b0fba640 1 -- 172.21.15.45:0/721809715 shutdown_connections 2023-10-03T19:20:03.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.260+0000 7f94b0fba640 1 -- 172.21.15.45:0/721809715 wait complete. 2023-10-03T19:20:03.318 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:20:03.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.440+0000 7fa568944640 1 Processor -- start 2023-10-03T19:20:03.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.440+0000 7fa568944640 1 -- start start 2023-10-03T19:20:03.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.440+0000 7fa568944640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa56414f240 0x7fa5641528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:03.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.440+0000 7fa568944640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa5640bb1d0 0x7fa5640c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:03.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.440+0000 7fa568944640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa56406b2d0 con 0x7fa5640c2790 2023-10-03T19:20:03.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.440+0000 7fa568944640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa56406b640 con 0x7fa5640bb1d0 2023-10-03T19:20:03.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.440+0000 7fa568944640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5640a3c60 con 0x7fa56414f240 2023-10-03T19:20:03.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.440+0000 7fa56259c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa56414f240 0x7fa5641528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:03.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.440+0000 7fa562d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa5640bb1d0 0x7fa5640c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:03.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.440+0000 7fa55bfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa5640c2790 0x7fa5640c0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:44014/0 (socket says 172.21.15.45:44014) 2023-10-03T19:20:03.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.440+0000 7fa562d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa5640bb1d0 0x7fa5640c12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:41218/0 (socket says 172.21.15.45:41218) 2023-10-03T19:20:03.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.440+0000 7fa55bfff640 1 -- 172.21.15.45:0/1084910578 learned_addr learned my addr 172.21.15.45:0/1084910578 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:20:03.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.440+0000 7fa56259c640 1 -- 172.21.15.45:0/1084910578 >> v2:172.21.15.79:3300/0 conn(0x7fa5640bb1d0 msgr2=0x7fa5640c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:03.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.440+0000 7fa56259c640 1 --2- 172.21.15.45:0/1084910578 >> v2:172.21.15.79:3300/0 conn(0x7fa5640bb1d0 0x7fa5640c12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:03.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.440+0000 7fa56259c640 1 -- 172.21.15.45:0/1084910578 >> v1:172.21.15.79:6789/0 conn(0x7fa5640c2790 legacy=0x7fa5640c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:03.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.440+0000 7fa56259c640 1 -- 172.21.15.45:0/1084910578 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56414e740 con 0x7fa56414f240 2023-10-03T19:20:03.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.444+0000 7fa56259c640 1 --2- 172.21.15.45:0/1084910578 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa56414f240 0x7fa5641528d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa5540097a0 tx=0x7fa55401ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a49f65e127384c17 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:03.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.444+0000 7fa561d9b640 1 -- 172.21.15.45:0/1084910578 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5540a8950 con 0x7fa56414f240 2023-10-03T19:20:03.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.444+0000 7fa561d9b640 1 -- 172.21.15.45:0/1084910578 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5540a8ab0 con 0x7fa56414f240 2023-10-03T19:20:03.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.444+0000 7fa561d9b640 1 -- 172.21.15.45:0/1084910578 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5540a8e40 con 0x7fa56414f240 2023-10-03T19:20:03.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.444+0000 7fa568944640 1 -- 172.21.15.45:0/1084910578 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa56414f240 msgr2=0x7fa5641528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:03.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.444+0000 7fa568944640 1 --2- 172.21.15.45:0/1084910578 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa56414f240 0x7fa5641528d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa5540097a0 tx=0x7fa55401ec50 comp rx=0 tx=0).stop 2023-10-03T19:20:03.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.444+0000 7fa568944640 1 -- 172.21.15.45:0/1084910578 shutdown_connections 2023-10-03T19:20:03.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.444+0000 7fa568944640 1 --2- 172.21.15.45:0/1084910578 >> v2:172.21.15.79:3300/0 conn(0x7fa5640bb1d0 0x7fa5640c12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:03.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.444+0000 7fa568944640 1 --2- 172.21.15.45:0/1084910578 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa56414f240 0x7fa5641528d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:03.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.444+0000 7fa568944640 1 -- 172.21.15.45:0/1084910578 >> 172.21.15.45:0/1084910578 conn(0x7fa5640a64a0 msgr2=0x7fa5640a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:03.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.444+0000 7fa568944640 1 -- 172.21.15.45:0/1084910578 shutdown_connections 2023-10-03T19:20:03.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.444+0000 7fa568944640 1 -- 172.21.15.45:0/1084910578 wait complete. 2023-10-03T19:20:03.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.444+0000 7fa568944640 1 Processor -- start 2023-10-03T19:20:03.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.444+0000 7fa568944640 1 -- start start 2023-10-03T19:20:03.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.444+0000 7fa568944640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa5640bb1d0 0x7fa5641e8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:03.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.444+0000 7fa568944640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5640c2790 0x7fa56414bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:03.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.444+0000 7fa568944640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa56414f240 0x7fa56414d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:03.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.444+0000 7fa568944640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5641e4100 con 0x7fa56414f240 2023-10-03T19:20:03.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.444+0000 7fa568944640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa564143040 con 0x7fa5640c2790 2023-10-03T19:20:03.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.444+0000 7fa568944640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa564151670 con 0x7fa5640bb1d0 2023-10-03T19:20:03.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.444+0000 7fa562d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa56414f240 0x7fa56414d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:03.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.444+0000 7fa562d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa56414f240 0x7fa56414d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60044/0 (socket says 172.21.15.45:60044) 2023-10-03T19:20:03.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.444+0000 7fa562d9d640 1 -- 172.21.15.45:0/90284147 learned_addr learned my addr 172.21.15.45:0/90284147 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:03.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.444+0000 7fa55bfff640 1 --2- 172.21.15.45:0/90284147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5640c2790 0x7fa56414bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:03.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.444+0000 7fa56259c640 1 --2- 172.21.15.45:0/90284147 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa5640bb1d0 0x7fa5641e8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:03.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.444+0000 7fa562d9d640 1 -- 172.21.15.45:0/90284147 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa5640bb1d0 msgr2=0x7fa5641e8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:03.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.444+0000 7fa562d9d640 1 --2- 172.21.15.45:0/90284147 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa5640bb1d0 0x7fa5641e8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:03.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.444+0000 7fa562d9d640 1 -- 172.21.15.45:0/90284147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5640c2790 msgr2=0x7fa56414bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:03.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.444+0000 7fa562d9d640 1 --2- 172.21.15.45:0/90284147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5640c2790 0x7fa56414bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:03.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.444+0000 7fa562d9d640 1 -- 172.21.15.45:0/90284147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5540093b0 con 0x7fa56414f240 2023-10-03T19:20:03.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.448+0000 7fa562d9d640 1 --2- 172.21.15.45:0/90284147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa56414f240 0x7fa56414d0b0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00efc0 tx=0x7fa55c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:03.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.448+0000 7fa55affd640 1 -- 172.21.15.45:0/90284147 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c014480 con 0x7fa56414f240 2023-10-03T19:20:03.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.448+0000 7fa55affd640 1 -- 172.21.15.45:0/90284147 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c00f040 con 0x7fa56414f240 2023-10-03T19:20:03.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.448+0000 7fa568944640 1 -- 172.21.15.45:0/90284147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa56414f610 con 0x7fa56414f240 2023-10-03T19:20:03.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.448+0000 7fa55affd640 1 -- 172.21.15.45:0/90284147 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c014820 con 0x7fa56414f240 2023-10-03T19:20:03.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.448+0000 7fa568944640 1 -- 172.21.15.45:0/90284147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5640a3f40 con 0x7fa56414f240 2023-10-03T19:20:03.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.448+0000 7fa568944640 1 -- 172.21.15.45:0/90284147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5640bf360 con 0x7fa56414f240 2023-10-03T19:20:03.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.448+0000 7fa55affd640 1 -- 172.21.15.45:0/90284147 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa55c014980 con 0x7fa56414f240 2023-10-03T19:20:03.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.448+0000 7fa55affd640 1 --2- 172.21.15.45:0/90284147 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa5440662d0 0x7fa544068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:03.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.448+0000 7fa55affd640 1 -- 172.21.15.45:0/90284147 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa55c084900 con 0x7fa56414f240 2023-10-03T19:20:03.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.448+0000 7fa56259c640 1 --2- 172.21.15.45:0/90284147 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa5440662d0 0x7fa544068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:03.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.448+0000 7fa56259c640 1 --2- 172.21.15.45:0/90284147 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa5440662d0 0x7fa544068780 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fa5540b2000 tx=0x7fa5540aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:03.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.452+0000 7fa55affd640 1 -- 172.21.15.45:0/90284147 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa55c051f10 con 0x7fa56414f240 2023-10-03T19:20:03.623 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:20:03.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.640+0000 7fa568944640 1 -- 172.21.15.45:0/90284147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5640bfa90 con 0x7fa56414f240 2023-10-03T19:20:03.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.640+0000 7fa55affd640 1 -- 172.21.15.45:0/90284147 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+3916 (secure 0 0 0) 0x7fa55c055530 con 0x7fa56414f240 2023-10-03T19:20:03.651 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:20:03.651 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":50,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5795,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2000006019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2000006019},{"type":"v1","addr":"172.21.15.79:6835","nonce":2000006019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":7149,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/3326584899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3326584899},{"type":"v1","addr":"172.21.15.45:6833","nonce":3326584899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:19:39.419474+0000","modified":"2023-10-03T19:19:41.692109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7155},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7155":{"gid":7155,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3401546487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3401546487},{"type":"v1","addr":"172.21.15.45:6835","nonce":3401546487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-10-03T19:20:03.653 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 50 2023-10-03T19:20:03.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.640+0000 7fa568944640 1 -- 172.21.15.45:0/90284147 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa5440662d0 msgr2=0x7fa544068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:03.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.640+0000 7fa568944640 1 --2- 172.21.15.45:0/90284147 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa5440662d0 0x7fa544068780 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fa5540b2000 tx=0x7fa5540aa070 comp rx=0 tx=0).stop 2023-10-03T19:20:03.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.640+0000 7fa568944640 1 -- 172.21.15.45:0/90284147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa56414f240 msgr2=0x7fa56414d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:03.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.640+0000 7fa568944640 1 --2- 172.21.15.45:0/90284147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa56414f240 0x7fa56414d0b0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00efc0 tx=0x7fa55c00c490 comp rx=0 tx=0).stop 2023-10-03T19:20:03.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.640+0000 7fa568944640 1 -- 172.21.15.45:0/90284147 shutdown_connections 2023-10-03T19:20:03.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.640+0000 7fa568944640 1 --2- 172.21.15.45:0/90284147 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa5440662d0 0x7fa544068780 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:03.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.640+0000 7fa568944640 1 --2- 172.21.15.45:0/90284147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa56414f240 0x7fa56414d0b0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:03.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.640+0000 7fa568944640 1 --2- 172.21.15.45:0/90284147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5640c2790 0x7fa56414bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:03.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.640+0000 7fa568944640 1 --2- 172.21.15.45:0/90284147 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa5640bb1d0 0x7fa5641e8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:03.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.640+0000 7fa568944640 1 -- 172.21.15.45:0/90284147 >> 172.21.15.45:0/90284147 conn(0x7fa5640a64a0 msgr2=0x7fa5640c3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:03.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.640+0000 7fa568944640 1 -- 172.21.15.45:0/90284147 shutdown_connections 2023-10-03T19:20:03.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.640+0000 7fa568944640 1 -- 172.21.15.45:0/90284147 wait complete. 2023-10-03T19:20:03.655 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:20:03.658 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:20:03.660 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:20:03.661 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:20:03.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.816+0000 7f2138323640 1 Processor -- start 2023-10-03T19:20:03.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.816+0000 7f2138323640 1 -- start start 2023-10-03T19:20:03.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.816+0000 7f2138323640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f213014f240 0x7f21301528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:03.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.816+0000 7f2138323640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f21300c2790 0x7f21300c0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:03.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.816+0000 7f2138323640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21300bb1d0 0x7f21300c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:03.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.816+0000 7f2138323640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f213006b640 con 0x7f21300c2790 2023-10-03T19:20:03.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.816+0000 7f2138323640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f213006b2d0 con 0x7f213014f240 2023-10-03T19:20:03.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.816+0000 7f2138323640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21300c0fa0 con 0x7f21300bb1d0 2023-10-03T19:20:03.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.816+0000 7f21358be640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f21300c2790 0x7f21300c0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:03.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.816+0000 7f21360bf640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f213014f240 0x7f21301528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:03.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.816+0000 7f21360bf640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f213014f240 0x7f21301528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:41230/0 (socket says 172.21.15.45:41230) 2023-10-03T19:20:03.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.816+0000 7f21360bf640 1 -- 172.21.15.45:0/2859123745 learned_addr learned my addr 172.21.15.45:0/2859123745 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:03.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.816+0000 7f21368c0640 1 --2- 172.21.15.45:0/2859123745 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21300bb1d0 0x7f21300c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:03.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.816+0000 7f21358be640 1 -- 172.21.15.45:0/2859123745 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21300bb1d0 msgr2=0x7f21300c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:03.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.816+0000 7f21358be640 1 --2- 172.21.15.45:0/2859123745 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21300bb1d0 0x7f21300c12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:03.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.816+0000 7f21358be640 1 -- 172.21.15.45:0/2859123745 >> v2:172.21.15.79:3300/0 conn(0x7f213014f240 msgr2=0x7f21301528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:03.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.816+0000 7f21358be640 1 --2- 172.21.15.45:0/2859123745 >> v2:172.21.15.79:3300/0 conn(0x7f213014f240 0x7f21301528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:03.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.816+0000 7f21358be640 1 -- 172.21.15.45:0/2859123745 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21300a3c60 con 0x7f21300c2790 2023-10-03T19:20:03.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.816+0000 7f21360bf640 1 --2- 172.21.15.45:0/2859123745 >> v2:172.21.15.79:3300/0 conn(0x7f213014f240 0x7f21301528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:20:03.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.820+0000 7f21358be640 1 --2- 172.21.15.45:0/2859123745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21300c2790 0x7f21300c0a60 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f21300c47f0 tx=0x7f212001ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2b3ead25991ac server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:03.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.820+0000 7f21350bd640 1 -- 172.21.15.45:0/2859123745 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21200a88f0 con 0x7f21300c2790 2023-10-03T19:20:03.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.820+0000 7f21350bd640 1 -- 172.21.15.45:0/2859123745 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21200a8a50 con 0x7f21300c2790 2023-10-03T19:20:03.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.820+0000 7f21350bd640 1 -- 172.21.15.45:0/2859123745 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21200a8de0 con 0x7f21300c2790 2023-10-03T19:20:03.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.820+0000 7f2138323640 1 -- 172.21.15.45:0/2859123745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21300c2790 msgr2=0x7f21300c0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:03.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.820+0000 7f2138323640 1 --2- 172.21.15.45:0/2859123745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21300c2790 0x7f21300c0a60 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f21300c47f0 tx=0x7f212001ec30 comp rx=0 tx=0).stop 2023-10-03T19:20:03.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.820+0000 7f2138323640 1 -- 172.21.15.45:0/2859123745 shutdown_connections 2023-10-03T19:20:03.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.820+0000 7f2138323640 1 --2- 172.21.15.45:0/2859123745 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21300bb1d0 0x7f21300c12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:03.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.820+0000 7f2138323640 1 --2- 172.21.15.45:0/2859123745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21300c2790 0x7f21300c0a60 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:03.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.820+0000 7f2138323640 1 --2- 172.21.15.45:0/2859123745 >> v2:172.21.15.79:3300/0 conn(0x7f213014f240 0x7f21301528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:03.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.820+0000 7f2138323640 1 -- 172.21.15.45:0/2859123745 >> 172.21.15.45:0/2859123745 conn(0x7f21300a64a0 msgr2=0x7f21300a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:03.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.820+0000 7f2138323640 1 -- 172.21.15.45:0/2859123745 shutdown_connections 2023-10-03T19:20:03.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.820+0000 7f2138323640 1 -- 172.21.15.45:0/2859123745 wait complete. 2023-10-03T19:20:03.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.820+0000 7f2138323640 1 Processor -- start 2023-10-03T19:20:03.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.820+0000 7f2138323640 1 -- start start 2023-10-03T19:20:03.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.824+0000 7f2138323640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21300bb1d0 0x7f213014aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:03.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.824+0000 7f2138323640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21300c2790 0x7f213014fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:03.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.824+0000 7f2138323640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f213014f240 0x7f21301e7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:03.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.824+0000 7f2138323640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2130151240 con 0x7f213014f240 2023-10-03T19:20:03.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.824+0000 7f2138323640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21300a8c60 con 0x7f21300bb1d0 2023-10-03T19:20:03.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.824+0000 7f2138323640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2130151660 con 0x7f21300c2790 2023-10-03T19:20:03.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.824+0000 7f21368c0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f213014f240 0x7f21301e7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:03.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.824+0000 7f21368c0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f213014f240 0x7f21301e7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60058/0 (socket says 172.21.15.45:60058) 2023-10-03T19:20:03.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.824+0000 7f21368c0640 1 -- 172.21.15.45:0/1103320697 learned_addr learned my addr 172.21.15.45:0/1103320697 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:03.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.824+0000 7f21360bf640 1 --2- 172.21.15.45:0/1103320697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21300bb1d0 0x7f213014aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:03.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.824+0000 7f21358be640 1 --2- 172.21.15.45:0/1103320697 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21300c2790 0x7f213014fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:03.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.824+0000 7f21368c0640 1 -- 172.21.15.45:0/1103320697 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21300c2790 msgr2=0x7f213014fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:03.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.824+0000 7f21368c0640 1 --2- 172.21.15.45:0/1103320697 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21300c2790 0x7f213014fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:03.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.824+0000 7f21368c0640 1 -- 172.21.15.45:0/1103320697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21300bb1d0 msgr2=0x7f213014aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:03.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.824+0000 7f21368c0640 1 --2- 172.21.15.45:0/1103320697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21300bb1d0 0x7f213014aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:03.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.824+0000 7f21368c0640 1 -- 172.21.15.45:0/1103320697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212c009480 con 0x7f213014f240 2023-10-03T19:20:03.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.824+0000 7f21368c0640 1 --2- 172.21.15.45:0/1103320697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f213014f240 0x7f21301e7130 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f212800eed0 tx=0x7f212800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:03.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.824+0000 7f2126ffd640 1 -- 172.21.15.45:0/1103320697 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2128010040 con 0x7f213014f240 2023-10-03T19:20:03.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.824+0000 7f2126ffd640 1 -- 172.21.15.45:0/1103320697 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2128014400 con 0x7f213014f240 2023-10-03T19:20:03.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.824+0000 7f2138323640 1 -- 172.21.15.45:0/1103320697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21200093b0 con 0x7f213014f240 2023-10-03T19:20:03.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.824+0000 7f2126ffd640 1 -- 172.21.15.45:0/1103320697 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2128009ea0 con 0x7f213014f240 2023-10-03T19:20:03.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.824+0000 7f2138323640 1 -- 172.21.15.45:0/1103320697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21300a3f40 con 0x7f213014f240 2023-10-03T19:20:03.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.824+0000 7f2138323640 1 -- 172.21.15.45:0/1103320697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f213014e740 con 0x7f213014f240 2023-10-03T19:20:03.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.824+0000 7f2126ffd640 1 -- 172.21.15.45:0/1103320697 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f21280147b0 con 0x7f213014f240 2023-10-03T19:20:03.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.824+0000 7f2126ffd640 1 --2- 172.21.15.45:0/1103320697 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2114066280 0x7f2114068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:03.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.824+0000 7f2126ffd640 1 -- 172.21.15.45:0/1103320697 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f21280843c0 con 0x7f213014f240 2023-10-03T19:20:03.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.824+0000 7f21360bf640 1 --2- 172.21.15.45:0/1103320697 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2114066280 0x7f2114068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:03.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.828+0000 7f21360bf640 1 --2- 172.21.15.45:0/1103320697 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2114066280 0x7f2114068730 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f212c006fd0 tx=0x7f212c009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:03.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.828+0000 7f2126ffd640 1 -- 172.21.15.45:0/1103320697 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2128051830 con 0x7f213014f240 2023-10-03T19:20:03.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.984+0000 7f2138323640 1 -- 172.21.15.45:0/1103320697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21300bfa90 con 0x7f213014f240 2023-10-03T19:20:03.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.984+0000 7f2126ffd640 1 -- 172.21.15.45:0/1103320697 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+18234 (secure 0 0 0) 0x7f2128054e50 con 0x7f213014f240 2023-10-03T19:20:03.989 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:20:03.990 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":98,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:19:40.422617+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:19:37.111278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-10-03T19:19:38.418651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:20:03.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.988+0000 7f2138323640 1 -- 172.21.15.45:0/1103320697 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2114066280 msgr2=0x7f2114068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:03.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.988+0000 7f2138323640 1 --2- 172.21.15.45:0/1103320697 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2114066280 0x7f2114068730 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f212c006fd0 tx=0x7f212c009210 comp rx=0 tx=0).stop 2023-10-03T19:20:03.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.988+0000 7f2138323640 1 -- 172.21.15.45:0/1103320697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f213014f240 msgr2=0x7f21301e7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:03.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.988+0000 7f2138323640 1 --2- 172.21.15.45:0/1103320697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f213014f240 0x7f21301e7130 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f212800eed0 tx=0x7f212800b480 comp rx=0 tx=0).stop 2023-10-03T19:20:03.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.988+0000 7f2138323640 1 -- 172.21.15.45:0/1103320697 shutdown_connections 2023-10-03T19:20:03.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.988+0000 7f2138323640 1 --2- 172.21.15.45:0/1103320697 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2114066280 0x7f2114068730 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:03.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.988+0000 7f2138323640 1 --2- 172.21.15.45:0/1103320697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f213014f240 0x7f21301e7130 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:03.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.988+0000 7f2138323640 1 --2- 172.21.15.45:0/1103320697 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21300c2790 0x7f213014fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:03.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.988+0000 7f2138323640 1 --2- 172.21.15.45:0/1103320697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21300bb1d0 0x7f213014aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:03.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.988+0000 7f2138323640 1 -- 172.21.15.45:0/1103320697 >> 172.21.15.45:0/1103320697 conn(0x7f21300a64a0 msgr2=0x7f21300a4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:03.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.988+0000 7f2138323640 1 -- 172.21.15.45:0/1103320697 shutdown_connections 2023-10-03T19:20:03.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:03.988+0000 7f2138323640 1 -- 172.21.15.45:0/1103320697 wait complete. 2023-10-03T19:20:04.009 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-03T19:20:04.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e4f269640 1 Processor -- start 2023-10-03T19:20:04.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e4f269640 1 -- start start 2023-10-03T19:20:04.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e4f269640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5e480bc8b0 0x7f5e4814ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:04.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e4f269640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e4806cac0 con 0x7f5e4806f170 2023-10-03T19:20:04.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e4f269640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e480720d0 con 0x7f5e4806d170 2023-10-03T19:20:04.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e4f269640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e480a5ab0 con 0x7f5e480bc8b0 2023-10-03T19:20:04.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e4d005640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5e4806f170 0x7f5e48150190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51618/0 (socket says 172.21.15.45:51618) 2023-10-03T19:20:04.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e4d005640 1 -- 172.21.15.45:0/792664451 learned_addr learned my addr 172.21.15.45:0/792664451 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:20:04.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e4c804640 1 --2- 172.21.15.45:0/792664451 >> v2:172.21.15.79:3300/0 conn(0x7f5e480bc8b0 0x7f5e4814ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:04.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e3ffff640 1 -- 172.21.15.45:0/792664451 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2647534619 0 0) 0x7f5e440014a0 con 0x7f5e4806f170 2023-10-03T19:20:04.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e3ffff640 1 -- 172.21.15.45:0/792664451 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e34003530 con 0x7f5e4806f170 2023-10-03T19:20:04.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e3ffff640 1 -- 172.21.15.45:0/792664451 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4215062325 0 0) 0x7f5e34003530 con 0x7f5e4806f170 2023-10-03T19:20:04.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e3ffff640 1 -- 172.21.15.45:0/792664451 >> v2:172.21.15.79:3300/0 conn(0x7f5e480bc8b0 msgr2=0x7f5e4814ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:04.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e3ffff640 1 --2- 172.21.15.45:0/792664451 >> v2:172.21.15.79:3300/0 conn(0x7f5e480bc8b0 0x7f5e4814ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:04.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e3ffff640 1 -- 172.21.15.45:0/792664451 >> v1:172.21.15.79:6789/0 conn(0x7f5e4806d170 legacy=0x7f5e4814cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:04.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e3ffff640 1 -- 172.21.15.45:0/792664451 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4806cd00 con 0x7f5e4806f170 2023-10-03T19:20:04.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e3ffff640 1 -- 172.21.15.45:0/792664451 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f5e44001b90 con 0x7f5e4806f170 2023-10-03T19:20:04.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e3ffff640 1 -- 172.21.15.45:0/792664451 >> v1:172.21.15.45:6789/0 conn(0x7f5e4806f170 legacy=0x7f5e48150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:04.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e3ffff640 1 --2- 172.21.15.45:0/792664451 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e34003980 0x7f5e34003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:04.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e3ffff640 1 --2- 172.21.15.45:0/792664451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e340047d0 0x7f5e34004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:04.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e3ffff640 1 --2- 172.21.15.45:0/792664451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e34005180 0x7f5e3400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:04.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e3ffff640 1 -- 172.21.15.45:0/792664451 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e480a5ab0 con 0x7f5e34005180 2023-10-03T19:20:04.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e3ffff640 1 -- 172.21.15.45:0/792664451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3400bfe0 con 0x7f5e340047d0 2023-10-03T19:20:04.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e3ffff640 1 -- 172.21.15.45:0/792664451 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3400c1a0 con 0x7f5e34003980 2023-10-03T19:20:04.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e4d806640 1 --2- 172.21.15.45:0/792664451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e34005180 0x7f5e3400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:04.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e4c804640 1 --2- 172.21.15.45:0/792664451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e340047d0 0x7f5e34004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:04.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e4d005640 1 --2- 172.21.15.45:0/792664451 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e34003980 0x7f5e34003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:04.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e4d806640 1 -- 172.21.15.45:0/792664451 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e34003980 msgr2=0x7f5e34003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:04.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e4d806640 1 --2- 172.21.15.45:0/792664451 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e34003980 0x7f5e34003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:04.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e4d806640 1 -- 172.21.15.45:0/792664451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e340047d0 msgr2=0x7f5e34004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:04.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e4d806640 1 --2- 172.21.15.45:0/792664451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e340047d0 0x7f5e34004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:04.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e4d806640 1 -- 172.21.15.45:0/792664451 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e34003530 con 0x7f5e34005180 2023-10-03T19:20:04.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.128+0000 7f5e4c804640 1 --2- 172.21.15.45:0/792664451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e340047d0 0x7f5e34004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:04.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.132+0000 7f5e4d806640 1 -- 172.21.15.45:0/792664451 reap_dead start 2023-10-03T19:20:04.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.132+0000 7f5e4d806640 1 --2- 172.21.15.45:0/792664451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e34005180 0x7f5e3400b990 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f5e40001780 tx=0x7f5e4001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb5fa715fc3d0a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:04.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.132+0000 7f5e3ffff640 1 -- 172.21.15.45:0/792664451 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e400052d0 con 0x7f5e34005180 2023-10-03T19:20:04.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.132+0000 7f5e3ffff640 1 -- 172.21.15.45:0/792664451 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e400a7050 con 0x7f5e34005180 2023-10-03T19:20:04.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.132+0000 7f5e3ffff640 1 -- 172.21.15.45:0/792664451 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e40003840 con 0x7f5e34005180 2023-10-03T19:20:04.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.132+0000 7f5e4f269640 1 -- 172.21.15.45:0/792664451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e34005180 msgr2=0x7f5e3400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:04.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.132+0000 7f5e4f269640 1 --2- 172.21.15.45:0/792664451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e34005180 0x7f5e3400b990 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f5e40001780 tx=0x7f5e4001c400 comp rx=0 tx=0).stop 2023-10-03T19:20:04.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.132+0000 7f5e4f269640 1 -- 172.21.15.45:0/792664451 shutdown_connections 2023-10-03T19:20:04.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.132+0000 7f5e4f269640 1 --2- 172.21.15.45:0/792664451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e34005180 0x7f5e3400b990 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:04.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.132+0000 7f5e4f269640 1 -- 172.21.15.45:0/792664451 >> 172.21.15.45:0/792664451 conn(0x7f5e480bcf50 msgr2=0x7f5e480bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:04.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.132+0000 7f5e4f269640 1 -- 172.21.15.45:0/792664451 shutdown_connections 2023-10-03T19:20:04.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.132+0000 7f5e4f269640 1 -- 172.21.15.45:0/792664451 wait complete. 2023-10-03T19:20:04.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.132+0000 7f5e4f269640 1 Processor -- start 2023-10-03T19:20:04.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.132+0000 7f5e4f269640 1 -- start start 2023-10-03T19:20:04.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.136+0000 7f5e4f269640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e34005180 0x7f5e481e69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:04.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.136+0000 7f5e4f269640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e480b9b50 0x7f5e480a3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:04.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.136+0000 7f5e4f269640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e481d7500 0x7f5e481d7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:04.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.136+0000 7f5e4f269640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e48140d70 con 0x7f5e34005180 2023-10-03T19:20:04.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.136+0000 7f5e4f269640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e480a51f0 con 0x7f5e480b9b50 2023-10-03T19:20:04.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.136+0000 7f5e4f269640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e48140ad0 con 0x7f5e481d7500 2023-10-03T19:20:04.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.136+0000 7f5e4d005640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e34005180 0x7f5e481e69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:04.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.136+0000 7f5e4d005640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e34005180 0x7f5e481e69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60080/0 (socket says 172.21.15.45:60080) 2023-10-03T19:20:04.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.136+0000 7f5e4d005640 1 -- 172.21.15.45:0/2865496761 learned_addr learned my addr 172.21.15.45:0/2865496761 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:04.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.136+0000 7f5e4c804640 1 --2- 172.21.15.45:0/2865496761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e480b9b50 0x7f5e480a3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:04.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.136+0000 7f5e4d806640 1 --2- 172.21.15.45:0/2865496761 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e481d7500 0x7f5e481d7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:04.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.136+0000 7f5e4d005640 1 -- 172.21.15.45:0/2865496761 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e481d7500 msgr2=0x7f5e481d7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:04.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.136+0000 7f5e4d005640 1 --2- 172.21.15.45:0/2865496761 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e481d7500 0x7f5e481d7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:04.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.136+0000 7f5e4d005640 1 -- 172.21.15.45:0/2865496761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e480b9b50 msgr2=0x7f5e480a3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:04.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.136+0000 7f5e4d005640 1 --2- 172.21.15.45:0/2865496761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e480b9b50 0x7f5e480a3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:04.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.136+0000 7f5e4d005640 1 -- 172.21.15.45:0/2865496761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4814c4a0 con 0x7f5e34005180 2023-10-03T19:20:04.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.136+0000 7f5e4d005640 1 --2- 172.21.15.45:0/2865496761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e34005180 0x7f5e481e69d0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f5e44001af0 tx=0x7f5e4400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:04.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.136+0000 7f5e3dffb640 1 -- 172.21.15.45:0/2865496761 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e44004d70 con 0x7f5e34005180 2023-10-03T19:20:04.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.136+0000 7f5e3dffb640 1 -- 172.21.15.45:0/2865496761 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4400be80 con 0x7f5e34005180 2023-10-03T19:20:04.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.136+0000 7f5e4f269640 1 -- 172.21.15.45:0/2865496761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e4814fae0 con 0x7f5e34005180 2023-10-03T19:20:04.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.136+0000 7f5e3dffb640 1 -- 172.21.15.45:0/2865496761 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e440072f0 con 0x7f5e34005180 2023-10-03T19:20:04.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.136+0000 7f5e4f269640 1 -- 172.21.15.45:0/2865496761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e4806f540 con 0x7f5e34005180 2023-10-03T19:20:04.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.136+0000 7f5e4f269640 1 -- 172.21.15.45:0/2865496761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e4806d660 con 0x7f5e34005180 2023-10-03T19:20:04.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.136+0000 7f5e3dffb640 1 -- 172.21.15.45:0/2865496761 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5e44007450 con 0x7f5e34005180 2023-10-03T19:20:04.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.136+0000 7f5e3dffb640 1 --2- 172.21.15.45:0/2865496761 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5e2c066280 0x7f5e2c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:04.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.136+0000 7f5e3dffb640 1 -- 172.21.15.45:0/2865496761 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5e44083f00 con 0x7f5e34005180 2023-10-03T19:20:04.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.136+0000 7f5e4c804640 1 --2- 172.21.15.45:0/2865496761 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5e2c066280 0x7f5e2c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:04.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.140+0000 7f5e4c804640 1 --2- 172.21.15.45:0/2865496761 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5e2c066280 0x7f5e2c068730 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5e480bc190 tx=0x7f5e38008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:04.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.140+0000 7f5e3dffb640 1 -- 172.21.15.45:0/2865496761 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5e440513b0 con 0x7f5e34005180 2023-10-03T19:20:04.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.328+0000 7f5e4f269640 1 -- 172.21.15.45:0/2865496761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5e4806cac0 con 0x7f5e34005180 2023-10-03T19:20:04.821 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-10-03T19:20:04.820+0000 7f00b6fb3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-03T19:20:04.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.836+0000 7f5e3dffb640 1 -- 172.21.15.45:0/2865496761 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v51) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5e4806cac0 con 0x7f5e34005180 2023-10-03T19:20:04.839 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-03T19:20:04.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.840+0000 7f5e4f269640 1 -- 172.21.15.45:0/2865496761 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5e2c066280 msgr2=0x7f5e2c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:04.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.840+0000 7f5e4f269640 1 --2- 172.21.15.45:0/2865496761 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5e2c066280 0x7f5e2c068730 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5e480bc190 tx=0x7f5e38008040 comp rx=0 tx=0).stop 2023-10-03T19:20:04.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.840+0000 7f5e4f269640 1 -- 172.21.15.45:0/2865496761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e34005180 msgr2=0x7f5e481e69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:04.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.840+0000 7f5e4f269640 1 --2- 172.21.15.45:0/2865496761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e34005180 0x7f5e481e69d0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f5e44001af0 tx=0x7f5e4400b4a0 comp rx=0 tx=0).stop 2023-10-03T19:20:04.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.840+0000 7f5e4f269640 1 -- 172.21.15.45:0/2865496761 shutdown_connections 2023-10-03T19:20:04.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.840+0000 7f5e4f269640 1 --2- 172.21.15.45:0/2865496761 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5e2c066280 0x7f5e2c068730 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:04.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.840+0000 7f5e4f269640 1 --2- 172.21.15.45:0/2865496761 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e481d7500 0x7f5e481d7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:04.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.840+0000 7f5e4f269640 1 --2- 172.21.15.45:0/2865496761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e480b9b50 0x7f5e480a3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:04.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.840+0000 7f5e4f269640 1 --2- 172.21.15.45:0/2865496761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e34005180 0x7f5e481e69d0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:04.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.840+0000 7f5e4f269640 1 -- 172.21.15.45:0/2865496761 >> 172.21.15.45:0/2865496761 conn(0x7f5e480bcf50 msgr2=0x7f5e4814ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:04.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.840+0000 7f5e4f269640 1 -- 172.21.15.45:0/2865496761 shutdown_connections 2023-10-03T19:20:04.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:04.840+0000 7f5e4f269640 1 -- 172.21.15.45:0/2865496761 wait complete. 2023-10-03T19:20:04.845 INFO:tasks.ceph.mds.a.smithi045.stderr: -1790> 2023-10-03T19:19:45.016+0000 7fd1a2c6b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-03T19:20:04.866 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-03T19:20:04.891 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-10-03T19:20:05.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.004+0000 7f671e080640 1 Processor -- start 2023-10-03T19:20:05.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.004+0000 7f671e080640 1 -- start start 2023-10-03T19:20:05.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.008+0000 7f671e080640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f671814eb90 0x7f6718159e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:05.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.008+0000 7f671e080640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f671806b1c0 con 0x7f6718071ec0 2023-10-03T19:20:05.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.008+0000 7f671e080640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6718069b40 con 0x7f671814bb80 2023-10-03T19:20:05.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.008+0000 7f671e080640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f671814bf50 con 0x7f671814eb90 2023-10-03T19:20:05.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.008+0000 7f6717fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f671814eb90 0x7f6718159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:05.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.008+0000 7f6717fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f671814eb90 0x7f6718159e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58298/0 (socket says 172.21.15.45:58298) 2023-10-03T19:20:05.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.008+0000 7f6717fff640 1 -- 172.21.15.45:0/446864767 learned_addr learned my addr 172.21.15.45:0/446864767 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:05.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.008+0000 7f6716ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6718071ec0 0x7f671814e480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43358/0 (socket says 172.21.15.45:43358) 2023-10-03T19:20:05.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.008+0000 7f6717fff640 1 -- 172.21.15.45:0/446864767 >> v1:172.21.15.79:6789/0 conn(0x7f671814bb80 legacy=0x7f6718071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:05.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.008+0000 7f6717fff640 1 -- 172.21.15.45:0/446864767 >> v1:172.21.15.45:6789/0 conn(0x7f6718071ec0 legacy=0x7f671814e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:05.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.008+0000 7f67167fc640 1 -- 172.21.15.45:0/446864767 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4162782320 0 0) 0x7f671806b1c0 con 0x7f6718071ec0 2023-10-03T19:20:05.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.008+0000 7f6717fff640 1 -- 172.21.15.45:0/446864767 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67181527d0 con 0x7f671814eb90 2023-10-03T19:20:05.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.008+0000 7f6717fff640 1 --2- 172.21.15.45:0/446864767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f671814eb90 0x7f6718159e10 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f6710009e50 tx=0x7f671001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab2371109b24d02 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:05.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.008+0000 7f67167fc640 1 -- 172.21.15.45:0/446864767 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67100a58a0 con 0x7f671814eb90 2023-10-03T19:20:05.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.008+0000 7f67167fc640 1 -- 172.21.15.45:0/446864767 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67100a5a00 con 0x7f671814eb90 2023-10-03T19:20:05.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.008+0000 7f67167fc640 1 -- 172.21.15.45:0/446864767 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67100a5d90 con 0x7f671814eb90 2023-10-03T19:20:05.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f671e080640 1 -- 172.21.15.45:0/446864767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f671814eb90 msgr2=0x7f6718159e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:05.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f671e080640 1 --2- 172.21.15.45:0/446864767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f671814eb90 0x7f6718159e10 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f6710009e50 tx=0x7f671001c9e0 comp rx=0 tx=0).stop 2023-10-03T19:20:05.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f671e080640 1 -- 172.21.15.45:0/446864767 shutdown_connections 2023-10-03T19:20:05.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f671e080640 1 --2- 172.21.15.45:0/446864767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f671814eb90 0x7f6718159e10 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:05.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f671e080640 1 -- 172.21.15.45:0/446864767 >> 172.21.15.45:0/446864767 conn(0x7f67180c25f0 msgr2=0x7f67180c29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:05.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f671e080640 1 -- 172.21.15.45:0/446864767 shutdown_connections 2023-10-03T19:20:05.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f671e080640 1 -- 172.21.15.45:0/446864767 wait complete. 2023-10-03T19:20:05.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f671e080640 1 Processor -- start 2023-10-03T19:20:05.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f671e080640 1 -- start start 2023-10-03T19:20:05.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f671e080640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6718071ec0 0x7f67180bbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:05.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f671e080640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f671814bb80 0x7f67181e9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:05.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f671e080640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f671814eb90 0x7f67181ea320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:05.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f671e080640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67180ba4f0 con 0x7f671814bb80 2023-10-03T19:20:05.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f671e080640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6718148cd0 con 0x7f6718071ec0 2023-10-03T19:20:05.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f671e080640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6718150230 con 0x7f671814eb90 2023-10-03T19:20:05.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f6716ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f671814bb80 0x7f67181e9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:05.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f6716ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f671814bb80 0x7f67181e9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58302/0 (socket says 172.21.15.45:58302) 2023-10-03T19:20:05.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f6716ffd640 1 -- 172.21.15.45:0/4193351292 learned_addr learned my addr 172.21.15.45:0/4193351292 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:05.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f67177fe640 1 --2- 172.21.15.45:0/4193351292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6718071ec0 0x7f67180bbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:05.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f6717fff640 1 --2- 172.21.15.45:0/4193351292 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f671814eb90 0x7f67181ea320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:05.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f6716ffd640 1 -- 172.21.15.45:0/4193351292 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f671814eb90 msgr2=0x7f67181ea320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:05.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f6716ffd640 1 --2- 172.21.15.45:0/4193351292 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f671814eb90 0x7f67181ea320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:05.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f6716ffd640 1 -- 172.21.15.45:0/4193351292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6718071ec0 msgr2=0x7f67180bbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:05.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f6716ffd640 1 --2- 172.21.15.45:0/4193351292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6718071ec0 0x7f67180bbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:05.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f6716ffd640 1 -- 172.21.15.45:0/4193351292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6710009b30 con 0x7f671814bb80 2023-10-03T19:20:05.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f6716ffd640 1 --2- 172.21.15.45:0/4193351292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f671814bb80 0x7f67181e9de0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f670c00c410 tx=0x7f670c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:05.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f66fffff640 1 -- 172.21.15.45:0/4193351292 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c0074e0 con 0x7f671814bb80 2023-10-03T19:20:05.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f66fffff640 1 -- 172.21.15.45:0/4193351292 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670c007640 con 0x7f671814bb80 2023-10-03T19:20:05.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f671e080640 1 -- 172.21.15.45:0/4193351292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6718152480 con 0x7f671814bb80 2023-10-03T19:20:05.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f66fffff640 1 -- 172.21.15.45:0/4193351292 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c004a30 con 0x7f671814bb80 2023-10-03T19:20:05.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.012+0000 7f671e080640 1 -- 172.21.15.45:0/4193351292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6718071730 con 0x7f671814bb80 2023-10-03T19:20:05.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.016+0000 7f671e080640 1 -- 172.21.15.45:0/4193351292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67180b9870 con 0x7f671814bb80 2023-10-03T19:20:05.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.016+0000 7f66fffff640 1 -- 172.21.15.45:0/4193351292 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f670c004b90 con 0x7f671814bb80 2023-10-03T19:20:05.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.016+0000 7f66fffff640 1 --2- 172.21.15.45:0/4193351292 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f67040662b0 0x7f6704068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:05.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.016+0000 7f66fffff640 1 -- 172.21.15.45:0/4193351292 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f670c083a70 con 0x7f671814bb80 2023-10-03T19:20:05.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.016+0000 7f67177fe640 1 --2- 172.21.15.45:0/4193351292 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f67040662b0 0x7f6704068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:05.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.016+0000 7f67177fe640 1 --2- 172.21.15.45:0/4193351292 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f67040662b0 0x7f6704068760 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f6708007fd0 tx=0x7f6708009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:05.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.020+0000 7f66fffff640 1 -- 172.21.15.45:0/4193351292 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f670c054920 con 0x7f671814bb80 2023-10-03T19:20:05.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.208+0000 7f671e080640 1 -- 172.21.15.45:0/4193351292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f671804de80 con 0x7f671814bb80 2023-10-03T19:20:05.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.836+0000 7f66fffff640 1 -- 172.21.15.45:0/4193351292 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v52) v1 ==== 104+0+0 (secure 0 0 0) 0x7f670c0544b0 con 0x7f671814bb80 2023-10-03T19:20:05.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.844+0000 7f671e080640 1 -- 172.21.15.45:0/4193351292 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f67040662b0 msgr2=0x7f6704068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:05.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.844+0000 7f671e080640 1 --2- 172.21.15.45:0/4193351292 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f67040662b0 0x7f6704068760 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f6708007fd0 tx=0x7f6708009040 comp rx=0 tx=0).stop 2023-10-03T19:20:05.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.844+0000 7f671e080640 1 -- 172.21.15.45:0/4193351292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f671814bb80 msgr2=0x7f67181e9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:05.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.844+0000 7f671e080640 1 --2- 172.21.15.45:0/4193351292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f671814bb80 0x7f67181e9de0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f670c00c410 tx=0x7f670c00c8d0 comp rx=0 tx=0).stop 2023-10-03T19:20:05.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.844+0000 7f671e080640 1 -- 172.21.15.45:0/4193351292 shutdown_connections 2023-10-03T19:20:05.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.844+0000 7f671e080640 1 --2- 172.21.15.45:0/4193351292 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f67040662b0 0x7f6704068760 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:05.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.844+0000 7f671e080640 1 --2- 172.21.15.45:0/4193351292 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f671814eb90 0x7f67181ea320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:05.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.844+0000 7f671e080640 1 --2- 172.21.15.45:0/4193351292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f671814bb80 0x7f67181e9de0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:05.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.844+0000 7f671e080640 1 --2- 172.21.15.45:0/4193351292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6718071ec0 0x7f67180bbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:05.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.844+0000 7f671e080640 1 -- 172.21.15.45:0/4193351292 >> 172.21.15.45:0/4193351292 conn(0x7f67180c25f0 msgr2=0x7f67180c29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:05.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.844+0000 7f671e080640 1 -- 172.21.15.45:0/4193351292 shutdown_connections 2023-10-03T19:20:05.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:05.844+0000 7f671e080640 1 -- 172.21.15.45:0/4193351292 wait complete. 2023-10-03T19:20:05.868 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-03T19:20:06.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.044+0000 7f59b40b5640 1 Processor -- start 2023-10-03T19:20:06.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.044+0000 7f59b40b5640 1 -- start start 2023-10-03T19:20:06.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.048+0000 7f59b40b5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f59ac0b8a20 0x7f59ac06e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:06.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.048+0000 7f59b40b5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f59ac0bd530 0x7f59ac0bd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:06.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.048+0000 7f59b40b5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59ac14a300 con 0x7f59ac149f30 2023-10-03T19:20:06.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.048+0000 7f59b40b5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59ac06ea40 con 0x7f59ac0bd530 2023-10-03T19:20:06.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.048+0000 7f59b40b5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59ac0bfa20 con 0x7f59ac0b8a20 2023-10-03T19:20:06.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.048+0000 7f59b1e51640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f59ac149f30 0x7f59ac06f1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43360/0 (socket says 172.21.15.45:43360) 2023-10-03T19:20:06.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.048+0000 7f59b1e51640 1 -- 172.21.15.45:0/2904426454 learned_addr learned my addr 172.21.15.45:0/2904426454 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:20:06.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.048+0000 7f59b2652640 1 --2- 172.21.15.45:0/2904426454 >> v2:172.21.15.45:3300/0 conn(0x7f59ac0bd530 0x7f59ac0bd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:06.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.048+0000 7f59b1650640 1 --2- 172.21.15.45:0/2904426454 >> v2:172.21.15.79:3300/0 conn(0x7f59ac0b8a20 0x7f59ac06e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:06.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.048+0000 7f59b0e4f640 1 -- 172.21.15.45:0/2904426454 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2092834874 0 0) 0x7f59ac14a300 con 0x7f59ac149f30 2023-10-03T19:20:06.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.048+0000 7f59b0e4f640 1 -- 172.21.15.45:0/2904426454 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5998003530 con 0x7f59ac149f30 2023-10-03T19:20:06.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.048+0000 7f59b2652640 1 -- 172.21.15.45:0/2904426454 >> v2:172.21.15.79:3300/0 conn(0x7f59ac0b8a20 msgr2=0x7f59ac06e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:06.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.048+0000 7f59b2652640 1 --2- 172.21.15.45:0/2904426454 >> v2:172.21.15.79:3300/0 conn(0x7f59ac0b8a20 0x7f59ac06e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:06.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.048+0000 7f59b2652640 1 -- 172.21.15.45:0/2904426454 >> v1:172.21.15.45:6789/0 conn(0x7f59ac149f30 legacy=0x7f59ac06f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:06.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.048+0000 7f59b2652640 1 -- 172.21.15.45:0/2904426454 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ac06ec20 con 0x7f59ac0bd530 2023-10-03T19:20:06.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.048+0000 7f59b2652640 1 --2- 172.21.15.45:0/2904426454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59ac0bd530 0x7f59ac0bd900 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f59ac0b7620 tx=0x7f59a401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa8611fb0629719 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:06.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.048+0000 7f59b0e4f640 1 -- 172.21.15.45:0/2904426454 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a40a5820 con 0x7f59ac0bd530 2023-10-03T19:20:06.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.048+0000 7f59b0e4f640 1 -- 172.21.15.45:0/2904426454 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a40a5980 con 0x7f59ac0bd530 2023-10-03T19:20:06.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.048+0000 7f59b0e4f640 1 -- 172.21.15.45:0/2904426454 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a40a5d10 con 0x7f59ac0bd530 2023-10-03T19:20:06.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59b40b5640 1 -- 172.21.15.45:0/2904426454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59ac0bd530 msgr2=0x7f59ac0bd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:06.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59b40b5640 1 --2- 172.21.15.45:0/2904426454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59ac0bd530 0x7f59ac0bd900 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f59ac0b7620 tx=0x7f59a401c850 comp rx=0 tx=0).stop 2023-10-03T19:20:06.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59b40b5640 1 -- 172.21.15.45:0/2904426454 shutdown_connections 2023-10-03T19:20:06.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59b40b5640 1 --2- 172.21.15.45:0/2904426454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59ac0bd530 0x7f59ac0bd900 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:06.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59b40b5640 1 --2- 172.21.15.45:0/2904426454 >> v2:172.21.15.79:3300/0 conn(0x7f59ac0b8a20 0x7f59ac06e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:06.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59b40b5640 1 -- 172.21.15.45:0/2904426454 >> 172.21.15.45:0/2904426454 conn(0x7f59ac0a4300 msgr2=0x7f59ac0a4700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:06.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59b40b5640 1 -- 172.21.15.45:0/2904426454 shutdown_connections 2023-10-03T19:20:06.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59b40b5640 1 -- 172.21.15.45:0/2904426454 wait complete. 2023-10-03T19:20:06.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59b40b5640 1 Processor -- start 2023-10-03T19:20:06.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59b40b5640 1 -- start start 2023-10-03T19:20:06.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59b40b5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59ac0b8a20 0x7f59ac071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:06.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59b40b5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59ac0bd530 0x7f59ac13f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:06.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59b40b5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59ac149f30 0x7f59ac13fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:06.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59b40b5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ac1503e0 con 0x7f59ac149f30 2023-10-03T19:20:06.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59b40b5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ac1401f0 con 0x7f59ac0b8a20 2023-10-03T19:20:06.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59b40b5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ac1e9ac0 con 0x7f59ac0bd530 2023-10-03T19:20:06.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59b2652640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59ac149f30 0x7f59ac13fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:06.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59b2652640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59ac149f30 0x7f59ac13fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58310/0 (socket says 172.21.15.45:58310) 2023-10-03T19:20:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59b2652640 1 -- 172.21.15.45:0/1023840106 learned_addr learned my addr 172.21.15.45:0/1023840106 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59b1e51640 1 --2- 172.21.15.45:0/1023840106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59ac0b8a20 0x7f59ac071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59b1650640 1 --2- 172.21.15.45:0/1023840106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59ac0bd530 0x7f59ac13f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59b2652640 1 -- 172.21.15.45:0/1023840106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59ac0bd530 msgr2=0x7f59ac13f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59b2652640 1 --2- 172.21.15.45:0/1023840106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59ac0bd530 0x7f59ac13f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59b2652640 1 -- 172.21.15.45:0/1023840106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59ac0b8a20 msgr2=0x7f59ac071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59b2652640 1 --2- 172.21.15.45:0/1023840106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59ac0b8a20 0x7f59ac071490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59b2652640 1 -- 172.21.15.45:0/1023840106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a4009a70 con 0x7f59ac149f30 2023-10-03T19:20:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59b2652640 1 --2- 172.21.15.45:0/1023840106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59ac149f30 0x7f59ac13fb90 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f59a4019460 tx=0x7f59a40195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59a27fc640 1 -- 172.21.15.45:0/1023840106 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a40b9650 con 0x7f59ac149f30 2023-10-03T19:20:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59a27fc640 1 -- 172.21.15.45:0/1023840106 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a40b97b0 con 0x7f59ac149f30 2023-10-03T19:20:06.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59b40b5640 1 -- 172.21.15.45:0/1023840106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59ac0bde40 con 0x7f59ac149f30 2023-10-03T19:20:06.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59a27fc640 1 -- 172.21.15.45:0/1023840106 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a40b9b40 con 0x7f59ac149f30 2023-10-03T19:20:06.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.052+0000 7f59b40b5640 1 -- 172.21.15.45:0/1023840106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59ac06f8f0 con 0x7f59ac149f30 2023-10-03T19:20:06.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.056+0000 7f59b40b5640 1 -- 172.21.15.45:0/1023840106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59ac0b7930 con 0x7f59ac149f30 2023-10-03T19:20:06.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.056+0000 7f59a27fc640 1 -- 172.21.15.45:0/1023840106 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f59a40b9ca0 con 0x7f59ac149f30 2023-10-03T19:20:06.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.056+0000 7f59a27fc640 1 --2- 172.21.15.45:0/1023840106 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f59900662b0 0x7f5990068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:06.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.056+0000 7f59a27fc640 1 -- 172.21.15.45:0/1023840106 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f59a411ece0 con 0x7f59ac149f30 2023-10-03T19:20:06.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.056+0000 7f59b1e51640 1 --2- 172.21.15.45:0/1023840106 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f59900662b0 0x7f5990068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:06.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.056+0000 7f59b1e51640 1 --2- 172.21.15.45:0/1023840106 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f59900662b0 0x7f5990068760 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f59a80011f0 tx=0x7f59a8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:06.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.060+0000 7f59a27fc640 1 -- 172.21.15.45:0/1023840106 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f59a40ec190 con 0x7f59ac149f30 2023-10-03T19:20:06.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.216+0000 7f59b40b5640 1 -- 172.21.15.45:0/1023840106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f59ac0be4d0 con 0x7f59ac149f30 2023-10-03T19:20:06.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.856+0000 7f59a27fc640 1 -- 172.21.15.45:0/1023840106 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v100) v1 ==== 181+0+0 (secure 0 0 0) 0x7f59a40ef7b0 con 0x7f59ac149f30 2023-10-03T19:20:06.859 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-10-03T19:20:06.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.856+0000 7f59b40b5640 1 -- 172.21.15.45:0/1023840106 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f59900662b0 msgr2=0x7f5990068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:06.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.856+0000 7f59b40b5640 1 --2- 172.21.15.45:0/1023840106 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f59900662b0 0x7f5990068760 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f59a80011f0 tx=0x7f59a8009040 comp rx=0 tx=0).stop 2023-10-03T19:20:06.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.856+0000 7f59b40b5640 1 -- 172.21.15.45:0/1023840106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59ac149f30 msgr2=0x7f59ac13fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:06.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.856+0000 7f59b40b5640 1 --2- 172.21.15.45:0/1023840106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59ac149f30 0x7f59ac13fb90 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f59a4019460 tx=0x7f59a40195f0 comp rx=0 tx=0).stop 2023-10-03T19:20:06.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.860+0000 7f59b40b5640 1 -- 172.21.15.45:0/1023840106 shutdown_connections 2023-10-03T19:20:06.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.860+0000 7f59b40b5640 1 --2- 172.21.15.45:0/1023840106 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f59900662b0 0x7f5990068760 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:06.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.860+0000 7f59b40b5640 1 --2- 172.21.15.45:0/1023840106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59ac149f30 0x7f59ac13fb90 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:06.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.860+0000 7f59b40b5640 1 --2- 172.21.15.45:0/1023840106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59ac0bd530 0x7f59ac13f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:06.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.860+0000 7f59b40b5640 1 --2- 172.21.15.45:0/1023840106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59ac0b8a20 0x7f59ac071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:06.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.860+0000 7f59b40b5640 1 -- 172.21.15.45:0/1023840106 >> 172.21.15.45:0/1023840106 conn(0x7f59ac0a4300 msgr2=0x7f59ac06f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:06.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.860+0000 7f59b40b5640 1 -- 172.21.15.45:0/1023840106 shutdown_connections 2023-10-03T19:20:06.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:06.860+0000 7f59b40b5640 1 -- 172.21.15.45:0/1023840106 wait complete. 2023-10-03T19:20:06.885 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-03T19:20:07.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.016+0000 7f1181903640 1 Processor -- start 2023-10-03T19:20:07.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.016+0000 7f1181903640 1 -- start start 2023-10-03T19:20:07.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.016+0000 7f1181903640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f117c06d630 0x7f117c14e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:07.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.016+0000 7f1181903640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f117c06c1b0 0x7f117c14eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:07.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.016+0000 7f1181903640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f117c0bcf80 con 0x7f117c148540 2023-10-03T19:20:07.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.016+0000 7f1181903640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f117c152b50 con 0x7f117c06c1b0 2023-10-03T19:20:07.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.016+0000 7f1181903640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117c14e550 con 0x7f117c06d630 2023-10-03T19:20:07.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.016+0000 7f117b7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f117c06c1b0 0x7f117c14eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:07.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.016+0000 7f117b7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f117c06c1b0 0x7f117c14eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58318/0 (socket says 172.21.15.45:58318) 2023-10-03T19:20:07.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.016+0000 7f117affd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f117c148540 0x7f117c0bb060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43366/0 (socket says 172.21.15.45:43366) 2023-10-03T19:20:07.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.016+0000 7f117b7fe640 1 -- 172.21.15.45:0/2229810142 learned_addr learned my addr 172.21.15.45:0/2229810142 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:07.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.016+0000 7f117a7fc640 1 --2- 172.21.15.45:0/2229810142 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f117c06d630 0x7f117c14e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:07.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.016+0000 7f117b7fe640 1 -- 172.21.15.45:0/2229810142 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f117c06d630 msgr2=0x7f117c14e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:07.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.016+0000 7f117b7fe640 1 --2- 172.21.15.45:0/2229810142 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f117c06d630 0x7f117c14e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:07.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.016+0000 7f117b7fe640 1 -- 172.21.15.45:0/2229810142 >> v1:172.21.15.45:6789/0 conn(0x7f117c148540 legacy=0x7f117c0bb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:07.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.016+0000 7f117b7fe640 1 -- 172.21.15.45:0/2229810142 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117c0bd260 con 0x7f117c06c1b0 2023-10-03T19:20:07.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.020+0000 7f117b7fe640 1 --2- 172.21.15.45:0/2229810142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f117c06c1b0 0x7f117c14eee0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f116c009870 tx=0x7f116c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c56c7f1d99b303 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:07.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.020+0000 7f1179ffb640 1 -- 172.21.15.45:0/2229810142 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c0aa430 con 0x7f117c06c1b0 2023-10-03T19:20:07.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.020+0000 7f1179ffb640 1 -- 172.21.15.45:0/2229810142 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116c0aa590 con 0x7f117c06c1b0 2023-10-03T19:20:07.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.020+0000 7f1179ffb640 1 -- 172.21.15.45:0/2229810142 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c0aa920 con 0x7f117c06c1b0 2023-10-03T19:20:07.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.020+0000 7f1181903640 1 -- 172.21.15.45:0/2229810142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f117c06c1b0 msgr2=0x7f117c14eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:07.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.020+0000 7f1181903640 1 --2- 172.21.15.45:0/2229810142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f117c06c1b0 0x7f117c14eee0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f116c009870 tx=0x7f116c01c510 comp rx=0 tx=0).stop 2023-10-03T19:20:07.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.020+0000 7f1181903640 1 -- 172.21.15.45:0/2229810142 shutdown_connections 2023-10-03T19:20:07.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.020+0000 7f1181903640 1 --2- 172.21.15.45:0/2229810142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f117c06c1b0 0x7f117c14eee0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:07.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.020+0000 7f1181903640 1 --2- 172.21.15.45:0/2229810142 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f117c06d630 0x7f117c14e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:07.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.020+0000 7f1181903640 1 -- 172.21.15.45:0/2229810142 >> 172.21.15.45:0/2229810142 conn(0x7f117c0a20d0 msgr2=0x7f117c0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:07.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.020+0000 7f1181903640 1 -- 172.21.15.45:0/2229810142 shutdown_connections 2023-10-03T19:20:07.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.020+0000 7f1181903640 1 -- 172.21.15.45:0/2229810142 wait complete. 2023-10-03T19:20:07.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.024+0000 7f1181903640 1 Processor -- start 2023-10-03T19:20:07.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.024+0000 7f1181903640 1 -- start start 2023-10-03T19:20:07.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.024+0000 7f1181903640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f117c06c1b0 0x7f117c070990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:07.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.024+0000 7f1181903640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f117c06d630 0x7f117c1e9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:07.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.024+0000 7f1181903640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f117c148540 0x7f117c1ea430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:07.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.024+0000 7f1181903640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117c14a980 con 0x7f117c06d630 2023-10-03T19:20:07.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.024+0000 7f1181903640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117c1e9ad0 con 0x7f117c06c1b0 2023-10-03T19:20:07.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.024+0000 7f1181903640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117c0a58b0 con 0x7f117c148540 2023-10-03T19:20:07.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.024+0000 7f117a7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f117c06d630 0x7f117c1e9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:07.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.024+0000 7f117a7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f117c06d630 0x7f117c1e9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58330/0 (socket says 172.21.15.45:58330) 2023-10-03T19:20:07.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.024+0000 7f117a7fc640 1 -- 172.21.15.45:0/2627681549 learned_addr learned my addr 172.21.15.45:0/2627681549 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:07.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.024+0000 7f117affd640 1 --2- 172.21.15.45:0/2627681549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f117c06c1b0 0x7f117c070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:07.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.024+0000 7f117b7fe640 1 --2- 172.21.15.45:0/2627681549 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f117c148540 0x7f117c1ea430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:07.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.024+0000 7f117a7fc640 1 -- 172.21.15.45:0/2627681549 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f117c148540 msgr2=0x7f117c1ea430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:07.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.024+0000 7f117a7fc640 1 --2- 172.21.15.45:0/2627681549 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f117c148540 0x7f117c1ea430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:07.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.024+0000 7f117a7fc640 1 -- 172.21.15.45:0/2627681549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f117c06c1b0 msgr2=0x7f117c070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:07.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.024+0000 7f117a7fc640 1 --2- 172.21.15.45:0/2627681549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f117c06c1b0 0x7f117c070990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:07.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.024+0000 7f117a7fc640 1 -- 172.21.15.45:0/2627681549 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116c0094d0 con 0x7f117c06d630 2023-10-03T19:20:07.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.024+0000 7f117a7fc640 1 --2- 172.21.15.45:0/2627681549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f117c06d630 0x7f117c1e9ef0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f117000d800 tx=0x7f117000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:07.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.024+0000 7f1163fff640 1 -- 172.21.15.45:0/2627681549 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117000b6c0 con 0x7f117c06d630 2023-10-03T19:20:07.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.024+0000 7f1163fff640 1 -- 172.21.15.45:0/2627681549 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117000b820 con 0x7f117c06d630 2023-10-03T19:20:07.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.024+0000 7f1181903640 1 -- 172.21.15.45:0/2627681549 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f117c148910 con 0x7f117c06d630 2023-10-03T19:20:07.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.024+0000 7f1163fff640 1 -- 172.21.15.45:0/2627681549 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117000bbd0 con 0x7f117c06d630 2023-10-03T19:20:07.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.024+0000 7f1181903640 1 -- 172.21.15.45:0/2627681549 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f117c14f420 con 0x7f117c06d630 2023-10-03T19:20:07.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.024+0000 7f1181903640 1 -- 172.21.15.45:0/2627681549 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f117c0a62e0 con 0x7f117c06d630 2023-10-03T19:20:07.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.024+0000 7f1163fff640 1 -- 172.21.15.45:0/2627681549 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f117000bd30 con 0x7f117c06d630 2023-10-03T19:20:07.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.024+0000 7f1163fff640 1 --2- 172.21.15.45:0/2627681549 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1168066280 0x7f1168068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:07.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.028+0000 7f1163fff640 1 -- 172.21.15.45:0/2627681549 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5710+0+0 (secure 0 0 0) 0x7f11700840a0 con 0x7f117c06d630 2023-10-03T19:20:07.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.028+0000 7f117affd640 1 --2- 172.21.15.45:0/2627681549 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1168066280 0x7f1168068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:07.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.028+0000 7f117affd640 1 --2- 172.21.15.45:0/2627681549 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1168066280 0x7f1168068730 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1174005fd0 tx=0x7f1174005ba0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:07.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.032+0000 7f1163fff640 1 -- 172.21.15.45:0/2627681549 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f11700551a0 con 0x7f117c06d630 2023-10-03T19:20:07.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.184+0000 7f1181903640 1 -- 172.21.15.45:0/2627681549 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f117c04de80 con 0x7f117c06d630 2023-10-03T19:20:07.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.864+0000 7f1163fff640 1 -- 172.21.15.45:0/2627681549 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v101) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1170054d30 con 0x7f117c06d630 2023-10-03T19:20:07.867 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-10-03T19:20:07.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.868+0000 7f1181903640 1 -- 172.21.15.45:0/2627681549 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1168066280 msgr2=0x7f1168068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:07.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.868+0000 7f1181903640 1 --2- 172.21.15.45:0/2627681549 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1168066280 0x7f1168068730 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1174005fd0 tx=0x7f1174005ba0 comp rx=0 tx=0).stop 2023-10-03T19:20:07.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.868+0000 7f1181903640 1 -- 172.21.15.45:0/2627681549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f117c06d630 msgr2=0x7f117c1e9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:07.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.868+0000 7f1181903640 1 --2- 172.21.15.45:0/2627681549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f117c06d630 0x7f117c1e9ef0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f117000d800 tx=0x7f117000dcc0 comp rx=0 tx=0).stop 2023-10-03T19:20:07.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.868+0000 7f1181903640 1 -- 172.21.15.45:0/2627681549 shutdown_connections 2023-10-03T19:20:07.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.868+0000 7f1181903640 1 --2- 172.21.15.45:0/2627681549 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1168066280 0x7f1168068730 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:07.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.868+0000 7f1181903640 1 --2- 172.21.15.45:0/2627681549 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f117c148540 0x7f117c1ea430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:07.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.868+0000 7f1181903640 1 --2- 172.21.15.45:0/2627681549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f117c06d630 0x7f117c1e9ef0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:07.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.868+0000 7f1181903640 1 --2- 172.21.15.45:0/2627681549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f117c06c1b0 0x7f117c070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:07.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.868+0000 7f1181903640 1 -- 172.21.15.45:0/2627681549 >> 172.21.15.45:0/2627681549 conn(0x7f117c0a20d0 msgr2=0x7f117c0a24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:07.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.868+0000 7f1181903640 1 -- 172.21.15.45:0/2627681549 shutdown_connections 2023-10-03T19:20:07.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:07.868+0000 7f1181903640 1 -- 172.21.15.45:0/2627681549 wait complete. 2023-10-03T19:20:07.895 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-03T19:20:08.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.016+0000 7f13b4ac9640 1 Processor -- start 2023-10-03T19:20:08.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.016+0000 7f13b4ac9640 1 -- start start 2023-10-03T19:20:08.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.020+0000 7f13b4ac9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f13b006f880 0x7f13b00a5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:08.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.020+0000 7f13b4ac9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f13b014f510 0x7f13b014b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:08.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.020+0000 7f13b4ac9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b014f080 con 0x7f13b00bd9f0 2023-10-03T19:20:08.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.020+0000 7f13b4ac9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b006f3e0 con 0x7f13b014f510 2023-10-03T19:20:08.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.020+0000 7f13b4ac9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b0070e90 con 0x7f13b006f880 2023-10-03T19:20:08.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.020+0000 7f13a7fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f13b014f510 0x7f13b014b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:08.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.020+0000 7f13ae59c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f13b006f880 0x7f13b00a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:08.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.020+0000 7f13aed9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f13b00bd9f0 0x7f13b00badc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:36516/0 (socket says 172.21.15.45:36516) 2023-10-03T19:20:08.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.020+0000 7f13aed9d640 1 -- 172.21.15.45:0/607476409 learned_addr learned my addr 172.21.15.45:0/607476409 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:20:08.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.020+0000 7f13ae59c640 1 -- 172.21.15.45:0/607476409 >> v2:172.21.15.79:3300/0 conn(0x7f13b014f510 msgr2=0x7f13b014b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:08.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.020+0000 7f13ae59c640 1 --2- 172.21.15.45:0/607476409 >> v2:172.21.15.79:3300/0 conn(0x7f13b014f510 0x7f13b014b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:08.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.020+0000 7f13ae59c640 1 -- 172.21.15.45:0/607476409 >> v1:172.21.15.79:6789/0 conn(0x7f13b00bd9f0 legacy=0x7f13b00badc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:08.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.020+0000 7f13ae59c640 1 -- 172.21.15.45:0/607476409 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b014ea30 con 0x7f13b006f880 2023-10-03T19:20:08.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.020+0000 7f13a7fff640 1 --2- 172.21.15.45:0/607476409 >> v2:172.21.15.79:3300/0 conn(0x7f13b014f510 0x7f13b014b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:20:08.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13ae59c640 1 --2- 172.21.15.45:0/607476409 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f13b006f880 0x7f13b00a5940 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f13a00097c0 tx=0x7f13a001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9f1240ea52ae542 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:08.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13add9b640 1 -- 172.21.15.45:0/607476409 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a00ac410 con 0x7f13b006f880 2023-10-03T19:20:08.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13add9b640 1 -- 172.21.15.45:0/607476409 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a00ac570 con 0x7f13b006f880 2023-10-03T19:20:08.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13add9b640 1 -- 172.21.15.45:0/607476409 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a00ac900 con 0x7f13b006f880 2023-10-03T19:20:08.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13b4ac9640 1 -- 172.21.15.45:0/607476409 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f13b006f880 msgr2=0x7f13b00a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:08.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13b4ac9640 1 --2- 172.21.15.45:0/607476409 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f13b006f880 0x7f13b00a5940 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f13a00097c0 tx=0x7f13a001c450 comp rx=0 tx=0).stop 2023-10-03T19:20:08.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13b4ac9640 1 -- 172.21.15.45:0/607476409 shutdown_connections 2023-10-03T19:20:08.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13b4ac9640 1 --2- 172.21.15.45:0/607476409 >> v2:172.21.15.79:3300/0 conn(0x7f13b014f510 0x7f13b014b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:08.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13b4ac9640 1 --2- 172.21.15.45:0/607476409 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f13b006f880 0x7f13b00a5940 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:08.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13b4ac9640 1 -- 172.21.15.45:0/607476409 >> 172.21.15.45:0/607476409 conn(0x7f13b00a20d0 msgr2=0x7f13b00a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:08.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13b4ac9640 1 -- 172.21.15.45:0/607476409 shutdown_connections 2023-10-03T19:20:08.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13b4ac9640 1 -- 172.21.15.45:0/607476409 wait complete. 2023-10-03T19:20:08.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13b4ac9640 1 Processor -- start 2023-10-03T19:20:08.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13b4ac9640 1 -- start start 2023-10-03T19:20:08.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13b4ac9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13b006f880 0x7f13b0143590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:08.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13b4ac9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f13b00bd9f0 0x7f13b0140430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:08.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13b4ac9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13b014f510 0x7f13b0140970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:08.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13b4ac9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b01e8f80 con 0x7f13b014f510 2023-10-03T19:20:08.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13b4ac9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b0148750 con 0x7f13b006f880 2023-10-03T19:20:08.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13b4ac9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b0140eb0 con 0x7f13b00bd9f0 2023-10-03T19:20:08.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13aed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13b014f510 0x7f13b0140970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:08.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13aed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13b014f510 0x7f13b0140970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58332/0 (socket says 172.21.15.45:58332) 2023-10-03T19:20:08.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13aed9d640 1 -- 172.21.15.45:0/3181520261 learned_addr learned my addr 172.21.15.45:0/3181520261 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:08.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13ae59c640 1 --2- 172.21.15.45:0/3181520261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13b006f880 0x7f13b0143590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:08.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13a7fff640 1 --2- 172.21.15.45:0/3181520261 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f13b00bd9f0 0x7f13b0140430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:08.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13aed9d640 1 -- 172.21.15.45:0/3181520261 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f13b00bd9f0 msgr2=0x7f13b0140430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:08.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13aed9d640 1 --2- 172.21.15.45:0/3181520261 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f13b00bd9f0 0x7f13b0140430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:08.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13aed9d640 1 -- 172.21.15.45:0/3181520261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13b006f880 msgr2=0x7f13b0143590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:08.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13aed9d640 1 --2- 172.21.15.45:0/3181520261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13b006f880 0x7f13b0143590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:08.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13aed9d640 1 -- 172.21.15.45:0/3181520261 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1398009420 con 0x7f13b014f510 2023-10-03T19:20:08.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13ae59c640 1 --2- 172.21.15.45:0/3181520261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13b006f880 0x7f13b0143590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:20:08.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13aed9d640 1 --2- 172.21.15.45:0/3181520261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13b014f510 0x7f13b0140970 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f13a800cbc0 tx=0x7f13a800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:08.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.024+0000 7f13a6ffd640 1 -- 172.21.15.45:0/3181520261 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a800ad40 con 0x7f13b014f510 2023-10-03T19:20:08.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.028+0000 7f13a6ffd640 1 -- 172.21.15.45:0/3181520261 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a8012400 con 0x7f13b014f510 2023-10-03T19:20:08.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.028+0000 7f13a6ffd640 1 -- 172.21.15.45:0/3181520261 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a800aea0 con 0x7f13b014f510 2023-10-03T19:20:08.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.028+0000 7f13b4ac9640 1 -- 172.21.15.45:0/3181520261 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a0009420 con 0x7f13b014f510 2023-10-03T19:20:08.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.028+0000 7f13b4ac9640 1 -- 172.21.15.45:0/3181520261 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b006fc50 con 0x7f13b014f510 2023-10-03T19:20:08.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.028+0000 7f13b4ac9640 1 -- 172.21.15.45:0/3181520261 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b014bc70 con 0x7f13b014f510 2023-10-03T19:20:08.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.028+0000 7f13a6ffd640 1 -- 172.21.15.45:0/3181520261 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f13a8007070 con 0x7f13b014f510 2023-10-03T19:20:08.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.028+0000 7f13a6ffd640 1 --2- 172.21.15.45:0/3181520261 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1390066280 0x7f1390068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:08.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.028+0000 7f13a6ffd640 1 -- 172.21.15.45:0/3181520261 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f13a8083860 con 0x7f13b014f510 2023-10-03T19:20:08.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.028+0000 7f13ae59c640 1 --2- 172.21.15.45:0/3181520261 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1390066280 0x7f1390068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:08.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.028+0000 7f13ae59c640 1 --2- 172.21.15.45:0/3181520261 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1390066280 0x7f1390068730 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f13a00ae000 tx=0x7f13a0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:08.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.032+0000 7f13a6ffd640 1 -- 172.21.15.45:0/3181520261 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f13a8051090 con 0x7f13b014f510 2023-10-03T19:20:08.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.208+0000 7f13b4ac9640 1 -- 172.21.15.45:0/3181520261 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f13b0070a40 con 0x7f13b014f510 2023-10-03T19:20:08.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.220+0000 7f13a6ffd640 1 -- 172.21.15.45:0/3181520261 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f13a80546b0 con 0x7f13b014f510 2023-10-03T19:20:08.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.220+0000 7f13b4ac9640 1 -- 172.21.15.45:0/3181520261 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1390066280 msgr2=0x7f1390068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:08.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.220+0000 7f13b4ac9640 1 --2- 172.21.15.45:0/3181520261 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1390066280 0x7f1390068730 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f13a00ae000 tx=0x7f13a0008040 comp rx=0 tx=0).stop 2023-10-03T19:20:08.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.220+0000 7f13b4ac9640 1 -- 172.21.15.45:0/3181520261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13b014f510 msgr2=0x7f13b0140970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:08.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.220+0000 7f13b4ac9640 1 --2- 172.21.15.45:0/3181520261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13b014f510 0x7f13b0140970 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f13a800cbc0 tx=0x7f13a800a430 comp rx=0 tx=0).stop 2023-10-03T19:20:08.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.220+0000 7f13b4ac9640 1 -- 172.21.15.45:0/3181520261 shutdown_connections 2023-10-03T19:20:08.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.220+0000 7f13b4ac9640 1 --2- 172.21.15.45:0/3181520261 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1390066280 0x7f1390068730 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:08.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.220+0000 7f13b4ac9640 1 --2- 172.21.15.45:0/3181520261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13b014f510 0x7f13b0140970 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:08.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.220+0000 7f13b4ac9640 1 --2- 172.21.15.45:0/3181520261 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f13b00bd9f0 0x7f13b0140430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:08.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.220+0000 7f13b4ac9640 1 --2- 172.21.15.45:0/3181520261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13b006f880 0x7f13b0143590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:08.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.220+0000 7f13b4ac9640 1 -- 172.21.15.45:0/3181520261 >> 172.21.15.45:0/3181520261 conn(0x7f13b00a20d0 msgr2=0x7f13b00c0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:08.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.224+0000 7f13b4ac9640 1 -- 172.21.15.45:0/3181520261 shutdown_connections 2023-10-03T19:20:08.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.224+0000 7f13b4ac9640 1 -- 172.21.15.45:0/3181520261 wait complete. 2023-10-03T19:20:08.243 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_dump_dir' 2023-10-03T19:20:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e4c2dc640 1 Processor -- start 2023-10-03T19:20:08.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e4c2dc640 1 -- start start 2023-10-03T19:20:08.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e4c2dc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e4406e450 0x7f6e440bf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:08.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e4c2dc640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e440a6e60 con 0x7f6e440bf5f0 2023-10-03T19:20:08.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e4c2dc640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e440be300 con 0x7f6e4414bf90 2023-10-03T19:20:08.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e4c2dc640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e440bd810 con 0x7f6e4406e450 2023-10-03T19:20:08.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e4a879640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6e440bf5f0 0x7f6e44158f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43380/0 (socket says 172.21.15.45:43380) 2023-10-03T19:20:08.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e4a879640 1 -- 172.21.15.45:0/625429119 learned_addr learned my addr 172.21.15.45:0/625429119 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:20:08.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e49877640 1 --2- 172.21.15.45:0/625429119 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e4406e450 0x7f6e440bf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:08.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e49076640 1 -- 172.21.15.45:0/625429119 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3640670404 0 0) 0x7f6e440a6e60 con 0x7f6e440bf5f0 2023-10-03T19:20:08.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e49076640 1 -- 172.21.15.45:0/625429119 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e30003530 con 0x7f6e440bf5f0 2023-10-03T19:20:08.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e49076640 1 -- 172.21.15.45:0/625429119 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 253749059 0 0) 0x7f6e30003530 con 0x7f6e440bf5f0 2023-10-03T19:20:08.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e49076640 1 -- 172.21.15.45:0/625429119 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e4406e450 msgr2=0x7f6e440bf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:08.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e49076640 1 --2- 172.21.15.45:0/625429119 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e4406e450 0x7f6e440bf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:08.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e49076640 1 -- 172.21.15.45:0/625429119 >> v1:172.21.15.79:6789/0 conn(0x7f6e4414bf90 legacy=0x7f6e4406e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:08.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e49076640 1 -- 172.21.15.45:0/625429119 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4414c360 con 0x7f6e440bf5f0 2023-10-03T19:20:08.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e49076640 1 -- 172.21.15.45:0/625429119 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f6e3c001a00 con 0x7f6e440bf5f0 2023-10-03T19:20:08.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e49076640 1 -- 172.21.15.45:0/625429119 >> v1:172.21.15.45:6789/0 conn(0x7f6e440bf5f0 legacy=0x7f6e44158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:08.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e49076640 1 --2- 172.21.15.45:0/625429119 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e4406e450 0x7f6e300039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:08.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e49076640 1 --2- 172.21.15.45:0/625429119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e30003ef0 0x7f6e300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:08.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e49076640 1 --2- 172.21.15.45:0/625429119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e30004d10 0x7f6e30005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:08.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e49076640 1 -- 172.21.15.45:0/625429119 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e440bd810 con 0x7f6e30003ef0 2023-10-03T19:20:08.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e49076640 1 -- 172.21.15.45:0/625429119 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3000b9c0 con 0x7f6e30004d10 2023-10-03T19:20:08.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e49076640 1 -- 172.21.15.45:0/625429119 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3000bb80 con 0x7f6e4406e450 2023-10-03T19:20:08.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e49877640 1 --2- 172.21.15.45:0/625429119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e30003ef0 0x7f6e300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e4a078640 1 --2- 172.21.15.45:0/625429119 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e4406e450 0x7f6e300039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e4a879640 1 --2- 172.21.15.45:0/625429119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e30004d10 0x7f6e30005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e49877640 1 -- 172.21.15.45:0/625429119 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e4406e450 msgr2=0x7f6e300039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e49877640 1 --2- 172.21.15.45:0/625429119 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e4406e450 0x7f6e300039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e49877640 1 -- 172.21.15.45:0/625429119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e30004d10 msgr2=0x7f6e30005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e49877640 1 --2- 172.21.15.45:0/625429119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e30004d10 0x7f6e30005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e49877640 1 -- 172.21.15.45:0/625429119 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e30003530 con 0x7f6e30003ef0 2023-10-03T19:20:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.368+0000 7f6e4a879640 1 --2- 172.21.15.45:0/625429119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e30004d10 0x7f6e30005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:08.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.372+0000 7f6e49877640 1 --2- 172.21.15.45:0/625429119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e30003ef0 0x7f6e300047d0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009ae0 tx=0x7f6e3401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b55c2e7299d288 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:08.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.372+0000 7f6e49076640 1 -- 172.21.15.45:0/625429119 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e340a5640 con 0x7f6e30003ef0 2023-10-03T19:20:08.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.372+0000 7f6e49076640 1 -- 172.21.15.45:0/625429119 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e340a57a0 con 0x7f6e30003ef0 2023-10-03T19:20:08.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.372+0000 7f6e49076640 1 -- 172.21.15.45:0/625429119 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e340a5b50 con 0x7f6e30003ef0 2023-10-03T19:20:08.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.372+0000 7f6e4c2dc640 1 -- 172.21.15.45:0/625429119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e30003ef0 msgr2=0x7f6e300047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:08.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.372+0000 7f6e4c2dc640 1 --2- 172.21.15.45:0/625429119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e30003ef0 0x7f6e300047d0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009ae0 tx=0x7f6e3401ca50 comp rx=0 tx=0).stop 2023-10-03T19:20:08.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.372+0000 7f6e4a879640 1 -- 172.21.15.45:0/625429119 reap_dead start 2023-10-03T19:20:08.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.372+0000 7f6e4c2dc640 1 -- 172.21.15.45:0/625429119 shutdown_connections 2023-10-03T19:20:08.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.372+0000 7f6e4c2dc640 1 -- 172.21.15.45:0/625429119 >> 172.21.15.45:0/625429119 conn(0x7f6e4406bce0 msgr2=0x7f6e4406c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:08.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.372+0000 7f6e4c2dc640 1 -- 172.21.15.45:0/625429119 shutdown_connections 2023-10-03T19:20:08.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.372+0000 7f6e4c2dc640 1 -- 172.21.15.45:0/625429119 wait complete. 2023-10-03T19:20:08.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.372+0000 7f6e4c2dc640 1 Processor -- start 2023-10-03T19:20:08.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.372+0000 7f6e4c2dc640 1 -- start start 2023-10-03T19:20:08.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.372+0000 7f6e4c2dc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e30003ef0 0x7f6e4414a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:08.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.372+0000 7f6e4c2dc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e4414ad40 0x7f6e441e3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:08.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.376+0000 7f6e4c2dc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e441e74e0 0x7f6e441e38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:08.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.376+0000 7f6e4c2dc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e44148080 con 0x7f6e441e74e0 2023-10-03T19:20:08.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.376+0000 7f6e4c2dc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e440badd0 con 0x7f6e4414ad40 2023-10-03T19:20:08.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.376+0000 7f6e4c2dc640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e441e6a00 con 0x7f6e30003ef0 2023-10-03T19:20:08.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.376+0000 7f6e4a879640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e441e74e0 0x7f6e441e38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:08.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.376+0000 7f6e4a879640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e441e74e0 0x7f6e441e38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58346/0 (socket says 172.21.15.45:58346) 2023-10-03T19:20:08.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.376+0000 7f6e4a879640 1 -- 172.21.15.45:0/2612511482 learned_addr learned my addr 172.21.15.45:0/2612511482 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:08.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.376+0000 7f6e4a078640 1 --2- 172.21.15.45:0/2612511482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e30003ef0 0x7f6e4414a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:08.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.376+0000 7f6e49877640 1 --2- 172.21.15.45:0/2612511482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e4414ad40 0x7f6e441e3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:08.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.376+0000 7f6e4a879640 1 -- 172.21.15.45:0/2612511482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e30003ef0 msgr2=0x7f6e4414a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:08.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.376+0000 7f6e4a879640 1 --2- 172.21.15.45:0/2612511482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e30003ef0 0x7f6e4414a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:08.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.376+0000 7f6e4a879640 1 -- 172.21.15.45:0/2612511482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e4414ad40 msgr2=0x7f6e441e3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:08.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.376+0000 7f6e4a879640 1 --2- 172.21.15.45:0/2612511482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e4414ad40 0x7f6e441e3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:08.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.376+0000 7f6e4a879640 1 -- 172.21.15.45:0/2612511482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e440bd9f0 con 0x7f6e441e74e0 2023-10-03T19:20:08.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.376+0000 7f6e4a078640 1 --2- 172.21.15.45:0/2612511482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e30003ef0 0x7f6e4414a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:20:08.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.376+0000 7f6e4a879640 1 --2- 172.21.15.45:0/2612511482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e441e74e0 0x7f6e441e38a0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f6e440bfd30 tx=0x7f6e3c002030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:08.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.376+0000 7f6e3affd640 1 -- 172.21.15.45:0/2612511482 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c007190 con 0x7f6e441e74e0 2023-10-03T19:20:08.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.376+0000 7f6e3affd640 1 -- 172.21.15.45:0/2612511482 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3c0072f0 con 0x7f6e441e74e0 2023-10-03T19:20:08.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.376+0000 7f6e4c2dc640 1 -- 172.21.15.45:0/2612511482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e440bd280 con 0x7f6e441e74e0 2023-10-03T19:20:08.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.376+0000 7f6e3affd640 1 -- 172.21.15.45:0/2612511482 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c007680 con 0x7f6e441e74e0 2023-10-03T19:20:08.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.376+0000 7f6e4c2dc640 1 -- 172.21.15.45:0/2612511482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e440bd530 con 0x7f6e441e74e0 2023-10-03T19:20:08.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.376+0000 7f6e4c2dc640 1 -- 172.21.15.45:0/2612511482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e4404de80 con 0x7f6e441e74e0 2023-10-03T19:20:08.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.376+0000 7f6e3affd640 1 -- 172.21.15.45:0/2612511482 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6e3c0077e0 con 0x7f6e441e74e0 2023-10-03T19:20:08.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.376+0000 7f6e3affd640 1 --2- 172.21.15.45:0/2612511482 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6e28066280 0x7f6e28068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:08.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.376+0000 7f6e3affd640 1 -- 172.21.15.45:0/2612511482 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f6e3c0836d0 con 0x7f6e441e74e0 2023-10-03T19:20:08.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.376+0000 7f6e4a078640 1 --2- 172.21.15.45:0/2612511482 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6e28066280 0x7f6e28068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:08.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.376+0000 7f6e4a078640 1 --2- 172.21.15.45:0/2612511482 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6e28066280 0x7f6e28068730 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f6e40000c10 tx=0x7f6e4000a980 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:08.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.380+0000 7f6e3affd640 1 -- 172.21.15.45:0/2612511482 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6e3c050ee0 con 0x7f6e441e74e0 2023-10-03T19:20:08.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.592+0000 7f6e4c2dc640 1 -- 172.21.15.45:0/2612511482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_dir"]} v 0) v1 -- 0x7f6e440bfdc0 con 0x7f6e441e74e0 2023-10-03T19:20:08.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.864+0000 7f6e3affd640 1 -- 172.21.15.45:0/2612511482 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_dir"]}]=0 v358) v1 ==== 124+0+0 (secure 0 0 0) 0x7f6e3c054500 con 0x7f6e441e74e0 2023-10-03T19:20:08.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.868+0000 7f6e4c2dc640 1 -- 172.21.15.45:0/2612511482 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6e28066280 msgr2=0x7f6e28068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:08.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.868+0000 7f6e4c2dc640 1 --2- 172.21.15.45:0/2612511482 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6e28066280 0x7f6e28068730 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f6e40000c10 tx=0x7f6e4000a980 comp rx=0 tx=0).stop 2023-10-03T19:20:08.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.868+0000 7f6e4c2dc640 1 -- 172.21.15.45:0/2612511482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e441e74e0 msgr2=0x7f6e441e38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:08.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.868+0000 7f6e4c2dc640 1 --2- 172.21.15.45:0/2612511482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e441e74e0 0x7f6e441e38a0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f6e440bfd30 tx=0x7f6e3c002030 comp rx=0 tx=0).stop 2023-10-03T19:20:08.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.868+0000 7f6e4c2dc640 1 -- 172.21.15.45:0/2612511482 shutdown_connections 2023-10-03T19:20:08.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.868+0000 7f6e4c2dc640 1 --2- 172.21.15.45:0/2612511482 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6e28066280 0x7f6e28068730 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:08.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.868+0000 7f6e4c2dc640 1 --2- 172.21.15.45:0/2612511482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e441e74e0 0x7f6e441e38a0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:08.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.868+0000 7f6e4c2dc640 1 --2- 172.21.15.45:0/2612511482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e4414ad40 0x7f6e441e3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:08.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.868+0000 7f6e4c2dc640 1 --2- 172.21.15.45:0/2612511482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e30003ef0 0x7f6e4414a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:08.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.868+0000 7f6e4c2dc640 1 -- 172.21.15.45:0/2612511482 >> 172.21.15.45:0/2612511482 conn(0x7f6e4406bce0 msgr2=0x7f6e44148be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:08.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.868+0000 7f6e4c2dc640 1 -- 172.21.15.45:0/2612511482 shutdown_connections 2023-10-03T19:20:08.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:08.868+0000 7f6e4c2dc640 1 -- 172.21.15.45:0/2612511482 wait complete. 2023-10-03T19:20:08.894 INFO:tasks.cephfs_test_runner:test_dump_dir (tasks.cephfs.test_misc.TestMisc) ... ok 2023-10-03T19:20:08.894 INFO:tasks.cephfs_test_runner:Starting test: test_dump_inmemory_log_on_client_eviction (tasks.cephfs.test_misc.TestMisc) That the in-memory logs are dumped during a client eviction event. 2023-10-03T19:20:08.894 INFO:tasks.cephfs_test_runner:test_dump_inmemory_log_on_client_eviction (tasks.cephfs.test_misc.TestMisc) 2023-10-03T19:20:08.895 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inmemory_log_on_client_eviction' 2023-10-03T19:20:09.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.020+0000 7ff028e69640 1 Processor -- start 2023-10-03T19:20:09.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.020+0000 7ff028e69640 1 -- start start 2023-10-03T19:20:09.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.024+0000 7ff028e69640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff0240c2790 0x7ff0241528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:09.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.024+0000 7ff028e69640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff02406b2d0 con 0x7ff02414f240 2023-10-03T19:20:09.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.024+0000 7ff028e69640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0240a3c60 con 0x7ff0240bb1d0 2023-10-03T19:20:09.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.024+0000 7ff028e69640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff02406b640 con 0x7ff0240c2790 2023-10-03T19:20:09.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.024+0000 7ff021d9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff0240c2790 0x7ff0241528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:09.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.024+0000 7ff02259c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff02414f240 0x7ff0240c0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43390/0 (socket says 172.21.15.45:43390) 2023-10-03T19:20:09.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.024+0000 7ff021d9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff0240c2790 0x7ff0241528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58362/0 (socket says 172.21.15.45:58362) 2023-10-03T19:20:09.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.024+0000 7ff02259c640 1 -- 172.21.15.45:0/3681173762 learned_addr learned my addr 172.21.15.45:0/3681173762 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:20:09.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.024+0000 7ff021d9b640 1 -- 172.21.15.45:0/3681173762 >> v1:172.21.15.79:6789/0 conn(0x7ff0240bb1d0 legacy=0x7ff0240c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:09.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.024+0000 7ff021d9b640 1 -- 172.21.15.45:0/3681173762 >> v1:172.21.15.45:6789/0 conn(0x7ff02414f240 legacy=0x7ff0240c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:09.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.024+0000 7ff02159a640 1 -- 172.21.15.45:0/3681173762 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3450911387 0 0) 0x7ff02406b2d0 con 0x7ff02414f240 2023-10-03T19:20:09.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.024+0000 7ff021d9b640 1 -- 172.21.15.45:0/3681173762 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0240c19b0 con 0x7ff0240c2790 2023-10-03T19:20:09.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.024+0000 7ff021d9b640 1 --2- 172.21.15.45:0/3681173762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0240c2790 0x7ff0241528d0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7ff0180097a0 tx=0x7ff01801ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d39c35af1aa37b22 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:09.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.024+0000 7ff02159a640 1 -- 172.21.15.45:0/3681173762 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0180a8910 con 0x7ff0240c2790 2023-10-03T19:20:09.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.024+0000 7ff02159a640 1 -- 172.21.15.45:0/3681173762 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0180a8a70 con 0x7ff0240c2790 2023-10-03T19:20:09.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.024+0000 7ff02159a640 1 -- 172.21.15.45:0/3681173762 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0180a8e00 con 0x7ff0240c2790 2023-10-03T19:20:09.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff028e69640 1 -- 172.21.15.45:0/3681173762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0240c2790 msgr2=0x7ff0241528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:09.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff028e69640 1 --2- 172.21.15.45:0/3681173762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0240c2790 0x7ff0241528d0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7ff0180097a0 tx=0x7ff01801ec10 comp rx=0 tx=0).stop 2023-10-03T19:20:09.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff028e69640 1 -- 172.21.15.45:0/3681173762 shutdown_connections 2023-10-03T19:20:09.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff028e69640 1 --2- 172.21.15.45:0/3681173762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0240c2790 0x7ff0241528d0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:09.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff028e69640 1 -- 172.21.15.45:0/3681173762 >> 172.21.15.45:0/3681173762 conn(0x7ff0240a64a0 msgr2=0x7ff0240a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:09.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff028e69640 1 -- 172.21.15.45:0/3681173762 shutdown_connections 2023-10-03T19:20:09.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff028e69640 1 -- 172.21.15.45:0/3681173762 wait complete. 2023-10-03T19:20:09.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff028e69640 1 Processor -- start 2023-10-03T19:20:09.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff028e69640 1 -- start start 2023-10-03T19:20:09.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff028e69640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0240bb1d0 0x7ff0240c3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:09.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff028e69640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0240c2790 0x7ff0240bdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:09.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff028e69640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff02414f240 0x7ff0241e3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:09.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff028e69640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0240bd620 con 0x7ff0240c2790 2023-10-03T19:20:09.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff028e69640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0240c40a0 con 0x7ff0240bb1d0 2023-10-03T19:20:09.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff028e69640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0240be530 con 0x7ff02414f240 2023-10-03T19:20:09.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff021d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0240c2790 0x7ff0240bdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:09.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff021d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0240c2790 0x7ff0240bdff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58368/0 (socket says 172.21.15.45:58368) 2023-10-03T19:20:09.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff021d9b640 1 -- 172.21.15.45:0/863776782 learned_addr learned my addr 172.21.15.45:0/863776782 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:09.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff02259c640 1 --2- 172.21.15.45:0/863776782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0240bb1d0 0x7ff0240c3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:09.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff022d9d640 1 --2- 172.21.15.45:0/863776782 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff02414f240 0x7ff0241e3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:09.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff021d9b640 1 -- 172.21.15.45:0/863776782 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff02414f240 msgr2=0x7ff0241e3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:09.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff021d9b640 1 --2- 172.21.15.45:0/863776782 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff02414f240 0x7ff0241e3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:09.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff021d9b640 1 -- 172.21.15.45:0/863776782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0240bb1d0 msgr2=0x7ff0240c3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:09.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff021d9b640 1 --2- 172.21.15.45:0/863776782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0240bb1d0 0x7ff0240c3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:09.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff021d9b640 1 -- 172.21.15.45:0/863776782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0180093b0 con 0x7ff0240c2790 2023-10-03T19:20:09.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff022d9d640 1 --2- 172.21.15.45:0/863776782 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff02414f240 0x7ff0241e3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:09.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff02259c640 1 --2- 172.21.15.45:0/863776782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0240bb1d0 0x7ff0240c3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:09.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff021d9b640 1 --2- 172.21.15.45:0/863776782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0240c2790 0x7ff0240bdff0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7ff0180b3040 tx=0x7ff01801b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:09.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff012ffd640 1 -- 172.21.15.45:0/863776782 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff018005ba0 con 0x7ff0240c2790 2023-10-03T19:20:09.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff012ffd640 1 -- 172.21.15.45:0/863776782 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff018005d20 con 0x7ff0240c2790 2023-10-03T19:20:09.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff012ffd640 1 -- 172.21.15.45:0/863776782 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0180b0a10 con 0x7ff0240c2790 2023-10-03T19:20:09.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff028e69640 1 -- 172.21.15.45:0/863776782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0240a3f40 con 0x7ff0240c2790 2023-10-03T19:20:09.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.028+0000 7ff028e69640 1 -- 172.21.15.45:0/863776782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff02414e740 con 0x7ff0240c2790 2023-10-03T19:20:09.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.032+0000 7ff028e69640 1 -- 172.21.15.45:0/863776782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff02414f610 con 0x7ff0240c2790 2023-10-03T19:20:09.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.032+0000 7ff012ffd640 1 -- 172.21.15.45:0/863776782 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff0180b7040 con 0x7ff0240c2790 2023-10-03T19:20:09.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.032+0000 7ff012ffd640 1 --2- 172.21.15.45:0/863776782 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff004066280 0x7ff004068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:09.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.032+0000 7ff012ffd640 1 -- 172.21.15.45:0/863776782 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ff0181205e0 con 0x7ff0240c2790 2023-10-03T19:20:09.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.032+0000 7ff02259c640 1 --2- 172.21.15.45:0/863776782 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff004066280 0x7ff004068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:09.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.032+0000 7ff02259c640 1 --2- 172.21.15.45:0/863776782 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff004066280 0x7ff004068730 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff0140016c0 tx=0x7ff014009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:09.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.036+0000 7ff012ffd640 1 -- 172.21.15.45:0/863776782 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff0180edd70 con 0x7ff0240c2790 2023-10-03T19:20:09.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.248+0000 7ff028e69640 1 -- 172.21.15.45:0/863776782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inmemory_log_on_client_eviction"]} v 0) v1 -- 0x7ff0240bd7d0 con 0x7ff0240c2790 2023-10-03T19:20:09.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.868+0000 7ff012ffd640 1 -- 172.21.15.45:0/863776782 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inmemory_log_on_client_eviction"]}]=0 v359) v1 ==== 155+0+0 (secure 0 0 0) 0x7ff0240bd7d0 con 0x7ff0240c2790 2023-10-03T19:20:09.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.872+0000 7ff028e69640 1 -- 172.21.15.45:0/863776782 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff004066280 msgr2=0x7ff004068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:09.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.872+0000 7ff028e69640 1 --2- 172.21.15.45:0/863776782 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff004066280 0x7ff004068730 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff0140016c0 tx=0x7ff014009040 comp rx=0 tx=0).stop 2023-10-03T19:20:09.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.872+0000 7ff028e69640 1 -- 172.21.15.45:0/863776782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0240c2790 msgr2=0x7ff0240bdff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:09.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.872+0000 7ff028e69640 1 --2- 172.21.15.45:0/863776782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0240c2790 0x7ff0240bdff0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7ff0180b3040 tx=0x7ff01801b9b0 comp rx=0 tx=0).stop 2023-10-03T19:20:09.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.872+0000 7ff028e69640 1 -- 172.21.15.45:0/863776782 shutdown_connections 2023-10-03T19:20:09.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.872+0000 7ff028e69640 1 --2- 172.21.15.45:0/863776782 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff004066280 0x7ff004068730 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:09.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.872+0000 7ff028e69640 1 --2- 172.21.15.45:0/863776782 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff02414f240 0x7ff0241e3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:09.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.872+0000 7ff028e69640 1 --2- 172.21.15.45:0/863776782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0240c2790 0x7ff0240bdff0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:09.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.872+0000 7ff028e69640 1 --2- 172.21.15.45:0/863776782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0240bb1d0 0x7ff0240c3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:09.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.872+0000 7ff028e69640 1 -- 172.21.15.45:0/863776782 >> 172.21.15.45:0/863776782 conn(0x7ff0240a64a0 msgr2=0x7ff0240a6870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:09.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.872+0000 7ff028e69640 1 -- 172.21.15.45:0/863776782 shutdown_connections 2023-10-03T19:20:09.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:09.872+0000 7ff028e69640 1 -- 172.21.15.45:0/863776782 wait complete. 2023-10-03T19:20:09.894 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-03T19:20:10.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f9268723640 1 Processor -- start 2023-10-03T19:20:10.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f9268723640 1 -- start start 2023-10-03T19:20:10.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f9268723640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92600bd640 0x7f9260150130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:10.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f9268723640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92600bdac0 con 0x7f92600c07f0 2023-10-03T19:20:10.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f9268723640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92600c14c0 con 0x7f92600c19b0 2023-10-03T19:20:10.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f9268723640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92600be420 con 0x7f92600bd640 2023-10-03T19:20:10.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f92664bf640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f92600c07f0 0x7f926014bab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43402/0 (socket says 172.21.15.45:43402) 2023-10-03T19:20:10.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f92664bf640 1 -- 172.21.15.45:0/129161141 learned_addr learned my addr 172.21.15.45:0/129161141 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:20:10.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f9266cc0640 1 --2- 172.21.15.45:0/129161141 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92600bd640 0x7f9260150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:10.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f92654bd640 1 -- 172.21.15.45:0/129161141 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3984881158 0 0) 0x7f925c001120 con 0x7f92600c07f0 2023-10-03T19:20:10.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f92654bd640 1 -- 172.21.15.45:0/129161141 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f924c003530 con 0x7f92600c07f0 2023-10-03T19:20:10.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f92654bd640 1 -- 172.21.15.45:0/129161141 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3049507263 0 0) 0x7f924c003530 con 0x7f92600c07f0 2023-10-03T19:20:10.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f92654bd640 1 -- 172.21.15.45:0/129161141 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92600bd640 msgr2=0x7f9260150130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:10.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f92654bd640 1 --2- 172.21.15.45:0/129161141 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92600bd640 0x7f9260150130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:10.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f92654bd640 1 -- 172.21.15.45:0/129161141 >> v1:172.21.15.79:6789/0 conn(0x7f92600c19b0 legacy=0x7f926014fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:10.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f92654bd640 1 -- 172.21.15.45:0/129161141 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92600a1f80 con 0x7f92600c07f0 2023-10-03T19:20:10.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f92654bd640 1 -- 172.21.15.45:0/129161141 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f925c001810 con 0x7f92600c07f0 2023-10-03T19:20:10.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f92654bd640 1 -- 172.21.15.45:0/129161141 >> v1:172.21.15.45:6789/0 conn(0x7f92600c07f0 legacy=0x7f926014bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:10.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f92654bd640 1 --2- 172.21.15.45:0/129161141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f924c0039b0 0x7f924c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:10.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f92654bd640 1 --2- 172.21.15.45:0/129161141 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92600bd640 0x7f924c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:10.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f92654bd640 1 --2- 172.21.15.45:0/129161141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f924c004d10 0x7f924c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:10.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f92654bd640 1 -- 172.21.15.45:0/129161141 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924c00ba40 con 0x7f924c004d10 2023-10-03T19:20:10.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f92654bd640 1 -- 172.21.15.45:0/129161141 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924c00bb80 con 0x7f924c0039b0 2023-10-03T19:20:10.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f92654bd640 1 -- 172.21.15.45:0/129161141 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f924c00bd10 con 0x7f92600bd640 2023-10-03T19:20:10.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f9266cc0640 1 --2- 172.21.15.45:0/129161141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f924c004d10 0x7f924c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:10.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f92664bf640 1 --2- 172.21.15.45:0/129161141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f924c0039b0 0x7f924c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:10.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f9265cbe640 1 --2- 172.21.15.45:0/129161141 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92600bd640 0x7f924c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:10.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f9266cc0640 1 -- 172.21.15.45:0/129161141 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92600bd640 msgr2=0x7f924c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:10.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f9266cc0640 1 --2- 172.21.15.45:0/129161141 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92600bd640 0x7f924c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:10.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f9266cc0640 1 -- 172.21.15.45:0/129161141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f924c0039b0 msgr2=0x7f924c003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:10.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f9266cc0640 1 --2- 172.21.15.45:0/129161141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f924c0039b0 0x7f924c003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:10.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f9266cc0640 1 -- 172.21.15.45:0/129161141 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f924c003530 con 0x7f924c004d10 2023-10-03T19:20:10.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.024+0000 7f92664bf640 1 --2- 172.21.15.45:0/129161141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f924c0039b0 0x7f924c003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:20:10.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.028+0000 7f9266cc0640 1 --2- 172.21.15.45:0/129161141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f924c004d10 0x7f924c005180 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f9258009fc0 tx=0x7f925801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e284f032815b0096 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:10.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.028+0000 7f92654bd640 1 -- 172.21.15.45:0/129161141 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92580a5b40 con 0x7f924c004d10 2023-10-03T19:20:10.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.028+0000 7f92654bd640 1 -- 172.21.15.45:0/129161141 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925800f040 con 0x7f924c004d10 2023-10-03T19:20:10.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.028+0000 7f92654bd640 1 -- 172.21.15.45:0/129161141 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92580ad440 con 0x7f924c004d10 2023-10-03T19:20:10.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.028+0000 7f9268723640 1 -- 172.21.15.45:0/129161141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f924c004d10 msgr2=0x7f924c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:10.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.028+0000 7f9268723640 1 --2- 172.21.15.45:0/129161141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f924c004d10 0x7f924c005180 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f9258009fc0 tx=0x7f925801cc60 comp rx=0 tx=0).stop 2023-10-03T19:20:10.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.028+0000 7f9266cc0640 1 -- 172.21.15.45:0/129161141 reap_dead start 2023-10-03T19:20:10.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.028+0000 7f9268723640 1 -- 172.21.15.45:0/129161141 shutdown_connections 2023-10-03T19:20:10.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.028+0000 7f9268723640 1 -- 172.21.15.45:0/129161141 >> 172.21.15.45:0/129161141 conn(0x7f92600a4260 msgr2=0x7f92600a4660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:10.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.028+0000 7f9268723640 1 -- 172.21.15.45:0/129161141 shutdown_connections 2023-10-03T19:20:10.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.028+0000 7f9268723640 1 -- 172.21.15.45:0/129161141 wait complete. 2023-10-03T19:20:10.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.028+0000 7f9268723640 1 Processor -- start 2023-10-03T19:20:10.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.028+0000 7f9268723640 1 -- start start 2023-10-03T19:20:10.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.032+0000 7f9268723640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f924c004d10 0x7f92600a6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:10.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.032+0000 7f9268723640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9260155190 0x7f9260151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:10.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.032+0000 7f9268723640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9260152060 0x7f9260147460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:10.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.032+0000 7f9268723640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9260149a90 con 0x7f924c004d10 2023-10-03T19:20:10.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.032+0000 7f9268723640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92601545e0 con 0x7f9260152060 2023-10-03T19:20:10.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.032+0000 7f9268723640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92601540f0 con 0x7f9260155190 2023-10-03T19:20:10.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.032+0000 7f92664bf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f924c004d10 0x7f92600a6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:10.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.032+0000 7f92664bf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f924c004d10 0x7f92600a6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58392/0 (socket says 172.21.15.45:58392) 2023-10-03T19:20:10.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.032+0000 7f92664bf640 1 -- 172.21.15.45:0/57447729 learned_addr learned my addr 172.21.15.45:0/57447729 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:10.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.032+0000 7f9266cc0640 1 --2- 172.21.15.45:0/57447729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9260152060 0x7f9260147460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:10.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.032+0000 7f9265cbe640 1 --2- 172.21.15.45:0/57447729 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9260155190 0x7f9260151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:10.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.032+0000 7f92664bf640 1 -- 172.21.15.45:0/57447729 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9260155190 msgr2=0x7f9260151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:10.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.032+0000 7f92664bf640 1 --2- 172.21.15.45:0/57447729 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9260155190 0x7f9260151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:10.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.032+0000 7f92664bf640 1 -- 172.21.15.45:0/57447729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9260152060 msgr2=0x7f9260147460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:10.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.032+0000 7f92664bf640 1 --2- 172.21.15.45:0/57447729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9260152060 0x7f9260147460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:10.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.032+0000 7f92664bf640 1 -- 172.21.15.45:0/57447729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92600c0d50 con 0x7f924c004d10 2023-10-03T19:20:10.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.032+0000 7f9265cbe640 1 --2- 172.21.15.45:0/57447729 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9260155190 0x7f9260151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:10.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.032+0000 7f92664bf640 1 --2- 172.21.15.45:0/57447729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f924c004d10 0x7f92600a6780 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f925c0072b0 tx=0x7f925c007770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:10.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.032+0000 7f9256ffd640 1 -- 172.21.15.45:0/57447729 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c00e6e0 con 0x7f924c004d10 2023-10-03T19:20:10.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.032+0000 7f9256ffd640 1 -- 172.21.15.45:0/57447729 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925c00e840 con 0x7f924c004d10 2023-10-03T19:20:10.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.032+0000 7f9268723640 1 -- 172.21.15.45:0/57447729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92600c0bc0 con 0x7f924c004d10 2023-10-03T19:20:10.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.032+0000 7f9256ffd640 1 -- 172.21.15.45:0/57447729 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c00ebb0 con 0x7f924c004d10 2023-10-03T19:20:10.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.032+0000 7f9268723640 1 -- 172.21.15.45:0/57447729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9260150540 con 0x7f924c004d10 2023-10-03T19:20:10.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.032+0000 7f9268723640 1 -- 172.21.15.45:0/57447729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f926004de80 con 0x7f924c004d10 2023-10-03T19:20:10.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.032+0000 7f9256ffd640 1 -- 172.21.15.45:0/57447729 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f925c00ed10 con 0x7f924c004d10 2023-10-03T19:20:10.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.032+0000 7f9256ffd640 1 --2- 172.21.15.45:0/57447729 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f92440662b0 0x7f9244068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:10.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.032+0000 7f9256ffd640 1 -- 172.21.15.45:0/57447729 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f925c083850 con 0x7f924c004d10 2023-10-03T19:20:10.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.032+0000 7f9265cbe640 1 --2- 172.21.15.45:0/57447729 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f92440662b0 0x7f9244068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:10.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.036+0000 7f9265cbe640 1 --2- 172.21.15.45:0/57447729 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f92440662b0 0x7f9244068760 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f92600bf520 tx=0x7f9250009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:10.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.036+0000 7f9256ffd640 1 -- 172.21.15.45:0/57447729 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f925c054af0 con 0x7f924c004d10 2023-10-03T19:20:10.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.192+0000 7f9268723640 1 -- 172.21.15.45:0/57447729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f92600bdac0 con 0x7f924c004d10 2023-10-03T19:20:10.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.200+0000 7f9256ffd640 1 -- 172.21.15.45:0/57447729 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f92600bdac0 con 0x7f924c004d10 2023-10-03T19:20:10.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.204+0000 7f9268723640 1 -- 172.21.15.45:0/57447729 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f92440662b0 msgr2=0x7f9244068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:10.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.204+0000 7f9268723640 1 --2- 172.21.15.45:0/57447729 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f92440662b0 0x7f9244068760 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f92600bf520 tx=0x7f9250009040 comp rx=0 tx=0).stop 2023-10-03T19:20:10.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.204+0000 7f9268723640 1 -- 172.21.15.45:0/57447729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f924c004d10 msgr2=0x7f92600a6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:10.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.204+0000 7f9268723640 1 --2- 172.21.15.45:0/57447729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f924c004d10 0x7f92600a6780 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f925c0072b0 tx=0x7f925c007770 comp rx=0 tx=0).stop 2023-10-03T19:20:10.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.204+0000 7f9268723640 1 -- 172.21.15.45:0/57447729 shutdown_connections 2023-10-03T19:20:10.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.204+0000 7f9268723640 1 --2- 172.21.15.45:0/57447729 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f92440662b0 0x7f9244068760 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:10.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.204+0000 7f9268723640 1 --2- 172.21.15.45:0/57447729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9260152060 0x7f9260147460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:10.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.204+0000 7f9268723640 1 --2- 172.21.15.45:0/57447729 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9260155190 0x7f9260151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:10.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.204+0000 7f9268723640 1 --2- 172.21.15.45:0/57447729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f924c004d10 0x7f92600a6780 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:10.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.204+0000 7f9268723640 1 -- 172.21.15.45:0/57447729 >> 172.21.15.45:0/57447729 conn(0x7f92600a4260 msgr2=0x7f926014e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:10.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.204+0000 7f9268723640 1 -- 172.21.15.45:0/57447729 shutdown_connections 2023-10-03T19:20:10.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.204+0000 7f9268723640 1 -- 172.21.15.45:0/57447729 wait complete. 2023-10-03T19:20:10.223 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-03T19:20:10.223 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:20:10.275 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:20:10.320 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:20:10.362 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:20:10.422 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-03T19:20:10.422 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:20:10.422 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:20:10.428 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336540k,nr_inodes=4084135,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16206 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-10-03T19:20:10.428 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-03T19:20:10.428 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:20:10.434 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336540k,nr_inodes=4084135,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=22607 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-10-03T19:20:10.434 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-10-03T19:20:10.434 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:20:10.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.560+0000 7f16643a9640 1 Processor -- start 2023-10-03T19:20:10.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.560+0000 7f16643a9640 1 -- start start 2023-10-03T19:20:10.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.564+0000 7f16643a9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f165c06d6b0 0x7f165c14bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:10.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.564+0000 7f16643a9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f165c0bdf20 0x7f165c0be360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:10.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.564+0000 7f16643a9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f165c148d60 con 0x7f165c0ba3d0 2023-10-03T19:20:10.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.564+0000 7f16643a9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f165c0a6f40 con 0x7f165c06d6b0 2023-10-03T19:20:10.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.564+0000 7f16643a9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165c14c2a0 con 0x7f165c0bdf20 2023-10-03T19:20:10.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.564+0000 7f1661944640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f165c06d6b0 0x7f165c14bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:10.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.564+0000 7f1661944640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f165c06d6b0 0x7f165c14bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58404/0 (socket says 172.21.15.45:58404) 2023-10-03T19:20:10.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.564+0000 7f1661944640 1 -- 172.21.15.45:0/523756250 learned_addr learned my addr 172.21.15.45:0/523756250 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:10.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.564+0000 7f1662946640 1 --2- 172.21.15.45:0/523756250 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f165c0bdf20 0x7f165c0be360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:10.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.564+0000 7f1661944640 1 -- 172.21.15.45:0/523756250 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f165c0bdf20 msgr2=0x7f165c0be360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:10.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.564+0000 7f1661944640 1 --2- 172.21.15.45:0/523756250 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f165c0bdf20 0x7f165c0be360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:10.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.564+0000 7f1661944640 1 -- 172.21.15.45:0/523756250 >> v1:172.21.15.79:6789/0 conn(0x7f165c0ba3d0 legacy=0x7f165c14e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:10.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.564+0000 7f1661944640 1 -- 172.21.15.45:0/523756250 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165c0ba7a0 con 0x7f165c06d6b0 2023-10-03T19:20:10.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.564+0000 7f1661944640 1 --2- 172.21.15.45:0/523756250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165c06d6b0 0x7f165c14bd60 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f164c009870 tx=0x7f164c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb2b0a29a0dee11 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:10.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.564+0000 7f1661143640 1 -- 172.21.15.45:0/523756250 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c0ab600 con 0x7f165c06d6b0 2023-10-03T19:20:10.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.564+0000 7f1661143640 1 -- 172.21.15.45:0/523756250 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164c0a7050 con 0x7f165c06d6b0 2023-10-03T19:20:10.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.564+0000 7f1661143640 1 -- 172.21.15.45:0/523756250 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c0ab980 con 0x7f165c06d6b0 2023-10-03T19:20:10.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f16643a9640 1 -- 172.21.15.45:0/523756250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165c06d6b0 msgr2=0x7f165c14bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:10.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f16643a9640 1 --2- 172.21.15.45:0/523756250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165c06d6b0 0x7f165c14bd60 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f164c009870 tx=0x7f164c01c470 comp rx=0 tx=0).stop 2023-10-03T19:20:10.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f16643a9640 1 -- 172.21.15.45:0/523756250 shutdown_connections 2023-10-03T19:20:10.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f16643a9640 1 --2- 172.21.15.45:0/523756250 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f165c0bdf20 0x7f165c0be360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:10.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f16643a9640 1 --2- 172.21.15.45:0/523756250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165c06d6b0 0x7f165c14bd60 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:10.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f16643a9640 1 -- 172.21.15.45:0/523756250 >> 172.21.15.45:0/523756250 conn(0x7f165c0c1a20 msgr2=0x7f165c0bd810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:10.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f16643a9640 1 -- 172.21.15.45:0/523756250 shutdown_connections 2023-10-03T19:20:10.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f16643a9640 1 -- 172.21.15.45:0/523756250 wait complete. 2023-10-03T19:20:10.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f16643a9640 1 Processor -- start 2023-10-03T19:20:10.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f16643a9640 1 -- start start 2023-10-03T19:20:10.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f16643a9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f165c06d6b0 0x7f165c0bb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:10.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f16643a9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165c0ba3d0 0x7f165c1e3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:10.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f16643a9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f165c0bdf20 0x7f165c1e4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:10.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f16643a9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165c143a40 con 0x7f165c0ba3d0 2023-10-03T19:20:10.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f16643a9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165c1e49d0 con 0x7f165c06d6b0 2023-10-03T19:20:10.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f16643a9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165c143fc0 con 0x7f165c0bdf20 2023-10-03T19:20:10.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f1661944640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165c0ba3d0 0x7f165c1e3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:10.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f1661944640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165c0ba3d0 0x7f165c1e3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58416/0 (socket says 172.21.15.45:58416) 2023-10-03T19:20:10.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f1661944640 1 -- 172.21.15.45:0/3648215108 learned_addr learned my addr 172.21.15.45:0/3648215108 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:10.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f1662946640 1 --2- 172.21.15.45:0/3648215108 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f165c0bdf20 0x7f165c1e4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:10.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f1662145640 1 --2- 172.21.15.45:0/3648215108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f165c06d6b0 0x7f165c0bb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:10.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f1661944640 1 -- 172.21.15.45:0/3648215108 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f165c0bdf20 msgr2=0x7f165c1e4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:10.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f1661944640 1 --2- 172.21.15.45:0/3648215108 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f165c0bdf20 0x7f165c1e4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:10.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f1661944640 1 -- 172.21.15.45:0/3648215108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f165c06d6b0 msgr2=0x7f165c0bb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:10.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f1661944640 1 --2- 172.21.15.45:0/3648215108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f165c06d6b0 0x7f165c0bb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:10.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f1661944640 1 -- 172.21.15.45:0/3648215108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c0094d0 con 0x7f165c0ba3d0 2023-10-03T19:20:10.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f1661944640 1 --2- 172.21.15.45:0/3648215108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165c0ba3d0 0x7f165c1e3f50 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f164c0ae040 tx=0x7f164c019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:10.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f1652ffd640 1 -- 172.21.15.45:0/3648215108 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c0ba070 con 0x7f165c0ba3d0 2023-10-03T19:20:10.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f1652ffd640 1 -- 172.21.15.45:0/3648215108 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164c0abe10 con 0x7f165c0ba3d0 2023-10-03T19:20:10.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f1652ffd640 1 -- 172.21.15.45:0/3648215108 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c0b4870 con 0x7f165c0ba3d0 2023-10-03T19:20:10.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f16643a9640 1 -- 172.21.15.45:0/3648215108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f165c14b560 con 0x7f165c0ba3d0 2023-10-03T19:20:10.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.568+0000 7f16643a9640 1 -- 172.21.15.45:0/3648215108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f165c071220 con 0x7f165c0ba3d0 2023-10-03T19:20:10.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.572+0000 7f16643a9640 1 -- 172.21.15.45:0/3648215108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f165c14b840 con 0x7f165c0ba3d0 2023-10-03T19:20:10.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.572+0000 7f1652ffd640 1 -- 172.21.15.45:0/3648215108 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f164c0b2070 con 0x7f165c0ba3d0 2023-10-03T19:20:10.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.572+0000 7f1652ffd640 1 --2- 172.21.15.45:0/3648215108 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1640066280 0x7f1640068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:10.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.572+0000 7f1652ffd640 1 -- 172.21.15.45:0/3648215108 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f164c11d670 con 0x7f165c0ba3d0 2023-10-03T19:20:10.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.572+0000 7f1662145640 1 --2- 172.21.15.45:0/3648215108 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1640066280 0x7f1640068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:10.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.572+0000 7f1662145640 1 --2- 172.21.15.45:0/3648215108 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1640066280 0x7f1640068730 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1658004e30 tx=0x7f1658009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:10.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.576+0000 7f1652ffd640 1 -- 172.21.15.45:0/3648215108 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f164c0ead70 con 0x7f165c0ba3d0 2023-10-03T19:20:10.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.768+0000 7f16643a9640 1 -- 172.21.15.45:0/3648215108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f165c0ba7a0 con 0x7f165c0ba3d0 2023-10-03T19:20:10.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.768+0000 7f1652ffd640 1 -- 172.21.15.45:0/3648215108 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+2769 (secure 0 0 0) 0x7f165c0ba7a0 con 0x7f165c0ba3d0 2023-10-03T19:20:10.772 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:20:10.772 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":52,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5795,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2000006019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2000006019},{"type":"v1","addr":"172.21.15.79:6835","nonce":2000006019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":7149,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/3326584899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3326584899},{"type":"v1","addr":"172.21.15.45:6833","nonce":3326584899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":7524,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/177030027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":177030027},{"type":"v1","addr":"172.21.15.45:6835","nonce":177030027}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[]} 2023-10-03T19:20:10.772 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 52 2023-10-03T19:20:10.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.772+0000 7f16643a9640 1 -- 172.21.15.45:0/3648215108 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1640066280 msgr2=0x7f1640068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:10.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.772+0000 7f16643a9640 1 --2- 172.21.15.45:0/3648215108 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1640066280 0x7f1640068730 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1658004e30 tx=0x7f1658009040 comp rx=0 tx=0).stop 2023-10-03T19:20:10.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.772+0000 7f16643a9640 1 -- 172.21.15.45:0/3648215108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165c0ba3d0 msgr2=0x7f165c1e3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:10.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.772+0000 7f16643a9640 1 --2- 172.21.15.45:0/3648215108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165c0ba3d0 0x7f165c1e3f50 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f164c0ae040 tx=0x7f164c019210 comp rx=0 tx=0).stop 2023-10-03T19:20:10.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.772+0000 7f16643a9640 1 -- 172.21.15.45:0/3648215108 shutdown_connections 2023-10-03T19:20:10.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.772+0000 7f16643a9640 1 --2- 172.21.15.45:0/3648215108 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1640066280 0x7f1640068730 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:10.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.772+0000 7f16643a9640 1 --2- 172.21.15.45:0/3648215108 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f165c0bdf20 0x7f165c1e4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:10.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.772+0000 7f16643a9640 1 --2- 172.21.15.45:0/3648215108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165c0ba3d0 0x7f165c1e3f50 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:10.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.772+0000 7f16643a9640 1 --2- 172.21.15.45:0/3648215108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f165c06d6b0 0x7f165c0bb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:10.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.772+0000 7f16643a9640 1 -- 172.21.15.45:0/3648215108 >> 172.21.15.45:0/3648215108 conn(0x7f165c0c1a20 msgr2=0x7f165c0bd810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:10.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.772+0000 7f16643a9640 1 -- 172.21.15.45:0/3648215108 shutdown_connections 2023-10-03T19:20:10.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.772+0000 7f16643a9640 1 -- 172.21.15.45:0/3648215108 wait complete. 2023-10-03T19:20:10.791 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-03T19:20:10.792 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-03T19:20:10.792 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-03T19:20:10.792 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:20:10.792 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-03T19:20:10.792 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-03T19:20:10.792 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-03T19:20:10.793 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:20:10.793 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-03T19:20:10.793 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-03T19:20:10.793 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-03T19:20:10.793 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:20:10.805 INFO:tasks.ceph.mds.a:Stopped 2023-10-03T19:20:10.805 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-03T19:20:10.806 INFO:tasks.ceph.mds.c:Stopped 2023-10-03T19:20:10.806 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-03T19:20:10.807 INFO:tasks.ceph.mds.b:Stopped 2023-10-03T19:20:10.807 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-03T19:20:10.852 INFO:tasks.ceph.mds.b:Started 2023-10-03T19:20:10.852 DEBUG:teuthology.parallel:result is None 2023-10-03T19:20:10.855 INFO:tasks.ceph.mds.a:Started 2023-10-03T19:20:10.855 DEBUG:teuthology.parallel:result is None 2023-10-03T19:20:10.856 INFO:tasks.ceph.mds.c:Started 2023-10-03T19:20:10.856 DEBUG:teuthology.parallel:result is None 2023-10-03T19:20:10.856 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-03T19:20:10.918 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-10-03T19:20:10.925 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-10-03T19:20:10.927 INFO:tasks.ceph.mds.b.smithi079.stdout:starting mds.b at 2023-10-03T19:20:10.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.972+0000 7ff1bf57f640 1 Processor -- start 2023-10-03T19:20:10.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.972+0000 7ff1bf57f640 1 -- start start 2023-10-03T19:20:10.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.972+0000 7ff1bf57f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff1b80bf370 0x7ff1b8149760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:10.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.972+0000 7ff1bf57f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1b814c770 con 0x7ff1b80a7100 2023-10-03T19:20:10.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.972+0000 7ff1bf57f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1b806efe0 con 0x7ff1b814d310 2023-10-03T19:20:10.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.972+0000 7ff1bf57f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b80bebc0 con 0x7ff1b80bf370 2023-10-03T19:20:10.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.972+0000 7ff1bcb1a640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff1b80a7100 0x7ff1b814cc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43414/0 (socket says 172.21.15.45:43414) 2023-10-03T19:20:10.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.972+0000 7ff1bcb1a640 1 -- 172.21.15.45:0/2857345938 learned_addr learned my addr 172.21.15.45:0/2857345938 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:20:10.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.972+0000 7ff1bd31b640 1 --2- 172.21.15.45:0/2857345938 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff1b80bf370 0x7ff1b8149760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:10.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.972+0000 7ff1affff640 1 -- 172.21.15.45:0/2857345938 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2616925417 0 0) 0x7ff1b814c770 con 0x7ff1b80a7100 2023-10-03T19:20:10.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.972+0000 7ff1affff640 1 -- 172.21.15.45:0/2857345938 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1a4003530 con 0x7ff1b80a7100 2023-10-03T19:20:10.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.972+0000 7ff1affff640 1 -- 172.21.15.45:0/2857345938 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2661877612 0 0) 0x7ff1b806efe0 con 0x7ff1b814d310 2023-10-03T19:20:10.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.972+0000 7ff1affff640 1 -- 172.21.15.45:0/2857345938 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1b814c770 con 0x7ff1b814d310 2023-10-03T19:20:10.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.972+0000 7ff1bd31b640 1 -- 172.21.15.45:0/2857345938 >> v1:172.21.15.79:6789/0 conn(0x7ff1b814d310 legacy=0x7ff1b814fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:10.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.972+0000 7ff1bd31b640 1 -- 172.21.15.45:0/2857345938 >> v1:172.21.15.45:6789/0 conn(0x7ff1b80a7100 legacy=0x7ff1b814cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:10.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.972+0000 7ff1bd31b640 1 -- 172.21.15.45:0/2857345938 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b806f2c0 con 0x7ff1b80bf370 2023-10-03T19:20:10.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.976+0000 7ff1bd31b640 1 --2- 172.21.15.45:0/2857345938 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff1b80bf370 0x7ff1b8149760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff1b40097f0 tx=0x7ff1b401c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4a09e08474f82f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:10.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.976+0000 7ff1affff640 1 -- 172.21.15.45:0/2857345938 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b40ab650 con 0x7ff1b80bf370 2023-10-03T19:20:10.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.976+0000 7ff1affff640 1 -- 172.21.15.45:0/2857345938 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b40ab7b0 con 0x7ff1b80bf370 2023-10-03T19:20:10.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.976+0000 7ff1affff640 1 -- 172.21.15.45:0/2857345938 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b40abb40 con 0x7ff1b80bf370 2023-10-03T19:20:10.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.976+0000 7ff1bf57f640 1 -- 172.21.15.45:0/2857345938 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff1b80bf370 msgr2=0x7ff1b8149760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:10.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.976+0000 7ff1bf57f640 1 --2- 172.21.15.45:0/2857345938 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff1b80bf370 0x7ff1b8149760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff1b40097f0 tx=0x7ff1b401c430 comp rx=0 tx=0).stop 2023-10-03T19:20:10.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.976+0000 7ff1bf57f640 1 -- 172.21.15.45:0/2857345938 shutdown_connections 2023-10-03T19:20:10.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.976+0000 7ff1bf57f640 1 --2- 172.21.15.45:0/2857345938 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff1b80bf370 0x7ff1b8149760 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:10.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.976+0000 7ff1bf57f640 1 -- 172.21.15.45:0/2857345938 >> 172.21.15.45:0/2857345938 conn(0x7ff1b806bce0 msgr2=0x7ff1b806c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:10.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.976+0000 7ff1bf57f640 1 -- 172.21.15.45:0/2857345938 shutdown_connections 2023-10-03T19:20:10.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.976+0000 7ff1bf57f640 1 -- 172.21.15.45:0/2857345938 wait complete. 2023-10-03T19:20:10.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.980+0000 7ff1bf57f640 1 Processor -- start 2023-10-03T19:20:10.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.980+0000 7ff1bf57f640 1 -- start start 2023-10-03T19:20:10.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.980+0000 7ff1bf57f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1b80a7100 0x7ff1b8150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:10.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.980+0000 7ff1bf57f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1b80bf370 0x7ff1b80bc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:10.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.980+0000 7ff1bf57f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff1b814d310 0x7ff1b81586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:10.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.980+0000 7ff1bf57f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b81519a0 con 0x7ff1b80a7100 2023-10-03T19:20:10.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.980+0000 7ff1bf57f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b8071910 con 0x7ff1b80bf370 2023-10-03T19:20:10.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.980+0000 7ff1bf57f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b8158c20 con 0x7ff1b814d310 2023-10-03T19:20:10.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.980+0000 7ff1bd31b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1b80a7100 0x7ff1b8150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:10.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.980+0000 7ff1bd31b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1b80a7100 0x7ff1b8150f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58468/0 (socket says 172.21.15.45:58468) 2023-10-03T19:20:10.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.980+0000 7ff1bd31b640 1 -- 172.21.15.45:0/3899663190 learned_addr learned my addr 172.21.15.45:0/3899663190 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:10.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.980+0000 7ff1bdb1c640 1 --2- 172.21.15.45:0/3899663190 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff1b814d310 0x7ff1b81586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:10.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.980+0000 7ff1bcb1a640 1 --2- 172.21.15.45:0/3899663190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1b80bf370 0x7ff1b80bc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:10.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.980+0000 7ff1bd31b640 1 -- 172.21.15.45:0/3899663190 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff1b814d310 msgr2=0x7ff1b81586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:10.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.980+0000 7ff1bd31b640 1 --2- 172.21.15.45:0/3899663190 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff1b814d310 0x7ff1b81586e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:10.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.980+0000 7ff1bd31b640 1 -- 172.21.15.45:0/3899663190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1b80bf370 msgr2=0x7ff1b80bc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:10.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.980+0000 7ff1bd31b640 1 --2- 172.21.15.45:0/3899663190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1b80bf370 0x7ff1b80bc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:10.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.980+0000 7ff1bd31b640 1 -- 172.21.15.45:0/3899663190 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b4009420 con 0x7ff1b80a7100 2023-10-03T19:20:10.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.980+0000 7ff1bdb1c640 1 --2- 172.21.15.45:0/3899663190 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff1b814d310 0x7ff1b81586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:20:10.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.980+0000 7ff1bd31b640 1 --2- 172.21.15.45:0/3899663190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1b80a7100 0x7ff1b8150f50 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4019040 tx=0x7ff1b401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:10.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.980+0000 7ff1adffb640 1 -- 172.21.15.45:0/3899663190 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b40bf610 con 0x7ff1b80a7100 2023-10-03T19:20:10.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.980+0000 7ff1adffb640 1 -- 172.21.15.45:0/3899663190 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b40bf790 con 0x7ff1b80a7100 2023-10-03T19:20:10.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.980+0000 7ff1bf57f640 1 -- 172.21.15.45:0/3899663190 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b8150b10 con 0x7ff1b80a7100 2023-10-03T19:20:10.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.980+0000 7ff1adffb640 1 -- 172.21.15.45:0/3899663190 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b40bfb40 con 0x7ff1b80a7100 2023-10-03T19:20:10.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.980+0000 7ff1bf57f640 1 -- 172.21.15.45:0/3899663190 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b814a0b0 con 0x7ff1b80a7100 2023-10-03T19:20:10.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.980+0000 7ff1bf57f640 1 -- 172.21.15.45:0/3899663190 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b815afb0 con 0x7ff1b80a7100 2023-10-03T19:20:10.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.980+0000 7ff1adffb640 1 -- 172.21.15.45:0/3899663190 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff1b40b5400 con 0x7ff1b80a7100 2023-10-03T19:20:10.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.980+0000 7ff1adffb640 1 --2- 172.21.15.45:0/3899663190 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff19c066280 0x7ff19c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:10.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.980+0000 7ff1adffb640 1 -- 172.21.15.45:0/3899663190 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ff1b411eb30 con 0x7ff1b80a7100 2023-10-03T19:20:10.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.984+0000 7ff1bcb1a640 1 --2- 172.21.15.45:0/3899663190 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff19c066280 0x7ff19c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:10.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.984+0000 7ff1bcb1a640 1 --2- 172.21.15.45:0/3899663190 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff19c066280 0x7ff19c068730 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff1b806efb0 tx=0x7ff1a8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:10.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:10.984+0000 7ff1adffb640 1 -- 172.21.15.45:0/3899663190 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff1b40ec3d0 con 0x7ff1b80a7100 2023-10-03T19:20:11.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:11.152+0000 7ff1bf57f640 1 -- 172.21.15.45:0/3899663190 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff1b804de80 con 0x7ff1b80a7100 2023-10-03T19:20:11.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:11.968+0000 7ff1adffb640 1 -- 172.21.15.45:0/3899663190 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v105) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff1b40ef9f0 con 0x7ff1b80a7100 2023-10-03T19:20:11.972 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-10-03T19:20:11.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:11.972+0000 7ff1bf57f640 1 -- 172.21.15.45:0/3899663190 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff19c066280 msgr2=0x7ff19c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:11.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:11.972+0000 7ff1bf57f640 1 --2- 172.21.15.45:0/3899663190 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff19c066280 0x7ff19c068730 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff1b806efb0 tx=0x7ff1a8009040 comp rx=0 tx=0).stop 2023-10-03T19:20:11.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:11.972+0000 7ff1bf57f640 1 -- 172.21.15.45:0/3899663190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1b80a7100 msgr2=0x7ff1b8150f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:11.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:11.972+0000 7ff1bf57f640 1 --2- 172.21.15.45:0/3899663190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1b80a7100 0x7ff1b8150f50 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4019040 tx=0x7ff1b401ac70 comp rx=0 tx=0).stop 2023-10-03T19:20:11.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:11.972+0000 7ff1bf57f640 1 -- 172.21.15.45:0/3899663190 shutdown_connections 2023-10-03T19:20:11.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:11.972+0000 7ff1bf57f640 1 --2- 172.21.15.45:0/3899663190 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff19c066280 0x7ff19c068730 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:11.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:11.972+0000 7ff1bf57f640 1 --2- 172.21.15.45:0/3899663190 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff1b814d310 0x7ff1b81586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:11.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:11.972+0000 7ff1bf57f640 1 --2- 172.21.15.45:0/3899663190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1b80bf370 0x7ff1b80bc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:11.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:11.972+0000 7ff1bf57f640 1 --2- 172.21.15.45:0/3899663190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1b80a7100 0x7ff1b8150f50 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:11.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:11.972+0000 7ff1bf57f640 1 -- 172.21.15.45:0/3899663190 >> 172.21.15.45:0/3899663190 conn(0x7ff1b806bce0 msgr2=0x7ff1b80bdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:11.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:11.972+0000 7ff1bf57f640 1 -- 172.21.15.45:0/3899663190 shutdown_connections 2023-10-03T19:20:11.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:11.972+0000 7ff1bf57f640 1 -- 172.21.15.45:0/3899663190 wait complete. 2023-10-03T19:20:11.997 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-03T19:20:12.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.120+0000 7f0d64890640 1 Processor -- start 2023-10-03T19:20:12.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.120+0000 7f0d64890640 1 -- start start 2023-10-03T19:20:12.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.120+0000 7f0d64890640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0d600c2790 0x7f0d601528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:12.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.120+0000 7f0d64890640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d600bb1d0 0x7f0d600c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:12.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.120+0000 7f0d64890640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d6006b2d0 con 0x7f0d6014f240 2023-10-03T19:20:12.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.120+0000 7f0d64890640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d6006b640 con 0x7f0d600c2790 2023-10-03T19:20:12.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.120+0000 7f0d64890640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d600a3c60 con 0x7f0d600bb1d0 2023-10-03T19:20:12.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.120+0000 7f0d5dd9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0d600c2790 0x7f0d601528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:12.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.120+0000 7f0d5dd9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0d600c2790 0x7f0d601528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58478/0 (socket says 172.21.15.45:58478) 2023-10-03T19:20:12.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.120+0000 7f0d5dd9b640 1 -- 172.21.15.45:0/3154663026 learned_addr learned my addr 172.21.15.45:0/3154663026 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:12.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.120+0000 7f0d5ed9d640 1 --2- 172.21.15.45:0/3154663026 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d600bb1d0 0x7f0d600c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:12.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.120+0000 7f0d5dd9b640 1 -- 172.21.15.45:0/3154663026 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d600bb1d0 msgr2=0x7f0d600c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:12.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.120+0000 7f0d5dd9b640 1 --2- 172.21.15.45:0/3154663026 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d600bb1d0 0x7f0d600c12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.120+0000 7f0d5dd9b640 1 -- 172.21.15.45:0/3154663026 >> v1:172.21.15.79:6789/0 conn(0x7f0d6014f240 legacy=0x7f0d600c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:12.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.120+0000 7f0d5dd9b640 1 -- 172.21.15.45:0/3154663026 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6014e740 con 0x7f0d600c2790 2023-10-03T19:20:12.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.120+0000 7f0d5ed9d640 1 --2- 172.21.15.45:0/3154663026 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d600bb1d0 0x7f0d600c12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:12.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.120+0000 7f0d5dd9b640 1 --2- 172.21.15.45:0/3154663026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d600c2790 0x7f0d601528d0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f0d54006fd0 tx=0x7f0d5401ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=929db5e695adea10 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:12.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d5d59a640 1 -- 172.21.15.45:0/3154663026 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d540a8990 con 0x7f0d600c2790 2023-10-03T19:20:12.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d5d59a640 1 -- 172.21.15.45:0/3154663026 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d540a8af0 con 0x7f0d600c2790 2023-10-03T19:20:12.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d5d59a640 1 -- 172.21.15.45:0/3154663026 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d540a8e80 con 0x7f0d600c2790 2023-10-03T19:20:12.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d64890640 1 -- 172.21.15.45:0/3154663026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d600c2790 msgr2=0x7f0d601528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:12.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d64890640 1 --2- 172.21.15.45:0/3154663026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d600c2790 0x7f0d601528d0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f0d54006fd0 tx=0x7f0d5401ecd0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d64890640 1 -- 172.21.15.45:0/3154663026 shutdown_connections 2023-10-03T19:20:12.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d64890640 1 --2- 172.21.15.45:0/3154663026 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d600bb1d0 0x7f0d600c12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d64890640 1 --2- 172.21.15.45:0/3154663026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d600c2790 0x7f0d601528d0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d64890640 1 -- 172.21.15.45:0/3154663026 >> 172.21.15.45:0/3154663026 conn(0x7f0d600a64a0 msgr2=0x7f0d600a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:12.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d64890640 1 -- 172.21.15.45:0/3154663026 shutdown_connections 2023-10-03T19:20:12.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d64890640 1 -- 172.21.15.45:0/3154663026 wait complete. 2023-10-03T19:20:12.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d64890640 1 Processor -- start 2023-10-03T19:20:12.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d64890640 1 -- start start 2023-10-03T19:20:12.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d64890640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d600bb1d0 0x7f0d60150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:12.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d64890640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d600c2790 0x7f0d601db4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:12.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d64890640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d6014f240 0x7f0d600be2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:12.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d64890640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6014bd40 con 0x7f0d600c2790 2023-10-03T19:20:12.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d64890640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6014b7f0 con 0x7f0d600bb1d0 2023-10-03T19:20:12.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d64890640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d601db9e0 con 0x7f0d6014f240 2023-10-03T19:20:12.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d5dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d600c2790 0x7f0d601db4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:12.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d5dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d600c2790 0x7f0d601db4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58492/0 (socket says 172.21.15.45:58492) 2023-10-03T19:20:12.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d5dd9b640 1 -- 172.21.15.45:0/1867436406 learned_addr learned my addr 172.21.15.45:0/1867436406 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:12.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d5e59c640 1 --2- 172.21.15.45:0/1867436406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d600bb1d0 0x7f0d60150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:12.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d5ed9d640 1 --2- 172.21.15.45:0/1867436406 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d6014f240 0x7f0d600be2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:12.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d5dd9b640 1 -- 172.21.15.45:0/1867436406 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d6014f240 msgr2=0x7f0d600be2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:12.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d5dd9b640 1 --2- 172.21.15.45:0/1867436406 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d6014f240 0x7f0d600be2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d5dd9b640 1 -- 172.21.15.45:0/1867436406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d600bb1d0 msgr2=0x7f0d60150d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:12.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d5dd9b640 1 --2- 172.21.15.45:0/1867436406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d600bb1d0 0x7f0d60150d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d5dd9b640 1 -- 172.21.15.45:0/1867436406 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d54009480 con 0x7f0d600c2790 2023-10-03T19:20:12.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d5ed9d640 1 --2- 172.21.15.45:0/1867436406 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d6014f240 0x7f0d600be2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:20:12.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.124+0000 7f0d5dd9b640 1 --2- 172.21.15.45:0/1867436406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d600c2790 0x7f0d601db4a0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f0d5409b4b0 tx=0x7f0d5401ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:12.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.128+0000 7f0d4effd640 1 -- 172.21.15.45:0/1867436406 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d540063d0 con 0x7f0d600c2790 2023-10-03T19:20:12.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.128+0000 7f0d4effd640 1 -- 172.21.15.45:0/1867436406 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d54006530 con 0x7f0d600c2790 2023-10-03T19:20:12.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.128+0000 7f0d64890640 1 -- 172.21.15.45:0/1867436406 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d6014f610 con 0x7f0d600c2790 2023-10-03T19:20:12.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.128+0000 7f0d4effd640 1 -- 172.21.15.45:0/1867436406 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d540068a0 con 0x7f0d600c2790 2023-10-03T19:20:12.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.128+0000 7f0d64890640 1 -- 172.21.15.45:0/1867436406 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d600a3f40 con 0x7f0d600c2790 2023-10-03T19:20:12.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.128+0000 7f0d64890640 1 -- 172.21.15.45:0/1867436406 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d600bf360 con 0x7f0d600c2790 2023-10-03T19:20:12.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.128+0000 7f0d4effd640 1 -- 172.21.15.45:0/1867436406 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0d540b7040 con 0x7f0d600c2790 2023-10-03T19:20:12.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.128+0000 7f0d4effd640 1 --2- 172.21.15.45:0/1867436406 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0d400662b0 0x7f0d40068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:12.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.128+0000 7f0d4effd640 1 -- 172.21.15.45:0/1867436406 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0d541215e0 con 0x7f0d600c2790 2023-10-03T19:20:12.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.128+0000 7f0d5e59c640 1 --2- 172.21.15.45:0/1867436406 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0d400662b0 0x7f0d40068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:12.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.128+0000 7f0d5e59c640 1 --2- 172.21.15.45:0/1867436406 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0d400662b0 0x7f0d40068760 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0d50006fd0 tx=0x7f0d50009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:12.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.132+0000 7f0d4effd640 1 -- 172.21.15.45:0/1867436406 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0d540eedb0 con 0x7f0d600c2790 2023-10-03T19:20:12.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.344+0000 7f0d64890640 1 -- 172.21.15.45:0/1867436406 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f0d600bf360 con 0x7f0d600c2790 2023-10-03T19:20:12.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.344+0000 7f0d4effd640 1 -- 172.21.15.45:0/1867436406 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+4440 (secure 0 0 0) 0x7f0d540f3e60 con 0x7f0d600c2790 2023-10-03T19:20:12.349 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:20:12.349 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-03T19:20:12.349 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-10-03T19:20:12.349 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:20:12.350 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-10-03T19:20:12.350 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlfyzhExAABLhtkQEZuiLwovBSO0kuAA==", 2023-10-03T19:20:12.350 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:20:12.350 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:20:12.350 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-03T19:20:12.350 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-03T19:20:12.350 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:20:12.350 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:20:12.350 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:20:12.350 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:20:12.351 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-10-03T19:20:12.351 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlzM8pIBAAMie9jpxS/xt2cymMpyJmiQ==", 2023-10-03T19:20:12.351 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:20:12.351 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:20:12.351 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-03T19:20:12.351 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-03T19:20:12.351 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:20:12.351 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:20:12.351 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:20:12.351 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:20:12.351 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-10-03T19:20:12.352 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlAsGOHBAAIHprnd9orKMQjzkNQZz94A==", 2023-10-03T19:20:12.352 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:20:12.352 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:20:12.352 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-03T19:20:12.352 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-03T19:20:12.352 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:20:12.352 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:20:12.352 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:20:12.352 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:20:12.352 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-10-03T19:20:12.352 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBmZxxlb0zQLRAA3z+f4/jsLTLUmFg/WOD/Xg==", 2023-10-03T19:20:12.353 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:20:12.353 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:20:12.353 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:20:12.353 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:20:12.353 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:20:12.353 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:20:12.353 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:20:12.353 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-10-03T19:20:12.353 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBpZxxlTjtZNRAA3HFqXjGLO7JoX+GBegGfqw==", 2023-10-03T19:20:12.353 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:20:12.353 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:20:12.353 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:20:12.354 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:20:12.354 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:20:12.354 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:20:12.354 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:20:12.354 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-10-03T19:20:12.354 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBtZxxld6kUBBAATcGPrxBbPLswrUHihB7AgQ==", 2023-10-03T19:20:12.354 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:20:12.354 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:20:12.354 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:20:12.354 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:20:12.354 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:20:12.355 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:20:12.355 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:20:12.355 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-10-03T19:20:12.355 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBwZxxlWUL3DBAAk4TW6N5mpjjyP7QgQAIuDw==", 2023-10-03T19:20:12.355 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:20:12.355 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:20:12.355 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:20:12.355 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:20:12.355 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:20:12.355 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:20:12.355 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:20:12.355 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-10-03T19:20:12.356 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQB2ZxxlK3KNIhAAjhvxAU0shg+5PbJfq1LEog==", 2023-10-03T19:20:12.356 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:20:12.356 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:20:12.356 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:20:12.356 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:20:12.356 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:20:12.356 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:20:12.356 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:20:12.356 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-10-03T19:20:12.356 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQB5ZxxlRAxuKhAA5ma3eAt3kkukdhgZN4wwEg==", 2023-10-03T19:20:12.356 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:20:12.357 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:20:12.357 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:20:12.357 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:20:12.357 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:20:12.357 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:20:12.357 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:20:12.357 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-10-03T19:20:12.357 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQB8ZxxlkQqOMxAAuKGy7vJQLUDsqgjPVtWMWg==", 2023-10-03T19:20:12.357 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:20:12.357 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:20:12.357 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:20:12.358 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:20:12.358 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:20:12.358 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:20:12.358 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:20:12.358 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-10-03T19:20:12.358 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCAZxxl65r/ABAAeWtP7nMLVm5NBU4vWQ6ceg==", 2023-10-03T19:20:12.358 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:20:12.358 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-10-03T19:20:12.358 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-10-03T19:20:12.358 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:20:12.358 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:20:12.359 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:20:12.359 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:20:12.359 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-10-03T19:20:12.359 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlg5PgJRAAvvN5Xrw/ZW4rSdJ1/adnzA==", 2023-10-03T19:20:12.359 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:20:12.359 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:20:12.359 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow r", 2023-10-03T19:20:12.359 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-03T19:20:12.359 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:20:12.359 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:20:12.359 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:20:12.359 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-10-03T19:20:12.360 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlKkW+KRAALzVyQ+iTWuD5FMLDKXNVTg==", 2023-10-03T19:20:12.360 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:20:12.360 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-10-03T19:20:12.360 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-10-03T19:20:12.360 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-10-03T19:20:12.360 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-10-03T19:20:12.360 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:20:12.360 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:20:12.360 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:20:12.360 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-10-03T19:20:12.360 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBkZxxldHb4LxAAc/oJcXFjNgH5Wxwv04WHgw==", 2023-10-03T19:20:12.360 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:20:12.361 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-10-03T19:20:12.361 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-10-03T19:20:12.361 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-10-03T19:20:12.361 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:20:12.361 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:20:12.361 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:20:12.361 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:20:12.361 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-10-03T19:20:12.361 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxl4txNEBAAonNqY2PmtF0vZGFmvzxIKw==", 2023-10-03T19:20:12.361 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:20:12.361 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-10-03T19:20:12.361 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-10-03T19:20:12.362 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:20:12.362 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:20:12.362 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:20:12.362 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:20:12.362 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-10-03T19:20:12.362 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBlZxxlUmKhDRAA7UKlGP9q9aKsk+J+nTxrUA==", 2023-10-03T19:20:12.362 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-10-03T19:20:12.362 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-10-03T19:20:12.362 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-10-03T19:20:12.362 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-10-03T19:20:12.362 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:20:12.362 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:20:12.363 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-10-03T19:20:12.363 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-03T19:20:12.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.348+0000 7f0d64890640 1 -- 172.21.15.45:0/1867436406 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0d400662b0 msgr2=0x7f0d40068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:12.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.348+0000 7f0d64890640 1 --2- 172.21.15.45:0/1867436406 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0d400662b0 0x7f0d40068760 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0d50006fd0 tx=0x7f0d50009060 comp rx=0 tx=0).stop 2023-10-03T19:20:12.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.348+0000 7f0d64890640 1 -- 172.21.15.45:0/1867436406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d600c2790 msgr2=0x7f0d601db4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:12.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.348+0000 7f0d64890640 1 --2- 172.21.15.45:0/1867436406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d600c2790 0x7f0d601db4a0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f0d5409b4b0 tx=0x7f0d5401ba70 comp rx=0 tx=0).stop 2023-10-03T19:20:12.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.348+0000 7f0d64890640 1 -- 172.21.15.45:0/1867436406 shutdown_connections 2023-10-03T19:20:12.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.348+0000 7f0d64890640 1 --2- 172.21.15.45:0/1867436406 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0d400662b0 0x7f0d40068760 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.348+0000 7f0d64890640 1 --2- 172.21.15.45:0/1867436406 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d6014f240 0x7f0d600be2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.348+0000 7f0d64890640 1 --2- 172.21.15.45:0/1867436406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d600c2790 0x7f0d601db4a0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.348+0000 7f0d64890640 1 --2- 172.21.15.45:0/1867436406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d600bb1d0 0x7f0d60150d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.348+0000 7f0d64890640 1 -- 172.21.15.45:0/1867436406 >> 172.21.15.45:0/1867436406 conn(0x7f0d600a64a0 msgr2=0x7f0d600a6870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:12.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.348+0000 7f0d64890640 1 -- 172.21.15.45:0/1867436406 shutdown_connections 2023-10-03T19:20:12.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.348+0000 7f0d64890640 1 -- 172.21.15.45:0/1867436406 wait complete. 2023-10-03T19:20:12.368 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:20:12.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.488+0000 7fcff4136640 1 Processor -- start 2023-10-03T19:20:12.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.488+0000 7fcff4136640 1 -- start start 2023-10-03T19:20:12.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.488+0000 7fcff4136640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcfec0658f0 0x7fcfec070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:12.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.488+0000 7fcff4136640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcfec069ad0 0x7fcfec069fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:12.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.488+0000 7fcff4136640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfec0bd700 con 0x7fcfec070230 2023-10-03T19:20:12.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.488+0000 7fcff4136640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfec14f2f0 con 0x7fcfec069ad0 2023-10-03T19:20:12.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.488+0000 7fcff4136640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfec0bdcc0 con 0x7fcfec0658f0 2023-10-03T19:20:12.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.488+0000 7fcff16d1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcfec069ad0 0x7fcfec069fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:12.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.488+0000 7fcff26d3640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fcfec070230 0x7fcfec14bad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43418/0 (socket says 172.21.15.45:43418) 2023-10-03T19:20:12.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.488+0000 7fcff26d3640 1 -- 172.21.15.45:0/1215319507 learned_addr learned my addr 172.21.15.45:0/1215319507 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:20:12.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.488+0000 7fcff1ed2640 1 --2- 172.21.15.45:0/1215319507 >> v2:172.21.15.79:3300/0 conn(0x7fcfec0658f0 0x7fcfec070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:12.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.488+0000 7fcff16d1640 1 -- 172.21.15.45:0/1215319507 >> v2:172.21.15.79:3300/0 conn(0x7fcfec0658f0 msgr2=0x7fcfec070a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:12.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.488+0000 7fcff16d1640 1 --2- 172.21.15.45:0/1215319507 >> v2:172.21.15.79:3300/0 conn(0x7fcfec0658f0 0x7fcfec070a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.488+0000 7fcff16d1640 1 -- 172.21.15.45:0/1215319507 >> v1:172.21.15.45:6789/0 conn(0x7fcfec070230 legacy=0x7fcfec14bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:12.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.488+0000 7fcff16d1640 1 -- 172.21.15.45:0/1215319507 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfec14f740 con 0x7fcfec069ad0 2023-10-03T19:20:12.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.492+0000 7fcff16d1640 1 --2- 172.21.15.45:0/1215319507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfec069ad0 0x7fcfec069fe0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc0097c0 tx=0x7fcfdc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04a8abdfa8dc4e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:12.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.492+0000 7fcff0ed0640 1 -- 172.21.15.45:0/1215319507 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc0ab660 con 0x7fcfec069ad0 2023-10-03T19:20:12.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.492+0000 7fcff0ed0640 1 -- 172.21.15.45:0/1215319507 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfdc0ab7c0 con 0x7fcfec069ad0 2023-10-03T19:20:12.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.492+0000 7fcff0ed0640 1 -- 172.21.15.45:0/1215319507 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc0abb50 con 0x7fcfec069ad0 2023-10-03T19:20:12.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.492+0000 7fcff4136640 1 -- 172.21.15.45:0/1215319507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfec069ad0 msgr2=0x7fcfec069fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:12.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.492+0000 7fcff4136640 1 --2- 172.21.15.45:0/1215319507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfec069ad0 0x7fcfec069fe0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc0097c0 tx=0x7fcfdc01c440 comp rx=0 tx=0).stop 2023-10-03T19:20:12.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.492+0000 7fcff4136640 1 -- 172.21.15.45:0/1215319507 shutdown_connections 2023-10-03T19:20:12.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.492+0000 7fcff4136640 1 --2- 172.21.15.45:0/1215319507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfec069ad0 0x7fcfec069fe0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.492+0000 7fcff4136640 1 --2- 172.21.15.45:0/1215319507 >> v2:172.21.15.79:3300/0 conn(0x7fcfec0658f0 0x7fcfec070a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.492+0000 7fcff4136640 1 -- 172.21.15.45:0/1215319507 >> 172.21.15.45:0/1215319507 conn(0x7fcfec0bed00 msgr2=0x7fcfec06d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:12.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.492+0000 7fcff4136640 1 -- 172.21.15.45:0/1215319507 shutdown_connections 2023-10-03T19:20:12.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.492+0000 7fcff4136640 1 -- 172.21.15.45:0/1215319507 wait complete. 2023-10-03T19:20:12.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.492+0000 7fcff4136640 1 Processor -- start 2023-10-03T19:20:12.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.492+0000 7fcff4136640 1 -- start start 2023-10-03T19:20:12.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.496+0000 7fcff4136640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfec0658f0 0x7fcfec1e9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:12.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.496+0000 7fcff4136640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfec069ad0 0x7fcfec0bfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:12.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.496+0000 7fcff4136640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcfec070230 0x7fcfec0c0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:12.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.496+0000 7fcff4136640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec141a10 con 0x7fcfec0658f0 2023-10-03T19:20:12.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.496+0000 7fcff4136640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec141730 con 0x7fcfec069ad0 2023-10-03T19:20:12.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.496+0000 7fcff4136640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec13b9d0 con 0x7fcfec070230 2023-10-03T19:20:12.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.496+0000 7fcff1ed2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfec0658f0 0x7fcfec1e9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:12.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.496+0000 7fcff1ed2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfec0658f0 0x7fcfec1e9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58508/0 (socket says 172.21.15.45:58508) 2023-10-03T19:20:12.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.496+0000 7fcff1ed2640 1 -- 172.21.15.45:0/167867571 learned_addr learned my addr 172.21.15.45:0/167867571 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:12.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.496+0000 7fcff16d1640 1 --2- 172.21.15.45:0/167867571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfec069ad0 0x7fcfec0bfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:12.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.496+0000 7fcff26d3640 1 --2- 172.21.15.45:0/167867571 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcfec070230 0x7fcfec0c0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:12.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.496+0000 7fcff1ed2640 1 -- 172.21.15.45:0/167867571 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcfec070230 msgr2=0x7fcfec0c0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:12.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.496+0000 7fcff1ed2640 1 --2- 172.21.15.45:0/167867571 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcfec070230 0x7fcfec0c0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.496+0000 7fcff1ed2640 1 -- 172.21.15.45:0/167867571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfec069ad0 msgr2=0x7fcfec0bfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:12.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.496+0000 7fcff1ed2640 1 --2- 172.21.15.45:0/167867571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfec069ad0 0x7fcfec0bfdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.496+0000 7fcff1ed2640 1 -- 172.21.15.45:0/167867571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfdc009420 con 0x7fcfec0658f0 2023-10-03T19:20:12.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.496+0000 7fcff26d3640 1 --2- 172.21.15.45:0/167867571 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcfec070230 0x7fcfec0c0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:12.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.496+0000 7fcff1ed2640 1 --2- 172.21.15.45:0/167867571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfec0658f0 0x7fcfec1e9bb0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fcfe800d800 tx=0x7fcfe800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:12.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.496+0000 7fcfe27fc640 1 -- 172.21.15.45:0/167867571 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe800b6c0 con 0x7fcfec0658f0 2023-10-03T19:20:12.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.496+0000 7fcfe27fc640 1 -- 172.21.15.45:0/167867571 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe800b820 con 0x7fcfec0658f0 2023-10-03T19:20:12.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.496+0000 7fcff4136640 1 -- 172.21.15.45:0/167867571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfec0a3ff0 con 0x7fcfec0658f0 2023-10-03T19:20:12.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.496+0000 7fcfe27fc640 1 -- 172.21.15.45:0/167867571 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe800bb90 con 0x7fcfec0658f0 2023-10-03T19:20:12.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.496+0000 7fcff4136640 1 -- 172.21.15.45:0/167867571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfec065cc0 con 0x7fcfec0658f0 2023-10-03T19:20:12.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.496+0000 7fcff4136640 1 -- 172.21.15.45:0/167867571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfec13b830 con 0x7fcfec0658f0 2023-10-03T19:20:12.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.496+0000 7fcfe27fc640 1 -- 172.21.15.45:0/167867571 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcfe800bcf0 con 0x7fcfec0658f0 2023-10-03T19:20:12.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.496+0000 7fcfe27fc640 1 --2- 172.21.15.45:0/167867571 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcfd0066280 0x7fcfd0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:12.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.496+0000 7fcfe27fc640 1 -- 172.21.15.45:0/167867571 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcfe8084860 con 0x7fcfec0658f0 2023-10-03T19:20:12.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.496+0000 7fcff16d1640 1 --2- 172.21.15.45:0/167867571 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcfd0066280 0x7fcfd0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:12.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.500+0000 7fcff16d1640 1 --2- 172.21.15.45:0/167867571 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcfd0066280 0x7fcfd0068730 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc0af000 tx=0x7fcfdc0a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:12.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.500+0000 7fcfe27fc640 1 -- 172.21.15.45:0/167867571 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fcfe8055ba0 con 0x7fcfec0658f0 2023-10-03T19:20:12.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.656+0000 7fcff4136640 1 -- 172.21.15.45:0/167867571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfec13b830 con 0x7fcfec0658f0 2023-10-03T19:20:12.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.656+0000 7fcfe27fc640 1 -- 172.21.15.45:0/167867571 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+14593 (secure 0 0 0) 0x7fcfec13b830 con 0x7fcfec0658f0 2023-10-03T19:20:12.660 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:20:12.660 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":105,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:20:11.962547+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:20:12.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.660+0000 7fcff4136640 1 -- 172.21.15.45:0/167867571 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcfd0066280 msgr2=0x7fcfd0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:12.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.660+0000 7fcff4136640 1 --2- 172.21.15.45:0/167867571 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcfd0066280 0x7fcfd0068730 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc0af000 tx=0x7fcfdc0a7000 comp rx=0 tx=0).stop 2023-10-03T19:20:12.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.660+0000 7fcff4136640 1 -- 172.21.15.45:0/167867571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfec0658f0 msgr2=0x7fcfec1e9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:12.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.660+0000 7fcff4136640 1 --2- 172.21.15.45:0/167867571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfec0658f0 0x7fcfec1e9bb0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fcfe800d800 tx=0x7fcfe800dcc0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.660+0000 7fcff4136640 1 -- 172.21.15.45:0/167867571 shutdown_connections 2023-10-03T19:20:12.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.660+0000 7fcff4136640 1 --2- 172.21.15.45:0/167867571 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcfd0066280 0x7fcfd0068730 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.660+0000 7fcff4136640 1 --2- 172.21.15.45:0/167867571 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcfec070230 0x7fcfec0c0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.660+0000 7fcff4136640 1 --2- 172.21.15.45:0/167867571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfec069ad0 0x7fcfec0bfdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.660+0000 7fcff4136640 1 --2- 172.21.15.45:0/167867571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfec0658f0 0x7fcfec1e9bb0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.660+0000 7fcff4136640 1 -- 172.21.15.45:0/167867571 >> 172.21.15.45:0/167867571 conn(0x7fcfec0bed00 msgr2=0x7fcfec14ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:12.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.660+0000 7fcff4136640 1 -- 172.21.15.45:0/167867571 shutdown_connections 2023-10-03T19:20:12.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.660+0000 7fcff4136640 1 -- 172.21.15.45:0/167867571 wait complete. 2023-10-03T19:20:12.678 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:20:12.679 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:20:12.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.804+0000 7fcf58097640 1 Processor -- start 2023-10-03T19:20:12.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.804+0000 7fcf58097640 1 -- start start 2023-10-03T19:20:12.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf58097640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcf5006d560 0x7fcf500a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:12.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf58097640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf5006c760 0x7fcf500a5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:12.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf58097640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5006c2d0 con 0x7fcf500712c0 2023-10-03T19:20:12.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf58097640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf50150610 con 0x7fcf5006d560 2023-10-03T19:20:12.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf58097640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf501508b0 con 0x7fcf5006c760 2023-10-03T19:20:12.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf55e33640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fcf500712c0 0x7fcf500bcbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43428/0 (socket says 172.21.15.45:43428) 2023-10-03T19:20:12.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf55e33640 1 -- 172.21.15.45:0/2269316669 learned_addr learned my addr 172.21.15.45:0/2269316669 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:20:12.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf56634640 1 --2- 172.21.15.45:0/2269316669 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf5006c760 0x7fcf500a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:12.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf54e31640 1 -- 172.21.15.45:0/2269316669 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2065266407 0 0) 0x7fcf5006c2d0 con 0x7fcf500712c0 2023-10-03T19:20:12.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf55632640 1 --2- 172.21.15.45:0/2269316669 >> v2:172.21.15.79:3300/0 conn(0x7fcf5006d560 0x7fcf500a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:12.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf54e31640 1 -- 172.21.15.45:0/2269316669 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf3c003530 con 0x7fcf500712c0 2023-10-03T19:20:12.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf54e31640 1 -- 172.21.15.45:0/2269316669 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 74078445 0 0) 0x7fcf3c003530 con 0x7fcf500712c0 2023-10-03T19:20:12.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf54e31640 1 -- 172.21.15.45:0/2269316669 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf5006c760 msgr2=0x7fcf500a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:12.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf54e31640 1 --2- 172.21.15.45:0/2269316669 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf5006c760 0x7fcf500a5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf54e31640 1 -- 172.21.15.45:0/2269316669 >> v2:172.21.15.79:3300/0 conn(0x7fcf5006d560 msgr2=0x7fcf500a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:12.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf54e31640 1 --2- 172.21.15.45:0/2269316669 >> v2:172.21.15.79:3300/0 conn(0x7fcf5006d560 0x7fcf500a53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf54e31640 1 -- 172.21.15.45:0/2269316669 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5006d2e0 con 0x7fcf500712c0 2023-10-03T19:20:12.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf54e31640 1 -- 172.21.15.45:0/2269316669 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fcf4c001680 con 0x7fcf500712c0 2023-10-03T19:20:12.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf54e31640 1 -- 172.21.15.45:0/2269316669 >> v1:172.21.15.45:6789/0 conn(0x7fcf500712c0 legacy=0x7fcf500bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:12.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf54e31640 1 --2- 172.21.15.45:0/2269316669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf3c003980 0x7fcf3c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:12.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf54e31640 1 --2- 172.21.15.45:0/2269316669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf3c0043b0 0x7fcf3c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:12.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf54e31640 1 --2- 172.21.15.45:0/2269316669 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf5006c760 0x7fcf3c004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:12.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf54e31640 1 -- 172.21.15.45:0/2269316669 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf50150610 con 0x7fcf3c0043b0 2023-10-03T19:20:12.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf54e31640 1 -- 172.21.15.45:0/2269316669 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf501508b0 con 0x7fcf3c003980 2023-10-03T19:20:12.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf54e31640 1 -- 172.21.15.45:0/2269316669 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c00fda0 con 0x7fcf5006c760 2023-10-03T19:20:12.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf55632640 1 --2- 172.21.15.45:0/2269316669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf3c0043b0 0x7fcf3c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:12.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf55e33640 1 --2- 172.21.15.45:0/2269316669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf3c003980 0x7fcf3c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:12.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf55632640 1 -- 172.21.15.45:0/2269316669 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf5006c760 msgr2=0x7fcf3c004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:12.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf55632640 1 --2- 172.21.15.45:0/2269316669 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf5006c760 0x7fcf3c004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf55632640 1 -- 172.21.15.45:0/2269316669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf3c003980 msgr2=0x7fcf3c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:12.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf55632640 1 --2- 172.21.15.45:0/2269316669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf3c003980 0x7fcf3c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf55632640 1 -- 172.21.15.45:0/2269316669 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3c003530 con 0x7fcf3c0043b0 2023-10-03T19:20:12.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.808+0000 7fcf55e33640 1 --2- 172.21.15.45:0/2269316669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf3c003980 0x7fcf3c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:12.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.812+0000 7fcf55632640 1 --2- 172.21.15.45:0/2269316669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf3c0043b0 0x7fcf3c004870 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fcf44009fc0 tx=0x7fcf4401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ab88513257780b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:12.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.812+0000 7fcf54e31640 1 -- 172.21.15.45:0/2269316669 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf440a5ba0 con 0x7fcf3c0043b0 2023-10-03T19:20:12.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.812+0000 7fcf54e31640 1 -- 172.21.15.45:0/2269316669 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4400f040 con 0x7fcf3c0043b0 2023-10-03T19:20:12.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.812+0000 7fcf54e31640 1 -- 172.21.15.45:0/2269316669 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf440ad440 con 0x7fcf3c0043b0 2023-10-03T19:20:12.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.812+0000 7fcf58097640 1 -- 172.21.15.45:0/2269316669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf3c0043b0 msgr2=0x7fcf3c004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:12.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.812+0000 7fcf58097640 1 --2- 172.21.15.45:0/2269316669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf3c0043b0 0x7fcf3c004870 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fcf44009fc0 tx=0x7fcf4401cca0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.812+0000 7fcf56634640 1 -- 172.21.15.45:0/2269316669 reap_dead start 2023-10-03T19:20:12.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.812+0000 7fcf58097640 1 -- 172.21.15.45:0/2269316669 shutdown_connections 2023-10-03T19:20:12.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.812+0000 7fcf58097640 1 -- 172.21.15.45:0/2269316669 >> 172.21.15.45:0/2269316669 conn(0x7fcf500a20d0 msgr2=0x7fcf500a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:12.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.812+0000 7fcf58097640 1 -- 172.21.15.45:0/2269316669 shutdown_connections 2023-10-03T19:20:12.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.812+0000 7fcf58097640 1 -- 172.21.15.45:0/2269316669 wait complete. 2023-10-03T19:20:12.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.812+0000 7fcf58097640 1 Processor -- start 2023-10-03T19:20:12.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.812+0000 7fcf58097640 1 -- start start 2023-10-03T19:20:12.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.812+0000 7fcf58097640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf3c0043b0 0x7fcf500b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:12.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.812+0000 7fcf58097640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf5006ed50 0x7fcf500b6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:12.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.812+0000 7fcf58097640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf50141560 0x7fcf501419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:12.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.812+0000 7fcf58097640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf50070710 con 0x7fcf50141560 2023-10-03T19:20:12.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.812+0000 7fcf58097640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf50070110 con 0x7fcf5006ed50 2023-10-03T19:20:12.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.812+0000 7fcf58097640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf50070b30 con 0x7fcf3c0043b0 2023-10-03T19:20:12.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.812+0000 7fcf56634640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf50141560 0x7fcf501419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:12.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.812+0000 7fcf56634640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf50141560 0x7fcf501419d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58520/0 (socket says 172.21.15.45:58520) 2023-10-03T19:20:12.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.812+0000 7fcf56634640 1 -- 172.21.15.45:0/1054374874 learned_addr learned my addr 172.21.15.45:0/1054374874 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:12.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.812+0000 7fcf55e33640 1 --2- 172.21.15.45:0/1054374874 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf3c0043b0 0x7fcf500b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:12.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.812+0000 7fcf55632640 1 --2- 172.21.15.45:0/1054374874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf5006ed50 0x7fcf500b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:12.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.816+0000 7fcf56634640 1 -- 172.21.15.45:0/1054374874 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf3c0043b0 msgr2=0x7fcf500b5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:12.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.816+0000 7fcf56634640 1 --2- 172.21.15.45:0/1054374874 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf3c0043b0 0x7fcf500b5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.816+0000 7fcf56634640 1 -- 172.21.15.45:0/1054374874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf5006ed50 msgr2=0x7fcf500b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:12.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.816+0000 7fcf56634640 1 --2- 172.21.15.45:0/1054374874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf5006ed50 0x7fcf500b6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.816+0000 7fcf56634640 1 -- 172.21.15.45:0/1054374874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf50071690 con 0x7fcf50141560 2023-10-03T19:20:12.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.816+0000 7fcf56634640 1 --2- 172.21.15.45:0/1054374874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf50141560 0x7fcf501419d0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fcf500bdf00 tx=0x7fcf4800e830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:12.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.816+0000 7fcf427fc640 1 -- 172.21.15.45:0/1054374874 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4800ecd0 con 0x7fcf50141560 2023-10-03T19:20:12.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.816+0000 7fcf427fc640 1 -- 172.21.15.45:0/1054374874 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4800ee50 con 0x7fcf50141560 2023-10-03T19:20:12.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.816+0000 7fcf58097640 1 -- 172.21.15.45:0/1054374874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5006cf40 con 0x7fcf50141560 2023-10-03T19:20:12.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.816+0000 7fcf427fc640 1 -- 172.21.15.45:0/1054374874 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf480136b0 con 0x7fcf50141560 2023-10-03T19:20:12.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.816+0000 7fcf58097640 1 -- 172.21.15.45:0/1054374874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf50071820 con 0x7fcf50141560 2023-10-03T19:20:12.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.816+0000 7fcf58097640 1 -- 172.21.15.45:0/1054374874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf50070850 con 0x7fcf50141560 2023-10-03T19:20:12.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.816+0000 7fcf427fc640 1 -- 172.21.15.45:0/1054374874 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcf48013810 con 0x7fcf50141560 2023-10-03T19:20:12.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.816+0000 7fcf427fc640 1 --2- 172.21.15.45:0/1054374874 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcf340662b0 0x7fcf34068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:12.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.816+0000 7fcf427fc640 1 -- 172.21.15.45:0/1054374874 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcf48082d80 con 0x7fcf50141560 2023-10-03T19:20:12.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.816+0000 7fcf55e33640 1 --2- 172.21.15.45:0/1054374874 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcf340662b0 0x7fcf34068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:12.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.816+0000 7fcf55e33640 1 --2- 172.21.15.45:0/1054374874 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcf340662b0 0x7fcf34068760 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c004880 tx=0x7fcf4c001440 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:12.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.820+0000 7fcf427fc640 1 -- 172.21.15.45:0/1054374874 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fcf50070850 con 0x7fcf50141560 2023-10-03T19:20:12.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.968+0000 7fcf58097640 1 -- 172.21.15.45:0/1054374874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf50070850 con 0x7fcf50141560 2023-10-03T19:20:12.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.968+0000 7fcf427fc640 1 -- 172.21.15.45:0/1054374874 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v105) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf50070850 con 0x7fcf50141560 2023-10-03T19:20:12.972 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:20:12.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.972+0000 7fcf58097640 1 -- 172.21.15.45:0/1054374874 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcf340662b0 msgr2=0x7fcf34068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:12.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.972+0000 7fcf58097640 1 --2- 172.21.15.45:0/1054374874 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcf340662b0 0x7fcf34068760 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c004880 tx=0x7fcf4c001440 comp rx=0 tx=0).stop 2023-10-03T19:20:12.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.972+0000 7fcf58097640 1 -- 172.21.15.45:0/1054374874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf50141560 msgr2=0x7fcf501419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:12.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.972+0000 7fcf58097640 1 --2- 172.21.15.45:0/1054374874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf50141560 0x7fcf501419d0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fcf500bdf00 tx=0x7fcf4800e830 comp rx=0 tx=0).stop 2023-10-03T19:20:12.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.972+0000 7fcf58097640 1 -- 172.21.15.45:0/1054374874 shutdown_connections 2023-10-03T19:20:12.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.972+0000 7fcf58097640 1 --2- 172.21.15.45:0/1054374874 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fcf340662b0 0x7fcf34068760 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.972+0000 7fcf58097640 1 --2- 172.21.15.45:0/1054374874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf50141560 0x7fcf501419d0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.972+0000 7fcf58097640 1 --2- 172.21.15.45:0/1054374874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf5006ed50 0x7fcf500b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.972+0000 7fcf58097640 1 --2- 172.21.15.45:0/1054374874 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf3c0043b0 0x7fcf500b5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:12.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.972+0000 7fcf58097640 1 -- 172.21.15.45:0/1054374874 >> 172.21.15.45:0/1054374874 conn(0x7fcf500a20d0 msgr2=0x7fcf500be730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:12.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.972+0000 7fcf58097640 1 -- 172.21.15.45:0/1054374874 shutdown_connections 2023-10-03T19:20:12.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:12.972+0000 7fcf58097640 1 -- 172.21.15.45:0/1054374874 wait complete. 2023-10-03T19:20:12.989 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:20:13.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.104+0000 7f4f426bd640 1 Processor -- start 2023-10-03T19:20:13.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.104+0000 7f4f426bd640 1 -- start start 2023-10-03T19:20:13.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.104+0000 7f4f426bd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4f3c0712c0 0x7f4f3c0bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:13.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.104+0000 7f4f426bd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f3c06c760 0x7f4f3c0bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:13.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.104+0000 7f4f426bd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f3c06c2d0 con 0x7f4f3c06d560 2023-10-03T19:20:13.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.104+0000 7f4f426bd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3c150610 con 0x7f4f3c0712c0 2023-10-03T19:20:13.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.104+0000 7f4f426bd640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c1508b0 con 0x7f4f3c06c760 2023-10-03T19:20:13.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.104+0000 7f4f3bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4f3c0712c0 0x7f4f3c0bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:13.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.104+0000 7f4f3b7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4f3c06d560 0x7f4f3c0a53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43434/0 (socket says 172.21.15.45:43434) 2023-10-03T19:20:13.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.104+0000 7f4f3b7fe640 1 -- 172.21.15.45:0/3422437083 learned_addr learned my addr 172.21.15.45:0/3422437083 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:20:13.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.104+0000 7f4f40c5a640 1 --2- 172.21.15.45:0/3422437083 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f3c06c760 0x7f4f3c0bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:13.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.104+0000 7f4f3bfff640 1 -- 172.21.15.45:0/3422437083 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f3c06c760 msgr2=0x7f4f3c0bd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:13.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.104+0000 7f4f3bfff640 1 --2- 172.21.15.45:0/3422437083 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f3c06c760 0x7f4f3c0bd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:13.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.104+0000 7f4f3bfff640 1 -- 172.21.15.45:0/3422437083 >> v1:172.21.15.45:6789/0 conn(0x7f4f3c06d560 legacy=0x7f4f3c0a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:13.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.104+0000 7f4f3affd640 1 -- 172.21.15.45:0/3422437083 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1513172712 0 0) 0x7f4f3c06c2d0 con 0x7f4f3c06d560 2023-10-03T19:20:13.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.104+0000 7f4f3bfff640 1 -- 172.21.15.45:0/3422437083 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c06d2e0 con 0x7f4f3c0712c0 2023-10-03T19:20:13.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.104+0000 7f4f40c5a640 1 --2- 172.21.15.45:0/3422437083 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f3c06c760 0x7f4f3c0bd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:20:13.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.108+0000 7f4f3bfff640 1 --2- 172.21.15.45:0/3422437083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f3c0712c0 0x7f4f3c0bcbc0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c0097c0 tx=0x7f4f2c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c28a4156fb6cd40 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:13.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.108+0000 7f4f3affd640 1 -- 172.21.15.45:0/3422437083 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c0ac620 con 0x7f4f3c0712c0 2023-10-03T19:20:13.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.108+0000 7f4f3affd640 1 -- 172.21.15.45:0/3422437083 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2c0ac780 con 0x7f4f3c0712c0 2023-10-03T19:20:13.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.108+0000 7f4f3affd640 1 -- 172.21.15.45:0/3422437083 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c0acb10 con 0x7f4f3c0712c0 2023-10-03T19:20:13.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.108+0000 7f4f426bd640 1 -- 172.21.15.45:0/3422437083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f3c0712c0 msgr2=0x7f4f3c0bcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:13.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.108+0000 7f4f426bd640 1 --2- 172.21.15.45:0/3422437083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f3c0712c0 0x7f4f3c0bcbc0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c0097c0 tx=0x7f4f2c01c480 comp rx=0 tx=0).stop 2023-10-03T19:20:13.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.108+0000 7f4f426bd640 1 -- 172.21.15.45:0/3422437083 shutdown_connections 2023-10-03T19:20:13.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.108+0000 7f4f426bd640 1 --2- 172.21.15.45:0/3422437083 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f3c06c760 0x7f4f3c0bd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:13.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.108+0000 7f4f426bd640 1 --2- 172.21.15.45:0/3422437083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f3c0712c0 0x7f4f3c0bcbc0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:13.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.108+0000 7f4f426bd640 1 -- 172.21.15.45:0/3422437083 >> 172.21.15.45:0/3422437083 conn(0x7f4f3c0a20d0 msgr2=0x7f4f3c0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:13.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.108+0000 7f4f426bd640 1 -- 172.21.15.45:0/3422437083 shutdown_connections 2023-10-03T19:20:13.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.108+0000 7f4f426bd640 1 -- 172.21.15.45:0/3422437083 wait complete. 2023-10-03T19:20:13.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.108+0000 7f4f426bd640 1 Processor -- start 2023-10-03T19:20:13.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.108+0000 7f4f426bd640 1 -- start start 2023-10-03T19:20:13.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.108+0000 7f4f426bd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f3c06c760 0x7f4f3c0b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:13.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.108+0000 7f4f426bd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f3c06d560 0x7f4f3c143b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:13.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.108+0000 7f4f426bd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f3c0712c0 0x7f4f3c144080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:13.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.108+0000 7f4f426bd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c1445c0 con 0x7f4f3c06c760 2023-10-03T19:20:13.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.108+0000 7f4f426bd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c0b6360 con 0x7f4f3c06d560 2023-10-03T19:20:13.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.108+0000 7f4f426bd640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c1e5910 con 0x7f4f3c0712c0 2023-10-03T19:20:13.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.108+0000 7f4f3bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f3c06c760 0x7f4f3c0b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:13.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.108+0000 7f4f3bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f3c06c760 0x7f4f3c0b5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58536/0 (socket says 172.21.15.45:58536) 2023-10-03T19:20:13.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.108+0000 7f4f3bfff640 1 -- 172.21.15.45:0/3179964015 learned_addr learned my addr 172.21.15.45:0/3179964015 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:13.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.108+0000 7f4f3bfff640 1 -- 172.21.15.45:0/3179964015 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f3c0712c0 msgr2=0x7f4f3c144080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:13.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.108+0000 7f4f40c5a640 1 --2- 172.21.15.45:0/3179964015 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f3c0712c0 0x7f4f3c144080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:13.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.108+0000 7f4f3bfff640 1 --2- 172.21.15.45:0/3179964015 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f3c0712c0 0x7f4f3c144080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:13.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.108+0000 7f4f3b7fe640 1 --2- 172.21.15.45:0/3179964015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f3c06d560 0x7f4f3c143b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:13.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.112+0000 7f4f3bfff640 1 -- 172.21.15.45:0/3179964015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f3c06d560 msgr2=0x7f4f3c143b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:13.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.112+0000 7f4f3bfff640 1 --2- 172.21.15.45:0/3179964015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f3c06d560 0x7f4f3c143b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:13.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.112+0000 7f4f3bfff640 1 -- 172.21.15.45:0/3179964015 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2c009420 con 0x7f4f3c06c760 2023-10-03T19:20:13.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.112+0000 7f4f3b7fe640 1 --2- 172.21.15.45:0/3179964015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f3c06d560 0x7f4f3c143b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:13.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.112+0000 7f4f3bfff640 1 --2- 172.21.15.45:0/3179964015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f3c06c760 0x7f4f3c0b5e20 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c01a0b0 tx=0x7f4f2c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:13.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.112+0000 7f4f38ff9640 1 -- 172.21.15.45:0/3179964015 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c0b8450 con 0x7f4f3c06c760 2023-10-03T19:20:13.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.112+0000 7f4f38ff9640 1 -- 172.21.15.45:0/3179964015 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2c0b85b0 con 0x7f4f3c06c760 2023-10-03T19:20:13.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.112+0000 7f4f426bd640 1 -- 172.21.15.45:0/3179964015 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f3c0a6070 con 0x7f4f3c06c760 2023-10-03T19:20:13.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.112+0000 7f4f38ff9640 1 -- 172.21.15.45:0/3179964015 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c0b8960 con 0x7f4f3c06c760 2023-10-03T19:20:13.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.112+0000 7f4f426bd640 1 -- 172.21.15.45:0/3179964015 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3c0a5ee0 con 0x7f4f3c06c760 2023-10-03T19:20:13.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.112+0000 7f4f426bd640 1 -- 172.21.15.45:0/3179964015 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f3c1596f0 con 0x7f4f3c06c760 2023-10-03T19:20:13.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.112+0000 7f4f38ff9640 1 -- 172.21.15.45:0/3179964015 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4f2c0aa070 con 0x7f4f3c06c760 2023-10-03T19:20:13.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.112+0000 7f4f38ff9640 1 --2- 172.21.15.45:0/3179964015 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4f280662b0 0x7f4f28068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:13.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.112+0000 7f4f38ff9640 1 -- 172.21.15.45:0/3179964015 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4f2c11e520 con 0x7f4f3c06c760 2023-10-03T19:20:13.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.112+0000 7f4f3b7fe640 1 --2- 172.21.15.45:0/3179964015 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4f280662b0 0x7f4f28068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:13.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.112+0000 7f4f3b7fe640 1 --2- 172.21.15.45:0/3179964015 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4f280662b0 0x7f4f28068760 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0a57f0 tx=0x7f4f30009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:13.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.116+0000 7f4f38ff9640 1 -- 172.21.15.45:0/3179964015 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4f2c0ebda0 con 0x7f4f3c06c760 2023-10-03T19:20:13.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.268+0000 7f4f426bd640 1 -- 172.21.15.45:0/3179964015 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4f3c0bca30 con 0x7f4f3c06c760 2023-10-03T19:20:13.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.272+0000 7f4f38ff9640 1 -- 172.21.15.45:0/3179964015 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v105) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4f2c0ef380 con 0x7f4f3c06c760 2023-10-03T19:20:13.274 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:20:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.272+0000 7f4f426bd640 1 -- 172.21.15.45:0/3179964015 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4f280662b0 msgr2=0x7f4f28068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.272+0000 7f4f426bd640 1 --2- 172.21.15.45:0/3179964015 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4f280662b0 0x7f4f28068760 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0a57f0 tx=0x7f4f30009040 comp rx=0 tx=0).stop 2023-10-03T19:20:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.272+0000 7f4f426bd640 1 -- 172.21.15.45:0/3179964015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f3c06c760 msgr2=0x7f4f3c0b5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.272+0000 7f4f426bd640 1 --2- 172.21.15.45:0/3179964015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f3c06c760 0x7f4f3c0b5e20 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c01a0b0 tx=0x7f4f2c01acc0 comp rx=0 tx=0).stop 2023-10-03T19:20:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.272+0000 7f4f426bd640 1 -- 172.21.15.45:0/3179964015 shutdown_connections 2023-10-03T19:20:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.272+0000 7f4f426bd640 1 --2- 172.21.15.45:0/3179964015 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4f280662b0 0x7f4f28068760 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.272+0000 7f4f426bd640 1 --2- 172.21.15.45:0/3179964015 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f3c0712c0 0x7f4f3c144080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.272+0000 7f4f426bd640 1 --2- 172.21.15.45:0/3179964015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f3c06d560 0x7f4f3c143b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:13.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.272+0000 7f4f426bd640 1 --2- 172.21.15.45:0/3179964015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f3c06c760 0x7f4f3c0b5e20 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:13.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.272+0000 7f4f426bd640 1 -- 172.21.15.45:0/3179964015 >> 172.21.15.45:0/3179964015 conn(0x7f4f3c0a20d0 msgr2=0x7f4f3c0baf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:13.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.272+0000 7f4f426bd640 1 -- 172.21.15.45:0/3179964015 shutdown_connections 2023-10-03T19:20:13.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.272+0000 7f4f426bd640 1 -- 172.21.15.45:0/3179964015 wait complete. 2023-10-03T19:20:13.292 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-03T19:20:13.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.420+0000 7f5f77f3b640 1 Processor -- start 2023-10-03T19:20:13.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.420+0000 7f5f77f3b640 1 -- start start 2023-10-03T19:20:13.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.420+0000 7f5f77f3b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f7014f600 0x7f5f7014be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:13.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.420+0000 7f5f77f3b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5f7006ce00 0x7f5f7006f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:13.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.420+0000 7f5f77f3b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f7014f170 con 0x7f5f70070b30 2023-10-03T19:20:13.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.420+0000 7f5f77f3b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f7014c3f0 con 0x7f5f7006ce00 2023-10-03T19:20:13.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.420+0000 7f5f77f3b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7006d400 con 0x7f5f7014f600 2023-10-03T19:20:13.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.420+0000 7f5f764d8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5f7006ce00 0x7f5f7006f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:13.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.420+0000 7f5f764d8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5f7006ce00 0x7f5f7006f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58546/0 (socket says 172.21.15.45:58546) 2023-10-03T19:20:13.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.420+0000 7f5f764d8640 1 -- 172.21.15.45:0/4208279106 learned_addr learned my addr 172.21.15.45:0/4208279106 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:13.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.420+0000 7f5f764d8640 1 -- 172.21.15.45:0/4208279106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f7014f600 msgr2=0x7f5f7014be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:13.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.420+0000 7f5f754d6640 1 --2- 172.21.15.45:0/4208279106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f7014f600 0x7f5f7014be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:13.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.420+0000 7f5f764d8640 1 --2- 172.21.15.45:0/4208279106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f7014f600 0x7f5f7014be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:13.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.420+0000 7f5f764d8640 1 -- 172.21.15.45:0/4208279106 >> v1:172.21.15.45:6789/0 conn(0x7f5f70070b30 legacy=0x7f5f700bdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:13.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.420+0000 7f5f764d8640 1 -- 172.21.15.45:0/4208279106 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7014eb20 con 0x7f5f7006ce00 2023-10-03T19:20:13.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.420+0000 7f5f74cd5640 1 -- 172.21.15.45:0/4208279106 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144823127 0 0) 0x7f5f7014f170 con 0x7f5f70070b30 2023-10-03T19:20:13.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.420+0000 7f5f754d6640 1 --2- 172.21.15.45:0/4208279106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f7014f600 0x7f5f7014be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:13.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.420+0000 7f5f764d8640 1 --2- 172.21.15.45:0/4208279106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f7006ce00 0x7f5f7006f770 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009e50 tx=0x7f5f6801f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43c8e208e3bcfc15 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:13.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.424+0000 7f5f74cd5640 1 -- 172.21.15.45:0/4208279106 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f680af400 con 0x7f5f7006ce00 2023-10-03T19:20:13.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.424+0000 7f5f74cd5640 1 -- 172.21.15.45:0/4208279106 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f680ab050 con 0x7f5f7006ce00 2023-10-03T19:20:13.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.424+0000 7f5f74cd5640 1 -- 172.21.15.45:0/4208279106 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f680af780 con 0x7f5f7006ce00 2023-10-03T19:20:13.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.424+0000 7f5f77f3b640 1 -- 172.21.15.45:0/4208279106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f7006ce00 msgr2=0x7f5f7006f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:13.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.424+0000 7f5f77f3b640 1 --2- 172.21.15.45:0/4208279106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f7006ce00 0x7f5f7006f770 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009e50 tx=0x7f5f6801f1f0 comp rx=0 tx=0).stop 2023-10-03T19:20:13.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.424+0000 7f5f77f3b640 1 -- 172.21.15.45:0/4208279106 shutdown_connections 2023-10-03T19:20:13.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.424+0000 7f5f77f3b640 1 --2- 172.21.15.45:0/4208279106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f7006ce00 0x7f5f7006f770 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:13.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.424+0000 7f5f77f3b640 1 --2- 172.21.15.45:0/4208279106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f7014f600 0x7f5f7014be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:13.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.424+0000 7f5f77f3b640 1 -- 172.21.15.45:0/4208279106 >> 172.21.15.45:0/4208279106 conn(0x7f5f700c1a10 msgr2=0x7f5f700bd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:13.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.424+0000 7f5f77f3b640 1 -- 172.21.15.45:0/4208279106 shutdown_connections 2023-10-03T19:20:13.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.424+0000 7f5f77f3b640 1 -- 172.21.15.45:0/4208279106 wait complete. 2023-10-03T19:20:13.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.424+0000 7f5f77f3b640 1 Processor -- start 2023-10-03T19:20:13.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.424+0000 7f5f77f3b640 1 -- start start 2023-10-03T19:20:13.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.424+0000 7f5f77f3b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f7006ce00 0x7f5f701df0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:13.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.424+0000 7f5f77f3b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f70070b30 0x7f5f700c0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:13.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.424+0000 7f5f77f3b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f7014f600 0x7f5f701e2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:13.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.424+0000 7f5f77f3b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f701e2640 con 0x7f5f7014f600 2023-10-03T19:20:13.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.424+0000 7f5f77f3b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f700c08a0 con 0x7f5f7006ce00 2023-10-03T19:20:13.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.424+0000 7f5f77f3b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f700b80d0 con 0x7f5f70070b30 2023-10-03T19:20:13.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.424+0000 7f5f764d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f7014f600 0x7f5f701e2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:13.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.424+0000 7f5f764d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f7014f600 0x7f5f701e2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58552/0 (socket says 172.21.15.45:58552) 2023-10-03T19:20:13.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.424+0000 7f5f764d8640 1 -- 172.21.15.45:0/3717109104 learned_addr learned my addr 172.21.15.45:0/3717109104 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:13.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.424+0000 7f5f754d6640 1 --2- 172.21.15.45:0/3717109104 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f70070b30 0x7f5f700c0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:13.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.424+0000 7f5f75cd7640 1 --2- 172.21.15.45:0/3717109104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f7006ce00 0x7f5f701df0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:13.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.428+0000 7f5f764d8640 1 -- 172.21.15.45:0/3717109104 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f70070b30 msgr2=0x7f5f700c0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:13.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.428+0000 7f5f764d8640 1 --2- 172.21.15.45:0/3717109104 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f70070b30 0x7f5f700c0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:13.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.428+0000 7f5f764d8640 1 -- 172.21.15.45:0/3717109104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f7006ce00 msgr2=0x7f5f701df0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:13.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.428+0000 7f5f764d8640 1 --2- 172.21.15.45:0/3717109104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f7006ce00 0x7f5f701df0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:13.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.428+0000 7f5f764d8640 1 -- 172.21.15.45:0/3717109104 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f68009b30 con 0x7f5f7014f600 2023-10-03T19:20:13.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.428+0000 7f5f764d8640 1 --2- 172.21.15.45:0/3717109104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f7014f600 0x7f5f701e2d90 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f5f6801ce20 tx=0x7f5f6801bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:13.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.428+0000 7f5f667fc640 1 -- 172.21.15.45:0/3717109104 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f680afde0 con 0x7f5f7014f600 2023-10-03T19:20:13.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.428+0000 7f5f667fc640 1 -- 172.21.15.45:0/3717109104 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f68009510 con 0x7f5f7014f600 2023-10-03T19:20:13.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.428+0000 7f5f667fc640 1 -- 172.21.15.45:0/3717109104 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f680b8640 con 0x7f5f7014f600 2023-10-03T19:20:13.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.428+0000 7f5f77f3b640 1 -- 172.21.15.45:0/3717109104 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f700be620 con 0x7f5f7014f600 2023-10-03T19:20:13.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.428+0000 7f5f77f3b640 1 -- 172.21.15.45:0/3717109104 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7014ee00 con 0x7f5f7014f600 2023-10-03T19:20:13.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.428+0000 7f5f77f3b640 1 -- 172.21.15.45:0/3717109104 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f70070f00 con 0x7f5f7014f600 2023-10-03T19:20:13.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.428+0000 7f5f667fc640 1 -- 172.21.15.45:0/3717109104 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5f680b6040 con 0x7f5f7014f600 2023-10-03T19:20:13.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.428+0000 7f5f667fc640 1 --2- 172.21.15.45:0/3717109104 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5f54066280 0x7f5f54068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:13.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.428+0000 7f5f667fc640 1 -- 172.21.15.45:0/3717109104 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5f68121aa0 con 0x7f5f7014f600 2023-10-03T19:20:13.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.428+0000 7f5f75cd7640 1 --2- 172.21.15.45:0/3717109104 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5f54066280 0x7f5f54068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:13.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.428+0000 7f5f75cd7640 1 --2- 172.21.15.45:0/3717109104 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5f54066280 0x7f5f54068730 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c000f70 tx=0x7f5f6c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:13.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.432+0000 7f5f667fc640 1 -- 172.21.15.45:0/3717109104 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5f680ef260 con 0x7f5f7014f600 2023-10-03T19:20:13.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.584+0000 7f5f77f3b640 1 -- 172.21.15.45:0/3717109104 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5f7004de80 con 0x7f5f7014f600 2023-10-03T19:20:13.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.588+0000 7f5f667fc640 1 -- 172.21.15.45:0/3717109104 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v105) v1 ==== 84+0+126 (secure 0 0 0) 0x7f5f680b4070 con 0x7f5f7014f600 2023-10-03T19:20:13.590 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:20:13.590 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-10-03T19:20:13.590 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:20:13.590 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-10-03T19:20:13.590 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-10-03T19:20:13.590 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-10-03T19:20:13.591 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-10-03T19:20:13.591 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 2, 2023-10-03T19:20:13.591 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "rbd" 2023-10-03T19:20:13.591 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-10-03T19:20:13.591 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-10-03T19:20:13.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.588+0000 7f5f77f3b640 1 -- 172.21.15.45:0/3717109104 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5f54066280 msgr2=0x7f5f54068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:13.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.588+0000 7f5f77f3b640 1 --2- 172.21.15.45:0/3717109104 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5f54066280 0x7f5f54068730 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c000f70 tx=0x7f5f6c009040 comp rx=0 tx=0).stop 2023-10-03T19:20:13.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.588+0000 7f5f77f3b640 1 -- 172.21.15.45:0/3717109104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f7014f600 msgr2=0x7f5f701e2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:13.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.588+0000 7f5f77f3b640 1 --2- 172.21.15.45:0/3717109104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f7014f600 0x7f5f701e2d90 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f5f6801ce20 tx=0x7f5f6801bf90 comp rx=0 tx=0).stop 2023-10-03T19:20:13.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.588+0000 7f5f77f3b640 1 -- 172.21.15.45:0/3717109104 shutdown_connections 2023-10-03T19:20:13.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.588+0000 7f5f77f3b640 1 --2- 172.21.15.45:0/3717109104 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5f54066280 0x7f5f54068730 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:13.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.588+0000 7f5f77f3b640 1 --2- 172.21.15.45:0/3717109104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f7014f600 0x7f5f701e2d90 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:13.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.588+0000 7f5f77f3b640 1 --2- 172.21.15.45:0/3717109104 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5f70070b30 0x7f5f700c0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:13.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.588+0000 7f5f77f3b640 1 --2- 172.21.15.45:0/3717109104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f7006ce00 0x7f5f701df0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:13.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.588+0000 7f5f77f3b640 1 -- 172.21.15.45:0/3717109104 >> 172.21.15.45:0/3717109104 conn(0x7f5f700c1a10 msgr2=0x7f5f7014d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:13.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.588+0000 7f5f77f3b640 1 -- 172.21.15.45:0/3717109104 shutdown_connections 2023-10-03T19:20:13.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.588+0000 7f5f77f3b640 1 -- 172.21.15.45:0/3717109104 wait complete. 2023-10-03T19:20:13.608 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-03T19:20:13.608 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-03T19:20:13.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.724+0000 7f89e2794640 1 Processor -- start 2023-10-03T19:20:13.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.724+0000 7f89e2794640 1 -- start start 2023-10-03T19:20:13.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.724+0000 7f89e2794640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f89dc148540 0x7f89dc0bb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:13.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.724+0000 7f89e2794640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f89dc0bb5a0 0x7f89dc14f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:13.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.724+0000 7f89e2794640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89dc0bcf80 con 0x7f89dc06d630 2023-10-03T19:20:13.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.724+0000 7f89e2794640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89dc152b50 con 0x7f89dc0bb5a0 2023-10-03T19:20:13.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.724+0000 7f89e2794640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89dc14e550 con 0x7f89dc148540 2023-10-03T19:20:13.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.724+0000 7f89e0d31640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f89dc0bb5a0 0x7f89dc14f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:13.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.724+0000 7f89e0d31640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f89dc0bb5a0 0x7f89dc14f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58566/0 (socket says 172.21.15.45:58566) 2023-10-03T19:20:13.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.724+0000 7f89e0d31640 1 -- 172.21.15.45:0/2671957821 learned_addr learned my addr 172.21.15.45:0/2671957821 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:13.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.724+0000 7f89dbfff640 1 --2- 172.21.15.45:0/2671957821 >> v2:172.21.15.79:3300/0 conn(0x7f89dc148540 0x7f89dc0bb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:13.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.724+0000 7f89e0d31640 1 -- 172.21.15.45:0/2671957821 >> v2:172.21.15.79:3300/0 conn(0x7f89dc148540 msgr2=0x7f89dc0bb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:13.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.724+0000 7f89e0d31640 1 --2- 172.21.15.45:0/2671957821 >> v2:172.21.15.79:3300/0 conn(0x7f89dc148540 0x7f89dc0bb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:13.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.724+0000 7f89e0d31640 1 -- 172.21.15.45:0/2671957821 >> v1:172.21.15.79:6789/0 conn(0x7f89dc06d630 legacy=0x7f89dc14e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:13.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.724+0000 7f89e0d31640 1 -- 172.21.15.45:0/2671957821 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc0bd260 con 0x7f89dc0bb5a0 2023-10-03T19:20:13.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.728+0000 7f89e0d31640 1 --2- 172.21.15.45:0/2671957821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89dc0bb5a0 0x7f89dc14f0b0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0bd960 tx=0x7f89cc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ae850920886f8d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:13.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.728+0000 7f89daffd640 1 -- 172.21.15.45:0/2671957821 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc0ac620 con 0x7f89dc0bb5a0 2023-10-03T19:20:13.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.728+0000 7f89daffd640 1 -- 172.21.15.45:0/2671957821 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89cc0ac780 con 0x7f89dc0bb5a0 2023-10-03T19:20:13.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.728+0000 7f89daffd640 1 -- 172.21.15.45:0/2671957821 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc0acb10 con 0x7f89dc0bb5a0 2023-10-03T19:20:13.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.728+0000 7f89e2794640 1 -- 172.21.15.45:0/2671957821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89dc0bb5a0 msgr2=0x7f89dc14f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:13.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.728+0000 7f89e2794640 1 --2- 172.21.15.45:0/2671957821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89dc0bb5a0 0x7f89dc14f0b0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0bd960 tx=0x7f89cc01c490 comp rx=0 tx=0).stop 2023-10-03T19:20:13.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.728+0000 7f89e2794640 1 -- 172.21.15.45:0/2671957821 shutdown_connections 2023-10-03T19:20:13.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.728+0000 7f89e2794640 1 --2- 172.21.15.45:0/2671957821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89dc0bb5a0 0x7f89dc14f0b0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:13.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.728+0000 7f89e2794640 1 --2- 172.21.15.45:0/2671957821 >> v2:172.21.15.79:3300/0 conn(0x7f89dc148540 0x7f89dc0bb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:13.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.728+0000 7f89e2794640 1 -- 172.21.15.45:0/2671957821 >> 172.21.15.45:0/2671957821 conn(0x7f89dc0a20d0 msgr2=0x7f89dc0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:13.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.728+0000 7f89e2794640 1 -- 172.21.15.45:0/2671957821 shutdown_connections 2023-10-03T19:20:13.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.728+0000 7f89e2794640 1 -- 172.21.15.45:0/2671957821 wait complete. 2023-10-03T19:20:13.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.728+0000 7f89e2794640 1 Processor -- start 2023-10-03T19:20:13.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.728+0000 7f89e2794640 1 -- start start 2023-10-03T19:20:13.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.732+0000 7f89e2794640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89dc06d630 0x7f89dc0a33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:13.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.732+0000 7f89e2794640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89dc0bb5a0 0x7f89dc0701b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:13.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.732+0000 7f89e2794640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89dc148540 0x7f89dc14b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:13.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.732+0000 7f89e2794640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc0706f0 con 0x7f89dc06d630 2023-10-03T19:20:13.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.732+0000 7f89e2794640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc145610 con 0x7f89dc148540 2023-10-03T19:20:13.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.732+0000 7f89e2794640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc0a5bc0 con 0x7f89dc0bb5a0 2023-10-03T19:20:13.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.732+0000 7f89dbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89dc06d630 0x7f89dc0a33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:13.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.732+0000 7f89dbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89dc06d630 0x7f89dc0a33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58574/0 (socket says 172.21.15.45:58574) 2023-10-03T19:20:13.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.732+0000 7f89dbfff640 1 -- 172.21.15.45:0/4115835758 learned_addr learned my addr 172.21.15.45:0/4115835758 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:13.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.732+0000 7f89db7fe640 1 --2- 172.21.15.45:0/4115835758 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89dc0bb5a0 0x7f89dc0701b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:13.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.732+0000 7f89e0d31640 1 --2- 172.21.15.45:0/4115835758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89dc148540 0x7f89dc14b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:13.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.732+0000 7f89dbfff640 1 -- 172.21.15.45:0/4115835758 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89dc0bb5a0 msgr2=0x7f89dc0701b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:13.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.732+0000 7f89dbfff640 1 --2- 172.21.15.45:0/4115835758 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89dc0bb5a0 0x7f89dc0701b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:13.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.732+0000 7f89dbfff640 1 -- 172.21.15.45:0/4115835758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89dc148540 msgr2=0x7f89dc14b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:13.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.732+0000 7f89dbfff640 1 --2- 172.21.15.45:0/4115835758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89dc148540 0x7f89dc14b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:13.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.732+0000 7f89dbfff640 1 -- 172.21.15.45:0/4115835758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc0094d0 con 0x7f89dc06d630 2023-10-03T19:20:13.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.732+0000 7f89e0d31640 1 --2- 172.21.15.45:0/4115835758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89dc148540 0x7f89dc14b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:13.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.732+0000 7f89dbfff640 1 --2- 172.21.15.45:0/4115835758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89dc06d630 0x7f89dc0a33d0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f89d4007e40 tx=0x7f89d400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:13.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.732+0000 7f89d8ff9640 1 -- 172.21.15.45:0/4115835758 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d4014620 con 0x7f89dc06d630 2023-10-03T19:20:13.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.732+0000 7f89d8ff9640 1 -- 172.21.15.45:0/4115835758 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d400ee90 con 0x7f89dc06d630 2023-10-03T19:20:13.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.732+0000 7f89e2794640 1 -- 172.21.15.45:0/4115835758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89dc0bdda0 con 0x7f89dc06d630 2023-10-03T19:20:13.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.732+0000 7f89d8ff9640 1 -- 172.21.15.45:0/4115835758 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d40149c0 con 0x7f89dc06d630 2023-10-03T19:20:13.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.732+0000 7f89e2794640 1 -- 172.21.15.45:0/4115835758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89dc0bdc10 con 0x7f89dc06d630 2023-10-03T19:20:13.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.732+0000 7f89e2794640 1 -- 172.21.15.45:0/4115835758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89dc152350 con 0x7f89dc06d630 2023-10-03T19:20:13.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.732+0000 7f89d8ff9640 1 -- 172.21.15.45:0/4115835758 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f89d4014b20 con 0x7f89dc06d630 2023-10-03T19:20:13.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.732+0000 7f89d8ff9640 1 --2- 172.21.15.45:0/4115835758 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f89bc066280 0x7f89bc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:13.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.732+0000 7f89d8ff9640 1 -- 172.21.15.45:0/4115835758 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f89d4084370 con 0x7f89dc06d630 2023-10-03T19:20:13.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.732+0000 7f89db7fe640 1 --2- 172.21.15.45:0/4115835758 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f89bc066280 0x7f89bc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:13.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.736+0000 7f89db7fe640 1 --2- 172.21.15.45:0/4115835758 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f89bc066280 0x7f89bc068730 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0bba70 tx=0x7f89c4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:13.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.736+0000 7f89d8ff9640 1 -- 172.21.15.45:0/4115835758 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f89d4051b40 con 0x7f89dc06d630 2023-10-03T19:20:13.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:13.896+0000 7f89e2794640 1 -- 172.21.15.45:0/4115835758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f89dc14afd0 con 0x7f89dc06d630 2023-10-03T19:20:14.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:14.908+0000 7f89d8ff9640 1 -- 172.21.15.45:0/4115835758 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v106) v1 ==== 138+0+0 (secure 0 0 0) 0x7f89d4055160 con 0x7f89dc06d630 2023-10-03T19:20:14.911 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-10-03T19:20:14.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:14.912+0000 7f89e2794640 1 -- 172.21.15.45:0/4115835758 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f89bc066280 msgr2=0x7f89bc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:14.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:14.912+0000 7f89e2794640 1 --2- 172.21.15.45:0/4115835758 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f89bc066280 0x7f89bc068730 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0bba70 tx=0x7f89c4009040 comp rx=0 tx=0).stop 2023-10-03T19:20:14.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:14.912+0000 7f89e2794640 1 -- 172.21.15.45:0/4115835758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89dc06d630 msgr2=0x7f89dc0a33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:14.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:14.912+0000 7f89e2794640 1 --2- 172.21.15.45:0/4115835758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89dc06d630 0x7f89dc0a33d0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f89d4007e40 tx=0x7f89d400e4b0 comp rx=0 tx=0).stop 2023-10-03T19:20:14.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:14.912+0000 7f89e2794640 1 -- 172.21.15.45:0/4115835758 shutdown_connections 2023-10-03T19:20:14.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:14.912+0000 7f89e2794640 1 --2- 172.21.15.45:0/4115835758 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f89bc066280 0x7f89bc068730 secure :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0bba70 tx=0x7f89c4009040 comp rx=0 tx=0).stop 2023-10-03T19:20:14.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:14.912+0000 7f89e2794640 1 --2- 172.21.15.45:0/4115835758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89dc148540 0x7f89dc14b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:14.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:14.912+0000 7f89e2794640 1 --2- 172.21.15.45:0/4115835758 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f89dc0bb5a0 0x7f89dc0701b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:14.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:14.912+0000 7f89e2794640 1 --2- 172.21.15.45:0/4115835758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89dc06d630 0x7f89dc0a33d0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:14.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:14.912+0000 7f89e2794640 1 -- 172.21.15.45:0/4115835758 >> 172.21.15.45:0/4115835758 conn(0x7f89dc0a20d0 msgr2=0x7f89dc0c0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:14.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:14.916+0000 7f89e2794640 1 -- 172.21.15.45:0/4115835758 shutdown_connections 2023-10-03T19:20:14.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:14.916+0000 7f89e2794640 1 -- 172.21.15.45:0/4115835758 wait complete. 2023-10-03T19:20:14.942 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-03T19:20:15.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.072+0000 7f2a1a3c8640 1 Processor -- start 2023-10-03T19:20:15.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.072+0000 7f2a1a3c8640 1 -- start start 2023-10-03T19:20:15.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.076+0000 7f2a1a3c8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2a140712c0 0x7f2a1406cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:15.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.076+0000 7f2a1a3c8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2a1406c3f0 0x7f2a140a5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:15.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.076+0000 7f2a1a3c8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a140a6260 con 0x7f2a1414c3d0 2023-10-03T19:20:15.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.076+0000 7f2a1a3c8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a140bc250 con 0x7f2a1406c3f0 2023-10-03T19:20:15.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.076+0000 7f2a1a3c8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a141507f0 con 0x7f2a140712c0 2023-10-03T19:20:15.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.076+0000 7f2a137fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2a1406c3f0 0x7f2a140a5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:15.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.076+0000 7f2a137fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2a1406c3f0 0x7f2a140a5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42796/0 (socket says 172.21.15.45:42796) 2023-10-03T19:20:15.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.076+0000 7f2a137fe640 1 -- 172.21.15.45:0/2207313351 learned_addr learned my addr 172.21.15.45:0/2207313351 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:15.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.076+0000 7f2a13fff640 1 --2- 172.21.15.45:0/2207313351 >> v2:172.21.15.79:3300/0 conn(0x7f2a140712c0 0x7f2a1406cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:15.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.076+0000 7f2a137fe640 1 -- 172.21.15.45:0/2207313351 >> v2:172.21.15.79:3300/0 conn(0x7f2a140712c0 msgr2=0x7f2a1406cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:15.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.076+0000 7f2a137fe640 1 --2- 172.21.15.45:0/2207313351 >> v2:172.21.15.79:3300/0 conn(0x7f2a140712c0 0x7f2a1406cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:15.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.076+0000 7f2a137fe640 1 -- 172.21.15.45:0/2207313351 >> v1:172.21.15.79:6789/0 conn(0x7f2a1414c3d0 legacy=0x7f2a140a4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:15.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.076+0000 7f2a137fe640 1 -- 172.21.15.45:0/2207313351 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a140a5a40 con 0x7f2a1406c3f0 2023-10-03T19:20:15.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.076+0000 7f2a137fe640 1 --2- 172.21.15.45:0/2207313351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a1406c3f0 0x7f2a140a5d20 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f2a140c02f0 tx=0x7f2a0401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae480cbd3f92066 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:15.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.076+0000 7f2a12ffd640 1 -- 172.21.15.45:0/2207313351 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a040ac410 con 0x7f2a1406c3f0 2023-10-03T19:20:15.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.076+0000 7f2a12ffd640 1 -- 172.21.15.45:0/2207313351 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a040ac570 con 0x7f2a1406c3f0 2023-10-03T19:20:15.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.076+0000 7f2a12ffd640 1 -- 172.21.15.45:0/2207313351 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a040ac900 con 0x7f2a1406c3f0 2023-10-03T19:20:15.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a1a3c8640 1 -- 172.21.15.45:0/2207313351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a1406c3f0 msgr2=0x7f2a140a5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:15.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a1a3c8640 1 --2- 172.21.15.45:0/2207313351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a1406c3f0 0x7f2a140a5d20 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f2a140c02f0 tx=0x7f2a0401c3b0 comp rx=0 tx=0).stop 2023-10-03T19:20:15.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a1a3c8640 1 -- 172.21.15.45:0/2207313351 shutdown_connections 2023-10-03T19:20:15.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a1a3c8640 1 --2- 172.21.15.45:0/2207313351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a1406c3f0 0x7f2a140a5d20 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:15.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a1a3c8640 1 --2- 172.21.15.45:0/2207313351 >> v2:172.21.15.79:3300/0 conn(0x7f2a140712c0 0x7f2a1406cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:15.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a1a3c8640 1 -- 172.21.15.45:0/2207313351 >> 172.21.15.45:0/2207313351 conn(0x7f2a140a20d0 msgr2=0x7f2a140a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:15.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a1a3c8640 1 -- 172.21.15.45:0/2207313351 shutdown_connections 2023-10-03T19:20:15.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a1a3c8640 1 -- 172.21.15.45:0/2207313351 wait complete. 2023-10-03T19:20:15.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a1a3c8640 1 Processor -- start 2023-10-03T19:20:15.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a1a3c8640 1 -- start start 2023-10-03T19:20:15.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a1a3c8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a1406c3f0 0x7f2a141441e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:15.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a1a3c8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2a140712c0 0x7f2a141e7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:15.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a1a3c8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a1414c3d0 0x7f2a141e7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:15.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a1a3c8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a14149b50 con 0x7f2a1406c3f0 2023-10-03T19:20:15.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a1a3c8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1414faa0 con 0x7f2a1414c3d0 2023-10-03T19:20:15.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a1a3c8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a14144c70 con 0x7f2a140712c0 2023-10-03T19:20:15.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a13fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a1406c3f0 0x7f2a141441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:15.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a13fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a1406c3f0 0x7f2a141441e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42800/0 (socket says 172.21.15.45:42800) 2023-10-03T19:20:15.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a13fff640 1 -- 172.21.15.45:0/3126940053 learned_addr learned my addr 172.21.15.45:0/3126940053 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:15.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a137fe640 1 --2- 172.21.15.45:0/3126940053 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2a140712c0 0x7f2a141e7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:15.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a18965640 1 --2- 172.21.15.45:0/3126940053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a1414c3d0 0x7f2a141e7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:15.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a13fff640 1 -- 172.21.15.45:0/3126940053 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2a140712c0 msgr2=0x7f2a141e7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:15.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a13fff640 1 --2- 172.21.15.45:0/3126940053 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2a140712c0 0x7f2a141e7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:15.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a13fff640 1 -- 172.21.15.45:0/3126940053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a1414c3d0 msgr2=0x7f2a141e7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:15.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a13fff640 1 --2- 172.21.15.45:0/3126940053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a1414c3d0 0x7f2a141e7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:15.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a13fff640 1 -- 172.21.15.45:0/3126940053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a040094d0 con 0x7f2a1406c3f0 2023-10-03T19:20:15.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a13fff640 1 --2- 172.21.15.45:0/3126940053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a1406c3f0 0x7f2a141441e0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f2a0800d830 tx=0x7f2a0800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:15.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a10ff9640 1 -- 172.21.15.45:0/3126940053 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0800b6c0 con 0x7f2a1406c3f0 2023-10-03T19:20:15.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a10ff9640 1 -- 172.21.15.45:0/3126940053 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0800b820 con 0x7f2a1406c3f0 2023-10-03T19:20:15.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a1a3c8640 1 -- 172.21.15.45:0/3126940053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a14071690 con 0x7f2a1406c3f0 2023-10-03T19:20:15.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a10ff9640 1 -- 172.21.15.45:0/3126940053 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0800bb90 con 0x7f2a1406c3f0 2023-10-03T19:20:15.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a1a3c8640 1 -- 172.21.15.45:0/3126940053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a140a56c0 con 0x7f2a1406c3f0 2023-10-03T19:20:15.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.080+0000 7f2a1a3c8640 1 -- 172.21.15.45:0/3126940053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a14071820 con 0x7f2a1406c3f0 2023-10-03T19:20:15.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.084+0000 7f2a10ff9640 1 -- 172.21.15.45:0/3126940053 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2a0801e460 con 0x7f2a1406c3f0 2023-10-03T19:20:15.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.084+0000 7f2a10ff9640 1 --2- 172.21.15.45:0/3126940053 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2a00066280 0x7f2a00068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:15.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.084+0000 7f2a10ff9640 1 -- 172.21.15.45:0/3126940053 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f2a08084eb0 con 0x7f2a1406c3f0 2023-10-03T19:20:15.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.084+0000 7f2a137fe640 1 --2- 172.21.15.45:0/3126940053 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2a00066280 0x7f2a00068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:15.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.084+0000 7f2a137fe640 1 --2- 172.21.15.45:0/3126940053 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2a00066280 0x7f2a00068730 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2a040ae000 tx=0x7f2a04008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:15.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.088+0000 7f2a10ff9640 1 -- 172.21.15.45:0/3126940053 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2a08052460 con 0x7f2a1406c3f0 2023-10-03T19:20:15.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.244+0000 7f2a1a3c8640 1 -- 172.21.15.45:0/3126940053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2a14144e30 con 0x7f2a1406c3f0 2023-10-03T19:20:15.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.920+0000 7f2a10ff9640 1 -- 172.21.15.45:0/3126940053 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v107) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2a08055a80 con 0x7f2a1406c3f0 2023-10-03T19:20:15.928 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-10-03T19:20:15.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.932+0000 7f2a1a3c8640 1 -- 172.21.15.45:0/3126940053 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2a00066280 msgr2=0x7f2a00068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:15.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.936+0000 7f2a1a3c8640 1 --2- 172.21.15.45:0/3126940053 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2a00066280 0x7f2a00068730 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2a040ae000 tx=0x7f2a04008040 comp rx=0 tx=0).stop 2023-10-03T19:20:15.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.936+0000 7f2a1a3c8640 1 -- 172.21.15.45:0/3126940053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a1406c3f0 msgr2=0x7f2a141441e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:15.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.936+0000 7f2a1a3c8640 1 --2- 172.21.15.45:0/3126940053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a1406c3f0 0x7f2a141441e0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f2a0800d830 tx=0x7f2a0800dcf0 comp rx=0 tx=0).stop 2023-10-03T19:20:15.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.936+0000 7f2a1a3c8640 1 -- 172.21.15.45:0/3126940053 shutdown_connections 2023-10-03T19:20:15.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.936+0000 7f2a1a3c8640 1 --2- 172.21.15.45:0/3126940053 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2a00066280 0x7f2a00068730 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:15.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.936+0000 7f2a1a3c8640 1 --2- 172.21.15.45:0/3126940053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a1414c3d0 0x7f2a141e7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:15.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.936+0000 7f2a1a3c8640 1 --2- 172.21.15.45:0/3126940053 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2a140712c0 0x7f2a141e7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:15.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.936+0000 7f2a1a3c8640 1 --2- 172.21.15.45:0/3126940053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a1406c3f0 0x7f2a141441e0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:15.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.936+0000 7f2a1a3c8640 1 -- 172.21.15.45:0/3126940053 >> 172.21.15.45:0/3126940053 conn(0x7f2a140a20d0 msgr2=0x7f2a140bb2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:15.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.936+0000 7f2a1a3c8640 1 -- 172.21.15.45:0/3126940053 shutdown_connections 2023-10-03T19:20:15.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:15.936+0000 7f2a1a3c8640 1 -- 172.21.15.45:0/3126940053 wait complete. 2023-10-03T19:20:15.970 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-03T19:20:16.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.092+0000 7f81330a0640 1 Processor -- start 2023-10-03T19:20:16.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.092+0000 7f81330a0640 1 -- start start 2023-10-03T19:20:16.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.092+0000 7f81330a0640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f812c0712c0 0x7f812c0bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:16.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.092+0000 7f81330a0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f812c06c760 0x7f812c0bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:16.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.092+0000 7f81330a0640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f812c06c2d0 con 0x7f812c06d560 2023-10-03T19:20:16.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.092+0000 7f81330a0640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812c150610 con 0x7f812c0712c0 2023-10-03T19:20:16.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.092+0000 7f81330a0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812c1508b0 con 0x7f812c06c760 2023-10-03T19:20:16.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.092+0000 7f8130e3c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f812c0712c0 0x7f812c0bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:16.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.092+0000 7f8130e3c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f812c0712c0 0x7f812c0bcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42806/0 (socket says 172.21.15.45:42806) 2023-10-03T19:20:16.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.092+0000 7f8130e3c640 1 -- 172.21.15.45:0/2533862349 learned_addr learned my addr 172.21.15.45:0/2533862349 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:16.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.092+0000 7f813163d640 1 --2- 172.21.15.45:0/2533862349 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f812c06c760 0x7f812c0bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:16.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.092+0000 7f8130e3c640 1 -- 172.21.15.45:0/2533862349 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f812c06c760 msgr2=0x7f812c0bd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:16.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.092+0000 7f8130e3c640 1 --2- 172.21.15.45:0/2533862349 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f812c06c760 0x7f812c0bd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:16.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.092+0000 7f8130e3c640 1 -- 172.21.15.45:0/2533862349 >> v1:172.21.15.79:6789/0 conn(0x7f812c06d560 legacy=0x7f812c0a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:16.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.092+0000 7f8130e3c640 1 -- 172.21.15.45:0/2533862349 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812c06d2e0 con 0x7f812c0712c0 2023-10-03T19:20:16.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.092+0000 7f8130e3c640 1 --2- 172.21.15.45:0/2533862349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f812c0712c0 0x7f812c0bcbc0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f8120009870 tx=0x7f812001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fced9ee83504be49 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:16.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f812b7fe640 1 -- 172.21.15.45:0/2533862349 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81200ab600 con 0x7f812c0712c0 2023-10-03T19:20:16.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f812b7fe640 1 -- 172.21.15.45:0/2533862349 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81200ab760 con 0x7f812c0712c0 2023-10-03T19:20:16.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f812b7fe640 1 -- 172.21.15.45:0/2533862349 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81200abaf0 con 0x7f812c0712c0 2023-10-03T19:20:16.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f81330a0640 1 -- 172.21.15.45:0/2533862349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f812c0712c0 msgr2=0x7f812c0bcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:16.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f81330a0640 1 --2- 172.21.15.45:0/2533862349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f812c0712c0 0x7f812c0bcbc0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f8120009870 tx=0x7f812001c500 comp rx=0 tx=0).stop 2023-10-03T19:20:16.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f81330a0640 1 -- 172.21.15.45:0/2533862349 shutdown_connections 2023-10-03T19:20:16.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f81330a0640 1 --2- 172.21.15.45:0/2533862349 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f812c06c760 0x7f812c0bd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:16.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f81330a0640 1 --2- 172.21.15.45:0/2533862349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f812c0712c0 0x7f812c0bcbc0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:16.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f81330a0640 1 -- 172.21.15.45:0/2533862349 >> 172.21.15.45:0/2533862349 conn(0x7f812c0a20d0 msgr2=0x7f812c0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:16.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f81330a0640 1 -- 172.21.15.45:0/2533862349 shutdown_connections 2023-10-03T19:20:16.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f81330a0640 1 -- 172.21.15.45:0/2533862349 wait complete. 2023-10-03T19:20:16.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f81330a0640 1 Processor -- start 2023-10-03T19:20:16.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f81330a0640 1 -- start start 2023-10-03T19:20:16.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f81330a0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f812c06c760 0x7f812c1eac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:16.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f81330a0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f812c06d560 0x7f812c156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:16.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f81330a0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f812c0712c0 0x7f812c1e6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:16.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f81330a0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812c14b1b0 con 0x7f812c06c760 2023-10-03T19:20:16.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f81330a0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812c151070 con 0x7f812c0712c0 2023-10-03T19:20:16.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f81330a0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812c14ce40 con 0x7f812c06d560 2023-10-03T19:20:16.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f8130e3c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f812c06c760 0x7f812c1eac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:16.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f8130e3c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f812c06c760 0x7f812c1eac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42810/0 (socket says 172.21.15.45:42810) 2023-10-03T19:20:16.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f8130e3c640 1 -- 172.21.15.45:0/2271942165 learned_addr learned my addr 172.21.15.45:0/2271942165 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:16.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f8130e3c640 1 -- 172.21.15.45:0/2271942165 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f812c06d560 msgr2=0x7f812c156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:16.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f8130e3c640 1 --2- 172.21.15.45:0/2271942165 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f812c06d560 0x7f812c156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:16.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f8130e3c640 1 -- 172.21.15.45:0/2271942165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f812c0712c0 msgr2=0x7f812c1e6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:16.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f8130e3c640 1 --2- 172.21.15.45:0/2271942165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f812c0712c0 0x7f812c1e6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:16.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f8130e3c640 1 -- 172.21.15.45:0/2271942165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81200094d0 con 0x7f812c06c760 2023-10-03T19:20:16.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f8130e3c640 1 --2- 172.21.15.45:0/2271942165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f812c06c760 0x7f812c1eac40 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f81200ad040 tx=0x7f812001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f81297fa640 1 -- 172.21.15.45:0/2271942165 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81200ab600 con 0x7f812c06c760 2023-10-03T19:20:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f81297fa640 1 -- 172.21.15.45:0/2271942165 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81200b4820 con 0x7f812c06c760 2023-10-03T19:20:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f81330a0640 1 -- 172.21.15.45:0/2271942165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f812c0a6070 con 0x7f812c06c760 2023-10-03T19:20:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f81297fa640 1 -- 172.21.15.45:0/2271942165 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81200b4bd0 con 0x7f812c06c760 2023-10-03T19:20:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.096+0000 7f81330a0640 1 -- 172.21.15.45:0/2271942165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f812c0a5ee0 con 0x7f812c06c760 2023-10-03T19:20:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.100+0000 7f81330a0640 1 -- 172.21.15.45:0/2271942165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f812c1596f0 con 0x7f812c06c760 2023-10-03T19:20:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.100+0000 7f81297fa640 1 -- 172.21.15.45:0/2271942165 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f81200b4d30 con 0x7f812c06c760 2023-10-03T19:20:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.100+0000 7f81297fa640 1 --2- 172.21.15.45:0/2271942165 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8110066280 0x7f8110068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.100+0000 7f81297fa640 1 -- 172.21.15.45:0/2271942165 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f812011e630 con 0x7f812c06c760 2023-10-03T19:20:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.100+0000 7f812bfff640 1 --2- 172.21.15.45:0/2271942165 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8110066280 0x7f8110068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:16.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.100+0000 7f812bfff640 1 --2- 172.21.15.45:0/2271942165 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8110066280 0x7f8110068730 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f812c0bd6a0 tx=0x7f81180079c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:16.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.104+0000 7f81297fa640 1 -- 172.21.15.45:0/2271942165 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f81200ebb10 con 0x7f812c06c760 2023-10-03T19:20:16.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.296+0000 7f81330a0640 1 -- 172.21.15.45:0/2271942165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f812c0bdb20 con 0x7f812c06c760 2023-10-03T19:20:16.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.308+0000 7f81297fa640 1 -- 172.21.15.45:0/2271942165 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v54) v1 ==== 174+0+0 (secure 0 0 0) 0x7f81200ef130 con 0x7f812c06c760 2023-10-03T19:20:16.311 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 17 and data pool 18 2023-10-03T19:20:16.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.324+0000 7f81330a0640 1 -- 172.21.15.45:0/2271942165 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8110066280 msgr2=0x7f8110068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:16.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.324+0000 7f81330a0640 1 --2- 172.21.15.45:0/2271942165 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8110066280 0x7f8110068730 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f812c0bd6a0 tx=0x7f81180079c0 comp rx=0 tx=0).stop 2023-10-03T19:20:16.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.324+0000 7f81330a0640 1 -- 172.21.15.45:0/2271942165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f812c06c760 msgr2=0x7f812c1eac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:16.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.324+0000 7f81330a0640 1 --2- 172.21.15.45:0/2271942165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f812c06c760 0x7f812c1eac40 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f81200ad040 tx=0x7f812001ad40 comp rx=0 tx=0).stop 2023-10-03T19:20:16.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.324+0000 7f81330a0640 1 -- 172.21.15.45:0/2271942165 shutdown_connections 2023-10-03T19:20:16.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.324+0000 7f81330a0640 1 --2- 172.21.15.45:0/2271942165 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8110066280 0x7f8110068730 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:16.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.324+0000 7f81330a0640 1 --2- 172.21.15.45:0/2271942165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f812c0712c0 0x7f812c1e6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:16.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.324+0000 7f81330a0640 1 --2- 172.21.15.45:0/2271942165 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f812c06d560 0x7f812c156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:16.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.324+0000 7f81330a0640 1 --2- 172.21.15.45:0/2271942165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f812c06c760 0x7f812c1eac40 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:16.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.324+0000 7f81330a0640 1 -- 172.21.15.45:0/2271942165 >> 172.21.15.45:0/2271942165 conn(0x7f812c0a20d0 msgr2=0x7f812c149b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:16.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.324+0000 7f81330a0640 1 -- 172.21.15.45:0/2271942165 shutdown_connections 2023-10-03T19:20:16.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.324+0000 7f81330a0640 1 -- 172.21.15.45:0/2271942165 wait complete. 2023-10-03T19:20:16.352 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:20:16.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.468+0000 7f640cd69640 1 Processor -- start 2023-10-03T19:20:16.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.468+0000 7f640cd69640 1 -- start start 2023-10-03T19:20:16.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.468+0000 7f640cd69640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f64080b98f0 0x7f64080b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:16.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.472+0000 7f640cd69640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64080a2e20 0x7f640806c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:16.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.472+0000 7f640cd69640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64080ba550 con 0x7f64080bc810 2023-10-03T19:20:16.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.472+0000 7f640cd69640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64081526d0 con 0x7f64080b98f0 2023-10-03T19:20:16.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.472+0000 7f640cd69640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64081529b0 con 0x7f64080a2e20 2023-10-03T19:20:16.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.472+0000 7f640659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f64080b98f0 0x7f64080b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:16.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.472+0000 7f6405d9b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f64080bc810 0x7f640806c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54730/0 (socket says 172.21.15.45:54730) 2023-10-03T19:20:16.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.472+0000 7f6405d9b640 1 -- 172.21.15.45:0/3773938812 learned_addr learned my addr 172.21.15.45:0/3773938812 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:20:16.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.472+0000 7f6406d9d640 1 --2- 172.21.15.45:0/3773938812 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64080a2e20 0x7f640806c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:16.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.472+0000 7f640659c640 1 -- 172.21.15.45:0/3773938812 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64080a2e20 msgr2=0x7f640806c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:16.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.472+0000 7f640659c640 1 --2- 172.21.15.45:0/3773938812 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64080a2e20 0x7f640806c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:16.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.472+0000 7f640659c640 1 -- 172.21.15.45:0/3773938812 >> v1:172.21.15.45:6789/0 conn(0x7f64080bc810 legacy=0x7f640806c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:16.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.472+0000 7f640559a640 1 -- 172.21.15.45:0/3773938812 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3985145525 0 0) 0x7f64080ba550 con 0x7f64080bc810 2023-10-03T19:20:16.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.472+0000 7f640659c640 1 -- 172.21.15.45:0/3773938812 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640806cee0 con 0x7f64080b98f0 2023-10-03T19:20:16.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.472+0000 7f640659c640 1 --2- 172.21.15.45:0/3773938812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64080b98f0 0x7f64080b9cc0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0097c0 tx=0x7f63fc01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897e09803d4d9793 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:16.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.472+0000 7f640559a640 1 -- 172.21.15.45:0/3773938812 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63fc0a8970 con 0x7f64080b98f0 2023-10-03T19:20:16.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.472+0000 7f640559a640 1 -- 172.21.15.45:0/3773938812 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63fc0a8ad0 con 0x7f64080b98f0 2023-10-03T19:20:16.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.472+0000 7f640559a640 1 -- 172.21.15.45:0/3773938812 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63fc0a8e60 con 0x7f64080b98f0 2023-10-03T19:20:16.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.472+0000 7f640cd69640 1 -- 172.21.15.45:0/3773938812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64080b98f0 msgr2=0x7f64080b9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:16.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.472+0000 7f640cd69640 1 --2- 172.21.15.45:0/3773938812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64080b98f0 0x7f64080b9cc0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0097c0 tx=0x7f63fc01ec70 comp rx=0 tx=0).stop 2023-10-03T19:20:16.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.472+0000 7f640cd69640 1 -- 172.21.15.45:0/3773938812 shutdown_connections 2023-10-03T19:20:16.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.472+0000 7f640cd69640 1 --2- 172.21.15.45:0/3773938812 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64080a2e20 0x7f640806c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:16.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.472+0000 7f640cd69640 1 --2- 172.21.15.45:0/3773938812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64080b98f0 0x7f64080b9cc0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:16.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.472+0000 7f640cd69640 1 -- 172.21.15.45:0/3773938812 >> 172.21.15.45:0/3773938812 conn(0x7f64080bcf50 msgr2=0x7f64080bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:16.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.472+0000 7f640cd69640 1 -- 172.21.15.45:0/3773938812 shutdown_connections 2023-10-03T19:20:16.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.476+0000 7f640cd69640 1 -- 172.21.15.45:0/3773938812 wait complete. 2023-10-03T19:20:16.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.476+0000 7f640cd69640 1 Processor -- start 2023-10-03T19:20:16.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.476+0000 7f640cd69640 1 -- start start 2023-10-03T19:20:16.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.476+0000 7f640cd69640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64080a2e20 0x7f6408151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:16.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.476+0000 7f640cd69640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64080b98f0 0x7f640814aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:16.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.476+0000 7f640cd69640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64080bc810 0x7f640814b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:16.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.476+0000 7f640cd69640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6408146880 con 0x7f64080bc810 2023-10-03T19:20:16.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.476+0000 7f640cd69640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6408151850 con 0x7f64080a2e20 2023-10-03T19:20:16.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.476+0000 7f640cd69640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f640813ea90 con 0x7f64080b98f0 2023-10-03T19:20:16.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.476+0000 7f6406d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64080bc810 0x7f640814b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:16.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.476+0000 7f6406d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64080bc810 0x7f640814b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42834/0 (socket says 172.21.15.45:42834) 2023-10-03T19:20:16.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.476+0000 7f6406d9d640 1 -- 172.21.15.45:0/4215896191 learned_addr learned my addr 172.21.15.45:0/4215896191 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:16.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.476+0000 7f6405d9b640 1 --2- 172.21.15.45:0/4215896191 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64080b98f0 0x7f640814aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:16.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.476+0000 7f640659c640 1 --2- 172.21.15.45:0/4215896191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64080a2e20 0x7f6408151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:16.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.476+0000 7f6406d9d640 1 -- 172.21.15.45:0/4215896191 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64080b98f0 msgr2=0x7f640814aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:16.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.476+0000 7f6406d9d640 1 --2- 172.21.15.45:0/4215896191 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64080b98f0 0x7f640814aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:16.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.476+0000 7f6406d9d640 1 -- 172.21.15.45:0/4215896191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64080a2e20 msgr2=0x7f6408151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:16.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.476+0000 7f6406d9d640 1 --2- 172.21.15.45:0/4215896191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64080a2e20 0x7f6408151310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:16.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.476+0000 7f6406d9d640 1 -- 172.21.15.45:0/4215896191 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63fc009420 con 0x7f64080bc810 2023-10-03T19:20:16.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.476+0000 7f6405d9b640 1 --2- 172.21.15.45:0/4215896191 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64080b98f0 0x7f640814aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:16.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.476+0000 7f6406d9d640 1 --2- 172.21.15.45:0/4215896191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64080bc810 0x7f640814b010 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f6400007e90 tx=0x7f640000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:16.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.476+0000 7f63f6ffd640 1 -- 172.21.15.45:0/4215896191 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6400014420 con 0x7f64080bc810 2023-10-03T19:20:16.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.476+0000 7f63f6ffd640 1 -- 172.21.15.45:0/4215896191 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6400014580 con 0x7f64080bc810 2023-10-03T19:20:16.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.476+0000 7f63f6ffd640 1 -- 172.21.15.45:0/4215896191 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6400014930 con 0x7f64080bc810 2023-10-03T19:20:16.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.476+0000 7f640cd69640 1 -- 172.21.15.45:0/4215896191 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64080ba950 con 0x7f64080bc810 2023-10-03T19:20:16.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.476+0000 7f640cd69640 1 -- 172.21.15.45:0/4215896191 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64080ba200 con 0x7f64080bc810 2023-10-03T19:20:16.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.476+0000 7f640cd69640 1 -- 172.21.15.45:0/4215896191 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64080baae0 con 0x7f64080bc810 2023-10-03T19:20:16.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.480+0000 7f63f6ffd640 1 -- 172.21.15.45:0/4215896191 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6400014a90 con 0x7f64080bc810 2023-10-03T19:20:16.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.480+0000 7f63f6ffd640 1 --2- 172.21.15.45:0/4215896191 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f63e80662b0 0x7f63e8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:16.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.480+0000 7f63f6ffd640 1 -- 172.21.15.45:0/4215896191 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f64000845e0 con 0x7f64080bc810 2023-10-03T19:20:16.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.480+0000 7f640659c640 1 --2- 172.21.15.45:0/4215896191 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f63e80662b0 0x7f63e8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:16.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.480+0000 7f640659c640 1 --2- 172.21.15.45:0/4215896191 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f63e80662b0 0x7f63e8068760 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0b2000 tx=0x7f63fc0aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:16.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.484+0000 7f63f6ffd640 1 -- 172.21.15.45:0/4215896191 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6400051a60 con 0x7f64080bc810 2023-10-03T19:20:16.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.636+0000 7f640cd69640 1 -- 172.21.15.45:0/4215896191 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64080a5fe0 con 0x7f64080bc810 2023-10-03T19:20:16.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.640+0000 7f63f6ffd640 1 -- 172.21.15.45:0/4215896191 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+18326 (secure 0 0 0) 0x7f6400055080 con 0x7f64080bc810 2023-10-03T19:20:16.644 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:20:16.644 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":108,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:20:16.300728+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:20:13.940428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-10-03T19:20:15.290748+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:20:16.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.644+0000 7f640cd69640 1 -- 172.21.15.45:0/4215896191 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f63e80662b0 msgr2=0x7f63e8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:16.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.644+0000 7f640cd69640 1 --2- 172.21.15.45:0/4215896191 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f63e80662b0 0x7f63e8068760 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0b2000 tx=0x7f63fc0aa070 comp rx=0 tx=0).stop 2023-10-03T19:20:16.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.644+0000 7f640cd69640 1 -- 172.21.15.45:0/4215896191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64080bc810 msgr2=0x7f640814b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:16.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.644+0000 7f640cd69640 1 --2- 172.21.15.45:0/4215896191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64080bc810 0x7f640814b010 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f6400007e90 tx=0x7f640000e4b0 comp rx=0 tx=0).stop 2023-10-03T19:20:16.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.644+0000 7f640cd69640 1 -- 172.21.15.45:0/4215896191 shutdown_connections 2023-10-03T19:20:16.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.644+0000 7f640cd69640 1 --2- 172.21.15.45:0/4215896191 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f63e80662b0 0x7f63e8068760 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:16.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.644+0000 7f640cd69640 1 --2- 172.21.15.45:0/4215896191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64080bc810 0x7f640814b010 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:16.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.644+0000 7f640cd69640 1 --2- 172.21.15.45:0/4215896191 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64080b98f0 0x7f640814aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:16.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.644+0000 7f640cd69640 1 --2- 172.21.15.45:0/4215896191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64080a2e20 0x7f6408151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:16.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.644+0000 7f640cd69640 1 -- 172.21.15.45:0/4215896191 >> 172.21.15.45:0/4215896191 conn(0x7f64080bcf50 msgr2=0x7f640806c190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:16.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.644+0000 7f640cd69640 1 -- 172.21.15.45:0/4215896191 shutdown_connections 2023-10-03T19:20:16.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.644+0000 7f640cd69640 1 -- 172.21.15.45:0/4215896191 wait complete. 2023-10-03T19:20:16.664 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:20:16.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.788+0000 7f3a6023a640 1 Processor -- start 2023-10-03T19:20:16.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.788+0000 7f3a6023a640 1 -- start start 2023-10-03T19:20:16.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.792+0000 7f3a6023a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3a5814f240 0x7f3a581528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:16.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.792+0000 7f3a6023a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a580c2790 0x7f3a580c0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:16.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.792+0000 7f3a6023a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a5806b2d0 con 0x7f3a580bb1d0 2023-10-03T19:20:16.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.792+0000 7f3a6023a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a5806b640 con 0x7f3a5814f240 2023-10-03T19:20:16.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.792+0000 7f3a6023a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a580c0fa0 con 0x7f3a580c2790 2023-10-03T19:20:16.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.792+0000 7f3a5dfd6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3a5814f240 0x7f3a581528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:16.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.792+0000 7f3a5dfd6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3a5814f240 0x7f3a581528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:44778/0 (socket says 172.21.15.45:44778) 2023-10-03T19:20:16.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.792+0000 7f3a5dfd6640 1 -- 172.21.15.45:0/1697567345 learned_addr learned my addr 172.21.15.45:0/1697567345 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:16.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.792+0000 7f3a5e7d7640 1 --1- 172.21.15.45:0/1697567345 >> v1:172.21.15.79:6789/0 conn(0x7f3a580bb1d0 0x7f3a580c12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:53630/0 (socket says 172.21.15.45:53630) 2023-10-03T19:20:16.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.792+0000 7f3a5d7d5640 1 --2- 172.21.15.45:0/1697567345 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a580c2790 0x7f3a580c0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:16.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.792+0000 7f3a5dfd6640 1 -- 172.21.15.45:0/1697567345 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a580c2790 msgr2=0x7f3a580c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:16.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.792+0000 7f3a5dfd6640 1 --2- 172.21.15.45:0/1697567345 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a580c2790 0x7f3a580c0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:16.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.792+0000 7f3a5dfd6640 1 -- 172.21.15.45:0/1697567345 >> v1:172.21.15.79:6789/0 conn(0x7f3a580bb1d0 legacy=0x7f3a580c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:16.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.792+0000 7f3a5dfd6640 1 -- 172.21.15.45:0/1697567345 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a580a3c60 con 0x7f3a5814f240 2023-10-03T19:20:16.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.796+0000 7f3a5dfd6640 1 --2- 172.21.15.45:0/1697567345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a5814f240 0x7f3a581528d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3a48006fd0 tx=0x7f3a4801ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2650c7ce69ca960 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:16.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.796+0000 7f3a5cfd4640 1 -- 172.21.15.45:0/1697567345 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a480a8a10 con 0x7f3a5814f240 2023-10-03T19:20:16.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.796+0000 7f3a5cfd4640 1 -- 172.21.15.45:0/1697567345 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a480a8b70 con 0x7f3a5814f240 2023-10-03T19:20:16.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.796+0000 7f3a5cfd4640 1 -- 172.21.15.45:0/1697567345 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a480b0440 con 0x7f3a5814f240 2023-10-03T19:20:16.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.796+0000 7f3a6023a640 1 -- 172.21.15.45:0/1697567345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a5814f240 msgr2=0x7f3a581528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:16.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.796+0000 7f3a6023a640 1 --2- 172.21.15.45:0/1697567345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a5814f240 0x7f3a581528d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3a48006fd0 tx=0x7f3a4801ed10 comp rx=0 tx=0).stop 2023-10-03T19:20:16.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.796+0000 7f3a6023a640 1 -- 172.21.15.45:0/1697567345 shutdown_connections 2023-10-03T19:20:16.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.796+0000 7f3a6023a640 1 --2- 172.21.15.45:0/1697567345 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a580c2790 0x7f3a580c0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:16.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.796+0000 7f3a6023a640 1 --2- 172.21.15.45:0/1697567345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a5814f240 0x7f3a581528d0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:16.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.796+0000 7f3a6023a640 1 -- 172.21.15.45:0/1697567345 >> 172.21.15.45:0/1697567345 conn(0x7f3a580a64a0 msgr2=0x7f3a580a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:16.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.796+0000 7f3a6023a640 1 -- 172.21.15.45:0/1697567345 shutdown_connections 2023-10-03T19:20:16.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.796+0000 7f3a6023a640 1 -- 172.21.15.45:0/1697567345 wait complete. 2023-10-03T19:20:16.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.796+0000 7f3a6023a640 1 Processor -- start 2023-10-03T19:20:16.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.796+0000 7f3a6023a640 1 -- start start 2023-10-03T19:20:16.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.796+0000 7f3a6023a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a580bb1d0 0x7f3a580be520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:16.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.796+0000 7f3a6023a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a580c2790 0x7f3a5814c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:16.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.796+0000 7f3a6023a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a5814f240 0x7f3a581e7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:16.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.796+0000 7f3a6023a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a580aa310 con 0x7f3a5814f240 2023-10-03T19:20:16.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.796+0000 7f3a6023a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a580bea60 con 0x7f3a580c2790 2023-10-03T19:20:16.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.796+0000 7f3a6023a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a580aa030 con 0x7f3a580bb1d0 2023-10-03T19:20:16.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.796+0000 7f3a5e7d7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a5814f240 0x7f3a581e7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:16.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.796+0000 7f3a5e7d7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a5814f240 0x7f3a581e7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42838/0 (socket says 172.21.15.45:42838) 2023-10-03T19:20:16.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.796+0000 7f3a5e7d7640 1 -- 172.21.15.45:0/2861333616 learned_addr learned my addr 172.21.15.45:0/2861333616 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:16.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.800+0000 7f3a5dfd6640 1 --2- 172.21.15.45:0/2861333616 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a580bb1d0 0x7f3a580be520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:16.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.800+0000 7f3a5d7d5640 1 --2- 172.21.15.45:0/2861333616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a580c2790 0x7f3a5814c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:16.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.800+0000 7f3a5e7d7640 1 -- 172.21.15.45:0/2861333616 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a580bb1d0 msgr2=0x7f3a580be520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:16.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.800+0000 7f3a5e7d7640 1 --2- 172.21.15.45:0/2861333616 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a580bb1d0 0x7f3a580be520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:16.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.800+0000 7f3a5e7d7640 1 -- 172.21.15.45:0/2861333616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a580c2790 msgr2=0x7f3a5814c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:16.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.800+0000 7f3a5e7d7640 1 --2- 172.21.15.45:0/2861333616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a580c2790 0x7f3a5814c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:16.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.800+0000 7f3a5e7d7640 1 -- 172.21.15.45:0/2861333616 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a48009480 con 0x7f3a5814f240 2023-10-03T19:20:16.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.800+0000 7f3a5e7d7640 1 --2- 172.21.15.45:0/2861333616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a5814f240 0x7f3a581e7720 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f3a5000c710 tx=0x7f3a5000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:16.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.800+0000 7f3a567fc640 1 -- 172.21.15.45:0/2861333616 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5000ce20 con 0x7f3a5814f240 2023-10-03T19:20:16.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.800+0000 7f3a567fc640 1 -- 172.21.15.45:0/2861333616 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5000a640 con 0x7f3a5814f240 2023-10-03T19:20:16.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.800+0000 7f3a6023a640 1 -- 172.21.15.45:0/2861333616 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5814e740 con 0x7f3a5814f240 2023-10-03T19:20:16.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.800+0000 7f3a567fc640 1 -- 172.21.15.45:0/2861333616 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5000a9d0 con 0x7f3a5814f240 2023-10-03T19:20:16.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.800+0000 7f3a6023a640 1 -- 172.21.15.45:0/2861333616 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a580c19b0 con 0x7f3a5814f240 2023-10-03T19:20:16.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.800+0000 7f3a6023a640 1 -- 172.21.15.45:0/2861333616 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a580a3f40 con 0x7f3a5814f240 2023-10-03T19:20:16.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.800+0000 7f3a567fc640 1 -- 172.21.15.45:0/2861333616 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3a5000ab30 con 0x7f3a5814f240 2023-10-03T19:20:16.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.800+0000 7f3a567fc640 1 --2- 172.21.15.45:0/2861333616 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3a44066280 0x7f3a44068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:16.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.800+0000 7f3a567fc640 1 -- 172.21.15.45:0/2861333616 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3a50083580 con 0x7f3a5814f240 2023-10-03T19:20:16.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.800+0000 7f3a5dfd6640 1 --2- 172.21.15.45:0/2861333616 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3a44066280 0x7f3a44068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:16.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.800+0000 7f3a5dfd6640 1 --2- 172.21.15.45:0/2861333616 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3a44066280 0x7f3a44068730 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f3a480b2000 tx=0x7f3a480aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:16.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.804+0000 7f3a567fc640 1 -- 172.21.15.45:0/2861333616 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3a50054480 con 0x7f3a5814f240 2023-10-03T19:20:16.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.960+0000 7f3a6023a640 1 -- 172.21.15.45:0/2861333616 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a580bfa90 con 0x7f3a5814f240 2023-10-03T19:20:16.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.960+0000 7f3a567fc640 1 -- 172.21.15.45:0/2861333616 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+18326 (secure 0 0 0) 0x7f3a50054010 con 0x7f3a5814f240 2023-10-03T19:20:16.965 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:20:16.965 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":108,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:20:16.300728+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:20:13.940428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-10-03T19:20:15.290748+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:20:16.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.964+0000 7f3a6023a640 1 -- 172.21.15.45:0/2861333616 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3a44066280 msgr2=0x7f3a44068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:16.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.964+0000 7f3a6023a640 1 --2- 172.21.15.45:0/2861333616 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3a44066280 0x7f3a44068730 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f3a480b2000 tx=0x7f3a480aa070 comp rx=0 tx=0).stop 2023-10-03T19:20:16.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.964+0000 7f3a6023a640 1 -- 172.21.15.45:0/2861333616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a5814f240 msgr2=0x7f3a581e7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:16.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.964+0000 7f3a6023a640 1 --2- 172.21.15.45:0/2861333616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a5814f240 0x7f3a581e7720 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f3a5000c710 tx=0x7f3a5000cbd0 comp rx=0 tx=0).stop 2023-10-03T19:20:16.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.964+0000 7f3a6023a640 1 -- 172.21.15.45:0/2861333616 shutdown_connections 2023-10-03T19:20:16.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.964+0000 7f3a6023a640 1 --2- 172.21.15.45:0/2861333616 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3a44066280 0x7f3a44068730 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:16.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.964+0000 7f3a6023a640 1 --2- 172.21.15.45:0/2861333616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a5814f240 0x7f3a581e7720 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:16.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.964+0000 7f3a6023a640 1 --2- 172.21.15.45:0/2861333616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a580c2790 0x7f3a5814c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:16.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.964+0000 7f3a6023a640 1 --2- 172.21.15.45:0/2861333616 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a580bb1d0 0x7f3a580be520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:16.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.964+0000 7f3a6023a640 1 -- 172.21.15.45:0/2861333616 >> 172.21.15.45:0/2861333616 conn(0x7f3a580a64a0 msgr2=0x7f3a580c12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:16.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.964+0000 7f3a6023a640 1 -- 172.21.15.45:0/2861333616 shutdown_connections 2023-10-03T19:20:16.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:16.964+0000 7f3a6023a640 1 -- 172.21.15.45:0/2861333616 wait complete. 2023-10-03T19:20:16.982 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-03T19:20:17.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.104+0000 7fa4493c7640 1 Processor -- start 2023-10-03T19:20:17.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.108+0000 7fa4493c7640 1 -- start start 2023-10-03T19:20:17.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.108+0000 7fa4493c7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa4440c14e0 0x7fa4440c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:17.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.108+0000 7fa4493c7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa4440bf1f0 0x7fa4440a9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:17.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.108+0000 7fa4493c7640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44406ac70 con 0x7fa4440c2770 2023-10-03T19:20:17.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.108+0000 7fa4493c7640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa44406aae0 con 0x7fa4440c14e0 2023-10-03T19:20:17.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.108+0000 7fa4493c7640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440c3000 con 0x7fa4440bf1f0 2023-10-03T19:20:17.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.108+0000 7fa442ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa4440c14e0 0x7fa4440c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:17.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.108+0000 7fa442ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa4440c14e0 0x7fa4440c0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42848/0 (socket says 172.21.15.45:42848) 2023-10-03T19:20:17.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.108+0000 7fa4437fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa4440c2770 0x7fa4440a9da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54738/0 (socket says 172.21.15.45:54738) 2023-10-03T19:20:17.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.108+0000 7fa442ffd640 1 -- 172.21.15.45:0/3618628390 learned_addr learned my addr 172.21.15.45:0/3618628390 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:17.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.108+0000 7fa4427fc640 1 --2- 172.21.15.45:0/3618628390 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa4440bf1f0 0x7fa4440a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:17.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.108+0000 7fa442ffd640 1 -- 172.21.15.45:0/3618628390 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa4440bf1f0 msgr2=0x7fa4440a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:17.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.108+0000 7fa442ffd640 1 --2- 172.21.15.45:0/3618628390 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa4440bf1f0 0x7fa4440a9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:17.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.108+0000 7fa442ffd640 1 -- 172.21.15.45:0/3618628390 >> v1:172.21.15.45:6789/0 conn(0x7fa4440c2770 legacy=0x7fa4440a9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:17.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.108+0000 7fa441ffb640 1 -- 172.21.15.45:0/3618628390 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679841717 0 0) 0x7fa44406ac70 con 0x7fa4440c2770 2023-10-03T19:20:17.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.108+0000 7fa442ffd640 1 -- 172.21.15.45:0/3618628390 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4440aa5f0 con 0x7fa4440c14e0 2023-10-03T19:20:17.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.108+0000 7fa442ffd640 1 --2- 172.21.15.45:0/3618628390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4440c14e0 0x7fa4440c0a40 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fa434009870 tx=0x7fa43401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6901107de5c0f260 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:17.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.108+0000 7fa441ffb640 1 -- 172.21.15.45:0/3618628390 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4340a8a30 con 0x7fa4440c14e0 2023-10-03T19:20:17.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.108+0000 7fa441ffb640 1 -- 172.21.15.45:0/3618628390 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4340a8b90 con 0x7fa4440c14e0 2023-10-03T19:20:17.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.108+0000 7fa441ffb640 1 -- 172.21.15.45:0/3618628390 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4340b0440 con 0x7fa4440c14e0 2023-10-03T19:20:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa4493c7640 1 -- 172.21.15.45:0/3618628390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4440c14e0 msgr2=0x7fa4440c0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa4493c7640 1 --2- 172.21.15.45:0/3618628390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4440c14e0 0x7fa4440c0a40 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fa434009870 tx=0x7fa43401ed30 comp rx=0 tx=0).stop 2023-10-03T19:20:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa4493c7640 1 -- 172.21.15.45:0/3618628390 shutdown_connections 2023-10-03T19:20:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa4493c7640 1 --2- 172.21.15.45:0/3618628390 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa4440bf1f0 0x7fa4440a9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:17.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa4493c7640 1 --2- 172.21.15.45:0/3618628390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4440c14e0 0x7fa4440c0a40 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:17.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa4493c7640 1 -- 172.21.15.45:0/3618628390 >> 172.21.15.45:0/3618628390 conn(0x7fa4440a6440 msgr2=0x7fa4440a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:17.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa4493c7640 1 -- 172.21.15.45:0/3618628390 shutdown_connections 2023-10-03T19:20:17.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa4493c7640 1 -- 172.21.15.45:0/3618628390 wait complete. 2023-10-03T19:20:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa4493c7640 1 Processor -- start 2023-10-03T19:20:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa4493c7640 1 -- start start 2023-10-03T19:20:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa4493c7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4440bf1f0 0x7fa4440bdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa4493c7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa4440c14e0 0x7fa4440b9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa4493c7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4440c2770 0x7fa4440b83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa4493c7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4441e69b0 con 0x7fa4440bf1f0 2023-10-03T19:20:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa4493c7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440be2b0 con 0x7fa4440c2770 2023-10-03T19:20:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa4493c7640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4441e6c00 con 0x7fa4440c14e0 2023-10-03T19:20:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa442ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4440bf1f0 0x7fa4440bdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:17.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa442ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4440bf1f0 0x7fa4440bdd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42854/0 (socket says 172.21.15.45:42854) 2023-10-03T19:20:17.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa442ffd640 1 -- 172.21.15.45:0/4190964326 learned_addr learned my addr 172.21.15.45:0/4190964326 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:17.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa4427fc640 1 --2- 172.21.15.45:0/4190964326 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa4440c14e0 0x7fa4440b9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:17.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa4437fe640 1 --2- 172.21.15.45:0/4190964326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4440c2770 0x7fa4440b83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:17.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa442ffd640 1 -- 172.21.15.45:0/4190964326 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa4440c14e0 msgr2=0x7fa4440b9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:17.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa442ffd640 1 --2- 172.21.15.45:0/4190964326 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa4440c14e0 0x7fa4440b9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:17.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa442ffd640 1 -- 172.21.15.45:0/4190964326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4440c2770 msgr2=0x7fa4440b83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:17.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa442ffd640 1 --2- 172.21.15.45:0/4190964326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4440c2770 0x7fa4440b83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:17.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa442ffd640 1 -- 172.21.15.45:0/4190964326 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4340094d0 con 0x7fa4440bf1f0 2023-10-03T19:20:17.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa4437fe640 1 --2- 172.21.15.45:0/4190964326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4440c2770 0x7fa4440b83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:17.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa442ffd640 1 --2- 172.21.15.45:0/4190964326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4440bf1f0 0x7fa4440bdd70 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fa4340b3040 tx=0x7fa43401bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:17.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa42b7fe640 1 -- 172.21.15.45:0/4190964326 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4340a8a30 con 0x7fa4440bf1f0 2023-10-03T19:20:17.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa42b7fe640 1 -- 172.21.15.45:0/4190964326 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4340bb480 con 0x7fa4440bf1f0 2023-10-03T19:20:17.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa4493c7640 1 -- 172.21.15.45:0/4190964326 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa44414f530 con 0x7fa4440bf1f0 2023-10-03T19:20:17.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa42b7fe640 1 -- 172.21.15.45:0/4190964326 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4340bb830 con 0x7fa4440bf1f0 2023-10-03T19:20:17.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.112+0000 7fa4493c7640 1 -- 172.21.15.45:0/4190964326 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa44414f250 con 0x7fa4440bf1f0 2023-10-03T19:20:17.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.116+0000 7fa4493c7640 1 -- 172.21.15.45:0/4190964326 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa44406b100 con 0x7fa4440bf1f0 2023-10-03T19:20:17.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.116+0000 7fa42b7fe640 1 -- 172.21.15.45:0/4190964326 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa4340bb990 con 0x7fa4440bf1f0 2023-10-03T19:20:17.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.116+0000 7fa42b7fe640 1 --2- 172.21.15.45:0/4190964326 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa430066280 0x7fa430068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:17.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.116+0000 7fa42b7fe640 1 -- 172.21.15.45:0/4190964326 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa4341222e0 con 0x7fa4440bf1f0 2023-10-03T19:20:17.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.116+0000 7fa4427fc640 1 --2- 172.21.15.45:0/4190964326 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa430066280 0x7fa430068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:17.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.116+0000 7fa4427fc640 1 --2- 172.21.15.45:0/4190964326 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa430066280 0x7fa430068730 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa4440b7f10 tx=0x7fa438008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:17.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.120+0000 7fa42b7fe640 1 -- 172.21.15.45:0/4190964326 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa4340ef910 con 0x7fa4440bf1f0 2023-10-03T19:20:17.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:17.316+0000 7fa4493c7640 1 -- 172.21.15.45:0/4190964326 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa44404de80 con 0x7fa4440bf1f0 2023-10-03T19:20:18.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.320+0000 7fa42b7fe640 1 -- 172.21.15.45:0/4190964326 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v57) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa4340f2f30 con 0x7fa4440bf1f0 2023-10-03T19:20:18.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.324+0000 7fa4493c7640 1 -- 172.21.15.45:0/4190964326 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa430066280 msgr2=0x7fa430068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:18.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.324+0000 7fa4493c7640 1 --2- 172.21.15.45:0/4190964326 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa430066280 0x7fa430068730 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa4440b7f10 tx=0x7fa438008040 comp rx=0 tx=0).stop 2023-10-03T19:20:18.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.324+0000 7fa4493c7640 1 -- 172.21.15.45:0/4190964326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4440bf1f0 msgr2=0x7fa4440bdd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:18.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.324+0000 7fa4493c7640 1 --2- 172.21.15.45:0/4190964326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4440bf1f0 0x7fa4440bdd70 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fa4340b3040 tx=0x7fa43401bad0 comp rx=0 tx=0).stop 2023-10-03T19:20:18.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.324+0000 7fa4493c7640 1 -- 172.21.15.45:0/4190964326 shutdown_connections 2023-10-03T19:20:18.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.324+0000 7fa4493c7640 1 --2- 172.21.15.45:0/4190964326 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fa430066280 0x7fa430068730 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:18.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.324+0000 7fa4493c7640 1 --2- 172.21.15.45:0/4190964326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4440c2770 0x7fa4440b83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:18.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.324+0000 7fa4493c7640 1 --2- 172.21.15.45:0/4190964326 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa4440c14e0 0x7fa4440b9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:18.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.324+0000 7fa4493c7640 1 --2- 172.21.15.45:0/4190964326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4440bf1f0 0x7fa4440bdd70 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:18.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.324+0000 7fa4493c7640 1 -- 172.21.15.45:0/4190964326 >> 172.21.15.45:0/4190964326 conn(0x7fa4440a6440 msgr2=0x7fa4440a6810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:18.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.324+0000 7fa4493c7640 1 -- 172.21.15.45:0/4190964326 shutdown_connections 2023-10-03T19:20:18.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.324+0000 7fa4493c7640 1 -- 172.21.15.45:0/4190964326 wait complete. 2023-10-03T19:20:18.348 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-03T19:20:18.348 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-03T19:20:18.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.480+0000 7fdd95024640 1 Processor -- start 2023-10-03T19:20:18.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.480+0000 7fdd95024640 1 -- start start 2023-10-03T19:20:18.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.480+0000 7fdd95024640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdd9006f880 0x7fdd900a5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:18.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.480+0000 7fdd95024640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd9014f080 con 0x7fdd9014f510 2023-10-03T19:20:18.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.480+0000 7fdd95024640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd90070e90 con 0x7fdd9014ba30 2023-10-03T19:20:18.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.480+0000 7fdd95024640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9006f3e0 con 0x7fdd9006f880 2023-10-03T19:20:18.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.480+0000 7fdd8e59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdd9014f510 0x7fdd9014b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54748/0 (socket says 172.21.15.45:54748) 2023-10-03T19:20:18.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.480+0000 7fdd8e59c640 1 -- 172.21.15.45:0/342749967 learned_addr learned my addr 172.21.15.45:0/342749967 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:20:18.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.480+0000 7fdd8ed9d640 1 --2- 172.21.15.45:0/342749967 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdd9006f880 0x7fdd900a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:18.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.480+0000 7fdd8dd9b640 1 -- 172.21.15.45:0/342749967 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 359835403 0 0) 0x7fdd9014f080 con 0x7fdd9014f510 2023-10-03T19:20:18.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.480+0000 7fdd8dd9b640 1 -- 172.21.15.45:0/342749967 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd78003530 con 0x7fdd9014f510 2023-10-03T19:20:18.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.480+0000 7fdd8dd9b640 1 -- 172.21.15.45:0/342749967 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1649935794 0 0) 0x7fdd78003530 con 0x7fdd9014f510 2023-10-03T19:20:18.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.480+0000 7fdd8ed9d640 1 -- 172.21.15.45:0/342749967 >> v1:172.21.15.79:6789/0 conn(0x7fdd9014ba30 legacy=0x7fdd90155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:18.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.480+0000 7fdd8ed9d640 1 -- 172.21.15.45:0/342749967 >> v1:172.21.15.45:6789/0 conn(0x7fdd9014f510 legacy=0x7fdd9014b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:18.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.480+0000 7fdd8ed9d640 1 -- 172.21.15.45:0/342749967 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9014ea30 con 0x7fdd9006f880 2023-10-03T19:20:18.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.484+0000 7fdd8ed9d640 1 --2- 172.21.15.45:0/342749967 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdd9006f880 0x7fdd900a5940 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdd800097f0 tx=0x7fdd8001e5c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50cfb351a4cde38c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:18.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.484+0000 7fdd8dd9b640 1 -- 172.21.15.45:0/342749967 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd84001680 con 0x7fdd9006f880 2023-10-03T19:20:18.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.484+0000 7fdd8dd9b640 1 -- 172.21.15.45:0/342749967 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd800ae410 con 0x7fdd9006f880 2023-10-03T19:20:18.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.484+0000 7fdd8dd9b640 1 -- 172.21.15.45:0/342749967 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd800ae580 con 0x7fdd9006f880 2023-10-03T19:20:18.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.484+0000 7fdd95024640 1 -- 172.21.15.45:0/342749967 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdd9006f880 msgr2=0x7fdd900a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:18.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.484+0000 7fdd95024640 1 --2- 172.21.15.45:0/342749967 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdd9006f880 0x7fdd900a5940 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdd800097f0 tx=0x7fdd8001e5c0 comp rx=0 tx=0).stop 2023-10-03T19:20:18.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.484+0000 7fdd95024640 1 -- 172.21.15.45:0/342749967 shutdown_connections 2023-10-03T19:20:18.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.484+0000 7fdd95024640 1 --2- 172.21.15.45:0/342749967 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdd9006f880 0x7fdd900a5940 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:18.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.484+0000 7fdd95024640 1 -- 172.21.15.45:0/342749967 >> 172.21.15.45:0/342749967 conn(0x7fdd900a20d0 msgr2=0x7fdd900a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:18.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.484+0000 7fdd95024640 1 -- 172.21.15.45:0/342749967 shutdown_connections 2023-10-03T19:20:18.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.484+0000 7fdd95024640 1 -- 172.21.15.45:0/342749967 wait complete. 2023-10-03T19:20:18.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.484+0000 7fdd95024640 1 Processor -- start 2023-10-03T19:20:18.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.484+0000 7fdd95024640 1 -- start start 2023-10-03T19:20:18.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.484+0000 7fdd95024640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd9006f880 0x7fdd901489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:18.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.484+0000 7fdd95024640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd9014ba30 0x7fdd901eaa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:18.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.484+0000 7fdd95024640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdd9014f510 0x7fdd90144470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:18.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.484+0000 7fdd95024640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd901ea600 con 0x7fdd9006f880 2023-10-03T19:20:18.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.484+0000 7fdd95024640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd901506f0 con 0x7fdd9014ba30 2023-10-03T19:20:18.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.484+0000 7fdd95024640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd90148ee0 con 0x7fdd9014f510 2023-10-03T19:20:18.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.484+0000 7fdd8ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd9006f880 0x7fdd901489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:18.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.484+0000 7fdd8ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd9006f880 0x7fdd901489a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42870/0 (socket says 172.21.15.45:42870) 2023-10-03T19:20:18.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.484+0000 7fdd8ed9d640 1 -- 172.21.15.45:0/3632079446 learned_addr learned my addr 172.21.15.45:0/3632079446 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:18.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.484+0000 7fdd8e59c640 1 --2- 172.21.15.45:0/3632079446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd9014ba30 0x7fdd901eaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:18.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.484+0000 7fdd8f59e640 1 --2- 172.21.15.45:0/3632079446 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdd9014f510 0x7fdd90144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:18.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.484+0000 7fdd8ed9d640 1 -- 172.21.15.45:0/3632079446 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdd9014f510 msgr2=0x7fdd90144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:18.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.484+0000 7fdd8ed9d640 1 --2- 172.21.15.45:0/3632079446 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdd9014f510 0x7fdd90144470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:18.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.484+0000 7fdd8ed9d640 1 -- 172.21.15.45:0/3632079446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd9014ba30 msgr2=0x7fdd901eaa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:18.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.484+0000 7fdd8ed9d640 1 --2- 172.21.15.45:0/3632079446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd9014ba30 0x7fdd901eaa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:18.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.484+0000 7fdd8ed9d640 1 -- 172.21.15.45:0/3632079446 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd80009420 con 0x7fdd9006f880 2023-10-03T19:20:18.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.488+0000 7fdd8ed9d640 1 --2- 172.21.15.45:0/3632079446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd9006f880 0x7fdd901489a0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fdd800097f0 tx=0x7fdd8001b360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:18.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.488+0000 7fdd777fe640 1 -- 172.21.15.45:0/3632079446 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd800038b0 con 0x7fdd9006f880 2023-10-03T19:20:18.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.488+0000 7fdd777fe640 1 -- 172.21.15.45:0/3632079446 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd80003a10 con 0x7fdd9006f880 2023-10-03T19:20:18.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.488+0000 7fdd95024640 1 -- 172.21.15.45:0/3632079446 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd90070a40 con 0x7fdd9006f880 2023-10-03T19:20:18.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.488+0000 7fdd777fe640 1 -- 172.21.15.45:0/3632079446 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd80003d80 con 0x7fdd9006f880 2023-10-03T19:20:18.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.488+0000 7fdd95024640 1 -- 172.21.15.45:0/3632079446 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd9006fc50 con 0x7fdd9006f880 2023-10-03T19:20:18.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.488+0000 7fdd95024640 1 -- 172.21.15.45:0/3632079446 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd90070bd0 con 0x7fdd9006f880 2023-10-03T19:20:18.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.488+0000 7fdd777fe640 1 -- 172.21.15.45:0/3632079446 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdd800ae580 con 0x7fdd9006f880 2023-10-03T19:20:18.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.488+0000 7fdd777fe640 1 --2- 172.21.15.45:0/3632079446 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fdd7c066280 0x7fdd7c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:18.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.488+0000 7fdd777fe640 1 -- 172.21.15.45:0/3632079446 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdd8011d860 con 0x7fdd9006f880 2023-10-03T19:20:18.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.488+0000 7fdd8e59c640 1 --2- 172.21.15.45:0/3632079446 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fdd7c066280 0x7fdd7c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:18.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.488+0000 7fdd8e59c640 1 --2- 172.21.15.45:0/3632079446 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fdd7c066280 0x7fdd7c068730 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fdd901e49d0 tx=0x7fdd84009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:18.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.492+0000 7fdd777fe640 1 -- 172.21.15.45:0/3632079446 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fdd800eac40 con 0x7fdd9006f880 2023-10-03T19:20:18.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:18.680+0000 7fdd95024640 1 -- 172.21.15.45:0/3632079446 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdd9004de80 con 0x7fdd9006f880 2023-10-03T19:20:19.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.332+0000 7fdd777fe640 1 -- 172.21.15.45:0/3632079446 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v58) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdd800ee260 con 0x7fdd9006f880 2023-10-03T19:20:19.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.336+0000 7fdd95024640 1 -- 172.21.15.45:0/3632079446 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fdd7c066280 msgr2=0x7fdd7c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:19.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.336+0000 7fdd95024640 1 --2- 172.21.15.45:0/3632079446 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fdd7c066280 0x7fdd7c068730 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fdd901e49d0 tx=0x7fdd84009040 comp rx=0 tx=0).stop 2023-10-03T19:20:19.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.336+0000 7fdd95024640 1 -- 172.21.15.45:0/3632079446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd9006f880 msgr2=0x7fdd901489a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:19.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.336+0000 7fdd95024640 1 --2- 172.21.15.45:0/3632079446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd9006f880 0x7fdd901489a0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fdd800097f0 tx=0x7fdd8001b360 comp rx=0 tx=0).stop 2023-10-03T19:20:19.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.336+0000 7fdd95024640 1 -- 172.21.15.45:0/3632079446 shutdown_connections 2023-10-03T19:20:19.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.336+0000 7fdd95024640 1 --2- 172.21.15.45:0/3632079446 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fdd7c066280 0x7fdd7c068730 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:19.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.336+0000 7fdd95024640 1 --2- 172.21.15.45:0/3632079446 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdd9014f510 0x7fdd90144470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:19.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.336+0000 7fdd95024640 1 --2- 172.21.15.45:0/3632079446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd9014ba30 0x7fdd901eaa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:19.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.336+0000 7fdd95024640 1 --2- 172.21.15.45:0/3632079446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd9006f880 0x7fdd901489a0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:19.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.336+0000 7fdd95024640 1 -- 172.21.15.45:0/3632079446 >> 172.21.15.45:0/3632079446 conn(0x7fdd900a20d0 msgr2=0x7fdd900bacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:19.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.336+0000 7fdd95024640 1 -- 172.21.15.45:0/3632079446 shutdown_connections 2023-10-03T19:20:19.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.336+0000 7fdd95024640 1 -- 172.21.15.45:0/3632079446 wait complete. 2023-10-03T19:20:19.358 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-03T19:20:19.358 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:20:19.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.484+0000 7fbe94430640 1 Processor -- start 2023-10-03T19:20:19.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.484+0000 7fbe94430640 1 -- start start 2023-10-03T19:20:19.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.484+0000 7fbe94430640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbe8c0bcb60 0x7fbe8c06c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:19.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.484+0000 7fbe94430640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbe8c06c7d0 0x7fbe8c155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:19.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.484+0000 7fbe94430640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe8c14b610 con 0x7fbe8c148b90 2023-10-03T19:20:19.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.484+0000 7fbe94430640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe8c0a3670 con 0x7fbe8c0bcb60 2023-10-03T19:20:19.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.484+0000 7fbe94430640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe8c14b370 con 0x7fbe8c06c7d0 2023-10-03T19:20:19.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.488+0000 7fbe919cb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbe8c0bcb60 0x7fbe8c06c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:19.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.488+0000 7fbe919cb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbe8c0bcb60 0x7fbe8c06c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42878/0 (socket says 172.21.15.45:42878) 2023-10-03T19:20:19.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.488+0000 7fbe919cb640 1 -- 172.21.15.45:0/358286497 learned_addr learned my addr 172.21.15.45:0/358286497 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:19.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.488+0000 7fbe929cd640 1 --2- 172.21.15.45:0/358286497 >> v2:172.21.15.79:3300/0 conn(0x7fbe8c06c7d0 0x7fbe8c155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:19.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.488+0000 7fbe919cb640 1 -- 172.21.15.45:0/358286497 >> v2:172.21.15.79:3300/0 conn(0x7fbe8c06c7d0 msgr2=0x7fbe8c155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:19.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.488+0000 7fbe919cb640 1 --2- 172.21.15.45:0/358286497 >> v2:172.21.15.79:3300/0 conn(0x7fbe8c06c7d0 0x7fbe8c155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:19.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.488+0000 7fbe919cb640 1 -- 172.21.15.45:0/358286497 >> v1:172.21.15.79:6789/0 conn(0x7fbe8c148b90 legacy=0x7fbe8c0bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:19.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.488+0000 7fbe919cb640 1 -- 172.21.15.45:0/358286497 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe8c0a5580 con 0x7fbe8c0bcb60 2023-10-03T19:20:19.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.488+0000 7fbe919cb640 1 --2- 172.21.15.45:0/358286497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe8c0bcb60 0x7fbe8c06c290 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c06aa90 tx=0x7fbe7c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4017b58528becfc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:19.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.488+0000 7fbe911ca640 1 -- 172.21.15.45:0/358286497 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c0a89f0 con 0x7fbe8c0bcb60 2023-10-03T19:20:19.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.488+0000 7fbe911ca640 1 -- 172.21.15.45:0/358286497 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7c0a8b50 con 0x7fbe8c0bcb60 2023-10-03T19:20:19.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.488+0000 7fbe911ca640 1 -- 172.21.15.45:0/358286497 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c0b0440 con 0x7fbe8c0bcb60 2023-10-03T19:20:19.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe94430640 1 -- 172.21.15.45:0/358286497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe8c0bcb60 msgr2=0x7fbe8c06c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:19.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe94430640 1 --2- 172.21.15.45:0/358286497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe8c0bcb60 0x7fbe8c06c290 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c06aa90 tx=0x7fbe7c01ecf0 comp rx=0 tx=0).stop 2023-10-03T19:20:19.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe94430640 1 -- 172.21.15.45:0/358286497 shutdown_connections 2023-10-03T19:20:19.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe94430640 1 --2- 172.21.15.45:0/358286497 >> v2:172.21.15.79:3300/0 conn(0x7fbe8c06c7d0 0x7fbe8c155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:19.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe94430640 1 --2- 172.21.15.45:0/358286497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe8c0bcb60 0x7fbe8c06c290 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:19.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe94430640 1 -- 172.21.15.45:0/358286497 >> 172.21.15.45:0/358286497 conn(0x7fbe8c0bcf50 msgr2=0x7fbe8c0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:19.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe94430640 1 -- 172.21.15.45:0/358286497 shutdown_connections 2023-10-03T19:20:19.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe94430640 1 -- 172.21.15.45:0/358286497 wait complete. 2023-10-03T19:20:19.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe94430640 1 Processor -- start 2023-10-03T19:20:19.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe94430640 1 -- start start 2023-10-03T19:20:19.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe94430640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe8c06c7d0 0x7fbe8c1d8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:19.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe94430640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe8c0bcb60 0x7fbe8c1e3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:19.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe94430640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe8c148b90 0x7fbe8c1e3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:19.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe94430640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c1e6a10 con 0x7fbe8c148b90 2023-10-03T19:20:19.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe94430640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c1d9350 con 0x7fbe8c06c7d0 2023-10-03T19:20:19.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe94430640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c0a2e30 con 0x7fbe8c0bcb60 2023-10-03T19:20:19.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe929cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe8c148b90 0x7fbe8c1e3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:19.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe929cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe8c148b90 0x7fbe8c1e3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42888/0 (socket says 172.21.15.45:42888) 2023-10-03T19:20:19.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe929cd640 1 -- 172.21.15.45:0/3157193683 learned_addr learned my addr 172.21.15.45:0/3157193683 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:19.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe919cb640 1 --2- 172.21.15.45:0/3157193683 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe8c0bcb60 0x7fbe8c1e3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:19.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe921cc640 1 --2- 172.21.15.45:0/3157193683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe8c06c7d0 0x7fbe8c1d8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:19.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe929cd640 1 -- 172.21.15.45:0/3157193683 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe8c0bcb60 msgr2=0x7fbe8c1e3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:19.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe929cd640 1 --2- 172.21.15.45:0/3157193683 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe8c0bcb60 0x7fbe8c1e3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:19.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe929cd640 1 -- 172.21.15.45:0/3157193683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe8c06c7d0 msgr2=0x7fbe8c1d8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:19.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe929cd640 1 --2- 172.21.15.45:0/3157193683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe8c06c7d0 0x7fbe8c1d8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:19.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe929cd640 1 -- 172.21.15.45:0/3157193683 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7c0094d0 con 0x7fbe8c148b90 2023-10-03T19:20:19.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe921cc640 1 --2- 172.21.15.45:0/3157193683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe8c06c7d0 0x7fbe8c1d8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:19.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe929cd640 1 --2- 172.21.15.45:0/3157193683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe8c148b90 0x7fbe8c1e3ff0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fbe84009dd0 tx=0x7fbe8400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:19.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe82ffd640 1 -- 172.21.15.45:0/3157193683 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe84014480 con 0x7fbe8c148b90 2023-10-03T19:20:19.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe82ffd640 1 -- 172.21.15.45:0/3157193683 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8400f040 con 0x7fbe8c148b90 2023-10-03T19:20:19.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe94430640 1 -- 172.21.15.45:0/3157193683 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe8c0bc670 con 0x7fbe8c148b90 2023-10-03T19:20:19.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe82ffd640 1 -- 172.21.15.45:0/3157193683 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe84014840 con 0x7fbe8c148b90 2023-10-03T19:20:19.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.492+0000 7fbe94430640 1 -- 172.21.15.45:0/3157193683 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe8c0a5820 con 0x7fbe8c148b90 2023-10-03T19:20:19.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.496+0000 7fbe94430640 1 -- 172.21.15.45:0/3157193683 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe8c148f60 con 0x7fbe8c148b90 2023-10-03T19:20:19.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.496+0000 7fbe82ffd640 1 -- 172.21.15.45:0/3157193683 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbe840149a0 con 0x7fbe8c148b90 2023-10-03T19:20:19.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.496+0000 7fbe82ffd640 1 --2- 172.21.15.45:0/3157193683 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbe700662b0 0x7fbe70068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:19.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.496+0000 7fbe82ffd640 1 -- 172.21.15.45:0/3157193683 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbe84084870 con 0x7fbe8c148b90 2023-10-03T19:20:19.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.496+0000 7fbe921cc640 1 --2- 172.21.15.45:0/3157193683 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbe700662b0 0x7fbe70068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:19.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.496+0000 7fbe921cc640 1 --2- 172.21.15.45:0/3157193683 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbe700662b0 0x7fbe70068760 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fbe88000f70 tx=0x7fbe88009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:19.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.500+0000 7fbe82ffd640 1 -- 172.21.15.45:0/3157193683 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbe84051cf0 con 0x7fbe8c148b90 2023-10-03T19:20:19.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.688+0000 7fbe94430640 1 -- 172.21.15.45:0/3157193683 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe8c1e6bc0 con 0x7fbe8c148b90 2023-10-03T19:20:19.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.688+0000 7fbe82ffd640 1 -- 172.21.15.45:0/3157193683 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+3916 (secure 0 0 0) 0x7fbe8c1e6bc0 con 0x7fbe8c148b90 2023-10-03T19:20:19.691 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:20:19.692 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":58,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3566869652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3566869652},{"type":"v1","addr":"172.21.15.79:6835","nonce":3566869652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":7587,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2339652261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2339652261},{"type":"v1","addr":"172.21.15.45:6833","nonce":2339652261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:20:16.301166+0000","modified":"2023-10-03T19:20:19.318778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7602":{"gid":7602,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1723126563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1723126563},{"type":"v1","addr":"172.21.15.45:6835","nonce":1723126563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-10-03T19:20:19.692 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 58 2023-10-03T19:20:19.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.692+0000 7fbe94430640 1 -- 172.21.15.45:0/3157193683 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbe700662b0 msgr2=0x7fbe70068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:19.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.692+0000 7fbe94430640 1 --2- 172.21.15.45:0/3157193683 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbe700662b0 0x7fbe70068760 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fbe88000f70 tx=0x7fbe88009040 comp rx=0 tx=0).stop 2023-10-03T19:20:19.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.692+0000 7fbe94430640 1 -- 172.21.15.45:0/3157193683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe8c148b90 msgr2=0x7fbe8c1e3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:19.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.692+0000 7fbe94430640 1 --2- 172.21.15.45:0/3157193683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe8c148b90 0x7fbe8c1e3ff0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fbe84009dd0 tx=0x7fbe8400c490 comp rx=0 tx=0).stop 2023-10-03T19:20:19.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.692+0000 7fbe94430640 1 -- 172.21.15.45:0/3157193683 shutdown_connections 2023-10-03T19:20:19.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.692+0000 7fbe94430640 1 --2- 172.21.15.45:0/3157193683 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbe700662b0 0x7fbe70068760 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:19.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.692+0000 7fbe94430640 1 --2- 172.21.15.45:0/3157193683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe8c148b90 0x7fbe8c1e3ff0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:19.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.692+0000 7fbe94430640 1 --2- 172.21.15.45:0/3157193683 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe8c0bcb60 0x7fbe8c1e3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:19.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.692+0000 7fbe94430640 1 --2- 172.21.15.45:0/3157193683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe8c06c7d0 0x7fbe8c1d8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:19.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.692+0000 7fbe94430640 1 -- 172.21.15.45:0/3157193683 >> 172.21.15.45:0/3157193683 conn(0x7fbe8c0bcf50 msgr2=0x7fbe8c0bb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:19.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.692+0000 7fbe94430640 1 -- 172.21.15.45:0/3157193683 shutdown_connections 2023-10-03T19:20:19.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.692+0000 7fbe94430640 1 -- 172.21.15.45:0/3157193683 wait complete. 2023-10-03T19:20:19.710 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:20:19.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.824+0000 7fe138550640 1 Processor -- start 2023-10-03T19:20:19.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.824+0000 7fe138550640 1 -- start start 2023-10-03T19:20:19.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.828+0000 7fe138550640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe13006f170 0x7fe130150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:19.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.828+0000 7fe138550640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe1300bc8b0 0x7fe13014ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:19.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.828+0000 7fe138550640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe13006cac0 con 0x7fe13006d170 2023-10-03T19:20:19.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.828+0000 7fe138550640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1300720d0 con 0x7fe1300bc8b0 2023-10-03T19:20:19.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.828+0000 7fe138550640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1300a5ab0 con 0x7fe13006f170 2023-10-03T19:20:19.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.828+0000 7fe1362ec640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe13006f170 0x7fe130150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:19.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.828+0000 7fe1362ec640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe13006f170 0x7fe130150190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:50400/0 (socket says 172.21.15.45:50400) 2023-10-03T19:20:19.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.828+0000 7fe1362ec640 1 -- 172.21.15.45:0/3028461012 learned_addr learned my addr 172.21.15.45:0/3028461012 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:19.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.828+0000 7fe135aeb640 1 --2- 172.21.15.45:0/3028461012 >> v2:172.21.15.79:3300/0 conn(0x7fe1300bc8b0 0x7fe13014ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:19.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.828+0000 7fe1362ec640 1 -- 172.21.15.45:0/3028461012 >> v2:172.21.15.79:3300/0 conn(0x7fe1300bc8b0 msgr2=0x7fe13014ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:19.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.828+0000 7fe1362ec640 1 --2- 172.21.15.45:0/3028461012 >> v2:172.21.15.79:3300/0 conn(0x7fe1300bc8b0 0x7fe13014ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:19.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.828+0000 7fe1362ec640 1 -- 172.21.15.45:0/3028461012 >> v1:172.21.15.79:6789/0 conn(0x7fe13006d170 legacy=0x7fe13014cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:19.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.828+0000 7fe1362ec640 1 -- 172.21.15.45:0/3028461012 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13006cd00 con 0x7fe13006f170 2023-10-03T19:20:19.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe1362ec640 1 --2- 172.21.15.45:0/3028461012 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe13006f170 0x7fe130150190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe11c009870 tx=0x7fe11c01ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db2d39c27fa4ab08 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:19.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe1352ea640 1 -- 172.21.15.45:0/3028461012 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c0a8a30 con 0x7fe13006f170 2023-10-03T19:20:19.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe1352ea640 1 -- 172.21.15.45:0/3028461012 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11c0a8b90 con 0x7fe13006f170 2023-10-03T19:20:19.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe1352ea640 1 -- 172.21.15.45:0/3028461012 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c0b0440 con 0x7fe13006f170 2023-10-03T19:20:19.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe138550640 1 -- 172.21.15.45:0/3028461012 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe13006f170 msgr2=0x7fe130150190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:19.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe138550640 1 --2- 172.21.15.45:0/3028461012 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe13006f170 0x7fe130150190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe11c009870 tx=0x7fe11c01ed30 comp rx=0 tx=0).stop 2023-10-03T19:20:19.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe138550640 1 -- 172.21.15.45:0/3028461012 shutdown_connections 2023-10-03T19:20:19.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe138550640 1 --2- 172.21.15.45:0/3028461012 >> v2:172.21.15.79:3300/0 conn(0x7fe1300bc8b0 0x7fe13014ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:19.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe138550640 1 --2- 172.21.15.45:0/3028461012 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe13006f170 0x7fe130150190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:19.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe138550640 1 -- 172.21.15.45:0/3028461012 >> 172.21.15.45:0/3028461012 conn(0x7fe1300bcf50 msgr2=0x7fe1300bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:19.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe138550640 1 -- 172.21.15.45:0/3028461012 shutdown_connections 2023-10-03T19:20:19.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe138550640 1 -- 172.21.15.45:0/3028461012 wait complete. 2023-10-03T19:20:19.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe138550640 1 Processor -- start 2023-10-03T19:20:19.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe138550640 1 -- start start 2023-10-03T19:20:19.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe138550640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe13006d170 0x7fe1301490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:19.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe138550640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe13006f170 0x7fe1301e6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:19.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe138550640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1300bc8b0 0x7fe1301e72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:19.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe138550640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1301d6c60 con 0x7fe1300bc8b0 2023-10-03T19:20:19.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe138550640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe130149610 con 0x7fe13006f170 2023-10-03T19:20:19.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe138550640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe130146a70 con 0x7fe13006d170 2023-10-03T19:20:19.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe136aed640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1300bc8b0 0x7fe1301e72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:19.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe136aed640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1300bc8b0 0x7fe1301e72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42902/0 (socket says 172.21.15.45:42902) 2023-10-03T19:20:19.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe136aed640 1 -- 172.21.15.45:0/208343014 learned_addr learned my addr 172.21.15.45:0/208343014 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:19.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe1362ec640 1 --2- 172.21.15.45:0/208343014 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe13006d170 0x7fe1301490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:19.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe135aeb640 1 --2- 172.21.15.45:0/208343014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe13006f170 0x7fe1301e6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:19.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe136aed640 1 -- 172.21.15.45:0/208343014 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe13006d170 msgr2=0x7fe1301490d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:19.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe136aed640 1 --2- 172.21.15.45:0/208343014 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe13006d170 0x7fe1301490d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:19.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe136aed640 1 -- 172.21.15.45:0/208343014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe13006f170 msgr2=0x7fe1301e6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:19.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe136aed640 1 --2- 172.21.15.45:0/208343014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe13006f170 0x7fe1301e6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:19.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe136aed640 1 -- 172.21.15.45:0/208343014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c0094d0 con 0x7fe1300bc8b0 2023-10-03T19:20:19.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe1362ec640 1 --2- 172.21.15.45:0/208343014 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe13006d170 0x7fe1301490d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:20:19.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.832+0000 7fe136aed640 1 --2- 172.21.15.45:0/208343014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1300bc8b0 0x7fe1301e72a0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fe12800c430 tx=0x7fe12800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:19.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.836+0000 7fe12effd640 1 -- 172.21.15.45:0/208343014 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe128005220 con 0x7fe1300bc8b0 2023-10-03T19:20:19.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.836+0000 7fe12effd640 1 -- 172.21.15.45:0/208343014 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe128005380 con 0x7fe1300bc8b0 2023-10-03T19:20:19.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.836+0000 7fe138550640 1 -- 172.21.15.45:0/208343014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe13014c4a0 con 0x7fe1300bc8b0 2023-10-03T19:20:19.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.836+0000 7fe12effd640 1 -- 172.21.15.45:0/208343014 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe128007270 con 0x7fe1300bc8b0 2023-10-03T19:20:19.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.836+0000 7fe138550640 1 -- 172.21.15.45:0/208343014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe13014fae0 con 0x7fe1300bc8b0 2023-10-03T19:20:19.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.836+0000 7fe138550640 1 -- 172.21.15.45:0/208343014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe13006f540 con 0x7fe1300bc8b0 2023-10-03T19:20:19.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.836+0000 7fe12effd640 1 -- 172.21.15.45:0/208343014 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe1280073d0 con 0x7fe1300bc8b0 2023-10-03T19:20:19.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.836+0000 7fe12effd640 1 --2- 172.21.15.45:0/208343014 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe114066280 0x7fe114068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:19.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.836+0000 7fe12effd640 1 -- 172.21.15.45:0/208343014 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe128083200 con 0x7fe1300bc8b0 2023-10-03T19:20:19.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.836+0000 7fe1362ec640 1 --2- 172.21.15.45:0/208343014 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe114066280 0x7fe114068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:19.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.836+0000 7fe1362ec640 1 --2- 172.21.15.45:0/208343014 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe114066280 0x7fe114068730 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe11c0b2000 tx=0x7fe11c0aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:19.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.840+0000 7fe12effd640 1 -- 172.21.15.45:0/208343014 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe1280505f0 con 0x7fe1300bc8b0 2023-10-03T19:20:19.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:19.996+0000 7fe138550640 1 -- 172.21.15.45:0/208343014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe13006d660 con 0x7fe1300bc8b0 2023-10-03T19:20:20.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.000+0000 7fe12effd640 1 -- 172.21.15.45:0/208343014 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+18313 (secure 0 0 0) 0x7fe128053c10 con 0x7fe1300bc8b0 2023-10-03T19:20:20.003 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:20:20.003 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":109,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:20:17.304980+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:20:13.940428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-10-03T19:20:15.290748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:20:20.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.000+0000 7fe138550640 1 -- 172.21.15.45:0/208343014 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe114066280 msgr2=0x7fe114068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:20.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.000+0000 7fe138550640 1 --2- 172.21.15.45:0/208343014 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe114066280 0x7fe114068730 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe11c0b2000 tx=0x7fe11c0aa070 comp rx=0 tx=0).stop 2023-10-03T19:20:20.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.000+0000 7fe138550640 1 -- 172.21.15.45:0/208343014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1300bc8b0 msgr2=0x7fe1301e72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:20.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.000+0000 7fe138550640 1 --2- 172.21.15.45:0/208343014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1300bc8b0 0x7fe1301e72a0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fe12800c430 tx=0x7fe12800c8f0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.000+0000 7fe138550640 1 -- 172.21.15.45:0/208343014 shutdown_connections 2023-10-03T19:20:20.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.000+0000 7fe138550640 1 --2- 172.21.15.45:0/208343014 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe114066280 0x7fe114068730 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.000+0000 7fe138550640 1 --2- 172.21.15.45:0/208343014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1300bc8b0 0x7fe1301e72a0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.000+0000 7fe138550640 1 --2- 172.21.15.45:0/208343014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe13006f170 0x7fe1301e6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.000+0000 7fe138550640 1 --2- 172.21.15.45:0/208343014 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe13006d170 0x7fe1301490d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.000+0000 7fe138550640 1 -- 172.21.15.45:0/208343014 >> 172.21.15.45:0/208343014 conn(0x7fe1300bcf50 msgr2=0x7fe1300b98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:20.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.000+0000 7fe138550640 1 -- 172.21.15.45:0/208343014 shutdown_connections 2023-10-03T19:20:20.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.000+0000 7fe138550640 1 -- 172.21.15.45:0/208343014 wait complete. 2023-10-03T19:20:20.023 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-03T19:20:20.023 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:20:20.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.136+0000 7f283f2d1640 1 Processor -- start 2023-10-03T19:20:20.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.136+0000 7f283f2d1640 1 -- start start 2023-10-03T19:20:20.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.140+0000 7f283f2d1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f28380c2790 0x7f28381528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:20.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.140+0000 7f283f2d1640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f283806b2d0 con 0x7f28380bb1d0 2023-10-03T19:20:20.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.140+0000 7f283f2d1640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28380a3c60 con 0x7f283814f240 2023-10-03T19:20:20.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.140+0000 7f283f2d1640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f283806b640 con 0x7f28380c2790 2023-10-03T19:20:20.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.140+0000 7f283c86c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f28380c2790 0x7f28381528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:20.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.140+0000 7f283c86c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f28380c2790 0x7f28381528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42918/0 (socket says 172.21.15.45:42918) 2023-10-03T19:20:20.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.140+0000 7f283c86c640 1 -- 172.21.15.45:0/2381835316 learned_addr learned my addr 172.21.15.45:0/2381835316 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:20.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.140+0000 7f283d86e640 1 --1- 172.21.15.45:0/2381835316 >> v1:172.21.15.45:6789/0 conn(0x7f28380bb1d0 0x7f28380c12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54756/0 (socket says 172.21.15.45:54756) 2023-10-03T19:20:20.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.140+0000 7f283c86c640 1 -- 172.21.15.45:0/2381835316 >> v1:172.21.15.79:6789/0 conn(0x7f283814f240 legacy=0x7f28380c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:20.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.140+0000 7f283c86c640 1 -- 172.21.15.45:0/2381835316 >> v1:172.21.15.45:6789/0 conn(0x7f28380bb1d0 legacy=0x7f28380c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:20.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.140+0000 7f2837fff640 1 -- 172.21.15.45:0/2381835316 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 489956992 0 0) 0x7f283806b2d0 con 0x7f28380bb1d0 2023-10-03T19:20:20.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.140+0000 7f283c86c640 1 -- 172.21.15.45:0/2381835316 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28380c19b0 con 0x7f28380c2790 2023-10-03T19:20:20.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.140+0000 7f283c86c640 1 --2- 172.21.15.45:0/2381835316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28380c2790 0x7f28381528d0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f282c006fd0 tx=0x7f282c01ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df9ed086e8c3b22 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:20.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.140+0000 7f2837fff640 1 -- 172.21.15.45:0/2381835316 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c0a89d0 con 0x7f28380c2790 2023-10-03T19:20:20.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.140+0000 7f2837fff640 1 -- 172.21.15.45:0/2381835316 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282c0a8b30 con 0x7f28380c2790 2023-10-03T19:20:20.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.140+0000 7f2837fff640 1 -- 172.21.15.45:0/2381835316 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c0b0440 con 0x7f28380c2790 2023-10-03T19:20:20.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.144+0000 7f283f2d1640 1 -- 172.21.15.45:0/2381835316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28380c2790 msgr2=0x7f28381528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:20.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.144+0000 7f283f2d1640 1 --2- 172.21.15.45:0/2381835316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28380c2790 0x7f28381528d0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f282c006fd0 tx=0x7f282c01ecd0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.144+0000 7f283f2d1640 1 -- 172.21.15.45:0/2381835316 shutdown_connections 2023-10-03T19:20:20.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.144+0000 7f283f2d1640 1 --2- 172.21.15.45:0/2381835316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28380c2790 0x7f28381528d0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.144+0000 7f283f2d1640 1 -- 172.21.15.45:0/2381835316 >> 172.21.15.45:0/2381835316 conn(0x7f28380a64a0 msgr2=0x7f28380a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:20.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.144+0000 7f283f2d1640 1 -- 172.21.15.45:0/2381835316 shutdown_connections 2023-10-03T19:20:20.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.144+0000 7f283f2d1640 1 -- 172.21.15.45:0/2381835316 wait complete. 2023-10-03T19:20:20.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.144+0000 7f283f2d1640 1 Processor -- start 2023-10-03T19:20:20.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.144+0000 7f283f2d1640 1 -- start start 2023-10-03T19:20:20.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.144+0000 7f283f2d1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28380bb1d0 0x7f28380bd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:20.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.144+0000 7f283f2d1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28380c2790 0x7f283814cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:20.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.144+0000 7f283f2d1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f283814f240 0x7f28381e7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:20.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.144+0000 7f283f2d1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28380a8da0 con 0x7f28380bb1d0 2023-10-03T19:20:20.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.144+0000 7f283f2d1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28380a30d0 con 0x7f28380c2790 2023-10-03T19:20:20.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.144+0000 7f283f2d1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28380bdbe0 con 0x7f283814f240 2023-10-03T19:20:20.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.144+0000 7f283d06d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28380bb1d0 0x7f28380bd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:20.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.144+0000 7f283d06d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28380bb1d0 0x7f28380bd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42924/0 (socket says 172.21.15.45:42924) 2023-10-03T19:20:20.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.144+0000 7f283d06d640 1 -- 172.21.15.45:0/1826387896 learned_addr learned my addr 172.21.15.45:0/1826387896 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:20.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.144+0000 7f283d06d640 1 -- 172.21.15.45:0/1826387896 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f283814f240 msgr2=0x7f28381e7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:20.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.144+0000 7f283d06d640 1 --2- 172.21.15.45:0/1826387896 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f283814f240 0x7f28381e7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.144+0000 7f283d06d640 1 -- 172.21.15.45:0/1826387896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28380c2790 msgr2=0x7f283814cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:20.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.144+0000 7f283d06d640 1 --2- 172.21.15.45:0/1826387896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28380c2790 0x7f283814cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.144+0000 7f283d06d640 1 -- 172.21.15.45:0/1826387896 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282c009480 con 0x7f28380bb1d0 2023-10-03T19:20:20.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.144+0000 7f283d06d640 1 --2- 172.21.15.45:0/1826387896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28380bb1d0 0x7f28380bd6a0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f282800ba50 tx=0x7f282800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:20.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.144+0000 7f2835ffb640 1 -- 172.21.15.45:0/1826387896 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282800cbe0 con 0x7f28380bb1d0 2023-10-03T19:20:20.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.144+0000 7f2835ffb640 1 -- 172.21.15.45:0/1826387896 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282800cd80 con 0x7f28380bb1d0 2023-10-03T19:20:20.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.144+0000 7f283f2d1640 1 -- 172.21.15.45:0/1826387896 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28380a3f40 con 0x7f28380bb1d0 2023-10-03T19:20:20.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.144+0000 7f2835ffb640 1 -- 172.21.15.45:0/1826387896 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2828014680 con 0x7f28380bb1d0 2023-10-03T19:20:20.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.144+0000 7f283f2d1640 1 -- 172.21.15.45:0/1826387896 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f283814e740 con 0x7f28380bb1d0 2023-10-03T19:20:20.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.148+0000 7f283f2d1640 1 -- 172.21.15.45:0/1826387896 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f283814f610 con 0x7f28380bb1d0 2023-10-03T19:20:20.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.148+0000 7f2835ffb640 1 -- 172.21.15.45:0/1826387896 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f28280147e0 con 0x7f28380bb1d0 2023-10-03T19:20:20.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.148+0000 7f2835ffb640 1 --2- 172.21.15.45:0/1826387896 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2824066280 0x7f2824068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:20.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.148+0000 7f2835ffb640 1 -- 172.21.15.45:0/1826387896 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2828083aa0 con 0x7f28380bb1d0 2023-10-03T19:20:20.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.148+0000 7f283c86c640 1 --2- 172.21.15.45:0/1826387896 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2824066280 0x7f2824068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:20.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.148+0000 7f283c86c640 1 --2- 172.21.15.45:0/1826387896 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2824066280 0x7f2824068730 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f282c0b2000 tx=0x7f282c004740 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:20.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.152+0000 7f2835ffb640 1 -- 172.21.15.45:0/1826387896 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2828050fd0 con 0x7f28380bb1d0 2023-10-03T19:20:20.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.300+0000 7f283f2d1640 1 -- 172.21.15.45:0/1826387896 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f28380aa700 con 0x7f2824066280 2023-10-03T19:20:20.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.324+0000 7f2835ffb640 1 -- 172.21.15.45:0/1826387896 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305730 (secure 0 0 0) 0x7f282c0a87d0 con 0x7f2824066280 2023-10-03T19:20:20.331 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:20:20.333 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:20:20.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.328+0000 7f283f2d1640 1 -- 172.21.15.45:0/1826387896 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2824066280 msgr2=0x7f2824068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:20.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.328+0000 7f283f2d1640 1 --2- 172.21.15.45:0/1826387896 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2824066280 0x7f2824068730 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f282c0b2000 tx=0x7f282c004740 comp rx=0 tx=0).stop 2023-10-03T19:20:20.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.328+0000 7f283f2d1640 1 -- 172.21.15.45:0/1826387896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28380bb1d0 msgr2=0x7f28380bd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:20.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.328+0000 7f283f2d1640 1 --2- 172.21.15.45:0/1826387896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28380bb1d0 0x7f28380bd6a0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f282800ba50 tx=0x7f282800bf10 comp rx=0 tx=0).stop 2023-10-03T19:20:20.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.328+0000 7f283f2d1640 1 -- 172.21.15.45:0/1826387896 shutdown_connections 2023-10-03T19:20:20.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.328+0000 7f283f2d1640 1 --2- 172.21.15.45:0/1826387896 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2824066280 0x7f2824068730 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.328+0000 7f283f2d1640 1 --2- 172.21.15.45:0/1826387896 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f283814f240 0x7f28381e7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.328+0000 7f283f2d1640 1 --2- 172.21.15.45:0/1826387896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28380c2790 0x7f283814cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.328+0000 7f283f2d1640 1 --2- 172.21.15.45:0/1826387896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28380bb1d0 0x7f28380bd6a0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.328+0000 7f283f2d1640 1 -- 172.21.15.45:0/1826387896 >> 172.21.15.45:0/1826387896 conn(0x7f28380a64a0 msgr2=0x7f28380c12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:20.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.328+0000 7f283f2d1640 1 -- 172.21.15.45:0/1826387896 shutdown_connections 2023-10-03T19:20:20.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.328+0000 7f283f2d1640 1 -- 172.21.15.45:0/1826387896 wait complete. 2023-10-03T19:20:20.351 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2023-10-03T19:20:18.613175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591748,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":194,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":152,"acting":152,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":251216,"kb_used_data":10512,"kb_used_omap":0,"kb_used_meta":240640,"kb_avail":754723504,"statfs":{"total":773094113280,"available":772836868096,"internally_reserved":0,"allocated":10764288,"data_stored":6038608,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":246415360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1380,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001169"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.359932+0000","last_change":"2023-10-03T19:20:16.343087+0000","last_active":"2023-10-03T19:20:16.359932+0000","last_peered":"2023-10-03T19:20:16.359932+0000","last_clean":"2023-10-03T19:20:16.359932+0000","last_became_active":"2023-10-03T19:20:16.342222+0000","last_became_peered":"2023-10-03T19:20:16.342222+0000","last_unstale":"2023-10-03T19:20:16.359932+0000","last_undegraded":"2023-10-03T19:20:16.359932+0000","last_fullsized":"2023-10-03T19:20:16.359932+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:50:10.917756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.313689+0000","last_change":"2023-10-03T19:20:16.313689+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.313689+0000","last_undegraded":"2023-10-03T19:20:16.313689+0000","last_fullsized":"2023-10-03T19:20:16.313689+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:46:55.330519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.319563+0000","last_change":"2023-10-03T19:20:16.319563+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.319563+0000","last_undegraded":"2023-10-03T19:20:16.319563+0000","last_fullsized":"2023-10-03T19:20:16.319563+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:10:04.836594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.388471+0000","last_change":"2023-10-03T19:20:16.366790+0000","last_active":"2023-10-03T19:20:16.388471+0000","last_peered":"2023-10-03T19:20:16.388471+0000","last_clean":"2023-10-03T19:20:16.388471+0000","last_became_active":"2023-10-03T19:20:16.366099+0000","last_became_peered":"2023-10-03T19:20:16.366099+0000","last_unstale":"2023-10-03T19:20:16.388471+0000","last_undegraded":"2023-10-03T19:20:16.388471+0000","last_fullsized":"2023-10-03T19:20:16.388471+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:38:23.411788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.384249+0000","last_change":"2023-10-03T19:20:16.380848+0000","last_active":"2023-10-03T19:20:16.384249+0000","last_peered":"2023-10-03T19:20:16.384249+0000","last_clean":"2023-10-03T19:20:16.384249+0000","last_became_active":"2023-10-03T19:20:16.379931+0000","last_became_peered":"2023-10-03T19:20:16.379931+0000","last_unstale":"2023-10-03T19:20:16.384249+0000","last_undegraded":"2023-10-03T19:20:16.384249+0000","last_fullsized":"2023-10-03T19:20:16.384249+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:38:10.161375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:20:15.906015+0000","last_change":"2023-10-03T19:20:15.906015+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:15.906015+0000","last_undegraded":"2023-10-03T19:20:15.906015+0000","last_fullsized":"2023-10-03T19:20:15.906015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:20:15.906015+0000","last_change":"2023-10-03T19:20:15.906015+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:15.906015+0000","last_undegraded":"2023-10-03T19:20:15.906015+0000","last_fullsized":"2023-10-03T19:20:15.906015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.313002+0000","last_change":"2023-10-03T19:20:16.313002+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.313002+0000","last_undegraded":"2023-10-03T19:20:16.313002+0000","last_fullsized":"2023-10-03T19:20:16.313002+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:58:50.794379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.388443+0000","last_change":"2023-10-03T19:20:16.366438+0000","last_active":"2023-10-03T19:20:16.388443+0000","last_peered":"2023-10-03T19:20:16.388443+0000","last_clean":"2023-10-03T19:20:16.388443+0000","last_became_active":"2023-10-03T19:20:16.365832+0000","last_became_peered":"2023-10-03T19:20:16.365832+0000","last_unstale":"2023-10-03T19:20:16.388443+0000","last_undegraded":"2023-10-03T19:20:16.388443+0000","last_fullsized":"2023-10-03T19:20:16.388443+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:25:32.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.337779+0000","last_change":"2023-10-03T19:20:16.333439+0000","last_active":"2023-10-03T19:20:16.337779+0000","last_peered":"2023-10-03T19:20:16.337779+0000","last_clean":"2023-10-03T19:20:16.337779+0000","last_became_active":"2023-10-03T19:20:16.332236+0000","last_became_peered":"2023-10-03T19:20:16.332236+0000","last_unstale":"2023-10-03T19:20:16.337779+0000","last_undegraded":"2023-10-03T19:20:16.337779+0000","last_fullsized":"2023-10-03T19:20:16.337779+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:44:23.426898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.374688+0000","last_change":"2023-10-03T19:20:16.369509+0000","last_active":"2023-10-03T19:20:16.374688+0000","last_peered":"2023-10-03T19:20:16.374688+0000","last_clean":"2023-10-03T19:20:16.374688+0000","last_became_active":"2023-10-03T19:20:16.368845+0000","last_became_peered":"2023-10-03T19:20:16.368845+0000","last_unstale":"2023-10-03T19:20:16.374688+0000","last_undegraded":"2023-10-03T19:20:16.374688+0000","last_fullsized":"2023-10-03T19:20:16.374688+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:44:06.881790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:20:15.906015+0000","last_change":"2023-10-03T19:20:15.906015+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:15.906015+0000","last_undegraded":"2023-10-03T19:20:15.906015+0000","last_fullsized":"2023-10-03T19:20:15.906015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.365387+0000","last_change":"2023-10-03T19:20:16.363982+0000","last_active":"2023-10-03T19:20:16.365387+0000","last_peered":"2023-10-03T19:20:16.365387+0000","last_clean":"2023-10-03T19:20:16.365387+0000","last_became_active":"2023-10-03T19:20:16.363497+0000","last_became_peered":"2023-10-03T19:20:16.363497+0000","last_unstale":"2023-10-03T19:20:16.365387+0000","last_undegraded":"2023-10-03T19:20:16.365387+0000","last_fullsized":"2023-10-03T19:20:16.365387+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:08:32.046373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.314003+0000","last_change":"2023-10-03T19:20:16.314003+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.314003+0000","last_undegraded":"2023-10-03T19:20:16.314003+0000","last_fullsized":"2023-10-03T19:20:16.314003+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:32:29.079841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.374687+0000","last_change":"2023-10-03T19:20:16.369450+0000","last_active":"2023-10-03T19:20:16.374687+0000","last_peered":"2023-10-03T19:20:16.374687+0000","last_clean":"2023-10-03T19:20:16.374687+0000","last_became_active":"2023-10-03T19:20:16.368874+0000","last_became_peered":"2023-10-03T19:20:16.368874+0000","last_unstale":"2023-10-03T19:20:16.374687+0000","last_undegraded":"2023-10-03T19:20:16.374687+0000","last_fullsized":"2023-10-03T19:20:16.374687+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:32:29.079841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:20:15.906015+0000","last_change":"2023-10-03T19:20:15.906015+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:15.906015+0000","last_undegraded":"2023-10-03T19:20:15.906015+0000","last_fullsized":"2023-10-03T19:20:15.906015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.365365+0000","last_change":"2023-10-03T19:20:16.363892+0000","last_active":"2023-10-03T19:20:16.365365+0000","last_peered":"2023-10-03T19:20:16.365365+0000","last_clean":"2023-10-03T19:20:16.365365+0000","last_became_active":"2023-10-03T19:20:16.363606+0000","last_became_peered":"2023-10-03T19:20:16.363606+0000","last_unstale":"2023-10-03T19:20:16.365365+0000","last_undegraded":"2023-10-03T19:20:16.365365+0000","last_fullsized":"2023-10-03T19:20:16.365365+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:28:24.282225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.313320+0000","last_change":"2023-10-03T19:20:16.313320+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.313320+0000","last_undegraded":"2023-10-03T19:20:16.313320+0000","last_fullsized":"2023-10-03T19:20:16.313320+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:38:10.161375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.329432+0000","last_change":"2023-10-03T19:20:16.383943+0000","last_active":"2023-10-03T19:20:17.329432+0000","last_peered":"2023-10-03T19:20:17.329432+0000","last_clean":"2023-10-03T19:20:17.329432+0000","last_became_active":"2023-10-03T19:20:16.383157+0000","last_became_peered":"2023-10-03T19:20:16.383157+0000","last_unstale":"2023-10-03T19:20:17.329432+0000","last_undegraded":"2023-10-03T19:20:17.329432+0000","last_fullsized":"2023-10-03T19:20:17.329432+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:34:17.223181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.318797+0000","last_change":"2023-10-03T19:20:16.322423+0000","last_active":"2023-10-03T19:20:17.318797+0000","last_peered":"2023-10-03T19:20:17.318797+0000","last_clean":"2023-10-03T19:20:17.318797+0000","last_became_active":"2023-10-03T19:20:16.322147+0000","last_became_peered":"2023-10-03T19:20:16.322147+0000","last_unstale":"2023-10-03T19:20:17.318797+0000","last_undegraded":"2023-10-03T19:20:17.318797+0000","last_fullsized":"2023-10-03T19:20:17.318797+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:12:31.453399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.388755+0000","last_change":"2023-10-03T19:20:16.372224+0000","last_active":"2023-10-03T19:20:16.388755+0000","last_peered":"2023-10-03T19:20:16.388755+0000","last_clean":"2023-10-03T19:20:16.388755+0000","last_became_active":"2023-10-03T19:20:16.371522+0000","last_became_peered":"2023-10-03T19:20:16.371522+0000","last_unstale":"2023-10-03T19:20:16.388755+0000","last_undegraded":"2023-10-03T19:20:16.388755+0000","last_fullsized":"2023-10-03T19:20:16.388755+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:37:56.189574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.364672+0000","last_change":"2023-10-03T19:20:16.348420+0000","last_active":"2023-10-03T19:20:16.364672+0000","last_peered":"2023-10-03T19:20:16.364672+0000","last_clean":"2023-10-03T19:20:16.364672+0000","last_became_active":"2023-10-03T19:20:16.347688+0000","last_became_peered":"2023-10-03T19:20:16.347688+0000","last_unstale":"2023-10-03T19:20:16.364672+0000","last_undegraded":"2023-10-03T19:20:16.364672+0000","last_fullsized":"2023-10-03T19:20:16.364672+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:35:03.160406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.388852+0000","last_change":"2023-10-03T19:20:16.373061+0000","last_active":"2023-10-03T19:20:16.388852+0000","last_peered":"2023-10-03T19:20:16.388852+0000","last_clean":"2023-10-03T19:20:16.388852+0000","last_became_active":"2023-10-03T19:20:16.372301+0000","last_became_peered":"2023-10-03T19:20:16.372301+0000","last_unstale":"2023-10-03T19:20:16.388852+0000","last_undegraded":"2023-10-03T19:20:16.388852+0000","last_fullsized":"2023-10-03T19:20:16.388852+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:32:36.381349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:20:15.906015+0000","last_change":"2023-10-03T19:20:15.906015+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:15.906015+0000","last_undegraded":"2023-10-03T19:20:15.906015+0000","last_fullsized":"2023-10-03T19:20:15.906015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:20:15.906015+0000","last_change":"2023-10-03T19:20:15.906015+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:15.906015+0000","last_undegraded":"2023-10-03T19:20:15.906015+0000","last_fullsized":"2023-10-03T19:20:15.906015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.318972+0000","last_change":"2023-10-03T19:20:16.332688+0000","last_active":"2023-10-03T19:20:17.318972+0000","last_peered":"2023-10-03T19:20:17.318972+0000","last_clean":"2023-10-03T19:20:17.318972+0000","last_became_active":"2023-10-03T19:20:16.332406+0000","last_became_peered":"2023-10-03T19:20:16.332406+0000","last_unstale":"2023-10-03T19:20:17.318972+0000","last_undegraded":"2023-10-03T19:20:17.318972+0000","last_fullsized":"2023-10-03T19:20:17.318972+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:56:57.997822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.329517+0000","last_change":"2023-10-03T19:20:16.383652+0000","last_active":"2023-10-03T19:20:17.329517+0000","last_peered":"2023-10-03T19:20:17.329517+0000","last_clean":"2023-10-03T19:20:17.329517+0000","last_became_active":"2023-10-03T19:20:16.382532+0000","last_became_peered":"2023-10-03T19:20:16.382532+0000","last_unstale":"2023-10-03T19:20:17.329517+0000","last_undegraded":"2023-10-03T19:20:17.329517+0000","last_fullsized":"2023-10-03T19:20:17.329517+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:13:33.426772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:20:15.906015+0000","last_change":"2023-10-03T19:20:15.906015+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:15.906015+0000","last_undegraded":"2023-10-03T19:20:15.906015+0000","last_fullsized":"2023-10-03T19:20:15.906015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.318244+0000","last_change":"2023-10-03T19:20:16.327198+0000","last_active":"2023-10-03T19:20:17.318244+0000","last_peered":"2023-10-03T19:20:17.318244+0000","last_clean":"2023-10-03T19:20:17.318244+0000","last_became_active":"2023-10-03T19:20:16.326730+0000","last_became_peered":"2023-10-03T19:20:16.326730+0000","last_unstale":"2023-10-03T19:20:17.318244+0000","last_undegraded":"2023-10-03T19:20:17.318244+0000","last_fullsized":"2023-10-03T19:20:17.318244+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:40:02.105613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.313651+0000","last_change":"2023-10-03T19:20:16.313651+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.313651+0000","last_undegraded":"2023-10-03T19:20:16.313651+0000","last_fullsized":"2023-10-03T19:20:16.313651+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:29:43.899924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:20:15.906015+0000","last_change":"2023-10-03T19:20:15.906015+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:15.906015+0000","last_undegraded":"2023-10-03T19:20:15.906015+0000","last_fullsized":"2023-10-03T19:20:15.906015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:20:15.906015+0000","last_change":"2023-10-03T19:20:15.906015+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:15.906015+0000","last_undegraded":"2023-10-03T19:20:15.906015+0000","last_fullsized":"2023-10-03T19:20:15.906015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.336171+0000","last_change":"2023-10-03T19:20:16.332773+0000","last_active":"2023-10-03T19:20:16.336171+0000","last_peered":"2023-10-03T19:20:16.336171+0000","last_clean":"2023-10-03T19:20:16.336171+0000","last_became_active":"2023-10-03T19:20:16.332432+0000","last_became_peered":"2023-10-03T19:20:16.332432+0000","last_unstale":"2023-10-03T19:20:16.336171+0000","last_undegraded":"2023-10-03T19:20:16.336171+0000","last_fullsized":"2023-10-03T19:20:16.336171+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:06:21.719875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"108'4","reported_seq":17,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.330032+0000","last_change":"2023-10-03T19:20:15.974915+0000","last_active":"2023-10-03T19:20:17.330032+0000","last_peered":"2023-10-03T19:20:17.330032+0000","last_clean":"2023-10-03T19:20:17.330032+0000","last_became_active":"2023-10-03T19:20:15.974027+0000","last_became_peered":"2023-10-03T19:20:15.974027+0000","last_unstale":"2023-10-03T19:20:17.330032+0000","last_undegraded":"2023-10-03T19:20:17.330032+0000","last_fullsized":"2023-10-03T19:20:17.330032+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:42:02.754043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:20:15.906015+0000","last_change":"2023-10-03T19:20:15.906015+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:15.906015+0000","last_undegraded":"2023-10-03T19:20:15.906015+0000","last_fullsized":"2023-10-03T19:20:15.906015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"108'1","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.332435+0000","last_change":"2023-10-03T19:20:15.948383+0000","last_active":"2023-10-03T19:20:16.332435+0000","last_peered":"2023-10-03T19:20:16.332435+0000","last_clean":"2023-10-03T19:20:16.332435+0000","last_became_active":"2023-10-03T19:20:15.947986+0000","last_became_peered":"2023-10-03T19:20:15.947986+0000","last_unstale":"2023-10-03T19:20:16.332435+0000","last_undegraded":"2023-10-03T19:20:16.332435+0000","last_fullsized":"2023-10-03T19:20:16.332435+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:59:30.670767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:20:15.906015+0000","last_change":"2023-10-03T19:20:15.906015+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:15.906015+0000","last_undegraded":"2023-10-03T19:20:15.906015+0000","last_fullsized":"2023-10-03T19:20:15.906015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"108'2","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.381745+0000","last_change":"2023-10-03T19:20:15.972052+0000","last_active":"2023-10-03T19:20:16.381745+0000","last_peered":"2023-10-03T19:20:16.381745+0000","last_clean":"2023-10-03T19:20:16.381745+0000","last_became_active":"2023-10-03T19:20:15.971172+0000","last_became_peered":"2023-10-03T19:20:15.971172+0000","last_unstale":"2023-10-03T19:20:16.381745+0000","last_undegraded":"2023-10-03T19:20:16.381745+0000","last_fullsized":"2023-10-03T19:20:16.381745+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:28:00.958370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.388611+0000","last_change":"2023-10-03T19:20:16.368357+0000","last_active":"2023-10-03T19:20:16.388611+0000","last_peered":"2023-10-03T19:20:16.388611+0000","last_clean":"2023-10-03T19:20:16.388611+0000","last_became_active":"2023-10-03T19:20:16.367616+0000","last_became_peered":"2023-10-03T19:20:16.367616+0000","last_unstale":"2023-10-03T19:20:16.388611+0000","last_undegraded":"2023-10-03T19:20:16.388611+0000","last_fullsized":"2023-10-03T19:20:16.388611+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:51:54.780344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"108'2","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.340323+0000","last_change":"2023-10-03T19:20:15.964371+0000","last_active":"2023-10-03T19:20:16.340323+0000","last_peered":"2023-10-03T19:20:16.340323+0000","last_clean":"2023-10-03T19:20:16.340323+0000","last_became_active":"2023-10-03T19:20:15.963961+0000","last_became_peered":"2023-10-03T19:20:15.963961+0000","last_unstale":"2023-10-03T19:20:16.340323+0000","last_undegraded":"2023-10-03T19:20:16.340323+0000","last_fullsized":"2023-10-03T19:20:16.340323+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:53:59.202663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.375198+0000","last_change":"2023-10-03T19:20:16.374148+0000","last_active":"2023-10-03T19:20:16.375198+0000","last_peered":"2023-10-03T19:20:16.375198+0000","last_clean":"2023-10-03T19:20:16.375198+0000","last_became_active":"2023-10-03T19:20:16.373840+0000","last_became_peered":"2023-10-03T19:20:16.373840+0000","last_unstale":"2023-10-03T19:20:16.375198+0000","last_undegraded":"2023-10-03T19:20:16.375198+0000","last_fullsized":"2023-10-03T19:20:16.375198+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:19:32.912872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"108'1","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.341648+0000","last_change":"2023-10-03T19:20:15.956585+0000","last_active":"2023-10-03T19:20:16.341648+0000","last_peered":"2023-10-03T19:20:16.341648+0000","last_clean":"2023-10-03T19:20:16.341648+0000","last_became_active":"2023-10-03T19:20:15.955764+0000","last_became_peered":"2023-10-03T19:20:15.955764+0000","last_unstale":"2023-10-03T19:20:16.341648+0000","last_undegraded":"2023-10-03T19:20:16.341648+0000","last_fullsized":"2023-10-03T19:20:16.341648+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:25:54.232755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.382347+0000","last_change":"2023-10-03T19:20:16.380278+0000","last_active":"2023-10-03T19:20:16.382347+0000","last_peered":"2023-10-03T19:20:16.382347+0000","last_clean":"2023-10-03T19:20:16.382347+0000","last_became_active":"2023-10-03T19:20:16.379843+0000","last_became_peered":"2023-10-03T19:20:16.379843+0000","last_unstale":"2023-10-03T19:20:16.382347+0000","last_undegraded":"2023-10-03T19:20:16.382347+0000","last_fullsized":"2023-10-03T19:20:16.382347+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:46:55.330519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:20:14.889785+0000","last_change":"2023-10-03T19:20:14.889785+0000","last_active":"2023-10-03T19:20:14.889785+0000","last_peered":"2023-10-03T19:20:14.889785+0000","last_clean":"2023-10-03T19:20:14.889785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:14.889785+0000","last_undegraded":"2023-10-03T19:20:14.889785+0000","last_fullsized":"2023-10-03T19:20:14.889785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.333211+0000","last_change":"2023-10-03T19:20:16.333211+0000","last_active":"2023-10-03T19:20:16.333211+0000","last_peered":"2023-10-03T19:20:16.333211+0000","last_clean":"2023-10-03T19:20:16.333211+0000","last_became_active":"2023-10-03T19:20:16.332946+0000","last_became_peered":"2023-10-03T19:20:16.332946+0000","last_unstale":"2023-10-03T19:20:16.333211+0000","last_undegraded":"2023-10-03T19:20:16.333211+0000","last_fullsized":"2023-10-03T19:20:16.333211+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:50:10.917756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:20:14.889785+0000","last_change":"2023-10-03T19:20:14.889785+0000","last_active":"2023-10-03T19:20:14.889785+0000","last_peered":"2023-10-03T19:20:14.889785+0000","last_clean":"2023-10-03T19:20:14.889785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:14.889785+0000","last_undegraded":"2023-10-03T19:20:14.889785+0000","last_fullsized":"2023-10-03T19:20:14.889785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.334203+0000","last_change":"2023-10-03T19:20:16.328049+0000","last_active":"2023-10-03T19:20:16.334203+0000","last_peered":"2023-10-03T19:20:16.334203+0000","last_clean":"2023-10-03T19:20:16.334203+0000","last_became_active":"2023-10-03T19:20:16.327707+0000","last_became_peered":"2023-10-03T19:20:16.327707+0000","last_unstale":"2023-10-03T19:20:16.334203+0000","last_undegraded":"2023-10-03T19:20:16.334203+0000","last_fullsized":"2023-10-03T19:20:16.334203+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:25:59.855509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:20:14.889785+0000","last_change":"2023-10-03T19:20:14.889785+0000","last_active":"2023-10-03T19:20:14.889785+0000","last_peered":"2023-10-03T19:20:14.889785+0000","last_clean":"2023-10-03T19:20:14.889785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:14.889785+0000","last_undegraded":"2023-10-03T19:20:14.889785+0000","last_fullsized":"2023-10-03T19:20:14.889785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:20:15.906015+0000","last_change":"2023-10-03T19:20:15.906015+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:15.906015+0000","last_undegraded":"2023-10-03T19:20:15.906015+0000","last_fullsized":"2023-10-03T19:20:15.906015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"108'1","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.334585+0000","last_change":"2023-10-03T19:20:15.956714+0000","last_active":"2023-10-03T19:20:16.334585+0000","last_peered":"2023-10-03T19:20:16.334585+0000","last_clean":"2023-10-03T19:20:16.334585+0000","last_became_active":"2023-10-03T19:20:15.956345+0000","last_became_peered":"2023-10-03T19:20:15.956345+0000","last_unstale":"2023-10-03T19:20:16.334585+0000","last_undegraded":"2023-10-03T19:20:16.334585+0000","last_fullsized":"2023-10-03T19:20:16.334585+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:25:21.009051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.364657+0000","last_change":"2023-10-03T19:20:16.346680+0000","last_active":"2023-10-03T19:20:16.364657+0000","last_peered":"2023-10-03T19:20:16.364657+0000","last_clean":"2023-10-03T19:20:16.364657+0000","last_became_active":"2023-10-03T19:20:16.345966+0000","last_became_peered":"2023-10-03T19:20:16.345966+0000","last_unstale":"2023-10-03T19:20:16.364657+0000","last_undegraded":"2023-10-03T19:20:16.364657+0000","last_fullsized":"2023-10-03T19:20:16.364657+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:29:43.899924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"108'2","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.319319+0000","last_change":"2023-10-03T19:20:15.957563+0000","last_active":"2023-10-03T19:20:17.319319+0000","last_peered":"2023-10-03T19:20:17.319319+0000","last_clean":"2023-10-03T19:20:17.319319+0000","last_became_active":"2023-10-03T19:20:15.957133+0000","last_became_peered":"2023-10-03T19:20:15.957133+0000","last_unstale":"2023-10-03T19:20:17.319319+0000","last_undegraded":"2023-10-03T19:20:17.319319+0000","last_fullsized":"2023-10-03T19:20:17.319319+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:14:44.702562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:20:15.906015+0000","last_change":"2023-10-03T19:20:15.906015+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:15.906015+0000","last_undegraded":"2023-10-03T19:20:15.906015+0000","last_fullsized":"2023-10-03T19:20:15.906015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"108'1","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.373081+0000","last_change":"2023-10-03T19:20:15.974399+0000","last_active":"2023-10-03T19:20:16.373081+0000","last_peered":"2023-10-03T19:20:16.373081+0000","last_clean":"2023-10-03T19:20:16.373081+0000","last_became_active":"2023-10-03T19:20:15.973595+0000","last_became_peered":"2023-10-03T19:20:15.973595+0000","last_unstale":"2023-10-03T19:20:16.373081+0000","last_undegraded":"2023-10-03T19:20:16.373081+0000","last_fullsized":"2023-10-03T19:20:16.373081+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:32:50.979185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:20:15.906015+0000","last_change":"2023-10-03T19:20:15.906015+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:15.906015+0000","last_undegraded":"2023-10-03T19:20:15.906015+0000","last_fullsized":"2023-10-03T19:20:15.906015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.334168+0000","last_change":"2023-10-03T19:20:15.969845+0000","last_active":"2023-10-03T19:20:16.334168+0000","last_peered":"2023-10-03T19:20:16.334168+0000","last_clean":"2023-10-03T19:20:16.334168+0000","last_became_active":"2023-10-03T19:20:15.969245+0000","last_became_peered":"2023-10-03T19:20:15.969245+0000","last_unstale":"2023-10-03T19:20:16.334168+0000","last_undegraded":"2023-10-03T19:20:16.334168+0000","last_fullsized":"2023-10-03T19:20:16.334168+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:02:40.240181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:20:15.906015+0000","last_change":"2023-10-03T19:20:15.906015+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:15.906015+0000","last_undegraded":"2023-10-03T19:20:15.906015+0000","last_fullsized":"2023-10-03T19:20:15.906015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:20:14.889785+0000","last_change":"2023-10-03T19:20:14.889785+0000","last_active":"2023-10-03T19:20:14.889785+0000","last_peered":"2023-10-03T19:20:14.889785+0000","last_clean":"2023-10-03T19:20:14.889785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:14.889785+0000","last_undegraded":"2023-10-03T19:20:14.889785+0000","last_fullsized":"2023-10-03T19:20:14.889785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.312802+0000","last_change":"2023-10-03T19:20:16.312802+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.312802+0000","last_undegraded":"2023-10-03T19:20:16.312802+0000","last_fullsized":"2023-10-03T19:20:16.312802+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:16:52.366869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.332701+0000","last_change":"2023-10-03T19:20:15.965136+0000","last_active":"2023-10-03T19:20:16.332701+0000","last_peered":"2023-10-03T19:20:16.332701+0000","last_clean":"2023-10-03T19:20:16.332701+0000","last_became_active":"2023-10-03T19:20:15.964445+0000","last_became_peered":"2023-10-03T19:20:15.964445+0000","last_unstale":"2023-10-03T19:20:16.332701+0000","last_undegraded":"2023-10-03T19:20:16.332701+0000","last_fullsized":"2023-10-03T19:20:16.332701+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:57:06.605896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.314019+0000","last_change":"2023-10-03T19:20:16.314019+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.314019+0000","last_undegraded":"2023-10-03T19:20:16.314019+0000","last_fullsized":"2023-10-03T19:20:16.314019+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:35:03.160406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.315594+0000","last_change":"2023-10-03T19:20:15.968473+0000","last_active":"2023-10-03T19:20:16.315594+0000","last_peered":"2023-10-03T19:20:16.315594+0000","last_clean":"2023-10-03T19:20:16.315594+0000","last_became_active":"2023-10-03T19:20:15.968149+0000","last_became_peered":"2023-10-03T19:20:15.968149+0000","last_unstale":"2023-10-03T19:20:16.315594+0000","last_undegraded":"2023-10-03T19:20:16.315594+0000","last_fullsized":"2023-10-03T19:20:16.315594+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:48:45.233305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:20:15.906015+0000","last_change":"2023-10-03T19:20:15.906015+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:15.906015+0000","last_undegraded":"2023-10-03T19:20:15.906015+0000","last_fullsized":"2023-10-03T19:20:15.906015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.333760+0000","last_change":"2023-10-03T19:20:15.974966+0000","last_active":"2023-10-03T19:20:16.333760+0000","last_peered":"2023-10-03T19:20:16.333760+0000","last_clean":"2023-10-03T19:20:16.333760+0000","last_became_active":"2023-10-03T19:20:15.974042+0000","last_became_peered":"2023-10-03T19:20:15.974042+0000","last_unstale":"2023-10-03T19:20:16.333760+0000","last_undegraded":"2023-10-03T19:20:16.333760+0000","last_fullsized":"2023-10-03T19:20:16.333760+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:09:35.872471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:20:15.906015+0000","last_change":"2023-10-03T19:20:15.906015+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:15.906015+0000","last_undegraded":"2023-10-03T19:20:15.906015+0000","last_fullsized":"2023-10-03T19:20:15.906015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:20:14.889785+0000","last_change":"2023-10-03T19:20:14.889785+0000","last_active":"2023-10-03T19:20:14.889785+0000","last_peered":"2023-10-03T19:20:14.889785+0000","last_clean":"2023-10-03T19:20:14.889785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:14.889785+0000","last_undegraded":"2023-10-03T19:20:14.889785+0000","last_fullsized":"2023-10-03T19:20:14.889785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.374335+0000","last_change":"2023-10-03T19:20:16.373432+0000","last_active":"2023-10-03T19:20:16.374335+0000","last_peered":"2023-10-03T19:20:16.374335+0000","last_clean":"2023-10-03T19:20:16.374335+0000","last_became_active":"2023-10-03T19:20:16.373117+0000","last_became_peered":"2023-10-03T19:20:16.373117+0000","last_unstale":"2023-10-03T19:20:16.374335+0000","last_undegraded":"2023-10-03T19:20:16.374335+0000","last_fullsized":"2023-10-03T19:20:16.374335+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:04:34.700899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.329921+0000","last_change":"2023-10-03T19:20:15.964945+0000","last_active":"2023-10-03T19:20:17.329921+0000","last_peered":"2023-10-03T19:20:17.329921+0000","last_clean":"2023-10-03T19:20:17.329921+0000","last_became_active":"2023-10-03T19:20:15.963013+0000","last_became_peered":"2023-10-03T19:20:15.963013+0000","last_unstale":"2023-10-03T19:20:17.329921+0000","last_undegraded":"2023-10-03T19:20:17.329921+0000","last_fullsized":"2023-10-03T19:20:17.329921+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:58:07.182707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.388513+0000","last_change":"2023-10-03T19:20:16.366914+0000","last_active":"2023-10-03T19:20:16.388513+0000","last_peered":"2023-10-03T19:20:16.388513+0000","last_clean":"2023-10-03T19:20:16.388513+0000","last_became_active":"2023-10-03T19:20:16.366399+0000","last_became_peered":"2023-10-03T19:20:16.366399+0000","last_unstale":"2023-10-03T19:20:16.388513+0000","last_undegraded":"2023-10-03T19:20:16.388513+0000","last_fullsized":"2023-10-03T19:20:16.388513+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:42:50.977022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.329780+0000","last_change":"2023-10-03T19:20:15.964082+0000","last_active":"2023-10-03T19:20:17.329780+0000","last_peered":"2023-10-03T19:20:17.329780+0000","last_clean":"2023-10-03T19:20:17.329780+0000","last_became_active":"2023-10-03T19:20:15.963061+0000","last_became_peered":"2023-10-03T19:20:15.963061+0000","last_unstale":"2023-10-03T19:20:17.329780+0000","last_undegraded":"2023-10-03T19:20:17.329780+0000","last_fullsized":"2023-10-03T19:20:17.329780+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:48:54.530229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.319098+0000","last_change":"2023-10-03T19:20:16.356943+0000","last_active":"2023-10-03T19:20:17.319098+0000","last_peered":"2023-10-03T19:20:17.319098+0000","last_clean":"2023-10-03T19:20:17.319098+0000","last_became_active":"2023-10-03T19:20:16.356724+0000","last_became_peered":"2023-10-03T19:20:16.356724+0000","last_unstale":"2023-10-03T19:20:17.319098+0000","last_undegraded":"2023-10-03T19:20:17.319098+0000","last_fullsized":"2023-10-03T19:20:17.319098+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:39:11.226990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:20:14.889785+0000","last_change":"2023-10-03T19:20:14.889785+0000","last_active":"2023-10-03T19:20:14.889785+0000","last_peered":"2023-10-03T19:20:14.889785+0000","last_clean":"2023-10-03T19:20:14.889785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:14.889785+0000","last_undegraded":"2023-10-03T19:20:14.889785+0000","last_fullsized":"2023-10-03T19:20:14.889785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:20:15.906015+0000","last_change":"2023-10-03T19:20:15.906015+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:15.906015+0000","last_undegraded":"2023-10-03T19:20:15.906015+0000","last_fullsized":"2023-10-03T19:20:15.906015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.330713+0000","last_change":"2023-10-03T19:20:15.951459+0000","last_active":"2023-10-03T19:20:16.330713+0000","last_peered":"2023-10-03T19:20:16.330713+0000","last_clean":"2023-10-03T19:20:16.330713+0000","last_became_active":"2023-10-03T19:20:15.950750+0000","last_became_peered":"2023-10-03T19:20:15.950750+0000","last_unstale":"2023-10-03T19:20:16.330713+0000","last_undegraded":"2023-10-03T19:20:16.330713+0000","last_fullsized":"2023-10-03T19:20:16.330713+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:32:44.255176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.312349+0000","last_change":"2023-10-03T19:20:16.312349+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.312349+0000","last_undegraded":"2023-10-03T19:20:16.312349+0000","last_fullsized":"2023-10-03T19:20:16.312349+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:27:20.469549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.333339+0000","last_change":"2023-10-03T19:20:15.957097+0000","last_active":"2023-10-03T19:20:16.333339+0000","last_peered":"2023-10-03T19:20:16.333339+0000","last_clean":"2023-10-03T19:20:16.333339+0000","last_became_active":"2023-10-03T19:20:15.956382+0000","last_became_peered":"2023-10-03T19:20:15.956382+0000","last_unstale":"2023-10-03T19:20:16.333339+0000","last_undegraded":"2023-10-03T19:20:16.333339+0000","last_fullsized":"2023-10-03T19:20:16.333339+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:48:45.233305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.388531+0000","last_change":"2023-10-03T19:20:16.366911+0000","last_active":"2023-10-03T19:20:16.388531+0000","last_peered":"2023-10-03T19:20:16.388531+0000","last_clean":"2023-10-03T19:20:16.388531+0000","last_became_active":"2023-10-03T19:20:16.366000+0000","last_became_peered":"2023-10-03T19:20:16.366000+0000","last_unstale":"2023-10-03T19:20:16.388531+0000","last_undegraded":"2023-10-03T19:20:16.388531+0000","last_fullsized":"2023-10-03T19:20:16.388531+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:20:23.512066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:20:14.889785+0000","last_change":"2023-10-03T19:20:14.889785+0000","last_active":"2023-10-03T19:20:14.889785+0000","last_peered":"2023-10-03T19:20:14.889785+0000","last_clean":"2023-10-03T19:20:14.889785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:14.889785+0000","last_undegraded":"2023-10-03T19:20:14.889785+0000","last_fullsized":"2023-10-03T19:20:14.889785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.368478+0000","last_change":"2023-10-03T19:20:16.367493+0000","last_active":"2023-10-03T19:20:16.368478+0000","last_peered":"2023-10-03T19:20:16.368478+0000","last_clean":"2023-10-03T19:20:16.368478+0000","last_became_active":"2023-10-03T19:20:16.367200+0000","last_became_peered":"2023-10-03T19:20:16.367200+0000","last_unstale":"2023-10-03T19:20:16.368478+0000","last_undegraded":"2023-10-03T19:20:16.368478+0000","last_fullsized":"2023-10-03T19:20:16.368478+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:38:21.268252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.334197+0000","last_change":"2023-10-03T19:20:15.976449+0000","last_active":"2023-10-03T19:20:16.334197+0000","last_peered":"2023-10-03T19:20:16.334197+0000","last_clean":"2023-10-03T19:20:16.334197+0000","last_became_active":"2023-10-03T19:20:15.975751+0000","last_became_peered":"2023-10-03T19:20:15.975751+0000","last_unstale":"2023-10-03T19:20:16.334197+0000","last_undegraded":"2023-10-03T19:20:16.334197+0000","last_fullsized":"2023-10-03T19:20:16.334197+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:44:51.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.390675+0000","last_change":"2023-10-03T19:20:16.378686+0000","last_active":"2023-10-03T19:20:16.390675+0000","last_peered":"2023-10-03T19:20:16.390675+0000","last_clean":"2023-10-03T19:20:16.390675+0000","last_became_active":"2023-10-03T19:20:16.377931+0000","last_became_peered":"2023-10-03T19:20:16.377931+0000","last_unstale":"2023-10-03T19:20:16.390675+0000","last_undegraded":"2023-10-03T19:20:16.390675+0000","last_fullsized":"2023-10-03T19:20:16.390675+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:51:26.296530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"108'8","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.314937+0000","last_change":"2023-10-03T19:20:15.968516+0000","last_active":"2023-10-03T19:20:16.314937+0000","last_peered":"2023-10-03T19:20:16.314937+0000","last_clean":"2023-10-03T19:20:16.314937+0000","last_became_active":"2023-10-03T19:20:15.967958+0000","last_became_peered":"2023-10-03T19:20:15.967958+0000","last_unstale":"2023-10-03T19:20:16.314937+0000","last_undegraded":"2023-10-03T19:20:16.314937+0000","last_fullsized":"2023-10-03T19:20:16.314937+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:25:54.232755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":332,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.334710+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:20:16.334710+0000","last_peered":"2023-10-03T19:20:16.334710+0000","last_clean":"2023-10-03T19:20:16.334710+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:20:16.334710+0000","last_undegraded":"2023-10-03T19:20:16.334710+0000","last_fullsized":"2023-10-03T19:20:16.334710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:11:06.488375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":174,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-03T19:20:11.977205+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:20:11.977205+0000","last_peered":"2023-10-03T19:20:11.977205+0000","last_clean":"2023-10-03T19:20:11.977205+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:20:11.977205+0000","last_undegraded":"2023-10-03T19:20:11.977205+0000","last_fullsized":"2023-10-03T19:20:11.977205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:33:33.517763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328782+0000","last_change":"2023-10-03T19:20:16.356061+0000","last_active":"2023-10-03T19:20:17.328782+0000","last_peered":"2023-10-03T19:20:17.328782+0000","last_clean":"2023-10-03T19:20:17.328782+0000","last_became_active":"2023-10-03T19:20:16.355199+0000","last_became_peered":"2023-10-03T19:20:16.355199+0000","last_unstale":"2023-10-03T19:20:17.328782+0000","last_undegraded":"2023-10-03T19:20:17.328782+0000","last_fullsized":"2023-10-03T19:20:17.328782+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:07:54.083803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"108'2","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.319323+0000","last_change":"2023-10-03T19:20:15.969199+0000","last_active":"2023-10-03T19:20:16.319323+0000","last_peered":"2023-10-03T19:20:16.319323+0000","last_clean":"2023-10-03T19:20:16.319323+0000","last_became_active":"2023-10-03T19:20:15.966849+0000","last_became_peered":"2023-10-03T19:20:15.966849+0000","last_unstale":"2023-10-03T19:20:16.319323+0000","last_undegraded":"2023-10-03T19:20:16.319323+0000","last_fullsized":"2023-10-03T19:20:16.319323+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:47:59.812937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":180,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.343563+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:20:16.343563+0000","last_peered":"2023-10-03T19:20:16.343563+0000","last_clean":"2023-10-03T19:20:16.343563+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:20:16.343563+0000","last_undegraded":"2023-10-03T19:20:16.343563+0000","last_fullsized":"2023-10-03T19:20:16.343563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:37:17.443617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.368589+0000","last_change":"2023-10-03T19:20:16.367501+0000","last_active":"2023-10-03T19:20:16.368589+0000","last_peered":"2023-10-03T19:20:16.368589+0000","last_clean":"2023-10-03T19:20:16.368589+0000","last_became_active":"2023-10-03T19:20:16.367248+0000","last_became_peered":"2023-10-03T19:20:16.367248+0000","last_unstale":"2023-10-03T19:20:16.368589+0000","last_undegraded":"2023-10-03T19:20:16.368589+0000","last_fullsized":"2023-10-03T19:20:16.368589+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:10:29.134502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.319316+0000","last_change":"2023-10-03T19:20:15.967698+0000","last_active":"2023-10-03T19:20:16.319316+0000","last_peered":"2023-10-03T19:20:16.319316+0000","last_clean":"2023-10-03T19:20:16.319316+0000","last_became_active":"2023-10-03T19:20:15.967254+0000","last_became_peered":"2023-10-03T19:20:15.967254+0000","last_unstale":"2023-10-03T19:20:16.319316+0000","last_undegraded":"2023-10-03T19:20:16.319316+0000","last_fullsized":"2023-10-03T19:20:16.319316+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:16:20.254315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":178,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.318094+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:20:17.318094+0000","last_peered":"2023-10-03T19:20:17.318094+0000","last_clean":"2023-10-03T19:20:17.318094+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:20:17.318094+0000","last_undegraded":"2023-10-03T19:20:17.318094+0000","last_fullsized":"2023-10-03T19:20:17.318094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:09:08.659807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.318441+0000","last_change":"2023-10-03T19:20:16.331087+0000","last_active":"2023-10-03T19:20:17.318441+0000","last_peered":"2023-10-03T19:20:17.318441+0000","last_clean":"2023-10-03T19:20:17.318441+0000","last_became_active":"2023-10-03T19:20:16.330789+0000","last_became_peered":"2023-10-03T19:20:16.330789+0000","last_unstale":"2023-10-03T19:20:17.318441+0000","last_undegraded":"2023-10-03T19:20:17.318441+0000","last_fullsized":"2023-10-03T19:20:17.318441+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:59:08.307318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.315395+0000","last_change":"2023-10-03T19:20:15.963326+0000","last_active":"2023-10-03T19:20:16.315395+0000","last_peered":"2023-10-03T19:20:16.315395+0000","last_clean":"2023-10-03T19:20:16.315395+0000","last_became_active":"2023-10-03T19:20:15.962683+0000","last_became_peered":"2023-10-03T19:20:15.962683+0000","last_unstale":"2023-10-03T19:20:16.315395+0000","last_undegraded":"2023-10-03T19:20:16.315395+0000","last_fullsized":"2023-10-03T19:20:16.315395+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:32:44.255176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":174,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-03T19:20:11.977200+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:20:11.977200+0000","last_peered":"2023-10-03T19:20:11.977200+0000","last_clean":"2023-10-03T19:20:11.977200+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:20:11.977200+0000","last_undegraded":"2023-10-03T19:20:11.977200+0000","last_fullsized":"2023-10-03T19:20:11.977200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:44:41.761341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.329037+0000","last_change":"2023-10-03T19:20:16.379445+0000","last_active":"2023-10-03T19:20:17.329037+0000","last_peered":"2023-10-03T19:20:17.329037+0000","last_clean":"2023-10-03T19:20:17.329037+0000","last_became_active":"2023-10-03T19:20:16.378708+0000","last_became_peered":"2023-10-03T19:20:16.378708+0000","last_unstale":"2023-10-03T19:20:17.329037+0000","last_undegraded":"2023-10-03T19:20:17.329037+0000","last_fullsized":"2023-10-03T19:20:17.329037+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:36:26.181089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.330048+0000","last_change":"2023-10-03T19:20:15.964353+0000","last_active":"2023-10-03T19:20:17.330048+0000","last_peered":"2023-10-03T19:20:17.330048+0000","last_clean":"2023-10-03T19:20:17.330048+0000","last_became_active":"2023-10-03T19:20:15.963577+0000","last_became_peered":"2023-10-03T19:20:15.963577+0000","last_unstale":"2023-10-03T19:20:17.330048+0000","last_undegraded":"2023-10-03T19:20:17.330048+0000","last_fullsized":"2023-10-03T19:20:17.330048+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:44:59.894758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":172,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.331800+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:20:16.331800+0000","last_peered":"2023-10-03T19:20:16.331800+0000","last_clean":"2023-10-03T19:20:16.331800+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:20:16.331800+0000","last_undegraded":"2023-10-03T19:20:16.331800+0000","last_fullsized":"2023-10-03T19:20:16.331800+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:45:55.749619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:20:15.906015+0000","last_change":"2023-10-03T19:20:15.906015+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:15.906015+0000","last_undegraded":"2023-10-03T19:20:15.906015+0000","last_fullsized":"2023-10-03T19:20:15.906015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:20:14.889785+0000","last_change":"2023-10-03T19:20:14.889785+0000","last_active":"2023-10-03T19:20:14.889785+0000","last_peered":"2023-10-03T19:20:14.889785+0000","last_clean":"2023-10-03T19:20:14.889785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:14.889785+0000","last_undegraded":"2023-10-03T19:20:14.889785+0000","last_fullsized":"2023-10-03T19:20:14.889785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":180,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.333768+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:20:16.333768+0000","last_peered":"2023-10-03T19:20:16.333768+0000","last_clean":"2023-10-03T19:20:16.333768+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:20:16.333768+0000","last_undegraded":"2023-10-03T19:20:16.333768+0000","last_fullsized":"2023-10-03T19:20:16.333768+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:51:39.452487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.312904+0000","last_change":"2023-10-03T19:20:16.312904+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.312904+0000","last_undegraded":"2023-10-03T19:20:16.312904+0000","last_fullsized":"2023-10-03T19:20:16.312904+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:41:46.307896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:20:14.889785+0000","last_change":"2023-10-03T19:20:14.889785+0000","last_active":"2023-10-03T19:20:14.889785+0000","last_peered":"2023-10-03T19:20:14.889785+0000","last_clean":"2023-10-03T19:20:14.889785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:14.889785+0000","last_undegraded":"2023-10-03T19:20:14.889785+0000","last_fullsized":"2023-10-03T19:20:14.889785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":172,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.327393+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:20:16.327393+0000","last_peered":"2023-10-03T19:20:16.327393+0000","last_clean":"2023-10-03T19:20:16.327393+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:20:16.327393+0000","last_undegraded":"2023-10-03T19:20:16.327393+0000","last_fullsized":"2023-10-03T19:20:16.327393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:38:41.426039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T19:20:15.906015+0000","last_change":"2023-10-03T19:20:15.906015+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:15.906015+0000","last_undegraded":"2023-10-03T19:20:15.906015+0000","last_fullsized":"2023-10-03T19:20:15.906015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"108'5","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.315568+0000","last_change":"2023-10-03T19:20:15.962877+0000","last_active":"2023-10-03T19:20:16.315568+0000","last_peered":"2023-10-03T19:20:16.315568+0000","last_clean":"2023-10-03T19:20:16.315568+0000","last_became_active":"2023-10-03T19:20:15.962063+0000","last_became_peered":"2023-10-03T19:20:15.962063+0000","last_unstale":"2023-10-03T19:20:16.315568+0000","last_undegraded":"2023-10-03T19:20:16.315568+0000","last_fullsized":"2023-10-03T19:20:16.315568+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:44:05.865560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.330163+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:20:17.330163+0000","last_peered":"2023-10-03T19:20:17.330163+0000","last_clean":"2023-10-03T19:20:17.330163+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:20:17.330163+0000","last_undegraded":"2023-10-03T19:20:17.330163+0000","last_fullsized":"2023-10-03T19:20:17.330163+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:17:59.521194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":88,"acting":88,"num_store_stats":6},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":1380,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":46,"acting":46,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509538,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34160,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":32768,"kb_avail":94337680,"statfs":{"total":96636764160,"available":96601784320,"internally_reserved":0,"allocated":1417216,"data_stored":1203428,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":33554432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.85899999999999999,"15min":0.92700000000000005},"min":{"1min":0.66300000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1950000000000001,"5min":1.206,"15min":4.0469999999999997},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.85299999999999998,"15min":0.82099999999999995},"min":{"1min":0.55200000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.177,"5min":1.2310000000000001,"15min":1.3420000000000001},"last":1.2230000000000001}]},{"osd":1,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.86299999999999999,"15min":0.98599999999999999},"min":{"1min":0.61899999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1359999999999999,"5min":1.3200000000000001,"15min":3.8239999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.89800000000000002,"15min":0.87},"min":{"1min":0.64500000000000002,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.91100000000000003}]},{"osd":2,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.95899999999999996,"15min":0.88400000000000001},"min":{"1min":0.55300000000000005,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1719999999999999,"5min":6.0449999999999999,"15min":6.0449999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.94199999999999995,"15min":1.0109999999999999},"min":{"1min":0.69999999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.296,"5min":1.5800000000000001,"15min":3.98},"last":1.161}]},{"osd":3,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.034,"15min":0.95799999999999996},"min":{"1min":0.68500000000000005,"5min":0.63800000000000001,"15min":0.51100000000000001},"max":{"1min":1.232,"5min":6.125,"15min":6.125},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.97599999999999998,"15min":1.0840000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.175,"5min":1.444,"15min":3.9140000000000001},"last":1.2509999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.89800000000000002,"15min":1.0920000000000001},"min":{"1min":0.61599999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":5.1130000000000004},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.016,"15min":1.018},"min":{"1min":0.70699999999999996,"5min":0.629,"15min":0.629},"max":{"1min":1.214,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":1.107}]},{"osd":5,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.006,"15min":1.2010000000000001},"min":{"1min":0.63700000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2470000000000001,"5min":1.349,"15min":5.1859999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.0209999999999999,"15min":1.115},"min":{"1min":0.69299999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.29,"5min":1.2949999999999999,"15min":2.0609999999999999},"last":1.133}]},{"osd":6,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0740000000000001,"15min":1.093},"min":{"1min":0.80000000000000004,"5min":0.75700000000000001,"15min":0.69399999999999995},"max":{"1min":1.3839999999999999,"5min":1.4890000000000001,"15min":1.5449999999999999},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.1459999999999999,"15min":1.167},"min":{"1min":0.77800000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.232,"5min":6.1580000000000004,"15min":6.1580000000000004},"last":1.2}]}]},{"osd":6,"up_from":15,"seq":64424509538,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":30144,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":1335296,"data_stored":611702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30867456},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.84599999999999997,"15min":0.82699999999999996},"min":{"1min":0.54100000000000004,"5min":0.45400000000000001,"15min":0.44600000000000001},"max":{"1min":1.234,"5min":1.3340000000000001,"15min":1.504},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.91100000000000003,"15min":0.88900000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.44600000000000001},"max":{"1min":1.1080000000000001,"5min":1.423,"15min":1.839},"last":0.91200000000000003}]},{"osd":1,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.86699999999999999,"15min":0.84699999999999998},"min":{"1min":0.56000000000000005,"5min":0.52100000000000002,"15min":0.504},"max":{"1min":1.1859999999999999,"5min":1.27,"15min":2.0150000000000001},"last":0.751},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.88900000000000001,"15min":0.88200000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.161,"5min":1.448,"15min":1.448},"last":0.70399999999999996}]},{"osd":2,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.93799999999999994,"15min":0.88900000000000001},"min":{"1min":0.66400000000000003,"5min":0.59199999999999997,"15min":0.51900000000000002},"max":{"1min":1.4430000000000001,"5min":1.528,"15min":1.528},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.92700000000000005,"15min":0.92500000000000004},"min":{"1min":0.60899999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1519999999999999,"5min":1.369,"15min":1.546},"last":0.81299999999999994}]},{"osd":3,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.96299999999999997,"15min":0.97899999999999998},"min":{"1min":0.68899999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.298,"5min":1.377,"15min":1.6990000000000001},"last":1.1299999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90700000000000003,"15min":0.90800000000000003},"min":{"1min":0.70199999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.143,"5min":1.206,"15min":2.121},"last":0.86899999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.91600000000000004,"15min":0.998},"min":{"1min":0.67400000000000004,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.335,"5min":1.339,"15min":1.95},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.995,"15min":1.0680000000000001},"min":{"1min":0.64400000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4490000000000001,"5min":1.504,"15min":1.7709999999999999},"last":1.0069999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.90700000000000003,"15min":0.99199999999999999},"min":{"1min":0.624,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.226,"5min":1.3200000000000001,"15min":2.2570000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.048,"15min":1.103},"min":{"1min":0.71799999999999997,"5min":0.68300000000000005,"15min":0.68100000000000005},"max":{"1min":1.5009999999999999,"5min":1.524,"15min":2.0619999999999998},"last":1.1579999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.071,"15min":1.109},"min":{"1min":0.748,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.639,"5min":1.639,"15min":2.0049999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.032,"5min":1.044,"15min":1.0820000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.61899999999999999},"max":{"1min":1.3879999999999999,"5min":1.4350000000000001,"15min":2.4249999999999998},"last":1.2}]}]},{"osd":4,"up_from":15,"seq":64424509539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42540,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":41216,"kb_avail":94329300,"statfs":{"total":96636764160,"available":96593203200,"internally_reserved":0,"allocated":1347584,"data_stored":613848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":42205184},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":1.0600000000000001,"15min":0.875},"min":{"1min":0.64200000000000002,"5min":0.54700000000000004,"15min":0.50600000000000001},"max":{"1min":1.0600000000000001,"5min":17.686,"15min":17.686},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.90100000000000002,"5min":1.02,"15min":0.89000000000000001},"min":{"1min":0.64000000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.28,"5min":16.925999999999998,"15min":16.925999999999998},"last":0.86699999999999999}]},{"osd":1,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.085,"15min":0.98499999999999999},"min":{"1min":0.67700000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1759999999999999,"5min":16.640999999999998,"15min":16.640999999999998},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.91300000000000003,"5min":1.089,"15min":0.93400000000000005},"min":{"1min":0.67300000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.151,"5min":17.59,"15min":17.59},"last":1.0269999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.997,"15min":0.94299999999999995},"min":{"1min":0.70699999999999996,"5min":0.56200000000000006,"15min":0.53200000000000003},"max":{"1min":1.1180000000000001,"5min":8.5630000000000006,"15min":8.5630000000000006},"last":1.286},{"interface":"front","average":{"1min":0.93999999999999995,"5min":1.143,"15min":1.01},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.175,"5min":17.734000000000002,"15min":17.734000000000002},"last":1.1970000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.0880000000000001,"15min":0.94299999999999995},"min":{"1min":0.72499999999999998,"5min":0.61499999999999999,"15min":0.53900000000000003},"max":{"1min":1.242,"5min":16.98,"15min":16.98},"last":1.3740000000000001},{"interface":"front","average":{"1min":0.997,"5min":1.161,"15min":1.105},"min":{"1min":0.66900000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2789999999999999,"5min":16.434000000000001,"15min":16.434000000000001},"last":1.4099999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":1.1020000000000001,"15min":1.0820000000000001},"min":{"1min":0.624,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.143,"5min":17.782,"15min":17.782},"last":1.3360000000000001},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.96599999999999997,"15min":1.002},"min":{"1min":0.65700000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.264,"5min":1.708,"15min":1.708},"last":1.48}]},{"osd":6,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.3859999999999999,"15min":1.27},"min":{"1min":0.66000000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.2250000000000001,"5min":36.106000000000002,"15min":36.106000000000002},"last":1.6910000000000001},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.2450000000000001,"15min":1.216},"min":{"1min":0.86099999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.2410000000000001,"5min":17.646999999999998,"15min":17.646999999999998},"last":1.4530000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.226,"15min":1.1359999999999999},"min":{"1min":0.81200000000000006,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.421,"5min":17.042000000000002,"15min":17.042000000000002},"last":1.6519999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.3,"15min":1.262},"min":{"1min":0.83199999999999996,"5min":0.66400000000000003,"15min":0.63300000000000001},"max":{"1min":1.4670000000000001,"5min":16.32,"15min":16.32},"last":1.5429999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509539,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":31616,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1331200,"data_stored":611120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":32374784},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.79100000000000004,"15min":0.61299999999999999},"min":{"1min":0.47799999999999998,"5min":0.32200000000000001,"15min":0.247},"max":{"1min":0.98199999999999998,"5min":13.629,"15min":13.629},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":1.206,"15min":0.80900000000000005},"min":{"1min":0.34000000000000002,"5min":0.30299999999999999,"15min":0.28999999999999998},"max":{"1min":0.97199999999999998,"5min":40.439,"15min":40.439},"last":0.91400000000000003}]},{"osd":1,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.90200000000000002,"15min":0.71099999999999997},"min":{"1min":0.47899999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1,"5min":14.074,"15min":14.074},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.78500000000000003,"15min":0.64900000000000002},"min":{"1min":0.38800000000000001,"5min":0.34799999999999998,"15min":0.26400000000000001},"max":{"1min":1.1080000000000001,"5min":7.0060000000000002,"15min":7.0060000000000002},"last":0.57899999999999996}]},{"osd":3,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.90000000000000002,"15min":0.71299999999999997},"min":{"1min":0.36699999999999999,"5min":0.28899999999999998,"15min":0.224},"max":{"1min":1.05,"5min":13.423999999999999,"15min":13.423999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.0649999999999999,"15min":0.82899999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.36399999999999999},"max":{"1min":1.1220000000000001,"5min":18.568999999999999,"15min":18.568999999999999},"last":0.65100000000000002}]},{"osd":4,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.94999999999999996,"15min":0.878},"min":{"1min":0.64200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.105,"5min":1.718,"15min":1.718},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.3380000000000001,"15min":1.05},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.22,"5min":28.667999999999999,"15min":28.667999999999999},"last":0.98599999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.0529999999999999,"15min":0.92100000000000004},"min":{"1min":0.67600000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.399,"5min":5.4459999999999997,"15min":5.4459999999999997},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.2230000000000001,"15min":1.0309999999999999},"min":{"1min":0.63300000000000001,"5min":0.57599999999999996,"15min":0.52700000000000002},"max":{"1min":1.4970000000000001,"5min":14.007,"15min":14.007},"last":0.84099999999999997}]},{"osd":6,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":1.1040000000000001,"15min":0.97099999999999997},"min":{"1min":0.65900000000000003,"5min":0.60099999999999998,"15min":0.49099999999999999},"max":{"1min":1.212,"5min":10.679,"15min":10.679},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.087,"15min":1.004},"min":{"1min":0.75600000000000001,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.325,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.1439999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.3240000000000001,"15min":1.1080000000000001},"min":{"1min":0.70299999999999996,"5min":0.63100000000000001,"15min":0.56100000000000005},"max":{"1min":1.415,"5min":18.623000000000001,"15min":18.623000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.0920000000000001,"15min":0.996},"min":{"1min":0.61699999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1850000000000001,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":1.016}]}]},{"osd":1,"up_from":15,"seq":64424509538,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31012,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":29696,"kb_avail":94340828,"statfs":{"total":96636764160,"available":96605007872,"internally_reserved":0,"allocated":1339392,"data_stored":612306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30408704},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59199999999999997,"15min":0.55600000000000005},"min":{"1min":0.27900000000000003,"5min":0.27200000000000002,"15min":0.26900000000000002},"max":{"1min":0.92100000000000004,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70399999999999996,"15min":0.56799999999999995},"min":{"1min":0.41799999999999998,"5min":0.27200000000000002,"15min":0.22900000000000001},"max":{"1min":1.1899999999999999,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.01}]},{"osd":2,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68300000000000005,"15min":0.58899999999999997},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.26200000000000001},"max":{"1min":0.879,"5min":1.506,"15min":1.506},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.82099999999999995,"15min":0.70599999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.312},"max":{"1min":1.1919999999999999,"5min":1.365,"15min":1.365},"last":0.89500000000000002}]},{"osd":3,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.76400000000000001,"15min":0.67300000000000004},"min":{"1min":0.36099999999999999,"5min":0.31,"15min":0.31},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.75700000000000001,"15min":0.63400000000000001},"min":{"1min":0.39100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.90700000000000003,"5min":1.232,"15min":1.27},"last":0.95299999999999996}]},{"osd":4,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.89000000000000001,"15min":0.82799999999999996},"min":{"1min":0.61199999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0860000000000001,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.98499999999999999,"15min":0.91400000000000003},"min":{"1min":0.69899999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3260000000000001,"5min":1.728,"15min":1.728},"last":0.77500000000000002}]},{"osd":5,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.98999999999999999,"15min":0.89500000000000002},"min":{"1min":0.60299999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.28,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.96299999999999997,"15min":0.88500000000000001},"min":{"1min":0.77300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.198,"5min":1.3959999999999999,"15min":1.6080000000000001},"last":0.74399999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0349999999999999,"15min":0.95399999999999996},"min":{"1min":0.59499999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2689999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.204},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0289999999999999,"15min":0.93400000000000005},"min":{"1min":0.66700000000000004,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3600000000000001,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.2470000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0669999999999999,"15min":0.97599999999999998},"min":{"1min":0.55100000000000005,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.292,"5min":1.673,"15min":1.673},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0289999999999999,"15min":0.93999999999999995},"min":{"1min":0.67500000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4379999999999999,"5min":1.5880000000000001,"15min":1.649},"last":1.1339999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542242,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25504,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":24192,"kb_avail":94346336,"statfs":{"total":96636764160,"available":96610648064,"internally_reserved":0,"allocated":1335296,"data_stored":612284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24772608},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.63200000000000001,"15min":0.58799999999999997},"min":{"1min":0.36399999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.96199999999999997,"5min":1.212,"15min":1.212},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.69999999999999996,"15min":0.66000000000000003},"min":{"1min":0.38900000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.5,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.82799999999999996}]},{"osd":1,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.70399999999999996,"15min":0.64800000000000002},"min":{"1min":0.42299999999999999,"5min":0.28599999999999998,"15min":0.27000000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76000000000000001,"15min":0.69099999999999995},"min":{"1min":0.34300000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.169,"5min":1.2210000000000001,"15min":1.222},"last":0.95899999999999996}]},{"osd":2,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.79400000000000004,"15min":0.73299999999999998},"min":{"1min":0.35999999999999999,"5min":0.317,"15min":0.317},"max":{"1min":1.1539999999999999,"5min":1.23,"15min":1.23},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73199999999999998,"15min":0.66000000000000003},"min":{"1min":0.371,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.05,"5min":1.671,"15min":1.671},"last":0.71599999999999997}]},{"osd":4,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.92000000000000004,"15min":0.91200000000000003},"min":{"1min":0.63900000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2949999999999999,"5min":1.411,"15min":1.496},"last":1.052},{"interface":"front","average":{"1min":1.006,"5min":1.018,"15min":0.95599999999999996},"min":{"1min":0.76400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3280000000000001,"5min":1.546,"15min":1.546},"last":1.085}]},{"osd":5,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.91200000000000003,"15min":0.88700000000000001},"min":{"1min":0.63300000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.095,"5min":1.581,"15min":1.581},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.022,"15min":1.004},"min":{"1min":0.68100000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4179999999999999,"5min":1.498,"15min":1.498},"last":1.173}]},{"osd":6,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.94599999999999995,"15min":0.92800000000000005},"min":{"1min":0.68799999999999994,"5min":0.56999999999999995,"15min":0.56699999999999995},"max":{"1min":1.212,"5min":1.347,"15min":1.347},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.05,"15min":1.006},"min":{"1min":0.80000000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.373,"5min":1.4970000000000001,"15min":1.5629999999999999},"last":1.1339999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.083,"15min":1.0289999999999999},"min":{"1min":0.70599999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.151},{"interface":"front","average":{"1min":1.109,"5min":1.0609999999999999,"15min":1.03},"min":{"1min":0.65300000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.659,"5min":1.659,"15min":1.708},"last":1.294}]}]},{"osd":5,"up_from":13,"seq":55834574945,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23100,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":21824,"kb_avail":94348740,"statfs":{"total":96636764160,"available":96613109760,"internally_reserved":0,"allocated":1298432,"data_stored":592358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22347776},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.85799999999999998,"15min":0.83399999999999996},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.181,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.89400000000000002,"15min":0.86599999999999999},"min":{"1min":0.78200000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.26,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.70599999999999996}]},{"osd":1,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.872,"15min":0.84499999999999997},"min":{"1min":0.505,"5min":0.501,"15min":0.501},"max":{"1min":1.044,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.052},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.91000000000000003,"15min":0.92300000000000004},"min":{"1min":0.63100000000000001,"5min":0.58699999999999997,"15min":0.57099999999999995},"max":{"1min":1.23,"5min":1.23,"15min":1.514},"last":0.86099999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.91000000000000003,"15min":0.90300000000000002},"min":{"1min":0.625,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2010000000000001,"5min":1.351,"15min":1.3700000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.999,"5min":0.93000000000000005,"15min":0.90600000000000003},"min":{"1min":0.82499999999999996,"5min":0.57099999999999995,"15min":0.53300000000000003},"max":{"1min":1.1819999999999999,"5min":1.1930000000000001,"15min":1.3320000000000001},"last":0.76300000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.93600000000000005,"15min":0.93100000000000005},"min":{"1min":0.67700000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2210000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.046,"5min":1.03,"15min":1.028},"min":{"1min":0.78700000000000003,"5min":0.65900000000000003,"15min":0.61199999999999999},"max":{"1min":1.3129999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.99099999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.97499999999999998,"15min":0.97299999999999998},"min":{"1min":0.70699999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.2450000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.167},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96399999999999997,"15min":1.0129999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2749999999999999,"5min":1.335,"15min":1.7709999999999999},"last":1.2130000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.995,"15min":1.024},"min":{"1min":0.67000000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.204,"5min":1.546,"15min":1.546},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0880000000000001,"15min":1.1240000000000001},"min":{"1min":0.82499999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.3759999999999999,"5min":1.823,"15min":1.823},"last":1.2470000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0569999999999999,"15min":1.071},"min":{"1min":0.68700000000000006,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.5680000000000001},"last":1.302},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.119,"15min":1.143},"min":{"1min":0.86499999999999999,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.325,"5min":1.4179999999999999,"15min":1.9099999999999999},"last":1.1020000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574946,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30520,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":29184,"kb_avail":94341320,"statfs":{"total":96636764160,"available":96605511680,"internally_reserved":0,"allocated":1359872,"data_stored":1181562,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":29884416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.69699999999999995,"15min":0.61399999999999999},"min":{"1min":0.502,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.92000000000000004,"5min":5.7480000000000002,"15min":5.7480000000000002},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.80900000000000005,"15min":0.746},"min":{"1min":0.54700000000000004,"5min":0.37,"15min":0.33000000000000002},"max":{"1min":1.0760000000000001,"5min":6.274,"15min":6.274},"last":1.248}]},{"osd":2,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.81999999999999995,"15min":0.746},"min":{"1min":0.46700000000000003,"5min":0.36499999999999999,"15min":0.35399999999999998},"max":{"1min":0.97599999999999998,"5min":6.1609999999999996,"15min":6.1609999999999996},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71499999999999997,"15min":0.69899999999999995},"min":{"1min":0.44500000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.997,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.56100000000000005}]},{"osd":3,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.90800000000000003,"15min":0.78000000000000003},"min":{"1min":0.57499999999999996,"5min":0.41799999999999998,"15min":0.36799999999999999},"max":{"1min":1.1739999999999999,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":1.101},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82199999999999995,"15min":0.73199999999999998},"min":{"1min":0.53300000000000003,"5min":0.376,"15min":0.30299999999999999},"max":{"1min":1.0780000000000001,"5min":1.375,"15min":1.375},"last":0.745}]},{"osd":4,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":1.0029999999999999,"15min":0.93600000000000005},"min":{"1min":0.71299999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.254,"5min":8.1159999999999997,"15min":8.1159999999999997},"last":0.874},{"interface":"front","average":{"1min":1.056,"5min":1.0860000000000001,"15min":1.0429999999999999},"min":{"1min":0.71199999999999997,"5min":0.57299999999999995,"15min":0.504},"max":{"1min":1.3440000000000001,"5min":6.2320000000000002,"15min":6.2320000000000002},"last":0.96199999999999997}]},{"osd":5,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.2549999999999999,"15min":1.1140000000000001},"min":{"1min":0.69199999999999995,"5min":0.59399999999999997,"15min":0.46899999999999997},"max":{"1min":1.4259999999999999,"5min":17.420000000000002,"15min":17.420000000000002},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.222,"15min":1.052},"min":{"1min":0.74299999999999999,"5min":0.59499999999999997,"15min":0.54300000000000004},"max":{"1min":1.371,"5min":17.643000000000001,"15min":17.643000000000001},"last":1.0429999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0880000000000001,"15min":1.038},"min":{"1min":0.77500000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3520000000000001,"5min":5.7220000000000004,"15min":5.7220000000000004},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0669999999999999,"15min":1.0129999999999999},"min":{"1min":0.877,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.417,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.01}]},{"osd":7,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.159,"15min":1.0740000000000001},"min":{"1min":0.81299999999999994,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3939999999999999,"5min":5.7800000000000002,"15min":5.7800000000000002},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.0920000000000001,"15min":1.0669999999999999},"min":{"1min":0.85699999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.343,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.0700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:20:20.359 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:20:20.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.516+0000 7fade056f640 1 Processor -- start 2023-10-03T19:20:20.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.516+0000 7fade056f640 1 -- start start 2023-10-03T19:20:20.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.516+0000 7fade056f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fadd814f240 0x7fadd81528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:20.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.516+0000 7fade056f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fadd80bb1d0 0x7fadd80c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:20.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.516+0000 7fade056f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd806b2d0 con 0x7fadd80c2790 2023-10-03T19:20:20.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.516+0000 7fade056f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd806b640 con 0x7fadd80bb1d0 2023-10-03T19:20:20.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.516+0000 7fade056f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd80a3c60 con 0x7fadd814f240 2023-10-03T19:20:20.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.516+0000 7fadde30b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fadd814f240 0x7fadd81528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:20.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.516+0000 7faddeb0c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fadd80bb1d0 0x7fadd80c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:20.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.516+0000 7fadde30b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fadd814f240 0x7fadd81528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:50414/0 (socket says 172.21.15.45:50414) 2023-10-03T19:20:20.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.516+0000 7fadde30b640 1 -- 172.21.15.45:0/2863792726 learned_addr learned my addr 172.21.15.45:0/2863792726 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:20.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.516+0000 7fadde30b640 1 -- 172.21.15.45:0/2863792726 >> v2:172.21.15.79:3300/0 conn(0x7fadd80bb1d0 msgr2=0x7fadd80c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:20.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.516+0000 7fadde30b640 1 --2- 172.21.15.45:0/2863792726 >> v2:172.21.15.79:3300/0 conn(0x7fadd80bb1d0 0x7fadd80c12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.516+0000 7fadde30b640 1 -- 172.21.15.45:0/2863792726 >> v1:172.21.15.79:6789/0 conn(0x7fadd80c2790 legacy=0x7fadd80c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:20.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.516+0000 7fadde30b640 1 -- 172.21.15.45:0/2863792726 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd814e740 con 0x7fadd814f240 2023-10-03T19:20:20.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.520+0000 7fadde30b640 1 --2- 172.21.15.45:0/2863792726 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fadd814f240 0x7fadd81528d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fadd4009ea0 tx=0x7fadd401f240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a65e18b6bddb4018 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:20.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.520+0000 7faddd309640 1 -- 172.21.15.45:0/2863792726 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd40af400 con 0x7fadd814f240 2023-10-03T19:20:20.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.520+0000 7faddd309640 1 -- 172.21.15.45:0/2863792726 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd40ab050 con 0x7fadd814f240 2023-10-03T19:20:20.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.520+0000 7faddd309640 1 -- 172.21.15.45:0/2863792726 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd40af780 con 0x7fadd814f240 2023-10-03T19:20:20.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.520+0000 7fade056f640 1 -- 172.21.15.45:0/2863792726 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fadd814f240 msgr2=0x7fadd81528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:20.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.520+0000 7fade056f640 1 --2- 172.21.15.45:0/2863792726 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fadd814f240 0x7fadd81528d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fadd4009ea0 tx=0x7fadd401f240 comp rx=0 tx=0).stop 2023-10-03T19:20:20.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.520+0000 7fade056f640 1 -- 172.21.15.45:0/2863792726 shutdown_connections 2023-10-03T19:20:20.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.520+0000 7fade056f640 1 --2- 172.21.15.45:0/2863792726 >> v2:172.21.15.79:3300/0 conn(0x7fadd80bb1d0 0x7fadd80c12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.520+0000 7fade056f640 1 --2- 172.21.15.45:0/2863792726 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fadd814f240 0x7fadd81528d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.520+0000 7fade056f640 1 -- 172.21.15.45:0/2863792726 >> 172.21.15.45:0/2863792726 conn(0x7fadd80a64a0 msgr2=0x7fadd80a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:20.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.520+0000 7fade056f640 1 -- 172.21.15.45:0/2863792726 shutdown_connections 2023-10-03T19:20:20.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.520+0000 7fade056f640 1 -- 172.21.15.45:0/2863792726 wait complete. 2023-10-03T19:20:20.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.520+0000 7fade056f640 1 Processor -- start 2023-10-03T19:20:20.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.520+0000 7fade056f640 1 -- start start 2023-10-03T19:20:20.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.520+0000 7fade056f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadd80bb1d0 0x7fadd8151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:20.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.520+0000 7fade056f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadd80c2790 0x7fadd8150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:20.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.520+0000 7fade056f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fadd814f240 0x7fadd81e7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:20.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.520+0000 7fade056f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd814bfd0 con 0x7fadd80c2790 2023-10-03T19:20:20.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.520+0000 7fade056f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd80a8de0 con 0x7fadd80bb1d0 2023-10-03T19:20:20.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.520+0000 7fade056f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd80a8ad0 con 0x7fadd814f240 2023-10-03T19:20:20.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.520+0000 7fadddb0a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadd80c2790 0x7fadd8150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:20.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.520+0000 7fadddb0a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadd80c2790 0x7fadd8150a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42928/0 (socket says 172.21.15.45:42928) 2023-10-03T19:20:20.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.520+0000 7fadddb0a640 1 -- 172.21.15.45:0/2447670205 learned_addr learned my addr 172.21.15.45:0/2447670205 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:20.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.520+0000 7faddeb0c640 1 --2- 172.21.15.45:0/2447670205 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fadd814f240 0x7fadd81e7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:20.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.520+0000 7fadde30b640 1 --2- 172.21.15.45:0/2447670205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadd80bb1d0 0x7fadd8151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:20.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.524+0000 7fadddb0a640 1 -- 172.21.15.45:0/2447670205 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fadd814f240 msgr2=0x7fadd81e7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:20.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.524+0000 7fadddb0a640 1 --2- 172.21.15.45:0/2447670205 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fadd814f240 0x7fadd81e7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.524+0000 7fadddb0a640 1 -- 172.21.15.45:0/2447670205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadd80bb1d0 msgr2=0x7fadd8151530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:20.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.524+0000 7fadddb0a640 1 --2- 172.21.15.45:0/2447670205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadd80bb1d0 0x7fadd8151530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.524+0000 7fadddb0a640 1 -- 172.21.15.45:0/2447670205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd4009b30 con 0x7fadd80c2790 2023-10-03T19:20:20.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.524+0000 7faddeb0c640 1 --2- 172.21.15.45:0/2447670205 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fadd814f240 0x7fadd81e7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:20:20.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.524+0000 7fadddb0a640 1 --2- 172.21.15.45:0/2447670205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadd80c2790 0x7fadd8150a00 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fadc800c430 tx=0x7fadc800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:20.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.524+0000 7fadceffd640 1 -- 172.21.15.45:0/2447670205 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc80052d0 con 0x7fadd80c2790 2023-10-03T19:20:20.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.524+0000 7fadceffd640 1 -- 172.21.15.45:0/2447670205 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc8005470 con 0x7fadd80c2790 2023-10-03T19:20:20.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.524+0000 7fadceffd640 1 -- 172.21.15.45:0/2447670205 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc8006a70 con 0x7fadd80c2790 2023-10-03T19:20:20.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.524+0000 7fade056f640 1 -- 172.21.15.45:0/2447670205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd814f610 con 0x7fadd80c2790 2023-10-03T19:20:20.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.524+0000 7fade056f640 1 -- 172.21.15.45:0/2447670205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd80a3f40 con 0x7fadd80c2790 2023-10-03T19:20:20.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.524+0000 7fade056f640 1 -- 172.21.15.45:0/2447670205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd80bf360 con 0x7fadd80c2790 2023-10-03T19:20:20.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.524+0000 7fadceffd640 1 -- 172.21.15.45:0/2447670205 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fadc8006bd0 con 0x7fadd80c2790 2023-10-03T19:20:20.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.524+0000 7fadceffd640 1 --2- 172.21.15.45:0/2447670205 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fadbc0662b0 0x7fadbc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:20.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.524+0000 7fadceffd640 1 -- 172.21.15.45:0/2447670205 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fadc8083170 con 0x7fadd80c2790 2023-10-03T19:20:20.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.524+0000 7fadde30b640 1 --2- 172.21.15.45:0/2447670205 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fadbc0662b0 0x7fadbc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:20.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.528+0000 7fadde30b640 1 --2- 172.21.15.45:0/2447670205 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fadbc0662b0 0x7fadbc068760 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fadd40b1000 tx=0x7fadd40aa000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:20.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.528+0000 7fadceffd640 1 -- 172.21.15.45:0/2447670205 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fadc80505e0 con 0x7fadd80c2790 2023-10-03T19:20:20.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.680+0000 7fade056f640 1 -- 172.21.15.45:0/2447670205 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fadd80a8f50 con 0x7fadbc0662b0 2023-10-03T19:20:20.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.704+0000 7fadceffd640 1 -- 172.21.15.45:0/2447670205 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310114 (secure 0 0 0) 0x7fadd80a8f50 con 0x7fadbc0662b0 2023-10-03T19:20:20.708 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:20:20.713 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:20:20.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.708+0000 7fade056f640 1 -- 172.21.15.45:0/2447670205 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fadbc0662b0 msgr2=0x7fadbc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:20.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.708+0000 7fade056f640 1 --2- 172.21.15.45:0/2447670205 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fadbc0662b0 0x7fadbc068760 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fadd40b1000 tx=0x7fadd40aa000 comp rx=0 tx=0).stop 2023-10-03T19:20:20.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.708+0000 7fade056f640 1 -- 172.21.15.45:0/2447670205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadd80c2790 msgr2=0x7fadd8150a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:20.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.708+0000 7fade056f640 1 --2- 172.21.15.45:0/2447670205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadd80c2790 0x7fadd8150a00 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fadc800c430 tx=0x7fadc800c8f0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.712+0000 7fade056f640 1 -- 172.21.15.45:0/2447670205 shutdown_connections 2023-10-03T19:20:20.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.712+0000 7fade056f640 1 --2- 172.21.15.45:0/2447670205 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fadbc0662b0 0x7fadbc068760 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.712+0000 7fade056f640 1 --2- 172.21.15.45:0/2447670205 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fadd814f240 0x7fadd81e7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.712+0000 7fade056f640 1 --2- 172.21.15.45:0/2447670205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadd80c2790 0x7fadd8150a00 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.712+0000 7fade056f640 1 --2- 172.21.15.45:0/2447670205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadd80bb1d0 0x7fadd8151530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.712+0000 7fade056f640 1 -- 172.21.15.45:0/2447670205 >> 172.21.15.45:0/2447670205 conn(0x7fadd80a64a0 msgr2=0x7fadd80a40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:20.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.712+0000 7fade056f640 1 -- 172.21.15.45:0/2447670205 shutdown_connections 2023-10-03T19:20:20.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.712+0000 7fade056f640 1 -- 172.21.15.45:0/2447670205 wait complete. 2023-10-03T19:20:20.731 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":344,"stamp":"2023-10-03T19:20:20.613975+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591838,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":72,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":251580,"kb_used_data":10620,"kb_used_omap":0,"kb_used_meta":240896,"kb_avail":754723140,"statfs":{"total":773094113280,"available":772836495360,"internally_reserved":0,"allocated":10874880,"data_stored":6091948,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":246677504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":71,"apply_latency_ms":71,"commit_latency_ns":71000000,"apply_latency_ns":71000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1470,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.699671"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.359932+0000","last_change":"2023-10-03T19:20:16.343087+0000","last_active":"2023-10-03T19:20:16.359932+0000","last_peered":"2023-10-03T19:20:16.359932+0000","last_clean":"2023-10-03T19:20:16.359932+0000","last_became_active":"2023-10-03T19:20:16.342222+0000","last_became_peered":"2023-10-03T19:20:16.342222+0000","last_unstale":"2023-10-03T19:20:16.359932+0000","last_undegraded":"2023-10-03T19:20:16.359932+0000","last_fullsized":"2023-10-03T19:20:16.359932+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:50:10.917756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.313689+0000","last_change":"2023-10-03T19:20:16.313689+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.313689+0000","last_undegraded":"2023-10-03T19:20:16.313689+0000","last_fullsized":"2023-10-03T19:20:16.313689+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:46:55.330519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.319563+0000","last_change":"2023-10-03T19:20:16.319563+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.319563+0000","last_undegraded":"2023-10-03T19:20:16.319563+0000","last_fullsized":"2023-10-03T19:20:16.319563+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:10:04.836594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.388471+0000","last_change":"2023-10-03T19:20:16.366790+0000","last_active":"2023-10-03T19:20:16.388471+0000","last_peered":"2023-10-03T19:20:16.388471+0000","last_clean":"2023-10-03T19:20:16.388471+0000","last_became_active":"2023-10-03T19:20:16.366099+0000","last_became_peered":"2023-10-03T19:20:16.366099+0000","last_unstale":"2023-10-03T19:20:16.388471+0000","last_undegraded":"2023-10-03T19:20:16.388471+0000","last_fullsized":"2023-10-03T19:20:16.388471+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:38:23.411788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.384249+0000","last_change":"2023-10-03T19:20:16.380848+0000","last_active":"2023-10-03T19:20:16.384249+0000","last_peered":"2023-10-03T19:20:16.384249+0000","last_clean":"2023-10-03T19:20:16.384249+0000","last_became_active":"2023-10-03T19:20:16.379931+0000","last_became_peered":"2023-10-03T19:20:16.379931+0000","last_unstale":"2023-10-03T19:20:16.384249+0000","last_undegraded":"2023-10-03T19:20:16.384249+0000","last_fullsized":"2023-10-03T19:20:16.384249+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:38:10.161375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427524+0000","last_change":"2023-10-03T19:20:16.326785+0000","last_active":"2023-10-03T19:20:17.427524+0000","last_peered":"2023-10-03T19:20:17.427524+0000","last_clean":"2023-10-03T19:20:17.427524+0000","last_became_active":"2023-10-03T19:20:16.326450+0000","last_became_peered":"2023-10-03T19:20:16.326450+0000","last_unstale":"2023-10-03T19:20:17.427524+0000","last_undegraded":"2023-10-03T19:20:17.427524+0000","last_fullsized":"2023-10-03T19:20:17.427524+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:28:31.610677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427927+0000","last_change":"2023-10-03T19:20:16.361601+0000","last_active":"2023-10-03T19:20:17.427927+0000","last_peered":"2023-10-03T19:20:17.427927+0000","last_clean":"2023-10-03T19:20:17.427927+0000","last_became_active":"2023-10-03T19:20:16.361314+0000","last_became_peered":"2023-10-03T19:20:16.361314+0000","last_unstale":"2023-10-03T19:20:17.427927+0000","last_undegraded":"2023-10-03T19:20:17.427927+0000","last_fullsized":"2023-10-03T19:20:17.427927+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:21:09.278090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.313002+0000","last_change":"2023-10-03T19:20:16.313002+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.313002+0000","last_undegraded":"2023-10-03T19:20:16.313002+0000","last_fullsized":"2023-10-03T19:20:16.313002+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:58:50.794379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.388443+0000","last_change":"2023-10-03T19:20:16.366438+0000","last_active":"2023-10-03T19:20:16.388443+0000","last_peered":"2023-10-03T19:20:16.388443+0000","last_clean":"2023-10-03T19:20:16.388443+0000","last_became_active":"2023-10-03T19:20:16.365832+0000","last_became_peered":"2023-10-03T19:20:16.365832+0000","last_unstale":"2023-10-03T19:20:16.388443+0000","last_undegraded":"2023-10-03T19:20:16.388443+0000","last_fullsized":"2023-10-03T19:20:16.388443+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:25:32.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.337779+0000","last_change":"2023-10-03T19:20:16.333439+0000","last_active":"2023-10-03T19:20:16.337779+0000","last_peered":"2023-10-03T19:20:16.337779+0000","last_clean":"2023-10-03T19:20:16.337779+0000","last_became_active":"2023-10-03T19:20:16.332236+0000","last_became_peered":"2023-10-03T19:20:16.332236+0000","last_unstale":"2023-10-03T19:20:16.337779+0000","last_undegraded":"2023-10-03T19:20:16.337779+0000","last_fullsized":"2023-10-03T19:20:16.337779+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:44:23.426898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.374688+0000","last_change":"2023-10-03T19:20:16.369509+0000","last_active":"2023-10-03T19:20:16.374688+0000","last_peered":"2023-10-03T19:20:16.374688+0000","last_clean":"2023-10-03T19:20:16.374688+0000","last_became_active":"2023-10-03T19:20:16.368845+0000","last_became_peered":"2023-10-03T19:20:16.368845+0000","last_unstale":"2023-10-03T19:20:16.374688+0000","last_undegraded":"2023-10-03T19:20:16.374688+0000","last_fullsized":"2023-10-03T19:20:16.374688+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:44:06.881790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.428312+0000","last_change":"2023-10-03T19:20:16.326180+0000","last_active":"2023-10-03T19:20:17.428312+0000","last_peered":"2023-10-03T19:20:17.428312+0000","last_clean":"2023-10-03T19:20:17.428312+0000","last_became_active":"2023-10-03T19:20:16.325905+0000","last_became_peered":"2023-10-03T19:20:16.325905+0000","last_unstale":"2023-10-03T19:20:17.428312+0000","last_undegraded":"2023-10-03T19:20:17.428312+0000","last_fullsized":"2023-10-03T19:20:17.428312+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:12:28.137148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.365387+0000","last_change":"2023-10-03T19:20:16.363982+0000","last_active":"2023-10-03T19:20:16.365387+0000","last_peered":"2023-10-03T19:20:16.365387+0000","last_clean":"2023-10-03T19:20:16.365387+0000","last_became_active":"2023-10-03T19:20:16.363497+0000","last_became_peered":"2023-10-03T19:20:16.363497+0000","last_unstale":"2023-10-03T19:20:16.365387+0000","last_undegraded":"2023-10-03T19:20:16.365387+0000","last_fullsized":"2023-10-03T19:20:16.365387+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:08:32.046373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.314003+0000","last_change":"2023-10-03T19:20:16.314003+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.314003+0000","last_undegraded":"2023-10-03T19:20:16.314003+0000","last_fullsized":"2023-10-03T19:20:16.314003+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:32:29.079841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.374687+0000","last_change":"2023-10-03T19:20:16.369450+0000","last_active":"2023-10-03T19:20:16.374687+0000","last_peered":"2023-10-03T19:20:16.374687+0000","last_clean":"2023-10-03T19:20:16.374687+0000","last_became_active":"2023-10-03T19:20:16.368874+0000","last_became_peered":"2023-10-03T19:20:16.368874+0000","last_unstale":"2023-10-03T19:20:16.374687+0000","last_undegraded":"2023-10-03T19:20:16.374687+0000","last_fullsized":"2023-10-03T19:20:16.374687+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:32:29.079841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427088+0000","last_change":"2023-10-03T19:20:16.330466+0000","last_active":"2023-10-03T19:20:17.427088+0000","last_peered":"2023-10-03T19:20:17.427088+0000","last_clean":"2023-10-03T19:20:17.427088+0000","last_became_active":"2023-10-03T19:20:16.330201+0000","last_became_peered":"2023-10-03T19:20:16.330201+0000","last_unstale":"2023-10-03T19:20:17.427088+0000","last_undegraded":"2023-10-03T19:20:17.427088+0000","last_fullsized":"2023-10-03T19:20:17.427088+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:40:35.218183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.365365+0000","last_change":"2023-10-03T19:20:16.363892+0000","last_active":"2023-10-03T19:20:16.365365+0000","last_peered":"2023-10-03T19:20:16.365365+0000","last_clean":"2023-10-03T19:20:16.365365+0000","last_became_active":"2023-10-03T19:20:16.363606+0000","last_became_peered":"2023-10-03T19:20:16.363606+0000","last_unstale":"2023-10-03T19:20:16.365365+0000","last_undegraded":"2023-10-03T19:20:16.365365+0000","last_fullsized":"2023-10-03T19:20:16.365365+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:28:24.282225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.313320+0000","last_change":"2023-10-03T19:20:16.313320+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.313320+0000","last_undegraded":"2023-10-03T19:20:16.313320+0000","last_fullsized":"2023-10-03T19:20:16.313320+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:38:10.161375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.329432+0000","last_change":"2023-10-03T19:20:16.383943+0000","last_active":"2023-10-03T19:20:17.329432+0000","last_peered":"2023-10-03T19:20:17.329432+0000","last_clean":"2023-10-03T19:20:17.329432+0000","last_became_active":"2023-10-03T19:20:16.383157+0000","last_became_peered":"2023-10-03T19:20:16.383157+0000","last_unstale":"2023-10-03T19:20:17.329432+0000","last_undegraded":"2023-10-03T19:20:17.329432+0000","last_fullsized":"2023-10-03T19:20:17.329432+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:34:17.223181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.318797+0000","last_change":"2023-10-03T19:20:16.322423+0000","last_active":"2023-10-03T19:20:17.318797+0000","last_peered":"2023-10-03T19:20:17.318797+0000","last_clean":"2023-10-03T19:20:17.318797+0000","last_became_active":"2023-10-03T19:20:16.322147+0000","last_became_peered":"2023-10-03T19:20:16.322147+0000","last_unstale":"2023-10-03T19:20:17.318797+0000","last_undegraded":"2023-10-03T19:20:17.318797+0000","last_fullsized":"2023-10-03T19:20:17.318797+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:12:31.453399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.388755+0000","last_change":"2023-10-03T19:20:16.372224+0000","last_active":"2023-10-03T19:20:16.388755+0000","last_peered":"2023-10-03T19:20:16.388755+0000","last_clean":"2023-10-03T19:20:16.388755+0000","last_became_active":"2023-10-03T19:20:16.371522+0000","last_became_peered":"2023-10-03T19:20:16.371522+0000","last_unstale":"2023-10-03T19:20:16.388755+0000","last_undegraded":"2023-10-03T19:20:16.388755+0000","last_fullsized":"2023-10-03T19:20:16.388755+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:37:56.189574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.364672+0000","last_change":"2023-10-03T19:20:16.348420+0000","last_active":"2023-10-03T19:20:16.364672+0000","last_peered":"2023-10-03T19:20:16.364672+0000","last_clean":"2023-10-03T19:20:16.364672+0000","last_became_active":"2023-10-03T19:20:16.347688+0000","last_became_peered":"2023-10-03T19:20:16.347688+0000","last_unstale":"2023-10-03T19:20:16.364672+0000","last_undegraded":"2023-10-03T19:20:16.364672+0000","last_fullsized":"2023-10-03T19:20:16.364672+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:35:03.160406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.388852+0000","last_change":"2023-10-03T19:20:16.373061+0000","last_active":"2023-10-03T19:20:16.388852+0000","last_peered":"2023-10-03T19:20:16.388852+0000","last_clean":"2023-10-03T19:20:16.388852+0000","last_became_active":"2023-10-03T19:20:16.372301+0000","last_became_peered":"2023-10-03T19:20:16.372301+0000","last_unstale":"2023-10-03T19:20:16.388852+0000","last_undegraded":"2023-10-03T19:20:16.388852+0000","last_fullsized":"2023-10-03T19:20:16.388852+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:32:36.381349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.326772+0000","last_change":"2023-10-03T19:20:16.378738+0000","last_active":"2023-10-03T19:20:17.326772+0000","last_peered":"2023-10-03T19:20:17.326772+0000","last_clean":"2023-10-03T19:20:17.326772+0000","last_became_active":"2023-10-03T19:20:16.378316+0000","last_became_peered":"2023-10-03T19:20:16.378316+0000","last_unstale":"2023-10-03T19:20:17.326772+0000","last_undegraded":"2023-10-03T19:20:17.326772+0000","last_fullsized":"2023-10-03T19:20:17.326772+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:48:24.816920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328599+0000","last_change":"2023-10-03T19:20:16.360114+0000","last_active":"2023-10-03T19:20:17.328599+0000","last_peered":"2023-10-03T19:20:17.328599+0000","last_clean":"2023-10-03T19:20:17.328599+0000","last_became_active":"2023-10-03T19:20:16.359471+0000","last_became_peered":"2023-10-03T19:20:16.359471+0000","last_unstale":"2023-10-03T19:20:17.328599+0000","last_undegraded":"2023-10-03T19:20:17.328599+0000","last_fullsized":"2023-10-03T19:20:17.328599+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:37:47.071602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.318972+0000","last_change":"2023-10-03T19:20:16.332688+0000","last_active":"2023-10-03T19:20:17.318972+0000","last_peered":"2023-10-03T19:20:17.318972+0000","last_clean":"2023-10-03T19:20:17.318972+0000","last_became_active":"2023-10-03T19:20:16.332406+0000","last_became_peered":"2023-10-03T19:20:16.332406+0000","last_unstale":"2023-10-03T19:20:17.318972+0000","last_undegraded":"2023-10-03T19:20:17.318972+0000","last_fullsized":"2023-10-03T19:20:17.318972+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:56:57.997822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.329517+0000","last_change":"2023-10-03T19:20:16.383652+0000","last_active":"2023-10-03T19:20:17.329517+0000","last_peered":"2023-10-03T19:20:17.329517+0000","last_clean":"2023-10-03T19:20:17.329517+0000","last_became_active":"2023-10-03T19:20:16.382532+0000","last_became_peered":"2023-10-03T19:20:16.382532+0000","last_unstale":"2023-10-03T19:20:17.329517+0000","last_undegraded":"2023-10-03T19:20:17.329517+0000","last_fullsized":"2023-10-03T19:20:17.329517+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:13:33.426772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.428479+0000","last_change":"2023-10-03T19:20:16.363654+0000","last_active":"2023-10-03T19:20:17.428479+0000","last_peered":"2023-10-03T19:20:17.428479+0000","last_clean":"2023-10-03T19:20:17.428479+0000","last_became_active":"2023-10-03T19:20:16.363344+0000","last_became_peered":"2023-10-03T19:20:16.363344+0000","last_unstale":"2023-10-03T19:20:17.428479+0000","last_undegraded":"2023-10-03T19:20:17.428479+0000","last_fullsized":"2023-10-03T19:20:17.428479+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:52:35.362235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.318244+0000","last_change":"2023-10-03T19:20:16.327198+0000","last_active":"2023-10-03T19:20:17.318244+0000","last_peered":"2023-10-03T19:20:17.318244+0000","last_clean":"2023-10-03T19:20:17.318244+0000","last_became_active":"2023-10-03T19:20:16.326730+0000","last_became_peered":"2023-10-03T19:20:16.326730+0000","last_unstale":"2023-10-03T19:20:17.318244+0000","last_undegraded":"2023-10-03T19:20:17.318244+0000","last_fullsized":"2023-10-03T19:20:17.318244+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:40:02.105613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.313651+0000","last_change":"2023-10-03T19:20:16.313651+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.313651+0000","last_undegraded":"2023-10-03T19:20:16.313651+0000","last_fullsized":"2023-10-03T19:20:16.313651+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:29:43.899924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.327148+0000","last_change":"2023-10-03T19:20:16.336333+0000","last_active":"2023-10-03T19:20:17.327148+0000","last_peered":"2023-10-03T19:20:17.327148+0000","last_clean":"2023-10-03T19:20:17.327148+0000","last_became_active":"2023-10-03T19:20:16.328732+0000","last_became_peered":"2023-10-03T19:20:16.328732+0000","last_unstale":"2023-10-03T19:20:17.327148+0000","last_undegraded":"2023-10-03T19:20:17.327148+0000","last_fullsized":"2023-10-03T19:20:17.327148+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:38:34.923323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.326771+0000","last_change":"2023-10-03T19:20:16.357185+0000","last_active":"2023-10-03T19:20:17.326771+0000","last_peered":"2023-10-03T19:20:17.326771+0000","last_clean":"2023-10-03T19:20:17.326771+0000","last_became_active":"2023-10-03T19:20:16.356591+0000","last_became_peered":"2023-10-03T19:20:16.356591+0000","last_unstale":"2023-10-03T19:20:17.326771+0000","last_undegraded":"2023-10-03T19:20:17.326771+0000","last_fullsized":"2023-10-03T19:20:17.326771+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:36:02.147396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.336171+0000","last_change":"2023-10-03T19:20:16.332773+0000","last_active":"2023-10-03T19:20:16.336171+0000","last_peered":"2023-10-03T19:20:16.336171+0000","last_clean":"2023-10-03T19:20:16.336171+0000","last_became_active":"2023-10-03T19:20:16.332432+0000","last_became_peered":"2023-10-03T19:20:16.332432+0000","last_unstale":"2023-10-03T19:20:16.336171+0000","last_undegraded":"2023-10-03T19:20:16.336171+0000","last_fullsized":"2023-10-03T19:20:16.336171+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:06:21.719875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"108'4","reported_seq":17,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.330032+0000","last_change":"2023-10-03T19:20:15.974915+0000","last_active":"2023-10-03T19:20:17.330032+0000","last_peered":"2023-10-03T19:20:17.330032+0000","last_clean":"2023-10-03T19:20:17.330032+0000","last_became_active":"2023-10-03T19:20:15.974027+0000","last_became_peered":"2023-10-03T19:20:15.974027+0000","last_unstale":"2023-10-03T19:20:17.330032+0000","last_undegraded":"2023-10-03T19:20:17.330032+0000","last_fullsized":"2023-10-03T19:20:17.330032+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:42:02.754043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427780+0000","last_change":"2023-10-03T19:20:16.328760+0000","last_active":"2023-10-03T19:20:17.427780+0000","last_peered":"2023-10-03T19:20:17.427780+0000","last_clean":"2023-10-03T19:20:17.427780+0000","last_became_active":"2023-10-03T19:20:16.328456+0000","last_became_peered":"2023-10-03T19:20:16.328456+0000","last_unstale":"2023-10-03T19:20:17.427780+0000","last_undegraded":"2023-10-03T19:20:17.427780+0000","last_fullsized":"2023-10-03T19:20:17.427780+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:36:28.692332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"108'1","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.332435+0000","last_change":"2023-10-03T19:20:15.948383+0000","last_active":"2023-10-03T19:20:16.332435+0000","last_peered":"2023-10-03T19:20:16.332435+0000","last_clean":"2023-10-03T19:20:16.332435+0000","last_became_active":"2023-10-03T19:20:15.947986+0000","last_became_peered":"2023-10-03T19:20:15.947986+0000","last_unstale":"2023-10-03T19:20:16.332435+0000","last_undegraded":"2023-10-03T19:20:16.332435+0000","last_fullsized":"2023-10-03T19:20:16.332435+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:59:30.670767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328274+0000","last_change":"2023-10-03T19:20:16.361589+0000","last_active":"2023-10-03T19:20:17.328274+0000","last_peered":"2023-10-03T19:20:17.328274+0000","last_clean":"2023-10-03T19:20:17.328274+0000","last_became_active":"2023-10-03T19:20:16.360874+0000","last_became_peered":"2023-10-03T19:20:16.360874+0000","last_unstale":"2023-10-03T19:20:17.328274+0000","last_undegraded":"2023-10-03T19:20:17.328274+0000","last_fullsized":"2023-10-03T19:20:17.328274+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:24:03.546278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"108'2","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.381745+0000","last_change":"2023-10-03T19:20:15.972052+0000","last_active":"2023-10-03T19:20:16.381745+0000","last_peered":"2023-10-03T19:20:16.381745+0000","last_clean":"2023-10-03T19:20:16.381745+0000","last_became_active":"2023-10-03T19:20:15.971172+0000","last_became_peered":"2023-10-03T19:20:15.971172+0000","last_unstale":"2023-10-03T19:20:16.381745+0000","last_undegraded":"2023-10-03T19:20:16.381745+0000","last_fullsized":"2023-10-03T19:20:16.381745+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:28:00.958370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.388611+0000","last_change":"2023-10-03T19:20:16.368357+0000","last_active":"2023-10-03T19:20:16.388611+0000","last_peered":"2023-10-03T19:20:16.388611+0000","last_clean":"2023-10-03T19:20:16.388611+0000","last_became_active":"2023-10-03T19:20:16.367616+0000","last_became_peered":"2023-10-03T19:20:16.367616+0000","last_unstale":"2023-10-03T19:20:16.388611+0000","last_undegraded":"2023-10-03T19:20:16.388611+0000","last_fullsized":"2023-10-03T19:20:16.388611+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:51:54.780344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"108'2","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.340323+0000","last_change":"2023-10-03T19:20:15.964371+0000","last_active":"2023-10-03T19:20:16.340323+0000","last_peered":"2023-10-03T19:20:16.340323+0000","last_clean":"2023-10-03T19:20:16.340323+0000","last_became_active":"2023-10-03T19:20:15.963961+0000","last_became_peered":"2023-10-03T19:20:15.963961+0000","last_unstale":"2023-10-03T19:20:16.340323+0000","last_undegraded":"2023-10-03T19:20:16.340323+0000","last_fullsized":"2023-10-03T19:20:16.340323+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:53:59.202663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.375198+0000","last_change":"2023-10-03T19:20:16.374148+0000","last_active":"2023-10-03T19:20:16.375198+0000","last_peered":"2023-10-03T19:20:16.375198+0000","last_clean":"2023-10-03T19:20:16.375198+0000","last_became_active":"2023-10-03T19:20:16.373840+0000","last_became_peered":"2023-10-03T19:20:16.373840+0000","last_unstale":"2023-10-03T19:20:16.375198+0000","last_undegraded":"2023-10-03T19:20:16.375198+0000","last_fullsized":"2023-10-03T19:20:16.375198+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:19:32.912872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"108'1","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.341648+0000","last_change":"2023-10-03T19:20:15.956585+0000","last_active":"2023-10-03T19:20:16.341648+0000","last_peered":"2023-10-03T19:20:16.341648+0000","last_clean":"2023-10-03T19:20:16.341648+0000","last_became_active":"2023-10-03T19:20:15.955764+0000","last_became_peered":"2023-10-03T19:20:15.955764+0000","last_unstale":"2023-10-03T19:20:16.341648+0000","last_undegraded":"2023-10-03T19:20:16.341648+0000","last_fullsized":"2023-10-03T19:20:16.341648+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:25:54.232755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.382347+0000","last_change":"2023-10-03T19:20:16.380278+0000","last_active":"2023-10-03T19:20:16.382347+0000","last_peered":"2023-10-03T19:20:16.382347+0000","last_clean":"2023-10-03T19:20:16.382347+0000","last_became_active":"2023-10-03T19:20:16.379843+0000","last_became_peered":"2023-10-03T19:20:16.379843+0000","last_unstale":"2023-10-03T19:20:16.382347+0000","last_undegraded":"2023-10-03T19:20:16.382347+0000","last_fullsized":"2023-10-03T19:20:16.382347+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:46:55.330519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"108'1","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427728+0000","last_change":"2023-10-03T19:20:15.967905+0000","last_active":"2023-10-03T19:20:17.427728+0000","last_peered":"2023-10-03T19:20:17.427728+0000","last_clean":"2023-10-03T19:20:17.427728+0000","last_became_active":"2023-10-03T19:20:15.967603+0000","last_became_peered":"2023-10-03T19:20:15.967603+0000","last_unstale":"2023-10-03T19:20:17.427728+0000","last_undegraded":"2023-10-03T19:20:17.427728+0000","last_fullsized":"2023-10-03T19:20:17.427728+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:23:31.344311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.333211+0000","last_change":"2023-10-03T19:20:16.333211+0000","last_active":"2023-10-03T19:20:16.333211+0000","last_peered":"2023-10-03T19:20:16.333211+0000","last_clean":"2023-10-03T19:20:16.333211+0000","last_became_active":"2023-10-03T19:20:16.332946+0000","last_became_peered":"2023-10-03T19:20:16.332946+0000","last_unstale":"2023-10-03T19:20:16.333211+0000","last_undegraded":"2023-10-03T19:20:16.333211+0000","last_fullsized":"2023-10-03T19:20:16.333211+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:50:10.917756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.327271+0000","last_change":"2023-10-03T19:20:15.955201+0000","last_active":"2023-10-03T19:20:17.327271+0000","last_peered":"2023-10-03T19:20:17.327271+0000","last_clean":"2023-10-03T19:20:17.327271+0000","last_became_active":"2023-10-03T19:20:15.954436+0000","last_became_peered":"2023-10-03T19:20:15.954436+0000","last_unstale":"2023-10-03T19:20:17.327271+0000","last_undegraded":"2023-10-03T19:20:17.327271+0000","last_fullsized":"2023-10-03T19:20:17.327271+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:39:18.747278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.334203+0000","last_change":"2023-10-03T19:20:16.328049+0000","last_active":"2023-10-03T19:20:16.334203+0000","last_peered":"2023-10-03T19:20:16.334203+0000","last_clean":"2023-10-03T19:20:16.334203+0000","last_became_active":"2023-10-03T19:20:16.327707+0000","last_became_peered":"2023-10-03T19:20:16.327707+0000","last_unstale":"2023-10-03T19:20:16.334203+0000","last_undegraded":"2023-10-03T19:20:16.334203+0000","last_fullsized":"2023-10-03T19:20:16.334203+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:25:59.855509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427488+0000","last_change":"2023-10-03T19:20:15.954813+0000","last_active":"2023-10-03T19:20:17.427488+0000","last_peered":"2023-10-03T19:20:17.427488+0000","last_clean":"2023-10-03T19:20:17.427488+0000","last_became_active":"2023-10-03T19:20:15.954281+0000","last_became_peered":"2023-10-03T19:20:15.954281+0000","last_unstale":"2023-10-03T19:20:17.427488+0000","last_undegraded":"2023-10-03T19:20:17.427488+0000","last_fullsized":"2023-10-03T19:20:17.427488+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:10:30.851090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328147+0000","last_change":"2023-10-03T19:20:16.360131+0000","last_active":"2023-10-03T19:20:17.328147+0000","last_peered":"2023-10-03T19:20:17.328147+0000","last_clean":"2023-10-03T19:20:17.328147+0000","last_became_active":"2023-10-03T19:20:16.359396+0000","last_became_peered":"2023-10-03T19:20:16.359396+0000","last_unstale":"2023-10-03T19:20:17.328147+0000","last_undegraded":"2023-10-03T19:20:17.328147+0000","last_fullsized":"2023-10-03T19:20:17.328147+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:19:39.425532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"108'1","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.334585+0000","last_change":"2023-10-03T19:20:15.956714+0000","last_active":"2023-10-03T19:20:16.334585+0000","last_peered":"2023-10-03T19:20:16.334585+0000","last_clean":"2023-10-03T19:20:16.334585+0000","last_became_active":"2023-10-03T19:20:15.956345+0000","last_became_peered":"2023-10-03T19:20:15.956345+0000","last_unstale":"2023-10-03T19:20:16.334585+0000","last_undegraded":"2023-10-03T19:20:16.334585+0000","last_fullsized":"2023-10-03T19:20:16.334585+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:25:21.009051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.364657+0000","last_change":"2023-10-03T19:20:16.346680+0000","last_active":"2023-10-03T19:20:16.364657+0000","last_peered":"2023-10-03T19:20:16.364657+0000","last_clean":"2023-10-03T19:20:16.364657+0000","last_became_active":"2023-10-03T19:20:16.345966+0000","last_became_peered":"2023-10-03T19:20:16.345966+0000","last_unstale":"2023-10-03T19:20:16.364657+0000","last_undegraded":"2023-10-03T19:20:16.364657+0000","last_fullsized":"2023-10-03T19:20:16.364657+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:29:43.899924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"108'2","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.319319+0000","last_change":"2023-10-03T19:20:15.957563+0000","last_active":"2023-10-03T19:20:17.319319+0000","last_peered":"2023-10-03T19:20:17.319319+0000","last_clean":"2023-10-03T19:20:17.319319+0000","last_became_active":"2023-10-03T19:20:15.957133+0000","last_became_peered":"2023-10-03T19:20:15.957133+0000","last_unstale":"2023-10-03T19:20:17.319319+0000","last_undegraded":"2023-10-03T19:20:17.319319+0000","last_fullsized":"2023-10-03T19:20:17.319319+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:14:44.702562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.428460+0000","last_change":"2023-10-03T19:20:16.350664+0000","last_active":"2023-10-03T19:20:17.428460+0000","last_peered":"2023-10-03T19:20:17.428460+0000","last_clean":"2023-10-03T19:20:17.428460+0000","last_became_active":"2023-10-03T19:20:16.350368+0000","last_became_peered":"2023-10-03T19:20:16.350368+0000","last_unstale":"2023-10-03T19:20:17.428460+0000","last_undegraded":"2023-10-03T19:20:17.428460+0000","last_fullsized":"2023-10-03T19:20:17.428460+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:26:55.310688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"108'1","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.373081+0000","last_change":"2023-10-03T19:20:15.974399+0000","last_active":"2023-10-03T19:20:16.373081+0000","last_peered":"2023-10-03T19:20:16.373081+0000","last_clean":"2023-10-03T19:20:16.373081+0000","last_became_active":"2023-10-03T19:20:15.973595+0000","last_became_peered":"2023-10-03T19:20:15.973595+0000","last_unstale":"2023-10-03T19:20:16.373081+0000","last_undegraded":"2023-10-03T19:20:16.373081+0000","last_fullsized":"2023-10-03T19:20:16.373081+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:32:50.979185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.329360+0000","last_change":"2023-10-03T19:20:16.380011+0000","last_active":"2023-10-03T19:20:17.329360+0000","last_peered":"2023-10-03T19:20:17.329360+0000","last_clean":"2023-10-03T19:20:17.329360+0000","last_became_active":"2023-10-03T19:20:16.379481+0000","last_became_peered":"2023-10-03T19:20:16.379481+0000","last_unstale":"2023-10-03T19:20:17.329360+0000","last_undegraded":"2023-10-03T19:20:17.329360+0000","last_fullsized":"2023-10-03T19:20:17.329360+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:03:01.967348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.334168+0000","last_change":"2023-10-03T19:20:15.969845+0000","last_active":"2023-10-03T19:20:16.334168+0000","last_peered":"2023-10-03T19:20:16.334168+0000","last_clean":"2023-10-03T19:20:16.334168+0000","last_became_active":"2023-10-03T19:20:15.969245+0000","last_became_peered":"2023-10-03T19:20:15.969245+0000","last_unstale":"2023-10-03T19:20:16.334168+0000","last_undegraded":"2023-10-03T19:20:16.334168+0000","last_fullsized":"2023-10-03T19:20:16.334168+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:02:40.240181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427116+0000","last_change":"2023-10-03T19:20:16.381646+0000","last_active":"2023-10-03T19:20:17.427116+0000","last_peered":"2023-10-03T19:20:17.427116+0000","last_clean":"2023-10-03T19:20:17.427116+0000","last_became_active":"2023-10-03T19:20:16.381252+0000","last_became_peered":"2023-10-03T19:20:16.381252+0000","last_unstale":"2023-10-03T19:20:17.427116+0000","last_undegraded":"2023-10-03T19:20:17.427116+0000","last_fullsized":"2023-10-03T19:20:17.427116+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:37:09.807280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"108'2","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427703+0000","last_change":"2023-10-03T19:20:15.968967+0000","last_active":"2023-10-03T19:20:17.427703+0000","last_peered":"2023-10-03T19:20:17.427703+0000","last_clean":"2023-10-03T19:20:17.427703+0000","last_became_active":"2023-10-03T19:20:15.968699+0000","last_became_peered":"2023-10-03T19:20:15.968699+0000","last_unstale":"2023-10-03T19:20:17.427703+0000","last_undegraded":"2023-10-03T19:20:17.427703+0000","last_fullsized":"2023-10-03T19:20:17.427703+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:10:38.839362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.312802+0000","last_change":"2023-10-03T19:20:16.312802+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.312802+0000","last_undegraded":"2023-10-03T19:20:16.312802+0000","last_fullsized":"2023-10-03T19:20:16.312802+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:16:52.366869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.332701+0000","last_change":"2023-10-03T19:20:15.965136+0000","last_active":"2023-10-03T19:20:16.332701+0000","last_peered":"2023-10-03T19:20:16.332701+0000","last_clean":"2023-10-03T19:20:16.332701+0000","last_became_active":"2023-10-03T19:20:15.964445+0000","last_became_peered":"2023-10-03T19:20:15.964445+0000","last_unstale":"2023-10-03T19:20:16.332701+0000","last_undegraded":"2023-10-03T19:20:16.332701+0000","last_fullsized":"2023-10-03T19:20:16.332701+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:57:06.605896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.314019+0000","last_change":"2023-10-03T19:20:16.314019+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.314019+0000","last_undegraded":"2023-10-03T19:20:16.314019+0000","last_fullsized":"2023-10-03T19:20:16.314019+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:35:03.160406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.315594+0000","last_change":"2023-10-03T19:20:15.968473+0000","last_active":"2023-10-03T19:20:16.315594+0000","last_peered":"2023-10-03T19:20:16.315594+0000","last_clean":"2023-10-03T19:20:16.315594+0000","last_became_active":"2023-10-03T19:20:15.968149+0000","last_became_peered":"2023-10-03T19:20:15.968149+0000","last_unstale":"2023-10-03T19:20:16.315594+0000","last_undegraded":"2023-10-03T19:20:16.315594+0000","last_fullsized":"2023-10-03T19:20:16.315594+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:48:45.233305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.327669+0000","last_change":"2023-10-03T19:20:16.360789+0000","last_active":"2023-10-03T19:20:17.327669+0000","last_peered":"2023-10-03T19:20:17.327669+0000","last_clean":"2023-10-03T19:20:17.327669+0000","last_became_active":"2023-10-03T19:20:16.360054+0000","last_became_peered":"2023-10-03T19:20:16.360054+0000","last_unstale":"2023-10-03T19:20:17.327669+0000","last_undegraded":"2023-10-03T19:20:17.327669+0000","last_fullsized":"2023-10-03T19:20:17.327669+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:49:08.311127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.333760+0000","last_change":"2023-10-03T19:20:15.974966+0000","last_active":"2023-10-03T19:20:16.333760+0000","last_peered":"2023-10-03T19:20:16.333760+0000","last_clean":"2023-10-03T19:20:16.333760+0000","last_became_active":"2023-10-03T19:20:15.974042+0000","last_became_peered":"2023-10-03T19:20:15.974042+0000","last_unstale":"2023-10-03T19:20:16.333760+0000","last_undegraded":"2023-10-03T19:20:16.333760+0000","last_fullsized":"2023-10-03T19:20:16.333760+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:09:35.872471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.428525+0000","last_change":"2023-10-03T19:20:16.323318+0000","last_active":"2023-10-03T19:20:17.428525+0000","last_peered":"2023-10-03T19:20:17.428525+0000","last_clean":"2023-10-03T19:20:17.428525+0000","last_became_active":"2023-10-03T19:20:16.322090+0000","last_became_peered":"2023-10-03T19:20:16.322090+0000","last_unstale":"2023-10-03T19:20:17.428525+0000","last_undegraded":"2023-10-03T19:20:17.428525+0000","last_fullsized":"2023-10-03T19:20:17.428525+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:41:27.118657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"108'2","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.428161+0000","last_change":"2023-10-03T19:20:15.948790+0000","last_active":"2023-10-03T19:20:17.428161+0000","last_peered":"2023-10-03T19:20:17.428161+0000","last_clean":"2023-10-03T19:20:17.428161+0000","last_became_active":"2023-10-03T19:20:15.948222+0000","last_became_peered":"2023-10-03T19:20:15.948222+0000","last_unstale":"2023-10-03T19:20:17.428161+0000","last_undegraded":"2023-10-03T19:20:17.428161+0000","last_fullsized":"2023-10-03T19:20:17.428161+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:14:18.658361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.374335+0000","last_change":"2023-10-03T19:20:16.373432+0000","last_active":"2023-10-03T19:20:16.374335+0000","last_peered":"2023-10-03T19:20:16.374335+0000","last_clean":"2023-10-03T19:20:16.374335+0000","last_became_active":"2023-10-03T19:20:16.373117+0000","last_became_peered":"2023-10-03T19:20:16.373117+0000","last_unstale":"2023-10-03T19:20:16.374335+0000","last_undegraded":"2023-10-03T19:20:16.374335+0000","last_fullsized":"2023-10-03T19:20:16.374335+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:04:34.700899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.329921+0000","last_change":"2023-10-03T19:20:15.964945+0000","last_active":"2023-10-03T19:20:17.329921+0000","last_peered":"2023-10-03T19:20:17.329921+0000","last_clean":"2023-10-03T19:20:17.329921+0000","last_became_active":"2023-10-03T19:20:15.963013+0000","last_became_peered":"2023-10-03T19:20:15.963013+0000","last_unstale":"2023-10-03T19:20:17.329921+0000","last_undegraded":"2023-10-03T19:20:17.329921+0000","last_fullsized":"2023-10-03T19:20:17.329921+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:58:07.182707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.388513+0000","last_change":"2023-10-03T19:20:16.366914+0000","last_active":"2023-10-03T19:20:16.388513+0000","last_peered":"2023-10-03T19:20:16.388513+0000","last_clean":"2023-10-03T19:20:16.388513+0000","last_became_active":"2023-10-03T19:20:16.366399+0000","last_became_peered":"2023-10-03T19:20:16.366399+0000","last_unstale":"2023-10-03T19:20:16.388513+0000","last_undegraded":"2023-10-03T19:20:16.388513+0000","last_fullsized":"2023-10-03T19:20:16.388513+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:42:50.977022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.329780+0000","last_change":"2023-10-03T19:20:15.964082+0000","last_active":"2023-10-03T19:20:17.329780+0000","last_peered":"2023-10-03T19:20:17.329780+0000","last_clean":"2023-10-03T19:20:17.329780+0000","last_became_active":"2023-10-03T19:20:15.963061+0000","last_became_peered":"2023-10-03T19:20:15.963061+0000","last_unstale":"2023-10-03T19:20:17.329780+0000","last_undegraded":"2023-10-03T19:20:17.329780+0000","last_fullsized":"2023-10-03T19:20:17.329780+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:48:54.530229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.319098+0000","last_change":"2023-10-03T19:20:16.356943+0000","last_active":"2023-10-03T19:20:17.319098+0000","last_peered":"2023-10-03T19:20:17.319098+0000","last_clean":"2023-10-03T19:20:17.319098+0000","last_became_active":"2023-10-03T19:20:16.356724+0000","last_became_peered":"2023-10-03T19:20:16.356724+0000","last_unstale":"2023-10-03T19:20:17.319098+0000","last_undegraded":"2023-10-03T19:20:17.319098+0000","last_fullsized":"2023-10-03T19:20:17.319098+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:39:11.226990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.428638+0000","last_change":"2023-10-03T19:20:15.950804+0000","last_active":"2023-10-03T19:20:17.428638+0000","last_peered":"2023-10-03T19:20:17.428638+0000","last_clean":"2023-10-03T19:20:17.428638+0000","last_became_active":"2023-10-03T19:20:15.949850+0000","last_became_peered":"2023-10-03T19:20:15.949850+0000","last_unstale":"2023-10-03T19:20:17.428638+0000","last_undegraded":"2023-10-03T19:20:17.428638+0000","last_fullsized":"2023-10-03T19:20:17.428638+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:22:47.665712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427510+0000","last_change":"2023-10-03T19:20:16.335345+0000","last_active":"2023-10-03T19:20:17.427510+0000","last_peered":"2023-10-03T19:20:17.427510+0000","last_clean":"2023-10-03T19:20:17.427510+0000","last_became_active":"2023-10-03T19:20:16.335141+0000","last_became_peered":"2023-10-03T19:20:16.335141+0000","last_unstale":"2023-10-03T19:20:17.427510+0000","last_undegraded":"2023-10-03T19:20:17.427510+0000","last_fullsized":"2023-10-03T19:20:17.427510+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:15:10.493042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.330713+0000","last_change":"2023-10-03T19:20:15.951459+0000","last_active":"2023-10-03T19:20:16.330713+0000","last_peered":"2023-10-03T19:20:16.330713+0000","last_clean":"2023-10-03T19:20:16.330713+0000","last_became_active":"2023-10-03T19:20:15.950750+0000","last_became_peered":"2023-10-03T19:20:15.950750+0000","last_unstale":"2023-10-03T19:20:16.330713+0000","last_undegraded":"2023-10-03T19:20:16.330713+0000","last_fullsized":"2023-10-03T19:20:16.330713+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:32:44.255176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.312349+0000","last_change":"2023-10-03T19:20:16.312349+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.312349+0000","last_undegraded":"2023-10-03T19:20:16.312349+0000","last_fullsized":"2023-10-03T19:20:16.312349+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:27:20.469549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.333339+0000","last_change":"2023-10-03T19:20:15.957097+0000","last_active":"2023-10-03T19:20:16.333339+0000","last_peered":"2023-10-03T19:20:16.333339+0000","last_clean":"2023-10-03T19:20:16.333339+0000","last_became_active":"2023-10-03T19:20:15.956382+0000","last_became_peered":"2023-10-03T19:20:15.956382+0000","last_unstale":"2023-10-03T19:20:16.333339+0000","last_undegraded":"2023-10-03T19:20:16.333339+0000","last_fullsized":"2023-10-03T19:20:16.333339+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:48:45.233305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.388531+0000","last_change":"2023-10-03T19:20:16.366911+0000","last_active":"2023-10-03T19:20:16.388531+0000","last_peered":"2023-10-03T19:20:16.388531+0000","last_clean":"2023-10-03T19:20:16.388531+0000","last_became_active":"2023-10-03T19:20:16.366000+0000","last_became_peered":"2023-10-03T19:20:16.366000+0000","last_unstale":"2023-10-03T19:20:16.388531+0000","last_undegraded":"2023-10-03T19:20:16.388531+0000","last_fullsized":"2023-10-03T19:20:16.388531+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:20:23.512066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.428211+0000","last_change":"2023-10-03T19:20:15.950221+0000","last_active":"2023-10-03T19:20:17.428211+0000","last_peered":"2023-10-03T19:20:17.428211+0000","last_clean":"2023-10-03T19:20:17.428211+0000","last_became_active":"2023-10-03T19:20:15.949702+0000","last_became_peered":"2023-10-03T19:20:15.949702+0000","last_unstale":"2023-10-03T19:20:17.428211+0000","last_undegraded":"2023-10-03T19:20:17.428211+0000","last_fullsized":"2023-10-03T19:20:17.428211+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:48:28.421358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.368478+0000","last_change":"2023-10-03T19:20:16.367493+0000","last_active":"2023-10-03T19:20:16.368478+0000","last_peered":"2023-10-03T19:20:16.368478+0000","last_clean":"2023-10-03T19:20:16.368478+0000","last_became_active":"2023-10-03T19:20:16.367200+0000","last_became_peered":"2023-10-03T19:20:16.367200+0000","last_unstale":"2023-10-03T19:20:16.368478+0000","last_undegraded":"2023-10-03T19:20:16.368478+0000","last_fullsized":"2023-10-03T19:20:16.368478+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:38:21.268252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.334197+0000","last_change":"2023-10-03T19:20:15.976449+0000","last_active":"2023-10-03T19:20:16.334197+0000","last_peered":"2023-10-03T19:20:16.334197+0000","last_clean":"2023-10-03T19:20:16.334197+0000","last_became_active":"2023-10-03T19:20:15.975751+0000","last_became_peered":"2023-10-03T19:20:15.975751+0000","last_unstale":"2023-10-03T19:20:16.334197+0000","last_undegraded":"2023-10-03T19:20:16.334197+0000","last_fullsized":"2023-10-03T19:20:16.334197+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:44:51.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.390675+0000","last_change":"2023-10-03T19:20:16.378686+0000","last_active":"2023-10-03T19:20:16.390675+0000","last_peered":"2023-10-03T19:20:16.390675+0000","last_clean":"2023-10-03T19:20:16.390675+0000","last_became_active":"2023-10-03T19:20:16.377931+0000","last_became_peered":"2023-10-03T19:20:16.377931+0000","last_unstale":"2023-10-03T19:20:16.390675+0000","last_undegraded":"2023-10-03T19:20:16.390675+0000","last_fullsized":"2023-10-03T19:20:16.390675+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:51:26.296530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"108'8","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.314937+0000","last_change":"2023-10-03T19:20:15.968516+0000","last_active":"2023-10-03T19:20:16.314937+0000","last_peered":"2023-10-03T19:20:16.314937+0000","last_clean":"2023-10-03T19:20:16.314937+0000","last_became_active":"2023-10-03T19:20:15.967958+0000","last_became_peered":"2023-10-03T19:20:15.967958+0000","last_unstale":"2023-10-03T19:20:16.314937+0000","last_undegraded":"2023-10-03T19:20:16.314937+0000","last_fullsized":"2023-10-03T19:20:16.314937+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:25:54.232755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":332,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.334710+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:20:16.334710+0000","last_peered":"2023-10-03T19:20:16.334710+0000","last_clean":"2023-10-03T19:20:16.334710+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:20:16.334710+0000","last_undegraded":"2023-10-03T19:20:16.334710+0000","last_fullsized":"2023-10-03T19:20:16.334710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:11:06.488375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.327849+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:20:17.327849+0000","last_peered":"2023-10-03T19:20:17.327849+0000","last_clean":"2023-10-03T19:20:17.327849+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:20:17.327849+0000","last_undegraded":"2023-10-03T19:20:17.327849+0000","last_fullsized":"2023-10-03T19:20:17.327849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:48:08.284624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328782+0000","last_change":"2023-10-03T19:20:16.356061+0000","last_active":"2023-10-03T19:20:17.328782+0000","last_peered":"2023-10-03T19:20:17.328782+0000","last_clean":"2023-10-03T19:20:17.328782+0000","last_became_active":"2023-10-03T19:20:16.355199+0000","last_became_peered":"2023-10-03T19:20:16.355199+0000","last_unstale":"2023-10-03T19:20:17.328782+0000","last_undegraded":"2023-10-03T19:20:17.328782+0000","last_fullsized":"2023-10-03T19:20:17.328782+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:07:54.083803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"108'2","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.319323+0000","last_change":"2023-10-03T19:20:15.969199+0000","last_active":"2023-10-03T19:20:16.319323+0000","last_peered":"2023-10-03T19:20:16.319323+0000","last_clean":"2023-10-03T19:20:16.319323+0000","last_became_active":"2023-10-03T19:20:15.966849+0000","last_became_peered":"2023-10-03T19:20:15.966849+0000","last_unstale":"2023-10-03T19:20:16.319323+0000","last_undegraded":"2023-10-03T19:20:16.319323+0000","last_fullsized":"2023-10-03T19:20:16.319323+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:47:59.812937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":180,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.343563+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:20:16.343563+0000","last_peered":"2023-10-03T19:20:16.343563+0000","last_clean":"2023-10-03T19:20:16.343563+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:20:16.343563+0000","last_undegraded":"2023-10-03T19:20:16.343563+0000","last_fullsized":"2023-10-03T19:20:16.343563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:37:17.443617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.368589+0000","last_change":"2023-10-03T19:20:16.367501+0000","last_active":"2023-10-03T19:20:16.368589+0000","last_peered":"2023-10-03T19:20:16.368589+0000","last_clean":"2023-10-03T19:20:16.368589+0000","last_became_active":"2023-10-03T19:20:16.367248+0000","last_became_peered":"2023-10-03T19:20:16.367248+0000","last_unstale":"2023-10-03T19:20:16.368589+0000","last_undegraded":"2023-10-03T19:20:16.368589+0000","last_fullsized":"2023-10-03T19:20:16.368589+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:10:29.134502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.319316+0000","last_change":"2023-10-03T19:20:15.967698+0000","last_active":"2023-10-03T19:20:16.319316+0000","last_peered":"2023-10-03T19:20:16.319316+0000","last_clean":"2023-10-03T19:20:16.319316+0000","last_became_active":"2023-10-03T19:20:15.967254+0000","last_became_peered":"2023-10-03T19:20:15.967254+0000","last_unstale":"2023-10-03T19:20:16.319316+0000","last_undegraded":"2023-10-03T19:20:16.319316+0000","last_fullsized":"2023-10-03T19:20:16.319316+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:16:20.254315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":178,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.318094+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:20:17.318094+0000","last_peered":"2023-10-03T19:20:17.318094+0000","last_clean":"2023-10-03T19:20:17.318094+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:20:17.318094+0000","last_undegraded":"2023-10-03T19:20:17.318094+0000","last_fullsized":"2023-10-03T19:20:17.318094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:09:08.659807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.318441+0000","last_change":"2023-10-03T19:20:16.331087+0000","last_active":"2023-10-03T19:20:17.318441+0000","last_peered":"2023-10-03T19:20:17.318441+0000","last_clean":"2023-10-03T19:20:17.318441+0000","last_became_active":"2023-10-03T19:20:16.330789+0000","last_became_peered":"2023-10-03T19:20:16.330789+0000","last_unstale":"2023-10-03T19:20:17.318441+0000","last_undegraded":"2023-10-03T19:20:17.318441+0000","last_fullsized":"2023-10-03T19:20:17.318441+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:59:08.307318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.315395+0000","last_change":"2023-10-03T19:20:15.963326+0000","last_active":"2023-10-03T19:20:16.315395+0000","last_peered":"2023-10-03T19:20:16.315395+0000","last_clean":"2023-10-03T19:20:16.315395+0000","last_became_active":"2023-10-03T19:20:15.962683+0000","last_became_peered":"2023-10-03T19:20:15.962683+0000","last_unstale":"2023-10-03T19:20:16.315395+0000","last_undegraded":"2023-10-03T19:20:16.315395+0000","last_fullsized":"2023-10-03T19:20:16.315395+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:32:44.255176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.327053+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:20:17.327053+0000","last_peered":"2023-10-03T19:20:17.327053+0000","last_clean":"2023-10-03T19:20:17.327053+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:20:17.327053+0000","last_undegraded":"2023-10-03T19:20:17.327053+0000","last_fullsized":"2023-10-03T19:20:17.327053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:13:16.390162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.329037+0000","last_change":"2023-10-03T19:20:16.379445+0000","last_active":"2023-10-03T19:20:17.329037+0000","last_peered":"2023-10-03T19:20:17.329037+0000","last_clean":"2023-10-03T19:20:17.329037+0000","last_became_active":"2023-10-03T19:20:16.378708+0000","last_became_peered":"2023-10-03T19:20:16.378708+0000","last_unstale":"2023-10-03T19:20:17.329037+0000","last_undegraded":"2023-10-03T19:20:17.329037+0000","last_fullsized":"2023-10-03T19:20:17.329037+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:36:26.181089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.330048+0000","last_change":"2023-10-03T19:20:15.964353+0000","last_active":"2023-10-03T19:20:17.330048+0000","last_peered":"2023-10-03T19:20:17.330048+0000","last_clean":"2023-10-03T19:20:17.330048+0000","last_became_active":"2023-10-03T19:20:15.963577+0000","last_became_peered":"2023-10-03T19:20:15.963577+0000","last_unstale":"2023-10-03T19:20:17.330048+0000","last_undegraded":"2023-10-03T19:20:17.330048+0000","last_fullsized":"2023-10-03T19:20:17.330048+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:44:59.894758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":172,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.331800+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:20:16.331800+0000","last_peered":"2023-10-03T19:20:16.331800+0000","last_clean":"2023-10-03T19:20:16.331800+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:20:16.331800+0000","last_undegraded":"2023-10-03T19:20:16.331800+0000","last_fullsized":"2023-10-03T19:20:16.331800+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:45:55.749619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328196+0000","last_change":"2023-10-03T19:20:16.360159+0000","last_active":"2023-10-03T19:20:17.328196+0000","last_peered":"2023-10-03T19:20:17.328196+0000","last_clean":"2023-10-03T19:20:17.328196+0000","last_became_active":"2023-10-03T19:20:16.359303+0000","last_became_peered":"2023-10-03T19:20:16.359303+0000","last_unstale":"2023-10-03T19:20:17.328196+0000","last_undegraded":"2023-10-03T19:20:17.328196+0000","last_fullsized":"2023-10-03T19:20:17.328196+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:01:13.570148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328583+0000","last_change":"2023-10-03T19:20:15.953426+0000","last_active":"2023-10-03T19:20:17.328583+0000","last_peered":"2023-10-03T19:20:17.328583+0000","last_clean":"2023-10-03T19:20:17.328583+0000","last_became_active":"2023-10-03T19:20:15.952566+0000","last_became_peered":"2023-10-03T19:20:15.952566+0000","last_unstale":"2023-10-03T19:20:17.328583+0000","last_undegraded":"2023-10-03T19:20:17.328583+0000","last_fullsized":"2023-10-03T19:20:17.328583+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:25:56.771799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":180,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.333768+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:20:16.333768+0000","last_peered":"2023-10-03T19:20:16.333768+0000","last_clean":"2023-10-03T19:20:16.333768+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:20:16.333768+0000","last_undegraded":"2023-10-03T19:20:16.333768+0000","last_fullsized":"2023-10-03T19:20:16.333768+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:51:39.452487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.312904+0000","last_change":"2023-10-03T19:20:16.312904+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.312904+0000","last_undegraded":"2023-10-03T19:20:16.312904+0000","last_fullsized":"2023-10-03T19:20:16.312904+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:41:46.307896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"108'3","reported_seq":16,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328281+0000","last_change":"2023-10-03T19:20:15.972534+0000","last_active":"2023-10-03T19:20:17.328281+0000","last_peered":"2023-10-03T19:20:17.328281+0000","last_clean":"2023-10-03T19:20:17.328281+0000","last_became_active":"2023-10-03T19:20:15.971724+0000","last_became_peered":"2023-10-03T19:20:15.971724+0000","last_unstale":"2023-10-03T19:20:17.328281+0000","last_undegraded":"2023-10-03T19:20:17.328281+0000","last_fullsized":"2023-10-03T19:20:17.328281+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:30:57.635979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":172,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.327393+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:20:16.327393+0000","last_peered":"2023-10-03T19:20:16.327393+0000","last_clean":"2023-10-03T19:20:16.327393+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:20:16.327393+0000","last_undegraded":"2023-10-03T19:20:16.327393+0000","last_fullsized":"2023-10-03T19:20:16.327393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:38:41.426039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328937+0000","last_change":"2023-10-03T19:20:16.367253+0000","last_active":"2023-10-03T19:20:17.328937+0000","last_peered":"2023-10-03T19:20:17.328937+0000","last_clean":"2023-10-03T19:20:17.328937+0000","last_became_active":"2023-10-03T19:20:16.366622+0000","last_became_peered":"2023-10-03T19:20:16.366622+0000","last_unstale":"2023-10-03T19:20:17.328937+0000","last_undegraded":"2023-10-03T19:20:17.328937+0000","last_fullsized":"2023-10-03T19:20:17.328937+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:09:15.902309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"108'5","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.315568+0000","last_change":"2023-10-03T19:20:15.962877+0000","last_active":"2023-10-03T19:20:16.315568+0000","last_peered":"2023-10-03T19:20:16.315568+0000","last_clean":"2023-10-03T19:20:16.315568+0000","last_became_active":"2023-10-03T19:20:15.962063+0000","last_became_peered":"2023-10-03T19:20:15.962063+0000","last_unstale":"2023-10-03T19:20:16.315568+0000","last_undegraded":"2023-10-03T19:20:16.315568+0000","last_fullsized":"2023-10-03T19:20:16.315568+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:44:05.865560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.330163+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:20:17.330163+0000","last_peered":"2023-10-03T19:20:17.330163+0000","last_clean":"2023-10-03T19:20:17.330163+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:20:17.330163+0000","last_undegraded":"2023-10-03T19:20:17.330163+0000","last_fullsized":"2023-10-03T19:20:17.330163+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:17:59.521194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":1470,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509538,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34160,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":32768,"kb_avail":94337680,"statfs":{"total":96636764160,"available":96601784320,"internally_reserved":0,"allocated":1417216,"data_stored":1203428,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":33554432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.85899999999999999,"15min":0.92700000000000005},"min":{"1min":0.66300000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1950000000000001,"5min":1.206,"15min":4.0469999999999997},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.85299999999999998,"15min":0.82099999999999995},"min":{"1min":0.55200000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.177,"5min":1.2310000000000001,"15min":1.3420000000000001},"last":1.2230000000000001}]},{"osd":1,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.86299999999999999,"15min":0.98599999999999999},"min":{"1min":0.61899999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1359999999999999,"5min":1.3200000000000001,"15min":3.8239999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.89800000000000002,"15min":0.87},"min":{"1min":0.64500000000000002,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.91100000000000003}]},{"osd":2,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.95899999999999996,"15min":0.88400000000000001},"min":{"1min":0.55300000000000005,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1719999999999999,"5min":6.0449999999999999,"15min":6.0449999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.94199999999999995,"15min":1.0109999999999999},"min":{"1min":0.69999999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.296,"5min":1.5800000000000001,"15min":3.98},"last":1.161}]},{"osd":3,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.034,"15min":0.95799999999999996},"min":{"1min":0.68500000000000005,"5min":0.63800000000000001,"15min":0.51100000000000001},"max":{"1min":1.232,"5min":6.125,"15min":6.125},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.97599999999999998,"15min":1.0840000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.175,"5min":1.444,"15min":3.9140000000000001},"last":1.2509999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.89800000000000002,"15min":1.0920000000000001},"min":{"1min":0.61599999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":5.1130000000000004},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.016,"15min":1.018},"min":{"1min":0.70699999999999996,"5min":0.629,"15min":0.629},"max":{"1min":1.214,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":1.107}]},{"osd":5,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.006,"15min":1.2010000000000001},"min":{"1min":0.63700000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2470000000000001,"5min":1.349,"15min":5.1859999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.0209999999999999,"15min":1.115},"min":{"1min":0.69299999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.29,"5min":1.2949999999999999,"15min":2.0609999999999999},"last":1.133}]},{"osd":6,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0740000000000001,"15min":1.093},"min":{"1min":0.80000000000000004,"5min":0.75700000000000001,"15min":0.69399999999999995},"max":{"1min":1.3839999999999999,"5min":1.4890000000000001,"15min":1.5449999999999999},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.1459999999999999,"15min":1.167},"min":{"1min":0.77800000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.232,"5min":6.1580000000000004,"15min":6.1580000000000004},"last":1.2}]}]},{"osd":6,"up_from":15,"seq":64424509538,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":30144,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":1335296,"data_stored":611702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30867456},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.84599999999999997,"15min":0.82699999999999996},"min":{"1min":0.54100000000000004,"5min":0.45400000000000001,"15min":0.44600000000000001},"max":{"1min":1.234,"5min":1.3340000000000001,"15min":1.504},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.91100000000000003,"15min":0.88900000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.44600000000000001},"max":{"1min":1.1080000000000001,"5min":1.423,"15min":1.839},"last":0.91200000000000003}]},{"osd":1,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.86699999999999999,"15min":0.84699999999999998},"min":{"1min":0.56000000000000005,"5min":0.52100000000000002,"15min":0.504},"max":{"1min":1.1859999999999999,"5min":1.27,"15min":2.0150000000000001},"last":0.751},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.88900000000000001,"15min":0.88200000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.161,"5min":1.448,"15min":1.448},"last":0.70399999999999996}]},{"osd":2,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.93799999999999994,"15min":0.88900000000000001},"min":{"1min":0.66400000000000003,"5min":0.59199999999999997,"15min":0.51900000000000002},"max":{"1min":1.4430000000000001,"5min":1.528,"15min":1.528},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.92700000000000005,"15min":0.92500000000000004},"min":{"1min":0.60899999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1519999999999999,"5min":1.369,"15min":1.546},"last":0.81299999999999994}]},{"osd":3,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.96299999999999997,"15min":0.97899999999999998},"min":{"1min":0.68899999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.298,"5min":1.377,"15min":1.6990000000000001},"last":1.1299999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90700000000000003,"15min":0.90800000000000003},"min":{"1min":0.70199999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.143,"5min":1.206,"15min":2.121},"last":0.86899999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.91600000000000004,"15min":0.998},"min":{"1min":0.67400000000000004,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.335,"5min":1.339,"15min":1.95},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.995,"15min":1.0680000000000001},"min":{"1min":0.64400000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4490000000000001,"5min":1.504,"15min":1.7709999999999999},"last":1.0069999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.90700000000000003,"15min":0.99199999999999999},"min":{"1min":0.624,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.226,"5min":1.3200000000000001,"15min":2.2570000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.048,"15min":1.103},"min":{"1min":0.71799999999999997,"5min":0.68300000000000005,"15min":0.68100000000000005},"max":{"1min":1.5009999999999999,"5min":1.524,"15min":2.0619999999999998},"last":1.1579999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.071,"15min":1.109},"min":{"1min":0.748,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.639,"5min":1.639,"15min":2.0049999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.032,"5min":1.044,"15min":1.0820000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.61899999999999999},"max":{"1min":1.3879999999999999,"5min":1.4350000000000001,"15min":2.4249999999999998},"last":1.2}]}]},{"osd":4,"up_from":15,"seq":64424509539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42540,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":41216,"kb_avail":94329300,"statfs":{"total":96636764160,"available":96593203200,"internally_reserved":0,"allocated":1347584,"data_stored":613848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":42205184},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":1.0600000000000001,"15min":0.875},"min":{"1min":0.64200000000000002,"5min":0.54700000000000004,"15min":0.50600000000000001},"max":{"1min":1.0600000000000001,"5min":17.686,"15min":17.686},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.90100000000000002,"5min":1.02,"15min":0.89000000000000001},"min":{"1min":0.64000000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.28,"5min":16.925999999999998,"15min":16.925999999999998},"last":0.86699999999999999}]},{"osd":1,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.085,"15min":0.98499999999999999},"min":{"1min":0.67700000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1759999999999999,"5min":16.640999999999998,"15min":16.640999999999998},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.91300000000000003,"5min":1.089,"15min":0.93400000000000005},"min":{"1min":0.67300000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.151,"5min":17.59,"15min":17.59},"last":1.0269999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.997,"15min":0.94299999999999995},"min":{"1min":0.70699999999999996,"5min":0.56200000000000006,"15min":0.53200000000000003},"max":{"1min":1.1180000000000001,"5min":8.5630000000000006,"15min":8.5630000000000006},"last":1.286},{"interface":"front","average":{"1min":0.93999999999999995,"5min":1.143,"15min":1.01},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.175,"5min":17.734000000000002,"15min":17.734000000000002},"last":1.1970000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.0880000000000001,"15min":0.94299999999999995},"min":{"1min":0.72499999999999998,"5min":0.61499999999999999,"15min":0.53900000000000003},"max":{"1min":1.242,"5min":16.98,"15min":16.98},"last":1.3740000000000001},{"interface":"front","average":{"1min":0.997,"5min":1.161,"15min":1.105},"min":{"1min":0.66900000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2789999999999999,"5min":16.434000000000001,"15min":16.434000000000001},"last":1.4099999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":1.1020000000000001,"15min":1.0820000000000001},"min":{"1min":0.624,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.143,"5min":17.782,"15min":17.782},"last":1.3360000000000001},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.96599999999999997,"15min":1.002},"min":{"1min":0.65700000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.264,"5min":1.708,"15min":1.708},"last":1.48}]},{"osd":6,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.3859999999999999,"15min":1.27},"min":{"1min":0.66000000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.2250000000000001,"5min":36.106000000000002,"15min":36.106000000000002},"last":1.6910000000000001},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.2450000000000001,"15min":1.216},"min":{"1min":0.86099999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.2410000000000001,"5min":17.646999999999998,"15min":17.646999999999998},"last":1.4530000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.226,"15min":1.1359999999999999},"min":{"1min":0.81200000000000006,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.421,"5min":17.042000000000002,"15min":17.042000000000002},"last":1.6519999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.3,"15min":1.262},"min":{"1min":0.83199999999999996,"5min":0.66400000000000003,"15min":0.63300000000000001},"max":{"1min":1.4670000000000001,"5min":16.32,"15min":16.32},"last":1.5429999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509539,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":31616,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1331200,"data_stored":611120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":32374784},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.79100000000000004,"15min":0.61299999999999999},"min":{"1min":0.47799999999999998,"5min":0.32200000000000001,"15min":0.247},"max":{"1min":0.98199999999999998,"5min":13.629,"15min":13.629},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":1.206,"15min":0.80900000000000005},"min":{"1min":0.34000000000000002,"5min":0.30299999999999999,"15min":0.28999999999999998},"max":{"1min":0.97199999999999998,"5min":40.439,"15min":40.439},"last":0.91400000000000003}]},{"osd":1,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.90200000000000002,"15min":0.71099999999999997},"min":{"1min":0.47899999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1,"5min":14.074,"15min":14.074},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.78500000000000003,"15min":0.64900000000000002},"min":{"1min":0.38800000000000001,"5min":0.34799999999999998,"15min":0.26400000000000001},"max":{"1min":1.1080000000000001,"5min":7.0060000000000002,"15min":7.0060000000000002},"last":0.57899999999999996}]},{"osd":3,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.90000000000000002,"15min":0.71299999999999997},"min":{"1min":0.36699999999999999,"5min":0.28899999999999998,"15min":0.224},"max":{"1min":1.05,"5min":13.423999999999999,"15min":13.423999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.0649999999999999,"15min":0.82899999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.36399999999999999},"max":{"1min":1.1220000000000001,"5min":18.568999999999999,"15min":18.568999999999999},"last":0.65100000000000002}]},{"osd":4,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.94999999999999996,"15min":0.878},"min":{"1min":0.64200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.105,"5min":1.718,"15min":1.718},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.3380000000000001,"15min":1.05},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.22,"5min":28.667999999999999,"15min":28.667999999999999},"last":0.98599999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.0529999999999999,"15min":0.92100000000000004},"min":{"1min":0.67600000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.399,"5min":5.4459999999999997,"15min":5.4459999999999997},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.2230000000000001,"15min":1.0309999999999999},"min":{"1min":0.63300000000000001,"5min":0.57599999999999996,"15min":0.52700000000000002},"max":{"1min":1.4970000000000001,"5min":14.007,"15min":14.007},"last":0.84099999999999997}]},{"osd":6,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":1.1040000000000001,"15min":0.97099999999999997},"min":{"1min":0.65900000000000003,"5min":0.60099999999999998,"15min":0.49099999999999999},"max":{"1min":1.212,"5min":10.679,"15min":10.679},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.087,"15min":1.004},"min":{"1min":0.75600000000000001,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.325,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.1439999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.3240000000000001,"15min":1.1080000000000001},"min":{"1min":0.70299999999999996,"5min":0.63100000000000001,"15min":0.56100000000000005},"max":{"1min":1.415,"5min":18.623000000000001,"15min":18.623000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.0920000000000001,"15min":0.996},"min":{"1min":0.61699999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1850000000000001,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":1.016}]}]},{"osd":1,"up_from":15,"seq":64424509538,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31012,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":29696,"kb_avail":94340828,"statfs":{"total":96636764160,"available":96605007872,"internally_reserved":0,"allocated":1339392,"data_stored":612306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30408704},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59199999999999997,"15min":0.55600000000000005},"min":{"1min":0.27900000000000003,"5min":0.27200000000000002,"15min":0.26900000000000002},"max":{"1min":0.92100000000000004,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70399999999999996,"15min":0.56799999999999995},"min":{"1min":0.41799999999999998,"5min":0.27200000000000002,"15min":0.22900000000000001},"max":{"1min":1.1899999999999999,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.01}]},{"osd":2,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68300000000000005,"15min":0.58899999999999997},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.26200000000000001},"max":{"1min":0.879,"5min":1.506,"15min":1.506},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.82099999999999995,"15min":0.70599999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.312},"max":{"1min":1.1919999999999999,"5min":1.365,"15min":1.365},"last":0.89500000000000002}]},{"osd":3,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.76400000000000001,"15min":0.67300000000000004},"min":{"1min":0.36099999999999999,"5min":0.31,"15min":0.31},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.75700000000000001,"15min":0.63400000000000001},"min":{"1min":0.39100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.90700000000000003,"5min":1.232,"15min":1.27},"last":0.95299999999999996}]},{"osd":4,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.89000000000000001,"15min":0.82799999999999996},"min":{"1min":0.61199999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0860000000000001,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.98499999999999999,"15min":0.91400000000000003},"min":{"1min":0.69899999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3260000000000001,"5min":1.728,"15min":1.728},"last":0.77500000000000002}]},{"osd":5,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.98999999999999999,"15min":0.89500000000000002},"min":{"1min":0.60299999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.28,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.96299999999999997,"15min":0.88500000000000001},"min":{"1min":0.77300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.198,"5min":1.3959999999999999,"15min":1.6080000000000001},"last":0.74399999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0349999999999999,"15min":0.95399999999999996},"min":{"1min":0.59499999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2689999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.204},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0289999999999999,"15min":0.93400000000000005},"min":{"1min":0.66700000000000004,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3600000000000001,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.2470000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0669999999999999,"15min":0.97599999999999998},"min":{"1min":0.55100000000000005,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.292,"5min":1.673,"15min":1.673},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0289999999999999,"15min":0.93999999999999995},"min":{"1min":0.67500000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4379999999999999,"5min":1.5880000000000001,"15min":1.649},"last":1.1339999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542242,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25504,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":24192,"kb_avail":94346336,"statfs":{"total":96636764160,"available":96610648064,"internally_reserved":0,"allocated":1335296,"data_stored":612284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24772608},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.63200000000000001,"15min":0.58799999999999997},"min":{"1min":0.36399999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.96199999999999997,"5min":1.212,"15min":1.212},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.69999999999999996,"15min":0.66000000000000003},"min":{"1min":0.38900000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.5,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.82799999999999996}]},{"osd":1,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.70399999999999996,"15min":0.64800000000000002},"min":{"1min":0.42299999999999999,"5min":0.28599999999999998,"15min":0.27000000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76000000000000001,"15min":0.69099999999999995},"min":{"1min":0.34300000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.169,"5min":1.2210000000000001,"15min":1.222},"last":0.95899999999999996}]},{"osd":2,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.79400000000000004,"15min":0.73299999999999998},"min":{"1min":0.35999999999999999,"5min":0.317,"15min":0.317},"max":{"1min":1.1539999999999999,"5min":1.23,"15min":1.23},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73199999999999998,"15min":0.66000000000000003},"min":{"1min":0.371,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.05,"5min":1.671,"15min":1.671},"last":0.71599999999999997}]},{"osd":4,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.92000000000000004,"15min":0.91200000000000003},"min":{"1min":0.63900000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2949999999999999,"5min":1.411,"15min":1.496},"last":1.052},{"interface":"front","average":{"1min":1.006,"5min":1.018,"15min":0.95599999999999996},"min":{"1min":0.76400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3280000000000001,"5min":1.546,"15min":1.546},"last":1.085}]},{"osd":5,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.91200000000000003,"15min":0.88700000000000001},"min":{"1min":0.63300000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.095,"5min":1.581,"15min":1.581},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.022,"15min":1.004},"min":{"1min":0.68100000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4179999999999999,"5min":1.498,"15min":1.498},"last":1.173}]},{"osd":6,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.94599999999999995,"15min":0.92800000000000005},"min":{"1min":0.68799999999999994,"5min":0.56999999999999995,"15min":0.56699999999999995},"max":{"1min":1.212,"5min":1.347,"15min":1.347},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.05,"15min":1.006},"min":{"1min":0.80000000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.373,"5min":1.4970000000000001,"15min":1.5629999999999999},"last":1.1339999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.083,"15min":1.0289999999999999},"min":{"1min":0.70599999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.151},{"interface":"front","average":{"1min":1.109,"5min":1.0609999999999999,"15min":1.03},"min":{"1min":0.65300000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.659,"5min":1.659,"15min":1.708},"last":1.294}]}]},{"osd":5,"up_from":13,"seq":55834574946,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23284,"kb_used_data":1324,"kb_used_omap":0,"kb_used_meta":21952,"kb_avail":94348556,"statfs":{"total":96636764160,"available":96612921344,"internally_reserved":0,"allocated":1355776,"data_stored":619097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22478848},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.85799999999999998,"15min":0.83399999999999996},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.181,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.89400000000000002,"15min":0.86599999999999999},"min":{"1min":0.78200000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.26,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.70599999999999996}]},{"osd":1,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.872,"15min":0.84499999999999997},"min":{"1min":0.505,"5min":0.501,"15min":0.501},"max":{"1min":1.044,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.052},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.91000000000000003,"15min":0.92300000000000004},"min":{"1min":0.63100000000000001,"5min":0.58699999999999997,"15min":0.57099999999999995},"max":{"1min":1.23,"5min":1.23,"15min":1.514},"last":0.86099999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.91000000000000003,"15min":0.90300000000000002},"min":{"1min":0.625,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2010000000000001,"5min":1.351,"15min":1.3700000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.999,"5min":0.93000000000000005,"15min":0.90600000000000003},"min":{"1min":0.82499999999999996,"5min":0.57099999999999995,"15min":0.53300000000000003},"max":{"1min":1.1819999999999999,"5min":1.1930000000000001,"15min":1.3320000000000001},"last":0.76300000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.93600000000000005,"15min":0.93100000000000005},"min":{"1min":0.67700000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2210000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.046,"5min":1.03,"15min":1.028},"min":{"1min":0.78700000000000003,"5min":0.65900000000000003,"15min":0.61199999999999999},"max":{"1min":1.3129999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.99099999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.97499999999999998,"15min":0.97299999999999998},"min":{"1min":0.70699999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.2450000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.167},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96399999999999997,"15min":1.0129999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2749999999999999,"5min":1.335,"15min":1.7709999999999999},"last":1.2130000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.995,"15min":1.024},"min":{"1min":0.67000000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.204,"5min":1.546,"15min":1.546},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0880000000000001,"15min":1.1240000000000001},"min":{"1min":0.82499999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.3759999999999999,"5min":1.823,"15min":1.823},"last":1.2470000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0569999999999999,"15min":1.071},"min":{"1min":0.68700000000000006,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.5680000000000001},"last":1.302},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.119,"15min":1.143},"min":{"1min":0.86499999999999999,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.325,"5min":1.4179999999999999,"15min":1.9099999999999999},"last":1.1020000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574947,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30700,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":29312,"kb_avail":94341140,"statfs":{"total":96636764160,"available":96605327360,"internally_reserved":0,"allocated":1413120,"data_stored":1208163,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":30015488},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.69699999999999995,"15min":0.61399999999999999},"min":{"1min":0.502,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.92000000000000004,"5min":5.7480000000000002,"15min":5.7480000000000002},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.80900000000000005,"15min":0.746},"min":{"1min":0.54700000000000004,"5min":0.37,"15min":0.33000000000000002},"max":{"1min":1.0760000000000001,"5min":6.274,"15min":6.274},"last":0.81799999999999995}]},{"osd":2,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.81999999999999995,"15min":0.746},"min":{"1min":0.46700000000000003,"5min":0.36499999999999999,"15min":0.35399999999999998},"max":{"1min":0.97599999999999998,"5min":6.1609999999999996,"15min":6.1609999999999996},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71499999999999997,"15min":0.69899999999999995},"min":{"1min":0.44500000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.997,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.56399999999999995}]},{"osd":3,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.90800000000000003,"15min":0.78000000000000003},"min":{"1min":0.57499999999999996,"5min":0.41799999999999998,"15min":0.36799999999999999},"max":{"1min":1.1739999999999999,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":1.05},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82199999999999995,"15min":0.73199999999999998},"min":{"1min":0.53300000000000003,"5min":0.376,"15min":0.30299999999999999},"max":{"1min":1.0780000000000001,"5min":1.375,"15min":1.375},"last":0.79100000000000004}]},{"osd":4,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":1.0029999999999999,"15min":0.93600000000000005},"min":{"1min":0.71299999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.254,"5min":8.1159999999999997,"15min":8.1159999999999997},"last":1.01},{"interface":"front","average":{"1min":1.056,"5min":1.0860000000000001,"15min":1.0429999999999999},"min":{"1min":0.71199999999999997,"5min":0.57299999999999995,"15min":0.504},"max":{"1min":1.3440000000000001,"5min":6.2320000000000002,"15min":6.2320000000000002},"last":0.98099999999999998}]},{"osd":5,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.2549999999999999,"15min":1.1140000000000001},"min":{"1min":0.69199999999999995,"5min":0.59399999999999997,"15min":0.46899999999999997},"max":{"1min":1.4259999999999999,"5min":17.420000000000002,"15min":17.420000000000002},"last":1.143},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.222,"15min":1.052},"min":{"1min":0.74299999999999999,"5min":0.59499999999999997,"15min":0.54300000000000004},"max":{"1min":1.371,"5min":17.643000000000001,"15min":17.643000000000001},"last":1.0780000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0880000000000001,"15min":1.038},"min":{"1min":0.77500000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3520000000000001,"5min":5.7220000000000004,"15min":5.7220000000000004},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0669999999999999,"15min":1.0129999999999999},"min":{"1min":0.877,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.417,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.2110000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.159,"15min":1.0740000000000001},"min":{"1min":0.81299999999999994,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3939999999999999,"5min":5.7800000000000002,"15min":5.7800000000000002},"last":1.244},{"interface":"front","average":{"1min":1.091,"5min":1.0920000000000001,"15min":1.0669999999999999},"min":{"1min":0.85699999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.343,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.27}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:20:20.738 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:20:20.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.900+0000 7fe5a58c8640 1 Processor -- start 2023-10-03T19:20:20.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.900+0000 7fe5a58c8640 1 -- start start 2023-10-03T19:20:20.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.900+0000 7fe5a58c8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe5a014f240 0x7fe5a01528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:20.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.900+0000 7fe5a58c8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe5a00c2790 0x7fe5a00c0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:20.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.900+0000 7fe5a58c8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe5a00bb1d0 0x7fe5a00c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:20.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.900+0000 7fe5a58c8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a006b640 con 0x7fe5a00c2790 2023-10-03T19:20:20.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.900+0000 7fe5a58c8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a006b2d0 con 0x7fe5a014f240 2023-10-03T19:20:20.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.900+0000 7fe5a58c8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a00c0fa0 con 0x7fe5a00bb1d0 2023-10-03T19:20:20.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.900+0000 7fe59e7fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe5a00c2790 0x7fe5a00c0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:20.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.900+0000 7fe59e7fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe5a00c2790 0x7fe5a00c0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42938/0 (socket says 172.21.15.45:42938) 2023-10-03T19:20:20.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.900+0000 7fe59e7fc640 1 -- 172.21.15.45:0/1111338688 learned_addr learned my addr 172.21.15.45:0/1111338688 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:20.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.900+0000 7fe59f7fe640 1 --2- 172.21.15.45:0/1111338688 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe5a00bb1d0 0x7fe5a00c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:20.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.900+0000 7fe59effd640 1 --2- 172.21.15.45:0/1111338688 >> v2:172.21.15.79:3300/0 conn(0x7fe5a014f240 0x7fe5a01528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:20.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.900+0000 7fe59e7fc640 1 -- 172.21.15.45:0/1111338688 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe5a00bb1d0 msgr2=0x7fe5a00c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:20.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.900+0000 7fe59e7fc640 1 --2- 172.21.15.45:0/1111338688 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe5a00bb1d0 0x7fe5a00c12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.900+0000 7fe59e7fc640 1 -- 172.21.15.45:0/1111338688 >> v2:172.21.15.79:3300/0 conn(0x7fe5a014f240 msgr2=0x7fe5a01528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:20.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.900+0000 7fe59e7fc640 1 --2- 172.21.15.45:0/1111338688 >> v2:172.21.15.79:3300/0 conn(0x7fe5a014f240 0x7fe5a01528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.900+0000 7fe59e7fc640 1 -- 172.21.15.45:0/1111338688 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a00a3c60 con 0x7fe5a00c2790 2023-10-03T19:20:20.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.900+0000 7fe59effd640 1 --2- 172.21.15.45:0/1111338688 >> v2:172.21.15.79:3300/0 conn(0x7fe5a014f240 0x7fe5a01528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:20.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe59e7fc640 1 --2- 172.21.15.45:0/1111338688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5a00c2790 0x7fe5a00c0a60 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00c47f0 tx=0x7fe59401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b94ac238d292aa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:20.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe59dffb640 1 -- 172.21.15.45:0/1111338688 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5940a89b0 con 0x7fe5a00c2790 2023-10-03T19:20:20.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe59dffb640 1 -- 172.21.15.45:0/1111338688 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5940a8b10 con 0x7fe5a00c2790 2023-10-03T19:20:20.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe59dffb640 1 -- 172.21.15.45:0/1111338688 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5940a8ea0 con 0x7fe5a00c2790 2023-10-03T19:20:20.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe5a58c8640 1 -- 172.21.15.45:0/1111338688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5a00c2790 msgr2=0x7fe5a00c0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:20.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe5a58c8640 1 --2- 172.21.15.45:0/1111338688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5a00c2790 0x7fe5a00c0a60 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00c47f0 tx=0x7fe59401ecf0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe5a58c8640 1 -- 172.21.15.45:0/1111338688 shutdown_connections 2023-10-03T19:20:20.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe5a58c8640 1 --2- 172.21.15.45:0/1111338688 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe5a00bb1d0 0x7fe5a00c12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe5a58c8640 1 --2- 172.21.15.45:0/1111338688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5a00c2790 0x7fe5a00c0a60 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe5a58c8640 1 --2- 172.21.15.45:0/1111338688 >> v2:172.21.15.79:3300/0 conn(0x7fe5a014f240 0x7fe5a01528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe5a58c8640 1 -- 172.21.15.45:0/1111338688 >> 172.21.15.45:0/1111338688 conn(0x7fe5a00a64a0 msgr2=0x7fe5a00a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:20.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe5a58c8640 1 -- 172.21.15.45:0/1111338688 shutdown_connections 2023-10-03T19:20:20.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe5a58c8640 1 -- 172.21.15.45:0/1111338688 wait complete. 2023-10-03T19:20:20.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe5a58c8640 1 Processor -- start 2023-10-03T19:20:20.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe5a58c8640 1 -- start start 2023-10-03T19:20:20.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe5a58c8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5a00bb1d0 0x7fe5a014fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:20.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe5a58c8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe5a00c2790 0x7fe5a00a7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:20.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe5a58c8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5a014f240 0x7fe5a00a92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:20.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe5a58c8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a014aca0 con 0x7fe5a014f240 2023-10-03T19:20:20.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe5a58c8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a014a9b0 con 0x7fe5a00bb1d0 2023-10-03T19:20:20.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe5a58c8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a0151440 con 0x7fe5a00c2790 2023-10-03T19:20:20.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe59f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5a014f240 0x7fe5a00a92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:20.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe59f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5a014f240 0x7fe5a00a92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42954/0 (socket says 172.21.15.45:42954) 2023-10-03T19:20:20.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe59f7fe640 1 -- 172.21.15.45:0/1269541485 learned_addr learned my addr 172.21.15.45:0/1269541485 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:20.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe59e7fc640 1 --2- 172.21.15.45:0/1269541485 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe5a00c2790 0x7fe5a00a7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:20.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe59effd640 1 --2- 172.21.15.45:0/1269541485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5a00bb1d0 0x7fe5a014fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:20.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe59f7fe640 1 -- 172.21.15.45:0/1269541485 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe5a00c2790 msgr2=0x7fe5a00a7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe59f7fe640 1 --2- 172.21.15.45:0/1269541485 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe5a00c2790 0x7fe5a00a7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe59f7fe640 1 -- 172.21.15.45:0/1269541485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5a00bb1d0 msgr2=0x7fe5a014fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe59f7fe640 1 --2- 172.21.15.45:0/1269541485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5a00bb1d0 0x7fe5a014fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe59f7fe640 1 -- 172.21.15.45:0/1269541485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe594009480 con 0x7fe5a014f240 2023-10-03T19:20:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe59f7fe640 1 --2- 172.21.15.45:0/1269541485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5a014f240 0x7fe5a00a92d0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fe598007e90 tx=0x7fe59800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe587fff640 1 -- 172.21.15.45:0/1269541485 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe598014420 con 0x7fe5a014f240 2023-10-03T19:20:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe587fff640 1 -- 172.21.15.45:0/1269541485 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5980145a0 con 0x7fe5a014f240 2023-10-03T19:20:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe587fff640 1 -- 172.21.15.45:0/1269541485 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe598014950 con 0x7fe5a014f240 2023-10-03T19:20:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.904+0000 7fe5a58c8640 1 -- 172.21.15.45:0/1269541485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a00a3f40 con 0x7fe5a014f240 2023-10-03T19:20:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.908+0000 7fe5a58c8640 1 -- 172.21.15.45:0/1269541485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a014e740 con 0x7fe5a014f240 2023-10-03T19:20:20.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.908+0000 7fe5a58c8640 1 -- 172.21.15.45:0/1269541485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a014f610 con 0x7fe5a014f240 2023-10-03T19:20:20.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.908+0000 7fe587fff640 1 -- 172.21.15.45:0/1269541485 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe598014ab0 con 0x7fe5a014f240 2023-10-03T19:20:20.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.908+0000 7fe587fff640 1 --2- 172.21.15.45:0/1269541485 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe58c0662b0 0x7fe58c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:20.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.908+0000 7fe587fff640 1 -- 172.21.15.45:0/1269541485 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe598084570 con 0x7fe5a014f240 2023-10-03T19:20:20.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.908+0000 7fe59effd640 1 --2- 172.21.15.45:0/1269541485 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe58c0662b0 0x7fe58c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:20.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.908+0000 7fe59effd640 1 --2- 172.21.15.45:0/1269541485 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe58c0662b0 0x7fe58c068760 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe59000a950 tx=0x7fe590008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:20.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:20.912+0000 7fe587fff640 1 -- 172.21.15.45:0/1269541485 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe598051a80 con 0x7fe5a014f240 2023-10-03T19:20:21.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.072+0000 7fe5a58c8640 1 -- 172.21.15.45:0/1269541485 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe5a00bfa90 con 0x7fe58c0662b0 2023-10-03T19:20:21.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.096+0000 7fe587fff640 1 -- 172.21.15.45:0/1269541485 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310114 (secure 0 0 0) 0x7fe5a00bfa90 con 0x7fe58c0662b0 2023-10-03T19:20:21.100 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:20:21.102 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:20:21.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.096+0000 7fe5a58c8640 1 -- 172.21.15.45:0/1269541485 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe58c0662b0 msgr2=0x7fe58c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:21.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.096+0000 7fe5a58c8640 1 --2- 172.21.15.45:0/1269541485 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe58c0662b0 0x7fe58c068760 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe59000a950 tx=0x7fe590008040 comp rx=0 tx=0).stop 2023-10-03T19:20:21.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.096+0000 7fe5a58c8640 1 -- 172.21.15.45:0/1269541485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5a014f240 msgr2=0x7fe5a00a92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:21.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.096+0000 7fe5a58c8640 1 --2- 172.21.15.45:0/1269541485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5a014f240 0x7fe5a00a92d0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fe598007e90 tx=0x7fe59800e4b0 comp rx=0 tx=0).stop 2023-10-03T19:20:21.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.096+0000 7fe5a58c8640 1 -- 172.21.15.45:0/1269541485 shutdown_connections 2023-10-03T19:20:21.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.096+0000 7fe5a58c8640 1 --2- 172.21.15.45:0/1269541485 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe58c0662b0 0x7fe58c068760 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:21.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.096+0000 7fe5a58c8640 1 --2- 172.21.15.45:0/1269541485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5a014f240 0x7fe5a00a92d0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:21.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.096+0000 7fe5a58c8640 1 --2- 172.21.15.45:0/1269541485 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe5a00c2790 0x7fe5a00a7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:21.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.096+0000 7fe5a58c8640 1 --2- 172.21.15.45:0/1269541485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5a00bb1d0 0x7fe5a014fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:21.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.096+0000 7fe5a58c8640 1 -- 172.21.15.45:0/1269541485 >> 172.21.15.45:0/1269541485 conn(0x7fe5a00a64a0 msgr2=0x7fe5a00a4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:21.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.096+0000 7fe5a58c8640 1 -- 172.21.15.45:0/1269541485 shutdown_connections 2023-10-03T19:20:21.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.096+0000 7fe5a58c8640 1 -- 172.21.15.45:0/1269541485 wait complete. 2023-10-03T19:20:21.118 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":344,"stamp":"2023-10-03T19:20:20.613975+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591838,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":72,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":251580,"kb_used_data":10620,"kb_used_omap":0,"kb_used_meta":240896,"kb_avail":754723140,"statfs":{"total":773094113280,"available":772836495360,"internally_reserved":0,"allocated":10874880,"data_stored":6091948,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":246677504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":71,"apply_latency_ms":71,"commit_latency_ns":71000000,"apply_latency_ns":71000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1470,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.699671"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.359932+0000","last_change":"2023-10-03T19:20:16.343087+0000","last_active":"2023-10-03T19:20:16.359932+0000","last_peered":"2023-10-03T19:20:16.359932+0000","last_clean":"2023-10-03T19:20:16.359932+0000","last_became_active":"2023-10-03T19:20:16.342222+0000","last_became_peered":"2023-10-03T19:20:16.342222+0000","last_unstale":"2023-10-03T19:20:16.359932+0000","last_undegraded":"2023-10-03T19:20:16.359932+0000","last_fullsized":"2023-10-03T19:20:16.359932+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:50:10.917756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.313689+0000","last_change":"2023-10-03T19:20:16.313689+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.313689+0000","last_undegraded":"2023-10-03T19:20:16.313689+0000","last_fullsized":"2023-10-03T19:20:16.313689+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:46:55.330519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.319563+0000","last_change":"2023-10-03T19:20:16.319563+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.319563+0000","last_undegraded":"2023-10-03T19:20:16.319563+0000","last_fullsized":"2023-10-03T19:20:16.319563+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:10:04.836594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.388471+0000","last_change":"2023-10-03T19:20:16.366790+0000","last_active":"2023-10-03T19:20:16.388471+0000","last_peered":"2023-10-03T19:20:16.388471+0000","last_clean":"2023-10-03T19:20:16.388471+0000","last_became_active":"2023-10-03T19:20:16.366099+0000","last_became_peered":"2023-10-03T19:20:16.366099+0000","last_unstale":"2023-10-03T19:20:16.388471+0000","last_undegraded":"2023-10-03T19:20:16.388471+0000","last_fullsized":"2023-10-03T19:20:16.388471+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:38:23.411788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.384249+0000","last_change":"2023-10-03T19:20:16.380848+0000","last_active":"2023-10-03T19:20:16.384249+0000","last_peered":"2023-10-03T19:20:16.384249+0000","last_clean":"2023-10-03T19:20:16.384249+0000","last_became_active":"2023-10-03T19:20:16.379931+0000","last_became_peered":"2023-10-03T19:20:16.379931+0000","last_unstale":"2023-10-03T19:20:16.384249+0000","last_undegraded":"2023-10-03T19:20:16.384249+0000","last_fullsized":"2023-10-03T19:20:16.384249+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:38:10.161375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427524+0000","last_change":"2023-10-03T19:20:16.326785+0000","last_active":"2023-10-03T19:20:17.427524+0000","last_peered":"2023-10-03T19:20:17.427524+0000","last_clean":"2023-10-03T19:20:17.427524+0000","last_became_active":"2023-10-03T19:20:16.326450+0000","last_became_peered":"2023-10-03T19:20:16.326450+0000","last_unstale":"2023-10-03T19:20:17.427524+0000","last_undegraded":"2023-10-03T19:20:17.427524+0000","last_fullsized":"2023-10-03T19:20:17.427524+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:28:31.610677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427927+0000","last_change":"2023-10-03T19:20:16.361601+0000","last_active":"2023-10-03T19:20:17.427927+0000","last_peered":"2023-10-03T19:20:17.427927+0000","last_clean":"2023-10-03T19:20:17.427927+0000","last_became_active":"2023-10-03T19:20:16.361314+0000","last_became_peered":"2023-10-03T19:20:16.361314+0000","last_unstale":"2023-10-03T19:20:17.427927+0000","last_undegraded":"2023-10-03T19:20:17.427927+0000","last_fullsized":"2023-10-03T19:20:17.427927+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:21:09.278090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.313002+0000","last_change":"2023-10-03T19:20:16.313002+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.313002+0000","last_undegraded":"2023-10-03T19:20:16.313002+0000","last_fullsized":"2023-10-03T19:20:16.313002+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:58:50.794379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.388443+0000","last_change":"2023-10-03T19:20:16.366438+0000","last_active":"2023-10-03T19:20:16.388443+0000","last_peered":"2023-10-03T19:20:16.388443+0000","last_clean":"2023-10-03T19:20:16.388443+0000","last_became_active":"2023-10-03T19:20:16.365832+0000","last_became_peered":"2023-10-03T19:20:16.365832+0000","last_unstale":"2023-10-03T19:20:16.388443+0000","last_undegraded":"2023-10-03T19:20:16.388443+0000","last_fullsized":"2023-10-03T19:20:16.388443+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:25:32.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.337779+0000","last_change":"2023-10-03T19:20:16.333439+0000","last_active":"2023-10-03T19:20:16.337779+0000","last_peered":"2023-10-03T19:20:16.337779+0000","last_clean":"2023-10-03T19:20:16.337779+0000","last_became_active":"2023-10-03T19:20:16.332236+0000","last_became_peered":"2023-10-03T19:20:16.332236+0000","last_unstale":"2023-10-03T19:20:16.337779+0000","last_undegraded":"2023-10-03T19:20:16.337779+0000","last_fullsized":"2023-10-03T19:20:16.337779+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:44:23.426898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.374688+0000","last_change":"2023-10-03T19:20:16.369509+0000","last_active":"2023-10-03T19:20:16.374688+0000","last_peered":"2023-10-03T19:20:16.374688+0000","last_clean":"2023-10-03T19:20:16.374688+0000","last_became_active":"2023-10-03T19:20:16.368845+0000","last_became_peered":"2023-10-03T19:20:16.368845+0000","last_unstale":"2023-10-03T19:20:16.374688+0000","last_undegraded":"2023-10-03T19:20:16.374688+0000","last_fullsized":"2023-10-03T19:20:16.374688+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:44:06.881790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.428312+0000","last_change":"2023-10-03T19:20:16.326180+0000","last_active":"2023-10-03T19:20:17.428312+0000","last_peered":"2023-10-03T19:20:17.428312+0000","last_clean":"2023-10-03T19:20:17.428312+0000","last_became_active":"2023-10-03T19:20:16.325905+0000","last_became_peered":"2023-10-03T19:20:16.325905+0000","last_unstale":"2023-10-03T19:20:17.428312+0000","last_undegraded":"2023-10-03T19:20:17.428312+0000","last_fullsized":"2023-10-03T19:20:17.428312+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:12:28.137148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.365387+0000","last_change":"2023-10-03T19:20:16.363982+0000","last_active":"2023-10-03T19:20:16.365387+0000","last_peered":"2023-10-03T19:20:16.365387+0000","last_clean":"2023-10-03T19:20:16.365387+0000","last_became_active":"2023-10-03T19:20:16.363497+0000","last_became_peered":"2023-10-03T19:20:16.363497+0000","last_unstale":"2023-10-03T19:20:16.365387+0000","last_undegraded":"2023-10-03T19:20:16.365387+0000","last_fullsized":"2023-10-03T19:20:16.365387+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:08:32.046373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.314003+0000","last_change":"2023-10-03T19:20:16.314003+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.314003+0000","last_undegraded":"2023-10-03T19:20:16.314003+0000","last_fullsized":"2023-10-03T19:20:16.314003+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:32:29.079841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.374687+0000","last_change":"2023-10-03T19:20:16.369450+0000","last_active":"2023-10-03T19:20:16.374687+0000","last_peered":"2023-10-03T19:20:16.374687+0000","last_clean":"2023-10-03T19:20:16.374687+0000","last_became_active":"2023-10-03T19:20:16.368874+0000","last_became_peered":"2023-10-03T19:20:16.368874+0000","last_unstale":"2023-10-03T19:20:16.374687+0000","last_undegraded":"2023-10-03T19:20:16.374687+0000","last_fullsized":"2023-10-03T19:20:16.374687+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:32:29.079841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427088+0000","last_change":"2023-10-03T19:20:16.330466+0000","last_active":"2023-10-03T19:20:17.427088+0000","last_peered":"2023-10-03T19:20:17.427088+0000","last_clean":"2023-10-03T19:20:17.427088+0000","last_became_active":"2023-10-03T19:20:16.330201+0000","last_became_peered":"2023-10-03T19:20:16.330201+0000","last_unstale":"2023-10-03T19:20:17.427088+0000","last_undegraded":"2023-10-03T19:20:17.427088+0000","last_fullsized":"2023-10-03T19:20:17.427088+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:40:35.218183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.365365+0000","last_change":"2023-10-03T19:20:16.363892+0000","last_active":"2023-10-03T19:20:16.365365+0000","last_peered":"2023-10-03T19:20:16.365365+0000","last_clean":"2023-10-03T19:20:16.365365+0000","last_became_active":"2023-10-03T19:20:16.363606+0000","last_became_peered":"2023-10-03T19:20:16.363606+0000","last_unstale":"2023-10-03T19:20:16.365365+0000","last_undegraded":"2023-10-03T19:20:16.365365+0000","last_fullsized":"2023-10-03T19:20:16.365365+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:28:24.282225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.313320+0000","last_change":"2023-10-03T19:20:16.313320+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.313320+0000","last_undegraded":"2023-10-03T19:20:16.313320+0000","last_fullsized":"2023-10-03T19:20:16.313320+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:38:10.161375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.329432+0000","last_change":"2023-10-03T19:20:16.383943+0000","last_active":"2023-10-03T19:20:17.329432+0000","last_peered":"2023-10-03T19:20:17.329432+0000","last_clean":"2023-10-03T19:20:17.329432+0000","last_became_active":"2023-10-03T19:20:16.383157+0000","last_became_peered":"2023-10-03T19:20:16.383157+0000","last_unstale":"2023-10-03T19:20:17.329432+0000","last_undegraded":"2023-10-03T19:20:17.329432+0000","last_fullsized":"2023-10-03T19:20:17.329432+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:34:17.223181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.318797+0000","last_change":"2023-10-03T19:20:16.322423+0000","last_active":"2023-10-03T19:20:17.318797+0000","last_peered":"2023-10-03T19:20:17.318797+0000","last_clean":"2023-10-03T19:20:17.318797+0000","last_became_active":"2023-10-03T19:20:16.322147+0000","last_became_peered":"2023-10-03T19:20:16.322147+0000","last_unstale":"2023-10-03T19:20:17.318797+0000","last_undegraded":"2023-10-03T19:20:17.318797+0000","last_fullsized":"2023-10-03T19:20:17.318797+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:12:31.453399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.388755+0000","last_change":"2023-10-03T19:20:16.372224+0000","last_active":"2023-10-03T19:20:16.388755+0000","last_peered":"2023-10-03T19:20:16.388755+0000","last_clean":"2023-10-03T19:20:16.388755+0000","last_became_active":"2023-10-03T19:20:16.371522+0000","last_became_peered":"2023-10-03T19:20:16.371522+0000","last_unstale":"2023-10-03T19:20:16.388755+0000","last_undegraded":"2023-10-03T19:20:16.388755+0000","last_fullsized":"2023-10-03T19:20:16.388755+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:37:56.189574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.364672+0000","last_change":"2023-10-03T19:20:16.348420+0000","last_active":"2023-10-03T19:20:16.364672+0000","last_peered":"2023-10-03T19:20:16.364672+0000","last_clean":"2023-10-03T19:20:16.364672+0000","last_became_active":"2023-10-03T19:20:16.347688+0000","last_became_peered":"2023-10-03T19:20:16.347688+0000","last_unstale":"2023-10-03T19:20:16.364672+0000","last_undegraded":"2023-10-03T19:20:16.364672+0000","last_fullsized":"2023-10-03T19:20:16.364672+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:35:03.160406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.388852+0000","last_change":"2023-10-03T19:20:16.373061+0000","last_active":"2023-10-03T19:20:16.388852+0000","last_peered":"2023-10-03T19:20:16.388852+0000","last_clean":"2023-10-03T19:20:16.388852+0000","last_became_active":"2023-10-03T19:20:16.372301+0000","last_became_peered":"2023-10-03T19:20:16.372301+0000","last_unstale":"2023-10-03T19:20:16.388852+0000","last_undegraded":"2023-10-03T19:20:16.388852+0000","last_fullsized":"2023-10-03T19:20:16.388852+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:32:36.381349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.326772+0000","last_change":"2023-10-03T19:20:16.378738+0000","last_active":"2023-10-03T19:20:17.326772+0000","last_peered":"2023-10-03T19:20:17.326772+0000","last_clean":"2023-10-03T19:20:17.326772+0000","last_became_active":"2023-10-03T19:20:16.378316+0000","last_became_peered":"2023-10-03T19:20:16.378316+0000","last_unstale":"2023-10-03T19:20:17.326772+0000","last_undegraded":"2023-10-03T19:20:17.326772+0000","last_fullsized":"2023-10-03T19:20:17.326772+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:48:24.816920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328599+0000","last_change":"2023-10-03T19:20:16.360114+0000","last_active":"2023-10-03T19:20:17.328599+0000","last_peered":"2023-10-03T19:20:17.328599+0000","last_clean":"2023-10-03T19:20:17.328599+0000","last_became_active":"2023-10-03T19:20:16.359471+0000","last_became_peered":"2023-10-03T19:20:16.359471+0000","last_unstale":"2023-10-03T19:20:17.328599+0000","last_undegraded":"2023-10-03T19:20:17.328599+0000","last_fullsized":"2023-10-03T19:20:17.328599+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:37:47.071602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.318972+0000","last_change":"2023-10-03T19:20:16.332688+0000","last_active":"2023-10-03T19:20:17.318972+0000","last_peered":"2023-10-03T19:20:17.318972+0000","last_clean":"2023-10-03T19:20:17.318972+0000","last_became_active":"2023-10-03T19:20:16.332406+0000","last_became_peered":"2023-10-03T19:20:16.332406+0000","last_unstale":"2023-10-03T19:20:17.318972+0000","last_undegraded":"2023-10-03T19:20:17.318972+0000","last_fullsized":"2023-10-03T19:20:17.318972+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:56:57.997822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.329517+0000","last_change":"2023-10-03T19:20:16.383652+0000","last_active":"2023-10-03T19:20:17.329517+0000","last_peered":"2023-10-03T19:20:17.329517+0000","last_clean":"2023-10-03T19:20:17.329517+0000","last_became_active":"2023-10-03T19:20:16.382532+0000","last_became_peered":"2023-10-03T19:20:16.382532+0000","last_unstale":"2023-10-03T19:20:17.329517+0000","last_undegraded":"2023-10-03T19:20:17.329517+0000","last_fullsized":"2023-10-03T19:20:17.329517+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:13:33.426772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.428479+0000","last_change":"2023-10-03T19:20:16.363654+0000","last_active":"2023-10-03T19:20:17.428479+0000","last_peered":"2023-10-03T19:20:17.428479+0000","last_clean":"2023-10-03T19:20:17.428479+0000","last_became_active":"2023-10-03T19:20:16.363344+0000","last_became_peered":"2023-10-03T19:20:16.363344+0000","last_unstale":"2023-10-03T19:20:17.428479+0000","last_undegraded":"2023-10-03T19:20:17.428479+0000","last_fullsized":"2023-10-03T19:20:17.428479+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:52:35.362235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.318244+0000","last_change":"2023-10-03T19:20:16.327198+0000","last_active":"2023-10-03T19:20:17.318244+0000","last_peered":"2023-10-03T19:20:17.318244+0000","last_clean":"2023-10-03T19:20:17.318244+0000","last_became_active":"2023-10-03T19:20:16.326730+0000","last_became_peered":"2023-10-03T19:20:16.326730+0000","last_unstale":"2023-10-03T19:20:17.318244+0000","last_undegraded":"2023-10-03T19:20:17.318244+0000","last_fullsized":"2023-10-03T19:20:17.318244+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:40:02.105613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.313651+0000","last_change":"2023-10-03T19:20:16.313651+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.313651+0000","last_undegraded":"2023-10-03T19:20:16.313651+0000","last_fullsized":"2023-10-03T19:20:16.313651+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:29:43.899924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.327148+0000","last_change":"2023-10-03T19:20:16.336333+0000","last_active":"2023-10-03T19:20:17.327148+0000","last_peered":"2023-10-03T19:20:17.327148+0000","last_clean":"2023-10-03T19:20:17.327148+0000","last_became_active":"2023-10-03T19:20:16.328732+0000","last_became_peered":"2023-10-03T19:20:16.328732+0000","last_unstale":"2023-10-03T19:20:17.327148+0000","last_undegraded":"2023-10-03T19:20:17.327148+0000","last_fullsized":"2023-10-03T19:20:17.327148+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:38:34.923323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.326771+0000","last_change":"2023-10-03T19:20:16.357185+0000","last_active":"2023-10-03T19:20:17.326771+0000","last_peered":"2023-10-03T19:20:17.326771+0000","last_clean":"2023-10-03T19:20:17.326771+0000","last_became_active":"2023-10-03T19:20:16.356591+0000","last_became_peered":"2023-10-03T19:20:16.356591+0000","last_unstale":"2023-10-03T19:20:17.326771+0000","last_undegraded":"2023-10-03T19:20:17.326771+0000","last_fullsized":"2023-10-03T19:20:17.326771+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:36:02.147396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.336171+0000","last_change":"2023-10-03T19:20:16.332773+0000","last_active":"2023-10-03T19:20:16.336171+0000","last_peered":"2023-10-03T19:20:16.336171+0000","last_clean":"2023-10-03T19:20:16.336171+0000","last_became_active":"2023-10-03T19:20:16.332432+0000","last_became_peered":"2023-10-03T19:20:16.332432+0000","last_unstale":"2023-10-03T19:20:16.336171+0000","last_undegraded":"2023-10-03T19:20:16.336171+0000","last_fullsized":"2023-10-03T19:20:16.336171+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:06:21.719875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"108'4","reported_seq":17,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.330032+0000","last_change":"2023-10-03T19:20:15.974915+0000","last_active":"2023-10-03T19:20:17.330032+0000","last_peered":"2023-10-03T19:20:17.330032+0000","last_clean":"2023-10-03T19:20:17.330032+0000","last_became_active":"2023-10-03T19:20:15.974027+0000","last_became_peered":"2023-10-03T19:20:15.974027+0000","last_unstale":"2023-10-03T19:20:17.330032+0000","last_undegraded":"2023-10-03T19:20:17.330032+0000","last_fullsized":"2023-10-03T19:20:17.330032+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:42:02.754043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427780+0000","last_change":"2023-10-03T19:20:16.328760+0000","last_active":"2023-10-03T19:20:17.427780+0000","last_peered":"2023-10-03T19:20:17.427780+0000","last_clean":"2023-10-03T19:20:17.427780+0000","last_became_active":"2023-10-03T19:20:16.328456+0000","last_became_peered":"2023-10-03T19:20:16.328456+0000","last_unstale":"2023-10-03T19:20:17.427780+0000","last_undegraded":"2023-10-03T19:20:17.427780+0000","last_fullsized":"2023-10-03T19:20:17.427780+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:36:28.692332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"108'1","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.332435+0000","last_change":"2023-10-03T19:20:15.948383+0000","last_active":"2023-10-03T19:20:16.332435+0000","last_peered":"2023-10-03T19:20:16.332435+0000","last_clean":"2023-10-03T19:20:16.332435+0000","last_became_active":"2023-10-03T19:20:15.947986+0000","last_became_peered":"2023-10-03T19:20:15.947986+0000","last_unstale":"2023-10-03T19:20:16.332435+0000","last_undegraded":"2023-10-03T19:20:16.332435+0000","last_fullsized":"2023-10-03T19:20:16.332435+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:59:30.670767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328274+0000","last_change":"2023-10-03T19:20:16.361589+0000","last_active":"2023-10-03T19:20:17.328274+0000","last_peered":"2023-10-03T19:20:17.328274+0000","last_clean":"2023-10-03T19:20:17.328274+0000","last_became_active":"2023-10-03T19:20:16.360874+0000","last_became_peered":"2023-10-03T19:20:16.360874+0000","last_unstale":"2023-10-03T19:20:17.328274+0000","last_undegraded":"2023-10-03T19:20:17.328274+0000","last_fullsized":"2023-10-03T19:20:17.328274+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:24:03.546278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"108'2","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.381745+0000","last_change":"2023-10-03T19:20:15.972052+0000","last_active":"2023-10-03T19:20:16.381745+0000","last_peered":"2023-10-03T19:20:16.381745+0000","last_clean":"2023-10-03T19:20:16.381745+0000","last_became_active":"2023-10-03T19:20:15.971172+0000","last_became_peered":"2023-10-03T19:20:15.971172+0000","last_unstale":"2023-10-03T19:20:16.381745+0000","last_undegraded":"2023-10-03T19:20:16.381745+0000","last_fullsized":"2023-10-03T19:20:16.381745+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:28:00.958370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.388611+0000","last_change":"2023-10-03T19:20:16.368357+0000","last_active":"2023-10-03T19:20:16.388611+0000","last_peered":"2023-10-03T19:20:16.388611+0000","last_clean":"2023-10-03T19:20:16.388611+0000","last_became_active":"2023-10-03T19:20:16.367616+0000","last_became_peered":"2023-10-03T19:20:16.367616+0000","last_unstale":"2023-10-03T19:20:16.388611+0000","last_undegraded":"2023-10-03T19:20:16.388611+0000","last_fullsized":"2023-10-03T19:20:16.388611+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:51:54.780344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"108'2","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.340323+0000","last_change":"2023-10-03T19:20:15.964371+0000","last_active":"2023-10-03T19:20:16.340323+0000","last_peered":"2023-10-03T19:20:16.340323+0000","last_clean":"2023-10-03T19:20:16.340323+0000","last_became_active":"2023-10-03T19:20:15.963961+0000","last_became_peered":"2023-10-03T19:20:15.963961+0000","last_unstale":"2023-10-03T19:20:16.340323+0000","last_undegraded":"2023-10-03T19:20:16.340323+0000","last_fullsized":"2023-10-03T19:20:16.340323+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:53:59.202663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.375198+0000","last_change":"2023-10-03T19:20:16.374148+0000","last_active":"2023-10-03T19:20:16.375198+0000","last_peered":"2023-10-03T19:20:16.375198+0000","last_clean":"2023-10-03T19:20:16.375198+0000","last_became_active":"2023-10-03T19:20:16.373840+0000","last_became_peered":"2023-10-03T19:20:16.373840+0000","last_unstale":"2023-10-03T19:20:16.375198+0000","last_undegraded":"2023-10-03T19:20:16.375198+0000","last_fullsized":"2023-10-03T19:20:16.375198+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:19:32.912872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"108'1","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.341648+0000","last_change":"2023-10-03T19:20:15.956585+0000","last_active":"2023-10-03T19:20:16.341648+0000","last_peered":"2023-10-03T19:20:16.341648+0000","last_clean":"2023-10-03T19:20:16.341648+0000","last_became_active":"2023-10-03T19:20:15.955764+0000","last_became_peered":"2023-10-03T19:20:15.955764+0000","last_unstale":"2023-10-03T19:20:16.341648+0000","last_undegraded":"2023-10-03T19:20:16.341648+0000","last_fullsized":"2023-10-03T19:20:16.341648+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:25:54.232755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.382347+0000","last_change":"2023-10-03T19:20:16.380278+0000","last_active":"2023-10-03T19:20:16.382347+0000","last_peered":"2023-10-03T19:20:16.382347+0000","last_clean":"2023-10-03T19:20:16.382347+0000","last_became_active":"2023-10-03T19:20:16.379843+0000","last_became_peered":"2023-10-03T19:20:16.379843+0000","last_unstale":"2023-10-03T19:20:16.382347+0000","last_undegraded":"2023-10-03T19:20:16.382347+0000","last_fullsized":"2023-10-03T19:20:16.382347+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:46:55.330519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"108'1","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427728+0000","last_change":"2023-10-03T19:20:15.967905+0000","last_active":"2023-10-03T19:20:17.427728+0000","last_peered":"2023-10-03T19:20:17.427728+0000","last_clean":"2023-10-03T19:20:17.427728+0000","last_became_active":"2023-10-03T19:20:15.967603+0000","last_became_peered":"2023-10-03T19:20:15.967603+0000","last_unstale":"2023-10-03T19:20:17.427728+0000","last_undegraded":"2023-10-03T19:20:17.427728+0000","last_fullsized":"2023-10-03T19:20:17.427728+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:23:31.344311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.333211+0000","last_change":"2023-10-03T19:20:16.333211+0000","last_active":"2023-10-03T19:20:16.333211+0000","last_peered":"2023-10-03T19:20:16.333211+0000","last_clean":"2023-10-03T19:20:16.333211+0000","last_became_active":"2023-10-03T19:20:16.332946+0000","last_became_peered":"2023-10-03T19:20:16.332946+0000","last_unstale":"2023-10-03T19:20:16.333211+0000","last_undegraded":"2023-10-03T19:20:16.333211+0000","last_fullsized":"2023-10-03T19:20:16.333211+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:50:10.917756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.327271+0000","last_change":"2023-10-03T19:20:15.955201+0000","last_active":"2023-10-03T19:20:17.327271+0000","last_peered":"2023-10-03T19:20:17.327271+0000","last_clean":"2023-10-03T19:20:17.327271+0000","last_became_active":"2023-10-03T19:20:15.954436+0000","last_became_peered":"2023-10-03T19:20:15.954436+0000","last_unstale":"2023-10-03T19:20:17.327271+0000","last_undegraded":"2023-10-03T19:20:17.327271+0000","last_fullsized":"2023-10-03T19:20:17.327271+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:39:18.747278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.334203+0000","last_change":"2023-10-03T19:20:16.328049+0000","last_active":"2023-10-03T19:20:16.334203+0000","last_peered":"2023-10-03T19:20:16.334203+0000","last_clean":"2023-10-03T19:20:16.334203+0000","last_became_active":"2023-10-03T19:20:16.327707+0000","last_became_peered":"2023-10-03T19:20:16.327707+0000","last_unstale":"2023-10-03T19:20:16.334203+0000","last_undegraded":"2023-10-03T19:20:16.334203+0000","last_fullsized":"2023-10-03T19:20:16.334203+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:25:59.855509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427488+0000","last_change":"2023-10-03T19:20:15.954813+0000","last_active":"2023-10-03T19:20:17.427488+0000","last_peered":"2023-10-03T19:20:17.427488+0000","last_clean":"2023-10-03T19:20:17.427488+0000","last_became_active":"2023-10-03T19:20:15.954281+0000","last_became_peered":"2023-10-03T19:20:15.954281+0000","last_unstale":"2023-10-03T19:20:17.427488+0000","last_undegraded":"2023-10-03T19:20:17.427488+0000","last_fullsized":"2023-10-03T19:20:17.427488+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:10:30.851090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328147+0000","last_change":"2023-10-03T19:20:16.360131+0000","last_active":"2023-10-03T19:20:17.328147+0000","last_peered":"2023-10-03T19:20:17.328147+0000","last_clean":"2023-10-03T19:20:17.328147+0000","last_became_active":"2023-10-03T19:20:16.359396+0000","last_became_peered":"2023-10-03T19:20:16.359396+0000","last_unstale":"2023-10-03T19:20:17.328147+0000","last_undegraded":"2023-10-03T19:20:17.328147+0000","last_fullsized":"2023-10-03T19:20:17.328147+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:19:39.425532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"108'1","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.334585+0000","last_change":"2023-10-03T19:20:15.956714+0000","last_active":"2023-10-03T19:20:16.334585+0000","last_peered":"2023-10-03T19:20:16.334585+0000","last_clean":"2023-10-03T19:20:16.334585+0000","last_became_active":"2023-10-03T19:20:15.956345+0000","last_became_peered":"2023-10-03T19:20:15.956345+0000","last_unstale":"2023-10-03T19:20:16.334585+0000","last_undegraded":"2023-10-03T19:20:16.334585+0000","last_fullsized":"2023-10-03T19:20:16.334585+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:25:21.009051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.364657+0000","last_change":"2023-10-03T19:20:16.346680+0000","last_active":"2023-10-03T19:20:16.364657+0000","last_peered":"2023-10-03T19:20:16.364657+0000","last_clean":"2023-10-03T19:20:16.364657+0000","last_became_active":"2023-10-03T19:20:16.345966+0000","last_became_peered":"2023-10-03T19:20:16.345966+0000","last_unstale":"2023-10-03T19:20:16.364657+0000","last_undegraded":"2023-10-03T19:20:16.364657+0000","last_fullsized":"2023-10-03T19:20:16.364657+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:29:43.899924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"108'2","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.319319+0000","last_change":"2023-10-03T19:20:15.957563+0000","last_active":"2023-10-03T19:20:17.319319+0000","last_peered":"2023-10-03T19:20:17.319319+0000","last_clean":"2023-10-03T19:20:17.319319+0000","last_became_active":"2023-10-03T19:20:15.957133+0000","last_became_peered":"2023-10-03T19:20:15.957133+0000","last_unstale":"2023-10-03T19:20:17.319319+0000","last_undegraded":"2023-10-03T19:20:17.319319+0000","last_fullsized":"2023-10-03T19:20:17.319319+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:14:44.702562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.428460+0000","last_change":"2023-10-03T19:20:16.350664+0000","last_active":"2023-10-03T19:20:17.428460+0000","last_peered":"2023-10-03T19:20:17.428460+0000","last_clean":"2023-10-03T19:20:17.428460+0000","last_became_active":"2023-10-03T19:20:16.350368+0000","last_became_peered":"2023-10-03T19:20:16.350368+0000","last_unstale":"2023-10-03T19:20:17.428460+0000","last_undegraded":"2023-10-03T19:20:17.428460+0000","last_fullsized":"2023-10-03T19:20:17.428460+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:26:55.310688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"108'1","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.373081+0000","last_change":"2023-10-03T19:20:15.974399+0000","last_active":"2023-10-03T19:20:16.373081+0000","last_peered":"2023-10-03T19:20:16.373081+0000","last_clean":"2023-10-03T19:20:16.373081+0000","last_became_active":"2023-10-03T19:20:15.973595+0000","last_became_peered":"2023-10-03T19:20:15.973595+0000","last_unstale":"2023-10-03T19:20:16.373081+0000","last_undegraded":"2023-10-03T19:20:16.373081+0000","last_fullsized":"2023-10-03T19:20:16.373081+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:32:50.979185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.329360+0000","last_change":"2023-10-03T19:20:16.380011+0000","last_active":"2023-10-03T19:20:17.329360+0000","last_peered":"2023-10-03T19:20:17.329360+0000","last_clean":"2023-10-03T19:20:17.329360+0000","last_became_active":"2023-10-03T19:20:16.379481+0000","last_became_peered":"2023-10-03T19:20:16.379481+0000","last_unstale":"2023-10-03T19:20:17.329360+0000","last_undegraded":"2023-10-03T19:20:17.329360+0000","last_fullsized":"2023-10-03T19:20:17.329360+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:03:01.967348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.334168+0000","last_change":"2023-10-03T19:20:15.969845+0000","last_active":"2023-10-03T19:20:16.334168+0000","last_peered":"2023-10-03T19:20:16.334168+0000","last_clean":"2023-10-03T19:20:16.334168+0000","last_became_active":"2023-10-03T19:20:15.969245+0000","last_became_peered":"2023-10-03T19:20:15.969245+0000","last_unstale":"2023-10-03T19:20:16.334168+0000","last_undegraded":"2023-10-03T19:20:16.334168+0000","last_fullsized":"2023-10-03T19:20:16.334168+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:02:40.240181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427116+0000","last_change":"2023-10-03T19:20:16.381646+0000","last_active":"2023-10-03T19:20:17.427116+0000","last_peered":"2023-10-03T19:20:17.427116+0000","last_clean":"2023-10-03T19:20:17.427116+0000","last_became_active":"2023-10-03T19:20:16.381252+0000","last_became_peered":"2023-10-03T19:20:16.381252+0000","last_unstale":"2023-10-03T19:20:17.427116+0000","last_undegraded":"2023-10-03T19:20:17.427116+0000","last_fullsized":"2023-10-03T19:20:17.427116+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:37:09.807280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"108'2","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427703+0000","last_change":"2023-10-03T19:20:15.968967+0000","last_active":"2023-10-03T19:20:17.427703+0000","last_peered":"2023-10-03T19:20:17.427703+0000","last_clean":"2023-10-03T19:20:17.427703+0000","last_became_active":"2023-10-03T19:20:15.968699+0000","last_became_peered":"2023-10-03T19:20:15.968699+0000","last_unstale":"2023-10-03T19:20:17.427703+0000","last_undegraded":"2023-10-03T19:20:17.427703+0000","last_fullsized":"2023-10-03T19:20:17.427703+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:10:38.839362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.312802+0000","last_change":"2023-10-03T19:20:16.312802+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.312802+0000","last_undegraded":"2023-10-03T19:20:16.312802+0000","last_fullsized":"2023-10-03T19:20:16.312802+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:16:52.366869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.332701+0000","last_change":"2023-10-03T19:20:15.965136+0000","last_active":"2023-10-03T19:20:16.332701+0000","last_peered":"2023-10-03T19:20:16.332701+0000","last_clean":"2023-10-03T19:20:16.332701+0000","last_became_active":"2023-10-03T19:20:15.964445+0000","last_became_peered":"2023-10-03T19:20:15.964445+0000","last_unstale":"2023-10-03T19:20:16.332701+0000","last_undegraded":"2023-10-03T19:20:16.332701+0000","last_fullsized":"2023-10-03T19:20:16.332701+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:57:06.605896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.314019+0000","last_change":"2023-10-03T19:20:16.314019+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.314019+0000","last_undegraded":"2023-10-03T19:20:16.314019+0000","last_fullsized":"2023-10-03T19:20:16.314019+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:35:03.160406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.315594+0000","last_change":"2023-10-03T19:20:15.968473+0000","last_active":"2023-10-03T19:20:16.315594+0000","last_peered":"2023-10-03T19:20:16.315594+0000","last_clean":"2023-10-03T19:20:16.315594+0000","last_became_active":"2023-10-03T19:20:15.968149+0000","last_became_peered":"2023-10-03T19:20:15.968149+0000","last_unstale":"2023-10-03T19:20:16.315594+0000","last_undegraded":"2023-10-03T19:20:16.315594+0000","last_fullsized":"2023-10-03T19:20:16.315594+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:48:45.233305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.327669+0000","last_change":"2023-10-03T19:20:16.360789+0000","last_active":"2023-10-03T19:20:17.327669+0000","last_peered":"2023-10-03T19:20:17.327669+0000","last_clean":"2023-10-03T19:20:17.327669+0000","last_became_active":"2023-10-03T19:20:16.360054+0000","last_became_peered":"2023-10-03T19:20:16.360054+0000","last_unstale":"2023-10-03T19:20:17.327669+0000","last_undegraded":"2023-10-03T19:20:17.327669+0000","last_fullsized":"2023-10-03T19:20:17.327669+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:49:08.311127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.333760+0000","last_change":"2023-10-03T19:20:15.974966+0000","last_active":"2023-10-03T19:20:16.333760+0000","last_peered":"2023-10-03T19:20:16.333760+0000","last_clean":"2023-10-03T19:20:16.333760+0000","last_became_active":"2023-10-03T19:20:15.974042+0000","last_became_peered":"2023-10-03T19:20:15.974042+0000","last_unstale":"2023-10-03T19:20:16.333760+0000","last_undegraded":"2023-10-03T19:20:16.333760+0000","last_fullsized":"2023-10-03T19:20:16.333760+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:09:35.872471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.428525+0000","last_change":"2023-10-03T19:20:16.323318+0000","last_active":"2023-10-03T19:20:17.428525+0000","last_peered":"2023-10-03T19:20:17.428525+0000","last_clean":"2023-10-03T19:20:17.428525+0000","last_became_active":"2023-10-03T19:20:16.322090+0000","last_became_peered":"2023-10-03T19:20:16.322090+0000","last_unstale":"2023-10-03T19:20:17.428525+0000","last_undegraded":"2023-10-03T19:20:17.428525+0000","last_fullsized":"2023-10-03T19:20:17.428525+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:41:27.118657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"108'2","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.428161+0000","last_change":"2023-10-03T19:20:15.948790+0000","last_active":"2023-10-03T19:20:17.428161+0000","last_peered":"2023-10-03T19:20:17.428161+0000","last_clean":"2023-10-03T19:20:17.428161+0000","last_became_active":"2023-10-03T19:20:15.948222+0000","last_became_peered":"2023-10-03T19:20:15.948222+0000","last_unstale":"2023-10-03T19:20:17.428161+0000","last_undegraded":"2023-10-03T19:20:17.428161+0000","last_fullsized":"2023-10-03T19:20:17.428161+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:14:18.658361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.374335+0000","last_change":"2023-10-03T19:20:16.373432+0000","last_active":"2023-10-03T19:20:16.374335+0000","last_peered":"2023-10-03T19:20:16.374335+0000","last_clean":"2023-10-03T19:20:16.374335+0000","last_became_active":"2023-10-03T19:20:16.373117+0000","last_became_peered":"2023-10-03T19:20:16.373117+0000","last_unstale":"2023-10-03T19:20:16.374335+0000","last_undegraded":"2023-10-03T19:20:16.374335+0000","last_fullsized":"2023-10-03T19:20:16.374335+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:04:34.700899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.329921+0000","last_change":"2023-10-03T19:20:15.964945+0000","last_active":"2023-10-03T19:20:17.329921+0000","last_peered":"2023-10-03T19:20:17.329921+0000","last_clean":"2023-10-03T19:20:17.329921+0000","last_became_active":"2023-10-03T19:20:15.963013+0000","last_became_peered":"2023-10-03T19:20:15.963013+0000","last_unstale":"2023-10-03T19:20:17.329921+0000","last_undegraded":"2023-10-03T19:20:17.329921+0000","last_fullsized":"2023-10-03T19:20:17.329921+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:58:07.182707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.388513+0000","last_change":"2023-10-03T19:20:16.366914+0000","last_active":"2023-10-03T19:20:16.388513+0000","last_peered":"2023-10-03T19:20:16.388513+0000","last_clean":"2023-10-03T19:20:16.388513+0000","last_became_active":"2023-10-03T19:20:16.366399+0000","last_became_peered":"2023-10-03T19:20:16.366399+0000","last_unstale":"2023-10-03T19:20:16.388513+0000","last_undegraded":"2023-10-03T19:20:16.388513+0000","last_fullsized":"2023-10-03T19:20:16.388513+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:42:50.977022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.329780+0000","last_change":"2023-10-03T19:20:15.964082+0000","last_active":"2023-10-03T19:20:17.329780+0000","last_peered":"2023-10-03T19:20:17.329780+0000","last_clean":"2023-10-03T19:20:17.329780+0000","last_became_active":"2023-10-03T19:20:15.963061+0000","last_became_peered":"2023-10-03T19:20:15.963061+0000","last_unstale":"2023-10-03T19:20:17.329780+0000","last_undegraded":"2023-10-03T19:20:17.329780+0000","last_fullsized":"2023-10-03T19:20:17.329780+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:48:54.530229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.319098+0000","last_change":"2023-10-03T19:20:16.356943+0000","last_active":"2023-10-03T19:20:17.319098+0000","last_peered":"2023-10-03T19:20:17.319098+0000","last_clean":"2023-10-03T19:20:17.319098+0000","last_became_active":"2023-10-03T19:20:16.356724+0000","last_became_peered":"2023-10-03T19:20:16.356724+0000","last_unstale":"2023-10-03T19:20:17.319098+0000","last_undegraded":"2023-10-03T19:20:17.319098+0000","last_fullsized":"2023-10-03T19:20:17.319098+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:39:11.226990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.428638+0000","last_change":"2023-10-03T19:20:15.950804+0000","last_active":"2023-10-03T19:20:17.428638+0000","last_peered":"2023-10-03T19:20:17.428638+0000","last_clean":"2023-10-03T19:20:17.428638+0000","last_became_active":"2023-10-03T19:20:15.949850+0000","last_became_peered":"2023-10-03T19:20:15.949850+0000","last_unstale":"2023-10-03T19:20:17.428638+0000","last_undegraded":"2023-10-03T19:20:17.428638+0000","last_fullsized":"2023-10-03T19:20:17.428638+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:22:47.665712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427510+0000","last_change":"2023-10-03T19:20:16.335345+0000","last_active":"2023-10-03T19:20:17.427510+0000","last_peered":"2023-10-03T19:20:17.427510+0000","last_clean":"2023-10-03T19:20:17.427510+0000","last_became_active":"2023-10-03T19:20:16.335141+0000","last_became_peered":"2023-10-03T19:20:16.335141+0000","last_unstale":"2023-10-03T19:20:17.427510+0000","last_undegraded":"2023-10-03T19:20:17.427510+0000","last_fullsized":"2023-10-03T19:20:17.427510+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:15:10.493042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.330713+0000","last_change":"2023-10-03T19:20:15.951459+0000","last_active":"2023-10-03T19:20:16.330713+0000","last_peered":"2023-10-03T19:20:16.330713+0000","last_clean":"2023-10-03T19:20:16.330713+0000","last_became_active":"2023-10-03T19:20:15.950750+0000","last_became_peered":"2023-10-03T19:20:15.950750+0000","last_unstale":"2023-10-03T19:20:16.330713+0000","last_undegraded":"2023-10-03T19:20:16.330713+0000","last_fullsized":"2023-10-03T19:20:16.330713+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:32:44.255176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.312349+0000","last_change":"2023-10-03T19:20:16.312349+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.312349+0000","last_undegraded":"2023-10-03T19:20:16.312349+0000","last_fullsized":"2023-10-03T19:20:16.312349+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:27:20.469549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.333339+0000","last_change":"2023-10-03T19:20:15.957097+0000","last_active":"2023-10-03T19:20:16.333339+0000","last_peered":"2023-10-03T19:20:16.333339+0000","last_clean":"2023-10-03T19:20:16.333339+0000","last_became_active":"2023-10-03T19:20:15.956382+0000","last_became_peered":"2023-10-03T19:20:15.956382+0000","last_unstale":"2023-10-03T19:20:16.333339+0000","last_undegraded":"2023-10-03T19:20:16.333339+0000","last_fullsized":"2023-10-03T19:20:16.333339+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:48:45.233305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.388531+0000","last_change":"2023-10-03T19:20:16.366911+0000","last_active":"2023-10-03T19:20:16.388531+0000","last_peered":"2023-10-03T19:20:16.388531+0000","last_clean":"2023-10-03T19:20:16.388531+0000","last_became_active":"2023-10-03T19:20:16.366000+0000","last_became_peered":"2023-10-03T19:20:16.366000+0000","last_unstale":"2023-10-03T19:20:16.388531+0000","last_undegraded":"2023-10-03T19:20:16.388531+0000","last_fullsized":"2023-10-03T19:20:16.388531+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:20:23.512066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.428211+0000","last_change":"2023-10-03T19:20:15.950221+0000","last_active":"2023-10-03T19:20:17.428211+0000","last_peered":"2023-10-03T19:20:17.428211+0000","last_clean":"2023-10-03T19:20:17.428211+0000","last_became_active":"2023-10-03T19:20:15.949702+0000","last_became_peered":"2023-10-03T19:20:15.949702+0000","last_unstale":"2023-10-03T19:20:17.428211+0000","last_undegraded":"2023-10-03T19:20:17.428211+0000","last_fullsized":"2023-10-03T19:20:17.428211+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:48:28.421358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.368478+0000","last_change":"2023-10-03T19:20:16.367493+0000","last_active":"2023-10-03T19:20:16.368478+0000","last_peered":"2023-10-03T19:20:16.368478+0000","last_clean":"2023-10-03T19:20:16.368478+0000","last_became_active":"2023-10-03T19:20:16.367200+0000","last_became_peered":"2023-10-03T19:20:16.367200+0000","last_unstale":"2023-10-03T19:20:16.368478+0000","last_undegraded":"2023-10-03T19:20:16.368478+0000","last_fullsized":"2023-10-03T19:20:16.368478+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:38:21.268252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.334197+0000","last_change":"2023-10-03T19:20:15.976449+0000","last_active":"2023-10-03T19:20:16.334197+0000","last_peered":"2023-10-03T19:20:16.334197+0000","last_clean":"2023-10-03T19:20:16.334197+0000","last_became_active":"2023-10-03T19:20:15.975751+0000","last_became_peered":"2023-10-03T19:20:15.975751+0000","last_unstale":"2023-10-03T19:20:16.334197+0000","last_undegraded":"2023-10-03T19:20:16.334197+0000","last_fullsized":"2023-10-03T19:20:16.334197+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:44:51.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.390675+0000","last_change":"2023-10-03T19:20:16.378686+0000","last_active":"2023-10-03T19:20:16.390675+0000","last_peered":"2023-10-03T19:20:16.390675+0000","last_clean":"2023-10-03T19:20:16.390675+0000","last_became_active":"2023-10-03T19:20:16.377931+0000","last_became_peered":"2023-10-03T19:20:16.377931+0000","last_unstale":"2023-10-03T19:20:16.390675+0000","last_undegraded":"2023-10-03T19:20:16.390675+0000","last_fullsized":"2023-10-03T19:20:16.390675+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:51:26.296530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"108'8","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.314937+0000","last_change":"2023-10-03T19:20:15.968516+0000","last_active":"2023-10-03T19:20:16.314937+0000","last_peered":"2023-10-03T19:20:16.314937+0000","last_clean":"2023-10-03T19:20:16.314937+0000","last_became_active":"2023-10-03T19:20:15.967958+0000","last_became_peered":"2023-10-03T19:20:15.967958+0000","last_unstale":"2023-10-03T19:20:16.314937+0000","last_undegraded":"2023-10-03T19:20:16.314937+0000","last_fullsized":"2023-10-03T19:20:16.314937+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:25:54.232755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":332,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.334710+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:20:16.334710+0000","last_peered":"2023-10-03T19:20:16.334710+0000","last_clean":"2023-10-03T19:20:16.334710+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:20:16.334710+0000","last_undegraded":"2023-10-03T19:20:16.334710+0000","last_fullsized":"2023-10-03T19:20:16.334710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:11:06.488375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.327849+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:20:17.327849+0000","last_peered":"2023-10-03T19:20:17.327849+0000","last_clean":"2023-10-03T19:20:17.327849+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:20:17.327849+0000","last_undegraded":"2023-10-03T19:20:17.327849+0000","last_fullsized":"2023-10-03T19:20:17.327849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:48:08.284624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328782+0000","last_change":"2023-10-03T19:20:16.356061+0000","last_active":"2023-10-03T19:20:17.328782+0000","last_peered":"2023-10-03T19:20:17.328782+0000","last_clean":"2023-10-03T19:20:17.328782+0000","last_became_active":"2023-10-03T19:20:16.355199+0000","last_became_peered":"2023-10-03T19:20:16.355199+0000","last_unstale":"2023-10-03T19:20:17.328782+0000","last_undegraded":"2023-10-03T19:20:17.328782+0000","last_fullsized":"2023-10-03T19:20:17.328782+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:07:54.083803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"108'2","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.319323+0000","last_change":"2023-10-03T19:20:15.969199+0000","last_active":"2023-10-03T19:20:16.319323+0000","last_peered":"2023-10-03T19:20:16.319323+0000","last_clean":"2023-10-03T19:20:16.319323+0000","last_became_active":"2023-10-03T19:20:15.966849+0000","last_became_peered":"2023-10-03T19:20:15.966849+0000","last_unstale":"2023-10-03T19:20:16.319323+0000","last_undegraded":"2023-10-03T19:20:16.319323+0000","last_fullsized":"2023-10-03T19:20:16.319323+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:47:59.812937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":180,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.343563+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:20:16.343563+0000","last_peered":"2023-10-03T19:20:16.343563+0000","last_clean":"2023-10-03T19:20:16.343563+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:20:16.343563+0000","last_undegraded":"2023-10-03T19:20:16.343563+0000","last_fullsized":"2023-10-03T19:20:16.343563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:37:17.443617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.368589+0000","last_change":"2023-10-03T19:20:16.367501+0000","last_active":"2023-10-03T19:20:16.368589+0000","last_peered":"2023-10-03T19:20:16.368589+0000","last_clean":"2023-10-03T19:20:16.368589+0000","last_became_active":"2023-10-03T19:20:16.367248+0000","last_became_peered":"2023-10-03T19:20:16.367248+0000","last_unstale":"2023-10-03T19:20:16.368589+0000","last_undegraded":"2023-10-03T19:20:16.368589+0000","last_fullsized":"2023-10-03T19:20:16.368589+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:10:29.134502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.319316+0000","last_change":"2023-10-03T19:20:15.967698+0000","last_active":"2023-10-03T19:20:16.319316+0000","last_peered":"2023-10-03T19:20:16.319316+0000","last_clean":"2023-10-03T19:20:16.319316+0000","last_became_active":"2023-10-03T19:20:15.967254+0000","last_became_peered":"2023-10-03T19:20:15.967254+0000","last_unstale":"2023-10-03T19:20:16.319316+0000","last_undegraded":"2023-10-03T19:20:16.319316+0000","last_fullsized":"2023-10-03T19:20:16.319316+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:16:20.254315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":178,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.318094+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:20:17.318094+0000","last_peered":"2023-10-03T19:20:17.318094+0000","last_clean":"2023-10-03T19:20:17.318094+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:20:17.318094+0000","last_undegraded":"2023-10-03T19:20:17.318094+0000","last_fullsized":"2023-10-03T19:20:17.318094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:09:08.659807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.318441+0000","last_change":"2023-10-03T19:20:16.331087+0000","last_active":"2023-10-03T19:20:17.318441+0000","last_peered":"2023-10-03T19:20:17.318441+0000","last_clean":"2023-10-03T19:20:17.318441+0000","last_became_active":"2023-10-03T19:20:16.330789+0000","last_became_peered":"2023-10-03T19:20:16.330789+0000","last_unstale":"2023-10-03T19:20:17.318441+0000","last_undegraded":"2023-10-03T19:20:17.318441+0000","last_fullsized":"2023-10-03T19:20:17.318441+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:59:08.307318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.315395+0000","last_change":"2023-10-03T19:20:15.963326+0000","last_active":"2023-10-03T19:20:16.315395+0000","last_peered":"2023-10-03T19:20:16.315395+0000","last_clean":"2023-10-03T19:20:16.315395+0000","last_became_active":"2023-10-03T19:20:15.962683+0000","last_became_peered":"2023-10-03T19:20:15.962683+0000","last_unstale":"2023-10-03T19:20:16.315395+0000","last_undegraded":"2023-10-03T19:20:16.315395+0000","last_fullsized":"2023-10-03T19:20:16.315395+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:32:44.255176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.327053+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:20:17.327053+0000","last_peered":"2023-10-03T19:20:17.327053+0000","last_clean":"2023-10-03T19:20:17.327053+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:20:17.327053+0000","last_undegraded":"2023-10-03T19:20:17.327053+0000","last_fullsized":"2023-10-03T19:20:17.327053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:13:16.390162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.329037+0000","last_change":"2023-10-03T19:20:16.379445+0000","last_active":"2023-10-03T19:20:17.329037+0000","last_peered":"2023-10-03T19:20:17.329037+0000","last_clean":"2023-10-03T19:20:17.329037+0000","last_became_active":"2023-10-03T19:20:16.378708+0000","last_became_peered":"2023-10-03T19:20:16.378708+0000","last_unstale":"2023-10-03T19:20:17.329037+0000","last_undegraded":"2023-10-03T19:20:17.329037+0000","last_fullsized":"2023-10-03T19:20:17.329037+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:36:26.181089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.330048+0000","last_change":"2023-10-03T19:20:15.964353+0000","last_active":"2023-10-03T19:20:17.330048+0000","last_peered":"2023-10-03T19:20:17.330048+0000","last_clean":"2023-10-03T19:20:17.330048+0000","last_became_active":"2023-10-03T19:20:15.963577+0000","last_became_peered":"2023-10-03T19:20:15.963577+0000","last_unstale":"2023-10-03T19:20:17.330048+0000","last_undegraded":"2023-10-03T19:20:17.330048+0000","last_fullsized":"2023-10-03T19:20:17.330048+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:44:59.894758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":172,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.331800+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:20:16.331800+0000","last_peered":"2023-10-03T19:20:16.331800+0000","last_clean":"2023-10-03T19:20:16.331800+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:20:16.331800+0000","last_undegraded":"2023-10-03T19:20:16.331800+0000","last_fullsized":"2023-10-03T19:20:16.331800+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:45:55.749619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328196+0000","last_change":"2023-10-03T19:20:16.360159+0000","last_active":"2023-10-03T19:20:17.328196+0000","last_peered":"2023-10-03T19:20:17.328196+0000","last_clean":"2023-10-03T19:20:17.328196+0000","last_became_active":"2023-10-03T19:20:16.359303+0000","last_became_peered":"2023-10-03T19:20:16.359303+0000","last_unstale":"2023-10-03T19:20:17.328196+0000","last_undegraded":"2023-10-03T19:20:17.328196+0000","last_fullsized":"2023-10-03T19:20:17.328196+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:01:13.570148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328583+0000","last_change":"2023-10-03T19:20:15.953426+0000","last_active":"2023-10-03T19:20:17.328583+0000","last_peered":"2023-10-03T19:20:17.328583+0000","last_clean":"2023-10-03T19:20:17.328583+0000","last_became_active":"2023-10-03T19:20:15.952566+0000","last_became_peered":"2023-10-03T19:20:15.952566+0000","last_unstale":"2023-10-03T19:20:17.328583+0000","last_undegraded":"2023-10-03T19:20:17.328583+0000","last_fullsized":"2023-10-03T19:20:17.328583+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:25:56.771799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":180,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.333768+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:20:16.333768+0000","last_peered":"2023-10-03T19:20:16.333768+0000","last_clean":"2023-10-03T19:20:16.333768+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:20:16.333768+0000","last_undegraded":"2023-10-03T19:20:16.333768+0000","last_fullsized":"2023-10-03T19:20:16.333768+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:51:39.452487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.312904+0000","last_change":"2023-10-03T19:20:16.312904+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.312904+0000","last_undegraded":"2023-10-03T19:20:16.312904+0000","last_fullsized":"2023-10-03T19:20:16.312904+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:41:46.307896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"108'3","reported_seq":16,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328281+0000","last_change":"2023-10-03T19:20:15.972534+0000","last_active":"2023-10-03T19:20:17.328281+0000","last_peered":"2023-10-03T19:20:17.328281+0000","last_clean":"2023-10-03T19:20:17.328281+0000","last_became_active":"2023-10-03T19:20:15.971724+0000","last_became_peered":"2023-10-03T19:20:15.971724+0000","last_unstale":"2023-10-03T19:20:17.328281+0000","last_undegraded":"2023-10-03T19:20:17.328281+0000","last_fullsized":"2023-10-03T19:20:17.328281+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:30:57.635979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":172,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.327393+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:20:16.327393+0000","last_peered":"2023-10-03T19:20:16.327393+0000","last_clean":"2023-10-03T19:20:16.327393+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:20:16.327393+0000","last_undegraded":"2023-10-03T19:20:16.327393+0000","last_fullsized":"2023-10-03T19:20:16.327393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:38:41.426039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328937+0000","last_change":"2023-10-03T19:20:16.367253+0000","last_active":"2023-10-03T19:20:17.328937+0000","last_peered":"2023-10-03T19:20:17.328937+0000","last_clean":"2023-10-03T19:20:17.328937+0000","last_became_active":"2023-10-03T19:20:16.366622+0000","last_became_peered":"2023-10-03T19:20:16.366622+0000","last_unstale":"2023-10-03T19:20:17.328937+0000","last_undegraded":"2023-10-03T19:20:17.328937+0000","last_fullsized":"2023-10-03T19:20:17.328937+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:09:15.902309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"108'5","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.315568+0000","last_change":"2023-10-03T19:20:15.962877+0000","last_active":"2023-10-03T19:20:16.315568+0000","last_peered":"2023-10-03T19:20:16.315568+0000","last_clean":"2023-10-03T19:20:16.315568+0000","last_became_active":"2023-10-03T19:20:15.962063+0000","last_became_peered":"2023-10-03T19:20:15.962063+0000","last_unstale":"2023-10-03T19:20:16.315568+0000","last_undegraded":"2023-10-03T19:20:16.315568+0000","last_fullsized":"2023-10-03T19:20:16.315568+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:44:05.865560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.330163+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:20:17.330163+0000","last_peered":"2023-10-03T19:20:17.330163+0000","last_clean":"2023-10-03T19:20:17.330163+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:20:17.330163+0000","last_undegraded":"2023-10-03T19:20:17.330163+0000","last_fullsized":"2023-10-03T19:20:17.330163+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:17:59.521194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":1470,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509538,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34160,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":32768,"kb_avail":94337680,"statfs":{"total":96636764160,"available":96601784320,"internally_reserved":0,"allocated":1417216,"data_stored":1203428,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":33554432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.85899999999999999,"15min":0.92700000000000005},"min":{"1min":0.66300000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1950000000000001,"5min":1.206,"15min":4.0469999999999997},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.85299999999999998,"15min":0.82099999999999995},"min":{"1min":0.55200000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.177,"5min":1.2310000000000001,"15min":1.3420000000000001},"last":1.2230000000000001}]},{"osd":1,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.86299999999999999,"15min":0.98599999999999999},"min":{"1min":0.61899999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1359999999999999,"5min":1.3200000000000001,"15min":3.8239999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.89800000000000002,"15min":0.87},"min":{"1min":0.64500000000000002,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.91100000000000003}]},{"osd":2,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.95899999999999996,"15min":0.88400000000000001},"min":{"1min":0.55300000000000005,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1719999999999999,"5min":6.0449999999999999,"15min":6.0449999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.94199999999999995,"15min":1.0109999999999999},"min":{"1min":0.69999999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.296,"5min":1.5800000000000001,"15min":3.98},"last":1.161}]},{"osd":3,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.034,"15min":0.95799999999999996},"min":{"1min":0.68500000000000005,"5min":0.63800000000000001,"15min":0.51100000000000001},"max":{"1min":1.232,"5min":6.125,"15min":6.125},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.97599999999999998,"15min":1.0840000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.175,"5min":1.444,"15min":3.9140000000000001},"last":1.2509999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.89800000000000002,"15min":1.0920000000000001},"min":{"1min":0.61599999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":5.1130000000000004},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.016,"15min":1.018},"min":{"1min":0.70699999999999996,"5min":0.629,"15min":0.629},"max":{"1min":1.214,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":1.107}]},{"osd":5,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.006,"15min":1.2010000000000001},"min":{"1min":0.63700000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2470000000000001,"5min":1.349,"15min":5.1859999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.0209999999999999,"15min":1.115},"min":{"1min":0.69299999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.29,"5min":1.2949999999999999,"15min":2.0609999999999999},"last":1.133}]},{"osd":6,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0740000000000001,"15min":1.093},"min":{"1min":0.80000000000000004,"5min":0.75700000000000001,"15min":0.69399999999999995},"max":{"1min":1.3839999999999999,"5min":1.4890000000000001,"15min":1.5449999999999999},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.1459999999999999,"15min":1.167},"min":{"1min":0.77800000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.232,"5min":6.1580000000000004,"15min":6.1580000000000004},"last":1.2}]}]},{"osd":6,"up_from":15,"seq":64424509538,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":30144,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":1335296,"data_stored":611702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30867456},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.84599999999999997,"15min":0.82699999999999996},"min":{"1min":0.54100000000000004,"5min":0.45400000000000001,"15min":0.44600000000000001},"max":{"1min":1.234,"5min":1.3340000000000001,"15min":1.504},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.91100000000000003,"15min":0.88900000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.44600000000000001},"max":{"1min":1.1080000000000001,"5min":1.423,"15min":1.839},"last":0.91200000000000003}]},{"osd":1,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.86699999999999999,"15min":0.84699999999999998},"min":{"1min":0.56000000000000005,"5min":0.52100000000000002,"15min":0.504},"max":{"1min":1.1859999999999999,"5min":1.27,"15min":2.0150000000000001},"last":0.751},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.88900000000000001,"15min":0.88200000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.161,"5min":1.448,"15min":1.448},"last":0.70399999999999996}]},{"osd":2,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.93799999999999994,"15min":0.88900000000000001},"min":{"1min":0.66400000000000003,"5min":0.59199999999999997,"15min":0.51900000000000002},"max":{"1min":1.4430000000000001,"5min":1.528,"15min":1.528},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.92700000000000005,"15min":0.92500000000000004},"min":{"1min":0.60899999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1519999999999999,"5min":1.369,"15min":1.546},"last":0.81299999999999994}]},{"osd":3,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.96299999999999997,"15min":0.97899999999999998},"min":{"1min":0.68899999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.298,"5min":1.377,"15min":1.6990000000000001},"last":1.1299999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90700000000000003,"15min":0.90800000000000003},"min":{"1min":0.70199999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.143,"5min":1.206,"15min":2.121},"last":0.86899999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.91600000000000004,"15min":0.998},"min":{"1min":0.67400000000000004,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.335,"5min":1.339,"15min":1.95},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.995,"15min":1.0680000000000001},"min":{"1min":0.64400000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4490000000000001,"5min":1.504,"15min":1.7709999999999999},"last":1.0069999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.90700000000000003,"15min":0.99199999999999999},"min":{"1min":0.624,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.226,"5min":1.3200000000000001,"15min":2.2570000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.048,"15min":1.103},"min":{"1min":0.71799999999999997,"5min":0.68300000000000005,"15min":0.68100000000000005},"max":{"1min":1.5009999999999999,"5min":1.524,"15min":2.0619999999999998},"last":1.1579999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.071,"15min":1.109},"min":{"1min":0.748,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.639,"5min":1.639,"15min":2.0049999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.032,"5min":1.044,"15min":1.0820000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.61899999999999999},"max":{"1min":1.3879999999999999,"5min":1.4350000000000001,"15min":2.4249999999999998},"last":1.2}]}]},{"osd":4,"up_from":15,"seq":64424509539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42540,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":41216,"kb_avail":94329300,"statfs":{"total":96636764160,"available":96593203200,"internally_reserved":0,"allocated":1347584,"data_stored":613848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":42205184},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":1.0600000000000001,"15min":0.875},"min":{"1min":0.64200000000000002,"5min":0.54700000000000004,"15min":0.50600000000000001},"max":{"1min":1.0600000000000001,"5min":17.686,"15min":17.686},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.90100000000000002,"5min":1.02,"15min":0.89000000000000001},"min":{"1min":0.64000000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.28,"5min":16.925999999999998,"15min":16.925999999999998},"last":0.86699999999999999}]},{"osd":1,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.085,"15min":0.98499999999999999},"min":{"1min":0.67700000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1759999999999999,"5min":16.640999999999998,"15min":16.640999999999998},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.91300000000000003,"5min":1.089,"15min":0.93400000000000005},"min":{"1min":0.67300000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.151,"5min":17.59,"15min":17.59},"last":1.0269999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.997,"15min":0.94299999999999995},"min":{"1min":0.70699999999999996,"5min":0.56200000000000006,"15min":0.53200000000000003},"max":{"1min":1.1180000000000001,"5min":8.5630000000000006,"15min":8.5630000000000006},"last":1.286},{"interface":"front","average":{"1min":0.93999999999999995,"5min":1.143,"15min":1.01},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.175,"5min":17.734000000000002,"15min":17.734000000000002},"last":1.1970000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.0880000000000001,"15min":0.94299999999999995},"min":{"1min":0.72499999999999998,"5min":0.61499999999999999,"15min":0.53900000000000003},"max":{"1min":1.242,"5min":16.98,"15min":16.98},"last":1.3740000000000001},{"interface":"front","average":{"1min":0.997,"5min":1.161,"15min":1.105},"min":{"1min":0.66900000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2789999999999999,"5min":16.434000000000001,"15min":16.434000000000001},"last":1.4099999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":1.1020000000000001,"15min":1.0820000000000001},"min":{"1min":0.624,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.143,"5min":17.782,"15min":17.782},"last":1.3360000000000001},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.96599999999999997,"15min":1.002},"min":{"1min":0.65700000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.264,"5min":1.708,"15min":1.708},"last":1.48}]},{"osd":6,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.3859999999999999,"15min":1.27},"min":{"1min":0.66000000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.2250000000000001,"5min":36.106000000000002,"15min":36.106000000000002},"last":1.6910000000000001},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.2450000000000001,"15min":1.216},"min":{"1min":0.86099999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.2410000000000001,"5min":17.646999999999998,"15min":17.646999999999998},"last":1.4530000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.226,"15min":1.1359999999999999},"min":{"1min":0.81200000000000006,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.421,"5min":17.042000000000002,"15min":17.042000000000002},"last":1.6519999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.3,"15min":1.262},"min":{"1min":0.83199999999999996,"5min":0.66400000000000003,"15min":0.63300000000000001},"max":{"1min":1.4670000000000001,"5min":16.32,"15min":16.32},"last":1.5429999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509539,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":31616,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1331200,"data_stored":611120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":32374784},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.79100000000000004,"15min":0.61299999999999999},"min":{"1min":0.47799999999999998,"5min":0.32200000000000001,"15min":0.247},"max":{"1min":0.98199999999999998,"5min":13.629,"15min":13.629},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":1.206,"15min":0.80900000000000005},"min":{"1min":0.34000000000000002,"5min":0.30299999999999999,"15min":0.28999999999999998},"max":{"1min":0.97199999999999998,"5min":40.439,"15min":40.439},"last":0.91400000000000003}]},{"osd":1,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.90200000000000002,"15min":0.71099999999999997},"min":{"1min":0.47899999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1,"5min":14.074,"15min":14.074},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.78500000000000003,"15min":0.64900000000000002},"min":{"1min":0.38800000000000001,"5min":0.34799999999999998,"15min":0.26400000000000001},"max":{"1min":1.1080000000000001,"5min":7.0060000000000002,"15min":7.0060000000000002},"last":0.57899999999999996}]},{"osd":3,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.90000000000000002,"15min":0.71299999999999997},"min":{"1min":0.36699999999999999,"5min":0.28899999999999998,"15min":0.224},"max":{"1min":1.05,"5min":13.423999999999999,"15min":13.423999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.0649999999999999,"15min":0.82899999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.36399999999999999},"max":{"1min":1.1220000000000001,"5min":18.568999999999999,"15min":18.568999999999999},"last":0.65100000000000002}]},{"osd":4,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.94999999999999996,"15min":0.878},"min":{"1min":0.64200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.105,"5min":1.718,"15min":1.718},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.3380000000000001,"15min":1.05},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.22,"5min":28.667999999999999,"15min":28.667999999999999},"last":0.98599999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.0529999999999999,"15min":0.92100000000000004},"min":{"1min":0.67600000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.399,"5min":5.4459999999999997,"15min":5.4459999999999997},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.2230000000000001,"15min":1.0309999999999999},"min":{"1min":0.63300000000000001,"5min":0.57599999999999996,"15min":0.52700000000000002},"max":{"1min":1.4970000000000001,"5min":14.007,"15min":14.007},"last":0.84099999999999997}]},{"osd":6,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":1.1040000000000001,"15min":0.97099999999999997},"min":{"1min":0.65900000000000003,"5min":0.60099999999999998,"15min":0.49099999999999999},"max":{"1min":1.212,"5min":10.679,"15min":10.679},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.087,"15min":1.004},"min":{"1min":0.75600000000000001,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.325,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.1439999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.3240000000000001,"15min":1.1080000000000001},"min":{"1min":0.70299999999999996,"5min":0.63100000000000001,"15min":0.56100000000000005},"max":{"1min":1.415,"5min":18.623000000000001,"15min":18.623000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.0920000000000001,"15min":0.996},"min":{"1min":0.61699999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1850000000000001,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":1.016}]}]},{"osd":1,"up_from":15,"seq":64424509538,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31012,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":29696,"kb_avail":94340828,"statfs":{"total":96636764160,"available":96605007872,"internally_reserved":0,"allocated":1339392,"data_stored":612306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30408704},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59199999999999997,"15min":0.55600000000000005},"min":{"1min":0.27900000000000003,"5min":0.27200000000000002,"15min":0.26900000000000002},"max":{"1min":0.92100000000000004,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70399999999999996,"15min":0.56799999999999995},"min":{"1min":0.41799999999999998,"5min":0.27200000000000002,"15min":0.22900000000000001},"max":{"1min":1.1899999999999999,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.01}]},{"osd":2,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68300000000000005,"15min":0.58899999999999997},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.26200000000000001},"max":{"1min":0.879,"5min":1.506,"15min":1.506},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.82099999999999995,"15min":0.70599999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.312},"max":{"1min":1.1919999999999999,"5min":1.365,"15min":1.365},"last":0.89500000000000002}]},{"osd":3,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.76400000000000001,"15min":0.67300000000000004},"min":{"1min":0.36099999999999999,"5min":0.31,"15min":0.31},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.75700000000000001,"15min":0.63400000000000001},"min":{"1min":0.39100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.90700000000000003,"5min":1.232,"15min":1.27},"last":0.95299999999999996}]},{"osd":4,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.89000000000000001,"15min":0.82799999999999996},"min":{"1min":0.61199999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0860000000000001,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.98499999999999999,"15min":0.91400000000000003},"min":{"1min":0.69899999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3260000000000001,"5min":1.728,"15min":1.728},"last":0.77500000000000002}]},{"osd":5,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.98999999999999999,"15min":0.89500000000000002},"min":{"1min":0.60299999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.28,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.96299999999999997,"15min":0.88500000000000001},"min":{"1min":0.77300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.198,"5min":1.3959999999999999,"15min":1.6080000000000001},"last":0.74399999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0349999999999999,"15min":0.95399999999999996},"min":{"1min":0.59499999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2689999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.204},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0289999999999999,"15min":0.93400000000000005},"min":{"1min":0.66700000000000004,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3600000000000001,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.2470000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0669999999999999,"15min":0.97599999999999998},"min":{"1min":0.55100000000000005,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.292,"5min":1.673,"15min":1.673},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0289999999999999,"15min":0.93999999999999995},"min":{"1min":0.67500000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4379999999999999,"5min":1.5880000000000001,"15min":1.649},"last":1.1339999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542242,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25504,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":24192,"kb_avail":94346336,"statfs":{"total":96636764160,"available":96610648064,"internally_reserved":0,"allocated":1335296,"data_stored":612284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24772608},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.63200000000000001,"15min":0.58799999999999997},"min":{"1min":0.36399999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.96199999999999997,"5min":1.212,"15min":1.212},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.69999999999999996,"15min":0.66000000000000003},"min":{"1min":0.38900000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.5,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.82799999999999996}]},{"osd":1,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.70399999999999996,"15min":0.64800000000000002},"min":{"1min":0.42299999999999999,"5min":0.28599999999999998,"15min":0.27000000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76000000000000001,"15min":0.69099999999999995},"min":{"1min":0.34300000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.169,"5min":1.2210000000000001,"15min":1.222},"last":0.95899999999999996}]},{"osd":2,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.79400000000000004,"15min":0.73299999999999998},"min":{"1min":0.35999999999999999,"5min":0.317,"15min":0.317},"max":{"1min":1.1539999999999999,"5min":1.23,"15min":1.23},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73199999999999998,"15min":0.66000000000000003},"min":{"1min":0.371,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.05,"5min":1.671,"15min":1.671},"last":0.71599999999999997}]},{"osd":4,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.92000000000000004,"15min":0.91200000000000003},"min":{"1min":0.63900000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2949999999999999,"5min":1.411,"15min":1.496},"last":1.052},{"interface":"front","average":{"1min":1.006,"5min":1.018,"15min":0.95599999999999996},"min":{"1min":0.76400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3280000000000001,"5min":1.546,"15min":1.546},"last":1.085}]},{"osd":5,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.91200000000000003,"15min":0.88700000000000001},"min":{"1min":0.63300000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.095,"5min":1.581,"15min":1.581},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.022,"15min":1.004},"min":{"1min":0.68100000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4179999999999999,"5min":1.498,"15min":1.498},"last":1.173}]},{"osd":6,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.94599999999999995,"15min":0.92800000000000005},"min":{"1min":0.68799999999999994,"5min":0.56999999999999995,"15min":0.56699999999999995},"max":{"1min":1.212,"5min":1.347,"15min":1.347},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.05,"15min":1.006},"min":{"1min":0.80000000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.373,"5min":1.4970000000000001,"15min":1.5629999999999999},"last":1.1339999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.083,"15min":1.0289999999999999},"min":{"1min":0.70599999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.151},{"interface":"front","average":{"1min":1.109,"5min":1.0609999999999999,"15min":1.03},"min":{"1min":0.65300000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.659,"5min":1.659,"15min":1.708},"last":1.294}]}]},{"osd":5,"up_from":13,"seq":55834574946,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23284,"kb_used_data":1324,"kb_used_omap":0,"kb_used_meta":21952,"kb_avail":94348556,"statfs":{"total":96636764160,"available":96612921344,"internally_reserved":0,"allocated":1355776,"data_stored":619097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22478848},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.85799999999999998,"15min":0.83399999999999996},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.181,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.89400000000000002,"15min":0.86599999999999999},"min":{"1min":0.78200000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.26,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.70599999999999996}]},{"osd":1,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.872,"15min":0.84499999999999997},"min":{"1min":0.505,"5min":0.501,"15min":0.501},"max":{"1min":1.044,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.052},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.91000000000000003,"15min":0.92300000000000004},"min":{"1min":0.63100000000000001,"5min":0.58699999999999997,"15min":0.57099999999999995},"max":{"1min":1.23,"5min":1.23,"15min":1.514},"last":0.86099999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.91000000000000003,"15min":0.90300000000000002},"min":{"1min":0.625,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2010000000000001,"5min":1.351,"15min":1.3700000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.999,"5min":0.93000000000000005,"15min":0.90600000000000003},"min":{"1min":0.82499999999999996,"5min":0.57099999999999995,"15min":0.53300000000000003},"max":{"1min":1.1819999999999999,"5min":1.1930000000000001,"15min":1.3320000000000001},"last":0.76300000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.93600000000000005,"15min":0.93100000000000005},"min":{"1min":0.67700000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2210000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.046,"5min":1.03,"15min":1.028},"min":{"1min":0.78700000000000003,"5min":0.65900000000000003,"15min":0.61199999999999999},"max":{"1min":1.3129999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.99099999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.97499999999999998,"15min":0.97299999999999998},"min":{"1min":0.70699999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.2450000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.167},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96399999999999997,"15min":1.0129999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2749999999999999,"5min":1.335,"15min":1.7709999999999999},"last":1.2130000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.995,"15min":1.024},"min":{"1min":0.67000000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.204,"5min":1.546,"15min":1.546},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0880000000000001,"15min":1.1240000000000001},"min":{"1min":0.82499999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.3759999999999999,"5min":1.823,"15min":1.823},"last":1.2470000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0569999999999999,"15min":1.071},"min":{"1min":0.68700000000000006,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.5680000000000001},"last":1.302},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.119,"15min":1.143},"min":{"1min":0.86499999999999999,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.325,"5min":1.4179999999999999,"15min":1.9099999999999999},"last":1.1020000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574947,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30700,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":29312,"kb_avail":94341140,"statfs":{"total":96636764160,"available":96605327360,"internally_reserved":0,"allocated":1413120,"data_stored":1208163,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":30015488},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.69699999999999995,"15min":0.61399999999999999},"min":{"1min":0.502,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.92000000000000004,"5min":5.7480000000000002,"15min":5.7480000000000002},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.80900000000000005,"15min":0.746},"min":{"1min":0.54700000000000004,"5min":0.37,"15min":0.33000000000000002},"max":{"1min":1.0760000000000001,"5min":6.274,"15min":6.274},"last":0.81799999999999995}]},{"osd":2,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.81999999999999995,"15min":0.746},"min":{"1min":0.46700000000000003,"5min":0.36499999999999999,"15min":0.35399999999999998},"max":{"1min":0.97599999999999998,"5min":6.1609999999999996,"15min":6.1609999999999996},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71499999999999997,"15min":0.69899999999999995},"min":{"1min":0.44500000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.997,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.56399999999999995}]},{"osd":3,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.90800000000000003,"15min":0.78000000000000003},"min":{"1min":0.57499999999999996,"5min":0.41799999999999998,"15min":0.36799999999999999},"max":{"1min":1.1739999999999999,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":1.05},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82199999999999995,"15min":0.73199999999999998},"min":{"1min":0.53300000000000003,"5min":0.376,"15min":0.30299999999999999},"max":{"1min":1.0780000000000001,"5min":1.375,"15min":1.375},"last":0.79100000000000004}]},{"osd":4,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":1.0029999999999999,"15min":0.93600000000000005},"min":{"1min":0.71299999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.254,"5min":8.1159999999999997,"15min":8.1159999999999997},"last":1.01},{"interface":"front","average":{"1min":1.056,"5min":1.0860000000000001,"15min":1.0429999999999999},"min":{"1min":0.71199999999999997,"5min":0.57299999999999995,"15min":0.504},"max":{"1min":1.3440000000000001,"5min":6.2320000000000002,"15min":6.2320000000000002},"last":0.98099999999999998}]},{"osd":5,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.2549999999999999,"15min":1.1140000000000001},"min":{"1min":0.69199999999999995,"5min":0.59399999999999997,"15min":0.46899999999999997},"max":{"1min":1.4259999999999999,"5min":17.420000000000002,"15min":17.420000000000002},"last":1.143},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.222,"15min":1.052},"min":{"1min":0.74299999999999999,"5min":0.59499999999999997,"15min":0.54300000000000004},"max":{"1min":1.371,"5min":17.643000000000001,"15min":17.643000000000001},"last":1.0780000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0880000000000001,"15min":1.038},"min":{"1min":0.77500000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3520000000000001,"5min":5.7220000000000004,"15min":5.7220000000000004},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0669999999999999,"15min":1.0129999999999999},"min":{"1min":0.877,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.417,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.2110000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.159,"15min":1.0740000000000001},"min":{"1min":0.81299999999999994,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3939999999999999,"5min":5.7800000000000002,"15min":5.7800000000000002},"last":1.244},{"interface":"front","average":{"1min":1.091,"5min":1.0920000000000001,"15min":1.0669999999999999},"min":{"1min":0.85699999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.343,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.27}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:20:21.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3e is not active+clean 2023-10-03T19:20:21.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3e', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 108, 'state': 'creating+activating', 'last_fresh': '2023-10-03T19:20:16.313689+0000', 'last_change': '2023-10-03T19:20:16.313689+0000', 'last_active': '2023-10-03T19:20:15.906015+0000', 'last_peered': '2023-10-03T19:20:15.906015+0000', 'last_clean': '2023-10-03T19:20:15.906015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:20:16.313689+0000', 'last_undegraded': '2023-10-03T19:20:16.313689+0000', 'last_fullsized': '2023-10-03T19:20:16.313689+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:20:15.906015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:20:15.906015+0000', 'last_clean_scrub_stamp': '2023-10-03T19:20:15.906015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-05T03:46:55.330519+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': ['3', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:20:21.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3d is not active+clean 2023-10-03T19:20:21.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3d', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 108, 'state': 'creating+activating', 'last_fresh': '2023-10-03T19:20:16.319563+0000', 'last_change': '2023-10-03T19:20:16.319563+0000', 'last_active': '2023-10-03T19:20:15.906015+0000', 'last_peered': '2023-10-03T19:20:15.906015+0000', 'last_clean': '2023-10-03T19:20:15.906015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:20:16.319563+0000', 'last_undegraded': '2023-10-03T19:20:16.319563+0000', 'last_fullsized': '2023-10-03T19:20:16.319563+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:20:15.906015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:20:15.906015+0000', 'last_clean_scrub_stamp': '2023-10-03T19:20:15.906015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-05T03:10:04.836594+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': ['3', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:20:21.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.38 is not active+clean 2023-10-03T19:20:21.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.38', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 108, 'state': 'creating+activating', 'last_fresh': '2023-10-03T19:20:16.313002+0000', 'last_change': '2023-10-03T19:20:16.313002+0000', 'last_active': '2023-10-03T19:20:15.906015+0000', 'last_peered': '2023-10-03T19:20:15.906015+0000', 'last_clean': '2023-10-03T19:20:15.906015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:20:16.313002+0000', 'last_undegraded': '2023-10-03T19:20:16.313002+0000', 'last_fullsized': '2023-10-03T19:20:16.313002+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:20:15.906015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:20:15.906015+0000', 'last_clean_scrub_stamp': '2023-10-03T19:20:15.906015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-04T23:58:50.794379+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': ['3', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:20:21.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.32 is not active+clean 2023-10-03T19:20:21.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.32', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 108, 'state': 'creating+activating', 'last_fresh': '2023-10-03T19:20:16.314003+0000', 'last_change': '2023-10-03T19:20:16.314003+0000', 'last_active': '2023-10-03T19:20:15.906015+0000', 'last_peered': '2023-10-03T19:20:15.906015+0000', 'last_clean': '2023-10-03T19:20:15.906015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:20:16.314003+0000', 'last_undegraded': '2023-10-03T19:20:16.314003+0000', 'last_fullsized': '2023-10-03T19:20:16.314003+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:20:15.906015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:20:15.906015+0000', 'last_clean_scrub_stamp': '2023-10-03T19:20:15.906015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-05T06:32:29.079841+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': ['3', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:20:21.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2e is not active+clean 2023-10-03T19:20:21.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2e', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 108, 'state': 'creating+activating', 'last_fresh': '2023-10-03T19:20:16.313320+0000', 'last_change': '2023-10-03T19:20:16.313320+0000', 'last_active': '2023-10-03T19:20:15.906015+0000', 'last_peered': '2023-10-03T19:20:15.906015+0000', 'last_clean': '2023-10-03T19:20:15.906015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:20:16.313320+0000', 'last_undegraded': '2023-10-03T19:20:16.313320+0000', 'last_fullsized': '2023-10-03T19:20:16.313320+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:20:15.906015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:20:15.906015+0000', 'last_clean_scrub_stamp': '2023-10-03T19:20:15.906015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-05T06:38:10.161375+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': ['3', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:20:21.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.22 is not active+clean 2023-10-03T19:20:21.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.22', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 108, 'state': 'creating+activating', 'last_fresh': '2023-10-03T19:20:16.313651+0000', 'last_change': '2023-10-03T19:20:16.313651+0000', 'last_active': '2023-10-03T19:20:15.906015+0000', 'last_peered': '2023-10-03T19:20:15.906015+0000', 'last_clean': '2023-10-03T19:20:15.906015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:20:16.313651+0000', 'last_undegraded': '2023-10-03T19:20:16.313651+0000', 'last_fullsized': '2023-10-03T19:20:16.313651+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:20:15.906015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:20:15.906015+0000', 'last_clean_scrub_stamp': '2023-10-03T19:20:15.906015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-05T03:29:43.899924+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': ['3', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:20:21.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.9 is not active+clean 2023-10-03T19:20:21.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.9', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 108, 'state': 'creating+activating', 'last_fresh': '2023-10-03T19:20:16.312802+0000', 'last_change': '2023-10-03T19:20:16.312802+0000', 'last_active': '2023-10-03T19:20:15.906015+0000', 'last_peered': '2023-10-03T19:20:15.906015+0000', 'last_clean': '2023-10-03T19:20:15.906015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:20:16.312802+0000', 'last_undegraded': '2023-10-03T19:20:16.312802+0000', 'last_fullsized': '2023-10-03T19:20:16.312802+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:20:15.906015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:20:15.906015+0000', 'last_clean_scrub_stamp': '2023-10-03T19:20:15.906015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-05T05:16:52.366869+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': ['3', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:20:21.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.a is not active+clean 2023-10-03T19:20:21.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.a', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 108, 'state': 'creating+activating', 'last_fresh': '2023-10-03T19:20:16.314019+0000', 'last_change': '2023-10-03T19:20:16.314019+0000', 'last_active': '2023-10-03T19:20:15.906015+0000', 'last_peered': '2023-10-03T19:20:15.906015+0000', 'last_clean': '2023-10-03T19:20:15.906015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:20:16.314019+0000', 'last_undegraded': '2023-10-03T19:20:16.314019+0000', 'last_fullsized': '2023-10-03T19:20:16.314019+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:20:15.906015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:20:15.906015+0000', 'last_clean_scrub_stamp': '2023-10-03T19:20:15.906015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-04T19:35:03.160406+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': ['3', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:20:21.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1 is not active+clean 2023-10-03T19:20:21.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 108, 'state': 'creating+activating', 'last_fresh': '2023-10-03T19:20:16.312349+0000', 'last_change': '2023-10-03T19:20:16.312349+0000', 'last_active': '2023-10-03T19:20:15.906015+0000', 'last_peered': '2023-10-03T19:20:15.906015+0000', 'last_clean': '2023-10-03T19:20:15.906015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:20:16.312349+0000', 'last_undegraded': '2023-10-03T19:20:16.312349+0000', 'last_fullsized': '2023-10-03T19:20:16.312349+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:20:15.906015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:20:15.906015+0000', 'last_clean_scrub_stamp': '2023-10-03T19:20:15.906015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-05T04:27:20.469549+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': ['3', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:20:21.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.16 is not active+clean 2023-10-03T19:20:21.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.16', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 108, 'state': 'creating+activating', 'last_fresh': '2023-10-03T19:20:16.312904+0000', 'last_change': '2023-10-03T19:20:16.312904+0000', 'last_active': '2023-10-03T19:20:15.906015+0000', 'last_peered': '2023-10-03T19:20:15.906015+0000', 'last_clean': '2023-10-03T19:20:15.906015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T19:20:16.312904+0000', 'last_undegraded': '2023-10-03T19:20:16.312904+0000', 'last_fullsized': '2023-10-03T19:20:16.312904+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T19:20:15.906015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T19:20:15.906015+0000', 'last_clean_scrub_stamp': '2023-10-03T19:20:15.906015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-04T20:41:46.307896+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': ['3', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T19:20:21.128 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-03T19:20:21.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.284+0000 7f5bf4283640 1 Processor -- start 2023-10-03T19:20:21.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.284+0000 7f5bf4283640 1 -- start start 2023-10-03T19:20:21.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.284+0000 7f5bf4283640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bec148b90 0x7f5bec0bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:21.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.284+0000 7f5bf4283640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5bec0bcb60 0x7f5bec06c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:21.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.284+0000 7f5bf4283640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5bec0bc4a0 0x7f5bec06c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:21.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.284+0000 7f5bf4283640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bec0a3670 con 0x7f5bec0bc4a0 2023-10-03T19:20:21.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.284+0000 7f5bf4283640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bec14b370 con 0x7f5bec0bcb60 2023-10-03T19:20:21.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.284+0000 7f5bf4283640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec14b610 con 0x7f5bec148b90 2023-10-03T19:20:21.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.288+0000 7f5bf2820640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5bec0bc4a0 0x7f5bec06c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:21.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.288+0000 7f5bf2820640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5bec0bc4a0 0x7f5bec06c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42962/0 (socket says 172.21.15.45:42962) 2023-10-03T19:20:21.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.288+0000 7f5bf2820640 1 -- 172.21.15.45:0/1557058359 learned_addr learned my addr 172.21.15.45:0/1557058359 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:21.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.288+0000 7f5bf181e640 1 --2- 172.21.15.45:0/1557058359 >> v2:172.21.15.79:3300/0 conn(0x7f5bec0bcb60 0x7f5bec06c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:21.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.288+0000 7f5bf201f640 1 --2- 172.21.15.45:0/1557058359 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bec148b90 0x7f5bec0bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:21.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.288+0000 7f5bf2820640 1 -- 172.21.15.45:0/1557058359 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bec148b90 msgr2=0x7f5bec0bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:21.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.288+0000 7f5bf2820640 1 --2- 172.21.15.45:0/1557058359 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bec148b90 0x7f5bec0bbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:21.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.288+0000 7f5bf2820640 1 -- 172.21.15.45:0/1557058359 >> v2:172.21.15.79:3300/0 conn(0x7f5bec0bcb60 msgr2=0x7f5bec06c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:21.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.288+0000 7f5bf2820640 1 --2- 172.21.15.45:0/1557058359 >> v2:172.21.15.79:3300/0 conn(0x7f5bec0bcb60 0x7f5bec06c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:21.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.288+0000 7f5bf2820640 1 -- 172.21.15.45:0/1557058359 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec0a5580 con 0x7f5bec0bc4a0 2023-10-03T19:20:21.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.288+0000 7f5bf2820640 1 --2- 172.21.15.45:0/1557058359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bec0bc4a0 0x7f5bec06c7d0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0665f0 tx=0x7f5be401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93fe66bbf65b106 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:21.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.288+0000 7f5bf101d640 1 -- 172.21.15.45:0/1557058359 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be40af400 con 0x7f5bec0bc4a0 2023-10-03T19:20:21.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.288+0000 7f5bf101d640 1 -- 172.21.15.45:0/1557058359 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be40ab050 con 0x7f5bec0bc4a0 2023-10-03T19:20:21.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.288+0000 7f5bf101d640 1 -- 172.21.15.45:0/1557058359 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be40af780 con 0x7f5bec0bc4a0 2023-10-03T19:20:21.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5bf4283640 1 -- 172.21.15.45:0/1557058359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bec0bc4a0 msgr2=0x7f5bec06c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:21.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5bf4283640 1 --2- 172.21.15.45:0/1557058359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bec0bc4a0 0x7f5bec06c7d0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0665f0 tx=0x7f5be401f1c0 comp rx=0 tx=0).stop 2023-10-03T19:20:21.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5bf4283640 1 -- 172.21.15.45:0/1557058359 shutdown_connections 2023-10-03T19:20:21.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5bf4283640 1 --2- 172.21.15.45:0/1557058359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bec0bc4a0 0x7f5bec06c7d0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:21.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5bf4283640 1 --2- 172.21.15.45:0/1557058359 >> v2:172.21.15.79:3300/0 conn(0x7f5bec0bcb60 0x7f5bec06c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:21.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5bf4283640 1 --2- 172.21.15.45:0/1557058359 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bec148b90 0x7f5bec0bbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:21.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5bf4283640 1 -- 172.21.15.45:0/1557058359 >> 172.21.15.45:0/1557058359 conn(0x7f5bec0bcf50 msgr2=0x7f5bec0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:21.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5bf4283640 1 -- 172.21.15.45:0/1557058359 shutdown_connections 2023-10-03T19:20:21.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5bf4283640 1 -- 172.21.15.45:0/1557058359 wait complete. 2023-10-03T19:20:21.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5bf4283640 1 Processor -- start 2023-10-03T19:20:21.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5bf4283640 1 -- start start 2023-10-03T19:20:21.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5bf4283640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bec0bc4a0 0x7f5bec14ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:21.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5bf4283640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bec0bcb60 0x7f5bec0b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:21.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5bf4283640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bec148b90 0x7f5bec1454b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:21.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5bf4283640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec0b9250 con 0x7f5bec0bcb60 2023-10-03T19:20:21.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5bf4283640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec1e12c0 con 0x7f5bec148b90 2023-10-03T19:20:21.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5bf4283640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec1e1b20 con 0x7f5bec0bc4a0 2023-10-03T19:20:21.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5bf181e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bec0bcb60 0x7f5bec0b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:21.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5bf181e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bec0bcb60 0x7f5bec0b54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42978/0 (socket says 172.21.15.45:42978) 2023-10-03T19:20:21.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5bf181e640 1 -- 172.21.15.45:0/3783541390 learned_addr learned my addr 172.21.15.45:0/3783541390 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:21.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5bf201f640 1 --2- 172.21.15.45:0/3783541390 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bec0bc4a0 0x7f5bec14ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:21.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5bf2820640 1 --2- 172.21.15.45:0/3783541390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bec148b90 0x7f5bec1454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:21.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5bf181e640 1 -- 172.21.15.45:0/3783541390 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bec0bc4a0 msgr2=0x7f5bec14ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:21.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5bf181e640 1 --2- 172.21.15.45:0/3783541390 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bec0bc4a0 0x7f5bec14ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:21.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5bf181e640 1 -- 172.21.15.45:0/3783541390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bec148b90 msgr2=0x7f5bec1454b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:21.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5bf181e640 1 --2- 172.21.15.45:0/3783541390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bec148b90 0x7f5bec1454b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:21.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5bf181e640 1 -- 172.21.15.45:0/3783541390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be4009b30 con 0x7f5bec0bcb60 2023-10-03T19:20:21.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5bf181e640 1 --2- 172.21.15.45:0/3783541390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bec0bcb60 0x7f5bec0b54e0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00e930 tx=0x7f5bdc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:21.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5be2ffd640 1 -- 172.21.15.45:0/3783541390 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc009690 con 0x7f5bec0bcb60 2023-10-03T19:20:21.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5be2ffd640 1 -- 172.21.15.45:0/3783541390 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bdc00ca00 con 0x7f5bec0bcb60 2023-10-03T19:20:21.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5be2ffd640 1 -- 172.21.15.45:0/3783541390 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc00cd70 con 0x7f5bec0bcb60 2023-10-03T19:20:21.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5bf4283640 1 -- 172.21.15.45:0/3783541390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bec148f60 con 0x7f5bec0bcb60 2023-10-03T19:20:21.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.292+0000 7f5bf4283640 1 -- 172.21.15.45:0/3783541390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bec0a5820 con 0x7f5bec0bcb60 2023-10-03T19:20:21.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.296+0000 7f5bf4283640 1 -- 172.21.15.45:0/3783541390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bec0a3880 con 0x7f5bec0bcb60 2023-10-03T19:20:21.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.296+0000 7f5be2ffd640 1 -- 172.21.15.45:0/3783541390 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5bdc013470 con 0x7f5bec0bcb60 2023-10-03T19:20:21.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.296+0000 7f5be2ffd640 1 --2- 172.21.15.45:0/3783541390 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5bd0066280 0x7f5bd0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:21.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.296+0000 7f5be2ffd640 1 -- 172.21.15.45:0/3783541390 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5bdc0843a0 con 0x7f5bec0bcb60 2023-10-03T19:20:21.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.296+0000 7f5bf201f640 1 --2- 172.21.15.45:0/3783541390 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5bd0066280 0x7f5bd0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:21.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.296+0000 7f5bf201f640 1 --2- 172.21.15.45:0/3783541390 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5bd0066280 0x7f5bd0068730 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f5be8009910 tx=0x7f5be8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:21.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.300+0000 7f5be2ffd640 1 -- 172.21.15.45:0/3783541390 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5bdc0518d0 con 0x7f5bec0bcb60 2023-10-03T19:20:21.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.508+0000 7f5bf4283640 1 -- 172.21.15.45:0/3783541390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f5bec0ba210 con 0x7f5bec0bcb60 2023-10-03T19:20:21.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.512+0000 7f5be2ffd640 1 -- 172.21.15.45:0/3783541390 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1105 (secure 0 0 0) 0x7f5bdc054ef0 con 0x7f5bec0bcb60 2023-10-03T19:20:21.514 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:20:21.514 INFO:teuthology.orchestra.run.smithi045.stdout:{"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":495,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":109,"num_osds":8,"num_up_osds":8,"osd_up_since":1696360341,"num_in_osds":8,"osd_in_since":1696360332,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":95},{"state_name":"creating+activating","count":10}],"num_pgs":105,"num_pools":4,"num_objects":22,"data_bytes":591838,"bytes_used":257617920,"bytes_avail":772836495360,"bytes_total":773094113280,"inactive_pgs_ratio":0.095238097012042999,"write_bytes_sec":2335,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":58,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":7602}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2023-10-03T19:19:28.596810+0000","services":{}},"progress_events":{}} 2023-10-03T19:20:21.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.512+0000 7f5bf4283640 1 -- 172.21.15.45:0/3783541390 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5bd0066280 msgr2=0x7f5bd0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:21.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.512+0000 7f5bf4283640 1 --2- 172.21.15.45:0/3783541390 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5bd0066280 0x7f5bd0068730 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f5be8009910 tx=0x7f5be8008040 comp rx=0 tx=0).stop 2023-10-03T19:20:21.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.512+0000 7f5bf4283640 1 -- 172.21.15.45:0/3783541390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bec0bcb60 msgr2=0x7f5bec0b54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:21.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.512+0000 7f5bf4283640 1 --2- 172.21.15.45:0/3783541390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bec0bcb60 0x7f5bec0b54e0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00e930 tx=0x7f5bdc00edf0 comp rx=0 tx=0).stop 2023-10-03T19:20:21.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.512+0000 7f5bf4283640 1 -- 172.21.15.45:0/3783541390 shutdown_connections 2023-10-03T19:20:21.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.512+0000 7f5bf4283640 1 --2- 172.21.15.45:0/3783541390 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5bd0066280 0x7f5bd0068730 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:21.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.512+0000 7f5bf4283640 1 --2- 172.21.15.45:0/3783541390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bec148b90 0x7f5bec1454b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:21.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.512+0000 7f5bf4283640 1 --2- 172.21.15.45:0/3783541390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bec0bcb60 0x7f5bec0b54e0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:21.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.512+0000 7f5bf4283640 1 --2- 172.21.15.45:0/3783541390 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5bec0bc4a0 0x7f5bec14ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:21.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.512+0000 7f5bf4283640 1 -- 172.21.15.45:0/3783541390 >> 172.21.15.45:0/3783541390 conn(0x7f5bec0bcf50 msgr2=0x7f5bec147b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:21.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.512+0000 7f5bf4283640 1 -- 172.21.15.45:0/3783541390 shutdown_connections 2023-10-03T19:20:21.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.512+0000 7f5bf4283640 1 -- 172.21.15.45:0/3783541390 wait complete. 2023-10-03T19:20:21.531 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-03T19:20:21.531 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:20:21.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.636+0000 7f75cf992640 1 Processor -- start 2023-10-03T19:20:21.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.636+0000 7f75cf992640 1 -- start start 2023-10-03T19:20:21.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.636+0000 7f75cf992640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75c80bcb60 0x7f75c806c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:21.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.636+0000 7f75cf992640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75c814b610 con 0x7f75c8148b90 2023-10-03T19:20:21.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.636+0000 7f75cf992640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75c80a5580 con 0x7f75c806c7d0 2023-10-03T19:20:21.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.636+0000 7f75cf992640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c80a3670 con 0x7f75c80bcb60 2023-10-03T19:20:21.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.636+0000 7f75cd72e640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f75c8148b90 0x7f75c80bbf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54772/0 (socket says 172.21.15.45:54772) 2023-10-03T19:20:21.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75cd72e640 1 -- 172.21.15.45:0/1417407469 learned_addr learned my addr 172.21.15.45:0/1417407469 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:20:21.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75ccf2d640 1 --2- 172.21.15.45:0/1417407469 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75c80bcb60 0x7f75c806c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:21.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75bffff640 1 -- 172.21.15.45:0/1417407469 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471312489 0 0) 0x7f75c814b610 con 0x7f75c8148b90 2023-10-03T19:20:21.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75bffff640 1 -- 172.21.15.45:0/1417407469 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75b4003530 con 0x7f75c8148b90 2023-10-03T19:20:21.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75bffff640 1 -- 172.21.15.45:0/1417407469 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1338065506 0 0) 0x7f75b4003530 con 0x7f75c8148b90 2023-10-03T19:20:21.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75bffff640 1 -- 172.21.15.45:0/1417407469 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75c80bcb60 msgr2=0x7f75c806c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:21.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75bffff640 1 --2- 172.21.15.45:0/1417407469 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75c80bcb60 0x7f75c806c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:21.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75bffff640 1 -- 172.21.15.45:0/1417407469 >> v1:172.21.15.79:6789/0 conn(0x7f75c806c7d0 legacy=0x7f75c8155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:21.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75bffff640 1 -- 172.21.15.45:0/1417407469 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c80a5820 con 0x7f75c8148b90 2023-10-03T19:20:21.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75bffff640 1 -- 172.21.15.45:0/1417407469 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f75c4001680 con 0x7f75c8148b90 2023-10-03T19:20:21.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75bffff640 1 -- 172.21.15.45:0/1417407469 >> v1:172.21.15.45:6789/0 conn(0x7f75c8148b90 legacy=0x7f75c80bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:21.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75ccf2d640 1 --2- 172.21.15.45:0/1417407469 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75c80bcb60 0x7f75c806c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:20:21.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75bffff640 1 --2- 172.21.15.45:0/1417407469 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75b40039b0 0x7f75b4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:21.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75bffff640 1 --2- 172.21.15.45:0/1417407469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75b4004390 0x7f75b4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:21.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75bffff640 1 --2- 172.21.15.45:0/1417407469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75b4005050 0x7f75b400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:21.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75bffff640 1 -- 172.21.15.45:0/1417407469 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c80a3670 con 0x7f75b4005050 2023-10-03T19:20:21.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75bffff640 1 -- 172.21.15.45:0/1417407469 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b400bf60 con 0x7f75b4004390 2023-10-03T19:20:21.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75bffff640 1 -- 172.21.15.45:0/1417407469 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b400c120 con 0x7f75b40039b0 2023-10-03T19:20:21.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75cdf2f640 1 --2- 172.21.15.45:0/1417407469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75b4005050 0x7f75b400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:21.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75ccf2d640 1 --2- 172.21.15.45:0/1417407469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75b4004390 0x7f75b4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:21.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75cd72e640 1 --2- 172.21.15.45:0/1417407469 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75b40039b0 0x7f75b4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:21.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75cdf2f640 1 -- 172.21.15.45:0/1417407469 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75b40039b0 msgr2=0x7f75b4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:21.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75cdf2f640 1 --2- 172.21.15.45:0/1417407469 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75b40039b0 0x7f75b4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:21.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75cdf2f640 1 -- 172.21.15.45:0/1417407469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75b4004390 msgr2=0x7f75b4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:21.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75cdf2f640 1 --2- 172.21.15.45:0/1417407469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75b4004390 0x7f75b4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:21.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75cdf2f640 1 -- 172.21.15.45:0/1417407469 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b4003530 con 0x7f75b4005050 2023-10-03T19:20:21.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75ccf2d640 1 --2- 172.21.15.45:0/1417407469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75b4004390 0x7f75b4004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:21.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75cdf2f640 1 --2- 172.21.15.45:0/1417407469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75b4005050 0x7f75b400b990 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f75c0001e70 tx=0x7f75c001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8508b568e95b3db5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:21.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75bffff640 1 -- 172.21.15.45:0/1417407469 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c0003b80 con 0x7f75b4005050 2023-10-03T19:20:21.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75bffff640 1 -- 172.21.15.45:0/1417407469 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c0003ce0 con 0x7f75b4005050 2023-10-03T19:20:21.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75bffff640 1 -- 172.21.15.45:0/1417407469 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c00052c0 con 0x7f75b4005050 2023-10-03T19:20:21.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75cf992640 1 -- 172.21.15.45:0/1417407469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75b4005050 msgr2=0x7f75b400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:21.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75cf992640 1 --2- 172.21.15.45:0/1417407469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75b4005050 0x7f75b400b990 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f75c0001e70 tx=0x7f75c001c760 comp rx=0 tx=0).stop 2023-10-03T19:20:21.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75cdf2f640 1 -- 172.21.15.45:0/1417407469 reap_dead start 2023-10-03T19:20:21.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75cf992640 1 -- 172.21.15.45:0/1417407469 shutdown_connections 2023-10-03T19:20:21.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75cf992640 1 -- 172.21.15.45:0/1417407469 >> 172.21.15.45:0/1417407469 conn(0x7f75c80bcf50 msgr2=0x7f75c80bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:21.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75cf992640 1 -- 172.21.15.45:0/1417407469 shutdown_connections 2023-10-03T19:20:21.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.640+0000 7f75cf992640 1 -- 172.21.15.45:0/1417407469 wait complete. 2023-10-03T19:20:21.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.644+0000 7f75cf992640 1 Processor -- start 2023-10-03T19:20:21.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.644+0000 7f75cf992640 1 -- start start 2023-10-03T19:20:21.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.644+0000 7f75cf992640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75c8140d20 0x7f75c81410f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:21.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.644+0000 7f75cf992640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75c8141b50 0x7f75c813d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:21.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.644+0000 7f75cf992640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75c813d740 0x7f75c8142190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:21.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.644+0000 7f75cf992640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c81e5230 con 0x7f75c8140d20 2023-10-03T19:20:21.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.644+0000 7f75cf992640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c81e5500 con 0x7f75c813d740 2023-10-03T19:20:21.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.644+0000 7f75cf992640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c8141710 con 0x7f75c8141b50 2023-10-03T19:20:21.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.644+0000 7f75cd72e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75c8140d20 0x7f75c81410f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:21.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.644+0000 7f75cd72e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75c8140d20 0x7f75c81410f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43000/0 (socket says 172.21.15.45:43000) 2023-10-03T19:20:21.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.644+0000 7f75cd72e640 1 -- 172.21.15.45:0/1635866368 learned_addr learned my addr 172.21.15.45:0/1635866368 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:21.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.644+0000 7f75ccf2d640 1 --2- 172.21.15.45:0/1635866368 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75c8141b50 0x7f75c813d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:21.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.644+0000 7f75cdf2f640 1 --2- 172.21.15.45:0/1635866368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75c813d740 0x7f75c8142190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:21.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.644+0000 7f75cd72e640 1 -- 172.21.15.45:0/1635866368 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75c8141b50 msgr2=0x7f75c813d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:21.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.644+0000 7f75cd72e640 1 --2- 172.21.15.45:0/1635866368 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75c8141b50 0x7f75c813d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:21.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.644+0000 7f75cd72e640 1 -- 172.21.15.45:0/1635866368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75c813d740 msgr2=0x7f75c8142190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:21.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.644+0000 7f75cd72e640 1 --2- 172.21.15.45:0/1635866368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75c813d740 0x7f75c8142190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:21.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.644+0000 7f75cd72e640 1 -- 172.21.15.45:0/1635866368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c8148f60 con 0x7f75c8140d20 2023-10-03T19:20:21.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.644+0000 7f75cd72e640 1 --2- 172.21.15.45:0/1635866368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75c8140d20 0x7f75c81410f0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f75c400e8c0 tx=0x7f75c400ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:21.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.644+0000 7f75bdffb640 1 -- 172.21.15.45:0/1635866368 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c400c8d0 con 0x7f75c8140d20 2023-10-03T19:20:21.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.644+0000 7f75bdffb640 1 -- 172.21.15.45:0/1635866368 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c400ca50 con 0x7f75c8140d20 2023-10-03T19:20:21.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.644+0000 7f75cf992640 1 -- 172.21.15.45:0/1635866368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c80bc670 con 0x7f75c8140d20 2023-10-03T19:20:21.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.644+0000 7f75bdffb640 1 -- 172.21.15.45:0/1635866368 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c400ce00 con 0x7f75c8140d20 2023-10-03T19:20:21.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.644+0000 7f75cf992640 1 -- 172.21.15.45:0/1635866368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75c80a3880 con 0x7f75c8140d20 2023-10-03T19:20:21.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.644+0000 7f75cf992640 1 -- 172.21.15.45:0/1635866368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75c813df10 con 0x7f75c8140d20 2023-10-03T19:20:21.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.644+0000 7f75bdffb640 1 -- 172.21.15.45:0/1635866368 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f75c401d460 con 0x7f75c8140d20 2023-10-03T19:20:21.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.648+0000 7f75bdffb640 1 --2- 172.21.15.45:0/1635866368 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f75ac066280 0x7f75ac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:21.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.648+0000 7f75bdffb640 1 -- 172.21.15.45:0/1635866368 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f75c4083eb0 con 0x7f75c8140d20 2023-10-03T19:20:21.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.648+0000 7f75ccf2d640 1 --2- 172.21.15.45:0/1635866368 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f75ac066280 0x7f75ac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:21.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.648+0000 7f75ccf2d640 1 --2- 172.21.15.45:0/1635866368 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f75ac066280 0x7f75ac068730 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f75c8140cb0 tx=0x7f75b8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:21.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.652+0000 7f75bdffb640 1 -- 172.21.15.45:0/1635866368 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f75c4054e50 con 0x7f75c8140d20 2023-10-03T19:20:21.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.796+0000 7f75cf992640 1 -- 172.21.15.45:0/1635866368 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f75c81e5370 con 0x7f75ac066280 2023-10-03T19:20:21.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.820+0000 7f75bdffb640 1 -- 172.21.15.45:0/1635866368 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310114 (secure 0 0 0) 0x7f75c81e5370 con 0x7f75ac066280 2023-10-03T19:20:21.824 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:20:21.826 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:20:21.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.820+0000 7f75cf992640 1 -- 172.21.15.45:0/1635866368 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f75ac066280 msgr2=0x7f75ac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:21.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.820+0000 7f75cf992640 1 --2- 172.21.15.45:0/1635866368 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f75ac066280 0x7f75ac068730 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f75c8140cb0 tx=0x7f75b8008040 comp rx=0 tx=0).stop 2023-10-03T19:20:21.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.820+0000 7f75cf992640 1 -- 172.21.15.45:0/1635866368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75c8140d20 msgr2=0x7f75c81410f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:21.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.820+0000 7f75cf992640 1 --2- 172.21.15.45:0/1635866368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75c8140d20 0x7f75c81410f0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f75c400e8c0 tx=0x7f75c400ed80 comp rx=0 tx=0).stop 2023-10-03T19:20:21.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.824+0000 7f75cf992640 1 -- 172.21.15.45:0/1635866368 shutdown_connections 2023-10-03T19:20:21.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.824+0000 7f75cf992640 1 --2- 172.21.15.45:0/1635866368 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f75ac066280 0x7f75ac068730 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:21.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.824+0000 7f75cf992640 1 --2- 172.21.15.45:0/1635866368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75c813d740 0x7f75c8142190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:21.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.824+0000 7f75cf992640 1 --2- 172.21.15.45:0/1635866368 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f75c8141b50 0x7f75c813d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:21.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.824+0000 7f75cf992640 1 --2- 172.21.15.45:0/1635866368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75c8140d20 0x7f75c81410f0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:21.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.824+0000 7f75cf992640 1 -- 172.21.15.45:0/1635866368 >> 172.21.15.45:0/1635866368 conn(0x7f75c80bcf50 msgr2=0x7f75c80bfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:21.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.824+0000 7f75cf992640 1 -- 172.21.15.45:0/1635866368 shutdown_connections 2023-10-03T19:20:21.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:21.824+0000 7f75cf992640 1 -- 172.21.15.45:0/1635866368 wait complete. 2023-10-03T19:20:21.840 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":344,"stamp":"2023-10-03T19:20:20.613975+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591838,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":72,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":251580,"kb_used_data":10620,"kb_used_omap":0,"kb_used_meta":240896,"kb_avail":754723140,"statfs":{"total":773094113280,"available":772836495360,"internally_reserved":0,"allocated":10874880,"data_stored":6091948,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":246677504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":71,"apply_latency_ms":71,"commit_latency_ns":71000000,"apply_latency_ns":71000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1470,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.699671"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.359932+0000","last_change":"2023-10-03T19:20:16.343087+0000","last_active":"2023-10-03T19:20:16.359932+0000","last_peered":"2023-10-03T19:20:16.359932+0000","last_clean":"2023-10-03T19:20:16.359932+0000","last_became_active":"2023-10-03T19:20:16.342222+0000","last_became_peered":"2023-10-03T19:20:16.342222+0000","last_unstale":"2023-10-03T19:20:16.359932+0000","last_undegraded":"2023-10-03T19:20:16.359932+0000","last_fullsized":"2023-10-03T19:20:16.359932+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:50:10.917756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.313689+0000","last_change":"2023-10-03T19:20:16.313689+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.313689+0000","last_undegraded":"2023-10-03T19:20:16.313689+0000","last_fullsized":"2023-10-03T19:20:16.313689+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:46:55.330519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.319563+0000","last_change":"2023-10-03T19:20:16.319563+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.319563+0000","last_undegraded":"2023-10-03T19:20:16.319563+0000","last_fullsized":"2023-10-03T19:20:16.319563+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:10:04.836594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.388471+0000","last_change":"2023-10-03T19:20:16.366790+0000","last_active":"2023-10-03T19:20:16.388471+0000","last_peered":"2023-10-03T19:20:16.388471+0000","last_clean":"2023-10-03T19:20:16.388471+0000","last_became_active":"2023-10-03T19:20:16.366099+0000","last_became_peered":"2023-10-03T19:20:16.366099+0000","last_unstale":"2023-10-03T19:20:16.388471+0000","last_undegraded":"2023-10-03T19:20:16.388471+0000","last_fullsized":"2023-10-03T19:20:16.388471+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:38:23.411788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.384249+0000","last_change":"2023-10-03T19:20:16.380848+0000","last_active":"2023-10-03T19:20:16.384249+0000","last_peered":"2023-10-03T19:20:16.384249+0000","last_clean":"2023-10-03T19:20:16.384249+0000","last_became_active":"2023-10-03T19:20:16.379931+0000","last_became_peered":"2023-10-03T19:20:16.379931+0000","last_unstale":"2023-10-03T19:20:16.384249+0000","last_undegraded":"2023-10-03T19:20:16.384249+0000","last_fullsized":"2023-10-03T19:20:16.384249+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:38:10.161375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427524+0000","last_change":"2023-10-03T19:20:16.326785+0000","last_active":"2023-10-03T19:20:17.427524+0000","last_peered":"2023-10-03T19:20:17.427524+0000","last_clean":"2023-10-03T19:20:17.427524+0000","last_became_active":"2023-10-03T19:20:16.326450+0000","last_became_peered":"2023-10-03T19:20:16.326450+0000","last_unstale":"2023-10-03T19:20:17.427524+0000","last_undegraded":"2023-10-03T19:20:17.427524+0000","last_fullsized":"2023-10-03T19:20:17.427524+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:28:31.610677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427927+0000","last_change":"2023-10-03T19:20:16.361601+0000","last_active":"2023-10-03T19:20:17.427927+0000","last_peered":"2023-10-03T19:20:17.427927+0000","last_clean":"2023-10-03T19:20:17.427927+0000","last_became_active":"2023-10-03T19:20:16.361314+0000","last_became_peered":"2023-10-03T19:20:16.361314+0000","last_unstale":"2023-10-03T19:20:17.427927+0000","last_undegraded":"2023-10-03T19:20:17.427927+0000","last_fullsized":"2023-10-03T19:20:17.427927+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:21:09.278090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.313002+0000","last_change":"2023-10-03T19:20:16.313002+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.313002+0000","last_undegraded":"2023-10-03T19:20:16.313002+0000","last_fullsized":"2023-10-03T19:20:16.313002+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:58:50.794379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.388443+0000","last_change":"2023-10-03T19:20:16.366438+0000","last_active":"2023-10-03T19:20:16.388443+0000","last_peered":"2023-10-03T19:20:16.388443+0000","last_clean":"2023-10-03T19:20:16.388443+0000","last_became_active":"2023-10-03T19:20:16.365832+0000","last_became_peered":"2023-10-03T19:20:16.365832+0000","last_unstale":"2023-10-03T19:20:16.388443+0000","last_undegraded":"2023-10-03T19:20:16.388443+0000","last_fullsized":"2023-10-03T19:20:16.388443+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:25:32.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.337779+0000","last_change":"2023-10-03T19:20:16.333439+0000","last_active":"2023-10-03T19:20:16.337779+0000","last_peered":"2023-10-03T19:20:16.337779+0000","last_clean":"2023-10-03T19:20:16.337779+0000","last_became_active":"2023-10-03T19:20:16.332236+0000","last_became_peered":"2023-10-03T19:20:16.332236+0000","last_unstale":"2023-10-03T19:20:16.337779+0000","last_undegraded":"2023-10-03T19:20:16.337779+0000","last_fullsized":"2023-10-03T19:20:16.337779+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:44:23.426898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.374688+0000","last_change":"2023-10-03T19:20:16.369509+0000","last_active":"2023-10-03T19:20:16.374688+0000","last_peered":"2023-10-03T19:20:16.374688+0000","last_clean":"2023-10-03T19:20:16.374688+0000","last_became_active":"2023-10-03T19:20:16.368845+0000","last_became_peered":"2023-10-03T19:20:16.368845+0000","last_unstale":"2023-10-03T19:20:16.374688+0000","last_undegraded":"2023-10-03T19:20:16.374688+0000","last_fullsized":"2023-10-03T19:20:16.374688+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:44:06.881790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.428312+0000","last_change":"2023-10-03T19:20:16.326180+0000","last_active":"2023-10-03T19:20:17.428312+0000","last_peered":"2023-10-03T19:20:17.428312+0000","last_clean":"2023-10-03T19:20:17.428312+0000","last_became_active":"2023-10-03T19:20:16.325905+0000","last_became_peered":"2023-10-03T19:20:16.325905+0000","last_unstale":"2023-10-03T19:20:17.428312+0000","last_undegraded":"2023-10-03T19:20:17.428312+0000","last_fullsized":"2023-10-03T19:20:17.428312+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:12:28.137148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.365387+0000","last_change":"2023-10-03T19:20:16.363982+0000","last_active":"2023-10-03T19:20:16.365387+0000","last_peered":"2023-10-03T19:20:16.365387+0000","last_clean":"2023-10-03T19:20:16.365387+0000","last_became_active":"2023-10-03T19:20:16.363497+0000","last_became_peered":"2023-10-03T19:20:16.363497+0000","last_unstale":"2023-10-03T19:20:16.365387+0000","last_undegraded":"2023-10-03T19:20:16.365387+0000","last_fullsized":"2023-10-03T19:20:16.365387+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:08:32.046373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.314003+0000","last_change":"2023-10-03T19:20:16.314003+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.314003+0000","last_undegraded":"2023-10-03T19:20:16.314003+0000","last_fullsized":"2023-10-03T19:20:16.314003+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:32:29.079841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.374687+0000","last_change":"2023-10-03T19:20:16.369450+0000","last_active":"2023-10-03T19:20:16.374687+0000","last_peered":"2023-10-03T19:20:16.374687+0000","last_clean":"2023-10-03T19:20:16.374687+0000","last_became_active":"2023-10-03T19:20:16.368874+0000","last_became_peered":"2023-10-03T19:20:16.368874+0000","last_unstale":"2023-10-03T19:20:16.374687+0000","last_undegraded":"2023-10-03T19:20:16.374687+0000","last_fullsized":"2023-10-03T19:20:16.374687+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:32:29.079841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427088+0000","last_change":"2023-10-03T19:20:16.330466+0000","last_active":"2023-10-03T19:20:17.427088+0000","last_peered":"2023-10-03T19:20:17.427088+0000","last_clean":"2023-10-03T19:20:17.427088+0000","last_became_active":"2023-10-03T19:20:16.330201+0000","last_became_peered":"2023-10-03T19:20:16.330201+0000","last_unstale":"2023-10-03T19:20:17.427088+0000","last_undegraded":"2023-10-03T19:20:17.427088+0000","last_fullsized":"2023-10-03T19:20:17.427088+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:40:35.218183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.365365+0000","last_change":"2023-10-03T19:20:16.363892+0000","last_active":"2023-10-03T19:20:16.365365+0000","last_peered":"2023-10-03T19:20:16.365365+0000","last_clean":"2023-10-03T19:20:16.365365+0000","last_became_active":"2023-10-03T19:20:16.363606+0000","last_became_peered":"2023-10-03T19:20:16.363606+0000","last_unstale":"2023-10-03T19:20:16.365365+0000","last_undegraded":"2023-10-03T19:20:16.365365+0000","last_fullsized":"2023-10-03T19:20:16.365365+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:28:24.282225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.313320+0000","last_change":"2023-10-03T19:20:16.313320+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.313320+0000","last_undegraded":"2023-10-03T19:20:16.313320+0000","last_fullsized":"2023-10-03T19:20:16.313320+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:38:10.161375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.329432+0000","last_change":"2023-10-03T19:20:16.383943+0000","last_active":"2023-10-03T19:20:17.329432+0000","last_peered":"2023-10-03T19:20:17.329432+0000","last_clean":"2023-10-03T19:20:17.329432+0000","last_became_active":"2023-10-03T19:20:16.383157+0000","last_became_peered":"2023-10-03T19:20:16.383157+0000","last_unstale":"2023-10-03T19:20:17.329432+0000","last_undegraded":"2023-10-03T19:20:17.329432+0000","last_fullsized":"2023-10-03T19:20:17.329432+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:34:17.223181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.318797+0000","last_change":"2023-10-03T19:20:16.322423+0000","last_active":"2023-10-03T19:20:17.318797+0000","last_peered":"2023-10-03T19:20:17.318797+0000","last_clean":"2023-10-03T19:20:17.318797+0000","last_became_active":"2023-10-03T19:20:16.322147+0000","last_became_peered":"2023-10-03T19:20:16.322147+0000","last_unstale":"2023-10-03T19:20:17.318797+0000","last_undegraded":"2023-10-03T19:20:17.318797+0000","last_fullsized":"2023-10-03T19:20:17.318797+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:12:31.453399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.388755+0000","last_change":"2023-10-03T19:20:16.372224+0000","last_active":"2023-10-03T19:20:16.388755+0000","last_peered":"2023-10-03T19:20:16.388755+0000","last_clean":"2023-10-03T19:20:16.388755+0000","last_became_active":"2023-10-03T19:20:16.371522+0000","last_became_peered":"2023-10-03T19:20:16.371522+0000","last_unstale":"2023-10-03T19:20:16.388755+0000","last_undegraded":"2023-10-03T19:20:16.388755+0000","last_fullsized":"2023-10-03T19:20:16.388755+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:37:56.189574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.364672+0000","last_change":"2023-10-03T19:20:16.348420+0000","last_active":"2023-10-03T19:20:16.364672+0000","last_peered":"2023-10-03T19:20:16.364672+0000","last_clean":"2023-10-03T19:20:16.364672+0000","last_became_active":"2023-10-03T19:20:16.347688+0000","last_became_peered":"2023-10-03T19:20:16.347688+0000","last_unstale":"2023-10-03T19:20:16.364672+0000","last_undegraded":"2023-10-03T19:20:16.364672+0000","last_fullsized":"2023-10-03T19:20:16.364672+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:35:03.160406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.388852+0000","last_change":"2023-10-03T19:20:16.373061+0000","last_active":"2023-10-03T19:20:16.388852+0000","last_peered":"2023-10-03T19:20:16.388852+0000","last_clean":"2023-10-03T19:20:16.388852+0000","last_became_active":"2023-10-03T19:20:16.372301+0000","last_became_peered":"2023-10-03T19:20:16.372301+0000","last_unstale":"2023-10-03T19:20:16.388852+0000","last_undegraded":"2023-10-03T19:20:16.388852+0000","last_fullsized":"2023-10-03T19:20:16.388852+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:32:36.381349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.326772+0000","last_change":"2023-10-03T19:20:16.378738+0000","last_active":"2023-10-03T19:20:17.326772+0000","last_peered":"2023-10-03T19:20:17.326772+0000","last_clean":"2023-10-03T19:20:17.326772+0000","last_became_active":"2023-10-03T19:20:16.378316+0000","last_became_peered":"2023-10-03T19:20:16.378316+0000","last_unstale":"2023-10-03T19:20:17.326772+0000","last_undegraded":"2023-10-03T19:20:17.326772+0000","last_fullsized":"2023-10-03T19:20:17.326772+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:48:24.816920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328599+0000","last_change":"2023-10-03T19:20:16.360114+0000","last_active":"2023-10-03T19:20:17.328599+0000","last_peered":"2023-10-03T19:20:17.328599+0000","last_clean":"2023-10-03T19:20:17.328599+0000","last_became_active":"2023-10-03T19:20:16.359471+0000","last_became_peered":"2023-10-03T19:20:16.359471+0000","last_unstale":"2023-10-03T19:20:17.328599+0000","last_undegraded":"2023-10-03T19:20:17.328599+0000","last_fullsized":"2023-10-03T19:20:17.328599+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:37:47.071602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.318972+0000","last_change":"2023-10-03T19:20:16.332688+0000","last_active":"2023-10-03T19:20:17.318972+0000","last_peered":"2023-10-03T19:20:17.318972+0000","last_clean":"2023-10-03T19:20:17.318972+0000","last_became_active":"2023-10-03T19:20:16.332406+0000","last_became_peered":"2023-10-03T19:20:16.332406+0000","last_unstale":"2023-10-03T19:20:17.318972+0000","last_undegraded":"2023-10-03T19:20:17.318972+0000","last_fullsized":"2023-10-03T19:20:17.318972+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:56:57.997822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.329517+0000","last_change":"2023-10-03T19:20:16.383652+0000","last_active":"2023-10-03T19:20:17.329517+0000","last_peered":"2023-10-03T19:20:17.329517+0000","last_clean":"2023-10-03T19:20:17.329517+0000","last_became_active":"2023-10-03T19:20:16.382532+0000","last_became_peered":"2023-10-03T19:20:16.382532+0000","last_unstale":"2023-10-03T19:20:17.329517+0000","last_undegraded":"2023-10-03T19:20:17.329517+0000","last_fullsized":"2023-10-03T19:20:17.329517+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:13:33.426772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.428479+0000","last_change":"2023-10-03T19:20:16.363654+0000","last_active":"2023-10-03T19:20:17.428479+0000","last_peered":"2023-10-03T19:20:17.428479+0000","last_clean":"2023-10-03T19:20:17.428479+0000","last_became_active":"2023-10-03T19:20:16.363344+0000","last_became_peered":"2023-10-03T19:20:16.363344+0000","last_unstale":"2023-10-03T19:20:17.428479+0000","last_undegraded":"2023-10-03T19:20:17.428479+0000","last_fullsized":"2023-10-03T19:20:17.428479+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:52:35.362235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.318244+0000","last_change":"2023-10-03T19:20:16.327198+0000","last_active":"2023-10-03T19:20:17.318244+0000","last_peered":"2023-10-03T19:20:17.318244+0000","last_clean":"2023-10-03T19:20:17.318244+0000","last_became_active":"2023-10-03T19:20:16.326730+0000","last_became_peered":"2023-10-03T19:20:16.326730+0000","last_unstale":"2023-10-03T19:20:17.318244+0000","last_undegraded":"2023-10-03T19:20:17.318244+0000","last_fullsized":"2023-10-03T19:20:17.318244+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:40:02.105613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.313651+0000","last_change":"2023-10-03T19:20:16.313651+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.313651+0000","last_undegraded":"2023-10-03T19:20:16.313651+0000","last_fullsized":"2023-10-03T19:20:16.313651+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:29:43.899924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.327148+0000","last_change":"2023-10-03T19:20:16.336333+0000","last_active":"2023-10-03T19:20:17.327148+0000","last_peered":"2023-10-03T19:20:17.327148+0000","last_clean":"2023-10-03T19:20:17.327148+0000","last_became_active":"2023-10-03T19:20:16.328732+0000","last_became_peered":"2023-10-03T19:20:16.328732+0000","last_unstale":"2023-10-03T19:20:17.327148+0000","last_undegraded":"2023-10-03T19:20:17.327148+0000","last_fullsized":"2023-10-03T19:20:17.327148+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:38:34.923323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.326771+0000","last_change":"2023-10-03T19:20:16.357185+0000","last_active":"2023-10-03T19:20:17.326771+0000","last_peered":"2023-10-03T19:20:17.326771+0000","last_clean":"2023-10-03T19:20:17.326771+0000","last_became_active":"2023-10-03T19:20:16.356591+0000","last_became_peered":"2023-10-03T19:20:16.356591+0000","last_unstale":"2023-10-03T19:20:17.326771+0000","last_undegraded":"2023-10-03T19:20:17.326771+0000","last_fullsized":"2023-10-03T19:20:17.326771+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:36:02.147396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.336171+0000","last_change":"2023-10-03T19:20:16.332773+0000","last_active":"2023-10-03T19:20:16.336171+0000","last_peered":"2023-10-03T19:20:16.336171+0000","last_clean":"2023-10-03T19:20:16.336171+0000","last_became_active":"2023-10-03T19:20:16.332432+0000","last_became_peered":"2023-10-03T19:20:16.332432+0000","last_unstale":"2023-10-03T19:20:16.336171+0000","last_undegraded":"2023-10-03T19:20:16.336171+0000","last_fullsized":"2023-10-03T19:20:16.336171+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:06:21.719875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"108'4","reported_seq":17,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.330032+0000","last_change":"2023-10-03T19:20:15.974915+0000","last_active":"2023-10-03T19:20:17.330032+0000","last_peered":"2023-10-03T19:20:17.330032+0000","last_clean":"2023-10-03T19:20:17.330032+0000","last_became_active":"2023-10-03T19:20:15.974027+0000","last_became_peered":"2023-10-03T19:20:15.974027+0000","last_unstale":"2023-10-03T19:20:17.330032+0000","last_undegraded":"2023-10-03T19:20:17.330032+0000","last_fullsized":"2023-10-03T19:20:17.330032+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:42:02.754043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427780+0000","last_change":"2023-10-03T19:20:16.328760+0000","last_active":"2023-10-03T19:20:17.427780+0000","last_peered":"2023-10-03T19:20:17.427780+0000","last_clean":"2023-10-03T19:20:17.427780+0000","last_became_active":"2023-10-03T19:20:16.328456+0000","last_became_peered":"2023-10-03T19:20:16.328456+0000","last_unstale":"2023-10-03T19:20:17.427780+0000","last_undegraded":"2023-10-03T19:20:17.427780+0000","last_fullsized":"2023-10-03T19:20:17.427780+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:36:28.692332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"108'1","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.332435+0000","last_change":"2023-10-03T19:20:15.948383+0000","last_active":"2023-10-03T19:20:16.332435+0000","last_peered":"2023-10-03T19:20:16.332435+0000","last_clean":"2023-10-03T19:20:16.332435+0000","last_became_active":"2023-10-03T19:20:15.947986+0000","last_became_peered":"2023-10-03T19:20:15.947986+0000","last_unstale":"2023-10-03T19:20:16.332435+0000","last_undegraded":"2023-10-03T19:20:16.332435+0000","last_fullsized":"2023-10-03T19:20:16.332435+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:59:30.670767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328274+0000","last_change":"2023-10-03T19:20:16.361589+0000","last_active":"2023-10-03T19:20:17.328274+0000","last_peered":"2023-10-03T19:20:17.328274+0000","last_clean":"2023-10-03T19:20:17.328274+0000","last_became_active":"2023-10-03T19:20:16.360874+0000","last_became_peered":"2023-10-03T19:20:16.360874+0000","last_unstale":"2023-10-03T19:20:17.328274+0000","last_undegraded":"2023-10-03T19:20:17.328274+0000","last_fullsized":"2023-10-03T19:20:17.328274+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:24:03.546278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"108'2","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.381745+0000","last_change":"2023-10-03T19:20:15.972052+0000","last_active":"2023-10-03T19:20:16.381745+0000","last_peered":"2023-10-03T19:20:16.381745+0000","last_clean":"2023-10-03T19:20:16.381745+0000","last_became_active":"2023-10-03T19:20:15.971172+0000","last_became_peered":"2023-10-03T19:20:15.971172+0000","last_unstale":"2023-10-03T19:20:16.381745+0000","last_undegraded":"2023-10-03T19:20:16.381745+0000","last_fullsized":"2023-10-03T19:20:16.381745+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:28:00.958370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.388611+0000","last_change":"2023-10-03T19:20:16.368357+0000","last_active":"2023-10-03T19:20:16.388611+0000","last_peered":"2023-10-03T19:20:16.388611+0000","last_clean":"2023-10-03T19:20:16.388611+0000","last_became_active":"2023-10-03T19:20:16.367616+0000","last_became_peered":"2023-10-03T19:20:16.367616+0000","last_unstale":"2023-10-03T19:20:16.388611+0000","last_undegraded":"2023-10-03T19:20:16.388611+0000","last_fullsized":"2023-10-03T19:20:16.388611+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:51:54.780344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"108'2","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.340323+0000","last_change":"2023-10-03T19:20:15.964371+0000","last_active":"2023-10-03T19:20:16.340323+0000","last_peered":"2023-10-03T19:20:16.340323+0000","last_clean":"2023-10-03T19:20:16.340323+0000","last_became_active":"2023-10-03T19:20:15.963961+0000","last_became_peered":"2023-10-03T19:20:15.963961+0000","last_unstale":"2023-10-03T19:20:16.340323+0000","last_undegraded":"2023-10-03T19:20:16.340323+0000","last_fullsized":"2023-10-03T19:20:16.340323+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:53:59.202663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.375198+0000","last_change":"2023-10-03T19:20:16.374148+0000","last_active":"2023-10-03T19:20:16.375198+0000","last_peered":"2023-10-03T19:20:16.375198+0000","last_clean":"2023-10-03T19:20:16.375198+0000","last_became_active":"2023-10-03T19:20:16.373840+0000","last_became_peered":"2023-10-03T19:20:16.373840+0000","last_unstale":"2023-10-03T19:20:16.375198+0000","last_undegraded":"2023-10-03T19:20:16.375198+0000","last_fullsized":"2023-10-03T19:20:16.375198+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:19:32.912872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"108'1","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.341648+0000","last_change":"2023-10-03T19:20:15.956585+0000","last_active":"2023-10-03T19:20:16.341648+0000","last_peered":"2023-10-03T19:20:16.341648+0000","last_clean":"2023-10-03T19:20:16.341648+0000","last_became_active":"2023-10-03T19:20:15.955764+0000","last_became_peered":"2023-10-03T19:20:15.955764+0000","last_unstale":"2023-10-03T19:20:16.341648+0000","last_undegraded":"2023-10-03T19:20:16.341648+0000","last_fullsized":"2023-10-03T19:20:16.341648+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:25:54.232755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.382347+0000","last_change":"2023-10-03T19:20:16.380278+0000","last_active":"2023-10-03T19:20:16.382347+0000","last_peered":"2023-10-03T19:20:16.382347+0000","last_clean":"2023-10-03T19:20:16.382347+0000","last_became_active":"2023-10-03T19:20:16.379843+0000","last_became_peered":"2023-10-03T19:20:16.379843+0000","last_unstale":"2023-10-03T19:20:16.382347+0000","last_undegraded":"2023-10-03T19:20:16.382347+0000","last_fullsized":"2023-10-03T19:20:16.382347+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:46:55.330519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"108'1","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427728+0000","last_change":"2023-10-03T19:20:15.967905+0000","last_active":"2023-10-03T19:20:17.427728+0000","last_peered":"2023-10-03T19:20:17.427728+0000","last_clean":"2023-10-03T19:20:17.427728+0000","last_became_active":"2023-10-03T19:20:15.967603+0000","last_became_peered":"2023-10-03T19:20:15.967603+0000","last_unstale":"2023-10-03T19:20:17.427728+0000","last_undegraded":"2023-10-03T19:20:17.427728+0000","last_fullsized":"2023-10-03T19:20:17.427728+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:23:31.344311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":8,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.333211+0000","last_change":"2023-10-03T19:20:16.333211+0000","last_active":"2023-10-03T19:20:16.333211+0000","last_peered":"2023-10-03T19:20:16.333211+0000","last_clean":"2023-10-03T19:20:16.333211+0000","last_became_active":"2023-10-03T19:20:16.332946+0000","last_became_peered":"2023-10-03T19:20:16.332946+0000","last_unstale":"2023-10-03T19:20:16.333211+0000","last_undegraded":"2023-10-03T19:20:16.333211+0000","last_fullsized":"2023-10-03T19:20:16.333211+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:50:10.917756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.327271+0000","last_change":"2023-10-03T19:20:15.955201+0000","last_active":"2023-10-03T19:20:17.327271+0000","last_peered":"2023-10-03T19:20:17.327271+0000","last_clean":"2023-10-03T19:20:17.327271+0000","last_became_active":"2023-10-03T19:20:15.954436+0000","last_became_peered":"2023-10-03T19:20:15.954436+0000","last_unstale":"2023-10-03T19:20:17.327271+0000","last_undegraded":"2023-10-03T19:20:17.327271+0000","last_fullsized":"2023-10-03T19:20:17.327271+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:39:18.747278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.334203+0000","last_change":"2023-10-03T19:20:16.328049+0000","last_active":"2023-10-03T19:20:16.334203+0000","last_peered":"2023-10-03T19:20:16.334203+0000","last_clean":"2023-10-03T19:20:16.334203+0000","last_became_active":"2023-10-03T19:20:16.327707+0000","last_became_peered":"2023-10-03T19:20:16.327707+0000","last_unstale":"2023-10-03T19:20:16.334203+0000","last_undegraded":"2023-10-03T19:20:16.334203+0000","last_fullsized":"2023-10-03T19:20:16.334203+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:25:59.855509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427488+0000","last_change":"2023-10-03T19:20:15.954813+0000","last_active":"2023-10-03T19:20:17.427488+0000","last_peered":"2023-10-03T19:20:17.427488+0000","last_clean":"2023-10-03T19:20:17.427488+0000","last_became_active":"2023-10-03T19:20:15.954281+0000","last_became_peered":"2023-10-03T19:20:15.954281+0000","last_unstale":"2023-10-03T19:20:17.427488+0000","last_undegraded":"2023-10-03T19:20:17.427488+0000","last_fullsized":"2023-10-03T19:20:17.427488+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:10:30.851090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328147+0000","last_change":"2023-10-03T19:20:16.360131+0000","last_active":"2023-10-03T19:20:17.328147+0000","last_peered":"2023-10-03T19:20:17.328147+0000","last_clean":"2023-10-03T19:20:17.328147+0000","last_became_active":"2023-10-03T19:20:16.359396+0000","last_became_peered":"2023-10-03T19:20:16.359396+0000","last_unstale":"2023-10-03T19:20:17.328147+0000","last_undegraded":"2023-10-03T19:20:17.328147+0000","last_fullsized":"2023-10-03T19:20:17.328147+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:19:39.425532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"108'1","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.334585+0000","last_change":"2023-10-03T19:20:15.956714+0000","last_active":"2023-10-03T19:20:16.334585+0000","last_peered":"2023-10-03T19:20:16.334585+0000","last_clean":"2023-10-03T19:20:16.334585+0000","last_became_active":"2023-10-03T19:20:15.956345+0000","last_became_peered":"2023-10-03T19:20:15.956345+0000","last_unstale":"2023-10-03T19:20:16.334585+0000","last_undegraded":"2023-10-03T19:20:16.334585+0000","last_fullsized":"2023-10-03T19:20:16.334585+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:25:21.009051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.364657+0000","last_change":"2023-10-03T19:20:16.346680+0000","last_active":"2023-10-03T19:20:16.364657+0000","last_peered":"2023-10-03T19:20:16.364657+0000","last_clean":"2023-10-03T19:20:16.364657+0000","last_became_active":"2023-10-03T19:20:16.345966+0000","last_became_peered":"2023-10-03T19:20:16.345966+0000","last_unstale":"2023-10-03T19:20:16.364657+0000","last_undegraded":"2023-10-03T19:20:16.364657+0000","last_fullsized":"2023-10-03T19:20:16.364657+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:29:43.899924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"108'2","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.319319+0000","last_change":"2023-10-03T19:20:15.957563+0000","last_active":"2023-10-03T19:20:17.319319+0000","last_peered":"2023-10-03T19:20:17.319319+0000","last_clean":"2023-10-03T19:20:17.319319+0000","last_became_active":"2023-10-03T19:20:15.957133+0000","last_became_peered":"2023-10-03T19:20:15.957133+0000","last_unstale":"2023-10-03T19:20:17.319319+0000","last_undegraded":"2023-10-03T19:20:17.319319+0000","last_fullsized":"2023-10-03T19:20:17.319319+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:14:44.702562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.428460+0000","last_change":"2023-10-03T19:20:16.350664+0000","last_active":"2023-10-03T19:20:17.428460+0000","last_peered":"2023-10-03T19:20:17.428460+0000","last_clean":"2023-10-03T19:20:17.428460+0000","last_became_active":"2023-10-03T19:20:16.350368+0000","last_became_peered":"2023-10-03T19:20:16.350368+0000","last_unstale":"2023-10-03T19:20:17.428460+0000","last_undegraded":"2023-10-03T19:20:17.428460+0000","last_fullsized":"2023-10-03T19:20:17.428460+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:26:55.310688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"108'1","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.373081+0000","last_change":"2023-10-03T19:20:15.974399+0000","last_active":"2023-10-03T19:20:16.373081+0000","last_peered":"2023-10-03T19:20:16.373081+0000","last_clean":"2023-10-03T19:20:16.373081+0000","last_became_active":"2023-10-03T19:20:15.973595+0000","last_became_peered":"2023-10-03T19:20:15.973595+0000","last_unstale":"2023-10-03T19:20:16.373081+0000","last_undegraded":"2023-10-03T19:20:16.373081+0000","last_fullsized":"2023-10-03T19:20:16.373081+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:32:50.979185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.329360+0000","last_change":"2023-10-03T19:20:16.380011+0000","last_active":"2023-10-03T19:20:17.329360+0000","last_peered":"2023-10-03T19:20:17.329360+0000","last_clean":"2023-10-03T19:20:17.329360+0000","last_became_active":"2023-10-03T19:20:16.379481+0000","last_became_peered":"2023-10-03T19:20:16.379481+0000","last_unstale":"2023-10-03T19:20:17.329360+0000","last_undegraded":"2023-10-03T19:20:17.329360+0000","last_fullsized":"2023-10-03T19:20:17.329360+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:03:01.967348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.334168+0000","last_change":"2023-10-03T19:20:15.969845+0000","last_active":"2023-10-03T19:20:16.334168+0000","last_peered":"2023-10-03T19:20:16.334168+0000","last_clean":"2023-10-03T19:20:16.334168+0000","last_became_active":"2023-10-03T19:20:15.969245+0000","last_became_peered":"2023-10-03T19:20:15.969245+0000","last_unstale":"2023-10-03T19:20:16.334168+0000","last_undegraded":"2023-10-03T19:20:16.334168+0000","last_fullsized":"2023-10-03T19:20:16.334168+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:02:40.240181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427116+0000","last_change":"2023-10-03T19:20:16.381646+0000","last_active":"2023-10-03T19:20:17.427116+0000","last_peered":"2023-10-03T19:20:17.427116+0000","last_clean":"2023-10-03T19:20:17.427116+0000","last_became_active":"2023-10-03T19:20:16.381252+0000","last_became_peered":"2023-10-03T19:20:16.381252+0000","last_unstale":"2023-10-03T19:20:17.427116+0000","last_undegraded":"2023-10-03T19:20:17.427116+0000","last_fullsized":"2023-10-03T19:20:17.427116+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:37:09.807280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"108'2","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427703+0000","last_change":"2023-10-03T19:20:15.968967+0000","last_active":"2023-10-03T19:20:17.427703+0000","last_peered":"2023-10-03T19:20:17.427703+0000","last_clean":"2023-10-03T19:20:17.427703+0000","last_became_active":"2023-10-03T19:20:15.968699+0000","last_became_peered":"2023-10-03T19:20:15.968699+0000","last_unstale":"2023-10-03T19:20:17.427703+0000","last_undegraded":"2023-10-03T19:20:17.427703+0000","last_fullsized":"2023-10-03T19:20:17.427703+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:10:38.839362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.312802+0000","last_change":"2023-10-03T19:20:16.312802+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.312802+0000","last_undegraded":"2023-10-03T19:20:16.312802+0000","last_fullsized":"2023-10-03T19:20:16.312802+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:16:52.366869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.332701+0000","last_change":"2023-10-03T19:20:15.965136+0000","last_active":"2023-10-03T19:20:16.332701+0000","last_peered":"2023-10-03T19:20:16.332701+0000","last_clean":"2023-10-03T19:20:16.332701+0000","last_became_active":"2023-10-03T19:20:15.964445+0000","last_became_peered":"2023-10-03T19:20:15.964445+0000","last_unstale":"2023-10-03T19:20:16.332701+0000","last_undegraded":"2023-10-03T19:20:16.332701+0000","last_fullsized":"2023-10-03T19:20:16.332701+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:57:06.605896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.314019+0000","last_change":"2023-10-03T19:20:16.314019+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.314019+0000","last_undegraded":"2023-10-03T19:20:16.314019+0000","last_fullsized":"2023-10-03T19:20:16.314019+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:35:03.160406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.315594+0000","last_change":"2023-10-03T19:20:15.968473+0000","last_active":"2023-10-03T19:20:16.315594+0000","last_peered":"2023-10-03T19:20:16.315594+0000","last_clean":"2023-10-03T19:20:16.315594+0000","last_became_active":"2023-10-03T19:20:15.968149+0000","last_became_peered":"2023-10-03T19:20:15.968149+0000","last_unstale":"2023-10-03T19:20:16.315594+0000","last_undegraded":"2023-10-03T19:20:16.315594+0000","last_fullsized":"2023-10-03T19:20:16.315594+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:48:45.233305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.327669+0000","last_change":"2023-10-03T19:20:16.360789+0000","last_active":"2023-10-03T19:20:17.327669+0000","last_peered":"2023-10-03T19:20:17.327669+0000","last_clean":"2023-10-03T19:20:17.327669+0000","last_became_active":"2023-10-03T19:20:16.360054+0000","last_became_peered":"2023-10-03T19:20:16.360054+0000","last_unstale":"2023-10-03T19:20:17.327669+0000","last_undegraded":"2023-10-03T19:20:17.327669+0000","last_fullsized":"2023-10-03T19:20:17.327669+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:49:08.311127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.333760+0000","last_change":"2023-10-03T19:20:15.974966+0000","last_active":"2023-10-03T19:20:16.333760+0000","last_peered":"2023-10-03T19:20:16.333760+0000","last_clean":"2023-10-03T19:20:16.333760+0000","last_became_active":"2023-10-03T19:20:15.974042+0000","last_became_peered":"2023-10-03T19:20:15.974042+0000","last_unstale":"2023-10-03T19:20:16.333760+0000","last_undegraded":"2023-10-03T19:20:16.333760+0000","last_fullsized":"2023-10-03T19:20:16.333760+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:09:35.872471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.428525+0000","last_change":"2023-10-03T19:20:16.323318+0000","last_active":"2023-10-03T19:20:17.428525+0000","last_peered":"2023-10-03T19:20:17.428525+0000","last_clean":"2023-10-03T19:20:17.428525+0000","last_became_active":"2023-10-03T19:20:16.322090+0000","last_became_peered":"2023-10-03T19:20:16.322090+0000","last_unstale":"2023-10-03T19:20:17.428525+0000","last_undegraded":"2023-10-03T19:20:17.428525+0000","last_fullsized":"2023-10-03T19:20:17.428525+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:41:27.118657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"108'2","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.428161+0000","last_change":"2023-10-03T19:20:15.948790+0000","last_active":"2023-10-03T19:20:17.428161+0000","last_peered":"2023-10-03T19:20:17.428161+0000","last_clean":"2023-10-03T19:20:17.428161+0000","last_became_active":"2023-10-03T19:20:15.948222+0000","last_became_peered":"2023-10-03T19:20:15.948222+0000","last_unstale":"2023-10-03T19:20:17.428161+0000","last_undegraded":"2023-10-03T19:20:17.428161+0000","last_fullsized":"2023-10-03T19:20:17.428161+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:14:18.658361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.374335+0000","last_change":"2023-10-03T19:20:16.373432+0000","last_active":"2023-10-03T19:20:16.374335+0000","last_peered":"2023-10-03T19:20:16.374335+0000","last_clean":"2023-10-03T19:20:16.374335+0000","last_became_active":"2023-10-03T19:20:16.373117+0000","last_became_peered":"2023-10-03T19:20:16.373117+0000","last_unstale":"2023-10-03T19:20:16.374335+0000","last_undegraded":"2023-10-03T19:20:16.374335+0000","last_fullsized":"2023-10-03T19:20:16.374335+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:04:34.700899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.329921+0000","last_change":"2023-10-03T19:20:15.964945+0000","last_active":"2023-10-03T19:20:17.329921+0000","last_peered":"2023-10-03T19:20:17.329921+0000","last_clean":"2023-10-03T19:20:17.329921+0000","last_became_active":"2023-10-03T19:20:15.963013+0000","last_became_peered":"2023-10-03T19:20:15.963013+0000","last_unstale":"2023-10-03T19:20:17.329921+0000","last_undegraded":"2023-10-03T19:20:17.329921+0000","last_fullsized":"2023-10-03T19:20:17.329921+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:58:07.182707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.388513+0000","last_change":"2023-10-03T19:20:16.366914+0000","last_active":"2023-10-03T19:20:16.388513+0000","last_peered":"2023-10-03T19:20:16.388513+0000","last_clean":"2023-10-03T19:20:16.388513+0000","last_became_active":"2023-10-03T19:20:16.366399+0000","last_became_peered":"2023-10-03T19:20:16.366399+0000","last_unstale":"2023-10-03T19:20:16.388513+0000","last_undegraded":"2023-10-03T19:20:16.388513+0000","last_fullsized":"2023-10-03T19:20:16.388513+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:42:50.977022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.329780+0000","last_change":"2023-10-03T19:20:15.964082+0000","last_active":"2023-10-03T19:20:17.329780+0000","last_peered":"2023-10-03T19:20:17.329780+0000","last_clean":"2023-10-03T19:20:17.329780+0000","last_became_active":"2023-10-03T19:20:15.963061+0000","last_became_peered":"2023-10-03T19:20:15.963061+0000","last_unstale":"2023-10-03T19:20:17.329780+0000","last_undegraded":"2023-10-03T19:20:17.329780+0000","last_fullsized":"2023-10-03T19:20:17.329780+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:48:54.530229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.319098+0000","last_change":"2023-10-03T19:20:16.356943+0000","last_active":"2023-10-03T19:20:17.319098+0000","last_peered":"2023-10-03T19:20:17.319098+0000","last_clean":"2023-10-03T19:20:17.319098+0000","last_became_active":"2023-10-03T19:20:16.356724+0000","last_became_peered":"2023-10-03T19:20:16.356724+0000","last_unstale":"2023-10-03T19:20:17.319098+0000","last_undegraded":"2023-10-03T19:20:17.319098+0000","last_fullsized":"2023-10-03T19:20:17.319098+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:39:11.226990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.428638+0000","last_change":"2023-10-03T19:20:15.950804+0000","last_active":"2023-10-03T19:20:17.428638+0000","last_peered":"2023-10-03T19:20:17.428638+0000","last_clean":"2023-10-03T19:20:17.428638+0000","last_became_active":"2023-10-03T19:20:15.949850+0000","last_became_peered":"2023-10-03T19:20:15.949850+0000","last_unstale":"2023-10-03T19:20:17.428638+0000","last_undegraded":"2023-10-03T19:20:17.428638+0000","last_fullsized":"2023-10-03T19:20:17.428638+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:22:47.665712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427510+0000","last_change":"2023-10-03T19:20:16.335345+0000","last_active":"2023-10-03T19:20:17.427510+0000","last_peered":"2023-10-03T19:20:17.427510+0000","last_clean":"2023-10-03T19:20:17.427510+0000","last_became_active":"2023-10-03T19:20:16.335141+0000","last_became_peered":"2023-10-03T19:20:16.335141+0000","last_unstale":"2023-10-03T19:20:17.427510+0000","last_undegraded":"2023-10-03T19:20:17.427510+0000","last_fullsized":"2023-10-03T19:20:17.427510+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:15:10.493042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.330713+0000","last_change":"2023-10-03T19:20:15.951459+0000","last_active":"2023-10-03T19:20:16.330713+0000","last_peered":"2023-10-03T19:20:16.330713+0000","last_clean":"2023-10-03T19:20:16.330713+0000","last_became_active":"2023-10-03T19:20:15.950750+0000","last_became_peered":"2023-10-03T19:20:15.950750+0000","last_unstale":"2023-10-03T19:20:16.330713+0000","last_undegraded":"2023-10-03T19:20:16.330713+0000","last_fullsized":"2023-10-03T19:20:16.330713+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:32:44.255176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.312349+0000","last_change":"2023-10-03T19:20:16.312349+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.312349+0000","last_undegraded":"2023-10-03T19:20:16.312349+0000","last_fullsized":"2023-10-03T19:20:16.312349+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:27:20.469549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.333339+0000","last_change":"2023-10-03T19:20:15.957097+0000","last_active":"2023-10-03T19:20:16.333339+0000","last_peered":"2023-10-03T19:20:16.333339+0000","last_clean":"2023-10-03T19:20:16.333339+0000","last_became_active":"2023-10-03T19:20:15.956382+0000","last_became_peered":"2023-10-03T19:20:15.956382+0000","last_unstale":"2023-10-03T19:20:16.333339+0000","last_undegraded":"2023-10-03T19:20:16.333339+0000","last_fullsized":"2023-10-03T19:20:16.333339+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:48:45.233305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.388531+0000","last_change":"2023-10-03T19:20:16.366911+0000","last_active":"2023-10-03T19:20:16.388531+0000","last_peered":"2023-10-03T19:20:16.388531+0000","last_clean":"2023-10-03T19:20:16.388531+0000","last_became_active":"2023-10-03T19:20:16.366000+0000","last_became_peered":"2023-10-03T19:20:16.366000+0000","last_unstale":"2023-10-03T19:20:16.388531+0000","last_undegraded":"2023-10-03T19:20:16.388531+0000","last_fullsized":"2023-10-03T19:20:16.388531+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:20:23.512066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.428211+0000","last_change":"2023-10-03T19:20:15.950221+0000","last_active":"2023-10-03T19:20:17.428211+0000","last_peered":"2023-10-03T19:20:17.428211+0000","last_clean":"2023-10-03T19:20:17.428211+0000","last_became_active":"2023-10-03T19:20:15.949702+0000","last_became_peered":"2023-10-03T19:20:15.949702+0000","last_unstale":"2023-10-03T19:20:17.428211+0000","last_undegraded":"2023-10-03T19:20:17.428211+0000","last_fullsized":"2023-10-03T19:20:17.428211+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:48:28.421358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.368478+0000","last_change":"2023-10-03T19:20:16.367493+0000","last_active":"2023-10-03T19:20:16.368478+0000","last_peered":"2023-10-03T19:20:16.368478+0000","last_clean":"2023-10-03T19:20:16.368478+0000","last_became_active":"2023-10-03T19:20:16.367200+0000","last_became_peered":"2023-10-03T19:20:16.367200+0000","last_unstale":"2023-10-03T19:20:16.368478+0000","last_undegraded":"2023-10-03T19:20:16.368478+0000","last_fullsized":"2023-10-03T19:20:16.368478+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:38:21.268252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.334197+0000","last_change":"2023-10-03T19:20:15.976449+0000","last_active":"2023-10-03T19:20:16.334197+0000","last_peered":"2023-10-03T19:20:16.334197+0000","last_clean":"2023-10-03T19:20:16.334197+0000","last_became_active":"2023-10-03T19:20:15.975751+0000","last_became_peered":"2023-10-03T19:20:15.975751+0000","last_unstale":"2023-10-03T19:20:16.334197+0000","last_undegraded":"2023-10-03T19:20:16.334197+0000","last_fullsized":"2023-10-03T19:20:16.334197+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:44:51.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.390675+0000","last_change":"2023-10-03T19:20:16.378686+0000","last_active":"2023-10-03T19:20:16.390675+0000","last_peered":"2023-10-03T19:20:16.390675+0000","last_clean":"2023-10-03T19:20:16.390675+0000","last_became_active":"2023-10-03T19:20:16.377931+0000","last_became_peered":"2023-10-03T19:20:16.377931+0000","last_unstale":"2023-10-03T19:20:16.390675+0000","last_undegraded":"2023-10-03T19:20:16.390675+0000","last_fullsized":"2023-10-03T19:20:16.390675+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:51:26.296530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"108'8","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.314937+0000","last_change":"2023-10-03T19:20:15.968516+0000","last_active":"2023-10-03T19:20:16.314937+0000","last_peered":"2023-10-03T19:20:16.314937+0000","last_clean":"2023-10-03T19:20:16.314937+0000","last_became_active":"2023-10-03T19:20:15.967958+0000","last_became_peered":"2023-10-03T19:20:15.967958+0000","last_unstale":"2023-10-03T19:20:16.314937+0000","last_undegraded":"2023-10-03T19:20:16.314937+0000","last_fullsized":"2023-10-03T19:20:16.314937+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:25:54.232755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":332,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.334710+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:20:16.334710+0000","last_peered":"2023-10-03T19:20:16.334710+0000","last_clean":"2023-10-03T19:20:16.334710+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:20:16.334710+0000","last_undegraded":"2023-10-03T19:20:16.334710+0000","last_fullsized":"2023-10-03T19:20:16.334710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:11:06.488375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.327849+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:20:17.327849+0000","last_peered":"2023-10-03T19:20:17.327849+0000","last_clean":"2023-10-03T19:20:17.327849+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:20:17.327849+0000","last_undegraded":"2023-10-03T19:20:17.327849+0000","last_fullsized":"2023-10-03T19:20:17.327849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:48:08.284624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328782+0000","last_change":"2023-10-03T19:20:16.356061+0000","last_active":"2023-10-03T19:20:17.328782+0000","last_peered":"2023-10-03T19:20:17.328782+0000","last_clean":"2023-10-03T19:20:17.328782+0000","last_became_active":"2023-10-03T19:20:16.355199+0000","last_became_peered":"2023-10-03T19:20:16.355199+0000","last_unstale":"2023-10-03T19:20:17.328782+0000","last_undegraded":"2023-10-03T19:20:17.328782+0000","last_fullsized":"2023-10-03T19:20:17.328782+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:07:54.083803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"108'2","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.319323+0000","last_change":"2023-10-03T19:20:15.969199+0000","last_active":"2023-10-03T19:20:16.319323+0000","last_peered":"2023-10-03T19:20:16.319323+0000","last_clean":"2023-10-03T19:20:16.319323+0000","last_became_active":"2023-10-03T19:20:15.966849+0000","last_became_peered":"2023-10-03T19:20:15.966849+0000","last_unstale":"2023-10-03T19:20:16.319323+0000","last_undegraded":"2023-10-03T19:20:16.319323+0000","last_fullsized":"2023-10-03T19:20:16.319323+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:47:59.812937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":180,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.343563+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:20:16.343563+0000","last_peered":"2023-10-03T19:20:16.343563+0000","last_clean":"2023-10-03T19:20:16.343563+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:20:16.343563+0000","last_undegraded":"2023-10-03T19:20:16.343563+0000","last_fullsized":"2023-10-03T19:20:16.343563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:37:17.443617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.368589+0000","last_change":"2023-10-03T19:20:16.367501+0000","last_active":"2023-10-03T19:20:16.368589+0000","last_peered":"2023-10-03T19:20:16.368589+0000","last_clean":"2023-10-03T19:20:16.368589+0000","last_became_active":"2023-10-03T19:20:16.367248+0000","last_became_peered":"2023-10-03T19:20:16.367248+0000","last_unstale":"2023-10-03T19:20:16.368589+0000","last_undegraded":"2023-10-03T19:20:16.368589+0000","last_fullsized":"2023-10-03T19:20:16.368589+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:10:29.134502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.319316+0000","last_change":"2023-10-03T19:20:15.967698+0000","last_active":"2023-10-03T19:20:16.319316+0000","last_peered":"2023-10-03T19:20:16.319316+0000","last_clean":"2023-10-03T19:20:16.319316+0000","last_became_active":"2023-10-03T19:20:15.967254+0000","last_became_peered":"2023-10-03T19:20:15.967254+0000","last_unstale":"2023-10-03T19:20:16.319316+0000","last_undegraded":"2023-10-03T19:20:16.319316+0000","last_fullsized":"2023-10-03T19:20:16.319316+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:16:20.254315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":178,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.318094+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:20:17.318094+0000","last_peered":"2023-10-03T19:20:17.318094+0000","last_clean":"2023-10-03T19:20:17.318094+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:20:17.318094+0000","last_undegraded":"2023-10-03T19:20:17.318094+0000","last_fullsized":"2023-10-03T19:20:17.318094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:09:08.659807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.318441+0000","last_change":"2023-10-03T19:20:16.331087+0000","last_active":"2023-10-03T19:20:17.318441+0000","last_peered":"2023-10-03T19:20:17.318441+0000","last_clean":"2023-10-03T19:20:17.318441+0000","last_became_active":"2023-10-03T19:20:16.330789+0000","last_became_peered":"2023-10-03T19:20:16.330789+0000","last_unstale":"2023-10-03T19:20:17.318441+0000","last_undegraded":"2023-10-03T19:20:17.318441+0000","last_fullsized":"2023-10-03T19:20:17.318441+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:59:08.307318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.315395+0000","last_change":"2023-10-03T19:20:15.963326+0000","last_active":"2023-10-03T19:20:16.315395+0000","last_peered":"2023-10-03T19:20:16.315395+0000","last_clean":"2023-10-03T19:20:16.315395+0000","last_became_active":"2023-10-03T19:20:15.962683+0000","last_became_peered":"2023-10-03T19:20:15.962683+0000","last_unstale":"2023-10-03T19:20:16.315395+0000","last_undegraded":"2023-10-03T19:20:16.315395+0000","last_fullsized":"2023-10-03T19:20:16.315395+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:32:44.255176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.327053+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:20:17.327053+0000","last_peered":"2023-10-03T19:20:17.327053+0000","last_clean":"2023-10-03T19:20:17.327053+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:20:17.327053+0000","last_undegraded":"2023-10-03T19:20:17.327053+0000","last_fullsized":"2023-10-03T19:20:17.327053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:13:16.390162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.329037+0000","last_change":"2023-10-03T19:20:16.379445+0000","last_active":"2023-10-03T19:20:17.329037+0000","last_peered":"2023-10-03T19:20:17.329037+0000","last_clean":"2023-10-03T19:20:17.329037+0000","last_became_active":"2023-10-03T19:20:16.378708+0000","last_became_peered":"2023-10-03T19:20:16.378708+0000","last_unstale":"2023-10-03T19:20:17.329037+0000","last_undegraded":"2023-10-03T19:20:17.329037+0000","last_fullsized":"2023-10-03T19:20:17.329037+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:36:26.181089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.330048+0000","last_change":"2023-10-03T19:20:15.964353+0000","last_active":"2023-10-03T19:20:17.330048+0000","last_peered":"2023-10-03T19:20:17.330048+0000","last_clean":"2023-10-03T19:20:17.330048+0000","last_became_active":"2023-10-03T19:20:15.963577+0000","last_became_peered":"2023-10-03T19:20:15.963577+0000","last_unstale":"2023-10-03T19:20:17.330048+0000","last_undegraded":"2023-10-03T19:20:17.330048+0000","last_fullsized":"2023-10-03T19:20:17.330048+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:44:59.894758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":172,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.331800+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:20:16.331800+0000","last_peered":"2023-10-03T19:20:16.331800+0000","last_clean":"2023-10-03T19:20:16.331800+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:20:16.331800+0000","last_undegraded":"2023-10-03T19:20:16.331800+0000","last_fullsized":"2023-10-03T19:20:16.331800+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:45:55.749619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328196+0000","last_change":"2023-10-03T19:20:16.360159+0000","last_active":"2023-10-03T19:20:17.328196+0000","last_peered":"2023-10-03T19:20:17.328196+0000","last_clean":"2023-10-03T19:20:17.328196+0000","last_became_active":"2023-10-03T19:20:16.359303+0000","last_became_peered":"2023-10-03T19:20:16.359303+0000","last_unstale":"2023-10-03T19:20:17.328196+0000","last_undegraded":"2023-10-03T19:20:17.328196+0000","last_fullsized":"2023-10-03T19:20:17.328196+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:01:13.570148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328583+0000","last_change":"2023-10-03T19:20:15.953426+0000","last_active":"2023-10-03T19:20:17.328583+0000","last_peered":"2023-10-03T19:20:17.328583+0000","last_clean":"2023-10-03T19:20:17.328583+0000","last_became_active":"2023-10-03T19:20:15.952566+0000","last_became_peered":"2023-10-03T19:20:15.952566+0000","last_unstale":"2023-10-03T19:20:17.328583+0000","last_undegraded":"2023-10-03T19:20:17.328583+0000","last_fullsized":"2023-10-03T19:20:17.328583+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:25:56.771799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":180,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.333768+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:20:16.333768+0000","last_peered":"2023-10-03T19:20:16.333768+0000","last_clean":"2023-10-03T19:20:16.333768+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:20:16.333768+0000","last_undegraded":"2023-10-03T19:20:16.333768+0000","last_fullsized":"2023-10-03T19:20:16.333768+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:51:39.452487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-10-03T19:20:16.312904+0000","last_change":"2023-10-03T19:20:16.312904+0000","last_active":"2023-10-03T19:20:15.906015+0000","last_peered":"2023-10-03T19:20:15.906015+0000","last_clean":"2023-10-03T19:20:15.906015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T19:20:16.312904+0000","last_undegraded":"2023-10-03T19:20:16.312904+0000","last_fullsized":"2023-10-03T19:20:16.312904+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:41:46.307896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"108'3","reported_seq":16,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328281+0000","last_change":"2023-10-03T19:20:15.972534+0000","last_active":"2023-10-03T19:20:17.328281+0000","last_peered":"2023-10-03T19:20:17.328281+0000","last_clean":"2023-10-03T19:20:17.328281+0000","last_became_active":"2023-10-03T19:20:15.971724+0000","last_became_peered":"2023-10-03T19:20:15.971724+0000","last_unstale":"2023-10-03T19:20:17.328281+0000","last_undegraded":"2023-10-03T19:20:17.328281+0000","last_fullsized":"2023-10-03T19:20:17.328281+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:30:57.635979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":172,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.327393+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:20:16.327393+0000","last_peered":"2023-10-03T19:20:16.327393+0000","last_clean":"2023-10-03T19:20:16.327393+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:20:16.327393+0000","last_undegraded":"2023-10-03T19:20:16.327393+0000","last_fullsized":"2023-10-03T19:20:16.327393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:38:41.426039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328937+0000","last_change":"2023-10-03T19:20:16.367253+0000","last_active":"2023-10-03T19:20:17.328937+0000","last_peered":"2023-10-03T19:20:17.328937+0000","last_clean":"2023-10-03T19:20:17.328937+0000","last_became_active":"2023-10-03T19:20:16.366622+0000","last_became_peered":"2023-10-03T19:20:16.366622+0000","last_unstale":"2023-10-03T19:20:17.328937+0000","last_undegraded":"2023-10-03T19:20:17.328937+0000","last_fullsized":"2023-10-03T19:20:17.328937+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:09:15.902309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"108'5","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-03T19:20:16.315568+0000","last_change":"2023-10-03T19:20:15.962877+0000","last_active":"2023-10-03T19:20:16.315568+0000","last_peered":"2023-10-03T19:20:16.315568+0000","last_clean":"2023-10-03T19:20:16.315568+0000","last_became_active":"2023-10-03T19:20:15.962063+0000","last_became_peered":"2023-10-03T19:20:15.962063+0000","last_unstale":"2023-10-03T19:20:16.315568+0000","last_undegraded":"2023-10-03T19:20:16.315568+0000","last_fullsized":"2023-10-03T19:20:16.315568+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:44:05.865560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.330163+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:20:17.330163+0000","last_peered":"2023-10-03T19:20:17.330163+0000","last_clean":"2023-10-03T19:20:17.330163+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:20:17.330163+0000","last_undegraded":"2023-10-03T19:20:17.330163+0000","last_fullsized":"2023-10-03T19:20:17.330163+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:17:59.521194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":1470,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509538,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34160,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":32768,"kb_avail":94337680,"statfs":{"total":96636764160,"available":96601784320,"internally_reserved":0,"allocated":1417216,"data_stored":1203428,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":33554432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.85899999999999999,"15min":0.92700000000000005},"min":{"1min":0.66300000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1950000000000001,"5min":1.206,"15min":4.0469999999999997},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.85299999999999998,"15min":0.82099999999999995},"min":{"1min":0.55200000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.177,"5min":1.2310000000000001,"15min":1.3420000000000001},"last":1.2230000000000001}]},{"osd":1,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.86299999999999999,"15min":0.98599999999999999},"min":{"1min":0.61899999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1359999999999999,"5min":1.3200000000000001,"15min":3.8239999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.89800000000000002,"15min":0.87},"min":{"1min":0.64500000000000002,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.91100000000000003}]},{"osd":2,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.95899999999999996,"15min":0.88400000000000001},"min":{"1min":0.55300000000000005,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1719999999999999,"5min":6.0449999999999999,"15min":6.0449999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.94199999999999995,"15min":1.0109999999999999},"min":{"1min":0.69999999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.296,"5min":1.5800000000000001,"15min":3.98},"last":1.161}]},{"osd":3,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.034,"15min":0.95799999999999996},"min":{"1min":0.68500000000000005,"5min":0.63800000000000001,"15min":0.51100000000000001},"max":{"1min":1.232,"5min":6.125,"15min":6.125},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.97599999999999998,"15min":1.0840000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.175,"5min":1.444,"15min":3.9140000000000001},"last":1.2509999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.89800000000000002,"15min":1.0920000000000001},"min":{"1min":0.61599999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":5.1130000000000004},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.016,"15min":1.018},"min":{"1min":0.70699999999999996,"5min":0.629,"15min":0.629},"max":{"1min":1.214,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":1.107}]},{"osd":5,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.006,"15min":1.2010000000000001},"min":{"1min":0.63700000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2470000000000001,"5min":1.349,"15min":5.1859999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.0209999999999999,"15min":1.115},"min":{"1min":0.69299999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.29,"5min":1.2949999999999999,"15min":2.0609999999999999},"last":1.133}]},{"osd":6,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0740000000000001,"15min":1.093},"min":{"1min":0.80000000000000004,"5min":0.75700000000000001,"15min":0.69399999999999995},"max":{"1min":1.3839999999999999,"5min":1.4890000000000001,"15min":1.5449999999999999},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.1459999999999999,"15min":1.167},"min":{"1min":0.77800000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.232,"5min":6.1580000000000004,"15min":6.1580000000000004},"last":1.2}]}]},{"osd":6,"up_from":15,"seq":64424509538,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":30144,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":1335296,"data_stored":611702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30867456},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.84599999999999997,"15min":0.82699999999999996},"min":{"1min":0.54100000000000004,"5min":0.45400000000000001,"15min":0.44600000000000001},"max":{"1min":1.234,"5min":1.3340000000000001,"15min":1.504},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.91100000000000003,"15min":0.88900000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.44600000000000001},"max":{"1min":1.1080000000000001,"5min":1.423,"15min":1.839},"last":0.91200000000000003}]},{"osd":1,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.86699999999999999,"15min":0.84699999999999998},"min":{"1min":0.56000000000000005,"5min":0.52100000000000002,"15min":0.504},"max":{"1min":1.1859999999999999,"5min":1.27,"15min":2.0150000000000001},"last":0.751},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.88900000000000001,"15min":0.88200000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.161,"5min":1.448,"15min":1.448},"last":0.70399999999999996}]},{"osd":2,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.93799999999999994,"15min":0.88900000000000001},"min":{"1min":0.66400000000000003,"5min":0.59199999999999997,"15min":0.51900000000000002},"max":{"1min":1.4430000000000001,"5min":1.528,"15min":1.528},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.92700000000000005,"15min":0.92500000000000004},"min":{"1min":0.60899999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1519999999999999,"5min":1.369,"15min":1.546},"last":0.81299999999999994}]},{"osd":3,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.96299999999999997,"15min":0.97899999999999998},"min":{"1min":0.68899999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.298,"5min":1.377,"15min":1.6990000000000001},"last":1.1299999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90700000000000003,"15min":0.90800000000000003},"min":{"1min":0.70199999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.143,"5min":1.206,"15min":2.121},"last":0.86899999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.91600000000000004,"15min":0.998},"min":{"1min":0.67400000000000004,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.335,"5min":1.339,"15min":1.95},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.995,"15min":1.0680000000000001},"min":{"1min":0.64400000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4490000000000001,"5min":1.504,"15min":1.7709999999999999},"last":1.0069999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.90700000000000003,"15min":0.99199999999999999},"min":{"1min":0.624,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.226,"5min":1.3200000000000001,"15min":2.2570000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.048,"15min":1.103},"min":{"1min":0.71799999999999997,"5min":0.68300000000000005,"15min":0.68100000000000005},"max":{"1min":1.5009999999999999,"5min":1.524,"15min":2.0619999999999998},"last":1.1579999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.071,"15min":1.109},"min":{"1min":0.748,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.639,"5min":1.639,"15min":2.0049999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.032,"5min":1.044,"15min":1.0820000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.61899999999999999},"max":{"1min":1.3879999999999999,"5min":1.4350000000000001,"15min":2.4249999999999998},"last":1.2}]}]},{"osd":4,"up_from":15,"seq":64424509539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42540,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":41216,"kb_avail":94329300,"statfs":{"total":96636764160,"available":96593203200,"internally_reserved":0,"allocated":1347584,"data_stored":613848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":42205184},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":1.0600000000000001,"15min":0.875},"min":{"1min":0.64200000000000002,"5min":0.54700000000000004,"15min":0.50600000000000001},"max":{"1min":1.0600000000000001,"5min":17.686,"15min":17.686},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.90100000000000002,"5min":1.02,"15min":0.89000000000000001},"min":{"1min":0.64000000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.28,"5min":16.925999999999998,"15min":16.925999999999998},"last":0.86699999999999999}]},{"osd":1,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.085,"15min":0.98499999999999999},"min":{"1min":0.67700000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1759999999999999,"5min":16.640999999999998,"15min":16.640999999999998},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.91300000000000003,"5min":1.089,"15min":0.93400000000000005},"min":{"1min":0.67300000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.151,"5min":17.59,"15min":17.59},"last":1.0269999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.997,"15min":0.94299999999999995},"min":{"1min":0.70699999999999996,"5min":0.56200000000000006,"15min":0.53200000000000003},"max":{"1min":1.1180000000000001,"5min":8.5630000000000006,"15min":8.5630000000000006},"last":1.286},{"interface":"front","average":{"1min":0.93999999999999995,"5min":1.143,"15min":1.01},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.175,"5min":17.734000000000002,"15min":17.734000000000002},"last":1.1970000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.0880000000000001,"15min":0.94299999999999995},"min":{"1min":0.72499999999999998,"5min":0.61499999999999999,"15min":0.53900000000000003},"max":{"1min":1.242,"5min":16.98,"15min":16.98},"last":1.3740000000000001},{"interface":"front","average":{"1min":0.997,"5min":1.161,"15min":1.105},"min":{"1min":0.66900000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2789999999999999,"5min":16.434000000000001,"15min":16.434000000000001},"last":1.4099999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":1.1020000000000001,"15min":1.0820000000000001},"min":{"1min":0.624,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.143,"5min":17.782,"15min":17.782},"last":1.3360000000000001},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.96599999999999997,"15min":1.002},"min":{"1min":0.65700000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.264,"5min":1.708,"15min":1.708},"last":1.48}]},{"osd":6,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.3859999999999999,"15min":1.27},"min":{"1min":0.66000000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.2250000000000001,"5min":36.106000000000002,"15min":36.106000000000002},"last":1.6910000000000001},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.2450000000000001,"15min":1.216},"min":{"1min":0.86099999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.2410000000000001,"5min":17.646999999999998,"15min":17.646999999999998},"last":1.4530000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.226,"15min":1.1359999999999999},"min":{"1min":0.81200000000000006,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.421,"5min":17.042000000000002,"15min":17.042000000000002},"last":1.6519999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.3,"15min":1.262},"min":{"1min":0.83199999999999996,"5min":0.66400000000000003,"15min":0.63300000000000001},"max":{"1min":1.4670000000000001,"5min":16.32,"15min":16.32},"last":1.5429999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509539,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":31616,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1331200,"data_stored":611120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":32374784},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.79100000000000004,"15min":0.61299999999999999},"min":{"1min":0.47799999999999998,"5min":0.32200000000000001,"15min":0.247},"max":{"1min":0.98199999999999998,"5min":13.629,"15min":13.629},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":1.206,"15min":0.80900000000000005},"min":{"1min":0.34000000000000002,"5min":0.30299999999999999,"15min":0.28999999999999998},"max":{"1min":0.97199999999999998,"5min":40.439,"15min":40.439},"last":0.91400000000000003}]},{"osd":1,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.90200000000000002,"15min":0.71099999999999997},"min":{"1min":0.47899999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1,"5min":14.074,"15min":14.074},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.78500000000000003,"15min":0.64900000000000002},"min":{"1min":0.38800000000000001,"5min":0.34799999999999998,"15min":0.26400000000000001},"max":{"1min":1.1080000000000001,"5min":7.0060000000000002,"15min":7.0060000000000002},"last":0.57899999999999996}]},{"osd":3,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.90000000000000002,"15min":0.71299999999999997},"min":{"1min":0.36699999999999999,"5min":0.28899999999999998,"15min":0.224},"max":{"1min":1.05,"5min":13.423999999999999,"15min":13.423999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.0649999999999999,"15min":0.82899999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.36399999999999999},"max":{"1min":1.1220000000000001,"5min":18.568999999999999,"15min":18.568999999999999},"last":0.65100000000000002}]},{"osd":4,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.94999999999999996,"15min":0.878},"min":{"1min":0.64200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.105,"5min":1.718,"15min":1.718},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.3380000000000001,"15min":1.05},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.22,"5min":28.667999999999999,"15min":28.667999999999999},"last":0.98599999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.0529999999999999,"15min":0.92100000000000004},"min":{"1min":0.67600000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.399,"5min":5.4459999999999997,"15min":5.4459999999999997},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.2230000000000001,"15min":1.0309999999999999},"min":{"1min":0.63300000000000001,"5min":0.57599999999999996,"15min":0.52700000000000002},"max":{"1min":1.4970000000000001,"5min":14.007,"15min":14.007},"last":0.84099999999999997}]},{"osd":6,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":1.1040000000000001,"15min":0.97099999999999997},"min":{"1min":0.65900000000000003,"5min":0.60099999999999998,"15min":0.49099999999999999},"max":{"1min":1.212,"5min":10.679,"15min":10.679},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.087,"15min":1.004},"min":{"1min":0.75600000000000001,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.325,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.1439999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.3240000000000001,"15min":1.1080000000000001},"min":{"1min":0.70299999999999996,"5min":0.63100000000000001,"15min":0.56100000000000005},"max":{"1min":1.415,"5min":18.623000000000001,"15min":18.623000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.0920000000000001,"15min":0.996},"min":{"1min":0.61699999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1850000000000001,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":1.016}]}]},{"osd":1,"up_from":15,"seq":64424509538,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31012,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":29696,"kb_avail":94340828,"statfs":{"total":96636764160,"available":96605007872,"internally_reserved":0,"allocated":1339392,"data_stored":612306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30408704},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59199999999999997,"15min":0.55600000000000005},"min":{"1min":0.27900000000000003,"5min":0.27200000000000002,"15min":0.26900000000000002},"max":{"1min":0.92100000000000004,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70399999999999996,"15min":0.56799999999999995},"min":{"1min":0.41799999999999998,"5min":0.27200000000000002,"15min":0.22900000000000001},"max":{"1min":1.1899999999999999,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.01}]},{"osd":2,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68300000000000005,"15min":0.58899999999999997},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.26200000000000001},"max":{"1min":0.879,"5min":1.506,"15min":1.506},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.82099999999999995,"15min":0.70599999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.312},"max":{"1min":1.1919999999999999,"5min":1.365,"15min":1.365},"last":0.89500000000000002}]},{"osd":3,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.76400000000000001,"15min":0.67300000000000004},"min":{"1min":0.36099999999999999,"5min":0.31,"15min":0.31},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.75700000000000001,"15min":0.63400000000000001},"min":{"1min":0.39100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.90700000000000003,"5min":1.232,"15min":1.27},"last":0.95299999999999996}]},{"osd":4,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.89000000000000001,"15min":0.82799999999999996},"min":{"1min":0.61199999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0860000000000001,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.98499999999999999,"15min":0.91400000000000003},"min":{"1min":0.69899999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3260000000000001,"5min":1.728,"15min":1.728},"last":0.77500000000000002}]},{"osd":5,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.98999999999999999,"15min":0.89500000000000002},"min":{"1min":0.60299999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.28,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.96299999999999997,"15min":0.88500000000000001},"min":{"1min":0.77300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.198,"5min":1.3959999999999999,"15min":1.6080000000000001},"last":0.74399999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0349999999999999,"15min":0.95399999999999996},"min":{"1min":0.59499999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2689999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.204},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0289999999999999,"15min":0.93400000000000005},"min":{"1min":0.66700000000000004,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3600000000000001,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.2470000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0669999999999999,"15min":0.97599999999999998},"min":{"1min":0.55100000000000005,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.292,"5min":1.673,"15min":1.673},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0289999999999999,"15min":0.93999999999999995},"min":{"1min":0.67500000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4379999999999999,"5min":1.5880000000000001,"15min":1.649},"last":1.1339999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542242,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25504,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":24192,"kb_avail":94346336,"statfs":{"total":96636764160,"available":96610648064,"internally_reserved":0,"allocated":1335296,"data_stored":612284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24772608},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.63200000000000001,"15min":0.58799999999999997},"min":{"1min":0.36399999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.96199999999999997,"5min":1.212,"15min":1.212},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.69999999999999996,"15min":0.66000000000000003},"min":{"1min":0.38900000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.5,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.82799999999999996}]},{"osd":1,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.70399999999999996,"15min":0.64800000000000002},"min":{"1min":0.42299999999999999,"5min":0.28599999999999998,"15min":0.27000000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76000000000000001,"15min":0.69099999999999995},"min":{"1min":0.34300000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.169,"5min":1.2210000000000001,"15min":1.222},"last":0.95899999999999996}]},{"osd":2,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.79400000000000004,"15min":0.73299999999999998},"min":{"1min":0.35999999999999999,"5min":0.317,"15min":0.317},"max":{"1min":1.1539999999999999,"5min":1.23,"15min":1.23},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73199999999999998,"15min":0.66000000000000003},"min":{"1min":0.371,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.05,"5min":1.671,"15min":1.671},"last":0.71599999999999997}]},{"osd":4,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.92000000000000004,"15min":0.91200000000000003},"min":{"1min":0.63900000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2949999999999999,"5min":1.411,"15min":1.496},"last":1.052},{"interface":"front","average":{"1min":1.006,"5min":1.018,"15min":0.95599999999999996},"min":{"1min":0.76400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3280000000000001,"5min":1.546,"15min":1.546},"last":1.085}]},{"osd":5,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.91200000000000003,"15min":0.88700000000000001},"min":{"1min":0.63300000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.095,"5min":1.581,"15min":1.581},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.022,"15min":1.004},"min":{"1min":0.68100000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4179999999999999,"5min":1.498,"15min":1.498},"last":1.173}]},{"osd":6,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.94599999999999995,"15min":0.92800000000000005},"min":{"1min":0.68799999999999994,"5min":0.56999999999999995,"15min":0.56699999999999995},"max":{"1min":1.212,"5min":1.347,"15min":1.347},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.05,"15min":1.006},"min":{"1min":0.80000000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.373,"5min":1.4970000000000001,"15min":1.5629999999999999},"last":1.1339999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.083,"15min":1.0289999999999999},"min":{"1min":0.70599999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.151},{"interface":"front","average":{"1min":1.109,"5min":1.0609999999999999,"15min":1.03},"min":{"1min":0.65300000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.659,"5min":1.659,"15min":1.708},"last":1.294}]}]},{"osd":5,"up_from":13,"seq":55834574946,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23284,"kb_used_data":1324,"kb_used_omap":0,"kb_used_meta":21952,"kb_avail":94348556,"statfs":{"total":96636764160,"available":96612921344,"internally_reserved":0,"allocated":1355776,"data_stored":619097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22478848},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.85799999999999998,"15min":0.83399999999999996},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.181,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.89400000000000002,"15min":0.86599999999999999},"min":{"1min":0.78200000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.26,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.70599999999999996}]},{"osd":1,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.872,"15min":0.84499999999999997},"min":{"1min":0.505,"5min":0.501,"15min":0.501},"max":{"1min":1.044,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.052},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.91000000000000003,"15min":0.92300000000000004},"min":{"1min":0.63100000000000001,"5min":0.58699999999999997,"15min":0.57099999999999995},"max":{"1min":1.23,"5min":1.23,"15min":1.514},"last":0.86099999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.91000000000000003,"15min":0.90300000000000002},"min":{"1min":0.625,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2010000000000001,"5min":1.351,"15min":1.3700000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.999,"5min":0.93000000000000005,"15min":0.90600000000000003},"min":{"1min":0.82499999999999996,"5min":0.57099999999999995,"15min":0.53300000000000003},"max":{"1min":1.1819999999999999,"5min":1.1930000000000001,"15min":1.3320000000000001},"last":0.76300000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.93600000000000005,"15min":0.93100000000000005},"min":{"1min":0.67700000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2210000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.046,"5min":1.03,"15min":1.028},"min":{"1min":0.78700000000000003,"5min":0.65900000000000003,"15min":0.61199999999999999},"max":{"1min":1.3129999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.99099999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.97499999999999998,"15min":0.97299999999999998},"min":{"1min":0.70699999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.2450000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.167},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96399999999999997,"15min":1.0129999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2749999999999999,"5min":1.335,"15min":1.7709999999999999},"last":1.2130000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.995,"15min":1.024},"min":{"1min":0.67000000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.204,"5min":1.546,"15min":1.546},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0880000000000001,"15min":1.1240000000000001},"min":{"1min":0.82499999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.3759999999999999,"5min":1.823,"15min":1.823},"last":1.2470000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0569999999999999,"15min":1.071},"min":{"1min":0.68700000000000006,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.5680000000000001},"last":1.302},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.119,"15min":1.143},"min":{"1min":0.86499999999999999,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.325,"5min":1.4179999999999999,"15min":1.9099999999999999},"last":1.1020000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574947,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30700,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":29312,"kb_avail":94341140,"statfs":{"total":96636764160,"available":96605327360,"internally_reserved":0,"allocated":1413120,"data_stored":1208163,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":30015488},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.69699999999999995,"15min":0.61399999999999999},"min":{"1min":0.502,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.92000000000000004,"5min":5.7480000000000002,"15min":5.7480000000000002},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.80900000000000005,"15min":0.746},"min":{"1min":0.54700000000000004,"5min":0.37,"15min":0.33000000000000002},"max":{"1min":1.0760000000000001,"5min":6.274,"15min":6.274},"last":0.81799999999999995}]},{"osd":2,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.81999999999999995,"15min":0.746},"min":{"1min":0.46700000000000003,"5min":0.36499999999999999,"15min":0.35399999999999998},"max":{"1min":0.97599999999999998,"5min":6.1609999999999996,"15min":6.1609999999999996},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71499999999999997,"15min":0.69899999999999995},"min":{"1min":0.44500000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.997,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.56399999999999995}]},{"osd":3,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.90800000000000003,"15min":0.78000000000000003},"min":{"1min":0.57499999999999996,"5min":0.41799999999999998,"15min":0.36799999999999999},"max":{"1min":1.1739999999999999,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":1.05},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82199999999999995,"15min":0.73199999999999998},"min":{"1min":0.53300000000000003,"5min":0.376,"15min":0.30299999999999999},"max":{"1min":1.0780000000000001,"5min":1.375,"15min":1.375},"last":0.79100000000000004}]},{"osd":4,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":1.0029999999999999,"15min":0.93600000000000005},"min":{"1min":0.71299999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.254,"5min":8.1159999999999997,"15min":8.1159999999999997},"last":1.01},{"interface":"front","average":{"1min":1.056,"5min":1.0860000000000001,"15min":1.0429999999999999},"min":{"1min":0.71199999999999997,"5min":0.57299999999999995,"15min":0.504},"max":{"1min":1.3440000000000001,"5min":6.2320000000000002,"15min":6.2320000000000002},"last":0.98099999999999998}]},{"osd":5,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.2549999999999999,"15min":1.1140000000000001},"min":{"1min":0.69199999999999995,"5min":0.59399999999999997,"15min":0.46899999999999997},"max":{"1min":1.4259999999999999,"5min":17.420000000000002,"15min":17.420000000000002},"last":1.143},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.222,"15min":1.052},"min":{"1min":0.74299999999999999,"5min":0.59499999999999997,"15min":0.54300000000000004},"max":{"1min":1.371,"5min":17.643000000000001,"15min":17.643000000000001},"last":1.0780000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0880000000000001,"15min":1.038},"min":{"1min":0.77500000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3520000000000001,"5min":5.7220000000000004,"15min":5.7220000000000004},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0669999999999999,"15min":1.0129999999999999},"min":{"1min":0.877,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.417,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.2110000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.159,"15min":1.0740000000000001},"min":{"1min":0.81299999999999994,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3939999999999999,"5min":5.7800000000000002,"15min":5.7800000000000002},"last":1.244},{"interface":"front","average":{"1min":1.091,"5min":1.0920000000000001,"15min":1.0669999999999999},"min":{"1min":0.85699999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.343,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.27}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:20:21.897 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-10-03T19:20:21.896+0000 7f04f6522640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-03T19:20:24.848 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:20:24.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.980+0000 7f928a701640 1 Processor -- start 2023-10-03T19:20:24.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.980+0000 7f928a701640 1 -- start start 2023-10-03T19:20:24.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.980+0000 7f928a701640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f92840b98f0 0x7f92840b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:24.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.980+0000 7f928a701640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f92840a2e20 0x7f928406c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:24.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.980+0000 7f928a701640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92840ba550 con 0x7f92840bc810 2023-10-03T19:20:24.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.980+0000 7f928a701640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92841526d0 con 0x7f92840b98f0 2023-10-03T19:20:24.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.980+0000 7f928a701640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92841529b0 con 0x7f92840a2e20 2023-10-03T19:20:24.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.980+0000 7f9283fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f92840b98f0 0x7f92840b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:24.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.980+0000 7f92837fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f92840bc810 0x7f928406c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38150/0 (socket says 172.21.15.45:38150) 2023-10-03T19:20:24.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.980+0000 7f92837fe640 1 -- 172.21.15.45:0/1368480115 learned_addr learned my addr 172.21.15.45:0/1368480115 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:20:24.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.980+0000 7f9288c9e640 1 --2- 172.21.15.45:0/1368480115 >> v2:172.21.15.79:3300/0 conn(0x7f92840a2e20 0x7f928406c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:24.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.980+0000 7f9283fff640 1 -- 172.21.15.45:0/1368480115 >> v2:172.21.15.79:3300/0 conn(0x7f92840a2e20 msgr2=0x7f928406c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:24.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.980+0000 7f9283fff640 1 --2- 172.21.15.45:0/1368480115 >> v2:172.21.15.79:3300/0 conn(0x7f92840a2e20 0x7f928406c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:24.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.980+0000 7f9283fff640 1 -- 172.21.15.45:0/1368480115 >> v1:172.21.15.45:6789/0 conn(0x7f92840bc810 legacy=0x7f928406c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:24.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.980+0000 7f9283fff640 1 -- 172.21.15.45:0/1368480115 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928406cee0 con 0x7f92840b98f0 2023-10-03T19:20:24.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.984+0000 7f9283fff640 1 --2- 172.21.15.45:0/1368480115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92840b98f0 0x7f92840b9cc0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f928406eea0 tx=0x7f927801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6bdc175ecf6c23 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:24.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.984+0000 7f9282ffd640 1 -- 172.21.15.45:0/1368480115 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92780a8950 con 0x7f92840b98f0 2023-10-03T19:20:24.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.984+0000 7f9282ffd640 1 -- 172.21.15.45:0/1368480115 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92780a8ab0 con 0x7f92840b98f0 2023-10-03T19:20:24.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.984+0000 7f9282ffd640 1 -- 172.21.15.45:0/1368480115 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92780a8e40 con 0x7f92840b98f0 2023-10-03T19:20:24.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.984+0000 7f928a701640 1 -- 172.21.15.45:0/1368480115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92840b98f0 msgr2=0x7f92840b9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:24.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.984+0000 7f928a701640 1 --2- 172.21.15.45:0/1368480115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92840b98f0 0x7f92840b9cc0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f928406eea0 tx=0x7f927801ec50 comp rx=0 tx=0).stop 2023-10-03T19:20:24.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.984+0000 7f928a701640 1 -- 172.21.15.45:0/1368480115 shutdown_connections 2023-10-03T19:20:24.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.984+0000 7f928a701640 1 --2- 172.21.15.45:0/1368480115 >> v2:172.21.15.79:3300/0 conn(0x7f92840a2e20 0x7f928406c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:24.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.984+0000 7f928a701640 1 --2- 172.21.15.45:0/1368480115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92840b98f0 0x7f92840b9cc0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:24.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.984+0000 7f928a701640 1 -- 172.21.15.45:0/1368480115 >> 172.21.15.45:0/1368480115 conn(0x7f92840bcf50 msgr2=0x7f92840bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:24.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.984+0000 7f928a701640 1 -- 172.21.15.45:0/1368480115 shutdown_connections 2023-10-03T19:20:24.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.984+0000 7f928a701640 1 -- 172.21.15.45:0/1368480115 wait complete. 2023-10-03T19:20:24.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.984+0000 7f928a701640 1 Processor -- start 2023-10-03T19:20:24.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.984+0000 7f928a701640 1 -- start start 2023-10-03T19:20:24.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.984+0000 7f928a701640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92840a2e20 0x7f92841e7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:24.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.984+0000 7f928a701640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92840b98f0 0x7f92841e7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:24.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.984+0000 7f928a701640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92840bc810 0x7f928413a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:24.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.984+0000 7f928a701640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92841e8290 con 0x7f92840a2e20 2023-10-03T19:20:24.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.984+0000 7f928a701640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9284151310 con 0x7f92840bc810 2023-10-03T19:20:24.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.984+0000 7f928a701640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928414b730 con 0x7f92840b98f0 2023-10-03T19:20:24.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.984+0000 7f9283fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92840a2e20 0x7f92841e7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:24.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.984+0000 7f9283fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92840a2e20 0x7f92841e7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41144/0 (socket says 172.21.15.45:41144) 2023-10-03T19:20:24.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.984+0000 7f9283fff640 1 -- 172.21.15.45:0/1456937076 learned_addr learned my addr 172.21.15.45:0/1456937076 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:24.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.984+0000 7f9288c9e640 1 --2- 172.21.15.45:0/1456937076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92840bc810 0x7f928413a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:24.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.984+0000 7f92837fe640 1 --2- 172.21.15.45:0/1456937076 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92840b98f0 0x7f92841e7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:24.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.988+0000 7f9283fff640 1 -- 172.21.15.45:0/1456937076 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92840b98f0 msgr2=0x7f92841e7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:24.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.988+0000 7f9283fff640 1 --2- 172.21.15.45:0/1456937076 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92840b98f0 0x7f92841e7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:24.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.988+0000 7f9283fff640 1 -- 172.21.15.45:0/1456937076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92840bc810 msgr2=0x7f928413a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:24.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.988+0000 7f9283fff640 1 --2- 172.21.15.45:0/1456937076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92840bc810 0x7f928413a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:24.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.988+0000 7f9283fff640 1 -- 172.21.15.45:0/1456937076 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9278009420 con 0x7f92840a2e20 2023-10-03T19:20:24.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.988+0000 7f9288c9e640 1 --2- 172.21.15.45:0/1456937076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92840bc810 0x7f928413a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:20:24.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.988+0000 7f9283fff640 1 --2- 172.21.15.45:0/1456937076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92840a2e20 0x7f92841e7810 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f92780b3040 tx=0x7f927801b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:24.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.988+0000 7f9280ff9640 1 -- 172.21.15.45:0/1456937076 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92780b9630 con 0x7f92840a2e20 2023-10-03T19:20:24.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.988+0000 7f9280ff9640 1 -- 172.21.15.45:0/1456937076 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92780b97b0 con 0x7f92840a2e20 2023-10-03T19:20:24.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.988+0000 7f928a701640 1 -- 172.21.15.45:0/1456937076 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92840ba950 con 0x7f92840a2e20 2023-10-03T19:20:24.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.988+0000 7f9280ff9640 1 -- 172.21.15.45:0/1456937076 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92780b9b60 con 0x7f92840a2e20 2023-10-03T19:20:24.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.988+0000 7f928a701640 1 -- 172.21.15.45:0/1456937076 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92840ba200 con 0x7f92840a2e20 2023-10-03T19:20:24.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.988+0000 7f928a701640 1 -- 172.21.15.45:0/1456937076 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92840baae0 con 0x7f92840a2e20 2023-10-03T19:20:24.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.988+0000 7f9280ff9640 1 -- 172.21.15.45:0/1456937076 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f92780b7040 con 0x7f92840a2e20 2023-10-03T19:20:24.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.988+0000 7f9280ff9640 1 --2- 172.21.15.45:0/1456937076 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f92700662b0 0x7f9270068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:24.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.988+0000 7f9280ff9640 1 -- 172.21.15.45:0/1456937076 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9278121db0 con 0x7f92840a2e20 2023-10-03T19:20:24.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.988+0000 7f92837fe640 1 --2- 172.21.15.45:0/1456937076 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f92700662b0 0x7f9270068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:24.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.988+0000 7f92837fe640 1 --2- 172.21.15.45:0/1456937076 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f92700662b0 0x7f9270068760 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f928406fb60 tx=0x7f9274009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:24.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:24.992+0000 7f9280ff9640 1 -- 172.21.15.45:0/1456937076 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f92780ef1a0 con 0x7f92840a2e20 2023-10-03T19:20:25.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.144+0000 7f928a701640 1 -- 172.21.15.45:0/1456937076 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f928404de80 con 0x7f92700662b0 2023-10-03T19:20:25.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.168+0000 7f9280ff9640 1 -- 172.21.15.45:0/1456937076 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310532 (secure 0 0 0) 0x7f928404de80 con 0x7f92700662b0 2023-10-03T19:20:25.172 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:20:25.174 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:20:25.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.168+0000 7f928a701640 1 -- 172.21.15.45:0/1456937076 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f92700662b0 msgr2=0x7f9270068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:25.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.168+0000 7f928a701640 1 --2- 172.21.15.45:0/1456937076 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f92700662b0 0x7f9270068760 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f928406fb60 tx=0x7f9274009040 comp rx=0 tx=0).stop 2023-10-03T19:20:25.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.168+0000 7f928a701640 1 -- 172.21.15.45:0/1456937076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92840a2e20 msgr2=0x7f92841e7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:25.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.168+0000 7f928a701640 1 --2- 172.21.15.45:0/1456937076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92840a2e20 0x7f92841e7810 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f92780b3040 tx=0x7f927801b9f0 comp rx=0 tx=0).stop 2023-10-03T19:20:25.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.168+0000 7f928a701640 1 -- 172.21.15.45:0/1456937076 shutdown_connections 2023-10-03T19:20:25.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.168+0000 7f928a701640 1 --2- 172.21.15.45:0/1456937076 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f92700662b0 0x7f9270068760 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:25.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.168+0000 7f928a701640 1 --2- 172.21.15.45:0/1456937076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92840bc810 0x7f928413a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:25.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.168+0000 7f928a701640 1 --2- 172.21.15.45:0/1456937076 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92840b98f0 0x7f92841e7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:25.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.168+0000 7f928a701640 1 --2- 172.21.15.45:0/1456937076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92840a2e20 0x7f92841e7810 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:25.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.168+0000 7f928a701640 1 -- 172.21.15.45:0/1456937076 >> 172.21.15.45:0/1456937076 conn(0x7f92840bcf50 msgr2=0x7f92840bad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:25.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.172+0000 7f928a701640 1 -- 172.21.15.45:0/1456937076 shutdown_connections 2023-10-03T19:20:25.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.172+0000 7f928a701640 1 -- 172.21.15.45:0/1456937076 wait complete. 2023-10-03T19:20:25.190 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":346,"stamp":"2023-10-03T19:20:24.615502+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":251860,"kb_used_data":10708,"kb_used_omap":0,"kb_used_meta":241088,"kb_avail":754722860,"statfs":{"total":773094113280,"available":772836208640,"internally_reserved":0,"allocated":10964992,"data_stored":6133464,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":246874112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.301574"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:18.723659+0000","last_change":"2023-10-03T19:20:16.343087+0000","last_active":"2023-10-03T19:20:18.723659+0000","last_peered":"2023-10-03T19:20:18.723659+0000","last_clean":"2023-10-03T19:20:18.723659+0000","last_became_active":"2023-10-03T19:20:16.342222+0000","last_became_peered":"2023-10-03T19:20:16.342222+0000","last_unstale":"2023-10-03T19:20:18.723659+0000","last_undegraded":"2023-10-03T19:20:18.723659+0000","last_fullsized":"2023-10-03T19:20:18.723659+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:19:42.521510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:18.223037+0000","last_change":"2023-10-03T19:20:16.363146+0000","last_active":"2023-10-03T19:20:18.223037+0000","last_peered":"2023-10-03T19:20:18.223037+0000","last_clean":"2023-10-03T19:20:18.223037+0000","last_became_active":"2023-10-03T19:20:16.362873+0000","last_became_peered":"2023-10-03T19:20:16.362873+0000","last_unstale":"2023-10-03T19:20:18.223037+0000","last_undegraded":"2023-10-03T19:20:18.223037+0000","last_fullsized":"2023-10-03T19:20:18.223037+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:06:18.751942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:18.223193+0000","last_change":"2023-10-03T19:20:16.373400+0000","last_active":"2023-10-03T19:20:18.223193+0000","last_peered":"2023-10-03T19:20:18.223193+0000","last_clean":"2023-10-03T19:20:18.223193+0000","last_became_active":"2023-10-03T19:20:16.373076+0000","last_became_peered":"2023-10-03T19:20:16.373076+0000","last_unstale":"2023-10-03T19:20:18.223193+0000","last_undegraded":"2023-10-03T19:20:18.223193+0000","last_fullsized":"2023-10-03T19:20:18.223193+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:41:14.659298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.355466+0000","last_change":"2023-10-03T19:20:16.366790+0000","last_active":"2023-10-03T19:20:17.355466+0000","last_peered":"2023-10-03T19:20:17.355466+0000","last_clean":"2023-10-03T19:20:17.355466+0000","last_became_active":"2023-10-03T19:20:16.366099+0000","last_became_peered":"2023-10-03T19:20:16.366099+0000","last_unstale":"2023-10-03T19:20:17.355466+0000","last_undegraded":"2023-10-03T19:20:17.355466+0000","last_fullsized":"2023-10-03T19:20:17.355466+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:39:11.031635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:18.722906+0000","last_change":"2023-10-03T19:20:16.380848+0000","last_active":"2023-10-03T19:20:18.722906+0000","last_peered":"2023-10-03T19:20:18.722906+0000","last_clean":"2023-10-03T19:20:18.722906+0000","last_became_active":"2023-10-03T19:20:16.379931+0000","last_became_peered":"2023-10-03T19:20:16.379931+0000","last_unstale":"2023-10-03T19:20:18.722906+0000","last_undegraded":"2023-10-03T19:20:18.722906+0000","last_fullsized":"2023-10-03T19:20:18.722906+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:28:09.778339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427524+0000","last_change":"2023-10-03T19:20:16.326785+0000","last_active":"2023-10-03T19:20:17.427524+0000","last_peered":"2023-10-03T19:20:17.427524+0000","last_clean":"2023-10-03T19:20:17.427524+0000","last_became_active":"2023-10-03T19:20:16.326450+0000","last_became_peered":"2023-10-03T19:20:16.326450+0000","last_unstale":"2023-10-03T19:20:17.427524+0000","last_undegraded":"2023-10-03T19:20:17.427524+0000","last_fullsized":"2023-10-03T19:20:17.427524+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:28:31.610677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427927+0000","last_change":"2023-10-03T19:20:16.361601+0000","last_active":"2023-10-03T19:20:17.427927+0000","last_peered":"2023-10-03T19:20:17.427927+0000","last_clean":"2023-10-03T19:20:17.427927+0000","last_became_active":"2023-10-03T19:20:16.361314+0000","last_became_peered":"2023-10-03T19:20:16.361314+0000","last_unstale":"2023-10-03T19:20:17.427927+0000","last_undegraded":"2023-10-03T19:20:17.427927+0000","last_fullsized":"2023-10-03T19:20:17.427927+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:21:09.278090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:18.221625+0000","last_change":"2023-10-03T19:20:16.381356+0000","last_active":"2023-10-03T19:20:18.221625+0000","last_peered":"2023-10-03T19:20:18.221625+0000","last_clean":"2023-10-03T19:20:18.221625+0000","last_became_active":"2023-10-03T19:20:16.381113+0000","last_became_peered":"2023-10-03T19:20:16.381113+0000","last_unstale":"2023-10-03T19:20:18.221625+0000","last_undegraded":"2023-10-03T19:20:18.221625+0000","last_fullsized":"2023-10-03T19:20:18.221625+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:33:26.631117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.356174+0000","last_change":"2023-10-03T19:20:16.366438+0000","last_active":"2023-10-03T19:20:17.356174+0000","last_peered":"2023-10-03T19:20:17.356174+0000","last_clean":"2023-10-03T19:20:17.356174+0000","last_became_active":"2023-10-03T19:20:16.365832+0000","last_became_peered":"2023-10-03T19:20:16.365832+0000","last_unstale":"2023-10-03T19:20:17.356174+0000","last_undegraded":"2023-10-03T19:20:17.356174+0000","last_fullsized":"2023-10-03T19:20:17.356174+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:54:12.225696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:19.323541+0000","last_change":"2023-10-03T19:20:16.333439+0000","last_active":"2023-10-03T19:20:19.323541+0000","last_peered":"2023-10-03T19:20:19.323541+0000","last_clean":"2023-10-03T19:20:19.323541+0000","last_became_active":"2023-10-03T19:20:16.332236+0000","last_became_peered":"2023-10-03T19:20:16.332236+0000","last_unstale":"2023-10-03T19:20:19.323541+0000","last_undegraded":"2023-10-03T19:20:19.323541+0000","last_fullsized":"2023-10-03T19:20:19.323541+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:29:36.657383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:18.723139+0000","last_change":"2023-10-03T19:20:16.369509+0000","last_active":"2023-10-03T19:20:18.723139+0000","last_peered":"2023-10-03T19:20:18.723139+0000","last_clean":"2023-10-03T19:20:18.723139+0000","last_became_active":"2023-10-03T19:20:16.368845+0000","last_became_peered":"2023-10-03T19:20:16.368845+0000","last_unstale":"2023-10-03T19:20:18.723139+0000","last_undegraded":"2023-10-03T19:20:18.723139+0000","last_fullsized":"2023-10-03T19:20:18.723139+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:33:58.594474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.428312+0000","last_change":"2023-10-03T19:20:16.326180+0000","last_active":"2023-10-03T19:20:17.428312+0000","last_peered":"2023-10-03T19:20:17.428312+0000","last_clean":"2023-10-03T19:20:17.428312+0000","last_became_active":"2023-10-03T19:20:16.325905+0000","last_became_peered":"2023-10-03T19:20:16.325905+0000","last_unstale":"2023-10-03T19:20:17.428312+0000","last_undegraded":"2023-10-03T19:20:17.428312+0000","last_fullsized":"2023-10-03T19:20:17.428312+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:12:28.137148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:19.323681+0000","last_change":"2023-10-03T19:20:16.363982+0000","last_active":"2023-10-03T19:20:19.323681+0000","last_peered":"2023-10-03T19:20:19.323681+0000","last_clean":"2023-10-03T19:20:19.323681+0000","last_became_active":"2023-10-03T19:20:16.363497+0000","last_became_peered":"2023-10-03T19:20:16.363497+0000","last_unstale":"2023-10-03T19:20:19.323681+0000","last_undegraded":"2023-10-03T19:20:19.323681+0000","last_fullsized":"2023-10-03T19:20:19.323681+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:08:29.072701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:18.222105+0000","last_change":"2023-10-03T19:20:16.375187+0000","last_active":"2023-10-03T19:20:18.222105+0000","last_peered":"2023-10-03T19:20:18.222105+0000","last_clean":"2023-10-03T19:20:18.222105+0000","last_became_active":"2023-10-03T19:20:16.374869+0000","last_became_peered":"2023-10-03T19:20:16.374869+0000","last_unstale":"2023-10-03T19:20:18.222105+0000","last_undegraded":"2023-10-03T19:20:18.222105+0000","last_fullsized":"2023-10-03T19:20:18.222105+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:43:20.569415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:18.722756+0000","last_change":"2023-10-03T19:20:16.369450+0000","last_active":"2023-10-03T19:20:18.722756+0000","last_peered":"2023-10-03T19:20:18.722756+0000","last_clean":"2023-10-03T19:20:18.722756+0000","last_became_active":"2023-10-03T19:20:16.368874+0000","last_became_peered":"2023-10-03T19:20:16.368874+0000","last_unstale":"2023-10-03T19:20:18.722756+0000","last_undegraded":"2023-10-03T19:20:18.722756+0000","last_fullsized":"2023-10-03T19:20:18.722756+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:51:33.511169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427088+0000","last_change":"2023-10-03T19:20:16.330466+0000","last_active":"2023-10-03T19:20:17.427088+0000","last_peered":"2023-10-03T19:20:17.427088+0000","last_clean":"2023-10-03T19:20:17.427088+0000","last_became_active":"2023-10-03T19:20:16.330201+0000","last_became_peered":"2023-10-03T19:20:16.330201+0000","last_unstale":"2023-10-03T19:20:17.427088+0000","last_undegraded":"2023-10-03T19:20:17.427088+0000","last_fullsized":"2023-10-03T19:20:17.427088+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:40:35.218183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:19.323950+0000","last_change":"2023-10-03T19:20:16.363892+0000","last_active":"2023-10-03T19:20:19.323950+0000","last_peered":"2023-10-03T19:20:19.323950+0000","last_clean":"2023-10-03T19:20:19.323950+0000","last_became_active":"2023-10-03T19:20:16.363606+0000","last_became_peered":"2023-10-03T19:20:16.363606+0000","last_unstale":"2023-10-03T19:20:19.323950+0000","last_undegraded":"2023-10-03T19:20:19.323950+0000","last_fullsized":"2023-10-03T19:20:19.323950+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:16:04.698746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:18.223088+0000","last_change":"2023-10-03T19:20:16.363096+0000","last_active":"2023-10-03T19:20:18.223088+0000","last_peered":"2023-10-03T19:20:18.223088+0000","last_clean":"2023-10-03T19:20:18.223088+0000","last_became_active":"2023-10-03T19:20:16.362798+0000","last_became_peered":"2023-10-03T19:20:16.362798+0000","last_unstale":"2023-10-03T19:20:18.223088+0000","last_undegraded":"2023-10-03T19:20:18.223088+0000","last_fullsized":"2023-10-03T19:20:18.223088+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:10:01.974881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.329432+0000","last_change":"2023-10-03T19:20:16.383943+0000","last_active":"2023-10-03T19:20:17.329432+0000","last_peered":"2023-10-03T19:20:17.329432+0000","last_clean":"2023-10-03T19:20:17.329432+0000","last_became_active":"2023-10-03T19:20:16.383157+0000","last_became_peered":"2023-10-03T19:20:16.383157+0000","last_unstale":"2023-10-03T19:20:17.329432+0000","last_undegraded":"2023-10-03T19:20:17.329432+0000","last_fullsized":"2023-10-03T19:20:17.329432+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:34:17.223181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.318797+0000","last_change":"2023-10-03T19:20:16.322423+0000","last_active":"2023-10-03T19:20:17.318797+0000","last_peered":"2023-10-03T19:20:17.318797+0000","last_clean":"2023-10-03T19:20:17.318797+0000","last_became_active":"2023-10-03T19:20:16.322147+0000","last_became_peered":"2023-10-03T19:20:16.322147+0000","last_unstale":"2023-10-03T19:20:17.318797+0000","last_undegraded":"2023-10-03T19:20:17.318797+0000","last_fullsized":"2023-10-03T19:20:17.318797+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:12:31.453399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.355168+0000","last_change":"2023-10-03T19:20:16.372224+0000","last_active":"2023-10-03T19:20:17.355168+0000","last_peered":"2023-10-03T19:20:17.355168+0000","last_clean":"2023-10-03T19:20:17.355168+0000","last_became_active":"2023-10-03T19:20:16.371522+0000","last_became_peered":"2023-10-03T19:20:16.371522+0000","last_unstale":"2023-10-03T19:20:17.355168+0000","last_undegraded":"2023-10-03T19:20:17.355168+0000","last_fullsized":"2023-10-03T19:20:17.355168+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:30:59.547552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:18.723203+0000","last_change":"2023-10-03T19:20:16.348420+0000","last_active":"2023-10-03T19:20:18.723203+0000","last_peered":"2023-10-03T19:20:18.723203+0000","last_clean":"2023-10-03T19:20:18.723203+0000","last_became_active":"2023-10-03T19:20:16.347688+0000","last_became_peered":"2023-10-03T19:20:16.347688+0000","last_unstale":"2023-10-03T19:20:18.723203+0000","last_undegraded":"2023-10-03T19:20:18.723203+0000","last_fullsized":"2023-10-03T19:20:18.723203+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:38:30.267489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.355435+0000","last_change":"2023-10-03T19:20:16.373061+0000","last_active":"2023-10-03T19:20:17.355435+0000","last_peered":"2023-10-03T19:20:17.355435+0000","last_clean":"2023-10-03T19:20:17.355435+0000","last_became_active":"2023-10-03T19:20:16.372301+0000","last_became_peered":"2023-10-03T19:20:16.372301+0000","last_unstale":"2023-10-03T19:20:17.355435+0000","last_undegraded":"2023-10-03T19:20:17.355435+0000","last_fullsized":"2023-10-03T19:20:17.355435+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:57:44.323828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.326772+0000","last_change":"2023-10-03T19:20:16.378738+0000","last_active":"2023-10-03T19:20:17.326772+0000","last_peered":"2023-10-03T19:20:17.326772+0000","last_clean":"2023-10-03T19:20:17.326772+0000","last_became_active":"2023-10-03T19:20:16.378316+0000","last_became_peered":"2023-10-03T19:20:16.378316+0000","last_unstale":"2023-10-03T19:20:17.326772+0000","last_undegraded":"2023-10-03T19:20:17.326772+0000","last_fullsized":"2023-10-03T19:20:17.326772+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:48:24.816920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328599+0000","last_change":"2023-10-03T19:20:16.360114+0000","last_active":"2023-10-03T19:20:17.328599+0000","last_peered":"2023-10-03T19:20:17.328599+0000","last_clean":"2023-10-03T19:20:17.328599+0000","last_became_active":"2023-10-03T19:20:16.359471+0000","last_became_peered":"2023-10-03T19:20:16.359471+0000","last_unstale":"2023-10-03T19:20:17.328599+0000","last_undegraded":"2023-10-03T19:20:17.328599+0000","last_fullsized":"2023-10-03T19:20:17.328599+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:37:47.071602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.318972+0000","last_change":"2023-10-03T19:20:16.332688+0000","last_active":"2023-10-03T19:20:17.318972+0000","last_peered":"2023-10-03T19:20:17.318972+0000","last_clean":"2023-10-03T19:20:17.318972+0000","last_became_active":"2023-10-03T19:20:16.332406+0000","last_became_peered":"2023-10-03T19:20:16.332406+0000","last_unstale":"2023-10-03T19:20:17.318972+0000","last_undegraded":"2023-10-03T19:20:17.318972+0000","last_fullsized":"2023-10-03T19:20:17.318972+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:56:57.997822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.329517+0000","last_change":"2023-10-03T19:20:16.383652+0000","last_active":"2023-10-03T19:20:17.329517+0000","last_peered":"2023-10-03T19:20:17.329517+0000","last_clean":"2023-10-03T19:20:17.329517+0000","last_became_active":"2023-10-03T19:20:16.382532+0000","last_became_peered":"2023-10-03T19:20:16.382532+0000","last_unstale":"2023-10-03T19:20:17.329517+0000","last_undegraded":"2023-10-03T19:20:17.329517+0000","last_fullsized":"2023-10-03T19:20:17.329517+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:13:33.426772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.428479+0000","last_change":"2023-10-03T19:20:16.363654+0000","last_active":"2023-10-03T19:20:17.428479+0000","last_peered":"2023-10-03T19:20:17.428479+0000","last_clean":"2023-10-03T19:20:17.428479+0000","last_became_active":"2023-10-03T19:20:16.363344+0000","last_became_peered":"2023-10-03T19:20:16.363344+0000","last_unstale":"2023-10-03T19:20:17.428479+0000","last_undegraded":"2023-10-03T19:20:17.428479+0000","last_fullsized":"2023-10-03T19:20:17.428479+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:52:35.362235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.318244+0000","last_change":"2023-10-03T19:20:16.327198+0000","last_active":"2023-10-03T19:20:17.318244+0000","last_peered":"2023-10-03T19:20:17.318244+0000","last_clean":"2023-10-03T19:20:17.318244+0000","last_became_active":"2023-10-03T19:20:16.326730+0000","last_became_peered":"2023-10-03T19:20:16.326730+0000","last_unstale":"2023-10-03T19:20:17.318244+0000","last_undegraded":"2023-10-03T19:20:17.318244+0000","last_fullsized":"2023-10-03T19:20:17.318244+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:40:02.105613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:18.222170+0000","last_change":"2023-10-03T19:20:16.350081+0000","last_active":"2023-10-03T19:20:18.222170+0000","last_peered":"2023-10-03T19:20:18.222170+0000","last_clean":"2023-10-03T19:20:18.222170+0000","last_became_active":"2023-10-03T19:20:16.349794+0000","last_became_peered":"2023-10-03T19:20:16.349794+0000","last_unstale":"2023-10-03T19:20:18.222170+0000","last_undegraded":"2023-10-03T19:20:18.222170+0000","last_fullsized":"2023-10-03T19:20:18.222170+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:07:59.611965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.327148+0000","last_change":"2023-10-03T19:20:16.336333+0000","last_active":"2023-10-03T19:20:17.327148+0000","last_peered":"2023-10-03T19:20:17.327148+0000","last_clean":"2023-10-03T19:20:17.327148+0000","last_became_active":"2023-10-03T19:20:16.328732+0000","last_became_peered":"2023-10-03T19:20:16.328732+0000","last_unstale":"2023-10-03T19:20:17.327148+0000","last_undegraded":"2023-10-03T19:20:17.327148+0000","last_fullsized":"2023-10-03T19:20:17.327148+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:38:34.923323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.326771+0000","last_change":"2023-10-03T19:20:16.357185+0000","last_active":"2023-10-03T19:20:17.326771+0000","last_peered":"2023-10-03T19:20:17.326771+0000","last_clean":"2023-10-03T19:20:17.326771+0000","last_became_active":"2023-10-03T19:20:16.356591+0000","last_became_peered":"2023-10-03T19:20:16.356591+0000","last_unstale":"2023-10-03T19:20:17.326771+0000","last_undegraded":"2023-10-03T19:20:17.326771+0000","last_fullsized":"2023-10-03T19:20:17.326771+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:36:02.147396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:19.323325+0000","last_change":"2023-10-03T19:20:16.332773+0000","last_active":"2023-10-03T19:20:19.323325+0000","last_peered":"2023-10-03T19:20:19.323325+0000","last_clean":"2023-10-03T19:20:19.323325+0000","last_became_active":"2023-10-03T19:20:16.332432+0000","last_became_peered":"2023-10-03T19:20:16.332432+0000","last_unstale":"2023-10-03T19:20:19.323325+0000","last_undegraded":"2023-10-03T19:20:19.323325+0000","last_fullsized":"2023-10-03T19:20:19.323325+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:48:21.430787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"108'4","reported_seq":17,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.330032+0000","last_change":"2023-10-03T19:20:15.974915+0000","last_active":"2023-10-03T19:20:17.330032+0000","last_peered":"2023-10-03T19:20:17.330032+0000","last_clean":"2023-10-03T19:20:17.330032+0000","last_became_active":"2023-10-03T19:20:15.974027+0000","last_became_peered":"2023-10-03T19:20:15.974027+0000","last_unstale":"2023-10-03T19:20:17.330032+0000","last_undegraded":"2023-10-03T19:20:17.330032+0000","last_fullsized":"2023-10-03T19:20:17.330032+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:42:02.754043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427780+0000","last_change":"2023-10-03T19:20:16.328760+0000","last_active":"2023-10-03T19:20:17.427780+0000","last_peered":"2023-10-03T19:20:17.427780+0000","last_clean":"2023-10-03T19:20:17.427780+0000","last_became_active":"2023-10-03T19:20:16.328456+0000","last_became_peered":"2023-10-03T19:20:16.328456+0000","last_unstale":"2023-10-03T19:20:17.427780+0000","last_undegraded":"2023-10-03T19:20:17.427780+0000","last_fullsized":"2023-10-03T19:20:17.427780+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:36:28.692332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"108'1","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:19.323865+0000","last_change":"2023-10-03T19:20:15.948383+0000","last_active":"2023-10-03T19:20:19.323865+0000","last_peered":"2023-10-03T19:20:19.323865+0000","last_clean":"2023-10-03T19:20:19.323865+0000","last_became_active":"2023-10-03T19:20:15.947986+0000","last_became_peered":"2023-10-03T19:20:15.947986+0000","last_unstale":"2023-10-03T19:20:19.323865+0000","last_undegraded":"2023-10-03T19:20:19.323865+0000","last_fullsized":"2023-10-03T19:20:19.323865+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:44:21.702985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328274+0000","last_change":"2023-10-03T19:20:16.361589+0000","last_active":"2023-10-03T19:20:17.328274+0000","last_peered":"2023-10-03T19:20:17.328274+0000","last_clean":"2023-10-03T19:20:17.328274+0000","last_became_active":"2023-10-03T19:20:16.360874+0000","last_became_peered":"2023-10-03T19:20:16.360874+0000","last_unstale":"2023-10-03T19:20:17.328274+0000","last_undegraded":"2023-10-03T19:20:17.328274+0000","last_fullsized":"2023-10-03T19:20:17.328274+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:24:03.546278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"108'2","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.355773+0000","last_change":"2023-10-03T19:20:15.972052+0000","last_active":"2023-10-03T19:20:17.355773+0000","last_peered":"2023-10-03T19:20:17.355773+0000","last_clean":"2023-10-03T19:20:17.355773+0000","last_became_active":"2023-10-03T19:20:15.971172+0000","last_became_peered":"2023-10-03T19:20:15.971172+0000","last_unstale":"2023-10-03T19:20:17.355773+0000","last_undegraded":"2023-10-03T19:20:17.355773+0000","last_fullsized":"2023-10-03T19:20:17.355773+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:43:04.125488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.356272+0000","last_change":"2023-10-03T19:20:16.368357+0000","last_active":"2023-10-03T19:20:17.356272+0000","last_peered":"2023-10-03T19:20:17.356272+0000","last_clean":"2023-10-03T19:20:17.356272+0000","last_became_active":"2023-10-03T19:20:16.367616+0000","last_became_peered":"2023-10-03T19:20:16.367616+0000","last_unstale":"2023-10-03T19:20:17.356272+0000","last_undegraded":"2023-10-03T19:20:17.356272+0000","last_fullsized":"2023-10-03T19:20:17.356272+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:31:03.941787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"108'2","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:19.323684+0000","last_change":"2023-10-03T19:20:15.964371+0000","last_active":"2023-10-03T19:20:19.323684+0000","last_peered":"2023-10-03T19:20:19.323684+0000","last_clean":"2023-10-03T19:20:19.323684+0000","last_became_active":"2023-10-03T19:20:15.963961+0000","last_became_peered":"2023-10-03T19:20:15.963961+0000","last_unstale":"2023-10-03T19:20:19.323684+0000","last_undegraded":"2023-10-03T19:20:19.323684+0000","last_fullsized":"2023-10-03T19:20:19.323684+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:10:10.675847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:19.322853+0000","last_change":"2023-10-03T19:20:16.374148+0000","last_active":"2023-10-03T19:20:19.322853+0000","last_peered":"2023-10-03T19:20:19.322853+0000","last_clean":"2023-10-03T19:20:19.322853+0000","last_became_active":"2023-10-03T19:20:16.373840+0000","last_became_peered":"2023-10-03T19:20:16.373840+0000","last_unstale":"2023-10-03T19:20:19.322853+0000","last_undegraded":"2023-10-03T19:20:19.322853+0000","last_fullsized":"2023-10-03T19:20:19.322853+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:02:21.053649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"108'1","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:18.723218+0000","last_change":"2023-10-03T19:20:15.956585+0000","last_active":"2023-10-03T19:20:18.723218+0000","last_peered":"2023-10-03T19:20:18.723218+0000","last_clean":"2023-10-03T19:20:18.723218+0000","last_became_active":"2023-10-03T19:20:15.955764+0000","last_became_peered":"2023-10-03T19:20:15.955764+0000","last_unstale":"2023-10-03T19:20:18.723218+0000","last_undegraded":"2023-10-03T19:20:18.723218+0000","last_fullsized":"2023-10-03T19:20:18.723218+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:28:33.486789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:18.722927+0000","last_change":"2023-10-03T19:20:16.380278+0000","last_active":"2023-10-03T19:20:18.722927+0000","last_peered":"2023-10-03T19:20:18.722927+0000","last_clean":"2023-10-03T19:20:18.722927+0000","last_became_active":"2023-10-03T19:20:16.379843+0000","last_became_peered":"2023-10-03T19:20:16.379843+0000","last_unstale":"2023-10-03T19:20:18.722927+0000","last_undegraded":"2023-10-03T19:20:18.722927+0000","last_fullsized":"2023-10-03T19:20:18.722927+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:33:26.631117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"108'1","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427728+0000","last_change":"2023-10-03T19:20:15.967905+0000","last_active":"2023-10-03T19:20:17.427728+0000","last_peered":"2023-10-03T19:20:17.427728+0000","last_clean":"2023-10-03T19:20:17.427728+0000","last_became_active":"2023-10-03T19:20:15.967603+0000","last_became_peered":"2023-10-03T19:20:15.967603+0000","last_unstale":"2023-10-03T19:20:17.427728+0000","last_undegraded":"2023-10-03T19:20:17.427728+0000","last_fullsized":"2023-10-03T19:20:17.427728+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:23:31.344311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:18.222422+0000","last_change":"2023-10-03T19:20:16.333211+0000","last_active":"2023-10-03T19:20:18.222422+0000","last_peered":"2023-10-03T19:20:18.222422+0000","last_clean":"2023-10-03T19:20:18.222422+0000","last_became_active":"2023-10-03T19:20:16.332946+0000","last_became_peered":"2023-10-03T19:20:16.332946+0000","last_unstale":"2023-10-03T19:20:18.222422+0000","last_undegraded":"2023-10-03T19:20:18.222422+0000","last_fullsized":"2023-10-03T19:20:18.222422+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:14:43.186724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.327271+0000","last_change":"2023-10-03T19:20:15.955201+0000","last_active":"2023-10-03T19:20:17.327271+0000","last_peered":"2023-10-03T19:20:17.327271+0000","last_clean":"2023-10-03T19:20:17.327271+0000","last_became_active":"2023-10-03T19:20:15.954436+0000","last_became_peered":"2023-10-03T19:20:15.954436+0000","last_unstale":"2023-10-03T19:20:17.327271+0000","last_undegraded":"2023-10-03T19:20:17.327271+0000","last_fullsized":"2023-10-03T19:20:17.327271+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:39:18.747278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:19.323790+0000","last_change":"2023-10-03T19:20:16.328049+0000","last_active":"2023-10-03T19:20:19.323790+0000","last_peered":"2023-10-03T19:20:19.323790+0000","last_clean":"2023-10-03T19:20:19.323790+0000","last_became_active":"2023-10-03T19:20:16.327707+0000","last_became_peered":"2023-10-03T19:20:16.327707+0000","last_unstale":"2023-10-03T19:20:19.323790+0000","last_undegraded":"2023-10-03T19:20:19.323790+0000","last_fullsized":"2023-10-03T19:20:19.323790+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:36:31.477923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427488+0000","last_change":"2023-10-03T19:20:15.954813+0000","last_active":"2023-10-03T19:20:17.427488+0000","last_peered":"2023-10-03T19:20:17.427488+0000","last_clean":"2023-10-03T19:20:17.427488+0000","last_became_active":"2023-10-03T19:20:15.954281+0000","last_became_peered":"2023-10-03T19:20:15.954281+0000","last_unstale":"2023-10-03T19:20:17.427488+0000","last_undegraded":"2023-10-03T19:20:17.427488+0000","last_fullsized":"2023-10-03T19:20:17.427488+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:10:30.851090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328147+0000","last_change":"2023-10-03T19:20:16.360131+0000","last_active":"2023-10-03T19:20:17.328147+0000","last_peered":"2023-10-03T19:20:17.328147+0000","last_clean":"2023-10-03T19:20:17.328147+0000","last_became_active":"2023-10-03T19:20:16.359396+0000","last_became_peered":"2023-10-03T19:20:16.359396+0000","last_unstale":"2023-10-03T19:20:17.328147+0000","last_undegraded":"2023-10-03T19:20:17.328147+0000","last_fullsized":"2023-10-03T19:20:17.328147+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:19:39.425532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"108'1","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:19.323766+0000","last_change":"2023-10-03T19:20:15.956714+0000","last_active":"2023-10-03T19:20:19.323766+0000","last_peered":"2023-10-03T19:20:19.323766+0000","last_clean":"2023-10-03T19:20:19.323766+0000","last_became_active":"2023-10-03T19:20:15.956345+0000","last_became_peered":"2023-10-03T19:20:15.956345+0000","last_unstale":"2023-10-03T19:20:19.323766+0000","last_undegraded":"2023-10-03T19:20:19.323766+0000","last_fullsized":"2023-10-03T19:20:19.323766+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:15:23.565237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:18.723314+0000","last_change":"2023-10-03T19:20:16.346680+0000","last_active":"2023-10-03T19:20:18.723314+0000","last_peered":"2023-10-03T19:20:18.723314+0000","last_clean":"2023-10-03T19:20:18.723314+0000","last_became_active":"2023-10-03T19:20:16.345966+0000","last_became_peered":"2023-10-03T19:20:16.345966+0000","last_unstale":"2023-10-03T19:20:18.723314+0000","last_undegraded":"2023-10-03T19:20:18.723314+0000","last_fullsized":"2023-10-03T19:20:18.723314+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:43:20.569415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"108'2","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.319319+0000","last_change":"2023-10-03T19:20:15.957563+0000","last_active":"2023-10-03T19:20:17.319319+0000","last_peered":"2023-10-03T19:20:17.319319+0000","last_clean":"2023-10-03T19:20:17.319319+0000","last_became_active":"2023-10-03T19:20:15.957133+0000","last_became_peered":"2023-10-03T19:20:15.957133+0000","last_unstale":"2023-10-03T19:20:17.319319+0000","last_undegraded":"2023-10-03T19:20:17.319319+0000","last_fullsized":"2023-10-03T19:20:17.319319+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:14:44.702562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.428460+0000","last_change":"2023-10-03T19:20:16.350664+0000","last_active":"2023-10-03T19:20:17.428460+0000","last_peered":"2023-10-03T19:20:17.428460+0000","last_clean":"2023-10-03T19:20:17.428460+0000","last_became_active":"2023-10-03T19:20:16.350368+0000","last_became_peered":"2023-10-03T19:20:16.350368+0000","last_unstale":"2023-10-03T19:20:17.428460+0000","last_undegraded":"2023-10-03T19:20:17.428460+0000","last_fullsized":"2023-10-03T19:20:17.428460+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:26:55.310688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"108'1","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.356239+0000","last_change":"2023-10-03T19:20:15.974399+0000","last_active":"2023-10-03T19:20:17.356239+0000","last_peered":"2023-10-03T19:20:17.356239+0000","last_clean":"2023-10-03T19:20:17.356239+0000","last_became_active":"2023-10-03T19:20:15.973595+0000","last_became_peered":"2023-10-03T19:20:15.973595+0000","last_unstale":"2023-10-03T19:20:17.356239+0000","last_undegraded":"2023-10-03T19:20:17.356239+0000","last_fullsized":"2023-10-03T19:20:17.356239+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:41:16.370396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.329360+0000","last_change":"2023-10-03T19:20:16.380011+0000","last_active":"2023-10-03T19:20:17.329360+0000","last_peered":"2023-10-03T19:20:17.329360+0000","last_clean":"2023-10-03T19:20:17.329360+0000","last_became_active":"2023-10-03T19:20:16.379481+0000","last_became_peered":"2023-10-03T19:20:16.379481+0000","last_unstale":"2023-10-03T19:20:17.329360+0000","last_undegraded":"2023-10-03T19:20:17.329360+0000","last_fullsized":"2023-10-03T19:20:17.329360+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:03:01.967348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.355903+0000","last_change":"2023-10-03T19:20:15.969845+0000","last_active":"2023-10-03T19:20:17.355903+0000","last_peered":"2023-10-03T19:20:17.355903+0000","last_clean":"2023-10-03T19:20:17.355903+0000","last_became_active":"2023-10-03T19:20:15.969245+0000","last_became_peered":"2023-10-03T19:20:15.969245+0000","last_unstale":"2023-10-03T19:20:17.355903+0000","last_undegraded":"2023-10-03T19:20:17.355903+0000","last_fullsized":"2023-10-03T19:20:17.355903+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:48:54.765040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427116+0000","last_change":"2023-10-03T19:20:16.381646+0000","last_active":"2023-10-03T19:20:17.427116+0000","last_peered":"2023-10-03T19:20:17.427116+0000","last_clean":"2023-10-03T19:20:17.427116+0000","last_became_active":"2023-10-03T19:20:16.381252+0000","last_became_peered":"2023-10-03T19:20:16.381252+0000","last_unstale":"2023-10-03T19:20:17.427116+0000","last_undegraded":"2023-10-03T19:20:17.427116+0000","last_fullsized":"2023-10-03T19:20:17.427116+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:37:09.807280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"108'2","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427703+0000","last_change":"2023-10-03T19:20:15.968967+0000","last_active":"2023-10-03T19:20:17.427703+0000","last_peered":"2023-10-03T19:20:17.427703+0000","last_clean":"2023-10-03T19:20:17.427703+0000","last_became_active":"2023-10-03T19:20:15.968699+0000","last_became_peered":"2023-10-03T19:20:15.968699+0000","last_unstale":"2023-10-03T19:20:17.427703+0000","last_undegraded":"2023-10-03T19:20:17.427703+0000","last_fullsized":"2023-10-03T19:20:17.427703+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:10:38.839362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:18.221722+0000","last_change":"2023-10-03T19:20:16.358065+0000","last_active":"2023-10-03T19:20:18.221722+0000","last_peered":"2023-10-03T19:20:18.221722+0000","last_clean":"2023-10-03T19:20:18.221722+0000","last_became_active":"2023-10-03T19:20:16.357785+0000","last_became_peered":"2023-10-03T19:20:16.357785+0000","last_unstale":"2023-10-03T19:20:18.221722+0000","last_undegraded":"2023-10-03T19:20:18.221722+0000","last_fullsized":"2023-10-03T19:20:18.221722+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:33:58.594474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.355125+0000","last_change":"2023-10-03T19:20:15.965136+0000","last_active":"2023-10-03T19:20:17.355125+0000","last_peered":"2023-10-03T19:20:17.355125+0000","last_clean":"2023-10-03T19:20:17.355125+0000","last_became_active":"2023-10-03T19:20:15.964445+0000","last_became_peered":"2023-10-03T19:20:15.964445+0000","last_unstale":"2023-10-03T19:20:17.355125+0000","last_undegraded":"2023-10-03T19:20:17.355125+0000","last_fullsized":"2023-10-03T19:20:17.355125+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:46:39.881918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:18.222606+0000","last_change":"2023-10-03T19:20:16.375180+0000","last_active":"2023-10-03T19:20:18.222606+0000","last_peered":"2023-10-03T19:20:18.222606+0000","last_clean":"2023-10-03T19:20:18.222606+0000","last_became_active":"2023-10-03T19:20:16.374827+0000","last_became_peered":"2023-10-03T19:20:16.374827+0000","last_unstale":"2023-10-03T19:20:18.222606+0000","last_undegraded":"2023-10-03T19:20:18.222606+0000","last_fullsized":"2023-10-03T19:20:18.222606+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:44:48.350041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:18.222240+0000","last_change":"2023-10-03T19:20:15.968473+0000","last_active":"2023-10-03T19:20:18.222240+0000","last_peered":"2023-10-03T19:20:18.222240+0000","last_clean":"2023-10-03T19:20:18.222240+0000","last_became_active":"2023-10-03T19:20:15.968149+0000","last_became_peered":"2023-10-03T19:20:15.968149+0000","last_unstale":"2023-10-03T19:20:18.222240+0000","last_undegraded":"2023-10-03T19:20:18.222240+0000","last_fullsized":"2023-10-03T19:20:18.222240+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:19:41.505280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.327669+0000","last_change":"2023-10-03T19:20:16.360789+0000","last_active":"2023-10-03T19:20:17.327669+0000","last_peered":"2023-10-03T19:20:17.327669+0000","last_clean":"2023-10-03T19:20:17.327669+0000","last_became_active":"2023-10-03T19:20:16.360054+0000","last_became_peered":"2023-10-03T19:20:16.360054+0000","last_unstale":"2023-10-03T19:20:17.327669+0000","last_undegraded":"2023-10-03T19:20:17.327669+0000","last_fullsized":"2023-10-03T19:20:17.327669+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:49:08.311127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.354799+0000","last_change":"2023-10-03T19:20:15.974966+0000","last_active":"2023-10-03T19:20:17.354799+0000","last_peered":"2023-10-03T19:20:17.354799+0000","last_clean":"2023-10-03T19:20:17.354799+0000","last_became_active":"2023-10-03T19:20:15.974042+0000","last_became_peered":"2023-10-03T19:20:15.974042+0000","last_unstale":"2023-10-03T19:20:17.354799+0000","last_undegraded":"2023-10-03T19:20:17.354799+0000","last_fullsized":"2023-10-03T19:20:17.354799+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:45:32.624972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.428525+0000","last_change":"2023-10-03T19:20:16.323318+0000","last_active":"2023-10-03T19:20:17.428525+0000","last_peered":"2023-10-03T19:20:17.428525+0000","last_clean":"2023-10-03T19:20:17.428525+0000","last_became_active":"2023-10-03T19:20:16.322090+0000","last_became_peered":"2023-10-03T19:20:16.322090+0000","last_unstale":"2023-10-03T19:20:17.428525+0000","last_undegraded":"2023-10-03T19:20:17.428525+0000","last_fullsized":"2023-10-03T19:20:17.428525+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T05:41:27.118657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"108'2","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.428161+0000","last_change":"2023-10-03T19:20:15.948790+0000","last_active":"2023-10-03T19:20:17.428161+0000","last_peered":"2023-10-03T19:20:17.428161+0000","last_clean":"2023-10-03T19:20:17.428161+0000","last_became_active":"2023-10-03T19:20:15.948222+0000","last_became_peered":"2023-10-03T19:20:15.948222+0000","last_unstale":"2023-10-03T19:20:17.428161+0000","last_undegraded":"2023-10-03T19:20:17.428161+0000","last_fullsized":"2023-10-03T19:20:17.428161+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:14:18.658361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:19.323258+0000","last_change":"2023-10-03T19:20:16.373432+0000","last_active":"2023-10-03T19:20:19.323258+0000","last_peered":"2023-10-03T19:20:19.323258+0000","last_clean":"2023-10-03T19:20:19.323258+0000","last_became_active":"2023-10-03T19:20:16.373117+0000","last_became_peered":"2023-10-03T19:20:16.373117+0000","last_unstale":"2023-10-03T19:20:19.323258+0000","last_undegraded":"2023-10-03T19:20:19.323258+0000","last_fullsized":"2023-10-03T19:20:19.323258+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:46:05.431749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"109'1","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.343467+0000","last_change":"2023-10-03T19:20:15.964945+0000","last_active":"2023-10-03T19:20:17.343467+0000","last_peered":"2023-10-03T19:20:17.343467+0000","last_clean":"2023-10-03T19:20:17.343467+0000","last_became_active":"2023-10-03T19:20:15.963013+0000","last_became_peered":"2023-10-03T19:20:15.963013+0000","last_unstale":"2023-10-03T19:20:17.343467+0000","last_undegraded":"2023-10-03T19:20:17.343467+0000","last_fullsized":"2023-10-03T19:20:17.343467+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:58:07.182707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.355921+0000","last_change":"2023-10-03T19:20:16.366914+0000","last_active":"2023-10-03T19:20:17.355921+0000","last_peered":"2023-10-03T19:20:17.355921+0000","last_clean":"2023-10-03T19:20:17.355921+0000","last_became_active":"2023-10-03T19:20:16.366399+0000","last_became_peered":"2023-10-03T19:20:16.366399+0000","last_unstale":"2023-10-03T19:20:17.355921+0000","last_undegraded":"2023-10-03T19:20:17.355921+0000","last_fullsized":"2023-10-03T19:20:17.355921+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:11:26.267368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.329780+0000","last_change":"2023-10-03T19:20:15.964082+0000","last_active":"2023-10-03T19:20:17.329780+0000","last_peered":"2023-10-03T19:20:17.329780+0000","last_clean":"2023-10-03T19:20:17.329780+0000","last_became_active":"2023-10-03T19:20:15.963061+0000","last_became_peered":"2023-10-03T19:20:15.963061+0000","last_unstale":"2023-10-03T19:20:17.329780+0000","last_undegraded":"2023-10-03T19:20:17.329780+0000","last_fullsized":"2023-10-03T19:20:17.329780+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:48:54.530229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.319098+0000","last_change":"2023-10-03T19:20:16.356943+0000","last_active":"2023-10-03T19:20:17.319098+0000","last_peered":"2023-10-03T19:20:17.319098+0000","last_clean":"2023-10-03T19:20:17.319098+0000","last_became_active":"2023-10-03T19:20:16.356724+0000","last_became_peered":"2023-10-03T19:20:16.356724+0000","last_unstale":"2023-10-03T19:20:17.319098+0000","last_undegraded":"2023-10-03T19:20:17.319098+0000","last_fullsized":"2023-10-03T19:20:17.319098+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:39:11.226990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.428638+0000","last_change":"2023-10-03T19:20:15.950804+0000","last_active":"2023-10-03T19:20:17.428638+0000","last_peered":"2023-10-03T19:20:17.428638+0000","last_clean":"2023-10-03T19:20:17.428638+0000","last_became_active":"2023-10-03T19:20:15.949850+0000","last_became_peered":"2023-10-03T19:20:15.949850+0000","last_unstale":"2023-10-03T19:20:17.428638+0000","last_undegraded":"2023-10-03T19:20:17.428638+0000","last_fullsized":"2023-10-03T19:20:17.428638+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:22:47.665712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.427510+0000","last_change":"2023-10-03T19:20:16.335345+0000","last_active":"2023-10-03T19:20:17.427510+0000","last_peered":"2023-10-03T19:20:17.427510+0000","last_clean":"2023-10-03T19:20:17.427510+0000","last_became_active":"2023-10-03T19:20:16.335141+0000","last_became_peered":"2023-10-03T19:20:16.335141+0000","last_unstale":"2023-10-03T19:20:17.427510+0000","last_undegraded":"2023-10-03T19:20:17.427510+0000","last_fullsized":"2023-10-03T19:20:17.427510+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:15:10.493042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:18.723261+0000","last_change":"2023-10-03T19:20:15.951459+0000","last_active":"2023-10-03T19:20:18.723261+0000","last_peered":"2023-10-03T19:20:18.723261+0000","last_clean":"2023-10-03T19:20:18.723261+0000","last_became_active":"2023-10-03T19:20:15.950750+0000","last_became_peered":"2023-10-03T19:20:15.950750+0000","last_unstale":"2023-10-03T19:20:18.723261+0000","last_undegraded":"2023-10-03T19:20:18.723261+0000","last_fullsized":"2023-10-03T19:20:18.723261+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:35:17.982504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:18.221897+0000","last_change":"2023-10-03T19:20:16.375367+0000","last_active":"2023-10-03T19:20:18.221897+0000","last_peered":"2023-10-03T19:20:18.221897+0000","last_clean":"2023-10-03T19:20:18.221897+0000","last_became_active":"2023-10-03T19:20:16.374988+0000","last_became_peered":"2023-10-03T19:20:16.374988+0000","last_unstale":"2023-10-03T19:20:18.221897+0000","last_undegraded":"2023-10-03T19:20:18.221897+0000","last_fullsized":"2023-10-03T19:20:18.221897+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:28:34.503019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:18.723587+0000","last_change":"2023-10-03T19:20:15.957097+0000","last_active":"2023-10-03T19:20:18.723587+0000","last_peered":"2023-10-03T19:20:18.723587+0000","last_clean":"2023-10-03T19:20:18.723587+0000","last_became_active":"2023-10-03T19:20:15.956382+0000","last_became_peered":"2023-10-03T19:20:15.956382+0000","last_unstale":"2023-10-03T19:20:18.723587+0000","last_undegraded":"2023-10-03T19:20:18.723587+0000","last_fullsized":"2023-10-03T19:20:18.723587+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:07:58.595735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.355801+0000","last_change":"2023-10-03T19:20:16.366911+0000","last_active":"2023-10-03T19:20:17.355801+0000","last_peered":"2023-10-03T19:20:17.355801+0000","last_clean":"2023-10-03T19:20:17.355801+0000","last_became_active":"2023-10-03T19:20:16.366000+0000","last_became_peered":"2023-10-03T19:20:16.366000+0000","last_unstale":"2023-10-03T19:20:17.355801+0000","last_undegraded":"2023-10-03T19:20:17.355801+0000","last_fullsized":"2023-10-03T19:20:17.355801+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:19:47.618839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.428211+0000","last_change":"2023-10-03T19:20:15.950221+0000","last_active":"2023-10-03T19:20:17.428211+0000","last_peered":"2023-10-03T19:20:17.428211+0000","last_clean":"2023-10-03T19:20:17.428211+0000","last_became_active":"2023-10-03T19:20:15.949702+0000","last_became_peered":"2023-10-03T19:20:15.949702+0000","last_unstale":"2023-10-03T19:20:17.428211+0000","last_undegraded":"2023-10-03T19:20:17.428211+0000","last_fullsized":"2023-10-03T19:20:17.428211+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:48:28.421358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:19.324070+0000","last_change":"2023-10-03T19:20:16.367493+0000","last_active":"2023-10-03T19:20:19.324070+0000","last_peered":"2023-10-03T19:20:19.324070+0000","last_clean":"2023-10-03T19:20:19.324070+0000","last_became_active":"2023-10-03T19:20:16.367200+0000","last_became_peered":"2023-10-03T19:20:16.367200+0000","last_unstale":"2023-10-03T19:20:19.324070+0000","last_undegraded":"2023-10-03T19:20:19.324070+0000","last_fullsized":"2023-10-03T19:20:19.324070+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:22:54.812977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.354768+0000","last_change":"2023-10-03T19:20:15.976449+0000","last_active":"2023-10-03T19:20:17.354768+0000","last_peered":"2023-10-03T19:20:17.354768+0000","last_clean":"2023-10-03T19:20:17.354768+0000","last_became_active":"2023-10-03T19:20:15.975751+0000","last_became_peered":"2023-10-03T19:20:15.975751+0000","last_unstale":"2023-10-03T19:20:17.354768+0000","last_undegraded":"2023-10-03T19:20:17.354768+0000","last_fullsized":"2023-10-03T19:20:17.354768+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:46:06.263087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.356029+0000","last_change":"2023-10-03T19:20:16.378686+0000","last_active":"2023-10-03T19:20:17.356029+0000","last_peered":"2023-10-03T19:20:17.356029+0000","last_clean":"2023-10-03T19:20:17.356029+0000","last_became_active":"2023-10-03T19:20:16.377931+0000","last_became_peered":"2023-10-03T19:20:16.377931+0000","last_unstale":"2023-10-03T19:20:17.356029+0000","last_undegraded":"2023-10-03T19:20:17.356029+0000","last_fullsized":"2023-10-03T19:20:17.356029+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:41:09.780575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"108'8","reported_seq":21,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:18.221857+0000","last_change":"2023-10-03T19:20:15.968516+0000","last_active":"2023-10-03T19:20:18.221857+0000","last_peered":"2023-10-03T19:20:18.221857+0000","last_clean":"2023-10-03T19:20:18.221857+0000","last_became_active":"2023-10-03T19:20:15.967958+0000","last_became_peered":"2023-10-03T19:20:15.967958+0000","last_unstale":"2023-10-03T19:20:18.221857+0000","last_undegraded":"2023-10-03T19:20:18.221857+0000","last_fullsized":"2023-10-03T19:20:18.221857+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:38:29.251259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":335,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.355969+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:20:17.355969+0000","last_peered":"2023-10-03T19:20:17.355969+0000","last_clean":"2023-10-03T19:20:17.355969+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:20:17.355969+0000","last_undegraded":"2023-10-03T19:20:17.355969+0000","last_fullsized":"2023-10-03T19:20:17.355969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:20:22.582897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.327849+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:20:17.327849+0000","last_peered":"2023-10-03T19:20:17.327849+0000","last_clean":"2023-10-03T19:20:17.327849+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:20:17.327849+0000","last_undegraded":"2023-10-03T19:20:17.327849+0000","last_fullsized":"2023-10-03T19:20:17.327849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:48:08.284624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328782+0000","last_change":"2023-10-03T19:20:16.356061+0000","last_active":"2023-10-03T19:20:17.328782+0000","last_peered":"2023-10-03T19:20:17.328782+0000","last_clean":"2023-10-03T19:20:17.328782+0000","last_became_active":"2023-10-03T19:20:16.355199+0000","last_became_peered":"2023-10-03T19:20:16.355199+0000","last_unstale":"2023-10-03T19:20:17.328782+0000","last_undegraded":"2023-10-03T19:20:17.328782+0000","last_fullsized":"2023-10-03T19:20:17.328782+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:07:54.083803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"108'2","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:18.222394+0000","last_change":"2023-10-03T19:20:15.969199+0000","last_active":"2023-10-03T19:20:18.222394+0000","last_peered":"2023-10-03T19:20:18.222394+0000","last_clean":"2023-10-03T19:20:18.222394+0000","last_became_active":"2023-10-03T19:20:15.966849+0000","last_became_peered":"2023-10-03T19:20:15.966849+0000","last_unstale":"2023-10-03T19:20:18.222394+0000","last_undegraded":"2023-10-03T19:20:18.222394+0000","last_fullsized":"2023-10-03T19:20:18.222394+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:24:21.506754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.355202+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:20:17.355202+0000","last_peered":"2023-10-03T19:20:17.355202+0000","last_clean":"2023-10-03T19:20:17.355202+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:20:17.355202+0000","last_undegraded":"2023-10-03T19:20:17.355202+0000","last_fullsized":"2023-10-03T19:20:17.355202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:53:45.901119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:19.322979+0000","last_change":"2023-10-03T19:20:16.367501+0000","last_active":"2023-10-03T19:20:19.322979+0000","last_peered":"2023-10-03T19:20:19.322979+0000","last_clean":"2023-10-03T19:20:19.322979+0000","last_became_active":"2023-10-03T19:20:16.367248+0000","last_became_peered":"2023-10-03T19:20:16.367248+0000","last_unstale":"2023-10-03T19:20:19.322979+0000","last_undegraded":"2023-10-03T19:20:19.322979+0000","last_fullsized":"2023-10-03T19:20:19.322979+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T23:09:53.180357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:18.222951+0000","last_change":"2023-10-03T19:20:15.967698+0000","last_active":"2023-10-03T19:20:18.222951+0000","last_peered":"2023-10-03T19:20:18.222951+0000","last_clean":"2023-10-03T19:20:18.222951+0000","last_became_active":"2023-10-03T19:20:15.967254+0000","last_became_peered":"2023-10-03T19:20:15.967254+0000","last_unstale":"2023-10-03T19:20:18.222951+0000","last_undegraded":"2023-10-03T19:20:18.222951+0000","last_fullsized":"2023-10-03T19:20:18.222951+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:11:18.631348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":178,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.318094+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:20:17.318094+0000","last_peered":"2023-10-03T19:20:17.318094+0000","last_clean":"2023-10-03T19:20:17.318094+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:20:17.318094+0000","last_undegraded":"2023-10-03T19:20:17.318094+0000","last_fullsized":"2023-10-03T19:20:17.318094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:09:08.659807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.318441+0000","last_change":"2023-10-03T19:20:16.331087+0000","last_active":"2023-10-03T19:20:17.318441+0000","last_peered":"2023-10-03T19:20:17.318441+0000","last_clean":"2023-10-03T19:20:17.318441+0000","last_became_active":"2023-10-03T19:20:16.330789+0000","last_became_peered":"2023-10-03T19:20:16.330789+0000","last_unstale":"2023-10-03T19:20:17.318441+0000","last_undegraded":"2023-10-03T19:20:17.318441+0000","last_fullsized":"2023-10-03T19:20:17.318441+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:59:08.307318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:18.222088+0000","last_change":"2023-10-03T19:20:15.963326+0000","last_active":"2023-10-03T19:20:18.222088+0000","last_peered":"2023-10-03T19:20:18.222088+0000","last_clean":"2023-10-03T19:20:18.222088+0000","last_became_active":"2023-10-03T19:20:15.962683+0000","last_became_peered":"2023-10-03T19:20:15.962683+0000","last_unstale":"2023-10-03T19:20:18.222088+0000","last_undegraded":"2023-10-03T19:20:18.222088+0000","last_fullsized":"2023-10-03T19:20:18.222088+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:35:17.982504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.327053+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:20:17.327053+0000","last_peered":"2023-10-03T19:20:17.327053+0000","last_clean":"2023-10-03T19:20:17.327053+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:20:17.327053+0000","last_undegraded":"2023-10-03T19:20:17.327053+0000","last_fullsized":"2023-10-03T19:20:17.327053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:13:16.390162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.329037+0000","last_change":"2023-10-03T19:20:16.379445+0000","last_active":"2023-10-03T19:20:17.329037+0000","last_peered":"2023-10-03T19:20:17.329037+0000","last_clean":"2023-10-03T19:20:17.329037+0000","last_became_active":"2023-10-03T19:20:16.378708+0000","last_became_peered":"2023-10-03T19:20:16.378708+0000","last_unstale":"2023-10-03T19:20:17.329037+0000","last_undegraded":"2023-10-03T19:20:17.329037+0000","last_fullsized":"2023-10-03T19:20:17.329037+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:36:26.181089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.330048+0000","last_change":"2023-10-03T19:20:15.964353+0000","last_active":"2023-10-03T19:20:17.330048+0000","last_peered":"2023-10-03T19:20:17.330048+0000","last_clean":"2023-10-03T19:20:17.330048+0000","last_became_active":"2023-10-03T19:20:15.963577+0000","last_became_peered":"2023-10-03T19:20:15.963577+0000","last_unstale":"2023-10-03T19:20:17.330048+0000","last_undegraded":"2023-10-03T19:20:17.330048+0000","last_fullsized":"2023-10-03T19:20:17.330048+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:44:59.894758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":174,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:19.323673+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:20:19.323673+0000","last_peered":"2023-10-03T19:20:19.323673+0000","last_clean":"2023-10-03T19:20:19.323673+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:20:19.323673+0000","last_undegraded":"2023-10-03T19:20:19.323673+0000","last_fullsized":"2023-10-03T19:20:19.323673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:44:47.179646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328196+0000","last_change":"2023-10-03T19:20:16.360159+0000","last_active":"2023-10-03T19:20:17.328196+0000","last_peered":"2023-10-03T19:20:17.328196+0000","last_clean":"2023-10-03T19:20:17.328196+0000","last_became_active":"2023-10-03T19:20:16.359303+0000","last_became_peered":"2023-10-03T19:20:16.359303+0000","last_unstale":"2023-10-03T19:20:17.328196+0000","last_undegraded":"2023-10-03T19:20:17.328196+0000","last_fullsized":"2023-10-03T19:20:17.328196+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:01:13.570148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328583+0000","last_change":"2023-10-03T19:20:15.953426+0000","last_active":"2023-10-03T19:20:17.328583+0000","last_peered":"2023-10-03T19:20:17.328583+0000","last_clean":"2023-10-03T19:20:17.328583+0000","last_became_active":"2023-10-03T19:20:15.952566+0000","last_became_peered":"2023-10-03T19:20:15.952566+0000","last_unstale":"2023-10-03T19:20:17.328583+0000","last_undegraded":"2023-10-03T19:20:17.328583+0000","last_fullsized":"2023-10-03T19:20:17.328583+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:25:56.771799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.356500+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:20:17.356500+0000","last_peered":"2023-10-03T19:20:17.356500+0000","last_clean":"2023-10-03T19:20:17.356500+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:20:17.356500+0000","last_undegraded":"2023-10-03T19:20:17.356500+0000","last_fullsized":"2023-10-03T19:20:17.356500+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:42:57.609408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:18.223302+0000","last_change":"2023-10-03T19:20:16.350056+0000","last_active":"2023-10-03T19:20:18.223302+0000","last_peered":"2023-10-03T19:20:18.223302+0000","last_clean":"2023-10-03T19:20:18.223302+0000","last_became_active":"2023-10-03T19:20:16.349752+0000","last_became_peered":"2023-10-03T19:20:16.349752+0000","last_unstale":"2023-10-03T19:20:18.223302+0000","last_undegraded":"2023-10-03T19:20:18.223302+0000","last_fullsized":"2023-10-03T19:20:18.223302+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:24:13.007282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"108'3","reported_seq":16,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328281+0000","last_change":"2023-10-03T19:20:15.972534+0000","last_active":"2023-10-03T19:20:17.328281+0000","last_peered":"2023-10-03T19:20:17.328281+0000","last_clean":"2023-10-03T19:20:17.328281+0000","last_became_active":"2023-10-03T19:20:15.971724+0000","last_became_peered":"2023-10-03T19:20:15.971724+0000","last_unstale":"2023-10-03T19:20:17.328281+0000","last_undegraded":"2023-10-03T19:20:17.328281+0000","last_fullsized":"2023-10-03T19:20:17.328281+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T06:30:57.635979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":174,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:19.324044+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:20:19.324044+0000","last_peered":"2023-10-03T19:20:19.324044+0000","last_clean":"2023-10-03T19:20:19.324044+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:20:19.324044+0000","last_undegraded":"2023-10-03T19:20:19.324044+0000","last_fullsized":"2023-10-03T19:20:19.324044+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:24:12.192384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.328937+0000","last_change":"2023-10-03T19:20:16.367253+0000","last_active":"2023-10-03T19:20:17.328937+0000","last_peered":"2023-10-03T19:20:17.328937+0000","last_clean":"2023-10-03T19:20:17.328937+0000","last_became_active":"2023-10-03T19:20:16.366622+0000","last_became_peered":"2023-10-03T19:20:16.366622+0000","last_unstale":"2023-10-03T19:20:17.328937+0000","last_undegraded":"2023-10-03T19:20:17.328937+0000","last_fullsized":"2023-10-03T19:20:17.328937+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:15.906015+0000","last_clean_scrub_stamp":"2023-10-03T19:20:15.906015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:09:15.902309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"108'6","reported_seq":19,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:18.222789+0000","last_change":"2023-10-03T19:20:15.962877+0000","last_active":"2023-10-03T19:20:18.222789+0000","last_peered":"2023-10-03T19:20:18.222789+0000","last_clean":"2023-10-03T19:20:18.222789+0000","last_became_active":"2023-10-03T19:20:15.962063+0000","last_became_peered":"2023-10-03T19:20:15.962063+0000","last_unstale":"2023-10-03T19:20:18.222789+0000","last_undegraded":"2023-10-03T19:20:18.222789+0000","last_fullsized":"2023-10-03T19:20:18.222789+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:20:14.889785+0000","last_clean_scrub_stamp":"2023-10-03T19:20:14.889785+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:31:26.070308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-03T19:20:17.330163+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:20:17.330163+0000","last_peered":"2023-10-03T19:20:17.330163+0000","last_clean":"2023-10-03T19:20:17.330163+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:20:17.330163+0000","last_undegraded":"2023-10-03T19:20:17.330163+0000","last_fullsized":"2023-10-03T19:20:17.330163+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:17:59.521194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509539,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34172,"kb_used_data":1396,"kb_used_omap":0,"kb_used_meta":32768,"kb_avail":94337668,"statfs":{"total":96636764160,"available":96601772032,"internally_reserved":0,"allocated":1429504,"data_stored":1210081,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":33554432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.85899999999999999,"15min":0.92700000000000005},"min":{"1min":0.66300000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1950000000000001,"5min":1.206,"15min":4.0469999999999997},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.85299999999999998,"15min":0.82099999999999995},"min":{"1min":0.55200000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.177,"5min":1.2310000000000001,"15min":1.3420000000000001},"last":0.76000000000000001}]},{"osd":1,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.86299999999999999,"15min":0.98599999999999999},"min":{"1min":0.61899999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1359999999999999,"5min":1.3200000000000001,"15min":3.8239999999999998},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.89800000000000002,"15min":0.87},"min":{"1min":0.64500000000000002,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.498}]},{"osd":2,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.95899999999999996,"15min":0.88400000000000001},"min":{"1min":0.55300000000000005,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1719999999999999,"5min":6.0449999999999999,"15min":6.0449999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.94199999999999995,"15min":1.0109999999999999},"min":{"1min":0.69999999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.296,"5min":1.5800000000000001,"15min":3.98},"last":0.80800000000000005}]},{"osd":3,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.034,"15min":0.95799999999999996},"min":{"1min":0.68500000000000005,"5min":0.63800000000000001,"15min":0.51100000000000001},"max":{"1min":1.232,"5min":6.125,"15min":6.125},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.97599999999999998,"15min":1.0840000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.175,"5min":1.444,"15min":3.9140000000000001},"last":0.64300000000000002}]},{"osd":4,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.89800000000000002,"15min":1.0920000000000001},"min":{"1min":0.61599999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":5.1130000000000004},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.016,"15min":1.018},"min":{"1min":0.70699999999999996,"5min":0.629,"15min":0.629},"max":{"1min":1.214,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":0.99399999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.006,"15min":1.2010000000000001},"min":{"1min":0.63700000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2470000000000001,"5min":1.349,"15min":5.1859999999999999},"last":1.117},{"interface":"front","average":{"1min":1.004,"5min":1.0209999999999999,"15min":1.115},"min":{"1min":0.69299999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.29,"5min":1.2949999999999999,"15min":2.0609999999999999},"last":1.0760000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:19:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0740000000000001,"15min":1.093},"min":{"1min":0.80000000000000004,"5min":0.75700000000000001,"15min":0.69399999999999995},"max":{"1min":1.3839999999999999,"5min":1.4890000000000001,"15min":1.5449999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.046,"5min":1.1459999999999999,"15min":1.167},"min":{"1min":0.77800000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.232,"5min":6.1580000000000004,"15min":6.1580000000000004},"last":0.88900000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509539,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":30208,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":1347584,"data_stored":618355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30932992},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.84599999999999997,"15min":0.82699999999999996},"min":{"1min":0.54100000000000004,"5min":0.45400000000000001,"15min":0.44600000000000001},"max":{"1min":1.234,"5min":1.3340000000000001,"15min":1.504},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.91100000000000003,"15min":0.88900000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.44600000000000001},"max":{"1min":1.1080000000000001,"5min":1.423,"15min":1.839},"last":0.49199999999999999}]},{"osd":1,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.86699999999999999,"15min":0.84699999999999998},"min":{"1min":0.56000000000000005,"5min":0.52100000000000002,"15min":0.504},"max":{"1min":1.1859999999999999,"5min":1.27,"15min":2.0150000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.88900000000000001,"15min":0.88200000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.161,"5min":1.448,"15min":1.448},"last":0.64700000000000002}]},{"osd":2,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.93799999999999994,"15min":0.88900000000000001},"min":{"1min":0.66400000000000003,"5min":0.59199999999999997,"15min":0.51900000000000002},"max":{"1min":1.4430000000000001,"5min":1.528,"15min":1.528},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.92700000000000005,"15min":0.92500000000000004},"min":{"1min":0.60899999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1519999999999999,"5min":1.369,"15min":1.546},"last":0.73299999999999998}]},{"osd":3,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.96299999999999997,"15min":0.97899999999999998},"min":{"1min":0.68899999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.298,"5min":1.377,"15min":1.6990000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90700000000000003,"15min":0.90800000000000003},"min":{"1min":0.70199999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.143,"5min":1.206,"15min":2.121},"last":0.78600000000000003}]},{"osd":4,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.91600000000000004,"15min":0.998},"min":{"1min":0.67400000000000004,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.335,"5min":1.339,"15min":1.95},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.995,"15min":1.0680000000000001},"min":{"1min":0.64400000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4490000000000001,"5min":1.504,"15min":1.7709999999999999},"last":0.88500000000000001}]},{"osd":5,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.90700000000000003,"15min":0.99199999999999999},"min":{"1min":0.624,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.226,"5min":1.3200000000000001,"15min":2.2570000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.048,"15min":1.103},"min":{"1min":0.71799999999999997,"5min":0.68300000000000005,"15min":0.68100000000000005},"max":{"1min":1.5009999999999999,"5min":1.524,"15min":2.0619999999999998},"last":1.0029999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.071,"15min":1.109},"min":{"1min":0.748,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.639,"5min":1.639,"15min":2.0049999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.032,"5min":1.044,"15min":1.0820000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.61899999999999999},"max":{"1min":1.3879999999999999,"5min":1.4350000000000001,"15min":2.4249999999999998},"last":0.86299999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509540,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42552,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":41216,"kb_avail":94329288,"statfs":{"total":96636764160,"available":96593190912,"internally_reserved":0,"allocated":1359872,"data_stored":620501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":42205184},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":1.0600000000000001,"15min":0.875},"min":{"1min":0.64200000000000002,"5min":0.54700000000000004,"15min":0.50600000000000001},"max":{"1min":1.0600000000000001,"5min":17.686,"15min":17.686},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":1.02,"15min":0.89000000000000001},"min":{"1min":0.64000000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.28,"5min":16.925999999999998,"15min":16.925999999999998},"last":0.80400000000000005}]},{"osd":1,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.085,"15min":0.98499999999999999},"min":{"1min":0.67700000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1759999999999999,"5min":16.640999999999998,"15min":16.640999999999998},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.91300000000000003,"5min":1.089,"15min":0.93400000000000005},"min":{"1min":0.67300000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.151,"5min":17.59,"15min":17.59},"last":1.1859999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.997,"15min":0.94299999999999995},"min":{"1min":0.70699999999999996,"5min":0.56200000000000006,"15min":0.53200000000000003},"max":{"1min":1.1180000000000001,"5min":8.5630000000000006,"15min":8.5630000000000006},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.93999999999999995,"5min":1.143,"15min":1.01},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.175,"5min":17.734000000000002,"15min":17.734000000000002},"last":0.76000000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.0880000000000001,"15min":0.94299999999999995},"min":{"1min":0.72499999999999998,"5min":0.61499999999999999,"15min":0.53900000000000003},"max":{"1min":1.242,"5min":16.98,"15min":16.98},"last":1.103},{"interface":"front","average":{"1min":0.997,"5min":1.161,"15min":1.105},"min":{"1min":0.66900000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2789999999999999,"5min":16.434000000000001,"15min":16.434000000000001},"last":1.143}]},{"osd":5,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":1.1020000000000001,"15min":1.0820000000000001},"min":{"1min":0.624,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.143,"5min":17.782,"15min":17.782},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.96599999999999997,"15min":1.002},"min":{"1min":0.65700000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.264,"5min":1.708,"15min":1.708},"last":1.268}]},{"osd":6,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.3859999999999999,"15min":1.27},"min":{"1min":0.66000000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.2250000000000001,"5min":36.106000000000002,"15min":36.106000000000002},"last":1.232},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.2450000000000001,"15min":1.216},"min":{"1min":0.86099999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.2410000000000001,"5min":17.646999999999998,"15min":17.646999999999998},"last":1.319}]},{"osd":7,"last update":"Tue Oct 3 19:19:29 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.226,"15min":1.1359999999999999},"min":{"1min":0.81200000000000006,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.421,"5min":17.042000000000002,"15min":17.042000000000002},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.3,"15min":1.262},"min":{"1min":0.83199999999999996,"5min":0.66400000000000003,"15min":0.63300000000000001},"max":{"1min":1.4670000000000001,"5min":16.32,"15min":16.32},"last":1.4239999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509540,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1312,"kb_used_omap":0,"kb_used_meta":31616,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1343488,"data_stored":617773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":32374784},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.79100000000000004,"15min":0.61299999999999999},"min":{"1min":0.47799999999999998,"5min":0.32200000000000001,"15min":0.247},"max":{"1min":0.98199999999999998,"5min":13.629,"15min":13.629},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":1.206,"15min":0.80900000000000005},"min":{"1min":0.34000000000000002,"5min":0.30299999999999999,"15min":0.28999999999999998},"max":{"1min":0.97199999999999998,"5min":40.439,"15min":40.439},"last":0.66900000000000004}]},{"osd":1,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.90200000000000002,"15min":0.71099999999999997},"min":{"1min":0.47899999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1,"5min":14.074,"15min":14.074},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.78500000000000003,"15min":0.64900000000000002},"min":{"1min":0.38800000000000001,"5min":0.34799999999999998,"15min":0.26400000000000001},"max":{"1min":1.1080000000000001,"5min":7.0060000000000002,"15min":7.0060000000000002},"last":0.73499999999999999}]},{"osd":3,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.90000000000000002,"15min":0.71299999999999997},"min":{"1min":0.36699999999999999,"5min":0.28899999999999998,"15min":0.224},"max":{"1min":1.05,"5min":13.423999999999999,"15min":13.423999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.0649999999999999,"15min":0.82899999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.36399999999999999},"max":{"1min":1.1220000000000001,"5min":18.568999999999999,"15min":18.568999999999999},"last":0.79200000000000004}]},{"osd":4,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.94999999999999996,"15min":0.878},"min":{"1min":0.64200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.105,"5min":1.718,"15min":1.718},"last":1.073},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.3380000000000001,"15min":1.05},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.22,"5min":28.667999999999999,"15min":28.667999999999999},"last":0.873}]},{"osd":5,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.0529999999999999,"15min":0.92100000000000004},"min":{"1min":0.67600000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.399,"5min":5.4459999999999997,"15min":5.4459999999999997},"last":1.2470000000000001},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.2230000000000001,"15min":1.0309999999999999},"min":{"1min":0.63300000000000001,"5min":0.57599999999999996,"15min":0.52700000000000002},"max":{"1min":1.4970000000000001,"5min":14.007,"15min":14.007},"last":0.92300000000000004}]},{"osd":6,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":1.1040000000000001,"15min":0.97099999999999997},"min":{"1min":0.65900000000000003,"5min":0.60099999999999998,"15min":0.49099999999999999},"max":{"1min":1.212,"5min":10.679,"15min":10.679},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.087,"15min":1.004},"min":{"1min":0.75600000000000001,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.325,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.155}]},{"osd":7,"last update":"Tue Oct 3 19:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.3240000000000001,"15min":1.1080000000000001},"min":{"1min":0.70299999999999996,"5min":0.63100000000000001,"15min":0.56100000000000005},"max":{"1min":1.415,"5min":18.623000000000001,"15min":18.623000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.002,"5min":1.0920000000000001,"15min":0.996},"min":{"1min":0.61699999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1850000000000001,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":1.208}]}]},{"osd":1,"up_from":15,"seq":64424509539,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31024,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":29696,"kb_avail":94340816,"statfs":{"total":96636764160,"available":96604995584,"internally_reserved":0,"allocated":1351680,"data_stored":618959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30408704},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59199999999999997,"15min":0.55600000000000005},"min":{"1min":0.27900000000000003,"5min":0.27200000000000002,"15min":0.26900000000000002},"max":{"1min":0.92100000000000004,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70399999999999996,"15min":0.56799999999999995},"min":{"1min":0.41799999999999998,"5min":0.27200000000000002,"15min":0.22900000000000001},"max":{"1min":1.1899999999999999,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.76000000000000001}]},{"osd":2,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68300000000000005,"15min":0.58899999999999997},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.26200000000000001},"max":{"1min":0.879,"5min":1.506,"15min":1.506},"last":0.5},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.82099999999999995,"15min":0.70599999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.312},"max":{"1min":1.1919999999999999,"5min":1.365,"15min":1.365},"last":0.873}]},{"osd":3,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.76400000000000001,"15min":0.67300000000000004},"min":{"1min":0.36099999999999999,"5min":0.31,"15min":0.31},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.75700000000000001,"15min":0.63400000000000001},"min":{"1min":0.39100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.90700000000000003,"5min":1.232,"15min":1.27},"last":0.55400000000000005}]},{"osd":4,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.89000000000000001,"15min":0.82799999999999996},"min":{"1min":0.61199999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0860000000000001,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.98499999999999999,"15min":0.91400000000000003},"min":{"1min":0.69899999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3260000000000001,"5min":1.728,"15min":1.728},"last":1.2430000000000001}]},{"osd":5,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.98999999999999999,"15min":0.89500000000000002},"min":{"1min":0.60299999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.28,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.96299999999999997,"15min":0.88500000000000001},"min":{"1min":0.77300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.198,"5min":1.3959999999999999,"15min":1.6080000000000001},"last":0.81799999999999995}]},{"osd":6,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0349999999999999,"15min":0.95399999999999996},"min":{"1min":0.59499999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2689999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0289999999999999,"15min":0.93400000000000005},"min":{"1min":0.66700000000000004,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3600000000000001,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.0580000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:19:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0669999999999999,"15min":0.97599999999999998},"min":{"1min":0.55100000000000005,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.292,"5min":1.673,"15min":1.673},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0289999999999999,"15min":0.93999999999999995},"min":{"1min":0.67500000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4379999999999999,"5min":1.5880000000000001,"15min":1.649},"last":0.95699999999999996}]}]},{"osd":3,"up_from":14,"seq":60129542243,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25660,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":24320,"kb_avail":94346180,"statfs":{"total":96636764160,"available":96610488320,"internally_reserved":0,"allocated":1363968,"data_stored":620535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24903680},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.63200000000000001,"15min":0.58799999999999997},"min":{"1min":0.36399999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.96199999999999997,"5min":1.212,"15min":1.212},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.69999999999999996,"15min":0.66000000000000003},"min":{"1min":0.38900000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.5,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.83399999999999996}]},{"osd":1,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.70399999999999996,"15min":0.64800000000000002},"min":{"1min":0.42299999999999999,"5min":0.28599999999999998,"15min":0.27000000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76000000000000001,"15min":0.69099999999999995},"min":{"1min":0.34300000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.169,"5min":1.2210000000000001,"15min":1.222},"last":1.0640000000000001}]},{"osd":2,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.79400000000000004,"15min":0.73299999999999998},"min":{"1min":0.35999999999999999,"5min":0.317,"15min":0.317},"max":{"1min":1.1539999999999999,"5min":1.23,"15min":1.23},"last":1.1599999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73199999999999998,"15min":0.66000000000000003},"min":{"1min":0.371,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.05,"5min":1.671,"15min":1.671},"last":1.1060000000000001}]},{"osd":4,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.92000000000000004,"15min":0.91200000000000003},"min":{"1min":0.63900000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2949999999999999,"5min":1.411,"15min":1.496},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.006,"5min":1.018,"15min":0.95599999999999996},"min":{"1min":0.76400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3280000000000001,"5min":1.546,"15min":1.546},"last":0.97399999999999998}]},{"osd":5,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.91200000000000003,"15min":0.88700000000000001},"min":{"1min":0.63300000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.095,"5min":1.581,"15min":1.581},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.022,"15min":1.004},"min":{"1min":0.68100000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4179999999999999,"5min":1.498,"15min":1.498},"last":1.333}]},{"osd":6,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.94599999999999995,"15min":0.92800000000000005},"min":{"1min":0.68799999999999994,"5min":0.56999999999999995,"15min":0.56699999999999995},"max":{"1min":1.212,"5min":1.347,"15min":1.347},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.05,"15min":1.006},"min":{"1min":0.80000000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.373,"5min":1.4970000000000001,"15min":1.5629999999999999},"last":1.1899999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:19:34 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.083,"15min":1.0289999999999999},"min":{"1min":0.70599999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.254},{"interface":"front","average":{"1min":1.109,"5min":1.0609999999999999,"15min":1.03},"min":{"1min":0.65300000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.659,"5min":1.659,"15min":1.708},"last":1.147}]}]},{"osd":5,"up_from":13,"seq":55834574947,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23284,"kb_used_data":1324,"kb_used_omap":0,"kb_used_meta":21952,"kb_avail":94348556,"statfs":{"total":96636764160,"available":96612921344,"internally_reserved":0,"allocated":1355776,"data_stored":619097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22478848},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.85799999999999998,"15min":0.83399999999999996},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.181,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.89400000000000002,"15min":0.86599999999999999},"min":{"1min":0.78200000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.26,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.61499999999999999}]},{"osd":1,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.872,"15min":0.84499999999999997},"min":{"1min":0.505,"5min":0.501,"15min":0.501},"max":{"1min":1.044,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.91000000000000003,"15min":0.92300000000000004},"min":{"1min":0.63100000000000001,"5min":0.58699999999999997,"15min":0.57099999999999995},"max":{"1min":1.23,"5min":1.23,"15min":1.514},"last":0.73299999999999998}]},{"osd":2,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.91000000000000003,"15min":0.90300000000000002},"min":{"1min":0.625,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2010000000000001,"5min":1.351,"15min":1.3700000000000001},"last":1.081},{"interface":"front","average":{"1min":0.999,"5min":0.93000000000000005,"15min":0.90600000000000003},"min":{"1min":0.82499999999999996,"5min":0.57099999999999995,"15min":0.53300000000000003},"max":{"1min":1.1819999999999999,"5min":1.1930000000000001,"15min":1.3320000000000001},"last":0.67600000000000005}]},{"osd":3,"last update":"Tue Oct 3 19:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.93600000000000005,"15min":0.93100000000000005},"min":{"1min":0.67700000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2210000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":1.046,"5min":1.03,"15min":1.028},"min":{"1min":0.78700000000000003,"5min":0.65900000000000003,"15min":0.61199999999999999},"max":{"1min":1.3129999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.96999999999999997}]},{"osd":4,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.97499999999999998,"15min":0.97299999999999998},"min":{"1min":0.70699999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.2450000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.161},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96399999999999997,"15min":1.0129999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2749999999999999,"5min":1.335,"15min":1.7709999999999999},"last":0.85499999999999998}]},{"osd":6,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.995,"15min":1.024},"min":{"1min":0.67000000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.204,"5min":1.546,"15min":1.546},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0880000000000001,"15min":1.1240000000000001},"min":{"1min":0.82499999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.3759999999999999,"5min":1.823,"15min":1.823},"last":1.238}]},{"osd":7,"last update":"Tue Oct 3 19:19:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0569999999999999,"15min":1.071},"min":{"1min":0.68700000000000006,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.5680000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.119,"15min":1.143},"min":{"1min":0.86499999999999999,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.325,"5min":1.4179999999999999,"15min":1.9099999999999999},"last":1.012}]}]},{"osd":0,"up_from":13,"seq":55834574948,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30700,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":29312,"kb_avail":94341140,"statfs":{"total":96636764160,"available":96605327360,"internally_reserved":0,"allocated":1413120,"data_stored":1208163,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":30015488},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.69699999999999995,"15min":0.61399999999999999},"min":{"1min":0.502,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.92000000000000004,"5min":5.7480000000000002,"15min":5.7480000000000002},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.80900000000000005,"15min":0.746},"min":{"1min":0.54700000000000004,"5min":0.37,"15min":0.33000000000000002},"max":{"1min":1.0760000000000001,"5min":6.274,"15min":6.274},"last":0.44700000000000001}]},{"osd":2,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.81999999999999995,"15min":0.746},"min":{"1min":0.46700000000000003,"5min":0.36499999999999999,"15min":0.35399999999999998},"max":{"1min":0.97599999999999998,"5min":6.1609999999999996,"15min":6.1609999999999996},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71499999999999997,"15min":0.69899999999999995},"min":{"1min":0.44500000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.997,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.35799999999999998}]},{"osd":3,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.90800000000000003,"15min":0.78000000000000003},"min":{"1min":0.57499999999999996,"5min":0.41799999999999998,"15min":0.36799999999999999},"max":{"1min":1.1739999999999999,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82199999999999995,"15min":0.73199999999999998},"min":{"1min":0.53300000000000003,"5min":0.376,"15min":0.30299999999999999},"max":{"1min":1.0780000000000001,"5min":1.375,"15min":1.375},"last":0.47499999999999998}]},{"osd":4,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":1.0029999999999999,"15min":0.93600000000000005},"min":{"1min":0.71299999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.254,"5min":8.1159999999999997,"15min":8.1159999999999997},"last":0.54300000000000004},{"interface":"front","average":{"1min":1.056,"5min":1.0860000000000001,"15min":1.0429999999999999},"min":{"1min":0.71199999999999997,"5min":0.57299999999999995,"15min":0.504},"max":{"1min":1.3440000000000001,"5min":6.2320000000000002,"15min":6.2320000000000002},"last":0.83699999999999997}]},{"osd":5,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.2549999999999999,"15min":1.1140000000000001},"min":{"1min":0.69199999999999995,"5min":0.59399999999999997,"15min":0.46899999999999997},"max":{"1min":1.4259999999999999,"5min":17.420000000000002,"15min":17.420000000000002},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.222,"15min":1.052},"min":{"1min":0.74299999999999999,"5min":0.59499999999999997,"15min":0.54300000000000004},"max":{"1min":1.371,"5min":17.643000000000001,"15min":17.643000000000001},"last":0.69699999999999995}]},{"osd":6,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0880000000000001,"15min":1.038},"min":{"1min":0.77500000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3520000000000001,"5min":5.7220000000000004,"15min":5.7220000000000004},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0669999999999999,"15min":1.0129999999999999},"min":{"1min":0.877,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.417,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.64100000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:19:33 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.159,"15min":1.0740000000000001},"min":{"1min":0.81299999999999994,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3939999999999999,"5min":5.7800000000000002,"15min":5.7800000000000002},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.091,"5min":1.0920000000000001,"15min":1.0669999999999999},"min":{"1min":0.85699999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.343,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.82599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:20:25.197 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-03T19:20:25.198 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-03T19:20:25.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f29666a8640 1 Processor -- start 2023-10-03T19:20:25.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f29666a8640 1 -- start start 2023-10-03T19:20:25.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f29666a8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f29600712c0 0x7f296006cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:25.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f29666a8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29601507f0 con 0x7f296006c3f0 2023-10-03T19:20:25.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f29666a8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f296014cae0 con 0x7f29600a5d20 2023-10-03T19:20:25.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f29666a8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29600bc250 con 0x7f29600712c0 2023-10-03T19:20:25.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f295f7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f296006c3f0 0x7f296014c3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38162/0 (socket says 172.21.15.45:38162) 2023-10-03T19:20:25.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f295f7fe640 1 -- 172.21.15.45:0/2370413635 learned_addr learned my addr 172.21.15.45:0/2370413635 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:20:25.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f295ffff640 1 --2- 172.21.15.45:0/2370413635 >> v2:172.21.15.79:3300/0 conn(0x7f29600712c0 0x7f296006cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:25.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f295effd640 1 -- 172.21.15.45:0/2370413635 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4073671125 0 0) 0x7f29601507f0 con 0x7f296006c3f0 2023-10-03T19:20:25.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f295effd640 1 -- 172.21.15.45:0/2370413635 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2940003530 con 0x7f296006c3f0 2023-10-03T19:20:25.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f295effd640 1 -- 172.21.15.45:0/2370413635 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 646920238 0 0) 0x7f2940003530 con 0x7f296006c3f0 2023-10-03T19:20:25.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f295effd640 1 -- 172.21.15.45:0/2370413635 >> v2:172.21.15.79:3300/0 conn(0x7f29600712c0 msgr2=0x7f296006cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:25.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f295effd640 1 --2- 172.21.15.45:0/2370413635 >> v2:172.21.15.79:3300/0 conn(0x7f29600712c0 0x7f296006cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:25.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f295effd640 1 -- 172.21.15.45:0/2370413635 >> v1:172.21.15.79:6789/0 conn(0x7f29600a5d20 legacy=0x7f29600a4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:25.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f295effd640 1 -- 172.21.15.45:0/2370413635 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29600a5a40 con 0x7f296006c3f0 2023-10-03T19:20:25.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f295effd640 1 -- 172.21.15.45:0/2370413635 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f2950001680 con 0x7f296006c3f0 2023-10-03T19:20:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f295effd640 1 -- 172.21.15.45:0/2370413635 >> v1:172.21.15.45:6789/0 conn(0x7f296006c3f0 legacy=0x7f296014c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f295effd640 1 --2- 172.21.15.45:0/2370413635 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2940003980 0x7f2940003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f295effd640 1 --2- 172.21.15.45:0/2370413635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29400047d0 0x7f2940004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f295effd640 1 --2- 172.21.15.45:0/2370413635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29400052a0 0x7f294000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f295effd640 1 -- 172.21.15.45:0/2370413635 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29600bc250 con 0x7f29400047d0 2023-10-03T19:20:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f295effd640 1 -- 172.21.15.45:0/2370413635 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294000c1d0 con 0x7f29400052a0 2023-10-03T19:20:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f295effd640 1 -- 172.21.15.45:0/2370413635 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294000c390 con 0x7f2940003980 2023-10-03T19:20:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f295f7fe640 1 --2- 172.21.15.45:0/2370413635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29400047d0 0x7f2940004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f295ffff640 1 --2- 172.21.15.45:0/2370413635 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2940003980 0x7f2940003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f2964c45640 1 --2- 172.21.15.45:0/2370413635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29400052a0 0x7f294000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f295f7fe640 1 -- 172.21.15.45:0/2370413635 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2940003980 msgr2=0x7f2940003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:25.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f295f7fe640 1 --2- 172.21.15.45:0/2370413635 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2940003980 0x7f2940003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:25.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f295f7fe640 1 -- 172.21.15.45:0/2370413635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29400052a0 msgr2=0x7f294000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:25.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f295f7fe640 1 --2- 172.21.15.45:0/2370413635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29400052a0 0x7f294000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:25.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f295f7fe640 1 -- 172.21.15.45:0/2370413635 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2940003530 con 0x7f29400047d0 2023-10-03T19:20:25.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f2964c45640 1 --2- 172.21.15.45:0/2370413635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29400052a0 0x7f294000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:25.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f295ffff640 1 --2- 172.21.15.45:0/2370413635 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2940003980 0x7f2940003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:25.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.368+0000 7f2964c45640 1 -- 172.21.15.45:0/2370413635 reap_dead start 2023-10-03T19:20:25.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.372+0000 7f295f7fe640 1 --2- 172.21.15.45:0/2370413635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29400047d0 0x7f2940004c40 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f295000c240 tx=0x7f295001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373ec8ec18f7942f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:25.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.372+0000 7f295effd640 1 -- 172.21.15.45:0/2370413635 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29500a5af0 con 0x7f29400047d0 2023-10-03T19:20:25.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.372+0000 7f295effd640 1 -- 172.21.15.45:0/2370413635 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29500a5c70 con 0x7f29400047d0 2023-10-03T19:20:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.372+0000 7f295effd640 1 -- 172.21.15.45:0/2370413635 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29500058e0 con 0x7f29400047d0 2023-10-03T19:20:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.372+0000 7f29666a8640 1 -- 172.21.15.45:0/2370413635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29400047d0 msgr2=0x7f2940004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.372+0000 7f29666a8640 1 --2- 172.21.15.45:0/2370413635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29400047d0 0x7f2940004c40 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f295000c240 tx=0x7f295001cc10 comp rx=0 tx=0).stop 2023-10-03T19:20:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.372+0000 7f29666a8640 1 -- 172.21.15.45:0/2370413635 shutdown_connections 2023-10-03T19:20:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.372+0000 7f29666a8640 1 --2- 172.21.15.45:0/2370413635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29400047d0 0x7f2940004c40 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.372+0000 7f29666a8640 1 -- 172.21.15.45:0/2370413635 >> 172.21.15.45:0/2370413635 conn(0x7f29600a20d0 msgr2=0x7f29600a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.372+0000 7f29666a8640 1 -- 172.21.15.45:0/2370413635 shutdown_connections 2023-10-03T19:20:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.372+0000 7f29666a8640 1 -- 172.21.15.45:0/2370413635 wait complete. 2023-10-03T19:20:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.372+0000 7f29666a8640 1 Processor -- start 2023-10-03T19:20:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.376+0000 7f29666a8640 1 -- start start 2023-10-03T19:20:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.376+0000 7f29666a8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29400047d0 0x7f2960070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.376+0000 7f29666a8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2960148ea0 0x7f29601ea2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.376+0000 7f29666a8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29601d9a80 0x7f29600b9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.376+0000 7f29666a8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29601dba00 con 0x7f29400047d0 2023-10-03T19:20:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.376+0000 7f29666a8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296006f1d0 con 0x7f2960148ea0 2023-10-03T19:20:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.376+0000 7f29666a8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296006eef0 con 0x7f29601d9a80 2023-10-03T19:20:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.376+0000 7f295ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29400047d0 0x7f2960070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.376+0000 7f295ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29400047d0 0x7f2960070ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41170/0 (socket says 172.21.15.45:41170) 2023-10-03T19:20:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.376+0000 7f295ffff640 1 -- 172.21.15.45:0/2406121506 learned_addr learned my addr 172.21.15.45:0/2406121506 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.376+0000 7f2964c45640 1 --2- 172.21.15.45:0/2406121506 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29601d9a80 0x7f29600b9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.376+0000 7f295f7fe640 1 --2- 172.21.15.45:0/2406121506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2960148ea0 0x7f29601ea2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.376+0000 7f295ffff640 1 -- 172.21.15.45:0/2406121506 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29601d9a80 msgr2=0x7f29600b9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.376+0000 7f295ffff640 1 --2- 172.21.15.45:0/2406121506 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29601d9a80 0x7f29600b9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.376+0000 7f295ffff640 1 -- 172.21.15.45:0/2406121506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2960148ea0 msgr2=0x7f29601ea2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.376+0000 7f295ffff640 1 --2- 172.21.15.45:0/2406121506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2960148ea0 0x7f29601ea2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.376+0000 7f295ffff640 1 -- 172.21.15.45:0/2406121506 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2960071c00 con 0x7f29400047d0 2023-10-03T19:20:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.376+0000 7f295f7fe640 1 --2- 172.21.15.45:0/2406121506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2960148ea0 0x7f29601ea2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:25.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.376+0000 7f295ffff640 1 --2- 172.21.15.45:0/2406121506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29400047d0 0x7f2960070ab0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f2948010790 tx=0x7f2948010880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:25.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.376+0000 7f295cff9640 1 -- 172.21.15.45:0/2406121506 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2948004220 con 0x7f29400047d0 2023-10-03T19:20:25.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.376+0000 7f295cff9640 1 -- 172.21.15.45:0/2406121506 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2948004380 con 0x7f29400047d0 2023-10-03T19:20:25.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.376+0000 7f295cff9640 1 -- 172.21.15.45:0/2406121506 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2948003840 con 0x7f29400047d0 2023-10-03T19:20:25.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.376+0000 7f29666a8640 1 -- 172.21.15.45:0/2406121506 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29600a57c0 con 0x7f29400047d0 2023-10-03T19:20:25.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.376+0000 7f29666a8640 1 -- 172.21.15.45:0/2406121506 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29600a6120 con 0x7f29400047d0 2023-10-03T19:20:25.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.376+0000 7f29666a8640 1 -- 172.21.15.45:0/2406121506 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f296004de80 con 0x7f29400047d0 2023-10-03T19:20:25.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.376+0000 7f295cff9640 1 -- 172.21.15.45:0/2406121506 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f29480039a0 con 0x7f29400047d0 2023-10-03T19:20:25.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.376+0000 7f295cff9640 1 --2- 172.21.15.45:0/2406121506 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f29440662b0 0x7f2944068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:25.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.376+0000 7f295cff9640 1 -- 172.21.15.45:0/2406121506 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2948083670 con 0x7f29400047d0 2023-10-03T19:20:25.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.380+0000 7f295f7fe640 1 --2- 172.21.15.45:0/2406121506 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f29440662b0 0x7f2944068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:25.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.380+0000 7f295f7fe640 1 --2- 172.21.15.45:0/2406121506 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f29440662b0 0x7f2944068760 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f29500ab000 tx=0x7f2950006040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:25.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.380+0000 7f295cff9640 1 -- 172.21.15.45:0/2406121506 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2948050b80 con 0x7f29400047d0 2023-10-03T19:20:25.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.592+0000 7f29666a8640 1 -- 172.21.15.45:0/2406121506 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f29600ba5a0 con 0x7f29400047d0 2023-10-03T19:20:25.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.600+0000 7f295cff9640 1 -- 172.21.15.45:0/2406121506 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7f2948081e60 con 0x7f29400047d0 2023-10-03T19:20:25.602 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-10-03T19:20:25.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.600+0000 7f29666a8640 1 -- 172.21.15.45:0/2406121506 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f29440662b0 msgr2=0x7f2944068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:25.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.600+0000 7f29666a8640 1 --2- 172.21.15.45:0/2406121506 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f29440662b0 0x7f2944068760 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f29500ab000 tx=0x7f2950006040 comp rx=0 tx=0).stop 2023-10-03T19:20:25.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.600+0000 7f29666a8640 1 -- 172.21.15.45:0/2406121506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29400047d0 msgr2=0x7f2960070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:25.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.600+0000 7f29666a8640 1 --2- 172.21.15.45:0/2406121506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29400047d0 0x7f2960070ab0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f2948010790 tx=0x7f2948010880 comp rx=0 tx=0).stop 2023-10-03T19:20:25.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.600+0000 7f29666a8640 1 -- 172.21.15.45:0/2406121506 shutdown_connections 2023-10-03T19:20:25.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.600+0000 7f29666a8640 1 --2- 172.21.15.45:0/2406121506 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f29440662b0 0x7f2944068760 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:25.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.600+0000 7f29666a8640 1 --2- 172.21.15.45:0/2406121506 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29601d9a80 0x7f29600b9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:25.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.600+0000 7f29666a8640 1 --2- 172.21.15.45:0/2406121506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2960148ea0 0x7f29601ea2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:25.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.600+0000 7f29666a8640 1 --2- 172.21.15.45:0/2406121506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29400047d0 0x7f2960070ab0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:25.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.600+0000 7f29666a8640 1 -- 172.21.15.45:0/2406121506 >> 172.21.15.45:0/2406121506 conn(0x7f29600a20d0 msgr2=0x7f29600a3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:25.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.600+0000 7f29666a8640 1 -- 172.21.15.45:0/2406121506 shutdown_connections 2023-10-03T19:20:25.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.600+0000 7f29666a8640 1 -- 172.21.15.45:0/2406121506 wait complete. 2023-10-03T19:20:25.623 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:20:25.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.744+0000 7f8a1062f640 1 Processor -- start 2023-10-03T19:20:25.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.744+0000 7f8a1062f640 1 -- start start 2023-10-03T19:20:25.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.744+0000 7f8a1062f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8a080c2790 0x7f8a081528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:25.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.744+0000 7f8a1062f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a0806b2d0 con 0x7f8a080bb1d0 2023-10-03T19:20:25.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.744+0000 7f8a1062f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a080a3c60 con 0x7f8a0814f240 2023-10-03T19:20:25.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.744+0000 7f8a1062f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a0806b640 con 0x7f8a080c2790 2023-10-03T19:20:25.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.744+0000 7f8a0dbca640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8a080c2790 0x7f8a081528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:25.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.744+0000 7f8a0ebcc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8a080bb1d0 0x7f8a080c12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38170/0 (socket says 172.21.15.45:38170) 2023-10-03T19:20:25.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.744+0000 7f8a0ebcc640 1 -- 172.21.15.45:0/3856149118 learned_addr learned my addr 172.21.15.45:0/3856149118 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:20:25.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.744+0000 7f8a0dbca640 1 -- 172.21.15.45:0/3856149118 >> v1:172.21.15.79:6789/0 conn(0x7f8a0814f240 legacy=0x7f8a080c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:25.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.744+0000 7f8a0dbca640 1 -- 172.21.15.45:0/3856149118 >> v1:172.21.15.45:6789/0 conn(0x7f8a080bb1d0 legacy=0x7f8a080c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:25.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.744+0000 7f8a0d3c9640 1 -- 172.21.15.45:0/3856149118 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3000787728 0 0) 0x7f8a0806b2d0 con 0x7f8a080bb1d0 2023-10-03T19:20:25.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.744+0000 7f8a0dbca640 1 -- 172.21.15.45:0/3856149118 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a080c19b0 con 0x7f8a080c2790 2023-10-03T19:20:25.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.748+0000 7f8a0dbca640 1 --2- 172.21.15.45:0/3856149118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a080c2790 0x7f8a081528d0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f89fc0097a0 tx=0x7f89fc01ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3845c1daf65dd753 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:25.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.748+0000 7f8a0d3c9640 1 -- 172.21.15.45:0/3856149118 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc0a8910 con 0x7f8a080c2790 2023-10-03T19:20:25.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.748+0000 7f8a0d3c9640 1 -- 172.21.15.45:0/3856149118 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89fc0a8a70 con 0x7f8a080c2790 2023-10-03T19:20:25.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.748+0000 7f8a0d3c9640 1 -- 172.21.15.45:0/3856149118 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc0a8e00 con 0x7f8a080c2790 2023-10-03T19:20:25.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.748+0000 7f8a1062f640 1 -- 172.21.15.45:0/3856149118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a080c2790 msgr2=0x7f8a081528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:25.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.748+0000 7f8a1062f640 1 --2- 172.21.15.45:0/3856149118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a080c2790 0x7f8a081528d0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f89fc0097a0 tx=0x7f89fc01ec10 comp rx=0 tx=0).stop 2023-10-03T19:20:25.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.748+0000 7f8a1062f640 1 -- 172.21.15.45:0/3856149118 shutdown_connections 2023-10-03T19:20:25.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.748+0000 7f8a1062f640 1 --2- 172.21.15.45:0/3856149118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a080c2790 0x7f8a081528d0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:25.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.748+0000 7f8a1062f640 1 -- 172.21.15.45:0/3856149118 >> 172.21.15.45:0/3856149118 conn(0x7f8a080a64a0 msgr2=0x7f8a080a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:25.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.748+0000 7f8a1062f640 1 -- 172.21.15.45:0/3856149118 shutdown_connections 2023-10-03T19:20:25.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.748+0000 7f8a1062f640 1 -- 172.21.15.45:0/3856149118 wait complete. 2023-10-03T19:20:25.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.748+0000 7f8a1062f640 1 Processor -- start 2023-10-03T19:20:25.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.748+0000 7f8a1062f640 1 -- start start 2023-10-03T19:20:25.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.748+0000 7f8a1062f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a080bb1d0 0x7f8a0814fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:25.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.748+0000 7f8a1062f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a080c2790 0x7f8a080a93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:25.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.748+0000 7f8a1062f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8a0814f240 0x7f8a080a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:25.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.748+0000 7f8a1062f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a080a8240 con 0x7f8a080c2790 2023-10-03T19:20:25.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.748+0000 7f8a1062f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a08151c80 con 0x7f8a080bb1d0 2023-10-03T19:20:25.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.748+0000 7f8a1062f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a081519a0 con 0x7f8a0814f240 2023-10-03T19:20:25.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.748+0000 7f8a0dbca640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a080c2790 0x7f8a080a93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:25.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.748+0000 7f8a0dbca640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a080c2790 0x7f8a080a93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41194/0 (socket says 172.21.15.45:41194) 2023-10-03T19:20:25.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.748+0000 7f8a0dbca640 1 -- 172.21.15.45:0/3637065554 learned_addr learned my addr 172.21.15.45:0/3637065554 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:25.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.748+0000 7f8a0e3cb640 1 --2- 172.21.15.45:0/3637065554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a080bb1d0 0x7f8a0814fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:25.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.748+0000 7f8a0ebcc640 1 --2- 172.21.15.45:0/3637065554 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8a0814f240 0x7f8a080a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:25.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.748+0000 7f8a0dbca640 1 -- 172.21.15.45:0/3637065554 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8a0814f240 msgr2=0x7f8a080a98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:25.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.748+0000 7f8a0dbca640 1 --2- 172.21.15.45:0/3637065554 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8a0814f240 0x7f8a080a98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:25.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.748+0000 7f8a0dbca640 1 -- 172.21.15.45:0/3637065554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a080bb1d0 msgr2=0x7f8a0814fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:25.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.748+0000 7f8a0dbca640 1 --2- 172.21.15.45:0/3637065554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a080bb1d0 0x7f8a0814fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:25.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.748+0000 7f8a0dbca640 1 -- 172.21.15.45:0/3637065554 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89fc0093b0 con 0x7f8a080c2790 2023-10-03T19:20:25.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.748+0000 7f8a0ebcc640 1 --2- 172.21.15.45:0/3637065554 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8a0814f240 0x7f8a080a98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:25.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.752+0000 7f8a0dbca640 1 --2- 172.21.15.45:0/3637065554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a080c2790 0x7f8a080a93b0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f89fc01b820 tx=0x7f89fc01b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:25.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.752+0000 7f8a06ffd640 1 -- 172.21.15.45:0/3637065554 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc0bf070 con 0x7f8a080c2790 2023-10-03T19:20:25.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.752+0000 7f8a06ffd640 1 -- 172.21.15.45:0/3637065554 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89fc005c70 con 0x7f8a080c2790 2023-10-03T19:20:25.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.752+0000 7f8a06ffd640 1 -- 172.21.15.45:0/3637065554 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc006230 con 0x7f8a080c2790 2023-10-03T19:20:25.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.752+0000 7f8a1062f640 1 -- 172.21.15.45:0/3637065554 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a080a3f40 con 0x7f8a080c2790 2023-10-03T19:20:25.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.752+0000 7f8a1062f640 1 -- 172.21.15.45:0/3637065554 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a0814e740 con 0x7f8a080c2790 2023-10-03T19:20:25.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.752+0000 7f8a1062f640 1 -- 172.21.15.45:0/3637065554 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a0814f610 con 0x7f8a080c2790 2023-10-03T19:20:25.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.752+0000 7f8a06ffd640 1 -- 172.21.15.45:0/3637065554 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f89fc0b7040 con 0x7f8a080c2790 2023-10-03T19:20:25.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.752+0000 7f8a06ffd640 1 --2- 172.21.15.45:0/3637065554 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f89f4066280 0x7f89f4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:25.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.752+0000 7f8a06ffd640 1 -- 172.21.15.45:0/3637065554 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f89fc120f10 con 0x7f8a080c2790 2023-10-03T19:20:25.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.752+0000 7f8a0e3cb640 1 --2- 172.21.15.45:0/3637065554 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f89f4066280 0x7f89f4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:25.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.752+0000 7f8a0e3cb640 1 --2- 172.21.15.45:0/3637065554 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f89f4066280 0x7f89f4068730 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f89f8009f20 tx=0x7f89f80094d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:25.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.756+0000 7f8a06ffd640 1 -- 172.21.15.45:0/3637065554 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f89fc0ee380 con 0x7f8a080c2790 2023-10-03T19:20:25.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.935+0000 7f8a1062f640 1 -- 172.21.15.45:0/3637065554 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a08150ad0 con 0x7f8a080c2790 2023-10-03T19:20:25.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.939+0000 7f8a06ffd640 1 -- 172.21.15.45:0/3637065554 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+3916 (secure 0 0 0) 0x7f8a08150ad0 con 0x7f8a080c2790 2023-10-03T19:20:25.942 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:20:25.942 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":58,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3566869652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3566869652},{"type":"v1","addr":"172.21.15.79:6835","nonce":3566869652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":7587,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2339652261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2339652261},{"type":"v1","addr":"172.21.15.45:6833","nonce":2339652261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:20:16.301166+0000","modified":"2023-10-03T19:20:19.318778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7602":{"gid":7602,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1723126563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1723126563},{"type":"v1","addr":"172.21.15.45:6835","nonce":1723126563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-10-03T19:20:25.942 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 58 2023-10-03T19:20:25.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.939+0000 7f8a1062f640 1 -- 172.21.15.45:0/3637065554 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f89f4066280 msgr2=0x7f89f4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:25.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.939+0000 7f8a1062f640 1 --2- 172.21.15.45:0/3637065554 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f89f4066280 0x7f89f4068730 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f89f8009f20 tx=0x7f89f80094d0 comp rx=0 tx=0).stop 2023-10-03T19:20:25.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.939+0000 7f8a1062f640 1 -- 172.21.15.45:0/3637065554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a080c2790 msgr2=0x7f8a080a93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:25.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.939+0000 7f8a1062f640 1 --2- 172.21.15.45:0/3637065554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a080c2790 0x7f8a080a93b0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f89fc01b820 tx=0x7f89fc01b9b0 comp rx=0 tx=0).stop 2023-10-03T19:20:25.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.939+0000 7f8a1062f640 1 -- 172.21.15.45:0/3637065554 shutdown_connections 2023-10-03T19:20:25.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.939+0000 7f8a1062f640 1 --2- 172.21.15.45:0/3637065554 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f89f4066280 0x7f89f4068730 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:25.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.939+0000 7f8a1062f640 1 --2- 172.21.15.45:0/3637065554 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8a0814f240 0x7f8a080a98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:25.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.939+0000 7f8a1062f640 1 --2- 172.21.15.45:0/3637065554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a080c2790 0x7f8a080a93b0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:25.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.939+0000 7f8a1062f640 1 --2- 172.21.15.45:0/3637065554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a080bb1d0 0x7f8a0814fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:25.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.939+0000 7f8a1062f640 1 -- 172.21.15.45:0/3637065554 >> 172.21.15.45:0/3637065554 conn(0x7f8a080a64a0 msgr2=0x7f8a080a40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:25.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.939+0000 7f8a1062f640 1 -- 172.21.15.45:0/3637065554 shutdown_connections 2023-10-03T19:20:25.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:25.939+0000 7f8a1062f640 1 -- 172.21.15.45:0/3637065554 wait complete. 2023-10-03T19:20:26.261 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 58, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-03T19:20:16.301166+0000', 'modified': '2023-10-03T19:20:19.318778+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7602}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7602': {'gid': 7602, 'name': 'a', 'rank': 0, 'incarnation': 54, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6835/1723126563', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6834', 'nonce': 1723126563}, {'type': 'v1', 'addr': '172.21.15.45:6835', 'nonce': 1723126563}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-03T19:20:26.262 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-03T19:20:26.262 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-03T19:20:26.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.387+0000 7f850ecae640 1 Processor -- start 2023-10-03T19:20:26.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.387+0000 7f850ecae640 1 -- start start 2023-10-03T19:20:26.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.387+0000 7f850ecae640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f85080bf370 0x7f8508149760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:26.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.387+0000 7f850ecae640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f85080a7100 0x7f8508149ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:26.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.387+0000 7f850ecae640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f850814c770 con 0x7f850806f5f0 2023-10-03T19:20:26.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.387+0000 7f850ecae640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8508150c00 con 0x7f85080a7100 2023-10-03T19:20:26.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.387+0000 7f850ecae640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85080bebc0 con 0x7f85080bf370 2023-10-03T19:20:26.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.387+0000 7f8507fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f85080a7100 0x7f8508149ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:26.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.387+0000 7f8507fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f85080a7100 0x7f8508149ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41198/0 (socket says 172.21.15.45:41198) 2023-10-03T19:20:26.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.387+0000 7f8507fff640 1 -- 172.21.15.45:0/536597570 learned_addr learned my addr 172.21.15.45:0/536597570 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:26.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.391+0000 7f850ca4a640 1 --2- 172.21.15.45:0/536597570 >> v2:172.21.15.79:3300/0 conn(0x7f85080bf370 0x7f8508149760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:26.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.391+0000 7f8507fff640 1 -- 172.21.15.45:0/536597570 >> v2:172.21.15.79:3300/0 conn(0x7f85080bf370 msgr2=0x7f8508149760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:26.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.391+0000 7f8507fff640 1 --2- 172.21.15.45:0/536597570 >> v2:172.21.15.79:3300/0 conn(0x7f85080bf370 0x7f8508149760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.391+0000 7f8507fff640 1 -- 172.21.15.45:0/536597570 >> v1:172.21.15.79:6789/0 conn(0x7f850806f5f0 legacy=0x7f850814cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:26.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.391+0000 7f8507fff640 1 -- 172.21.15.45:0/536597570 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850806efe0 con 0x7f85080a7100 2023-10-03T19:20:26.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.391+0000 7f8507fff640 1 --2- 172.21.15.45:0/536597570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85080a7100 0x7f8508149ca0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f850806ebb0 tx=0x7f84fc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83707bbd8dd80fa5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:26.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.391+0000 7f85077fe640 1 -- 172.21.15.45:0/536597570 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc0aa5f0 con 0x7f85080a7100 2023-10-03T19:20:26.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.391+0000 7f85077fe640 1 -- 172.21.15.45:0/536597570 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84fc0aa750 con 0x7f85080a7100 2023-10-03T19:20:26.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.391+0000 7f85077fe640 1 -- 172.21.15.45:0/536597570 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc0aaae0 con 0x7f85080a7100 2023-10-03T19:20:26.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.391+0000 7f850ecae640 1 -- 172.21.15.45:0/536597570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85080a7100 msgr2=0x7f8508149ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:26.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.391+0000 7f850ecae640 1 --2- 172.21.15.45:0/536597570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85080a7100 0x7f8508149ca0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f850806ebb0 tx=0x7f84fc01c470 comp rx=0 tx=0).stop 2023-10-03T19:20:26.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.391+0000 7f850ecae640 1 -- 172.21.15.45:0/536597570 shutdown_connections 2023-10-03T19:20:26.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.391+0000 7f850ecae640 1 --2- 172.21.15.45:0/536597570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85080a7100 0x7f8508149ca0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.391+0000 7f850ecae640 1 --2- 172.21.15.45:0/536597570 >> v2:172.21.15.79:3300/0 conn(0x7f85080bf370 0x7f8508149760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.391+0000 7f850ecae640 1 -- 172.21.15.45:0/536597570 >> 172.21.15.45:0/536597570 conn(0x7f850806bce0 msgr2=0x7f850806c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:26.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.391+0000 7f850ecae640 1 -- 172.21.15.45:0/536597570 shutdown_connections 2023-10-03T19:20:26.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.391+0000 7f850ecae640 1 -- 172.21.15.45:0/536597570 wait complete. 2023-10-03T19:20:26.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.395+0000 7f850ecae640 1 Processor -- start 2023-10-03T19:20:26.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.395+0000 7f850ecae640 1 -- start start 2023-10-03T19:20:26.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.395+0000 7f850ecae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f850806f5f0 0x7f85080c1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:26.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.395+0000 7f850ecae640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85080a7100 0x7f850814e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:26.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.395+0000 7f850ecae640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85080bf370 0x7f850814e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:26.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.395+0000 7f850ecae640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85080c0850 con 0x7f850806f5f0 2023-10-03T19:20:26.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.395+0000 7f850ecae640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8508149a70 con 0x7f85080bf370 2023-10-03T19:20:26.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.395+0000 7f850ecae640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850814f490 con 0x7f85080a7100 2023-10-03T19:20:26.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.395+0000 7f850ca4a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f850806f5f0 0x7f85080c1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:26.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.395+0000 7f850ca4a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f850806f5f0 0x7f85080c1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41204/0 (socket says 172.21.15.45:41204) 2023-10-03T19:20:26.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.395+0000 7f850ca4a640 1 -- 172.21.15.45:0/2031632729 learned_addr learned my addr 172.21.15.45:0/2031632729 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:26.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.395+0000 7f850d24b640 1 --2- 172.21.15.45:0/2031632729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85080bf370 0x7f850814e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:26.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.395+0000 7f8507fff640 1 --2- 172.21.15.45:0/2031632729 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85080a7100 0x7f850814e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:26.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.395+0000 7f850ca4a640 1 -- 172.21.15.45:0/2031632729 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85080a7100 msgr2=0x7f850814e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:26.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.395+0000 7f850ca4a640 1 --2- 172.21.15.45:0/2031632729 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85080a7100 0x7f850814e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.395+0000 7f850ca4a640 1 -- 172.21.15.45:0/2031632729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85080bf370 msgr2=0x7f850814e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:26.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.395+0000 7f850ca4a640 1 --2- 172.21.15.45:0/2031632729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85080bf370 0x7f850814e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.395+0000 7f850ca4a640 1 -- 172.21.15.45:0/2031632729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84fc0094d0 con 0x7f850806f5f0 2023-10-03T19:20:26.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.395+0000 7f8507fff640 1 --2- 172.21.15.45:0/2031632729 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85080a7100 0x7f850814e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:20:26.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.395+0000 7f850d24b640 1 --2- 172.21.15.45:0/2031632729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85080bf370 0x7f850814e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:20:26.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.395+0000 7f850ca4a640 1 --2- 172.21.15.45:0/2031632729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f850806f5f0 0x7f85080c1950 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f84f800d5f0 tx=0x7f84f800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:26.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.395+0000 7f85057fa640 1 -- 172.21.15.45:0/2031632729 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f80125f0 con 0x7f850806f5f0 2023-10-03T19:20:26.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.395+0000 7f85057fa640 1 -- 172.21.15.45:0/2031632729 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f8012750 con 0x7f850806f5f0 2023-10-03T19:20:26.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.395+0000 7f850ecae640 1 -- 172.21.15.45:0/2031632729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85080bca70 con 0x7f850806f5f0 2023-10-03T19:20:26.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.395+0000 7f85057fa640 1 -- 172.21.15.45:0/2031632729 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f8012ae0 con 0x7f850806f5f0 2023-10-03T19:20:26.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.395+0000 7f850ecae640 1 -- 172.21.15.45:0/2031632729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85080bc8e0 con 0x7f850806f5f0 2023-10-03T19:20:26.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.395+0000 7f85057fa640 1 -- 172.21.15.45:0/2031632729 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f84f8012c40 con 0x7f850806f5f0 2023-10-03T19:20:26.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f85057fa640 1 --2- 172.21.15.45:0/2031632729 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f84f4066280 0x7f84f4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:26.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f85057fa640 1 -- 172.21.15.45:0/2031632729 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f84f80842e0 con 0x7f850806f5f0 2023-10-03T19:20:26.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f8507fff640 1 --2- 172.21.15.45:0/2031632729 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f84f4066280 0x7f84f4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:26.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f8511dd2000 1 Processor -- start 2023-10-03T19:20:26.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f8511dd2000 1 -- start start 2023-10-03T19:20:26.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f8507fff640 1 --2- 172.21.15.45:0/2031632729 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f84f4066280 0x7f84f4068730 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0ae000 tx=0x7f84fc0a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:26.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f8511dd2000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5642596216f0 0x564259620b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:26.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f8511dd2000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642596210a0 0x56425965f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:26.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f8511dd2000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56425965fc40 0x564259660010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:26.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f8511dd2000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642594e3310 con 0x5642596216f0 2023-10-03T19:20:26.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f8511dd2000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56425941d980 con 0x5642596210a0 2023-10-03T19:20:26.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f8511dd2000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x564259471040 con 0x56425965fc40 2023-10-03T19:20:26.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f850ca4a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5642596216f0 0x564259620b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:26.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f850ca4a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5642596216f0 0x564259620b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41212/0 (socket says 172.21.15.45:41212) 2023-10-03T19:20:26.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f850ca4a640 1 -- 172.21.15.45:0/32858882 learned_addr learned my addr 172.21.15.45:0/32858882 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:26.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f850d24b640 1 --2- 172.21.15.45:0/32858882 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56425965fc40 0x564259660010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:26.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f8507fff640 1 --2- 172.21.15.45:0/32858882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642596210a0 0x56425965f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:26.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f850ca4a640 1 -- 172.21.15.45:0/32858882 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56425965fc40 msgr2=0x564259660010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:26.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f850ca4a640 1 --2- 172.21.15.45:0/32858882 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56425965fc40 0x564259660010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f850ca4a640 1 -- 172.21.15.45:0/32858882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642596210a0 msgr2=0x56425965f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:26.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f850ca4a640 1 --2- 172.21.15.45:0/32858882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642596210a0 0x56425965f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f850ca4a640 1 -- 172.21.15.45:0/32858882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56425942f0b0 con 0x5642596216f0 2023-10-03T19:20:26.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f850ca4a640 1 --2- 172.21.15.45:0/32858882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5642596216f0 0x564259620b60 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f84f80826d0 tx=0x7f84f8059350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9923ba978cfc709 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:26.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f84ee7fc640 1 -- 172.21.15.45:0/32858882 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f8059160 con 0x5642596216f0 2023-10-03T19:20:26.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f84ee7fc640 1 -- 172.21.15.45:0/32858882 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f80534d0 con 0x5642596216f0 2023-10-03T19:20:26.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f84ee7fc640 1 -- 172.21.15.45:0/32858882 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f8051aa0 con 0x5642596216f0 2023-10-03T19:20:26.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f8511dd2000 1 -- 172.21.15.45:0/32858882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5642596216f0 msgr2=0x564259620b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:26.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f8511dd2000 1 --2- 172.21.15.45:0/32858882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5642596216f0 0x564259620b60 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f84f80826d0 tx=0x7f84f8059350 comp rx=0 tx=0).stop 2023-10-03T19:20:26.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f8511dd2000 1 -- 172.21.15.45:0/32858882 shutdown_connections 2023-10-03T19:20:26.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f8511dd2000 1 --2- 172.21.15.45:0/32858882 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56425965fc40 0x564259660010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f8511dd2000 1 --2- 172.21.15.45:0/32858882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642596210a0 0x56425965f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f8511dd2000 1 --2- 172.21.15.45:0/32858882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5642596216f0 0x564259620b60 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f8511dd2000 1 -- 172.21.15.45:0/32858882 >> 172.21.15.45:0/32858882 conn(0x564259653220 msgr2=0x564259655600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:26.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f8511dd2000 1 -- 172.21.15.45:0/32858882 shutdown_connections 2023-10-03T19:20:26.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f8511dd2000 1 -- 172.21.15.45:0/32858882 wait complete. 2023-10-03T19:20:26.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f8511dd2000 1 -- start start 2023-10-03T19:20:26.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.399+0000 7f8511dd2000 1 Processor -- start 2023-10-03T19:20:26.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f8511dd2000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5642596210a0 0x56425965ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:26.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f8511dd2000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642596216f0 0x56425965bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:26.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f8511dd2000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56425965fc40 0x56425965c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:26.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f8511dd2000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56425946a0e0 con 0x56425965fc40 2023-10-03T19:20:26.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f8511dd2000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564259426bd0 con 0x5642596216f0 2023-10-03T19:20:26.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f8511dd2000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x564259426870 con 0x5642596210a0 2023-10-03T19:20:26.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f8511dd2000 10 client.0 _ll_register_callbacks cb 0x564259606c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T19:20:26.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f850d24b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56425965fc40 0x56425965c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:26.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f850d24b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56425965fc40 0x56425965c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41220/0 (socket says 172.21.15.45:41220) 2023-10-03T19:20:26.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f850d24b640 1 -- 172.21.15.45:0/1308607674 learned_addr learned my addr 172.21.15.45:0/1308607674 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:26.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f850ca4a640 1 --2- 172.21.15.45:0/1308607674 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5642596210a0 0x56425965ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:26.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f8507fff640 1 --2- 172.21.15.45:0/1308607674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642596216f0 0x56425965bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:26.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f850d24b640 1 -- 172.21.15.45:0/1308607674 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5642596210a0 msgr2=0x56425965ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:26.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f850d24b640 1 --2- 172.21.15.45:0/1308607674 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5642596210a0 0x56425965ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f850d24b640 1 -- 172.21.15.45:0/1308607674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642596216f0 msgr2=0x56425965bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:26.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f850d24b640 1 --2- 172.21.15.45:0/1308607674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642596216f0 0x56425965bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f850d24b640 1 -- 172.21.15.45:0/1308607674 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85080bc8e0 con 0x56425965fc40 2023-10-03T19:20:26.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f850d24b640 1 --2- 172.21.15.45:0/1308607674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56425965fc40 0x56425965c4b0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f8500005950 tx=0x7f8500001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2539b9df4ccd810 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:26.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f84e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-10-03T19:20:26.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f84e77fe640 1 -- 172.21.15.45:0/1308607674 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8500013570 con 0x56425965fc40 2023-10-03T19:20:26.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f84e77fe640 1 -- 172.21.15.45:0/1308607674 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f85000136d0 con 0x56425965fc40 2023-10-03T19:20:26.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f8511dd2000 1 -- 172.21.15.45:0/1308607674 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5642594658b0 con 0x56425965fc40 2023-10-03T19:20:26.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f84e77fe640 1 -- 172.21.15.45:0/1308607674 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8500003d40 con 0x56425965fc40 2023-10-03T19:20:26.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f8511dd2000 10 client.7770 fetch_fsmap learned FSMap version 58 2023-10-03T19:20:26.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f8511dd2000 1 -- 172.21.15.45:0/1308607674 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x564259166890 con 0x56425965fc40 2023-10-03T19:20:26.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f84e77fe640 1 -- 172.21.15.45:0/1308607674 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5642594658b0 con 0x56425965fc40 2023-10-03T19:20:26.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f84e77fe640 1 -- 172.21.15.45:0/1308607674 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 58) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f85000138d0 con 0x56425965fc40 2023-10-03T19:20:26.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f8511dd2000 10 client.7770 fetch_fsmap finished waiting for FSMap version 58 2023-10-03T19:20:26.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f8511dd2000 10 client.7770 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T19:20:26.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f8511dd2000 20 client.7770 populate_metadata read hostname 'smithi045' 2023-10-03T19:20:26.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f8511dd2000 1 --2- 172.21.15.45:0/1308607674 >> [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] conn(0x56425966f880 0x564259671c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:26.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f8511dd2000 4 client.7770 mds_command: new command op to 7602 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-03T19:20:26.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f8511dd2000 1 -- 172.21.15.45:0/1308607674 --> [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564259498f70 con 0x56425966f880 2023-10-03T19:20:26.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f850ca4a640 1 --2- 172.21.15.45:0/1308607674 >> [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] conn(0x56425966f880 0x564259671c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:26.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f84e77fe640 10 client.7770 ms_handle_connect on v2:172.21.15.45:6834/1723126563 2023-10-03T19:20:26.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f850ca4a640 1 --2- 172.21.15.45:0/1308607674 >> [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] conn(0x56425966f880 0x564259671c60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d24b9e767bf5d9f4 server_cookie=4c7fae54f31f38a3 in_seq=0 out_seq=0 2023-10-03T19:20:26.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f84e77fe640 1 -- 172.21.15.45:0/1308607674 <== mds.0 v2:172.21.15.45:6834/1723126563 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x564259498f70 con 0x56425966f880 2023-10-03T19:20:26.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f84e77fe640 10 client.7770 handle_command_reply: tid=0 2023-10-03T19:20:26.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f8511dd2000 1 client.7770 shutdown 2023-10-03T19:20:26.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f8511dd2000 1 -- 172.21.15.45:0/1308607674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56425965fc40 msgr2=0x56425965c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:26.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f8511dd2000 1 --2- 172.21.15.45:0/1308607674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56425965fc40 0x56425965c4b0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f8500005950 tx=0x7f8500001a00 comp rx=0 tx=0).stop 2023-10-03T19:20:26.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f8511dd2000 1 -- 172.21.15.45:0/1308607674 shutdown_connections 2023-10-03T19:20:26.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f8511dd2000 1 --2- 172.21.15.45:0/1308607674 >> [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] conn(0x56425966f880 0x564259671c60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f8511dd2000 1 --2- 172.21.15.45:0/1308607674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56425965fc40 0x56425965c4b0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f8511dd2000 1 --2- 172.21.15.45:0/1308607674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642596216f0 0x56425965bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f84e77fe640 0 client.7770 ms_handle_reset on v2:172.21.15.45:6834/1723126563 2023-10-03T19:20:26.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f8511dd2000 1 --2- 172.21.15.45:0/1308607674 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5642596210a0 0x56425965ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f8511dd2000 1 -- 172.21.15.45:0/1308607674 >> 172.21.15.45:0/1308607674 conn(0x564259653220 msgr2=0x564259654580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:26.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f8511dd2000 1 -- 172.21.15.45:0/1308607674 shutdown_connections 2023-10-03T19:20:26.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f8511dd2000 1 -- 172.21.15.45:0/1308607674 wait complete. 2023-10-03T19:20:26.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.403+0000 7f8511dd2000 20 client.7770 trim_cache size 0 max 16384 2023-10-03T19:20:26.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.419+0000 7f8511dd2000 1 Processor -- start 2023-10-03T19:20:26.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.419+0000 7f8511dd2000 1 -- start start 2023-10-03T19:20:26.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.419+0000 7f8511dd2000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5642596210a0 0x564259673c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:26.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.419+0000 7f8511dd2000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642596216f0 0x564259674150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:26.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.419+0000 7f8511dd2000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56425965fc40 0x564259674690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:26.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.419+0000 7f8511dd2000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564259127940 con 0x5642596210a0 2023-10-03T19:20:26.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.419+0000 7f8511dd2000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56425961fa50 con 0x5642596216f0 2023-10-03T19:20:26.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.419+0000 7f8511dd2000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x564259439620 con 0x56425965fc40 2023-10-03T19:20:26.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.419+0000 7f850ca4a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5642596210a0 0x564259673c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:26.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.419+0000 7f850ca4a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5642596210a0 0x564259673c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41228/0 (socket says 172.21.15.45:41228) 2023-10-03T19:20:26.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.419+0000 7f850ca4a640 1 -- 172.21.15.45:0/3497074820 learned_addr learned my addr 172.21.15.45:0/3497074820 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:26.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.419+0000 7f850ca4a640 1 -- 172.21.15.45:0/3497074820 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56425965fc40 msgr2=0x564259674690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:26.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.419+0000 7f850ca4a640 1 --2- 172.21.15.45:0/3497074820 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56425965fc40 0x564259674690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.419+0000 7f850ca4a640 1 -- 172.21.15.45:0/3497074820 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642596216f0 msgr2=0x564259674150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:26.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.419+0000 7f850ca4a640 1 --2- 172.21.15.45:0/3497074820 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642596216f0 0x564259674150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.419+0000 7f850ca4a640 1 -- 172.21.15.45:0/3497074820 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56425942f360 con 0x5642596210a0 2023-10-03T19:20:26.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.419+0000 7f850ca4a640 1 --2- 172.21.15.45:0/3497074820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5642596210a0 0x564259673c10 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f84f800dfb0 tx=0x7f84f8084070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f9c91d7621a807 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:26.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f84eeffd640 1 -- 172.21.15.45:0/3497074820 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f8084160 con 0x5642596210a0 2023-10-03T19:20:26.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f84eeffd640 1 -- 172.21.15.45:0/3497074820 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f8012ef0 con 0x5642596210a0 2023-10-03T19:20:26.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f84eeffd640 1 -- 172.21.15.45:0/3497074820 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f8082180 con 0x5642596210a0 2023-10-03T19:20:26.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8511dd2000 1 -- 172.21.15.45:0/3497074820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5642596210a0 msgr2=0x564259673c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:26.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8511dd2000 1 --2- 172.21.15.45:0/3497074820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5642596210a0 0x564259673c10 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f84f800dfb0 tx=0x7f84f8084070 comp rx=0 tx=0).stop 2023-10-03T19:20:26.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8511dd2000 1 -- 172.21.15.45:0/3497074820 shutdown_connections 2023-10-03T19:20:26.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8511dd2000 1 --2- 172.21.15.45:0/3497074820 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56425965fc40 0x564259674690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8511dd2000 1 --2- 172.21.15.45:0/3497074820 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642596216f0 0x564259674150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8511dd2000 1 --2- 172.21.15.45:0/3497074820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5642596210a0 0x564259673c10 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8511dd2000 1 -- 172.21.15.45:0/3497074820 >> 172.21.15.45:0/3497074820 conn(0x564259653220 msgr2=0x5642596724f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:26.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8511dd2000 1 -- 172.21.15.45:0/3497074820 shutdown_connections 2023-10-03T19:20:26.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8511dd2000 1 -- 172.21.15.45:0/3497074820 wait complete. 2023-10-03T19:20:26.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8511dd2000 1 -- start start 2023-10-03T19:20:26.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8511dd2000 1 Processor -- start 2023-10-03T19:20:26.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8511dd2000 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642596210a0 0x5642596bc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:26.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8511dd2000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5642596216f0 0x5642596bc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:26.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8511dd2000 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56425965fc40 0x5642596bd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:26.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8511dd2000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642594ad150 con 0x5642596216f0 2023-10-03T19:20:26.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8511dd2000 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642594678f0 con 0x5642596210a0 2023-10-03T19:20:26.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8511dd2000 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x5642594674e0 con 0x56425965fc40 2023-10-03T19:20:26.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8511dd2000 10 client.0 _ll_register_callbacks cb 0x56425946c260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T19:20:26.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8507fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5642596216f0 0x5642596bc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:26.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8507fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5642596216f0 0x5642596bc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41230/0 (socket says 172.21.15.45:41230) 2023-10-03T19:20:26.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8507fff640 1 -- 172.21.15.45:0/179994653 learned_addr learned my addr 172.21.15.45:0/179994653 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:26.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f850d24b640 1 --2- 172.21.15.45:0/179994653 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56425965fc40 0x5642596bd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:26.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f850ca4a640 1 --2- 172.21.15.45:0/179994653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642596210a0 0x5642596bc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:26.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8507fff640 1 -- 172.21.15.45:0/179994653 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56425965fc40 msgr2=0x5642596bd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:26.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8507fff640 1 --2- 172.21.15.45:0/179994653 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56425965fc40 0x5642596bd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8507fff640 1 -- 172.21.15.45:0/179994653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642596210a0 msgr2=0x5642596bc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:26.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8507fff640 1 --2- 172.21.15.45:0/179994653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642596210a0 0x5642596bc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8507fff640 1 -- 172.21.15.45:0/179994653 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56425942f0b0 con 0x5642596216f0 2023-10-03T19:20:26.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8507fff640 1 --2- 172.21.15.45:0/179994653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5642596216f0 0x5642596bc900 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f84fc01a0a0 tx=0x7f84fc019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9890adc422c03057 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:26.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f84e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-10-03T19:20:26.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f84e77fe640 1 -- 172.21.15.45:0/179994653 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc0c3070 con 0x5642596216f0 2023-10-03T19:20:26.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f84e77fe640 1 -- 172.21.15.45:0/179994653 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f84fc0a7070 con 0x5642596216f0 2023-10-03T19:20:26.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8511dd2000 1 -- 172.21.15.45:0/179994653 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5642594630c0 con 0x5642596216f0 2023-10-03T19:20:26.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f84e77fe640 1 -- 172.21.15.45:0/179994653 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84fc0bd3f0 con 0x5642596216f0 2023-10-03T19:20:26.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8511dd2000 10 client.7776 fetch_fsmap learned FSMap version 58 2023-10-03T19:20:26.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8511dd2000 1 -- 172.21.15.45:0/179994653 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x564259414be0 con 0x5642596216f0 2023-10-03T19:20:26.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f84e77fe640 1 -- 172.21.15.45:0/179994653 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5642594630c0 con 0x5642596216f0 2023-10-03T19:20:26.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f84e77fe640 1 -- 172.21.15.45:0/179994653 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 58) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f84fc0a9070 con 0x5642596216f0 2023-10-03T19:20:26.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8511dd2000 10 client.7776 fetch_fsmap finished waiting for FSMap version 58 2023-10-03T19:20:26.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8511dd2000 10 client.7776 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T19:20:26.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8511dd2000 20 client.7776 populate_metadata read hostname 'smithi045' 2023-10-03T19:20:26.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8511dd2000 1 --2- 172.21.15.45:0/179994653 >> [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] conn(0x5642596c63d0 0x5642596c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:26.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8511dd2000 4 client.7776 mds_command: new command op to 7602 tid=0[{"prefix": "status"}] 2023-10-03T19:20:26.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f8511dd2000 1 -- 172.21.15.45:0/179994653 --> [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564259462de0 con 0x5642596c63d0 2023-10-03T19:20:26.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f850ca4a640 1 --2- 172.21.15.45:0/179994653 >> [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] conn(0x5642596c63d0 0x5642596c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:26.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f850ca4a640 1 --2- 172.21.15.45:0/179994653 >> [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] conn(0x5642596c63d0 0x5642596c87b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6f7fe7e2aecc2e1 server_cookie=db5bc4525e0068d8 in_seq=0 out_seq=0 2023-10-03T19:20:26.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.423+0000 7f84e77fe640 10 client.7776 ms_handle_connect on v2:172.21.15.45:6834/1723126563 2023-10-03T19:20:26.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.427+0000 7f84e77fe640 1 -- 172.21.15.45:0/179994653 <== mds.0 v2:172.21.15.45:6834/1723126563 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x564259462de0 con 0x5642596c63d0 2023-10-03T19:20:26.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.427+0000 7f84e77fe640 10 client.7776 handle_command_reply: tid=0 2023-10-03T19:20:26.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.427+0000 7f8511dd2000 1 client.7776 shutdown 2023-10-03T19:20:26.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.427+0000 7f8511dd2000 1 -- 172.21.15.45:0/179994653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5642596216f0 msgr2=0x5642596bc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:26.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.427+0000 7f8511dd2000 1 --2- 172.21.15.45:0/179994653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5642596216f0 0x5642596bc900 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f84fc01a0a0 tx=0x7f84fc019210 comp rx=0 tx=0).stop 2023-10-03T19:20:26.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.427+0000 7f8511dd2000 1 -- 172.21.15.45:0/179994653 shutdown_connections 2023-10-03T19:20:26.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.427+0000 7f8511dd2000 1 --2- 172.21.15.45:0/179994653 >> [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] conn(0x5642596c63d0 0x5642596c87b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.427+0000 7f8511dd2000 1 --2- 172.21.15.45:0/179994653 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56425965fc40 0x5642596bd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.427+0000 7f8511dd2000 1 --2- 172.21.15.45:0/179994653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5642596216f0 0x5642596bc900 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.427+0000 7f84e77fe640 0 client.7776 ms_handle_reset on v2:172.21.15.45:6834/1723126563 2023-10-03T19:20:26.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.427+0000 7f8511dd2000 1 --2- 172.21.15.45:0/179994653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642596210a0 0x5642596bc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.427+0000 7f8511dd2000 1 -- 172.21.15.45:0/179994653 >> 172.21.15.45:0/179994653 conn(0x564259653220 msgr2=0x5642596724f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:26.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.427+0000 7f8511dd2000 1 -- 172.21.15.45:0/179994653 shutdown_connections 2023-10-03T19:20:26.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.427+0000 7f8511dd2000 1 -- 172.21.15.45:0/179994653 wait complete. 2023-10-03T19:20:26.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.427+0000 7f8511dd2000 20 client.7776 trim_cache size 0 max 16384 2023-10-03T19:20:26.438 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-03T19:20:26.438 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "58400977-12ba-4c73-bb3e-1589b2492669", 2023-10-03T19:20:26.439 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-10-03T19:20:26.439 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 7602, 2023-10-03T19:20:26.439 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-10-03T19:20:26.439 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-10-03T19:20:26.439 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-10-03T19:20:26.439 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 10.125008920999999, 2023-10-03T19:20:26.439 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 58, 2023-10-03T19:20:26.439 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 109, 2023-10-03T19:20:26.439 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 109, 2023-10-03T19:20:26.439 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 15.502016205 2023-10-03T19:20:26.440 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-03T19:20:26.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.427+0000 7f850ecae640 1 -- 172.21.15.45:0/2031632729 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f84f4066280 msgr2=0x7f84f4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:26.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.427+0000 7f850ecae640 1 --2- 172.21.15.45:0/2031632729 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f84f4066280 0x7f84f4068730 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0ae000 tx=0x7f84fc0a7000 comp rx=0 tx=0).stop 2023-10-03T19:20:26.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.427+0000 7f850ecae640 1 -- 172.21.15.45:0/2031632729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f850806f5f0 msgr2=0x7f85080c1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:26.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.427+0000 7f850ecae640 1 --2- 172.21.15.45:0/2031632729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f850806f5f0 0x7f85080c1950 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f84f800d5f0 tx=0x7f84f800dab0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.427+0000 7f850ecae640 1 -- 172.21.15.45:0/2031632729 shutdown_connections 2023-10-03T19:20:26.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.427+0000 7f850ecae640 1 --2- 172.21.15.45:0/2031632729 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f84f4066280 0x7f84f4068730 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.427+0000 7f850ecae640 1 --2- 172.21.15.45:0/2031632729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85080bf370 0x7f850814e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.427+0000 7f850ecae640 1 --2- 172.21.15.45:0/2031632729 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85080a7100 0x7f850814e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.427+0000 7f850ecae640 1 --2- 172.21.15.45:0/2031632729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f850806f5f0 0x7f85080c1950 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.427+0000 7f850ecae640 1 -- 172.21.15.45:0/2031632729 >> 172.21.15.45:0/2031632729 conn(0x7f850806bce0 msgr2=0x7f85080a6660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:26.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.427+0000 7f850ecae640 1 -- 172.21.15.45:0/2031632729 shutdown_connections 2023-10-03T19:20:26.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.427+0000 7f850ecae640 1 -- 172.21.15.45:0/2031632729 wait complete. 2023-10-03T19:20:26.446 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-03T19:20:26.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95eaa68640 1 Processor -- start 2023-10-03T19:20:26.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95eaa68640 1 -- start start 2023-10-03T19:20:26.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95eaa68640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95e406a440 0x7f95e414f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:26.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95eaa68640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f95e406f7c0 0x7f95e414ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:26.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95eaa68640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e406d050 con 0x7f95e414bf90 2023-10-03T19:20:26.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95eaa68640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e406d860 con 0x7f95e406f7c0 2023-10-03T19:20:26.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95eaa68640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e414b320 con 0x7f95e406a440 2023-10-03T19:20:26.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95e9005640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f95e414bf90 0x7f95e4144e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38172/0 (socket says 172.21.15.45:38172) 2023-10-03T19:20:26.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95e9005640 1 -- 172.21.15.45:0/1747682492 learned_addr learned my addr 172.21.15.45:0/1747682492 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:20:26.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95e8804640 1 --2- 172.21.15.45:0/1747682492 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95e406a440 0x7f95e414f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:26.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95e3fff640 1 --2- 172.21.15.45:0/1747682492 >> v2:172.21.15.79:3300/0 conn(0x7f95e406f7c0 0x7f95e414ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:26.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95e37fe640 1 -- 172.21.15.45:0/1747682492 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1961210767 0 0) 0x7f95e406d050 con 0x7f95e414bf90 2023-10-03T19:20:26.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95e37fe640 1 -- 172.21.15.45:0/1747682492 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95d4003530 con 0x7f95e414bf90 2023-10-03T19:20:26.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95e37fe640 1 -- 172.21.15.45:0/1747682492 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 661177881 0 0) 0x7f95d4003530 con 0x7f95e414bf90 2023-10-03T19:20:26.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95e37fe640 1 -- 172.21.15.45:0/1747682492 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95e406a440 msgr2=0x7f95e414f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:26.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95e37fe640 1 --2- 172.21.15.45:0/1747682492 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95e406a440 0x7f95e414f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95e37fe640 1 -- 172.21.15.45:0/1747682492 >> v2:172.21.15.79:3300/0 conn(0x7f95e406f7c0 msgr2=0x7f95e414ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:26.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95e37fe640 1 --2- 172.21.15.45:0/1747682492 >> v2:172.21.15.79:3300/0 conn(0x7f95e406f7c0 0x7f95e414ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95e37fe640 1 -- 172.21.15.45:0/1747682492 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e414b5c0 con 0x7f95e414bf90 2023-10-03T19:20:26.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95e37fe640 1 -- 172.21.15.45:0/1747682492 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f95dc001a00 con 0x7f95e414bf90 2023-10-03T19:20:26.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95e37fe640 1 -- 172.21.15.45:0/1747682492 >> v1:172.21.15.45:6789/0 conn(0x7f95e414bf90 legacy=0x7f95e4144e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:26.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95e37fe640 1 --2- 172.21.15.45:0/1747682492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95d4003980 0x7f95d4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:26.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95e37fe640 1 --2- 172.21.15.45:0/1747682492 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95e406a440 0x7f95d40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:26.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95e37fe640 1 --2- 172.21.15.45:0/1747682492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95d4004d10 0x7f95d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:26.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95e37fe640 1 -- 172.21.15.45:0/1747682492 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e406d860 con 0x7f95d4003980 2023-10-03T19:20:26.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95e37fe640 1 -- 172.21.15.45:0/1747682492 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e414b320 con 0x7f95d4004d10 2023-10-03T19:20:26.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95e37fe640 1 -- 172.21.15.45:0/1747682492 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d400b990 con 0x7f95e406a440 2023-10-03T19:20:26.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95e8804640 1 --2- 172.21.15.45:0/1747682492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95d4003980 0x7f95d4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:26.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95e3fff640 1 --2- 172.21.15.45:0/1747682492 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95e406a440 0x7f95d40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:26.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95e8804640 1 -- 172.21.15.45:0/1747682492 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95e406a440 msgr2=0x7f95d40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:26.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95e8804640 1 --2- 172.21.15.45:0/1747682492 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95e406a440 0x7f95d40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95e8804640 1 -- 172.21.15.45:0/1747682492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95d4004d10 msgr2=0x7f95d4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:26.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95e9005640 1 --2- 172.21.15.45:0/1747682492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95d4004d10 0x7f95d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:26.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95e8804640 1 --2- 172.21.15.45:0/1747682492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95d4004d10 0x7f95d4005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.559+0000 7f95e8804640 1 -- 172.21.15.45:0/1747682492 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d4003530 con 0x7f95d4003980 2023-10-03T19:20:26.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.563+0000 7f95e8804640 1 --2- 172.21.15.45:0/1747682492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95d4003980 0x7f95d4003d90 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009ae0 tx=0x7f95d801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b031b3845d7ed9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:26.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.563+0000 7f95e37fe640 1 -- 172.21.15.45:0/1747682492 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d80a6500 con 0x7f95d4003980 2023-10-03T19:20:26.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.563+0000 7f95e37fe640 1 -- 172.21.15.45:0/1747682492 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d80a6660 con 0x7f95d4003980 2023-10-03T19:20:26.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.563+0000 7f95e37fe640 1 -- 172.21.15.45:0/1747682492 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d80a6a10 con 0x7f95d4003980 2023-10-03T19:20:26.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.563+0000 7f95eaa68640 1 -- 172.21.15.45:0/1747682492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95d4003980 msgr2=0x7f95d4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:26.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.563+0000 7f95eaa68640 1 --2- 172.21.15.45:0/1747682492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95d4003980 0x7f95d4003d90 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009ae0 tx=0x7f95d801ca20 comp rx=0 tx=0).stop 2023-10-03T19:20:26.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.563+0000 7f95e9005640 1 -- 172.21.15.45:0/1747682492 reap_dead start 2023-10-03T19:20:26.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.563+0000 7f95eaa68640 1 -- 172.21.15.45:0/1747682492 shutdown_connections 2023-10-03T19:20:26.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.563+0000 7f95eaa68640 1 -- 172.21.15.45:0/1747682492 >> 172.21.15.45:0/1747682492 conn(0x7f95e40be510 msgr2=0x7f95e4069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:26.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.563+0000 7f95eaa68640 1 -- 172.21.15.45:0/1747682492 shutdown_connections 2023-10-03T19:20:26.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.563+0000 7f95eaa68640 1 -- 172.21.15.45:0/1747682492 wait complete. 2023-10-03T19:20:26.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.563+0000 7f95eaa68640 1 Processor -- start 2023-10-03T19:20:26.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.563+0000 7f95eaa68640 1 -- start start 2023-10-03T19:20:26.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.563+0000 7f95eaa68640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95d4003980 0x7f95e414d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:26.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.563+0000 7f95eaa68640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95e41403f0 0x7f95e413eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:26.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.563+0000 7f95eaa68640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95e413f0b0 0x7f95e41459e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:26.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.563+0000 7f95eaa68640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e413e2a0 con 0x7f95d4003980 2023-10-03T19:20:26.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.563+0000 7f95eaa68640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e413e030 con 0x7f95e413f0b0 2023-10-03T19:20:26.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.563+0000 7f95eaa68640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e414dc80 con 0x7f95e41403f0 2023-10-03T19:20:26.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.563+0000 7f95e8804640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95d4003980 0x7f95e414d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:26.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.563+0000 7f95e8804640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95d4003980 0x7f95e414d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41240/0 (socket says 172.21.15.45:41240) 2023-10-03T19:20:26.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.563+0000 7f95e8804640 1 -- 172.21.15.45:0/419752773 learned_addr learned my addr 172.21.15.45:0/419752773 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:26.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.567+0000 7f95e3fff640 1 --2- 172.21.15.45:0/419752773 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95e41403f0 0x7f95e413eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:26.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.567+0000 7f95e9005640 1 --2- 172.21.15.45:0/419752773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95e413f0b0 0x7f95e41459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:26.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.567+0000 7f95e8804640 1 -- 172.21.15.45:0/419752773 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95e41403f0 msgr2=0x7f95e413eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:26.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.567+0000 7f95e8804640 1 --2- 172.21.15.45:0/419752773 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95e41403f0 0x7f95e413eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.567+0000 7f95e8804640 1 -- 172.21.15.45:0/419752773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95e413f0b0 msgr2=0x7f95e41459e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:26.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.567+0000 7f95e8804640 1 --2- 172.21.15.45:0/419752773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95e413f0b0 0x7f95e41459e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.567+0000 7f95e8804640 1 -- 172.21.15.45:0/419752773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e406a810 con 0x7f95d4003980 2023-10-03T19:20:26.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.567+0000 7f95e3fff640 1 --2- 172.21.15.45:0/419752773 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95e41403f0 0x7f95e413eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:26.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.567+0000 7f95e9005640 1 --2- 172.21.15.45:0/419752773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95e413f0b0 0x7f95e41459e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:26.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.567+0000 7f95e8804640 1 --2- 172.21.15.45:0/419752773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95d4003980 0x7f95e414d740 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f95d8098410 tx=0x7f95d4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:26.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.567+0000 7f95e17fa640 1 -- 172.21.15.45:0/419752773 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d80be070 con 0x7f95d4003980 2023-10-03T19:20:26.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.567+0000 7f95e17fa640 1 -- 172.21.15.45:0/419752773 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d800f000 con 0x7f95d4003980 2023-10-03T19:20:26.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.567+0000 7f95eaa68640 1 -- 172.21.15.45:0/419752773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e414f730 con 0x7f95d4003980 2023-10-03T19:20:26.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.567+0000 7f95e17fa640 1 -- 172.21.15.45:0/419752773 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d8004020 con 0x7f95d4003980 2023-10-03T19:20:26.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.567+0000 7f95eaa68640 1 -- 172.21.15.45:0/419752773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e406a9a0 con 0x7f95d4003980 2023-10-03T19:20:26.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.567+0000 7f95eaa68640 1 -- 172.21.15.45:0/419752773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e404de80 con 0x7f95d4003980 2023-10-03T19:20:26.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.567+0000 7f95e17fa640 1 -- 172.21.15.45:0/419752773 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f95d8004180 con 0x7f95d4003980 2023-10-03T19:20:26.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.567+0000 7f95e17fa640 1 --2- 172.21.15.45:0/419752773 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f95c80662b0 0x7f95c8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:26.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.567+0000 7f95e17fa640 1 -- 172.21.15.45:0/419752773 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f95d80aa070 con 0x7f95d4003980 2023-10-03T19:20:26.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.567+0000 7f95e3fff640 1 --2- 172.21.15.45:0/419752773 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f95c80662b0 0x7f95c8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:26.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.567+0000 7f95e3fff640 1 --2- 172.21.15.45:0/419752773 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f95c80662b0 0x7f95c8068760 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f95e413e6e0 tx=0x7f95d0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:26.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.571+0000 7f95e17fa640 1 -- 172.21.15.45:0/419752773 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f95d80eb740 con 0x7f95d4003980 2023-10-03T19:20:26.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.755+0000 7f95eaa68640 1 -- 172.21.15.45:0/419752773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f95e4144bd0 con 0x7f95d4003980 2023-10-03T19:20:26.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.755+0000 7f95e17fa640 1 -- 172.21.15.45:0/419752773 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v58) v1 ==== 53+0+73 (secure 0 0 0) 0x7f95d80eed60 con 0x7f95d4003980 2023-10-03T19:20:26.761 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-03T19:20:26.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.759+0000 7f95eaa68640 1 -- 172.21.15.45:0/419752773 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f95c80662b0 msgr2=0x7f95c8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:26.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.759+0000 7f95eaa68640 1 --2- 172.21.15.45:0/419752773 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f95c80662b0 0x7f95c8068760 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f95e413e6e0 tx=0x7f95d0008040 comp rx=0 tx=0).stop 2023-10-03T19:20:26.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.759+0000 7f95eaa68640 1 -- 172.21.15.45:0/419752773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95d4003980 msgr2=0x7f95e414d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:26.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.759+0000 7f95eaa68640 1 --2- 172.21.15.45:0/419752773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95d4003980 0x7f95e414d740 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f95d8098410 tx=0x7f95d4005800 comp rx=0 tx=0).stop 2023-10-03T19:20:26.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.759+0000 7f95eaa68640 1 -- 172.21.15.45:0/419752773 shutdown_connections 2023-10-03T19:20:26.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.759+0000 7f95eaa68640 1 --2- 172.21.15.45:0/419752773 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f95c80662b0 0x7f95c8068760 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.759+0000 7f95eaa68640 1 --2- 172.21.15.45:0/419752773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95e413f0b0 0x7f95e41459e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.759+0000 7f95eaa68640 1 --2- 172.21.15.45:0/419752773 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f95e41403f0 0x7f95e413eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.759+0000 7f95eaa68640 1 --2- 172.21.15.45:0/419752773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95d4003980 0x7f95e414d740 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:26.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.759+0000 7f95eaa68640 1 -- 172.21.15.45:0/419752773 >> 172.21.15.45:0/419752773 conn(0x7f95e40be510 msgr2=0x7f95e40bfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:26.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.759+0000 7f95eaa68640 1 -- 172.21.15.45:0/419752773 shutdown_connections 2023-10-03T19:20:26.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:26.759+0000 7f95eaa68640 1 -- 172.21.15.45:0/419752773 wait complete. 2023-10-03T19:20:26.779 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-03T19:20:26.779 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-03T19:20:26.779 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-10-03T19:20:26.779 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-03T19:20:26.779 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-03T19:20:26.779 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-03T19:20:26.779 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-03T19:20:26.779 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-03T19:20:26.780 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-03T19:20:26.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:20:26.780 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-10-03T19:20:26.786 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-03T19:20:26.786 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-03T19:20:26.787 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-10-03T19:20:26.787 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:20:26.787 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-10-03T19:20:26.787 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:20:26.787 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:20:26.787 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-10-03T19:20:26.787 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-10-03T19:20:26.787 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:20:26.787 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-10-03T19:20:26.787 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-10-03T19:20:26.788 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:20:26.788 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-10-03T19:20:26.788 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-03T19:20:26.788 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-10-03T19:20:26.788 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-03T19:20:26.788 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 41956sec preferred_lft 41956sec 2023-10-03T19:20:26.788 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2023-10-03T19:20:26.788 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:20:26.788 INFO:teuthology.orchestra.run.smithi146.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-03T19:20:26.788 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 02:42:a6:2d:ab:3b brd ff:ff:ff:ff:ff:ff 2023-10-03T19:20:26.789 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-03T19:20:26.789 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:20:26.789 INFO:teuthology.orchestra.run.smithi146.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-03T19:20:26.789 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-03T19:20:26.789 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-03T19:20:26.789 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:20:26.789 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::5c3e:4eff:fee6:56da/64 scope link 2023-10-03T19:20:26.789 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:20:26.789 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-03T19:20:26.789 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T19:20:26.789 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-03T19:20:26.789 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:20:26.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:20:26.790 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-03T19:20:26.840 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T19:20:26.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:20:26.842 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-10-03T19:20:26.892 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-10-03T19:20:26.892 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-03T19:20:26.892 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-03T19:20:26.892 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-03T19:20:26.893 INFO:teuthology.orchestra.run.smithi146.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-03T19:20:26.893 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-03T19:20:26.893 INFO:teuthology.orchestra.run.smithi146.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:20:26.893 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:20:26.893 INFO:teuthology.orchestra.run.smithi146.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:20:26.893 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-03T19:20:26.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:20:26.893 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-03T19:20:26.893 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-03T19:20:26.893 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-03T19:20:26.894 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-03T19:20:26.894 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-03T19:20:26.894 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-03T19:20:26.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:20:26.969 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-10-03T19:20:27.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-03T19:20:27.018 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-03T19:20:27.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:20:27.018 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-10-03T19:20:27.072 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-03T19:20:27.072 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T19:20:27.072 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-03T19:20:27.118 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-03T19:20:27.118 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T19:20:27.118 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-03T19:20:27.165 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-03T19:20:27.223 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:20:27.223 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:20:27.275 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:20:27.277 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:20:27.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:20:27.277 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-03T19:20:27.325 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-03T19:20:27.325 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-03T19:20:27.370 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-03T19:20:27.384 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:20:27.384 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:20:27.439 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:20:27.440 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:20:27.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:20:27.441 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-03T19:20:27.452 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:2023-10-03T19:20:27.448+0000 7f9ca029d580 -1 init, newargv = 0x55c7bf89a030 newargc=15 2023-10-03T19:20:27.452 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[34037]: starting ceph client 2023-10-03T19:20:27.462 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[34037]: starting fuse 2023-10-03T19:20:28.558 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-03T19:20:28.574 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:20:28.575 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:20:28.629 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:20:28.630 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:20:28.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:20:28.630 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-03T19:20:28.677 INFO:teuthology.orchestra.run.smithi146.stdout:45 2023-10-03T19:20:28.678 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-03T19:20:28.678 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-03T19:20:28.678 DEBUG:teuthology.orchestra.run.smithi146:> import glob 2023-10-03T19:20:28.678 DEBUG:teuthology.orchestra.run.smithi146:> import re 2023-10-03T19:20:28.678 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-03T19:20:28.678 DEBUG:teuthology.orchestra.run.smithi146:> import subprocess 2023-10-03T19:20:28.678 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:20:28.678 DEBUG:teuthology.orchestra.run.smithi146:> def _find_admin_socket(client_name): 2023-10-03T19:20:28.678 DEBUG:teuthology.orchestra.run.smithi146:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-03T19:20:28.679 DEBUG:teuthology.orchestra.run.smithi146:> files = glob.glob(asok_path) 2023-10-03T19:20:28.679 DEBUG:teuthology.orchestra.run.smithi146:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-03T19:20:28.679 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:20:28.679 DEBUG:teuthology.orchestra.run.smithi146:> # Given a non-glob path, it better be there 2023-10-03T19:20:28.679 DEBUG:teuthology.orchestra.run.smithi146:> if "*" not in asok_path: 2023-10-03T19:20:28.679 DEBUG:teuthology.orchestra.run.smithi146:> assert(len(files) == 1) 2023-10-03T19:20:28.679 DEBUG:teuthology.orchestra.run.smithi146:> return files[0] 2023-10-03T19:20:28.679 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:20:28.679 DEBUG:teuthology.orchestra.run.smithi146:> for f in files: 2023-10-03T19:20:28.679 DEBUG:teuthology.orchestra.run.smithi146:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-03T19:20:28.679 DEBUG:teuthology.orchestra.run.smithi146:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-03T19:20:28.679 DEBUG:teuthology.orchestra.run.smithi146:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-03T19:20:28.680 DEBUG:teuthology.orchestra.run.smithi146:> contents = proc_f.read() 2023-10-03T19:20:28.680 DEBUG:teuthology.orchestra.run.smithi146:> if mountpoint in contents: 2023-10-03T19:20:28.680 DEBUG:teuthology.orchestra.run.smithi146:> return f 2023-10-03T19:20:28.680 DEBUG:teuthology.orchestra.run.smithi146:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-03T19:20:28.680 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:20:28.680 DEBUG:teuthology.orchestra.run.smithi146:> print(_find_admin_socket("client.0")) 2023-10-03T19:20:28.680 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-03T19:20:28.797 INFO:teuthology.orchestra.run.smithi146.stdout:/var/run/ceph/ceph-client.0.34037.asok 2023-10-03T19:20:28.980 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.34037.asok 2023-10-03T19:20:28.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:20:28.980 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.34037.asok status 2023-10-03T19:20:29.135 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-03T19:20:29.135 INFO:teuthology.orchestra.run.smithi146.stdout: "metadata": { 2023-10-03T19:20:29.135 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_sha1": "05a43c8fb3988914c879a50970f9054a098e0612", 2023-10-03T19:20:29.135 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 18.0.0-3908-g05a43c8f (05a43c8fb3988914c879a50970f9054a098e0612) reef (dev)", 2023-10-03T19:20:29.135 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "0", 2023-10-03T19:20:29.136 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2023-10-03T19:20:29.136 INFO:teuthology.orchestra.run.smithi146.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-03T19:20:29.136 INFO:teuthology.orchestra.run.smithi146.stdout: "pid": "34037", 2023-10-03T19:20:29.136 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2023-10-03T19:20:29.136 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:20:29.136 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_count": 0, 2023-10-03T19:20:29.136 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_pinned_count": 0, 2023-10-03T19:20:29.136 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 6826, 2023-10-03T19:20:29.136 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": { 2023-10-03T19:20:29.136 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2023-10-03T19:20:29.136 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2023-10-03T19:20:29.136 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 6826 2023-10-03T19:20:29.137 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:20:29.137 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-03T19:20:29.137 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T19:20:29.137 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:0", 2023-10-03T19:20:29.137 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 2294298422 2023-10-03T19:20:29.137 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T19:20:29.137 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:20:29.137 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-03T19:20:29.137 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T19:20:29.137 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:0", 2023-10-03T19:20:29.137 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 2294298422 2023-10-03T19:20:29.137 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:20:29.138 INFO:teuthology.orchestra.run.smithi146.stdout: "inst_str": "client.6826 172.21.15.146:0/2294298422", 2023-10-03T19:20:29.138 INFO:teuthology.orchestra.run.smithi146.stdout: "addr_str": "172.21.15.146:0/2294298422", 2023-10-03T19:20:29.138 INFO:teuthology.orchestra.run.smithi146.stdout: "inode_count": 1, 2023-10-03T19:20:29.138 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_epoch": 58, 2023-10-03T19:20:29.138 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch": 109, 2023-10-03T19:20:29.138 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch_barrier": 0, 2023-10-03T19:20:29.138 INFO:teuthology.orchestra.run.smithi146.stdout: "blocklisted": false, 2023-10-03T19:20:29.138 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs" 2023-10-03T19:20:29.138 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-03T19:20:29.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:20:29.150 DEBUG:teuthology.orchestra.run.smithi146:> stat --file-system '--printf=%T 2023-10-03T19:20:29.150 DEBUG:teuthology.orchestra.run.smithi146:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-03T19:20:29.157 INFO:teuthology.orchestra.run.smithi146.stdout:fuseblk 2023-10-03T19:20:29.157 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-03T19:20:29.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:20:29.157 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-03T19:20:29.214 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-03T19:20:29.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.347+0000 7f649dc2b640 1 Processor -- start 2023-10-03T19:20:29.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.347+0000 7f649dc2b640 1 -- start start 2023-10-03T19:20:29.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.347+0000 7f649dc2b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f649806f170 0x7f6498150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:29.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.347+0000 7f649dc2b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f649806cac0 con 0x7f64980bc8b0 2023-10-03T19:20:29.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.347+0000 7f649dc2b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64980720d0 con 0x7f649806d170 2023-10-03T19:20:29.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.347+0000 7f649dc2b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64980a5ab0 con 0x7f649806f170 2023-10-03T19:20:29.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.347+0000 7f6496ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f64980bc8b0 0x7f649814ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38176/0 (socket says 172.21.15.45:38176) 2023-10-03T19:20:29.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.347+0000 7f6496ffd640 1 -- 172.21.15.45:0/1962615352 learned_addr learned my addr 172.21.15.45:0/1962615352 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:20:29.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.347+0000 7f64977fe640 1 --2- 172.21.15.45:0/1962615352 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f649806f170 0x7f6498150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:29.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.347+0000 7f64967fc640 1 -- 172.21.15.45:0/1962615352 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2901701798 0 0) 0x7f6480001120 con 0x7f64980bc8b0 2023-10-03T19:20:29.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.347+0000 7f64967fc640 1 -- 172.21.15.45:0/1962615352 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6484003530 con 0x7f64980bc8b0 2023-10-03T19:20:29.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.347+0000 7f64967fc640 1 -- 172.21.15.45:0/1962615352 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2330645370 0 0) 0x7f6484003530 con 0x7f64980bc8b0 2023-10-03T19:20:29.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.347+0000 7f64967fc640 1 -- 172.21.15.45:0/1962615352 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f649806f170 msgr2=0x7f6498150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:29.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.347+0000 7f64967fc640 1 --2- 172.21.15.45:0/1962615352 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f649806f170 0x7f6498150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:29.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.347+0000 7f64967fc640 1 -- 172.21.15.45:0/1962615352 >> v1:172.21.15.79:6789/0 conn(0x7f649806d170 legacy=0x7f6498156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:29.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.347+0000 7f64967fc640 1 -- 172.21.15.45:0/1962615352 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f649806cd00 con 0x7f64980bc8b0 2023-10-03T19:20:29.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.347+0000 7f64967fc640 1 -- 172.21.15.45:0/1962615352 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f6480001810 con 0x7f64980bc8b0 2023-10-03T19:20:29.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.347+0000 7f64967fc640 1 -- 172.21.15.45:0/1962615352 >> v1:172.21.15.45:6789/0 conn(0x7f64980bc8b0 legacy=0x7f649814ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:29.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.347+0000 7f64967fc640 1 --2- 172.21.15.45:0/1962615352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64840039b0 0x7f6484003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:29.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.347+0000 7f64967fc640 1 --2- 172.21.15.45:0/1962615352 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f649806f170 0x7f64840047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:29.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.347+0000 7f64967fc640 1 --2- 172.21.15.45:0/1962615352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6484004d10 0x7f6484005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:29.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.351+0000 7f64967fc640 1 -- 172.21.15.45:0/1962615352 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64980a5ab0 con 0x7f6484004d10 2023-10-03T19:20:29.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.351+0000 7f64967fc640 1 -- 172.21.15.45:0/1962615352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648400ba40 con 0x7f64840039b0 2023-10-03T19:20:29.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.351+0000 7f64967fc640 1 -- 172.21.15.45:0/1962615352 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648400bbd0 con 0x7f649806f170 2023-10-03T19:20:29.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.351+0000 7f6497fff640 1 --2- 172.21.15.45:0/1962615352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6484004d10 0x7f6484005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:29.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.351+0000 7f6496ffd640 1 --2- 172.21.15.45:0/1962615352 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f649806f170 0x7f64840047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:29.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.351+0000 7f64977fe640 1 --2- 172.21.15.45:0/1962615352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64840039b0 0x7f6484003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:29.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.351+0000 7f6497fff640 1 -- 172.21.15.45:0/1962615352 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f649806f170 msgr2=0x7f64840047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:29.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.351+0000 7f6497fff640 1 --2- 172.21.15.45:0/1962615352 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f649806f170 0x7f64840047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:29.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.351+0000 7f6497fff640 1 -- 172.21.15.45:0/1962615352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64840039b0 msgr2=0x7f6484003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:29.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.351+0000 7f6497fff640 1 --2- 172.21.15.45:0/1962615352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64840039b0 0x7f6484003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:29.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.351+0000 7f6497fff640 1 -- 172.21.15.45:0/1962615352 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6484003530 con 0x7f6484004d10 2023-10-03T19:20:29.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.351+0000 7f6496ffd640 1 --2- 172.21.15.45:0/1962615352 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f649806f170 0x7f64840047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:20:29.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.351+0000 7f6497fff640 1 --2- 172.21.15.45:0/1962615352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6484004d10 0x7f6484005180 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f6490001780 tx=0x7f649001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67e146144dfc3094 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:29.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.351+0000 7f64967fc640 1 -- 172.21.15.45:0/1962615352 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64900052d0 con 0x7f6484004d10 2023-10-03T19:20:29.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.351+0000 7f64967fc640 1 -- 172.21.15.45:0/1962615352 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64900a7050 con 0x7f6484004d10 2023-10-03T19:20:29.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.351+0000 7f64967fc640 1 -- 172.21.15.45:0/1962615352 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6490003600 con 0x7f6484004d10 2023-10-03T19:20:29.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.351+0000 7f649dc2b640 1 -- 172.21.15.45:0/1962615352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6484004d10 msgr2=0x7f6484005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:29.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.351+0000 7f649dc2b640 1 --2- 172.21.15.45:0/1962615352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6484004d10 0x7f6484005180 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f6490001780 tx=0x7f649001c400 comp rx=0 tx=0).stop 2023-10-03T19:20:29.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.351+0000 7f6497fff640 1 -- 172.21.15.45:0/1962615352 reap_dead start 2023-10-03T19:20:29.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.351+0000 7f649dc2b640 1 -- 172.21.15.45:0/1962615352 shutdown_connections 2023-10-03T19:20:29.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.351+0000 7f649dc2b640 1 -- 172.21.15.45:0/1962615352 >> 172.21.15.45:0/1962615352 conn(0x7f64980bcf50 msgr2=0x7f64980bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:29.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.351+0000 7f649dc2b640 1 -- 172.21.15.45:0/1962615352 shutdown_connections 2023-10-03T19:20:29.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.351+0000 7f649dc2b640 1 -- 172.21.15.45:0/1962615352 wait complete. 2023-10-03T19:20:29.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.355+0000 7f649dc2b640 1 Processor -- start 2023-10-03T19:20:29.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.355+0000 7f649dc2b640 1 -- start start 2023-10-03T19:20:29.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.355+0000 7f649dc2b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6484004d10 0x7f6498147e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:29.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.355+0000 7f649dc2b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64981e5420 0x7f6498145740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:29.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.355+0000 7f649dc2b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6498145c80 0x7f64981d5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:29.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.355+0000 7f649dc2b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64981d72d0 con 0x7f6498145c80 2023-10-03T19:20:29.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.355+0000 7f649dc2b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64981483c0 con 0x7f64981e5420 2023-10-03T19:20:29.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.355+0000 7f649dc2b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64980bbd60 con 0x7f6484004d10 2023-10-03T19:20:29.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.355+0000 7f6497fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6498145c80 0x7f64981d5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:29.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.355+0000 7f6497fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6498145c80 0x7f64981d5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41262/0 (socket says 172.21.15.45:41262) 2023-10-03T19:20:29.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.355+0000 7f6497fff640 1 -- 172.21.15.45:0/2273752937 learned_addr learned my addr 172.21.15.45:0/2273752937 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:29.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.355+0000 7f64977fe640 1 --2- 172.21.15.45:0/2273752937 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6484004d10 0x7f6498147e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:29.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.355+0000 7f6496ffd640 1 --2- 172.21.15.45:0/2273752937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64981e5420 0x7f6498145740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:29.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.355+0000 7f6497fff640 1 -- 172.21.15.45:0/2273752937 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6484004d10 msgr2=0x7f6498147e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:29.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.355+0000 7f6497fff640 1 --2- 172.21.15.45:0/2273752937 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6484004d10 0x7f6498147e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:29.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.355+0000 7f6497fff640 1 -- 172.21.15.45:0/2273752937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64981e5420 msgr2=0x7f6498145740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:29.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.355+0000 7f6497fff640 1 --2- 172.21.15.45:0/2273752937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64981e5420 0x7f6498145740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:29.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.355+0000 7f6497fff640 1 -- 172.21.15.45:0/2273752937 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f649814c4a0 con 0x7f6498145c80 2023-10-03T19:20:29.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.355+0000 7f64977fe640 1 --2- 172.21.15.45:0/2273752937 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6484004d10 0x7f6498147e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:20:29.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.355+0000 7f6497fff640 1 --2- 172.21.15.45:0/2273752937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6498145c80 0x7f64981d5980 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f6490005040 tx=0x7f6484005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:29.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.355+0000 7f648ffff640 1 -- 172.21.15.45:0/2273752937 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6490007250 con 0x7f6498145c80 2023-10-03T19:20:29.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.355+0000 7f648ffff640 1 -- 172.21.15.45:0/2273752937 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64900073b0 con 0x7f6498145c80 2023-10-03T19:20:29.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.355+0000 7f649dc2b640 1 -- 172.21.15.45:0/2273752937 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f649814fae0 con 0x7f6498145c80 2023-10-03T19:20:29.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.355+0000 7f648ffff640 1 -- 172.21.15.45:0/2273752937 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64900067e0 con 0x7f6498145c80 2023-10-03T19:20:29.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.355+0000 7f649dc2b640 1 -- 172.21.15.45:0/2273752937 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f649806f540 con 0x7f6498145c80 2023-10-03T19:20:29.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.355+0000 7f649dc2b640 1 -- 172.21.15.45:0/2273752937 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f649806d660 con 0x7f6498145c80 2023-10-03T19:20:29.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.355+0000 7f648ffff640 1 -- 172.21.15.45:0/2273752937 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6490006940 con 0x7f6498145c80 2023-10-03T19:20:29.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.359+0000 7f648ffff640 1 --2- 172.21.15.45:0/2273752937 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6478066280 0x7f6478068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:29.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.359+0000 7f648ffff640 1 -- 172.21.15.45:0/2273752937 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f649011e0d0 con 0x7f6498145c80 2023-10-03T19:20:29.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.359+0000 7f64977fe640 1 --2- 172.21.15.45:0/2273752937 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6478066280 0x7f6478068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:29.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.359+0000 7f64977fe640 1 --2- 172.21.15.45:0/2273752937 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6478066280 0x7f6478068730 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f64880074d0 tx=0x7f648800b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:29.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.363+0000 7f648ffff640 1 -- 172.21.15.45:0/2273752937 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f64900eb670 con 0x7f6498145c80 2023-10-03T19:20:29.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.547+0000 7f649dc2b640 1 -- 172.21.15.45:0/2273752937 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f649804de80 con 0x7f6498145c80 2023-10-03T19:20:29.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.547+0000 7f648ffff640 1 -- 172.21.15.45:0/2273752937 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v58) v1 ==== 53+0+73 (secure 0 0 0) 0x7f64900eec90 con 0x7f6498145c80 2023-10-03T19:20:29.551 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-03T19:20:29.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.547+0000 7f649dc2b640 1 -- 172.21.15.45:0/2273752937 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6478066280 msgr2=0x7f6478068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:29.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.547+0000 7f649dc2b640 1 --2- 172.21.15.45:0/2273752937 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6478066280 0x7f6478068730 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f64880074d0 tx=0x7f648800b040 comp rx=0 tx=0).stop 2023-10-03T19:20:29.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.547+0000 7f649dc2b640 1 -- 172.21.15.45:0/2273752937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6498145c80 msgr2=0x7f64981d5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:29.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.547+0000 7f649dc2b640 1 --2- 172.21.15.45:0/2273752937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6498145c80 0x7f64981d5980 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f6490005040 tx=0x7f6484005800 comp rx=0 tx=0).stop 2023-10-03T19:20:29.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.547+0000 7f649dc2b640 1 -- 172.21.15.45:0/2273752937 shutdown_connections 2023-10-03T19:20:29.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.547+0000 7f649dc2b640 1 --2- 172.21.15.45:0/2273752937 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6478066280 0x7f6478068730 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:29.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.547+0000 7f649dc2b640 1 --2- 172.21.15.45:0/2273752937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6498145c80 0x7f64981d5980 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:29.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.547+0000 7f649dc2b640 1 --2- 172.21.15.45:0/2273752937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64981e5420 0x7f6498145740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:29.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.547+0000 7f649dc2b640 1 --2- 172.21.15.45:0/2273752937 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6484004d10 0x7f6498147e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:29.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.547+0000 7f649dc2b640 1 -- 172.21.15.45:0/2273752937 >> 172.21.15.45:0/2273752937 conn(0x7f64980bcf50 msgr2=0x7f649814abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:29.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.547+0000 7f649dc2b640 1 -- 172.21.15.45:0/2273752937 shutdown_connections 2023-10-03T19:20:29.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:29.547+0000 7f649dc2b640 1 -- 172.21.15.45:0/2273752937 wait complete. 2023-10-03T19:20:29.568 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-03T19:20:29.568 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-03T19:20:29.568 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi172.front.sepia.ceph.com 2023-10-03T19:20:29.568 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-03T19:20:29.568 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-03T19:20:29.568 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-03T19:20:29.568 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-03T19:20:29.568 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-03T19:20:29.568 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-03T19:20:29.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:20:29.569 DEBUG:teuthology.orchestra.run.smithi172:> ip addr 2023-10-03T19:20:29.577 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-03T19:20:29.577 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-03T19:20:29.577 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2023-10-03T19:20:29.577 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:20:29.577 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2023-10-03T19:20:29.578 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:20:29.578 INFO:teuthology.orchestra.run.smithi172.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:20:29.578 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2c brd ff:ff:ff:ff:ff:ff 2023-10-03T19:20:29.578 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f0 2023-10-03T19:20:29.578 INFO:teuthology.orchestra.run.smithi172.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:20:29.578 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2d brd ff:ff:ff:ff:ff:ff 2023-10-03T19:20:29.578 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f1 2023-10-03T19:20:29.578 INFO:teuthology.orchestra.run.smithi172.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-03T19:20:29.578 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:90 brd ff:ff:ff:ff:ff:ff 2023-10-03T19:20:29.578 INFO:teuthology.orchestra.run.smithi172.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-03T19:20:29.579 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:91 brd ff:ff:ff:ff:ff:ff 2023-10-03T19:20:29.579 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.21.15.172/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-03T19:20:29.579 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft 41945sec preferred_lft 41945sec 2023-10-03T19:20:29.579 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::ec4:7aff:fe88:7f91/64 scope link 2023-10-03T19:20:29.579 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:20:29.579 INFO:teuthology.orchestra.run.smithi172.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-03T19:20:29.579 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 02:42:f8:ea:71:4e brd ff:ff:ff:ff:ff:ff 2023-10-03T19:20:29.579 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-03T19:20:29.579 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:20:29.579 INFO:teuthology.orchestra.run.smithi172.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-03T19:20:29.579 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-03T19:20:29.580 INFO:teuthology.orchestra.run.smithi172.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-03T19:20:29.580 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:20:29.580 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::7ce5:4fff:fe93:8871/64 scope link 2023-10-03T19:20:29.580 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:20:29.580 INFO:teuthology.orchestra.run.smithi172.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-03T19:20:29.580 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-03T19:20:29.580 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-03T19:20:29.580 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-03T19:20:29.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:20:29.581 DEBUG:teuthology.orchestra.run.smithi172:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-03T19:20:29.633 INFO:teuthology.orchestra.run.smithi172.stdout:1 2023-10-03T19:20:29.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:20:29.635 DEBUG:teuthology.orchestra.run.smithi172:> route 2023-10-03T19:20:29.688 INFO:teuthology.orchestra.run.smithi172.stdout:Kernel IP routing table 2023-10-03T19:20:29.688 INFO:teuthology.orchestra.run.smithi172.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-03T19:20:29.688 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-03T19:20:29.688 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-03T19:20:29.688 INFO:teuthology.orchestra.run.smithi172.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-03T19:20:29.688 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-03T19:20:29.688 INFO:teuthology.orchestra.run.smithi172.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:20:29.689 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:20:29.689 INFO:teuthology.orchestra.run.smithi172.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-03T19:20:29.689 INFO:teuthology.orchestra.run.smithi172.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-03T19:20:29.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:20:29.689 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-10-03T19:20:29.689 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-10-03T19:20:29.689 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-03T19:20:29.689 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-03T19:20:29.690 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-03T19:20:29.690 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-10-03T19:20:29.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:20:29.763 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2023-10-03T19:20:29.808 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-03T19:20:29.809 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-03T19:20:29.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:20:29.809 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set brx.0 up 2023-10-03T19:20:29.862 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-03T19:20:29.862 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T19:20:29.862 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-03T19:20:29.908 INFO:teuthology.orchestra.run.smithi172.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-03T19:20:29.908 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T19:20:29.909 DEBUG:teuthology.orchestra.run.smithi172:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-03T19:20:29.956 DEBUG:teuthology.orchestra.run.smithi172:> sudo modprobe fuse 2023-10-03T19:20:30.017 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:20:30.017 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:20:30.071 INFO:teuthology.orchestra.run.smithi172.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:20:30.072 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:20:30.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:20:30.073 DEBUG:teuthology.orchestra.run.smithi172:> ls /sys/fs/fuse/connections 2023-10-03T19:20:30.120 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-03T19:20:30.120 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-03T19:20:30.165 DEBUG:teuthology.orchestra.run.smithi172:> sudo modprobe fuse 2023-10-03T19:20:30.181 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:20:30.181 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:20:30.239 INFO:teuthology.orchestra.run.smithi172.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:20:30.240 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:20:30.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:20:30.241 DEBUG:teuthology.orchestra.run.smithi172:> ls /sys/fs/fuse/connections 2023-10-03T19:20:30.245 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi172.stderr:2023-10-03T19:20:30.246+0000 7f85db824580 -1 init, newargv = 0x5588bf5772a0 newargc=15 2023-10-03T19:20:30.246 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi172.stderr:ceph-fuse[33514]: starting ceph client 2023-10-03T19:20:30.254 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi172.stderr:ceph-fuse[33514]: starting fuse 2023-10-03T19:20:31.351 DEBUG:teuthology.orchestra.run.smithi172:> sudo modprobe fuse 2023-10-03T19:20:31.366 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:20:31.366 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-03T19:20:31.420 INFO:teuthology.orchestra.run.smithi172.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-03T19:20:31.421 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-03T19:20:31.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:20:31.421 DEBUG:teuthology.orchestra.run.smithi172:> ls /sys/fs/fuse/connections 2023-10-03T19:20:31.468 INFO:teuthology.orchestra.run.smithi172.stdout:45 2023-10-03T19:20:31.468 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-03T19:20:31.468 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-03T19:20:31.469 DEBUG:teuthology.orchestra.run.smithi172:> import glob 2023-10-03T19:20:31.469 DEBUG:teuthology.orchestra.run.smithi172:> import re 2023-10-03T19:20:31.469 DEBUG:teuthology.orchestra.run.smithi172:> import os 2023-10-03T19:20:31.469 DEBUG:teuthology.orchestra.run.smithi172:> import subprocess 2023-10-03T19:20:31.469 DEBUG:teuthology.orchestra.run.smithi172:> 2023-10-03T19:20:31.469 DEBUG:teuthology.orchestra.run.smithi172:> def _find_admin_socket(client_name): 2023-10-03T19:20:31.469 DEBUG:teuthology.orchestra.run.smithi172:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-03T19:20:31.469 DEBUG:teuthology.orchestra.run.smithi172:> files = glob.glob(asok_path) 2023-10-03T19:20:31.469 DEBUG:teuthology.orchestra.run.smithi172:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-03T19:20:31.469 DEBUG:teuthology.orchestra.run.smithi172:> 2023-10-03T19:20:31.469 DEBUG:teuthology.orchestra.run.smithi172:> # Given a non-glob path, it better be there 2023-10-03T19:20:31.470 DEBUG:teuthology.orchestra.run.smithi172:> if "*" not in asok_path: 2023-10-03T19:20:31.470 DEBUG:teuthology.orchestra.run.smithi172:> assert(len(files) == 1) 2023-10-03T19:20:31.470 DEBUG:teuthology.orchestra.run.smithi172:> return files[0] 2023-10-03T19:20:31.470 DEBUG:teuthology.orchestra.run.smithi172:> 2023-10-03T19:20:31.470 DEBUG:teuthology.orchestra.run.smithi172:> for f in files: 2023-10-03T19:20:31.470 DEBUG:teuthology.orchestra.run.smithi172:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-03T19:20:31.470 DEBUG:teuthology.orchestra.run.smithi172:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-03T19:20:31.470 DEBUG:teuthology.orchestra.run.smithi172:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-03T19:20:31.470 DEBUG:teuthology.orchestra.run.smithi172:> contents = proc_f.read() 2023-10-03T19:20:31.470 DEBUG:teuthology.orchestra.run.smithi172:> if mountpoint in contents: 2023-10-03T19:20:31.470 DEBUG:teuthology.orchestra.run.smithi172:> return f 2023-10-03T19:20:31.471 DEBUG:teuthology.orchestra.run.smithi172:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-03T19:20:31.471 DEBUG:teuthology.orchestra.run.smithi172:> 2023-10-03T19:20:31.471 DEBUG:teuthology.orchestra.run.smithi172:> print(_find_admin_socket("client.1")) 2023-10-03T19:20:31.471 DEBUG:teuthology.orchestra.run.smithi172:> ' 2023-10-03T19:20:31.588 INFO:teuthology.orchestra.run.smithi172.stdout:/var/run/ceph/ceph-client.1.33514.asok 2023-10-03T19:20:31.771 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.33514.asok 2023-10-03T19:20:31.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:20:31.771 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.33514.asok status 2023-10-03T19:20:31.924 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2023-10-03T19:20:31.924 INFO:teuthology.orchestra.run.smithi172.stdout: "metadata": { 2023-10-03T19:20:31.924 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_sha1": "05a43c8fb3988914c879a50970f9054a098e0612", 2023-10-03T19:20:31.924 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_version": "ceph version 18.0.0-3908-g05a43c8f (05a43c8fb3988914c879a50970f9054a098e0612) reef (dev)", 2023-10-03T19:20:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: "entity_id": "1", 2023-10-03T19:20:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: "hostname": "smithi172", 2023-10-03T19:20:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-03T19:20:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: "pid": "33514", 2023-10-03T19:20:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: "root": "/" 2023-10-03T19:20:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-03T19:20:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: "dentry_count": 0, 2023-10-03T19:20:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: "dentry_pinned_count": 0, 2023-10-03T19:20:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: "id": 7803, 2023-10-03T19:20:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: "inst": { 2023-10-03T19:20:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: "name": { 2023-10-03T19:20:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: "type": "client", 2023-10-03T19:20:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: "num": 7803 2023-10-03T19:20:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-03T19:20:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": { 2023-10-03T19:20:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: "type": "v1", 2023-10-03T19:20:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": "172.21.15.172:0", 2023-10-03T19:20:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: "nonce": 707580424 2023-10-03T19:20:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-03T19:20:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-03T19:20:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": { 2023-10-03T19:20:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: "type": "v1", 2023-10-03T19:20:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": "172.21.15.172:0", 2023-10-03T19:20:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: "nonce": 707580424 2023-10-03T19:20:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-03T19:20:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: "inst_str": "client.7803 172.21.15.172:0/707580424", 2023-10-03T19:20:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: "addr_str": "172.21.15.172:0/707580424", 2023-10-03T19:20:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: "inode_count": 1, 2023-10-03T19:20:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_epoch": 58, 2023-10-03T19:20:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_epoch": 109, 2023-10-03T19:20:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_epoch_barrier": 0, 2023-10-03T19:20:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: "blocklisted": false, 2023-10-03T19:20:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: "fs_name": "cephfs" 2023-10-03T19:20:31.927 INFO:teuthology.orchestra.run.smithi172.stdout:} 2023-10-03T19:20:31.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:20:31.939 DEBUG:teuthology.orchestra.run.smithi172:> stat --file-system '--printf=%T 2023-10-03T19:20:31.940 DEBUG:teuthology.orchestra.run.smithi172:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-03T19:20:31.946 INFO:teuthology.orchestra.run.smithi172.stdout:fuseblk 2023-10-03T19:20:31.946 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-03T19:20:31.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:20:31.946 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-03T19:20:31.999 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:20:32.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.131+0000 7f976b893640 1 Processor -- start 2023-10-03T19:20:32.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.131+0000 7f976b893640 1 -- start start 2023-10-03T19:20:32.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.131+0000 7f976b893640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f976414bc10 0x7f97640beca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:32.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.131+0000 7f976b893640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9764070b70 0x7f976414efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:32.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.131+0000 7f976b893640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9764071550 con 0x7f97640ba1b0 2023-10-03T19:20:32.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.131+0000 7f976b893640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97640c0c10 con 0x7f9764070b70 2023-10-03T19:20:32.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.131+0000 7f976b893640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9764071270 con 0x7f976414bc10 2023-10-03T19:20:32.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.131+0000 7f976962f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f976414bc10 0x7f97640beca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:32.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.131+0000 7f9768e2e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9764070b70 0x7f976414efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:32.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.131+0000 7f976962f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f976414bc10 0x7f97640beca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:59004/0 (socket says 172.21.15.45:59004) 2023-10-03T19:20:32.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.131+0000 7f976962f640 1 -- 172.21.15.45:0/2031237070 learned_addr learned my addr 172.21.15.45:0/2031237070 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:32.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.131+0000 7f9768e2e640 1 -- 172.21.15.45:0/2031237070 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f976414bc10 msgr2=0x7f97640beca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:32.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.131+0000 7f9768e2e640 1 --2- 172.21.15.45:0/2031237070 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f976414bc10 0x7f97640beca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:32.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.131+0000 7f9768e2e640 1 -- 172.21.15.45:0/2031237070 >> v1:172.21.15.79:6789/0 conn(0x7f97640ba1b0 legacy=0x7f9764151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:32.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.131+0000 7f9768e2e640 1 -- 172.21.15.45:0/2031237070 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976414e7a0 con 0x7f9764070b70 2023-10-03T19:20:32.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.131+0000 7f976962f640 1 --2- 172.21.15.45:0/2031237070 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f976414bc10 0x7f97640beca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:20:32.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.135+0000 7f9768e2e640 1 --2- 172.21.15.45:0/2031237070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9764070b70 0x7f976414efa0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f97540097c0 tx=0x7f975401ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50a8a7431e58fbb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:32.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.135+0000 7f975bfff640 1 -- 172.21.15.45:0/2031237070 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97540a8970 con 0x7f9764070b70 2023-10-03T19:20:32.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.135+0000 7f975bfff640 1 -- 172.21.15.45:0/2031237070 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97540a8ad0 con 0x7f9764070b70 2023-10-03T19:20:32.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.135+0000 7f975bfff640 1 -- 172.21.15.45:0/2031237070 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97540a8e60 con 0x7f9764070b70 2023-10-03T19:20:32.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.135+0000 7f976b893640 1 -- 172.21.15.45:0/2031237070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9764070b70 msgr2=0x7f976414efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:32.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.135+0000 7f976b893640 1 --2- 172.21.15.45:0/2031237070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9764070b70 0x7f976414efa0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f97540097c0 tx=0x7f975401ec70 comp rx=0 tx=0).stop 2023-10-03T19:20:32.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.135+0000 7f976b893640 1 -- 172.21.15.45:0/2031237070 shutdown_connections 2023-10-03T19:20:32.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.135+0000 7f976b893640 1 --2- 172.21.15.45:0/2031237070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9764070b70 0x7f976414efa0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:32.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.135+0000 7f976b893640 1 --2- 172.21.15.45:0/2031237070 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f976414bc10 0x7f97640beca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:32.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.135+0000 7f976b893640 1 -- 172.21.15.45:0/2031237070 >> 172.21.15.45:0/2031237070 conn(0x7f97640bd880 msgr2=0x7f97640bdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:32.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.135+0000 7f976b893640 1 -- 172.21.15.45:0/2031237070 shutdown_connections 2023-10-03T19:20:32.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.135+0000 7f976b893640 1 -- 172.21.15.45:0/2031237070 wait complete. 2023-10-03T19:20:32.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.135+0000 7f976b893640 1 Processor -- start 2023-10-03T19:20:32.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.135+0000 7f976b893640 1 -- start start 2023-10-03T19:20:32.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.139+0000 7f976b893640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9764070b70 0x7f97640b9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:32.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.139+0000 7f976b893640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97640ba1b0 0x7f97641eb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:32.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.139+0000 7f976b893640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f976414bc10 0x7f97641eb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:32.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.139+0000 7f976b893640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9764151b70 con 0x7f97640ba1b0 2023-10-03T19:20:32.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.139+0000 7f976b893640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97641e5770 con 0x7f976414bc10 2023-10-03T19:20:32.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.139+0000 7f976b893640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97640b7d80 con 0x7f9764070b70 2023-10-03T19:20:32.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.139+0000 7f9768e2e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97640ba1b0 0x7f97641eb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:32.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.139+0000 7f9768e2e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97640ba1b0 0x7f97641eb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41276/0 (socket says 172.21.15.45:41276) 2023-10-03T19:20:32.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.139+0000 7f9768e2e640 1 -- 172.21.15.45:0/531619274 learned_addr learned my addr 172.21.15.45:0/531619274 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:32.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.139+0000 7f976962f640 1 --2- 172.21.15.45:0/531619274 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9764070b70 0x7f97640b9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:32.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.139+0000 7f9769e30640 1 --2- 172.21.15.45:0/531619274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f976414bc10 0x7f97641eb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:32.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.139+0000 7f9768e2e640 1 -- 172.21.15.45:0/531619274 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9764070b70 msgr2=0x7f97640b9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:32.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.139+0000 7f9768e2e640 1 --2- 172.21.15.45:0/531619274 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9764070b70 0x7f97640b9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:32.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.139+0000 7f9768e2e640 1 -- 172.21.15.45:0/531619274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f976414bc10 msgr2=0x7f97641eb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:32.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.139+0000 7f9768e2e640 1 --2- 172.21.15.45:0/531619274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f976414bc10 0x7f97641eb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:32.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.139+0000 7f9768e2e640 1 -- 172.21.15.45:0/531619274 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97600094d0 con 0x7f97640ba1b0 2023-10-03T19:20:32.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.139+0000 7f9769e30640 1 --2- 172.21.15.45:0/531619274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f976414bc10 0x7f97641eb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:32.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.139+0000 7f9768e2e640 1 --2- 172.21.15.45:0/531619274 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97640ba1b0 0x7f97641eb0d0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f975401c8a0 tx=0x7f975401ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:32.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.139+0000 7f9759ffb640 1 -- 172.21.15.45:0/531619274 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97540b9630 con 0x7f97640ba1b0 2023-10-03T19:20:32.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.139+0000 7f9759ffb640 1 -- 172.21.15.45:0/531619274 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97540b97b0 con 0x7f97640ba1b0 2023-10-03T19:20:32.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.139+0000 7f976b893640 1 -- 172.21.15.45:0/531619274 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9754009420 con 0x7f97640ba1b0 2023-10-03T19:20:32.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.139+0000 7f9759ffb640 1 -- 172.21.15.45:0/531619274 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97540b9b60 con 0x7f97640ba1b0 2023-10-03T19:20:32.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.139+0000 7f976b893640 1 -- 172.21.15.45:0/531619274 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f976414bfe0 con 0x7f97640ba1b0 2023-10-03T19:20:32.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.139+0000 7f976b893640 1 -- 172.21.15.45:0/531619274 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f976414ea80 con 0x7f97640ba1b0 2023-10-03T19:20:32.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.139+0000 7f9759ffb640 1 -- 172.21.15.45:0/531619274 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f97540b7040 con 0x7f97640ba1b0 2023-10-03T19:20:32.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.139+0000 7f9759ffb640 1 --2- 172.21.15.45:0/531619274 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9748066280 0x7f9748068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:32.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.139+0000 7f9759ffb640 1 -- 172.21.15.45:0/531619274 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9754122850 con 0x7f97640ba1b0 2023-10-03T19:20:32.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.139+0000 7f976962f640 1 --2- 172.21.15.45:0/531619274 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9748066280 0x7f9748068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:32.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.143+0000 7f976962f640 1 --2- 172.21.15.45:0/531619274 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9748066280 0x7f9748068730 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9760009bd0 tx=0x7f9760008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:32.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.143+0000 7f9759ffb640 1 -- 172.21.15.45:0/531619274 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f97540efe40 con 0x7f97640ba1b0 2023-10-03T19:20:32.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.335+0000 7f976b893640 1 -- 172.21.15.45:0/531619274 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f976404de80 con 0x7f97640ba1b0 2023-10-03T19:20:32.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.335+0000 7f9759ffb640 1 -- 172.21.15.45:0/531619274 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+3916 (secure 0 0 0) 0x7f97540f3460 con 0x7f97640ba1b0 2023-10-03T19:20:32.339 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:20:32.339 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":58,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3566869652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3566869652},{"type":"v1","addr":"172.21.15.79:6835","nonce":3566869652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":7587,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2339652261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2339652261},{"type":"v1","addr":"172.21.15.45:6833","nonce":2339652261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:20:16.301166+0000","modified":"2023-10-03T19:20:19.318778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7602":{"gid":7602,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1723126563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1723126563},{"type":"v1","addr":"172.21.15.45:6835","nonce":1723126563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-10-03T19:20:32.339 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 58 2023-10-03T19:20:32.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.335+0000 7f976b893640 1 -- 172.21.15.45:0/531619274 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9748066280 msgr2=0x7f9748068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:32.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.335+0000 7f976b893640 1 --2- 172.21.15.45:0/531619274 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9748066280 0x7f9748068730 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9760009bd0 tx=0x7f9760008040 comp rx=0 tx=0).stop 2023-10-03T19:20:32.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.335+0000 7f976b893640 1 -- 172.21.15.45:0/531619274 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97640ba1b0 msgr2=0x7f97641eb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:32.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.335+0000 7f976b893640 1 --2- 172.21.15.45:0/531619274 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97640ba1b0 0x7f97641eb0d0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f975401c8a0 tx=0x7f975401ba10 comp rx=0 tx=0).stop 2023-10-03T19:20:32.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.335+0000 7f976b893640 1 -- 172.21.15.45:0/531619274 shutdown_connections 2023-10-03T19:20:32.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.335+0000 7f976b893640 1 --2- 172.21.15.45:0/531619274 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f9748066280 0x7f9748068730 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:32.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.335+0000 7f976b893640 1 --2- 172.21.15.45:0/531619274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f976414bc10 0x7f97641eb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:32.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.335+0000 7f976b893640 1 --2- 172.21.15.45:0/531619274 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97640ba1b0 0x7f97641eb0d0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:32.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.335+0000 7f976b893640 1 --2- 172.21.15.45:0/531619274 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9764070b70 0x7f97640b9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:32.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.335+0000 7f976b893640 1 -- 172.21.15.45:0/531619274 >> 172.21.15.45:0/531619274 conn(0x7f97640bd880 msgr2=0x7f97640bbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:32.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.335+0000 7f976b893640 1 -- 172.21.15.45:0/531619274 shutdown_connections 2023-10-03T19:20:32.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.335+0000 7f976b893640 1 -- 172.21.15.45:0/531619274 wait complete. 2023-10-03T19:20:32.357 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set debug_mds 1/10 2023-10-03T19:20:32.481 INFO:teuthology.orchestra.run.smithi045.stdout:{"success":""} 2023-10-03T19:20:32.481 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "" } 2023-10-03T19:20:32.481 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:20:32.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.591+0000 7f82af6b7640 1 Processor -- start 2023-10-03T19:20:32.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.591+0000 7f82af6b7640 1 -- start start 2023-10-03T19:20:32.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.595+0000 7f82af6b7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f82a814bb80 0x7f82a80bdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:32.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.595+0000 7f82af6b7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f82a80ba770 0x7f82a8158f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:32.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.595+0000 7f82af6b7640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82a806dc20 con 0x7f82a80bb230 2023-10-03T19:20:32.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.595+0000 7f82af6b7640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a8070b20 con 0x7f82a80ba770 2023-10-03T19:20:32.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.595+0000 7f82af6b7640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a806e0b0 con 0x7f82a814bb80 2023-10-03T19:20:32.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.595+0000 7f82adc54640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f82a80ba770 0x7f82a8158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:32.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.595+0000 7f82adc54640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f82a80ba770 0x7f82a8158f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41278/0 (socket says 172.21.15.45:41278) 2023-10-03T19:20:32.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.595+0000 7f82adc54640 1 -- 172.21.15.45:0/1620372273 learned_addr learned my addr 172.21.15.45:0/1620372273 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:32.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.595+0000 7f82ad453640 1 --2- 172.21.15.45:0/1620372273 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f82a814bb80 0x7f82a80bdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:32.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.595+0000 7f82adc54640 1 -- 172.21.15.45:0/1620372273 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f82a814bb80 msgr2=0x7f82a80bdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:32.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.595+0000 7f82adc54640 1 --2- 172.21.15.45:0/1620372273 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f82a814bb80 0x7f82a80bdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:32.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.595+0000 7f82adc54640 1 -- 172.21.15.45:0/1620372273 >> v1:172.21.15.79:6789/0 conn(0x7f82a80bb230 legacy=0x7f82a8151b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:32.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.595+0000 7f82adc54640 1 -- 172.21.15.45:0/1620372273 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a8070db0 con 0x7f82a80ba770 2023-10-03T19:20:32.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.595+0000 7f82adc54640 1 --2- 172.21.15.45:0/1620372273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a80ba770 0x7f82a8158f00 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f82a0009e50 tx=0x7f82a001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e6a85912d49901 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:32.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f829ffff640 1 -- 172.21.15.45:0/1620372273 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a00a5890 con 0x7f82a80ba770 2023-10-03T19:20:32.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f829ffff640 1 -- 172.21.15.45:0/1620372273 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a00a59f0 con 0x7f82a80ba770 2023-10-03T19:20:32.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f829ffff640 1 -- 172.21.15.45:0/1620372273 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a00a5d80 con 0x7f82a80ba770 2023-10-03T19:20:32.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f82af6b7640 1 -- 172.21.15.45:0/1620372273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a80ba770 msgr2=0x7f82a8158f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:32.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f82af6b7640 1 --2- 172.21.15.45:0/1620372273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a80ba770 0x7f82a8158f00 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f82a0009e50 tx=0x7f82a001c9b0 comp rx=0 tx=0).stop 2023-10-03T19:20:32.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f82af6b7640 1 -- 172.21.15.45:0/1620372273 shutdown_connections 2023-10-03T19:20:32.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f82af6b7640 1 --2- 172.21.15.45:0/1620372273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a80ba770 0x7f82a8158f00 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:32.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f82af6b7640 1 --2- 172.21.15.45:0/1620372273 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f82a814bb80 0x7f82a80bdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:32.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f82af6b7640 1 -- 172.21.15.45:0/1620372273 >> 172.21.15.45:0/1620372273 conn(0x7f82a80c1a20 msgr2=0x7f82a80bd810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:32.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f82af6b7640 1 -- 172.21.15.45:0/1620372273 shutdown_connections 2023-10-03T19:20:32.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f82af6b7640 1 -- 172.21.15.45:0/1620372273 wait complete. 2023-10-03T19:20:32.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f82af6b7640 1 Processor -- start 2023-10-03T19:20:32.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f82af6b7640 1 -- start start 2023-10-03T19:20:32.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f82af6b7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f82a80ba770 0x7f82a8144570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:32.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f82af6b7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a814bb80 0x7f82a81515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:32.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f82af6b7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82a813ce10 0x7f82a80bc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:32.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f82af6b7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a813ded0 con 0x7f82a814bb80 2023-10-03T19:20:32.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f82af6b7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a80bd5e0 con 0x7f82a813ce10 2023-10-03T19:20:32.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f82af6b7640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a8150520 con 0x7f82a80ba770 2023-10-03T19:20:32.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f82acc52640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a814bb80 0x7f82a81515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:32.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f82acc52640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a814bb80 0x7f82a81515e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41288/0 (socket says 172.21.15.45:41288) 2023-10-03T19:20:32.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f82acc52640 1 -- 172.21.15.45:0/224207605 learned_addr learned my addr 172.21.15.45:0/224207605 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:32.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f82ad453640 1 --2- 172.21.15.45:0/224207605 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f82a80ba770 0x7f82a8144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:32.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f82adc54640 1 --2- 172.21.15.45:0/224207605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82a813ce10 0x7f82a80bc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:32.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f82acc52640 1 -- 172.21.15.45:0/224207605 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f82a80ba770 msgr2=0x7f82a8144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:32.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f82acc52640 1 --2- 172.21.15.45:0/224207605 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f82a80ba770 0x7f82a8144570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:32.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f82acc52640 1 -- 172.21.15.45:0/224207605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82a813ce10 msgr2=0x7f82a80bc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:32.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f82acc52640 1 --2- 172.21.15.45:0/224207605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82a813ce10 0x7f82a80bc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:32.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f82acc52640 1 -- 172.21.15.45:0/224207605 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a0009b30 con 0x7f82a814bb80 2023-10-03T19:20:32.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f82adc54640 1 --2- 172.21.15.45:0/224207605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82a813ce10 0x7f82a80bc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:32.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f82acc52640 1 --2- 172.21.15.45:0/224207605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a814bb80 0x7f82a81515e0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f829800c530 tx=0x7f829800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:32.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f829dffb640 1 -- 172.21.15.45:0/224207605 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8298005220 con 0x7f82a814bb80 2023-10-03T19:20:32.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f829dffb640 1 -- 172.21.15.45:0/224207605 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8298005380 con 0x7f82a814bb80 2023-10-03T19:20:32.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f82af6b7640 1 -- 172.21.15.45:0/224207605 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a8152410 con 0x7f82a814bb80 2023-10-03T19:20:32.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f829dffb640 1 -- 172.21.15.45:0/224207605 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8298007270 con 0x7f82a814bb80 2023-10-03T19:20:32.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.599+0000 7f82af6b7640 1 -- 172.21.15.45:0/224207605 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a8152280 con 0x7f82a814bb80 2023-10-03T19:20:32.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.603+0000 7f82af6b7640 1 -- 172.21.15.45:0/224207605 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a81525a0 con 0x7f82a814bb80 2023-10-03T19:20:32.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.603+0000 7f829dffb640 1 -- 172.21.15.45:0/224207605 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f82980073d0 con 0x7f82a814bb80 2023-10-03T19:20:32.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.603+0000 7f829dffb640 1 --2- 172.21.15.45:0/224207605 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f828c066280 0x7f828c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:32.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.603+0000 7f829dffb640 1 -- 172.21.15.45:0/224207605 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f82980835b0 con 0x7f82a814bb80 2023-10-03T19:20:32.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.603+0000 7f82ad453640 1 --2- 172.21.15.45:0/224207605 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f828c066280 0x7f828c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:32.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.603+0000 7f82ad453640 1 --2- 172.21.15.45:0/224207605 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f828c066280 0x7f828c068730 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f82a400b930 tx=0x7f82a4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:32.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.607+0000 7f829dffb640 1 -- 172.21.15.45:0/224207605 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8298050ac0 con 0x7f82a814bb80 2023-10-03T19:20:32.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.795+0000 7f82af6b7640 1 -- 172.21.15.45:0/224207605 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82a80714a0 con 0x7f82a814bb80 2023-10-03T19:20:32.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.799+0000 7f829dffb640 1 -- 172.21.15.45:0/224207605 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+3916 (secure 0 0 0) 0x7f82980540e0 con 0x7f82a814bb80 2023-10-03T19:20:32.802 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:20:32.802 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":58,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3566869652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3566869652},{"type":"v1","addr":"172.21.15.79:6835","nonce":3566869652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":7587,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2339652261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2339652261},{"type":"v1","addr":"172.21.15.45:6833","nonce":2339652261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:20:16.301166+0000","modified":"2023-10-03T19:20:19.318778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7602":{"gid":7602,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1723126563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1723126563},{"type":"v1","addr":"172.21.15.45:6835","nonce":1723126563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-10-03T19:20:32.802 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 58 2023-10-03T19:20:32.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.799+0000 7f82af6b7640 1 -- 172.21.15.45:0/224207605 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f828c066280 msgr2=0x7f828c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:32.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.799+0000 7f82af6b7640 1 --2- 172.21.15.45:0/224207605 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f828c066280 0x7f828c068730 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f82a400b930 tx=0x7f82a4008040 comp rx=0 tx=0).stop 2023-10-03T19:20:32.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.799+0000 7f82af6b7640 1 -- 172.21.15.45:0/224207605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a814bb80 msgr2=0x7f82a81515e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:32.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.799+0000 7f82af6b7640 1 --2- 172.21.15.45:0/224207605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a814bb80 0x7f82a81515e0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f829800c530 tx=0x7f829800c9f0 comp rx=0 tx=0).stop 2023-10-03T19:20:32.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.799+0000 7f82af6b7640 1 -- 172.21.15.45:0/224207605 shutdown_connections 2023-10-03T19:20:32.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.799+0000 7f82af6b7640 1 --2- 172.21.15.45:0/224207605 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f828c066280 0x7f828c068730 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:32.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.799+0000 7f82af6b7640 1 --2- 172.21.15.45:0/224207605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82a813ce10 0x7f82a80bc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:32.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.799+0000 7f82af6b7640 1 --2- 172.21.15.45:0/224207605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a814bb80 0x7f82a81515e0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:32.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.799+0000 7f82af6b7640 1 --2- 172.21.15.45:0/224207605 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f82a80ba770 0x7f82a8144570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:32.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.799+0000 7f82af6b7640 1 -- 172.21.15.45:0/224207605 >> 172.21.15.45:0/224207605 conn(0x7f82a80c1a20 msgr2=0x7f82a8149350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:32.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.799+0000 7f82af6b7640 1 -- 172.21.15.45:0/224207605 shutdown_connections 2023-10-03T19:20:32.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:32.799+0000 7f82af6b7640 1 -- 172.21.15.45:0/224207605 wait complete. 2023-10-03T19:20:32.819 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_extraordinary_events_dump_interval 1 2023-10-03T19:20:32.940 INFO:teuthology.orchestra.run.smithi045.stdout:{"success":"mds_extraordinary_events_dump_interval = '1' "} 2023-10-03T19:20:32.940 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_extraordinary_events_dump_interval = '1' " } 2023-10-03T19:20:32.940 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-03T19:20:32.941 DEBUG:teuthology.orchestra.run.smithi146:> import glob 2023-10-03T19:20:32.941 DEBUG:teuthology.orchestra.run.smithi146:> import re 2023-10-03T19:20:32.941 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-03T19:20:32.941 DEBUG:teuthology.orchestra.run.smithi146:> import subprocess 2023-10-03T19:20:32.941 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:20:32.941 DEBUG:teuthology.orchestra.run.smithi146:> def _find_admin_socket(client_name): 2023-10-03T19:20:32.941 DEBUG:teuthology.orchestra.run.smithi146:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-03T19:20:32.942 DEBUG:teuthology.orchestra.run.smithi146:> files = glob.glob(asok_path) 2023-10-03T19:20:32.942 DEBUG:teuthology.orchestra.run.smithi146:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-03T19:20:32.942 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:20:32.942 DEBUG:teuthology.orchestra.run.smithi146:> # Given a non-glob path, it better be there 2023-10-03T19:20:32.942 DEBUG:teuthology.orchestra.run.smithi146:> if "*" not in asok_path: 2023-10-03T19:20:32.942 DEBUG:teuthology.orchestra.run.smithi146:> assert(len(files) == 1) 2023-10-03T19:20:32.942 DEBUG:teuthology.orchestra.run.smithi146:> return files[0] 2023-10-03T19:20:32.943 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:20:32.943 DEBUG:teuthology.orchestra.run.smithi146:> for f in files: 2023-10-03T19:20:32.943 DEBUG:teuthology.orchestra.run.smithi146:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-03T19:20:32.943 DEBUG:teuthology.orchestra.run.smithi146:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-03T19:20:32.943 DEBUG:teuthology.orchestra.run.smithi146:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-03T19:20:32.943 DEBUG:teuthology.orchestra.run.smithi146:> contents = proc_f.read() 2023-10-03T19:20:32.943 DEBUG:teuthology.orchestra.run.smithi146:> if mountpoint in contents: 2023-10-03T19:20:32.943 DEBUG:teuthology.orchestra.run.smithi146:> return f 2023-10-03T19:20:32.944 DEBUG:teuthology.orchestra.run.smithi146:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-03T19:20:32.944 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-03T19:20:32.944 DEBUG:teuthology.orchestra.run.smithi146:> print(_find_admin_socket("client.0")) 2023-10-03T19:20:32.944 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-03T19:20:33.024 INFO:teuthology.orchestra.run.smithi146.stdout:/var/run/ceph/ceph-client.0.34037.asok 2023-10-03T19:20:33.206 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.34037.asok 2023-10-03T19:20:33.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:20:33.206 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.34037.asok mds_sessions 2023-10-03T19:20:33.364 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-03T19:20:33.364 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 6826, 2023-10-03T19:20:33.364 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": { 2023-10-03T19:20:33.364 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2023-10-03T19:20:33.364 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2023-10-03T19:20:33.364 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 6826 2023-10-03T19:20:33.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:20:33.365 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-03T19:20:33.365 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T19:20:33.365 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:0", 2023-10-03T19:20:33.365 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 2294298422 2023-10-03T19:20:33.365 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T19:20:33.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:20:33.366 INFO:teuthology.orchestra.run.smithi146.stdout: "inst_str": "client.6826 v1:172.21.15.146:0/2294298422", 2023-10-03T19:20:33.366 INFO:teuthology.orchestra.run.smithi146.stdout: "addr_str": "v1:172.21.15.146:0/2294298422", 2023-10-03T19:20:33.366 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions": [ 2023-10-03T19:20:33.366 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T19:20:33.366 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": 0, 2023-10-03T19:20:33.366 INFO:teuthology.orchestra.run.smithi146.stdout: "addrs": { 2023-10-03T19:20:33.366 INFO:teuthology.orchestra.run.smithi146.stdout: "addrvec": [ 2023-10-03T19:20:33.367 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T19:20:33.367 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v2", 2023-10-03T19:20:33.367 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.45:6834", 2023-10-03T19:20:33.367 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 1723126563 2023-10-03T19:20:33.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:20:33.367 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T19:20:33.367 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T19:20:33.367 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.45:6835", 2023-10-03T19:20:33.368 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 1723126563 2023-10-03T19:20:33.368 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T19:20:33.368 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-03T19:20:33.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T19:20:33.368 INFO:teuthology.orchestra.run.smithi146.stdout: "seq": 0, 2023-10-03T19:20:33.368 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_gen": 0, 2023-10-03T19:20:33.368 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_ttl": "2023-10-03T19:21:28.454415+0000", 2023-10-03T19:20:33.368 INFO:teuthology.orchestra.run.smithi146.stdout: "last_cap_renew_request": "2023-10-03T19:20:28.454415+0000", 2023-10-03T19:20:33.368 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_renew_seq": 2, 2023-10-03T19:20:33.369 INFO:teuthology.orchestra.run.smithi146.stdout: "num_caps": 1, 2023-10-03T19:20:33.369 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "open" 2023-10-03T19:20:33.369 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T19:20:33.369 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2023-10-03T19:20:33.369 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 58 2023-10-03T19:20:33.369 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-03T19:20:33.377 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:20:33.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.503+0000 7fde8c758640 1 Processor -- start 2023-10-03T19:20:33.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.507+0000 7fde8c758640 1 -- start start 2023-10-03T19:20:33.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.507+0000 7fde8c758640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fde8406f170 0x7fde84150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:33.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.507+0000 7fde8c758640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fde840bc8b0 0x7fde8414ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:33.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.507+0000 7fde8c758640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde8406cac0 con 0x7fde8406d170 2023-10-03T19:20:33.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.507+0000 7fde8c758640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde840720d0 con 0x7fde840bc8b0 2023-10-03T19:20:33.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.507+0000 7fde8c758640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde840a5ab0 con 0x7fde8406f170 2023-10-03T19:20:33.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.507+0000 7fde89cf3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fde840bc8b0 0x7fde8414ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:33.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.507+0000 7fde89cf3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fde840bc8b0 0x7fde8414ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41304/0 (socket says 172.21.15.45:41304) 2023-10-03T19:20:33.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.507+0000 7fde89cf3640 1 -- 172.21.15.45:0/1460391016 learned_addr learned my addr 172.21.15.45:0/1460391016 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:33.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.507+0000 7fde8a4f4640 1 --2- 172.21.15.45:0/1460391016 >> v2:172.21.15.79:3300/0 conn(0x7fde8406f170 0x7fde84150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:33.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.507+0000 7fde89cf3640 1 -- 172.21.15.45:0/1460391016 >> v2:172.21.15.79:3300/0 conn(0x7fde8406f170 msgr2=0x7fde84150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:33.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.507+0000 7fde89cf3640 1 --2- 172.21.15.45:0/1460391016 >> v2:172.21.15.79:3300/0 conn(0x7fde8406f170 0x7fde84150190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:33.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.507+0000 7fde89cf3640 1 -- 172.21.15.45:0/1460391016 >> v1:172.21.15.79:6789/0 conn(0x7fde8406d170 legacy=0x7fde8414cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:33.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.507+0000 7fde89cf3640 1 -- 172.21.15.45:0/1460391016 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8406cd00 con 0x7fde840bc8b0 2023-10-03T19:20:33.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.507+0000 7fde89cf3640 1 --2- 172.21.15.45:0/1460391016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde840bc8b0 0x7fde8414ca70 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fde840bdf90 tx=0x7fde8001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2838f91647eeeeea server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:33.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.507+0000 7fde894f2640 1 -- 172.21.15.45:0/1460391016 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde800ac630 con 0x7fde840bc8b0 2023-10-03T19:20:33.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.507+0000 7fde894f2640 1 -- 172.21.15.45:0/1460391016 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde800ac790 con 0x7fde840bc8b0 2023-10-03T19:20:33.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.507+0000 7fde894f2640 1 -- 172.21.15.45:0/1460391016 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde800acb20 con 0x7fde840bc8b0 2023-10-03T19:20:33.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde8c758640 1 -- 172.21.15.45:0/1460391016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde840bc8b0 msgr2=0x7fde8414ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:33.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde8c758640 1 --2- 172.21.15.45:0/1460391016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde840bc8b0 0x7fde8414ca70 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fde840bdf90 tx=0x7fde8001c480 comp rx=0 tx=0).stop 2023-10-03T19:20:33.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde8c758640 1 -- 172.21.15.45:0/1460391016 shutdown_connections 2023-10-03T19:20:33.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde8c758640 1 --2- 172.21.15.45:0/1460391016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde840bc8b0 0x7fde8414ca70 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:33.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde8c758640 1 --2- 172.21.15.45:0/1460391016 >> v2:172.21.15.79:3300/0 conn(0x7fde8406f170 0x7fde84150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:33.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde8c758640 1 -- 172.21.15.45:0/1460391016 >> 172.21.15.45:0/1460391016 conn(0x7fde840bcf50 msgr2=0x7fde840bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:33.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde8c758640 1 -- 172.21.15.45:0/1460391016 shutdown_connections 2023-10-03T19:20:33.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde8c758640 1 -- 172.21.15.45:0/1460391016 wait complete. 2023-10-03T19:20:33.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde8c758640 1 Processor -- start 2023-10-03T19:20:33.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde8c758640 1 -- start start 2023-10-03T19:20:33.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde8c758640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde8406d170 0x7fde841e53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:33.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde8c758640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde8406f170 0x7fde841434b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:33.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde8c758640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde840bc8b0 0x7fde84145e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:33.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde8c758640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde840bf730 con 0x7fde8406f170 2023-10-03T19:20:33.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde8c758640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde841e5920 con 0x7fde840bc8b0 2023-10-03T19:20:33.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde8c758640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde840bf3c0 con 0x7fde8406d170 2023-10-03T19:20:33.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde89cf3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde8406f170 0x7fde841434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:33.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde89cf3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde8406f170 0x7fde841434b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41310/0 (socket says 172.21.15.45:41310) 2023-10-03T19:20:33.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde89cf3640 1 -- 172.21.15.45:0/591484457 learned_addr learned my addr 172.21.15.45:0/591484457 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:33.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde8acf5640 1 --2- 172.21.15.45:0/591484457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde840bc8b0 0x7fde84145e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:33.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde8a4f4640 1 --2- 172.21.15.45:0/591484457 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde8406d170 0x7fde841e53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:33.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde89cf3640 1 -- 172.21.15.45:0/591484457 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde8406d170 msgr2=0x7fde841e53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:33.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde89cf3640 1 --2- 172.21.15.45:0/591484457 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde8406d170 0x7fde841e53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:33.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde89cf3640 1 -- 172.21.15.45:0/591484457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde840bc8b0 msgr2=0x7fde84145e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:33.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde89cf3640 1 --2- 172.21.15.45:0/591484457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde840bc8b0 0x7fde84145e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:33.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde89cf3640 1 -- 172.21.15.45:0/591484457 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde800094d0 con 0x7fde8406f170 2023-10-03T19:20:33.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde8acf5640 1 --2- 172.21.15.45:0/591484457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde840bc8b0 0x7fde84145e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:20:33.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde89cf3640 1 --2- 172.21.15.45:0/591484457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde8406f170 0x7fde841434b0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fde800af040 tx=0x7fde80019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:33.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde76ffd640 1 -- 172.21.15.45:0/591484457 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde800b5850 con 0x7fde8406f170 2023-10-03T19:20:33.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde76ffd640 1 -- 172.21.15.45:0/591484457 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde800b59b0 con 0x7fde8406f170 2023-10-03T19:20:33.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde8c758640 1 -- 172.21.15.45:0/591484457 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde8406f6d0 con 0x7fde8406f170 2023-10-03T19:20:33.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde76ffd640 1 -- 172.21.15.45:0/591484457 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde800b5d60 con 0x7fde8406f170 2023-10-03T19:20:33.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.511+0000 7fde8c758640 1 -- 172.21.15.45:0/591484457 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8406f540 con 0x7fde8406f170 2023-10-03T19:20:33.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.515+0000 7fde8c758640 1 -- 172.21.15.45:0/591484457 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde84159670 con 0x7fde8406f170 2023-10-03T19:20:33.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.515+0000 7fde76ffd640 1 -- 172.21.15.45:0/591484457 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fde800b3070 con 0x7fde8406f170 2023-10-03T19:20:33.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.515+0000 7fde76ffd640 1 --2- 172.21.15.45:0/591484457 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fde680662b0 0x7fde68068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:33.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.515+0000 7fde76ffd640 1 -- 172.21.15.45:0/591484457 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fde8011dbf0 con 0x7fde8406f170 2023-10-03T19:20:33.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.515+0000 7fde8a4f4640 1 --2- 172.21.15.45:0/591484457 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fde680662b0 0x7fde68068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:33.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.515+0000 7fde8a4f4640 1 --2- 172.21.15.45:0/591484457 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fde680662b0 0x7fde68068760 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fde7800a970 tx=0x7fde78008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:33.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.519+0000 7fde76ffd640 1 -- 172.21.15.45:0/591484457 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fde800eb100 con 0x7fde8406f170 2023-10-03T19:20:33.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.703+0000 7fde8c758640 1 -- 172.21.15.45:0/591484457 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde8406d660 con 0x7fde8406f170 2023-10-03T19:20:33.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.703+0000 7fde76ffd640 1 -- 172.21.15.45:0/591484457 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+3916 (secure 0 0 0) 0x7fde800b1020 con 0x7fde8406f170 2023-10-03T19:20:33.709 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:20:33.709 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":58,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3566869652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3566869652},{"type":"v1","addr":"172.21.15.79:6835","nonce":3566869652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":7587,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2339652261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2339652261},{"type":"v1","addr":"172.21.15.45:6833","nonce":2339652261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:20:16.301166+0000","modified":"2023-10-03T19:20:19.318778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7602":{"gid":7602,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1723126563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1723126563},{"type":"v1","addr":"172.21.15.45:6835","nonce":1723126563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-10-03T19:20:33.710 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 58 2023-10-03T19:20:33.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.707+0000 7fde8c758640 1 -- 172.21.15.45:0/591484457 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fde680662b0 msgr2=0x7fde68068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:33.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.707+0000 7fde8c758640 1 --2- 172.21.15.45:0/591484457 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fde680662b0 0x7fde68068760 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fde7800a970 tx=0x7fde78008040 comp rx=0 tx=0).stop 2023-10-03T19:20:33.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.707+0000 7fde8c758640 1 -- 172.21.15.45:0/591484457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde8406f170 msgr2=0x7fde841434b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:33.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.707+0000 7fde8c758640 1 --2- 172.21.15.45:0/591484457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde8406f170 0x7fde841434b0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fde800af040 tx=0x7fde80019220 comp rx=0 tx=0).stop 2023-10-03T19:20:33.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.707+0000 7fde8c758640 1 -- 172.21.15.45:0/591484457 shutdown_connections 2023-10-03T19:20:33.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.707+0000 7fde8c758640 1 --2- 172.21.15.45:0/591484457 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fde680662b0 0x7fde68068760 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:33.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.707+0000 7fde8c758640 1 --2- 172.21.15.45:0/591484457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde840bc8b0 0x7fde84145e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:33.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.707+0000 7fde8c758640 1 --2- 172.21.15.45:0/591484457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde8406f170 0x7fde841434b0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:33.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.707+0000 7fde8c758640 1 --2- 172.21.15.45:0/591484457 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde8406d170 0x7fde841e53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:33.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.707+0000 7fde8c758640 1 -- 172.21.15.45:0/591484457 >> 172.21.15.45:0/591484457 conn(0x7fde840bcf50 msgr2=0x7fde8414e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:33.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.707+0000 7fde8c758640 1 -- 172.21.15.45:0/591484457 shutdown_connections 2023-10-03T19:20:33.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.707+0000 7fde8c758640 1 -- 172.21.15.45:0/591484457 wait complete. 2023-10-03T19:20:33.727 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:20:33.796 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:20:33.798 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:20:33.801 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:20:33.803 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:20:33.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.843+0000 7efce1ed4640 1 Processor -- start 2023-10-03T19:20:33.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.843+0000 7efce1ed4640 1 -- start start 2023-10-03T19:20:33.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efce1ed4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efcdc0bcb60 0x7efcdc06c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:33.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efce1ed4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efcdc06c7d0 0x7efcdc155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:33.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efce1ed4640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcdc14b610 con 0x7efcdc148b90 2023-10-03T19:20:33.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efce1ed4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcdc0a3670 con 0x7efcdc06c7d0 2023-10-03T19:20:33.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efce1ed4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc14b370 con 0x7efcdc0bcb60 2023-10-03T19:20:33.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efcdb7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7efcdc148b90 0x7efcdc0bbf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38182/0 (socket says 172.21.15.45:38182) 2023-10-03T19:20:33.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efcdb7fe640 1 -- 172.21.15.45:0/1841829268 learned_addr learned my addr 172.21.15.45:0/1841829268 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:20:33.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efcdbfff640 1 --2- 172.21.15.45:0/1841829268 >> v2:172.21.15.79:3300/0 conn(0x7efcdc06c7d0 0x7efcdc155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:33.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efcdaffd640 1 --2- 172.21.15.45:0/1841829268 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efcdc0bcb60 0x7efcdc06c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:33.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efcda7fc640 1 -- 172.21.15.45:0/1841829268 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1638028310 0 0) 0x7efcdc14b610 con 0x7efcdc148b90 2023-10-03T19:20:33.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efcda7fc640 1 -- 172.21.15.45:0/1841829268 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcc4003530 con 0x7efcdc148b90 2023-10-03T19:20:33.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efcda7fc640 1 -- 172.21.15.45:0/1841829268 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 586534505 0 0) 0x7efcc4003530 con 0x7efcdc148b90 2023-10-03T19:20:33.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efcda7fc640 1 -- 172.21.15.45:0/1841829268 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efcdc0bcb60 msgr2=0x7efcdc06c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:33.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efcda7fc640 1 --2- 172.21.15.45:0/1841829268 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efcdc0bcb60 0x7efcdc06c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:33.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efcda7fc640 1 -- 172.21.15.45:0/1841829268 >> v2:172.21.15.79:3300/0 conn(0x7efcdc06c7d0 msgr2=0x7efcdc155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:33.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efcda7fc640 1 --2- 172.21.15.45:0/1841829268 >> v2:172.21.15.79:3300/0 conn(0x7efcdc06c7d0 0x7efcdc155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:33.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efcda7fc640 1 -- 172.21.15.45:0/1841829268 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc0a5580 con 0x7efcdc148b90 2023-10-03T19:20:33.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efcda7fc640 1 -- 172.21.15.45:0/1841829268 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7efccc001a00 con 0x7efcdc148b90 2023-10-03T19:20:33.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efcda7fc640 1 -- 172.21.15.45:0/1841829268 >> v1:172.21.15.45:6789/0 conn(0x7efcdc148b90 legacy=0x7efcdc0bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:33.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efcda7fc640 1 --2- 172.21.15.45:0/1841829268 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efcdc0bcb60 0x7efcc4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:33.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efcda7fc640 1 --2- 172.21.15.45:0/1841829268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcc4003f00 0x7efcc40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:33.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efcda7fc640 1 --2- 172.21.15.45:0/1841829268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcc4004d10 0x7efcc4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:33.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efcda7fc640 1 -- 172.21.15.45:0/1841829268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc0a3670 con 0x7efcc4003f00 2023-10-03T19:20:33.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efcda7fc640 1 -- 172.21.15.45:0/1841829268 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc14b370 con 0x7efcc4004d10 2023-10-03T19:20:33.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efcda7fc640 1 -- 172.21.15.45:0/1841829268 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc400b9c0 con 0x7efcdc0bcb60 2023-10-03T19:20:33.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efcdaffd640 1 --2- 172.21.15.45:0/1841829268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcc4003f00 0x7efcc40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:33.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efcdbfff640 1 --2- 172.21.15.45:0/1841829268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcc4004d10 0x7efcc4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:33.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efcdaffd640 1 -- 172.21.15.45:0/1841829268 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efcdc0bcb60 msgr2=0x7efcc4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:33.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efcdaffd640 1 --2- 172.21.15.45:0/1841829268 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efcdc0bcb60 0x7efcc4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:33.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efcdaffd640 1 -- 172.21.15.45:0/1841829268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcc4004d10 msgr2=0x7efcc4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:33.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efcdaffd640 1 --2- 172.21.15.45:0/1841829268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcc4004d10 0x7efcc4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:33.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efcdaffd640 1 -- 172.21.15.45:0/1841829268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc4003530 con 0x7efcc4003f00 2023-10-03T19:20:33.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.847+0000 7efcdaffd640 1 --2- 172.21.15.45:0/1841829268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcc4003f00 0x7efcc40047d0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7efcd0009ae0 tx=0x7efcd001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad773a49274cf339 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:33.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efcda7fc640 1 -- 172.21.15.45:0/1841829268 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd00a5680 con 0x7efcc4003f00 2023-10-03T19:20:33.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efcda7fc640 1 -- 172.21.15.45:0/1841829268 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd00a57e0 con 0x7efcc4003f00 2023-10-03T19:20:33.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efcda7fc640 1 -- 172.21.15.45:0/1841829268 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd00a5b90 con 0x7efcc4003f00 2023-10-03T19:20:33.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efce1ed4640 1 -- 172.21.15.45:0/1841829268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcc4003f00 msgr2=0x7efcc40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:33.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efce1ed4640 1 --2- 172.21.15.45:0/1841829268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcc4003f00 0x7efcc40047d0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7efcd0009ae0 tx=0x7efcd001ca90 comp rx=0 tx=0).stop 2023-10-03T19:20:33.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efcdbfff640 1 -- 172.21.15.45:0/1841829268 reap_dead start 2023-10-03T19:20:33.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efce1ed4640 1 -- 172.21.15.45:0/1841829268 shutdown_connections 2023-10-03T19:20:33.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efce1ed4640 1 -- 172.21.15.45:0/1841829268 >> 172.21.15.45:0/1841829268 conn(0x7efcdc0bcf50 msgr2=0x7efcdc0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:33.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efce1ed4640 1 -- 172.21.15.45:0/1841829268 shutdown_connections 2023-10-03T19:20:33.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efce1ed4640 1 -- 172.21.15.45:0/1841829268 wait complete. 2023-10-03T19:20:33.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efce1ed4640 1 Processor -- start 2023-10-03T19:20:33.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efce1ed4640 1 -- start start 2023-10-03T19:20:33.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efce1ed4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efcc4003f00 0x7efcdc0bf890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:33.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efce1ed4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcdc14e2c0 0x7efcdc0b9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:33.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efce1ed4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcdc14de00 0x7efcdc0ba270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:33.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efce1ed4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc14f940 con 0x7efcdc14e2c0 2023-10-03T19:20:33.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efce1ed4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc0b54e0 con 0x7efcdc14de00 2023-10-03T19:20:33.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efce1ed4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc0bfdd0 con 0x7efcc4003f00 2023-10-03T19:20:33.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efcdaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcdc14e2c0 0x7efcdc0b9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:33.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efcdaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcdc14e2c0 0x7efcdc0b9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41338/0 (socket says 172.21.15.45:41338) 2023-10-03T19:20:33.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efcdaffd640 1 -- 172.21.15.45:0/447892582 learned_addr learned my addr 172.21.15.45:0/447892582 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:33.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efcdb7fe640 1 --2- 172.21.15.45:0/447892582 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efcc4003f00 0x7efcdc0bf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:33.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efcdbfff640 1 --2- 172.21.15.45:0/447892582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcdc14de00 0x7efcdc0ba270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:33.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efcdaffd640 1 -- 172.21.15.45:0/447892582 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efcc4003f00 msgr2=0x7efcdc0bf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:33.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efcdaffd640 1 --2- 172.21.15.45:0/447892582 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efcc4003f00 0x7efcdc0bf890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:33.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efcdaffd640 1 -- 172.21.15.45:0/447892582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcdc14de00 msgr2=0x7efcdc0ba270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:33.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efcdaffd640 1 --2- 172.21.15.45:0/447892582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcdc14de00 0x7efcdc0ba270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:33.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efcdaffd640 1 -- 172.21.15.45:0/447892582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc0bc670 con 0x7efcdc14e2c0 2023-10-03T19:20:33.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efcdbfff640 1 --2- 172.21.15.45:0/447892582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcdc14de00 0x7efcdc0ba270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:33.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efcdaffd640 1 --2- 172.21.15.45:0/447892582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcdc14e2c0 0x7efcdc0b9d30 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7efcd0009ae0 tx=0x7efcc4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:33.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efcc3fff640 1 -- 172.21.15.45:0/447892582 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd00bc070 con 0x7efcdc14e2c0 2023-10-03T19:20:33.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efcc3fff640 1 -- 172.21.15.45:0/447892582 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd0004020 con 0x7efcdc14e2c0 2023-10-03T19:20:33.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efce1ed4640 1 -- 172.21.15.45:0/447892582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcdc0a5820 con 0x7efcdc14e2c0 2023-10-03T19:20:33.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efcc3fff640 1 -- 172.21.15.45:0/447892582 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd00043b0 con 0x7efcdc14e2c0 2023-10-03T19:20:33.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.851+0000 7efce1ed4640 1 -- 172.21.15.45:0/447892582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcdc148f60 con 0x7efcdc14e2c0 2023-10-03T19:20:33.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.855+0000 7efce1ed4640 1 -- 172.21.15.45:0/447892582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcdc0720f0 con 0x7efcdc14e2c0 2023-10-03T19:20:33.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.855+0000 7efcc3fff640 1 -- 172.21.15.45:0/447892582 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efcd00b4040 con 0x7efcdc14e2c0 2023-10-03T19:20:33.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.855+0000 7efcc3fff640 1 --2- 172.21.15.45:0/447892582 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efcc80662b0 0x7efcc8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:33.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.855+0000 7efcc3fff640 1 -- 172.21.15.45:0/447892582 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efcd011e2f0 con 0x7efcdc14e2c0 2023-10-03T19:20:33.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.855+0000 7efcdb7fe640 1 --2- 172.21.15.45:0/447892582 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efcc80662b0 0x7efcc8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:33.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.855+0000 7efcdb7fe640 1 --2- 172.21.15.45:0/447892582 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efcc80662b0 0x7efcc8068760 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7efccc001b90 tx=0x7efccc001aa0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:33.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:33.859+0000 7efcc3fff640 1 -- 172.21.15.45:0/447892582 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7efcd00eb7e0 con 0x7efcdc14e2c0 2023-10-03T19:20:34.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:34.047+0000 7efce1ed4640 1 -- 172.21.15.45:0/447892582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efcdc04de80 con 0x7efcdc14e2c0 2023-10-03T19:20:34.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:34.047+0000 7efcc3fff640 1 -- 172.21.15.45:0/447892582 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+3916 (secure 0 0 0) 0x7efcd00eee00 con 0x7efcdc14e2c0 2023-10-03T19:20:34.051 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:20:34.051 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":58,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3566869652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3566869652},{"type":"v1","addr":"172.21.15.79:6835","nonce":3566869652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":7587,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2339652261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2339652261},{"type":"v1","addr":"172.21.15.45:6833","nonce":2339652261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:20:16.301166+0000","modified":"2023-10-03T19:20:19.318778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7602":{"gid":7602,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1723126563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1723126563},{"type":"v1","addr":"172.21.15.45:6835","nonce":1723126563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-10-03T19:20:34.051 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 58 2023-10-03T19:20:34.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:34.047+0000 7efce1ed4640 1 -- 172.21.15.45:0/447892582 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efcc80662b0 msgr2=0x7efcc8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:34.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:34.047+0000 7efce1ed4640 1 --2- 172.21.15.45:0/447892582 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efcc80662b0 0x7efcc8068760 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7efccc001b90 tx=0x7efccc001aa0 comp rx=0 tx=0).stop 2023-10-03T19:20:34.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:34.047+0000 7efce1ed4640 1 -- 172.21.15.45:0/447892582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcdc14e2c0 msgr2=0x7efcdc0b9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:34.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:34.047+0000 7efce1ed4640 1 --2- 172.21.15.45:0/447892582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcdc14e2c0 0x7efcdc0b9d30 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7efcd0009ae0 tx=0x7efcc4005800 comp rx=0 tx=0).stop 2023-10-03T19:20:34.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:34.047+0000 7efce1ed4640 1 -- 172.21.15.45:0/447892582 shutdown_connections 2023-10-03T19:20:34.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:34.047+0000 7efce1ed4640 1 --2- 172.21.15.45:0/447892582 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efcc80662b0 0x7efcc8068760 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:34.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:34.047+0000 7efce1ed4640 1 --2- 172.21.15.45:0/447892582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcdc14de00 0x7efcdc0ba270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:34.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:34.047+0000 7efce1ed4640 1 --2- 172.21.15.45:0/447892582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcdc14e2c0 0x7efcdc0b9d30 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:34.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:34.047+0000 7efce1ed4640 1 --2- 172.21.15.45:0/447892582 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efcc4003f00 0x7efcdc0bf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:34.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:34.047+0000 7efce1ed4640 1 -- 172.21.15.45:0/447892582 >> 172.21.15.45:0/447892582 conn(0x7efcdc0bcf50 msgr2=0x7efcdc143970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:34.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:34.051+0000 7efce1ed4640 1 -- 172.21.15.45:0/447892582 shutdown_connections 2023-10-03T19:20:34.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:34.051+0000 7efce1ed4640 1 -- 172.21.15.45:0/447892582 wait complete. 2023-10-03T19:20:34.070 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session evict 6826 2023-10-03T19:20:34.789 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:2023-10-03T19:20:34.788+0000 7f9c857fa640 -1 client.6826 I was blocklisted at osd epoch 110 2023-10-03T19:20:34.804 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-10-03T19:20:34.934 INFO:tasks.ceph.mds.a.smithi045.stderr: -776> 2023-10-03T19:20:21.896+0000 7f04f6522640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-03T19:20:44.805 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:20:44.806 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:20:44.812 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:20:44.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.943+0000 7f65065c9640 1 Processor -- start 2023-10-03T19:20:44.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.943+0000 7f65065c9640 1 -- start start 2023-10-03T19:20:44.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.943+0000 7f65065c9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f650014c040 0x7f6500070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:44.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.943+0000 7f65065c9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f650006a240 con 0x7f65000a6af0 2023-10-03T19:20:44.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.943+0000 7f65065c9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65000a75e0 con 0x7f65001503e0 2023-10-03T19:20:44.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.943+0000 7f65065c9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65000bc0f0 con 0x7f650014c040 2023-10-03T19:20:44.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.943+0000 7f64ff7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f650014c040 0x7f6500070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:44.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.943+0000 7f64ff7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f650014c040 0x7f6500070b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57998/0 (socket says 172.21.15.45:57998) 2023-10-03T19:20:44.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.943+0000 7f64fffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f65000a6af0 0x7f650014b930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52128/0 (socket says 172.21.15.45:52128) 2023-10-03T19:20:44.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.943+0000 7f64ff7fe640 1 -- 172.21.15.45:0/3204353914 learned_addr learned my addr 172.21.15.45:0/3204353914 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:44.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.943+0000 7f64ff7fe640 1 -- 172.21.15.45:0/3204353914 >> v1:172.21.15.79:6789/0 conn(0x7f65001503e0 legacy=0x7f6500156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:44.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.943+0000 7f64ff7fe640 1 -- 172.21.15.45:0/3204353914 >> v1:172.21.15.45:6789/0 conn(0x7f65000a6af0 legacy=0x7f650014b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:44.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.943+0000 7f64ff7fe640 1 -- 172.21.15.45:0/3204353914 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6500069db0 con 0x7f650014c040 2023-10-03T19:20:44.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.943+0000 7f64feffd640 1 -- 172.21.15.45:0/3204353914 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 243625032 0 0) 0x7f650006a240 con 0x7f65000a6af0 2023-10-03T19:20:44.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.947+0000 7f64ff7fe640 1 --2- 172.21.15.45:0/3204353914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f650014c040 0x7f6500070b50 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f64f4009870 tx=0x7f64f401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e6da0e6e52e54e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:44.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.947+0000 7f64feffd640 1 -- 172.21.15.45:0/3204353914 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f40ab600 con 0x7f650014c040 2023-10-03T19:20:44.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.947+0000 7f64feffd640 1 -- 172.21.15.45:0/3204353914 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f40a7050 con 0x7f650014c040 2023-10-03T19:20:44.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.947+0000 7f64feffd640 1 -- 172.21.15.45:0/3204353914 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f40ab980 con 0x7f650014c040 2023-10-03T19:20:44.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.947+0000 7f65065c9640 1 -- 172.21.15.45:0/3204353914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f650014c040 msgr2=0x7f6500070b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:44.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.947+0000 7f65065c9640 1 --2- 172.21.15.45:0/3204353914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f650014c040 0x7f6500070b50 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f64f4009870 tx=0x7f64f401c500 comp rx=0 tx=0).stop 2023-10-03T19:20:44.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.947+0000 7f65065c9640 1 -- 172.21.15.45:0/3204353914 shutdown_connections 2023-10-03T19:20:44.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.947+0000 7f65065c9640 1 --2- 172.21.15.45:0/3204353914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f650014c040 0x7f6500070b50 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:44.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.947+0000 7f65065c9640 1 -- 172.21.15.45:0/3204353914 >> 172.21.15.45:0/3204353914 conn(0x7f65000bed00 msgr2=0x7f650006d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:44.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.947+0000 7f65065c9640 1 -- 172.21.15.45:0/3204353914 shutdown_connections 2023-10-03T19:20:44.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.947+0000 7f65065c9640 1 -- 172.21.15.45:0/3204353914 wait complete. 2023-10-03T19:20:44.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.947+0000 7f65065c9640 1 Processor -- start 2023-10-03T19:20:44.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.947+0000 7f65065c9640 1 -- start start 2023-10-03T19:20:44.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.947+0000 7f65065c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65000a6af0 0x7f650014a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:44.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.947+0000 7f65065c9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f650014c040 0x7f65000bf760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:44.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.947+0000 7f65065c9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65001503e0 0x7f65000bfca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:44.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.947+0000 7f65065c9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6500140090 con 0x7f65000a6af0 2023-10-03T19:20:44.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.947+0000 7f65065c9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65001e9de0 con 0x7f650014c040 2023-10-03T19:20:44.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.947+0000 7f65065c9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f650013fb60 con 0x7f65001503e0 2023-10-03T19:20:44.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.947+0000 7f64fffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65000a6af0 0x7f650014a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:44.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.947+0000 7f64fffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65000a6af0 0x7f650014a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58006/0 (socket says 172.21.15.45:58006) 2023-10-03T19:20:44.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.947+0000 7f64fffff640 1 -- 172.21.15.45:0/747474271 learned_addr learned my addr 172.21.15.45:0/747474271 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:44.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.947+0000 7f64ff7fe640 1 --2- 172.21.15.45:0/747474271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f650014c040 0x7f65000bf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:44.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.947+0000 7f6504b66640 1 --2- 172.21.15.45:0/747474271 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65001503e0 0x7f65000bfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:44.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.947+0000 7f64fffff640 1 -- 172.21.15.45:0/747474271 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65001503e0 msgr2=0x7f65000bfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:44.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.947+0000 7f64fffff640 1 --2- 172.21.15.45:0/747474271 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65001503e0 0x7f65000bfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:44.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.947+0000 7f64fffff640 1 -- 172.21.15.45:0/747474271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f650014c040 msgr2=0x7f65000bf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:44.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.947+0000 7f64fffff640 1 --2- 172.21.15.45:0/747474271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f650014c040 0x7f65000bf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:44.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.947+0000 7f64fffff640 1 -- 172.21.15.45:0/747474271 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f40094d0 con 0x7f65000a6af0 2023-10-03T19:20:44.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.947+0000 7f64fffff640 1 --2- 172.21.15.45:0/747474271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65000a6af0 0x7f650014a9c0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f64f80011f0 tx=0x7f64f800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:44.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.951+0000 7f64fcff9640 1 -- 172.21.15.45:0/747474271 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f80074e0 con 0x7f65000a6af0 2023-10-03T19:20:44.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.951+0000 7f64fcff9640 1 -- 172.21.15.45:0/747474271 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f8007640 con 0x7f65000a6af0 2023-10-03T19:20:44.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.951+0000 7f65065c9640 1 -- 172.21.15.45:0/747474271 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65000bdd60 con 0x7f65000a6af0 2023-10-03T19:20:44.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.951+0000 7f64fcff9640 1 -- 172.21.15.45:0/747474271 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f8004a10 con 0x7f65000a6af0 2023-10-03T19:20:44.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.951+0000 7f65065c9640 1 -- 172.21.15.45:0/747474271 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f650006b010 con 0x7f65000a6af0 2023-10-03T19:20:44.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.951+0000 7f65065c9640 1 -- 172.21.15.45:0/747474271 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65000a6ec0 con 0x7f65000a6af0 2023-10-03T19:20:44.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.951+0000 7f64fcff9640 1 -- 172.21.15.45:0/747474271 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f64f8004b70 con 0x7f65000a6af0 2023-10-03T19:20:44.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.951+0000 7f64fcff9640 1 --2- 172.21.15.45:0/747474271 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f64ec066280 0x7f64ec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:44.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.951+0000 7f64fcff9640 1 -- 172.21.15.45:0/747474271 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f64f8083610 con 0x7f65000a6af0 2023-10-03T19:20:44.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.951+0000 7f64ff7fe640 1 --2- 172.21.15.45:0/747474271 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f64ec066280 0x7f64ec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:44.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.951+0000 7f64ff7fe640 1 --2- 172.21.15.45:0/747474271 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f64ec066280 0x7f64ec068730 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f64f40ad000 tx=0x7f64f4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:44.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:44.955+0000 7f64fcff9640 1 -- 172.21.15.45:0/747474271 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f64f8050b50 con 0x7f65000a6af0 2023-10-03T19:20:45.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.111+0000 7f65065c9640 1 -- 172.21.15.45:0/747474271 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65000c0d00 con 0x7f65000a6af0 2023-10-03T19:20:45.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.115+0000 7f64fcff9640 1 -- 172.21.15.45:0/747474271 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+18375 (secure 0 0 0) 0x7f64f8054170 con 0x7f65000a6af0 2023-10-03T19:20:45.147 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:20:45.147 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":110,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:20:34.764210+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:20:13.940428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-10-03T19:20:15.290748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:0/2294298422":"2023-10-03T20:20:34.239894+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:20:45.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.115+0000 7f65065c9640 1 -- 172.21.15.45:0/747474271 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f64ec066280 msgr2=0x7f64ec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:45.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.115+0000 7f65065c9640 1 --2- 172.21.15.45:0/747474271 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f64ec066280 0x7f64ec068730 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f64f40ad000 tx=0x7f64f4008040 comp rx=0 tx=0).stop 2023-10-03T19:20:45.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.115+0000 7f65065c9640 1 -- 172.21.15.45:0/747474271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65000a6af0 msgr2=0x7f650014a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:45.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.115+0000 7f65065c9640 1 --2- 172.21.15.45:0/747474271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65000a6af0 0x7f650014a9c0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f64f80011f0 tx=0x7f64f800c9b0 comp rx=0 tx=0).stop 2023-10-03T19:20:45.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.115+0000 7f65065c9640 1 -- 172.21.15.45:0/747474271 shutdown_connections 2023-10-03T19:20:45.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.115+0000 7f65065c9640 1 --2- 172.21.15.45:0/747474271 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f64ec066280 0x7f64ec068730 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:45.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.115+0000 7f65065c9640 1 --2- 172.21.15.45:0/747474271 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65001503e0 0x7f65000bfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:45.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.115+0000 7f65065c9640 1 --2- 172.21.15.45:0/747474271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f650014c040 0x7f65000bf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:45.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.115+0000 7f65065c9640 1 --2- 172.21.15.45:0/747474271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65000a6af0 0x7f650014a9c0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:45.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.115+0000 7f65065c9640 1 -- 172.21.15.45:0/747474271 >> 172.21.15.45:0/747474271 conn(0x7f65000bed00 msgr2=0x7f65000bc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:45.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.115+0000 7f65065c9640 1 -- 172.21.15.45:0/747474271 shutdown_connections 2023-10-03T19:20:45.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.115+0000 7f65065c9640 1 -- 172.21.15.45:0/747474271 wait complete. 2023-10-03T19:20:45.150 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T19:20:13.940428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T19:20:15.290748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:20:45.159 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:20:45.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.283+0000 7ff51db04640 1 Processor -- start 2023-10-03T19:20:45.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.283+0000 7ff51db04640 1 -- start start 2023-10-03T19:20:45.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.283+0000 7ff51db04640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff5180c14e0 0x7ff5180c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:45.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.283+0000 7ff51db04640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff5180c2770 0x7ff5180a9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:45.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.283+0000 7ff51db04640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff51806ac70 con 0x7ff5180bf1f0 2023-10-03T19:20:45.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.283+0000 7ff51db04640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff51806aae0 con 0x7ff5180c14e0 2023-10-03T19:20:45.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.283+0000 7ff51db04640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5180c3000 con 0x7ff5180c2770 2023-10-03T19:20:45.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.283+0000 7ff5177fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff5180c14e0 0x7ff5180c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:45.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.283+0000 7ff5177fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff5180c14e0 0x7ff5180c0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58012/0 (socket says 172.21.15.45:58012) 2023-10-03T19:20:45.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.283+0000 7ff5177fe640 1 -- 172.21.15.45:0/885227525 learned_addr learned my addr 172.21.15.45:0/885227525 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:45.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.283+0000 7ff517fff640 1 --2- 172.21.15.45:0/885227525 >> v2:172.21.15.79:3300/0 conn(0x7ff5180c2770 0x7ff5180a9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:45.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.283+0000 7ff5177fe640 1 -- 172.21.15.45:0/885227525 >> v2:172.21.15.79:3300/0 conn(0x7ff5180c2770 msgr2=0x7ff5180a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:45.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.283+0000 7ff5177fe640 1 --2- 172.21.15.45:0/885227525 >> v2:172.21.15.79:3300/0 conn(0x7ff5180c2770 0x7ff5180a9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:45.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.283+0000 7ff5177fe640 1 -- 172.21.15.45:0/885227525 >> v1:172.21.15.45:6789/0 conn(0x7ff5180bf1f0 legacy=0x7ff5180a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:45.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.283+0000 7ff5177fe640 1 -- 172.21.15.45:0/885227525 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5180aa5f0 con 0x7ff5180c14e0 2023-10-03T19:20:45.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.287+0000 7ff5177fe640 1 --2- 172.21.15.45:0/885227525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5180c14e0 0x7ff5180c0a40 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7ff5180c5910 tx=0x7ff50801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3cbe11bcd5ad17 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:45.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.287+0000 7ff5167fc640 1 -- 172.21.15.45:0/885227525 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5080a89f0 con 0x7ff5180c14e0 2023-10-03T19:20:45.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.287+0000 7ff5167fc640 1 -- 172.21.15.45:0/885227525 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5080a8b50 con 0x7ff5180c14e0 2023-10-03T19:20:45.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.287+0000 7ff5167fc640 1 -- 172.21.15.45:0/885227525 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5080b0440 con 0x7ff5180c14e0 2023-10-03T19:20:45.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.287+0000 7ff51db04640 1 -- 172.21.15.45:0/885227525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5180c14e0 msgr2=0x7ff5180c0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:45.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.287+0000 7ff51db04640 1 --2- 172.21.15.45:0/885227525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5180c14e0 0x7ff5180c0a40 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7ff5180c5910 tx=0x7ff50801ecf0 comp rx=0 tx=0).stop 2023-10-03T19:20:45.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.287+0000 7ff51db04640 1 -- 172.21.15.45:0/885227525 shutdown_connections 2023-10-03T19:20:45.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.287+0000 7ff51db04640 1 --2- 172.21.15.45:0/885227525 >> v2:172.21.15.79:3300/0 conn(0x7ff5180c2770 0x7ff5180a9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:45.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.287+0000 7ff51db04640 1 --2- 172.21.15.45:0/885227525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5180c14e0 0x7ff5180c0a40 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:45.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.287+0000 7ff51db04640 1 -- 172.21.15.45:0/885227525 >> 172.21.15.45:0/885227525 conn(0x7ff5180a6440 msgr2=0x7ff5180a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:45.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.287+0000 7ff51db04640 1 -- 172.21.15.45:0/885227525 shutdown_connections 2023-10-03T19:20:45.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.287+0000 7ff51db04640 1 -- 172.21.15.45:0/885227525 wait complete. 2023-10-03T19:20:45.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.287+0000 7ff51db04640 1 Processor -- start 2023-10-03T19:20:45.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.287+0000 7ff51db04640 1 -- start start 2023-10-03T19:20:45.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.287+0000 7ff51db04640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5180bf1f0 0x7ff5180b9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:45.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.287+0000 7ff51db04640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5180c14e0 0x7ff5180bdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:45.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.287+0000 7ff51db04640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5180c2770 0x7ff5180a3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:45.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.287+0000 7ff51db04640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51809aec0 con 0x7ff5180bf1f0 2023-10-03T19:20:45.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.287+0000 7ff51db04640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5180be740 con 0x7ff5180c14e0 2023-10-03T19:20:45.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.287+0000 7ff51db04640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5180be2b0 con 0x7ff5180c2770 2023-10-03T19:20:45.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.287+0000 7ff5177fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5180bf1f0 0x7ff5180b9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:45.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.287+0000 7ff5177fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5180bf1f0 0x7ff5180b9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58014/0 (socket says 172.21.15.45:58014) 2023-10-03T19:20:45.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.287+0000 7ff5177fe640 1 -- 172.21.15.45:0/3623843470 learned_addr learned my addr 172.21.15.45:0/3623843470 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:45.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.287+0000 7ff517fff640 1 --2- 172.21.15.45:0/3623843470 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5180c2770 0x7ff5180a3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:45.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.287+0000 7ff516ffd640 1 --2- 172.21.15.45:0/3623843470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5180c14e0 0x7ff5180bdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:45.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.287+0000 7ff5177fe640 1 -- 172.21.15.45:0/3623843470 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5180c2770 msgr2=0x7ff5180a3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:45.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.287+0000 7ff5177fe640 1 --2- 172.21.15.45:0/3623843470 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5180c2770 0x7ff5180a3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:45.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.287+0000 7ff5177fe640 1 -- 172.21.15.45:0/3623843470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5180c14e0 msgr2=0x7ff5180bdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:45.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.287+0000 7ff5177fe640 1 --2- 172.21.15.45:0/3623843470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5180c14e0 0x7ff5180bdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:45.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.287+0000 7ff5177fe640 1 -- 172.21.15.45:0/3623843470 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5080094d0 con 0x7ff5180bf1f0 2023-10-03T19:20:45.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.291+0000 7ff5177fe640 1 --2- 172.21.15.45:0/3623843470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5180bf1f0 0x7ff5180b9a80 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7ff50801b900 tx=0x7ff50801ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:45.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.291+0000 7ff4fffff640 1 -- 172.21.15.45:0/3623843470 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5080a89f0 con 0x7ff5180bf1f0 2023-10-03T19:20:45.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.291+0000 7ff4fffff640 1 -- 172.21.15.45:0/3623843470 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5080b9410 con 0x7ff5180bf1f0 2023-10-03T19:20:45.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.291+0000 7ff51db04640 1 -- 172.21.15.45:0/3623843470 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff51814f530 con 0x7ff5180bf1f0 2023-10-03T19:20:45.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.291+0000 7ff4fffff640 1 -- 172.21.15.45:0/3623843470 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5080b97a0 con 0x7ff5180bf1f0 2023-10-03T19:20:45.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.291+0000 7ff51db04640 1 -- 172.21.15.45:0/3623843470 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff51814f250 con 0x7ff5180bf1f0 2023-10-03T19:20:45.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.291+0000 7ff51db04640 1 -- 172.21.15.45:0/3623843470 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff51806b100 con 0x7ff5180bf1f0 2023-10-03T19:20:45.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.291+0000 7ff4fffff640 1 -- 172.21.15.45:0/3623843470 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff5080b7040 con 0x7ff5180bf1f0 2023-10-03T19:20:45.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.291+0000 7ff4fffff640 1 --2- 172.21.15.45:0/3623843470 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff504066280 0x7ff504068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:45.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.291+0000 7ff4fffff640 1 -- 172.21.15.45:0/3623843470 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6105+0+0 (secure 0 0 0) 0x7ff508122300 con 0x7ff5180bf1f0 2023-10-03T19:20:45.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.291+0000 7ff516ffd640 1 --2- 172.21.15.45:0/3623843470 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff504066280 0x7ff504068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:45.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.291+0000 7ff516ffd640 1 --2- 172.21.15.45:0/3623843470 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff504066280 0x7ff504068730 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff5181e15d0 tx=0x7ff50c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:45.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.295+0000 7ff4fffff640 1 -- 172.21.15.45:0/3623843470 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff5080ef8c0 con 0x7ff5180bf1f0 2023-10-03T19:20:45.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.447+0000 7ff51db04640 1 -- 172.21.15.45:0/3623843470 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff51804de80 con 0x7ff5180bf1f0 2023-10-03T19:20:45.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.447+0000 7ff4fffff640 1 -- 172.21.15.45:0/3623843470 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff5080b50a0 con 0x7ff5180bf1f0 2023-10-03T19:20:45.627 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:20:45.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.451+0000 7ff51db04640 1 -- 172.21.15.45:0/3623843470 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff504066280 msgr2=0x7ff504068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:45.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.451+0000 7ff51db04640 1 --2- 172.21.15.45:0/3623843470 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff504066280 0x7ff504068730 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff5181e15d0 tx=0x7ff50c009040 comp rx=0 tx=0).stop 2023-10-03T19:20:45.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.451+0000 7ff51db04640 1 -- 172.21.15.45:0/3623843470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5180bf1f0 msgr2=0x7ff5180b9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:45.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.451+0000 7ff51db04640 1 --2- 172.21.15.45:0/3623843470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5180bf1f0 0x7ff5180b9a80 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7ff50801b900 tx=0x7ff50801ba90 comp rx=0 tx=0).stop 2023-10-03T19:20:45.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.451+0000 7ff51db04640 1 -- 172.21.15.45:0/3623843470 shutdown_connections 2023-10-03T19:20:45.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.451+0000 7ff51db04640 1 --2- 172.21.15.45:0/3623843470 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff504066280 0x7ff504068730 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:45.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.451+0000 7ff51db04640 1 --2- 172.21.15.45:0/3623843470 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5180c2770 0x7ff5180a3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:45.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.451+0000 7ff51db04640 1 --2- 172.21.15.45:0/3623843470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5180c14e0 0x7ff5180bdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:45.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.451+0000 7ff51db04640 1 --2- 172.21.15.45:0/3623843470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5180bf1f0 0x7ff5180b9a80 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:45.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.451+0000 7ff51db04640 1 -- 172.21.15.45:0/3623843470 >> 172.21.15.45:0/3623843470 conn(0x7ff5180a6440 msgr2=0x7ff5180c50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:45.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.451+0000 7ff51db04640 1 -- 172.21.15.45:0/3623843470 shutdown_connections 2023-10-03T19:20:45.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.451+0000 7ff51db04640 1 -- 172.21.15.45:0/3623843470 wait complete. 2023-10-03T19:20:45.630 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:20:45.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a70885640 1 Processor -- start 2023-10-03T19:20:45.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a70885640 1 -- start start 2023-10-03T19:20:45.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a70885640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0a6c0712c0 0x7f0a6c0bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:45.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a70885640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a6c06c2d0 con 0x7f0a6c06d560 2023-10-03T19:20:45.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a70885640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a6c150610 con 0x7f0a6c06c760 2023-10-03T19:20:45.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a70885640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c1508b0 con 0x7f0a6c0712c0 2023-10-03T19:20:45.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a69d9b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0a6c06d560 0x7f0a6c0a53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52142/0 (socket says 172.21.15.45:52142) 2023-10-03T19:20:45.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a69d9b640 1 -- 172.21.15.45:0/3793653696 learned_addr learned my addr 172.21.15.45:0/3793653696 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:20:45.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a6a59c640 1 --2- 172.21.15.45:0/3793653696 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0a6c0712c0 0x7f0a6c0bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:45.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a6959a640 1 -- 172.21.15.45:0/3793653696 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307422593 0 0) 0x7f0a6c06c2d0 con 0x7f0a6c06d560 2023-10-03T19:20:45.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a6959a640 1 -- 172.21.15.45:0/3793653696 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a54003530 con 0x7f0a6c06d560 2023-10-03T19:20:45.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a6959a640 1 -- 172.21.15.45:0/3793653696 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1824431887 0 0) 0x7f0a54003530 con 0x7f0a6c06d560 2023-10-03T19:20:45.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a6959a640 1 -- 172.21.15.45:0/3793653696 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0a6c0712c0 msgr2=0x7f0a6c0bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:45.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a6959a640 1 --2- 172.21.15.45:0/3793653696 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0a6c0712c0 0x7f0a6c0bcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:45.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a6959a640 1 -- 172.21.15.45:0/3793653696 >> v1:172.21.15.79:6789/0 conn(0x7f0a6c06c760 legacy=0x7f0a6c0a5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:45.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a6959a640 1 -- 172.21.15.45:0/3793653696 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6c06d2e0 con 0x7f0a6c06d560 2023-10-03T19:20:45.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a6959a640 1 -- 172.21.15.45:0/3793653696 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f0a60001680 con 0x7f0a6c06d560 2023-10-03T19:20:45.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a6959a640 1 -- 172.21.15.45:0/3793653696 >> v1:172.21.15.45:6789/0 conn(0x7f0a6c06d560 legacy=0x7f0a6c0a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:45.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a6959a640 1 --2- 172.21.15.45:0/3793653696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a540039b0 0x7f0a54003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:45.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a6959a640 1 --2- 172.21.15.45:0/3793653696 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0a6c0712c0 0x7f0a540047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:45.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a6959a640 1 --2- 172.21.15.45:0/3793653696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a54004d10 0x7f0a54005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:45.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a6959a640 1 -- 172.21.15.45:0/3793653696 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c1508b0 con 0x7f0a54004d10 2023-10-03T19:20:45.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a6959a640 1 -- 172.21.15.45:0/3793653696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5400ba40 con 0x7f0a540039b0 2023-10-03T19:20:45.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a6959a640 1 -- 172.21.15.45:0/3793653696 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5400bbd0 con 0x7f0a6c0712c0 2023-10-03T19:20:45.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a6ad9d640 1 --2- 172.21.15.45:0/3793653696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a54004d10 0x7f0a54005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:45.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a6a59c640 1 --2- 172.21.15.45:0/3793653696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a540039b0 0x7f0a54003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:45.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a69d9b640 1 --2- 172.21.15.45:0/3793653696 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0a6c0712c0 0x7f0a540047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:45.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a6ad9d640 1 -- 172.21.15.45:0/3793653696 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0a6c0712c0 msgr2=0x7f0a540047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:45.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a6ad9d640 1 --2- 172.21.15.45:0/3793653696 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0a6c0712c0 0x7f0a540047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:45.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a6ad9d640 1 -- 172.21.15.45:0/3793653696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a540039b0 msgr2=0x7f0a54003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:45.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a6ad9d640 1 --2- 172.21.15.45:0/3793653696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a540039b0 0x7f0a54003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:45.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.763+0000 7f0a6ad9d640 1 -- 172.21.15.45:0/3793653696 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a54003530 con 0x7f0a54004d10 2023-10-03T19:20:45.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.767+0000 7f0a6ad9d640 1 --2- 172.21.15.45:0/3793653696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a54004d10 0x7f0a54005180 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f0a64001e40 tx=0x7f0a6401c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6206c9d6cf40c84c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:45.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.767+0000 7f0a6959a640 1 -- 172.21.15.45:0/3793653696 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a64003b80 con 0x7f0a54004d10 2023-10-03T19:20:45.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.767+0000 7f0a6959a640 1 -- 172.21.15.45:0/3793653696 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a64003ce0 con 0x7f0a54004d10 2023-10-03T19:20:45.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.767+0000 7f0a6959a640 1 -- 172.21.15.45:0/3793653696 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a640052c0 con 0x7f0a54004d10 2023-10-03T19:20:45.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.767+0000 7f0a70885640 1 -- 172.21.15.45:0/3793653696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a54004d10 msgr2=0x7f0a54005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:45.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.767+0000 7f0a70885640 1 --2- 172.21.15.45:0/3793653696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a54004d10 0x7f0a54005180 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f0a64001e40 tx=0x7f0a6401c740 comp rx=0 tx=0).stop 2023-10-03T19:20:45.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.767+0000 7f0a6ad9d640 1 -- 172.21.15.45:0/3793653696 reap_dead start 2023-10-03T19:20:45.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.767+0000 7f0a70885640 1 -- 172.21.15.45:0/3793653696 shutdown_connections 2023-10-03T19:20:45.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.767+0000 7f0a70885640 1 -- 172.21.15.45:0/3793653696 >> 172.21.15.45:0/3793653696 conn(0x7f0a6c0a20d0 msgr2=0x7f0a6c0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:45.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.767+0000 7f0a70885640 1 -- 172.21.15.45:0/3793653696 shutdown_connections 2023-10-03T19:20:45.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.767+0000 7f0a70885640 1 -- 172.21.15.45:0/3793653696 wait complete. 2023-10-03T19:20:45.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.767+0000 7f0a70885640 1 Processor -- start 2023-10-03T19:20:45.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.767+0000 7f0a70885640 1 -- start start 2023-10-03T19:20:45.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.771+0000 7f0a70885640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a54004d10 0x7f0a6c143010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:45.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.771+0000 7f0a70885640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a6c14cf00 0x7f0a6c14e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:45.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.771+0000 7f0a70885640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0a6c14a460 0x7f0a6c141660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:45.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.771+0000 7f0a70885640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c143870 con 0x7f0a54004d10 2023-10-03T19:20:45.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.771+0000 7f0a70885640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c14b8c0 con 0x7f0a6c14cf00 2023-10-03T19:20:45.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.771+0000 7f0a70885640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c142b80 con 0x7f0a6c14a460 2023-10-03T19:20:45.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.771+0000 7f0a6a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a54004d10 0x7f0a6c143010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:45.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.771+0000 7f0a6a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a54004d10 0x7f0a6c143010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58026/0 (socket says 172.21.15.45:58026) 2023-10-03T19:20:45.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.771+0000 7f0a6a59c640 1 -- 172.21.15.45:0/1260604216 learned_addr learned my addr 172.21.15.45:0/1260604216 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:45.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.771+0000 7f0a6ad9d640 1 --2- 172.21.15.45:0/1260604216 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0a6c14a460 0x7f0a6c141660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:45.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.771+0000 7f0a69d9b640 1 --2- 172.21.15.45:0/1260604216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a6c14cf00 0x7f0a6c14e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:45.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.771+0000 7f0a6a59c640 1 -- 172.21.15.45:0/1260604216 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0a6c14a460 msgr2=0x7f0a6c141660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:45.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.771+0000 7f0a6a59c640 1 --2- 172.21.15.45:0/1260604216 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0a6c14a460 0x7f0a6c141660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:45.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.771+0000 7f0a6a59c640 1 -- 172.21.15.45:0/1260604216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a6c14cf00 msgr2=0x7f0a6c14e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:45.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.771+0000 7f0a6a59c640 1 --2- 172.21.15.45:0/1260604216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a6c14cf00 0x7f0a6c14e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:45.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.771+0000 7f0a6a59c640 1 -- 172.21.15.45:0/1260604216 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6c071690 con 0x7f0a54004d10 2023-10-03T19:20:45.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.771+0000 7f0a69d9b640 1 --2- 172.21.15.45:0/1260604216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a6c14cf00 0x7f0a6c14e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:45.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.771+0000 7f0a6a59c640 1 --2- 172.21.15.45:0/1260604216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a54004d10 0x7f0a6c143010 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c0115e0 tx=0x7f0a5c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:45.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.771+0000 7f0a5affd640 1 -- 172.21.15.45:0/1260604216 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c00f8f0 con 0x7f0a54004d10 2023-10-03T19:20:45.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.771+0000 7f0a5affd640 1 -- 172.21.15.45:0/1260604216 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5c00fa50 con 0x7f0a54004d10 2023-10-03T19:20:45.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.771+0000 7f0a70885640 1 -- 172.21.15.45:0/1260604216 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a6c06cf40 con 0x7f0a54004d10 2023-10-03T19:20:45.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.771+0000 7f0a5affd640 1 -- 172.21.15.45:0/1260604216 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c00fdc0 con 0x7f0a54004d10 2023-10-03T19:20:45.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.771+0000 7f0a70885640 1 -- 172.21.15.45:0/1260604216 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6c071820 con 0x7f0a54004d10 2023-10-03T19:20:45.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.771+0000 7f0a70885640 1 -- 172.21.15.45:0/1260604216 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a6c04de80 con 0x7f0a54004d10 2023-10-03T19:20:45.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.771+0000 7f0a5affd640 1 -- 172.21.15.45:0/1260604216 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0a5c015460 con 0x7f0a54004d10 2023-10-03T19:20:45.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.771+0000 7f0a5affd640 1 --2- 172.21.15.45:0/1260604216 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0a4c066280 0x7f0a4c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:45.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.771+0000 7f0a5affd640 1 -- 172.21.15.45:0/1260604216 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f0a5c0842c0 con 0x7f0a54004d10 2023-10-03T19:20:45.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.771+0000 7f0a69d9b640 1 --2- 172.21.15.45:0/1260604216 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0a4c066280 0x7f0a4c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:45.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.775+0000 7f0a69d9b640 1 --2- 172.21.15.45:0/1260604216 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0a4c066280 0x7f0a4c068730 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0a60000f70 tx=0x7f0a60000f00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:45.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.775+0000 7f0a5affd640 1 -- 172.21.15.45:0/1260604216 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0a5c051710 con 0x7f0a54004d10 2023-10-03T19:20:45.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.931+0000 7f0a70885640 1 -- 172.21.15.45:0/1260604216 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0a6c0ba5a0 con 0x7f0a54004d10 2023-10-03T19:20:45.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.931+0000 7f0a5affd640 1 -- 172.21.15.45:0/1260604216 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v110) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0a5c054d30 con 0x7f0a54004d10 2023-10-03T19:20:45.937 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:20:45.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.935+0000 7f0a70885640 1 -- 172.21.15.45:0/1260604216 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0a4c066280 msgr2=0x7f0a4c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:45.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.935+0000 7f0a70885640 1 --2- 172.21.15.45:0/1260604216 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0a4c066280 0x7f0a4c068730 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0a60000f70 tx=0x7f0a60000f00 comp rx=0 tx=0).stop 2023-10-03T19:20:45.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.935+0000 7f0a70885640 1 -- 172.21.15.45:0/1260604216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a54004d10 msgr2=0x7f0a6c143010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:45.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.935+0000 7f0a70885640 1 --2- 172.21.15.45:0/1260604216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a54004d10 0x7f0a6c143010 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c0115e0 tx=0x7f0a5c011aa0 comp rx=0 tx=0).stop 2023-10-03T19:20:45.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.935+0000 7f0a70885640 1 -- 172.21.15.45:0/1260604216 shutdown_connections 2023-10-03T19:20:45.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.935+0000 7f0a70885640 1 --2- 172.21.15.45:0/1260604216 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0a4c066280 0x7f0a4c068730 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:45.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.935+0000 7f0a70885640 1 --2- 172.21.15.45:0/1260604216 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0a6c14a460 0x7f0a6c141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:45.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.935+0000 7f0a70885640 1 --2- 172.21.15.45:0/1260604216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a6c14cf00 0x7f0a6c14e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:45.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.935+0000 7f0a70885640 1 --2- 172.21.15.45:0/1260604216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a54004d10 0x7f0a6c143010 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:45.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.935+0000 7f0a70885640 1 -- 172.21.15.45:0/1260604216 >> 172.21.15.45:0/1260604216 conn(0x7f0a6c0a20d0 msgr2=0x7f0a6c0c0440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:45.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.935+0000 7f0a70885640 1 -- 172.21.15.45:0/1260604216 shutdown_connections 2023-10-03T19:20:45.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:45.935+0000 7f0a70885640 1 -- 172.21.15.45:0/1260604216 wait complete. 2023-10-03T19:20:45.956 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T19:20:46.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.083+0000 7fc317303640 1 Processor -- start 2023-10-03T19:20:46.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.083+0000 7fc317303640 1 -- start start 2023-10-03T19:20:46.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.083+0000 7fc317303640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3100712c0 0x7fc3100bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:46.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.083+0000 7fc317303640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc31006c760 0x7fc3100bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:46.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.083+0000 7fc317303640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc31006c2d0 con 0x7fc31006d560 2023-10-03T19:20:46.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.083+0000 7fc317303640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc310150610 con 0x7fc31006c760 2023-10-03T19:20:46.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.083+0000 7fc317303640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3101508b0 con 0x7fc3100712c0 2023-10-03T19:20:46.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.083+0000 7fc31489e640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc31006d560 0x7fc3100a53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52146/0 (socket says 172.21.15.45:52146) 2023-10-03T19:20:46.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.083+0000 7fc31489e640 1 -- 172.21.15.45:0/1343209881 learned_addr learned my addr 172.21.15.45:0/1343209881 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:20:46.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.083+0000 7fc3158a0640 1 --2- 172.21.15.45:0/1343209881 >> v2:172.21.15.45:3300/0 conn(0x7fc31006c760 0x7fc3100bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:46.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.083+0000 7fc31509f640 1 --2- 172.21.15.45:0/1343209881 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3100712c0 0x7fc3100bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:46.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.083+0000 7fc30ffff640 1 -- 172.21.15.45:0/1343209881 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642436715 0 0) 0x7fc31006c2d0 con 0x7fc31006d560 2023-10-03T19:20:46.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.083+0000 7fc30ffff640 1 -- 172.21.15.45:0/1343209881 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc300003530 con 0x7fc31006d560 2023-10-03T19:20:46.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.083+0000 7fc3158a0640 1 -- 172.21.15.45:0/1343209881 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3100712c0 msgr2=0x7fc3100bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:46.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.083+0000 7fc3158a0640 1 --2- 172.21.15.45:0/1343209881 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3100712c0 0x7fc3100bcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:46.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.083+0000 7fc3158a0640 1 -- 172.21.15.45:0/1343209881 >> v1:172.21.15.45:6789/0 conn(0x7fc31006d560 legacy=0x7fc3100a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:46.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.083+0000 7fc3158a0640 1 -- 172.21.15.45:0/1343209881 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31006d2e0 con 0x7fc31006c760 2023-10-03T19:20:46.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.087+0000 7fc3158a0640 1 --2- 172.21.15.45:0/1343209881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc31006c760 0x7fc3100bd100 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fc3040097c0 tx=0x7fc30401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=881302c38feb2e22 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:46.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.087+0000 7fc30ffff640 1 -- 172.21.15.45:0/1343209881 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3040ac620 con 0x7fc31006c760 2023-10-03T19:20:46.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.087+0000 7fc30ffff640 1 -- 172.21.15.45:0/1343209881 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3040ac780 con 0x7fc31006c760 2023-10-03T19:20:46.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.087+0000 7fc30ffff640 1 -- 172.21.15.45:0/1343209881 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3040acaf0 con 0x7fc31006c760 2023-10-03T19:20:46.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.087+0000 7fc317303640 1 -- 172.21.15.45:0/1343209881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc31006c760 msgr2=0x7fc3100bd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:46.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.087+0000 7fc317303640 1 --2- 172.21.15.45:0/1343209881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc31006c760 0x7fc3100bd100 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fc3040097c0 tx=0x7fc30401c480 comp rx=0 tx=0).stop 2023-10-03T19:20:46.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.087+0000 7fc317303640 1 -- 172.21.15.45:0/1343209881 shutdown_connections 2023-10-03T19:20:46.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.087+0000 7fc317303640 1 --2- 172.21.15.45:0/1343209881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc31006c760 0x7fc3100bd100 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:46.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.087+0000 7fc317303640 1 --2- 172.21.15.45:0/1343209881 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3100712c0 0x7fc3100bcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:46.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.087+0000 7fc317303640 1 -- 172.21.15.45:0/1343209881 >> 172.21.15.45:0/1343209881 conn(0x7fc3100a20d0 msgr2=0x7fc3100a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:46.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.087+0000 7fc317303640 1 -- 172.21.15.45:0/1343209881 shutdown_connections 2023-10-03T19:20:46.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.087+0000 7fc317303640 1 -- 172.21.15.45:0/1343209881 wait complete. 2023-10-03T19:20:46.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.087+0000 7fc317303640 1 Processor -- start 2023-10-03T19:20:46.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.087+0000 7fc317303640 1 -- start start 2023-10-03T19:20:46.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.087+0000 7fc317303640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc31006c760 0x7fc3101515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:46.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.087+0000 7fc317303640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc31006d560 0x7fc3100b8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:46.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.087+0000 7fc317303640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3100712c0 0x7fc3101e47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:46.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.087+0000 7fc317303640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc310152160 con 0x7fc31006c760 2023-10-03T19:20:46.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.087+0000 7fc317303640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc310151ae0 con 0x7fc3100712c0 2023-10-03T19:20:46.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.087+0000 7fc317303640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3100b8eb0 con 0x7fc31006d560 2023-10-03T19:20:46.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.087+0000 7fc31509f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc31006c760 0x7fc3101515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:46.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.087+0000 7fc31509f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc31006c760 0x7fc3101515a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58046/0 (socket says 172.21.15.45:58046) 2023-10-03T19:20:46.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.087+0000 7fc31509f640 1 -- 172.21.15.45:0/3429313841 learned_addr learned my addr 172.21.15.45:0/3429313841 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:46.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.091+0000 7fc31489e640 1 --2- 172.21.15.45:0/3429313841 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc31006d560 0x7fc3100b8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:46.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.091+0000 7fc3158a0640 1 --2- 172.21.15.45:0/3429313841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3100712c0 0x7fc3101e47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:46.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.091+0000 7fc31509f640 1 -- 172.21.15.45:0/3429313841 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc31006d560 msgr2=0x7fc3100b8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:46.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.091+0000 7fc31509f640 1 --2- 172.21.15.45:0/3429313841 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc31006d560 0x7fc3100b8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:46.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.091+0000 7fc31509f640 1 -- 172.21.15.45:0/3429313841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3100712c0 msgr2=0x7fc3101e47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:46.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.091+0000 7fc31509f640 1 --2- 172.21.15.45:0/3429313841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3100712c0 0x7fc3101e47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:46.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.091+0000 7fc31509f640 1 -- 172.21.15.45:0/3429313841 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc304009420 con 0x7fc31006c760 2023-10-03T19:20:46.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.091+0000 7fc3158a0640 1 --2- 172.21.15.45:0/3429313841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3100712c0 0x7fc3101e47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:46.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.091+0000 7fc31509f640 1 --2- 172.21.15.45:0/3429313841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc31006c760 0x7fc3101515a0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc00e870 tx=0x7fc2fc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:46.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.091+0000 7fc30dffb640 1 -- 172.21.15.45:0/3429313841 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc009510 con 0x7fc31006c760 2023-10-03T19:20:46.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.091+0000 7fc30dffb640 1 -- 172.21.15.45:0/3429313841 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2fc00eec0 con 0x7fc31006c760 2023-10-03T19:20:46.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.091+0000 7fc317303640 1 -- 172.21.15.45:0/3429313841 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3100a6070 con 0x7fc31006c760 2023-10-03T19:20:46.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.091+0000 7fc30dffb640 1 -- 172.21.15.45:0/3429313841 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc00cb40 con 0x7fc31006c760 2023-10-03T19:20:46.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.091+0000 7fc317303640 1 -- 172.21.15.45:0/3429313841 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3100a5ee0 con 0x7fc31006c760 2023-10-03T19:20:46.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.091+0000 7fc317303640 1 -- 172.21.15.45:0/3429313841 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3101596f0 con 0x7fc31006c760 2023-10-03T19:20:46.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.091+0000 7fc30dffb640 1 -- 172.21.15.45:0/3429313841 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc2fc00cca0 con 0x7fc31006c760 2023-10-03T19:20:46.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.091+0000 7fc30dffb640 1 --2- 172.21.15.45:0/3429313841 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc2f4066280 0x7fc2f4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:46.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.091+0000 7fc30dffb640 1 -- 172.21.15.45:0/3429313841 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fc2fc083f40 con 0x7fc31006c760 2023-10-03T19:20:46.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.091+0000 7fc31489e640 1 --2- 172.21.15.45:0/3429313841 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc2f4066280 0x7fc2f4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:46.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.091+0000 7fc31489e640 1 --2- 172.21.15.45:0/3429313841 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc2f4066280 0x7fc2f4068730 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc310152a30 tx=0x7fc308009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:46.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.095+0000 7fc30dffb640 1 -- 172.21.15.45:0/3429313841 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc2fc051300 con 0x7fc31006c760 2023-10-03T19:20:46.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.247+0000 7fc317303640 1 -- 172.21.15.45:0/3429313841 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc3100bd1f0 con 0x7fc31006c760 2023-10-03T19:20:46.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.251+0000 7fc30dffb640 1 -- 172.21.15.45:0/3429313841 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v110) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc2fc021020 con 0x7fc31006c760 2023-10-03T19:20:46.295 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-03T19:20:46.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.251+0000 7fc317303640 1 -- 172.21.15.45:0/3429313841 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc2f4066280 msgr2=0x7fc2f4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:46.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.251+0000 7fc317303640 1 --2- 172.21.15.45:0/3429313841 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc2f4066280 0x7fc2f4068730 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc310152a30 tx=0x7fc308009040 comp rx=0 tx=0).stop 2023-10-03T19:20:46.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.251+0000 7fc317303640 1 -- 172.21.15.45:0/3429313841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc31006c760 msgr2=0x7fc3101515a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:46.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.251+0000 7fc317303640 1 --2- 172.21.15.45:0/3429313841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc31006c760 0x7fc3101515a0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc00e870 tx=0x7fc2fc00ec70 comp rx=0 tx=0).stop 2023-10-03T19:20:46.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.251+0000 7fc317303640 1 -- 172.21.15.45:0/3429313841 shutdown_connections 2023-10-03T19:20:46.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.251+0000 7fc317303640 1 --2- 172.21.15.45:0/3429313841 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc2f4066280 0x7fc2f4068730 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:46.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.251+0000 7fc317303640 1 --2- 172.21.15.45:0/3429313841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3100712c0 0x7fc3101e47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:46.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.251+0000 7fc317303640 1 --2- 172.21.15.45:0/3429313841 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc31006d560 0x7fc3100b8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:46.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.251+0000 7fc317303640 1 --2- 172.21.15.45:0/3429313841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc31006c760 0x7fc3101515a0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:46.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.251+0000 7fc317303640 1 -- 172.21.15.45:0/3429313841 >> 172.21.15.45:0/3429313841 conn(0x7fc3100a20d0 msgr2=0x7fc3100be010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:46.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.251+0000 7fc317303640 1 -- 172.21.15.45:0/3429313841 shutdown_connections 2023-10-03T19:20:46.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.251+0000 7fc317303640 1 -- 172.21.15.45:0/3429313841 wait complete. 2023-10-03T19:20:46.297 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T19:20:46.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.423+0000 7f282e726640 1 Processor -- start 2023-10-03T19:20:46.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.423+0000 7f282e726640 1 -- start start 2023-10-03T19:20:46.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.423+0000 7f282e726640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2828148540 0x7f28280bb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:46.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.423+0000 7f282e726640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f282806d630 0x7f282814e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:46.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.423+0000 7f282e726640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28280bcf80 con 0x7f28280bb5a0 2023-10-03T19:20:46.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.423+0000 7f282e726640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2828152b50 con 0x7f2828148540 2023-10-03T19:20:46.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.423+0000 7f282e726640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f282814e550 con 0x7f282806d630 2023-10-03T19:20:46.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.423+0000 7f2827fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2828148540 0x7f28280bb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:46.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.423+0000 7f2827fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2828148540 0x7f28280bb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58060/0 (socket says 172.21.15.45:58060) 2023-10-03T19:20:46.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.423+0000 7f2827fff640 1 -- 172.21.15.45:0/2556877120 learned_addr learned my addr 172.21.15.45:0/2556877120 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:46.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.423+0000 7f281ffff640 1 --2- 172.21.15.45:0/2556877120 >> v2:172.21.15.79:3300/0 conn(0x7f282806d630 0x7f282814e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:46.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.423+0000 7f2827fff640 1 -- 172.21.15.45:0/2556877120 >> v2:172.21.15.79:3300/0 conn(0x7f282806d630 msgr2=0x7f282814e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:46.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.423+0000 7f2827fff640 1 --2- 172.21.15.45:0/2556877120 >> v2:172.21.15.79:3300/0 conn(0x7f282806d630 0x7f282814e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:46.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.423+0000 7f2827fff640 1 -- 172.21.15.45:0/2556877120 >> v1:172.21.15.79:6789/0 conn(0x7f28280bb5a0 legacy=0x7f282814eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:20:46.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.423+0000 7f2827fff640 1 -- 172.21.15.45:0/2556877120 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28280bd260 con 0x7f2828148540 2023-10-03T19:20:46.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.423+0000 7f281ffff640 1 --2- 172.21.15.45:0/2556877120 >> v2:172.21.15.79:3300/0 conn(0x7f282806d630 0x7f282814e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:46.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f2827fff640 1 --2- 172.21.15.45:0/2556877120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2828148540 0x7f28280bb060 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f28280a6690 tx=0x7f281801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ab8f1d99d5259 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:46.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f28277fe640 1 -- 172.21.15.45:0/2556877120 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28180ac620 con 0x7f2828148540 2023-10-03T19:20:46.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f28277fe640 1 -- 172.21.15.45:0/2556877120 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28180ac780 con 0x7f2828148540 2023-10-03T19:20:46.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f28277fe640 1 -- 172.21.15.45:0/2556877120 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28180acb10 con 0x7f2828148540 2023-10-03T19:20:46.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f282e726640 1 -- 172.21.15.45:0/2556877120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2828148540 msgr2=0x7f28280bb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:46.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f282e726640 1 --2- 172.21.15.45:0/2556877120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2828148540 0x7f28280bb060 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f28280a6690 tx=0x7f281801c490 comp rx=0 tx=0).stop 2023-10-03T19:20:46.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f282e726640 1 -- 172.21.15.45:0/2556877120 shutdown_connections 2023-10-03T19:20:46.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f282e726640 1 --2- 172.21.15.45:0/2556877120 >> v2:172.21.15.79:3300/0 conn(0x7f282806d630 0x7f282814e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:46.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f282e726640 1 --2- 172.21.15.45:0/2556877120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2828148540 0x7f28280bb060 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:46.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f282e726640 1 -- 172.21.15.45:0/2556877120 >> 172.21.15.45:0/2556877120 conn(0x7f28280a20d0 msgr2=0x7f28280a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:46.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f282e726640 1 -- 172.21.15.45:0/2556877120 shutdown_connections 2023-10-03T19:20:46.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f282e726640 1 -- 172.21.15.45:0/2556877120 wait complete. 2023-10-03T19:20:46.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f282e726640 1 Processor -- start 2023-10-03T19:20:46.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f282e726640 1 -- start start 2023-10-03T19:20:46.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f282e726640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f282806d630 0x7f2828148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:46.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f282e726640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28280bb5a0 0x7f2828147850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:46.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f282e726640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2828148540 0x7f282814aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:46.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f282e726640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2828147d90 con 0x7f2828148540 2023-10-03T19:20:46.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f282e726640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282814a590 con 0x7f282806d630 2023-10-03T19:20:46.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f282e726640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28281eaca0 con 0x7f28280bb5a0 2023-10-03T19:20:46.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f282ccc3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2828148540 0x7f282814aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:46.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f282ccc3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2828148540 0x7f282814aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58066/0 (socket says 172.21.15.45:58066) 2023-10-03T19:20:46.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f282ccc3640 1 -- 172.21.15.45:0/3825680668 learned_addr learned my addr 172.21.15.45:0/3825680668 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:46.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f2827fff640 1 --2- 172.21.15.45:0/3825680668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f282806d630 0x7f2828148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:46.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f281ffff640 1 --2- 172.21.15.45:0/3825680668 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28280bb5a0 0x7f2828147850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:46.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f282ccc3640 1 -- 172.21.15.45:0/3825680668 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28280bb5a0 msgr2=0x7f2828147850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:46.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f282ccc3640 1 --2- 172.21.15.45:0/3825680668 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28280bb5a0 0x7f2828147850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:46.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f282ccc3640 1 -- 172.21.15.45:0/3825680668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f282806d630 msgr2=0x7f2828148c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:46.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f282ccc3640 1 --2- 172.21.15.45:0/3825680668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f282806d630 0x7f2828148c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:46.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f282ccc3640 1 -- 172.21.15.45:0/3825680668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28180094d0 con 0x7f2828148540 2023-10-03T19:20:46.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f282ccc3640 1 --2- 172.21.15.45:0/3825680668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2828148540 0x7f282814aa70 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f282000c780 tx=0x7f282000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:46.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f28257fa640 1 -- 172.21.15.45:0/3825680668 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282000a9f0 con 0x7f2828148540 2023-10-03T19:20:46.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f28257fa640 1 -- 172.21.15.45:0/3825680668 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282000ce90 con 0x7f2828148540 2023-10-03T19:20:46.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f282e726640 1 -- 172.21.15.45:0/3825680668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28280bdda0 con 0x7f2828148540 2023-10-03T19:20:46.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f28257fa640 1 -- 172.21.15.45:0/3825680668 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282000add0 con 0x7f2828148540 2023-10-03T19:20:46.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.427+0000 7f282e726640 1 -- 172.21.15.45:0/3825680668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28280bdc10 con 0x7f2828148540 2023-10-03T19:20:46.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.431+0000 7f282e726640 1 -- 172.21.15.45:0/3825680668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2828152350 con 0x7f2828148540 2023-10-03T19:20:46.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.431+0000 7f28257fa640 1 -- 172.21.15.45:0/3825680668 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2820012420 con 0x7f2828148540 2023-10-03T19:20:46.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.431+0000 7f28257fa640 1 --2- 172.21.15.45:0/3825680668 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f28080662b0 0x7f2808068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:46.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.431+0000 7f28257fa640 1 -- 172.21.15.45:0/3825680668 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f2820083fc0 con 0x7f2828148540 2023-10-03T19:20:46.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.431+0000 7f2827fff640 1 --2- 172.21.15.45:0/3825680668 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f28080662b0 0x7f2808068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:46.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.431+0000 7f2827fff640 1 --2- 172.21.15.45:0/3825680668 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f28080662b0 0x7f2808068760 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f28180ae000 tx=0x7f2818009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:46.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.435+0000 7f28257fa640 1 -- 172.21.15.45:0/3825680668 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2820051370 con 0x7f2828148540 2023-10-03T19:20:46.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.591+0000 7f282e726640 1 -- 172.21.15.45:0/3825680668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f282814a760 con 0x7f2828148540 2023-10-03T19:20:46.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.591+0000 7f28257fa640 1 -- 172.21.15.45:0/3825680668 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v110) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2820016020 con 0x7f2828148540 2023-10-03T19:20:46.623 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-03T19:20:46.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.595+0000 7f282e726640 1 -- 172.21.15.45:0/3825680668 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f28080662b0 msgr2=0x7f2808068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:46.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.595+0000 7f282e726640 1 --2- 172.21.15.45:0/3825680668 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f28080662b0 0x7f2808068760 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f28180ae000 tx=0x7f2818009040 comp rx=0 tx=0).stop 2023-10-03T19:20:46.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.595+0000 7f282e726640 1 -- 172.21.15.45:0/3825680668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2828148540 msgr2=0x7f282814aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:46.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.595+0000 7f282e726640 1 --2- 172.21.15.45:0/3825680668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2828148540 0x7f282814aa70 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f282000c780 tx=0x7f282000cc40 comp rx=0 tx=0).stop 2023-10-03T19:20:46.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.595+0000 7f282e726640 1 -- 172.21.15.45:0/3825680668 shutdown_connections 2023-10-03T19:20:46.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.595+0000 7f282e726640 1 --2- 172.21.15.45:0/3825680668 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f28080662b0 0x7f2808068760 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:46.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.595+0000 7f282e726640 1 --2- 172.21.15.45:0/3825680668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2828148540 0x7f282814aa70 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:46.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.595+0000 7f282e726640 1 --2- 172.21.15.45:0/3825680668 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28280bb5a0 0x7f2828147850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:46.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.595+0000 7f282e726640 1 --2- 172.21.15.45:0/3825680668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f282806d630 0x7f2828148c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:46.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.595+0000 7f282e726640 1 -- 172.21.15.45:0/3825680668 >> 172.21.15.45:0/3825680668 conn(0x7f28280a20d0 msgr2=0x7f282814fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:46.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.595+0000 7f282e726640 1 -- 172.21.15.45:0/3825680668 shutdown_connections 2023-10-03T19:20:46.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.595+0000 7f282e726640 1 -- 172.21.15.45:0/3825680668 wait complete. 2023-10-03T19:20:46.625 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-03T19:20:46.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.751+0000 7f4da9d86640 1 Processor -- start 2023-10-03T19:20:46.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.755+0000 7f4da9d86640 1 -- start start 2023-10-03T19:20:46.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.755+0000 7f4da9d86640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4da406f170 0x7f4da4150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:46.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.755+0000 7f4da9d86640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da406cac0 con 0x7f4da406d170 2023-10-03T19:20:46.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.755+0000 7f4da9d86640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da40720d0 con 0x7f4da40bc8b0 2023-10-03T19:20:46.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.755+0000 7f4da9d86640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da40a5ab0 con 0x7f4da406f170 2023-10-03T19:20:46.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.755+0000 7f4da37fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4da406f170 0x7f4da4150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:46.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.755+0000 7f4da3fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4da406d170 0x7f4da4156e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52160/0 (socket says 172.21.15.45:52160) 2023-10-03T19:20:46.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.755+0000 7f4da3fff640 1 -- 172.21.15.45:0/4069865411 learned_addr learned my addr 172.21.15.45:0/4069865411 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:20:46.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.755+0000 7f4da37fe640 1 -- 172.21.15.45:0/4069865411 >> v1:172.21.15.79:6789/0 conn(0x7f4da40bc8b0 legacy=0x7f4da414ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:46.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.755+0000 7f4da37fe640 1 -- 172.21.15.45:0/4069865411 >> v1:172.21.15.45:6789/0 conn(0x7f4da406d170 legacy=0x7f4da4156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:46.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.755+0000 7f4da27fc640 1 -- 172.21.15.45:0/4069865411 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1979588882 0 0) 0x7f4d9c0014a0 con 0x7f4da406d170 2023-10-03T19:20:46.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.755+0000 7f4da37fe640 1 -- 172.21.15.45:0/4069865411 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da406cd00 con 0x7f4da406f170 2023-10-03T19:20:46.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.755+0000 7f4da37fe640 1 --2- 172.21.15.45:0/4069865411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4da406f170 0x7f4da4150190 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f4d940097c0 tx=0x7f4d9401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6344ba3ddd2cfc58 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:46.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4da27fc640 1 -- 172.21.15.45:0/4069865411 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d940a8970 con 0x7f4da406f170 2023-10-03T19:20:46.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4da27fc640 1 -- 172.21.15.45:0/4069865411 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d940a8ad0 con 0x7f4da406f170 2023-10-03T19:20:46.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4da27fc640 1 -- 172.21.15.45:0/4069865411 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d940a8e60 con 0x7f4da406f170 2023-10-03T19:20:46.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4da9d86640 1 -- 172.21.15.45:0/4069865411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4da406f170 msgr2=0x7f4da4150190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:46.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4da9d86640 1 --2- 172.21.15.45:0/4069865411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4da406f170 0x7f4da4150190 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f4d940097c0 tx=0x7f4d9401ec70 comp rx=0 tx=0).stop 2023-10-03T19:20:46.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4da9d86640 1 -- 172.21.15.45:0/4069865411 shutdown_connections 2023-10-03T19:20:46.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4da9d86640 1 --2- 172.21.15.45:0/4069865411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4da406f170 0x7f4da4150190 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:46.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4da9d86640 1 -- 172.21.15.45:0/4069865411 >> 172.21.15.45:0/4069865411 conn(0x7f4da40bcf50 msgr2=0x7f4da40bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:46.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4da9d86640 1 -- 172.21.15.45:0/4069865411 shutdown_connections 2023-10-03T19:20:46.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4da9d86640 1 -- 172.21.15.45:0/4069865411 wait complete. 2023-10-03T19:20:46.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4da9d86640 1 Processor -- start 2023-10-03T19:20:46.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4da9d86640 1 -- start start 2023-10-03T19:20:46.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4da9d86640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4da406d170 0x7f4da41d6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:46.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4da9d86640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4da406f170 0x7f4da41e15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:46.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4da9d86640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4da40bc8b0 0x7f4da40b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:46.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4da9d86640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da40b68d0 con 0x7f4da406d170 2023-10-03T19:20:46.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4da9d86640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da41d6a60 con 0x7f4da40bc8b0 2023-10-03T19:20:46.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4da9d86640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da41e1ae0 con 0x7f4da406f170 2023-10-03T19:20:46.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4da37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4da406d170 0x7f4da41d6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:46.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4da37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4da406d170 0x7f4da41d6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58090/0 (socket says 172.21.15.45:58090) 2023-10-03T19:20:46.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4da37fe640 1 -- 172.21.15.45:0/218640605 learned_addr learned my addr 172.21.15.45:0/218640605 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:20:46.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4da2ffd640 1 --2- 172.21.15.45:0/218640605 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4da406f170 0x7f4da41e15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:46.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4da37fe640 1 -- 172.21.15.45:0/218640605 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4da406f170 msgr2=0x7f4da41e15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:46.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4da37fe640 1 --2- 172.21.15.45:0/218640605 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4da406f170 0x7f4da41e15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:46.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4da37fe640 1 -- 172.21.15.45:0/218640605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4da40bc8b0 msgr2=0x7f4da40b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:46.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4da37fe640 1 --2- 172.21.15.45:0/218640605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4da40bc8b0 0x7f4da40b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:46.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4da37fe640 1 -- 172.21.15.45:0/218640605 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d94009420 con 0x7f4da406d170 2023-10-03T19:20:46.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4da2ffd640 1 --2- 172.21.15.45:0/218640605 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4da406f170 0x7f4da41e15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:20:46.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4da37fe640 1 --2- 172.21.15.45:0/218640605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4da406d170 0x7f4da41d6520 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f4d9401c8a0 tx=0x7f4d9401d4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:46.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4d8bfff640 1 -- 172.21.15.45:0/218640605 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d940b1e10 con 0x7f4da406d170 2023-10-03T19:20:46.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4d8bfff640 1 -- 172.21.15.45:0/218640605 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d94004030 con 0x7f4da406d170 2023-10-03T19:20:46.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4d8bfff640 1 -- 172.21.15.45:0/218640605 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d940043c0 con 0x7f4da406d170 2023-10-03T19:20:46.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.759+0000 7f4da9d86640 1 -- 172.21.15.45:0/218640605 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da414c4a0 con 0x7f4da406d170 2023-10-03T19:20:46.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.763+0000 7f4da9d86640 1 -- 172.21.15.45:0/218640605 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da414fae0 con 0x7f4da406d170 2023-10-03T19:20:46.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.763+0000 7f4da9d86640 1 -- 172.21.15.45:0/218640605 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da406f540 con 0x7f4da406d170 2023-10-03T19:20:46.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.763+0000 7f4d8bfff640 1 -- 172.21.15.45:0/218640605 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4d94003620 con 0x7f4da406d170 2023-10-03T19:20:46.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.763+0000 7f4d8bfff640 1 --2- 172.21.15.45:0/218640605 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4d90066280 0x7f4d90068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:20:46.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.763+0000 7f4d8bfff640 1 -- 172.21.15.45:0/218640605 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f4d94121870 con 0x7f4da406d170 2023-10-03T19:20:46.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.763+0000 7f4da2ffd640 1 --2- 172.21.15.45:0/218640605 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4d90066280 0x7f4d90068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:20:46.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.763+0000 7f4da2ffd640 1 --2- 172.21.15.45:0/218640605 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4d90066280 0x7f4d90068730 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4da4149800 tx=0x7f4d98009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:20:46.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.767+0000 7f4d8bfff640 1 -- 172.21.15.45:0/218640605 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4d940eeb90 con 0x7f4da406d170 2023-10-03T19:20:46.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.931+0000 7f4da9d86640 1 -- 172.21.15.45:0/218640605 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4da406d660 con 0x7f4da406d170 2023-10-03T19:20:46.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.931+0000 7f4d8bfff640 1 -- 172.21.15.45:0/218640605 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v110) v1 ==== 80+0+59 (secure 0 0 0) 0x7f4d940b5080 con 0x7f4da406d170 2023-10-03T19:20:46.947 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.146:0/2294298422 2023-10-03T20:20:34.239894+0000 2023-10-03T19:20:46.948 INFO:teuthology.orchestra.run.smithi045.stderr:listed 1 entries 2023-10-03T19:20:46.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.931+0000 7f4da9d86640 1 -- 172.21.15.45:0/218640605 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4d90066280 msgr2=0x7f4d90068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:46.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.931+0000 7f4da9d86640 1 --2- 172.21.15.45:0/218640605 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4d90066280 0x7f4d90068730 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4da4149800 tx=0x7f4d98009040 comp rx=0 tx=0).stop 2023-10-03T19:20:46.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.931+0000 7f4da9d86640 1 -- 172.21.15.45:0/218640605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4da406d170 msgr2=0x7f4da41d6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:20:46.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.931+0000 7f4da9d86640 1 --2- 172.21.15.45:0/218640605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4da406d170 0x7f4da41d6520 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f4d9401c8a0 tx=0x7f4d9401d4b0 comp rx=0 tx=0).stop 2023-10-03T19:20:46.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.931+0000 7f4da9d86640 1 -- 172.21.15.45:0/218640605 shutdown_connections 2023-10-03T19:20:46.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.931+0000 7f4da9d86640 1 --2- 172.21.15.45:0/218640605 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4d90066280 0x7f4d90068730 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:46.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.931+0000 7f4da9d86640 1 --2- 172.21.15.45:0/218640605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4da40bc8b0 0x7f4da40b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:46.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.931+0000 7f4da9d86640 1 --2- 172.21.15.45:0/218640605 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4da406f170 0x7f4da41e15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:46.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.931+0000 7f4da9d86640 1 --2- 172.21.15.45:0/218640605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4da406d170 0x7f4da41d6520 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:46.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.931+0000 7f4da9d86640 1 -- 172.21.15.45:0/218640605 >> 172.21.15.45:0/218640605 conn(0x7f4da40bcf50 msgr2=0x7f4da414ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:20:46.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.931+0000 7f4da9d86640 1 -- 172.21.15.45:0/218640605 shutdown_connections 2023-10-03T19:20:46.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:20:46.935+0000 7f4da9d86640 1 -- 172.21.15.45:0/218640605 wait complete. 2023-10-03T19:20:46.953 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-10-03T19:20:46.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:20:46.953 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-10-03T19:20:46.966 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[34037]: fuse finished with error 0 and tester_r 0 2023-10-03T19:20:46.968 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-03T19:20:46.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:20:46.969 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-03T19:20:47.014 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-03T19:20:47.059 DEBUG:teuthology.orchestra.run.smithi045:> sed -n '/^--- begin dump of recent events ---$/,/^--- end dump of recent events ---$/p' /var/log/ceph/ceph-mds.a.log 2023-10-03T19:20:47.212 INFO:teuthology.orchestra.run.smithi045.stdout:--- begin dump of recent events --- 2023-10-03T19:20:47.258 INFO:teuthology.orchestra.run.smithi045.stdout: -9999> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002c5) clear_dirty_parent 2023-10-03T19:20:47.258 INFO:teuthology.orchestra.run.smithi045.stdout: -9998> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002c6) _stored_backtrace v 838 2023-10-03T19:20:47.258 INFO:teuthology.orchestra.run.smithi045.stdout: -9997> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002c6) auth_unpin by 0x55cf620db700 on [inode 0x100000002c6 [2,head] /dc-dir/dc-file_209 auth v3118 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:36.853324+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf620db700] now 0 2023-10-03T19:20:47.258 INFO:teuthology.orchestra.run.smithi045.stdout: -9996> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+766 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf620db700 count now 1/766 2023-10-03T19:20:47.258 INFO:teuthology.orchestra.run.smithi045.stdout: -9995> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002c6) clear_dirty_parent 2023-10-03T19:20:47.258 INFO:teuthology.orchestra.run.smithi045.stdout: -9994> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002c7) _stored_backtrace v 842 2023-10-03T19:20:47.258 INFO:teuthology.orchestra.run.smithi045.stdout: -9993> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002c7) auth_unpin by 0x55cf620e2000 on [inode 0x100000002c7 [2,head] /dc-dir/dc-file_210 auth v3120 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:36.864540+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf620e2000] now 0 2023-10-03T19:20:47.258 INFO:teuthology.orchestra.run.smithi045.stdout: -9992> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+765 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf620e2000 count now 1/765 2023-10-03T19:20:47.259 INFO:teuthology.orchestra.run.smithi045.stdout: -9991> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002c7) clear_dirty_parent 2023-10-03T19:20:47.259 INFO:teuthology.orchestra.run.smithi045.stdout: -9990> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002c8) _stored_backtrace v 846 2023-10-03T19:20:47.259 INFO:teuthology.orchestra.run.smithi045.stdout: -9989> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002c8) auth_unpin by 0x55cf620e2580 on [inode 0x100000002c8 [2,head] /dc-dir/dc-file_211 auth v3122 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:36.875534+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf620e2580] now 0 2023-10-03T19:20:47.259 INFO:teuthology.orchestra.run.smithi045.stdout: -9988> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+764 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf620e2580 count now 1/764 2023-10-03T19:20:47.259 INFO:teuthology.orchestra.run.smithi045.stdout: -9987> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002c8) clear_dirty_parent 2023-10-03T19:20:47.259 INFO:teuthology.orchestra.run.smithi045.stdout: -9986> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002c9) _stored_backtrace v 850 2023-10-03T19:20:47.259 INFO:teuthology.orchestra.run.smithi045.stdout: -9985> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002c9) auth_unpin by 0x55cf620e2b00 on [inode 0x100000002c9 [2,head] /dc-dir/dc-file_212 auth v3124 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:36.888773+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf620e2b00] now 0 2023-10-03T19:20:47.259 INFO:teuthology.orchestra.run.smithi045.stdout: -9984> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+763 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf620e2b00 count now 1/763 2023-10-03T19:20:47.259 INFO:teuthology.orchestra.run.smithi045.stdout: -9983> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002c9) clear_dirty_parent 2023-10-03T19:20:47.259 INFO:teuthology.orchestra.run.smithi045.stdout: -9982> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002ca) _stored_backtrace v 854 2023-10-03T19:20:47.259 INFO:teuthology.orchestra.run.smithi045.stdout: -9981> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002ca) auth_unpin by 0x55cf620e3080 on [inode 0x100000002ca [2,head] /dc-dir/dc-file_213 auth v3126 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:36.901863+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf620e3080] now 0 2023-10-03T19:20:47.260 INFO:teuthology.orchestra.run.smithi045.stdout: -9980> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+762 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf620e3080 count now 1/762 2023-10-03T19:20:47.260 INFO:teuthology.orchestra.run.smithi045.stdout: -9979> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002ca) clear_dirty_parent 2023-10-03T19:20:47.260 INFO:teuthology.orchestra.run.smithi045.stdout: -9978> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002cb) _stored_backtrace v 858 2023-10-03T19:20:47.260 INFO:teuthology.orchestra.run.smithi045.stdout: -9977> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002cb) auth_unpin by 0x55cf620e3600 on [inode 0x100000002cb [2,head] /dc-dir/dc-file_214 auth v3128 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:36.914475+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf620e3600] now 0 2023-10-03T19:20:47.260 INFO:teuthology.orchestra.run.smithi045.stdout: -9976> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+761 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf620e3600 count now 1/761 2023-10-03T19:20:47.260 INFO:teuthology.orchestra.run.smithi045.stdout: -9975> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002cb) clear_dirty_parent 2023-10-03T19:20:47.260 INFO:teuthology.orchestra.run.smithi045.stdout: -9974> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002cc) _stored_backtrace v 862 2023-10-03T19:20:47.260 INFO:teuthology.orchestra.run.smithi045.stdout: -9973> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002cc) auth_unpin by 0x55cf620e3b80 on [inode 0x100000002cc [2,head] /dc-dir/dc-file_215 auth v3130 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:36.927072+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf620e3b80] now 0 2023-10-03T19:20:47.260 INFO:teuthology.orchestra.run.smithi045.stdout: -9972> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+760 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf620e3b80 count now 1/760 2023-10-03T19:20:47.260 INFO:teuthology.orchestra.run.smithi045.stdout: -9971> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002cc) clear_dirty_parent 2023-10-03T19:20:47.260 INFO:teuthology.orchestra.run.smithi045.stdout: -9970> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002cd) _stored_backtrace v 866 2023-10-03T19:20:47.260 INFO:teuthology.orchestra.run.smithi045.stdout: -9969> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002cd) auth_unpin by 0x55cf620e4100 on [inode 0x100000002cd [2,head] /dc-dir/dc-file_216 auth v3132 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:36.939744+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf620e4100] now 0 2023-10-03T19:20:47.261 INFO:teuthology.orchestra.run.smithi045.stdout: -9968> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+759 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf620e4100 count now 1/759 2023-10-03T19:20:47.261 INFO:teuthology.orchestra.run.smithi045.stdout: -9967> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002cd) clear_dirty_parent 2023-10-03T19:20:47.261 INFO:teuthology.orchestra.run.smithi045.stdout: -9966> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002ce) _stored_backtrace v 870 2023-10-03T19:20:47.261 INFO:teuthology.orchestra.run.smithi045.stdout: -9965> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002ce) auth_unpin by 0x55cf620e4680 on [inode 0x100000002ce [2,head] /dc-dir/dc-file_217 auth v3134 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:36.952186+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf620e4680] now 0 2023-10-03T19:20:47.261 INFO:teuthology.orchestra.run.smithi045.stdout: -9964> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+758 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf620e4680 count now 1/758 2023-10-03T19:20:47.261 INFO:teuthology.orchestra.run.smithi045.stdout: -9963> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002ce) clear_dirty_parent 2023-10-03T19:20:47.261 INFO:teuthology.orchestra.run.smithi045.stdout: -9962> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002cf) _stored_backtrace v 874 2023-10-03T19:20:47.261 INFO:teuthology.orchestra.run.smithi045.stdout: -9961> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002cf) auth_unpin by 0x55cf620e4c00 on [inode 0x100000002cf [2,head] /dc-dir/dc-file_218 auth v3136 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:36.964132+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf620e4c00] now 0 2023-10-03T19:20:47.261 INFO:teuthology.orchestra.run.smithi045.stdout: -9960> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+757 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf620e4c00 count now 1/757 2023-10-03T19:20:47.261 INFO:teuthology.orchestra.run.smithi045.stdout: -9959> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002cf) clear_dirty_parent 2023-10-03T19:20:47.261 INFO:teuthology.orchestra.run.smithi045.stdout: -9958> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002d0) _stored_backtrace v 878 2023-10-03T19:20:47.262 INFO:teuthology.orchestra.run.smithi045.stdout: -9957> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002d0) auth_unpin by 0x55cf620e5180 on [inode 0x100000002d0 [2,head] /dc-dir/dc-file_219 auth v3138 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:36.976260+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf620e5180] now 0 2023-10-03T19:20:47.262 INFO:teuthology.orchestra.run.smithi045.stdout: -9956> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+756 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf620e5180 count now 1/756 2023-10-03T19:20:47.262 INFO:teuthology.orchestra.run.smithi045.stdout: -9955> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002d0) clear_dirty_parent 2023-10-03T19:20:47.262 INFO:teuthology.orchestra.run.smithi045.stdout: -9954> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002d1) _stored_backtrace v 882 2023-10-03T19:20:47.262 INFO:teuthology.orchestra.run.smithi045.stdout: -9953> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002d1) auth_unpin by 0x55cf620e5700 on [inode 0x100000002d1 [2,head] /dc-dir/dc-file_220 auth v3140 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:36.988533+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf620e5700] now 0 2023-10-03T19:20:47.262 INFO:teuthology.orchestra.run.smithi045.stdout: -9952> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+755 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf620e5700 count now 1/755 2023-10-03T19:20:47.262 INFO:teuthology.orchestra.run.smithi045.stdout: -9951> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002d1) clear_dirty_parent 2023-10-03T19:20:47.262 INFO:teuthology.orchestra.run.smithi045.stdout: -9950> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002d2) _stored_backtrace v 886 2023-10-03T19:20:47.262 INFO:teuthology.orchestra.run.smithi045.stdout: -9949> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002d2) auth_unpin by 0x55cf62102000 on [inode 0x100000002d2 [2,head] /dc-dir/dc-file_221 auth v3142 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:36.999813+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62102000] now 0 2023-10-03T19:20:47.263 INFO:teuthology.orchestra.run.smithi045.stdout: -9948> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+754 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62102000 count now 1/754 2023-10-03T19:20:47.263 INFO:teuthology.orchestra.run.smithi045.stdout: -9947> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002d2) clear_dirty_parent 2023-10-03T19:20:47.263 INFO:teuthology.orchestra.run.smithi045.stdout: -9946> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002d3) _stored_backtrace v 890 2023-10-03T19:20:47.263 INFO:teuthology.orchestra.run.smithi045.stdout: -9945> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002d3) auth_unpin by 0x55cf62102580 on [inode 0x100000002d3 [2,head] /dc-dir/dc-file_222 auth v3144 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.011015+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62102580] now 0 2023-10-03T19:20:47.263 INFO:teuthology.orchestra.run.smithi045.stdout: -9944> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+753 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62102580 count now 1/753 2023-10-03T19:20:47.263 INFO:teuthology.orchestra.run.smithi045.stdout: -9943> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002d3) clear_dirty_parent 2023-10-03T19:20:47.263 INFO:teuthology.orchestra.run.smithi045.stdout: -9942> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002d4) _stored_backtrace v 894 2023-10-03T19:20:47.263 INFO:teuthology.orchestra.run.smithi045.stdout: -9941> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002d4) auth_unpin by 0x55cf62102b00 on [inode 0x100000002d4 [2,head] /dc-dir/dc-file_223 auth v3146 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.023908+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62102b00] now 0 2023-10-03T19:20:47.263 INFO:teuthology.orchestra.run.smithi045.stdout: -9940> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+752 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62102b00 count now 1/752 2023-10-03T19:20:47.265 INFO:teuthology.orchestra.run.smithi045.stdout: -9939> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002d4) clear_dirty_parent 2023-10-03T19:20:47.265 INFO:teuthology.orchestra.run.smithi045.stdout: -9938> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002d5) _stored_backtrace v 898 2023-10-03T19:20:47.266 INFO:teuthology.orchestra.run.smithi045.stdout: -9937> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002d5) auth_unpin by 0x55cf62103080 on [inode 0x100000002d5 [2,head] /dc-dir/dc-file_224 auth v3148 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.036150+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62103080] now 0 2023-10-03T19:20:47.266 INFO:teuthology.orchestra.run.smithi045.stdout: -9936> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+751 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62103080 count now 1/751 2023-10-03T19:20:47.266 INFO:teuthology.orchestra.run.smithi045.stdout: -9935> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002d5) clear_dirty_parent 2023-10-03T19:20:47.266 INFO:teuthology.orchestra.run.smithi045.stdout: -9934> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002d6) _stored_backtrace v 902 2023-10-03T19:20:47.266 INFO:teuthology.orchestra.run.smithi045.stdout: -9933> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002d6) auth_unpin by 0x55cf62103600 on [inode 0x100000002d6 [2,head] /dc-dir/dc-file_225 auth v3150 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.047501+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62103600] now 0 2023-10-03T19:20:47.266 INFO:teuthology.orchestra.run.smithi045.stdout: -9932> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+750 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62103600 count now 1/750 2023-10-03T19:20:47.266 INFO:teuthology.orchestra.run.smithi045.stdout: -9931> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002d6) clear_dirty_parent 2023-10-03T19:20:47.266 INFO:teuthology.orchestra.run.smithi045.stdout: -9930> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002d7) _stored_backtrace v 906 2023-10-03T19:20:47.266 INFO:teuthology.orchestra.run.smithi045.stdout: -9929> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002d7) auth_unpin by 0x55cf62103b80 on [inode 0x100000002d7 [2,head] /dc-dir/dc-file_226 auth v3152 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.058936+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62103b80] now 0 2023-10-03T19:20:47.267 INFO:teuthology.orchestra.run.smithi045.stdout: -9928> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+749 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62103b80 count now 1/749 2023-10-03T19:20:47.267 INFO:teuthology.orchestra.run.smithi045.stdout: -9927> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002d7) clear_dirty_parent 2023-10-03T19:20:47.267 INFO:teuthology.orchestra.run.smithi045.stdout: -9926> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002d8) _stored_backtrace v 910 2023-10-03T19:20:47.267 INFO:teuthology.orchestra.run.smithi045.stdout: -9925> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002d8) auth_unpin by 0x55cf62104100 on [inode 0x100000002d8 [2,head] /dc-dir/dc-file_227 auth v3154 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.070616+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62104100] now 0 2023-10-03T19:20:47.267 INFO:teuthology.orchestra.run.smithi045.stdout: -9924> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+748 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62104100 count now 1/748 2023-10-03T19:20:47.267 INFO:teuthology.orchestra.run.smithi045.stdout: -9923> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002d8) clear_dirty_parent 2023-10-03T19:20:47.267 INFO:teuthology.orchestra.run.smithi045.stdout: -9922> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002d9) _stored_backtrace v 914 2023-10-03T19:20:47.267 INFO:teuthology.orchestra.run.smithi045.stdout: -9921> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002d9) auth_unpin by 0x55cf62104680 on [inode 0x100000002d9 [2,head] /dc-dir/dc-file_228 auth v3156 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.082487+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62104680] now 0 2023-10-03T19:20:47.267 INFO:teuthology.orchestra.run.smithi045.stdout: -9920> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+747 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62104680 count now 1/747 2023-10-03T19:20:47.267 INFO:teuthology.orchestra.run.smithi045.stdout: -9919> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002d9) clear_dirty_parent 2023-10-03T19:20:47.267 INFO:teuthology.orchestra.run.smithi045.stdout: -9918> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002da) _stored_backtrace v 918 2023-10-03T19:20:47.267 INFO:teuthology.orchestra.run.smithi045.stdout: -9917> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002da) auth_unpin by 0x55cf62104c00 on [inode 0x100000002da [2,head] /dc-dir/dc-file_229 auth v3158 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.095186+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62104c00] now 0 2023-10-03T19:20:47.268 INFO:teuthology.orchestra.run.smithi045.stdout: -9916> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+746 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62104c00 count now 1/746 2023-10-03T19:20:47.268 INFO:teuthology.orchestra.run.smithi045.stdout: -9915> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002da) clear_dirty_parent 2023-10-03T19:20:47.268 INFO:teuthology.orchestra.run.smithi045.stdout: -9914> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002db) _stored_backtrace v 922 2023-10-03T19:20:47.268 INFO:teuthology.orchestra.run.smithi045.stdout: -9913> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002db) auth_unpin by 0x55cf62105180 on [inode 0x100000002db [2,head] /dc-dir/dc-file_230 auth v3160 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.106378+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62105180] now 0 2023-10-03T19:20:47.268 INFO:teuthology.orchestra.run.smithi045.stdout: -9912> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+745 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62105180 count now 1/745 2023-10-03T19:20:47.268 INFO:teuthology.orchestra.run.smithi045.stdout: -9911> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002db) clear_dirty_parent 2023-10-03T19:20:47.268 INFO:teuthology.orchestra.run.smithi045.stdout: -9910> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002dc) _stored_backtrace v 926 2023-10-03T19:20:47.268 INFO:teuthology.orchestra.run.smithi045.stdout: -9909> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002dc) auth_unpin by 0x55cf62105700 on [inode 0x100000002dc [2,head] /dc-dir/dc-file_231 auth v3162 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.118390+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62105700] now 0 2023-10-03T19:20:47.268 INFO:teuthology.orchestra.run.smithi045.stdout: -9908> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+744 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62105700 count now 1/744 2023-10-03T19:20:47.268 INFO:teuthology.orchestra.run.smithi045.stdout: -9907> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002dc) clear_dirty_parent 2023-10-03T19:20:47.269 INFO:teuthology.orchestra.run.smithi045.stdout: -9906> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002dd) _stored_backtrace v 930 2023-10-03T19:20:47.269 INFO:teuthology.orchestra.run.smithi045.stdout: -9905> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002dd) auth_unpin by 0x55cf6210e000 on [inode 0x100000002dd [2,head] /dc-dir/dc-file_232 auth v3164 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.131173+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6210e000] now 0 2023-10-03T19:20:47.269 INFO:teuthology.orchestra.run.smithi045.stdout: -9904> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+743 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6210e000 count now 1/743 2023-10-03T19:20:47.269 INFO:teuthology.orchestra.run.smithi045.stdout: -9903> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002dd) clear_dirty_parent 2023-10-03T19:20:47.269 INFO:teuthology.orchestra.run.smithi045.stdout: -9902> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002de) _stored_backtrace v 934 2023-10-03T19:20:47.269 INFO:teuthology.orchestra.run.smithi045.stdout: -9901> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002de) auth_unpin by 0x55cf6210e580 on [inode 0x100000002de [2,head] /dc-dir/dc-file_233 auth v3166 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.143535+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6210e580] now 0 2023-10-03T19:20:47.269 INFO:teuthology.orchestra.run.smithi045.stdout: -9900> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+742 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6210e580 count now 1/742 2023-10-03T19:20:47.269 INFO:teuthology.orchestra.run.smithi045.stdout: -9899> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002de) clear_dirty_parent 2023-10-03T19:20:47.269 INFO:teuthology.orchestra.run.smithi045.stdout: -9898> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002df) _stored_backtrace v 938 2023-10-03T19:20:47.269 INFO:teuthology.orchestra.run.smithi045.stdout: -9897> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002df) auth_unpin by 0x55cf6210eb00 on [inode 0x100000002df [2,head] /dc-dir/dc-file_234 auth v3168 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.155683+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6210eb00] now 0 2023-10-03T19:20:47.269 INFO:teuthology.orchestra.run.smithi045.stdout: -9896> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+741 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6210eb00 count now 1/741 2023-10-03T19:20:47.270 INFO:teuthology.orchestra.run.smithi045.stdout: -9895> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002df) clear_dirty_parent 2023-10-03T19:20:47.270 INFO:teuthology.orchestra.run.smithi045.stdout: -9894> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002e0) _stored_backtrace v 942 2023-10-03T19:20:47.270 INFO:teuthology.orchestra.run.smithi045.stdout: -9893> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002e0) auth_unpin by 0x55cf6210f080 on [inode 0x100000002e0 [2,head] /dc-dir/dc-file_235 auth v3170 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.168003+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6210f080] now 0 2023-10-03T19:20:47.270 INFO:teuthology.orchestra.run.smithi045.stdout: -9892> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+740 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6210f080 count now 1/740 2023-10-03T19:20:47.270 INFO:teuthology.orchestra.run.smithi045.stdout: -9891> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002e0) clear_dirty_parent 2023-10-03T19:20:47.270 INFO:teuthology.orchestra.run.smithi045.stdout: -9890> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002e1) _stored_backtrace v 946 2023-10-03T19:20:47.270 INFO:teuthology.orchestra.run.smithi045.stdout: -9889> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002e1) auth_unpin by 0x55cf6210f600 on [inode 0x100000002e1 [2,head] /dc-dir/dc-file_236 auth v3172 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.179478+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6210f600] now 0 2023-10-03T19:20:47.270 INFO:teuthology.orchestra.run.smithi045.stdout: -9888> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+739 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6210f600 count now 1/739 2023-10-03T19:20:47.270 INFO:teuthology.orchestra.run.smithi045.stdout: -9887> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002e1) clear_dirty_parent 2023-10-03T19:20:47.270 INFO:teuthology.orchestra.run.smithi045.stdout: -9886> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002e2) _stored_backtrace v 950 2023-10-03T19:20:47.271 INFO:teuthology.orchestra.run.smithi045.stdout: -9885> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002e2) auth_unpin by 0x55cf6210fb80 on [inode 0x100000002e2 [2,head] /dc-dir/dc-file_237 auth v3174 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.190919+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6210fb80] now 0 2023-10-03T19:20:47.271 INFO:teuthology.orchestra.run.smithi045.stdout: -9884> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+738 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6210fb80 count now 1/738 2023-10-03T19:20:47.271 INFO:teuthology.orchestra.run.smithi045.stdout: -9883> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002e2) clear_dirty_parent 2023-10-03T19:20:47.271 INFO:teuthology.orchestra.run.smithi045.stdout: -9882> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002e3) _stored_backtrace v 954 2023-10-03T19:20:47.271 INFO:teuthology.orchestra.run.smithi045.stdout: -9881> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002e3) auth_unpin by 0x55cf62110100 on [inode 0x100000002e3 [2,head] /dc-dir/dc-file_238 auth v3176 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.202489+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62110100] now 0 2023-10-03T19:20:47.271 INFO:teuthology.orchestra.run.smithi045.stdout: -9880> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+737 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62110100 count now 1/737 2023-10-03T19:20:47.271 INFO:teuthology.orchestra.run.smithi045.stdout: -9879> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002e3) clear_dirty_parent 2023-10-03T19:20:47.271 INFO:teuthology.orchestra.run.smithi045.stdout: -9878> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002e4) _stored_backtrace v 958 2023-10-03T19:20:47.286 INFO:teuthology.orchestra.run.smithi045.stdout: -9877> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002e4) auth_unpin by 0x55cf62110680 on [inode 0x100000002e4 [2,head] /dc-dir/dc-file_239 auth v3178 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.214382+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62110680] now 0 2023-10-03T19:20:47.286 INFO:teuthology.orchestra.run.smithi045.stdout: -9876> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+736 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62110680 count now 1/736 2023-10-03T19:20:47.287 INFO:teuthology.orchestra.run.smithi045.stdout: -9875> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002e4) clear_dirty_parent 2023-10-03T19:20:47.287 INFO:teuthology.orchestra.run.smithi045.stdout: -9874> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002e5) _stored_backtrace v 962 2023-10-03T19:20:47.287 INFO:teuthology.orchestra.run.smithi045.stdout: -9873> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002e5) auth_unpin by 0x55cf62110c00 on [inode 0x100000002e5 [2,head] /dc-dir/dc-file_240 auth v3180 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.225629+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62110c00] now 0 2023-10-03T19:20:47.287 INFO:teuthology.orchestra.run.smithi045.stdout: -9872> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+735 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62110c00 count now 1/735 2023-10-03T19:20:47.287 INFO:teuthology.orchestra.run.smithi045.stdout: -9871> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002e5) clear_dirty_parent 2023-10-03T19:20:47.287 INFO:teuthology.orchestra.run.smithi045.stdout: -9870> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002e6) _stored_backtrace v 966 2023-10-03T19:20:47.287 INFO:teuthology.orchestra.run.smithi045.stdout: -9869> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002e6) auth_unpin by 0x55cf62111180 on [inode 0x100000002e6 [2,head] /dc-dir/dc-file_241 auth v3182 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.236624+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62111180] now 0 2023-10-03T19:20:47.287 INFO:teuthology.orchestra.run.smithi045.stdout: -9868> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+734 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62111180 count now 1/734 2023-10-03T19:20:47.287 INFO:teuthology.orchestra.run.smithi045.stdout: -9867> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002e6) clear_dirty_parent 2023-10-03T19:20:47.288 INFO:teuthology.orchestra.run.smithi045.stdout: -9866> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002e7) _stored_backtrace v 970 2023-10-03T19:20:47.288 INFO:teuthology.orchestra.run.smithi045.stdout: -9865> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002e7) auth_unpin by 0x55cf62111700 on [inode 0x100000002e7 [2,head] /dc-dir/dc-file_242 auth v3184 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.247752+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62111700] now 0 2023-10-03T19:20:47.288 INFO:teuthology.orchestra.run.smithi045.stdout: -9864> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+733 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62111700 count now 1/733 2023-10-03T19:20:47.288 INFO:teuthology.orchestra.run.smithi045.stdout: -9863> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002e7) clear_dirty_parent 2023-10-03T19:20:47.288 INFO:teuthology.orchestra.run.smithi045.stdout: -9862> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002e8) _stored_backtrace v 974 2023-10-03T19:20:47.288 INFO:teuthology.orchestra.run.smithi045.stdout: -9861> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002e8) auth_unpin by 0x55cf6211a000 on [inode 0x100000002e8 [2,head] /dc-dir/dc-file_243 auth v3186 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.259539+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6211a000] now 0 2023-10-03T19:20:47.288 INFO:teuthology.orchestra.run.smithi045.stdout: -9860> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+732 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6211a000 count now 1/732 2023-10-03T19:20:47.288 INFO:teuthology.orchestra.run.smithi045.stdout: -9859> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002e8) clear_dirty_parent 2023-10-03T19:20:47.288 INFO:teuthology.orchestra.run.smithi045.stdout: -9858> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002e9) _stored_backtrace v 978 2023-10-03T19:20:47.288 INFO:teuthology.orchestra.run.smithi045.stdout: -9857> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002e9) auth_unpin by 0x55cf6211a580 on [inode 0x100000002e9 [2,head] /dc-dir/dc-file_244 auth v3188 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.270573+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6211a580] now 0 2023-10-03T19:20:47.289 INFO:teuthology.orchestra.run.smithi045.stdout: -9856> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+731 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6211a580 count now 1/731 2023-10-03T19:20:47.289 INFO:teuthology.orchestra.run.smithi045.stdout: -9855> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002e9) clear_dirty_parent 2023-10-03T19:20:47.289 INFO:teuthology.orchestra.run.smithi045.stdout: -9854> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002ea) _stored_backtrace v 982 2023-10-03T19:20:47.289 INFO:teuthology.orchestra.run.smithi045.stdout: -9853> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002ea) auth_unpin by 0x55cf6211ab00 on [inode 0x100000002ea [2,head] /dc-dir/dc-file_245 auth v3190 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.281735+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6211ab00] now 0 2023-10-03T19:20:47.289 INFO:teuthology.orchestra.run.smithi045.stdout: -9852> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+730 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6211ab00 count now 1/730 2023-10-03T19:20:47.289 INFO:teuthology.orchestra.run.smithi045.stdout: -9851> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002ea) clear_dirty_parent 2023-10-03T19:20:47.289 INFO:teuthology.orchestra.run.smithi045.stdout: -9850> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002eb) _stored_backtrace v 986 2023-10-03T19:20:47.289 INFO:teuthology.orchestra.run.smithi045.stdout: -9849> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002eb) auth_unpin by 0x55cf6211b080 on [inode 0x100000002eb [2,head] /dc-dir/dc-file_246 auth v3192 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.294433+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6211b080] now 0 2023-10-03T19:20:47.289 INFO:teuthology.orchestra.run.smithi045.stdout: -9848> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+729 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6211b080 count now 1/729 2023-10-03T19:20:47.290 INFO:teuthology.orchestra.run.smithi045.stdout: -9847> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002eb) clear_dirty_parent 2023-10-03T19:20:47.290 INFO:teuthology.orchestra.run.smithi045.stdout: -9846> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002ec) _stored_backtrace v 990 2023-10-03T19:20:47.290 INFO:teuthology.orchestra.run.smithi045.stdout: -9845> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002ec) auth_unpin by 0x55cf6211b600 on [inode 0x100000002ec [2,head] /dc-dir/dc-file_247 auth v3194 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.307662+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6211b600] now 0 2023-10-03T19:20:47.290 INFO:teuthology.orchestra.run.smithi045.stdout: -9844> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+728 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6211b600 count now 1/728 2023-10-03T19:20:47.290 INFO:teuthology.orchestra.run.smithi045.stdout: -9843> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002ec) clear_dirty_parent 2023-10-03T19:20:47.290 INFO:teuthology.orchestra.run.smithi045.stdout: -9842> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002ed) _stored_backtrace v 994 2023-10-03T19:20:47.290 INFO:teuthology.orchestra.run.smithi045.stdout: -9841> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002ed) auth_unpin by 0x55cf6211bb80 on [inode 0x100000002ed [2,head] /dc-dir/dc-file_248 auth v3196 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.319004+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6211bb80] now 0 2023-10-03T19:20:47.290 INFO:teuthology.orchestra.run.smithi045.stdout: -9840> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+727 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6211bb80 count now 1/727 2023-10-03T19:20:47.290 INFO:teuthology.orchestra.run.smithi045.stdout: -9839> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002ed) clear_dirty_parent 2023-10-03T19:20:47.290 INFO:teuthology.orchestra.run.smithi045.stdout: -9838> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002ee) _stored_backtrace v 998 2023-10-03T19:20:47.290 INFO:teuthology.orchestra.run.smithi045.stdout: -9837> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002ee) auth_unpin by 0x55cf6211c100 on [inode 0x100000002ee [2,head] /dc-dir/dc-file_249 auth v3198 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.330158+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6211c100] now 0 2023-10-03T19:20:47.290 INFO:teuthology.orchestra.run.smithi045.stdout: -9836> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+726 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6211c100 count now 1/726 2023-10-03T19:20:47.291 INFO:teuthology.orchestra.run.smithi045.stdout: -9835> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002ee) clear_dirty_parent 2023-10-03T19:20:47.291 INFO:teuthology.orchestra.run.smithi045.stdout: -9834> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002ef) _stored_backtrace v 1002 2023-10-03T19:20:47.291 INFO:teuthology.orchestra.run.smithi045.stdout: -9833> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002ef) auth_unpin by 0x55cf6211c680 on [inode 0x100000002ef [2,head] /dc-dir/dc-file_250 auth v3200 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.342396+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6211c680] now 0 2023-10-03T19:20:47.291 INFO:teuthology.orchestra.run.smithi045.stdout: -9832> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+725 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6211c680 count now 1/725 2023-10-03T19:20:47.291 INFO:teuthology.orchestra.run.smithi045.stdout: -9831> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002ef) clear_dirty_parent 2023-10-03T19:20:47.291 INFO:teuthology.orchestra.run.smithi045.stdout: -9830> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002f0) _stored_backtrace v 1006 2023-10-03T19:20:47.291 INFO:teuthology.orchestra.run.smithi045.stdout: -9829> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002f0) auth_unpin by 0x55cf6211cc00 on [inode 0x100000002f0 [2,head] /dc-dir/dc-file_251 auth v3202 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.354930+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6211cc00] now 0 2023-10-03T19:20:47.291 INFO:teuthology.orchestra.run.smithi045.stdout: -9828> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+724 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6211cc00 count now 1/724 2023-10-03T19:20:47.291 INFO:teuthology.orchestra.run.smithi045.stdout: -9827> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002f0) clear_dirty_parent 2023-10-03T19:20:47.291 INFO:teuthology.orchestra.run.smithi045.stdout: -9826> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002f1) _stored_backtrace v 1010 2023-10-03T19:20:47.291 INFO:teuthology.orchestra.run.smithi045.stdout: -9825> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002f1) auth_unpin by 0x55cf6211d180 on [inode 0x100000002f1 [2,head] /dc-dir/dc-file_252 auth v3204 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.367153+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6211d180] now 0 2023-10-03T19:20:47.292 INFO:teuthology.orchestra.run.smithi045.stdout: -9824> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+723 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6211d180 count now 1/723 2023-10-03T19:20:47.292 INFO:teuthology.orchestra.run.smithi045.stdout: -9823> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002f1) clear_dirty_parent 2023-10-03T19:20:47.292 INFO:teuthology.orchestra.run.smithi045.stdout: -9822> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002f2) _stored_backtrace v 1014 2023-10-03T19:20:47.292 INFO:teuthology.orchestra.run.smithi045.stdout: -9821> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002f2) auth_unpin by 0x55cf6211d700 on [inode 0x100000002f2 [2,head] /dc-dir/dc-file_253 auth v3206 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.378606+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6211d700] now 0 2023-10-03T19:20:47.292 INFO:teuthology.orchestra.run.smithi045.stdout: -9820> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+722 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6211d700 count now 1/722 2023-10-03T19:20:47.292 INFO:teuthology.orchestra.run.smithi045.stdout: -9819> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002f2) clear_dirty_parent 2023-10-03T19:20:47.292 INFO:teuthology.orchestra.run.smithi045.stdout: -9818> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002f3) _stored_backtrace v 1018 2023-10-03T19:20:47.292 INFO:teuthology.orchestra.run.smithi045.stdout: -9817> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002f3) auth_unpin by 0x55cf62124000 on [inode 0x100000002f3 [2,head] /dc-dir/dc-file_254 auth v3208 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.390404+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62124000] now 0 2023-10-03T19:20:47.292 INFO:teuthology.orchestra.run.smithi045.stdout: -9816> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+721 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62124000 count now 1/721 2023-10-03T19:20:47.292 INFO:teuthology.orchestra.run.smithi045.stdout: -9815> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002f3) clear_dirty_parent 2023-10-03T19:20:47.292 INFO:teuthology.orchestra.run.smithi045.stdout: -9814> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002f4) _stored_backtrace v 1022 2023-10-03T19:20:47.292 INFO:teuthology.orchestra.run.smithi045.stdout: -9813> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002f4) auth_unpin by 0x55cf62124580 on [inode 0x100000002f4 [2,head] /dc-dir/dc-file_255 auth v3210 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.402104+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62124580] now 0 2023-10-03T19:20:47.297 INFO:teuthology.orchestra.run.smithi045.stdout: -9812> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+720 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62124580 count now 1/720 2023-10-03T19:20:47.297 INFO:teuthology.orchestra.run.smithi045.stdout: -9811> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002f4) clear_dirty_parent 2023-10-03T19:20:47.297 INFO:teuthology.orchestra.run.smithi045.stdout: -9810> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002f5) _stored_backtrace v 1026 2023-10-03T19:20:47.297 INFO:teuthology.orchestra.run.smithi045.stdout: -9809> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002f5) auth_unpin by 0x55cf62124b00 on [inode 0x100000002f5 [2,head] /dc-dir/dc-file_256 auth v3212 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.413247+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62124b00] now 0 2023-10-03T19:20:47.297 INFO:teuthology.orchestra.run.smithi045.stdout: -9808> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+719 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62124b00 count now 1/719 2023-10-03T19:20:47.297 INFO:teuthology.orchestra.run.smithi045.stdout: -9807> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002f5) clear_dirty_parent 2023-10-03T19:20:47.297 INFO:teuthology.orchestra.run.smithi045.stdout: -9806> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002f6) _stored_backtrace v 1030 2023-10-03T19:20:47.298 INFO:teuthology.orchestra.run.smithi045.stdout: -9805> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002f6) auth_unpin by 0x55cf62125080 on [inode 0x100000002f6 [2,head] /dc-dir/dc-file_257 auth v3214 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.424227+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62125080] now 0 2023-10-03T19:20:47.298 INFO:teuthology.orchestra.run.smithi045.stdout: -9804> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+718 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62125080 count now 1/718 2023-10-03T19:20:47.298 INFO:teuthology.orchestra.run.smithi045.stdout: -9803> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002f6) clear_dirty_parent 2023-10-03T19:20:47.298 INFO:teuthology.orchestra.run.smithi045.stdout: -9802> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002f7) _stored_backtrace v 1034 2023-10-03T19:20:47.298 INFO:teuthology.orchestra.run.smithi045.stdout: -9801> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002f7) auth_unpin by 0x55cf62125600 on [inode 0x100000002f7 [2,head] /dc-dir/dc-file_258 auth v3216 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.435651+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62125600] now 0 2023-10-03T19:20:47.298 INFO:teuthology.orchestra.run.smithi045.stdout: -9800> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+717 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62125600 count now 1/717 2023-10-03T19:20:47.298 INFO:teuthology.orchestra.run.smithi045.stdout: -9799> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002f7) clear_dirty_parent 2023-10-03T19:20:47.298 INFO:teuthology.orchestra.run.smithi045.stdout: -9798> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002f8) _stored_backtrace v 1038 2023-10-03T19:20:47.298 INFO:teuthology.orchestra.run.smithi045.stdout: -9797> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002f8) auth_unpin by 0x55cf62125b80 on [inode 0x100000002f8 [2,head] /dc-dir/dc-file_259 auth v3218 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.447466+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62125b80] now 0 2023-10-03T19:20:47.299 INFO:teuthology.orchestra.run.smithi045.stdout: -9796> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+716 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62125b80 count now 1/716 2023-10-03T19:20:47.299 INFO:teuthology.orchestra.run.smithi045.stdout: -9795> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002f8) clear_dirty_parent 2023-10-03T19:20:47.299 INFO:teuthology.orchestra.run.smithi045.stdout: -9794> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002f9) _stored_backtrace v 1042 2023-10-03T19:20:47.299 INFO:teuthology.orchestra.run.smithi045.stdout: -9793> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002f9) auth_unpin by 0x55cf62126100 on [inode 0x100000002f9 [2,head] /dc-dir/dc-file_260 auth v3220 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.458922+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62126100] now 0 2023-10-03T19:20:47.299 INFO:teuthology.orchestra.run.smithi045.stdout: -9792> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+715 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62126100 count now 1/715 2023-10-03T19:20:47.299 INFO:teuthology.orchestra.run.smithi045.stdout: -9791> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002f9) clear_dirty_parent 2023-10-03T19:20:47.299 INFO:teuthology.orchestra.run.smithi045.stdout: -9790> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002fa) _stored_backtrace v 1046 2023-10-03T19:20:47.299 INFO:teuthology.orchestra.run.smithi045.stdout: -9789> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002fa) auth_unpin by 0x55cf62126680 on [inode 0x100000002fa [2,head] /dc-dir/dc-file_261 auth v3222 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.470456+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62126680] now 0 2023-10-03T19:20:47.299 INFO:teuthology.orchestra.run.smithi045.stdout: -9788> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+714 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62126680 count now 1/714 2023-10-03T19:20:47.299 INFO:teuthology.orchestra.run.smithi045.stdout: -9787> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002fa) clear_dirty_parent 2023-10-03T19:20:47.299 INFO:teuthology.orchestra.run.smithi045.stdout: -9786> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002fb) _stored_backtrace v 1050 2023-10-03T19:20:47.300 INFO:teuthology.orchestra.run.smithi045.stdout: -9785> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002fb) auth_unpin by 0x55cf62126c00 on [inode 0x100000002fb [2,head] /dc-dir/dc-file_262 auth v3224 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.483117+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62126c00] now 0 2023-10-03T19:20:47.300 INFO:teuthology.orchestra.run.smithi045.stdout: -9784> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+713 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62126c00 count now 1/713 2023-10-03T19:20:47.300 INFO:teuthology.orchestra.run.smithi045.stdout: -9783> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002fb) clear_dirty_parent 2023-10-03T19:20:47.300 INFO:teuthology.orchestra.run.smithi045.stdout: -9782> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002fc) _stored_backtrace v 1054 2023-10-03T19:20:47.300 INFO:teuthology.orchestra.run.smithi045.stdout: -9781> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002fc) auth_unpin by 0x55cf62127180 on [inode 0x100000002fc [2,head] /dc-dir/dc-file_263 auth v3544 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.494635+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62127180] now 0 2023-10-03T19:20:47.300 INFO:teuthology.orchestra.run.smithi045.stdout: -9780> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+712 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62127180 count now 1/712 2023-10-03T19:20:47.300 INFO:teuthology.orchestra.run.smithi045.stdout: -9779> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002fc) clear_dirty_parent 2023-10-03T19:20:47.300 INFO:teuthology.orchestra.run.smithi045.stdout: -9778> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002fd) _stored_backtrace v 1058 2023-10-03T19:20:47.300 INFO:teuthology.orchestra.run.smithi045.stdout: -9777> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002fd) auth_unpin by 0x55cf62127700 on [inode 0x100000002fd [2,head] /dc-dir/dc-file_264 auth v3546 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.506123+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62127700] now 0 2023-10-03T19:20:47.300 INFO:teuthology.orchestra.run.smithi045.stdout: -9776> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+711 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62127700 count now 1/711 2023-10-03T19:20:47.300 INFO:teuthology.orchestra.run.smithi045.stdout: -9775> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002fd) clear_dirty_parent 2023-10-03T19:20:47.301 INFO:teuthology.orchestra.run.smithi045.stdout: -9774> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002fe) _stored_backtrace v 1062 2023-10-03T19:20:47.301 INFO:teuthology.orchestra.run.smithi045.stdout: -9773> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002fe) auth_unpin by 0x55cf62136000 on [inode 0x100000002fe [2,head] /dc-dir/dc-file_265 auth v3548 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.517502+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62136000] now 0 2023-10-03T19:20:47.301 INFO:teuthology.orchestra.run.smithi045.stdout: -9772> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+710 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62136000 count now 1/710 2023-10-03T19:20:47.301 INFO:teuthology.orchestra.run.smithi045.stdout: -9771> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002fe) clear_dirty_parent 2023-10-03T19:20:47.301 INFO:teuthology.orchestra.run.smithi045.stdout: -9770> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002ff) _stored_backtrace v 1066 2023-10-03T19:20:47.301 INFO:teuthology.orchestra.run.smithi045.stdout: -9769> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002ff) auth_unpin by 0x55cf62136580 on [inode 0x100000002ff [2,head] /dc-dir/dc-file_266 auth v3550 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.528715+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62136580] now 0 2023-10-03T19:20:47.301 INFO:teuthology.orchestra.run.smithi045.stdout: -9768> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+709 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62136580 count now 1/709 2023-10-03T19:20:47.301 INFO:teuthology.orchestra.run.smithi045.stdout: -9767> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000002ff) clear_dirty_parent 2023-10-03T19:20:47.301 INFO:teuthology.orchestra.run.smithi045.stdout: -9766> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000300) _stored_backtrace v 1070 2023-10-03T19:20:47.301 INFO:teuthology.orchestra.run.smithi045.stdout: -9765> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000300) auth_unpin by 0x55cf62136b00 on [inode 0x10000000300 [2,head] /dc-dir/dc-file_267 auth v3552 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.540232+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62136b00] now 0 2023-10-03T19:20:47.302 INFO:teuthology.orchestra.run.smithi045.stdout: -9764> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+708 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62136b00 count now 1/708 2023-10-03T19:20:47.302 INFO:teuthology.orchestra.run.smithi045.stdout: -9763> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000300) clear_dirty_parent 2023-10-03T19:20:47.302 INFO:teuthology.orchestra.run.smithi045.stdout: -9762> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000301) _stored_backtrace v 1074 2023-10-03T19:20:47.302 INFO:teuthology.orchestra.run.smithi045.stdout: -9761> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000301) auth_unpin by 0x55cf62137080 on [inode 0x10000000301 [2,head] /dc-dir/dc-file_268 auth v3554 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.551480+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62137080] now 0 2023-10-03T19:20:47.302 INFO:teuthology.orchestra.run.smithi045.stdout: -9760> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+707 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62137080 count now 1/707 2023-10-03T19:20:47.302 INFO:teuthology.orchestra.run.smithi045.stdout: -9759> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000301) clear_dirty_parent 2023-10-03T19:20:47.302 INFO:teuthology.orchestra.run.smithi045.stdout: -9758> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000302) _stored_backtrace v 1078 2023-10-03T19:20:47.305 INFO:teuthology.orchestra.run.smithi045.stdout: -9757> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000302) auth_unpin by 0x55cf62137600 on [inode 0x10000000302 [2,head] /dc-dir/dc-file_269 auth v3556 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.562837+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62137600] now 0 2023-10-03T19:20:47.305 INFO:teuthology.orchestra.run.smithi045.stdout: -9756> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+706 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62137600 count now 1/706 2023-10-03T19:20:47.305 INFO:teuthology.orchestra.run.smithi045.stdout: -9755> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000302) clear_dirty_parent 2023-10-03T19:20:47.305 INFO:teuthology.orchestra.run.smithi045.stdout: -9754> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000303) _stored_backtrace v 1082 2023-10-03T19:20:47.305 INFO:teuthology.orchestra.run.smithi045.stdout: -9753> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000303) auth_unpin by 0x55cf62137b80 on [inode 0x10000000303 [2,head] /dc-dir/dc-file_270 auth v3558 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.573562+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62137b80] now 0 2023-10-03T19:20:47.305 INFO:teuthology.orchestra.run.smithi045.stdout: -9752> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+705 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62137b80 count now 1/705 2023-10-03T19:20:47.305 INFO:teuthology.orchestra.run.smithi045.stdout: -9751> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000303) clear_dirty_parent 2023-10-03T19:20:47.306 INFO:teuthology.orchestra.run.smithi045.stdout: -9750> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000304) _stored_backtrace v 1086 2023-10-03T19:20:47.306 INFO:teuthology.orchestra.run.smithi045.stdout: -9749> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000304) auth_unpin by 0x55cf62138100 on [inode 0x10000000304 [2,head] /dc-dir/dc-file_271 auth v3560 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.584720+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62138100] now 0 2023-10-03T19:20:47.306 INFO:teuthology.orchestra.run.smithi045.stdout: -9748> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+704 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62138100 count now 1/704 2023-10-03T19:20:47.306 INFO:teuthology.orchestra.run.smithi045.stdout: -9747> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000304) clear_dirty_parent 2023-10-03T19:20:47.306 INFO:teuthology.orchestra.run.smithi045.stdout: -9746> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000305) _stored_backtrace v 1090 2023-10-03T19:20:47.306 INFO:teuthology.orchestra.run.smithi045.stdout: -9745> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000305) auth_unpin by 0x55cf62138680 on [inode 0x10000000305 [2,head] /dc-dir/dc-file_272 auth v3562 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.595691+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62138680] now 0 2023-10-03T19:20:47.306 INFO:teuthology.orchestra.run.smithi045.stdout: -9744> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+703 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62138680 count now 1/703 2023-10-03T19:20:47.306 INFO:teuthology.orchestra.run.smithi045.stdout: -9743> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000305) clear_dirty_parent 2023-10-03T19:20:47.306 INFO:teuthology.orchestra.run.smithi045.stdout: -9742> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000306) _stored_backtrace v 1094 2023-10-03T19:20:47.306 INFO:teuthology.orchestra.run.smithi045.stdout: -9741> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000306) auth_unpin by 0x55cf62138c00 on [inode 0x10000000306 [2,head] /dc-dir/dc-file_273 auth v3564 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.607656+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62138c00] now 0 2023-10-03T19:20:47.306 INFO:teuthology.orchestra.run.smithi045.stdout: -9740> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+702 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62138c00 count now 1/702 2023-10-03T19:20:47.307 INFO:teuthology.orchestra.run.smithi045.stdout: -9739> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000306) clear_dirty_parent 2023-10-03T19:20:47.307 INFO:teuthology.orchestra.run.smithi045.stdout: -9738> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000307) _stored_backtrace v 1098 2023-10-03T19:20:47.307 INFO:teuthology.orchestra.run.smithi045.stdout: -9737> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000307) auth_unpin by 0x55cf62139180 on [inode 0x10000000307 [2,head] /dc-dir/dc-file_274 auth v3566 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.618818+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62139180] now 0 2023-10-03T19:20:47.307 INFO:teuthology.orchestra.run.smithi045.stdout: -9736> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+701 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62139180 count now 1/701 2023-10-03T19:20:47.307 INFO:teuthology.orchestra.run.smithi045.stdout: -9735> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000307) clear_dirty_parent 2023-10-03T19:20:47.307 INFO:teuthology.orchestra.run.smithi045.stdout: -9734> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000308) _stored_backtrace v 1102 2023-10-03T19:20:47.307 INFO:teuthology.orchestra.run.smithi045.stdout: -9733> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000308) auth_unpin by 0x55cf62139700 on [inode 0x10000000308 [2,head] /dc-dir/dc-file_275 auth v3568 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.629562+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62139700] now 0 2023-10-03T19:20:47.307 INFO:teuthology.orchestra.run.smithi045.stdout: -9732> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+700 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62139700 count now 1/700 2023-10-03T19:20:47.307 INFO:teuthology.orchestra.run.smithi045.stdout: -9731> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000308) clear_dirty_parent 2023-10-03T19:20:47.307 INFO:teuthology.orchestra.run.smithi045.stdout: -9730> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000309) _stored_backtrace v 1106 2023-10-03T19:20:47.307 INFO:teuthology.orchestra.run.smithi045.stdout: -9729> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000309) auth_unpin by 0x55cf62144000 on [inode 0x10000000309 [2,head] /dc-dir/dc-file_276 auth v3570 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.640456+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62144000] now 0 2023-10-03T19:20:47.308 INFO:teuthology.orchestra.run.smithi045.stdout: -9728> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+699 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62144000 count now 1/699 2023-10-03T19:20:47.308 INFO:teuthology.orchestra.run.smithi045.stdout: -9727> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000309) clear_dirty_parent 2023-10-03T19:20:47.308 INFO:teuthology.orchestra.run.smithi045.stdout: -9726> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000030a) _stored_backtrace v 1110 2023-10-03T19:20:47.308 INFO:teuthology.orchestra.run.smithi045.stdout: -9725> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000030a) auth_unpin by 0x55cf62144580 on [inode 0x1000000030a [2,head] /dc-dir/dc-file_277 auth v3572 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.651409+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62144580] now 0 2023-10-03T19:20:47.308 INFO:teuthology.orchestra.run.smithi045.stdout: -9724> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+698 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62144580 count now 1/698 2023-10-03T19:20:47.308 INFO:teuthology.orchestra.run.smithi045.stdout: -9723> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000030a) clear_dirty_parent 2023-10-03T19:20:47.308 INFO:teuthology.orchestra.run.smithi045.stdout: -9722> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000030b) _stored_backtrace v 1114 2023-10-03T19:20:47.308 INFO:teuthology.orchestra.run.smithi045.stdout: -9721> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000030b) auth_unpin by 0x55cf62144b00 on [inode 0x1000000030b [2,head] /dc-dir/dc-file_278 auth v3574 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.661921+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62144b00] now 0 2023-10-03T19:20:47.308 INFO:teuthology.orchestra.run.smithi045.stdout: -9720> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+697 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62144b00 count now 1/697 2023-10-03T19:20:47.308 INFO:teuthology.orchestra.run.smithi045.stdout: -9719> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000030b) clear_dirty_parent 2023-10-03T19:20:47.308 INFO:teuthology.orchestra.run.smithi045.stdout: -9718> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000030c) _stored_backtrace v 1118 2023-10-03T19:20:47.308 INFO:teuthology.orchestra.run.smithi045.stdout: -9717> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000030c) auth_unpin by 0x55cf62145080 on [inode 0x1000000030c [2,head] /dc-dir/dc-file_279 auth v3576 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.672762+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62145080] now 0 2023-10-03T19:20:47.309 INFO:teuthology.orchestra.run.smithi045.stdout: -9716> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+696 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62145080 count now 1/696 2023-10-03T19:20:47.309 INFO:teuthology.orchestra.run.smithi045.stdout: -9715> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000030c) clear_dirty_parent 2023-10-03T19:20:47.309 INFO:teuthology.orchestra.run.smithi045.stdout: -9714> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000030d) _stored_backtrace v 1122 2023-10-03T19:20:47.309 INFO:teuthology.orchestra.run.smithi045.stdout: -9713> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000030d) auth_unpin by 0x55cf62145600 on [inode 0x1000000030d [2,head] /dc-dir/dc-file_280 auth v3578 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.684768+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62145600] now 0 2023-10-03T19:20:47.309 INFO:teuthology.orchestra.run.smithi045.stdout: -9712> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+695 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62145600 count now 1/695 2023-10-03T19:20:47.309 INFO:teuthology.orchestra.run.smithi045.stdout: -9711> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000030d) clear_dirty_parent 2023-10-03T19:20:47.309 INFO:teuthology.orchestra.run.smithi045.stdout: -9710> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000030e) _stored_backtrace v 1126 2023-10-03T19:20:47.309 INFO:teuthology.orchestra.run.smithi045.stdout: -9709> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000030e) auth_unpin by 0x55cf62145b80 on [inode 0x1000000030e [2,head] /dc-dir/dc-file_281 auth v3580 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.696091+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62145b80] now 0 2023-10-03T19:20:47.309 INFO:teuthology.orchestra.run.smithi045.stdout: -9708> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+694 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62145b80 count now 1/694 2023-10-03T19:20:47.309 INFO:teuthology.orchestra.run.smithi045.stdout: -9707> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000030e) clear_dirty_parent 2023-10-03T19:20:47.309 INFO:teuthology.orchestra.run.smithi045.stdout: -9706> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000030f) _stored_backtrace v 1130 2023-10-03T19:20:47.309 INFO:teuthology.orchestra.run.smithi045.stdout: -9705> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000030f) auth_unpin by 0x55cf62146100 on [inode 0x1000000030f [2,head] /dc-dir/dc-file_282 auth v3582 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.707536+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62146100] now 0 2023-10-03T19:20:47.309 INFO:teuthology.orchestra.run.smithi045.stdout: -9704> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+693 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62146100 count now 1/693 2023-10-03T19:20:47.310 INFO:teuthology.orchestra.run.smithi045.stdout: -9703> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000030f) clear_dirty_parent 2023-10-03T19:20:47.310 INFO:teuthology.orchestra.run.smithi045.stdout: -9702> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000310) _stored_backtrace v 1134 2023-10-03T19:20:47.310 INFO:teuthology.orchestra.run.smithi045.stdout: -9701> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000310) auth_unpin by 0x55cf62146680 on [inode 0x10000000310 [2,head] /dc-dir/dc-file_283 auth v3584 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.717973+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62146680] now 0 2023-10-03T19:20:47.310 INFO:teuthology.orchestra.run.smithi045.stdout: -9700> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+692 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62146680 count now 1/692 2023-10-03T19:20:47.310 INFO:teuthology.orchestra.run.smithi045.stdout: -9699> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000310) clear_dirty_parent 2023-10-03T19:20:47.310 INFO:teuthology.orchestra.run.smithi045.stdout: -9698> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000311) _stored_backtrace v 1138 2023-10-03T19:20:47.310 INFO:teuthology.orchestra.run.smithi045.stdout: -9697> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000311) auth_unpin by 0x55cf62146c00 on [inode 0x10000000311 [2,head] /dc-dir/dc-file_284 auth v3586 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.729059+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62146c00] now 0 2023-10-03T19:20:47.310 INFO:teuthology.orchestra.run.smithi045.stdout: -9696> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+691 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62146c00 count now 1/691 2023-10-03T19:20:47.310 INFO:teuthology.orchestra.run.smithi045.stdout: -9695> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000311) clear_dirty_parent 2023-10-03T19:20:47.310 INFO:teuthology.orchestra.run.smithi045.stdout: -9694> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000312) _stored_backtrace v 1142 2023-10-03T19:20:47.311 INFO:teuthology.orchestra.run.smithi045.stdout: -9693> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000312) auth_unpin by 0x55cf62147180 on [inode 0x10000000312 [2,head] /dc-dir/dc-file_285 auth v3588 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.739748+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62147180] now 0 2023-10-03T19:20:47.311 INFO:teuthology.orchestra.run.smithi045.stdout: -9692> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+690 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62147180 count now 1/690 2023-10-03T19:20:47.311 INFO:teuthology.orchestra.run.smithi045.stdout: -9691> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000312) clear_dirty_parent 2023-10-03T19:20:47.311 INFO:teuthology.orchestra.run.smithi045.stdout: -9690> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000313) _stored_backtrace v 1146 2023-10-03T19:20:47.311 INFO:teuthology.orchestra.run.smithi045.stdout: -9689> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000313) auth_unpin by 0x55cf62147700 on [inode 0x10000000313 [2,head] /dc-dir/dc-file_286 auth v3590 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.751004+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62147700] now 0 2023-10-03T19:20:47.311 INFO:teuthology.orchestra.run.smithi045.stdout: -9688> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+689 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62147700 count now 1/689 2023-10-03T19:20:47.311 INFO:teuthology.orchestra.run.smithi045.stdout: -9687> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000313) clear_dirty_parent 2023-10-03T19:20:47.311 INFO:teuthology.orchestra.run.smithi045.stdout: -9686> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000314) _stored_backtrace v 1150 2023-10-03T19:20:47.311 INFO:teuthology.orchestra.run.smithi045.stdout: -9685> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000314) auth_unpin by 0x55cf62154000 on [inode 0x10000000314 [2,head] /dc-dir/dc-file_287 auth v3592 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.762539+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62154000] now 0 2023-10-03T19:20:47.311 INFO:teuthology.orchestra.run.smithi045.stdout: -9684> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+688 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62154000 count now 1/688 2023-10-03T19:20:47.311 INFO:teuthology.orchestra.run.smithi045.stdout: -9683> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000314) clear_dirty_parent 2023-10-03T19:20:47.412 INFO:teuthology.orchestra.run.smithi045.stdout: -9682> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000315) _stored_backtrace v 1154 2023-10-03T19:20:47.412 INFO:teuthology.orchestra.run.smithi045.stdout: -9681> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000315) auth_unpin by 0x55cf62154580 on [inode 0x10000000315 [2,head] /dc-dir/dc-file_288 auth v3594 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.773552+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62154580] now 0 2023-10-03T19:20:47.412 INFO:teuthology.orchestra.run.smithi045.stdout: -9680> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+687 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62154580 count now 1/687 2023-10-03T19:20:47.412 INFO:teuthology.orchestra.run.smithi045.stdout: -9679> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000315) clear_dirty_parent 2023-10-03T19:20:47.412 INFO:teuthology.orchestra.run.smithi045.stdout: -9678> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000316) _stored_backtrace v 1158 2023-10-03T19:20:47.413 INFO:teuthology.orchestra.run.smithi045.stdout: -9677> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000316) auth_unpin by 0x55cf62154b00 on [inode 0x10000000316 [2,head] /dc-dir/dc-file_289 auth v3596 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.784863+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62154b00] now 0 2023-10-03T19:20:47.413 INFO:teuthology.orchestra.run.smithi045.stdout: -9676> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+686 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62154b00 count now 1/686 2023-10-03T19:20:47.413 INFO:teuthology.orchestra.run.smithi045.stdout: -9675> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000316) clear_dirty_parent 2023-10-03T19:20:47.413 INFO:teuthology.orchestra.run.smithi045.stdout: -9674> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000317) _stored_backtrace v 1162 2023-10-03T19:20:47.413 INFO:teuthology.orchestra.run.smithi045.stdout: -9673> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000317) auth_unpin by 0x55cf62155080 on [inode 0x10000000317 [2,head] /dc-dir/dc-file_290 auth v3598 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.795094+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62155080] now 0 2023-10-03T19:20:47.413 INFO:teuthology.orchestra.run.smithi045.stdout: -9672> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+685 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62155080 count now 1/685 2023-10-03T19:20:47.413 INFO:teuthology.orchestra.run.smithi045.stdout: -9671> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000317) clear_dirty_parent 2023-10-03T19:20:47.414 INFO:teuthology.orchestra.run.smithi045.stdout: -9670> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000318) _stored_backtrace v 1166 2023-10-03T19:20:47.414 INFO:teuthology.orchestra.run.smithi045.stdout: -9669> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000318) auth_unpin by 0x55cf62155600 on [inode 0x10000000318 [2,head] /dc-dir/dc-file_291 auth v3600 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.805671+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62155600] now 0 2023-10-03T19:20:47.414 INFO:teuthology.orchestra.run.smithi045.stdout: -9668> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+684 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62155600 count now 1/684 2023-10-03T19:20:47.414 INFO:teuthology.orchestra.run.smithi045.stdout: -9667> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000318) clear_dirty_parent 2023-10-03T19:20:47.414 INFO:teuthology.orchestra.run.smithi045.stdout: -9666> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000319) _stored_backtrace v 1170 2023-10-03T19:20:47.414 INFO:teuthology.orchestra.run.smithi045.stdout: -9665> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000319) auth_unpin by 0x55cf62155b80 on [inode 0x10000000319 [2,head] /dc-dir/dc-file_292 auth v3602 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.816495+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62155b80] now 0 2023-10-03T19:20:47.414 INFO:teuthology.orchestra.run.smithi045.stdout: -9664> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+683 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62155b80 count now 1/683 2023-10-03T19:20:47.414 INFO:teuthology.orchestra.run.smithi045.stdout: -9663> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000319) clear_dirty_parent 2023-10-03T19:20:47.414 INFO:teuthology.orchestra.run.smithi045.stdout: -9662> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000031a) _stored_backtrace v 1174 2023-10-03T19:20:47.414 INFO:teuthology.orchestra.run.smithi045.stdout: -9661> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000031a) auth_unpin by 0x55cf62156100 on [inode 0x1000000031a [2,head] /dc-dir/dc-file_293 auth v3604 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.827270+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62156100] now 0 2023-10-03T19:20:47.415 INFO:teuthology.orchestra.run.smithi045.stdout: -9660> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+682 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62156100 count now 1/682 2023-10-03T19:20:47.415 INFO:teuthology.orchestra.run.smithi045.stdout: -9659> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000031a) clear_dirty_parent 2023-10-03T19:20:47.415 INFO:teuthology.orchestra.run.smithi045.stdout: -9658> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000031b) _stored_backtrace v 1178 2023-10-03T19:20:47.415 INFO:teuthology.orchestra.run.smithi045.stdout: -9657> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000031b) auth_unpin by 0x55cf62156680 on [inode 0x1000000031b [2,head] /dc-dir/dc-file_294 auth v3606 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.839082+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62156680] now 0 2023-10-03T19:20:47.415 INFO:teuthology.orchestra.run.smithi045.stdout: -9656> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+681 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62156680 count now 1/681 2023-10-03T19:20:47.415 INFO:teuthology.orchestra.run.smithi045.stdout: -9655> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000031b) clear_dirty_parent 2023-10-03T19:20:47.415 INFO:teuthology.orchestra.run.smithi045.stdout: -9654> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000031c) _stored_backtrace v 1182 2023-10-03T19:20:47.415 INFO:teuthology.orchestra.run.smithi045.stdout: -9653> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000031c) auth_unpin by 0x55cf62156c00 on [inode 0x1000000031c [2,head] /dc-dir/dc-file_295 auth v3608 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.849919+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62156c00] now 0 2023-10-03T19:20:47.415 INFO:teuthology.orchestra.run.smithi045.stdout: -9652> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+680 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62156c00 count now 1/680 2023-10-03T19:20:47.415 INFO:teuthology.orchestra.run.smithi045.stdout: -9651> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000031c) clear_dirty_parent 2023-10-03T19:20:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: -9650> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000031d) _stored_backtrace v 1186 2023-10-03T19:20:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: -9649> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000031d) auth_unpin by 0x55cf62157180 on [inode 0x1000000031d [2,head] /dc-dir/dc-file_296 auth v3610 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.861619+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62157180] now 0 2023-10-03T19:20:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: -9648> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+679 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62157180 count now 1/679 2023-10-03T19:20:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: -9647> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000031d) clear_dirty_parent 2023-10-03T19:20:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: -9646> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000031e) _stored_backtrace v 1190 2023-10-03T19:20:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: -9645> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000031e) auth_unpin by 0x55cf62157700 on [inode 0x1000000031e [2,head] /dc-dir/dc-file_297 auth v3612 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.872805+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62157700] now 0 2023-10-03T19:20:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: -9644> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+678 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62157700 count now 1/678 2023-10-03T19:20:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: -9643> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000031e) clear_dirty_parent 2023-10-03T19:20:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: -9642> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000031f) _stored_backtrace v 1194 2023-10-03T19:20:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: -9641> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000031f) auth_unpin by 0x55cf6215a000 on [inode 0x1000000031f [2,head] /dc-dir/dc-file_298 auth v3614 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.885162+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6215a000] now 0 2023-10-03T19:20:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: -9640> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+677 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6215a000 count now 1/677 2023-10-03T19:20:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: -9639> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000031f) clear_dirty_parent 2023-10-03T19:20:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: -9638> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000320) _stored_backtrace v 1198 2023-10-03T19:20:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: -9637> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000320) auth_unpin by 0x55cf6215a580 on [inode 0x10000000320 [2,head] /dc-dir/dc-file_299 auth v3616 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.895875+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6215a580] now 0 2023-10-03T19:20:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: -9636> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+676 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6215a580 count now 1/676 2023-10-03T19:20:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: -9635> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000320) clear_dirty_parent 2023-10-03T19:20:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: -9634> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000321) _stored_backtrace v 1202 2023-10-03T19:20:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: -9633> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000321) auth_unpin by 0x55cf6215ab00 on [inode 0x10000000321 [2,head] /dc-dir/dc-file_300 auth v3618 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.908080+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6215ab00] now 0 2023-10-03T19:20:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: -9632> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+675 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6215ab00 count now 1/675 2023-10-03T19:20:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: -9631> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000321) clear_dirty_parent 2023-10-03T19:20:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: -9630> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000322) _stored_backtrace v 1206 2023-10-03T19:20:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: -9629> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000322) auth_unpin by 0x55cf6215b080 on [inode 0x10000000322 [2,head] /dc-dir/dc-file_301 auth v3620 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.920696+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6215b080] now 0 2023-10-03T19:20:47.418 INFO:teuthology.orchestra.run.smithi045.stdout: -9628> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+674 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6215b080 count now 1/674 2023-10-03T19:20:47.418 INFO:teuthology.orchestra.run.smithi045.stdout: -9627> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000322) clear_dirty_parent 2023-10-03T19:20:47.418 INFO:teuthology.orchestra.run.smithi045.stdout: -9626> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000323) _stored_backtrace v 1210 2023-10-03T19:20:47.418 INFO:teuthology.orchestra.run.smithi045.stdout: -9625> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000323) auth_unpin by 0x55cf6215b600 on [inode 0x10000000323 [2,head] /dc-dir/dc-file_302 auth v3622 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.933135+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6215b600] now 0 2023-10-03T19:20:47.418 INFO:teuthology.orchestra.run.smithi045.stdout: -9624> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+673 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6215b600 count now 1/673 2023-10-03T19:20:47.418 INFO:teuthology.orchestra.run.smithi045.stdout: -9623> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000323) clear_dirty_parent 2023-10-03T19:20:47.418 INFO:teuthology.orchestra.run.smithi045.stdout: -9622> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000324) _stored_backtrace v 1214 2023-10-03T19:20:47.418 INFO:teuthology.orchestra.run.smithi045.stdout: -9621> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000324) auth_unpin by 0x55cf6215bb80 on [inode 0x10000000324 [2,head] /dc-dir/dc-file_303 auth v3624 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.944259+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6215bb80] now 0 2023-10-03T19:20:47.418 INFO:teuthology.orchestra.run.smithi045.stdout: -9620> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+672 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6215bb80 count now 1/672 2023-10-03T19:20:47.418 INFO:teuthology.orchestra.run.smithi045.stdout: -9619> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000324) clear_dirty_parent 2023-10-03T19:20:47.419 INFO:teuthology.orchestra.run.smithi045.stdout: -9618> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000325) _stored_backtrace v 1218 2023-10-03T19:20:47.419 INFO:teuthology.orchestra.run.smithi045.stdout: -9617> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000325) auth_unpin by 0x55cf6215c100 on [inode 0x10000000325 [2,head] /dc-dir/dc-file_304 auth v3626 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.956531+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6215c100] now 0 2023-10-03T19:20:47.419 INFO:teuthology.orchestra.run.smithi045.stdout: -9616> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+671 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6215c100 count now 1/671 2023-10-03T19:20:47.419 INFO:teuthology.orchestra.run.smithi045.stdout: -9615> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000325) clear_dirty_parent 2023-10-03T19:20:47.419 INFO:teuthology.orchestra.run.smithi045.stdout: -9614> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000326) _stored_backtrace v 1222 2023-10-03T19:20:47.419 INFO:teuthology.orchestra.run.smithi045.stdout: -9613> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000326) auth_unpin by 0x55cf6215c680 on [inode 0x10000000326 [2,head] /dc-dir/dc-file_305 auth v3628 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.967274+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6215c680] now 0 2023-10-03T19:20:47.419 INFO:teuthology.orchestra.run.smithi045.stdout: -9612> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+670 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6215c680 count now 1/670 2023-10-03T19:20:47.419 INFO:teuthology.orchestra.run.smithi045.stdout: -9611> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000326) clear_dirty_parent 2023-10-03T19:20:47.419 INFO:teuthology.orchestra.run.smithi045.stdout: -9610> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000327) _stored_backtrace v 1226 2023-10-03T19:20:47.420 INFO:teuthology.orchestra.run.smithi045.stdout: -9609> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000327) auth_unpin by 0x55cf6215cc00 on [inode 0x10000000327 [2,head] /dc-dir/dc-file_306 auth v3630 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.977841+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6215cc00] now 0 2023-10-03T19:20:47.420 INFO:teuthology.orchestra.run.smithi045.stdout: -9608> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+669 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6215cc00 count now 1/669 2023-10-03T19:20:47.420 INFO:teuthology.orchestra.run.smithi045.stdout: -9607> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000327) clear_dirty_parent 2023-10-03T19:20:47.420 INFO:teuthology.orchestra.run.smithi045.stdout: -9606> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000328) _stored_backtrace v 1230 2023-10-03T19:20:47.420 INFO:teuthology.orchestra.run.smithi045.stdout: -9605> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000328) auth_unpin by 0x55cf6215d180 on [inode 0x10000000328 [2,head] /dc-dir/dc-file_307 auth v3632 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:37.989663+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6215d180] now 0 2023-10-03T19:20:47.420 INFO:teuthology.orchestra.run.smithi045.stdout: -9604> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+668 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6215d180 count now 1/668 2023-10-03T19:20:47.420 INFO:teuthology.orchestra.run.smithi045.stdout: -9603> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000328) clear_dirty_parent 2023-10-03T19:20:47.420 INFO:teuthology.orchestra.run.smithi045.stdout: -9602> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000329) _stored_backtrace v 1234 2023-10-03T19:20:47.420 INFO:teuthology.orchestra.run.smithi045.stdout: -9601> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000329) auth_unpin by 0x55cf6215d700 on [inode 0x10000000329 [2,head] /dc-dir/dc-file_308 auth v3634 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.003041+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6215d700] now 0 2023-10-03T19:20:47.420 INFO:teuthology.orchestra.run.smithi045.stdout: -9600> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+667 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6215d700 count now 1/667 2023-10-03T19:20:47.421 INFO:teuthology.orchestra.run.smithi045.stdout: -9599> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000329) clear_dirty_parent 2023-10-03T19:20:47.421 INFO:teuthology.orchestra.run.smithi045.stdout: -9598> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000032a) _stored_backtrace v 1238 2023-10-03T19:20:47.421 INFO:teuthology.orchestra.run.smithi045.stdout: -9597> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000032a) auth_unpin by 0x55cf62168000 on [inode 0x1000000032a [2,head] /dc-dir/dc-file_309 auth v3636 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.015935+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62168000] now 0 2023-10-03T19:20:47.421 INFO:teuthology.orchestra.run.smithi045.stdout: -9596> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+666 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62168000 count now 1/666 2023-10-03T19:20:47.421 INFO:teuthology.orchestra.run.smithi045.stdout: -9595> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000032a) clear_dirty_parent 2023-10-03T19:20:47.421 INFO:teuthology.orchestra.run.smithi045.stdout: -9594> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000032b) _stored_backtrace v 1242 2023-10-03T19:20:47.421 INFO:teuthology.orchestra.run.smithi045.stdout: -9593> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000032b) auth_unpin by 0x55cf62168580 on [inode 0x1000000032b [2,head] /dc-dir/dc-file_310 auth v3638 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.026805+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62168580] now 0 2023-10-03T19:20:47.421 INFO:teuthology.orchestra.run.smithi045.stdout: -9592> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+665 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62168580 count now 1/665 2023-10-03T19:20:47.421 INFO:teuthology.orchestra.run.smithi045.stdout: -9591> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000032b) clear_dirty_parent 2023-10-03T19:20:47.421 INFO:teuthology.orchestra.run.smithi045.stdout: -9590> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000032c) _stored_backtrace v 1246 2023-10-03T19:20:47.422 INFO:teuthology.orchestra.run.smithi045.stdout: -9589> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000032c) auth_unpin by 0x55cf62168b00 on [inode 0x1000000032c [2,head] /dc-dir/dc-file_311 auth v3640 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.038384+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62168b00] now 0 2023-10-03T19:20:47.422 INFO:teuthology.orchestra.run.smithi045.stdout: -9588> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+664 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62168b00 count now 1/664 2023-10-03T19:20:47.422 INFO:teuthology.orchestra.run.smithi045.stdout: -9587> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000032c) clear_dirty_parent 2023-10-03T19:20:47.422 INFO:teuthology.orchestra.run.smithi045.stdout: -9586> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000032d) _stored_backtrace v 1250 2023-10-03T19:20:47.422 INFO:teuthology.orchestra.run.smithi045.stdout: -9585> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000032d) auth_unpin by 0x55cf62169080 on [inode 0x1000000032d [2,head] /dc-dir/dc-file_312 auth v3642 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.051899+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62169080] now 0 2023-10-03T19:20:47.422 INFO:teuthology.orchestra.run.smithi045.stdout: -9584> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+663 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62169080 count now 1/663 2023-10-03T19:20:47.422 INFO:teuthology.orchestra.run.smithi045.stdout: -9583> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000032d) clear_dirty_parent 2023-10-03T19:20:47.422 INFO:teuthology.orchestra.run.smithi045.stdout: -9582> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000032e) _stored_backtrace v 1254 2023-10-03T19:20:47.422 INFO:teuthology.orchestra.run.smithi045.stdout: -9581> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000032e) auth_unpin by 0x55cf62169600 on [inode 0x1000000032e [2,head] /dc-dir/dc-file_313 auth v3644 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.064468+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62169600] now 0 2023-10-03T19:20:47.427 INFO:teuthology.orchestra.run.smithi045.stdout: -9580> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+662 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62169600 count now 1/662 2023-10-03T19:20:47.427 INFO:teuthology.orchestra.run.smithi045.stdout: -9579> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000032e) clear_dirty_parent 2023-10-03T19:20:47.427 INFO:teuthology.orchestra.run.smithi045.stdout: -9578> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000032f) _stored_backtrace v 1258 2023-10-03T19:20:47.427 INFO:teuthology.orchestra.run.smithi045.stdout: -9577> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000032f) auth_unpin by 0x55cf62169b80 on [inode 0x1000000032f [2,head] /dc-dir/dc-file_314 auth v3646 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.076806+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62169b80] now 0 2023-10-03T19:20:47.428 INFO:teuthology.orchestra.run.smithi045.stdout: -9576> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+661 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62169b80 count now 1/661 2023-10-03T19:20:47.428 INFO:teuthology.orchestra.run.smithi045.stdout: -9575> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000032f) clear_dirty_parent 2023-10-03T19:20:47.428 INFO:teuthology.orchestra.run.smithi045.stdout: -9574> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000330) _stored_backtrace v 1262 2023-10-03T19:20:47.428 INFO:teuthology.orchestra.run.smithi045.stdout: -9573> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000330) auth_unpin by 0x55cf6216a100 on [inode 0x10000000330 [2,head] /dc-dir/dc-file_315 auth v3648 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.089165+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6216a100] now 0 2023-10-03T19:20:47.428 INFO:teuthology.orchestra.run.smithi045.stdout: -9572> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+660 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6216a100 count now 1/660 2023-10-03T19:20:47.428 INFO:teuthology.orchestra.run.smithi045.stdout: -9571> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000330) clear_dirty_parent 2023-10-03T19:20:47.428 INFO:teuthology.orchestra.run.smithi045.stdout: -9570> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000331) _stored_backtrace v 1266 2023-10-03T19:20:47.428 INFO:teuthology.orchestra.run.smithi045.stdout: -9569> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000331) auth_unpin by 0x55cf6216a680 on [inode 0x10000000331 [2,head] /dc-dir/dc-file_316 auth v3650 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.100463+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6216a680] now 0 2023-10-03T19:20:47.428 INFO:teuthology.orchestra.run.smithi045.stdout: -9568> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+659 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6216a680 count now 1/659 2023-10-03T19:20:47.428 INFO:teuthology.orchestra.run.smithi045.stdout: -9567> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000331) clear_dirty_parent 2023-10-03T19:20:47.429 INFO:teuthology.orchestra.run.smithi045.stdout: -9566> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000332) _stored_backtrace v 1270 2023-10-03T19:20:47.429 INFO:teuthology.orchestra.run.smithi045.stdout: -9565> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000332) auth_unpin by 0x55cf6216ac00 on [inode 0x10000000332 [2,head] /dc-dir/dc-file_317 auth v3652 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.111334+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6216ac00] now 0 2023-10-03T19:20:47.429 INFO:teuthology.orchestra.run.smithi045.stdout: -9564> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+658 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6216ac00 count now 1/658 2023-10-03T19:20:47.429 INFO:teuthology.orchestra.run.smithi045.stdout: -9563> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000332) clear_dirty_parent 2023-10-03T19:20:47.429 INFO:teuthology.orchestra.run.smithi045.stdout: -9562> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000333) _stored_backtrace v 1274 2023-10-03T19:20:47.429 INFO:teuthology.orchestra.run.smithi045.stdout: -9561> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000333) auth_unpin by 0x55cf6216b180 on [inode 0x10000000333 [2,head] /dc-dir/dc-file_318 auth v3654 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.122314+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6216b180] now 0 2023-10-03T19:20:47.429 INFO:teuthology.orchestra.run.smithi045.stdout: -9560> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+657 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6216b180 count now 1/657 2023-10-03T19:20:47.429 INFO:teuthology.orchestra.run.smithi045.stdout: -9559> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000333) clear_dirty_parent 2023-10-03T19:20:47.429 INFO:teuthology.orchestra.run.smithi045.stdout: -9558> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000334) _stored_backtrace v 1278 2023-10-03T19:20:47.429 INFO:teuthology.orchestra.run.smithi045.stdout: -9557> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000334) auth_unpin by 0x55cf6216b700 on [inode 0x10000000334 [2,head] /dc-dir/dc-file_319 auth v3656 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.134732+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6216b700] now 0 2023-10-03T19:20:47.429 INFO:teuthology.orchestra.run.smithi045.stdout: -9556> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+656 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6216b700 count now 1/656 2023-10-03T19:20:47.430 INFO:teuthology.orchestra.run.smithi045.stdout: -9555> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000334) clear_dirty_parent 2023-10-03T19:20:47.430 INFO:teuthology.orchestra.run.smithi045.stdout: -9554> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000335) _stored_backtrace v 1282 2023-10-03T19:20:47.430 INFO:teuthology.orchestra.run.smithi045.stdout: -9553> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000335) auth_unpin by 0x55cf62176000 on [inode 0x10000000335 [2,head] /dc-dir/dc-file_320 auth v3658 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.147532+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62176000] now 0 2023-10-03T19:20:47.430 INFO:teuthology.orchestra.run.smithi045.stdout: -9552> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+655 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62176000 count now 1/655 2023-10-03T19:20:47.430 INFO:teuthology.orchestra.run.smithi045.stdout: -9551> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000335) clear_dirty_parent 2023-10-03T19:20:47.430 INFO:teuthology.orchestra.run.smithi045.stdout: -9550> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000336) _stored_backtrace v 1286 2023-10-03T19:20:47.430 INFO:teuthology.orchestra.run.smithi045.stdout: -9549> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000336) auth_unpin by 0x55cf62176580 on [inode 0x10000000336 [2,head] /dc-dir/dc-file_321 auth v3660 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.158174+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62176580] now 0 2023-10-03T19:20:47.430 INFO:teuthology.orchestra.run.smithi045.stdout: -9548> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+654 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62176580 count now 1/654 2023-10-03T19:20:47.430 INFO:teuthology.orchestra.run.smithi045.stdout: -9547> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000336) clear_dirty_parent 2023-10-03T19:20:47.430 INFO:teuthology.orchestra.run.smithi045.stdout: -9546> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000337) _stored_backtrace v 1290 2023-10-03T19:20:47.430 INFO:teuthology.orchestra.run.smithi045.stdout: -9545> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000337) auth_unpin by 0x55cf62176b00 on [inode 0x10000000337 [2,head] /dc-dir/dc-file_322 auth v3662 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.168909+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62176b00] now 0 2023-10-03T19:20:47.431 INFO:teuthology.orchestra.run.smithi045.stdout: -9544> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+653 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62176b00 count now 1/653 2023-10-03T19:20:47.431 INFO:teuthology.orchestra.run.smithi045.stdout: -9543> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000337) clear_dirty_parent 2023-10-03T19:20:47.431 INFO:teuthology.orchestra.run.smithi045.stdout: -9542> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000338) _stored_backtrace v 1294 2023-10-03T19:20:47.431 INFO:teuthology.orchestra.run.smithi045.stdout: -9541> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000338) auth_unpin by 0x55cf62177080 on [inode 0x10000000338 [2,head] /dc-dir/dc-file_323 auth v3664 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.179715+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62177080] now 0 2023-10-03T19:20:47.431 INFO:teuthology.orchestra.run.smithi045.stdout: -9540> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+652 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62177080 count now 1/652 2023-10-03T19:20:47.431 INFO:teuthology.orchestra.run.smithi045.stdout: -9539> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000338) clear_dirty_parent 2023-10-03T19:20:47.431 INFO:teuthology.orchestra.run.smithi045.stdout: -9538> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000339) _stored_backtrace v 1298 2023-10-03T19:20:47.431 INFO:teuthology.orchestra.run.smithi045.stdout: -9537> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000339) auth_unpin by 0x55cf62177600 on [inode 0x10000000339 [2,head] /dc-dir/dc-file_324 auth v3666 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.190478+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62177600] now 0 2023-10-03T19:20:47.431 INFO:teuthology.orchestra.run.smithi045.stdout: -9536> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+651 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62177600 count now 1/651 2023-10-03T19:20:47.431 INFO:teuthology.orchestra.run.smithi045.stdout: -9535> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000339) clear_dirty_parent 2023-10-03T19:20:47.431 INFO:teuthology.orchestra.run.smithi045.stdout: -9534> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000033a) _stored_backtrace v 1302 2023-10-03T19:20:47.431 INFO:teuthology.orchestra.run.smithi045.stdout: -9533> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000033a) auth_unpin by 0x55cf62177b80 on [inode 0x1000000033a [2,head] /dc-dir/dc-file_325 auth v3668 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.202501+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62177b80] now 0 2023-10-03T19:20:47.432 INFO:teuthology.orchestra.run.smithi045.stdout: -9532> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+650 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62177b80 count now 1/650 2023-10-03T19:20:47.432 INFO:teuthology.orchestra.run.smithi045.stdout: -9531> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000033a) clear_dirty_parent 2023-10-03T19:20:47.432 INFO:teuthology.orchestra.run.smithi045.stdout: -9530> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000033b) _stored_backtrace v 1306 2023-10-03T19:20:47.432 INFO:teuthology.orchestra.run.smithi045.stdout: -9529> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000033b) auth_unpin by 0x55cf62178100 on [inode 0x1000000033b [2,head] /dc-dir/dc-file_326 auth v3670 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.213593+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62178100] now 0 2023-10-03T19:20:47.432 INFO:teuthology.orchestra.run.smithi045.stdout: -9528> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+649 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62178100 count now 1/649 2023-10-03T19:20:47.432 INFO:teuthology.orchestra.run.smithi045.stdout: -9527> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000033b) clear_dirty_parent 2023-10-03T19:20:47.432 INFO:teuthology.orchestra.run.smithi045.stdout: -9526> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000033c) _stored_backtrace v 1310 2023-10-03T19:20:47.432 INFO:teuthology.orchestra.run.smithi045.stdout: -9525> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000033c) auth_unpin by 0x55cf62178680 on [inode 0x1000000033c [2,head] /dc-dir/dc-file_327 auth v3672 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.224668+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62178680] now 0 2023-10-03T19:20:47.432 INFO:teuthology.orchestra.run.smithi045.stdout: -9524> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+648 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62178680 count now 1/648 2023-10-03T19:20:47.432 INFO:teuthology.orchestra.run.smithi045.stdout: -9523> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000033c) clear_dirty_parent 2023-10-03T19:20:47.432 INFO:teuthology.orchestra.run.smithi045.stdout: -9522> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000033d) _stored_backtrace v 1314 2023-10-03T19:20:47.433 INFO:teuthology.orchestra.run.smithi045.stdout: -9521> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000033d) auth_unpin by 0x55cf62178c00 on [inode 0x1000000033d [2,head] /dc-dir/dc-file_328 auth v3674 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.235934+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62178c00] now 0 2023-10-03T19:20:47.433 INFO:teuthology.orchestra.run.smithi045.stdout: -9520> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+647 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62178c00 count now 1/647 2023-10-03T19:20:47.433 INFO:teuthology.orchestra.run.smithi045.stdout: -9519> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000033d) clear_dirty_parent 2023-10-03T19:20:47.433 INFO:teuthology.orchestra.run.smithi045.stdout: -9518> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000033e) _stored_backtrace v 1318 2023-10-03T19:20:47.433 INFO:teuthology.orchestra.run.smithi045.stdout: -9517> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000033e) auth_unpin by 0x55cf62179180 on [inode 0x1000000033e [2,head] /dc-dir/dc-file_329 auth v3676 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.246829+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62179180] now 0 2023-10-03T19:20:47.433 INFO:teuthology.orchestra.run.smithi045.stdout: -9516> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+646 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62179180 count now 1/646 2023-10-03T19:20:47.452 INFO:teuthology.orchestra.run.smithi045.stdout: -9515> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000033e) clear_dirty_parent 2023-10-03T19:20:47.452 INFO:teuthology.orchestra.run.smithi045.stdout: -9514> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000033f) _stored_backtrace v 1322 2023-10-03T19:20:47.452 INFO:teuthology.orchestra.run.smithi045.stdout: -9513> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000033f) auth_unpin by 0x55cf62179700 on [inode 0x1000000033f [2,head] /dc-dir/dc-file_330 auth v3678 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.258037+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62179700] now 0 2023-10-03T19:20:47.453 INFO:teuthology.orchestra.run.smithi045.stdout: -9512> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+645 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62179700 count now 1/645 2023-10-03T19:20:47.453 INFO:teuthology.orchestra.run.smithi045.stdout: -9511> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000033f) clear_dirty_parent 2023-10-03T19:20:47.453 INFO:teuthology.orchestra.run.smithi045.stdout: -9510> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000340) _stored_backtrace v 1326 2023-10-03T19:20:47.453 INFO:teuthology.orchestra.run.smithi045.stdout: -9509> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000340) auth_unpin by 0x55cf62182000 on [inode 0x10000000340 [2,head] /dc-dir/dc-file_331 auth v3680 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.269114+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62182000] now 0 2023-10-03T19:20:47.453 INFO:teuthology.orchestra.run.smithi045.stdout: -9508> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+644 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62182000 count now 1/644 2023-10-03T19:20:47.453 INFO:teuthology.orchestra.run.smithi045.stdout: -9507> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000340) clear_dirty_parent 2023-10-03T19:20:47.453 INFO:teuthology.orchestra.run.smithi045.stdout: -9506> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000341) _stored_backtrace v 1330 2023-10-03T19:20:47.453 INFO:teuthology.orchestra.run.smithi045.stdout: -9505> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000341) auth_unpin by 0x55cf62182580 on [inode 0x10000000341 [2,head] /dc-dir/dc-file_332 auth v3682 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.279909+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62182580] now 0 2023-10-03T19:20:47.453 INFO:teuthology.orchestra.run.smithi045.stdout: -9504> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+643 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62182580 count now 1/643 2023-10-03T19:20:47.453 INFO:teuthology.orchestra.run.smithi045.stdout: -9503> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000341) clear_dirty_parent 2023-10-03T19:20:47.453 INFO:teuthology.orchestra.run.smithi045.stdout: -9502> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000342) _stored_backtrace v 1334 2023-10-03T19:20:47.454 INFO:teuthology.orchestra.run.smithi045.stdout: -9501> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000342) auth_unpin by 0x55cf62182b00 on [inode 0x10000000342 [2,head] /dc-dir/dc-file_333 auth v3684 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.290747+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62182b00] now 0 2023-10-03T19:20:47.454 INFO:teuthology.orchestra.run.smithi045.stdout: -9500> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+642 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62182b00 count now 1/642 2023-10-03T19:20:47.454 INFO:teuthology.orchestra.run.smithi045.stdout: -9499> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000342) clear_dirty_parent 2023-10-03T19:20:47.454 INFO:teuthology.orchestra.run.smithi045.stdout: -9498> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000343) _stored_backtrace v 1338 2023-10-03T19:20:47.454 INFO:teuthology.orchestra.run.smithi045.stdout: -9497> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000343) auth_unpin by 0x55cf62183080 on [inode 0x10000000343 [2,head] /dc-dir/dc-file_334 auth v3686 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.302027+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62183080] now 0 2023-10-03T19:20:47.454 INFO:teuthology.orchestra.run.smithi045.stdout: -9496> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+641 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62183080 count now 1/641 2023-10-03T19:20:47.454 INFO:teuthology.orchestra.run.smithi045.stdout: -9495> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000343) clear_dirty_parent 2023-10-03T19:20:47.454 INFO:teuthology.orchestra.run.smithi045.stdout: -9494> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000344) _stored_backtrace v 1342 2023-10-03T19:20:47.454 INFO:teuthology.orchestra.run.smithi045.stdout: -9493> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000344) auth_unpin by 0x55cf62183600 on [inode 0x10000000344 [2,head] /dc-dir/dc-file_335 auth v3688 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.313684+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62183600] now 0 2023-10-03T19:20:47.454 INFO:teuthology.orchestra.run.smithi045.stdout: -9492> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+640 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62183600 count now 1/640 2023-10-03T19:20:47.455 INFO:teuthology.orchestra.run.smithi045.stdout: -9491> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000344) clear_dirty_parent 2023-10-03T19:20:47.455 INFO:teuthology.orchestra.run.smithi045.stdout: -9490> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000345) _stored_backtrace v 1346 2023-10-03T19:20:47.455 INFO:teuthology.orchestra.run.smithi045.stdout: -9489> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000345) auth_unpin by 0x55cf62183b80 on [inode 0x10000000345 [2,head] /dc-dir/dc-file_336 auth v3690 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.324441+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62183b80] now 0 2023-10-03T19:20:47.455 INFO:teuthology.orchestra.run.smithi045.stdout: -9488> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+639 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62183b80 count now 1/639 2023-10-03T19:20:47.455 INFO:teuthology.orchestra.run.smithi045.stdout: -9487> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000345) clear_dirty_parent 2023-10-03T19:20:47.455 INFO:teuthology.orchestra.run.smithi045.stdout: -9486> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000346) _stored_backtrace v 1350 2023-10-03T19:20:47.455 INFO:teuthology.orchestra.run.smithi045.stdout: -9485> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000346) auth_unpin by 0x55cf62184100 on [inode 0x10000000346 [2,head] /dc-dir/dc-file_337 auth v3692 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.337236+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62184100] now 0 2023-10-03T19:20:47.455 INFO:teuthology.orchestra.run.smithi045.stdout: -9484> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+638 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62184100 count now 1/638 2023-10-03T19:20:47.455 INFO:teuthology.orchestra.run.smithi045.stdout: -9483> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000346) clear_dirty_parent 2023-10-03T19:20:47.455 INFO:teuthology.orchestra.run.smithi045.stdout: -9482> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000347) _stored_backtrace v 1354 2023-10-03T19:20:47.455 INFO:teuthology.orchestra.run.smithi045.stdout: -9481> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000347) auth_unpin by 0x55cf62184680 on [inode 0x10000000347 [2,head] /dc-dir/dc-file_338 auth v3694 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.349680+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62184680] now 0 2023-10-03T19:20:47.456 INFO:teuthology.orchestra.run.smithi045.stdout: -9480> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+637 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62184680 count now 1/637 2023-10-03T19:20:47.456 INFO:teuthology.orchestra.run.smithi045.stdout: -9479> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000347) clear_dirty_parent 2023-10-03T19:20:47.456 INFO:teuthology.orchestra.run.smithi045.stdout: -9478> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000348) _stored_backtrace v 1358 2023-10-03T19:20:47.456 INFO:teuthology.orchestra.run.smithi045.stdout: -9477> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000348) auth_unpin by 0x55cf62184c00 on [inode 0x10000000348 [2,head] /dc-dir/dc-file_339 auth v3696 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.360737+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62184c00] now 0 2023-10-03T19:20:47.456 INFO:teuthology.orchestra.run.smithi045.stdout: -9476> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+636 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62184c00 count now 1/636 2023-10-03T19:20:47.456 INFO:teuthology.orchestra.run.smithi045.stdout: -9475> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000348) clear_dirty_parent 2023-10-03T19:20:47.456 INFO:teuthology.orchestra.run.smithi045.stdout: -9474> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000349) _stored_backtrace v 1362 2023-10-03T19:20:47.456 INFO:teuthology.orchestra.run.smithi045.stdout: -9473> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000349) auth_unpin by 0x55cf62185180 on [inode 0x10000000349 [2,head] /dc-dir/dc-file_340 auth v3698 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.371735+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62185180] now 0 2023-10-03T19:20:47.456 INFO:teuthology.orchestra.run.smithi045.stdout: -9472> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+635 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62185180 count now 1/635 2023-10-03T19:20:47.456 INFO:teuthology.orchestra.run.smithi045.stdout: -9471> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000349) clear_dirty_parent 2023-10-03T19:20:47.457 INFO:teuthology.orchestra.run.smithi045.stdout: -9470> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000034a) _stored_backtrace v 1366 2023-10-03T19:20:47.457 INFO:teuthology.orchestra.run.smithi045.stdout: -9469> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000034a) auth_unpin by 0x55cf62185700 on [inode 0x1000000034a [2,head] /dc-dir/dc-file_341 auth v3700 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.382812+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62185700] now 0 2023-10-03T19:20:47.457 INFO:teuthology.orchestra.run.smithi045.stdout: -9468> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+634 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62185700 count now 1/634 2023-10-03T19:20:47.457 INFO:teuthology.orchestra.run.smithi045.stdout: -9467> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000034a) clear_dirty_parent 2023-10-03T19:20:47.457 INFO:teuthology.orchestra.run.smithi045.stdout: -9466> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000034b) _stored_backtrace v 1370 2023-10-03T19:20:47.457 INFO:teuthology.orchestra.run.smithi045.stdout: -9465> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000034b) auth_unpin by 0x55cf62190000 on [inode 0x1000000034b [2,head] /dc-dir/dc-file_342 auth v3702 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.395685+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62190000] now 0 2023-10-03T19:20:47.457 INFO:teuthology.orchestra.run.smithi045.stdout: -9464> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+633 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62190000 count now 1/633 2023-10-03T19:20:47.457 INFO:teuthology.orchestra.run.smithi045.stdout: -9463> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000034b) clear_dirty_parent 2023-10-03T19:20:47.457 INFO:teuthology.orchestra.run.smithi045.stdout: -9462> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000034c) _stored_backtrace v 1374 2023-10-03T19:20:47.458 INFO:teuthology.orchestra.run.smithi045.stdout: -9461> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000034c) auth_unpin by 0x55cf62190580 on [inode 0x1000000034c [2,head] /dc-dir/dc-file_343 auth v3704 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.408829+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62190580] now 0 2023-10-03T19:20:47.458 INFO:teuthology.orchestra.run.smithi045.stdout: -9460> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+632 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62190580 count now 1/632 2023-10-03T19:20:47.458 INFO:teuthology.orchestra.run.smithi045.stdout: -9459> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000034c) clear_dirty_parent 2023-10-03T19:20:47.458 INFO:teuthology.orchestra.run.smithi045.stdout: -9458> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000034d) _stored_backtrace v 1378 2023-10-03T19:20:47.458 INFO:teuthology.orchestra.run.smithi045.stdout: -9457> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000034d) auth_unpin by 0x55cf62190b00 on [inode 0x1000000034d [2,head] /dc-dir/dc-file_344 auth v3706 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.421906+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62190b00] now 0 2023-10-03T19:20:47.458 INFO:teuthology.orchestra.run.smithi045.stdout: -9456> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+631 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62190b00 count now 1/631 2023-10-03T19:20:47.458 INFO:teuthology.orchestra.run.smithi045.stdout: -9455> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000034d) clear_dirty_parent 2023-10-03T19:20:47.458 INFO:teuthology.orchestra.run.smithi045.stdout: -9454> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000034e) _stored_backtrace v 1382 2023-10-03T19:20:47.458 INFO:teuthology.orchestra.run.smithi045.stdout: -9453> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000034e) auth_unpin by 0x55cf62191080 on [inode 0x1000000034e [2,head] /dc-dir/dc-file_345 auth v3708 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.435755+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62191080] now 0 2023-10-03T19:20:47.458 INFO:teuthology.orchestra.run.smithi045.stdout: -9452> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+630 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62191080 count now 1/630 2023-10-03T19:20:47.459 INFO:teuthology.orchestra.run.smithi045.stdout: -9451> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000034e) clear_dirty_parent 2023-10-03T19:20:47.459 INFO:teuthology.orchestra.run.smithi045.stdout: -9450> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000034f) _stored_backtrace v 1386 2023-10-03T19:20:47.459 INFO:teuthology.orchestra.run.smithi045.stdout: -9449> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000034f) auth_unpin by 0x55cf62191600 on [inode 0x1000000034f [2,head] /dc-dir/dc-file_346 auth v3710 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.448900+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62191600] now 0 2023-10-03T19:20:47.459 INFO:teuthology.orchestra.run.smithi045.stdout: -9448> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+629 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62191600 count now 1/629 2023-10-03T19:20:47.459 INFO:teuthology.orchestra.run.smithi045.stdout: -9447> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000034f) clear_dirty_parent 2023-10-03T19:20:47.459 INFO:teuthology.orchestra.run.smithi045.stdout: -9446> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000350) _stored_backtrace v 1390 2023-10-03T19:20:47.459 INFO:teuthology.orchestra.run.smithi045.stdout: -9445> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000350) auth_unpin by 0x55cf62191b80 on [inode 0x10000000350 [2,head] /dc-dir/dc-file_347 auth v3712 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.460642+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62191b80] now 0 2023-10-03T19:20:47.459 INFO:teuthology.orchestra.run.smithi045.stdout: -9444> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+628 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62191b80 count now 1/628 2023-10-03T19:20:47.459 INFO:teuthology.orchestra.run.smithi045.stdout: -9443> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000350) clear_dirty_parent 2023-10-03T19:20:47.459 INFO:teuthology.orchestra.run.smithi045.stdout: -9442> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000351) _stored_backtrace v 1394 2023-10-03T19:20:47.459 INFO:teuthology.orchestra.run.smithi045.stdout: -9441> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000351) auth_unpin by 0x55cf62192100 on [inode 0x10000000351 [2,head] /dc-dir/dc-file_348 auth v3714 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.471555+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62192100] now 0 2023-10-03T19:20:47.460 INFO:teuthology.orchestra.run.smithi045.stdout: -9440> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+627 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62192100 count now 1/627 2023-10-03T19:20:47.460 INFO:teuthology.orchestra.run.smithi045.stdout: -9439> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000351) clear_dirty_parent 2023-10-03T19:20:47.460 INFO:teuthology.orchestra.run.smithi045.stdout: -9438> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000352) _stored_backtrace v 1398 2023-10-03T19:20:47.460 INFO:teuthology.orchestra.run.smithi045.stdout: -9437> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000352) auth_unpin by 0x55cf62192680 on [inode 0x10000000352 [2,head] /dc-dir/dc-file_349 auth v3716 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.484242+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62192680] now 0 2023-10-03T19:20:47.460 INFO:teuthology.orchestra.run.smithi045.stdout: -9436> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+626 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62192680 count now 1/626 2023-10-03T19:20:47.460 INFO:teuthology.orchestra.run.smithi045.stdout: -9435> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000352) clear_dirty_parent 2023-10-03T19:20:47.460 INFO:teuthology.orchestra.run.smithi045.stdout: -9434> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000353) _stored_backtrace v 1402 2023-10-03T19:20:47.460 INFO:teuthology.orchestra.run.smithi045.stdout: -9433> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000353) auth_unpin by 0x55cf62192c00 on [inode 0x10000000353 [2,head] /dc-dir/dc-file_350 auth v4010 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.497207+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62192c00] now 0 2023-10-03T19:20:47.460 INFO:teuthology.orchestra.run.smithi045.stdout: -9432> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+625 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62192c00 count now 1/625 2023-10-03T19:20:47.460 INFO:teuthology.orchestra.run.smithi045.stdout: -9431> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000353) clear_dirty_parent 2023-10-03T19:20:47.460 INFO:teuthology.orchestra.run.smithi045.stdout: -9430> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000354) _stored_backtrace v 1406 2023-10-03T19:20:47.460 INFO:teuthology.orchestra.run.smithi045.stdout: -9429> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000354) auth_unpin by 0x55cf62193180 on [inode 0x10000000354 [2,head] /dc-dir/dc-file_351 auth v4012 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.510887+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62193180] now 0 2023-10-03T19:20:47.461 INFO:teuthology.orchestra.run.smithi045.stdout: -9428> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+624 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62193180 count now 1/624 2023-10-03T19:20:47.461 INFO:teuthology.orchestra.run.smithi045.stdout: -9427> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000354) clear_dirty_parent 2023-10-03T19:20:47.461 INFO:teuthology.orchestra.run.smithi045.stdout: -9426> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000355) _stored_backtrace v 1410 2023-10-03T19:20:47.461 INFO:teuthology.orchestra.run.smithi045.stdout: -9425> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000355) auth_unpin by 0x55cf62193700 on [inode 0x10000000355 [2,head] /dc-dir/dc-file_352 auth v4014 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.523120+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62193700] now 0 2023-10-03T19:20:47.461 INFO:teuthology.orchestra.run.smithi045.stdout: -9424> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+623 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62193700 count now 1/623 2023-10-03T19:20:47.461 INFO:teuthology.orchestra.run.smithi045.stdout: -9423> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000355) clear_dirty_parent 2023-10-03T19:20:47.461 INFO:teuthology.orchestra.run.smithi045.stdout: -9422> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000356) _stored_backtrace v 1414 2023-10-03T19:20:47.461 INFO:teuthology.orchestra.run.smithi045.stdout: -9421> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000356) auth_unpin by 0x55cf6219e000 on [inode 0x10000000356 [2,head] /dc-dir/dc-file_353 auth v4016 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.534585+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6219e000] now 0 2023-10-03T19:20:47.461 INFO:teuthology.orchestra.run.smithi045.stdout: -9420> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+622 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6219e000 count now 1/622 2023-10-03T19:20:47.461 INFO:teuthology.orchestra.run.smithi045.stdout: -9419> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000356) clear_dirty_parent 2023-10-03T19:20:47.461 INFO:teuthology.orchestra.run.smithi045.stdout: -9418> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000357) _stored_backtrace v 1418 2023-10-03T19:20:47.462 INFO:teuthology.orchestra.run.smithi045.stdout: -9417> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000357) auth_unpin by 0x55cf6219e580 on [inode 0x10000000357 [2,head] /dc-dir/dc-file_354 auth v4018 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.545931+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6219e580] now 0 2023-10-03T19:20:47.462 INFO:teuthology.orchestra.run.smithi045.stdout: -9416> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+621 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6219e580 count now 1/621 2023-10-03T19:20:47.462 INFO:teuthology.orchestra.run.smithi045.stdout: -9415> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000357) clear_dirty_parent 2023-10-03T19:20:47.462 INFO:teuthology.orchestra.run.smithi045.stdout: -9414> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000358) _stored_backtrace v 1422 2023-10-03T19:20:47.462 INFO:teuthology.orchestra.run.smithi045.stdout: -9413> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000358) auth_unpin by 0x55cf6219eb00 on [inode 0x10000000358 [2,head] /dc-dir/dc-file_355 auth v4020 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.557120+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6219eb00] now 0 2023-10-03T19:20:47.462 INFO:teuthology.orchestra.run.smithi045.stdout: -9412> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+620 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6219eb00 count now 1/620 2023-10-03T19:20:47.462 INFO:teuthology.orchestra.run.smithi045.stdout: -9411> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000358) clear_dirty_parent 2023-10-03T19:20:47.462 INFO:teuthology.orchestra.run.smithi045.stdout: -9410> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000359) _stored_backtrace v 1426 2023-10-03T19:20:47.462 INFO:teuthology.orchestra.run.smithi045.stdout: -9409> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000359) auth_unpin by 0x55cf6219f080 on [inode 0x10000000359 [2,head] /dc-dir/dc-file_356 auth v4022 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.567987+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6219f080] now 0 2023-10-03T19:20:47.462 INFO:teuthology.orchestra.run.smithi045.stdout: -9408> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+619 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6219f080 count now 1/619 2023-10-03T19:20:47.462 INFO:teuthology.orchestra.run.smithi045.stdout: -9407> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000359) clear_dirty_parent 2023-10-03T19:20:47.462 INFO:teuthology.orchestra.run.smithi045.stdout: -9406> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000035a) _stored_backtrace v 1430 2023-10-03T19:20:47.463 INFO:teuthology.orchestra.run.smithi045.stdout: -9405> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000035a) auth_unpin by 0x55cf6219f600 on [inode 0x1000000035a [2,head] /dc-dir/dc-file_357 auth v4024 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.579309+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6219f600] now 0 2023-10-03T19:20:47.463 INFO:teuthology.orchestra.run.smithi045.stdout: -9404> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+618 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6219f600 count now 1/618 2023-10-03T19:20:47.463 INFO:teuthology.orchestra.run.smithi045.stdout: -9403> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000035a) clear_dirty_parent 2023-10-03T19:20:47.463 INFO:teuthology.orchestra.run.smithi045.stdout: -9402> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000035b) _stored_backtrace v 1434 2023-10-03T19:20:47.463 INFO:teuthology.orchestra.run.smithi045.stdout: -9401> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000035b) auth_unpin by 0x55cf6219fb80 on [inode 0x1000000035b [2,head] /dc-dir/dc-file_358 auth v4026 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.590530+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6219fb80] now 0 2023-10-03T19:20:47.463 INFO:teuthology.orchestra.run.smithi045.stdout: -9400> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+617 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6219fb80 count now 1/617 2023-10-03T19:20:47.463 INFO:teuthology.orchestra.run.smithi045.stdout: -9399> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000035b) clear_dirty_parent 2023-10-03T19:20:47.463 INFO:teuthology.orchestra.run.smithi045.stdout: -9398> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000035c) _stored_backtrace v 1438 2023-10-03T19:20:47.463 INFO:teuthology.orchestra.run.smithi045.stdout: -9397> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000035c) auth_unpin by 0x55cf621a0100 on [inode 0x1000000035c [2,head] /dc-dir/dc-file_359 auth v4028 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.601600+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621a0100] now 0 2023-10-03T19:20:47.463 INFO:teuthology.orchestra.run.smithi045.stdout: -9396> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+616 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621a0100 count now 1/616 2023-10-03T19:20:47.463 INFO:teuthology.orchestra.run.smithi045.stdout: -9395> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000035c) clear_dirty_parent 2023-10-03T19:20:47.464 INFO:teuthology.orchestra.run.smithi045.stdout: -9394> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000035d) _stored_backtrace v 1442 2023-10-03T19:20:47.464 INFO:teuthology.orchestra.run.smithi045.stdout: -9393> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000035d) auth_unpin by 0x55cf621a0680 on [inode 0x1000000035d [2,head] /dc-dir/dc-file_360 auth v4030 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.612503+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621a0680] now 0 2023-10-03T19:20:47.464 INFO:teuthology.orchestra.run.smithi045.stdout: -9392> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+615 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621a0680 count now 1/615 2023-10-03T19:20:47.464 INFO:teuthology.orchestra.run.smithi045.stdout: -9391> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000035d) clear_dirty_parent 2023-10-03T19:20:47.464 INFO:teuthology.orchestra.run.smithi045.stdout: -9390> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000035e) _stored_backtrace v 1446 2023-10-03T19:20:47.464 INFO:teuthology.orchestra.run.smithi045.stdout: -9389> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000035e) auth_unpin by 0x55cf621a0c00 on [inode 0x1000000035e [2,head] /dc-dir/dc-file_361 auth v4032 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.623776+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621a0c00] now 0 2023-10-03T19:20:47.464 INFO:teuthology.orchestra.run.smithi045.stdout: -9388> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+614 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621a0c00 count now 1/614 2023-10-03T19:20:47.464 INFO:teuthology.orchestra.run.smithi045.stdout: -9387> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000035e) clear_dirty_parent 2023-10-03T19:20:47.464 INFO:teuthology.orchestra.run.smithi045.stdout: -9386> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000035f) _stored_backtrace v 1450 2023-10-03T19:20:47.464 INFO:teuthology.orchestra.run.smithi045.stdout: -9385> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000035f) auth_unpin by 0x55cf621a1180 on [inode 0x1000000035f [2,head] /dc-dir/dc-file_362 auth v4034 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.634593+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621a1180] now 0 2023-10-03T19:20:47.464 INFO:teuthology.orchestra.run.smithi045.stdout: -9384> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+613 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621a1180 count now 1/613 2023-10-03T19:20:47.464 INFO:teuthology.orchestra.run.smithi045.stdout: -9383> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000035f) clear_dirty_parent 2023-10-03T19:20:47.464 INFO:teuthology.orchestra.run.smithi045.stdout: -9382> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000360) _stored_backtrace v 1454 2023-10-03T19:20:47.465 INFO:teuthology.orchestra.run.smithi045.stdout: -9381> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000360) auth_unpin by 0x55cf621a1700 on [inode 0x10000000360 [2,head] /dc-dir/dc-file_363 auth v4036 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.645806+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621a1700] now 0 2023-10-03T19:20:47.465 INFO:teuthology.orchestra.run.smithi045.stdout: -9380> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+612 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621a1700 count now 1/612 2023-10-03T19:20:47.465 INFO:teuthology.orchestra.run.smithi045.stdout: -9379> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000360) clear_dirty_parent 2023-10-03T19:20:47.465 INFO:teuthology.orchestra.run.smithi045.stdout: -9378> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000361) _stored_backtrace v 1458 2023-10-03T19:20:47.465 INFO:teuthology.orchestra.run.smithi045.stdout: -9377> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000361) auth_unpin by 0x55cf621a8000 on [inode 0x10000000361 [2,head] /dc-dir/dc-file_364 auth v4038 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.657339+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621a8000] now 0 2023-10-03T19:20:47.566 INFO:teuthology.orchestra.run.smithi045.stdout: -9376> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+611 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621a8000 count now 1/611 2023-10-03T19:20:47.566 INFO:teuthology.orchestra.run.smithi045.stdout: -9375> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000361) clear_dirty_parent 2023-10-03T19:20:47.566 INFO:teuthology.orchestra.run.smithi045.stdout: -9374> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000362) _stored_backtrace v 1462 2023-10-03T19:20:47.566 INFO:teuthology.orchestra.run.smithi045.stdout: -9373> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000362) auth_unpin by 0x55cf621a8580 on [inode 0x10000000362 [2,head] /dc-dir/dc-file_365 auth v4040 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.668338+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621a8580] now 0 2023-10-03T19:20:47.566 INFO:teuthology.orchestra.run.smithi045.stdout: -9372> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+610 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621a8580 count now 1/610 2023-10-03T19:20:47.566 INFO:teuthology.orchestra.run.smithi045.stdout: -9371> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000362) clear_dirty_parent 2023-10-03T19:20:47.566 INFO:teuthology.orchestra.run.smithi045.stdout: -9370> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000363) _stored_backtrace v 1466 2023-10-03T19:20:47.566 INFO:teuthology.orchestra.run.smithi045.stdout: -9369> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000363) auth_unpin by 0x55cf621a8b00 on [inode 0x10000000363 [2,head] /dc-dir/dc-file_366 auth v4042 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.679026+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621a8b00] now 0 2023-10-03T19:20:47.566 INFO:teuthology.orchestra.run.smithi045.stdout: -9368> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+609 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621a8b00 count now 1/609 2023-10-03T19:20:47.567 INFO:teuthology.orchestra.run.smithi045.stdout: -9367> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000363) clear_dirty_parent 2023-10-03T19:20:47.567 INFO:teuthology.orchestra.run.smithi045.stdout: -9366> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000364) _stored_backtrace v 1470 2023-10-03T19:20:47.567 INFO:teuthology.orchestra.run.smithi045.stdout: -9365> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000364) auth_unpin by 0x55cf621a9080 on [inode 0x10000000364 [2,head] /dc-dir/dc-file_367 auth v4044 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.690497+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621a9080] now 0 2023-10-03T19:20:47.567 INFO:teuthology.orchestra.run.smithi045.stdout: -9364> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+608 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621a9080 count now 1/608 2023-10-03T19:20:47.567 INFO:teuthology.orchestra.run.smithi045.stdout: -9363> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000364) clear_dirty_parent 2023-10-03T19:20:47.567 INFO:teuthology.orchestra.run.smithi045.stdout: -9362> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000365) _stored_backtrace v 1474 2023-10-03T19:20:47.567 INFO:teuthology.orchestra.run.smithi045.stdout: -9361> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000365) auth_unpin by 0x55cf621a9600 on [inode 0x10000000365 [2,head] /dc-dir/dc-file_368 auth v4046 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.701251+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621a9600] now 0 2023-10-03T19:20:47.567 INFO:teuthology.orchestra.run.smithi045.stdout: -9360> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+607 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621a9600 count now 1/607 2023-10-03T19:20:47.567 INFO:teuthology.orchestra.run.smithi045.stdout: -9359> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000365) clear_dirty_parent 2023-10-03T19:20:47.567 INFO:teuthology.orchestra.run.smithi045.stdout: -9358> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000366) _stored_backtrace v 1478 2023-10-03T19:20:47.568 INFO:teuthology.orchestra.run.smithi045.stdout: -9357> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000366) auth_unpin by 0x55cf621a9b80 on [inode 0x10000000366 [2,head] /dc-dir/dc-file_369 auth v4048 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.712051+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621a9b80] now 0 2023-10-03T19:20:47.568 INFO:teuthology.orchestra.run.smithi045.stdout: -9356> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+606 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621a9b80 count now 1/606 2023-10-03T19:20:47.568 INFO:teuthology.orchestra.run.smithi045.stdout: -9355> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000366) clear_dirty_parent 2023-10-03T19:20:47.568 INFO:teuthology.orchestra.run.smithi045.stdout: -9354> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000367) _stored_backtrace v 1482 2023-10-03T19:20:47.568 INFO:teuthology.orchestra.run.smithi045.stdout: -9353> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000367) auth_unpin by 0x55cf621aa100 on [inode 0x10000000367 [2,head] /dc-dir/dc-file_370 auth v4050 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.722479+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621aa100] now 0 2023-10-03T19:20:47.568 INFO:teuthology.orchestra.run.smithi045.stdout: -9352> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+605 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621aa100 count now 1/605 2023-10-03T19:20:47.568 INFO:teuthology.orchestra.run.smithi045.stdout: -9351> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000367) clear_dirty_parent 2023-10-03T19:20:47.568 INFO:teuthology.orchestra.run.smithi045.stdout: -9350> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000368) _stored_backtrace v 1486 2023-10-03T19:20:47.568 INFO:teuthology.orchestra.run.smithi045.stdout: -9349> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000368) auth_unpin by 0x55cf621aa680 on [inode 0x10000000368 [2,head] /dc-dir/dc-file_371 auth v4052 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.733601+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621aa680] now 0 2023-10-03T19:20:47.568 INFO:teuthology.orchestra.run.smithi045.stdout: -9348> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+604 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621aa680 count now 1/604 2023-10-03T19:20:47.569 INFO:teuthology.orchestra.run.smithi045.stdout: -9347> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000368) clear_dirty_parent 2023-10-03T19:20:47.569 INFO:teuthology.orchestra.run.smithi045.stdout: -9346> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000369) _stored_backtrace v 1490 2023-10-03T19:20:47.569 INFO:teuthology.orchestra.run.smithi045.stdout: -9345> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000369) auth_unpin by 0x55cf621aac00 on [inode 0x10000000369 [2,head] /dc-dir/dc-file_372 auth v4054 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.744534+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621aac00] now 0 2023-10-03T19:20:47.569 INFO:teuthology.orchestra.run.smithi045.stdout: -9344> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+603 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621aac00 count now 1/603 2023-10-03T19:20:47.569 INFO:teuthology.orchestra.run.smithi045.stdout: -9343> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000369) clear_dirty_parent 2023-10-03T19:20:47.569 INFO:teuthology.orchestra.run.smithi045.stdout: -9342> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000036a) _stored_backtrace v 1494 2023-10-03T19:20:47.569 INFO:teuthology.orchestra.run.smithi045.stdout: -9341> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000036a) auth_unpin by 0x55cf621ab180 on [inode 0x1000000036a [2,head] /dc-dir/dc-file_373 auth v4056 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.756144+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621ab180] now 0 2023-10-03T19:20:47.569 INFO:teuthology.orchestra.run.smithi045.stdout: -9340> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+602 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621ab180 count now 1/602 2023-10-03T19:20:47.569 INFO:teuthology.orchestra.run.smithi045.stdout: -9339> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000036a) clear_dirty_parent 2023-10-03T19:20:47.569 INFO:teuthology.orchestra.run.smithi045.stdout: -9338> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000036b) _stored_backtrace v 1498 2023-10-03T19:20:47.569 INFO:teuthology.orchestra.run.smithi045.stdout: -9337> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000036b) auth_unpin by 0x55cf621ab700 on [inode 0x1000000036b [2,head] /dc-dir/dc-file_374 auth v4058 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.766867+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621ab700] now 0 2023-10-03T19:20:47.570 INFO:teuthology.orchestra.run.smithi045.stdout: -9336> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+601 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621ab700 count now 1/601 2023-10-03T19:20:47.570 INFO:teuthology.orchestra.run.smithi045.stdout: -9335> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000036b) clear_dirty_parent 2023-10-03T19:20:47.570 INFO:teuthology.orchestra.run.smithi045.stdout: -9334> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000036c) _stored_backtrace v 1502 2023-10-03T19:20:47.570 INFO:teuthology.orchestra.run.smithi045.stdout: -9333> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000036c) auth_unpin by 0x55cf621b6000 on [inode 0x1000000036c [2,head] /dc-dir/dc-file_375 auth v4060 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.779328+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621b6000] now 0 2023-10-03T19:20:47.570 INFO:teuthology.orchestra.run.smithi045.stdout: -9332> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+600 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621b6000 count now 1/600 2023-10-03T19:20:47.570 INFO:teuthology.orchestra.run.smithi045.stdout: -9331> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000036c) clear_dirty_parent 2023-10-03T19:20:47.570 INFO:teuthology.orchestra.run.smithi045.stdout: -9330> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000036d) _stored_backtrace v 1506 2023-10-03T19:20:47.570 INFO:teuthology.orchestra.run.smithi045.stdout: -9329> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000036d) auth_unpin by 0x55cf621b6580 on [inode 0x1000000036d [2,head] /dc-dir/dc-file_376 auth v4062 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.790665+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621b6580] now 0 2023-10-03T19:20:47.570 INFO:teuthology.orchestra.run.smithi045.stdout: -9328> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+599 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621b6580 count now 1/599 2023-10-03T19:20:47.570 INFO:teuthology.orchestra.run.smithi045.stdout: -9327> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000036d) clear_dirty_parent 2023-10-03T19:20:47.570 INFO:teuthology.orchestra.run.smithi045.stdout: -9326> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000036e) _stored_backtrace v 1510 2023-10-03T19:20:47.571 INFO:teuthology.orchestra.run.smithi045.stdout: -9325> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000036e) auth_unpin by 0x55cf621b6b00 on [inode 0x1000000036e [2,head] /dc-dir/dc-file_377 auth v4064 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.802504+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621b6b00] now 0 2023-10-03T19:20:47.571 INFO:teuthology.orchestra.run.smithi045.stdout: -9324> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+598 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621b6b00 count now 1/598 2023-10-03T19:20:47.571 INFO:teuthology.orchestra.run.smithi045.stdout: -9323> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000036e) clear_dirty_parent 2023-10-03T19:20:47.571 INFO:teuthology.orchestra.run.smithi045.stdout: -9322> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000036f) _stored_backtrace v 1514 2023-10-03T19:20:47.571 INFO:teuthology.orchestra.run.smithi045.stdout: -9321> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000036f) auth_unpin by 0x55cf621b7080 on [inode 0x1000000036f [2,head] /dc-dir/dc-file_378 auth v4066 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.813876+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621b7080] now 0 2023-10-03T19:20:47.571 INFO:teuthology.orchestra.run.smithi045.stdout: -9320> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+597 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621b7080 count now 1/597 2023-10-03T19:20:47.571 INFO:teuthology.orchestra.run.smithi045.stdout: -9319> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000036f) clear_dirty_parent 2023-10-03T19:20:47.571 INFO:teuthology.orchestra.run.smithi045.stdout: -9318> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000370) _stored_backtrace v 1518 2023-10-03T19:20:47.571 INFO:teuthology.orchestra.run.smithi045.stdout: -9317> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000370) auth_unpin by 0x55cf621b7600 on [inode 0x10000000370 [2,head] /dc-dir/dc-file_379 auth v4068 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.825194+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621b7600] now 0 2023-10-03T19:20:47.571 INFO:teuthology.orchestra.run.smithi045.stdout: -9316> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+596 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621b7600 count now 1/596 2023-10-03T19:20:47.571 INFO:teuthology.orchestra.run.smithi045.stdout: -9315> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000370) clear_dirty_parent 2023-10-03T19:20:47.572 INFO:teuthology.orchestra.run.smithi045.stdout: -9314> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000371) _stored_backtrace v 1522 2023-10-03T19:20:47.572 INFO:teuthology.orchestra.run.smithi045.stdout: -9313> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000371) auth_unpin by 0x55cf621b7b80 on [inode 0x10000000371 [2,head] /dc-dir/dc-file_380 auth v4070 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.837701+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621b7b80] now 0 2023-10-03T19:20:47.572 INFO:teuthology.orchestra.run.smithi045.stdout: -9312> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+595 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621b7b80 count now 1/595 2023-10-03T19:20:47.572 INFO:teuthology.orchestra.run.smithi045.stdout: -9311> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000371) clear_dirty_parent 2023-10-03T19:20:47.572 INFO:teuthology.orchestra.run.smithi045.stdout: -9310> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000372) _stored_backtrace v 1526 2023-10-03T19:20:47.572 INFO:teuthology.orchestra.run.smithi045.stdout: -9309> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000372) auth_unpin by 0x55cf621b8100 on [inode 0x10000000372 [2,head] /dc-dir/dc-file_381 auth v4072 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.849043+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621b8100] now 0 2023-10-03T19:20:47.573 INFO:teuthology.orchestra.run.smithi045.stdout: -9308> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+594 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621b8100 count now 1/594 2023-10-03T19:20:47.573 INFO:teuthology.orchestra.run.smithi045.stdout: -9307> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000372) clear_dirty_parent 2023-10-03T19:20:47.573 INFO:teuthology.orchestra.run.smithi045.stdout: -9306> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000373) _stored_backtrace v 1530 2023-10-03T19:20:47.573 INFO:teuthology.orchestra.run.smithi045.stdout: -9305> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000373) auth_unpin by 0x55cf621b8680 on [inode 0x10000000373 [2,head] /dc-dir/dc-file_382 auth v4074 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.860236+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621b8680] now 0 2023-10-03T19:20:47.573 INFO:teuthology.orchestra.run.smithi045.stdout: -9304> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+593 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621b8680 count now 1/593 2023-10-03T19:20:47.573 INFO:teuthology.orchestra.run.smithi045.stdout: -9303> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000373) clear_dirty_parent 2023-10-03T19:20:47.573 INFO:teuthology.orchestra.run.smithi045.stdout: -9302> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000374) _stored_backtrace v 1534 2023-10-03T19:20:47.573 INFO:teuthology.orchestra.run.smithi045.stdout: -9301> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000374) auth_unpin by 0x55cf621b8c00 on [inode 0x10000000374 [2,head] /dc-dir/dc-file_383 auth v4076 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.871294+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621b8c00] now 0 2023-10-03T19:20:47.573 INFO:teuthology.orchestra.run.smithi045.stdout: -9300> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+592 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621b8c00 count now 1/592 2023-10-03T19:20:47.573 INFO:teuthology.orchestra.run.smithi045.stdout: -9299> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000374) clear_dirty_parent 2023-10-03T19:20:47.573 INFO:teuthology.orchestra.run.smithi045.stdout: -9298> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000375) _stored_backtrace v 1538 2023-10-03T19:20:47.574 INFO:teuthology.orchestra.run.smithi045.stdout: -9297> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000375) auth_unpin by 0x55cf621b9180 on [inode 0x10000000375 [2,head] /dc-dir/dc-file_384 auth v4078 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.883251+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621b9180] now 0 2023-10-03T19:20:47.574 INFO:teuthology.orchestra.run.smithi045.stdout: -9296> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+591 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621b9180 count now 1/591 2023-10-03T19:20:47.574 INFO:teuthology.orchestra.run.smithi045.stdout: -9295> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000375) clear_dirty_parent 2023-10-03T19:20:47.574 INFO:teuthology.orchestra.run.smithi045.stdout: -9294> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000376) _stored_backtrace v 1542 2023-10-03T19:20:47.574 INFO:teuthology.orchestra.run.smithi045.stdout: -9293> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000376) auth_unpin by 0x55cf621b9700 on [inode 0x10000000376 [2,head] /dc-dir/dc-file_385 auth v4080 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.894388+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621b9700] now 0 2023-10-03T19:20:47.574 INFO:teuthology.orchestra.run.smithi045.stdout: -9292> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+590 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621b9700 count now 1/590 2023-10-03T19:20:47.574 INFO:teuthology.orchestra.run.smithi045.stdout: -9291> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000376) clear_dirty_parent 2023-10-03T19:20:47.574 INFO:teuthology.orchestra.run.smithi045.stdout: -9290> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000377) _stored_backtrace v 1546 2023-10-03T19:20:47.574 INFO:teuthology.orchestra.run.smithi045.stdout: -9289> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000377) auth_unpin by 0x55cf621c6000 on [inode 0x10000000377 [2,head] /dc-dir/dc-file_386 auth v4082 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.905291+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621c6000] now 0 2023-10-03T19:20:47.574 INFO:teuthology.orchestra.run.smithi045.stdout: -9288> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+589 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621c6000 count now 1/589 2023-10-03T19:20:47.574 INFO:teuthology.orchestra.run.smithi045.stdout: -9287> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000377) clear_dirty_parent 2023-10-03T19:20:47.575 INFO:teuthology.orchestra.run.smithi045.stdout: -9286> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000378) _stored_backtrace v 1550 2023-10-03T19:20:47.575 INFO:teuthology.orchestra.run.smithi045.stdout: -9285> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000378) auth_unpin by 0x55cf621c6580 on [inode 0x10000000378 [2,head] /dc-dir/dc-file_387 auth v4084 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.916121+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621c6580] now 0 2023-10-03T19:20:47.575 INFO:teuthology.orchestra.run.smithi045.stdout: -9284> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+588 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621c6580 count now 1/588 2023-10-03T19:20:47.575 INFO:teuthology.orchestra.run.smithi045.stdout: -9283> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000378) clear_dirty_parent 2023-10-03T19:20:47.575 INFO:teuthology.orchestra.run.smithi045.stdout: -9282> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000379) _stored_backtrace v 1554 2023-10-03T19:20:47.575 INFO:teuthology.orchestra.run.smithi045.stdout: -9281> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000379) auth_unpin by 0x55cf621c6b00 on [inode 0x10000000379 [2,head] /dc-dir/dc-file_388 auth v4086 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.927069+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621c6b00] now 0 2023-10-03T19:20:47.575 INFO:teuthology.orchestra.run.smithi045.stdout: -9280> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+587 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621c6b00 count now 1/587 2023-10-03T19:20:47.575 INFO:teuthology.orchestra.run.smithi045.stdout: -9279> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000379) clear_dirty_parent 2023-10-03T19:20:47.575 INFO:teuthology.orchestra.run.smithi045.stdout: -9278> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000037a) _stored_backtrace v 1558 2023-10-03T19:20:47.575 INFO:teuthology.orchestra.run.smithi045.stdout: -9277> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000037a) auth_unpin by 0x55cf621c7080 on [inode 0x1000000037a [2,head] /dc-dir/dc-file_389 auth v4088 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.938380+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621c7080] now 0 2023-10-03T19:20:47.575 INFO:teuthology.orchestra.run.smithi045.stdout: -9276> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+586 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621c7080 count now 1/586 2023-10-03T19:20:47.576 INFO:teuthology.orchestra.run.smithi045.stdout: -9275> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000037a) clear_dirty_parent 2023-10-03T19:20:47.576 INFO:teuthology.orchestra.run.smithi045.stdout: -9274> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000037b) _stored_backtrace v 1562 2023-10-03T19:20:47.576 INFO:teuthology.orchestra.run.smithi045.stdout: -9273> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000037b) auth_unpin by 0x55cf621c7600 on [inode 0x1000000037b [2,head] /dc-dir/dc-file_390 auth v4090 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.949907+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621c7600] now 0 2023-10-03T19:20:47.576 INFO:teuthology.orchestra.run.smithi045.stdout: -9272> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+585 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621c7600 count now 1/585 2023-10-03T19:20:47.576 INFO:teuthology.orchestra.run.smithi045.stdout: -9271> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000037b) clear_dirty_parent 2023-10-03T19:20:47.576 INFO:teuthology.orchestra.run.smithi045.stdout: -9270> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000037c) _stored_backtrace v 1566 2023-10-03T19:20:47.576 INFO:teuthology.orchestra.run.smithi045.stdout: -9269> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000037c) auth_unpin by 0x55cf621c7b80 on [inode 0x1000000037c [2,head] /dc-dir/dc-file_391 auth v4092 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.961596+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621c7b80] now 0 2023-10-03T19:20:47.576 INFO:teuthology.orchestra.run.smithi045.stdout: -9268> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+584 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621c7b80 count now 1/584 2023-10-03T19:20:47.576 INFO:teuthology.orchestra.run.smithi045.stdout: -9267> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000037c) clear_dirty_parent 2023-10-03T19:20:47.576 INFO:teuthology.orchestra.run.smithi045.stdout: -9266> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000037d) _stored_backtrace v 1570 2023-10-03T19:20:47.576 INFO:teuthology.orchestra.run.smithi045.stdout: -9265> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000037d) auth_unpin by 0x55cf621c8100 on [inode 0x1000000037d [2,head] /dc-dir/dc-file_392 auth v4094 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.972974+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621c8100] now 0 2023-10-03T19:20:47.576 INFO:teuthology.orchestra.run.smithi045.stdout: -9264> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+583 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621c8100 count now 1/583 2023-10-03T19:20:47.577 INFO:teuthology.orchestra.run.smithi045.stdout: -9263> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000037d) clear_dirty_parent 2023-10-03T19:20:47.577 INFO:teuthology.orchestra.run.smithi045.stdout: -9262> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000037e) _stored_backtrace v 1574 2023-10-03T19:20:47.577 INFO:teuthology.orchestra.run.smithi045.stdout: -9261> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000037e) auth_unpin by 0x55cf621c8680 on [inode 0x1000000037e [2,head] /dc-dir/dc-file_393 auth v4096 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.983956+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621c8680] now 0 2023-10-03T19:20:47.577 INFO:teuthology.orchestra.run.smithi045.stdout: -9260> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+582 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621c8680 count now 1/582 2023-10-03T19:20:47.577 INFO:teuthology.orchestra.run.smithi045.stdout: -9259> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000037e) clear_dirty_parent 2023-10-03T19:20:47.577 INFO:teuthology.orchestra.run.smithi045.stdout: -9258> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000037f) _stored_backtrace v 1578 2023-10-03T19:20:47.577 INFO:teuthology.orchestra.run.smithi045.stdout: -9257> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000037f) auth_unpin by 0x55cf621c8c00 on [inode 0x1000000037f [2,head] /dc-dir/dc-file_394 auth v4098 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:38.995357+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621c8c00] now 0 2023-10-03T19:20:47.577 INFO:teuthology.orchestra.run.smithi045.stdout: -9256> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+581 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621c8c00 count now 1/581 2023-10-03T19:20:47.577 INFO:teuthology.orchestra.run.smithi045.stdout: -9255> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000037f) clear_dirty_parent 2023-10-03T19:20:47.577 INFO:teuthology.orchestra.run.smithi045.stdout: -9254> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000380) _stored_backtrace v 1582 2023-10-03T19:20:47.577 INFO:teuthology.orchestra.run.smithi045.stdout: -9253> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000380) auth_unpin by 0x55cf621c9180 on [inode 0x10000000380 [2,head] /dc-dir/dc-file_395 auth v4100 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.006388+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621c9180] now 0 2023-10-03T19:20:47.577 INFO:teuthology.orchestra.run.smithi045.stdout: -9252> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+580 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621c9180 count now 1/580 2023-10-03T19:20:47.578 INFO:teuthology.orchestra.run.smithi045.stdout: -9251> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000380) clear_dirty_parent 2023-10-03T19:20:47.578 INFO:teuthology.orchestra.run.smithi045.stdout: -9250> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000381) _stored_backtrace v 1586 2023-10-03T19:20:47.578 INFO:teuthology.orchestra.run.smithi045.stdout: -9249> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000381) auth_unpin by 0x55cf621c9700 on [inode 0x10000000381 [2,head] /dc-dir/dc-file_396 auth v4102 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.017118+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621c9700] now 0 2023-10-03T19:20:47.578 INFO:teuthology.orchestra.run.smithi045.stdout: -9248> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+579 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621c9700 count now 1/579 2023-10-03T19:20:47.578 INFO:teuthology.orchestra.run.smithi045.stdout: -9247> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000381) clear_dirty_parent 2023-10-03T19:20:47.578 INFO:teuthology.orchestra.run.smithi045.stdout: -9246> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000382) _stored_backtrace v 1590 2023-10-03T19:20:47.578 INFO:teuthology.orchestra.run.smithi045.stdout: -9245> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000382) auth_unpin by 0x55cf621d2000 on [inode 0x10000000382 [2,head] /dc-dir/dc-file_397 auth v4104 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.029585+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621d2000] now 0 2023-10-03T19:20:47.578 INFO:teuthology.orchestra.run.smithi045.stdout: -9244> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+578 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621d2000 count now 1/578 2023-10-03T19:20:47.578 INFO:teuthology.orchestra.run.smithi045.stdout: -9243> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000382) clear_dirty_parent 2023-10-03T19:20:47.578 INFO:teuthology.orchestra.run.smithi045.stdout: -9242> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000383) _stored_backtrace v 1594 2023-10-03T19:20:47.578 INFO:teuthology.orchestra.run.smithi045.stdout: -9241> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000383) auth_unpin by 0x55cf621d2580 on [inode 0x10000000383 [2,head] /dc-dir/dc-file_398 auth v4106 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.042619+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621d2580] now 0 2023-10-03T19:20:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: -9240> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+577 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621d2580 count now 1/577 2023-10-03T19:20:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: -9239> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000383) clear_dirty_parent 2023-10-03T19:20:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: -9238> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000384) _stored_backtrace v 1598 2023-10-03T19:20:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: -9237> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000384) auth_unpin by 0x55cf621d2b00 on [inode 0x10000000384 [2,head] /dc-dir/dc-file_399 auth v4108 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.055818+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621d2b00] now 0 2023-10-03T19:20:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: -9236> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+576 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621d2b00 count now 1/576 2023-10-03T19:20:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: -9235> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000384) clear_dirty_parent 2023-10-03T19:20:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: -9234> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000385) _stored_backtrace v 1602 2023-10-03T19:20:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: -9233> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000385) auth_unpin by 0x55cf621d3080 on [inode 0x10000000385 [2,head] /dc-dir/dc-file_400 auth v4110 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.067297+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621d3080] now 0 2023-10-03T19:20:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: -9232> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+575 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621d3080 count now 1/575 2023-10-03T19:20:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: -9231> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000385) clear_dirty_parent 2023-10-03T19:20:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: -9230> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000386) _stored_backtrace v 1606 2023-10-03T19:20:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: -9229> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000386) auth_unpin by 0x55cf621d3600 on [inode 0x10000000386 [2,head] /dc-dir/dc-file_401 auth v4112 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.079078+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621d3600] now 0 2023-10-03T19:20:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: -9228> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+574 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621d3600 count now 1/574 2023-10-03T19:20:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: -9227> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000386) clear_dirty_parent 2023-10-03T19:20:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: -9226> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000387) _stored_backtrace v 1610 2023-10-03T19:20:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: -9225> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000387) auth_unpin by 0x55cf621d3b80 on [inode 0x10000000387 [2,head] /dc-dir/dc-file_402 auth v4114 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.090173+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621d3b80] now 0 2023-10-03T19:20:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: -9224> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+573 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621d3b80 count now 1/573 2023-10-03T19:20:47.603 INFO:teuthology.orchestra.run.smithi045.stdout: -9223> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000387) clear_dirty_parent 2023-10-03T19:20:47.603 INFO:teuthology.orchestra.run.smithi045.stdout: -9222> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000388) _stored_backtrace v 1614 2023-10-03T19:20:47.603 INFO:teuthology.orchestra.run.smithi045.stdout: -9221> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000388) auth_unpin by 0x55cf621d4100 on [inode 0x10000000388 [2,head] /dc-dir/dc-file_403 auth v4116 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.100921+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621d4100] now 0 2023-10-03T19:20:47.603 INFO:teuthology.orchestra.run.smithi045.stdout: -9220> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+572 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621d4100 count now 1/572 2023-10-03T19:20:47.603 INFO:teuthology.orchestra.run.smithi045.stdout: -9219> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000388) clear_dirty_parent 2023-10-03T19:20:47.603 INFO:teuthology.orchestra.run.smithi045.stdout: -9218> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000389) _stored_backtrace v 1618 2023-10-03T19:20:47.603 INFO:teuthology.orchestra.run.smithi045.stdout: -9217> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000389) auth_unpin by 0x55cf621d4680 on [inode 0x10000000389 [2,head] /dc-dir/dc-file_404 auth v4118 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.111842+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621d4680] now 0 2023-10-03T19:20:47.603 INFO:teuthology.orchestra.run.smithi045.stdout: -9216> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+571 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621d4680 count now 1/571 2023-10-03T19:20:47.603 INFO:teuthology.orchestra.run.smithi045.stdout: -9215> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000389) clear_dirty_parent 2023-10-03T19:20:47.603 INFO:teuthology.orchestra.run.smithi045.stdout: -9214> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000038a) _stored_backtrace v 1622 2023-10-03T19:20:47.603 INFO:teuthology.orchestra.run.smithi045.stdout: -9213> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000038a) auth_unpin by 0x55cf621d4c00 on [inode 0x1000000038a [2,head] /dc-dir/dc-file_405 auth v4120 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.122820+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621d4c00] now 0 2023-10-03T19:20:47.603 INFO:teuthology.orchestra.run.smithi045.stdout: -9212> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+570 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621d4c00 count now 1/570 2023-10-03T19:20:47.604 INFO:teuthology.orchestra.run.smithi045.stdout: -9211> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000038a) clear_dirty_parent 2023-10-03T19:20:47.604 INFO:teuthology.orchestra.run.smithi045.stdout: -9210> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000038b) _stored_backtrace v 1626 2023-10-03T19:20:47.604 INFO:teuthology.orchestra.run.smithi045.stdout: -9209> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000038b) auth_unpin by 0x55cf621d5180 on [inode 0x1000000038b [2,head] /dc-dir/dc-file_406 auth v4122 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.133568+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621d5180] now 0 2023-10-03T19:20:47.604 INFO:teuthology.orchestra.run.smithi045.stdout: -9208> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+569 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621d5180 count now 1/569 2023-10-03T19:20:47.604 INFO:teuthology.orchestra.run.smithi045.stdout: -9207> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000038b) clear_dirty_parent 2023-10-03T19:20:47.604 INFO:teuthology.orchestra.run.smithi045.stdout: -9206> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000038c) _stored_backtrace v 1630 2023-10-03T19:20:47.604 INFO:teuthology.orchestra.run.smithi045.stdout: -9205> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000038c) auth_unpin by 0x55cf621d5700 on [inode 0x1000000038c [2,head] /dc-dir/dc-file_407 auth v4124 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.144183+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf621d5700] now 0 2023-10-03T19:20:47.604 INFO:teuthology.orchestra.run.smithi045.stdout: -9204> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+568 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf621d5700 count now 1/568 2023-10-03T19:20:47.604 INFO:teuthology.orchestra.run.smithi045.stdout: -9203> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000038c) clear_dirty_parent 2023-10-03T19:20:47.604 INFO:teuthology.orchestra.run.smithi045.stdout: -9202> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000038d) _stored_backtrace v 1634 2023-10-03T19:20:47.604 INFO:teuthology.orchestra.run.smithi045.stdout: -9201> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000038d) auth_unpin by 0x55cf62280000 on [inode 0x1000000038d [2,head] /dc-dir/dc-file_408 auth v4126 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.155423+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62280000] now 0 2023-10-03T19:20:47.604 INFO:teuthology.orchestra.run.smithi045.stdout: -9200> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+567 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62280000 count now 1/567 2023-10-03T19:20:47.605 INFO:teuthology.orchestra.run.smithi045.stdout: -9199> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000038d) clear_dirty_parent 2023-10-03T19:20:47.605 INFO:teuthology.orchestra.run.smithi045.stdout: -9198> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000038e) _stored_backtrace v 1638 2023-10-03T19:20:47.605 INFO:teuthology.orchestra.run.smithi045.stdout: -9197> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000038e) auth_unpin by 0x55cf62280580 on [inode 0x1000000038e [2,head] /dc-dir/dc-file_409 auth v4128 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.166612+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62280580] now 0 2023-10-03T19:20:47.605 INFO:teuthology.orchestra.run.smithi045.stdout: -9196> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+566 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62280580 count now 1/566 2023-10-03T19:20:47.605 INFO:teuthology.orchestra.run.smithi045.stdout: -9195> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000038e) clear_dirty_parent 2023-10-03T19:20:47.605 INFO:teuthology.orchestra.run.smithi045.stdout: -9194> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000038f) _stored_backtrace v 1642 2023-10-03T19:20:47.605 INFO:teuthology.orchestra.run.smithi045.stdout: -9193> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000038f) auth_unpin by 0x55cf62280b00 on [inode 0x1000000038f [2,head] /dc-dir/dc-file_410 auth v4130 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.177775+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62280b00] now 0 2023-10-03T19:20:47.605 INFO:teuthology.orchestra.run.smithi045.stdout: -9192> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+565 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62280b00 count now 1/565 2023-10-03T19:20:47.605 INFO:teuthology.orchestra.run.smithi045.stdout: -9191> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000038f) clear_dirty_parent 2023-10-03T19:20:47.605 INFO:teuthology.orchestra.run.smithi045.stdout: -9190> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000390) _stored_backtrace v 1646 2023-10-03T19:20:47.605 INFO:teuthology.orchestra.run.smithi045.stdout: -9189> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000390) auth_unpin by 0x55cf62281080 on [inode 0x10000000390 [2,head] /dc-dir/dc-file_411 auth v4132 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.188460+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62281080] now 0 2023-10-03T19:20:47.605 INFO:teuthology.orchestra.run.smithi045.stdout: -9188> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+564 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62281080 count now 1/564 2023-10-03T19:20:47.606 INFO:teuthology.orchestra.run.smithi045.stdout: -9187> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000390) clear_dirty_parent 2023-10-03T19:20:47.606 INFO:teuthology.orchestra.run.smithi045.stdout: -9186> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000391) _stored_backtrace v 1650 2023-10-03T19:20:47.606 INFO:teuthology.orchestra.run.smithi045.stdout: -9185> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000391) auth_unpin by 0x55cf62281600 on [inode 0x10000000391 [2,head] /dc-dir/dc-file_412 auth v4134 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.200003+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62281600] now 0 2023-10-03T19:20:47.606 INFO:teuthology.orchestra.run.smithi045.stdout: -9184> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+563 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62281600 count now 1/563 2023-10-03T19:20:47.606 INFO:teuthology.orchestra.run.smithi045.stdout: -9183> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000391) clear_dirty_parent 2023-10-03T19:20:47.606 INFO:teuthology.orchestra.run.smithi045.stdout: -9182> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000392) _stored_backtrace v 1654 2023-10-03T19:20:47.606 INFO:teuthology.orchestra.run.smithi045.stdout: -9181> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000392) auth_unpin by 0x55cf62281b80 on [inode 0x10000000392 [2,head] /dc-dir/dc-file_413 auth v4136 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.210967+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62281b80] now 0 2023-10-03T19:20:47.606 INFO:teuthology.orchestra.run.smithi045.stdout: -9180> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+562 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62281b80 count now 1/562 2023-10-03T19:20:47.606 INFO:teuthology.orchestra.run.smithi045.stdout: -9179> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000392) clear_dirty_parent 2023-10-03T19:20:47.606 INFO:teuthology.orchestra.run.smithi045.stdout: -9178> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000393) _stored_backtrace v 1658 2023-10-03T19:20:47.606 INFO:teuthology.orchestra.run.smithi045.stdout: -9177> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000393) auth_unpin by 0x55cf62282100 on [inode 0x10000000393 [2,head] /dc-dir/dc-file_414 auth v4138 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.222030+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62282100] now 0 2023-10-03T19:20:47.607 INFO:teuthology.orchestra.run.smithi045.stdout: -9176> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+561 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62282100 count now 1/561 2023-10-03T19:20:47.607 INFO:teuthology.orchestra.run.smithi045.stdout: -9175> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000393) clear_dirty_parent 2023-10-03T19:20:47.607 INFO:teuthology.orchestra.run.smithi045.stdout: -9174> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000394) _stored_backtrace v 1662 2023-10-03T19:20:47.607 INFO:teuthology.orchestra.run.smithi045.stdout: -9173> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000394) auth_unpin by 0x55cf62282680 on [inode 0x10000000394 [2,head] /dc-dir/dc-file_415 auth v4140 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.233114+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62282680] now 0 2023-10-03T19:20:47.607 INFO:teuthology.orchestra.run.smithi045.stdout: -9172> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+560 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62282680 count now 1/560 2023-10-03T19:20:47.607 INFO:teuthology.orchestra.run.smithi045.stdout: -9171> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000394) clear_dirty_parent 2023-10-03T19:20:47.614 INFO:teuthology.orchestra.run.smithi045.stdout: -9170> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000395) _stored_backtrace v 1666 2023-10-03T19:20:47.614 INFO:teuthology.orchestra.run.smithi045.stdout: -9169> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000395) auth_unpin by 0x55cf62282c00 on [inode 0x10000000395 [2,head] /dc-dir/dc-file_416 auth v4142 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.244142+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62282c00] now 0 2023-10-03T19:20:47.614 INFO:teuthology.orchestra.run.smithi045.stdout: -9168> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+559 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62282c00 count now 1/559 2023-10-03T19:20:47.614 INFO:teuthology.orchestra.run.smithi045.stdout: -9167> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000395) clear_dirty_parent 2023-10-03T19:20:47.614 INFO:teuthology.orchestra.run.smithi045.stdout: -9166> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000396) _stored_backtrace v 1670 2023-10-03T19:20:47.615 INFO:teuthology.orchestra.run.smithi045.stdout: -9165> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000396) auth_unpin by 0x55cf62283180 on [inode 0x10000000396 [2,head] /dc-dir/dc-file_417 auth v4144 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.257364+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62283180] now 0 2023-10-03T19:20:47.615 INFO:teuthology.orchestra.run.smithi045.stdout: -9164> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+558 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62283180 count now 1/558 2023-10-03T19:20:47.615 INFO:teuthology.orchestra.run.smithi045.stdout: -9163> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000396) clear_dirty_parent 2023-10-03T19:20:47.615 INFO:teuthology.orchestra.run.smithi045.stdout: -9162> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000397) _stored_backtrace v 1674 2023-10-03T19:20:47.615 INFO:teuthology.orchestra.run.smithi045.stdout: -9161> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000397) auth_unpin by 0x55cf62283700 on [inode 0x10000000397 [2,head] /dc-dir/dc-file_418 auth v4146 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.269530+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62283700] now 0 2023-10-03T19:20:47.615 INFO:teuthology.orchestra.run.smithi045.stdout: -9160> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+557 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62283700 count now 1/557 2023-10-03T19:20:47.615 INFO:teuthology.orchestra.run.smithi045.stdout: -9159> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000397) clear_dirty_parent 2023-10-03T19:20:47.615 INFO:teuthology.orchestra.run.smithi045.stdout: -9158> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000398) _stored_backtrace v 1678 2023-10-03T19:20:47.615 INFO:teuthology.orchestra.run.smithi045.stdout: -9157> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000398) auth_unpin by 0x55cf622e0000 on [inode 0x10000000398 [2,head] /dc-dir/dc-file_419 auth v4148 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.281030+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622e0000] now 0 2023-10-03T19:20:47.616 INFO:teuthology.orchestra.run.smithi045.stdout: -9156> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+556 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622e0000 count now 1/556 2023-10-03T19:20:47.616 INFO:teuthology.orchestra.run.smithi045.stdout: -9155> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000398) clear_dirty_parent 2023-10-03T19:20:47.616 INFO:teuthology.orchestra.run.smithi045.stdout: -9154> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000399) _stored_backtrace v 1682 2023-10-03T19:20:47.616 INFO:teuthology.orchestra.run.smithi045.stdout: -9153> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000399) auth_unpin by 0x55cf622e0580 on [inode 0x10000000399 [2,head] /dc-dir/dc-file_420 auth v4150 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.293314+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622e0580] now 0 2023-10-03T19:20:47.616 INFO:teuthology.orchestra.run.smithi045.stdout: -9152> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+555 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622e0580 count now 1/555 2023-10-03T19:20:47.616 INFO:teuthology.orchestra.run.smithi045.stdout: -9151> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000399) clear_dirty_parent 2023-10-03T19:20:47.616 INFO:teuthology.orchestra.run.smithi045.stdout: -9150> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000039a) _stored_backtrace v 1686 2023-10-03T19:20:47.616 INFO:teuthology.orchestra.run.smithi045.stdout: -9149> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000039a) auth_unpin by 0x55cf622e0b00 on [inode 0x1000000039a [2,head] /dc-dir/dc-file_421 auth v4152 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.305361+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622e0b00] now 0 2023-10-03T19:20:47.616 INFO:teuthology.orchestra.run.smithi045.stdout: -9148> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+554 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622e0b00 count now 1/554 2023-10-03T19:20:47.617 INFO:teuthology.orchestra.run.smithi045.stdout: -9147> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000039a) clear_dirty_parent 2023-10-03T19:20:47.617 INFO:teuthology.orchestra.run.smithi045.stdout: -9146> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000039b) _stored_backtrace v 1690 2023-10-03T19:20:47.617 INFO:teuthology.orchestra.run.smithi045.stdout: -9145> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000039b) auth_unpin by 0x55cf622e1080 on [inode 0x1000000039b [2,head] /dc-dir/dc-file_422 auth v4154 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.316569+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622e1080] now 0 2023-10-03T19:20:47.617 INFO:teuthology.orchestra.run.smithi045.stdout: -9144> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+553 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622e1080 count now 1/553 2023-10-03T19:20:47.617 INFO:teuthology.orchestra.run.smithi045.stdout: -9143> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000039b) clear_dirty_parent 2023-10-03T19:20:47.617 INFO:teuthology.orchestra.run.smithi045.stdout: -9142> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000039c) _stored_backtrace v 1694 2023-10-03T19:20:47.617 INFO:teuthology.orchestra.run.smithi045.stdout: -9141> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000039c) auth_unpin by 0x55cf622e1600 on [inode 0x1000000039c [2,head] /dc-dir/dc-file_423 auth v4156 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.327788+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622e1600] now 0 2023-10-03T19:20:47.617 INFO:teuthology.orchestra.run.smithi045.stdout: -9140> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+552 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622e1600 count now 1/552 2023-10-03T19:20:47.617 INFO:teuthology.orchestra.run.smithi045.stdout: -9139> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000039c) clear_dirty_parent 2023-10-03T19:20:47.617 INFO:teuthology.orchestra.run.smithi045.stdout: -9138> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000039d) _stored_backtrace v 1698 2023-10-03T19:20:47.617 INFO:teuthology.orchestra.run.smithi045.stdout: -9137> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000039d) auth_unpin by 0x55cf622e1b80 on [inode 0x1000000039d [2,head] /dc-dir/dc-file_424 auth v4158 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.339858+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622e1b80] now 0 2023-10-03T19:20:47.618 INFO:teuthology.orchestra.run.smithi045.stdout: -9136> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+551 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622e1b80 count now 1/551 2023-10-03T19:20:47.618 INFO:teuthology.orchestra.run.smithi045.stdout: -9135> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000039d) clear_dirty_parent 2023-10-03T19:20:47.618 INFO:teuthology.orchestra.run.smithi045.stdout: -9134> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000039e) _stored_backtrace v 1702 2023-10-03T19:20:47.618 INFO:teuthology.orchestra.run.smithi045.stdout: -9133> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000039e) auth_unpin by 0x55cf622e2100 on [inode 0x1000000039e [2,head] /dc-dir/dc-file_425 auth v4160 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.353440+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622e2100] now 0 2023-10-03T19:20:47.618 INFO:teuthology.orchestra.run.smithi045.stdout: -9132> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+550 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622e2100 count now 1/550 2023-10-03T19:20:47.618 INFO:teuthology.orchestra.run.smithi045.stdout: -9131> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000039e) clear_dirty_parent 2023-10-03T19:20:47.618 INFO:teuthology.orchestra.run.smithi045.stdout: -9130> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000039f) _stored_backtrace v 1706 2023-10-03T19:20:47.618 INFO:teuthology.orchestra.run.smithi045.stdout: -9129> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000039f) auth_unpin by 0x55cf622e2680 on [inode 0x1000000039f [2,head] /dc-dir/dc-file_426 auth v4162 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.365408+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622e2680] now 0 2023-10-03T19:20:47.618 INFO:teuthology.orchestra.run.smithi045.stdout: -9128> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+549 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622e2680 count now 1/549 2023-10-03T19:20:47.618 INFO:teuthology.orchestra.run.smithi045.stdout: -9127> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000039f) clear_dirty_parent 2023-10-03T19:20:47.618 INFO:teuthology.orchestra.run.smithi045.stdout: -9126> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003a0) _stored_backtrace v 1710 2023-10-03T19:20:47.619 INFO:teuthology.orchestra.run.smithi045.stdout: -9125> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003a0) auth_unpin by 0x55cf622e2c00 on [inode 0x100000003a0 [2,head] /dc-dir/dc-file_427 auth v4164 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.378255+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622e2c00] now 0 2023-10-03T19:20:47.619 INFO:teuthology.orchestra.run.smithi045.stdout: -9124> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+548 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622e2c00 count now 1/548 2023-10-03T19:20:47.619 INFO:teuthology.orchestra.run.smithi045.stdout: -9123> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003a0) clear_dirty_parent 2023-10-03T19:20:47.619 INFO:teuthology.orchestra.run.smithi045.stdout: -9122> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003a1) _stored_backtrace v 1714 2023-10-03T19:20:47.619 INFO:teuthology.orchestra.run.smithi045.stdout: -9121> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003a1) auth_unpin by 0x55cf622e3180 on [inode 0x100000003a1 [2,head] /dc-dir/dc-file_428 auth v4166 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.391538+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622e3180] now 0 2023-10-03T19:20:47.619 INFO:teuthology.orchestra.run.smithi045.stdout: -9120> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+547 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622e3180 count now 1/547 2023-10-03T19:20:47.619 INFO:teuthology.orchestra.run.smithi045.stdout: -9119> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003a1) clear_dirty_parent 2023-10-03T19:20:47.619 INFO:teuthology.orchestra.run.smithi045.stdout: -9118> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003a2) _stored_backtrace v 1718 2023-10-03T19:20:47.619 INFO:teuthology.orchestra.run.smithi045.stdout: -9117> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003a2) auth_unpin by 0x55cf622e3700 on [inode 0x100000003a2 [2,head] /dc-dir/dc-file_429 auth v4168 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.404509+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622e3700] now 0 2023-10-03T19:20:47.619 INFO:teuthology.orchestra.run.smithi045.stdout: -9116> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+546 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622e3700 count now 1/546 2023-10-03T19:20:47.619 INFO:teuthology.orchestra.run.smithi045.stdout: -9115> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003a2) clear_dirty_parent 2023-10-03T19:20:47.620 INFO:teuthology.orchestra.run.smithi045.stdout: -9114> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003a3) _stored_backtrace v 1722 2023-10-03T19:20:47.620 INFO:teuthology.orchestra.run.smithi045.stdout: -9113> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003a3) auth_unpin by 0x55cf622ea000 on [inode 0x100000003a3 [2,head] /dc-dir/dc-file_430 auth v4170 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.418214+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622ea000] now 0 2023-10-03T19:20:47.621 INFO:teuthology.orchestra.run.smithi045.stdout: -9112> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+545 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622ea000 count now 1/545 2023-10-03T19:20:47.621 INFO:teuthology.orchestra.run.smithi045.stdout: -9111> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003a3) clear_dirty_parent 2023-10-03T19:20:47.621 INFO:teuthology.orchestra.run.smithi045.stdout: -9110> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003a4) _stored_backtrace v 1726 2023-10-03T19:20:47.621 INFO:teuthology.orchestra.run.smithi045.stdout: -9109> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003a4) auth_unpin by 0x55cf622ea580 on [inode 0x100000003a4 [2,head] /dc-dir/dc-file_431 auth v4172 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.430347+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622ea580] now 0 2023-10-03T19:20:47.621 INFO:teuthology.orchestra.run.smithi045.stdout: -9108> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+544 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622ea580 count now 1/544 2023-10-03T19:20:47.621 INFO:teuthology.orchestra.run.smithi045.stdout: -9107> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003a4) clear_dirty_parent 2023-10-03T19:20:47.621 INFO:teuthology.orchestra.run.smithi045.stdout: -9106> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003a5) _stored_backtrace v 1730 2023-10-03T19:20:47.621 INFO:teuthology.orchestra.run.smithi045.stdout: -9105> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003a5) auth_unpin by 0x55cf622eab00 on [inode 0x100000003a5 [2,head] /dc-dir/dc-file_432 auth v4174 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.442175+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622eab00] now 0 2023-10-03T19:20:47.621 INFO:teuthology.orchestra.run.smithi045.stdout: -9104> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+543 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622eab00 count now 1/543 2023-10-03T19:20:47.621 INFO:teuthology.orchestra.run.smithi045.stdout: -9103> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003a5) clear_dirty_parent 2023-10-03T19:20:47.622 INFO:teuthology.orchestra.run.smithi045.stdout: -9102> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003a6) _stored_backtrace v 1734 2023-10-03T19:20:47.622 INFO:teuthology.orchestra.run.smithi045.stdout: -9101> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003a6) auth_unpin by 0x55cf622eb080 on [inode 0x100000003a6 [2,head] /dc-dir/dc-file_433 auth v4176 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.453518+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622eb080] now 0 2023-10-03T19:20:47.622 INFO:teuthology.orchestra.run.smithi045.stdout: -9100> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+542 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622eb080 count now 1/542 2023-10-03T19:20:47.622 INFO:teuthology.orchestra.run.smithi045.stdout: -9099> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003a6) clear_dirty_parent 2023-10-03T19:20:47.622 INFO:teuthology.orchestra.run.smithi045.stdout: -9098> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003a7) _stored_backtrace v 1738 2023-10-03T19:20:47.622 INFO:teuthology.orchestra.run.smithi045.stdout: -9097> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003a7) auth_unpin by 0x55cf622eb600 on [inode 0x100000003a7 [2,head] /dc-dir/dc-file_434 auth v4178 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.466639+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622eb600] now 0 2023-10-03T19:20:47.622 INFO:teuthology.orchestra.run.smithi045.stdout: -9096> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+541 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622eb600 count now 1/541 2023-10-03T19:20:47.622 INFO:teuthology.orchestra.run.smithi045.stdout: -9095> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003a7) clear_dirty_parent 2023-10-03T19:20:47.622 INFO:teuthology.orchestra.run.smithi045.stdout: -9094> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003a8) _stored_backtrace v 1742 2023-10-03T19:20:47.622 INFO:teuthology.orchestra.run.smithi045.stdout: -9093> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003a8) auth_unpin by 0x55cf622ebb80 on [inode 0x100000003a8 [2,head] /dc-dir/dc-file_435 auth v4180 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.477674+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622ebb80] now 0 2023-10-03T19:20:47.623 INFO:teuthology.orchestra.run.smithi045.stdout: -9092> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+540 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622ebb80 count now 1/540 2023-10-03T19:20:47.623 INFO:teuthology.orchestra.run.smithi045.stdout: -9091> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003a8) clear_dirty_parent 2023-10-03T19:20:47.623 INFO:teuthology.orchestra.run.smithi045.stdout: -9090> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003a9) _stored_backtrace v 1746 2023-10-03T19:20:47.623 INFO:teuthology.orchestra.run.smithi045.stdout: -9089> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003a9) auth_unpin by 0x55cf622ec100 on [inode 0x100000003a9 [2,head] /dc-dir/dc-file_436 auth v4182 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.488584+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622ec100] now 0 2023-10-03T19:20:47.623 INFO:teuthology.orchestra.run.smithi045.stdout: -9088> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+539 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622ec100 count now 1/539 2023-10-03T19:20:47.623 INFO:teuthology.orchestra.run.smithi045.stdout: -9087> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003a9) clear_dirty_parent 2023-10-03T19:20:47.623 INFO:teuthology.orchestra.run.smithi045.stdout: -9086> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003aa) _stored_backtrace v 1750 2023-10-03T19:20:47.623 INFO:teuthology.orchestra.run.smithi045.stdout: -9085> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003aa) auth_unpin by 0x55cf622ec680 on [inode 0x100000003aa [2,head] /dc-dir/dc-file_437 auth v4184 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.499495+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622ec680] now 0 2023-10-03T19:20:47.623 INFO:teuthology.orchestra.run.smithi045.stdout: -9084> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+538 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622ec680 count now 1/538 2023-10-03T19:20:47.623 INFO:teuthology.orchestra.run.smithi045.stdout: -9083> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003aa) clear_dirty_parent 2023-10-03T19:20:47.623 INFO:teuthology.orchestra.run.smithi045.stdout: -9082> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ab) _stored_backtrace v 1754 2023-10-03T19:20:47.623 INFO:teuthology.orchestra.run.smithi045.stdout: -9081> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ab) auth_unpin by 0x55cf622ecc00 on [inode 0x100000003ab [2,head] /dc-dir/dc-file_438 auth v4482 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.511822+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622ecc00] now 0 2023-10-03T19:20:47.624 INFO:teuthology.orchestra.run.smithi045.stdout: -9080> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+537 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622ecc00 count now 1/537 2023-10-03T19:20:47.624 INFO:teuthology.orchestra.run.smithi045.stdout: -9079> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ab) clear_dirty_parent 2023-10-03T19:20:47.624 INFO:teuthology.orchestra.run.smithi045.stdout: -9078> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ac) _stored_backtrace v 1758 2023-10-03T19:20:47.624 INFO:teuthology.orchestra.run.smithi045.stdout: -9077> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ac) auth_unpin by 0x55cf622ed180 on [inode 0x100000003ac [2,head] /dc-dir/dc-file_439 auth v4484 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.524144+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622ed180] now 0 2023-10-03T19:20:47.624 INFO:teuthology.orchestra.run.smithi045.stdout: -9076> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+536 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622ed180 count now 1/536 2023-10-03T19:20:47.624 INFO:teuthology.orchestra.run.smithi045.stdout: -9075> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ac) clear_dirty_parent 2023-10-03T19:20:47.624 INFO:teuthology.orchestra.run.smithi045.stdout: -9074> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ad) _stored_backtrace v 1762 2023-10-03T19:20:47.624 INFO:teuthology.orchestra.run.smithi045.stdout: -9073> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ad) auth_unpin by 0x55cf622ed700 on [inode 0x100000003ad [2,head] /dc-dir/dc-file_440 auth v4486 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.535734+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622ed700] now 0 2023-10-03T19:20:47.624 INFO:teuthology.orchestra.run.smithi045.stdout: -9072> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+535 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622ed700 count now 1/535 2023-10-03T19:20:47.624 INFO:teuthology.orchestra.run.smithi045.stdout: -9071> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ad) clear_dirty_parent 2023-10-03T19:20:47.624 INFO:teuthology.orchestra.run.smithi045.stdout: -9070> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ae) _stored_backtrace v 1766 2023-10-03T19:20:47.624 INFO:teuthology.orchestra.run.smithi045.stdout: -9069> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ae) auth_unpin by 0x55cf622fa000 on [inode 0x100000003ae [2,head] /dc-dir/dc-file_441 auth v4488 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.547274+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622fa000] now 0 2023-10-03T19:20:47.625 INFO:teuthology.orchestra.run.smithi045.stdout: -9068> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+534 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622fa000 count now 1/534 2023-10-03T19:20:47.625 INFO:teuthology.orchestra.run.smithi045.stdout: -9067> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ae) clear_dirty_parent 2023-10-03T19:20:47.625 INFO:teuthology.orchestra.run.smithi045.stdout: -9066> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003af) _stored_backtrace v 1770 2023-10-03T19:20:47.625 INFO:teuthology.orchestra.run.smithi045.stdout: -9065> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003af) auth_unpin by 0x55cf622fa580 on [inode 0x100000003af [2,head] /dc-dir/dc-file_442 auth v4490 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.559736+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622fa580] now 0 2023-10-03T19:20:47.625 INFO:teuthology.orchestra.run.smithi045.stdout: -9064> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+533 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622fa580 count now 1/533 2023-10-03T19:20:47.625 INFO:teuthology.orchestra.run.smithi045.stdout: -9063> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003af) clear_dirty_parent 2023-10-03T19:20:47.625 INFO:teuthology.orchestra.run.smithi045.stdout: -9062> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003b0) _stored_backtrace v 1774 2023-10-03T19:20:47.625 INFO:teuthology.orchestra.run.smithi045.stdout: -9061> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003b0) auth_unpin by 0x55cf622fab00 on [inode 0x100000003b0 [2,head] /dc-dir/dc-file_443 auth v4492 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.570983+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622fab00] now 0 2023-10-03T19:20:47.625 INFO:teuthology.orchestra.run.smithi045.stdout: -9060> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+532 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622fab00 count now 1/532 2023-10-03T19:20:47.625 INFO:teuthology.orchestra.run.smithi045.stdout: -9059> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003b0) clear_dirty_parent 2023-10-03T19:20:47.625 INFO:teuthology.orchestra.run.smithi045.stdout: -9058> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003b1) _stored_backtrace v 1778 2023-10-03T19:20:47.625 INFO:teuthology.orchestra.run.smithi045.stdout: -9057> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003b1) auth_unpin by 0x55cf622fb080 on [inode 0x100000003b1 [2,head] /dc-dir/dc-file_444 auth v4494 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.581638+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622fb080] now 0 2023-10-03T19:20:47.626 INFO:teuthology.orchestra.run.smithi045.stdout: -9056> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+531 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622fb080 count now 1/531 2023-10-03T19:20:47.626 INFO:teuthology.orchestra.run.smithi045.stdout: -9055> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003b1) clear_dirty_parent 2023-10-03T19:20:47.626 INFO:teuthology.orchestra.run.smithi045.stdout: -9054> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003b2) _stored_backtrace v 1782 2023-10-03T19:20:47.626 INFO:teuthology.orchestra.run.smithi045.stdout: -9053> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003b2) auth_unpin by 0x55cf622fb600 on [inode 0x100000003b2 [2,head] /dc-dir/dc-file_445 auth v4496 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.592179+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622fb600] now 0 2023-10-03T19:20:47.626 INFO:teuthology.orchestra.run.smithi045.stdout: -9052> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+530 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622fb600 count now 1/530 2023-10-03T19:20:47.626 INFO:teuthology.orchestra.run.smithi045.stdout: -9051> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003b2) clear_dirty_parent 2023-10-03T19:20:47.626 INFO:teuthology.orchestra.run.smithi045.stdout: -9050> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003b3) _stored_backtrace v 1786 2023-10-03T19:20:47.727 INFO:teuthology.orchestra.run.smithi045.stdout: -9049> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003b3) auth_unpin by 0x55cf622fbb80 on [inode 0x100000003b3 [2,head] /dc-dir/dc-file_446 auth v4498 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.604959+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622fbb80] now 0 2023-10-03T19:20:47.727 INFO:teuthology.orchestra.run.smithi045.stdout: -9048> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+529 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622fbb80 count now 1/529 2023-10-03T19:20:47.727 INFO:teuthology.orchestra.run.smithi045.stdout: -9047> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003b3) clear_dirty_parent 2023-10-03T19:20:47.727 INFO:teuthology.orchestra.run.smithi045.stdout: -9046> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003b4) _stored_backtrace v 1790 2023-10-03T19:20:47.727 INFO:teuthology.orchestra.run.smithi045.stdout: -9045> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003b4) auth_unpin by 0x55cf622fc100 on [inode 0x100000003b4 [2,head] /dc-dir/dc-file_447 auth v4500 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.616558+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622fc100] now 0 2023-10-03T19:20:47.727 INFO:teuthology.orchestra.run.smithi045.stdout: -9044> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+528 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622fc100 count now 1/528 2023-10-03T19:20:47.727 INFO:teuthology.orchestra.run.smithi045.stdout: -9043> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003b4) clear_dirty_parent 2023-10-03T19:20:47.727 INFO:teuthology.orchestra.run.smithi045.stdout: -9042> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003b5) _stored_backtrace v 1794 2023-10-03T19:20:47.727 INFO:teuthology.orchestra.run.smithi045.stdout: -9041> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003b5) auth_unpin by 0x55cf622fc680 on [inode 0x100000003b5 [2,head] /dc-dir/dc-file_448 auth v4502 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.627978+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622fc680] now 0 2023-10-03T19:20:47.728 INFO:teuthology.orchestra.run.smithi045.stdout: -9040> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+527 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622fc680 count now 1/527 2023-10-03T19:20:47.728 INFO:teuthology.orchestra.run.smithi045.stdout: -9039> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003b5) clear_dirty_parent 2023-10-03T19:20:47.728 INFO:teuthology.orchestra.run.smithi045.stdout: -9038> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003b6) _stored_backtrace v 1798 2023-10-03T19:20:47.728 INFO:teuthology.orchestra.run.smithi045.stdout: -9037> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003b6) auth_unpin by 0x55cf622fcc00 on [inode 0x100000003b6 [2,head] /dc-dir/dc-file_449 auth v4504 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.638917+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622fcc00] now 0 2023-10-03T19:20:47.728 INFO:teuthology.orchestra.run.smithi045.stdout: -9036> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+526 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622fcc00 count now 1/526 2023-10-03T19:20:47.728 INFO:teuthology.orchestra.run.smithi045.stdout: -9035> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003b6) clear_dirty_parent 2023-10-03T19:20:47.728 INFO:teuthology.orchestra.run.smithi045.stdout: -9034> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003b7) _stored_backtrace v 1802 2023-10-03T19:20:47.728 INFO:teuthology.orchestra.run.smithi045.stdout: -9033> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003b7) auth_unpin by 0x55cf622fd180 on [inode 0x100000003b7 [2,head] /dc-dir/dc-file_450 auth v4506 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.649968+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622fd180] now 0 2023-10-03T19:20:47.728 INFO:teuthology.orchestra.run.smithi045.stdout: -9032> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+525 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622fd180 count now 1/525 2023-10-03T19:20:47.728 INFO:teuthology.orchestra.run.smithi045.stdout: -9031> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003b7) clear_dirty_parent 2023-10-03T19:20:47.728 INFO:teuthology.orchestra.run.smithi045.stdout: -9030> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003b8) _stored_backtrace v 1806 2023-10-03T19:20:47.729 INFO:teuthology.orchestra.run.smithi045.stdout: -9029> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003b8) auth_unpin by 0x55cf622fd700 on [inode 0x100000003b8 [2,head] /dc-dir/dc-file_451 auth v4508 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.661214+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622fd700] now 0 2023-10-03T19:20:47.729 INFO:teuthology.orchestra.run.smithi045.stdout: -9028> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+524 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622fd700 count now 1/524 2023-10-03T19:20:47.729 INFO:teuthology.orchestra.run.smithi045.stdout: -9027> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003b8) clear_dirty_parent 2023-10-03T19:20:47.729 INFO:teuthology.orchestra.run.smithi045.stdout: -9026> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003b9) _stored_backtrace v 1810 2023-10-03T19:20:47.729 INFO:teuthology.orchestra.run.smithi045.stdout: -9025> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003b9) auth_unpin by 0x55cf62306000 on [inode 0x100000003b9 [2,head] /dc-dir/dc-file_452 auth v4510 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.671912+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62306000] now 0 2023-10-03T19:20:47.729 INFO:teuthology.orchestra.run.smithi045.stdout: -9024> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+523 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62306000 count now 1/523 2023-10-03T19:20:47.729 INFO:teuthology.orchestra.run.smithi045.stdout: -9023> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003b9) clear_dirty_parent 2023-10-03T19:20:47.729 INFO:teuthology.orchestra.run.smithi045.stdout: -9022> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ba) _stored_backtrace v 1814 2023-10-03T19:20:47.729 INFO:teuthology.orchestra.run.smithi045.stdout: -9021> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ba) auth_unpin by 0x55cf62306580 on [inode 0x100000003ba [2,head] /dc-dir/dc-file_453 auth v4512 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.683268+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62306580] now 0 2023-10-03T19:20:47.729 INFO:teuthology.orchestra.run.smithi045.stdout: -9020> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+522 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62306580 count now 1/522 2023-10-03T19:20:47.729 INFO:teuthology.orchestra.run.smithi045.stdout: -9019> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ba) clear_dirty_parent 2023-10-03T19:20:47.730 INFO:teuthology.orchestra.run.smithi045.stdout: -9018> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003bb) _stored_backtrace v 1818 2023-10-03T19:20:47.730 INFO:teuthology.orchestra.run.smithi045.stdout: -9017> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003bb) auth_unpin by 0x55cf62306b00 on [inode 0x100000003bb [2,head] /dc-dir/dc-file_454 auth v4514 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.694828+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62306b00] now 0 2023-10-03T19:20:47.730 INFO:teuthology.orchestra.run.smithi045.stdout: -9016> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+521 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62306b00 count now 1/521 2023-10-03T19:20:47.730 INFO:teuthology.orchestra.run.smithi045.stdout: -9015> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003bb) clear_dirty_parent 2023-10-03T19:20:47.730 INFO:teuthology.orchestra.run.smithi045.stdout: -9014> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003bc) _stored_backtrace v 1822 2023-10-03T19:20:47.730 INFO:teuthology.orchestra.run.smithi045.stdout: -9013> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003bc) auth_unpin by 0x55cf62307080 on [inode 0x100000003bc [2,head] /dc-dir/dc-file_455 auth v4516 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.706001+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62307080] now 0 2023-10-03T19:20:47.730 INFO:teuthology.orchestra.run.smithi045.stdout: -9012> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+520 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62307080 count now 1/520 2023-10-03T19:20:47.730 INFO:teuthology.orchestra.run.smithi045.stdout: -9011> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003bc) clear_dirty_parent 2023-10-03T19:20:47.730 INFO:teuthology.orchestra.run.smithi045.stdout: -9010> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003bd) _stored_backtrace v 1826 2023-10-03T19:20:47.730 INFO:teuthology.orchestra.run.smithi045.stdout: -9009> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003bd) auth_unpin by 0x55cf62307600 on [inode 0x100000003bd [2,head] /dc-dir/dc-file_456 auth v4518 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.718344+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62307600] now 0 2023-10-03T19:20:47.730 INFO:teuthology.orchestra.run.smithi045.stdout: -9008> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+519 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62307600 count now 1/519 2023-10-03T19:20:47.731 INFO:teuthology.orchestra.run.smithi045.stdout: -9007> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003bd) clear_dirty_parent 2023-10-03T19:20:47.731 INFO:teuthology.orchestra.run.smithi045.stdout: -9006> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003be) _stored_backtrace v 1830 2023-10-03T19:20:47.731 INFO:teuthology.orchestra.run.smithi045.stdout: -9005> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003be) auth_unpin by 0x55cf62307b80 on [inode 0x100000003be [2,head] /dc-dir/dc-file_457 auth v4520 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.729313+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62307b80] now 0 2023-10-03T19:20:47.731 INFO:teuthology.orchestra.run.smithi045.stdout: -9004> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+518 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62307b80 count now 1/518 2023-10-03T19:20:47.731 INFO:teuthology.orchestra.run.smithi045.stdout: -9003> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003be) clear_dirty_parent 2023-10-03T19:20:47.731 INFO:teuthology.orchestra.run.smithi045.stdout: -9002> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003bf) _stored_backtrace v 1834 2023-10-03T19:20:47.731 INFO:teuthology.orchestra.run.smithi045.stdout: -9001> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003bf) auth_unpin by 0x55cf62308100 on [inode 0x100000003bf [2,head] /dc-dir/dc-file_458 auth v4522 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.740269+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62308100] now 0 2023-10-03T19:20:47.731 INFO:teuthology.orchestra.run.smithi045.stdout: -9000> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+517 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62308100 count now 1/517 2023-10-03T19:20:47.731 INFO:teuthology.orchestra.run.smithi045.stdout: -8999> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003bf) clear_dirty_parent 2023-10-03T19:20:47.731 INFO:teuthology.orchestra.run.smithi045.stdout: -8998> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003c0) _stored_backtrace v 1838 2023-10-03T19:20:47.731 INFO:teuthology.orchestra.run.smithi045.stdout: -8997> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003c0) auth_unpin by 0x55cf62308680 on [inode 0x100000003c0 [2,head] /dc-dir/dc-file_459 auth v4524 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.751580+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62308680] now 0 2023-10-03T19:20:47.731 INFO:teuthology.orchestra.run.smithi045.stdout: -8996> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+516 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62308680 count now 1/516 2023-10-03T19:20:47.731 INFO:teuthology.orchestra.run.smithi045.stdout: -8995> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003c0) clear_dirty_parent 2023-10-03T19:20:47.732 INFO:teuthology.orchestra.run.smithi045.stdout: -8994> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003c1) _stored_backtrace v 1842 2023-10-03T19:20:47.732 INFO:teuthology.orchestra.run.smithi045.stdout: -8993> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003c1) auth_unpin by 0x55cf62308c00 on [inode 0x100000003c1 [2,head] /dc-dir/dc-file_460 auth v4526 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.763050+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62308c00] now 0 2023-10-03T19:20:47.732 INFO:teuthology.orchestra.run.smithi045.stdout: -8992> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+515 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62308c00 count now 1/515 2023-10-03T19:20:47.732 INFO:teuthology.orchestra.run.smithi045.stdout: -8991> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003c1) clear_dirty_parent 2023-10-03T19:20:47.732 INFO:teuthology.orchestra.run.smithi045.stdout: -8990> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003c2) _stored_backtrace v 1846 2023-10-03T19:20:47.732 INFO:teuthology.orchestra.run.smithi045.stdout: -8989> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003c2) auth_unpin by 0x55cf62309180 on [inode 0x100000003c2 [2,head] /dc-dir/dc-file_461 auth v4528 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.775098+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62309180] now 0 2023-10-03T19:20:47.732 INFO:teuthology.orchestra.run.smithi045.stdout: -8988> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+514 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62309180 count now 1/514 2023-10-03T19:20:47.732 INFO:teuthology.orchestra.run.smithi045.stdout: -8987> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003c2) clear_dirty_parent 2023-10-03T19:20:47.732 INFO:teuthology.orchestra.run.smithi045.stdout: -8986> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003c3) _stored_backtrace v 1850 2023-10-03T19:20:47.734 INFO:teuthology.orchestra.run.smithi045.stdout: -8985> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003c3) auth_unpin by 0x55cf62309700 on [inode 0x100000003c3 [2,head] /dc-dir/dc-file_462 auth v4530 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.787531+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62309700] now 0 2023-10-03T19:20:47.734 INFO:teuthology.orchestra.run.smithi045.stdout: -8984> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+513 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62309700 count now 1/513 2023-10-03T19:20:47.735 INFO:teuthology.orchestra.run.smithi045.stdout: -8983> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003c3) clear_dirty_parent 2023-10-03T19:20:47.735 INFO:teuthology.orchestra.run.smithi045.stdout: -8982> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003c4) _stored_backtrace v 1854 2023-10-03T19:20:47.735 INFO:teuthology.orchestra.run.smithi045.stdout: -8981> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003c4) auth_unpin by 0x55cf62314000 on [inode 0x100000003c4 [2,head] /dc-dir/dc-file_463 auth v4532 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.798165+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62314000] now 0 2023-10-03T19:20:47.735 INFO:teuthology.orchestra.run.smithi045.stdout: -8980> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+512 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62314000 count now 1/512 2023-10-03T19:20:47.735 INFO:teuthology.orchestra.run.smithi045.stdout: -8979> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003c4) clear_dirty_parent 2023-10-03T19:20:47.735 INFO:teuthology.orchestra.run.smithi045.stdout: -8978> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003c5) _stored_backtrace v 1858 2023-10-03T19:20:47.735 INFO:teuthology.orchestra.run.smithi045.stdout: -8977> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003c5) auth_unpin by 0x55cf62314580 on [inode 0x100000003c5 [2,head] /dc-dir/dc-file_464 auth v4534 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.809269+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62314580] now 0 2023-10-03T19:20:47.735 INFO:teuthology.orchestra.run.smithi045.stdout: -8976> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+511 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62314580 count now 1/511 2023-10-03T19:20:47.735 INFO:teuthology.orchestra.run.smithi045.stdout: -8975> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003c5) clear_dirty_parent 2023-10-03T19:20:47.735 INFO:teuthology.orchestra.run.smithi045.stdout: -8974> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003c6) _stored_backtrace v 1862 2023-10-03T19:20:47.735 INFO:teuthology.orchestra.run.smithi045.stdout: -8973> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003c6) auth_unpin by 0x55cf62314b00 on [inode 0x100000003c6 [2,head] /dc-dir/dc-file_465 auth v4536 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.820667+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62314b00] now 0 2023-10-03T19:20:47.735 INFO:teuthology.orchestra.run.smithi045.stdout: -8972> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+510 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62314b00 count now 1/510 2023-10-03T19:20:47.736 INFO:teuthology.orchestra.run.smithi045.stdout: -8971> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003c6) clear_dirty_parent 2023-10-03T19:20:47.736 INFO:teuthology.orchestra.run.smithi045.stdout: -8970> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003c7) _stored_backtrace v 1866 2023-10-03T19:20:47.736 INFO:teuthology.orchestra.run.smithi045.stdout: -8969> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003c7) auth_unpin by 0x55cf62315080 on [inode 0x100000003c7 [2,head] /dc-dir/dc-file_466 auth v4538 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.833468+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62315080] now 0 2023-10-03T19:20:47.736 INFO:teuthology.orchestra.run.smithi045.stdout: -8968> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+509 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62315080 count now 1/509 2023-10-03T19:20:47.736 INFO:teuthology.orchestra.run.smithi045.stdout: -8967> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003c7) clear_dirty_parent 2023-10-03T19:20:47.736 INFO:teuthology.orchestra.run.smithi045.stdout: -8966> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003c8) _stored_backtrace v 1870 2023-10-03T19:20:47.736 INFO:teuthology.orchestra.run.smithi045.stdout: -8965> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003c8) auth_unpin by 0x55cf62315600 on [inode 0x100000003c8 [2,head] /dc-dir/dc-file_467 auth v4540 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.847084+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62315600] now 0 2023-10-03T19:20:47.736 INFO:teuthology.orchestra.run.smithi045.stdout: -8964> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+508 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62315600 count now 1/508 2023-10-03T19:20:47.736 INFO:teuthology.orchestra.run.smithi045.stdout: -8963> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003c8) clear_dirty_parent 2023-10-03T19:20:47.736 INFO:teuthology.orchestra.run.smithi045.stdout: -8962> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003c9) _stored_backtrace v 1874 2023-10-03T19:20:47.736 INFO:teuthology.orchestra.run.smithi045.stdout: -8961> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003c9) auth_unpin by 0x55cf62315b80 on [inode 0x100000003c9 [2,head] /dc-dir/dc-file_468 auth v4542 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.858672+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62315b80] now 0 2023-10-03T19:20:47.737 INFO:teuthology.orchestra.run.smithi045.stdout: -8960> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+507 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62315b80 count now 1/507 2023-10-03T19:20:47.737 INFO:teuthology.orchestra.run.smithi045.stdout: -8959> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003c9) clear_dirty_parent 2023-10-03T19:20:47.737 INFO:teuthology.orchestra.run.smithi045.stdout: -8958> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ca) _stored_backtrace v 1878 2023-10-03T19:20:47.737 INFO:teuthology.orchestra.run.smithi045.stdout: -8957> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ca) auth_unpin by 0x55cf62316100 on [inode 0x100000003ca [2,head] /dc-dir/dc-file_469 auth v4544 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.869654+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62316100] now 0 2023-10-03T19:20:47.737 INFO:teuthology.orchestra.run.smithi045.stdout: -8956> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+506 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62316100 count now 1/506 2023-10-03T19:20:47.737 INFO:teuthology.orchestra.run.smithi045.stdout: -8955> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ca) clear_dirty_parent 2023-10-03T19:20:47.737 INFO:teuthology.orchestra.run.smithi045.stdout: -8954> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003cb) _stored_backtrace v 1882 2023-10-03T19:20:47.737 INFO:teuthology.orchestra.run.smithi045.stdout: -8953> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003cb) auth_unpin by 0x55cf62316680 on [inode 0x100000003cb [2,head] /dc-dir/dc-file_470 auth v4546 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.880957+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62316680] now 0 2023-10-03T19:20:47.737 INFO:teuthology.orchestra.run.smithi045.stdout: -8952> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+505 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62316680 count now 1/505 2023-10-03T19:20:47.737 INFO:teuthology.orchestra.run.smithi045.stdout: -8951> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003cb) clear_dirty_parent 2023-10-03T19:20:47.737 INFO:teuthology.orchestra.run.smithi045.stdout: -8950> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003cc) _stored_backtrace v 1886 2023-10-03T19:20:47.738 INFO:teuthology.orchestra.run.smithi045.stdout: -8949> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003cc) auth_unpin by 0x55cf62316c00 on [inode 0x100000003cc [2,head] /dc-dir/dc-file_471 auth v4548 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.891988+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62316c00] now 0 2023-10-03T19:20:47.738 INFO:teuthology.orchestra.run.smithi045.stdout: -8948> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+504 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62316c00 count now 1/504 2023-10-03T19:20:47.738 INFO:teuthology.orchestra.run.smithi045.stdout: -8947> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003cc) clear_dirty_parent 2023-10-03T19:20:47.738 INFO:teuthology.orchestra.run.smithi045.stdout: -8946> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003cd) _stored_backtrace v 1890 2023-10-03T19:20:47.738 INFO:teuthology.orchestra.run.smithi045.stdout: -8945> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003cd) auth_unpin by 0x55cf62317180 on [inode 0x100000003cd [2,head] /dc-dir/dc-file_472 auth v4550 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.903207+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62317180] now 0 2023-10-03T19:20:47.738 INFO:teuthology.orchestra.run.smithi045.stdout: -8944> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+503 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62317180 count now 1/503 2023-10-03T19:20:47.738 INFO:teuthology.orchestra.run.smithi045.stdout: -8943> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003cd) clear_dirty_parent 2023-10-03T19:20:47.738 INFO:teuthology.orchestra.run.smithi045.stdout: -8942> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ce) _stored_backtrace v 1894 2023-10-03T19:20:47.738 INFO:teuthology.orchestra.run.smithi045.stdout: -8941> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ce) auth_unpin by 0x55cf62317700 on [inode 0x100000003ce [2,head] /dc-dir/dc-file_473 auth v4552 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.915243+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62317700] now 0 2023-10-03T19:20:47.738 INFO:teuthology.orchestra.run.smithi045.stdout: -8940> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+502 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62317700 count now 1/502 2023-10-03T19:20:47.738 INFO:teuthology.orchestra.run.smithi045.stdout: -8939> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ce) clear_dirty_parent 2023-10-03T19:20:47.739 INFO:teuthology.orchestra.run.smithi045.stdout: -8938> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003cf) _stored_backtrace v 1898 2023-10-03T19:20:47.739 INFO:teuthology.orchestra.run.smithi045.stdout: -8937> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003cf) auth_unpin by 0x55cf6231e000 on [inode 0x100000003cf [2,head] /dc-dir/dc-file_474 auth v4554 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.927331+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6231e000] now 0 2023-10-03T19:20:47.739 INFO:teuthology.orchestra.run.smithi045.stdout: -8936> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+501 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6231e000 count now 1/501 2023-10-03T19:20:47.739 INFO:teuthology.orchestra.run.smithi045.stdout: -8935> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003cf) clear_dirty_parent 2023-10-03T19:20:47.739 INFO:teuthology.orchestra.run.smithi045.stdout: -8934> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003d0) _stored_backtrace v 1902 2023-10-03T19:20:47.739 INFO:teuthology.orchestra.run.smithi045.stdout: -8933> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003d0) auth_unpin by 0x55cf6231e580 on [inode 0x100000003d0 [2,head] /dc-dir/dc-file_475 auth v4556 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.938498+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6231e580] now 0 2023-10-03T19:20:47.739 INFO:teuthology.orchestra.run.smithi045.stdout: -8932> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+500 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6231e580 count now 1/500 2023-10-03T19:20:47.739 INFO:teuthology.orchestra.run.smithi045.stdout: -8931> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003d0) clear_dirty_parent 2023-10-03T19:20:47.758 INFO:teuthology.orchestra.run.smithi045.stdout: -8930> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003d1) _stored_backtrace v 1906 2023-10-03T19:20:47.758 INFO:teuthology.orchestra.run.smithi045.stdout: -8929> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003d1) auth_unpin by 0x55cf6231eb00 on [inode 0x100000003d1 [2,head] /dc-dir/dc-file_476 auth v4558 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.949298+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6231eb00] now 0 2023-10-03T19:20:47.758 INFO:teuthology.orchestra.run.smithi045.stdout: -8928> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+499 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6231eb00 count now 1/499 2023-10-03T19:20:47.758 INFO:teuthology.orchestra.run.smithi045.stdout: -8927> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003d1) clear_dirty_parent 2023-10-03T19:20:47.759 INFO:teuthology.orchestra.run.smithi045.stdout: -8926> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003d2) _stored_backtrace v 1910 2023-10-03T19:20:47.775 INFO:teuthology.orchestra.run.smithi045.stdout: -8925> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003d2) auth_unpin by 0x55cf6231f080 on [inode 0x100000003d2 [2,head] /dc-dir/dc-file_477 auth v4560 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.961860+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6231f080] now 0 2023-10-03T19:20:47.775 INFO:teuthology.orchestra.run.smithi045.stdout: -8924> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+498 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6231f080 count now 1/498 2023-10-03T19:20:47.775 INFO:teuthology.orchestra.run.smithi045.stdout: -8923> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003d2) clear_dirty_parent 2023-10-03T19:20:47.775 INFO:teuthology.orchestra.run.smithi045.stdout: -8922> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003d3) _stored_backtrace v 1914 2023-10-03T19:20:47.775 INFO:teuthology.orchestra.run.smithi045.stdout: -8921> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003d3) auth_unpin by 0x55cf6231f600 on [inode 0x100000003d3 [2,head] /dc-dir/dc-file_478 auth v4562 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.975080+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6231f600] now 0 2023-10-03T19:20:47.775 INFO:teuthology.orchestra.run.smithi045.stdout: -8920> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+497 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6231f600 count now 1/497 2023-10-03T19:20:47.776 INFO:teuthology.orchestra.run.smithi045.stdout: -8919> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003d3) clear_dirty_parent 2023-10-03T19:20:47.776 INFO:teuthology.orchestra.run.smithi045.stdout: -8918> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003d4) _stored_backtrace v 1918 2023-10-03T19:20:47.776 INFO:teuthology.orchestra.run.smithi045.stdout: -8917> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003d4) auth_unpin by 0x55cf6231fb80 on [inode 0x100000003d4 [2,head] /dc-dir/dc-file_479 auth v4564 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:39.988302+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6231fb80] now 0 2023-10-03T19:20:47.776 INFO:teuthology.orchestra.run.smithi045.stdout: -8916> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+496 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6231fb80 count now 1/496 2023-10-03T19:20:47.776 INFO:teuthology.orchestra.run.smithi045.stdout: -8915> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003d4) clear_dirty_parent 2023-10-03T19:20:47.776 INFO:teuthology.orchestra.run.smithi045.stdout: -8914> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003d5) _stored_backtrace v 1922 2023-10-03T19:20:47.776 INFO:teuthology.orchestra.run.smithi045.stdout: -8913> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003d5) auth_unpin by 0x55cf62320100 on [inode 0x100000003d5 [2,head] /dc-dir/dc-file_480 auth v4566 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.001135+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62320100] now 0 2023-10-03T19:20:47.776 INFO:teuthology.orchestra.run.smithi045.stdout: -8912> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+495 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62320100 count now 1/495 2023-10-03T19:20:47.776 INFO:teuthology.orchestra.run.smithi045.stdout: -8911> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003d5) clear_dirty_parent 2023-10-03T19:20:47.776 INFO:teuthology.orchestra.run.smithi045.stdout: -8910> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003d6) _stored_backtrace v 1926 2023-10-03T19:20:47.776 INFO:teuthology.orchestra.run.smithi045.stdout: -8909> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003d6) auth_unpin by 0x55cf62320680 on [inode 0x100000003d6 [2,head] /dc-dir/dc-file_481 auth v4568 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.014369+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62320680] now 0 2023-10-03T19:20:47.777 INFO:teuthology.orchestra.run.smithi045.stdout: -8908> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+494 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62320680 count now 1/494 2023-10-03T19:20:47.777 INFO:teuthology.orchestra.run.smithi045.stdout: -8907> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003d6) clear_dirty_parent 2023-10-03T19:20:47.777 INFO:teuthology.orchestra.run.smithi045.stdout: -8906> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003d7) _stored_backtrace v 1930 2023-10-03T19:20:47.777 INFO:teuthology.orchestra.run.smithi045.stdout: -8905> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003d7) auth_unpin by 0x55cf62320c00 on [inode 0x100000003d7 [2,head] /dc-dir/dc-file_482 auth v4570 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.026860+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62320c00] now 0 2023-10-03T19:20:47.777 INFO:teuthology.orchestra.run.smithi045.stdout: -8904> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+493 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62320c00 count now 1/493 2023-10-03T19:20:47.777 INFO:teuthology.orchestra.run.smithi045.stdout: -8903> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003d7) clear_dirty_parent 2023-10-03T19:20:47.777 INFO:teuthology.orchestra.run.smithi045.stdout: -8902> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003d8) _stored_backtrace v 1934 2023-10-03T19:20:47.777 INFO:teuthology.orchestra.run.smithi045.stdout: -8901> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003d8) auth_unpin by 0x55cf62321180 on [inode 0x100000003d8 [2,head] /dc-dir/dc-file_483 auth v4572 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.039687+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62321180] now 0 2023-10-03T19:20:47.777 INFO:teuthology.orchestra.run.smithi045.stdout: -8900> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+492 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62321180 count now 1/492 2023-10-03T19:20:47.777 INFO:teuthology.orchestra.run.smithi045.stdout: -8899> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003d8) clear_dirty_parent 2023-10-03T19:20:47.777 INFO:teuthology.orchestra.run.smithi045.stdout: -8898> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003d9) _stored_backtrace v 1938 2023-10-03T19:20:47.777 INFO:teuthology.orchestra.run.smithi045.stdout: -8897> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003d9) auth_unpin by 0x55cf62321700 on [inode 0x100000003d9 [2,head] /dc-dir/dc-file_484 auth v4574 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.052495+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62321700] now 0 2023-10-03T19:20:47.778 INFO:teuthology.orchestra.run.smithi045.stdout: -8896> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+491 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62321700 count now 1/491 2023-10-03T19:20:47.778 INFO:teuthology.orchestra.run.smithi045.stdout: -8895> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003d9) clear_dirty_parent 2023-10-03T19:20:47.778 INFO:teuthology.orchestra.run.smithi045.stdout: -8894> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003da) _stored_backtrace v 1942 2023-10-03T19:20:47.778 INFO:teuthology.orchestra.run.smithi045.stdout: -8893> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003da) auth_unpin by 0x55cf62328000 on [inode 0x100000003da [2,head] /dc-dir/dc-file_485 auth v4576 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.064925+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62328000] now 0 2023-10-03T19:20:47.778 INFO:teuthology.orchestra.run.smithi045.stdout: -8892> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+490 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62328000 count now 1/490 2023-10-03T19:20:47.778 INFO:teuthology.orchestra.run.smithi045.stdout: -8891> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003da) clear_dirty_parent 2023-10-03T19:20:47.778 INFO:teuthology.orchestra.run.smithi045.stdout: -8890> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003db) _stored_backtrace v 1946 2023-10-03T19:20:47.778 INFO:teuthology.orchestra.run.smithi045.stdout: -8889> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003db) auth_unpin by 0x55cf62328580 on [inode 0x100000003db [2,head] /dc-dir/dc-file_486 auth v4578 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.077191+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62328580] now 0 2023-10-03T19:20:47.778 INFO:teuthology.orchestra.run.smithi045.stdout: -8888> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+489 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62328580 count now 1/489 2023-10-03T19:20:47.779 INFO:teuthology.orchestra.run.smithi045.stdout: -8887> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003db) clear_dirty_parent 2023-10-03T19:20:47.779 INFO:teuthology.orchestra.run.smithi045.stdout: -8886> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003dc) _stored_backtrace v 1950 2023-10-03T19:20:47.779 INFO:teuthology.orchestra.run.smithi045.stdout: -8885> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003dc) auth_unpin by 0x55cf62328b00 on [inode 0x100000003dc [2,head] /dc-dir/dc-file_487 auth v4580 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.088727+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62328b00] now 0 2023-10-03T19:20:47.779 INFO:teuthology.orchestra.run.smithi045.stdout: -8884> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+488 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62328b00 count now 1/488 2023-10-03T19:20:47.779 INFO:teuthology.orchestra.run.smithi045.stdout: -8883> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003dc) clear_dirty_parent 2023-10-03T19:20:47.779 INFO:teuthology.orchestra.run.smithi045.stdout: -8882> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003dd) _stored_backtrace v 1954 2023-10-03T19:20:47.779 INFO:teuthology.orchestra.run.smithi045.stdout: -8881> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003dd) auth_unpin by 0x55cf62329080 on [inode 0x100000003dd [2,head] /dc-dir/dc-file_488 auth v4582 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.101150+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62329080] now 0 2023-10-03T19:20:47.779 INFO:teuthology.orchestra.run.smithi045.stdout: -8880> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+487 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62329080 count now 1/487 2023-10-03T19:20:47.779 INFO:teuthology.orchestra.run.smithi045.stdout: -8879> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003dd) clear_dirty_parent 2023-10-03T19:20:47.779 INFO:teuthology.orchestra.run.smithi045.stdout: -8878> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003de) _stored_backtrace v 1958 2023-10-03T19:20:47.779 INFO:teuthology.orchestra.run.smithi045.stdout: -8877> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003de) auth_unpin by 0x55cf62329600 on [inode 0x100000003de [2,head] /dc-dir/dc-file_489 auth v4584 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.112875+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62329600] now 0 2023-10-03T19:20:47.780 INFO:teuthology.orchestra.run.smithi045.stdout: -8876> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+486 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62329600 count now 1/486 2023-10-03T19:20:47.780 INFO:teuthology.orchestra.run.smithi045.stdout: -8875> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003de) clear_dirty_parent 2023-10-03T19:20:47.780 INFO:teuthology.orchestra.run.smithi045.stdout: -8874> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003df) _stored_backtrace v 1962 2023-10-03T19:20:47.780 INFO:teuthology.orchestra.run.smithi045.stdout: -8873> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003df) auth_unpin by 0x55cf62329b80 on [inode 0x100000003df [2,head] /dc-dir/dc-file_490 auth v4586 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.124501+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62329b80] now 0 2023-10-03T19:20:47.780 INFO:teuthology.orchestra.run.smithi045.stdout: -8872> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+485 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62329b80 count now 1/485 2023-10-03T19:20:47.780 INFO:teuthology.orchestra.run.smithi045.stdout: -8871> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003df) clear_dirty_parent 2023-10-03T19:20:47.780 INFO:teuthology.orchestra.run.smithi045.stdout: -8870> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003e0) _stored_backtrace v 1966 2023-10-03T19:20:47.780 INFO:teuthology.orchestra.run.smithi045.stdout: -8869> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003e0) auth_unpin by 0x55cf6232a100 on [inode 0x100000003e0 [2,head] /dc-dir/dc-file_491 auth v4588 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.135350+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6232a100] now 0 2023-10-03T19:20:47.780 INFO:teuthology.orchestra.run.smithi045.stdout: -8868> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+484 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6232a100 count now 1/484 2023-10-03T19:20:47.780 INFO:teuthology.orchestra.run.smithi045.stdout: -8867> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003e0) clear_dirty_parent 2023-10-03T19:20:47.780 INFO:teuthology.orchestra.run.smithi045.stdout: -8866> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003e1) _stored_backtrace v 1970 2023-10-03T19:20:47.781 INFO:teuthology.orchestra.run.smithi045.stdout: -8865> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003e1) auth_unpin by 0x55cf6232a680 on [inode 0x100000003e1 [2,head] /dc-dir/dc-file_492 auth v4590 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.146521+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6232a680] now 0 2023-10-03T19:20:47.781 INFO:teuthology.orchestra.run.smithi045.stdout: -8864> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+483 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6232a680 count now 1/483 2023-10-03T19:20:47.781 INFO:teuthology.orchestra.run.smithi045.stdout: -8863> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003e1) clear_dirty_parent 2023-10-03T19:20:47.781 INFO:teuthology.orchestra.run.smithi045.stdout: -8862> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003e2) _stored_backtrace v 1974 2023-10-03T19:20:47.781 INFO:teuthology.orchestra.run.smithi045.stdout: -8861> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003e2) auth_unpin by 0x55cf6232ac00 on [inode 0x100000003e2 [2,head] /dc-dir/dc-file_493 auth v4592 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.157744+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6232ac00] now 0 2023-10-03T19:20:47.781 INFO:teuthology.orchestra.run.smithi045.stdout: -8860> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+482 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6232ac00 count now 1/482 2023-10-03T19:20:47.781 INFO:teuthology.orchestra.run.smithi045.stdout: -8859> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003e2) clear_dirty_parent 2023-10-03T19:20:47.781 INFO:teuthology.orchestra.run.smithi045.stdout: -8858> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003e3) _stored_backtrace v 1978 2023-10-03T19:20:47.781 INFO:teuthology.orchestra.run.smithi045.stdout: -8857> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003e3) auth_unpin by 0x55cf6232b180 on [inode 0x100000003e3 [2,head] /dc-dir/dc-file_494 auth v4594 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.169839+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6232b180] now 0 2023-10-03T19:20:47.781 INFO:teuthology.orchestra.run.smithi045.stdout: -8856> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+481 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6232b180 count now 1/481 2023-10-03T19:20:47.781 INFO:teuthology.orchestra.run.smithi045.stdout: -8855> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003e3) clear_dirty_parent 2023-10-03T19:20:47.782 INFO:teuthology.orchestra.run.smithi045.stdout: -8854> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003e4) _stored_backtrace v 1982 2023-10-03T19:20:47.782 INFO:teuthology.orchestra.run.smithi045.stdout: -8853> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003e4) auth_unpin by 0x55cf6232b700 on [inode 0x100000003e4 [2,head] /dc-dir/dc-file_495 auth v4596 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.181959+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6232b700] now 0 2023-10-03T19:20:47.782 INFO:teuthology.orchestra.run.smithi045.stdout: -8852> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+480 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6232b700 count now 1/480 2023-10-03T19:20:47.782 INFO:teuthology.orchestra.run.smithi045.stdout: -8851> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003e4) clear_dirty_parent 2023-10-03T19:20:47.782 INFO:teuthology.orchestra.run.smithi045.stdout: -8850> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003e5) _stored_backtrace v 1986 2023-10-03T19:20:47.782 INFO:teuthology.orchestra.run.smithi045.stdout: -8849> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003e5) auth_unpin by 0x55cf62288000 on [inode 0x100000003e5 [2,head] /dc-dir/dc-file_496 auth v4598 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.193344+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62288000] now 0 2023-10-03T19:20:47.782 INFO:teuthology.orchestra.run.smithi045.stdout: -8848> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+479 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62288000 count now 1/479 2023-10-03T19:20:47.782 INFO:teuthology.orchestra.run.smithi045.stdout: -8847> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003e5) clear_dirty_parent 2023-10-03T19:20:47.782 INFO:teuthology.orchestra.run.smithi045.stdout: -8846> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003e6) _stored_backtrace v 1990 2023-10-03T19:20:47.782 INFO:teuthology.orchestra.run.smithi045.stdout: -8845> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003e6) auth_unpin by 0x55cf62288580 on [inode 0x100000003e6 [2,head] /dc-dir/dc-file_497 auth v4600 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.205254+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62288580] now 0 2023-10-03T19:20:47.782 INFO:teuthology.orchestra.run.smithi045.stdout: -8844> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+478 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62288580 count now 1/478 2023-10-03T19:20:47.783 INFO:teuthology.orchestra.run.smithi045.stdout: -8843> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003e6) clear_dirty_parent 2023-10-03T19:20:47.783 INFO:teuthology.orchestra.run.smithi045.stdout: -8842> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003e7) _stored_backtrace v 1994 2023-10-03T19:20:47.783 INFO:teuthology.orchestra.run.smithi045.stdout: -8841> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003e7) auth_unpin by 0x55cf62288b00 on [inode 0x100000003e7 [2,head] /dc-dir/dc-file_498 auth v4602 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.216415+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62288b00] now 0 2023-10-03T19:20:47.783 INFO:teuthology.orchestra.run.smithi045.stdout: -8840> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+477 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62288b00 count now 1/477 2023-10-03T19:20:47.783 INFO:teuthology.orchestra.run.smithi045.stdout: -8839> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003e7) clear_dirty_parent 2023-10-03T19:20:47.783 INFO:teuthology.orchestra.run.smithi045.stdout: -8838> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003e8) _stored_backtrace v 1998 2023-10-03T19:20:47.783 INFO:teuthology.orchestra.run.smithi045.stdout: -8837> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003e8) auth_unpin by 0x55cf62289080 on [inode 0x100000003e8 [2,head] /dc-dir/dc-file_499 auth v4604 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.227397+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62289080] now 0 2023-10-03T19:20:47.783 INFO:teuthology.orchestra.run.smithi045.stdout: -8836> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+476 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62289080 count now 1/476 2023-10-03T19:20:47.783 INFO:teuthology.orchestra.run.smithi045.stdout: -8835> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003e8) clear_dirty_parent 2023-10-03T19:20:47.783 INFO:teuthology.orchestra.run.smithi045.stdout: -8834> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003e9) _stored_backtrace v 2002 2023-10-03T19:20:47.783 INFO:teuthology.orchestra.run.smithi045.stdout: -8833> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003e9) auth_unpin by 0x55cf62289600 on [inode 0x100000003e9 [2,head] /dc-dir/dc-file_500 auth v4606 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.238658+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62289600] now 0 2023-10-03T19:20:47.783 INFO:teuthology.orchestra.run.smithi045.stdout: -8832> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+475 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62289600 count now 1/475 2023-10-03T19:20:47.784 INFO:teuthology.orchestra.run.smithi045.stdout: -8831> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003e9) clear_dirty_parent 2023-10-03T19:20:47.784 INFO:teuthology.orchestra.run.smithi045.stdout: -8830> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ea) _stored_backtrace v 2006 2023-10-03T19:20:47.784 INFO:teuthology.orchestra.run.smithi045.stdout: -8829> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ea) auth_unpin by 0x55cf62289b80 on [inode 0x100000003ea [2,head] /dc-dir/dc-file_501 auth v4608 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.250445+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62289b80] now 0 2023-10-03T19:20:47.784 INFO:teuthology.orchestra.run.smithi045.stdout: -8828> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+474 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62289b80 count now 1/474 2023-10-03T19:20:47.784 INFO:teuthology.orchestra.run.smithi045.stdout: -8827> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ea) clear_dirty_parent 2023-10-03T19:20:47.784 INFO:teuthology.orchestra.run.smithi045.stdout: -8826> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003eb) _stored_backtrace v 2010 2023-10-03T19:20:47.784 INFO:teuthology.orchestra.run.smithi045.stdout: -8825> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003eb) auth_unpin by 0x55cf6228a100 on [inode 0x100000003eb [2,head] /dc-dir/dc-file_502 auth v4610 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.261634+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6228a100] now 0 2023-10-03T19:20:47.881 INFO:teuthology.orchestra.run.smithi045.stdout: -8824> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+473 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6228a100 count now 1/473 2023-10-03T19:20:47.881 INFO:teuthology.orchestra.run.smithi045.stdout: -8823> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003eb) clear_dirty_parent 2023-10-03T19:20:47.881 INFO:teuthology.orchestra.run.smithi045.stdout: -8822> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ec) _stored_backtrace v 2014 2023-10-03T19:20:47.881 INFO:teuthology.orchestra.run.smithi045.stdout: -8821> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ec) auth_unpin by 0x55cf6228a680 on [inode 0x100000003ec [2,head] /dc-dir/dc-file_503 auth v4612 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.273510+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6228a680] now 0 2023-10-03T19:20:47.881 INFO:teuthology.orchestra.run.smithi045.stdout: -8820> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+472 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6228a680 count now 1/472 2023-10-03T19:20:47.881 INFO:teuthology.orchestra.run.smithi045.stdout: -8819> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ec) clear_dirty_parent 2023-10-03T19:20:47.881 INFO:teuthology.orchestra.run.smithi045.stdout: -8818> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ed) _stored_backtrace v 2018 2023-10-03T19:20:47.881 INFO:teuthology.orchestra.run.smithi045.stdout: -8817> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ed) auth_unpin by 0x55cf6228ac00 on [inode 0x100000003ed [2,head] /dc-dir/dc-file_504 auth v4614 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.285195+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6228ac00] now 0 2023-10-03T19:20:47.882 INFO:teuthology.orchestra.run.smithi045.stdout: -8816> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+471 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6228ac00 count now 1/471 2023-10-03T19:20:47.882 INFO:teuthology.orchestra.run.smithi045.stdout: -8815> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ed) clear_dirty_parent 2023-10-03T19:20:47.882 INFO:teuthology.orchestra.run.smithi045.stdout: -8814> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ee) _stored_backtrace v 2022 2023-10-03T19:20:47.882 INFO:teuthology.orchestra.run.smithi045.stdout: -8813> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ee) auth_unpin by 0x55cf6228b180 on [inode 0x100000003ee [2,head] /dc-dir/dc-file_505 auth v4616 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.297375+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6228b180] now 0 2023-10-03T19:20:47.882 INFO:teuthology.orchestra.run.smithi045.stdout: -8812> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+470 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6228b180 count now 1/470 2023-10-03T19:20:47.882 INFO:teuthology.orchestra.run.smithi045.stdout: -8811> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ee) clear_dirty_parent 2023-10-03T19:20:47.882 INFO:teuthology.orchestra.run.smithi045.stdout: -8810> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ef) _stored_backtrace v 2026 2023-10-03T19:20:47.882 INFO:teuthology.orchestra.run.smithi045.stdout: -8809> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ef) auth_unpin by 0x55cf6228b700 on [inode 0x100000003ef [2,head] /dc-dir/dc-file_506 auth v4618 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.309477+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6228b700] now 0 2023-10-03T19:20:47.882 INFO:teuthology.orchestra.run.smithi045.stdout: -8808> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+469 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6228b700 count now 1/469 2023-10-03T19:20:47.882 INFO:teuthology.orchestra.run.smithi045.stdout: -8807> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ef) clear_dirty_parent 2023-10-03T19:20:47.883 INFO:teuthology.orchestra.run.smithi045.stdout: -8806> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003f0) _stored_backtrace v 2030 2023-10-03T19:20:47.883 INFO:teuthology.orchestra.run.smithi045.stdout: -8805> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003f0) auth_unpin by 0x55cf62296000 on [inode 0x100000003f0 [2,head] /dc-dir/dc-file_507 auth v4620 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.322045+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62296000] now 0 2023-10-03T19:20:47.883 INFO:teuthology.orchestra.run.smithi045.stdout: -8804> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+468 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62296000 count now 1/468 2023-10-03T19:20:47.883 INFO:teuthology.orchestra.run.smithi045.stdout: -8803> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003f0) clear_dirty_parent 2023-10-03T19:20:47.883 INFO:teuthology.orchestra.run.smithi045.stdout: -8802> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003f1) _stored_backtrace v 2034 2023-10-03T19:20:47.883 INFO:teuthology.orchestra.run.smithi045.stdout: -8801> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003f1) auth_unpin by 0x55cf62296580 on [inode 0x100000003f1 [2,head] /dc-dir/dc-file_508 auth v4622 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.333797+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62296580] now 0 2023-10-03T19:20:47.883 INFO:teuthology.orchestra.run.smithi045.stdout: -8800> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+467 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62296580 count now 1/467 2023-10-03T19:20:47.883 INFO:teuthology.orchestra.run.smithi045.stdout: -8799> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003f1) clear_dirty_parent 2023-10-03T19:20:47.883 INFO:teuthology.orchestra.run.smithi045.stdout: -8798> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003f2) _stored_backtrace v 2038 2023-10-03T19:20:47.883 INFO:teuthology.orchestra.run.smithi045.stdout: -8797> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003f2) auth_unpin by 0x55cf62296b00 on [inode 0x100000003f2 [2,head] /dc-dir/dc-file_509 auth v4624 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.344517+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62296b00] now 0 2023-10-03T19:20:47.883 INFO:teuthology.orchestra.run.smithi045.stdout: -8796> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+466 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62296b00 count now 1/466 2023-10-03T19:20:47.883 INFO:teuthology.orchestra.run.smithi045.stdout: -8795> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003f2) clear_dirty_parent 2023-10-03T19:20:47.884 INFO:teuthology.orchestra.run.smithi045.stdout: -8794> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 MDSContext::complete: 21C_MaybeExpiredSegment 2023-10-03T19:20:47.884 INFO:teuthology.orchestra.run.smithi045.stdout: -8793> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.log _maybe_expired segment 1/4194304, 1024 events 2023-10-03T19:20:47.884 INFO:teuthology.orchestra.run.smithi045.stdout: -8792> 2023-10-03T19:15:17.703+0000 7f0f05562640 6 mds.0.journal LogSegment(1/4194304).try_to_expire 2023-10-03T19:20:47.884 INFO:teuthology.orchestra.run.smithi045.stdout: -8791> 2023-10-03T19:15:17.703+0000 7f0f05562640 4 mds.0.sessionmap save_if_dirty: writing 0 2023-10-03T19:20:47.884 INFO:teuthology.orchestra.run.smithi045.stdout: -8790> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.journal try_to_expire waiting for purge of [] 2023-10-03T19:20:47.884 INFO:teuthology.orchestra.run.smithi045.stdout: -8789> 2023-10-03T19:15:17.703+0000 7f0f05562640 6 mds.0.journal LogSegment(1/4194304).try_to_expire success 2023-10-03T19:20:47.884 INFO:teuthology.orchestra.run.smithi045.stdout: -8788> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.log try_expire expired segment 1/4194304 2023-10-03T19:20:47.884 INFO:teuthology.orchestra.run.smithi045.stdout: -8787> 2023-10-03T19:15:17.703+0000 7f0f05562640 5 mds.0.log _expired segment 1/4194304, 1024 events 2023-10-03T19:20:47.884 INFO:teuthology.orchestra.run.smithi045.stdout: -8786> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 MDSIOContextBase::complete: 20BatchStoredBacktrace 2023-10-03T19:20:47.885 INFO:teuthology.orchestra.run.smithi045.stdout: -8785> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 MDSContext::complete: 20BatchStoredBacktrace 2023-10-03T19:20:47.885 INFO:teuthology.orchestra.run.smithi045.stdout: -8784> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003f3) _stored_backtrace v 2042 2023-10-03T19:20:47.885 INFO:teuthology.orchestra.run.smithi045.stdout: -8783> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003f3) auth_unpin by 0x55cf62297080 on [inode 0x100000003f3 [2,head] /dc-dir/dc-file_510 auth v4626 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.355951+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62297080] now 0 2023-10-03T19:20:47.885 INFO:teuthology.orchestra.run.smithi045.stdout: -8782> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+465 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62297080 count now 1/465 2023-10-03T19:20:47.885 INFO:teuthology.orchestra.run.smithi045.stdout: -8781> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003f3) clear_dirty_parent 2023-10-03T19:20:47.885 INFO:teuthology.orchestra.run.smithi045.stdout: -8780> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003f4) _stored_backtrace v 2046 2023-10-03T19:20:47.885 INFO:teuthology.orchestra.run.smithi045.stdout: -8779> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003f4) auth_unpin by 0x55cf62297600 on [inode 0x100000003f4 [2,head] /dc-dir/dc-file_511 auth v4628 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.366704+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62297600] now 0 2023-10-03T19:20:47.885 INFO:teuthology.orchestra.run.smithi045.stdout: -8778> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+464 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62297600 count now 1/464 2023-10-03T19:20:47.885 INFO:teuthology.orchestra.run.smithi045.stdout: -8777> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003f4) clear_dirty_parent 2023-10-03T19:20:47.885 INFO:teuthology.orchestra.run.smithi045.stdout: -8776> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003f5) _stored_backtrace v 2050 2023-10-03T19:20:47.885 INFO:teuthology.orchestra.run.smithi045.stdout: -8775> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003f5) auth_unpin by 0x55cf62297b80 on [inode 0x100000003f5 [2,head] /dc-dir/dc-file_512 auth v4630 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.377284+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62297b80] now 0 2023-10-03T19:20:47.885 INFO:teuthology.orchestra.run.smithi045.stdout: -8774> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+463 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62297b80 count now 1/463 2023-10-03T19:20:47.886 INFO:teuthology.orchestra.run.smithi045.stdout: -8773> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003f5) clear_dirty_parent 2023-10-03T19:20:47.886 INFO:teuthology.orchestra.run.smithi045.stdout: -8772> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003f6) _stored_backtrace v 2054 2023-10-03T19:20:47.886 INFO:teuthology.orchestra.run.smithi045.stdout: -8771> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003f6) auth_unpin by 0x55cf62298100 on [inode 0x100000003f6 [2,head] /dc-dir/dc-file_513 auth v4632 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.388228+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62298100] now 0 2023-10-03T19:20:47.886 INFO:teuthology.orchestra.run.smithi045.stdout: -8770> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+462 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62298100 count now 1/462 2023-10-03T19:20:47.886 INFO:teuthology.orchestra.run.smithi045.stdout: -8769> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003f6) clear_dirty_parent 2023-10-03T19:20:47.886 INFO:teuthology.orchestra.run.smithi045.stdout: -8768> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003f7) _stored_backtrace v 2058 2023-10-03T19:20:47.886 INFO:teuthology.orchestra.run.smithi045.stdout: -8767> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003f7) auth_unpin by 0x55cf62298680 on [inode 0x100000003f7 [2,head] /dc-dir/dc-file_514 auth v4634 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.399302+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62298680] now 0 2023-10-03T19:20:47.890 INFO:teuthology.orchestra.run.smithi045.stdout: -8766> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+461 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62298680 count now 1/461 2023-10-03T19:20:47.890 INFO:teuthology.orchestra.run.smithi045.stdout: -8765> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003f7) clear_dirty_parent 2023-10-03T19:20:47.890 INFO:teuthology.orchestra.run.smithi045.stdout: -8764> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003f8) _stored_backtrace v 2062 2023-10-03T19:20:47.890 INFO:teuthology.orchestra.run.smithi045.stdout: -8763> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003f8) auth_unpin by 0x55cf62298c00 on [inode 0x100000003f8 [2,head] /dc-dir/dc-file_515 auth v4636 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.411664+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62298c00] now 0 2023-10-03T19:20:47.890 INFO:teuthology.orchestra.run.smithi045.stdout: -8762> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+460 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62298c00 count now 1/460 2023-10-03T19:20:47.890 INFO:teuthology.orchestra.run.smithi045.stdout: -8761> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003f8) clear_dirty_parent 2023-10-03T19:20:47.890 INFO:teuthology.orchestra.run.smithi045.stdout: -8760> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003f9) _stored_backtrace v 2066 2023-10-03T19:20:47.890 INFO:teuthology.orchestra.run.smithi045.stdout: -8759> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003f9) auth_unpin by 0x55cf62299180 on [inode 0x100000003f9 [2,head] /dc-dir/dc-file_516 auth v4638 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.422617+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62299180] now 0 2023-10-03T19:20:47.891 INFO:teuthology.orchestra.run.smithi045.stdout: -8758> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+459 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62299180 count now 1/459 2023-10-03T19:20:47.891 INFO:teuthology.orchestra.run.smithi045.stdout: -8757> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003f9) clear_dirty_parent 2023-10-03T19:20:47.891 INFO:teuthology.orchestra.run.smithi045.stdout: -8756> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003fa) _stored_backtrace v 2070 2023-10-03T19:20:47.891 INFO:teuthology.orchestra.run.smithi045.stdout: -8755> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003fa) auth_unpin by 0x55cf62299700 on [inode 0x100000003fa [2,head] /dc-dir/dc-file_517 auth v4640 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.434674+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62299700] now 0 2023-10-03T19:20:47.891 INFO:teuthology.orchestra.run.smithi045.stdout: -8754> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+458 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62299700 count now 1/458 2023-10-03T19:20:47.891 INFO:teuthology.orchestra.run.smithi045.stdout: -8753> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003fa) clear_dirty_parent 2023-10-03T19:20:47.891 INFO:teuthology.orchestra.run.smithi045.stdout: -8752> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003fb) _stored_backtrace v 2074 2023-10-03T19:20:47.891 INFO:teuthology.orchestra.run.smithi045.stdout: -8751> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003fb) auth_unpin by 0x55cf622a4000 on [inode 0x100000003fb [2,head] /dc-dir/dc-file_518 auth v4642 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.445979+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622a4000] now 0 2023-10-03T19:20:47.891 INFO:teuthology.orchestra.run.smithi045.stdout: -8750> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+457 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622a4000 count now 1/457 2023-10-03T19:20:47.891 INFO:teuthology.orchestra.run.smithi045.stdout: -8749> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003fb) clear_dirty_parent 2023-10-03T19:20:47.892 INFO:teuthology.orchestra.run.smithi045.stdout: -8748> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003fc) _stored_backtrace v 2078 2023-10-03T19:20:47.892 INFO:teuthology.orchestra.run.smithi045.stdout: -8747> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003fc) auth_unpin by 0x55cf622a4580 on [inode 0x100000003fc [2,head] /dc-dir/dc-file_519 auth v4644 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.457848+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622a4580] now 0 2023-10-03T19:20:47.892 INFO:teuthology.orchestra.run.smithi045.stdout: -8746> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+456 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622a4580 count now 1/456 2023-10-03T19:20:47.892 INFO:teuthology.orchestra.run.smithi045.stdout: -8745> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003fc) clear_dirty_parent 2023-10-03T19:20:47.892 INFO:teuthology.orchestra.run.smithi045.stdout: -8744> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003fd) _stored_backtrace v 2082 2023-10-03T19:20:47.892 INFO:teuthology.orchestra.run.smithi045.stdout: -8743> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003fd) auth_unpin by 0x55cf622a4b00 on [inode 0x100000003fd [2,head] /dc-dir/dc-file_520 auth v4646 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.468906+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622a4b00] now 0 2023-10-03T19:20:47.892 INFO:teuthology.orchestra.run.smithi045.stdout: -8742> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+455 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622a4b00 count now 1/455 2023-10-03T19:20:47.892 INFO:teuthology.orchestra.run.smithi045.stdout: -8741> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003fd) clear_dirty_parent 2023-10-03T19:20:47.892 INFO:teuthology.orchestra.run.smithi045.stdout: -8740> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003fe) _stored_backtrace v 2086 2023-10-03T19:20:47.892 INFO:teuthology.orchestra.run.smithi045.stdout: -8739> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003fe) auth_unpin by 0x55cf622a5080 on [inode 0x100000003fe [2,head] /dc-dir/dc-file_521 auth v4648 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.480302+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622a5080] now 0 2023-10-03T19:20:47.892 INFO:teuthology.orchestra.run.smithi045.stdout: -8738> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+454 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622a5080 count now 1/454 2023-10-03T19:20:47.892 INFO:teuthology.orchestra.run.smithi045.stdout: -8737> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003fe) clear_dirty_parent 2023-10-03T19:20:47.893 INFO:teuthology.orchestra.run.smithi045.stdout: -8736> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ff) _stored_backtrace v 2270 2023-10-03T19:20:47.893 INFO:teuthology.orchestra.run.smithi045.stdout: -8735> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ff) auth_unpin by 0x55cf622a5600 on [inode 0x100000003ff [2,head] /dc-dir/dc-file_522 auth v4944 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.575231+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622a5600] now 0 2023-10-03T19:20:47.893 INFO:teuthology.orchestra.run.smithi045.stdout: -8734> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+453 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622a5600 count now 1/453 2023-10-03T19:20:47.893 INFO:teuthology.orchestra.run.smithi045.stdout: -8733> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x100000003ff) clear_dirty_parent 2023-10-03T19:20:47.893 INFO:teuthology.orchestra.run.smithi045.stdout: -8732> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000400) _stored_backtrace v 2274 2023-10-03T19:20:47.893 INFO:teuthology.orchestra.run.smithi045.stdout: -8731> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000400) auth_unpin by 0x55cf622a5b80 on [inode 0x10000000400 [2,head] /dc-dir/dc-file_523 auth v4946 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.622812+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622a5b80] now 0 2023-10-03T19:20:47.893 INFO:teuthology.orchestra.run.smithi045.stdout: -8730> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+452 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622a5b80 count now 1/452 2023-10-03T19:20:47.893 INFO:teuthology.orchestra.run.smithi045.stdout: -8729> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000400) clear_dirty_parent 2023-10-03T19:20:47.893 INFO:teuthology.orchestra.run.smithi045.stdout: -8728> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000401) _stored_backtrace v 2278 2023-10-03T19:20:47.893 INFO:teuthology.orchestra.run.smithi045.stdout: -8727> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000401) auth_unpin by 0x55cf622a6100 on [inode 0x10000000401 [2,head] /dc-dir/dc-file_524 auth v4948 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.633600+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622a6100] now 0 2023-10-03T19:20:47.893 INFO:teuthology.orchestra.run.smithi045.stdout: -8726> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+451 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622a6100 count now 1/451 2023-10-03T19:20:47.894 INFO:teuthology.orchestra.run.smithi045.stdout: -8725> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000401) clear_dirty_parent 2023-10-03T19:20:47.894 INFO:teuthology.orchestra.run.smithi045.stdout: -8724> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000402) _stored_backtrace v 2282 2023-10-03T19:20:47.894 INFO:teuthology.orchestra.run.smithi045.stdout: -8723> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000402) auth_unpin by 0x55cf622a6680 on [inode 0x10000000402 [2,head] /dc-dir/dc-file_525 auth v4950 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.645411+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622a6680] now 0 2023-10-03T19:20:47.894 INFO:teuthology.orchestra.run.smithi045.stdout: -8722> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+450 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622a6680 count now 1/450 2023-10-03T19:20:47.894 INFO:teuthology.orchestra.run.smithi045.stdout: -8721> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000402) clear_dirty_parent 2023-10-03T19:20:47.894 INFO:teuthology.orchestra.run.smithi045.stdout: -8720> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000403) _stored_backtrace v 2286 2023-10-03T19:20:47.894 INFO:teuthology.orchestra.run.smithi045.stdout: -8719> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000403) auth_unpin by 0x55cf622a6c00 on [inode 0x10000000403 [2,head] /dc-dir/dc-file_526 auth v4952 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.657316+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622a6c00] now 0 2023-10-03T19:20:47.894 INFO:teuthology.orchestra.run.smithi045.stdout: -8718> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+449 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622a6c00 count now 1/449 2023-10-03T19:20:47.894 INFO:teuthology.orchestra.run.smithi045.stdout: -8717> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000403) clear_dirty_parent 2023-10-03T19:20:47.894 INFO:teuthology.orchestra.run.smithi045.stdout: -8716> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000404) _stored_backtrace v 2290 2023-10-03T19:20:47.895 INFO:teuthology.orchestra.run.smithi045.stdout: -8715> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000404) auth_unpin by 0x55cf622a7180 on [inode 0x10000000404 [2,head] /dc-dir/dc-file_527 auth v4954 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.669699+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622a7180] now 0 2023-10-03T19:20:47.895 INFO:teuthology.orchestra.run.smithi045.stdout: -8714> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+448 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622a7180 count now 1/448 2023-10-03T19:20:47.895 INFO:teuthology.orchestra.run.smithi045.stdout: -8713> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000404) clear_dirty_parent 2023-10-03T19:20:47.895 INFO:teuthology.orchestra.run.smithi045.stdout: -8712> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000405) _stored_backtrace v 2294 2023-10-03T19:20:47.895 INFO:teuthology.orchestra.run.smithi045.stdout: -8711> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000405) auth_unpin by 0x55cf622a7700 on [inode 0x10000000405 [2,head] /dc-dir/dc-file_528 auth v4956 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.680601+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf622a7700] now 0 2023-10-03T19:20:47.895 INFO:teuthology.orchestra.run.smithi045.stdout: -8710> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+447 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf622a7700 count now 1/447 2023-10-03T19:20:47.895 INFO:teuthology.orchestra.run.smithi045.stdout: -8709> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000405) clear_dirty_parent 2023-10-03T19:20:47.895 INFO:teuthology.orchestra.run.smithi045.stdout: -8708> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000406) _stored_backtrace v 2298 2023-10-03T19:20:47.895 INFO:teuthology.orchestra.run.smithi045.stdout: -8707> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000406) auth_unpin by 0x55cf6236c000 on [inode 0x10000000406 [2,head] /dc-dir/dc-file_529 auth v4958 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.691699+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6236c000] now 0 2023-10-03T19:20:47.895 INFO:teuthology.orchestra.run.smithi045.stdout: -8706> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+446 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6236c000 count now 1/446 2023-10-03T19:20:47.895 INFO:teuthology.orchestra.run.smithi045.stdout: -8705> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000406) clear_dirty_parent 2023-10-03T19:20:47.896 INFO:teuthology.orchestra.run.smithi045.stdout: -8704> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000407) _stored_backtrace v 2302 2023-10-03T19:20:47.896 INFO:teuthology.orchestra.run.smithi045.stdout: -8703> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000407) auth_unpin by 0x55cf6236c580 on [inode 0x10000000407 [2,head] /dc-dir/dc-file_530 auth v4960 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.702577+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6236c580] now 0 2023-10-03T19:20:47.896 INFO:teuthology.orchestra.run.smithi045.stdout: -8702> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+445 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6236c580 count now 1/445 2023-10-03T19:20:47.896 INFO:teuthology.orchestra.run.smithi045.stdout: -8701> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000407) clear_dirty_parent 2023-10-03T19:20:47.896 INFO:teuthology.orchestra.run.smithi045.stdout: -8700> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000408) _stored_backtrace v 2306 2023-10-03T19:20:47.896 INFO:teuthology.orchestra.run.smithi045.stdout: -8699> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000408) auth_unpin by 0x55cf6236cb00 on [inode 0x10000000408 [2,head] /dc-dir/dc-file_531 auth v4962 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.713332+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6236cb00] now 0 2023-10-03T19:20:47.896 INFO:teuthology.orchestra.run.smithi045.stdout: -8698> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+444 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6236cb00 count now 1/444 2023-10-03T19:20:47.896 INFO:teuthology.orchestra.run.smithi045.stdout: -8697> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000408) clear_dirty_parent 2023-10-03T19:20:47.896 INFO:teuthology.orchestra.run.smithi045.stdout: -8696> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000409) _stored_backtrace v 2310 2023-10-03T19:20:47.896 INFO:teuthology.orchestra.run.smithi045.stdout: -8695> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000409) auth_unpin by 0x55cf6236d080 on [inode 0x10000000409 [2,head] /dc-dir/dc-file_532 auth v4964 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.725288+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6236d080] now 0 2023-10-03T19:20:47.896 INFO:teuthology.orchestra.run.smithi045.stdout: -8694> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+443 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6236d080 count now 1/443 2023-10-03T19:20:47.896 INFO:teuthology.orchestra.run.smithi045.stdout: -8693> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000409) clear_dirty_parent 2023-10-03T19:20:47.897 INFO:teuthology.orchestra.run.smithi045.stdout: -8692> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000040a) _stored_backtrace v 2314 2023-10-03T19:20:47.897 INFO:teuthology.orchestra.run.smithi045.stdout: -8691> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000040a) auth_unpin by 0x55cf6236d600 on [inode 0x1000000040a [2,head] /dc-dir/dc-file_533 auth v4966 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.737551+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6236d600] now 0 2023-10-03T19:20:47.897 INFO:teuthology.orchestra.run.smithi045.stdout: -8690> 2023-10-03T19:15:17.703+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+442 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6236d600 count now 1/442 2023-10-03T19:20:47.897 INFO:teuthology.orchestra.run.smithi045.stdout: -8689> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000040a) clear_dirty_parent 2023-10-03T19:20:47.897 INFO:teuthology.orchestra.run.smithi045.stdout: -8688> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000040b) _stored_backtrace v 2318 2023-10-03T19:20:47.897 INFO:teuthology.orchestra.run.smithi045.stdout: -8687> 2023-10-03T19:15:17.703+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000040b) auth_unpin by 0x55cf6236db80 on [inode 0x1000000040b [2,head] /dc-dir/dc-file_534 auth v4968 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.749178+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6236db80] now 0 2023-10-03T19:20:47.897 INFO:teuthology.orchestra.run.smithi045.stdout: -8686> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+441 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6236db80 count now 1/441 2023-10-03T19:20:47.897 INFO:teuthology.orchestra.run.smithi045.stdout: -8685> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000040b) clear_dirty_parent 2023-10-03T19:20:47.897 INFO:teuthology.orchestra.run.smithi045.stdout: -8684> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000040c) _stored_backtrace v 2322 2023-10-03T19:20:47.897 INFO:teuthology.orchestra.run.smithi045.stdout: -8683> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000040c) auth_unpin by 0x55cf6236e100 on [inode 0x1000000040c [2,head] /dc-dir/dc-file_535 auth v4970 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.761559+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6236e100] now 0 2023-10-03T19:20:47.898 INFO:teuthology.orchestra.run.smithi045.stdout: -8682> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+440 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6236e100 count now 1/440 2023-10-03T19:20:47.898 INFO:teuthology.orchestra.run.smithi045.stdout: -8681> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000040c) clear_dirty_parent 2023-10-03T19:20:47.898 INFO:teuthology.orchestra.run.smithi045.stdout: -8680> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000040d) _stored_backtrace v 2326 2023-10-03T19:20:47.898 INFO:teuthology.orchestra.run.smithi045.stdout: -8679> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000040d) auth_unpin by 0x55cf6236e680 on [inode 0x1000000040d [2,head] /dc-dir/dc-file_536 auth v4972 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.773949+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6236e680] now 0 2023-10-03T19:20:47.898 INFO:teuthology.orchestra.run.smithi045.stdout: -8678> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+439 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6236e680 count now 1/439 2023-10-03T19:20:47.898 INFO:teuthology.orchestra.run.smithi045.stdout: -8677> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000040d) clear_dirty_parent 2023-10-03T19:20:47.898 INFO:teuthology.orchestra.run.smithi045.stdout: -8676> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000040e) _stored_backtrace v 2330 2023-10-03T19:20:47.898 INFO:teuthology.orchestra.run.smithi045.stdout: -8675> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000040e) auth_unpin by 0x55cf6236ec00 on [inode 0x1000000040e [2,head] /dc-dir/dc-file_537 auth v4974 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.786402+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6236ec00] now 0 2023-10-03T19:20:47.898 INFO:teuthology.orchestra.run.smithi045.stdout: -8674> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+438 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6236ec00 count now 1/438 2023-10-03T19:20:47.898 INFO:teuthology.orchestra.run.smithi045.stdout: -8673> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000040e) clear_dirty_parent 2023-10-03T19:20:47.898 INFO:teuthology.orchestra.run.smithi045.stdout: -8672> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000040f) _stored_backtrace v 2334 2023-10-03T19:20:47.899 INFO:teuthology.orchestra.run.smithi045.stdout: -8671> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000040f) auth_unpin by 0x55cf6236f180 on [inode 0x1000000040f [2,head] /dc-dir/dc-file_538 auth v4976 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.797645+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6236f180] now 0 2023-10-03T19:20:47.899 INFO:teuthology.orchestra.run.smithi045.stdout: -8670> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+437 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6236f180 count now 1/437 2023-10-03T19:20:47.899 INFO:teuthology.orchestra.run.smithi045.stdout: -8669> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000040f) clear_dirty_parent 2023-10-03T19:20:47.899 INFO:teuthology.orchestra.run.smithi045.stdout: -8668> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000410) _stored_backtrace v 2338 2023-10-03T19:20:47.899 INFO:teuthology.orchestra.run.smithi045.stdout: -8667> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000410) auth_unpin by 0x55cf6236f700 on [inode 0x10000000410 [2,head] /dc-dir/dc-file_539 auth v4978 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.808505+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6236f700] now 0 2023-10-03T19:20:47.899 INFO:teuthology.orchestra.run.smithi045.stdout: -8666> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+436 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6236f700 count now 1/436 2023-10-03T19:20:47.899 INFO:teuthology.orchestra.run.smithi045.stdout: -8665> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000410) clear_dirty_parent 2023-10-03T19:20:47.899 INFO:teuthology.orchestra.run.smithi045.stdout: -8664> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000411) _stored_backtrace v 2342 2023-10-03T19:20:47.899 INFO:teuthology.orchestra.run.smithi045.stdout: -8663> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000411) auth_unpin by 0x55cf62372000 on [inode 0x10000000411 [2,head] /dc-dir/dc-file_540 auth v4980 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.819492+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62372000] now 0 2023-10-03T19:20:47.899 INFO:teuthology.orchestra.run.smithi045.stdout: -8662> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+435 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62372000 count now 1/435 2023-10-03T19:20:47.899 INFO:teuthology.orchestra.run.smithi045.stdout: -8661> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000411) clear_dirty_parent 2023-10-03T19:20:47.899 INFO:teuthology.orchestra.run.smithi045.stdout: -8660> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000412) _stored_backtrace v 2346 2023-10-03T19:20:47.900 INFO:teuthology.orchestra.run.smithi045.stdout: -8659> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000412) auth_unpin by 0x55cf62372580 on [inode 0x10000000412 [2,head] /dc-dir/dc-file_541 auth v4982 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.831152+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62372580] now 0 2023-10-03T19:20:47.900 INFO:teuthology.orchestra.run.smithi045.stdout: -8658> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+434 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62372580 count now 1/434 2023-10-03T19:20:47.900 INFO:teuthology.orchestra.run.smithi045.stdout: -8657> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000412) clear_dirty_parent 2023-10-03T19:20:47.900 INFO:teuthology.orchestra.run.smithi045.stdout: -8656> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000413) _stored_backtrace v 2350 2023-10-03T19:20:47.900 INFO:teuthology.orchestra.run.smithi045.stdout: -8655> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000413) auth_unpin by 0x55cf62372b00 on [inode 0x10000000413 [2,head] /dc-dir/dc-file_542 auth v4984 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.842969+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62372b00] now 0 2023-10-03T19:20:47.900 INFO:teuthology.orchestra.run.smithi045.stdout: -8654> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+433 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62372b00 count now 1/433 2023-10-03T19:20:47.900 INFO:teuthology.orchestra.run.smithi045.stdout: -8653> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000413) clear_dirty_parent 2023-10-03T19:20:47.913 INFO:teuthology.orchestra.run.smithi045.stdout: -8652> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000414) _stored_backtrace v 2354 2023-10-03T19:20:47.914 INFO:teuthology.orchestra.run.smithi045.stdout: -8651> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000414) auth_unpin by 0x55cf62373080 on [inode 0x10000000414 [2,head] /dc-dir/dc-file_543 auth v4986 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.853526+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62373080] now 0 2023-10-03T19:20:47.914 INFO:teuthology.orchestra.run.smithi045.stdout: -8650> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+432 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62373080 count now 1/432 2023-10-03T19:20:47.914 INFO:teuthology.orchestra.run.smithi045.stdout: -8649> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000414) clear_dirty_parent 2023-10-03T19:20:47.914 INFO:teuthology.orchestra.run.smithi045.stdout: -8648> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000415) _stored_backtrace v 2358 2023-10-03T19:20:47.914 INFO:teuthology.orchestra.run.smithi045.stdout: -8647> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000415) auth_unpin by 0x55cf62373600 on [inode 0x10000000415 [2,head] /dc-dir/dc-file_544 auth v4988 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.864849+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62373600] now 0 2023-10-03T19:20:47.914 INFO:teuthology.orchestra.run.smithi045.stdout: -8646> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+431 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62373600 count now 1/431 2023-10-03T19:20:47.914 INFO:teuthology.orchestra.run.smithi045.stdout: -8645> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000415) clear_dirty_parent 2023-10-03T19:20:47.914 INFO:teuthology.orchestra.run.smithi045.stdout: -8644> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000416) _stored_backtrace v 2362 2023-10-03T19:20:47.914 INFO:teuthology.orchestra.run.smithi045.stdout: -8643> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000416) auth_unpin by 0x55cf62373b80 on [inode 0x10000000416 [2,head] /dc-dir/dc-file_545 auth v4990 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.875750+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62373b80] now 0 2023-10-03T19:20:47.914 INFO:teuthology.orchestra.run.smithi045.stdout: -8642> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+430 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62373b80 count now 1/430 2023-10-03T19:20:47.914 INFO:teuthology.orchestra.run.smithi045.stdout: -8641> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000416) clear_dirty_parent 2023-10-03T19:20:47.914 INFO:teuthology.orchestra.run.smithi045.stdout: -8640> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000417) _stored_backtrace v 2366 2023-10-03T19:20:47.915 INFO:teuthology.orchestra.run.smithi045.stdout: -8639> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000417) auth_unpin by 0x55cf62374100 on [inode 0x10000000417 [2,head] /dc-dir/dc-file_546 auth v4992 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.886080+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62374100] now 0 2023-10-03T19:20:47.915 INFO:teuthology.orchestra.run.smithi045.stdout: -8638> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+429 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62374100 count now 1/429 2023-10-03T19:20:47.915 INFO:teuthology.orchestra.run.smithi045.stdout: -8637> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000417) clear_dirty_parent 2023-10-03T19:20:47.915 INFO:teuthology.orchestra.run.smithi045.stdout: -8636> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000418) _stored_backtrace v 2370 2023-10-03T19:20:47.915 INFO:teuthology.orchestra.run.smithi045.stdout: -8635> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000418) auth_unpin by 0x55cf62374680 on [inode 0x10000000418 [2,head] /dc-dir/dc-file_547 auth v4994 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.896874+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62374680] now 0 2023-10-03T19:20:47.915 INFO:teuthology.orchestra.run.smithi045.stdout: -8634> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+428 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62374680 count now 1/428 2023-10-03T19:20:47.915 INFO:teuthology.orchestra.run.smithi045.stdout: -8633> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000418) clear_dirty_parent 2023-10-03T19:20:47.915 INFO:teuthology.orchestra.run.smithi045.stdout: -8632> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000419) _stored_backtrace v 2374 2023-10-03T19:20:47.915 INFO:teuthology.orchestra.run.smithi045.stdout: -8631> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000419) auth_unpin by 0x55cf62374c00 on [inode 0x10000000419 [2,head] /dc-dir/dc-file_548 auth v4996 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.908472+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62374c00] now 0 2023-10-03T19:20:47.917 INFO:teuthology.orchestra.run.smithi045.stdout: -8630> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+427 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62374c00 count now 1/427 2023-10-03T19:20:47.917 INFO:teuthology.orchestra.run.smithi045.stdout: -8629> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000419) clear_dirty_parent 2023-10-03T19:20:47.917 INFO:teuthology.orchestra.run.smithi045.stdout: -8628> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000041a) _stored_backtrace v 2378 2023-10-03T19:20:47.917 INFO:teuthology.orchestra.run.smithi045.stdout: -8627> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000041a) auth_unpin by 0x55cf62375180 on [inode 0x1000000041a [2,head] /dc-dir/dc-file_549 auth v4998 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.919148+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62375180] now 0 2023-10-03T19:20:47.917 INFO:teuthology.orchestra.run.smithi045.stdout: -8626> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+426 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62375180 count now 1/426 2023-10-03T19:20:47.917 INFO:teuthology.orchestra.run.smithi045.stdout: -8625> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000041a) clear_dirty_parent 2023-10-03T19:20:47.918 INFO:teuthology.orchestra.run.smithi045.stdout: -8624> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000041b) _stored_backtrace v 2382 2023-10-03T19:20:47.918 INFO:teuthology.orchestra.run.smithi045.stdout: -8623> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000041b) auth_unpin by 0x55cf62375700 on [inode 0x1000000041b [2,head] /dc-dir/dc-file_550 auth v5000 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.931794+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62375700] now 0 2023-10-03T19:20:47.918 INFO:teuthology.orchestra.run.smithi045.stdout: -8622> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+425 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62375700 count now 1/425 2023-10-03T19:20:47.918 INFO:teuthology.orchestra.run.smithi045.stdout: -8621> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000041b) clear_dirty_parent 2023-10-03T19:20:47.918 INFO:teuthology.orchestra.run.smithi045.stdout: -8620> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000041c) _stored_backtrace v 2386 2023-10-03T19:20:47.918 INFO:teuthology.orchestra.run.smithi045.stdout: -8619> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000041c) auth_unpin by 0x55cf62380000 on [inode 0x1000000041c [2,head] /dc-dir/dc-file_551 auth v5002 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.943622+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62380000] now 0 2023-10-03T19:20:47.918 INFO:teuthology.orchestra.run.smithi045.stdout: -8618> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+424 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62380000 count now 1/424 2023-10-03T19:20:47.918 INFO:teuthology.orchestra.run.smithi045.stdout: -8617> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000041c) clear_dirty_parent 2023-10-03T19:20:47.918 INFO:teuthology.orchestra.run.smithi045.stdout: -8616> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000041d) _stored_backtrace v 2390 2023-10-03T19:20:47.919 INFO:teuthology.orchestra.run.smithi045.stdout: -8615> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000041d) auth_unpin by 0x55cf62380580 on [inode 0x1000000041d [2,head] /dc-dir/dc-file_552 auth v5004 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.955445+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62380580] now 0 2023-10-03T19:20:47.919 INFO:teuthology.orchestra.run.smithi045.stdout: -8614> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+423 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62380580 count now 1/423 2023-10-03T19:20:47.919 INFO:teuthology.orchestra.run.smithi045.stdout: -8613> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000041d) clear_dirty_parent 2023-10-03T19:20:47.919 INFO:teuthology.orchestra.run.smithi045.stdout: -8612> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000041e) _stored_backtrace v 2394 2023-10-03T19:20:47.919 INFO:teuthology.orchestra.run.smithi045.stdout: -8611> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000041e) auth_unpin by 0x55cf62380b00 on [inode 0x1000000041e [2,head] /dc-dir/dc-file_553 auth v5006 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.966887+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62380b00] now 0 2023-10-03T19:20:47.919 INFO:teuthology.orchestra.run.smithi045.stdout: -8610> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+422 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62380b00 count now 1/422 2023-10-03T19:20:47.919 INFO:teuthology.orchestra.run.smithi045.stdout: -8609> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000041e) clear_dirty_parent 2023-10-03T19:20:47.919 INFO:teuthology.orchestra.run.smithi045.stdout: -8608> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000041f) _stored_backtrace v 2398 2023-10-03T19:20:47.919 INFO:teuthology.orchestra.run.smithi045.stdout: -8607> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000041f) auth_unpin by 0x55cf62381080 on [inode 0x1000000041f [2,head] /dc-dir/dc-file_554 auth v5008 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.978472+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62381080] now 0 2023-10-03T19:20:47.919 INFO:teuthology.orchestra.run.smithi045.stdout: -8606> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+421 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62381080 count now 1/421 2023-10-03T19:20:47.920 INFO:teuthology.orchestra.run.smithi045.stdout: -8605> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000041f) clear_dirty_parent 2023-10-03T19:20:47.920 INFO:teuthology.orchestra.run.smithi045.stdout: -8604> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000420) _stored_backtrace v 2402 2023-10-03T19:20:47.920 INFO:teuthology.orchestra.run.smithi045.stdout: -8603> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000420) auth_unpin by 0x55cf62381600 on [inode 0x10000000420 [2,head] /dc-dir/dc-file_555 auth v5010 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:40.989293+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62381600] now 0 2023-10-03T19:20:47.920 INFO:teuthology.orchestra.run.smithi045.stdout: -8602> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+420 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62381600 count now 1/420 2023-10-03T19:20:47.920 INFO:teuthology.orchestra.run.smithi045.stdout: -8601> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000420) clear_dirty_parent 2023-10-03T19:20:47.920 INFO:teuthology.orchestra.run.smithi045.stdout: -8600> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000421) _stored_backtrace v 2406 2023-10-03T19:20:47.920 INFO:teuthology.orchestra.run.smithi045.stdout: -8599> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000421) auth_unpin by 0x55cf62381b80 on [inode 0x10000000421 [2,head] /dc-dir/dc-file_556 auth v5012 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.000144+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62381b80] now 0 2023-10-03T19:20:47.920 INFO:teuthology.orchestra.run.smithi045.stdout: -8598> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+419 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62381b80 count now 1/419 2023-10-03T19:20:47.920 INFO:teuthology.orchestra.run.smithi045.stdout: -8597> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000421) clear_dirty_parent 2023-10-03T19:20:47.920 INFO:teuthology.orchestra.run.smithi045.stdout: -8596> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000422) _stored_backtrace v 2410 2023-10-03T19:20:47.920 INFO:teuthology.orchestra.run.smithi045.stdout: -8595> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000422) auth_unpin by 0x55cf62382100 on [inode 0x10000000422 [2,head] /dc-dir/dc-file_557 auth v5014 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.011222+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62382100] now 0 2023-10-03T19:20:47.921 INFO:teuthology.orchestra.run.smithi045.stdout: -8594> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+418 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62382100 count now 1/418 2023-10-03T19:20:47.921 INFO:teuthology.orchestra.run.smithi045.stdout: -8593> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000422) clear_dirty_parent 2023-10-03T19:20:47.921 INFO:teuthology.orchestra.run.smithi045.stdout: -8592> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000423) _stored_backtrace v 2414 2023-10-03T19:20:47.921 INFO:teuthology.orchestra.run.smithi045.stdout: -8591> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000423) auth_unpin by 0x55cf62382680 on [inode 0x10000000423 [2,head] /dc-dir/dc-file_558 auth v5016 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.021827+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62382680] now 0 2023-10-03T19:20:47.921 INFO:teuthology.orchestra.run.smithi045.stdout: -8590> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+417 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62382680 count now 1/417 2023-10-03T19:20:47.921 INFO:teuthology.orchestra.run.smithi045.stdout: -8589> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000423) clear_dirty_parent 2023-10-03T19:20:47.921 INFO:teuthology.orchestra.run.smithi045.stdout: -8588> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000424) _stored_backtrace v 2418 2023-10-03T19:20:47.921 INFO:teuthology.orchestra.run.smithi045.stdout: -8587> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000424) auth_unpin by 0x55cf62382c00 on [inode 0x10000000424 [2,head] /dc-dir/dc-file_559 auth v5018 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.033266+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62382c00] now 0 2023-10-03T19:20:47.921 INFO:teuthology.orchestra.run.smithi045.stdout: -8586> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+416 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62382c00 count now 1/416 2023-10-03T19:20:47.921 INFO:teuthology.orchestra.run.smithi045.stdout: -8585> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000424) clear_dirty_parent 2023-10-03T19:20:47.922 INFO:teuthology.orchestra.run.smithi045.stdout: -8584> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000425) _stored_backtrace v 2422 2023-10-03T19:20:47.922 INFO:teuthology.orchestra.run.smithi045.stdout: -8583> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000425) auth_unpin by 0x55cf62383180 on [inode 0x10000000425 [2,head] /dc-dir/dc-file_560 auth v5020 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.045382+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62383180] now 0 2023-10-03T19:20:47.922 INFO:teuthology.orchestra.run.smithi045.stdout: -8582> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+415 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62383180 count now 1/415 2023-10-03T19:20:47.922 INFO:teuthology.orchestra.run.smithi045.stdout: -8581> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000425) clear_dirty_parent 2023-10-03T19:20:47.922 INFO:teuthology.orchestra.run.smithi045.stdout: -8580> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000426) _stored_backtrace v 2426 2023-10-03T19:20:47.922 INFO:teuthology.orchestra.run.smithi045.stdout: -8579> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000426) auth_unpin by 0x55cf62383700 on [inode 0x10000000426 [2,head] /dc-dir/dc-file_561 auth v5022 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.057946+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62383700] now 0 2023-10-03T19:20:47.922 INFO:teuthology.orchestra.run.smithi045.stdout: -8578> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+414 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62383700 count now 1/414 2023-10-03T19:20:47.922 INFO:teuthology.orchestra.run.smithi045.stdout: -8577> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000426) clear_dirty_parent 2023-10-03T19:20:47.922 INFO:teuthology.orchestra.run.smithi045.stdout: -8576> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000427) _stored_backtrace v 2430 2023-10-03T19:20:48.198 INFO:teuthology.orchestra.run.smithi045.stdout: -8575> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000427) auth_unpin by 0x55cf62388000 on [inode 0x10000000427 [2,head] /dc-dir/dc-file_562 auth v5024 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.070582+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62388000] now 0 2023-10-03T19:20:48.198 INFO:teuthology.orchestra.run.smithi045.stdout: -8574> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+413 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62388000 count now 1/413 2023-10-03T19:20:48.198 INFO:teuthology.orchestra.run.smithi045.stdout: -8573> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000427) clear_dirty_parent 2023-10-03T19:20:48.198 INFO:teuthology.orchestra.run.smithi045.stdout: -8572> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000428) _stored_backtrace v 2434 2023-10-03T19:20:48.198 INFO:teuthology.orchestra.run.smithi045.stdout: -8571> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000428) auth_unpin by 0x55cf62388580 on [inode 0x10000000428 [2,head] /dc-dir/dc-file_563 auth v5026 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.081775+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62388580] now 0 2023-10-03T19:20:48.199 INFO:teuthology.orchestra.run.smithi045.stdout: -8570> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+412 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62388580 count now 1/412 2023-10-03T19:20:48.199 INFO:teuthology.orchestra.run.smithi045.stdout: -8569> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000428) clear_dirty_parent 2023-10-03T19:20:48.199 INFO:teuthology.orchestra.run.smithi045.stdout: -8568> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000429) _stored_backtrace v 2438 2023-10-03T19:20:48.199 INFO:teuthology.orchestra.run.smithi045.stdout: -8567> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000429) auth_unpin by 0x55cf62388b00 on [inode 0x10000000429 [2,head] /dc-dir/dc-file_564 auth v5028 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.092752+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62388b00] now 0 2023-10-03T19:20:48.199 INFO:teuthology.orchestra.run.smithi045.stdout: -8566> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+411 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62388b00 count now 1/411 2023-10-03T19:20:48.199 INFO:teuthology.orchestra.run.smithi045.stdout: -8565> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000429) clear_dirty_parent 2023-10-03T19:20:48.199 INFO:teuthology.orchestra.run.smithi045.stdout: -8564> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000042a) _stored_backtrace v 2442 2023-10-03T19:20:48.199 INFO:teuthology.orchestra.run.smithi045.stdout: -8563> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000042a) auth_unpin by 0x55cf62389080 on [inode 0x1000000042a [2,head] /dc-dir/dc-file_565 auth v5030 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.104052+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62389080] now 0 2023-10-03T19:20:48.199 INFO:teuthology.orchestra.run.smithi045.stdout: -8562> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+410 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62389080 count now 1/410 2023-10-03T19:20:48.200 INFO:teuthology.orchestra.run.smithi045.stdout: -8561> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000042a) clear_dirty_parent 2023-10-03T19:20:48.200 INFO:teuthology.orchestra.run.smithi045.stdout: -8560> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000042b) _stored_backtrace v 2446 2023-10-03T19:20:48.200 INFO:teuthology.orchestra.run.smithi045.stdout: -8559> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000042b) auth_unpin by 0x55cf62389600 on [inode 0x1000000042b [2,head] /dc-dir/dc-file_566 auth v5032 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.115446+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62389600] now 0 2023-10-03T19:20:48.200 INFO:teuthology.orchestra.run.smithi045.stdout: -8558> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+409 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62389600 count now 1/409 2023-10-03T19:20:48.200 INFO:teuthology.orchestra.run.smithi045.stdout: -8557> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000042b) clear_dirty_parent 2023-10-03T19:20:48.200 INFO:teuthology.orchestra.run.smithi045.stdout: -8556> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000042c) _stored_backtrace v 2450 2023-10-03T19:20:48.200 INFO:teuthology.orchestra.run.smithi045.stdout: -8555> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000042c) auth_unpin by 0x55cf62389b80 on [inode 0x1000000042c [2,head] /dc-dir/dc-file_567 auth v5034 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.128937+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62389b80] now 0 2023-10-03T19:20:48.200 INFO:teuthology.orchestra.run.smithi045.stdout: -8554> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+408 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62389b80 count now 1/408 2023-10-03T19:20:48.200 INFO:teuthology.orchestra.run.smithi045.stdout: -8553> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000042c) clear_dirty_parent 2023-10-03T19:20:48.200 INFO:teuthology.orchestra.run.smithi045.stdout: -8552> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000042d) _stored_backtrace v 2454 2023-10-03T19:20:48.201 INFO:teuthology.orchestra.run.smithi045.stdout: -8551> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000042d) auth_unpin by 0x55cf6238a100 on [inode 0x1000000042d [2,head] /dc-dir/dc-file_568 auth v5036 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.141997+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6238a100] now 0 2023-10-03T19:20:48.201 INFO:teuthology.orchestra.run.smithi045.stdout: -8550> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+407 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6238a100 count now 1/407 2023-10-03T19:20:48.201 INFO:teuthology.orchestra.run.smithi045.stdout: -8549> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000042d) clear_dirty_parent 2023-10-03T19:20:48.201 INFO:teuthology.orchestra.run.smithi045.stdout: -8548> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000042e) _stored_backtrace v 2458 2023-10-03T19:20:48.201 INFO:teuthology.orchestra.run.smithi045.stdout: -8547> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000042e) auth_unpin by 0x55cf6238a680 on [inode 0x1000000042e [2,head] /dc-dir/dc-file_569 auth v5038 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.153546+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6238a680] now 0 2023-10-03T19:20:48.205 INFO:teuthology.orchestra.run.smithi045.stdout: -8546> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+406 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6238a680 count now 1/406 2023-10-03T19:20:48.205 INFO:teuthology.orchestra.run.smithi045.stdout: -8545> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000042e) clear_dirty_parent 2023-10-03T19:20:48.205 INFO:teuthology.orchestra.run.smithi045.stdout: -8544> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000042f) _stored_backtrace v 2462 2023-10-03T19:20:48.205 INFO:teuthology.orchestra.run.smithi045.stdout: -8543> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000042f) auth_unpin by 0x55cf6238ac00 on [inode 0x1000000042f [2,head] /dc-dir/dc-file_570 auth v5040 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.165052+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6238ac00] now 0 2023-10-03T19:20:48.205 INFO:teuthology.orchestra.run.smithi045.stdout: -8542> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+405 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6238ac00 count now 1/405 2023-10-03T19:20:48.205 INFO:teuthology.orchestra.run.smithi045.stdout: -8541> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000042f) clear_dirty_parent 2023-10-03T19:20:48.205 INFO:teuthology.orchestra.run.smithi045.stdout: -8540> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000430) _stored_backtrace v 2466 2023-10-03T19:20:48.205 INFO:teuthology.orchestra.run.smithi045.stdout: -8539> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000430) auth_unpin by 0x55cf6238b180 on [inode 0x10000000430 [2,head] /dc-dir/dc-file_571 auth v5042 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.175636+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6238b180] now 0 2023-10-03T19:20:48.205 INFO:teuthology.orchestra.run.smithi045.stdout: -8538> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+404 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6238b180 count now 1/404 2023-10-03T19:20:48.205 INFO:teuthology.orchestra.run.smithi045.stdout: -8537> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000430) clear_dirty_parent 2023-10-03T19:20:48.205 INFO:teuthology.orchestra.run.smithi045.stdout: -8536> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000431) _stored_backtrace v 2470 2023-10-03T19:20:48.206 INFO:teuthology.orchestra.run.smithi045.stdout: -8535> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000431) auth_unpin by 0x55cf6238b700 on [inode 0x10000000431 [2,head] /dc-dir/dc-file_572 auth v5044 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.186509+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6238b700] now 0 2023-10-03T19:20:48.206 INFO:teuthology.orchestra.run.smithi045.stdout: -8534> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+403 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6238b700 count now 1/403 2023-10-03T19:20:48.206 INFO:teuthology.orchestra.run.smithi045.stdout: -8533> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000431) clear_dirty_parent 2023-10-03T19:20:48.206 INFO:teuthology.orchestra.run.smithi045.stdout: -8532> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000432) _stored_backtrace v 2474 2023-10-03T19:20:48.206 INFO:teuthology.orchestra.run.smithi045.stdout: -8531> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000432) auth_unpin by 0x55cf623ae000 on [inode 0x10000000432 [2,head] /dc-dir/dc-file_573 auth v5046 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.196893+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623ae000] now 0 2023-10-03T19:20:48.206 INFO:teuthology.orchestra.run.smithi045.stdout: -8530> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+402 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623ae000 count now 1/402 2023-10-03T19:20:48.206 INFO:teuthology.orchestra.run.smithi045.stdout: -8529> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000432) clear_dirty_parent 2023-10-03T19:20:48.206 INFO:teuthology.orchestra.run.smithi045.stdout: -8528> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000433) _stored_backtrace v 2478 2023-10-03T19:20:48.206 INFO:teuthology.orchestra.run.smithi045.stdout: -8527> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000433) auth_unpin by 0x55cf623ae580 on [inode 0x10000000433 [2,head] /dc-dir/dc-file_574 auth v5048 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.210166+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623ae580] now 0 2023-10-03T19:20:48.206 INFO:teuthology.orchestra.run.smithi045.stdout: -8526> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+401 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623ae580 count now 1/401 2023-10-03T19:20:48.206 INFO:teuthology.orchestra.run.smithi045.stdout: -8525> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000433) clear_dirty_parent 2023-10-03T19:20:48.207 INFO:teuthology.orchestra.run.smithi045.stdout: -8524> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000434) _stored_backtrace v 2482 2023-10-03T19:20:48.207 INFO:teuthology.orchestra.run.smithi045.stdout: -8523> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000434) auth_unpin by 0x55cf623aeb00 on [inode 0x10000000434 [2,head] /dc-dir/dc-file_575 auth v5050 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.221744+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623aeb00] now 0 2023-10-03T19:20:48.207 INFO:teuthology.orchestra.run.smithi045.stdout: -8522> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+400 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623aeb00 count now 1/400 2023-10-03T19:20:48.207 INFO:teuthology.orchestra.run.smithi045.stdout: -8521> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000434) clear_dirty_parent 2023-10-03T19:20:48.207 INFO:teuthology.orchestra.run.smithi045.stdout: -8520> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000435) _stored_backtrace v 2486 2023-10-03T19:20:48.207 INFO:teuthology.orchestra.run.smithi045.stdout: -8519> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000435) auth_unpin by 0x55cf623af080 on [inode 0x10000000435 [2,head] /dc-dir/dc-file_576 auth v5052 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.232978+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623af080] now 0 2023-10-03T19:20:48.207 INFO:teuthology.orchestra.run.smithi045.stdout: -8518> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+399 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623af080 count now 1/399 2023-10-03T19:20:48.207 INFO:teuthology.orchestra.run.smithi045.stdout: -8517> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000435) clear_dirty_parent 2023-10-03T19:20:48.207 INFO:teuthology.orchestra.run.smithi045.stdout: -8516> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000436) _stored_backtrace v 2490 2023-10-03T19:20:48.208 INFO:teuthology.orchestra.run.smithi045.stdout: -8515> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000436) auth_unpin by 0x55cf623af600 on [inode 0x10000000436 [2,head] /dc-dir/dc-file_577 auth v5054 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.243843+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623af600] now 0 2023-10-03T19:20:48.208 INFO:teuthology.orchestra.run.smithi045.stdout: -8514> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+398 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623af600 count now 1/398 2023-10-03T19:20:48.208 INFO:teuthology.orchestra.run.smithi045.stdout: -8513> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000436) clear_dirty_parent 2023-10-03T19:20:48.208 INFO:teuthology.orchestra.run.smithi045.stdout: -8512> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000437) _stored_backtrace v 2494 2023-10-03T19:20:48.208 INFO:teuthology.orchestra.run.smithi045.stdout: -8511> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000437) auth_unpin by 0x55cf623afb80 on [inode 0x10000000437 [2,head] /dc-dir/dc-file_578 auth v5056 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.254520+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623afb80] now 0 2023-10-03T19:20:48.208 INFO:teuthology.orchestra.run.smithi045.stdout: -8510> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+397 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623afb80 count now 1/397 2023-10-03T19:20:48.208 INFO:teuthology.orchestra.run.smithi045.stdout: -8509> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000437) clear_dirty_parent 2023-10-03T19:20:48.208 INFO:teuthology.orchestra.run.smithi045.stdout: -8508> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000438) _stored_backtrace v 2498 2023-10-03T19:20:48.208 INFO:teuthology.orchestra.run.smithi045.stdout: -8507> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000438) auth_unpin by 0x55cf623b0100 on [inode 0x10000000438 [2,head] /dc-dir/dc-file_579 auth v5058 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.265851+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623b0100] now 0 2023-10-03T19:20:48.208 INFO:teuthology.orchestra.run.smithi045.stdout: -8506> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+396 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623b0100 count now 1/396 2023-10-03T19:20:48.208 INFO:teuthology.orchestra.run.smithi045.stdout: -8505> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000438) clear_dirty_parent 2023-10-03T19:20:48.208 INFO:teuthology.orchestra.run.smithi045.stdout: -8504> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000439) _stored_backtrace v 2502 2023-10-03T19:20:48.209 INFO:teuthology.orchestra.run.smithi045.stdout: -8503> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000439) auth_unpin by 0x55cf623b0680 on [inode 0x10000000439 [2,head] /dc-dir/dc-file_580 auth v5060 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.277330+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623b0680] now 0 2023-10-03T19:20:48.209 INFO:teuthology.orchestra.run.smithi045.stdout: -8502> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+395 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623b0680 count now 1/395 2023-10-03T19:20:48.209 INFO:teuthology.orchestra.run.smithi045.stdout: -8501> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000439) clear_dirty_parent 2023-10-03T19:20:48.209 INFO:teuthology.orchestra.run.smithi045.stdout: -8500> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000043a) _stored_backtrace v 2506 2023-10-03T19:20:48.209 INFO:teuthology.orchestra.run.smithi045.stdout: -8499> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000043a) auth_unpin by 0x55cf623b0c00 on [inode 0x1000000043a [2,head] /dc-dir/dc-file_581 auth v5062 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.288985+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623b0c00] now 0 2023-10-03T19:20:48.209 INFO:teuthology.orchestra.run.smithi045.stdout: -8498> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+394 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623b0c00 count now 1/394 2023-10-03T19:20:48.209 INFO:teuthology.orchestra.run.smithi045.stdout: -8497> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000043a) clear_dirty_parent 2023-10-03T19:20:48.209 INFO:teuthology.orchestra.run.smithi045.stdout: -8496> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000043b) _stored_backtrace v 2510 2023-10-03T19:20:48.209 INFO:teuthology.orchestra.run.smithi045.stdout: -8495> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000043b) auth_unpin by 0x55cf623b1180 on [inode 0x1000000043b [2,head] /dc-dir/dc-file_582 auth v5064 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.300372+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623b1180] now 0 2023-10-03T19:20:48.209 INFO:teuthology.orchestra.run.smithi045.stdout: -8494> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+393 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623b1180 count now 1/393 2023-10-03T19:20:48.209 INFO:teuthology.orchestra.run.smithi045.stdout: -8493> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000043b) clear_dirty_parent 2023-10-03T19:20:48.210 INFO:teuthology.orchestra.run.smithi045.stdout: -8492> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000043c) _stored_backtrace v 2514 2023-10-03T19:20:48.210 INFO:teuthology.orchestra.run.smithi045.stdout: -8491> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000043c) auth_unpin by 0x55cf623b1700 on [inode 0x1000000043c [2,head] /dc-dir/dc-file_583 auth v5066 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.312001+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623b1700] now 0 2023-10-03T19:20:48.210 INFO:teuthology.orchestra.run.smithi045.stdout: -8490> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+392 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623b1700 count now 1/392 2023-10-03T19:20:48.225 INFO:teuthology.orchestra.run.smithi045.stdout: -8489> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000043c) clear_dirty_parent 2023-10-03T19:20:48.225 INFO:teuthology.orchestra.run.smithi045.stdout: -8488> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000043d) _stored_backtrace v 2518 2023-10-03T19:20:48.226 INFO:teuthology.orchestra.run.smithi045.stdout: -8487> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000043d) auth_unpin by 0x55cf623b6000 on [inode 0x1000000043d [2,head] /dc-dir/dc-file_584 auth v5068 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.322663+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623b6000] now 0 2023-10-03T19:20:48.226 INFO:teuthology.orchestra.run.smithi045.stdout: -8486> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+391 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623b6000 count now 1/391 2023-10-03T19:20:48.226 INFO:teuthology.orchestra.run.smithi045.stdout: -8485> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000043d) clear_dirty_parent 2023-10-03T19:20:48.226 INFO:teuthology.orchestra.run.smithi045.stdout: -8484> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000043e) _stored_backtrace v 2522 2023-10-03T19:20:48.226 INFO:teuthology.orchestra.run.smithi045.stdout: -8483> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000043e) auth_unpin by 0x55cf623b6580 on [inode 0x1000000043e [2,head] /dc-dir/dc-file_585 auth v5070 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.333779+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623b6580] now 0 2023-10-03T19:20:48.226 INFO:teuthology.orchestra.run.smithi045.stdout: -8482> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+390 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623b6580 count now 1/390 2023-10-03T19:20:48.226 INFO:teuthology.orchestra.run.smithi045.stdout: -8481> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000043e) clear_dirty_parent 2023-10-03T19:20:48.226 INFO:teuthology.orchestra.run.smithi045.stdout: -8480> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000043f) _stored_backtrace v 2526 2023-10-03T19:20:48.226 INFO:teuthology.orchestra.run.smithi045.stdout: -8479> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000043f) auth_unpin by 0x55cf623b6b00 on [inode 0x1000000043f [2,head] /dc-dir/dc-file_586 auth v5072 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.345083+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623b6b00] now 0 2023-10-03T19:20:48.227 INFO:teuthology.orchestra.run.smithi045.stdout: -8478> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+389 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623b6b00 count now 1/389 2023-10-03T19:20:48.227 INFO:teuthology.orchestra.run.smithi045.stdout: -8477> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000043f) clear_dirty_parent 2023-10-03T19:20:48.227 INFO:teuthology.orchestra.run.smithi045.stdout: -8476> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000440) _stored_backtrace v 2530 2023-10-03T19:20:48.227 INFO:teuthology.orchestra.run.smithi045.stdout: -8475> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000440) auth_unpin by 0x55cf623b7080 on [inode 0x10000000440 [2,head] /dc-dir/dc-file_587 auth v5074 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.356040+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623b7080] now 0 2023-10-03T19:20:48.227 INFO:teuthology.orchestra.run.smithi045.stdout: -8474> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+388 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623b7080 count now 1/388 2023-10-03T19:20:48.227 INFO:teuthology.orchestra.run.smithi045.stdout: -8473> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000440) clear_dirty_parent 2023-10-03T19:20:48.227 INFO:teuthology.orchestra.run.smithi045.stdout: -8472> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000441) _stored_backtrace v 2534 2023-10-03T19:20:48.227 INFO:teuthology.orchestra.run.smithi045.stdout: -8471> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000441) auth_unpin by 0x55cf623b7600 on [inode 0x10000000441 [2,head] /dc-dir/dc-file_588 auth v5076 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.367209+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623b7600] now 0 2023-10-03T19:20:48.227 INFO:teuthology.orchestra.run.smithi045.stdout: -8470> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+387 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623b7600 count now 1/387 2023-10-03T19:20:48.227 INFO:teuthology.orchestra.run.smithi045.stdout: -8469> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000441) clear_dirty_parent 2023-10-03T19:20:48.227 INFO:teuthology.orchestra.run.smithi045.stdout: -8468> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000442) _stored_backtrace v 2538 2023-10-03T19:20:48.227 INFO:teuthology.orchestra.run.smithi045.stdout: -8467> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000442) auth_unpin by 0x55cf623b7b80 on [inode 0x10000000442 [2,head] /dc-dir/dc-file_589 auth v5078 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.378307+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623b7b80] now 0 2023-10-03T19:20:48.228 INFO:teuthology.orchestra.run.smithi045.stdout: -8466> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+386 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623b7b80 count now 1/386 2023-10-03T19:20:48.228 INFO:teuthology.orchestra.run.smithi045.stdout: -8465> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000442) clear_dirty_parent 2023-10-03T19:20:48.228 INFO:teuthology.orchestra.run.smithi045.stdout: -8464> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000443) _stored_backtrace v 2542 2023-10-03T19:20:48.228 INFO:teuthology.orchestra.run.smithi045.stdout: -8463> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000443) auth_unpin by 0x55cf623b8100 on [inode 0x10000000443 [2,head] /dc-dir/dc-file_590 auth v5080 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.389675+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623b8100] now 0 2023-10-03T19:20:48.228 INFO:teuthology.orchestra.run.smithi045.stdout: -8462> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+385 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623b8100 count now 1/385 2023-10-03T19:20:48.228 INFO:teuthology.orchestra.run.smithi045.stdout: -8461> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000443) clear_dirty_parent 2023-10-03T19:20:48.228 INFO:teuthology.orchestra.run.smithi045.stdout: -8460> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000444) _stored_backtrace v 2546 2023-10-03T19:20:48.228 INFO:teuthology.orchestra.run.smithi045.stdout: -8459> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000444) auth_unpin by 0x55cf623b8680 on [inode 0x10000000444 [2,head] /dc-dir/dc-file_591 auth v5082 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.400669+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623b8680] now 0 2023-10-03T19:20:48.228 INFO:teuthology.orchestra.run.smithi045.stdout: -8458> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+384 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623b8680 count now 1/384 2023-10-03T19:20:48.228 INFO:teuthology.orchestra.run.smithi045.stdout: -8457> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000444) clear_dirty_parent 2023-10-03T19:20:48.228 INFO:teuthology.orchestra.run.smithi045.stdout: -8456> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000445) _stored_backtrace v 2550 2023-10-03T19:20:48.229 INFO:teuthology.orchestra.run.smithi045.stdout: -8455> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000445) auth_unpin by 0x55cf623b8c00 on [inode 0x10000000445 [2,head] /dc-dir/dc-file_592 auth v5084 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.411524+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623b8c00] now 0 2023-10-03T19:20:48.229 INFO:teuthology.orchestra.run.smithi045.stdout: -8454> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+383 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623b8c00 count now 1/383 2023-10-03T19:20:48.229 INFO:teuthology.orchestra.run.smithi045.stdout: -8453> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000445) clear_dirty_parent 2023-10-03T19:20:48.229 INFO:teuthology.orchestra.run.smithi045.stdout: -8452> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000446) _stored_backtrace v 2554 2023-10-03T19:20:48.229 INFO:teuthology.orchestra.run.smithi045.stdout: -8451> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000446) auth_unpin by 0x55cf623b9180 on [inode 0x10000000446 [2,head] /dc-dir/dc-file_593 auth v5086 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.422417+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623b9180] now 0 2023-10-03T19:20:48.229 INFO:teuthology.orchestra.run.smithi045.stdout: -8450> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+382 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623b9180 count now 1/382 2023-10-03T19:20:48.229 INFO:teuthology.orchestra.run.smithi045.stdout: -8449> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000446) clear_dirty_parent 2023-10-03T19:20:48.229 INFO:teuthology.orchestra.run.smithi045.stdout: -8448> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000447) _stored_backtrace v 2558 2023-10-03T19:20:48.229 INFO:teuthology.orchestra.run.smithi045.stdout: -8447> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000447) auth_unpin by 0x55cf623b9700 on [inode 0x10000000447 [2,head] /dc-dir/dc-file_594 auth v5088 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.433472+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623b9700] now 0 2023-10-03T19:20:48.229 INFO:teuthology.orchestra.run.smithi045.stdout: -8446> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+381 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623b9700 count now 1/381 2023-10-03T19:20:48.230 INFO:teuthology.orchestra.run.smithi045.stdout: -8445> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000447) clear_dirty_parent 2023-10-03T19:20:48.230 INFO:teuthology.orchestra.run.smithi045.stdout: -8444> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000448) _stored_backtrace v 2562 2023-10-03T19:20:48.230 INFO:teuthology.orchestra.run.smithi045.stdout: -8443> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000448) auth_unpin by 0x55cf623c0000 on [inode 0x10000000448 [2,head] /dc-dir/dc-file_595 auth v5090 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.444538+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623c0000] now 0 2023-10-03T19:20:48.230 INFO:teuthology.orchestra.run.smithi045.stdout: -8442> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+380 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623c0000 count now 1/380 2023-10-03T19:20:48.230 INFO:teuthology.orchestra.run.smithi045.stdout: -8441> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000448) clear_dirty_parent 2023-10-03T19:20:48.230 INFO:teuthology.orchestra.run.smithi045.stdout: -8440> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000449) _stored_backtrace v 2566 2023-10-03T19:20:48.230 INFO:teuthology.orchestra.run.smithi045.stdout: -8439> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000449) auth_unpin by 0x55cf623c0580 on [inode 0x10000000449 [2,head] /dc-dir/dc-file_596 auth v5092 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.455922+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623c0580] now 0 2023-10-03T19:20:48.230 INFO:teuthology.orchestra.run.smithi045.stdout: -8438> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+379 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623c0580 count now 1/379 2023-10-03T19:20:48.230 INFO:teuthology.orchestra.run.smithi045.stdout: -8437> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000449) clear_dirty_parent 2023-10-03T19:20:48.230 INFO:teuthology.orchestra.run.smithi045.stdout: -8436> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000044a) _stored_backtrace v 2570 2023-10-03T19:20:48.230 INFO:teuthology.orchestra.run.smithi045.stdout: -8435> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000044a) auth_unpin by 0x55cf623c0b00 on [inode 0x1000000044a [2,head] /dc-dir/dc-file_597 auth v5094 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.466877+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623c0b00] now 0 2023-10-03T19:20:48.231 INFO:teuthology.orchestra.run.smithi045.stdout: -8434> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+378 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623c0b00 count now 1/378 2023-10-03T19:20:48.231 INFO:teuthology.orchestra.run.smithi045.stdout: -8433> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000044a) clear_dirty_parent 2023-10-03T19:20:48.231 INFO:teuthology.orchestra.run.smithi045.stdout: -8432> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000044b) _stored_backtrace v 2574 2023-10-03T19:20:48.231 INFO:teuthology.orchestra.run.smithi045.stdout: -8431> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000044b) auth_unpin by 0x55cf623c1080 on [inode 0x1000000044b [2,head] /dc-dir/dc-file_598 auth v5096 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.477744+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623c1080] now 0 2023-10-03T19:20:48.231 INFO:teuthology.orchestra.run.smithi045.stdout: -8430> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+377 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623c1080 count now 1/377 2023-10-03T19:20:48.231 INFO:teuthology.orchestra.run.smithi045.stdout: -8429> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000044b) clear_dirty_parent 2023-10-03T19:20:48.231 INFO:teuthology.orchestra.run.smithi045.stdout: -8428> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000044c) _stored_backtrace v 2578 2023-10-03T19:20:48.231 INFO:teuthology.orchestra.run.smithi045.stdout: -8427> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000044c) auth_unpin by 0x55cf623c1600 on [inode 0x1000000044c [2,head] /dc-dir/dc-file_599 auth v5200 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.496736+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623c1600] now 0 2023-10-03T19:20:48.231 INFO:teuthology.orchestra.run.smithi045.stdout: -8426> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+376 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623c1600 count now 1/376 2023-10-03T19:20:48.231 INFO:teuthology.orchestra.run.smithi045.stdout: -8425> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000044c) clear_dirty_parent 2023-10-03T19:20:48.231 INFO:teuthology.orchestra.run.smithi045.stdout: -8424> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000044d) _stored_backtrace v 2758 2023-10-03T19:20:48.231 INFO:teuthology.orchestra.run.smithi045.stdout: -8423> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000044d) auth_unpin by 0x55cf623c1b80 on [inode 0x1000000044d [2,head] /dc-dir/dc-file_600 auth v5202 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.635913+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623c1b80] now 0 2023-10-03T19:20:48.232 INFO:teuthology.orchestra.run.smithi045.stdout: -8422> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+375 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623c1b80 count now 1/375 2023-10-03T19:20:48.232 INFO:teuthology.orchestra.run.smithi045.stdout: -8421> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000044d) clear_dirty_parent 2023-10-03T19:20:48.237 INFO:teuthology.orchestra.run.smithi045.stdout: -8420> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000044e) _stored_backtrace v 2762 2023-10-03T19:20:48.237 INFO:teuthology.orchestra.run.smithi045.stdout: -8419> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000044e) auth_unpin by 0x55cf623c2100 on [inode 0x1000000044e [2,head] /dc-dir/dc-file_601 auth v5204 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.648694+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623c2100] now 0 2023-10-03T19:20:48.237 INFO:teuthology.orchestra.run.smithi045.stdout: -8418> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+374 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623c2100 count now 1/374 2023-10-03T19:20:48.238 INFO:teuthology.orchestra.run.smithi045.stdout: -8417> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000044e) clear_dirty_parent 2023-10-03T19:20:48.238 INFO:teuthology.orchestra.run.smithi045.stdout: -8416> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000044f) _stored_backtrace v 2766 2023-10-03T19:20:48.238 INFO:teuthology.orchestra.run.smithi045.stdout: -8415> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000044f) auth_unpin by 0x55cf623c2680 on [inode 0x1000000044f [2,head] /dc-dir/dc-file_602 auth v5206 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.659403+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623c2680] now 0 2023-10-03T19:20:48.238 INFO:teuthology.orchestra.run.smithi045.stdout: -8414> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+373 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623c2680 count now 1/373 2023-10-03T19:20:48.238 INFO:teuthology.orchestra.run.smithi045.stdout: -8413> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000044f) clear_dirty_parent 2023-10-03T19:20:48.238 INFO:teuthology.orchestra.run.smithi045.stdout: -8412> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000450) _stored_backtrace v 2770 2023-10-03T19:20:48.238 INFO:teuthology.orchestra.run.smithi045.stdout: -8411> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000450) auth_unpin by 0x55cf623c2c00 on [inode 0x10000000450 [2,head] /dc-dir/dc-file_603 auth v5208 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.672075+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623c2c00] now 0 2023-10-03T19:20:48.238 INFO:teuthology.orchestra.run.smithi045.stdout: -8410> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+372 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623c2c00 count now 1/372 2023-10-03T19:20:48.238 INFO:teuthology.orchestra.run.smithi045.stdout: -8409> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000450) clear_dirty_parent 2023-10-03T19:20:48.238 INFO:teuthology.orchestra.run.smithi045.stdout: -8408> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000451) _stored_backtrace v 2774 2023-10-03T19:20:48.238 INFO:teuthology.orchestra.run.smithi045.stdout: -8407> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000451) auth_unpin by 0x55cf623c3180 on [inode 0x10000000451 [2,head] /dc-dir/dc-file_604 auth v5210 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.684827+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623c3180] now 0 2023-10-03T19:20:48.239 INFO:teuthology.orchestra.run.smithi045.stdout: -8406> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+371 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623c3180 count now 1/371 2023-10-03T19:20:48.239 INFO:teuthology.orchestra.run.smithi045.stdout: -8405> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000451) clear_dirty_parent 2023-10-03T19:20:48.239 INFO:teuthology.orchestra.run.smithi045.stdout: -8404> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000452) _stored_backtrace v 2778 2023-10-03T19:20:48.239 INFO:teuthology.orchestra.run.smithi045.stdout: -8403> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000452) auth_unpin by 0x55cf623c3700 on [inode 0x10000000452 [2,head] /dc-dir/dc-file_605 auth v5212 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.697325+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623c3700] now 0 2023-10-03T19:20:48.239 INFO:teuthology.orchestra.run.smithi045.stdout: -8402> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+370 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623c3700 count now 1/370 2023-10-03T19:20:48.239 INFO:teuthology.orchestra.run.smithi045.stdout: -8401> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000452) clear_dirty_parent 2023-10-03T19:20:48.239 INFO:teuthology.orchestra.run.smithi045.stdout: -8400> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000453) _stored_backtrace v 2782 2023-10-03T19:20:48.239 INFO:teuthology.orchestra.run.smithi045.stdout: -8399> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000453) auth_unpin by 0x55cf623de000 on [inode 0x10000000453 [2,head] /dc-dir/dc-file_606 auth v5214 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.710314+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623de000] now 0 2023-10-03T19:20:48.239 INFO:teuthology.orchestra.run.smithi045.stdout: -8398> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+369 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623de000 count now 1/369 2023-10-03T19:20:48.239 INFO:teuthology.orchestra.run.smithi045.stdout: -8397> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000453) clear_dirty_parent 2023-10-03T19:20:48.239 INFO:teuthology.orchestra.run.smithi045.stdout: -8396> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000454) _stored_backtrace v 2786 2023-10-03T19:20:48.239 INFO:teuthology.orchestra.run.smithi045.stdout: -8395> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000454) auth_unpin by 0x55cf623de580 on [inode 0x10000000454 [2,head] /dc-dir/dc-file_607 auth v5216 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.722527+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623de580] now 0 2023-10-03T19:20:48.240 INFO:teuthology.orchestra.run.smithi045.stdout: -8394> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+368 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623de580 count now 1/368 2023-10-03T19:20:48.240 INFO:teuthology.orchestra.run.smithi045.stdout: -8393> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000454) clear_dirty_parent 2023-10-03T19:20:48.240 INFO:teuthology.orchestra.run.smithi045.stdout: -8392> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000455) _stored_backtrace v 2790 2023-10-03T19:20:48.240 INFO:teuthology.orchestra.run.smithi045.stdout: -8391> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000455) auth_unpin by 0x55cf623deb00 on [inode 0x10000000455 [2,head] /dc-dir/dc-file_608 auth v5218 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.733802+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623deb00] now 0 2023-10-03T19:20:48.240 INFO:teuthology.orchestra.run.smithi045.stdout: -8390> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+367 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623deb00 count now 1/367 2023-10-03T19:20:48.240 INFO:teuthology.orchestra.run.smithi045.stdout: -8389> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000455) clear_dirty_parent 2023-10-03T19:20:48.240 INFO:teuthology.orchestra.run.smithi045.stdout: -8388> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000456) _stored_backtrace v 2794 2023-10-03T19:20:48.240 INFO:teuthology.orchestra.run.smithi045.stdout: -8387> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000456) auth_unpin by 0x55cf623df080 on [inode 0x10000000456 [2,head] /dc-dir/dc-file_609 auth v5220 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.746015+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623df080] now 0 2023-10-03T19:20:48.240 INFO:teuthology.orchestra.run.smithi045.stdout: -8386> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+366 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623df080 count now 1/366 2023-10-03T19:20:48.240 INFO:teuthology.orchestra.run.smithi045.stdout: -8385> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000456) clear_dirty_parent 2023-10-03T19:20:48.240 INFO:teuthology.orchestra.run.smithi045.stdout: -8384> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000457) _stored_backtrace v 2798 2023-10-03T19:20:48.241 INFO:teuthology.orchestra.run.smithi045.stdout: -8383> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000457) auth_unpin by 0x55cf623df600 on [inode 0x10000000457 [2,head] /dc-dir/dc-file_610 auth v5222 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.759059+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623df600] now 0 2023-10-03T19:20:48.241 INFO:teuthology.orchestra.run.smithi045.stdout: -8382> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+365 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623df600 count now 1/365 2023-10-03T19:20:48.241 INFO:teuthology.orchestra.run.smithi045.stdout: -8381> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000457) clear_dirty_parent 2023-10-03T19:20:48.241 INFO:teuthology.orchestra.run.smithi045.stdout: -8380> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000458) _stored_backtrace v 2802 2023-10-03T19:20:48.241 INFO:teuthology.orchestra.run.smithi045.stdout: -8379> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000458) auth_unpin by 0x55cf623dfb80 on [inode 0x10000000458 [2,head] /dc-dir/dc-file_611 auth v5224 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.770690+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623dfb80] now 0 2023-10-03T19:20:48.241 INFO:teuthology.orchestra.run.smithi045.stdout: -8378> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+364 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623dfb80 count now 1/364 2023-10-03T19:20:48.241 INFO:teuthology.orchestra.run.smithi045.stdout: -8377> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000458) clear_dirty_parent 2023-10-03T19:20:48.241 INFO:teuthology.orchestra.run.smithi045.stdout: -8376> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000459) _stored_backtrace v 2806 2023-10-03T19:20:48.241 INFO:teuthology.orchestra.run.smithi045.stdout: -8375> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000459) auth_unpin by 0x55cf623e0100 on [inode 0x10000000459 [2,head] /dc-dir/dc-file_612 auth v5226 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.781394+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623e0100] now 0 2023-10-03T19:20:48.241 INFO:teuthology.orchestra.run.smithi045.stdout: -8374> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+363 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623e0100 count now 1/363 2023-10-03T19:20:48.242 INFO:teuthology.orchestra.run.smithi045.stdout: -8373> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000459) clear_dirty_parent 2023-10-03T19:20:48.242 INFO:teuthology.orchestra.run.smithi045.stdout: -8372> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000045a) _stored_backtrace v 2810 2023-10-03T19:20:48.242 INFO:teuthology.orchestra.run.smithi045.stdout: -8371> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000045a) auth_unpin by 0x55cf623e0680 on [inode 0x1000000045a [2,head] /dc-dir/dc-file_613 auth v5228 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.792588+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623e0680] now 0 2023-10-03T19:20:48.242 INFO:teuthology.orchestra.run.smithi045.stdout: -8370> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+362 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623e0680 count now 1/362 2023-10-03T19:20:48.242 INFO:teuthology.orchestra.run.smithi045.stdout: -8369> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000045a) clear_dirty_parent 2023-10-03T19:20:48.242 INFO:teuthology.orchestra.run.smithi045.stdout: -8368> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000045b) _stored_backtrace v 2814 2023-10-03T19:20:48.242 INFO:teuthology.orchestra.run.smithi045.stdout: -8367> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000045b) auth_unpin by 0x55cf623e0c00 on [inode 0x1000000045b [2,head] /dc-dir/dc-file_614 auth v5230 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.804514+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623e0c00] now 0 2023-10-03T19:20:48.242 INFO:teuthology.orchestra.run.smithi045.stdout: -8366> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+361 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623e0c00 count now 1/361 2023-10-03T19:20:48.242 INFO:teuthology.orchestra.run.smithi045.stdout: -8365> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000045b) clear_dirty_parent 2023-10-03T19:20:48.242 INFO:teuthology.orchestra.run.smithi045.stdout: -8364> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000045c) _stored_backtrace v 2818 2023-10-03T19:20:48.242 INFO:teuthology.orchestra.run.smithi045.stdout: -8363> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000045c) auth_unpin by 0x55cf623e1180 on [inode 0x1000000045c [2,head] /dc-dir/dc-file_615 auth v5232 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.817150+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623e1180] now 0 2023-10-03T19:20:48.242 INFO:teuthology.orchestra.run.smithi045.stdout: -8362> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+360 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623e1180 count now 1/360 2023-10-03T19:20:48.243 INFO:teuthology.orchestra.run.smithi045.stdout: -8361> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000045c) clear_dirty_parent 2023-10-03T19:20:48.243 INFO:teuthology.orchestra.run.smithi045.stdout: -8360> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000045d) _stored_backtrace v 2822 2023-10-03T19:20:48.243 INFO:teuthology.orchestra.run.smithi045.stdout: -8359> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000045d) auth_unpin by 0x55cf623e1700 on [inode 0x1000000045d [2,head] /dc-dir/dc-file_616 auth v5234 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.828092+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623e1700] now 0 2023-10-03T19:20:48.243 INFO:teuthology.orchestra.run.smithi045.stdout: -8358> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+359 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623e1700 count now 1/359 2023-10-03T19:20:48.243 INFO:teuthology.orchestra.run.smithi045.stdout: -8357> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000045d) clear_dirty_parent 2023-10-03T19:20:48.243 INFO:teuthology.orchestra.run.smithi045.stdout: -8356> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000045e) _stored_backtrace v 2826 2023-10-03T19:20:48.243 INFO:teuthology.orchestra.run.smithi045.stdout: -8355> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000045e) auth_unpin by 0x55cf623ec000 on [inode 0x1000000045e [2,head] /dc-dir/dc-file_617 auth v5236 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.839408+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623ec000] now 0 2023-10-03T19:20:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: -8354> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+358 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623ec000 count now 1/358 2023-10-03T19:20:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: -8353> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000045e) clear_dirty_parent 2023-10-03T19:20:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: -8352> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000045f) _stored_backtrace v 2830 2023-10-03T19:20:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: -8351> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000045f) auth_unpin by 0x55cf623ec580 on [inode 0x1000000045f [2,head] /dc-dir/dc-file_618 auth v5238 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.849913+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623ec580] now 0 2023-10-03T19:20:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: -8350> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+357 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623ec580 count now 1/357 2023-10-03T19:20:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: -8349> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000045f) clear_dirty_parent 2023-10-03T19:20:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: -8348> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000460) _stored_backtrace v 2834 2023-10-03T19:20:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: -8347> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000460) auth_unpin by 0x55cf623ecb00 on [inode 0x10000000460 [2,head] /dc-dir/dc-file_619 auth v5240 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.860860+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623ecb00] now 0 2023-10-03T19:20:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: -8346> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+356 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623ecb00 count now 1/356 2023-10-03T19:20:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: -8345> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000460) clear_dirty_parent 2023-10-03T19:20:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: -8344> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000461) _stored_backtrace v 2838 2023-10-03T19:20:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: -8343> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000461) auth_unpin by 0x55cf623ed080 on [inode 0x10000000461 [2,head] /dc-dir/dc-file_620 auth v5242 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.871599+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623ed080] now 0 2023-10-03T19:20:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: -8342> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+355 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623ed080 count now 1/355 2023-10-03T19:20:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: -8341> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000461) clear_dirty_parent 2023-10-03T19:20:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: -8340> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000462) _stored_backtrace v 2842 2023-10-03T19:20:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: -8339> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000462) auth_unpin by 0x55cf623ed600 on [inode 0x10000000462 [2,head] /dc-dir/dc-file_621 auth v5244 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.882287+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623ed600] now 0 2023-10-03T19:20:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: -8338> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+354 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623ed600 count now 1/354 2023-10-03T19:20:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: -8337> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000462) clear_dirty_parent 2023-10-03T19:20:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: -8336> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000463) _stored_backtrace v 2846 2023-10-03T19:20:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: -8335> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000463) auth_unpin by 0x55cf623edb80 on [inode 0x10000000463 [2,head] /dc-dir/dc-file_622 auth v5246 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.893916+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623edb80] now 0 2023-10-03T19:20:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: -8334> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+353 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623edb80 count now 1/353 2023-10-03T19:20:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: -8333> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000463) clear_dirty_parent 2023-10-03T19:20:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: -8332> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000464) _stored_backtrace v 2850 2023-10-03T19:20:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: -8331> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000464) auth_unpin by 0x55cf623ee100 on [inode 0x10000000464 [2,head] /dc-dir/dc-file_623 auth v5248 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.905346+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623ee100] now 0 2023-10-03T19:20:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: -8330> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+352 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623ee100 count now 1/352 2023-10-03T19:20:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: -8329> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000464) clear_dirty_parent 2023-10-03T19:20:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: -8328> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000465) _stored_backtrace v 2854 2023-10-03T19:20:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: -8327> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000465) auth_unpin by 0x55cf623ee680 on [inode 0x10000000465 [2,head] /dc-dir/dc-file_624 auth v5250 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.917308+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623ee680] now 0 2023-10-03T19:20:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: -8326> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+351 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623ee680 count now 1/351 2023-10-03T19:20:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: -8325> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000465) clear_dirty_parent 2023-10-03T19:20:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: -8324> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000466) _stored_backtrace v 2858 2023-10-03T19:20:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: -8323> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000466) auth_unpin by 0x55cf623eec00 on [inode 0x10000000466 [2,head] /dc-dir/dc-file_625 auth v5252 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.929217+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623eec00] now 0 2023-10-03T19:20:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: -8322> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+350 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623eec00 count now 1/350 2023-10-03T19:20:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: -8321> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000466) clear_dirty_parent 2023-10-03T19:20:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: -8320> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000467) _stored_backtrace v 2862 2023-10-03T19:20:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: -8319> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000467) auth_unpin by 0x55cf623ef180 on [inode 0x10000000467 [2,head] /dc-dir/dc-file_626 auth v5254 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.940439+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623ef180] now 0 2023-10-03T19:20:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: -8318> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+349 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623ef180 count now 1/349 2023-10-03T19:20:48.329 INFO:teuthology.orchestra.run.smithi045.stdout: -8317> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000467) clear_dirty_parent 2023-10-03T19:20:48.329 INFO:teuthology.orchestra.run.smithi045.stdout: -8316> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000468) _stored_backtrace v 2866 2023-10-03T19:20:48.329 INFO:teuthology.orchestra.run.smithi045.stdout: -8315> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000468) auth_unpin by 0x55cf623ef700 on [inode 0x10000000468 [2,head] /dc-dir/dc-file_627 auth v5256 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.953824+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623ef700] now 0 2023-10-03T19:20:48.329 INFO:teuthology.orchestra.run.smithi045.stdout: -8314> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+348 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623ef700 count now 1/348 2023-10-03T19:20:48.329 INFO:teuthology.orchestra.run.smithi045.stdout: -8313> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000468) clear_dirty_parent 2023-10-03T19:20:48.329 INFO:teuthology.orchestra.run.smithi045.stdout: -8312> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000469) _stored_backtrace v 2870 2023-10-03T19:20:48.329 INFO:teuthology.orchestra.run.smithi045.stdout: -8311> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000469) auth_unpin by 0x55cf623f2000 on [inode 0x10000000469 [2,head] /dc-dir/dc-file_628 auth v5258 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.966453+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623f2000] now 0 2023-10-03T19:20:48.329 INFO:teuthology.orchestra.run.smithi045.stdout: -8310> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+347 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623f2000 count now 1/347 2023-10-03T19:20:48.329 INFO:teuthology.orchestra.run.smithi045.stdout: -8309> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000469) clear_dirty_parent 2023-10-03T19:20:48.329 INFO:teuthology.orchestra.run.smithi045.stdout: -8308> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000046a) _stored_backtrace v 2874 2023-10-03T19:20:48.330 INFO:teuthology.orchestra.run.smithi045.stdout: -8307> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000046a) auth_unpin by 0x55cf623f2580 on [inode 0x1000000046a [2,head] /dc-dir/dc-file_629 auth v5260 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.978279+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623f2580] now 0 2023-10-03T19:20:48.330 INFO:teuthology.orchestra.run.smithi045.stdout: -8306> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+346 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623f2580 count now 1/346 2023-10-03T19:20:48.330 INFO:teuthology.orchestra.run.smithi045.stdout: -8305> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000046a) clear_dirty_parent 2023-10-03T19:20:48.330 INFO:teuthology.orchestra.run.smithi045.stdout: -8304> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000046b) _stored_backtrace v 2878 2023-10-03T19:20:48.330 INFO:teuthology.orchestra.run.smithi045.stdout: -8303> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000046b) auth_unpin by 0x55cf623f2b00 on [inode 0x1000000046b [2,head] /dc-dir/dc-file_630 auth v5262 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:41.989527+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623f2b00] now 0 2023-10-03T19:20:48.330 INFO:teuthology.orchestra.run.smithi045.stdout: -8302> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+345 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623f2b00 count now 1/345 2023-10-03T19:20:48.330 INFO:teuthology.orchestra.run.smithi045.stdout: -8301> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000046b) clear_dirty_parent 2023-10-03T19:20:48.330 INFO:teuthology.orchestra.run.smithi045.stdout: -8300> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000046c) _stored_backtrace v 2882 2023-10-03T19:20:48.330 INFO:teuthology.orchestra.run.smithi045.stdout: -8299> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000046c) auth_unpin by 0x55cf623f3080 on [inode 0x1000000046c [2,head] /dc-dir/dc-file_631 auth v5264 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.003288+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623f3080] now 0 2023-10-03T19:20:48.330 INFO:teuthology.orchestra.run.smithi045.stdout: -8298> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+344 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623f3080 count now 1/344 2023-10-03T19:20:48.330 INFO:teuthology.orchestra.run.smithi045.stdout: -8297> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000046c) clear_dirty_parent 2023-10-03T19:20:48.331 INFO:teuthology.orchestra.run.smithi045.stdout: -8296> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000046d) _stored_backtrace v 2886 2023-10-03T19:20:48.331 INFO:teuthology.orchestra.run.smithi045.stdout: -8295> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000046d) auth_unpin by 0x55cf623f3600 on [inode 0x1000000046d [2,head] /dc-dir/dc-file_632 auth v5266 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.014817+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623f3600] now 0 2023-10-03T19:20:48.331 INFO:teuthology.orchestra.run.smithi045.stdout: -8294> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+343 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623f3600 count now 1/343 2023-10-03T19:20:48.331 INFO:teuthology.orchestra.run.smithi045.stdout: -8293> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000046d) clear_dirty_parent 2023-10-03T19:20:48.331 INFO:teuthology.orchestra.run.smithi045.stdout: -8292> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000046e) _stored_backtrace v 2890 2023-10-03T19:20:48.331 INFO:teuthology.orchestra.run.smithi045.stdout: -8291> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000046e) auth_unpin by 0x55cf623f3b80 on [inode 0x1000000046e [2,head] /dc-dir/dc-file_633 auth v5268 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.025774+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623f3b80] now 0 2023-10-03T19:20:48.331 INFO:teuthology.orchestra.run.smithi045.stdout: -8290> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+342 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623f3b80 count now 1/342 2023-10-03T19:20:48.349 INFO:teuthology.orchestra.run.smithi045.stdout: -8289> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000046e) clear_dirty_parent 2023-10-03T19:20:48.350 INFO:teuthology.orchestra.run.smithi045.stdout: -8288> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000046f) _stored_backtrace v 2894 2023-10-03T19:20:48.350 INFO:teuthology.orchestra.run.smithi045.stdout: -8287> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000046f) auth_unpin by 0x55cf623f4100 on [inode 0x1000000046f [2,head] /dc-dir/dc-file_634 auth v5270 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.037202+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623f4100] now 0 2023-10-03T19:20:48.350 INFO:teuthology.orchestra.run.smithi045.stdout: -8286> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+341 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623f4100 count now 1/341 2023-10-03T19:20:48.350 INFO:teuthology.orchestra.run.smithi045.stdout: -8285> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000046f) clear_dirty_parent 2023-10-03T19:20:48.350 INFO:teuthology.orchestra.run.smithi045.stdout: -8284> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000470) _stored_backtrace v 2898 2023-10-03T19:20:48.350 INFO:teuthology.orchestra.run.smithi045.stdout: -8283> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000470) auth_unpin by 0x55cf623f4680 on [inode 0x10000000470 [2,head] /dc-dir/dc-file_635 auth v5272 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.049331+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623f4680] now 0 2023-10-03T19:20:48.350 INFO:teuthology.orchestra.run.smithi045.stdout: -8282> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+340 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623f4680 count now 1/340 2023-10-03T19:20:48.351 INFO:teuthology.orchestra.run.smithi045.stdout: -8281> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000470) clear_dirty_parent 2023-10-03T19:20:48.351 INFO:teuthology.orchestra.run.smithi045.stdout: -8280> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000471) _stored_backtrace v 2902 2023-10-03T19:20:48.351 INFO:teuthology.orchestra.run.smithi045.stdout: -8279> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000471) auth_unpin by 0x55cf623f4c00 on [inode 0x10000000471 [2,head] /dc-dir/dc-file_636 auth v5274 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.062332+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623f4c00] now 0 2023-10-03T19:20:48.351 INFO:teuthology.orchestra.run.smithi045.stdout: -8278> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+339 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623f4c00 count now 1/339 2023-10-03T19:20:48.351 INFO:teuthology.orchestra.run.smithi045.stdout: -8277> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000471) clear_dirty_parent 2023-10-03T19:20:48.351 INFO:teuthology.orchestra.run.smithi045.stdout: -8276> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000472) _stored_backtrace v 2906 2023-10-03T19:20:48.351 INFO:teuthology.orchestra.run.smithi045.stdout: -8275> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000472) auth_unpin by 0x55cf623f5180 on [inode 0x10000000472 [2,head] /dc-dir/dc-file_637 auth v5276 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.073799+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623f5180] now 0 2023-10-03T19:20:48.351 INFO:teuthology.orchestra.run.smithi045.stdout: -8274> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+338 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623f5180 count now 1/338 2023-10-03T19:20:48.351 INFO:teuthology.orchestra.run.smithi045.stdout: -8273> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000472) clear_dirty_parent 2023-10-03T19:20:48.352 INFO:teuthology.orchestra.run.smithi045.stdout: -8272> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000473) _stored_backtrace v 2910 2023-10-03T19:20:48.352 INFO:teuthology.orchestra.run.smithi045.stdout: -8271> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000473) auth_unpin by 0x55cf623f5700 on [inode 0x10000000473 [2,head] /dc-dir/dc-file_638 auth v5278 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.085489+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623f5700] now 0 2023-10-03T19:20:48.352 INFO:teuthology.orchestra.run.smithi045.stdout: -8270> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+337 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623f5700 count now 1/337 2023-10-03T19:20:48.352 INFO:teuthology.orchestra.run.smithi045.stdout: -8269> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000473) clear_dirty_parent 2023-10-03T19:20:48.352 INFO:teuthology.orchestra.run.smithi045.stdout: -8268> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000474) _stored_backtrace v 2914 2023-10-03T19:20:48.352 INFO:teuthology.orchestra.run.smithi045.stdout: -8267> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000474) auth_unpin by 0x55cf623fc000 on [inode 0x10000000474 [2,head] /dc-dir/dc-file_639 auth v5280 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.097861+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623fc000] now 0 2023-10-03T19:20:48.352 INFO:teuthology.orchestra.run.smithi045.stdout: -8266> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+336 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623fc000 count now 1/336 2023-10-03T19:20:48.352 INFO:teuthology.orchestra.run.smithi045.stdout: -8265> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000474) clear_dirty_parent 2023-10-03T19:20:48.352 INFO:teuthology.orchestra.run.smithi045.stdout: -8264> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000475) _stored_backtrace v 2918 2023-10-03T19:20:48.352 INFO:teuthology.orchestra.run.smithi045.stdout: -8263> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000475) auth_unpin by 0x55cf623fc580 on [inode 0x10000000475 [2,head] /dc-dir/dc-file_640 auth v5282 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.111870+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623fc580] now 0 2023-10-03T19:20:48.352 INFO:teuthology.orchestra.run.smithi045.stdout: -8262> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+335 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623fc580 count now 1/335 2023-10-03T19:20:48.353 INFO:teuthology.orchestra.run.smithi045.stdout: -8261> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000475) clear_dirty_parent 2023-10-03T19:20:48.353 INFO:teuthology.orchestra.run.smithi045.stdout: -8260> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000476) _stored_backtrace v 2922 2023-10-03T19:20:48.353 INFO:teuthology.orchestra.run.smithi045.stdout: -8259> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000476) auth_unpin by 0x55cf623fcb00 on [inode 0x10000000476 [2,head] /dc-dir/dc-file_641 auth v5284 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.124667+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623fcb00] now 0 2023-10-03T19:20:48.353 INFO:teuthology.orchestra.run.smithi045.stdout: -8258> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+334 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623fcb00 count now 1/334 2023-10-03T19:20:48.353 INFO:teuthology.orchestra.run.smithi045.stdout: -8257> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000476) clear_dirty_parent 2023-10-03T19:20:48.353 INFO:teuthology.orchestra.run.smithi045.stdout: -8256> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000477) _stored_backtrace v 2926 2023-10-03T19:20:48.353 INFO:teuthology.orchestra.run.smithi045.stdout: -8255> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000477) auth_unpin by 0x55cf623fd080 on [inode 0x10000000477 [2,head] /dc-dir/dc-file_642 auth v5286 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.136275+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623fd080] now 0 2023-10-03T19:20:48.353 INFO:teuthology.orchestra.run.smithi045.stdout: -8254> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+333 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623fd080 count now 1/333 2023-10-03T19:20:48.353 INFO:teuthology.orchestra.run.smithi045.stdout: -8253> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000477) clear_dirty_parent 2023-10-03T19:20:48.353 INFO:teuthology.orchestra.run.smithi045.stdout: -8252> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000478) _stored_backtrace v 2930 2023-10-03T19:20:48.353 INFO:teuthology.orchestra.run.smithi045.stdout: -8251> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000478) auth_unpin by 0x55cf623fd600 on [inode 0x10000000478 [2,head] /dc-dir/dc-file_643 auth v5288 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.146940+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623fd600] now 0 2023-10-03T19:20:48.354 INFO:teuthology.orchestra.run.smithi045.stdout: -8250> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+332 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623fd600 count now 1/332 2023-10-03T19:20:48.354 INFO:teuthology.orchestra.run.smithi045.stdout: -8249> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000478) clear_dirty_parent 2023-10-03T19:20:48.354 INFO:teuthology.orchestra.run.smithi045.stdout: -8248> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000479) _stored_backtrace v 2934 2023-10-03T19:20:48.354 INFO:teuthology.orchestra.run.smithi045.stdout: -8247> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000479) auth_unpin by 0x55cf623fdb80 on [inode 0x10000000479 [2,head] /dc-dir/dc-file_644 auth v5290 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.159523+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623fdb80] now 0 2023-10-03T19:20:48.354 INFO:teuthology.orchestra.run.smithi045.stdout: -8246> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+331 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623fdb80 count now 1/331 2023-10-03T19:20:48.354 INFO:teuthology.orchestra.run.smithi045.stdout: -8245> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000479) clear_dirty_parent 2023-10-03T19:20:48.354 INFO:teuthology.orchestra.run.smithi045.stdout: -8244> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000047a) _stored_backtrace v 2938 2023-10-03T19:20:48.354 INFO:teuthology.orchestra.run.smithi045.stdout: -8243> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000047a) auth_unpin by 0x55cf623fe100 on [inode 0x1000000047a [2,head] /dc-dir/dc-file_645 auth v5292 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.170798+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623fe100] now 0 2023-10-03T19:20:48.354 INFO:teuthology.orchestra.run.smithi045.stdout: -8242> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+330 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623fe100 count now 1/330 2023-10-03T19:20:48.354 INFO:teuthology.orchestra.run.smithi045.stdout: -8241> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000047a) clear_dirty_parent 2023-10-03T19:20:48.355 INFO:teuthology.orchestra.run.smithi045.stdout: -8240> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000047b) _stored_backtrace v 2942 2023-10-03T19:20:48.355 INFO:teuthology.orchestra.run.smithi045.stdout: -8239> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000047b) auth_unpin by 0x55cf623fe680 on [inode 0x1000000047b [2,head] /dc-dir/dc-file_646 auth v5294 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.182061+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623fe680] now 0 2023-10-03T19:20:48.355 INFO:teuthology.orchestra.run.smithi045.stdout: -8238> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+329 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623fe680 count now 1/329 2023-10-03T19:20:48.355 INFO:teuthology.orchestra.run.smithi045.stdout: -8237> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000047b) clear_dirty_parent 2023-10-03T19:20:48.355 INFO:teuthology.orchestra.run.smithi045.stdout: -8236> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000047c) _stored_backtrace v 2946 2023-10-03T19:20:48.355 INFO:teuthology.orchestra.run.smithi045.stdout: -8235> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000047c) auth_unpin by 0x55cf623fec00 on [inode 0x1000000047c [2,head] /dc-dir/dc-file_647 auth v5296 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.193457+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623fec00] now 0 2023-10-03T19:20:48.359 INFO:teuthology.orchestra.run.smithi045.stdout: -8234> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+328 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623fec00 count now 1/328 2023-10-03T19:20:48.359 INFO:teuthology.orchestra.run.smithi045.stdout: -8233> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000047c) clear_dirty_parent 2023-10-03T19:20:48.359 INFO:teuthology.orchestra.run.smithi045.stdout: -8232> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000047d) _stored_backtrace v 2950 2023-10-03T19:20:48.359 INFO:teuthology.orchestra.run.smithi045.stdout: -8231> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000047d) auth_unpin by 0x55cf623ff180 on [inode 0x1000000047d [2,head] /dc-dir/dc-file_648 auth v5298 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.204393+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623ff180] now 0 2023-10-03T19:20:48.359 INFO:teuthology.orchestra.run.smithi045.stdout: -8230> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+327 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623ff180 count now 1/327 2023-10-03T19:20:48.359 INFO:teuthology.orchestra.run.smithi045.stdout: -8229> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000047d) clear_dirty_parent 2023-10-03T19:20:48.359 INFO:teuthology.orchestra.run.smithi045.stdout: -8228> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000047e) _stored_backtrace v 2954 2023-10-03T19:20:48.359 INFO:teuthology.orchestra.run.smithi045.stdout: -8227> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000047e) auth_unpin by 0x55cf623ff700 on [inode 0x1000000047e [2,head] /dc-dir/dc-file_649 auth v5300 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.215554+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf623ff700] now 0 2023-10-03T19:20:48.359 INFO:teuthology.orchestra.run.smithi045.stdout: -8226> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+326 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf623ff700 count now 1/326 2023-10-03T19:20:48.359 INFO:teuthology.orchestra.run.smithi045.stdout: -8225> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000047e) clear_dirty_parent 2023-10-03T19:20:48.360 INFO:teuthology.orchestra.run.smithi045.stdout: -8224> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000047f) _stored_backtrace v 2958 2023-10-03T19:20:48.360 INFO:teuthology.orchestra.run.smithi045.stdout: -8223> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000047f) auth_unpin by 0x55cf62404000 on [inode 0x1000000047f [2,head] /dc-dir/dc-file_650 auth v5302 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.226790+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62404000] now 0 2023-10-03T19:20:48.360 INFO:teuthology.orchestra.run.smithi045.stdout: -8222> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+325 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62404000 count now 1/325 2023-10-03T19:20:48.360 INFO:teuthology.orchestra.run.smithi045.stdout: -8221> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000047f) clear_dirty_parent 2023-10-03T19:20:48.360 INFO:teuthology.orchestra.run.smithi045.stdout: -8220> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000480) _stored_backtrace v 2962 2023-10-03T19:20:48.360 INFO:teuthology.orchestra.run.smithi045.stdout: -8219> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000480) auth_unpin by 0x55cf62404580 on [inode 0x10000000480 [2,head] /dc-dir/dc-file_651 auth v5304 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.237416+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62404580] now 0 2023-10-03T19:20:48.360 INFO:teuthology.orchestra.run.smithi045.stdout: -8218> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+324 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62404580 count now 1/324 2023-10-03T19:20:48.360 INFO:teuthology.orchestra.run.smithi045.stdout: -8217> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000480) clear_dirty_parent 2023-10-03T19:20:48.360 INFO:teuthology.orchestra.run.smithi045.stdout: -8216> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000481) _stored_backtrace v 2966 2023-10-03T19:20:48.361 INFO:teuthology.orchestra.run.smithi045.stdout: -8215> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000481) auth_unpin by 0x55cf62404b00 on [inode 0x10000000481 [2,head] /dc-dir/dc-file_652 auth v5306 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.248235+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62404b00] now 0 2023-10-03T19:20:48.361 INFO:teuthology.orchestra.run.smithi045.stdout: -8214> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+323 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62404b00 count now 1/323 2023-10-03T19:20:48.361 INFO:teuthology.orchestra.run.smithi045.stdout: -8213> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000481) clear_dirty_parent 2023-10-03T19:20:48.361 INFO:teuthology.orchestra.run.smithi045.stdout: -8212> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000482) _stored_backtrace v 2970 2023-10-03T19:20:48.361 INFO:teuthology.orchestra.run.smithi045.stdout: -8211> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000482) auth_unpin by 0x55cf62405080 on [inode 0x10000000482 [2,head] /dc-dir/dc-file_653 auth v5308 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.258835+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62405080] now 0 2023-10-03T19:20:48.361 INFO:teuthology.orchestra.run.smithi045.stdout: -8210> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+322 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62405080 count now 1/322 2023-10-03T19:20:48.361 INFO:teuthology.orchestra.run.smithi045.stdout: -8209> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000482) clear_dirty_parent 2023-10-03T19:20:48.361 INFO:teuthology.orchestra.run.smithi045.stdout: -8208> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000483) _stored_backtrace v 2974 2023-10-03T19:20:48.361 INFO:teuthology.orchestra.run.smithi045.stdout: -8207> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000483) auth_unpin by 0x55cf62405600 on [inode 0x10000000483 [2,head] /dc-dir/dc-file_654 auth v5310 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.269692+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62405600] now 0 2023-10-03T19:20:48.361 INFO:teuthology.orchestra.run.smithi045.stdout: -8206> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+321 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62405600 count now 1/321 2023-10-03T19:20:48.361 INFO:teuthology.orchestra.run.smithi045.stdout: -8205> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000483) clear_dirty_parent 2023-10-03T19:20:48.361 INFO:teuthology.orchestra.run.smithi045.stdout: -8204> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000484) _stored_backtrace v 2978 2023-10-03T19:20:48.362 INFO:teuthology.orchestra.run.smithi045.stdout: -8203> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000484) auth_unpin by 0x55cf62405b80 on [inode 0x10000000484 [2,head] /dc-dir/dc-file_655 auth v5312 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.281331+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62405b80] now 0 2023-10-03T19:20:48.362 INFO:teuthology.orchestra.run.smithi045.stdout: -8202> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+320 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62405b80 count now 1/320 2023-10-03T19:20:48.362 INFO:teuthology.orchestra.run.smithi045.stdout: -8201> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000484) clear_dirty_parent 2023-10-03T19:20:48.362 INFO:teuthology.orchestra.run.smithi045.stdout: -8200> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000485) _stored_backtrace v 2982 2023-10-03T19:20:48.362 INFO:teuthology.orchestra.run.smithi045.stdout: -8199> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000485) auth_unpin by 0x55cf62406100 on [inode 0x10000000485 [2,head] /dc-dir/dc-file_656 auth v5314 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.292930+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62406100] now 0 2023-10-03T19:20:48.362 INFO:teuthology.orchestra.run.smithi045.stdout: -8198> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+319 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62406100 count now 1/319 2023-10-03T19:20:48.362 INFO:teuthology.orchestra.run.smithi045.stdout: -8197> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000485) clear_dirty_parent 2023-10-03T19:20:48.380 INFO:teuthology.orchestra.run.smithi045.stdout: -8196> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000486) _stored_backtrace v 2986 2023-10-03T19:20:48.380 INFO:teuthology.orchestra.run.smithi045.stdout: -8195> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000486) auth_unpin by 0x55cf62406680 on [inode 0x10000000486 [2,head] /dc-dir/dc-file_657 auth v5316 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.304347+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62406680] now 0 2023-10-03T19:20:48.380 INFO:teuthology.orchestra.run.smithi045.stdout: -8194> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+318 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62406680 count now 1/318 2023-10-03T19:20:48.380 INFO:teuthology.orchestra.run.smithi045.stdout: -8193> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000486) clear_dirty_parent 2023-10-03T19:20:48.380 INFO:teuthology.orchestra.run.smithi045.stdout: -8192> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000487) _stored_backtrace v 2990 2023-10-03T19:20:48.380 INFO:teuthology.orchestra.run.smithi045.stdout: -8191> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000487) auth_unpin by 0x55cf62406c00 on [inode 0x10000000487 [2,head] /dc-dir/dc-file_658 auth v5318 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.315523+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62406c00] now 0 2023-10-03T19:20:48.380 INFO:teuthology.orchestra.run.smithi045.stdout: -8190> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+317 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62406c00 count now 1/317 2023-10-03T19:20:48.380 INFO:teuthology.orchestra.run.smithi045.stdout: -8189> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000487) clear_dirty_parent 2023-10-03T19:20:48.380 INFO:teuthology.orchestra.run.smithi045.stdout: -8188> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000488) _stored_backtrace v 2994 2023-10-03T19:20:48.380 INFO:teuthology.orchestra.run.smithi045.stdout: -8187> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000488) auth_unpin by 0x55cf62407180 on [inode 0x10000000488 [2,head] /dc-dir/dc-file_659 auth v5320 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.325886+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62407180] now 0 2023-10-03T19:20:48.380 INFO:teuthology.orchestra.run.smithi045.stdout: -8186> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+316 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62407180 count now 1/316 2023-10-03T19:20:48.381 INFO:teuthology.orchestra.run.smithi045.stdout: -8185> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000488) clear_dirty_parent 2023-10-03T19:20:48.381 INFO:teuthology.orchestra.run.smithi045.stdout: -8184> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000489) _stored_backtrace v 2998 2023-10-03T19:20:48.381 INFO:teuthology.orchestra.run.smithi045.stdout: -8183> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000489) auth_unpin by 0x55cf62407700 on [inode 0x10000000489 [2,head] /dc-dir/dc-file_660 auth v5322 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.337539+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62407700] now 0 2023-10-03T19:20:48.381 INFO:teuthology.orchestra.run.smithi045.stdout: -8182> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+315 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62407700 count now 1/315 2023-10-03T19:20:48.381 INFO:teuthology.orchestra.run.smithi045.stdout: -8181> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000489) clear_dirty_parent 2023-10-03T19:20:48.381 INFO:teuthology.orchestra.run.smithi045.stdout: -8180> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000048a) _stored_backtrace v 3002 2023-10-03T19:20:48.381 INFO:teuthology.orchestra.run.smithi045.stdout: -8179> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000048a) auth_unpin by 0x55cf62418000 on [inode 0x1000000048a [2,head] /dc-dir/dc-file_661 auth v5324 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.349587+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62418000] now 0 2023-10-03T19:20:48.381 INFO:teuthology.orchestra.run.smithi045.stdout: -8178> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+314 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62418000 count now 1/314 2023-10-03T19:20:48.381 INFO:teuthology.orchestra.run.smithi045.stdout: -8177> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000048a) clear_dirty_parent 2023-10-03T19:20:48.382 INFO:teuthology.orchestra.run.smithi045.stdout: -8176> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000048b) _stored_backtrace v 3006 2023-10-03T19:20:48.382 INFO:teuthology.orchestra.run.smithi045.stdout: -8175> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000048b) auth_unpin by 0x55cf62418580 on [inode 0x1000000048b [2,head] /dc-dir/dc-file_662 auth v5326 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.361033+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62418580] now 0 2023-10-03T19:20:48.382 INFO:teuthology.orchestra.run.smithi045.stdout: -8174> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+313 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62418580 count now 1/313 2023-10-03T19:20:48.382 INFO:teuthology.orchestra.run.smithi045.stdout: -8173> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000048b) clear_dirty_parent 2023-10-03T19:20:48.382 INFO:teuthology.orchestra.run.smithi045.stdout: -8172> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000048c) _stored_backtrace v 3010 2023-10-03T19:20:48.382 INFO:teuthology.orchestra.run.smithi045.stdout: -8171> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000048c) auth_unpin by 0x55cf62418b00 on [inode 0x1000000048c [2,head] /dc-dir/dc-file_663 auth v5328 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.371705+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62418b00] now 0 2023-10-03T19:20:48.382 INFO:teuthology.orchestra.run.smithi045.stdout: -8170> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+312 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62418b00 count now 1/312 2023-10-03T19:20:48.382 INFO:teuthology.orchestra.run.smithi045.stdout: -8169> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000048c) clear_dirty_parent 2023-10-03T19:20:48.382 INFO:teuthology.orchestra.run.smithi045.stdout: -8168> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000048d) _stored_backtrace v 3014 2023-10-03T19:20:48.382 INFO:teuthology.orchestra.run.smithi045.stdout: -8167> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000048d) auth_unpin by 0x55cf62419080 on [inode 0x1000000048d [2,head] /dc-dir/dc-file_664 auth v5330 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.382282+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62419080] now 0 2023-10-03T19:20:48.382 INFO:teuthology.orchestra.run.smithi045.stdout: -8166> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+311 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62419080 count now 1/311 2023-10-03T19:20:48.382 INFO:teuthology.orchestra.run.smithi045.stdout: -8165> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000048d) clear_dirty_parent 2023-10-03T19:20:48.383 INFO:teuthology.orchestra.run.smithi045.stdout: -8164> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000048e) _stored_backtrace v 3018 2023-10-03T19:20:48.383 INFO:teuthology.orchestra.run.smithi045.stdout: -8163> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000048e) auth_unpin by 0x55cf62419600 on [inode 0x1000000048e [2,head] /dc-dir/dc-file_665 auth v5332 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.393282+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62419600] now 0 2023-10-03T19:20:48.383 INFO:teuthology.orchestra.run.smithi045.stdout: -8162> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+310 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62419600 count now 1/310 2023-10-03T19:20:48.383 INFO:teuthology.orchestra.run.smithi045.stdout: -8161> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000048e) clear_dirty_parent 2023-10-03T19:20:48.383 INFO:teuthology.orchestra.run.smithi045.stdout: -8160> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000048f) _stored_backtrace v 3022 2023-10-03T19:20:48.383 INFO:teuthology.orchestra.run.smithi045.stdout: -8159> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000048f) auth_unpin by 0x55cf62419b80 on [inode 0x1000000048f [2,head] /dc-dir/dc-file_666 auth v5334 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.404663+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62419b80] now 0 2023-10-03T19:20:48.383 INFO:teuthology.orchestra.run.smithi045.stdout: -8158> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+309 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62419b80 count now 1/309 2023-10-03T19:20:48.383 INFO:teuthology.orchestra.run.smithi045.stdout: -8157> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000048f) clear_dirty_parent 2023-10-03T19:20:48.383 INFO:teuthology.orchestra.run.smithi045.stdout: -8156> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000490) _stored_backtrace v 3026 2023-10-03T19:20:48.383 INFO:teuthology.orchestra.run.smithi045.stdout: -8155> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000490) auth_unpin by 0x55cf6241a100 on [inode 0x10000000490 [2,head] /dc-dir/dc-file_667 auth v5336 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.416971+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6241a100] now 0 2023-10-03T19:20:48.383 INFO:teuthology.orchestra.run.smithi045.stdout: -8154> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+308 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6241a100 count now 1/308 2023-10-03T19:20:48.383 INFO:teuthology.orchestra.run.smithi045.stdout: -8153> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000490) clear_dirty_parent 2023-10-03T19:20:48.384 INFO:teuthology.orchestra.run.smithi045.stdout: -8152> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000491) _stored_backtrace v 3030 2023-10-03T19:20:48.384 INFO:teuthology.orchestra.run.smithi045.stdout: -8151> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000491) auth_unpin by 0x55cf6241a680 on [inode 0x10000000491 [2,head] /dc-dir/dc-file_668 auth v5338 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.428810+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6241a680] now 0 2023-10-03T19:20:48.384 INFO:teuthology.orchestra.run.smithi045.stdout: -8150> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+307 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6241a680 count now 1/307 2023-10-03T19:20:48.384 INFO:teuthology.orchestra.run.smithi045.stdout: -8149> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000491) clear_dirty_parent 2023-10-03T19:20:48.384 INFO:teuthology.orchestra.run.smithi045.stdout: -8148> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000492) _stored_backtrace v 3034 2023-10-03T19:20:48.384 INFO:teuthology.orchestra.run.smithi045.stdout: -8147> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000492) auth_unpin by 0x55cf6241ac00 on [inode 0x10000000492 [2,head] /dc-dir/dc-file_669 auth v5340 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.440685+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6241ac00] now 0 2023-10-03T19:20:48.384 INFO:teuthology.orchestra.run.smithi045.stdout: -8146> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+306 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6241ac00 count now 1/306 2023-10-03T19:20:48.384 INFO:teuthology.orchestra.run.smithi045.stdout: -8145> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000492) clear_dirty_parent 2023-10-03T19:20:48.384 INFO:teuthology.orchestra.run.smithi045.stdout: -8144> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000493) _stored_backtrace v 3038 2023-10-03T19:20:48.384 INFO:teuthology.orchestra.run.smithi045.stdout: -8143> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000493) auth_unpin by 0x55cf6241b180 on [inode 0x10000000493 [2,head] /dc-dir/dc-file_670 auth v5342 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.452581+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6241b180] now 0 2023-10-03T19:20:48.385 INFO:teuthology.orchestra.run.smithi045.stdout: -8142> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+305 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6241b180 count now 1/305 2023-10-03T19:20:48.385 INFO:teuthology.orchestra.run.smithi045.stdout: -8141> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000493) clear_dirty_parent 2023-10-03T19:20:48.385 INFO:teuthology.orchestra.run.smithi045.stdout: -8140> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000494) _stored_backtrace v 3042 2023-10-03T19:20:48.385 INFO:teuthology.orchestra.run.smithi045.stdout: -8139> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000494) auth_unpin by 0x55cf6241b700 on [inode 0x10000000494 [2,head] /dc-dir/dc-file_671 auth v5344 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.464115+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6241b700] now 0 2023-10-03T19:20:48.385 INFO:teuthology.orchestra.run.smithi045.stdout: -8138> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+304 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6241b700 count now 1/304 2023-10-03T19:20:48.385 INFO:teuthology.orchestra.run.smithi045.stdout: -8137> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000494) clear_dirty_parent 2023-10-03T19:20:48.385 INFO:teuthology.orchestra.run.smithi045.stdout: -8136> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000495) _stored_backtrace v 3046 2023-10-03T19:20:48.385 INFO:teuthology.orchestra.run.smithi045.stdout: -8135> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000495) auth_unpin by 0x55cf62420000 on [inode 0x10000000495 [2,head] /dc-dir/dc-file_672 auth v5346 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.474985+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62420000] now 0 2023-10-03T19:20:48.385 INFO:teuthology.orchestra.run.smithi045.stdout: -8134> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+303 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62420000 count now 1/303 2023-10-03T19:20:48.385 INFO:teuthology.orchestra.run.smithi045.stdout: -8133> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000495) clear_dirty_parent 2023-10-03T19:20:48.385 INFO:teuthology.orchestra.run.smithi045.stdout: -8132> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000496) _stored_backtrace v 3050 2023-10-03T19:20:48.385 INFO:teuthology.orchestra.run.smithi045.stdout: -8131> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000496) auth_unpin by 0x55cf62420580 on [inode 0x10000000496 [2,head] /dc-dir/dc-file_673 auth v5348 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.485814+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62420580] now 0 2023-10-03T19:20:48.386 INFO:teuthology.orchestra.run.smithi045.stdout: -8130> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+302 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62420580 count now 1/302 2023-10-03T19:20:48.386 INFO:teuthology.orchestra.run.smithi045.stdout: -8129> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000496) clear_dirty_parent 2023-10-03T19:20:48.386 INFO:teuthology.orchestra.run.smithi045.stdout: -8128> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000497) _stored_backtrace v 3054 2023-10-03T19:20:48.386 INFO:teuthology.orchestra.run.smithi045.stdout: -8127> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000497) auth_unpin by 0x55cf62420b00 on [inode 0x10000000497 [2,head] /dc-dir/dc-file_674 auth v5350 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.504539+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62420b00] now 0 2023-10-03T19:20:48.386 INFO:teuthology.orchestra.run.smithi045.stdout: -8126> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+301 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62420b00 count now 1/301 2023-10-03T19:20:48.386 INFO:teuthology.orchestra.run.smithi045.stdout: -8125> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000497) clear_dirty_parent 2023-10-03T19:20:48.386 INFO:teuthology.orchestra.run.smithi045.stdout: -8124> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000498) _stored_backtrace v 3228 2023-10-03T19:20:48.386 INFO:teuthology.orchestra.run.smithi045.stdout: -8123> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000498) auth_unpin by 0x55cf62421080 on [inode 0x10000000498 [2,head] /dc-dir/dc-file_675 auth v5352 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.601242+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62421080] now 0 2023-10-03T19:20:48.386 INFO:teuthology.orchestra.run.smithi045.stdout: -8122> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+300 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62421080 count now 1/300 2023-10-03T19:20:48.386 INFO:teuthology.orchestra.run.smithi045.stdout: -8121> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000498) clear_dirty_parent 2023-10-03T19:20:48.386 INFO:teuthology.orchestra.run.smithi045.stdout: -8120> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000499) _stored_backtrace v 3232 2023-10-03T19:20:48.386 INFO:teuthology.orchestra.run.smithi045.stdout: -8119> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000499) auth_unpin by 0x55cf62421600 on [inode 0x10000000499 [2,head] /dc-dir/dc-file_676 auth v5354 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.612272+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62421600] now 0 2023-10-03T19:20:48.387 INFO:teuthology.orchestra.run.smithi045.stdout: -8118> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+299 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62421600 count now 1/299 2023-10-03T19:20:48.387 INFO:teuthology.orchestra.run.smithi045.stdout: -8117> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000499) clear_dirty_parent 2023-10-03T19:20:48.387 INFO:teuthology.orchestra.run.smithi045.stdout: -8116> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000049a) _stored_backtrace v 3236 2023-10-03T19:20:48.387 INFO:teuthology.orchestra.run.smithi045.stdout: -8115> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000049a) auth_unpin by 0x55cf62421b80 on [inode 0x1000000049a [2,head] /dc-dir/dc-file_677 auth v5356 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.623178+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62421b80] now 0 2023-10-03T19:20:48.387 INFO:teuthology.orchestra.run.smithi045.stdout: -8114> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+298 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62421b80 count now 1/298 2023-10-03T19:20:48.387 INFO:teuthology.orchestra.run.smithi045.stdout: -8113> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000049a) clear_dirty_parent 2023-10-03T19:20:48.387 INFO:teuthology.orchestra.run.smithi045.stdout: -8112> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000049b) _stored_backtrace v 3240 2023-10-03T19:20:48.387 INFO:teuthology.orchestra.run.smithi045.stdout: -8111> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000049b) auth_unpin by 0x55cf62422100 on [inode 0x1000000049b [2,head] /dc-dir/dc-file_678 auth v5358 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.634369+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62422100] now 0 2023-10-03T19:20:48.387 INFO:teuthology.orchestra.run.smithi045.stdout: -8110> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+297 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62422100 count now 1/297 2023-10-03T19:20:48.387 INFO:teuthology.orchestra.run.smithi045.stdout: -8109> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000049b) clear_dirty_parent 2023-10-03T19:20:48.387 INFO:teuthology.orchestra.run.smithi045.stdout: -8108> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000049c) _stored_backtrace v 3244 2023-10-03T19:20:48.388 INFO:teuthology.orchestra.run.smithi045.stdout: -8107> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000049c) auth_unpin by 0x55cf62422680 on [inode 0x1000000049c [2,head] /dc-dir/dc-file_679 auth v5360 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.645053+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62422680] now 0 2023-10-03T19:20:48.388 INFO:teuthology.orchestra.run.smithi045.stdout: -8106> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+296 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62422680 count now 1/296 2023-10-03T19:20:48.388 INFO:teuthology.orchestra.run.smithi045.stdout: -8105> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000049c) clear_dirty_parent 2023-10-03T19:20:48.388 INFO:teuthology.orchestra.run.smithi045.stdout: -8104> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000049d) _stored_backtrace v 3248 2023-10-03T19:20:48.388 INFO:teuthology.orchestra.run.smithi045.stdout: -8103> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000049d) auth_unpin by 0x55cf62422c00 on [inode 0x1000000049d [2,head] /dc-dir/dc-file_680 auth v5362 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.657392+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62422c00] now 0 2023-10-03T19:20:48.388 INFO:teuthology.orchestra.run.smithi045.stdout: -8102> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+295 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62422c00 count now 1/295 2023-10-03T19:20:48.388 INFO:teuthology.orchestra.run.smithi045.stdout: -8101> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000049d) clear_dirty_parent 2023-10-03T19:20:48.388 INFO:teuthology.orchestra.run.smithi045.stdout: -8100> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000049e) _stored_backtrace v 3252 2023-10-03T19:20:48.388 INFO:teuthology.orchestra.run.smithi045.stdout: -8099> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000049e) auth_unpin by 0x55cf62423180 on [inode 0x1000000049e [2,head] /dc-dir/dc-file_681 auth v5364 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.668794+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62423180] now 0 2023-10-03T19:20:48.388 INFO:teuthology.orchestra.run.smithi045.stdout: -8098> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+294 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62423180 count now 1/294 2023-10-03T19:20:48.388 INFO:teuthology.orchestra.run.smithi045.stdout: -8097> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000049e) clear_dirty_parent 2023-10-03T19:20:48.388 INFO:teuthology.orchestra.run.smithi045.stdout: -8096> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000049f) _stored_backtrace v 3256 2023-10-03T19:20:48.389 INFO:teuthology.orchestra.run.smithi045.stdout: -8095> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000049f) auth_unpin by 0x55cf62423700 on [inode 0x1000000049f [2,head] /dc-dir/dc-file_682 auth v5366 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.679824+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62423700] now 0 2023-10-03T19:20:48.389 INFO:teuthology.orchestra.run.smithi045.stdout: -8094> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+293 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62423700 count now 1/293 2023-10-03T19:20:48.389 INFO:teuthology.orchestra.run.smithi045.stdout: -8093> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000049f) clear_dirty_parent 2023-10-03T19:20:48.389 INFO:teuthology.orchestra.run.smithi045.stdout: -8092> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004a0) _stored_backtrace v 3260 2023-10-03T19:20:48.389 INFO:teuthology.orchestra.run.smithi045.stdout: -8091> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004a0) auth_unpin by 0x55cf62444000 on [inode 0x100000004a0 [2,head] /dc-dir/dc-file_683 auth v5368 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.691499+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62444000] now 0 2023-10-03T19:20:48.389 INFO:teuthology.orchestra.run.smithi045.stdout: -8090> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+292 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62444000 count now 1/292 2023-10-03T19:20:48.389 INFO:teuthology.orchestra.run.smithi045.stdout: -8089> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004a0) clear_dirty_parent 2023-10-03T19:20:48.389 INFO:teuthology.orchestra.run.smithi045.stdout: -8088> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004a1) _stored_backtrace v 3264 2023-10-03T19:20:48.389 INFO:teuthology.orchestra.run.smithi045.stdout: -8087> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004a1) auth_unpin by 0x55cf62444580 on [inode 0x100000004a1 [2,head] /dc-dir/dc-file_684 auth v5370 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.702434+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62444580] now 0 2023-10-03T19:20:48.389 INFO:teuthology.orchestra.run.smithi045.stdout: -8086> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+291 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62444580 count now 1/291 2023-10-03T19:20:48.389 INFO:teuthology.orchestra.run.smithi045.stdout: -8085> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004a1) clear_dirty_parent 2023-10-03T19:20:48.389 INFO:teuthology.orchestra.run.smithi045.stdout: -8084> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004a2) _stored_backtrace v 3268 2023-10-03T19:20:48.390 INFO:teuthology.orchestra.run.smithi045.stdout: -8083> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004a2) auth_unpin by 0x55cf62444b00 on [inode 0x100000004a2 [2,head] /dc-dir/dc-file_685 auth v5372 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.714241+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62444b00] now 0 2023-10-03T19:20:48.390 INFO:teuthology.orchestra.run.smithi045.stdout: -8082> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+290 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62444b00 count now 1/290 2023-10-03T19:20:48.390 INFO:teuthology.orchestra.run.smithi045.stdout: -8081> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004a2) clear_dirty_parent 2023-10-03T19:20:48.390 INFO:teuthology.orchestra.run.smithi045.stdout: -8080> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004a3) _stored_backtrace v 3272 2023-10-03T19:20:48.390 INFO:teuthology.orchestra.run.smithi045.stdout: -8079> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004a3) auth_unpin by 0x55cf62445080 on [inode 0x100000004a3 [2,head] /dc-dir/dc-file_686 auth v5374 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.725796+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62445080] now 0 2023-10-03T19:20:48.390 INFO:teuthology.orchestra.run.smithi045.stdout: -8078> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+289 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62445080 count now 1/289 2023-10-03T19:20:48.390 INFO:teuthology.orchestra.run.smithi045.stdout: -8077> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004a3) clear_dirty_parent 2023-10-03T19:20:48.390 INFO:teuthology.orchestra.run.smithi045.stdout: -8076> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004a4) _stored_backtrace v 3276 2023-10-03T19:20:48.390 INFO:teuthology.orchestra.run.smithi045.stdout: -8075> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004a4) auth_unpin by 0x55cf62445600 on [inode 0x100000004a4 [2,head] /dc-dir/dc-file_687 auth v5376 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.736228+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62445600] now 0 2023-10-03T19:20:48.394 INFO:teuthology.orchestra.run.smithi045.stdout: -8074> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+288 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62445600 count now 1/288 2023-10-03T19:20:48.394 INFO:teuthology.orchestra.run.smithi045.stdout: -8073> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004a4) clear_dirty_parent 2023-10-03T19:20:48.394 INFO:teuthology.orchestra.run.smithi045.stdout: -8072> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004a5) _stored_backtrace v 3280 2023-10-03T19:20:48.394 INFO:teuthology.orchestra.run.smithi045.stdout: -8071> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004a5) auth_unpin by 0x55cf62445b80 on [inode 0x100000004a5 [2,head] /dc-dir/dc-file_688 auth v5378 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.747185+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62445b80] now 0 2023-10-03T19:20:48.394 INFO:teuthology.orchestra.run.smithi045.stdout: -8070> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+287 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62445b80 count now 1/287 2023-10-03T19:20:48.394 INFO:teuthology.orchestra.run.smithi045.stdout: -8069> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004a5) clear_dirty_parent 2023-10-03T19:20:48.394 INFO:teuthology.orchestra.run.smithi045.stdout: -8068> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004a6) _stored_backtrace v 3284 2023-10-03T19:20:48.394 INFO:teuthology.orchestra.run.smithi045.stdout: -8067> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004a6) auth_unpin by 0x55cf62446100 on [inode 0x100000004a6 [2,head] /dc-dir/dc-file_689 auth v5380 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.758138+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62446100] now 0 2023-10-03T19:20:48.394 INFO:teuthology.orchestra.run.smithi045.stdout: -8066> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+286 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62446100 count now 1/286 2023-10-03T19:20:48.395 INFO:teuthology.orchestra.run.smithi045.stdout: -8065> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004a6) clear_dirty_parent 2023-10-03T19:20:48.395 INFO:teuthology.orchestra.run.smithi045.stdout: -8064> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004a7) _stored_backtrace v 3288 2023-10-03T19:20:48.395 INFO:teuthology.orchestra.run.smithi045.stdout: -8063> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004a7) auth_unpin by 0x55cf62446680 on [inode 0x100000004a7 [2,head] /dc-dir/dc-file_690 auth v5382 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.769264+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62446680] now 0 2023-10-03T19:20:48.395 INFO:teuthology.orchestra.run.smithi045.stdout: -8062> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+285 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62446680 count now 1/285 2023-10-03T19:20:48.395 INFO:teuthology.orchestra.run.smithi045.stdout: -8061> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004a7) clear_dirty_parent 2023-10-03T19:20:48.395 INFO:teuthology.orchestra.run.smithi045.stdout: -8060> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004a8) _stored_backtrace v 3292 2023-10-03T19:20:48.395 INFO:teuthology.orchestra.run.smithi045.stdout: -8059> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004a8) auth_unpin by 0x55cf62446c00 on [inode 0x100000004a8 [2,head] /dc-dir/dc-file_691 auth v5384 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.780934+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62446c00] now 0 2023-10-03T19:20:48.395 INFO:teuthology.orchestra.run.smithi045.stdout: -8058> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+284 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62446c00 count now 1/284 2023-10-03T19:20:48.395 INFO:teuthology.orchestra.run.smithi045.stdout: -8057> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004a8) clear_dirty_parent 2023-10-03T19:20:48.395 INFO:teuthology.orchestra.run.smithi045.stdout: -8056> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004a9) _stored_backtrace v 3296 2023-10-03T19:20:48.395 INFO:teuthology.orchestra.run.smithi045.stdout: -8055> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004a9) auth_unpin by 0x55cf62447180 on [inode 0x100000004a9 [2,head] /dc-dir/dc-file_692 auth v5386 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.792361+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62447180] now 0 2023-10-03T19:20:48.395 INFO:teuthology.orchestra.run.smithi045.stdout: -8054> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+283 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62447180 count now 1/283 2023-10-03T19:20:48.396 INFO:teuthology.orchestra.run.smithi045.stdout: -8053> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004a9) clear_dirty_parent 2023-10-03T19:20:48.396 INFO:teuthology.orchestra.run.smithi045.stdout: -8052> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004aa) _stored_backtrace v 3300 2023-10-03T19:20:48.396 INFO:teuthology.orchestra.run.smithi045.stdout: -8051> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004aa) auth_unpin by 0x55cf62447700 on [inode 0x100000004aa [2,head] /dc-dir/dc-file_693 auth v5388 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.803191+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62447700] now 0 2023-10-03T19:20:48.396 INFO:teuthology.orchestra.run.smithi045.stdout: -8050> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+282 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62447700 count now 1/282 2023-10-03T19:20:48.396 INFO:teuthology.orchestra.run.smithi045.stdout: -8049> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004aa) clear_dirty_parent 2023-10-03T19:20:48.396 INFO:teuthology.orchestra.run.smithi045.stdout: -8048> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ab) _stored_backtrace v 3304 2023-10-03T19:20:48.396 INFO:teuthology.orchestra.run.smithi045.stdout: -8047> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ab) auth_unpin by 0x55cf62434000 on [inode 0x100000004ab [2,head] /dc-dir/dc-file_694 auth v5390 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.814512+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62434000] now 0 2023-10-03T19:20:48.396 INFO:teuthology.orchestra.run.smithi045.stdout: -8046> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+281 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62434000 count now 1/281 2023-10-03T19:20:48.396 INFO:teuthology.orchestra.run.smithi045.stdout: -8045> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ab) clear_dirty_parent 2023-10-03T19:20:48.396 INFO:teuthology.orchestra.run.smithi045.stdout: -8044> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ac) _stored_backtrace v 3308 2023-10-03T19:20:48.397 INFO:teuthology.orchestra.run.smithi045.stdout: -8043> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ac) auth_unpin by 0x55cf62434580 on [inode 0x100000004ac [2,head] /dc-dir/dc-file_695 auth v5392 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.827423+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62434580] now 0 2023-10-03T19:20:48.397 INFO:teuthology.orchestra.run.smithi045.stdout: -8042> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+280 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62434580 count now 1/280 2023-10-03T19:20:48.397 INFO:teuthology.orchestra.run.smithi045.stdout: -8041> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ac) clear_dirty_parent 2023-10-03T19:20:48.397 INFO:teuthology.orchestra.run.smithi045.stdout: -8040> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ad) _stored_backtrace v 3312 2023-10-03T19:20:48.397 INFO:teuthology.orchestra.run.smithi045.stdout: -8039> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ad) auth_unpin by 0x55cf62434b00 on [inode 0x100000004ad [2,head] /dc-dir/dc-file_696 auth v5394 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.839584+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62434b00] now 0 2023-10-03T19:20:48.397 INFO:teuthology.orchestra.run.smithi045.stdout: -8038> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+279 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62434b00 count now 1/279 2023-10-03T19:20:48.397 INFO:teuthology.orchestra.run.smithi045.stdout: -8037> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ad) clear_dirty_parent 2023-10-03T19:20:48.397 INFO:teuthology.orchestra.run.smithi045.stdout: -8036> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ae) _stored_backtrace v 3316 2023-10-03T19:20:48.397 INFO:teuthology.orchestra.run.smithi045.stdout: -8035> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ae) auth_unpin by 0x55cf62435080 on [inode 0x100000004ae [2,head] /dc-dir/dc-file_697 auth v5396 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.850586+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62435080] now 0 2023-10-03T19:20:48.397 INFO:teuthology.orchestra.run.smithi045.stdout: -8034> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+278 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62435080 count now 1/278 2023-10-03T19:20:48.397 INFO:teuthology.orchestra.run.smithi045.stdout: -8033> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ae) clear_dirty_parent 2023-10-03T19:20:48.397 INFO:teuthology.orchestra.run.smithi045.stdout: -8032> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004af) _stored_backtrace v 3320 2023-10-03T19:20:48.397 INFO:teuthology.orchestra.run.smithi045.stdout: -8031> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004af) auth_unpin by 0x55cf62435600 on [inode 0x100000004af [2,head] /dc-dir/dc-file_698 auth v5398 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.861511+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62435600] now 0 2023-10-03T19:20:48.398 INFO:teuthology.orchestra.run.smithi045.stdout: -8030> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+277 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62435600 count now 1/277 2023-10-03T19:20:48.398 INFO:teuthology.orchestra.run.smithi045.stdout: -8029> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004af) clear_dirty_parent 2023-10-03T19:20:48.398 INFO:teuthology.orchestra.run.smithi045.stdout: -8028> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004b0) _stored_backtrace v 3324 2023-10-03T19:20:48.398 INFO:teuthology.orchestra.run.smithi045.stdout: -8027> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004b0) auth_unpin by 0x55cf62435b80 on [inode 0x100000004b0 [2,head] /dc-dir/dc-file_699 auth v5400 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.872625+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62435b80] now 0 2023-10-03T19:20:48.398 INFO:teuthology.orchestra.run.smithi045.stdout: -8026> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+276 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62435b80 count now 1/276 2023-10-03T19:20:48.398 INFO:teuthology.orchestra.run.smithi045.stdout: -8025> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004b0) clear_dirty_parent 2023-10-03T19:20:48.398 INFO:teuthology.orchestra.run.smithi045.stdout: -8024> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004b1) _stored_backtrace v 3328 2023-10-03T19:20:48.398 INFO:teuthology.orchestra.run.smithi045.stdout: -8023> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004b1) auth_unpin by 0x55cf62436100 on [inode 0x100000004b1 [2,head] /dc-dir/dc-file_700 auth v5402 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.883533+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62436100] now 0 2023-10-03T19:20:48.398 INFO:teuthology.orchestra.run.smithi045.stdout: -8022> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+275 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62436100 count now 1/275 2023-10-03T19:20:48.398 INFO:teuthology.orchestra.run.smithi045.stdout: -8021> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004b1) clear_dirty_parent 2023-10-03T19:20:48.398 INFO:teuthology.orchestra.run.smithi045.stdout: -8020> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004b2) _stored_backtrace v 3332 2023-10-03T19:20:48.399 INFO:teuthology.orchestra.run.smithi045.stdout: -8019> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004b2) auth_unpin by 0x55cf62436680 on [inode 0x100000004b2 [2,head] /dc-dir/dc-file_701 auth v5404 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.893801+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62436680] now 0 2023-10-03T19:20:48.399 INFO:teuthology.orchestra.run.smithi045.stdout: -8018> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+274 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62436680 count now 1/274 2023-10-03T19:20:48.399 INFO:teuthology.orchestra.run.smithi045.stdout: -8017> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004b2) clear_dirty_parent 2023-10-03T19:20:48.399 INFO:teuthology.orchestra.run.smithi045.stdout: -8016> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004b3) _stored_backtrace v 3336 2023-10-03T19:20:48.399 INFO:teuthology.orchestra.run.smithi045.stdout: -8015> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004b3) auth_unpin by 0x55cf62436c00 on [inode 0x100000004b3 [2,head] /dc-dir/dc-file_702 auth v5406 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.905503+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62436c00] now 0 2023-10-03T19:20:48.399 INFO:teuthology.orchestra.run.smithi045.stdout: -8014> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+273 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62436c00 count now 1/273 2023-10-03T19:20:48.399 INFO:teuthology.orchestra.run.smithi045.stdout: -8013> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004b3) clear_dirty_parent 2023-10-03T19:20:48.399 INFO:teuthology.orchestra.run.smithi045.stdout: -8012> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004b4) _stored_backtrace v 3340 2023-10-03T19:20:48.399 INFO:teuthology.orchestra.run.smithi045.stdout: -8011> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004b4) auth_unpin by 0x55cf62437180 on [inode 0x100000004b4 [2,head] /dc-dir/dc-file_703 auth v5408 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.916256+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62437180] now 0 2023-10-03T19:20:48.399 INFO:teuthology.orchestra.run.smithi045.stdout: -8010> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+272 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62437180 count now 1/272 2023-10-03T19:20:48.400 INFO:teuthology.orchestra.run.smithi045.stdout: -8009> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004b4) clear_dirty_parent 2023-10-03T19:20:48.400 INFO:teuthology.orchestra.run.smithi045.stdout: -8008> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004b5) _stored_backtrace v 3344 2023-10-03T19:20:48.400 INFO:teuthology.orchestra.run.smithi045.stdout: -8007> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004b5) auth_unpin by 0x55cf62437700 on [inode 0x100000004b5 [2,head] /dc-dir/dc-file_704 auth v5410 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.927021+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62437700] now 0 2023-10-03T19:20:48.400 INFO:teuthology.orchestra.run.smithi045.stdout: -8006> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+271 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62437700 count now 1/271 2023-10-03T19:20:48.499 INFO:teuthology.orchestra.run.smithi045.stdout: -8005> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004b5) clear_dirty_parent 2023-10-03T19:20:48.499 INFO:teuthology.orchestra.run.smithi045.stdout: -8004> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004b6) _stored_backtrace v 3348 2023-10-03T19:20:48.499 INFO:teuthology.orchestra.run.smithi045.stdout: -8003> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004b6) auth_unpin by 0x55cf62454000 on [inode 0x100000004b6 [2,head] /dc-dir/dc-file_705 auth v5412 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.937642+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62454000] now 0 2023-10-03T19:20:48.499 INFO:teuthology.orchestra.run.smithi045.stdout: -8002> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+270 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62454000 count now 1/270 2023-10-03T19:20:48.499 INFO:teuthology.orchestra.run.smithi045.stdout: -8001> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004b6) clear_dirty_parent 2023-10-03T19:20:48.499 INFO:teuthology.orchestra.run.smithi045.stdout: -8000> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004b7) _stored_backtrace v 3352 2023-10-03T19:20:48.499 INFO:teuthology.orchestra.run.smithi045.stdout: -7999> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004b7) auth_unpin by 0x55cf62454580 on [inode 0x100000004b7 [2,head] /dc-dir/dc-file_706 auth v5414 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.948402+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62454580] now 0 2023-10-03T19:20:48.499 INFO:teuthology.orchestra.run.smithi045.stdout: -7998> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+269 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62454580 count now 1/269 2023-10-03T19:20:48.499 INFO:teuthology.orchestra.run.smithi045.stdout: -7997> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004b7) clear_dirty_parent 2023-10-03T19:20:48.499 INFO:teuthology.orchestra.run.smithi045.stdout: -7996> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004b8) _stored_backtrace v 3356 2023-10-03T19:20:48.499 INFO:teuthology.orchestra.run.smithi045.stdout: -7995> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004b8) auth_unpin by 0x55cf62454b00 on [inode 0x100000004b8 [2,head] /dc-dir/dc-file_707 auth v5416 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.959279+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62454b00] now 0 2023-10-03T19:20:48.500 INFO:teuthology.orchestra.run.smithi045.stdout: -7994> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+268 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62454b00 count now 1/268 2023-10-03T19:20:48.500 INFO:teuthology.orchestra.run.smithi045.stdout: -7993> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004b8) clear_dirty_parent 2023-10-03T19:20:48.500 INFO:teuthology.orchestra.run.smithi045.stdout: -7992> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004b9) _stored_backtrace v 3360 2023-10-03T19:20:48.500 INFO:teuthology.orchestra.run.smithi045.stdout: -7991> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004b9) auth_unpin by 0x55cf62455080 on [inode 0x100000004b9 [2,head] /dc-dir/dc-file_708 auth v5418 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.970731+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62455080] now 0 2023-10-03T19:20:48.500 INFO:teuthology.orchestra.run.smithi045.stdout: -7990> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+267 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62455080 count now 1/267 2023-10-03T19:20:48.500 INFO:teuthology.orchestra.run.smithi045.stdout: -7989> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004b9) clear_dirty_parent 2023-10-03T19:20:48.500 INFO:teuthology.orchestra.run.smithi045.stdout: -7988> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ba) _stored_backtrace v 3364 2023-10-03T19:20:48.500 INFO:teuthology.orchestra.run.smithi045.stdout: -7987> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ba) auth_unpin by 0x55cf62455600 on [inode 0x100000004ba [2,head] /dc-dir/dc-file_709 auth v5420 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.983182+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62455600] now 0 2023-10-03T19:20:48.500 INFO:teuthology.orchestra.run.smithi045.stdout: -7986> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+266 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62455600 count now 1/266 2023-10-03T19:20:48.500 INFO:teuthology.orchestra.run.smithi045.stdout: -7985> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ba) clear_dirty_parent 2023-10-03T19:20:48.500 INFO:teuthology.orchestra.run.smithi045.stdout: -7984> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004bb) _stored_backtrace v 3368 2023-10-03T19:20:48.501 INFO:teuthology.orchestra.run.smithi045.stdout: -7983> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004bb) auth_unpin by 0x55cf62455b80 on [inode 0x100000004bb [2,head] /dc-dir/dc-file_710 auth v5422 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:42.995104+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62455b80] now 0 2023-10-03T19:20:48.501 INFO:teuthology.orchestra.run.smithi045.stdout: -7982> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+265 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62455b80 count now 1/265 2023-10-03T19:20:48.501 INFO:teuthology.orchestra.run.smithi045.stdout: -7981> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004bb) clear_dirty_parent 2023-10-03T19:20:48.501 INFO:teuthology.orchestra.run.smithi045.stdout: -7980> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004bc) _stored_backtrace v 3372 2023-10-03T19:20:48.501 INFO:teuthology.orchestra.run.smithi045.stdout: -7979> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004bc) auth_unpin by 0x55cf62456100 on [inode 0x100000004bc [2,head] /dc-dir/dc-file_711 auth v5424 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.007236+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62456100] now 0 2023-10-03T19:20:48.501 INFO:teuthology.orchestra.run.smithi045.stdout: -7978> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+264 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62456100 count now 1/264 2023-10-03T19:20:48.501 INFO:teuthology.orchestra.run.smithi045.stdout: -7977> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004bc) clear_dirty_parent 2023-10-03T19:20:48.501 INFO:teuthology.orchestra.run.smithi045.stdout: -7976> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004bd) _stored_backtrace v 3376 2023-10-03T19:20:48.501 INFO:teuthology.orchestra.run.smithi045.stdout: -7975> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004bd) auth_unpin by 0x55cf62456680 on [inode 0x100000004bd [2,head] /dc-dir/dc-file_712 auth v5426 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.019864+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62456680] now 0 2023-10-03T19:20:48.502 INFO:teuthology.orchestra.run.smithi045.stdout: -7974> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+263 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62456680 count now 1/263 2023-10-03T19:20:48.502 INFO:teuthology.orchestra.run.smithi045.stdout: -7973> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004bd) clear_dirty_parent 2023-10-03T19:20:48.502 INFO:teuthology.orchestra.run.smithi045.stdout: -7972> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004be) _stored_backtrace v 3380 2023-10-03T19:20:48.502 INFO:teuthology.orchestra.run.smithi045.stdout: -7971> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004be) auth_unpin by 0x55cf62456c00 on [inode 0x100000004be [2,head] /dc-dir/dc-file_713 auth v5428 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.032114+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62456c00] now 0 2023-10-03T19:20:48.502 INFO:teuthology.orchestra.run.smithi045.stdout: -7970> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+262 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62456c00 count now 1/262 2023-10-03T19:20:48.502 INFO:teuthology.orchestra.run.smithi045.stdout: -7969> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004be) clear_dirty_parent 2023-10-03T19:20:48.502 INFO:teuthology.orchestra.run.smithi045.stdout: -7968> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004bf) _stored_backtrace v 3384 2023-10-03T19:20:48.502 INFO:teuthology.orchestra.run.smithi045.stdout: -7967> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004bf) auth_unpin by 0x55cf62457180 on [inode 0x100000004bf [2,head] /dc-dir/dc-file_714 auth v5430 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.044675+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62457180] now 0 2023-10-03T19:20:48.502 INFO:teuthology.orchestra.run.smithi045.stdout: -7966> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+261 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62457180 count now 1/261 2023-10-03T19:20:48.502 INFO:teuthology.orchestra.run.smithi045.stdout: -7965> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004bf) clear_dirty_parent 2023-10-03T19:20:48.502 INFO:teuthology.orchestra.run.smithi045.stdout: -7964> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004c0) _stored_backtrace v 3388 2023-10-03T19:20:48.503 INFO:teuthology.orchestra.run.smithi045.stdout: -7963> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004c0) auth_unpin by 0x55cf62457700 on [inode 0x100000004c0 [2,head] /dc-dir/dc-file_715 auth v5432 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.056617+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62457700] now 0 2023-10-03T19:20:48.503 INFO:teuthology.orchestra.run.smithi045.stdout: -7962> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+260 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62457700 count now 1/260 2023-10-03T19:20:48.503 INFO:teuthology.orchestra.run.smithi045.stdout: -7961> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004c0) clear_dirty_parent 2023-10-03T19:20:48.503 INFO:teuthology.orchestra.run.smithi045.stdout: -7960> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004c1) _stored_backtrace v 3392 2023-10-03T19:20:48.503 INFO:teuthology.orchestra.run.smithi045.stdout: -7959> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004c1) auth_unpin by 0x55cf6245c000 on [inode 0x100000004c1 [2,head] /dc-dir/dc-file_716 auth v5434 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.068645+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6245c000] now 0 2023-10-03T19:20:48.503 INFO:teuthology.orchestra.run.smithi045.stdout: -7958> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+259 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6245c000 count now 1/259 2023-10-03T19:20:48.503 INFO:teuthology.orchestra.run.smithi045.stdout: -7957> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004c1) clear_dirty_parent 2023-10-03T19:20:48.503 INFO:teuthology.orchestra.run.smithi045.stdout: -7956> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004c2) _stored_backtrace v 3396 2023-10-03T19:20:48.503 INFO:teuthology.orchestra.run.smithi045.stdout: -7955> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004c2) auth_unpin by 0x55cf6245c580 on [inode 0x100000004c2 [2,head] /dc-dir/dc-file_717 auth v5436 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.080578+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6245c580] now 0 2023-10-03T19:20:48.503 INFO:teuthology.orchestra.run.smithi045.stdout: -7954> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+258 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6245c580 count now 1/258 2023-10-03T19:20:48.503 INFO:teuthology.orchestra.run.smithi045.stdout: -7953> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004c2) clear_dirty_parent 2023-10-03T19:20:48.503 INFO:teuthology.orchestra.run.smithi045.stdout: -7952> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004c3) _stored_backtrace v 3400 2023-10-03T19:20:48.504 INFO:teuthology.orchestra.run.smithi045.stdout: -7951> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004c3) auth_unpin by 0x55cf6245cb00 on [inode 0x100000004c3 [2,head] /dc-dir/dc-file_718 auth v5438 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.092782+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6245cb00] now 0 2023-10-03T19:20:48.504 INFO:teuthology.orchestra.run.smithi045.stdout: -7950> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+257 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6245cb00 count now 1/257 2023-10-03T19:20:48.504 INFO:teuthology.orchestra.run.smithi045.stdout: -7949> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004c3) clear_dirty_parent 2023-10-03T19:20:48.504 INFO:teuthology.orchestra.run.smithi045.stdout: -7948> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004c4) _stored_backtrace v 3404 2023-10-03T19:20:48.504 INFO:teuthology.orchestra.run.smithi045.stdout: -7947> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004c4) auth_unpin by 0x55cf6245d080 on [inode 0x100000004c4 [2,head] /dc-dir/dc-file_719 auth v5440 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.104676+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6245d080] now 0 2023-10-03T19:20:48.504 INFO:teuthology.orchestra.run.smithi045.stdout: -7946> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+256 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6245d080 count now 1/256 2023-10-03T19:20:48.504 INFO:teuthology.orchestra.run.smithi045.stdout: -7945> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004c4) clear_dirty_parent 2023-10-03T19:20:48.504 INFO:teuthology.orchestra.run.smithi045.stdout: -7944> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004c5) _stored_backtrace v 3408 2023-10-03T19:20:48.504 INFO:teuthology.orchestra.run.smithi045.stdout: -7943> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004c5) auth_unpin by 0x55cf6245d600 on [inode 0x100000004c5 [2,head] /dc-dir/dc-file_720 auth v5442 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.115900+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6245d600] now 0 2023-10-03T19:20:48.507 INFO:teuthology.orchestra.run.smithi045.stdout: -7942> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+255 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6245d600 count now 1/255 2023-10-03T19:20:48.508 INFO:teuthology.orchestra.run.smithi045.stdout: -7941> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004c5) clear_dirty_parent 2023-10-03T19:20:48.508 INFO:teuthology.orchestra.run.smithi045.stdout: -7940> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004c6) _stored_backtrace v 3412 2023-10-03T19:20:48.508 INFO:teuthology.orchestra.run.smithi045.stdout: -7939> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004c6) auth_unpin by 0x55cf6245db80 on [inode 0x100000004c6 [2,head] /dc-dir/dc-file_721 auth v5444 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.126968+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6245db80] now 0 2023-10-03T19:20:48.508 INFO:teuthology.orchestra.run.smithi045.stdout: -7938> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+254 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6245db80 count now 1/254 2023-10-03T19:20:48.508 INFO:teuthology.orchestra.run.smithi045.stdout: -7937> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004c6) clear_dirty_parent 2023-10-03T19:20:48.508 INFO:teuthology.orchestra.run.smithi045.stdout: -7936> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004c7) _stored_backtrace v 3416 2023-10-03T19:20:48.508 INFO:teuthology.orchestra.run.smithi045.stdout: -7935> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004c7) auth_unpin by 0x55cf6245e100 on [inode 0x100000004c7 [2,head] /dc-dir/dc-file_722 auth v5446 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.138338+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6245e100] now 0 2023-10-03T19:20:48.508 INFO:teuthology.orchestra.run.smithi045.stdout: -7934> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+253 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6245e100 count now 1/253 2023-10-03T19:20:48.508 INFO:teuthology.orchestra.run.smithi045.stdout: -7933> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004c7) clear_dirty_parent 2023-10-03T19:20:48.508 INFO:teuthology.orchestra.run.smithi045.stdout: -7932> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004c8) _stored_backtrace v 3420 2023-10-03T19:20:48.509 INFO:teuthology.orchestra.run.smithi045.stdout: -7931> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004c8) auth_unpin by 0x55cf6245e680 on [inode 0x100000004c8 [2,head] /dc-dir/dc-file_723 auth v5448 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.150633+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6245e680] now 0 2023-10-03T19:20:48.509 INFO:teuthology.orchestra.run.smithi045.stdout: -7930> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+252 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6245e680 count now 1/252 2023-10-03T19:20:48.509 INFO:teuthology.orchestra.run.smithi045.stdout: -7929> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004c8) clear_dirty_parent 2023-10-03T19:20:48.509 INFO:teuthology.orchestra.run.smithi045.stdout: -7928> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004c9) _stored_backtrace v 3424 2023-10-03T19:20:48.509 INFO:teuthology.orchestra.run.smithi045.stdout: -7927> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004c9) auth_unpin by 0x55cf6245ec00 on [inode 0x100000004c9 [2,head] /dc-dir/dc-file_724 auth v5450 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.163155+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6245ec00] now 0 2023-10-03T19:20:48.509 INFO:teuthology.orchestra.run.smithi045.stdout: -7926> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+251 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6245ec00 count now 1/251 2023-10-03T19:20:48.509 INFO:teuthology.orchestra.run.smithi045.stdout: -7925> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004c9) clear_dirty_parent 2023-10-03T19:20:48.509 INFO:teuthology.orchestra.run.smithi045.stdout: -7924> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ca) _stored_backtrace v 3428 2023-10-03T19:20:48.509 INFO:teuthology.orchestra.run.smithi045.stdout: -7923> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ca) auth_unpin by 0x55cf6245f180 on [inode 0x100000004ca [2,head] /dc-dir/dc-file_725 auth v5452 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.174391+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6245f180] now 0 2023-10-03T19:20:48.509 INFO:teuthology.orchestra.run.smithi045.stdout: -7922> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+250 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6245f180 count now 1/250 2023-10-03T19:20:48.509 INFO:teuthology.orchestra.run.smithi045.stdout: -7921> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ca) clear_dirty_parent 2023-10-03T19:20:48.509 INFO:teuthology.orchestra.run.smithi045.stdout: -7920> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004cb) _stored_backtrace v 3432 2023-10-03T19:20:48.510 INFO:teuthology.orchestra.run.smithi045.stdout: -7919> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004cb) auth_unpin by 0x55cf6245f700 on [inode 0x100000004cb [2,head] /dc-dir/dc-file_726 auth v5454 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.185696+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6245f700] now 0 2023-10-03T19:20:48.510 INFO:teuthology.orchestra.run.smithi045.stdout: -7918> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+249 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6245f700 count now 1/249 2023-10-03T19:20:48.510 INFO:teuthology.orchestra.run.smithi045.stdout: -7917> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004cb) clear_dirty_parent 2023-10-03T19:20:48.510 INFO:teuthology.orchestra.run.smithi045.stdout: -7916> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004cc) _stored_backtrace v 3436 2023-10-03T19:20:48.510 INFO:teuthology.orchestra.run.smithi045.stdout: -7915> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004cc) auth_unpin by 0x55cf62468000 on [inode 0x100000004cc [2,head] /dc-dir/dc-file_727 auth v5456 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.197645+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62468000] now 0 2023-10-03T19:20:48.510 INFO:teuthology.orchestra.run.smithi045.stdout: -7914> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+248 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62468000 count now 1/248 2023-10-03T19:20:48.510 INFO:teuthology.orchestra.run.smithi045.stdout: -7913> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004cc) clear_dirty_parent 2023-10-03T19:20:48.510 INFO:teuthology.orchestra.run.smithi045.stdout: -7912> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004cd) _stored_backtrace v 3440 2023-10-03T19:20:48.510 INFO:teuthology.orchestra.run.smithi045.stdout: -7911> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004cd) auth_unpin by 0x55cf62468580 on [inode 0x100000004cd [2,head] /dc-dir/dc-file_728 auth v5458 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.209698+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62468580] now 0 2023-10-03T19:20:48.511 INFO:teuthology.orchestra.run.smithi045.stdout: -7910> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+247 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62468580 count now 1/247 2023-10-03T19:20:48.511 INFO:teuthology.orchestra.run.smithi045.stdout: -7909> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004cd) clear_dirty_parent 2023-10-03T19:20:48.511 INFO:teuthology.orchestra.run.smithi045.stdout: -7908> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ce) _stored_backtrace v 3444 2023-10-03T19:20:48.511 INFO:teuthology.orchestra.run.smithi045.stdout: -7907> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ce) auth_unpin by 0x55cf62468b00 on [inode 0x100000004ce [2,head] /dc-dir/dc-file_729 auth v5460 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.221199+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62468b00] now 0 2023-10-03T19:20:48.511 INFO:teuthology.orchestra.run.smithi045.stdout: -7906> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+246 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62468b00 count now 1/246 2023-10-03T19:20:48.511 INFO:teuthology.orchestra.run.smithi045.stdout: -7905> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ce) clear_dirty_parent 2023-10-03T19:20:48.511 INFO:teuthology.orchestra.run.smithi045.stdout: -7904> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004cf) _stored_backtrace v 3448 2023-10-03T19:20:48.511 INFO:teuthology.orchestra.run.smithi045.stdout: -7903> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004cf) auth_unpin by 0x55cf62469080 on [inode 0x100000004cf [2,head] /dc-dir/dc-file_730 auth v5462 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.232353+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62469080] now 0 2023-10-03T19:20:48.511 INFO:teuthology.orchestra.run.smithi045.stdout: -7902> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+245 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62469080 count now 1/245 2023-10-03T19:20:48.511 INFO:teuthology.orchestra.run.smithi045.stdout: -7901> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004cf) clear_dirty_parent 2023-10-03T19:20:48.511 INFO:teuthology.orchestra.run.smithi045.stdout: -7900> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004d0) _stored_backtrace v 3452 2023-10-03T19:20:48.512 INFO:teuthology.orchestra.run.smithi045.stdout: -7899> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004d0) auth_unpin by 0x55cf62469600 on [inode 0x100000004d0 [2,head] /dc-dir/dc-file_731 auth v5464 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.245041+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62469600] now 0 2023-10-03T19:20:48.512 INFO:teuthology.orchestra.run.smithi045.stdout: -7898> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+244 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62469600 count now 1/244 2023-10-03T19:20:48.512 INFO:teuthology.orchestra.run.smithi045.stdout: -7897> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004d0) clear_dirty_parent 2023-10-03T19:20:48.512 INFO:teuthology.orchestra.run.smithi045.stdout: -7896> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004d1) _stored_backtrace v 3456 2023-10-03T19:20:48.512 INFO:teuthology.orchestra.run.smithi045.stdout: -7895> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004d1) auth_unpin by 0x55cf62469b80 on [inode 0x100000004d1 [2,head] /dc-dir/dc-file_732 auth v5466 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.256483+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62469b80] now 0 2023-10-03T19:20:48.512 INFO:teuthology.orchestra.run.smithi045.stdout: -7894> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+243 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62469b80 count now 1/243 2023-10-03T19:20:48.512 INFO:teuthology.orchestra.run.smithi045.stdout: -7893> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004d1) clear_dirty_parent 2023-10-03T19:20:48.512 INFO:teuthology.orchestra.run.smithi045.stdout: -7892> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004d2) _stored_backtrace v 3460 2023-10-03T19:20:48.512 INFO:teuthology.orchestra.run.smithi045.stdout: -7891> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004d2) auth_unpin by 0x55cf6246a100 on [inode 0x100000004d2 [2,head] /dc-dir/dc-file_733 auth v5468 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.269559+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6246a100] now 0 2023-10-03T19:20:48.512 INFO:teuthology.orchestra.run.smithi045.stdout: -7890> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+242 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6246a100 count now 1/242 2023-10-03T19:20:48.512 INFO:teuthology.orchestra.run.smithi045.stdout: -7889> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004d2) clear_dirty_parent 2023-10-03T19:20:48.513 INFO:teuthology.orchestra.run.smithi045.stdout: -7888> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004d3) _stored_backtrace v 3464 2023-10-03T19:20:48.513 INFO:teuthology.orchestra.run.smithi045.stdout: -7887> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004d3) auth_unpin by 0x55cf6246a680 on [inode 0x100000004d3 [2,head] /dc-dir/dc-file_734 auth v5470 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.281792+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6246a680] now 0 2023-10-03T19:20:48.513 INFO:teuthology.orchestra.run.smithi045.stdout: -7886> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+241 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6246a680 count now 1/241 2023-10-03T19:20:48.513 INFO:teuthology.orchestra.run.smithi045.stdout: -7885> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004d3) clear_dirty_parent 2023-10-03T19:20:48.513 INFO:teuthology.orchestra.run.smithi045.stdout: -7884> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004d4) _stored_backtrace v 3468 2023-10-03T19:20:48.513 INFO:teuthology.orchestra.run.smithi045.stdout: -7883> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004d4) auth_unpin by 0x55cf6246ac00 on [inode 0x100000004d4 [2,head] /dc-dir/dc-file_735 auth v5472 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.292872+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6246ac00] now 0 2023-10-03T19:20:48.513 INFO:teuthology.orchestra.run.smithi045.stdout: -7882> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+240 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6246ac00 count now 1/240 2023-10-03T19:20:48.513 INFO:teuthology.orchestra.run.smithi045.stdout: -7881> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004d4) clear_dirty_parent 2023-10-03T19:20:48.513 INFO:teuthology.orchestra.run.smithi045.stdout: -7880> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004d5) _stored_backtrace v 3472 2023-10-03T19:20:48.513 INFO:teuthology.orchestra.run.smithi045.stdout: -7879> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004d5) auth_unpin by 0x55cf6246b180 on [inode 0x100000004d5 [2,head] /dc-dir/dc-file_736 auth v5474 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.304063+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6246b180] now 0 2023-10-03T19:20:48.513 INFO:teuthology.orchestra.run.smithi045.stdout: -7878> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+239 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6246b180 count now 1/239 2023-10-03T19:20:48.514 INFO:teuthology.orchestra.run.smithi045.stdout: -7877> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004d5) clear_dirty_parent 2023-10-03T19:20:48.514 INFO:teuthology.orchestra.run.smithi045.stdout: -7876> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004d6) _stored_backtrace v 3476 2023-10-03T19:20:48.514 INFO:teuthology.orchestra.run.smithi045.stdout: -7875> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004d6) auth_unpin by 0x55cf6246b700 on [inode 0x100000004d6 [2,head] /dc-dir/dc-file_737 auth v5476 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.315492+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6246b700] now 0 2023-10-03T19:20:48.514 INFO:teuthology.orchestra.run.smithi045.stdout: -7874> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+238 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6246b700 count now 1/238 2023-10-03T19:20:48.514 INFO:teuthology.orchestra.run.smithi045.stdout: -7873> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004d6) clear_dirty_parent 2023-10-03T19:20:48.514 INFO:teuthology.orchestra.run.smithi045.stdout: -7872> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004d7) _stored_backtrace v 3480 2023-10-03T19:20:48.514 INFO:teuthology.orchestra.run.smithi045.stdout: -7871> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004d7) auth_unpin by 0x55cf62470000 on [inode 0x100000004d7 [2,head] /dc-dir/dc-file_738 auth v5478 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.326432+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62470000] now 0 2023-10-03T19:20:48.514 INFO:teuthology.orchestra.run.smithi045.stdout: -7870> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+237 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62470000 count now 1/237 2023-10-03T19:20:48.514 INFO:teuthology.orchestra.run.smithi045.stdout: -7869> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004d7) clear_dirty_parent 2023-10-03T19:20:48.514 INFO:teuthology.orchestra.run.smithi045.stdout: -7868> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004d8) _stored_backtrace v 3484 2023-10-03T19:20:48.514 INFO:teuthology.orchestra.run.smithi045.stdout: -7867> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004d8) auth_unpin by 0x55cf62470580 on [inode 0x100000004d8 [2,head] /dc-dir/dc-file_739 auth v5480 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.337741+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62470580] now 0 2023-10-03T19:20:48.515 INFO:teuthology.orchestra.run.smithi045.stdout: -7866> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+236 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62470580 count now 1/236 2023-10-03T19:20:48.515 INFO:teuthology.orchestra.run.smithi045.stdout: -7865> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004d8) clear_dirty_parent 2023-10-03T19:20:48.515 INFO:teuthology.orchestra.run.smithi045.stdout: -7864> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004d9) _stored_backtrace v 3488 2023-10-03T19:20:48.515 INFO:teuthology.orchestra.run.smithi045.stdout: -7863> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004d9) auth_unpin by 0x55cf62470b00 on [inode 0x100000004d9 [2,head] /dc-dir/dc-file_740 auth v5482 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.348525+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62470b00] now 0 2023-10-03T19:20:48.515 INFO:teuthology.orchestra.run.smithi045.stdout: -7862> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+235 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62470b00 count now 1/235 2023-10-03T19:20:48.515 INFO:teuthology.orchestra.run.smithi045.stdout: -7861> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004d9) clear_dirty_parent 2023-10-03T19:20:48.515 INFO:teuthology.orchestra.run.smithi045.stdout: -7860> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004da) _stored_backtrace v 3492 2023-10-03T19:20:48.515 INFO:teuthology.orchestra.run.smithi045.stdout: -7859> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004da) auth_unpin by 0x55cf62471080 on [inode 0x100000004da [2,head] /dc-dir/dc-file_741 auth v5484 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.360589+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62471080] now 0 2023-10-03T19:20:48.515 INFO:teuthology.orchestra.run.smithi045.stdout: -7858> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+234 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62471080 count now 1/234 2023-10-03T19:20:48.515 INFO:teuthology.orchestra.run.smithi045.stdout: -7857> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004da) clear_dirty_parent 2023-10-03T19:20:48.515 INFO:teuthology.orchestra.run.smithi045.stdout: -7856> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004db) _stored_backtrace v 3496 2023-10-03T19:20:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: -7855> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004db) auth_unpin by 0x55cf62471600 on [inode 0x100000004db [2,head] /dc-dir/dc-file_742 auth v5486 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.372133+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62471600] now 0 2023-10-03T19:20:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: -7854> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+233 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62471600 count now 1/233 2023-10-03T19:20:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: -7853> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004db) clear_dirty_parent 2023-10-03T19:20:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: -7852> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004dc) _stored_backtrace v 3500 2023-10-03T19:20:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: -7851> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004dc) auth_unpin by 0x55cf62471b80 on [inode 0x100000004dc [2,head] /dc-dir/dc-file_743 auth v5488 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.383212+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62471b80] now 0 2023-10-03T19:20:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: -7850> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+232 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62471b80 count now 1/232 2023-10-03T19:20:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: -7849> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004dc) clear_dirty_parent 2023-10-03T19:20:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: -7848> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004dd) _stored_backtrace v 3504 2023-10-03T19:20:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: -7847> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004dd) auth_unpin by 0x55cf62472100 on [inode 0x100000004dd [2,head] /dc-dir/dc-file_744 auth v5490 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.393523+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62472100] now 0 2023-10-03T19:20:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: -7846> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+231 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62472100 count now 1/231 2023-10-03T19:20:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: -7845> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004dd) clear_dirty_parent 2023-10-03T19:20:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: -7844> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004de) _stored_backtrace v 3508 2023-10-03T19:20:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: -7843> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004de) auth_unpin by 0x55cf62472680 on [inode 0x100000004de [2,head] /dc-dir/dc-file_745 auth v5492 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.404128+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62472680] now 0 2023-10-03T19:20:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: -7842> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+230 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62472680 count now 1/230 2023-10-03T19:20:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: -7841> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004de) clear_dirty_parent 2023-10-03T19:20:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: -7840> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004df) _stored_backtrace v 3512 2023-10-03T19:20:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: -7839> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004df) auth_unpin by 0x55cf62472c00 on [inode 0x100000004df [2,head] /dc-dir/dc-file_746 auth v5494 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.415017+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62472c00] now 0 2023-10-03T19:20:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: -7838> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+229 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62472c00 count now 1/229 2023-10-03T19:20:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: -7837> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004df) clear_dirty_parent 2023-10-03T19:20:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: -7836> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004e0) _stored_backtrace v 3516 2023-10-03T19:20:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: -7835> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004e0) auth_unpin by 0x55cf62473180 on [inode 0x100000004e0 [2,head] /dc-dir/dc-file_747 auth v5496 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.426421+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62473180] now 0 2023-10-03T19:20:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: -7834> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+228 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62473180 count now 1/228 2023-10-03T19:20:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: -7833> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004e0) clear_dirty_parent 2023-10-03T19:20:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: -7832> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004e1) _stored_backtrace v 3520 2023-10-03T19:20:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: -7831> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004e1) auth_unpin by 0x55cf62473700 on [inode 0x100000004e1 [2,head] /dc-dir/dc-file_748 auth v5498 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.437848+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62473700] now 0 2023-10-03T19:20:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: -7830> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+227 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62473700 count now 1/227 2023-10-03T19:20:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: -7829> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004e1) clear_dirty_parent 2023-10-03T19:20:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: -7828> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004e2) _stored_backtrace v 3524 2023-10-03T19:20:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: -7827> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004e2) auth_unpin by 0x55cf6247a000 on [inode 0x100000004e2 [2,head] /dc-dir/dc-file_749 auth v5500 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.449985+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6247a000] now 0 2023-10-03T19:20:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: -7826> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+226 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6247a000 count now 1/226 2023-10-03T19:20:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: -7825> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004e2) clear_dirty_parent 2023-10-03T19:20:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: -7824> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004e3) _stored_backtrace v 3528 2023-10-03T19:20:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: -7823> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004e3) auth_unpin by 0x55cf6247a580 on [inode 0x100000004e3 [2,head] /dc-dir/dc-file_750 auth v5502 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.461790+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6247a580] now 0 2023-10-03T19:20:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: -7822> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+225 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6247a580 count now 1/225 2023-10-03T19:20:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: -7821> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004e3) clear_dirty_parent 2023-10-03T19:20:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: -7820> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004e4) _stored_backtrace v 3532 2023-10-03T19:20:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: -7819> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004e4) auth_unpin by 0x55cf6247ab00 on [inode 0x100000004e4 [2,head] /dc-dir/dc-file_751 auth v5504 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.473217+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6247ab00] now 0 2023-10-03T19:20:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: -7818> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+224 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6247ab00 count now 1/224 2023-10-03T19:20:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: -7817> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004e4) clear_dirty_parent 2023-10-03T19:20:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: -7816> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004e5) _stored_backtrace v 3536 2023-10-03T19:20:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: -7815> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004e5) auth_unpin by 0x55cf6247b080 on [inode 0x100000004e5 [2,head] /dc-dir/dc-file_752 auth v5506 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.484483+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6247b080] now 0 2023-10-03T19:20:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: -7814> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+223 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6247b080 count now 1/223 2023-10-03T19:20:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: -7813> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004e5) clear_dirty_parent 2023-10-03T19:20:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: -7812> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004e6) _stored_backtrace v 3540 2023-10-03T19:20:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: -7811> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004e6) auth_unpin by 0x55cf6247b600 on [inode 0x100000004e6 [2,head] /dc-dir/dc-file_753 auth v5508 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.495827+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6247b600] now 0 2023-10-03T19:20:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: -7810> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+222 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6247b600 count now 1/222 2023-10-03T19:20:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: -7809> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004e6) clear_dirty_parent 2023-10-03T19:20:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: -7808> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004e7) _stored_backtrace v 3718 2023-10-03T19:20:48.535 INFO:teuthology.orchestra.run.smithi045.stdout: -7807> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004e7) auth_unpin by 0x55cf6247bb80 on [inode 0x100000004e7 [2,head] /dc-dir/dc-file_754 auth v5510 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.590761+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6247bb80] now 0 2023-10-03T19:20:48.535 INFO:teuthology.orchestra.run.smithi045.stdout: -7806> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+221 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6247bb80 count now 1/221 2023-10-03T19:20:48.535 INFO:teuthology.orchestra.run.smithi045.stdout: -7805> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004e7) clear_dirty_parent 2023-10-03T19:20:48.535 INFO:teuthology.orchestra.run.smithi045.stdout: -7804> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004e8) _stored_backtrace v 3722 2023-10-03T19:20:48.535 INFO:teuthology.orchestra.run.smithi045.stdout: -7803> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004e8) auth_unpin by 0x55cf6247c100 on [inode 0x100000004e8 [2,head] /dc-dir/dc-file_755 auth v5512 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.635973+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6247c100] now 0 2023-10-03T19:20:48.535 INFO:teuthology.orchestra.run.smithi045.stdout: -7802> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+220 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6247c100 count now 1/220 2023-10-03T19:20:48.535 INFO:teuthology.orchestra.run.smithi045.stdout: -7801> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004e8) clear_dirty_parent 2023-10-03T19:20:48.536 INFO:teuthology.orchestra.run.smithi045.stdout: -7800> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004e9) _stored_backtrace v 3726 2023-10-03T19:20:48.536 INFO:teuthology.orchestra.run.smithi045.stdout: -7799> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004e9) auth_unpin by 0x55cf6247c680 on [inode 0x100000004e9 [2,head] /dc-dir/dc-file_756 auth v5514 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.647861+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6247c680] now 0 2023-10-03T19:20:48.536 INFO:teuthology.orchestra.run.smithi045.stdout: -7798> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+219 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6247c680 count now 1/219 2023-10-03T19:20:48.536 INFO:teuthology.orchestra.run.smithi045.stdout: -7797> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004e9) clear_dirty_parent 2023-10-03T19:20:48.536 INFO:teuthology.orchestra.run.smithi045.stdout: -7796> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ea) _stored_backtrace v 3730 2023-10-03T19:20:48.536 INFO:teuthology.orchestra.run.smithi045.stdout: -7795> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ea) auth_unpin by 0x55cf6247cc00 on [inode 0x100000004ea [2,head] /dc-dir/dc-file_757 auth v5516 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.659752+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6247cc00] now 0 2023-10-03T19:20:48.536 INFO:teuthology.orchestra.run.smithi045.stdout: -7794> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+218 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6247cc00 count now 1/218 2023-10-03T19:20:48.536 INFO:teuthology.orchestra.run.smithi045.stdout: -7793> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ea) clear_dirty_parent 2023-10-03T19:20:48.536 INFO:teuthology.orchestra.run.smithi045.stdout: -7792> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004eb) _stored_backtrace v 3734 2023-10-03T19:20:48.536 INFO:teuthology.orchestra.run.smithi045.stdout: -7791> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004eb) auth_unpin by 0x55cf6247d180 on [inode 0x100000004eb [2,head] /dc-dir/dc-file_758 auth v5518 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.671597+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6247d180] now 0 2023-10-03T19:20:48.536 INFO:teuthology.orchestra.run.smithi045.stdout: -7790> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+217 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6247d180 count now 1/217 2023-10-03T19:20:48.536 INFO:teuthology.orchestra.run.smithi045.stdout: -7789> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004eb) clear_dirty_parent 2023-10-03T19:20:48.537 INFO:teuthology.orchestra.run.smithi045.stdout: -7788> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ec) _stored_backtrace v 3738 2023-10-03T19:20:48.537 INFO:teuthology.orchestra.run.smithi045.stdout: -7787> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ec) auth_unpin by 0x55cf6247d700 on [inode 0x100000004ec [2,head] /dc-dir/dc-file_759 auth v5520 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.683273+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6247d700] now 0 2023-10-03T19:20:48.537 INFO:teuthology.orchestra.run.smithi045.stdout: -7786> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+216 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6247d700 count now 1/216 2023-10-03T19:20:48.537 INFO:teuthology.orchestra.run.smithi045.stdout: -7785> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ec) clear_dirty_parent 2023-10-03T19:20:48.537 INFO:teuthology.orchestra.run.smithi045.stdout: -7784> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ed) _stored_backtrace v 3742 2023-10-03T19:20:48.537 INFO:teuthology.orchestra.run.smithi045.stdout: -7783> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ed) auth_unpin by 0x55cf624aa000 on [inode 0x100000004ed [2,head] /dc-dir/dc-file_760 auth v5522 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.694570+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624aa000] now 0 2023-10-03T19:20:48.537 INFO:teuthology.orchestra.run.smithi045.stdout: -7782> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+215 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624aa000 count now 1/215 2023-10-03T19:20:48.537 INFO:teuthology.orchestra.run.smithi045.stdout: -7781> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ed) clear_dirty_parent 2023-10-03T19:20:48.537 INFO:teuthology.orchestra.run.smithi045.stdout: -7780> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ee) _stored_backtrace v 3746 2023-10-03T19:20:48.538 INFO:teuthology.orchestra.run.smithi045.stdout: -7779> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ee) auth_unpin by 0x55cf624aa580 on [inode 0x100000004ee [2,head] /dc-dir/dc-file_761 auth v5524 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.706520+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624aa580] now 0 2023-10-03T19:20:48.538 INFO:teuthology.orchestra.run.smithi045.stdout: -7778> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+214 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624aa580 count now 1/214 2023-10-03T19:20:48.538 INFO:teuthology.orchestra.run.smithi045.stdout: -7777> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ee) clear_dirty_parent 2023-10-03T19:20:48.545 INFO:teuthology.orchestra.run.smithi045.stdout: -7776> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ef) _stored_backtrace v 3750 2023-10-03T19:20:48.546 INFO:teuthology.orchestra.run.smithi045.stdout: -7775> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ef) auth_unpin by 0x55cf624aab00 on [inode 0x100000004ef [2,head] /dc-dir/dc-file_762 auth v5526 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.717795+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624aab00] now 0 2023-10-03T19:20:48.546 INFO:teuthology.orchestra.run.smithi045.stdout: -7774> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+213 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624aab00 count now 1/213 2023-10-03T19:20:48.546 INFO:teuthology.orchestra.run.smithi045.stdout: -7773> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ef) clear_dirty_parent 2023-10-03T19:20:48.546 INFO:teuthology.orchestra.run.smithi045.stdout: -7772> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004f0) _stored_backtrace v 3754 2023-10-03T19:20:48.546 INFO:teuthology.orchestra.run.smithi045.stdout: -7771> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004f0) auth_unpin by 0x55cf624ab080 on [inode 0x100000004f0 [2,head] /dc-dir/dc-file_763 auth v5528 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.729578+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624ab080] now 0 2023-10-03T19:20:48.546 INFO:teuthology.orchestra.run.smithi045.stdout: -7770> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+212 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624ab080 count now 1/212 2023-10-03T19:20:48.546 INFO:teuthology.orchestra.run.smithi045.stdout: -7769> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004f0) clear_dirty_parent 2023-10-03T19:20:48.546 INFO:teuthology.orchestra.run.smithi045.stdout: -7768> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004f1) _stored_backtrace v 3758 2023-10-03T19:20:48.546 INFO:teuthology.orchestra.run.smithi045.stdout: -7767> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004f1) auth_unpin by 0x55cf624ab600 on [inode 0x100000004f1 [2,head] /dc-dir/dc-file_764 auth v5530 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.741541+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624ab600] now 0 2023-10-03T19:20:48.546 INFO:teuthology.orchestra.run.smithi045.stdout: -7766> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+211 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624ab600 count now 1/211 2023-10-03T19:20:48.546 INFO:teuthology.orchestra.run.smithi045.stdout: -7765> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004f1) clear_dirty_parent 2023-10-03T19:20:48.547 INFO:teuthology.orchestra.run.smithi045.stdout: -7764> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004f2) _stored_backtrace v 3762 2023-10-03T19:20:48.547 INFO:teuthology.orchestra.run.smithi045.stdout: -7763> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004f2) auth_unpin by 0x55cf624abb80 on [inode 0x100000004f2 [2,head] /dc-dir/dc-file_765 auth v5532 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.753129+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624abb80] now 0 2023-10-03T19:20:48.547 INFO:teuthology.orchestra.run.smithi045.stdout: -7762> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+210 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624abb80 count now 1/210 2023-10-03T19:20:48.547 INFO:teuthology.orchestra.run.smithi045.stdout: -7761> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004f2) clear_dirty_parent 2023-10-03T19:20:48.547 INFO:teuthology.orchestra.run.smithi045.stdout: -7760> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004f3) _stored_backtrace v 3766 2023-10-03T19:20:48.547 INFO:teuthology.orchestra.run.smithi045.stdout: -7759> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004f3) auth_unpin by 0x55cf624ac100 on [inode 0x100000004f3 [2,head] /dc-dir/dc-file_766 auth v5534 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.765095+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624ac100] now 0 2023-10-03T19:20:48.547 INFO:teuthology.orchestra.run.smithi045.stdout: -7758> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+209 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624ac100 count now 1/209 2023-10-03T19:20:48.547 INFO:teuthology.orchestra.run.smithi045.stdout: -7757> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004f3) clear_dirty_parent 2023-10-03T19:20:48.547 INFO:teuthology.orchestra.run.smithi045.stdout: -7756> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004f4) _stored_backtrace v 3770 2023-10-03T19:20:48.547 INFO:teuthology.orchestra.run.smithi045.stdout: -7755> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004f4) auth_unpin by 0x55cf624ac680 on [inode 0x100000004f4 [2,head] /dc-dir/dc-file_767 auth v5536 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.776543+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624ac680] now 0 2023-10-03T19:20:48.547 INFO:teuthology.orchestra.run.smithi045.stdout: -7754> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+208 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624ac680 count now 1/208 2023-10-03T19:20:48.547 INFO:teuthology.orchestra.run.smithi045.stdout: -7753> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004f4) clear_dirty_parent 2023-10-03T19:20:48.548 INFO:teuthology.orchestra.run.smithi045.stdout: -7752> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004f5) _stored_backtrace v 3774 2023-10-03T19:20:48.548 INFO:teuthology.orchestra.run.smithi045.stdout: -7751> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004f5) auth_unpin by 0x55cf624acc00 on [inode 0x100000004f5 [2,head] /dc-dir/dc-file_768 auth v5538 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.787621+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624acc00] now 0 2023-10-03T19:20:48.548 INFO:teuthology.orchestra.run.smithi045.stdout: -7750> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+207 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624acc00 count now 1/207 2023-10-03T19:20:48.548 INFO:teuthology.orchestra.run.smithi045.stdout: -7749> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004f5) clear_dirty_parent 2023-10-03T19:20:48.548 INFO:teuthology.orchestra.run.smithi045.stdout: -7748> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004f6) _stored_backtrace v 3778 2023-10-03T19:20:48.548 INFO:teuthology.orchestra.run.smithi045.stdout: -7747> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004f6) auth_unpin by 0x55cf624ad180 on [inode 0x100000004f6 [2,head] /dc-dir/dc-file_769 auth v5540 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.798954+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624ad180] now 0 2023-10-03T19:20:48.548 INFO:teuthology.orchestra.run.smithi045.stdout: -7746> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+206 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624ad180 count now 1/206 2023-10-03T19:20:48.548 INFO:teuthology.orchestra.run.smithi045.stdout: -7745> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004f6) clear_dirty_parent 2023-10-03T19:20:48.548 INFO:teuthology.orchestra.run.smithi045.stdout: -7744> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004f7) _stored_backtrace v 3782 2023-10-03T19:20:48.549 INFO:teuthology.orchestra.run.smithi045.stdout: -7743> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004f7) auth_unpin by 0x55cf624ad700 on [inode 0x100000004f7 [2,head] /dc-dir/dc-file_770 auth v5542 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.810090+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624ad700] now 0 2023-10-03T19:20:48.549 INFO:teuthology.orchestra.run.smithi045.stdout: -7742> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+205 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624ad700 count now 1/205 2023-10-03T19:20:48.549 INFO:teuthology.orchestra.run.smithi045.stdout: -7741> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004f7) clear_dirty_parent 2023-10-03T19:20:48.715 INFO:teuthology.orchestra.run.smithi045.stdout: -7740> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004f8) _stored_backtrace v 3786 2023-10-03T19:20:48.715 INFO:teuthology.orchestra.run.smithi045.stdout: -7739> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004f8) auth_unpin by 0x55cf624b4000 on [inode 0x100000004f8 [2,head] /dc-dir/dc-file_771 auth v5544 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.821355+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624b4000] now 0 2023-10-03T19:20:48.716 INFO:teuthology.orchestra.run.smithi045.stdout: -7738> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+204 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624b4000 count now 1/204 2023-10-03T19:20:48.716 INFO:teuthology.orchestra.run.smithi045.stdout: -7737> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004f8) clear_dirty_parent 2023-10-03T19:20:48.716 INFO:teuthology.orchestra.run.smithi045.stdout: -7736> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004f9) _stored_backtrace v 3790 2023-10-03T19:20:48.716 INFO:teuthology.orchestra.run.smithi045.stdout: -7735> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004f9) auth_unpin by 0x55cf624b4580 on [inode 0x100000004f9 [2,head] /dc-dir/dc-file_772 auth v5546 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.832622+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624b4580] now 0 2023-10-03T19:20:48.716 INFO:teuthology.orchestra.run.smithi045.stdout: -7734> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+203 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624b4580 count now 1/203 2023-10-03T19:20:48.716 INFO:teuthology.orchestra.run.smithi045.stdout: -7733> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004f9) clear_dirty_parent 2023-10-03T19:20:48.716 INFO:teuthology.orchestra.run.smithi045.stdout: -7732> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004fa) _stored_backtrace v 3794 2023-10-03T19:20:48.716 INFO:teuthology.orchestra.run.smithi045.stdout: -7731> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004fa) auth_unpin by 0x55cf624b4b00 on [inode 0x100000004fa [2,head] /dc-dir/dc-file_773 auth v5548 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.844770+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624b4b00] now 0 2023-10-03T19:20:48.716 INFO:teuthology.orchestra.run.smithi045.stdout: -7730> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+202 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624b4b00 count now 1/202 2023-10-03T19:20:48.716 INFO:teuthology.orchestra.run.smithi045.stdout: -7729> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004fa) clear_dirty_parent 2023-10-03T19:20:48.716 INFO:teuthology.orchestra.run.smithi045.stdout: -7728> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004fb) _stored_backtrace v 3798 2023-10-03T19:20:48.717 INFO:teuthology.orchestra.run.smithi045.stdout: -7727> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004fb) auth_unpin by 0x55cf624b5080 on [inode 0x100000004fb [2,head] /dc-dir/dc-file_774 auth v5550 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.856261+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624b5080] now 0 2023-10-03T19:20:48.717 INFO:teuthology.orchestra.run.smithi045.stdout: -7726> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+201 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624b5080 count now 1/201 2023-10-03T19:20:48.717 INFO:teuthology.orchestra.run.smithi045.stdout: -7725> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004fb) clear_dirty_parent 2023-10-03T19:20:48.717 INFO:teuthology.orchestra.run.smithi045.stdout: -7724> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004fc) _stored_backtrace v 3802 2023-10-03T19:20:48.717 INFO:teuthology.orchestra.run.smithi045.stdout: -7723> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004fc) auth_unpin by 0x55cf624b5600 on [inode 0x100000004fc [2,head] /dc-dir/dc-file_775 auth v5552 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.868357+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624b5600] now 0 2023-10-03T19:20:48.717 INFO:teuthology.orchestra.run.smithi045.stdout: -7722> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+200 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624b5600 count now 1/200 2023-10-03T19:20:48.717 INFO:teuthology.orchestra.run.smithi045.stdout: -7721> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004fc) clear_dirty_parent 2023-10-03T19:20:48.717 INFO:teuthology.orchestra.run.smithi045.stdout: -7720> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004fd) _stored_backtrace v 3806 2023-10-03T19:20:48.717 INFO:teuthology.orchestra.run.smithi045.stdout: -7719> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004fd) auth_unpin by 0x55cf624b5b80 on [inode 0x100000004fd [2,head] /dc-dir/dc-file_776 auth v5554 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.880780+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624b5b80] now 0 2023-10-03T19:20:48.717 INFO:teuthology.orchestra.run.smithi045.stdout: -7718> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+199 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624b5b80 count now 1/199 2023-10-03T19:20:48.717 INFO:teuthology.orchestra.run.smithi045.stdout: -7717> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004fd) clear_dirty_parent 2023-10-03T19:20:48.717 INFO:teuthology.orchestra.run.smithi045.stdout: -7716> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004fe) _stored_backtrace v 3810 2023-10-03T19:20:48.718 INFO:teuthology.orchestra.run.smithi045.stdout: -7715> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004fe) auth_unpin by 0x55cf624b6100 on [inode 0x100000004fe [2,head] /dc-dir/dc-file_777 auth v5556 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.893903+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624b6100] now 0 2023-10-03T19:20:48.718 INFO:teuthology.orchestra.run.smithi045.stdout: -7714> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+198 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624b6100 count now 1/198 2023-10-03T19:20:48.718 INFO:teuthology.orchestra.run.smithi045.stdout: -7713> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004fe) clear_dirty_parent 2023-10-03T19:20:48.718 INFO:teuthology.orchestra.run.smithi045.stdout: -7712> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ff) _stored_backtrace v 3814 2023-10-03T19:20:48.718 INFO:teuthology.orchestra.run.smithi045.stdout: -7711> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ff) auth_unpin by 0x55cf624b6680 on [inode 0x100000004ff [2,head] /dc-dir/dc-file_778 auth v5558 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.907180+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624b6680] now 0 2023-10-03T19:20:48.718 INFO:teuthology.orchestra.run.smithi045.stdout: -7710> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+197 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624b6680 count now 1/197 2023-10-03T19:20:48.718 INFO:teuthology.orchestra.run.smithi045.stdout: -7709> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000004ff) clear_dirty_parent 2023-10-03T19:20:48.718 INFO:teuthology.orchestra.run.smithi045.stdout: -7708> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000500) _stored_backtrace v 3818 2023-10-03T19:20:48.718 INFO:teuthology.orchestra.run.smithi045.stdout: -7707> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000500) auth_unpin by 0x55cf624b6c00 on [inode 0x10000000500 [2,head] /dc-dir/dc-file_779 auth v5560 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.920499+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624b6c00] now 0 2023-10-03T19:20:48.719 INFO:teuthology.orchestra.run.smithi045.stdout: -7706> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+196 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624b6c00 count now 1/196 2023-10-03T19:20:48.719 INFO:teuthology.orchestra.run.smithi045.stdout: -7705> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000500) clear_dirty_parent 2023-10-03T19:20:48.719 INFO:teuthology.orchestra.run.smithi045.stdout: -7704> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000501) _stored_backtrace v 3822 2023-10-03T19:20:48.719 INFO:teuthology.orchestra.run.smithi045.stdout: -7703> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000501) auth_unpin by 0x55cf624b7180 on [inode 0x10000000501 [2,head] /dc-dir/dc-file_780 auth v5562 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.932682+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624b7180] now 0 2023-10-03T19:20:48.719 INFO:teuthology.orchestra.run.smithi045.stdout: -7702> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+195 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624b7180 count now 1/195 2023-10-03T19:20:48.719 INFO:teuthology.orchestra.run.smithi045.stdout: -7701> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000501) clear_dirty_parent 2023-10-03T19:20:48.719 INFO:teuthology.orchestra.run.smithi045.stdout: -7700> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000502) _stored_backtrace v 3826 2023-10-03T19:20:48.719 INFO:teuthology.orchestra.run.smithi045.stdout: -7699> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000502) auth_unpin by 0x55cf624b7700 on [inode 0x10000000502 [2,head] /dc-dir/dc-file_781 auth v5564 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.945762+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624b7700] now 0 2023-10-03T19:20:48.719 INFO:teuthology.orchestra.run.smithi045.stdout: -7698> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+194 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624b7700 count now 1/194 2023-10-03T19:20:48.719 INFO:teuthology.orchestra.run.smithi045.stdout: -7697> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000502) clear_dirty_parent 2023-10-03T19:20:48.719 INFO:teuthology.orchestra.run.smithi045.stdout: -7696> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000503) _stored_backtrace v 3830 2023-10-03T19:20:48.719 INFO:teuthology.orchestra.run.smithi045.stdout: -7695> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000503) auth_unpin by 0x55cf624c2000 on [inode 0x10000000503 [2,head] /dc-dir/dc-file_782 auth v5566 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.958819+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624c2000] now 0 2023-10-03T19:20:48.720 INFO:teuthology.orchestra.run.smithi045.stdout: -7694> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+193 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624c2000 count now 1/193 2023-10-03T19:20:48.720 INFO:teuthology.orchestra.run.smithi045.stdout: -7693> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000503) clear_dirty_parent 2023-10-03T19:20:48.720 INFO:teuthology.orchestra.run.smithi045.stdout: -7692> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000504) _stored_backtrace v 3834 2023-10-03T19:20:48.720 INFO:teuthology.orchestra.run.smithi045.stdout: -7691> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000504) auth_unpin by 0x55cf624c2580 on [inode 0x10000000504 [2,head] /dc-dir/dc-file_783 auth v5568 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.971691+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624c2580] now 0 2023-10-03T19:20:48.720 INFO:teuthology.orchestra.run.smithi045.stdout: -7690> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+192 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624c2580 count now 1/192 2023-10-03T19:20:48.720 INFO:teuthology.orchestra.run.smithi045.stdout: -7689> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000504) clear_dirty_parent 2023-10-03T19:20:48.720 INFO:teuthology.orchestra.run.smithi045.stdout: -7688> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000505) _stored_backtrace v 3838 2023-10-03T19:20:48.720 INFO:teuthology.orchestra.run.smithi045.stdout: -7687> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000505) auth_unpin by 0x55cf624c2b00 on [inode 0x10000000505 [2,head] /dc-dir/dc-file_784 auth v5570 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.984317+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624c2b00] now 0 2023-10-03T19:20:48.720 INFO:teuthology.orchestra.run.smithi045.stdout: -7686> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+191 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624c2b00 count now 1/191 2023-10-03T19:20:48.720 INFO:teuthology.orchestra.run.smithi045.stdout: -7685> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000505) clear_dirty_parent 2023-10-03T19:20:48.720 INFO:teuthology.orchestra.run.smithi045.stdout: -7684> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000506) _stored_backtrace v 3842 2023-10-03T19:20:48.721 INFO:teuthology.orchestra.run.smithi045.stdout: -7683> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000506) auth_unpin by 0x55cf624c3080 on [inode 0x10000000506 [2,head] /dc-dir/dc-file_785 auth v5572 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:43.996458+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624c3080] now 0 2023-10-03T19:20:48.750 INFO:teuthology.orchestra.run.smithi045.stdout: -7682> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+190 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624c3080 count now 1/190 2023-10-03T19:20:48.751 INFO:teuthology.orchestra.run.smithi045.stdout: -7681> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000506) clear_dirty_parent 2023-10-03T19:20:48.751 INFO:teuthology.orchestra.run.smithi045.stdout: -7680> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000507) _stored_backtrace v 3846 2023-10-03T19:20:48.751 INFO:teuthology.orchestra.run.smithi045.stdout: -7679> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000507) auth_unpin by 0x55cf624c3600 on [inode 0x10000000507 [2,head] /dc-dir/dc-file_786 auth v5574 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.009555+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624c3600] now 0 2023-10-03T19:20:48.751 INFO:teuthology.orchestra.run.smithi045.stdout: -7678> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+189 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624c3600 count now 1/189 2023-10-03T19:20:48.751 INFO:teuthology.orchestra.run.smithi045.stdout: -7677> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000507) clear_dirty_parent 2023-10-03T19:20:48.751 INFO:teuthology.orchestra.run.smithi045.stdout: -7676> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000508) _stored_backtrace v 3850 2023-10-03T19:20:48.751 INFO:teuthology.orchestra.run.smithi045.stdout: -7675> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000508) auth_unpin by 0x55cf624c3b80 on [inode 0x10000000508 [2,head] /dc-dir/dc-file_787 auth v5576 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.022165+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624c3b80] now 0 2023-10-03T19:20:48.751 INFO:teuthology.orchestra.run.smithi045.stdout: -7674> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+188 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624c3b80 count now 1/188 2023-10-03T19:20:48.751 INFO:teuthology.orchestra.run.smithi045.stdout: -7673> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000508) clear_dirty_parent 2023-10-03T19:20:48.752 INFO:teuthology.orchestra.run.smithi045.stdout: -7672> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000509) _stored_backtrace v 3854 2023-10-03T19:20:48.752 INFO:teuthology.orchestra.run.smithi045.stdout: -7671> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000509) auth_unpin by 0x55cf624c4100 on [inode 0x10000000509 [2,head] /dc-dir/dc-file_788 auth v5578 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.034507+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624c4100] now 0 2023-10-03T19:20:48.752 INFO:teuthology.orchestra.run.smithi045.stdout: -7670> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+187 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624c4100 count now 1/187 2023-10-03T19:20:48.752 INFO:teuthology.orchestra.run.smithi045.stdout: -7669> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000509) clear_dirty_parent 2023-10-03T19:20:48.752 INFO:teuthology.orchestra.run.smithi045.stdout: -7668> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000050a) _stored_backtrace v 3858 2023-10-03T19:20:48.752 INFO:teuthology.orchestra.run.smithi045.stdout: -7667> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000050a) auth_unpin by 0x55cf624c4680 on [inode 0x1000000050a [2,head] /dc-dir/dc-file_789 auth v5580 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.050564+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624c4680] now 0 2023-10-03T19:20:48.752 INFO:teuthology.orchestra.run.smithi045.stdout: -7666> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+186 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624c4680 count now 1/186 2023-10-03T19:20:48.752 INFO:teuthology.orchestra.run.smithi045.stdout: -7665> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000050a) clear_dirty_parent 2023-10-03T19:20:48.752 INFO:teuthology.orchestra.run.smithi045.stdout: -7664> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000050b) _stored_backtrace v 3862 2023-10-03T19:20:48.752 INFO:teuthology.orchestra.run.smithi045.stdout: -7663> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000050b) auth_unpin by 0x55cf624c4c00 on [inode 0x1000000050b [2,head] /dc-dir/dc-file_790 auth v5582 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.069751+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624c4c00] now 0 2023-10-03T19:20:48.752 INFO:teuthology.orchestra.run.smithi045.stdout: -7662> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+185 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624c4c00 count now 1/185 2023-10-03T19:20:48.753 INFO:teuthology.orchestra.run.smithi045.stdout: -7661> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000050b) clear_dirty_parent 2023-10-03T19:20:48.753 INFO:teuthology.orchestra.run.smithi045.stdout: -7660> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000050c) _stored_backtrace v 3866 2023-10-03T19:20:48.753 INFO:teuthology.orchestra.run.smithi045.stdout: -7659> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000050c) auth_unpin by 0x55cf624c5180 on [inode 0x1000000050c [2,head] /dc-dir/dc-file_791 auth v5584 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.081430+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624c5180] now 0 2023-10-03T19:20:48.753 INFO:teuthology.orchestra.run.smithi045.stdout: -7658> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+184 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624c5180 count now 1/184 2023-10-03T19:20:48.753 INFO:teuthology.orchestra.run.smithi045.stdout: -7657> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000050c) clear_dirty_parent 2023-10-03T19:20:48.753 INFO:teuthology.orchestra.run.smithi045.stdout: -7656> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000050d) _stored_backtrace v 3870 2023-10-03T19:20:48.753 INFO:teuthology.orchestra.run.smithi045.stdout: -7655> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000050d) auth_unpin by 0x55cf624c5700 on [inode 0x1000000050d [2,head] /dc-dir/dc-file_792 auth v5586 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.093706+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624c5700] now 0 2023-10-03T19:20:48.753 INFO:teuthology.orchestra.run.smithi045.stdout: -7654> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+183 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624c5700 count now 1/183 2023-10-03T19:20:48.753 INFO:teuthology.orchestra.run.smithi045.stdout: -7653> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000050d) clear_dirty_parent 2023-10-03T19:20:48.753 INFO:teuthology.orchestra.run.smithi045.stdout: -7652> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000050e) _stored_backtrace v 3874 2023-10-03T19:20:48.753 INFO:teuthology.orchestra.run.smithi045.stdout: -7651> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000050e) auth_unpin by 0x55cf624cc000 on [inode 0x1000000050e [2,head] /dc-dir/dc-file_793 auth v5588 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.104806+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624cc000] now 0 2023-10-03T19:20:48.754 INFO:teuthology.orchestra.run.smithi045.stdout: -7650> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+182 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624cc000 count now 1/182 2023-10-03T19:20:48.754 INFO:teuthology.orchestra.run.smithi045.stdout: -7649> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000050e) clear_dirty_parent 2023-10-03T19:20:48.754 INFO:teuthology.orchestra.run.smithi045.stdout: -7648> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000050f) _stored_backtrace v 3878 2023-10-03T19:20:48.754 INFO:teuthology.orchestra.run.smithi045.stdout: -7647> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000050f) auth_unpin by 0x55cf624cc580 on [inode 0x1000000050f [2,head] /dc-dir/dc-file_794 auth v5590 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.116381+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624cc580] now 0 2023-10-03T19:20:48.754 INFO:teuthology.orchestra.run.smithi045.stdout: -7646> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+181 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624cc580 count now 1/181 2023-10-03T19:20:48.754 INFO:teuthology.orchestra.run.smithi045.stdout: -7645> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000050f) clear_dirty_parent 2023-10-03T19:20:48.754 INFO:teuthology.orchestra.run.smithi045.stdout: -7644> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000510) _stored_backtrace v 3882 2023-10-03T19:20:48.754 INFO:teuthology.orchestra.run.smithi045.stdout: -7643> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000510) auth_unpin by 0x55cf624ccb00 on [inode 0x10000000510 [2,head] /dc-dir/dc-file_795 auth v5592 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.128279+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624ccb00] now 0 2023-10-03T19:20:48.754 INFO:teuthology.orchestra.run.smithi045.stdout: -7642> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+180 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624ccb00 count now 1/180 2023-10-03T19:20:48.754 INFO:teuthology.orchestra.run.smithi045.stdout: -7641> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000510) clear_dirty_parent 2023-10-03T19:20:48.755 INFO:teuthology.orchestra.run.smithi045.stdout: -7640> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000511) _stored_backtrace v 3886 2023-10-03T19:20:48.755 INFO:teuthology.orchestra.run.smithi045.stdout: -7639> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000511) auth_unpin by 0x55cf624cd080 on [inode 0x10000000511 [2,head] /dc-dir/dc-file_796 auth v5594 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.140294+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624cd080] now 0 2023-10-03T19:20:48.755 INFO:teuthology.orchestra.run.smithi045.stdout: -7638> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+179 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624cd080 count now 1/179 2023-10-03T19:20:48.755 INFO:teuthology.orchestra.run.smithi045.stdout: -7637> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000511) clear_dirty_parent 2023-10-03T19:20:48.755 INFO:teuthology.orchestra.run.smithi045.stdout: -7636> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000512) _stored_backtrace v 3890 2023-10-03T19:20:48.755 INFO:teuthology.orchestra.run.smithi045.stdout: -7635> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000512) auth_unpin by 0x55cf624cd600 on [inode 0x10000000512 [2,head] /dc-dir/dc-file_797 auth v5596 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.152107+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624cd600] now 0 2023-10-03T19:20:48.755 INFO:teuthology.orchestra.run.smithi045.stdout: -7634> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+178 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624cd600 count now 1/178 2023-10-03T19:20:48.813 INFO:teuthology.orchestra.run.smithi045.stdout: -7633> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000512) clear_dirty_parent 2023-10-03T19:20:48.813 INFO:teuthology.orchestra.run.smithi045.stdout: -7632> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000513) _stored_backtrace v 3894 2023-10-03T19:20:48.813 INFO:teuthology.orchestra.run.smithi045.stdout: -7631> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000513) auth_unpin by 0x55cf624cdb80 on [inode 0x10000000513 [2,head] /dc-dir/dc-file_798 auth v5598 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.165311+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624cdb80] now 0 2023-10-03T19:20:48.813 INFO:teuthology.orchestra.run.smithi045.stdout: -7630> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+177 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624cdb80 count now 1/177 2023-10-03T19:20:48.814 INFO:teuthology.orchestra.run.smithi045.stdout: -7629> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000513) clear_dirty_parent 2023-10-03T19:20:48.814 INFO:teuthology.orchestra.run.smithi045.stdout: -7628> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000514) _stored_backtrace v 3898 2023-10-03T19:20:48.814 INFO:teuthology.orchestra.run.smithi045.stdout: -7627> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000514) auth_unpin by 0x55cf624ce100 on [inode 0x10000000514 [2,head] /dc-dir/dc-file_799 auth v5600 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.176717+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624ce100] now 0 2023-10-03T19:20:48.814 INFO:teuthology.orchestra.run.smithi045.stdout: -7626> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+176 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624ce100 count now 1/176 2023-10-03T19:20:48.814 INFO:teuthology.orchestra.run.smithi045.stdout: -7625> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000514) clear_dirty_parent 2023-10-03T19:20:48.814 INFO:teuthology.orchestra.run.smithi045.stdout: -7624> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000515) _stored_backtrace v 3902 2023-10-03T19:20:48.814 INFO:teuthology.orchestra.run.smithi045.stdout: -7623> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000515) auth_unpin by 0x55cf624ce680 on [inode 0x10000000515 [2,head] /dc-dir/dc-file_800 auth v5602 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.188355+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624ce680] now 0 2023-10-03T19:20:48.814 INFO:teuthology.orchestra.run.smithi045.stdout: -7622> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+175 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624ce680 count now 1/175 2023-10-03T19:20:48.814 INFO:teuthology.orchestra.run.smithi045.stdout: -7621> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000515) clear_dirty_parent 2023-10-03T19:20:48.814 INFO:teuthology.orchestra.run.smithi045.stdout: -7620> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000516) _stored_backtrace v 3906 2023-10-03T19:20:48.814 INFO:teuthology.orchestra.run.smithi045.stdout: -7619> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000516) auth_unpin by 0x55cf624cec00 on [inode 0x10000000516 [2,head] /dc-dir/dc-file_801 auth v5604 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.200198+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624cec00] now 0 2023-10-03T19:20:48.815 INFO:teuthology.orchestra.run.smithi045.stdout: -7618> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+174 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624cec00 count now 1/174 2023-10-03T19:20:48.815 INFO:teuthology.orchestra.run.smithi045.stdout: -7617> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000516) clear_dirty_parent 2023-10-03T19:20:48.815 INFO:teuthology.orchestra.run.smithi045.stdout: -7616> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000517) _stored_backtrace v 3910 2023-10-03T19:20:48.815 INFO:teuthology.orchestra.run.smithi045.stdout: -7615> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000517) auth_unpin by 0x55cf624cf180 on [inode 0x10000000517 [2,head] /dc-dir/dc-file_802 auth v5606 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.212051+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624cf180] now 0 2023-10-03T19:20:48.815 INFO:teuthology.orchestra.run.smithi045.stdout: -7614> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+173 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624cf180 count now 1/173 2023-10-03T19:20:48.815 INFO:teuthology.orchestra.run.smithi045.stdout: -7613> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000517) clear_dirty_parent 2023-10-03T19:20:48.815 INFO:teuthology.orchestra.run.smithi045.stdout: -7612> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000518) _stored_backtrace v 3914 2023-10-03T19:20:48.815 INFO:teuthology.orchestra.run.smithi045.stdout: -7611> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000518) auth_unpin by 0x55cf624cf700 on [inode 0x10000000518 [2,head] /dc-dir/dc-file_803 auth v5608 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.223474+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624cf700] now 0 2023-10-03T19:20:48.815 INFO:teuthology.orchestra.run.smithi045.stdout: -7610> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+172 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624cf700 count now 1/172 2023-10-03T19:20:48.815 INFO:teuthology.orchestra.run.smithi045.stdout: -7609> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000518) clear_dirty_parent 2023-10-03T19:20:48.816 INFO:teuthology.orchestra.run.smithi045.stdout: -7608> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000519) _stored_backtrace v 3918 2023-10-03T19:20:48.816 INFO:teuthology.orchestra.run.smithi045.stdout: -7607> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000519) auth_unpin by 0x55cf624d6000 on [inode 0x10000000519 [2,head] /dc-dir/dc-file_804 auth v5610 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.235016+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624d6000] now 0 2023-10-03T19:20:48.816 INFO:teuthology.orchestra.run.smithi045.stdout: -7606> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+171 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624d6000 count now 1/171 2023-10-03T19:20:48.816 INFO:teuthology.orchestra.run.smithi045.stdout: -7605> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000519) clear_dirty_parent 2023-10-03T19:20:48.816 INFO:teuthology.orchestra.run.smithi045.stdout: -7604> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000051a) _stored_backtrace v 3922 2023-10-03T19:20:48.816 INFO:teuthology.orchestra.run.smithi045.stdout: -7603> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000051a) auth_unpin by 0x55cf624d6580 on [inode 0x1000000051a [2,head] /dc-dir/dc-file_805 auth v5612 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.247186+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624d6580] now 0 2023-10-03T19:20:48.816 INFO:teuthology.orchestra.run.smithi045.stdout: -7602> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+170 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624d6580 count now 1/170 2023-10-03T19:20:48.816 INFO:teuthology.orchestra.run.smithi045.stdout: -7601> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000051a) clear_dirty_parent 2023-10-03T19:20:48.816 INFO:teuthology.orchestra.run.smithi045.stdout: -7600> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000051b) _stored_backtrace v 3926 2023-10-03T19:20:48.816 INFO:teuthology.orchestra.run.smithi045.stdout: -7599> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000051b) auth_unpin by 0x55cf624d6b00 on [inode 0x1000000051b [2,head] /dc-dir/dc-file_806 auth v5614 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.260747+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624d6b00] now 0 2023-10-03T19:20:48.816 INFO:teuthology.orchestra.run.smithi045.stdout: -7598> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+169 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624d6b00 count now 1/169 2023-10-03T19:20:48.817 INFO:teuthology.orchestra.run.smithi045.stdout: -7597> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000051b) clear_dirty_parent 2023-10-03T19:20:48.817 INFO:teuthology.orchestra.run.smithi045.stdout: -7596> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000051c) _stored_backtrace v 3930 2023-10-03T19:20:48.817 INFO:teuthology.orchestra.run.smithi045.stdout: -7595> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000051c) auth_unpin by 0x55cf624d7080 on [inode 0x1000000051c [2,head] /dc-dir/dc-file_807 auth v5616 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.273861+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624d7080] now 0 2023-10-03T19:20:48.817 INFO:teuthology.orchestra.run.smithi045.stdout: -7594> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+168 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624d7080 count now 1/168 2023-10-03T19:20:48.817 INFO:teuthology.orchestra.run.smithi045.stdout: -7593> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000051c) clear_dirty_parent 2023-10-03T19:20:48.817 INFO:teuthology.orchestra.run.smithi045.stdout: -7592> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000051d) _stored_backtrace v 3934 2023-10-03T19:20:48.817 INFO:teuthology.orchestra.run.smithi045.stdout: -7591> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000051d) auth_unpin by 0x55cf624d7600 on [inode 0x1000000051d [2,head] /dc-dir/dc-file_808 auth v5618 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.287313+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624d7600] now 0 2023-10-03T19:20:48.817 INFO:teuthology.orchestra.run.smithi045.stdout: -7590> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+167 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624d7600 count now 1/167 2023-10-03T19:20:48.817 INFO:teuthology.orchestra.run.smithi045.stdout: -7589> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000051d) clear_dirty_parent 2023-10-03T19:20:48.817 INFO:teuthology.orchestra.run.smithi045.stdout: -7588> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000051e) _stored_backtrace v 3938 2023-10-03T19:20:48.817 INFO:teuthology.orchestra.run.smithi045.stdout: -7587> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000051e) auth_unpin by 0x55cf624d7b80 on [inode 0x1000000051e [2,head] /dc-dir/dc-file_809 auth v5620 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.300711+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624d7b80] now 0 2023-10-03T19:20:48.818 INFO:teuthology.orchestra.run.smithi045.stdout: -7586> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+166 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624d7b80 count now 1/166 2023-10-03T19:20:48.818 INFO:teuthology.orchestra.run.smithi045.stdout: -7585> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000051e) clear_dirty_parent 2023-10-03T19:20:48.818 INFO:teuthology.orchestra.run.smithi045.stdout: -7584> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000051f) _stored_backtrace v 3942 2023-10-03T19:20:48.818 INFO:teuthology.orchestra.run.smithi045.stdout: -7583> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000051f) auth_unpin by 0x55cf624d8100 on [inode 0x1000000051f [2,head] /dc-dir/dc-file_810 auth v5622 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.313584+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624d8100] now 0 2023-10-03T19:20:48.818 INFO:teuthology.orchestra.run.smithi045.stdout: -7582> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+165 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624d8100 count now 1/165 2023-10-03T19:20:48.818 INFO:teuthology.orchestra.run.smithi045.stdout: -7581> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000051f) clear_dirty_parent 2023-10-03T19:20:48.818 INFO:teuthology.orchestra.run.smithi045.stdout: -7580> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000520) _stored_backtrace v 3946 2023-10-03T19:20:48.818 INFO:teuthology.orchestra.run.smithi045.stdout: -7579> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000520) auth_unpin by 0x55cf624d8680 on [inode 0x10000000520 [2,head] /dc-dir/dc-file_811 auth v5624 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.325607+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624d8680] now 0 2023-10-03T19:20:48.818 INFO:teuthology.orchestra.run.smithi045.stdout: -7578> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+164 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624d8680 count now 1/164 2023-10-03T19:20:48.819 INFO:teuthology.orchestra.run.smithi045.stdout: -7577> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000520) clear_dirty_parent 2023-10-03T19:20:48.819 INFO:teuthology.orchestra.run.smithi045.stdout: -7576> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000521) _stored_backtrace v 3950 2023-10-03T19:20:48.819 INFO:teuthology.orchestra.run.smithi045.stdout: -7575> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000521) auth_unpin by 0x55cf624d8c00 on [inode 0x10000000521 [2,head] /dc-dir/dc-file_812 auth v5626 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.337848+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624d8c00] now 0 2023-10-03T19:20:48.819 INFO:teuthology.orchestra.run.smithi045.stdout: -7574> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+163 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624d8c00 count now 1/163 2023-10-03T19:20:48.821 INFO:teuthology.orchestra.run.smithi045.stdout: -7573> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000521) clear_dirty_parent 2023-10-03T19:20:48.821 INFO:teuthology.orchestra.run.smithi045.stdout: -7572> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000522) _stored_backtrace v 3954 2023-10-03T19:20:48.821 INFO:teuthology.orchestra.run.smithi045.stdout: -7571> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000522) auth_unpin by 0x55cf624d9180 on [inode 0x10000000522 [2,head] /dc-dir/dc-file_813 auth v5628 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.349710+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624d9180] now 0 2023-10-03T19:20:48.821 INFO:teuthology.orchestra.run.smithi045.stdout: -7570> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+162 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624d9180 count now 1/162 2023-10-03T19:20:48.821 INFO:teuthology.orchestra.run.smithi045.stdout: -7569> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000522) clear_dirty_parent 2023-10-03T19:20:48.821 INFO:teuthology.orchestra.run.smithi045.stdout: -7568> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000523) _stored_backtrace v 3958 2023-10-03T19:20:48.822 INFO:teuthology.orchestra.run.smithi045.stdout: -7567> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000523) auth_unpin by 0x55cf624d9700 on [inode 0x10000000523 [2,head] /dc-dir/dc-file_814 auth v5630 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.361557+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624d9700] now 0 2023-10-03T19:20:48.822 INFO:teuthology.orchestra.run.smithi045.stdout: -7566> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+161 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624d9700 count now 1/161 2023-10-03T19:20:48.822 INFO:teuthology.orchestra.run.smithi045.stdout: -7565> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000523) clear_dirty_parent 2023-10-03T19:20:48.822 INFO:teuthology.orchestra.run.smithi045.stdout: -7564> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000524) _stored_backtrace v 3962 2023-10-03T19:20:48.822 INFO:teuthology.orchestra.run.smithi045.stdout: -7563> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000524) auth_unpin by 0x55cf624e0000 on [inode 0x10000000524 [2,head] /dc-dir/dc-file_815 auth v5632 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.372895+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624e0000] now 0 2023-10-03T19:20:48.822 INFO:teuthology.orchestra.run.smithi045.stdout: -7562> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+160 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624e0000 count now 1/160 2023-10-03T19:20:48.822 INFO:teuthology.orchestra.run.smithi045.stdout: -7561> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000524) clear_dirty_parent 2023-10-03T19:20:48.822 INFO:teuthology.orchestra.run.smithi045.stdout: -7560> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000525) _stored_backtrace v 3966 2023-10-03T19:20:48.822 INFO:teuthology.orchestra.run.smithi045.stdout: -7559> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000525) auth_unpin by 0x55cf624e0580 on [inode 0x10000000525 [2,head] /dc-dir/dc-file_816 auth v5634 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.385253+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624e0580] now 0 2023-10-03T19:20:48.822 INFO:teuthology.orchestra.run.smithi045.stdout: -7558> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+159 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624e0580 count now 1/159 2023-10-03T19:20:48.822 INFO:teuthology.orchestra.run.smithi045.stdout: -7557> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000525) clear_dirty_parent 2023-10-03T19:20:48.823 INFO:teuthology.orchestra.run.smithi045.stdout: -7556> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000526) _stored_backtrace v 3970 2023-10-03T19:20:48.823 INFO:teuthology.orchestra.run.smithi045.stdout: -7555> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000526) auth_unpin by 0x55cf624e0b00 on [inode 0x10000000526 [2,head] /dc-dir/dc-file_817 auth v5636 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.396723+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624e0b00] now 0 2023-10-03T19:20:48.823 INFO:teuthology.orchestra.run.smithi045.stdout: -7554> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+158 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624e0b00 count now 1/158 2023-10-03T19:20:48.823 INFO:teuthology.orchestra.run.smithi045.stdout: -7553> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000526) clear_dirty_parent 2023-10-03T19:20:48.823 INFO:teuthology.orchestra.run.smithi045.stdout: -7552> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000527) _stored_backtrace v 3974 2023-10-03T19:20:48.823 INFO:teuthology.orchestra.run.smithi045.stdout: -7551> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000527) auth_unpin by 0x55cf624e1080 on [inode 0x10000000527 [2,head] /dc-dir/dc-file_818 auth v5638 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.408956+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624e1080] now 0 2023-10-03T19:20:48.823 INFO:teuthology.orchestra.run.smithi045.stdout: -7550> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+157 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624e1080 count now 1/157 2023-10-03T19:20:48.823 INFO:teuthology.orchestra.run.smithi045.stdout: -7549> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000527) clear_dirty_parent 2023-10-03T19:20:48.823 INFO:teuthology.orchestra.run.smithi045.stdout: -7548> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000528) _stored_backtrace v 3978 2023-10-03T19:20:48.823 INFO:teuthology.orchestra.run.smithi045.stdout: -7547> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000528) auth_unpin by 0x55cf624e1600 on [inode 0x10000000528 [2,head] /dc-dir/dc-file_819 auth v5640 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.421064+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624e1600] now 0 2023-10-03T19:20:48.823 INFO:teuthology.orchestra.run.smithi045.stdout: -7546> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+156 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624e1600 count now 1/156 2023-10-03T19:20:48.824 INFO:teuthology.orchestra.run.smithi045.stdout: -7545> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000528) clear_dirty_parent 2023-10-03T19:20:48.824 INFO:teuthology.orchestra.run.smithi045.stdout: -7544> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000529) _stored_backtrace v 3982 2023-10-03T19:20:48.824 INFO:teuthology.orchestra.run.smithi045.stdout: -7543> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000529) auth_unpin by 0x55cf624e1b80 on [inode 0x10000000529 [2,head] /dc-dir/dc-file_820 auth v5642 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.432893+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624e1b80] now 0 2023-10-03T19:20:48.824 INFO:teuthology.orchestra.run.smithi045.stdout: -7542> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+155 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624e1b80 count now 1/155 2023-10-03T19:20:48.824 INFO:teuthology.orchestra.run.smithi045.stdout: -7541> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000529) clear_dirty_parent 2023-10-03T19:20:48.824 INFO:teuthology.orchestra.run.smithi045.stdout: -7540> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000052a) _stored_backtrace v 3986 2023-10-03T19:20:48.824 INFO:teuthology.orchestra.run.smithi045.stdout: -7539> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000052a) auth_unpin by 0x55cf624e2100 on [inode 0x1000000052a [2,head] /dc-dir/dc-file_821 auth v5644 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.444473+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624e2100] now 0 2023-10-03T19:20:48.824 INFO:teuthology.orchestra.run.smithi045.stdout: -7538> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+154 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624e2100 count now 1/154 2023-10-03T19:20:48.824 INFO:teuthology.orchestra.run.smithi045.stdout: -7537> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000052a) clear_dirty_parent 2023-10-03T19:20:48.824 INFO:teuthology.orchestra.run.smithi045.stdout: -7536> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000052b) _stored_backtrace v 3990 2023-10-03T19:20:48.824 INFO:teuthology.orchestra.run.smithi045.stdout: -7535> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000052b) auth_unpin by 0x55cf624e2680 on [inode 0x1000000052b [2,head] /dc-dir/dc-file_822 auth v5646 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.455804+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624e2680] now 0 2023-10-03T19:20:48.824 INFO:teuthology.orchestra.run.smithi045.stdout: -7534> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+153 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624e2680 count now 1/153 2023-10-03T19:20:48.825 INFO:teuthology.orchestra.run.smithi045.stdout: -7533> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000052b) clear_dirty_parent 2023-10-03T19:20:48.825 INFO:teuthology.orchestra.run.smithi045.stdout: -7532> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000052c) _stored_backtrace v 3994 2023-10-03T19:20:48.825 INFO:teuthology.orchestra.run.smithi045.stdout: -7531> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000052c) auth_unpin by 0x55cf624e2c00 on [inode 0x1000000052c [2,head] /dc-dir/dc-file_823 auth v5648 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.467474+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624e2c00] now 0 2023-10-03T19:20:48.825 INFO:teuthology.orchestra.run.smithi045.stdout: -7530> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+152 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624e2c00 count now 1/152 2023-10-03T19:20:48.825 INFO:teuthology.orchestra.run.smithi045.stdout: -7529> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000052c) clear_dirty_parent 2023-10-03T19:20:48.825 INFO:teuthology.orchestra.run.smithi045.stdout: -7528> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000052d) _stored_backtrace v 3998 2023-10-03T19:20:48.825 INFO:teuthology.orchestra.run.smithi045.stdout: -7527> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000052d) auth_unpin by 0x55cf624e3180 on [inode 0x1000000052d [2,head] /dc-dir/dc-file_824 auth v5650 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.479482+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624e3180] now 0 2023-10-03T19:20:48.825 INFO:teuthology.orchestra.run.smithi045.stdout: -7526> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+151 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624e3180 count now 1/151 2023-10-03T19:20:48.825 INFO:teuthology.orchestra.run.smithi045.stdout: -7525> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000052d) clear_dirty_parent 2023-10-03T19:20:48.825 INFO:teuthology.orchestra.run.smithi045.stdout: -7524> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000052e) _stored_backtrace v 4002 2023-10-03T19:20:48.825 INFO:teuthology.orchestra.run.smithi045.stdout: -7523> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000052e) auth_unpin by 0x55cf624e3700 on [inode 0x1000000052e [2,head] /dc-dir/dc-file_825 auth v5652 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.492072+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf624e3700] now 0 2023-10-03T19:20:48.825 INFO:teuthology.orchestra.run.smithi045.stdout: -7522> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+150 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624e3700 count now 1/150 2023-10-03T19:20:48.826 INFO:teuthology.orchestra.run.smithi045.stdout: -7521> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000052e) clear_dirty_parent 2023-10-03T19:20:48.826 INFO:teuthology.orchestra.run.smithi045.stdout: -7520> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000052f) _stored_backtrace v 4006 2023-10-03T19:20:48.826 INFO:teuthology.orchestra.run.smithi045.stdout: -7519> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000052f) auth_unpin by 0x55cf6225c000 on [inode 0x1000000052f [2,head] /dc-dir/dc-file_826 auth v5654 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.503823+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6225c000] now 0 2023-10-03T19:20:48.826 INFO:teuthology.orchestra.run.smithi045.stdout: -7518> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+149 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6225c000 count now 1/149 2023-10-03T19:20:48.826 INFO:teuthology.orchestra.run.smithi045.stdout: -7517> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000052f) clear_dirty_parent 2023-10-03T19:20:48.826 INFO:teuthology.orchestra.run.smithi045.stdout: -7516> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 MDSContext::complete: 21C_MaybeExpiredSegment 2023-10-03T19:20:48.826 INFO:teuthology.orchestra.run.smithi045.stdout: -7515> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.log _maybe_expired segment 1025/6208052, 1024 events 2023-10-03T19:20:48.826 INFO:teuthology.orchestra.run.smithi045.stdout: -7514> 2023-10-03T19:15:17.707+0000 7f0f05562640 6 mds.0.journal LogSegment(1025/6208052).try_to_expire 2023-10-03T19:20:48.830 INFO:teuthology.orchestra.run.smithi045.stdout: -7513> 2023-10-03T19:15:17.707+0000 7f0f05562640 4 mds.0.sessionmap save_if_dirty: writing 0 2023-10-03T19:20:48.830 INFO:teuthology.orchestra.run.smithi045.stdout: -7512> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.journal try_to_expire waiting for purge of [] 2023-10-03T19:20:48.830 INFO:teuthology.orchestra.run.smithi045.stdout: -7511> 2023-10-03T19:15:17.707+0000 7f0f05562640 6 mds.0.journal LogSegment(1025/6208052).try_to_expire success 2023-10-03T19:20:48.831 INFO:teuthology.orchestra.run.smithi045.stdout: -7510> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.log try_expire expired segment 1025/6208052 2023-10-03T19:20:48.831 INFO:teuthology.orchestra.run.smithi045.stdout: -7509> 2023-10-03T19:15:17.707+0000 7f0f05562640 5 mds.0.log _expired segment 1025/6208052, 1024 events 2023-10-03T19:20:48.831 INFO:teuthology.orchestra.run.smithi045.stdout: -7508> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 MDSIOContextBase::complete: 20BatchStoredBacktrace 2023-10-03T19:20:48.831 INFO:teuthology.orchestra.run.smithi045.stdout: -7507> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 MDSContext::complete: 20BatchStoredBacktrace 2023-10-03T19:20:48.831 INFO:teuthology.orchestra.run.smithi045.stdout: -7506> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000548) _stored_backtrace v 4282 2023-10-03T19:20:48.831 INFO:teuthology.orchestra.run.smithi045.stdout: -7505> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000548) auth_unpin by 0x55cf6250d080 on [inode 0x10000000548 [2,head] /dc-dir/dc-file_851 auth v5704 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.927756+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6250d080] now 0 2023-10-03T19:20:48.831 INFO:teuthology.orchestra.run.smithi045.stdout: -7504> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+148 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6250d080 count now 1/148 2023-10-03T19:20:48.831 INFO:teuthology.orchestra.run.smithi045.stdout: -7503> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000548) clear_dirty_parent 2023-10-03T19:20:48.831 INFO:teuthology.orchestra.run.smithi045.stdout: -7502> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000549) _stored_backtrace v 4286 2023-10-03T19:20:48.831 INFO:teuthology.orchestra.run.smithi045.stdout: -7501> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000549) auth_unpin by 0x55cf6250d600 on [inode 0x10000000549 [2,head] /dc-dir/dc-file_852 auth v5706 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.941567+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6250d600] now 0 2023-10-03T19:20:48.831 INFO:teuthology.orchestra.run.smithi045.stdout: -7500> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+147 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6250d600 count now 1/147 2023-10-03T19:20:48.832 INFO:teuthology.orchestra.run.smithi045.stdout: -7499> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000549) clear_dirty_parent 2023-10-03T19:20:48.832 INFO:teuthology.orchestra.run.smithi045.stdout: -7498> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000054a) _stored_backtrace v 4290 2023-10-03T19:20:48.832 INFO:teuthology.orchestra.run.smithi045.stdout: -7497> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000054a) auth_unpin by 0x55cf6250db80 on [inode 0x1000000054a [2,head] /dc-dir/dc-file_853 auth v5708 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.952360+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6250db80] now 0 2023-10-03T19:20:48.832 INFO:teuthology.orchestra.run.smithi045.stdout: -7496> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+146 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6250db80 count now 1/146 2023-10-03T19:20:48.832 INFO:teuthology.orchestra.run.smithi045.stdout: -7495> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000054a) clear_dirty_parent 2023-10-03T19:20:48.832 INFO:teuthology.orchestra.run.smithi045.stdout: -7494> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000054b) _stored_backtrace v 4294 2023-10-03T19:20:48.832 INFO:teuthology.orchestra.run.smithi045.stdout: -7493> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000054b) auth_unpin by 0x55cf6250e100 on [inode 0x1000000054b [2,head] /dc-dir/dc-file_854 auth v5710 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.964002+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6250e100] now 0 2023-10-03T19:20:48.832 INFO:teuthology.orchestra.run.smithi045.stdout: -7492> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+145 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6250e100 count now 1/145 2023-10-03T19:20:48.832 INFO:teuthology.orchestra.run.smithi045.stdout: -7491> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000054b) clear_dirty_parent 2023-10-03T19:20:48.832 INFO:teuthology.orchestra.run.smithi045.stdout: -7490> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000054c) _stored_backtrace v 4298 2023-10-03T19:20:48.832 INFO:teuthology.orchestra.run.smithi045.stdout: -7489> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000054c) auth_unpin by 0x55cf6250e680 on [inode 0x1000000054c [2,head] /dc-dir/dc-file_855 auth v5712 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.975357+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6250e680] now 0 2023-10-03T19:20:48.832 INFO:teuthology.orchestra.run.smithi045.stdout: -7488> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+144 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6250e680 count now 1/144 2023-10-03T19:20:48.832 INFO:teuthology.orchestra.run.smithi045.stdout: -7487> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000054c) clear_dirty_parent 2023-10-03T19:20:48.833 INFO:teuthology.orchestra.run.smithi045.stdout: -7486> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000054d) _stored_backtrace v 4302 2023-10-03T19:20:48.833 INFO:teuthology.orchestra.run.smithi045.stdout: -7485> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000054d) auth_unpin by 0x55cf6250ec00 on [inode 0x1000000054d [2,head] /dc-dir/dc-file_856 auth v5714 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.986571+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6250ec00] now 0 2023-10-03T19:20:48.833 INFO:teuthology.orchestra.run.smithi045.stdout: -7484> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+143 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6250ec00 count now 1/143 2023-10-03T19:20:48.833 INFO:teuthology.orchestra.run.smithi045.stdout: -7483> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000054d) clear_dirty_parent 2023-10-03T19:20:48.833 INFO:teuthology.orchestra.run.smithi045.stdout: -7482> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000054e) _stored_backtrace v 4306 2023-10-03T19:20:48.833 INFO:teuthology.orchestra.run.smithi045.stdout: -7481> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000054e) auth_unpin by 0x55cf6250f180 on [inode 0x1000000054e [2,head] /dc-dir/dc-file_857 auth v5716 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:44.999350+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6250f180] now 0 2023-10-03T19:20:48.833 INFO:teuthology.orchestra.run.smithi045.stdout: -7480> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+142 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6250f180 count now 1/142 2023-10-03T19:20:48.833 INFO:teuthology.orchestra.run.smithi045.stdout: -7479> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000054e) clear_dirty_parent 2023-10-03T19:20:48.833 INFO:teuthology.orchestra.run.smithi045.stdout: -7478> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000054f) _stored_backtrace v 4310 2023-10-03T19:20:48.833 INFO:teuthology.orchestra.run.smithi045.stdout: -7477> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000054f) auth_unpin by 0x55cf6250f700 on [inode 0x1000000054f [2,head] /dc-dir/dc-file_858 auth v5718 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.011060+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6250f700] now 0 2023-10-03T19:20:48.833 INFO:teuthology.orchestra.run.smithi045.stdout: -7476> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+141 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6250f700 count now 1/141 2023-10-03T19:20:48.833 INFO:teuthology.orchestra.run.smithi045.stdout: -7475> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000054f) clear_dirty_parent 2023-10-03T19:20:48.834 INFO:teuthology.orchestra.run.smithi045.stdout: -7474> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000550) _stored_backtrace v 4314 2023-10-03T19:20:48.834 INFO:teuthology.orchestra.run.smithi045.stdout: -7473> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000550) auth_unpin by 0x55cf6251a000 on [inode 0x10000000550 [2,head] /dc-dir/dc-file_859 auth v5720 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.022491+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6251a000] now 0 2023-10-03T19:20:48.834 INFO:teuthology.orchestra.run.smithi045.stdout: -7472> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+140 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6251a000 count now 1/140 2023-10-03T19:20:48.834 INFO:teuthology.orchestra.run.smithi045.stdout: -7471> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000550) clear_dirty_parent 2023-10-03T19:20:48.834 INFO:teuthology.orchestra.run.smithi045.stdout: -7470> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000551) _stored_backtrace v 4318 2023-10-03T19:20:48.834 INFO:teuthology.orchestra.run.smithi045.stdout: -7469> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000551) auth_unpin by 0x55cf6251a580 on [inode 0x10000000551 [2,head] /dc-dir/dc-file_860 auth v5722 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.035544+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6251a580] now 0 2023-10-03T19:20:48.834 INFO:teuthology.orchestra.run.smithi045.stdout: -7468> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+139 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6251a580 count now 1/139 2023-10-03T19:20:48.834 INFO:teuthology.orchestra.run.smithi045.stdout: -7467> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000551) clear_dirty_parent 2023-10-03T19:20:48.834 INFO:teuthology.orchestra.run.smithi045.stdout: -7466> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000552) _stored_backtrace v 4322 2023-10-03T19:20:48.835 INFO:teuthology.orchestra.run.smithi045.stdout: -7465> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000552) auth_unpin by 0x55cf6251ab00 on [inode 0x10000000552 [2,head] /dc-dir/dc-file_861 auth v5724 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.048188+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6251ab00] now 0 2023-10-03T19:20:48.835 INFO:teuthology.orchestra.run.smithi045.stdout: -7464> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+138 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6251ab00 count now 1/138 2023-10-03T19:20:48.835 INFO:teuthology.orchestra.run.smithi045.stdout: -7463> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000552) clear_dirty_parent 2023-10-03T19:20:48.835 INFO:teuthology.orchestra.run.smithi045.stdout: -7462> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000553) _stored_backtrace v 4326 2023-10-03T19:20:48.835 INFO:teuthology.orchestra.run.smithi045.stdout: -7461> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000553) auth_unpin by 0x55cf6251b080 on [inode 0x10000000553 [2,head] /dc-dir/dc-file_862 auth v5726 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.059565+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6251b080] now 0 2023-10-03T19:20:48.835 INFO:teuthology.orchestra.run.smithi045.stdout: -7460> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+137 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6251b080 count now 1/137 2023-10-03T19:20:48.835 INFO:teuthology.orchestra.run.smithi045.stdout: -7459> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000553) clear_dirty_parent 2023-10-03T19:20:48.835 INFO:teuthology.orchestra.run.smithi045.stdout: -7458> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000554) _stored_backtrace v 4330 2023-10-03T19:20:48.835 INFO:teuthology.orchestra.run.smithi045.stdout: -7457> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000554) auth_unpin by 0x55cf6251b600 on [inode 0x10000000554 [2,head] /dc-dir/dc-file_863 auth v5728 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.071903+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6251b600] now 0 2023-10-03T19:20:48.835 INFO:teuthology.orchestra.run.smithi045.stdout: -7456> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+136 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6251b600 count now 1/136 2023-10-03T19:20:48.835 INFO:teuthology.orchestra.run.smithi045.stdout: -7455> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000554) clear_dirty_parent 2023-10-03T19:20:48.835 INFO:teuthology.orchestra.run.smithi045.stdout: -7454> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000555) _stored_backtrace v 4334 2023-10-03T19:20:48.835 INFO:teuthology.orchestra.run.smithi045.stdout: -7453> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000555) auth_unpin by 0x55cf6251bb80 on [inode 0x10000000555 [2,head] /dc-dir/dc-file_864 auth v5730 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.083720+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6251bb80] now 0 2023-10-03T19:20:48.836 INFO:teuthology.orchestra.run.smithi045.stdout: -7452> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+135 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6251bb80 count now 1/135 2023-10-03T19:20:48.836 INFO:teuthology.orchestra.run.smithi045.stdout: -7451> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000555) clear_dirty_parent 2023-10-03T19:20:48.836 INFO:teuthology.orchestra.run.smithi045.stdout: -7450> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000556) _stored_backtrace v 4338 2023-10-03T19:20:48.836 INFO:teuthology.orchestra.run.smithi045.stdout: -7449> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000556) auth_unpin by 0x55cf6251c100 on [inode 0x10000000556 [2,head] /dc-dir/dc-file_865 auth v5732 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.095216+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6251c100] now 0 2023-10-03T19:20:48.836 INFO:teuthology.orchestra.run.smithi045.stdout: -7448> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+134 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6251c100 count now 1/134 2023-10-03T19:20:48.836 INFO:teuthology.orchestra.run.smithi045.stdout: -7447> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000556) clear_dirty_parent 2023-10-03T19:20:48.836 INFO:teuthology.orchestra.run.smithi045.stdout: -7446> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000557) _stored_backtrace v 4342 2023-10-03T19:20:48.836 INFO:teuthology.orchestra.run.smithi045.stdout: -7445> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000557) auth_unpin by 0x55cf6251c680 on [inode 0x10000000557 [2,head] /dc-dir/dc-file_866 auth v5734 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.107664+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6251c680] now 0 2023-10-03T19:20:48.836 INFO:teuthology.orchestra.run.smithi045.stdout: -7444> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+133 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6251c680 count now 1/133 2023-10-03T19:20:48.836 INFO:teuthology.orchestra.run.smithi045.stdout: -7443> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000557) clear_dirty_parent 2023-10-03T19:20:48.836 INFO:teuthology.orchestra.run.smithi045.stdout: -7442> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000558) _stored_backtrace v 4346 2023-10-03T19:20:48.836 INFO:teuthology.orchestra.run.smithi045.stdout: -7441> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000558) auth_unpin by 0x55cf6251cc00 on [inode 0x10000000558 [2,head] /dc-dir/dc-file_867 auth v5736 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.118603+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6251cc00] now 0 2023-10-03T19:20:48.837 INFO:teuthology.orchestra.run.smithi045.stdout: -7440> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+132 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6251cc00 count now 1/132 2023-10-03T19:20:48.837 INFO:teuthology.orchestra.run.smithi045.stdout: -7439> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000558) clear_dirty_parent 2023-10-03T19:20:48.837 INFO:teuthology.orchestra.run.smithi045.stdout: -7438> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000559) _stored_backtrace v 4350 2023-10-03T19:20:48.847 INFO:teuthology.orchestra.run.smithi045.stdout: -7437> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000559) auth_unpin by 0x55cf6251d180 on [inode 0x10000000559 [2,head] /dc-dir/dc-file_868 auth v5738 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.132017+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6251d180] now 0 2023-10-03T19:20:48.847 INFO:teuthology.orchestra.run.smithi045.stdout: -7436> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+131 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6251d180 count now 1/131 2023-10-03T19:20:48.848 INFO:teuthology.orchestra.run.smithi045.stdout: -7435> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000559) clear_dirty_parent 2023-10-03T19:20:48.848 INFO:teuthology.orchestra.run.smithi045.stdout: -7434> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000055a) _stored_backtrace v 4354 2023-10-03T19:20:48.848 INFO:teuthology.orchestra.run.smithi045.stdout: -7433> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000055a) auth_unpin by 0x55cf6251d700 on [inode 0x1000000055a [2,head] /dc-dir/dc-file_869 auth v5740 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.143352+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6251d700] now 0 2023-10-03T19:20:48.848 INFO:teuthology.orchestra.run.smithi045.stdout: -7432> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+130 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6251d700 count now 1/130 2023-10-03T19:20:48.848 INFO:teuthology.orchestra.run.smithi045.stdout: -7431> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000055a) clear_dirty_parent 2023-10-03T19:20:48.848 INFO:teuthology.orchestra.run.smithi045.stdout: -7430> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000055b) _stored_backtrace v 4358 2023-10-03T19:20:48.848 INFO:teuthology.orchestra.run.smithi045.stdout: -7429> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000055b) auth_unpin by 0x55cf62524000 on [inode 0x1000000055b [2,head] /dc-dir/dc-file_870 auth v5742 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.156212+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62524000] now 0 2023-10-03T19:20:48.848 INFO:teuthology.orchestra.run.smithi045.stdout: -7428> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+129 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62524000 count now 1/129 2023-10-03T19:20:48.848 INFO:teuthology.orchestra.run.smithi045.stdout: -7427> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000055b) clear_dirty_parent 2023-10-03T19:20:48.848 INFO:teuthology.orchestra.run.smithi045.stdout: -7426> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000055c) _stored_backtrace v 4362 2023-10-03T19:20:48.848 INFO:teuthology.orchestra.run.smithi045.stdout: -7425> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000055c) auth_unpin by 0x55cf62524580 on [inode 0x1000000055c [2,head] /dc-dir/dc-file_871 auth v5744 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.168693+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62524580] now 0 2023-10-03T19:20:48.849 INFO:teuthology.orchestra.run.smithi045.stdout: -7424> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+128 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62524580 count now 1/128 2023-10-03T19:20:48.849 INFO:teuthology.orchestra.run.smithi045.stdout: -7423> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000055c) clear_dirty_parent 2023-10-03T19:20:48.849 INFO:teuthology.orchestra.run.smithi045.stdout: -7422> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000055d) _stored_backtrace v 4366 2023-10-03T19:20:48.849 INFO:teuthology.orchestra.run.smithi045.stdout: -7421> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000055d) auth_unpin by 0x55cf62524b00 on [inode 0x1000000055d [2,head] /dc-dir/dc-file_872 auth v5746 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.181140+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62524b00] now 0 2023-10-03T19:20:48.849 INFO:teuthology.orchestra.run.smithi045.stdout: -7420> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+127 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62524b00 count now 1/127 2023-10-03T19:20:48.849 INFO:teuthology.orchestra.run.smithi045.stdout: -7419> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000055d) clear_dirty_parent 2023-10-03T19:20:48.849 INFO:teuthology.orchestra.run.smithi045.stdout: -7418> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000055e) _stored_backtrace v 4370 2023-10-03T19:20:48.849 INFO:teuthology.orchestra.run.smithi045.stdout: -7417> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000055e) auth_unpin by 0x55cf62525080 on [inode 0x1000000055e [2,head] /dc-dir/dc-file_873 auth v5748 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.192626+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62525080] now 0 2023-10-03T19:20:48.849 INFO:teuthology.orchestra.run.smithi045.stdout: -7416> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+126 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62525080 count now 1/126 2023-10-03T19:20:48.849 INFO:teuthology.orchestra.run.smithi045.stdout: -7415> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000055e) clear_dirty_parent 2023-10-03T19:20:48.849 INFO:teuthology.orchestra.run.smithi045.stdout: -7414> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000055f) _stored_backtrace v 4374 2023-10-03T19:20:48.849 INFO:teuthology.orchestra.run.smithi045.stdout: -7413> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000055f) auth_unpin by 0x55cf62525600 on [inode 0x1000000055f [2,head] /dc-dir/dc-file_874 auth v5750 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.205309+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62525600] now 0 2023-10-03T19:20:48.850 INFO:teuthology.orchestra.run.smithi045.stdout: -7412> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+125 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62525600 count now 1/125 2023-10-03T19:20:48.850 INFO:teuthology.orchestra.run.smithi045.stdout: -7411> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000055f) clear_dirty_parent 2023-10-03T19:20:48.850 INFO:teuthology.orchestra.run.smithi045.stdout: -7410> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000560) _stored_backtrace v 4378 2023-10-03T19:20:48.850 INFO:teuthology.orchestra.run.smithi045.stdout: -7409> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000560) auth_unpin by 0x55cf62525b80 on [inode 0x10000000560 [2,head] /dc-dir/dc-file_875 auth v5752 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.216818+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62525b80] now 0 2023-10-03T19:20:48.850 INFO:teuthology.orchestra.run.smithi045.stdout: -7408> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+124 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62525b80 count now 1/124 2023-10-03T19:20:48.850 INFO:teuthology.orchestra.run.smithi045.stdout: -7407> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000560) clear_dirty_parent 2023-10-03T19:20:48.850 INFO:teuthology.orchestra.run.smithi045.stdout: -7406> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000561) _stored_backtrace v 4382 2023-10-03T19:20:48.851 INFO:teuthology.orchestra.run.smithi045.stdout: -7405> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000561) auth_unpin by 0x55cf62526100 on [inode 0x10000000561 [2,head] /dc-dir/dc-file_876 auth v5754 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.228305+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62526100] now 0 2023-10-03T19:20:48.851 INFO:teuthology.orchestra.run.smithi045.stdout: -7404> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+123 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62526100 count now 1/123 2023-10-03T19:20:48.851 INFO:teuthology.orchestra.run.smithi045.stdout: -7403> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000561) clear_dirty_parent 2023-10-03T19:20:48.851 INFO:teuthology.orchestra.run.smithi045.stdout: -7402> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000562) _stored_backtrace v 4386 2023-10-03T19:20:48.851 INFO:teuthology.orchestra.run.smithi045.stdout: -7401> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000562) auth_unpin by 0x55cf62526680 on [inode 0x10000000562 [2,head] /dc-dir/dc-file_877 auth v5756 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.239987+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62526680] now 0 2023-10-03T19:20:48.851 INFO:teuthology.orchestra.run.smithi045.stdout: -7400> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+122 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62526680 count now 1/122 2023-10-03T19:20:48.851 INFO:teuthology.orchestra.run.smithi045.stdout: -7399> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000562) clear_dirty_parent 2023-10-03T19:20:48.851 INFO:teuthology.orchestra.run.smithi045.stdout: -7398> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000563) _stored_backtrace v 4390 2023-10-03T19:20:48.851 INFO:teuthology.orchestra.run.smithi045.stdout: -7397> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000563) auth_unpin by 0x55cf62526c00 on [inode 0x10000000563 [2,head] /dc-dir/dc-file_878 auth v5758 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.251772+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62526c00] now 0 2023-10-03T19:20:48.851 INFO:teuthology.orchestra.run.smithi045.stdout: -7396> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+121 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62526c00 count now 1/121 2023-10-03T19:20:48.851 INFO:teuthology.orchestra.run.smithi045.stdout: -7395> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000563) clear_dirty_parent 2023-10-03T19:20:48.852 INFO:teuthology.orchestra.run.smithi045.stdout: -7394> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000564) _stored_backtrace v 4394 2023-10-03T19:20:48.852 INFO:teuthology.orchestra.run.smithi045.stdout: -7393> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000564) auth_unpin by 0x55cf62527180 on [inode 0x10000000564 [2,head] /dc-dir/dc-file_879 auth v5760 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.263082+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62527180] now 0 2023-10-03T19:20:48.852 INFO:teuthology.orchestra.run.smithi045.stdout: -7392> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+120 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62527180 count now 1/120 2023-10-03T19:20:48.852 INFO:teuthology.orchestra.run.smithi045.stdout: -7391> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000564) clear_dirty_parent 2023-10-03T19:20:48.852 INFO:teuthology.orchestra.run.smithi045.stdout: -7390> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000565) _stored_backtrace v 4398 2023-10-03T19:20:48.852 INFO:teuthology.orchestra.run.smithi045.stdout: -7389> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000565) auth_unpin by 0x55cf62527700 on [inode 0x10000000565 [2,head] /dc-dir/dc-file_880 auth v5762 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.275476+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62527700] now 0 2023-10-03T19:20:48.852 INFO:teuthology.orchestra.run.smithi045.stdout: -7388> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+119 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62527700 count now 1/119 2023-10-03T19:20:48.852 INFO:teuthology.orchestra.run.smithi045.stdout: -7387> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000565) clear_dirty_parent 2023-10-03T19:20:48.852 INFO:teuthology.orchestra.run.smithi045.stdout: -7386> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000566) _stored_backtrace v 4402 2023-10-03T19:20:48.852 INFO:teuthology.orchestra.run.smithi045.stdout: -7385> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000566) auth_unpin by 0x55cf6252a000 on [inode 0x10000000566 [2,head] /dc-dir/dc-file_881 auth v5764 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.287936+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6252a000] now 0 2023-10-03T19:20:48.852 INFO:teuthology.orchestra.run.smithi045.stdout: -7384> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+118 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6252a000 count now 1/118 2023-10-03T19:20:48.853 INFO:teuthology.orchestra.run.smithi045.stdout: -7383> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000566) clear_dirty_parent 2023-10-03T19:20:48.853 INFO:teuthology.orchestra.run.smithi045.stdout: -7382> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000567) _stored_backtrace v 4406 2023-10-03T19:20:48.853 INFO:teuthology.orchestra.run.smithi045.stdout: -7381> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000567) auth_unpin by 0x55cf6252a580 on [inode 0x10000000567 [2,head] /dc-dir/dc-file_882 auth v5766 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.299989+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6252a580] now 0 2023-10-03T19:20:48.853 INFO:teuthology.orchestra.run.smithi045.stdout: -7380> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+117 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6252a580 count now 1/117 2023-10-03T19:20:48.873 INFO:teuthology.orchestra.run.smithi045.stdout: -7379> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000567) clear_dirty_parent 2023-10-03T19:20:48.874 INFO:teuthology.orchestra.run.smithi045.stdout: -7378> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000568) _stored_backtrace v 4410 2023-10-03T19:20:48.874 INFO:teuthology.orchestra.run.smithi045.stdout: -7377> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000568) auth_unpin by 0x55cf6252ab00 on [inode 0x10000000568 [2,head] /dc-dir/dc-file_883 auth v5768 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.311725+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6252ab00] now 0 2023-10-03T19:20:48.874 INFO:teuthology.orchestra.run.smithi045.stdout: -7376> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+116 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6252ab00 count now 1/116 2023-10-03T19:20:48.874 INFO:teuthology.orchestra.run.smithi045.stdout: -7375> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000568) clear_dirty_parent 2023-10-03T19:20:48.874 INFO:teuthology.orchestra.run.smithi045.stdout: -7374> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000569) _stored_backtrace v 4414 2023-10-03T19:20:48.874 INFO:teuthology.orchestra.run.smithi045.stdout: -7373> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000569) auth_unpin by 0x55cf6252b080 on [inode 0x10000000569 [2,head] /dc-dir/dc-file_884 auth v5770 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.324409+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6252b080] now 0 2023-10-03T19:20:48.874 INFO:teuthology.orchestra.run.smithi045.stdout: -7372> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+115 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6252b080 count now 1/115 2023-10-03T19:20:48.874 INFO:teuthology.orchestra.run.smithi045.stdout: -7371> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000569) clear_dirty_parent 2023-10-03T19:20:48.874 INFO:teuthology.orchestra.run.smithi045.stdout: -7370> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000056a) _stored_backtrace v 4418 2023-10-03T19:20:48.875 INFO:teuthology.orchestra.run.smithi045.stdout: -7369> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000056a) auth_unpin by 0x55cf6252b600 on [inode 0x1000000056a [2,head] /dc-dir/dc-file_885 auth v5772 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.335913+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6252b600] now 0 2023-10-03T19:20:48.875 INFO:teuthology.orchestra.run.smithi045.stdout: -7368> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+114 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6252b600 count now 1/114 2023-10-03T19:20:48.875 INFO:teuthology.orchestra.run.smithi045.stdout: -7367> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000056a) clear_dirty_parent 2023-10-03T19:20:48.875 INFO:teuthology.orchestra.run.smithi045.stdout: -7366> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000056b) _stored_backtrace v 4422 2023-10-03T19:20:48.875 INFO:teuthology.orchestra.run.smithi045.stdout: -7365> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000056b) auth_unpin by 0x55cf6252bb80 on [inode 0x1000000056b [2,head] /dc-dir/dc-file_886 auth v5774 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.348546+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6252bb80] now 0 2023-10-03T19:20:48.875 INFO:teuthology.orchestra.run.smithi045.stdout: -7364> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+113 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6252bb80 count now 1/113 2023-10-03T19:20:48.875 INFO:teuthology.orchestra.run.smithi045.stdout: -7363> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000056b) clear_dirty_parent 2023-10-03T19:20:48.875 INFO:teuthology.orchestra.run.smithi045.stdout: -7362> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000056c) _stored_backtrace v 4426 2023-10-03T19:20:48.875 INFO:teuthology.orchestra.run.smithi045.stdout: -7361> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000056c) auth_unpin by 0x55cf6252c100 on [inode 0x1000000056c [2,head] /dc-dir/dc-file_887 auth v5776 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.359711+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6252c100] now 0 2023-10-03T19:20:48.875 INFO:teuthology.orchestra.run.smithi045.stdout: -7360> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+112 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6252c100 count now 1/112 2023-10-03T19:20:48.876 INFO:teuthology.orchestra.run.smithi045.stdout: -7359> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000056c) clear_dirty_parent 2023-10-03T19:20:48.876 INFO:teuthology.orchestra.run.smithi045.stdout: -7358> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000056d) _stored_backtrace v 4430 2023-10-03T19:20:48.876 INFO:teuthology.orchestra.run.smithi045.stdout: -7357> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000056d) auth_unpin by 0x55cf6252c680 on [inode 0x1000000056d [2,head] /dc-dir/dc-file_888 auth v5778 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.372018+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6252c680] now 0 2023-10-03T19:20:48.876 INFO:teuthology.orchestra.run.smithi045.stdout: -7356> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+111 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6252c680 count now 1/111 2023-10-03T19:20:48.876 INFO:teuthology.orchestra.run.smithi045.stdout: -7355> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000056d) clear_dirty_parent 2023-10-03T19:20:48.876 INFO:teuthology.orchestra.run.smithi045.stdout: -7354> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000056e) _stored_backtrace v 4434 2023-10-03T19:20:48.876 INFO:teuthology.orchestra.run.smithi045.stdout: -7353> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000056e) auth_unpin by 0x55cf6252cc00 on [inode 0x1000000056e [2,head] /dc-dir/dc-file_889 auth v5780 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.384245+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6252cc00] now 0 2023-10-03T19:20:48.876 INFO:teuthology.orchestra.run.smithi045.stdout: -7352> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+110 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6252cc00 count now 1/110 2023-10-03T19:20:48.876 INFO:teuthology.orchestra.run.smithi045.stdout: -7351> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000056e) clear_dirty_parent 2023-10-03T19:20:48.876 INFO:teuthology.orchestra.run.smithi045.stdout: -7350> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000056f) _stored_backtrace v 4438 2023-10-03T19:20:48.876 INFO:teuthology.orchestra.run.smithi045.stdout: -7349> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000056f) auth_unpin by 0x55cf6252d180 on [inode 0x1000000056f [2,head] /dc-dir/dc-file_890 auth v5782 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.396184+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6252d180] now 0 2023-10-03T19:20:48.876 INFO:teuthology.orchestra.run.smithi045.stdout: -7348> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+109 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6252d180 count now 1/109 2023-10-03T19:20:48.877 INFO:teuthology.orchestra.run.smithi045.stdout: -7347> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000056f) clear_dirty_parent 2023-10-03T19:20:48.877 INFO:teuthology.orchestra.run.smithi045.stdout: -7346> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000570) _stored_backtrace v 4442 2023-10-03T19:20:48.877 INFO:teuthology.orchestra.run.smithi045.stdout: -7345> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000570) auth_unpin by 0x55cf6252d700 on [inode 0x10000000570 [2,head] /dc-dir/dc-file_891 auth v5784 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.407148+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf6252d700] now 0 2023-10-03T19:20:48.881 INFO:teuthology.orchestra.run.smithi045.stdout: -7344> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+108 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6252d700 count now 1/108 2023-10-03T19:20:48.881 INFO:teuthology.orchestra.run.smithi045.stdout: -7343> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000570) clear_dirty_parent 2023-10-03T19:20:48.881 INFO:teuthology.orchestra.run.smithi045.stdout: -7342> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000571) _stored_backtrace v 4446 2023-10-03T19:20:48.881 INFO:teuthology.orchestra.run.smithi045.stdout: -7341> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000571) auth_unpin by 0x55cf62536000 on [inode 0x10000000571 [2,head] /dc-dir/dc-file_892 auth v5786 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.418547+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62536000] now 0 2023-10-03T19:20:48.882 INFO:teuthology.orchestra.run.smithi045.stdout: -7340> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+107 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62536000 count now 1/107 2023-10-03T19:20:48.882 INFO:teuthology.orchestra.run.smithi045.stdout: -7339> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000571) clear_dirty_parent 2023-10-03T19:20:48.882 INFO:teuthology.orchestra.run.smithi045.stdout: -7338> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000572) _stored_backtrace v 4450 2023-10-03T19:20:48.882 INFO:teuthology.orchestra.run.smithi045.stdout: -7337> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000572) auth_unpin by 0x55cf62536580 on [inode 0x10000000572 [2,head] /dc-dir/dc-file_893 auth v5788 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.429511+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62536580] now 0 2023-10-03T19:20:48.882 INFO:teuthology.orchestra.run.smithi045.stdout: -7336> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+106 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62536580 count now 1/106 2023-10-03T19:20:48.882 INFO:teuthology.orchestra.run.smithi045.stdout: -7335> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000572) clear_dirty_parent 2023-10-03T19:20:48.882 INFO:teuthology.orchestra.run.smithi045.stdout: -7334> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000573) _stored_backtrace v 4454 2023-10-03T19:20:48.882 INFO:teuthology.orchestra.run.smithi045.stdout: -7333> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000573) auth_unpin by 0x55cf62536b00 on [inode 0x10000000573 [2,head] /dc-dir/dc-file_894 auth v5790 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.440120+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62536b00] now 0 2023-10-03T19:20:48.882 INFO:teuthology.orchestra.run.smithi045.stdout: -7332> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+105 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62536b00 count now 1/105 2023-10-03T19:20:48.882 INFO:teuthology.orchestra.run.smithi045.stdout: -7331> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000573) clear_dirty_parent 2023-10-03T19:20:48.883 INFO:teuthology.orchestra.run.smithi045.stdout: -7330> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000574) _stored_backtrace v 4458 2023-10-03T19:20:48.883 INFO:teuthology.orchestra.run.smithi045.stdout: -7329> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000574) auth_unpin by 0x55cf62537080 on [inode 0x10000000574 [2,head] /dc-dir/dc-file_895 auth v5792 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.450975+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62537080] now 0 2023-10-03T19:20:48.883 INFO:teuthology.orchestra.run.smithi045.stdout: -7328> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+104 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62537080 count now 1/104 2023-10-03T19:20:48.883 INFO:teuthology.orchestra.run.smithi045.stdout: -7327> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000574) clear_dirty_parent 2023-10-03T19:20:48.883 INFO:teuthology.orchestra.run.smithi045.stdout: -7326> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000575) _stored_backtrace v 4462 2023-10-03T19:20:48.883 INFO:teuthology.orchestra.run.smithi045.stdout: -7325> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000575) auth_unpin by 0x55cf62537600 on [inode 0x10000000575 [2,head] /dc-dir/dc-file_896 auth v5794 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.462676+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62537600] now 0 2023-10-03T19:20:48.883 INFO:teuthology.orchestra.run.smithi045.stdout: -7324> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+103 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62537600 count now 1/103 2023-10-03T19:20:48.883 INFO:teuthology.orchestra.run.smithi045.stdout: -7323> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000575) clear_dirty_parent 2023-10-03T19:20:48.883 INFO:teuthology.orchestra.run.smithi045.stdout: -7322> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000576) _stored_backtrace v 4466 2023-10-03T19:20:48.883 INFO:teuthology.orchestra.run.smithi045.stdout: -7321> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000576) auth_unpin by 0x55cf62537b80 on [inode 0x10000000576 [2,head] /dc-dir/dc-file_897 auth v5796 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.473580+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62537b80] now 0 2023-10-03T19:20:48.883 INFO:teuthology.orchestra.run.smithi045.stdout: -7320> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+102 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62537b80 count now 1/102 2023-10-03T19:20:48.884 INFO:teuthology.orchestra.run.smithi045.stdout: -7319> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000576) clear_dirty_parent 2023-10-03T19:20:48.884 INFO:teuthology.orchestra.run.smithi045.stdout: -7318> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000577) _stored_backtrace v 4470 2023-10-03T19:20:48.884 INFO:teuthology.orchestra.run.smithi045.stdout: -7317> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000577) auth_unpin by 0x55cf62538100 on [inode 0x10000000577 [2,head] /dc-dir/dc-file_898 auth v5798 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.486308+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62538100] now 0 2023-10-03T19:20:48.884 INFO:teuthology.orchestra.run.smithi045.stdout: -7316> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+101 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62538100 count now 1/101 2023-10-03T19:20:48.884 INFO:teuthology.orchestra.run.smithi045.stdout: -7315> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000577) clear_dirty_parent 2023-10-03T19:20:48.884 INFO:teuthology.orchestra.run.smithi045.stdout: -7314> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000578) _stored_backtrace v 4474 2023-10-03T19:20:48.884 INFO:teuthology.orchestra.run.smithi045.stdout: -7313> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000578) auth_unpin by 0x55cf62538680 on [inode 0x10000000578 [2,head] /dc-dir/dc-file_899 auth v5800 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.499139+0000 b3 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cf62538680] now 0 2023-10-03T19:20:48.884 INFO:teuthology.orchestra.run.smithi045.stdout: -7312> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+100 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62538680 count now 1/100 2023-10-03T19:20:48.884 INFO:teuthology.orchestra.run.smithi045.stdout: -7311> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000578) clear_dirty_parent 2023-10-03T19:20:48.884 INFO:teuthology.orchestra.run.smithi045.stdout: -7310> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000579) _stored_backtrace v 4478 2023-10-03T19:20:48.884 INFO:teuthology.orchestra.run.smithi045.stdout: -7309> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000579) auth_unpin by 0x55cf62538c00 on [inode 0x10000000579 [2,head] /dc-dir/dc-file_900 auth v5802 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.510923+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62538c00] now 0 2023-10-03T19:20:48.884 INFO:teuthology.orchestra.run.smithi045.stdout: -7308> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+99 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62538c00 count now 1/99 2023-10-03T19:20:48.885 INFO:teuthology.orchestra.run.smithi045.stdout: -7307> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000579) clear_dirty_parent 2023-10-03T19:20:48.885 INFO:teuthology.orchestra.run.smithi045.stdout: -7306> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000057a) _stored_backtrace v 4650 2023-10-03T19:20:48.885 INFO:teuthology.orchestra.run.smithi045.stdout: -7305> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000057a) auth_unpin by 0x55cf62539180 on [inode 0x1000000057a [2,head] /dc-dir/dc-file_901 auth v5804 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.605077+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62539180] now 0 2023-10-03T19:20:48.885 INFO:teuthology.orchestra.run.smithi045.stdout: -7304> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+98 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62539180 count now 1/98 2023-10-03T19:20:48.885 INFO:teuthology.orchestra.run.smithi045.stdout: -7303> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000057a) clear_dirty_parent 2023-10-03T19:20:48.885 INFO:teuthology.orchestra.run.smithi045.stdout: -7302> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000057b) _stored_backtrace v 4654 2023-10-03T19:20:48.885 INFO:teuthology.orchestra.run.smithi045.stdout: -7301> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000057b) auth_unpin by 0x55cf62539700 on [inode 0x1000000057b [2,head] /dc-dir/dc-file_902 auth v5806 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.649354+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62539700] now 0 2023-10-03T19:20:48.885 INFO:teuthology.orchestra.run.smithi045.stdout: -7300> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+97 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62539700 count now 1/97 2023-10-03T19:20:48.885 INFO:teuthology.orchestra.run.smithi045.stdout: -7299> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000057b) clear_dirty_parent 2023-10-03T19:20:48.885 INFO:teuthology.orchestra.run.smithi045.stdout: -7298> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000057c) _stored_backtrace v 4658 2023-10-03T19:20:48.886 INFO:teuthology.orchestra.run.smithi045.stdout: -7297> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000057c) auth_unpin by 0x55cf62582000 on [inode 0x1000000057c [2,head] /dc-dir/dc-file_903 auth v5808 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.660649+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62582000] now 0 2023-10-03T19:20:48.886 INFO:teuthology.orchestra.run.smithi045.stdout: -7296> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+96 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62582000 count now 1/96 2023-10-03T19:20:48.886 INFO:teuthology.orchestra.run.smithi045.stdout: -7295> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000057c) clear_dirty_parent 2023-10-03T19:20:48.886 INFO:teuthology.orchestra.run.smithi045.stdout: -7294> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000057d) _stored_backtrace v 4662 2023-10-03T19:20:48.886 INFO:teuthology.orchestra.run.smithi045.stdout: -7293> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000057d) auth_unpin by 0x55cf62582580 on [inode 0x1000000057d [2,head] /dc-dir/dc-file_904 auth v5810 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.673422+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62582580] now 0 2023-10-03T19:20:48.886 INFO:teuthology.orchestra.run.smithi045.stdout: -7292> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+95 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62582580 count now 1/95 2023-10-03T19:20:48.974 INFO:teuthology.orchestra.run.smithi045.stdout: -7291> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000057d) clear_dirty_parent 2023-10-03T19:20:48.974 INFO:teuthology.orchestra.run.smithi045.stdout: -7290> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000057e) _stored_backtrace v 4666 2023-10-03T19:20:48.974 INFO:teuthology.orchestra.run.smithi045.stdout: -7289> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000057e) auth_unpin by 0x55cf62582b00 on [inode 0x1000000057e [2,head] /dc-dir/dc-file_905 auth v5812 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.685163+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62582b00] now 0 2023-10-03T19:20:48.974 INFO:teuthology.orchestra.run.smithi045.stdout: -7288> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+94 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62582b00 count now 1/94 2023-10-03T19:20:48.974 INFO:teuthology.orchestra.run.smithi045.stdout: -7287> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000057e) clear_dirty_parent 2023-10-03T19:20:48.974 INFO:teuthology.orchestra.run.smithi045.stdout: -7286> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000057f) _stored_backtrace v 4670 2023-10-03T19:20:48.974 INFO:teuthology.orchestra.run.smithi045.stdout: -7285> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000057f) auth_unpin by 0x55cf62583080 on [inode 0x1000000057f [2,head] /dc-dir/dc-file_906 auth v5814 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.696552+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62583080] now 0 2023-10-03T19:20:48.975 INFO:teuthology.orchestra.run.smithi045.stdout: -7284> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+93 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62583080 count now 1/93 2023-10-03T19:20:48.975 INFO:teuthology.orchestra.run.smithi045.stdout: -7283> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000057f) clear_dirty_parent 2023-10-03T19:20:48.975 INFO:teuthology.orchestra.run.smithi045.stdout: -7282> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000580) _stored_backtrace v 4674 2023-10-03T19:20:48.975 INFO:teuthology.orchestra.run.smithi045.stdout: -7281> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000580) auth_unpin by 0x55cf62583600 on [inode 0x10000000580 [2,head] /dc-dir/dc-file_907 auth v5816 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.708613+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62583600] now 0 2023-10-03T19:20:48.975 INFO:teuthology.orchestra.run.smithi045.stdout: -7280> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+92 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62583600 count now 1/92 2023-10-03T19:20:48.975 INFO:teuthology.orchestra.run.smithi045.stdout: -7279> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000580) clear_dirty_parent 2023-10-03T19:20:48.975 INFO:teuthology.orchestra.run.smithi045.stdout: -7278> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000581) _stored_backtrace v 4678 2023-10-03T19:20:48.975 INFO:teuthology.orchestra.run.smithi045.stdout: -7277> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000581) auth_unpin by 0x55cf62583b80 on [inode 0x10000000581 [2,head] /dc-dir/dc-file_908 auth v5818 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.720329+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62583b80] now 0 2023-10-03T19:20:48.975 INFO:teuthology.orchestra.run.smithi045.stdout: -7276> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+91 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62583b80 count now 1/91 2023-10-03T19:20:48.975 INFO:teuthology.orchestra.run.smithi045.stdout: -7275> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000581) clear_dirty_parent 2023-10-03T19:20:48.975 INFO:teuthology.orchestra.run.smithi045.stdout: -7274> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000582) _stored_backtrace v 4682 2023-10-03T19:20:48.976 INFO:teuthology.orchestra.run.smithi045.stdout: -7273> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000582) auth_unpin by 0x55cf62584100 on [inode 0x10000000582 [2,head] /dc-dir/dc-file_909 auth v5820 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.731754+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62584100] now 0 2023-10-03T19:20:48.976 INFO:teuthology.orchestra.run.smithi045.stdout: -7272> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+90 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62584100 count now 1/90 2023-10-03T19:20:48.976 INFO:teuthology.orchestra.run.smithi045.stdout: -7271> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000582) clear_dirty_parent 2023-10-03T19:20:48.976 INFO:teuthology.orchestra.run.smithi045.stdout: -7270> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000583) _stored_backtrace v 4686 2023-10-03T19:20:48.976 INFO:teuthology.orchestra.run.smithi045.stdout: -7269> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000583) auth_unpin by 0x55cf62584680 on [inode 0x10000000583 [2,head] /dc-dir/dc-file_910 auth v5822 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.742946+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62584680] now 0 2023-10-03T19:20:48.976 INFO:teuthology.orchestra.run.smithi045.stdout: -7268> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+89 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62584680 count now 1/89 2023-10-03T19:20:48.976 INFO:teuthology.orchestra.run.smithi045.stdout: -7267> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000583) clear_dirty_parent 2023-10-03T19:20:48.976 INFO:teuthology.orchestra.run.smithi045.stdout: -7266> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000584) _stored_backtrace v 4690 2023-10-03T19:20:48.976 INFO:teuthology.orchestra.run.smithi045.stdout: -7265> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000584) auth_unpin by 0x55cf62584c00 on [inode 0x10000000584 [2,head] /dc-dir/dc-file_911 auth v5824 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.754523+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62584c00] now 0 2023-10-03T19:20:48.977 INFO:teuthology.orchestra.run.smithi045.stdout: -7264> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+88 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62584c00 count now 1/88 2023-10-03T19:20:48.977 INFO:teuthology.orchestra.run.smithi045.stdout: -7263> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000584) clear_dirty_parent 2023-10-03T19:20:48.977 INFO:teuthology.orchestra.run.smithi045.stdout: -7262> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000585) _stored_backtrace v 4694 2023-10-03T19:20:48.977 INFO:teuthology.orchestra.run.smithi045.stdout: -7261> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000585) auth_unpin by 0x55cf62585180 on [inode 0x10000000585 [2,head] /dc-dir/dc-file_912 auth v5826 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.765566+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62585180] now 0 2023-10-03T19:20:48.977 INFO:teuthology.orchestra.run.smithi045.stdout: -7260> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+87 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62585180 count now 1/87 2023-10-03T19:20:48.977 INFO:teuthology.orchestra.run.smithi045.stdout: -7259> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000585) clear_dirty_parent 2023-10-03T19:20:48.977 INFO:teuthology.orchestra.run.smithi045.stdout: -7258> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000586) _stored_backtrace v 4698 2023-10-03T19:20:48.977 INFO:teuthology.orchestra.run.smithi045.stdout: -7257> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000586) auth_unpin by 0x55cf62585700 on [inode 0x10000000586 [2,head] /dc-dir/dc-file_913 auth v5828 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.776598+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62585700] now 0 2023-10-03T19:20:48.977 INFO:teuthology.orchestra.run.smithi045.stdout: -7256> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+86 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62585700 count now 1/86 2023-10-03T19:20:48.977 INFO:teuthology.orchestra.run.smithi045.stdout: -7255> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000586) clear_dirty_parent 2023-10-03T19:20:48.977 INFO:teuthology.orchestra.run.smithi045.stdout: -7254> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000587) _stored_backtrace v 4702 2023-10-03T19:20:48.978 INFO:teuthology.orchestra.run.smithi045.stdout: -7253> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000587) auth_unpin by 0x55cf62586000 on [inode 0x10000000587 [2,head] /dc-dir/dc-file_914 auth v5830 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.787826+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62586000] now 0 2023-10-03T19:20:48.978 INFO:teuthology.orchestra.run.smithi045.stdout: -7252> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+85 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62586000 count now 1/85 2023-10-03T19:20:48.978 INFO:teuthology.orchestra.run.smithi045.stdout: -7251> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000587) clear_dirty_parent 2023-10-03T19:20:48.978 INFO:teuthology.orchestra.run.smithi045.stdout: -7250> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000588) _stored_backtrace v 4706 2023-10-03T19:20:48.978 INFO:teuthology.orchestra.run.smithi045.stdout: -7249> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000588) auth_unpin by 0x55cf62586580 on [inode 0x10000000588 [2,head] /dc-dir/dc-file_915 auth v5832 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.799547+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62586580] now 0 2023-10-03T19:20:48.978 INFO:teuthology.orchestra.run.smithi045.stdout: -7248> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+84 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62586580 count now 1/84 2023-10-03T19:20:48.978 INFO:teuthology.orchestra.run.smithi045.stdout: -7247> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000588) clear_dirty_parent 2023-10-03T19:20:48.978 INFO:teuthology.orchestra.run.smithi045.stdout: -7246> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000589) _stored_backtrace v 4710 2023-10-03T19:20:48.978 INFO:teuthology.orchestra.run.smithi045.stdout: -7245> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000589) auth_unpin by 0x55cf62586b00 on [inode 0x10000000589 [2,head] /dc-dir/dc-file_916 auth v5834 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.811585+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62586b00] now 0 2023-10-03T19:20:48.978 INFO:teuthology.orchestra.run.smithi045.stdout: -7244> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+83 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62586b00 count now 1/83 2023-10-03T19:20:48.979 INFO:teuthology.orchestra.run.smithi045.stdout: -7243> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000589) clear_dirty_parent 2023-10-03T19:20:48.979 INFO:teuthology.orchestra.run.smithi045.stdout: -7242> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000058a) _stored_backtrace v 4714 2023-10-03T19:20:48.979 INFO:teuthology.orchestra.run.smithi045.stdout: -7241> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000058a) auth_unpin by 0x55cf62587080 on [inode 0x1000000058a [2,head] /dc-dir/dc-file_917 auth v5836 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.822785+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62587080] now 0 2023-10-03T19:20:48.979 INFO:teuthology.orchestra.run.smithi045.stdout: -7240> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+82 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62587080 count now 1/82 2023-10-03T19:20:48.979 INFO:teuthology.orchestra.run.smithi045.stdout: -7239> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000058a) clear_dirty_parent 2023-10-03T19:20:48.979 INFO:teuthology.orchestra.run.smithi045.stdout: -7238> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000058b) _stored_backtrace v 4718 2023-10-03T19:20:48.979 INFO:teuthology.orchestra.run.smithi045.stdout: -7237> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000058b) auth_unpin by 0x55cf62587600 on [inode 0x1000000058b [2,head] /dc-dir/dc-file_918 auth v5838 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.835343+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62587600] now 0 2023-10-03T19:20:48.979 INFO:teuthology.orchestra.run.smithi045.stdout: -7236> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+81 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62587600 count now 1/81 2023-10-03T19:20:48.979 INFO:teuthology.orchestra.run.smithi045.stdout: -7235> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000058b) clear_dirty_parent 2023-10-03T19:20:48.979 INFO:teuthology.orchestra.run.smithi045.stdout: -7234> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000058c) _stored_backtrace v 4722 2023-10-03T19:20:48.980 INFO:teuthology.orchestra.run.smithi045.stdout: -7233> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000058c) auth_unpin by 0x55cf62587b80 on [inode 0x1000000058c [2,head] /dc-dir/dc-file_919 auth v5840 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.849454+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62587b80] now 0 2023-10-03T19:20:48.980 INFO:teuthology.orchestra.run.smithi045.stdout: -7232> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+80 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62587b80 count now 1/80 2023-10-03T19:20:48.980 INFO:teuthology.orchestra.run.smithi045.stdout: -7231> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000058c) clear_dirty_parent 2023-10-03T19:20:48.980 INFO:teuthology.orchestra.run.smithi045.stdout: -7230> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000058d) _stored_backtrace v 4726 2023-10-03T19:20:48.980 INFO:teuthology.orchestra.run.smithi045.stdout: -7229> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000058d) auth_unpin by 0x55cf62588100 on [inode 0x1000000058d [2,head] /dc-dir/dc-file_920 auth v5842 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.863522+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62588100] now 0 2023-10-03T19:20:48.980 INFO:teuthology.orchestra.run.smithi045.stdout: -7228> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+79 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62588100 count now 1/79 2023-10-03T19:20:48.987 INFO:teuthology.orchestra.run.smithi045.stdout: -7227> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000058d) clear_dirty_parent 2023-10-03T19:20:48.987 INFO:teuthology.orchestra.run.smithi045.stdout: -7226> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000058e) _stored_backtrace v 4730 2023-10-03T19:20:48.987 INFO:teuthology.orchestra.run.smithi045.stdout: -7225> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000058e) auth_unpin by 0x55cf62588680 on [inode 0x1000000058e [2,head] /dc-dir/dc-file_921 auth v5844 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.877080+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62588680] now 0 2023-10-03T19:20:48.987 INFO:teuthology.orchestra.run.smithi045.stdout: -7224> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+78 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62588680 count now 1/78 2023-10-03T19:20:48.987 INFO:teuthology.orchestra.run.smithi045.stdout: -7223> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000058e) clear_dirty_parent 2023-10-03T19:20:48.988 INFO:teuthology.orchestra.run.smithi045.stdout: -7222> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000058f) _stored_backtrace v 4734 2023-10-03T19:20:48.988 INFO:teuthology.orchestra.run.smithi045.stdout: -7221> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000058f) auth_unpin by 0x55cf62588c00 on [inode 0x1000000058f [2,head] /dc-dir/dc-file_922 auth v5846 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.890661+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62588c00] now 0 2023-10-03T19:20:48.988 INFO:teuthology.orchestra.run.smithi045.stdout: -7220> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+77 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62588c00 count now 1/77 2023-10-03T19:20:48.988 INFO:teuthology.orchestra.run.smithi045.stdout: -7219> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000058f) clear_dirty_parent 2023-10-03T19:20:48.988 INFO:teuthology.orchestra.run.smithi045.stdout: -7218> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000590) _stored_backtrace v 4738 2023-10-03T19:20:48.988 INFO:teuthology.orchestra.run.smithi045.stdout: -7217> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000590) auth_unpin by 0x55cf62589180 on [inode 0x10000000590 [2,head] /dc-dir/dc-file_923 auth v5848 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.904722+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62589180] now 0 2023-10-03T19:20:48.988 INFO:teuthology.orchestra.run.smithi045.stdout: -7216> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+76 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62589180 count now 1/76 2023-10-03T19:20:48.988 INFO:teuthology.orchestra.run.smithi045.stdout: -7215> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000590) clear_dirty_parent 2023-10-03T19:20:48.988 INFO:teuthology.orchestra.run.smithi045.stdout: -7214> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000591) _stored_backtrace v 4742 2023-10-03T19:20:48.988 INFO:teuthology.orchestra.run.smithi045.stdout: -7213> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000591) auth_unpin by 0x55cf62589700 on [inode 0x10000000591 [2,head] /dc-dir/dc-file_924 auth v5850 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.916141+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62589700] now 0 2023-10-03T19:20:48.988 INFO:teuthology.orchestra.run.smithi045.stdout: -7212> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+75 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62589700 count now 1/75 2023-10-03T19:20:48.989 INFO:teuthology.orchestra.run.smithi045.stdout: -7211> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000591) clear_dirty_parent 2023-10-03T19:20:48.989 INFO:teuthology.orchestra.run.smithi045.stdout: -7210> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000592) _stored_backtrace v 4746 2023-10-03T19:20:48.989 INFO:teuthology.orchestra.run.smithi045.stdout: -7209> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000592) auth_unpin by 0x55cf6258c000 on [inode 0x10000000592 [2,head] /dc-dir/dc-file_925 auth v5852 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.927638+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf6258c000] now 0 2023-10-03T19:20:48.989 INFO:teuthology.orchestra.run.smithi045.stdout: -7208> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+74 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6258c000 count now 1/74 2023-10-03T19:20:48.989 INFO:teuthology.orchestra.run.smithi045.stdout: -7207> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000592) clear_dirty_parent 2023-10-03T19:20:48.989 INFO:teuthology.orchestra.run.smithi045.stdout: -7206> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000593) _stored_backtrace v 4750 2023-10-03T19:20:48.989 INFO:teuthology.orchestra.run.smithi045.stdout: -7205> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000593) auth_unpin by 0x55cf6258c580 on [inode 0x10000000593 [2,head] /dc-dir/dc-file_926 auth v5854 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.938963+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf6258c580] now 0 2023-10-03T19:20:48.989 INFO:teuthology.orchestra.run.smithi045.stdout: -7204> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+73 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6258c580 count now 1/73 2023-10-03T19:20:48.989 INFO:teuthology.orchestra.run.smithi045.stdout: -7203> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000593) clear_dirty_parent 2023-10-03T19:20:48.989 INFO:teuthology.orchestra.run.smithi045.stdout: -7202> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000594) _stored_backtrace v 4754 2023-10-03T19:20:48.990 INFO:teuthology.orchestra.run.smithi045.stdout: -7201> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000594) auth_unpin by 0x55cf6258cb00 on [inode 0x10000000594 [2,head] /dc-dir/dc-file_927 auth v5856 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.952747+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf6258cb00] now 0 2023-10-03T19:20:48.990 INFO:teuthology.orchestra.run.smithi045.stdout: -7200> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+72 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6258cb00 count now 1/72 2023-10-03T19:20:48.990 INFO:teuthology.orchestra.run.smithi045.stdout: -7199> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000594) clear_dirty_parent 2023-10-03T19:20:48.990 INFO:teuthology.orchestra.run.smithi045.stdout: -7198> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000595) _stored_backtrace v 4758 2023-10-03T19:20:48.990 INFO:teuthology.orchestra.run.smithi045.stdout: -7197> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000595) auth_unpin by 0x55cf6258d080 on [inode 0x10000000595 [2,head] /dc-dir/dc-file_928 auth v5858 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.964142+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf6258d080] now 0 2023-10-03T19:20:48.990 INFO:teuthology.orchestra.run.smithi045.stdout: -7196> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+71 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6258d080 count now 1/71 2023-10-03T19:20:48.990 INFO:teuthology.orchestra.run.smithi045.stdout: -7195> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000595) clear_dirty_parent 2023-10-03T19:20:48.990 INFO:teuthology.orchestra.run.smithi045.stdout: -7194> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000596) _stored_backtrace v 4762 2023-10-03T19:20:48.990 INFO:teuthology.orchestra.run.smithi045.stdout: -7193> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000596) auth_unpin by 0x55cf6258d600 on [inode 0x10000000596 [2,head] /dc-dir/dc-file_929 auth v5860 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.975622+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf6258d600] now 0 2023-10-03T19:20:48.990 INFO:teuthology.orchestra.run.smithi045.stdout: -7192> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+70 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6258d600 count now 1/70 2023-10-03T19:20:48.990 INFO:teuthology.orchestra.run.smithi045.stdout: -7191> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000596) clear_dirty_parent 2023-10-03T19:20:48.991 INFO:teuthology.orchestra.run.smithi045.stdout: -7190> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000597) _stored_backtrace v 4766 2023-10-03T19:20:48.991 INFO:teuthology.orchestra.run.smithi045.stdout: -7189> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000597) auth_unpin by 0x55cf6258db80 on [inode 0x10000000597 [2,head] /dc-dir/dc-file_930 auth v5862 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.988680+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf6258db80] now 0 2023-10-03T19:20:48.991 INFO:teuthology.orchestra.run.smithi045.stdout: -7188> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+69 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6258db80 count now 1/69 2023-10-03T19:20:48.991 INFO:teuthology.orchestra.run.smithi045.stdout: -7187> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000597) clear_dirty_parent 2023-10-03T19:20:48.991 INFO:teuthology.orchestra.run.smithi045.stdout: -7186> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000598) _stored_backtrace v 4770 2023-10-03T19:20:48.991 INFO:teuthology.orchestra.run.smithi045.stdout: -7185> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000598) auth_unpin by 0x55cf6258e100 on [inode 0x10000000598 [2,head] /dc-dir/dc-file_931 auth v5864 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:45.999959+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf6258e100] now 0 2023-10-03T19:20:48.991 INFO:teuthology.orchestra.run.smithi045.stdout: -7184> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+68 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6258e100 count now 1/68 2023-10-03T19:20:48.991 INFO:teuthology.orchestra.run.smithi045.stdout: -7183> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000598) clear_dirty_parent 2023-10-03T19:20:48.991 INFO:teuthology.orchestra.run.smithi045.stdout: -7182> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000599) _stored_backtrace v 4774 2023-10-03T19:20:48.991 INFO:teuthology.orchestra.run.smithi045.stdout: -7181> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000599) auth_unpin by 0x55cf6258e680 on [inode 0x10000000599 [2,head] /dc-dir/dc-file_932 auth v5866 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.012330+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf6258e680] now 0 2023-10-03T19:20:48.991 INFO:teuthology.orchestra.run.smithi045.stdout: -7180> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+67 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6258e680 count now 1/67 2023-10-03T19:20:48.992 INFO:teuthology.orchestra.run.smithi045.stdout: -7179> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000599) clear_dirty_parent 2023-10-03T19:20:48.992 INFO:teuthology.orchestra.run.smithi045.stdout: -7178> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000059a) _stored_backtrace v 4778 2023-10-03T19:20:48.992 INFO:teuthology.orchestra.run.smithi045.stdout: -7177> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000059a) auth_unpin by 0x55cf6258ec00 on [inode 0x1000000059a [2,head] /dc-dir/dc-file_933 auth v5868 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.023712+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf6258ec00] now 0 2023-10-03T19:20:48.992 INFO:teuthology.orchestra.run.smithi045.stdout: -7176> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+66 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6258ec00 count now 1/66 2023-10-03T19:20:48.992 INFO:teuthology.orchestra.run.smithi045.stdout: -7175> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000059a) clear_dirty_parent 2023-10-03T19:20:48.992 INFO:teuthology.orchestra.run.smithi045.stdout: -7174> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000059b) _stored_backtrace v 4782 2023-10-03T19:20:48.992 INFO:teuthology.orchestra.run.smithi045.stdout: -7173> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000059b) auth_unpin by 0x55cf6258f180 on [inode 0x1000000059b [2,head] /dc-dir/dc-file_934 auth v5870 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.036963+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf6258f180] now 0 2023-10-03T19:20:48.992 INFO:teuthology.orchestra.run.smithi045.stdout: -7172> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+65 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6258f180 count now 1/65 2023-10-03T19:20:48.992 INFO:teuthology.orchestra.run.smithi045.stdout: -7171> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000059b) clear_dirty_parent 2023-10-03T19:20:48.992 INFO:teuthology.orchestra.run.smithi045.stdout: -7170> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000059c) _stored_backtrace v 4786 2023-10-03T19:20:48.992 INFO:teuthology.orchestra.run.smithi045.stdout: -7169> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000059c) auth_unpin by 0x55cf6258f700 on [inode 0x1000000059c [2,head] /dc-dir/dc-file_935 auth v5872 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.048305+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf6258f700] now 0 2023-10-03T19:20:48.993 INFO:teuthology.orchestra.run.smithi045.stdout: -7168> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+64 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6258f700 count now 1/64 2023-10-03T19:20:48.993 INFO:teuthology.orchestra.run.smithi045.stdout: -7167> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000059c) clear_dirty_parent 2023-10-03T19:20:48.993 INFO:teuthology.orchestra.run.smithi045.stdout: -7166> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000059d) _stored_backtrace v 4790 2023-10-03T19:20:48.993 INFO:teuthology.orchestra.run.smithi045.stdout: -7165> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000059d) auth_unpin by 0x55cf62596000 on [inode 0x1000000059d [2,head] /dc-dir/dc-file_936 auth v5874 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.059802+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62596000] now 0 2023-10-03T19:20:48.993 INFO:teuthology.orchestra.run.smithi045.stdout: -7164> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+63 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62596000 count now 1/63 2023-10-03T19:20:48.993 INFO:teuthology.orchestra.run.smithi045.stdout: -7163> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000059d) clear_dirty_parent 2023-10-03T19:20:48.993 INFO:teuthology.orchestra.run.smithi045.stdout: -7162> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000059e) _stored_backtrace v 4794 2023-10-03T19:20:48.993 INFO:teuthology.orchestra.run.smithi045.stdout: -7161> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000059e) auth_unpin by 0x55cf62596580 on [inode 0x1000000059e [2,head] /dc-dir/dc-file_937 auth v5876 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.073285+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62596580] now 0 2023-10-03T19:20:48.993 INFO:teuthology.orchestra.run.smithi045.stdout: -7160> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+62 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62596580 count now 1/62 2023-10-03T19:20:48.993 INFO:teuthology.orchestra.run.smithi045.stdout: -7159> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000059e) clear_dirty_parent 2023-10-03T19:20:48.993 INFO:teuthology.orchestra.run.smithi045.stdout: -7158> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000059f) _stored_backtrace v 4798 2023-10-03T19:20:48.993 INFO:teuthology.orchestra.run.smithi045.stdout: -7157> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000059f) auth_unpin by 0x55cf62596b00 on [inode 0x1000000059f [2,head] /dc-dir/dc-file_938 auth v5878 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.085262+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62596b00] now 0 2023-10-03T19:20:48.994 INFO:teuthology.orchestra.run.smithi045.stdout: -7156> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+61 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62596b00 count now 1/61 2023-10-03T19:20:49.000 INFO:teuthology.orchestra.run.smithi045.stdout: -7155> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000059f) clear_dirty_parent 2023-10-03T19:20:49.000 INFO:teuthology.orchestra.run.smithi045.stdout: -7154> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a0) _stored_backtrace v 4802 2023-10-03T19:20:49.000 INFO:teuthology.orchestra.run.smithi045.stdout: -7153> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a0) auth_unpin by 0x55cf62597080 on [inode 0x100000005a0 [2,head] /dc-dir/dc-file_939 auth v5880 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.097881+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62597080] now 0 2023-10-03T19:20:49.000 INFO:teuthology.orchestra.run.smithi045.stdout: -7152> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+60 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62597080 count now 1/60 2023-10-03T19:20:49.000 INFO:teuthology.orchestra.run.smithi045.stdout: -7151> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a0) clear_dirty_parent 2023-10-03T19:20:49.000 INFO:teuthology.orchestra.run.smithi045.stdout: -7150> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a1) _stored_backtrace v 4806 2023-10-03T19:20:49.000 INFO:teuthology.orchestra.run.smithi045.stdout: -7149> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a1) auth_unpin by 0x55cf62597600 on [inode 0x100000005a1 [2,head] /dc-dir/dc-file_940 auth v5882 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.109594+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62597600] now 0 2023-10-03T19:20:49.001 INFO:teuthology.orchestra.run.smithi045.stdout: -7148> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+59 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62597600 count now 1/59 2023-10-03T19:20:49.001 INFO:teuthology.orchestra.run.smithi045.stdout: -7147> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a1) clear_dirty_parent 2023-10-03T19:20:49.001 INFO:teuthology.orchestra.run.smithi045.stdout: -7146> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a2) _stored_backtrace v 4810 2023-10-03T19:20:49.001 INFO:teuthology.orchestra.run.smithi045.stdout: -7145> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a2) auth_unpin by 0x55cf62597b80 on [inode 0x100000005a2 [2,head] /dc-dir/dc-file_941 auth v5884 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.121334+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62597b80] now 0 2023-10-03T19:20:49.001 INFO:teuthology.orchestra.run.smithi045.stdout: -7144> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+58 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62597b80 count now 1/58 2023-10-03T19:20:49.001 INFO:teuthology.orchestra.run.smithi045.stdout: -7143> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a2) clear_dirty_parent 2023-10-03T19:20:49.001 INFO:teuthology.orchestra.run.smithi045.stdout: -7142> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a3) _stored_backtrace v 4814 2023-10-03T19:20:49.001 INFO:teuthology.orchestra.run.smithi045.stdout: -7141> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a3) auth_unpin by 0x55cf62598100 on [inode 0x100000005a3 [2,head] /dc-dir/dc-file_942 auth v5886 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.133565+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62598100] now 0 2023-10-03T19:20:49.001 INFO:teuthology.orchestra.run.smithi045.stdout: -7140> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+57 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62598100 count now 1/57 2023-10-03T19:20:49.001 INFO:teuthology.orchestra.run.smithi045.stdout: -7139> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a3) clear_dirty_parent 2023-10-03T19:20:49.002 INFO:teuthology.orchestra.run.smithi045.stdout: -7138> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a4) _stored_backtrace v 4818 2023-10-03T19:20:49.002 INFO:teuthology.orchestra.run.smithi045.stdout: -7137> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a4) auth_unpin by 0x55cf62598680 on [inode 0x100000005a4 [2,head] /dc-dir/dc-file_943 auth v5888 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.145587+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62598680] now 0 2023-10-03T19:20:49.002 INFO:teuthology.orchestra.run.smithi045.stdout: -7136> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+56 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62598680 count now 1/56 2023-10-03T19:20:49.002 INFO:teuthology.orchestra.run.smithi045.stdout: -7135> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a4) clear_dirty_parent 2023-10-03T19:20:49.002 INFO:teuthology.orchestra.run.smithi045.stdout: -7134> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a5) _stored_backtrace v 4822 2023-10-03T19:20:49.002 INFO:teuthology.orchestra.run.smithi045.stdout: -7133> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a5) auth_unpin by 0x55cf62598c00 on [inode 0x100000005a5 [2,head] /dc-dir/dc-file_944 auth v5890 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.159098+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62598c00] now 0 2023-10-03T19:20:49.002 INFO:teuthology.orchestra.run.smithi045.stdout: -7132> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+55 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62598c00 count now 1/55 2023-10-03T19:20:49.002 INFO:teuthology.orchestra.run.smithi045.stdout: -7131> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a5) clear_dirty_parent 2023-10-03T19:20:49.002 INFO:teuthology.orchestra.run.smithi045.stdout: -7130> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a6) _stored_backtrace v 4826 2023-10-03T19:20:49.002 INFO:teuthology.orchestra.run.smithi045.stdout: -7129> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a6) auth_unpin by 0x55cf62599180 on [inode 0x100000005a6 [2,head] /dc-dir/dc-file_945 auth v5892 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.170290+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62599180] now 0 2023-10-03T19:20:49.002 INFO:teuthology.orchestra.run.smithi045.stdout: -7128> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+54 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62599180 count now 1/54 2023-10-03T19:20:49.003 INFO:teuthology.orchestra.run.smithi045.stdout: -7127> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a6) clear_dirty_parent 2023-10-03T19:20:49.003 INFO:teuthology.orchestra.run.smithi045.stdout: -7126> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a7) _stored_backtrace v 4830 2023-10-03T19:20:49.003 INFO:teuthology.orchestra.run.smithi045.stdout: -7125> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a7) auth_unpin by 0x55cf62599700 on [inode 0x100000005a7 [2,head] /dc-dir/dc-file_946 auth v5894 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.181295+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62599700] now 0 2023-10-03T19:20:49.003 INFO:teuthology.orchestra.run.smithi045.stdout: -7124> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+53 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62599700 count now 1/53 2023-10-03T19:20:49.003 INFO:teuthology.orchestra.run.smithi045.stdout: -7123> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a7) clear_dirty_parent 2023-10-03T19:20:49.003 INFO:teuthology.orchestra.run.smithi045.stdout: -7122> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a8) _stored_backtrace v 4834 2023-10-03T19:20:49.003 INFO:teuthology.orchestra.run.smithi045.stdout: -7121> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a8) auth_unpin by 0x55cf624be000 on [inode 0x100000005a8 [2,head] /dc-dir/dc-file_947 auth v5896 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.194044+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf624be000] now 0 2023-10-03T19:20:49.003 INFO:teuthology.orchestra.run.smithi045.stdout: -7120> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+52 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624be000 count now 1/52 2023-10-03T19:20:49.003 INFO:teuthology.orchestra.run.smithi045.stdout: -7119> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a8) clear_dirty_parent 2023-10-03T19:20:49.003 INFO:teuthology.orchestra.run.smithi045.stdout: -7118> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a9) _stored_backtrace v 4838 2023-10-03T19:20:49.003 INFO:teuthology.orchestra.run.smithi045.stdout: -7117> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a9) auth_unpin by 0x55cf624be580 on [inode 0x100000005a9 [2,head] /dc-dir/dc-file_948 auth v5898 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.206451+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf624be580] now 0 2023-10-03T19:20:49.003 INFO:teuthology.orchestra.run.smithi045.stdout: -7116> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+51 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624be580 count now 1/51 2023-10-03T19:20:49.004 INFO:teuthology.orchestra.run.smithi045.stdout: -7115> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a9) clear_dirty_parent 2023-10-03T19:20:49.004 INFO:teuthology.orchestra.run.smithi045.stdout: -7114> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005aa) _stored_backtrace v 4842 2023-10-03T19:20:49.004 INFO:teuthology.orchestra.run.smithi045.stdout: -7113> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005aa) auth_unpin by 0x55cf624beb00 on [inode 0x100000005aa [2,head] /dc-dir/dc-file_949 auth v5900 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.218584+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf624beb00] now 0 2023-10-03T19:20:49.004 INFO:teuthology.orchestra.run.smithi045.stdout: -7112> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+50 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624beb00 count now 1/50 2023-10-03T19:20:49.004 INFO:teuthology.orchestra.run.smithi045.stdout: -7111> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005aa) clear_dirty_parent 2023-10-03T19:20:49.004 INFO:teuthology.orchestra.run.smithi045.stdout: -7110> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005ab) _stored_backtrace v 4846 2023-10-03T19:20:49.004 INFO:teuthology.orchestra.run.smithi045.stdout: -7109> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005ab) auth_unpin by 0x55cf624bf080 on [inode 0x100000005ab [2,head] /dc-dir/dc-file_950 auth v5902 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.231068+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf624bf080] now 0 2023-10-03T19:20:49.004 INFO:teuthology.orchestra.run.smithi045.stdout: -7108> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+49 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624bf080 count now 1/49 2023-10-03T19:20:49.004 INFO:teuthology.orchestra.run.smithi045.stdout: -7107> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005ab) clear_dirty_parent 2023-10-03T19:20:49.005 INFO:teuthology.orchestra.run.smithi045.stdout: -7106> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005ac) _stored_backtrace v 4850 2023-10-03T19:20:49.005 INFO:teuthology.orchestra.run.smithi045.stdout: -7105> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005ac) auth_unpin by 0x55cf624bf600 on [inode 0x100000005ac [2,head] /dc-dir/dc-file_951 auth v5904 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.243324+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf624bf600] now 0 2023-10-03T19:20:49.005 INFO:teuthology.orchestra.run.smithi045.stdout: -7104> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+48 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624bf600 count now 1/48 2023-10-03T19:20:49.005 INFO:teuthology.orchestra.run.smithi045.stdout: -7103> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005ac) clear_dirty_parent 2023-10-03T19:20:49.005 INFO:teuthology.orchestra.run.smithi045.stdout: -7102> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005ad) _stored_backtrace v 4854 2023-10-03T19:20:49.005 INFO:teuthology.orchestra.run.smithi045.stdout: -7101> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005ad) auth_unpin by 0x55cf624bfb80 on [inode 0x100000005ad [2,head] /dc-dir/dc-file_952 auth v5906 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.255576+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf624bfb80] now 0 2023-10-03T19:20:49.005 INFO:teuthology.orchestra.run.smithi045.stdout: -7100> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+47 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624bfb80 count now 1/47 2023-10-03T19:20:49.005 INFO:teuthology.orchestra.run.smithi045.stdout: -7099> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005ad) clear_dirty_parent 2023-10-03T19:20:49.005 INFO:teuthology.orchestra.run.smithi045.stdout: -7098> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005ae) _stored_backtrace v 4858 2023-10-03T19:20:49.005 INFO:teuthology.orchestra.run.smithi045.stdout: -7097> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005ae) auth_unpin by 0x55cf624c0100 on [inode 0x100000005ae [2,head] /dc-dir/dc-file_953 auth v5908 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.269403+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf624c0100] now 0 2023-10-03T19:20:49.005 INFO:teuthology.orchestra.run.smithi045.stdout: -7096> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+46 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624c0100 count now 1/46 2023-10-03T19:20:49.005 INFO:teuthology.orchestra.run.smithi045.stdout: -7095> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005ae) clear_dirty_parent 2023-10-03T19:20:49.006 INFO:teuthology.orchestra.run.smithi045.stdout: -7094> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005af) _stored_backtrace v 4862 2023-10-03T19:20:49.006 INFO:teuthology.orchestra.run.smithi045.stdout: -7093> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005af) auth_unpin by 0x55cf624c0680 on [inode 0x100000005af [2,head] /dc-dir/dc-file_954 auth v5910 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.283326+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf624c0680] now 0 2023-10-03T19:20:49.006 INFO:teuthology.orchestra.run.smithi045.stdout: -7092> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+45 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624c0680 count now 1/45 2023-10-03T19:20:49.006 INFO:teuthology.orchestra.run.smithi045.stdout: -7091> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005af) clear_dirty_parent 2023-10-03T19:20:49.006 INFO:teuthology.orchestra.run.smithi045.stdout: -7090> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b0) _stored_backtrace v 4866 2023-10-03T19:20:49.006 INFO:teuthology.orchestra.run.smithi045.stdout: -7089> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b0) auth_unpin by 0x55cf624c0c00 on [inode 0x100000005b0 [2,head] /dc-dir/dc-file_955 auth v5912 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.297051+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf624c0c00] now 0 2023-10-03T19:20:49.006 INFO:teuthology.orchestra.run.smithi045.stdout: -7088> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+44 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624c0c00 count now 1/44 2023-10-03T19:20:49.006 INFO:teuthology.orchestra.run.smithi045.stdout: -7087> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b0) clear_dirty_parent 2023-10-03T19:20:49.006 INFO:teuthology.orchestra.run.smithi045.stdout: -7086> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b1) _stored_backtrace v 4870 2023-10-03T19:20:49.006 INFO:teuthology.orchestra.run.smithi045.stdout: -7085> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b1) auth_unpin by 0x55cf624c1180 on [inode 0x100000005b1 [2,head] /dc-dir/dc-file_956 auth v5914 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.308468+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf624c1180] now 0 2023-10-03T19:20:49.006 INFO:teuthology.orchestra.run.smithi045.stdout: -7084> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+43 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624c1180 count now 1/43 2023-10-03T19:20:49.013 INFO:teuthology.orchestra.run.smithi045.stdout: -7083> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b1) clear_dirty_parent 2023-10-03T19:20:49.013 INFO:teuthology.orchestra.run.smithi045.stdout: -7082> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b2) _stored_backtrace v 4874 2023-10-03T19:20:49.013 INFO:teuthology.orchestra.run.smithi045.stdout: -7081> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b2) auth_unpin by 0x55cf624c1700 on [inode 0x100000005b2 [2,head] /dc-dir/dc-file_957 auth v5916 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.321869+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf624c1700] now 0 2023-10-03T19:20:49.013 INFO:teuthology.orchestra.run.smithi045.stdout: -7080> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+42 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf624c1700 count now 1/42 2023-10-03T19:20:49.013 INFO:teuthology.orchestra.run.smithi045.stdout: -7079> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b2) clear_dirty_parent 2023-10-03T19:20:49.013 INFO:teuthology.orchestra.run.smithi045.stdout: -7078> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b3) _stored_backtrace v 4878 2023-10-03T19:20:49.014 INFO:teuthology.orchestra.run.smithi045.stdout: -7077> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b3) auth_unpin by 0x55cf6259e000 on [inode 0x100000005b3 [2,head] /dc-dir/dc-file_958 auth v5918 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.334335+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf6259e000] now 0 2023-10-03T19:20:49.014 INFO:teuthology.orchestra.run.smithi045.stdout: -7076> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+41 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6259e000 count now 1/41 2023-10-03T19:20:49.014 INFO:teuthology.orchestra.run.smithi045.stdout: -7075> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b3) clear_dirty_parent 2023-10-03T19:20:49.014 INFO:teuthology.orchestra.run.smithi045.stdout: -7074> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b4) _stored_backtrace v 4882 2023-10-03T19:20:49.014 INFO:teuthology.orchestra.run.smithi045.stdout: -7073> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b4) auth_unpin by 0x55cf6259e580 on [inode 0x100000005b4 [2,head] /dc-dir/dc-file_959 auth v5920 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.345966+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf6259e580] now 0 2023-10-03T19:20:49.014 INFO:teuthology.orchestra.run.smithi045.stdout: -7072> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+40 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6259e580 count now 1/40 2023-10-03T19:20:49.014 INFO:teuthology.orchestra.run.smithi045.stdout: -7071> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b4) clear_dirty_parent 2023-10-03T19:20:49.014 INFO:teuthology.orchestra.run.smithi045.stdout: -7070> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b5) _stored_backtrace v 4886 2023-10-03T19:20:49.014 INFO:teuthology.orchestra.run.smithi045.stdout: -7069> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b5) auth_unpin by 0x55cf6259eb00 on [inode 0x100000005b5 [2,head] /dc-dir/dc-file_960 auth v5922 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.356745+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf6259eb00] now 0 2023-10-03T19:20:49.014 INFO:teuthology.orchestra.run.smithi045.stdout: -7068> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+39 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6259eb00 count now 1/39 2023-10-03T19:20:49.014 INFO:teuthology.orchestra.run.smithi045.stdout: -7067> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b5) clear_dirty_parent 2023-10-03T19:20:49.015 INFO:teuthology.orchestra.run.smithi045.stdout: -7066> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b6) _stored_backtrace v 4890 2023-10-03T19:20:49.015 INFO:teuthology.orchestra.run.smithi045.stdout: -7065> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b6) auth_unpin by 0x55cf6259f080 on [inode 0x100000005b6 [2,head] /dc-dir/dc-file_961 auth v5924 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.368033+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf6259f080] now 0 2023-10-03T19:20:49.015 INFO:teuthology.orchestra.run.smithi045.stdout: -7064> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+38 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6259f080 count now 1/38 2023-10-03T19:20:49.015 INFO:teuthology.orchestra.run.smithi045.stdout: -7063> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b6) clear_dirty_parent 2023-10-03T19:20:49.015 INFO:teuthology.orchestra.run.smithi045.stdout: -7062> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b7) _stored_backtrace v 4894 2023-10-03T19:20:49.015 INFO:teuthology.orchestra.run.smithi045.stdout: -7061> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b7) auth_unpin by 0x55cf6259f600 on [inode 0x100000005b7 [2,head] /dc-dir/dc-file_962 auth v5926 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.381385+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf6259f600] now 0 2023-10-03T19:20:49.015 INFO:teuthology.orchestra.run.smithi045.stdout: -7060> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+37 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6259f600 count now 1/37 2023-10-03T19:20:49.015 INFO:teuthology.orchestra.run.smithi045.stdout: -7059> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b7) clear_dirty_parent 2023-10-03T19:20:49.015 INFO:teuthology.orchestra.run.smithi045.stdout: -7058> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b8) _stored_backtrace v 4898 2023-10-03T19:20:49.015 INFO:teuthology.orchestra.run.smithi045.stdout: -7057> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b8) auth_unpin by 0x55cf6259fb80 on [inode 0x100000005b8 [2,head] /dc-dir/dc-file_963 auth v5928 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.393933+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf6259fb80] now 0 2023-10-03T19:20:49.015 INFO:teuthology.orchestra.run.smithi045.stdout: -7056> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+36 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf6259fb80 count now 1/36 2023-10-03T19:20:49.015 INFO:teuthology.orchestra.run.smithi045.stdout: -7055> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b8) clear_dirty_parent 2023-10-03T19:20:49.016 INFO:teuthology.orchestra.run.smithi045.stdout: -7054> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b9) _stored_backtrace v 4902 2023-10-03T19:20:49.016 INFO:teuthology.orchestra.run.smithi045.stdout: -7053> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b9) auth_unpin by 0x55cf625a0100 on [inode 0x100000005b9 [2,head] /dc-dir/dc-file_964 auth v5930 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.405662+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf625a0100] now 0 2023-10-03T19:20:49.016 INFO:teuthology.orchestra.run.smithi045.stdout: -7052> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+35 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf625a0100 count now 1/35 2023-10-03T19:20:49.016 INFO:teuthology.orchestra.run.smithi045.stdout: -7051> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b9) clear_dirty_parent 2023-10-03T19:20:49.016 INFO:teuthology.orchestra.run.smithi045.stdout: -7050> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005ba) _stored_backtrace v 4906 2023-10-03T19:20:49.016 INFO:teuthology.orchestra.run.smithi045.stdout: -7049> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005ba) auth_unpin by 0x55cf625a0680 on [inode 0x100000005ba [2,head] /dc-dir/dc-file_965 auth v5932 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.417957+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf625a0680] now 0 2023-10-03T19:20:49.016 INFO:teuthology.orchestra.run.smithi045.stdout: -7048> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+34 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf625a0680 count now 1/34 2023-10-03T19:20:49.016 INFO:teuthology.orchestra.run.smithi045.stdout: -7047> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005ba) clear_dirty_parent 2023-10-03T19:20:49.016 INFO:teuthology.orchestra.run.smithi045.stdout: -7046> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005bb) _stored_backtrace v 4910 2023-10-03T19:20:49.016 INFO:teuthology.orchestra.run.smithi045.stdout: -7045> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005bb) auth_unpin by 0x55cf625a0c00 on [inode 0x100000005bb [2,head] /dc-dir/dc-file_966 auth v5934 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.429871+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf625a0c00] now 0 2023-10-03T19:20:49.017 INFO:teuthology.orchestra.run.smithi045.stdout: -7044> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+33 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf625a0c00 count now 1/33 2023-10-03T19:20:49.017 INFO:teuthology.orchestra.run.smithi045.stdout: -7043> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005bb) clear_dirty_parent 2023-10-03T19:20:49.017 INFO:teuthology.orchestra.run.smithi045.stdout: -7042> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005bc) _stored_backtrace v 4914 2023-10-03T19:20:49.017 INFO:teuthology.orchestra.run.smithi045.stdout: -7041> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005bc) auth_unpin by 0x55cf625a1180 on [inode 0x100000005bc [2,head] /dc-dir/dc-file_967 auth v5936 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.441933+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf625a1180] now 0 2023-10-03T19:20:49.017 INFO:teuthology.orchestra.run.smithi045.stdout: -7040> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+32 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf625a1180 count now 1/32 2023-10-03T19:20:49.017 INFO:teuthology.orchestra.run.smithi045.stdout: -7039> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005bc) clear_dirty_parent 2023-10-03T19:20:49.017 INFO:teuthology.orchestra.run.smithi045.stdout: -7038> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005bd) _stored_backtrace v 4918 2023-10-03T19:20:49.017 INFO:teuthology.orchestra.run.smithi045.stdout: -7037> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005bd) auth_unpin by 0x55cf625a1700 on [inode 0x100000005bd [2,head] /dc-dir/dc-file_968 auth v5938 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.454270+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf625a1700] now 0 2023-10-03T19:20:49.017 INFO:teuthology.orchestra.run.smithi045.stdout: -7036> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+31 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf625a1700 count now 1/31 2023-10-03T19:20:49.017 INFO:teuthology.orchestra.run.smithi045.stdout: -7035> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005bd) clear_dirty_parent 2023-10-03T19:20:49.017 INFO:teuthology.orchestra.run.smithi045.stdout: -7034> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005be) _stored_backtrace v 4922 2023-10-03T19:20:49.018 INFO:teuthology.orchestra.run.smithi045.stdout: -7033> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005be) auth_unpin by 0x55cf625a6000 on [inode 0x100000005be [2,head] /dc-dir/dc-file_969 auth v5940 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.465947+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf625a6000] now 0 2023-10-03T19:20:49.018 INFO:teuthology.orchestra.run.smithi045.stdout: -7032> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+30 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf625a6000 count now 1/30 2023-10-03T19:20:49.018 INFO:teuthology.orchestra.run.smithi045.stdout: -7031> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005be) clear_dirty_parent 2023-10-03T19:20:49.018 INFO:teuthology.orchestra.run.smithi045.stdout: -7030> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005bf) _stored_backtrace v 4926 2023-10-03T19:20:49.018 INFO:teuthology.orchestra.run.smithi045.stdout: -7029> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005bf) auth_unpin by 0x55cf625a6580 on [inode 0x100000005bf [2,head] /dc-dir/dc-file_970 auth v5942 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.477521+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf625a6580] now 0 2023-10-03T19:20:49.018 INFO:teuthology.orchestra.run.smithi045.stdout: -7028> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+29 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf625a6580 count now 1/29 2023-10-03T19:20:49.018 INFO:teuthology.orchestra.run.smithi045.stdout: -7027> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005bf) clear_dirty_parent 2023-10-03T19:20:49.018 INFO:teuthology.orchestra.run.smithi045.stdout: -7026> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c0) _stored_backtrace v 4930 2023-10-03T19:20:49.018 INFO:teuthology.orchestra.run.smithi045.stdout: -7025> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c0) auth_unpin by 0x55cf625a6b00 on [inode 0x100000005c0 [2,head] /dc-dir/dc-file_971 auth v5944 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.490445+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf625a6b00] now 0 2023-10-03T19:20:49.018 INFO:teuthology.orchestra.run.smithi045.stdout: -7024> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+28 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf625a6b00 count now 1/28 2023-10-03T19:20:49.018 INFO:teuthology.orchestra.run.smithi045.stdout: -7023> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c0) clear_dirty_parent 2023-10-03T19:20:49.018 INFO:teuthology.orchestra.run.smithi045.stdout: -7022> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c1) _stored_backtrace v 4934 2023-10-03T19:20:49.019 INFO:teuthology.orchestra.run.smithi045.stdout: -7021> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c1) auth_unpin by 0x55cf625a7080 on [inode 0x100000005c1 [2,head] /dc-dir/dc-file_972 auth v5946 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.501626+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf625a7080] now 0 2023-10-03T19:20:49.019 INFO:teuthology.orchestra.run.smithi045.stdout: -7020> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+27 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf625a7080 count now 1/27 2023-10-03T19:20:49.019 INFO:teuthology.orchestra.run.smithi045.stdout: -7019> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c1) clear_dirty_parent 2023-10-03T19:20:49.019 INFO:teuthology.orchestra.run.smithi045.stdout: -7018> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c2) _stored_backtrace v 4938 2023-10-03T19:20:49.044 INFO:teuthology.orchestra.run.smithi045.stdout: -7017> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c2) auth_unpin by 0x55cf625a7600 on [inode 0x100000005c2 [2,head] /dc-dir/dc-file_973 auth v5948 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.513035+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf625a7600] now 0 2023-10-03T19:20:49.044 INFO:teuthology.orchestra.run.smithi045.stdout: -7016> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+26 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf625a7600 count now 1/26 2023-10-03T19:20:49.045 INFO:teuthology.orchestra.run.smithi045.stdout: -7015> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c2) clear_dirty_parent 2023-10-03T19:20:49.045 INFO:teuthology.orchestra.run.smithi045.stdout: -7014> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c3) _stored_backtrace v 4942 2023-10-03T19:20:49.045 INFO:teuthology.orchestra.run.smithi045.stdout: -7013> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c3) auth_unpin by 0x55cf625a7b80 on [inode 0x100000005c3 [2,head] /dc-dir/dc-file_974 auth v5950 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.529374+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf625a7b80] now 0 2023-10-03T19:20:49.045 INFO:teuthology.orchestra.run.smithi045.stdout: -7012> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+25 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf625a7b80 count now 1/25 2023-10-03T19:20:49.045 INFO:teuthology.orchestra.run.smithi045.stdout: -7011> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c3) clear_dirty_parent 2023-10-03T19:20:49.045 INFO:teuthology.orchestra.run.smithi045.stdout: -7010> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c4) _stored_backtrace v 5100 2023-10-03T19:20:49.045 INFO:teuthology.orchestra.run.smithi045.stdout: -7009> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c4) auth_unpin by 0x55cf625a8100 on [inode 0x100000005c4 [2,head] /dc-dir/dc-file_975 auth v5952 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.680771+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf625a8100] now 0 2023-10-03T19:20:49.045 INFO:teuthology.orchestra.run.smithi045.stdout: -7008> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+24 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf625a8100 count now 1/24 2023-10-03T19:20:49.045 INFO:teuthology.orchestra.run.smithi045.stdout: -7007> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c4) clear_dirty_parent 2023-10-03T19:20:49.045 INFO:teuthology.orchestra.run.smithi045.stdout: -7006> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c5) _stored_backtrace v 5104 2023-10-03T19:20:49.046 INFO:teuthology.orchestra.run.smithi045.stdout: -7005> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c5) auth_unpin by 0x55cf625a8680 on [inode 0x100000005c5 [2,head] /dc-dir/dc-file_976 auth v5954 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.691487+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf625a8680] now 0 2023-10-03T19:20:49.046 INFO:teuthology.orchestra.run.smithi045.stdout: -7004> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+23 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf625a8680 count now 1/23 2023-10-03T19:20:49.046 INFO:teuthology.orchestra.run.smithi045.stdout: -7003> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c5) clear_dirty_parent 2023-10-03T19:20:49.046 INFO:teuthology.orchestra.run.smithi045.stdout: -7002> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c6) _stored_backtrace v 5108 2023-10-03T19:20:49.046 INFO:teuthology.orchestra.run.smithi045.stdout: -7001> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c6) auth_unpin by 0x55cf625a8c00 on [inode 0x100000005c6 [2,head] /dc-dir/dc-file_977 auth v5956 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.703556+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf625a8c00] now 0 2023-10-03T19:20:49.046 INFO:teuthology.orchestra.run.smithi045.stdout: -7000> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+22 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf625a8c00 count now 1/22 2023-10-03T19:20:49.046 INFO:teuthology.orchestra.run.smithi045.stdout: -6999> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c6) clear_dirty_parent 2023-10-03T19:20:49.046 INFO:teuthology.orchestra.run.smithi045.stdout: -6998> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c7) _stored_backtrace v 5112 2023-10-03T19:20:49.046 INFO:teuthology.orchestra.run.smithi045.stdout: -6997> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c7) auth_unpin by 0x55cf625a9180 on [inode 0x100000005c7 [2,head] /dc-dir/dc-file_978 auth v5958 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.716323+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf625a9180] now 0 2023-10-03T19:20:49.046 INFO:teuthology.orchestra.run.smithi045.stdout: -6996> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+21 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf625a9180 count now 1/21 2023-10-03T19:20:49.046 INFO:teuthology.orchestra.run.smithi045.stdout: -6995> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c7) clear_dirty_parent 2023-10-03T19:20:49.047 INFO:teuthology.orchestra.run.smithi045.stdout: -6994> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c8) _stored_backtrace v 5116 2023-10-03T19:20:49.047 INFO:teuthology.orchestra.run.smithi045.stdout: -6993> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c8) auth_unpin by 0x55cf625a9700 on [inode 0x100000005c8 [2,head] /dc-dir/dc-file_979 auth v5960 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.729137+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf625a9700] now 0 2023-10-03T19:20:49.047 INFO:teuthology.orchestra.run.smithi045.stdout: -6992> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+20 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf625a9700 count now 1/20 2023-10-03T19:20:49.047 INFO:teuthology.orchestra.run.smithi045.stdout: -6991> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c8) clear_dirty_parent 2023-10-03T19:20:49.047 INFO:teuthology.orchestra.run.smithi045.stdout: -6990> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c9) _stored_backtrace v 5120 2023-10-03T19:20:49.047 INFO:teuthology.orchestra.run.smithi045.stdout: -6989> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c9) auth_unpin by 0x55cf625b4000 on [inode 0x100000005c9 [2,head] /dc-dir/dc-file_980 auth v5962 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.741348+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf625b4000] now 0 2023-10-03T19:20:49.047 INFO:teuthology.orchestra.run.smithi045.stdout: -6988> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+19 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf625b4000 count now 1/19 2023-10-03T19:20:49.047 INFO:teuthology.orchestra.run.smithi045.stdout: -6987> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c9) clear_dirty_parent 2023-10-03T19:20:49.047 INFO:teuthology.orchestra.run.smithi045.stdout: -6986> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005ca) _stored_backtrace v 5124 2023-10-03T19:20:49.047 INFO:teuthology.orchestra.run.smithi045.stdout: -6985> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005ca) auth_unpin by 0x55cf625b4580 on [inode 0x100000005ca [2,head] /dc-dir/dc-file_981 auth v5964 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.752268+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf625b4580] now 0 2023-10-03T19:20:49.047 INFO:teuthology.orchestra.run.smithi045.stdout: -6984> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+18 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf625b4580 count now 1/18 2023-10-03T19:20:49.047 INFO:teuthology.orchestra.run.smithi045.stdout: -6983> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005ca) clear_dirty_parent 2023-10-03T19:20:49.048 INFO:teuthology.orchestra.run.smithi045.stdout: -6982> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005cb) _stored_backtrace v 5128 2023-10-03T19:20:49.048 INFO:teuthology.orchestra.run.smithi045.stdout: -6981> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005cb) auth_unpin by 0x55cf625b4b00 on [inode 0x100000005cb [2,head] /dc-dir/dc-file_982 auth v5966 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.763999+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf625b4b00] now 0 2023-10-03T19:20:49.048 INFO:teuthology.orchestra.run.smithi045.stdout: -6980> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+17 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf625b4b00 count now 1/17 2023-10-03T19:20:49.048 INFO:teuthology.orchestra.run.smithi045.stdout: -6979> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005cb) clear_dirty_parent 2023-10-03T19:20:49.048 INFO:teuthology.orchestra.run.smithi045.stdout: -6978> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005cc) _stored_backtrace v 5132 2023-10-03T19:20:49.048 INFO:teuthology.orchestra.run.smithi045.stdout: -6977> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005cc) auth_unpin by 0x55cf625b5080 on [inode 0x100000005cc [2,head] /dc-dir/dc-file_983 auth v5968 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.775000+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf625b5080] now 0 2023-10-03T19:20:49.048 INFO:teuthology.orchestra.run.smithi045.stdout: -6976> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+16 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf625b5080 count now 1/16 2023-10-03T19:20:49.048 INFO:teuthology.orchestra.run.smithi045.stdout: -6975> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005cc) clear_dirty_parent 2023-10-03T19:20:49.048 INFO:teuthology.orchestra.run.smithi045.stdout: -6974> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005cd) _stored_backtrace v 5136 2023-10-03T19:20:49.048 INFO:teuthology.orchestra.run.smithi045.stdout: -6973> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005cd) auth_unpin by 0x55cf625b5600 on [inode 0x100000005cd [2,head] /dc-dir/dc-file_984 auth v5970 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.786235+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf625b5600] now 0 2023-10-03T19:20:49.049 INFO:teuthology.orchestra.run.smithi045.stdout: -6972> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+15 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf625b5600 count now 1/15 2023-10-03T19:20:49.049 INFO:teuthology.orchestra.run.smithi045.stdout: -6971> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005cd) clear_dirty_parent 2023-10-03T19:20:49.049 INFO:teuthology.orchestra.run.smithi045.stdout: -6970> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005ce) _stored_backtrace v 5140 2023-10-03T19:20:49.049 INFO:teuthology.orchestra.run.smithi045.stdout: -6969> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005ce) auth_unpin by 0x55cf625b5b80 on [inode 0x100000005ce [2,head] /dc-dir/dc-file_985 auth v5972 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.797819+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf625b5b80] now 0 2023-10-03T19:20:49.049 INFO:teuthology.orchestra.run.smithi045.stdout: -6968> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+14 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf625b5b80 count now 1/14 2023-10-03T19:20:49.049 INFO:teuthology.orchestra.run.smithi045.stdout: -6967> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005ce) clear_dirty_parent 2023-10-03T19:20:49.049 INFO:teuthology.orchestra.run.smithi045.stdout: -6966> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005cf) _stored_backtrace v 5144 2023-10-03T19:20:49.049 INFO:teuthology.orchestra.run.smithi045.stdout: -6965> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005cf) auth_unpin by 0x55cf625b6100 on [inode 0x100000005cf [2,head] /dc-dir/dc-file_986 auth v5974 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.809773+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf625b6100] now 0 2023-10-03T19:20:49.049 INFO:teuthology.orchestra.run.smithi045.stdout: -6964> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+13 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf625b6100 count now 1/13 2023-10-03T19:20:49.049 INFO:teuthology.orchestra.run.smithi045.stdout: -6963> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005cf) clear_dirty_parent 2023-10-03T19:20:49.049 INFO:teuthology.orchestra.run.smithi045.stdout: -6962> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d0) _stored_backtrace v 5148 2023-10-03T19:20:49.049 INFO:teuthology.orchestra.run.smithi045.stdout: -6961> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d0) auth_unpin by 0x55cf625b6680 on [inode 0x100000005d0 [2,head] /dc-dir/dc-file_987 auth v5976 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.821940+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf625b6680] now 0 2023-10-03T19:20:49.050 INFO:teuthology.orchestra.run.smithi045.stdout: -6960> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+12 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf625b6680 count now 1/12 2023-10-03T19:20:49.050 INFO:teuthology.orchestra.run.smithi045.stdout: -6959> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d0) clear_dirty_parent 2023-10-03T19:20:49.050 INFO:teuthology.orchestra.run.smithi045.stdout: -6958> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d1) _stored_backtrace v 5152 2023-10-03T19:20:49.050 INFO:teuthology.orchestra.run.smithi045.stdout: -6957> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d1) auth_unpin by 0x55cf625b6c00 on [inode 0x100000005d1 [2,head] /dc-dir/dc-file_988 auth v5978 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.834467+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf625b6c00] now 0 2023-10-03T19:20:49.050 INFO:teuthology.orchestra.run.smithi045.stdout: -6956> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+11 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf625b6c00 count now 1/11 2023-10-03T19:20:49.050 INFO:teuthology.orchestra.run.smithi045.stdout: -6955> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d1) clear_dirty_parent 2023-10-03T19:20:49.050 INFO:teuthology.orchestra.run.smithi045.stdout: -6954> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d2) _stored_backtrace v 5156 2023-10-03T19:20:49.050 INFO:teuthology.orchestra.run.smithi045.stdout: -6953> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d2) auth_unpin by 0x55cf625b7180 on [inode 0x100000005d2 [2,head] /dc-dir/dc-file_989 auth v5980 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.845915+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf625b7180] now 0 2023-10-03T19:20:49.050 INFO:teuthology.orchestra.run.smithi045.stdout: -6952> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+10 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf625b7180 count now 1/10 2023-10-03T19:20:49.050 INFO:teuthology.orchestra.run.smithi045.stdout: -6951> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d2) clear_dirty_parent 2023-10-03T19:20:49.050 INFO:teuthology.orchestra.run.smithi045.stdout: -6950> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d3) _stored_backtrace v 5160 2023-10-03T19:20:49.120 INFO:teuthology.orchestra.run.smithi045.stdout: -6949> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d3) auth_unpin by 0x55cf625b7700 on [inode 0x100000005d3 [2,head] /dc-dir/dc-file_990 auth v5982 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.857969+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf625b7700] now 0 2023-10-03T19:20:50.222 INFO:teuthology.orchestra.run.smithi045.stdout: -6948> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+9 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf625b7700 count now 1/9 2023-10-03T19:20:50.222 INFO:teuthology.orchestra.run.smithi045.stdout: -6947> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d3) clear_dirty_parent 2023-10-03T19:20:50.222 INFO:teuthology.orchestra.run.smithi045.stdout: -6946> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d4) _stored_backtrace v 5164 2023-10-03T19:20:50.222 INFO:teuthology.orchestra.run.smithi045.stdout: -6945> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d4) auth_unpin by 0x55cf62476000 on [inode 0x100000005d4 [2,head] /dc-dir/dc-file_991 auth v5984 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.869531+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62476000] now 0 2023-10-03T19:20:50.222 INFO:teuthology.orchestra.run.smithi045.stdout: -6944> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+8 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62476000 count now 1/8 2023-10-03T19:20:50.223 INFO:teuthology.orchestra.run.smithi045.stdout: -6943> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d4) clear_dirty_parent 2023-10-03T19:20:50.223 INFO:teuthology.orchestra.run.smithi045.stdout: -6942> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d5) _stored_backtrace v 5168 2023-10-03T19:20:50.223 INFO:teuthology.orchestra.run.smithi045.stdout: -6941> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d5) auth_unpin by 0x55cf62476580 on [inode 0x100000005d5 [2,head] /dc-dir/dc-file_992 auth v5986 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.880760+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62476580] now 0 2023-10-03T19:20:50.223 INFO:teuthology.orchestra.run.smithi045.stdout: -6940> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+7 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62476580 count now 1/7 2023-10-03T19:20:50.223 INFO:teuthology.orchestra.run.smithi045.stdout: -6939> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d5) clear_dirty_parent 2023-10-03T19:20:50.223 INFO:teuthology.orchestra.run.smithi045.stdout: -6938> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d6) _stored_backtrace v 5172 2023-10-03T19:20:50.223 INFO:teuthology.orchestra.run.smithi045.stdout: -6937> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d6) auth_unpin by 0x55cf62476b00 on [inode 0x100000005d6 [2,head] /dc-dir/dc-file_993 auth v5988 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.892745+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62476b00] now 0 2023-10-03T19:20:50.224 INFO:teuthology.orchestra.run.smithi045.stdout: -6936> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+6 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62476b00 count now 1/6 2023-10-03T19:20:50.224 INFO:teuthology.orchestra.run.smithi045.stdout: -6935> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d6) clear_dirty_parent 2023-10-03T19:20:50.224 INFO:teuthology.orchestra.run.smithi045.stdout: -6934> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d7) _stored_backtrace v 5176 2023-10-03T19:20:50.224 INFO:teuthology.orchestra.run.smithi045.stdout: -6933> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d7) auth_unpin by 0x55cf62477080 on [inode 0x100000005d7 [2,head] /dc-dir/dc-file_994 auth v5990 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.906262+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62477080] now 0 2023-10-03T19:20:50.224 INFO:teuthology.orchestra.run.smithi045.stdout: -6932> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+5 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62477080 count now 1/5 2023-10-03T19:20:50.224 INFO:teuthology.orchestra.run.smithi045.stdout: -6931> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d7) clear_dirty_parent 2023-10-03T19:20:50.224 INFO:teuthology.orchestra.run.smithi045.stdout: -6930> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d8) _stored_backtrace v 5180 2023-10-03T19:20:50.225 INFO:teuthology.orchestra.run.smithi045.stdout: -6929> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d8) auth_unpin by 0x55cf62477600 on [inode 0x100000005d8 [2,head] /dc-dir/dc-file_995 auth v5992 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.918717+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62477600] now 0 2023-10-03T19:20:50.225 INFO:teuthology.orchestra.run.smithi045.stdout: -6928> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+4 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62477600 count now 1/4 2023-10-03T19:20:50.225 INFO:teuthology.orchestra.run.smithi045.stdout: -6927> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d8) clear_dirty_parent 2023-10-03T19:20:50.225 INFO:teuthology.orchestra.run.smithi045.stdout: -6926> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d9) _stored_backtrace v 5184 2023-10-03T19:20:50.225 INFO:teuthology.orchestra.run.smithi045.stdout: -6925> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d9) auth_unpin by 0x55cf62477b80 on [inode 0x100000005d9 [2,head] /dc-dir/dc-file_996 auth v5994 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.930134+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62477b80] now 0 2023-10-03T19:20:50.225 INFO:teuthology.orchestra.run.smithi045.stdout: -6924> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+3 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62477b80 count now 1/3 2023-10-03T19:20:50.225 INFO:teuthology.orchestra.run.smithi045.stdout: -6923> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d9) clear_dirty_parent 2023-10-03T19:20:50.225 INFO:teuthology.orchestra.run.smithi045.stdout: -6922> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005da) _stored_backtrace v 5188 2023-10-03T19:20:50.226 INFO:teuthology.orchestra.run.smithi045.stdout: -6921> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005da) auth_unpin by 0x55cf62478100 on [inode 0x100000005da [2,head] /dc-dir/dc-file_997 auth v5996 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.941392+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62478100] now 0 2023-10-03T19:20:50.226 INFO:teuthology.orchestra.run.smithi045.stdout: -6920> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+2 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62478100 count now 1/2 2023-10-03T19:20:50.226 INFO:teuthology.orchestra.run.smithi045.stdout: -6919> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005da) clear_dirty_parent 2023-10-03T19:20:50.226 INFO:teuthology.orchestra.run.smithi045.stdout: -6918> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005db) _stored_backtrace v 5192 2023-10-03T19:20:50.226 INFO:teuthology.orchestra.run.smithi045.stdout: -6917> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005db) auth_unpin by 0x55cf62478680 on [inode 0x100000005db [2,head] /dc-dir/dc-file_998 auth v5998 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.952724+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62478680] now 0 2023-10-03T19:20:50.227 INFO:teuthology.orchestra.run.smithi045.stdout: -6916> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+1 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62478680 count now 1/1 2023-10-03T19:20:50.227 INFO:teuthology.orchestra.run.smithi045.stdout: -6915> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005db) clear_dirty_parent 2023-10-03T19:20:50.227 INFO:teuthology.orchestra.run.smithi045.stdout: -6914> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005dc) _stored_backtrace v 5196 2023-10-03T19:20:50.227 INFO:teuthology.orchestra.run.smithi045.stdout: -6913> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005dc) auth_unpin by 0x55cf62478c00 on [inode 0x100000005dc [2,head] /dc-dir/dc-file_999 auth v6000 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:13:46.964642+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cf62478c00] now 0 2023-10-03T19:20:50.227 INFO:teuthology.orchestra.run.smithi045.stdout: -6912> 2023-10-03T19:15:17.707+0000 7f0f05562640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+0 state=1074003969|complete f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] by 0x55cf62478c00 count now 1/0 2023-10-03T19:20:50.227 INFO:teuthology.orchestra.run.smithi045.stdout: -6911> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005dc) clear_dirty_parent 2023-10-03T19:20:50.228 INFO:teuthology.orchestra.run.smithi045.stdout: -6910> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 MDSContext::complete: 21C_MaybeExpiredSegment 2023-10-03T19:20:50.228 INFO:teuthology.orchestra.run.smithi045.stdout: -6909> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.log _maybe_expired segment 2149/8392541, 862 events 2023-10-03T19:20:50.228 INFO:teuthology.orchestra.run.smithi045.stdout: -6908> 2023-10-03T19:15:17.707+0000 7f0f05562640 6 mds.0.journal LogSegment(2149/8392541).try_to_expire 2023-10-03T19:20:50.228 INFO:teuthology.orchestra.run.smithi045.stdout: -6907> 2023-10-03T19:15:17.707+0000 7f0f05562640 4 mds.0.sessionmap save_if_dirty: writing 0 2023-10-03T19:20:50.228 INFO:teuthology.orchestra.run.smithi045.stdout: -6906> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.journal try_to_expire waiting for purge of [] 2023-10-03T19:20:50.228 INFO:teuthology.orchestra.run.smithi045.stdout: -6905> 2023-10-03T19:15:17.707+0000 7f0f05562640 6 mds.0.journal LogSegment(2149/8392541).try_to_expire success 2023-10-03T19:20:50.228 INFO:teuthology.orchestra.run.smithi045.stdout: -6904> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.log try_expire expired segment 2149/8392541 2023-10-03T19:20:50.228 INFO:teuthology.orchestra.run.smithi045.stdout: -6903> 2023-10-03T19:15:17.707+0000 7f0f05562640 5 mds.0.log _expired segment 2149/8392541, 862 events 2023-10-03T19:20:50.229 INFO:teuthology.orchestra.run.smithi045.stdout: -6902> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 MDSContext::complete: 25MDSInternalContextWrapper 2023-10-03T19:20:50.229 INFO:teuthology.orchestra.run.smithi045.stdout: -6901> 2023-10-03T19:15:17.707+0000 7f0f05562640 20 mds.0.11 handle_expire_segments: r=0 2023-10-03T19:20:50.229 INFO:teuthology.orchestra.run.smithi045.stdout: -6900> 2023-10-03T19:15:17.707+0000 7f0f05562640 20 mds.0.11 trim_segments 2023-10-03T19:20:50.229 INFO:teuthology.orchestra.run.smithi045.stdout: -6899> 2023-10-03T19:15:17.707+0000 7f0f05562640 5 mds.0.11 trim_expired_segments: expiry complete, expire_pos/trim_pos is now 400000/400000 2023-10-03T19:20:50.229 INFO:teuthology.orchestra.run.smithi045.stdout: -6898> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.log _trim_expired_segments trimming expired 1/0x400000 2023-10-03T19:20:50.229 INFO:teuthology.orchestra.run.smithi045.stdout: -6897> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.log _trim_expired_segments trimming expired 1025/0x5eba34 2023-10-03T19:20:50.229 INFO:teuthology.orchestra.run.smithi045.stdout: -6896> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.log _trim_expired_segments trimming expired 2049/0x7d1f10 2023-10-03T19:20:50.229 INFO:teuthology.orchestra.run.smithi045.stdout: -6895> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.log _trim_expired_segments trimming expired 2149/0x800f5d 2023-10-03T19:20:50.230 INFO:teuthology.orchestra.run.smithi045.stdout: -6894> 2023-10-03T19:15:17.707+0000 7f0f05562640 10 mds.0.log _trim_expired_segments waiting for 3011/10057300 to expire 2023-10-03T19:20:50.230 INFO:teuthology.orchestra.run.smithi045.stdout: -6893> 2023-10-03T19:15:17.707+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2070 5.14 5:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed] in=90b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63c13880 con 0x55cf61df4400 2023-10-03T19:20:50.230 INFO:teuthology.orchestra.run.smithi045.stdout: -6892> 2023-10-03T19:15:17.707+0000 7f0f05562640 5 mds.0.11 trim_expired_segments: trim complete, expire_pos/trim_pos is now 997654/400000 2023-10-03T19:20:50.230 INFO:teuthology.orchestra.run.smithi045.stdout: -6891> 2023-10-03T19:15:17.707+0000 7f0f05562640 20 mds.0.11 write_journal_head 2023-10-03T19:20:50.230 INFO:teuthology.orchestra.run.smithi045.stdout: -6890> 2023-10-03T19:15:17.707+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2071 5.14 5:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed] in=90b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63c13c00 con 0x55cf61df4400 2023-10-03T19:20:50.230 INFO:teuthology.orchestra.run.smithi045.stdout: -6889> 2023-10-03T19:15:17.711+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1022 ==== osd_op_reply(2070 200.00000000 [writefull 0~90 [fadvise_dontneed]] v37'867 uv867 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:50.230 INFO:teuthology.orchestra.run.smithi045.stdout: -6888> 2023-10-03T19:15:17.711+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2072 5.14 5:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63adb180 con 0x55cf61df4400 2023-10-03T19:20:50.231 INFO:teuthology.orchestra.run.smithi045.stdout: -6887> 2023-10-03T19:15:17.711+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1023 ==== osd_op_reply(2071 200.00000000 [writefull 0~90 [fadvise_dontneed]] v37'868 uv868 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:50.231 INFO:teuthology.orchestra.run.smithi045.stdout: -6886> 2023-10-03T19:15:17.711+0000 7f0f05562640 5 mds.0.11 handle_write_head: write_head complete, all done! 2023-10-03T19:20:50.231 INFO:teuthology.orchestra.run.smithi045.stdout: -6885> 2023-10-03T19:15:17.711+0000 7f0f05562640 10 MDSContext::complete: 15C_Flush_Journal 2023-10-03T19:20:50.231 INFO:teuthology.orchestra.run.smithi045.stdout: -6884> 2023-10-03T19:15:17.711+0000 7f0f05562640 20 mds.0.11 finish: r=0 2023-10-03T19:20:50.231 INFO:teuthology.orchestra.run.smithi045.stdout: -6883> 2023-10-03T19:15:17.711+0000 7f0f05562640 20 mds.0.11 handle_flush_journal: r=0 2023-10-03T19:20:50.231 INFO:teuthology.orchestra.run.smithi045.stdout: -6882> 2023-10-03T19:15:17.711+0000 7f0f05562640 20 mds.0.11 trim_cache 2023-10-03T19:20:50.231 INFO:teuthology.orchestra.run.smithi045.stdout: -6881> 2023-10-03T19:15:17.711+0000 7f0f05562640 7 mds.0.cache trim bytes_used=2MB limit=4GB reservation=0.05% count=18446744073709551615 2023-10-03T19:20:50.231 INFO:teuthology.orchestra.run.smithi045.stdout: -6880> 2023-10-03T19:15:17.711+0000 7f0f05562640 7 mds.0.cache trim_lru trimming 18446744073709551615 items from LRU size=1011 mid=630 pintail=111 pinned=111 2023-10-03T19:20:50.232 INFO:teuthology.orchestra.run.smithi045.stdout: -6879> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_899 [2,head] auth (dversion lock) v=5800 ino=0x10000000578 state=1073741824 0x55cf61fba000] 2023-10-03T19:20:50.232 INFO:teuthology.orchestra.run.smithi045.stdout: -6878> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:50.232 INFO:teuthology.orchestra.run.smithi045.stdout: -6877> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000578 [2,head] /dc-dir/dc-file_899 auth v5800 s=3 n(v0 rc2023-10-03T19:13:45.499139+0000 b3 1=1+0) (iversion lock) 0x55cf62538680] 2023-10-03T19:20:50.232 INFO:teuthology.orchestra.run.smithi045.stdout: -6876> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_899 [2,head] auth (dversion lock) v=5800 ino=0x10000000578 state=1073741824 0x55cf61fba000] [inode 0x10000000578 [2,head] /dc-dir/dc-file_899 auth v5800 s=3 n(v0 rc2023-10-03T19:13:45.499139+0000 b3 1=1+0) (iversion lock) 0x55cf62538680] 2023-10-03T19:20:50.232 INFO:teuthology.orchestra.run.smithi045.stdout: -6875> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000578 [2,head] #10000000578 auth v5800 s=3 n(v0 rc2023-10-03T19:13:45.499139+0000 b3 1=1+0) (iversion lock) 0x55cf62538680] 2023-10-03T19:20:50.232 INFO:teuthology.orchestra.run.smithi045.stdout: -6874> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_899 [2,head] auth NULL (dversion lock) v=5800 ino=(nil) state=1073741824 0x55cf61fba000] 2023-10-03T19:20:50.232 INFO:teuthology.orchestra.run.smithi045.stdout: -6873> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_898 [2,head] auth (dversion lock) v=5798 ino=0x10000000577 state=1073741824 0x55cf62533b80] 2023-10-03T19:20:50.233 INFO:teuthology.orchestra.run.smithi045.stdout: -6872> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:50.233 INFO:teuthology.orchestra.run.smithi045.stdout: -6871> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000577 [2,head] /dc-dir/dc-file_898 auth v5798 s=3 n(v0 rc2023-10-03T19:13:45.486308+0000 b3 1=1+0) (iversion lock) 0x55cf62538100] 2023-10-03T19:20:50.233 INFO:teuthology.orchestra.run.smithi045.stdout: -6870> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_898 [2,head] auth (dversion lock) v=5798 ino=0x10000000577 state=1073741824 0x55cf62533b80] [inode 0x10000000577 [2,head] /dc-dir/dc-file_898 auth v5798 s=3 n(v0 rc2023-10-03T19:13:45.486308+0000 b3 1=1+0) (iversion lock) 0x55cf62538100] 2023-10-03T19:20:50.233 INFO:teuthology.orchestra.run.smithi045.stdout: -6869> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000577 [2,head] #10000000577 auth v5798 s=3 n(v0 rc2023-10-03T19:13:45.486308+0000 b3 1=1+0) (iversion lock) 0x55cf62538100] 2023-10-03T19:20:50.233 INFO:teuthology.orchestra.run.smithi045.stdout: -6868> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_898 [2,head] auth NULL (dversion lock) v=5798 ino=(nil) state=1073741824 0x55cf62533b80] 2023-10-03T19:20:50.233 INFO:teuthology.orchestra.run.smithi045.stdout: -6867> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_897 [2,head] auth (dversion lock) v=5796 ino=0x10000000576 state=1073741824 0x55cf62533900] 2023-10-03T19:20:50.234 INFO:teuthology.orchestra.run.smithi045.stdout: -6866> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:50.234 INFO:teuthology.orchestra.run.smithi045.stdout: -6865> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000576 [2,head] /dc-dir/dc-file_897 auth v5796 s=3 n(v0 rc2023-10-03T19:13:45.473580+0000 b3 1=1+0) (iversion lock) 0x55cf62537b80] 2023-10-03T19:20:50.234 INFO:teuthology.orchestra.run.smithi045.stdout: -6864> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_897 [2,head] auth (dversion lock) v=5796 ino=0x10000000576 state=1073741824 0x55cf62533900] [inode 0x10000000576 [2,head] /dc-dir/dc-file_897 auth v5796 s=3 n(v0 rc2023-10-03T19:13:45.473580+0000 b3 1=1+0) (iversion lock) 0x55cf62537b80] 2023-10-03T19:20:50.234 INFO:teuthology.orchestra.run.smithi045.stdout: -6863> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000576 [2,head] #10000000576 auth v5796 s=3 n(v0 rc2023-10-03T19:13:45.473580+0000 b3 1=1+0) (iversion lock) 0x55cf62537b80] 2023-10-03T19:20:50.234 INFO:teuthology.orchestra.run.smithi045.stdout: -6862> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_897 [2,head] auth NULL (dversion lock) v=5796 ino=(nil) state=1073741824 0x55cf62533900] 2023-10-03T19:20:50.234 INFO:teuthology.orchestra.run.smithi045.stdout: -6861> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_896 [2,head] auth (dversion lock) v=5794 ino=0x10000000575 state=1073741824 0x55cf62533680] 2023-10-03T19:20:50.234 INFO:teuthology.orchestra.run.smithi045.stdout: -6860> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:50.234 INFO:teuthology.orchestra.run.smithi045.stdout: -6859> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000575 [2,head] /dc-dir/dc-file_896 auth v5794 s=3 n(v0 rc2023-10-03T19:13:45.462676+0000 b3 1=1+0) (iversion lock) 0x55cf62537600] 2023-10-03T19:20:50.235 INFO:teuthology.orchestra.run.smithi045.stdout: -6858> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_896 [2,head] auth (dversion lock) v=5794 ino=0x10000000575 state=1073741824 0x55cf62533680] [inode 0x10000000575 [2,head] /dc-dir/dc-file_896 auth v5794 s=3 n(v0 rc2023-10-03T19:13:45.462676+0000 b3 1=1+0) (iversion lock) 0x55cf62537600] 2023-10-03T19:20:50.235 INFO:teuthology.orchestra.run.smithi045.stdout: -6857> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000575 [2,head] #10000000575 auth v5794 s=3 n(v0 rc2023-10-03T19:13:45.462676+0000 b3 1=1+0) (iversion lock) 0x55cf62537600] 2023-10-03T19:20:50.235 INFO:teuthology.orchestra.run.smithi045.stdout: -6856> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_896 [2,head] auth NULL (dversion lock) v=5794 ino=(nil) state=1073741824 0x55cf62533680] 2023-10-03T19:20:50.235 INFO:teuthology.orchestra.run.smithi045.stdout: -6855> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_895 [2,head] auth (dversion lock) v=5792 ino=0x10000000574 state=1073741824 0x55cf62533400] 2023-10-03T19:20:50.235 INFO:teuthology.orchestra.run.smithi045.stdout: -6854> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:50.235 INFO:teuthology.orchestra.run.smithi045.stdout: -6853> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000574 [2,head] /dc-dir/dc-file_895 auth v5792 s=3 n(v0 rc2023-10-03T19:13:45.450975+0000 b3 1=1+0) (iversion lock) 0x55cf62537080] 2023-10-03T19:20:50.235 INFO:teuthology.orchestra.run.smithi045.stdout: -6852> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_895 [2,head] auth (dversion lock) v=5792 ino=0x10000000574 state=1073741824 0x55cf62533400] [inode 0x10000000574 [2,head] /dc-dir/dc-file_895 auth v5792 s=3 n(v0 rc2023-10-03T19:13:45.450975+0000 b3 1=1+0) (iversion lock) 0x55cf62537080] 2023-10-03T19:20:50.236 INFO:teuthology.orchestra.run.smithi045.stdout: -6851> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000574 [2,head] #10000000574 auth v5792 s=3 n(v0 rc2023-10-03T19:13:45.450975+0000 b3 1=1+0) (iversion lock) 0x55cf62537080] 2023-10-03T19:20:50.236 INFO:teuthology.orchestra.run.smithi045.stdout: -6850> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_895 [2,head] auth NULL (dversion lock) v=5792 ino=(nil) state=1073741824 0x55cf62533400] 2023-10-03T19:20:50.236 INFO:teuthology.orchestra.run.smithi045.stdout: -6849> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_894 [2,head] auth (dversion lock) v=5790 ino=0x10000000573 state=1073741824 0x55cf62533180] 2023-10-03T19:20:50.236 INFO:teuthology.orchestra.run.smithi045.stdout: -6848> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:50.236 INFO:teuthology.orchestra.run.smithi045.stdout: -6847> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000573 [2,head] /dc-dir/dc-file_894 auth v5790 s=3 n(v0 rc2023-10-03T19:13:45.440120+0000 b3 1=1+0) (iversion lock) 0x55cf62536b00] 2023-10-03T19:20:50.236 INFO:teuthology.orchestra.run.smithi045.stdout: -6846> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_894 [2,head] auth (dversion lock) v=5790 ino=0x10000000573 state=1073741824 0x55cf62533180] [inode 0x10000000573 [2,head] /dc-dir/dc-file_894 auth v5790 s=3 n(v0 rc2023-10-03T19:13:45.440120+0000 b3 1=1+0) (iversion lock) 0x55cf62536b00] 2023-10-03T19:20:50.236 INFO:teuthology.orchestra.run.smithi045.stdout: -6845> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000573 [2,head] #10000000573 auth v5790 s=3 n(v0 rc2023-10-03T19:13:45.440120+0000 b3 1=1+0) (iversion lock) 0x55cf62536b00] 2023-10-03T19:20:50.236 INFO:teuthology.orchestra.run.smithi045.stdout: -6844> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_894 [2,head] auth NULL (dversion lock) v=5790 ino=(nil) state=1073741824 0x55cf62533180] 2023-10-03T19:20:50.237 INFO:teuthology.orchestra.run.smithi045.stdout: -6843> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_893 [2,head] auth (dversion lock) v=5788 ino=0x10000000572 state=1073741824 0x55cf62532f00] 2023-10-03T19:20:50.237 INFO:teuthology.orchestra.run.smithi045.stdout: -6842> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:50.237 INFO:teuthology.orchestra.run.smithi045.stdout: -6841> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000572 [2,head] /dc-dir/dc-file_893 auth v5788 s=3 n(v0 rc2023-10-03T19:13:45.429511+0000 b3 1=1+0) (iversion lock) 0x55cf62536580] 2023-10-03T19:20:50.237 INFO:teuthology.orchestra.run.smithi045.stdout: -6840> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_893 [2,head] auth (dversion lock) v=5788 ino=0x10000000572 state=1073741824 0x55cf62532f00] [inode 0x10000000572 [2,head] /dc-dir/dc-file_893 auth v5788 s=3 n(v0 rc2023-10-03T19:13:45.429511+0000 b3 1=1+0) (iversion lock) 0x55cf62536580] 2023-10-03T19:20:50.237 INFO:teuthology.orchestra.run.smithi045.stdout: -6839> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000572 [2,head] #10000000572 auth v5788 s=3 n(v0 rc2023-10-03T19:13:45.429511+0000 b3 1=1+0) (iversion lock) 0x55cf62536580] 2023-10-03T19:20:50.237 INFO:teuthology.orchestra.run.smithi045.stdout: -6838> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_893 [2,head] auth NULL (dversion lock) v=5788 ino=(nil) state=1073741824 0x55cf62532f00] 2023-10-03T19:20:50.238 INFO:teuthology.orchestra.run.smithi045.stdout: -6837> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_892 [2,head] auth (dversion lock) v=5786 ino=0x10000000571 state=1073741824 0x55cf62532c80] 2023-10-03T19:20:50.238 INFO:teuthology.orchestra.run.smithi045.stdout: -6836> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:50.238 INFO:teuthology.orchestra.run.smithi045.stdout: -6835> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000571 [2,head] /dc-dir/dc-file_892 auth v5786 s=3 n(v0 rc2023-10-03T19:13:45.418547+0000 b3 1=1+0) (iversion lock) 0x55cf62536000] 2023-10-03T19:20:50.238 INFO:teuthology.orchestra.run.smithi045.stdout: -6834> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_892 [2,head] auth (dversion lock) v=5786 ino=0x10000000571 state=1073741824 0x55cf62532c80] [inode 0x10000000571 [2,head] /dc-dir/dc-file_892 auth v5786 s=3 n(v0 rc2023-10-03T19:13:45.418547+0000 b3 1=1+0) (iversion lock) 0x55cf62536000] 2023-10-03T19:20:50.238 INFO:teuthology.orchestra.run.smithi045.stdout: -6833> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000571 [2,head] #10000000571 auth v5786 s=3 n(v0 rc2023-10-03T19:13:45.418547+0000 b3 1=1+0) (iversion lock) 0x55cf62536000] 2023-10-03T19:20:50.238 INFO:teuthology.orchestra.run.smithi045.stdout: -6832> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_892 [2,head] auth NULL (dversion lock) v=5786 ino=(nil) state=1073741824 0x55cf62532c80] 2023-10-03T19:20:50.238 INFO:teuthology.orchestra.run.smithi045.stdout: -6831> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_891 [2,head] auth (dversion lock) v=5784 ino=0x10000000570 state=1073741824 0x55cf62532a00] 2023-10-03T19:20:50.239 INFO:teuthology.orchestra.run.smithi045.stdout: -6830> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:50.239 INFO:teuthology.orchestra.run.smithi045.stdout: -6829> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000570 [2,head] /dc-dir/dc-file_891 auth v5784 s=3 n(v0 rc2023-10-03T19:13:45.407148+0000 b3 1=1+0) (iversion lock) 0x55cf6252d700] 2023-10-03T19:20:50.239 INFO:teuthology.orchestra.run.smithi045.stdout: -6828> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_891 [2,head] auth (dversion lock) v=5784 ino=0x10000000570 state=1073741824 0x55cf62532a00] [inode 0x10000000570 [2,head] /dc-dir/dc-file_891 auth v5784 s=3 n(v0 rc2023-10-03T19:13:45.407148+0000 b3 1=1+0) (iversion lock) 0x55cf6252d700] 2023-10-03T19:20:50.239 INFO:teuthology.orchestra.run.smithi045.stdout: -6827> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000570 [2,head] #10000000570 auth v5784 s=3 n(v0 rc2023-10-03T19:13:45.407148+0000 b3 1=1+0) (iversion lock) 0x55cf6252d700] 2023-10-03T19:20:50.239 INFO:teuthology.orchestra.run.smithi045.stdout: -6826> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_891 [2,head] auth NULL (dversion lock) v=5784 ino=(nil) state=1073741824 0x55cf62532a00] 2023-10-03T19:20:50.239 INFO:teuthology.orchestra.run.smithi045.stdout: -6825> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_890 [2,head] auth (dversion lock) v=5782 ino=0x1000000056f state=1073741824 0x55cf62532780] 2023-10-03T19:20:50.239 INFO:teuthology.orchestra.run.smithi045.stdout: -6824> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:50.239 INFO:teuthology.orchestra.run.smithi045.stdout: -6823> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000056f [2,head] /dc-dir/dc-file_890 auth v5782 s=3 n(v0 rc2023-10-03T19:13:45.396184+0000 b3 1=1+0) (iversion lock) 0x55cf6252d180] 2023-10-03T19:20:50.240 INFO:teuthology.orchestra.run.smithi045.stdout: -6822> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_890 [2,head] auth (dversion lock) v=5782 ino=0x1000000056f state=1073741824 0x55cf62532780] [inode 0x1000000056f [2,head] /dc-dir/dc-file_890 auth v5782 s=3 n(v0 rc2023-10-03T19:13:45.396184+0000 b3 1=1+0) (iversion lock) 0x55cf6252d180] 2023-10-03T19:20:50.240 INFO:teuthology.orchestra.run.smithi045.stdout: -6821> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000056f [2,head] #1000000056f auth v5782 s=3 n(v0 rc2023-10-03T19:13:45.396184+0000 b3 1=1+0) (iversion lock) 0x55cf6252d180] 2023-10-03T19:20:50.240 INFO:teuthology.orchestra.run.smithi045.stdout: -6820> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_890 [2,head] auth NULL (dversion lock) v=5782 ino=(nil) state=1073741824 0x55cf62532780] 2023-10-03T19:20:50.240 INFO:teuthology.orchestra.run.smithi045.stdout: -6819> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_889 [2,head] auth (dversion lock) v=5780 ino=0x1000000056e state=1073741824 0x55cf62532500] 2023-10-03T19:20:50.240 INFO:teuthology.orchestra.run.smithi045.stdout: -6818> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:50.240 INFO:teuthology.orchestra.run.smithi045.stdout: -6817> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000056e [2,head] /dc-dir/dc-file_889 auth v5780 s=3 n(v0 rc2023-10-03T19:13:45.384245+0000 b3 1=1+0) (iversion lock) 0x55cf6252cc00] 2023-10-03T19:20:50.240 INFO:teuthology.orchestra.run.smithi045.stdout: -6816> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_889 [2,head] auth (dversion lock) v=5780 ino=0x1000000056e state=1073741824 0x55cf62532500] [inode 0x1000000056e [2,head] /dc-dir/dc-file_889 auth v5780 s=3 n(v0 rc2023-10-03T19:13:45.384245+0000 b3 1=1+0) (iversion lock) 0x55cf6252cc00] 2023-10-03T19:20:50.240 INFO:teuthology.orchestra.run.smithi045.stdout: -6815> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000056e [2,head] #1000000056e auth v5780 s=3 n(v0 rc2023-10-03T19:13:45.384245+0000 b3 1=1+0) (iversion lock) 0x55cf6252cc00] 2023-10-03T19:20:50.241 INFO:teuthology.orchestra.run.smithi045.stdout: -6814> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_889 [2,head] auth NULL (dversion lock) v=5780 ino=(nil) state=1073741824 0x55cf62532500] 2023-10-03T19:20:50.241 INFO:teuthology.orchestra.run.smithi045.stdout: -6813> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_888 [2,head] auth (dversion lock) v=5778 ino=0x1000000056d state=1073741824 0x55cf62532280] 2023-10-03T19:20:50.241 INFO:teuthology.orchestra.run.smithi045.stdout: -6812> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:50.241 INFO:teuthology.orchestra.run.smithi045.stdout: -6811> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000056d [2,head] /dc-dir/dc-file_888 auth v5778 s=3 n(v0 rc2023-10-03T19:13:45.372018+0000 b3 1=1+0) (iversion lock) 0x55cf6252c680] 2023-10-03T19:20:50.241 INFO:teuthology.orchestra.run.smithi045.stdout: -6810> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_888 [2,head] auth (dversion lock) v=5778 ino=0x1000000056d state=1073741824 0x55cf62532280] [inode 0x1000000056d [2,head] /dc-dir/dc-file_888 auth v5778 s=3 n(v0 rc2023-10-03T19:13:45.372018+0000 b3 1=1+0) (iversion lock) 0x55cf6252c680] 2023-10-03T19:20:50.241 INFO:teuthology.orchestra.run.smithi045.stdout: -6809> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000056d [2,head] #1000000056d auth v5778 s=3 n(v0 rc2023-10-03T19:13:45.372018+0000 b3 1=1+0) (iversion lock) 0x55cf6252c680] 2023-10-03T19:20:50.242 INFO:teuthology.orchestra.run.smithi045.stdout: -6808> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_888 [2,head] auth NULL (dversion lock) v=5778 ino=(nil) state=1073741824 0x55cf62532280] 2023-10-03T19:20:50.242 INFO:teuthology.orchestra.run.smithi045.stdout: -6807> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_887 [2,head] auth (dversion lock) v=5776 ino=0x1000000056c state=1073741824 0x55cf62532000] 2023-10-03T19:20:50.242 INFO:teuthology.orchestra.run.smithi045.stdout: -6806> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:50.242 INFO:teuthology.orchestra.run.smithi045.stdout: -6805> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000056c [2,head] /dc-dir/dc-file_887 auth v5776 s=3 n(v0 rc2023-10-03T19:13:45.359711+0000 b3 1=1+0) (iversion lock) 0x55cf6252c100] 2023-10-03T19:20:50.242 INFO:teuthology.orchestra.run.smithi045.stdout: -6804> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_887 [2,head] auth (dversion lock) v=5776 ino=0x1000000056c state=1073741824 0x55cf62532000] [inode 0x1000000056c [2,head] /dc-dir/dc-file_887 auth v5776 s=3 n(v0 rc2023-10-03T19:13:45.359711+0000 b3 1=1+0) (iversion lock) 0x55cf6252c100] 2023-10-03T19:20:50.242 INFO:teuthology.orchestra.run.smithi045.stdout: -6803> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000056c [2,head] #1000000056c auth v5776 s=3 n(v0 rc2023-10-03T19:13:45.359711+0000 b3 1=1+0) (iversion lock) 0x55cf6252c100] 2023-10-03T19:20:50.242 INFO:teuthology.orchestra.run.smithi045.stdout: -6802> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_887 [2,head] auth NULL (dversion lock) v=5776 ino=(nil) state=1073741824 0x55cf62532000] 2023-10-03T19:20:50.242 INFO:teuthology.orchestra.run.smithi045.stdout: -6801> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_886 [2,head] auth (dversion lock) v=5774 ino=0x1000000056b state=1073741824 0x55cf62529b80] 2023-10-03T19:20:50.243 INFO:teuthology.orchestra.run.smithi045.stdout: -6800> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:50.243 INFO:teuthology.orchestra.run.smithi045.stdout: -6799> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000056b [2,head] /dc-dir/dc-file_886 auth v5774 s=3 n(v0 rc2023-10-03T19:13:45.348546+0000 b3 1=1+0) (iversion lock) 0x55cf6252bb80] 2023-10-03T19:20:50.243 INFO:teuthology.orchestra.run.smithi045.stdout: -6798> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_886 [2,head] auth (dversion lock) v=5774 ino=0x1000000056b state=1073741824 0x55cf62529b80] [inode 0x1000000056b [2,head] /dc-dir/dc-file_886 auth v5774 s=3 n(v0 rc2023-10-03T19:13:45.348546+0000 b3 1=1+0) (iversion lock) 0x55cf6252bb80] 2023-10-03T19:20:50.243 INFO:teuthology.orchestra.run.smithi045.stdout: -6797> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000056b [2,head] #1000000056b auth v5774 s=3 n(v0 rc2023-10-03T19:13:45.348546+0000 b3 1=1+0) (iversion lock) 0x55cf6252bb80] 2023-10-03T19:20:50.243 INFO:teuthology.orchestra.run.smithi045.stdout: -6796> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_886 [2,head] auth NULL (dversion lock) v=5774 ino=(nil) state=1073741824 0x55cf62529b80] 2023-10-03T19:20:50.243 INFO:teuthology.orchestra.run.smithi045.stdout: -6795> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_885 [2,head] auth (dversion lock) v=5772 ino=0x1000000056a state=1073741824 0x55cf62529900] 2023-10-03T19:20:50.243 INFO:teuthology.orchestra.run.smithi045.stdout: -6794> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:50.243 INFO:teuthology.orchestra.run.smithi045.stdout: -6793> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000056a [2,head] /dc-dir/dc-file_885 auth v5772 s=3 n(v0 rc2023-10-03T19:13:45.335913+0000 b3 1=1+0) (iversion lock) 0x55cf6252b600] 2023-10-03T19:20:50.244 INFO:teuthology.orchestra.run.smithi045.stdout: -6792> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_885 [2,head] auth (dversion lock) v=5772 ino=0x1000000056a state=1073741824 0x55cf62529900] [inode 0x1000000056a [2,head] /dc-dir/dc-file_885 auth v5772 s=3 n(v0 rc2023-10-03T19:13:45.335913+0000 b3 1=1+0) (iversion lock) 0x55cf6252b600] 2023-10-03T19:20:50.244 INFO:teuthology.orchestra.run.smithi045.stdout: -6791> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000056a [2,head] #1000000056a auth v5772 s=3 n(v0 rc2023-10-03T19:13:45.335913+0000 b3 1=1+0) (iversion lock) 0x55cf6252b600] 2023-10-03T19:20:50.244 INFO:teuthology.orchestra.run.smithi045.stdout: -6790> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_885 [2,head] auth NULL (dversion lock) v=5772 ino=(nil) state=1073741824 0x55cf62529900] 2023-10-03T19:20:50.244 INFO:teuthology.orchestra.run.smithi045.stdout: -6789> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_884 [2,head] auth (dversion lock) v=5770 ino=0x10000000569 state=1073741824 0x55cf62529680] 2023-10-03T19:20:50.244 INFO:teuthology.orchestra.run.smithi045.stdout: -6788> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:50.244 INFO:teuthology.orchestra.run.smithi045.stdout: -6787> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000569 [2,head] /dc-dir/dc-file_884 auth v5770 s=3 n(v0 rc2023-10-03T19:13:45.324409+0000 b3 1=1+0) (iversion lock) 0x55cf6252b080] 2023-10-03T19:20:50.244 INFO:teuthology.orchestra.run.smithi045.stdout: -6786> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_884 [2,head] auth (dversion lock) v=5770 ino=0x10000000569 state=1073741824 0x55cf62529680] [inode 0x10000000569 [2,head] /dc-dir/dc-file_884 auth v5770 s=3 n(v0 rc2023-10-03T19:13:45.324409+0000 b3 1=1+0) (iversion lock) 0x55cf6252b080] 2023-10-03T19:20:50.244 INFO:teuthology.orchestra.run.smithi045.stdout: -6785> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000569 [2,head] #10000000569 auth v5770 s=3 n(v0 rc2023-10-03T19:13:45.324409+0000 b3 1=1+0) (iversion lock) 0x55cf6252b080] 2023-10-03T19:20:50.245 INFO:teuthology.orchestra.run.smithi045.stdout: -6784> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_884 [2,head] auth NULL (dversion lock) v=5770 ino=(nil) state=1073741824 0x55cf62529680] 2023-10-03T19:20:50.245 INFO:teuthology.orchestra.run.smithi045.stdout: -6783> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_883 [2,head] auth (dversion lock) v=5768 ino=0x10000000568 state=1073741824 0x55cf62529400] 2023-10-03T19:20:50.245 INFO:teuthology.orchestra.run.smithi045.stdout: -6782> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:50.245 INFO:teuthology.orchestra.run.smithi045.stdout: -6781> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000568 [2,head] /dc-dir/dc-file_883 auth v5768 s=3 n(v0 rc2023-10-03T19:13:45.311725+0000 b3 1=1+0) (iversion lock) 0x55cf6252ab00] 2023-10-03T19:20:50.245 INFO:teuthology.orchestra.run.smithi045.stdout: -6780> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_883 [2,head] auth (dversion lock) v=5768 ino=0x10000000568 state=1073741824 0x55cf62529400] [inode 0x10000000568 [2,head] /dc-dir/dc-file_883 auth v5768 s=3 n(v0 rc2023-10-03T19:13:45.311725+0000 b3 1=1+0) (iversion lock) 0x55cf6252ab00] 2023-10-03T19:20:50.245 INFO:teuthology.orchestra.run.smithi045.stdout: -6779> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000568 [2,head] #10000000568 auth v5768 s=3 n(v0 rc2023-10-03T19:13:45.311725+0000 b3 1=1+0) (iversion lock) 0x55cf6252ab00] 2023-10-03T19:20:50.245 INFO:teuthology.orchestra.run.smithi045.stdout: -6778> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_883 [2,head] auth NULL (dversion lock) v=5768 ino=(nil) state=1073741824 0x55cf62529400] 2023-10-03T19:20:50.246 INFO:teuthology.orchestra.run.smithi045.stdout: -6777> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_882 [2,head] auth (dversion lock) v=5766 ino=0x10000000567 state=1073741824 0x55cf62529180] 2023-10-03T19:20:50.246 INFO:teuthology.orchestra.run.smithi045.stdout: -6776> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:50.246 INFO:teuthology.orchestra.run.smithi045.stdout: -6775> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000567 [2,head] /dc-dir/dc-file_882 auth v5766 s=3 n(v0 rc2023-10-03T19:13:45.299989+0000 b3 1=1+0) (iversion lock) 0x55cf6252a580] 2023-10-03T19:20:50.246 INFO:teuthology.orchestra.run.smithi045.stdout: -6774> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_882 [2,head] auth (dversion lock) v=5766 ino=0x10000000567 state=1073741824 0x55cf62529180] [inode 0x10000000567 [2,head] /dc-dir/dc-file_882 auth v5766 s=3 n(v0 rc2023-10-03T19:13:45.299989+0000 b3 1=1+0) (iversion lock) 0x55cf6252a580] 2023-10-03T19:20:50.246 INFO:teuthology.orchestra.run.smithi045.stdout: -6773> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000567 [2,head] #10000000567 auth v5766 s=3 n(v0 rc2023-10-03T19:13:45.299989+0000 b3 1=1+0) (iversion lock) 0x55cf6252a580] 2023-10-03T19:20:50.246 INFO:teuthology.orchestra.run.smithi045.stdout: -6772> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_882 [2,head] auth NULL (dversion lock) v=5766 ino=(nil) state=1073741824 0x55cf62529180] 2023-10-03T19:20:50.246 INFO:teuthology.orchestra.run.smithi045.stdout: -6771> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_881 [2,head] auth (dversion lock) v=5764 ino=0x10000000566 state=1073741824 0x55cf62528f00] 2023-10-03T19:20:50.246 INFO:teuthology.orchestra.run.smithi045.stdout: -6770> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:50.247 INFO:teuthology.orchestra.run.smithi045.stdout: -6769> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000566 [2,head] /dc-dir/dc-file_881 auth v5764 s=3 n(v0 rc2023-10-03T19:13:45.287936+0000 b3 1=1+0) (iversion lock) 0x55cf6252a000] 2023-10-03T19:20:50.247 INFO:teuthology.orchestra.run.smithi045.stdout: -6768> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_881 [2,head] auth (dversion lock) v=5764 ino=0x10000000566 state=1073741824 0x55cf62528f00] [inode 0x10000000566 [2,head] /dc-dir/dc-file_881 auth v5764 s=3 n(v0 rc2023-10-03T19:13:45.287936+0000 b3 1=1+0) (iversion lock) 0x55cf6252a000] 2023-10-03T19:20:50.247 INFO:teuthology.orchestra.run.smithi045.stdout: -6767> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000566 [2,head] #10000000566 auth v5764 s=3 n(v0 rc2023-10-03T19:13:45.287936+0000 b3 1=1+0) (iversion lock) 0x55cf6252a000] 2023-10-03T19:20:50.247 INFO:teuthology.orchestra.run.smithi045.stdout: -6766> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_881 [2,head] auth NULL (dversion lock) v=5764 ino=(nil) state=1073741824 0x55cf62528f00] 2023-10-03T19:20:50.247 INFO:teuthology.orchestra.run.smithi045.stdout: -6765> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_880 [2,head] auth (dversion lock) v=5762 ino=0x10000000565 state=1073741824 0x55cf62528c80] 2023-10-03T19:20:50.247 INFO:teuthology.orchestra.run.smithi045.stdout: -6764> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:50.247 INFO:teuthology.orchestra.run.smithi045.stdout: -6763> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000565 [2,head] /dc-dir/dc-file_880 auth v5762 s=3 n(v0 rc2023-10-03T19:13:45.275476+0000 b3 1=1+0) (iversion lock) 0x55cf62527700] 2023-10-03T19:20:50.247 INFO:teuthology.orchestra.run.smithi045.stdout: -6762> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_880 [2,head] auth (dversion lock) v=5762 ino=0x10000000565 state=1073741824 0x55cf62528c80] [inode 0x10000000565 [2,head] /dc-dir/dc-file_880 auth v5762 s=3 n(v0 rc2023-10-03T19:13:45.275476+0000 b3 1=1+0) (iversion lock) 0x55cf62527700] 2023-10-03T19:20:50.248 INFO:teuthology.orchestra.run.smithi045.stdout: -6761> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000565 [2,head] #10000000565 auth v5762 s=3 n(v0 rc2023-10-03T19:13:45.275476+0000 b3 1=1+0) (iversion lock) 0x55cf62527700] 2023-10-03T19:20:50.248 INFO:teuthology.orchestra.run.smithi045.stdout: -6760> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_880 [2,head] auth NULL (dversion lock) v=5762 ino=(nil) state=1073741824 0x55cf62528c80] 2023-10-03T19:20:50.248 INFO:teuthology.orchestra.run.smithi045.stdout: -6759> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_879 [2,head] auth (dversion lock) v=5760 ino=0x10000000564 state=1073741824 0x55cf62528a00] 2023-10-03T19:20:50.248 INFO:teuthology.orchestra.run.smithi045.stdout: -6758> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:50.248 INFO:teuthology.orchestra.run.smithi045.stdout: -6757> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000564 [2,head] /dc-dir/dc-file_879 auth v5760 s=3 n(v0 rc2023-10-03T19:13:45.263082+0000 b3 1=1+0) (iversion lock) 0x55cf62527180] 2023-10-03T19:20:50.248 INFO:teuthology.orchestra.run.smithi045.stdout: -6756> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_879 [2,head] auth (dversion lock) v=5760 ino=0x10000000564 state=1073741824 0x55cf62528a00] [inode 0x10000000564 [2,head] /dc-dir/dc-file_879 auth v5760 s=3 n(v0 rc2023-10-03T19:13:45.263082+0000 b3 1=1+0) (iversion lock) 0x55cf62527180] 2023-10-03T19:20:50.248 INFO:teuthology.orchestra.run.smithi045.stdout: -6755> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000564 [2,head] #10000000564 auth v5760 s=3 n(v0 rc2023-10-03T19:13:45.263082+0000 b3 1=1+0) (iversion lock) 0x55cf62527180] 2023-10-03T19:20:50.248 INFO:teuthology.orchestra.run.smithi045.stdout: -6754> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_879 [2,head] auth NULL (dversion lock) v=5760 ino=(nil) state=1073741824 0x55cf62528a00] 2023-10-03T19:20:50.249 INFO:teuthology.orchestra.run.smithi045.stdout: -6753> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_878 [2,head] auth (dversion lock) v=5758 ino=0x10000000563 state=1073741824 0x55cf62528780] 2023-10-03T19:20:50.249 INFO:teuthology.orchestra.run.smithi045.stdout: -6752> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:50.249 INFO:teuthology.orchestra.run.smithi045.stdout: -6751> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000563 [2,head] /dc-dir/dc-file_878 auth v5758 s=3 n(v0 rc2023-10-03T19:13:45.251772+0000 b3 1=1+0) (iversion lock) 0x55cf62526c00] 2023-10-03T19:20:50.249 INFO:teuthology.orchestra.run.smithi045.stdout: -6750> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_878 [2,head] auth (dversion lock) v=5758 ino=0x10000000563 state=1073741824 0x55cf62528780] [inode 0x10000000563 [2,head] /dc-dir/dc-file_878 auth v5758 s=3 n(v0 rc2023-10-03T19:13:45.251772+0000 b3 1=1+0) (iversion lock) 0x55cf62526c00] 2023-10-03T19:20:50.249 INFO:teuthology.orchestra.run.smithi045.stdout: -6749> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000563 [2,head] #10000000563 auth v5758 s=3 n(v0 rc2023-10-03T19:13:45.251772+0000 b3 1=1+0) (iversion lock) 0x55cf62526c00] 2023-10-03T19:20:50.249 INFO:teuthology.orchestra.run.smithi045.stdout: -6748> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_878 [2,head] auth NULL (dversion lock) v=5758 ino=(nil) state=1073741824 0x55cf62528780] 2023-10-03T19:20:50.249 INFO:teuthology.orchestra.run.smithi045.stdout: -6747> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_877 [2,head] auth (dversion lock) v=5756 ino=0x10000000562 state=1073741824 0x55cf62528500] 2023-10-03T19:20:50.249 INFO:teuthology.orchestra.run.smithi045.stdout: -6746> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:50.250 INFO:teuthology.orchestra.run.smithi045.stdout: -6745> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000562 [2,head] /dc-dir/dc-file_877 auth v5756 s=3 n(v0 rc2023-10-03T19:13:45.239987+0000 b3 1=1+0) (iversion lock) 0x55cf62526680] 2023-10-03T19:20:50.250 INFO:teuthology.orchestra.run.smithi045.stdout: -6744> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_877 [2,head] auth (dversion lock) v=5756 ino=0x10000000562 state=1073741824 0x55cf62528500] [inode 0x10000000562 [2,head] /dc-dir/dc-file_877 auth v5756 s=3 n(v0 rc2023-10-03T19:13:45.239987+0000 b3 1=1+0) (iversion lock) 0x55cf62526680] 2023-10-03T19:20:50.250 INFO:teuthology.orchestra.run.smithi045.stdout: -6743> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000562 [2,head] #10000000562 auth v5756 s=3 n(v0 rc2023-10-03T19:13:45.239987+0000 b3 1=1+0) (iversion lock) 0x55cf62526680] 2023-10-03T19:20:50.250 INFO:teuthology.orchestra.run.smithi045.stdout: -6742> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_877 [2,head] auth NULL (dversion lock) v=5756 ino=(nil) state=1073741824 0x55cf62528500] 2023-10-03T19:20:50.250 INFO:teuthology.orchestra.run.smithi045.stdout: -6741> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_876 [2,head] auth (dversion lock) v=5754 ino=0x10000000561 state=1073741824 0x55cf62528280] 2023-10-03T19:20:50.250 INFO:teuthology.orchestra.run.smithi045.stdout: -6740> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:50.251 INFO:teuthology.orchestra.run.smithi045.stdout: -6739> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000561 [2,head] /dc-dir/dc-file_876 auth v5754 s=3 n(v0 rc2023-10-03T19:13:45.228305+0000 b3 1=1+0) (iversion lock) 0x55cf62526100] 2023-10-03T19:20:50.251 INFO:teuthology.orchestra.run.smithi045.stdout: -6738> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_876 [2,head] auth (dversion lock) v=5754 ino=0x10000000561 state=1073741824 0x55cf62528280] [inode 0x10000000561 [2,head] /dc-dir/dc-file_876 auth v5754 s=3 n(v0 rc2023-10-03T19:13:45.228305+0000 b3 1=1+0) (iversion lock) 0x55cf62526100] 2023-10-03T19:20:50.251 INFO:teuthology.orchestra.run.smithi045.stdout: -6737> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000561 [2,head] #10000000561 auth v5754 s=3 n(v0 rc2023-10-03T19:13:45.228305+0000 b3 1=1+0) (iversion lock) 0x55cf62526100] 2023-10-03T19:20:50.251 INFO:teuthology.orchestra.run.smithi045.stdout: -6736> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_876 [2,head] auth NULL (dversion lock) v=5754 ino=(nil) state=1073741824 0x55cf62528280] 2023-10-03T19:20:50.251 INFO:teuthology.orchestra.run.smithi045.stdout: -6735> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_875 [2,head] auth (dversion lock) v=5752 ino=0x10000000560 state=1073741824 0x55cf62528000] 2023-10-03T19:20:50.251 INFO:teuthology.orchestra.run.smithi045.stdout: -6734> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:50.251 INFO:teuthology.orchestra.run.smithi045.stdout: -6733> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000560 [2,head] /dc-dir/dc-file_875 auth v5752 s=3 n(v0 rc2023-10-03T19:13:45.216818+0000 b3 1=1+0) (iversion lock) 0x55cf62525b80] 2023-10-03T19:20:50.251 INFO:teuthology.orchestra.run.smithi045.stdout: -6732> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_875 [2,head] auth (dversion lock) v=5752 ino=0x10000000560 state=1073741824 0x55cf62528000] [inode 0x10000000560 [2,head] /dc-dir/dc-file_875 auth v5752 s=3 n(v0 rc2023-10-03T19:13:45.216818+0000 b3 1=1+0) (iversion lock) 0x55cf62525b80] 2023-10-03T19:20:50.251 INFO:teuthology.orchestra.run.smithi045.stdout: -6731> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000560 [2,head] #10000000560 auth v5752 s=3 n(v0 rc2023-10-03T19:13:45.216818+0000 b3 1=1+0) (iversion lock) 0x55cf62525b80] 2023-10-03T19:20:50.252 INFO:teuthology.orchestra.run.smithi045.stdout: -6730> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_875 [2,head] auth NULL (dversion lock) v=5752 ino=(nil) state=1073741824 0x55cf62528000] 2023-10-03T19:20:50.252 INFO:teuthology.orchestra.run.smithi045.stdout: -6729> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_874 [2,head] auth (dversion lock) v=5750 ino=0x1000000055f state=1073741824 0x55cf62521b80] 2023-10-03T19:20:50.252 INFO:teuthology.orchestra.run.smithi045.stdout: -6728> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:50.252 INFO:teuthology.orchestra.run.smithi045.stdout: -6727> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000055f [2,head] /dc-dir/dc-file_874 auth v5750 s=3 n(v0 rc2023-10-03T19:13:45.205309+0000 b3 1=1+0) (iversion lock) 0x55cf62525600] 2023-10-03T19:20:50.252 INFO:teuthology.orchestra.run.smithi045.stdout: -6726> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_874 [2,head] auth (dversion lock) v=5750 ino=0x1000000055f state=1073741824 0x55cf62521b80] [inode 0x1000000055f [2,head] /dc-dir/dc-file_874 auth v5750 s=3 n(v0 rc2023-10-03T19:13:45.205309+0000 b3 1=1+0) (iversion lock) 0x55cf62525600] 2023-10-03T19:20:50.252 INFO:teuthology.orchestra.run.smithi045.stdout: -6725> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000055f [2,head] #1000000055f auth v5750 s=3 n(v0 rc2023-10-03T19:13:45.205309+0000 b3 1=1+0) (iversion lock) 0x55cf62525600] 2023-10-03T19:20:50.252 INFO:teuthology.orchestra.run.smithi045.stdout: -6724> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_874 [2,head] auth NULL (dversion lock) v=5750 ino=(nil) state=1073741824 0x55cf62521b80] 2023-10-03T19:20:50.252 INFO:teuthology.orchestra.run.smithi045.stdout: -6723> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_873 [2,head] auth (dversion lock) v=5748 ino=0x1000000055e state=1073741824 0x55cf62521900] 2023-10-03T19:20:50.253 INFO:teuthology.orchestra.run.smithi045.stdout: -6722> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:50.253 INFO:teuthology.orchestra.run.smithi045.stdout: -6721> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000055e [2,head] /dc-dir/dc-file_873 auth v5748 s=3 n(v0 rc2023-10-03T19:13:45.192626+0000 b3 1=1+0) (iversion lock) 0x55cf62525080] 2023-10-03T19:20:50.253 INFO:teuthology.orchestra.run.smithi045.stdout: -6720> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_873 [2,head] auth (dversion lock) v=5748 ino=0x1000000055e state=1073741824 0x55cf62521900] [inode 0x1000000055e [2,head] /dc-dir/dc-file_873 auth v5748 s=3 n(v0 rc2023-10-03T19:13:45.192626+0000 b3 1=1+0) (iversion lock) 0x55cf62525080] 2023-10-03T19:20:52.155 INFO:teuthology.orchestra.run.smithi045.stdout: -6719> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000055e [2,head] #1000000055e auth v5748 s=3 n(v0 rc2023-10-03T19:13:45.192626+0000 b3 1=1+0) (iversion lock) 0x55cf62525080] 2023-10-03T19:20:52.155 INFO:teuthology.orchestra.run.smithi045.stdout: -6718> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_873 [2,head] auth NULL (dversion lock) v=5748 ino=(nil) state=1073741824 0x55cf62521900] 2023-10-03T19:20:52.155 INFO:teuthology.orchestra.run.smithi045.stdout: -6717> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_872 [2,head] auth (dversion lock) v=5746 ino=0x1000000055d state=1073741824 0x55cf62521680] 2023-10-03T19:20:52.155 INFO:teuthology.orchestra.run.smithi045.stdout: -6716> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.155 INFO:teuthology.orchestra.run.smithi045.stdout: -6715> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000055d [2,head] /dc-dir/dc-file_872 auth v5746 s=3 n(v0 rc2023-10-03T19:13:45.181140+0000 b3 1=1+0) (iversion lock) 0x55cf62524b00] 2023-10-03T19:20:52.155 INFO:teuthology.orchestra.run.smithi045.stdout: -6714> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_872 [2,head] auth (dversion lock) v=5746 ino=0x1000000055d state=1073741824 0x55cf62521680] [inode 0x1000000055d [2,head] /dc-dir/dc-file_872 auth v5746 s=3 n(v0 rc2023-10-03T19:13:45.181140+0000 b3 1=1+0) (iversion lock) 0x55cf62524b00] 2023-10-03T19:20:52.155 INFO:teuthology.orchestra.run.smithi045.stdout: -6713> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000055d [2,head] #1000000055d auth v5746 s=3 n(v0 rc2023-10-03T19:13:45.181140+0000 b3 1=1+0) (iversion lock) 0x55cf62524b00] 2023-10-03T19:20:52.156 INFO:teuthology.orchestra.run.smithi045.stdout: -6712> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_872 [2,head] auth NULL (dversion lock) v=5746 ino=(nil) state=1073741824 0x55cf62521680] 2023-10-03T19:20:52.156 INFO:teuthology.orchestra.run.smithi045.stdout: -6711> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_871 [2,head] auth (dversion lock) v=5744 ino=0x1000000055c state=1073741824 0x55cf62521400] 2023-10-03T19:20:52.156 INFO:teuthology.orchestra.run.smithi045.stdout: -6710> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.157 INFO:teuthology.orchestra.run.smithi045.stdout: -6709> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000055c [2,head] /dc-dir/dc-file_871 auth v5744 s=3 n(v0 rc2023-10-03T19:13:45.168693+0000 b3 1=1+0) (iversion lock) 0x55cf62524580] 2023-10-03T19:20:52.157 INFO:teuthology.orchestra.run.smithi045.stdout: -6708> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_871 [2,head] auth (dversion lock) v=5744 ino=0x1000000055c state=1073741824 0x55cf62521400] [inode 0x1000000055c [2,head] /dc-dir/dc-file_871 auth v5744 s=3 n(v0 rc2023-10-03T19:13:45.168693+0000 b3 1=1+0) (iversion lock) 0x55cf62524580] 2023-10-03T19:20:52.157 INFO:teuthology.orchestra.run.smithi045.stdout: -6707> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000055c [2,head] #1000000055c auth v5744 s=3 n(v0 rc2023-10-03T19:13:45.168693+0000 b3 1=1+0) (iversion lock) 0x55cf62524580] 2023-10-03T19:20:52.157 INFO:teuthology.orchestra.run.smithi045.stdout: -6706> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_871 [2,head] auth NULL (dversion lock) v=5744 ino=(nil) state=1073741824 0x55cf62521400] 2023-10-03T19:20:52.157 INFO:teuthology.orchestra.run.smithi045.stdout: -6705> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_870 [2,head] auth (dversion lock) v=5742 ino=0x1000000055b state=1073741824 0x55cf62521180] 2023-10-03T19:20:52.157 INFO:teuthology.orchestra.run.smithi045.stdout: -6704> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.157 INFO:teuthology.orchestra.run.smithi045.stdout: -6703> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000055b [2,head] /dc-dir/dc-file_870 auth v5742 s=3 n(v0 rc2023-10-03T19:13:45.156212+0000 b3 1=1+0) (iversion lock) 0x55cf62524000] 2023-10-03T19:20:52.157 INFO:teuthology.orchestra.run.smithi045.stdout: -6702> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_870 [2,head] auth (dversion lock) v=5742 ino=0x1000000055b state=1073741824 0x55cf62521180] [inode 0x1000000055b [2,head] /dc-dir/dc-file_870 auth v5742 s=3 n(v0 rc2023-10-03T19:13:45.156212+0000 b3 1=1+0) (iversion lock) 0x55cf62524000] 2023-10-03T19:20:52.158 INFO:teuthology.orchestra.run.smithi045.stdout: -6701> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000055b [2,head] #1000000055b auth v5742 s=3 n(v0 rc2023-10-03T19:13:45.156212+0000 b3 1=1+0) (iversion lock) 0x55cf62524000] 2023-10-03T19:20:52.158 INFO:teuthology.orchestra.run.smithi045.stdout: -6700> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_870 [2,head] auth NULL (dversion lock) v=5742 ino=(nil) state=1073741824 0x55cf62521180] 2023-10-03T19:20:52.158 INFO:teuthology.orchestra.run.smithi045.stdout: -6699> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_869 [2,head] auth (dversion lock) v=5740 ino=0x1000000055a state=1073741824 0x55cf62520f00] 2023-10-03T19:20:52.158 INFO:teuthology.orchestra.run.smithi045.stdout: -6698> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.158 INFO:teuthology.orchestra.run.smithi045.stdout: -6697> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000055a [2,head] /dc-dir/dc-file_869 auth v5740 s=3 n(v0 rc2023-10-03T19:13:45.143352+0000 b3 1=1+0) (iversion lock) 0x55cf6251d700] 2023-10-03T19:20:52.158 INFO:teuthology.orchestra.run.smithi045.stdout: -6696> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_869 [2,head] auth (dversion lock) v=5740 ino=0x1000000055a state=1073741824 0x55cf62520f00] [inode 0x1000000055a [2,head] /dc-dir/dc-file_869 auth v5740 s=3 n(v0 rc2023-10-03T19:13:45.143352+0000 b3 1=1+0) (iversion lock) 0x55cf6251d700] 2023-10-03T19:20:52.158 INFO:teuthology.orchestra.run.smithi045.stdout: -6695> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000055a [2,head] #1000000055a auth v5740 s=3 n(v0 rc2023-10-03T19:13:45.143352+0000 b3 1=1+0) (iversion lock) 0x55cf6251d700] 2023-10-03T19:20:52.158 INFO:teuthology.orchestra.run.smithi045.stdout: -6694> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_869 [2,head] auth NULL (dversion lock) v=5740 ino=(nil) state=1073741824 0x55cf62520f00] 2023-10-03T19:20:52.158 INFO:teuthology.orchestra.run.smithi045.stdout: -6693> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_868 [2,head] auth (dversion lock) v=5738 ino=0x10000000559 state=1073741824 0x55cf62520c80] 2023-10-03T19:20:52.159 INFO:teuthology.orchestra.run.smithi045.stdout: -6692> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.159 INFO:teuthology.orchestra.run.smithi045.stdout: -6691> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000559 [2,head] /dc-dir/dc-file_868 auth v5738 s=3 n(v0 rc2023-10-03T19:13:45.132017+0000 b3 1=1+0) (iversion lock) 0x55cf6251d180] 2023-10-03T19:20:52.159 INFO:teuthology.orchestra.run.smithi045.stdout: -6690> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_868 [2,head] auth (dversion lock) v=5738 ino=0x10000000559 state=1073741824 0x55cf62520c80] [inode 0x10000000559 [2,head] /dc-dir/dc-file_868 auth v5738 s=3 n(v0 rc2023-10-03T19:13:45.132017+0000 b3 1=1+0) (iversion lock) 0x55cf6251d180] 2023-10-03T19:20:52.159 INFO:teuthology.orchestra.run.smithi045.stdout: -6689> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000559 [2,head] #10000000559 auth v5738 s=3 n(v0 rc2023-10-03T19:13:45.132017+0000 b3 1=1+0) (iversion lock) 0x55cf6251d180] 2023-10-03T19:20:52.159 INFO:teuthology.orchestra.run.smithi045.stdout: -6688> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_868 [2,head] auth NULL (dversion lock) v=5738 ino=(nil) state=1073741824 0x55cf62520c80] 2023-10-03T19:20:52.159 INFO:teuthology.orchestra.run.smithi045.stdout: -6687> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_867 [2,head] auth (dversion lock) v=5736 ino=0x10000000558 state=1073741824 0x55cf62520a00] 2023-10-03T19:20:52.159 INFO:teuthology.orchestra.run.smithi045.stdout: -6686> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.159 INFO:teuthology.orchestra.run.smithi045.stdout: -6685> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000558 [2,head] /dc-dir/dc-file_867 auth v5736 s=3 n(v0 rc2023-10-03T19:13:45.118603+0000 b3 1=1+0) (iversion lock) 0x55cf6251cc00] 2023-10-03T19:20:52.159 INFO:teuthology.orchestra.run.smithi045.stdout: -6684> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_867 [2,head] auth (dversion lock) v=5736 ino=0x10000000558 state=1073741824 0x55cf62520a00] [inode 0x10000000558 [2,head] /dc-dir/dc-file_867 auth v5736 s=3 n(v0 rc2023-10-03T19:13:45.118603+0000 b3 1=1+0) (iversion lock) 0x55cf6251cc00] 2023-10-03T19:20:52.159 INFO:teuthology.orchestra.run.smithi045.stdout: -6683> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000558 [2,head] #10000000558 auth v5736 s=3 n(v0 rc2023-10-03T19:13:45.118603+0000 b3 1=1+0) (iversion lock) 0x55cf6251cc00] 2023-10-03T19:20:52.160 INFO:teuthology.orchestra.run.smithi045.stdout: -6682> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_867 [2,head] auth NULL (dversion lock) v=5736 ino=(nil) state=1073741824 0x55cf62520a00] 2023-10-03T19:20:52.160 INFO:teuthology.orchestra.run.smithi045.stdout: -6681> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_866 [2,head] auth (dversion lock) v=5734 ino=0x10000000557 state=1073741824 0x55cf62520780] 2023-10-03T19:20:52.160 INFO:teuthology.orchestra.run.smithi045.stdout: -6680> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.160 INFO:teuthology.orchestra.run.smithi045.stdout: -6679> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000557 [2,head] /dc-dir/dc-file_866 auth v5734 s=3 n(v0 rc2023-10-03T19:13:45.107664+0000 b3 1=1+0) (iversion lock) 0x55cf6251c680] 2023-10-03T19:20:52.160 INFO:teuthology.orchestra.run.smithi045.stdout: -6678> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_866 [2,head] auth (dversion lock) v=5734 ino=0x10000000557 state=1073741824 0x55cf62520780] [inode 0x10000000557 [2,head] /dc-dir/dc-file_866 auth v5734 s=3 n(v0 rc2023-10-03T19:13:45.107664+0000 b3 1=1+0) (iversion lock) 0x55cf6251c680] 2023-10-03T19:20:52.160 INFO:teuthology.orchestra.run.smithi045.stdout: -6677> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000557 [2,head] #10000000557 auth v5734 s=3 n(v0 rc2023-10-03T19:13:45.107664+0000 b3 1=1+0) (iversion lock) 0x55cf6251c680] 2023-10-03T19:20:52.160 INFO:teuthology.orchestra.run.smithi045.stdout: -6676> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_866 [2,head] auth NULL (dversion lock) v=5734 ino=(nil) state=1073741824 0x55cf62520780] 2023-10-03T19:20:52.160 INFO:teuthology.orchestra.run.smithi045.stdout: -6675> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_865 [2,head] auth (dversion lock) v=5732 ino=0x10000000556 state=1073741824 0x55cf62520500] 2023-10-03T19:20:52.160 INFO:teuthology.orchestra.run.smithi045.stdout: -6674> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.476 INFO:teuthology.orchestra.run.smithi045.stdout: -6673> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000556 [2,head] /dc-dir/dc-file_865 auth v5732 s=3 n(v0 rc2023-10-03T19:13:45.095216+0000 b3 1=1+0) (iversion lock) 0x55cf6251c100] 2023-10-03T19:20:52.476 INFO:teuthology.orchestra.run.smithi045.stdout: -6672> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_865 [2,head] auth (dversion lock) v=5732 ino=0x10000000556 state=1073741824 0x55cf62520500] [inode 0x10000000556 [2,head] /dc-dir/dc-file_865 auth v5732 s=3 n(v0 rc2023-10-03T19:13:45.095216+0000 b3 1=1+0) (iversion lock) 0x55cf6251c100] 2023-10-03T19:20:52.477 INFO:teuthology.orchestra.run.smithi045.stdout: -6671> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000556 [2,head] #10000000556 auth v5732 s=3 n(v0 rc2023-10-03T19:13:45.095216+0000 b3 1=1+0) (iversion lock) 0x55cf6251c100] 2023-10-03T19:20:52.477 INFO:teuthology.orchestra.run.smithi045.stdout: -6670> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_865 [2,head] auth NULL (dversion lock) v=5732 ino=(nil) state=1073741824 0x55cf62520500] 2023-10-03T19:20:52.477 INFO:teuthology.orchestra.run.smithi045.stdout: -6669> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_864 [2,head] auth (dversion lock) v=5730 ino=0x10000000555 state=1073741824 0x55cf62520280] 2023-10-03T19:20:52.477 INFO:teuthology.orchestra.run.smithi045.stdout: -6668> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.477 INFO:teuthology.orchestra.run.smithi045.stdout: -6667> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000555 [2,head] /dc-dir/dc-file_864 auth v5730 s=3 n(v0 rc2023-10-03T19:13:45.083720+0000 b3 1=1+0) (iversion lock) 0x55cf6251bb80] 2023-10-03T19:20:52.477 INFO:teuthology.orchestra.run.smithi045.stdout: -6666> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_864 [2,head] auth (dversion lock) v=5730 ino=0x10000000555 state=1073741824 0x55cf62520280] [inode 0x10000000555 [2,head] /dc-dir/dc-file_864 auth v5730 s=3 n(v0 rc2023-10-03T19:13:45.083720+0000 b3 1=1+0) (iversion lock) 0x55cf6251bb80] 2023-10-03T19:20:52.477 INFO:teuthology.orchestra.run.smithi045.stdout: -6665> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000555 [2,head] #10000000555 auth v5730 s=3 n(v0 rc2023-10-03T19:13:45.083720+0000 b3 1=1+0) (iversion lock) 0x55cf6251bb80] 2023-10-03T19:20:52.477 INFO:teuthology.orchestra.run.smithi045.stdout: -6664> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_864 [2,head] auth NULL (dversion lock) v=5730 ino=(nil) state=1073741824 0x55cf62520280] 2023-10-03T19:20:52.477 INFO:teuthology.orchestra.run.smithi045.stdout: -6663> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_863 [2,head] auth (dversion lock) v=5728 ino=0x10000000554 state=1073741824 0x55cf62520000] 2023-10-03T19:20:52.478 INFO:teuthology.orchestra.run.smithi045.stdout: -6662> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.478 INFO:teuthology.orchestra.run.smithi045.stdout: -6661> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000554 [2,head] /dc-dir/dc-file_863 auth v5728 s=3 n(v0 rc2023-10-03T19:13:45.071903+0000 b3 1=1+0) (iversion lock) 0x55cf6251b600] 2023-10-03T19:20:52.478 INFO:teuthology.orchestra.run.smithi045.stdout: -6660> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_863 [2,head] auth (dversion lock) v=5728 ino=0x10000000554 state=1073741824 0x55cf62520000] [inode 0x10000000554 [2,head] /dc-dir/dc-file_863 auth v5728 s=3 n(v0 rc2023-10-03T19:13:45.071903+0000 b3 1=1+0) (iversion lock) 0x55cf6251b600] 2023-10-03T19:20:52.478 INFO:teuthology.orchestra.run.smithi045.stdout: -6659> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000554 [2,head] #10000000554 auth v5728 s=3 n(v0 rc2023-10-03T19:13:45.071903+0000 b3 1=1+0) (iversion lock) 0x55cf6251b600] 2023-10-03T19:20:52.478 INFO:teuthology.orchestra.run.smithi045.stdout: -6658> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_863 [2,head] auth NULL (dversion lock) v=5728 ino=(nil) state=1073741824 0x55cf62520000] 2023-10-03T19:20:52.478 INFO:teuthology.orchestra.run.smithi045.stdout: -6657> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_862 [2,head] auth (dversion lock) v=5726 ino=0x10000000553 state=1073741824 0x55cf62511b80] 2023-10-03T19:20:52.478 INFO:teuthology.orchestra.run.smithi045.stdout: -6656> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.478 INFO:teuthology.orchestra.run.smithi045.stdout: -6655> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000553 [2,head] /dc-dir/dc-file_862 auth v5726 s=3 n(v0 rc2023-10-03T19:13:45.059565+0000 b3 1=1+0) (iversion lock) 0x55cf6251b080] 2023-10-03T19:20:52.478 INFO:teuthology.orchestra.run.smithi045.stdout: -6654> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_862 [2,head] auth (dversion lock) v=5726 ino=0x10000000553 state=1073741824 0x55cf62511b80] [inode 0x10000000553 [2,head] /dc-dir/dc-file_862 auth v5726 s=3 n(v0 rc2023-10-03T19:13:45.059565+0000 b3 1=1+0) (iversion lock) 0x55cf6251b080] 2023-10-03T19:20:52.479 INFO:teuthology.orchestra.run.smithi045.stdout: -6653> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000553 [2,head] #10000000553 auth v5726 s=3 n(v0 rc2023-10-03T19:13:45.059565+0000 b3 1=1+0) (iversion lock) 0x55cf6251b080] 2023-10-03T19:20:52.479 INFO:teuthology.orchestra.run.smithi045.stdout: -6652> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_862 [2,head] auth NULL (dversion lock) v=5726 ino=(nil) state=1073741824 0x55cf62511b80] 2023-10-03T19:20:52.479 INFO:teuthology.orchestra.run.smithi045.stdout: -6651> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_861 [2,head] auth (dversion lock) v=5724 ino=0x10000000552 state=1073741824 0x55cf62511900] 2023-10-03T19:20:52.479 INFO:teuthology.orchestra.run.smithi045.stdout: -6650> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.479 INFO:teuthology.orchestra.run.smithi045.stdout: -6649> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000552 [2,head] /dc-dir/dc-file_861 auth v5724 s=3 n(v0 rc2023-10-03T19:13:45.048188+0000 b3 1=1+0) (iversion lock) 0x55cf6251ab00] 2023-10-03T19:20:52.479 INFO:teuthology.orchestra.run.smithi045.stdout: -6648> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_861 [2,head] auth (dversion lock) v=5724 ino=0x10000000552 state=1073741824 0x55cf62511900] [inode 0x10000000552 [2,head] /dc-dir/dc-file_861 auth v5724 s=3 n(v0 rc2023-10-03T19:13:45.048188+0000 b3 1=1+0) (iversion lock) 0x55cf6251ab00] 2023-10-03T19:20:52.479 INFO:teuthology.orchestra.run.smithi045.stdout: -6647> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000552 [2,head] #10000000552 auth v5724 s=3 n(v0 rc2023-10-03T19:13:45.048188+0000 b3 1=1+0) (iversion lock) 0x55cf6251ab00] 2023-10-03T19:20:52.479 INFO:teuthology.orchestra.run.smithi045.stdout: -6646> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_861 [2,head] auth NULL (dversion lock) v=5724 ino=(nil) state=1073741824 0x55cf62511900] 2023-10-03T19:20:52.480 INFO:teuthology.orchestra.run.smithi045.stdout: -6645> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_860 [2,head] auth (dversion lock) v=5722 ino=0x10000000551 state=1073741824 0x55cf62511680] 2023-10-03T19:20:52.480 INFO:teuthology.orchestra.run.smithi045.stdout: -6644> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.480 INFO:teuthology.orchestra.run.smithi045.stdout: -6643> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000551 [2,head] /dc-dir/dc-file_860 auth v5722 s=3 n(v0 rc2023-10-03T19:13:45.035544+0000 b3 1=1+0) (iversion lock) 0x55cf6251a580] 2023-10-03T19:20:52.480 INFO:teuthology.orchestra.run.smithi045.stdout: -6642> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_860 [2,head] auth (dversion lock) v=5722 ino=0x10000000551 state=1073741824 0x55cf62511680] [inode 0x10000000551 [2,head] /dc-dir/dc-file_860 auth v5722 s=3 n(v0 rc2023-10-03T19:13:45.035544+0000 b3 1=1+0) (iversion lock) 0x55cf6251a580] 2023-10-03T19:20:52.480 INFO:teuthology.orchestra.run.smithi045.stdout: -6641> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000551 [2,head] #10000000551 auth v5722 s=3 n(v0 rc2023-10-03T19:13:45.035544+0000 b3 1=1+0) (iversion lock) 0x55cf6251a580] 2023-10-03T19:20:52.480 INFO:teuthology.orchestra.run.smithi045.stdout: -6640> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_860 [2,head] auth NULL (dversion lock) v=5722 ino=(nil) state=1073741824 0x55cf62511680] 2023-10-03T19:20:52.480 INFO:teuthology.orchestra.run.smithi045.stdout: -6639> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_859 [2,head] auth (dversion lock) v=5720 ino=0x10000000550 state=1073741824 0x55cf62511400] 2023-10-03T19:20:52.480 INFO:teuthology.orchestra.run.smithi045.stdout: -6638> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.480 INFO:teuthology.orchestra.run.smithi045.stdout: -6637> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000550 [2,head] /dc-dir/dc-file_859 auth v5720 s=3 n(v0 rc2023-10-03T19:13:45.022491+0000 b3 1=1+0) (iversion lock) 0x55cf6251a000] 2023-10-03T19:20:52.480 INFO:teuthology.orchestra.run.smithi045.stdout: -6636> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_859 [2,head] auth (dversion lock) v=5720 ino=0x10000000550 state=1073741824 0x55cf62511400] [inode 0x10000000550 [2,head] /dc-dir/dc-file_859 auth v5720 s=3 n(v0 rc2023-10-03T19:13:45.022491+0000 b3 1=1+0) (iversion lock) 0x55cf6251a000] 2023-10-03T19:20:52.481 INFO:teuthology.orchestra.run.smithi045.stdout: -6635> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000550 [2,head] #10000000550 auth v5720 s=3 n(v0 rc2023-10-03T19:13:45.022491+0000 b3 1=1+0) (iversion lock) 0x55cf6251a000] 2023-10-03T19:20:52.481 INFO:teuthology.orchestra.run.smithi045.stdout: -6634> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_859 [2,head] auth NULL (dversion lock) v=5720 ino=(nil) state=1073741824 0x55cf62511400] 2023-10-03T19:20:52.481 INFO:teuthology.orchestra.run.smithi045.stdout: -6633> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_858 [2,head] auth (dversion lock) v=5718 ino=0x1000000054f state=1073741824 0x55cf62511180] 2023-10-03T19:20:52.481 INFO:teuthology.orchestra.run.smithi045.stdout: -6632> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.481 INFO:teuthology.orchestra.run.smithi045.stdout: -6631> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000054f [2,head] /dc-dir/dc-file_858 auth v5718 s=3 n(v0 rc2023-10-03T19:13:45.011060+0000 b3 1=1+0) (iversion lock) 0x55cf6250f700] 2023-10-03T19:20:52.481 INFO:teuthology.orchestra.run.smithi045.stdout: -6630> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_858 [2,head] auth (dversion lock) v=5718 ino=0x1000000054f state=1073741824 0x55cf62511180] [inode 0x1000000054f [2,head] /dc-dir/dc-file_858 auth v5718 s=3 n(v0 rc2023-10-03T19:13:45.011060+0000 b3 1=1+0) (iversion lock) 0x55cf6250f700] 2023-10-03T19:20:52.481 INFO:teuthology.orchestra.run.smithi045.stdout: -6629> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000054f [2,head] #1000000054f auth v5718 s=3 n(v0 rc2023-10-03T19:13:45.011060+0000 b3 1=1+0) (iversion lock) 0x55cf6250f700] 2023-10-03T19:20:52.481 INFO:teuthology.orchestra.run.smithi045.stdout: -6628> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_858 [2,head] auth NULL (dversion lock) v=5718 ino=(nil) state=1073741824 0x55cf62511180] 2023-10-03T19:20:52.481 INFO:teuthology.orchestra.run.smithi045.stdout: -6627> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_857 [2,head] auth (dversion lock) v=5716 ino=0x1000000054e state=1073741824 0x55cf62510f00] 2023-10-03T19:20:52.481 INFO:teuthology.orchestra.run.smithi045.stdout: -6626> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.482 INFO:teuthology.orchestra.run.smithi045.stdout: -6625> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000054e [2,head] /dc-dir/dc-file_857 auth v5716 s=3 n(v0 rc2023-10-03T19:13:44.999350+0000 b3 1=1+0) (iversion lock) 0x55cf6250f180] 2023-10-03T19:20:52.482 INFO:teuthology.orchestra.run.smithi045.stdout: -6624> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_857 [2,head] auth (dversion lock) v=5716 ino=0x1000000054e state=1073741824 0x55cf62510f00] [inode 0x1000000054e [2,head] /dc-dir/dc-file_857 auth v5716 s=3 n(v0 rc2023-10-03T19:13:44.999350+0000 b3 1=1+0) (iversion lock) 0x55cf6250f180] 2023-10-03T19:20:52.482 INFO:teuthology.orchestra.run.smithi045.stdout: -6623> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000054e [2,head] #1000000054e auth v5716 s=3 n(v0 rc2023-10-03T19:13:44.999350+0000 b3 1=1+0) (iversion lock) 0x55cf6250f180] 2023-10-03T19:20:52.482 INFO:teuthology.orchestra.run.smithi045.stdout: -6622> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_857 [2,head] auth NULL (dversion lock) v=5716 ino=(nil) state=1073741824 0x55cf62510f00] 2023-10-03T19:20:52.482 INFO:teuthology.orchestra.run.smithi045.stdout: -6621> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_856 [2,head] auth (dversion lock) v=5714 ino=0x1000000054d state=1073741824 0x55cf62510c80] 2023-10-03T19:20:52.482 INFO:teuthology.orchestra.run.smithi045.stdout: -6620> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.482 INFO:teuthology.orchestra.run.smithi045.stdout: -6619> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000054d [2,head] /dc-dir/dc-file_856 auth v5714 s=3 n(v0 rc2023-10-03T19:13:44.986571+0000 b3 1=1+0) (iversion lock) 0x55cf6250ec00] 2023-10-03T19:20:52.482 INFO:teuthology.orchestra.run.smithi045.stdout: -6618> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_856 [2,head] auth (dversion lock) v=5714 ino=0x1000000054d state=1073741824 0x55cf62510c80] [inode 0x1000000054d [2,head] /dc-dir/dc-file_856 auth v5714 s=3 n(v0 rc2023-10-03T19:13:44.986571+0000 b3 1=1+0) (iversion lock) 0x55cf6250ec00] 2023-10-03T19:20:52.482 INFO:teuthology.orchestra.run.smithi045.stdout: -6617> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000054d [2,head] #1000000054d auth v5714 s=3 n(v0 rc2023-10-03T19:13:44.986571+0000 b3 1=1+0) (iversion lock) 0x55cf6250ec00] 2023-10-03T19:20:52.483 INFO:teuthology.orchestra.run.smithi045.stdout: -6616> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_856 [2,head] auth NULL (dversion lock) v=5714 ino=(nil) state=1073741824 0x55cf62510c80] 2023-10-03T19:20:52.483 INFO:teuthology.orchestra.run.smithi045.stdout: -6615> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_855 [2,head] auth (dversion lock) v=5712 ino=0x1000000054c state=1073741824 0x55cf62510a00] 2023-10-03T19:20:52.483 INFO:teuthology.orchestra.run.smithi045.stdout: -6614> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.483 INFO:teuthology.orchestra.run.smithi045.stdout: -6613> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000054c [2,head] /dc-dir/dc-file_855 auth v5712 s=3 n(v0 rc2023-10-03T19:13:44.975357+0000 b3 1=1+0) (iversion lock) 0x55cf6250e680] 2023-10-03T19:20:52.483 INFO:teuthology.orchestra.run.smithi045.stdout: -6612> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_855 [2,head] auth (dversion lock) v=5712 ino=0x1000000054c state=1073741824 0x55cf62510a00] [inode 0x1000000054c [2,head] /dc-dir/dc-file_855 auth v5712 s=3 n(v0 rc2023-10-03T19:13:44.975357+0000 b3 1=1+0) (iversion lock) 0x55cf6250e680] 2023-10-03T19:20:52.483 INFO:teuthology.orchestra.run.smithi045.stdout: -6611> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000054c [2,head] #1000000054c auth v5712 s=3 n(v0 rc2023-10-03T19:13:44.975357+0000 b3 1=1+0) (iversion lock) 0x55cf6250e680] 2023-10-03T19:20:52.483 INFO:teuthology.orchestra.run.smithi045.stdout: -6610> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_855 [2,head] auth NULL (dversion lock) v=5712 ino=(nil) state=1073741824 0x55cf62510a00] 2023-10-03T19:20:52.483 INFO:teuthology.orchestra.run.smithi045.stdout: -6609> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_854 [2,head] auth (dversion lock) v=5710 ino=0x1000000054b state=1073741824 0x55cf62510780] 2023-10-03T19:20:52.483 INFO:teuthology.orchestra.run.smithi045.stdout: -6608> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.483 INFO:teuthology.orchestra.run.smithi045.stdout: -6607> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000054b [2,head] /dc-dir/dc-file_854 auth v5710 s=3 n(v0 rc2023-10-03T19:13:44.964002+0000 b3 1=1+0) (iversion lock) 0x55cf6250e100] 2023-10-03T19:20:52.483 INFO:teuthology.orchestra.run.smithi045.stdout: -6606> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_854 [2,head] auth (dversion lock) v=5710 ino=0x1000000054b state=1073741824 0x55cf62510780] [inode 0x1000000054b [2,head] /dc-dir/dc-file_854 auth v5710 s=3 n(v0 rc2023-10-03T19:13:44.964002+0000 b3 1=1+0) (iversion lock) 0x55cf6250e100] 2023-10-03T19:20:52.484 INFO:teuthology.orchestra.run.smithi045.stdout: -6605> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000054b [2,head] #1000000054b auth v5710 s=3 n(v0 rc2023-10-03T19:13:44.964002+0000 b3 1=1+0) (iversion lock) 0x55cf6250e100] 2023-10-03T19:20:52.484 INFO:teuthology.orchestra.run.smithi045.stdout: -6604> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_854 [2,head] auth NULL (dversion lock) v=5710 ino=(nil) state=1073741824 0x55cf62510780] 2023-10-03T19:20:52.484 INFO:teuthology.orchestra.run.smithi045.stdout: -6603> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_853 [2,head] auth (dversion lock) v=5708 ino=0x1000000054a state=1073741824 0x55cf62510500] 2023-10-03T19:20:52.484 INFO:teuthology.orchestra.run.smithi045.stdout: -6602> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.484 INFO:teuthology.orchestra.run.smithi045.stdout: -6601> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000054a [2,head] /dc-dir/dc-file_853 auth v5708 s=3 n(v0 rc2023-10-03T19:13:44.952360+0000 b3 1=1+0) (iversion lock) 0x55cf6250db80] 2023-10-03T19:20:52.484 INFO:teuthology.orchestra.run.smithi045.stdout: -6600> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_853 [2,head] auth (dversion lock) v=5708 ino=0x1000000054a state=1073741824 0x55cf62510500] [inode 0x1000000054a [2,head] /dc-dir/dc-file_853 auth v5708 s=3 n(v0 rc2023-10-03T19:13:44.952360+0000 b3 1=1+0) (iversion lock) 0x55cf6250db80] 2023-10-03T19:20:52.484 INFO:teuthology.orchestra.run.smithi045.stdout: -6599> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000054a [2,head] #1000000054a auth v5708 s=3 n(v0 rc2023-10-03T19:13:44.952360+0000 b3 1=1+0) (iversion lock) 0x55cf6250db80] 2023-10-03T19:20:52.484 INFO:teuthology.orchestra.run.smithi045.stdout: -6598> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_853 [2,head] auth NULL (dversion lock) v=5708 ino=(nil) state=1073741824 0x55cf62510500] 2023-10-03T19:20:52.484 INFO:teuthology.orchestra.run.smithi045.stdout: -6597> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_852 [2,head] auth (dversion lock) v=5706 ino=0x10000000549 state=1073741824 0x55cf62510280] 2023-10-03T19:20:52.484 INFO:teuthology.orchestra.run.smithi045.stdout: -6596> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.484 INFO:teuthology.orchestra.run.smithi045.stdout: -6595> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000549 [2,head] /dc-dir/dc-file_852 auth v5706 s=3 n(v0 rc2023-10-03T19:13:44.941567+0000 b3 1=1+0) (iversion lock) 0x55cf6250d600] 2023-10-03T19:20:52.485 INFO:teuthology.orchestra.run.smithi045.stdout: -6594> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_852 [2,head] auth (dversion lock) v=5706 ino=0x10000000549 state=1073741824 0x55cf62510280] [inode 0x10000000549 [2,head] /dc-dir/dc-file_852 auth v5706 s=3 n(v0 rc2023-10-03T19:13:44.941567+0000 b3 1=1+0) (iversion lock) 0x55cf6250d600] 2023-10-03T19:20:52.485 INFO:teuthology.orchestra.run.smithi045.stdout: -6593> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000549 [2,head] #10000000549 auth v5706 s=3 n(v0 rc2023-10-03T19:13:44.941567+0000 b3 1=1+0) (iversion lock) 0x55cf6250d600] 2023-10-03T19:20:52.485 INFO:teuthology.orchestra.run.smithi045.stdout: -6592> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_852 [2,head] auth NULL (dversion lock) v=5706 ino=(nil) state=1073741824 0x55cf62510280] 2023-10-03T19:20:52.485 INFO:teuthology.orchestra.run.smithi045.stdout: -6591> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_851 [2,head] auth (dversion lock) v=5704 ino=0x10000000548 state=1073741824 0x55cf62510000] 2023-10-03T19:20:52.485 INFO:teuthology.orchestra.run.smithi045.stdout: -6590> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.485 INFO:teuthology.orchestra.run.smithi045.stdout: -6589> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000548 [2,head] /dc-dir/dc-file_851 auth v5704 s=3 n(v0 rc2023-10-03T19:13:44.927756+0000 b3 1=1+0) (iversion lock) 0x55cf6250d080] 2023-10-03T19:20:52.485 INFO:teuthology.orchestra.run.smithi045.stdout: -6588> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_851 [2,head] auth (dversion lock) v=5704 ino=0x10000000548 state=1073741824 0x55cf62510000] [inode 0x10000000548 [2,head] /dc-dir/dc-file_851 auth v5704 s=3 n(v0 rc2023-10-03T19:13:44.927756+0000 b3 1=1+0) (iversion lock) 0x55cf6250d080] 2023-10-03T19:20:52.485 INFO:teuthology.orchestra.run.smithi045.stdout: -6587> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000548 [2,head] #10000000548 auth v5704 s=3 n(v0 rc2023-10-03T19:13:44.927756+0000 b3 1=1+0) (iversion lock) 0x55cf6250d080] 2023-10-03T19:20:52.485 INFO:teuthology.orchestra.run.smithi045.stdout: -6586> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_851 [2,head] auth NULL (dversion lock) v=5704 ino=(nil) state=1073741824 0x55cf62510000] 2023-10-03T19:20:52.486 INFO:teuthology.orchestra.run.smithi045.stdout: -6585> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_826 [2,head] auth (dversion lock) v=5654 ino=0x1000000052f state=1073741824 0x55cf624dfb80] 2023-10-03T19:20:52.486 INFO:teuthology.orchestra.run.smithi045.stdout: -6584> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.486 INFO:teuthology.orchestra.run.smithi045.stdout: -6583> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000052f [2,head] /dc-dir/dc-file_826 auth v5654 s=3 n(v0 rc2023-10-03T19:13:44.503823+0000 b3 1=1+0) (iversion lock) 0x55cf6225c000] 2023-10-03T19:20:52.486 INFO:teuthology.orchestra.run.smithi045.stdout: -6582> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_826 [2,head] auth (dversion lock) v=5654 ino=0x1000000052f state=1073741824 0x55cf624dfb80] [inode 0x1000000052f [2,head] /dc-dir/dc-file_826 auth v5654 s=3 n(v0 rc2023-10-03T19:13:44.503823+0000 b3 1=1+0) (iversion lock) 0x55cf6225c000] 2023-10-03T19:20:52.486 INFO:teuthology.orchestra.run.smithi045.stdout: -6581> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000052f [2,head] #1000000052f auth v5654 s=3 n(v0 rc2023-10-03T19:13:44.503823+0000 b3 1=1+0) (iversion lock) 0x55cf6225c000] 2023-10-03T19:20:52.486 INFO:teuthology.orchestra.run.smithi045.stdout: -6580> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_826 [2,head] auth NULL (dversion lock) v=5654 ino=(nil) state=1073741824 0x55cf624dfb80] 2023-10-03T19:20:52.486 INFO:teuthology.orchestra.run.smithi045.stdout: -6579> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_825 [2,head] auth (dversion lock) v=5652 ino=0x1000000052e state=1073741824 0x55cf624df900] 2023-10-03T19:20:52.486 INFO:teuthology.orchestra.run.smithi045.stdout: -6578> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.486 INFO:teuthology.orchestra.run.smithi045.stdout: -6577> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000052e [2,head] /dc-dir/dc-file_825 auth v5652 s=3 n(v0 rc2023-10-03T19:13:44.492072+0000 b3 1=1+0) (iversion lock) 0x55cf624e3700] 2023-10-03T19:20:52.486 INFO:teuthology.orchestra.run.smithi045.stdout: -6576> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_825 [2,head] auth (dversion lock) v=5652 ino=0x1000000052e state=1073741824 0x55cf624df900] [inode 0x1000000052e [2,head] /dc-dir/dc-file_825 auth v5652 s=3 n(v0 rc2023-10-03T19:13:44.492072+0000 b3 1=1+0) (iversion lock) 0x55cf624e3700] 2023-10-03T19:20:52.486 INFO:teuthology.orchestra.run.smithi045.stdout: -6575> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000052e [2,head] #1000000052e auth v5652 s=3 n(v0 rc2023-10-03T19:13:44.492072+0000 b3 1=1+0) (iversion lock) 0x55cf624e3700] 2023-10-03T19:20:52.487 INFO:teuthology.orchestra.run.smithi045.stdout: -6574> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_825 [2,head] auth NULL (dversion lock) v=5652 ino=(nil) state=1073741824 0x55cf624df900] 2023-10-03T19:20:52.487 INFO:teuthology.orchestra.run.smithi045.stdout: -6573> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_824 [2,head] auth (dversion lock) v=5650 ino=0x1000000052d state=1073741824 0x55cf624df680] 2023-10-03T19:20:52.487 INFO:teuthology.orchestra.run.smithi045.stdout: -6572> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.487 INFO:teuthology.orchestra.run.smithi045.stdout: -6571> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000052d [2,head] /dc-dir/dc-file_824 auth v5650 s=3 n(v0 rc2023-10-03T19:13:44.479482+0000 b3 1=1+0) (iversion lock) 0x55cf624e3180] 2023-10-03T19:20:52.487 INFO:teuthology.orchestra.run.smithi045.stdout: -6570> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_824 [2,head] auth (dversion lock) v=5650 ino=0x1000000052d state=1073741824 0x55cf624df680] [inode 0x1000000052d [2,head] /dc-dir/dc-file_824 auth v5650 s=3 n(v0 rc2023-10-03T19:13:44.479482+0000 b3 1=1+0) (iversion lock) 0x55cf624e3180] 2023-10-03T19:20:52.487 INFO:teuthology.orchestra.run.smithi045.stdout: -6569> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000052d [2,head] #1000000052d auth v5650 s=3 n(v0 rc2023-10-03T19:13:44.479482+0000 b3 1=1+0) (iversion lock) 0x55cf624e3180] 2023-10-03T19:20:52.487 INFO:teuthology.orchestra.run.smithi045.stdout: -6568> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_824 [2,head] auth NULL (dversion lock) v=5650 ino=(nil) state=1073741824 0x55cf624df680] 2023-10-03T19:20:52.487 INFO:teuthology.orchestra.run.smithi045.stdout: -6567> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_823 [2,head] auth (dversion lock) v=5648 ino=0x1000000052c state=1073741824 0x55cf624df400] 2023-10-03T19:20:52.636 INFO:teuthology.orchestra.run.smithi045.stdout: -6566> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.636 INFO:teuthology.orchestra.run.smithi045.stdout: -6565> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000052c [2,head] /dc-dir/dc-file_823 auth v5648 s=3 n(v0 rc2023-10-03T19:13:44.467474+0000 b3 1=1+0) (iversion lock) 0x55cf624e2c00] 2023-10-03T19:20:52.636 INFO:teuthology.orchestra.run.smithi045.stdout: -6564> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_823 [2,head] auth (dversion lock) v=5648 ino=0x1000000052c state=1073741824 0x55cf624df400] [inode 0x1000000052c [2,head] /dc-dir/dc-file_823 auth v5648 s=3 n(v0 rc2023-10-03T19:13:44.467474+0000 b3 1=1+0) (iversion lock) 0x55cf624e2c00] 2023-10-03T19:20:52.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6563> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000052c [2,head] #1000000052c auth v5648 s=3 n(v0 rc2023-10-03T19:13:44.467474+0000 b3 1=1+0) (iversion lock) 0x55cf624e2c00] 2023-10-03T19:20:52.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6562> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_823 [2,head] auth NULL (dversion lock) v=5648 ino=(nil) state=1073741824 0x55cf624df400] 2023-10-03T19:20:52.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6561> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_822 [2,head] auth (dversion lock) v=5646 ino=0x1000000052b state=1073741824 0x55cf624df180] 2023-10-03T19:20:52.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6560> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6559> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000052b [2,head] /dc-dir/dc-file_822 auth v5646 s=3 n(v0 rc2023-10-03T19:13:44.455804+0000 b3 1=1+0) (iversion lock) 0x55cf624e2680] 2023-10-03T19:20:52.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6558> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_822 [2,head] auth (dversion lock) v=5646 ino=0x1000000052b state=1073741824 0x55cf624df180] [inode 0x1000000052b [2,head] /dc-dir/dc-file_822 auth v5646 s=3 n(v0 rc2023-10-03T19:13:44.455804+0000 b3 1=1+0) (iversion lock) 0x55cf624e2680] 2023-10-03T19:20:52.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6557> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000052b [2,head] #1000000052b auth v5646 s=3 n(v0 rc2023-10-03T19:13:44.455804+0000 b3 1=1+0) (iversion lock) 0x55cf624e2680] 2023-10-03T19:20:52.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6556> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_822 [2,head] auth NULL (dversion lock) v=5646 ino=(nil) state=1073741824 0x55cf624df180] 2023-10-03T19:20:52.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6555> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_821 [2,head] auth (dversion lock) v=5644 ino=0x1000000052a state=1073741824 0x55cf624def00] 2023-10-03T19:20:52.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6554> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6553> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000052a [2,head] /dc-dir/dc-file_821 auth v5644 s=3 n(v0 rc2023-10-03T19:13:44.444473+0000 b3 1=1+0) (iversion lock) 0x55cf624e2100] 2023-10-03T19:20:52.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6552> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_821 [2,head] auth (dversion lock) v=5644 ino=0x1000000052a state=1073741824 0x55cf624def00] [inode 0x1000000052a [2,head] /dc-dir/dc-file_821 auth v5644 s=3 n(v0 rc2023-10-03T19:13:44.444473+0000 b3 1=1+0) (iversion lock) 0x55cf624e2100] 2023-10-03T19:20:52.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6551> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000052a [2,head] #1000000052a auth v5644 s=3 n(v0 rc2023-10-03T19:13:44.444473+0000 b3 1=1+0) (iversion lock) 0x55cf624e2100] 2023-10-03T19:20:52.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6550> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_821 [2,head] auth NULL (dversion lock) v=5644 ino=(nil) state=1073741824 0x55cf624def00] 2023-10-03T19:20:52.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6549> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_820 [2,head] auth (dversion lock) v=5642 ino=0x10000000529 state=1073741824 0x55cf624dec80] 2023-10-03T19:20:52.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6548> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6547> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000529 [2,head] /dc-dir/dc-file_820 auth v5642 s=3 n(v0 rc2023-10-03T19:13:44.432893+0000 b3 1=1+0) (iversion lock) 0x55cf624e1b80] 2023-10-03T19:20:52.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6546> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_820 [2,head] auth (dversion lock) v=5642 ino=0x10000000529 state=1073741824 0x55cf624dec80] [inode 0x10000000529 [2,head] /dc-dir/dc-file_820 auth v5642 s=3 n(v0 rc2023-10-03T19:13:44.432893+0000 b3 1=1+0) (iversion lock) 0x55cf624e1b80] 2023-10-03T19:20:52.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6545> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000529 [2,head] #10000000529 auth v5642 s=3 n(v0 rc2023-10-03T19:13:44.432893+0000 b3 1=1+0) (iversion lock) 0x55cf624e1b80] 2023-10-03T19:20:52.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6544> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_820 [2,head] auth NULL (dversion lock) v=5642 ino=(nil) state=1073741824 0x55cf624dec80] 2023-10-03T19:20:52.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6543> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_819 [2,head] auth (dversion lock) v=5640 ino=0x10000000528 state=1073741824 0x55cf624dea00] 2023-10-03T19:20:52.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6542> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6541> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000528 [2,head] /dc-dir/dc-file_819 auth v5640 s=3 n(v0 rc2023-10-03T19:13:44.421064+0000 b3 1=1+0) (iversion lock) 0x55cf624e1600] 2023-10-03T19:20:52.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6540> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_819 [2,head] auth (dversion lock) v=5640 ino=0x10000000528 state=1073741824 0x55cf624dea00] [inode 0x10000000528 [2,head] /dc-dir/dc-file_819 auth v5640 s=3 n(v0 rc2023-10-03T19:13:44.421064+0000 b3 1=1+0) (iversion lock) 0x55cf624e1600] 2023-10-03T19:20:52.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6539> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000528 [2,head] #10000000528 auth v5640 s=3 n(v0 rc2023-10-03T19:13:44.421064+0000 b3 1=1+0) (iversion lock) 0x55cf624e1600] 2023-10-03T19:20:52.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6538> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_819 [2,head] auth NULL (dversion lock) v=5640 ino=(nil) state=1073741824 0x55cf624dea00] 2023-10-03T19:20:52.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6537> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_818 [2,head] auth (dversion lock) v=5638 ino=0x10000000527 state=1073741824 0x55cf624de780] 2023-10-03T19:20:52.640 INFO:teuthology.orchestra.run.smithi045.stdout: -6536> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.640 INFO:teuthology.orchestra.run.smithi045.stdout: -6535> 2023-10-03T19:15:17.711+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000527 [2,head] /dc-dir/dc-file_818 auth v5638 s=3 n(v0 rc2023-10-03T19:13:44.408956+0000 b3 1=1+0) (iversion lock) 0x55cf624e1080] 2023-10-03T19:20:52.640 INFO:teuthology.orchestra.run.smithi045.stdout: -6534> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_818 [2,head] auth (dversion lock) v=5638 ino=0x10000000527 state=1073741824 0x55cf624de780] [inode 0x10000000527 [2,head] /dc-dir/dc-file_818 auth v5638 s=3 n(v0 rc2023-10-03T19:13:44.408956+0000 b3 1=1+0) (iversion lock) 0x55cf624e1080] 2023-10-03T19:20:52.640 INFO:teuthology.orchestra.run.smithi045.stdout: -6533> 2023-10-03T19:15:17.711+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000527 [2,head] #10000000527 auth v5638 s=3 n(v0 rc2023-10-03T19:13:44.408956+0000 b3 1=1+0) (iversion lock) 0x55cf624e1080] 2023-10-03T19:20:52.640 INFO:teuthology.orchestra.run.smithi045.stdout: -6532> 2023-10-03T19:15:17.711+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_818 [2,head] auth NULL (dversion lock) v=5638 ino=(nil) state=1073741824 0x55cf624de780] 2023-10-03T19:20:52.640 INFO:teuthology.orchestra.run.smithi045.stdout: -6531> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_817 [2,head] auth (dversion lock) v=5636 ino=0x10000000526 state=1073741824 0x55cf624de500] 2023-10-03T19:20:52.640 INFO:teuthology.orchestra.run.smithi045.stdout: -6530> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.640 INFO:teuthology.orchestra.run.smithi045.stdout: -6529> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000526 [2,head] /dc-dir/dc-file_817 auth v5636 s=3 n(v0 rc2023-10-03T19:13:44.396723+0000 b3 1=1+0) (iversion lock) 0x55cf624e0b00] 2023-10-03T19:20:52.640 INFO:teuthology.orchestra.run.smithi045.stdout: -6528> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_817 [2,head] auth (dversion lock) v=5636 ino=0x10000000526 state=1073741824 0x55cf624de500] [inode 0x10000000526 [2,head] /dc-dir/dc-file_817 auth v5636 s=3 n(v0 rc2023-10-03T19:13:44.396723+0000 b3 1=1+0) (iversion lock) 0x55cf624e0b00] 2023-10-03T19:20:52.640 INFO:teuthology.orchestra.run.smithi045.stdout: -6527> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000526 [2,head] #10000000526 auth v5636 s=3 n(v0 rc2023-10-03T19:13:44.396723+0000 b3 1=1+0) (iversion lock) 0x55cf624e0b00] 2023-10-03T19:20:52.641 INFO:teuthology.orchestra.run.smithi045.stdout: -6526> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_817 [2,head] auth NULL (dversion lock) v=5636 ino=(nil) state=1073741824 0x55cf624de500] 2023-10-03T19:20:52.641 INFO:teuthology.orchestra.run.smithi045.stdout: -6525> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_816 [2,head] auth (dversion lock) v=5634 ino=0x10000000525 state=1073741824 0x55cf624de280] 2023-10-03T19:20:52.641 INFO:teuthology.orchestra.run.smithi045.stdout: -6524> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.641 INFO:teuthology.orchestra.run.smithi045.stdout: -6523> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000525 [2,head] /dc-dir/dc-file_816 auth v5634 s=3 n(v0 rc2023-10-03T19:13:44.385253+0000 b3 1=1+0) (iversion lock) 0x55cf624e0580] 2023-10-03T19:20:52.641 INFO:teuthology.orchestra.run.smithi045.stdout: -6522> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_816 [2,head] auth (dversion lock) v=5634 ino=0x10000000525 state=1073741824 0x55cf624de280] [inode 0x10000000525 [2,head] /dc-dir/dc-file_816 auth v5634 s=3 n(v0 rc2023-10-03T19:13:44.385253+0000 b3 1=1+0) (iversion lock) 0x55cf624e0580] 2023-10-03T19:20:52.641 INFO:teuthology.orchestra.run.smithi045.stdout: -6521> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000525 [2,head] #10000000525 auth v5634 s=3 n(v0 rc2023-10-03T19:13:44.385253+0000 b3 1=1+0) (iversion lock) 0x55cf624e0580] 2023-10-03T19:20:52.641 INFO:teuthology.orchestra.run.smithi045.stdout: -6520> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_816 [2,head] auth NULL (dversion lock) v=5634 ino=(nil) state=1073741824 0x55cf624de280] 2023-10-03T19:20:52.641 INFO:teuthology.orchestra.run.smithi045.stdout: -6519> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_815 [2,head] auth (dversion lock) v=5632 ino=0x10000000524 state=1073741824 0x55cf624de000] 2023-10-03T19:20:52.641 INFO:teuthology.orchestra.run.smithi045.stdout: -6518> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.642 INFO:teuthology.orchestra.run.smithi045.stdout: -6517> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000524 [2,head] /dc-dir/dc-file_815 auth v5632 s=3 n(v0 rc2023-10-03T19:13:44.372895+0000 b3 1=1+0) (iversion lock) 0x55cf624e0000] 2023-10-03T19:20:52.642 INFO:teuthology.orchestra.run.smithi045.stdout: -6516> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_815 [2,head] auth (dversion lock) v=5632 ino=0x10000000524 state=1073741824 0x55cf624de000] [inode 0x10000000524 [2,head] /dc-dir/dc-file_815 auth v5632 s=3 n(v0 rc2023-10-03T19:13:44.372895+0000 b3 1=1+0) (iversion lock) 0x55cf624e0000] 2023-10-03T19:20:52.642 INFO:teuthology.orchestra.run.smithi045.stdout: -6515> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000524 [2,head] #10000000524 auth v5632 s=3 n(v0 rc2023-10-03T19:13:44.372895+0000 b3 1=1+0) (iversion lock) 0x55cf624e0000] 2023-10-03T19:20:52.642 INFO:teuthology.orchestra.run.smithi045.stdout: -6514> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_815 [2,head] auth NULL (dversion lock) v=5632 ino=(nil) state=1073741824 0x55cf624de000] 2023-10-03T19:20:52.642 INFO:teuthology.orchestra.run.smithi045.stdout: -6513> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_814 [2,head] auth (dversion lock) v=5630 ino=0x10000000523 state=1073741824 0x55cf624d3b80] 2023-10-03T19:20:52.642 INFO:teuthology.orchestra.run.smithi045.stdout: -6512> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.642 INFO:teuthology.orchestra.run.smithi045.stdout: -6511> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000523 [2,head] /dc-dir/dc-file_814 auth v5630 s=3 n(v0 rc2023-10-03T19:13:44.361557+0000 b3 1=1+0) (iversion lock) 0x55cf624d9700] 2023-10-03T19:20:52.642 INFO:teuthology.orchestra.run.smithi045.stdout: -6510> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_814 [2,head] auth (dversion lock) v=5630 ino=0x10000000523 state=1073741824 0x55cf624d3b80] [inode 0x10000000523 [2,head] /dc-dir/dc-file_814 auth v5630 s=3 n(v0 rc2023-10-03T19:13:44.361557+0000 b3 1=1+0) (iversion lock) 0x55cf624d9700] 2023-10-03T19:20:52.642 INFO:teuthology.orchestra.run.smithi045.stdout: -6509> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000523 [2,head] #10000000523 auth v5630 s=3 n(v0 rc2023-10-03T19:13:44.361557+0000 b3 1=1+0) (iversion lock) 0x55cf624d9700] 2023-10-03T19:20:52.642 INFO:teuthology.orchestra.run.smithi045.stdout: -6508> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_814 [2,head] auth NULL (dversion lock) v=5630 ino=(nil) state=1073741824 0x55cf624d3b80] 2023-10-03T19:20:52.643 INFO:teuthology.orchestra.run.smithi045.stdout: -6507> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_813 [2,head] auth (dversion lock) v=5628 ino=0x10000000522 state=1073741824 0x55cf624d3900] 2023-10-03T19:20:52.643 INFO:teuthology.orchestra.run.smithi045.stdout: -6506> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.643 INFO:teuthology.orchestra.run.smithi045.stdout: -6505> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000522 [2,head] /dc-dir/dc-file_813 auth v5628 s=3 n(v0 rc2023-10-03T19:13:44.349710+0000 b3 1=1+0) (iversion lock) 0x55cf624d9180] 2023-10-03T19:20:52.643 INFO:teuthology.orchestra.run.smithi045.stdout: -6504> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_813 [2,head] auth (dversion lock) v=5628 ino=0x10000000522 state=1073741824 0x55cf624d3900] [inode 0x10000000522 [2,head] /dc-dir/dc-file_813 auth v5628 s=3 n(v0 rc2023-10-03T19:13:44.349710+0000 b3 1=1+0) (iversion lock) 0x55cf624d9180] 2023-10-03T19:20:52.643 INFO:teuthology.orchestra.run.smithi045.stdout: -6503> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000522 [2,head] #10000000522 auth v5628 s=3 n(v0 rc2023-10-03T19:13:44.349710+0000 b3 1=1+0) (iversion lock) 0x55cf624d9180] 2023-10-03T19:20:52.643 INFO:teuthology.orchestra.run.smithi045.stdout: -6502> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_813 [2,head] auth NULL (dversion lock) v=5628 ino=(nil) state=1073741824 0x55cf624d3900] 2023-10-03T19:20:52.643 INFO:teuthology.orchestra.run.smithi045.stdout: -6501> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_812 [2,head] auth (dversion lock) v=5626 ino=0x10000000521 state=1073741824 0x55cf624d3680] 2023-10-03T19:20:52.643 INFO:teuthology.orchestra.run.smithi045.stdout: -6500> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.643 INFO:teuthology.orchestra.run.smithi045.stdout: -6499> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000521 [2,head] /dc-dir/dc-file_812 auth v5626 s=3 n(v0 rc2023-10-03T19:13:44.337848+0000 b3 1=1+0) (iversion lock) 0x55cf624d8c00] 2023-10-03T19:20:52.643 INFO:teuthology.orchestra.run.smithi045.stdout: -6498> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_812 [2,head] auth (dversion lock) v=5626 ino=0x10000000521 state=1073741824 0x55cf624d3680] [inode 0x10000000521 [2,head] /dc-dir/dc-file_812 auth v5626 s=3 n(v0 rc2023-10-03T19:13:44.337848+0000 b3 1=1+0) (iversion lock) 0x55cf624d8c00] 2023-10-03T19:20:52.643 INFO:teuthology.orchestra.run.smithi045.stdout: -6497> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000521 [2,head] #10000000521 auth v5626 s=3 n(v0 rc2023-10-03T19:13:44.337848+0000 b3 1=1+0) (iversion lock) 0x55cf624d8c00] 2023-10-03T19:20:52.644 INFO:teuthology.orchestra.run.smithi045.stdout: -6496> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_812 [2,head] auth NULL (dversion lock) v=5626 ino=(nil) state=1073741824 0x55cf624d3680] 2023-10-03T19:20:52.644 INFO:teuthology.orchestra.run.smithi045.stdout: -6495> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_811 [2,head] auth (dversion lock) v=5624 ino=0x10000000520 state=1073741824 0x55cf624d3400] 2023-10-03T19:20:52.644 INFO:teuthology.orchestra.run.smithi045.stdout: -6494> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.644 INFO:teuthology.orchestra.run.smithi045.stdout: -6493> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000520 [2,head] /dc-dir/dc-file_811 auth v5624 s=3 n(v0 rc2023-10-03T19:13:44.325607+0000 b3 1=1+0) (iversion lock) 0x55cf624d8680] 2023-10-03T19:20:52.644 INFO:teuthology.orchestra.run.smithi045.stdout: -6492> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_811 [2,head] auth (dversion lock) v=5624 ino=0x10000000520 state=1073741824 0x55cf624d3400] [inode 0x10000000520 [2,head] /dc-dir/dc-file_811 auth v5624 s=3 n(v0 rc2023-10-03T19:13:44.325607+0000 b3 1=1+0) (iversion lock) 0x55cf624d8680] 2023-10-03T19:20:52.644 INFO:teuthology.orchestra.run.smithi045.stdout: -6491> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000520 [2,head] #10000000520 auth v5624 s=3 n(v0 rc2023-10-03T19:13:44.325607+0000 b3 1=1+0) (iversion lock) 0x55cf624d8680] 2023-10-03T19:20:52.644 INFO:teuthology.orchestra.run.smithi045.stdout: -6490> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_811 [2,head] auth NULL (dversion lock) v=5624 ino=(nil) state=1073741824 0x55cf624d3400] 2023-10-03T19:20:52.644 INFO:teuthology.orchestra.run.smithi045.stdout: -6489> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_810 [2,head] auth (dversion lock) v=5622 ino=0x1000000051f state=1073741824 0x55cf624d3180] 2023-10-03T19:20:52.644 INFO:teuthology.orchestra.run.smithi045.stdout: -6488> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.644 INFO:teuthology.orchestra.run.smithi045.stdout: -6487> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000051f [2,head] /dc-dir/dc-file_810 auth v5622 s=3 n(v0 rc2023-10-03T19:13:44.313584+0000 b3 1=1+0) (iversion lock) 0x55cf624d8100] 2023-10-03T19:20:52.645 INFO:teuthology.orchestra.run.smithi045.stdout: -6486> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_810 [2,head] auth (dversion lock) v=5622 ino=0x1000000051f state=1073741824 0x55cf624d3180] [inode 0x1000000051f [2,head] /dc-dir/dc-file_810 auth v5622 s=3 n(v0 rc2023-10-03T19:13:44.313584+0000 b3 1=1+0) (iversion lock) 0x55cf624d8100] 2023-10-03T19:20:52.645 INFO:teuthology.orchestra.run.smithi045.stdout: -6485> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000051f [2,head] #1000000051f auth v5622 s=3 n(v0 rc2023-10-03T19:13:44.313584+0000 b3 1=1+0) (iversion lock) 0x55cf624d8100] 2023-10-03T19:20:52.645 INFO:teuthology.orchestra.run.smithi045.stdout: -6484> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_810 [2,head] auth NULL (dversion lock) v=5622 ino=(nil) state=1073741824 0x55cf624d3180] 2023-10-03T19:20:52.645 INFO:teuthology.orchestra.run.smithi045.stdout: -6483> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_809 [2,head] auth (dversion lock) v=5620 ino=0x1000000051e state=1073741824 0x55cf624d2f00] 2023-10-03T19:20:52.645 INFO:teuthology.orchestra.run.smithi045.stdout: -6482> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.645 INFO:teuthology.orchestra.run.smithi045.stdout: -6481> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000051e [2,head] /dc-dir/dc-file_809 auth v5620 s=3 n(v0 rc2023-10-03T19:13:44.300711+0000 b3 1=1+0) (iversion lock) 0x55cf624d7b80] 2023-10-03T19:20:52.645 INFO:teuthology.orchestra.run.smithi045.stdout: -6480> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_809 [2,head] auth (dversion lock) v=5620 ino=0x1000000051e state=1073741824 0x55cf624d2f00] [inode 0x1000000051e [2,head] /dc-dir/dc-file_809 auth v5620 s=3 n(v0 rc2023-10-03T19:13:44.300711+0000 b3 1=1+0) (iversion lock) 0x55cf624d7b80] 2023-10-03T19:20:52.645 INFO:teuthology.orchestra.run.smithi045.stdout: -6479> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000051e [2,head] #1000000051e auth v5620 s=3 n(v0 rc2023-10-03T19:13:44.300711+0000 b3 1=1+0) (iversion lock) 0x55cf624d7b80] 2023-10-03T19:20:52.645 INFO:teuthology.orchestra.run.smithi045.stdout: -6478> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_809 [2,head] auth NULL (dversion lock) v=5620 ino=(nil) state=1073741824 0x55cf624d2f00] 2023-10-03T19:20:52.646 INFO:teuthology.orchestra.run.smithi045.stdout: -6477> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_808 [2,head] auth (dversion lock) v=5618 ino=0x1000000051d state=1073741824 0x55cf624d2c80] 2023-10-03T19:20:52.646 INFO:teuthology.orchestra.run.smithi045.stdout: -6476> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.646 INFO:teuthology.orchestra.run.smithi045.stdout: -6475> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000051d [2,head] /dc-dir/dc-file_808 auth v5618 s=3 n(v0 rc2023-10-03T19:13:44.287313+0000 b3 1=1+0) (iversion lock) 0x55cf624d7600] 2023-10-03T19:20:52.646 INFO:teuthology.orchestra.run.smithi045.stdout: -6474> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_808 [2,head] auth (dversion lock) v=5618 ino=0x1000000051d state=1073741824 0x55cf624d2c80] [inode 0x1000000051d [2,head] /dc-dir/dc-file_808 auth v5618 s=3 n(v0 rc2023-10-03T19:13:44.287313+0000 b3 1=1+0) (iversion lock) 0x55cf624d7600] 2023-10-03T19:20:52.646 INFO:teuthology.orchestra.run.smithi045.stdout: -6473> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000051d [2,head] #1000000051d auth v5618 s=3 n(v0 rc2023-10-03T19:13:44.287313+0000 b3 1=1+0) (iversion lock) 0x55cf624d7600] 2023-10-03T19:20:52.646 INFO:teuthology.orchestra.run.smithi045.stdout: -6472> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_808 [2,head] auth NULL (dversion lock) v=5618 ino=(nil) state=1073741824 0x55cf624d2c80] 2023-10-03T19:20:52.646 INFO:teuthology.orchestra.run.smithi045.stdout: -6471> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_807 [2,head] auth (dversion lock) v=5616 ino=0x1000000051c state=1073741824 0x55cf624d2a00] 2023-10-03T19:20:52.646 INFO:teuthology.orchestra.run.smithi045.stdout: -6470> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.646 INFO:teuthology.orchestra.run.smithi045.stdout: -6469> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000051c [2,head] /dc-dir/dc-file_807 auth v5616 s=3 n(v0 rc2023-10-03T19:13:44.273861+0000 b3 1=1+0) (iversion lock) 0x55cf624d7080] 2023-10-03T19:20:52.646 INFO:teuthology.orchestra.run.smithi045.stdout: -6468> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_807 [2,head] auth (dversion lock) v=5616 ino=0x1000000051c state=1073741824 0x55cf624d2a00] [inode 0x1000000051c [2,head] /dc-dir/dc-file_807 auth v5616 s=3 n(v0 rc2023-10-03T19:13:44.273861+0000 b3 1=1+0) (iversion lock) 0x55cf624d7080] 2023-10-03T19:20:52.647 INFO:teuthology.orchestra.run.smithi045.stdout: -6467> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000051c [2,head] #1000000051c auth v5616 s=3 n(v0 rc2023-10-03T19:13:44.273861+0000 b3 1=1+0) (iversion lock) 0x55cf624d7080] 2023-10-03T19:20:52.647 INFO:teuthology.orchestra.run.smithi045.stdout: -6466> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_807 [2,head] auth NULL (dversion lock) v=5616 ino=(nil) state=1073741824 0x55cf624d2a00] 2023-10-03T19:20:52.647 INFO:teuthology.orchestra.run.smithi045.stdout: -6465> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_806 [2,head] auth (dversion lock) v=5614 ino=0x1000000051b state=1073741824 0x55cf624d2780] 2023-10-03T19:20:52.647 INFO:teuthology.orchestra.run.smithi045.stdout: -6464> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.647 INFO:teuthology.orchestra.run.smithi045.stdout: -6463> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000051b [2,head] /dc-dir/dc-file_806 auth v5614 s=3 n(v0 rc2023-10-03T19:13:44.260747+0000 b3 1=1+0) (iversion lock) 0x55cf624d6b00] 2023-10-03T19:20:52.647 INFO:teuthology.orchestra.run.smithi045.stdout: -6462> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_806 [2,head] auth (dversion lock) v=5614 ino=0x1000000051b state=1073741824 0x55cf624d2780] [inode 0x1000000051b [2,head] /dc-dir/dc-file_806 auth v5614 s=3 n(v0 rc2023-10-03T19:13:44.260747+0000 b3 1=1+0) (iversion lock) 0x55cf624d6b00] 2023-10-03T19:20:52.647 INFO:teuthology.orchestra.run.smithi045.stdout: -6461> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000051b [2,head] #1000000051b auth v5614 s=3 n(v0 rc2023-10-03T19:13:44.260747+0000 b3 1=1+0) (iversion lock) 0x55cf624d6b00] 2023-10-03T19:20:52.647 INFO:teuthology.orchestra.run.smithi045.stdout: -6460> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_806 [2,head] auth NULL (dversion lock) v=5614 ino=(nil) state=1073741824 0x55cf624d2780] 2023-10-03T19:20:52.649 INFO:teuthology.orchestra.run.smithi045.stdout: -6459> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_805 [2,head] auth (dversion lock) v=5612 ino=0x1000000051a state=1073741824 0x55cf624d2500] 2023-10-03T19:20:52.649 INFO:teuthology.orchestra.run.smithi045.stdout: -6458> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.650 INFO:teuthology.orchestra.run.smithi045.stdout: -6457> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000051a [2,head] /dc-dir/dc-file_805 auth v5612 s=3 n(v0 rc2023-10-03T19:13:44.247186+0000 b3 1=1+0) (iversion lock) 0x55cf624d6580] 2023-10-03T19:20:52.650 INFO:teuthology.orchestra.run.smithi045.stdout: -6456> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_805 [2,head] auth (dversion lock) v=5612 ino=0x1000000051a state=1073741824 0x55cf624d2500] [inode 0x1000000051a [2,head] /dc-dir/dc-file_805 auth v5612 s=3 n(v0 rc2023-10-03T19:13:44.247186+0000 b3 1=1+0) (iversion lock) 0x55cf624d6580] 2023-10-03T19:20:52.650 INFO:teuthology.orchestra.run.smithi045.stdout: -6455> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000051a [2,head] #1000000051a auth v5612 s=3 n(v0 rc2023-10-03T19:13:44.247186+0000 b3 1=1+0) (iversion lock) 0x55cf624d6580] 2023-10-03T19:20:52.650 INFO:teuthology.orchestra.run.smithi045.stdout: -6454> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_805 [2,head] auth NULL (dversion lock) v=5612 ino=(nil) state=1073741824 0x55cf624d2500] 2023-10-03T19:20:52.650 INFO:teuthology.orchestra.run.smithi045.stdout: -6453> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_804 [2,head] auth (dversion lock) v=5610 ino=0x10000000519 state=1073741824 0x55cf624d2280] 2023-10-03T19:20:52.650 INFO:teuthology.orchestra.run.smithi045.stdout: -6452> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.650 INFO:teuthology.orchestra.run.smithi045.stdout: -6451> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000519 [2,head] /dc-dir/dc-file_804 auth v5610 s=3 n(v0 rc2023-10-03T19:13:44.235016+0000 b3 1=1+0) (iversion lock) 0x55cf624d6000] 2023-10-03T19:20:52.650 INFO:teuthology.orchestra.run.smithi045.stdout: -6450> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_804 [2,head] auth (dversion lock) v=5610 ino=0x10000000519 state=1073741824 0x55cf624d2280] [inode 0x10000000519 [2,head] /dc-dir/dc-file_804 auth v5610 s=3 n(v0 rc2023-10-03T19:13:44.235016+0000 b3 1=1+0) (iversion lock) 0x55cf624d6000] 2023-10-03T19:20:52.650 INFO:teuthology.orchestra.run.smithi045.stdout: -6449> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000519 [2,head] #10000000519 auth v5610 s=3 n(v0 rc2023-10-03T19:13:44.235016+0000 b3 1=1+0) (iversion lock) 0x55cf624d6000] 2023-10-03T19:20:52.650 INFO:teuthology.orchestra.run.smithi045.stdout: -6448> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_804 [2,head] auth NULL (dversion lock) v=5610 ino=(nil) state=1073741824 0x55cf624d2280] 2023-10-03T19:20:52.651 INFO:teuthology.orchestra.run.smithi045.stdout: -6447> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_803 [2,head] auth (dversion lock) v=5608 ino=0x10000000518 state=1073741824 0x55cf624d2000] 2023-10-03T19:20:52.651 INFO:teuthology.orchestra.run.smithi045.stdout: -6446> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.651 INFO:teuthology.orchestra.run.smithi045.stdout: -6445> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000518 [2,head] /dc-dir/dc-file_803 auth v5608 s=3 n(v0 rc2023-10-03T19:13:44.223474+0000 b3 1=1+0) (iversion lock) 0x55cf624cf700] 2023-10-03T19:20:52.651 INFO:teuthology.orchestra.run.smithi045.stdout: -6444> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_803 [2,head] auth (dversion lock) v=5608 ino=0x10000000518 state=1073741824 0x55cf624d2000] [inode 0x10000000518 [2,head] /dc-dir/dc-file_803 auth v5608 s=3 n(v0 rc2023-10-03T19:13:44.223474+0000 b3 1=1+0) (iversion lock) 0x55cf624cf700] 2023-10-03T19:20:52.651 INFO:teuthology.orchestra.run.smithi045.stdout: -6443> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000518 [2,head] #10000000518 auth v5608 s=3 n(v0 rc2023-10-03T19:13:44.223474+0000 b3 1=1+0) (iversion lock) 0x55cf624cf700] 2023-10-03T19:20:52.651 INFO:teuthology.orchestra.run.smithi045.stdout: -6442> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_803 [2,head] auth NULL (dversion lock) v=5608 ino=(nil) state=1073741824 0x55cf624d2000] 2023-10-03T19:20:52.651 INFO:teuthology.orchestra.run.smithi045.stdout: -6441> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_802 [2,head] auth (dversion lock) v=5606 ino=0x10000000517 state=1073741824 0x55cf624cbb80] 2023-10-03T19:20:52.651 INFO:teuthology.orchestra.run.smithi045.stdout: -6440> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.651 INFO:teuthology.orchestra.run.smithi045.stdout: -6439> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000517 [2,head] /dc-dir/dc-file_802 auth v5606 s=3 n(v0 rc2023-10-03T19:13:44.212051+0000 b3 1=1+0) (iversion lock) 0x55cf624cf180] 2023-10-03T19:20:52.651 INFO:teuthology.orchestra.run.smithi045.stdout: -6438> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_802 [2,head] auth (dversion lock) v=5606 ino=0x10000000517 state=1073741824 0x55cf624cbb80] [inode 0x10000000517 [2,head] /dc-dir/dc-file_802 auth v5606 s=3 n(v0 rc2023-10-03T19:13:44.212051+0000 b3 1=1+0) (iversion lock) 0x55cf624cf180] 2023-10-03T19:20:52.652 INFO:teuthology.orchestra.run.smithi045.stdout: -6437> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000517 [2,head] #10000000517 auth v5606 s=3 n(v0 rc2023-10-03T19:13:44.212051+0000 b3 1=1+0) (iversion lock) 0x55cf624cf180] 2023-10-03T19:20:52.652 INFO:teuthology.orchestra.run.smithi045.stdout: -6436> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_802 [2,head] auth NULL (dversion lock) v=5606 ino=(nil) state=1073741824 0x55cf624cbb80] 2023-10-03T19:20:52.652 INFO:teuthology.orchestra.run.smithi045.stdout: -6435> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_801 [2,head] auth (dversion lock) v=5604 ino=0x10000000516 state=1073741824 0x55cf624cb900] 2023-10-03T19:20:52.652 INFO:teuthology.orchestra.run.smithi045.stdout: -6434> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.652 INFO:teuthology.orchestra.run.smithi045.stdout: -6433> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000516 [2,head] /dc-dir/dc-file_801 auth v5604 s=3 n(v0 rc2023-10-03T19:13:44.200198+0000 b3 1=1+0) (iversion lock) 0x55cf624cec00] 2023-10-03T19:20:52.652 INFO:teuthology.orchestra.run.smithi045.stdout: -6432> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_801 [2,head] auth (dversion lock) v=5604 ino=0x10000000516 state=1073741824 0x55cf624cb900] [inode 0x10000000516 [2,head] /dc-dir/dc-file_801 auth v5604 s=3 n(v0 rc2023-10-03T19:13:44.200198+0000 b3 1=1+0) (iversion lock) 0x55cf624cec00] 2023-10-03T19:20:52.652 INFO:teuthology.orchestra.run.smithi045.stdout: -6431> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000516 [2,head] #10000000516 auth v5604 s=3 n(v0 rc2023-10-03T19:13:44.200198+0000 b3 1=1+0) (iversion lock) 0x55cf624cec00] 2023-10-03T19:20:52.652 INFO:teuthology.orchestra.run.smithi045.stdout: -6430> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_801 [2,head] auth NULL (dversion lock) v=5604 ino=(nil) state=1073741824 0x55cf624cb900] 2023-10-03T19:20:52.652 INFO:teuthology.orchestra.run.smithi045.stdout: -6429> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_800 [2,head] auth (dversion lock) v=5602 ino=0x10000000515 state=1073741824 0x55cf624cb680] 2023-10-03T19:20:52.652 INFO:teuthology.orchestra.run.smithi045.stdout: -6428> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.653 INFO:teuthology.orchestra.run.smithi045.stdout: -6427> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000515 [2,head] /dc-dir/dc-file_800 auth v5602 s=3 n(v0 rc2023-10-03T19:13:44.188355+0000 b3 1=1+0) (iversion lock) 0x55cf624ce680] 2023-10-03T19:20:52.653 INFO:teuthology.orchestra.run.smithi045.stdout: -6426> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_800 [2,head] auth (dversion lock) v=5602 ino=0x10000000515 state=1073741824 0x55cf624cb680] [inode 0x10000000515 [2,head] /dc-dir/dc-file_800 auth v5602 s=3 n(v0 rc2023-10-03T19:13:44.188355+0000 b3 1=1+0) (iversion lock) 0x55cf624ce680] 2023-10-03T19:20:52.653 INFO:teuthology.orchestra.run.smithi045.stdout: -6425> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000515 [2,head] #10000000515 auth v5602 s=3 n(v0 rc2023-10-03T19:13:44.188355+0000 b3 1=1+0) (iversion lock) 0x55cf624ce680] 2023-10-03T19:20:52.653 INFO:teuthology.orchestra.run.smithi045.stdout: -6424> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_800 [2,head] auth NULL (dversion lock) v=5602 ino=(nil) state=1073741824 0x55cf624cb680] 2023-10-03T19:20:52.653 INFO:teuthology.orchestra.run.smithi045.stdout: -6423> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_799 [2,head] auth (dversion lock) v=5600 ino=0x10000000514 state=1073741824 0x55cf624cb400] 2023-10-03T19:20:52.653 INFO:teuthology.orchestra.run.smithi045.stdout: -6422> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.653 INFO:teuthology.orchestra.run.smithi045.stdout: -6421> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000514 [2,head] /dc-dir/dc-file_799 auth v5600 s=3 n(v0 rc2023-10-03T19:13:44.176717+0000 b3 1=1+0) (iversion lock) 0x55cf624ce100] 2023-10-03T19:20:52.653 INFO:teuthology.orchestra.run.smithi045.stdout: -6420> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_799 [2,head] auth (dversion lock) v=5600 ino=0x10000000514 state=1073741824 0x55cf624cb400] [inode 0x10000000514 [2,head] /dc-dir/dc-file_799 auth v5600 s=3 n(v0 rc2023-10-03T19:13:44.176717+0000 b3 1=1+0) (iversion lock) 0x55cf624ce100] 2023-10-03T19:20:52.653 INFO:teuthology.orchestra.run.smithi045.stdout: -6419> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000514 [2,head] #10000000514 auth v5600 s=3 n(v0 rc2023-10-03T19:13:44.176717+0000 b3 1=1+0) (iversion lock) 0x55cf624ce100] 2023-10-03T19:20:52.654 INFO:teuthology.orchestra.run.smithi045.stdout: -6418> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_799 [2,head] auth NULL (dversion lock) v=5600 ino=(nil) state=1073741824 0x55cf624cb400] 2023-10-03T19:20:52.654 INFO:teuthology.orchestra.run.smithi045.stdout: -6417> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_798 [2,head] auth (dversion lock) v=5598 ino=0x10000000513 state=1073741824 0x55cf624cb180] 2023-10-03T19:20:52.654 INFO:teuthology.orchestra.run.smithi045.stdout: -6416> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.654 INFO:teuthology.orchestra.run.smithi045.stdout: -6415> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000513 [2,head] /dc-dir/dc-file_798 auth v5598 s=3 n(v0 rc2023-10-03T19:13:44.165311+0000 b3 1=1+0) (iversion lock) 0x55cf624cdb80] 2023-10-03T19:20:52.654 INFO:teuthology.orchestra.run.smithi045.stdout: -6414> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_798 [2,head] auth (dversion lock) v=5598 ino=0x10000000513 state=1073741824 0x55cf624cb180] [inode 0x10000000513 [2,head] /dc-dir/dc-file_798 auth v5598 s=3 n(v0 rc2023-10-03T19:13:44.165311+0000 b3 1=1+0) (iversion lock) 0x55cf624cdb80] 2023-10-03T19:20:52.654 INFO:teuthology.orchestra.run.smithi045.stdout: -6413> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000513 [2,head] #10000000513 auth v5598 s=3 n(v0 rc2023-10-03T19:13:44.165311+0000 b3 1=1+0) (iversion lock) 0x55cf624cdb80] 2023-10-03T19:20:52.654 INFO:teuthology.orchestra.run.smithi045.stdout: -6412> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_798 [2,head] auth NULL (dversion lock) v=5598 ino=(nil) state=1073741824 0x55cf624cb180] 2023-10-03T19:20:52.654 INFO:teuthology.orchestra.run.smithi045.stdout: -6411> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_797 [2,head] auth (dversion lock) v=5596 ino=0x10000000512 state=1073741824 0x55cf624caf00] 2023-10-03T19:20:52.654 INFO:teuthology.orchestra.run.smithi045.stdout: -6410> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.654 INFO:teuthology.orchestra.run.smithi045.stdout: -6409> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000512 [2,head] /dc-dir/dc-file_797 auth v5596 s=3 n(v0 rc2023-10-03T19:13:44.152107+0000 b3 1=1+0) (iversion lock) 0x55cf624cd600] 2023-10-03T19:20:52.654 INFO:teuthology.orchestra.run.smithi045.stdout: -6408> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_797 [2,head] auth (dversion lock) v=5596 ino=0x10000000512 state=1073741824 0x55cf624caf00] [inode 0x10000000512 [2,head] /dc-dir/dc-file_797 auth v5596 s=3 n(v0 rc2023-10-03T19:13:44.152107+0000 b3 1=1+0) (iversion lock) 0x55cf624cd600] 2023-10-03T19:20:52.655 INFO:teuthology.orchestra.run.smithi045.stdout: -6407> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000512 [2,head] #10000000512 auth v5596 s=3 n(v0 rc2023-10-03T19:13:44.152107+0000 b3 1=1+0) (iversion lock) 0x55cf624cd600] 2023-10-03T19:20:52.655 INFO:teuthology.orchestra.run.smithi045.stdout: -6406> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_797 [2,head] auth NULL (dversion lock) v=5596 ino=(nil) state=1073741824 0x55cf624caf00] 2023-10-03T19:20:52.655 INFO:teuthology.orchestra.run.smithi045.stdout: -6405> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_796 [2,head] auth (dversion lock) v=5594 ino=0x10000000511 state=1073741824 0x55cf624cac80] 2023-10-03T19:20:52.655 INFO:teuthology.orchestra.run.smithi045.stdout: -6404> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.655 INFO:teuthology.orchestra.run.smithi045.stdout: -6403> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000511 [2,head] /dc-dir/dc-file_796 auth v5594 s=3 n(v0 rc2023-10-03T19:13:44.140294+0000 b3 1=1+0) (iversion lock) 0x55cf624cd080] 2023-10-03T19:20:52.655 INFO:teuthology.orchestra.run.smithi045.stdout: -6402> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_796 [2,head] auth (dversion lock) v=5594 ino=0x10000000511 state=1073741824 0x55cf624cac80] [inode 0x10000000511 [2,head] /dc-dir/dc-file_796 auth v5594 s=3 n(v0 rc2023-10-03T19:13:44.140294+0000 b3 1=1+0) (iversion lock) 0x55cf624cd080] 2023-10-03T19:20:52.655 INFO:teuthology.orchestra.run.smithi045.stdout: -6401> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000511 [2,head] #10000000511 auth v5594 s=3 n(v0 rc2023-10-03T19:13:44.140294+0000 b3 1=1+0) (iversion lock) 0x55cf624cd080] 2023-10-03T19:20:52.655 INFO:teuthology.orchestra.run.smithi045.stdout: -6400> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_796 [2,head] auth NULL (dversion lock) v=5594 ino=(nil) state=1073741824 0x55cf624cac80] 2023-10-03T19:20:52.655 INFO:teuthology.orchestra.run.smithi045.stdout: -6399> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_795 [2,head] auth (dversion lock) v=5592 ino=0x10000000510 state=1073741824 0x55cf624caa00] 2023-10-03T19:20:52.656 INFO:teuthology.orchestra.run.smithi045.stdout: -6398> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.656 INFO:teuthology.orchestra.run.smithi045.stdout: -6397> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000510 [2,head] /dc-dir/dc-file_795 auth v5592 s=3 n(v0 rc2023-10-03T19:13:44.128279+0000 b3 1=1+0) (iversion lock) 0x55cf624ccb00] 2023-10-03T19:20:52.656 INFO:teuthology.orchestra.run.smithi045.stdout: -6396> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_795 [2,head] auth (dversion lock) v=5592 ino=0x10000000510 state=1073741824 0x55cf624caa00] [inode 0x10000000510 [2,head] /dc-dir/dc-file_795 auth v5592 s=3 n(v0 rc2023-10-03T19:13:44.128279+0000 b3 1=1+0) (iversion lock) 0x55cf624ccb00] 2023-10-03T19:20:52.656 INFO:teuthology.orchestra.run.smithi045.stdout: -6395> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000510 [2,head] #10000000510 auth v5592 s=3 n(v0 rc2023-10-03T19:13:44.128279+0000 b3 1=1+0) (iversion lock) 0x55cf624ccb00] 2023-10-03T19:20:52.656 INFO:teuthology.orchestra.run.smithi045.stdout: -6394> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_795 [2,head] auth NULL (dversion lock) v=5592 ino=(nil) state=1073741824 0x55cf624caa00] 2023-10-03T19:20:52.656 INFO:teuthology.orchestra.run.smithi045.stdout: -6393> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_794 [2,head] auth (dversion lock) v=5590 ino=0x1000000050f state=1073741824 0x55cf624ca780] 2023-10-03T19:20:52.656 INFO:teuthology.orchestra.run.smithi045.stdout: -6392> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.656 INFO:teuthology.orchestra.run.smithi045.stdout: -6391> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000050f [2,head] /dc-dir/dc-file_794 auth v5590 s=3 n(v0 rc2023-10-03T19:13:44.116381+0000 b3 1=1+0) (iversion lock) 0x55cf624cc580] 2023-10-03T19:20:52.656 INFO:teuthology.orchestra.run.smithi045.stdout: -6390> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_794 [2,head] auth (dversion lock) v=5590 ino=0x1000000050f state=1073741824 0x55cf624ca780] [inode 0x1000000050f [2,head] /dc-dir/dc-file_794 auth v5590 s=3 n(v0 rc2023-10-03T19:13:44.116381+0000 b3 1=1+0) (iversion lock) 0x55cf624cc580] 2023-10-03T19:20:52.656 INFO:teuthology.orchestra.run.smithi045.stdout: -6389> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000050f [2,head] #1000000050f auth v5590 s=3 n(v0 rc2023-10-03T19:13:44.116381+0000 b3 1=1+0) (iversion lock) 0x55cf624cc580] 2023-10-03T19:20:52.656 INFO:teuthology.orchestra.run.smithi045.stdout: -6388> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_794 [2,head] auth NULL (dversion lock) v=5590 ino=(nil) state=1073741824 0x55cf624ca780] 2023-10-03T19:20:52.657 INFO:teuthology.orchestra.run.smithi045.stdout: -6387> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_793 [2,head] auth (dversion lock) v=5588 ino=0x1000000050e state=1073741824 0x55cf624ca500] 2023-10-03T19:20:52.657 INFO:teuthology.orchestra.run.smithi045.stdout: -6386> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.657 INFO:teuthology.orchestra.run.smithi045.stdout: -6385> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000050e [2,head] /dc-dir/dc-file_793 auth v5588 s=3 n(v0 rc2023-10-03T19:13:44.104806+0000 b3 1=1+0) (iversion lock) 0x55cf624cc000] 2023-10-03T19:20:52.657 INFO:teuthology.orchestra.run.smithi045.stdout: -6384> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_793 [2,head] auth (dversion lock) v=5588 ino=0x1000000050e state=1073741824 0x55cf624ca500] [inode 0x1000000050e [2,head] /dc-dir/dc-file_793 auth v5588 s=3 n(v0 rc2023-10-03T19:13:44.104806+0000 b3 1=1+0) (iversion lock) 0x55cf624cc000] 2023-10-03T19:20:52.657 INFO:teuthology.orchestra.run.smithi045.stdout: -6383> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000050e [2,head] #1000000050e auth v5588 s=3 n(v0 rc2023-10-03T19:13:44.104806+0000 b3 1=1+0) (iversion lock) 0x55cf624cc000] 2023-10-03T19:20:52.657 INFO:teuthology.orchestra.run.smithi045.stdout: -6382> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_793 [2,head] auth NULL (dversion lock) v=5588 ino=(nil) state=1073741824 0x55cf624ca500] 2023-10-03T19:20:52.657 INFO:teuthology.orchestra.run.smithi045.stdout: -6381> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_792 [2,head] auth (dversion lock) v=5586 ino=0x1000000050d state=1073741824 0x55cf624ca280] 2023-10-03T19:20:52.657 INFO:teuthology.orchestra.run.smithi045.stdout: -6380> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.657 INFO:teuthology.orchestra.run.smithi045.stdout: -6379> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000050d [2,head] /dc-dir/dc-file_792 auth v5586 s=3 n(v0 rc2023-10-03T19:13:44.093706+0000 b3 1=1+0) (iversion lock) 0x55cf624c5700] 2023-10-03T19:20:52.657 INFO:teuthology.orchestra.run.smithi045.stdout: -6378> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_792 [2,head] auth (dversion lock) v=5586 ino=0x1000000050d state=1073741824 0x55cf624ca280] [inode 0x1000000050d [2,head] /dc-dir/dc-file_792 auth v5586 s=3 n(v0 rc2023-10-03T19:13:44.093706+0000 b3 1=1+0) (iversion lock) 0x55cf624c5700] 2023-10-03T19:20:52.658 INFO:teuthology.orchestra.run.smithi045.stdout: -6377> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000050d [2,head] #1000000050d auth v5586 s=3 n(v0 rc2023-10-03T19:13:44.093706+0000 b3 1=1+0) (iversion lock) 0x55cf624c5700] 2023-10-03T19:20:52.658 INFO:teuthology.orchestra.run.smithi045.stdout: -6376> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_792 [2,head] auth NULL (dversion lock) v=5586 ino=(nil) state=1073741824 0x55cf624ca280] 2023-10-03T19:20:52.658 INFO:teuthology.orchestra.run.smithi045.stdout: -6375> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_791 [2,head] auth (dversion lock) v=5584 ino=0x1000000050c state=1073741824 0x55cf624ca000] 2023-10-03T19:20:52.658 INFO:teuthology.orchestra.run.smithi045.stdout: -6374> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.658 INFO:teuthology.orchestra.run.smithi045.stdout: -6373> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000050c [2,head] /dc-dir/dc-file_791 auth v5584 s=3 n(v0 rc2023-10-03T19:13:44.081430+0000 b3 1=1+0) (iversion lock) 0x55cf624c5180] 2023-10-03T19:20:52.658 INFO:teuthology.orchestra.run.smithi045.stdout: -6372> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_791 [2,head] auth (dversion lock) v=5584 ino=0x1000000050c state=1073741824 0x55cf624ca000] [inode 0x1000000050c [2,head] /dc-dir/dc-file_791 auth v5584 s=3 n(v0 rc2023-10-03T19:13:44.081430+0000 b3 1=1+0) (iversion lock) 0x55cf624c5180] 2023-10-03T19:20:52.658 INFO:teuthology.orchestra.run.smithi045.stdout: -6371> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000050c [2,head] #1000000050c auth v5584 s=3 n(v0 rc2023-10-03T19:13:44.081430+0000 b3 1=1+0) (iversion lock) 0x55cf624c5180] 2023-10-03T19:20:52.658 INFO:teuthology.orchestra.run.smithi045.stdout: -6370> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_791 [2,head] auth NULL (dversion lock) v=5584 ino=(nil) state=1073741824 0x55cf624ca000] 2023-10-03T19:20:52.658 INFO:teuthology.orchestra.run.smithi045.stdout: -6369> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_790 [2,head] auth (dversion lock) v=5582 ino=0x1000000050b state=1073741824 0x55cf624bbb80] 2023-10-03T19:20:52.658 INFO:teuthology.orchestra.run.smithi045.stdout: -6368> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.658 INFO:teuthology.orchestra.run.smithi045.stdout: -6367> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000050b [2,head] /dc-dir/dc-file_790 auth v5582 s=3 n(v0 rc2023-10-03T19:13:44.069751+0000 b3 1=1+0) (iversion lock) 0x55cf624c4c00] 2023-10-03T19:20:52.659 INFO:teuthology.orchestra.run.smithi045.stdout: -6366> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_790 [2,head] auth (dversion lock) v=5582 ino=0x1000000050b state=1073741824 0x55cf624bbb80] [inode 0x1000000050b [2,head] /dc-dir/dc-file_790 auth v5582 s=3 n(v0 rc2023-10-03T19:13:44.069751+0000 b3 1=1+0) (iversion lock) 0x55cf624c4c00] 2023-10-03T19:20:52.659 INFO:teuthology.orchestra.run.smithi045.stdout: -6365> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000050b [2,head] #1000000050b auth v5582 s=3 n(v0 rc2023-10-03T19:13:44.069751+0000 b3 1=1+0) (iversion lock) 0x55cf624c4c00] 2023-10-03T19:20:52.659 INFO:teuthology.orchestra.run.smithi045.stdout: -6364> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_790 [2,head] auth NULL (dversion lock) v=5582 ino=(nil) state=1073741824 0x55cf624bbb80] 2023-10-03T19:20:52.659 INFO:teuthology.orchestra.run.smithi045.stdout: -6363> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_789 [2,head] auth (dversion lock) v=5580 ino=0x1000000050a state=1073741824 0x55cf624bb900] 2023-10-03T19:20:52.659 INFO:teuthology.orchestra.run.smithi045.stdout: -6362> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.659 INFO:teuthology.orchestra.run.smithi045.stdout: -6361> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000050a [2,head] /dc-dir/dc-file_789 auth v5580 s=3 n(v0 rc2023-10-03T19:13:44.050564+0000 b3 1=1+0) (iversion lock) 0x55cf624c4680] 2023-10-03T19:20:52.659 INFO:teuthology.orchestra.run.smithi045.stdout: -6360> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_789 [2,head] auth (dversion lock) v=5580 ino=0x1000000050a state=1073741824 0x55cf624bb900] [inode 0x1000000050a [2,head] /dc-dir/dc-file_789 auth v5580 s=3 n(v0 rc2023-10-03T19:13:44.050564+0000 b3 1=1+0) (iversion lock) 0x55cf624c4680] 2023-10-03T19:20:52.659 INFO:teuthology.orchestra.run.smithi045.stdout: -6359> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000050a [2,head] #1000000050a auth v5580 s=3 n(v0 rc2023-10-03T19:13:44.050564+0000 b3 1=1+0) (iversion lock) 0x55cf624c4680] 2023-10-03T19:20:52.659 INFO:teuthology.orchestra.run.smithi045.stdout: -6358> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_789 [2,head] auth NULL (dversion lock) v=5580 ino=(nil) state=1073741824 0x55cf624bb900] 2023-10-03T19:20:52.659 INFO:teuthology.orchestra.run.smithi045.stdout: -6357> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_788 [2,head] auth (dversion lock) v=5578 ino=0x10000000509 state=1073741824 0x55cf624bb680] 2023-10-03T19:20:52.660 INFO:teuthology.orchestra.run.smithi045.stdout: -6356> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.660 INFO:teuthology.orchestra.run.smithi045.stdout: -6355> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000509 [2,head] /dc-dir/dc-file_788 auth v5578 s=3 n(v0 rc2023-10-03T19:13:44.034507+0000 b3 1=1+0) (iversion lock) 0x55cf624c4100] 2023-10-03T19:20:52.660 INFO:teuthology.orchestra.run.smithi045.stdout: -6354> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_788 [2,head] auth (dversion lock) v=5578 ino=0x10000000509 state=1073741824 0x55cf624bb680] [inode 0x10000000509 [2,head] /dc-dir/dc-file_788 auth v5578 s=3 n(v0 rc2023-10-03T19:13:44.034507+0000 b3 1=1+0) (iversion lock) 0x55cf624c4100] 2023-10-03T19:20:52.660 INFO:teuthology.orchestra.run.smithi045.stdout: -6353> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000509 [2,head] #10000000509 auth v5578 s=3 n(v0 rc2023-10-03T19:13:44.034507+0000 b3 1=1+0) (iversion lock) 0x55cf624c4100] 2023-10-03T19:20:52.660 INFO:teuthology.orchestra.run.smithi045.stdout: -6352> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_788 [2,head] auth NULL (dversion lock) v=5578 ino=(nil) state=1073741824 0x55cf624bb680] 2023-10-03T19:20:52.660 INFO:teuthology.orchestra.run.smithi045.stdout: -6351> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_787 [2,head] auth (dversion lock) v=5576 ino=0x10000000508 state=1073741824 0x55cf624bb400] 2023-10-03T19:20:52.660 INFO:teuthology.orchestra.run.smithi045.stdout: -6350> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.660 INFO:teuthology.orchestra.run.smithi045.stdout: -6349> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000508 [2,head] /dc-dir/dc-file_787 auth v5576 s=3 n(v0 rc2023-10-03T19:13:44.022165+0000 b3 1=1+0) (iversion lock) 0x55cf624c3b80] 2023-10-03T19:20:52.660 INFO:teuthology.orchestra.run.smithi045.stdout: -6348> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_787 [2,head] auth (dversion lock) v=5576 ino=0x10000000508 state=1073741824 0x55cf624bb400] [inode 0x10000000508 [2,head] /dc-dir/dc-file_787 auth v5576 s=3 n(v0 rc2023-10-03T19:13:44.022165+0000 b3 1=1+0) (iversion lock) 0x55cf624c3b80] 2023-10-03T19:20:52.660 INFO:teuthology.orchestra.run.smithi045.stdout: -6347> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000508 [2,head] #10000000508 auth v5576 s=3 n(v0 rc2023-10-03T19:13:44.022165+0000 b3 1=1+0) (iversion lock) 0x55cf624c3b80] 2023-10-03T19:20:52.661 INFO:teuthology.orchestra.run.smithi045.stdout: -6346> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_787 [2,head] auth NULL (dversion lock) v=5576 ino=(nil) state=1073741824 0x55cf624bb400] 2023-10-03T19:20:52.661 INFO:teuthology.orchestra.run.smithi045.stdout: -6345> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_786 [2,head] auth (dversion lock) v=5574 ino=0x10000000507 state=1073741824 0x55cf624bb180] 2023-10-03T19:20:52.661 INFO:teuthology.orchestra.run.smithi045.stdout: -6344> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.661 INFO:teuthology.orchestra.run.smithi045.stdout: -6343> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000507 [2,head] /dc-dir/dc-file_786 auth v5574 s=3 n(v0 rc2023-10-03T19:13:44.009555+0000 b3 1=1+0) (iversion lock) 0x55cf624c3600] 2023-10-03T19:20:52.661 INFO:teuthology.orchestra.run.smithi045.stdout: -6342> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_786 [2,head] auth (dversion lock) v=5574 ino=0x10000000507 state=1073741824 0x55cf624bb180] [inode 0x10000000507 [2,head] /dc-dir/dc-file_786 auth v5574 s=3 n(v0 rc2023-10-03T19:13:44.009555+0000 b3 1=1+0) (iversion lock) 0x55cf624c3600] 2023-10-03T19:20:52.661 INFO:teuthology.orchestra.run.smithi045.stdout: -6341> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000507 [2,head] #10000000507 auth v5574 s=3 n(v0 rc2023-10-03T19:13:44.009555+0000 b3 1=1+0) (iversion lock) 0x55cf624c3600] 2023-10-03T19:20:52.661 INFO:teuthology.orchestra.run.smithi045.stdout: -6340> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_786 [2,head] auth NULL (dversion lock) v=5574 ino=(nil) state=1073741824 0x55cf624bb180] 2023-10-03T19:20:52.661 INFO:teuthology.orchestra.run.smithi045.stdout: -6339> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_785 [2,head] auth (dversion lock) v=5572 ino=0x10000000506 state=1073741824 0x55cf624baf00] 2023-10-03T19:20:52.661 INFO:teuthology.orchestra.run.smithi045.stdout: -6338> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.661 INFO:teuthology.orchestra.run.smithi045.stdout: -6337> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000506 [2,head] /dc-dir/dc-file_785 auth v5572 s=3 n(v0 rc2023-10-03T19:13:43.996458+0000 b3 1=1+0) (iversion lock) 0x55cf624c3080] 2023-10-03T19:20:52.661 INFO:teuthology.orchestra.run.smithi045.stdout: -6336> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_785 [2,head] auth (dversion lock) v=5572 ino=0x10000000506 state=1073741824 0x55cf624baf00] [inode 0x10000000506 [2,head] /dc-dir/dc-file_785 auth v5572 s=3 n(v0 rc2023-10-03T19:13:43.996458+0000 b3 1=1+0) (iversion lock) 0x55cf624c3080] 2023-10-03T19:20:52.662 INFO:teuthology.orchestra.run.smithi045.stdout: -6335> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000506 [2,head] #10000000506 auth v5572 s=3 n(v0 rc2023-10-03T19:13:43.996458+0000 b3 1=1+0) (iversion lock) 0x55cf624c3080] 2023-10-03T19:20:52.662 INFO:teuthology.orchestra.run.smithi045.stdout: -6334> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_785 [2,head] auth NULL (dversion lock) v=5572 ino=(nil) state=1073741824 0x55cf624baf00] 2023-10-03T19:20:52.662 INFO:teuthology.orchestra.run.smithi045.stdout: -6333> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_784 [2,head] auth (dversion lock) v=5570 ino=0x10000000505 state=1073741824 0x55cf624bac80] 2023-10-03T19:20:52.662 INFO:teuthology.orchestra.run.smithi045.stdout: -6332> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.662 INFO:teuthology.orchestra.run.smithi045.stdout: -6331> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000505 [2,head] /dc-dir/dc-file_784 auth v5570 s=3 n(v0 rc2023-10-03T19:13:43.984317+0000 b3 1=1+0) (iversion lock) 0x55cf624c2b00] 2023-10-03T19:20:52.662 INFO:teuthology.orchestra.run.smithi045.stdout: -6330> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_784 [2,head] auth (dversion lock) v=5570 ino=0x10000000505 state=1073741824 0x55cf624bac80] [inode 0x10000000505 [2,head] /dc-dir/dc-file_784 auth v5570 s=3 n(v0 rc2023-10-03T19:13:43.984317+0000 b3 1=1+0) (iversion lock) 0x55cf624c2b00] 2023-10-03T19:20:52.662 INFO:teuthology.orchestra.run.smithi045.stdout: -6329> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000505 [2,head] #10000000505 auth v5570 s=3 n(v0 rc2023-10-03T19:13:43.984317+0000 b3 1=1+0) (iversion lock) 0x55cf624c2b00] 2023-10-03T19:20:52.662 INFO:teuthology.orchestra.run.smithi045.stdout: -6328> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_784 [2,head] auth NULL (dversion lock) v=5570 ino=(nil) state=1073741824 0x55cf624bac80] 2023-10-03T19:20:52.662 INFO:teuthology.orchestra.run.smithi045.stdout: -6327> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_783 [2,head] auth (dversion lock) v=5568 ino=0x10000000504 state=1073741824 0x55cf624baa00] 2023-10-03T19:20:52.663 INFO:teuthology.orchestra.run.smithi045.stdout: -6326> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.663 INFO:teuthology.orchestra.run.smithi045.stdout: -6325> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000504 [2,head] /dc-dir/dc-file_783 auth v5568 s=3 n(v0 rc2023-10-03T19:13:43.971691+0000 b3 1=1+0) (iversion lock) 0x55cf624c2580] 2023-10-03T19:20:52.663 INFO:teuthology.orchestra.run.smithi045.stdout: -6324> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_783 [2,head] auth (dversion lock) v=5568 ino=0x10000000504 state=1073741824 0x55cf624baa00] [inode 0x10000000504 [2,head] /dc-dir/dc-file_783 auth v5568 s=3 n(v0 rc2023-10-03T19:13:43.971691+0000 b3 1=1+0) (iversion lock) 0x55cf624c2580] 2023-10-03T19:20:52.663 INFO:teuthology.orchestra.run.smithi045.stdout: -6323> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000504 [2,head] #10000000504 auth v5568 s=3 n(v0 rc2023-10-03T19:13:43.971691+0000 b3 1=1+0) (iversion lock) 0x55cf624c2580] 2023-10-03T19:20:52.663 INFO:teuthology.orchestra.run.smithi045.stdout: -6322> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_783 [2,head] auth NULL (dversion lock) v=5568 ino=(nil) state=1073741824 0x55cf624baa00] 2023-10-03T19:20:52.663 INFO:teuthology.orchestra.run.smithi045.stdout: -6321> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_782 [2,head] auth (dversion lock) v=5566 ino=0x10000000503 state=1073741824 0x55cf624ba780] 2023-10-03T19:20:52.663 INFO:teuthology.orchestra.run.smithi045.stdout: -6320> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.663 INFO:teuthology.orchestra.run.smithi045.stdout: -6319> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000503 [2,head] /dc-dir/dc-file_782 auth v5566 s=3 n(v0 rc2023-10-03T19:13:43.958819+0000 b3 1=1+0) (iversion lock) 0x55cf624c2000] 2023-10-03T19:20:52.663 INFO:teuthology.orchestra.run.smithi045.stdout: -6318> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_782 [2,head] auth (dversion lock) v=5566 ino=0x10000000503 state=1073741824 0x55cf624ba780] [inode 0x10000000503 [2,head] /dc-dir/dc-file_782 auth v5566 s=3 n(v0 rc2023-10-03T19:13:43.958819+0000 b3 1=1+0) (iversion lock) 0x55cf624c2000] 2023-10-03T19:20:52.663 INFO:teuthology.orchestra.run.smithi045.stdout: -6317> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000503 [2,head] #10000000503 auth v5566 s=3 n(v0 rc2023-10-03T19:13:43.958819+0000 b3 1=1+0) (iversion lock) 0x55cf624c2000] 2023-10-03T19:20:52.663 INFO:teuthology.orchestra.run.smithi045.stdout: -6316> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_782 [2,head] auth NULL (dversion lock) v=5566 ino=(nil) state=1073741824 0x55cf624ba780] 2023-10-03T19:20:52.664 INFO:teuthology.orchestra.run.smithi045.stdout: -6315> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_781 [2,head] auth (dversion lock) v=5564 ino=0x10000000502 state=1073741824 0x55cf624ba500] 2023-10-03T19:20:52.664 INFO:teuthology.orchestra.run.smithi045.stdout: -6314> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.664 INFO:teuthology.orchestra.run.smithi045.stdout: -6313> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000502 [2,head] /dc-dir/dc-file_781 auth v5564 s=3 n(v0 rc2023-10-03T19:13:43.945762+0000 b3 1=1+0) (iversion lock) 0x55cf624b7700] 2023-10-03T19:20:52.664 INFO:teuthology.orchestra.run.smithi045.stdout: -6312> 2023-10-03T19:15:17.715+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1024 ==== osd_op_reply(2072 200.00000001 [delete] v37'869 uv869 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:52.953 INFO:teuthology.orchestra.run.smithi045.stdout: -6311> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_781 [2,head] auth (dversion lock) v=5564 ino=0x10000000502 state=1073741824 0x55cf624ba500] [inode 0x10000000502 [2,head] /dc-dir/dc-file_781 auth v5564 s=3 n(v0 rc2023-10-03T19:13:43.945762+0000 b3 1=1+0) (iversion lock) 0x55cf624b7700] 2023-10-03T19:20:52.953 INFO:teuthology.orchestra.run.smithi045.stdout: -6310> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000502 [2,head] #10000000502 auth v5564 s=3 n(v0 rc2023-10-03T19:13:43.945762+0000 b3 1=1+0) (iversion lock) 0x55cf624b7700] 2023-10-03T19:20:52.953 INFO:teuthology.orchestra.run.smithi045.stdout: -6309> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_781 [2,head] auth NULL (dversion lock) v=5564 ino=(nil) state=1073741824 0x55cf624ba500] 2023-10-03T19:20:52.953 INFO:teuthology.orchestra.run.smithi045.stdout: -6308> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_780 [2,head] auth (dversion lock) v=5562 ino=0x10000000501 state=1073741824 0x55cf624ba280] 2023-10-03T19:20:52.953 INFO:teuthology.orchestra.run.smithi045.stdout: -6307> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.953 INFO:teuthology.orchestra.run.smithi045.stdout: -6306> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000501 [2,head] /dc-dir/dc-file_780 auth v5562 s=3 n(v0 rc2023-10-03T19:13:43.932682+0000 b3 1=1+0) (iversion lock) 0x55cf624b7180] 2023-10-03T19:20:52.953 INFO:teuthology.orchestra.run.smithi045.stdout: -6305> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_780 [2,head] auth (dversion lock) v=5562 ino=0x10000000501 state=1073741824 0x55cf624ba280] [inode 0x10000000501 [2,head] /dc-dir/dc-file_780 auth v5562 s=3 n(v0 rc2023-10-03T19:13:43.932682+0000 b3 1=1+0) (iversion lock) 0x55cf624b7180] 2023-10-03T19:20:52.953 INFO:teuthology.orchestra.run.smithi045.stdout: -6304> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000501 [2,head] #10000000501 auth v5562 s=3 n(v0 rc2023-10-03T19:13:43.932682+0000 b3 1=1+0) (iversion lock) 0x55cf624b7180] 2023-10-03T19:20:52.954 INFO:teuthology.orchestra.run.smithi045.stdout: -6303> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_780 [2,head] auth NULL (dversion lock) v=5562 ino=(nil) state=1073741824 0x55cf624ba280] 2023-10-03T19:20:52.954 INFO:teuthology.orchestra.run.smithi045.stdout: -6302> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_779 [2,head] auth (dversion lock) v=5560 ino=0x10000000500 state=1073741824 0x55cf624ba000] 2023-10-03T19:20:52.954 INFO:teuthology.orchestra.run.smithi045.stdout: -6301> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.954 INFO:teuthology.orchestra.run.smithi045.stdout: -6300> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000500 [2,head] /dc-dir/dc-file_779 auth v5560 s=3 n(v0 rc2023-10-03T19:13:43.920499+0000 b3 1=1+0) (iversion lock) 0x55cf624b6c00] 2023-10-03T19:20:52.954 INFO:teuthology.orchestra.run.smithi045.stdout: -6299> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_779 [2,head] auth (dversion lock) v=5560 ino=0x10000000500 state=1073741824 0x55cf624ba000] [inode 0x10000000500 [2,head] /dc-dir/dc-file_779 auth v5560 s=3 n(v0 rc2023-10-03T19:13:43.920499+0000 b3 1=1+0) (iversion lock) 0x55cf624b6c00] 2023-10-03T19:20:52.954 INFO:teuthology.orchestra.run.smithi045.stdout: -6298> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000500 [2,head] #10000000500 auth v5560 s=3 n(v0 rc2023-10-03T19:13:43.920499+0000 b3 1=1+0) (iversion lock) 0x55cf624b6c00] 2023-10-03T19:20:52.954 INFO:teuthology.orchestra.run.smithi045.stdout: -6297> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_779 [2,head] auth NULL (dversion lock) v=5560 ino=(nil) state=1073741824 0x55cf624ba000] 2023-10-03T19:20:52.954 INFO:teuthology.orchestra.run.smithi045.stdout: -6296> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_778 [2,head] auth (dversion lock) v=5558 ino=0x100000004ff state=1073741824 0x55cf624b1b80] 2023-10-03T19:20:52.954 INFO:teuthology.orchestra.run.smithi045.stdout: -6295> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.954 INFO:teuthology.orchestra.run.smithi045.stdout: -6294> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004ff [2,head] /dc-dir/dc-file_778 auth v5558 s=3 n(v0 rc2023-10-03T19:13:43.907180+0000 b3 1=1+0) (iversion lock) 0x55cf624b6680] 2023-10-03T19:20:52.955 INFO:teuthology.orchestra.run.smithi045.stdout: -6293> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_778 [2,head] auth (dversion lock) v=5558 ino=0x100000004ff state=1073741824 0x55cf624b1b80] [inode 0x100000004ff [2,head] /dc-dir/dc-file_778 auth v5558 s=3 n(v0 rc2023-10-03T19:13:43.907180+0000 b3 1=1+0) (iversion lock) 0x55cf624b6680] 2023-10-03T19:20:52.955 INFO:teuthology.orchestra.run.smithi045.stdout: -6292> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004ff [2,head] #100000004ff auth v5558 s=3 n(v0 rc2023-10-03T19:13:43.907180+0000 b3 1=1+0) (iversion lock) 0x55cf624b6680] 2023-10-03T19:20:52.955 INFO:teuthology.orchestra.run.smithi045.stdout: -6291> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_778 [2,head] auth NULL (dversion lock) v=5558 ino=(nil) state=1073741824 0x55cf624b1b80] 2023-10-03T19:20:52.955 INFO:teuthology.orchestra.run.smithi045.stdout: -6290> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_777 [2,head] auth (dversion lock) v=5556 ino=0x100000004fe state=1073741824 0x55cf624b1900] 2023-10-03T19:20:52.955 INFO:teuthology.orchestra.run.smithi045.stdout: -6289> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.955 INFO:teuthology.orchestra.run.smithi045.stdout: -6288> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004fe [2,head] /dc-dir/dc-file_777 auth v5556 s=3 n(v0 rc2023-10-03T19:13:43.893903+0000 b3 1=1+0) (iversion lock) 0x55cf624b6100] 2023-10-03T19:20:52.955 INFO:teuthology.orchestra.run.smithi045.stdout: -6287> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_777 [2,head] auth (dversion lock) v=5556 ino=0x100000004fe state=1073741824 0x55cf624b1900] [inode 0x100000004fe [2,head] /dc-dir/dc-file_777 auth v5556 s=3 n(v0 rc2023-10-03T19:13:43.893903+0000 b3 1=1+0) (iversion lock) 0x55cf624b6100] 2023-10-03T19:20:52.955 INFO:teuthology.orchestra.run.smithi045.stdout: -6286> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004fe [2,head] #100000004fe auth v5556 s=3 n(v0 rc2023-10-03T19:13:43.893903+0000 b3 1=1+0) (iversion lock) 0x55cf624b6100] 2023-10-03T19:20:52.955 INFO:teuthology.orchestra.run.smithi045.stdout: -6285> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_777 [2,head] auth NULL (dversion lock) v=5556 ino=(nil) state=1073741824 0x55cf624b1900] 2023-10-03T19:20:52.955 INFO:teuthology.orchestra.run.smithi045.stdout: -6284> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_776 [2,head] auth (dversion lock) v=5554 ino=0x100000004fd state=1073741824 0x55cf624b1680] 2023-10-03T19:20:52.955 INFO:teuthology.orchestra.run.smithi045.stdout: -6283> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.956 INFO:teuthology.orchestra.run.smithi045.stdout: -6282> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004fd [2,head] /dc-dir/dc-file_776 auth v5554 s=3 n(v0 rc2023-10-03T19:13:43.880780+0000 b3 1=1+0) (iversion lock) 0x55cf624b5b80] 2023-10-03T19:20:52.956 INFO:teuthology.orchestra.run.smithi045.stdout: -6281> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_776 [2,head] auth (dversion lock) v=5554 ino=0x100000004fd state=1073741824 0x55cf624b1680] [inode 0x100000004fd [2,head] /dc-dir/dc-file_776 auth v5554 s=3 n(v0 rc2023-10-03T19:13:43.880780+0000 b3 1=1+0) (iversion lock) 0x55cf624b5b80] 2023-10-03T19:20:52.956 INFO:teuthology.orchestra.run.smithi045.stdout: -6280> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004fd [2,head] #100000004fd auth v5554 s=3 n(v0 rc2023-10-03T19:13:43.880780+0000 b3 1=1+0) (iversion lock) 0x55cf624b5b80] 2023-10-03T19:20:52.956 INFO:teuthology.orchestra.run.smithi045.stdout: -6279> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_776 [2,head] auth NULL (dversion lock) v=5554 ino=(nil) state=1073741824 0x55cf624b1680] 2023-10-03T19:20:52.956 INFO:teuthology.orchestra.run.smithi045.stdout: -6278> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_775 [2,head] auth (dversion lock) v=5552 ino=0x100000004fc state=1073741824 0x55cf624b1400] 2023-10-03T19:20:52.956 INFO:teuthology.orchestra.run.smithi045.stdout: -6277> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.956 INFO:teuthology.orchestra.run.smithi045.stdout: -6276> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004fc [2,head] /dc-dir/dc-file_775 auth v5552 s=3 n(v0 rc2023-10-03T19:13:43.868357+0000 b3 1=1+0) (iversion lock) 0x55cf624b5600] 2023-10-03T19:20:52.956 INFO:teuthology.orchestra.run.smithi045.stdout: -6275> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_775 [2,head] auth (dversion lock) v=5552 ino=0x100000004fc state=1073741824 0x55cf624b1400] [inode 0x100000004fc [2,head] /dc-dir/dc-file_775 auth v5552 s=3 n(v0 rc2023-10-03T19:13:43.868357+0000 b3 1=1+0) (iversion lock) 0x55cf624b5600] 2023-10-03T19:20:52.956 INFO:teuthology.orchestra.run.smithi045.stdout: -6274> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004fc [2,head] #100000004fc auth v5552 s=3 n(v0 rc2023-10-03T19:13:43.868357+0000 b3 1=1+0) (iversion lock) 0x55cf624b5600] 2023-10-03T19:20:52.956 INFO:teuthology.orchestra.run.smithi045.stdout: -6273> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_775 [2,head] auth NULL (dversion lock) v=5552 ino=(nil) state=1073741824 0x55cf624b1400] 2023-10-03T19:20:52.957 INFO:teuthology.orchestra.run.smithi045.stdout: -6272> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_774 [2,head] auth (dversion lock) v=5550 ino=0x100000004fb state=1073741824 0x55cf624b1180] 2023-10-03T19:20:52.957 INFO:teuthology.orchestra.run.smithi045.stdout: -6271> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.957 INFO:teuthology.orchestra.run.smithi045.stdout: -6270> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004fb [2,head] /dc-dir/dc-file_774 auth v5550 s=3 n(v0 rc2023-10-03T19:13:43.856261+0000 b3 1=1+0) (iversion lock) 0x55cf624b5080] 2023-10-03T19:20:52.957 INFO:teuthology.orchestra.run.smithi045.stdout: -6269> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_774 [2,head] auth (dversion lock) v=5550 ino=0x100000004fb state=1073741824 0x55cf624b1180] [inode 0x100000004fb [2,head] /dc-dir/dc-file_774 auth v5550 s=3 n(v0 rc2023-10-03T19:13:43.856261+0000 b3 1=1+0) (iversion lock) 0x55cf624b5080] 2023-10-03T19:20:52.957 INFO:teuthology.orchestra.run.smithi045.stdout: -6268> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004fb [2,head] #100000004fb auth v5550 s=3 n(v0 rc2023-10-03T19:13:43.856261+0000 b3 1=1+0) (iversion lock) 0x55cf624b5080] 2023-10-03T19:20:52.957 INFO:teuthology.orchestra.run.smithi045.stdout: -6267> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_774 [2,head] auth NULL (dversion lock) v=5550 ino=(nil) state=1073741824 0x55cf624b1180] 2023-10-03T19:20:52.957 INFO:teuthology.orchestra.run.smithi045.stdout: -6266> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_773 [2,head] auth (dversion lock) v=5548 ino=0x100000004fa state=1073741824 0x55cf624b0f00] 2023-10-03T19:20:52.957 INFO:teuthology.orchestra.run.smithi045.stdout: -6265> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.957 INFO:teuthology.orchestra.run.smithi045.stdout: -6264> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004fa [2,head] /dc-dir/dc-file_773 auth v5548 s=3 n(v0 rc2023-10-03T19:13:43.844770+0000 b3 1=1+0) (iversion lock) 0x55cf624b4b00] 2023-10-03T19:20:52.957 INFO:teuthology.orchestra.run.smithi045.stdout: -6263> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_773 [2,head] auth (dversion lock) v=5548 ino=0x100000004fa state=1073741824 0x55cf624b0f00] [inode 0x100000004fa [2,head] /dc-dir/dc-file_773 auth v5548 s=3 n(v0 rc2023-10-03T19:13:43.844770+0000 b3 1=1+0) (iversion lock) 0x55cf624b4b00] 2023-10-03T19:20:52.958 INFO:teuthology.orchestra.run.smithi045.stdout: -6262> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004fa [2,head] #100000004fa auth v5548 s=3 n(v0 rc2023-10-03T19:13:43.844770+0000 b3 1=1+0) (iversion lock) 0x55cf624b4b00] 2023-10-03T19:20:52.958 INFO:teuthology.orchestra.run.smithi045.stdout: -6261> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_773 [2,head] auth NULL (dversion lock) v=5548 ino=(nil) state=1073741824 0x55cf624b0f00] 2023-10-03T19:20:52.958 INFO:teuthology.orchestra.run.smithi045.stdout: -6260> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_772 [2,head] auth (dversion lock) v=5546 ino=0x100000004f9 state=1073741824 0x55cf624b0c80] 2023-10-03T19:20:52.958 INFO:teuthology.orchestra.run.smithi045.stdout: -6259> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.958 INFO:teuthology.orchestra.run.smithi045.stdout: -6258> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004f9 [2,head] /dc-dir/dc-file_772 auth v5546 s=3 n(v0 rc2023-10-03T19:13:43.832622+0000 b3 1=1+0) (iversion lock) 0x55cf624b4580] 2023-10-03T19:20:52.958 INFO:teuthology.orchestra.run.smithi045.stdout: -6257> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_772 [2,head] auth (dversion lock) v=5546 ino=0x100000004f9 state=1073741824 0x55cf624b0c80] [inode 0x100000004f9 [2,head] /dc-dir/dc-file_772 auth v5546 s=3 n(v0 rc2023-10-03T19:13:43.832622+0000 b3 1=1+0) (iversion lock) 0x55cf624b4580] 2023-10-03T19:20:52.958 INFO:teuthology.orchestra.run.smithi045.stdout: -6256> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004f9 [2,head] #100000004f9 auth v5546 s=3 n(v0 rc2023-10-03T19:13:43.832622+0000 b3 1=1+0) (iversion lock) 0x55cf624b4580] 2023-10-03T19:20:52.958 INFO:teuthology.orchestra.run.smithi045.stdout: -6255> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_772 [2,head] auth NULL (dversion lock) v=5546 ino=(nil) state=1073741824 0x55cf624b0c80] 2023-10-03T19:20:52.958 INFO:teuthology.orchestra.run.smithi045.stdout: -6254> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_771 [2,head] auth (dversion lock) v=5544 ino=0x100000004f8 state=1073741824 0x55cf624b0a00] 2023-10-03T19:20:52.958 INFO:teuthology.orchestra.run.smithi045.stdout: -6253> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.959 INFO:teuthology.orchestra.run.smithi045.stdout: -6252> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004f8 [2,head] /dc-dir/dc-file_771 auth v5544 s=3 n(v0 rc2023-10-03T19:13:43.821355+0000 b3 1=1+0) (iversion lock) 0x55cf624b4000] 2023-10-03T19:20:52.959 INFO:teuthology.orchestra.run.smithi045.stdout: -6251> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_771 [2,head] auth (dversion lock) v=5544 ino=0x100000004f8 state=1073741824 0x55cf624b0a00] [inode 0x100000004f8 [2,head] /dc-dir/dc-file_771 auth v5544 s=3 n(v0 rc2023-10-03T19:13:43.821355+0000 b3 1=1+0) (iversion lock) 0x55cf624b4000] 2023-10-03T19:20:52.959 INFO:teuthology.orchestra.run.smithi045.stdout: -6250> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004f8 [2,head] #100000004f8 auth v5544 s=3 n(v0 rc2023-10-03T19:13:43.821355+0000 b3 1=1+0) (iversion lock) 0x55cf624b4000] 2023-10-03T19:20:52.959 INFO:teuthology.orchestra.run.smithi045.stdout: -6249> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_771 [2,head] auth NULL (dversion lock) v=5544 ino=(nil) state=1073741824 0x55cf624b0a00] 2023-10-03T19:20:52.959 INFO:teuthology.orchestra.run.smithi045.stdout: -6248> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_770 [2,head] auth (dversion lock) v=5542 ino=0x100000004f7 state=1073741824 0x55cf624b0780] 2023-10-03T19:20:52.959 INFO:teuthology.orchestra.run.smithi045.stdout: -6247> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.959 INFO:teuthology.orchestra.run.smithi045.stdout: -6246> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004f7 [2,head] /dc-dir/dc-file_770 auth v5542 s=3 n(v0 rc2023-10-03T19:13:43.810090+0000 b3 1=1+0) (iversion lock) 0x55cf624ad700] 2023-10-03T19:20:52.959 INFO:teuthology.orchestra.run.smithi045.stdout: -6245> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_770 [2,head] auth (dversion lock) v=5542 ino=0x100000004f7 state=1073741824 0x55cf624b0780] [inode 0x100000004f7 [2,head] /dc-dir/dc-file_770 auth v5542 s=3 n(v0 rc2023-10-03T19:13:43.810090+0000 b3 1=1+0) (iversion lock) 0x55cf624ad700] 2023-10-03T19:20:52.959 INFO:teuthology.orchestra.run.smithi045.stdout: -6244> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004f7 [2,head] #100000004f7 auth v5542 s=3 n(v0 rc2023-10-03T19:13:43.810090+0000 b3 1=1+0) (iversion lock) 0x55cf624ad700] 2023-10-03T19:20:52.959 INFO:teuthology.orchestra.run.smithi045.stdout: -6243> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_770 [2,head] auth NULL (dversion lock) v=5542 ino=(nil) state=1073741824 0x55cf624b0780] 2023-10-03T19:20:52.959 INFO:teuthology.orchestra.run.smithi045.stdout: -6242> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_769 [2,head] auth (dversion lock) v=5540 ino=0x100000004f6 state=1073741824 0x55cf624b0500] 2023-10-03T19:20:52.960 INFO:teuthology.orchestra.run.smithi045.stdout: -6241> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.960 INFO:teuthology.orchestra.run.smithi045.stdout: -6240> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004f6 [2,head] /dc-dir/dc-file_769 auth v5540 s=3 n(v0 rc2023-10-03T19:13:43.798954+0000 b3 1=1+0) (iversion lock) 0x55cf624ad180] 2023-10-03T19:20:52.960 INFO:teuthology.orchestra.run.smithi045.stdout: -6239> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_769 [2,head] auth (dversion lock) v=5540 ino=0x100000004f6 state=1073741824 0x55cf624b0500] [inode 0x100000004f6 [2,head] /dc-dir/dc-file_769 auth v5540 s=3 n(v0 rc2023-10-03T19:13:43.798954+0000 b3 1=1+0) (iversion lock) 0x55cf624ad180] 2023-10-03T19:20:52.960 INFO:teuthology.orchestra.run.smithi045.stdout: -6238> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004f6 [2,head] #100000004f6 auth v5540 s=3 n(v0 rc2023-10-03T19:13:43.798954+0000 b3 1=1+0) (iversion lock) 0x55cf624ad180] 2023-10-03T19:20:52.960 INFO:teuthology.orchestra.run.smithi045.stdout: -6237> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_769 [2,head] auth NULL (dversion lock) v=5540 ino=(nil) state=1073741824 0x55cf624b0500] 2023-10-03T19:20:52.960 INFO:teuthology.orchestra.run.smithi045.stdout: -6236> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_768 [2,head] auth (dversion lock) v=5538 ino=0x100000004f5 state=1073741824 0x55cf624b0280] 2023-10-03T19:20:52.960 INFO:teuthology.orchestra.run.smithi045.stdout: -6235> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.960 INFO:teuthology.orchestra.run.smithi045.stdout: -6234> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004f5 [2,head] /dc-dir/dc-file_768 auth v5538 s=3 n(v0 rc2023-10-03T19:13:43.787621+0000 b3 1=1+0) (iversion lock) 0x55cf624acc00] 2023-10-03T19:20:52.960 INFO:teuthology.orchestra.run.smithi045.stdout: -6233> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_768 [2,head] auth (dversion lock) v=5538 ino=0x100000004f5 state=1073741824 0x55cf624b0280] [inode 0x100000004f5 [2,head] /dc-dir/dc-file_768 auth v5538 s=3 n(v0 rc2023-10-03T19:13:43.787621+0000 b3 1=1+0) (iversion lock) 0x55cf624acc00] 2023-10-03T19:20:52.960 INFO:teuthology.orchestra.run.smithi045.stdout: -6232> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004f5 [2,head] #100000004f5 auth v5538 s=3 n(v0 rc2023-10-03T19:13:43.787621+0000 b3 1=1+0) (iversion lock) 0x55cf624acc00] 2023-10-03T19:20:52.961 INFO:teuthology.orchestra.run.smithi045.stdout: -6231> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_768 [2,head] auth NULL (dversion lock) v=5538 ino=(nil) state=1073741824 0x55cf624b0280] 2023-10-03T19:20:52.961 INFO:teuthology.orchestra.run.smithi045.stdout: -6230> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_767 [2,head] auth (dversion lock) v=5536 ino=0x100000004f4 state=1073741824 0x55cf624b0000] 2023-10-03T19:20:52.961 INFO:teuthology.orchestra.run.smithi045.stdout: -6229> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.961 INFO:teuthology.orchestra.run.smithi045.stdout: -6228> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004f4 [2,head] /dc-dir/dc-file_767 auth v5536 s=3 n(v0 rc2023-10-03T19:13:43.776543+0000 b3 1=1+0) (iversion lock) 0x55cf624ac680] 2023-10-03T19:20:52.961 INFO:teuthology.orchestra.run.smithi045.stdout: -6227> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_767 [2,head] auth (dversion lock) v=5536 ino=0x100000004f4 state=1073741824 0x55cf624b0000] [inode 0x100000004f4 [2,head] /dc-dir/dc-file_767 auth v5536 s=3 n(v0 rc2023-10-03T19:13:43.776543+0000 b3 1=1+0) (iversion lock) 0x55cf624ac680] 2023-10-03T19:20:52.961 INFO:teuthology.orchestra.run.smithi045.stdout: -6226> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004f4 [2,head] #100000004f4 auth v5536 s=3 n(v0 rc2023-10-03T19:13:43.776543+0000 b3 1=1+0) (iversion lock) 0x55cf624ac680] 2023-10-03T19:20:52.961 INFO:teuthology.orchestra.run.smithi045.stdout: -6225> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_767 [2,head] auth NULL (dversion lock) v=5536 ino=(nil) state=1073741824 0x55cf624b0000] 2023-10-03T19:20:52.961 INFO:teuthology.orchestra.run.smithi045.stdout: -6224> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_766 [2,head] auth (dversion lock) v=5534 ino=0x100000004f3 state=1073741824 0x55cf62495b80] 2023-10-03T19:20:52.961 INFO:teuthology.orchestra.run.smithi045.stdout: -6223> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.961 INFO:teuthology.orchestra.run.smithi045.stdout: -6222> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004f3 [2,head] /dc-dir/dc-file_766 auth v5534 s=3 n(v0 rc2023-10-03T19:13:43.765095+0000 b3 1=1+0) (iversion lock) 0x55cf624ac100] 2023-10-03T19:20:52.962 INFO:teuthology.orchestra.run.smithi045.stdout: -6221> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_766 [2,head] auth (dversion lock) v=5534 ino=0x100000004f3 state=1073741824 0x55cf62495b80] [inode 0x100000004f3 [2,head] /dc-dir/dc-file_766 auth v5534 s=3 n(v0 rc2023-10-03T19:13:43.765095+0000 b3 1=1+0) (iversion lock) 0x55cf624ac100] 2023-10-03T19:20:52.962 INFO:teuthology.orchestra.run.smithi045.stdout: -6220> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004f3 [2,head] #100000004f3 auth v5534 s=3 n(v0 rc2023-10-03T19:13:43.765095+0000 b3 1=1+0) (iversion lock) 0x55cf624ac100] 2023-10-03T19:20:52.962 INFO:teuthology.orchestra.run.smithi045.stdout: -6219> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_766 [2,head] auth NULL (dversion lock) v=5534 ino=(nil) state=1073741824 0x55cf62495b80] 2023-10-03T19:20:52.962 INFO:teuthology.orchestra.run.smithi045.stdout: -6218> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_765 [2,head] auth (dversion lock) v=5532 ino=0x100000004f2 state=1073741824 0x55cf62495900] 2023-10-03T19:20:52.962 INFO:teuthology.orchestra.run.smithi045.stdout: -6217> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.962 INFO:teuthology.orchestra.run.smithi045.stdout: -6216> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004f2 [2,head] /dc-dir/dc-file_765 auth v5532 s=3 n(v0 rc2023-10-03T19:13:43.753129+0000 b3 1=1+0) (iversion lock) 0x55cf624abb80] 2023-10-03T19:20:52.962 INFO:teuthology.orchestra.run.smithi045.stdout: -6215> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_765 [2,head] auth (dversion lock) v=5532 ino=0x100000004f2 state=1073741824 0x55cf62495900] [inode 0x100000004f2 [2,head] /dc-dir/dc-file_765 auth v5532 s=3 n(v0 rc2023-10-03T19:13:43.753129+0000 b3 1=1+0) (iversion lock) 0x55cf624abb80] 2023-10-03T19:20:52.962 INFO:teuthology.orchestra.run.smithi045.stdout: -6214> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004f2 [2,head] #100000004f2 auth v5532 s=3 n(v0 rc2023-10-03T19:13:43.753129+0000 b3 1=1+0) (iversion lock) 0x55cf624abb80] 2023-10-03T19:20:52.962 INFO:teuthology.orchestra.run.smithi045.stdout: -6213> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_765 [2,head] auth NULL (dversion lock) v=5532 ino=(nil) state=1073741824 0x55cf62495900] 2023-10-03T19:20:52.962 INFO:teuthology.orchestra.run.smithi045.stdout: -6212> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_764 [2,head] auth (dversion lock) v=5530 ino=0x100000004f1 state=1073741824 0x55cf62495680] 2023-10-03T19:20:52.963 INFO:teuthology.orchestra.run.smithi045.stdout: -6211> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.963 INFO:teuthology.orchestra.run.smithi045.stdout: -6210> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004f1 [2,head] /dc-dir/dc-file_764 auth v5530 s=3 n(v0 rc2023-10-03T19:13:43.741541+0000 b3 1=1+0) (iversion lock) 0x55cf624ab600] 2023-10-03T19:20:52.963 INFO:teuthology.orchestra.run.smithi045.stdout: -6209> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_764 [2,head] auth (dversion lock) v=5530 ino=0x100000004f1 state=1073741824 0x55cf62495680] [inode 0x100000004f1 [2,head] /dc-dir/dc-file_764 auth v5530 s=3 n(v0 rc2023-10-03T19:13:43.741541+0000 b3 1=1+0) (iversion lock) 0x55cf624ab600] 2023-10-03T19:20:52.963 INFO:teuthology.orchestra.run.smithi045.stdout: -6208> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004f1 [2,head] #100000004f1 auth v5530 s=3 n(v0 rc2023-10-03T19:13:43.741541+0000 b3 1=1+0) (iversion lock) 0x55cf624ab600] 2023-10-03T19:20:52.963 INFO:teuthology.orchestra.run.smithi045.stdout: -6207> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_764 [2,head] auth NULL (dversion lock) v=5530 ino=(nil) state=1073741824 0x55cf62495680] 2023-10-03T19:20:52.963 INFO:teuthology.orchestra.run.smithi045.stdout: -6206> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_763 [2,head] auth (dversion lock) v=5528 ino=0x100000004f0 state=1073741824 0x55cf62495400] 2023-10-03T19:20:52.963 INFO:teuthology.orchestra.run.smithi045.stdout: -6205> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.963 INFO:teuthology.orchestra.run.smithi045.stdout: -6204> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004f0 [2,head] /dc-dir/dc-file_763 auth v5528 s=3 n(v0 rc2023-10-03T19:13:43.729578+0000 b3 1=1+0) (iversion lock) 0x55cf624ab080] 2023-10-03T19:20:52.963 INFO:teuthology.orchestra.run.smithi045.stdout: -6203> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_763 [2,head] auth (dversion lock) v=5528 ino=0x100000004f0 state=1073741824 0x55cf62495400] [inode 0x100000004f0 [2,head] /dc-dir/dc-file_763 auth v5528 s=3 n(v0 rc2023-10-03T19:13:43.729578+0000 b3 1=1+0) (iversion lock) 0x55cf624ab080] 2023-10-03T19:20:52.964 INFO:teuthology.orchestra.run.smithi045.stdout: -6202> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004f0 [2,head] #100000004f0 auth v5528 s=3 n(v0 rc2023-10-03T19:13:43.729578+0000 b3 1=1+0) (iversion lock) 0x55cf624ab080] 2023-10-03T19:20:52.964 INFO:teuthology.orchestra.run.smithi045.stdout: -6201> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_763 [2,head] auth NULL (dversion lock) v=5528 ino=(nil) state=1073741824 0x55cf62495400] 2023-10-03T19:20:52.964 INFO:teuthology.orchestra.run.smithi045.stdout: -6200> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_762 [2,head] auth (dversion lock) v=5526 ino=0x100000004ef state=1073741824 0x55cf62495180] 2023-10-03T19:20:52.964 INFO:teuthology.orchestra.run.smithi045.stdout: -6199> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.964 INFO:teuthology.orchestra.run.smithi045.stdout: -6198> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004ef [2,head] /dc-dir/dc-file_762 auth v5526 s=3 n(v0 rc2023-10-03T19:13:43.717795+0000 b3 1=1+0) (iversion lock) 0x55cf624aab00] 2023-10-03T19:20:52.964 INFO:teuthology.orchestra.run.smithi045.stdout: -6197> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_762 [2,head] auth (dversion lock) v=5526 ino=0x100000004ef state=1073741824 0x55cf62495180] [inode 0x100000004ef [2,head] /dc-dir/dc-file_762 auth v5526 s=3 n(v0 rc2023-10-03T19:13:43.717795+0000 b3 1=1+0) (iversion lock) 0x55cf624aab00] 2023-10-03T19:20:52.964 INFO:teuthology.orchestra.run.smithi045.stdout: -6196> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004ef [2,head] #100000004ef auth v5526 s=3 n(v0 rc2023-10-03T19:13:43.717795+0000 b3 1=1+0) (iversion lock) 0x55cf624aab00] 2023-10-03T19:20:52.964 INFO:teuthology.orchestra.run.smithi045.stdout: -6195> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_762 [2,head] auth NULL (dversion lock) v=5526 ino=(nil) state=1073741824 0x55cf62495180] 2023-10-03T19:20:52.964 INFO:teuthology.orchestra.run.smithi045.stdout: -6194> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_761 [2,head] auth (dversion lock) v=5524 ino=0x100000004ee state=1073741824 0x55cf62494f00] 2023-10-03T19:20:52.964 INFO:teuthology.orchestra.run.smithi045.stdout: -6193> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.964 INFO:teuthology.orchestra.run.smithi045.stdout: -6192> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004ee [2,head] /dc-dir/dc-file_761 auth v5524 s=3 n(v0 rc2023-10-03T19:13:43.706520+0000 b3 1=1+0) (iversion lock) 0x55cf624aa580] 2023-10-03T19:20:52.965 INFO:teuthology.orchestra.run.smithi045.stdout: -6191> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_761 [2,head] auth (dversion lock) v=5524 ino=0x100000004ee state=1073741824 0x55cf62494f00] [inode 0x100000004ee [2,head] /dc-dir/dc-file_761 auth v5524 s=3 n(v0 rc2023-10-03T19:13:43.706520+0000 b3 1=1+0) (iversion lock) 0x55cf624aa580] 2023-10-03T19:20:52.965 INFO:teuthology.orchestra.run.smithi045.stdout: -6190> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004ee [2,head] #100000004ee auth v5524 s=3 n(v0 rc2023-10-03T19:13:43.706520+0000 b3 1=1+0) (iversion lock) 0x55cf624aa580] 2023-10-03T19:20:52.965 INFO:teuthology.orchestra.run.smithi045.stdout: -6189> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_761 [2,head] auth NULL (dversion lock) v=5524 ino=(nil) state=1073741824 0x55cf62494f00] 2023-10-03T19:20:52.965 INFO:teuthology.orchestra.run.smithi045.stdout: -6188> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_760 [2,head] auth (dversion lock) v=5522 ino=0x100000004ed state=1073741824 0x55cf62494c80] 2023-10-03T19:20:52.965 INFO:teuthology.orchestra.run.smithi045.stdout: -6187> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.965 INFO:teuthology.orchestra.run.smithi045.stdout: -6186> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004ed [2,head] /dc-dir/dc-file_760 auth v5522 s=3 n(v0 rc2023-10-03T19:13:43.694570+0000 b3 1=1+0) (iversion lock) 0x55cf624aa000] 2023-10-03T19:20:52.965 INFO:teuthology.orchestra.run.smithi045.stdout: -6185> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_760 [2,head] auth (dversion lock) v=5522 ino=0x100000004ed state=1073741824 0x55cf62494c80] [inode 0x100000004ed [2,head] /dc-dir/dc-file_760 auth v5522 s=3 n(v0 rc2023-10-03T19:13:43.694570+0000 b3 1=1+0) (iversion lock) 0x55cf624aa000] 2023-10-03T19:20:52.965 INFO:teuthology.orchestra.run.smithi045.stdout: -6184> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004ed [2,head] #100000004ed auth v5522 s=3 n(v0 rc2023-10-03T19:13:43.694570+0000 b3 1=1+0) (iversion lock) 0x55cf624aa000] 2023-10-03T19:20:52.965 INFO:teuthology.orchestra.run.smithi045.stdout: -6183> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_760 [2,head] auth NULL (dversion lock) v=5522 ino=(nil) state=1073741824 0x55cf62494c80] 2023-10-03T19:20:52.965 INFO:teuthology.orchestra.run.smithi045.stdout: -6182> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_759 [2,head] auth (dversion lock) v=5520 ino=0x100000004ec state=1073741824 0x55cf62494a00] 2023-10-03T19:20:52.965 INFO:teuthology.orchestra.run.smithi045.stdout: -6181> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.966 INFO:teuthology.orchestra.run.smithi045.stdout: -6180> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004ec [2,head] /dc-dir/dc-file_759 auth v5520 s=3 n(v0 rc2023-10-03T19:13:43.683273+0000 b3 1=1+0) (iversion lock) 0x55cf6247d700] 2023-10-03T19:20:52.966 INFO:teuthology.orchestra.run.smithi045.stdout: -6179> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_759 [2,head] auth (dversion lock) v=5520 ino=0x100000004ec state=1073741824 0x55cf62494a00] [inode 0x100000004ec [2,head] /dc-dir/dc-file_759 auth v5520 s=3 n(v0 rc2023-10-03T19:13:43.683273+0000 b3 1=1+0) (iversion lock) 0x55cf6247d700] 2023-10-03T19:20:52.966 INFO:teuthology.orchestra.run.smithi045.stdout: -6178> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004ec [2,head] #100000004ec auth v5520 s=3 n(v0 rc2023-10-03T19:13:43.683273+0000 b3 1=1+0) (iversion lock) 0x55cf6247d700] 2023-10-03T19:20:52.966 INFO:teuthology.orchestra.run.smithi045.stdout: -6177> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_759 [2,head] auth NULL (dversion lock) v=5520 ino=(nil) state=1073741824 0x55cf62494a00] 2023-10-03T19:20:52.966 INFO:teuthology.orchestra.run.smithi045.stdout: -6176> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_758 [2,head] auth (dversion lock) v=5518 ino=0x100000004eb state=1073741824 0x55cf62494780] 2023-10-03T19:20:52.966 INFO:teuthology.orchestra.run.smithi045.stdout: -6175> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.966 INFO:teuthology.orchestra.run.smithi045.stdout: -6174> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004eb [2,head] /dc-dir/dc-file_758 auth v5518 s=3 n(v0 rc2023-10-03T19:13:43.671597+0000 b3 1=1+0) (iversion lock) 0x55cf6247d180] 2023-10-03T19:20:52.966 INFO:teuthology.orchestra.run.smithi045.stdout: -6173> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_758 [2,head] auth (dversion lock) v=5518 ino=0x100000004eb state=1073741824 0x55cf62494780] [inode 0x100000004eb [2,head] /dc-dir/dc-file_758 auth v5518 s=3 n(v0 rc2023-10-03T19:13:43.671597+0000 b3 1=1+0) (iversion lock) 0x55cf6247d180] 2023-10-03T19:20:52.966 INFO:teuthology.orchestra.run.smithi045.stdout: -6172> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004eb [2,head] #100000004eb auth v5518 s=3 n(v0 rc2023-10-03T19:13:43.671597+0000 b3 1=1+0) (iversion lock) 0x55cf6247d180] 2023-10-03T19:20:52.967 INFO:teuthology.orchestra.run.smithi045.stdout: -6171> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_758 [2,head] auth NULL (dversion lock) v=5518 ino=(nil) state=1073741824 0x55cf62494780] 2023-10-03T19:20:52.967 INFO:teuthology.orchestra.run.smithi045.stdout: -6170> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_757 [2,head] auth (dversion lock) v=5516 ino=0x100000004ea state=1073741824 0x55cf62494500] 2023-10-03T19:20:52.967 INFO:teuthology.orchestra.run.smithi045.stdout: -6169> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.967 INFO:teuthology.orchestra.run.smithi045.stdout: -6168> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004ea [2,head] /dc-dir/dc-file_757 auth v5516 s=3 n(v0 rc2023-10-03T19:13:43.659752+0000 b3 1=1+0) (iversion lock) 0x55cf6247cc00] 2023-10-03T19:20:52.967 INFO:teuthology.orchestra.run.smithi045.stdout: -6167> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_757 [2,head] auth (dversion lock) v=5516 ino=0x100000004ea state=1073741824 0x55cf62494500] [inode 0x100000004ea [2,head] /dc-dir/dc-file_757 auth v5516 s=3 n(v0 rc2023-10-03T19:13:43.659752+0000 b3 1=1+0) (iversion lock) 0x55cf6247cc00] 2023-10-03T19:20:52.967 INFO:teuthology.orchestra.run.smithi045.stdout: -6166> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004ea [2,head] #100000004ea auth v5516 s=3 n(v0 rc2023-10-03T19:13:43.659752+0000 b3 1=1+0) (iversion lock) 0x55cf6247cc00] 2023-10-03T19:20:52.967 INFO:teuthology.orchestra.run.smithi045.stdout: -6165> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_757 [2,head] auth NULL (dversion lock) v=5516 ino=(nil) state=1073741824 0x55cf62494500] 2023-10-03T19:20:52.967 INFO:teuthology.orchestra.run.smithi045.stdout: -6164> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_756 [2,head] auth (dversion lock) v=5514 ino=0x100000004e9 state=1073741824 0x55cf62494280] 2023-10-03T19:20:52.967 INFO:teuthology.orchestra.run.smithi045.stdout: -6163> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.967 INFO:teuthology.orchestra.run.smithi045.stdout: -6162> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004e9 [2,head] /dc-dir/dc-file_756 auth v5514 s=3 n(v0 rc2023-10-03T19:13:43.647861+0000 b3 1=1+0) (iversion lock) 0x55cf6247c680] 2023-10-03T19:20:52.967 INFO:teuthology.orchestra.run.smithi045.stdout: -6161> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_756 [2,head] auth (dversion lock) v=5514 ino=0x100000004e9 state=1073741824 0x55cf62494280] [inode 0x100000004e9 [2,head] /dc-dir/dc-file_756 auth v5514 s=3 n(v0 rc2023-10-03T19:13:43.647861+0000 b3 1=1+0) (iversion lock) 0x55cf6247c680] 2023-10-03T19:20:52.968 INFO:teuthology.orchestra.run.smithi045.stdout: -6160> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004e9 [2,head] #100000004e9 auth v5514 s=3 n(v0 rc2023-10-03T19:13:43.647861+0000 b3 1=1+0) (iversion lock) 0x55cf6247c680] 2023-10-03T19:20:52.968 INFO:teuthology.orchestra.run.smithi045.stdout: -6159> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_756 [2,head] auth NULL (dversion lock) v=5514 ino=(nil) state=1073741824 0x55cf62494280] 2023-10-03T19:20:52.968 INFO:teuthology.orchestra.run.smithi045.stdout: -6158> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_755 [2,head] auth (dversion lock) v=5512 ino=0x100000004e8 state=1073741824 0x55cf62494000] 2023-10-03T19:20:52.968 INFO:teuthology.orchestra.run.smithi045.stdout: -6157> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.968 INFO:teuthology.orchestra.run.smithi045.stdout: -6156> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004e8 [2,head] /dc-dir/dc-file_755 auth v5512 s=3 n(v0 rc2023-10-03T19:13:43.635973+0000 b3 1=1+0) (iversion lock) 0x55cf6247c100] 2023-10-03T19:20:52.968 INFO:teuthology.orchestra.run.smithi045.stdout: -6155> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_755 [2,head] auth (dversion lock) v=5512 ino=0x100000004e8 state=1073741824 0x55cf62494000] [inode 0x100000004e8 [2,head] /dc-dir/dc-file_755 auth v5512 s=3 n(v0 rc2023-10-03T19:13:43.635973+0000 b3 1=1+0) (iversion lock) 0x55cf6247c100] 2023-10-03T19:20:52.968 INFO:teuthology.orchestra.run.smithi045.stdout: -6154> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004e8 [2,head] #100000004e8 auth v5512 s=3 n(v0 rc2023-10-03T19:13:43.635973+0000 b3 1=1+0) (iversion lock) 0x55cf6247c100] 2023-10-03T19:20:52.968 INFO:teuthology.orchestra.run.smithi045.stdout: -6153> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_755 [2,head] auth NULL (dversion lock) v=5512 ino=(nil) state=1073741824 0x55cf62494000] 2023-10-03T19:20:52.968 INFO:teuthology.orchestra.run.smithi045.stdout: -6152> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_754 [2,head] auth (dversion lock) v=5510 ino=0x100000004e7 state=1073741824 0x55cf62475b80] 2023-10-03T19:20:52.968 INFO:teuthology.orchestra.run.smithi045.stdout: -6151> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.969 INFO:teuthology.orchestra.run.smithi045.stdout: -6150> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004e7 [2,head] /dc-dir/dc-file_754 auth v5510 s=3 n(v0 rc2023-10-03T19:13:43.590761+0000 b3 1=1+0) (iversion lock) 0x55cf6247bb80] 2023-10-03T19:20:52.969 INFO:teuthology.orchestra.run.smithi045.stdout: -6149> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_754 [2,head] auth (dversion lock) v=5510 ino=0x100000004e7 state=1073741824 0x55cf62475b80] [inode 0x100000004e7 [2,head] /dc-dir/dc-file_754 auth v5510 s=3 n(v0 rc2023-10-03T19:13:43.590761+0000 b3 1=1+0) (iversion lock) 0x55cf6247bb80] 2023-10-03T19:20:52.969 INFO:teuthology.orchestra.run.smithi045.stdout: -6148> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004e7 [2,head] #100000004e7 auth v5510 s=3 n(v0 rc2023-10-03T19:13:43.590761+0000 b3 1=1+0) (iversion lock) 0x55cf6247bb80] 2023-10-03T19:20:52.969 INFO:teuthology.orchestra.run.smithi045.stdout: -6147> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_754 [2,head] auth NULL (dversion lock) v=5510 ino=(nil) state=1073741824 0x55cf62475b80] 2023-10-03T19:20:52.969 INFO:teuthology.orchestra.run.smithi045.stdout: -6146> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_753 [2,head] auth (dversion lock) v=5508 ino=0x100000004e6 state=1073741824 0x55cf62475900] 2023-10-03T19:20:52.969 INFO:teuthology.orchestra.run.smithi045.stdout: -6145> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.969 INFO:teuthology.orchestra.run.smithi045.stdout: -6144> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004e6 [2,head] /dc-dir/dc-file_753 auth v5508 s=3 n(v0 rc2023-10-03T19:13:43.495827+0000 b3 1=1+0) (iversion lock) 0x55cf6247b600] 2023-10-03T19:20:52.969 INFO:teuthology.orchestra.run.smithi045.stdout: -6143> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_753 [2,head] auth (dversion lock) v=5508 ino=0x100000004e6 state=1073741824 0x55cf62475900] [inode 0x100000004e6 [2,head] /dc-dir/dc-file_753 auth v5508 s=3 n(v0 rc2023-10-03T19:13:43.495827+0000 b3 1=1+0) (iversion lock) 0x55cf6247b600] 2023-10-03T19:20:52.969 INFO:teuthology.orchestra.run.smithi045.stdout: -6142> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004e6 [2,head] #100000004e6 auth v5508 s=3 n(v0 rc2023-10-03T19:13:43.495827+0000 b3 1=1+0) (iversion lock) 0x55cf6247b600] 2023-10-03T19:20:52.970 INFO:teuthology.orchestra.run.smithi045.stdout: -6141> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_753 [2,head] auth NULL (dversion lock) v=5508 ino=(nil) state=1073741824 0x55cf62475900] 2023-10-03T19:20:52.970 INFO:teuthology.orchestra.run.smithi045.stdout: -6140> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_752 [2,head] auth (dversion lock) v=5506 ino=0x100000004e5 state=1073741824 0x55cf62475680] 2023-10-03T19:20:52.970 INFO:teuthology.orchestra.run.smithi045.stdout: -6139> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.970 INFO:teuthology.orchestra.run.smithi045.stdout: -6138> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004e5 [2,head] /dc-dir/dc-file_752 auth v5506 s=3 n(v0 rc2023-10-03T19:13:43.484483+0000 b3 1=1+0) (iversion lock) 0x55cf6247b080] 2023-10-03T19:20:52.970 INFO:teuthology.orchestra.run.smithi045.stdout: -6137> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_752 [2,head] auth (dversion lock) v=5506 ino=0x100000004e5 state=1073741824 0x55cf62475680] [inode 0x100000004e5 [2,head] /dc-dir/dc-file_752 auth v5506 s=3 n(v0 rc2023-10-03T19:13:43.484483+0000 b3 1=1+0) (iversion lock) 0x55cf6247b080] 2023-10-03T19:20:52.970 INFO:teuthology.orchestra.run.smithi045.stdout: -6136> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004e5 [2,head] #100000004e5 auth v5506 s=3 n(v0 rc2023-10-03T19:13:43.484483+0000 b3 1=1+0) (iversion lock) 0x55cf6247b080] 2023-10-03T19:20:52.970 INFO:teuthology.orchestra.run.smithi045.stdout: -6135> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_752 [2,head] auth NULL (dversion lock) v=5506 ino=(nil) state=1073741824 0x55cf62475680] 2023-10-03T19:20:52.970 INFO:teuthology.orchestra.run.smithi045.stdout: -6134> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_751 [2,head] auth (dversion lock) v=5504 ino=0x100000004e4 state=1073741824 0x55cf62475400] 2023-10-03T19:20:52.970 INFO:teuthology.orchestra.run.smithi045.stdout: -6133> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.970 INFO:teuthology.orchestra.run.smithi045.stdout: -6132> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004e4 [2,head] /dc-dir/dc-file_751 auth v5504 s=3 n(v0 rc2023-10-03T19:13:43.473217+0000 b3 1=1+0) (iversion lock) 0x55cf6247ab00] 2023-10-03T19:20:52.970 INFO:teuthology.orchestra.run.smithi045.stdout: -6131> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_751 [2,head] auth (dversion lock) v=5504 ino=0x100000004e4 state=1073741824 0x55cf62475400] [inode 0x100000004e4 [2,head] /dc-dir/dc-file_751 auth v5504 s=3 n(v0 rc2023-10-03T19:13:43.473217+0000 b3 1=1+0) (iversion lock) 0x55cf6247ab00] 2023-10-03T19:20:52.971 INFO:teuthology.orchestra.run.smithi045.stdout: -6130> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004e4 [2,head] #100000004e4 auth v5504 s=3 n(v0 rc2023-10-03T19:13:43.473217+0000 b3 1=1+0) (iversion lock) 0x55cf6247ab00] 2023-10-03T19:20:52.971 INFO:teuthology.orchestra.run.smithi045.stdout: -6129> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_751 [2,head] auth NULL (dversion lock) v=5504 ino=(nil) state=1073741824 0x55cf62475400] 2023-10-03T19:20:52.971 INFO:teuthology.orchestra.run.smithi045.stdout: -6128> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_750 [2,head] auth (dversion lock) v=5502 ino=0x100000004e3 state=1073741824 0x55cf62475180] 2023-10-03T19:20:52.971 INFO:teuthology.orchestra.run.smithi045.stdout: -6127> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.971 INFO:teuthology.orchestra.run.smithi045.stdout: -6126> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004e3 [2,head] /dc-dir/dc-file_750 auth v5502 s=3 n(v0 rc2023-10-03T19:13:43.461790+0000 b3 1=1+0) (iversion lock) 0x55cf6247a580] 2023-10-03T19:20:52.971 INFO:teuthology.orchestra.run.smithi045.stdout: -6125> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_750 [2,head] auth (dversion lock) v=5502 ino=0x100000004e3 state=1073741824 0x55cf62475180] [inode 0x100000004e3 [2,head] /dc-dir/dc-file_750 auth v5502 s=3 n(v0 rc2023-10-03T19:13:43.461790+0000 b3 1=1+0) (iversion lock) 0x55cf6247a580] 2023-10-03T19:20:52.971 INFO:teuthology.orchestra.run.smithi045.stdout: -6124> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004e3 [2,head] #100000004e3 auth v5502 s=3 n(v0 rc2023-10-03T19:13:43.461790+0000 b3 1=1+0) (iversion lock) 0x55cf6247a580] 2023-10-03T19:20:52.971 INFO:teuthology.orchestra.run.smithi045.stdout: -6123> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_750 [2,head] auth NULL (dversion lock) v=5502 ino=(nil) state=1073741824 0x55cf62475180] 2023-10-03T19:20:52.971 INFO:teuthology.orchestra.run.smithi045.stdout: -6122> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_749 [2,head] auth (dversion lock) v=5500 ino=0x100000004e2 state=1073741824 0x55cf62474f00] 2023-10-03T19:20:52.971 INFO:teuthology.orchestra.run.smithi045.stdout: -6121> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.971 INFO:teuthology.orchestra.run.smithi045.stdout: -6120> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004e2 [2,head] /dc-dir/dc-file_749 auth v5500 s=3 n(v0 rc2023-10-03T19:13:43.449985+0000 b3 1=1+0) (iversion lock) 0x55cf6247a000] 2023-10-03T19:20:52.972 INFO:teuthology.orchestra.run.smithi045.stdout: -6119> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_749 [2,head] auth (dversion lock) v=5500 ino=0x100000004e2 state=1073741824 0x55cf62474f00] [inode 0x100000004e2 [2,head] /dc-dir/dc-file_749 auth v5500 s=3 n(v0 rc2023-10-03T19:13:43.449985+0000 b3 1=1+0) (iversion lock) 0x55cf6247a000] 2023-10-03T19:20:52.972 INFO:teuthology.orchestra.run.smithi045.stdout: -6118> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004e2 [2,head] #100000004e2 auth v5500 s=3 n(v0 rc2023-10-03T19:13:43.449985+0000 b3 1=1+0) (iversion lock) 0x55cf6247a000] 2023-10-03T19:20:52.972 INFO:teuthology.orchestra.run.smithi045.stdout: -6117> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_749 [2,head] auth NULL (dversion lock) v=5500 ino=(nil) state=1073741824 0x55cf62474f00] 2023-10-03T19:20:52.972 INFO:teuthology.orchestra.run.smithi045.stdout: -6116> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_748 [2,head] auth (dversion lock) v=5498 ino=0x100000004e1 state=1073741824 0x55cf62474c80] 2023-10-03T19:20:52.972 INFO:teuthology.orchestra.run.smithi045.stdout: -6115> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.972 INFO:teuthology.orchestra.run.smithi045.stdout: -6114> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004e1 [2,head] /dc-dir/dc-file_748 auth v5498 s=3 n(v0 rc2023-10-03T19:13:43.437848+0000 b3 1=1+0) (iversion lock) 0x55cf62473700] 2023-10-03T19:20:52.972 INFO:teuthology.orchestra.run.smithi045.stdout: -6113> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_748 [2,head] auth (dversion lock) v=5498 ino=0x100000004e1 state=1073741824 0x55cf62474c80] [inode 0x100000004e1 [2,head] /dc-dir/dc-file_748 auth v5498 s=3 n(v0 rc2023-10-03T19:13:43.437848+0000 b3 1=1+0) (iversion lock) 0x55cf62473700] 2023-10-03T19:20:52.972 INFO:teuthology.orchestra.run.smithi045.stdout: -6112> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004e1 [2,head] #100000004e1 auth v5498 s=3 n(v0 rc2023-10-03T19:13:43.437848+0000 b3 1=1+0) (iversion lock) 0x55cf62473700] 2023-10-03T19:20:52.972 INFO:teuthology.orchestra.run.smithi045.stdout: -6111> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_748 [2,head] auth NULL (dversion lock) v=5498 ino=(nil) state=1073741824 0x55cf62474c80] 2023-10-03T19:20:52.973 INFO:teuthology.orchestra.run.smithi045.stdout: -6110> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_747 [2,head] auth (dversion lock) v=5496 ino=0x100000004e0 state=1073741824 0x55cf62474a00] 2023-10-03T19:20:52.973 INFO:teuthology.orchestra.run.smithi045.stdout: -6109> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.973 INFO:teuthology.orchestra.run.smithi045.stdout: -6108> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004e0 [2,head] /dc-dir/dc-file_747 auth v5496 s=3 n(v0 rc2023-10-03T19:13:43.426421+0000 b3 1=1+0) (iversion lock) 0x55cf62473180] 2023-10-03T19:20:52.973 INFO:teuthology.orchestra.run.smithi045.stdout: -6107> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_747 [2,head] auth (dversion lock) v=5496 ino=0x100000004e0 state=1073741824 0x55cf62474a00] [inode 0x100000004e0 [2,head] /dc-dir/dc-file_747 auth v5496 s=3 n(v0 rc2023-10-03T19:13:43.426421+0000 b3 1=1+0) (iversion lock) 0x55cf62473180] 2023-10-03T19:20:52.973 INFO:teuthology.orchestra.run.smithi045.stdout: -6106> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004e0 [2,head] #100000004e0 auth v5496 s=3 n(v0 rc2023-10-03T19:13:43.426421+0000 b3 1=1+0) (iversion lock) 0x55cf62473180] 2023-10-03T19:20:52.973 INFO:teuthology.orchestra.run.smithi045.stdout: -6105> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_747 [2,head] auth NULL (dversion lock) v=5496 ino=(nil) state=1073741824 0x55cf62474a00] 2023-10-03T19:20:52.973 INFO:teuthology.orchestra.run.smithi045.stdout: -6104> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_746 [2,head] auth (dversion lock) v=5494 ino=0x100000004df state=1073741824 0x55cf62474780] 2023-10-03T19:20:52.973 INFO:teuthology.orchestra.run.smithi045.stdout: -6103> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.973 INFO:teuthology.orchestra.run.smithi045.stdout: -6102> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004df [2,head] /dc-dir/dc-file_746 auth v5494 s=3 n(v0 rc2023-10-03T19:13:43.415017+0000 b3 1=1+0) (iversion lock) 0x55cf62472c00] 2023-10-03T19:20:52.973 INFO:teuthology.orchestra.run.smithi045.stdout: -6101> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_746 [2,head] auth (dversion lock) v=5494 ino=0x100000004df state=1073741824 0x55cf62474780] [inode 0x100000004df [2,head] /dc-dir/dc-file_746 auth v5494 s=3 n(v0 rc2023-10-03T19:13:43.415017+0000 b3 1=1+0) (iversion lock) 0x55cf62472c00] 2023-10-03T19:20:52.973 INFO:teuthology.orchestra.run.smithi045.stdout: -6100> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004df [2,head] #100000004df auth v5494 s=3 n(v0 rc2023-10-03T19:13:43.415017+0000 b3 1=1+0) (iversion lock) 0x55cf62472c00] 2023-10-03T19:20:52.974 INFO:teuthology.orchestra.run.smithi045.stdout: -6099> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_746 [2,head] auth NULL (dversion lock) v=5494 ino=(nil) state=1073741824 0x55cf62474780] 2023-10-03T19:20:52.974 INFO:teuthology.orchestra.run.smithi045.stdout: -6098> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_745 [2,head] auth (dversion lock) v=5492 ino=0x100000004de state=1073741824 0x55cf62474500] 2023-10-03T19:20:52.974 INFO:teuthology.orchestra.run.smithi045.stdout: -6097> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.974 INFO:teuthology.orchestra.run.smithi045.stdout: -6096> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004de [2,head] /dc-dir/dc-file_745 auth v5492 s=3 n(v0 rc2023-10-03T19:13:43.404128+0000 b3 1=1+0) (iversion lock) 0x55cf62472680] 2023-10-03T19:20:52.974 INFO:teuthology.orchestra.run.smithi045.stdout: -6095> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_745 [2,head] auth (dversion lock) v=5492 ino=0x100000004de state=1073741824 0x55cf62474500] [inode 0x100000004de [2,head] /dc-dir/dc-file_745 auth v5492 s=3 n(v0 rc2023-10-03T19:13:43.404128+0000 b3 1=1+0) (iversion lock) 0x55cf62472680] 2023-10-03T19:20:52.974 INFO:teuthology.orchestra.run.smithi045.stdout: -6094> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004de [2,head] #100000004de auth v5492 s=3 n(v0 rc2023-10-03T19:13:43.404128+0000 b3 1=1+0) (iversion lock) 0x55cf62472680] 2023-10-03T19:20:52.974 INFO:teuthology.orchestra.run.smithi045.stdout: -6093> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_745 [2,head] auth NULL (dversion lock) v=5492 ino=(nil) state=1073741824 0x55cf62474500] 2023-10-03T19:20:52.974 INFO:teuthology.orchestra.run.smithi045.stdout: -6092> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_744 [2,head] auth (dversion lock) v=5490 ino=0x100000004dd state=1073741824 0x55cf62474280] 2023-10-03T19:20:52.974 INFO:teuthology.orchestra.run.smithi045.stdout: -6091> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.974 INFO:teuthology.orchestra.run.smithi045.stdout: -6090> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004dd [2,head] /dc-dir/dc-file_744 auth v5490 s=3 n(v0 rc2023-10-03T19:13:43.393523+0000 b3 1=1+0) (iversion lock) 0x55cf62472100] 2023-10-03T19:20:52.975 INFO:teuthology.orchestra.run.smithi045.stdout: -6089> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_744 [2,head] auth (dversion lock) v=5490 ino=0x100000004dd state=1073741824 0x55cf62474280] [inode 0x100000004dd [2,head] /dc-dir/dc-file_744 auth v5490 s=3 n(v0 rc2023-10-03T19:13:43.393523+0000 b3 1=1+0) (iversion lock) 0x55cf62472100] 2023-10-03T19:20:52.975 INFO:teuthology.orchestra.run.smithi045.stdout: -6088> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004dd [2,head] #100000004dd auth v5490 s=3 n(v0 rc2023-10-03T19:13:43.393523+0000 b3 1=1+0) (iversion lock) 0x55cf62472100] 2023-10-03T19:20:52.975 INFO:teuthology.orchestra.run.smithi045.stdout: -6087> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_744 [2,head] auth NULL (dversion lock) v=5490 ino=(nil) state=1073741824 0x55cf62474280] 2023-10-03T19:20:52.975 INFO:teuthology.orchestra.run.smithi045.stdout: -6086> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_743 [2,head] auth (dversion lock) v=5488 ino=0x100000004dc state=1073741824 0x55cf62474000] 2023-10-03T19:20:52.975 INFO:teuthology.orchestra.run.smithi045.stdout: -6085> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.975 INFO:teuthology.orchestra.run.smithi045.stdout: -6084> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004dc [2,head] /dc-dir/dc-file_743 auth v5488 s=3 n(v0 rc2023-10-03T19:13:43.383212+0000 b3 1=1+0) (iversion lock) 0x55cf62471b80] 2023-10-03T19:20:52.975 INFO:teuthology.orchestra.run.smithi045.stdout: -6083> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_743 [2,head] auth (dversion lock) v=5488 ino=0x100000004dc state=1073741824 0x55cf62474000] [inode 0x100000004dc [2,head] /dc-dir/dc-file_743 auth v5488 s=3 n(v0 rc2023-10-03T19:13:43.383212+0000 b3 1=1+0) (iversion lock) 0x55cf62471b80] 2023-10-03T19:20:52.975 INFO:teuthology.orchestra.run.smithi045.stdout: -6082> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004dc [2,head] #100000004dc auth v5488 s=3 n(v0 rc2023-10-03T19:13:43.383212+0000 b3 1=1+0) (iversion lock) 0x55cf62471b80] 2023-10-03T19:20:52.975 INFO:teuthology.orchestra.run.smithi045.stdout: -6081> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_743 [2,head] auth NULL (dversion lock) v=5488 ino=(nil) state=1073741824 0x55cf62474000] 2023-10-03T19:20:52.975 INFO:teuthology.orchestra.run.smithi045.stdout: -6080> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_742 [2,head] auth (dversion lock) v=5486 ino=0x100000004db state=1073741824 0x55cf6246db80] 2023-10-03T19:20:52.975 INFO:teuthology.orchestra.run.smithi045.stdout: -6079> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.976 INFO:teuthology.orchestra.run.smithi045.stdout: -6078> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004db [2,head] /dc-dir/dc-file_742 auth v5486 s=3 n(v0 rc2023-10-03T19:13:43.372133+0000 b3 1=1+0) (iversion lock) 0x55cf62471600] 2023-10-03T19:20:52.976 INFO:teuthology.orchestra.run.smithi045.stdout: -6077> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_742 [2,head] auth (dversion lock) v=5486 ino=0x100000004db state=1073741824 0x55cf6246db80] [inode 0x100000004db [2,head] /dc-dir/dc-file_742 auth v5486 s=3 n(v0 rc2023-10-03T19:13:43.372133+0000 b3 1=1+0) (iversion lock) 0x55cf62471600] 2023-10-03T19:20:52.976 INFO:teuthology.orchestra.run.smithi045.stdout: -6076> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004db [2,head] #100000004db auth v5486 s=3 n(v0 rc2023-10-03T19:13:43.372133+0000 b3 1=1+0) (iversion lock) 0x55cf62471600] 2023-10-03T19:20:52.976 INFO:teuthology.orchestra.run.smithi045.stdout: -6075> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_742 [2,head] auth NULL (dversion lock) v=5486 ino=(nil) state=1073741824 0x55cf6246db80] 2023-10-03T19:20:52.976 INFO:teuthology.orchestra.run.smithi045.stdout: -6074> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_741 [2,head] auth (dversion lock) v=5484 ino=0x100000004da state=1073741824 0x55cf6246d900] 2023-10-03T19:20:52.976 INFO:teuthology.orchestra.run.smithi045.stdout: -6073> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.976 INFO:teuthology.orchestra.run.smithi045.stdout: -6072> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004da [2,head] /dc-dir/dc-file_741 auth v5484 s=3 n(v0 rc2023-10-03T19:13:43.360589+0000 b3 1=1+0) (iversion lock) 0x55cf62471080] 2023-10-03T19:20:52.976 INFO:teuthology.orchestra.run.smithi045.stdout: -6071> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_741 [2,head] auth (dversion lock) v=5484 ino=0x100000004da state=1073741824 0x55cf6246d900] [inode 0x100000004da [2,head] /dc-dir/dc-file_741 auth v5484 s=3 n(v0 rc2023-10-03T19:13:43.360589+0000 b3 1=1+0) (iversion lock) 0x55cf62471080] 2023-10-03T19:20:52.976 INFO:teuthology.orchestra.run.smithi045.stdout: -6070> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004da [2,head] #100000004da auth v5484 s=3 n(v0 rc2023-10-03T19:13:43.360589+0000 b3 1=1+0) (iversion lock) 0x55cf62471080] 2023-10-03T19:20:52.976 INFO:teuthology.orchestra.run.smithi045.stdout: -6069> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_741 [2,head] auth NULL (dversion lock) v=5484 ino=(nil) state=1073741824 0x55cf6246d900] 2023-10-03T19:20:52.976 INFO:teuthology.orchestra.run.smithi045.stdout: -6068> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_740 [2,head] auth (dversion lock) v=5482 ino=0x100000004d9 state=1073741824 0x55cf6246d680] 2023-10-03T19:20:52.977 INFO:teuthology.orchestra.run.smithi045.stdout: -6067> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.977 INFO:teuthology.orchestra.run.smithi045.stdout: -6066> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004d9 [2,head] /dc-dir/dc-file_740 auth v5482 s=3 n(v0 rc2023-10-03T19:13:43.348525+0000 b3 1=1+0) (iversion lock) 0x55cf62470b00] 2023-10-03T19:20:52.977 INFO:teuthology.orchestra.run.smithi045.stdout: -6065> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_740 [2,head] auth (dversion lock) v=5482 ino=0x100000004d9 state=1073741824 0x55cf6246d680] [inode 0x100000004d9 [2,head] /dc-dir/dc-file_740 auth v5482 s=3 n(v0 rc2023-10-03T19:13:43.348525+0000 b3 1=1+0) (iversion lock) 0x55cf62470b00] 2023-10-03T19:20:52.977 INFO:teuthology.orchestra.run.smithi045.stdout: -6064> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004d9 [2,head] #100000004d9 auth v5482 s=3 n(v0 rc2023-10-03T19:13:43.348525+0000 b3 1=1+0) (iversion lock) 0x55cf62470b00] 2023-10-03T19:20:52.977 INFO:teuthology.orchestra.run.smithi045.stdout: -6063> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_740 [2,head] auth NULL (dversion lock) v=5482 ino=(nil) state=1073741824 0x55cf6246d680] 2023-10-03T19:20:52.977 INFO:teuthology.orchestra.run.smithi045.stdout: -6062> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_739 [2,head] auth (dversion lock) v=5480 ino=0x100000004d8 state=1073741824 0x55cf6246d400] 2023-10-03T19:20:52.977 INFO:teuthology.orchestra.run.smithi045.stdout: -6061> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:52.977 INFO:teuthology.orchestra.run.smithi045.stdout: -6060> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004d8 [2,head] /dc-dir/dc-file_739 auth v5480 s=3 n(v0 rc2023-10-03T19:13:43.337741+0000 b3 1=1+0) (iversion lock) 0x55cf62470580] 2023-10-03T19:20:52.977 INFO:teuthology.orchestra.run.smithi045.stdout: -6059> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_739 [2,head] auth (dversion lock) v=5480 ino=0x100000004d8 state=1073741824 0x55cf6246d400] [inode 0x100000004d8 [2,head] /dc-dir/dc-file_739 auth v5480 s=3 n(v0 rc2023-10-03T19:13:43.337741+0000 b3 1=1+0) (iversion lock) 0x55cf62470580] 2023-10-03T19:20:52.977 INFO:teuthology.orchestra.run.smithi045.stdout: -6058> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004d8 [2,head] #100000004d8 auth v5480 s=3 n(v0 rc2023-10-03T19:13:43.337741+0000 b3 1=1+0) (iversion lock) 0x55cf62470580] 2023-10-03T19:20:52.977 INFO:teuthology.orchestra.run.smithi045.stdout: -6057> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_739 [2,head] auth NULL (dversion lock) v=5480 ino=(nil) state=1073741824 0x55cf6246d400] 2023-10-03T19:20:52.978 INFO:teuthology.orchestra.run.smithi045.stdout: -6056> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_738 [2,head] auth (dversion lock) v=5478 ino=0x100000004d7 state=1073741824 0x55cf6246d180] 2023-10-03T19:20:53.037 INFO:teuthology.orchestra.run.smithi045.stdout: -6055> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.037 INFO:teuthology.orchestra.run.smithi045.stdout: -6054> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004d7 [2,head] /dc-dir/dc-file_738 auth v5478 s=3 n(v0 rc2023-10-03T19:13:43.326432+0000 b3 1=1+0) (iversion lock) 0x55cf62470000] 2023-10-03T19:20:53.037 INFO:teuthology.orchestra.run.smithi045.stdout: -6053> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_738 [2,head] auth (dversion lock) v=5478 ino=0x100000004d7 state=1073741824 0x55cf6246d180] [inode 0x100000004d7 [2,head] /dc-dir/dc-file_738 auth v5478 s=3 n(v0 rc2023-10-03T19:13:43.326432+0000 b3 1=1+0) (iversion lock) 0x55cf62470000] 2023-10-03T19:20:53.037 INFO:teuthology.orchestra.run.smithi045.stdout: -6052> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004d7 [2,head] #100000004d7 auth v5478 s=3 n(v0 rc2023-10-03T19:13:43.326432+0000 b3 1=1+0) (iversion lock) 0x55cf62470000] 2023-10-03T19:20:53.038 INFO:teuthology.orchestra.run.smithi045.stdout: -6051> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_738 [2,head] auth NULL (dversion lock) v=5478 ino=(nil) state=1073741824 0x55cf6246d180] 2023-10-03T19:20:53.038 INFO:teuthology.orchestra.run.smithi045.stdout: -6050> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_737 [2,head] auth (dversion lock) v=5476 ino=0x100000004d6 state=1073741824 0x55cf6246cf00] 2023-10-03T19:20:53.038 INFO:teuthology.orchestra.run.smithi045.stdout: -6049> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.038 INFO:teuthology.orchestra.run.smithi045.stdout: -6048> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004d6 [2,head] /dc-dir/dc-file_737 auth v5476 s=3 n(v0 rc2023-10-03T19:13:43.315492+0000 b3 1=1+0) (iversion lock) 0x55cf6246b700] 2023-10-03T19:20:53.038 INFO:teuthology.orchestra.run.smithi045.stdout: -6047> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_737 [2,head] auth (dversion lock) v=5476 ino=0x100000004d6 state=1073741824 0x55cf6246cf00] [inode 0x100000004d6 [2,head] /dc-dir/dc-file_737 auth v5476 s=3 n(v0 rc2023-10-03T19:13:43.315492+0000 b3 1=1+0) (iversion lock) 0x55cf6246b700] 2023-10-03T19:20:53.038 INFO:teuthology.orchestra.run.smithi045.stdout: -6046> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004d6 [2,head] #100000004d6 auth v5476 s=3 n(v0 rc2023-10-03T19:13:43.315492+0000 b3 1=1+0) (iversion lock) 0x55cf6246b700] 2023-10-03T19:20:53.038 INFO:teuthology.orchestra.run.smithi045.stdout: -6045> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_737 [2,head] auth NULL (dversion lock) v=5476 ino=(nil) state=1073741824 0x55cf6246cf00] 2023-10-03T19:20:53.038 INFO:teuthology.orchestra.run.smithi045.stdout: -6044> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_736 [2,head] auth (dversion lock) v=5474 ino=0x100000004d5 state=1073741824 0x55cf6246cc80] 2023-10-03T19:20:53.038 INFO:teuthology.orchestra.run.smithi045.stdout: -6043> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.038 INFO:teuthology.orchestra.run.smithi045.stdout: -6042> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004d5 [2,head] /dc-dir/dc-file_736 auth v5474 s=3 n(v0 rc2023-10-03T19:13:43.304063+0000 b3 1=1+0) (iversion lock) 0x55cf6246b180] 2023-10-03T19:20:53.039 INFO:teuthology.orchestra.run.smithi045.stdout: -6041> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_736 [2,head] auth (dversion lock) v=5474 ino=0x100000004d5 state=1073741824 0x55cf6246cc80] [inode 0x100000004d5 [2,head] /dc-dir/dc-file_736 auth v5474 s=3 n(v0 rc2023-10-03T19:13:43.304063+0000 b3 1=1+0) (iversion lock) 0x55cf6246b180] 2023-10-03T19:20:53.039 INFO:teuthology.orchestra.run.smithi045.stdout: -6040> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004d5 [2,head] #100000004d5 auth v5474 s=3 n(v0 rc2023-10-03T19:13:43.304063+0000 b3 1=1+0) (iversion lock) 0x55cf6246b180] 2023-10-03T19:20:53.039 INFO:teuthology.orchestra.run.smithi045.stdout: -6039> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_736 [2,head] auth NULL (dversion lock) v=5474 ino=(nil) state=1073741824 0x55cf6246cc80] 2023-10-03T19:20:53.039 INFO:teuthology.orchestra.run.smithi045.stdout: -6038> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_735 [2,head] auth (dversion lock) v=5472 ino=0x100000004d4 state=1073741824 0x55cf6246ca00] 2023-10-03T19:20:53.039 INFO:teuthology.orchestra.run.smithi045.stdout: -6037> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.039 INFO:teuthology.orchestra.run.smithi045.stdout: -6036> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004d4 [2,head] /dc-dir/dc-file_735 auth v5472 s=3 n(v0 rc2023-10-03T19:13:43.292872+0000 b3 1=1+0) (iversion lock) 0x55cf6246ac00] 2023-10-03T19:20:53.039 INFO:teuthology.orchestra.run.smithi045.stdout: -6035> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_735 [2,head] auth (dversion lock) v=5472 ino=0x100000004d4 state=1073741824 0x55cf6246ca00] [inode 0x100000004d4 [2,head] /dc-dir/dc-file_735 auth v5472 s=3 n(v0 rc2023-10-03T19:13:43.292872+0000 b3 1=1+0) (iversion lock) 0x55cf6246ac00] 2023-10-03T19:20:53.039 INFO:teuthology.orchestra.run.smithi045.stdout: -6034> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004d4 [2,head] #100000004d4 auth v5472 s=3 n(v0 rc2023-10-03T19:13:43.292872+0000 b3 1=1+0) (iversion lock) 0x55cf6246ac00] 2023-10-03T19:20:53.039 INFO:teuthology.orchestra.run.smithi045.stdout: -6033> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_735 [2,head] auth NULL (dversion lock) v=5472 ino=(nil) state=1073741824 0x55cf6246ca00] 2023-10-03T19:20:53.039 INFO:teuthology.orchestra.run.smithi045.stdout: -6032> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_734 [2,head] auth (dversion lock) v=5470 ino=0x100000004d3 state=1073741824 0x55cf6246c780] 2023-10-03T19:20:53.039 INFO:teuthology.orchestra.run.smithi045.stdout: -6031> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.039 INFO:teuthology.orchestra.run.smithi045.stdout: -6030> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004d3 [2,head] /dc-dir/dc-file_734 auth v5470 s=3 n(v0 rc2023-10-03T19:13:43.281792+0000 b3 1=1+0) (iversion lock) 0x55cf6246a680] 2023-10-03T19:20:53.040 INFO:teuthology.orchestra.run.smithi045.stdout: -6029> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_734 [2,head] auth (dversion lock) v=5470 ino=0x100000004d3 state=1073741824 0x55cf6246c780] [inode 0x100000004d3 [2,head] /dc-dir/dc-file_734 auth v5470 s=3 n(v0 rc2023-10-03T19:13:43.281792+0000 b3 1=1+0) (iversion lock) 0x55cf6246a680] 2023-10-03T19:20:53.040 INFO:teuthology.orchestra.run.smithi045.stdout: -6028> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004d3 [2,head] #100000004d3 auth v5470 s=3 n(v0 rc2023-10-03T19:13:43.281792+0000 b3 1=1+0) (iversion lock) 0x55cf6246a680] 2023-10-03T19:20:53.040 INFO:teuthology.orchestra.run.smithi045.stdout: -6027> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_734 [2,head] auth NULL (dversion lock) v=5470 ino=(nil) state=1073741824 0x55cf6246c780] 2023-10-03T19:20:53.040 INFO:teuthology.orchestra.run.smithi045.stdout: -6026> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_733 [2,head] auth (dversion lock) v=5468 ino=0x100000004d2 state=1073741824 0x55cf6246c500] 2023-10-03T19:20:53.040 INFO:teuthology.orchestra.run.smithi045.stdout: -6025> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.040 INFO:teuthology.orchestra.run.smithi045.stdout: -6024> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004d2 [2,head] /dc-dir/dc-file_733 auth v5468 s=3 n(v0 rc2023-10-03T19:13:43.269559+0000 b3 1=1+0) (iversion lock) 0x55cf6246a100] 2023-10-03T19:20:53.040 INFO:teuthology.orchestra.run.smithi045.stdout: -6023> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_733 [2,head] auth (dversion lock) v=5468 ino=0x100000004d2 state=1073741824 0x55cf6246c500] [inode 0x100000004d2 [2,head] /dc-dir/dc-file_733 auth v5468 s=3 n(v0 rc2023-10-03T19:13:43.269559+0000 b3 1=1+0) (iversion lock) 0x55cf6246a100] 2023-10-03T19:20:53.040 INFO:teuthology.orchestra.run.smithi045.stdout: -6022> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004d2 [2,head] #100000004d2 auth v5468 s=3 n(v0 rc2023-10-03T19:13:43.269559+0000 b3 1=1+0) (iversion lock) 0x55cf6246a100] 2023-10-03T19:20:53.040 INFO:teuthology.orchestra.run.smithi045.stdout: -6021> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_733 [2,head] auth NULL (dversion lock) v=5468 ino=(nil) state=1073741824 0x55cf6246c500] 2023-10-03T19:20:53.040 INFO:teuthology.orchestra.run.smithi045.stdout: -6020> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_732 [2,head] auth (dversion lock) v=5466 ino=0x100000004d1 state=1073741824 0x55cf6246c280] 2023-10-03T19:20:53.041 INFO:teuthology.orchestra.run.smithi045.stdout: -6019> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.041 INFO:teuthology.orchestra.run.smithi045.stdout: -6018> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004d1 [2,head] /dc-dir/dc-file_732 auth v5466 s=3 n(v0 rc2023-10-03T19:13:43.256483+0000 b3 1=1+0) (iversion lock) 0x55cf62469b80] 2023-10-03T19:20:53.041 INFO:teuthology.orchestra.run.smithi045.stdout: -6017> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_732 [2,head] auth (dversion lock) v=5466 ino=0x100000004d1 state=1073741824 0x55cf6246c280] [inode 0x100000004d1 [2,head] /dc-dir/dc-file_732 auth v5466 s=3 n(v0 rc2023-10-03T19:13:43.256483+0000 b3 1=1+0) (iversion lock) 0x55cf62469b80] 2023-10-03T19:20:53.041 INFO:teuthology.orchestra.run.smithi045.stdout: -6016> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004d1 [2,head] #100000004d1 auth v5466 s=3 n(v0 rc2023-10-03T19:13:43.256483+0000 b3 1=1+0) (iversion lock) 0x55cf62469b80] 2023-10-03T19:20:53.041 INFO:teuthology.orchestra.run.smithi045.stdout: -6015> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_732 [2,head] auth NULL (dversion lock) v=5466 ino=(nil) state=1073741824 0x55cf6246c280] 2023-10-03T19:20:53.041 INFO:teuthology.orchestra.run.smithi045.stdout: -6014> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_731 [2,head] auth (dversion lock) v=5464 ino=0x100000004d0 state=1073741824 0x55cf6246c000] 2023-10-03T19:20:53.041 INFO:teuthology.orchestra.run.smithi045.stdout: -6013> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.041 INFO:teuthology.orchestra.run.smithi045.stdout: -6012> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004d0 [2,head] /dc-dir/dc-file_731 auth v5464 s=3 n(v0 rc2023-10-03T19:13:43.245041+0000 b3 1=1+0) (iversion lock) 0x55cf62469600] 2023-10-03T19:20:53.041 INFO:teuthology.orchestra.run.smithi045.stdout: -6011> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_731 [2,head] auth (dversion lock) v=5464 ino=0x100000004d0 state=1073741824 0x55cf6246c000] [inode 0x100000004d0 [2,head] /dc-dir/dc-file_731 auth v5464 s=3 n(v0 rc2023-10-03T19:13:43.245041+0000 b3 1=1+0) (iversion lock) 0x55cf62469600] 2023-10-03T19:20:53.041 INFO:teuthology.orchestra.run.smithi045.stdout: -6010> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004d0 [2,head] #100000004d0 auth v5464 s=3 n(v0 rc2023-10-03T19:13:43.245041+0000 b3 1=1+0) (iversion lock) 0x55cf62469600] 2023-10-03T19:20:53.041 INFO:teuthology.orchestra.run.smithi045.stdout: -6009> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_731 [2,head] auth NULL (dversion lock) v=5464 ino=(nil) state=1073741824 0x55cf6246c000] 2023-10-03T19:20:53.042 INFO:teuthology.orchestra.run.smithi045.stdout: -6008> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_730 [2,head] auth (dversion lock) v=5462 ino=0x100000004cf state=1073741824 0x55cf62463b80] 2023-10-03T19:20:53.042 INFO:teuthology.orchestra.run.smithi045.stdout: -6007> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.042 INFO:teuthology.orchestra.run.smithi045.stdout: -6006> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004cf [2,head] /dc-dir/dc-file_730 auth v5462 s=3 n(v0 rc2023-10-03T19:13:43.232353+0000 b3 1=1+0) (iversion lock) 0x55cf62469080] 2023-10-03T19:20:53.042 INFO:teuthology.orchestra.run.smithi045.stdout: -6005> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_730 [2,head] auth (dversion lock) v=5462 ino=0x100000004cf state=1073741824 0x55cf62463b80] [inode 0x100000004cf [2,head] /dc-dir/dc-file_730 auth v5462 s=3 n(v0 rc2023-10-03T19:13:43.232353+0000 b3 1=1+0) (iversion lock) 0x55cf62469080] 2023-10-03T19:20:53.042 INFO:teuthology.orchestra.run.smithi045.stdout: -6004> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004cf [2,head] #100000004cf auth v5462 s=3 n(v0 rc2023-10-03T19:13:43.232353+0000 b3 1=1+0) (iversion lock) 0x55cf62469080] 2023-10-03T19:20:53.042 INFO:teuthology.orchestra.run.smithi045.stdout: -6003> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_730 [2,head] auth NULL (dversion lock) v=5462 ino=(nil) state=1073741824 0x55cf62463b80] 2023-10-03T19:20:53.042 INFO:teuthology.orchestra.run.smithi045.stdout: -6002> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_729 [2,head] auth (dversion lock) v=5460 ino=0x100000004ce state=1073741824 0x55cf62463900] 2023-10-03T19:20:53.042 INFO:teuthology.orchestra.run.smithi045.stdout: -6001> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.042 INFO:teuthology.orchestra.run.smithi045.stdout: -6000> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004ce [2,head] /dc-dir/dc-file_729 auth v5460 s=3 n(v0 rc2023-10-03T19:13:43.221199+0000 b3 1=1+0) (iversion lock) 0x55cf62468b00] 2023-10-03T19:20:53.042 INFO:teuthology.orchestra.run.smithi045.stdout: -5999> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_729 [2,head] auth (dversion lock) v=5460 ino=0x100000004ce state=1073741824 0x55cf62463900] [inode 0x100000004ce [2,head] /dc-dir/dc-file_729 auth v5460 s=3 n(v0 rc2023-10-03T19:13:43.221199+0000 b3 1=1+0) (iversion lock) 0x55cf62468b00] 2023-10-03T19:20:53.042 INFO:teuthology.orchestra.run.smithi045.stdout: -5998> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004ce [2,head] #100000004ce auth v5460 s=3 n(v0 rc2023-10-03T19:13:43.221199+0000 b3 1=1+0) (iversion lock) 0x55cf62468b00] 2023-10-03T19:20:53.043 INFO:teuthology.orchestra.run.smithi045.stdout: -5997> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_729 [2,head] auth NULL (dversion lock) v=5460 ino=(nil) state=1073741824 0x55cf62463900] 2023-10-03T19:20:53.043 INFO:teuthology.orchestra.run.smithi045.stdout: -5996> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_728 [2,head] auth (dversion lock) v=5458 ino=0x100000004cd state=1073741824 0x55cf62463680] 2023-10-03T19:20:53.043 INFO:teuthology.orchestra.run.smithi045.stdout: -5995> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.043 INFO:teuthology.orchestra.run.smithi045.stdout: -5994> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004cd [2,head] /dc-dir/dc-file_728 auth v5458 s=3 n(v0 rc2023-10-03T19:13:43.209698+0000 b3 1=1+0) (iversion lock) 0x55cf62468580] 2023-10-03T19:20:53.043 INFO:teuthology.orchestra.run.smithi045.stdout: -5993> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_728 [2,head] auth (dversion lock) v=5458 ino=0x100000004cd state=1073741824 0x55cf62463680] [inode 0x100000004cd [2,head] /dc-dir/dc-file_728 auth v5458 s=3 n(v0 rc2023-10-03T19:13:43.209698+0000 b3 1=1+0) (iversion lock) 0x55cf62468580] 2023-10-03T19:20:53.043 INFO:teuthology.orchestra.run.smithi045.stdout: -5992> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004cd [2,head] #100000004cd auth v5458 s=3 n(v0 rc2023-10-03T19:13:43.209698+0000 b3 1=1+0) (iversion lock) 0x55cf62468580] 2023-10-03T19:20:53.043 INFO:teuthology.orchestra.run.smithi045.stdout: -5991> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_728 [2,head] auth NULL (dversion lock) v=5458 ino=(nil) state=1073741824 0x55cf62463680] 2023-10-03T19:20:53.043 INFO:teuthology.orchestra.run.smithi045.stdout: -5990> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_727 [2,head] auth (dversion lock) v=5456 ino=0x100000004cc state=1073741824 0x55cf62463400] 2023-10-03T19:20:53.043 INFO:teuthology.orchestra.run.smithi045.stdout: -5989> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.043 INFO:teuthology.orchestra.run.smithi045.stdout: -5988> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004cc [2,head] /dc-dir/dc-file_727 auth v5456 s=3 n(v0 rc2023-10-03T19:13:43.197645+0000 b3 1=1+0) (iversion lock) 0x55cf62468000] 2023-10-03T19:20:53.044 INFO:teuthology.orchestra.run.smithi045.stdout: -5987> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_727 [2,head] auth (dversion lock) v=5456 ino=0x100000004cc state=1073741824 0x55cf62463400] [inode 0x100000004cc [2,head] /dc-dir/dc-file_727 auth v5456 s=3 n(v0 rc2023-10-03T19:13:43.197645+0000 b3 1=1+0) (iversion lock) 0x55cf62468000] 2023-10-03T19:20:53.044 INFO:teuthology.orchestra.run.smithi045.stdout: -5986> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004cc [2,head] #100000004cc auth v5456 s=3 n(v0 rc2023-10-03T19:13:43.197645+0000 b3 1=1+0) (iversion lock) 0x55cf62468000] 2023-10-03T19:20:53.044 INFO:teuthology.orchestra.run.smithi045.stdout: -5985> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_727 [2,head] auth NULL (dversion lock) v=5456 ino=(nil) state=1073741824 0x55cf62463400] 2023-10-03T19:20:53.044 INFO:teuthology.orchestra.run.smithi045.stdout: -5984> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_726 [2,head] auth (dversion lock) v=5454 ino=0x100000004cb state=1073741824 0x55cf62463180] 2023-10-03T19:20:53.044 INFO:teuthology.orchestra.run.smithi045.stdout: -5983> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.044 INFO:teuthology.orchestra.run.smithi045.stdout: -5982> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004cb [2,head] /dc-dir/dc-file_726 auth v5454 s=3 n(v0 rc2023-10-03T19:13:43.185696+0000 b3 1=1+0) (iversion lock) 0x55cf6245f700] 2023-10-03T19:20:53.044 INFO:teuthology.orchestra.run.smithi045.stdout: -5981> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_726 [2,head] auth (dversion lock) v=5454 ino=0x100000004cb state=1073741824 0x55cf62463180] [inode 0x100000004cb [2,head] /dc-dir/dc-file_726 auth v5454 s=3 n(v0 rc2023-10-03T19:13:43.185696+0000 b3 1=1+0) (iversion lock) 0x55cf6245f700] 2023-10-03T19:20:53.044 INFO:teuthology.orchestra.run.smithi045.stdout: -5980> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004cb [2,head] #100000004cb auth v5454 s=3 n(v0 rc2023-10-03T19:13:43.185696+0000 b3 1=1+0) (iversion lock) 0x55cf6245f700] 2023-10-03T19:20:53.044 INFO:teuthology.orchestra.run.smithi045.stdout: -5979> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_726 [2,head] auth NULL (dversion lock) v=5454 ino=(nil) state=1073741824 0x55cf62463180] 2023-10-03T19:20:53.044 INFO:teuthology.orchestra.run.smithi045.stdout: -5978> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_725 [2,head] auth (dversion lock) v=5452 ino=0x100000004ca state=1073741824 0x55cf62462f00] 2023-10-03T19:20:53.044 INFO:teuthology.orchestra.run.smithi045.stdout: -5977> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.045 INFO:teuthology.orchestra.run.smithi045.stdout: -5976> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004ca [2,head] /dc-dir/dc-file_725 auth v5452 s=3 n(v0 rc2023-10-03T19:13:43.174391+0000 b3 1=1+0) (iversion lock) 0x55cf6245f180] 2023-10-03T19:20:53.045 INFO:teuthology.orchestra.run.smithi045.stdout: -5975> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_725 [2,head] auth (dversion lock) v=5452 ino=0x100000004ca state=1073741824 0x55cf62462f00] [inode 0x100000004ca [2,head] /dc-dir/dc-file_725 auth v5452 s=3 n(v0 rc2023-10-03T19:13:43.174391+0000 b3 1=1+0) (iversion lock) 0x55cf6245f180] 2023-10-03T19:20:53.045 INFO:teuthology.orchestra.run.smithi045.stdout: -5974> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004ca [2,head] #100000004ca auth v5452 s=3 n(v0 rc2023-10-03T19:13:43.174391+0000 b3 1=1+0) (iversion lock) 0x55cf6245f180] 2023-10-03T19:20:53.045 INFO:teuthology.orchestra.run.smithi045.stdout: -5973> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_725 [2,head] auth NULL (dversion lock) v=5452 ino=(nil) state=1073741824 0x55cf62462f00] 2023-10-03T19:20:53.045 INFO:teuthology.orchestra.run.smithi045.stdout: -5972> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_724 [2,head] auth (dversion lock) v=5450 ino=0x100000004c9 state=1073741824 0x55cf62462c80] 2023-10-03T19:20:53.045 INFO:teuthology.orchestra.run.smithi045.stdout: -5971> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.045 INFO:teuthology.orchestra.run.smithi045.stdout: -5970> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004c9 [2,head] /dc-dir/dc-file_724 auth v5450 s=3 n(v0 rc2023-10-03T19:13:43.163155+0000 b3 1=1+0) (iversion lock) 0x55cf6245ec00] 2023-10-03T19:20:53.045 INFO:teuthology.orchestra.run.smithi045.stdout: -5969> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_724 [2,head] auth (dversion lock) v=5450 ino=0x100000004c9 state=1073741824 0x55cf62462c80] [inode 0x100000004c9 [2,head] /dc-dir/dc-file_724 auth v5450 s=3 n(v0 rc2023-10-03T19:13:43.163155+0000 b3 1=1+0) (iversion lock) 0x55cf6245ec00] 2023-10-03T19:20:53.045 INFO:teuthology.orchestra.run.smithi045.stdout: -5968> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004c9 [2,head] #100000004c9 auth v5450 s=3 n(v0 rc2023-10-03T19:13:43.163155+0000 b3 1=1+0) (iversion lock) 0x55cf6245ec00] 2023-10-03T19:20:53.045 INFO:teuthology.orchestra.run.smithi045.stdout: -5967> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_724 [2,head] auth NULL (dversion lock) v=5450 ino=(nil) state=1073741824 0x55cf62462c80] 2023-10-03T19:20:53.045 INFO:teuthology.orchestra.run.smithi045.stdout: -5966> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_723 [2,head] auth (dversion lock) v=5448 ino=0x100000004c8 state=1073741824 0x55cf62462a00] 2023-10-03T19:20:53.046 INFO:teuthology.orchestra.run.smithi045.stdout: -5965> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.046 INFO:teuthology.orchestra.run.smithi045.stdout: -5964> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004c8 [2,head] /dc-dir/dc-file_723 auth v5448 s=3 n(v0 rc2023-10-03T19:13:43.150633+0000 b3 1=1+0) (iversion lock) 0x55cf6245e680] 2023-10-03T19:20:53.046 INFO:teuthology.orchestra.run.smithi045.stdout: -5963> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_723 [2,head] auth (dversion lock) v=5448 ino=0x100000004c8 state=1073741824 0x55cf62462a00] [inode 0x100000004c8 [2,head] /dc-dir/dc-file_723 auth v5448 s=3 n(v0 rc2023-10-03T19:13:43.150633+0000 b3 1=1+0) (iversion lock) 0x55cf6245e680] 2023-10-03T19:20:53.046 INFO:teuthology.orchestra.run.smithi045.stdout: -5962> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004c8 [2,head] #100000004c8 auth v5448 s=3 n(v0 rc2023-10-03T19:13:43.150633+0000 b3 1=1+0) (iversion lock) 0x55cf6245e680] 2023-10-03T19:20:53.046 INFO:teuthology.orchestra.run.smithi045.stdout: -5961> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_723 [2,head] auth NULL (dversion lock) v=5448 ino=(nil) state=1073741824 0x55cf62462a00] 2023-10-03T19:20:53.046 INFO:teuthology.orchestra.run.smithi045.stdout: -5960> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_722 [2,head] auth (dversion lock) v=5446 ino=0x100000004c7 state=1073741824 0x55cf62462780] 2023-10-03T19:20:53.046 INFO:teuthology.orchestra.run.smithi045.stdout: -5959> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.046 INFO:teuthology.orchestra.run.smithi045.stdout: -5958> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004c7 [2,head] /dc-dir/dc-file_722 auth v5446 s=3 n(v0 rc2023-10-03T19:13:43.138338+0000 b3 1=1+0) (iversion lock) 0x55cf6245e100] 2023-10-03T19:20:53.046 INFO:teuthology.orchestra.run.smithi045.stdout: -5957> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_722 [2,head] auth (dversion lock) v=5446 ino=0x100000004c7 state=1073741824 0x55cf62462780] [inode 0x100000004c7 [2,head] /dc-dir/dc-file_722 auth v5446 s=3 n(v0 rc2023-10-03T19:13:43.138338+0000 b3 1=1+0) (iversion lock) 0x55cf6245e100] 2023-10-03T19:20:53.046 INFO:teuthology.orchestra.run.smithi045.stdout: -5956> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004c7 [2,head] #100000004c7 auth v5446 s=3 n(v0 rc2023-10-03T19:13:43.138338+0000 b3 1=1+0) (iversion lock) 0x55cf6245e100] 2023-10-03T19:20:53.047 INFO:teuthology.orchestra.run.smithi045.stdout: -5955> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_722 [2,head] auth NULL (dversion lock) v=5446 ino=(nil) state=1073741824 0x55cf62462780] 2023-10-03T19:20:53.047 INFO:teuthology.orchestra.run.smithi045.stdout: -5954> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_721 [2,head] auth (dversion lock) v=5444 ino=0x100000004c6 state=1073741824 0x55cf62462500] 2023-10-03T19:20:53.047 INFO:teuthology.orchestra.run.smithi045.stdout: -5953> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.047 INFO:teuthology.orchestra.run.smithi045.stdout: -5952> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004c6 [2,head] /dc-dir/dc-file_721 auth v5444 s=3 n(v0 rc2023-10-03T19:13:43.126968+0000 b3 1=1+0) (iversion lock) 0x55cf6245db80] 2023-10-03T19:20:53.047 INFO:teuthology.orchestra.run.smithi045.stdout: -5951> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_721 [2,head] auth (dversion lock) v=5444 ino=0x100000004c6 state=1073741824 0x55cf62462500] [inode 0x100000004c6 [2,head] /dc-dir/dc-file_721 auth v5444 s=3 n(v0 rc2023-10-03T19:13:43.126968+0000 b3 1=1+0) (iversion lock) 0x55cf6245db80] 2023-10-03T19:20:53.047 INFO:teuthology.orchestra.run.smithi045.stdout: -5950> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004c6 [2,head] #100000004c6 auth v5444 s=3 n(v0 rc2023-10-03T19:13:43.126968+0000 b3 1=1+0) (iversion lock) 0x55cf6245db80] 2023-10-03T19:20:53.047 INFO:teuthology.orchestra.run.smithi045.stdout: -5949> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_721 [2,head] auth NULL (dversion lock) v=5444 ino=(nil) state=1073741824 0x55cf62462500] 2023-10-03T19:20:53.047 INFO:teuthology.orchestra.run.smithi045.stdout: -5948> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_720 [2,head] auth (dversion lock) v=5442 ino=0x100000004c5 state=1073741824 0x55cf62462280] 2023-10-03T19:20:53.047 INFO:teuthology.orchestra.run.smithi045.stdout: -5947> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.047 INFO:teuthology.orchestra.run.smithi045.stdout: -5946> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004c5 [2,head] /dc-dir/dc-file_720 auth v5442 s=3 n(v0 rc2023-10-03T19:13:43.115900+0000 b3 1=1+0) (iversion lock) 0x55cf6245d600] 2023-10-03T19:20:53.047 INFO:teuthology.orchestra.run.smithi045.stdout: -5945> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_720 [2,head] auth (dversion lock) v=5442 ino=0x100000004c5 state=1073741824 0x55cf62462280] [inode 0x100000004c5 [2,head] /dc-dir/dc-file_720 auth v5442 s=3 n(v0 rc2023-10-03T19:13:43.115900+0000 b3 1=1+0) (iversion lock) 0x55cf6245d600] 2023-10-03T19:20:53.048 INFO:teuthology.orchestra.run.smithi045.stdout: -5944> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004c5 [2,head] #100000004c5 auth v5442 s=3 n(v0 rc2023-10-03T19:13:43.115900+0000 b3 1=1+0) (iversion lock) 0x55cf6245d600] 2023-10-03T19:20:53.048 INFO:teuthology.orchestra.run.smithi045.stdout: -5943> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_720 [2,head] auth NULL (dversion lock) v=5442 ino=(nil) state=1073741824 0x55cf62462280] 2023-10-03T19:20:53.048 INFO:teuthology.orchestra.run.smithi045.stdout: -5942> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_719 [2,head] auth (dversion lock) v=5440 ino=0x100000004c4 state=1073741824 0x55cf62462000] 2023-10-03T19:20:53.048 INFO:teuthology.orchestra.run.smithi045.stdout: -5941> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.108 INFO:teuthology.orchestra.run.smithi045.stdout: -5940> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004c4 [2,head] /dc-dir/dc-file_719 auth v5440 s=3 n(v0 rc2023-10-03T19:13:43.104676+0000 b3 1=1+0) (iversion lock) 0x55cf6245d080] 2023-10-03T19:20:53.108 INFO:teuthology.orchestra.run.smithi045.stdout: -5939> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_719 [2,head] auth (dversion lock) v=5440 ino=0x100000004c4 state=1073741824 0x55cf62462000] [inode 0x100000004c4 [2,head] /dc-dir/dc-file_719 auth v5440 s=3 n(v0 rc2023-10-03T19:13:43.104676+0000 b3 1=1+0) (iversion lock) 0x55cf6245d080] 2023-10-03T19:20:53.108 INFO:teuthology.orchestra.run.smithi045.stdout: -5938> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004c4 [2,head] #100000004c4 auth v5440 s=3 n(v0 rc2023-10-03T19:13:43.104676+0000 b3 1=1+0) (iversion lock) 0x55cf6245d080] 2023-10-03T19:20:53.108 INFO:teuthology.orchestra.run.smithi045.stdout: -5937> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_719 [2,head] auth NULL (dversion lock) v=5440 ino=(nil) state=1073741824 0x55cf62462000] 2023-10-03T19:20:53.108 INFO:teuthology.orchestra.run.smithi045.stdout: -5936> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_718 [2,head] auth (dversion lock) v=5438 ino=0x100000004c3 state=1073741824 0x55cf6245bb80] 2023-10-03T19:20:53.108 INFO:teuthology.orchestra.run.smithi045.stdout: -5935> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.108 INFO:teuthology.orchestra.run.smithi045.stdout: -5934> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004c3 [2,head] /dc-dir/dc-file_718 auth v5438 s=3 n(v0 rc2023-10-03T19:13:43.092782+0000 b3 1=1+0) (iversion lock) 0x55cf6245cb00] 2023-10-03T19:20:53.108 INFO:teuthology.orchestra.run.smithi045.stdout: -5933> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_718 [2,head] auth (dversion lock) v=5438 ino=0x100000004c3 state=1073741824 0x55cf6245bb80] [inode 0x100000004c3 [2,head] /dc-dir/dc-file_718 auth v5438 s=3 n(v0 rc2023-10-03T19:13:43.092782+0000 b3 1=1+0) (iversion lock) 0x55cf6245cb00] 2023-10-03T19:20:53.108 INFO:teuthology.orchestra.run.smithi045.stdout: -5932> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004c3 [2,head] #100000004c3 auth v5438 s=3 n(v0 rc2023-10-03T19:13:43.092782+0000 b3 1=1+0) (iversion lock) 0x55cf6245cb00] 2023-10-03T19:20:53.109 INFO:teuthology.orchestra.run.smithi045.stdout: -5931> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_718 [2,head] auth NULL (dversion lock) v=5438 ino=(nil) state=1073741824 0x55cf6245bb80] 2023-10-03T19:20:53.109 INFO:teuthology.orchestra.run.smithi045.stdout: -5930> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_717 [2,head] auth (dversion lock) v=5436 ino=0x100000004c2 state=1073741824 0x55cf6245b900] 2023-10-03T19:20:53.109 INFO:teuthology.orchestra.run.smithi045.stdout: -5929> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.109 INFO:teuthology.orchestra.run.smithi045.stdout: -5928> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004c2 [2,head] /dc-dir/dc-file_717 auth v5436 s=3 n(v0 rc2023-10-03T19:13:43.080578+0000 b3 1=1+0) (iversion lock) 0x55cf6245c580] 2023-10-03T19:20:53.109 INFO:teuthology.orchestra.run.smithi045.stdout: -5927> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_717 [2,head] auth (dversion lock) v=5436 ino=0x100000004c2 state=1073741824 0x55cf6245b900] [inode 0x100000004c2 [2,head] /dc-dir/dc-file_717 auth v5436 s=3 n(v0 rc2023-10-03T19:13:43.080578+0000 b3 1=1+0) (iversion lock) 0x55cf6245c580] 2023-10-03T19:20:53.109 INFO:teuthology.orchestra.run.smithi045.stdout: -5926> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004c2 [2,head] #100000004c2 auth v5436 s=3 n(v0 rc2023-10-03T19:13:43.080578+0000 b3 1=1+0) (iversion lock) 0x55cf6245c580] 2023-10-03T19:20:53.109 INFO:teuthology.orchestra.run.smithi045.stdout: -5925> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_717 [2,head] auth NULL (dversion lock) v=5436 ino=(nil) state=1073741824 0x55cf6245b900] 2023-10-03T19:20:53.109 INFO:teuthology.orchestra.run.smithi045.stdout: -5924> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_716 [2,head] auth (dversion lock) v=5434 ino=0x100000004c1 state=1073741824 0x55cf6245b680] 2023-10-03T19:20:53.109 INFO:teuthology.orchestra.run.smithi045.stdout: -5923> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.109 INFO:teuthology.orchestra.run.smithi045.stdout: -5922> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004c1 [2,head] /dc-dir/dc-file_716 auth v5434 s=3 n(v0 rc2023-10-03T19:13:43.068645+0000 b3 1=1+0) (iversion lock) 0x55cf6245c000] 2023-10-03T19:20:53.110 INFO:teuthology.orchestra.run.smithi045.stdout: -5921> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_716 [2,head] auth (dversion lock) v=5434 ino=0x100000004c1 state=1073741824 0x55cf6245b680] [inode 0x100000004c1 [2,head] /dc-dir/dc-file_716 auth v5434 s=3 n(v0 rc2023-10-03T19:13:43.068645+0000 b3 1=1+0) (iversion lock) 0x55cf6245c000] 2023-10-03T19:20:53.110 INFO:teuthology.orchestra.run.smithi045.stdout: -5920> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004c1 [2,head] #100000004c1 auth v5434 s=3 n(v0 rc2023-10-03T19:13:43.068645+0000 b3 1=1+0) (iversion lock) 0x55cf6245c000] 2023-10-03T19:20:53.110 INFO:teuthology.orchestra.run.smithi045.stdout: -5919> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_716 [2,head] auth NULL (dversion lock) v=5434 ino=(nil) state=1073741824 0x55cf6245b680] 2023-10-03T19:20:53.110 INFO:teuthology.orchestra.run.smithi045.stdout: -5918> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_715 [2,head] auth (dversion lock) v=5432 ino=0x100000004c0 state=1073741824 0x55cf6245b400] 2023-10-03T19:20:53.110 INFO:teuthology.orchestra.run.smithi045.stdout: -5917> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.110 INFO:teuthology.orchestra.run.smithi045.stdout: -5916> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004c0 [2,head] /dc-dir/dc-file_715 auth v5432 s=3 n(v0 rc2023-10-03T19:13:43.056617+0000 b3 1=1+0) (iversion lock) 0x55cf62457700] 2023-10-03T19:20:53.110 INFO:teuthology.orchestra.run.smithi045.stdout: -5915> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_715 [2,head] auth (dversion lock) v=5432 ino=0x100000004c0 state=1073741824 0x55cf6245b400] [inode 0x100000004c0 [2,head] /dc-dir/dc-file_715 auth v5432 s=3 n(v0 rc2023-10-03T19:13:43.056617+0000 b3 1=1+0) (iversion lock) 0x55cf62457700] 2023-10-03T19:20:53.110 INFO:teuthology.orchestra.run.smithi045.stdout: -5914> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004c0 [2,head] #100000004c0 auth v5432 s=3 n(v0 rc2023-10-03T19:13:43.056617+0000 b3 1=1+0) (iversion lock) 0x55cf62457700] 2023-10-03T19:20:53.110 INFO:teuthology.orchestra.run.smithi045.stdout: -5913> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_715 [2,head] auth NULL (dversion lock) v=5432 ino=(nil) state=1073741824 0x55cf6245b400] 2023-10-03T19:20:53.110 INFO:teuthology.orchestra.run.smithi045.stdout: -5912> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_714 [2,head] auth (dversion lock) v=5430 ino=0x100000004bf state=1073741824 0x55cf6245b180] 2023-10-03T19:20:53.110 INFO:teuthology.orchestra.run.smithi045.stdout: -5911> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.111 INFO:teuthology.orchestra.run.smithi045.stdout: -5910> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004bf [2,head] /dc-dir/dc-file_714 auth v5430 s=3 n(v0 rc2023-10-03T19:13:43.044675+0000 b3 1=1+0) (iversion lock) 0x55cf62457180] 2023-10-03T19:20:53.111 INFO:teuthology.orchestra.run.smithi045.stdout: -5909> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_714 [2,head] auth (dversion lock) v=5430 ino=0x100000004bf state=1073741824 0x55cf6245b180] [inode 0x100000004bf [2,head] /dc-dir/dc-file_714 auth v5430 s=3 n(v0 rc2023-10-03T19:13:43.044675+0000 b3 1=1+0) (iversion lock) 0x55cf62457180] 2023-10-03T19:20:53.111 INFO:teuthology.orchestra.run.smithi045.stdout: -5908> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004bf [2,head] #100000004bf auth v5430 s=3 n(v0 rc2023-10-03T19:13:43.044675+0000 b3 1=1+0) (iversion lock) 0x55cf62457180] 2023-10-03T19:20:53.111 INFO:teuthology.orchestra.run.smithi045.stdout: -5907> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_714 [2,head] auth NULL (dversion lock) v=5430 ino=(nil) state=1073741824 0x55cf6245b180] 2023-10-03T19:20:53.111 INFO:teuthology.orchestra.run.smithi045.stdout: -5906> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_713 [2,head] auth (dversion lock) v=5428 ino=0x100000004be state=1073741824 0x55cf6245af00] 2023-10-03T19:20:53.111 INFO:teuthology.orchestra.run.smithi045.stdout: -5905> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.111 INFO:teuthology.orchestra.run.smithi045.stdout: -5904> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004be [2,head] /dc-dir/dc-file_713 auth v5428 s=3 n(v0 rc2023-10-03T19:13:43.032114+0000 b3 1=1+0) (iversion lock) 0x55cf62456c00] 2023-10-03T19:20:53.111 INFO:teuthology.orchestra.run.smithi045.stdout: -5903> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_713 [2,head] auth (dversion lock) v=5428 ino=0x100000004be state=1073741824 0x55cf6245af00] [inode 0x100000004be [2,head] /dc-dir/dc-file_713 auth v5428 s=3 n(v0 rc2023-10-03T19:13:43.032114+0000 b3 1=1+0) (iversion lock) 0x55cf62456c00] 2023-10-03T19:20:53.111 INFO:teuthology.orchestra.run.smithi045.stdout: -5902> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004be [2,head] #100000004be auth v5428 s=3 n(v0 rc2023-10-03T19:13:43.032114+0000 b3 1=1+0) (iversion lock) 0x55cf62456c00] 2023-10-03T19:20:53.111 INFO:teuthology.orchestra.run.smithi045.stdout: -5901> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_713 [2,head] auth NULL (dversion lock) v=5428 ino=(nil) state=1073741824 0x55cf6245af00] 2023-10-03T19:20:53.111 INFO:teuthology.orchestra.run.smithi045.stdout: -5900> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_712 [2,head] auth (dversion lock) v=5426 ino=0x100000004bd state=1073741824 0x55cf6245ac80] 2023-10-03T19:20:53.111 INFO:teuthology.orchestra.run.smithi045.stdout: -5899> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.112 INFO:teuthology.orchestra.run.smithi045.stdout: -5898> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004bd [2,head] /dc-dir/dc-file_712 auth v5426 s=3 n(v0 rc2023-10-03T19:13:43.019864+0000 b3 1=1+0) (iversion lock) 0x55cf62456680] 2023-10-03T19:20:53.112 INFO:teuthology.orchestra.run.smithi045.stdout: -5897> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_712 [2,head] auth (dversion lock) v=5426 ino=0x100000004bd state=1073741824 0x55cf6245ac80] [inode 0x100000004bd [2,head] /dc-dir/dc-file_712 auth v5426 s=3 n(v0 rc2023-10-03T19:13:43.019864+0000 b3 1=1+0) (iversion lock) 0x55cf62456680] 2023-10-03T19:20:53.112 INFO:teuthology.orchestra.run.smithi045.stdout: -5896> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004bd [2,head] #100000004bd auth v5426 s=3 n(v0 rc2023-10-03T19:13:43.019864+0000 b3 1=1+0) (iversion lock) 0x55cf62456680] 2023-10-03T19:20:53.112 INFO:teuthology.orchestra.run.smithi045.stdout: -5895> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_712 [2,head] auth NULL (dversion lock) v=5426 ino=(nil) state=1073741824 0x55cf6245ac80] 2023-10-03T19:20:53.112 INFO:teuthology.orchestra.run.smithi045.stdout: -5894> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_711 [2,head] auth (dversion lock) v=5424 ino=0x100000004bc state=1073741824 0x55cf6245aa00] 2023-10-03T19:20:53.112 INFO:teuthology.orchestra.run.smithi045.stdout: -5893> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.112 INFO:teuthology.orchestra.run.smithi045.stdout: -5892> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004bc [2,head] /dc-dir/dc-file_711 auth v5424 s=3 n(v0 rc2023-10-03T19:13:43.007236+0000 b3 1=1+0) (iversion lock) 0x55cf62456100] 2023-10-03T19:20:53.112 INFO:teuthology.orchestra.run.smithi045.stdout: -5891> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_711 [2,head] auth (dversion lock) v=5424 ino=0x100000004bc state=1073741824 0x55cf6245aa00] [inode 0x100000004bc [2,head] /dc-dir/dc-file_711 auth v5424 s=3 n(v0 rc2023-10-03T19:13:43.007236+0000 b3 1=1+0) (iversion lock) 0x55cf62456100] 2023-10-03T19:20:53.112 INFO:teuthology.orchestra.run.smithi045.stdout: -5890> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004bc [2,head] #100000004bc auth v5424 s=3 n(v0 rc2023-10-03T19:13:43.007236+0000 b3 1=1+0) (iversion lock) 0x55cf62456100] 2023-10-03T19:20:53.112 INFO:teuthology.orchestra.run.smithi045.stdout: -5889> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_711 [2,head] auth NULL (dversion lock) v=5424 ino=(nil) state=1073741824 0x55cf6245aa00] 2023-10-03T19:20:53.113 INFO:teuthology.orchestra.run.smithi045.stdout: -5888> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_710 [2,head] auth (dversion lock) v=5422 ino=0x100000004bb state=1073741824 0x55cf6245a780] 2023-10-03T19:20:53.113 INFO:teuthology.orchestra.run.smithi045.stdout: -5887> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.113 INFO:teuthology.orchestra.run.smithi045.stdout: -5886> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004bb [2,head] /dc-dir/dc-file_710 auth v5422 s=3 n(v0 rc2023-10-03T19:13:42.995104+0000 b3 1=1+0) (iversion lock) 0x55cf62455b80] 2023-10-03T19:20:53.113 INFO:teuthology.orchestra.run.smithi045.stdout: -5885> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_710 [2,head] auth (dversion lock) v=5422 ino=0x100000004bb state=1073741824 0x55cf6245a780] [inode 0x100000004bb [2,head] /dc-dir/dc-file_710 auth v5422 s=3 n(v0 rc2023-10-03T19:13:42.995104+0000 b3 1=1+0) (iversion lock) 0x55cf62455b80] 2023-10-03T19:20:53.113 INFO:teuthology.orchestra.run.smithi045.stdout: -5884> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004bb [2,head] #100000004bb auth v5422 s=3 n(v0 rc2023-10-03T19:13:42.995104+0000 b3 1=1+0) (iversion lock) 0x55cf62455b80] 2023-10-03T19:20:53.113 INFO:teuthology.orchestra.run.smithi045.stdout: -5883> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_710 [2,head] auth NULL (dversion lock) v=5422 ino=(nil) state=1073741824 0x55cf6245a780] 2023-10-03T19:20:53.113 INFO:teuthology.orchestra.run.smithi045.stdout: -5882> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_709 [2,head] auth (dversion lock) v=5420 ino=0x100000004ba state=1073741824 0x55cf6245a500] 2023-10-03T19:20:53.113 INFO:teuthology.orchestra.run.smithi045.stdout: -5881> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.113 INFO:teuthology.orchestra.run.smithi045.stdout: -5880> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004ba [2,head] /dc-dir/dc-file_709 auth v5420 s=3 n(v0 rc2023-10-03T19:13:42.983182+0000 b3 1=1+0) (iversion lock) 0x55cf62455600] 2023-10-03T19:20:53.113 INFO:teuthology.orchestra.run.smithi045.stdout: -5879> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_709 [2,head] auth (dversion lock) v=5420 ino=0x100000004ba state=1073741824 0x55cf6245a500] [inode 0x100000004ba [2,head] /dc-dir/dc-file_709 auth v5420 s=3 n(v0 rc2023-10-03T19:13:42.983182+0000 b3 1=1+0) (iversion lock) 0x55cf62455600] 2023-10-03T19:20:53.113 INFO:teuthology.orchestra.run.smithi045.stdout: -5878> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004ba [2,head] #100000004ba auth v5420 s=3 n(v0 rc2023-10-03T19:13:42.983182+0000 b3 1=1+0) (iversion lock) 0x55cf62455600] 2023-10-03T19:20:53.114 INFO:teuthology.orchestra.run.smithi045.stdout: -5877> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_709 [2,head] auth NULL (dversion lock) v=5420 ino=(nil) state=1073741824 0x55cf6245a500] 2023-10-03T19:20:53.114 INFO:teuthology.orchestra.run.smithi045.stdout: -5876> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_708 [2,head] auth (dversion lock) v=5418 ino=0x100000004b9 state=1073741824 0x55cf6245a280] 2023-10-03T19:20:53.114 INFO:teuthology.orchestra.run.smithi045.stdout: -5875> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.114 INFO:teuthology.orchestra.run.smithi045.stdout: -5874> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004b9 [2,head] /dc-dir/dc-file_708 auth v5418 s=3 n(v0 rc2023-10-03T19:13:42.970731+0000 b3 1=1+0) (iversion lock) 0x55cf62455080] 2023-10-03T19:20:53.114 INFO:teuthology.orchestra.run.smithi045.stdout: -5873> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_708 [2,head] auth (dversion lock) v=5418 ino=0x100000004b9 state=1073741824 0x55cf6245a280] [inode 0x100000004b9 [2,head] /dc-dir/dc-file_708 auth v5418 s=3 n(v0 rc2023-10-03T19:13:42.970731+0000 b3 1=1+0) (iversion lock) 0x55cf62455080] 2023-10-03T19:20:53.114 INFO:teuthology.orchestra.run.smithi045.stdout: -5872> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004b9 [2,head] #100000004b9 auth v5418 s=3 n(v0 rc2023-10-03T19:13:42.970731+0000 b3 1=1+0) (iversion lock) 0x55cf62455080] 2023-10-03T19:20:53.114 INFO:teuthology.orchestra.run.smithi045.stdout: -5871> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_708 [2,head] auth NULL (dversion lock) v=5418 ino=(nil) state=1073741824 0x55cf6245a280] 2023-10-03T19:20:53.114 INFO:teuthology.orchestra.run.smithi045.stdout: -5870> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_707 [2,head] auth (dversion lock) v=5416 ino=0x100000004b8 state=1073741824 0x55cf6245a000] 2023-10-03T19:20:53.114 INFO:teuthology.orchestra.run.smithi045.stdout: -5869> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.114 INFO:teuthology.orchestra.run.smithi045.stdout: -5868> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004b8 [2,head] /dc-dir/dc-file_707 auth v5416 s=3 n(v0 rc2023-10-03T19:13:42.959279+0000 b3 1=1+0) (iversion lock) 0x55cf62454b00] 2023-10-03T19:20:53.114 INFO:teuthology.orchestra.run.smithi045.stdout: -5867> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_707 [2,head] auth (dversion lock) v=5416 ino=0x100000004b8 state=1073741824 0x55cf6245a000] [inode 0x100000004b8 [2,head] /dc-dir/dc-file_707 auth v5416 s=3 n(v0 rc2023-10-03T19:13:42.959279+0000 b3 1=1+0) (iversion lock) 0x55cf62454b00] 2023-10-03T19:20:53.115 INFO:teuthology.orchestra.run.smithi045.stdout: -5866> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004b8 [2,head] #100000004b8 auth v5416 s=3 n(v0 rc2023-10-03T19:13:42.959279+0000 b3 1=1+0) (iversion lock) 0x55cf62454b00] 2023-10-03T19:20:53.115 INFO:teuthology.orchestra.run.smithi045.stdout: -5865> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_707 [2,head] auth NULL (dversion lock) v=5416 ino=(nil) state=1073741824 0x55cf6245a000] 2023-10-03T19:20:53.115 INFO:teuthology.orchestra.run.smithi045.stdout: -5864> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_706 [2,head] auth (dversion lock) v=5414 ino=0x100000004b7 state=1073741824 0x55cf62439b80] 2023-10-03T19:20:53.115 INFO:teuthology.orchestra.run.smithi045.stdout: -5863> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.115 INFO:teuthology.orchestra.run.smithi045.stdout: -5862> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004b7 [2,head] /dc-dir/dc-file_706 auth v5414 s=3 n(v0 rc2023-10-03T19:13:42.948402+0000 b3 1=1+0) (iversion lock) 0x55cf62454580] 2023-10-03T19:20:53.115 INFO:teuthology.orchestra.run.smithi045.stdout: -5861> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_706 [2,head] auth (dversion lock) v=5414 ino=0x100000004b7 state=1073741824 0x55cf62439b80] [inode 0x100000004b7 [2,head] /dc-dir/dc-file_706 auth v5414 s=3 n(v0 rc2023-10-03T19:13:42.948402+0000 b3 1=1+0) (iversion lock) 0x55cf62454580] 2023-10-03T19:20:53.115 INFO:teuthology.orchestra.run.smithi045.stdout: -5860> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004b7 [2,head] #100000004b7 auth v5414 s=3 n(v0 rc2023-10-03T19:13:42.948402+0000 b3 1=1+0) (iversion lock) 0x55cf62454580] 2023-10-03T19:20:53.115 INFO:teuthology.orchestra.run.smithi045.stdout: -5859> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_706 [2,head] auth NULL (dversion lock) v=5414 ino=(nil) state=1073741824 0x55cf62439b80] 2023-10-03T19:20:53.115 INFO:teuthology.orchestra.run.smithi045.stdout: -5858> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_705 [2,head] auth (dversion lock) v=5412 ino=0x100000004b6 state=1073741824 0x55cf62439900] 2023-10-03T19:20:53.115 INFO:teuthology.orchestra.run.smithi045.stdout: -5857> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.115 INFO:teuthology.orchestra.run.smithi045.stdout: -5856> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004b6 [2,head] /dc-dir/dc-file_705 auth v5412 s=3 n(v0 rc2023-10-03T19:13:42.937642+0000 b3 1=1+0) (iversion lock) 0x55cf62454000] 2023-10-03T19:20:53.116 INFO:teuthology.orchestra.run.smithi045.stdout: -5855> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_705 [2,head] auth (dversion lock) v=5412 ino=0x100000004b6 state=1073741824 0x55cf62439900] [inode 0x100000004b6 [2,head] /dc-dir/dc-file_705 auth v5412 s=3 n(v0 rc2023-10-03T19:13:42.937642+0000 b3 1=1+0) (iversion lock) 0x55cf62454000] 2023-10-03T19:20:53.116 INFO:teuthology.orchestra.run.smithi045.stdout: -5854> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004b6 [2,head] #100000004b6 auth v5412 s=3 n(v0 rc2023-10-03T19:13:42.937642+0000 b3 1=1+0) (iversion lock) 0x55cf62454000] 2023-10-03T19:20:53.116 INFO:teuthology.orchestra.run.smithi045.stdout: -5853> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_705 [2,head] auth NULL (dversion lock) v=5412 ino=(nil) state=1073741824 0x55cf62439900] 2023-10-03T19:20:53.116 INFO:teuthology.orchestra.run.smithi045.stdout: -5852> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_704 [2,head] auth (dversion lock) v=5410 ino=0x100000004b5 state=1073741824 0x55cf62439680] 2023-10-03T19:20:53.116 INFO:teuthology.orchestra.run.smithi045.stdout: -5851> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.116 INFO:teuthology.orchestra.run.smithi045.stdout: -5850> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004b5 [2,head] /dc-dir/dc-file_704 auth v5410 s=3 n(v0 rc2023-10-03T19:13:42.927021+0000 b3 1=1+0) (iversion lock) 0x55cf62437700] 2023-10-03T19:20:53.116 INFO:teuthology.orchestra.run.smithi045.stdout: -5849> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_704 [2,head] auth (dversion lock) v=5410 ino=0x100000004b5 state=1073741824 0x55cf62439680] [inode 0x100000004b5 [2,head] /dc-dir/dc-file_704 auth v5410 s=3 n(v0 rc2023-10-03T19:13:42.927021+0000 b3 1=1+0) (iversion lock) 0x55cf62437700] 2023-10-03T19:20:53.116 INFO:teuthology.orchestra.run.smithi045.stdout: -5848> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004b5 [2,head] #100000004b5 auth v5410 s=3 n(v0 rc2023-10-03T19:13:42.927021+0000 b3 1=1+0) (iversion lock) 0x55cf62437700] 2023-10-03T19:20:53.116 INFO:teuthology.orchestra.run.smithi045.stdout: -5847> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_704 [2,head] auth NULL (dversion lock) v=5410 ino=(nil) state=1073741824 0x55cf62439680] 2023-10-03T19:20:53.116 INFO:teuthology.orchestra.run.smithi045.stdout: -5846> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_703 [2,head] auth (dversion lock) v=5408 ino=0x100000004b4 state=1073741824 0x55cf62439400] 2023-10-03T19:20:53.116 INFO:teuthology.orchestra.run.smithi045.stdout: -5845> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.117 INFO:teuthology.orchestra.run.smithi045.stdout: -5844> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004b4 [2,head] /dc-dir/dc-file_703 auth v5408 s=3 n(v0 rc2023-10-03T19:13:42.916256+0000 b3 1=1+0) (iversion lock) 0x55cf62437180] 2023-10-03T19:20:53.117 INFO:teuthology.orchestra.run.smithi045.stdout: -5843> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_703 [2,head] auth (dversion lock) v=5408 ino=0x100000004b4 state=1073741824 0x55cf62439400] [inode 0x100000004b4 [2,head] /dc-dir/dc-file_703 auth v5408 s=3 n(v0 rc2023-10-03T19:13:42.916256+0000 b3 1=1+0) (iversion lock) 0x55cf62437180] 2023-10-03T19:20:53.117 INFO:teuthology.orchestra.run.smithi045.stdout: -5842> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004b4 [2,head] #100000004b4 auth v5408 s=3 n(v0 rc2023-10-03T19:13:42.916256+0000 b3 1=1+0) (iversion lock) 0x55cf62437180] 2023-10-03T19:20:53.117 INFO:teuthology.orchestra.run.smithi045.stdout: -5841> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_703 [2,head] auth NULL (dversion lock) v=5408 ino=(nil) state=1073741824 0x55cf62439400] 2023-10-03T19:20:53.117 INFO:teuthology.orchestra.run.smithi045.stdout: -5840> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_702 [2,head] auth (dversion lock) v=5406 ino=0x100000004b3 state=1073741824 0x55cf62439180] 2023-10-03T19:20:53.117 INFO:teuthology.orchestra.run.smithi045.stdout: -5839> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.117 INFO:teuthology.orchestra.run.smithi045.stdout: -5838> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004b3 [2,head] /dc-dir/dc-file_702 auth v5406 s=3 n(v0 rc2023-10-03T19:13:42.905503+0000 b3 1=1+0) (iversion lock) 0x55cf62436c00] 2023-10-03T19:20:53.117 INFO:teuthology.orchestra.run.smithi045.stdout: -5837> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_702 [2,head] auth (dversion lock) v=5406 ino=0x100000004b3 state=1073741824 0x55cf62439180] [inode 0x100000004b3 [2,head] /dc-dir/dc-file_702 auth v5406 s=3 n(v0 rc2023-10-03T19:13:42.905503+0000 b3 1=1+0) (iversion lock) 0x55cf62436c00] 2023-10-03T19:20:53.117 INFO:teuthology.orchestra.run.smithi045.stdout: -5836> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004b3 [2,head] #100000004b3 auth v5406 s=3 n(v0 rc2023-10-03T19:13:42.905503+0000 b3 1=1+0) (iversion lock) 0x55cf62436c00] 2023-10-03T19:20:53.117 INFO:teuthology.orchestra.run.smithi045.stdout: -5835> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_702 [2,head] auth NULL (dversion lock) v=5406 ino=(nil) state=1073741824 0x55cf62439180] 2023-10-03T19:20:53.117 INFO:teuthology.orchestra.run.smithi045.stdout: -5834> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_701 [2,head] auth (dversion lock) v=5404 ino=0x100000004b2 state=1073741824 0x55cf62438f00] 2023-10-03T19:20:53.118 INFO:teuthology.orchestra.run.smithi045.stdout: -5833> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.118 INFO:teuthology.orchestra.run.smithi045.stdout: -5832> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004b2 [2,head] /dc-dir/dc-file_701 auth v5404 s=3 n(v0 rc2023-10-03T19:13:42.893801+0000 b3 1=1+0) (iversion lock) 0x55cf62436680] 2023-10-03T19:20:53.118 INFO:teuthology.orchestra.run.smithi045.stdout: -5831> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_701 [2,head] auth (dversion lock) v=5404 ino=0x100000004b2 state=1073741824 0x55cf62438f00] [inode 0x100000004b2 [2,head] /dc-dir/dc-file_701 auth v5404 s=3 n(v0 rc2023-10-03T19:13:42.893801+0000 b3 1=1+0) (iversion lock) 0x55cf62436680] 2023-10-03T19:20:53.118 INFO:teuthology.orchestra.run.smithi045.stdout: -5830> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004b2 [2,head] #100000004b2 auth v5404 s=3 n(v0 rc2023-10-03T19:13:42.893801+0000 b3 1=1+0) (iversion lock) 0x55cf62436680] 2023-10-03T19:20:53.118 INFO:teuthology.orchestra.run.smithi045.stdout: -5829> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_701 [2,head] auth NULL (dversion lock) v=5404 ino=(nil) state=1073741824 0x55cf62438f00] 2023-10-03T19:20:53.118 INFO:teuthology.orchestra.run.smithi045.stdout: -5828> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_700 [2,head] auth (dversion lock) v=5402 ino=0x100000004b1 state=1073741824 0x55cf62438c80] 2023-10-03T19:20:53.118 INFO:teuthology.orchestra.run.smithi045.stdout: -5827> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.118 INFO:teuthology.orchestra.run.smithi045.stdout: -5826> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004b1 [2,head] /dc-dir/dc-file_700 auth v5402 s=3 n(v0 rc2023-10-03T19:13:42.883533+0000 b3 1=1+0) (iversion lock) 0x55cf62436100] 2023-10-03T19:20:53.118 INFO:teuthology.orchestra.run.smithi045.stdout: -5825> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_700 [2,head] auth (dversion lock) v=5402 ino=0x100000004b1 state=1073741824 0x55cf62438c80] [inode 0x100000004b1 [2,head] /dc-dir/dc-file_700 auth v5402 s=3 n(v0 rc2023-10-03T19:13:42.883533+0000 b3 1=1+0) (iversion lock) 0x55cf62436100] 2023-10-03T19:20:53.118 INFO:teuthology.orchestra.run.smithi045.stdout: -5824> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004b1 [2,head] #100000004b1 auth v5402 s=3 n(v0 rc2023-10-03T19:13:42.883533+0000 b3 1=1+0) (iversion lock) 0x55cf62436100] 2023-10-03T19:20:53.119 INFO:teuthology.orchestra.run.smithi045.stdout: -5823> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_700 [2,head] auth NULL (dversion lock) v=5402 ino=(nil) state=1073741824 0x55cf62438c80] 2023-10-03T19:20:53.119 INFO:teuthology.orchestra.run.smithi045.stdout: -5822> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_699 [2,head] auth (dversion lock) v=5400 ino=0x100000004b0 state=1073741824 0x55cf62438a00] 2023-10-03T19:20:53.119 INFO:teuthology.orchestra.run.smithi045.stdout: -5821> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.119 INFO:teuthology.orchestra.run.smithi045.stdout: -5820> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004b0 [2,head] /dc-dir/dc-file_699 auth v5400 s=3 n(v0 rc2023-10-03T19:13:42.872625+0000 b3 1=1+0) (iversion lock) 0x55cf62435b80] 2023-10-03T19:20:53.119 INFO:teuthology.orchestra.run.smithi045.stdout: -5819> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_699 [2,head] auth (dversion lock) v=5400 ino=0x100000004b0 state=1073741824 0x55cf62438a00] [inode 0x100000004b0 [2,head] /dc-dir/dc-file_699 auth v5400 s=3 n(v0 rc2023-10-03T19:13:42.872625+0000 b3 1=1+0) (iversion lock) 0x55cf62435b80] 2023-10-03T19:20:53.119 INFO:teuthology.orchestra.run.smithi045.stdout: -5818> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004b0 [2,head] #100000004b0 auth v5400 s=3 n(v0 rc2023-10-03T19:13:42.872625+0000 b3 1=1+0) (iversion lock) 0x55cf62435b80] 2023-10-03T19:20:53.119 INFO:teuthology.orchestra.run.smithi045.stdout: -5817> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_699 [2,head] auth NULL (dversion lock) v=5400 ino=(nil) state=1073741824 0x55cf62438a00] 2023-10-03T19:20:53.119 INFO:teuthology.orchestra.run.smithi045.stdout: -5816> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_698 [2,head] auth (dversion lock) v=5398 ino=0x100000004af state=1073741824 0x55cf62438780] 2023-10-03T19:20:53.119 INFO:teuthology.orchestra.run.smithi045.stdout: -5815> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.119 INFO:teuthology.orchestra.run.smithi045.stdout: -5814> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004af [2,head] /dc-dir/dc-file_698 auth v5398 s=3 n(v0 rc2023-10-03T19:13:42.861511+0000 b3 1=1+0) (iversion lock) 0x55cf62435600] 2023-10-03T19:20:53.119 INFO:teuthology.orchestra.run.smithi045.stdout: -5813> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_698 [2,head] auth (dversion lock) v=5398 ino=0x100000004af state=1073741824 0x55cf62438780] [inode 0x100000004af [2,head] /dc-dir/dc-file_698 auth v5398 s=3 n(v0 rc2023-10-03T19:13:42.861511+0000 b3 1=1+0) (iversion lock) 0x55cf62435600] 2023-10-03T19:20:53.119 INFO:teuthology.orchestra.run.smithi045.stdout: -5812> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004af [2,head] #100000004af auth v5398 s=3 n(v0 rc2023-10-03T19:13:42.861511+0000 b3 1=1+0) (iversion lock) 0x55cf62435600] 2023-10-03T19:20:53.120 INFO:teuthology.orchestra.run.smithi045.stdout: -5811> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_698 [2,head] auth NULL (dversion lock) v=5398 ino=(nil) state=1073741824 0x55cf62438780] 2023-10-03T19:20:53.120 INFO:teuthology.orchestra.run.smithi045.stdout: -5810> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_697 [2,head] auth (dversion lock) v=5396 ino=0x100000004ae state=1073741824 0x55cf62438500] 2023-10-03T19:20:53.120 INFO:teuthology.orchestra.run.smithi045.stdout: -5809> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.120 INFO:teuthology.orchestra.run.smithi045.stdout: -5808> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004ae [2,head] /dc-dir/dc-file_697 auth v5396 s=3 n(v0 rc2023-10-03T19:13:42.850586+0000 b3 1=1+0) (iversion lock) 0x55cf62435080] 2023-10-03T19:20:53.182 INFO:teuthology.orchestra.run.smithi045.stdout: -5807> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_697 [2,head] auth (dversion lock) v=5396 ino=0x100000004ae state=1073741824 0x55cf62438500] [inode 0x100000004ae [2,head] /dc-dir/dc-file_697 auth v5396 s=3 n(v0 rc2023-10-03T19:13:42.850586+0000 b3 1=1+0) (iversion lock) 0x55cf62435080] 2023-10-03T19:20:53.183 INFO:teuthology.orchestra.run.smithi045.stdout: -5806> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004ae [2,head] #100000004ae auth v5396 s=3 n(v0 rc2023-10-03T19:13:42.850586+0000 b3 1=1+0) (iversion lock) 0x55cf62435080] 2023-10-03T19:20:53.183 INFO:teuthology.orchestra.run.smithi045.stdout: -5805> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_697 [2,head] auth NULL (dversion lock) v=5396 ino=(nil) state=1073741824 0x55cf62438500] 2023-10-03T19:20:53.183 INFO:teuthology.orchestra.run.smithi045.stdout: -5804> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_696 [2,head] auth (dversion lock) v=5394 ino=0x100000004ad state=1073741824 0x55cf62438280] 2023-10-03T19:20:53.183 INFO:teuthology.orchestra.run.smithi045.stdout: -5803> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.183 INFO:teuthology.orchestra.run.smithi045.stdout: -5802> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004ad [2,head] /dc-dir/dc-file_696 auth v5394 s=3 n(v0 rc2023-10-03T19:13:42.839584+0000 b3 1=1+0) (iversion lock) 0x55cf62434b00] 2023-10-03T19:20:53.183 INFO:teuthology.orchestra.run.smithi045.stdout: -5801> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_696 [2,head] auth (dversion lock) v=5394 ino=0x100000004ad state=1073741824 0x55cf62438280] [inode 0x100000004ad [2,head] /dc-dir/dc-file_696 auth v5394 s=3 n(v0 rc2023-10-03T19:13:42.839584+0000 b3 1=1+0) (iversion lock) 0x55cf62434b00] 2023-10-03T19:20:53.183 INFO:teuthology.orchestra.run.smithi045.stdout: -5800> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004ad [2,head] #100000004ad auth v5394 s=3 n(v0 rc2023-10-03T19:13:42.839584+0000 b3 1=1+0) (iversion lock) 0x55cf62434b00] 2023-10-03T19:20:53.183 INFO:teuthology.orchestra.run.smithi045.stdout: -5799> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_696 [2,head] auth NULL (dversion lock) v=5394 ino=(nil) state=1073741824 0x55cf62438280] 2023-10-03T19:20:53.183 INFO:teuthology.orchestra.run.smithi045.stdout: -5798> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_695 [2,head] auth (dversion lock) v=5392 ino=0x100000004ac state=1073741824 0x55cf62438000] 2023-10-03T19:20:53.183 INFO:teuthology.orchestra.run.smithi045.stdout: -5797> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.184 INFO:teuthology.orchestra.run.smithi045.stdout: -5796> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004ac [2,head] /dc-dir/dc-file_695 auth v5392 s=3 n(v0 rc2023-10-03T19:13:42.827423+0000 b3 1=1+0) (iversion lock) 0x55cf62434580] 2023-10-03T19:20:53.184 INFO:teuthology.orchestra.run.smithi045.stdout: -5795> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_695 [2,head] auth (dversion lock) v=5392 ino=0x100000004ac state=1073741824 0x55cf62438000] [inode 0x100000004ac [2,head] /dc-dir/dc-file_695 auth v5392 s=3 n(v0 rc2023-10-03T19:13:42.827423+0000 b3 1=1+0) (iversion lock) 0x55cf62434580] 2023-10-03T19:20:53.184 INFO:teuthology.orchestra.run.smithi045.stdout: -5794> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004ac [2,head] #100000004ac auth v5392 s=3 n(v0 rc2023-10-03T19:13:42.827423+0000 b3 1=1+0) (iversion lock) 0x55cf62434580] 2023-10-03T19:20:53.184 INFO:teuthology.orchestra.run.smithi045.stdout: -5793> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_695 [2,head] auth NULL (dversion lock) v=5392 ino=(nil) state=1073741824 0x55cf62438000] 2023-10-03T19:20:53.184 INFO:teuthology.orchestra.run.smithi045.stdout: -5792> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_694 [2,head] auth (dversion lock) v=5390 ino=0x100000004ab state=1073741824 0x55cf62443b80] 2023-10-03T19:20:53.184 INFO:teuthology.orchestra.run.smithi045.stdout: -5791> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.184 INFO:teuthology.orchestra.run.smithi045.stdout: -5790> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004ab [2,head] /dc-dir/dc-file_694 auth v5390 s=3 n(v0 rc2023-10-03T19:13:42.814512+0000 b3 1=1+0) (iversion lock) 0x55cf62434000] 2023-10-03T19:20:53.184 INFO:teuthology.orchestra.run.smithi045.stdout: -5789> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_694 [2,head] auth (dversion lock) v=5390 ino=0x100000004ab state=1073741824 0x55cf62443b80] [inode 0x100000004ab [2,head] /dc-dir/dc-file_694 auth v5390 s=3 n(v0 rc2023-10-03T19:13:42.814512+0000 b3 1=1+0) (iversion lock) 0x55cf62434000] 2023-10-03T19:20:53.184 INFO:teuthology.orchestra.run.smithi045.stdout: -5788> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004ab [2,head] #100000004ab auth v5390 s=3 n(v0 rc2023-10-03T19:13:42.814512+0000 b3 1=1+0) (iversion lock) 0x55cf62434000] 2023-10-03T19:20:53.184 INFO:teuthology.orchestra.run.smithi045.stdout: -5787> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_694 [2,head] auth NULL (dversion lock) v=5390 ino=(nil) state=1073741824 0x55cf62443b80] 2023-10-03T19:20:53.184 INFO:teuthology.orchestra.run.smithi045.stdout: -5786> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_693 [2,head] auth (dversion lock) v=5388 ino=0x100000004aa state=1073741824 0x55cf62443900] 2023-10-03T19:20:53.184 INFO:teuthology.orchestra.run.smithi045.stdout: -5785> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.185 INFO:teuthology.orchestra.run.smithi045.stdout: -5784> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004aa [2,head] /dc-dir/dc-file_693 auth v5388 s=3 n(v0 rc2023-10-03T19:13:42.803191+0000 b3 1=1+0) (iversion lock) 0x55cf62447700] 2023-10-03T19:20:53.185 INFO:teuthology.orchestra.run.smithi045.stdout: -5783> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_693 [2,head] auth (dversion lock) v=5388 ino=0x100000004aa state=1073741824 0x55cf62443900] [inode 0x100000004aa [2,head] /dc-dir/dc-file_693 auth v5388 s=3 n(v0 rc2023-10-03T19:13:42.803191+0000 b3 1=1+0) (iversion lock) 0x55cf62447700] 2023-10-03T19:20:53.185 INFO:teuthology.orchestra.run.smithi045.stdout: -5782> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004aa [2,head] #100000004aa auth v5388 s=3 n(v0 rc2023-10-03T19:13:42.803191+0000 b3 1=1+0) (iversion lock) 0x55cf62447700] 2023-10-03T19:20:53.185 INFO:teuthology.orchestra.run.smithi045.stdout: -5781> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_693 [2,head] auth NULL (dversion lock) v=5388 ino=(nil) state=1073741824 0x55cf62443900] 2023-10-03T19:20:53.185 INFO:teuthology.orchestra.run.smithi045.stdout: -5780> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_692 [2,head] auth (dversion lock) v=5386 ino=0x100000004a9 state=1073741824 0x55cf62443680] 2023-10-03T19:20:53.185 INFO:teuthology.orchestra.run.smithi045.stdout: -5779> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.185 INFO:teuthology.orchestra.run.smithi045.stdout: -5778> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004a9 [2,head] /dc-dir/dc-file_692 auth v5386 s=3 n(v0 rc2023-10-03T19:13:42.792361+0000 b3 1=1+0) (iversion lock) 0x55cf62447180] 2023-10-03T19:20:53.185 INFO:teuthology.orchestra.run.smithi045.stdout: -5777> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_692 [2,head] auth (dversion lock) v=5386 ino=0x100000004a9 state=1073741824 0x55cf62443680] [inode 0x100000004a9 [2,head] /dc-dir/dc-file_692 auth v5386 s=3 n(v0 rc2023-10-03T19:13:42.792361+0000 b3 1=1+0) (iversion lock) 0x55cf62447180] 2023-10-03T19:20:53.185 INFO:teuthology.orchestra.run.smithi045.stdout: -5776> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004a9 [2,head] #100000004a9 auth v5386 s=3 n(v0 rc2023-10-03T19:13:42.792361+0000 b3 1=1+0) (iversion lock) 0x55cf62447180] 2023-10-03T19:20:53.185 INFO:teuthology.orchestra.run.smithi045.stdout: -5775> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_692 [2,head] auth NULL (dversion lock) v=5386 ino=(nil) state=1073741824 0x55cf62443680] 2023-10-03T19:20:53.185 INFO:teuthology.orchestra.run.smithi045.stdout: -5774> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_691 [2,head] auth (dversion lock) v=5384 ino=0x100000004a8 state=1073741824 0x55cf62443400] 2023-10-03T19:20:53.185 INFO:teuthology.orchestra.run.smithi045.stdout: -5773> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.186 INFO:teuthology.orchestra.run.smithi045.stdout: -5772> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004a8 [2,head] /dc-dir/dc-file_691 auth v5384 s=3 n(v0 rc2023-10-03T19:13:42.780934+0000 b3 1=1+0) (iversion lock) 0x55cf62446c00] 2023-10-03T19:20:53.186 INFO:teuthology.orchestra.run.smithi045.stdout: -5771> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_691 [2,head] auth (dversion lock) v=5384 ino=0x100000004a8 state=1073741824 0x55cf62443400] [inode 0x100000004a8 [2,head] /dc-dir/dc-file_691 auth v5384 s=3 n(v0 rc2023-10-03T19:13:42.780934+0000 b3 1=1+0) (iversion lock) 0x55cf62446c00] 2023-10-03T19:20:53.186 INFO:teuthology.orchestra.run.smithi045.stdout: -5770> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004a8 [2,head] #100000004a8 auth v5384 s=3 n(v0 rc2023-10-03T19:13:42.780934+0000 b3 1=1+0) (iversion lock) 0x55cf62446c00] 2023-10-03T19:20:53.186 INFO:teuthology.orchestra.run.smithi045.stdout: -5769> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_691 [2,head] auth NULL (dversion lock) v=5384 ino=(nil) state=1073741824 0x55cf62443400] 2023-10-03T19:20:53.186 INFO:teuthology.orchestra.run.smithi045.stdout: -5768> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_690 [2,head] auth (dversion lock) v=5382 ino=0x100000004a7 state=1073741824 0x55cf62443180] 2023-10-03T19:20:53.186 INFO:teuthology.orchestra.run.smithi045.stdout: -5767> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.186 INFO:teuthology.orchestra.run.smithi045.stdout: -5766> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004a7 [2,head] /dc-dir/dc-file_690 auth v5382 s=3 n(v0 rc2023-10-03T19:13:42.769264+0000 b3 1=1+0) (iversion lock) 0x55cf62446680] 2023-10-03T19:20:53.186 INFO:teuthology.orchestra.run.smithi045.stdout: -5765> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_690 [2,head] auth (dversion lock) v=5382 ino=0x100000004a7 state=1073741824 0x55cf62443180] [inode 0x100000004a7 [2,head] /dc-dir/dc-file_690 auth v5382 s=3 n(v0 rc2023-10-03T19:13:42.769264+0000 b3 1=1+0) (iversion lock) 0x55cf62446680] 2023-10-03T19:20:53.186 INFO:teuthology.orchestra.run.smithi045.stdout: -5764> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004a7 [2,head] #100000004a7 auth v5382 s=3 n(v0 rc2023-10-03T19:13:42.769264+0000 b3 1=1+0) (iversion lock) 0x55cf62446680] 2023-10-03T19:20:53.187 INFO:teuthology.orchestra.run.smithi045.stdout: -5763> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_690 [2,head] auth NULL (dversion lock) v=5382 ino=(nil) state=1073741824 0x55cf62443180] 2023-10-03T19:20:53.187 INFO:teuthology.orchestra.run.smithi045.stdout: -5762> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_689 [2,head] auth (dversion lock) v=5380 ino=0x100000004a6 state=1073741824 0x55cf62442f00] 2023-10-03T19:20:53.187 INFO:teuthology.orchestra.run.smithi045.stdout: -5761> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.187 INFO:teuthology.orchestra.run.smithi045.stdout: -5760> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004a6 [2,head] /dc-dir/dc-file_689 auth v5380 s=3 n(v0 rc2023-10-03T19:13:42.758138+0000 b3 1=1+0) (iversion lock) 0x55cf62446100] 2023-10-03T19:20:53.187 INFO:teuthology.orchestra.run.smithi045.stdout: -5759> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_689 [2,head] auth (dversion lock) v=5380 ino=0x100000004a6 state=1073741824 0x55cf62442f00] [inode 0x100000004a6 [2,head] /dc-dir/dc-file_689 auth v5380 s=3 n(v0 rc2023-10-03T19:13:42.758138+0000 b3 1=1+0) (iversion lock) 0x55cf62446100] 2023-10-03T19:20:53.187 INFO:teuthology.orchestra.run.smithi045.stdout: -5758> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004a6 [2,head] #100000004a6 auth v5380 s=3 n(v0 rc2023-10-03T19:13:42.758138+0000 b3 1=1+0) (iversion lock) 0x55cf62446100] 2023-10-03T19:20:53.187 INFO:teuthology.orchestra.run.smithi045.stdout: -5757> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_689 [2,head] auth NULL (dversion lock) v=5380 ino=(nil) state=1073741824 0x55cf62442f00] 2023-10-03T19:20:53.187 INFO:teuthology.orchestra.run.smithi045.stdout: -5756> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_688 [2,head] auth (dversion lock) v=5378 ino=0x100000004a5 state=1073741824 0x55cf62442c80] 2023-10-03T19:20:53.187 INFO:teuthology.orchestra.run.smithi045.stdout: -5755> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.187 INFO:teuthology.orchestra.run.smithi045.stdout: -5754> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004a5 [2,head] /dc-dir/dc-file_688 auth v5378 s=3 n(v0 rc2023-10-03T19:13:42.747185+0000 b3 1=1+0) (iversion lock) 0x55cf62445b80] 2023-10-03T19:20:53.187 INFO:teuthology.orchestra.run.smithi045.stdout: -5753> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_688 [2,head] auth (dversion lock) v=5378 ino=0x100000004a5 state=1073741824 0x55cf62442c80] [inode 0x100000004a5 [2,head] /dc-dir/dc-file_688 auth v5378 s=3 n(v0 rc2023-10-03T19:13:42.747185+0000 b3 1=1+0) (iversion lock) 0x55cf62445b80] 2023-10-03T19:20:53.187 INFO:teuthology.orchestra.run.smithi045.stdout: -5752> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004a5 [2,head] #100000004a5 auth v5378 s=3 n(v0 rc2023-10-03T19:13:42.747185+0000 b3 1=1+0) (iversion lock) 0x55cf62445b80] 2023-10-03T19:20:53.188 INFO:teuthology.orchestra.run.smithi045.stdout: -5751> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_688 [2,head] auth NULL (dversion lock) v=5378 ino=(nil) state=1073741824 0x55cf62442c80] 2023-10-03T19:20:53.188 INFO:teuthology.orchestra.run.smithi045.stdout: -5750> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_687 [2,head] auth (dversion lock) v=5376 ino=0x100000004a4 state=1073741824 0x55cf62442a00] 2023-10-03T19:20:53.188 INFO:teuthology.orchestra.run.smithi045.stdout: -5749> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.188 INFO:teuthology.orchestra.run.smithi045.stdout: -5748> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004a4 [2,head] /dc-dir/dc-file_687 auth v5376 s=3 n(v0 rc2023-10-03T19:13:42.736228+0000 b3 1=1+0) (iversion lock) 0x55cf62445600] 2023-10-03T19:20:53.188 INFO:teuthology.orchestra.run.smithi045.stdout: -5747> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_687 [2,head] auth (dversion lock) v=5376 ino=0x100000004a4 state=1073741824 0x55cf62442a00] [inode 0x100000004a4 [2,head] /dc-dir/dc-file_687 auth v5376 s=3 n(v0 rc2023-10-03T19:13:42.736228+0000 b3 1=1+0) (iversion lock) 0x55cf62445600] 2023-10-03T19:20:53.188 INFO:teuthology.orchestra.run.smithi045.stdout: -5746> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004a4 [2,head] #100000004a4 auth v5376 s=3 n(v0 rc2023-10-03T19:13:42.736228+0000 b3 1=1+0) (iversion lock) 0x55cf62445600] 2023-10-03T19:20:53.188 INFO:teuthology.orchestra.run.smithi045.stdout: -5745> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_687 [2,head] auth NULL (dversion lock) v=5376 ino=(nil) state=1073741824 0x55cf62442a00] 2023-10-03T19:20:53.188 INFO:teuthology.orchestra.run.smithi045.stdout: -5744> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_686 [2,head] auth (dversion lock) v=5374 ino=0x100000004a3 state=1073741824 0x55cf62442780] 2023-10-03T19:20:53.188 INFO:teuthology.orchestra.run.smithi045.stdout: -5743> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.188 INFO:teuthology.orchestra.run.smithi045.stdout: -5742> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004a3 [2,head] /dc-dir/dc-file_686 auth v5374 s=3 n(v0 rc2023-10-03T19:13:42.725796+0000 b3 1=1+0) (iversion lock) 0x55cf62445080] 2023-10-03T19:20:53.188 INFO:teuthology.orchestra.run.smithi045.stdout: -5741> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_686 [2,head] auth (dversion lock) v=5374 ino=0x100000004a3 state=1073741824 0x55cf62442780] [inode 0x100000004a3 [2,head] /dc-dir/dc-file_686 auth v5374 s=3 n(v0 rc2023-10-03T19:13:42.725796+0000 b3 1=1+0) (iversion lock) 0x55cf62445080] 2023-10-03T19:20:53.189 INFO:teuthology.orchestra.run.smithi045.stdout: -5740> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004a3 [2,head] #100000004a3 auth v5374 s=3 n(v0 rc2023-10-03T19:13:42.725796+0000 b3 1=1+0) (iversion lock) 0x55cf62445080] 2023-10-03T19:20:53.189 INFO:teuthology.orchestra.run.smithi045.stdout: -5739> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_686 [2,head] auth NULL (dversion lock) v=5374 ino=(nil) state=1073741824 0x55cf62442780] 2023-10-03T19:20:53.189 INFO:teuthology.orchestra.run.smithi045.stdout: -5738> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_685 [2,head] auth (dversion lock) v=5372 ino=0x100000004a2 state=1073741824 0x55cf62442500] 2023-10-03T19:20:53.189 INFO:teuthology.orchestra.run.smithi045.stdout: -5737> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.189 INFO:teuthology.orchestra.run.smithi045.stdout: -5736> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004a2 [2,head] /dc-dir/dc-file_685 auth v5372 s=3 n(v0 rc2023-10-03T19:13:42.714241+0000 b3 1=1+0) (iversion lock) 0x55cf62444b00] 2023-10-03T19:20:53.189 INFO:teuthology.orchestra.run.smithi045.stdout: -5735> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_685 [2,head] auth (dversion lock) v=5372 ino=0x100000004a2 state=1073741824 0x55cf62442500] [inode 0x100000004a2 [2,head] /dc-dir/dc-file_685 auth v5372 s=3 n(v0 rc2023-10-03T19:13:42.714241+0000 b3 1=1+0) (iversion lock) 0x55cf62444b00] 2023-10-03T19:20:53.189 INFO:teuthology.orchestra.run.smithi045.stdout: -5734> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004a2 [2,head] #100000004a2 auth v5372 s=3 n(v0 rc2023-10-03T19:13:42.714241+0000 b3 1=1+0) (iversion lock) 0x55cf62444b00] 2023-10-03T19:20:53.189 INFO:teuthology.orchestra.run.smithi045.stdout: -5733> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_685 [2,head] auth NULL (dversion lock) v=5372 ino=(nil) state=1073741824 0x55cf62442500] 2023-10-03T19:20:53.190 INFO:teuthology.orchestra.run.smithi045.stdout: -5732> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_684 [2,head] auth (dversion lock) v=5370 ino=0x100000004a1 state=1073741824 0x55cf62442280] 2023-10-03T19:20:53.190 INFO:teuthology.orchestra.run.smithi045.stdout: -5731> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.190 INFO:teuthology.orchestra.run.smithi045.stdout: -5730> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004a1 [2,head] /dc-dir/dc-file_684 auth v5370 s=3 n(v0 rc2023-10-03T19:13:42.702434+0000 b3 1=1+0) (iversion lock) 0x55cf62444580] 2023-10-03T19:20:53.190 INFO:teuthology.orchestra.run.smithi045.stdout: -5729> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_684 [2,head] auth (dversion lock) v=5370 ino=0x100000004a1 state=1073741824 0x55cf62442280] [inode 0x100000004a1 [2,head] /dc-dir/dc-file_684 auth v5370 s=3 n(v0 rc2023-10-03T19:13:42.702434+0000 b3 1=1+0) (iversion lock) 0x55cf62444580] 2023-10-03T19:20:53.190 INFO:teuthology.orchestra.run.smithi045.stdout: -5728> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004a1 [2,head] #100000004a1 auth v5370 s=3 n(v0 rc2023-10-03T19:13:42.702434+0000 b3 1=1+0) (iversion lock) 0x55cf62444580] 2023-10-03T19:20:53.190 INFO:teuthology.orchestra.run.smithi045.stdout: -5727> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_684 [2,head] auth NULL (dversion lock) v=5370 ino=(nil) state=1073741824 0x55cf62442280] 2023-10-03T19:20:53.190 INFO:teuthology.orchestra.run.smithi045.stdout: -5726> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_683 [2,head] auth (dversion lock) v=5368 ino=0x100000004a0 state=1073741824 0x55cf62442000] 2023-10-03T19:20:53.190 INFO:teuthology.orchestra.run.smithi045.stdout: -5725> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.190 INFO:teuthology.orchestra.run.smithi045.stdout: -5724> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000004a0 [2,head] /dc-dir/dc-file_683 auth v5368 s=3 n(v0 rc2023-10-03T19:13:42.691499+0000 b3 1=1+0) (iversion lock) 0x55cf62444000] 2023-10-03T19:20:53.190 INFO:teuthology.orchestra.run.smithi045.stdout: -5723> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_683 [2,head] auth (dversion lock) v=5368 ino=0x100000004a0 state=1073741824 0x55cf62442000] [inode 0x100000004a0 [2,head] /dc-dir/dc-file_683 auth v5368 s=3 n(v0 rc2023-10-03T19:13:42.691499+0000 b3 1=1+0) (iversion lock) 0x55cf62444000] 2023-10-03T19:20:53.190 INFO:teuthology.orchestra.run.smithi045.stdout: -5722> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000004a0 [2,head] #100000004a0 auth v5368 s=3 n(v0 rc2023-10-03T19:13:42.691499+0000 b3 1=1+0) (iversion lock) 0x55cf62444000] 2023-10-03T19:20:53.191 INFO:teuthology.orchestra.run.smithi045.stdout: -5721> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_683 [2,head] auth NULL (dversion lock) v=5368 ino=(nil) state=1073741824 0x55cf62442000] 2023-10-03T19:20:53.191 INFO:teuthology.orchestra.run.smithi045.stdout: -5720> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_682 [2,head] auth (dversion lock) v=5366 ino=0x1000000049f state=1073741824 0x55cf6241fb80] 2023-10-03T19:20:53.191 INFO:teuthology.orchestra.run.smithi045.stdout: -5719> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.191 INFO:teuthology.orchestra.run.smithi045.stdout: -5718> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000049f [2,head] /dc-dir/dc-file_682 auth v5366 s=3 n(v0 rc2023-10-03T19:13:42.679824+0000 b3 1=1+0) (iversion lock) 0x55cf62423700] 2023-10-03T19:20:53.191 INFO:teuthology.orchestra.run.smithi045.stdout: -5717> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_682 [2,head] auth (dversion lock) v=5366 ino=0x1000000049f state=1073741824 0x55cf6241fb80] [inode 0x1000000049f [2,head] /dc-dir/dc-file_682 auth v5366 s=3 n(v0 rc2023-10-03T19:13:42.679824+0000 b3 1=1+0) (iversion lock) 0x55cf62423700] 2023-10-03T19:20:53.191 INFO:teuthology.orchestra.run.smithi045.stdout: -5716> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000049f [2,head] #1000000049f auth v5366 s=3 n(v0 rc2023-10-03T19:13:42.679824+0000 b3 1=1+0) (iversion lock) 0x55cf62423700] 2023-10-03T19:20:53.191 INFO:teuthology.orchestra.run.smithi045.stdout: -5715> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_682 [2,head] auth NULL (dversion lock) v=5366 ino=(nil) state=1073741824 0x55cf6241fb80] 2023-10-03T19:20:53.191 INFO:teuthology.orchestra.run.smithi045.stdout: -5714> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_681 [2,head] auth (dversion lock) v=5364 ino=0x1000000049e state=1073741824 0x55cf6241f900] 2023-10-03T19:20:53.191 INFO:teuthology.orchestra.run.smithi045.stdout: -5713> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.191 INFO:teuthology.orchestra.run.smithi045.stdout: -5712> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000049e [2,head] /dc-dir/dc-file_681 auth v5364 s=3 n(v0 rc2023-10-03T19:13:42.668794+0000 b3 1=1+0) (iversion lock) 0x55cf62423180] 2023-10-03T19:20:53.191 INFO:teuthology.orchestra.run.smithi045.stdout: -5711> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_681 [2,head] auth (dversion lock) v=5364 ino=0x1000000049e state=1073741824 0x55cf6241f900] [inode 0x1000000049e [2,head] /dc-dir/dc-file_681 auth v5364 s=3 n(v0 rc2023-10-03T19:13:42.668794+0000 b3 1=1+0) (iversion lock) 0x55cf62423180] 2023-10-03T19:20:53.191 INFO:teuthology.orchestra.run.smithi045.stdout: -5710> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000049e [2,head] #1000000049e auth v5364 s=3 n(v0 rc2023-10-03T19:13:42.668794+0000 b3 1=1+0) (iversion lock) 0x55cf62423180] 2023-10-03T19:20:53.192 INFO:teuthology.orchestra.run.smithi045.stdout: -5709> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_681 [2,head] auth NULL (dversion lock) v=5364 ino=(nil) state=1073741824 0x55cf6241f900] 2023-10-03T19:20:53.192 INFO:teuthology.orchestra.run.smithi045.stdout: -5708> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_680 [2,head] auth (dversion lock) v=5362 ino=0x1000000049d state=1073741824 0x55cf6241f680] 2023-10-03T19:20:53.192 INFO:teuthology.orchestra.run.smithi045.stdout: -5707> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.192 INFO:teuthology.orchestra.run.smithi045.stdout: -5706> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000049d [2,head] /dc-dir/dc-file_680 auth v5362 s=3 n(v0 rc2023-10-03T19:13:42.657392+0000 b3 1=1+0) (iversion lock) 0x55cf62422c00] 2023-10-03T19:20:53.192 INFO:teuthology.orchestra.run.smithi045.stdout: -5705> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_680 [2,head] auth (dversion lock) v=5362 ino=0x1000000049d state=1073741824 0x55cf6241f680] [inode 0x1000000049d [2,head] /dc-dir/dc-file_680 auth v5362 s=3 n(v0 rc2023-10-03T19:13:42.657392+0000 b3 1=1+0) (iversion lock) 0x55cf62422c00] 2023-10-03T19:20:53.192 INFO:teuthology.orchestra.run.smithi045.stdout: -5704> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000049d [2,head] #1000000049d auth v5362 s=3 n(v0 rc2023-10-03T19:13:42.657392+0000 b3 1=1+0) (iversion lock) 0x55cf62422c00] 2023-10-03T19:20:53.192 INFO:teuthology.orchestra.run.smithi045.stdout: -5703> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_680 [2,head] auth NULL (dversion lock) v=5362 ino=(nil) state=1073741824 0x55cf6241f680] 2023-10-03T19:20:53.192 INFO:teuthology.orchestra.run.smithi045.stdout: -5702> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_679 [2,head] auth (dversion lock) v=5360 ino=0x1000000049c state=1073741824 0x55cf6241f400] 2023-10-03T19:20:53.192 INFO:teuthology.orchestra.run.smithi045.stdout: -5701> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.192 INFO:teuthology.orchestra.run.smithi045.stdout: -5700> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000049c [2,head] /dc-dir/dc-file_679 auth v5360 s=3 n(v0 rc2023-10-03T19:13:42.645053+0000 b3 1=1+0) (iversion lock) 0x55cf62422680] 2023-10-03T19:20:53.193 INFO:teuthology.orchestra.run.smithi045.stdout: -5699> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_679 [2,head] auth (dversion lock) v=5360 ino=0x1000000049c state=1073741824 0x55cf6241f400] [inode 0x1000000049c [2,head] /dc-dir/dc-file_679 auth v5360 s=3 n(v0 rc2023-10-03T19:13:42.645053+0000 b3 1=1+0) (iversion lock) 0x55cf62422680] 2023-10-03T19:20:53.193 INFO:teuthology.orchestra.run.smithi045.stdout: -5698> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000049c [2,head] #1000000049c auth v5360 s=3 n(v0 rc2023-10-03T19:13:42.645053+0000 b3 1=1+0) (iversion lock) 0x55cf62422680] 2023-10-03T19:20:53.193 INFO:teuthology.orchestra.run.smithi045.stdout: -5697> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_679 [2,head] auth NULL (dversion lock) v=5360 ino=(nil) state=1073741824 0x55cf6241f400] 2023-10-03T19:20:53.193 INFO:teuthology.orchestra.run.smithi045.stdout: -5696> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_678 [2,head] auth (dversion lock) v=5358 ino=0x1000000049b state=1073741824 0x55cf6241f180] 2023-10-03T19:20:53.193 INFO:teuthology.orchestra.run.smithi045.stdout: -5695> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.264 INFO:teuthology.orchestra.run.smithi045.stdout: -5694> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000049b [2,head] /dc-dir/dc-file_678 auth v5358 s=3 n(v0 rc2023-10-03T19:13:42.634369+0000 b3 1=1+0) (iversion lock) 0x55cf62422100] 2023-10-03T19:20:53.265 INFO:teuthology.orchestra.run.smithi045.stdout: -5693> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_678 [2,head] auth (dversion lock) v=5358 ino=0x1000000049b state=1073741824 0x55cf6241f180] [inode 0x1000000049b [2,head] /dc-dir/dc-file_678 auth v5358 s=3 n(v0 rc2023-10-03T19:13:42.634369+0000 b3 1=1+0) (iversion lock) 0x55cf62422100] 2023-10-03T19:20:53.265 INFO:teuthology.orchestra.run.smithi045.stdout: -5692> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000049b [2,head] #1000000049b auth v5358 s=3 n(v0 rc2023-10-03T19:13:42.634369+0000 b3 1=1+0) (iversion lock) 0x55cf62422100] 2023-10-03T19:20:53.265 INFO:teuthology.orchestra.run.smithi045.stdout: -5691> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_678 [2,head] auth NULL (dversion lock) v=5358 ino=(nil) state=1073741824 0x55cf6241f180] 2023-10-03T19:20:53.265 INFO:teuthology.orchestra.run.smithi045.stdout: -5690> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_677 [2,head] auth (dversion lock) v=5356 ino=0x1000000049a state=1073741824 0x55cf6241ef00] 2023-10-03T19:20:53.265 INFO:teuthology.orchestra.run.smithi045.stdout: -5689> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.265 INFO:teuthology.orchestra.run.smithi045.stdout: -5688> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000049a [2,head] /dc-dir/dc-file_677 auth v5356 s=3 n(v0 rc2023-10-03T19:13:42.623178+0000 b3 1=1+0) (iversion lock) 0x55cf62421b80] 2023-10-03T19:20:53.265 INFO:teuthology.orchestra.run.smithi045.stdout: -5687> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_677 [2,head] auth (dversion lock) v=5356 ino=0x1000000049a state=1073741824 0x55cf6241ef00] [inode 0x1000000049a [2,head] /dc-dir/dc-file_677 auth v5356 s=3 n(v0 rc2023-10-03T19:13:42.623178+0000 b3 1=1+0) (iversion lock) 0x55cf62421b80] 2023-10-03T19:20:53.265 INFO:teuthology.orchestra.run.smithi045.stdout: -5686> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000049a [2,head] #1000000049a auth v5356 s=3 n(v0 rc2023-10-03T19:13:42.623178+0000 b3 1=1+0) (iversion lock) 0x55cf62421b80] 2023-10-03T19:20:53.265 INFO:teuthology.orchestra.run.smithi045.stdout: -5685> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_677 [2,head] auth NULL (dversion lock) v=5356 ino=(nil) state=1073741824 0x55cf6241ef00] 2023-10-03T19:20:53.265 INFO:teuthology.orchestra.run.smithi045.stdout: -5684> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_676 [2,head] auth (dversion lock) v=5354 ino=0x10000000499 state=1073741824 0x55cf6241ec80] 2023-10-03T19:20:53.265 INFO:teuthology.orchestra.run.smithi045.stdout: -5683> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.266 INFO:teuthology.orchestra.run.smithi045.stdout: -5682> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000499 [2,head] /dc-dir/dc-file_676 auth v5354 s=3 n(v0 rc2023-10-03T19:13:42.612272+0000 b3 1=1+0) (iversion lock) 0x55cf62421600] 2023-10-03T19:20:53.266 INFO:teuthology.orchestra.run.smithi045.stdout: -5681> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_676 [2,head] auth (dversion lock) v=5354 ino=0x10000000499 state=1073741824 0x55cf6241ec80] [inode 0x10000000499 [2,head] /dc-dir/dc-file_676 auth v5354 s=3 n(v0 rc2023-10-03T19:13:42.612272+0000 b3 1=1+0) (iversion lock) 0x55cf62421600] 2023-10-03T19:20:53.266 INFO:teuthology.orchestra.run.smithi045.stdout: -5680> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000499 [2,head] #10000000499 auth v5354 s=3 n(v0 rc2023-10-03T19:13:42.612272+0000 b3 1=1+0) (iversion lock) 0x55cf62421600] 2023-10-03T19:20:53.266 INFO:teuthology.orchestra.run.smithi045.stdout: -5679> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_676 [2,head] auth NULL (dversion lock) v=5354 ino=(nil) state=1073741824 0x55cf6241ec80] 2023-10-03T19:20:53.266 INFO:teuthology.orchestra.run.smithi045.stdout: -5678> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_675 [2,head] auth (dversion lock) v=5352 ino=0x10000000498 state=1073741824 0x55cf6241ea00] 2023-10-03T19:20:53.266 INFO:teuthology.orchestra.run.smithi045.stdout: -5677> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.266 INFO:teuthology.orchestra.run.smithi045.stdout: -5676> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000498 [2,head] /dc-dir/dc-file_675 auth v5352 s=3 n(v0 rc2023-10-03T19:13:42.601242+0000 b3 1=1+0) (iversion lock) 0x55cf62421080] 2023-10-03T19:20:53.266 INFO:teuthology.orchestra.run.smithi045.stdout: -5675> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_675 [2,head] auth (dversion lock) v=5352 ino=0x10000000498 state=1073741824 0x55cf6241ea00] [inode 0x10000000498 [2,head] /dc-dir/dc-file_675 auth v5352 s=3 n(v0 rc2023-10-03T19:13:42.601242+0000 b3 1=1+0) (iversion lock) 0x55cf62421080] 2023-10-03T19:20:53.266 INFO:teuthology.orchestra.run.smithi045.stdout: -5674> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000498 [2,head] #10000000498 auth v5352 s=3 n(v0 rc2023-10-03T19:13:42.601242+0000 b3 1=1+0) (iversion lock) 0x55cf62421080] 2023-10-03T19:20:53.266 INFO:teuthology.orchestra.run.smithi045.stdout: -5673> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_675 [2,head] auth NULL (dversion lock) v=5352 ino=(nil) state=1073741824 0x55cf6241ea00] 2023-10-03T19:20:53.267 INFO:teuthology.orchestra.run.smithi045.stdout: -5672> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_674 [2,head] auth (dversion lock) v=5350 ino=0x10000000497 state=1073741824 0x55cf6241e780] 2023-10-03T19:20:53.267 INFO:teuthology.orchestra.run.smithi045.stdout: -5671> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.267 INFO:teuthology.orchestra.run.smithi045.stdout: -5670> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000497 [2,head] /dc-dir/dc-file_674 auth v5350 s=3 n(v0 rc2023-10-03T19:13:42.504539+0000 b3 1=1+0) (iversion lock) 0x55cf62420b00] 2023-10-03T19:20:53.267 INFO:teuthology.orchestra.run.smithi045.stdout: -5669> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_674 [2,head] auth (dversion lock) v=5350 ino=0x10000000497 state=1073741824 0x55cf6241e780] [inode 0x10000000497 [2,head] /dc-dir/dc-file_674 auth v5350 s=3 n(v0 rc2023-10-03T19:13:42.504539+0000 b3 1=1+0) (iversion lock) 0x55cf62420b00] 2023-10-03T19:20:53.267 INFO:teuthology.orchestra.run.smithi045.stdout: -5668> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000497 [2,head] #10000000497 auth v5350 s=3 n(v0 rc2023-10-03T19:13:42.504539+0000 b3 1=1+0) (iversion lock) 0x55cf62420b00] 2023-10-03T19:20:53.267 INFO:teuthology.orchestra.run.smithi045.stdout: -5667> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_674 [2,head] auth NULL (dversion lock) v=5350 ino=(nil) state=1073741824 0x55cf6241e780] 2023-10-03T19:20:53.267 INFO:teuthology.orchestra.run.smithi045.stdout: -5666> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_673 [2,head] auth (dversion lock) v=5348 ino=0x10000000496 state=1073741824 0x55cf6241e500] 2023-10-03T19:20:53.267 INFO:teuthology.orchestra.run.smithi045.stdout: -5665> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.267 INFO:teuthology.orchestra.run.smithi045.stdout: -5664> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000496 [2,head] /dc-dir/dc-file_673 auth v5348 s=3 n(v0 rc2023-10-03T19:13:42.485814+0000 b3 1=1+0) (iversion lock) 0x55cf62420580] 2023-10-03T19:20:53.267 INFO:teuthology.orchestra.run.smithi045.stdout: -5663> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_673 [2,head] auth (dversion lock) v=5348 ino=0x10000000496 state=1073741824 0x55cf6241e500] [inode 0x10000000496 [2,head] /dc-dir/dc-file_673 auth v5348 s=3 n(v0 rc2023-10-03T19:13:42.485814+0000 b3 1=1+0) (iversion lock) 0x55cf62420580] 2023-10-03T19:20:53.267 INFO:teuthology.orchestra.run.smithi045.stdout: -5662> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000496 [2,head] #10000000496 auth v5348 s=3 n(v0 rc2023-10-03T19:13:42.485814+0000 b3 1=1+0) (iversion lock) 0x55cf62420580] 2023-10-03T19:20:53.268 INFO:teuthology.orchestra.run.smithi045.stdout: -5661> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_673 [2,head] auth NULL (dversion lock) v=5348 ino=(nil) state=1073741824 0x55cf6241e500] 2023-10-03T19:20:53.268 INFO:teuthology.orchestra.run.smithi045.stdout: -5660> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_672 [2,head] auth (dversion lock) v=5346 ino=0x10000000495 state=1073741824 0x55cf6241e280] 2023-10-03T19:20:53.268 INFO:teuthology.orchestra.run.smithi045.stdout: -5659> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.268 INFO:teuthology.orchestra.run.smithi045.stdout: -5658> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000495 [2,head] /dc-dir/dc-file_672 auth v5346 s=3 n(v0 rc2023-10-03T19:13:42.474985+0000 b3 1=1+0) (iversion lock) 0x55cf62420000] 2023-10-03T19:20:53.268 INFO:teuthology.orchestra.run.smithi045.stdout: -5657> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_672 [2,head] auth (dversion lock) v=5346 ino=0x10000000495 state=1073741824 0x55cf6241e280] [inode 0x10000000495 [2,head] /dc-dir/dc-file_672 auth v5346 s=3 n(v0 rc2023-10-03T19:13:42.474985+0000 b3 1=1+0) (iversion lock) 0x55cf62420000] 2023-10-03T19:20:53.268 INFO:teuthology.orchestra.run.smithi045.stdout: -5656> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000495 [2,head] #10000000495 auth v5346 s=3 n(v0 rc2023-10-03T19:13:42.474985+0000 b3 1=1+0) (iversion lock) 0x55cf62420000] 2023-10-03T19:20:53.268 INFO:teuthology.orchestra.run.smithi045.stdout: -5655> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_672 [2,head] auth NULL (dversion lock) v=5346 ino=(nil) state=1073741824 0x55cf6241e280] 2023-10-03T19:20:53.268 INFO:teuthology.orchestra.run.smithi045.stdout: -5654> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_671 [2,head] auth (dversion lock) v=5344 ino=0x10000000494 state=1073741824 0x55cf6241e000] 2023-10-03T19:20:53.268 INFO:teuthology.orchestra.run.smithi045.stdout: -5653> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.268 INFO:teuthology.orchestra.run.smithi045.stdout: -5652> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000494 [2,head] /dc-dir/dc-file_671 auth v5344 s=3 n(v0 rc2023-10-03T19:13:42.464115+0000 b3 1=1+0) (iversion lock) 0x55cf6241b700] 2023-10-03T19:20:53.268 INFO:teuthology.orchestra.run.smithi045.stdout: -5651> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_671 [2,head] auth (dversion lock) v=5344 ino=0x10000000494 state=1073741824 0x55cf6241e000] [inode 0x10000000494 [2,head] /dc-dir/dc-file_671 auth v5344 s=3 n(v0 rc2023-10-03T19:13:42.464115+0000 b3 1=1+0) (iversion lock) 0x55cf6241b700] 2023-10-03T19:20:53.269 INFO:teuthology.orchestra.run.smithi045.stdout: -5650> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000494 [2,head] #10000000494 auth v5344 s=3 n(v0 rc2023-10-03T19:13:42.464115+0000 b3 1=1+0) (iversion lock) 0x55cf6241b700] 2023-10-03T19:20:53.269 INFO:teuthology.orchestra.run.smithi045.stdout: -5649> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_671 [2,head] auth NULL (dversion lock) v=5344 ino=(nil) state=1073741824 0x55cf6241e000] 2023-10-03T19:20:53.269 INFO:teuthology.orchestra.run.smithi045.stdout: -5648> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_670 [2,head] auth (dversion lock) v=5342 ino=0x10000000493 state=1073741824 0x55cf62417b80] 2023-10-03T19:20:53.269 INFO:teuthology.orchestra.run.smithi045.stdout: -5647> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.269 INFO:teuthology.orchestra.run.smithi045.stdout: -5646> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000493 [2,head] /dc-dir/dc-file_670 auth v5342 s=3 n(v0 rc2023-10-03T19:13:42.452581+0000 b3 1=1+0) (iversion lock) 0x55cf6241b180] 2023-10-03T19:20:53.269 INFO:teuthology.orchestra.run.smithi045.stdout: -5645> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_670 [2,head] auth (dversion lock) v=5342 ino=0x10000000493 state=1073741824 0x55cf62417b80] [inode 0x10000000493 [2,head] /dc-dir/dc-file_670 auth v5342 s=3 n(v0 rc2023-10-03T19:13:42.452581+0000 b3 1=1+0) (iversion lock) 0x55cf6241b180] 2023-10-03T19:20:53.269 INFO:teuthology.orchestra.run.smithi045.stdout: -5644> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000493 [2,head] #10000000493 auth v5342 s=3 n(v0 rc2023-10-03T19:13:42.452581+0000 b3 1=1+0) (iversion lock) 0x55cf6241b180] 2023-10-03T19:20:53.269 INFO:teuthology.orchestra.run.smithi045.stdout: -5643> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_670 [2,head] auth NULL (dversion lock) v=5342 ino=(nil) state=1073741824 0x55cf62417b80] 2023-10-03T19:20:53.269 INFO:teuthology.orchestra.run.smithi045.stdout: -5642> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_669 [2,head] auth (dversion lock) v=5340 ino=0x10000000492 state=1073741824 0x55cf62417900] 2023-10-03T19:20:53.269 INFO:teuthology.orchestra.run.smithi045.stdout: -5641> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.270 INFO:teuthology.orchestra.run.smithi045.stdout: -5640> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000492 [2,head] /dc-dir/dc-file_669 auth v5340 s=3 n(v0 rc2023-10-03T19:13:42.440685+0000 b3 1=1+0) (iversion lock) 0x55cf6241ac00] 2023-10-03T19:20:53.270 INFO:teuthology.orchestra.run.smithi045.stdout: -5639> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_669 [2,head] auth (dversion lock) v=5340 ino=0x10000000492 state=1073741824 0x55cf62417900] [inode 0x10000000492 [2,head] /dc-dir/dc-file_669 auth v5340 s=3 n(v0 rc2023-10-03T19:13:42.440685+0000 b3 1=1+0) (iversion lock) 0x55cf6241ac00] 2023-10-03T19:20:53.270 INFO:teuthology.orchestra.run.smithi045.stdout: -5638> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000492 [2,head] #10000000492 auth v5340 s=3 n(v0 rc2023-10-03T19:13:42.440685+0000 b3 1=1+0) (iversion lock) 0x55cf6241ac00] 2023-10-03T19:20:53.270 INFO:teuthology.orchestra.run.smithi045.stdout: -5637> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_669 [2,head] auth NULL (dversion lock) v=5340 ino=(nil) state=1073741824 0x55cf62417900] 2023-10-03T19:20:53.270 INFO:teuthology.orchestra.run.smithi045.stdout: -5636> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_668 [2,head] auth (dversion lock) v=5338 ino=0x10000000491 state=1073741824 0x55cf62417680] 2023-10-03T19:20:53.354 INFO:teuthology.orchestra.run.smithi045.stdout: -5635> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.354 INFO:teuthology.orchestra.run.smithi045.stdout: -5634> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000491 [2,head] /dc-dir/dc-file_668 auth v5338 s=3 n(v0 rc2023-10-03T19:13:42.428810+0000 b3 1=1+0) (iversion lock) 0x55cf6241a680] 2023-10-03T19:20:53.354 INFO:teuthology.orchestra.run.smithi045.stdout: -5633> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_668 [2,head] auth (dversion lock) v=5338 ino=0x10000000491 state=1073741824 0x55cf62417680] [inode 0x10000000491 [2,head] /dc-dir/dc-file_668 auth v5338 s=3 n(v0 rc2023-10-03T19:13:42.428810+0000 b3 1=1+0) (iversion lock) 0x55cf6241a680] 2023-10-03T19:20:53.354 INFO:teuthology.orchestra.run.smithi045.stdout: -5632> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000491 [2,head] #10000000491 auth v5338 s=3 n(v0 rc2023-10-03T19:13:42.428810+0000 b3 1=1+0) (iversion lock) 0x55cf6241a680] 2023-10-03T19:20:53.354 INFO:teuthology.orchestra.run.smithi045.stdout: -5631> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_668 [2,head] auth NULL (dversion lock) v=5338 ino=(nil) state=1073741824 0x55cf62417680] 2023-10-03T19:20:53.354 INFO:teuthology.orchestra.run.smithi045.stdout: -5630> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_667 [2,head] auth (dversion lock) v=5336 ino=0x10000000490 state=1073741824 0x55cf62417400] 2023-10-03T19:20:53.354 INFO:teuthology.orchestra.run.smithi045.stdout: -5629> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.355 INFO:teuthology.orchestra.run.smithi045.stdout: -5628> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000490 [2,head] /dc-dir/dc-file_667 auth v5336 s=3 n(v0 rc2023-10-03T19:13:42.416971+0000 b3 1=1+0) (iversion lock) 0x55cf6241a100] 2023-10-03T19:20:53.355 INFO:teuthology.orchestra.run.smithi045.stdout: -5627> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_667 [2,head] auth (dversion lock) v=5336 ino=0x10000000490 state=1073741824 0x55cf62417400] [inode 0x10000000490 [2,head] /dc-dir/dc-file_667 auth v5336 s=3 n(v0 rc2023-10-03T19:13:42.416971+0000 b3 1=1+0) (iversion lock) 0x55cf6241a100] 2023-10-03T19:20:53.355 INFO:teuthology.orchestra.run.smithi045.stdout: -5626> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000490 [2,head] #10000000490 auth v5336 s=3 n(v0 rc2023-10-03T19:13:42.416971+0000 b3 1=1+0) (iversion lock) 0x55cf6241a100] 2023-10-03T19:20:53.355 INFO:teuthology.orchestra.run.smithi045.stdout: -5625> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_667 [2,head] auth NULL (dversion lock) v=5336 ino=(nil) state=1073741824 0x55cf62417400] 2023-10-03T19:20:53.355 INFO:teuthology.orchestra.run.smithi045.stdout: -5624> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_666 [2,head] auth (dversion lock) v=5334 ino=0x1000000048f state=1073741824 0x55cf62417180] 2023-10-03T19:20:53.355 INFO:teuthology.orchestra.run.smithi045.stdout: -5623> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.355 INFO:teuthology.orchestra.run.smithi045.stdout: -5622> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000048f [2,head] /dc-dir/dc-file_666 auth v5334 s=3 n(v0 rc2023-10-03T19:13:42.404663+0000 b3 1=1+0) (iversion lock) 0x55cf62419b80] 2023-10-03T19:20:53.355 INFO:teuthology.orchestra.run.smithi045.stdout: -5621> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_666 [2,head] auth (dversion lock) v=5334 ino=0x1000000048f state=1073741824 0x55cf62417180] [inode 0x1000000048f [2,head] /dc-dir/dc-file_666 auth v5334 s=3 n(v0 rc2023-10-03T19:13:42.404663+0000 b3 1=1+0) (iversion lock) 0x55cf62419b80] 2023-10-03T19:20:53.355 INFO:teuthology.orchestra.run.smithi045.stdout: -5620> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000048f [2,head] #1000000048f auth v5334 s=3 n(v0 rc2023-10-03T19:13:42.404663+0000 b3 1=1+0) (iversion lock) 0x55cf62419b80] 2023-10-03T19:20:53.356 INFO:teuthology.orchestra.run.smithi045.stdout: -5619> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_666 [2,head] auth NULL (dversion lock) v=5334 ino=(nil) state=1073741824 0x55cf62417180] 2023-10-03T19:20:53.356 INFO:teuthology.orchestra.run.smithi045.stdout: -5618> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_665 [2,head] auth (dversion lock) v=5332 ino=0x1000000048e state=1073741824 0x55cf62416f00] 2023-10-03T19:20:53.356 INFO:teuthology.orchestra.run.smithi045.stdout: -5617> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.356 INFO:teuthology.orchestra.run.smithi045.stdout: -5616> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000048e [2,head] /dc-dir/dc-file_665 auth v5332 s=3 n(v0 rc2023-10-03T19:13:42.393282+0000 b3 1=1+0) (iversion lock) 0x55cf62419600] 2023-10-03T19:20:53.356 INFO:teuthology.orchestra.run.smithi045.stdout: -5615> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_665 [2,head] auth (dversion lock) v=5332 ino=0x1000000048e state=1073741824 0x55cf62416f00] [inode 0x1000000048e [2,head] /dc-dir/dc-file_665 auth v5332 s=3 n(v0 rc2023-10-03T19:13:42.393282+0000 b3 1=1+0) (iversion lock) 0x55cf62419600] 2023-10-03T19:20:53.356 INFO:teuthology.orchestra.run.smithi045.stdout: -5614> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000048e [2,head] #1000000048e auth v5332 s=3 n(v0 rc2023-10-03T19:13:42.393282+0000 b3 1=1+0) (iversion lock) 0x55cf62419600] 2023-10-03T19:20:53.356 INFO:teuthology.orchestra.run.smithi045.stdout: -5613> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_665 [2,head] auth NULL (dversion lock) v=5332 ino=(nil) state=1073741824 0x55cf62416f00] 2023-10-03T19:20:53.356 INFO:teuthology.orchestra.run.smithi045.stdout: -5612> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_664 [2,head] auth (dversion lock) v=5330 ino=0x1000000048d state=1073741824 0x55cf62416c80] 2023-10-03T19:20:53.356 INFO:teuthology.orchestra.run.smithi045.stdout: -5611> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.356 INFO:teuthology.orchestra.run.smithi045.stdout: -5610> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000048d [2,head] /dc-dir/dc-file_664 auth v5330 s=3 n(v0 rc2023-10-03T19:13:42.382282+0000 b3 1=1+0) (iversion lock) 0x55cf62419080] 2023-10-03T19:20:53.357 INFO:teuthology.orchestra.run.smithi045.stdout: -5609> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_664 [2,head] auth (dversion lock) v=5330 ino=0x1000000048d state=1073741824 0x55cf62416c80] [inode 0x1000000048d [2,head] /dc-dir/dc-file_664 auth v5330 s=3 n(v0 rc2023-10-03T19:13:42.382282+0000 b3 1=1+0) (iversion lock) 0x55cf62419080] 2023-10-03T19:20:53.357 INFO:teuthology.orchestra.run.smithi045.stdout: -5608> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000048d [2,head] #1000000048d auth v5330 s=3 n(v0 rc2023-10-03T19:13:42.382282+0000 b3 1=1+0) (iversion lock) 0x55cf62419080] 2023-10-03T19:20:53.357 INFO:teuthology.orchestra.run.smithi045.stdout: -5607> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_664 [2,head] auth NULL (dversion lock) v=5330 ino=(nil) state=1073741824 0x55cf62416c80] 2023-10-03T19:20:53.357 INFO:teuthology.orchestra.run.smithi045.stdout: -5606> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_663 [2,head] auth (dversion lock) v=5328 ino=0x1000000048c state=1073741824 0x55cf62416a00] 2023-10-03T19:20:53.357 INFO:teuthology.orchestra.run.smithi045.stdout: -5605> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.357 INFO:teuthology.orchestra.run.smithi045.stdout: -5604> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000048c [2,head] /dc-dir/dc-file_663 auth v5328 s=3 n(v0 rc2023-10-03T19:13:42.371705+0000 b3 1=1+0) (iversion lock) 0x55cf62418b00] 2023-10-03T19:20:53.357 INFO:teuthology.orchestra.run.smithi045.stdout: -5603> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_663 [2,head] auth (dversion lock) v=5328 ino=0x1000000048c state=1073741824 0x55cf62416a00] [inode 0x1000000048c [2,head] /dc-dir/dc-file_663 auth v5328 s=3 n(v0 rc2023-10-03T19:13:42.371705+0000 b3 1=1+0) (iversion lock) 0x55cf62418b00] 2023-10-03T19:20:53.357 INFO:teuthology.orchestra.run.smithi045.stdout: -5602> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000048c [2,head] #1000000048c auth v5328 s=3 n(v0 rc2023-10-03T19:13:42.371705+0000 b3 1=1+0) (iversion lock) 0x55cf62418b00] 2023-10-03T19:20:53.357 INFO:teuthology.orchestra.run.smithi045.stdout: -5601> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_663 [2,head] auth NULL (dversion lock) v=5328 ino=(nil) state=1073741824 0x55cf62416a00] 2023-10-03T19:20:53.357 INFO:teuthology.orchestra.run.smithi045.stdout: -5600> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_662 [2,head] auth (dversion lock) v=5326 ino=0x1000000048b state=1073741824 0x55cf62416780] 2023-10-03T19:20:53.357 INFO:teuthology.orchestra.run.smithi045.stdout: -5599> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.358 INFO:teuthology.orchestra.run.smithi045.stdout: -5598> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000048b [2,head] /dc-dir/dc-file_662 auth v5326 s=3 n(v0 rc2023-10-03T19:13:42.361033+0000 b3 1=1+0) (iversion lock) 0x55cf62418580] 2023-10-03T19:20:53.358 INFO:teuthology.orchestra.run.smithi045.stdout: -5597> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_662 [2,head] auth (dversion lock) v=5326 ino=0x1000000048b state=1073741824 0x55cf62416780] [inode 0x1000000048b [2,head] /dc-dir/dc-file_662 auth v5326 s=3 n(v0 rc2023-10-03T19:13:42.361033+0000 b3 1=1+0) (iversion lock) 0x55cf62418580] 2023-10-03T19:20:53.358 INFO:teuthology.orchestra.run.smithi045.stdout: -5596> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000048b [2,head] #1000000048b auth v5326 s=3 n(v0 rc2023-10-03T19:13:42.361033+0000 b3 1=1+0) (iversion lock) 0x55cf62418580] 2023-10-03T19:20:53.358 INFO:teuthology.orchestra.run.smithi045.stdout: -5595> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_662 [2,head] auth NULL (dversion lock) v=5326 ino=(nil) state=1073741824 0x55cf62416780] 2023-10-03T19:20:53.358 INFO:teuthology.orchestra.run.smithi045.stdout: -5594> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_661 [2,head] auth (dversion lock) v=5324 ino=0x1000000048a state=1073741824 0x55cf62416500] 2023-10-03T19:20:53.358 INFO:teuthology.orchestra.run.smithi045.stdout: -5593> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.358 INFO:teuthology.orchestra.run.smithi045.stdout: -5592> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000048a [2,head] /dc-dir/dc-file_661 auth v5324 s=3 n(v0 rc2023-10-03T19:13:42.349587+0000 b3 1=1+0) (iversion lock) 0x55cf62418000] 2023-10-03T19:20:53.358 INFO:teuthology.orchestra.run.smithi045.stdout: -5591> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_661 [2,head] auth (dversion lock) v=5324 ino=0x1000000048a state=1073741824 0x55cf62416500] [inode 0x1000000048a [2,head] /dc-dir/dc-file_661 auth v5324 s=3 n(v0 rc2023-10-03T19:13:42.349587+0000 b3 1=1+0) (iversion lock) 0x55cf62418000] 2023-10-03T19:20:53.358 INFO:teuthology.orchestra.run.smithi045.stdout: -5590> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000048a [2,head] #1000000048a auth v5324 s=3 n(v0 rc2023-10-03T19:13:42.349587+0000 b3 1=1+0) (iversion lock) 0x55cf62418000] 2023-10-03T19:20:53.358 INFO:teuthology.orchestra.run.smithi045.stdout: -5589> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_661 [2,head] auth NULL (dversion lock) v=5324 ino=(nil) state=1073741824 0x55cf62416500] 2023-10-03T19:20:53.358 INFO:teuthology.orchestra.run.smithi045.stdout: -5588> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_660 [2,head] auth (dversion lock) v=5322 ino=0x10000000489 state=1073741824 0x55cf62416280] 2023-10-03T19:20:53.359 INFO:teuthology.orchestra.run.smithi045.stdout: -5587> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.359 INFO:teuthology.orchestra.run.smithi045.stdout: -5586> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000489 [2,head] /dc-dir/dc-file_660 auth v5322 s=3 n(v0 rc2023-10-03T19:13:42.337539+0000 b3 1=1+0) (iversion lock) 0x55cf62407700] 2023-10-03T19:20:53.359 INFO:teuthology.orchestra.run.smithi045.stdout: -5585> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_660 [2,head] auth (dversion lock) v=5322 ino=0x10000000489 state=1073741824 0x55cf62416280] [inode 0x10000000489 [2,head] /dc-dir/dc-file_660 auth v5322 s=3 n(v0 rc2023-10-03T19:13:42.337539+0000 b3 1=1+0) (iversion lock) 0x55cf62407700] 2023-10-03T19:20:53.359 INFO:teuthology.orchestra.run.smithi045.stdout: -5584> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000489 [2,head] #10000000489 auth v5322 s=3 n(v0 rc2023-10-03T19:13:42.337539+0000 b3 1=1+0) (iversion lock) 0x55cf62407700] 2023-10-03T19:20:53.359 INFO:teuthology.orchestra.run.smithi045.stdout: -5583> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_660 [2,head] auth NULL (dversion lock) v=5322 ino=(nil) state=1073741824 0x55cf62416280] 2023-10-03T19:20:53.359 INFO:teuthology.orchestra.run.smithi045.stdout: -5582> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_659 [2,head] auth (dversion lock) v=5320 ino=0x10000000488 state=1073741824 0x55cf62416000] 2023-10-03T19:20:53.359 INFO:teuthology.orchestra.run.smithi045.stdout: -5581> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.359 INFO:teuthology.orchestra.run.smithi045.stdout: -5580> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000488 [2,head] /dc-dir/dc-file_659 auth v5320 s=3 n(v0 rc2023-10-03T19:13:42.325886+0000 b3 1=1+0) (iversion lock) 0x55cf62407180] 2023-10-03T19:20:53.359 INFO:teuthology.orchestra.run.smithi045.stdout: -5579> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_659 [2,head] auth (dversion lock) v=5320 ino=0x10000000488 state=1073741824 0x55cf62416000] [inode 0x10000000488 [2,head] /dc-dir/dc-file_659 auth v5320 s=3 n(v0 rc2023-10-03T19:13:42.325886+0000 b3 1=1+0) (iversion lock) 0x55cf62407180] 2023-10-03T19:20:53.359 INFO:teuthology.orchestra.run.smithi045.stdout: -5578> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000488 [2,head] #10000000488 auth v5320 s=3 n(v0 rc2023-10-03T19:13:42.325886+0000 b3 1=1+0) (iversion lock) 0x55cf62407180] 2023-10-03T19:20:53.360 INFO:teuthology.orchestra.run.smithi045.stdout: -5577> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_659 [2,head] auth NULL (dversion lock) v=5320 ino=(nil) state=1073741824 0x55cf62416000] 2023-10-03T19:20:53.360 INFO:teuthology.orchestra.run.smithi045.stdout: -5576> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_658 [2,head] auth (dversion lock) v=5318 ino=0x10000000487 state=1073741824 0x55cf62403b80] 2023-10-03T19:20:53.360 INFO:teuthology.orchestra.run.smithi045.stdout: -5575> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.360 INFO:teuthology.orchestra.run.smithi045.stdout: -5574> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000487 [2,head] /dc-dir/dc-file_658 auth v5318 s=3 n(v0 rc2023-10-03T19:13:42.315523+0000 b3 1=1+0) (iversion lock) 0x55cf62406c00] 2023-10-03T19:20:53.360 INFO:teuthology.orchestra.run.smithi045.stdout: -5573> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_658 [2,head] auth (dversion lock) v=5318 ino=0x10000000487 state=1073741824 0x55cf62403b80] [inode 0x10000000487 [2,head] /dc-dir/dc-file_658 auth v5318 s=3 n(v0 rc2023-10-03T19:13:42.315523+0000 b3 1=1+0) (iversion lock) 0x55cf62406c00] 2023-10-03T19:20:53.360 INFO:teuthology.orchestra.run.smithi045.stdout: -5572> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000487 [2,head] #10000000487 auth v5318 s=3 n(v0 rc2023-10-03T19:13:42.315523+0000 b3 1=1+0) (iversion lock) 0x55cf62406c00] 2023-10-03T19:20:53.360 INFO:teuthology.orchestra.run.smithi045.stdout: -5571> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_658 [2,head] auth NULL (dversion lock) v=5318 ino=(nil) state=1073741824 0x55cf62403b80] 2023-10-03T19:20:53.360 INFO:teuthology.orchestra.run.smithi045.stdout: -5570> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_657 [2,head] auth (dversion lock) v=5316 ino=0x10000000486 state=1073741824 0x55cf62403900] 2023-10-03T19:20:53.360 INFO:teuthology.orchestra.run.smithi045.stdout: -5569> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.360 INFO:teuthology.orchestra.run.smithi045.stdout: -5568> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000486 [2,head] /dc-dir/dc-file_657 auth v5316 s=3 n(v0 rc2023-10-03T19:13:42.304347+0000 b3 1=1+0) (iversion lock) 0x55cf62406680] 2023-10-03T19:20:53.360 INFO:teuthology.orchestra.run.smithi045.stdout: -5567> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_657 [2,head] auth (dversion lock) v=5316 ino=0x10000000486 state=1073741824 0x55cf62403900] [inode 0x10000000486 [2,head] /dc-dir/dc-file_657 auth v5316 s=3 n(v0 rc2023-10-03T19:13:42.304347+0000 b3 1=1+0) (iversion lock) 0x55cf62406680] 2023-10-03T19:20:53.361 INFO:teuthology.orchestra.run.smithi045.stdout: -5566> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000486 [2,head] #10000000486 auth v5316 s=3 n(v0 rc2023-10-03T19:13:42.304347+0000 b3 1=1+0) (iversion lock) 0x55cf62406680] 2023-10-03T19:20:53.361 INFO:teuthology.orchestra.run.smithi045.stdout: -5565> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_657 [2,head] auth NULL (dversion lock) v=5316 ino=(nil) state=1073741824 0x55cf62403900] 2023-10-03T19:20:53.361 INFO:teuthology.orchestra.run.smithi045.stdout: -5564> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_656 [2,head] auth (dversion lock) v=5314 ino=0x10000000485 state=1073741824 0x55cf62403680] 2023-10-03T19:20:53.361 INFO:teuthology.orchestra.run.smithi045.stdout: -5563> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.361 INFO:teuthology.orchestra.run.smithi045.stdout: -5562> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000485 [2,head] /dc-dir/dc-file_656 auth v5314 s=3 n(v0 rc2023-10-03T19:13:42.292930+0000 b3 1=1+0) (iversion lock) 0x55cf62406100] 2023-10-03T19:20:53.361 INFO:teuthology.orchestra.run.smithi045.stdout: -5561> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_656 [2,head] auth (dversion lock) v=5314 ino=0x10000000485 state=1073741824 0x55cf62403680] [inode 0x10000000485 [2,head] /dc-dir/dc-file_656 auth v5314 s=3 n(v0 rc2023-10-03T19:13:42.292930+0000 b3 1=1+0) (iversion lock) 0x55cf62406100] 2023-10-03T19:20:53.361 INFO:teuthology.orchestra.run.smithi045.stdout: -5560> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000485 [2,head] #10000000485 auth v5314 s=3 n(v0 rc2023-10-03T19:13:42.292930+0000 b3 1=1+0) (iversion lock) 0x55cf62406100] 2023-10-03T19:20:53.361 INFO:teuthology.orchestra.run.smithi045.stdout: -5559> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_656 [2,head] auth NULL (dversion lock) v=5314 ino=(nil) state=1073741824 0x55cf62403680] 2023-10-03T19:20:53.361 INFO:teuthology.orchestra.run.smithi045.stdout: -5558> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_655 [2,head] auth (dversion lock) v=5312 ino=0x10000000484 state=1073741824 0x55cf62403400] 2023-10-03T19:20:53.361 INFO:teuthology.orchestra.run.smithi045.stdout: -5557> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.361 INFO:teuthology.orchestra.run.smithi045.stdout: -5556> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000484 [2,head] /dc-dir/dc-file_655 auth v5312 s=3 n(v0 rc2023-10-03T19:13:42.281331+0000 b3 1=1+0) (iversion lock) 0x55cf62405b80] 2023-10-03T19:20:53.361 INFO:teuthology.orchestra.run.smithi045.stdout: -5555> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_655 [2,head] auth (dversion lock) v=5312 ino=0x10000000484 state=1073741824 0x55cf62403400] [inode 0x10000000484 [2,head] /dc-dir/dc-file_655 auth v5312 s=3 n(v0 rc2023-10-03T19:13:42.281331+0000 b3 1=1+0) (iversion lock) 0x55cf62405b80] 2023-10-03T19:20:53.362 INFO:teuthology.orchestra.run.smithi045.stdout: -5554> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000484 [2,head] #10000000484 auth v5312 s=3 n(v0 rc2023-10-03T19:13:42.281331+0000 b3 1=1+0) (iversion lock) 0x55cf62405b80] 2023-10-03T19:20:53.362 INFO:teuthology.orchestra.run.smithi045.stdout: -5553> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_655 [2,head] auth NULL (dversion lock) v=5312 ino=(nil) state=1073741824 0x55cf62403400] 2023-10-03T19:20:53.362 INFO:teuthology.orchestra.run.smithi045.stdout: -5552> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_654 [2,head] auth (dversion lock) v=5310 ino=0x10000000483 state=1073741824 0x55cf62403180] 2023-10-03T19:20:53.362 INFO:teuthology.orchestra.run.smithi045.stdout: -5551> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.362 INFO:teuthology.orchestra.run.smithi045.stdout: -5550> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000483 [2,head] /dc-dir/dc-file_654 auth v5310 s=3 n(v0 rc2023-10-03T19:13:42.269692+0000 b3 1=1+0) (iversion lock) 0x55cf62405600] 2023-10-03T19:20:53.362 INFO:teuthology.orchestra.run.smithi045.stdout: -5549> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_654 [2,head] auth (dversion lock) v=5310 ino=0x10000000483 state=1073741824 0x55cf62403180] [inode 0x10000000483 [2,head] /dc-dir/dc-file_654 auth v5310 s=3 n(v0 rc2023-10-03T19:13:42.269692+0000 b3 1=1+0) (iversion lock) 0x55cf62405600] 2023-10-03T19:20:53.362 INFO:teuthology.orchestra.run.smithi045.stdout: -5548> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000483 [2,head] #10000000483 auth v5310 s=3 n(v0 rc2023-10-03T19:13:42.269692+0000 b3 1=1+0) (iversion lock) 0x55cf62405600] 2023-10-03T19:20:53.362 INFO:teuthology.orchestra.run.smithi045.stdout: -5547> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_654 [2,head] auth NULL (dversion lock) v=5310 ino=(nil) state=1073741824 0x55cf62403180] 2023-10-03T19:20:53.362 INFO:teuthology.orchestra.run.smithi045.stdout: -5546> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_653 [2,head] auth (dversion lock) v=5308 ino=0x10000000482 state=1073741824 0x55cf62402f00] 2023-10-03T19:20:53.363 INFO:teuthology.orchestra.run.smithi045.stdout: -5545> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.678 INFO:teuthology.orchestra.run.smithi045.stdout: -5544> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000482 [2,head] /dc-dir/dc-file_653 auth v5308 s=3 n(v0 rc2023-10-03T19:13:42.258835+0000 b3 1=1+0) (iversion lock) 0x55cf62405080] 2023-10-03T19:20:53.678 INFO:teuthology.orchestra.run.smithi045.stdout: -5543> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_653 [2,head] auth (dversion lock) v=5308 ino=0x10000000482 state=1073741824 0x55cf62402f00] [inode 0x10000000482 [2,head] /dc-dir/dc-file_653 auth v5308 s=3 n(v0 rc2023-10-03T19:13:42.258835+0000 b3 1=1+0) (iversion lock) 0x55cf62405080] 2023-10-03T19:20:53.678 INFO:teuthology.orchestra.run.smithi045.stdout: -5542> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000482 [2,head] #10000000482 auth v5308 s=3 n(v0 rc2023-10-03T19:13:42.258835+0000 b3 1=1+0) (iversion lock) 0x55cf62405080] 2023-10-03T19:20:53.678 INFO:teuthology.orchestra.run.smithi045.stdout: -5541> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_653 [2,head] auth NULL (dversion lock) v=5308 ino=(nil) state=1073741824 0x55cf62402f00] 2023-10-03T19:20:53.678 INFO:teuthology.orchestra.run.smithi045.stdout: -5540> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_652 [2,head] auth (dversion lock) v=5306 ino=0x10000000481 state=1073741824 0x55cf62402c80] 2023-10-03T19:20:53.678 INFO:teuthology.orchestra.run.smithi045.stdout: -5539> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.678 INFO:teuthology.orchestra.run.smithi045.stdout: -5538> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000481 [2,head] /dc-dir/dc-file_652 auth v5306 s=3 n(v0 rc2023-10-03T19:13:42.248235+0000 b3 1=1+0) (iversion lock) 0x55cf62404b00] 2023-10-03T19:20:53.678 INFO:teuthology.orchestra.run.smithi045.stdout: -5537> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_652 [2,head] auth (dversion lock) v=5306 ino=0x10000000481 state=1073741824 0x55cf62402c80] [inode 0x10000000481 [2,head] /dc-dir/dc-file_652 auth v5306 s=3 n(v0 rc2023-10-03T19:13:42.248235+0000 b3 1=1+0) (iversion lock) 0x55cf62404b00] 2023-10-03T19:20:53.678 INFO:teuthology.orchestra.run.smithi045.stdout: -5536> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000481 [2,head] #10000000481 auth v5306 s=3 n(v0 rc2023-10-03T19:13:42.248235+0000 b3 1=1+0) (iversion lock) 0x55cf62404b00] 2023-10-03T19:20:53.679 INFO:teuthology.orchestra.run.smithi045.stdout: -5535> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_652 [2,head] auth NULL (dversion lock) v=5306 ino=(nil) state=1073741824 0x55cf62402c80] 2023-10-03T19:20:53.679 INFO:teuthology.orchestra.run.smithi045.stdout: -5534> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_651 [2,head] auth (dversion lock) v=5304 ino=0x10000000480 state=1073741824 0x55cf62402a00] 2023-10-03T19:20:53.679 INFO:teuthology.orchestra.run.smithi045.stdout: -5533> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.679 INFO:teuthology.orchestra.run.smithi045.stdout: -5532> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000480 [2,head] /dc-dir/dc-file_651 auth v5304 s=3 n(v0 rc2023-10-03T19:13:42.237416+0000 b3 1=1+0) (iversion lock) 0x55cf62404580] 2023-10-03T19:20:53.679 INFO:teuthology.orchestra.run.smithi045.stdout: -5531> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_651 [2,head] auth (dversion lock) v=5304 ino=0x10000000480 state=1073741824 0x55cf62402a00] [inode 0x10000000480 [2,head] /dc-dir/dc-file_651 auth v5304 s=3 n(v0 rc2023-10-03T19:13:42.237416+0000 b3 1=1+0) (iversion lock) 0x55cf62404580] 2023-10-03T19:20:53.679 INFO:teuthology.orchestra.run.smithi045.stdout: -5530> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000480 [2,head] #10000000480 auth v5304 s=3 n(v0 rc2023-10-03T19:13:42.237416+0000 b3 1=1+0) (iversion lock) 0x55cf62404580] 2023-10-03T19:20:53.679 INFO:teuthology.orchestra.run.smithi045.stdout: -5529> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_651 [2,head] auth NULL (dversion lock) v=5304 ino=(nil) state=1073741824 0x55cf62402a00] 2023-10-03T19:20:53.679 INFO:teuthology.orchestra.run.smithi045.stdout: -5528> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_650 [2,head] auth (dversion lock) v=5302 ino=0x1000000047f state=1073741824 0x55cf62402780] 2023-10-03T19:20:53.679 INFO:teuthology.orchestra.run.smithi045.stdout: -5527> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.679 INFO:teuthology.orchestra.run.smithi045.stdout: -5526> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000047f [2,head] /dc-dir/dc-file_650 auth v5302 s=3 n(v0 rc2023-10-03T19:13:42.226790+0000 b3 1=1+0) (iversion lock) 0x55cf62404000] 2023-10-03T19:20:53.679 INFO:teuthology.orchestra.run.smithi045.stdout: -5525> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_650 [2,head] auth (dversion lock) v=5302 ino=0x1000000047f state=1073741824 0x55cf62402780] [inode 0x1000000047f [2,head] /dc-dir/dc-file_650 auth v5302 s=3 n(v0 rc2023-10-03T19:13:42.226790+0000 b3 1=1+0) (iversion lock) 0x55cf62404000] 2023-10-03T19:20:53.680 INFO:teuthology.orchestra.run.smithi045.stdout: -5524> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000047f [2,head] #1000000047f auth v5302 s=3 n(v0 rc2023-10-03T19:13:42.226790+0000 b3 1=1+0) (iversion lock) 0x55cf62404000] 2023-10-03T19:20:53.680 INFO:teuthology.orchestra.run.smithi045.stdout: -5523> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_650 [2,head] auth NULL (dversion lock) v=5302 ino=(nil) state=1073741824 0x55cf62402780] 2023-10-03T19:20:53.680 INFO:teuthology.orchestra.run.smithi045.stdout: -5522> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_649 [2,head] auth (dversion lock) v=5300 ino=0x1000000047e state=1073741824 0x55cf62402500] 2023-10-03T19:20:53.680 INFO:teuthology.orchestra.run.smithi045.stdout: -5521> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.680 INFO:teuthology.orchestra.run.smithi045.stdout: -5520> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000047e [2,head] /dc-dir/dc-file_649 auth v5300 s=3 n(v0 rc2023-10-03T19:13:42.215554+0000 b3 1=1+0) (iversion lock) 0x55cf623ff700] 2023-10-03T19:20:53.680 INFO:teuthology.orchestra.run.smithi045.stdout: -5519> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_649 [2,head] auth (dversion lock) v=5300 ino=0x1000000047e state=1073741824 0x55cf62402500] [inode 0x1000000047e [2,head] /dc-dir/dc-file_649 auth v5300 s=3 n(v0 rc2023-10-03T19:13:42.215554+0000 b3 1=1+0) (iversion lock) 0x55cf623ff700] 2023-10-03T19:20:53.680 INFO:teuthology.orchestra.run.smithi045.stdout: -5518> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000047e [2,head] #1000000047e auth v5300 s=3 n(v0 rc2023-10-03T19:13:42.215554+0000 b3 1=1+0) (iversion lock) 0x55cf623ff700] 2023-10-03T19:20:53.680 INFO:teuthology.orchestra.run.smithi045.stdout: -5517> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_649 [2,head] auth NULL (dversion lock) v=5300 ino=(nil) state=1073741824 0x55cf62402500] 2023-10-03T19:20:53.680 INFO:teuthology.orchestra.run.smithi045.stdout: -5516> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_648 [2,head] auth (dversion lock) v=5298 ino=0x1000000047d state=1073741824 0x55cf62402280] 2023-10-03T19:20:53.680 INFO:teuthology.orchestra.run.smithi045.stdout: -5515> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.681 INFO:teuthology.orchestra.run.smithi045.stdout: -5514> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000047d [2,head] /dc-dir/dc-file_648 auth v5298 s=3 n(v0 rc2023-10-03T19:13:42.204393+0000 b3 1=1+0) (iversion lock) 0x55cf623ff180] 2023-10-03T19:20:53.681 INFO:teuthology.orchestra.run.smithi045.stdout: -5513> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_648 [2,head] auth (dversion lock) v=5298 ino=0x1000000047d state=1073741824 0x55cf62402280] [inode 0x1000000047d [2,head] /dc-dir/dc-file_648 auth v5298 s=3 n(v0 rc2023-10-03T19:13:42.204393+0000 b3 1=1+0) (iversion lock) 0x55cf623ff180] 2023-10-03T19:20:53.681 INFO:teuthology.orchestra.run.smithi045.stdout: -5512> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000047d [2,head] #1000000047d auth v5298 s=3 n(v0 rc2023-10-03T19:13:42.204393+0000 b3 1=1+0) (iversion lock) 0x55cf623ff180] 2023-10-03T19:20:53.681 INFO:teuthology.orchestra.run.smithi045.stdout: -5511> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_648 [2,head] auth NULL (dversion lock) v=5298 ino=(nil) state=1073741824 0x55cf62402280] 2023-10-03T19:20:53.681 INFO:teuthology.orchestra.run.smithi045.stdout: -5510> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_647 [2,head] auth (dversion lock) v=5296 ino=0x1000000047c state=1073741824 0x55cf62402000] 2023-10-03T19:20:53.681 INFO:teuthology.orchestra.run.smithi045.stdout: -5509> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.681 INFO:teuthology.orchestra.run.smithi045.stdout: -5508> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000047c [2,head] /dc-dir/dc-file_647 auth v5296 s=3 n(v0 rc2023-10-03T19:13:42.193457+0000 b3 1=1+0) (iversion lock) 0x55cf623fec00] 2023-10-03T19:20:53.681 INFO:teuthology.orchestra.run.smithi045.stdout: -5507> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_647 [2,head] auth (dversion lock) v=5296 ino=0x1000000047c state=1073741824 0x55cf62402000] [inode 0x1000000047c [2,head] /dc-dir/dc-file_647 auth v5296 s=3 n(v0 rc2023-10-03T19:13:42.193457+0000 b3 1=1+0) (iversion lock) 0x55cf623fec00] 2023-10-03T19:20:53.681 INFO:teuthology.orchestra.run.smithi045.stdout: -5506> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000047c [2,head] #1000000047c auth v5296 s=3 n(v0 rc2023-10-03T19:13:42.193457+0000 b3 1=1+0) (iversion lock) 0x55cf623fec00] 2023-10-03T19:20:53.681 INFO:teuthology.orchestra.run.smithi045.stdout: -5505> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_647 [2,head] auth NULL (dversion lock) v=5296 ino=(nil) state=1073741824 0x55cf62402000] 2023-10-03T19:20:53.682 INFO:teuthology.orchestra.run.smithi045.stdout: -5504> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_646 [2,head] auth (dversion lock) v=5294 ino=0x1000000047b state=1073741824 0x55cf623fbb80] 2023-10-03T19:20:53.682 INFO:teuthology.orchestra.run.smithi045.stdout: -5503> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.682 INFO:teuthology.orchestra.run.smithi045.stdout: -5502> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000047b [2,head] /dc-dir/dc-file_646 auth v5294 s=3 n(v0 rc2023-10-03T19:13:42.182061+0000 b3 1=1+0) (iversion lock) 0x55cf623fe680] 2023-10-03T19:20:53.682 INFO:teuthology.orchestra.run.smithi045.stdout: -5501> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_646 [2,head] auth (dversion lock) v=5294 ino=0x1000000047b state=1073741824 0x55cf623fbb80] [inode 0x1000000047b [2,head] /dc-dir/dc-file_646 auth v5294 s=3 n(v0 rc2023-10-03T19:13:42.182061+0000 b3 1=1+0) (iversion lock) 0x55cf623fe680] 2023-10-03T19:20:53.682 INFO:teuthology.orchestra.run.smithi045.stdout: -5500> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000047b [2,head] #1000000047b auth v5294 s=3 n(v0 rc2023-10-03T19:13:42.182061+0000 b3 1=1+0) (iversion lock) 0x55cf623fe680] 2023-10-03T19:20:53.682 INFO:teuthology.orchestra.run.smithi045.stdout: -5499> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_646 [2,head] auth NULL (dversion lock) v=5294 ino=(nil) state=1073741824 0x55cf623fbb80] 2023-10-03T19:20:53.682 INFO:teuthology.orchestra.run.smithi045.stdout: -5498> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_645 [2,head] auth (dversion lock) v=5292 ino=0x1000000047a state=1073741824 0x55cf623fb900] 2023-10-03T19:20:53.682 INFO:teuthology.orchestra.run.smithi045.stdout: -5497> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.682 INFO:teuthology.orchestra.run.smithi045.stdout: -5496> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000047a [2,head] /dc-dir/dc-file_645 auth v5292 s=3 n(v0 rc2023-10-03T19:13:42.170798+0000 b3 1=1+0) (iversion lock) 0x55cf623fe100] 2023-10-03T19:20:53.682 INFO:teuthology.orchestra.run.smithi045.stdout: -5495> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_645 [2,head] auth (dversion lock) v=5292 ino=0x1000000047a state=1073741824 0x55cf623fb900] [inode 0x1000000047a [2,head] /dc-dir/dc-file_645 auth v5292 s=3 n(v0 rc2023-10-03T19:13:42.170798+0000 b3 1=1+0) (iversion lock) 0x55cf623fe100] 2023-10-03T19:20:53.683 INFO:teuthology.orchestra.run.smithi045.stdout: -5494> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000047a [2,head] #1000000047a auth v5292 s=3 n(v0 rc2023-10-03T19:13:42.170798+0000 b3 1=1+0) (iversion lock) 0x55cf623fe100] 2023-10-03T19:20:53.683 INFO:teuthology.orchestra.run.smithi045.stdout: -5493> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_645 [2,head] auth NULL (dversion lock) v=5292 ino=(nil) state=1073741824 0x55cf623fb900] 2023-10-03T19:20:53.683 INFO:teuthology.orchestra.run.smithi045.stdout: -5492> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_644 [2,head] auth (dversion lock) v=5290 ino=0x10000000479 state=1073741824 0x55cf623fb680] 2023-10-03T19:20:53.683 INFO:teuthology.orchestra.run.smithi045.stdout: -5491> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.683 INFO:teuthology.orchestra.run.smithi045.stdout: -5490> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000479 [2,head] /dc-dir/dc-file_644 auth v5290 s=3 n(v0 rc2023-10-03T19:13:42.159523+0000 b3 1=1+0) (iversion lock) 0x55cf623fdb80] 2023-10-03T19:20:53.683 INFO:teuthology.orchestra.run.smithi045.stdout: -5489> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_644 [2,head] auth (dversion lock) v=5290 ino=0x10000000479 state=1073741824 0x55cf623fb680] [inode 0x10000000479 [2,head] /dc-dir/dc-file_644 auth v5290 s=3 n(v0 rc2023-10-03T19:13:42.159523+0000 b3 1=1+0) (iversion lock) 0x55cf623fdb80] 2023-10-03T19:20:53.683 INFO:teuthology.orchestra.run.smithi045.stdout: -5488> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000479 [2,head] #10000000479 auth v5290 s=3 n(v0 rc2023-10-03T19:13:42.159523+0000 b3 1=1+0) (iversion lock) 0x55cf623fdb80] 2023-10-03T19:20:53.683 INFO:teuthology.orchestra.run.smithi045.stdout: -5487> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_644 [2,head] auth NULL (dversion lock) v=5290 ino=(nil) state=1073741824 0x55cf623fb680] 2023-10-03T19:20:53.683 INFO:teuthology.orchestra.run.smithi045.stdout: -5486> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_643 [2,head] auth (dversion lock) v=5288 ino=0x10000000478 state=1073741824 0x55cf623fb400] 2023-10-03T19:20:53.683 INFO:teuthology.orchestra.run.smithi045.stdout: -5485> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.683 INFO:teuthology.orchestra.run.smithi045.stdout: -5484> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000478 [2,head] /dc-dir/dc-file_643 auth v5288 s=3 n(v0 rc2023-10-03T19:13:42.146940+0000 b3 1=1+0) (iversion lock) 0x55cf623fd600] 2023-10-03T19:20:53.684 INFO:teuthology.orchestra.run.smithi045.stdout: -5483> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_643 [2,head] auth (dversion lock) v=5288 ino=0x10000000478 state=1073741824 0x55cf623fb400] [inode 0x10000000478 [2,head] /dc-dir/dc-file_643 auth v5288 s=3 n(v0 rc2023-10-03T19:13:42.146940+0000 b3 1=1+0) (iversion lock) 0x55cf623fd600] 2023-10-03T19:20:53.684 INFO:teuthology.orchestra.run.smithi045.stdout: -5482> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000478 [2,head] #10000000478 auth v5288 s=3 n(v0 rc2023-10-03T19:13:42.146940+0000 b3 1=1+0) (iversion lock) 0x55cf623fd600] 2023-10-03T19:20:53.684 INFO:teuthology.orchestra.run.smithi045.stdout: -5481> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_643 [2,head] auth NULL (dversion lock) v=5288 ino=(nil) state=1073741824 0x55cf623fb400] 2023-10-03T19:20:53.684 INFO:teuthology.orchestra.run.smithi045.stdout: -5480> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_642 [2,head] auth (dversion lock) v=5286 ino=0x10000000477 state=1073741824 0x55cf623fb180] 2023-10-03T19:20:53.684 INFO:teuthology.orchestra.run.smithi045.stdout: -5479> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.684 INFO:teuthology.orchestra.run.smithi045.stdout: -5478> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000477 [2,head] /dc-dir/dc-file_642 auth v5286 s=3 n(v0 rc2023-10-03T19:13:42.136275+0000 b3 1=1+0) (iversion lock) 0x55cf623fd080] 2023-10-03T19:20:53.684 INFO:teuthology.orchestra.run.smithi045.stdout: -5477> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_642 [2,head] auth (dversion lock) v=5286 ino=0x10000000477 state=1073741824 0x55cf623fb180] [inode 0x10000000477 [2,head] /dc-dir/dc-file_642 auth v5286 s=3 n(v0 rc2023-10-03T19:13:42.136275+0000 b3 1=1+0) (iversion lock) 0x55cf623fd080] 2023-10-03T19:20:53.684 INFO:teuthology.orchestra.run.smithi045.stdout: -5476> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000477 [2,head] #10000000477 auth v5286 s=3 n(v0 rc2023-10-03T19:13:42.136275+0000 b3 1=1+0) (iversion lock) 0x55cf623fd080] 2023-10-03T19:20:53.684 INFO:teuthology.orchestra.run.smithi045.stdout: -5475> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_642 [2,head] auth NULL (dversion lock) v=5286 ino=(nil) state=1073741824 0x55cf623fb180] 2023-10-03T19:20:53.684 INFO:teuthology.orchestra.run.smithi045.stdout: -5474> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_641 [2,head] auth (dversion lock) v=5284 ino=0x10000000476 state=1073741824 0x55cf623faf00] 2023-10-03T19:20:53.685 INFO:teuthology.orchestra.run.smithi045.stdout: -5473> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.685 INFO:teuthology.orchestra.run.smithi045.stdout: -5472> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000476 [2,head] /dc-dir/dc-file_641 auth v5284 s=3 n(v0 rc2023-10-03T19:13:42.124667+0000 b3 1=1+0) (iversion lock) 0x55cf623fcb00] 2023-10-03T19:20:53.685 INFO:teuthology.orchestra.run.smithi045.stdout: -5471> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_641 [2,head] auth (dversion lock) v=5284 ino=0x10000000476 state=1073741824 0x55cf623faf00] [inode 0x10000000476 [2,head] /dc-dir/dc-file_641 auth v5284 s=3 n(v0 rc2023-10-03T19:13:42.124667+0000 b3 1=1+0) (iversion lock) 0x55cf623fcb00] 2023-10-03T19:20:53.685 INFO:teuthology.orchestra.run.smithi045.stdout: -5470> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000476 [2,head] #10000000476 auth v5284 s=3 n(v0 rc2023-10-03T19:13:42.124667+0000 b3 1=1+0) (iversion lock) 0x55cf623fcb00] 2023-10-03T19:20:53.685 INFO:teuthology.orchestra.run.smithi045.stdout: -5469> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_641 [2,head] auth NULL (dversion lock) v=5284 ino=(nil) state=1073741824 0x55cf623faf00] 2023-10-03T19:20:53.685 INFO:teuthology.orchestra.run.smithi045.stdout: -5468> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_640 [2,head] auth (dversion lock) v=5282 ino=0x10000000475 state=1073741824 0x55cf623fac80] 2023-10-03T19:20:53.685 INFO:teuthology.orchestra.run.smithi045.stdout: -5467> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.685 INFO:teuthology.orchestra.run.smithi045.stdout: -5466> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000475 [2,head] /dc-dir/dc-file_640 auth v5282 s=3 n(v0 rc2023-10-03T19:13:42.111870+0000 b3 1=1+0) (iversion lock) 0x55cf623fc580] 2023-10-03T19:20:53.685 INFO:teuthology.orchestra.run.smithi045.stdout: -5465> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_640 [2,head] auth (dversion lock) v=5282 ino=0x10000000475 state=1073741824 0x55cf623fac80] [inode 0x10000000475 [2,head] /dc-dir/dc-file_640 auth v5282 s=3 n(v0 rc2023-10-03T19:13:42.111870+0000 b3 1=1+0) (iversion lock) 0x55cf623fc580] 2023-10-03T19:20:53.685 INFO:teuthology.orchestra.run.smithi045.stdout: -5464> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000475 [2,head] #10000000475 auth v5282 s=3 n(v0 rc2023-10-03T19:13:42.111870+0000 b3 1=1+0) (iversion lock) 0x55cf623fc580] 2023-10-03T19:20:53.685 INFO:teuthology.orchestra.run.smithi045.stdout: -5463> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_640 [2,head] auth NULL (dversion lock) v=5282 ino=(nil) state=1073741824 0x55cf623fac80] 2023-10-03T19:20:53.686 INFO:teuthology.orchestra.run.smithi045.stdout: -5462> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_639 [2,head] auth (dversion lock) v=5280 ino=0x10000000474 state=1073741824 0x55cf623faa00] 2023-10-03T19:20:53.686 INFO:teuthology.orchestra.run.smithi045.stdout: -5461> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.686 INFO:teuthology.orchestra.run.smithi045.stdout: -5460> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000474 [2,head] /dc-dir/dc-file_639 auth v5280 s=3 n(v0 rc2023-10-03T19:13:42.097861+0000 b3 1=1+0) (iversion lock) 0x55cf623fc000] 2023-10-03T19:20:53.686 INFO:teuthology.orchestra.run.smithi045.stdout: -5459> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_639 [2,head] auth (dversion lock) v=5280 ino=0x10000000474 state=1073741824 0x55cf623faa00] [inode 0x10000000474 [2,head] /dc-dir/dc-file_639 auth v5280 s=3 n(v0 rc2023-10-03T19:13:42.097861+0000 b3 1=1+0) (iversion lock) 0x55cf623fc000] 2023-10-03T19:20:53.686 INFO:teuthology.orchestra.run.smithi045.stdout: -5458> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000474 [2,head] #10000000474 auth v5280 s=3 n(v0 rc2023-10-03T19:13:42.097861+0000 b3 1=1+0) (iversion lock) 0x55cf623fc000] 2023-10-03T19:20:53.686 INFO:teuthology.orchestra.run.smithi045.stdout: -5457> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_639 [2,head] auth NULL (dversion lock) v=5280 ino=(nil) state=1073741824 0x55cf623faa00] 2023-10-03T19:20:53.686 INFO:teuthology.orchestra.run.smithi045.stdout: -5456> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_638 [2,head] auth (dversion lock) v=5278 ino=0x10000000473 state=1073741824 0x55cf623fa780] 2023-10-03T19:20:53.686 INFO:teuthology.orchestra.run.smithi045.stdout: -5455> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.686 INFO:teuthology.orchestra.run.smithi045.stdout: -5454> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000473 [2,head] /dc-dir/dc-file_638 auth v5278 s=3 n(v0 rc2023-10-03T19:13:42.085489+0000 b3 1=1+0) (iversion lock) 0x55cf623f5700] 2023-10-03T19:20:53.686 INFO:teuthology.orchestra.run.smithi045.stdout: -5453> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_638 [2,head] auth (dversion lock) v=5278 ino=0x10000000473 state=1073741824 0x55cf623fa780] [inode 0x10000000473 [2,head] /dc-dir/dc-file_638 auth v5278 s=3 n(v0 rc2023-10-03T19:13:42.085489+0000 b3 1=1+0) (iversion lock) 0x55cf623f5700] 2023-10-03T19:20:53.686 INFO:teuthology.orchestra.run.smithi045.stdout: -5452> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000473 [2,head] #10000000473 auth v5278 s=3 n(v0 rc2023-10-03T19:13:42.085489+0000 b3 1=1+0) (iversion lock) 0x55cf623f5700] 2023-10-03T19:20:53.687 INFO:teuthology.orchestra.run.smithi045.stdout: -5451> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_638 [2,head] auth NULL (dversion lock) v=5278 ino=(nil) state=1073741824 0x55cf623fa780] 2023-10-03T19:20:53.687 INFO:teuthology.orchestra.run.smithi045.stdout: -5450> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_637 [2,head] auth (dversion lock) v=5276 ino=0x10000000472 state=1073741824 0x55cf623fa500] 2023-10-03T19:20:53.687 INFO:teuthology.orchestra.run.smithi045.stdout: -5449> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.687 INFO:teuthology.orchestra.run.smithi045.stdout: -5448> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000472 [2,head] /dc-dir/dc-file_637 auth v5276 s=3 n(v0 rc2023-10-03T19:13:42.073799+0000 b3 1=1+0) (iversion lock) 0x55cf623f5180] 2023-10-03T19:20:53.687 INFO:teuthology.orchestra.run.smithi045.stdout: -5447> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_637 [2,head] auth (dversion lock) v=5276 ino=0x10000000472 state=1073741824 0x55cf623fa500] [inode 0x10000000472 [2,head] /dc-dir/dc-file_637 auth v5276 s=3 n(v0 rc2023-10-03T19:13:42.073799+0000 b3 1=1+0) (iversion lock) 0x55cf623f5180] 2023-10-03T19:20:53.687 INFO:teuthology.orchestra.run.smithi045.stdout: -5446> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000472 [2,head] #10000000472 auth v5276 s=3 n(v0 rc2023-10-03T19:13:42.073799+0000 b3 1=1+0) (iversion lock) 0x55cf623f5180] 2023-10-03T19:20:53.687 INFO:teuthology.orchestra.run.smithi045.stdout: -5445> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_637 [2,head] auth NULL (dversion lock) v=5276 ino=(nil) state=1073741824 0x55cf623fa500] 2023-10-03T19:20:53.687 INFO:teuthology.orchestra.run.smithi045.stdout: -5444> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_636 [2,head] auth (dversion lock) v=5274 ino=0x10000000471 state=1073741824 0x55cf623fa280] 2023-10-03T19:20:53.687 INFO:teuthology.orchestra.run.smithi045.stdout: -5443> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.688 INFO:teuthology.orchestra.run.smithi045.stdout: -5442> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000471 [2,head] /dc-dir/dc-file_636 auth v5274 s=3 n(v0 rc2023-10-03T19:13:42.062332+0000 b3 1=1+0) (iversion lock) 0x55cf623f4c00] 2023-10-03T19:20:53.688 INFO:teuthology.orchestra.run.smithi045.stdout: -5441> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_636 [2,head] auth (dversion lock) v=5274 ino=0x10000000471 state=1073741824 0x55cf623fa280] [inode 0x10000000471 [2,head] /dc-dir/dc-file_636 auth v5274 s=3 n(v0 rc2023-10-03T19:13:42.062332+0000 b3 1=1+0) (iversion lock) 0x55cf623f4c00] 2023-10-03T19:20:53.688 INFO:teuthology.orchestra.run.smithi045.stdout: -5440> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000471 [2,head] #10000000471 auth v5274 s=3 n(v0 rc2023-10-03T19:13:42.062332+0000 b3 1=1+0) (iversion lock) 0x55cf623f4c00] 2023-10-03T19:20:53.688 INFO:teuthology.orchestra.run.smithi045.stdout: -5439> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_636 [2,head] auth NULL (dversion lock) v=5274 ino=(nil) state=1073741824 0x55cf623fa280] 2023-10-03T19:20:53.688 INFO:teuthology.orchestra.run.smithi045.stdout: -5438> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_635 [2,head] auth (dversion lock) v=5272 ino=0x10000000470 state=1073741824 0x55cf623fa000] 2023-10-03T19:20:53.688 INFO:teuthology.orchestra.run.smithi045.stdout: -5437> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.688 INFO:teuthology.orchestra.run.smithi045.stdout: -5436> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000470 [2,head] /dc-dir/dc-file_635 auth v5272 s=3 n(v0 rc2023-10-03T19:13:42.049331+0000 b3 1=1+0) (iversion lock) 0x55cf623f4680] 2023-10-03T19:20:53.688 INFO:teuthology.orchestra.run.smithi045.stdout: -5435> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_635 [2,head] auth (dversion lock) v=5272 ino=0x10000000470 state=1073741824 0x55cf623fa000] [inode 0x10000000470 [2,head] /dc-dir/dc-file_635 auth v5272 s=3 n(v0 rc2023-10-03T19:13:42.049331+0000 b3 1=1+0) (iversion lock) 0x55cf623f4680] 2023-10-03T19:20:53.688 INFO:teuthology.orchestra.run.smithi045.stdout: -5434> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000470 [2,head] #10000000470 auth v5272 s=3 n(v0 rc2023-10-03T19:13:42.049331+0000 b3 1=1+0) (iversion lock) 0x55cf623f4680] 2023-10-03T19:20:53.688 INFO:teuthology.orchestra.run.smithi045.stdout: -5433> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_635 [2,head] auth NULL (dversion lock) v=5272 ino=(nil) state=1073741824 0x55cf623fa000] 2023-10-03T19:20:53.688 INFO:teuthology.orchestra.run.smithi045.stdout: -5432> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_634 [2,head] auth (dversion lock) v=5270 ino=0x1000000046f state=1073741824 0x55cf623f1b80] 2023-10-03T19:20:53.688 INFO:teuthology.orchestra.run.smithi045.stdout: -5431> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.689 INFO:teuthology.orchestra.run.smithi045.stdout: -5430> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000046f [2,head] /dc-dir/dc-file_634 auth v5270 s=3 n(v0 rc2023-10-03T19:13:42.037202+0000 b3 1=1+0) (iversion lock) 0x55cf623f4100] 2023-10-03T19:20:53.689 INFO:teuthology.orchestra.run.smithi045.stdout: -5429> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_634 [2,head] auth (dversion lock) v=5270 ino=0x1000000046f state=1073741824 0x55cf623f1b80] [inode 0x1000000046f [2,head] /dc-dir/dc-file_634 auth v5270 s=3 n(v0 rc2023-10-03T19:13:42.037202+0000 b3 1=1+0) (iversion lock) 0x55cf623f4100] 2023-10-03T19:20:53.689 INFO:teuthology.orchestra.run.smithi045.stdout: -5428> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000046f [2,head] #1000000046f auth v5270 s=3 n(v0 rc2023-10-03T19:13:42.037202+0000 b3 1=1+0) (iversion lock) 0x55cf623f4100] 2023-10-03T19:20:53.689 INFO:teuthology.orchestra.run.smithi045.stdout: -5427> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_634 [2,head] auth NULL (dversion lock) v=5270 ino=(nil) state=1073741824 0x55cf623f1b80] 2023-10-03T19:20:53.689 INFO:teuthology.orchestra.run.smithi045.stdout: -5426> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_633 [2,head] auth (dversion lock) v=5268 ino=0x1000000046e state=1073741824 0x55cf623f1900] 2023-10-03T19:20:53.689 INFO:teuthology.orchestra.run.smithi045.stdout: -5425> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.689 INFO:teuthology.orchestra.run.smithi045.stdout: -5424> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000046e [2,head] /dc-dir/dc-file_633 auth v5268 s=3 n(v0 rc2023-10-03T19:13:42.025774+0000 b3 1=1+0) (iversion lock) 0x55cf623f3b80] 2023-10-03T19:20:53.689 INFO:teuthology.orchestra.run.smithi045.stdout: -5423> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_633 [2,head] auth (dversion lock) v=5268 ino=0x1000000046e state=1073741824 0x55cf623f1900] [inode 0x1000000046e [2,head] /dc-dir/dc-file_633 auth v5268 s=3 n(v0 rc2023-10-03T19:13:42.025774+0000 b3 1=1+0) (iversion lock) 0x55cf623f3b80] 2023-10-03T19:20:53.689 INFO:teuthology.orchestra.run.smithi045.stdout: -5422> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000046e [2,head] #1000000046e auth v5268 s=3 n(v0 rc2023-10-03T19:13:42.025774+0000 b3 1=1+0) (iversion lock) 0x55cf623f3b80] 2023-10-03T19:20:53.689 INFO:teuthology.orchestra.run.smithi045.stdout: -5421> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_633 [2,head] auth NULL (dversion lock) v=5268 ino=(nil) state=1073741824 0x55cf623f1900] 2023-10-03T19:20:53.689 INFO:teuthology.orchestra.run.smithi045.stdout: -5420> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_632 [2,head] auth (dversion lock) v=5266 ino=0x1000000046d state=1073741824 0x55cf623f1680] 2023-10-03T19:20:53.690 INFO:teuthology.orchestra.run.smithi045.stdout: -5419> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.690 INFO:teuthology.orchestra.run.smithi045.stdout: -5418> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000046d [2,head] /dc-dir/dc-file_632 auth v5266 s=3 n(v0 rc2023-10-03T19:13:42.014817+0000 b3 1=1+0) (iversion lock) 0x55cf623f3600] 2023-10-03T19:20:53.690 INFO:teuthology.orchestra.run.smithi045.stdout: -5417> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_632 [2,head] auth (dversion lock) v=5266 ino=0x1000000046d state=1073741824 0x55cf623f1680] [inode 0x1000000046d [2,head] /dc-dir/dc-file_632 auth v5266 s=3 n(v0 rc2023-10-03T19:13:42.014817+0000 b3 1=1+0) (iversion lock) 0x55cf623f3600] 2023-10-03T19:20:53.690 INFO:teuthology.orchestra.run.smithi045.stdout: -5416> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000046d [2,head] #1000000046d auth v5266 s=3 n(v0 rc2023-10-03T19:13:42.014817+0000 b3 1=1+0) (iversion lock) 0x55cf623f3600] 2023-10-03T19:20:53.690 INFO:teuthology.orchestra.run.smithi045.stdout: -5415> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_632 [2,head] auth NULL (dversion lock) v=5266 ino=(nil) state=1073741824 0x55cf623f1680] 2023-10-03T19:20:53.690 INFO:teuthology.orchestra.run.smithi045.stdout: -5414> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_631 [2,head] auth (dversion lock) v=5264 ino=0x1000000046c state=1073741824 0x55cf623f1400] 2023-10-03T19:20:53.690 INFO:teuthology.orchestra.run.smithi045.stdout: -5413> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.690 INFO:teuthology.orchestra.run.smithi045.stdout: -5412> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000046c [2,head] /dc-dir/dc-file_631 auth v5264 s=3 n(v0 rc2023-10-03T19:13:42.003288+0000 b3 1=1+0) (iversion lock) 0x55cf623f3080] 2023-10-03T19:20:53.690 INFO:teuthology.orchestra.run.smithi045.stdout: -5411> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_631 [2,head] auth (dversion lock) v=5264 ino=0x1000000046c state=1073741824 0x55cf623f1400] [inode 0x1000000046c [2,head] /dc-dir/dc-file_631 auth v5264 s=3 n(v0 rc2023-10-03T19:13:42.003288+0000 b3 1=1+0) (iversion lock) 0x55cf623f3080] 2023-10-03T19:20:53.690 INFO:teuthology.orchestra.run.smithi045.stdout: -5410> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000046c [2,head] #1000000046c auth v5264 s=3 n(v0 rc2023-10-03T19:13:42.003288+0000 b3 1=1+0) (iversion lock) 0x55cf623f3080] 2023-10-03T19:20:53.691 INFO:teuthology.orchestra.run.smithi045.stdout: -5409> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_631 [2,head] auth NULL (dversion lock) v=5264 ino=(nil) state=1073741824 0x55cf623f1400] 2023-10-03T19:20:53.691 INFO:teuthology.orchestra.run.smithi045.stdout: -5408> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_630 [2,head] auth (dversion lock) v=5262 ino=0x1000000046b state=1073741824 0x55cf623f1180] 2023-10-03T19:20:53.691 INFO:teuthology.orchestra.run.smithi045.stdout: -5407> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.691 INFO:teuthology.orchestra.run.smithi045.stdout: -5406> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000046b [2,head] /dc-dir/dc-file_630 auth v5262 s=3 n(v0 rc2023-10-03T19:13:41.989527+0000 b3 1=1+0) (iversion lock) 0x55cf623f2b00] 2023-10-03T19:20:53.691 INFO:teuthology.orchestra.run.smithi045.stdout: -5405> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_630 [2,head] auth (dversion lock) v=5262 ino=0x1000000046b state=1073741824 0x55cf623f1180] [inode 0x1000000046b [2,head] /dc-dir/dc-file_630 auth v5262 s=3 n(v0 rc2023-10-03T19:13:41.989527+0000 b3 1=1+0) (iversion lock) 0x55cf623f2b00] 2023-10-03T19:20:53.691 INFO:teuthology.orchestra.run.smithi045.stdout: -5404> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000046b [2,head] #1000000046b auth v5262 s=3 n(v0 rc2023-10-03T19:13:41.989527+0000 b3 1=1+0) (iversion lock) 0x55cf623f2b00] 2023-10-03T19:20:53.691 INFO:teuthology.orchestra.run.smithi045.stdout: -5403> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_630 [2,head] auth NULL (dversion lock) v=5262 ino=(nil) state=1073741824 0x55cf623f1180] 2023-10-03T19:20:53.691 INFO:teuthology.orchestra.run.smithi045.stdout: -5402> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_629 [2,head] auth (dversion lock) v=5260 ino=0x1000000046a state=1073741824 0x55cf623f0f00] 2023-10-03T19:20:53.691 INFO:teuthology.orchestra.run.smithi045.stdout: -5401> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.691 INFO:teuthology.orchestra.run.smithi045.stdout: -5400> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000046a [2,head] /dc-dir/dc-file_629 auth v5260 s=3 n(v0 rc2023-10-03T19:13:41.978279+0000 b3 1=1+0) (iversion lock) 0x55cf623f2580] 2023-10-03T19:20:53.691 INFO:teuthology.orchestra.run.smithi045.stdout: -5399> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_629 [2,head] auth (dversion lock) v=5260 ino=0x1000000046a state=1073741824 0x55cf623f0f00] [inode 0x1000000046a [2,head] /dc-dir/dc-file_629 auth v5260 s=3 n(v0 rc2023-10-03T19:13:41.978279+0000 b3 1=1+0) (iversion lock) 0x55cf623f2580] 2023-10-03T19:20:53.692 INFO:teuthology.orchestra.run.smithi045.stdout: -5398> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000046a [2,head] #1000000046a auth v5260 s=3 n(v0 rc2023-10-03T19:13:41.978279+0000 b3 1=1+0) (iversion lock) 0x55cf623f2580] 2023-10-03T19:20:53.692 INFO:teuthology.orchestra.run.smithi045.stdout: -5397> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_629 [2,head] auth NULL (dversion lock) v=5260 ino=(nil) state=1073741824 0x55cf623f0f00] 2023-10-03T19:20:53.692 INFO:teuthology.orchestra.run.smithi045.stdout: -5396> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_628 [2,head] auth (dversion lock) v=5258 ino=0x10000000469 state=1073741824 0x55cf623f0c80] 2023-10-03T19:20:53.692 INFO:teuthology.orchestra.run.smithi045.stdout: -5395> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.692 INFO:teuthology.orchestra.run.smithi045.stdout: -5394> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000469 [2,head] /dc-dir/dc-file_628 auth v5258 s=3 n(v0 rc2023-10-03T19:13:41.966453+0000 b3 1=1+0) (iversion lock) 0x55cf623f2000] 2023-10-03T19:20:53.692 INFO:teuthology.orchestra.run.smithi045.stdout: -5393> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_628 [2,head] auth (dversion lock) v=5258 ino=0x10000000469 state=1073741824 0x55cf623f0c80] [inode 0x10000000469 [2,head] /dc-dir/dc-file_628 auth v5258 s=3 n(v0 rc2023-10-03T19:13:41.966453+0000 b3 1=1+0) (iversion lock) 0x55cf623f2000] 2023-10-03T19:20:53.692 INFO:teuthology.orchestra.run.smithi045.stdout: -5392> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000469 [2,head] #10000000469 auth v5258 s=3 n(v0 rc2023-10-03T19:13:41.966453+0000 b3 1=1+0) (iversion lock) 0x55cf623f2000] 2023-10-03T19:20:53.692 INFO:teuthology.orchestra.run.smithi045.stdout: -5391> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_628 [2,head] auth NULL (dversion lock) v=5258 ino=(nil) state=1073741824 0x55cf623f0c80] 2023-10-03T19:20:53.692 INFO:teuthology.orchestra.run.smithi045.stdout: -5390> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_627 [2,head] auth (dversion lock) v=5256 ino=0x10000000468 state=1073741824 0x55cf623f0a00] 2023-10-03T19:20:53.692 INFO:teuthology.orchestra.run.smithi045.stdout: -5389> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.692 INFO:teuthology.orchestra.run.smithi045.stdout: -5388> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000468 [2,head] /dc-dir/dc-file_627 auth v5256 s=3 n(v0 rc2023-10-03T19:13:41.953824+0000 b3 1=1+0) (iversion lock) 0x55cf623ef700] 2023-10-03T19:20:53.693 INFO:teuthology.orchestra.run.smithi045.stdout: -5387> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_627 [2,head] auth (dversion lock) v=5256 ino=0x10000000468 state=1073741824 0x55cf623f0a00] [inode 0x10000000468 [2,head] /dc-dir/dc-file_627 auth v5256 s=3 n(v0 rc2023-10-03T19:13:41.953824+0000 b3 1=1+0) (iversion lock) 0x55cf623ef700] 2023-10-03T19:20:53.693 INFO:teuthology.orchestra.run.smithi045.stdout: -5386> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000468 [2,head] #10000000468 auth v5256 s=3 n(v0 rc2023-10-03T19:13:41.953824+0000 b3 1=1+0) (iversion lock) 0x55cf623ef700] 2023-10-03T19:20:53.693 INFO:teuthology.orchestra.run.smithi045.stdout: -5385> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_627 [2,head] auth NULL (dversion lock) v=5256 ino=(nil) state=1073741824 0x55cf623f0a00] 2023-10-03T19:20:53.693 INFO:teuthology.orchestra.run.smithi045.stdout: -5384> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_626 [2,head] auth (dversion lock) v=5254 ino=0x10000000467 state=1073741824 0x55cf623f0780] 2023-10-03T19:20:53.693 INFO:teuthology.orchestra.run.smithi045.stdout: -5383> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.693 INFO:teuthology.orchestra.run.smithi045.stdout: -5382> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000467 [2,head] /dc-dir/dc-file_626 auth v5254 s=3 n(v0 rc2023-10-03T19:13:41.940439+0000 b3 1=1+0) (iversion lock) 0x55cf623ef180] 2023-10-03T19:20:53.693 INFO:teuthology.orchestra.run.smithi045.stdout: -5381> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_626 [2,head] auth (dversion lock) v=5254 ino=0x10000000467 state=1073741824 0x55cf623f0780] [inode 0x10000000467 [2,head] /dc-dir/dc-file_626 auth v5254 s=3 n(v0 rc2023-10-03T19:13:41.940439+0000 b3 1=1+0) (iversion lock) 0x55cf623ef180] 2023-10-03T19:20:53.693 INFO:teuthology.orchestra.run.smithi045.stdout: -5380> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000467 [2,head] #10000000467 auth v5254 s=3 n(v0 rc2023-10-03T19:13:41.940439+0000 b3 1=1+0) (iversion lock) 0x55cf623ef180] 2023-10-03T19:20:53.693 INFO:teuthology.orchestra.run.smithi045.stdout: -5379> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_626 [2,head] auth NULL (dversion lock) v=5254 ino=(nil) state=1073741824 0x55cf623f0780] 2023-10-03T19:20:53.693 INFO:teuthology.orchestra.run.smithi045.stdout: -5378> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_625 [2,head] auth (dversion lock) v=5252 ino=0x10000000466 state=1073741824 0x55cf623f0500] 2023-10-03T19:20:53.693 INFO:teuthology.orchestra.run.smithi045.stdout: -5377> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.693 INFO:teuthology.orchestra.run.smithi045.stdout: -5376> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000466 [2,head] /dc-dir/dc-file_625 auth v5252 s=3 n(v0 rc2023-10-03T19:13:41.929217+0000 b3 1=1+0) (iversion lock) 0x55cf623eec00] 2023-10-03T19:20:53.694 INFO:teuthology.orchestra.run.smithi045.stdout: -5375> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_625 [2,head] auth (dversion lock) v=5252 ino=0x10000000466 state=1073741824 0x55cf623f0500] [inode 0x10000000466 [2,head] /dc-dir/dc-file_625 auth v5252 s=3 n(v0 rc2023-10-03T19:13:41.929217+0000 b3 1=1+0) (iversion lock) 0x55cf623eec00] 2023-10-03T19:20:53.694 INFO:teuthology.orchestra.run.smithi045.stdout: -5374> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000466 [2,head] #10000000466 auth v5252 s=3 n(v0 rc2023-10-03T19:13:41.929217+0000 b3 1=1+0) (iversion lock) 0x55cf623eec00] 2023-10-03T19:20:53.824 INFO:teuthology.orchestra.run.smithi045.stdout: -5373> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_625 [2,head] auth NULL (dversion lock) v=5252 ino=(nil) state=1073741824 0x55cf623f0500] 2023-10-03T19:20:53.824 INFO:teuthology.orchestra.run.smithi045.stdout: -5372> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_624 [2,head] auth (dversion lock) v=5250 ino=0x10000000465 state=1073741824 0x55cf623f0280] 2023-10-03T19:20:53.824 INFO:teuthology.orchestra.run.smithi045.stdout: -5371> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.824 INFO:teuthology.orchestra.run.smithi045.stdout: -5370> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000465 [2,head] /dc-dir/dc-file_624 auth v5250 s=3 n(v0 rc2023-10-03T19:13:41.917308+0000 b3 1=1+0) (iversion lock) 0x55cf623ee680] 2023-10-03T19:20:53.824 INFO:teuthology.orchestra.run.smithi045.stdout: -5369> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_624 [2,head] auth (dversion lock) v=5250 ino=0x10000000465 state=1073741824 0x55cf623f0280] [inode 0x10000000465 [2,head] /dc-dir/dc-file_624 auth v5250 s=3 n(v0 rc2023-10-03T19:13:41.917308+0000 b3 1=1+0) (iversion lock) 0x55cf623ee680] 2023-10-03T19:20:53.824 INFO:teuthology.orchestra.run.smithi045.stdout: -5368> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000465 [2,head] #10000000465 auth v5250 s=3 n(v0 rc2023-10-03T19:13:41.917308+0000 b3 1=1+0) (iversion lock) 0x55cf623ee680] 2023-10-03T19:20:53.824 INFO:teuthology.orchestra.run.smithi045.stdout: -5367> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_624 [2,head] auth NULL (dversion lock) v=5250 ino=(nil) state=1073741824 0x55cf623f0280] 2023-10-03T19:20:53.824 INFO:teuthology.orchestra.run.smithi045.stdout: -5366> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_623 [2,head] auth (dversion lock) v=5248 ino=0x10000000464 state=1073741824 0x55cf623f0000] 2023-10-03T19:20:53.824 INFO:teuthology.orchestra.run.smithi045.stdout: -5365> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.825 INFO:teuthology.orchestra.run.smithi045.stdout: -5364> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000464 [2,head] /dc-dir/dc-file_623 auth v5248 s=3 n(v0 rc2023-10-03T19:13:41.905346+0000 b3 1=1+0) (iversion lock) 0x55cf623ee100] 2023-10-03T19:20:53.825 INFO:teuthology.orchestra.run.smithi045.stdout: -5363> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_623 [2,head] auth (dversion lock) v=5248 ino=0x10000000464 state=1073741824 0x55cf623f0000] [inode 0x10000000464 [2,head] /dc-dir/dc-file_623 auth v5248 s=3 n(v0 rc2023-10-03T19:13:41.905346+0000 b3 1=1+0) (iversion lock) 0x55cf623ee100] 2023-10-03T19:20:53.825 INFO:teuthology.orchestra.run.smithi045.stdout: -5362> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000464 [2,head] #10000000464 auth v5248 s=3 n(v0 rc2023-10-03T19:13:41.905346+0000 b3 1=1+0) (iversion lock) 0x55cf623ee100] 2023-10-03T19:20:53.825 INFO:teuthology.orchestra.run.smithi045.stdout: -5361> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_623 [2,head] auth NULL (dversion lock) v=5248 ino=(nil) state=1073741824 0x55cf623f0000] 2023-10-03T19:20:53.825 INFO:teuthology.orchestra.run.smithi045.stdout: -5360> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_622 [2,head] auth (dversion lock) v=5246 ino=0x10000000463 state=1073741824 0x55cf623dbb80] 2023-10-03T19:20:53.825 INFO:teuthology.orchestra.run.smithi045.stdout: -5359> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.825 INFO:teuthology.orchestra.run.smithi045.stdout: -5358> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000463 [2,head] /dc-dir/dc-file_622 auth v5246 s=3 n(v0 rc2023-10-03T19:13:41.893916+0000 b3 1=1+0) (iversion lock) 0x55cf623edb80] 2023-10-03T19:20:53.825 INFO:teuthology.orchestra.run.smithi045.stdout: -5357> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_622 [2,head] auth (dversion lock) v=5246 ino=0x10000000463 state=1073741824 0x55cf623dbb80] [inode 0x10000000463 [2,head] /dc-dir/dc-file_622 auth v5246 s=3 n(v0 rc2023-10-03T19:13:41.893916+0000 b3 1=1+0) (iversion lock) 0x55cf623edb80] 2023-10-03T19:20:53.825 INFO:teuthology.orchestra.run.smithi045.stdout: -5356> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000463 [2,head] #10000000463 auth v5246 s=3 n(v0 rc2023-10-03T19:13:41.893916+0000 b3 1=1+0) (iversion lock) 0x55cf623edb80] 2023-10-03T19:20:53.826 INFO:teuthology.orchestra.run.smithi045.stdout: -5355> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_622 [2,head] auth NULL (dversion lock) v=5246 ino=(nil) state=1073741824 0x55cf623dbb80] 2023-10-03T19:20:53.826 INFO:teuthology.orchestra.run.smithi045.stdout: -5354> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_621 [2,head] auth (dversion lock) v=5244 ino=0x10000000462 state=1073741824 0x55cf623db900] 2023-10-03T19:20:53.826 INFO:teuthology.orchestra.run.smithi045.stdout: -5353> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.826 INFO:teuthology.orchestra.run.smithi045.stdout: -5352> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000462 [2,head] /dc-dir/dc-file_621 auth v5244 s=3 n(v0 rc2023-10-03T19:13:41.882287+0000 b3 1=1+0) (iversion lock) 0x55cf623ed600] 2023-10-03T19:20:53.826 INFO:teuthology.orchestra.run.smithi045.stdout: -5351> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_621 [2,head] auth (dversion lock) v=5244 ino=0x10000000462 state=1073741824 0x55cf623db900] [inode 0x10000000462 [2,head] /dc-dir/dc-file_621 auth v5244 s=3 n(v0 rc2023-10-03T19:13:41.882287+0000 b3 1=1+0) (iversion lock) 0x55cf623ed600] 2023-10-03T19:20:53.826 INFO:teuthology.orchestra.run.smithi045.stdout: -5350> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000462 [2,head] #10000000462 auth v5244 s=3 n(v0 rc2023-10-03T19:13:41.882287+0000 b3 1=1+0) (iversion lock) 0x55cf623ed600] 2023-10-03T19:20:53.826 INFO:teuthology.orchestra.run.smithi045.stdout: -5349> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_621 [2,head] auth NULL (dversion lock) v=5244 ino=(nil) state=1073741824 0x55cf623db900] 2023-10-03T19:20:53.826 INFO:teuthology.orchestra.run.smithi045.stdout: -5348> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_620 [2,head] auth (dversion lock) v=5242 ino=0x10000000461 state=1073741824 0x55cf623db680] 2023-10-03T19:20:53.826 INFO:teuthology.orchestra.run.smithi045.stdout: -5347> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.826 INFO:teuthology.orchestra.run.smithi045.stdout: -5346> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000461 [2,head] /dc-dir/dc-file_620 auth v5242 s=3 n(v0 rc2023-10-03T19:13:41.871599+0000 b3 1=1+0) (iversion lock) 0x55cf623ed080] 2023-10-03T19:20:53.826 INFO:teuthology.orchestra.run.smithi045.stdout: -5345> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_620 [2,head] auth (dversion lock) v=5242 ino=0x10000000461 state=1073741824 0x55cf623db680] [inode 0x10000000461 [2,head] /dc-dir/dc-file_620 auth v5242 s=3 n(v0 rc2023-10-03T19:13:41.871599+0000 b3 1=1+0) (iversion lock) 0x55cf623ed080] 2023-10-03T19:20:53.827 INFO:teuthology.orchestra.run.smithi045.stdout: -5344> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000461 [2,head] #10000000461 auth v5242 s=3 n(v0 rc2023-10-03T19:13:41.871599+0000 b3 1=1+0) (iversion lock) 0x55cf623ed080] 2023-10-03T19:20:53.827 INFO:teuthology.orchestra.run.smithi045.stdout: -5343> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_620 [2,head] auth NULL (dversion lock) v=5242 ino=(nil) state=1073741824 0x55cf623db680] 2023-10-03T19:20:53.827 INFO:teuthology.orchestra.run.smithi045.stdout: -5342> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_619 [2,head] auth (dversion lock) v=5240 ino=0x10000000460 state=1073741824 0x55cf623db400] 2023-10-03T19:20:53.827 INFO:teuthology.orchestra.run.smithi045.stdout: -5341> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.827 INFO:teuthology.orchestra.run.smithi045.stdout: -5340> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000460 [2,head] /dc-dir/dc-file_619 auth v5240 s=3 n(v0 rc2023-10-03T19:13:41.860860+0000 b3 1=1+0) (iversion lock) 0x55cf623ecb00] 2023-10-03T19:20:53.827 INFO:teuthology.orchestra.run.smithi045.stdout: -5339> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_619 [2,head] auth (dversion lock) v=5240 ino=0x10000000460 state=1073741824 0x55cf623db400] [inode 0x10000000460 [2,head] /dc-dir/dc-file_619 auth v5240 s=3 n(v0 rc2023-10-03T19:13:41.860860+0000 b3 1=1+0) (iversion lock) 0x55cf623ecb00] 2023-10-03T19:20:53.827 INFO:teuthology.orchestra.run.smithi045.stdout: -5338> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000460 [2,head] #10000000460 auth v5240 s=3 n(v0 rc2023-10-03T19:13:41.860860+0000 b3 1=1+0) (iversion lock) 0x55cf623ecb00] 2023-10-03T19:20:53.827 INFO:teuthology.orchestra.run.smithi045.stdout: -5337> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_619 [2,head] auth NULL (dversion lock) v=5240 ino=(nil) state=1073741824 0x55cf623db400] 2023-10-03T19:20:53.827 INFO:teuthology.orchestra.run.smithi045.stdout: -5336> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_618 [2,head] auth (dversion lock) v=5238 ino=0x1000000045f state=1073741824 0x55cf623db180] 2023-10-03T19:20:53.827 INFO:teuthology.orchestra.run.smithi045.stdout: -5335> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.828 INFO:teuthology.orchestra.run.smithi045.stdout: -5334> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000045f [2,head] /dc-dir/dc-file_618 auth v5238 s=3 n(v0 rc2023-10-03T19:13:41.849913+0000 b3 1=1+0) (iversion lock) 0x55cf623ec580] 2023-10-03T19:20:53.828 INFO:teuthology.orchestra.run.smithi045.stdout: -5333> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_618 [2,head] auth (dversion lock) v=5238 ino=0x1000000045f state=1073741824 0x55cf623db180] [inode 0x1000000045f [2,head] /dc-dir/dc-file_618 auth v5238 s=3 n(v0 rc2023-10-03T19:13:41.849913+0000 b3 1=1+0) (iversion lock) 0x55cf623ec580] 2023-10-03T19:20:53.828 INFO:teuthology.orchestra.run.smithi045.stdout: -5332> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000045f [2,head] #1000000045f auth v5238 s=3 n(v0 rc2023-10-03T19:13:41.849913+0000 b3 1=1+0) (iversion lock) 0x55cf623ec580] 2023-10-03T19:20:53.828 INFO:teuthology.orchestra.run.smithi045.stdout: -5331> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_618 [2,head] auth NULL (dversion lock) v=5238 ino=(nil) state=1073741824 0x55cf623db180] 2023-10-03T19:20:53.828 INFO:teuthology.orchestra.run.smithi045.stdout: -5330> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_617 [2,head] auth (dversion lock) v=5236 ino=0x1000000045e state=1073741824 0x55cf623daf00] 2023-10-03T19:20:53.828 INFO:teuthology.orchestra.run.smithi045.stdout: -5329> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.828 INFO:teuthology.orchestra.run.smithi045.stdout: -5328> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000045e [2,head] /dc-dir/dc-file_617 auth v5236 s=3 n(v0 rc2023-10-03T19:13:41.839408+0000 b3 1=1+0) (iversion lock) 0x55cf623ec000] 2023-10-03T19:20:53.828 INFO:teuthology.orchestra.run.smithi045.stdout: -5327> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_617 [2,head] auth (dversion lock) v=5236 ino=0x1000000045e state=1073741824 0x55cf623daf00] [inode 0x1000000045e [2,head] /dc-dir/dc-file_617 auth v5236 s=3 n(v0 rc2023-10-03T19:13:41.839408+0000 b3 1=1+0) (iversion lock) 0x55cf623ec000] 2023-10-03T19:20:53.828 INFO:teuthology.orchestra.run.smithi045.stdout: -5326> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000045e [2,head] #1000000045e auth v5236 s=3 n(v0 rc2023-10-03T19:13:41.839408+0000 b3 1=1+0) (iversion lock) 0x55cf623ec000] 2023-10-03T19:20:53.828 INFO:teuthology.orchestra.run.smithi045.stdout: -5325> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_617 [2,head] auth NULL (dversion lock) v=5236 ino=(nil) state=1073741824 0x55cf623daf00] 2023-10-03T19:20:53.829 INFO:teuthology.orchestra.run.smithi045.stdout: -5324> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_616 [2,head] auth (dversion lock) v=5234 ino=0x1000000045d state=1073741824 0x55cf623dac80] 2023-10-03T19:20:53.829 INFO:teuthology.orchestra.run.smithi045.stdout: -5323> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.829 INFO:teuthology.orchestra.run.smithi045.stdout: -5322> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000045d [2,head] /dc-dir/dc-file_616 auth v5234 s=3 n(v0 rc2023-10-03T19:13:41.828092+0000 b3 1=1+0) (iversion lock) 0x55cf623e1700] 2023-10-03T19:20:53.829 INFO:teuthology.orchestra.run.smithi045.stdout: -5321> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_616 [2,head] auth (dversion lock) v=5234 ino=0x1000000045d state=1073741824 0x55cf623dac80] [inode 0x1000000045d [2,head] /dc-dir/dc-file_616 auth v5234 s=3 n(v0 rc2023-10-03T19:13:41.828092+0000 b3 1=1+0) (iversion lock) 0x55cf623e1700] 2023-10-03T19:20:53.829 INFO:teuthology.orchestra.run.smithi045.stdout: -5320> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000045d [2,head] #1000000045d auth v5234 s=3 n(v0 rc2023-10-03T19:13:41.828092+0000 b3 1=1+0) (iversion lock) 0x55cf623e1700] 2023-10-03T19:20:53.829 INFO:teuthology.orchestra.run.smithi045.stdout: -5319> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_616 [2,head] auth NULL (dversion lock) v=5234 ino=(nil) state=1073741824 0x55cf623dac80] 2023-10-03T19:20:53.829 INFO:teuthology.orchestra.run.smithi045.stdout: -5318> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_615 [2,head] auth (dversion lock) v=5232 ino=0x1000000045c state=1073741824 0x55cf623daa00] 2023-10-03T19:20:53.829 INFO:teuthology.orchestra.run.smithi045.stdout: -5317> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.829 INFO:teuthology.orchestra.run.smithi045.stdout: -5316> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000045c [2,head] /dc-dir/dc-file_615 auth v5232 s=3 n(v0 rc2023-10-03T19:13:41.817150+0000 b3 1=1+0) (iversion lock) 0x55cf623e1180] 2023-10-03T19:20:53.829 INFO:teuthology.orchestra.run.smithi045.stdout: -5315> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_615 [2,head] auth (dversion lock) v=5232 ino=0x1000000045c state=1073741824 0x55cf623daa00] [inode 0x1000000045c [2,head] /dc-dir/dc-file_615 auth v5232 s=3 n(v0 rc2023-10-03T19:13:41.817150+0000 b3 1=1+0) (iversion lock) 0x55cf623e1180] 2023-10-03T19:20:53.829 INFO:teuthology.orchestra.run.smithi045.stdout: -5314> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000045c [2,head] #1000000045c auth v5232 s=3 n(v0 rc2023-10-03T19:13:41.817150+0000 b3 1=1+0) (iversion lock) 0x55cf623e1180] 2023-10-03T19:20:53.830 INFO:teuthology.orchestra.run.smithi045.stdout: -5313> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_615 [2,head] auth NULL (dversion lock) v=5232 ino=(nil) state=1073741824 0x55cf623daa00] 2023-10-03T19:20:53.830 INFO:teuthology.orchestra.run.smithi045.stdout: -5312> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_614 [2,head] auth (dversion lock) v=5230 ino=0x1000000045b state=1073741824 0x55cf623da780] 2023-10-03T19:20:53.835 INFO:teuthology.orchestra.run.smithi045.stdout: -5311> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.835 INFO:teuthology.orchestra.run.smithi045.stdout: -5310> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000045b [2,head] /dc-dir/dc-file_614 auth v5230 s=3 n(v0 rc2023-10-03T19:13:41.804514+0000 b3 1=1+0) (iversion lock) 0x55cf623e0c00] 2023-10-03T19:20:53.835 INFO:teuthology.orchestra.run.smithi045.stdout: -5309> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_614 [2,head] auth (dversion lock) v=5230 ino=0x1000000045b state=1073741824 0x55cf623da780] [inode 0x1000000045b [2,head] /dc-dir/dc-file_614 auth v5230 s=3 n(v0 rc2023-10-03T19:13:41.804514+0000 b3 1=1+0) (iversion lock) 0x55cf623e0c00] 2023-10-03T19:20:53.835 INFO:teuthology.orchestra.run.smithi045.stdout: -5308> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000045b [2,head] #1000000045b auth v5230 s=3 n(v0 rc2023-10-03T19:13:41.804514+0000 b3 1=1+0) (iversion lock) 0x55cf623e0c00] 2023-10-03T19:20:53.835 INFO:teuthology.orchestra.run.smithi045.stdout: -5307> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_614 [2,head] auth NULL (dversion lock) v=5230 ino=(nil) state=1073741824 0x55cf623da780] 2023-10-03T19:20:53.836 INFO:teuthology.orchestra.run.smithi045.stdout: -5306> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_613 [2,head] auth (dversion lock) v=5228 ino=0x1000000045a state=1073741824 0x55cf623da500] 2023-10-03T19:20:53.836 INFO:teuthology.orchestra.run.smithi045.stdout: -5305> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.836 INFO:teuthology.orchestra.run.smithi045.stdout: -5304> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000045a [2,head] /dc-dir/dc-file_613 auth v5228 s=3 n(v0 rc2023-10-03T19:13:41.792588+0000 b3 1=1+0) (iversion lock) 0x55cf623e0680] 2023-10-03T19:20:53.836 INFO:teuthology.orchestra.run.smithi045.stdout: -5303> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_613 [2,head] auth (dversion lock) v=5228 ino=0x1000000045a state=1073741824 0x55cf623da500] [inode 0x1000000045a [2,head] /dc-dir/dc-file_613 auth v5228 s=3 n(v0 rc2023-10-03T19:13:41.792588+0000 b3 1=1+0) (iversion lock) 0x55cf623e0680] 2023-10-03T19:20:53.836 INFO:teuthology.orchestra.run.smithi045.stdout: -5302> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000045a [2,head] #1000000045a auth v5228 s=3 n(v0 rc2023-10-03T19:13:41.792588+0000 b3 1=1+0) (iversion lock) 0x55cf623e0680] 2023-10-03T19:20:53.836 INFO:teuthology.orchestra.run.smithi045.stdout: -5301> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_613 [2,head] auth NULL (dversion lock) v=5228 ino=(nil) state=1073741824 0x55cf623da500] 2023-10-03T19:20:53.836 INFO:teuthology.orchestra.run.smithi045.stdout: -5300> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_612 [2,head] auth (dversion lock) v=5226 ino=0x10000000459 state=1073741824 0x55cf623da280] 2023-10-03T19:20:53.836 INFO:teuthology.orchestra.run.smithi045.stdout: -5299> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.836 INFO:teuthology.orchestra.run.smithi045.stdout: -5298> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000459 [2,head] /dc-dir/dc-file_612 auth v5226 s=3 n(v0 rc2023-10-03T19:13:41.781394+0000 b3 1=1+0) (iversion lock) 0x55cf623e0100] 2023-10-03T19:20:53.836 INFO:teuthology.orchestra.run.smithi045.stdout: -5297> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_612 [2,head] auth (dversion lock) v=5226 ino=0x10000000459 state=1073741824 0x55cf623da280] [inode 0x10000000459 [2,head] /dc-dir/dc-file_612 auth v5226 s=3 n(v0 rc2023-10-03T19:13:41.781394+0000 b3 1=1+0) (iversion lock) 0x55cf623e0100] 2023-10-03T19:20:53.836 INFO:teuthology.orchestra.run.smithi045.stdout: -5296> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000459 [2,head] #10000000459 auth v5226 s=3 n(v0 rc2023-10-03T19:13:41.781394+0000 b3 1=1+0) (iversion lock) 0x55cf623e0100] 2023-10-03T19:20:53.837 INFO:teuthology.orchestra.run.smithi045.stdout: -5295> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_612 [2,head] auth NULL (dversion lock) v=5226 ino=(nil) state=1073741824 0x55cf623da280] 2023-10-03T19:20:53.837 INFO:teuthology.orchestra.run.smithi045.stdout: -5294> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_611 [2,head] auth (dversion lock) v=5224 ino=0x10000000458 state=1073741824 0x55cf623da000] 2023-10-03T19:20:53.837 INFO:teuthology.orchestra.run.smithi045.stdout: -5293> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.837 INFO:teuthology.orchestra.run.smithi045.stdout: -5292> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000458 [2,head] /dc-dir/dc-file_611 auth v5224 s=3 n(v0 rc2023-10-03T19:13:41.770690+0000 b3 1=1+0) (iversion lock) 0x55cf623dfb80] 2023-10-03T19:20:53.837 INFO:teuthology.orchestra.run.smithi045.stdout: -5291> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_611 [2,head] auth (dversion lock) v=5224 ino=0x10000000458 state=1073741824 0x55cf623da000] [inode 0x10000000458 [2,head] /dc-dir/dc-file_611 auth v5224 s=3 n(v0 rc2023-10-03T19:13:41.770690+0000 b3 1=1+0) (iversion lock) 0x55cf623dfb80] 2023-10-03T19:20:53.837 INFO:teuthology.orchestra.run.smithi045.stdout: -5290> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000458 [2,head] #10000000458 auth v5224 s=3 n(v0 rc2023-10-03T19:13:41.770690+0000 b3 1=1+0) (iversion lock) 0x55cf623dfb80] 2023-10-03T19:20:53.837 INFO:teuthology.orchestra.run.smithi045.stdout: -5289> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_611 [2,head] auth NULL (dversion lock) v=5224 ino=(nil) state=1073741824 0x55cf623da000] 2023-10-03T19:20:53.837 INFO:teuthology.orchestra.run.smithi045.stdout: -5288> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_610 [2,head] auth (dversion lock) v=5222 ino=0x10000000457 state=1073741824 0x55cf623c7b80] 2023-10-03T19:20:53.837 INFO:teuthology.orchestra.run.smithi045.stdout: -5287> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.837 INFO:teuthology.orchestra.run.smithi045.stdout: -5286> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000457 [2,head] /dc-dir/dc-file_610 auth v5222 s=3 n(v0 rc2023-10-03T19:13:41.759059+0000 b3 1=1+0) (iversion lock) 0x55cf623df600] 2023-10-03T19:20:53.838 INFO:teuthology.orchestra.run.smithi045.stdout: -5285> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_610 [2,head] auth (dversion lock) v=5222 ino=0x10000000457 state=1073741824 0x55cf623c7b80] [inode 0x10000000457 [2,head] /dc-dir/dc-file_610 auth v5222 s=3 n(v0 rc2023-10-03T19:13:41.759059+0000 b3 1=1+0) (iversion lock) 0x55cf623df600] 2023-10-03T19:20:53.838 INFO:teuthology.orchestra.run.smithi045.stdout: -5284> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000457 [2,head] #10000000457 auth v5222 s=3 n(v0 rc2023-10-03T19:13:41.759059+0000 b3 1=1+0) (iversion lock) 0x55cf623df600] 2023-10-03T19:20:53.838 INFO:teuthology.orchestra.run.smithi045.stdout: -5283> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_610 [2,head] auth NULL (dversion lock) v=5222 ino=(nil) state=1073741824 0x55cf623c7b80] 2023-10-03T19:20:53.838 INFO:teuthology.orchestra.run.smithi045.stdout: -5282> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_609 [2,head] auth (dversion lock) v=5220 ino=0x10000000456 state=1073741824 0x55cf623c7900] 2023-10-03T19:20:53.838 INFO:teuthology.orchestra.run.smithi045.stdout: -5281> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.838 INFO:teuthology.orchestra.run.smithi045.stdout: -5280> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000456 [2,head] /dc-dir/dc-file_609 auth v5220 s=3 n(v0 rc2023-10-03T19:13:41.746015+0000 b3 1=1+0) (iversion lock) 0x55cf623df080] 2023-10-03T19:20:53.838 INFO:teuthology.orchestra.run.smithi045.stdout: -5279> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_609 [2,head] auth (dversion lock) v=5220 ino=0x10000000456 state=1073741824 0x55cf623c7900] [inode 0x10000000456 [2,head] /dc-dir/dc-file_609 auth v5220 s=3 n(v0 rc2023-10-03T19:13:41.746015+0000 b3 1=1+0) (iversion lock) 0x55cf623df080] 2023-10-03T19:20:53.838 INFO:teuthology.orchestra.run.smithi045.stdout: -5278> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000456 [2,head] #10000000456 auth v5220 s=3 n(v0 rc2023-10-03T19:13:41.746015+0000 b3 1=1+0) (iversion lock) 0x55cf623df080] 2023-10-03T19:20:53.838 INFO:teuthology.orchestra.run.smithi045.stdout: -5277> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_609 [2,head] auth NULL (dversion lock) v=5220 ino=(nil) state=1073741824 0x55cf623c7900] 2023-10-03T19:20:53.838 INFO:teuthology.orchestra.run.smithi045.stdout: -5276> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_608 [2,head] auth (dversion lock) v=5218 ino=0x10000000455 state=1073741824 0x55cf623c7680] 2023-10-03T19:20:53.839 INFO:teuthology.orchestra.run.smithi045.stdout: -5275> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.839 INFO:teuthology.orchestra.run.smithi045.stdout: -5274> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000455 [2,head] /dc-dir/dc-file_608 auth v5218 s=3 n(v0 rc2023-10-03T19:13:41.733802+0000 b3 1=1+0) (iversion lock) 0x55cf623deb00] 2023-10-03T19:20:53.839 INFO:teuthology.orchestra.run.smithi045.stdout: -5273> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_608 [2,head] auth (dversion lock) v=5218 ino=0x10000000455 state=1073741824 0x55cf623c7680] [inode 0x10000000455 [2,head] /dc-dir/dc-file_608 auth v5218 s=3 n(v0 rc2023-10-03T19:13:41.733802+0000 b3 1=1+0) (iversion lock) 0x55cf623deb00] 2023-10-03T19:20:53.839 INFO:teuthology.orchestra.run.smithi045.stdout: -5272> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000455 [2,head] #10000000455 auth v5218 s=3 n(v0 rc2023-10-03T19:13:41.733802+0000 b3 1=1+0) (iversion lock) 0x55cf623deb00] 2023-10-03T19:20:53.839 INFO:teuthology.orchestra.run.smithi045.stdout: -5271> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_608 [2,head] auth NULL (dversion lock) v=5218 ino=(nil) state=1073741824 0x55cf623c7680] 2023-10-03T19:20:53.839 INFO:teuthology.orchestra.run.smithi045.stdout: -5270> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_607 [2,head] auth (dversion lock) v=5216 ino=0x10000000454 state=1073741824 0x55cf623c7400] 2023-10-03T19:20:53.839 INFO:teuthology.orchestra.run.smithi045.stdout: -5269> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.839 INFO:teuthology.orchestra.run.smithi045.stdout: -5268> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000454 [2,head] /dc-dir/dc-file_607 auth v5216 s=3 n(v0 rc2023-10-03T19:13:41.722527+0000 b3 1=1+0) (iversion lock) 0x55cf623de580] 2023-10-03T19:20:53.839 INFO:teuthology.orchestra.run.smithi045.stdout: -5267> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_607 [2,head] auth (dversion lock) v=5216 ino=0x10000000454 state=1073741824 0x55cf623c7400] [inode 0x10000000454 [2,head] /dc-dir/dc-file_607 auth v5216 s=3 n(v0 rc2023-10-03T19:13:41.722527+0000 b3 1=1+0) (iversion lock) 0x55cf623de580] 2023-10-03T19:20:53.839 INFO:teuthology.orchestra.run.smithi045.stdout: -5266> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000454 [2,head] #10000000454 auth v5216 s=3 n(v0 rc2023-10-03T19:13:41.722527+0000 b3 1=1+0) (iversion lock) 0x55cf623de580] 2023-10-03T19:20:53.839 INFO:teuthology.orchestra.run.smithi045.stdout: -5265> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_607 [2,head] auth NULL (dversion lock) v=5216 ino=(nil) state=1073741824 0x55cf623c7400] 2023-10-03T19:20:53.840 INFO:teuthology.orchestra.run.smithi045.stdout: -5264> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_606 [2,head] auth (dversion lock) v=5214 ino=0x10000000453 state=1073741824 0x55cf623c7180] 2023-10-03T19:20:53.840 INFO:teuthology.orchestra.run.smithi045.stdout: -5263> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.840 INFO:teuthology.orchestra.run.smithi045.stdout: -5262> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000453 [2,head] /dc-dir/dc-file_606 auth v5214 s=3 n(v0 rc2023-10-03T19:13:41.710314+0000 b3 1=1+0) (iversion lock) 0x55cf623de000] 2023-10-03T19:20:53.840 INFO:teuthology.orchestra.run.smithi045.stdout: -5261> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_606 [2,head] auth (dversion lock) v=5214 ino=0x10000000453 state=1073741824 0x55cf623c7180] [inode 0x10000000453 [2,head] /dc-dir/dc-file_606 auth v5214 s=3 n(v0 rc2023-10-03T19:13:41.710314+0000 b3 1=1+0) (iversion lock) 0x55cf623de000] 2023-10-03T19:20:53.840 INFO:teuthology.orchestra.run.smithi045.stdout: -5260> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000453 [2,head] #10000000453 auth v5214 s=3 n(v0 rc2023-10-03T19:13:41.710314+0000 b3 1=1+0) (iversion lock) 0x55cf623de000] 2023-10-03T19:20:53.840 INFO:teuthology.orchestra.run.smithi045.stdout: -5259> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_606 [2,head] auth NULL (dversion lock) v=5214 ino=(nil) state=1073741824 0x55cf623c7180] 2023-10-03T19:20:53.840 INFO:teuthology.orchestra.run.smithi045.stdout: -5258> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_605 [2,head] auth (dversion lock) v=5212 ino=0x10000000452 state=1073741824 0x55cf623c6f00] 2023-10-03T19:20:53.840 INFO:teuthology.orchestra.run.smithi045.stdout: -5257> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.840 INFO:teuthology.orchestra.run.smithi045.stdout: -5256> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000452 [2,head] /dc-dir/dc-file_605 auth v5212 s=3 n(v0 rc2023-10-03T19:13:41.697325+0000 b3 1=1+0) (iversion lock) 0x55cf623c3700] 2023-10-03T19:20:53.840 INFO:teuthology.orchestra.run.smithi045.stdout: -5255> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_605 [2,head] auth (dversion lock) v=5212 ino=0x10000000452 state=1073741824 0x55cf623c6f00] [inode 0x10000000452 [2,head] /dc-dir/dc-file_605 auth v5212 s=3 n(v0 rc2023-10-03T19:13:41.697325+0000 b3 1=1+0) (iversion lock) 0x55cf623c3700] 2023-10-03T19:20:53.841 INFO:teuthology.orchestra.run.smithi045.stdout: -5254> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000452 [2,head] #10000000452 auth v5212 s=3 n(v0 rc2023-10-03T19:13:41.697325+0000 b3 1=1+0) (iversion lock) 0x55cf623c3700] 2023-10-03T19:20:53.841 INFO:teuthology.orchestra.run.smithi045.stdout: -5253> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_605 [2,head] auth NULL (dversion lock) v=5212 ino=(nil) state=1073741824 0x55cf623c6f00] 2023-10-03T19:20:53.841 INFO:teuthology.orchestra.run.smithi045.stdout: -5252> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_604 [2,head] auth (dversion lock) v=5210 ino=0x10000000451 state=1073741824 0x55cf623c6c80] 2023-10-03T19:20:53.841 INFO:teuthology.orchestra.run.smithi045.stdout: -5251> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.841 INFO:teuthology.orchestra.run.smithi045.stdout: -5250> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000451 [2,head] /dc-dir/dc-file_604 auth v5210 s=3 n(v0 rc2023-10-03T19:13:41.684827+0000 b3 1=1+0) (iversion lock) 0x55cf623c3180] 2023-10-03T19:20:53.841 INFO:teuthology.orchestra.run.smithi045.stdout: -5249> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_604 [2,head] auth (dversion lock) v=5210 ino=0x10000000451 state=1073741824 0x55cf623c6c80] [inode 0x10000000451 [2,head] /dc-dir/dc-file_604 auth v5210 s=3 n(v0 rc2023-10-03T19:13:41.684827+0000 b3 1=1+0) (iversion lock) 0x55cf623c3180] 2023-10-03T19:20:53.841 INFO:teuthology.orchestra.run.smithi045.stdout: -5248> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000451 [2,head] #10000000451 auth v5210 s=3 n(v0 rc2023-10-03T19:13:41.684827+0000 b3 1=1+0) (iversion lock) 0x55cf623c3180] 2023-10-03T19:20:53.841 INFO:teuthology.orchestra.run.smithi045.stdout: -5247> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_604 [2,head] auth NULL (dversion lock) v=5210 ino=(nil) state=1073741824 0x55cf623c6c80] 2023-10-03T19:20:53.841 INFO:teuthology.orchestra.run.smithi045.stdout: -5246> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_603 [2,head] auth (dversion lock) v=5208 ino=0x10000000450 state=1073741824 0x55cf623c6a00] 2023-10-03T19:20:53.841 INFO:teuthology.orchestra.run.smithi045.stdout: -5245> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.841 INFO:teuthology.orchestra.run.smithi045.stdout: -5244> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000450 [2,head] /dc-dir/dc-file_603 auth v5208 s=3 n(v0 rc2023-10-03T19:13:41.672075+0000 b3 1=1+0) (iversion lock) 0x55cf623c2c00] 2023-10-03T19:20:53.842 INFO:teuthology.orchestra.run.smithi045.stdout: -5243> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_603 [2,head] auth (dversion lock) v=5208 ino=0x10000000450 state=1073741824 0x55cf623c6a00] [inode 0x10000000450 [2,head] /dc-dir/dc-file_603 auth v5208 s=3 n(v0 rc2023-10-03T19:13:41.672075+0000 b3 1=1+0) (iversion lock) 0x55cf623c2c00] 2023-10-03T19:20:53.842 INFO:teuthology.orchestra.run.smithi045.stdout: -5242> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000450 [2,head] #10000000450 auth v5208 s=3 n(v0 rc2023-10-03T19:13:41.672075+0000 b3 1=1+0) (iversion lock) 0x55cf623c2c00] 2023-10-03T19:20:53.842 INFO:teuthology.orchestra.run.smithi045.stdout: -5241> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_603 [2,head] auth NULL (dversion lock) v=5208 ino=(nil) state=1073741824 0x55cf623c6a00] 2023-10-03T19:20:53.842 INFO:teuthology.orchestra.run.smithi045.stdout: -5240> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_602 [2,head] auth (dversion lock) v=5206 ino=0x1000000044f state=1073741824 0x55cf623c6780] 2023-10-03T19:20:53.842 INFO:teuthology.orchestra.run.smithi045.stdout: -5239> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.842 INFO:teuthology.orchestra.run.smithi045.stdout: -5238> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000044f [2,head] /dc-dir/dc-file_602 auth v5206 s=3 n(v0 rc2023-10-03T19:13:41.659403+0000 b3 1=1+0) (iversion lock) 0x55cf623c2680] 2023-10-03T19:20:53.842 INFO:teuthology.orchestra.run.smithi045.stdout: -5237> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_602 [2,head] auth (dversion lock) v=5206 ino=0x1000000044f state=1073741824 0x55cf623c6780] [inode 0x1000000044f [2,head] /dc-dir/dc-file_602 auth v5206 s=3 n(v0 rc2023-10-03T19:13:41.659403+0000 b3 1=1+0) (iversion lock) 0x55cf623c2680] 2023-10-03T19:20:53.842 INFO:teuthology.orchestra.run.smithi045.stdout: -5236> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000044f [2,head] #1000000044f auth v5206 s=3 n(v0 rc2023-10-03T19:13:41.659403+0000 b3 1=1+0) (iversion lock) 0x55cf623c2680] 2023-10-03T19:20:53.842 INFO:teuthology.orchestra.run.smithi045.stdout: -5235> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_602 [2,head] auth NULL (dversion lock) v=5206 ino=(nil) state=1073741824 0x55cf623c6780] 2023-10-03T19:20:53.842 INFO:teuthology.orchestra.run.smithi045.stdout: -5234> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_601 [2,head] auth (dversion lock) v=5204 ino=0x1000000044e state=1073741824 0x55cf623c6500] 2023-10-03T19:20:53.842 INFO:teuthology.orchestra.run.smithi045.stdout: -5233> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.843 INFO:teuthology.orchestra.run.smithi045.stdout: -5232> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000044e [2,head] /dc-dir/dc-file_601 auth v5204 s=3 n(v0 rc2023-10-03T19:13:41.648694+0000 b3 1=1+0) (iversion lock) 0x55cf623c2100] 2023-10-03T19:20:53.843 INFO:teuthology.orchestra.run.smithi045.stdout: -5231> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_601 [2,head] auth (dversion lock) v=5204 ino=0x1000000044e state=1073741824 0x55cf623c6500] [inode 0x1000000044e [2,head] /dc-dir/dc-file_601 auth v5204 s=3 n(v0 rc2023-10-03T19:13:41.648694+0000 b3 1=1+0) (iversion lock) 0x55cf623c2100] 2023-10-03T19:20:53.843 INFO:teuthology.orchestra.run.smithi045.stdout: -5230> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000044e [2,head] #1000000044e auth v5204 s=3 n(v0 rc2023-10-03T19:13:41.648694+0000 b3 1=1+0) (iversion lock) 0x55cf623c2100] 2023-10-03T19:20:53.843 INFO:teuthology.orchestra.run.smithi045.stdout: -5229> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_601 [2,head] auth NULL (dversion lock) v=5204 ino=(nil) state=1073741824 0x55cf623c6500] 2023-10-03T19:20:53.843 INFO:teuthology.orchestra.run.smithi045.stdout: -5228> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_600 [2,head] auth (dversion lock) v=5202 ino=0x1000000044d state=1073741824 0x55cf623c6280] 2023-10-03T19:20:53.843 INFO:teuthology.orchestra.run.smithi045.stdout: -5227> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.843 INFO:teuthology.orchestra.run.smithi045.stdout: -5226> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000044d [2,head] /dc-dir/dc-file_600 auth v5202 s=3 n(v0 rc2023-10-03T19:13:41.635913+0000 b3 1=1+0) (iversion lock) 0x55cf623c1b80] 2023-10-03T19:20:53.843 INFO:teuthology.orchestra.run.smithi045.stdout: -5225> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_600 [2,head] auth (dversion lock) v=5202 ino=0x1000000044d state=1073741824 0x55cf623c6280] [inode 0x1000000044d [2,head] /dc-dir/dc-file_600 auth v5202 s=3 n(v0 rc2023-10-03T19:13:41.635913+0000 b3 1=1+0) (iversion lock) 0x55cf623c1b80] 2023-10-03T19:20:53.843 INFO:teuthology.orchestra.run.smithi045.stdout: -5224> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000044d [2,head] #1000000044d auth v5202 s=3 n(v0 rc2023-10-03T19:13:41.635913+0000 b3 1=1+0) (iversion lock) 0x55cf623c1b80] 2023-10-03T19:20:53.844 INFO:teuthology.orchestra.run.smithi045.stdout: -5223> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_600 [2,head] auth NULL (dversion lock) v=5202 ino=(nil) state=1073741824 0x55cf623c6280] 2023-10-03T19:20:53.844 INFO:teuthology.orchestra.run.smithi045.stdout: -5222> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_599 [2,head] auth (dversion lock) v=5200 ino=0x1000000044c state=1073741824 0x55cf623c6000] 2023-10-03T19:20:53.844 INFO:teuthology.orchestra.run.smithi045.stdout: -5221> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.844 INFO:teuthology.orchestra.run.smithi045.stdout: -5220> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000044c [2,head] /dc-dir/dc-file_599 auth v5200 s=3 n(v0 rc2023-10-03T19:13:41.496736+0000 b3 1=1+0) (iversion lock) 0x55cf623c1600] 2023-10-03T19:20:53.844 INFO:teuthology.orchestra.run.smithi045.stdout: -5219> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_599 [2,head] auth (dversion lock) v=5200 ino=0x1000000044c state=1073741824 0x55cf623c6000] [inode 0x1000000044c [2,head] /dc-dir/dc-file_599 auth v5200 s=3 n(v0 rc2023-10-03T19:13:41.496736+0000 b3 1=1+0) (iversion lock) 0x55cf623c1600] 2023-10-03T19:20:53.844 INFO:teuthology.orchestra.run.smithi045.stdout: -5218> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000044c [2,head] #1000000044c auth v5200 s=3 n(v0 rc2023-10-03T19:13:41.496736+0000 b3 1=1+0) (iversion lock) 0x55cf623c1600] 2023-10-03T19:20:53.844 INFO:teuthology.orchestra.run.smithi045.stdout: -5217> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_599 [2,head] auth NULL (dversion lock) v=5200 ino=(nil) state=1073741824 0x55cf623c6000] 2023-10-03T19:20:53.844 INFO:teuthology.orchestra.run.smithi045.stdout: -5216> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_598 [2,head] auth (dversion lock) v=5096 ino=0x1000000044b state=1073741824 0x55cf623bbb80] 2023-10-03T19:20:53.844 INFO:teuthology.orchestra.run.smithi045.stdout: -5215> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.844 INFO:teuthology.orchestra.run.smithi045.stdout: -5214> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000044b [2,head] /dc-dir/dc-file_598 auth v5096 s=3 n(v0 rc2023-10-03T19:13:41.477744+0000 b3 1=1+0) (iversion lock) 0x55cf623c1080] 2023-10-03T19:20:53.844 INFO:teuthology.orchestra.run.smithi045.stdout: -5213> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_598 [2,head] auth (dversion lock) v=5096 ino=0x1000000044b state=1073741824 0x55cf623bbb80] [inode 0x1000000044b [2,head] /dc-dir/dc-file_598 auth v5096 s=3 n(v0 rc2023-10-03T19:13:41.477744+0000 b3 1=1+0) (iversion lock) 0x55cf623c1080] 2023-10-03T19:20:53.845 INFO:teuthology.orchestra.run.smithi045.stdout: -5212> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000044b [2,head] #1000000044b auth v5096 s=3 n(v0 rc2023-10-03T19:13:41.477744+0000 b3 1=1+0) (iversion lock) 0x55cf623c1080] 2023-10-03T19:20:53.845 INFO:teuthology.orchestra.run.smithi045.stdout: -5211> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_598 [2,head] auth NULL (dversion lock) v=5096 ino=(nil) state=1073741824 0x55cf623bbb80] 2023-10-03T19:20:53.845 INFO:teuthology.orchestra.run.smithi045.stdout: -5210> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_597 [2,head] auth (dversion lock) v=5094 ino=0x1000000044a state=1073741824 0x55cf623bb900] 2023-10-03T19:20:53.845 INFO:teuthology.orchestra.run.smithi045.stdout: -5209> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.845 INFO:teuthology.orchestra.run.smithi045.stdout: -5208> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000044a [2,head] /dc-dir/dc-file_597 auth v5094 s=3 n(v0 rc2023-10-03T19:13:41.466877+0000 b3 1=1+0) (iversion lock) 0x55cf623c0b00] 2023-10-03T19:20:53.845 INFO:teuthology.orchestra.run.smithi045.stdout: -5207> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_597 [2,head] auth (dversion lock) v=5094 ino=0x1000000044a state=1073741824 0x55cf623bb900] [inode 0x1000000044a [2,head] /dc-dir/dc-file_597 auth v5094 s=3 n(v0 rc2023-10-03T19:13:41.466877+0000 b3 1=1+0) (iversion lock) 0x55cf623c0b00] 2023-10-03T19:20:53.845 INFO:teuthology.orchestra.run.smithi045.stdout: -5206> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000044a [2,head] #1000000044a auth v5094 s=3 n(v0 rc2023-10-03T19:13:41.466877+0000 b3 1=1+0) (iversion lock) 0x55cf623c0b00] 2023-10-03T19:20:53.845 INFO:teuthology.orchestra.run.smithi045.stdout: -5205> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_597 [2,head] auth NULL (dversion lock) v=5094 ino=(nil) state=1073741824 0x55cf623bb900] 2023-10-03T19:20:53.845 INFO:teuthology.orchestra.run.smithi045.stdout: -5204> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_596 [2,head] auth (dversion lock) v=5092 ino=0x10000000449 state=1073741824 0x55cf623bb680] 2023-10-03T19:20:53.845 INFO:teuthology.orchestra.run.smithi045.stdout: -5203> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.845 INFO:teuthology.orchestra.run.smithi045.stdout: -5202> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000449 [2,head] /dc-dir/dc-file_596 auth v5092 s=3 n(v0 rc2023-10-03T19:13:41.455922+0000 b3 1=1+0) (iversion lock) 0x55cf623c0580] 2023-10-03T19:20:53.846 INFO:teuthology.orchestra.run.smithi045.stdout: -5201> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_596 [2,head] auth (dversion lock) v=5092 ino=0x10000000449 state=1073741824 0x55cf623bb680] [inode 0x10000000449 [2,head] /dc-dir/dc-file_596 auth v5092 s=3 n(v0 rc2023-10-03T19:13:41.455922+0000 b3 1=1+0) (iversion lock) 0x55cf623c0580] 2023-10-03T19:20:53.846 INFO:teuthology.orchestra.run.smithi045.stdout: -5200> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000449 [2,head] #10000000449 auth v5092 s=3 n(v0 rc2023-10-03T19:13:41.455922+0000 b3 1=1+0) (iversion lock) 0x55cf623c0580] 2023-10-03T19:20:53.846 INFO:teuthology.orchestra.run.smithi045.stdout: -5199> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_596 [2,head] auth NULL (dversion lock) v=5092 ino=(nil) state=1073741824 0x55cf623bb680] 2023-10-03T19:20:53.846 INFO:teuthology.orchestra.run.smithi045.stdout: -5198> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_595 [2,head] auth (dversion lock) v=5090 ino=0x10000000448 state=1073741824 0x55cf623bb400] 2023-10-03T19:20:53.846 INFO:teuthology.orchestra.run.smithi045.stdout: -5197> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.846 INFO:teuthology.orchestra.run.smithi045.stdout: -5196> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000448 [2,head] /dc-dir/dc-file_595 auth v5090 s=3 n(v0 rc2023-10-03T19:13:41.444538+0000 b3 1=1+0) (iversion lock) 0x55cf623c0000] 2023-10-03T19:20:53.846 INFO:teuthology.orchestra.run.smithi045.stdout: -5195> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_595 [2,head] auth (dversion lock) v=5090 ino=0x10000000448 state=1073741824 0x55cf623bb400] [inode 0x10000000448 [2,head] /dc-dir/dc-file_595 auth v5090 s=3 n(v0 rc2023-10-03T19:13:41.444538+0000 b3 1=1+0) (iversion lock) 0x55cf623c0000] 2023-10-03T19:20:53.846 INFO:teuthology.orchestra.run.smithi045.stdout: -5194> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000448 [2,head] #10000000448 auth v5090 s=3 n(v0 rc2023-10-03T19:13:41.444538+0000 b3 1=1+0) (iversion lock) 0x55cf623c0000] 2023-10-03T19:20:53.846 INFO:teuthology.orchestra.run.smithi045.stdout: -5193> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_595 [2,head] auth NULL (dversion lock) v=5090 ino=(nil) state=1073741824 0x55cf623bb400] 2023-10-03T19:20:53.847 INFO:teuthology.orchestra.run.smithi045.stdout: -5192> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_594 [2,head] auth (dversion lock) v=5088 ino=0x10000000447 state=1073741824 0x55cf623bb180] 2023-10-03T19:20:53.847 INFO:teuthology.orchestra.run.smithi045.stdout: -5191> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.847 INFO:teuthology.orchestra.run.smithi045.stdout: -5190> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000447 [2,head] /dc-dir/dc-file_594 auth v5088 s=3 n(v0 rc2023-10-03T19:13:41.433472+0000 b3 1=1+0) (iversion lock) 0x55cf623b9700] 2023-10-03T19:20:53.847 INFO:teuthology.orchestra.run.smithi045.stdout: -5189> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_594 [2,head] auth (dversion lock) v=5088 ino=0x10000000447 state=1073741824 0x55cf623bb180] [inode 0x10000000447 [2,head] /dc-dir/dc-file_594 auth v5088 s=3 n(v0 rc2023-10-03T19:13:41.433472+0000 b3 1=1+0) (iversion lock) 0x55cf623b9700] 2023-10-03T19:20:53.847 INFO:teuthology.orchestra.run.smithi045.stdout: -5188> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000447 [2,head] #10000000447 auth v5088 s=3 n(v0 rc2023-10-03T19:13:41.433472+0000 b3 1=1+0) (iversion lock) 0x55cf623b9700] 2023-10-03T19:20:53.847 INFO:teuthology.orchestra.run.smithi045.stdout: -5187> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_594 [2,head] auth NULL (dversion lock) v=5088 ino=(nil) state=1073741824 0x55cf623bb180] 2023-10-03T19:20:53.847 INFO:teuthology.orchestra.run.smithi045.stdout: -5186> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_593 [2,head] auth (dversion lock) v=5086 ino=0x10000000446 state=1073741824 0x55cf623baf00] 2023-10-03T19:20:53.847 INFO:teuthology.orchestra.run.smithi045.stdout: -5185> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.847 INFO:teuthology.orchestra.run.smithi045.stdout: -5184> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000446 [2,head] /dc-dir/dc-file_593 auth v5086 s=3 n(v0 rc2023-10-03T19:13:41.422417+0000 b3 1=1+0) (iversion lock) 0x55cf623b9180] 2023-10-03T19:20:53.847 INFO:teuthology.orchestra.run.smithi045.stdout: -5183> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_593 [2,head] auth (dversion lock) v=5086 ino=0x10000000446 state=1073741824 0x55cf623baf00] [inode 0x10000000446 [2,head] /dc-dir/dc-file_593 auth v5086 s=3 n(v0 rc2023-10-03T19:13:41.422417+0000 b3 1=1+0) (iversion lock) 0x55cf623b9180] 2023-10-03T19:20:53.847 INFO:teuthology.orchestra.run.smithi045.stdout: -5182> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000446 [2,head] #10000000446 auth v5086 s=3 n(v0 rc2023-10-03T19:13:41.422417+0000 b3 1=1+0) (iversion lock) 0x55cf623b9180] 2023-10-03T19:20:53.848 INFO:teuthology.orchestra.run.smithi045.stdout: -5181> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_593 [2,head] auth NULL (dversion lock) v=5086 ino=(nil) state=1073741824 0x55cf623baf00] 2023-10-03T19:20:53.848 INFO:teuthology.orchestra.run.smithi045.stdout: -5180> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_592 [2,head] auth (dversion lock) v=5084 ino=0x10000000445 state=1073741824 0x55cf623bac80] 2023-10-03T19:20:53.848 INFO:teuthology.orchestra.run.smithi045.stdout: -5179> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.848 INFO:teuthology.orchestra.run.smithi045.stdout: -5178> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000445 [2,head] /dc-dir/dc-file_592 auth v5084 s=3 n(v0 rc2023-10-03T19:13:41.411524+0000 b3 1=1+0) (iversion lock) 0x55cf623b8c00] 2023-10-03T19:20:53.848 INFO:teuthology.orchestra.run.smithi045.stdout: -5177> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_592 [2,head] auth (dversion lock) v=5084 ino=0x10000000445 state=1073741824 0x55cf623bac80] [inode 0x10000000445 [2,head] /dc-dir/dc-file_592 auth v5084 s=3 n(v0 rc2023-10-03T19:13:41.411524+0000 b3 1=1+0) (iversion lock) 0x55cf623b8c00] 2023-10-03T19:20:53.848 INFO:teuthology.orchestra.run.smithi045.stdout: -5176> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000445 [2,head] #10000000445 auth v5084 s=3 n(v0 rc2023-10-03T19:13:41.411524+0000 b3 1=1+0) (iversion lock) 0x55cf623b8c00] 2023-10-03T19:20:53.848 INFO:teuthology.orchestra.run.smithi045.stdout: -5175> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_592 [2,head] auth NULL (dversion lock) v=5084 ino=(nil) state=1073741824 0x55cf623bac80] 2023-10-03T19:20:53.848 INFO:teuthology.orchestra.run.smithi045.stdout: -5174> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_591 [2,head] auth (dversion lock) v=5082 ino=0x10000000444 state=1073741824 0x55cf623baa00] 2023-10-03T19:20:53.848 INFO:teuthology.orchestra.run.smithi045.stdout: -5173> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.848 INFO:teuthology.orchestra.run.smithi045.stdout: -5172> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000444 [2,head] /dc-dir/dc-file_591 auth v5082 s=3 n(v0 rc2023-10-03T19:13:41.400669+0000 b3 1=1+0) (iversion lock) 0x55cf623b8680] 2023-10-03T19:20:53.848 INFO:teuthology.orchestra.run.smithi045.stdout: -5171> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_591 [2,head] auth (dversion lock) v=5082 ino=0x10000000444 state=1073741824 0x55cf623baa00] [inode 0x10000000444 [2,head] /dc-dir/dc-file_591 auth v5082 s=3 n(v0 rc2023-10-03T19:13:41.400669+0000 b3 1=1+0) (iversion lock) 0x55cf623b8680] 2023-10-03T19:20:53.848 INFO:teuthology.orchestra.run.smithi045.stdout: -5170> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000444 [2,head] #10000000444 auth v5082 s=3 n(v0 rc2023-10-03T19:13:41.400669+0000 b3 1=1+0) (iversion lock) 0x55cf623b8680] 2023-10-03T19:20:53.849 INFO:teuthology.orchestra.run.smithi045.stdout: -5169> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_591 [2,head] auth NULL (dversion lock) v=5082 ino=(nil) state=1073741824 0x55cf623baa00] 2023-10-03T19:20:53.849 INFO:teuthology.orchestra.run.smithi045.stdout: -5168> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_590 [2,head] auth (dversion lock) v=5080 ino=0x10000000443 state=1073741824 0x55cf623ba780] 2023-10-03T19:20:53.849 INFO:teuthology.orchestra.run.smithi045.stdout: -5167> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.849 INFO:teuthology.orchestra.run.smithi045.stdout: -5166> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000443 [2,head] /dc-dir/dc-file_590 auth v5080 s=3 n(v0 rc2023-10-03T19:13:41.389675+0000 b3 1=1+0) (iversion lock) 0x55cf623b8100] 2023-10-03T19:20:53.849 INFO:teuthology.orchestra.run.smithi045.stdout: -5165> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_590 [2,head] auth (dversion lock) v=5080 ino=0x10000000443 state=1073741824 0x55cf623ba780] [inode 0x10000000443 [2,head] /dc-dir/dc-file_590 auth v5080 s=3 n(v0 rc2023-10-03T19:13:41.389675+0000 b3 1=1+0) (iversion lock) 0x55cf623b8100] 2023-10-03T19:20:53.849 INFO:teuthology.orchestra.run.smithi045.stdout: -5164> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000443 [2,head] #10000000443 auth v5080 s=3 n(v0 rc2023-10-03T19:13:41.389675+0000 b3 1=1+0) (iversion lock) 0x55cf623b8100] 2023-10-03T19:20:53.849 INFO:teuthology.orchestra.run.smithi045.stdout: -5163> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_590 [2,head] auth NULL (dversion lock) v=5080 ino=(nil) state=1073741824 0x55cf623ba780] 2023-10-03T19:20:53.849 INFO:teuthology.orchestra.run.smithi045.stdout: -5162> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_589 [2,head] auth (dversion lock) v=5078 ino=0x10000000442 state=1073741824 0x55cf623ba500] 2023-10-03T19:20:53.849 INFO:teuthology.orchestra.run.smithi045.stdout: -5161> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.849 INFO:teuthology.orchestra.run.smithi045.stdout: -5160> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000442 [2,head] /dc-dir/dc-file_589 auth v5078 s=3 n(v0 rc2023-10-03T19:13:41.378307+0000 b3 1=1+0) (iversion lock) 0x55cf623b7b80] 2023-10-03T19:20:53.850 INFO:teuthology.orchestra.run.smithi045.stdout: -5159> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_589 [2,head] auth (dversion lock) v=5078 ino=0x10000000442 state=1073741824 0x55cf623ba500] [inode 0x10000000442 [2,head] /dc-dir/dc-file_589 auth v5078 s=3 n(v0 rc2023-10-03T19:13:41.378307+0000 b3 1=1+0) (iversion lock) 0x55cf623b7b80] 2023-10-03T19:20:53.850 INFO:teuthology.orchestra.run.smithi045.stdout: -5158> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000442 [2,head] #10000000442 auth v5078 s=3 n(v0 rc2023-10-03T19:13:41.378307+0000 b3 1=1+0) (iversion lock) 0x55cf623b7b80] 2023-10-03T19:20:53.850 INFO:teuthology.orchestra.run.smithi045.stdout: -5157> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_589 [2,head] auth NULL (dversion lock) v=5078 ino=(nil) state=1073741824 0x55cf623ba500] 2023-10-03T19:20:53.983 INFO:teuthology.orchestra.run.smithi045.stdout: -5156> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_588 [2,head] auth (dversion lock) v=5076 ino=0x10000000441 state=1073741824 0x55cf623ba280] 2023-10-03T19:20:53.983 INFO:teuthology.orchestra.run.smithi045.stdout: -5155> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.983 INFO:teuthology.orchestra.run.smithi045.stdout: -5154> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000441 [2,head] /dc-dir/dc-file_588 auth v5076 s=3 n(v0 rc2023-10-03T19:13:41.367209+0000 b3 1=1+0) (iversion lock) 0x55cf623b7600] 2023-10-03T19:20:53.983 INFO:teuthology.orchestra.run.smithi045.stdout: -5153> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_588 [2,head] auth (dversion lock) v=5076 ino=0x10000000441 state=1073741824 0x55cf623ba280] [inode 0x10000000441 [2,head] /dc-dir/dc-file_588 auth v5076 s=3 n(v0 rc2023-10-03T19:13:41.367209+0000 b3 1=1+0) (iversion lock) 0x55cf623b7600] 2023-10-03T19:20:53.983 INFO:teuthology.orchestra.run.smithi045.stdout: -5152> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000441 [2,head] #10000000441 auth v5076 s=3 n(v0 rc2023-10-03T19:13:41.367209+0000 b3 1=1+0) (iversion lock) 0x55cf623b7600] 2023-10-03T19:20:53.984 INFO:teuthology.orchestra.run.smithi045.stdout: -5151> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_588 [2,head] auth NULL (dversion lock) v=5076 ino=(nil) state=1073741824 0x55cf623ba280] 2023-10-03T19:20:53.984 INFO:teuthology.orchestra.run.smithi045.stdout: -5150> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_587 [2,head] auth (dversion lock) v=5074 ino=0x10000000440 state=1073741824 0x55cf623ba000] 2023-10-03T19:20:53.984 INFO:teuthology.orchestra.run.smithi045.stdout: -5149> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.984 INFO:teuthology.orchestra.run.smithi045.stdout: -5148> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000440 [2,head] /dc-dir/dc-file_587 auth v5074 s=3 n(v0 rc2023-10-03T19:13:41.356040+0000 b3 1=1+0) (iversion lock) 0x55cf623b7080] 2023-10-03T19:20:53.984 INFO:teuthology.orchestra.run.smithi045.stdout: -5147> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_587 [2,head] auth (dversion lock) v=5074 ino=0x10000000440 state=1073741824 0x55cf623ba000] [inode 0x10000000440 [2,head] /dc-dir/dc-file_587 auth v5074 s=3 n(v0 rc2023-10-03T19:13:41.356040+0000 b3 1=1+0) (iversion lock) 0x55cf623b7080] 2023-10-03T19:20:53.984 INFO:teuthology.orchestra.run.smithi045.stdout: -5146> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000440 [2,head] #10000000440 auth v5074 s=3 n(v0 rc2023-10-03T19:13:41.356040+0000 b3 1=1+0) (iversion lock) 0x55cf623b7080] 2023-10-03T19:20:53.984 INFO:teuthology.orchestra.run.smithi045.stdout: -5145> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_587 [2,head] auth NULL (dversion lock) v=5074 ino=(nil) state=1073741824 0x55cf623ba000] 2023-10-03T19:20:53.984 INFO:teuthology.orchestra.run.smithi045.stdout: -5144> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_586 [2,head] auth (dversion lock) v=5072 ino=0x1000000043f state=1073741824 0x55cf623b3b80] 2023-10-03T19:20:53.984 INFO:teuthology.orchestra.run.smithi045.stdout: -5143> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.984 INFO:teuthology.orchestra.run.smithi045.stdout: -5142> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000043f [2,head] /dc-dir/dc-file_586 auth v5072 s=3 n(v0 rc2023-10-03T19:13:41.345083+0000 b3 1=1+0) (iversion lock) 0x55cf623b6b00] 2023-10-03T19:20:53.984 INFO:teuthology.orchestra.run.smithi045.stdout: -5141> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_586 [2,head] auth (dversion lock) v=5072 ino=0x1000000043f state=1073741824 0x55cf623b3b80] [inode 0x1000000043f [2,head] /dc-dir/dc-file_586 auth v5072 s=3 n(v0 rc2023-10-03T19:13:41.345083+0000 b3 1=1+0) (iversion lock) 0x55cf623b6b00] 2023-10-03T19:20:53.985 INFO:teuthology.orchestra.run.smithi045.stdout: -5140> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000043f [2,head] #1000000043f auth v5072 s=3 n(v0 rc2023-10-03T19:13:41.345083+0000 b3 1=1+0) (iversion lock) 0x55cf623b6b00] 2023-10-03T19:20:53.985 INFO:teuthology.orchestra.run.smithi045.stdout: -5139> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_586 [2,head] auth NULL (dversion lock) v=5072 ino=(nil) state=1073741824 0x55cf623b3b80] 2023-10-03T19:20:53.985 INFO:teuthology.orchestra.run.smithi045.stdout: -5138> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_585 [2,head] auth (dversion lock) v=5070 ino=0x1000000043e state=1073741824 0x55cf623b3900] 2023-10-03T19:20:53.985 INFO:teuthology.orchestra.run.smithi045.stdout: -5137> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.985 INFO:teuthology.orchestra.run.smithi045.stdout: -5136> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000043e [2,head] /dc-dir/dc-file_585 auth v5070 s=3 n(v0 rc2023-10-03T19:13:41.333779+0000 b3 1=1+0) (iversion lock) 0x55cf623b6580] 2023-10-03T19:20:53.985 INFO:teuthology.orchestra.run.smithi045.stdout: -5135> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_585 [2,head] auth (dversion lock) v=5070 ino=0x1000000043e state=1073741824 0x55cf623b3900] [inode 0x1000000043e [2,head] /dc-dir/dc-file_585 auth v5070 s=3 n(v0 rc2023-10-03T19:13:41.333779+0000 b3 1=1+0) (iversion lock) 0x55cf623b6580] 2023-10-03T19:20:53.985 INFO:teuthology.orchestra.run.smithi045.stdout: -5134> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000043e [2,head] #1000000043e auth v5070 s=3 n(v0 rc2023-10-03T19:13:41.333779+0000 b3 1=1+0) (iversion lock) 0x55cf623b6580] 2023-10-03T19:20:53.985 INFO:teuthology.orchestra.run.smithi045.stdout: -5133> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_585 [2,head] auth NULL (dversion lock) v=5070 ino=(nil) state=1073741824 0x55cf623b3900] 2023-10-03T19:20:53.985 INFO:teuthology.orchestra.run.smithi045.stdout: -5132> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_584 [2,head] auth (dversion lock) v=5068 ino=0x1000000043d state=1073741824 0x55cf623b3680] 2023-10-03T19:20:53.986 INFO:teuthology.orchestra.run.smithi045.stdout: -5131> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.986 INFO:teuthology.orchestra.run.smithi045.stdout: -5130> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000043d [2,head] /dc-dir/dc-file_584 auth v5068 s=3 n(v0 rc2023-10-03T19:13:41.322663+0000 b3 1=1+0) (iversion lock) 0x55cf623b6000] 2023-10-03T19:20:53.986 INFO:teuthology.orchestra.run.smithi045.stdout: -5129> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_584 [2,head] auth (dversion lock) v=5068 ino=0x1000000043d state=1073741824 0x55cf623b3680] [inode 0x1000000043d [2,head] /dc-dir/dc-file_584 auth v5068 s=3 n(v0 rc2023-10-03T19:13:41.322663+0000 b3 1=1+0) (iversion lock) 0x55cf623b6000] 2023-10-03T19:20:53.986 INFO:teuthology.orchestra.run.smithi045.stdout: -5128> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000043d [2,head] #1000000043d auth v5068 s=3 n(v0 rc2023-10-03T19:13:41.322663+0000 b3 1=1+0) (iversion lock) 0x55cf623b6000] 2023-10-03T19:20:53.986 INFO:teuthology.orchestra.run.smithi045.stdout: -5127> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_584 [2,head] auth NULL (dversion lock) v=5068 ino=(nil) state=1073741824 0x55cf623b3680] 2023-10-03T19:20:53.986 INFO:teuthology.orchestra.run.smithi045.stdout: -5126> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_583 [2,head] auth (dversion lock) v=5066 ino=0x1000000043c state=1073741824 0x55cf623b3400] 2023-10-03T19:20:53.986 INFO:teuthology.orchestra.run.smithi045.stdout: -5125> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.986 INFO:teuthology.orchestra.run.smithi045.stdout: -5124> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000043c [2,head] /dc-dir/dc-file_583 auth v5066 s=3 n(v0 rc2023-10-03T19:13:41.312001+0000 b3 1=1+0) (iversion lock) 0x55cf623b1700] 2023-10-03T19:20:53.986 INFO:teuthology.orchestra.run.smithi045.stdout: -5123> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_583 [2,head] auth (dversion lock) v=5066 ino=0x1000000043c state=1073741824 0x55cf623b3400] [inode 0x1000000043c [2,head] /dc-dir/dc-file_583 auth v5066 s=3 n(v0 rc2023-10-03T19:13:41.312001+0000 b3 1=1+0) (iversion lock) 0x55cf623b1700] 2023-10-03T19:20:53.986 INFO:teuthology.orchestra.run.smithi045.stdout: -5122> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000043c [2,head] #1000000043c auth v5066 s=3 n(v0 rc2023-10-03T19:13:41.312001+0000 b3 1=1+0) (iversion lock) 0x55cf623b1700] 2023-10-03T19:20:53.987 INFO:teuthology.orchestra.run.smithi045.stdout: -5121> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_583 [2,head] auth NULL (dversion lock) v=5066 ino=(nil) state=1073741824 0x55cf623b3400] 2023-10-03T19:20:53.987 INFO:teuthology.orchestra.run.smithi045.stdout: -5120> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_582 [2,head] auth (dversion lock) v=5064 ino=0x1000000043b state=1073741824 0x55cf623b3180] 2023-10-03T19:20:53.987 INFO:teuthology.orchestra.run.smithi045.stdout: -5119> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.987 INFO:teuthology.orchestra.run.smithi045.stdout: -5118> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000043b [2,head] /dc-dir/dc-file_582 auth v5064 s=3 n(v0 rc2023-10-03T19:13:41.300372+0000 b3 1=1+0) (iversion lock) 0x55cf623b1180] 2023-10-03T19:20:53.987 INFO:teuthology.orchestra.run.smithi045.stdout: -5117> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_582 [2,head] auth (dversion lock) v=5064 ino=0x1000000043b state=1073741824 0x55cf623b3180] [inode 0x1000000043b [2,head] /dc-dir/dc-file_582 auth v5064 s=3 n(v0 rc2023-10-03T19:13:41.300372+0000 b3 1=1+0) (iversion lock) 0x55cf623b1180] 2023-10-03T19:20:53.987 INFO:teuthology.orchestra.run.smithi045.stdout: -5116> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000043b [2,head] #1000000043b auth v5064 s=3 n(v0 rc2023-10-03T19:13:41.300372+0000 b3 1=1+0) (iversion lock) 0x55cf623b1180] 2023-10-03T19:20:53.987 INFO:teuthology.orchestra.run.smithi045.stdout: -5115> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_582 [2,head] auth NULL (dversion lock) v=5064 ino=(nil) state=1073741824 0x55cf623b3180] 2023-10-03T19:20:53.987 INFO:teuthology.orchestra.run.smithi045.stdout: -5114> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_581 [2,head] auth (dversion lock) v=5062 ino=0x1000000043a state=1073741824 0x55cf623b2f00] 2023-10-03T19:20:53.987 INFO:teuthology.orchestra.run.smithi045.stdout: -5113> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.987 INFO:teuthology.orchestra.run.smithi045.stdout: -5112> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000043a [2,head] /dc-dir/dc-file_581 auth v5062 s=3 n(v0 rc2023-10-03T19:13:41.288985+0000 b3 1=1+0) (iversion lock) 0x55cf623b0c00] 2023-10-03T19:20:53.987 INFO:teuthology.orchestra.run.smithi045.stdout: -5111> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_581 [2,head] auth (dversion lock) v=5062 ino=0x1000000043a state=1073741824 0x55cf623b2f00] [inode 0x1000000043a [2,head] /dc-dir/dc-file_581 auth v5062 s=3 n(v0 rc2023-10-03T19:13:41.288985+0000 b3 1=1+0) (iversion lock) 0x55cf623b0c00] 2023-10-03T19:20:53.987 INFO:teuthology.orchestra.run.smithi045.stdout: -5110> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000043a [2,head] #1000000043a auth v5062 s=3 n(v0 rc2023-10-03T19:13:41.288985+0000 b3 1=1+0) (iversion lock) 0x55cf623b0c00] 2023-10-03T19:20:53.988 INFO:teuthology.orchestra.run.smithi045.stdout: -5109> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_581 [2,head] auth NULL (dversion lock) v=5062 ino=(nil) state=1073741824 0x55cf623b2f00] 2023-10-03T19:20:53.988 INFO:teuthology.orchestra.run.smithi045.stdout: -5108> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_580 [2,head] auth (dversion lock) v=5060 ino=0x10000000439 state=1073741824 0x55cf623b2c80] 2023-10-03T19:20:53.988 INFO:teuthology.orchestra.run.smithi045.stdout: -5107> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.988 INFO:teuthology.orchestra.run.smithi045.stdout: -5106> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000439 [2,head] /dc-dir/dc-file_580 auth v5060 s=3 n(v0 rc2023-10-03T19:13:41.277330+0000 b3 1=1+0) (iversion lock) 0x55cf623b0680] 2023-10-03T19:20:53.988 INFO:teuthology.orchestra.run.smithi045.stdout: -5105> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_580 [2,head] auth (dversion lock) v=5060 ino=0x10000000439 state=1073741824 0x55cf623b2c80] [inode 0x10000000439 [2,head] /dc-dir/dc-file_580 auth v5060 s=3 n(v0 rc2023-10-03T19:13:41.277330+0000 b3 1=1+0) (iversion lock) 0x55cf623b0680] 2023-10-03T19:20:53.988 INFO:teuthology.orchestra.run.smithi045.stdout: -5104> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000439 [2,head] #10000000439 auth v5060 s=3 n(v0 rc2023-10-03T19:13:41.277330+0000 b3 1=1+0) (iversion lock) 0x55cf623b0680] 2023-10-03T19:20:53.988 INFO:teuthology.orchestra.run.smithi045.stdout: -5103> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_580 [2,head] auth NULL (dversion lock) v=5060 ino=(nil) state=1073741824 0x55cf623b2c80] 2023-10-03T19:20:53.988 INFO:teuthology.orchestra.run.smithi045.stdout: -5102> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_579 [2,head] auth (dversion lock) v=5058 ino=0x10000000438 state=1073741824 0x55cf623b2a00] 2023-10-03T19:20:53.988 INFO:teuthology.orchestra.run.smithi045.stdout: -5101> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.989 INFO:teuthology.orchestra.run.smithi045.stdout: -5100> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000438 [2,head] /dc-dir/dc-file_579 auth v5058 s=3 n(v0 rc2023-10-03T19:13:41.265851+0000 b3 1=1+0) (iversion lock) 0x55cf623b0100] 2023-10-03T19:20:53.989 INFO:teuthology.orchestra.run.smithi045.stdout: -5099> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_579 [2,head] auth (dversion lock) v=5058 ino=0x10000000438 state=1073741824 0x55cf623b2a00] [inode 0x10000000438 [2,head] /dc-dir/dc-file_579 auth v5058 s=3 n(v0 rc2023-10-03T19:13:41.265851+0000 b3 1=1+0) (iversion lock) 0x55cf623b0100] 2023-10-03T19:20:53.989 INFO:teuthology.orchestra.run.smithi045.stdout: -5098> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000438 [2,head] #10000000438 auth v5058 s=3 n(v0 rc2023-10-03T19:13:41.265851+0000 b3 1=1+0) (iversion lock) 0x55cf623b0100] 2023-10-03T19:20:53.989 INFO:teuthology.orchestra.run.smithi045.stdout: -5097> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_579 [2,head] auth NULL (dversion lock) v=5058 ino=(nil) state=1073741824 0x55cf623b2a00] 2023-10-03T19:20:53.989 INFO:teuthology.orchestra.run.smithi045.stdout: -5096> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_578 [2,head] auth (dversion lock) v=5056 ino=0x10000000437 state=1073741824 0x55cf623b2780] 2023-10-03T19:20:53.989 INFO:teuthology.orchestra.run.smithi045.stdout: -5095> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.989 INFO:teuthology.orchestra.run.smithi045.stdout: -5094> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000437 [2,head] /dc-dir/dc-file_578 auth v5056 s=3 n(v0 rc2023-10-03T19:13:41.254520+0000 b3 1=1+0) (iversion lock) 0x55cf623afb80] 2023-10-03T19:20:53.996 INFO:teuthology.orchestra.run.smithi045.stdout: -5093> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_578 [2,head] auth (dversion lock) v=5056 ino=0x10000000437 state=1073741824 0x55cf623b2780] [inode 0x10000000437 [2,head] /dc-dir/dc-file_578 auth v5056 s=3 n(v0 rc2023-10-03T19:13:41.254520+0000 b3 1=1+0) (iversion lock) 0x55cf623afb80] 2023-10-03T19:20:53.996 INFO:teuthology.orchestra.run.smithi045.stdout: -5092> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000437 [2,head] #10000000437 auth v5056 s=3 n(v0 rc2023-10-03T19:13:41.254520+0000 b3 1=1+0) (iversion lock) 0x55cf623afb80] 2023-10-03T19:20:53.996 INFO:teuthology.orchestra.run.smithi045.stdout: -5091> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_578 [2,head] auth NULL (dversion lock) v=5056 ino=(nil) state=1073741824 0x55cf623b2780] 2023-10-03T19:20:53.996 INFO:teuthology.orchestra.run.smithi045.stdout: -5090> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_577 [2,head] auth (dversion lock) v=5054 ino=0x10000000436 state=1073741824 0x55cf623b2500] 2023-10-03T19:20:53.996 INFO:teuthology.orchestra.run.smithi045.stdout: -5089> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.996 INFO:teuthology.orchestra.run.smithi045.stdout: -5088> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000436 [2,head] /dc-dir/dc-file_577 auth v5054 s=3 n(v0 rc2023-10-03T19:13:41.243843+0000 b3 1=1+0) (iversion lock) 0x55cf623af600] 2023-10-03T19:20:53.996 INFO:teuthology.orchestra.run.smithi045.stdout: -5087> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_577 [2,head] auth (dversion lock) v=5054 ino=0x10000000436 state=1073741824 0x55cf623b2500] [inode 0x10000000436 [2,head] /dc-dir/dc-file_577 auth v5054 s=3 n(v0 rc2023-10-03T19:13:41.243843+0000 b3 1=1+0) (iversion lock) 0x55cf623af600] 2023-10-03T19:20:53.997 INFO:teuthology.orchestra.run.smithi045.stdout: -5086> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000436 [2,head] #10000000436 auth v5054 s=3 n(v0 rc2023-10-03T19:13:41.243843+0000 b3 1=1+0) (iversion lock) 0x55cf623af600] 2023-10-03T19:20:53.997 INFO:teuthology.orchestra.run.smithi045.stdout: -5085> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_577 [2,head] auth NULL (dversion lock) v=5054 ino=(nil) state=1073741824 0x55cf623b2500] 2023-10-03T19:20:53.997 INFO:teuthology.orchestra.run.smithi045.stdout: -5084> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_576 [2,head] auth (dversion lock) v=5052 ino=0x10000000435 state=1073741824 0x55cf623b2280] 2023-10-03T19:20:53.997 INFO:teuthology.orchestra.run.smithi045.stdout: -5083> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.997 INFO:teuthology.orchestra.run.smithi045.stdout: -5082> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000435 [2,head] /dc-dir/dc-file_576 auth v5052 s=3 n(v0 rc2023-10-03T19:13:41.232978+0000 b3 1=1+0) (iversion lock) 0x55cf623af080] 2023-10-03T19:20:53.997 INFO:teuthology.orchestra.run.smithi045.stdout: -5081> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_576 [2,head] auth (dversion lock) v=5052 ino=0x10000000435 state=1073741824 0x55cf623b2280] [inode 0x10000000435 [2,head] /dc-dir/dc-file_576 auth v5052 s=3 n(v0 rc2023-10-03T19:13:41.232978+0000 b3 1=1+0) (iversion lock) 0x55cf623af080] 2023-10-03T19:20:53.997 INFO:teuthology.orchestra.run.smithi045.stdout: -5080> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000435 [2,head] #10000000435 auth v5052 s=3 n(v0 rc2023-10-03T19:13:41.232978+0000 b3 1=1+0) (iversion lock) 0x55cf623af080] 2023-10-03T19:20:53.997 INFO:teuthology.orchestra.run.smithi045.stdout: -5079> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_576 [2,head] auth NULL (dversion lock) v=5052 ino=(nil) state=1073741824 0x55cf623b2280] 2023-10-03T19:20:53.997 INFO:teuthology.orchestra.run.smithi045.stdout: -5078> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_575 [2,head] auth (dversion lock) v=5050 ino=0x10000000434 state=1073741824 0x55cf623b2000] 2023-10-03T19:20:53.997 INFO:teuthology.orchestra.run.smithi045.stdout: -5077> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.997 INFO:teuthology.orchestra.run.smithi045.stdout: -5076> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000434 [2,head] /dc-dir/dc-file_575 auth v5050 s=3 n(v0 rc2023-10-03T19:13:41.221744+0000 b3 1=1+0) (iversion lock) 0x55cf623aeb00] 2023-10-03T19:20:53.998 INFO:teuthology.orchestra.run.smithi045.stdout: -5075> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_575 [2,head] auth (dversion lock) v=5050 ino=0x10000000434 state=1073741824 0x55cf623b2000] [inode 0x10000000434 [2,head] /dc-dir/dc-file_575 auth v5050 s=3 n(v0 rc2023-10-03T19:13:41.221744+0000 b3 1=1+0) (iversion lock) 0x55cf623aeb00] 2023-10-03T19:20:53.998 INFO:teuthology.orchestra.run.smithi045.stdout: -5074> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000434 [2,head] #10000000434 auth v5050 s=3 n(v0 rc2023-10-03T19:13:41.221744+0000 b3 1=1+0) (iversion lock) 0x55cf623aeb00] 2023-10-03T19:20:53.998 INFO:teuthology.orchestra.run.smithi045.stdout: -5073> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_575 [2,head] auth NULL (dversion lock) v=5050 ino=(nil) state=1073741824 0x55cf623b2000] 2023-10-03T19:20:53.998 INFO:teuthology.orchestra.run.smithi045.stdout: -5072> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_574 [2,head] auth (dversion lock) v=5048 ino=0x10000000433 state=1073741824 0x55cf6238db80] 2023-10-03T19:20:53.998 INFO:teuthology.orchestra.run.smithi045.stdout: -5071> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.998 INFO:teuthology.orchestra.run.smithi045.stdout: -5070> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000433 [2,head] /dc-dir/dc-file_574 auth v5048 s=3 n(v0 rc2023-10-03T19:13:41.210166+0000 b3 1=1+0) (iversion lock) 0x55cf623ae580] 2023-10-03T19:20:53.998 INFO:teuthology.orchestra.run.smithi045.stdout: -5069> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_574 [2,head] auth (dversion lock) v=5048 ino=0x10000000433 state=1073741824 0x55cf6238db80] [inode 0x10000000433 [2,head] /dc-dir/dc-file_574 auth v5048 s=3 n(v0 rc2023-10-03T19:13:41.210166+0000 b3 1=1+0) (iversion lock) 0x55cf623ae580] 2023-10-03T19:20:53.998 INFO:teuthology.orchestra.run.smithi045.stdout: -5068> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000433 [2,head] #10000000433 auth v5048 s=3 n(v0 rc2023-10-03T19:13:41.210166+0000 b3 1=1+0) (iversion lock) 0x55cf623ae580] 2023-10-03T19:20:53.998 INFO:teuthology.orchestra.run.smithi045.stdout: -5067> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_574 [2,head] auth NULL (dversion lock) v=5048 ino=(nil) state=1073741824 0x55cf6238db80] 2023-10-03T19:20:53.999 INFO:teuthology.orchestra.run.smithi045.stdout: -5066> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_573 [2,head] auth (dversion lock) v=5046 ino=0x10000000432 state=1073741824 0x55cf6238d900] 2023-10-03T19:20:53.999 INFO:teuthology.orchestra.run.smithi045.stdout: -5065> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.999 INFO:teuthology.orchestra.run.smithi045.stdout: -5064> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000432 [2,head] /dc-dir/dc-file_573 auth v5046 s=3 n(v0 rc2023-10-03T19:13:41.196893+0000 b3 1=1+0) (iversion lock) 0x55cf623ae000] 2023-10-03T19:20:53.999 INFO:teuthology.orchestra.run.smithi045.stdout: -5063> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_573 [2,head] auth (dversion lock) v=5046 ino=0x10000000432 state=1073741824 0x55cf6238d900] [inode 0x10000000432 [2,head] /dc-dir/dc-file_573 auth v5046 s=3 n(v0 rc2023-10-03T19:13:41.196893+0000 b3 1=1+0) (iversion lock) 0x55cf623ae000] 2023-10-03T19:20:53.999 INFO:teuthology.orchestra.run.smithi045.stdout: -5062> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000432 [2,head] #10000000432 auth v5046 s=3 n(v0 rc2023-10-03T19:13:41.196893+0000 b3 1=1+0) (iversion lock) 0x55cf623ae000] 2023-10-03T19:20:53.999 INFO:teuthology.orchestra.run.smithi045.stdout: -5061> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_573 [2,head] auth NULL (dversion lock) v=5046 ino=(nil) state=1073741824 0x55cf6238d900] 2023-10-03T19:20:53.999 INFO:teuthology.orchestra.run.smithi045.stdout: -5060> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_572 [2,head] auth (dversion lock) v=5044 ino=0x10000000431 state=1073741824 0x55cf6238d680] 2023-10-03T19:20:53.999 INFO:teuthology.orchestra.run.smithi045.stdout: -5059> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:53.999 INFO:teuthology.orchestra.run.smithi045.stdout: -5058> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000431 [2,head] /dc-dir/dc-file_572 auth v5044 s=3 n(v0 rc2023-10-03T19:13:41.186509+0000 b3 1=1+0) (iversion lock) 0x55cf6238b700] 2023-10-03T19:20:53.999 INFO:teuthology.orchestra.run.smithi045.stdout: -5057> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_572 [2,head] auth (dversion lock) v=5044 ino=0x10000000431 state=1073741824 0x55cf6238d680] [inode 0x10000000431 [2,head] /dc-dir/dc-file_572 auth v5044 s=3 n(v0 rc2023-10-03T19:13:41.186509+0000 b3 1=1+0) (iversion lock) 0x55cf6238b700] 2023-10-03T19:20:53.999 INFO:teuthology.orchestra.run.smithi045.stdout: -5056> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000431 [2,head] #10000000431 auth v5044 s=3 n(v0 rc2023-10-03T19:13:41.186509+0000 b3 1=1+0) (iversion lock) 0x55cf6238b700] 2023-10-03T19:20:54.000 INFO:teuthology.orchestra.run.smithi045.stdout: -5055> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_572 [2,head] auth NULL (dversion lock) v=5044 ino=(nil) state=1073741824 0x55cf6238d680] 2023-10-03T19:20:54.000 INFO:teuthology.orchestra.run.smithi045.stdout: -5054> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_571 [2,head] auth (dversion lock) v=5042 ino=0x10000000430 state=1073741824 0x55cf6238d400] 2023-10-03T19:20:54.000 INFO:teuthology.orchestra.run.smithi045.stdout: -5053> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.000 INFO:teuthology.orchestra.run.smithi045.stdout: -5052> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000430 [2,head] /dc-dir/dc-file_571 auth v5042 s=3 n(v0 rc2023-10-03T19:13:41.175636+0000 b3 1=1+0) (iversion lock) 0x55cf6238b180] 2023-10-03T19:20:54.000 INFO:teuthology.orchestra.run.smithi045.stdout: -5051> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_571 [2,head] auth (dversion lock) v=5042 ino=0x10000000430 state=1073741824 0x55cf6238d400] [inode 0x10000000430 [2,head] /dc-dir/dc-file_571 auth v5042 s=3 n(v0 rc2023-10-03T19:13:41.175636+0000 b3 1=1+0) (iversion lock) 0x55cf6238b180] 2023-10-03T19:20:54.000 INFO:teuthology.orchestra.run.smithi045.stdout: -5050> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000430 [2,head] #10000000430 auth v5042 s=3 n(v0 rc2023-10-03T19:13:41.175636+0000 b3 1=1+0) (iversion lock) 0x55cf6238b180] 2023-10-03T19:20:54.000 INFO:teuthology.orchestra.run.smithi045.stdout: -5049> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_571 [2,head] auth NULL (dversion lock) v=5042 ino=(nil) state=1073741824 0x55cf6238d400] 2023-10-03T19:20:54.000 INFO:teuthology.orchestra.run.smithi045.stdout: -5048> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_570 [2,head] auth (dversion lock) v=5040 ino=0x1000000042f state=1073741824 0x55cf6238d180] 2023-10-03T19:20:54.000 INFO:teuthology.orchestra.run.smithi045.stdout: -5047> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.000 INFO:teuthology.orchestra.run.smithi045.stdout: -5046> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000042f [2,head] /dc-dir/dc-file_570 auth v5040 s=3 n(v0 rc2023-10-03T19:13:41.165052+0000 b3 1=1+0) (iversion lock) 0x55cf6238ac00] 2023-10-03T19:20:54.000 INFO:teuthology.orchestra.run.smithi045.stdout: -5045> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_570 [2,head] auth (dversion lock) v=5040 ino=0x1000000042f state=1073741824 0x55cf6238d180] [inode 0x1000000042f [2,head] /dc-dir/dc-file_570 auth v5040 s=3 n(v0 rc2023-10-03T19:13:41.165052+0000 b3 1=1+0) (iversion lock) 0x55cf6238ac00] 2023-10-03T19:20:54.001 INFO:teuthology.orchestra.run.smithi045.stdout: -5044> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000042f [2,head] #1000000042f auth v5040 s=3 n(v0 rc2023-10-03T19:13:41.165052+0000 b3 1=1+0) (iversion lock) 0x55cf6238ac00] 2023-10-03T19:20:54.001 INFO:teuthology.orchestra.run.smithi045.stdout: -5043> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_570 [2,head] auth NULL (dversion lock) v=5040 ino=(nil) state=1073741824 0x55cf6238d180] 2023-10-03T19:20:54.001 INFO:teuthology.orchestra.run.smithi045.stdout: -5042> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_569 [2,head] auth (dversion lock) v=5038 ino=0x1000000042e state=1073741824 0x55cf6238cf00] 2023-10-03T19:20:54.001 INFO:teuthology.orchestra.run.smithi045.stdout: -5041> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.001 INFO:teuthology.orchestra.run.smithi045.stdout: -5040> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000042e [2,head] /dc-dir/dc-file_569 auth v5038 s=3 n(v0 rc2023-10-03T19:13:41.153546+0000 b3 1=1+0) (iversion lock) 0x55cf6238a680] 2023-10-03T19:20:54.001 INFO:teuthology.orchestra.run.smithi045.stdout: -5039> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_569 [2,head] auth (dversion lock) v=5038 ino=0x1000000042e state=1073741824 0x55cf6238cf00] [inode 0x1000000042e [2,head] /dc-dir/dc-file_569 auth v5038 s=3 n(v0 rc2023-10-03T19:13:41.153546+0000 b3 1=1+0) (iversion lock) 0x55cf6238a680] 2023-10-03T19:20:54.001 INFO:teuthology.orchestra.run.smithi045.stdout: -5038> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000042e [2,head] #1000000042e auth v5038 s=3 n(v0 rc2023-10-03T19:13:41.153546+0000 b3 1=1+0) (iversion lock) 0x55cf6238a680] 2023-10-03T19:20:54.001 INFO:teuthology.orchestra.run.smithi045.stdout: -5037> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_569 [2,head] auth NULL (dversion lock) v=5038 ino=(nil) state=1073741824 0x55cf6238cf00] 2023-10-03T19:20:54.001 INFO:teuthology.orchestra.run.smithi045.stdout: -5036> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_568 [2,head] auth (dversion lock) v=5036 ino=0x1000000042d state=1073741824 0x55cf6238cc80] 2023-10-03T19:20:54.001 INFO:teuthology.orchestra.run.smithi045.stdout: -5035> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.002 INFO:teuthology.orchestra.run.smithi045.stdout: -5034> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000042d [2,head] /dc-dir/dc-file_568 auth v5036 s=3 n(v0 rc2023-10-03T19:13:41.141997+0000 b3 1=1+0) (iversion lock) 0x55cf6238a100] 2023-10-03T19:20:54.002 INFO:teuthology.orchestra.run.smithi045.stdout: -5033> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_568 [2,head] auth (dversion lock) v=5036 ino=0x1000000042d state=1073741824 0x55cf6238cc80] [inode 0x1000000042d [2,head] /dc-dir/dc-file_568 auth v5036 s=3 n(v0 rc2023-10-03T19:13:41.141997+0000 b3 1=1+0) (iversion lock) 0x55cf6238a100] 2023-10-03T19:20:54.002 INFO:teuthology.orchestra.run.smithi045.stdout: -5032> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000042d [2,head] #1000000042d auth v5036 s=3 n(v0 rc2023-10-03T19:13:41.141997+0000 b3 1=1+0) (iversion lock) 0x55cf6238a100] 2023-10-03T19:20:54.002 INFO:teuthology.orchestra.run.smithi045.stdout: -5031> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_568 [2,head] auth NULL (dversion lock) v=5036 ino=(nil) state=1073741824 0x55cf6238cc80] 2023-10-03T19:20:54.002 INFO:teuthology.orchestra.run.smithi045.stdout: -5030> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_567 [2,head] auth (dversion lock) v=5034 ino=0x1000000042c state=1073741824 0x55cf6238ca00] 2023-10-03T19:20:54.002 INFO:teuthology.orchestra.run.smithi045.stdout: -5029> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.002 INFO:teuthology.orchestra.run.smithi045.stdout: -5028> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000042c [2,head] /dc-dir/dc-file_567 auth v5034 s=3 n(v0 rc2023-10-03T19:13:41.128937+0000 b3 1=1+0) (iversion lock) 0x55cf62389b80] 2023-10-03T19:20:54.002 INFO:teuthology.orchestra.run.smithi045.stdout: -5027> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_567 [2,head] auth (dversion lock) v=5034 ino=0x1000000042c state=1073741824 0x55cf6238ca00] [inode 0x1000000042c [2,head] /dc-dir/dc-file_567 auth v5034 s=3 n(v0 rc2023-10-03T19:13:41.128937+0000 b3 1=1+0) (iversion lock) 0x55cf62389b80] 2023-10-03T19:20:54.002 INFO:teuthology.orchestra.run.smithi045.stdout: -5026> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000042c [2,head] #1000000042c auth v5034 s=3 n(v0 rc2023-10-03T19:13:41.128937+0000 b3 1=1+0) (iversion lock) 0x55cf62389b80] 2023-10-03T19:20:54.002 INFO:teuthology.orchestra.run.smithi045.stdout: -5025> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_567 [2,head] auth NULL (dversion lock) v=5034 ino=(nil) state=1073741824 0x55cf6238ca00] 2023-10-03T19:20:54.002 INFO:teuthology.orchestra.run.smithi045.stdout: -5024> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_566 [2,head] auth (dversion lock) v=5032 ino=0x1000000042b state=1073741824 0x55cf6238c780] 2023-10-03T19:20:54.003 INFO:teuthology.orchestra.run.smithi045.stdout: -5023> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.003 INFO:teuthology.orchestra.run.smithi045.stdout: -5022> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000042b [2,head] /dc-dir/dc-file_566 auth v5032 s=3 n(v0 rc2023-10-03T19:13:41.115446+0000 b3 1=1+0) (iversion lock) 0x55cf62389600] 2023-10-03T19:20:54.003 INFO:teuthology.orchestra.run.smithi045.stdout: -5021> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_566 [2,head] auth (dversion lock) v=5032 ino=0x1000000042b state=1073741824 0x55cf6238c780] [inode 0x1000000042b [2,head] /dc-dir/dc-file_566 auth v5032 s=3 n(v0 rc2023-10-03T19:13:41.115446+0000 b3 1=1+0) (iversion lock) 0x55cf62389600] 2023-10-03T19:20:54.003 INFO:teuthology.orchestra.run.smithi045.stdout: -5020> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000042b [2,head] #1000000042b auth v5032 s=3 n(v0 rc2023-10-03T19:13:41.115446+0000 b3 1=1+0) (iversion lock) 0x55cf62389600] 2023-10-03T19:20:54.003 INFO:teuthology.orchestra.run.smithi045.stdout: -5019> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_566 [2,head] auth NULL (dversion lock) v=5032 ino=(nil) state=1073741824 0x55cf6238c780] 2023-10-03T19:20:54.003 INFO:teuthology.orchestra.run.smithi045.stdout: -5018> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_565 [2,head] auth (dversion lock) v=5030 ino=0x1000000042a state=1073741824 0x55cf6238c500] 2023-10-03T19:20:54.003 INFO:teuthology.orchestra.run.smithi045.stdout: -5017> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.003 INFO:teuthology.orchestra.run.smithi045.stdout: -5016> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000042a [2,head] /dc-dir/dc-file_565 auth v5030 s=3 n(v0 rc2023-10-03T19:13:41.104052+0000 b3 1=1+0) (iversion lock) 0x55cf62389080] 2023-10-03T19:20:54.003 INFO:teuthology.orchestra.run.smithi045.stdout: -5015> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_565 [2,head] auth (dversion lock) v=5030 ino=0x1000000042a state=1073741824 0x55cf6238c500] [inode 0x1000000042a [2,head] /dc-dir/dc-file_565 auth v5030 s=3 n(v0 rc2023-10-03T19:13:41.104052+0000 b3 1=1+0) (iversion lock) 0x55cf62389080] 2023-10-03T19:20:54.003 INFO:teuthology.orchestra.run.smithi045.stdout: -5014> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000042a [2,head] #1000000042a auth v5030 s=3 n(v0 rc2023-10-03T19:13:41.104052+0000 b3 1=1+0) (iversion lock) 0x55cf62389080] 2023-10-03T19:20:54.003 INFO:teuthology.orchestra.run.smithi045.stdout: -5013> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_565 [2,head] auth NULL (dversion lock) v=5030 ino=(nil) state=1073741824 0x55cf6238c500] 2023-10-03T19:20:54.004 INFO:teuthology.orchestra.run.smithi045.stdout: -5012> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_564 [2,head] auth (dversion lock) v=5028 ino=0x10000000429 state=1073741824 0x55cf6238c280] 2023-10-03T19:20:54.004 INFO:teuthology.orchestra.run.smithi045.stdout: -5011> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.004 INFO:teuthology.orchestra.run.smithi045.stdout: -5010> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000429 [2,head] /dc-dir/dc-file_564 auth v5028 s=3 n(v0 rc2023-10-03T19:13:41.092752+0000 b3 1=1+0) (iversion lock) 0x55cf62388b00] 2023-10-03T19:20:54.004 INFO:teuthology.orchestra.run.smithi045.stdout: -5009> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_564 [2,head] auth (dversion lock) v=5028 ino=0x10000000429 state=1073741824 0x55cf6238c280] [inode 0x10000000429 [2,head] /dc-dir/dc-file_564 auth v5028 s=3 n(v0 rc2023-10-03T19:13:41.092752+0000 b3 1=1+0) (iversion lock) 0x55cf62388b00] 2023-10-03T19:20:54.004 INFO:teuthology.orchestra.run.smithi045.stdout: -5008> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000429 [2,head] #10000000429 auth v5028 s=3 n(v0 rc2023-10-03T19:13:41.092752+0000 b3 1=1+0) (iversion lock) 0x55cf62388b00] 2023-10-03T19:20:54.004 INFO:teuthology.orchestra.run.smithi045.stdout: -5007> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_564 [2,head] auth NULL (dversion lock) v=5028 ino=(nil) state=1073741824 0x55cf6238c280] 2023-10-03T19:20:54.004 INFO:teuthology.orchestra.run.smithi045.stdout: -5006> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_563 [2,head] auth (dversion lock) v=5026 ino=0x10000000428 state=1073741824 0x55cf6238c000] 2023-10-03T19:20:54.004 INFO:teuthology.orchestra.run.smithi045.stdout: -5005> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.004 INFO:teuthology.orchestra.run.smithi045.stdout: -5004> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000428 [2,head] /dc-dir/dc-file_563 auth v5026 s=3 n(v0 rc2023-10-03T19:13:41.081775+0000 b3 1=1+0) (iversion lock) 0x55cf62388580] 2023-10-03T19:20:54.004 INFO:teuthology.orchestra.run.smithi045.stdout: -5003> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_563 [2,head] auth (dversion lock) v=5026 ino=0x10000000428 state=1073741824 0x55cf6238c000] [inode 0x10000000428 [2,head] /dc-dir/dc-file_563 auth v5026 s=3 n(v0 rc2023-10-03T19:13:41.081775+0000 b3 1=1+0) (iversion lock) 0x55cf62388580] 2023-10-03T19:20:54.005 INFO:teuthology.orchestra.run.smithi045.stdout: -5002> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000428 [2,head] #10000000428 auth v5026 s=3 n(v0 rc2023-10-03T19:13:41.081775+0000 b3 1=1+0) (iversion lock) 0x55cf62388580] 2023-10-03T19:20:54.005 INFO:teuthology.orchestra.run.smithi045.stdout: -5001> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_563 [2,head] auth NULL (dversion lock) v=5026 ino=(nil) state=1073741824 0x55cf6238c000] 2023-10-03T19:20:54.005 INFO:teuthology.orchestra.run.smithi045.stdout: -5000> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_562 [2,head] auth (dversion lock) v=5024 ino=0x10000000427 state=1073741824 0x55cf6237fb80] 2023-10-03T19:20:54.005 INFO:teuthology.orchestra.run.smithi045.stdout: -4999> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.005 INFO:teuthology.orchestra.run.smithi045.stdout: -4998> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000427 [2,head] /dc-dir/dc-file_562 auth v5024 s=3 n(v0 rc2023-10-03T19:13:41.070582+0000 b3 1=1+0) (iversion lock) 0x55cf62388000] 2023-10-03T19:20:54.005 INFO:teuthology.orchestra.run.smithi045.stdout: -4997> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_562 [2,head] auth (dversion lock) v=5024 ino=0x10000000427 state=1073741824 0x55cf6237fb80] [inode 0x10000000427 [2,head] /dc-dir/dc-file_562 auth v5024 s=3 n(v0 rc2023-10-03T19:13:41.070582+0000 b3 1=1+0) (iversion lock) 0x55cf62388000] 2023-10-03T19:20:54.005 INFO:teuthology.orchestra.run.smithi045.stdout: -4996> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000427 [2,head] #10000000427 auth v5024 s=3 n(v0 rc2023-10-03T19:13:41.070582+0000 b3 1=1+0) (iversion lock) 0x55cf62388000] 2023-10-03T19:20:54.005 INFO:teuthology.orchestra.run.smithi045.stdout: -4995> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_562 [2,head] auth NULL (dversion lock) v=5024 ino=(nil) state=1073741824 0x55cf6237fb80] 2023-10-03T19:20:54.005 INFO:teuthology.orchestra.run.smithi045.stdout: -4994> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_561 [2,head] auth (dversion lock) v=5022 ino=0x10000000426 state=1073741824 0x55cf6237f900] 2023-10-03T19:20:54.005 INFO:teuthology.orchestra.run.smithi045.stdout: -4993> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.005 INFO:teuthology.orchestra.run.smithi045.stdout: -4992> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000426 [2,head] /dc-dir/dc-file_561 auth v5022 s=3 n(v0 rc2023-10-03T19:13:41.057946+0000 b3 1=1+0) (iversion lock) 0x55cf62383700] 2023-10-03T19:20:54.005 INFO:teuthology.orchestra.run.smithi045.stdout: -4991> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_561 [2,head] auth (dversion lock) v=5022 ino=0x10000000426 state=1073741824 0x55cf6237f900] [inode 0x10000000426 [2,head] /dc-dir/dc-file_561 auth v5022 s=3 n(v0 rc2023-10-03T19:13:41.057946+0000 b3 1=1+0) (iversion lock) 0x55cf62383700] 2023-10-03T19:20:54.006 INFO:teuthology.orchestra.run.smithi045.stdout: -4990> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000426 [2,head] #10000000426 auth v5022 s=3 n(v0 rc2023-10-03T19:13:41.057946+0000 b3 1=1+0) (iversion lock) 0x55cf62383700] 2023-10-03T19:20:54.006 INFO:teuthology.orchestra.run.smithi045.stdout: -4989> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_561 [2,head] auth NULL (dversion lock) v=5022 ino=(nil) state=1073741824 0x55cf6237f900] 2023-10-03T19:20:54.006 INFO:teuthology.orchestra.run.smithi045.stdout: -4988> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_560 [2,head] auth (dversion lock) v=5020 ino=0x10000000425 state=1073741824 0x55cf6237f680] 2023-10-03T19:20:54.006 INFO:teuthology.orchestra.run.smithi045.stdout: -4987> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.006 INFO:teuthology.orchestra.run.smithi045.stdout: -4986> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000425 [2,head] /dc-dir/dc-file_560 auth v5020 s=3 n(v0 rc2023-10-03T19:13:41.045382+0000 b3 1=1+0) (iversion lock) 0x55cf62383180] 2023-10-03T19:20:54.006 INFO:teuthology.orchestra.run.smithi045.stdout: -4985> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_560 [2,head] auth (dversion lock) v=5020 ino=0x10000000425 state=1073741824 0x55cf6237f680] [inode 0x10000000425 [2,head] /dc-dir/dc-file_560 auth v5020 s=3 n(v0 rc2023-10-03T19:13:41.045382+0000 b3 1=1+0) (iversion lock) 0x55cf62383180] 2023-10-03T19:20:54.006 INFO:teuthology.orchestra.run.smithi045.stdout: -4984> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000425 [2,head] #10000000425 auth v5020 s=3 n(v0 rc2023-10-03T19:13:41.045382+0000 b3 1=1+0) (iversion lock) 0x55cf62383180] 2023-10-03T19:20:54.006 INFO:teuthology.orchestra.run.smithi045.stdout: -4983> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_560 [2,head] auth NULL (dversion lock) v=5020 ino=(nil) state=1073741824 0x55cf6237f680] 2023-10-03T19:20:54.006 INFO:teuthology.orchestra.run.smithi045.stdout: -4982> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_559 [2,head] auth (dversion lock) v=5018 ino=0x10000000424 state=1073741824 0x55cf6237f400] 2023-10-03T19:20:54.006 INFO:teuthology.orchestra.run.smithi045.stdout: -4981> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.006 INFO:teuthology.orchestra.run.smithi045.stdout: -4980> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000424 [2,head] /dc-dir/dc-file_559 auth v5018 s=3 n(v0 rc2023-10-03T19:13:41.033266+0000 b3 1=1+0) (iversion lock) 0x55cf62382c00] 2023-10-03T19:20:54.007 INFO:teuthology.orchestra.run.smithi045.stdout: -4979> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_559 [2,head] auth (dversion lock) v=5018 ino=0x10000000424 state=1073741824 0x55cf6237f400] [inode 0x10000000424 [2,head] /dc-dir/dc-file_559 auth v5018 s=3 n(v0 rc2023-10-03T19:13:41.033266+0000 b3 1=1+0) (iversion lock) 0x55cf62382c00] 2023-10-03T19:20:54.007 INFO:teuthology.orchestra.run.smithi045.stdout: -4978> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000424 [2,head] #10000000424 auth v5018 s=3 n(v0 rc2023-10-03T19:13:41.033266+0000 b3 1=1+0) (iversion lock) 0x55cf62382c00] 2023-10-03T19:20:54.007 INFO:teuthology.orchestra.run.smithi045.stdout: -4977> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_559 [2,head] auth NULL (dversion lock) v=5018 ino=(nil) state=1073741824 0x55cf6237f400] 2023-10-03T19:20:54.007 INFO:teuthology.orchestra.run.smithi045.stdout: -4976> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_558 [2,head] auth (dversion lock) v=5016 ino=0x10000000423 state=1073741824 0x55cf6237f180] 2023-10-03T19:20:54.007 INFO:teuthology.orchestra.run.smithi045.stdout: -4975> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.007 INFO:teuthology.orchestra.run.smithi045.stdout: -4974> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000423 [2,head] /dc-dir/dc-file_558 auth v5016 s=3 n(v0 rc2023-10-03T19:13:41.021827+0000 b3 1=1+0) (iversion lock) 0x55cf62382680] 2023-10-03T19:20:54.007 INFO:teuthology.orchestra.run.smithi045.stdout: -4973> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_558 [2,head] auth (dversion lock) v=5016 ino=0x10000000423 state=1073741824 0x55cf6237f180] [inode 0x10000000423 [2,head] /dc-dir/dc-file_558 auth v5016 s=3 n(v0 rc2023-10-03T19:13:41.021827+0000 b3 1=1+0) (iversion lock) 0x55cf62382680] 2023-10-03T19:20:54.007 INFO:teuthology.orchestra.run.smithi045.stdout: -4972> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000423 [2,head] #10000000423 auth v5016 s=3 n(v0 rc2023-10-03T19:13:41.021827+0000 b3 1=1+0) (iversion lock) 0x55cf62382680] 2023-10-03T19:20:54.007 INFO:teuthology.orchestra.run.smithi045.stdout: -4971> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_558 [2,head] auth NULL (dversion lock) v=5016 ino=(nil) state=1073741824 0x55cf6237f180] 2023-10-03T19:20:54.007 INFO:teuthology.orchestra.run.smithi045.stdout: -4970> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_557 [2,head] auth (dversion lock) v=5014 ino=0x10000000422 state=1073741824 0x55cf6237ef00] 2023-10-03T19:20:54.008 INFO:teuthology.orchestra.run.smithi045.stdout: -4969> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.008 INFO:teuthology.orchestra.run.smithi045.stdout: -4968> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000422 [2,head] /dc-dir/dc-file_557 auth v5014 s=3 n(v0 rc2023-10-03T19:13:41.011222+0000 b3 1=1+0) (iversion lock) 0x55cf62382100] 2023-10-03T19:20:54.008 INFO:teuthology.orchestra.run.smithi045.stdout: -4967> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_557 [2,head] auth (dversion lock) v=5014 ino=0x10000000422 state=1073741824 0x55cf6237ef00] [inode 0x10000000422 [2,head] /dc-dir/dc-file_557 auth v5014 s=3 n(v0 rc2023-10-03T19:13:41.011222+0000 b3 1=1+0) (iversion lock) 0x55cf62382100] 2023-10-03T19:20:54.008 INFO:teuthology.orchestra.run.smithi045.stdout: -4966> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000422 [2,head] #10000000422 auth v5014 s=3 n(v0 rc2023-10-03T19:13:41.011222+0000 b3 1=1+0) (iversion lock) 0x55cf62382100] 2023-10-03T19:20:54.008 INFO:teuthology.orchestra.run.smithi045.stdout: -4965> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_557 [2,head] auth NULL (dversion lock) v=5014 ino=(nil) state=1073741824 0x55cf6237ef00] 2023-10-03T19:20:54.008 INFO:teuthology.orchestra.run.smithi045.stdout: -4964> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_556 [2,head] auth (dversion lock) v=5012 ino=0x10000000421 state=1073741824 0x55cf6237ec80] 2023-10-03T19:20:54.008 INFO:teuthology.orchestra.run.smithi045.stdout: -4963> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.008 INFO:teuthology.orchestra.run.smithi045.stdout: -4962> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000421 [2,head] /dc-dir/dc-file_556 auth v5012 s=3 n(v0 rc2023-10-03T19:13:41.000144+0000 b3 1=1+0) (iversion lock) 0x55cf62381b80] 2023-10-03T19:20:54.008 INFO:teuthology.orchestra.run.smithi045.stdout: -4961> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_556 [2,head] auth (dversion lock) v=5012 ino=0x10000000421 state=1073741824 0x55cf6237ec80] [inode 0x10000000421 [2,head] /dc-dir/dc-file_556 auth v5012 s=3 n(v0 rc2023-10-03T19:13:41.000144+0000 b3 1=1+0) (iversion lock) 0x55cf62381b80] 2023-10-03T19:20:54.008 INFO:teuthology.orchestra.run.smithi045.stdout: -4960> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000421 [2,head] #10000000421 auth v5012 s=3 n(v0 rc2023-10-03T19:13:41.000144+0000 b3 1=1+0) (iversion lock) 0x55cf62381b80] 2023-10-03T19:20:54.008 INFO:teuthology.orchestra.run.smithi045.stdout: -4959> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_556 [2,head] auth NULL (dversion lock) v=5012 ino=(nil) state=1073741824 0x55cf6237ec80] 2023-10-03T19:20:54.009 INFO:teuthology.orchestra.run.smithi045.stdout: -4958> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_555 [2,head] auth (dversion lock) v=5010 ino=0x10000000420 state=1073741824 0x55cf6237ea00] 2023-10-03T19:20:54.009 INFO:teuthology.orchestra.run.smithi045.stdout: -4957> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.009 INFO:teuthology.orchestra.run.smithi045.stdout: -4956> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000420 [2,head] /dc-dir/dc-file_555 auth v5010 s=3 n(v0 rc2023-10-03T19:13:40.989293+0000 b3 1=1+0) (iversion lock) 0x55cf62381600] 2023-10-03T19:20:54.009 INFO:teuthology.orchestra.run.smithi045.stdout: -4955> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_555 [2,head] auth (dversion lock) v=5010 ino=0x10000000420 state=1073741824 0x55cf6237ea00] [inode 0x10000000420 [2,head] /dc-dir/dc-file_555 auth v5010 s=3 n(v0 rc2023-10-03T19:13:40.989293+0000 b3 1=1+0) (iversion lock) 0x55cf62381600] 2023-10-03T19:20:54.009 INFO:teuthology.orchestra.run.smithi045.stdout: -4954> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000420 [2,head] #10000000420 auth v5010 s=3 n(v0 rc2023-10-03T19:13:40.989293+0000 b3 1=1+0) (iversion lock) 0x55cf62381600] 2023-10-03T19:20:54.009 INFO:teuthology.orchestra.run.smithi045.stdout: -4953> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_555 [2,head] auth NULL (dversion lock) v=5010 ino=(nil) state=1073741824 0x55cf6237ea00] 2023-10-03T19:20:54.009 INFO:teuthology.orchestra.run.smithi045.stdout: -4952> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_554 [2,head] auth (dversion lock) v=5008 ino=0x1000000041f state=1073741824 0x55cf6237e780] 2023-10-03T19:20:54.009 INFO:teuthology.orchestra.run.smithi045.stdout: -4951> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.009 INFO:teuthology.orchestra.run.smithi045.stdout: -4950> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000041f [2,head] /dc-dir/dc-file_554 auth v5008 s=3 n(v0 rc2023-10-03T19:13:40.978472+0000 b3 1=1+0) (iversion lock) 0x55cf62381080] 2023-10-03T19:20:54.009 INFO:teuthology.orchestra.run.smithi045.stdout: -4949> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_554 [2,head] auth (dversion lock) v=5008 ino=0x1000000041f state=1073741824 0x55cf6237e780] [inode 0x1000000041f [2,head] /dc-dir/dc-file_554 auth v5008 s=3 n(v0 rc2023-10-03T19:13:40.978472+0000 b3 1=1+0) (iversion lock) 0x55cf62381080] 2023-10-03T19:20:54.009 INFO:teuthology.orchestra.run.smithi045.stdout: -4948> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000041f [2,head] #1000000041f auth v5008 s=3 n(v0 rc2023-10-03T19:13:40.978472+0000 b3 1=1+0) (iversion lock) 0x55cf62381080] 2023-10-03T19:20:54.009 INFO:teuthology.orchestra.run.smithi045.stdout: -4947> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_554 [2,head] auth NULL (dversion lock) v=5008 ino=(nil) state=1073741824 0x55cf6237e780] 2023-10-03T19:20:54.010 INFO:teuthology.orchestra.run.smithi045.stdout: -4946> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_553 [2,head] auth (dversion lock) v=5006 ino=0x1000000041e state=1073741824 0x55cf6237e500] 2023-10-03T19:20:54.010 INFO:teuthology.orchestra.run.smithi045.stdout: -4945> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.010 INFO:teuthology.orchestra.run.smithi045.stdout: -4944> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000041e [2,head] /dc-dir/dc-file_553 auth v5006 s=3 n(v0 rc2023-10-03T19:13:40.966887+0000 b3 1=1+0) (iversion lock) 0x55cf62380b00] 2023-10-03T19:20:54.010 INFO:teuthology.orchestra.run.smithi045.stdout: -4943> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_553 [2,head] auth (dversion lock) v=5006 ino=0x1000000041e state=1073741824 0x55cf6237e500] [inode 0x1000000041e [2,head] /dc-dir/dc-file_553 auth v5006 s=3 n(v0 rc2023-10-03T19:13:40.966887+0000 b3 1=1+0) (iversion lock) 0x55cf62380b00] 2023-10-03T19:20:54.010 INFO:teuthology.orchestra.run.smithi045.stdout: -4942> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000041e [2,head] #1000000041e auth v5006 s=3 n(v0 rc2023-10-03T19:13:40.966887+0000 b3 1=1+0) (iversion lock) 0x55cf62380b00] 2023-10-03T19:20:54.010 INFO:teuthology.orchestra.run.smithi045.stdout: -4941> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_553 [2,head] auth NULL (dversion lock) v=5006 ino=(nil) state=1073741824 0x55cf6237e500] 2023-10-03T19:20:54.010 INFO:teuthology.orchestra.run.smithi045.stdout: -4940> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_552 [2,head] auth (dversion lock) v=5004 ino=0x1000000041d state=1073741824 0x55cf6237e280] 2023-10-03T19:20:54.010 INFO:teuthology.orchestra.run.smithi045.stdout: -4939> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.010 INFO:teuthology.orchestra.run.smithi045.stdout: -4938> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000041d [2,head] /dc-dir/dc-file_552 auth v5004 s=3 n(v0 rc2023-10-03T19:13:40.955445+0000 b3 1=1+0) (iversion lock) 0x55cf62380580] 2023-10-03T19:20:54.010 INFO:teuthology.orchestra.run.smithi045.stdout: -4937> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_552 [2,head] auth (dversion lock) v=5004 ino=0x1000000041d state=1073741824 0x55cf6237e280] [inode 0x1000000041d [2,head] /dc-dir/dc-file_552 auth v5004 s=3 n(v0 rc2023-10-03T19:13:40.955445+0000 b3 1=1+0) (iversion lock) 0x55cf62380580] 2023-10-03T19:20:54.011 INFO:teuthology.orchestra.run.smithi045.stdout: -4936> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000041d [2,head] #1000000041d auth v5004 s=3 n(v0 rc2023-10-03T19:13:40.955445+0000 b3 1=1+0) (iversion lock) 0x55cf62380580] 2023-10-03T19:20:54.011 INFO:teuthology.orchestra.run.smithi045.stdout: -4935> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_552 [2,head] auth NULL (dversion lock) v=5004 ino=(nil) state=1073741824 0x55cf6237e280] 2023-10-03T19:20:54.011 INFO:teuthology.orchestra.run.smithi045.stdout: -4934> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_551 [2,head] auth (dversion lock) v=5002 ino=0x1000000041c state=1073741824 0x55cf6237e000] 2023-10-03T19:20:54.011 INFO:teuthology.orchestra.run.smithi045.stdout: -4933> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.011 INFO:teuthology.orchestra.run.smithi045.stdout: -4932> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000041c [2,head] /dc-dir/dc-file_551 auth v5002 s=3 n(v0 rc2023-10-03T19:13:40.943622+0000 b3 1=1+0) (iversion lock) 0x55cf62380000] 2023-10-03T19:20:54.011 INFO:teuthology.orchestra.run.smithi045.stdout: -4931> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_551 [2,head] auth (dversion lock) v=5002 ino=0x1000000041c state=1073741824 0x55cf6237e000] [inode 0x1000000041c [2,head] /dc-dir/dc-file_551 auth v5002 s=3 n(v0 rc2023-10-03T19:13:40.943622+0000 b3 1=1+0) (iversion lock) 0x55cf62380000] 2023-10-03T19:20:54.011 INFO:teuthology.orchestra.run.smithi045.stdout: -4930> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000041c [2,head] #1000000041c auth v5002 s=3 n(v0 rc2023-10-03T19:13:40.943622+0000 b3 1=1+0) (iversion lock) 0x55cf62380000] 2023-10-03T19:20:54.011 INFO:teuthology.orchestra.run.smithi045.stdout: -4929> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_551 [2,head] auth NULL (dversion lock) v=5002 ino=(nil) state=1073741824 0x55cf6237e000] 2023-10-03T19:20:54.011 INFO:teuthology.orchestra.run.smithi045.stdout: -4928> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_550 [2,head] auth (dversion lock) v=5000 ino=0x1000000041b state=1073741824 0x55cf62367b80] 2023-10-03T19:20:54.011 INFO:teuthology.orchestra.run.smithi045.stdout: -4927> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.011 INFO:teuthology.orchestra.run.smithi045.stdout: -4926> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000041b [2,head] /dc-dir/dc-file_550 auth v5000 s=3 n(v0 rc2023-10-03T19:13:40.931794+0000 b3 1=1+0) (iversion lock) 0x55cf62375700] 2023-10-03T19:20:54.012 INFO:teuthology.orchestra.run.smithi045.stdout: -4925> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_550 [2,head] auth (dversion lock) v=5000 ino=0x1000000041b state=1073741824 0x55cf62367b80] [inode 0x1000000041b [2,head] /dc-dir/dc-file_550 auth v5000 s=3 n(v0 rc2023-10-03T19:13:40.931794+0000 b3 1=1+0) (iversion lock) 0x55cf62375700] 2023-10-03T19:20:54.145 INFO:teuthology.orchestra.run.smithi045.stdout: -4924> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000041b [2,head] #1000000041b auth v5000 s=3 n(v0 rc2023-10-03T19:13:40.931794+0000 b3 1=1+0) (iversion lock) 0x55cf62375700] 2023-10-03T19:20:54.145 INFO:teuthology.orchestra.run.smithi045.stdout: -4923> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_550 [2,head] auth NULL (dversion lock) v=5000 ino=(nil) state=1073741824 0x55cf62367b80] 2023-10-03T19:20:54.145 INFO:teuthology.orchestra.run.smithi045.stdout: -4922> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_549 [2,head] auth (dversion lock) v=4998 ino=0x1000000041a state=1073741824 0x55cf62367900] 2023-10-03T19:20:54.145 INFO:teuthology.orchestra.run.smithi045.stdout: -4921> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.145 INFO:teuthology.orchestra.run.smithi045.stdout: -4920> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000041a [2,head] /dc-dir/dc-file_549 auth v4998 s=3 n(v0 rc2023-10-03T19:13:40.919148+0000 b3 1=1+0) (iversion lock) 0x55cf62375180] 2023-10-03T19:20:54.145 INFO:teuthology.orchestra.run.smithi045.stdout: -4919> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_549 [2,head] auth (dversion lock) v=4998 ino=0x1000000041a state=1073741824 0x55cf62367900] [inode 0x1000000041a [2,head] /dc-dir/dc-file_549 auth v4998 s=3 n(v0 rc2023-10-03T19:13:40.919148+0000 b3 1=1+0) (iversion lock) 0x55cf62375180] 2023-10-03T19:20:54.145 INFO:teuthology.orchestra.run.smithi045.stdout: -4918> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000041a [2,head] #1000000041a auth v4998 s=3 n(v0 rc2023-10-03T19:13:40.919148+0000 b3 1=1+0) (iversion lock) 0x55cf62375180] 2023-10-03T19:20:54.145 INFO:teuthology.orchestra.run.smithi045.stdout: -4917> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_549 [2,head] auth NULL (dversion lock) v=4998 ino=(nil) state=1073741824 0x55cf62367900] 2023-10-03T19:20:54.146 INFO:teuthology.orchestra.run.smithi045.stdout: -4916> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_548 [2,head] auth (dversion lock) v=4996 ino=0x10000000419 state=1073741824 0x55cf62367680] 2023-10-03T19:20:54.146 INFO:teuthology.orchestra.run.smithi045.stdout: -4915> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.146 INFO:teuthology.orchestra.run.smithi045.stdout: -4914> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000419 [2,head] /dc-dir/dc-file_548 auth v4996 s=3 n(v0 rc2023-10-03T19:13:40.908472+0000 b3 1=1+0) (iversion lock) 0x55cf62374c00] 2023-10-03T19:20:54.146 INFO:teuthology.orchestra.run.smithi045.stdout: -4913> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_548 [2,head] auth (dversion lock) v=4996 ino=0x10000000419 state=1073741824 0x55cf62367680] [inode 0x10000000419 [2,head] /dc-dir/dc-file_548 auth v4996 s=3 n(v0 rc2023-10-03T19:13:40.908472+0000 b3 1=1+0) (iversion lock) 0x55cf62374c00] 2023-10-03T19:20:54.146 INFO:teuthology.orchestra.run.smithi045.stdout: -4912> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000419 [2,head] #10000000419 auth v4996 s=3 n(v0 rc2023-10-03T19:13:40.908472+0000 b3 1=1+0) (iversion lock) 0x55cf62374c00] 2023-10-03T19:20:54.146 INFO:teuthology.orchestra.run.smithi045.stdout: -4911> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_548 [2,head] auth NULL (dversion lock) v=4996 ino=(nil) state=1073741824 0x55cf62367680] 2023-10-03T19:20:54.146 INFO:teuthology.orchestra.run.smithi045.stdout: -4910> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_547 [2,head] auth (dversion lock) v=4994 ino=0x10000000418 state=1073741824 0x55cf62367400] 2023-10-03T19:20:54.147 INFO:teuthology.orchestra.run.smithi045.stdout: -4909> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.147 INFO:teuthology.orchestra.run.smithi045.stdout: -4908> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000418 [2,head] /dc-dir/dc-file_547 auth v4994 s=3 n(v0 rc2023-10-03T19:13:40.896874+0000 b3 1=1+0) (iversion lock) 0x55cf62374680] 2023-10-03T19:20:54.147 INFO:teuthology.orchestra.run.smithi045.stdout: -4907> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_547 [2,head] auth (dversion lock) v=4994 ino=0x10000000418 state=1073741824 0x55cf62367400] [inode 0x10000000418 [2,head] /dc-dir/dc-file_547 auth v4994 s=3 n(v0 rc2023-10-03T19:13:40.896874+0000 b3 1=1+0) (iversion lock) 0x55cf62374680] 2023-10-03T19:20:54.147 INFO:teuthology.orchestra.run.smithi045.stdout: -4906> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000418 [2,head] #10000000418 auth v4994 s=3 n(v0 rc2023-10-03T19:13:40.896874+0000 b3 1=1+0) (iversion lock) 0x55cf62374680] 2023-10-03T19:20:54.147 INFO:teuthology.orchestra.run.smithi045.stdout: -4905> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_547 [2,head] auth NULL (dversion lock) v=4994 ino=(nil) state=1073741824 0x55cf62367400] 2023-10-03T19:20:54.147 INFO:teuthology.orchestra.run.smithi045.stdout: -4904> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_546 [2,head] auth (dversion lock) v=4992 ino=0x10000000417 state=1073741824 0x55cf62367180] 2023-10-03T19:20:54.147 INFO:teuthology.orchestra.run.smithi045.stdout: -4903> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.147 INFO:teuthology.orchestra.run.smithi045.stdout: -4902> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000417 [2,head] /dc-dir/dc-file_546 auth v4992 s=3 n(v0 rc2023-10-03T19:13:40.886080+0000 b3 1=1+0) (iversion lock) 0x55cf62374100] 2023-10-03T19:20:54.147 INFO:teuthology.orchestra.run.smithi045.stdout: -4901> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_546 [2,head] auth (dversion lock) v=4992 ino=0x10000000417 state=1073741824 0x55cf62367180] [inode 0x10000000417 [2,head] /dc-dir/dc-file_546 auth v4992 s=3 n(v0 rc2023-10-03T19:13:40.886080+0000 b3 1=1+0) (iversion lock) 0x55cf62374100] 2023-10-03T19:20:54.147 INFO:teuthology.orchestra.run.smithi045.stdout: -4900> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000417 [2,head] #10000000417 auth v4992 s=3 n(v0 rc2023-10-03T19:13:40.886080+0000 b3 1=1+0) (iversion lock) 0x55cf62374100] 2023-10-03T19:20:54.148 INFO:teuthology.orchestra.run.smithi045.stdout: -4899> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_546 [2,head] auth NULL (dversion lock) v=4992 ino=(nil) state=1073741824 0x55cf62367180] 2023-10-03T19:20:54.148 INFO:teuthology.orchestra.run.smithi045.stdout: -4898> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_545 [2,head] auth (dversion lock) v=4990 ino=0x10000000416 state=1073741824 0x55cf62366f00] 2023-10-03T19:20:54.148 INFO:teuthology.orchestra.run.smithi045.stdout: -4897> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.148 INFO:teuthology.orchestra.run.smithi045.stdout: -4896> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000416 [2,head] /dc-dir/dc-file_545 auth v4990 s=3 n(v0 rc2023-10-03T19:13:40.875750+0000 b3 1=1+0) (iversion lock) 0x55cf62373b80] 2023-10-03T19:20:54.148 INFO:teuthology.orchestra.run.smithi045.stdout: -4895> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_545 [2,head] auth (dversion lock) v=4990 ino=0x10000000416 state=1073741824 0x55cf62366f00] [inode 0x10000000416 [2,head] /dc-dir/dc-file_545 auth v4990 s=3 n(v0 rc2023-10-03T19:13:40.875750+0000 b3 1=1+0) (iversion lock) 0x55cf62373b80] 2023-10-03T19:20:54.148 INFO:teuthology.orchestra.run.smithi045.stdout: -4894> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000416 [2,head] #10000000416 auth v4990 s=3 n(v0 rc2023-10-03T19:13:40.875750+0000 b3 1=1+0) (iversion lock) 0x55cf62373b80] 2023-10-03T19:20:54.148 INFO:teuthology.orchestra.run.smithi045.stdout: -4893> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_545 [2,head] auth NULL (dversion lock) v=4990 ino=(nil) state=1073741824 0x55cf62366f00] 2023-10-03T19:20:54.148 INFO:teuthology.orchestra.run.smithi045.stdout: -4892> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_544 [2,head] auth (dversion lock) v=4988 ino=0x10000000415 state=1073741824 0x55cf62366c80] 2023-10-03T19:20:54.148 INFO:teuthology.orchestra.run.smithi045.stdout: -4891> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.148 INFO:teuthology.orchestra.run.smithi045.stdout: -4890> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000415 [2,head] /dc-dir/dc-file_544 auth v4988 s=3 n(v0 rc2023-10-03T19:13:40.864849+0000 b3 1=1+0) (iversion lock) 0x55cf62373600] 2023-10-03T19:20:54.148 INFO:teuthology.orchestra.run.smithi045.stdout: -4889> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_544 [2,head] auth (dversion lock) v=4988 ino=0x10000000415 state=1073741824 0x55cf62366c80] [inode 0x10000000415 [2,head] /dc-dir/dc-file_544 auth v4988 s=3 n(v0 rc2023-10-03T19:13:40.864849+0000 b3 1=1+0) (iversion lock) 0x55cf62373600] 2023-10-03T19:20:54.149 INFO:teuthology.orchestra.run.smithi045.stdout: -4888> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000415 [2,head] #10000000415 auth v4988 s=3 n(v0 rc2023-10-03T19:13:40.864849+0000 b3 1=1+0) (iversion lock) 0x55cf62373600] 2023-10-03T19:20:54.149 INFO:teuthology.orchestra.run.smithi045.stdout: -4887> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_544 [2,head] auth NULL (dversion lock) v=4988 ino=(nil) state=1073741824 0x55cf62366c80] 2023-10-03T19:20:54.149 INFO:teuthology.orchestra.run.smithi045.stdout: -4886> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_543 [2,head] auth (dversion lock) v=4986 ino=0x10000000414 state=1073741824 0x55cf62366a00] 2023-10-03T19:20:54.149 INFO:teuthology.orchestra.run.smithi045.stdout: -4885> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.149 INFO:teuthology.orchestra.run.smithi045.stdout: -4884> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000414 [2,head] /dc-dir/dc-file_543 auth v4986 s=3 n(v0 rc2023-10-03T19:13:40.853526+0000 b3 1=1+0) (iversion lock) 0x55cf62373080] 2023-10-03T19:20:54.149 INFO:teuthology.orchestra.run.smithi045.stdout: -4883> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_543 [2,head] auth (dversion lock) v=4986 ino=0x10000000414 state=1073741824 0x55cf62366a00] [inode 0x10000000414 [2,head] /dc-dir/dc-file_543 auth v4986 s=3 n(v0 rc2023-10-03T19:13:40.853526+0000 b3 1=1+0) (iversion lock) 0x55cf62373080] 2023-10-03T19:20:54.149 INFO:teuthology.orchestra.run.smithi045.stdout: -4882> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000414 [2,head] #10000000414 auth v4986 s=3 n(v0 rc2023-10-03T19:13:40.853526+0000 b3 1=1+0) (iversion lock) 0x55cf62373080] 2023-10-03T19:20:54.149 INFO:teuthology.orchestra.run.smithi045.stdout: -4881> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_543 [2,head] auth NULL (dversion lock) v=4986 ino=(nil) state=1073741824 0x55cf62366a00] 2023-10-03T19:20:54.149 INFO:teuthology.orchestra.run.smithi045.stdout: -4880> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_542 [2,head] auth (dversion lock) v=4984 ino=0x10000000413 state=1073741824 0x55cf62366780] 2023-10-03T19:20:54.149 INFO:teuthology.orchestra.run.smithi045.stdout: -4879> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.150 INFO:teuthology.orchestra.run.smithi045.stdout: -4878> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000413 [2,head] /dc-dir/dc-file_542 auth v4984 s=3 n(v0 rc2023-10-03T19:13:40.842969+0000 b3 1=1+0) (iversion lock) 0x55cf62372b00] 2023-10-03T19:20:54.150 INFO:teuthology.orchestra.run.smithi045.stdout: -4877> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_542 [2,head] auth (dversion lock) v=4984 ino=0x10000000413 state=1073741824 0x55cf62366780] [inode 0x10000000413 [2,head] /dc-dir/dc-file_542 auth v4984 s=3 n(v0 rc2023-10-03T19:13:40.842969+0000 b3 1=1+0) (iversion lock) 0x55cf62372b00] 2023-10-03T19:20:54.150 INFO:teuthology.orchestra.run.smithi045.stdout: -4876> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000413 [2,head] #10000000413 auth v4984 s=3 n(v0 rc2023-10-03T19:13:40.842969+0000 b3 1=1+0) (iversion lock) 0x55cf62372b00] 2023-10-03T19:20:54.150 INFO:teuthology.orchestra.run.smithi045.stdout: -4875> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_542 [2,head] auth NULL (dversion lock) v=4984 ino=(nil) state=1073741824 0x55cf62366780] 2023-10-03T19:20:54.150 INFO:teuthology.orchestra.run.smithi045.stdout: -4874> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_541 [2,head] auth (dversion lock) v=4982 ino=0x10000000412 state=1073741824 0x55cf62366500] 2023-10-03T19:20:54.150 INFO:teuthology.orchestra.run.smithi045.stdout: -4873> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.150 INFO:teuthology.orchestra.run.smithi045.stdout: -4872> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000412 [2,head] /dc-dir/dc-file_541 auth v4982 s=3 n(v0 rc2023-10-03T19:13:40.831152+0000 b3 1=1+0) (iversion lock) 0x55cf62372580] 2023-10-03T19:20:54.150 INFO:teuthology.orchestra.run.smithi045.stdout: -4871> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_541 [2,head] auth (dversion lock) v=4982 ino=0x10000000412 state=1073741824 0x55cf62366500] [inode 0x10000000412 [2,head] /dc-dir/dc-file_541 auth v4982 s=3 n(v0 rc2023-10-03T19:13:40.831152+0000 b3 1=1+0) (iversion lock) 0x55cf62372580] 2023-10-03T19:20:54.150 INFO:teuthology.orchestra.run.smithi045.stdout: -4870> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000412 [2,head] #10000000412 auth v4982 s=3 n(v0 rc2023-10-03T19:13:40.831152+0000 b3 1=1+0) (iversion lock) 0x55cf62372580] 2023-10-03T19:20:54.150 INFO:teuthology.orchestra.run.smithi045.stdout: -4869> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_541 [2,head] auth NULL (dversion lock) v=4982 ino=(nil) state=1073741824 0x55cf62366500] 2023-10-03T19:20:54.151 INFO:teuthology.orchestra.run.smithi045.stdout: -4868> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_540 [2,head] auth (dversion lock) v=4980 ino=0x10000000411 state=1073741824 0x55cf62366280] 2023-10-03T19:20:54.151 INFO:teuthology.orchestra.run.smithi045.stdout: -4867> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.151 INFO:teuthology.orchestra.run.smithi045.stdout: -4866> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000411 [2,head] /dc-dir/dc-file_540 auth v4980 s=3 n(v0 rc2023-10-03T19:13:40.819492+0000 b3 1=1+0) (iversion lock) 0x55cf62372000] 2023-10-03T19:20:54.151 INFO:teuthology.orchestra.run.smithi045.stdout: -4865> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_540 [2,head] auth (dversion lock) v=4980 ino=0x10000000411 state=1073741824 0x55cf62366280] [inode 0x10000000411 [2,head] /dc-dir/dc-file_540 auth v4980 s=3 n(v0 rc2023-10-03T19:13:40.819492+0000 b3 1=1+0) (iversion lock) 0x55cf62372000] 2023-10-03T19:20:54.151 INFO:teuthology.orchestra.run.smithi045.stdout: -4864> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000411 [2,head] #10000000411 auth v4980 s=3 n(v0 rc2023-10-03T19:13:40.819492+0000 b3 1=1+0) (iversion lock) 0x55cf62372000] 2023-10-03T19:20:54.151 INFO:teuthology.orchestra.run.smithi045.stdout: -4863> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_540 [2,head] auth NULL (dversion lock) v=4980 ino=(nil) state=1073741824 0x55cf62366280] 2023-10-03T19:20:54.151 INFO:teuthology.orchestra.run.smithi045.stdout: -4862> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_539 [2,head] auth (dversion lock) v=4978 ino=0x10000000410 state=1073741824 0x55cf62366000] 2023-10-03T19:20:54.151 INFO:teuthology.orchestra.run.smithi045.stdout: -4861> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.151 INFO:teuthology.orchestra.run.smithi045.stdout: -4860> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000410 [2,head] /dc-dir/dc-file_539 auth v4978 s=3 n(v0 rc2023-10-03T19:13:40.808505+0000 b3 1=1+0) (iversion lock) 0x55cf6236f700] 2023-10-03T19:20:54.151 INFO:teuthology.orchestra.run.smithi045.stdout: -4859> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_539 [2,head] auth (dversion lock) v=4978 ino=0x10000000410 state=1073741824 0x55cf62366000] [inode 0x10000000410 [2,head] /dc-dir/dc-file_539 auth v4978 s=3 n(v0 rc2023-10-03T19:13:40.808505+0000 b3 1=1+0) (iversion lock) 0x55cf6236f700] 2023-10-03T19:20:54.151 INFO:teuthology.orchestra.run.smithi045.stdout: -4858> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000410 [2,head] #10000000410 auth v4978 s=3 n(v0 rc2023-10-03T19:13:40.808505+0000 b3 1=1+0) (iversion lock) 0x55cf6236f700] 2023-10-03T19:20:54.152 INFO:teuthology.orchestra.run.smithi045.stdout: -4857> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_539 [2,head] auth NULL (dversion lock) v=4978 ino=(nil) state=1073741824 0x55cf62366000] 2023-10-03T19:20:54.152 INFO:teuthology.orchestra.run.smithi045.stdout: -4856> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_538 [2,head] auth (dversion lock) v=4976 ino=0x1000000040f state=1073741824 0x55cf62397b80] 2023-10-03T19:20:54.152 INFO:teuthology.orchestra.run.smithi045.stdout: -4855> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.152 INFO:teuthology.orchestra.run.smithi045.stdout: -4854> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000040f [2,head] /dc-dir/dc-file_538 auth v4976 s=3 n(v0 rc2023-10-03T19:13:40.797645+0000 b3 1=1+0) (iversion lock) 0x55cf6236f180] 2023-10-03T19:20:54.159 INFO:teuthology.orchestra.run.smithi045.stdout: -4853> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_538 [2,head] auth (dversion lock) v=4976 ino=0x1000000040f state=1073741824 0x55cf62397b80] [inode 0x1000000040f [2,head] /dc-dir/dc-file_538 auth v4976 s=3 n(v0 rc2023-10-03T19:13:40.797645+0000 b3 1=1+0) (iversion lock) 0x55cf6236f180] 2023-10-03T19:20:54.160 INFO:teuthology.orchestra.run.smithi045.stdout: -4852> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000040f [2,head] #1000000040f auth v4976 s=3 n(v0 rc2023-10-03T19:13:40.797645+0000 b3 1=1+0) (iversion lock) 0x55cf6236f180] 2023-10-03T19:20:54.160 INFO:teuthology.orchestra.run.smithi045.stdout: -4851> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_538 [2,head] auth NULL (dversion lock) v=4976 ino=(nil) state=1073741824 0x55cf62397b80] 2023-10-03T19:20:54.160 INFO:teuthology.orchestra.run.smithi045.stdout: -4850> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_537 [2,head] auth (dversion lock) v=4974 ino=0x1000000040e state=1073741824 0x55cf62397900] 2023-10-03T19:20:54.160 INFO:teuthology.orchestra.run.smithi045.stdout: -4849> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.160 INFO:teuthology.orchestra.run.smithi045.stdout: -4848> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000040e [2,head] /dc-dir/dc-file_537 auth v4974 s=3 n(v0 rc2023-10-03T19:13:40.786402+0000 b3 1=1+0) (iversion lock) 0x55cf6236ec00] 2023-10-03T19:20:54.160 INFO:teuthology.orchestra.run.smithi045.stdout: -4847> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_537 [2,head] auth (dversion lock) v=4974 ino=0x1000000040e state=1073741824 0x55cf62397900] [inode 0x1000000040e [2,head] /dc-dir/dc-file_537 auth v4974 s=3 n(v0 rc2023-10-03T19:13:40.786402+0000 b3 1=1+0) (iversion lock) 0x55cf6236ec00] 2023-10-03T19:20:54.160 INFO:teuthology.orchestra.run.smithi045.stdout: -4846> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000040e [2,head] #1000000040e auth v4974 s=3 n(v0 rc2023-10-03T19:13:40.786402+0000 b3 1=1+0) (iversion lock) 0x55cf6236ec00] 2023-10-03T19:20:54.160 INFO:teuthology.orchestra.run.smithi045.stdout: -4845> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_537 [2,head] auth NULL (dversion lock) v=4974 ino=(nil) state=1073741824 0x55cf62397900] 2023-10-03T19:20:54.161 INFO:teuthology.orchestra.run.smithi045.stdout: -4844> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_536 [2,head] auth (dversion lock) v=4972 ino=0x1000000040d state=1073741824 0x55cf62397680] 2023-10-03T19:20:54.161 INFO:teuthology.orchestra.run.smithi045.stdout: -4843> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.161 INFO:teuthology.orchestra.run.smithi045.stdout: -4842> 2023-10-03T19:15:17.715+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000040d [2,head] /dc-dir/dc-file_536 auth v4972 s=3 n(v0 rc2023-10-03T19:13:40.773949+0000 b3 1=1+0) (iversion lock) 0x55cf6236e680] 2023-10-03T19:20:54.161 INFO:teuthology.orchestra.run.smithi045.stdout: -4841> 2023-10-03T19:15:17.715+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_536 [2,head] auth (dversion lock) v=4972 ino=0x1000000040d state=1073741824 0x55cf62397680] [inode 0x1000000040d [2,head] /dc-dir/dc-file_536 auth v4972 s=3 n(v0 rc2023-10-03T19:13:40.773949+0000 b3 1=1+0) (iversion lock) 0x55cf6236e680] 2023-10-03T19:20:54.161 INFO:teuthology.orchestra.run.smithi045.stdout: -4840> 2023-10-03T19:15:17.715+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000040d [2,head] #1000000040d auth v4972 s=3 n(v0 rc2023-10-03T19:13:40.773949+0000 b3 1=1+0) (iversion lock) 0x55cf6236e680] 2023-10-03T19:20:54.161 INFO:teuthology.orchestra.run.smithi045.stdout: -4839> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_536 [2,head] auth NULL (dversion lock) v=4972 ino=(nil) state=1073741824 0x55cf62397680] 2023-10-03T19:20:54.161 INFO:teuthology.orchestra.run.smithi045.stdout: -4838> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_535 [2,head] auth (dversion lock) v=4970 ino=0x1000000040c state=1073741824 0x55cf62397400] 2023-10-03T19:20:54.161 INFO:teuthology.orchestra.run.smithi045.stdout: -4837> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.161 INFO:teuthology.orchestra.run.smithi045.stdout: -4836> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000040c [2,head] /dc-dir/dc-file_535 auth v4970 s=3 n(v0 rc2023-10-03T19:13:40.761559+0000 b3 1=1+0) (iversion lock) 0x55cf6236e100] 2023-10-03T19:20:54.161 INFO:teuthology.orchestra.run.smithi045.stdout: -4835> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_535 [2,head] auth (dversion lock) v=4970 ino=0x1000000040c state=1073741824 0x55cf62397400] [inode 0x1000000040c [2,head] /dc-dir/dc-file_535 auth v4970 s=3 n(v0 rc2023-10-03T19:13:40.761559+0000 b3 1=1+0) (iversion lock) 0x55cf6236e100] 2023-10-03T19:20:54.162 INFO:teuthology.orchestra.run.smithi045.stdout: -4834> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000040c [2,head] #1000000040c auth v4970 s=3 n(v0 rc2023-10-03T19:13:40.761559+0000 b3 1=1+0) (iversion lock) 0x55cf6236e100] 2023-10-03T19:20:54.162 INFO:teuthology.orchestra.run.smithi045.stdout: -4833> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_535 [2,head] auth NULL (dversion lock) v=4970 ino=(nil) state=1073741824 0x55cf62397400] 2023-10-03T19:20:54.162 INFO:teuthology.orchestra.run.smithi045.stdout: -4832> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_534 [2,head] auth (dversion lock) v=4968 ino=0x1000000040b state=1073741824 0x55cf62397180] 2023-10-03T19:20:54.162 INFO:teuthology.orchestra.run.smithi045.stdout: -4831> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.162 INFO:teuthology.orchestra.run.smithi045.stdout: -4830> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000040b [2,head] /dc-dir/dc-file_534 auth v4968 s=3 n(v0 rc2023-10-03T19:13:40.749178+0000 b3 1=1+0) (iversion lock) 0x55cf6236db80] 2023-10-03T19:20:54.162 INFO:teuthology.orchestra.run.smithi045.stdout: -4829> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_534 [2,head] auth (dversion lock) v=4968 ino=0x1000000040b state=1073741824 0x55cf62397180] [inode 0x1000000040b [2,head] /dc-dir/dc-file_534 auth v4968 s=3 n(v0 rc2023-10-03T19:13:40.749178+0000 b3 1=1+0) (iversion lock) 0x55cf6236db80] 2023-10-03T19:20:54.162 INFO:teuthology.orchestra.run.smithi045.stdout: -4828> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000040b [2,head] #1000000040b auth v4968 s=3 n(v0 rc2023-10-03T19:13:40.749178+0000 b3 1=1+0) (iversion lock) 0x55cf6236db80] 2023-10-03T19:20:54.162 INFO:teuthology.orchestra.run.smithi045.stdout: -4827> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_534 [2,head] auth NULL (dversion lock) v=4968 ino=(nil) state=1073741824 0x55cf62397180] 2023-10-03T19:20:54.162 INFO:teuthology.orchestra.run.smithi045.stdout: -4826> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_533 [2,head] auth (dversion lock) v=4966 ino=0x1000000040a state=1073741824 0x55cf62396f00] 2023-10-03T19:20:54.162 INFO:teuthology.orchestra.run.smithi045.stdout: -4825> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.162 INFO:teuthology.orchestra.run.smithi045.stdout: -4824> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000040a [2,head] /dc-dir/dc-file_533 auth v4966 s=3 n(v0 rc2023-10-03T19:13:40.737551+0000 b3 1=1+0) (iversion lock) 0x55cf6236d600] 2023-10-03T19:20:54.163 INFO:teuthology.orchestra.run.smithi045.stdout: -4823> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_533 [2,head] auth (dversion lock) v=4966 ino=0x1000000040a state=1073741824 0x55cf62396f00] [inode 0x1000000040a [2,head] /dc-dir/dc-file_533 auth v4966 s=3 n(v0 rc2023-10-03T19:13:40.737551+0000 b3 1=1+0) (iversion lock) 0x55cf6236d600] 2023-10-03T19:20:54.163 INFO:teuthology.orchestra.run.smithi045.stdout: -4822> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000040a [2,head] #1000000040a auth v4966 s=3 n(v0 rc2023-10-03T19:13:40.737551+0000 b3 1=1+0) (iversion lock) 0x55cf6236d600] 2023-10-03T19:20:54.163 INFO:teuthology.orchestra.run.smithi045.stdout: -4821> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_533 [2,head] auth NULL (dversion lock) v=4966 ino=(nil) state=1073741824 0x55cf62396f00] 2023-10-03T19:20:54.163 INFO:teuthology.orchestra.run.smithi045.stdout: -4820> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_532 [2,head] auth (dversion lock) v=4964 ino=0x10000000409 state=1073741824 0x55cf62396c80] 2023-10-03T19:20:54.163 INFO:teuthology.orchestra.run.smithi045.stdout: -4819> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.163 INFO:teuthology.orchestra.run.smithi045.stdout: -4818> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000409 [2,head] /dc-dir/dc-file_532 auth v4964 s=3 n(v0 rc2023-10-03T19:13:40.725288+0000 b3 1=1+0) (iversion lock) 0x55cf6236d080] 2023-10-03T19:20:54.163 INFO:teuthology.orchestra.run.smithi045.stdout: -4817> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_532 [2,head] auth (dversion lock) v=4964 ino=0x10000000409 state=1073741824 0x55cf62396c80] [inode 0x10000000409 [2,head] /dc-dir/dc-file_532 auth v4964 s=3 n(v0 rc2023-10-03T19:13:40.725288+0000 b3 1=1+0) (iversion lock) 0x55cf6236d080] 2023-10-03T19:20:54.163 INFO:teuthology.orchestra.run.smithi045.stdout: -4816> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000409 [2,head] #10000000409 auth v4964 s=3 n(v0 rc2023-10-03T19:13:40.725288+0000 b3 1=1+0) (iversion lock) 0x55cf6236d080] 2023-10-03T19:20:54.163 INFO:teuthology.orchestra.run.smithi045.stdout: -4815> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_532 [2,head] auth NULL (dversion lock) v=4964 ino=(nil) state=1073741824 0x55cf62396c80] 2023-10-03T19:20:54.164 INFO:teuthology.orchestra.run.smithi045.stdout: -4814> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_531 [2,head] auth (dversion lock) v=4962 ino=0x10000000408 state=1073741824 0x55cf62396a00] 2023-10-03T19:20:54.164 INFO:teuthology.orchestra.run.smithi045.stdout: -4813> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.164 INFO:teuthology.orchestra.run.smithi045.stdout: -4812> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000408 [2,head] /dc-dir/dc-file_531 auth v4962 s=3 n(v0 rc2023-10-03T19:13:40.713332+0000 b3 1=1+0) (iversion lock) 0x55cf6236cb00] 2023-10-03T19:20:54.164 INFO:teuthology.orchestra.run.smithi045.stdout: -4811> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_531 [2,head] auth (dversion lock) v=4962 ino=0x10000000408 state=1073741824 0x55cf62396a00] [inode 0x10000000408 [2,head] /dc-dir/dc-file_531 auth v4962 s=3 n(v0 rc2023-10-03T19:13:40.713332+0000 b3 1=1+0) (iversion lock) 0x55cf6236cb00] 2023-10-03T19:20:54.164 INFO:teuthology.orchestra.run.smithi045.stdout: -4810> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000408 [2,head] #10000000408 auth v4962 s=3 n(v0 rc2023-10-03T19:13:40.713332+0000 b3 1=1+0) (iversion lock) 0x55cf6236cb00] 2023-10-03T19:20:54.164 INFO:teuthology.orchestra.run.smithi045.stdout: -4809> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_531 [2,head] auth NULL (dversion lock) v=4962 ino=(nil) state=1073741824 0x55cf62396a00] 2023-10-03T19:20:54.164 INFO:teuthology.orchestra.run.smithi045.stdout: -4808> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_530 [2,head] auth (dversion lock) v=4960 ino=0x10000000407 state=1073741824 0x55cf62396780] 2023-10-03T19:20:54.164 INFO:teuthology.orchestra.run.smithi045.stdout: -4807> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.164 INFO:teuthology.orchestra.run.smithi045.stdout: -4806> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000407 [2,head] /dc-dir/dc-file_530 auth v4960 s=3 n(v0 rc2023-10-03T19:13:40.702577+0000 b3 1=1+0) (iversion lock) 0x55cf6236c580] 2023-10-03T19:20:54.164 INFO:teuthology.orchestra.run.smithi045.stdout: -4805> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_530 [2,head] auth (dversion lock) v=4960 ino=0x10000000407 state=1073741824 0x55cf62396780] [inode 0x10000000407 [2,head] /dc-dir/dc-file_530 auth v4960 s=3 n(v0 rc2023-10-03T19:13:40.702577+0000 b3 1=1+0) (iversion lock) 0x55cf6236c580] 2023-10-03T19:20:54.164 INFO:teuthology.orchestra.run.smithi045.stdout: -4804> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000407 [2,head] #10000000407 auth v4960 s=3 n(v0 rc2023-10-03T19:13:40.702577+0000 b3 1=1+0) (iversion lock) 0x55cf6236c580] 2023-10-03T19:20:54.165 INFO:teuthology.orchestra.run.smithi045.stdout: -4803> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_530 [2,head] auth NULL (dversion lock) v=4960 ino=(nil) state=1073741824 0x55cf62396780] 2023-10-03T19:20:54.165 INFO:teuthology.orchestra.run.smithi045.stdout: -4802> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_529 [2,head] auth (dversion lock) v=4958 ino=0x10000000406 state=1073741824 0x55cf62396500] 2023-10-03T19:20:54.165 INFO:teuthology.orchestra.run.smithi045.stdout: -4801> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.165 INFO:teuthology.orchestra.run.smithi045.stdout: -4800> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000406 [2,head] /dc-dir/dc-file_529 auth v4958 s=3 n(v0 rc2023-10-03T19:13:40.691699+0000 b3 1=1+0) (iversion lock) 0x55cf6236c000] 2023-10-03T19:20:54.165 INFO:teuthology.orchestra.run.smithi045.stdout: -4799> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_529 [2,head] auth (dversion lock) v=4958 ino=0x10000000406 state=1073741824 0x55cf62396500] [inode 0x10000000406 [2,head] /dc-dir/dc-file_529 auth v4958 s=3 n(v0 rc2023-10-03T19:13:40.691699+0000 b3 1=1+0) (iversion lock) 0x55cf6236c000] 2023-10-03T19:20:54.165 INFO:teuthology.orchestra.run.smithi045.stdout: -4798> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000406 [2,head] #10000000406 auth v4958 s=3 n(v0 rc2023-10-03T19:13:40.691699+0000 b3 1=1+0) (iversion lock) 0x55cf6236c000] 2023-10-03T19:20:54.165 INFO:teuthology.orchestra.run.smithi045.stdout: -4797> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_529 [2,head] auth NULL (dversion lock) v=4958 ino=(nil) state=1073741824 0x55cf62396500] 2023-10-03T19:20:54.165 INFO:teuthology.orchestra.run.smithi045.stdout: -4796> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_528 [2,head] auth (dversion lock) v=4956 ino=0x10000000405 state=1073741824 0x55cf62396280] 2023-10-03T19:20:54.165 INFO:teuthology.orchestra.run.smithi045.stdout: -4795> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.165 INFO:teuthology.orchestra.run.smithi045.stdout: -4794> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000405 [2,head] /dc-dir/dc-file_528 auth v4956 s=3 n(v0 rc2023-10-03T19:13:40.680601+0000 b3 1=1+0) (iversion lock) 0x55cf622a7700] 2023-10-03T19:20:54.165 INFO:teuthology.orchestra.run.smithi045.stdout: -4793> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_528 [2,head] auth (dversion lock) v=4956 ino=0x10000000405 state=1073741824 0x55cf62396280] [inode 0x10000000405 [2,head] /dc-dir/dc-file_528 auth v4956 s=3 n(v0 rc2023-10-03T19:13:40.680601+0000 b3 1=1+0) (iversion lock) 0x55cf622a7700] 2023-10-03T19:20:54.166 INFO:teuthology.orchestra.run.smithi045.stdout: -4792> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000405 [2,head] #10000000405 auth v4956 s=3 n(v0 rc2023-10-03T19:13:40.680601+0000 b3 1=1+0) (iversion lock) 0x55cf622a7700] 2023-10-03T19:20:54.166 INFO:teuthology.orchestra.run.smithi045.stdout: -4791> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_528 [2,head] auth NULL (dversion lock) v=4956 ino=(nil) state=1073741824 0x55cf62396280] 2023-10-03T19:20:54.166 INFO:teuthology.orchestra.run.smithi045.stdout: -4790> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_527 [2,head] auth (dversion lock) v=4954 ino=0x10000000404 state=1073741824 0x55cf62396000] 2023-10-03T19:20:54.166 INFO:teuthology.orchestra.run.smithi045.stdout: -4789> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.166 INFO:teuthology.orchestra.run.smithi045.stdout: -4788> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000404 [2,head] /dc-dir/dc-file_527 auth v4954 s=3 n(v0 rc2023-10-03T19:13:40.669699+0000 b3 1=1+0) (iversion lock) 0x55cf622a7180] 2023-10-03T19:20:54.166 INFO:teuthology.orchestra.run.smithi045.stdout: -4787> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_527 [2,head] auth (dversion lock) v=4954 ino=0x10000000404 state=1073741824 0x55cf62396000] [inode 0x10000000404 [2,head] /dc-dir/dc-file_527 auth v4954 s=3 n(v0 rc2023-10-03T19:13:40.669699+0000 b3 1=1+0) (iversion lock) 0x55cf622a7180] 2023-10-03T19:20:54.166 INFO:teuthology.orchestra.run.smithi045.stdout: -4786> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000404 [2,head] #10000000404 auth v4954 s=3 n(v0 rc2023-10-03T19:13:40.669699+0000 b3 1=1+0) (iversion lock) 0x55cf622a7180] 2023-10-03T19:20:54.166 INFO:teuthology.orchestra.run.smithi045.stdout: -4785> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_527 [2,head] auth NULL (dversion lock) v=4954 ino=(nil) state=1073741824 0x55cf62396000] 2023-10-03T19:20:54.166 INFO:teuthology.orchestra.run.smithi045.stdout: -4784> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_526 [2,head] auth (dversion lock) v=4952 ino=0x10000000403 state=1073741824 0x55cf622a3b80] 2023-10-03T19:20:54.166 INFO:teuthology.orchestra.run.smithi045.stdout: -4783> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.167 INFO:teuthology.orchestra.run.smithi045.stdout: -4782> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000403 [2,head] /dc-dir/dc-file_526 auth v4952 s=3 n(v0 rc2023-10-03T19:13:40.657316+0000 b3 1=1+0) (iversion lock) 0x55cf622a6c00] 2023-10-03T19:20:54.167 INFO:teuthology.orchestra.run.smithi045.stdout: -4781> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_526 [2,head] auth (dversion lock) v=4952 ino=0x10000000403 state=1073741824 0x55cf622a3b80] [inode 0x10000000403 [2,head] /dc-dir/dc-file_526 auth v4952 s=3 n(v0 rc2023-10-03T19:13:40.657316+0000 b3 1=1+0) (iversion lock) 0x55cf622a6c00] 2023-10-03T19:20:54.167 INFO:teuthology.orchestra.run.smithi045.stdout: -4780> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000403 [2,head] #10000000403 auth v4952 s=3 n(v0 rc2023-10-03T19:13:40.657316+0000 b3 1=1+0) (iversion lock) 0x55cf622a6c00] 2023-10-03T19:20:54.167 INFO:teuthology.orchestra.run.smithi045.stdout: -4779> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_526 [2,head] auth NULL (dversion lock) v=4952 ino=(nil) state=1073741824 0x55cf622a3b80] 2023-10-03T19:20:54.167 INFO:teuthology.orchestra.run.smithi045.stdout: -4778> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_525 [2,head] auth (dversion lock) v=4950 ino=0x10000000402 state=1073741824 0x55cf622a3900] 2023-10-03T19:20:54.167 INFO:teuthology.orchestra.run.smithi045.stdout: -4777> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.167 INFO:teuthology.orchestra.run.smithi045.stdout: -4776> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000402 [2,head] /dc-dir/dc-file_525 auth v4950 s=3 n(v0 rc2023-10-03T19:13:40.645411+0000 b3 1=1+0) (iversion lock) 0x55cf622a6680] 2023-10-03T19:20:54.167 INFO:teuthology.orchestra.run.smithi045.stdout: -4775> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_525 [2,head] auth (dversion lock) v=4950 ino=0x10000000402 state=1073741824 0x55cf622a3900] [inode 0x10000000402 [2,head] /dc-dir/dc-file_525 auth v4950 s=3 n(v0 rc2023-10-03T19:13:40.645411+0000 b3 1=1+0) (iversion lock) 0x55cf622a6680] 2023-10-03T19:20:54.167 INFO:teuthology.orchestra.run.smithi045.stdout: -4774> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000402 [2,head] #10000000402 auth v4950 s=3 n(v0 rc2023-10-03T19:13:40.645411+0000 b3 1=1+0) (iversion lock) 0x55cf622a6680] 2023-10-03T19:20:54.167 INFO:teuthology.orchestra.run.smithi045.stdout: -4773> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_525 [2,head] auth NULL (dversion lock) v=4950 ino=(nil) state=1073741824 0x55cf622a3900] 2023-10-03T19:20:54.167 INFO:teuthology.orchestra.run.smithi045.stdout: -4772> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_524 [2,head] auth (dversion lock) v=4948 ino=0x10000000401 state=1073741824 0x55cf622a3680] 2023-10-03T19:20:54.168 INFO:teuthology.orchestra.run.smithi045.stdout: -4771> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.168 INFO:teuthology.orchestra.run.smithi045.stdout: -4770> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000401 [2,head] /dc-dir/dc-file_524 auth v4948 s=3 n(v0 rc2023-10-03T19:13:40.633600+0000 b3 1=1+0) (iversion lock) 0x55cf622a6100] 2023-10-03T19:20:54.168 INFO:teuthology.orchestra.run.smithi045.stdout: -4769> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_524 [2,head] auth (dversion lock) v=4948 ino=0x10000000401 state=1073741824 0x55cf622a3680] [inode 0x10000000401 [2,head] /dc-dir/dc-file_524 auth v4948 s=3 n(v0 rc2023-10-03T19:13:40.633600+0000 b3 1=1+0) (iversion lock) 0x55cf622a6100] 2023-10-03T19:20:54.168 INFO:teuthology.orchestra.run.smithi045.stdout: -4768> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000401 [2,head] #10000000401 auth v4948 s=3 n(v0 rc2023-10-03T19:13:40.633600+0000 b3 1=1+0) (iversion lock) 0x55cf622a6100] 2023-10-03T19:20:54.168 INFO:teuthology.orchestra.run.smithi045.stdout: -4767> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_524 [2,head] auth NULL (dversion lock) v=4948 ino=(nil) state=1073741824 0x55cf622a3680] 2023-10-03T19:20:54.168 INFO:teuthology.orchestra.run.smithi045.stdout: -4766> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_523 [2,head] auth (dversion lock) v=4946 ino=0x10000000400 state=1073741824 0x55cf622a3400] 2023-10-03T19:20:54.168 INFO:teuthology.orchestra.run.smithi045.stdout: -4765> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.168 INFO:teuthology.orchestra.run.smithi045.stdout: -4764> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000400 [2,head] /dc-dir/dc-file_523 auth v4946 s=3 n(v0 rc2023-10-03T19:13:40.622812+0000 b3 1=1+0) (iversion lock) 0x55cf622a5b80] 2023-10-03T19:20:54.168 INFO:teuthology.orchestra.run.smithi045.stdout: -4763> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_523 [2,head] auth (dversion lock) v=4946 ino=0x10000000400 state=1073741824 0x55cf622a3400] [inode 0x10000000400 [2,head] /dc-dir/dc-file_523 auth v4946 s=3 n(v0 rc2023-10-03T19:13:40.622812+0000 b3 1=1+0) (iversion lock) 0x55cf622a5b80] 2023-10-03T19:20:54.168 INFO:teuthology.orchestra.run.smithi045.stdout: -4762> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000400 [2,head] #10000000400 auth v4946 s=3 n(v0 rc2023-10-03T19:13:40.622812+0000 b3 1=1+0) (iversion lock) 0x55cf622a5b80] 2023-10-03T19:20:54.168 INFO:teuthology.orchestra.run.smithi045.stdout: -4761> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_523 [2,head] auth NULL (dversion lock) v=4946 ino=(nil) state=1073741824 0x55cf622a3400] 2023-10-03T19:20:54.169 INFO:teuthology.orchestra.run.smithi045.stdout: -4760> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_522 [2,head] auth (dversion lock) v=4944 ino=0x100000003ff state=1073741824 0x55cf622a3180] 2023-10-03T19:20:54.169 INFO:teuthology.orchestra.run.smithi045.stdout: -4759> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.169 INFO:teuthology.orchestra.run.smithi045.stdout: -4758> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003ff [2,head] /dc-dir/dc-file_522 auth v4944 s=3 n(v0 rc2023-10-03T19:13:40.575231+0000 b3 1=1+0) (iversion lock) 0x55cf622a5600] 2023-10-03T19:20:54.169 INFO:teuthology.orchestra.run.smithi045.stdout: -4757> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_522 [2,head] auth (dversion lock) v=4944 ino=0x100000003ff state=1073741824 0x55cf622a3180] [inode 0x100000003ff [2,head] /dc-dir/dc-file_522 auth v4944 s=3 n(v0 rc2023-10-03T19:13:40.575231+0000 b3 1=1+0) (iversion lock) 0x55cf622a5600] 2023-10-03T19:20:54.169 INFO:teuthology.orchestra.run.smithi045.stdout: -4756> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003ff [2,head] #100000003ff auth v4944 s=3 n(v0 rc2023-10-03T19:13:40.575231+0000 b3 1=1+0) (iversion lock) 0x55cf622a5600] 2023-10-03T19:20:54.169 INFO:teuthology.orchestra.run.smithi045.stdout: -4755> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_522 [2,head] auth NULL (dversion lock) v=4944 ino=(nil) state=1073741824 0x55cf622a3180] 2023-10-03T19:20:54.169 INFO:teuthology.orchestra.run.smithi045.stdout: -4754> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_521 [2,head] auth (dversion lock) v=4648 ino=0x100000003fe state=1073741824 0x55cf622a2f00] 2023-10-03T19:20:54.169 INFO:teuthology.orchestra.run.smithi045.stdout: -4753> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.169 INFO:teuthology.orchestra.run.smithi045.stdout: -4752> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003fe [2,head] /dc-dir/dc-file_521 auth v4648 s=3 n(v0 rc2023-10-03T19:13:40.480302+0000 b3 1=1+0) (iversion lock) 0x55cf622a5080] 2023-10-03T19:20:54.169 INFO:teuthology.orchestra.run.smithi045.stdout: -4751> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_521 [2,head] auth (dversion lock) v=4648 ino=0x100000003fe state=1073741824 0x55cf622a2f00] [inode 0x100000003fe [2,head] /dc-dir/dc-file_521 auth v4648 s=3 n(v0 rc2023-10-03T19:13:40.480302+0000 b3 1=1+0) (iversion lock) 0x55cf622a5080] 2023-10-03T19:20:54.170 INFO:teuthology.orchestra.run.smithi045.stdout: -4750> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003fe [2,head] #100000003fe auth v4648 s=3 n(v0 rc2023-10-03T19:13:40.480302+0000 b3 1=1+0) (iversion lock) 0x55cf622a5080] 2023-10-03T19:20:54.170 INFO:teuthology.orchestra.run.smithi045.stdout: -4749> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_521 [2,head] auth NULL (dversion lock) v=4648 ino=(nil) state=1073741824 0x55cf622a2f00] 2023-10-03T19:20:54.170 INFO:teuthology.orchestra.run.smithi045.stdout: -4748> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_520 [2,head] auth (dversion lock) v=4646 ino=0x100000003fd state=1073741824 0x55cf622a2c80] 2023-10-03T19:20:54.170 INFO:teuthology.orchestra.run.smithi045.stdout: -4747> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.170 INFO:teuthology.orchestra.run.smithi045.stdout: -4746> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003fd [2,head] /dc-dir/dc-file_520 auth v4646 s=3 n(v0 rc2023-10-03T19:13:40.468906+0000 b3 1=1+0) (iversion lock) 0x55cf622a4b00] 2023-10-03T19:20:54.170 INFO:teuthology.orchestra.run.smithi045.stdout: -4745> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_520 [2,head] auth (dversion lock) v=4646 ino=0x100000003fd state=1073741824 0x55cf622a2c80] [inode 0x100000003fd [2,head] /dc-dir/dc-file_520 auth v4646 s=3 n(v0 rc2023-10-03T19:13:40.468906+0000 b3 1=1+0) (iversion lock) 0x55cf622a4b00] 2023-10-03T19:20:54.170 INFO:teuthology.orchestra.run.smithi045.stdout: -4744> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003fd [2,head] #100000003fd auth v4646 s=3 n(v0 rc2023-10-03T19:13:40.468906+0000 b3 1=1+0) (iversion lock) 0x55cf622a4b00] 2023-10-03T19:20:54.170 INFO:teuthology.orchestra.run.smithi045.stdout: -4743> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_520 [2,head] auth NULL (dversion lock) v=4646 ino=(nil) state=1073741824 0x55cf622a2c80] 2023-10-03T19:20:54.170 INFO:teuthology.orchestra.run.smithi045.stdout: -4742> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_519 [2,head] auth (dversion lock) v=4644 ino=0x100000003fc state=1073741824 0x55cf622a2a00] 2023-10-03T19:20:54.170 INFO:teuthology.orchestra.run.smithi045.stdout: -4741> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.170 INFO:teuthology.orchestra.run.smithi045.stdout: -4740> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003fc [2,head] /dc-dir/dc-file_519 auth v4644 s=3 n(v0 rc2023-10-03T19:13:40.457848+0000 b3 1=1+0) (iversion lock) 0x55cf622a4580] 2023-10-03T19:20:54.171 INFO:teuthology.orchestra.run.smithi045.stdout: -4739> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_519 [2,head] auth (dversion lock) v=4644 ino=0x100000003fc state=1073741824 0x55cf622a2a00] [inode 0x100000003fc [2,head] /dc-dir/dc-file_519 auth v4644 s=3 n(v0 rc2023-10-03T19:13:40.457848+0000 b3 1=1+0) (iversion lock) 0x55cf622a4580] 2023-10-03T19:20:54.171 INFO:teuthology.orchestra.run.smithi045.stdout: -4738> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003fc [2,head] #100000003fc auth v4644 s=3 n(v0 rc2023-10-03T19:13:40.457848+0000 b3 1=1+0) (iversion lock) 0x55cf622a4580] 2023-10-03T19:20:54.171 INFO:teuthology.orchestra.run.smithi045.stdout: -4737> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_519 [2,head] auth NULL (dversion lock) v=4644 ino=(nil) state=1073741824 0x55cf622a2a00] 2023-10-03T19:20:54.171 INFO:teuthology.orchestra.run.smithi045.stdout: -4736> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_518 [2,head] auth (dversion lock) v=4642 ino=0x100000003fb state=1073741824 0x55cf622a2780] 2023-10-03T19:20:54.171 INFO:teuthology.orchestra.run.smithi045.stdout: -4735> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.171 INFO:teuthology.orchestra.run.smithi045.stdout: -4734> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003fb [2,head] /dc-dir/dc-file_518 auth v4642 s=3 n(v0 rc2023-10-03T19:13:40.445979+0000 b3 1=1+0) (iversion lock) 0x55cf622a4000] 2023-10-03T19:20:54.171 INFO:teuthology.orchestra.run.smithi045.stdout: -4733> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_518 [2,head] auth (dversion lock) v=4642 ino=0x100000003fb state=1073741824 0x55cf622a2780] [inode 0x100000003fb [2,head] /dc-dir/dc-file_518 auth v4642 s=3 n(v0 rc2023-10-03T19:13:40.445979+0000 b3 1=1+0) (iversion lock) 0x55cf622a4000] 2023-10-03T19:20:54.171 INFO:teuthology.orchestra.run.smithi045.stdout: -4732> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003fb [2,head] #100000003fb auth v4642 s=3 n(v0 rc2023-10-03T19:13:40.445979+0000 b3 1=1+0) (iversion lock) 0x55cf622a4000] 2023-10-03T19:20:54.171 INFO:teuthology.orchestra.run.smithi045.stdout: -4731> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_518 [2,head] auth NULL (dversion lock) v=4642 ino=(nil) state=1073741824 0x55cf622a2780] 2023-10-03T19:20:54.171 INFO:teuthology.orchestra.run.smithi045.stdout: -4730> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_517 [2,head] auth (dversion lock) v=4640 ino=0x100000003fa state=1073741824 0x55cf622a2500] 2023-10-03T19:20:54.172 INFO:teuthology.orchestra.run.smithi045.stdout: -4729> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.172 INFO:teuthology.orchestra.run.smithi045.stdout: -4728> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003fa [2,head] /dc-dir/dc-file_517 auth v4640 s=3 n(v0 rc2023-10-03T19:13:40.434674+0000 b3 1=1+0) (iversion lock) 0x55cf62299700] 2023-10-03T19:20:54.172 INFO:teuthology.orchestra.run.smithi045.stdout: -4727> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_517 [2,head] auth (dversion lock) v=4640 ino=0x100000003fa state=1073741824 0x55cf622a2500] [inode 0x100000003fa [2,head] /dc-dir/dc-file_517 auth v4640 s=3 n(v0 rc2023-10-03T19:13:40.434674+0000 b3 1=1+0) (iversion lock) 0x55cf62299700] 2023-10-03T19:20:54.172 INFO:teuthology.orchestra.run.smithi045.stdout: -4726> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003fa [2,head] #100000003fa auth v4640 s=3 n(v0 rc2023-10-03T19:13:40.434674+0000 b3 1=1+0) (iversion lock) 0x55cf62299700] 2023-10-03T19:20:54.210 INFO:teuthology.orchestra.run.smithi045.stdout: -4725> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_517 [2,head] auth NULL (dversion lock) v=4640 ino=(nil) state=1073741824 0x55cf622a2500] 2023-10-03T19:20:54.210 INFO:teuthology.orchestra.run.smithi045.stdout: -4724> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_516 [2,head] auth (dversion lock) v=4638 ino=0x100000003f9 state=1073741824 0x55cf622a2280] 2023-10-03T19:20:54.210 INFO:teuthology.orchestra.run.smithi045.stdout: -4723> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.210 INFO:teuthology.orchestra.run.smithi045.stdout: -4722> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003f9 [2,head] /dc-dir/dc-file_516 auth v4638 s=3 n(v0 rc2023-10-03T19:13:40.422617+0000 b3 1=1+0) (iversion lock) 0x55cf62299180] 2023-10-03T19:20:54.211 INFO:teuthology.orchestra.run.smithi045.stdout: -4721> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_516 [2,head] auth (dversion lock) v=4638 ino=0x100000003f9 state=1073741824 0x55cf622a2280] [inode 0x100000003f9 [2,head] /dc-dir/dc-file_516 auth v4638 s=3 n(v0 rc2023-10-03T19:13:40.422617+0000 b3 1=1+0) (iversion lock) 0x55cf62299180] 2023-10-03T19:20:54.211 INFO:teuthology.orchestra.run.smithi045.stdout: -4720> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003f9 [2,head] #100000003f9 auth v4638 s=3 n(v0 rc2023-10-03T19:13:40.422617+0000 b3 1=1+0) (iversion lock) 0x55cf62299180] 2023-10-03T19:20:54.211 INFO:teuthology.orchestra.run.smithi045.stdout: -4719> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_516 [2,head] auth NULL (dversion lock) v=4638 ino=(nil) state=1073741824 0x55cf622a2280] 2023-10-03T19:20:54.211 INFO:teuthology.orchestra.run.smithi045.stdout: -4718> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_515 [2,head] auth (dversion lock) v=4636 ino=0x100000003f8 state=1073741824 0x55cf622a2000] 2023-10-03T19:20:54.211 INFO:teuthology.orchestra.run.smithi045.stdout: -4717> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.211 INFO:teuthology.orchestra.run.smithi045.stdout: -4716> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003f8 [2,head] /dc-dir/dc-file_515 auth v4636 s=3 n(v0 rc2023-10-03T19:13:40.411664+0000 b3 1=1+0) (iversion lock) 0x55cf62298c00] 2023-10-03T19:20:54.211 INFO:teuthology.orchestra.run.smithi045.stdout: -4715> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_515 [2,head] auth (dversion lock) v=4636 ino=0x100000003f8 state=1073741824 0x55cf622a2000] [inode 0x100000003f8 [2,head] /dc-dir/dc-file_515 auth v4636 s=3 n(v0 rc2023-10-03T19:13:40.411664+0000 b3 1=1+0) (iversion lock) 0x55cf62298c00] 2023-10-03T19:20:54.211 INFO:teuthology.orchestra.run.smithi045.stdout: -4714> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003f8 [2,head] #100000003f8 auth v4636 s=3 n(v0 rc2023-10-03T19:13:40.411664+0000 b3 1=1+0) (iversion lock) 0x55cf62298c00] 2023-10-03T19:20:54.211 INFO:teuthology.orchestra.run.smithi045.stdout: -4713> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_515 [2,head] auth NULL (dversion lock) v=4636 ino=(nil) state=1073741824 0x55cf622a2000] 2023-10-03T19:20:54.211 INFO:teuthology.orchestra.run.smithi045.stdout: -4712> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_514 [2,head] auth (dversion lock) v=4634 ino=0x100000003f7 state=1073741824 0x55cf62291b80] 2023-10-03T19:20:54.211 INFO:teuthology.orchestra.run.smithi045.stdout: -4711> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.212 INFO:teuthology.orchestra.run.smithi045.stdout: -4710> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003f7 [2,head] /dc-dir/dc-file_514 auth v4634 s=3 n(v0 rc2023-10-03T19:13:40.399302+0000 b3 1=1+0) (iversion lock) 0x55cf62298680] 2023-10-03T19:20:54.212 INFO:teuthology.orchestra.run.smithi045.stdout: -4709> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_514 [2,head] auth (dversion lock) v=4634 ino=0x100000003f7 state=1073741824 0x55cf62291b80] [inode 0x100000003f7 [2,head] /dc-dir/dc-file_514 auth v4634 s=3 n(v0 rc2023-10-03T19:13:40.399302+0000 b3 1=1+0) (iversion lock) 0x55cf62298680] 2023-10-03T19:20:54.212 INFO:teuthology.orchestra.run.smithi045.stdout: -4708> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003f7 [2,head] #100000003f7 auth v4634 s=3 n(v0 rc2023-10-03T19:13:40.399302+0000 b3 1=1+0) (iversion lock) 0x55cf62298680] 2023-10-03T19:20:54.212 INFO:teuthology.orchestra.run.smithi045.stdout: -4707> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_514 [2,head] auth NULL (dversion lock) v=4634 ino=(nil) state=1073741824 0x55cf62291b80] 2023-10-03T19:20:54.212 INFO:teuthology.orchestra.run.smithi045.stdout: -4706> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_513 [2,head] auth (dversion lock) v=4632 ino=0x100000003f6 state=1073741824 0x55cf62291900] 2023-10-03T19:20:54.212 INFO:teuthology.orchestra.run.smithi045.stdout: -4705> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.212 INFO:teuthology.orchestra.run.smithi045.stdout: -4704> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003f6 [2,head] /dc-dir/dc-file_513 auth v4632 s=3 n(v0 rc2023-10-03T19:13:40.388228+0000 b3 1=1+0) (iversion lock) 0x55cf62298100] 2023-10-03T19:20:54.212 INFO:teuthology.orchestra.run.smithi045.stdout: -4703> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_513 [2,head] auth (dversion lock) v=4632 ino=0x100000003f6 state=1073741824 0x55cf62291900] [inode 0x100000003f6 [2,head] /dc-dir/dc-file_513 auth v4632 s=3 n(v0 rc2023-10-03T19:13:40.388228+0000 b3 1=1+0) (iversion lock) 0x55cf62298100] 2023-10-03T19:20:54.212 INFO:teuthology.orchestra.run.smithi045.stdout: -4702> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003f6 [2,head] #100000003f6 auth v4632 s=3 n(v0 rc2023-10-03T19:13:40.388228+0000 b3 1=1+0) (iversion lock) 0x55cf62298100] 2023-10-03T19:20:54.212 INFO:teuthology.orchestra.run.smithi045.stdout: -4701> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_513 [2,head] auth NULL (dversion lock) v=4632 ino=(nil) state=1073741824 0x55cf62291900] 2023-10-03T19:20:54.212 INFO:teuthology.orchestra.run.smithi045.stdout: -4700> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_512 [2,head] auth (dversion lock) v=4630 ino=0x100000003f5 state=1073741824 0x55cf62291680] 2023-10-03T19:20:54.212 INFO:teuthology.orchestra.run.smithi045.stdout: -4699> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.213 INFO:teuthology.orchestra.run.smithi045.stdout: -4698> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003f5 [2,head] /dc-dir/dc-file_512 auth v4630 s=3 n(v0 rc2023-10-03T19:13:40.377284+0000 b3 1=1+0) (iversion lock) 0x55cf62297b80] 2023-10-03T19:20:54.213 INFO:teuthology.orchestra.run.smithi045.stdout: -4697> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_512 [2,head] auth (dversion lock) v=4630 ino=0x100000003f5 state=1073741824 0x55cf62291680] [inode 0x100000003f5 [2,head] /dc-dir/dc-file_512 auth v4630 s=3 n(v0 rc2023-10-03T19:13:40.377284+0000 b3 1=1+0) (iversion lock) 0x55cf62297b80] 2023-10-03T19:20:54.213 INFO:teuthology.orchestra.run.smithi045.stdout: -4696> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003f5 [2,head] #100000003f5 auth v4630 s=3 n(v0 rc2023-10-03T19:13:40.377284+0000 b3 1=1+0) (iversion lock) 0x55cf62297b80] 2023-10-03T19:20:54.213 INFO:teuthology.orchestra.run.smithi045.stdout: -4695> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_512 [2,head] auth NULL (dversion lock) v=4630 ino=(nil) state=1073741824 0x55cf62291680] 2023-10-03T19:20:54.213 INFO:teuthology.orchestra.run.smithi045.stdout: -4694> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_511 [2,head] auth (dversion lock) v=4628 ino=0x100000003f4 state=1073741824 0x55cf62291400] 2023-10-03T19:20:54.213 INFO:teuthology.orchestra.run.smithi045.stdout: -4693> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.213 INFO:teuthology.orchestra.run.smithi045.stdout: -4692> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003f4 [2,head] /dc-dir/dc-file_511 auth v4628 s=3 n(v0 rc2023-10-03T19:13:40.366704+0000 b3 1=1+0) (iversion lock) 0x55cf62297600] 2023-10-03T19:20:54.213 INFO:teuthology.orchestra.run.smithi045.stdout: -4691> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_511 [2,head] auth (dversion lock) v=4628 ino=0x100000003f4 state=1073741824 0x55cf62291400] [inode 0x100000003f4 [2,head] /dc-dir/dc-file_511 auth v4628 s=3 n(v0 rc2023-10-03T19:13:40.366704+0000 b3 1=1+0) (iversion lock) 0x55cf62297600] 2023-10-03T19:20:54.213 INFO:teuthology.orchestra.run.smithi045.stdout: -4690> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003f4 [2,head] #100000003f4 auth v4628 s=3 n(v0 rc2023-10-03T19:13:40.366704+0000 b3 1=1+0) (iversion lock) 0x55cf62297600] 2023-10-03T19:20:54.213 INFO:teuthology.orchestra.run.smithi045.stdout: -4689> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_511 [2,head] auth NULL (dversion lock) v=4628 ino=(nil) state=1073741824 0x55cf62291400] 2023-10-03T19:20:54.214 INFO:teuthology.orchestra.run.smithi045.stdout: -4688> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_510 [2,head] auth (dversion lock) v=4626 ino=0x100000003f3 state=1073741824 0x55cf62291180] 2023-10-03T19:20:54.214 INFO:teuthology.orchestra.run.smithi045.stdout: -4687> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.214 INFO:teuthology.orchestra.run.smithi045.stdout: -4686> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003f3 [2,head] /dc-dir/dc-file_510 auth v4626 s=3 n(v0 rc2023-10-03T19:13:40.355951+0000 b3 1=1+0) (iversion lock) 0x55cf62297080] 2023-10-03T19:20:54.214 INFO:teuthology.orchestra.run.smithi045.stdout: -4685> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_510 [2,head] auth (dversion lock) v=4626 ino=0x100000003f3 state=1073741824 0x55cf62291180] [inode 0x100000003f3 [2,head] /dc-dir/dc-file_510 auth v4626 s=3 n(v0 rc2023-10-03T19:13:40.355951+0000 b3 1=1+0) (iversion lock) 0x55cf62297080] 2023-10-03T19:20:54.214 INFO:teuthology.orchestra.run.smithi045.stdout: -4684> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003f3 [2,head] #100000003f3 auth v4626 s=3 n(v0 rc2023-10-03T19:13:40.355951+0000 b3 1=1+0) (iversion lock) 0x55cf62297080] 2023-10-03T19:20:54.214 INFO:teuthology.orchestra.run.smithi045.stdout: -4683> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_510 [2,head] auth NULL (dversion lock) v=4626 ino=(nil) state=1073741824 0x55cf62291180] 2023-10-03T19:20:54.214 INFO:teuthology.orchestra.run.smithi045.stdout: -4682> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_509 [2,head] auth (dversion lock) v=4624 ino=0x100000003f2 state=1073741824 0x55cf62290f00] 2023-10-03T19:20:54.214 INFO:teuthology.orchestra.run.smithi045.stdout: -4681> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.214 INFO:teuthology.orchestra.run.smithi045.stdout: -4680> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003f2 [2,head] /dc-dir/dc-file_509 auth v4624 s=3 n(v0 rc2023-10-03T19:13:40.344517+0000 b3 1=1+0) (iversion lock) 0x55cf62296b00] 2023-10-03T19:20:54.214 INFO:teuthology.orchestra.run.smithi045.stdout: -4679> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_509 [2,head] auth (dversion lock) v=4624 ino=0x100000003f2 state=1073741824 0x55cf62290f00] [inode 0x100000003f2 [2,head] /dc-dir/dc-file_509 auth v4624 s=3 n(v0 rc2023-10-03T19:13:40.344517+0000 b3 1=1+0) (iversion lock) 0x55cf62296b00] 2023-10-03T19:20:54.214 INFO:teuthology.orchestra.run.smithi045.stdout: -4678> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003f2 [2,head] #100000003f2 auth v4624 s=3 n(v0 rc2023-10-03T19:13:40.344517+0000 b3 1=1+0) (iversion lock) 0x55cf62296b00] 2023-10-03T19:20:54.215 INFO:teuthology.orchestra.run.smithi045.stdout: -4677> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_509 [2,head] auth NULL (dversion lock) v=4624 ino=(nil) state=1073741824 0x55cf62290f00] 2023-10-03T19:20:54.215 INFO:teuthology.orchestra.run.smithi045.stdout: -4676> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_508 [2,head] auth (dversion lock) v=4622 ino=0x100000003f1 state=1073741824 0x55cf62290c80] 2023-10-03T19:20:54.215 INFO:teuthology.orchestra.run.smithi045.stdout: -4675> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.215 INFO:teuthology.orchestra.run.smithi045.stdout: -4674> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003f1 [2,head] /dc-dir/dc-file_508 auth v4622 s=3 n(v0 rc2023-10-03T19:13:40.333797+0000 b3 1=1+0) (iversion lock) 0x55cf62296580] 2023-10-03T19:20:54.215 INFO:teuthology.orchestra.run.smithi045.stdout: -4673> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_508 [2,head] auth (dversion lock) v=4622 ino=0x100000003f1 state=1073741824 0x55cf62290c80] [inode 0x100000003f1 [2,head] /dc-dir/dc-file_508 auth v4622 s=3 n(v0 rc2023-10-03T19:13:40.333797+0000 b3 1=1+0) (iversion lock) 0x55cf62296580] 2023-10-03T19:20:54.215 INFO:teuthology.orchestra.run.smithi045.stdout: -4672> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003f1 [2,head] #100000003f1 auth v4622 s=3 n(v0 rc2023-10-03T19:13:40.333797+0000 b3 1=1+0) (iversion lock) 0x55cf62296580] 2023-10-03T19:20:54.215 INFO:teuthology.orchestra.run.smithi045.stdout: -4671> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_508 [2,head] auth NULL (dversion lock) v=4622 ino=(nil) state=1073741824 0x55cf62290c80] 2023-10-03T19:20:54.215 INFO:teuthology.orchestra.run.smithi045.stdout: -4670> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_507 [2,head] auth (dversion lock) v=4620 ino=0x100000003f0 state=1073741824 0x55cf62290a00] 2023-10-03T19:20:54.215 INFO:teuthology.orchestra.run.smithi045.stdout: -4669> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.215 INFO:teuthology.orchestra.run.smithi045.stdout: -4668> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003f0 [2,head] /dc-dir/dc-file_507 auth v4620 s=3 n(v0 rc2023-10-03T19:13:40.322045+0000 b3 1=1+0) (iversion lock) 0x55cf62296000] 2023-10-03T19:20:54.215 INFO:teuthology.orchestra.run.smithi045.stdout: -4667> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_507 [2,head] auth (dversion lock) v=4620 ino=0x100000003f0 state=1073741824 0x55cf62290a00] [inode 0x100000003f0 [2,head] /dc-dir/dc-file_507 auth v4620 s=3 n(v0 rc2023-10-03T19:13:40.322045+0000 b3 1=1+0) (iversion lock) 0x55cf62296000] 2023-10-03T19:20:54.215 INFO:teuthology.orchestra.run.smithi045.stdout: -4666> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003f0 [2,head] #100000003f0 auth v4620 s=3 n(v0 rc2023-10-03T19:13:40.322045+0000 b3 1=1+0) (iversion lock) 0x55cf62296000] 2023-10-03T19:20:54.216 INFO:teuthology.orchestra.run.smithi045.stdout: -4665> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_507 [2,head] auth NULL (dversion lock) v=4620 ino=(nil) state=1073741824 0x55cf62290a00] 2023-10-03T19:20:54.216 INFO:teuthology.orchestra.run.smithi045.stdout: -4664> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_506 [2,head] auth (dversion lock) v=4618 ino=0x100000003ef state=1073741824 0x55cf62290780] 2023-10-03T19:20:54.304 INFO:teuthology.orchestra.run.smithi045.stdout: -4663> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.304 INFO:teuthology.orchestra.run.smithi045.stdout: -4662> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003ef [2,head] /dc-dir/dc-file_506 auth v4618 s=3 n(v0 rc2023-10-03T19:13:40.309477+0000 b3 1=1+0) (iversion lock) 0x55cf6228b700] 2023-10-03T19:20:54.305 INFO:teuthology.orchestra.run.smithi045.stdout: -4661> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_506 [2,head] auth (dversion lock) v=4618 ino=0x100000003ef state=1073741824 0x55cf62290780] [inode 0x100000003ef [2,head] /dc-dir/dc-file_506 auth v4618 s=3 n(v0 rc2023-10-03T19:13:40.309477+0000 b3 1=1+0) (iversion lock) 0x55cf6228b700] 2023-10-03T19:20:54.305 INFO:teuthology.orchestra.run.smithi045.stdout: -4660> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003ef [2,head] #100000003ef auth v4618 s=3 n(v0 rc2023-10-03T19:13:40.309477+0000 b3 1=1+0) (iversion lock) 0x55cf6228b700] 2023-10-03T19:20:54.305 INFO:teuthology.orchestra.run.smithi045.stdout: -4659> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_506 [2,head] auth NULL (dversion lock) v=4618 ino=(nil) state=1073741824 0x55cf62290780] 2023-10-03T19:20:54.305 INFO:teuthology.orchestra.run.smithi045.stdout: -4658> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_505 [2,head] auth (dversion lock) v=4616 ino=0x100000003ee state=1073741824 0x55cf62290500] 2023-10-03T19:20:54.305 INFO:teuthology.orchestra.run.smithi045.stdout: -4657> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.305 INFO:teuthology.orchestra.run.smithi045.stdout: -4656> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003ee [2,head] /dc-dir/dc-file_505 auth v4616 s=3 n(v0 rc2023-10-03T19:13:40.297375+0000 b3 1=1+0) (iversion lock) 0x55cf6228b180] 2023-10-03T19:20:54.305 INFO:teuthology.orchestra.run.smithi045.stdout: -4655> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_505 [2,head] auth (dversion lock) v=4616 ino=0x100000003ee state=1073741824 0x55cf62290500] [inode 0x100000003ee [2,head] /dc-dir/dc-file_505 auth v4616 s=3 n(v0 rc2023-10-03T19:13:40.297375+0000 b3 1=1+0) (iversion lock) 0x55cf6228b180] 2023-10-03T19:20:54.305 INFO:teuthology.orchestra.run.smithi045.stdout: -4654> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003ee [2,head] #100000003ee auth v4616 s=3 n(v0 rc2023-10-03T19:13:40.297375+0000 b3 1=1+0) (iversion lock) 0x55cf6228b180] 2023-10-03T19:20:54.305 INFO:teuthology.orchestra.run.smithi045.stdout: -4653> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_505 [2,head] auth NULL (dversion lock) v=4616 ino=(nil) state=1073741824 0x55cf62290500] 2023-10-03T19:20:54.305 INFO:teuthology.orchestra.run.smithi045.stdout: -4652> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_504 [2,head] auth (dversion lock) v=4614 ino=0x100000003ed state=1073741824 0x55cf62290280] 2023-10-03T19:20:54.305 INFO:teuthology.orchestra.run.smithi045.stdout: -4651> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.306 INFO:teuthology.orchestra.run.smithi045.stdout: -4650> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003ed [2,head] /dc-dir/dc-file_504 auth v4614 s=3 n(v0 rc2023-10-03T19:13:40.285195+0000 b3 1=1+0) (iversion lock) 0x55cf6228ac00] 2023-10-03T19:20:54.306 INFO:teuthology.orchestra.run.smithi045.stdout: -4649> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_504 [2,head] auth (dversion lock) v=4614 ino=0x100000003ed state=1073741824 0x55cf62290280] [inode 0x100000003ed [2,head] /dc-dir/dc-file_504 auth v4614 s=3 n(v0 rc2023-10-03T19:13:40.285195+0000 b3 1=1+0) (iversion lock) 0x55cf6228ac00] 2023-10-03T19:20:54.306 INFO:teuthology.orchestra.run.smithi045.stdout: -4648> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003ed [2,head] #100000003ed auth v4614 s=3 n(v0 rc2023-10-03T19:13:40.285195+0000 b3 1=1+0) (iversion lock) 0x55cf6228ac00] 2023-10-03T19:20:54.306 INFO:teuthology.orchestra.run.smithi045.stdout: -4647> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_504 [2,head] auth NULL (dversion lock) v=4614 ino=(nil) state=1073741824 0x55cf62290280] 2023-10-03T19:20:54.306 INFO:teuthology.orchestra.run.smithi045.stdout: -4646> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_503 [2,head] auth (dversion lock) v=4612 ino=0x100000003ec state=1073741824 0x55cf62290000] 2023-10-03T19:20:54.307 INFO:teuthology.orchestra.run.smithi045.stdout: -4645> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.307 INFO:teuthology.orchestra.run.smithi045.stdout: -4644> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003ec [2,head] /dc-dir/dc-file_503 auth v4612 s=3 n(v0 rc2023-10-03T19:13:40.273510+0000 b3 1=1+0) (iversion lock) 0x55cf6228a680] 2023-10-03T19:20:54.307 INFO:teuthology.orchestra.run.smithi045.stdout: -4643> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_503 [2,head] auth (dversion lock) v=4612 ino=0x100000003ec state=1073741824 0x55cf62290000] [inode 0x100000003ec [2,head] /dc-dir/dc-file_503 auth v4612 s=3 n(v0 rc2023-10-03T19:13:40.273510+0000 b3 1=1+0) (iversion lock) 0x55cf6228a680] 2023-10-03T19:20:54.307 INFO:teuthology.orchestra.run.smithi045.stdout: -4642> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003ec [2,head] #100000003ec auth v4612 s=3 n(v0 rc2023-10-03T19:13:40.273510+0000 b3 1=1+0) (iversion lock) 0x55cf6228a680] 2023-10-03T19:20:54.307 INFO:teuthology.orchestra.run.smithi045.stdout: -4641> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_503 [2,head] auth NULL (dversion lock) v=4612 ino=(nil) state=1073741824 0x55cf62290000] 2023-10-03T19:20:54.307 INFO:teuthology.orchestra.run.smithi045.stdout: -4640> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_502 [2,head] auth (dversion lock) v=4610 ino=0x100000003eb state=1073741824 0x55cf62331b80] 2023-10-03T19:20:54.308 INFO:teuthology.orchestra.run.smithi045.stdout: -4639> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.308 INFO:teuthology.orchestra.run.smithi045.stdout: -4638> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003eb [2,head] /dc-dir/dc-file_502 auth v4610 s=3 n(v0 rc2023-10-03T19:13:40.261634+0000 b3 1=1+0) (iversion lock) 0x55cf6228a100] 2023-10-03T19:20:54.308 INFO:teuthology.orchestra.run.smithi045.stdout: -4637> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_502 [2,head] auth (dversion lock) v=4610 ino=0x100000003eb state=1073741824 0x55cf62331b80] [inode 0x100000003eb [2,head] /dc-dir/dc-file_502 auth v4610 s=3 n(v0 rc2023-10-03T19:13:40.261634+0000 b3 1=1+0) (iversion lock) 0x55cf6228a100] 2023-10-03T19:20:54.308 INFO:teuthology.orchestra.run.smithi045.stdout: -4636> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003eb [2,head] #100000003eb auth v4610 s=3 n(v0 rc2023-10-03T19:13:40.261634+0000 b3 1=1+0) (iversion lock) 0x55cf6228a100] 2023-10-03T19:20:54.309 INFO:teuthology.orchestra.run.smithi045.stdout: -4635> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_502 [2,head] auth NULL (dversion lock) v=4610 ino=(nil) state=1073741824 0x55cf62331b80] 2023-10-03T19:20:54.309 INFO:teuthology.orchestra.run.smithi045.stdout: -4634> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_501 [2,head] auth (dversion lock) v=4608 ino=0x100000003ea state=1073741824 0x55cf62331900] 2023-10-03T19:20:54.309 INFO:teuthology.orchestra.run.smithi045.stdout: -4633> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.309 INFO:teuthology.orchestra.run.smithi045.stdout: -4632> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003ea [2,head] /dc-dir/dc-file_501 auth v4608 s=3 n(v0 rc2023-10-03T19:13:40.250445+0000 b3 1=1+0) (iversion lock) 0x55cf62289b80] 2023-10-03T19:20:54.310 INFO:teuthology.orchestra.run.smithi045.stdout: -4631> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_501 [2,head] auth (dversion lock) v=4608 ino=0x100000003ea state=1073741824 0x55cf62331900] [inode 0x100000003ea [2,head] /dc-dir/dc-file_501 auth v4608 s=3 n(v0 rc2023-10-03T19:13:40.250445+0000 b3 1=1+0) (iversion lock) 0x55cf62289b80] 2023-10-03T19:20:54.310 INFO:teuthology.orchestra.run.smithi045.stdout: -4630> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003ea [2,head] #100000003ea auth v4608 s=3 n(v0 rc2023-10-03T19:13:40.250445+0000 b3 1=1+0) (iversion lock) 0x55cf62289b80] 2023-10-03T19:20:54.310 INFO:teuthology.orchestra.run.smithi045.stdout: -4629> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_501 [2,head] auth NULL (dversion lock) v=4608 ino=(nil) state=1073741824 0x55cf62331900] 2023-10-03T19:20:54.310 INFO:teuthology.orchestra.run.smithi045.stdout: -4628> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_500 [2,head] auth (dversion lock) v=4606 ino=0x100000003e9 state=1073741824 0x55cf62331680] 2023-10-03T19:20:54.310 INFO:teuthology.orchestra.run.smithi045.stdout: -4627> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.311 INFO:teuthology.orchestra.run.smithi045.stdout: -4626> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003e9 [2,head] /dc-dir/dc-file_500 auth v4606 s=3 n(v0 rc2023-10-03T19:13:40.238658+0000 b3 1=1+0) (iversion lock) 0x55cf62289600] 2023-10-03T19:20:54.311 INFO:teuthology.orchestra.run.smithi045.stdout: -4625> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_500 [2,head] auth (dversion lock) v=4606 ino=0x100000003e9 state=1073741824 0x55cf62331680] [inode 0x100000003e9 [2,head] /dc-dir/dc-file_500 auth v4606 s=3 n(v0 rc2023-10-03T19:13:40.238658+0000 b3 1=1+0) (iversion lock) 0x55cf62289600] 2023-10-03T19:20:54.311 INFO:teuthology.orchestra.run.smithi045.stdout: -4624> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003e9 [2,head] #100000003e9 auth v4606 s=3 n(v0 rc2023-10-03T19:13:40.238658+0000 b3 1=1+0) (iversion lock) 0x55cf62289600] 2023-10-03T19:20:54.320 INFO:teuthology.orchestra.run.smithi045.stdout: -4623> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_500 [2,head] auth NULL (dversion lock) v=4606 ino=(nil) state=1073741824 0x55cf62331680] 2023-10-03T19:20:54.320 INFO:teuthology.orchestra.run.smithi045.stdout: -4622> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_499 [2,head] auth (dversion lock) v=4604 ino=0x100000003e8 state=1073741824 0x55cf62331400] 2023-10-03T19:20:54.320 INFO:teuthology.orchestra.run.smithi045.stdout: -4621> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.321 INFO:teuthology.orchestra.run.smithi045.stdout: -4620> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003e8 [2,head] /dc-dir/dc-file_499 auth v4604 s=3 n(v0 rc2023-10-03T19:13:40.227397+0000 b3 1=1+0) (iversion lock) 0x55cf62289080] 2023-10-03T19:20:54.321 INFO:teuthology.orchestra.run.smithi045.stdout: -4619> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_499 [2,head] auth (dversion lock) v=4604 ino=0x100000003e8 state=1073741824 0x55cf62331400] [inode 0x100000003e8 [2,head] /dc-dir/dc-file_499 auth v4604 s=3 n(v0 rc2023-10-03T19:13:40.227397+0000 b3 1=1+0) (iversion lock) 0x55cf62289080] 2023-10-03T19:20:54.321 INFO:teuthology.orchestra.run.smithi045.stdout: -4618> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003e8 [2,head] #100000003e8 auth v4604 s=3 n(v0 rc2023-10-03T19:13:40.227397+0000 b3 1=1+0) (iversion lock) 0x55cf62289080] 2023-10-03T19:20:54.321 INFO:teuthology.orchestra.run.smithi045.stdout: -4617> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_499 [2,head] auth NULL (dversion lock) v=4604 ino=(nil) state=1073741824 0x55cf62331400] 2023-10-03T19:20:54.321 INFO:teuthology.orchestra.run.smithi045.stdout: -4616> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_498 [2,head] auth (dversion lock) v=4602 ino=0x100000003e7 state=1073741824 0x55cf62331180] 2023-10-03T19:20:54.322 INFO:teuthology.orchestra.run.smithi045.stdout: -4615> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.322 INFO:teuthology.orchestra.run.smithi045.stdout: -4614> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003e7 [2,head] /dc-dir/dc-file_498 auth v4602 s=3 n(v0 rc2023-10-03T19:13:40.216415+0000 b3 1=1+0) (iversion lock) 0x55cf62288b00] 2023-10-03T19:20:54.322 INFO:teuthology.orchestra.run.smithi045.stdout: -4613> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_498 [2,head] auth (dversion lock) v=4602 ino=0x100000003e7 state=1073741824 0x55cf62331180] [inode 0x100000003e7 [2,head] /dc-dir/dc-file_498 auth v4602 s=3 n(v0 rc2023-10-03T19:13:40.216415+0000 b3 1=1+0) (iversion lock) 0x55cf62288b00] 2023-10-03T19:20:54.322 INFO:teuthology.orchestra.run.smithi045.stdout: -4612> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003e7 [2,head] #100000003e7 auth v4602 s=3 n(v0 rc2023-10-03T19:13:40.216415+0000 b3 1=1+0) (iversion lock) 0x55cf62288b00] 2023-10-03T19:20:54.322 INFO:teuthology.orchestra.run.smithi045.stdout: -4611> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_498 [2,head] auth NULL (dversion lock) v=4602 ino=(nil) state=1073741824 0x55cf62331180] 2023-10-03T19:20:54.323 INFO:teuthology.orchestra.run.smithi045.stdout: -4610> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_497 [2,head] auth (dversion lock) v=4600 ino=0x100000003e6 state=1073741824 0x55cf62330f00] 2023-10-03T19:20:54.323 INFO:teuthology.orchestra.run.smithi045.stdout: -4609> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.323 INFO:teuthology.orchestra.run.smithi045.stdout: -4608> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003e6 [2,head] /dc-dir/dc-file_497 auth v4600 s=3 n(v0 rc2023-10-03T19:13:40.205254+0000 b3 1=1+0) (iversion lock) 0x55cf62288580] 2023-10-03T19:20:54.323 INFO:teuthology.orchestra.run.smithi045.stdout: -4607> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_497 [2,head] auth (dversion lock) v=4600 ino=0x100000003e6 state=1073741824 0x55cf62330f00] [inode 0x100000003e6 [2,head] /dc-dir/dc-file_497 auth v4600 s=3 n(v0 rc2023-10-03T19:13:40.205254+0000 b3 1=1+0) (iversion lock) 0x55cf62288580] 2023-10-03T19:20:54.323 INFO:teuthology.orchestra.run.smithi045.stdout: -4606> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003e6 [2,head] #100000003e6 auth v4600 s=3 n(v0 rc2023-10-03T19:13:40.205254+0000 b3 1=1+0) (iversion lock) 0x55cf62288580] 2023-10-03T19:20:54.324 INFO:teuthology.orchestra.run.smithi045.stdout: -4605> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_497 [2,head] auth NULL (dversion lock) v=4600 ino=(nil) state=1073741824 0x55cf62330f00] 2023-10-03T19:20:54.324 INFO:teuthology.orchestra.run.smithi045.stdout: -4604> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_496 [2,head] auth (dversion lock) v=4598 ino=0x100000003e5 state=1073741824 0x55cf62330c80] 2023-10-03T19:20:54.324 INFO:teuthology.orchestra.run.smithi045.stdout: -4603> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.324 INFO:teuthology.orchestra.run.smithi045.stdout: -4602> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003e5 [2,head] /dc-dir/dc-file_496 auth v4598 s=3 n(v0 rc2023-10-03T19:13:40.193344+0000 b3 1=1+0) (iversion lock) 0x55cf62288000] 2023-10-03T19:20:54.324 INFO:teuthology.orchestra.run.smithi045.stdout: -4601> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_496 [2,head] auth (dversion lock) v=4598 ino=0x100000003e5 state=1073741824 0x55cf62330c80] [inode 0x100000003e5 [2,head] /dc-dir/dc-file_496 auth v4598 s=3 n(v0 rc2023-10-03T19:13:40.193344+0000 b3 1=1+0) (iversion lock) 0x55cf62288000] 2023-10-03T19:20:54.325 INFO:teuthology.orchestra.run.smithi045.stdout: -4600> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003e5 [2,head] #100000003e5 auth v4598 s=3 n(v0 rc2023-10-03T19:13:40.193344+0000 b3 1=1+0) (iversion lock) 0x55cf62288000] 2023-10-03T19:20:54.325 INFO:teuthology.orchestra.run.smithi045.stdout: -4599> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_496 [2,head] auth NULL (dversion lock) v=4598 ino=(nil) state=1073741824 0x55cf62330c80] 2023-10-03T19:20:54.325 INFO:teuthology.orchestra.run.smithi045.stdout: -4598> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_495 [2,head] auth (dversion lock) v=4596 ino=0x100000003e4 state=1073741824 0x55cf62330a00] 2023-10-03T19:20:54.325 INFO:teuthology.orchestra.run.smithi045.stdout: -4597> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.325 INFO:teuthology.orchestra.run.smithi045.stdout: -4596> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003e4 [2,head] /dc-dir/dc-file_495 auth v4596 s=3 n(v0 rc2023-10-03T19:13:40.181959+0000 b3 1=1+0) (iversion lock) 0x55cf6232b700] 2023-10-03T19:20:54.326 INFO:teuthology.orchestra.run.smithi045.stdout: -4595> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_495 [2,head] auth (dversion lock) v=4596 ino=0x100000003e4 state=1073741824 0x55cf62330a00] [inode 0x100000003e4 [2,head] /dc-dir/dc-file_495 auth v4596 s=3 n(v0 rc2023-10-03T19:13:40.181959+0000 b3 1=1+0) (iversion lock) 0x55cf6232b700] 2023-10-03T19:20:54.326 INFO:teuthology.orchestra.run.smithi045.stdout: -4594> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003e4 [2,head] #100000003e4 auth v4596 s=3 n(v0 rc2023-10-03T19:13:40.181959+0000 b3 1=1+0) (iversion lock) 0x55cf6232b700] 2023-10-03T19:20:54.326 INFO:teuthology.orchestra.run.smithi045.stdout: -4593> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_495 [2,head] auth NULL (dversion lock) v=4596 ino=(nil) state=1073741824 0x55cf62330a00] 2023-10-03T19:20:54.326 INFO:teuthology.orchestra.run.smithi045.stdout: -4592> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_494 [2,head] auth (dversion lock) v=4594 ino=0x100000003e3 state=1073741824 0x55cf62330780] 2023-10-03T19:20:54.326 INFO:teuthology.orchestra.run.smithi045.stdout: -4591> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.327 INFO:teuthology.orchestra.run.smithi045.stdout: -4590> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003e3 [2,head] /dc-dir/dc-file_494 auth v4594 s=3 n(v0 rc2023-10-03T19:13:40.169839+0000 b3 1=1+0) (iversion lock) 0x55cf6232b180] 2023-10-03T19:20:54.327 INFO:teuthology.orchestra.run.smithi045.stdout: -4589> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_494 [2,head] auth (dversion lock) v=4594 ino=0x100000003e3 state=1073741824 0x55cf62330780] [inode 0x100000003e3 [2,head] /dc-dir/dc-file_494 auth v4594 s=3 n(v0 rc2023-10-03T19:13:40.169839+0000 b3 1=1+0) (iversion lock) 0x55cf6232b180] 2023-10-03T19:20:54.327 INFO:teuthology.orchestra.run.smithi045.stdout: -4588> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003e3 [2,head] #100000003e3 auth v4594 s=3 n(v0 rc2023-10-03T19:13:40.169839+0000 b3 1=1+0) (iversion lock) 0x55cf6232b180] 2023-10-03T19:20:54.327 INFO:teuthology.orchestra.run.smithi045.stdout: -4587> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_494 [2,head] auth NULL (dversion lock) v=4594 ino=(nil) state=1073741824 0x55cf62330780] 2023-10-03T19:20:54.327 INFO:teuthology.orchestra.run.smithi045.stdout: -4586> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_493 [2,head] auth (dversion lock) v=4592 ino=0x100000003e2 state=1073741824 0x55cf62330500] 2023-10-03T19:20:54.328 INFO:teuthology.orchestra.run.smithi045.stdout: -4585> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.328 INFO:teuthology.orchestra.run.smithi045.stdout: -4584> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003e2 [2,head] /dc-dir/dc-file_493 auth v4592 s=3 n(v0 rc2023-10-03T19:13:40.157744+0000 b3 1=1+0) (iversion lock) 0x55cf6232ac00] 2023-10-03T19:20:54.328 INFO:teuthology.orchestra.run.smithi045.stdout: -4583> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_493 [2,head] auth (dversion lock) v=4592 ino=0x100000003e2 state=1073741824 0x55cf62330500] [inode 0x100000003e2 [2,head] /dc-dir/dc-file_493 auth v4592 s=3 n(v0 rc2023-10-03T19:13:40.157744+0000 b3 1=1+0) (iversion lock) 0x55cf6232ac00] 2023-10-03T19:20:54.328 INFO:teuthology.orchestra.run.smithi045.stdout: -4582> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003e2 [2,head] #100000003e2 auth v4592 s=3 n(v0 rc2023-10-03T19:13:40.157744+0000 b3 1=1+0) (iversion lock) 0x55cf6232ac00] 2023-10-03T19:20:54.328 INFO:teuthology.orchestra.run.smithi045.stdout: -4581> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_493 [2,head] auth NULL (dversion lock) v=4592 ino=(nil) state=1073741824 0x55cf62330500] 2023-10-03T19:20:54.329 INFO:teuthology.orchestra.run.smithi045.stdout: -4580> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_492 [2,head] auth (dversion lock) v=4590 ino=0x100000003e1 state=1073741824 0x55cf62330280] 2023-10-03T19:20:54.329 INFO:teuthology.orchestra.run.smithi045.stdout: -4579> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.329 INFO:teuthology.orchestra.run.smithi045.stdout: -4578> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003e1 [2,head] /dc-dir/dc-file_492 auth v4590 s=3 n(v0 rc2023-10-03T19:13:40.146521+0000 b3 1=1+0) (iversion lock) 0x55cf6232a680] 2023-10-03T19:20:54.329 INFO:teuthology.orchestra.run.smithi045.stdout: -4577> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_492 [2,head] auth (dversion lock) v=4590 ino=0x100000003e1 state=1073741824 0x55cf62330280] [inode 0x100000003e1 [2,head] /dc-dir/dc-file_492 auth v4590 s=3 n(v0 rc2023-10-03T19:13:40.146521+0000 b3 1=1+0) (iversion lock) 0x55cf6232a680] 2023-10-03T19:20:54.329 INFO:teuthology.orchestra.run.smithi045.stdout: -4576> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003e1 [2,head] #100000003e1 auth v4590 s=3 n(v0 rc2023-10-03T19:13:40.146521+0000 b3 1=1+0) (iversion lock) 0x55cf6232a680] 2023-10-03T19:20:54.330 INFO:teuthology.orchestra.run.smithi045.stdout: -4575> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_492 [2,head] auth NULL (dversion lock) v=4590 ino=(nil) state=1073741824 0x55cf62330280] 2023-10-03T19:20:54.330 INFO:teuthology.orchestra.run.smithi045.stdout: -4574> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_491 [2,head] auth (dversion lock) v=4588 ino=0x100000003e0 state=1073741824 0x55cf62330000] 2023-10-03T19:20:54.330 INFO:teuthology.orchestra.run.smithi045.stdout: -4573> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.330 INFO:teuthology.orchestra.run.smithi045.stdout: -4572> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003e0 [2,head] /dc-dir/dc-file_491 auth v4588 s=3 n(v0 rc2023-10-03T19:13:40.135350+0000 b3 1=1+0) (iversion lock) 0x55cf6232a100] 2023-10-03T19:20:54.330 INFO:teuthology.orchestra.run.smithi045.stdout: -4571> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_491 [2,head] auth (dversion lock) v=4588 ino=0x100000003e0 state=1073741824 0x55cf62330000] [inode 0x100000003e0 [2,head] /dc-dir/dc-file_491 auth v4588 s=3 n(v0 rc2023-10-03T19:13:40.135350+0000 b3 1=1+0) (iversion lock) 0x55cf6232a100] 2023-10-03T19:20:54.331 INFO:teuthology.orchestra.run.smithi045.stdout: -4570> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003e0 [2,head] #100000003e0 auth v4588 s=3 n(v0 rc2023-10-03T19:13:40.135350+0000 b3 1=1+0) (iversion lock) 0x55cf6232a100] 2023-10-03T19:20:54.331 INFO:teuthology.orchestra.run.smithi045.stdout: -4569> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_491 [2,head] auth NULL (dversion lock) v=4588 ino=(nil) state=1073741824 0x55cf62330000] 2023-10-03T19:20:54.331 INFO:teuthology.orchestra.run.smithi045.stdout: -4568> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_490 [2,head] auth (dversion lock) v=4586 ino=0x100000003df state=1073741824 0x55cf62325b80] 2023-10-03T19:20:54.331 INFO:teuthology.orchestra.run.smithi045.stdout: -4567> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.331 INFO:teuthology.orchestra.run.smithi045.stdout: -4566> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003df [2,head] /dc-dir/dc-file_490 auth v4586 s=3 n(v0 rc2023-10-03T19:13:40.124501+0000 b3 1=1+0) (iversion lock) 0x55cf62329b80] 2023-10-03T19:20:54.332 INFO:teuthology.orchestra.run.smithi045.stdout: -4565> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_490 [2,head] auth (dversion lock) v=4586 ino=0x100000003df state=1073741824 0x55cf62325b80] [inode 0x100000003df [2,head] /dc-dir/dc-file_490 auth v4586 s=3 n(v0 rc2023-10-03T19:13:40.124501+0000 b3 1=1+0) (iversion lock) 0x55cf62329b80] 2023-10-03T19:20:54.332 INFO:teuthology.orchestra.run.smithi045.stdout: -4564> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003df [2,head] #100000003df auth v4586 s=3 n(v0 rc2023-10-03T19:13:40.124501+0000 b3 1=1+0) (iversion lock) 0x55cf62329b80] 2023-10-03T19:20:54.332 INFO:teuthology.orchestra.run.smithi045.stdout: -4563> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_490 [2,head] auth NULL (dversion lock) v=4586 ino=(nil) state=1073741824 0x55cf62325b80] 2023-10-03T19:20:54.332 INFO:teuthology.orchestra.run.smithi045.stdout: -4562> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_489 [2,head] auth (dversion lock) v=4584 ino=0x100000003de state=1073741824 0x55cf62325900] 2023-10-03T19:20:54.332 INFO:teuthology.orchestra.run.smithi045.stdout: -4561> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.333 INFO:teuthology.orchestra.run.smithi045.stdout: -4560> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003de [2,head] /dc-dir/dc-file_489 auth v4584 s=3 n(v0 rc2023-10-03T19:13:40.112875+0000 b3 1=1+0) (iversion lock) 0x55cf62329600] 2023-10-03T19:20:54.333 INFO:teuthology.orchestra.run.smithi045.stdout: -4559> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_489 [2,head] auth (dversion lock) v=4584 ino=0x100000003de state=1073741824 0x55cf62325900] [inode 0x100000003de [2,head] /dc-dir/dc-file_489 auth v4584 s=3 n(v0 rc2023-10-03T19:13:40.112875+0000 b3 1=1+0) (iversion lock) 0x55cf62329600] 2023-10-03T19:20:54.333 INFO:teuthology.orchestra.run.smithi045.stdout: -4558> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003de [2,head] #100000003de auth v4584 s=3 n(v0 rc2023-10-03T19:13:40.112875+0000 b3 1=1+0) (iversion lock) 0x55cf62329600] 2023-10-03T19:20:54.333 INFO:teuthology.orchestra.run.smithi045.stdout: -4557> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_489 [2,head] auth NULL (dversion lock) v=4584 ino=(nil) state=1073741824 0x55cf62325900] 2023-10-03T19:20:54.333 INFO:teuthology.orchestra.run.smithi045.stdout: -4556> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_488 [2,head] auth (dversion lock) v=4582 ino=0x100000003dd state=1073741824 0x55cf62325680] 2023-10-03T19:20:54.334 INFO:teuthology.orchestra.run.smithi045.stdout: -4555> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.334 INFO:teuthology.orchestra.run.smithi045.stdout: -4554> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003dd [2,head] /dc-dir/dc-file_488 auth v4582 s=3 n(v0 rc2023-10-03T19:13:40.101150+0000 b3 1=1+0) (iversion lock) 0x55cf62329080] 2023-10-03T19:20:54.334 INFO:teuthology.orchestra.run.smithi045.stdout: -4553> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_488 [2,head] auth (dversion lock) v=4582 ino=0x100000003dd state=1073741824 0x55cf62325680] [inode 0x100000003dd [2,head] /dc-dir/dc-file_488 auth v4582 s=3 n(v0 rc2023-10-03T19:13:40.101150+0000 b3 1=1+0) (iversion lock) 0x55cf62329080] 2023-10-03T19:20:54.334 INFO:teuthology.orchestra.run.smithi045.stdout: -4552> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003dd [2,head] #100000003dd auth v4582 s=3 n(v0 rc2023-10-03T19:13:40.101150+0000 b3 1=1+0) (iversion lock) 0x55cf62329080] 2023-10-03T19:20:54.334 INFO:teuthology.orchestra.run.smithi045.stdout: -4551> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_488 [2,head] auth NULL (dversion lock) v=4582 ino=(nil) state=1073741824 0x55cf62325680] 2023-10-03T19:20:54.335 INFO:teuthology.orchestra.run.smithi045.stdout: -4550> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_487 [2,head] auth (dversion lock) v=4580 ino=0x100000003dc state=1073741824 0x55cf62325400] 2023-10-03T19:20:54.335 INFO:teuthology.orchestra.run.smithi045.stdout: -4549> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.335 INFO:teuthology.orchestra.run.smithi045.stdout: -4548> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003dc [2,head] /dc-dir/dc-file_487 auth v4580 s=3 n(v0 rc2023-10-03T19:13:40.088727+0000 b3 1=1+0) (iversion lock) 0x55cf62328b00] 2023-10-03T19:20:54.335 INFO:teuthology.orchestra.run.smithi045.stdout: -4547> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_487 [2,head] auth (dversion lock) v=4580 ino=0x100000003dc state=1073741824 0x55cf62325400] [inode 0x100000003dc [2,head] /dc-dir/dc-file_487 auth v4580 s=3 n(v0 rc2023-10-03T19:13:40.088727+0000 b3 1=1+0) (iversion lock) 0x55cf62328b00] 2023-10-03T19:20:54.335 INFO:teuthology.orchestra.run.smithi045.stdout: -4546> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003dc [2,head] #100000003dc auth v4580 s=3 n(v0 rc2023-10-03T19:13:40.088727+0000 b3 1=1+0) (iversion lock) 0x55cf62328b00] 2023-10-03T19:20:54.336 INFO:teuthology.orchestra.run.smithi045.stdout: -4545> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_487 [2,head] auth NULL (dversion lock) v=4580 ino=(nil) state=1073741824 0x55cf62325400] 2023-10-03T19:20:54.336 INFO:teuthology.orchestra.run.smithi045.stdout: -4544> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_486 [2,head] auth (dversion lock) v=4578 ino=0x100000003db state=1073741824 0x55cf62325180] 2023-10-03T19:20:54.469 INFO:teuthology.orchestra.run.smithi045.stdout: -4543> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.469 INFO:teuthology.orchestra.run.smithi045.stdout: -4542> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003db [2,head] /dc-dir/dc-file_486 auth v4578 s=3 n(v0 rc2023-10-03T19:13:40.077191+0000 b3 1=1+0) (iversion lock) 0x55cf62328580] 2023-10-03T19:20:54.469 INFO:teuthology.orchestra.run.smithi045.stdout: -4541> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_486 [2,head] auth (dversion lock) v=4578 ino=0x100000003db state=1073741824 0x55cf62325180] [inode 0x100000003db [2,head] /dc-dir/dc-file_486 auth v4578 s=3 n(v0 rc2023-10-03T19:13:40.077191+0000 b3 1=1+0) (iversion lock) 0x55cf62328580] 2023-10-03T19:20:54.470 INFO:teuthology.orchestra.run.smithi045.stdout: -4540> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003db [2,head] #100000003db auth v4578 s=3 n(v0 rc2023-10-03T19:13:40.077191+0000 b3 1=1+0) (iversion lock) 0x55cf62328580] 2023-10-03T19:20:54.470 INFO:teuthology.orchestra.run.smithi045.stdout: -4539> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_486 [2,head] auth NULL (dversion lock) v=4578 ino=(nil) state=1073741824 0x55cf62325180] 2023-10-03T19:20:54.470 INFO:teuthology.orchestra.run.smithi045.stdout: -4538> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_485 [2,head] auth (dversion lock) v=4576 ino=0x100000003da state=1073741824 0x55cf62324f00] 2023-10-03T19:20:54.470 INFO:teuthology.orchestra.run.smithi045.stdout: -4537> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.470 INFO:teuthology.orchestra.run.smithi045.stdout: -4536> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003da [2,head] /dc-dir/dc-file_485 auth v4576 s=3 n(v0 rc2023-10-03T19:13:40.064925+0000 b3 1=1+0) (iversion lock) 0x55cf62328000] 2023-10-03T19:20:54.471 INFO:teuthology.orchestra.run.smithi045.stdout: -4535> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_485 [2,head] auth (dversion lock) v=4576 ino=0x100000003da state=1073741824 0x55cf62324f00] [inode 0x100000003da [2,head] /dc-dir/dc-file_485 auth v4576 s=3 n(v0 rc2023-10-03T19:13:40.064925+0000 b3 1=1+0) (iversion lock) 0x55cf62328000] 2023-10-03T19:20:54.471 INFO:teuthology.orchestra.run.smithi045.stdout: -4534> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003da [2,head] #100000003da auth v4576 s=3 n(v0 rc2023-10-03T19:13:40.064925+0000 b3 1=1+0) (iversion lock) 0x55cf62328000] 2023-10-03T19:20:54.471 INFO:teuthology.orchestra.run.smithi045.stdout: -4533> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_485 [2,head] auth NULL (dversion lock) v=4576 ino=(nil) state=1073741824 0x55cf62324f00] 2023-10-03T19:20:54.472 INFO:teuthology.orchestra.run.smithi045.stdout: -4532> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_484 [2,head] auth (dversion lock) v=4574 ino=0x100000003d9 state=1073741824 0x55cf62324c80] 2023-10-03T19:20:54.472 INFO:teuthology.orchestra.run.smithi045.stdout: -4531> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.472 INFO:teuthology.orchestra.run.smithi045.stdout: -4530> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003d9 [2,head] /dc-dir/dc-file_484 auth v4574 s=3 n(v0 rc2023-10-03T19:13:40.052495+0000 b3 1=1+0) (iversion lock) 0x55cf62321700] 2023-10-03T19:20:54.472 INFO:teuthology.orchestra.run.smithi045.stdout: -4529> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_484 [2,head] auth (dversion lock) v=4574 ino=0x100000003d9 state=1073741824 0x55cf62324c80] [inode 0x100000003d9 [2,head] /dc-dir/dc-file_484 auth v4574 s=3 n(v0 rc2023-10-03T19:13:40.052495+0000 b3 1=1+0) (iversion lock) 0x55cf62321700] 2023-10-03T19:20:54.472 INFO:teuthology.orchestra.run.smithi045.stdout: -4528> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003d9 [2,head] #100000003d9 auth v4574 s=3 n(v0 rc2023-10-03T19:13:40.052495+0000 b3 1=1+0) (iversion lock) 0x55cf62321700] 2023-10-03T19:20:54.473 INFO:teuthology.orchestra.run.smithi045.stdout: -4527> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_484 [2,head] auth NULL (dversion lock) v=4574 ino=(nil) state=1073741824 0x55cf62324c80] 2023-10-03T19:20:54.473 INFO:teuthology.orchestra.run.smithi045.stdout: -4526> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_483 [2,head] auth (dversion lock) v=4572 ino=0x100000003d8 state=1073741824 0x55cf62324a00] 2023-10-03T19:20:54.473 INFO:teuthology.orchestra.run.smithi045.stdout: -4525> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.473 INFO:teuthology.orchestra.run.smithi045.stdout: -4524> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003d8 [2,head] /dc-dir/dc-file_483 auth v4572 s=3 n(v0 rc2023-10-03T19:13:40.039687+0000 b3 1=1+0) (iversion lock) 0x55cf62321180] 2023-10-03T19:20:54.473 INFO:teuthology.orchestra.run.smithi045.stdout: -4523> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_483 [2,head] auth (dversion lock) v=4572 ino=0x100000003d8 state=1073741824 0x55cf62324a00] [inode 0x100000003d8 [2,head] /dc-dir/dc-file_483 auth v4572 s=3 n(v0 rc2023-10-03T19:13:40.039687+0000 b3 1=1+0) (iversion lock) 0x55cf62321180] 2023-10-03T19:20:54.474 INFO:teuthology.orchestra.run.smithi045.stdout: -4522> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003d8 [2,head] #100000003d8 auth v4572 s=3 n(v0 rc2023-10-03T19:13:40.039687+0000 b3 1=1+0) (iversion lock) 0x55cf62321180] 2023-10-03T19:20:54.474 INFO:teuthology.orchestra.run.smithi045.stdout: -4521> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_483 [2,head] auth NULL (dversion lock) v=4572 ino=(nil) state=1073741824 0x55cf62324a00] 2023-10-03T19:20:54.474 INFO:teuthology.orchestra.run.smithi045.stdout: -4520> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_482 [2,head] auth (dversion lock) v=4570 ino=0x100000003d7 state=1073741824 0x55cf62324780] 2023-10-03T19:20:54.474 INFO:teuthology.orchestra.run.smithi045.stdout: -4519> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.474 INFO:teuthology.orchestra.run.smithi045.stdout: -4518> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003d7 [2,head] /dc-dir/dc-file_482 auth v4570 s=3 n(v0 rc2023-10-03T19:13:40.026860+0000 b3 1=1+0) (iversion lock) 0x55cf62320c00] 2023-10-03T19:20:54.475 INFO:teuthology.orchestra.run.smithi045.stdout: -4517> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_482 [2,head] auth (dversion lock) v=4570 ino=0x100000003d7 state=1073741824 0x55cf62324780] [inode 0x100000003d7 [2,head] /dc-dir/dc-file_482 auth v4570 s=3 n(v0 rc2023-10-03T19:13:40.026860+0000 b3 1=1+0) (iversion lock) 0x55cf62320c00] 2023-10-03T19:20:54.475 INFO:teuthology.orchestra.run.smithi045.stdout: -4516> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003d7 [2,head] #100000003d7 auth v4570 s=3 n(v0 rc2023-10-03T19:13:40.026860+0000 b3 1=1+0) (iversion lock) 0x55cf62320c00] 2023-10-03T19:20:54.475 INFO:teuthology.orchestra.run.smithi045.stdout: -4515> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_482 [2,head] auth NULL (dversion lock) v=4570 ino=(nil) state=1073741824 0x55cf62324780] 2023-10-03T19:20:54.475 INFO:teuthology.orchestra.run.smithi045.stdout: -4514> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_481 [2,head] auth (dversion lock) v=4568 ino=0x100000003d6 state=1073741824 0x55cf62324500] 2023-10-03T19:20:54.475 INFO:teuthology.orchestra.run.smithi045.stdout: -4513> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.475 INFO:teuthology.orchestra.run.smithi045.stdout: -4512> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003d6 [2,head] /dc-dir/dc-file_481 auth v4568 s=3 n(v0 rc2023-10-03T19:13:40.014369+0000 b3 1=1+0) (iversion lock) 0x55cf62320680] 2023-10-03T19:20:54.476 INFO:teuthology.orchestra.run.smithi045.stdout: -4511> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_481 [2,head] auth (dversion lock) v=4568 ino=0x100000003d6 state=1073741824 0x55cf62324500] [inode 0x100000003d6 [2,head] /dc-dir/dc-file_481 auth v4568 s=3 n(v0 rc2023-10-03T19:13:40.014369+0000 b3 1=1+0) (iversion lock) 0x55cf62320680] 2023-10-03T19:20:54.476 INFO:teuthology.orchestra.run.smithi045.stdout: -4510> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003d6 [2,head] #100000003d6 auth v4568 s=3 n(v0 rc2023-10-03T19:13:40.014369+0000 b3 1=1+0) (iversion lock) 0x55cf62320680] 2023-10-03T19:20:54.476 INFO:teuthology.orchestra.run.smithi045.stdout: -4509> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_481 [2,head] auth NULL (dversion lock) v=4568 ino=(nil) state=1073741824 0x55cf62324500] 2023-10-03T19:20:54.476 INFO:teuthology.orchestra.run.smithi045.stdout: -4508> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_480 [2,head] auth (dversion lock) v=4566 ino=0x100000003d5 state=1073741824 0x55cf62324280] 2023-10-03T19:20:54.476 INFO:teuthology.orchestra.run.smithi045.stdout: -4507> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.477 INFO:teuthology.orchestra.run.smithi045.stdout: -4506> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003d5 [2,head] /dc-dir/dc-file_480 auth v4566 s=3 n(v0 rc2023-10-03T19:13:40.001135+0000 b3 1=1+0) (iversion lock) 0x55cf62320100] 2023-10-03T19:20:54.477 INFO:teuthology.orchestra.run.smithi045.stdout: -4505> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_480 [2,head] auth (dversion lock) v=4566 ino=0x100000003d5 state=1073741824 0x55cf62324280] [inode 0x100000003d5 [2,head] /dc-dir/dc-file_480 auth v4566 s=3 n(v0 rc2023-10-03T19:13:40.001135+0000 b3 1=1+0) (iversion lock) 0x55cf62320100] 2023-10-03T19:20:54.477 INFO:teuthology.orchestra.run.smithi045.stdout: -4504> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003d5 [2,head] #100000003d5 auth v4566 s=3 n(v0 rc2023-10-03T19:13:40.001135+0000 b3 1=1+0) (iversion lock) 0x55cf62320100] 2023-10-03T19:20:54.477 INFO:teuthology.orchestra.run.smithi045.stdout: -4503> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_480 [2,head] auth NULL (dversion lock) v=4566 ino=(nil) state=1073741824 0x55cf62324280] 2023-10-03T19:20:54.477 INFO:teuthology.orchestra.run.smithi045.stdout: -4502> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_479 [2,head] auth (dversion lock) v=4564 ino=0x100000003d4 state=1073741824 0x55cf62324000] 2023-10-03T19:20:54.478 INFO:teuthology.orchestra.run.smithi045.stdout: -4501> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.478 INFO:teuthology.orchestra.run.smithi045.stdout: -4500> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003d4 [2,head] /dc-dir/dc-file_479 auth v4564 s=3 n(v0 rc2023-10-03T19:13:39.988302+0000 b3 1=1+0) (iversion lock) 0x55cf6231fb80] 2023-10-03T19:20:54.478 INFO:teuthology.orchestra.run.smithi045.stdout: -4499> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_479 [2,head] auth (dversion lock) v=4564 ino=0x100000003d4 state=1073741824 0x55cf62324000] [inode 0x100000003d4 [2,head] /dc-dir/dc-file_479 auth v4564 s=3 n(v0 rc2023-10-03T19:13:39.988302+0000 b3 1=1+0) (iversion lock) 0x55cf6231fb80] 2023-10-03T19:20:54.478 INFO:teuthology.orchestra.run.smithi045.stdout: -4498> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003d4 [2,head] #100000003d4 auth v4564 s=3 n(v0 rc2023-10-03T19:13:39.988302+0000 b3 1=1+0) (iversion lock) 0x55cf6231fb80] 2023-10-03T19:20:54.478 INFO:teuthology.orchestra.run.smithi045.stdout: -4497> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_479 [2,head] auth NULL (dversion lock) v=4564 ino=(nil) state=1073741824 0x55cf62324000] 2023-10-03T19:20:54.479 INFO:teuthology.orchestra.run.smithi045.stdout: -4496> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_478 [2,head] auth (dversion lock) v=4562 ino=0x100000003d3 state=1073741824 0x55cf6231bb80] 2023-10-03T19:20:54.479 INFO:teuthology.orchestra.run.smithi045.stdout: -4495> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.479 INFO:teuthology.orchestra.run.smithi045.stdout: -4494> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003d3 [2,head] /dc-dir/dc-file_478 auth v4562 s=3 n(v0 rc2023-10-03T19:13:39.975080+0000 b3 1=1+0) (iversion lock) 0x55cf6231f600] 2023-10-03T19:20:54.479 INFO:teuthology.orchestra.run.smithi045.stdout: -4493> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_478 [2,head] auth (dversion lock) v=4562 ino=0x100000003d3 state=1073741824 0x55cf6231bb80] [inode 0x100000003d3 [2,head] /dc-dir/dc-file_478 auth v4562 s=3 n(v0 rc2023-10-03T19:13:39.975080+0000 b3 1=1+0) (iversion lock) 0x55cf6231f600] 2023-10-03T19:20:54.479 INFO:teuthology.orchestra.run.smithi045.stdout: -4492> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003d3 [2,head] #100000003d3 auth v4562 s=3 n(v0 rc2023-10-03T19:13:39.975080+0000 b3 1=1+0) (iversion lock) 0x55cf6231f600] 2023-10-03T19:20:54.480 INFO:teuthology.orchestra.run.smithi045.stdout: -4491> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_478 [2,head] auth NULL (dversion lock) v=4562 ino=(nil) state=1073741824 0x55cf6231bb80] 2023-10-03T19:20:54.480 INFO:teuthology.orchestra.run.smithi045.stdout: -4490> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_477 [2,head] auth (dversion lock) v=4560 ino=0x100000003d2 state=1073741824 0x55cf6231b900] 2023-10-03T19:20:54.480 INFO:teuthology.orchestra.run.smithi045.stdout: -4489> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.480 INFO:teuthology.orchestra.run.smithi045.stdout: -4488> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003d2 [2,head] /dc-dir/dc-file_477 auth v4560 s=3 n(v0 rc2023-10-03T19:13:39.961860+0000 b3 1=1+0) (iversion lock) 0x55cf6231f080] 2023-10-03T19:20:54.480 INFO:teuthology.orchestra.run.smithi045.stdout: -4487> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_477 [2,head] auth (dversion lock) v=4560 ino=0x100000003d2 state=1073741824 0x55cf6231b900] [inode 0x100000003d2 [2,head] /dc-dir/dc-file_477 auth v4560 s=3 n(v0 rc2023-10-03T19:13:39.961860+0000 b3 1=1+0) (iversion lock) 0x55cf6231f080] 2023-10-03T19:20:54.481 INFO:teuthology.orchestra.run.smithi045.stdout: -4486> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003d2 [2,head] #100000003d2 auth v4560 s=3 n(v0 rc2023-10-03T19:13:39.961860+0000 b3 1=1+0) (iversion lock) 0x55cf6231f080] 2023-10-03T19:20:54.481 INFO:teuthology.orchestra.run.smithi045.stdout: -4485> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_477 [2,head] auth NULL (dversion lock) v=4560 ino=(nil) state=1073741824 0x55cf6231b900] 2023-10-03T19:20:54.481 INFO:teuthology.orchestra.run.smithi045.stdout: -4484> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_476 [2,head] auth (dversion lock) v=4558 ino=0x100000003d1 state=1073741824 0x55cf6231b680] 2023-10-03T19:20:54.481 INFO:teuthology.orchestra.run.smithi045.stdout: -4483> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.481 INFO:teuthology.orchestra.run.smithi045.stdout: -4482> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003d1 [2,head] /dc-dir/dc-file_476 auth v4558 s=3 n(v0 rc2023-10-03T19:13:39.949298+0000 b3 1=1+0) (iversion lock) 0x55cf6231eb00] 2023-10-03T19:20:54.482 INFO:teuthology.orchestra.run.smithi045.stdout: -4481> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_476 [2,head] auth (dversion lock) v=4558 ino=0x100000003d1 state=1073741824 0x55cf6231b680] [inode 0x100000003d1 [2,head] /dc-dir/dc-file_476 auth v4558 s=3 n(v0 rc2023-10-03T19:13:39.949298+0000 b3 1=1+0) (iversion lock) 0x55cf6231eb00] 2023-10-03T19:20:54.482 INFO:teuthology.orchestra.run.smithi045.stdout: -4480> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003d1 [2,head] #100000003d1 auth v4558 s=3 n(v0 rc2023-10-03T19:13:39.949298+0000 b3 1=1+0) (iversion lock) 0x55cf6231eb00] 2023-10-03T19:20:54.482 INFO:teuthology.orchestra.run.smithi045.stdout: -4479> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_476 [2,head] auth NULL (dversion lock) v=4558 ino=(nil) state=1073741824 0x55cf6231b680] 2023-10-03T19:20:54.482 INFO:teuthology.orchestra.run.smithi045.stdout: -4478> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_475 [2,head] auth (dversion lock) v=4556 ino=0x100000003d0 state=1073741824 0x55cf6231b400] 2023-10-03T19:20:54.482 INFO:teuthology.orchestra.run.smithi045.stdout: -4477> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.483 INFO:teuthology.orchestra.run.smithi045.stdout: -4476> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003d0 [2,head] /dc-dir/dc-file_475 auth v4556 s=3 n(v0 rc2023-10-03T19:13:39.938498+0000 b3 1=1+0) (iversion lock) 0x55cf6231e580] 2023-10-03T19:20:54.483 INFO:teuthology.orchestra.run.smithi045.stdout: -4475> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_475 [2,head] auth (dversion lock) v=4556 ino=0x100000003d0 state=1073741824 0x55cf6231b400] [inode 0x100000003d0 [2,head] /dc-dir/dc-file_475 auth v4556 s=3 n(v0 rc2023-10-03T19:13:39.938498+0000 b3 1=1+0) (iversion lock) 0x55cf6231e580] 2023-10-03T19:20:54.483 INFO:teuthology.orchestra.run.smithi045.stdout: -4474> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003d0 [2,head] #100000003d0 auth v4556 s=3 n(v0 rc2023-10-03T19:13:39.938498+0000 b3 1=1+0) (iversion lock) 0x55cf6231e580] 2023-10-03T19:20:54.483 INFO:teuthology.orchestra.run.smithi045.stdout: -4473> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_475 [2,head] auth NULL (dversion lock) v=4556 ino=(nil) state=1073741824 0x55cf6231b400] 2023-10-03T19:20:54.483 INFO:teuthology.orchestra.run.smithi045.stdout: -4472> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_474 [2,head] auth (dversion lock) v=4554 ino=0x100000003cf state=1073741824 0x55cf6231b180] 2023-10-03T19:20:54.484 INFO:teuthology.orchestra.run.smithi045.stdout: -4471> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.484 INFO:teuthology.orchestra.run.smithi045.stdout: -4470> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003cf [2,head] /dc-dir/dc-file_474 auth v4554 s=3 n(v0 rc2023-10-03T19:13:39.927331+0000 b3 1=1+0) (iversion lock) 0x55cf6231e000] 2023-10-03T19:20:54.484 INFO:teuthology.orchestra.run.smithi045.stdout: -4469> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_474 [2,head] auth (dversion lock) v=4554 ino=0x100000003cf state=1073741824 0x55cf6231b180] [inode 0x100000003cf [2,head] /dc-dir/dc-file_474 auth v4554 s=3 n(v0 rc2023-10-03T19:13:39.927331+0000 b3 1=1+0) (iversion lock) 0x55cf6231e000] 2023-10-03T19:20:54.484 INFO:teuthology.orchestra.run.smithi045.stdout: -4468> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003cf [2,head] #100000003cf auth v4554 s=3 n(v0 rc2023-10-03T19:13:39.927331+0000 b3 1=1+0) (iversion lock) 0x55cf6231e000] 2023-10-03T19:20:54.484 INFO:teuthology.orchestra.run.smithi045.stdout: -4467> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_474 [2,head] auth NULL (dversion lock) v=4554 ino=(nil) state=1073741824 0x55cf6231b180] 2023-10-03T19:20:54.485 INFO:teuthology.orchestra.run.smithi045.stdout: -4466> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_473 [2,head] auth (dversion lock) v=4552 ino=0x100000003ce state=1073741824 0x55cf6231af00] 2023-10-03T19:20:54.485 INFO:teuthology.orchestra.run.smithi045.stdout: -4465> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.485 INFO:teuthology.orchestra.run.smithi045.stdout: -4464> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003ce [2,head] /dc-dir/dc-file_473 auth v4552 s=3 n(v0 rc2023-10-03T19:13:39.915243+0000 b3 1=1+0) (iversion lock) 0x55cf62317700] 2023-10-03T19:20:54.485 INFO:teuthology.orchestra.run.smithi045.stdout: -4463> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_473 [2,head] auth (dversion lock) v=4552 ino=0x100000003ce state=1073741824 0x55cf6231af00] [inode 0x100000003ce [2,head] /dc-dir/dc-file_473 auth v4552 s=3 n(v0 rc2023-10-03T19:13:39.915243+0000 b3 1=1+0) (iversion lock) 0x55cf62317700] 2023-10-03T19:20:54.485 INFO:teuthology.orchestra.run.smithi045.stdout: -4462> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003ce [2,head] #100000003ce auth v4552 s=3 n(v0 rc2023-10-03T19:13:39.915243+0000 b3 1=1+0) (iversion lock) 0x55cf62317700] 2023-10-03T19:20:54.486 INFO:teuthology.orchestra.run.smithi045.stdout: -4461> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_473 [2,head] auth NULL (dversion lock) v=4552 ino=(nil) state=1073741824 0x55cf6231af00] 2023-10-03T19:20:54.486 INFO:teuthology.orchestra.run.smithi045.stdout: -4460> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_472 [2,head] auth (dversion lock) v=4550 ino=0x100000003cd state=1073741824 0x55cf6231ac80] 2023-10-03T19:20:54.486 INFO:teuthology.orchestra.run.smithi045.stdout: -4459> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.486 INFO:teuthology.orchestra.run.smithi045.stdout: -4458> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003cd [2,head] /dc-dir/dc-file_472 auth v4550 s=3 n(v0 rc2023-10-03T19:13:39.903207+0000 b3 1=1+0) (iversion lock) 0x55cf62317180] 2023-10-03T19:20:54.486 INFO:teuthology.orchestra.run.smithi045.stdout: -4457> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_472 [2,head] auth (dversion lock) v=4550 ino=0x100000003cd state=1073741824 0x55cf6231ac80] [inode 0x100000003cd [2,head] /dc-dir/dc-file_472 auth v4550 s=3 n(v0 rc2023-10-03T19:13:39.903207+0000 b3 1=1+0) (iversion lock) 0x55cf62317180] 2023-10-03T19:20:54.487 INFO:teuthology.orchestra.run.smithi045.stdout: -4456> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003cd [2,head] #100000003cd auth v4550 s=3 n(v0 rc2023-10-03T19:13:39.903207+0000 b3 1=1+0) (iversion lock) 0x55cf62317180] 2023-10-03T19:20:54.487 INFO:teuthology.orchestra.run.smithi045.stdout: -4455> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_472 [2,head] auth NULL (dversion lock) v=4550 ino=(nil) state=1073741824 0x55cf6231ac80] 2023-10-03T19:20:54.487 INFO:teuthology.orchestra.run.smithi045.stdout: -4454> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_471 [2,head] auth (dversion lock) v=4548 ino=0x100000003cc state=1073741824 0x55cf6231aa00] 2023-10-03T19:20:54.487 INFO:teuthology.orchestra.run.smithi045.stdout: -4453> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.487 INFO:teuthology.orchestra.run.smithi045.stdout: -4452> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003cc [2,head] /dc-dir/dc-file_471 auth v4548 s=3 n(v0 rc2023-10-03T19:13:39.891988+0000 b3 1=1+0) (iversion lock) 0x55cf62316c00] 2023-10-03T19:20:54.488 INFO:teuthology.orchestra.run.smithi045.stdout: -4451> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_471 [2,head] auth (dversion lock) v=4548 ino=0x100000003cc state=1073741824 0x55cf6231aa00] [inode 0x100000003cc [2,head] /dc-dir/dc-file_471 auth v4548 s=3 n(v0 rc2023-10-03T19:13:39.891988+0000 b3 1=1+0) (iversion lock) 0x55cf62316c00] 2023-10-03T19:20:54.488 INFO:teuthology.orchestra.run.smithi045.stdout: -4450> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003cc [2,head] #100000003cc auth v4548 s=3 n(v0 rc2023-10-03T19:13:39.891988+0000 b3 1=1+0) (iversion lock) 0x55cf62316c00] 2023-10-03T19:20:54.488 INFO:teuthology.orchestra.run.smithi045.stdout: -4449> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_471 [2,head] auth NULL (dversion lock) v=4548 ino=(nil) state=1073741824 0x55cf6231aa00] 2023-10-03T19:20:54.488 INFO:teuthology.orchestra.run.smithi045.stdout: -4448> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_470 [2,head] auth (dversion lock) v=4546 ino=0x100000003cb state=1073741824 0x55cf6231a780] 2023-10-03T19:20:54.488 INFO:teuthology.orchestra.run.smithi045.stdout: -4447> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.488 INFO:teuthology.orchestra.run.smithi045.stdout: -4446> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003cb [2,head] /dc-dir/dc-file_470 auth v4546 s=3 n(v0 rc2023-10-03T19:13:39.880957+0000 b3 1=1+0) (iversion lock) 0x55cf62316680] 2023-10-03T19:20:54.489 INFO:teuthology.orchestra.run.smithi045.stdout: -4445> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_470 [2,head] auth (dversion lock) v=4546 ino=0x100000003cb state=1073741824 0x55cf6231a780] [inode 0x100000003cb [2,head] /dc-dir/dc-file_470 auth v4546 s=3 n(v0 rc2023-10-03T19:13:39.880957+0000 b3 1=1+0) (iversion lock) 0x55cf62316680] 2023-10-03T19:20:54.489 INFO:teuthology.orchestra.run.smithi045.stdout: -4444> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003cb [2,head] #100000003cb auth v4546 s=3 n(v0 rc2023-10-03T19:13:39.880957+0000 b3 1=1+0) (iversion lock) 0x55cf62316680] 2023-10-03T19:20:54.489 INFO:teuthology.orchestra.run.smithi045.stdout: -4443> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_470 [2,head] auth NULL (dversion lock) v=4546 ino=(nil) state=1073741824 0x55cf6231a780] 2023-10-03T19:20:54.489 INFO:teuthology.orchestra.run.smithi045.stdout: -4442> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_469 [2,head] auth (dversion lock) v=4544 ino=0x100000003ca state=1073741824 0x55cf6231a500] 2023-10-03T19:20:54.489 INFO:teuthology.orchestra.run.smithi045.stdout: -4441> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.490 INFO:teuthology.orchestra.run.smithi045.stdout: -4440> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003ca [2,head] /dc-dir/dc-file_469 auth v4544 s=3 n(v0 rc2023-10-03T19:13:39.869654+0000 b3 1=1+0) (iversion lock) 0x55cf62316100] 2023-10-03T19:20:54.490 INFO:teuthology.orchestra.run.smithi045.stdout: -4439> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_469 [2,head] auth (dversion lock) v=4544 ino=0x100000003ca state=1073741824 0x55cf6231a500] [inode 0x100000003ca [2,head] /dc-dir/dc-file_469 auth v4544 s=3 n(v0 rc2023-10-03T19:13:39.869654+0000 b3 1=1+0) (iversion lock) 0x55cf62316100] 2023-10-03T19:20:54.490 INFO:teuthology.orchestra.run.smithi045.stdout: -4438> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003ca [2,head] #100000003ca auth v4544 s=3 n(v0 rc2023-10-03T19:13:39.869654+0000 b3 1=1+0) (iversion lock) 0x55cf62316100] 2023-10-03T19:20:54.490 INFO:teuthology.orchestra.run.smithi045.stdout: -4437> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_469 [2,head] auth NULL (dversion lock) v=4544 ino=(nil) state=1073741824 0x55cf6231a500] 2023-10-03T19:20:54.491 INFO:teuthology.orchestra.run.smithi045.stdout: -4436> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_468 [2,head] auth (dversion lock) v=4542 ino=0x100000003c9 state=1073741824 0x55cf6231a280] 2023-10-03T19:20:54.491 INFO:teuthology.orchestra.run.smithi045.stdout: -4435> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.491 INFO:teuthology.orchestra.run.smithi045.stdout: -4434> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003c9 [2,head] /dc-dir/dc-file_468 auth v4542 s=3 n(v0 rc2023-10-03T19:13:39.858672+0000 b3 1=1+0) (iversion lock) 0x55cf62315b80] 2023-10-03T19:20:54.491 INFO:teuthology.orchestra.run.smithi045.stdout: -4433> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_468 [2,head] auth (dversion lock) v=4542 ino=0x100000003c9 state=1073741824 0x55cf6231a280] [inode 0x100000003c9 [2,head] /dc-dir/dc-file_468 auth v4542 s=3 n(v0 rc2023-10-03T19:13:39.858672+0000 b3 1=1+0) (iversion lock) 0x55cf62315b80] 2023-10-03T19:20:54.491 INFO:teuthology.orchestra.run.smithi045.stdout: -4432> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003c9 [2,head] #100000003c9 auth v4542 s=3 n(v0 rc2023-10-03T19:13:39.858672+0000 b3 1=1+0) (iversion lock) 0x55cf62315b80] 2023-10-03T19:20:54.491 INFO:teuthology.orchestra.run.smithi045.stdout: -4431> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_468 [2,head] auth NULL (dversion lock) v=4542 ino=(nil) state=1073741824 0x55cf6231a280] 2023-10-03T19:20:54.492 INFO:teuthology.orchestra.run.smithi045.stdout: -4430> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_467 [2,head] auth (dversion lock) v=4540 ino=0x100000003c8 state=1073741824 0x55cf6231a000] 2023-10-03T19:20:54.492 INFO:teuthology.orchestra.run.smithi045.stdout: -4429> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.492 INFO:teuthology.orchestra.run.smithi045.stdout: -4428> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003c8 [2,head] /dc-dir/dc-file_467 auth v4540 s=3 n(v0 rc2023-10-03T19:13:39.847084+0000 b3 1=1+0) (iversion lock) 0x55cf62315600] 2023-10-03T19:20:54.492 INFO:teuthology.orchestra.run.smithi045.stdout: -4427> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_467 [2,head] auth (dversion lock) v=4540 ino=0x100000003c8 state=1073741824 0x55cf6231a000] [inode 0x100000003c8 [2,head] /dc-dir/dc-file_467 auth v4540 s=3 n(v0 rc2023-10-03T19:13:39.847084+0000 b3 1=1+0) (iversion lock) 0x55cf62315600] 2023-10-03T19:20:54.492 INFO:teuthology.orchestra.run.smithi045.stdout: -4426> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003c8 [2,head] #100000003c8 auth v4540 s=3 n(v0 rc2023-10-03T19:13:39.847084+0000 b3 1=1+0) (iversion lock) 0x55cf62315600] 2023-10-03T19:20:54.493 INFO:teuthology.orchestra.run.smithi045.stdout: -4425> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_467 [2,head] auth NULL (dversion lock) v=4540 ino=(nil) state=1073741824 0x55cf6231a000] 2023-10-03T19:20:54.493 INFO:teuthology.orchestra.run.smithi045.stdout: -4424> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_466 [2,head] auth (dversion lock) v=4538 ino=0x100000003c7 state=1073741824 0x55cf6230bb80] 2023-10-03T19:20:54.493 INFO:teuthology.orchestra.run.smithi045.stdout: -4423> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.493 INFO:teuthology.orchestra.run.smithi045.stdout: -4422> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003c7 [2,head] /dc-dir/dc-file_466 auth v4538 s=3 n(v0 rc2023-10-03T19:13:39.833468+0000 b3 1=1+0) (iversion lock) 0x55cf62315080] 2023-10-03T19:20:54.493 INFO:teuthology.orchestra.run.smithi045.stdout: -4421> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_466 [2,head] auth (dversion lock) v=4538 ino=0x100000003c7 state=1073741824 0x55cf6230bb80] [inode 0x100000003c7 [2,head] /dc-dir/dc-file_466 auth v4538 s=3 n(v0 rc2023-10-03T19:13:39.833468+0000 b3 1=1+0) (iversion lock) 0x55cf62315080] 2023-10-03T19:20:54.494 INFO:teuthology.orchestra.run.smithi045.stdout: -4420> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003c7 [2,head] #100000003c7 auth v4538 s=3 n(v0 rc2023-10-03T19:13:39.833468+0000 b3 1=1+0) (iversion lock) 0x55cf62315080] 2023-10-03T19:20:54.494 INFO:teuthology.orchestra.run.smithi045.stdout: -4419> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_466 [2,head] auth NULL (dversion lock) v=4538 ino=(nil) state=1073741824 0x55cf6230bb80] 2023-10-03T19:20:54.494 INFO:teuthology.orchestra.run.smithi045.stdout: -4418> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_465 [2,head] auth (dversion lock) v=4536 ino=0x100000003c6 state=1073741824 0x55cf6230b900] 2023-10-03T19:20:54.494 INFO:teuthology.orchestra.run.smithi045.stdout: -4417> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.494 INFO:teuthology.orchestra.run.smithi045.stdout: -4416> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003c6 [2,head] /dc-dir/dc-file_465 auth v4536 s=3 n(v0 rc2023-10-03T19:13:39.820667+0000 b3 1=1+0) (iversion lock) 0x55cf62314b00] 2023-10-03T19:20:54.495 INFO:teuthology.orchestra.run.smithi045.stdout: -4415> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_465 [2,head] auth (dversion lock) v=4536 ino=0x100000003c6 state=1073741824 0x55cf6230b900] [inode 0x100000003c6 [2,head] /dc-dir/dc-file_465 auth v4536 s=3 n(v0 rc2023-10-03T19:13:39.820667+0000 b3 1=1+0) (iversion lock) 0x55cf62314b00] 2023-10-03T19:20:54.495 INFO:teuthology.orchestra.run.smithi045.stdout: -4414> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003c6 [2,head] #100000003c6 auth v4536 s=3 n(v0 rc2023-10-03T19:13:39.820667+0000 b3 1=1+0) (iversion lock) 0x55cf62314b00] 2023-10-03T19:20:54.495 INFO:teuthology.orchestra.run.smithi045.stdout: -4413> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_465 [2,head] auth NULL (dversion lock) v=4536 ino=(nil) state=1073741824 0x55cf6230b900] 2023-10-03T19:20:54.495 INFO:teuthology.orchestra.run.smithi045.stdout: -4412> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_464 [2,head] auth (dversion lock) v=4534 ino=0x100000003c5 state=1073741824 0x55cf6230b680] 2023-10-03T19:20:54.495 INFO:teuthology.orchestra.run.smithi045.stdout: -4411> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.496 INFO:teuthology.orchestra.run.smithi045.stdout: -4410> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003c5 [2,head] /dc-dir/dc-file_464 auth v4534 s=3 n(v0 rc2023-10-03T19:13:39.809269+0000 b3 1=1+0) (iversion lock) 0x55cf62314580] 2023-10-03T19:20:54.496 INFO:teuthology.orchestra.run.smithi045.stdout: -4409> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_464 [2,head] auth (dversion lock) v=4534 ino=0x100000003c5 state=1073741824 0x55cf6230b680] [inode 0x100000003c5 [2,head] /dc-dir/dc-file_464 auth v4534 s=3 n(v0 rc2023-10-03T19:13:39.809269+0000 b3 1=1+0) (iversion lock) 0x55cf62314580] 2023-10-03T19:20:54.496 INFO:teuthology.orchestra.run.smithi045.stdout: -4408> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003c5 [2,head] #100000003c5 auth v4534 s=3 n(v0 rc2023-10-03T19:13:39.809269+0000 b3 1=1+0) (iversion lock) 0x55cf62314580] 2023-10-03T19:20:54.496 INFO:teuthology.orchestra.run.smithi045.stdout: -4407> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_464 [2,head] auth NULL (dversion lock) v=4534 ino=(nil) state=1073741824 0x55cf6230b680] 2023-10-03T19:20:54.497 INFO:teuthology.orchestra.run.smithi045.stdout: -4406> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_463 [2,head] auth (dversion lock) v=4532 ino=0x100000003c4 state=1073741824 0x55cf6230b400] 2023-10-03T19:20:54.497 INFO:teuthology.orchestra.run.smithi045.stdout: -4405> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.497 INFO:teuthology.orchestra.run.smithi045.stdout: -4404> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003c4 [2,head] /dc-dir/dc-file_463 auth v4532 s=3 n(v0 rc2023-10-03T19:13:39.798165+0000 b3 1=1+0) (iversion lock) 0x55cf62314000] 2023-10-03T19:20:54.497 INFO:teuthology.orchestra.run.smithi045.stdout: -4403> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_463 [2,head] auth (dversion lock) v=4532 ino=0x100000003c4 state=1073741824 0x55cf6230b400] [inode 0x100000003c4 [2,head] /dc-dir/dc-file_463 auth v4532 s=3 n(v0 rc2023-10-03T19:13:39.798165+0000 b3 1=1+0) (iversion lock) 0x55cf62314000] 2023-10-03T19:20:54.497 INFO:teuthology.orchestra.run.smithi045.stdout: -4402> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003c4 [2,head] #100000003c4 auth v4532 s=3 n(v0 rc2023-10-03T19:13:39.798165+0000 b3 1=1+0) (iversion lock) 0x55cf62314000] 2023-10-03T19:20:54.498 INFO:teuthology.orchestra.run.smithi045.stdout: -4401> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_463 [2,head] auth NULL (dversion lock) v=4532 ino=(nil) state=1073741824 0x55cf6230b400] 2023-10-03T19:20:54.498 INFO:teuthology.orchestra.run.smithi045.stdout: -4400> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_462 [2,head] auth (dversion lock) v=4530 ino=0x100000003c3 state=1073741824 0x55cf6230b180] 2023-10-03T19:20:54.498 INFO:teuthology.orchestra.run.smithi045.stdout: -4399> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.498 INFO:teuthology.orchestra.run.smithi045.stdout: -4398> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003c3 [2,head] /dc-dir/dc-file_462 auth v4530 s=3 n(v0 rc2023-10-03T19:13:39.787531+0000 b3 1=1+0) (iversion lock) 0x55cf62309700] 2023-10-03T19:20:54.498 INFO:teuthology.orchestra.run.smithi045.stdout: -4397> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_462 [2,head] auth (dversion lock) v=4530 ino=0x100000003c3 state=1073741824 0x55cf6230b180] [inode 0x100000003c3 [2,head] /dc-dir/dc-file_462 auth v4530 s=3 n(v0 rc2023-10-03T19:13:39.787531+0000 b3 1=1+0) (iversion lock) 0x55cf62309700] 2023-10-03T19:20:54.499 INFO:teuthology.orchestra.run.smithi045.stdout: -4396> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003c3 [2,head] #100000003c3 auth v4530 s=3 n(v0 rc2023-10-03T19:13:39.787531+0000 b3 1=1+0) (iversion lock) 0x55cf62309700] 2023-10-03T19:20:54.499 INFO:teuthology.orchestra.run.smithi045.stdout: -4395> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_462 [2,head] auth NULL (dversion lock) v=4530 ino=(nil) state=1073741824 0x55cf6230b180] 2023-10-03T19:20:54.499 INFO:teuthology.orchestra.run.smithi045.stdout: -4394> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_461 [2,head] auth (dversion lock) v=4528 ino=0x100000003c2 state=1073741824 0x55cf6230af00] 2023-10-03T19:20:54.499 INFO:teuthology.orchestra.run.smithi045.stdout: -4393> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.499 INFO:teuthology.orchestra.run.smithi045.stdout: -4392> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003c2 [2,head] /dc-dir/dc-file_461 auth v4528 s=3 n(v0 rc2023-10-03T19:13:39.775098+0000 b3 1=1+0) (iversion lock) 0x55cf62309180] 2023-10-03T19:20:54.500 INFO:teuthology.orchestra.run.smithi045.stdout: -4391> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_461 [2,head] auth (dversion lock) v=4528 ino=0x100000003c2 state=1073741824 0x55cf6230af00] [inode 0x100000003c2 [2,head] /dc-dir/dc-file_461 auth v4528 s=3 n(v0 rc2023-10-03T19:13:39.775098+0000 b3 1=1+0) (iversion lock) 0x55cf62309180] 2023-10-03T19:20:54.500 INFO:teuthology.orchestra.run.smithi045.stdout: -4390> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003c2 [2,head] #100000003c2 auth v4528 s=3 n(v0 rc2023-10-03T19:13:39.775098+0000 b3 1=1+0) (iversion lock) 0x55cf62309180] 2023-10-03T19:20:54.500 INFO:teuthology.orchestra.run.smithi045.stdout: -4389> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_461 [2,head] auth NULL (dversion lock) v=4528 ino=(nil) state=1073741824 0x55cf6230af00] 2023-10-03T19:20:54.500 INFO:teuthology.orchestra.run.smithi045.stdout: -4388> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_460 [2,head] auth (dversion lock) v=4526 ino=0x100000003c1 state=1073741824 0x55cf6230ac80] 2023-10-03T19:20:54.500 INFO:teuthology.orchestra.run.smithi045.stdout: -4387> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.501 INFO:teuthology.orchestra.run.smithi045.stdout: -4386> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003c1 [2,head] /dc-dir/dc-file_460 auth v4526 s=3 n(v0 rc2023-10-03T19:13:39.763050+0000 b3 1=1+0) (iversion lock) 0x55cf62308c00] 2023-10-03T19:20:54.501 INFO:teuthology.orchestra.run.smithi045.stdout: -4385> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_460 [2,head] auth (dversion lock) v=4526 ino=0x100000003c1 state=1073741824 0x55cf6230ac80] [inode 0x100000003c1 [2,head] /dc-dir/dc-file_460 auth v4526 s=3 n(v0 rc2023-10-03T19:13:39.763050+0000 b3 1=1+0) (iversion lock) 0x55cf62308c00] 2023-10-03T19:20:54.501 INFO:teuthology.orchestra.run.smithi045.stdout: -4384> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003c1 [2,head] #100000003c1 auth v4526 s=3 n(v0 rc2023-10-03T19:13:39.763050+0000 b3 1=1+0) (iversion lock) 0x55cf62308c00] 2023-10-03T19:20:54.501 INFO:teuthology.orchestra.run.smithi045.stdout: -4383> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_460 [2,head] auth NULL (dversion lock) v=4526 ino=(nil) state=1073741824 0x55cf6230ac80] 2023-10-03T19:20:54.501 INFO:teuthology.orchestra.run.smithi045.stdout: -4382> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_459 [2,head] auth (dversion lock) v=4524 ino=0x100000003c0 state=1073741824 0x55cf6230aa00] 2023-10-03T19:20:54.502 INFO:teuthology.orchestra.run.smithi045.stdout: -4381> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.502 INFO:teuthology.orchestra.run.smithi045.stdout: -4380> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003c0 [2,head] /dc-dir/dc-file_459 auth v4524 s=3 n(v0 rc2023-10-03T19:13:39.751580+0000 b3 1=1+0) (iversion lock) 0x55cf62308680] 2023-10-03T19:20:54.502 INFO:teuthology.orchestra.run.smithi045.stdout: -4379> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_459 [2,head] auth (dversion lock) v=4524 ino=0x100000003c0 state=1073741824 0x55cf6230aa00] [inode 0x100000003c0 [2,head] /dc-dir/dc-file_459 auth v4524 s=3 n(v0 rc2023-10-03T19:13:39.751580+0000 b3 1=1+0) (iversion lock) 0x55cf62308680] 2023-10-03T19:20:54.502 INFO:teuthology.orchestra.run.smithi045.stdout: -4378> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003c0 [2,head] #100000003c0 auth v4524 s=3 n(v0 rc2023-10-03T19:13:39.751580+0000 b3 1=1+0) (iversion lock) 0x55cf62308680] 2023-10-03T19:20:54.502 INFO:teuthology.orchestra.run.smithi045.stdout: -4377> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_459 [2,head] auth NULL (dversion lock) v=4524 ino=(nil) state=1073741824 0x55cf6230aa00] 2023-10-03T19:20:54.503 INFO:teuthology.orchestra.run.smithi045.stdout: -4376> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_458 [2,head] auth (dversion lock) v=4522 ino=0x100000003bf state=1073741824 0x55cf6230a780] 2023-10-03T19:20:54.503 INFO:teuthology.orchestra.run.smithi045.stdout: -4375> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.503 INFO:teuthology.orchestra.run.smithi045.stdout: -4374> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003bf [2,head] /dc-dir/dc-file_458 auth v4522 s=3 n(v0 rc2023-10-03T19:13:39.740269+0000 b3 1=1+0) (iversion lock) 0x55cf62308100] 2023-10-03T19:20:54.503 INFO:teuthology.orchestra.run.smithi045.stdout: -4373> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_458 [2,head] auth (dversion lock) v=4522 ino=0x100000003bf state=1073741824 0x55cf6230a780] [inode 0x100000003bf [2,head] /dc-dir/dc-file_458 auth v4522 s=3 n(v0 rc2023-10-03T19:13:39.740269+0000 b3 1=1+0) (iversion lock) 0x55cf62308100] 2023-10-03T19:20:54.503 INFO:teuthology.orchestra.run.smithi045.stdout: -4372> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003bf [2,head] #100000003bf auth v4522 s=3 n(v0 rc2023-10-03T19:13:39.740269+0000 b3 1=1+0) (iversion lock) 0x55cf62308100] 2023-10-03T19:20:54.504 INFO:teuthology.orchestra.run.smithi045.stdout: -4371> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_458 [2,head] auth NULL (dversion lock) v=4522 ino=(nil) state=1073741824 0x55cf6230a780] 2023-10-03T19:20:54.504 INFO:teuthology.orchestra.run.smithi045.stdout: -4370> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_457 [2,head] auth (dversion lock) v=4520 ino=0x100000003be state=1073741824 0x55cf6230a500] 2023-10-03T19:20:54.504 INFO:teuthology.orchestra.run.smithi045.stdout: -4369> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.504 INFO:teuthology.orchestra.run.smithi045.stdout: -4368> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003be [2,head] /dc-dir/dc-file_457 auth v4520 s=3 n(v0 rc2023-10-03T19:13:39.729313+0000 b3 1=1+0) (iversion lock) 0x55cf62307b80] 2023-10-03T19:20:54.504 INFO:teuthology.orchestra.run.smithi045.stdout: -4367> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_457 [2,head] auth (dversion lock) v=4520 ino=0x100000003be state=1073741824 0x55cf6230a500] [inode 0x100000003be [2,head] /dc-dir/dc-file_457 auth v4520 s=3 n(v0 rc2023-10-03T19:13:39.729313+0000 b3 1=1+0) (iversion lock) 0x55cf62307b80] 2023-10-03T19:20:54.505 INFO:teuthology.orchestra.run.smithi045.stdout: -4366> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003be [2,head] #100000003be auth v4520 s=3 n(v0 rc2023-10-03T19:13:39.729313+0000 b3 1=1+0) (iversion lock) 0x55cf62307b80] 2023-10-03T19:20:54.505 INFO:teuthology.orchestra.run.smithi045.stdout: -4365> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_457 [2,head] auth NULL (dversion lock) v=4520 ino=(nil) state=1073741824 0x55cf6230a500] 2023-10-03T19:20:54.624 INFO:teuthology.orchestra.run.smithi045.stdout: -4364> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_456 [2,head] auth (dversion lock) v=4518 ino=0x100000003bd state=1073741824 0x55cf6230a280] 2023-10-03T19:20:54.624 INFO:teuthology.orchestra.run.smithi045.stdout: -4363> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.625 INFO:teuthology.orchestra.run.smithi045.stdout: -4362> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003bd [2,head] /dc-dir/dc-file_456 auth v4518 s=3 n(v0 rc2023-10-03T19:13:39.718344+0000 b3 1=1+0) (iversion lock) 0x55cf62307600] 2023-10-03T19:20:54.625 INFO:teuthology.orchestra.run.smithi045.stdout: -4361> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_456 [2,head] auth (dversion lock) v=4518 ino=0x100000003bd state=1073741824 0x55cf6230a280] [inode 0x100000003bd [2,head] /dc-dir/dc-file_456 auth v4518 s=3 n(v0 rc2023-10-03T19:13:39.718344+0000 b3 1=1+0) (iversion lock) 0x55cf62307600] 2023-10-03T19:20:54.625 INFO:teuthology.orchestra.run.smithi045.stdout: -4360> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003bd [2,head] #100000003bd auth v4518 s=3 n(v0 rc2023-10-03T19:13:39.718344+0000 b3 1=1+0) (iversion lock) 0x55cf62307600] 2023-10-03T19:20:54.625 INFO:teuthology.orchestra.run.smithi045.stdout: -4359> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_456 [2,head] auth NULL (dversion lock) v=4518 ino=(nil) state=1073741824 0x55cf6230a280] 2023-10-03T19:20:54.625 INFO:teuthology.orchestra.run.smithi045.stdout: -4358> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_455 [2,head] auth (dversion lock) v=4516 ino=0x100000003bc state=1073741824 0x55cf6230a000] 2023-10-03T19:20:54.625 INFO:teuthology.orchestra.run.smithi045.stdout: -4357> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.625 INFO:teuthology.orchestra.run.smithi045.stdout: -4356> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003bc [2,head] /dc-dir/dc-file_455 auth v4516 s=3 n(v0 rc2023-10-03T19:13:39.706001+0000 b3 1=1+0) (iversion lock) 0x55cf62307080] 2023-10-03T19:20:54.625 INFO:teuthology.orchestra.run.smithi045.stdout: -4355> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_455 [2,head] auth (dversion lock) v=4516 ino=0x100000003bc state=1073741824 0x55cf6230a000] [inode 0x100000003bc [2,head] /dc-dir/dc-file_455 auth v4516 s=3 n(v0 rc2023-10-03T19:13:39.706001+0000 b3 1=1+0) (iversion lock) 0x55cf62307080] 2023-10-03T19:20:54.625 INFO:teuthology.orchestra.run.smithi045.stdout: -4354> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003bc [2,head] #100000003bc auth v4516 s=3 n(v0 rc2023-10-03T19:13:39.706001+0000 b3 1=1+0) (iversion lock) 0x55cf62307080] 2023-10-03T19:20:54.625 INFO:teuthology.orchestra.run.smithi045.stdout: -4353> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_455 [2,head] auth NULL (dversion lock) v=4516 ino=(nil) state=1073741824 0x55cf6230a000] 2023-10-03T19:20:54.626 INFO:teuthology.orchestra.run.smithi045.stdout: -4352> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_454 [2,head] auth (dversion lock) v=4514 ino=0x100000003bb state=1073741824 0x55cf622ffb80] 2023-10-03T19:20:54.626 INFO:teuthology.orchestra.run.smithi045.stdout: -4351> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.626 INFO:teuthology.orchestra.run.smithi045.stdout: -4350> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003bb [2,head] /dc-dir/dc-file_454 auth v4514 s=3 n(v0 rc2023-10-03T19:13:39.694828+0000 b3 1=1+0) (iversion lock) 0x55cf62306b00] 2023-10-03T19:20:54.626 INFO:teuthology.orchestra.run.smithi045.stdout: -4349> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_454 [2,head] auth (dversion lock) v=4514 ino=0x100000003bb state=1073741824 0x55cf622ffb80] [inode 0x100000003bb [2,head] /dc-dir/dc-file_454 auth v4514 s=3 n(v0 rc2023-10-03T19:13:39.694828+0000 b3 1=1+0) (iversion lock) 0x55cf62306b00] 2023-10-03T19:20:54.626 INFO:teuthology.orchestra.run.smithi045.stdout: -4348> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003bb [2,head] #100000003bb auth v4514 s=3 n(v0 rc2023-10-03T19:13:39.694828+0000 b3 1=1+0) (iversion lock) 0x55cf62306b00] 2023-10-03T19:20:54.626 INFO:teuthology.orchestra.run.smithi045.stdout: -4347> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_454 [2,head] auth NULL (dversion lock) v=4514 ino=(nil) state=1073741824 0x55cf622ffb80] 2023-10-03T19:20:54.626 INFO:teuthology.orchestra.run.smithi045.stdout: -4346> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_453 [2,head] auth (dversion lock) v=4512 ino=0x100000003ba state=1073741824 0x55cf622ff900] 2023-10-03T19:20:54.626 INFO:teuthology.orchestra.run.smithi045.stdout: -4345> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.626 INFO:teuthology.orchestra.run.smithi045.stdout: -4344> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003ba [2,head] /dc-dir/dc-file_453 auth v4512 s=3 n(v0 rc2023-10-03T19:13:39.683268+0000 b3 1=1+0) (iversion lock) 0x55cf62306580] 2023-10-03T19:20:54.627 INFO:teuthology.orchestra.run.smithi045.stdout: -4343> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_453 [2,head] auth (dversion lock) v=4512 ino=0x100000003ba state=1073741824 0x55cf622ff900] [inode 0x100000003ba [2,head] /dc-dir/dc-file_453 auth v4512 s=3 n(v0 rc2023-10-03T19:13:39.683268+0000 b3 1=1+0) (iversion lock) 0x55cf62306580] 2023-10-03T19:20:54.627 INFO:teuthology.orchestra.run.smithi045.stdout: -4342> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003ba [2,head] #100000003ba auth v4512 s=3 n(v0 rc2023-10-03T19:13:39.683268+0000 b3 1=1+0) (iversion lock) 0x55cf62306580] 2023-10-03T19:20:54.627 INFO:teuthology.orchestra.run.smithi045.stdout: -4341> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_453 [2,head] auth NULL (dversion lock) v=4512 ino=(nil) state=1073741824 0x55cf622ff900] 2023-10-03T19:20:54.627 INFO:teuthology.orchestra.run.smithi045.stdout: -4340> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_452 [2,head] auth (dversion lock) v=4510 ino=0x100000003b9 state=1073741824 0x55cf622ff680] 2023-10-03T19:20:54.627 INFO:teuthology.orchestra.run.smithi045.stdout: -4339> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.627 INFO:teuthology.orchestra.run.smithi045.stdout: -4338> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003b9 [2,head] /dc-dir/dc-file_452 auth v4510 s=3 n(v0 rc2023-10-03T19:13:39.671912+0000 b3 1=1+0) (iversion lock) 0x55cf62306000] 2023-10-03T19:20:54.627 INFO:teuthology.orchestra.run.smithi045.stdout: -4337> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_452 [2,head] auth (dversion lock) v=4510 ino=0x100000003b9 state=1073741824 0x55cf622ff680] [inode 0x100000003b9 [2,head] /dc-dir/dc-file_452 auth v4510 s=3 n(v0 rc2023-10-03T19:13:39.671912+0000 b3 1=1+0) (iversion lock) 0x55cf62306000] 2023-10-03T19:20:54.627 INFO:teuthology.orchestra.run.smithi045.stdout: -4336> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003b9 [2,head] #100000003b9 auth v4510 s=3 n(v0 rc2023-10-03T19:13:39.671912+0000 b3 1=1+0) (iversion lock) 0x55cf62306000] 2023-10-03T19:20:54.627 INFO:teuthology.orchestra.run.smithi045.stdout: -4335> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_452 [2,head] auth NULL (dversion lock) v=4510 ino=(nil) state=1073741824 0x55cf622ff680] 2023-10-03T19:20:54.627 INFO:teuthology.orchestra.run.smithi045.stdout: -4334> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_451 [2,head] auth (dversion lock) v=4508 ino=0x100000003b8 state=1073741824 0x55cf622ff400] 2023-10-03T19:20:54.627 INFO:teuthology.orchestra.run.smithi045.stdout: -4333> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.628 INFO:teuthology.orchestra.run.smithi045.stdout: -4332> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003b8 [2,head] /dc-dir/dc-file_451 auth v4508 s=3 n(v0 rc2023-10-03T19:13:39.661214+0000 b3 1=1+0) (iversion lock) 0x55cf622fd700] 2023-10-03T19:20:54.628 INFO:teuthology.orchestra.run.smithi045.stdout: -4331> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_451 [2,head] auth (dversion lock) v=4508 ino=0x100000003b8 state=1073741824 0x55cf622ff400] [inode 0x100000003b8 [2,head] /dc-dir/dc-file_451 auth v4508 s=3 n(v0 rc2023-10-03T19:13:39.661214+0000 b3 1=1+0) (iversion lock) 0x55cf622fd700] 2023-10-03T19:20:54.628 INFO:teuthology.orchestra.run.smithi045.stdout: -4330> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003b8 [2,head] #100000003b8 auth v4508 s=3 n(v0 rc2023-10-03T19:13:39.661214+0000 b3 1=1+0) (iversion lock) 0x55cf622fd700] 2023-10-03T19:20:54.628 INFO:teuthology.orchestra.run.smithi045.stdout: -4329> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_451 [2,head] auth NULL (dversion lock) v=4508 ino=(nil) state=1073741824 0x55cf622ff400] 2023-10-03T19:20:54.628 INFO:teuthology.orchestra.run.smithi045.stdout: -4328> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_450 [2,head] auth (dversion lock) v=4506 ino=0x100000003b7 state=1073741824 0x55cf622ff180] 2023-10-03T19:20:54.628 INFO:teuthology.orchestra.run.smithi045.stdout: -4327> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.628 INFO:teuthology.orchestra.run.smithi045.stdout: -4326> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003b7 [2,head] /dc-dir/dc-file_450 auth v4506 s=3 n(v0 rc2023-10-03T19:13:39.649968+0000 b3 1=1+0) (iversion lock) 0x55cf622fd180] 2023-10-03T19:20:54.628 INFO:teuthology.orchestra.run.smithi045.stdout: -4325> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_450 [2,head] auth (dversion lock) v=4506 ino=0x100000003b7 state=1073741824 0x55cf622ff180] [inode 0x100000003b7 [2,head] /dc-dir/dc-file_450 auth v4506 s=3 n(v0 rc2023-10-03T19:13:39.649968+0000 b3 1=1+0) (iversion lock) 0x55cf622fd180] 2023-10-03T19:20:54.628 INFO:teuthology.orchestra.run.smithi045.stdout: -4324> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003b7 [2,head] #100000003b7 auth v4506 s=3 n(v0 rc2023-10-03T19:13:39.649968+0000 b3 1=1+0) (iversion lock) 0x55cf622fd180] 2023-10-03T19:20:54.628 INFO:teuthology.orchestra.run.smithi045.stdout: -4323> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_450 [2,head] auth NULL (dversion lock) v=4506 ino=(nil) state=1073741824 0x55cf622ff180] 2023-10-03T19:20:54.628 INFO:teuthology.orchestra.run.smithi045.stdout: -4322> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_449 [2,head] auth (dversion lock) v=4504 ino=0x100000003b6 state=1073741824 0x55cf622fef00] 2023-10-03T19:20:54.629 INFO:teuthology.orchestra.run.smithi045.stdout: -4321> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.629 INFO:teuthology.orchestra.run.smithi045.stdout: -4320> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003b6 [2,head] /dc-dir/dc-file_449 auth v4504 s=3 n(v0 rc2023-10-03T19:13:39.638917+0000 b3 1=1+0) (iversion lock) 0x55cf622fcc00] 2023-10-03T19:20:54.629 INFO:teuthology.orchestra.run.smithi045.stdout: -4319> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_449 [2,head] auth (dversion lock) v=4504 ino=0x100000003b6 state=1073741824 0x55cf622fef00] [inode 0x100000003b6 [2,head] /dc-dir/dc-file_449 auth v4504 s=3 n(v0 rc2023-10-03T19:13:39.638917+0000 b3 1=1+0) (iversion lock) 0x55cf622fcc00] 2023-10-03T19:20:54.629 INFO:teuthology.orchestra.run.smithi045.stdout: -4318> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003b6 [2,head] #100000003b6 auth v4504 s=3 n(v0 rc2023-10-03T19:13:39.638917+0000 b3 1=1+0) (iversion lock) 0x55cf622fcc00] 2023-10-03T19:20:54.629 INFO:teuthology.orchestra.run.smithi045.stdout: -4317> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_449 [2,head] auth NULL (dversion lock) v=4504 ino=(nil) state=1073741824 0x55cf622fef00] 2023-10-03T19:20:54.629 INFO:teuthology.orchestra.run.smithi045.stdout: -4316> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_448 [2,head] auth (dversion lock) v=4502 ino=0x100000003b5 state=1073741824 0x55cf622fec80] 2023-10-03T19:20:54.629 INFO:teuthology.orchestra.run.smithi045.stdout: -4315> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.629 INFO:teuthology.orchestra.run.smithi045.stdout: -4314> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003b5 [2,head] /dc-dir/dc-file_448 auth v4502 s=3 n(v0 rc2023-10-03T19:13:39.627978+0000 b3 1=1+0) (iversion lock) 0x55cf622fc680] 2023-10-03T19:20:54.629 INFO:teuthology.orchestra.run.smithi045.stdout: -4313> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_448 [2,head] auth (dversion lock) v=4502 ino=0x100000003b5 state=1073741824 0x55cf622fec80] [inode 0x100000003b5 [2,head] /dc-dir/dc-file_448 auth v4502 s=3 n(v0 rc2023-10-03T19:13:39.627978+0000 b3 1=1+0) (iversion lock) 0x55cf622fc680] 2023-10-03T19:20:54.629 INFO:teuthology.orchestra.run.smithi045.stdout: -4312> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003b5 [2,head] #100000003b5 auth v4502 s=3 n(v0 rc2023-10-03T19:13:39.627978+0000 b3 1=1+0) (iversion lock) 0x55cf622fc680] 2023-10-03T19:20:54.630 INFO:teuthology.orchestra.run.smithi045.stdout: -4311> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_448 [2,head] auth NULL (dversion lock) v=4502 ino=(nil) state=1073741824 0x55cf622fec80] 2023-10-03T19:20:54.630 INFO:teuthology.orchestra.run.smithi045.stdout: -4310> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_447 [2,head] auth (dversion lock) v=4500 ino=0x100000003b4 state=1073741824 0x55cf622fea00] 2023-10-03T19:20:54.630 INFO:teuthology.orchestra.run.smithi045.stdout: -4309> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.630 INFO:teuthology.orchestra.run.smithi045.stdout: -4308> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003b4 [2,head] /dc-dir/dc-file_447 auth v4500 s=3 n(v0 rc2023-10-03T19:13:39.616558+0000 b3 1=1+0) (iversion lock) 0x55cf622fc100] 2023-10-03T19:20:54.630 INFO:teuthology.orchestra.run.smithi045.stdout: -4307> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_447 [2,head] auth (dversion lock) v=4500 ino=0x100000003b4 state=1073741824 0x55cf622fea00] [inode 0x100000003b4 [2,head] /dc-dir/dc-file_447 auth v4500 s=3 n(v0 rc2023-10-03T19:13:39.616558+0000 b3 1=1+0) (iversion lock) 0x55cf622fc100] 2023-10-03T19:20:54.630 INFO:teuthology.orchestra.run.smithi045.stdout: -4306> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003b4 [2,head] #100000003b4 auth v4500 s=3 n(v0 rc2023-10-03T19:13:39.616558+0000 b3 1=1+0) (iversion lock) 0x55cf622fc100] 2023-10-03T19:20:54.630 INFO:teuthology.orchestra.run.smithi045.stdout: -4305> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_447 [2,head] auth NULL (dversion lock) v=4500 ino=(nil) state=1073741824 0x55cf622fea00] 2023-10-03T19:20:54.630 INFO:teuthology.orchestra.run.smithi045.stdout: -4304> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_446 [2,head] auth (dversion lock) v=4498 ino=0x100000003b3 state=1073741824 0x55cf622fe780] 2023-10-03T19:20:54.630 INFO:teuthology.orchestra.run.smithi045.stdout: -4303> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.630 INFO:teuthology.orchestra.run.smithi045.stdout: -4302> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003b3 [2,head] /dc-dir/dc-file_446 auth v4498 s=3 n(v0 rc2023-10-03T19:13:39.604959+0000 b3 1=1+0) (iversion lock) 0x55cf622fbb80] 2023-10-03T19:20:54.630 INFO:teuthology.orchestra.run.smithi045.stdout: -4301> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_446 [2,head] auth (dversion lock) v=4498 ino=0x100000003b3 state=1073741824 0x55cf622fe780] [inode 0x100000003b3 [2,head] /dc-dir/dc-file_446 auth v4498 s=3 n(v0 rc2023-10-03T19:13:39.604959+0000 b3 1=1+0) (iversion lock) 0x55cf622fbb80] 2023-10-03T19:20:54.631 INFO:teuthology.orchestra.run.smithi045.stdout: -4300> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003b3 [2,head] #100000003b3 auth v4498 s=3 n(v0 rc2023-10-03T19:13:39.604959+0000 b3 1=1+0) (iversion lock) 0x55cf622fbb80] 2023-10-03T19:20:54.636 INFO:teuthology.orchestra.run.smithi045.stdout: -4299> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_446 [2,head] auth NULL (dversion lock) v=4498 ino=(nil) state=1073741824 0x55cf622fe780] 2023-10-03T19:20:54.636 INFO:teuthology.orchestra.run.smithi045.stdout: -4298> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_445 [2,head] auth (dversion lock) v=4496 ino=0x100000003b2 state=1073741824 0x55cf622fe500] 2023-10-03T19:20:54.636 INFO:teuthology.orchestra.run.smithi045.stdout: -4297> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.636 INFO:teuthology.orchestra.run.smithi045.stdout: -4296> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003b2 [2,head] /dc-dir/dc-file_445 auth v4496 s=3 n(v0 rc2023-10-03T19:13:39.592179+0000 b3 1=1+0) (iversion lock) 0x55cf622fb600] 2023-10-03T19:20:54.636 INFO:teuthology.orchestra.run.smithi045.stdout: -4295> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_445 [2,head] auth (dversion lock) v=4496 ino=0x100000003b2 state=1073741824 0x55cf622fe500] [inode 0x100000003b2 [2,head] /dc-dir/dc-file_445 auth v4496 s=3 n(v0 rc2023-10-03T19:13:39.592179+0000 b3 1=1+0) (iversion lock) 0x55cf622fb600] 2023-10-03T19:20:54.637 INFO:teuthology.orchestra.run.smithi045.stdout: -4294> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003b2 [2,head] #100000003b2 auth v4496 s=3 n(v0 rc2023-10-03T19:13:39.592179+0000 b3 1=1+0) (iversion lock) 0x55cf622fb600] 2023-10-03T19:20:54.637 INFO:teuthology.orchestra.run.smithi045.stdout: -4293> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_445 [2,head] auth NULL (dversion lock) v=4496 ino=(nil) state=1073741824 0x55cf622fe500] 2023-10-03T19:20:54.637 INFO:teuthology.orchestra.run.smithi045.stdout: -4292> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_444 [2,head] auth (dversion lock) v=4494 ino=0x100000003b1 state=1073741824 0x55cf622fe280] 2023-10-03T19:20:54.637 INFO:teuthology.orchestra.run.smithi045.stdout: -4291> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.637 INFO:teuthology.orchestra.run.smithi045.stdout: -4290> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003b1 [2,head] /dc-dir/dc-file_444 auth v4494 s=3 n(v0 rc2023-10-03T19:13:39.581638+0000 b3 1=1+0) (iversion lock) 0x55cf622fb080] 2023-10-03T19:20:54.637 INFO:teuthology.orchestra.run.smithi045.stdout: -4289> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_444 [2,head] auth (dversion lock) v=4494 ino=0x100000003b1 state=1073741824 0x55cf622fe280] [inode 0x100000003b1 [2,head] /dc-dir/dc-file_444 auth v4494 s=3 n(v0 rc2023-10-03T19:13:39.581638+0000 b3 1=1+0) (iversion lock) 0x55cf622fb080] 2023-10-03T19:20:54.637 INFO:teuthology.orchestra.run.smithi045.stdout: -4288> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003b1 [2,head] #100000003b1 auth v4494 s=3 n(v0 rc2023-10-03T19:13:39.581638+0000 b3 1=1+0) (iversion lock) 0x55cf622fb080] 2023-10-03T19:20:54.637 INFO:teuthology.orchestra.run.smithi045.stdout: -4287> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_444 [2,head] auth NULL (dversion lock) v=4494 ino=(nil) state=1073741824 0x55cf622fe280] 2023-10-03T19:20:54.637 INFO:teuthology.orchestra.run.smithi045.stdout: -4286> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_443 [2,head] auth (dversion lock) v=4492 ino=0x100000003b0 state=1073741824 0x55cf622fe000] 2023-10-03T19:20:54.637 INFO:teuthology.orchestra.run.smithi045.stdout: -4285> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.637 INFO:teuthology.orchestra.run.smithi045.stdout: -4284> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003b0 [2,head] /dc-dir/dc-file_443 auth v4492 s=3 n(v0 rc2023-10-03T19:13:39.570983+0000 b3 1=1+0) (iversion lock) 0x55cf622fab00] 2023-10-03T19:20:54.638 INFO:teuthology.orchestra.run.smithi045.stdout: -4283> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_443 [2,head] auth (dversion lock) v=4492 ino=0x100000003b0 state=1073741824 0x55cf622fe000] [inode 0x100000003b0 [2,head] /dc-dir/dc-file_443 auth v4492 s=3 n(v0 rc2023-10-03T19:13:39.570983+0000 b3 1=1+0) (iversion lock) 0x55cf622fab00] 2023-10-03T19:20:54.638 INFO:teuthology.orchestra.run.smithi045.stdout: -4282> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003b0 [2,head] #100000003b0 auth v4492 s=3 n(v0 rc2023-10-03T19:13:39.570983+0000 b3 1=1+0) (iversion lock) 0x55cf622fab00] 2023-10-03T19:20:54.638 INFO:teuthology.orchestra.run.smithi045.stdout: -4281> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_443 [2,head] auth NULL (dversion lock) v=4492 ino=(nil) state=1073741824 0x55cf622fe000] 2023-10-03T19:20:54.638 INFO:teuthology.orchestra.run.smithi045.stdout: -4280> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_442 [2,head] auth (dversion lock) v=4490 ino=0x100000003af state=1073741824 0x55cf622efb80] 2023-10-03T19:20:54.638 INFO:teuthology.orchestra.run.smithi045.stdout: -4279> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.638 INFO:teuthology.orchestra.run.smithi045.stdout: -4278> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003af [2,head] /dc-dir/dc-file_442 auth v4490 s=3 n(v0 rc2023-10-03T19:13:39.559736+0000 b3 1=1+0) (iversion lock) 0x55cf622fa580] 2023-10-03T19:20:54.638 INFO:teuthology.orchestra.run.smithi045.stdout: -4277> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_442 [2,head] auth (dversion lock) v=4490 ino=0x100000003af state=1073741824 0x55cf622efb80] [inode 0x100000003af [2,head] /dc-dir/dc-file_442 auth v4490 s=3 n(v0 rc2023-10-03T19:13:39.559736+0000 b3 1=1+0) (iversion lock) 0x55cf622fa580] 2023-10-03T19:20:54.638 INFO:teuthology.orchestra.run.smithi045.stdout: -4276> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003af [2,head] #100000003af auth v4490 s=3 n(v0 rc2023-10-03T19:13:39.559736+0000 b3 1=1+0) (iversion lock) 0x55cf622fa580] 2023-10-03T19:20:54.638 INFO:teuthology.orchestra.run.smithi045.stdout: -4275> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_442 [2,head] auth NULL (dversion lock) v=4490 ino=(nil) state=1073741824 0x55cf622efb80] 2023-10-03T19:20:54.638 INFO:teuthology.orchestra.run.smithi045.stdout: -4274> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_441 [2,head] auth (dversion lock) v=4488 ino=0x100000003ae state=1073741824 0x55cf622ef900] 2023-10-03T19:20:54.638 INFO:teuthology.orchestra.run.smithi045.stdout: -4273> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.638 INFO:teuthology.orchestra.run.smithi045.stdout: -4272> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003ae [2,head] /dc-dir/dc-file_441 auth v4488 s=3 n(v0 rc2023-10-03T19:13:39.547274+0000 b3 1=1+0) (iversion lock) 0x55cf622fa000] 2023-10-03T19:20:54.639 INFO:teuthology.orchestra.run.smithi045.stdout: -4271> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_441 [2,head] auth (dversion lock) v=4488 ino=0x100000003ae state=1073741824 0x55cf622ef900] [inode 0x100000003ae [2,head] /dc-dir/dc-file_441 auth v4488 s=3 n(v0 rc2023-10-03T19:13:39.547274+0000 b3 1=1+0) (iversion lock) 0x55cf622fa000] 2023-10-03T19:20:54.639 INFO:teuthology.orchestra.run.smithi045.stdout: -4270> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003ae [2,head] #100000003ae auth v4488 s=3 n(v0 rc2023-10-03T19:13:39.547274+0000 b3 1=1+0) (iversion lock) 0x55cf622fa000] 2023-10-03T19:20:54.639 INFO:teuthology.orchestra.run.smithi045.stdout: -4269> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_441 [2,head] auth NULL (dversion lock) v=4488 ino=(nil) state=1073741824 0x55cf622ef900] 2023-10-03T19:20:54.639 INFO:teuthology.orchestra.run.smithi045.stdout: -4268> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_440 [2,head] auth (dversion lock) v=4486 ino=0x100000003ad state=1073741824 0x55cf622ef680] 2023-10-03T19:20:54.639 INFO:teuthology.orchestra.run.smithi045.stdout: -4267> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.639 INFO:teuthology.orchestra.run.smithi045.stdout: -4266> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003ad [2,head] /dc-dir/dc-file_440 auth v4486 s=3 n(v0 rc2023-10-03T19:13:39.535734+0000 b3 1=1+0) (iversion lock) 0x55cf622ed700] 2023-10-03T19:20:54.639 INFO:teuthology.orchestra.run.smithi045.stdout: -4265> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_440 [2,head] auth (dversion lock) v=4486 ino=0x100000003ad state=1073741824 0x55cf622ef680] [inode 0x100000003ad [2,head] /dc-dir/dc-file_440 auth v4486 s=3 n(v0 rc2023-10-03T19:13:39.535734+0000 b3 1=1+0) (iversion lock) 0x55cf622ed700] 2023-10-03T19:20:54.639 INFO:teuthology.orchestra.run.smithi045.stdout: -4264> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003ad [2,head] #100000003ad auth v4486 s=3 n(v0 rc2023-10-03T19:13:39.535734+0000 b3 1=1+0) (iversion lock) 0x55cf622ed700] 2023-10-03T19:20:54.639 INFO:teuthology.orchestra.run.smithi045.stdout: -4263> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_440 [2,head] auth NULL (dversion lock) v=4486 ino=(nil) state=1073741824 0x55cf622ef680] 2023-10-03T19:20:54.639 INFO:teuthology.orchestra.run.smithi045.stdout: -4262> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_439 [2,head] auth (dversion lock) v=4484 ino=0x100000003ac state=1073741824 0x55cf622ef400] 2023-10-03T19:20:54.639 INFO:teuthology.orchestra.run.smithi045.stdout: -4261> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.639 INFO:teuthology.orchestra.run.smithi045.stdout: -4260> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003ac [2,head] /dc-dir/dc-file_439 auth v4484 s=3 n(v0 rc2023-10-03T19:13:39.524144+0000 b3 1=1+0) (iversion lock) 0x55cf622ed180] 2023-10-03T19:20:54.640 INFO:teuthology.orchestra.run.smithi045.stdout: -4259> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_439 [2,head] auth (dversion lock) v=4484 ino=0x100000003ac state=1073741824 0x55cf622ef400] [inode 0x100000003ac [2,head] /dc-dir/dc-file_439 auth v4484 s=3 n(v0 rc2023-10-03T19:13:39.524144+0000 b3 1=1+0) (iversion lock) 0x55cf622ed180] 2023-10-03T19:20:54.640 INFO:teuthology.orchestra.run.smithi045.stdout: -4258> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003ac [2,head] #100000003ac auth v4484 s=3 n(v0 rc2023-10-03T19:13:39.524144+0000 b3 1=1+0) (iversion lock) 0x55cf622ed180] 2023-10-03T19:20:54.640 INFO:teuthology.orchestra.run.smithi045.stdout: -4257> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_439 [2,head] auth NULL (dversion lock) v=4484 ino=(nil) state=1073741824 0x55cf622ef400] 2023-10-03T19:20:54.640 INFO:teuthology.orchestra.run.smithi045.stdout: -4256> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_438 [2,head] auth (dversion lock) v=4482 ino=0x100000003ab state=1073741824 0x55cf622ef180] 2023-10-03T19:20:54.640 INFO:teuthology.orchestra.run.smithi045.stdout: -4255> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.640 INFO:teuthology.orchestra.run.smithi045.stdout: -4254> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003ab [2,head] /dc-dir/dc-file_438 auth v4482 s=3 n(v0 rc2023-10-03T19:13:39.511822+0000 b3 1=1+0) (iversion lock) 0x55cf622ecc00] 2023-10-03T19:20:54.640 INFO:teuthology.orchestra.run.smithi045.stdout: -4253> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_438 [2,head] auth (dversion lock) v=4482 ino=0x100000003ab state=1073741824 0x55cf622ef180] [inode 0x100000003ab [2,head] /dc-dir/dc-file_438 auth v4482 s=3 n(v0 rc2023-10-03T19:13:39.511822+0000 b3 1=1+0) (iversion lock) 0x55cf622ecc00] 2023-10-03T19:20:54.640 INFO:teuthology.orchestra.run.smithi045.stdout: -4252> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003ab [2,head] #100000003ab auth v4482 s=3 n(v0 rc2023-10-03T19:13:39.511822+0000 b3 1=1+0) (iversion lock) 0x55cf622ecc00] 2023-10-03T19:20:54.640 INFO:teuthology.orchestra.run.smithi045.stdout: -4251> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_438 [2,head] auth NULL (dversion lock) v=4482 ino=(nil) state=1073741824 0x55cf622ef180] 2023-10-03T19:20:54.640 INFO:teuthology.orchestra.run.smithi045.stdout: -4250> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_437 [2,head] auth (dversion lock) v=4184 ino=0x100000003aa state=1073741824 0x55cf622eef00] 2023-10-03T19:20:54.641 INFO:teuthology.orchestra.run.smithi045.stdout: -4249> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.641 INFO:teuthology.orchestra.run.smithi045.stdout: -4248> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003aa [2,head] /dc-dir/dc-file_437 auth v4184 s=3 n(v0 rc2023-10-03T19:13:39.499495+0000 b3 1=1+0) (iversion lock) 0x55cf622ec680] 2023-10-03T19:20:54.641 INFO:teuthology.orchestra.run.smithi045.stdout: -4247> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_437 [2,head] auth (dversion lock) v=4184 ino=0x100000003aa state=1073741824 0x55cf622eef00] [inode 0x100000003aa [2,head] /dc-dir/dc-file_437 auth v4184 s=3 n(v0 rc2023-10-03T19:13:39.499495+0000 b3 1=1+0) (iversion lock) 0x55cf622ec680] 2023-10-03T19:20:54.641 INFO:teuthology.orchestra.run.smithi045.stdout: -4246> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003aa [2,head] #100000003aa auth v4184 s=3 n(v0 rc2023-10-03T19:13:39.499495+0000 b3 1=1+0) (iversion lock) 0x55cf622ec680] 2023-10-03T19:20:54.641 INFO:teuthology.orchestra.run.smithi045.stdout: -4245> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_437 [2,head] auth NULL (dversion lock) v=4184 ino=(nil) state=1073741824 0x55cf622eef00] 2023-10-03T19:20:54.641 INFO:teuthology.orchestra.run.smithi045.stdout: -4244> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_436 [2,head] auth (dversion lock) v=4182 ino=0x100000003a9 state=1073741824 0x55cf622eec80] 2023-10-03T19:20:54.641 INFO:teuthology.orchestra.run.smithi045.stdout: -4243> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.641 INFO:teuthology.orchestra.run.smithi045.stdout: -4242> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003a9 [2,head] /dc-dir/dc-file_436 auth v4182 s=3 n(v0 rc2023-10-03T19:13:39.488584+0000 b3 1=1+0) (iversion lock) 0x55cf622ec100] 2023-10-03T19:20:54.641 INFO:teuthology.orchestra.run.smithi045.stdout: -4241> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_436 [2,head] auth (dversion lock) v=4182 ino=0x100000003a9 state=1073741824 0x55cf622eec80] [inode 0x100000003a9 [2,head] /dc-dir/dc-file_436 auth v4182 s=3 n(v0 rc2023-10-03T19:13:39.488584+0000 b3 1=1+0) (iversion lock) 0x55cf622ec100] 2023-10-03T19:20:54.641 INFO:teuthology.orchestra.run.smithi045.stdout: -4240> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003a9 [2,head] #100000003a9 auth v4182 s=3 n(v0 rc2023-10-03T19:13:39.488584+0000 b3 1=1+0) (iversion lock) 0x55cf622ec100] 2023-10-03T19:20:54.641 INFO:teuthology.orchestra.run.smithi045.stdout: -4239> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_436 [2,head] auth NULL (dversion lock) v=4182 ino=(nil) state=1073741824 0x55cf622eec80] 2023-10-03T19:20:54.642 INFO:teuthology.orchestra.run.smithi045.stdout: -4238> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_435 [2,head] auth (dversion lock) v=4180 ino=0x100000003a8 state=1073741824 0x55cf622eea00] 2023-10-03T19:20:54.642 INFO:teuthology.orchestra.run.smithi045.stdout: -4237> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.642 INFO:teuthology.orchestra.run.smithi045.stdout: -4236> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003a8 [2,head] /dc-dir/dc-file_435 auth v4180 s=3 n(v0 rc2023-10-03T19:13:39.477674+0000 b3 1=1+0) (iversion lock) 0x55cf622ebb80] 2023-10-03T19:20:54.642 INFO:teuthology.orchestra.run.smithi045.stdout: -4235> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_435 [2,head] auth (dversion lock) v=4180 ino=0x100000003a8 state=1073741824 0x55cf622eea00] [inode 0x100000003a8 [2,head] /dc-dir/dc-file_435 auth v4180 s=3 n(v0 rc2023-10-03T19:13:39.477674+0000 b3 1=1+0) (iversion lock) 0x55cf622ebb80] 2023-10-03T19:20:54.642 INFO:teuthology.orchestra.run.smithi045.stdout: -4234> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003a8 [2,head] #100000003a8 auth v4180 s=3 n(v0 rc2023-10-03T19:13:39.477674+0000 b3 1=1+0) (iversion lock) 0x55cf622ebb80] 2023-10-03T19:20:54.642 INFO:teuthology.orchestra.run.smithi045.stdout: -4233> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_435 [2,head] auth NULL (dversion lock) v=4180 ino=(nil) state=1073741824 0x55cf622eea00] 2023-10-03T19:20:54.642 INFO:teuthology.orchestra.run.smithi045.stdout: -4232> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_434 [2,head] auth (dversion lock) v=4178 ino=0x100000003a7 state=1073741824 0x55cf622ee780] 2023-10-03T19:20:54.642 INFO:teuthology.orchestra.run.smithi045.stdout: -4231> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.642 INFO:teuthology.orchestra.run.smithi045.stdout: -4230> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003a7 [2,head] /dc-dir/dc-file_434 auth v4178 s=3 n(v0 rc2023-10-03T19:13:39.466639+0000 b3 1=1+0) (iversion lock) 0x55cf622eb600] 2023-10-03T19:20:54.642 INFO:teuthology.orchestra.run.smithi045.stdout: -4229> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_434 [2,head] auth (dversion lock) v=4178 ino=0x100000003a7 state=1073741824 0x55cf622ee780] [inode 0x100000003a7 [2,head] /dc-dir/dc-file_434 auth v4178 s=3 n(v0 rc2023-10-03T19:13:39.466639+0000 b3 1=1+0) (iversion lock) 0x55cf622eb600] 2023-10-03T19:20:54.642 INFO:teuthology.orchestra.run.smithi045.stdout: -4228> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003a7 [2,head] #100000003a7 auth v4178 s=3 n(v0 rc2023-10-03T19:13:39.466639+0000 b3 1=1+0) (iversion lock) 0x55cf622eb600] 2023-10-03T19:20:54.643 INFO:teuthology.orchestra.run.smithi045.stdout: -4227> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_434 [2,head] auth NULL (dversion lock) v=4178 ino=(nil) state=1073741824 0x55cf622ee780] 2023-10-03T19:20:54.643 INFO:teuthology.orchestra.run.smithi045.stdout: -4226> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_433 [2,head] auth (dversion lock) v=4176 ino=0x100000003a6 state=1073741824 0x55cf622ee500] 2023-10-03T19:20:54.643 INFO:teuthology.orchestra.run.smithi045.stdout: -4225> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.643 INFO:teuthology.orchestra.run.smithi045.stdout: -4224> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003a6 [2,head] /dc-dir/dc-file_433 auth v4176 s=3 n(v0 rc2023-10-03T19:13:39.453518+0000 b3 1=1+0) (iversion lock) 0x55cf622eb080] 2023-10-03T19:20:54.643 INFO:teuthology.orchestra.run.smithi045.stdout: -4223> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_433 [2,head] auth (dversion lock) v=4176 ino=0x100000003a6 state=1073741824 0x55cf622ee500] [inode 0x100000003a6 [2,head] /dc-dir/dc-file_433 auth v4176 s=3 n(v0 rc2023-10-03T19:13:39.453518+0000 b3 1=1+0) (iversion lock) 0x55cf622eb080] 2023-10-03T19:20:54.643 INFO:teuthology.orchestra.run.smithi045.stdout: -4222> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003a6 [2,head] #100000003a6 auth v4176 s=3 n(v0 rc2023-10-03T19:13:39.453518+0000 b3 1=1+0) (iversion lock) 0x55cf622eb080] 2023-10-03T19:20:54.643 INFO:teuthology.orchestra.run.smithi045.stdout: -4221> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_433 [2,head] auth NULL (dversion lock) v=4176 ino=(nil) state=1073741824 0x55cf622ee500] 2023-10-03T19:20:54.643 INFO:teuthology.orchestra.run.smithi045.stdout: -4220> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_432 [2,head] auth (dversion lock) v=4174 ino=0x100000003a5 state=1073741824 0x55cf622ee280] 2023-10-03T19:20:54.643 INFO:teuthology.orchestra.run.smithi045.stdout: -4219> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.643 INFO:teuthology.orchestra.run.smithi045.stdout: -4218> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003a5 [2,head] /dc-dir/dc-file_432 auth v4174 s=3 n(v0 rc2023-10-03T19:13:39.442175+0000 b3 1=1+0) (iversion lock) 0x55cf622eab00] 2023-10-03T19:20:54.643 INFO:teuthology.orchestra.run.smithi045.stdout: -4217> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_432 [2,head] auth (dversion lock) v=4174 ino=0x100000003a5 state=1073741824 0x55cf622ee280] [inode 0x100000003a5 [2,head] /dc-dir/dc-file_432 auth v4174 s=3 n(v0 rc2023-10-03T19:13:39.442175+0000 b3 1=1+0) (iversion lock) 0x55cf622eab00] 2023-10-03T19:20:54.643 INFO:teuthology.orchestra.run.smithi045.stdout: -4216> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003a5 [2,head] #100000003a5 auth v4174 s=3 n(v0 rc2023-10-03T19:13:39.442175+0000 b3 1=1+0) (iversion lock) 0x55cf622eab00] 2023-10-03T19:20:54.644 INFO:teuthology.orchestra.run.smithi045.stdout: -4215> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_432 [2,head] auth NULL (dversion lock) v=4174 ino=(nil) state=1073741824 0x55cf622ee280] 2023-10-03T19:20:54.644 INFO:teuthology.orchestra.run.smithi045.stdout: -4214> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_431 [2,head] auth (dversion lock) v=4172 ino=0x100000003a4 state=1073741824 0x55cf622ee000] 2023-10-03T19:20:54.644 INFO:teuthology.orchestra.run.smithi045.stdout: -4213> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.644 INFO:teuthology.orchestra.run.smithi045.stdout: -4212> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003a4 [2,head] /dc-dir/dc-file_431 auth v4172 s=3 n(v0 rc2023-10-03T19:13:39.430347+0000 b3 1=1+0) (iversion lock) 0x55cf622ea580] 2023-10-03T19:20:54.644 INFO:teuthology.orchestra.run.smithi045.stdout: -4211> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_431 [2,head] auth (dversion lock) v=4172 ino=0x100000003a4 state=1073741824 0x55cf622ee000] [inode 0x100000003a4 [2,head] /dc-dir/dc-file_431 auth v4172 s=3 n(v0 rc2023-10-03T19:13:39.430347+0000 b3 1=1+0) (iversion lock) 0x55cf622ea580] 2023-10-03T19:20:54.644 INFO:teuthology.orchestra.run.smithi045.stdout: -4210> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003a4 [2,head] #100000003a4 auth v4172 s=3 n(v0 rc2023-10-03T19:13:39.430347+0000 b3 1=1+0) (iversion lock) 0x55cf622ea580] 2023-10-03T19:20:54.644 INFO:teuthology.orchestra.run.smithi045.stdout: -4209> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_431 [2,head] auth NULL (dversion lock) v=4172 ino=(nil) state=1073741824 0x55cf622ee000] 2023-10-03T19:20:54.644 INFO:teuthology.orchestra.run.smithi045.stdout: -4208> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_430 [2,head] auth (dversion lock) v=4170 ino=0x100000003a3 state=1073741824 0x55cf61ecbb80] 2023-10-03T19:20:54.644 INFO:teuthology.orchestra.run.smithi045.stdout: -4207> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.644 INFO:teuthology.orchestra.run.smithi045.stdout: -4206> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003a3 [2,head] /dc-dir/dc-file_430 auth v4170 s=3 n(v0 rc2023-10-03T19:13:39.418214+0000 b3 1=1+0) (iversion lock) 0x55cf622ea000] 2023-10-03T19:20:54.644 INFO:teuthology.orchestra.run.smithi045.stdout: -4205> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_430 [2,head] auth (dversion lock) v=4170 ino=0x100000003a3 state=1073741824 0x55cf61ecbb80] [inode 0x100000003a3 [2,head] /dc-dir/dc-file_430 auth v4170 s=3 n(v0 rc2023-10-03T19:13:39.418214+0000 b3 1=1+0) (iversion lock) 0x55cf622ea000] 2023-10-03T19:20:54.644 INFO:teuthology.orchestra.run.smithi045.stdout: -4204> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003a3 [2,head] #100000003a3 auth v4170 s=3 n(v0 rc2023-10-03T19:13:39.418214+0000 b3 1=1+0) (iversion lock) 0x55cf622ea000] 2023-10-03T19:20:54.645 INFO:teuthology.orchestra.run.smithi045.stdout: -4203> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_430 [2,head] auth NULL (dversion lock) v=4170 ino=(nil) state=1073741824 0x55cf61ecbb80] 2023-10-03T19:20:54.645 INFO:teuthology.orchestra.run.smithi045.stdout: -4202> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_429 [2,head] auth (dversion lock) v=4168 ino=0x100000003a2 state=1073741824 0x55cf61ecb900] 2023-10-03T19:20:54.645 INFO:teuthology.orchestra.run.smithi045.stdout: -4201> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.645 INFO:teuthology.orchestra.run.smithi045.stdout: -4200> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003a2 [2,head] /dc-dir/dc-file_429 auth v4168 s=3 n(v0 rc2023-10-03T19:13:39.404509+0000 b3 1=1+0) (iversion lock) 0x55cf622e3700] 2023-10-03T19:20:54.645 INFO:teuthology.orchestra.run.smithi045.stdout: -4199> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_429 [2,head] auth (dversion lock) v=4168 ino=0x100000003a2 state=1073741824 0x55cf61ecb900] [inode 0x100000003a2 [2,head] /dc-dir/dc-file_429 auth v4168 s=3 n(v0 rc2023-10-03T19:13:39.404509+0000 b3 1=1+0) (iversion lock) 0x55cf622e3700] 2023-10-03T19:20:54.645 INFO:teuthology.orchestra.run.smithi045.stdout: -4198> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003a2 [2,head] #100000003a2 auth v4168 s=3 n(v0 rc2023-10-03T19:13:39.404509+0000 b3 1=1+0) (iversion lock) 0x55cf622e3700] 2023-10-03T19:20:54.645 INFO:teuthology.orchestra.run.smithi045.stdout: -4197> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_429 [2,head] auth NULL (dversion lock) v=4168 ino=(nil) state=1073741824 0x55cf61ecb900] 2023-10-03T19:20:54.645 INFO:teuthology.orchestra.run.smithi045.stdout: -4196> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_428 [2,head] auth (dversion lock) v=4166 ino=0x100000003a1 state=1073741824 0x55cf61ecb680] 2023-10-03T19:20:54.645 INFO:teuthology.orchestra.run.smithi045.stdout: -4195> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.645 INFO:teuthology.orchestra.run.smithi045.stdout: -4194> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003a1 [2,head] /dc-dir/dc-file_428 auth v4166 s=3 n(v0 rc2023-10-03T19:13:39.391538+0000 b3 1=1+0) (iversion lock) 0x55cf622e3180] 2023-10-03T19:20:54.645 INFO:teuthology.orchestra.run.smithi045.stdout: -4193> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_428 [2,head] auth (dversion lock) v=4166 ino=0x100000003a1 state=1073741824 0x55cf61ecb680] [inode 0x100000003a1 [2,head] /dc-dir/dc-file_428 auth v4166 s=3 n(v0 rc2023-10-03T19:13:39.391538+0000 b3 1=1+0) (iversion lock) 0x55cf622e3180] 2023-10-03T19:20:54.645 INFO:teuthology.orchestra.run.smithi045.stdout: -4192> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003a1 [2,head] #100000003a1 auth v4166 s=3 n(v0 rc2023-10-03T19:13:39.391538+0000 b3 1=1+0) (iversion lock) 0x55cf622e3180] 2023-10-03T19:20:54.646 INFO:teuthology.orchestra.run.smithi045.stdout: -4191> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_428 [2,head] auth NULL (dversion lock) v=4166 ino=(nil) state=1073741824 0x55cf61ecb680] 2023-10-03T19:20:54.646 INFO:teuthology.orchestra.run.smithi045.stdout: -4190> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_427 [2,head] auth (dversion lock) v=4164 ino=0x100000003a0 state=1073741824 0x55cf61ecb400] 2023-10-03T19:20:54.646 INFO:teuthology.orchestra.run.smithi045.stdout: -4189> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.646 INFO:teuthology.orchestra.run.smithi045.stdout: -4188> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000003a0 [2,head] /dc-dir/dc-file_427 auth v4164 s=3 n(v0 rc2023-10-03T19:13:39.378255+0000 b3 1=1+0) (iversion lock) 0x55cf622e2c00] 2023-10-03T19:20:54.646 INFO:teuthology.orchestra.run.smithi045.stdout: -4187> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_427 [2,head] auth (dversion lock) v=4164 ino=0x100000003a0 state=1073741824 0x55cf61ecb400] [inode 0x100000003a0 [2,head] /dc-dir/dc-file_427 auth v4164 s=3 n(v0 rc2023-10-03T19:13:39.378255+0000 b3 1=1+0) (iversion lock) 0x55cf622e2c00] 2023-10-03T19:20:54.646 INFO:teuthology.orchestra.run.smithi045.stdout: -4186> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000003a0 [2,head] #100000003a0 auth v4164 s=3 n(v0 rc2023-10-03T19:13:39.378255+0000 b3 1=1+0) (iversion lock) 0x55cf622e2c00] 2023-10-03T19:20:54.646 INFO:teuthology.orchestra.run.smithi045.stdout: -4185> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_427 [2,head] auth NULL (dversion lock) v=4164 ino=(nil) state=1073741824 0x55cf61ecb400] 2023-10-03T19:20:54.646 INFO:teuthology.orchestra.run.smithi045.stdout: -4184> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_426 [2,head] auth (dversion lock) v=4162 ino=0x1000000039f state=1073741824 0x55cf61ecb180] 2023-10-03T19:20:54.646 INFO:teuthology.orchestra.run.smithi045.stdout: -4183> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.646 INFO:teuthology.orchestra.run.smithi045.stdout: -4182> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000039f [2,head] /dc-dir/dc-file_426 auth v4162 s=3 n(v0 rc2023-10-03T19:13:39.365408+0000 b3 1=1+0) (iversion lock) 0x55cf622e2680] 2023-10-03T19:20:54.647 INFO:teuthology.orchestra.run.smithi045.stdout: -4181> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_426 [2,head] auth (dversion lock) v=4162 ino=0x1000000039f state=1073741824 0x55cf61ecb180] [inode 0x1000000039f [2,head] /dc-dir/dc-file_426 auth v4162 s=3 n(v0 rc2023-10-03T19:13:39.365408+0000 b3 1=1+0) (iversion lock) 0x55cf622e2680] 2023-10-03T19:20:54.647 INFO:teuthology.orchestra.run.smithi045.stdout: -4180> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000039f [2,head] #1000000039f auth v4162 s=3 n(v0 rc2023-10-03T19:13:39.365408+0000 b3 1=1+0) (iversion lock) 0x55cf622e2680] 2023-10-03T19:20:54.647 INFO:teuthology.orchestra.run.smithi045.stdout: -4179> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_426 [2,head] auth NULL (dversion lock) v=4162 ino=(nil) state=1073741824 0x55cf61ecb180] 2023-10-03T19:20:54.647 INFO:teuthology.orchestra.run.smithi045.stdout: -4178> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_425 [2,head] auth (dversion lock) v=4160 ino=0x1000000039e state=1073741824 0x55cf61ecaf00] 2023-10-03T19:20:54.647 INFO:teuthology.orchestra.run.smithi045.stdout: -4177> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.647 INFO:teuthology.orchestra.run.smithi045.stdout: -4176> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000039e [2,head] /dc-dir/dc-file_425 auth v4160 s=3 n(v0 rc2023-10-03T19:13:39.353440+0000 b3 1=1+0) (iversion lock) 0x55cf622e2100] 2023-10-03T19:20:54.647 INFO:teuthology.orchestra.run.smithi045.stdout: -4175> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_425 [2,head] auth (dversion lock) v=4160 ino=0x1000000039e state=1073741824 0x55cf61ecaf00] [inode 0x1000000039e [2,head] /dc-dir/dc-file_425 auth v4160 s=3 n(v0 rc2023-10-03T19:13:39.353440+0000 b3 1=1+0) (iversion lock) 0x55cf622e2100] 2023-10-03T19:20:54.647 INFO:teuthology.orchestra.run.smithi045.stdout: -4174> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000039e [2,head] #1000000039e auth v4160 s=3 n(v0 rc2023-10-03T19:13:39.353440+0000 b3 1=1+0) (iversion lock) 0x55cf622e2100] 2023-10-03T19:20:54.647 INFO:teuthology.orchestra.run.smithi045.stdout: -4173> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_425 [2,head] auth NULL (dversion lock) v=4160 ino=(nil) state=1073741824 0x55cf61ecaf00] 2023-10-03T19:20:54.647 INFO:teuthology.orchestra.run.smithi045.stdout: -4172> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_424 [2,head] auth (dversion lock) v=4158 ino=0x1000000039d state=1073741824 0x55cf61ecac80] 2023-10-03T19:20:54.647 INFO:teuthology.orchestra.run.smithi045.stdout: -4171> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.647 INFO:teuthology.orchestra.run.smithi045.stdout: -4170> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000039d [2,head] /dc-dir/dc-file_424 auth v4158 s=3 n(v0 rc2023-10-03T19:13:39.339858+0000 b3 1=1+0) (iversion lock) 0x55cf622e1b80] 2023-10-03T19:20:54.648 INFO:teuthology.orchestra.run.smithi045.stdout: -4169> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_424 [2,head] auth (dversion lock) v=4158 ino=0x1000000039d state=1073741824 0x55cf61ecac80] [inode 0x1000000039d [2,head] /dc-dir/dc-file_424 auth v4158 s=3 n(v0 rc2023-10-03T19:13:39.339858+0000 b3 1=1+0) (iversion lock) 0x55cf622e1b80] 2023-10-03T19:20:54.648 INFO:teuthology.orchestra.run.smithi045.stdout: -4168> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000039d [2,head] #1000000039d auth v4158 s=3 n(v0 rc2023-10-03T19:13:39.339858+0000 b3 1=1+0) (iversion lock) 0x55cf622e1b80] 2023-10-03T19:20:54.648 INFO:teuthology.orchestra.run.smithi045.stdout: -4167> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_424 [2,head] auth NULL (dversion lock) v=4158 ino=(nil) state=1073741824 0x55cf61ecac80] 2023-10-03T19:20:54.648 INFO:teuthology.orchestra.run.smithi045.stdout: -4166> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_423 [2,head] auth (dversion lock) v=4156 ino=0x1000000039c state=1073741824 0x55cf61ecaa00] 2023-10-03T19:20:54.648 INFO:teuthology.orchestra.run.smithi045.stdout: -4165> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.648 INFO:teuthology.orchestra.run.smithi045.stdout: -4164> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000039c [2,head] /dc-dir/dc-file_423 auth v4156 s=3 n(v0 rc2023-10-03T19:13:39.327788+0000 b3 1=1+0) (iversion lock) 0x55cf622e1600] 2023-10-03T19:20:54.648 INFO:teuthology.orchestra.run.smithi045.stdout: -4163> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_423 [2,head] auth (dversion lock) v=4156 ino=0x1000000039c state=1073741824 0x55cf61ecaa00] [inode 0x1000000039c [2,head] /dc-dir/dc-file_423 auth v4156 s=3 n(v0 rc2023-10-03T19:13:39.327788+0000 b3 1=1+0) (iversion lock) 0x55cf622e1600] 2023-10-03T19:20:54.648 INFO:teuthology.orchestra.run.smithi045.stdout: -4162> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000039c [2,head] #1000000039c auth v4156 s=3 n(v0 rc2023-10-03T19:13:39.327788+0000 b3 1=1+0) (iversion lock) 0x55cf622e1600] 2023-10-03T19:20:54.648 INFO:teuthology.orchestra.run.smithi045.stdout: -4161> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_423 [2,head] auth NULL (dversion lock) v=4156 ino=(nil) state=1073741824 0x55cf61ecaa00] 2023-10-03T19:20:54.648 INFO:teuthology.orchestra.run.smithi045.stdout: -4160> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_422 [2,head] auth (dversion lock) v=4154 ino=0x1000000039b state=1073741824 0x55cf61eca780] 2023-10-03T19:20:54.648 INFO:teuthology.orchestra.run.smithi045.stdout: -4159> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.648 INFO:teuthology.orchestra.run.smithi045.stdout: -4158> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000039b [2,head] /dc-dir/dc-file_422 auth v4154 s=3 n(v0 rc2023-10-03T19:13:39.316569+0000 b3 1=1+0) (iversion lock) 0x55cf622e1080] 2023-10-03T19:20:54.649 INFO:teuthology.orchestra.run.smithi045.stdout: -4157> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_422 [2,head] auth (dversion lock) v=4154 ino=0x1000000039b state=1073741824 0x55cf61eca780] [inode 0x1000000039b [2,head] /dc-dir/dc-file_422 auth v4154 s=3 n(v0 rc2023-10-03T19:13:39.316569+0000 b3 1=1+0) (iversion lock) 0x55cf622e1080] 2023-10-03T19:20:54.683 INFO:teuthology.orchestra.run.smithi045.stdout: -4156> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000039b [2,head] #1000000039b auth v4154 s=3 n(v0 rc2023-10-03T19:13:39.316569+0000 b3 1=1+0) (iversion lock) 0x55cf622e1080] 2023-10-03T19:20:54.683 INFO:teuthology.orchestra.run.smithi045.stdout: -4155> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_422 [2,head] auth NULL (dversion lock) v=4154 ino=(nil) state=1073741824 0x55cf61eca780] 2023-10-03T19:20:54.683 INFO:teuthology.orchestra.run.smithi045.stdout: -4154> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_421 [2,head] auth (dversion lock) v=4152 ino=0x1000000039a state=1073741824 0x55cf61eca500] 2023-10-03T19:20:54.683 INFO:teuthology.orchestra.run.smithi045.stdout: -4153> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.683 INFO:teuthology.orchestra.run.smithi045.stdout: -4152> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000039a [2,head] /dc-dir/dc-file_421 auth v4152 s=3 n(v0 rc2023-10-03T19:13:39.305361+0000 b3 1=1+0) (iversion lock) 0x55cf622e0b00] 2023-10-03T19:20:54.683 INFO:teuthology.orchestra.run.smithi045.stdout: -4151> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_421 [2,head] auth (dversion lock) v=4152 ino=0x1000000039a state=1073741824 0x55cf61eca500] [inode 0x1000000039a [2,head] /dc-dir/dc-file_421 auth v4152 s=3 n(v0 rc2023-10-03T19:13:39.305361+0000 b3 1=1+0) (iversion lock) 0x55cf622e0b00] 2023-10-03T19:20:54.683 INFO:teuthology.orchestra.run.smithi045.stdout: -4150> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000039a [2,head] #1000000039a auth v4152 s=3 n(v0 rc2023-10-03T19:13:39.305361+0000 b3 1=1+0) (iversion lock) 0x55cf622e0b00] 2023-10-03T19:20:54.684 INFO:teuthology.orchestra.run.smithi045.stdout: -4149> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_421 [2,head] auth NULL (dversion lock) v=4152 ino=(nil) state=1073741824 0x55cf61eca500] 2023-10-03T19:20:54.684 INFO:teuthology.orchestra.run.smithi045.stdout: -4148> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_420 [2,head] auth (dversion lock) v=4150 ino=0x10000000399 state=1073741824 0x55cf61eca280] 2023-10-03T19:20:54.684 INFO:teuthology.orchestra.run.smithi045.stdout: -4147> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.684 INFO:teuthology.orchestra.run.smithi045.stdout: -4146> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000399 [2,head] /dc-dir/dc-file_420 auth v4150 s=3 n(v0 rc2023-10-03T19:13:39.293314+0000 b3 1=1+0) (iversion lock) 0x55cf622e0580] 2023-10-03T19:20:54.684 INFO:teuthology.orchestra.run.smithi045.stdout: -4145> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_420 [2,head] auth (dversion lock) v=4150 ino=0x10000000399 state=1073741824 0x55cf61eca280] [inode 0x10000000399 [2,head] /dc-dir/dc-file_420 auth v4150 s=3 n(v0 rc2023-10-03T19:13:39.293314+0000 b3 1=1+0) (iversion lock) 0x55cf622e0580] 2023-10-03T19:20:54.684 INFO:teuthology.orchestra.run.smithi045.stdout: -4144> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000399 [2,head] #10000000399 auth v4150 s=3 n(v0 rc2023-10-03T19:13:39.293314+0000 b3 1=1+0) (iversion lock) 0x55cf622e0580] 2023-10-03T19:20:54.684 INFO:teuthology.orchestra.run.smithi045.stdout: -4143> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_420 [2,head] auth NULL (dversion lock) v=4150 ino=(nil) state=1073741824 0x55cf61eca280] 2023-10-03T19:20:54.684 INFO:teuthology.orchestra.run.smithi045.stdout: -4142> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_419 [2,head] auth (dversion lock) v=4148 ino=0x10000000398 state=1073741824 0x55cf61eca000] 2023-10-03T19:20:54.684 INFO:teuthology.orchestra.run.smithi045.stdout: -4141> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.684 INFO:teuthology.orchestra.run.smithi045.stdout: -4140> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000398 [2,head] /dc-dir/dc-file_419 auth v4148 s=3 n(v0 rc2023-10-03T19:13:39.281030+0000 b3 1=1+0) (iversion lock) 0x55cf622e0000] 2023-10-03T19:20:54.684 INFO:teuthology.orchestra.run.smithi045.stdout: -4139> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_419 [2,head] auth (dversion lock) v=4148 ino=0x10000000398 state=1073741824 0x55cf61eca000] [inode 0x10000000398 [2,head] /dc-dir/dc-file_419 auth v4148 s=3 n(v0 rc2023-10-03T19:13:39.281030+0000 b3 1=1+0) (iversion lock) 0x55cf622e0000] 2023-10-03T19:20:54.685 INFO:teuthology.orchestra.run.smithi045.stdout: -4138> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000398 [2,head] #10000000398 auth v4148 s=3 n(v0 rc2023-10-03T19:13:39.281030+0000 b3 1=1+0) (iversion lock) 0x55cf622e0000] 2023-10-03T19:20:54.685 INFO:teuthology.orchestra.run.smithi045.stdout: -4137> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_419 [2,head] auth NULL (dversion lock) v=4148 ino=(nil) state=1073741824 0x55cf61eca000] 2023-10-03T19:20:54.685 INFO:teuthology.orchestra.run.smithi045.stdout: -4136> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_418 [2,head] auth (dversion lock) v=4146 ino=0x10000000397 state=1073741824 0x55cf6227db80] 2023-10-03T19:20:54.685 INFO:teuthology.orchestra.run.smithi045.stdout: -4135> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.685 INFO:teuthology.orchestra.run.smithi045.stdout: -4134> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000397 [2,head] /dc-dir/dc-file_418 auth v4146 s=3 n(v0 rc2023-10-03T19:13:39.269530+0000 b3 1=1+0) (iversion lock) 0x55cf62283700] 2023-10-03T19:20:54.685 INFO:teuthology.orchestra.run.smithi045.stdout: -4133> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_418 [2,head] auth (dversion lock) v=4146 ino=0x10000000397 state=1073741824 0x55cf6227db80] [inode 0x10000000397 [2,head] /dc-dir/dc-file_418 auth v4146 s=3 n(v0 rc2023-10-03T19:13:39.269530+0000 b3 1=1+0) (iversion lock) 0x55cf62283700] 2023-10-03T19:20:54.685 INFO:teuthology.orchestra.run.smithi045.stdout: -4132> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000397 [2,head] #10000000397 auth v4146 s=3 n(v0 rc2023-10-03T19:13:39.269530+0000 b3 1=1+0) (iversion lock) 0x55cf62283700] 2023-10-03T19:20:54.685 INFO:teuthology.orchestra.run.smithi045.stdout: -4131> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_418 [2,head] auth NULL (dversion lock) v=4146 ino=(nil) state=1073741824 0x55cf6227db80] 2023-10-03T19:20:54.685 INFO:teuthology.orchestra.run.smithi045.stdout: -4130> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_417 [2,head] auth (dversion lock) v=4144 ino=0x10000000396 state=1073741824 0x55cf6227d900] 2023-10-03T19:20:54.685 INFO:teuthology.orchestra.run.smithi045.stdout: -4129> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.685 INFO:teuthology.orchestra.run.smithi045.stdout: -4128> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000396 [2,head] /dc-dir/dc-file_417 auth v4144 s=3 n(v0 rc2023-10-03T19:13:39.257364+0000 b3 1=1+0) (iversion lock) 0x55cf62283180] 2023-10-03T19:20:54.685 INFO:teuthology.orchestra.run.smithi045.stdout: -4127> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_417 [2,head] auth (dversion lock) v=4144 ino=0x10000000396 state=1073741824 0x55cf6227d900] [inode 0x10000000396 [2,head] /dc-dir/dc-file_417 auth v4144 s=3 n(v0 rc2023-10-03T19:13:39.257364+0000 b3 1=1+0) (iversion lock) 0x55cf62283180] 2023-10-03T19:20:54.686 INFO:teuthology.orchestra.run.smithi045.stdout: -4126> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000396 [2,head] #10000000396 auth v4144 s=3 n(v0 rc2023-10-03T19:13:39.257364+0000 b3 1=1+0) (iversion lock) 0x55cf62283180] 2023-10-03T19:20:54.686 INFO:teuthology.orchestra.run.smithi045.stdout: -4125> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_417 [2,head] auth NULL (dversion lock) v=4144 ino=(nil) state=1073741824 0x55cf6227d900] 2023-10-03T19:20:54.686 INFO:teuthology.orchestra.run.smithi045.stdout: -4124> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_416 [2,head] auth (dversion lock) v=4142 ino=0x10000000395 state=1073741824 0x55cf6227d680] 2023-10-03T19:20:54.686 INFO:teuthology.orchestra.run.smithi045.stdout: -4123> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.686 INFO:teuthology.orchestra.run.smithi045.stdout: -4122> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000395 [2,head] /dc-dir/dc-file_416 auth v4142 s=3 n(v0 rc2023-10-03T19:13:39.244142+0000 b3 1=1+0) (iversion lock) 0x55cf62282c00] 2023-10-03T19:20:54.686 INFO:teuthology.orchestra.run.smithi045.stdout: -4121> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_416 [2,head] auth (dversion lock) v=4142 ino=0x10000000395 state=1073741824 0x55cf6227d680] [inode 0x10000000395 [2,head] /dc-dir/dc-file_416 auth v4142 s=3 n(v0 rc2023-10-03T19:13:39.244142+0000 b3 1=1+0) (iversion lock) 0x55cf62282c00] 2023-10-03T19:20:54.686 INFO:teuthology.orchestra.run.smithi045.stdout: -4120> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000395 [2,head] #10000000395 auth v4142 s=3 n(v0 rc2023-10-03T19:13:39.244142+0000 b3 1=1+0) (iversion lock) 0x55cf62282c00] 2023-10-03T19:20:54.686 INFO:teuthology.orchestra.run.smithi045.stdout: -4119> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_416 [2,head] auth NULL (dversion lock) v=4142 ino=(nil) state=1073741824 0x55cf6227d680] 2023-10-03T19:20:54.686 INFO:teuthology.orchestra.run.smithi045.stdout: -4118> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_415 [2,head] auth (dversion lock) v=4140 ino=0x10000000394 state=1073741824 0x55cf6227d400] 2023-10-03T19:20:54.686 INFO:teuthology.orchestra.run.smithi045.stdout: -4117> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.687 INFO:teuthology.orchestra.run.smithi045.stdout: -4116> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000394 [2,head] /dc-dir/dc-file_415 auth v4140 s=3 n(v0 rc2023-10-03T19:13:39.233114+0000 b3 1=1+0) (iversion lock) 0x55cf62282680] 2023-10-03T19:20:54.687 INFO:teuthology.orchestra.run.smithi045.stdout: -4115> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_415 [2,head] auth (dversion lock) v=4140 ino=0x10000000394 state=1073741824 0x55cf6227d400] [inode 0x10000000394 [2,head] /dc-dir/dc-file_415 auth v4140 s=3 n(v0 rc2023-10-03T19:13:39.233114+0000 b3 1=1+0) (iversion lock) 0x55cf62282680] 2023-10-03T19:20:54.687 INFO:teuthology.orchestra.run.smithi045.stdout: -4114> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000394 [2,head] #10000000394 auth v4140 s=3 n(v0 rc2023-10-03T19:13:39.233114+0000 b3 1=1+0) (iversion lock) 0x55cf62282680] 2023-10-03T19:20:54.687 INFO:teuthology.orchestra.run.smithi045.stdout: -4113> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_415 [2,head] auth NULL (dversion lock) v=4140 ino=(nil) state=1073741824 0x55cf6227d400] 2023-10-03T19:20:54.687 INFO:teuthology.orchestra.run.smithi045.stdout: -4112> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_414 [2,head] auth (dversion lock) v=4138 ino=0x10000000393 state=1073741824 0x55cf6227d180] 2023-10-03T19:20:54.687 INFO:teuthology.orchestra.run.smithi045.stdout: -4111> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.687 INFO:teuthology.orchestra.run.smithi045.stdout: -4110> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000393 [2,head] /dc-dir/dc-file_414 auth v4138 s=3 n(v0 rc2023-10-03T19:13:39.222030+0000 b3 1=1+0) (iversion lock) 0x55cf62282100] 2023-10-03T19:20:54.687 INFO:teuthology.orchestra.run.smithi045.stdout: -4109> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_414 [2,head] auth (dversion lock) v=4138 ino=0x10000000393 state=1073741824 0x55cf6227d180] [inode 0x10000000393 [2,head] /dc-dir/dc-file_414 auth v4138 s=3 n(v0 rc2023-10-03T19:13:39.222030+0000 b3 1=1+0) (iversion lock) 0x55cf62282100] 2023-10-03T19:20:54.687 INFO:teuthology.orchestra.run.smithi045.stdout: -4108> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000393 [2,head] #10000000393 auth v4138 s=3 n(v0 rc2023-10-03T19:13:39.222030+0000 b3 1=1+0) (iversion lock) 0x55cf62282100] 2023-10-03T19:20:54.687 INFO:teuthology.orchestra.run.smithi045.stdout: -4107> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_414 [2,head] auth NULL (dversion lock) v=4138 ino=(nil) state=1073741824 0x55cf6227d180] 2023-10-03T19:20:54.687 INFO:teuthology.orchestra.run.smithi045.stdout: -4106> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_413 [2,head] auth (dversion lock) v=4136 ino=0x10000000392 state=1073741824 0x55cf6227cf00] 2023-10-03T19:20:54.687 INFO:teuthology.orchestra.run.smithi045.stdout: -4105> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.688 INFO:teuthology.orchestra.run.smithi045.stdout: -4104> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000392 [2,head] /dc-dir/dc-file_413 auth v4136 s=3 n(v0 rc2023-10-03T19:13:39.210967+0000 b3 1=1+0) (iversion lock) 0x55cf62281b80] 2023-10-03T19:20:54.688 INFO:teuthology.orchestra.run.smithi045.stdout: -4103> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_413 [2,head] auth (dversion lock) v=4136 ino=0x10000000392 state=1073741824 0x55cf6227cf00] [inode 0x10000000392 [2,head] /dc-dir/dc-file_413 auth v4136 s=3 n(v0 rc2023-10-03T19:13:39.210967+0000 b3 1=1+0) (iversion lock) 0x55cf62281b80] 2023-10-03T19:20:54.688 INFO:teuthology.orchestra.run.smithi045.stdout: -4102> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000392 [2,head] #10000000392 auth v4136 s=3 n(v0 rc2023-10-03T19:13:39.210967+0000 b3 1=1+0) (iversion lock) 0x55cf62281b80] 2023-10-03T19:20:54.688 INFO:teuthology.orchestra.run.smithi045.stdout: -4101> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_413 [2,head] auth NULL (dversion lock) v=4136 ino=(nil) state=1073741824 0x55cf6227cf00] 2023-10-03T19:20:54.688 INFO:teuthology.orchestra.run.smithi045.stdout: -4100> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_412 [2,head] auth (dversion lock) v=4134 ino=0x10000000391 state=1073741824 0x55cf6227cc80] 2023-10-03T19:20:54.688 INFO:teuthology.orchestra.run.smithi045.stdout: -4099> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.688 INFO:teuthology.orchestra.run.smithi045.stdout: -4098> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000391 [2,head] /dc-dir/dc-file_412 auth v4134 s=3 n(v0 rc2023-10-03T19:13:39.200003+0000 b3 1=1+0) (iversion lock) 0x55cf62281600] 2023-10-03T19:20:54.688 INFO:teuthology.orchestra.run.smithi045.stdout: -4097> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_412 [2,head] auth (dversion lock) v=4134 ino=0x10000000391 state=1073741824 0x55cf6227cc80] [inode 0x10000000391 [2,head] /dc-dir/dc-file_412 auth v4134 s=3 n(v0 rc2023-10-03T19:13:39.200003+0000 b3 1=1+0) (iversion lock) 0x55cf62281600] 2023-10-03T19:20:54.688 INFO:teuthology.orchestra.run.smithi045.stdout: -4096> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000391 [2,head] #10000000391 auth v4134 s=3 n(v0 rc2023-10-03T19:13:39.200003+0000 b3 1=1+0) (iversion lock) 0x55cf62281600] 2023-10-03T19:20:54.688 INFO:teuthology.orchestra.run.smithi045.stdout: -4095> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_412 [2,head] auth NULL (dversion lock) v=4134 ino=(nil) state=1073741824 0x55cf6227cc80] 2023-10-03T19:20:54.688 INFO:teuthology.orchestra.run.smithi045.stdout: -4094> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_411 [2,head] auth (dversion lock) v=4132 ino=0x10000000390 state=1073741824 0x55cf6227ca00] 2023-10-03T19:20:54.689 INFO:teuthology.orchestra.run.smithi045.stdout: -4093> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.689 INFO:teuthology.orchestra.run.smithi045.stdout: -4092> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000390 [2,head] /dc-dir/dc-file_411 auth v4132 s=3 n(v0 rc2023-10-03T19:13:39.188460+0000 b3 1=1+0) (iversion lock) 0x55cf62281080] 2023-10-03T19:20:54.689 INFO:teuthology.orchestra.run.smithi045.stdout: -4091> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_411 [2,head] auth (dversion lock) v=4132 ino=0x10000000390 state=1073741824 0x55cf6227ca00] [inode 0x10000000390 [2,head] /dc-dir/dc-file_411 auth v4132 s=3 n(v0 rc2023-10-03T19:13:39.188460+0000 b3 1=1+0) (iversion lock) 0x55cf62281080] 2023-10-03T19:20:54.689 INFO:teuthology.orchestra.run.smithi045.stdout: -4090> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000390 [2,head] #10000000390 auth v4132 s=3 n(v0 rc2023-10-03T19:13:39.188460+0000 b3 1=1+0) (iversion lock) 0x55cf62281080] 2023-10-03T19:20:54.782 INFO:teuthology.orchestra.run.smithi045.stdout: -4089> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_411 [2,head] auth NULL (dversion lock) v=4132 ino=(nil) state=1073741824 0x55cf6227ca00] 2023-10-03T19:20:54.783 INFO:teuthology.orchestra.run.smithi045.stdout: -4088> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_410 [2,head] auth (dversion lock) v=4130 ino=0x1000000038f state=1073741824 0x55cf6227c780] 2023-10-03T19:20:54.783 INFO:teuthology.orchestra.run.smithi045.stdout: -4087> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.783 INFO:teuthology.orchestra.run.smithi045.stdout: -4086> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000038f [2,head] /dc-dir/dc-file_410 auth v4130 s=3 n(v0 rc2023-10-03T19:13:39.177775+0000 b3 1=1+0) (iversion lock) 0x55cf62280b00] 2023-10-03T19:20:54.783 INFO:teuthology.orchestra.run.smithi045.stdout: -4085> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_410 [2,head] auth (dversion lock) v=4130 ino=0x1000000038f state=1073741824 0x55cf6227c780] [inode 0x1000000038f [2,head] /dc-dir/dc-file_410 auth v4130 s=3 n(v0 rc2023-10-03T19:13:39.177775+0000 b3 1=1+0) (iversion lock) 0x55cf62280b00] 2023-10-03T19:20:54.783 INFO:teuthology.orchestra.run.smithi045.stdout: -4084> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000038f [2,head] #1000000038f auth v4130 s=3 n(v0 rc2023-10-03T19:13:39.177775+0000 b3 1=1+0) (iversion lock) 0x55cf62280b00] 2023-10-03T19:20:54.783 INFO:teuthology.orchestra.run.smithi045.stdout: -4083> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_410 [2,head] auth NULL (dversion lock) v=4130 ino=(nil) state=1073741824 0x55cf6227c780] 2023-10-03T19:20:54.783 INFO:teuthology.orchestra.run.smithi045.stdout: -4082> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_409 [2,head] auth (dversion lock) v=4128 ino=0x1000000038e state=1073741824 0x55cf6227c500] 2023-10-03T19:20:54.783 INFO:teuthology.orchestra.run.smithi045.stdout: -4081> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.783 INFO:teuthology.orchestra.run.smithi045.stdout: -4080> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000038e [2,head] /dc-dir/dc-file_409 auth v4128 s=3 n(v0 rc2023-10-03T19:13:39.166612+0000 b3 1=1+0) (iversion lock) 0x55cf62280580] 2023-10-03T19:20:54.783 INFO:teuthology.orchestra.run.smithi045.stdout: -4079> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_409 [2,head] auth (dversion lock) v=4128 ino=0x1000000038e state=1073741824 0x55cf6227c500] [inode 0x1000000038e [2,head] /dc-dir/dc-file_409 auth v4128 s=3 n(v0 rc2023-10-03T19:13:39.166612+0000 b3 1=1+0) (iversion lock) 0x55cf62280580] 2023-10-03T19:20:54.783 INFO:teuthology.orchestra.run.smithi045.stdout: -4078> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000038e [2,head] #1000000038e auth v4128 s=3 n(v0 rc2023-10-03T19:13:39.166612+0000 b3 1=1+0) (iversion lock) 0x55cf62280580] 2023-10-03T19:20:54.783 INFO:teuthology.orchestra.run.smithi045.stdout: -4077> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_409 [2,head] auth NULL (dversion lock) v=4128 ino=(nil) state=1073741824 0x55cf6227c500] 2023-10-03T19:20:54.784 INFO:teuthology.orchestra.run.smithi045.stdout: -4076> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_408 [2,head] auth (dversion lock) v=4126 ino=0x1000000038d state=1073741824 0x55cf6227c280] 2023-10-03T19:20:54.784 INFO:teuthology.orchestra.run.smithi045.stdout: -4075> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.784 INFO:teuthology.orchestra.run.smithi045.stdout: -4074> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000038d [2,head] /dc-dir/dc-file_408 auth v4126 s=3 n(v0 rc2023-10-03T19:13:39.155423+0000 b3 1=1+0) (iversion lock) 0x55cf62280000] 2023-10-03T19:20:54.784 INFO:teuthology.orchestra.run.smithi045.stdout: -4073> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_408 [2,head] auth (dversion lock) v=4126 ino=0x1000000038d state=1073741824 0x55cf6227c280] [inode 0x1000000038d [2,head] /dc-dir/dc-file_408 auth v4126 s=3 n(v0 rc2023-10-03T19:13:39.155423+0000 b3 1=1+0) (iversion lock) 0x55cf62280000] 2023-10-03T19:20:54.784 INFO:teuthology.orchestra.run.smithi045.stdout: -4072> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000038d [2,head] #1000000038d auth v4126 s=3 n(v0 rc2023-10-03T19:13:39.155423+0000 b3 1=1+0) (iversion lock) 0x55cf62280000] 2023-10-03T19:20:54.784 INFO:teuthology.orchestra.run.smithi045.stdout: -4071> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_408 [2,head] auth NULL (dversion lock) v=4126 ino=(nil) state=1073741824 0x55cf6227c280] 2023-10-03T19:20:54.784 INFO:teuthology.orchestra.run.smithi045.stdout: -4070> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_407 [2,head] auth (dversion lock) v=4124 ino=0x1000000038c state=1073741824 0x55cf6227c000] 2023-10-03T19:20:54.784 INFO:teuthology.orchestra.run.smithi045.stdout: -4069> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.784 INFO:teuthology.orchestra.run.smithi045.stdout: -4068> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000038c [2,head] /dc-dir/dc-file_407 auth v4124 s=3 n(v0 rc2023-10-03T19:13:39.144183+0000 b3 1=1+0) (iversion lock) 0x55cf621d5700] 2023-10-03T19:20:54.785 INFO:teuthology.orchestra.run.smithi045.stdout: -4067> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_407 [2,head] auth (dversion lock) v=4124 ino=0x1000000038c state=1073741824 0x55cf6227c000] [inode 0x1000000038c [2,head] /dc-dir/dc-file_407 auth v4124 s=3 n(v0 rc2023-10-03T19:13:39.144183+0000 b3 1=1+0) (iversion lock) 0x55cf621d5700] 2023-10-03T19:20:54.785 INFO:teuthology.orchestra.run.smithi045.stdout: -4066> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000038c [2,head] #1000000038c auth v4124 s=3 n(v0 rc2023-10-03T19:13:39.144183+0000 b3 1=1+0) (iversion lock) 0x55cf621d5700] 2023-10-03T19:20:54.785 INFO:teuthology.orchestra.run.smithi045.stdout: -4065> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_407 [2,head] auth NULL (dversion lock) v=4124 ino=(nil) state=1073741824 0x55cf6227c000] 2023-10-03T19:20:54.785 INFO:teuthology.orchestra.run.smithi045.stdout: -4064> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_406 [2,head] auth (dversion lock) v=4122 ino=0x1000000038b state=1073741824 0x55cf621cfb80] 2023-10-03T19:20:54.785 INFO:teuthology.orchestra.run.smithi045.stdout: -4063> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.785 INFO:teuthology.orchestra.run.smithi045.stdout: -4062> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000038b [2,head] /dc-dir/dc-file_406 auth v4122 s=3 n(v0 rc2023-10-03T19:13:39.133568+0000 b3 1=1+0) (iversion lock) 0x55cf621d5180] 2023-10-03T19:20:54.785 INFO:teuthology.orchestra.run.smithi045.stdout: -4061> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_406 [2,head] auth (dversion lock) v=4122 ino=0x1000000038b state=1073741824 0x55cf621cfb80] [inode 0x1000000038b [2,head] /dc-dir/dc-file_406 auth v4122 s=3 n(v0 rc2023-10-03T19:13:39.133568+0000 b3 1=1+0) (iversion lock) 0x55cf621d5180] 2023-10-03T19:20:54.785 INFO:teuthology.orchestra.run.smithi045.stdout: -4060> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000038b [2,head] #1000000038b auth v4122 s=3 n(v0 rc2023-10-03T19:13:39.133568+0000 b3 1=1+0) (iversion lock) 0x55cf621d5180] 2023-10-03T19:20:54.785 INFO:teuthology.orchestra.run.smithi045.stdout: -4059> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_406 [2,head] auth NULL (dversion lock) v=4122 ino=(nil) state=1073741824 0x55cf621cfb80] 2023-10-03T19:20:54.786 INFO:teuthology.orchestra.run.smithi045.stdout: -4058> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_405 [2,head] auth (dversion lock) v=4120 ino=0x1000000038a state=1073741824 0x55cf621cf900] 2023-10-03T19:20:54.786 INFO:teuthology.orchestra.run.smithi045.stdout: -4057> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.786 INFO:teuthology.orchestra.run.smithi045.stdout: -4056> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000038a [2,head] /dc-dir/dc-file_405 auth v4120 s=3 n(v0 rc2023-10-03T19:13:39.122820+0000 b3 1=1+0) (iversion lock) 0x55cf621d4c00] 2023-10-03T19:20:54.786 INFO:teuthology.orchestra.run.smithi045.stdout: -4055> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_405 [2,head] auth (dversion lock) v=4120 ino=0x1000000038a state=1073741824 0x55cf621cf900] [inode 0x1000000038a [2,head] /dc-dir/dc-file_405 auth v4120 s=3 n(v0 rc2023-10-03T19:13:39.122820+0000 b3 1=1+0) (iversion lock) 0x55cf621d4c00] 2023-10-03T19:20:54.786 INFO:teuthology.orchestra.run.smithi045.stdout: -4054> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000038a [2,head] #1000000038a auth v4120 s=3 n(v0 rc2023-10-03T19:13:39.122820+0000 b3 1=1+0) (iversion lock) 0x55cf621d4c00] 2023-10-03T19:20:54.786 INFO:teuthology.orchestra.run.smithi045.stdout: -4053> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_405 [2,head] auth NULL (dversion lock) v=4120 ino=(nil) state=1073741824 0x55cf621cf900] 2023-10-03T19:20:54.786 INFO:teuthology.orchestra.run.smithi045.stdout: -4052> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_404 [2,head] auth (dversion lock) v=4118 ino=0x10000000389 state=1073741824 0x55cf621cf680] 2023-10-03T19:20:54.786 INFO:teuthology.orchestra.run.smithi045.stdout: -4051> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.786 INFO:teuthology.orchestra.run.smithi045.stdout: -4050> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000389 [2,head] /dc-dir/dc-file_404 auth v4118 s=3 n(v0 rc2023-10-03T19:13:39.111842+0000 b3 1=1+0) (iversion lock) 0x55cf621d4680] 2023-10-03T19:20:54.786 INFO:teuthology.orchestra.run.smithi045.stdout: -4049> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_404 [2,head] auth (dversion lock) v=4118 ino=0x10000000389 state=1073741824 0x55cf621cf680] [inode 0x10000000389 [2,head] /dc-dir/dc-file_404 auth v4118 s=3 n(v0 rc2023-10-03T19:13:39.111842+0000 b3 1=1+0) (iversion lock) 0x55cf621d4680] 2023-10-03T19:20:54.787 INFO:teuthology.orchestra.run.smithi045.stdout: -4048> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000389 [2,head] #10000000389 auth v4118 s=3 n(v0 rc2023-10-03T19:13:39.111842+0000 b3 1=1+0) (iversion lock) 0x55cf621d4680] 2023-10-03T19:20:54.787 INFO:teuthology.orchestra.run.smithi045.stdout: -4047> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_404 [2,head] auth NULL (dversion lock) v=4118 ino=(nil) state=1073741824 0x55cf621cf680] 2023-10-03T19:20:54.787 INFO:teuthology.orchestra.run.smithi045.stdout: -4046> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_403 [2,head] auth (dversion lock) v=4116 ino=0x10000000388 state=1073741824 0x55cf621cf400] 2023-10-03T19:20:54.787 INFO:teuthology.orchestra.run.smithi045.stdout: -4045> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.787 INFO:teuthology.orchestra.run.smithi045.stdout: -4044> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000388 [2,head] /dc-dir/dc-file_403 auth v4116 s=3 n(v0 rc2023-10-03T19:13:39.100921+0000 b3 1=1+0) (iversion lock) 0x55cf621d4100] 2023-10-03T19:20:54.787 INFO:teuthology.orchestra.run.smithi045.stdout: -4043> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_403 [2,head] auth (dversion lock) v=4116 ino=0x10000000388 state=1073741824 0x55cf621cf400] [inode 0x10000000388 [2,head] /dc-dir/dc-file_403 auth v4116 s=3 n(v0 rc2023-10-03T19:13:39.100921+0000 b3 1=1+0) (iversion lock) 0x55cf621d4100] 2023-10-03T19:20:54.787 INFO:teuthology.orchestra.run.smithi045.stdout: -4042> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000388 [2,head] #10000000388 auth v4116 s=3 n(v0 rc2023-10-03T19:13:39.100921+0000 b3 1=1+0) (iversion lock) 0x55cf621d4100] 2023-10-03T19:20:54.787 INFO:teuthology.orchestra.run.smithi045.stdout: -4041> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_403 [2,head] auth NULL (dversion lock) v=4116 ino=(nil) state=1073741824 0x55cf621cf400] 2023-10-03T19:20:54.787 INFO:teuthology.orchestra.run.smithi045.stdout: -4040> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_402 [2,head] auth (dversion lock) v=4114 ino=0x10000000387 state=1073741824 0x55cf621cf180] 2023-10-03T19:20:54.787 INFO:teuthology.orchestra.run.smithi045.stdout: -4039> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.787 INFO:teuthology.orchestra.run.smithi045.stdout: -4038> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000387 [2,head] /dc-dir/dc-file_402 auth v4114 s=3 n(v0 rc2023-10-03T19:13:39.090173+0000 b3 1=1+0) (iversion lock) 0x55cf621d3b80] 2023-10-03T19:20:54.787 INFO:teuthology.orchestra.run.smithi045.stdout: -4037> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_402 [2,head] auth (dversion lock) v=4114 ino=0x10000000387 state=1073741824 0x55cf621cf180] [inode 0x10000000387 [2,head] /dc-dir/dc-file_402 auth v4114 s=3 n(v0 rc2023-10-03T19:13:39.090173+0000 b3 1=1+0) (iversion lock) 0x55cf621d3b80] 2023-10-03T19:20:54.788 INFO:teuthology.orchestra.run.smithi045.stdout: -4036> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000387 [2,head] #10000000387 auth v4114 s=3 n(v0 rc2023-10-03T19:13:39.090173+0000 b3 1=1+0) (iversion lock) 0x55cf621d3b80] 2023-10-03T19:20:54.788 INFO:teuthology.orchestra.run.smithi045.stdout: -4035> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_402 [2,head] auth NULL (dversion lock) v=4114 ino=(nil) state=1073741824 0x55cf621cf180] 2023-10-03T19:20:54.788 INFO:teuthology.orchestra.run.smithi045.stdout: -4034> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_401 [2,head] auth (dversion lock) v=4112 ino=0x10000000386 state=1073741824 0x55cf621cef00] 2023-10-03T19:20:54.788 INFO:teuthology.orchestra.run.smithi045.stdout: -4033> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.788 INFO:teuthology.orchestra.run.smithi045.stdout: -4032> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000386 [2,head] /dc-dir/dc-file_401 auth v4112 s=3 n(v0 rc2023-10-03T19:13:39.079078+0000 b3 1=1+0) (iversion lock) 0x55cf621d3600] 2023-10-03T19:20:54.788 INFO:teuthology.orchestra.run.smithi045.stdout: -4031> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_401 [2,head] auth (dversion lock) v=4112 ino=0x10000000386 state=1073741824 0x55cf621cef00] [inode 0x10000000386 [2,head] /dc-dir/dc-file_401 auth v4112 s=3 n(v0 rc2023-10-03T19:13:39.079078+0000 b3 1=1+0) (iversion lock) 0x55cf621d3600] 2023-10-03T19:20:54.788 INFO:teuthology.orchestra.run.smithi045.stdout: -4030> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000386 [2,head] #10000000386 auth v4112 s=3 n(v0 rc2023-10-03T19:13:39.079078+0000 b3 1=1+0) (iversion lock) 0x55cf621d3600] 2023-10-03T19:20:54.788 INFO:teuthology.orchestra.run.smithi045.stdout: -4029> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_401 [2,head] auth NULL (dversion lock) v=4112 ino=(nil) state=1073741824 0x55cf621cef00] 2023-10-03T19:20:54.788 INFO:teuthology.orchestra.run.smithi045.stdout: -4028> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_400 [2,head] auth (dversion lock) v=4110 ino=0x10000000385 state=1073741824 0x55cf621cec80] 2023-10-03T19:20:54.788 INFO:teuthology.orchestra.run.smithi045.stdout: -4027> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.788 INFO:teuthology.orchestra.run.smithi045.stdout: -4026> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000385 [2,head] /dc-dir/dc-file_400 auth v4110 s=3 n(v0 rc2023-10-03T19:13:39.067297+0000 b3 1=1+0) (iversion lock) 0x55cf621d3080] 2023-10-03T19:20:54.789 INFO:teuthology.orchestra.run.smithi045.stdout: -4025> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_400 [2,head] auth (dversion lock) v=4110 ino=0x10000000385 state=1073741824 0x55cf621cec80] [inode 0x10000000385 [2,head] /dc-dir/dc-file_400 auth v4110 s=3 n(v0 rc2023-10-03T19:13:39.067297+0000 b3 1=1+0) (iversion lock) 0x55cf621d3080] 2023-10-03T19:20:54.789 INFO:teuthology.orchestra.run.smithi045.stdout: -4024> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000385 [2,head] #10000000385 auth v4110 s=3 n(v0 rc2023-10-03T19:13:39.067297+0000 b3 1=1+0) (iversion lock) 0x55cf621d3080] 2023-10-03T19:20:54.789 INFO:teuthology.orchestra.run.smithi045.stdout: -4023> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_400 [2,head] auth NULL (dversion lock) v=4110 ino=(nil) state=1073741824 0x55cf621cec80] 2023-10-03T19:20:54.789 INFO:teuthology.orchestra.run.smithi045.stdout: -4022> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_399 [2,head] auth (dversion lock) v=4108 ino=0x10000000384 state=1073741824 0x55cf621cea00] 2023-10-03T19:20:54.789 INFO:teuthology.orchestra.run.smithi045.stdout: -4021> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.789 INFO:teuthology.orchestra.run.smithi045.stdout: -4020> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000384 [2,head] /dc-dir/dc-file_399 auth v4108 s=3 n(v0 rc2023-10-03T19:13:39.055818+0000 b3 1=1+0) (iversion lock) 0x55cf621d2b00] 2023-10-03T19:20:54.789 INFO:teuthology.orchestra.run.smithi045.stdout: -4019> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_399 [2,head] auth (dversion lock) v=4108 ino=0x10000000384 state=1073741824 0x55cf621cea00] [inode 0x10000000384 [2,head] /dc-dir/dc-file_399 auth v4108 s=3 n(v0 rc2023-10-03T19:13:39.055818+0000 b3 1=1+0) (iversion lock) 0x55cf621d2b00] 2023-10-03T19:20:54.790 INFO:teuthology.orchestra.run.smithi045.stdout: -4018> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000384 [2,head] #10000000384 auth v4108 s=3 n(v0 rc2023-10-03T19:13:39.055818+0000 b3 1=1+0) (iversion lock) 0x55cf621d2b00] 2023-10-03T19:20:54.790 INFO:teuthology.orchestra.run.smithi045.stdout: -4017> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_399 [2,head] auth NULL (dversion lock) v=4108 ino=(nil) state=1073741824 0x55cf621cea00] 2023-10-03T19:20:54.790 INFO:teuthology.orchestra.run.smithi045.stdout: -4016> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_398 [2,head] auth (dversion lock) v=4106 ino=0x10000000383 state=1073741824 0x55cf621ce780] 2023-10-03T19:20:54.790 INFO:teuthology.orchestra.run.smithi045.stdout: -4015> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.790 INFO:teuthology.orchestra.run.smithi045.stdout: -4014> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000383 [2,head] /dc-dir/dc-file_398 auth v4106 s=3 n(v0 rc2023-10-03T19:13:39.042619+0000 b3 1=1+0) (iversion lock) 0x55cf621d2580] 2023-10-03T19:20:54.790 INFO:teuthology.orchestra.run.smithi045.stdout: -4013> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_398 [2,head] auth (dversion lock) v=4106 ino=0x10000000383 state=1073741824 0x55cf621ce780] [inode 0x10000000383 [2,head] /dc-dir/dc-file_398 auth v4106 s=3 n(v0 rc2023-10-03T19:13:39.042619+0000 b3 1=1+0) (iversion lock) 0x55cf621d2580] 2023-10-03T19:20:54.791 INFO:teuthology.orchestra.run.smithi045.stdout: -4012> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000383 [2,head] #10000000383 auth v4106 s=3 n(v0 rc2023-10-03T19:13:39.042619+0000 b3 1=1+0) (iversion lock) 0x55cf621d2580] 2023-10-03T19:20:54.791 INFO:teuthology.orchestra.run.smithi045.stdout: -4011> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_398 [2,head] auth NULL (dversion lock) v=4106 ino=(nil) state=1073741824 0x55cf621ce780] 2023-10-03T19:20:54.791 INFO:teuthology.orchestra.run.smithi045.stdout: -4010> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_397 [2,head] auth (dversion lock) v=4104 ino=0x10000000382 state=1073741824 0x55cf621ce500] 2023-10-03T19:20:54.791 INFO:teuthology.orchestra.run.smithi045.stdout: -4009> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.791 INFO:teuthology.orchestra.run.smithi045.stdout: -4008> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000382 [2,head] /dc-dir/dc-file_397 auth v4104 s=3 n(v0 rc2023-10-03T19:13:39.029585+0000 b3 1=1+0) (iversion lock) 0x55cf621d2000] 2023-10-03T19:20:54.791 INFO:teuthology.orchestra.run.smithi045.stdout: -4007> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_397 [2,head] auth (dversion lock) v=4104 ino=0x10000000382 state=1073741824 0x55cf621ce500] [inode 0x10000000382 [2,head] /dc-dir/dc-file_397 auth v4104 s=3 n(v0 rc2023-10-03T19:13:39.029585+0000 b3 1=1+0) (iversion lock) 0x55cf621d2000] 2023-10-03T19:20:54.791 INFO:teuthology.orchestra.run.smithi045.stdout: -4006> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000382 [2,head] #10000000382 auth v4104 s=3 n(v0 rc2023-10-03T19:13:39.029585+0000 b3 1=1+0) (iversion lock) 0x55cf621d2000] 2023-10-03T19:20:54.791 INFO:teuthology.orchestra.run.smithi045.stdout: -4005> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_397 [2,head] auth NULL (dversion lock) v=4104 ino=(nil) state=1073741824 0x55cf621ce500] 2023-10-03T19:20:54.791 INFO:teuthology.orchestra.run.smithi045.stdout: -4004> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_396 [2,head] auth (dversion lock) v=4102 ino=0x10000000381 state=1073741824 0x55cf621ce280] 2023-10-03T19:20:54.791 INFO:teuthology.orchestra.run.smithi045.stdout: -4003> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.791 INFO:teuthology.orchestra.run.smithi045.stdout: -4002> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000381 [2,head] /dc-dir/dc-file_396 auth v4102 s=3 n(v0 rc2023-10-03T19:13:39.017118+0000 b3 1=1+0) (iversion lock) 0x55cf621c9700] 2023-10-03T19:20:54.792 INFO:teuthology.orchestra.run.smithi045.stdout: -4001> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_396 [2,head] auth (dversion lock) v=4102 ino=0x10000000381 state=1073741824 0x55cf621ce280] [inode 0x10000000381 [2,head] /dc-dir/dc-file_396 auth v4102 s=3 n(v0 rc2023-10-03T19:13:39.017118+0000 b3 1=1+0) (iversion lock) 0x55cf621c9700] 2023-10-03T19:20:54.792 INFO:teuthology.orchestra.run.smithi045.stdout: -4000> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000381 [2,head] #10000000381 auth v4102 s=3 n(v0 rc2023-10-03T19:13:39.017118+0000 b3 1=1+0) (iversion lock) 0x55cf621c9700] 2023-10-03T19:20:54.792 INFO:teuthology.orchestra.run.smithi045.stdout: -3999> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_396 [2,head] auth NULL (dversion lock) v=4102 ino=(nil) state=1073741824 0x55cf621ce280] 2023-10-03T19:20:54.792 INFO:teuthology.orchestra.run.smithi045.stdout: -3998> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_395 [2,head] auth (dversion lock) v=4100 ino=0x10000000380 state=1073741824 0x55cf621ce000] 2023-10-03T19:20:54.792 INFO:teuthology.orchestra.run.smithi045.stdout: -3997> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.792 INFO:teuthology.orchestra.run.smithi045.stdout: -3996> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000380 [2,head] /dc-dir/dc-file_395 auth v4100 s=3 n(v0 rc2023-10-03T19:13:39.006388+0000 b3 1=1+0) (iversion lock) 0x55cf621c9180] 2023-10-03T19:20:54.792 INFO:teuthology.orchestra.run.smithi045.stdout: -3995> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_395 [2,head] auth (dversion lock) v=4100 ino=0x10000000380 state=1073741824 0x55cf621ce000] [inode 0x10000000380 [2,head] /dc-dir/dc-file_395 auth v4100 s=3 n(v0 rc2023-10-03T19:13:39.006388+0000 b3 1=1+0) (iversion lock) 0x55cf621c9180] 2023-10-03T19:20:54.792 INFO:teuthology.orchestra.run.smithi045.stdout: -3994> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000380 [2,head] #10000000380 auth v4100 s=3 n(v0 rc2023-10-03T19:13:39.006388+0000 b3 1=1+0) (iversion lock) 0x55cf621c9180] 2023-10-03T19:20:54.792 INFO:teuthology.orchestra.run.smithi045.stdout: -3993> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_395 [2,head] auth NULL (dversion lock) v=4100 ino=(nil) state=1073741824 0x55cf621ce000] 2023-10-03T19:20:54.792 INFO:teuthology.orchestra.run.smithi045.stdout: -3992> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_394 [2,head] auth (dversion lock) v=4098 ino=0x1000000037f state=1073741824 0x55cf621c1b80] 2023-10-03T19:20:54.792 INFO:teuthology.orchestra.run.smithi045.stdout: -3991> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.793 INFO:teuthology.orchestra.run.smithi045.stdout: -3990> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000037f [2,head] /dc-dir/dc-file_394 auth v4098 s=3 n(v0 rc2023-10-03T19:13:38.995357+0000 b3 1=1+0) (iversion lock) 0x55cf621c8c00] 2023-10-03T19:20:54.793 INFO:teuthology.orchestra.run.smithi045.stdout: -3989> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_394 [2,head] auth (dversion lock) v=4098 ino=0x1000000037f state=1073741824 0x55cf621c1b80] [inode 0x1000000037f [2,head] /dc-dir/dc-file_394 auth v4098 s=3 n(v0 rc2023-10-03T19:13:38.995357+0000 b3 1=1+0) (iversion lock) 0x55cf621c8c00] 2023-10-03T19:20:54.793 INFO:teuthology.orchestra.run.smithi045.stdout: -3988> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000037f [2,head] #1000000037f auth v4098 s=3 n(v0 rc2023-10-03T19:13:38.995357+0000 b3 1=1+0) (iversion lock) 0x55cf621c8c00] 2023-10-03T19:20:54.793 INFO:teuthology.orchestra.run.smithi045.stdout: -3987> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_394 [2,head] auth NULL (dversion lock) v=4098 ino=(nil) state=1073741824 0x55cf621c1b80] 2023-10-03T19:20:54.793 INFO:teuthology.orchestra.run.smithi045.stdout: -3986> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_393 [2,head] auth (dversion lock) v=4096 ino=0x1000000037e state=1073741824 0x55cf621c1900] 2023-10-03T19:20:54.793 INFO:teuthology.orchestra.run.smithi045.stdout: -3985> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.793 INFO:teuthology.orchestra.run.smithi045.stdout: -3984> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000037e [2,head] /dc-dir/dc-file_393 auth v4096 s=3 n(v0 rc2023-10-03T19:13:38.983956+0000 b3 1=1+0) (iversion lock) 0x55cf621c8680] 2023-10-03T19:20:54.793 INFO:teuthology.orchestra.run.smithi045.stdout: -3983> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_393 [2,head] auth (dversion lock) v=4096 ino=0x1000000037e state=1073741824 0x55cf621c1900] [inode 0x1000000037e [2,head] /dc-dir/dc-file_393 auth v4096 s=3 n(v0 rc2023-10-03T19:13:38.983956+0000 b3 1=1+0) (iversion lock) 0x55cf621c8680] 2023-10-03T19:20:54.793 INFO:teuthology.orchestra.run.smithi045.stdout: -3982> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000037e [2,head] #1000000037e auth v4096 s=3 n(v0 rc2023-10-03T19:13:38.983956+0000 b3 1=1+0) (iversion lock) 0x55cf621c8680] 2023-10-03T19:20:54.793 INFO:teuthology.orchestra.run.smithi045.stdout: -3981> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_393 [2,head] auth NULL (dversion lock) v=4096 ino=(nil) state=1073741824 0x55cf621c1900] 2023-10-03T19:20:54.793 INFO:teuthology.orchestra.run.smithi045.stdout: -3980> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_392 [2,head] auth (dversion lock) v=4094 ino=0x1000000037d state=1073741824 0x55cf621c1680] 2023-10-03T19:20:54.793 INFO:teuthology.orchestra.run.smithi045.stdout: -3979> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.794 INFO:teuthology.orchestra.run.smithi045.stdout: -3978> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000037d [2,head] /dc-dir/dc-file_392 auth v4094 s=3 n(v0 rc2023-10-03T19:13:38.972974+0000 b3 1=1+0) (iversion lock) 0x55cf621c8100] 2023-10-03T19:20:54.794 INFO:teuthology.orchestra.run.smithi045.stdout: -3977> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_392 [2,head] auth (dversion lock) v=4094 ino=0x1000000037d state=1073741824 0x55cf621c1680] [inode 0x1000000037d [2,head] /dc-dir/dc-file_392 auth v4094 s=3 n(v0 rc2023-10-03T19:13:38.972974+0000 b3 1=1+0) (iversion lock) 0x55cf621c8100] 2023-10-03T19:20:54.794 INFO:teuthology.orchestra.run.smithi045.stdout: -3976> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000037d [2,head] #1000000037d auth v4094 s=3 n(v0 rc2023-10-03T19:13:38.972974+0000 b3 1=1+0) (iversion lock) 0x55cf621c8100] 2023-10-03T19:20:54.794 INFO:teuthology.orchestra.run.smithi045.stdout: -3975> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_392 [2,head] auth NULL (dversion lock) v=4094 ino=(nil) state=1073741824 0x55cf621c1680] 2023-10-03T19:20:54.794 INFO:teuthology.orchestra.run.smithi045.stdout: -3974> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_391 [2,head] auth (dversion lock) v=4092 ino=0x1000000037c state=1073741824 0x55cf621c1400] 2023-10-03T19:20:54.794 INFO:teuthology.orchestra.run.smithi045.stdout: -3973> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.794 INFO:teuthology.orchestra.run.smithi045.stdout: -3972> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000037c [2,head] /dc-dir/dc-file_391 auth v4092 s=3 n(v0 rc2023-10-03T19:13:38.961596+0000 b3 1=1+0) (iversion lock) 0x55cf621c7b80] 2023-10-03T19:20:54.794 INFO:teuthology.orchestra.run.smithi045.stdout: -3971> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_391 [2,head] auth (dversion lock) v=4092 ino=0x1000000037c state=1073741824 0x55cf621c1400] [inode 0x1000000037c [2,head] /dc-dir/dc-file_391 auth v4092 s=3 n(v0 rc2023-10-03T19:13:38.961596+0000 b3 1=1+0) (iversion lock) 0x55cf621c7b80] 2023-10-03T19:20:54.794 INFO:teuthology.orchestra.run.smithi045.stdout: -3970> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000037c [2,head] #1000000037c auth v4092 s=3 n(v0 rc2023-10-03T19:13:38.961596+0000 b3 1=1+0) (iversion lock) 0x55cf621c7b80] 2023-10-03T19:20:54.794 INFO:teuthology.orchestra.run.smithi045.stdout: -3969> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_391 [2,head] auth NULL (dversion lock) v=4092 ino=(nil) state=1073741824 0x55cf621c1400] 2023-10-03T19:20:54.794 INFO:teuthology.orchestra.run.smithi045.stdout: -3968> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_390 [2,head] auth (dversion lock) v=4090 ino=0x1000000037b state=1073741824 0x55cf621c1180] 2023-10-03T19:20:54.795 INFO:teuthology.orchestra.run.smithi045.stdout: -3967> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.795 INFO:teuthology.orchestra.run.smithi045.stdout: -3966> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000037b [2,head] /dc-dir/dc-file_390 auth v4090 s=3 n(v0 rc2023-10-03T19:13:38.949907+0000 b3 1=1+0) (iversion lock) 0x55cf621c7600] 2023-10-03T19:20:54.795 INFO:teuthology.orchestra.run.smithi045.stdout: -3965> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_390 [2,head] auth (dversion lock) v=4090 ino=0x1000000037b state=1073741824 0x55cf621c1180] [inode 0x1000000037b [2,head] /dc-dir/dc-file_390 auth v4090 s=3 n(v0 rc2023-10-03T19:13:38.949907+0000 b3 1=1+0) (iversion lock) 0x55cf621c7600] 2023-10-03T19:20:54.795 INFO:teuthology.orchestra.run.smithi045.stdout: -3964> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000037b [2,head] #1000000037b auth v4090 s=3 n(v0 rc2023-10-03T19:13:38.949907+0000 b3 1=1+0) (iversion lock) 0x55cf621c7600] 2023-10-03T19:20:54.797 INFO:teuthology.orchestra.run.smithi045.stdout: -3963> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_390 [2,head] auth NULL (dversion lock) v=4090 ino=(nil) state=1073741824 0x55cf621c1180] 2023-10-03T19:20:54.797 INFO:teuthology.orchestra.run.smithi045.stdout: -3962> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_389 [2,head] auth (dversion lock) v=4088 ino=0x1000000037a state=1073741824 0x55cf621c0f00] 2023-10-03T19:20:54.797 INFO:teuthology.orchestra.run.smithi045.stdout: -3961> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.797 INFO:teuthology.orchestra.run.smithi045.stdout: -3960> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000037a [2,head] /dc-dir/dc-file_389 auth v4088 s=3 n(v0 rc2023-10-03T19:13:38.938380+0000 b3 1=1+0) (iversion lock) 0x55cf621c7080] 2023-10-03T19:20:54.797 INFO:teuthology.orchestra.run.smithi045.stdout: -3959> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_389 [2,head] auth (dversion lock) v=4088 ino=0x1000000037a state=1073741824 0x55cf621c0f00] [inode 0x1000000037a [2,head] /dc-dir/dc-file_389 auth v4088 s=3 n(v0 rc2023-10-03T19:13:38.938380+0000 b3 1=1+0) (iversion lock) 0x55cf621c7080] 2023-10-03T19:20:54.797 INFO:teuthology.orchestra.run.smithi045.stdout: -3958> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000037a [2,head] #1000000037a auth v4088 s=3 n(v0 rc2023-10-03T19:13:38.938380+0000 b3 1=1+0) (iversion lock) 0x55cf621c7080] 2023-10-03T19:20:54.797 INFO:teuthology.orchestra.run.smithi045.stdout: -3957> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_389 [2,head] auth NULL (dversion lock) v=4088 ino=(nil) state=1073741824 0x55cf621c0f00] 2023-10-03T19:20:54.797 INFO:teuthology.orchestra.run.smithi045.stdout: -3956> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_388 [2,head] auth (dversion lock) v=4086 ino=0x10000000379 state=1073741824 0x55cf621c0c80] 2023-10-03T19:20:54.797 INFO:teuthology.orchestra.run.smithi045.stdout: -3955> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.798 INFO:teuthology.orchestra.run.smithi045.stdout: -3954> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000379 [2,head] /dc-dir/dc-file_388 auth v4086 s=3 n(v0 rc2023-10-03T19:13:38.927069+0000 b3 1=1+0) (iversion lock) 0x55cf621c6b00] 2023-10-03T19:20:54.798 INFO:teuthology.orchestra.run.smithi045.stdout: -3953> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_388 [2,head] auth (dversion lock) v=4086 ino=0x10000000379 state=1073741824 0x55cf621c0c80] [inode 0x10000000379 [2,head] /dc-dir/dc-file_388 auth v4086 s=3 n(v0 rc2023-10-03T19:13:38.927069+0000 b3 1=1+0) (iversion lock) 0x55cf621c6b00] 2023-10-03T19:20:54.798 INFO:teuthology.orchestra.run.smithi045.stdout: -3952> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000379 [2,head] #10000000379 auth v4086 s=3 n(v0 rc2023-10-03T19:13:38.927069+0000 b3 1=1+0) (iversion lock) 0x55cf621c6b00] 2023-10-03T19:20:54.798 INFO:teuthology.orchestra.run.smithi045.stdout: -3951> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_388 [2,head] auth NULL (dversion lock) v=4086 ino=(nil) state=1073741824 0x55cf621c0c80] 2023-10-03T19:20:54.798 INFO:teuthology.orchestra.run.smithi045.stdout: -3950> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_387 [2,head] auth (dversion lock) v=4084 ino=0x10000000378 state=1073741824 0x55cf621c0a00] 2023-10-03T19:20:54.798 INFO:teuthology.orchestra.run.smithi045.stdout: -3949> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.798 INFO:teuthology.orchestra.run.smithi045.stdout: -3948> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000378 [2,head] /dc-dir/dc-file_387 auth v4084 s=3 n(v0 rc2023-10-03T19:13:38.916121+0000 b3 1=1+0) (iversion lock) 0x55cf621c6580] 2023-10-03T19:20:54.798 INFO:teuthology.orchestra.run.smithi045.stdout: -3947> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_387 [2,head] auth (dversion lock) v=4084 ino=0x10000000378 state=1073741824 0x55cf621c0a00] [inode 0x10000000378 [2,head] /dc-dir/dc-file_387 auth v4084 s=3 n(v0 rc2023-10-03T19:13:38.916121+0000 b3 1=1+0) (iversion lock) 0x55cf621c6580] 2023-10-03T19:20:54.798 INFO:teuthology.orchestra.run.smithi045.stdout: -3946> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000378 [2,head] #10000000378 auth v4084 s=3 n(v0 rc2023-10-03T19:13:38.916121+0000 b3 1=1+0) (iversion lock) 0x55cf621c6580] 2023-10-03T19:20:54.798 INFO:teuthology.orchestra.run.smithi045.stdout: -3945> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_387 [2,head] auth NULL (dversion lock) v=4084 ino=(nil) state=1073741824 0x55cf621c0a00] 2023-10-03T19:20:54.799 INFO:teuthology.orchestra.run.smithi045.stdout: -3944> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_386 [2,head] auth (dversion lock) v=4082 ino=0x10000000377 state=1073741824 0x55cf621c0780] 2023-10-03T19:20:54.799 INFO:teuthology.orchestra.run.smithi045.stdout: -3943> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.799 INFO:teuthology.orchestra.run.smithi045.stdout: -3942> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000377 [2,head] /dc-dir/dc-file_386 auth v4082 s=3 n(v0 rc2023-10-03T19:13:38.905291+0000 b3 1=1+0) (iversion lock) 0x55cf621c6000] 2023-10-03T19:20:54.799 INFO:teuthology.orchestra.run.smithi045.stdout: -3941> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_386 [2,head] auth (dversion lock) v=4082 ino=0x10000000377 state=1073741824 0x55cf621c0780] [inode 0x10000000377 [2,head] /dc-dir/dc-file_386 auth v4082 s=3 n(v0 rc2023-10-03T19:13:38.905291+0000 b3 1=1+0) (iversion lock) 0x55cf621c6000] 2023-10-03T19:20:54.799 INFO:teuthology.orchestra.run.smithi045.stdout: -3940> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000377 [2,head] #10000000377 auth v4082 s=3 n(v0 rc2023-10-03T19:13:38.905291+0000 b3 1=1+0) (iversion lock) 0x55cf621c6000] 2023-10-03T19:20:54.799 INFO:teuthology.orchestra.run.smithi045.stdout: -3939> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_386 [2,head] auth NULL (dversion lock) v=4082 ino=(nil) state=1073741824 0x55cf621c0780] 2023-10-03T19:20:54.799 INFO:teuthology.orchestra.run.smithi045.stdout: -3938> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_385 [2,head] auth (dversion lock) v=4080 ino=0x10000000376 state=1073741824 0x55cf621c0500] 2023-10-03T19:20:54.799 INFO:teuthology.orchestra.run.smithi045.stdout: -3937> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.799 INFO:teuthology.orchestra.run.smithi045.stdout: -3936> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000376 [2,head] /dc-dir/dc-file_385 auth v4080 s=3 n(v0 rc2023-10-03T19:13:38.894388+0000 b3 1=1+0) (iversion lock) 0x55cf621b9700] 2023-10-03T19:20:54.799 INFO:teuthology.orchestra.run.smithi045.stdout: -3935> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_385 [2,head] auth (dversion lock) v=4080 ino=0x10000000376 state=1073741824 0x55cf621c0500] [inode 0x10000000376 [2,head] /dc-dir/dc-file_385 auth v4080 s=3 n(v0 rc2023-10-03T19:13:38.894388+0000 b3 1=1+0) (iversion lock) 0x55cf621b9700] 2023-10-03T19:20:54.799 INFO:teuthology.orchestra.run.smithi045.stdout: -3934> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000376 [2,head] #10000000376 auth v4080 s=3 n(v0 rc2023-10-03T19:13:38.894388+0000 b3 1=1+0) (iversion lock) 0x55cf621b9700] 2023-10-03T19:20:54.800 INFO:teuthology.orchestra.run.smithi045.stdout: -3933> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_385 [2,head] auth NULL (dversion lock) v=4080 ino=(nil) state=1073741824 0x55cf621c0500] 2023-10-03T19:20:54.800 INFO:teuthology.orchestra.run.smithi045.stdout: -3932> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_384 [2,head] auth (dversion lock) v=4078 ino=0x10000000375 state=1073741824 0x55cf621c0280] 2023-10-03T19:20:54.800 INFO:teuthology.orchestra.run.smithi045.stdout: -3931> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.800 INFO:teuthology.orchestra.run.smithi045.stdout: -3930> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000375 [2,head] /dc-dir/dc-file_384 auth v4078 s=3 n(v0 rc2023-10-03T19:13:38.883251+0000 b3 1=1+0) (iversion lock) 0x55cf621b9180] 2023-10-03T19:20:54.800 INFO:teuthology.orchestra.run.smithi045.stdout: -3929> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_384 [2,head] auth (dversion lock) v=4078 ino=0x10000000375 state=1073741824 0x55cf621c0280] [inode 0x10000000375 [2,head] /dc-dir/dc-file_384 auth v4078 s=3 n(v0 rc2023-10-03T19:13:38.883251+0000 b3 1=1+0) (iversion lock) 0x55cf621b9180] 2023-10-03T19:20:54.800 INFO:teuthology.orchestra.run.smithi045.stdout: -3928> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000375 [2,head] #10000000375 auth v4078 s=3 n(v0 rc2023-10-03T19:13:38.883251+0000 b3 1=1+0) (iversion lock) 0x55cf621b9180] 2023-10-03T19:20:54.800 INFO:teuthology.orchestra.run.smithi045.stdout: -3927> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_384 [2,head] auth NULL (dversion lock) v=4078 ino=(nil) state=1073741824 0x55cf621c0280] 2023-10-03T19:20:54.800 INFO:teuthology.orchestra.run.smithi045.stdout: -3926> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_383 [2,head] auth (dversion lock) v=4076 ino=0x10000000374 state=1073741824 0x55cf621c0000] 2023-10-03T19:20:54.800 INFO:teuthology.orchestra.run.smithi045.stdout: -3925> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.800 INFO:teuthology.orchestra.run.smithi045.stdout: -3924> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000374 [2,head] /dc-dir/dc-file_383 auth v4076 s=3 n(v0 rc2023-10-03T19:13:38.871294+0000 b3 1=1+0) (iversion lock) 0x55cf621b8c00] 2023-10-03T19:20:54.800 INFO:teuthology.orchestra.run.smithi045.stdout: -3923> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_383 [2,head] auth (dversion lock) v=4076 ino=0x10000000374 state=1073741824 0x55cf621c0000] [inode 0x10000000374 [2,head] /dc-dir/dc-file_383 auth v4076 s=3 n(v0 rc2023-10-03T19:13:38.871294+0000 b3 1=1+0) (iversion lock) 0x55cf621b8c00] 2023-10-03T19:20:54.801 INFO:teuthology.orchestra.run.smithi045.stdout: -3922> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000374 [2,head] #10000000374 auth v4076 s=3 n(v0 rc2023-10-03T19:13:38.871294+0000 b3 1=1+0) (iversion lock) 0x55cf621b8c00] 2023-10-03T19:20:54.801 INFO:teuthology.orchestra.run.smithi045.stdout: -3921> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_383 [2,head] auth NULL (dversion lock) v=4076 ino=(nil) state=1073741824 0x55cf621c0000] 2023-10-03T19:20:54.801 INFO:teuthology.orchestra.run.smithi045.stdout: -3920> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_382 [2,head] auth (dversion lock) v=4074 ino=0x10000000373 state=1073741824 0x55cf621b3b80] 2023-10-03T19:20:54.801 INFO:teuthology.orchestra.run.smithi045.stdout: -3919> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.801 INFO:teuthology.orchestra.run.smithi045.stdout: -3918> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000373 [2,head] /dc-dir/dc-file_382 auth v4074 s=3 n(v0 rc2023-10-03T19:13:38.860236+0000 b3 1=1+0) (iversion lock) 0x55cf621b8680] 2023-10-03T19:20:54.801 INFO:teuthology.orchestra.run.smithi045.stdout: -3917> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_382 [2,head] auth (dversion lock) v=4074 ino=0x10000000373 state=1073741824 0x55cf621b3b80] [inode 0x10000000373 [2,head] /dc-dir/dc-file_382 auth v4074 s=3 n(v0 rc2023-10-03T19:13:38.860236+0000 b3 1=1+0) (iversion lock) 0x55cf621b8680] 2023-10-03T19:20:54.801 INFO:teuthology.orchestra.run.smithi045.stdout: -3916> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000373 [2,head] #10000000373 auth v4074 s=3 n(v0 rc2023-10-03T19:13:38.860236+0000 b3 1=1+0) (iversion lock) 0x55cf621b8680] 2023-10-03T19:20:54.801 INFO:teuthology.orchestra.run.smithi045.stdout: -3915> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_382 [2,head] auth NULL (dversion lock) v=4074 ino=(nil) state=1073741824 0x55cf621b3b80] 2023-10-03T19:20:54.801 INFO:teuthology.orchestra.run.smithi045.stdout: -3914> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_381 [2,head] auth (dversion lock) v=4072 ino=0x10000000372 state=1073741824 0x55cf621b3900] 2023-10-03T19:20:54.801 INFO:teuthology.orchestra.run.smithi045.stdout: -3913> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.801 INFO:teuthology.orchestra.run.smithi045.stdout: -3912> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000372 [2,head] /dc-dir/dc-file_381 auth v4072 s=3 n(v0 rc2023-10-03T19:13:38.849043+0000 b3 1=1+0) (iversion lock) 0x55cf621b8100] 2023-10-03T19:20:54.801 INFO:teuthology.orchestra.run.smithi045.stdout: -3911> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_381 [2,head] auth (dversion lock) v=4072 ino=0x10000000372 state=1073741824 0x55cf621b3900] [inode 0x10000000372 [2,head] /dc-dir/dc-file_381 auth v4072 s=3 n(v0 rc2023-10-03T19:13:38.849043+0000 b3 1=1+0) (iversion lock) 0x55cf621b8100] 2023-10-03T19:20:54.802 INFO:teuthology.orchestra.run.smithi045.stdout: -3910> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000372 [2,head] #10000000372 auth v4072 s=3 n(v0 rc2023-10-03T19:13:38.849043+0000 b3 1=1+0) (iversion lock) 0x55cf621b8100] 2023-10-03T19:20:54.802 INFO:teuthology.orchestra.run.smithi045.stdout: -3909> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_381 [2,head] auth NULL (dversion lock) v=4072 ino=(nil) state=1073741824 0x55cf621b3900] 2023-10-03T19:20:54.802 INFO:teuthology.orchestra.run.smithi045.stdout: -3908> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_380 [2,head] auth (dversion lock) v=4070 ino=0x10000000371 state=1073741824 0x55cf621b3680] 2023-10-03T19:20:54.802 INFO:teuthology.orchestra.run.smithi045.stdout: -3907> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.802 INFO:teuthology.orchestra.run.smithi045.stdout: -3906> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000371 [2,head] /dc-dir/dc-file_380 auth v4070 s=3 n(v0 rc2023-10-03T19:13:38.837701+0000 b3 1=1+0) (iversion lock) 0x55cf621b7b80] 2023-10-03T19:20:54.887 INFO:teuthology.orchestra.run.smithi045.stdout: -3905> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_380 [2,head] auth (dversion lock) v=4070 ino=0x10000000371 state=1073741824 0x55cf621b3680] [inode 0x10000000371 [2,head] /dc-dir/dc-file_380 auth v4070 s=3 n(v0 rc2023-10-03T19:13:38.837701+0000 b3 1=1+0) (iversion lock) 0x55cf621b7b80] 2023-10-03T19:20:54.887 INFO:teuthology.orchestra.run.smithi045.stdout: -3904> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000371 [2,head] #10000000371 auth v4070 s=3 n(v0 rc2023-10-03T19:13:38.837701+0000 b3 1=1+0) (iversion lock) 0x55cf621b7b80] 2023-10-03T19:20:54.887 INFO:teuthology.orchestra.run.smithi045.stdout: -3903> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_380 [2,head] auth NULL (dversion lock) v=4070 ino=(nil) state=1073741824 0x55cf621b3680] 2023-10-03T19:20:54.887 INFO:teuthology.orchestra.run.smithi045.stdout: -3902> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_379 [2,head] auth (dversion lock) v=4068 ino=0x10000000370 state=1073741824 0x55cf621b3400] 2023-10-03T19:20:54.888 INFO:teuthology.orchestra.run.smithi045.stdout: -3901> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.888 INFO:teuthology.orchestra.run.smithi045.stdout: -3900> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000370 [2,head] /dc-dir/dc-file_379 auth v4068 s=3 n(v0 rc2023-10-03T19:13:38.825194+0000 b3 1=1+0) (iversion lock) 0x55cf621b7600] 2023-10-03T19:20:54.888 INFO:teuthology.orchestra.run.smithi045.stdout: -3899> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_379 [2,head] auth (dversion lock) v=4068 ino=0x10000000370 state=1073741824 0x55cf621b3400] [inode 0x10000000370 [2,head] /dc-dir/dc-file_379 auth v4068 s=3 n(v0 rc2023-10-03T19:13:38.825194+0000 b3 1=1+0) (iversion lock) 0x55cf621b7600] 2023-10-03T19:20:54.888 INFO:teuthology.orchestra.run.smithi045.stdout: -3898> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000370 [2,head] #10000000370 auth v4068 s=3 n(v0 rc2023-10-03T19:13:38.825194+0000 b3 1=1+0) (iversion lock) 0x55cf621b7600] 2023-10-03T19:20:54.888 INFO:teuthology.orchestra.run.smithi045.stdout: -3897> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_379 [2,head] auth NULL (dversion lock) v=4068 ino=(nil) state=1073741824 0x55cf621b3400] 2023-10-03T19:20:54.889 INFO:teuthology.orchestra.run.smithi045.stdout: -3896> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_378 [2,head] auth (dversion lock) v=4066 ino=0x1000000036f state=1073741824 0x55cf621b3180] 2023-10-03T19:20:54.889 INFO:teuthology.orchestra.run.smithi045.stdout: -3895> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.889 INFO:teuthology.orchestra.run.smithi045.stdout: -3894> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000036f [2,head] /dc-dir/dc-file_378 auth v4066 s=3 n(v0 rc2023-10-03T19:13:38.813876+0000 b3 1=1+0) (iversion lock) 0x55cf621b7080] 2023-10-03T19:20:54.889 INFO:teuthology.orchestra.run.smithi045.stdout: -3893> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_378 [2,head] auth (dversion lock) v=4066 ino=0x1000000036f state=1073741824 0x55cf621b3180] [inode 0x1000000036f [2,head] /dc-dir/dc-file_378 auth v4066 s=3 n(v0 rc2023-10-03T19:13:38.813876+0000 b3 1=1+0) (iversion lock) 0x55cf621b7080] 2023-10-03T19:20:54.889 INFO:teuthology.orchestra.run.smithi045.stdout: -3892> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000036f [2,head] #1000000036f auth v4066 s=3 n(v0 rc2023-10-03T19:13:38.813876+0000 b3 1=1+0) (iversion lock) 0x55cf621b7080] 2023-10-03T19:20:54.890 INFO:teuthology.orchestra.run.smithi045.stdout: -3891> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_378 [2,head] auth NULL (dversion lock) v=4066 ino=(nil) state=1073741824 0x55cf621b3180] 2023-10-03T19:20:54.890 INFO:teuthology.orchestra.run.smithi045.stdout: -3890> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_377 [2,head] auth (dversion lock) v=4064 ino=0x1000000036e state=1073741824 0x55cf621b2f00] 2023-10-03T19:20:54.890 INFO:teuthology.orchestra.run.smithi045.stdout: -3889> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.890 INFO:teuthology.orchestra.run.smithi045.stdout: -3888> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000036e [2,head] /dc-dir/dc-file_377 auth v4064 s=3 n(v0 rc2023-10-03T19:13:38.802504+0000 b3 1=1+0) (iversion lock) 0x55cf621b6b00] 2023-10-03T19:20:54.890 INFO:teuthology.orchestra.run.smithi045.stdout: -3887> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_377 [2,head] auth (dversion lock) v=4064 ino=0x1000000036e state=1073741824 0x55cf621b2f00] [inode 0x1000000036e [2,head] /dc-dir/dc-file_377 auth v4064 s=3 n(v0 rc2023-10-03T19:13:38.802504+0000 b3 1=1+0) (iversion lock) 0x55cf621b6b00] 2023-10-03T19:20:54.890 INFO:teuthology.orchestra.run.smithi045.stdout: -3886> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000036e [2,head] #1000000036e auth v4064 s=3 n(v0 rc2023-10-03T19:13:38.802504+0000 b3 1=1+0) (iversion lock) 0x55cf621b6b00] 2023-10-03T19:20:54.890 INFO:teuthology.orchestra.run.smithi045.stdout: -3885> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_377 [2,head] auth NULL (dversion lock) v=4064 ino=(nil) state=1073741824 0x55cf621b2f00] 2023-10-03T19:20:54.890 INFO:teuthology.orchestra.run.smithi045.stdout: -3884> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_376 [2,head] auth (dversion lock) v=4062 ino=0x1000000036d state=1073741824 0x55cf621b2c80] 2023-10-03T19:20:54.890 INFO:teuthology.orchestra.run.smithi045.stdout: -3883> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.891 INFO:teuthology.orchestra.run.smithi045.stdout: -3882> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000036d [2,head] /dc-dir/dc-file_376 auth v4062 s=3 n(v0 rc2023-10-03T19:13:38.790665+0000 b3 1=1+0) (iversion lock) 0x55cf621b6580] 2023-10-03T19:20:54.891 INFO:teuthology.orchestra.run.smithi045.stdout: -3881> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_376 [2,head] auth (dversion lock) v=4062 ino=0x1000000036d state=1073741824 0x55cf621b2c80] [inode 0x1000000036d [2,head] /dc-dir/dc-file_376 auth v4062 s=3 n(v0 rc2023-10-03T19:13:38.790665+0000 b3 1=1+0) (iversion lock) 0x55cf621b6580] 2023-10-03T19:20:54.891 INFO:teuthology.orchestra.run.smithi045.stdout: -3880> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000036d [2,head] #1000000036d auth v4062 s=3 n(v0 rc2023-10-03T19:13:38.790665+0000 b3 1=1+0) (iversion lock) 0x55cf621b6580] 2023-10-03T19:20:54.891 INFO:teuthology.orchestra.run.smithi045.stdout: -3879> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_376 [2,head] auth NULL (dversion lock) v=4062 ino=(nil) state=1073741824 0x55cf621b2c80] 2023-10-03T19:20:54.891 INFO:teuthology.orchestra.run.smithi045.stdout: -3878> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_375 [2,head] auth (dversion lock) v=4060 ino=0x1000000036c state=1073741824 0x55cf621b2a00] 2023-10-03T19:20:54.891 INFO:teuthology.orchestra.run.smithi045.stdout: -3877> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.891 INFO:teuthology.orchestra.run.smithi045.stdout: -3876> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000036c [2,head] /dc-dir/dc-file_375 auth v4060 s=3 n(v0 rc2023-10-03T19:13:38.779328+0000 b3 1=1+0) (iversion lock) 0x55cf621b6000] 2023-10-03T19:20:54.891 INFO:teuthology.orchestra.run.smithi045.stdout: -3875> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_375 [2,head] auth (dversion lock) v=4060 ino=0x1000000036c state=1073741824 0x55cf621b2a00] [inode 0x1000000036c [2,head] /dc-dir/dc-file_375 auth v4060 s=3 n(v0 rc2023-10-03T19:13:38.779328+0000 b3 1=1+0) (iversion lock) 0x55cf621b6000] 2023-10-03T19:20:54.891 INFO:teuthology.orchestra.run.smithi045.stdout: -3874> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000036c [2,head] #1000000036c auth v4060 s=3 n(v0 rc2023-10-03T19:13:38.779328+0000 b3 1=1+0) (iversion lock) 0x55cf621b6000] 2023-10-03T19:20:54.891 INFO:teuthology.orchestra.run.smithi045.stdout: -3873> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_375 [2,head] auth NULL (dversion lock) v=4060 ino=(nil) state=1073741824 0x55cf621b2a00] 2023-10-03T19:20:54.892 INFO:teuthology.orchestra.run.smithi045.stdout: -3872> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_374 [2,head] auth (dversion lock) v=4058 ino=0x1000000036b state=1073741824 0x55cf621b2780] 2023-10-03T19:20:54.892 INFO:teuthology.orchestra.run.smithi045.stdout: -3871> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.892 INFO:teuthology.orchestra.run.smithi045.stdout: -3870> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000036b [2,head] /dc-dir/dc-file_374 auth v4058 s=3 n(v0 rc2023-10-03T19:13:38.766867+0000 b3 1=1+0) (iversion lock) 0x55cf621ab700] 2023-10-03T19:20:54.892 INFO:teuthology.orchestra.run.smithi045.stdout: -3869> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_374 [2,head] auth (dversion lock) v=4058 ino=0x1000000036b state=1073741824 0x55cf621b2780] [inode 0x1000000036b [2,head] /dc-dir/dc-file_374 auth v4058 s=3 n(v0 rc2023-10-03T19:13:38.766867+0000 b3 1=1+0) (iversion lock) 0x55cf621ab700] 2023-10-03T19:20:54.892 INFO:teuthology.orchestra.run.smithi045.stdout: -3868> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000036b [2,head] #1000000036b auth v4058 s=3 n(v0 rc2023-10-03T19:13:38.766867+0000 b3 1=1+0) (iversion lock) 0x55cf621ab700] 2023-10-03T19:20:54.892 INFO:teuthology.orchestra.run.smithi045.stdout: -3867> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_374 [2,head] auth NULL (dversion lock) v=4058 ino=(nil) state=1073741824 0x55cf621b2780] 2023-10-03T19:20:54.892 INFO:teuthology.orchestra.run.smithi045.stdout: -3866> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_373 [2,head] auth (dversion lock) v=4056 ino=0x1000000036a state=1073741824 0x55cf621b2500] 2023-10-03T19:20:54.892 INFO:teuthology.orchestra.run.smithi045.stdout: -3865> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.892 INFO:teuthology.orchestra.run.smithi045.stdout: -3864> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000036a [2,head] /dc-dir/dc-file_373 auth v4056 s=3 n(v0 rc2023-10-03T19:13:38.756144+0000 b3 1=1+0) (iversion lock) 0x55cf621ab180] 2023-10-03T19:20:54.892 INFO:teuthology.orchestra.run.smithi045.stdout: -3863> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_373 [2,head] auth (dversion lock) v=4056 ino=0x1000000036a state=1073741824 0x55cf621b2500] [inode 0x1000000036a [2,head] /dc-dir/dc-file_373 auth v4056 s=3 n(v0 rc2023-10-03T19:13:38.756144+0000 b3 1=1+0) (iversion lock) 0x55cf621ab180] 2023-10-03T19:20:54.892 INFO:teuthology.orchestra.run.smithi045.stdout: -3862> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000036a [2,head] #1000000036a auth v4056 s=3 n(v0 rc2023-10-03T19:13:38.756144+0000 b3 1=1+0) (iversion lock) 0x55cf621ab180] 2023-10-03T19:20:54.893 INFO:teuthology.orchestra.run.smithi045.stdout: -3861> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_373 [2,head] auth NULL (dversion lock) v=4056 ino=(nil) state=1073741824 0x55cf621b2500] 2023-10-03T19:20:54.893 INFO:teuthology.orchestra.run.smithi045.stdout: -3860> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_372 [2,head] auth (dversion lock) v=4054 ino=0x10000000369 state=1073741824 0x55cf621b2280] 2023-10-03T19:20:54.893 INFO:teuthology.orchestra.run.smithi045.stdout: -3859> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.893 INFO:teuthology.orchestra.run.smithi045.stdout: -3858> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000369 [2,head] /dc-dir/dc-file_372 auth v4054 s=3 n(v0 rc2023-10-03T19:13:38.744534+0000 b3 1=1+0) (iversion lock) 0x55cf621aac00] 2023-10-03T19:20:54.893 INFO:teuthology.orchestra.run.smithi045.stdout: -3857> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_372 [2,head] auth (dversion lock) v=4054 ino=0x10000000369 state=1073741824 0x55cf621b2280] [inode 0x10000000369 [2,head] /dc-dir/dc-file_372 auth v4054 s=3 n(v0 rc2023-10-03T19:13:38.744534+0000 b3 1=1+0) (iversion lock) 0x55cf621aac00] 2023-10-03T19:20:54.893 INFO:teuthology.orchestra.run.smithi045.stdout: -3856> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000369 [2,head] #10000000369 auth v4054 s=3 n(v0 rc2023-10-03T19:13:38.744534+0000 b3 1=1+0) (iversion lock) 0x55cf621aac00] 2023-10-03T19:20:54.893 INFO:teuthology.orchestra.run.smithi045.stdout: -3855> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_372 [2,head] auth NULL (dversion lock) v=4054 ino=(nil) state=1073741824 0x55cf621b2280] 2023-10-03T19:20:54.893 INFO:teuthology.orchestra.run.smithi045.stdout: -3854> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_371 [2,head] auth (dversion lock) v=4052 ino=0x10000000368 state=1073741824 0x55cf621b2000] 2023-10-03T19:20:54.893 INFO:teuthology.orchestra.run.smithi045.stdout: -3853> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.893 INFO:teuthology.orchestra.run.smithi045.stdout: -3852> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000368 [2,head] /dc-dir/dc-file_371 auth v4052 s=3 n(v0 rc2023-10-03T19:13:38.733601+0000 b3 1=1+0) (iversion lock) 0x55cf621aa680] 2023-10-03T19:20:54.893 INFO:teuthology.orchestra.run.smithi045.stdout: -3851> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_371 [2,head] auth (dversion lock) v=4052 ino=0x10000000368 state=1073741824 0x55cf621b2000] [inode 0x10000000368 [2,head] /dc-dir/dc-file_371 auth v4052 s=3 n(v0 rc2023-10-03T19:13:38.733601+0000 b3 1=1+0) (iversion lock) 0x55cf621aa680] 2023-10-03T19:20:54.893 INFO:teuthology.orchestra.run.smithi045.stdout: -3850> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000368 [2,head] #10000000368 auth v4052 s=3 n(v0 rc2023-10-03T19:13:38.733601+0000 b3 1=1+0) (iversion lock) 0x55cf621aa680] 2023-10-03T19:20:54.894 INFO:teuthology.orchestra.run.smithi045.stdout: -3849> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_371 [2,head] auth NULL (dversion lock) v=4052 ino=(nil) state=1073741824 0x55cf621b2000] 2023-10-03T19:20:54.894 INFO:teuthology.orchestra.run.smithi045.stdout: -3848> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_370 [2,head] auth (dversion lock) v=4050 ino=0x10000000367 state=1073741824 0x55cf621a5b80] 2023-10-03T19:20:54.894 INFO:teuthology.orchestra.run.smithi045.stdout: -3847> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.940 INFO:teuthology.orchestra.run.smithi045.stdout: -3846> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000367 [2,head] /dc-dir/dc-file_370 auth v4050 s=3 n(v0 rc2023-10-03T19:13:38.722479+0000 b3 1=1+0) (iversion lock) 0x55cf621aa100] 2023-10-03T19:20:54.940 INFO:teuthology.orchestra.run.smithi045.stdout: -3845> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_370 [2,head] auth (dversion lock) v=4050 ino=0x10000000367 state=1073741824 0x55cf621a5b80] [inode 0x10000000367 [2,head] /dc-dir/dc-file_370 auth v4050 s=3 n(v0 rc2023-10-03T19:13:38.722479+0000 b3 1=1+0) (iversion lock) 0x55cf621aa100] 2023-10-03T19:20:54.940 INFO:teuthology.orchestra.run.smithi045.stdout: -3844> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000367 [2,head] #10000000367 auth v4050 s=3 n(v0 rc2023-10-03T19:13:38.722479+0000 b3 1=1+0) (iversion lock) 0x55cf621aa100] 2023-10-03T19:20:54.941 INFO:teuthology.orchestra.run.smithi045.stdout: -3843> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_370 [2,head] auth NULL (dversion lock) v=4050 ino=(nil) state=1073741824 0x55cf621a5b80] 2023-10-03T19:20:54.941 INFO:teuthology.orchestra.run.smithi045.stdout: -3842> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_369 [2,head] auth (dversion lock) v=4048 ino=0x10000000366 state=1073741824 0x55cf621a5900] 2023-10-03T19:20:54.941 INFO:teuthology.orchestra.run.smithi045.stdout: -3841> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.941 INFO:teuthology.orchestra.run.smithi045.stdout: -3840> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000366 [2,head] /dc-dir/dc-file_369 auth v4048 s=3 n(v0 rc2023-10-03T19:13:38.712051+0000 b3 1=1+0) (iversion lock) 0x55cf621a9b80] 2023-10-03T19:20:54.941 INFO:teuthology.orchestra.run.smithi045.stdout: -3839> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_369 [2,head] auth (dversion lock) v=4048 ino=0x10000000366 state=1073741824 0x55cf621a5900] [inode 0x10000000366 [2,head] /dc-dir/dc-file_369 auth v4048 s=3 n(v0 rc2023-10-03T19:13:38.712051+0000 b3 1=1+0) (iversion lock) 0x55cf621a9b80] 2023-10-03T19:20:54.941 INFO:teuthology.orchestra.run.smithi045.stdout: -3838> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000366 [2,head] #10000000366 auth v4048 s=3 n(v0 rc2023-10-03T19:13:38.712051+0000 b3 1=1+0) (iversion lock) 0x55cf621a9b80] 2023-10-03T19:20:54.941 INFO:teuthology.orchestra.run.smithi045.stdout: -3837> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_369 [2,head] auth NULL (dversion lock) v=4048 ino=(nil) state=1073741824 0x55cf621a5900] 2023-10-03T19:20:54.941 INFO:teuthology.orchestra.run.smithi045.stdout: -3836> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_368 [2,head] auth (dversion lock) v=4046 ino=0x10000000365 state=1073741824 0x55cf621a5680] 2023-10-03T19:20:54.941 INFO:teuthology.orchestra.run.smithi045.stdout: -3835> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.941 INFO:teuthology.orchestra.run.smithi045.stdout: -3834> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000365 [2,head] /dc-dir/dc-file_368 auth v4046 s=3 n(v0 rc2023-10-03T19:13:38.701251+0000 b3 1=1+0) (iversion lock) 0x55cf621a9600] 2023-10-03T19:20:54.942 INFO:teuthology.orchestra.run.smithi045.stdout: -3833> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_368 [2,head] auth (dversion lock) v=4046 ino=0x10000000365 state=1073741824 0x55cf621a5680] [inode 0x10000000365 [2,head] /dc-dir/dc-file_368 auth v4046 s=3 n(v0 rc2023-10-03T19:13:38.701251+0000 b3 1=1+0) (iversion lock) 0x55cf621a9600] 2023-10-03T19:20:54.942 INFO:teuthology.orchestra.run.smithi045.stdout: -3832> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000365 [2,head] #10000000365 auth v4046 s=3 n(v0 rc2023-10-03T19:13:38.701251+0000 b3 1=1+0) (iversion lock) 0x55cf621a9600] 2023-10-03T19:20:54.942 INFO:teuthology.orchestra.run.smithi045.stdout: -3831> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_368 [2,head] auth NULL (dversion lock) v=4046 ino=(nil) state=1073741824 0x55cf621a5680] 2023-10-03T19:20:54.942 INFO:teuthology.orchestra.run.smithi045.stdout: -3830> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_367 [2,head] auth (dversion lock) v=4044 ino=0x10000000364 state=1073741824 0x55cf621a5400] 2023-10-03T19:20:54.942 INFO:teuthology.orchestra.run.smithi045.stdout: -3829> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.942 INFO:teuthology.orchestra.run.smithi045.stdout: -3828> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000364 [2,head] /dc-dir/dc-file_367 auth v4044 s=3 n(v0 rc2023-10-03T19:13:38.690497+0000 b3 1=1+0) (iversion lock) 0x55cf621a9080] 2023-10-03T19:20:54.943 INFO:teuthology.orchestra.run.smithi045.stdout: -3827> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_367 [2,head] auth (dversion lock) v=4044 ino=0x10000000364 state=1073741824 0x55cf621a5400] [inode 0x10000000364 [2,head] /dc-dir/dc-file_367 auth v4044 s=3 n(v0 rc2023-10-03T19:13:38.690497+0000 b3 1=1+0) (iversion lock) 0x55cf621a9080] 2023-10-03T19:20:54.943 INFO:teuthology.orchestra.run.smithi045.stdout: -3826> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000364 [2,head] #10000000364 auth v4044 s=3 n(v0 rc2023-10-03T19:13:38.690497+0000 b3 1=1+0) (iversion lock) 0x55cf621a9080] 2023-10-03T19:20:54.943 INFO:teuthology.orchestra.run.smithi045.stdout: -3825> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_367 [2,head] auth NULL (dversion lock) v=4044 ino=(nil) state=1073741824 0x55cf621a5400] 2023-10-03T19:20:54.943 INFO:teuthology.orchestra.run.smithi045.stdout: -3824> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_366 [2,head] auth (dversion lock) v=4042 ino=0x10000000363 state=1073741824 0x55cf621a5180] 2023-10-03T19:20:54.943 INFO:teuthology.orchestra.run.smithi045.stdout: -3823> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.943 INFO:teuthology.orchestra.run.smithi045.stdout: -3822> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000363 [2,head] /dc-dir/dc-file_366 auth v4042 s=3 n(v0 rc2023-10-03T19:13:38.679026+0000 b3 1=1+0) (iversion lock) 0x55cf621a8b00] 2023-10-03T19:20:54.944 INFO:teuthology.orchestra.run.smithi045.stdout: -3821> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_366 [2,head] auth (dversion lock) v=4042 ino=0x10000000363 state=1073741824 0x55cf621a5180] [inode 0x10000000363 [2,head] /dc-dir/dc-file_366 auth v4042 s=3 n(v0 rc2023-10-03T19:13:38.679026+0000 b3 1=1+0) (iversion lock) 0x55cf621a8b00] 2023-10-03T19:20:54.944 INFO:teuthology.orchestra.run.smithi045.stdout: -3820> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000363 [2,head] #10000000363 auth v4042 s=3 n(v0 rc2023-10-03T19:13:38.679026+0000 b3 1=1+0) (iversion lock) 0x55cf621a8b00] 2023-10-03T19:20:54.944 INFO:teuthology.orchestra.run.smithi045.stdout: -3819> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_366 [2,head] auth NULL (dversion lock) v=4042 ino=(nil) state=1073741824 0x55cf621a5180] 2023-10-03T19:20:54.944 INFO:teuthology.orchestra.run.smithi045.stdout: -3818> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_365 [2,head] auth (dversion lock) v=4040 ino=0x10000000362 state=1073741824 0x55cf621a4f00] 2023-10-03T19:20:54.944 INFO:teuthology.orchestra.run.smithi045.stdout: -3817> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.944 INFO:teuthology.orchestra.run.smithi045.stdout: -3816> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000362 [2,head] /dc-dir/dc-file_365 auth v4040 s=3 n(v0 rc2023-10-03T19:13:38.668338+0000 b3 1=1+0) (iversion lock) 0x55cf621a8580] 2023-10-03T19:20:54.945 INFO:teuthology.orchestra.run.smithi045.stdout: -3815> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_365 [2,head] auth (dversion lock) v=4040 ino=0x10000000362 state=1073741824 0x55cf621a4f00] [inode 0x10000000362 [2,head] /dc-dir/dc-file_365 auth v4040 s=3 n(v0 rc2023-10-03T19:13:38.668338+0000 b3 1=1+0) (iversion lock) 0x55cf621a8580] 2023-10-03T19:20:54.945 INFO:teuthology.orchestra.run.smithi045.stdout: -3814> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000362 [2,head] #10000000362 auth v4040 s=3 n(v0 rc2023-10-03T19:13:38.668338+0000 b3 1=1+0) (iversion lock) 0x55cf621a8580] 2023-10-03T19:20:54.945 INFO:teuthology.orchestra.run.smithi045.stdout: -3813> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_365 [2,head] auth NULL (dversion lock) v=4040 ino=(nil) state=1073741824 0x55cf621a4f00] 2023-10-03T19:20:54.945 INFO:teuthology.orchestra.run.smithi045.stdout: -3812> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_364 [2,head] auth (dversion lock) v=4038 ino=0x10000000361 state=1073741824 0x55cf621a4c80] 2023-10-03T19:20:54.945 INFO:teuthology.orchestra.run.smithi045.stdout: -3811> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.945 INFO:teuthology.orchestra.run.smithi045.stdout: -3810> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000361 [2,head] /dc-dir/dc-file_364 auth v4038 s=3 n(v0 rc2023-10-03T19:13:38.657339+0000 b3 1=1+0) (iversion lock) 0x55cf621a8000] 2023-10-03T19:20:54.945 INFO:teuthology.orchestra.run.smithi045.stdout: -3809> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_364 [2,head] auth (dversion lock) v=4038 ino=0x10000000361 state=1073741824 0x55cf621a4c80] [inode 0x10000000361 [2,head] /dc-dir/dc-file_364 auth v4038 s=3 n(v0 rc2023-10-03T19:13:38.657339+0000 b3 1=1+0) (iversion lock) 0x55cf621a8000] 2023-10-03T19:20:54.945 INFO:teuthology.orchestra.run.smithi045.stdout: -3808> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000361 [2,head] #10000000361 auth v4038 s=3 n(v0 rc2023-10-03T19:13:38.657339+0000 b3 1=1+0) (iversion lock) 0x55cf621a8000] 2023-10-03T19:20:54.945 INFO:teuthology.orchestra.run.smithi045.stdout: -3807> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_364 [2,head] auth NULL (dversion lock) v=4038 ino=(nil) state=1073741824 0x55cf621a4c80] 2023-10-03T19:20:54.945 INFO:teuthology.orchestra.run.smithi045.stdout: -3806> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_363 [2,head] auth (dversion lock) v=4036 ino=0x10000000360 state=1073741824 0x55cf621a4a00] 2023-10-03T19:20:54.945 INFO:teuthology.orchestra.run.smithi045.stdout: -3805> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.946 INFO:teuthology.orchestra.run.smithi045.stdout: -3804> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000360 [2,head] /dc-dir/dc-file_363 auth v4036 s=3 n(v0 rc2023-10-03T19:13:38.645806+0000 b3 1=1+0) (iversion lock) 0x55cf621a1700] 2023-10-03T19:20:54.946 INFO:teuthology.orchestra.run.smithi045.stdout: -3803> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_363 [2,head] auth (dversion lock) v=4036 ino=0x10000000360 state=1073741824 0x55cf621a4a00] [inode 0x10000000360 [2,head] /dc-dir/dc-file_363 auth v4036 s=3 n(v0 rc2023-10-03T19:13:38.645806+0000 b3 1=1+0) (iversion lock) 0x55cf621a1700] 2023-10-03T19:20:54.946 INFO:teuthology.orchestra.run.smithi045.stdout: -3802> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000360 [2,head] #10000000360 auth v4036 s=3 n(v0 rc2023-10-03T19:13:38.645806+0000 b3 1=1+0) (iversion lock) 0x55cf621a1700] 2023-10-03T19:20:54.946 INFO:teuthology.orchestra.run.smithi045.stdout: -3801> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_363 [2,head] auth NULL (dversion lock) v=4036 ino=(nil) state=1073741824 0x55cf621a4a00] 2023-10-03T19:20:54.946 INFO:teuthology.orchestra.run.smithi045.stdout: -3800> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_362 [2,head] auth (dversion lock) v=4034 ino=0x1000000035f state=1073741824 0x55cf621a4780] 2023-10-03T19:20:54.946 INFO:teuthology.orchestra.run.smithi045.stdout: -3799> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.946 INFO:teuthology.orchestra.run.smithi045.stdout: -3798> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000035f [2,head] /dc-dir/dc-file_362 auth v4034 s=3 n(v0 rc2023-10-03T19:13:38.634593+0000 b3 1=1+0) (iversion lock) 0x55cf621a1180] 2023-10-03T19:20:54.946 INFO:teuthology.orchestra.run.smithi045.stdout: -3797> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_362 [2,head] auth (dversion lock) v=4034 ino=0x1000000035f state=1073741824 0x55cf621a4780] [inode 0x1000000035f [2,head] /dc-dir/dc-file_362 auth v4034 s=3 n(v0 rc2023-10-03T19:13:38.634593+0000 b3 1=1+0) (iversion lock) 0x55cf621a1180] 2023-10-03T19:20:54.946 INFO:teuthology.orchestra.run.smithi045.stdout: -3796> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000035f [2,head] #1000000035f auth v4034 s=3 n(v0 rc2023-10-03T19:13:38.634593+0000 b3 1=1+0) (iversion lock) 0x55cf621a1180] 2023-10-03T19:20:54.946 INFO:teuthology.orchestra.run.smithi045.stdout: -3795> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_362 [2,head] auth NULL (dversion lock) v=4034 ino=(nil) state=1073741824 0x55cf621a4780] 2023-10-03T19:20:54.946 INFO:teuthology.orchestra.run.smithi045.stdout: -3794> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_361 [2,head] auth (dversion lock) v=4032 ino=0x1000000035e state=1073741824 0x55cf621a4500] 2023-10-03T19:20:54.947 INFO:teuthology.orchestra.run.smithi045.stdout: -3793> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.947 INFO:teuthology.orchestra.run.smithi045.stdout: -3792> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000035e [2,head] /dc-dir/dc-file_361 auth v4032 s=3 n(v0 rc2023-10-03T19:13:38.623776+0000 b3 1=1+0) (iversion lock) 0x55cf621a0c00] 2023-10-03T19:20:54.947 INFO:teuthology.orchestra.run.smithi045.stdout: -3791> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_361 [2,head] auth (dversion lock) v=4032 ino=0x1000000035e state=1073741824 0x55cf621a4500] [inode 0x1000000035e [2,head] /dc-dir/dc-file_361 auth v4032 s=3 n(v0 rc2023-10-03T19:13:38.623776+0000 b3 1=1+0) (iversion lock) 0x55cf621a0c00] 2023-10-03T19:20:54.947 INFO:teuthology.orchestra.run.smithi045.stdout: -3790> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000035e [2,head] #1000000035e auth v4032 s=3 n(v0 rc2023-10-03T19:13:38.623776+0000 b3 1=1+0) (iversion lock) 0x55cf621a0c00] 2023-10-03T19:20:54.947 INFO:teuthology.orchestra.run.smithi045.stdout: -3789> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_361 [2,head] auth NULL (dversion lock) v=4032 ino=(nil) state=1073741824 0x55cf621a4500] 2023-10-03T19:20:54.947 INFO:teuthology.orchestra.run.smithi045.stdout: -3788> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_360 [2,head] auth (dversion lock) v=4030 ino=0x1000000035d state=1073741824 0x55cf621a4280] 2023-10-03T19:20:54.947 INFO:teuthology.orchestra.run.smithi045.stdout: -3787> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.947 INFO:teuthology.orchestra.run.smithi045.stdout: -3786> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000035d [2,head] /dc-dir/dc-file_360 auth v4030 s=3 n(v0 rc2023-10-03T19:13:38.612503+0000 b3 1=1+0) (iversion lock) 0x55cf621a0680] 2023-10-03T19:20:54.947 INFO:teuthology.orchestra.run.smithi045.stdout: -3785> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_360 [2,head] auth (dversion lock) v=4030 ino=0x1000000035d state=1073741824 0x55cf621a4280] [inode 0x1000000035d [2,head] /dc-dir/dc-file_360 auth v4030 s=3 n(v0 rc2023-10-03T19:13:38.612503+0000 b3 1=1+0) (iversion lock) 0x55cf621a0680] 2023-10-03T19:20:54.947 INFO:teuthology.orchestra.run.smithi045.stdout: -3784> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000035d [2,head] #1000000035d auth v4030 s=3 n(v0 rc2023-10-03T19:13:38.612503+0000 b3 1=1+0) (iversion lock) 0x55cf621a0680] 2023-10-03T19:20:54.947 INFO:teuthology.orchestra.run.smithi045.stdout: -3783> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_360 [2,head] auth NULL (dversion lock) v=4030 ino=(nil) state=1073741824 0x55cf621a4280] 2023-10-03T19:20:54.947 INFO:teuthology.orchestra.run.smithi045.stdout: -3782> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_359 [2,head] auth (dversion lock) v=4028 ino=0x1000000035c state=1073741824 0x55cf621a4000] 2023-10-03T19:20:54.948 INFO:teuthology.orchestra.run.smithi045.stdout: -3781> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.948 INFO:teuthology.orchestra.run.smithi045.stdout: -3780> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000035c [2,head] /dc-dir/dc-file_359 auth v4028 s=3 n(v0 rc2023-10-03T19:13:38.601600+0000 b3 1=1+0) (iversion lock) 0x55cf621a0100] 2023-10-03T19:20:54.948 INFO:teuthology.orchestra.run.smithi045.stdout: -3779> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_359 [2,head] auth (dversion lock) v=4028 ino=0x1000000035c state=1073741824 0x55cf621a4000] [inode 0x1000000035c [2,head] /dc-dir/dc-file_359 auth v4028 s=3 n(v0 rc2023-10-03T19:13:38.601600+0000 b3 1=1+0) (iversion lock) 0x55cf621a0100] 2023-10-03T19:20:54.948 INFO:teuthology.orchestra.run.smithi045.stdout: -3778> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000035c [2,head] #1000000035c auth v4028 s=3 n(v0 rc2023-10-03T19:13:38.601600+0000 b3 1=1+0) (iversion lock) 0x55cf621a0100] 2023-10-03T19:20:54.948 INFO:teuthology.orchestra.run.smithi045.stdout: -3777> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_359 [2,head] auth NULL (dversion lock) v=4028 ino=(nil) state=1073741824 0x55cf621a4000] 2023-10-03T19:20:54.948 INFO:teuthology.orchestra.run.smithi045.stdout: -3776> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_358 [2,head] auth (dversion lock) v=4026 ino=0x1000000035b state=1073741824 0x55cf62199b80] 2023-10-03T19:20:54.948 INFO:teuthology.orchestra.run.smithi045.stdout: -3775> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.948 INFO:teuthology.orchestra.run.smithi045.stdout: -3774> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000035b [2,head] /dc-dir/dc-file_358 auth v4026 s=3 n(v0 rc2023-10-03T19:13:38.590530+0000 b3 1=1+0) (iversion lock) 0x55cf6219fb80] 2023-10-03T19:20:54.948 INFO:teuthology.orchestra.run.smithi045.stdout: -3773> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_358 [2,head] auth (dversion lock) v=4026 ino=0x1000000035b state=1073741824 0x55cf62199b80] [inode 0x1000000035b [2,head] /dc-dir/dc-file_358 auth v4026 s=3 n(v0 rc2023-10-03T19:13:38.590530+0000 b3 1=1+0) (iversion lock) 0x55cf6219fb80] 2023-10-03T19:20:54.948 INFO:teuthology.orchestra.run.smithi045.stdout: -3772> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000035b [2,head] #1000000035b auth v4026 s=3 n(v0 rc2023-10-03T19:13:38.590530+0000 b3 1=1+0) (iversion lock) 0x55cf6219fb80] 2023-10-03T19:20:54.948 INFO:teuthology.orchestra.run.smithi045.stdout: -3771> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_358 [2,head] auth NULL (dversion lock) v=4026 ino=(nil) state=1073741824 0x55cf62199b80] 2023-10-03T19:20:54.949 INFO:teuthology.orchestra.run.smithi045.stdout: -3770> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_357 [2,head] auth (dversion lock) v=4024 ino=0x1000000035a state=1073741824 0x55cf62199900] 2023-10-03T19:20:54.949 INFO:teuthology.orchestra.run.smithi045.stdout: -3769> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.949 INFO:teuthology.orchestra.run.smithi045.stdout: -3768> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000035a [2,head] /dc-dir/dc-file_357 auth v4024 s=3 n(v0 rc2023-10-03T19:13:38.579309+0000 b3 1=1+0) (iversion lock) 0x55cf6219f600] 2023-10-03T19:20:54.949 INFO:teuthology.orchestra.run.smithi045.stdout: -3767> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_357 [2,head] auth (dversion lock) v=4024 ino=0x1000000035a state=1073741824 0x55cf62199900] [inode 0x1000000035a [2,head] /dc-dir/dc-file_357 auth v4024 s=3 n(v0 rc2023-10-03T19:13:38.579309+0000 b3 1=1+0) (iversion lock) 0x55cf6219f600] 2023-10-03T19:20:54.949 INFO:teuthology.orchestra.run.smithi045.stdout: -3766> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000035a [2,head] #1000000035a auth v4024 s=3 n(v0 rc2023-10-03T19:13:38.579309+0000 b3 1=1+0) (iversion lock) 0x55cf6219f600] 2023-10-03T19:20:54.949 INFO:teuthology.orchestra.run.smithi045.stdout: -3765> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_357 [2,head] auth NULL (dversion lock) v=4024 ino=(nil) state=1073741824 0x55cf62199900] 2023-10-03T19:20:54.949 INFO:teuthology.orchestra.run.smithi045.stdout: -3764> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_356 [2,head] auth (dversion lock) v=4022 ino=0x10000000359 state=1073741824 0x55cf62199680] 2023-10-03T19:20:54.949 INFO:teuthology.orchestra.run.smithi045.stdout: -3763> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.949 INFO:teuthology.orchestra.run.smithi045.stdout: -3762> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000359 [2,head] /dc-dir/dc-file_356 auth v4022 s=3 n(v0 rc2023-10-03T19:13:38.567987+0000 b3 1=1+0) (iversion lock) 0x55cf6219f080] 2023-10-03T19:20:54.949 INFO:teuthology.orchestra.run.smithi045.stdout: -3761> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_356 [2,head] auth (dversion lock) v=4022 ino=0x10000000359 state=1073741824 0x55cf62199680] [inode 0x10000000359 [2,head] /dc-dir/dc-file_356 auth v4022 s=3 n(v0 rc2023-10-03T19:13:38.567987+0000 b3 1=1+0) (iversion lock) 0x55cf6219f080] 2023-10-03T19:20:54.949 INFO:teuthology.orchestra.run.smithi045.stdout: -3760> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000359 [2,head] #10000000359 auth v4022 s=3 n(v0 rc2023-10-03T19:13:38.567987+0000 b3 1=1+0) (iversion lock) 0x55cf6219f080] 2023-10-03T19:20:54.950 INFO:teuthology.orchestra.run.smithi045.stdout: -3759> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_356 [2,head] auth NULL (dversion lock) v=4022 ino=(nil) state=1073741824 0x55cf62199680] 2023-10-03T19:20:54.950 INFO:teuthology.orchestra.run.smithi045.stdout: -3758> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_355 [2,head] auth (dversion lock) v=4020 ino=0x10000000358 state=1073741824 0x55cf62199400] 2023-10-03T19:20:54.950 INFO:teuthology.orchestra.run.smithi045.stdout: -3757> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.950 INFO:teuthology.orchestra.run.smithi045.stdout: -3756> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000358 [2,head] /dc-dir/dc-file_355 auth v4020 s=3 n(v0 rc2023-10-03T19:13:38.557120+0000 b3 1=1+0) (iversion lock) 0x55cf6219eb00] 2023-10-03T19:20:54.950 INFO:teuthology.orchestra.run.smithi045.stdout: -3755> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_355 [2,head] auth (dversion lock) v=4020 ino=0x10000000358 state=1073741824 0x55cf62199400] [inode 0x10000000358 [2,head] /dc-dir/dc-file_355 auth v4020 s=3 n(v0 rc2023-10-03T19:13:38.557120+0000 b3 1=1+0) (iversion lock) 0x55cf6219eb00] 2023-10-03T19:20:54.950 INFO:teuthology.orchestra.run.smithi045.stdout: -3754> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000358 [2,head] #10000000358 auth v4020 s=3 n(v0 rc2023-10-03T19:13:38.557120+0000 b3 1=1+0) (iversion lock) 0x55cf6219eb00] 2023-10-03T19:20:54.950 INFO:teuthology.orchestra.run.smithi045.stdout: -3753> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_355 [2,head] auth NULL (dversion lock) v=4020 ino=(nil) state=1073741824 0x55cf62199400] 2023-10-03T19:20:54.950 INFO:teuthology.orchestra.run.smithi045.stdout: -3752> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_354 [2,head] auth (dversion lock) v=4018 ino=0x10000000357 state=1073741824 0x55cf62199180] 2023-10-03T19:20:54.950 INFO:teuthology.orchestra.run.smithi045.stdout: -3751> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.950 INFO:teuthology.orchestra.run.smithi045.stdout: -3750> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000357 [2,head] /dc-dir/dc-file_354 auth v4018 s=3 n(v0 rc2023-10-03T19:13:38.545931+0000 b3 1=1+0) (iversion lock) 0x55cf6219e580] 2023-10-03T19:20:54.950 INFO:teuthology.orchestra.run.smithi045.stdout: -3749> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_354 [2,head] auth (dversion lock) v=4018 ino=0x10000000357 state=1073741824 0x55cf62199180] [inode 0x10000000357 [2,head] /dc-dir/dc-file_354 auth v4018 s=3 n(v0 rc2023-10-03T19:13:38.545931+0000 b3 1=1+0) (iversion lock) 0x55cf6219e580] 2023-10-03T19:20:54.950 INFO:teuthology.orchestra.run.smithi045.stdout: -3748> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000357 [2,head] #10000000357 auth v4018 s=3 n(v0 rc2023-10-03T19:13:38.545931+0000 b3 1=1+0) (iversion lock) 0x55cf6219e580] 2023-10-03T19:20:54.951 INFO:teuthology.orchestra.run.smithi045.stdout: -3747> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_354 [2,head] auth NULL (dversion lock) v=4018 ino=(nil) state=1073741824 0x55cf62199180] 2023-10-03T19:20:54.951 INFO:teuthology.orchestra.run.smithi045.stdout: -3746> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_353 [2,head] auth (dversion lock) v=4016 ino=0x10000000356 state=1073741824 0x55cf62198f00] 2023-10-03T19:20:54.951 INFO:teuthology.orchestra.run.smithi045.stdout: -3745> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.951 INFO:teuthology.orchestra.run.smithi045.stdout: -3744> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000356 [2,head] /dc-dir/dc-file_353 auth v4016 s=3 n(v0 rc2023-10-03T19:13:38.534585+0000 b3 1=1+0) (iversion lock) 0x55cf6219e000] 2023-10-03T19:20:54.951 INFO:teuthology.orchestra.run.smithi045.stdout: -3743> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_353 [2,head] auth (dversion lock) v=4016 ino=0x10000000356 state=1073741824 0x55cf62198f00] [inode 0x10000000356 [2,head] /dc-dir/dc-file_353 auth v4016 s=3 n(v0 rc2023-10-03T19:13:38.534585+0000 b3 1=1+0) (iversion lock) 0x55cf6219e000] 2023-10-03T19:20:54.951 INFO:teuthology.orchestra.run.smithi045.stdout: -3742> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000356 [2,head] #10000000356 auth v4016 s=3 n(v0 rc2023-10-03T19:13:38.534585+0000 b3 1=1+0) (iversion lock) 0x55cf6219e000] 2023-10-03T19:20:54.951 INFO:teuthology.orchestra.run.smithi045.stdout: -3741> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_353 [2,head] auth NULL (dversion lock) v=4016 ino=(nil) state=1073741824 0x55cf62198f00] 2023-10-03T19:20:54.951 INFO:teuthology.orchestra.run.smithi045.stdout: -3740> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_352 [2,head] auth (dversion lock) v=4014 ino=0x10000000355 state=1073741824 0x55cf62198c80] 2023-10-03T19:20:54.951 INFO:teuthology.orchestra.run.smithi045.stdout: -3739> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.951 INFO:teuthology.orchestra.run.smithi045.stdout: -3738> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000355 [2,head] /dc-dir/dc-file_352 auth v4014 s=3 n(v0 rc2023-10-03T19:13:38.523120+0000 b3 1=1+0) (iversion lock) 0x55cf62193700] 2023-10-03T19:20:54.951 INFO:teuthology.orchestra.run.smithi045.stdout: -3737> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_352 [2,head] auth (dversion lock) v=4014 ino=0x10000000355 state=1073741824 0x55cf62198c80] [inode 0x10000000355 [2,head] /dc-dir/dc-file_352 auth v4014 s=3 n(v0 rc2023-10-03T19:13:38.523120+0000 b3 1=1+0) (iversion lock) 0x55cf62193700] 2023-10-03T19:20:54.952 INFO:teuthology.orchestra.run.smithi045.stdout: -3736> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000355 [2,head] #10000000355 auth v4014 s=3 n(v0 rc2023-10-03T19:13:38.523120+0000 b3 1=1+0) (iversion lock) 0x55cf62193700] 2023-10-03T19:20:54.952 INFO:teuthology.orchestra.run.smithi045.stdout: -3735> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_352 [2,head] auth NULL (dversion lock) v=4014 ino=(nil) state=1073741824 0x55cf62198c80] 2023-10-03T19:20:54.952 INFO:teuthology.orchestra.run.smithi045.stdout: -3734> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_351 [2,head] auth (dversion lock) v=4012 ino=0x10000000354 state=1073741824 0x55cf62198a00] 2023-10-03T19:20:54.952 INFO:teuthology.orchestra.run.smithi045.stdout: -3733> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.952 INFO:teuthology.orchestra.run.smithi045.stdout: -3732> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000354 [2,head] /dc-dir/dc-file_351 auth v4012 s=3 n(v0 rc2023-10-03T19:13:38.510887+0000 b3 1=1+0) (iversion lock) 0x55cf62193180] 2023-10-03T19:20:54.952 INFO:teuthology.orchestra.run.smithi045.stdout: -3731> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_351 [2,head] auth (dversion lock) v=4012 ino=0x10000000354 state=1073741824 0x55cf62198a00] [inode 0x10000000354 [2,head] /dc-dir/dc-file_351 auth v4012 s=3 n(v0 rc2023-10-03T19:13:38.510887+0000 b3 1=1+0) (iversion lock) 0x55cf62193180] 2023-10-03T19:20:54.952 INFO:teuthology.orchestra.run.smithi045.stdout: -3730> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000354 [2,head] #10000000354 auth v4012 s=3 n(v0 rc2023-10-03T19:13:38.510887+0000 b3 1=1+0) (iversion lock) 0x55cf62193180] 2023-10-03T19:20:54.952 INFO:teuthology.orchestra.run.smithi045.stdout: -3729> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_351 [2,head] auth NULL (dversion lock) v=4012 ino=(nil) state=1073741824 0x55cf62198a00] 2023-10-03T19:20:54.952 INFO:teuthology.orchestra.run.smithi045.stdout: -3728> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_350 [2,head] auth (dversion lock) v=4010 ino=0x10000000353 state=1073741824 0x55cf62198780] 2023-10-03T19:20:54.952 INFO:teuthology.orchestra.run.smithi045.stdout: -3727> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.952 INFO:teuthology.orchestra.run.smithi045.stdout: -3726> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000353 [2,head] /dc-dir/dc-file_350 auth v4010 s=3 n(v0 rc2023-10-03T19:13:38.497207+0000 b3 1=1+0) (iversion lock) 0x55cf62192c00] 2023-10-03T19:20:54.953 INFO:teuthology.orchestra.run.smithi045.stdout: -3725> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_350 [2,head] auth (dversion lock) v=4010 ino=0x10000000353 state=1073741824 0x55cf62198780] [inode 0x10000000353 [2,head] /dc-dir/dc-file_350 auth v4010 s=3 n(v0 rc2023-10-03T19:13:38.497207+0000 b3 1=1+0) (iversion lock) 0x55cf62192c00] 2023-10-03T19:20:54.953 INFO:teuthology.orchestra.run.smithi045.stdout: -3724> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000353 [2,head] #10000000353 auth v4010 s=3 n(v0 rc2023-10-03T19:13:38.497207+0000 b3 1=1+0) (iversion lock) 0x55cf62192c00] 2023-10-03T19:20:54.953 INFO:teuthology.orchestra.run.smithi045.stdout: -3723> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_350 [2,head] auth NULL (dversion lock) v=4010 ino=(nil) state=1073741824 0x55cf62198780] 2023-10-03T19:20:54.953 INFO:teuthology.orchestra.run.smithi045.stdout: -3722> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_349 [2,head] auth (dversion lock) v=3716 ino=0x10000000352 state=1073741824 0x55cf62198500] 2023-10-03T19:20:54.953 INFO:teuthology.orchestra.run.smithi045.stdout: -3721> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.953 INFO:teuthology.orchestra.run.smithi045.stdout: -3720> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000352 [2,head] /dc-dir/dc-file_349 auth v3716 s=3 n(v0 rc2023-10-03T19:13:38.484242+0000 b3 1=1+0) (iversion lock) 0x55cf62192680] 2023-10-03T19:20:54.953 INFO:teuthology.orchestra.run.smithi045.stdout: -3719> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_349 [2,head] auth (dversion lock) v=3716 ino=0x10000000352 state=1073741824 0x55cf62198500] [inode 0x10000000352 [2,head] /dc-dir/dc-file_349 auth v3716 s=3 n(v0 rc2023-10-03T19:13:38.484242+0000 b3 1=1+0) (iversion lock) 0x55cf62192680] 2023-10-03T19:20:54.953 INFO:teuthology.orchestra.run.smithi045.stdout: -3718> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000352 [2,head] #10000000352 auth v3716 s=3 n(v0 rc2023-10-03T19:13:38.484242+0000 b3 1=1+0) (iversion lock) 0x55cf62192680] 2023-10-03T19:20:54.953 INFO:teuthology.orchestra.run.smithi045.stdout: -3717> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_349 [2,head] auth NULL (dversion lock) v=3716 ino=(nil) state=1073741824 0x55cf62198500] 2023-10-03T19:20:54.953 INFO:teuthology.orchestra.run.smithi045.stdout: -3716> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_348 [2,head] auth (dversion lock) v=3714 ino=0x10000000351 state=1073741824 0x55cf62198280] 2023-10-03T19:20:54.953 INFO:teuthology.orchestra.run.smithi045.stdout: -3715> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.954 INFO:teuthology.orchestra.run.smithi045.stdout: -3714> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000351 [2,head] /dc-dir/dc-file_348 auth v3714 s=3 n(v0 rc2023-10-03T19:13:38.471555+0000 b3 1=1+0) (iversion lock) 0x55cf62192100] 2023-10-03T19:20:54.954 INFO:teuthology.orchestra.run.smithi045.stdout: -3713> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_348 [2,head] auth (dversion lock) v=3714 ino=0x10000000351 state=1073741824 0x55cf62198280] [inode 0x10000000351 [2,head] /dc-dir/dc-file_348 auth v3714 s=3 n(v0 rc2023-10-03T19:13:38.471555+0000 b3 1=1+0) (iversion lock) 0x55cf62192100] 2023-10-03T19:20:54.954 INFO:teuthology.orchestra.run.smithi045.stdout: -3712> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000351 [2,head] #10000000351 auth v3714 s=3 n(v0 rc2023-10-03T19:13:38.471555+0000 b3 1=1+0) (iversion lock) 0x55cf62192100] 2023-10-03T19:20:54.954 INFO:teuthology.orchestra.run.smithi045.stdout: -3711> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_348 [2,head] auth NULL (dversion lock) v=3714 ino=(nil) state=1073741824 0x55cf62198280] 2023-10-03T19:20:54.954 INFO:teuthology.orchestra.run.smithi045.stdout: -3710> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_347 [2,head] auth (dversion lock) v=3712 ino=0x10000000350 state=1073741824 0x55cf62198000] 2023-10-03T19:20:54.954 INFO:teuthology.orchestra.run.smithi045.stdout: -3709> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.954 INFO:teuthology.orchestra.run.smithi045.stdout: -3708> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000350 [2,head] /dc-dir/dc-file_347 auth v3712 s=3 n(v0 rc2023-10-03T19:13:38.460642+0000 b3 1=1+0) (iversion lock) 0x55cf62191b80] 2023-10-03T19:20:54.954 INFO:teuthology.orchestra.run.smithi045.stdout: -3707> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_347 [2,head] auth (dversion lock) v=3712 ino=0x10000000350 state=1073741824 0x55cf62198000] [inode 0x10000000350 [2,head] /dc-dir/dc-file_347 auth v3712 s=3 n(v0 rc2023-10-03T19:13:38.460642+0000 b3 1=1+0) (iversion lock) 0x55cf62191b80] 2023-10-03T19:20:54.954 INFO:teuthology.orchestra.run.smithi045.stdout: -3706> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000350 [2,head] #10000000350 auth v3712 s=3 n(v0 rc2023-10-03T19:13:38.460642+0000 b3 1=1+0) (iversion lock) 0x55cf62191b80] 2023-10-03T19:20:54.954 INFO:teuthology.orchestra.run.smithi045.stdout: -3705> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_347 [2,head] auth NULL (dversion lock) v=3712 ino=(nil) state=1073741824 0x55cf62198000] 2023-10-03T19:20:54.954 INFO:teuthology.orchestra.run.smithi045.stdout: -3704> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_346 [2,head] auth (dversion lock) v=3710 ino=0x1000000034f state=1073741824 0x55cf62189b80] 2023-10-03T19:20:54.955 INFO:teuthology.orchestra.run.smithi045.stdout: -3703> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.955 INFO:teuthology.orchestra.run.smithi045.stdout: -3702> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000034f [2,head] /dc-dir/dc-file_346 auth v3710 s=3 n(v0 rc2023-10-03T19:13:38.448900+0000 b3 1=1+0) (iversion lock) 0x55cf62191600] 2023-10-03T19:20:54.955 INFO:teuthology.orchestra.run.smithi045.stdout: -3701> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_346 [2,head] auth (dversion lock) v=3710 ino=0x1000000034f state=1073741824 0x55cf62189b80] [inode 0x1000000034f [2,head] /dc-dir/dc-file_346 auth v3710 s=3 n(v0 rc2023-10-03T19:13:38.448900+0000 b3 1=1+0) (iversion lock) 0x55cf62191600] 2023-10-03T19:20:54.955 INFO:teuthology.orchestra.run.smithi045.stdout: -3700> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000034f [2,head] #1000000034f auth v3710 s=3 n(v0 rc2023-10-03T19:13:38.448900+0000 b3 1=1+0) (iversion lock) 0x55cf62191600] 2023-10-03T19:20:54.955 INFO:teuthology.orchestra.run.smithi045.stdout: -3699> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_346 [2,head] auth NULL (dversion lock) v=3710 ino=(nil) state=1073741824 0x55cf62189b80] 2023-10-03T19:20:54.955 INFO:teuthology.orchestra.run.smithi045.stdout: -3698> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_345 [2,head] auth (dversion lock) v=3708 ino=0x1000000034e state=1073741824 0x55cf62189900] 2023-10-03T19:20:54.955 INFO:teuthology.orchestra.run.smithi045.stdout: -3697> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.955 INFO:teuthology.orchestra.run.smithi045.stdout: -3696> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000034e [2,head] /dc-dir/dc-file_345 auth v3708 s=3 n(v0 rc2023-10-03T19:13:38.435755+0000 b3 1=1+0) (iversion lock) 0x55cf62191080] 2023-10-03T19:20:54.955 INFO:teuthology.orchestra.run.smithi045.stdout: -3695> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_345 [2,head] auth (dversion lock) v=3708 ino=0x1000000034e state=1073741824 0x55cf62189900] [inode 0x1000000034e [2,head] /dc-dir/dc-file_345 auth v3708 s=3 n(v0 rc2023-10-03T19:13:38.435755+0000 b3 1=1+0) (iversion lock) 0x55cf62191080] 2023-10-03T19:20:54.955 INFO:teuthology.orchestra.run.smithi045.stdout: -3694> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000034e [2,head] #1000000034e auth v3708 s=3 n(v0 rc2023-10-03T19:13:38.435755+0000 b3 1=1+0) (iversion lock) 0x55cf62191080] 2023-10-03T19:20:54.955 INFO:teuthology.orchestra.run.smithi045.stdout: -3693> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_345 [2,head] auth NULL (dversion lock) v=3708 ino=(nil) state=1073741824 0x55cf62189900] 2023-10-03T19:20:54.955 INFO:teuthology.orchestra.run.smithi045.stdout: -3692> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_344 [2,head] auth (dversion lock) v=3706 ino=0x1000000034d state=1073741824 0x55cf62189680] 2023-10-03T19:20:54.956 INFO:teuthology.orchestra.run.smithi045.stdout: -3691> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.956 INFO:teuthology.orchestra.run.smithi045.stdout: -3690> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000034d [2,head] /dc-dir/dc-file_344 auth v3706 s=3 n(v0 rc2023-10-03T19:13:38.421906+0000 b3 1=1+0) (iversion lock) 0x55cf62190b00] 2023-10-03T19:20:54.956 INFO:teuthology.orchestra.run.smithi045.stdout: -3689> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_344 [2,head] auth (dversion lock) v=3706 ino=0x1000000034d state=1073741824 0x55cf62189680] [inode 0x1000000034d [2,head] /dc-dir/dc-file_344 auth v3706 s=3 n(v0 rc2023-10-03T19:13:38.421906+0000 b3 1=1+0) (iversion lock) 0x55cf62190b00] 2023-10-03T19:20:54.956 INFO:teuthology.orchestra.run.smithi045.stdout: -3688> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000034d [2,head] #1000000034d auth v3706 s=3 n(v0 rc2023-10-03T19:13:38.421906+0000 b3 1=1+0) (iversion lock) 0x55cf62190b00] 2023-10-03T19:20:54.956 INFO:teuthology.orchestra.run.smithi045.stdout: -3687> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_344 [2,head] auth NULL (dversion lock) v=3706 ino=(nil) state=1073741824 0x55cf62189680] 2023-10-03T19:20:54.956 INFO:teuthology.orchestra.run.smithi045.stdout: -3686> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_343 [2,head] auth (dversion lock) v=3704 ino=0x1000000034c state=1073741824 0x55cf62189400] 2023-10-03T19:20:54.956 INFO:teuthology.orchestra.run.smithi045.stdout: -3685> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.956 INFO:teuthology.orchestra.run.smithi045.stdout: -3684> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000034c [2,head] /dc-dir/dc-file_343 auth v3704 s=3 n(v0 rc2023-10-03T19:13:38.408829+0000 b3 1=1+0) (iversion lock) 0x55cf62190580] 2023-10-03T19:20:54.956 INFO:teuthology.orchestra.run.smithi045.stdout: -3683> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_343 [2,head] auth (dversion lock) v=3704 ino=0x1000000034c state=1073741824 0x55cf62189400] [inode 0x1000000034c [2,head] /dc-dir/dc-file_343 auth v3704 s=3 n(v0 rc2023-10-03T19:13:38.408829+0000 b3 1=1+0) (iversion lock) 0x55cf62190580] 2023-10-03T19:20:54.956 INFO:teuthology.orchestra.run.smithi045.stdout: -3682> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000034c [2,head] #1000000034c auth v3704 s=3 n(v0 rc2023-10-03T19:13:38.408829+0000 b3 1=1+0) (iversion lock) 0x55cf62190580] 2023-10-03T19:20:54.956 INFO:teuthology.orchestra.run.smithi045.stdout: -3681> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_343 [2,head] auth NULL (dversion lock) v=3704 ino=(nil) state=1073741824 0x55cf62189400] 2023-10-03T19:20:54.957 INFO:teuthology.orchestra.run.smithi045.stdout: -3680> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_342 [2,head] auth (dversion lock) v=3702 ino=0x1000000034b state=1073741824 0x55cf62189180] 2023-10-03T19:20:54.957 INFO:teuthology.orchestra.run.smithi045.stdout: -3679> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.957 INFO:teuthology.orchestra.run.smithi045.stdout: -3678> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000034b [2,head] /dc-dir/dc-file_342 auth v3702 s=3 n(v0 rc2023-10-03T19:13:38.395685+0000 b3 1=1+0) (iversion lock) 0x55cf62190000] 2023-10-03T19:20:54.957 INFO:teuthology.orchestra.run.smithi045.stdout: -3677> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_342 [2,head] auth (dversion lock) v=3702 ino=0x1000000034b state=1073741824 0x55cf62189180] [inode 0x1000000034b [2,head] /dc-dir/dc-file_342 auth v3702 s=3 n(v0 rc2023-10-03T19:13:38.395685+0000 b3 1=1+0) (iversion lock) 0x55cf62190000] 2023-10-03T19:20:54.957 INFO:teuthology.orchestra.run.smithi045.stdout: -3676> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000034b [2,head] #1000000034b auth v3702 s=3 n(v0 rc2023-10-03T19:13:38.395685+0000 b3 1=1+0) (iversion lock) 0x55cf62190000] 2023-10-03T19:20:54.957 INFO:teuthology.orchestra.run.smithi045.stdout: -3675> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_342 [2,head] auth NULL (dversion lock) v=3702 ino=(nil) state=1073741824 0x55cf62189180] 2023-10-03T19:20:54.957 INFO:teuthology.orchestra.run.smithi045.stdout: -3674> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_341 [2,head] auth (dversion lock) v=3700 ino=0x1000000034a state=1073741824 0x55cf62188f00] 2023-10-03T19:20:54.957 INFO:teuthology.orchestra.run.smithi045.stdout: -3673> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.957 INFO:teuthology.orchestra.run.smithi045.stdout: -3672> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000034a [2,head] /dc-dir/dc-file_341 auth v3700 s=3 n(v0 rc2023-10-03T19:13:38.382812+0000 b3 1=1+0) (iversion lock) 0x55cf62185700] 2023-10-03T19:20:54.957 INFO:teuthology.orchestra.run.smithi045.stdout: -3671> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_341 [2,head] auth (dversion lock) v=3700 ino=0x1000000034a state=1073741824 0x55cf62188f00] [inode 0x1000000034a [2,head] /dc-dir/dc-file_341 auth v3700 s=3 n(v0 rc2023-10-03T19:13:38.382812+0000 b3 1=1+0) (iversion lock) 0x55cf62185700] 2023-10-03T19:20:54.957 INFO:teuthology.orchestra.run.smithi045.stdout: -3670> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000034a [2,head] #1000000034a auth v3700 s=3 n(v0 rc2023-10-03T19:13:38.382812+0000 b3 1=1+0) (iversion lock) 0x55cf62185700] 2023-10-03T19:20:54.957 INFO:teuthology.orchestra.run.smithi045.stdout: -3669> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_341 [2,head] auth NULL (dversion lock) v=3700 ino=(nil) state=1073741824 0x55cf62188f00] 2023-10-03T19:20:54.958 INFO:teuthology.orchestra.run.smithi045.stdout: -3668> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_340 [2,head] auth (dversion lock) v=3698 ino=0x10000000349 state=1073741824 0x55cf62188c80] 2023-10-03T19:20:54.958 INFO:teuthology.orchestra.run.smithi045.stdout: -3667> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.958 INFO:teuthology.orchestra.run.smithi045.stdout: -3666> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000349 [2,head] /dc-dir/dc-file_340 auth v3698 s=3 n(v0 rc2023-10-03T19:13:38.371735+0000 b3 1=1+0) (iversion lock) 0x55cf62185180] 2023-10-03T19:20:54.958 INFO:teuthology.orchestra.run.smithi045.stdout: -3665> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_340 [2,head] auth (dversion lock) v=3698 ino=0x10000000349 state=1073741824 0x55cf62188c80] [inode 0x10000000349 [2,head] /dc-dir/dc-file_340 auth v3698 s=3 n(v0 rc2023-10-03T19:13:38.371735+0000 b3 1=1+0) (iversion lock) 0x55cf62185180] 2023-10-03T19:20:54.958 INFO:teuthology.orchestra.run.smithi045.stdout: -3664> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000349 [2,head] #10000000349 auth v3698 s=3 n(v0 rc2023-10-03T19:13:38.371735+0000 b3 1=1+0) (iversion lock) 0x55cf62185180] 2023-10-03T19:20:54.958 INFO:teuthology.orchestra.run.smithi045.stdout: -3663> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_340 [2,head] auth NULL (dversion lock) v=3698 ino=(nil) state=1073741824 0x55cf62188c80] 2023-10-03T19:20:54.958 INFO:teuthology.orchestra.run.smithi045.stdout: -3662> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_339 [2,head] auth (dversion lock) v=3696 ino=0x10000000348 state=1073741824 0x55cf62188a00] 2023-10-03T19:20:54.958 INFO:teuthology.orchestra.run.smithi045.stdout: -3661> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.958 INFO:teuthology.orchestra.run.smithi045.stdout: -3660> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000348 [2,head] /dc-dir/dc-file_339 auth v3696 s=3 n(v0 rc2023-10-03T19:13:38.360737+0000 b3 1=1+0) (iversion lock) 0x55cf62184c00] 2023-10-03T19:20:54.958 INFO:teuthology.orchestra.run.smithi045.stdout: -3659> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_339 [2,head] auth (dversion lock) v=3696 ino=0x10000000348 state=1073741824 0x55cf62188a00] [inode 0x10000000348 [2,head] /dc-dir/dc-file_339 auth v3696 s=3 n(v0 rc2023-10-03T19:13:38.360737+0000 b3 1=1+0) (iversion lock) 0x55cf62184c00] 2023-10-03T19:20:54.958 INFO:teuthology.orchestra.run.smithi045.stdout: -3658> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000348 [2,head] #10000000348 auth v3696 s=3 n(v0 rc2023-10-03T19:13:38.360737+0000 b3 1=1+0) (iversion lock) 0x55cf62184c00] 2023-10-03T19:20:54.959 INFO:teuthology.orchestra.run.smithi045.stdout: -3657> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_339 [2,head] auth NULL (dversion lock) v=3696 ino=(nil) state=1073741824 0x55cf62188a00] 2023-10-03T19:20:54.959 INFO:teuthology.orchestra.run.smithi045.stdout: -3656> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_338 [2,head] auth (dversion lock) v=3694 ino=0x10000000347 state=1073741824 0x55cf62188780] 2023-10-03T19:20:54.959 INFO:teuthology.orchestra.run.smithi045.stdout: -3655> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.959 INFO:teuthology.orchestra.run.smithi045.stdout: -3654> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000347 [2,head] /dc-dir/dc-file_338 auth v3694 s=3 n(v0 rc2023-10-03T19:13:38.349680+0000 b3 1=1+0) (iversion lock) 0x55cf62184680] 2023-10-03T19:20:54.959 INFO:teuthology.orchestra.run.smithi045.stdout: -3653> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_338 [2,head] auth (dversion lock) v=3694 ino=0x10000000347 state=1073741824 0x55cf62188780] [inode 0x10000000347 [2,head] /dc-dir/dc-file_338 auth v3694 s=3 n(v0 rc2023-10-03T19:13:38.349680+0000 b3 1=1+0) (iversion lock) 0x55cf62184680] 2023-10-03T19:20:54.959 INFO:teuthology.orchestra.run.smithi045.stdout: -3652> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000347 [2,head] #10000000347 auth v3694 s=3 n(v0 rc2023-10-03T19:13:38.349680+0000 b3 1=1+0) (iversion lock) 0x55cf62184680] 2023-10-03T19:20:54.959 INFO:teuthology.orchestra.run.smithi045.stdout: -3651> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_338 [2,head] auth NULL (dversion lock) v=3694 ino=(nil) state=1073741824 0x55cf62188780] 2023-10-03T19:20:54.959 INFO:teuthology.orchestra.run.smithi045.stdout: -3650> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_337 [2,head] auth (dversion lock) v=3692 ino=0x10000000346 state=1073741824 0x55cf62188500] 2023-10-03T19:20:54.959 INFO:teuthology.orchestra.run.smithi045.stdout: -3649> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.959 INFO:teuthology.orchestra.run.smithi045.stdout: -3648> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000346 [2,head] /dc-dir/dc-file_337 auth v3692 s=3 n(v0 rc2023-10-03T19:13:38.337236+0000 b3 1=1+0) (iversion lock) 0x55cf62184100] 2023-10-03T19:20:54.959 INFO:teuthology.orchestra.run.smithi045.stdout: -3647> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_337 [2,head] auth (dversion lock) v=3692 ino=0x10000000346 state=1073741824 0x55cf62188500] [inode 0x10000000346 [2,head] /dc-dir/dc-file_337 auth v3692 s=3 n(v0 rc2023-10-03T19:13:38.337236+0000 b3 1=1+0) (iversion lock) 0x55cf62184100] 2023-10-03T19:20:54.960 INFO:teuthology.orchestra.run.smithi045.stdout: -3646> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000346 [2,head] #10000000346 auth v3692 s=3 n(v0 rc2023-10-03T19:13:38.337236+0000 b3 1=1+0) (iversion lock) 0x55cf62184100] 2023-10-03T19:20:54.960 INFO:teuthology.orchestra.run.smithi045.stdout: -3645> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_337 [2,head] auth NULL (dversion lock) v=3692 ino=(nil) state=1073741824 0x55cf62188500] 2023-10-03T19:20:54.960 INFO:teuthology.orchestra.run.smithi045.stdout: -3644> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_336 [2,head] auth (dversion lock) v=3690 ino=0x10000000345 state=1073741824 0x55cf62188280] 2023-10-03T19:20:54.960 INFO:teuthology.orchestra.run.smithi045.stdout: -3643> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.960 INFO:teuthology.orchestra.run.smithi045.stdout: -3642> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000345 [2,head] /dc-dir/dc-file_336 auth v3690 s=3 n(v0 rc2023-10-03T19:13:38.324441+0000 b3 1=1+0) (iversion lock) 0x55cf62183b80] 2023-10-03T19:20:54.960 INFO:teuthology.orchestra.run.smithi045.stdout: -3641> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_336 [2,head] auth (dversion lock) v=3690 ino=0x10000000345 state=1073741824 0x55cf62188280] [inode 0x10000000345 [2,head] /dc-dir/dc-file_336 auth v3690 s=3 n(v0 rc2023-10-03T19:13:38.324441+0000 b3 1=1+0) (iversion lock) 0x55cf62183b80] 2023-10-03T19:20:54.960 INFO:teuthology.orchestra.run.smithi045.stdout: -3640> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000345 [2,head] #10000000345 auth v3690 s=3 n(v0 rc2023-10-03T19:13:38.324441+0000 b3 1=1+0) (iversion lock) 0x55cf62183b80] 2023-10-03T19:20:54.960 INFO:teuthology.orchestra.run.smithi045.stdout: -3639> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_336 [2,head] auth NULL (dversion lock) v=3690 ino=(nil) state=1073741824 0x55cf62188280] 2023-10-03T19:20:54.960 INFO:teuthology.orchestra.run.smithi045.stdout: -3638> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_335 [2,head] auth (dversion lock) v=3688 ino=0x10000000344 state=1073741824 0x55cf62188000] 2023-10-03T19:20:54.960 INFO:teuthology.orchestra.run.smithi045.stdout: -3637> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:54.960 INFO:teuthology.orchestra.run.smithi045.stdout: -3636> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000344 [2,head] /dc-dir/dc-file_335 auth v3688 s=3 n(v0 rc2023-10-03T19:13:38.313684+0000 b3 1=1+0) (iversion lock) 0x55cf62183600] 2023-10-03T19:20:54.960 INFO:teuthology.orchestra.run.smithi045.stdout: -3635> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_335 [2,head] auth (dversion lock) v=3688 ino=0x10000000344 state=1073741824 0x55cf62188000] [inode 0x10000000344 [2,head] /dc-dir/dc-file_335 auth v3688 s=3 n(v0 rc2023-10-03T19:13:38.313684+0000 b3 1=1+0) (iversion lock) 0x55cf62183600] 2023-10-03T19:20:55.094 INFO:teuthology.orchestra.run.smithi045.stdout: -3634> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000344 [2,head] #10000000344 auth v3688 s=3 n(v0 rc2023-10-03T19:13:38.313684+0000 b3 1=1+0) (iversion lock) 0x55cf62183600] 2023-10-03T19:20:55.094 INFO:teuthology.orchestra.run.smithi045.stdout: -3633> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_335 [2,head] auth NULL (dversion lock) v=3688 ino=(nil) state=1073741824 0x55cf62188000] 2023-10-03T19:20:55.094 INFO:teuthology.orchestra.run.smithi045.stdout: -3632> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_334 [2,head] auth (dversion lock) v=3686 ino=0x10000000343 state=1073741824 0x55cf6217fb80] 2023-10-03T19:20:55.095 INFO:teuthology.orchestra.run.smithi045.stdout: -3631> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.095 INFO:teuthology.orchestra.run.smithi045.stdout: -3630> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000343 [2,head] /dc-dir/dc-file_334 auth v3686 s=3 n(v0 rc2023-10-03T19:13:38.302027+0000 b3 1=1+0) (iversion lock) 0x55cf62183080] 2023-10-03T19:20:55.095 INFO:teuthology.orchestra.run.smithi045.stdout: -3629> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_334 [2,head] auth (dversion lock) v=3686 ino=0x10000000343 state=1073741824 0x55cf6217fb80] [inode 0x10000000343 [2,head] /dc-dir/dc-file_334 auth v3686 s=3 n(v0 rc2023-10-03T19:13:38.302027+0000 b3 1=1+0) (iversion lock) 0x55cf62183080] 2023-10-03T19:20:55.095 INFO:teuthology.orchestra.run.smithi045.stdout: -3628> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000343 [2,head] #10000000343 auth v3686 s=3 n(v0 rc2023-10-03T19:13:38.302027+0000 b3 1=1+0) (iversion lock) 0x55cf62183080] 2023-10-03T19:20:55.095 INFO:teuthology.orchestra.run.smithi045.stdout: -3627> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_334 [2,head] auth NULL (dversion lock) v=3686 ino=(nil) state=1073741824 0x55cf6217fb80] 2023-10-03T19:20:55.095 INFO:teuthology.orchestra.run.smithi045.stdout: -3626> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_333 [2,head] auth (dversion lock) v=3684 ino=0x10000000342 state=1073741824 0x55cf6217f900] 2023-10-03T19:20:55.095 INFO:teuthology.orchestra.run.smithi045.stdout: -3625> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.095 INFO:teuthology.orchestra.run.smithi045.stdout: -3624> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000342 [2,head] /dc-dir/dc-file_333 auth v3684 s=3 n(v0 rc2023-10-03T19:13:38.290747+0000 b3 1=1+0) (iversion lock) 0x55cf62182b00] 2023-10-03T19:20:55.095 INFO:teuthology.orchestra.run.smithi045.stdout: -3623> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_333 [2,head] auth (dversion lock) v=3684 ino=0x10000000342 state=1073741824 0x55cf6217f900] [inode 0x10000000342 [2,head] /dc-dir/dc-file_333 auth v3684 s=3 n(v0 rc2023-10-03T19:13:38.290747+0000 b3 1=1+0) (iversion lock) 0x55cf62182b00] 2023-10-03T19:20:55.095 INFO:teuthology.orchestra.run.smithi045.stdout: -3622> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000342 [2,head] #10000000342 auth v3684 s=3 n(v0 rc2023-10-03T19:13:38.290747+0000 b3 1=1+0) (iversion lock) 0x55cf62182b00] 2023-10-03T19:20:55.096 INFO:teuthology.orchestra.run.smithi045.stdout: -3621> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_333 [2,head] auth NULL (dversion lock) v=3684 ino=(nil) state=1073741824 0x55cf6217f900] 2023-10-03T19:20:55.096 INFO:teuthology.orchestra.run.smithi045.stdout: -3620> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_332 [2,head] auth (dversion lock) v=3682 ino=0x10000000341 state=1073741824 0x55cf6217f680] 2023-10-03T19:20:55.096 INFO:teuthology.orchestra.run.smithi045.stdout: -3619> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.096 INFO:teuthology.orchestra.run.smithi045.stdout: -3618> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000341 [2,head] /dc-dir/dc-file_332 auth v3682 s=3 n(v0 rc2023-10-03T19:13:38.279909+0000 b3 1=1+0) (iversion lock) 0x55cf62182580] 2023-10-03T19:20:55.096 INFO:teuthology.orchestra.run.smithi045.stdout: -3617> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_332 [2,head] auth (dversion lock) v=3682 ino=0x10000000341 state=1073741824 0x55cf6217f680] [inode 0x10000000341 [2,head] /dc-dir/dc-file_332 auth v3682 s=3 n(v0 rc2023-10-03T19:13:38.279909+0000 b3 1=1+0) (iversion lock) 0x55cf62182580] 2023-10-03T19:20:55.096 INFO:teuthology.orchestra.run.smithi045.stdout: -3616> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000341 [2,head] #10000000341 auth v3682 s=3 n(v0 rc2023-10-03T19:13:38.279909+0000 b3 1=1+0) (iversion lock) 0x55cf62182580] 2023-10-03T19:20:55.096 INFO:teuthology.orchestra.run.smithi045.stdout: -3615> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_332 [2,head] auth NULL (dversion lock) v=3682 ino=(nil) state=1073741824 0x55cf6217f680] 2023-10-03T19:20:55.096 INFO:teuthology.orchestra.run.smithi045.stdout: -3614> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_331 [2,head] auth (dversion lock) v=3680 ino=0x10000000340 state=1073741824 0x55cf6217f400] 2023-10-03T19:20:55.096 INFO:teuthology.orchestra.run.smithi045.stdout: -3613> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.096 INFO:teuthology.orchestra.run.smithi045.stdout: -3612> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000340 [2,head] /dc-dir/dc-file_331 auth v3680 s=3 n(v0 rc2023-10-03T19:13:38.269114+0000 b3 1=1+0) (iversion lock) 0x55cf62182000] 2023-10-03T19:20:55.096 INFO:teuthology.orchestra.run.smithi045.stdout: -3611> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_331 [2,head] auth (dversion lock) v=3680 ino=0x10000000340 state=1073741824 0x55cf6217f400] [inode 0x10000000340 [2,head] /dc-dir/dc-file_331 auth v3680 s=3 n(v0 rc2023-10-03T19:13:38.269114+0000 b3 1=1+0) (iversion lock) 0x55cf62182000] 2023-10-03T19:20:55.097 INFO:teuthology.orchestra.run.smithi045.stdout: -3610> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000340 [2,head] #10000000340 auth v3680 s=3 n(v0 rc2023-10-03T19:13:38.269114+0000 b3 1=1+0) (iversion lock) 0x55cf62182000] 2023-10-03T19:20:55.097 INFO:teuthology.orchestra.run.smithi045.stdout: -3609> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_331 [2,head] auth NULL (dversion lock) v=3680 ino=(nil) state=1073741824 0x55cf6217f400] 2023-10-03T19:20:55.097 INFO:teuthology.orchestra.run.smithi045.stdout: -3608> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_330 [2,head] auth (dversion lock) v=3678 ino=0x1000000033f state=1073741824 0x55cf6217f180] 2023-10-03T19:20:55.097 INFO:teuthology.orchestra.run.smithi045.stdout: -3607> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.097 INFO:teuthology.orchestra.run.smithi045.stdout: -3606> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000033f [2,head] /dc-dir/dc-file_330 auth v3678 s=3 n(v0 rc2023-10-03T19:13:38.258037+0000 b3 1=1+0) (iversion lock) 0x55cf62179700] 2023-10-03T19:20:55.097 INFO:teuthology.orchestra.run.smithi045.stdout: -3605> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_330 [2,head] auth (dversion lock) v=3678 ino=0x1000000033f state=1073741824 0x55cf6217f180] [inode 0x1000000033f [2,head] /dc-dir/dc-file_330 auth v3678 s=3 n(v0 rc2023-10-03T19:13:38.258037+0000 b3 1=1+0) (iversion lock) 0x55cf62179700] 2023-10-03T19:20:55.097 INFO:teuthology.orchestra.run.smithi045.stdout: -3604> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000033f [2,head] #1000000033f auth v3678 s=3 n(v0 rc2023-10-03T19:13:38.258037+0000 b3 1=1+0) (iversion lock) 0x55cf62179700] 2023-10-03T19:20:55.097 INFO:teuthology.orchestra.run.smithi045.stdout: -3603> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_330 [2,head] auth NULL (dversion lock) v=3678 ino=(nil) state=1073741824 0x55cf6217f180] 2023-10-03T19:20:55.097 INFO:teuthology.orchestra.run.smithi045.stdout: -3602> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_329 [2,head] auth (dversion lock) v=3676 ino=0x1000000033e state=1073741824 0x55cf6217ef00] 2023-10-03T19:20:55.097 INFO:teuthology.orchestra.run.smithi045.stdout: -3601> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.097 INFO:teuthology.orchestra.run.smithi045.stdout: -3600> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000033e [2,head] /dc-dir/dc-file_329 auth v3676 s=3 n(v0 rc2023-10-03T19:13:38.246829+0000 b3 1=1+0) (iversion lock) 0x55cf62179180] 2023-10-03T19:20:55.098 INFO:teuthology.orchestra.run.smithi045.stdout: -3599> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_329 [2,head] auth (dversion lock) v=3676 ino=0x1000000033e state=1073741824 0x55cf6217ef00] [inode 0x1000000033e [2,head] /dc-dir/dc-file_329 auth v3676 s=3 n(v0 rc2023-10-03T19:13:38.246829+0000 b3 1=1+0) (iversion lock) 0x55cf62179180] 2023-10-03T19:20:55.098 INFO:teuthology.orchestra.run.smithi045.stdout: -3598> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000033e [2,head] #1000000033e auth v3676 s=3 n(v0 rc2023-10-03T19:13:38.246829+0000 b3 1=1+0) (iversion lock) 0x55cf62179180] 2023-10-03T19:20:55.098 INFO:teuthology.orchestra.run.smithi045.stdout: -3597> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_329 [2,head] auth NULL (dversion lock) v=3676 ino=(nil) state=1073741824 0x55cf6217ef00] 2023-10-03T19:20:55.098 INFO:teuthology.orchestra.run.smithi045.stdout: -3596> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_328 [2,head] auth (dversion lock) v=3674 ino=0x1000000033d state=1073741824 0x55cf6217ec80] 2023-10-03T19:20:55.098 INFO:teuthology.orchestra.run.smithi045.stdout: -3595> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.098 INFO:teuthology.orchestra.run.smithi045.stdout: -3594> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000033d [2,head] /dc-dir/dc-file_328 auth v3674 s=3 n(v0 rc2023-10-03T19:13:38.235934+0000 b3 1=1+0) (iversion lock) 0x55cf62178c00] 2023-10-03T19:20:55.098 INFO:teuthology.orchestra.run.smithi045.stdout: -3593> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_328 [2,head] auth (dversion lock) v=3674 ino=0x1000000033d state=1073741824 0x55cf6217ec80] [inode 0x1000000033d [2,head] /dc-dir/dc-file_328 auth v3674 s=3 n(v0 rc2023-10-03T19:13:38.235934+0000 b3 1=1+0) (iversion lock) 0x55cf62178c00] 2023-10-03T19:20:55.098 INFO:teuthology.orchestra.run.smithi045.stdout: -3592> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000033d [2,head] #1000000033d auth v3674 s=3 n(v0 rc2023-10-03T19:13:38.235934+0000 b3 1=1+0) (iversion lock) 0x55cf62178c00] 2023-10-03T19:20:55.098 INFO:teuthology.orchestra.run.smithi045.stdout: -3591> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_328 [2,head] auth NULL (dversion lock) v=3674 ino=(nil) state=1073741824 0x55cf6217ec80] 2023-10-03T19:20:55.098 INFO:teuthology.orchestra.run.smithi045.stdout: -3590> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_327 [2,head] auth (dversion lock) v=3672 ino=0x1000000033c state=1073741824 0x55cf6217ea00] 2023-10-03T19:20:55.098 INFO:teuthology.orchestra.run.smithi045.stdout: -3589> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.099 INFO:teuthology.orchestra.run.smithi045.stdout: -3588> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000033c [2,head] /dc-dir/dc-file_327 auth v3672 s=3 n(v0 rc2023-10-03T19:13:38.224668+0000 b3 1=1+0) (iversion lock) 0x55cf62178680] 2023-10-03T19:20:55.099 INFO:teuthology.orchestra.run.smithi045.stdout: -3587> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_327 [2,head] auth (dversion lock) v=3672 ino=0x1000000033c state=1073741824 0x55cf6217ea00] [inode 0x1000000033c [2,head] /dc-dir/dc-file_327 auth v3672 s=3 n(v0 rc2023-10-03T19:13:38.224668+0000 b3 1=1+0) (iversion lock) 0x55cf62178680] 2023-10-03T19:20:55.099 INFO:teuthology.orchestra.run.smithi045.stdout: -3586> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000033c [2,head] #1000000033c auth v3672 s=3 n(v0 rc2023-10-03T19:13:38.224668+0000 b3 1=1+0) (iversion lock) 0x55cf62178680] 2023-10-03T19:20:55.099 INFO:teuthology.orchestra.run.smithi045.stdout: -3585> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_327 [2,head] auth NULL (dversion lock) v=3672 ino=(nil) state=1073741824 0x55cf6217ea00] 2023-10-03T19:20:55.099 INFO:teuthology.orchestra.run.smithi045.stdout: -3584> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_326 [2,head] auth (dversion lock) v=3670 ino=0x1000000033b state=1073741824 0x55cf6217e780] 2023-10-03T19:20:55.099 INFO:teuthology.orchestra.run.smithi045.stdout: -3583> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.099 INFO:teuthology.orchestra.run.smithi045.stdout: -3582> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000033b [2,head] /dc-dir/dc-file_326 auth v3670 s=3 n(v0 rc2023-10-03T19:13:38.213593+0000 b3 1=1+0) (iversion lock) 0x55cf62178100] 2023-10-03T19:20:55.099 INFO:teuthology.orchestra.run.smithi045.stdout: -3581> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_326 [2,head] auth (dversion lock) v=3670 ino=0x1000000033b state=1073741824 0x55cf6217e780] [inode 0x1000000033b [2,head] /dc-dir/dc-file_326 auth v3670 s=3 n(v0 rc2023-10-03T19:13:38.213593+0000 b3 1=1+0) (iversion lock) 0x55cf62178100] 2023-10-03T19:20:55.099 INFO:teuthology.orchestra.run.smithi045.stdout: -3580> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000033b [2,head] #1000000033b auth v3670 s=3 n(v0 rc2023-10-03T19:13:38.213593+0000 b3 1=1+0) (iversion lock) 0x55cf62178100] 2023-10-03T19:20:55.099 INFO:teuthology.orchestra.run.smithi045.stdout: -3579> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_326 [2,head] auth NULL (dversion lock) v=3670 ino=(nil) state=1073741824 0x55cf6217e780] 2023-10-03T19:20:55.100 INFO:teuthology.orchestra.run.smithi045.stdout: -3578> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_325 [2,head] auth (dversion lock) v=3668 ino=0x1000000033a state=1073741824 0x55cf6217e500] 2023-10-03T19:20:55.100 INFO:teuthology.orchestra.run.smithi045.stdout: -3577> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.100 INFO:teuthology.orchestra.run.smithi045.stdout: -3576> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000033a [2,head] /dc-dir/dc-file_325 auth v3668 s=3 n(v0 rc2023-10-03T19:13:38.202501+0000 b3 1=1+0) (iversion lock) 0x55cf62177b80] 2023-10-03T19:20:55.100 INFO:teuthology.orchestra.run.smithi045.stdout: -3575> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_325 [2,head] auth (dversion lock) v=3668 ino=0x1000000033a state=1073741824 0x55cf6217e500] [inode 0x1000000033a [2,head] /dc-dir/dc-file_325 auth v3668 s=3 n(v0 rc2023-10-03T19:13:38.202501+0000 b3 1=1+0) (iversion lock) 0x55cf62177b80] 2023-10-03T19:20:55.100 INFO:teuthology.orchestra.run.smithi045.stdout: -3574> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000033a [2,head] #1000000033a auth v3668 s=3 n(v0 rc2023-10-03T19:13:38.202501+0000 b3 1=1+0) (iversion lock) 0x55cf62177b80] 2023-10-03T19:20:55.100 INFO:teuthology.orchestra.run.smithi045.stdout: -3573> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_325 [2,head] auth NULL (dversion lock) v=3668 ino=(nil) state=1073741824 0x55cf6217e500] 2023-10-03T19:20:55.100 INFO:teuthology.orchestra.run.smithi045.stdout: -3572> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_324 [2,head] auth (dversion lock) v=3666 ino=0x10000000339 state=1073741824 0x55cf6217e280] 2023-10-03T19:20:55.100 INFO:teuthology.orchestra.run.smithi045.stdout: -3571> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.100 INFO:teuthology.orchestra.run.smithi045.stdout: -3570> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000339 [2,head] /dc-dir/dc-file_324 auth v3666 s=3 n(v0 rc2023-10-03T19:13:38.190478+0000 b3 1=1+0) (iversion lock) 0x55cf62177600] 2023-10-03T19:20:55.100 INFO:teuthology.orchestra.run.smithi045.stdout: -3569> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_324 [2,head] auth (dversion lock) v=3666 ino=0x10000000339 state=1073741824 0x55cf6217e280] [inode 0x10000000339 [2,head] /dc-dir/dc-file_324 auth v3666 s=3 n(v0 rc2023-10-03T19:13:38.190478+0000 b3 1=1+0) (iversion lock) 0x55cf62177600] 2023-10-03T19:20:55.100 INFO:teuthology.orchestra.run.smithi045.stdout: -3568> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000339 [2,head] #10000000339 auth v3666 s=3 n(v0 rc2023-10-03T19:13:38.190478+0000 b3 1=1+0) (iversion lock) 0x55cf62177600] 2023-10-03T19:20:55.101 INFO:teuthology.orchestra.run.smithi045.stdout: -3567> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_324 [2,head] auth NULL (dversion lock) v=3666 ino=(nil) state=1073741824 0x55cf6217e280] 2023-10-03T19:20:55.101 INFO:teuthology.orchestra.run.smithi045.stdout: -3566> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_323 [2,head] auth (dversion lock) v=3664 ino=0x10000000338 state=1073741824 0x55cf6217e000] 2023-10-03T19:20:55.101 INFO:teuthology.orchestra.run.smithi045.stdout: -3565> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.101 INFO:teuthology.orchestra.run.smithi045.stdout: -3564> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000338 [2,head] /dc-dir/dc-file_323 auth v3664 s=3 n(v0 rc2023-10-03T19:13:38.179715+0000 b3 1=1+0) (iversion lock) 0x55cf62177080] 2023-10-03T19:20:55.101 INFO:teuthology.orchestra.run.smithi045.stdout: -3563> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_323 [2,head] auth (dversion lock) v=3664 ino=0x10000000338 state=1073741824 0x55cf6217e000] [inode 0x10000000338 [2,head] /dc-dir/dc-file_323 auth v3664 s=3 n(v0 rc2023-10-03T19:13:38.179715+0000 b3 1=1+0) (iversion lock) 0x55cf62177080] 2023-10-03T19:20:55.101 INFO:teuthology.orchestra.run.smithi045.stdout: -3562> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000338 [2,head] #10000000338 auth v3664 s=3 n(v0 rc2023-10-03T19:13:38.179715+0000 b3 1=1+0) (iversion lock) 0x55cf62177080] 2023-10-03T19:20:55.101 INFO:teuthology.orchestra.run.smithi045.stdout: -3561> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_323 [2,head] auth NULL (dversion lock) v=3664 ino=(nil) state=1073741824 0x55cf6217e000] 2023-10-03T19:20:55.101 INFO:teuthology.orchestra.run.smithi045.stdout: -3560> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_322 [2,head] auth (dversion lock) v=3662 ino=0x10000000337 state=1073741824 0x55cf62173b80] 2023-10-03T19:20:55.101 INFO:teuthology.orchestra.run.smithi045.stdout: -3559> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.101 INFO:teuthology.orchestra.run.smithi045.stdout: -3558> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000337 [2,head] /dc-dir/dc-file_322 auth v3662 s=3 n(v0 rc2023-10-03T19:13:38.168909+0000 b3 1=1+0) (iversion lock) 0x55cf62176b00] 2023-10-03T19:20:55.102 INFO:teuthology.orchestra.run.smithi045.stdout: -3557> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_322 [2,head] auth (dversion lock) v=3662 ino=0x10000000337 state=1073741824 0x55cf62173b80] [inode 0x10000000337 [2,head] /dc-dir/dc-file_322 auth v3662 s=3 n(v0 rc2023-10-03T19:13:38.168909+0000 b3 1=1+0) (iversion lock) 0x55cf62176b00] 2023-10-03T19:20:55.102 INFO:teuthology.orchestra.run.smithi045.stdout: -3556> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000337 [2,head] #10000000337 auth v3662 s=3 n(v0 rc2023-10-03T19:13:38.168909+0000 b3 1=1+0) (iversion lock) 0x55cf62176b00] 2023-10-03T19:20:55.102 INFO:teuthology.orchestra.run.smithi045.stdout: -3555> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_322 [2,head] auth NULL (dversion lock) v=3662 ino=(nil) state=1073741824 0x55cf62173b80] 2023-10-03T19:20:55.102 INFO:teuthology.orchestra.run.smithi045.stdout: -3554> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_321 [2,head] auth (dversion lock) v=3660 ino=0x10000000336 state=1073741824 0x55cf62173900] 2023-10-03T19:20:55.102 INFO:teuthology.orchestra.run.smithi045.stdout: -3553> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.102 INFO:teuthology.orchestra.run.smithi045.stdout: -3552> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000336 [2,head] /dc-dir/dc-file_321 auth v3660 s=3 n(v0 rc2023-10-03T19:13:38.158174+0000 b3 1=1+0) (iversion lock) 0x55cf62176580] 2023-10-03T19:20:55.102 INFO:teuthology.orchestra.run.smithi045.stdout: -3551> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_321 [2,head] auth (dversion lock) v=3660 ino=0x10000000336 state=1073741824 0x55cf62173900] [inode 0x10000000336 [2,head] /dc-dir/dc-file_321 auth v3660 s=3 n(v0 rc2023-10-03T19:13:38.158174+0000 b3 1=1+0) (iversion lock) 0x55cf62176580] 2023-10-03T19:20:55.102 INFO:teuthology.orchestra.run.smithi045.stdout: -3550> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000336 [2,head] #10000000336 auth v3660 s=3 n(v0 rc2023-10-03T19:13:38.158174+0000 b3 1=1+0) (iversion lock) 0x55cf62176580] 2023-10-03T19:20:55.102 INFO:teuthology.orchestra.run.smithi045.stdout: -3549> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_321 [2,head] auth NULL (dversion lock) v=3660 ino=(nil) state=1073741824 0x55cf62173900] 2023-10-03T19:20:55.102 INFO:teuthology.orchestra.run.smithi045.stdout: -3548> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_320 [2,head] auth (dversion lock) v=3658 ino=0x10000000335 state=1073741824 0x55cf62173680] 2023-10-03T19:20:55.102 INFO:teuthology.orchestra.run.smithi045.stdout: -3547> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.103 INFO:teuthology.orchestra.run.smithi045.stdout: -3546> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000335 [2,head] /dc-dir/dc-file_320 auth v3658 s=3 n(v0 rc2023-10-03T19:13:38.147532+0000 b3 1=1+0) (iversion lock) 0x55cf62176000] 2023-10-03T19:20:55.103 INFO:teuthology.orchestra.run.smithi045.stdout: -3545> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_320 [2,head] auth (dversion lock) v=3658 ino=0x10000000335 state=1073741824 0x55cf62173680] [inode 0x10000000335 [2,head] /dc-dir/dc-file_320 auth v3658 s=3 n(v0 rc2023-10-03T19:13:38.147532+0000 b3 1=1+0) (iversion lock) 0x55cf62176000] 2023-10-03T19:20:55.103 INFO:teuthology.orchestra.run.smithi045.stdout: -3544> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000335 [2,head] #10000000335 auth v3658 s=3 n(v0 rc2023-10-03T19:13:38.147532+0000 b3 1=1+0) (iversion lock) 0x55cf62176000] 2023-10-03T19:20:55.103 INFO:teuthology.orchestra.run.smithi045.stdout: -3543> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_320 [2,head] auth NULL (dversion lock) v=3658 ino=(nil) state=1073741824 0x55cf62173680] 2023-10-03T19:20:55.103 INFO:teuthology.orchestra.run.smithi045.stdout: -3542> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_319 [2,head] auth (dversion lock) v=3656 ino=0x10000000334 state=1073741824 0x55cf62173400] 2023-10-03T19:20:55.103 INFO:teuthology.orchestra.run.smithi045.stdout: -3541> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.103 INFO:teuthology.orchestra.run.smithi045.stdout: -3540> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000334 [2,head] /dc-dir/dc-file_319 auth v3656 s=3 n(v0 rc2023-10-03T19:13:38.134732+0000 b3 1=1+0) (iversion lock) 0x55cf6216b700] 2023-10-03T19:20:55.103 INFO:teuthology.orchestra.run.smithi045.stdout: -3539> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_319 [2,head] auth (dversion lock) v=3656 ino=0x10000000334 state=1073741824 0x55cf62173400] [inode 0x10000000334 [2,head] /dc-dir/dc-file_319 auth v3656 s=3 n(v0 rc2023-10-03T19:13:38.134732+0000 b3 1=1+0) (iversion lock) 0x55cf6216b700] 2023-10-03T19:20:55.103 INFO:teuthology.orchestra.run.smithi045.stdout: -3538> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000334 [2,head] #10000000334 auth v3656 s=3 n(v0 rc2023-10-03T19:13:38.134732+0000 b3 1=1+0) (iversion lock) 0x55cf6216b700] 2023-10-03T19:20:55.103 INFO:teuthology.orchestra.run.smithi045.stdout: -3537> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_319 [2,head] auth NULL (dversion lock) v=3656 ino=(nil) state=1073741824 0x55cf62173400] 2023-10-03T19:20:55.103 INFO:teuthology.orchestra.run.smithi045.stdout: -3536> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_318 [2,head] auth (dversion lock) v=3654 ino=0x10000000333 state=1073741824 0x55cf62173180] 2023-10-03T19:20:55.103 INFO:teuthology.orchestra.run.smithi045.stdout: -3535> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.104 INFO:teuthology.orchestra.run.smithi045.stdout: -3534> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000333 [2,head] /dc-dir/dc-file_318 auth v3654 s=3 n(v0 rc2023-10-03T19:13:38.122314+0000 b3 1=1+0) (iversion lock) 0x55cf6216b180] 2023-10-03T19:20:55.104 INFO:teuthology.orchestra.run.smithi045.stdout: -3533> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_318 [2,head] auth (dversion lock) v=3654 ino=0x10000000333 state=1073741824 0x55cf62173180] [inode 0x10000000333 [2,head] /dc-dir/dc-file_318 auth v3654 s=3 n(v0 rc2023-10-03T19:13:38.122314+0000 b3 1=1+0) (iversion lock) 0x55cf6216b180] 2023-10-03T19:20:55.104 INFO:teuthology.orchestra.run.smithi045.stdout: -3532> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000333 [2,head] #10000000333 auth v3654 s=3 n(v0 rc2023-10-03T19:13:38.122314+0000 b3 1=1+0) (iversion lock) 0x55cf6216b180] 2023-10-03T19:20:55.104 INFO:teuthology.orchestra.run.smithi045.stdout: -3531> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_318 [2,head] auth NULL (dversion lock) v=3654 ino=(nil) state=1073741824 0x55cf62173180] 2023-10-03T19:20:55.104 INFO:teuthology.orchestra.run.smithi045.stdout: -3530> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_317 [2,head] auth (dversion lock) v=3652 ino=0x10000000332 state=1073741824 0x55cf62172f00] 2023-10-03T19:20:55.104 INFO:teuthology.orchestra.run.smithi045.stdout: -3529> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.104 INFO:teuthology.orchestra.run.smithi045.stdout: -3528> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000332 [2,head] /dc-dir/dc-file_317 auth v3652 s=3 n(v0 rc2023-10-03T19:13:38.111334+0000 b3 1=1+0) (iversion lock) 0x55cf6216ac00] 2023-10-03T19:20:55.104 INFO:teuthology.orchestra.run.smithi045.stdout: -3527> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_317 [2,head] auth (dversion lock) v=3652 ino=0x10000000332 state=1073741824 0x55cf62172f00] [inode 0x10000000332 [2,head] /dc-dir/dc-file_317 auth v3652 s=3 n(v0 rc2023-10-03T19:13:38.111334+0000 b3 1=1+0) (iversion lock) 0x55cf6216ac00] 2023-10-03T19:20:55.104 INFO:teuthology.orchestra.run.smithi045.stdout: -3526> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000332 [2,head] #10000000332 auth v3652 s=3 n(v0 rc2023-10-03T19:13:38.111334+0000 b3 1=1+0) (iversion lock) 0x55cf6216ac00] 2023-10-03T19:20:55.104 INFO:teuthology.orchestra.run.smithi045.stdout: -3525> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_317 [2,head] auth NULL (dversion lock) v=3652 ino=(nil) state=1073741824 0x55cf62172f00] 2023-10-03T19:20:55.105 INFO:teuthology.orchestra.run.smithi045.stdout: -3524> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_316 [2,head] auth (dversion lock) v=3650 ino=0x10000000331 state=1073741824 0x55cf62172c80] 2023-10-03T19:20:55.105 INFO:teuthology.orchestra.run.smithi045.stdout: -3523> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.105 INFO:teuthology.orchestra.run.smithi045.stdout: -3522> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000331 [2,head] /dc-dir/dc-file_316 auth v3650 s=3 n(v0 rc2023-10-03T19:13:38.100463+0000 b3 1=1+0) (iversion lock) 0x55cf6216a680] 2023-10-03T19:20:55.105 INFO:teuthology.orchestra.run.smithi045.stdout: -3521> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_316 [2,head] auth (dversion lock) v=3650 ino=0x10000000331 state=1073741824 0x55cf62172c80] [inode 0x10000000331 [2,head] /dc-dir/dc-file_316 auth v3650 s=3 n(v0 rc2023-10-03T19:13:38.100463+0000 b3 1=1+0) (iversion lock) 0x55cf6216a680] 2023-10-03T19:20:55.105 INFO:teuthology.orchestra.run.smithi045.stdout: -3520> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000331 [2,head] #10000000331 auth v3650 s=3 n(v0 rc2023-10-03T19:13:38.100463+0000 b3 1=1+0) (iversion lock) 0x55cf6216a680] 2023-10-03T19:20:55.105 INFO:teuthology.orchestra.run.smithi045.stdout: -3519> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_316 [2,head] auth NULL (dversion lock) v=3650 ino=(nil) state=1073741824 0x55cf62172c80] 2023-10-03T19:20:55.106 INFO:teuthology.orchestra.run.smithi045.stdout: -3518> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_315 [2,head] auth (dversion lock) v=3648 ino=0x10000000330 state=1073741824 0x55cf62172a00] 2023-10-03T19:20:55.106 INFO:teuthology.orchestra.run.smithi045.stdout: -3517> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.106 INFO:teuthology.orchestra.run.smithi045.stdout: -3516> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000330 [2,head] /dc-dir/dc-file_315 auth v3648 s=3 n(v0 rc2023-10-03T19:13:38.089165+0000 b3 1=1+0) (iversion lock) 0x55cf6216a100] 2023-10-03T19:20:55.106 INFO:teuthology.orchestra.run.smithi045.stdout: -3515> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_315 [2,head] auth (dversion lock) v=3648 ino=0x10000000330 state=1073741824 0x55cf62172a00] [inode 0x10000000330 [2,head] /dc-dir/dc-file_315 auth v3648 s=3 n(v0 rc2023-10-03T19:13:38.089165+0000 b3 1=1+0) (iversion lock) 0x55cf6216a100] 2023-10-03T19:20:55.106 INFO:teuthology.orchestra.run.smithi045.stdout: -3514> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000330 [2,head] #10000000330 auth v3648 s=3 n(v0 rc2023-10-03T19:13:38.089165+0000 b3 1=1+0) (iversion lock) 0x55cf6216a100] 2023-10-03T19:20:55.106 INFO:teuthology.orchestra.run.smithi045.stdout: -3513> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_315 [2,head] auth NULL (dversion lock) v=3648 ino=(nil) state=1073741824 0x55cf62172a00] 2023-10-03T19:20:55.106 INFO:teuthology.orchestra.run.smithi045.stdout: -3512> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_314 [2,head] auth (dversion lock) v=3646 ino=0x1000000032f state=1073741824 0x55cf62172780] 2023-10-03T19:20:55.106 INFO:teuthology.orchestra.run.smithi045.stdout: -3511> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.106 INFO:teuthology.orchestra.run.smithi045.stdout: -3510> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000032f [2,head] /dc-dir/dc-file_314 auth v3646 s=3 n(v0 rc2023-10-03T19:13:38.076806+0000 b3 1=1+0) (iversion lock) 0x55cf62169b80] 2023-10-03T19:20:55.106 INFO:teuthology.orchestra.run.smithi045.stdout: -3509> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_314 [2,head] auth (dversion lock) v=3646 ino=0x1000000032f state=1073741824 0x55cf62172780] [inode 0x1000000032f [2,head] /dc-dir/dc-file_314 auth v3646 s=3 n(v0 rc2023-10-03T19:13:38.076806+0000 b3 1=1+0) (iversion lock) 0x55cf62169b80] 2023-10-03T19:20:55.107 INFO:teuthology.orchestra.run.smithi045.stdout: -3508> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000032f [2,head] #1000000032f auth v3646 s=3 n(v0 rc2023-10-03T19:13:38.076806+0000 b3 1=1+0) (iversion lock) 0x55cf62169b80] 2023-10-03T19:20:55.107 INFO:teuthology.orchestra.run.smithi045.stdout: -3507> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_314 [2,head] auth NULL (dversion lock) v=3646 ino=(nil) state=1073741824 0x55cf62172780] 2023-10-03T19:20:55.107 INFO:teuthology.orchestra.run.smithi045.stdout: -3506> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_313 [2,head] auth (dversion lock) v=3644 ino=0x1000000032e state=1073741824 0x55cf62172500] 2023-10-03T19:20:55.107 INFO:teuthology.orchestra.run.smithi045.stdout: -3505> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.107 INFO:teuthology.orchestra.run.smithi045.stdout: -3504> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000032e [2,head] /dc-dir/dc-file_313 auth v3644 s=3 n(v0 rc2023-10-03T19:13:38.064468+0000 b3 1=1+0) (iversion lock) 0x55cf62169600] 2023-10-03T19:20:55.107 INFO:teuthology.orchestra.run.smithi045.stdout: -3503> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_313 [2,head] auth (dversion lock) v=3644 ino=0x1000000032e state=1073741824 0x55cf62172500] [inode 0x1000000032e [2,head] /dc-dir/dc-file_313 auth v3644 s=3 n(v0 rc2023-10-03T19:13:38.064468+0000 b3 1=1+0) (iversion lock) 0x55cf62169600] 2023-10-03T19:20:55.107 INFO:teuthology.orchestra.run.smithi045.stdout: -3502> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000032e [2,head] #1000000032e auth v3644 s=3 n(v0 rc2023-10-03T19:13:38.064468+0000 b3 1=1+0) (iversion lock) 0x55cf62169600] 2023-10-03T19:20:55.107 INFO:teuthology.orchestra.run.smithi045.stdout: -3501> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_313 [2,head] auth NULL (dversion lock) v=3644 ino=(nil) state=1073741824 0x55cf62172500] 2023-10-03T19:20:55.107 INFO:teuthology.orchestra.run.smithi045.stdout: -3500> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_312 [2,head] auth (dversion lock) v=3642 ino=0x1000000032d state=1073741824 0x55cf62172280] 2023-10-03T19:20:55.107 INFO:teuthology.orchestra.run.smithi045.stdout: -3499> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.108 INFO:teuthology.orchestra.run.smithi045.stdout: -3498> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000032d [2,head] /dc-dir/dc-file_312 auth v3642 s=3 n(v0 rc2023-10-03T19:13:38.051899+0000 b3 1=1+0) (iversion lock) 0x55cf62169080] 2023-10-03T19:20:55.108 INFO:teuthology.orchestra.run.smithi045.stdout: -3497> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_312 [2,head] auth (dversion lock) v=3642 ino=0x1000000032d state=1073741824 0x55cf62172280] [inode 0x1000000032d [2,head] /dc-dir/dc-file_312 auth v3642 s=3 n(v0 rc2023-10-03T19:13:38.051899+0000 b3 1=1+0) (iversion lock) 0x55cf62169080] 2023-10-03T19:20:55.108 INFO:teuthology.orchestra.run.smithi045.stdout: -3496> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000032d [2,head] #1000000032d auth v3642 s=3 n(v0 rc2023-10-03T19:13:38.051899+0000 b3 1=1+0) (iversion lock) 0x55cf62169080] 2023-10-03T19:20:55.109 INFO:teuthology.orchestra.run.smithi045.stdout: -3495> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_312 [2,head] auth NULL (dversion lock) v=3642 ino=(nil) state=1073741824 0x55cf62172280] 2023-10-03T19:20:55.109 INFO:teuthology.orchestra.run.smithi045.stdout: -3494> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_311 [2,head] auth (dversion lock) v=3640 ino=0x1000000032c state=1073741824 0x55cf62172000] 2023-10-03T19:20:55.109 INFO:teuthology.orchestra.run.smithi045.stdout: -3493> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.109 INFO:teuthology.orchestra.run.smithi045.stdout: -3492> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000032c [2,head] /dc-dir/dc-file_311 auth v3640 s=3 n(v0 rc2023-10-03T19:13:38.038384+0000 b3 1=1+0) (iversion lock) 0x55cf62168b00] 2023-10-03T19:20:55.109 INFO:teuthology.orchestra.run.smithi045.stdout: -3491> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_311 [2,head] auth (dversion lock) v=3640 ino=0x1000000032c state=1073741824 0x55cf62172000] [inode 0x1000000032c [2,head] /dc-dir/dc-file_311 auth v3640 s=3 n(v0 rc2023-10-03T19:13:38.038384+0000 b3 1=1+0) (iversion lock) 0x55cf62168b00] 2023-10-03T19:20:55.109 INFO:teuthology.orchestra.run.smithi045.stdout: -3490> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000032c [2,head] #1000000032c auth v3640 s=3 n(v0 rc2023-10-03T19:13:38.038384+0000 b3 1=1+0) (iversion lock) 0x55cf62168b00] 2023-10-03T19:20:55.109 INFO:teuthology.orchestra.run.smithi045.stdout: -3489> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_311 [2,head] auth NULL (dversion lock) v=3640 ino=(nil) state=1073741824 0x55cf62172000] 2023-10-03T19:20:55.109 INFO:teuthology.orchestra.run.smithi045.stdout: -3488> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_310 [2,head] auth (dversion lock) v=3638 ino=0x1000000032b state=1073741824 0x55cf6215fb80] 2023-10-03T19:20:55.109 INFO:teuthology.orchestra.run.smithi045.stdout: -3487> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.110 INFO:teuthology.orchestra.run.smithi045.stdout: -3486> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000032b [2,head] /dc-dir/dc-file_310 auth v3638 s=3 n(v0 rc2023-10-03T19:13:38.026805+0000 b3 1=1+0) (iversion lock) 0x55cf62168580] 2023-10-03T19:20:55.110 INFO:teuthology.orchestra.run.smithi045.stdout: -3485> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_310 [2,head] auth (dversion lock) v=3638 ino=0x1000000032b state=1073741824 0x55cf6215fb80] [inode 0x1000000032b [2,head] /dc-dir/dc-file_310 auth v3638 s=3 n(v0 rc2023-10-03T19:13:38.026805+0000 b3 1=1+0) (iversion lock) 0x55cf62168580] 2023-10-03T19:20:55.110 INFO:teuthology.orchestra.run.smithi045.stdout: -3484> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000032b [2,head] #1000000032b auth v3638 s=3 n(v0 rc2023-10-03T19:13:38.026805+0000 b3 1=1+0) (iversion lock) 0x55cf62168580] 2023-10-03T19:20:55.110 INFO:teuthology.orchestra.run.smithi045.stdout: -3483> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_310 [2,head] auth NULL (dversion lock) v=3638 ino=(nil) state=1073741824 0x55cf6215fb80] 2023-10-03T19:20:55.110 INFO:teuthology.orchestra.run.smithi045.stdout: -3482> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_309 [2,head] auth (dversion lock) v=3636 ino=0x1000000032a state=1073741824 0x55cf6215f900] 2023-10-03T19:20:55.110 INFO:teuthology.orchestra.run.smithi045.stdout: -3481> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.110 INFO:teuthology.orchestra.run.smithi045.stdout: -3480> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000032a [2,head] /dc-dir/dc-file_309 auth v3636 s=3 n(v0 rc2023-10-03T19:13:38.015935+0000 b3 1=1+0) (iversion lock) 0x55cf62168000] 2023-10-03T19:20:55.110 INFO:teuthology.orchestra.run.smithi045.stdout: -3479> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_309 [2,head] auth (dversion lock) v=3636 ino=0x1000000032a state=1073741824 0x55cf6215f900] [inode 0x1000000032a [2,head] /dc-dir/dc-file_309 auth v3636 s=3 n(v0 rc2023-10-03T19:13:38.015935+0000 b3 1=1+0) (iversion lock) 0x55cf62168000] 2023-10-03T19:20:55.110 INFO:teuthology.orchestra.run.smithi045.stdout: -3478> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000032a [2,head] #1000000032a auth v3636 s=3 n(v0 rc2023-10-03T19:13:38.015935+0000 b3 1=1+0) (iversion lock) 0x55cf62168000] 2023-10-03T19:20:55.110 INFO:teuthology.orchestra.run.smithi045.stdout: -3477> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_309 [2,head] auth NULL (dversion lock) v=3636 ino=(nil) state=1073741824 0x55cf6215f900] 2023-10-03T19:20:55.110 INFO:teuthology.orchestra.run.smithi045.stdout: -3476> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_308 [2,head] auth (dversion lock) v=3634 ino=0x10000000329 state=1073741824 0x55cf6215f680] 2023-10-03T19:20:55.111 INFO:teuthology.orchestra.run.smithi045.stdout: -3475> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.111 INFO:teuthology.orchestra.run.smithi045.stdout: -3474> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000329 [2,head] /dc-dir/dc-file_308 auth v3634 s=3 n(v0 rc2023-10-03T19:13:38.003041+0000 b3 1=1+0) (iversion lock) 0x55cf6215d700] 2023-10-03T19:20:55.111 INFO:teuthology.orchestra.run.smithi045.stdout: -3473> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_308 [2,head] auth (dversion lock) v=3634 ino=0x10000000329 state=1073741824 0x55cf6215f680] [inode 0x10000000329 [2,head] /dc-dir/dc-file_308 auth v3634 s=3 n(v0 rc2023-10-03T19:13:38.003041+0000 b3 1=1+0) (iversion lock) 0x55cf6215d700] 2023-10-03T19:20:55.111 INFO:teuthology.orchestra.run.smithi045.stdout: -3472> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000329 [2,head] #10000000329 auth v3634 s=3 n(v0 rc2023-10-03T19:13:38.003041+0000 b3 1=1+0) (iversion lock) 0x55cf6215d700] 2023-10-03T19:20:55.111 INFO:teuthology.orchestra.run.smithi045.stdout: -3471> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_308 [2,head] auth NULL (dversion lock) v=3634 ino=(nil) state=1073741824 0x55cf6215f680] 2023-10-03T19:20:55.111 INFO:teuthology.orchestra.run.smithi045.stdout: -3470> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_307 [2,head] auth (dversion lock) v=3632 ino=0x10000000328 state=1073741824 0x55cf6215f400] 2023-10-03T19:20:55.111 INFO:teuthology.orchestra.run.smithi045.stdout: -3469> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.111 INFO:teuthology.orchestra.run.smithi045.stdout: -3468> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000328 [2,head] /dc-dir/dc-file_307 auth v3632 s=3 n(v0 rc2023-10-03T19:13:37.989663+0000 b3 1=1+0) (iversion lock) 0x55cf6215d180] 2023-10-03T19:20:55.111 INFO:teuthology.orchestra.run.smithi045.stdout: -3467> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_307 [2,head] auth (dversion lock) v=3632 ino=0x10000000328 state=1073741824 0x55cf6215f400] [inode 0x10000000328 [2,head] /dc-dir/dc-file_307 auth v3632 s=3 n(v0 rc2023-10-03T19:13:37.989663+0000 b3 1=1+0) (iversion lock) 0x55cf6215d180] 2023-10-03T19:20:55.111 INFO:teuthology.orchestra.run.smithi045.stdout: -3466> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000328 [2,head] #10000000328 auth v3632 s=3 n(v0 rc2023-10-03T19:13:37.989663+0000 b3 1=1+0) (iversion lock) 0x55cf6215d180] 2023-10-03T19:20:55.111 INFO:teuthology.orchestra.run.smithi045.stdout: -3465> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_307 [2,head] auth NULL (dversion lock) v=3632 ino=(nil) state=1073741824 0x55cf6215f400] 2023-10-03T19:20:55.112 INFO:teuthology.orchestra.run.smithi045.stdout: -3464> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_306 [2,head] auth (dversion lock) v=3630 ino=0x10000000327 state=1073741824 0x55cf6215f180] 2023-10-03T19:20:55.112 INFO:teuthology.orchestra.run.smithi045.stdout: -3463> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.112 INFO:teuthology.orchestra.run.smithi045.stdout: -3462> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000327 [2,head] /dc-dir/dc-file_306 auth v3630 s=3 n(v0 rc2023-10-03T19:13:37.977841+0000 b3 1=1+0) (iversion lock) 0x55cf6215cc00] 2023-10-03T19:20:55.112 INFO:teuthology.orchestra.run.smithi045.stdout: -3461> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_306 [2,head] auth (dversion lock) v=3630 ino=0x10000000327 state=1073741824 0x55cf6215f180] [inode 0x10000000327 [2,head] /dc-dir/dc-file_306 auth v3630 s=3 n(v0 rc2023-10-03T19:13:37.977841+0000 b3 1=1+0) (iversion lock) 0x55cf6215cc00] 2023-10-03T19:20:55.112 INFO:teuthology.orchestra.run.smithi045.stdout: -3460> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000327 [2,head] #10000000327 auth v3630 s=3 n(v0 rc2023-10-03T19:13:37.977841+0000 b3 1=1+0) (iversion lock) 0x55cf6215cc00] 2023-10-03T19:20:55.112 INFO:teuthology.orchestra.run.smithi045.stdout: -3459> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_306 [2,head] auth NULL (dversion lock) v=3630 ino=(nil) state=1073741824 0x55cf6215f180] 2023-10-03T19:20:55.112 INFO:teuthology.orchestra.run.smithi045.stdout: -3458> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_305 [2,head] auth (dversion lock) v=3628 ino=0x10000000326 state=1073741824 0x55cf6215ef00] 2023-10-03T19:20:55.112 INFO:teuthology.orchestra.run.smithi045.stdout: -3457> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.112 INFO:teuthology.orchestra.run.smithi045.stdout: -3456> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000326 [2,head] /dc-dir/dc-file_305 auth v3628 s=3 n(v0 rc2023-10-03T19:13:37.967274+0000 b3 1=1+0) (iversion lock) 0x55cf6215c680] 2023-10-03T19:20:55.112 INFO:teuthology.orchestra.run.smithi045.stdout: -3455> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_305 [2,head] auth (dversion lock) v=3628 ino=0x10000000326 state=1073741824 0x55cf6215ef00] [inode 0x10000000326 [2,head] /dc-dir/dc-file_305 auth v3628 s=3 n(v0 rc2023-10-03T19:13:37.967274+0000 b3 1=1+0) (iversion lock) 0x55cf6215c680] 2023-10-03T19:20:55.112 INFO:teuthology.orchestra.run.smithi045.stdout: -3454> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000326 [2,head] #10000000326 auth v3628 s=3 n(v0 rc2023-10-03T19:13:37.967274+0000 b3 1=1+0) (iversion lock) 0x55cf6215c680] 2023-10-03T19:20:55.113 INFO:teuthology.orchestra.run.smithi045.stdout: -3453> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_305 [2,head] auth NULL (dversion lock) v=3628 ino=(nil) state=1073741824 0x55cf6215ef00] 2023-10-03T19:20:55.113 INFO:teuthology.orchestra.run.smithi045.stdout: -3452> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_304 [2,head] auth (dversion lock) v=3626 ino=0x10000000325 state=1073741824 0x55cf6215ec80] 2023-10-03T19:20:55.113 INFO:teuthology.orchestra.run.smithi045.stdout: -3451> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.113 INFO:teuthology.orchestra.run.smithi045.stdout: -3450> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000325 [2,head] /dc-dir/dc-file_304 auth v3626 s=3 n(v0 rc2023-10-03T19:13:37.956531+0000 b3 1=1+0) (iversion lock) 0x55cf6215c100] 2023-10-03T19:20:55.113 INFO:teuthology.orchestra.run.smithi045.stdout: -3449> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_304 [2,head] auth (dversion lock) v=3626 ino=0x10000000325 state=1073741824 0x55cf6215ec80] [inode 0x10000000325 [2,head] /dc-dir/dc-file_304 auth v3626 s=3 n(v0 rc2023-10-03T19:13:37.956531+0000 b3 1=1+0) (iversion lock) 0x55cf6215c100] 2023-10-03T19:20:55.113 INFO:teuthology.orchestra.run.smithi045.stdout: -3448> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000325 [2,head] #10000000325 auth v3626 s=3 n(v0 rc2023-10-03T19:13:37.956531+0000 b3 1=1+0) (iversion lock) 0x55cf6215c100] 2023-10-03T19:20:55.113 INFO:teuthology.orchestra.run.smithi045.stdout: -3447> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_304 [2,head] auth NULL (dversion lock) v=3626 ino=(nil) state=1073741824 0x55cf6215ec80] 2023-10-03T19:20:55.113 INFO:teuthology.orchestra.run.smithi045.stdout: -3446> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_303 [2,head] auth (dversion lock) v=3624 ino=0x10000000324 state=1073741824 0x55cf6215ea00] 2023-10-03T19:20:55.113 INFO:teuthology.orchestra.run.smithi045.stdout: -3445> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.113 INFO:teuthology.orchestra.run.smithi045.stdout: -3444> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000324 [2,head] /dc-dir/dc-file_303 auth v3624 s=3 n(v0 rc2023-10-03T19:13:37.944259+0000 b3 1=1+0) (iversion lock) 0x55cf6215bb80] 2023-10-03T19:20:55.113 INFO:teuthology.orchestra.run.smithi045.stdout: -3443> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_303 [2,head] auth (dversion lock) v=3624 ino=0x10000000324 state=1073741824 0x55cf6215ea00] [inode 0x10000000324 [2,head] /dc-dir/dc-file_303 auth v3624 s=3 n(v0 rc2023-10-03T19:13:37.944259+0000 b3 1=1+0) (iversion lock) 0x55cf6215bb80] 2023-10-03T19:20:55.113 INFO:teuthology.orchestra.run.smithi045.stdout: -3442> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000324 [2,head] #10000000324 auth v3624 s=3 n(v0 rc2023-10-03T19:13:37.944259+0000 b3 1=1+0) (iversion lock) 0x55cf6215bb80] 2023-10-03T19:20:55.114 INFO:teuthology.orchestra.run.smithi045.stdout: -3441> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_303 [2,head] auth NULL (dversion lock) v=3624 ino=(nil) state=1073741824 0x55cf6215ea00] 2023-10-03T19:20:55.114 INFO:teuthology.orchestra.run.smithi045.stdout: -3440> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_302 [2,head] auth (dversion lock) v=3622 ino=0x10000000323 state=1073741824 0x55cf6215e780] 2023-10-03T19:20:55.114 INFO:teuthology.orchestra.run.smithi045.stdout: -3439> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.114 INFO:teuthology.orchestra.run.smithi045.stdout: -3438> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000323 [2,head] /dc-dir/dc-file_302 auth v3622 s=3 n(v0 rc2023-10-03T19:13:37.933135+0000 b3 1=1+0) (iversion lock) 0x55cf6215b600] 2023-10-03T19:20:55.114 INFO:teuthology.orchestra.run.smithi045.stdout: -3437> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_302 [2,head] auth (dversion lock) v=3622 ino=0x10000000323 state=1073741824 0x55cf6215e780] [inode 0x10000000323 [2,head] /dc-dir/dc-file_302 auth v3622 s=3 n(v0 rc2023-10-03T19:13:37.933135+0000 b3 1=1+0) (iversion lock) 0x55cf6215b600] 2023-10-03T19:20:55.114 INFO:teuthology.orchestra.run.smithi045.stdout: -3436> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000323 [2,head] #10000000323 auth v3622 s=3 n(v0 rc2023-10-03T19:13:37.933135+0000 b3 1=1+0) (iversion lock) 0x55cf6215b600] 2023-10-03T19:20:55.114 INFO:teuthology.orchestra.run.smithi045.stdout: -3435> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_302 [2,head] auth NULL (dversion lock) v=3622 ino=(nil) state=1073741824 0x55cf6215e780] 2023-10-03T19:20:55.114 INFO:teuthology.orchestra.run.smithi045.stdout: -3434> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_301 [2,head] auth (dversion lock) v=3620 ino=0x10000000322 state=1073741824 0x55cf6215e500] 2023-10-03T19:20:55.114 INFO:teuthology.orchestra.run.smithi045.stdout: -3433> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.114 INFO:teuthology.orchestra.run.smithi045.stdout: -3432> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000322 [2,head] /dc-dir/dc-file_301 auth v3620 s=3 n(v0 rc2023-10-03T19:13:37.920696+0000 b3 1=1+0) (iversion lock) 0x55cf6215b080] 2023-10-03T19:20:55.114 INFO:teuthology.orchestra.run.smithi045.stdout: -3431> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_301 [2,head] auth (dversion lock) v=3620 ino=0x10000000322 state=1073741824 0x55cf6215e500] [inode 0x10000000322 [2,head] /dc-dir/dc-file_301 auth v3620 s=3 n(v0 rc2023-10-03T19:13:37.920696+0000 b3 1=1+0) (iversion lock) 0x55cf6215b080] 2023-10-03T19:20:55.115 INFO:teuthology.orchestra.run.smithi045.stdout: -3430> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000322 [2,head] #10000000322 auth v3620 s=3 n(v0 rc2023-10-03T19:13:37.920696+0000 b3 1=1+0) (iversion lock) 0x55cf6215b080] 2023-10-03T19:20:55.115 INFO:teuthology.orchestra.run.smithi045.stdout: -3429> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_301 [2,head] auth NULL (dversion lock) v=3620 ino=(nil) state=1073741824 0x55cf6215e500] 2023-10-03T19:20:55.115 INFO:teuthology.orchestra.run.smithi045.stdout: -3428> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_300 [2,head] auth (dversion lock) v=3618 ino=0x10000000321 state=1073741824 0x55cf6215e280] 2023-10-03T19:20:55.115 INFO:teuthology.orchestra.run.smithi045.stdout: -3427> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.115 INFO:teuthology.orchestra.run.smithi045.stdout: -3426> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000321 [2,head] /dc-dir/dc-file_300 auth v3618 s=3 n(v0 rc2023-10-03T19:13:37.908080+0000 b3 1=1+0) (iversion lock) 0x55cf6215ab00] 2023-10-03T19:20:55.115 INFO:teuthology.orchestra.run.smithi045.stdout: -3425> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_300 [2,head] auth (dversion lock) v=3618 ino=0x10000000321 state=1073741824 0x55cf6215e280] [inode 0x10000000321 [2,head] /dc-dir/dc-file_300 auth v3618 s=3 n(v0 rc2023-10-03T19:13:37.908080+0000 b3 1=1+0) (iversion lock) 0x55cf6215ab00] 2023-10-03T19:20:55.115 INFO:teuthology.orchestra.run.smithi045.stdout: -3424> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000321 [2,head] #10000000321 auth v3618 s=3 n(v0 rc2023-10-03T19:13:37.908080+0000 b3 1=1+0) (iversion lock) 0x55cf6215ab00] 2023-10-03T19:20:55.143 INFO:teuthology.orchestra.run.smithi045.stdout: -3423> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_300 [2,head] auth NULL (dversion lock) v=3618 ino=(nil) state=1073741824 0x55cf6215e280] 2023-10-03T19:20:55.143 INFO:teuthology.orchestra.run.smithi045.stdout: -3422> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_299 [2,head] auth (dversion lock) v=3616 ino=0x10000000320 state=1073741824 0x55cf6215e000] 2023-10-03T19:20:55.143 INFO:teuthology.orchestra.run.smithi045.stdout: -3421> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.143 INFO:teuthology.orchestra.run.smithi045.stdout: -3420> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000320 [2,head] /dc-dir/dc-file_299 auth v3616 s=3 n(v0 rc2023-10-03T19:13:37.895875+0000 b3 1=1+0) (iversion lock) 0x55cf6215a580] 2023-10-03T19:20:55.143 INFO:teuthology.orchestra.run.smithi045.stdout: -3419> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_299 [2,head] auth (dversion lock) v=3616 ino=0x10000000320 state=1073741824 0x55cf6215e000] [inode 0x10000000320 [2,head] /dc-dir/dc-file_299 auth v3616 s=3 n(v0 rc2023-10-03T19:13:37.895875+0000 b3 1=1+0) (iversion lock) 0x55cf6215a580] 2023-10-03T19:20:55.143 INFO:teuthology.orchestra.run.smithi045.stdout: -3418> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000320 [2,head] #10000000320 auth v3616 s=3 n(v0 rc2023-10-03T19:13:37.895875+0000 b3 1=1+0) (iversion lock) 0x55cf6215a580] 2023-10-03T19:20:55.143 INFO:teuthology.orchestra.run.smithi045.stdout: -3417> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_299 [2,head] auth NULL (dversion lock) v=3616 ino=(nil) state=1073741824 0x55cf6215e000] 2023-10-03T19:20:55.143 INFO:teuthology.orchestra.run.smithi045.stdout: -3416> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_298 [2,head] auth (dversion lock) v=3614 ino=0x1000000031f state=1073741824 0x55cf62153b80] 2023-10-03T19:20:55.143 INFO:teuthology.orchestra.run.smithi045.stdout: -3415> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.143 INFO:teuthology.orchestra.run.smithi045.stdout: -3414> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000031f [2,head] /dc-dir/dc-file_298 auth v3614 s=3 n(v0 rc2023-10-03T19:13:37.885162+0000 b3 1=1+0) (iversion lock) 0x55cf6215a000] 2023-10-03T19:20:55.143 INFO:teuthology.orchestra.run.smithi045.stdout: -3413> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_298 [2,head] auth (dversion lock) v=3614 ino=0x1000000031f state=1073741824 0x55cf62153b80] [inode 0x1000000031f [2,head] /dc-dir/dc-file_298 auth v3614 s=3 n(v0 rc2023-10-03T19:13:37.885162+0000 b3 1=1+0) (iversion lock) 0x55cf6215a000] 2023-10-03T19:20:55.144 INFO:teuthology.orchestra.run.smithi045.stdout: -3412> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000031f [2,head] #1000000031f auth v3614 s=3 n(v0 rc2023-10-03T19:13:37.885162+0000 b3 1=1+0) (iversion lock) 0x55cf6215a000] 2023-10-03T19:20:55.144 INFO:teuthology.orchestra.run.smithi045.stdout: -3411> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_298 [2,head] auth NULL (dversion lock) v=3614 ino=(nil) state=1073741824 0x55cf62153b80] 2023-10-03T19:20:55.144 INFO:teuthology.orchestra.run.smithi045.stdout: -3410> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_297 [2,head] auth (dversion lock) v=3612 ino=0x1000000031e state=1073741824 0x55cf62153900] 2023-10-03T19:20:55.144 INFO:teuthology.orchestra.run.smithi045.stdout: -3409> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.144 INFO:teuthology.orchestra.run.smithi045.stdout: -3408> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000031e [2,head] /dc-dir/dc-file_297 auth v3612 s=3 n(v0 rc2023-10-03T19:13:37.872805+0000 b3 1=1+0) (iversion lock) 0x55cf62157700] 2023-10-03T19:20:55.144 INFO:teuthology.orchestra.run.smithi045.stdout: -3407> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_297 [2,head] auth (dversion lock) v=3612 ino=0x1000000031e state=1073741824 0x55cf62153900] [inode 0x1000000031e [2,head] /dc-dir/dc-file_297 auth v3612 s=3 n(v0 rc2023-10-03T19:13:37.872805+0000 b3 1=1+0) (iversion lock) 0x55cf62157700] 2023-10-03T19:20:55.144 INFO:teuthology.orchestra.run.smithi045.stdout: -3406> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000031e [2,head] #1000000031e auth v3612 s=3 n(v0 rc2023-10-03T19:13:37.872805+0000 b3 1=1+0) (iversion lock) 0x55cf62157700] 2023-10-03T19:20:55.144 INFO:teuthology.orchestra.run.smithi045.stdout: -3405> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_297 [2,head] auth NULL (dversion lock) v=3612 ino=(nil) state=1073741824 0x55cf62153900] 2023-10-03T19:20:55.144 INFO:teuthology.orchestra.run.smithi045.stdout: -3404> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_296 [2,head] auth (dversion lock) v=3610 ino=0x1000000031d state=1073741824 0x55cf62153680] 2023-10-03T19:20:55.144 INFO:teuthology.orchestra.run.smithi045.stdout: -3403> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.144 INFO:teuthology.orchestra.run.smithi045.stdout: -3402> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000031d [2,head] /dc-dir/dc-file_296 auth v3610 s=3 n(v0 rc2023-10-03T19:13:37.861619+0000 b3 1=1+0) (iversion lock) 0x55cf62157180] 2023-10-03T19:20:55.144 INFO:teuthology.orchestra.run.smithi045.stdout: -3401> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_296 [2,head] auth (dversion lock) v=3610 ino=0x1000000031d state=1073741824 0x55cf62153680] [inode 0x1000000031d [2,head] /dc-dir/dc-file_296 auth v3610 s=3 n(v0 rc2023-10-03T19:13:37.861619+0000 b3 1=1+0) (iversion lock) 0x55cf62157180] 2023-10-03T19:20:55.145 INFO:teuthology.orchestra.run.smithi045.stdout: -3400> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000031d [2,head] #1000000031d auth v3610 s=3 n(v0 rc2023-10-03T19:13:37.861619+0000 b3 1=1+0) (iversion lock) 0x55cf62157180] 2023-10-03T19:20:55.145 INFO:teuthology.orchestra.run.smithi045.stdout: -3399> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_296 [2,head] auth NULL (dversion lock) v=3610 ino=(nil) state=1073741824 0x55cf62153680] 2023-10-03T19:20:55.145 INFO:teuthology.orchestra.run.smithi045.stdout: -3398> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_295 [2,head] auth (dversion lock) v=3608 ino=0x1000000031c state=1073741824 0x55cf62153400] 2023-10-03T19:20:55.145 INFO:teuthology.orchestra.run.smithi045.stdout: -3397> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.145 INFO:teuthology.orchestra.run.smithi045.stdout: -3396> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000031c [2,head] /dc-dir/dc-file_295 auth v3608 s=3 n(v0 rc2023-10-03T19:13:37.849919+0000 b3 1=1+0) (iversion lock) 0x55cf62156c00] 2023-10-03T19:20:55.145 INFO:teuthology.orchestra.run.smithi045.stdout: -3395> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_295 [2,head] auth (dversion lock) v=3608 ino=0x1000000031c state=1073741824 0x55cf62153400] [inode 0x1000000031c [2,head] /dc-dir/dc-file_295 auth v3608 s=3 n(v0 rc2023-10-03T19:13:37.849919+0000 b3 1=1+0) (iversion lock) 0x55cf62156c00] 2023-10-03T19:20:55.145 INFO:teuthology.orchestra.run.smithi045.stdout: -3394> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000031c [2,head] #1000000031c auth v3608 s=3 n(v0 rc2023-10-03T19:13:37.849919+0000 b3 1=1+0) (iversion lock) 0x55cf62156c00] 2023-10-03T19:20:55.145 INFO:teuthology.orchestra.run.smithi045.stdout: -3393> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_295 [2,head] auth NULL (dversion lock) v=3608 ino=(nil) state=1073741824 0x55cf62153400] 2023-10-03T19:20:55.145 INFO:teuthology.orchestra.run.smithi045.stdout: -3392> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_294 [2,head] auth (dversion lock) v=3606 ino=0x1000000031b state=1073741824 0x55cf62153180] 2023-10-03T19:20:55.146 INFO:teuthology.orchestra.run.smithi045.stdout: -3391> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.146 INFO:teuthology.orchestra.run.smithi045.stdout: -3390> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000031b [2,head] /dc-dir/dc-file_294 auth v3606 s=3 n(v0 rc2023-10-03T19:13:37.839082+0000 b3 1=1+0) (iversion lock) 0x55cf62156680] 2023-10-03T19:20:55.146 INFO:teuthology.orchestra.run.smithi045.stdout: -3389> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_294 [2,head] auth (dversion lock) v=3606 ino=0x1000000031b state=1073741824 0x55cf62153180] [inode 0x1000000031b [2,head] /dc-dir/dc-file_294 auth v3606 s=3 n(v0 rc2023-10-03T19:13:37.839082+0000 b3 1=1+0) (iversion lock) 0x55cf62156680] 2023-10-03T19:20:55.146 INFO:teuthology.orchestra.run.smithi045.stdout: -3388> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000031b [2,head] #1000000031b auth v3606 s=3 n(v0 rc2023-10-03T19:13:37.839082+0000 b3 1=1+0) (iversion lock) 0x55cf62156680] 2023-10-03T19:20:55.146 INFO:teuthology.orchestra.run.smithi045.stdout: -3387> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_294 [2,head] auth NULL (dversion lock) v=3606 ino=(nil) state=1073741824 0x55cf62153180] 2023-10-03T19:20:55.146 INFO:teuthology.orchestra.run.smithi045.stdout: -3386> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_293 [2,head] auth (dversion lock) v=3604 ino=0x1000000031a state=1073741824 0x55cf62152f00] 2023-10-03T19:20:55.146 INFO:teuthology.orchestra.run.smithi045.stdout: -3385> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.146 INFO:teuthology.orchestra.run.smithi045.stdout: -3384> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000031a [2,head] /dc-dir/dc-file_293 auth v3604 s=3 n(v0 rc2023-10-03T19:13:37.827270+0000 b3 1=1+0) (iversion lock) 0x55cf62156100] 2023-10-03T19:20:55.146 INFO:teuthology.orchestra.run.smithi045.stdout: -3383> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_293 [2,head] auth (dversion lock) v=3604 ino=0x1000000031a state=1073741824 0x55cf62152f00] [inode 0x1000000031a [2,head] /dc-dir/dc-file_293 auth v3604 s=3 n(v0 rc2023-10-03T19:13:37.827270+0000 b3 1=1+0) (iversion lock) 0x55cf62156100] 2023-10-03T19:20:55.146 INFO:teuthology.orchestra.run.smithi045.stdout: -3382> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000031a [2,head] #1000000031a auth v3604 s=3 n(v0 rc2023-10-03T19:13:37.827270+0000 b3 1=1+0) (iversion lock) 0x55cf62156100] 2023-10-03T19:20:55.146 INFO:teuthology.orchestra.run.smithi045.stdout: -3381> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_293 [2,head] auth NULL (dversion lock) v=3604 ino=(nil) state=1073741824 0x55cf62152f00] 2023-10-03T19:20:55.147 INFO:teuthology.orchestra.run.smithi045.stdout: -3380> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_292 [2,head] auth (dversion lock) v=3602 ino=0x10000000319 state=1073741824 0x55cf62152c80] 2023-10-03T19:20:55.147 INFO:teuthology.orchestra.run.smithi045.stdout: -3379> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.147 INFO:teuthology.orchestra.run.smithi045.stdout: -3378> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000319 [2,head] /dc-dir/dc-file_292 auth v3602 s=3 n(v0 rc2023-10-03T19:13:37.816495+0000 b3 1=1+0) (iversion lock) 0x55cf62155b80] 2023-10-03T19:20:55.147 INFO:teuthology.orchestra.run.smithi045.stdout: -3377> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_292 [2,head] auth (dversion lock) v=3602 ino=0x10000000319 state=1073741824 0x55cf62152c80] [inode 0x10000000319 [2,head] /dc-dir/dc-file_292 auth v3602 s=3 n(v0 rc2023-10-03T19:13:37.816495+0000 b3 1=1+0) (iversion lock) 0x55cf62155b80] 2023-10-03T19:20:55.147 INFO:teuthology.orchestra.run.smithi045.stdout: -3376> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000319 [2,head] #10000000319 auth v3602 s=3 n(v0 rc2023-10-03T19:13:37.816495+0000 b3 1=1+0) (iversion lock) 0x55cf62155b80] 2023-10-03T19:20:55.147 INFO:teuthology.orchestra.run.smithi045.stdout: -3375> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_292 [2,head] auth NULL (dversion lock) v=3602 ino=(nil) state=1073741824 0x55cf62152c80] 2023-10-03T19:20:55.147 INFO:teuthology.orchestra.run.smithi045.stdout: -3374> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_291 [2,head] auth (dversion lock) v=3600 ino=0x10000000318 state=1073741824 0x55cf62152a00] 2023-10-03T19:20:55.147 INFO:teuthology.orchestra.run.smithi045.stdout: -3373> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.147 INFO:teuthology.orchestra.run.smithi045.stdout: -3372> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000318 [2,head] /dc-dir/dc-file_291 auth v3600 s=3 n(v0 rc2023-10-03T19:13:37.805671+0000 b3 1=1+0) (iversion lock) 0x55cf62155600] 2023-10-03T19:20:55.147 INFO:teuthology.orchestra.run.smithi045.stdout: -3371> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_291 [2,head] auth (dversion lock) v=3600 ino=0x10000000318 state=1073741824 0x55cf62152a00] [inode 0x10000000318 [2,head] /dc-dir/dc-file_291 auth v3600 s=3 n(v0 rc2023-10-03T19:13:37.805671+0000 b3 1=1+0) (iversion lock) 0x55cf62155600] 2023-10-03T19:20:55.147 INFO:teuthology.orchestra.run.smithi045.stdout: -3370> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000318 [2,head] #10000000318 auth v3600 s=3 n(v0 rc2023-10-03T19:13:37.805671+0000 b3 1=1+0) (iversion lock) 0x55cf62155600] 2023-10-03T19:20:55.147 INFO:teuthology.orchestra.run.smithi045.stdout: -3369> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_291 [2,head] auth NULL (dversion lock) v=3600 ino=(nil) state=1073741824 0x55cf62152a00] 2023-10-03T19:20:55.148 INFO:teuthology.orchestra.run.smithi045.stdout: -3368> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_290 [2,head] auth (dversion lock) v=3598 ino=0x10000000317 state=1073741824 0x55cf62152780] 2023-10-03T19:20:55.148 INFO:teuthology.orchestra.run.smithi045.stdout: -3367> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.148 INFO:teuthology.orchestra.run.smithi045.stdout: -3366> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000317 [2,head] /dc-dir/dc-file_290 auth v3598 s=3 n(v0 rc2023-10-03T19:13:37.795094+0000 b3 1=1+0) (iversion lock) 0x55cf62155080] 2023-10-03T19:20:55.148 INFO:teuthology.orchestra.run.smithi045.stdout: -3365> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_290 [2,head] auth (dversion lock) v=3598 ino=0x10000000317 state=1073741824 0x55cf62152780] [inode 0x10000000317 [2,head] /dc-dir/dc-file_290 auth v3598 s=3 n(v0 rc2023-10-03T19:13:37.795094+0000 b3 1=1+0) (iversion lock) 0x55cf62155080] 2023-10-03T19:20:55.148 INFO:teuthology.orchestra.run.smithi045.stdout: -3364> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000317 [2,head] #10000000317 auth v3598 s=3 n(v0 rc2023-10-03T19:13:37.795094+0000 b3 1=1+0) (iversion lock) 0x55cf62155080] 2023-10-03T19:20:55.148 INFO:teuthology.orchestra.run.smithi045.stdout: -3363> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_290 [2,head] auth NULL (dversion lock) v=3598 ino=(nil) state=1073741824 0x55cf62152780] 2023-10-03T19:20:55.148 INFO:teuthology.orchestra.run.smithi045.stdout: -3362> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_289 [2,head] auth (dversion lock) v=3596 ino=0x10000000316 state=1073741824 0x55cf62152500] 2023-10-03T19:20:55.148 INFO:teuthology.orchestra.run.smithi045.stdout: -3361> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.148 INFO:teuthology.orchestra.run.smithi045.stdout: -3360> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000316 [2,head] /dc-dir/dc-file_289 auth v3596 s=3 n(v0 rc2023-10-03T19:13:37.784863+0000 b3 1=1+0) (iversion lock) 0x55cf62154b00] 2023-10-03T19:20:55.148 INFO:teuthology.orchestra.run.smithi045.stdout: -3359> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_289 [2,head] auth (dversion lock) v=3596 ino=0x10000000316 state=1073741824 0x55cf62152500] [inode 0x10000000316 [2,head] /dc-dir/dc-file_289 auth v3596 s=3 n(v0 rc2023-10-03T19:13:37.784863+0000 b3 1=1+0) (iversion lock) 0x55cf62154b00] 2023-10-03T19:20:55.148 INFO:teuthology.orchestra.run.smithi045.stdout: -3358> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000316 [2,head] #10000000316 auth v3596 s=3 n(v0 rc2023-10-03T19:13:37.784863+0000 b3 1=1+0) (iversion lock) 0x55cf62154b00] 2023-10-03T19:20:55.149 INFO:teuthology.orchestra.run.smithi045.stdout: -3357> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_289 [2,head] auth NULL (dversion lock) v=3596 ino=(nil) state=1073741824 0x55cf62152500] 2023-10-03T19:20:55.149 INFO:teuthology.orchestra.run.smithi045.stdout: -3356> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_288 [2,head] auth (dversion lock) v=3594 ino=0x10000000315 state=1073741824 0x55cf62152280] 2023-10-03T19:20:55.149 INFO:teuthology.orchestra.run.smithi045.stdout: -3355> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.149 INFO:teuthology.orchestra.run.smithi045.stdout: -3354> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000315 [2,head] /dc-dir/dc-file_288 auth v3594 s=3 n(v0 rc2023-10-03T19:13:37.773552+0000 b3 1=1+0) (iversion lock) 0x55cf62154580] 2023-10-03T19:20:55.149 INFO:teuthology.orchestra.run.smithi045.stdout: -3353> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_288 [2,head] auth (dversion lock) v=3594 ino=0x10000000315 state=1073741824 0x55cf62152280] [inode 0x10000000315 [2,head] /dc-dir/dc-file_288 auth v3594 s=3 n(v0 rc2023-10-03T19:13:37.773552+0000 b3 1=1+0) (iversion lock) 0x55cf62154580] 2023-10-03T19:20:55.149 INFO:teuthology.orchestra.run.smithi045.stdout: -3352> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000315 [2,head] #10000000315 auth v3594 s=3 n(v0 rc2023-10-03T19:13:37.773552+0000 b3 1=1+0) (iversion lock) 0x55cf62154580] 2023-10-03T19:20:55.251 INFO:teuthology.orchestra.run.smithi045.stdout: -3351> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_288 [2,head] auth NULL (dversion lock) v=3594 ino=(nil) state=1073741824 0x55cf62152280] 2023-10-03T19:20:55.251 INFO:teuthology.orchestra.run.smithi045.stdout: -3350> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_287 [2,head] auth (dversion lock) v=3592 ino=0x10000000314 state=1073741824 0x55cf62152000] 2023-10-03T19:20:55.251 INFO:teuthology.orchestra.run.smithi045.stdout: -3349> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.251 INFO:teuthology.orchestra.run.smithi045.stdout: -3348> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000314 [2,head] /dc-dir/dc-file_287 auth v3592 s=3 n(v0 rc2023-10-03T19:13:37.762539+0000 b3 1=1+0) (iversion lock) 0x55cf62154000] 2023-10-03T19:20:55.252 INFO:teuthology.orchestra.run.smithi045.stdout: -3347> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_287 [2,head] auth (dversion lock) v=3592 ino=0x10000000314 state=1073741824 0x55cf62152000] [inode 0x10000000314 [2,head] /dc-dir/dc-file_287 auth v3592 s=3 n(v0 rc2023-10-03T19:13:37.762539+0000 b3 1=1+0) (iversion lock) 0x55cf62154000] 2023-10-03T19:20:55.252 INFO:teuthology.orchestra.run.smithi045.stdout: -3346> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000314 [2,head] #10000000314 auth v3592 s=3 n(v0 rc2023-10-03T19:13:37.762539+0000 b3 1=1+0) (iversion lock) 0x55cf62154000] 2023-10-03T19:20:55.252 INFO:teuthology.orchestra.run.smithi045.stdout: -3345> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_287 [2,head] auth NULL (dversion lock) v=3592 ino=(nil) state=1073741824 0x55cf62152000] 2023-10-03T19:20:55.252 INFO:teuthology.orchestra.run.smithi045.stdout: -3344> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_286 [2,head] auth (dversion lock) v=3590 ino=0x10000000313 state=1073741824 0x55cf62143b80] 2023-10-03T19:20:55.252 INFO:teuthology.orchestra.run.smithi045.stdout: -3343> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.252 INFO:teuthology.orchestra.run.smithi045.stdout: -3342> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000313 [2,head] /dc-dir/dc-file_286 auth v3590 s=3 n(v0 rc2023-10-03T19:13:37.751004+0000 b3 1=1+0) (iversion lock) 0x55cf62147700] 2023-10-03T19:20:55.252 INFO:teuthology.orchestra.run.smithi045.stdout: -3341> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_286 [2,head] auth (dversion lock) v=3590 ino=0x10000000313 state=1073741824 0x55cf62143b80] [inode 0x10000000313 [2,head] /dc-dir/dc-file_286 auth v3590 s=3 n(v0 rc2023-10-03T19:13:37.751004+0000 b3 1=1+0) (iversion lock) 0x55cf62147700] 2023-10-03T19:20:55.252 INFO:teuthology.orchestra.run.smithi045.stdout: -3340> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000313 [2,head] #10000000313 auth v3590 s=3 n(v0 rc2023-10-03T19:13:37.751004+0000 b3 1=1+0) (iversion lock) 0x55cf62147700] 2023-10-03T19:20:55.252 INFO:teuthology.orchestra.run.smithi045.stdout: -3339> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_286 [2,head] auth NULL (dversion lock) v=3590 ino=(nil) state=1073741824 0x55cf62143b80] 2023-10-03T19:20:55.252 INFO:teuthology.orchestra.run.smithi045.stdout: -3338> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_285 [2,head] auth (dversion lock) v=3588 ino=0x10000000312 state=1073741824 0x55cf62143900] 2023-10-03T19:20:55.252 INFO:teuthology.orchestra.run.smithi045.stdout: -3337> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3336> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000312 [2,head] /dc-dir/dc-file_285 auth v3588 s=3 n(v0 rc2023-10-03T19:13:37.739748+0000 b3 1=1+0) (iversion lock) 0x55cf62147180] 2023-10-03T19:20:55.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3335> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_285 [2,head] auth (dversion lock) v=3588 ino=0x10000000312 state=1073741824 0x55cf62143900] [inode 0x10000000312 [2,head] /dc-dir/dc-file_285 auth v3588 s=3 n(v0 rc2023-10-03T19:13:37.739748+0000 b3 1=1+0) (iversion lock) 0x55cf62147180] 2023-10-03T19:20:55.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3334> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000312 [2,head] #10000000312 auth v3588 s=3 n(v0 rc2023-10-03T19:13:37.739748+0000 b3 1=1+0) (iversion lock) 0x55cf62147180] 2023-10-03T19:20:55.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3333> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_285 [2,head] auth NULL (dversion lock) v=3588 ino=(nil) state=1073741824 0x55cf62143900] 2023-10-03T19:20:55.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3332> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_284 [2,head] auth (dversion lock) v=3586 ino=0x10000000311 state=1073741824 0x55cf62143680] 2023-10-03T19:20:55.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3331> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3330> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000311 [2,head] /dc-dir/dc-file_284 auth v3586 s=3 n(v0 rc2023-10-03T19:13:37.729059+0000 b3 1=1+0) (iversion lock) 0x55cf62146c00] 2023-10-03T19:20:55.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3329> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_284 [2,head] auth (dversion lock) v=3586 ino=0x10000000311 state=1073741824 0x55cf62143680] [inode 0x10000000311 [2,head] /dc-dir/dc-file_284 auth v3586 s=3 n(v0 rc2023-10-03T19:13:37.729059+0000 b3 1=1+0) (iversion lock) 0x55cf62146c00] 2023-10-03T19:20:55.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3328> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000311 [2,head] #10000000311 auth v3586 s=3 n(v0 rc2023-10-03T19:13:37.729059+0000 b3 1=1+0) (iversion lock) 0x55cf62146c00] 2023-10-03T19:20:55.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3327> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_284 [2,head] auth NULL (dversion lock) v=3586 ino=(nil) state=1073741824 0x55cf62143680] 2023-10-03T19:20:55.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3326> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_283 [2,head] auth (dversion lock) v=3584 ino=0x10000000310 state=1073741824 0x55cf62143400] 2023-10-03T19:20:55.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3325> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3324> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000310 [2,head] /dc-dir/dc-file_283 auth v3584 s=3 n(v0 rc2023-10-03T19:13:37.717973+0000 b3 1=1+0) (iversion lock) 0x55cf62146680] 2023-10-03T19:20:55.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3323> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_283 [2,head] auth (dversion lock) v=3584 ino=0x10000000310 state=1073741824 0x55cf62143400] [inode 0x10000000310 [2,head] /dc-dir/dc-file_283 auth v3584 s=3 n(v0 rc2023-10-03T19:13:37.717973+0000 b3 1=1+0) (iversion lock) 0x55cf62146680] 2023-10-03T19:20:55.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3322> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000310 [2,head] #10000000310 auth v3584 s=3 n(v0 rc2023-10-03T19:13:37.717973+0000 b3 1=1+0) (iversion lock) 0x55cf62146680] 2023-10-03T19:20:55.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3321> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_283 [2,head] auth NULL (dversion lock) v=3584 ino=(nil) state=1073741824 0x55cf62143400] 2023-10-03T19:20:55.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3320> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_282 [2,head] auth (dversion lock) v=3582 ino=0x1000000030f state=1073741824 0x55cf62143180] 2023-10-03T19:20:55.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3319> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3318> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000030f [2,head] /dc-dir/dc-file_282 auth v3582 s=3 n(v0 rc2023-10-03T19:13:37.707536+0000 b3 1=1+0) (iversion lock) 0x55cf62146100] 2023-10-03T19:20:55.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3317> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_282 [2,head] auth (dversion lock) v=3582 ino=0x1000000030f state=1073741824 0x55cf62143180] [inode 0x1000000030f [2,head] /dc-dir/dc-file_282 auth v3582 s=3 n(v0 rc2023-10-03T19:13:37.707536+0000 b3 1=1+0) (iversion lock) 0x55cf62146100] 2023-10-03T19:20:55.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3316> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000030f [2,head] #1000000030f auth v3582 s=3 n(v0 rc2023-10-03T19:13:37.707536+0000 b3 1=1+0) (iversion lock) 0x55cf62146100] 2023-10-03T19:20:55.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3315> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_282 [2,head] auth NULL (dversion lock) v=3582 ino=(nil) state=1073741824 0x55cf62143180] 2023-10-03T19:20:55.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3314> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_281 [2,head] auth (dversion lock) v=3580 ino=0x1000000030e state=1073741824 0x55cf62142f00] 2023-10-03T19:20:55.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3313> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3312> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000030e [2,head] /dc-dir/dc-file_281 auth v3580 s=3 n(v0 rc2023-10-03T19:13:37.696091+0000 b3 1=1+0) (iversion lock) 0x55cf62145b80] 2023-10-03T19:20:55.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3311> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_281 [2,head] auth (dversion lock) v=3580 ino=0x1000000030e state=1073741824 0x55cf62142f00] [inode 0x1000000030e [2,head] /dc-dir/dc-file_281 auth v3580 s=3 n(v0 rc2023-10-03T19:13:37.696091+0000 b3 1=1+0) (iversion lock) 0x55cf62145b80] 2023-10-03T19:20:55.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3310> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000030e [2,head] #1000000030e auth v3580 s=3 n(v0 rc2023-10-03T19:13:37.696091+0000 b3 1=1+0) (iversion lock) 0x55cf62145b80] 2023-10-03T19:20:55.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3309> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_281 [2,head] auth NULL (dversion lock) v=3580 ino=(nil) state=1073741824 0x55cf62142f00] 2023-10-03T19:20:55.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3308> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_280 [2,head] auth (dversion lock) v=3578 ino=0x1000000030d state=1073741824 0x55cf62142c80] 2023-10-03T19:20:55.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3307> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3306> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000030d [2,head] /dc-dir/dc-file_280 auth v3578 s=3 n(v0 rc2023-10-03T19:13:37.684768+0000 b3 1=1+0) (iversion lock) 0x55cf62145600] 2023-10-03T19:20:55.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3305> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_280 [2,head] auth (dversion lock) v=3578 ino=0x1000000030d state=1073741824 0x55cf62142c80] [inode 0x1000000030d [2,head] /dc-dir/dc-file_280 auth v3578 s=3 n(v0 rc2023-10-03T19:13:37.684768+0000 b3 1=1+0) (iversion lock) 0x55cf62145600] 2023-10-03T19:20:55.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3304> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000030d [2,head] #1000000030d auth v3578 s=3 n(v0 rc2023-10-03T19:13:37.684768+0000 b3 1=1+0) (iversion lock) 0x55cf62145600] 2023-10-03T19:20:55.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3303> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_280 [2,head] auth NULL (dversion lock) v=3578 ino=(nil) state=1073741824 0x55cf62142c80] 2023-10-03T19:20:55.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3302> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_279 [2,head] auth (dversion lock) v=3576 ino=0x1000000030c state=1073741824 0x55cf62142a00] 2023-10-03T19:20:55.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3301> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3300> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000030c [2,head] /dc-dir/dc-file_279 auth v3576 s=3 n(v0 rc2023-10-03T19:13:37.672762+0000 b3 1=1+0) (iversion lock) 0x55cf62145080] 2023-10-03T19:20:55.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3299> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_279 [2,head] auth (dversion lock) v=3576 ino=0x1000000030c state=1073741824 0x55cf62142a00] [inode 0x1000000030c [2,head] /dc-dir/dc-file_279 auth v3576 s=3 n(v0 rc2023-10-03T19:13:37.672762+0000 b3 1=1+0) (iversion lock) 0x55cf62145080] 2023-10-03T19:20:55.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3298> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000030c [2,head] #1000000030c auth v3576 s=3 n(v0 rc2023-10-03T19:13:37.672762+0000 b3 1=1+0) (iversion lock) 0x55cf62145080] 2023-10-03T19:20:55.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3297> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_279 [2,head] auth NULL (dversion lock) v=3576 ino=(nil) state=1073741824 0x55cf62142a00] 2023-10-03T19:20:55.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3296> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_278 [2,head] auth (dversion lock) v=3574 ino=0x1000000030b state=1073741824 0x55cf62142780] 2023-10-03T19:20:55.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3295> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3294> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000030b [2,head] /dc-dir/dc-file_278 auth v3574 s=3 n(v0 rc2023-10-03T19:13:37.661921+0000 b3 1=1+0) (iversion lock) 0x55cf62144b00] 2023-10-03T19:20:55.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3293> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_278 [2,head] auth (dversion lock) v=3574 ino=0x1000000030b state=1073741824 0x55cf62142780] [inode 0x1000000030b [2,head] /dc-dir/dc-file_278 auth v3574 s=3 n(v0 rc2023-10-03T19:13:37.661921+0000 b3 1=1+0) (iversion lock) 0x55cf62144b00] 2023-10-03T19:20:55.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3292> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000030b [2,head] #1000000030b auth v3574 s=3 n(v0 rc2023-10-03T19:13:37.661921+0000 b3 1=1+0) (iversion lock) 0x55cf62144b00] 2023-10-03T19:20:55.257 INFO:teuthology.orchestra.run.smithi045.stdout: -3291> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_278 [2,head] auth NULL (dversion lock) v=3574 ino=(nil) state=1073741824 0x55cf62142780] 2023-10-03T19:20:55.257 INFO:teuthology.orchestra.run.smithi045.stdout: -3290> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_277 [2,head] auth (dversion lock) v=3572 ino=0x1000000030a state=1073741824 0x55cf62142500] 2023-10-03T19:20:55.257 INFO:teuthology.orchestra.run.smithi045.stdout: -3289> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.257 INFO:teuthology.orchestra.run.smithi045.stdout: -3288> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000030a [2,head] /dc-dir/dc-file_277 auth v3572 s=3 n(v0 rc2023-10-03T19:13:37.651409+0000 b3 1=1+0) (iversion lock) 0x55cf62144580] 2023-10-03T19:20:55.257 INFO:teuthology.orchestra.run.smithi045.stdout: -3287> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_277 [2,head] auth (dversion lock) v=3572 ino=0x1000000030a state=1073741824 0x55cf62142500] [inode 0x1000000030a [2,head] /dc-dir/dc-file_277 auth v3572 s=3 n(v0 rc2023-10-03T19:13:37.651409+0000 b3 1=1+0) (iversion lock) 0x55cf62144580] 2023-10-03T19:20:55.257 INFO:teuthology.orchestra.run.smithi045.stdout: -3286> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000030a [2,head] #1000000030a auth v3572 s=3 n(v0 rc2023-10-03T19:13:37.651409+0000 b3 1=1+0) (iversion lock) 0x55cf62144580] 2023-10-03T19:20:55.257 INFO:teuthology.orchestra.run.smithi045.stdout: -3285> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_277 [2,head] auth NULL (dversion lock) v=3572 ino=(nil) state=1073741824 0x55cf62142500] 2023-10-03T19:20:55.257 INFO:teuthology.orchestra.run.smithi045.stdout: -3284> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_276 [2,head] auth (dversion lock) v=3570 ino=0x10000000309 state=1073741824 0x55cf62142280] 2023-10-03T19:20:55.258 INFO:teuthology.orchestra.run.smithi045.stdout: -3283> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.258 INFO:teuthology.orchestra.run.smithi045.stdout: -3282> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000309 [2,head] /dc-dir/dc-file_276 auth v3570 s=3 n(v0 rc2023-10-03T19:13:37.640456+0000 b3 1=1+0) (iversion lock) 0x55cf62144000] 2023-10-03T19:20:55.258 INFO:teuthology.orchestra.run.smithi045.stdout: -3281> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_276 [2,head] auth (dversion lock) v=3570 ino=0x10000000309 state=1073741824 0x55cf62142280] [inode 0x10000000309 [2,head] /dc-dir/dc-file_276 auth v3570 s=3 n(v0 rc2023-10-03T19:13:37.640456+0000 b3 1=1+0) (iversion lock) 0x55cf62144000] 2023-10-03T19:20:55.258 INFO:teuthology.orchestra.run.smithi045.stdout: -3280> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000309 [2,head] #10000000309 auth v3570 s=3 n(v0 rc2023-10-03T19:13:37.640456+0000 b3 1=1+0) (iversion lock) 0x55cf62144000] 2023-10-03T19:20:55.258 INFO:teuthology.orchestra.run.smithi045.stdout: -3279> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_276 [2,head] auth NULL (dversion lock) v=3570 ino=(nil) state=1073741824 0x55cf62142280] 2023-10-03T19:20:55.258 INFO:teuthology.orchestra.run.smithi045.stdout: -3278> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_275 [2,head] auth (dversion lock) v=3568 ino=0x10000000308 state=1073741824 0x55cf62142000] 2023-10-03T19:20:55.258 INFO:teuthology.orchestra.run.smithi045.stdout: -3277> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.258 INFO:teuthology.orchestra.run.smithi045.stdout: -3276> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000308 [2,head] /dc-dir/dc-file_275 auth v3568 s=3 n(v0 rc2023-10-03T19:13:37.629562+0000 b3 1=1+0) (iversion lock) 0x55cf62139700] 2023-10-03T19:20:55.258 INFO:teuthology.orchestra.run.smithi045.stdout: -3275> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_275 [2,head] auth (dversion lock) v=3568 ino=0x10000000308 state=1073741824 0x55cf62142000] [inode 0x10000000308 [2,head] /dc-dir/dc-file_275 auth v3568 s=3 n(v0 rc2023-10-03T19:13:37.629562+0000 b3 1=1+0) (iversion lock) 0x55cf62139700] 2023-10-03T19:20:55.258 INFO:teuthology.orchestra.run.smithi045.stdout: -3274> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000308 [2,head] #10000000308 auth v3568 s=3 n(v0 rc2023-10-03T19:13:37.629562+0000 b3 1=1+0) (iversion lock) 0x55cf62139700] 2023-10-03T19:20:55.259 INFO:teuthology.orchestra.run.smithi045.stdout: -3273> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_275 [2,head] auth NULL (dversion lock) v=3568 ino=(nil) state=1073741824 0x55cf62142000] 2023-10-03T19:20:55.259 INFO:teuthology.orchestra.run.smithi045.stdout: -3272> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_274 [2,head] auth (dversion lock) v=3566 ino=0x10000000307 state=1073741824 0x55cf62133b80] 2023-10-03T19:20:55.259 INFO:teuthology.orchestra.run.smithi045.stdout: -3271> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.259 INFO:teuthology.orchestra.run.smithi045.stdout: -3270> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000307 [2,head] /dc-dir/dc-file_274 auth v3566 s=3 n(v0 rc2023-10-03T19:13:37.618818+0000 b3 1=1+0) (iversion lock) 0x55cf62139180] 2023-10-03T19:20:55.259 INFO:teuthology.orchestra.run.smithi045.stdout: -3269> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_274 [2,head] auth (dversion lock) v=3566 ino=0x10000000307 state=1073741824 0x55cf62133b80] [inode 0x10000000307 [2,head] /dc-dir/dc-file_274 auth v3566 s=3 n(v0 rc2023-10-03T19:13:37.618818+0000 b3 1=1+0) (iversion lock) 0x55cf62139180] 2023-10-03T19:20:55.259 INFO:teuthology.orchestra.run.smithi045.stdout: -3268> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000307 [2,head] #10000000307 auth v3566 s=3 n(v0 rc2023-10-03T19:13:37.618818+0000 b3 1=1+0) (iversion lock) 0x55cf62139180] 2023-10-03T19:20:55.259 INFO:teuthology.orchestra.run.smithi045.stdout: -3267> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_274 [2,head] auth NULL (dversion lock) v=3566 ino=(nil) state=1073741824 0x55cf62133b80] 2023-10-03T19:20:55.259 INFO:teuthology.orchestra.run.smithi045.stdout: -3266> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_273 [2,head] auth (dversion lock) v=3564 ino=0x10000000306 state=1073741824 0x55cf62133900] 2023-10-03T19:20:55.259 INFO:teuthology.orchestra.run.smithi045.stdout: -3265> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.259 INFO:teuthology.orchestra.run.smithi045.stdout: -3264> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000306 [2,head] /dc-dir/dc-file_273 auth v3564 s=3 n(v0 rc2023-10-03T19:13:37.607656+0000 b3 1=1+0) (iversion lock) 0x55cf62138c00] 2023-10-03T19:20:55.260 INFO:teuthology.orchestra.run.smithi045.stdout: -3263> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_273 [2,head] auth (dversion lock) v=3564 ino=0x10000000306 state=1073741824 0x55cf62133900] [inode 0x10000000306 [2,head] /dc-dir/dc-file_273 auth v3564 s=3 n(v0 rc2023-10-03T19:13:37.607656+0000 b3 1=1+0) (iversion lock) 0x55cf62138c00] 2023-10-03T19:20:55.260 INFO:teuthology.orchestra.run.smithi045.stdout: -3262> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000306 [2,head] #10000000306 auth v3564 s=3 n(v0 rc2023-10-03T19:13:37.607656+0000 b3 1=1+0) (iversion lock) 0x55cf62138c00] 2023-10-03T19:20:55.260 INFO:teuthology.orchestra.run.smithi045.stdout: -3261> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_273 [2,head] auth NULL (dversion lock) v=3564 ino=(nil) state=1073741824 0x55cf62133900] 2023-10-03T19:20:55.260 INFO:teuthology.orchestra.run.smithi045.stdout: -3260> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_272 [2,head] auth (dversion lock) v=3562 ino=0x10000000305 state=1073741824 0x55cf62133680] 2023-10-03T19:20:55.260 INFO:teuthology.orchestra.run.smithi045.stdout: -3259> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.260 INFO:teuthology.orchestra.run.smithi045.stdout: -3258> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000305 [2,head] /dc-dir/dc-file_272 auth v3562 s=3 n(v0 rc2023-10-03T19:13:37.595691+0000 b3 1=1+0) (iversion lock) 0x55cf62138680] 2023-10-03T19:20:55.260 INFO:teuthology.orchestra.run.smithi045.stdout: -3257> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_272 [2,head] auth (dversion lock) v=3562 ino=0x10000000305 state=1073741824 0x55cf62133680] [inode 0x10000000305 [2,head] /dc-dir/dc-file_272 auth v3562 s=3 n(v0 rc2023-10-03T19:13:37.595691+0000 b3 1=1+0) (iversion lock) 0x55cf62138680] 2023-10-03T19:20:55.260 INFO:teuthology.orchestra.run.smithi045.stdout: -3256> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000305 [2,head] #10000000305 auth v3562 s=3 n(v0 rc2023-10-03T19:13:37.595691+0000 b3 1=1+0) (iversion lock) 0x55cf62138680] 2023-10-03T19:20:55.260 INFO:teuthology.orchestra.run.smithi045.stdout: -3255> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_272 [2,head] auth NULL (dversion lock) v=3562 ino=(nil) state=1073741824 0x55cf62133680] 2023-10-03T19:20:55.260 INFO:teuthology.orchestra.run.smithi045.stdout: -3254> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_271 [2,head] auth (dversion lock) v=3560 ino=0x10000000304 state=1073741824 0x55cf62133400] 2023-10-03T19:20:55.260 INFO:teuthology.orchestra.run.smithi045.stdout: -3253> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3252> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000304 [2,head] /dc-dir/dc-file_271 auth v3560 s=3 n(v0 rc2023-10-03T19:13:37.584720+0000 b3 1=1+0) (iversion lock) 0x55cf62138100] 2023-10-03T19:20:55.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3251> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_271 [2,head] auth (dversion lock) v=3560 ino=0x10000000304 state=1073741824 0x55cf62133400] [inode 0x10000000304 [2,head] /dc-dir/dc-file_271 auth v3560 s=3 n(v0 rc2023-10-03T19:13:37.584720+0000 b3 1=1+0) (iversion lock) 0x55cf62138100] 2023-10-03T19:20:55.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3250> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000304 [2,head] #10000000304 auth v3560 s=3 n(v0 rc2023-10-03T19:13:37.584720+0000 b3 1=1+0) (iversion lock) 0x55cf62138100] 2023-10-03T19:20:55.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3249> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_271 [2,head] auth NULL (dversion lock) v=3560 ino=(nil) state=1073741824 0x55cf62133400] 2023-10-03T19:20:55.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3248> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_270 [2,head] auth (dversion lock) v=3558 ino=0x10000000303 state=1073741824 0x55cf62133180] 2023-10-03T19:20:55.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3247> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3246> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000303 [2,head] /dc-dir/dc-file_270 auth v3558 s=3 n(v0 rc2023-10-03T19:13:37.573562+0000 b3 1=1+0) (iversion lock) 0x55cf62137b80] 2023-10-03T19:20:55.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3245> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_270 [2,head] auth (dversion lock) v=3558 ino=0x10000000303 state=1073741824 0x55cf62133180] [inode 0x10000000303 [2,head] /dc-dir/dc-file_270 auth v3558 s=3 n(v0 rc2023-10-03T19:13:37.573562+0000 b3 1=1+0) (iversion lock) 0x55cf62137b80] 2023-10-03T19:20:55.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3244> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000303 [2,head] #10000000303 auth v3558 s=3 n(v0 rc2023-10-03T19:13:37.573562+0000 b3 1=1+0) (iversion lock) 0x55cf62137b80] 2023-10-03T19:20:55.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3243> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_270 [2,head] auth NULL (dversion lock) v=3558 ino=(nil) state=1073741824 0x55cf62133180] 2023-10-03T19:20:55.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3242> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_269 [2,head] auth (dversion lock) v=3556 ino=0x10000000302 state=1073741824 0x55cf62132f00] 2023-10-03T19:20:55.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3241> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3240> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000302 [2,head] /dc-dir/dc-file_269 auth v3556 s=3 n(v0 rc2023-10-03T19:13:37.562837+0000 b3 1=1+0) (iversion lock) 0x55cf62137600] 2023-10-03T19:20:55.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3239> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_269 [2,head] auth (dversion lock) v=3556 ino=0x10000000302 state=1073741824 0x55cf62132f00] [inode 0x10000000302 [2,head] /dc-dir/dc-file_269 auth v3556 s=3 n(v0 rc2023-10-03T19:13:37.562837+0000 b3 1=1+0) (iversion lock) 0x55cf62137600] 2023-10-03T19:20:55.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3238> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000302 [2,head] #10000000302 auth v3556 s=3 n(v0 rc2023-10-03T19:13:37.562837+0000 b3 1=1+0) (iversion lock) 0x55cf62137600] 2023-10-03T19:20:55.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3237> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_269 [2,head] auth NULL (dversion lock) v=3556 ino=(nil) state=1073741824 0x55cf62132f00] 2023-10-03T19:20:55.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3236> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_268 [2,head] auth (dversion lock) v=3554 ino=0x10000000301 state=1073741824 0x55cf62132c80] 2023-10-03T19:20:55.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3235> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3234> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000301 [2,head] /dc-dir/dc-file_268 auth v3554 s=3 n(v0 rc2023-10-03T19:13:37.551480+0000 b3 1=1+0) (iversion lock) 0x55cf62137080] 2023-10-03T19:20:55.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3233> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_268 [2,head] auth (dversion lock) v=3554 ino=0x10000000301 state=1073741824 0x55cf62132c80] [inode 0x10000000301 [2,head] /dc-dir/dc-file_268 auth v3554 s=3 n(v0 rc2023-10-03T19:13:37.551480+0000 b3 1=1+0) (iversion lock) 0x55cf62137080] 2023-10-03T19:20:55.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3232> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000301 [2,head] #10000000301 auth v3554 s=3 n(v0 rc2023-10-03T19:13:37.551480+0000 b3 1=1+0) (iversion lock) 0x55cf62137080] 2023-10-03T19:20:55.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3231> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_268 [2,head] auth NULL (dversion lock) v=3554 ino=(nil) state=1073741824 0x55cf62132c80] 2023-10-03T19:20:55.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3230> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_267 [2,head] auth (dversion lock) v=3552 ino=0x10000000300 state=1073741824 0x55cf62132a00] 2023-10-03T19:20:55.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3229> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3228> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000300 [2,head] /dc-dir/dc-file_267 auth v3552 s=3 n(v0 rc2023-10-03T19:13:37.540232+0000 b3 1=1+0) (iversion lock) 0x55cf62136b00] 2023-10-03T19:20:55.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3227> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_267 [2,head] auth (dversion lock) v=3552 ino=0x10000000300 state=1073741824 0x55cf62132a00] [inode 0x10000000300 [2,head] /dc-dir/dc-file_267 auth v3552 s=3 n(v0 rc2023-10-03T19:13:37.540232+0000 b3 1=1+0) (iversion lock) 0x55cf62136b00] 2023-10-03T19:20:55.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3226> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000300 [2,head] #10000000300 auth v3552 s=3 n(v0 rc2023-10-03T19:13:37.540232+0000 b3 1=1+0) (iversion lock) 0x55cf62136b00] 2023-10-03T19:20:55.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3225> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_267 [2,head] auth NULL (dversion lock) v=3552 ino=(nil) state=1073741824 0x55cf62132a00] 2023-10-03T19:20:55.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3224> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_266 [2,head] auth (dversion lock) v=3550 ino=0x100000002ff state=1073741824 0x55cf62132780] 2023-10-03T19:20:55.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3223> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3222> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002ff [2,head] /dc-dir/dc-file_266 auth v3550 s=3 n(v0 rc2023-10-03T19:13:37.528715+0000 b3 1=1+0) (iversion lock) 0x55cf62136580] 2023-10-03T19:20:55.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3221> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_266 [2,head] auth (dversion lock) v=3550 ino=0x100000002ff state=1073741824 0x55cf62132780] [inode 0x100000002ff [2,head] /dc-dir/dc-file_266 auth v3550 s=3 n(v0 rc2023-10-03T19:13:37.528715+0000 b3 1=1+0) (iversion lock) 0x55cf62136580] 2023-10-03T19:20:55.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3220> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002ff [2,head] #100000002ff auth v3550 s=3 n(v0 rc2023-10-03T19:13:37.528715+0000 b3 1=1+0) (iversion lock) 0x55cf62136580] 2023-10-03T19:20:55.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3219> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_266 [2,head] auth NULL (dversion lock) v=3550 ino=(nil) state=1073741824 0x55cf62132780] 2023-10-03T19:20:55.264 INFO:teuthology.orchestra.run.smithi045.stdout: -3218> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_265 [2,head] auth (dversion lock) v=3548 ino=0x100000002fe state=1073741824 0x55cf62132500] 2023-10-03T19:20:55.267 INFO:teuthology.orchestra.run.smithi045.stdout: -3217> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.267 INFO:teuthology.orchestra.run.smithi045.stdout: -3216> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002fe [2,head] /dc-dir/dc-file_265 auth v3548 s=3 n(v0 rc2023-10-03T19:13:37.517502+0000 b3 1=1+0) (iversion lock) 0x55cf62136000] 2023-10-03T19:20:55.267 INFO:teuthology.orchestra.run.smithi045.stdout: -3215> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_265 [2,head] auth (dversion lock) v=3548 ino=0x100000002fe state=1073741824 0x55cf62132500] [inode 0x100000002fe [2,head] /dc-dir/dc-file_265 auth v3548 s=3 n(v0 rc2023-10-03T19:13:37.517502+0000 b3 1=1+0) (iversion lock) 0x55cf62136000] 2023-10-03T19:20:55.267 INFO:teuthology.orchestra.run.smithi045.stdout: -3214> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002fe [2,head] #100000002fe auth v3548 s=3 n(v0 rc2023-10-03T19:13:37.517502+0000 b3 1=1+0) (iversion lock) 0x55cf62136000] 2023-10-03T19:20:55.267 INFO:teuthology.orchestra.run.smithi045.stdout: -3213> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_265 [2,head] auth NULL (dversion lock) v=3548 ino=(nil) state=1073741824 0x55cf62132500] 2023-10-03T19:20:55.267 INFO:teuthology.orchestra.run.smithi045.stdout: -3212> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_264 [2,head] auth (dversion lock) v=3546 ino=0x100000002fd state=1073741824 0x55cf62132280] 2023-10-03T19:20:55.267 INFO:teuthology.orchestra.run.smithi045.stdout: -3211> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.267 INFO:teuthology.orchestra.run.smithi045.stdout: -3210> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002fd [2,head] /dc-dir/dc-file_264 auth v3546 s=3 n(v0 rc2023-10-03T19:13:37.506123+0000 b3 1=1+0) (iversion lock) 0x55cf62127700] 2023-10-03T19:20:55.267 INFO:teuthology.orchestra.run.smithi045.stdout: -3209> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_264 [2,head] auth (dversion lock) v=3546 ino=0x100000002fd state=1073741824 0x55cf62132280] [inode 0x100000002fd [2,head] /dc-dir/dc-file_264 auth v3546 s=3 n(v0 rc2023-10-03T19:13:37.506123+0000 b3 1=1+0) (iversion lock) 0x55cf62127700] 2023-10-03T19:20:55.269 INFO:teuthology.orchestra.run.smithi045.stdout: -3208> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002fd [2,head] #100000002fd auth v3546 s=3 n(v0 rc2023-10-03T19:13:37.506123+0000 b3 1=1+0) (iversion lock) 0x55cf62127700] 2023-10-03T19:20:55.269 INFO:teuthology.orchestra.run.smithi045.stdout: -3207> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_264 [2,head] auth NULL (dversion lock) v=3546 ino=(nil) state=1073741824 0x55cf62132280] 2023-10-03T19:20:55.269 INFO:teuthology.orchestra.run.smithi045.stdout: -3206> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_263 [2,head] auth (dversion lock) v=3544 ino=0x100000002fc state=1073741824 0x55cf62132000] 2023-10-03T19:20:55.269 INFO:teuthology.orchestra.run.smithi045.stdout: -3205> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.269 INFO:teuthology.orchestra.run.smithi045.stdout: -3204> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002fc [2,head] /dc-dir/dc-file_263 auth v3544 s=3 n(v0 rc2023-10-03T19:13:37.494635+0000 b3 1=1+0) (iversion lock) 0x55cf62127180] 2023-10-03T19:20:55.269 INFO:teuthology.orchestra.run.smithi045.stdout: -3203> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_263 [2,head] auth (dversion lock) v=3544 ino=0x100000002fc state=1073741824 0x55cf62132000] [inode 0x100000002fc [2,head] /dc-dir/dc-file_263 auth v3544 s=3 n(v0 rc2023-10-03T19:13:37.494635+0000 b3 1=1+0) (iversion lock) 0x55cf62127180] 2023-10-03T19:20:55.270 INFO:teuthology.orchestra.run.smithi045.stdout: -3202> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002fc [2,head] #100000002fc auth v3544 s=3 n(v0 rc2023-10-03T19:13:37.494635+0000 b3 1=1+0) (iversion lock) 0x55cf62127180] 2023-10-03T19:20:55.270 INFO:teuthology.orchestra.run.smithi045.stdout: -3201> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_263 [2,head] auth NULL (dversion lock) v=3544 ino=(nil) state=1073741824 0x55cf62132000] 2023-10-03T19:20:55.270 INFO:teuthology.orchestra.run.smithi045.stdout: -3200> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_262 [2,head] auth (dversion lock) v=3224 ino=0x100000002fb state=1073741824 0x55cf62123b80] 2023-10-03T19:20:55.270 INFO:teuthology.orchestra.run.smithi045.stdout: -3199> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.270 INFO:teuthology.orchestra.run.smithi045.stdout: -3198> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002fb [2,head] /dc-dir/dc-file_262 auth v3224 s=3 n(v0 rc2023-10-03T19:13:37.483117+0000 b3 1=1+0) (iversion lock) 0x55cf62126c00] 2023-10-03T19:20:55.270 INFO:teuthology.orchestra.run.smithi045.stdout: -3197> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_262 [2,head] auth (dversion lock) v=3224 ino=0x100000002fb state=1073741824 0x55cf62123b80] [inode 0x100000002fb [2,head] /dc-dir/dc-file_262 auth v3224 s=3 n(v0 rc2023-10-03T19:13:37.483117+0000 b3 1=1+0) (iversion lock) 0x55cf62126c00] 2023-10-03T19:20:55.270 INFO:teuthology.orchestra.run.smithi045.stdout: -3196> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002fb [2,head] #100000002fb auth v3224 s=3 n(v0 rc2023-10-03T19:13:37.483117+0000 b3 1=1+0) (iversion lock) 0x55cf62126c00] 2023-10-03T19:20:55.270 INFO:teuthology.orchestra.run.smithi045.stdout: -3195> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_262 [2,head] auth NULL (dversion lock) v=3224 ino=(nil) state=1073741824 0x55cf62123b80] 2023-10-03T19:20:55.270 INFO:teuthology.orchestra.run.smithi045.stdout: -3194> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_261 [2,head] auth (dversion lock) v=3222 ino=0x100000002fa state=1073741824 0x55cf62123900] 2023-10-03T19:20:55.270 INFO:teuthology.orchestra.run.smithi045.stdout: -3193> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.271 INFO:teuthology.orchestra.run.smithi045.stdout: -3192> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002fa [2,head] /dc-dir/dc-file_261 auth v3222 s=3 n(v0 rc2023-10-03T19:13:37.470456+0000 b3 1=1+0) (iversion lock) 0x55cf62126680] 2023-10-03T19:20:55.271 INFO:teuthology.orchestra.run.smithi045.stdout: -3191> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_261 [2,head] auth (dversion lock) v=3222 ino=0x100000002fa state=1073741824 0x55cf62123900] [inode 0x100000002fa [2,head] /dc-dir/dc-file_261 auth v3222 s=3 n(v0 rc2023-10-03T19:13:37.470456+0000 b3 1=1+0) (iversion lock) 0x55cf62126680] 2023-10-03T19:20:55.271 INFO:teuthology.orchestra.run.smithi045.stdout: -3190> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002fa [2,head] #100000002fa auth v3222 s=3 n(v0 rc2023-10-03T19:13:37.470456+0000 b3 1=1+0) (iversion lock) 0x55cf62126680] 2023-10-03T19:20:55.271 INFO:teuthology.orchestra.run.smithi045.stdout: -3189> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_261 [2,head] auth NULL (dversion lock) v=3222 ino=(nil) state=1073741824 0x55cf62123900] 2023-10-03T19:20:55.271 INFO:teuthology.orchestra.run.smithi045.stdout: -3188> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_260 [2,head] auth (dversion lock) v=3220 ino=0x100000002f9 state=1073741824 0x55cf62123680] 2023-10-03T19:20:55.271 INFO:teuthology.orchestra.run.smithi045.stdout: -3187> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.271 INFO:teuthology.orchestra.run.smithi045.stdout: -3186> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002f9 [2,head] /dc-dir/dc-file_260 auth v3220 s=3 n(v0 rc2023-10-03T19:13:37.458922+0000 b3 1=1+0) (iversion lock) 0x55cf62126100] 2023-10-03T19:20:55.271 INFO:teuthology.orchestra.run.smithi045.stdout: -3185> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_260 [2,head] auth (dversion lock) v=3220 ino=0x100000002f9 state=1073741824 0x55cf62123680] [inode 0x100000002f9 [2,head] /dc-dir/dc-file_260 auth v3220 s=3 n(v0 rc2023-10-03T19:13:37.458922+0000 b3 1=1+0) (iversion lock) 0x55cf62126100] 2023-10-03T19:20:55.271 INFO:teuthology.orchestra.run.smithi045.stdout: -3184> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002f9 [2,head] #100000002f9 auth v3220 s=3 n(v0 rc2023-10-03T19:13:37.458922+0000 b3 1=1+0) (iversion lock) 0x55cf62126100] 2023-10-03T19:20:55.271 INFO:teuthology.orchestra.run.smithi045.stdout: -3183> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_260 [2,head] auth NULL (dversion lock) v=3220 ino=(nil) state=1073741824 0x55cf62123680] 2023-10-03T19:20:55.271 INFO:teuthology.orchestra.run.smithi045.stdout: -3182> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_259 [2,head] auth (dversion lock) v=3218 ino=0x100000002f8 state=1073741824 0x55cf62123400] 2023-10-03T19:20:55.271 INFO:teuthology.orchestra.run.smithi045.stdout: -3181> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.272 INFO:teuthology.orchestra.run.smithi045.stdout: -3180> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002f8 [2,head] /dc-dir/dc-file_259 auth v3218 s=3 n(v0 rc2023-10-03T19:13:37.447466+0000 b3 1=1+0) (iversion lock) 0x55cf62125b80] 2023-10-03T19:20:55.272 INFO:teuthology.orchestra.run.smithi045.stdout: -3179> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_259 [2,head] auth (dversion lock) v=3218 ino=0x100000002f8 state=1073741824 0x55cf62123400] [inode 0x100000002f8 [2,head] /dc-dir/dc-file_259 auth v3218 s=3 n(v0 rc2023-10-03T19:13:37.447466+0000 b3 1=1+0) (iversion lock) 0x55cf62125b80] 2023-10-03T19:20:55.272 INFO:teuthology.orchestra.run.smithi045.stdout: -3178> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002f8 [2,head] #100000002f8 auth v3218 s=3 n(v0 rc2023-10-03T19:13:37.447466+0000 b3 1=1+0) (iversion lock) 0x55cf62125b80] 2023-10-03T19:20:55.272 INFO:teuthology.orchestra.run.smithi045.stdout: -3177> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_259 [2,head] auth NULL (dversion lock) v=3218 ino=(nil) state=1073741824 0x55cf62123400] 2023-10-03T19:20:55.272 INFO:teuthology.orchestra.run.smithi045.stdout: -3176> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_258 [2,head] auth (dversion lock) v=3216 ino=0x100000002f7 state=1073741824 0x55cf62123180] 2023-10-03T19:20:55.272 INFO:teuthology.orchestra.run.smithi045.stdout: -3175> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.272 INFO:teuthology.orchestra.run.smithi045.stdout: -3174> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002f7 [2,head] /dc-dir/dc-file_258 auth v3216 s=3 n(v0 rc2023-10-03T19:13:37.435651+0000 b3 1=1+0) (iversion lock) 0x55cf62125600] 2023-10-03T19:20:55.272 INFO:teuthology.orchestra.run.smithi045.stdout: -3173> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_258 [2,head] auth (dversion lock) v=3216 ino=0x100000002f7 state=1073741824 0x55cf62123180] [inode 0x100000002f7 [2,head] /dc-dir/dc-file_258 auth v3216 s=3 n(v0 rc2023-10-03T19:13:37.435651+0000 b3 1=1+0) (iversion lock) 0x55cf62125600] 2023-10-03T19:20:55.272 INFO:teuthology.orchestra.run.smithi045.stdout: -3172> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002f7 [2,head] #100000002f7 auth v3216 s=3 n(v0 rc2023-10-03T19:13:37.435651+0000 b3 1=1+0) (iversion lock) 0x55cf62125600] 2023-10-03T19:20:55.272 INFO:teuthology.orchestra.run.smithi045.stdout: -3171> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_258 [2,head] auth NULL (dversion lock) v=3216 ino=(nil) state=1073741824 0x55cf62123180] 2023-10-03T19:20:55.272 INFO:teuthology.orchestra.run.smithi045.stdout: -3170> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_257 [2,head] auth (dversion lock) v=3214 ino=0x100000002f6 state=1073741824 0x55cf62122f00] 2023-10-03T19:20:55.273 INFO:teuthology.orchestra.run.smithi045.stdout: -3169> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.273 INFO:teuthology.orchestra.run.smithi045.stdout: -3168> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002f6 [2,head] /dc-dir/dc-file_257 auth v3214 s=3 n(v0 rc2023-10-03T19:13:37.424227+0000 b3 1=1+0) (iversion lock) 0x55cf62125080] 2023-10-03T19:20:55.273 INFO:teuthology.orchestra.run.smithi045.stdout: -3167> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_257 [2,head] auth (dversion lock) v=3214 ino=0x100000002f6 state=1073741824 0x55cf62122f00] [inode 0x100000002f6 [2,head] /dc-dir/dc-file_257 auth v3214 s=3 n(v0 rc2023-10-03T19:13:37.424227+0000 b3 1=1+0) (iversion lock) 0x55cf62125080] 2023-10-03T19:20:55.273 INFO:teuthology.orchestra.run.smithi045.stdout: -3166> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002f6 [2,head] #100000002f6 auth v3214 s=3 n(v0 rc2023-10-03T19:13:37.424227+0000 b3 1=1+0) (iversion lock) 0x55cf62125080] 2023-10-03T19:20:55.273 INFO:teuthology.orchestra.run.smithi045.stdout: -3165> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_257 [2,head] auth NULL (dversion lock) v=3214 ino=(nil) state=1073741824 0x55cf62122f00] 2023-10-03T19:20:55.273 INFO:teuthology.orchestra.run.smithi045.stdout: -3164> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_256 [2,head] auth (dversion lock) v=3212 ino=0x100000002f5 state=1073741824 0x55cf62122c80] 2023-10-03T19:20:55.273 INFO:teuthology.orchestra.run.smithi045.stdout: -3163> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.273 INFO:teuthology.orchestra.run.smithi045.stdout: -3162> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002f5 [2,head] /dc-dir/dc-file_256 auth v3212 s=3 n(v0 rc2023-10-03T19:13:37.413247+0000 b3 1=1+0) (iversion lock) 0x55cf62124b00] 2023-10-03T19:20:55.273 INFO:teuthology.orchestra.run.smithi045.stdout: -3161> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_256 [2,head] auth (dversion lock) v=3212 ino=0x100000002f5 state=1073741824 0x55cf62122c80] [inode 0x100000002f5 [2,head] /dc-dir/dc-file_256 auth v3212 s=3 n(v0 rc2023-10-03T19:13:37.413247+0000 b3 1=1+0) (iversion lock) 0x55cf62124b00] 2023-10-03T19:20:55.273 INFO:teuthology.orchestra.run.smithi045.stdout: -3160> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002f5 [2,head] #100000002f5 auth v3212 s=3 n(v0 rc2023-10-03T19:13:37.413247+0000 b3 1=1+0) (iversion lock) 0x55cf62124b00] 2023-10-03T19:20:55.273 INFO:teuthology.orchestra.run.smithi045.stdout: -3159> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_256 [2,head] auth NULL (dversion lock) v=3212 ino=(nil) state=1073741824 0x55cf62122c80] 2023-10-03T19:20:55.273 INFO:teuthology.orchestra.run.smithi045.stdout: -3158> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_255 [2,head] auth (dversion lock) v=3210 ino=0x100000002f4 state=1073741824 0x55cf62122a00] 2023-10-03T19:20:55.274 INFO:teuthology.orchestra.run.smithi045.stdout: -3157> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.274 INFO:teuthology.orchestra.run.smithi045.stdout: -3156> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002f4 [2,head] /dc-dir/dc-file_255 auth v3210 s=3 n(v0 rc2023-10-03T19:13:37.402104+0000 b3 1=1+0) (iversion lock) 0x55cf62124580] 2023-10-03T19:20:55.274 INFO:teuthology.orchestra.run.smithi045.stdout: -3155> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_255 [2,head] auth (dversion lock) v=3210 ino=0x100000002f4 state=1073741824 0x55cf62122a00] [inode 0x100000002f4 [2,head] /dc-dir/dc-file_255 auth v3210 s=3 n(v0 rc2023-10-03T19:13:37.402104+0000 b3 1=1+0) (iversion lock) 0x55cf62124580] 2023-10-03T19:20:55.274 INFO:teuthology.orchestra.run.smithi045.stdout: -3154> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002f4 [2,head] #100000002f4 auth v3210 s=3 n(v0 rc2023-10-03T19:13:37.402104+0000 b3 1=1+0) (iversion lock) 0x55cf62124580] 2023-10-03T19:20:55.274 INFO:teuthology.orchestra.run.smithi045.stdout: -3153> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_255 [2,head] auth NULL (dversion lock) v=3210 ino=(nil) state=1073741824 0x55cf62122a00] 2023-10-03T19:20:55.274 INFO:teuthology.orchestra.run.smithi045.stdout: -3152> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_254 [2,head] auth (dversion lock) v=3208 ino=0x100000002f3 state=1073741824 0x55cf62122780] 2023-10-03T19:20:55.274 INFO:teuthology.orchestra.run.smithi045.stdout: -3151> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.274 INFO:teuthology.orchestra.run.smithi045.stdout: -3150> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002f3 [2,head] /dc-dir/dc-file_254 auth v3208 s=3 n(v0 rc2023-10-03T19:13:37.390404+0000 b3 1=1+0) (iversion lock) 0x55cf62124000] 2023-10-03T19:20:55.274 INFO:teuthology.orchestra.run.smithi045.stdout: -3149> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_254 [2,head] auth (dversion lock) v=3208 ino=0x100000002f3 state=1073741824 0x55cf62122780] [inode 0x100000002f3 [2,head] /dc-dir/dc-file_254 auth v3208 s=3 n(v0 rc2023-10-03T19:13:37.390404+0000 b3 1=1+0) (iversion lock) 0x55cf62124000] 2023-10-03T19:20:55.274 INFO:teuthology.orchestra.run.smithi045.stdout: -3148> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002f3 [2,head] #100000002f3 auth v3208 s=3 n(v0 rc2023-10-03T19:13:37.390404+0000 b3 1=1+0) (iversion lock) 0x55cf62124000] 2023-10-03T19:20:55.297 INFO:teuthology.orchestra.run.smithi045.stdout: -3147> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_254 [2,head] auth NULL (dversion lock) v=3208 ino=(nil) state=1073741824 0x55cf62122780] 2023-10-03T19:20:55.297 INFO:teuthology.orchestra.run.smithi045.stdout: -3146> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_253 [2,head] auth (dversion lock) v=3206 ino=0x100000002f2 state=1073741824 0x55cf62122500] 2023-10-03T19:20:55.297 INFO:teuthology.orchestra.run.smithi045.stdout: -3145> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.297 INFO:teuthology.orchestra.run.smithi045.stdout: -3144> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002f2 [2,head] /dc-dir/dc-file_253 auth v3206 s=3 n(v0 rc2023-10-03T19:13:37.378606+0000 b3 1=1+0) (iversion lock) 0x55cf6211d700] 2023-10-03T19:20:55.297 INFO:teuthology.orchestra.run.smithi045.stdout: -3143> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_253 [2,head] auth (dversion lock) v=3206 ino=0x100000002f2 state=1073741824 0x55cf62122500] [inode 0x100000002f2 [2,head] /dc-dir/dc-file_253 auth v3206 s=3 n(v0 rc2023-10-03T19:13:37.378606+0000 b3 1=1+0) (iversion lock) 0x55cf6211d700] 2023-10-03T19:20:55.297 INFO:teuthology.orchestra.run.smithi045.stdout: -3142> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002f2 [2,head] #100000002f2 auth v3206 s=3 n(v0 rc2023-10-03T19:13:37.378606+0000 b3 1=1+0) (iversion lock) 0x55cf6211d700] 2023-10-03T19:20:55.297 INFO:teuthology.orchestra.run.smithi045.stdout: -3141> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_253 [2,head] auth NULL (dversion lock) v=3206 ino=(nil) state=1073741824 0x55cf62122500] 2023-10-03T19:20:55.298 INFO:teuthology.orchestra.run.smithi045.stdout: -3140> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_252 [2,head] auth (dversion lock) v=3204 ino=0x100000002f1 state=1073741824 0x55cf62122280] 2023-10-03T19:20:55.298 INFO:teuthology.orchestra.run.smithi045.stdout: -3139> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.298 INFO:teuthology.orchestra.run.smithi045.stdout: -3138> 2023-10-03T19:15:17.719+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002f1 [2,head] /dc-dir/dc-file_252 auth v3204 s=3 n(v0 rc2023-10-03T19:13:37.367153+0000 b3 1=1+0) (iversion lock) 0x55cf6211d180] 2023-10-03T19:20:55.298 INFO:teuthology.orchestra.run.smithi045.stdout: -3137> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_252 [2,head] auth (dversion lock) v=3204 ino=0x100000002f1 state=1073741824 0x55cf62122280] [inode 0x100000002f1 [2,head] /dc-dir/dc-file_252 auth v3204 s=3 n(v0 rc2023-10-03T19:13:37.367153+0000 b3 1=1+0) (iversion lock) 0x55cf6211d180] 2023-10-03T19:20:55.298 INFO:teuthology.orchestra.run.smithi045.stdout: -3136> 2023-10-03T19:15:17.719+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002f1 [2,head] #100000002f1 auth v3204 s=3 n(v0 rc2023-10-03T19:13:37.367153+0000 b3 1=1+0) (iversion lock) 0x55cf6211d180] 2023-10-03T19:20:55.298 INFO:teuthology.orchestra.run.smithi045.stdout: -3135> 2023-10-03T19:15:17.719+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_252 [2,head] auth NULL (dversion lock) v=3204 ino=(nil) state=1073741824 0x55cf62122280] 2023-10-03T19:20:55.298 INFO:teuthology.orchestra.run.smithi045.stdout: -3134> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_251 [2,head] auth (dversion lock) v=3202 ino=0x100000002f0 state=1073741824 0x55cf62122000] 2023-10-03T19:20:55.298 INFO:teuthology.orchestra.run.smithi045.stdout: -3133> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.298 INFO:teuthology.orchestra.run.smithi045.stdout: -3132> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002f0 [2,head] /dc-dir/dc-file_251 auth v3202 s=3 n(v0 rc2023-10-03T19:13:37.354930+0000 b3 1=1+0) (iversion lock) 0x55cf6211cc00] 2023-10-03T19:20:55.298 INFO:teuthology.orchestra.run.smithi045.stdout: -3131> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_251 [2,head] auth (dversion lock) v=3202 ino=0x100000002f0 state=1073741824 0x55cf62122000] [inode 0x100000002f0 [2,head] /dc-dir/dc-file_251 auth v3202 s=3 n(v0 rc2023-10-03T19:13:37.354930+0000 b3 1=1+0) (iversion lock) 0x55cf6211cc00] 2023-10-03T19:20:55.298 INFO:teuthology.orchestra.run.smithi045.stdout: -3130> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002f0 [2,head] #100000002f0 auth v3202 s=3 n(v0 rc2023-10-03T19:13:37.354930+0000 b3 1=1+0) (iversion lock) 0x55cf6211cc00] 2023-10-03T19:20:55.299 INFO:teuthology.orchestra.run.smithi045.stdout: -3129> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_251 [2,head] auth NULL (dversion lock) v=3202 ino=(nil) state=1073741824 0x55cf62122000] 2023-10-03T19:20:55.299 INFO:teuthology.orchestra.run.smithi045.stdout: -3128> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_250 [2,head] auth (dversion lock) v=3200 ino=0x100000002ef state=1073741824 0x55cf62115b80] 2023-10-03T19:20:55.299 INFO:teuthology.orchestra.run.smithi045.stdout: -3127> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.299 INFO:teuthology.orchestra.run.smithi045.stdout: -3126> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002ef [2,head] /dc-dir/dc-file_250 auth v3200 s=3 n(v0 rc2023-10-03T19:13:37.342396+0000 b3 1=1+0) (iversion lock) 0x55cf6211c680] 2023-10-03T19:20:55.299 INFO:teuthology.orchestra.run.smithi045.stdout: -3125> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_250 [2,head] auth (dversion lock) v=3200 ino=0x100000002ef state=1073741824 0x55cf62115b80] [inode 0x100000002ef [2,head] /dc-dir/dc-file_250 auth v3200 s=3 n(v0 rc2023-10-03T19:13:37.342396+0000 b3 1=1+0) (iversion lock) 0x55cf6211c680] 2023-10-03T19:20:55.299 INFO:teuthology.orchestra.run.smithi045.stdout: -3124> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002ef [2,head] #100000002ef auth v3200 s=3 n(v0 rc2023-10-03T19:13:37.342396+0000 b3 1=1+0) (iversion lock) 0x55cf6211c680] 2023-10-03T19:20:55.299 INFO:teuthology.orchestra.run.smithi045.stdout: -3123> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_250 [2,head] auth NULL (dversion lock) v=3200 ino=(nil) state=1073741824 0x55cf62115b80] 2023-10-03T19:20:55.299 INFO:teuthology.orchestra.run.smithi045.stdout: -3122> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_249 [2,head] auth (dversion lock) v=3198 ino=0x100000002ee state=1073741824 0x55cf62115900] 2023-10-03T19:20:55.299 INFO:teuthology.orchestra.run.smithi045.stdout: -3121> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.299 INFO:teuthology.orchestra.run.smithi045.stdout: -3120> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002ee [2,head] /dc-dir/dc-file_249 auth v3198 s=3 n(v0 rc2023-10-03T19:13:37.330158+0000 b3 1=1+0) (iversion lock) 0x55cf6211c100] 2023-10-03T19:20:55.299 INFO:teuthology.orchestra.run.smithi045.stdout: -3119> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_249 [2,head] auth (dversion lock) v=3198 ino=0x100000002ee state=1073741824 0x55cf62115900] [inode 0x100000002ee [2,head] /dc-dir/dc-file_249 auth v3198 s=3 n(v0 rc2023-10-03T19:13:37.330158+0000 b3 1=1+0) (iversion lock) 0x55cf6211c100] 2023-10-03T19:20:55.299 INFO:teuthology.orchestra.run.smithi045.stdout: -3118> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002ee [2,head] #100000002ee auth v3198 s=3 n(v0 rc2023-10-03T19:13:37.330158+0000 b3 1=1+0) (iversion lock) 0x55cf6211c100] 2023-10-03T19:20:55.300 INFO:teuthology.orchestra.run.smithi045.stdout: -3117> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_249 [2,head] auth NULL (dversion lock) v=3198 ino=(nil) state=1073741824 0x55cf62115900] 2023-10-03T19:20:55.300 INFO:teuthology.orchestra.run.smithi045.stdout: -3116> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_248 [2,head] auth (dversion lock) v=3196 ino=0x100000002ed state=1073741824 0x55cf62115680] 2023-10-03T19:20:55.300 INFO:teuthology.orchestra.run.smithi045.stdout: -3115> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.300 INFO:teuthology.orchestra.run.smithi045.stdout: -3114> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002ed [2,head] /dc-dir/dc-file_248 auth v3196 s=3 n(v0 rc2023-10-03T19:13:37.319004+0000 b3 1=1+0) (iversion lock) 0x55cf6211bb80] 2023-10-03T19:20:55.300 INFO:teuthology.orchestra.run.smithi045.stdout: -3113> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_248 [2,head] auth (dversion lock) v=3196 ino=0x100000002ed state=1073741824 0x55cf62115680] [inode 0x100000002ed [2,head] /dc-dir/dc-file_248 auth v3196 s=3 n(v0 rc2023-10-03T19:13:37.319004+0000 b3 1=1+0) (iversion lock) 0x55cf6211bb80] 2023-10-03T19:20:55.300 INFO:teuthology.orchestra.run.smithi045.stdout: -3112> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002ed [2,head] #100000002ed auth v3196 s=3 n(v0 rc2023-10-03T19:13:37.319004+0000 b3 1=1+0) (iversion lock) 0x55cf6211bb80] 2023-10-03T19:20:55.300 INFO:teuthology.orchestra.run.smithi045.stdout: -3111> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_248 [2,head] auth NULL (dversion lock) v=3196 ino=(nil) state=1073741824 0x55cf62115680] 2023-10-03T19:20:55.300 INFO:teuthology.orchestra.run.smithi045.stdout: -3110> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_247 [2,head] auth (dversion lock) v=3194 ino=0x100000002ec state=1073741824 0x55cf62115400] 2023-10-03T19:20:55.300 INFO:teuthology.orchestra.run.smithi045.stdout: -3109> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.300 INFO:teuthology.orchestra.run.smithi045.stdout: -3108> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002ec [2,head] /dc-dir/dc-file_247 auth v3194 s=3 n(v0 rc2023-10-03T19:13:37.307662+0000 b3 1=1+0) (iversion lock) 0x55cf6211b600] 2023-10-03T19:20:55.301 INFO:teuthology.orchestra.run.smithi045.stdout: -3107> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_247 [2,head] auth (dversion lock) v=3194 ino=0x100000002ec state=1073741824 0x55cf62115400] [inode 0x100000002ec [2,head] /dc-dir/dc-file_247 auth v3194 s=3 n(v0 rc2023-10-03T19:13:37.307662+0000 b3 1=1+0) (iversion lock) 0x55cf6211b600] 2023-10-03T19:20:55.301 INFO:teuthology.orchestra.run.smithi045.stdout: -3106> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002ec [2,head] #100000002ec auth v3194 s=3 n(v0 rc2023-10-03T19:13:37.307662+0000 b3 1=1+0) (iversion lock) 0x55cf6211b600] 2023-10-03T19:20:55.301 INFO:teuthology.orchestra.run.smithi045.stdout: -3105> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_247 [2,head] auth NULL (dversion lock) v=3194 ino=(nil) state=1073741824 0x55cf62115400] 2023-10-03T19:20:55.301 INFO:teuthology.orchestra.run.smithi045.stdout: -3104> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_246 [2,head] auth (dversion lock) v=3192 ino=0x100000002eb state=1073741824 0x55cf62115180] 2023-10-03T19:20:55.301 INFO:teuthology.orchestra.run.smithi045.stdout: -3103> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.301 INFO:teuthology.orchestra.run.smithi045.stdout: -3102> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002eb [2,head] /dc-dir/dc-file_246 auth v3192 s=3 n(v0 rc2023-10-03T19:13:37.294433+0000 b3 1=1+0) (iversion lock) 0x55cf6211b080] 2023-10-03T19:20:55.301 INFO:teuthology.orchestra.run.smithi045.stdout: -3101> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_246 [2,head] auth (dversion lock) v=3192 ino=0x100000002eb state=1073741824 0x55cf62115180] [inode 0x100000002eb [2,head] /dc-dir/dc-file_246 auth v3192 s=3 n(v0 rc2023-10-03T19:13:37.294433+0000 b3 1=1+0) (iversion lock) 0x55cf6211b080] 2023-10-03T19:20:55.301 INFO:teuthology.orchestra.run.smithi045.stdout: -3100> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002eb [2,head] #100000002eb auth v3192 s=3 n(v0 rc2023-10-03T19:13:37.294433+0000 b3 1=1+0) (iversion lock) 0x55cf6211b080] 2023-10-03T19:20:55.301 INFO:teuthology.orchestra.run.smithi045.stdout: -3099> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_246 [2,head] auth NULL (dversion lock) v=3192 ino=(nil) state=1073741824 0x55cf62115180] 2023-10-03T19:20:55.301 INFO:teuthology.orchestra.run.smithi045.stdout: -3098> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_245 [2,head] auth (dversion lock) v=3190 ino=0x100000002ea state=1073741824 0x55cf62114f00] 2023-10-03T19:20:55.301 INFO:teuthology.orchestra.run.smithi045.stdout: -3097> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.301 INFO:teuthology.orchestra.run.smithi045.stdout: -3096> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002ea [2,head] /dc-dir/dc-file_245 auth v3190 s=3 n(v0 rc2023-10-03T19:13:37.281735+0000 b3 1=1+0) (iversion lock) 0x55cf6211ab00] 2023-10-03T19:20:55.301 INFO:teuthology.orchestra.run.smithi045.stdout: -3095> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_245 [2,head] auth (dversion lock) v=3190 ino=0x100000002ea state=1073741824 0x55cf62114f00] [inode 0x100000002ea [2,head] /dc-dir/dc-file_245 auth v3190 s=3 n(v0 rc2023-10-03T19:13:37.281735+0000 b3 1=1+0) (iversion lock) 0x55cf6211ab00] 2023-10-03T19:20:55.302 INFO:teuthology.orchestra.run.smithi045.stdout: -3094> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002ea [2,head] #100000002ea auth v3190 s=3 n(v0 rc2023-10-03T19:13:37.281735+0000 b3 1=1+0) (iversion lock) 0x55cf6211ab00] 2023-10-03T19:20:55.302 INFO:teuthology.orchestra.run.smithi045.stdout: -3093> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_245 [2,head] auth NULL (dversion lock) v=3190 ino=(nil) state=1073741824 0x55cf62114f00] 2023-10-03T19:20:55.302 INFO:teuthology.orchestra.run.smithi045.stdout: -3092> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_244 [2,head] auth (dversion lock) v=3188 ino=0x100000002e9 state=1073741824 0x55cf62114c80] 2023-10-03T19:20:55.302 INFO:teuthology.orchestra.run.smithi045.stdout: -3091> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.302 INFO:teuthology.orchestra.run.smithi045.stdout: -3090> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002e9 [2,head] /dc-dir/dc-file_244 auth v3188 s=3 n(v0 rc2023-10-03T19:13:37.270573+0000 b3 1=1+0) (iversion lock) 0x55cf6211a580] 2023-10-03T19:20:55.302 INFO:teuthology.orchestra.run.smithi045.stdout: -3089> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_244 [2,head] auth (dversion lock) v=3188 ino=0x100000002e9 state=1073741824 0x55cf62114c80] [inode 0x100000002e9 [2,head] /dc-dir/dc-file_244 auth v3188 s=3 n(v0 rc2023-10-03T19:13:37.270573+0000 b3 1=1+0) (iversion lock) 0x55cf6211a580] 2023-10-03T19:20:55.302 INFO:teuthology.orchestra.run.smithi045.stdout: -3088> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002e9 [2,head] #100000002e9 auth v3188 s=3 n(v0 rc2023-10-03T19:13:37.270573+0000 b3 1=1+0) (iversion lock) 0x55cf6211a580] 2023-10-03T19:20:55.302 INFO:teuthology.orchestra.run.smithi045.stdout: -3087> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_244 [2,head] auth NULL (dversion lock) v=3188 ino=(nil) state=1073741824 0x55cf62114c80] 2023-10-03T19:20:55.302 INFO:teuthology.orchestra.run.smithi045.stdout: -3086> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_243 [2,head] auth (dversion lock) v=3186 ino=0x100000002e8 state=1073741824 0x55cf62114a00] 2023-10-03T19:20:55.302 INFO:teuthology.orchestra.run.smithi045.stdout: -3085> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.302 INFO:teuthology.orchestra.run.smithi045.stdout: -3084> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002e8 [2,head] /dc-dir/dc-file_243 auth v3186 s=3 n(v0 rc2023-10-03T19:13:37.259539+0000 b3 1=1+0) (iversion lock) 0x55cf6211a000] 2023-10-03T19:20:55.303 INFO:teuthology.orchestra.run.smithi045.stdout: -3083> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_243 [2,head] auth (dversion lock) v=3186 ino=0x100000002e8 state=1073741824 0x55cf62114a00] [inode 0x100000002e8 [2,head] /dc-dir/dc-file_243 auth v3186 s=3 n(v0 rc2023-10-03T19:13:37.259539+0000 b3 1=1+0) (iversion lock) 0x55cf6211a000] 2023-10-03T19:20:55.303 INFO:teuthology.orchestra.run.smithi045.stdout: -3082> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002e8 [2,head] #100000002e8 auth v3186 s=3 n(v0 rc2023-10-03T19:13:37.259539+0000 b3 1=1+0) (iversion lock) 0x55cf6211a000] 2023-10-03T19:20:55.303 INFO:teuthology.orchestra.run.smithi045.stdout: -3081> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_243 [2,head] auth NULL (dversion lock) v=3186 ino=(nil) state=1073741824 0x55cf62114a00] 2023-10-03T19:20:55.303 INFO:teuthology.orchestra.run.smithi045.stdout: -3080> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_242 [2,head] auth (dversion lock) v=3184 ino=0x100000002e7 state=1073741824 0x55cf62114780] 2023-10-03T19:20:55.303 INFO:teuthology.orchestra.run.smithi045.stdout: -3079> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.303 INFO:teuthology.orchestra.run.smithi045.stdout: -3078> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002e7 [2,head] /dc-dir/dc-file_242 auth v3184 s=3 n(v0 rc2023-10-03T19:13:37.247752+0000 b3 1=1+0) (iversion lock) 0x55cf62111700] 2023-10-03T19:20:55.303 INFO:teuthology.orchestra.run.smithi045.stdout: -3077> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_242 [2,head] auth (dversion lock) v=3184 ino=0x100000002e7 state=1073741824 0x55cf62114780] [inode 0x100000002e7 [2,head] /dc-dir/dc-file_242 auth v3184 s=3 n(v0 rc2023-10-03T19:13:37.247752+0000 b3 1=1+0) (iversion lock) 0x55cf62111700] 2023-10-03T19:20:55.304 INFO:teuthology.orchestra.run.smithi045.stdout: -3076> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002e7 [2,head] #100000002e7 auth v3184 s=3 n(v0 rc2023-10-03T19:13:37.247752+0000 b3 1=1+0) (iversion lock) 0x55cf62111700] 2023-10-03T19:20:55.412 INFO:teuthology.orchestra.run.smithi045.stdout: -3075> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_242 [2,head] auth NULL (dversion lock) v=3184 ino=(nil) state=1073741824 0x55cf62114780] 2023-10-03T19:20:55.412 INFO:teuthology.orchestra.run.smithi045.stdout: -3074> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_241 [2,head] auth (dversion lock) v=3182 ino=0x100000002e6 state=1073741824 0x55cf62114500] 2023-10-03T19:20:55.412 INFO:teuthology.orchestra.run.smithi045.stdout: -3073> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.412 INFO:teuthology.orchestra.run.smithi045.stdout: -3072> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002e6 [2,head] /dc-dir/dc-file_241 auth v3182 s=3 n(v0 rc2023-10-03T19:13:37.236624+0000 b3 1=1+0) (iversion lock) 0x55cf62111180] 2023-10-03T19:20:55.412 INFO:teuthology.orchestra.run.smithi045.stdout: -3071> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_241 [2,head] auth (dversion lock) v=3182 ino=0x100000002e6 state=1073741824 0x55cf62114500] [inode 0x100000002e6 [2,head] /dc-dir/dc-file_241 auth v3182 s=3 n(v0 rc2023-10-03T19:13:37.236624+0000 b3 1=1+0) (iversion lock) 0x55cf62111180] 2023-10-03T19:20:55.412 INFO:teuthology.orchestra.run.smithi045.stdout: -3070> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002e6 [2,head] #100000002e6 auth v3182 s=3 n(v0 rc2023-10-03T19:13:37.236624+0000 b3 1=1+0) (iversion lock) 0x55cf62111180] 2023-10-03T19:20:55.412 INFO:teuthology.orchestra.run.smithi045.stdout: -3069> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_241 [2,head] auth NULL (dversion lock) v=3182 ino=(nil) state=1073741824 0x55cf62114500] 2023-10-03T19:20:55.412 INFO:teuthology.orchestra.run.smithi045.stdout: -3068> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_240 [2,head] auth (dversion lock) v=3180 ino=0x100000002e5 state=1073741824 0x55cf62114280] 2023-10-03T19:20:55.412 INFO:teuthology.orchestra.run.smithi045.stdout: -3067> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.413 INFO:teuthology.orchestra.run.smithi045.stdout: -3066> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002e5 [2,head] /dc-dir/dc-file_240 auth v3180 s=3 n(v0 rc2023-10-03T19:13:37.225629+0000 b3 1=1+0) (iversion lock) 0x55cf62110c00] 2023-10-03T19:20:55.413 INFO:teuthology.orchestra.run.smithi045.stdout: -3065> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_240 [2,head] auth (dversion lock) v=3180 ino=0x100000002e5 state=1073741824 0x55cf62114280] [inode 0x100000002e5 [2,head] /dc-dir/dc-file_240 auth v3180 s=3 n(v0 rc2023-10-03T19:13:37.225629+0000 b3 1=1+0) (iversion lock) 0x55cf62110c00] 2023-10-03T19:20:55.413 INFO:teuthology.orchestra.run.smithi045.stdout: -3064> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002e5 [2,head] #100000002e5 auth v3180 s=3 n(v0 rc2023-10-03T19:13:37.225629+0000 b3 1=1+0) (iversion lock) 0x55cf62110c00] 2023-10-03T19:20:55.413 INFO:teuthology.orchestra.run.smithi045.stdout: -3063> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_240 [2,head] auth NULL (dversion lock) v=3180 ino=(nil) state=1073741824 0x55cf62114280] 2023-10-03T19:20:55.413 INFO:teuthology.orchestra.run.smithi045.stdout: -3062> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_239 [2,head] auth (dversion lock) v=3178 ino=0x100000002e4 state=1073741824 0x55cf62114000] 2023-10-03T19:20:55.413 INFO:teuthology.orchestra.run.smithi045.stdout: -3061> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.413 INFO:teuthology.orchestra.run.smithi045.stdout: -3060> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002e4 [2,head] /dc-dir/dc-file_239 auth v3178 s=3 n(v0 rc2023-10-03T19:13:37.214382+0000 b3 1=1+0) (iversion lock) 0x55cf62110680] 2023-10-03T19:20:55.413 INFO:teuthology.orchestra.run.smithi045.stdout: -3059> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_239 [2,head] auth (dversion lock) v=3178 ino=0x100000002e4 state=1073741824 0x55cf62114000] [inode 0x100000002e4 [2,head] /dc-dir/dc-file_239 auth v3178 s=3 n(v0 rc2023-10-03T19:13:37.214382+0000 b3 1=1+0) (iversion lock) 0x55cf62110680] 2023-10-03T19:20:55.413 INFO:teuthology.orchestra.run.smithi045.stdout: -3058> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002e4 [2,head] #100000002e4 auth v3178 s=3 n(v0 rc2023-10-03T19:13:37.214382+0000 b3 1=1+0) (iversion lock) 0x55cf62110680] 2023-10-03T19:20:55.413 INFO:teuthology.orchestra.run.smithi045.stdout: -3057> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_239 [2,head] auth NULL (dversion lock) v=3178 ino=(nil) state=1073741824 0x55cf62114000] 2023-10-03T19:20:55.413 INFO:teuthology.orchestra.run.smithi045.stdout: -3056> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_238 [2,head] auth (dversion lock) v=3176 ino=0x100000002e3 state=1073741824 0x55cf62109b80] 2023-10-03T19:20:55.414 INFO:teuthology.orchestra.run.smithi045.stdout: -3055> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.414 INFO:teuthology.orchestra.run.smithi045.stdout: -3054> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002e3 [2,head] /dc-dir/dc-file_238 auth v3176 s=3 n(v0 rc2023-10-03T19:13:37.202489+0000 b3 1=1+0) (iversion lock) 0x55cf62110100] 2023-10-03T19:20:55.414 INFO:teuthology.orchestra.run.smithi045.stdout: -3053> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_238 [2,head] auth (dversion lock) v=3176 ino=0x100000002e3 state=1073741824 0x55cf62109b80] [inode 0x100000002e3 [2,head] /dc-dir/dc-file_238 auth v3176 s=3 n(v0 rc2023-10-03T19:13:37.202489+0000 b3 1=1+0) (iversion lock) 0x55cf62110100] 2023-10-03T19:20:55.414 INFO:teuthology.orchestra.run.smithi045.stdout: -3052> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002e3 [2,head] #100000002e3 auth v3176 s=3 n(v0 rc2023-10-03T19:13:37.202489+0000 b3 1=1+0) (iversion lock) 0x55cf62110100] 2023-10-03T19:20:55.414 INFO:teuthology.orchestra.run.smithi045.stdout: -3051> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_238 [2,head] auth NULL (dversion lock) v=3176 ino=(nil) state=1073741824 0x55cf62109b80] 2023-10-03T19:20:55.414 INFO:teuthology.orchestra.run.smithi045.stdout: -3050> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_237 [2,head] auth (dversion lock) v=3174 ino=0x100000002e2 state=1073741824 0x55cf62109900] 2023-10-03T19:20:55.414 INFO:teuthology.orchestra.run.smithi045.stdout: -3049> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.414 INFO:teuthology.orchestra.run.smithi045.stdout: -3048> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002e2 [2,head] /dc-dir/dc-file_237 auth v3174 s=3 n(v0 rc2023-10-03T19:13:37.190919+0000 b3 1=1+0) (iversion lock) 0x55cf6210fb80] 2023-10-03T19:20:55.414 INFO:teuthology.orchestra.run.smithi045.stdout: -3047> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_237 [2,head] auth (dversion lock) v=3174 ino=0x100000002e2 state=1073741824 0x55cf62109900] [inode 0x100000002e2 [2,head] /dc-dir/dc-file_237 auth v3174 s=3 n(v0 rc2023-10-03T19:13:37.190919+0000 b3 1=1+0) (iversion lock) 0x55cf6210fb80] 2023-10-03T19:20:55.414 INFO:teuthology.orchestra.run.smithi045.stdout: -3046> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002e2 [2,head] #100000002e2 auth v3174 s=3 n(v0 rc2023-10-03T19:13:37.190919+0000 b3 1=1+0) (iversion lock) 0x55cf6210fb80] 2023-10-03T19:20:55.414 INFO:teuthology.orchestra.run.smithi045.stdout: -3045> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_237 [2,head] auth NULL (dversion lock) v=3174 ino=(nil) state=1073741824 0x55cf62109900] 2023-10-03T19:20:55.415 INFO:teuthology.orchestra.run.smithi045.stdout: -3044> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_236 [2,head] auth (dversion lock) v=3172 ino=0x100000002e1 state=1073741824 0x55cf62109680] 2023-10-03T19:20:55.415 INFO:teuthology.orchestra.run.smithi045.stdout: -3043> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.415 INFO:teuthology.orchestra.run.smithi045.stdout: -3042> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002e1 [2,head] /dc-dir/dc-file_236 auth v3172 s=3 n(v0 rc2023-10-03T19:13:37.179478+0000 b3 1=1+0) (iversion lock) 0x55cf6210f600] 2023-10-03T19:20:55.415 INFO:teuthology.orchestra.run.smithi045.stdout: -3041> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_236 [2,head] auth (dversion lock) v=3172 ino=0x100000002e1 state=1073741824 0x55cf62109680] [inode 0x100000002e1 [2,head] /dc-dir/dc-file_236 auth v3172 s=3 n(v0 rc2023-10-03T19:13:37.179478+0000 b3 1=1+0) (iversion lock) 0x55cf6210f600] 2023-10-03T19:20:55.415 INFO:teuthology.orchestra.run.smithi045.stdout: -3040> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002e1 [2,head] #100000002e1 auth v3172 s=3 n(v0 rc2023-10-03T19:13:37.179478+0000 b3 1=1+0) (iversion lock) 0x55cf6210f600] 2023-10-03T19:20:55.415 INFO:teuthology.orchestra.run.smithi045.stdout: -3039> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_236 [2,head] auth NULL (dversion lock) v=3172 ino=(nil) state=1073741824 0x55cf62109680] 2023-10-03T19:20:55.415 INFO:teuthology.orchestra.run.smithi045.stdout: -3038> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_235 [2,head] auth (dversion lock) v=3170 ino=0x100000002e0 state=1073741824 0x55cf62109400] 2023-10-03T19:20:55.415 INFO:teuthology.orchestra.run.smithi045.stdout: -3037> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.415 INFO:teuthology.orchestra.run.smithi045.stdout: -3036> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002e0 [2,head] /dc-dir/dc-file_235 auth v3170 s=3 n(v0 rc2023-10-03T19:13:37.168003+0000 b3 1=1+0) (iversion lock) 0x55cf6210f080] 2023-10-03T19:20:55.415 INFO:teuthology.orchestra.run.smithi045.stdout: -3035> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_235 [2,head] auth (dversion lock) v=3170 ino=0x100000002e0 state=1073741824 0x55cf62109400] [inode 0x100000002e0 [2,head] /dc-dir/dc-file_235 auth v3170 s=3 n(v0 rc2023-10-03T19:13:37.168003+0000 b3 1=1+0) (iversion lock) 0x55cf6210f080] 2023-10-03T19:20:55.415 INFO:teuthology.orchestra.run.smithi045.stdout: -3034> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002e0 [2,head] #100000002e0 auth v3170 s=3 n(v0 rc2023-10-03T19:13:37.168003+0000 b3 1=1+0) (iversion lock) 0x55cf6210f080] 2023-10-03T19:20:55.416 INFO:teuthology.orchestra.run.smithi045.stdout: -3033> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_235 [2,head] auth NULL (dversion lock) v=3170 ino=(nil) state=1073741824 0x55cf62109400] 2023-10-03T19:20:55.416 INFO:teuthology.orchestra.run.smithi045.stdout: -3032> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_234 [2,head] auth (dversion lock) v=3168 ino=0x100000002df state=1073741824 0x55cf62109180] 2023-10-03T19:20:55.416 INFO:teuthology.orchestra.run.smithi045.stdout: -3031> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.416 INFO:teuthology.orchestra.run.smithi045.stdout: -3030> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002df [2,head] /dc-dir/dc-file_234 auth v3168 s=3 n(v0 rc2023-10-03T19:13:37.155683+0000 b3 1=1+0) (iversion lock) 0x55cf6210eb00] 2023-10-03T19:20:55.416 INFO:teuthology.orchestra.run.smithi045.stdout: -3029> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_234 [2,head] auth (dversion lock) v=3168 ino=0x100000002df state=1073741824 0x55cf62109180] [inode 0x100000002df [2,head] /dc-dir/dc-file_234 auth v3168 s=3 n(v0 rc2023-10-03T19:13:37.155683+0000 b3 1=1+0) (iversion lock) 0x55cf6210eb00] 2023-10-03T19:20:55.416 INFO:teuthology.orchestra.run.smithi045.stdout: -3028> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002df [2,head] #100000002df auth v3168 s=3 n(v0 rc2023-10-03T19:13:37.155683+0000 b3 1=1+0) (iversion lock) 0x55cf6210eb00] 2023-10-03T19:20:55.416 INFO:teuthology.orchestra.run.smithi045.stdout: -3027> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_234 [2,head] auth NULL (dversion lock) v=3168 ino=(nil) state=1073741824 0x55cf62109180] 2023-10-03T19:20:55.416 INFO:teuthology.orchestra.run.smithi045.stdout: -3026> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_233 [2,head] auth (dversion lock) v=3166 ino=0x100000002de state=1073741824 0x55cf62108f00] 2023-10-03T19:20:55.416 INFO:teuthology.orchestra.run.smithi045.stdout: -3025> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.416 INFO:teuthology.orchestra.run.smithi045.stdout: -3024> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002de [2,head] /dc-dir/dc-file_233 auth v3166 s=3 n(v0 rc2023-10-03T19:13:37.143535+0000 b3 1=1+0) (iversion lock) 0x55cf6210e580] 2023-10-03T19:20:55.416 INFO:teuthology.orchestra.run.smithi045.stdout: -3023> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_233 [2,head] auth (dversion lock) v=3166 ino=0x100000002de state=1073741824 0x55cf62108f00] [inode 0x100000002de [2,head] /dc-dir/dc-file_233 auth v3166 s=3 n(v0 rc2023-10-03T19:13:37.143535+0000 b3 1=1+0) (iversion lock) 0x55cf6210e580] 2023-10-03T19:20:55.417 INFO:teuthology.orchestra.run.smithi045.stdout: -3022> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002de [2,head] #100000002de auth v3166 s=3 n(v0 rc2023-10-03T19:13:37.143535+0000 b3 1=1+0) (iversion lock) 0x55cf6210e580] 2023-10-03T19:20:55.417 INFO:teuthology.orchestra.run.smithi045.stdout: -3021> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_233 [2,head] auth NULL (dversion lock) v=3166 ino=(nil) state=1073741824 0x55cf62108f00] 2023-10-03T19:20:55.417 INFO:teuthology.orchestra.run.smithi045.stdout: -3020> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_232 [2,head] auth (dversion lock) v=3164 ino=0x100000002dd state=1073741824 0x55cf62108c80] 2023-10-03T19:20:55.417 INFO:teuthology.orchestra.run.smithi045.stdout: -3019> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.417 INFO:teuthology.orchestra.run.smithi045.stdout: -3018> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002dd [2,head] /dc-dir/dc-file_232 auth v3164 s=3 n(v0 rc2023-10-03T19:13:37.131173+0000 b3 1=1+0) (iversion lock) 0x55cf6210e000] 2023-10-03T19:20:55.417 INFO:teuthology.orchestra.run.smithi045.stdout: -3017> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_232 [2,head] auth (dversion lock) v=3164 ino=0x100000002dd state=1073741824 0x55cf62108c80] [inode 0x100000002dd [2,head] /dc-dir/dc-file_232 auth v3164 s=3 n(v0 rc2023-10-03T19:13:37.131173+0000 b3 1=1+0) (iversion lock) 0x55cf6210e000] 2023-10-03T19:20:55.417 INFO:teuthology.orchestra.run.smithi045.stdout: -3016> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002dd [2,head] #100000002dd auth v3164 s=3 n(v0 rc2023-10-03T19:13:37.131173+0000 b3 1=1+0) (iversion lock) 0x55cf6210e000] 2023-10-03T19:20:55.417 INFO:teuthology.orchestra.run.smithi045.stdout: -3015> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_232 [2,head] auth NULL (dversion lock) v=3164 ino=(nil) state=1073741824 0x55cf62108c80] 2023-10-03T19:20:55.417 INFO:teuthology.orchestra.run.smithi045.stdout: -3014> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_231 [2,head] auth (dversion lock) v=3162 ino=0x100000002dc state=1073741824 0x55cf62108a00] 2023-10-03T19:20:55.417 INFO:teuthology.orchestra.run.smithi045.stdout: -3013> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.418 INFO:teuthology.orchestra.run.smithi045.stdout: -3012> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002dc [2,head] /dc-dir/dc-file_231 auth v3162 s=3 n(v0 rc2023-10-03T19:13:37.118390+0000 b3 1=1+0) (iversion lock) 0x55cf62105700] 2023-10-03T19:20:55.418 INFO:teuthology.orchestra.run.smithi045.stdout: -3011> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_231 [2,head] auth (dversion lock) v=3162 ino=0x100000002dc state=1073741824 0x55cf62108a00] [inode 0x100000002dc [2,head] /dc-dir/dc-file_231 auth v3162 s=3 n(v0 rc2023-10-03T19:13:37.118390+0000 b3 1=1+0) (iversion lock) 0x55cf62105700] 2023-10-03T19:20:55.418 INFO:teuthology.orchestra.run.smithi045.stdout: -3010> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002dc [2,head] #100000002dc auth v3162 s=3 n(v0 rc2023-10-03T19:13:37.118390+0000 b3 1=1+0) (iversion lock) 0x55cf62105700] 2023-10-03T19:20:55.418 INFO:teuthology.orchestra.run.smithi045.stdout: -3009> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_231 [2,head] auth NULL (dversion lock) v=3162 ino=(nil) state=1073741824 0x55cf62108a00] 2023-10-03T19:20:55.418 INFO:teuthology.orchestra.run.smithi045.stdout: -3008> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_230 [2,head] auth (dversion lock) v=3160 ino=0x100000002db state=1073741824 0x55cf62108780] 2023-10-03T19:20:55.418 INFO:teuthology.orchestra.run.smithi045.stdout: -3007> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.418 INFO:teuthology.orchestra.run.smithi045.stdout: -3006> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002db [2,head] /dc-dir/dc-file_230 auth v3160 s=3 n(v0 rc2023-10-03T19:13:37.106378+0000 b3 1=1+0) (iversion lock) 0x55cf62105180] 2023-10-03T19:20:55.418 INFO:teuthology.orchestra.run.smithi045.stdout: -3005> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_230 [2,head] auth (dversion lock) v=3160 ino=0x100000002db state=1073741824 0x55cf62108780] [inode 0x100000002db [2,head] /dc-dir/dc-file_230 auth v3160 s=3 n(v0 rc2023-10-03T19:13:37.106378+0000 b3 1=1+0) (iversion lock) 0x55cf62105180] 2023-10-03T19:20:55.418 INFO:teuthology.orchestra.run.smithi045.stdout: -3004> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002db [2,head] #100000002db auth v3160 s=3 n(v0 rc2023-10-03T19:13:37.106378+0000 b3 1=1+0) (iversion lock) 0x55cf62105180] 2023-10-03T19:20:55.418 INFO:teuthology.orchestra.run.smithi045.stdout: -3003> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_230 [2,head] auth NULL (dversion lock) v=3160 ino=(nil) state=1073741824 0x55cf62108780] 2023-10-03T19:20:55.418 INFO:teuthology.orchestra.run.smithi045.stdout: -3002> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_229 [2,head] auth (dversion lock) v=3158 ino=0x100000002da state=1073741824 0x55cf62108500] 2023-10-03T19:20:55.418 INFO:teuthology.orchestra.run.smithi045.stdout: -3001> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.419 INFO:teuthology.orchestra.run.smithi045.stdout: -3000> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002da [2,head] /dc-dir/dc-file_229 auth v3158 s=3 n(v0 rc2023-10-03T19:13:37.095186+0000 b3 1=1+0) (iversion lock) 0x55cf62104c00] 2023-10-03T19:20:55.419 INFO:teuthology.orchestra.run.smithi045.stdout: -2999> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_229 [2,head] auth (dversion lock) v=3158 ino=0x100000002da state=1073741824 0x55cf62108500] [inode 0x100000002da [2,head] /dc-dir/dc-file_229 auth v3158 s=3 n(v0 rc2023-10-03T19:13:37.095186+0000 b3 1=1+0) (iversion lock) 0x55cf62104c00] 2023-10-03T19:20:55.419 INFO:teuthology.orchestra.run.smithi045.stdout: -2998> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002da [2,head] #100000002da auth v3158 s=3 n(v0 rc2023-10-03T19:13:37.095186+0000 b3 1=1+0) (iversion lock) 0x55cf62104c00] 2023-10-03T19:20:55.419 INFO:teuthology.orchestra.run.smithi045.stdout: -2997> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_229 [2,head] auth NULL (dversion lock) v=3158 ino=(nil) state=1073741824 0x55cf62108500] 2023-10-03T19:20:55.419 INFO:teuthology.orchestra.run.smithi045.stdout: -2996> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_228 [2,head] auth (dversion lock) v=3156 ino=0x100000002d9 state=1073741824 0x55cf62108280] 2023-10-03T19:20:55.419 INFO:teuthology.orchestra.run.smithi045.stdout: -2995> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.419 INFO:teuthology.orchestra.run.smithi045.stdout: -2994> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002d9 [2,head] /dc-dir/dc-file_228 auth v3156 s=3 n(v0 rc2023-10-03T19:13:37.082487+0000 b3 1=1+0) (iversion lock) 0x55cf62104680] 2023-10-03T19:20:55.419 INFO:teuthology.orchestra.run.smithi045.stdout: -2993> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_228 [2,head] auth (dversion lock) v=3156 ino=0x100000002d9 state=1073741824 0x55cf62108280] [inode 0x100000002d9 [2,head] /dc-dir/dc-file_228 auth v3156 s=3 n(v0 rc2023-10-03T19:13:37.082487+0000 b3 1=1+0) (iversion lock) 0x55cf62104680] 2023-10-03T19:20:55.419 INFO:teuthology.orchestra.run.smithi045.stdout: -2992> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002d9 [2,head] #100000002d9 auth v3156 s=3 n(v0 rc2023-10-03T19:13:37.082487+0000 b3 1=1+0) (iversion lock) 0x55cf62104680] 2023-10-03T19:20:55.419 INFO:teuthology.orchestra.run.smithi045.stdout: -2991> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_228 [2,head] auth NULL (dversion lock) v=3156 ino=(nil) state=1073741824 0x55cf62108280] 2023-10-03T19:20:55.419 INFO:teuthology.orchestra.run.smithi045.stdout: -2990> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_227 [2,head] auth (dversion lock) v=3154 ino=0x100000002d8 state=1073741824 0x55cf62108000] 2023-10-03T19:20:55.420 INFO:teuthology.orchestra.run.smithi045.stdout: -2989> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.420 INFO:teuthology.orchestra.run.smithi045.stdout: -2988> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002d8 [2,head] /dc-dir/dc-file_227 auth v3154 s=3 n(v0 rc2023-10-03T19:13:37.070616+0000 b3 1=1+0) (iversion lock) 0x55cf62104100] 2023-10-03T19:20:55.420 INFO:teuthology.orchestra.run.smithi045.stdout: -2987> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_227 [2,head] auth (dversion lock) v=3154 ino=0x100000002d8 state=1073741824 0x55cf62108000] [inode 0x100000002d8 [2,head] /dc-dir/dc-file_227 auth v3154 s=3 n(v0 rc2023-10-03T19:13:37.070616+0000 b3 1=1+0) (iversion lock) 0x55cf62104100] 2023-10-03T19:20:55.420 INFO:teuthology.orchestra.run.smithi045.stdout: -2986> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002d8 [2,head] #100000002d8 auth v3154 s=3 n(v0 rc2023-10-03T19:13:37.070616+0000 b3 1=1+0) (iversion lock) 0x55cf62104100] 2023-10-03T19:20:55.420 INFO:teuthology.orchestra.run.smithi045.stdout: -2985> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_227 [2,head] auth NULL (dversion lock) v=3154 ino=(nil) state=1073741824 0x55cf62108000] 2023-10-03T19:20:55.420 INFO:teuthology.orchestra.run.smithi045.stdout: -2984> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_226 [2,head] auth (dversion lock) v=3152 ino=0x100000002d7 state=1073741824 0x55cf620e9b80] 2023-10-03T19:20:55.420 INFO:teuthology.orchestra.run.smithi045.stdout: -2983> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.420 INFO:teuthology.orchestra.run.smithi045.stdout: -2982> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002d7 [2,head] /dc-dir/dc-file_226 auth v3152 s=3 n(v0 rc2023-10-03T19:13:37.058936+0000 b3 1=1+0) (iversion lock) 0x55cf62103b80] 2023-10-03T19:20:55.420 INFO:teuthology.orchestra.run.smithi045.stdout: -2981> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_226 [2,head] auth (dversion lock) v=3152 ino=0x100000002d7 state=1073741824 0x55cf620e9b80] [inode 0x100000002d7 [2,head] /dc-dir/dc-file_226 auth v3152 s=3 n(v0 rc2023-10-03T19:13:37.058936+0000 b3 1=1+0) (iversion lock) 0x55cf62103b80] 2023-10-03T19:20:55.420 INFO:teuthology.orchestra.run.smithi045.stdout: -2980> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002d7 [2,head] #100000002d7 auth v3152 s=3 n(v0 rc2023-10-03T19:13:37.058936+0000 b3 1=1+0) (iversion lock) 0x55cf62103b80] 2023-10-03T19:20:55.421 INFO:teuthology.orchestra.run.smithi045.stdout: -2979> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_226 [2,head] auth NULL (dversion lock) v=3152 ino=(nil) state=1073741824 0x55cf620e9b80] 2023-10-03T19:20:55.421 INFO:teuthology.orchestra.run.smithi045.stdout: -2978> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_225 [2,head] auth (dversion lock) v=3150 ino=0x100000002d6 state=1073741824 0x55cf620e9900] 2023-10-03T19:20:55.421 INFO:teuthology.orchestra.run.smithi045.stdout: -2977> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.421 INFO:teuthology.orchestra.run.smithi045.stdout: -2976> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002d6 [2,head] /dc-dir/dc-file_225 auth v3150 s=3 n(v0 rc2023-10-03T19:13:37.047501+0000 b3 1=1+0) (iversion lock) 0x55cf62103600] 2023-10-03T19:20:55.421 INFO:teuthology.orchestra.run.smithi045.stdout: -2975> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_225 [2,head] auth (dversion lock) v=3150 ino=0x100000002d6 state=1073741824 0x55cf620e9900] [inode 0x100000002d6 [2,head] /dc-dir/dc-file_225 auth v3150 s=3 n(v0 rc2023-10-03T19:13:37.047501+0000 b3 1=1+0) (iversion lock) 0x55cf62103600] 2023-10-03T19:20:55.421 INFO:teuthology.orchestra.run.smithi045.stdout: -2974> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002d6 [2,head] #100000002d6 auth v3150 s=3 n(v0 rc2023-10-03T19:13:37.047501+0000 b3 1=1+0) (iversion lock) 0x55cf62103600] 2023-10-03T19:20:55.421 INFO:teuthology.orchestra.run.smithi045.stdout: -2973> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_225 [2,head] auth NULL (dversion lock) v=3150 ino=(nil) state=1073741824 0x55cf620e9900] 2023-10-03T19:20:55.421 INFO:teuthology.orchestra.run.smithi045.stdout: -2972> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_224 [2,head] auth (dversion lock) v=3148 ino=0x100000002d5 state=1073741824 0x55cf620e9680] 2023-10-03T19:20:55.421 INFO:teuthology.orchestra.run.smithi045.stdout: -2971> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.421 INFO:teuthology.orchestra.run.smithi045.stdout: -2970> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002d5 [2,head] /dc-dir/dc-file_224 auth v3148 s=3 n(v0 rc2023-10-03T19:13:37.036150+0000 b3 1=1+0) (iversion lock) 0x55cf62103080] 2023-10-03T19:20:55.421 INFO:teuthology.orchestra.run.smithi045.stdout: -2969> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_224 [2,head] auth (dversion lock) v=3148 ino=0x100000002d5 state=1073741824 0x55cf620e9680] [inode 0x100000002d5 [2,head] /dc-dir/dc-file_224 auth v3148 s=3 n(v0 rc2023-10-03T19:13:37.036150+0000 b3 1=1+0) (iversion lock) 0x55cf62103080] 2023-10-03T19:20:55.421 INFO:teuthology.orchestra.run.smithi045.stdout: -2968> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002d5 [2,head] #100000002d5 auth v3148 s=3 n(v0 rc2023-10-03T19:13:37.036150+0000 b3 1=1+0) (iversion lock) 0x55cf62103080] 2023-10-03T19:20:55.422 INFO:teuthology.orchestra.run.smithi045.stdout: -2967> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_224 [2,head] auth NULL (dversion lock) v=3148 ino=(nil) state=1073741824 0x55cf620e9680] 2023-10-03T19:20:55.422 INFO:teuthology.orchestra.run.smithi045.stdout: -2966> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_223 [2,head] auth (dversion lock) v=3146 ino=0x100000002d4 state=1073741824 0x55cf620e9400] 2023-10-03T19:20:55.422 INFO:teuthology.orchestra.run.smithi045.stdout: -2965> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.422 INFO:teuthology.orchestra.run.smithi045.stdout: -2964> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002d4 [2,head] /dc-dir/dc-file_223 auth v3146 s=3 n(v0 rc2023-10-03T19:13:37.023908+0000 b3 1=1+0) (iversion lock) 0x55cf62102b00] 2023-10-03T19:20:55.422 INFO:teuthology.orchestra.run.smithi045.stdout: -2963> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_223 [2,head] auth (dversion lock) v=3146 ino=0x100000002d4 state=1073741824 0x55cf620e9400] [inode 0x100000002d4 [2,head] /dc-dir/dc-file_223 auth v3146 s=3 n(v0 rc2023-10-03T19:13:37.023908+0000 b3 1=1+0) (iversion lock) 0x55cf62102b00] 2023-10-03T19:20:55.422 INFO:teuthology.orchestra.run.smithi045.stdout: -2962> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002d4 [2,head] #100000002d4 auth v3146 s=3 n(v0 rc2023-10-03T19:13:37.023908+0000 b3 1=1+0) (iversion lock) 0x55cf62102b00] 2023-10-03T19:20:55.422 INFO:teuthology.orchestra.run.smithi045.stdout: -2961> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_223 [2,head] auth NULL (dversion lock) v=3146 ino=(nil) state=1073741824 0x55cf620e9400] 2023-10-03T19:20:55.422 INFO:teuthology.orchestra.run.smithi045.stdout: -2960> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_222 [2,head] auth (dversion lock) v=3144 ino=0x100000002d3 state=1073741824 0x55cf620e9180] 2023-10-03T19:20:55.422 INFO:teuthology.orchestra.run.smithi045.stdout: -2959> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.422 INFO:teuthology.orchestra.run.smithi045.stdout: -2958> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002d3 [2,head] /dc-dir/dc-file_222 auth v3144 s=3 n(v0 rc2023-10-03T19:13:37.011015+0000 b3 1=1+0) (iversion lock) 0x55cf62102580] 2023-10-03T19:20:55.423 INFO:teuthology.orchestra.run.smithi045.stdout: -2957> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_222 [2,head] auth (dversion lock) v=3144 ino=0x100000002d3 state=1073741824 0x55cf620e9180] [inode 0x100000002d3 [2,head] /dc-dir/dc-file_222 auth v3144 s=3 n(v0 rc2023-10-03T19:13:37.011015+0000 b3 1=1+0) (iversion lock) 0x55cf62102580] 2023-10-03T19:20:55.423 INFO:teuthology.orchestra.run.smithi045.stdout: -2956> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002d3 [2,head] #100000002d3 auth v3144 s=3 n(v0 rc2023-10-03T19:13:37.011015+0000 b3 1=1+0) (iversion lock) 0x55cf62102580] 2023-10-03T19:20:55.423 INFO:teuthology.orchestra.run.smithi045.stdout: -2955> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_222 [2,head] auth NULL (dversion lock) v=3144 ino=(nil) state=1073741824 0x55cf620e9180] 2023-10-03T19:20:55.423 INFO:teuthology.orchestra.run.smithi045.stdout: -2954> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_221 [2,head] auth (dversion lock) v=3142 ino=0x100000002d2 state=1073741824 0x55cf620e8f00] 2023-10-03T19:20:55.423 INFO:teuthology.orchestra.run.smithi045.stdout: -2953> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.423 INFO:teuthology.orchestra.run.smithi045.stdout: -2952> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002d2 [2,head] /dc-dir/dc-file_221 auth v3142 s=3 n(v0 rc2023-10-03T19:13:36.999813+0000 b3 1=1+0) (iversion lock) 0x55cf62102000] 2023-10-03T19:20:55.423 INFO:teuthology.orchestra.run.smithi045.stdout: -2951> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_221 [2,head] auth (dversion lock) v=3142 ino=0x100000002d2 state=1073741824 0x55cf620e8f00] [inode 0x100000002d2 [2,head] /dc-dir/dc-file_221 auth v3142 s=3 n(v0 rc2023-10-03T19:13:36.999813+0000 b3 1=1+0) (iversion lock) 0x55cf62102000] 2023-10-03T19:20:55.423 INFO:teuthology.orchestra.run.smithi045.stdout: -2950> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002d2 [2,head] #100000002d2 auth v3142 s=3 n(v0 rc2023-10-03T19:13:36.999813+0000 b3 1=1+0) (iversion lock) 0x55cf62102000] 2023-10-03T19:20:55.423 INFO:teuthology.orchestra.run.smithi045.stdout: -2949> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_221 [2,head] auth NULL (dversion lock) v=3142 ino=(nil) state=1073741824 0x55cf620e8f00] 2023-10-03T19:20:55.423 INFO:teuthology.orchestra.run.smithi045.stdout: -2948> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_220 [2,head] auth (dversion lock) v=3140 ino=0x100000002d1 state=1073741824 0x55cf620e8c80] 2023-10-03T19:20:55.423 INFO:teuthology.orchestra.run.smithi045.stdout: -2947> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.423 INFO:teuthology.orchestra.run.smithi045.stdout: -2946> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002d1 [2,head] /dc-dir/dc-file_220 auth v3140 s=3 n(v0 rc2023-10-03T19:13:36.988533+0000 b3 1=1+0) (iversion lock) 0x55cf620e5700] 2023-10-03T19:20:55.424 INFO:teuthology.orchestra.run.smithi045.stdout: -2945> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_220 [2,head] auth (dversion lock) v=3140 ino=0x100000002d1 state=1073741824 0x55cf620e8c80] [inode 0x100000002d1 [2,head] /dc-dir/dc-file_220 auth v3140 s=3 n(v0 rc2023-10-03T19:13:36.988533+0000 b3 1=1+0) (iversion lock) 0x55cf620e5700] 2023-10-03T19:20:55.424 INFO:teuthology.orchestra.run.smithi045.stdout: -2944> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002d1 [2,head] #100000002d1 auth v3140 s=3 n(v0 rc2023-10-03T19:13:36.988533+0000 b3 1=1+0) (iversion lock) 0x55cf620e5700] 2023-10-03T19:20:55.424 INFO:teuthology.orchestra.run.smithi045.stdout: -2943> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_220 [2,head] auth NULL (dversion lock) v=3140 ino=(nil) state=1073741824 0x55cf620e8c80] 2023-10-03T19:20:55.424 INFO:teuthology.orchestra.run.smithi045.stdout: -2942> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_219 [2,head] auth (dversion lock) v=3138 ino=0x100000002d0 state=1073741824 0x55cf620e8a00] 2023-10-03T19:20:55.424 INFO:teuthology.orchestra.run.smithi045.stdout: -2941> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.424 INFO:teuthology.orchestra.run.smithi045.stdout: -2940> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002d0 [2,head] /dc-dir/dc-file_219 auth v3138 s=3 n(v0 rc2023-10-03T19:13:36.976260+0000 b3 1=1+0) (iversion lock) 0x55cf620e5180] 2023-10-03T19:20:55.424 INFO:teuthology.orchestra.run.smithi045.stdout: -2939> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_219 [2,head] auth (dversion lock) v=3138 ino=0x100000002d0 state=1073741824 0x55cf620e8a00] [inode 0x100000002d0 [2,head] /dc-dir/dc-file_219 auth v3138 s=3 n(v0 rc2023-10-03T19:13:36.976260+0000 b3 1=1+0) (iversion lock) 0x55cf620e5180] 2023-10-03T19:20:55.424 INFO:teuthology.orchestra.run.smithi045.stdout: -2938> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002d0 [2,head] #100000002d0 auth v3138 s=3 n(v0 rc2023-10-03T19:13:36.976260+0000 b3 1=1+0) (iversion lock) 0x55cf620e5180] 2023-10-03T19:20:55.425 INFO:teuthology.orchestra.run.smithi045.stdout: -2937> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_219 [2,head] auth NULL (dversion lock) v=3138 ino=(nil) state=1073741824 0x55cf620e8a00] 2023-10-03T19:20:55.425 INFO:teuthology.orchestra.run.smithi045.stdout: -2936> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_218 [2,head] auth (dversion lock) v=3136 ino=0x100000002cf state=1073741824 0x55cf620e8780] 2023-10-03T19:20:55.425 INFO:teuthology.orchestra.run.smithi045.stdout: -2935> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.425 INFO:teuthology.orchestra.run.smithi045.stdout: -2934> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002cf [2,head] /dc-dir/dc-file_218 auth v3136 s=3 n(v0 rc2023-10-03T19:13:36.964132+0000 b3 1=1+0) (iversion lock) 0x55cf620e4c00] 2023-10-03T19:20:55.425 INFO:teuthology.orchestra.run.smithi045.stdout: -2933> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_218 [2,head] auth (dversion lock) v=3136 ino=0x100000002cf state=1073741824 0x55cf620e8780] [inode 0x100000002cf [2,head] /dc-dir/dc-file_218 auth v3136 s=3 n(v0 rc2023-10-03T19:13:36.964132+0000 b3 1=1+0) (iversion lock) 0x55cf620e4c00] 2023-10-03T19:20:55.425 INFO:teuthology.orchestra.run.smithi045.stdout: -2932> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002cf [2,head] #100000002cf auth v3136 s=3 n(v0 rc2023-10-03T19:13:36.964132+0000 b3 1=1+0) (iversion lock) 0x55cf620e4c00] 2023-10-03T19:20:55.425 INFO:teuthology.orchestra.run.smithi045.stdout: -2931> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_218 [2,head] auth NULL (dversion lock) v=3136 ino=(nil) state=1073741824 0x55cf620e8780] 2023-10-03T19:20:55.425 INFO:teuthology.orchestra.run.smithi045.stdout: -2930> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_217 [2,head] auth (dversion lock) v=3134 ino=0x100000002ce state=1073741824 0x55cf620e8500] 2023-10-03T19:20:55.425 INFO:teuthology.orchestra.run.smithi045.stdout: -2929> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.426 INFO:teuthology.orchestra.run.smithi045.stdout: -2928> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002ce [2,head] /dc-dir/dc-file_217 auth v3134 s=3 n(v0 rc2023-10-03T19:13:36.952186+0000 b3 1=1+0) (iversion lock) 0x55cf620e4680] 2023-10-03T19:20:55.426 INFO:teuthology.orchestra.run.smithi045.stdout: -2927> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_217 [2,head] auth (dversion lock) v=3134 ino=0x100000002ce state=1073741824 0x55cf620e8500] [inode 0x100000002ce [2,head] /dc-dir/dc-file_217 auth v3134 s=3 n(v0 rc2023-10-03T19:13:36.952186+0000 b3 1=1+0) (iversion lock) 0x55cf620e4680] 2023-10-03T19:20:55.426 INFO:teuthology.orchestra.run.smithi045.stdout: -2926> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002ce [2,head] #100000002ce auth v3134 s=3 n(v0 rc2023-10-03T19:13:36.952186+0000 b3 1=1+0) (iversion lock) 0x55cf620e4680] 2023-10-03T19:20:55.426 INFO:teuthology.orchestra.run.smithi045.stdout: -2925> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_217 [2,head] auth NULL (dversion lock) v=3134 ino=(nil) state=1073741824 0x55cf620e8500] 2023-10-03T19:20:55.426 INFO:teuthology.orchestra.run.smithi045.stdout: -2924> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_216 [2,head] auth (dversion lock) v=3132 ino=0x100000002cd state=1073741824 0x55cf620e8280] 2023-10-03T19:20:55.426 INFO:teuthology.orchestra.run.smithi045.stdout: -2923> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.426 INFO:teuthology.orchestra.run.smithi045.stdout: -2922> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002cd [2,head] /dc-dir/dc-file_216 auth v3132 s=3 n(v0 rc2023-10-03T19:13:36.939744+0000 b3 1=1+0) (iversion lock) 0x55cf620e4100] 2023-10-03T19:20:55.426 INFO:teuthology.orchestra.run.smithi045.stdout: -2921> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_216 [2,head] auth (dversion lock) v=3132 ino=0x100000002cd state=1073741824 0x55cf620e8280] [inode 0x100000002cd [2,head] /dc-dir/dc-file_216 auth v3132 s=3 n(v0 rc2023-10-03T19:13:36.939744+0000 b3 1=1+0) (iversion lock) 0x55cf620e4100] 2023-10-03T19:20:55.426 INFO:teuthology.orchestra.run.smithi045.stdout: -2920> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002cd [2,head] #100000002cd auth v3132 s=3 n(v0 rc2023-10-03T19:13:36.939744+0000 b3 1=1+0) (iversion lock) 0x55cf620e4100] 2023-10-03T19:20:55.426 INFO:teuthology.orchestra.run.smithi045.stdout: -2919> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_216 [2,head] auth NULL (dversion lock) v=3132 ino=(nil) state=1073741824 0x55cf620e8280] 2023-10-03T19:20:55.426 INFO:teuthology.orchestra.run.smithi045.stdout: -2918> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_215 [2,head] auth (dversion lock) v=3130 ino=0x100000002cc state=1073741824 0x55cf620e8000] 2023-10-03T19:20:55.427 INFO:teuthology.orchestra.run.smithi045.stdout: -2917> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.427 INFO:teuthology.orchestra.run.smithi045.stdout: -2916> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002cc [2,head] /dc-dir/dc-file_215 auth v3130 s=3 n(v0 rc2023-10-03T19:13:36.927072+0000 b3 1=1+0) (iversion lock) 0x55cf620e3b80] 2023-10-03T19:20:55.427 INFO:teuthology.orchestra.run.smithi045.stdout: -2915> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_215 [2,head] auth (dversion lock) v=3130 ino=0x100000002cc state=1073741824 0x55cf620e8000] [inode 0x100000002cc [2,head] /dc-dir/dc-file_215 auth v3130 s=3 n(v0 rc2023-10-03T19:13:36.927072+0000 b3 1=1+0) (iversion lock) 0x55cf620e3b80] 2023-10-03T19:20:55.427 INFO:teuthology.orchestra.run.smithi045.stdout: -2914> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002cc [2,head] #100000002cc auth v3130 s=3 n(v0 rc2023-10-03T19:13:36.927072+0000 b3 1=1+0) (iversion lock) 0x55cf620e3b80] 2023-10-03T19:20:55.427 INFO:teuthology.orchestra.run.smithi045.stdout: -2913> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_215 [2,head] auth NULL (dversion lock) v=3130 ino=(nil) state=1073741824 0x55cf620e8000] 2023-10-03T19:20:55.427 INFO:teuthology.orchestra.run.smithi045.stdout: -2912> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_214 [2,head] auth (dversion lock) v=3128 ino=0x100000002cb state=1073741824 0x55cf620e1b80] 2023-10-03T19:20:55.427 INFO:teuthology.orchestra.run.smithi045.stdout: -2911> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.427 INFO:teuthology.orchestra.run.smithi045.stdout: -2910> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002cb [2,head] /dc-dir/dc-file_214 auth v3128 s=3 n(v0 rc2023-10-03T19:13:36.914475+0000 b3 1=1+0) (iversion lock) 0x55cf620e3600] 2023-10-03T19:20:55.427 INFO:teuthology.orchestra.run.smithi045.stdout: -2909> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_214 [2,head] auth (dversion lock) v=3128 ino=0x100000002cb state=1073741824 0x55cf620e1b80] [inode 0x100000002cb [2,head] /dc-dir/dc-file_214 auth v3128 s=3 n(v0 rc2023-10-03T19:13:36.914475+0000 b3 1=1+0) (iversion lock) 0x55cf620e3600] 2023-10-03T19:20:55.427 INFO:teuthology.orchestra.run.smithi045.stdout: -2908> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002cb [2,head] #100000002cb auth v3128 s=3 n(v0 rc2023-10-03T19:13:36.914475+0000 b3 1=1+0) (iversion lock) 0x55cf620e3600] 2023-10-03T19:20:55.427 INFO:teuthology.orchestra.run.smithi045.stdout: -2907> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_214 [2,head] auth NULL (dversion lock) v=3128 ino=(nil) state=1073741824 0x55cf620e1b80] 2023-10-03T19:20:55.427 INFO:teuthology.orchestra.run.smithi045.stdout: -2906> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_213 [2,head] auth (dversion lock) v=3126 ino=0x100000002ca state=1073741824 0x55cf620e1900] 2023-10-03T19:20:55.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2905> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2904> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002ca [2,head] /dc-dir/dc-file_213 auth v3126 s=3 n(v0 rc2023-10-03T19:13:36.901863+0000 b3 1=1+0) (iversion lock) 0x55cf620e3080] 2023-10-03T19:20:55.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2903> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_213 [2,head] auth (dversion lock) v=3126 ino=0x100000002ca state=1073741824 0x55cf620e1900] [inode 0x100000002ca [2,head] /dc-dir/dc-file_213 auth v3126 s=3 n(v0 rc2023-10-03T19:13:36.901863+0000 b3 1=1+0) (iversion lock) 0x55cf620e3080] 2023-10-03T19:20:55.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2902> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002ca [2,head] #100000002ca auth v3126 s=3 n(v0 rc2023-10-03T19:13:36.901863+0000 b3 1=1+0) (iversion lock) 0x55cf620e3080] 2023-10-03T19:20:55.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2901> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_213 [2,head] auth NULL (dversion lock) v=3126 ino=(nil) state=1073741824 0x55cf620e1900] 2023-10-03T19:20:55.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2900> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_212 [2,head] auth (dversion lock) v=3124 ino=0x100000002c9 state=1073741824 0x55cf620e1680] 2023-10-03T19:20:55.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2899> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2898> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002c9 [2,head] /dc-dir/dc-file_212 auth v3124 s=3 n(v0 rc2023-10-03T19:13:36.888773+0000 b3 1=1+0) (iversion lock) 0x55cf620e2b00] 2023-10-03T19:20:55.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2897> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_212 [2,head] auth (dversion lock) v=3124 ino=0x100000002c9 state=1073741824 0x55cf620e1680] [inode 0x100000002c9 [2,head] /dc-dir/dc-file_212 auth v3124 s=3 n(v0 rc2023-10-03T19:13:36.888773+0000 b3 1=1+0) (iversion lock) 0x55cf620e2b00] 2023-10-03T19:20:55.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2896> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002c9 [2,head] #100000002c9 auth v3124 s=3 n(v0 rc2023-10-03T19:13:36.888773+0000 b3 1=1+0) (iversion lock) 0x55cf620e2b00] 2023-10-03T19:20:55.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2895> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_212 [2,head] auth NULL (dversion lock) v=3124 ino=(nil) state=1073741824 0x55cf620e1680] 2023-10-03T19:20:55.429 INFO:teuthology.orchestra.run.smithi045.stdout: -2894> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_211 [2,head] auth (dversion lock) v=3122 ino=0x100000002c8 state=1073741824 0x55cf620e1400] 2023-10-03T19:20:55.429 INFO:teuthology.orchestra.run.smithi045.stdout: -2893> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.429 INFO:teuthology.orchestra.run.smithi045.stdout: -2892> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002c8 [2,head] /dc-dir/dc-file_211 auth v3122 s=3 n(v0 rc2023-10-03T19:13:36.875534+0000 b3 1=1+0) (iversion lock) 0x55cf620e2580] 2023-10-03T19:20:55.429 INFO:teuthology.orchestra.run.smithi045.stdout: -2891> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_211 [2,head] auth (dversion lock) v=3122 ino=0x100000002c8 state=1073741824 0x55cf620e1400] [inode 0x100000002c8 [2,head] /dc-dir/dc-file_211 auth v3122 s=3 n(v0 rc2023-10-03T19:13:36.875534+0000 b3 1=1+0) (iversion lock) 0x55cf620e2580] 2023-10-03T19:20:55.429 INFO:teuthology.orchestra.run.smithi045.stdout: -2890> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002c8 [2,head] #100000002c8 auth v3122 s=3 n(v0 rc2023-10-03T19:13:36.875534+0000 b3 1=1+0) (iversion lock) 0x55cf620e2580] 2023-10-03T19:20:55.429 INFO:teuthology.orchestra.run.smithi045.stdout: -2889> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_211 [2,head] auth NULL (dversion lock) v=3122 ino=(nil) state=1073741824 0x55cf620e1400] 2023-10-03T19:20:55.429 INFO:teuthology.orchestra.run.smithi045.stdout: -2888> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_210 [2,head] auth (dversion lock) v=3120 ino=0x100000002c7 state=1073741824 0x55cf620e1180] 2023-10-03T19:20:55.429 INFO:teuthology.orchestra.run.smithi045.stdout: -2887> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.429 INFO:teuthology.orchestra.run.smithi045.stdout: -2886> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002c7 [2,head] /dc-dir/dc-file_210 auth v3120 s=3 n(v0 rc2023-10-03T19:13:36.864540+0000 b3 1=1+0) (iversion lock) 0x55cf620e2000] 2023-10-03T19:20:55.429 INFO:teuthology.orchestra.run.smithi045.stdout: -2885> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_210 [2,head] auth (dversion lock) v=3120 ino=0x100000002c7 state=1073741824 0x55cf620e1180] [inode 0x100000002c7 [2,head] /dc-dir/dc-file_210 auth v3120 s=3 n(v0 rc2023-10-03T19:13:36.864540+0000 b3 1=1+0) (iversion lock) 0x55cf620e2000] 2023-10-03T19:20:55.429 INFO:teuthology.orchestra.run.smithi045.stdout: -2884> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002c7 [2,head] #100000002c7 auth v3120 s=3 n(v0 rc2023-10-03T19:13:36.864540+0000 b3 1=1+0) (iversion lock) 0x55cf620e2000] 2023-10-03T19:20:55.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2883> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_210 [2,head] auth NULL (dversion lock) v=3120 ino=(nil) state=1073741824 0x55cf620e1180] 2023-10-03T19:20:55.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2882> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_209 [2,head] auth (dversion lock) v=3118 ino=0x100000002c6 state=1073741824 0x55cf620e0f00] 2023-10-03T19:20:55.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2881> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2880> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002c6 [2,head] /dc-dir/dc-file_209 auth v3118 s=3 n(v0 rc2023-10-03T19:13:36.853324+0000 b3 1=1+0) (iversion lock) 0x55cf620db700] 2023-10-03T19:20:55.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2879> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_209 [2,head] auth (dversion lock) v=3118 ino=0x100000002c6 state=1073741824 0x55cf620e0f00] [inode 0x100000002c6 [2,head] /dc-dir/dc-file_209 auth v3118 s=3 n(v0 rc2023-10-03T19:13:36.853324+0000 b3 1=1+0) (iversion lock) 0x55cf620db700] 2023-10-03T19:20:55.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2878> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002c6 [2,head] #100000002c6 auth v3118 s=3 n(v0 rc2023-10-03T19:13:36.853324+0000 b3 1=1+0) (iversion lock) 0x55cf620db700] 2023-10-03T19:20:55.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2877> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_209 [2,head] auth NULL (dversion lock) v=3118 ino=(nil) state=1073741824 0x55cf620e0f00] 2023-10-03T19:20:55.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2876> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_208 [2,head] auth (dversion lock) v=3116 ino=0x100000002c5 state=1073741824 0x55cf620e0c80] 2023-10-03T19:20:55.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2875> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2874> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002c5 [2,head] /dc-dir/dc-file_208 auth v3116 s=3 n(v0 rc2023-10-03T19:13:36.840646+0000 b3 1=1+0) (iversion lock) 0x55cf620db180] 2023-10-03T19:20:55.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2873> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_208 [2,head] auth (dversion lock) v=3116 ino=0x100000002c5 state=1073741824 0x55cf620e0c80] [inode 0x100000002c5 [2,head] /dc-dir/dc-file_208 auth v3116 s=3 n(v0 rc2023-10-03T19:13:36.840646+0000 b3 1=1+0) (iversion lock) 0x55cf620db180] 2023-10-03T19:20:55.431 INFO:teuthology.orchestra.run.smithi045.stdout: -2872> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002c5 [2,head] #100000002c5 auth v3116 s=3 n(v0 rc2023-10-03T19:13:36.840646+0000 b3 1=1+0) (iversion lock) 0x55cf620db180] 2023-10-03T19:20:55.431 INFO:teuthology.orchestra.run.smithi045.stdout: -2871> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_208 [2,head] auth NULL (dversion lock) v=3116 ino=(nil) state=1073741824 0x55cf620e0c80] 2023-10-03T19:20:55.431 INFO:teuthology.orchestra.run.smithi045.stdout: -2870> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_207 [2,head] auth (dversion lock) v=3114 ino=0x100000002c4 state=1073741824 0x55cf620e0a00] 2023-10-03T19:20:55.431 INFO:teuthology.orchestra.run.smithi045.stdout: -2869> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.431 INFO:teuthology.orchestra.run.smithi045.stdout: -2868> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002c4 [2,head] /dc-dir/dc-file_207 auth v3114 s=3 n(v0 rc2023-10-03T19:13:36.829909+0000 b3 1=1+0) (iversion lock) 0x55cf620dac00] 2023-10-03T19:20:55.431 INFO:teuthology.orchestra.run.smithi045.stdout: -2867> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_207 [2,head] auth (dversion lock) v=3114 ino=0x100000002c4 state=1073741824 0x55cf620e0a00] [inode 0x100000002c4 [2,head] /dc-dir/dc-file_207 auth v3114 s=3 n(v0 rc2023-10-03T19:13:36.829909+0000 b3 1=1+0) (iversion lock) 0x55cf620dac00] 2023-10-03T19:20:55.431 INFO:teuthology.orchestra.run.smithi045.stdout: -2866> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002c4 [2,head] #100000002c4 auth v3114 s=3 n(v0 rc2023-10-03T19:13:36.829909+0000 b3 1=1+0) (iversion lock) 0x55cf620dac00] 2023-10-03T19:20:55.431 INFO:teuthology.orchestra.run.smithi045.stdout: -2865> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_207 [2,head] auth NULL (dversion lock) v=3114 ino=(nil) state=1073741824 0x55cf620e0a00] 2023-10-03T19:20:55.431 INFO:teuthology.orchestra.run.smithi045.stdout: -2864> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_206 [2,head] auth (dversion lock) v=3112 ino=0x100000002c3 state=1073741824 0x55cf620e0780] 2023-10-03T19:20:55.495 INFO:teuthology.orchestra.run.smithi045.stdout: -2863> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.495 INFO:teuthology.orchestra.run.smithi045.stdout: -2862> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002c3 [2,head] /dc-dir/dc-file_206 auth v3112 s=3 n(v0 rc2023-10-03T19:13:36.818430+0000 b3 1=1+0) (iversion lock) 0x55cf620da680] 2023-10-03T19:20:55.496 INFO:teuthology.orchestra.run.smithi045.stdout: -2861> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_206 [2,head] auth (dversion lock) v=3112 ino=0x100000002c3 state=1073741824 0x55cf620e0780] [inode 0x100000002c3 [2,head] /dc-dir/dc-file_206 auth v3112 s=3 n(v0 rc2023-10-03T19:13:36.818430+0000 b3 1=1+0) (iversion lock) 0x55cf620da680] 2023-10-03T19:20:55.496 INFO:teuthology.orchestra.run.smithi045.stdout: -2860> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002c3 [2,head] #100000002c3 auth v3112 s=3 n(v0 rc2023-10-03T19:13:36.818430+0000 b3 1=1+0) (iversion lock) 0x55cf620da680] 2023-10-03T19:20:55.496 INFO:teuthology.orchestra.run.smithi045.stdout: -2859> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_206 [2,head] auth NULL (dversion lock) v=3112 ino=(nil) state=1073741824 0x55cf620e0780] 2023-10-03T19:20:55.496 INFO:teuthology.orchestra.run.smithi045.stdout: -2858> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_205 [2,head] auth (dversion lock) v=3110 ino=0x100000002c2 state=1073741824 0x55cf620e0500] 2023-10-03T19:20:55.496 INFO:teuthology.orchestra.run.smithi045.stdout: -2857> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.496 INFO:teuthology.orchestra.run.smithi045.stdout: -2856> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002c2 [2,head] /dc-dir/dc-file_205 auth v3110 s=3 n(v0 rc2023-10-03T19:13:36.807157+0000 b3 1=1+0) (iversion lock) 0x55cf620da100] 2023-10-03T19:20:55.496 INFO:teuthology.orchestra.run.smithi045.stdout: -2855> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_205 [2,head] auth (dversion lock) v=3110 ino=0x100000002c2 state=1073741824 0x55cf620e0500] [inode 0x100000002c2 [2,head] /dc-dir/dc-file_205 auth v3110 s=3 n(v0 rc2023-10-03T19:13:36.807157+0000 b3 1=1+0) (iversion lock) 0x55cf620da100] 2023-10-03T19:20:55.496 INFO:teuthology.orchestra.run.smithi045.stdout: -2854> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002c2 [2,head] #100000002c2 auth v3110 s=3 n(v0 rc2023-10-03T19:13:36.807157+0000 b3 1=1+0) (iversion lock) 0x55cf620da100] 2023-10-03T19:20:55.496 INFO:teuthology.orchestra.run.smithi045.stdout: -2853> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_205 [2,head] auth NULL (dversion lock) v=3110 ino=(nil) state=1073741824 0x55cf620e0500] 2023-10-03T19:20:55.496 INFO:teuthology.orchestra.run.smithi045.stdout: -2852> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_204 [2,head] auth (dversion lock) v=3108 ino=0x100000002c1 state=1073741824 0x55cf620e0280] 2023-10-03T19:20:55.496 INFO:teuthology.orchestra.run.smithi045.stdout: -2851> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.497 INFO:teuthology.orchestra.run.smithi045.stdout: -2850> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002c1 [2,head] /dc-dir/dc-file_204 auth v3108 s=3 n(v0 rc2023-10-03T19:13:36.794296+0000 b3 1=1+0) (iversion lock) 0x55cf620d9b80] 2023-10-03T19:20:55.497 INFO:teuthology.orchestra.run.smithi045.stdout: -2849> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_204 [2,head] auth (dversion lock) v=3108 ino=0x100000002c1 state=1073741824 0x55cf620e0280] [inode 0x100000002c1 [2,head] /dc-dir/dc-file_204 auth v3108 s=3 n(v0 rc2023-10-03T19:13:36.794296+0000 b3 1=1+0) (iversion lock) 0x55cf620d9b80] 2023-10-03T19:20:55.497 INFO:teuthology.orchestra.run.smithi045.stdout: -2848> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002c1 [2,head] #100000002c1 auth v3108 s=3 n(v0 rc2023-10-03T19:13:36.794296+0000 b3 1=1+0) (iversion lock) 0x55cf620d9b80] 2023-10-03T19:20:55.497 INFO:teuthology.orchestra.run.smithi045.stdout: -2847> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_204 [2,head] auth NULL (dversion lock) v=3108 ino=(nil) state=1073741824 0x55cf620e0280] 2023-10-03T19:20:55.497 INFO:teuthology.orchestra.run.smithi045.stdout: -2846> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_203 [2,head] auth (dversion lock) v=3106 ino=0x100000002c0 state=1073741824 0x55cf620e0000] 2023-10-03T19:20:55.497 INFO:teuthology.orchestra.run.smithi045.stdout: -2845> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.497 INFO:teuthology.orchestra.run.smithi045.stdout: -2844> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002c0 [2,head] /dc-dir/dc-file_203 auth v3106 s=3 n(v0 rc2023-10-03T19:13:36.781590+0000 b3 1=1+0) (iversion lock) 0x55cf620d9600] 2023-10-03T19:20:55.497 INFO:teuthology.orchestra.run.smithi045.stdout: -2843> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_203 [2,head] auth (dversion lock) v=3106 ino=0x100000002c0 state=1073741824 0x55cf620e0000] [inode 0x100000002c0 [2,head] /dc-dir/dc-file_203 auth v3106 s=3 n(v0 rc2023-10-03T19:13:36.781590+0000 b3 1=1+0) (iversion lock) 0x55cf620d9600] 2023-10-03T19:20:55.497 INFO:teuthology.orchestra.run.smithi045.stdout: -2842> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002c0 [2,head] #100000002c0 auth v3106 s=3 n(v0 rc2023-10-03T19:13:36.781590+0000 b3 1=1+0) (iversion lock) 0x55cf620d9600] 2023-10-03T19:20:55.497 INFO:teuthology.orchestra.run.smithi045.stdout: -2841> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_203 [2,head] auth NULL (dversion lock) v=3106 ino=(nil) state=1073741824 0x55cf620e0000] 2023-10-03T19:20:55.497 INFO:teuthology.orchestra.run.smithi045.stdout: -2840> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_202 [2,head] auth (dversion lock) v=3104 ino=0x100000002bf state=1073741824 0x55cf620d1b80] 2023-10-03T19:20:55.497 INFO:teuthology.orchestra.run.smithi045.stdout: -2839> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.498 INFO:teuthology.orchestra.run.smithi045.stdout: -2838> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002bf [2,head] /dc-dir/dc-file_202 auth v3104 s=3 n(v0 rc2023-10-03T19:13:36.768413+0000 b3 1=1+0) (iversion lock) 0x55cf620d9080] 2023-10-03T19:20:55.498 INFO:teuthology.orchestra.run.smithi045.stdout: -2837> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_202 [2,head] auth (dversion lock) v=3104 ino=0x100000002bf state=1073741824 0x55cf620d1b80] [inode 0x100000002bf [2,head] /dc-dir/dc-file_202 auth v3104 s=3 n(v0 rc2023-10-03T19:13:36.768413+0000 b3 1=1+0) (iversion lock) 0x55cf620d9080] 2023-10-03T19:20:55.498 INFO:teuthology.orchestra.run.smithi045.stdout: -2836> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002bf [2,head] #100000002bf auth v3104 s=3 n(v0 rc2023-10-03T19:13:36.768413+0000 b3 1=1+0) (iversion lock) 0x55cf620d9080] 2023-10-03T19:20:55.498 INFO:teuthology.orchestra.run.smithi045.stdout: -2835> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_202 [2,head] auth NULL (dversion lock) v=3104 ino=(nil) state=1073741824 0x55cf620d1b80] 2023-10-03T19:20:55.498 INFO:teuthology.orchestra.run.smithi045.stdout: -2834> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_201 [2,head] auth (dversion lock) v=3102 ino=0x100000002be state=1073741824 0x55cf620d1900] 2023-10-03T19:20:55.498 INFO:teuthology.orchestra.run.smithi045.stdout: -2833> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.498 INFO:teuthology.orchestra.run.smithi045.stdout: -2832> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002be [2,head] /dc-dir/dc-file_201 auth v3102 s=3 n(v0 rc2023-10-03T19:13:36.756148+0000 b3 1=1+0) (iversion lock) 0x55cf620d8b00] 2023-10-03T19:20:55.498 INFO:teuthology.orchestra.run.smithi045.stdout: -2831> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_201 [2,head] auth (dversion lock) v=3102 ino=0x100000002be state=1073741824 0x55cf620d1900] [inode 0x100000002be [2,head] /dc-dir/dc-file_201 auth v3102 s=3 n(v0 rc2023-10-03T19:13:36.756148+0000 b3 1=1+0) (iversion lock) 0x55cf620d8b00] 2023-10-03T19:20:55.498 INFO:teuthology.orchestra.run.smithi045.stdout: -2830> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002be [2,head] #100000002be auth v3102 s=3 n(v0 rc2023-10-03T19:13:36.756148+0000 b3 1=1+0) (iversion lock) 0x55cf620d8b00] 2023-10-03T19:20:55.498 INFO:teuthology.orchestra.run.smithi045.stdout: -2829> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_201 [2,head] auth NULL (dversion lock) v=3102 ino=(nil) state=1073741824 0x55cf620d1900] 2023-10-03T19:20:55.498 INFO:teuthology.orchestra.run.smithi045.stdout: -2828> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_200 [2,head] auth (dversion lock) v=3100 ino=0x100000002bd state=1073741824 0x55cf620d1680] 2023-10-03T19:20:55.499 INFO:teuthology.orchestra.run.smithi045.stdout: -2827> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.499 INFO:teuthology.orchestra.run.smithi045.stdout: -2826> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002bd [2,head] /dc-dir/dc-file_200 auth v3100 s=3 n(v0 rc2023-10-03T19:13:36.744625+0000 b3 1=1+0) (iversion lock) 0x55cf620d8580] 2023-10-03T19:20:55.499 INFO:teuthology.orchestra.run.smithi045.stdout: -2825> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_200 [2,head] auth (dversion lock) v=3100 ino=0x100000002bd state=1073741824 0x55cf620d1680] [inode 0x100000002bd [2,head] /dc-dir/dc-file_200 auth v3100 s=3 n(v0 rc2023-10-03T19:13:36.744625+0000 b3 1=1+0) (iversion lock) 0x55cf620d8580] 2023-10-03T19:20:55.499 INFO:teuthology.orchestra.run.smithi045.stdout: -2824> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002bd [2,head] #100000002bd auth v3100 s=3 n(v0 rc2023-10-03T19:13:36.744625+0000 b3 1=1+0) (iversion lock) 0x55cf620d8580] 2023-10-03T19:20:55.499 INFO:teuthology.orchestra.run.smithi045.stdout: -2823> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_200 [2,head] auth NULL (dversion lock) v=3100 ino=(nil) state=1073741824 0x55cf620d1680] 2023-10-03T19:20:55.499 INFO:teuthology.orchestra.run.smithi045.stdout: -2822> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_199 [2,head] auth (dversion lock) v=3098 ino=0x100000002bc state=1073741824 0x55cf620d1400] 2023-10-03T19:20:55.499 INFO:teuthology.orchestra.run.smithi045.stdout: -2821> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.499 INFO:teuthology.orchestra.run.smithi045.stdout: -2820> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002bc [2,head] /dc-dir/dc-file_199 auth v3098 s=3 n(v0 rc2023-10-03T19:13:36.733214+0000 b3 1=1+0) (iversion lock) 0x55cf620d8000] 2023-10-03T19:20:55.499 INFO:teuthology.orchestra.run.smithi045.stdout: -2819> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_199 [2,head] auth (dversion lock) v=3098 ino=0x100000002bc state=1073741824 0x55cf620d1400] [inode 0x100000002bc [2,head] /dc-dir/dc-file_199 auth v3098 s=3 n(v0 rc2023-10-03T19:13:36.733214+0000 b3 1=1+0) (iversion lock) 0x55cf620d8000] 2023-10-03T19:20:55.499 INFO:teuthology.orchestra.run.smithi045.stdout: -2818> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002bc [2,head] #100000002bc auth v3098 s=3 n(v0 rc2023-10-03T19:13:36.733214+0000 b3 1=1+0) (iversion lock) 0x55cf620d8000] 2023-10-03T19:20:55.499 INFO:teuthology.orchestra.run.smithi045.stdout: -2817> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_199 [2,head] auth NULL (dversion lock) v=3098 ino=(nil) state=1073741824 0x55cf620d1400] 2023-10-03T19:20:55.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2816> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_198 [2,head] auth (dversion lock) v=3096 ino=0x100000002bb state=1073741824 0x55cf620d1180] 2023-10-03T19:20:55.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2815> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2814> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002bb [2,head] /dc-dir/dc-file_198 auth v3096 s=3 n(v0 rc2023-10-03T19:13:36.721288+0000 b3 1=1+0) (iversion lock) 0x55cf620cf700] 2023-10-03T19:20:55.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2813> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_198 [2,head] auth (dversion lock) v=3096 ino=0x100000002bb state=1073741824 0x55cf620d1180] [inode 0x100000002bb [2,head] /dc-dir/dc-file_198 auth v3096 s=3 n(v0 rc2023-10-03T19:13:36.721288+0000 b3 1=1+0) (iversion lock) 0x55cf620cf700] 2023-10-03T19:20:55.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2812> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002bb [2,head] #100000002bb auth v3096 s=3 n(v0 rc2023-10-03T19:13:36.721288+0000 b3 1=1+0) (iversion lock) 0x55cf620cf700] 2023-10-03T19:20:55.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2811> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_198 [2,head] auth NULL (dversion lock) v=3096 ino=(nil) state=1073741824 0x55cf620d1180] 2023-10-03T19:20:55.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2810> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_197 [2,head] auth (dversion lock) v=3094 ino=0x100000002ba state=1073741824 0x55cf620d0f00] 2023-10-03T19:20:55.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2809> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2808> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002ba [2,head] /dc-dir/dc-file_197 auth v3094 s=3 n(v0 rc2023-10-03T19:13:36.709877+0000 b3 1=1+0) (iversion lock) 0x55cf620cf180] 2023-10-03T19:20:55.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2807> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_197 [2,head] auth (dversion lock) v=3094 ino=0x100000002ba state=1073741824 0x55cf620d0f00] [inode 0x100000002ba [2,head] /dc-dir/dc-file_197 auth v3094 s=3 n(v0 rc2023-10-03T19:13:36.709877+0000 b3 1=1+0) (iversion lock) 0x55cf620cf180] 2023-10-03T19:20:55.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2806> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002ba [2,head] #100000002ba auth v3094 s=3 n(v0 rc2023-10-03T19:13:36.709877+0000 b3 1=1+0) (iversion lock) 0x55cf620cf180] 2023-10-03T19:20:55.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2805> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_197 [2,head] auth NULL (dversion lock) v=3094 ino=(nil) state=1073741824 0x55cf620d0f00] 2023-10-03T19:20:55.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2804> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_196 [2,head] auth (dversion lock) v=3092 ino=0x100000002b9 state=1073741824 0x55cf620d0c80] 2023-10-03T19:20:55.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2803> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2802> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002b9 [2,head] /dc-dir/dc-file_196 auth v3092 s=3 n(v0 rc2023-10-03T19:13:36.698997+0000 b3 1=1+0) (iversion lock) 0x55cf620cec00] 2023-10-03T19:20:55.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2801> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_196 [2,head] auth (dversion lock) v=3092 ino=0x100000002b9 state=1073741824 0x55cf620d0c80] [inode 0x100000002b9 [2,head] /dc-dir/dc-file_196 auth v3092 s=3 n(v0 rc2023-10-03T19:13:36.698997+0000 b3 1=1+0) (iversion lock) 0x55cf620cec00] 2023-10-03T19:20:55.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2800> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002b9 [2,head] #100000002b9 auth v3092 s=3 n(v0 rc2023-10-03T19:13:36.698997+0000 b3 1=1+0) (iversion lock) 0x55cf620cec00] 2023-10-03T19:20:55.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2799> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_196 [2,head] auth NULL (dversion lock) v=3092 ino=(nil) state=1073741824 0x55cf620d0c80] 2023-10-03T19:20:55.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2798> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_195 [2,head] auth (dversion lock) v=3090 ino=0x100000002b8 state=1073741824 0x55cf620d0a00] 2023-10-03T19:20:55.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2797> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2796> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002b8 [2,head] /dc-dir/dc-file_195 auth v3090 s=3 n(v0 rc2023-10-03T19:13:36.686928+0000 b3 1=1+0) (iversion lock) 0x55cf620ce680] 2023-10-03T19:20:55.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2795> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_195 [2,head] auth (dversion lock) v=3090 ino=0x100000002b8 state=1073741824 0x55cf620d0a00] [inode 0x100000002b8 [2,head] /dc-dir/dc-file_195 auth v3090 s=3 n(v0 rc2023-10-03T19:13:36.686928+0000 b3 1=1+0) (iversion lock) 0x55cf620ce680] 2023-10-03T19:20:55.566 INFO:teuthology.orchestra.run.smithi045.stdout: -2794> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002b8 [2,head] #100000002b8 auth v3090 s=3 n(v0 rc2023-10-03T19:13:36.686928+0000 b3 1=1+0) (iversion lock) 0x55cf620ce680] 2023-10-03T19:20:55.566 INFO:teuthology.orchestra.run.smithi045.stdout: -2793> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_195 [2,head] auth NULL (dversion lock) v=3090 ino=(nil) state=1073741824 0x55cf620d0a00] 2023-10-03T19:20:55.566 INFO:teuthology.orchestra.run.smithi045.stdout: -2792> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_194 [2,head] auth (dversion lock) v=3088 ino=0x100000002b7 state=1073741824 0x55cf620d0780] 2023-10-03T19:20:55.566 INFO:teuthology.orchestra.run.smithi045.stdout: -2791> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.566 INFO:teuthology.orchestra.run.smithi045.stdout: -2790> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002b7 [2,head] /dc-dir/dc-file_194 auth v3088 s=3 n(v0 rc2023-10-03T19:13:36.675261+0000 b3 1=1+0) (iversion lock) 0x55cf620ce100] 2023-10-03T19:20:55.566 INFO:teuthology.orchestra.run.smithi045.stdout: -2789> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_194 [2,head] auth (dversion lock) v=3088 ino=0x100000002b7 state=1073741824 0x55cf620d0780] [inode 0x100000002b7 [2,head] /dc-dir/dc-file_194 auth v3088 s=3 n(v0 rc2023-10-03T19:13:36.675261+0000 b3 1=1+0) (iversion lock) 0x55cf620ce100] 2023-10-03T19:20:55.566 INFO:teuthology.orchestra.run.smithi045.stdout: -2788> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002b7 [2,head] #100000002b7 auth v3088 s=3 n(v0 rc2023-10-03T19:13:36.675261+0000 b3 1=1+0) (iversion lock) 0x55cf620ce100] 2023-10-03T19:20:55.567 INFO:teuthology.orchestra.run.smithi045.stdout: -2787> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_194 [2,head] auth NULL (dversion lock) v=3088 ino=(nil) state=1073741824 0x55cf620d0780] 2023-10-03T19:20:55.567 INFO:teuthology.orchestra.run.smithi045.stdout: -2786> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_193 [2,head] auth (dversion lock) v=3086 ino=0x100000002b6 state=1073741824 0x55cf620d0500] 2023-10-03T19:20:55.567 INFO:teuthology.orchestra.run.smithi045.stdout: -2785> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.567 INFO:teuthology.orchestra.run.smithi045.stdout: -2784> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002b6 [2,head] /dc-dir/dc-file_193 auth v3086 s=3 n(v0 rc2023-10-03T19:13:36.663707+0000 b3 1=1+0) (iversion lock) 0x55cf620cdb80] 2023-10-03T19:20:55.567 INFO:teuthology.orchestra.run.smithi045.stdout: -2783> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_193 [2,head] auth (dversion lock) v=3086 ino=0x100000002b6 state=1073741824 0x55cf620d0500] [inode 0x100000002b6 [2,head] /dc-dir/dc-file_193 auth v3086 s=3 n(v0 rc2023-10-03T19:13:36.663707+0000 b3 1=1+0) (iversion lock) 0x55cf620cdb80] 2023-10-03T19:20:55.567 INFO:teuthology.orchestra.run.smithi045.stdout: -2782> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002b6 [2,head] #100000002b6 auth v3086 s=3 n(v0 rc2023-10-03T19:13:36.663707+0000 b3 1=1+0) (iversion lock) 0x55cf620cdb80] 2023-10-03T19:20:55.567 INFO:teuthology.orchestra.run.smithi045.stdout: -2781> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_193 [2,head] auth NULL (dversion lock) v=3086 ino=(nil) state=1073741824 0x55cf620d0500] 2023-10-03T19:20:55.567 INFO:teuthology.orchestra.run.smithi045.stdout: -2780> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_192 [2,head] auth (dversion lock) v=3084 ino=0x100000002b5 state=1073741824 0x55cf620d0280] 2023-10-03T19:20:55.567 INFO:teuthology.orchestra.run.smithi045.stdout: -2779> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.567 INFO:teuthology.orchestra.run.smithi045.stdout: -2778> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002b5 [2,head] /dc-dir/dc-file_192 auth v3084 s=3 n(v0 rc2023-10-03T19:13:36.652545+0000 b3 1=1+0) (iversion lock) 0x55cf620cd600] 2023-10-03T19:20:55.568 INFO:teuthology.orchestra.run.smithi045.stdout: -2777> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_192 [2,head] auth (dversion lock) v=3084 ino=0x100000002b5 state=1073741824 0x55cf620d0280] [inode 0x100000002b5 [2,head] /dc-dir/dc-file_192 auth v3084 s=3 n(v0 rc2023-10-03T19:13:36.652545+0000 b3 1=1+0) (iversion lock) 0x55cf620cd600] 2023-10-03T19:20:55.568 INFO:teuthology.orchestra.run.smithi045.stdout: -2776> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002b5 [2,head] #100000002b5 auth v3084 s=3 n(v0 rc2023-10-03T19:13:36.652545+0000 b3 1=1+0) (iversion lock) 0x55cf620cd600] 2023-10-03T19:20:55.568 INFO:teuthology.orchestra.run.smithi045.stdout: -2775> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_192 [2,head] auth NULL (dversion lock) v=3084 ino=(nil) state=1073741824 0x55cf620d0280] 2023-10-03T19:20:55.568 INFO:teuthology.orchestra.run.smithi045.stdout: -2774> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_191 [2,head] auth (dversion lock) v=3082 ino=0x100000002b4 state=1073741824 0x55cf620d0000] 2023-10-03T19:20:55.568 INFO:teuthology.orchestra.run.smithi045.stdout: -2773> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.568 INFO:teuthology.orchestra.run.smithi045.stdout: -2772> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002b4 [2,head] /dc-dir/dc-file_191 auth v3082 s=3 n(v0 rc2023-10-03T19:13:36.638411+0000 b3 1=1+0) (iversion lock) 0x55cf620cd080] 2023-10-03T19:20:55.568 INFO:teuthology.orchestra.run.smithi045.stdout: -2771> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_191 [2,head] auth (dversion lock) v=3082 ino=0x100000002b4 state=1073741824 0x55cf620d0000] [inode 0x100000002b4 [2,head] /dc-dir/dc-file_191 auth v3082 s=3 n(v0 rc2023-10-03T19:13:36.638411+0000 b3 1=1+0) (iversion lock) 0x55cf620cd080] 2023-10-03T19:20:55.568 INFO:teuthology.orchestra.run.smithi045.stdout: -2770> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002b4 [2,head] #100000002b4 auth v3082 s=3 n(v0 rc2023-10-03T19:13:36.638411+0000 b3 1=1+0) (iversion lock) 0x55cf620cd080] 2023-10-03T19:20:55.568 INFO:teuthology.orchestra.run.smithi045.stdout: -2769> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_191 [2,head] auth NULL (dversion lock) v=3082 ino=(nil) state=1073741824 0x55cf620d0000] 2023-10-03T19:20:55.568 INFO:teuthology.orchestra.run.smithi045.stdout: -2768> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_190 [2,head] auth (dversion lock) v=3080 ino=0x100000002b3 state=1073741824 0x55cf61ec9b80] 2023-10-03T19:20:55.568 INFO:teuthology.orchestra.run.smithi045.stdout: -2767> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.569 INFO:teuthology.orchestra.run.smithi045.stdout: -2766> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002b3 [2,head] /dc-dir/dc-file_190 auth v3080 s=3 n(v0 rc2023-10-03T19:13:36.625235+0000 b3 1=1+0) (iversion lock) 0x55cf620ccb00] 2023-10-03T19:20:55.569 INFO:teuthology.orchestra.run.smithi045.stdout: -2765> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_190 [2,head] auth (dversion lock) v=3080 ino=0x100000002b3 state=1073741824 0x55cf61ec9b80] [inode 0x100000002b3 [2,head] /dc-dir/dc-file_190 auth v3080 s=3 n(v0 rc2023-10-03T19:13:36.625235+0000 b3 1=1+0) (iversion lock) 0x55cf620ccb00] 2023-10-03T19:20:55.569 INFO:teuthology.orchestra.run.smithi045.stdout: -2764> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002b3 [2,head] #100000002b3 auth v3080 s=3 n(v0 rc2023-10-03T19:13:36.625235+0000 b3 1=1+0) (iversion lock) 0x55cf620ccb00] 2023-10-03T19:20:55.569 INFO:teuthology.orchestra.run.smithi045.stdout: -2763> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_190 [2,head] auth NULL (dversion lock) v=3080 ino=(nil) state=1073741824 0x55cf61ec9b80] 2023-10-03T19:20:55.569 INFO:teuthology.orchestra.run.smithi045.stdout: -2762> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_189 [2,head] auth (dversion lock) v=3078 ino=0x100000002b2 state=1073741824 0x55cf61ec9900] 2023-10-03T19:20:55.569 INFO:teuthology.orchestra.run.smithi045.stdout: -2761> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.569 INFO:teuthology.orchestra.run.smithi045.stdout: -2760> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002b2 [2,head] /dc-dir/dc-file_189 auth v3078 s=3 n(v0 rc2023-10-03T19:13:36.613131+0000 b3 1=1+0) (iversion lock) 0x55cf620cc580] 2023-10-03T19:20:55.569 INFO:teuthology.orchestra.run.smithi045.stdout: -2759> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_189 [2,head] auth (dversion lock) v=3078 ino=0x100000002b2 state=1073741824 0x55cf61ec9900] [inode 0x100000002b2 [2,head] /dc-dir/dc-file_189 auth v3078 s=3 n(v0 rc2023-10-03T19:13:36.613131+0000 b3 1=1+0) (iversion lock) 0x55cf620cc580] 2023-10-03T19:20:55.569 INFO:teuthology.orchestra.run.smithi045.stdout: -2758> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002b2 [2,head] #100000002b2 auth v3078 s=3 n(v0 rc2023-10-03T19:13:36.613131+0000 b3 1=1+0) (iversion lock) 0x55cf620cc580] 2023-10-03T19:20:55.569 INFO:teuthology.orchestra.run.smithi045.stdout: -2757> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_189 [2,head] auth NULL (dversion lock) v=3078 ino=(nil) state=1073741824 0x55cf61ec9900] 2023-10-03T19:20:55.569 INFO:teuthology.orchestra.run.smithi045.stdout: -2756> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_188 [2,head] auth (dversion lock) v=3076 ino=0x100000002b1 state=1073741824 0x55cf61ec9680] 2023-10-03T19:20:55.570 INFO:teuthology.orchestra.run.smithi045.stdout: -2755> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.570 INFO:teuthology.orchestra.run.smithi045.stdout: -2754> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002b1 [2,head] /dc-dir/dc-file_188 auth v3076 s=3 n(v0 rc2023-10-03T19:13:36.600731+0000 b3 1=1+0) (iversion lock) 0x55cf620cc000] 2023-10-03T19:20:55.570 INFO:teuthology.orchestra.run.smithi045.stdout: -2753> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_188 [2,head] auth (dversion lock) v=3076 ino=0x100000002b1 state=1073741824 0x55cf61ec9680] [inode 0x100000002b1 [2,head] /dc-dir/dc-file_188 auth v3076 s=3 n(v0 rc2023-10-03T19:13:36.600731+0000 b3 1=1+0) (iversion lock) 0x55cf620cc000] 2023-10-03T19:20:55.570 INFO:teuthology.orchestra.run.smithi045.stdout: -2752> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002b1 [2,head] #100000002b1 auth v3076 s=3 n(v0 rc2023-10-03T19:13:36.600731+0000 b3 1=1+0) (iversion lock) 0x55cf620cc000] 2023-10-03T19:20:55.570 INFO:teuthology.orchestra.run.smithi045.stdout: -2751> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_188 [2,head] auth NULL (dversion lock) v=3076 ino=(nil) state=1073741824 0x55cf61ec9680] 2023-10-03T19:20:55.570 INFO:teuthology.orchestra.run.smithi045.stdout: -2750> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_187 [2,head] auth (dversion lock) v=3074 ino=0x100000002b0 state=1073741824 0x55cf61ec9400] 2023-10-03T19:20:55.570 INFO:teuthology.orchestra.run.smithi045.stdout: -2749> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.570 INFO:teuthology.orchestra.run.smithi045.stdout: -2748> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002b0 [2,head] /dc-dir/dc-file_187 auth v3074 s=3 n(v0 rc2023-10-03T19:13:36.587641+0000 b3 1=1+0) (iversion lock) 0x55cf61ec5700] 2023-10-03T19:20:55.570 INFO:teuthology.orchestra.run.smithi045.stdout: -2747> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_187 [2,head] auth (dversion lock) v=3074 ino=0x100000002b0 state=1073741824 0x55cf61ec9400] [inode 0x100000002b0 [2,head] /dc-dir/dc-file_187 auth v3074 s=3 n(v0 rc2023-10-03T19:13:36.587641+0000 b3 1=1+0) (iversion lock) 0x55cf61ec5700] 2023-10-03T19:20:55.570 INFO:teuthology.orchestra.run.smithi045.stdout: -2746> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002b0 [2,head] #100000002b0 auth v3074 s=3 n(v0 rc2023-10-03T19:13:36.587641+0000 b3 1=1+0) (iversion lock) 0x55cf61ec5700] 2023-10-03T19:20:55.571 INFO:teuthology.orchestra.run.smithi045.stdout: -2745> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_187 [2,head] auth NULL (dversion lock) v=3074 ino=(nil) state=1073741824 0x55cf61ec9400] 2023-10-03T19:20:55.571 INFO:teuthology.orchestra.run.smithi045.stdout: -2744> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_186 [2,head] auth (dversion lock) v=3072 ino=0x100000002af state=1073741824 0x55cf61ec9180] 2023-10-03T19:20:55.571 INFO:teuthology.orchestra.run.smithi045.stdout: -2743> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.571 INFO:teuthology.orchestra.run.smithi045.stdout: -2742> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002af [2,head] /dc-dir/dc-file_186 auth v3072 s=3 n(v0 rc2023-10-03T19:13:36.572332+0000 b3 1=1+0) (iversion lock) 0x55cf61ec5180] 2023-10-03T19:20:55.571 INFO:teuthology.orchestra.run.smithi045.stdout: -2741> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_186 [2,head] auth (dversion lock) v=3072 ino=0x100000002af state=1073741824 0x55cf61ec9180] [inode 0x100000002af [2,head] /dc-dir/dc-file_186 auth v3072 s=3 n(v0 rc2023-10-03T19:13:36.572332+0000 b3 1=1+0) (iversion lock) 0x55cf61ec5180] 2023-10-03T19:20:55.571 INFO:teuthology.orchestra.run.smithi045.stdout: -2740> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002af [2,head] #100000002af auth v3072 s=3 n(v0 rc2023-10-03T19:13:36.572332+0000 b3 1=1+0) (iversion lock) 0x55cf61ec5180] 2023-10-03T19:20:55.571 INFO:teuthology.orchestra.run.smithi045.stdout: -2739> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_186 [2,head] auth NULL (dversion lock) v=3072 ino=(nil) state=1073741824 0x55cf61ec9180] 2023-10-03T19:20:55.571 INFO:teuthology.orchestra.run.smithi045.stdout: -2738> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_185 [2,head] auth (dversion lock) v=3070 ino=0x100000002ae state=1073741824 0x55cf61ec8f00] 2023-10-03T19:20:55.571 INFO:teuthology.orchestra.run.smithi045.stdout: -2737> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.571 INFO:teuthology.orchestra.run.smithi045.stdout: -2736> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002ae [2,head] /dc-dir/dc-file_185 auth v3070 s=3 n(v0 rc2023-10-03T19:13:36.559755+0000 b3 1=1+0) (iversion lock) 0x55cf61ec4c00] 2023-10-03T19:20:55.572 INFO:teuthology.orchestra.run.smithi045.stdout: -2735> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_185 [2,head] auth (dversion lock) v=3070 ino=0x100000002ae state=1073741824 0x55cf61ec8f00] [inode 0x100000002ae [2,head] /dc-dir/dc-file_185 auth v3070 s=3 n(v0 rc2023-10-03T19:13:36.559755+0000 b3 1=1+0) (iversion lock) 0x55cf61ec4c00] 2023-10-03T19:20:55.572 INFO:teuthology.orchestra.run.smithi045.stdout: -2734> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002ae [2,head] #100000002ae auth v3070 s=3 n(v0 rc2023-10-03T19:13:36.559755+0000 b3 1=1+0) (iversion lock) 0x55cf61ec4c00] 2023-10-03T19:20:55.572 INFO:teuthology.orchestra.run.smithi045.stdout: -2733> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_185 [2,head] auth NULL (dversion lock) v=3070 ino=(nil) state=1073741824 0x55cf61ec8f00] 2023-10-03T19:20:55.572 INFO:teuthology.orchestra.run.smithi045.stdout: -2732> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_184 [2,head] auth (dversion lock) v=3068 ino=0x100000002ad state=1073741824 0x55cf61ec8c80] 2023-10-03T19:20:55.572 INFO:teuthology.orchestra.run.smithi045.stdout: -2731> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.572 INFO:teuthology.orchestra.run.smithi045.stdout: -2730> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002ad [2,head] /dc-dir/dc-file_184 auth v3068 s=3 n(v0 rc2023-10-03T19:13:36.548796+0000 b3 1=1+0) (iversion lock) 0x55cf61ec4680] 2023-10-03T19:20:55.572 INFO:teuthology.orchestra.run.smithi045.stdout: -2729> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_184 [2,head] auth (dversion lock) v=3068 ino=0x100000002ad state=1073741824 0x55cf61ec8c80] [inode 0x100000002ad [2,head] /dc-dir/dc-file_184 auth v3068 s=3 n(v0 rc2023-10-03T19:13:36.548796+0000 b3 1=1+0) (iversion lock) 0x55cf61ec4680] 2023-10-03T19:20:55.572 INFO:teuthology.orchestra.run.smithi045.stdout: -2728> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002ad [2,head] #100000002ad auth v3068 s=3 n(v0 rc2023-10-03T19:13:36.548796+0000 b3 1=1+0) (iversion lock) 0x55cf61ec4680] 2023-10-03T19:20:55.572 INFO:teuthology.orchestra.run.smithi045.stdout: -2727> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_184 [2,head] auth NULL (dversion lock) v=3068 ino=(nil) state=1073741824 0x55cf61ec8c80] 2023-10-03T19:20:55.572 INFO:teuthology.orchestra.run.smithi045.stdout: -2726> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_183 [2,head] auth (dversion lock) v=3066 ino=0x100000002ac state=1073741824 0x55cf61ec8a00] 2023-10-03T19:20:55.572 INFO:teuthology.orchestra.run.smithi045.stdout: -2725> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.572 INFO:teuthology.orchestra.run.smithi045.stdout: -2724> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002ac [2,head] /dc-dir/dc-file_183 auth v3066 s=3 n(v0 rc2023-10-03T19:13:36.538096+0000 b3 1=1+0) (iversion lock) 0x55cf61ec4100] 2023-10-03T19:20:55.573 INFO:teuthology.orchestra.run.smithi045.stdout: -2723> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_183 [2,head] auth (dversion lock) v=3066 ino=0x100000002ac state=1073741824 0x55cf61ec8a00] [inode 0x100000002ac [2,head] /dc-dir/dc-file_183 auth v3066 s=3 n(v0 rc2023-10-03T19:13:36.538096+0000 b3 1=1+0) (iversion lock) 0x55cf61ec4100] 2023-10-03T19:20:55.573 INFO:teuthology.orchestra.run.smithi045.stdout: -2722> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002ac [2,head] #100000002ac auth v3066 s=3 n(v0 rc2023-10-03T19:13:36.538096+0000 b3 1=1+0) (iversion lock) 0x55cf61ec4100] 2023-10-03T19:20:55.573 INFO:teuthology.orchestra.run.smithi045.stdout: -2721> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_183 [2,head] auth NULL (dversion lock) v=3066 ino=(nil) state=1073741824 0x55cf61ec8a00] 2023-10-03T19:20:55.573 INFO:teuthology.orchestra.run.smithi045.stdout: -2720> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_182 [2,head] auth (dversion lock) v=3064 ino=0x100000002ab state=1073741824 0x55cf61ec8780] 2023-10-03T19:20:55.573 INFO:teuthology.orchestra.run.smithi045.stdout: -2719> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.573 INFO:teuthology.orchestra.run.smithi045.stdout: -2718> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002ab [2,head] /dc-dir/dc-file_182 auth v3064 s=3 n(v0 rc2023-10-03T19:13:36.527078+0000 b3 1=1+0) (iversion lock) 0x55cf61ec3b80] 2023-10-03T19:20:55.573 INFO:teuthology.orchestra.run.smithi045.stdout: -2717> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_182 [2,head] auth (dversion lock) v=3064 ino=0x100000002ab state=1073741824 0x55cf61ec8780] [inode 0x100000002ab [2,head] /dc-dir/dc-file_182 auth v3064 s=3 n(v0 rc2023-10-03T19:13:36.527078+0000 b3 1=1+0) (iversion lock) 0x55cf61ec3b80] 2023-10-03T19:20:55.573 INFO:teuthology.orchestra.run.smithi045.stdout: -2716> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002ab [2,head] #100000002ab auth v3064 s=3 n(v0 rc2023-10-03T19:13:36.527078+0000 b3 1=1+0) (iversion lock) 0x55cf61ec3b80] 2023-10-03T19:20:55.573 INFO:teuthology.orchestra.run.smithi045.stdout: -2715> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_182 [2,head] auth NULL (dversion lock) v=3064 ino=(nil) state=1073741824 0x55cf61ec8780] 2023-10-03T19:20:55.573 INFO:teuthology.orchestra.run.smithi045.stdout: -2714> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_181 [2,head] auth (dversion lock) v=3062 ino=0x100000002aa state=1073741824 0x55cf61ec8500] 2023-10-03T19:20:55.573 INFO:teuthology.orchestra.run.smithi045.stdout: -2713> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.573 INFO:teuthology.orchestra.run.smithi045.stdout: -2712> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002aa [2,head] /dc-dir/dc-file_181 auth v3062 s=3 n(v0 rc2023-10-03T19:13:36.516676+0000 b3 1=1+0) (iversion lock) 0x55cf61ec3600] 2023-10-03T19:20:55.574 INFO:teuthology.orchestra.run.smithi045.stdout: -2711> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_181 [2,head] auth (dversion lock) v=3062 ino=0x100000002aa state=1073741824 0x55cf61ec8500] [inode 0x100000002aa [2,head] /dc-dir/dc-file_181 auth v3062 s=3 n(v0 rc2023-10-03T19:13:36.516676+0000 b3 1=1+0) (iversion lock) 0x55cf61ec3600] 2023-10-03T19:20:55.574 INFO:teuthology.orchestra.run.smithi045.stdout: -2710> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002aa [2,head] #100000002aa auth v3062 s=3 n(v0 rc2023-10-03T19:13:36.516676+0000 b3 1=1+0) (iversion lock) 0x55cf61ec3600] 2023-10-03T19:20:55.574 INFO:teuthology.orchestra.run.smithi045.stdout: -2709> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_181 [2,head] auth NULL (dversion lock) v=3062 ino=(nil) state=1073741824 0x55cf61ec8500] 2023-10-03T19:20:55.574 INFO:teuthology.orchestra.run.smithi045.stdout: -2708> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_180 [2,head] auth (dversion lock) v=3060 ino=0x100000002a9 state=1073741824 0x55cf61ec8280] 2023-10-03T19:20:55.574 INFO:teuthology.orchestra.run.smithi045.stdout: -2707> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.574 INFO:teuthology.orchestra.run.smithi045.stdout: -2706> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002a9 [2,head] /dc-dir/dc-file_180 auth v3060 s=3 n(v0 rc2023-10-03T19:13:36.506265+0000 b3 1=1+0) (iversion lock) 0x55cf61ec3080] 2023-10-03T19:20:55.574 INFO:teuthology.orchestra.run.smithi045.stdout: -2705> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_180 [2,head] auth (dversion lock) v=3060 ino=0x100000002a9 state=1073741824 0x55cf61ec8280] [inode 0x100000002a9 [2,head] /dc-dir/dc-file_180 auth v3060 s=3 n(v0 rc2023-10-03T19:13:36.506265+0000 b3 1=1+0) (iversion lock) 0x55cf61ec3080] 2023-10-03T19:20:55.574 INFO:teuthology.orchestra.run.smithi045.stdout: -2704> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002a9 [2,head] #100000002a9 auth v3060 s=3 n(v0 rc2023-10-03T19:13:36.506265+0000 b3 1=1+0) (iversion lock) 0x55cf61ec3080] 2023-10-03T19:20:55.574 INFO:teuthology.orchestra.run.smithi045.stdout: -2703> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_180 [2,head] auth NULL (dversion lock) v=3060 ino=(nil) state=1073741824 0x55cf61ec8280] 2023-10-03T19:20:55.574 INFO:teuthology.orchestra.run.smithi045.stdout: -2702> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_179 [2,head] auth (dversion lock) v=3058 ino=0x100000002a8 state=1073741824 0x55cf61ec8000] 2023-10-03T19:20:55.575 INFO:teuthology.orchestra.run.smithi045.stdout: -2701> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.575 INFO:teuthology.orchestra.run.smithi045.stdout: -2700> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002a8 [2,head] /dc-dir/dc-file_179 auth v3058 s=3 n(v0 rc2023-10-03T19:13:36.495220+0000 b3 1=1+0) (iversion lock) 0x55cf61ec2b00] 2023-10-03T19:20:55.575 INFO:teuthology.orchestra.run.smithi045.stdout: -2699> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_179 [2,head] auth (dversion lock) v=3058 ino=0x100000002a8 state=1073741824 0x55cf61ec8000] [inode 0x100000002a8 [2,head] /dc-dir/dc-file_179 auth v3058 s=3 n(v0 rc2023-10-03T19:13:36.495220+0000 b3 1=1+0) (iversion lock) 0x55cf61ec2b00] 2023-10-03T19:20:55.575 INFO:teuthology.orchestra.run.smithi045.stdout: -2698> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002a8 [2,head] #100000002a8 auth v3058 s=3 n(v0 rc2023-10-03T19:13:36.495220+0000 b3 1=1+0) (iversion lock) 0x55cf61ec2b00] 2023-10-03T19:20:55.575 INFO:teuthology.orchestra.run.smithi045.stdout: -2697> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_179 [2,head] auth NULL (dversion lock) v=3058 ino=(nil) state=1073741824 0x55cf61ec8000] 2023-10-03T19:20:55.575 INFO:teuthology.orchestra.run.smithi045.stdout: -2696> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_178 [2,head] auth (dversion lock) v=3056 ino=0x100000002a7 state=1073741824 0x55cf61ebdb80] 2023-10-03T19:20:55.575 INFO:teuthology.orchestra.run.smithi045.stdout: -2695> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.575 INFO:teuthology.orchestra.run.smithi045.stdout: -2694> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002a7 [2,head] /dc-dir/dc-file_178 auth v3056 s=3 n(v0 rc2023-10-03T19:13:36.484344+0000 b3 1=1+0) (iversion lock) 0x55cf61ec2580] 2023-10-03T19:20:55.575 INFO:teuthology.orchestra.run.smithi045.stdout: -2693> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_178 [2,head] auth (dversion lock) v=3056 ino=0x100000002a7 state=1073741824 0x55cf61ebdb80] [inode 0x100000002a7 [2,head] /dc-dir/dc-file_178 auth v3056 s=3 n(v0 rc2023-10-03T19:13:36.484344+0000 b3 1=1+0) (iversion lock) 0x55cf61ec2580] 2023-10-03T19:20:55.575 INFO:teuthology.orchestra.run.smithi045.stdout: -2692> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002a7 [2,head] #100000002a7 auth v3056 s=3 n(v0 rc2023-10-03T19:13:36.484344+0000 b3 1=1+0) (iversion lock) 0x55cf61ec2580] 2023-10-03T19:20:55.575 INFO:teuthology.orchestra.run.smithi045.stdout: -2691> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_178 [2,head] auth NULL (dversion lock) v=3056 ino=(nil) state=1073741824 0x55cf61ebdb80] 2023-10-03T19:20:55.575 INFO:teuthology.orchestra.run.smithi045.stdout: -2690> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_177 [2,head] auth (dversion lock) v=2754 ino=0x100000002a6 state=1073741824 0x55cf61ebd900] 2023-10-03T19:20:55.576 INFO:teuthology.orchestra.run.smithi045.stdout: -2689> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.576 INFO:teuthology.orchestra.run.smithi045.stdout: -2688> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002a6 [2,head] /dc-dir/dc-file_177 auth v2754 s=3 n(v0 rc2023-10-03T19:13:36.472570+0000 b3 1=1+0) (iversion lock) 0x55cf61ec2000] 2023-10-03T19:20:55.576 INFO:teuthology.orchestra.run.smithi045.stdout: -2687> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_177 [2,head] auth (dversion lock) v=2754 ino=0x100000002a6 state=1073741824 0x55cf61ebd900] [inode 0x100000002a6 [2,head] /dc-dir/dc-file_177 auth v2754 s=3 n(v0 rc2023-10-03T19:13:36.472570+0000 b3 1=1+0) (iversion lock) 0x55cf61ec2000] 2023-10-03T19:20:55.576 INFO:teuthology.orchestra.run.smithi045.stdout: -2686> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002a6 [2,head] #100000002a6 auth v2754 s=3 n(v0 rc2023-10-03T19:13:36.472570+0000 b3 1=1+0) (iversion lock) 0x55cf61ec2000] 2023-10-03T19:20:55.576 INFO:teuthology.orchestra.run.smithi045.stdout: -2685> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_177 [2,head] auth NULL (dversion lock) v=2754 ino=(nil) state=1073741824 0x55cf61ebd900] 2023-10-03T19:20:55.576 INFO:teuthology.orchestra.run.smithi045.stdout: -2684> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_176 [2,head] auth (dversion lock) v=2752 ino=0x100000002a5 state=1073741824 0x55cf61ebd680] 2023-10-03T19:20:55.576 INFO:teuthology.orchestra.run.smithi045.stdout: -2683> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.576 INFO:teuthology.orchestra.run.smithi045.stdout: -2682> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002a5 [2,head] /dc-dir/dc-file_176 auth v2752 s=3 n(v0 rc2023-10-03T19:13:36.460236+0000 b3 1=1+0) (iversion lock) 0x55cf61ebb700] 2023-10-03T19:20:55.576 INFO:teuthology.orchestra.run.smithi045.stdout: -2681> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_176 [2,head] auth (dversion lock) v=2752 ino=0x100000002a5 state=1073741824 0x55cf61ebd680] [inode 0x100000002a5 [2,head] /dc-dir/dc-file_176 auth v2752 s=3 n(v0 rc2023-10-03T19:13:36.460236+0000 b3 1=1+0) (iversion lock) 0x55cf61ebb700] 2023-10-03T19:20:55.576 INFO:teuthology.orchestra.run.smithi045.stdout: -2680> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002a5 [2,head] #100000002a5 auth v2752 s=3 n(v0 rc2023-10-03T19:13:36.460236+0000 b3 1=1+0) (iversion lock) 0x55cf61ebb700] 2023-10-03T19:20:55.576 INFO:teuthology.orchestra.run.smithi045.stdout: -2679> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_176 [2,head] auth NULL (dversion lock) v=2752 ino=(nil) state=1073741824 0x55cf61ebd680] 2023-10-03T19:20:55.577 INFO:teuthology.orchestra.run.smithi045.stdout: -2678> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_175 [2,head] auth (dversion lock) v=2750 ino=0x100000002a4 state=1073741824 0x55cf61ebd400] 2023-10-03T19:20:55.577 INFO:teuthology.orchestra.run.smithi045.stdout: -2677> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.577 INFO:teuthology.orchestra.run.smithi045.stdout: -2676> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002a4 [2,head] /dc-dir/dc-file_175 auth v2750 s=3 n(v0 rc2023-10-03T19:13:36.449179+0000 b3 1=1+0) (iversion lock) 0x55cf61ebb180] 2023-10-03T19:20:55.577 INFO:teuthology.orchestra.run.smithi045.stdout: -2675> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_175 [2,head] auth (dversion lock) v=2750 ino=0x100000002a4 state=1073741824 0x55cf61ebd400] [inode 0x100000002a4 [2,head] /dc-dir/dc-file_175 auth v2750 s=3 n(v0 rc2023-10-03T19:13:36.449179+0000 b3 1=1+0) (iversion lock) 0x55cf61ebb180] 2023-10-03T19:20:55.577 INFO:teuthology.orchestra.run.smithi045.stdout: -2674> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002a4 [2,head] #100000002a4 auth v2750 s=3 n(v0 rc2023-10-03T19:13:36.449179+0000 b3 1=1+0) (iversion lock) 0x55cf61ebb180] 2023-10-03T19:20:55.577 INFO:teuthology.orchestra.run.smithi045.stdout: -2673> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_175 [2,head] auth NULL (dversion lock) v=2750 ino=(nil) state=1073741824 0x55cf61ebd400] 2023-10-03T19:20:55.577 INFO:teuthology.orchestra.run.smithi045.stdout: -2672> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_174 [2,head] auth (dversion lock) v=2748 ino=0x100000002a3 state=1073741824 0x55cf61ebd180] 2023-10-03T19:20:55.577 INFO:teuthology.orchestra.run.smithi045.stdout: -2671> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.577 INFO:teuthology.orchestra.run.smithi045.stdout: -2670> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002a3 [2,head] /dc-dir/dc-file_174 auth v2748 s=3 n(v0 rc2023-10-03T19:13:36.437923+0000 b3 1=1+0) (iversion lock) 0x55cf61ebac00] 2023-10-03T19:20:55.577 INFO:teuthology.orchestra.run.smithi045.stdout: -2669> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_174 [2,head] auth (dversion lock) v=2748 ino=0x100000002a3 state=1073741824 0x55cf61ebd180] [inode 0x100000002a3 [2,head] /dc-dir/dc-file_174 auth v2748 s=3 n(v0 rc2023-10-03T19:13:36.437923+0000 b3 1=1+0) (iversion lock) 0x55cf61ebac00] 2023-10-03T19:20:55.577 INFO:teuthology.orchestra.run.smithi045.stdout: -2668> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002a3 [2,head] #100000002a3 auth v2748 s=3 n(v0 rc2023-10-03T19:13:36.437923+0000 b3 1=1+0) (iversion lock) 0x55cf61ebac00] 2023-10-03T19:20:55.578 INFO:teuthology.orchestra.run.smithi045.stdout: -2667> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_174 [2,head] auth NULL (dversion lock) v=2748 ino=(nil) state=1073741824 0x55cf61ebd180] 2023-10-03T19:20:55.578 INFO:teuthology.orchestra.run.smithi045.stdout: -2666> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_173 [2,head] auth (dversion lock) v=2746 ino=0x100000002a2 state=1073741824 0x55cf61ebcf00] 2023-10-03T19:20:55.578 INFO:teuthology.orchestra.run.smithi045.stdout: -2665> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.578 INFO:teuthology.orchestra.run.smithi045.stdout: -2664> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002a2 [2,head] /dc-dir/dc-file_173 auth v2746 s=3 n(v0 rc2023-10-03T19:13:36.427145+0000 b3 1=1+0) (iversion lock) 0x55cf61eba680] 2023-10-03T19:20:55.578 INFO:teuthology.orchestra.run.smithi045.stdout: -2663> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_173 [2,head] auth (dversion lock) v=2746 ino=0x100000002a2 state=1073741824 0x55cf61ebcf00] [inode 0x100000002a2 [2,head] /dc-dir/dc-file_173 auth v2746 s=3 n(v0 rc2023-10-03T19:13:36.427145+0000 b3 1=1+0) (iversion lock) 0x55cf61eba680] 2023-10-03T19:20:55.578 INFO:teuthology.orchestra.run.smithi045.stdout: -2662> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002a2 [2,head] #100000002a2 auth v2746 s=3 n(v0 rc2023-10-03T19:13:36.427145+0000 b3 1=1+0) (iversion lock) 0x55cf61eba680] 2023-10-03T19:20:55.580 INFO:teuthology.orchestra.run.smithi045.stdout: -2661> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_173 [2,head] auth NULL (dversion lock) v=2746 ino=(nil) state=1073741824 0x55cf61ebcf00] 2023-10-03T19:20:55.580 INFO:teuthology.orchestra.run.smithi045.stdout: -2660> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_172 [2,head] auth (dversion lock) v=2744 ino=0x100000002a1 state=1073741824 0x55cf61ebcc80] 2023-10-03T19:20:55.581 INFO:teuthology.orchestra.run.smithi045.stdout: -2659> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.581 INFO:teuthology.orchestra.run.smithi045.stdout: -2658> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002a1 [2,head] /dc-dir/dc-file_172 auth v2744 s=3 n(v0 rc2023-10-03T19:13:36.415972+0000 b3 1=1+0) (iversion lock) 0x55cf61eba100] 2023-10-03T19:20:55.581 INFO:teuthology.orchestra.run.smithi045.stdout: -2657> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_172 [2,head] auth (dversion lock) v=2744 ino=0x100000002a1 state=1073741824 0x55cf61ebcc80] [inode 0x100000002a1 [2,head] /dc-dir/dc-file_172 auth v2744 s=3 n(v0 rc2023-10-03T19:13:36.415972+0000 b3 1=1+0) (iversion lock) 0x55cf61eba100] 2023-10-03T19:20:55.581 INFO:teuthology.orchestra.run.smithi045.stdout: -2656> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002a1 [2,head] #100000002a1 auth v2744 s=3 n(v0 rc2023-10-03T19:13:36.415972+0000 b3 1=1+0) (iversion lock) 0x55cf61eba100] 2023-10-03T19:20:55.581 INFO:teuthology.orchestra.run.smithi045.stdout: -2655> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_172 [2,head] auth NULL (dversion lock) v=2744 ino=(nil) state=1073741824 0x55cf61ebcc80] 2023-10-03T19:20:55.581 INFO:teuthology.orchestra.run.smithi045.stdout: -2654> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_171 [2,head] auth (dversion lock) v=2742 ino=0x100000002a0 state=1073741824 0x55cf61ebca00] 2023-10-03T19:20:55.581 INFO:teuthology.orchestra.run.smithi045.stdout: -2653> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.581 INFO:teuthology.orchestra.run.smithi045.stdout: -2652> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000002a0 [2,head] /dc-dir/dc-file_171 auth v2742 s=3 n(v0 rc2023-10-03T19:13:36.404862+0000 b3 1=1+0) (iversion lock) 0x55cf61eb9b80] 2023-10-03T19:20:55.581 INFO:teuthology.orchestra.run.smithi045.stdout: -2651> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_171 [2,head] auth (dversion lock) v=2742 ino=0x100000002a0 state=1073741824 0x55cf61ebca00] [inode 0x100000002a0 [2,head] /dc-dir/dc-file_171 auth v2742 s=3 n(v0 rc2023-10-03T19:13:36.404862+0000 b3 1=1+0) (iversion lock) 0x55cf61eb9b80] 2023-10-03T19:20:55.581 INFO:teuthology.orchestra.run.smithi045.stdout: -2650> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000002a0 [2,head] #100000002a0 auth v2742 s=3 n(v0 rc2023-10-03T19:13:36.404862+0000 b3 1=1+0) (iversion lock) 0x55cf61eb9b80] 2023-10-03T19:20:55.581 INFO:teuthology.orchestra.run.smithi045.stdout: -2649> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_171 [2,head] auth NULL (dversion lock) v=2742 ino=(nil) state=1073741824 0x55cf61ebca00] 2023-10-03T19:20:55.581 INFO:teuthology.orchestra.run.smithi045.stdout: -2648> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_170 [2,head] auth (dversion lock) v=2740 ino=0x1000000029f state=1073741824 0x55cf61ebc780] 2023-10-03T19:20:55.582 INFO:teuthology.orchestra.run.smithi045.stdout: -2647> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.582 INFO:teuthology.orchestra.run.smithi045.stdout: -2646> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000029f [2,head] /dc-dir/dc-file_170 auth v2740 s=3 n(v0 rc2023-10-03T19:13:36.394228+0000 b3 1=1+0) (iversion lock) 0x55cf61eb9600] 2023-10-03T19:20:55.582 INFO:teuthology.orchestra.run.smithi045.stdout: -2645> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_170 [2,head] auth (dversion lock) v=2740 ino=0x1000000029f state=1073741824 0x55cf61ebc780] [inode 0x1000000029f [2,head] /dc-dir/dc-file_170 auth v2740 s=3 n(v0 rc2023-10-03T19:13:36.394228+0000 b3 1=1+0) (iversion lock) 0x55cf61eb9600] 2023-10-03T19:20:55.582 INFO:teuthology.orchestra.run.smithi045.stdout: -2644> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000029f [2,head] #1000000029f auth v2740 s=3 n(v0 rc2023-10-03T19:13:36.394228+0000 b3 1=1+0) (iversion lock) 0x55cf61eb9600] 2023-10-03T19:20:55.582 INFO:teuthology.orchestra.run.smithi045.stdout: -2643> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_170 [2,head] auth NULL (dversion lock) v=2740 ino=(nil) state=1073741824 0x55cf61ebc780] 2023-10-03T19:20:55.582 INFO:teuthology.orchestra.run.smithi045.stdout: -2642> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_169 [2,head] auth (dversion lock) v=2738 ino=0x1000000029e state=1073741824 0x55cf61ebc500] 2023-10-03T19:20:55.582 INFO:teuthology.orchestra.run.smithi045.stdout: -2641> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.582 INFO:teuthology.orchestra.run.smithi045.stdout: -2640> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000029e [2,head] /dc-dir/dc-file_169 auth v2738 s=3 n(v0 rc2023-10-03T19:13:36.382976+0000 b3 1=1+0) (iversion lock) 0x55cf61eb9080] 2023-10-03T19:20:55.582 INFO:teuthology.orchestra.run.smithi045.stdout: -2639> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_169 [2,head] auth (dversion lock) v=2738 ino=0x1000000029e state=1073741824 0x55cf61ebc500] [inode 0x1000000029e [2,head] /dc-dir/dc-file_169 auth v2738 s=3 n(v0 rc2023-10-03T19:13:36.382976+0000 b3 1=1+0) (iversion lock) 0x55cf61eb9080] 2023-10-03T19:20:55.582 INFO:teuthology.orchestra.run.smithi045.stdout: -2638> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000029e [2,head] #1000000029e auth v2738 s=3 n(v0 rc2023-10-03T19:13:36.382976+0000 b3 1=1+0) (iversion lock) 0x55cf61eb9080] 2023-10-03T19:20:55.583 INFO:teuthology.orchestra.run.smithi045.stdout: -2637> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_169 [2,head] auth NULL (dversion lock) v=2738 ino=(nil) state=1073741824 0x55cf61ebc500] 2023-10-03T19:20:55.583 INFO:teuthology.orchestra.run.smithi045.stdout: -2636> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_168 [2,head] auth (dversion lock) v=2736 ino=0x1000000029d state=1073741824 0x55cf61ebc280] 2023-10-03T19:20:55.583 INFO:teuthology.orchestra.run.smithi045.stdout: -2635> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.583 INFO:teuthology.orchestra.run.smithi045.stdout: -2634> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000029d [2,head] /dc-dir/dc-file_168 auth v2736 s=3 n(v0 rc2023-10-03T19:13:36.372157+0000 b3 1=1+0) (iversion lock) 0x55cf61eb8b00] 2023-10-03T19:20:55.583 INFO:teuthology.orchestra.run.smithi045.stdout: -2633> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_168 [2,head] auth (dversion lock) v=2736 ino=0x1000000029d state=1073741824 0x55cf61ebc280] [inode 0x1000000029d [2,head] /dc-dir/dc-file_168 auth v2736 s=3 n(v0 rc2023-10-03T19:13:36.372157+0000 b3 1=1+0) (iversion lock) 0x55cf61eb8b00] 2023-10-03T19:20:55.583 INFO:teuthology.orchestra.run.smithi045.stdout: -2632> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000029d [2,head] #1000000029d auth v2736 s=3 n(v0 rc2023-10-03T19:13:36.372157+0000 b3 1=1+0) (iversion lock) 0x55cf61eb8b00] 2023-10-03T19:20:55.583 INFO:teuthology.orchestra.run.smithi045.stdout: -2631> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_168 [2,head] auth NULL (dversion lock) v=2736 ino=(nil) state=1073741824 0x55cf61ebc280] 2023-10-03T19:20:55.583 INFO:teuthology.orchestra.run.smithi045.stdout: -2630> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_167 [2,head] auth (dversion lock) v=2734 ino=0x1000000029c state=1073741824 0x55cf61ebc000] 2023-10-03T19:20:55.583 INFO:teuthology.orchestra.run.smithi045.stdout: -2629> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.583 INFO:teuthology.orchestra.run.smithi045.stdout: -2628> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000029c [2,head] /dc-dir/dc-file_167 auth v2734 s=3 n(v0 rc2023-10-03T19:13:36.361649+0000 b3 1=1+0) (iversion lock) 0x55cf61eb8580] 2023-10-03T19:20:55.583 INFO:teuthology.orchestra.run.smithi045.stdout: -2627> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_167 [2,head] auth (dversion lock) v=2734 ino=0x1000000029c state=1073741824 0x55cf61ebc000] [inode 0x1000000029c [2,head] /dc-dir/dc-file_167 auth v2734 s=3 n(v0 rc2023-10-03T19:13:36.361649+0000 b3 1=1+0) (iversion lock) 0x55cf61eb8580] 2023-10-03T19:20:55.584 INFO:teuthology.orchestra.run.smithi045.stdout: -2626> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000029c [2,head] #1000000029c auth v2734 s=3 n(v0 rc2023-10-03T19:13:36.361649+0000 b3 1=1+0) (iversion lock) 0x55cf61eb8580] 2023-10-03T19:20:55.584 INFO:teuthology.orchestra.run.smithi045.stdout: -2625> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_167 [2,head] auth NULL (dversion lock) v=2734 ino=(nil) state=1073741824 0x55cf61ebc000] 2023-10-03T19:20:55.584 INFO:teuthology.orchestra.run.smithi045.stdout: -2624> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_166 [2,head] auth (dversion lock) v=2732 ino=0x1000000029b state=1073741824 0x55cf61e99b80] 2023-10-03T19:20:55.584 INFO:teuthology.orchestra.run.smithi045.stdout: -2623> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.608 INFO:teuthology.orchestra.run.smithi045.stdout: -2622> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000029b [2,head] /dc-dir/dc-file_166 auth v2732 s=3 n(v0 rc2023-10-03T19:13:36.351279+0000 b3 1=1+0) (iversion lock) 0x55cf61eb8000] 2023-10-03T19:20:55.608 INFO:teuthology.orchestra.run.smithi045.stdout: -2621> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_166 [2,head] auth (dversion lock) v=2732 ino=0x1000000029b state=1073741824 0x55cf61e99b80] [inode 0x1000000029b [2,head] /dc-dir/dc-file_166 auth v2732 s=3 n(v0 rc2023-10-03T19:13:36.351279+0000 b3 1=1+0) (iversion lock) 0x55cf61eb8000] 2023-10-03T19:20:55.608 INFO:teuthology.orchestra.run.smithi045.stdout: -2620> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000029b [2,head] #1000000029b auth v2732 s=3 n(v0 rc2023-10-03T19:13:36.351279+0000 b3 1=1+0) (iversion lock) 0x55cf61eb8000] 2023-10-03T19:20:55.608 INFO:teuthology.orchestra.run.smithi045.stdout: -2619> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_166 [2,head] auth NULL (dversion lock) v=2732 ino=(nil) state=1073741824 0x55cf61e99b80] 2023-10-03T19:20:55.608 INFO:teuthology.orchestra.run.smithi045.stdout: -2618> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_165 [2,head] auth (dversion lock) v=2730 ino=0x1000000029a state=1073741824 0x55cf61e99900] 2023-10-03T19:20:55.608 INFO:teuthology.orchestra.run.smithi045.stdout: -2617> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.608 INFO:teuthology.orchestra.run.smithi045.stdout: -2616> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000029a [2,head] /dc-dir/dc-file_165 auth v2730 s=3 n(v0 rc2023-10-03T19:13:36.340929+0000 b3 1=1+0) (iversion lock) 0x55cf61e9d700] 2023-10-03T19:20:55.608 INFO:teuthology.orchestra.run.smithi045.stdout: -2615> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_165 [2,head] auth (dversion lock) v=2730 ino=0x1000000029a state=1073741824 0x55cf61e99900] [inode 0x1000000029a [2,head] /dc-dir/dc-file_165 auth v2730 s=3 n(v0 rc2023-10-03T19:13:36.340929+0000 b3 1=1+0) (iversion lock) 0x55cf61e9d700] 2023-10-03T19:20:55.608 INFO:teuthology.orchestra.run.smithi045.stdout: -2614> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000029a [2,head] #1000000029a auth v2730 s=3 n(v0 rc2023-10-03T19:13:36.340929+0000 b3 1=1+0) (iversion lock) 0x55cf61e9d700] 2023-10-03T19:20:55.608 INFO:teuthology.orchestra.run.smithi045.stdout: -2613> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_165 [2,head] auth NULL (dversion lock) v=2730 ino=(nil) state=1073741824 0x55cf61e99900] 2023-10-03T19:20:55.609 INFO:teuthology.orchestra.run.smithi045.stdout: -2612> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_164 [2,head] auth (dversion lock) v=2728 ino=0x10000000299 state=1073741824 0x55cf61e99680] 2023-10-03T19:20:55.609 INFO:teuthology.orchestra.run.smithi045.stdout: -2611> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.609 INFO:teuthology.orchestra.run.smithi045.stdout: -2610> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000299 [2,head] /dc-dir/dc-file_164 auth v2728 s=3 n(v0 rc2023-10-03T19:13:36.330296+0000 b3 1=1+0) (iversion lock) 0x55cf61e9d180] 2023-10-03T19:20:55.609 INFO:teuthology.orchestra.run.smithi045.stdout: -2609> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_164 [2,head] auth (dversion lock) v=2728 ino=0x10000000299 state=1073741824 0x55cf61e99680] [inode 0x10000000299 [2,head] /dc-dir/dc-file_164 auth v2728 s=3 n(v0 rc2023-10-03T19:13:36.330296+0000 b3 1=1+0) (iversion lock) 0x55cf61e9d180] 2023-10-03T19:20:55.609 INFO:teuthology.orchestra.run.smithi045.stdout: -2608> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000299 [2,head] #10000000299 auth v2728 s=3 n(v0 rc2023-10-03T19:13:36.330296+0000 b3 1=1+0) (iversion lock) 0x55cf61e9d180] 2023-10-03T19:20:55.609 INFO:teuthology.orchestra.run.smithi045.stdout: -2607> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_164 [2,head] auth NULL (dversion lock) v=2728 ino=(nil) state=1073741824 0x55cf61e99680] 2023-10-03T19:20:55.609 INFO:teuthology.orchestra.run.smithi045.stdout: -2606> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_163 [2,head] auth (dversion lock) v=2726 ino=0x10000000298 state=1073741824 0x55cf61e99400] 2023-10-03T19:20:55.609 INFO:teuthology.orchestra.run.smithi045.stdout: -2605> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.609 INFO:teuthology.orchestra.run.smithi045.stdout: -2604> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000298 [2,head] /dc-dir/dc-file_163 auth v2726 s=3 n(v0 rc2023-10-03T19:13:36.318136+0000 b3 1=1+0) (iversion lock) 0x55cf61e9cc00] 2023-10-03T19:20:55.609 INFO:teuthology.orchestra.run.smithi045.stdout: -2603> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_163 [2,head] auth (dversion lock) v=2726 ino=0x10000000298 state=1073741824 0x55cf61e99400] [inode 0x10000000298 [2,head] /dc-dir/dc-file_163 auth v2726 s=3 n(v0 rc2023-10-03T19:13:36.318136+0000 b3 1=1+0) (iversion lock) 0x55cf61e9cc00] 2023-10-03T19:20:55.610 INFO:teuthology.orchestra.run.smithi045.stdout: -2602> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000298 [2,head] #10000000298 auth v2726 s=3 n(v0 rc2023-10-03T19:13:36.318136+0000 b3 1=1+0) (iversion lock) 0x55cf61e9cc00] 2023-10-03T19:20:55.610 INFO:teuthology.orchestra.run.smithi045.stdout: -2601> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_163 [2,head] auth NULL (dversion lock) v=2726 ino=(nil) state=1073741824 0x55cf61e99400] 2023-10-03T19:20:55.610 INFO:teuthology.orchestra.run.smithi045.stdout: -2600> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_162 [2,head] auth (dversion lock) v=2724 ino=0x10000000297 state=1073741824 0x55cf61e99180] 2023-10-03T19:20:55.610 INFO:teuthology.orchestra.run.smithi045.stdout: -2599> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.610 INFO:teuthology.orchestra.run.smithi045.stdout: -2598> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000297 [2,head] /dc-dir/dc-file_162 auth v2724 s=3 n(v0 rc2023-10-03T19:13:36.305479+0000 b3 1=1+0) (iversion lock) 0x55cf61e9c680] 2023-10-03T19:20:55.610 INFO:teuthology.orchestra.run.smithi045.stdout: -2597> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_162 [2,head] auth (dversion lock) v=2724 ino=0x10000000297 state=1073741824 0x55cf61e99180] [inode 0x10000000297 [2,head] /dc-dir/dc-file_162 auth v2724 s=3 n(v0 rc2023-10-03T19:13:36.305479+0000 b3 1=1+0) (iversion lock) 0x55cf61e9c680] 2023-10-03T19:20:55.610 INFO:teuthology.orchestra.run.smithi045.stdout: -2596> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000297 [2,head] #10000000297 auth v2724 s=3 n(v0 rc2023-10-03T19:13:36.305479+0000 b3 1=1+0) (iversion lock) 0x55cf61e9c680] 2023-10-03T19:20:55.611 INFO:teuthology.orchestra.run.smithi045.stdout: -2595> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_162 [2,head] auth NULL (dversion lock) v=2724 ino=(nil) state=1073741824 0x55cf61e99180] 2023-10-03T19:20:55.611 INFO:teuthology.orchestra.run.smithi045.stdout: -2594> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_161 [2,head] auth (dversion lock) v=2722 ino=0x10000000296 state=1073741824 0x55cf61e98f00] 2023-10-03T19:20:55.611 INFO:teuthology.orchestra.run.smithi045.stdout: -2593> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.611 INFO:teuthology.orchestra.run.smithi045.stdout: -2592> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000296 [2,head] /dc-dir/dc-file_161 auth v2722 s=3 n(v0 rc2023-10-03T19:13:36.293099+0000 b3 1=1+0) (iversion lock) 0x55cf61e9c100] 2023-10-03T19:20:55.611 INFO:teuthology.orchestra.run.smithi045.stdout: -2591> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_161 [2,head] auth (dversion lock) v=2722 ino=0x10000000296 state=1073741824 0x55cf61e98f00] [inode 0x10000000296 [2,head] /dc-dir/dc-file_161 auth v2722 s=3 n(v0 rc2023-10-03T19:13:36.293099+0000 b3 1=1+0) (iversion lock) 0x55cf61e9c100] 2023-10-03T19:20:55.611 INFO:teuthology.orchestra.run.smithi045.stdout: -2590> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000296 [2,head] #10000000296 auth v2722 s=3 n(v0 rc2023-10-03T19:13:36.293099+0000 b3 1=1+0) (iversion lock) 0x55cf61e9c100] 2023-10-03T19:20:55.611 INFO:teuthology.orchestra.run.smithi045.stdout: -2589> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_161 [2,head] auth NULL (dversion lock) v=2722 ino=(nil) state=1073741824 0x55cf61e98f00] 2023-10-03T19:20:55.611 INFO:teuthology.orchestra.run.smithi045.stdout: -2588> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_160 [2,head] auth (dversion lock) v=2720 ino=0x10000000295 state=1073741824 0x55cf61e98c80] 2023-10-03T19:20:55.611 INFO:teuthology.orchestra.run.smithi045.stdout: -2587> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.612 INFO:teuthology.orchestra.run.smithi045.stdout: -2586> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000295 [2,head] /dc-dir/dc-file_160 auth v2720 s=3 n(v0 rc2023-10-03T19:13:36.280029+0000 b3 1=1+0) (iversion lock) 0x55cf61e9bb80] 2023-10-03T19:20:55.612 INFO:teuthology.orchestra.run.smithi045.stdout: -2585> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_160 [2,head] auth (dversion lock) v=2720 ino=0x10000000295 state=1073741824 0x55cf61e98c80] [inode 0x10000000295 [2,head] /dc-dir/dc-file_160 auth v2720 s=3 n(v0 rc2023-10-03T19:13:36.280029+0000 b3 1=1+0) (iversion lock) 0x55cf61e9bb80] 2023-10-03T19:20:55.612 INFO:teuthology.orchestra.run.smithi045.stdout: -2584> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000295 [2,head] #10000000295 auth v2720 s=3 n(v0 rc2023-10-03T19:13:36.280029+0000 b3 1=1+0) (iversion lock) 0x55cf61e9bb80] 2023-10-03T19:20:55.612 INFO:teuthology.orchestra.run.smithi045.stdout: -2583> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_160 [2,head] auth NULL (dversion lock) v=2720 ino=(nil) state=1073741824 0x55cf61e98c80] 2023-10-03T19:20:55.612 INFO:teuthology.orchestra.run.smithi045.stdout: -2582> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_159 [2,head] auth (dversion lock) v=2718 ino=0x10000000294 state=1073741824 0x55cf61e98a00] 2023-10-03T19:20:55.612 INFO:teuthology.orchestra.run.smithi045.stdout: -2581> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.612 INFO:teuthology.orchestra.run.smithi045.stdout: -2580> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000294 [2,head] /dc-dir/dc-file_159 auth v2718 s=3 n(v0 rc2023-10-03T19:13:36.266700+0000 b3 1=1+0) (iversion lock) 0x55cf61e9b600] 2023-10-03T19:20:55.612 INFO:teuthology.orchestra.run.smithi045.stdout: -2579> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_159 [2,head] auth (dversion lock) v=2718 ino=0x10000000294 state=1073741824 0x55cf61e98a00] [inode 0x10000000294 [2,head] /dc-dir/dc-file_159 auth v2718 s=3 n(v0 rc2023-10-03T19:13:36.266700+0000 b3 1=1+0) (iversion lock) 0x55cf61e9b600] 2023-10-03T19:20:55.612 INFO:teuthology.orchestra.run.smithi045.stdout: -2578> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000294 [2,head] #10000000294 auth v2718 s=3 n(v0 rc2023-10-03T19:13:36.266700+0000 b3 1=1+0) (iversion lock) 0x55cf61e9b600] 2023-10-03T19:20:55.612 INFO:teuthology.orchestra.run.smithi045.stdout: -2577> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_159 [2,head] auth NULL (dversion lock) v=2718 ino=(nil) state=1073741824 0x55cf61e98a00] 2023-10-03T19:20:55.612 INFO:teuthology.orchestra.run.smithi045.stdout: -2576> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_158 [2,head] auth (dversion lock) v=2716 ino=0x10000000293 state=1073741824 0x55cf61e98780] 2023-10-03T19:20:55.613 INFO:teuthology.orchestra.run.smithi045.stdout: -2575> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.613 INFO:teuthology.orchestra.run.smithi045.stdout: -2574> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000293 [2,head] /dc-dir/dc-file_158 auth v2716 s=3 n(v0 rc2023-10-03T19:13:36.253806+0000 b3 1=1+0) (iversion lock) 0x55cf61e9b080] 2023-10-03T19:20:55.613 INFO:teuthology.orchestra.run.smithi045.stdout: -2573> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_158 [2,head] auth (dversion lock) v=2716 ino=0x10000000293 state=1073741824 0x55cf61e98780] [inode 0x10000000293 [2,head] /dc-dir/dc-file_158 auth v2716 s=3 n(v0 rc2023-10-03T19:13:36.253806+0000 b3 1=1+0) (iversion lock) 0x55cf61e9b080] 2023-10-03T19:20:55.613 INFO:teuthology.orchestra.run.smithi045.stdout: -2572> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000293 [2,head] #10000000293 auth v2716 s=3 n(v0 rc2023-10-03T19:13:36.253806+0000 b3 1=1+0) (iversion lock) 0x55cf61e9b080] 2023-10-03T19:20:55.613 INFO:teuthology.orchestra.run.smithi045.stdout: -2571> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_158 [2,head] auth NULL (dversion lock) v=2716 ino=(nil) state=1073741824 0x55cf61e98780] 2023-10-03T19:20:55.613 INFO:teuthology.orchestra.run.smithi045.stdout: -2570> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_157 [2,head] auth (dversion lock) v=2714 ino=0x10000000292 state=1073741824 0x55cf61e98500] 2023-10-03T19:20:55.613 INFO:teuthology.orchestra.run.smithi045.stdout: -2569> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.613 INFO:teuthology.orchestra.run.smithi045.stdout: -2568> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000292 [2,head] /dc-dir/dc-file_157 auth v2714 s=3 n(v0 rc2023-10-03T19:13:36.241841+0000 b3 1=1+0) (iversion lock) 0x55cf61e9ab00] 2023-10-03T19:20:55.613 INFO:teuthology.orchestra.run.smithi045.stdout: -2567> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_157 [2,head] auth (dversion lock) v=2714 ino=0x10000000292 state=1073741824 0x55cf61e98500] [inode 0x10000000292 [2,head] /dc-dir/dc-file_157 auth v2714 s=3 n(v0 rc2023-10-03T19:13:36.241841+0000 b3 1=1+0) (iversion lock) 0x55cf61e9ab00] 2023-10-03T19:20:55.613 INFO:teuthology.orchestra.run.smithi045.stdout: -2566> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000292 [2,head] #10000000292 auth v2714 s=3 n(v0 rc2023-10-03T19:13:36.241841+0000 b3 1=1+0) (iversion lock) 0x55cf61e9ab00] 2023-10-03T19:20:55.613 INFO:teuthology.orchestra.run.smithi045.stdout: -2565> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_157 [2,head] auth NULL (dversion lock) v=2714 ino=(nil) state=1073741824 0x55cf61e98500] 2023-10-03T19:20:55.613 INFO:teuthology.orchestra.run.smithi045.stdout: -2564> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_156 [2,head] auth (dversion lock) v=2712 ino=0x10000000291 state=1073741824 0x55cf61e98280] 2023-10-03T19:20:55.613 INFO:teuthology.orchestra.run.smithi045.stdout: -2563> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.614 INFO:teuthology.orchestra.run.smithi045.stdout: -2562> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000291 [2,head] /dc-dir/dc-file_156 auth v2712 s=3 n(v0 rc2023-10-03T19:13:36.230928+0000 b3 1=1+0) (iversion lock) 0x55cf61e9a580] 2023-10-03T19:20:55.614 INFO:teuthology.orchestra.run.smithi045.stdout: -2561> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_156 [2,head] auth (dversion lock) v=2712 ino=0x10000000291 state=1073741824 0x55cf61e98280] [inode 0x10000000291 [2,head] /dc-dir/dc-file_156 auth v2712 s=3 n(v0 rc2023-10-03T19:13:36.230928+0000 b3 1=1+0) (iversion lock) 0x55cf61e9a580] 2023-10-03T19:20:55.614 INFO:teuthology.orchestra.run.smithi045.stdout: -2560> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000291 [2,head] #10000000291 auth v2712 s=3 n(v0 rc2023-10-03T19:13:36.230928+0000 b3 1=1+0) (iversion lock) 0x55cf61e9a580] 2023-10-03T19:20:55.614 INFO:teuthology.orchestra.run.smithi045.stdout: -2559> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_156 [2,head] auth NULL (dversion lock) v=2712 ino=(nil) state=1073741824 0x55cf61e98280] 2023-10-03T19:20:55.614 INFO:teuthology.orchestra.run.smithi045.stdout: -2558> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_155 [2,head] auth (dversion lock) v=2710 ino=0x10000000290 state=1073741824 0x55cf61e98000] 2023-10-03T19:20:55.614 INFO:teuthology.orchestra.run.smithi045.stdout: -2557> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.614 INFO:teuthology.orchestra.run.smithi045.stdout: -2556> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000290 [2,head] /dc-dir/dc-file_155 auth v2710 s=3 n(v0 rc2023-10-03T19:13:36.220622+0000 b3 1=1+0) (iversion lock) 0x55cf61e9a000] 2023-10-03T19:20:55.720 INFO:teuthology.orchestra.run.smithi045.stdout: -2555> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_155 [2,head] auth (dversion lock) v=2710 ino=0x10000000290 state=1073741824 0x55cf61e98000] [inode 0x10000000290 [2,head] /dc-dir/dc-file_155 auth v2710 s=3 n(v0 rc2023-10-03T19:13:36.220622+0000 b3 1=1+0) (iversion lock) 0x55cf61e9a000] 2023-10-03T19:20:55.720 INFO:teuthology.orchestra.run.smithi045.stdout: -2554> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000290 [2,head] #10000000290 auth v2710 s=3 n(v0 rc2023-10-03T19:13:36.220622+0000 b3 1=1+0) (iversion lock) 0x55cf61e9a000] 2023-10-03T19:20:55.720 INFO:teuthology.orchestra.run.smithi045.stdout: -2553> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_155 [2,head] auth NULL (dversion lock) v=2710 ino=(nil) state=1073741824 0x55cf61e98000] 2023-10-03T19:20:55.720 INFO:teuthology.orchestra.run.smithi045.stdout: -2552> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_154 [2,head] auth (dversion lock) v=2708 ino=0x1000000028f state=1073741824 0x55cf61d6bb80] 2023-10-03T19:20:55.721 INFO:teuthology.orchestra.run.smithi045.stdout: -2551> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.721 INFO:teuthology.orchestra.run.smithi045.stdout: -2550> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000028f [2,head] /dc-dir/dc-file_154 auth v2708 s=3 n(v0 rc2023-10-03T19:13:36.209991+0000 b3 1=1+0) (iversion lock) 0x55cf61e91700] 2023-10-03T19:20:55.721 INFO:teuthology.orchestra.run.smithi045.stdout: -2549> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_154 [2,head] auth (dversion lock) v=2708 ino=0x1000000028f state=1073741824 0x55cf61d6bb80] [inode 0x1000000028f [2,head] /dc-dir/dc-file_154 auth v2708 s=3 n(v0 rc2023-10-03T19:13:36.209991+0000 b3 1=1+0) (iversion lock) 0x55cf61e91700] 2023-10-03T19:20:55.721 INFO:teuthology.orchestra.run.smithi045.stdout: -2548> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000028f [2,head] #1000000028f auth v2708 s=3 n(v0 rc2023-10-03T19:13:36.209991+0000 b3 1=1+0) (iversion lock) 0x55cf61e91700] 2023-10-03T19:20:55.721 INFO:teuthology.orchestra.run.smithi045.stdout: -2547> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_154 [2,head] auth NULL (dversion lock) v=2708 ino=(nil) state=1073741824 0x55cf61d6bb80] 2023-10-03T19:20:55.721 INFO:teuthology.orchestra.run.smithi045.stdout: -2546> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_153 [2,head] auth (dversion lock) v=2706 ino=0x1000000028e state=1073741824 0x55cf61d6b900] 2023-10-03T19:20:55.721 INFO:teuthology.orchestra.run.smithi045.stdout: -2545> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.721 INFO:teuthology.orchestra.run.smithi045.stdout: -2544> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000028e [2,head] /dc-dir/dc-file_153 auth v2706 s=3 n(v0 rc2023-10-03T19:13:36.199376+0000 b3 1=1+0) (iversion lock) 0x55cf61e91180] 2023-10-03T19:20:55.722 INFO:teuthology.orchestra.run.smithi045.stdout: -2543> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_153 [2,head] auth (dversion lock) v=2706 ino=0x1000000028e state=1073741824 0x55cf61d6b900] [inode 0x1000000028e [2,head] /dc-dir/dc-file_153 auth v2706 s=3 n(v0 rc2023-10-03T19:13:36.199376+0000 b3 1=1+0) (iversion lock) 0x55cf61e91180] 2023-10-03T19:20:55.722 INFO:teuthology.orchestra.run.smithi045.stdout: -2542> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000028e [2,head] #1000000028e auth v2706 s=3 n(v0 rc2023-10-03T19:13:36.199376+0000 b3 1=1+0) (iversion lock) 0x55cf61e91180] 2023-10-03T19:20:55.722 INFO:teuthology.orchestra.run.smithi045.stdout: -2541> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_153 [2,head] auth NULL (dversion lock) v=2706 ino=(nil) state=1073741824 0x55cf61d6b900] 2023-10-03T19:20:55.722 INFO:teuthology.orchestra.run.smithi045.stdout: -2540> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_152 [2,head] auth (dversion lock) v=2704 ino=0x1000000028d state=1073741824 0x55cf61d6b680] 2023-10-03T19:20:55.722 INFO:teuthology.orchestra.run.smithi045.stdout: -2539> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.722 INFO:teuthology.orchestra.run.smithi045.stdout: -2538> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000028d [2,head] /dc-dir/dc-file_152 auth v2704 s=3 n(v0 rc2023-10-03T19:13:36.187825+0000 b3 1=1+0) (iversion lock) 0x55cf61e90c00] 2023-10-03T19:20:55.722 INFO:teuthology.orchestra.run.smithi045.stdout: -2537> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_152 [2,head] auth (dversion lock) v=2704 ino=0x1000000028d state=1073741824 0x55cf61d6b680] [inode 0x1000000028d [2,head] /dc-dir/dc-file_152 auth v2704 s=3 n(v0 rc2023-10-03T19:13:36.187825+0000 b3 1=1+0) (iversion lock) 0x55cf61e90c00] 2023-10-03T19:20:55.722 INFO:teuthology.orchestra.run.smithi045.stdout: -2536> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000028d [2,head] #1000000028d auth v2704 s=3 n(v0 rc2023-10-03T19:13:36.187825+0000 b3 1=1+0) (iversion lock) 0x55cf61e90c00] 2023-10-03T19:20:55.722 INFO:teuthology.orchestra.run.smithi045.stdout: -2535> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_152 [2,head] auth NULL (dversion lock) v=2704 ino=(nil) state=1073741824 0x55cf61d6b680] 2023-10-03T19:20:55.722 INFO:teuthology.orchestra.run.smithi045.stdout: -2534> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_151 [2,head] auth (dversion lock) v=2702 ino=0x1000000028c state=1073741824 0x55cf61d6b400] 2023-10-03T19:20:55.722 INFO:teuthology.orchestra.run.smithi045.stdout: -2533> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.723 INFO:teuthology.orchestra.run.smithi045.stdout: -2532> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000028c [2,head] /dc-dir/dc-file_151 auth v2702 s=3 n(v0 rc2023-10-03T19:13:36.175437+0000 b3 1=1+0) (iversion lock) 0x55cf61e90680] 2023-10-03T19:20:55.723 INFO:teuthology.orchestra.run.smithi045.stdout: -2531> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_151 [2,head] auth (dversion lock) v=2702 ino=0x1000000028c state=1073741824 0x55cf61d6b400] [inode 0x1000000028c [2,head] /dc-dir/dc-file_151 auth v2702 s=3 n(v0 rc2023-10-03T19:13:36.175437+0000 b3 1=1+0) (iversion lock) 0x55cf61e90680] 2023-10-03T19:20:55.723 INFO:teuthology.orchestra.run.smithi045.stdout: -2530> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000028c [2,head] #1000000028c auth v2702 s=3 n(v0 rc2023-10-03T19:13:36.175437+0000 b3 1=1+0) (iversion lock) 0x55cf61e90680] 2023-10-03T19:20:55.723 INFO:teuthology.orchestra.run.smithi045.stdout: -2529> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_151 [2,head] auth NULL (dversion lock) v=2702 ino=(nil) state=1073741824 0x55cf61d6b400] 2023-10-03T19:20:55.723 INFO:teuthology.orchestra.run.smithi045.stdout: -2528> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_150 [2,head] auth (dversion lock) v=2700 ino=0x1000000028b state=1073741824 0x55cf61d6b180] 2023-10-03T19:20:55.723 INFO:teuthology.orchestra.run.smithi045.stdout: -2527> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.723 INFO:teuthology.orchestra.run.smithi045.stdout: -2526> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000028b [2,head] /dc-dir/dc-file_150 auth v2700 s=3 n(v0 rc2023-10-03T19:13:36.164550+0000 b3 1=1+0) (iversion lock) 0x55cf61e90100] 2023-10-03T19:20:55.723 INFO:teuthology.orchestra.run.smithi045.stdout: -2525> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_150 [2,head] auth (dversion lock) v=2700 ino=0x1000000028b state=1073741824 0x55cf61d6b180] [inode 0x1000000028b [2,head] /dc-dir/dc-file_150 auth v2700 s=3 n(v0 rc2023-10-03T19:13:36.164550+0000 b3 1=1+0) (iversion lock) 0x55cf61e90100] 2023-10-03T19:20:55.723 INFO:teuthology.orchestra.run.smithi045.stdout: -2524> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000028b [2,head] #1000000028b auth v2700 s=3 n(v0 rc2023-10-03T19:13:36.164550+0000 b3 1=1+0) (iversion lock) 0x55cf61e90100] 2023-10-03T19:20:55.723 INFO:teuthology.orchestra.run.smithi045.stdout: -2523> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_150 [2,head] auth NULL (dversion lock) v=2700 ino=(nil) state=1073741824 0x55cf61d6b180] 2023-10-03T19:20:55.723 INFO:teuthology.orchestra.run.smithi045.stdout: -2522> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_149 [2,head] auth (dversion lock) v=2698 ino=0x1000000028a state=1073741824 0x55cf61d6af00] 2023-10-03T19:20:55.724 INFO:teuthology.orchestra.run.smithi045.stdout: -2521> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.724 INFO:teuthology.orchestra.run.smithi045.stdout: -2520> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000028a [2,head] /dc-dir/dc-file_149 auth v2698 s=3 n(v0 rc2023-10-03T19:13:36.152377+0000 b3 1=1+0) (iversion lock) 0x55cf61e8fb80] 2023-10-03T19:20:55.724 INFO:teuthology.orchestra.run.smithi045.stdout: -2519> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_149 [2,head] auth (dversion lock) v=2698 ino=0x1000000028a state=1073741824 0x55cf61d6af00] [inode 0x1000000028a [2,head] /dc-dir/dc-file_149 auth v2698 s=3 n(v0 rc2023-10-03T19:13:36.152377+0000 b3 1=1+0) (iversion lock) 0x55cf61e8fb80] 2023-10-03T19:20:55.724 INFO:teuthology.orchestra.run.smithi045.stdout: -2518> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000028a [2,head] #1000000028a auth v2698 s=3 n(v0 rc2023-10-03T19:13:36.152377+0000 b3 1=1+0) (iversion lock) 0x55cf61e8fb80] 2023-10-03T19:20:55.724 INFO:teuthology.orchestra.run.smithi045.stdout: -2517> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_149 [2,head] auth NULL (dversion lock) v=2698 ino=(nil) state=1073741824 0x55cf61d6af00] 2023-10-03T19:20:55.724 INFO:teuthology.orchestra.run.smithi045.stdout: -2516> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_148 [2,head] auth (dversion lock) v=2696 ino=0x10000000289 state=1073741824 0x55cf61d6ac80] 2023-10-03T19:20:55.724 INFO:teuthology.orchestra.run.smithi045.stdout: -2515> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.724 INFO:teuthology.orchestra.run.smithi045.stdout: -2514> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000289 [2,head] /dc-dir/dc-file_148 auth v2696 s=3 n(v0 rc2023-10-03T19:13:36.141399+0000 b3 1=1+0) (iversion lock) 0x55cf61e8f600] 2023-10-03T19:20:55.725 INFO:teuthology.orchestra.run.smithi045.stdout: -2513> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_148 [2,head] auth (dversion lock) v=2696 ino=0x10000000289 state=1073741824 0x55cf61d6ac80] [inode 0x10000000289 [2,head] /dc-dir/dc-file_148 auth v2696 s=3 n(v0 rc2023-10-03T19:13:36.141399+0000 b3 1=1+0) (iversion lock) 0x55cf61e8f600] 2023-10-03T19:20:55.725 INFO:teuthology.orchestra.run.smithi045.stdout: -2512> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000289 [2,head] #10000000289 auth v2696 s=3 n(v0 rc2023-10-03T19:13:36.141399+0000 b3 1=1+0) (iversion lock) 0x55cf61e8f600] 2023-10-03T19:20:55.725 INFO:teuthology.orchestra.run.smithi045.stdout: -2511> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_148 [2,head] auth NULL (dversion lock) v=2696 ino=(nil) state=1073741824 0x55cf61d6ac80] 2023-10-03T19:20:55.725 INFO:teuthology.orchestra.run.smithi045.stdout: -2510> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_147 [2,head] auth (dversion lock) v=2694 ino=0x10000000288 state=1073741824 0x55cf61d6aa00] 2023-10-03T19:20:55.725 INFO:teuthology.orchestra.run.smithi045.stdout: -2509> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.725 INFO:teuthology.orchestra.run.smithi045.stdout: -2508> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000288 [2,head] /dc-dir/dc-file_147 auth v2694 s=3 n(v0 rc2023-10-03T19:13:36.129640+0000 b3 1=1+0) (iversion lock) 0x55cf61e8f080] 2023-10-03T19:20:55.725 INFO:teuthology.orchestra.run.smithi045.stdout: -2507> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_147 [2,head] auth (dversion lock) v=2694 ino=0x10000000288 state=1073741824 0x55cf61d6aa00] [inode 0x10000000288 [2,head] /dc-dir/dc-file_147 auth v2694 s=3 n(v0 rc2023-10-03T19:13:36.129640+0000 b3 1=1+0) (iversion lock) 0x55cf61e8f080] 2023-10-03T19:20:55.725 INFO:teuthology.orchestra.run.smithi045.stdout: -2506> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000288 [2,head] #10000000288 auth v2694 s=3 n(v0 rc2023-10-03T19:13:36.129640+0000 b3 1=1+0) (iversion lock) 0x55cf61e8f080] 2023-10-03T19:20:55.726 INFO:teuthology.orchestra.run.smithi045.stdout: -2505> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_147 [2,head] auth NULL (dversion lock) v=2694 ino=(nil) state=1073741824 0x55cf61d6aa00] 2023-10-03T19:20:55.726 INFO:teuthology.orchestra.run.smithi045.stdout: -2504> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_146 [2,head] auth (dversion lock) v=2692 ino=0x10000000287 state=1073741824 0x55cf61d6a780] 2023-10-03T19:20:55.726 INFO:teuthology.orchestra.run.smithi045.stdout: -2503> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.726 INFO:teuthology.orchestra.run.smithi045.stdout: -2502> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000287 [2,head] /dc-dir/dc-file_146 auth v2692 s=3 n(v0 rc2023-10-03T19:13:36.118833+0000 b3 1=1+0) (iversion lock) 0x55cf61e8eb00] 2023-10-03T19:20:55.726 INFO:teuthology.orchestra.run.smithi045.stdout: -2501> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_146 [2,head] auth (dversion lock) v=2692 ino=0x10000000287 state=1073741824 0x55cf61d6a780] [inode 0x10000000287 [2,head] /dc-dir/dc-file_146 auth v2692 s=3 n(v0 rc2023-10-03T19:13:36.118833+0000 b3 1=1+0) (iversion lock) 0x55cf61e8eb00] 2023-10-03T19:20:55.726 INFO:teuthology.orchestra.run.smithi045.stdout: -2500> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000287 [2,head] #10000000287 auth v2692 s=3 n(v0 rc2023-10-03T19:13:36.118833+0000 b3 1=1+0) (iversion lock) 0x55cf61e8eb00] 2023-10-03T19:20:55.726 INFO:teuthology.orchestra.run.smithi045.stdout: -2499> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_146 [2,head] auth NULL (dversion lock) v=2692 ino=(nil) state=1073741824 0x55cf61d6a780] 2023-10-03T19:20:55.726 INFO:teuthology.orchestra.run.smithi045.stdout: -2498> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_145 [2,head] auth (dversion lock) v=2690 ino=0x10000000286 state=1073741824 0x55cf61d6a500] 2023-10-03T19:20:55.726 INFO:teuthology.orchestra.run.smithi045.stdout: -2497> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.726 INFO:teuthology.orchestra.run.smithi045.stdout: -2496> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000286 [2,head] /dc-dir/dc-file_145 auth v2690 s=3 n(v0 rc2023-10-03T19:13:36.107008+0000 b3 1=1+0) (iversion lock) 0x55cf61e8e580] 2023-10-03T19:20:55.727 INFO:teuthology.orchestra.run.smithi045.stdout: -2495> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_145 [2,head] auth (dversion lock) v=2690 ino=0x10000000286 state=1073741824 0x55cf61d6a500] [inode 0x10000000286 [2,head] /dc-dir/dc-file_145 auth v2690 s=3 n(v0 rc2023-10-03T19:13:36.107008+0000 b3 1=1+0) (iversion lock) 0x55cf61e8e580] 2023-10-03T19:20:55.727 INFO:teuthology.orchestra.run.smithi045.stdout: -2494> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000286 [2,head] #10000000286 auth v2690 s=3 n(v0 rc2023-10-03T19:13:36.107008+0000 b3 1=1+0) (iversion lock) 0x55cf61e8e580] 2023-10-03T19:20:55.727 INFO:teuthology.orchestra.run.smithi045.stdout: -2493> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_145 [2,head] auth NULL (dversion lock) v=2690 ino=(nil) state=1073741824 0x55cf61d6a500] 2023-10-03T19:20:55.733 INFO:teuthology.orchestra.run.smithi045.stdout: -2492> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_144 [2,head] auth (dversion lock) v=2688 ino=0x10000000285 state=1073741824 0x55cf61d6a280] 2023-10-03T19:20:55.733 INFO:teuthology.orchestra.run.smithi045.stdout: -2491> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.734 INFO:teuthology.orchestra.run.smithi045.stdout: -2490> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000285 [2,head] /dc-dir/dc-file_144 auth v2688 s=3 n(v0 rc2023-10-03T19:13:36.095935+0000 b3 1=1+0) (iversion lock) 0x55cf61e8e000] 2023-10-03T19:20:55.734 INFO:teuthology.orchestra.run.smithi045.stdout: -2489> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_144 [2,head] auth (dversion lock) v=2688 ino=0x10000000285 state=1073741824 0x55cf61d6a280] [inode 0x10000000285 [2,head] /dc-dir/dc-file_144 auth v2688 s=3 n(v0 rc2023-10-03T19:13:36.095935+0000 b3 1=1+0) (iversion lock) 0x55cf61e8e000] 2023-10-03T19:20:55.734 INFO:teuthology.orchestra.run.smithi045.stdout: -2488> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000285 [2,head] #10000000285 auth v2688 s=3 n(v0 rc2023-10-03T19:13:36.095935+0000 b3 1=1+0) (iversion lock) 0x55cf61e8e000] 2023-10-03T19:20:55.734 INFO:teuthology.orchestra.run.smithi045.stdout: -2487> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_144 [2,head] auth NULL (dversion lock) v=2688 ino=(nil) state=1073741824 0x55cf61d6a280] 2023-10-03T19:20:55.734 INFO:teuthology.orchestra.run.smithi045.stdout: -2486> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_143 [2,head] auth (dversion lock) v=2686 ino=0x10000000284 state=1073741824 0x55cf61d6a000] 2023-10-03T19:20:55.734 INFO:teuthology.orchestra.run.smithi045.stdout: -2485> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.734 INFO:teuthology.orchestra.run.smithi045.stdout: -2484> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000284 [2,head] /dc-dir/dc-file_143 auth v2686 s=3 n(v0 rc2023-10-03T19:13:36.083578+0000 b3 1=1+0) (iversion lock) 0x55cf620bf700] 2023-10-03T19:20:55.734 INFO:teuthology.orchestra.run.smithi045.stdout: -2483> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_143 [2,head] auth (dversion lock) v=2686 ino=0x10000000284 state=1073741824 0x55cf61d6a000] [inode 0x10000000284 [2,head] /dc-dir/dc-file_143 auth v2686 s=3 n(v0 rc2023-10-03T19:13:36.083578+0000 b3 1=1+0) (iversion lock) 0x55cf620bf700] 2023-10-03T19:20:55.734 INFO:teuthology.orchestra.run.smithi045.stdout: -2482> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000284 [2,head] #10000000284 auth v2686 s=3 n(v0 rc2023-10-03T19:13:36.083578+0000 b3 1=1+0) (iversion lock) 0x55cf620bf700] 2023-10-03T19:20:55.734 INFO:teuthology.orchestra.run.smithi045.stdout: -2481> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_143 [2,head] auth NULL (dversion lock) v=2686 ino=(nil) state=1073741824 0x55cf61d6a000] 2023-10-03T19:20:55.734 INFO:teuthology.orchestra.run.smithi045.stdout: -2480> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_142 [2,head] auth (dversion lock) v=2684 ino=0x10000000283 state=1073741824 0x55cf620bbb80] 2023-10-03T19:20:55.735 INFO:teuthology.orchestra.run.smithi045.stdout: -2479> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.735 INFO:teuthology.orchestra.run.smithi045.stdout: -2478> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000283 [2,head] /dc-dir/dc-file_142 auth v2684 s=3 n(v0 rc2023-10-03T19:13:36.072540+0000 b3 1=1+0) (iversion lock) 0x55cf620bf180] 2023-10-03T19:20:55.735 INFO:teuthology.orchestra.run.smithi045.stdout: -2477> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_142 [2,head] auth (dversion lock) v=2684 ino=0x10000000283 state=1073741824 0x55cf620bbb80] [inode 0x10000000283 [2,head] /dc-dir/dc-file_142 auth v2684 s=3 n(v0 rc2023-10-03T19:13:36.072540+0000 b3 1=1+0) (iversion lock) 0x55cf620bf180] 2023-10-03T19:20:55.735 INFO:teuthology.orchestra.run.smithi045.stdout: -2476> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000283 [2,head] #10000000283 auth v2684 s=3 n(v0 rc2023-10-03T19:13:36.072540+0000 b3 1=1+0) (iversion lock) 0x55cf620bf180] 2023-10-03T19:20:55.735 INFO:teuthology.orchestra.run.smithi045.stdout: -2475> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_142 [2,head] auth NULL (dversion lock) v=2684 ino=(nil) state=1073741824 0x55cf620bbb80] 2023-10-03T19:20:55.735 INFO:teuthology.orchestra.run.smithi045.stdout: -2474> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_141 [2,head] auth (dversion lock) v=2682 ino=0x10000000282 state=1073741824 0x55cf620bb900] 2023-10-03T19:20:55.735 INFO:teuthology.orchestra.run.smithi045.stdout: -2473> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.735 INFO:teuthology.orchestra.run.smithi045.stdout: -2472> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000282 [2,head] /dc-dir/dc-file_141 auth v2682 s=3 n(v0 rc2023-10-03T19:13:36.061637+0000 b3 1=1+0) (iversion lock) 0x55cf620bec00] 2023-10-03T19:20:55.735 INFO:teuthology.orchestra.run.smithi045.stdout: -2471> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_141 [2,head] auth (dversion lock) v=2682 ino=0x10000000282 state=1073741824 0x55cf620bb900] [inode 0x10000000282 [2,head] /dc-dir/dc-file_141 auth v2682 s=3 n(v0 rc2023-10-03T19:13:36.061637+0000 b3 1=1+0) (iversion lock) 0x55cf620bec00] 2023-10-03T19:20:55.735 INFO:teuthology.orchestra.run.smithi045.stdout: -2470> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000282 [2,head] #10000000282 auth v2682 s=3 n(v0 rc2023-10-03T19:13:36.061637+0000 b3 1=1+0) (iversion lock) 0x55cf620bec00] 2023-10-03T19:20:55.735 INFO:teuthology.orchestra.run.smithi045.stdout: -2469> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_141 [2,head] auth NULL (dversion lock) v=2682 ino=(nil) state=1073741824 0x55cf620bb900] 2023-10-03T19:20:55.736 INFO:teuthology.orchestra.run.smithi045.stdout: -2468> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_140 [2,head] auth (dversion lock) v=2680 ino=0x10000000281 state=1073741824 0x55cf620bb680] 2023-10-03T19:20:55.736 INFO:teuthology.orchestra.run.smithi045.stdout: -2467> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.736 INFO:teuthology.orchestra.run.smithi045.stdout: -2466> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000281 [2,head] /dc-dir/dc-file_140 auth v2680 s=3 n(v0 rc2023-10-03T19:13:36.049633+0000 b3 1=1+0) (iversion lock) 0x55cf620be680] 2023-10-03T19:20:55.736 INFO:teuthology.orchestra.run.smithi045.stdout: -2465> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_140 [2,head] auth (dversion lock) v=2680 ino=0x10000000281 state=1073741824 0x55cf620bb680] [inode 0x10000000281 [2,head] /dc-dir/dc-file_140 auth v2680 s=3 n(v0 rc2023-10-03T19:13:36.049633+0000 b3 1=1+0) (iversion lock) 0x55cf620be680] 2023-10-03T19:20:55.736 INFO:teuthology.orchestra.run.smithi045.stdout: -2464> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000281 [2,head] #10000000281 auth v2680 s=3 n(v0 rc2023-10-03T19:13:36.049633+0000 b3 1=1+0) (iversion lock) 0x55cf620be680] 2023-10-03T19:20:55.736 INFO:teuthology.orchestra.run.smithi045.stdout: -2463> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_140 [2,head] auth NULL (dversion lock) v=2680 ino=(nil) state=1073741824 0x55cf620bb680] 2023-10-03T19:20:55.736 INFO:teuthology.orchestra.run.smithi045.stdout: -2462> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_139 [2,head] auth (dversion lock) v=2678 ino=0x10000000280 state=1073741824 0x55cf620bb400] 2023-10-03T19:20:55.736 INFO:teuthology.orchestra.run.smithi045.stdout: -2461> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.737 INFO:teuthology.orchestra.run.smithi045.stdout: -2460> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000280 [2,head] /dc-dir/dc-file_139 auth v2678 s=3 n(v0 rc2023-10-03T19:13:36.038678+0000 b3 1=1+0) (iversion lock) 0x55cf620be100] 2023-10-03T19:20:55.737 INFO:teuthology.orchestra.run.smithi045.stdout: -2459> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_139 [2,head] auth (dversion lock) v=2678 ino=0x10000000280 state=1073741824 0x55cf620bb400] [inode 0x10000000280 [2,head] /dc-dir/dc-file_139 auth v2678 s=3 n(v0 rc2023-10-03T19:13:36.038678+0000 b3 1=1+0) (iversion lock) 0x55cf620be100] 2023-10-03T19:20:55.737 INFO:teuthology.orchestra.run.smithi045.stdout: -2458> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000280 [2,head] #10000000280 auth v2678 s=3 n(v0 rc2023-10-03T19:13:36.038678+0000 b3 1=1+0) (iversion lock) 0x55cf620be100] 2023-10-03T19:20:55.737 INFO:teuthology.orchestra.run.smithi045.stdout: -2457> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_139 [2,head] auth NULL (dversion lock) v=2678 ino=(nil) state=1073741824 0x55cf620bb400] 2023-10-03T19:20:55.737 INFO:teuthology.orchestra.run.smithi045.stdout: -2456> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_138 [2,head] auth (dversion lock) v=2676 ino=0x1000000027f state=1073741824 0x55cf620bb180] 2023-10-03T19:20:55.737 INFO:teuthology.orchestra.run.smithi045.stdout: -2455> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.737 INFO:teuthology.orchestra.run.smithi045.stdout: -2454> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000027f [2,head] /dc-dir/dc-file_138 auth v2676 s=3 n(v0 rc2023-10-03T19:13:36.028265+0000 b3 1=1+0) (iversion lock) 0x55cf620bdb80] 2023-10-03T19:20:55.737 INFO:teuthology.orchestra.run.smithi045.stdout: -2453> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_138 [2,head] auth (dversion lock) v=2676 ino=0x1000000027f state=1073741824 0x55cf620bb180] [inode 0x1000000027f [2,head] /dc-dir/dc-file_138 auth v2676 s=3 n(v0 rc2023-10-03T19:13:36.028265+0000 b3 1=1+0) (iversion lock) 0x55cf620bdb80] 2023-10-03T19:20:55.737 INFO:teuthology.orchestra.run.smithi045.stdout: -2452> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000027f [2,head] #1000000027f auth v2676 s=3 n(v0 rc2023-10-03T19:13:36.028265+0000 b3 1=1+0) (iversion lock) 0x55cf620bdb80] 2023-10-03T19:20:55.738 INFO:teuthology.orchestra.run.smithi045.stdout: -2451> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_138 [2,head] auth NULL (dversion lock) v=2676 ino=(nil) state=1073741824 0x55cf620bb180] 2023-10-03T19:20:55.738 INFO:teuthology.orchestra.run.smithi045.stdout: -2450> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_137 [2,head] auth (dversion lock) v=2674 ino=0x1000000027e state=1073741824 0x55cf620baf00] 2023-10-03T19:20:55.738 INFO:teuthology.orchestra.run.smithi045.stdout: -2449> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.738 INFO:teuthology.orchestra.run.smithi045.stdout: -2448> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000027e [2,head] /dc-dir/dc-file_137 auth v2674 s=3 n(v0 rc2023-10-03T19:13:36.017363+0000 b3 1=1+0) (iversion lock) 0x55cf620bd600] 2023-10-03T19:20:55.738 INFO:teuthology.orchestra.run.smithi045.stdout: -2447> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_137 [2,head] auth (dversion lock) v=2674 ino=0x1000000027e state=1073741824 0x55cf620baf00] [inode 0x1000000027e [2,head] /dc-dir/dc-file_137 auth v2674 s=3 n(v0 rc2023-10-03T19:13:36.017363+0000 b3 1=1+0) (iversion lock) 0x55cf620bd600] 2023-10-03T19:20:55.738 INFO:teuthology.orchestra.run.smithi045.stdout: -2446> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000027e [2,head] #1000000027e auth v2674 s=3 n(v0 rc2023-10-03T19:13:36.017363+0000 b3 1=1+0) (iversion lock) 0x55cf620bd600] 2023-10-03T19:20:55.738 INFO:teuthology.orchestra.run.smithi045.stdout: -2445> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_137 [2,head] auth NULL (dversion lock) v=2674 ino=(nil) state=1073741824 0x55cf620baf00] 2023-10-03T19:20:55.738 INFO:teuthology.orchestra.run.smithi045.stdout: -2444> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_136 [2,head] auth (dversion lock) v=2672 ino=0x1000000027d state=1073741824 0x55cf620bac80] 2023-10-03T19:20:55.738 INFO:teuthology.orchestra.run.smithi045.stdout: -2443> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.738 INFO:teuthology.orchestra.run.smithi045.stdout: -2442> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000027d [2,head] /dc-dir/dc-file_136 auth v2672 s=3 n(v0 rc2023-10-03T19:13:36.006284+0000 b3 1=1+0) (iversion lock) 0x55cf620bd080] 2023-10-03T19:20:55.738 INFO:teuthology.orchestra.run.smithi045.stdout: -2441> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_136 [2,head] auth (dversion lock) v=2672 ino=0x1000000027d state=1073741824 0x55cf620bac80] [inode 0x1000000027d [2,head] /dc-dir/dc-file_136 auth v2672 s=3 n(v0 rc2023-10-03T19:13:36.006284+0000 b3 1=1+0) (iversion lock) 0x55cf620bd080] 2023-10-03T19:20:55.739 INFO:teuthology.orchestra.run.smithi045.stdout: -2440> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000027d [2,head] #1000000027d auth v2672 s=3 n(v0 rc2023-10-03T19:13:36.006284+0000 b3 1=1+0) (iversion lock) 0x55cf620bd080] 2023-10-03T19:20:55.739 INFO:teuthology.orchestra.run.smithi045.stdout: -2439> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_136 [2,head] auth NULL (dversion lock) v=2672 ino=(nil) state=1073741824 0x55cf620bac80] 2023-10-03T19:20:55.739 INFO:teuthology.orchestra.run.smithi045.stdout: -2438> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_135 [2,head] auth (dversion lock) v=2670 ino=0x1000000027c state=1073741824 0x55cf620baa00] 2023-10-03T19:20:55.739 INFO:teuthology.orchestra.run.smithi045.stdout: -2437> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.739 INFO:teuthology.orchestra.run.smithi045.stdout: -2436> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000027c [2,head] /dc-dir/dc-file_135 auth v2670 s=3 n(v0 rc2023-10-03T19:13:35.994941+0000 b3 1=1+0) (iversion lock) 0x55cf620bcb00] 2023-10-03T19:20:55.739 INFO:teuthology.orchestra.run.smithi045.stdout: -2435> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_135 [2,head] auth (dversion lock) v=2670 ino=0x1000000027c state=1073741824 0x55cf620baa00] [inode 0x1000000027c [2,head] /dc-dir/dc-file_135 auth v2670 s=3 n(v0 rc2023-10-03T19:13:35.994941+0000 b3 1=1+0) (iversion lock) 0x55cf620bcb00] 2023-10-03T19:20:55.739 INFO:teuthology.orchestra.run.smithi045.stdout: -2434> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000027c [2,head] #1000000027c auth v2670 s=3 n(v0 rc2023-10-03T19:13:35.994941+0000 b3 1=1+0) (iversion lock) 0x55cf620bcb00] 2023-10-03T19:20:55.739 INFO:teuthology.orchestra.run.smithi045.stdout: -2433> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_135 [2,head] auth NULL (dversion lock) v=2670 ino=(nil) state=1073741824 0x55cf620baa00] 2023-10-03T19:20:55.739 INFO:teuthology.orchestra.run.smithi045.stdout: -2432> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_134 [2,head] auth (dversion lock) v=2668 ino=0x1000000027b state=1073741824 0x55cf620ba780] 2023-10-03T19:20:55.739 INFO:teuthology.orchestra.run.smithi045.stdout: -2431> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.739 INFO:teuthology.orchestra.run.smithi045.stdout: -2430> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000027b [2,head] /dc-dir/dc-file_134 auth v2668 s=3 n(v0 rc2023-10-03T19:13:35.984103+0000 b3 1=1+0) (iversion lock) 0x55cf620bc580] 2023-10-03T19:20:55.740 INFO:teuthology.orchestra.run.smithi045.stdout: -2429> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_134 [2,head] auth (dversion lock) v=2668 ino=0x1000000027b state=1073741824 0x55cf620ba780] [inode 0x1000000027b [2,head] /dc-dir/dc-file_134 auth v2668 s=3 n(v0 rc2023-10-03T19:13:35.984103+0000 b3 1=1+0) (iversion lock) 0x55cf620bc580] 2023-10-03T19:20:55.740 INFO:teuthology.orchestra.run.smithi045.stdout: -2428> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000027b [2,head] #1000000027b auth v2668 s=3 n(v0 rc2023-10-03T19:13:35.984103+0000 b3 1=1+0) (iversion lock) 0x55cf620bc580] 2023-10-03T19:20:55.740 INFO:teuthology.orchestra.run.smithi045.stdout: -2427> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_134 [2,head] auth NULL (dversion lock) v=2668 ino=(nil) state=1073741824 0x55cf620ba780] 2023-10-03T19:20:55.740 INFO:teuthology.orchestra.run.smithi045.stdout: -2426> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_133 [2,head] auth (dversion lock) v=2666 ino=0x1000000027a state=1073741824 0x55cf620ba500] 2023-10-03T19:20:55.740 INFO:teuthology.orchestra.run.smithi045.stdout: -2425> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.740 INFO:teuthology.orchestra.run.smithi045.stdout: -2424> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000027a [2,head] /dc-dir/dc-file_133 auth v2666 s=3 n(v0 rc2023-10-03T19:13:35.973812+0000 b3 1=1+0) (iversion lock) 0x55cf620bc000] 2023-10-03T19:20:55.740 INFO:teuthology.orchestra.run.smithi045.stdout: -2423> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_133 [2,head] auth (dversion lock) v=2666 ino=0x1000000027a state=1073741824 0x55cf620ba500] [inode 0x1000000027a [2,head] /dc-dir/dc-file_133 auth v2666 s=3 n(v0 rc2023-10-03T19:13:35.973812+0000 b3 1=1+0) (iversion lock) 0x55cf620bc000] 2023-10-03T19:20:55.741 INFO:teuthology.orchestra.run.smithi045.stdout: -2422> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000027a [2,head] #1000000027a auth v2666 s=3 n(v0 rc2023-10-03T19:13:35.973812+0000 b3 1=1+0) (iversion lock) 0x55cf620bc000] 2023-10-03T19:20:55.741 INFO:teuthology.orchestra.run.smithi045.stdout: -2421> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_133 [2,head] auth NULL (dversion lock) v=2666 ino=(nil) state=1073741824 0x55cf620ba500] 2023-10-03T19:20:55.741 INFO:teuthology.orchestra.run.smithi045.stdout: -2420> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_132 [2,head] auth (dversion lock) v=2664 ino=0x10000000279 state=1073741824 0x55cf620ba280] 2023-10-03T19:20:55.741 INFO:teuthology.orchestra.run.smithi045.stdout: -2419> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.742 INFO:teuthology.orchestra.run.smithi045.stdout: -2418> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000279 [2,head] /dc-dir/dc-file_132 auth v2664 s=3 n(v0 rc2023-10-03T19:13:35.962734+0000 b3 1=1+0) (iversion lock) 0x55cf620ab700] 2023-10-03T19:20:55.742 INFO:teuthology.orchestra.run.smithi045.stdout: -2417> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_132 [2,head] auth (dversion lock) v=2664 ino=0x10000000279 state=1073741824 0x55cf620ba280] [inode 0x10000000279 [2,head] /dc-dir/dc-file_132 auth v2664 s=3 n(v0 rc2023-10-03T19:13:35.962734+0000 b3 1=1+0) (iversion lock) 0x55cf620ab700] 2023-10-03T19:20:55.742 INFO:teuthology.orchestra.run.smithi045.stdout: -2416> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000279 [2,head] #10000000279 auth v2664 s=3 n(v0 rc2023-10-03T19:13:35.962734+0000 b3 1=1+0) (iversion lock) 0x55cf620ab700] 2023-10-03T19:20:55.742 INFO:teuthology.orchestra.run.smithi045.stdout: -2415> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_132 [2,head] auth NULL (dversion lock) v=2664 ino=(nil) state=1073741824 0x55cf620ba280] 2023-10-03T19:20:55.742 INFO:teuthology.orchestra.run.smithi045.stdout: -2414> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_131 [2,head] auth (dversion lock) v=2662 ino=0x10000000278 state=1073741824 0x55cf620ba000] 2023-10-03T19:20:55.742 INFO:teuthology.orchestra.run.smithi045.stdout: -2413> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.742 INFO:teuthology.orchestra.run.smithi045.stdout: -2412> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000278 [2,head] /dc-dir/dc-file_131 auth v2662 s=3 n(v0 rc2023-10-03T19:13:35.952017+0000 b3 1=1+0) (iversion lock) 0x55cf620ab180] 2023-10-03T19:20:55.742 INFO:teuthology.orchestra.run.smithi045.stdout: -2411> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_131 [2,head] auth (dversion lock) v=2662 ino=0x10000000278 state=1073741824 0x55cf620ba000] [inode 0x10000000278 [2,head] /dc-dir/dc-file_131 auth v2662 s=3 n(v0 rc2023-10-03T19:13:35.952017+0000 b3 1=1+0) (iversion lock) 0x55cf620ab180] 2023-10-03T19:20:55.742 INFO:teuthology.orchestra.run.smithi045.stdout: -2410> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000278 [2,head] #10000000278 auth v2662 s=3 n(v0 rc2023-10-03T19:13:35.952017+0000 b3 1=1+0) (iversion lock) 0x55cf620ab180] 2023-10-03T19:20:55.742 INFO:teuthology.orchestra.run.smithi045.stdout: -2409> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_131 [2,head] auth NULL (dversion lock) v=2662 ino=(nil) state=1073741824 0x55cf620ba000] 2023-10-03T19:20:55.742 INFO:teuthology.orchestra.run.smithi045.stdout: -2408> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_130 [2,head] auth (dversion lock) v=2660 ino=0x10000000277 state=1073741824 0x55cf620a7b80] 2023-10-03T19:20:55.743 INFO:teuthology.orchestra.run.smithi045.stdout: -2407> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.743 INFO:teuthology.orchestra.run.smithi045.stdout: -2406> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000277 [2,head] /dc-dir/dc-file_130 auth v2660 s=3 n(v0 rc2023-10-03T19:13:35.941198+0000 b3 1=1+0) (iversion lock) 0x55cf620aac00] 2023-10-03T19:20:55.743 INFO:teuthology.orchestra.run.smithi045.stdout: -2405> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_130 [2,head] auth (dversion lock) v=2660 ino=0x10000000277 state=1073741824 0x55cf620a7b80] [inode 0x10000000277 [2,head] /dc-dir/dc-file_130 auth v2660 s=3 n(v0 rc2023-10-03T19:13:35.941198+0000 b3 1=1+0) (iversion lock) 0x55cf620aac00] 2023-10-03T19:20:55.743 INFO:teuthology.orchestra.run.smithi045.stdout: -2404> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000277 [2,head] #10000000277 auth v2660 s=3 n(v0 rc2023-10-03T19:13:35.941198+0000 b3 1=1+0) (iversion lock) 0x55cf620aac00] 2023-10-03T19:20:55.743 INFO:teuthology.orchestra.run.smithi045.stdout: -2403> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_130 [2,head] auth NULL (dversion lock) v=2660 ino=(nil) state=1073741824 0x55cf620a7b80] 2023-10-03T19:20:55.743 INFO:teuthology.orchestra.run.smithi045.stdout: -2402> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_129 [2,head] auth (dversion lock) v=2658 ino=0x10000000276 state=1073741824 0x55cf620a7900] 2023-10-03T19:20:55.743 INFO:teuthology.orchestra.run.smithi045.stdout: -2401> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.743 INFO:teuthology.orchestra.run.smithi045.stdout: -2400> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000276 [2,head] /dc-dir/dc-file_129 auth v2658 s=3 n(v0 rc2023-10-03T19:13:35.930945+0000 b3 1=1+0) (iversion lock) 0x55cf620aa680] 2023-10-03T19:20:55.743 INFO:teuthology.orchestra.run.smithi045.stdout: -2399> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_129 [2,head] auth (dversion lock) v=2658 ino=0x10000000276 state=1073741824 0x55cf620a7900] [inode 0x10000000276 [2,head] /dc-dir/dc-file_129 auth v2658 s=3 n(v0 rc2023-10-03T19:13:35.930945+0000 b3 1=1+0) (iversion lock) 0x55cf620aa680] 2023-10-03T19:20:55.743 INFO:teuthology.orchestra.run.smithi045.stdout: -2398> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000276 [2,head] #10000000276 auth v2658 s=3 n(v0 rc2023-10-03T19:13:35.930945+0000 b3 1=1+0) (iversion lock) 0x55cf620aa680] 2023-10-03T19:20:55.743 INFO:teuthology.orchestra.run.smithi045.stdout: -2397> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_129 [2,head] auth NULL (dversion lock) v=2658 ino=(nil) state=1073741824 0x55cf620a7900] 2023-10-03T19:20:55.743 INFO:teuthology.orchestra.run.smithi045.stdout: -2396> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_128 [2,head] auth (dversion lock) v=2656 ino=0x10000000275 state=1073741824 0x55cf620a7680] 2023-10-03T19:20:55.744 INFO:teuthology.orchestra.run.smithi045.stdout: -2395> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.744 INFO:teuthology.orchestra.run.smithi045.stdout: -2394> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000275 [2,head] /dc-dir/dc-file_128 auth v2656 s=3 n(v0 rc2023-10-03T19:13:35.920191+0000 b3 1=1+0) (iversion lock) 0x55cf620aa100] 2023-10-03T19:20:55.744 INFO:teuthology.orchestra.run.smithi045.stdout: -2393> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_128 [2,head] auth (dversion lock) v=2656 ino=0x10000000275 state=1073741824 0x55cf620a7680] [inode 0x10000000275 [2,head] /dc-dir/dc-file_128 auth v2656 s=3 n(v0 rc2023-10-03T19:13:35.920191+0000 b3 1=1+0) (iversion lock) 0x55cf620aa100] 2023-10-03T19:20:55.744 INFO:teuthology.orchestra.run.smithi045.stdout: -2392> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000275 [2,head] #10000000275 auth v2656 s=3 n(v0 rc2023-10-03T19:13:35.920191+0000 b3 1=1+0) (iversion lock) 0x55cf620aa100] 2023-10-03T19:20:55.744 INFO:teuthology.orchestra.run.smithi045.stdout: -2391> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_128 [2,head] auth NULL (dversion lock) v=2656 ino=(nil) state=1073741824 0x55cf620a7680] 2023-10-03T19:20:55.744 INFO:teuthology.orchestra.run.smithi045.stdout: -2390> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_127 [2,head] auth (dversion lock) v=2654 ino=0x10000000274 state=1073741824 0x55cf620a7400] 2023-10-03T19:20:55.744 INFO:teuthology.orchestra.run.smithi045.stdout: -2389> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.744 INFO:teuthology.orchestra.run.smithi045.stdout: -2388> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000274 [2,head] /dc-dir/dc-file_127 auth v2654 s=3 n(v0 rc2023-10-03T19:13:35.909354+0000 b3 1=1+0) (iversion lock) 0x55cf620a9b80] 2023-10-03T19:20:55.744 INFO:teuthology.orchestra.run.smithi045.stdout: -2387> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_127 [2,head] auth (dversion lock) v=2654 ino=0x10000000274 state=1073741824 0x55cf620a7400] [inode 0x10000000274 [2,head] /dc-dir/dc-file_127 auth v2654 s=3 n(v0 rc2023-10-03T19:13:35.909354+0000 b3 1=1+0) (iversion lock) 0x55cf620a9b80] 2023-10-03T19:20:55.744 INFO:teuthology.orchestra.run.smithi045.stdout: -2386> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000274 [2,head] #10000000274 auth v2654 s=3 n(v0 rc2023-10-03T19:13:35.909354+0000 b3 1=1+0) (iversion lock) 0x55cf620a9b80] 2023-10-03T19:20:55.744 INFO:teuthology.orchestra.run.smithi045.stdout: -2385> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_127 [2,head] auth NULL (dversion lock) v=2654 ino=(nil) state=1073741824 0x55cf620a7400] 2023-10-03T19:20:55.745 INFO:teuthology.orchestra.run.smithi045.stdout: -2384> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_126 [2,head] auth (dversion lock) v=2652 ino=0x10000000273 state=1073741824 0x55cf620a7180] 2023-10-03T19:20:55.745 INFO:teuthology.orchestra.run.smithi045.stdout: -2383> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.745 INFO:teuthology.orchestra.run.smithi045.stdout: -2382> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000273 [2,head] /dc-dir/dc-file_126 auth v2652 s=3 n(v0 rc2023-10-03T19:13:35.898796+0000 b3 1=1+0) (iversion lock) 0x55cf620a9600] 2023-10-03T19:20:55.745 INFO:teuthology.orchestra.run.smithi045.stdout: -2381> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_126 [2,head] auth (dversion lock) v=2652 ino=0x10000000273 state=1073741824 0x55cf620a7180] [inode 0x10000000273 [2,head] /dc-dir/dc-file_126 auth v2652 s=3 n(v0 rc2023-10-03T19:13:35.898796+0000 b3 1=1+0) (iversion lock) 0x55cf620a9600] 2023-10-03T19:20:55.745 INFO:teuthology.orchestra.run.smithi045.stdout: -2380> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000273 [2,head] #10000000273 auth v2652 s=3 n(v0 rc2023-10-03T19:13:35.898796+0000 b3 1=1+0) (iversion lock) 0x55cf620a9600] 2023-10-03T19:20:55.745 INFO:teuthology.orchestra.run.smithi045.stdout: -2379> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_126 [2,head] auth NULL (dversion lock) v=2652 ino=(nil) state=1073741824 0x55cf620a7180] 2023-10-03T19:20:55.745 INFO:teuthology.orchestra.run.smithi045.stdout: -2378> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_125 [2,head] auth (dversion lock) v=2650 ino=0x10000000272 state=1073741824 0x55cf620a6f00] 2023-10-03T19:20:55.745 INFO:teuthology.orchestra.run.smithi045.stdout: -2377> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.745 INFO:teuthology.orchestra.run.smithi045.stdout: -2376> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000272 [2,head] /dc-dir/dc-file_125 auth v2650 s=3 n(v0 rc2023-10-03T19:13:35.887817+0000 b3 1=1+0) (iversion lock) 0x55cf620a9080] 2023-10-03T19:20:55.745 INFO:teuthology.orchestra.run.smithi045.stdout: -2375> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_125 [2,head] auth (dversion lock) v=2650 ino=0x10000000272 state=1073741824 0x55cf620a6f00] [inode 0x10000000272 [2,head] /dc-dir/dc-file_125 auth v2650 s=3 n(v0 rc2023-10-03T19:13:35.887817+0000 b3 1=1+0) (iversion lock) 0x55cf620a9080] 2023-10-03T19:20:55.745 INFO:teuthology.orchestra.run.smithi045.stdout: -2374> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000272 [2,head] #10000000272 auth v2650 s=3 n(v0 rc2023-10-03T19:13:35.887817+0000 b3 1=1+0) (iversion lock) 0x55cf620a9080] 2023-10-03T19:20:55.746 INFO:teuthology.orchestra.run.smithi045.stdout: -2373> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_125 [2,head] auth NULL (dversion lock) v=2650 ino=(nil) state=1073741824 0x55cf620a6f00] 2023-10-03T19:20:55.746 INFO:teuthology.orchestra.run.smithi045.stdout: -2372> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_124 [2,head] auth (dversion lock) v=2648 ino=0x10000000271 state=1073741824 0x55cf620a6c80] 2023-10-03T19:20:55.746 INFO:teuthology.orchestra.run.smithi045.stdout: -2371> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.746 INFO:teuthology.orchestra.run.smithi045.stdout: -2370> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000271 [2,head] /dc-dir/dc-file_124 auth v2648 s=3 n(v0 rc2023-10-03T19:13:35.877056+0000 b3 1=1+0) (iversion lock) 0x55cf620a8b00] 2023-10-03T19:20:55.746 INFO:teuthology.orchestra.run.smithi045.stdout: -2369> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_124 [2,head] auth (dversion lock) v=2648 ino=0x10000000271 state=1073741824 0x55cf620a6c80] [inode 0x10000000271 [2,head] /dc-dir/dc-file_124 auth v2648 s=3 n(v0 rc2023-10-03T19:13:35.877056+0000 b3 1=1+0) (iversion lock) 0x55cf620a8b00] 2023-10-03T19:20:55.746 INFO:teuthology.orchestra.run.smithi045.stdout: -2368> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000271 [2,head] #10000000271 auth v2648 s=3 n(v0 rc2023-10-03T19:13:35.877056+0000 b3 1=1+0) (iversion lock) 0x55cf620a8b00] 2023-10-03T19:20:55.746 INFO:teuthology.orchestra.run.smithi045.stdout: -2367> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_124 [2,head] auth NULL (dversion lock) v=2648 ino=(nil) state=1073741824 0x55cf620a6c80] 2023-10-03T19:20:55.746 INFO:teuthology.orchestra.run.smithi045.stdout: -2366> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_123 [2,head] auth (dversion lock) v=2646 ino=0x10000000270 state=1073741824 0x55cf620a6a00] 2023-10-03T19:20:55.746 INFO:teuthology.orchestra.run.smithi045.stdout: -2365> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.746 INFO:teuthology.orchestra.run.smithi045.stdout: -2364> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000270 [2,head] /dc-dir/dc-file_123 auth v2646 s=3 n(v0 rc2023-10-03T19:13:35.866440+0000 b3 1=1+0) (iversion lock) 0x55cf620a8580] 2023-10-03T19:20:55.747 INFO:teuthology.orchestra.run.smithi045.stdout: -2363> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_123 [2,head] auth (dversion lock) v=2646 ino=0x10000000270 state=1073741824 0x55cf620a6a00] [inode 0x10000000270 [2,head] /dc-dir/dc-file_123 auth v2646 s=3 n(v0 rc2023-10-03T19:13:35.866440+0000 b3 1=1+0) (iversion lock) 0x55cf620a8580] 2023-10-03T19:20:55.747 INFO:teuthology.orchestra.run.smithi045.stdout: -2362> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000270 [2,head] #10000000270 auth v2646 s=3 n(v0 rc2023-10-03T19:13:35.866440+0000 b3 1=1+0) (iversion lock) 0x55cf620a8580] 2023-10-03T19:20:55.747 INFO:teuthology.orchestra.run.smithi045.stdout: -2361> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_123 [2,head] auth NULL (dversion lock) v=2646 ino=(nil) state=1073741824 0x55cf620a6a00] 2023-10-03T19:20:55.747 INFO:teuthology.orchestra.run.smithi045.stdout: -2360> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_122 [2,head] auth (dversion lock) v=2644 ino=0x1000000026f state=1073741824 0x55cf620a6780] 2023-10-03T19:20:55.747 INFO:teuthology.orchestra.run.smithi045.stdout: -2359> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.747 INFO:teuthology.orchestra.run.smithi045.stdout: -2358> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000026f [2,head] /dc-dir/dc-file_122 auth v2644 s=3 n(v0 rc2023-10-03T19:13:35.856140+0000 b3 1=1+0) (iversion lock) 0x55cf620a8000] 2023-10-03T19:20:55.770 INFO:teuthology.orchestra.run.smithi045.stdout: -2357> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_122 [2,head] auth (dversion lock) v=2644 ino=0x1000000026f state=1073741824 0x55cf620a6780] [inode 0x1000000026f [2,head] /dc-dir/dc-file_122 auth v2644 s=3 n(v0 rc2023-10-03T19:13:35.856140+0000 b3 1=1+0) (iversion lock) 0x55cf620a8000] 2023-10-03T19:20:55.770 INFO:teuthology.orchestra.run.smithi045.stdout: -2356> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000026f [2,head] #1000000026f auth v2644 s=3 n(v0 rc2023-10-03T19:13:35.856140+0000 b3 1=1+0) (iversion lock) 0x55cf620a8000] 2023-10-03T19:20:55.770 INFO:teuthology.orchestra.run.smithi045.stdout: -2355> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_122 [2,head] auth NULL (dversion lock) v=2644 ino=(nil) state=1073741824 0x55cf620a6780] 2023-10-03T19:20:55.770 INFO:teuthology.orchestra.run.smithi045.stdout: -2354> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_121 [2,head] auth (dversion lock) v=2642 ino=0x1000000026e state=1073741824 0x55cf620a6500] 2023-10-03T19:20:55.770 INFO:teuthology.orchestra.run.smithi045.stdout: -2353> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.770 INFO:teuthology.orchestra.run.smithi045.stdout: -2352> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000026e [2,head] /dc-dir/dc-file_121 auth v2642 s=3 n(v0 rc2023-10-03T19:13:35.845672+0000 b3 1=1+0) (iversion lock) 0x55cf6209d700] 2023-10-03T19:20:55.770 INFO:teuthology.orchestra.run.smithi045.stdout: -2351> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_121 [2,head] auth (dversion lock) v=2642 ino=0x1000000026e state=1073741824 0x55cf620a6500] [inode 0x1000000026e [2,head] /dc-dir/dc-file_121 auth v2642 s=3 n(v0 rc2023-10-03T19:13:35.845672+0000 b3 1=1+0) (iversion lock) 0x55cf6209d700] 2023-10-03T19:20:55.770 INFO:teuthology.orchestra.run.smithi045.stdout: -2350> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000026e [2,head] #1000000026e auth v2642 s=3 n(v0 rc2023-10-03T19:13:35.845672+0000 b3 1=1+0) (iversion lock) 0x55cf6209d700] 2023-10-03T19:20:55.771 INFO:teuthology.orchestra.run.smithi045.stdout: -2349> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_121 [2,head] auth NULL (dversion lock) v=2642 ino=(nil) state=1073741824 0x55cf620a6500] 2023-10-03T19:20:55.771 INFO:teuthology.orchestra.run.smithi045.stdout: -2348> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_120 [2,head] auth (dversion lock) v=2640 ino=0x1000000026d state=1073741824 0x55cf620a6280] 2023-10-03T19:20:55.771 INFO:teuthology.orchestra.run.smithi045.stdout: -2347> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.771 INFO:teuthology.orchestra.run.smithi045.stdout: -2346> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000026d [2,head] /dc-dir/dc-file_120 auth v2640 s=3 n(v0 rc2023-10-03T19:13:35.833936+0000 b3 1=1+0) (iversion lock) 0x55cf6209d180] 2023-10-03T19:20:55.771 INFO:teuthology.orchestra.run.smithi045.stdout: -2345> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_120 [2,head] auth (dversion lock) v=2640 ino=0x1000000026d state=1073741824 0x55cf620a6280] [inode 0x1000000026d [2,head] /dc-dir/dc-file_120 auth v2640 s=3 n(v0 rc2023-10-03T19:13:35.833936+0000 b3 1=1+0) (iversion lock) 0x55cf6209d180] 2023-10-03T19:20:55.771 INFO:teuthology.orchestra.run.smithi045.stdout: -2344> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000026d [2,head] #1000000026d auth v2640 s=3 n(v0 rc2023-10-03T19:13:35.833936+0000 b3 1=1+0) (iversion lock) 0x55cf6209d180] 2023-10-03T19:20:55.771 INFO:teuthology.orchestra.run.smithi045.stdout: -2343> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_120 [2,head] auth NULL (dversion lock) v=2640 ino=(nil) state=1073741824 0x55cf620a6280] 2023-10-03T19:20:55.771 INFO:teuthology.orchestra.run.smithi045.stdout: -2342> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_119 [2,head] auth (dversion lock) v=2638 ino=0x1000000026c state=1073741824 0x55cf620a6000] 2023-10-03T19:20:55.771 INFO:teuthology.orchestra.run.smithi045.stdout: -2341> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.772 INFO:teuthology.orchestra.run.smithi045.stdout: -2340> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000026c [2,head] /dc-dir/dc-file_119 auth v2638 s=3 n(v0 rc2023-10-03T19:13:35.823711+0000 b3 1=1+0) (iversion lock) 0x55cf6209cc00] 2023-10-03T19:20:55.772 INFO:teuthology.orchestra.run.smithi045.stdout: -2339> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_119 [2,head] auth (dversion lock) v=2638 ino=0x1000000026c state=1073741824 0x55cf620a6000] [inode 0x1000000026c [2,head] /dc-dir/dc-file_119 auth v2638 s=3 n(v0 rc2023-10-03T19:13:35.823711+0000 b3 1=1+0) (iversion lock) 0x55cf6209cc00] 2023-10-03T19:20:55.772 INFO:teuthology.orchestra.run.smithi045.stdout: -2338> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000026c [2,head] #1000000026c auth v2638 s=3 n(v0 rc2023-10-03T19:13:35.823711+0000 b3 1=1+0) (iversion lock) 0x55cf6209cc00] 2023-10-03T19:20:55.772 INFO:teuthology.orchestra.run.smithi045.stdout: -2337> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_119 [2,head] auth NULL (dversion lock) v=2638 ino=(nil) state=1073741824 0x55cf620a6000] 2023-10-03T19:20:55.772 INFO:teuthology.orchestra.run.smithi045.stdout: -2336> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_118 [2,head] auth (dversion lock) v=2636 ino=0x1000000026b state=1073741824 0x55cf62093b80] 2023-10-03T19:20:55.772 INFO:teuthology.orchestra.run.smithi045.stdout: -2335> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.772 INFO:teuthology.orchestra.run.smithi045.stdout: -2334> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000026b [2,head] /dc-dir/dc-file_118 auth v2636 s=3 n(v0 rc2023-10-03T19:13:35.812548+0000 b3 1=1+0) (iversion lock) 0x55cf6209c680] 2023-10-03T19:20:55.772 INFO:teuthology.orchestra.run.smithi045.stdout: -2333> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_118 [2,head] auth (dversion lock) v=2636 ino=0x1000000026b state=1073741824 0x55cf62093b80] [inode 0x1000000026b [2,head] /dc-dir/dc-file_118 auth v2636 s=3 n(v0 rc2023-10-03T19:13:35.812548+0000 b3 1=1+0) (iversion lock) 0x55cf6209c680] 2023-10-03T19:20:55.772 INFO:teuthology.orchestra.run.smithi045.stdout: -2332> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000026b [2,head] #1000000026b auth v2636 s=3 n(v0 rc2023-10-03T19:13:35.812548+0000 b3 1=1+0) (iversion lock) 0x55cf6209c680] 2023-10-03T19:20:55.772 INFO:teuthology.orchestra.run.smithi045.stdout: -2331> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_118 [2,head] auth NULL (dversion lock) v=2636 ino=(nil) state=1073741824 0x55cf62093b80] 2023-10-03T19:20:55.772 INFO:teuthology.orchestra.run.smithi045.stdout: -2330> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_117 [2,head] auth (dversion lock) v=2634 ino=0x1000000026a state=1073741824 0x55cf62093900] 2023-10-03T19:20:55.773 INFO:teuthology.orchestra.run.smithi045.stdout: -2329> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.773 INFO:teuthology.orchestra.run.smithi045.stdout: -2328> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000026a [2,head] /dc-dir/dc-file_117 auth v2634 s=3 n(v0 rc2023-10-03T19:13:35.800585+0000 b3 1=1+0) (iversion lock) 0x55cf6209c100] 2023-10-03T19:20:55.773 INFO:teuthology.orchestra.run.smithi045.stdout: -2327> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_117 [2,head] auth (dversion lock) v=2634 ino=0x1000000026a state=1073741824 0x55cf62093900] [inode 0x1000000026a [2,head] /dc-dir/dc-file_117 auth v2634 s=3 n(v0 rc2023-10-03T19:13:35.800585+0000 b3 1=1+0) (iversion lock) 0x55cf6209c100] 2023-10-03T19:20:55.773 INFO:teuthology.orchestra.run.smithi045.stdout: -2326> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000026a [2,head] #1000000026a auth v2634 s=3 n(v0 rc2023-10-03T19:13:35.800585+0000 b3 1=1+0) (iversion lock) 0x55cf6209c100] 2023-10-03T19:20:55.773 INFO:teuthology.orchestra.run.smithi045.stdout: -2325> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_117 [2,head] auth NULL (dversion lock) v=2634 ino=(nil) state=1073741824 0x55cf62093900] 2023-10-03T19:20:55.773 INFO:teuthology.orchestra.run.smithi045.stdout: -2324> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_116 [2,head] auth (dversion lock) v=2632 ino=0x10000000269 state=1073741824 0x55cf62093680] 2023-10-03T19:20:55.773 INFO:teuthology.orchestra.run.smithi045.stdout: -2323> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.773 INFO:teuthology.orchestra.run.smithi045.stdout: -2322> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000269 [2,head] /dc-dir/dc-file_116 auth v2632 s=3 n(v0 rc2023-10-03T19:13:35.789254+0000 b3 1=1+0) (iversion lock) 0x55cf6209bb80] 2023-10-03T19:20:55.773 INFO:teuthology.orchestra.run.smithi045.stdout: -2321> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_116 [2,head] auth (dversion lock) v=2632 ino=0x10000000269 state=1073741824 0x55cf62093680] [inode 0x10000000269 [2,head] /dc-dir/dc-file_116 auth v2632 s=3 n(v0 rc2023-10-03T19:13:35.789254+0000 b3 1=1+0) (iversion lock) 0x55cf6209bb80] 2023-10-03T19:20:55.773 INFO:teuthology.orchestra.run.smithi045.stdout: -2320> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000269 [2,head] #10000000269 auth v2632 s=3 n(v0 rc2023-10-03T19:13:35.789254+0000 b3 1=1+0) (iversion lock) 0x55cf6209bb80] 2023-10-03T19:20:55.773 INFO:teuthology.orchestra.run.smithi045.stdout: -2319> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_116 [2,head] auth NULL (dversion lock) v=2632 ino=(nil) state=1073741824 0x55cf62093680] 2023-10-03T19:20:55.774 INFO:teuthology.orchestra.run.smithi045.stdout: -2318> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_115 [2,head] auth (dversion lock) v=2630 ino=0x10000000268 state=1073741824 0x55cf62093400] 2023-10-03T19:20:55.774 INFO:teuthology.orchestra.run.smithi045.stdout: -2317> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.774 INFO:teuthology.orchestra.run.smithi045.stdout: -2316> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000268 [2,head] /dc-dir/dc-file_115 auth v2630 s=3 n(v0 rc2023-10-03T19:13:35.778504+0000 b3 1=1+0) (iversion lock) 0x55cf6209b600] 2023-10-03T19:20:55.774 INFO:teuthology.orchestra.run.smithi045.stdout: -2315> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_115 [2,head] auth (dversion lock) v=2630 ino=0x10000000268 state=1073741824 0x55cf62093400] [inode 0x10000000268 [2,head] /dc-dir/dc-file_115 auth v2630 s=3 n(v0 rc2023-10-03T19:13:35.778504+0000 b3 1=1+0) (iversion lock) 0x55cf6209b600] 2023-10-03T19:20:55.774 INFO:teuthology.orchestra.run.smithi045.stdout: -2314> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000268 [2,head] #10000000268 auth v2630 s=3 n(v0 rc2023-10-03T19:13:35.778504+0000 b3 1=1+0) (iversion lock) 0x55cf6209b600] 2023-10-03T19:20:55.774 INFO:teuthology.orchestra.run.smithi045.stdout: -2313> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_115 [2,head] auth NULL (dversion lock) v=2630 ino=(nil) state=1073741824 0x55cf62093400] 2023-10-03T19:20:55.774 INFO:teuthology.orchestra.run.smithi045.stdout: -2312> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_114 [2,head] auth (dversion lock) v=2628 ino=0x10000000267 state=1073741824 0x55cf62093180] 2023-10-03T19:20:55.774 INFO:teuthology.orchestra.run.smithi045.stdout: -2311> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.774 INFO:teuthology.orchestra.run.smithi045.stdout: -2310> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000267 [2,head] /dc-dir/dc-file_114 auth v2628 s=3 n(v0 rc2023-10-03T19:13:35.765951+0000 b3 1=1+0) (iversion lock) 0x55cf6209b080] 2023-10-03T19:20:55.774 INFO:teuthology.orchestra.run.smithi045.stdout: -2309> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_114 [2,head] auth (dversion lock) v=2628 ino=0x10000000267 state=1073741824 0x55cf62093180] [inode 0x10000000267 [2,head] /dc-dir/dc-file_114 auth v2628 s=3 n(v0 rc2023-10-03T19:13:35.765951+0000 b3 1=1+0) (iversion lock) 0x55cf6209b080] 2023-10-03T19:20:55.774 INFO:teuthology.orchestra.run.smithi045.stdout: -2308> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000267 [2,head] #10000000267 auth v2628 s=3 n(v0 rc2023-10-03T19:13:35.765951+0000 b3 1=1+0) (iversion lock) 0x55cf6209b080] 2023-10-03T19:20:55.775 INFO:teuthology.orchestra.run.smithi045.stdout: -2307> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_114 [2,head] auth NULL (dversion lock) v=2628 ino=(nil) state=1073741824 0x55cf62093180] 2023-10-03T19:20:55.775 INFO:teuthology.orchestra.run.smithi045.stdout: -2306> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_113 [2,head] auth (dversion lock) v=2626 ino=0x10000000266 state=1073741824 0x55cf62092f00] 2023-10-03T19:20:55.775 INFO:teuthology.orchestra.run.smithi045.stdout: -2305> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.775 INFO:teuthology.orchestra.run.smithi045.stdout: -2304> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000266 [2,head] /dc-dir/dc-file_113 auth v2626 s=3 n(v0 rc2023-10-03T19:13:35.752894+0000 b3 1=1+0) (iversion lock) 0x55cf6209ab00] 2023-10-03T19:20:55.775 INFO:teuthology.orchestra.run.smithi045.stdout: -2303> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_113 [2,head] auth (dversion lock) v=2626 ino=0x10000000266 state=1073741824 0x55cf62092f00] [inode 0x10000000266 [2,head] /dc-dir/dc-file_113 auth v2626 s=3 n(v0 rc2023-10-03T19:13:35.752894+0000 b3 1=1+0) (iversion lock) 0x55cf6209ab00] 2023-10-03T19:20:55.775 INFO:teuthology.orchestra.run.smithi045.stdout: -2302> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000266 [2,head] #10000000266 auth v2626 s=3 n(v0 rc2023-10-03T19:13:35.752894+0000 b3 1=1+0) (iversion lock) 0x55cf6209ab00] 2023-10-03T19:20:55.775 INFO:teuthology.orchestra.run.smithi045.stdout: -2301> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_113 [2,head] auth NULL (dversion lock) v=2626 ino=(nil) state=1073741824 0x55cf62092f00] 2023-10-03T19:20:55.775 INFO:teuthology.orchestra.run.smithi045.stdout: -2300> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_112 [2,head] auth (dversion lock) v=2624 ino=0x10000000265 state=1073741824 0x55cf62092c80] 2023-10-03T19:20:55.775 INFO:teuthology.orchestra.run.smithi045.stdout: -2299> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.775 INFO:teuthology.orchestra.run.smithi045.stdout: -2298> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000265 [2,head] /dc-dir/dc-file_112 auth v2624 s=3 n(v0 rc2023-10-03T19:13:35.740550+0000 b3 1=1+0) (iversion lock) 0x55cf6209a580] 2023-10-03T19:20:55.775 INFO:teuthology.orchestra.run.smithi045.stdout: -2297> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_112 [2,head] auth (dversion lock) v=2624 ino=0x10000000265 state=1073741824 0x55cf62092c80] [inode 0x10000000265 [2,head] /dc-dir/dc-file_112 auth v2624 s=3 n(v0 rc2023-10-03T19:13:35.740550+0000 b3 1=1+0) (iversion lock) 0x55cf6209a580] 2023-10-03T19:20:55.775 INFO:teuthology.orchestra.run.smithi045.stdout: -2296> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000265 [2,head] #10000000265 auth v2624 s=3 n(v0 rc2023-10-03T19:13:35.740550+0000 b3 1=1+0) (iversion lock) 0x55cf6209a580] 2023-10-03T19:20:55.776 INFO:teuthology.orchestra.run.smithi045.stdout: -2295> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_112 [2,head] auth NULL (dversion lock) v=2624 ino=(nil) state=1073741824 0x55cf62092c80] 2023-10-03T19:20:55.776 INFO:teuthology.orchestra.run.smithi045.stdout: -2294> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_111 [2,head] auth (dversion lock) v=2622 ino=0x10000000264 state=1073741824 0x55cf62092a00] 2023-10-03T19:20:55.776 INFO:teuthology.orchestra.run.smithi045.stdout: -2293> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.776 INFO:teuthology.orchestra.run.smithi045.stdout: -2292> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000264 [2,head] /dc-dir/dc-file_111 auth v2622 s=3 n(v0 rc2023-10-03T19:13:35.727801+0000 b3 1=1+0) (iversion lock) 0x55cf6209a000] 2023-10-03T19:20:55.896 INFO:teuthology.orchestra.run.smithi045.stdout: -2291> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_111 [2,head] auth (dversion lock) v=2622 ino=0x10000000264 state=1073741824 0x55cf62092a00] [inode 0x10000000264 [2,head] /dc-dir/dc-file_111 auth v2622 s=3 n(v0 rc2023-10-03T19:13:35.727801+0000 b3 1=1+0) (iversion lock) 0x55cf6209a000] 2023-10-03T19:20:55.896 INFO:teuthology.orchestra.run.smithi045.stdout: -2290> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000264 [2,head] #10000000264 auth v2622 s=3 n(v0 rc2023-10-03T19:13:35.727801+0000 b3 1=1+0) (iversion lock) 0x55cf6209a000] 2023-10-03T19:20:55.897 INFO:teuthology.orchestra.run.smithi045.stdout: -2289> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_111 [2,head] auth NULL (dversion lock) v=2622 ino=(nil) state=1073741824 0x55cf62092a00] 2023-10-03T19:20:55.897 INFO:teuthology.orchestra.run.smithi045.stdout: -2288> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_110 [2,head] auth (dversion lock) v=2620 ino=0x10000000263 state=1073741824 0x55cf62092780] 2023-10-03T19:20:55.897 INFO:teuthology.orchestra.run.smithi045.stdout: -2287> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.897 INFO:teuthology.orchestra.run.smithi045.stdout: -2286> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000263 [2,head] /dc-dir/dc-file_110 auth v2620 s=3 n(v0 rc2023-10-03T19:13:35.715083+0000 b3 1=1+0) (iversion lock) 0x55cf6208f700] 2023-10-03T19:20:55.898 INFO:teuthology.orchestra.run.smithi045.stdout: -2285> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_110 [2,head] auth (dversion lock) v=2620 ino=0x10000000263 state=1073741824 0x55cf62092780] [inode 0x10000000263 [2,head] /dc-dir/dc-file_110 auth v2620 s=3 n(v0 rc2023-10-03T19:13:35.715083+0000 b3 1=1+0) (iversion lock) 0x55cf6208f700] 2023-10-03T19:20:55.898 INFO:teuthology.orchestra.run.smithi045.stdout: -2284> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000263 [2,head] #10000000263 auth v2620 s=3 n(v0 rc2023-10-03T19:13:35.715083+0000 b3 1=1+0) (iversion lock) 0x55cf6208f700] 2023-10-03T19:20:55.898 INFO:teuthology.orchestra.run.smithi045.stdout: -2283> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_110 [2,head] auth NULL (dversion lock) v=2620 ino=(nil) state=1073741824 0x55cf62092780] 2023-10-03T19:20:55.898 INFO:teuthology.orchestra.run.smithi045.stdout: -2282> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_109 [2,head] auth (dversion lock) v=2618 ino=0x10000000262 state=1073741824 0x55cf62092500] 2023-10-03T19:20:55.898 INFO:teuthology.orchestra.run.smithi045.stdout: -2281> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.898 INFO:teuthology.orchestra.run.smithi045.stdout: -2280> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000262 [2,head] /dc-dir/dc-file_109 auth v2618 s=3 n(v0 rc2023-10-03T19:13:35.702648+0000 b3 1=1+0) (iversion lock) 0x55cf6208f180] 2023-10-03T19:20:55.898 INFO:teuthology.orchestra.run.smithi045.stdout: -2279> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_109 [2,head] auth (dversion lock) v=2618 ino=0x10000000262 state=1073741824 0x55cf62092500] [inode 0x10000000262 [2,head] /dc-dir/dc-file_109 auth v2618 s=3 n(v0 rc2023-10-03T19:13:35.702648+0000 b3 1=1+0) (iversion lock) 0x55cf6208f180] 2023-10-03T19:20:55.898 INFO:teuthology.orchestra.run.smithi045.stdout: -2278> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000262 [2,head] #10000000262 auth v2618 s=3 n(v0 rc2023-10-03T19:13:35.702648+0000 b3 1=1+0) (iversion lock) 0x55cf6208f180] 2023-10-03T19:20:55.898 INFO:teuthology.orchestra.run.smithi045.stdout: -2277> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_109 [2,head] auth NULL (dversion lock) v=2618 ino=(nil) state=1073741824 0x55cf62092500] 2023-10-03T19:20:55.898 INFO:teuthology.orchestra.run.smithi045.stdout: -2276> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_108 [2,head] auth (dversion lock) v=2616 ino=0x10000000261 state=1073741824 0x55cf62092280] 2023-10-03T19:20:55.899 INFO:teuthology.orchestra.run.smithi045.stdout: -2275> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.899 INFO:teuthology.orchestra.run.smithi045.stdout: -2274> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000261 [2,head] /dc-dir/dc-file_108 auth v2616 s=3 n(v0 rc2023-10-03T19:13:35.690321+0000 b3 1=1+0) (iversion lock) 0x55cf6208ec00] 2023-10-03T19:20:55.899 INFO:teuthology.orchestra.run.smithi045.stdout: -2273> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_108 [2,head] auth (dversion lock) v=2616 ino=0x10000000261 state=1073741824 0x55cf62092280] [inode 0x10000000261 [2,head] /dc-dir/dc-file_108 auth v2616 s=3 n(v0 rc2023-10-03T19:13:35.690321+0000 b3 1=1+0) (iversion lock) 0x55cf6208ec00] 2023-10-03T19:20:55.899 INFO:teuthology.orchestra.run.smithi045.stdout: -2272> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000261 [2,head] #10000000261 auth v2616 s=3 n(v0 rc2023-10-03T19:13:35.690321+0000 b3 1=1+0) (iversion lock) 0x55cf6208ec00] 2023-10-03T19:20:55.899 INFO:teuthology.orchestra.run.smithi045.stdout: -2271> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_108 [2,head] auth NULL (dversion lock) v=2616 ino=(nil) state=1073741824 0x55cf62092280] 2023-10-03T19:20:55.899 INFO:teuthology.orchestra.run.smithi045.stdout: -2270> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_107 [2,head] auth (dversion lock) v=2614 ino=0x10000000260 state=1073741824 0x55cf62092000] 2023-10-03T19:20:55.899 INFO:teuthology.orchestra.run.smithi045.stdout: -2269> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.900 INFO:teuthology.orchestra.run.smithi045.stdout: -2268> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000260 [2,head] /dc-dir/dc-file_107 auth v2614 s=3 n(v0 rc2023-10-03T19:13:35.677493+0000 b3 1=1+0) (iversion lock) 0x55cf6208e680] 2023-10-03T19:20:55.900 INFO:teuthology.orchestra.run.smithi045.stdout: -2267> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_107 [2,head] auth (dversion lock) v=2614 ino=0x10000000260 state=1073741824 0x55cf62092000] [inode 0x10000000260 [2,head] /dc-dir/dc-file_107 auth v2614 s=3 n(v0 rc2023-10-03T19:13:35.677493+0000 b3 1=1+0) (iversion lock) 0x55cf6208e680] 2023-10-03T19:20:55.900 INFO:teuthology.orchestra.run.smithi045.stdout: -2266> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000260 [2,head] #10000000260 auth v2614 s=3 n(v0 rc2023-10-03T19:13:35.677493+0000 b3 1=1+0) (iversion lock) 0x55cf6208e680] 2023-10-03T19:20:55.900 INFO:teuthology.orchestra.run.smithi045.stdout: -2265> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_107 [2,head] auth NULL (dversion lock) v=2614 ino=(nil) state=1073741824 0x55cf62092000] 2023-10-03T19:20:55.900 INFO:teuthology.orchestra.run.smithi045.stdout: -2264> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_106 [2,head] auth (dversion lock) v=2612 ino=0x1000000025f state=1073741824 0x55cf61eabb80] 2023-10-03T19:20:55.900 INFO:teuthology.orchestra.run.smithi045.stdout: -2263> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.900 INFO:teuthology.orchestra.run.smithi045.stdout: -2262> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000025f [2,head] /dc-dir/dc-file_106 auth v2612 s=3 n(v0 rc2023-10-03T19:13:35.665146+0000 b3 1=1+0) (iversion lock) 0x55cf6208e100] 2023-10-03T19:20:55.900 INFO:teuthology.orchestra.run.smithi045.stdout: -2261> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_106 [2,head] auth (dversion lock) v=2612 ino=0x1000000025f state=1073741824 0x55cf61eabb80] [inode 0x1000000025f [2,head] /dc-dir/dc-file_106 auth v2612 s=3 n(v0 rc2023-10-03T19:13:35.665146+0000 b3 1=1+0) (iversion lock) 0x55cf6208e100] 2023-10-03T19:20:55.900 INFO:teuthology.orchestra.run.smithi045.stdout: -2260> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000025f [2,head] #1000000025f auth v2612 s=3 n(v0 rc2023-10-03T19:13:35.665146+0000 b3 1=1+0) (iversion lock) 0x55cf6208e100] 2023-10-03T19:20:55.901 INFO:teuthology.orchestra.run.smithi045.stdout: -2259> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_106 [2,head] auth NULL (dversion lock) v=2612 ino=(nil) state=1073741824 0x55cf61eabb80] 2023-10-03T19:20:55.901 INFO:teuthology.orchestra.run.smithi045.stdout: -2258> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_105 [2,head] auth (dversion lock) v=2610 ino=0x1000000025e state=1073741824 0x55cf61eab900] 2023-10-03T19:20:55.901 INFO:teuthology.orchestra.run.smithi045.stdout: -2257> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.901 INFO:teuthology.orchestra.run.smithi045.stdout: -2256> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000025e [2,head] /dc-dir/dc-file_105 auth v2610 s=3 n(v0 rc2023-10-03T19:13:35.652648+0000 b3 1=1+0) (iversion lock) 0x55cf6208db80] 2023-10-03T19:20:55.901 INFO:teuthology.orchestra.run.smithi045.stdout: -2255> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_105 [2,head] auth (dversion lock) v=2610 ino=0x1000000025e state=1073741824 0x55cf61eab900] [inode 0x1000000025e [2,head] /dc-dir/dc-file_105 auth v2610 s=3 n(v0 rc2023-10-03T19:13:35.652648+0000 b3 1=1+0) (iversion lock) 0x55cf6208db80] 2023-10-03T19:20:55.901 INFO:teuthology.orchestra.run.smithi045.stdout: -2254> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000025e [2,head] #1000000025e auth v2610 s=3 n(v0 rc2023-10-03T19:13:35.652648+0000 b3 1=1+0) (iversion lock) 0x55cf6208db80] 2023-10-03T19:20:55.901 INFO:teuthology.orchestra.run.smithi045.stdout: -2253> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_105 [2,head] auth NULL (dversion lock) v=2610 ino=(nil) state=1073741824 0x55cf61eab900] 2023-10-03T19:20:55.901 INFO:teuthology.orchestra.run.smithi045.stdout: -2252> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_104 [2,head] auth (dversion lock) v=2608 ino=0x1000000025d state=1073741824 0x55cf61eab680] 2023-10-03T19:20:55.901 INFO:teuthology.orchestra.run.smithi045.stdout: -2251> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.901 INFO:teuthology.orchestra.run.smithi045.stdout: -2250> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000025d [2,head] /dc-dir/dc-file_104 auth v2608 s=3 n(v0 rc2023-10-03T19:13:35.642187+0000 b3 1=1+0) (iversion lock) 0x55cf6208d600] 2023-10-03T19:20:55.902 INFO:teuthology.orchestra.run.smithi045.stdout: -2249> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_104 [2,head] auth (dversion lock) v=2608 ino=0x1000000025d state=1073741824 0x55cf61eab680] [inode 0x1000000025d [2,head] /dc-dir/dc-file_104 auth v2608 s=3 n(v0 rc2023-10-03T19:13:35.642187+0000 b3 1=1+0) (iversion lock) 0x55cf6208d600] 2023-10-03T19:20:55.902 INFO:teuthology.orchestra.run.smithi045.stdout: -2248> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000025d [2,head] #1000000025d auth v2608 s=3 n(v0 rc2023-10-03T19:13:35.642187+0000 b3 1=1+0) (iversion lock) 0x55cf6208d600] 2023-10-03T19:20:55.902 INFO:teuthology.orchestra.run.smithi045.stdout: -2247> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_104 [2,head] auth NULL (dversion lock) v=2608 ino=(nil) state=1073741824 0x55cf61eab680] 2023-10-03T19:20:55.902 INFO:teuthology.orchestra.run.smithi045.stdout: -2246> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_103 [2,head] auth (dversion lock) v=2606 ino=0x1000000025c state=1073741824 0x55cf61eab400] 2023-10-03T19:20:55.902 INFO:teuthology.orchestra.run.smithi045.stdout: -2245> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.902 INFO:teuthology.orchestra.run.smithi045.stdout: -2244> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000025c [2,head] /dc-dir/dc-file_103 auth v2606 s=3 n(v0 rc2023-10-03T19:13:35.631861+0000 b3 1=1+0) (iversion lock) 0x55cf6208d080] 2023-10-03T19:20:55.902 INFO:teuthology.orchestra.run.smithi045.stdout: -2243> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_103 [2,head] auth (dversion lock) v=2606 ino=0x1000000025c state=1073741824 0x55cf61eab400] [inode 0x1000000025c [2,head] /dc-dir/dc-file_103 auth v2606 s=3 n(v0 rc2023-10-03T19:13:35.631861+0000 b3 1=1+0) (iversion lock) 0x55cf6208d080] 2023-10-03T19:20:55.902 INFO:teuthology.orchestra.run.smithi045.stdout: -2242> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000025c [2,head] #1000000025c auth v2606 s=3 n(v0 rc2023-10-03T19:13:35.631861+0000 b3 1=1+0) (iversion lock) 0x55cf6208d080] 2023-10-03T19:20:55.903 INFO:teuthology.orchestra.run.smithi045.stdout: -2241> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_103 [2,head] auth NULL (dversion lock) v=2606 ino=(nil) state=1073741824 0x55cf61eab400] 2023-10-03T19:20:55.903 INFO:teuthology.orchestra.run.smithi045.stdout: -2240> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_102 [2,head] auth (dversion lock) v=2604 ino=0x1000000025b state=1073741824 0x55cf61eab180] 2023-10-03T19:20:55.903 INFO:teuthology.orchestra.run.smithi045.stdout: -2239> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.903 INFO:teuthology.orchestra.run.smithi045.stdout: -2238> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000025b [2,head] /dc-dir/dc-file_102 auth v2604 s=3 n(v0 rc2023-10-03T19:13:35.621301+0000 b3 1=1+0) (iversion lock) 0x55cf6208cb00] 2023-10-03T19:20:55.903 INFO:teuthology.orchestra.run.smithi045.stdout: -2237> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_102 [2,head] auth (dversion lock) v=2604 ino=0x1000000025b state=1073741824 0x55cf61eab180] [inode 0x1000000025b [2,head] /dc-dir/dc-file_102 auth v2604 s=3 n(v0 rc2023-10-03T19:13:35.621301+0000 b3 1=1+0) (iversion lock) 0x55cf6208cb00] 2023-10-03T19:20:55.908 INFO:teuthology.orchestra.run.smithi045.stdout: -2236> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000025b [2,head] #1000000025b auth v2604 s=3 n(v0 rc2023-10-03T19:13:35.621301+0000 b3 1=1+0) (iversion lock) 0x55cf6208cb00] 2023-10-03T19:20:55.908 INFO:teuthology.orchestra.run.smithi045.stdout: -2235> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_102 [2,head] auth NULL (dversion lock) v=2604 ino=(nil) state=1073741824 0x55cf61eab180] 2023-10-03T19:20:55.908 INFO:teuthology.orchestra.run.smithi045.stdout: -2234> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_101 [2,head] auth (dversion lock) v=2602 ino=0x1000000025a state=1073741824 0x55cf61eaaf00] 2023-10-03T19:20:55.909 INFO:teuthology.orchestra.run.smithi045.stdout: -2233> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.909 INFO:teuthology.orchestra.run.smithi045.stdout: -2232> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000025a [2,head] /dc-dir/dc-file_101 auth v2602 s=3 n(v0 rc2023-10-03T19:13:35.610677+0000 b3 1=1+0) (iversion lock) 0x55cf6208c580] 2023-10-03T19:20:55.909 INFO:teuthology.orchestra.run.smithi045.stdout: -2231> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_101 [2,head] auth (dversion lock) v=2602 ino=0x1000000025a state=1073741824 0x55cf61eaaf00] [inode 0x1000000025a [2,head] /dc-dir/dc-file_101 auth v2602 s=3 n(v0 rc2023-10-03T19:13:35.610677+0000 b3 1=1+0) (iversion lock) 0x55cf6208c580] 2023-10-03T19:20:55.909 INFO:teuthology.orchestra.run.smithi045.stdout: -2230> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000025a [2,head] #1000000025a auth v2602 s=3 n(v0 rc2023-10-03T19:13:35.610677+0000 b3 1=1+0) (iversion lock) 0x55cf6208c580] 2023-10-03T19:20:55.909 INFO:teuthology.orchestra.run.smithi045.stdout: -2229> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_101 [2,head] auth NULL (dversion lock) v=2602 ino=(nil) state=1073741824 0x55cf61eaaf00] 2023-10-03T19:20:55.909 INFO:teuthology.orchestra.run.smithi045.stdout: -2228> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_100 [2,head] auth (dversion lock) v=2600 ino=0x10000000259 state=1073741824 0x55cf61eaac80] 2023-10-03T19:20:55.909 INFO:teuthology.orchestra.run.smithi045.stdout: -2227> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.909 INFO:teuthology.orchestra.run.smithi045.stdout: -2226> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000259 [2,head] /dc-dir/dc-file_100 auth v2600 s=3 n(v0 rc2023-10-03T19:13:35.599595+0000 b3 1=1+0) (iversion lock) 0x55cf6208c000] 2023-10-03T19:20:55.909 INFO:teuthology.orchestra.run.smithi045.stdout: -2225> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_100 [2,head] auth (dversion lock) v=2600 ino=0x10000000259 state=1073741824 0x55cf61eaac80] [inode 0x10000000259 [2,head] /dc-dir/dc-file_100 auth v2600 s=3 n(v0 rc2023-10-03T19:13:35.599595+0000 b3 1=1+0) (iversion lock) 0x55cf6208c000] 2023-10-03T19:20:55.909 INFO:teuthology.orchestra.run.smithi045.stdout: -2224> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000259 [2,head] #10000000259 auth v2600 s=3 n(v0 rc2023-10-03T19:13:35.599595+0000 b3 1=1+0) (iversion lock) 0x55cf6208c000] 2023-10-03T19:20:55.909 INFO:teuthology.orchestra.run.smithi045.stdout: -2223> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_100 [2,head] auth NULL (dversion lock) v=2600 ino=(nil) state=1073741824 0x55cf61eaac80] 2023-10-03T19:20:55.910 INFO:teuthology.orchestra.run.smithi045.stdout: -2222> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_99 [2,head] auth (dversion lock) v=2598 ino=0x10000000258 state=1073741824 0x55cf61eaaa00] 2023-10-03T19:20:55.910 INFO:teuthology.orchestra.run.smithi045.stdout: -2221> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.910 INFO:teuthology.orchestra.run.smithi045.stdout: -2220> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000258 [2,head] /dc-dir/dc-file_99 auth v2598 s=2 n(v0 rc2023-10-03T19:13:35.587086+0000 b2 1=1+0) (iversion lock) 0x55cf62085700] 2023-10-03T19:20:55.910 INFO:teuthology.orchestra.run.smithi045.stdout: -2219> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_99 [2,head] auth (dversion lock) v=2598 ino=0x10000000258 state=1073741824 0x55cf61eaaa00] [inode 0x10000000258 [2,head] /dc-dir/dc-file_99 auth v2598 s=2 n(v0 rc2023-10-03T19:13:35.587086+0000 b2 1=1+0) (iversion lock) 0x55cf62085700] 2023-10-03T19:20:55.910 INFO:teuthology.orchestra.run.smithi045.stdout: -2218> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000258 [2,head] #10000000258 auth v2598 s=2 n(v0 rc2023-10-03T19:13:35.587086+0000 b2 1=1+0) (iversion lock) 0x55cf62085700] 2023-10-03T19:20:55.910 INFO:teuthology.orchestra.run.smithi045.stdout: -2217> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_99 [2,head] auth NULL (dversion lock) v=2598 ino=(nil) state=1073741824 0x55cf61eaaa00] 2023-10-03T19:20:55.910 INFO:teuthology.orchestra.run.smithi045.stdout: -2216> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_98 [2,head] auth (dversion lock) v=2596 ino=0x10000000257 state=1073741824 0x55cf61eaa780] 2023-10-03T19:20:55.910 INFO:teuthology.orchestra.run.smithi045.stdout: -2215> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.910 INFO:teuthology.orchestra.run.smithi045.stdout: -2214> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000257 [2,head] /dc-dir/dc-file_98 auth v2596 s=2 n(v0 rc2023-10-03T19:13:35.575510+0000 b2 1=1+0) (iversion lock) 0x55cf62085180] 2023-10-03T19:20:55.910 INFO:teuthology.orchestra.run.smithi045.stdout: -2213> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_98 [2,head] auth (dversion lock) v=2596 ino=0x10000000257 state=1073741824 0x55cf61eaa780] [inode 0x10000000257 [2,head] /dc-dir/dc-file_98 auth v2596 s=2 n(v0 rc2023-10-03T19:13:35.575510+0000 b2 1=1+0) (iversion lock) 0x55cf62085180] 2023-10-03T19:20:55.911 INFO:teuthology.orchestra.run.smithi045.stdout: -2212> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000257 [2,head] #10000000257 auth v2596 s=2 n(v0 rc2023-10-03T19:13:35.575510+0000 b2 1=1+0) (iversion lock) 0x55cf62085180] 2023-10-03T19:20:55.911 INFO:teuthology.orchestra.run.smithi045.stdout: -2211> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_98 [2,head] auth NULL (dversion lock) v=2596 ino=(nil) state=1073741824 0x55cf61eaa780] 2023-10-03T19:20:55.911 INFO:teuthology.orchestra.run.smithi045.stdout: -2210> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_97 [2,head] auth (dversion lock) v=2594 ino=0x10000000256 state=1073741824 0x55cf61eaa500] 2023-10-03T19:20:55.911 INFO:teuthology.orchestra.run.smithi045.stdout: -2209> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.911 INFO:teuthology.orchestra.run.smithi045.stdout: -2208> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000256 [2,head] /dc-dir/dc-file_97 auth v2594 s=2 n(v0 rc2023-10-03T19:13:35.563921+0000 b2 1=1+0) (iversion lock) 0x55cf62084c00] 2023-10-03T19:20:55.911 INFO:teuthology.orchestra.run.smithi045.stdout: -2207> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_97 [2,head] auth (dversion lock) v=2594 ino=0x10000000256 state=1073741824 0x55cf61eaa500] [inode 0x10000000256 [2,head] /dc-dir/dc-file_97 auth v2594 s=2 n(v0 rc2023-10-03T19:13:35.563921+0000 b2 1=1+0) (iversion lock) 0x55cf62084c00] 2023-10-03T19:20:55.911 INFO:teuthology.orchestra.run.smithi045.stdout: -2206> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000256 [2,head] #10000000256 auth v2594 s=2 n(v0 rc2023-10-03T19:13:35.563921+0000 b2 1=1+0) (iversion lock) 0x55cf62084c00] 2023-10-03T19:20:55.911 INFO:teuthology.orchestra.run.smithi045.stdout: -2205> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_97 [2,head] auth NULL (dversion lock) v=2594 ino=(nil) state=1073741824 0x55cf61eaa500] 2023-10-03T19:20:55.911 INFO:teuthology.orchestra.run.smithi045.stdout: -2204> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_96 [2,head] auth (dversion lock) v=2592 ino=0x10000000255 state=1073741824 0x55cf61eaa280] 2023-10-03T19:20:55.911 INFO:teuthology.orchestra.run.smithi045.stdout: -2203> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.911 INFO:teuthology.orchestra.run.smithi045.stdout: -2202> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000255 [2,head] /dc-dir/dc-file_96 auth v2592 s=2 n(v0 rc2023-10-03T19:13:35.551524+0000 b2 1=1+0) (iversion lock) 0x55cf62084680] 2023-10-03T19:20:55.912 INFO:teuthology.orchestra.run.smithi045.stdout: -2201> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_96 [2,head] auth (dversion lock) v=2592 ino=0x10000000255 state=1073741824 0x55cf61eaa280] [inode 0x10000000255 [2,head] /dc-dir/dc-file_96 auth v2592 s=2 n(v0 rc2023-10-03T19:13:35.551524+0000 b2 1=1+0) (iversion lock) 0x55cf62084680] 2023-10-03T19:20:55.912 INFO:teuthology.orchestra.run.smithi045.stdout: -2200> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000255 [2,head] #10000000255 auth v2592 s=2 n(v0 rc2023-10-03T19:13:35.551524+0000 b2 1=1+0) (iversion lock) 0x55cf62084680] 2023-10-03T19:20:55.912 INFO:teuthology.orchestra.run.smithi045.stdout: -2199> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_96 [2,head] auth NULL (dversion lock) v=2592 ino=(nil) state=1073741824 0x55cf61eaa280] 2023-10-03T19:20:55.912 INFO:teuthology.orchestra.run.smithi045.stdout: -2198> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_95 [2,head] auth (dversion lock) v=2590 ino=0x10000000254 state=1073741824 0x55cf61eaa000] 2023-10-03T19:20:55.912 INFO:teuthology.orchestra.run.smithi045.stdout: -2197> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.912 INFO:teuthology.orchestra.run.smithi045.stdout: -2196> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000254 [2,head] /dc-dir/dc-file_95 auth v2590 s=2 n(v0 rc2023-10-03T19:13:35.539748+0000 b2 1=1+0) (iversion lock) 0x55cf62084100] 2023-10-03T19:20:55.912 INFO:teuthology.orchestra.run.smithi045.stdout: -2195> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_95 [2,head] auth (dversion lock) v=2590 ino=0x10000000254 state=1073741824 0x55cf61eaa000] [inode 0x10000000254 [2,head] /dc-dir/dc-file_95 auth v2590 s=2 n(v0 rc2023-10-03T19:13:35.539748+0000 b2 1=1+0) (iversion lock) 0x55cf62084100] 2023-10-03T19:20:55.912 INFO:teuthology.orchestra.run.smithi045.stdout: -2194> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000254 [2,head] #10000000254 auth v2590 s=2 n(v0 rc2023-10-03T19:13:35.539748+0000 b2 1=1+0) (iversion lock) 0x55cf62084100] 2023-10-03T19:20:55.912 INFO:teuthology.orchestra.run.smithi045.stdout: -2193> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_95 [2,head] auth NULL (dversion lock) v=2590 ino=(nil) state=1073741824 0x55cf61eaa000] 2023-10-03T19:20:55.912 INFO:teuthology.orchestra.run.smithi045.stdout: -2192> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_94 [2,head] auth (dversion lock) v=2588 ino=0x10000000253 state=1073741824 0x55cf61fd3b80] 2023-10-03T19:20:55.912 INFO:teuthology.orchestra.run.smithi045.stdout: -2191> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.913 INFO:teuthology.orchestra.run.smithi045.stdout: -2190> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000253 [2,head] /dc-dir/dc-file_94 auth v2588 s=2 n(v0 rc2023-10-03T19:13:35.528338+0000 b2 1=1+0) (iversion lock) 0x55cf62083b80] 2023-10-03T19:20:55.913 INFO:teuthology.orchestra.run.smithi045.stdout: -2189> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_94 [2,head] auth (dversion lock) v=2588 ino=0x10000000253 state=1073741824 0x55cf61fd3b80] [inode 0x10000000253 [2,head] /dc-dir/dc-file_94 auth v2588 s=2 n(v0 rc2023-10-03T19:13:35.528338+0000 b2 1=1+0) (iversion lock) 0x55cf62083b80] 2023-10-03T19:20:55.913 INFO:teuthology.orchestra.run.smithi045.stdout: -2188> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000253 [2,head] #10000000253 auth v2588 s=2 n(v0 rc2023-10-03T19:13:35.528338+0000 b2 1=1+0) (iversion lock) 0x55cf62083b80] 2023-10-03T19:20:55.913 INFO:teuthology.orchestra.run.smithi045.stdout: -2187> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_94 [2,head] auth NULL (dversion lock) v=2588 ino=(nil) state=1073741824 0x55cf61fd3b80] 2023-10-03T19:20:55.913 INFO:teuthology.orchestra.run.smithi045.stdout: -2186> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_93 [2,head] auth (dversion lock) v=2586 ino=0x10000000252 state=1073741824 0x55cf61fd3900] 2023-10-03T19:20:55.913 INFO:teuthology.orchestra.run.smithi045.stdout: -2185> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.913 INFO:teuthology.orchestra.run.smithi045.stdout: -2184> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000252 [2,head] /dc-dir/dc-file_93 auth v2586 s=2 n(v0 rc2023-10-03T19:13:35.516946+0000 b2 1=1+0) (iversion lock) 0x55cf62083600] 2023-10-03T19:20:55.913 INFO:teuthology.orchestra.run.smithi045.stdout: -2183> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_93 [2,head] auth (dversion lock) v=2586 ino=0x10000000252 state=1073741824 0x55cf61fd3900] [inode 0x10000000252 [2,head] /dc-dir/dc-file_93 auth v2586 s=2 n(v0 rc2023-10-03T19:13:35.516946+0000 b2 1=1+0) (iversion lock) 0x55cf62083600] 2023-10-03T19:20:55.913 INFO:teuthology.orchestra.run.smithi045.stdout: -2182> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000252 [2,head] #10000000252 auth v2586 s=2 n(v0 rc2023-10-03T19:13:35.516946+0000 b2 1=1+0) (iversion lock) 0x55cf62083600] 2023-10-03T19:20:55.913 INFO:teuthology.orchestra.run.smithi045.stdout: -2181> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_93 [2,head] auth NULL (dversion lock) v=2586 ino=(nil) state=1073741824 0x55cf61fd3900] 2023-10-03T19:20:55.913 INFO:teuthology.orchestra.run.smithi045.stdout: -2180> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_92 [2,head] auth (dversion lock) v=2584 ino=0x10000000251 state=1073741824 0x55cf61fd3680] 2023-10-03T19:20:55.914 INFO:teuthology.orchestra.run.smithi045.stdout: -2179> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.914 INFO:teuthology.orchestra.run.smithi045.stdout: -2178> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000251 [2,head] /dc-dir/dc-file_92 auth v2584 s=2 n(v0 rc2023-10-03T19:13:35.505323+0000 b2 1=1+0) (iversion lock) 0x55cf62083080] 2023-10-03T19:20:55.914 INFO:teuthology.orchestra.run.smithi045.stdout: -2177> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_92 [2,head] auth (dversion lock) v=2584 ino=0x10000000251 state=1073741824 0x55cf61fd3680] [inode 0x10000000251 [2,head] /dc-dir/dc-file_92 auth v2584 s=2 n(v0 rc2023-10-03T19:13:35.505323+0000 b2 1=1+0) (iversion lock) 0x55cf62083080] 2023-10-03T19:20:55.914 INFO:teuthology.orchestra.run.smithi045.stdout: -2176> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000251 [2,head] #10000000251 auth v2584 s=2 n(v0 rc2023-10-03T19:13:35.505323+0000 b2 1=1+0) (iversion lock) 0x55cf62083080] 2023-10-03T19:20:55.914 INFO:teuthology.orchestra.run.smithi045.stdout: -2175> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_92 [2,head] auth NULL (dversion lock) v=2584 ino=(nil) state=1073741824 0x55cf61fd3680] 2023-10-03T19:20:55.914 INFO:teuthology.orchestra.run.smithi045.stdout: -2174> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_91 [2,head] auth (dversion lock) v=2582 ino=0x10000000250 state=1073741824 0x55cf61fd3400] 2023-10-03T19:20:55.914 INFO:teuthology.orchestra.run.smithi045.stdout: -2173> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.914 INFO:teuthology.orchestra.run.smithi045.stdout: -2172> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000250 [2,head] /dc-dir/dc-file_91 auth v2582 s=2 n(v0 rc2023-10-03T19:13:35.493530+0000 b2 1=1+0) (iversion lock) 0x55cf62082b00] 2023-10-03T19:20:55.914 INFO:teuthology.orchestra.run.smithi045.stdout: -2171> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_91 [2,head] auth (dversion lock) v=2582 ino=0x10000000250 state=1073741824 0x55cf61fd3400] [inode 0x10000000250 [2,head] /dc-dir/dc-file_91 auth v2582 s=2 n(v0 rc2023-10-03T19:13:35.493530+0000 b2 1=1+0) (iversion lock) 0x55cf62082b00] 2023-10-03T19:20:55.914 INFO:teuthology.orchestra.run.smithi045.stdout: -2170> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000250 [2,head] #10000000250 auth v2582 s=2 n(v0 rc2023-10-03T19:13:35.493530+0000 b2 1=1+0) (iversion lock) 0x55cf62082b00] 2023-10-03T19:20:55.914 INFO:teuthology.orchestra.run.smithi045.stdout: -2169> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_91 [2,head] auth NULL (dversion lock) v=2582 ino=(nil) state=1073741824 0x55cf61fd3400] 2023-10-03T19:20:55.915 INFO:teuthology.orchestra.run.smithi045.stdout: -2168> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_90 [2,head] auth (dversion lock) v=2580 ino=0x1000000024f state=1073741824 0x55cf61fd3180] 2023-10-03T19:20:55.915 INFO:teuthology.orchestra.run.smithi045.stdout: -2167> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.915 INFO:teuthology.orchestra.run.smithi045.stdout: -2166> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000024f [2,head] /dc-dir/dc-file_90 auth v2580 s=2 n(v0 rc2023-10-03T19:13:35.481541+0000 b2 1=1+0) (iversion lock) 0x55cf62082580] 2023-10-03T19:20:55.915 INFO:teuthology.orchestra.run.smithi045.stdout: -2165> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_90 [2,head] auth (dversion lock) v=2580 ino=0x1000000024f state=1073741824 0x55cf61fd3180] [inode 0x1000000024f [2,head] /dc-dir/dc-file_90 auth v2580 s=2 n(v0 rc2023-10-03T19:13:35.481541+0000 b2 1=1+0) (iversion lock) 0x55cf62082580] 2023-10-03T19:20:55.915 INFO:teuthology.orchestra.run.smithi045.stdout: -2164> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000024f [2,head] #1000000024f auth v2580 s=2 n(v0 rc2023-10-03T19:13:35.481541+0000 b2 1=1+0) (iversion lock) 0x55cf62082580] 2023-10-03T19:20:55.915 INFO:teuthology.orchestra.run.smithi045.stdout: -2163> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_90 [2,head] auth NULL (dversion lock) v=2580 ino=(nil) state=1073741824 0x55cf61fd3180] 2023-10-03T19:20:55.915 INFO:teuthology.orchestra.run.smithi045.stdout: -2162> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_89 [2,head] auth (dversion lock) v=2268 ino=0x1000000024e state=1073741824 0x55cf61fd2f00] 2023-10-03T19:20:55.915 INFO:teuthology.orchestra.run.smithi045.stdout: -2161> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.915 INFO:teuthology.orchestra.run.smithi045.stdout: -2160> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000024e [2,head] /dc-dir/dc-file_89 auth v2268 s=2 n(v0 rc2023-10-03T19:13:35.469643+0000 b2 1=1+0) (iversion lock) 0x55cf62082000] 2023-10-03T19:20:55.915 INFO:teuthology.orchestra.run.smithi045.stdout: -2159> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_89 [2,head] auth (dversion lock) v=2268 ino=0x1000000024e state=1073741824 0x55cf61fd2f00] [inode 0x1000000024e [2,head] /dc-dir/dc-file_89 auth v2268 s=2 n(v0 rc2023-10-03T19:13:35.469643+0000 b2 1=1+0) (iversion lock) 0x55cf62082000] 2023-10-03T19:20:55.915 INFO:teuthology.orchestra.run.smithi045.stdout: -2158> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000024e [2,head] #1000000024e auth v2268 s=2 n(v0 rc2023-10-03T19:13:35.469643+0000 b2 1=1+0) (iversion lock) 0x55cf62082000] 2023-10-03T19:20:55.916 INFO:teuthology.orchestra.run.smithi045.stdout: -2157> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_89 [2,head] auth NULL (dversion lock) v=2268 ino=(nil) state=1073741824 0x55cf61fd2f00] 2023-10-03T19:20:55.916 INFO:teuthology.orchestra.run.smithi045.stdout: -2156> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_88 [2,head] auth (dversion lock) v=2266 ino=0x1000000024d state=1073741824 0x55cf61fd2c80] 2023-10-03T19:20:55.916 INFO:teuthology.orchestra.run.smithi045.stdout: -2155> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.916 INFO:teuthology.orchestra.run.smithi045.stdout: -2154> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000024d [2,head] /dc-dir/dc-file_88 auth v2266 s=2 n(v0 rc2023-10-03T19:13:35.457797+0000 b2 1=1+0) (iversion lock) 0x55cf6207d700] 2023-10-03T19:20:55.916 INFO:teuthology.orchestra.run.smithi045.stdout: -2153> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_88 [2,head] auth (dversion lock) v=2266 ino=0x1000000024d state=1073741824 0x55cf61fd2c80] [inode 0x1000000024d [2,head] /dc-dir/dc-file_88 auth v2266 s=2 n(v0 rc2023-10-03T19:13:35.457797+0000 b2 1=1+0) (iversion lock) 0x55cf6207d700] 2023-10-03T19:20:55.916 INFO:teuthology.orchestra.run.smithi045.stdout: -2152> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000024d [2,head] #1000000024d auth v2266 s=2 n(v0 rc2023-10-03T19:13:35.457797+0000 b2 1=1+0) (iversion lock) 0x55cf6207d700] 2023-10-03T19:20:55.916 INFO:teuthology.orchestra.run.smithi045.stdout: -2151> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_88 [2,head] auth NULL (dversion lock) v=2266 ino=(nil) state=1073741824 0x55cf61fd2c80] 2023-10-03T19:20:55.916 INFO:teuthology.orchestra.run.smithi045.stdout: -2150> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_87 [2,head] auth (dversion lock) v=2264 ino=0x1000000024c state=1073741824 0x55cf61fd2a00] 2023-10-03T19:20:55.916 INFO:teuthology.orchestra.run.smithi045.stdout: -2149> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.916 INFO:teuthology.orchestra.run.smithi045.stdout: -2148> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000024c [2,head] /dc-dir/dc-file_87 auth v2264 s=2 n(v0 rc2023-10-03T19:13:35.446420+0000 b2 1=1+0) (iversion lock) 0x55cf6207d180] 2023-10-03T19:20:55.916 INFO:teuthology.orchestra.run.smithi045.stdout: -2147> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_87 [2,head] auth (dversion lock) v=2264 ino=0x1000000024c state=1073741824 0x55cf61fd2a00] [inode 0x1000000024c [2,head] /dc-dir/dc-file_87 auth v2264 s=2 n(v0 rc2023-10-03T19:13:35.446420+0000 b2 1=1+0) (iversion lock) 0x55cf6207d180] 2023-10-03T19:20:55.916 INFO:teuthology.orchestra.run.smithi045.stdout: -2146> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000024c [2,head] #1000000024c auth v2264 s=2 n(v0 rc2023-10-03T19:13:35.446420+0000 b2 1=1+0) (iversion lock) 0x55cf6207d180] 2023-10-03T19:20:55.917 INFO:teuthology.orchestra.run.smithi045.stdout: -2145> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_87 [2,head] auth NULL (dversion lock) v=2264 ino=(nil) state=1073741824 0x55cf61fd2a00] 2023-10-03T19:20:55.917 INFO:teuthology.orchestra.run.smithi045.stdout: -2144> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_86 [2,head] auth (dversion lock) v=2262 ino=0x1000000024b state=1073741824 0x55cf61fd2780] 2023-10-03T19:20:55.917 INFO:teuthology.orchestra.run.smithi045.stdout: -2143> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.917 INFO:teuthology.orchestra.run.smithi045.stdout: -2142> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000024b [2,head] /dc-dir/dc-file_86 auth v2262 s=2 n(v0 rc2023-10-03T19:13:35.435033+0000 b2 1=1+0) (iversion lock) 0x55cf6207cc00] 2023-10-03T19:20:55.917 INFO:teuthology.orchestra.run.smithi045.stdout: -2141> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_86 [2,head] auth (dversion lock) v=2262 ino=0x1000000024b state=1073741824 0x55cf61fd2780] [inode 0x1000000024b [2,head] /dc-dir/dc-file_86 auth v2262 s=2 n(v0 rc2023-10-03T19:13:35.435033+0000 b2 1=1+0) (iversion lock) 0x55cf6207cc00] 2023-10-03T19:20:55.917 INFO:teuthology.orchestra.run.smithi045.stdout: -2140> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000024b [2,head] #1000000024b auth v2262 s=2 n(v0 rc2023-10-03T19:13:35.435033+0000 b2 1=1+0) (iversion lock) 0x55cf6207cc00] 2023-10-03T19:20:55.917 INFO:teuthology.orchestra.run.smithi045.stdout: -2139> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_86 [2,head] auth NULL (dversion lock) v=2262 ino=(nil) state=1073741824 0x55cf61fd2780] 2023-10-03T19:20:55.917 INFO:teuthology.orchestra.run.smithi045.stdout: -2138> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_85 [2,head] auth (dversion lock) v=2260 ino=0x1000000024a state=1073741824 0x55cf61fd2500] 2023-10-03T19:20:55.917 INFO:teuthology.orchestra.run.smithi045.stdout: -2137> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.917 INFO:teuthology.orchestra.run.smithi045.stdout: -2136> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000024a [2,head] /dc-dir/dc-file_85 auth v2260 s=2 n(v0 rc2023-10-03T19:13:35.423849+0000 b2 1=1+0) (iversion lock) 0x55cf6207c680] 2023-10-03T19:20:55.917 INFO:teuthology.orchestra.run.smithi045.stdout: -2135> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_85 [2,head] auth (dversion lock) v=2260 ino=0x1000000024a state=1073741824 0x55cf61fd2500] [inode 0x1000000024a [2,head] /dc-dir/dc-file_85 auth v2260 s=2 n(v0 rc2023-10-03T19:13:35.423849+0000 b2 1=1+0) (iversion lock) 0x55cf6207c680] 2023-10-03T19:20:55.918 INFO:teuthology.orchestra.run.smithi045.stdout: -2134> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000024a [2,head] #1000000024a auth v2260 s=2 n(v0 rc2023-10-03T19:13:35.423849+0000 b2 1=1+0) (iversion lock) 0x55cf6207c680] 2023-10-03T19:20:55.918 INFO:teuthology.orchestra.run.smithi045.stdout: -2133> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_85 [2,head] auth NULL (dversion lock) v=2260 ino=(nil) state=1073741824 0x55cf61fd2500] 2023-10-03T19:20:55.918 INFO:teuthology.orchestra.run.smithi045.stdout: -2132> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_84 [2,head] auth (dversion lock) v=2258 ino=0x10000000249 state=1073741824 0x55cf61fd2280] 2023-10-03T19:20:55.918 INFO:teuthology.orchestra.run.smithi045.stdout: -2131> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.918 INFO:teuthology.orchestra.run.smithi045.stdout: -2130> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000249 [2,head] /dc-dir/dc-file_84 auth v2258 s=2 n(v0 rc2023-10-03T19:13:35.411966+0000 b2 1=1+0) (iversion lock) 0x55cf6207c100] 2023-10-03T19:20:55.918 INFO:teuthology.orchestra.run.smithi045.stdout: -2129> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_84 [2,head] auth (dversion lock) v=2258 ino=0x10000000249 state=1073741824 0x55cf61fd2280] [inode 0x10000000249 [2,head] /dc-dir/dc-file_84 auth v2258 s=2 n(v0 rc2023-10-03T19:13:35.411966+0000 b2 1=1+0) (iversion lock) 0x55cf6207c100] 2023-10-03T19:20:55.918 INFO:teuthology.orchestra.run.smithi045.stdout: -2128> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000249 [2,head] #10000000249 auth v2258 s=2 n(v0 rc2023-10-03T19:13:35.411966+0000 b2 1=1+0) (iversion lock) 0x55cf6207c100] 2023-10-03T19:20:55.918 INFO:teuthology.orchestra.run.smithi045.stdout: -2127> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_84 [2,head] auth NULL (dversion lock) v=2258 ino=(nil) state=1073741824 0x55cf61fd2280] 2023-10-03T19:20:55.918 INFO:teuthology.orchestra.run.smithi045.stdout: -2126> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_83 [2,head] auth (dversion lock) v=2256 ino=0x10000000248 state=1073741824 0x55cf61fd2000] 2023-10-03T19:20:55.918 INFO:teuthology.orchestra.run.smithi045.stdout: -2125> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.918 INFO:teuthology.orchestra.run.smithi045.stdout: -2124> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000248 [2,head] /dc-dir/dc-file_83 auth v2256 s=2 n(v0 rc2023-10-03T19:13:35.400011+0000 b2 1=1+0) (iversion lock) 0x55cf6207bb80] 2023-10-03T19:20:55.919 INFO:teuthology.orchestra.run.smithi045.stdout: -2123> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_83 [2,head] auth (dversion lock) v=2256 ino=0x10000000248 state=1073741824 0x55cf61fd2000] [inode 0x10000000248 [2,head] /dc-dir/dc-file_83 auth v2256 s=2 n(v0 rc2023-10-03T19:13:35.400011+0000 b2 1=1+0) (iversion lock) 0x55cf6207bb80] 2023-10-03T19:20:55.919 INFO:teuthology.orchestra.run.smithi045.stdout: -2122> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000248 [2,head] #10000000248 auth v2256 s=2 n(v0 rc2023-10-03T19:13:35.400011+0000 b2 1=1+0) (iversion lock) 0x55cf6207bb80] 2023-10-03T19:20:55.919 INFO:teuthology.orchestra.run.smithi045.stdout: -2121> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_83 [2,head] auth NULL (dversion lock) v=2256 ino=(nil) state=1073741824 0x55cf61fd2000] 2023-10-03T19:20:55.919 INFO:teuthology.orchestra.run.smithi045.stdout: -2120> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_82 [2,head] auth (dversion lock) v=2254 ino=0x10000000247 state=1073741824 0x55cf61fe3b80] 2023-10-03T19:20:55.919 INFO:teuthology.orchestra.run.smithi045.stdout: -2119> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.919 INFO:teuthology.orchestra.run.smithi045.stdout: -2118> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000247 [2,head] /dc-dir/dc-file_82 auth v2254 s=2 n(v0 rc2023-10-03T19:13:35.388542+0000 b2 1=1+0) (iversion lock) 0x55cf6207b600] 2023-10-03T19:20:55.919 INFO:teuthology.orchestra.run.smithi045.stdout: -2117> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_82 [2,head] auth (dversion lock) v=2254 ino=0x10000000247 state=1073741824 0x55cf61fe3b80] [inode 0x10000000247 [2,head] /dc-dir/dc-file_82 auth v2254 s=2 n(v0 rc2023-10-03T19:13:35.388542+0000 b2 1=1+0) (iversion lock) 0x55cf6207b600] 2023-10-03T19:20:55.919 INFO:teuthology.orchestra.run.smithi045.stdout: -2116> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000247 [2,head] #10000000247 auth v2254 s=2 n(v0 rc2023-10-03T19:13:35.388542+0000 b2 1=1+0) (iversion lock) 0x55cf6207b600] 2023-10-03T19:20:55.919 INFO:teuthology.orchestra.run.smithi045.stdout: -2115> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_82 [2,head] auth NULL (dversion lock) v=2254 ino=(nil) state=1073741824 0x55cf61fe3b80] 2023-10-03T19:20:55.919 INFO:teuthology.orchestra.run.smithi045.stdout: -2114> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_81 [2,head] auth (dversion lock) v=2252 ino=0x10000000246 state=1073741824 0x55cf61fe3900] 2023-10-03T19:20:55.919 INFO:teuthology.orchestra.run.smithi045.stdout: -2113> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.919 INFO:teuthology.orchestra.run.smithi045.stdout: -2112> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000246 [2,head] /dc-dir/dc-file_81 auth v2252 s=2 n(v0 rc2023-10-03T19:13:35.376553+0000 b2 1=1+0) (iversion lock) 0x55cf6207b080] 2023-10-03T19:20:55.920 INFO:teuthology.orchestra.run.smithi045.stdout: -2111> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_81 [2,head] auth (dversion lock) v=2252 ino=0x10000000246 state=1073741824 0x55cf61fe3900] [inode 0x10000000246 [2,head] /dc-dir/dc-file_81 auth v2252 s=2 n(v0 rc2023-10-03T19:13:35.376553+0000 b2 1=1+0) (iversion lock) 0x55cf6207b080] 2023-10-03T19:20:55.920 INFO:teuthology.orchestra.run.smithi045.stdout: -2110> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000246 [2,head] #10000000246 auth v2252 s=2 n(v0 rc2023-10-03T19:13:35.376553+0000 b2 1=1+0) (iversion lock) 0x55cf6207b080] 2023-10-03T19:20:55.920 INFO:teuthology.orchestra.run.smithi045.stdout: -2109> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_81 [2,head] auth NULL (dversion lock) v=2252 ino=(nil) state=1073741824 0x55cf61fe3900] 2023-10-03T19:20:55.920 INFO:teuthology.orchestra.run.smithi045.stdout: -2108> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_80 [2,head] auth (dversion lock) v=2250 ino=0x10000000245 state=1073741824 0x55cf61fe3680] 2023-10-03T19:20:55.920 INFO:teuthology.orchestra.run.smithi045.stdout: -2107> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.920 INFO:teuthology.orchestra.run.smithi045.stdout: -2106> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000245 [2,head] /dc-dir/dc-file_80 auth v2250 s=2 n(v0 rc2023-10-03T19:13:35.365190+0000 b2 1=1+0) (iversion lock) 0x55cf6207ab00] 2023-10-03T19:20:55.920 INFO:teuthology.orchestra.run.smithi045.stdout: -2105> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_80 [2,head] auth (dversion lock) v=2250 ino=0x10000000245 state=1073741824 0x55cf61fe3680] [inode 0x10000000245 [2,head] /dc-dir/dc-file_80 auth v2250 s=2 n(v0 rc2023-10-03T19:13:35.365190+0000 b2 1=1+0) (iversion lock) 0x55cf6207ab00] 2023-10-03T19:20:55.920 INFO:teuthology.orchestra.run.smithi045.stdout: -2104> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000245 [2,head] #10000000245 auth v2250 s=2 n(v0 rc2023-10-03T19:13:35.365190+0000 b2 1=1+0) (iversion lock) 0x55cf6207ab00] 2023-10-03T19:20:55.920 INFO:teuthology.orchestra.run.smithi045.stdout: -2103> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_80 [2,head] auth NULL (dversion lock) v=2250 ino=(nil) state=1073741824 0x55cf61fe3680] 2023-10-03T19:20:55.920 INFO:teuthology.orchestra.run.smithi045.stdout: -2102> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_79 [2,head] auth (dversion lock) v=2248 ino=0x10000000244 state=1073741824 0x55cf61fe3400] 2023-10-03T19:20:55.921 INFO:teuthology.orchestra.run.smithi045.stdout: -2101> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.921 INFO:teuthology.orchestra.run.smithi045.stdout: -2100> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000244 [2,head] /dc-dir/dc-file_79 auth v2248 s=2 n(v0 rc2023-10-03T19:13:35.353186+0000 b2 1=1+0) (iversion lock) 0x55cf6207a580] 2023-10-03T19:20:55.921 INFO:teuthology.orchestra.run.smithi045.stdout: -2099> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_79 [2,head] auth (dversion lock) v=2248 ino=0x10000000244 state=1073741824 0x55cf61fe3400] [inode 0x10000000244 [2,head] /dc-dir/dc-file_79 auth v2248 s=2 n(v0 rc2023-10-03T19:13:35.353186+0000 b2 1=1+0) (iversion lock) 0x55cf6207a580] 2023-10-03T19:20:55.921 INFO:teuthology.orchestra.run.smithi045.stdout: -2098> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000244 [2,head] #10000000244 auth v2248 s=2 n(v0 rc2023-10-03T19:13:35.353186+0000 b2 1=1+0) (iversion lock) 0x55cf6207a580] 2023-10-03T19:20:55.921 INFO:teuthology.orchestra.run.smithi045.stdout: -2097> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_79 [2,head] auth NULL (dversion lock) v=2248 ino=(nil) state=1073741824 0x55cf61fe3400] 2023-10-03T19:20:55.921 INFO:teuthology.orchestra.run.smithi045.stdout: -2096> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_78 [2,head] auth (dversion lock) v=2246 ino=0x10000000243 state=1073741824 0x55cf61fe3180] 2023-10-03T19:20:55.921 INFO:teuthology.orchestra.run.smithi045.stdout: -2095> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.921 INFO:teuthology.orchestra.run.smithi045.stdout: -2094> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000243 [2,head] /dc-dir/dc-file_78 auth v2246 s=2 n(v0 rc2023-10-03T19:13:35.341333+0000 b2 1=1+0) (iversion lock) 0x55cf6207a000] 2023-10-03T19:20:55.921 INFO:teuthology.orchestra.run.smithi045.stdout: -2093> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_78 [2,head] auth (dversion lock) v=2246 ino=0x10000000243 state=1073741824 0x55cf61fe3180] [inode 0x10000000243 [2,head] /dc-dir/dc-file_78 auth v2246 s=2 n(v0 rc2023-10-03T19:13:35.341333+0000 b2 1=1+0) (iversion lock) 0x55cf6207a000] 2023-10-03T19:20:55.921 INFO:teuthology.orchestra.run.smithi045.stdout: -2092> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000243 [2,head] #10000000243 auth v2246 s=2 n(v0 rc2023-10-03T19:13:35.341333+0000 b2 1=1+0) (iversion lock) 0x55cf6207a000] 2023-10-03T19:20:55.921 INFO:teuthology.orchestra.run.smithi045.stdout: -2091> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_78 [2,head] auth NULL (dversion lock) v=2246 ino=(nil) state=1073741824 0x55cf61fe3180] 2023-10-03T19:20:55.921 INFO:teuthology.orchestra.run.smithi045.stdout: -2090> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_77 [2,head] auth (dversion lock) v=2244 ino=0x10000000242 state=1073741824 0x55cf61fe2f00] 2023-10-03T19:20:55.922 INFO:teuthology.orchestra.run.smithi045.stdout: -2089> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.922 INFO:teuthology.orchestra.run.smithi045.stdout: -2088> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000242 [2,head] /dc-dir/dc-file_77 auth v2244 s=2 n(v0 rc2023-10-03T19:13:35.330918+0000 b2 1=1+0) (iversion lock) 0x55cf62077700] 2023-10-03T19:20:55.922 INFO:teuthology.orchestra.run.smithi045.stdout: -2087> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_77 [2,head] auth (dversion lock) v=2244 ino=0x10000000242 state=1073741824 0x55cf61fe2f00] [inode 0x10000000242 [2,head] /dc-dir/dc-file_77 auth v2244 s=2 n(v0 rc2023-10-03T19:13:35.330918+0000 b2 1=1+0) (iversion lock) 0x55cf62077700] 2023-10-03T19:20:55.922 INFO:teuthology.orchestra.run.smithi045.stdout: -2086> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000242 [2,head] #10000000242 auth v2244 s=2 n(v0 rc2023-10-03T19:13:35.330918+0000 b2 1=1+0) (iversion lock) 0x55cf62077700] 2023-10-03T19:20:55.922 INFO:teuthology.orchestra.run.smithi045.stdout: -2085> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_77 [2,head] auth NULL (dversion lock) v=2244 ino=(nil) state=1073741824 0x55cf61fe2f00] 2023-10-03T19:20:55.922 INFO:teuthology.orchestra.run.smithi045.stdout: -2084> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_76 [2,head] auth (dversion lock) v=2242 ino=0x10000000241 state=1073741824 0x55cf61fe2c80] 2023-10-03T19:20:55.922 INFO:teuthology.orchestra.run.smithi045.stdout: -2083> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.922 INFO:teuthology.orchestra.run.smithi045.stdout: -2082> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000241 [2,head] /dc-dir/dc-file_76 auth v2242 s=2 n(v0 rc2023-10-03T19:13:35.319756+0000 b2 1=1+0) (iversion lock) 0x55cf62077180] 2023-10-03T19:20:55.922 INFO:teuthology.orchestra.run.smithi045.stdout: -2081> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_76 [2,head] auth (dversion lock) v=2242 ino=0x10000000241 state=1073741824 0x55cf61fe2c80] [inode 0x10000000241 [2,head] /dc-dir/dc-file_76 auth v2242 s=2 n(v0 rc2023-10-03T19:13:35.319756+0000 b2 1=1+0) (iversion lock) 0x55cf62077180] 2023-10-03T19:20:55.937 INFO:teuthology.orchestra.run.smithi045.stdout: -2080> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000241 [2,head] #10000000241 auth v2242 s=2 n(v0 rc2023-10-03T19:13:35.319756+0000 b2 1=1+0) (iversion lock) 0x55cf62077180] 2023-10-03T19:20:55.937 INFO:teuthology.orchestra.run.smithi045.stdout: -2079> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_76 [2,head] auth NULL (dversion lock) v=2242 ino=(nil) state=1073741824 0x55cf61fe2c80] 2023-10-03T19:20:55.937 INFO:teuthology.orchestra.run.smithi045.stdout: -2078> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_75 [2,head] auth (dversion lock) v=2240 ino=0x10000000240 state=1073741824 0x55cf61fe2a00] 2023-10-03T19:20:55.937 INFO:teuthology.orchestra.run.smithi045.stdout: -2077> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.937 INFO:teuthology.orchestra.run.smithi045.stdout: -2076> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000240 [2,head] /dc-dir/dc-file_75 auth v2240 s=2 n(v0 rc2023-10-03T19:13:35.309932+0000 b2 1=1+0) (iversion lock) 0x55cf62076c00] 2023-10-03T19:20:55.937 INFO:teuthology.orchestra.run.smithi045.stdout: -2075> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_75 [2,head] auth (dversion lock) v=2240 ino=0x10000000240 state=1073741824 0x55cf61fe2a00] [inode 0x10000000240 [2,head] /dc-dir/dc-file_75 auth v2240 s=2 n(v0 rc2023-10-03T19:13:35.309932+0000 b2 1=1+0) (iversion lock) 0x55cf62076c00] 2023-10-03T19:20:55.937 INFO:teuthology.orchestra.run.smithi045.stdout: -2074> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000240 [2,head] #10000000240 auth v2240 s=2 n(v0 rc2023-10-03T19:13:35.309932+0000 b2 1=1+0) (iversion lock) 0x55cf62076c00] 2023-10-03T19:20:55.938 INFO:teuthology.orchestra.run.smithi045.stdout: -2073> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_75 [2,head] auth NULL (dversion lock) v=2240 ino=(nil) state=1073741824 0x55cf61fe2a00] 2023-10-03T19:20:55.938 INFO:teuthology.orchestra.run.smithi045.stdout: -2072> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_74 [2,head] auth (dversion lock) v=2238 ino=0x1000000023f state=1073741824 0x55cf61fe2780] 2023-10-03T19:20:55.938 INFO:teuthology.orchestra.run.smithi045.stdout: -2071> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.938 INFO:teuthology.orchestra.run.smithi045.stdout: -2070> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000023f [2,head] /dc-dir/dc-file_74 auth v2238 s=2 n(v0 rc2023-10-03T19:13:35.299172+0000 b2 1=1+0) (iversion lock) 0x55cf62076680] 2023-10-03T19:20:55.938 INFO:teuthology.orchestra.run.smithi045.stdout: -2069> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_74 [2,head] auth (dversion lock) v=2238 ino=0x1000000023f state=1073741824 0x55cf61fe2780] [inode 0x1000000023f [2,head] /dc-dir/dc-file_74 auth v2238 s=2 n(v0 rc2023-10-03T19:13:35.299172+0000 b2 1=1+0) (iversion lock) 0x55cf62076680] 2023-10-03T19:20:55.938 INFO:teuthology.orchestra.run.smithi045.stdout: -2068> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000023f [2,head] #1000000023f auth v2238 s=2 n(v0 rc2023-10-03T19:13:35.299172+0000 b2 1=1+0) (iversion lock) 0x55cf62076680] 2023-10-03T19:20:55.938 INFO:teuthology.orchestra.run.smithi045.stdout: -2067> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_74 [2,head] auth NULL (dversion lock) v=2238 ino=(nil) state=1073741824 0x55cf61fe2780] 2023-10-03T19:20:55.938 INFO:teuthology.orchestra.run.smithi045.stdout: -2066> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_73 [2,head] auth (dversion lock) v=2236 ino=0x1000000023e state=1073741824 0x55cf61fe2500] 2023-10-03T19:20:55.938 INFO:teuthology.orchestra.run.smithi045.stdout: -2065> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.938 INFO:teuthology.orchestra.run.smithi045.stdout: -2064> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000023e [2,head] /dc-dir/dc-file_73 auth v2236 s=2 n(v0 rc2023-10-03T19:13:35.288470+0000 b2 1=1+0) (iversion lock) 0x55cf62076100] 2023-10-03T19:20:55.939 INFO:teuthology.orchestra.run.smithi045.stdout: -2063> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_73 [2,head] auth (dversion lock) v=2236 ino=0x1000000023e state=1073741824 0x55cf61fe2500] [inode 0x1000000023e [2,head] /dc-dir/dc-file_73 auth v2236 s=2 n(v0 rc2023-10-03T19:13:35.288470+0000 b2 1=1+0) (iversion lock) 0x55cf62076100] 2023-10-03T19:20:55.939 INFO:teuthology.orchestra.run.smithi045.stdout: -2062> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000023e [2,head] #1000000023e auth v2236 s=2 n(v0 rc2023-10-03T19:13:35.288470+0000 b2 1=1+0) (iversion lock) 0x55cf62076100] 2023-10-03T19:20:55.939 INFO:teuthology.orchestra.run.smithi045.stdout: -2061> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_73 [2,head] auth NULL (dversion lock) v=2236 ino=(nil) state=1073741824 0x55cf61fe2500] 2023-10-03T19:20:55.939 INFO:teuthology.orchestra.run.smithi045.stdout: -2060> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_72 [2,head] auth (dversion lock) v=2234 ino=0x1000000023d state=1073741824 0x55cf61fe2280] 2023-10-03T19:20:55.939 INFO:teuthology.orchestra.run.smithi045.stdout: -2059> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.939 INFO:teuthology.orchestra.run.smithi045.stdout: -2058> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000023d [2,head] /dc-dir/dc-file_72 auth v2234 s=2 n(v0 rc2023-10-03T19:13:35.278143+0000 b2 1=1+0) (iversion lock) 0x55cf62075b80] 2023-10-03T19:20:55.939 INFO:teuthology.orchestra.run.smithi045.stdout: -2057> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_72 [2,head] auth (dversion lock) v=2234 ino=0x1000000023d state=1073741824 0x55cf61fe2280] [inode 0x1000000023d [2,head] /dc-dir/dc-file_72 auth v2234 s=2 n(v0 rc2023-10-03T19:13:35.278143+0000 b2 1=1+0) (iversion lock) 0x55cf62075b80] 2023-10-03T19:20:55.939 INFO:teuthology.orchestra.run.smithi045.stdout: -2056> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000023d [2,head] #1000000023d auth v2234 s=2 n(v0 rc2023-10-03T19:13:35.278143+0000 b2 1=1+0) (iversion lock) 0x55cf62075b80] 2023-10-03T19:20:55.939 INFO:teuthology.orchestra.run.smithi045.stdout: -2055> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_72 [2,head] auth NULL (dversion lock) v=2234 ino=(nil) state=1073741824 0x55cf61fe2280] 2023-10-03T19:20:55.939 INFO:teuthology.orchestra.run.smithi045.stdout: -2054> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_71 [2,head] auth (dversion lock) v=2232 ino=0x1000000023c state=1073741824 0x55cf61fe2000] 2023-10-03T19:20:55.939 INFO:teuthology.orchestra.run.smithi045.stdout: -2053> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.939 INFO:teuthology.orchestra.run.smithi045.stdout: -2052> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000023c [2,head] /dc-dir/dc-file_71 auth v2232 s=2 n(v0 rc2023-10-03T19:13:35.267325+0000 b2 1=1+0) (iversion lock) 0x55cf62075600] 2023-10-03T19:20:55.940 INFO:teuthology.orchestra.run.smithi045.stdout: -2051> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_71 [2,head] auth (dversion lock) v=2232 ino=0x1000000023c state=1073741824 0x55cf61fe2000] [inode 0x1000000023c [2,head] /dc-dir/dc-file_71 auth v2232 s=2 n(v0 rc2023-10-03T19:13:35.267325+0000 b2 1=1+0) (iversion lock) 0x55cf62075600] 2023-10-03T19:20:55.940 INFO:teuthology.orchestra.run.smithi045.stdout: -2050> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000023c [2,head] #1000000023c auth v2232 s=2 n(v0 rc2023-10-03T19:13:35.267325+0000 b2 1=1+0) (iversion lock) 0x55cf62075600] 2023-10-03T19:20:55.940 INFO:teuthology.orchestra.run.smithi045.stdout: -2049> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_71 [2,head] auth NULL (dversion lock) v=2232 ino=(nil) state=1073741824 0x55cf61fe2000] 2023-10-03T19:20:55.940 INFO:teuthology.orchestra.run.smithi045.stdout: -2048> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_70 [2,head] auth (dversion lock) v=2230 ino=0x1000000023b state=1073741824 0x55cf62073b80] 2023-10-03T19:20:55.940 INFO:teuthology.orchestra.run.smithi045.stdout: -2047> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.940 INFO:teuthology.orchestra.run.smithi045.stdout: -2046> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000023b [2,head] /dc-dir/dc-file_70 auth v2230 s=2 n(v0 rc2023-10-03T19:13:35.256362+0000 b2 1=1+0) (iversion lock) 0x55cf62075080] 2023-10-03T19:20:55.940 INFO:teuthology.orchestra.run.smithi045.stdout: -2045> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_70 [2,head] auth (dversion lock) v=2230 ino=0x1000000023b state=1073741824 0x55cf62073b80] [inode 0x1000000023b [2,head] /dc-dir/dc-file_70 auth v2230 s=2 n(v0 rc2023-10-03T19:13:35.256362+0000 b2 1=1+0) (iversion lock) 0x55cf62075080] 2023-10-03T19:20:55.940 INFO:teuthology.orchestra.run.smithi045.stdout: -2044> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000023b [2,head] #1000000023b auth v2230 s=2 n(v0 rc2023-10-03T19:13:35.256362+0000 b2 1=1+0) (iversion lock) 0x55cf62075080] 2023-10-03T19:20:55.940 INFO:teuthology.orchestra.run.smithi045.stdout: -2043> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_70 [2,head] auth NULL (dversion lock) v=2230 ino=(nil) state=1073741824 0x55cf62073b80] 2023-10-03T19:20:55.940 INFO:teuthology.orchestra.run.smithi045.stdout: -2042> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_69 [2,head] auth (dversion lock) v=2228 ino=0x1000000023a state=1073741824 0x55cf62073900] 2023-10-03T19:20:55.940 INFO:teuthology.orchestra.run.smithi045.stdout: -2041> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.941 INFO:teuthology.orchestra.run.smithi045.stdout: -2040> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000023a [2,head] /dc-dir/dc-file_69 auth v2228 s=2 n(v0 rc2023-10-03T19:13:35.245461+0000 b2 1=1+0) (iversion lock) 0x55cf62074b00] 2023-10-03T19:20:55.941 INFO:teuthology.orchestra.run.smithi045.stdout: -2039> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_69 [2,head] auth (dversion lock) v=2228 ino=0x1000000023a state=1073741824 0x55cf62073900] [inode 0x1000000023a [2,head] /dc-dir/dc-file_69 auth v2228 s=2 n(v0 rc2023-10-03T19:13:35.245461+0000 b2 1=1+0) (iversion lock) 0x55cf62074b00] 2023-10-03T19:20:55.941 INFO:teuthology.orchestra.run.smithi045.stdout: -2038> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000023a [2,head] #1000000023a auth v2228 s=2 n(v0 rc2023-10-03T19:13:35.245461+0000 b2 1=1+0) (iversion lock) 0x55cf62074b00] 2023-10-03T19:20:55.941 INFO:teuthology.orchestra.run.smithi045.stdout: -2037> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_69 [2,head] auth NULL (dversion lock) v=2228 ino=(nil) state=1073741824 0x55cf62073900] 2023-10-03T19:20:55.941 INFO:teuthology.orchestra.run.smithi045.stdout: -2036> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_68 [2,head] auth (dversion lock) v=2226 ino=0x10000000239 state=1073741824 0x55cf62073680] 2023-10-03T19:20:55.941 INFO:teuthology.orchestra.run.smithi045.stdout: -2035> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.941 INFO:teuthology.orchestra.run.smithi045.stdout: -2034> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000239 [2,head] /dc-dir/dc-file_68 auth v2226 s=2 n(v0 rc2023-10-03T19:13:35.234843+0000 b2 1=1+0) (iversion lock) 0x55cf62074580] 2023-10-03T19:20:55.941 INFO:teuthology.orchestra.run.smithi045.stdout: -2033> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_68 [2,head] auth (dversion lock) v=2226 ino=0x10000000239 state=1073741824 0x55cf62073680] [inode 0x10000000239 [2,head] /dc-dir/dc-file_68 auth v2226 s=2 n(v0 rc2023-10-03T19:13:35.234843+0000 b2 1=1+0) (iversion lock) 0x55cf62074580] 2023-10-03T19:20:55.941 INFO:teuthology.orchestra.run.smithi045.stdout: -2032> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000239 [2,head] #10000000239 auth v2226 s=2 n(v0 rc2023-10-03T19:13:35.234843+0000 b2 1=1+0) (iversion lock) 0x55cf62074580] 2023-10-03T19:20:55.941 INFO:teuthology.orchestra.run.smithi045.stdout: -2031> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_68 [2,head] auth NULL (dversion lock) v=2226 ino=(nil) state=1073741824 0x55cf62073680] 2023-10-03T19:20:55.941 INFO:teuthology.orchestra.run.smithi045.stdout: -2030> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_67 [2,head] auth (dversion lock) v=2224 ino=0x10000000238 state=1073741824 0x55cf62073400] 2023-10-03T19:20:55.941 INFO:teuthology.orchestra.run.smithi045.stdout: -2029> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.942 INFO:teuthology.orchestra.run.smithi045.stdout: -2028> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000238 [2,head] /dc-dir/dc-file_67 auth v2224 s=2 n(v0 rc2023-10-03T19:13:35.223950+0000 b2 1=1+0) (iversion lock) 0x55cf62074000] 2023-10-03T19:20:55.942 INFO:teuthology.orchestra.run.smithi045.stdout: -2027> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_67 [2,head] auth (dversion lock) v=2224 ino=0x10000000238 state=1073741824 0x55cf62073400] [inode 0x10000000238 [2,head] /dc-dir/dc-file_67 auth v2224 s=2 n(v0 rc2023-10-03T19:13:35.223950+0000 b2 1=1+0) (iversion lock) 0x55cf62074000] 2023-10-03T19:20:55.942 INFO:teuthology.orchestra.run.smithi045.stdout: -2026> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000238 [2,head] #10000000238 auth v2224 s=2 n(v0 rc2023-10-03T19:13:35.223950+0000 b2 1=1+0) (iversion lock) 0x55cf62074000] 2023-10-03T19:20:55.942 INFO:teuthology.orchestra.run.smithi045.stdout: -2025> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_67 [2,head] auth NULL (dversion lock) v=2224 ino=(nil) state=1073741824 0x55cf62073400] 2023-10-03T19:20:55.942 INFO:teuthology.orchestra.run.smithi045.stdout: -2024> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_66 [2,head] auth (dversion lock) v=2222 ino=0x10000000237 state=1073741824 0x55cf62073180] 2023-10-03T19:20:55.942 INFO:teuthology.orchestra.run.smithi045.stdout: -2023> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.942 INFO:teuthology.orchestra.run.smithi045.stdout: -2022> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000237 [2,head] /dc-dir/dc-file_66 auth v2222 s=2 n(v0 rc2023-10-03T19:13:35.212979+0000 b2 1=1+0) (iversion lock) 0x55cf6206b700] 2023-10-03T19:20:55.942 INFO:teuthology.orchestra.run.smithi045.stdout: -2021> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_66 [2,head] auth (dversion lock) v=2222 ino=0x10000000237 state=1073741824 0x55cf62073180] [inode 0x10000000237 [2,head] /dc-dir/dc-file_66 auth v2222 s=2 n(v0 rc2023-10-03T19:13:35.212979+0000 b2 1=1+0) (iversion lock) 0x55cf6206b700] 2023-10-03T19:20:55.942 INFO:teuthology.orchestra.run.smithi045.stdout: -2020> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000237 [2,head] #10000000237 auth v2222 s=2 n(v0 rc2023-10-03T19:13:35.212979+0000 b2 1=1+0) (iversion lock) 0x55cf6206b700] 2023-10-03T19:20:55.942 INFO:teuthology.orchestra.run.smithi045.stdout: -2019> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_66 [2,head] auth NULL (dversion lock) v=2222 ino=(nil) state=1073741824 0x55cf62073180] 2023-10-03T19:20:55.942 INFO:teuthology.orchestra.run.smithi045.stdout: -2018> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_65 [2,head] auth (dversion lock) v=2220 ino=0x10000000236 state=1073741824 0x55cf62072f00] 2023-10-03T19:20:55.943 INFO:teuthology.orchestra.run.smithi045.stdout: -2017> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.943 INFO:teuthology.orchestra.run.smithi045.stdout: -2016> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000236 [2,head] /dc-dir/dc-file_65 auth v2220 s=2 n(v0 rc2023-10-03T19:13:35.201984+0000 b2 1=1+0) (iversion lock) 0x55cf6206b180] 2023-10-03T19:20:55.943 INFO:teuthology.orchestra.run.smithi045.stdout: -2015> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_65 [2,head] auth (dversion lock) v=2220 ino=0x10000000236 state=1073741824 0x55cf62072f00] [inode 0x10000000236 [2,head] /dc-dir/dc-file_65 auth v2220 s=2 n(v0 rc2023-10-03T19:13:35.201984+0000 b2 1=1+0) (iversion lock) 0x55cf6206b180] 2023-10-03T19:20:55.943 INFO:teuthology.orchestra.run.smithi045.stdout: -2014> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000236 [2,head] #10000000236 auth v2220 s=2 n(v0 rc2023-10-03T19:13:35.201984+0000 b2 1=1+0) (iversion lock) 0x55cf6206b180] 2023-10-03T19:20:55.943 INFO:teuthology.orchestra.run.smithi045.stdout: -2013> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_65 [2,head] auth NULL (dversion lock) v=2220 ino=(nil) state=1073741824 0x55cf62072f00] 2023-10-03T19:20:55.943 INFO:teuthology.orchestra.run.smithi045.stdout: -2012> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_64 [2,head] auth (dversion lock) v=2218 ino=0x10000000235 state=1073741824 0x55cf62072c80] 2023-10-03T19:20:55.943 INFO:teuthology.orchestra.run.smithi045.stdout: -2011> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.943 INFO:teuthology.orchestra.run.smithi045.stdout: -2010> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000235 [2,head] /dc-dir/dc-file_64 auth v2218 s=2 n(v0 rc2023-10-03T19:13:35.191426+0000 b2 1=1+0) (iversion lock) 0x55cf6206ac00] 2023-10-03T19:20:55.943 INFO:teuthology.orchestra.run.smithi045.stdout: -2009> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_64 [2,head] auth (dversion lock) v=2218 ino=0x10000000235 state=1073741824 0x55cf62072c80] [inode 0x10000000235 [2,head] /dc-dir/dc-file_64 auth v2218 s=2 n(v0 rc2023-10-03T19:13:35.191426+0000 b2 1=1+0) (iversion lock) 0x55cf6206ac00] 2023-10-03T19:20:55.943 INFO:teuthology.orchestra.run.smithi045.stdout: -2008> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000235 [2,head] #10000000235 auth v2218 s=2 n(v0 rc2023-10-03T19:13:35.191426+0000 b2 1=1+0) (iversion lock) 0x55cf6206ac00] 2023-10-03T19:20:55.943 INFO:teuthology.orchestra.run.smithi045.stdout: -2007> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_64 [2,head] auth NULL (dversion lock) v=2218 ino=(nil) state=1073741824 0x55cf62072c80] 2023-10-03T19:20:55.943 INFO:teuthology.orchestra.run.smithi045.stdout: -2006> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_63 [2,head] auth (dversion lock) v=2216 ino=0x10000000234 state=1073741824 0x55cf62072a00] 2023-10-03T19:20:55.944 INFO:teuthology.orchestra.run.smithi045.stdout: -2005> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.944 INFO:teuthology.orchestra.run.smithi045.stdout: -2004> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000234 [2,head] /dc-dir/dc-file_63 auth v2216 s=2 n(v0 rc2023-10-03T19:13:35.180540+0000 b2 1=1+0) (iversion lock) 0x55cf6206a680] 2023-10-03T19:20:55.944 INFO:teuthology.orchestra.run.smithi045.stdout: -2003> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_63 [2,head] auth (dversion lock) v=2216 ino=0x10000000234 state=1073741824 0x55cf62072a00] [inode 0x10000000234 [2,head] /dc-dir/dc-file_63 auth v2216 s=2 n(v0 rc2023-10-03T19:13:35.180540+0000 b2 1=1+0) (iversion lock) 0x55cf6206a680] 2023-10-03T19:20:55.944 INFO:teuthology.orchestra.run.smithi045.stdout: -2002> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000234 [2,head] #10000000234 auth v2216 s=2 n(v0 rc2023-10-03T19:13:35.180540+0000 b2 1=1+0) (iversion lock) 0x55cf6206a680] 2023-10-03T19:20:55.944 INFO:teuthology.orchestra.run.smithi045.stdout: -2001> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_63 [2,head] auth NULL (dversion lock) v=2216 ino=(nil) state=1073741824 0x55cf62072a00] 2023-10-03T19:20:55.944 INFO:teuthology.orchestra.run.smithi045.stdout: -2000> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_62 [2,head] auth (dversion lock) v=2214 ino=0x10000000233 state=1073741824 0x55cf62072780] 2023-10-03T19:20:55.944 INFO:teuthology.orchestra.run.smithi045.stdout: -1999> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.944 INFO:teuthology.orchestra.run.smithi045.stdout: -1998> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000233 [2,head] /dc-dir/dc-file_62 auth v2214 s=2 n(v0 rc2023-10-03T19:13:35.168332+0000 b2 1=1+0) (iversion lock) 0x55cf6206a100] 2023-10-03T19:20:55.944 INFO:teuthology.orchestra.run.smithi045.stdout: -1997> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_62 [2,head] auth (dversion lock) v=2214 ino=0x10000000233 state=1073741824 0x55cf62072780] [inode 0x10000000233 [2,head] /dc-dir/dc-file_62 auth v2214 s=2 n(v0 rc2023-10-03T19:13:35.168332+0000 b2 1=1+0) (iversion lock) 0x55cf6206a100] 2023-10-03T19:20:55.944 INFO:teuthology.orchestra.run.smithi045.stdout: -1996> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000233 [2,head] #10000000233 auth v2214 s=2 n(v0 rc2023-10-03T19:13:35.168332+0000 b2 1=1+0) (iversion lock) 0x55cf6206a100] 2023-10-03T19:20:55.944 INFO:teuthology.orchestra.run.smithi045.stdout: -1995> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_62 [2,head] auth NULL (dversion lock) v=2214 ino=(nil) state=1073741824 0x55cf62072780] 2023-10-03T19:20:55.944 INFO:teuthology.orchestra.run.smithi045.stdout: -1994> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_61 [2,head] auth (dversion lock) v=2212 ino=0x10000000232 state=1073741824 0x55cf62072500] 2023-10-03T19:20:55.945 INFO:teuthology.orchestra.run.smithi045.stdout: -1993> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:55.945 INFO:teuthology.orchestra.run.smithi045.stdout: -1992> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000232 [2,head] /dc-dir/dc-file_61 auth v2212 s=2 n(v0 rc2023-10-03T19:13:35.157300+0000 b2 1=1+0) (iversion lock) 0x55cf62069b80] 2023-10-03T19:20:56.053 INFO:teuthology.orchestra.run.smithi045.stdout: -1991> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_61 [2,head] auth (dversion lock) v=2212 ino=0x10000000232 state=1073741824 0x55cf62072500] [inode 0x10000000232 [2,head] /dc-dir/dc-file_61 auth v2212 s=2 n(v0 rc2023-10-03T19:13:35.157300+0000 b2 1=1+0) (iversion lock) 0x55cf62069b80] 2023-10-03T19:20:56.053 INFO:teuthology.orchestra.run.smithi045.stdout: -1990> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000232 [2,head] #10000000232 auth v2212 s=2 n(v0 rc2023-10-03T19:13:35.157300+0000 b2 1=1+0) (iversion lock) 0x55cf62069b80] 2023-10-03T19:20:56.053 INFO:teuthology.orchestra.run.smithi045.stdout: -1989> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_61 [2,head] auth NULL (dversion lock) v=2212 ino=(nil) state=1073741824 0x55cf62072500] 2023-10-03T19:20:56.053 INFO:teuthology.orchestra.run.smithi045.stdout: -1988> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_60 [2,head] auth (dversion lock) v=2210 ino=0x10000000231 state=1073741824 0x55cf62072280] 2023-10-03T19:20:56.053 INFO:teuthology.orchestra.run.smithi045.stdout: -1987> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.053 INFO:teuthology.orchestra.run.smithi045.stdout: -1986> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000231 [2,head] /dc-dir/dc-file_60 auth v2210 s=2 n(v0 rc2023-10-03T19:13:35.146821+0000 b2 1=1+0) (iversion lock) 0x55cf62069600] 2023-10-03T19:20:56.054 INFO:teuthology.orchestra.run.smithi045.stdout: -1985> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_60 [2,head] auth (dversion lock) v=2210 ino=0x10000000231 state=1073741824 0x55cf62072280] [inode 0x10000000231 [2,head] /dc-dir/dc-file_60 auth v2210 s=2 n(v0 rc2023-10-03T19:13:35.146821+0000 b2 1=1+0) (iversion lock) 0x55cf62069600] 2023-10-03T19:20:56.054 INFO:teuthology.orchestra.run.smithi045.stdout: -1984> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000231 [2,head] #10000000231 auth v2210 s=2 n(v0 rc2023-10-03T19:13:35.146821+0000 b2 1=1+0) (iversion lock) 0x55cf62069600] 2023-10-03T19:20:56.054 INFO:teuthology.orchestra.run.smithi045.stdout: -1983> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_60 [2,head] auth NULL (dversion lock) v=2210 ino=(nil) state=1073741824 0x55cf62072280] 2023-10-03T19:20:56.054 INFO:teuthology.orchestra.run.smithi045.stdout: -1982> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_59 [2,head] auth (dversion lock) v=2208 ino=0x10000000230 state=1073741824 0x55cf62072000] 2023-10-03T19:20:56.054 INFO:teuthology.orchestra.run.smithi045.stdout: -1981> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.054 INFO:teuthology.orchestra.run.smithi045.stdout: -1980> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000230 [2,head] /dc-dir/dc-file_59 auth v2208 s=2 n(v0 rc2023-10-03T19:13:35.135109+0000 b2 1=1+0) (iversion lock) 0x55cf62069080] 2023-10-03T19:20:56.054 INFO:teuthology.orchestra.run.smithi045.stdout: -1979> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_59 [2,head] auth (dversion lock) v=2208 ino=0x10000000230 state=1073741824 0x55cf62072000] [inode 0x10000000230 [2,head] /dc-dir/dc-file_59 auth v2208 s=2 n(v0 rc2023-10-03T19:13:35.135109+0000 b2 1=1+0) (iversion lock) 0x55cf62069080] 2023-10-03T19:20:56.054 INFO:teuthology.orchestra.run.smithi045.stdout: -1978> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000230 [2,head] #10000000230 auth v2208 s=2 n(v0 rc2023-10-03T19:13:35.135109+0000 b2 1=1+0) (iversion lock) 0x55cf62069080] 2023-10-03T19:20:56.054 INFO:teuthology.orchestra.run.smithi045.stdout: -1977> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_59 [2,head] auth NULL (dversion lock) v=2208 ino=(nil) state=1073741824 0x55cf62072000] 2023-10-03T19:20:56.054 INFO:teuthology.orchestra.run.smithi045.stdout: -1976> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_58 [2,head] auth (dversion lock) v=2206 ino=0x1000000022f state=1073741824 0x55cf6205fb80] 2023-10-03T19:20:56.055 INFO:teuthology.orchestra.run.smithi045.stdout: -1975> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.055 INFO:teuthology.orchestra.run.smithi045.stdout: -1974> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000022f [2,head] /dc-dir/dc-file_58 auth v2206 s=2 n(v0 rc2023-10-03T19:13:35.124880+0000 b2 1=1+0) (iversion lock) 0x55cf62068b00] 2023-10-03T19:20:56.055 INFO:teuthology.orchestra.run.smithi045.stdout: -1973> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_58 [2,head] auth (dversion lock) v=2206 ino=0x1000000022f state=1073741824 0x55cf6205fb80] [inode 0x1000000022f [2,head] /dc-dir/dc-file_58 auth v2206 s=2 n(v0 rc2023-10-03T19:13:35.124880+0000 b2 1=1+0) (iversion lock) 0x55cf62068b00] 2023-10-03T19:20:56.055 INFO:teuthology.orchestra.run.smithi045.stdout: -1972> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000022f [2,head] #1000000022f auth v2206 s=2 n(v0 rc2023-10-03T19:13:35.124880+0000 b2 1=1+0) (iversion lock) 0x55cf62068b00] 2023-10-03T19:20:56.055 INFO:teuthology.orchestra.run.smithi045.stdout: -1971> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_58 [2,head] auth NULL (dversion lock) v=2206 ino=(nil) state=1073741824 0x55cf6205fb80] 2023-10-03T19:20:56.055 INFO:teuthology.orchestra.run.smithi045.stdout: -1970> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_57 [2,head] auth (dversion lock) v=2204 ino=0x1000000022e state=1073741824 0x55cf6205f900] 2023-10-03T19:20:56.055 INFO:teuthology.orchestra.run.smithi045.stdout: -1969> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.055 INFO:teuthology.orchestra.run.smithi045.stdout: -1968> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000022e [2,head] /dc-dir/dc-file_57 auth v2204 s=2 n(v0 rc2023-10-03T19:13:35.114433+0000 b2 1=1+0) (iversion lock) 0x55cf62068580] 2023-10-03T19:20:56.055 INFO:teuthology.orchestra.run.smithi045.stdout: -1967> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_57 [2,head] auth (dversion lock) v=2204 ino=0x1000000022e state=1073741824 0x55cf6205f900] [inode 0x1000000022e [2,head] /dc-dir/dc-file_57 auth v2204 s=2 n(v0 rc2023-10-03T19:13:35.114433+0000 b2 1=1+0) (iversion lock) 0x55cf62068580] 2023-10-03T19:20:56.055 INFO:teuthology.orchestra.run.smithi045.stdout: -1966> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000022e [2,head] #1000000022e auth v2204 s=2 n(v0 rc2023-10-03T19:13:35.114433+0000 b2 1=1+0) (iversion lock) 0x55cf62068580] 2023-10-03T19:20:56.056 INFO:teuthology.orchestra.run.smithi045.stdout: -1965> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_57 [2,head] auth NULL (dversion lock) v=2204 ino=(nil) state=1073741824 0x55cf6205f900] 2023-10-03T19:20:56.056 INFO:teuthology.orchestra.run.smithi045.stdout: -1964> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_56 [2,head] auth (dversion lock) v=2202 ino=0x1000000022d state=1073741824 0x55cf6205f680] 2023-10-03T19:20:56.056 INFO:teuthology.orchestra.run.smithi045.stdout: -1963> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.056 INFO:teuthology.orchestra.run.smithi045.stdout: -1962> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000022d [2,head] /dc-dir/dc-file_56 auth v2202 s=2 n(v0 rc2023-10-03T19:13:35.104021+0000 b2 1=1+0) (iversion lock) 0x55cf62068000] 2023-10-03T19:20:56.056 INFO:teuthology.orchestra.run.smithi045.stdout: -1961> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_56 [2,head] auth (dversion lock) v=2202 ino=0x1000000022d state=1073741824 0x55cf6205f680] [inode 0x1000000022d [2,head] /dc-dir/dc-file_56 auth v2202 s=2 n(v0 rc2023-10-03T19:13:35.104021+0000 b2 1=1+0) (iversion lock) 0x55cf62068000] 2023-10-03T19:20:56.056 INFO:teuthology.orchestra.run.smithi045.stdout: -1960> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000022d [2,head] #1000000022d auth v2202 s=2 n(v0 rc2023-10-03T19:13:35.104021+0000 b2 1=1+0) (iversion lock) 0x55cf62068000] 2023-10-03T19:20:56.056 INFO:teuthology.orchestra.run.smithi045.stdout: -1959> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_56 [2,head] auth NULL (dversion lock) v=2202 ino=(nil) state=1073741824 0x55cf6205f680] 2023-10-03T19:20:56.056 INFO:teuthology.orchestra.run.smithi045.stdout: -1958> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_55 [2,head] auth (dversion lock) v=2200 ino=0x1000000022c state=1073741824 0x55cf6205f400] 2023-10-03T19:20:56.056 INFO:teuthology.orchestra.run.smithi045.stdout: -1957> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.056 INFO:teuthology.orchestra.run.smithi045.stdout: -1956> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000022c [2,head] /dc-dir/dc-file_55 auth v2200 s=2 n(v0 rc2023-10-03T19:13:35.093349+0000 b2 1=1+0) (iversion lock) 0x55cf6205b700] 2023-10-03T19:20:56.056 INFO:teuthology.orchestra.run.smithi045.stdout: -1955> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_55 [2,head] auth (dversion lock) v=2200 ino=0x1000000022c state=1073741824 0x55cf6205f400] [inode 0x1000000022c [2,head] /dc-dir/dc-file_55 auth v2200 s=2 n(v0 rc2023-10-03T19:13:35.093349+0000 b2 1=1+0) (iversion lock) 0x55cf6205b700] 2023-10-03T19:20:56.057 INFO:teuthology.orchestra.run.smithi045.stdout: -1954> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000022c [2,head] #1000000022c auth v2200 s=2 n(v0 rc2023-10-03T19:13:35.093349+0000 b2 1=1+0) (iversion lock) 0x55cf6205b700] 2023-10-03T19:20:56.057 INFO:teuthology.orchestra.run.smithi045.stdout: -1953> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_55 [2,head] auth NULL (dversion lock) v=2200 ino=(nil) state=1073741824 0x55cf6205f400] 2023-10-03T19:20:56.057 INFO:teuthology.orchestra.run.smithi045.stdout: -1952> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_54 [2,head] auth (dversion lock) v=2198 ino=0x1000000022b state=1073741824 0x55cf6205f180] 2023-10-03T19:20:56.057 INFO:teuthology.orchestra.run.smithi045.stdout: -1951> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.057 INFO:teuthology.orchestra.run.smithi045.stdout: -1950> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000022b [2,head] /dc-dir/dc-file_54 auth v2198 s=2 n(v0 rc2023-10-03T19:13:35.082453+0000 b2 1=1+0) (iversion lock) 0x55cf6205b180] 2023-10-03T19:20:56.057 INFO:teuthology.orchestra.run.smithi045.stdout: -1949> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_54 [2,head] auth (dversion lock) v=2198 ino=0x1000000022b state=1073741824 0x55cf6205f180] [inode 0x1000000022b [2,head] /dc-dir/dc-file_54 auth v2198 s=2 n(v0 rc2023-10-03T19:13:35.082453+0000 b2 1=1+0) (iversion lock) 0x55cf6205b180] 2023-10-03T19:20:56.057 INFO:teuthology.orchestra.run.smithi045.stdout: -1948> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000022b [2,head] #1000000022b auth v2198 s=2 n(v0 rc2023-10-03T19:13:35.082453+0000 b2 1=1+0) (iversion lock) 0x55cf6205b180] 2023-10-03T19:20:56.057 INFO:teuthology.orchestra.run.smithi045.stdout: -1947> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_54 [2,head] auth NULL (dversion lock) v=2198 ino=(nil) state=1073741824 0x55cf6205f180] 2023-10-03T19:20:56.057 INFO:teuthology.orchestra.run.smithi045.stdout: -1946> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_53 [2,head] auth (dversion lock) v=2196 ino=0x1000000022a state=1073741824 0x55cf6205ef00] 2023-10-03T19:20:56.057 INFO:teuthology.orchestra.run.smithi045.stdout: -1945> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.057 INFO:teuthology.orchestra.run.smithi045.stdout: -1944> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000022a [2,head] /dc-dir/dc-file_53 auth v2196 s=2 n(v0 rc2023-10-03T19:13:35.071761+0000 b2 1=1+0) (iversion lock) 0x55cf6205ac00] 2023-10-03T19:20:56.058 INFO:teuthology.orchestra.run.smithi045.stdout: -1943> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_53 [2,head] auth (dversion lock) v=2196 ino=0x1000000022a state=1073741824 0x55cf6205ef00] [inode 0x1000000022a [2,head] /dc-dir/dc-file_53 auth v2196 s=2 n(v0 rc2023-10-03T19:13:35.071761+0000 b2 1=1+0) (iversion lock) 0x55cf6205ac00] 2023-10-03T19:20:56.058 INFO:teuthology.orchestra.run.smithi045.stdout: -1942> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000022a [2,head] #1000000022a auth v2196 s=2 n(v0 rc2023-10-03T19:13:35.071761+0000 b2 1=1+0) (iversion lock) 0x55cf6205ac00] 2023-10-03T19:20:56.058 INFO:teuthology.orchestra.run.smithi045.stdout: -1941> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_53 [2,head] auth NULL (dversion lock) v=2196 ino=(nil) state=1073741824 0x55cf6205ef00] 2023-10-03T19:20:56.058 INFO:teuthology.orchestra.run.smithi045.stdout: -1940> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_52 [2,head] auth (dversion lock) v=2194 ino=0x10000000229 state=1073741824 0x55cf6205ec80] 2023-10-03T19:20:56.058 INFO:teuthology.orchestra.run.smithi045.stdout: -1939> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.058 INFO:teuthology.orchestra.run.smithi045.stdout: -1938> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000229 [2,head] /dc-dir/dc-file_52 auth v2194 s=2 n(v0 rc2023-10-03T19:13:35.061105+0000 b2 1=1+0) (iversion lock) 0x55cf6205a680] 2023-10-03T19:20:56.058 INFO:teuthology.orchestra.run.smithi045.stdout: -1937> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_52 [2,head] auth (dversion lock) v=2194 ino=0x10000000229 state=1073741824 0x55cf6205ec80] [inode 0x10000000229 [2,head] /dc-dir/dc-file_52 auth v2194 s=2 n(v0 rc2023-10-03T19:13:35.061105+0000 b2 1=1+0) (iversion lock) 0x55cf6205a680] 2023-10-03T19:20:56.058 INFO:teuthology.orchestra.run.smithi045.stdout: -1936> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000229 [2,head] #10000000229 auth v2194 s=2 n(v0 rc2023-10-03T19:13:35.061105+0000 b2 1=1+0) (iversion lock) 0x55cf6205a680] 2023-10-03T19:20:56.058 INFO:teuthology.orchestra.run.smithi045.stdout: -1935> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_52 [2,head] auth NULL (dversion lock) v=2194 ino=(nil) state=1073741824 0x55cf6205ec80] 2023-10-03T19:20:56.058 INFO:teuthology.orchestra.run.smithi045.stdout: -1934> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_51 [2,head] auth (dversion lock) v=2192 ino=0x10000000228 state=1073741824 0x55cf6205ea00] 2023-10-03T19:20:56.059 INFO:teuthology.orchestra.run.smithi045.stdout: -1933> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.059 INFO:teuthology.orchestra.run.smithi045.stdout: -1932> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000228 [2,head] /dc-dir/dc-file_51 auth v2192 s=2 n(v0 rc2023-10-03T19:13:35.048035+0000 b2 1=1+0) (iversion lock) 0x55cf6205a100] 2023-10-03T19:20:56.059 INFO:teuthology.orchestra.run.smithi045.stdout: -1931> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_51 [2,head] auth (dversion lock) v=2192 ino=0x10000000228 state=1073741824 0x55cf6205ea00] [inode 0x10000000228 [2,head] /dc-dir/dc-file_51 auth v2192 s=2 n(v0 rc2023-10-03T19:13:35.048035+0000 b2 1=1+0) (iversion lock) 0x55cf6205a100] 2023-10-03T19:20:56.059 INFO:teuthology.orchestra.run.smithi045.stdout: -1930> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000228 [2,head] #10000000228 auth v2192 s=2 n(v0 rc2023-10-03T19:13:35.048035+0000 b2 1=1+0) (iversion lock) 0x55cf6205a100] 2023-10-03T19:20:56.059 INFO:teuthology.orchestra.run.smithi045.stdout: -1929> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_51 [2,head] auth NULL (dversion lock) v=2192 ino=(nil) state=1073741824 0x55cf6205ea00] 2023-10-03T19:20:56.059 INFO:teuthology.orchestra.run.smithi045.stdout: -1928> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_50 [2,head] auth (dversion lock) v=2190 ino=0x10000000227 state=1073741824 0x55cf6205e780] 2023-10-03T19:20:56.059 INFO:teuthology.orchestra.run.smithi045.stdout: -1927> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.059 INFO:teuthology.orchestra.run.smithi045.stdout: -1926> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000227 [2,head] /dc-dir/dc-file_50 auth v2190 s=2 n(v0 rc2023-10-03T19:13:35.035749+0000 b2 1=1+0) (iversion lock) 0x55cf62059b80] 2023-10-03T19:20:56.059 INFO:teuthology.orchestra.run.smithi045.stdout: -1925> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_50 [2,head] auth (dversion lock) v=2190 ino=0x10000000227 state=1073741824 0x55cf6205e780] [inode 0x10000000227 [2,head] /dc-dir/dc-file_50 auth v2190 s=2 n(v0 rc2023-10-03T19:13:35.035749+0000 b2 1=1+0) (iversion lock) 0x55cf62059b80] 2023-10-03T19:20:56.059 INFO:teuthology.orchestra.run.smithi045.stdout: -1924> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000227 [2,head] #10000000227 auth v2190 s=2 n(v0 rc2023-10-03T19:13:35.035749+0000 b2 1=1+0) (iversion lock) 0x55cf62059b80] 2023-10-03T19:20:56.059 INFO:teuthology.orchestra.run.smithi045.stdout: -1923> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_50 [2,head] auth NULL (dversion lock) v=2190 ino=(nil) state=1073741824 0x55cf6205e780] 2023-10-03T19:20:56.060 INFO:teuthology.orchestra.run.smithi045.stdout: -1922> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_49 [2,head] auth (dversion lock) v=2188 ino=0x10000000226 state=1073741824 0x55cf6205e500] 2023-10-03T19:20:56.060 INFO:teuthology.orchestra.run.smithi045.stdout: -1921> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.060 INFO:teuthology.orchestra.run.smithi045.stdout: -1920> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000226 [2,head] /dc-dir/dc-file_49 auth v2188 s=2 n(v0 rc2023-10-03T19:13:35.024104+0000 b2 1=1+0) (iversion lock) 0x55cf62059600] 2023-10-03T19:20:56.060 INFO:teuthology.orchestra.run.smithi045.stdout: -1919> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_49 [2,head] auth (dversion lock) v=2188 ino=0x10000000226 state=1073741824 0x55cf6205e500] [inode 0x10000000226 [2,head] /dc-dir/dc-file_49 auth v2188 s=2 n(v0 rc2023-10-03T19:13:35.024104+0000 b2 1=1+0) (iversion lock) 0x55cf62059600] 2023-10-03T19:20:56.060 INFO:teuthology.orchestra.run.smithi045.stdout: -1918> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000226 [2,head] #10000000226 auth v2188 s=2 n(v0 rc2023-10-03T19:13:35.024104+0000 b2 1=1+0) (iversion lock) 0x55cf62059600] 2023-10-03T19:20:56.060 INFO:teuthology.orchestra.run.smithi045.stdout: -1917> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_49 [2,head] auth NULL (dversion lock) v=2188 ino=(nil) state=1073741824 0x55cf6205e500] 2023-10-03T19:20:56.060 INFO:teuthology.orchestra.run.smithi045.stdout: -1916> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_48 [2,head] auth (dversion lock) v=2186 ino=0x10000000225 state=1073741824 0x55cf6205e280] 2023-10-03T19:20:56.060 INFO:teuthology.orchestra.run.smithi045.stdout: -1915> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.060 INFO:teuthology.orchestra.run.smithi045.stdout: -1914> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000225 [2,head] /dc-dir/dc-file_48 auth v2186 s=2 n(v0 rc2023-10-03T19:13:35.012415+0000 b2 1=1+0) (iversion lock) 0x55cf62059080] 2023-10-03T19:20:56.060 INFO:teuthology.orchestra.run.smithi045.stdout: -1913> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_48 [2,head] auth (dversion lock) v=2186 ino=0x10000000225 state=1073741824 0x55cf6205e280] [inode 0x10000000225 [2,head] /dc-dir/dc-file_48 auth v2186 s=2 n(v0 rc2023-10-03T19:13:35.012415+0000 b2 1=1+0) (iversion lock) 0x55cf62059080] 2023-10-03T19:20:56.060 INFO:teuthology.orchestra.run.smithi045.stdout: -1912> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000225 [2,head] #10000000225 auth v2186 s=2 n(v0 rc2023-10-03T19:13:35.012415+0000 b2 1=1+0) (iversion lock) 0x55cf62059080] 2023-10-03T19:20:56.061 INFO:teuthology.orchestra.run.smithi045.stdout: -1911> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_48 [2,head] auth NULL (dversion lock) v=2186 ino=(nil) state=1073741824 0x55cf6205e280] 2023-10-03T19:20:56.061 INFO:teuthology.orchestra.run.smithi045.stdout: -1910> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_47 [2,head] auth (dversion lock) v=2184 ino=0x10000000224 state=1073741824 0x55cf6205e000] 2023-10-03T19:20:56.061 INFO:teuthology.orchestra.run.smithi045.stdout: -1909> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.067 INFO:teuthology.orchestra.run.smithi045.stdout: -1908> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000224 [2,head] /dc-dir/dc-file_47 auth v2184 s=2 n(v0 rc2023-10-03T19:13:34.999953+0000 b2 1=1+0) (iversion lock) 0x55cf62058b00] 2023-10-03T19:20:56.067 INFO:teuthology.orchestra.run.smithi045.stdout: -1907> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_47 [2,head] auth (dversion lock) v=2184 ino=0x10000000224 state=1073741824 0x55cf6205e000] [inode 0x10000000224 [2,head] /dc-dir/dc-file_47 auth v2184 s=2 n(v0 rc2023-10-03T19:13:34.999953+0000 b2 1=1+0) (iversion lock) 0x55cf62058b00] 2023-10-03T19:20:56.068 INFO:teuthology.orchestra.run.smithi045.stdout: -1906> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000224 [2,head] #10000000224 auth v2184 s=2 n(v0 rc2023-10-03T19:13:34.999953+0000 b2 1=1+0) (iversion lock) 0x55cf62058b00] 2023-10-03T19:20:56.068 INFO:teuthology.orchestra.run.smithi045.stdout: -1905> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_47 [2,head] auth NULL (dversion lock) v=2184 ino=(nil) state=1073741824 0x55cf6205e000] 2023-10-03T19:20:56.068 INFO:teuthology.orchestra.run.smithi045.stdout: -1904> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_46 [2,head] auth (dversion lock) v=2182 ino=0x10000000223 state=1073741824 0x55cf6204bb80] 2023-10-03T19:20:56.068 INFO:teuthology.orchestra.run.smithi045.stdout: -1903> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.068 INFO:teuthology.orchestra.run.smithi045.stdout: -1902> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000223 [2,head] /dc-dir/dc-file_46 auth v2182 s=2 n(v0 rc2023-10-03T19:13:34.989479+0000 b2 1=1+0) (iversion lock) 0x55cf62058580] 2023-10-03T19:20:56.068 INFO:teuthology.orchestra.run.smithi045.stdout: -1901> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_46 [2,head] auth (dversion lock) v=2182 ino=0x10000000223 state=1073741824 0x55cf6204bb80] [inode 0x10000000223 [2,head] /dc-dir/dc-file_46 auth v2182 s=2 n(v0 rc2023-10-03T19:13:34.989479+0000 b2 1=1+0) (iversion lock) 0x55cf62058580] 2023-10-03T19:20:56.068 INFO:teuthology.orchestra.run.smithi045.stdout: -1900> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000223 [2,head] #10000000223 auth v2182 s=2 n(v0 rc2023-10-03T19:13:34.989479+0000 b2 1=1+0) (iversion lock) 0x55cf62058580] 2023-10-03T19:20:56.068 INFO:teuthology.orchestra.run.smithi045.stdout: -1899> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_46 [2,head] auth NULL (dversion lock) v=2182 ino=(nil) state=1073741824 0x55cf6204bb80] 2023-10-03T19:20:56.068 INFO:teuthology.orchestra.run.smithi045.stdout: -1898> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_45 [2,head] auth (dversion lock) v=2180 ino=0x10000000222 state=1073741824 0x55cf6204b900] 2023-10-03T19:20:56.069 INFO:teuthology.orchestra.run.smithi045.stdout: -1897> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.069 INFO:teuthology.orchestra.run.smithi045.stdout: -1896> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000222 [2,head] /dc-dir/dc-file_45 auth v2180 s=2 n(v0 rc2023-10-03T19:13:34.978644+0000 b2 1=1+0) (iversion lock) 0x55cf62058000] 2023-10-03T19:20:56.069 INFO:teuthology.orchestra.run.smithi045.stdout: -1895> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_45 [2,head] auth (dversion lock) v=2180 ino=0x10000000222 state=1073741824 0x55cf6204b900] [inode 0x10000000222 [2,head] /dc-dir/dc-file_45 auth v2180 s=2 n(v0 rc2023-10-03T19:13:34.978644+0000 b2 1=1+0) (iversion lock) 0x55cf62058000] 2023-10-03T19:20:56.069 INFO:teuthology.orchestra.run.smithi045.stdout: -1894> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000222 [2,head] #10000000222 auth v2180 s=2 n(v0 rc2023-10-03T19:13:34.978644+0000 b2 1=1+0) (iversion lock) 0x55cf62058000] 2023-10-03T19:20:56.069 INFO:teuthology.orchestra.run.smithi045.stdout: -1893> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_45 [2,head] auth NULL (dversion lock) v=2180 ino=(nil) state=1073741824 0x55cf6204b900] 2023-10-03T19:20:56.069 INFO:teuthology.orchestra.run.smithi045.stdout: -1892> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_44 [2,head] auth (dversion lock) v=2178 ino=0x10000000221 state=1073741824 0x55cf6204b680] 2023-10-03T19:20:56.069 INFO:teuthology.orchestra.run.smithi045.stdout: -1891> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.069 INFO:teuthology.orchestra.run.smithi045.stdout: -1890> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000221 [2,head] /dc-dir/dc-file_44 auth v2178 s=2 n(v0 rc2023-10-03T19:13:34.968523+0000 b2 1=1+0) (iversion lock) 0x55cf62049700] 2023-10-03T19:20:56.069 INFO:teuthology.orchestra.run.smithi045.stdout: -1889> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_44 [2,head] auth (dversion lock) v=2178 ino=0x10000000221 state=1073741824 0x55cf6204b680] [inode 0x10000000221 [2,head] /dc-dir/dc-file_44 auth v2178 s=2 n(v0 rc2023-10-03T19:13:34.968523+0000 b2 1=1+0) (iversion lock) 0x55cf62049700] 2023-10-03T19:20:56.069 INFO:teuthology.orchestra.run.smithi045.stdout: -1888> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000221 [2,head] #10000000221 auth v2178 s=2 n(v0 rc2023-10-03T19:13:34.968523+0000 b2 1=1+0) (iversion lock) 0x55cf62049700] 2023-10-03T19:20:56.070 INFO:teuthology.orchestra.run.smithi045.stdout: -1887> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_44 [2,head] auth NULL (dversion lock) v=2178 ino=(nil) state=1073741824 0x55cf6204b680] 2023-10-03T19:20:56.070 INFO:teuthology.orchestra.run.smithi045.stdout: -1886> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_43 [2,head] auth (dversion lock) v=2176 ino=0x10000000220 state=1073741824 0x55cf6204b400] 2023-10-03T19:20:56.070 INFO:teuthology.orchestra.run.smithi045.stdout: -1885> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.070 INFO:teuthology.orchestra.run.smithi045.stdout: -1884> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000220 [2,head] /dc-dir/dc-file_43 auth v2176 s=2 n(v0 rc2023-10-03T19:13:34.955914+0000 b2 1=1+0) (iversion lock) 0x55cf62049180] 2023-10-03T19:20:56.070 INFO:teuthology.orchestra.run.smithi045.stdout: -1883> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_43 [2,head] auth (dversion lock) v=2176 ino=0x10000000220 state=1073741824 0x55cf6204b400] [inode 0x10000000220 [2,head] /dc-dir/dc-file_43 auth v2176 s=2 n(v0 rc2023-10-03T19:13:34.955914+0000 b2 1=1+0) (iversion lock) 0x55cf62049180] 2023-10-03T19:20:56.070 INFO:teuthology.orchestra.run.smithi045.stdout: -1882> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000220 [2,head] #10000000220 auth v2176 s=2 n(v0 rc2023-10-03T19:13:34.955914+0000 b2 1=1+0) (iversion lock) 0x55cf62049180] 2023-10-03T19:20:56.070 INFO:teuthology.orchestra.run.smithi045.stdout: -1881> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_43 [2,head] auth NULL (dversion lock) v=2176 ino=(nil) state=1073741824 0x55cf6204b400] 2023-10-03T19:20:56.070 INFO:teuthology.orchestra.run.smithi045.stdout: -1880> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_42 [2,head] auth (dversion lock) v=2174 ino=0x1000000021f state=1073741824 0x55cf6204b180] 2023-10-03T19:20:56.070 INFO:teuthology.orchestra.run.smithi045.stdout: -1879> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.070 INFO:teuthology.orchestra.run.smithi045.stdout: -1878> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000021f [2,head] /dc-dir/dc-file_42 auth v2174 s=2 n(v0 rc2023-10-03T19:13:34.945351+0000 b2 1=1+0) (iversion lock) 0x55cf62048c00] 2023-10-03T19:20:56.071 INFO:teuthology.orchestra.run.smithi045.stdout: -1877> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_42 [2,head] auth (dversion lock) v=2174 ino=0x1000000021f state=1073741824 0x55cf6204b180] [inode 0x1000000021f [2,head] /dc-dir/dc-file_42 auth v2174 s=2 n(v0 rc2023-10-03T19:13:34.945351+0000 b2 1=1+0) (iversion lock) 0x55cf62048c00] 2023-10-03T19:20:56.071 INFO:teuthology.orchestra.run.smithi045.stdout: -1876> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000021f [2,head] #1000000021f auth v2174 s=2 n(v0 rc2023-10-03T19:13:34.945351+0000 b2 1=1+0) (iversion lock) 0x55cf62048c00] 2023-10-03T19:20:56.071 INFO:teuthology.orchestra.run.smithi045.stdout: -1875> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_42 [2,head] auth NULL (dversion lock) v=2174 ino=(nil) state=1073741824 0x55cf6204b180] 2023-10-03T19:20:56.071 INFO:teuthology.orchestra.run.smithi045.stdout: -1874> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_41 [2,head] auth (dversion lock) v=2172 ino=0x1000000021e state=1073741824 0x55cf6204af00] 2023-10-03T19:20:56.071 INFO:teuthology.orchestra.run.smithi045.stdout: -1873> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.071 INFO:teuthology.orchestra.run.smithi045.stdout: -1872> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000021e [2,head] /dc-dir/dc-file_41 auth v2172 s=2 n(v0 rc2023-10-03T19:13:34.933601+0000 b2 1=1+0) (iversion lock) 0x55cf62048680] 2023-10-03T19:20:56.071 INFO:teuthology.orchestra.run.smithi045.stdout: -1871> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_41 [2,head] auth (dversion lock) v=2172 ino=0x1000000021e state=1073741824 0x55cf6204af00] [inode 0x1000000021e [2,head] /dc-dir/dc-file_41 auth v2172 s=2 n(v0 rc2023-10-03T19:13:34.933601+0000 b2 1=1+0) (iversion lock) 0x55cf62048680] 2023-10-03T19:20:56.071 INFO:teuthology.orchestra.run.smithi045.stdout: -1870> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000021e [2,head] #1000000021e auth v2172 s=2 n(v0 rc2023-10-03T19:13:34.933601+0000 b2 1=1+0) (iversion lock) 0x55cf62048680] 2023-10-03T19:20:56.071 INFO:teuthology.orchestra.run.smithi045.stdout: -1869> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_41 [2,head] auth NULL (dversion lock) v=2172 ino=(nil) state=1073741824 0x55cf6204af00] 2023-10-03T19:20:56.071 INFO:teuthology.orchestra.run.smithi045.stdout: -1868> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_40 [2,head] auth (dversion lock) v=2170 ino=0x1000000021d state=1073741824 0x55cf6204ac80] 2023-10-03T19:20:56.071 INFO:teuthology.orchestra.run.smithi045.stdout: -1867> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.072 INFO:teuthology.orchestra.run.smithi045.stdout: -1866> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000021d [2,head] /dc-dir/dc-file_40 auth v2170 s=2 n(v0 rc2023-10-03T19:13:34.922180+0000 b2 1=1+0) (iversion lock) 0x55cf62048100] 2023-10-03T19:20:56.072 INFO:teuthology.orchestra.run.smithi045.stdout: -1865> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_40 [2,head] auth (dversion lock) v=2170 ino=0x1000000021d state=1073741824 0x55cf6204ac80] [inode 0x1000000021d [2,head] /dc-dir/dc-file_40 auth v2170 s=2 n(v0 rc2023-10-03T19:13:34.922180+0000 b2 1=1+0) (iversion lock) 0x55cf62048100] 2023-10-03T19:20:56.072 INFO:teuthology.orchestra.run.smithi045.stdout: -1864> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000021d [2,head] #1000000021d auth v2170 s=2 n(v0 rc2023-10-03T19:13:34.922180+0000 b2 1=1+0) (iversion lock) 0x55cf62048100] 2023-10-03T19:20:56.072 INFO:teuthology.orchestra.run.smithi045.stdout: -1863> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_40 [2,head] auth NULL (dversion lock) v=2170 ino=(nil) state=1073741824 0x55cf6204ac80] 2023-10-03T19:20:56.072 INFO:teuthology.orchestra.run.smithi045.stdout: -1862> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_39 [2,head] auth (dversion lock) v=2168 ino=0x1000000021c state=1073741824 0x55cf6204aa00] 2023-10-03T19:20:56.072 INFO:teuthology.orchestra.run.smithi045.stdout: -1861> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.072 INFO:teuthology.orchestra.run.smithi045.stdout: -1860> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000021c [2,head] /dc-dir/dc-file_39 auth v2168 s=2 n(v0 rc2023-10-03T19:13:34.910814+0000 b2 1=1+0) (iversion lock) 0x55cf62047b80] 2023-10-03T19:20:56.072 INFO:teuthology.orchestra.run.smithi045.stdout: -1859> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_39 [2,head] auth (dversion lock) v=2168 ino=0x1000000021c state=1073741824 0x55cf6204aa00] [inode 0x1000000021c [2,head] /dc-dir/dc-file_39 auth v2168 s=2 n(v0 rc2023-10-03T19:13:34.910814+0000 b2 1=1+0) (iversion lock) 0x55cf62047b80] 2023-10-03T19:20:56.072 INFO:teuthology.orchestra.run.smithi045.stdout: -1858> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000021c [2,head] #1000000021c auth v2168 s=2 n(v0 rc2023-10-03T19:13:34.910814+0000 b2 1=1+0) (iversion lock) 0x55cf62047b80] 2023-10-03T19:20:56.072 INFO:teuthology.orchestra.run.smithi045.stdout: -1857> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_39 [2,head] auth NULL (dversion lock) v=2168 ino=(nil) state=1073741824 0x55cf6204aa00] 2023-10-03T19:20:56.073 INFO:teuthology.orchestra.run.smithi045.stdout: -1856> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_38 [2,head] auth (dversion lock) v=2166 ino=0x1000000021b state=1073741824 0x55cf6204a780] 2023-10-03T19:20:56.073 INFO:teuthology.orchestra.run.smithi045.stdout: -1855> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.073 INFO:teuthology.orchestra.run.smithi045.stdout: -1854> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000021b [2,head] /dc-dir/dc-file_38 auth v2166 s=2 n(v0 rc2023-10-03T19:13:34.899110+0000 b2 1=1+0) (iversion lock) 0x55cf62047600] 2023-10-03T19:20:56.073 INFO:teuthology.orchestra.run.smithi045.stdout: -1853> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_38 [2,head] auth (dversion lock) v=2166 ino=0x1000000021b state=1073741824 0x55cf6204a780] [inode 0x1000000021b [2,head] /dc-dir/dc-file_38 auth v2166 s=2 n(v0 rc2023-10-03T19:13:34.899110+0000 b2 1=1+0) (iversion lock) 0x55cf62047600] 2023-10-03T19:20:56.073 INFO:teuthology.orchestra.run.smithi045.stdout: -1852> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000021b [2,head] #1000000021b auth v2166 s=2 n(v0 rc2023-10-03T19:13:34.899110+0000 b2 1=1+0) (iversion lock) 0x55cf62047600] 2023-10-03T19:20:56.073 INFO:teuthology.orchestra.run.smithi045.stdout: -1851> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_38 [2,head] auth NULL (dversion lock) v=2166 ino=(nil) state=1073741824 0x55cf6204a780] 2023-10-03T19:20:56.073 INFO:teuthology.orchestra.run.smithi045.stdout: -1850> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_37 [2,head] auth (dversion lock) v=2164 ino=0x1000000021a state=1073741824 0x55cf6204a500] 2023-10-03T19:20:56.073 INFO:teuthology.orchestra.run.smithi045.stdout: -1849> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.073 INFO:teuthology.orchestra.run.smithi045.stdout: -1848> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000021a [2,head] /dc-dir/dc-file_37 auth v2164 s=2 n(v0 rc2023-10-03T19:13:34.887544+0000 b2 1=1+0) (iversion lock) 0x55cf62047080] 2023-10-03T19:20:56.073 INFO:teuthology.orchestra.run.smithi045.stdout: -1847> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_37 [2,head] auth (dversion lock) v=2164 ino=0x1000000021a state=1073741824 0x55cf6204a500] [inode 0x1000000021a [2,head] /dc-dir/dc-file_37 auth v2164 s=2 n(v0 rc2023-10-03T19:13:34.887544+0000 b2 1=1+0) (iversion lock) 0x55cf62047080] 2023-10-03T19:20:56.074 INFO:teuthology.orchestra.run.smithi045.stdout: -1846> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000021a [2,head] #1000000021a auth v2164 s=2 n(v0 rc2023-10-03T19:13:34.887544+0000 b2 1=1+0) (iversion lock) 0x55cf62047080] 2023-10-03T19:20:56.074 INFO:teuthology.orchestra.run.smithi045.stdout: -1845> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_37 [2,head] auth NULL (dversion lock) v=2164 ino=(nil) state=1073741824 0x55cf6204a500] 2023-10-03T19:20:56.074 INFO:teuthology.orchestra.run.smithi045.stdout: -1844> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_36 [2,head] auth (dversion lock) v=2162 ino=0x10000000219 state=1073741824 0x55cf6204a280] 2023-10-03T19:20:56.074 INFO:teuthology.orchestra.run.smithi045.stdout: -1843> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.074 INFO:teuthology.orchestra.run.smithi045.stdout: -1842> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000219 [2,head] /dc-dir/dc-file_36 auth v2162 s=2 n(v0 rc2023-10-03T19:13:34.873379+0000 b2 1=1+0) (iversion lock) 0x55cf62046b00] 2023-10-03T19:20:56.074 INFO:teuthology.orchestra.run.smithi045.stdout: -1841> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_36 [2,head] auth (dversion lock) v=2162 ino=0x10000000219 state=1073741824 0x55cf6204a280] [inode 0x10000000219 [2,head] /dc-dir/dc-file_36 auth v2162 s=2 n(v0 rc2023-10-03T19:13:34.873379+0000 b2 1=1+0) (iversion lock) 0x55cf62046b00] 2023-10-03T19:20:56.074 INFO:teuthology.orchestra.run.smithi045.stdout: -1840> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000219 [2,head] #10000000219 auth v2162 s=2 n(v0 rc2023-10-03T19:13:34.873379+0000 b2 1=1+0) (iversion lock) 0x55cf62046b00] 2023-10-03T19:20:56.074 INFO:teuthology.orchestra.run.smithi045.stdout: -1839> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_36 [2,head] auth NULL (dversion lock) v=2162 ino=(nil) state=1073741824 0x55cf6204a280] 2023-10-03T19:20:56.074 INFO:teuthology.orchestra.run.smithi045.stdout: -1838> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_35 [2,head] auth (dversion lock) v=2160 ino=0x10000000218 state=1073741824 0x55cf6204a000] 2023-10-03T19:20:56.074 INFO:teuthology.orchestra.run.smithi045.stdout: -1837> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.074 INFO:teuthology.orchestra.run.smithi045.stdout: -1836> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000218 [2,head] /dc-dir/dc-file_35 auth v2160 s=2 n(v0 rc2023-10-03T19:13:34.863308+0000 b2 1=1+0) (iversion lock) 0x55cf62046580] 2023-10-03T19:20:56.074 INFO:teuthology.orchestra.run.smithi045.stdout: -1835> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_35 [2,head] auth (dversion lock) v=2160 ino=0x10000000218 state=1073741824 0x55cf6204a000] [inode 0x10000000218 [2,head] /dc-dir/dc-file_35 auth v2160 s=2 n(v0 rc2023-10-03T19:13:34.863308+0000 b2 1=1+0) (iversion lock) 0x55cf62046580] 2023-10-03T19:20:56.075 INFO:teuthology.orchestra.run.smithi045.stdout: -1834> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000218 [2,head] #10000000218 auth v2160 s=2 n(v0 rc2023-10-03T19:13:34.863308+0000 b2 1=1+0) (iversion lock) 0x55cf62046580] 2023-10-03T19:20:56.075 INFO:teuthology.orchestra.run.smithi045.stdout: -1833> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_35 [2,head] auth NULL (dversion lock) v=2160 ino=(nil) state=1073741824 0x55cf6204a000] 2023-10-03T19:20:56.075 INFO:teuthology.orchestra.run.smithi045.stdout: -1832> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_34 [2,head] auth (dversion lock) v=2158 ino=0x10000000217 state=1073741824 0x55cf62037b80] 2023-10-03T19:20:56.075 INFO:teuthology.orchestra.run.smithi045.stdout: -1831> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.075 INFO:teuthology.orchestra.run.smithi045.stdout: -1830> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000217 [2,head] /dc-dir/dc-file_34 auth v2158 s=2 n(v0 rc2023-10-03T19:13:34.853480+0000 b2 1=1+0) (iversion lock) 0x55cf62046000] 2023-10-03T19:20:56.075 INFO:teuthology.orchestra.run.smithi045.stdout: -1829> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_34 [2,head] auth (dversion lock) v=2158 ino=0x10000000217 state=1073741824 0x55cf62037b80] [inode 0x10000000217 [2,head] /dc-dir/dc-file_34 auth v2158 s=2 n(v0 rc2023-10-03T19:13:34.853480+0000 b2 1=1+0) (iversion lock) 0x55cf62046000] 2023-10-03T19:20:56.075 INFO:teuthology.orchestra.run.smithi045.stdout: -1828> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000217 [2,head] #10000000217 auth v2158 s=2 n(v0 rc2023-10-03T19:13:34.853480+0000 b2 1=1+0) (iversion lock) 0x55cf62046000] 2023-10-03T19:20:56.075 INFO:teuthology.orchestra.run.smithi045.stdout: -1827> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_34 [2,head] auth NULL (dversion lock) v=2158 ino=(nil) state=1073741824 0x55cf62037b80] 2023-10-03T19:20:56.075 INFO:teuthology.orchestra.run.smithi045.stdout: -1826> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_33 [2,head] auth (dversion lock) v=2156 ino=0x10000000216 state=1073741824 0x55cf62037900] 2023-10-03T19:20:56.075 INFO:teuthology.orchestra.run.smithi045.stdout: -1825> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.075 INFO:teuthology.orchestra.run.smithi045.stdout: -1824> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000216 [2,head] /dc-dir/dc-file_33 auth v2156 s=2 n(v0 rc2023-10-03T19:13:34.843596+0000 b2 1=1+0) (iversion lock) 0x55cf6203b700] 2023-10-03T19:20:56.076 INFO:teuthology.orchestra.run.smithi045.stdout: -1823> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_33 [2,head] auth (dversion lock) v=2156 ino=0x10000000216 state=1073741824 0x55cf62037900] [inode 0x10000000216 [2,head] /dc-dir/dc-file_33 auth v2156 s=2 n(v0 rc2023-10-03T19:13:34.843596+0000 b2 1=1+0) (iversion lock) 0x55cf6203b700] 2023-10-03T19:20:56.076 INFO:teuthology.orchestra.run.smithi045.stdout: -1822> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000216 [2,head] #10000000216 auth v2156 s=2 n(v0 rc2023-10-03T19:13:34.843596+0000 b2 1=1+0) (iversion lock) 0x55cf6203b700] 2023-10-03T19:20:56.076 INFO:teuthology.orchestra.run.smithi045.stdout: -1821> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_33 [2,head] auth NULL (dversion lock) v=2156 ino=(nil) state=1073741824 0x55cf62037900] 2023-10-03T19:20:56.076 INFO:teuthology.orchestra.run.smithi045.stdout: -1820> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_32 [2,head] auth (dversion lock) v=2154 ino=0x10000000215 state=1073741824 0x55cf62037680] 2023-10-03T19:20:56.076 INFO:teuthology.orchestra.run.smithi045.stdout: -1819> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.076 INFO:teuthology.orchestra.run.smithi045.stdout: -1818> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000215 [2,head] /dc-dir/dc-file_32 auth v2154 s=2 n(v0 rc2023-10-03T19:13:34.833467+0000 b2 1=1+0) (iversion lock) 0x55cf6203b180] 2023-10-03T19:20:56.076 INFO:teuthology.orchestra.run.smithi045.stdout: -1817> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_32 [2,head] auth (dversion lock) v=2154 ino=0x10000000215 state=1073741824 0x55cf62037680] [inode 0x10000000215 [2,head] /dc-dir/dc-file_32 auth v2154 s=2 n(v0 rc2023-10-03T19:13:34.833467+0000 b2 1=1+0) (iversion lock) 0x55cf6203b180] 2023-10-03T19:20:56.076 INFO:teuthology.orchestra.run.smithi045.stdout: -1816> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000215 [2,head] #10000000215 auth v2154 s=2 n(v0 rc2023-10-03T19:13:34.833467+0000 b2 1=1+0) (iversion lock) 0x55cf6203b180] 2023-10-03T19:20:56.076 INFO:teuthology.orchestra.run.smithi045.stdout: -1815> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_32 [2,head] auth NULL (dversion lock) v=2154 ino=(nil) state=1073741824 0x55cf62037680] 2023-10-03T19:20:56.076 INFO:teuthology.orchestra.run.smithi045.stdout: -1814> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_31 [2,head] auth (dversion lock) v=2152 ino=0x10000000214 state=1073741824 0x55cf62037400] 2023-10-03T19:20:56.077 INFO:teuthology.orchestra.run.smithi045.stdout: -1813> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.077 INFO:teuthology.orchestra.run.smithi045.stdout: -1812> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000214 [2,head] /dc-dir/dc-file_31 auth v2152 s=2 n(v0 rc2023-10-03T19:13:34.822734+0000 b2 1=1+0) (iversion lock) 0x55cf6203ac00] 2023-10-03T19:20:56.077 INFO:teuthology.orchestra.run.smithi045.stdout: -1811> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_31 [2,head] auth (dversion lock) v=2152 ino=0x10000000214 state=1073741824 0x55cf62037400] [inode 0x10000000214 [2,head] /dc-dir/dc-file_31 auth v2152 s=2 n(v0 rc2023-10-03T19:13:34.822734+0000 b2 1=1+0) (iversion lock) 0x55cf6203ac00] 2023-10-03T19:20:56.077 INFO:teuthology.orchestra.run.smithi045.stdout: -1810> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000214 [2,head] #10000000214 auth v2152 s=2 n(v0 rc2023-10-03T19:13:34.822734+0000 b2 1=1+0) (iversion lock) 0x55cf6203ac00] 2023-10-03T19:20:56.077 INFO:teuthology.orchestra.run.smithi045.stdout: -1809> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_31 [2,head] auth NULL (dversion lock) v=2152 ino=(nil) state=1073741824 0x55cf62037400] 2023-10-03T19:20:56.077 INFO:teuthology.orchestra.run.smithi045.stdout: -1808> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_30 [2,head] auth (dversion lock) v=2150 ino=0x10000000213 state=1073741824 0x55cf62037180] 2023-10-03T19:20:56.077 INFO:teuthology.orchestra.run.smithi045.stdout: -1807> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.077 INFO:teuthology.orchestra.run.smithi045.stdout: -1806> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000213 [2,head] /dc-dir/dc-file_30 auth v2150 s=2 n(v0 rc2023-10-03T19:13:34.812933+0000 b2 1=1+0) (iversion lock) 0x55cf6203a680] 2023-10-03T19:20:56.077 INFO:teuthology.orchestra.run.smithi045.stdout: -1805> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_30 [2,head] auth (dversion lock) v=2150 ino=0x10000000213 state=1073741824 0x55cf62037180] [inode 0x10000000213 [2,head] /dc-dir/dc-file_30 auth v2150 s=2 n(v0 rc2023-10-03T19:13:34.812933+0000 b2 1=1+0) (iversion lock) 0x55cf6203a680] 2023-10-03T19:20:56.077 INFO:teuthology.orchestra.run.smithi045.stdout: -1804> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000213 [2,head] #10000000213 auth v2150 s=2 n(v0 rc2023-10-03T19:13:34.812933+0000 b2 1=1+0) (iversion lock) 0x55cf6203a680] 2023-10-03T19:20:56.077 INFO:teuthology.orchestra.run.smithi045.stdout: -1803> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_30 [2,head] auth NULL (dversion lock) v=2150 ino=(nil) state=1073741824 0x55cf62037180] 2023-10-03T19:20:56.078 INFO:teuthology.orchestra.run.smithi045.stdout: -1802> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_29 [2,head] auth (dversion lock) v=2148 ino=0x10000000212 state=1073741824 0x55cf62036f00] 2023-10-03T19:20:56.078 INFO:teuthology.orchestra.run.smithi045.stdout: -1801> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.078 INFO:teuthology.orchestra.run.smithi045.stdout: -1800> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000212 [2,head] /dc-dir/dc-file_29 auth v2148 s=2 n(v0 rc2023-10-03T19:13:34.802498+0000 b2 1=1+0) (iversion lock) 0x55cf6203a100] 2023-10-03T19:20:56.078 INFO:teuthology.orchestra.run.smithi045.stdout: -1799> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_29 [2,head] auth (dversion lock) v=2148 ino=0x10000000212 state=1073741824 0x55cf62036f00] [inode 0x10000000212 [2,head] /dc-dir/dc-file_29 auth v2148 s=2 n(v0 rc2023-10-03T19:13:34.802498+0000 b2 1=1+0) (iversion lock) 0x55cf6203a100] 2023-10-03T19:20:56.078 INFO:teuthology.orchestra.run.smithi045.stdout: -1798> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000212 [2,head] #10000000212 auth v2148 s=2 n(v0 rc2023-10-03T19:13:34.802498+0000 b2 1=1+0) (iversion lock) 0x55cf6203a100] 2023-10-03T19:20:56.078 INFO:teuthology.orchestra.run.smithi045.stdout: -1797> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_29 [2,head] auth NULL (dversion lock) v=2148 ino=(nil) state=1073741824 0x55cf62036f00] 2023-10-03T19:20:56.078 INFO:teuthology.orchestra.run.smithi045.stdout: -1796> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_28 [2,head] auth (dversion lock) v=2146 ino=0x10000000211 state=1073741824 0x55cf62036c80] 2023-10-03T19:20:56.078 INFO:teuthology.orchestra.run.smithi045.stdout: -1795> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.078 INFO:teuthology.orchestra.run.smithi045.stdout: -1794> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000211 [2,head] /dc-dir/dc-file_28 auth v2146 s=2 n(v0 rc2023-10-03T19:13:34.791632+0000 b2 1=1+0) (iversion lock) 0x55cf62039b80] 2023-10-03T19:20:56.078 INFO:teuthology.orchestra.run.smithi045.stdout: -1793> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_28 [2,head] auth (dversion lock) v=2146 ino=0x10000000211 state=1073741824 0x55cf62036c80] [inode 0x10000000211 [2,head] /dc-dir/dc-file_28 auth v2146 s=2 n(v0 rc2023-10-03T19:13:34.791632+0000 b2 1=1+0) (iversion lock) 0x55cf62039b80] 2023-10-03T19:20:56.078 INFO:teuthology.orchestra.run.smithi045.stdout: -1792> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000211 [2,head] #10000000211 auth v2146 s=2 n(v0 rc2023-10-03T19:13:34.791632+0000 b2 1=1+0) (iversion lock) 0x55cf62039b80] 2023-10-03T19:20:56.078 INFO:teuthology.orchestra.run.smithi045.stdout: -1791> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_28 [2,head] auth NULL (dversion lock) v=2146 ino=(nil) state=1073741824 0x55cf62036c80] 2023-10-03T19:20:56.079 INFO:teuthology.orchestra.run.smithi045.stdout: -1790> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_27 [2,head] auth (dversion lock) v=2144 ino=0x10000000210 state=1073741824 0x55cf62036a00] 2023-10-03T19:20:56.079 INFO:teuthology.orchestra.run.smithi045.stdout: -1789> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.079 INFO:teuthology.orchestra.run.smithi045.stdout: -1788> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000210 [2,head] /dc-dir/dc-file_27 auth v2144 s=2 n(v0 rc2023-10-03T19:13:34.781726+0000 b2 1=1+0) (iversion lock) 0x55cf62039600] 2023-10-03T19:20:56.079 INFO:teuthology.orchestra.run.smithi045.stdout: -1787> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_27 [2,head] auth (dversion lock) v=2144 ino=0x10000000210 state=1073741824 0x55cf62036a00] [inode 0x10000000210 [2,head] /dc-dir/dc-file_27 auth v2144 s=2 n(v0 rc2023-10-03T19:13:34.781726+0000 b2 1=1+0) (iversion lock) 0x55cf62039600] 2023-10-03T19:20:56.079 INFO:teuthology.orchestra.run.smithi045.stdout: -1786> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000210 [2,head] #10000000210 auth v2144 s=2 n(v0 rc2023-10-03T19:13:34.781726+0000 b2 1=1+0) (iversion lock) 0x55cf62039600] 2023-10-03T19:20:56.079 INFO:teuthology.orchestra.run.smithi045.stdout: -1785> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_27 [2,head] auth NULL (dversion lock) v=2144 ino=(nil) state=1073741824 0x55cf62036a00] 2023-10-03T19:20:56.079 INFO:teuthology.orchestra.run.smithi045.stdout: -1784> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_26 [2,head] auth (dversion lock) v=2142 ino=0x1000000020f state=1073741824 0x55cf62036780] 2023-10-03T19:20:56.079 INFO:teuthology.orchestra.run.smithi045.stdout: -1783> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.079 INFO:teuthology.orchestra.run.smithi045.stdout: -1782> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000020f [2,head] /dc-dir/dc-file_26 auth v2142 s=2 n(v0 rc2023-10-03T19:13:34.771493+0000 b2 1=1+0) (iversion lock) 0x55cf62039080] 2023-10-03T19:20:56.079 INFO:teuthology.orchestra.run.smithi045.stdout: -1781> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_26 [2,head] auth (dversion lock) v=2142 ino=0x1000000020f state=1073741824 0x55cf62036780] [inode 0x1000000020f [2,head] /dc-dir/dc-file_26 auth v2142 s=2 n(v0 rc2023-10-03T19:13:34.771493+0000 b2 1=1+0) (iversion lock) 0x55cf62039080] 2023-10-03T19:20:56.079 INFO:teuthology.orchestra.run.smithi045.stdout: -1780> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000020f [2,head] #1000000020f auth v2142 s=2 n(v0 rc2023-10-03T19:13:34.771493+0000 b2 1=1+0) (iversion lock) 0x55cf62039080] 2023-10-03T19:20:56.080 INFO:teuthology.orchestra.run.smithi045.stdout: -1779> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_26 [2,head] auth NULL (dversion lock) v=2142 ino=(nil) state=1073741824 0x55cf62036780] 2023-10-03T19:20:56.080 INFO:teuthology.orchestra.run.smithi045.stdout: -1778> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_25 [2,head] auth (dversion lock) v=2140 ino=0x1000000020e state=1073741824 0x55cf62036500] 2023-10-03T19:20:56.080 INFO:teuthology.orchestra.run.smithi045.stdout: -1777> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.080 INFO:teuthology.orchestra.run.smithi045.stdout: -1776> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000020e [2,head] /dc-dir/dc-file_25 auth v2140 s=2 n(v0 rc2023-10-03T19:13:34.761712+0000 b2 1=1+0) (iversion lock) 0x55cf62038b00] 2023-10-03T19:20:56.080 INFO:teuthology.orchestra.run.smithi045.stdout: -1775> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_25 [2,head] auth (dversion lock) v=2140 ino=0x1000000020e state=1073741824 0x55cf62036500] [inode 0x1000000020e [2,head] /dc-dir/dc-file_25 auth v2140 s=2 n(v0 rc2023-10-03T19:13:34.761712+0000 b2 1=1+0) (iversion lock) 0x55cf62038b00] 2023-10-03T19:20:56.080 INFO:teuthology.orchestra.run.smithi045.stdout: -1774> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000020e [2,head] #1000000020e auth v2140 s=2 n(v0 rc2023-10-03T19:13:34.761712+0000 b2 1=1+0) (iversion lock) 0x55cf62038b00] 2023-10-03T19:20:56.080 INFO:teuthology.orchestra.run.smithi045.stdout: -1773> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_25 [2,head] auth NULL (dversion lock) v=2140 ino=(nil) state=1073741824 0x55cf62036500] 2023-10-03T19:20:56.080 INFO:teuthology.orchestra.run.smithi045.stdout: -1772> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_24 [2,head] auth (dversion lock) v=2138 ino=0x1000000020d state=1073741824 0x55cf62036280] 2023-10-03T19:20:56.080 INFO:teuthology.orchestra.run.smithi045.stdout: -1771> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.080 INFO:teuthology.orchestra.run.smithi045.stdout: -1770> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000020d [2,head] /dc-dir/dc-file_24 auth v2138 s=2 n(v0 rc2023-10-03T19:13:34.751852+0000 b2 1=1+0) (iversion lock) 0x55cf62038580] 2023-10-03T19:20:56.080 INFO:teuthology.orchestra.run.smithi045.stdout: -1769> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_24 [2,head] auth (dversion lock) v=2138 ino=0x1000000020d state=1073741824 0x55cf62036280] [inode 0x1000000020d [2,head] /dc-dir/dc-file_24 auth v2138 s=2 n(v0 rc2023-10-03T19:13:34.751852+0000 b2 1=1+0) (iversion lock) 0x55cf62038580] 2023-10-03T19:20:56.081 INFO:teuthology.orchestra.run.smithi045.stdout: -1768> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000020d [2,head] #1000000020d auth v2138 s=2 n(v0 rc2023-10-03T19:13:34.751852+0000 b2 1=1+0) (iversion lock) 0x55cf62038580] 2023-10-03T19:20:56.081 INFO:teuthology.orchestra.run.smithi045.stdout: -1767> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_24 [2,head] auth NULL (dversion lock) v=2138 ino=(nil) state=1073741824 0x55cf62036280] 2023-10-03T19:20:56.081 INFO:teuthology.orchestra.run.smithi045.stdout: -1766> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_23 [2,head] auth (dversion lock) v=2136 ino=0x1000000020c state=1073741824 0x55cf62036000] 2023-10-03T19:20:56.081 INFO:teuthology.orchestra.run.smithi045.stdout: -1765> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.081 INFO:teuthology.orchestra.run.smithi045.stdout: -1764> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000020c [2,head] /dc-dir/dc-file_23 auth v2136 s=2 n(v0 rc2023-10-03T19:13:34.741299+0000 b2 1=1+0) (iversion lock) 0x55cf62038000] 2023-10-03T19:20:56.081 INFO:teuthology.orchestra.run.smithi045.stdout: -1763> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_23 [2,head] auth (dversion lock) v=2136 ino=0x1000000020c state=1073741824 0x55cf62036000] [inode 0x1000000020c [2,head] /dc-dir/dc-file_23 auth v2136 s=2 n(v0 rc2023-10-03T19:13:34.741299+0000 b2 1=1+0) (iversion lock) 0x55cf62038000] 2023-10-03T19:20:56.081 INFO:teuthology.orchestra.run.smithi045.stdout: -1762> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000020c [2,head] #1000000020c auth v2136 s=2 n(v0 rc2023-10-03T19:13:34.741299+0000 b2 1=1+0) (iversion lock) 0x55cf62038000] 2023-10-03T19:20:56.081 INFO:teuthology.orchestra.run.smithi045.stdout: -1761> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_23 [2,head] auth NULL (dversion lock) v=2136 ino=(nil) state=1073741824 0x55cf62036000] 2023-10-03T19:20:56.081 INFO:teuthology.orchestra.run.smithi045.stdout: -1760> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_22 [2,head] auth (dversion lock) v=2134 ino=0x1000000020b state=1073741824 0x55cf62025b80] 2023-10-03T19:20:56.081 INFO:teuthology.orchestra.run.smithi045.stdout: -1759> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.081 INFO:teuthology.orchestra.run.smithi045.stdout: -1758> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000020b [2,head] /dc-dir/dc-file_22 auth v2134 s=2 n(v0 rc2023-10-03T19:13:34.731470+0000 b2 1=1+0) (iversion lock) 0x55cf62029700] 2023-10-03T19:20:56.082 INFO:teuthology.orchestra.run.smithi045.stdout: -1757> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_22 [2,head] auth (dversion lock) v=2134 ino=0x1000000020b state=1073741824 0x55cf62025b80] [inode 0x1000000020b [2,head] /dc-dir/dc-file_22 auth v2134 s=2 n(v0 rc2023-10-03T19:13:34.731470+0000 b2 1=1+0) (iversion lock) 0x55cf62029700] 2023-10-03T19:20:56.082 INFO:teuthology.orchestra.run.smithi045.stdout: -1756> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000020b [2,head] #1000000020b auth v2134 s=2 n(v0 rc2023-10-03T19:13:34.731470+0000 b2 1=1+0) (iversion lock) 0x55cf62029700] 2023-10-03T19:20:56.082 INFO:teuthology.orchestra.run.smithi045.stdout: -1755> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_22 [2,head] auth NULL (dversion lock) v=2134 ino=(nil) state=1073741824 0x55cf62025b80] 2023-10-03T19:20:56.082 INFO:teuthology.orchestra.run.smithi045.stdout: -1754> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_21 [2,head] auth (dversion lock) v=2132 ino=0x1000000020a state=1073741824 0x55cf62025900] 2023-10-03T19:20:56.082 INFO:teuthology.orchestra.run.smithi045.stdout: -1753> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.082 INFO:teuthology.orchestra.run.smithi045.stdout: -1752> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000020a [2,head] /dc-dir/dc-file_21 auth v2132 s=2 n(v0 rc2023-10-03T19:13:34.721618+0000 b2 1=1+0) (iversion lock) 0x55cf62029180] 2023-10-03T19:20:56.082 INFO:teuthology.orchestra.run.smithi045.stdout: -1751> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_21 [2,head] auth (dversion lock) v=2132 ino=0x1000000020a state=1073741824 0x55cf62025900] [inode 0x1000000020a [2,head] /dc-dir/dc-file_21 auth v2132 s=2 n(v0 rc2023-10-03T19:13:34.721618+0000 b2 1=1+0) (iversion lock) 0x55cf62029180] 2023-10-03T19:20:56.082 INFO:teuthology.orchestra.run.smithi045.stdout: -1750> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000020a [2,head] #1000000020a auth v2132 s=2 n(v0 rc2023-10-03T19:13:34.721618+0000 b2 1=1+0) (iversion lock) 0x55cf62029180] 2023-10-03T19:20:56.082 INFO:teuthology.orchestra.run.smithi045.stdout: -1749> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_21 [2,head] auth NULL (dversion lock) v=2132 ino=(nil) state=1073741824 0x55cf62025900] 2023-10-03T19:20:56.082 INFO:teuthology.orchestra.run.smithi045.stdout: -1748> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_20 [2,head] auth (dversion lock) v=2130 ino=0x10000000209 state=1073741824 0x55cf62025680] 2023-10-03T19:20:56.082 INFO:teuthology.orchestra.run.smithi045.stdout: -1747> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.083 INFO:teuthology.orchestra.run.smithi045.stdout: -1746> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000209 [2,head] /dc-dir/dc-file_20 auth v2130 s=2 n(v0 rc2023-10-03T19:13:34.711062+0000 b2 1=1+0) (iversion lock) 0x55cf62028c00] 2023-10-03T19:20:56.083 INFO:teuthology.orchestra.run.smithi045.stdout: -1745> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_20 [2,head] auth (dversion lock) v=2130 ino=0x10000000209 state=1073741824 0x55cf62025680] [inode 0x10000000209 [2,head] /dc-dir/dc-file_20 auth v2130 s=2 n(v0 rc2023-10-03T19:13:34.711062+0000 b2 1=1+0) (iversion lock) 0x55cf62028c00] 2023-10-03T19:20:56.083 INFO:teuthology.orchestra.run.smithi045.stdout: -1744> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000209 [2,head] #10000000209 auth v2130 s=2 n(v0 rc2023-10-03T19:13:34.711062+0000 b2 1=1+0) (iversion lock) 0x55cf62028c00] 2023-10-03T19:20:56.083 INFO:teuthology.orchestra.run.smithi045.stdout: -1743> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_20 [2,head] auth NULL (dversion lock) v=2130 ino=(nil) state=1073741824 0x55cf62025680] 2023-10-03T19:20:56.083 INFO:teuthology.orchestra.run.smithi045.stdout: -1742> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_19 [2,head] auth (dversion lock) v=2128 ino=0x10000000208 state=1073741824 0x55cf62025400] 2023-10-03T19:20:56.083 INFO:teuthology.orchestra.run.smithi045.stdout: -1741> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.083 INFO:teuthology.orchestra.run.smithi045.stdout: -1740> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000208 [2,head] /dc-dir/dc-file_19 auth v2128 s=2 n(v0 rc2023-10-03T19:13:34.700831+0000 b2 1=1+0) (iversion lock) 0x55cf62028680] 2023-10-03T19:20:56.083 INFO:teuthology.orchestra.run.smithi045.stdout: -1739> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_19 [2,head] auth (dversion lock) v=2128 ino=0x10000000208 state=1073741824 0x55cf62025400] [inode 0x10000000208 [2,head] /dc-dir/dc-file_19 auth v2128 s=2 n(v0 rc2023-10-03T19:13:34.700831+0000 b2 1=1+0) (iversion lock) 0x55cf62028680] 2023-10-03T19:20:56.083 INFO:teuthology.orchestra.run.smithi045.stdout: -1738> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000208 [2,head] #10000000208 auth v2128 s=2 n(v0 rc2023-10-03T19:13:34.700831+0000 b2 1=1+0) (iversion lock) 0x55cf62028680] 2023-10-03T19:20:56.083 INFO:teuthology.orchestra.run.smithi045.stdout: -1737> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_19 [2,head] auth NULL (dversion lock) v=2128 ino=(nil) state=1073741824 0x55cf62025400] 2023-10-03T19:20:56.083 INFO:teuthology.orchestra.run.smithi045.stdout: -1736> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_18 [2,head] auth (dversion lock) v=2126 ino=0x10000000207 state=1073741824 0x55cf62025180] 2023-10-03T19:20:56.084 INFO:teuthology.orchestra.run.smithi045.stdout: -1735> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.084 INFO:teuthology.orchestra.run.smithi045.stdout: -1734> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000207 [2,head] /dc-dir/dc-file_18 auth v2126 s=2 n(v0 rc2023-10-03T19:13:34.690842+0000 b2 1=1+0) (iversion lock) 0x55cf62028100] 2023-10-03T19:20:56.084 INFO:teuthology.orchestra.run.smithi045.stdout: -1733> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_18 [2,head] auth (dversion lock) v=2126 ino=0x10000000207 state=1073741824 0x55cf62025180] [inode 0x10000000207 [2,head] /dc-dir/dc-file_18 auth v2126 s=2 n(v0 rc2023-10-03T19:13:34.690842+0000 b2 1=1+0) (iversion lock) 0x55cf62028100] 2023-10-03T19:20:56.084 INFO:teuthology.orchestra.run.smithi045.stdout: -1732> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000207 [2,head] #10000000207 auth v2126 s=2 n(v0 rc2023-10-03T19:13:34.690842+0000 b2 1=1+0) (iversion lock) 0x55cf62028100] 2023-10-03T19:20:56.084 INFO:teuthology.orchestra.run.smithi045.stdout: -1731> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_18 [2,head] auth NULL (dversion lock) v=2126 ino=(nil) state=1073741824 0x55cf62025180] 2023-10-03T19:20:56.084 INFO:teuthology.orchestra.run.smithi045.stdout: -1730> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_17 [2,head] auth (dversion lock) v=2124 ino=0x10000000206 state=1073741824 0x55cf62024f00] 2023-10-03T19:20:56.084 INFO:teuthology.orchestra.run.smithi045.stdout: -1729> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.084 INFO:teuthology.orchestra.run.smithi045.stdout: -1728> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000206 [2,head] /dc-dir/dc-file_17 auth v2124 s=2 n(v0 rc2023-10-03T19:13:34.680330+0000 b2 1=1+0) (iversion lock) 0x55cf62027b80] 2023-10-03T19:20:56.084 INFO:teuthology.orchestra.run.smithi045.stdout: -1727> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_17 [2,head] auth (dversion lock) v=2124 ino=0x10000000206 state=1073741824 0x55cf62024f00] [inode 0x10000000206 [2,head] /dc-dir/dc-file_17 auth v2124 s=2 n(v0 rc2023-10-03T19:13:34.680330+0000 b2 1=1+0) (iversion lock) 0x55cf62027b80] 2023-10-03T19:20:56.084 INFO:teuthology.orchestra.run.smithi045.stdout: -1726> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000206 [2,head] #10000000206 auth v2124 s=2 n(v0 rc2023-10-03T19:13:34.680330+0000 b2 1=1+0) (iversion lock) 0x55cf62027b80] 2023-10-03T19:20:56.084 INFO:teuthology.orchestra.run.smithi045.stdout: -1725> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_17 [2,head] auth NULL (dversion lock) v=2124 ino=(nil) state=1073741824 0x55cf62024f00] 2023-10-03T19:20:56.085 INFO:teuthology.orchestra.run.smithi045.stdout: -1724> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_16 [2,head] auth (dversion lock) v=2122 ino=0x10000000205 state=1073741824 0x55cf62024c80] 2023-10-03T19:20:56.085 INFO:teuthology.orchestra.run.smithi045.stdout: -1723> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.085 INFO:teuthology.orchestra.run.smithi045.stdout: -1722> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000205 [2,head] /dc-dir/dc-file_16 auth v2122 s=2 n(v0 rc2023-10-03T19:13:34.669794+0000 b2 1=1+0) (iversion lock) 0x55cf62027600] 2023-10-03T19:20:56.085 INFO:teuthology.orchestra.run.smithi045.stdout: -1721> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_16 [2,head] auth (dversion lock) v=2122 ino=0x10000000205 state=1073741824 0x55cf62024c80] [inode 0x10000000205 [2,head] /dc-dir/dc-file_16 auth v2122 s=2 n(v0 rc2023-10-03T19:13:34.669794+0000 b2 1=1+0) (iversion lock) 0x55cf62027600] 2023-10-03T19:20:56.085 INFO:teuthology.orchestra.run.smithi045.stdout: -1720> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000205 [2,head] #10000000205 auth v2122 s=2 n(v0 rc2023-10-03T19:13:34.669794+0000 b2 1=1+0) (iversion lock) 0x55cf62027600] 2023-10-03T19:20:56.085 INFO:teuthology.orchestra.run.smithi045.stdout: -1719> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_16 [2,head] auth NULL (dversion lock) v=2122 ino=(nil) state=1073741824 0x55cf62024c80] 2023-10-03T19:20:56.085 INFO:teuthology.orchestra.run.smithi045.stdout: -1718> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_15 [2,head] auth (dversion lock) v=2120 ino=0x10000000204 state=1073741824 0x55cf62024a00] 2023-10-03T19:20:56.085 INFO:teuthology.orchestra.run.smithi045.stdout: -1717> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.085 INFO:teuthology.orchestra.run.smithi045.stdout: -1716> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000204 [2,head] /dc-dir/dc-file_15 auth v2120 s=2 n(v0 rc2023-10-03T19:13:34.659346+0000 b2 1=1+0) (iversion lock) 0x55cf62027080] 2023-10-03T19:20:56.086 INFO:teuthology.orchestra.run.smithi045.stdout: -1715> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_15 [2,head] auth (dversion lock) v=2120 ino=0x10000000204 state=1073741824 0x55cf62024a00] [inode 0x10000000204 [2,head] /dc-dir/dc-file_15 auth v2120 s=2 n(v0 rc2023-10-03T19:13:34.659346+0000 b2 1=1+0) (iversion lock) 0x55cf62027080] 2023-10-03T19:20:56.086 INFO:teuthology.orchestra.run.smithi045.stdout: -1714> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000204 [2,head] #10000000204 auth v2120 s=2 n(v0 rc2023-10-03T19:13:34.659346+0000 b2 1=1+0) (iversion lock) 0x55cf62027080] 2023-10-03T19:20:56.086 INFO:teuthology.orchestra.run.smithi045.stdout: -1713> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_15 [2,head] auth NULL (dversion lock) v=2120 ino=(nil) state=1073741824 0x55cf62024a00] 2023-10-03T19:20:56.086 INFO:teuthology.orchestra.run.smithi045.stdout: -1712> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_14 [2,head] auth (dversion lock) v=2118 ino=0x10000000203 state=1073741824 0x55cf62024780] 2023-10-03T19:20:56.086 INFO:teuthology.orchestra.run.smithi045.stdout: -1711> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.086 INFO:teuthology.orchestra.run.smithi045.stdout: -1710> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000203 [2,head] /dc-dir/dc-file_14 auth v2118 s=2 n(v0 rc2023-10-03T19:13:34.649327+0000 b2 1=1+0) (iversion lock) 0x55cf62026b00] 2023-10-03T19:20:56.086 INFO:teuthology.orchestra.run.smithi045.stdout: -1709> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_14 [2,head] auth (dversion lock) v=2118 ino=0x10000000203 state=1073741824 0x55cf62024780] [inode 0x10000000203 [2,head] /dc-dir/dc-file_14 auth v2118 s=2 n(v0 rc2023-10-03T19:13:34.649327+0000 b2 1=1+0) (iversion lock) 0x55cf62026b00] 2023-10-03T19:20:56.086 INFO:teuthology.orchestra.run.smithi045.stdout: -1708> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000203 [2,head] #10000000203 auth v2118 s=2 n(v0 rc2023-10-03T19:13:34.649327+0000 b2 1=1+0) (iversion lock) 0x55cf62026b00] 2023-10-03T19:20:56.086 INFO:teuthology.orchestra.run.smithi045.stdout: -1707> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_14 [2,head] auth NULL (dversion lock) v=2118 ino=(nil) state=1073741824 0x55cf62024780] 2023-10-03T19:20:56.086 INFO:teuthology.orchestra.run.smithi045.stdout: -1706> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_13 [2,head] auth (dversion lock) v=2116 ino=0x10000000202 state=1073741824 0x55cf62024500] 2023-10-03T19:20:56.087 INFO:teuthology.orchestra.run.smithi045.stdout: -1705> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.092 INFO:teuthology.orchestra.run.smithi045.stdout: -1704> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000202 [2,head] /dc-dir/dc-file_13 auth v2116 s=2 n(v0 rc2023-10-03T19:13:34.639073+0000 b2 1=1+0) (iversion lock) 0x55cf62026580] 2023-10-03T19:20:56.092 INFO:teuthology.orchestra.run.smithi045.stdout: -1703> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_13 [2,head] auth (dversion lock) v=2116 ino=0x10000000202 state=1073741824 0x55cf62024500] [inode 0x10000000202 [2,head] /dc-dir/dc-file_13 auth v2116 s=2 n(v0 rc2023-10-03T19:13:34.639073+0000 b2 1=1+0) (iversion lock) 0x55cf62026580] 2023-10-03T19:20:56.092 INFO:teuthology.orchestra.run.smithi045.stdout: -1702> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000202 [2,head] #10000000202 auth v2116 s=2 n(v0 rc2023-10-03T19:13:34.639073+0000 b2 1=1+0) (iversion lock) 0x55cf62026580] 2023-10-03T19:20:56.092 INFO:teuthology.orchestra.run.smithi045.stdout: -1701> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_13 [2,head] auth NULL (dversion lock) v=2116 ino=(nil) state=1073741824 0x55cf62024500] 2023-10-03T19:20:56.092 INFO:teuthology.orchestra.run.smithi045.stdout: -1700> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_12 [2,head] auth (dversion lock) v=2114 ino=0x10000000201 state=1073741824 0x55cf62024280] 2023-10-03T19:20:56.093 INFO:teuthology.orchestra.run.smithi045.stdout: -1699> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.093 INFO:teuthology.orchestra.run.smithi045.stdout: -1698> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000201 [2,head] /dc-dir/dc-file_12 auth v2114 s=2 n(v0 rc2023-10-03T19:13:34.628977+0000 b2 1=1+0) (iversion lock) 0x55cf62026000] 2023-10-03T19:20:56.093 INFO:teuthology.orchestra.run.smithi045.stdout: -1697> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_12 [2,head] auth (dversion lock) v=2114 ino=0x10000000201 state=1073741824 0x55cf62024280] [inode 0x10000000201 [2,head] /dc-dir/dc-file_12 auth v2114 s=2 n(v0 rc2023-10-03T19:13:34.628977+0000 b2 1=1+0) (iversion lock) 0x55cf62026000] 2023-10-03T19:20:56.093 INFO:teuthology.orchestra.run.smithi045.stdout: -1696> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000201 [2,head] #10000000201 auth v2114 s=2 n(v0 rc2023-10-03T19:13:34.628977+0000 b2 1=1+0) (iversion lock) 0x55cf62026000] 2023-10-03T19:20:56.093 INFO:teuthology.orchestra.run.smithi045.stdout: -1695> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_12 [2,head] auth NULL (dversion lock) v=2114 ino=(nil) state=1073741824 0x55cf62024280] 2023-10-03T19:20:56.093 INFO:teuthology.orchestra.run.smithi045.stdout: -1694> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_11 [2,head] auth (dversion lock) v=2112 ino=0x10000000200 state=1073741824 0x55cf62024000] 2023-10-03T19:20:56.093 INFO:teuthology.orchestra.run.smithi045.stdout: -1693> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.093 INFO:teuthology.orchestra.run.smithi045.stdout: -1692> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000200 [2,head] /dc-dir/dc-file_11 auth v2112 s=2 n(v0 rc2023-10-03T19:13:34.618929+0000 b2 1=1+0) (iversion lock) 0x55cf61ff1700] 2023-10-03T19:20:56.093 INFO:teuthology.orchestra.run.smithi045.stdout: -1691> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_11 [2,head] auth (dversion lock) v=2112 ino=0x10000000200 state=1073741824 0x55cf62024000] [inode 0x10000000200 [2,head] /dc-dir/dc-file_11 auth v2112 s=2 n(v0 rc2023-10-03T19:13:34.618929+0000 b2 1=1+0) (iversion lock) 0x55cf61ff1700] 2023-10-03T19:20:56.093 INFO:teuthology.orchestra.run.smithi045.stdout: -1690> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000200 [2,head] #10000000200 auth v2112 s=2 n(v0 rc2023-10-03T19:13:34.618929+0000 b2 1=1+0) (iversion lock) 0x55cf61ff1700] 2023-10-03T19:20:56.093 INFO:teuthology.orchestra.run.smithi045.stdout: -1689> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_11 [2,head] auth NULL (dversion lock) v=2112 ino=(nil) state=1073741824 0x55cf62024000] 2023-10-03T19:20:56.094 INFO:teuthology.orchestra.run.smithi045.stdout: -1688> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_10 [2,head] auth (dversion lock) v=2110 ino=0x100000001ff state=1073741824 0x55cf61fdbb80] 2023-10-03T19:20:56.094 INFO:teuthology.orchestra.run.smithi045.stdout: -1687> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.094 INFO:teuthology.orchestra.run.smithi045.stdout: -1686> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000001ff [2,head] /dc-dir/dc-file_10 auth v2110 s=2 n(v0 rc2023-10-03T19:13:34.608384+0000 b2 1=1+0) (iversion lock) 0x55cf61ff1180] 2023-10-03T19:20:56.094 INFO:teuthology.orchestra.run.smithi045.stdout: -1685> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_10 [2,head] auth (dversion lock) v=2110 ino=0x100000001ff state=1073741824 0x55cf61fdbb80] [inode 0x100000001ff [2,head] /dc-dir/dc-file_10 auth v2110 s=2 n(v0 rc2023-10-03T19:13:34.608384+0000 b2 1=1+0) (iversion lock) 0x55cf61ff1180] 2023-10-03T19:20:56.094 INFO:teuthology.orchestra.run.smithi045.stdout: -1684> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000001ff [2,head] #100000001ff auth v2110 s=2 n(v0 rc2023-10-03T19:13:34.608384+0000 b2 1=1+0) (iversion lock) 0x55cf61ff1180] 2023-10-03T19:20:56.094 INFO:teuthology.orchestra.run.smithi045.stdout: -1683> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_10 [2,head] auth NULL (dversion lock) v=2110 ino=(nil) state=1073741824 0x55cf61fdbb80] 2023-10-03T19:20:56.094 INFO:teuthology.orchestra.run.smithi045.stdout: -1682> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_9 [2,head] auth (dversion lock) v=2108 ino=0x100000001fe state=1073741824 0x55cf61fdb900] 2023-10-03T19:20:56.094 INFO:teuthology.orchestra.run.smithi045.stdout: -1681> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.094 INFO:teuthology.orchestra.run.smithi045.stdout: -1680> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000001fe [2,head] /dc-dir/dc-file_9 auth v2108 s=1 n(v0 rc2023-10-03T19:13:34.598223+0000 b1 1=1+0) (iversion lock) 0x55cf61ff0c00] 2023-10-03T19:20:56.094 INFO:teuthology.orchestra.run.smithi045.stdout: -1679> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_9 [2,head] auth (dversion lock) v=2108 ino=0x100000001fe state=1073741824 0x55cf61fdb900] [inode 0x100000001fe [2,head] /dc-dir/dc-file_9 auth v2108 s=1 n(v0 rc2023-10-03T19:13:34.598223+0000 b1 1=1+0) (iversion lock) 0x55cf61ff0c00] 2023-10-03T19:20:56.094 INFO:teuthology.orchestra.run.smithi045.stdout: -1678> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000001fe [2,head] #100000001fe auth v2108 s=1 n(v0 rc2023-10-03T19:13:34.598223+0000 b1 1=1+0) (iversion lock) 0x55cf61ff0c00] 2023-10-03T19:20:56.095 INFO:teuthology.orchestra.run.smithi045.stdout: -1677> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_9 [2,head] auth NULL (dversion lock) v=2108 ino=(nil) state=1073741824 0x55cf61fdb900] 2023-10-03T19:20:56.095 INFO:teuthology.orchestra.run.smithi045.stdout: -1676> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_8 [2,head] auth (dversion lock) v=2106 ino=0x100000001fd state=1073741824 0x55cf61fdb680] 2023-10-03T19:20:56.095 INFO:teuthology.orchestra.run.smithi045.stdout: -1675> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.095 INFO:teuthology.orchestra.run.smithi045.stdout: -1674> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000001fd [2,head] /dc-dir/dc-file_8 auth v2106 s=1 n(v0 rc2023-10-03T19:13:34.587719+0000 b1 1=1+0) (iversion lock) 0x55cf61ff0680] 2023-10-03T19:20:56.095 INFO:teuthology.orchestra.run.smithi045.stdout: -1673> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_8 [2,head] auth (dversion lock) v=2106 ino=0x100000001fd state=1073741824 0x55cf61fdb680] [inode 0x100000001fd [2,head] /dc-dir/dc-file_8 auth v2106 s=1 n(v0 rc2023-10-03T19:13:34.587719+0000 b1 1=1+0) (iversion lock) 0x55cf61ff0680] 2023-10-03T19:20:56.095 INFO:teuthology.orchestra.run.smithi045.stdout: -1672> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000001fd [2,head] #100000001fd auth v2106 s=1 n(v0 rc2023-10-03T19:13:34.587719+0000 b1 1=1+0) (iversion lock) 0x55cf61ff0680] 2023-10-03T19:20:56.095 INFO:teuthology.orchestra.run.smithi045.stdout: -1671> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_8 [2,head] auth NULL (dversion lock) v=2106 ino=(nil) state=1073741824 0x55cf61fdb680] 2023-10-03T19:20:56.095 INFO:teuthology.orchestra.run.smithi045.stdout: -1670> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_7 [2,head] auth (dversion lock) v=2104 ino=0x100000001fc state=1073741824 0x55cf61fdb400] 2023-10-03T19:20:56.095 INFO:teuthology.orchestra.run.smithi045.stdout: -1669> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.095 INFO:teuthology.orchestra.run.smithi045.stdout: -1668> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000001fc [2,head] /dc-dir/dc-file_7 auth v2104 s=1 n(v0 rc2023-10-03T19:13:34.577693+0000 b1 1=1+0) (iversion lock) 0x55cf61ff0100] 2023-10-03T19:20:56.095 INFO:teuthology.orchestra.run.smithi045.stdout: -1667> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_7 [2,head] auth (dversion lock) v=2104 ino=0x100000001fc state=1073741824 0x55cf61fdb400] [inode 0x100000001fc [2,head] /dc-dir/dc-file_7 auth v2104 s=1 n(v0 rc2023-10-03T19:13:34.577693+0000 b1 1=1+0) (iversion lock) 0x55cf61ff0100] 2023-10-03T19:20:56.095 INFO:teuthology.orchestra.run.smithi045.stdout: -1666> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000001fc [2,head] #100000001fc auth v2104 s=1 n(v0 rc2023-10-03T19:13:34.577693+0000 b1 1=1+0) (iversion lock) 0x55cf61ff0100] 2023-10-03T19:20:56.096 INFO:teuthology.orchestra.run.smithi045.stdout: -1665> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_7 [2,head] auth NULL (dversion lock) v=2104 ino=(nil) state=1073741824 0x55cf61fdb400] 2023-10-03T19:20:56.096 INFO:teuthology.orchestra.run.smithi045.stdout: -1664> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_6 [2,head] auth (dversion lock) v=2102 ino=0x100000001fb state=1073741824 0x55cf61fdb180] 2023-10-03T19:20:56.096 INFO:teuthology.orchestra.run.smithi045.stdout: -1663> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.096 INFO:teuthology.orchestra.run.smithi045.stdout: -1662> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000001fb [2,head] /dc-dir/dc-file_6 auth v2102 s=1 n(v0 rc2023-10-03T19:13:34.567410+0000 b1 1=1+0) (iversion lock) 0x55cf61fefb80] 2023-10-03T19:20:56.096 INFO:teuthology.orchestra.run.smithi045.stdout: -1661> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_6 [2,head] auth (dversion lock) v=2102 ino=0x100000001fb state=1073741824 0x55cf61fdb180] [inode 0x100000001fb [2,head] /dc-dir/dc-file_6 auth v2102 s=1 n(v0 rc2023-10-03T19:13:34.567410+0000 b1 1=1+0) (iversion lock) 0x55cf61fefb80] 2023-10-03T19:20:56.096 INFO:teuthology.orchestra.run.smithi045.stdout: -1660> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000001fb [2,head] #100000001fb auth v2102 s=1 n(v0 rc2023-10-03T19:13:34.567410+0000 b1 1=1+0) (iversion lock) 0x55cf61fefb80] 2023-10-03T19:20:56.096 INFO:teuthology.orchestra.run.smithi045.stdout: -1659> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_6 [2,head] auth NULL (dversion lock) v=2102 ino=(nil) state=1073741824 0x55cf61fdb180] 2023-10-03T19:20:56.096 INFO:teuthology.orchestra.run.smithi045.stdout: -1658> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_5 [2,head] auth (dversion lock) v=2100 ino=0x100000001fa state=1073741824 0x55cf61fdaf00] 2023-10-03T19:20:56.096 INFO:teuthology.orchestra.run.smithi045.stdout: -1657> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.096 INFO:teuthology.orchestra.run.smithi045.stdout: -1656> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000001fa [2,head] /dc-dir/dc-file_5 auth v2100 s=1 n(v0 rc2023-10-03T19:13:34.557444+0000 b1 1=1+0) (iversion lock) 0x55cf61fef600] 2023-10-03T19:20:56.096 INFO:teuthology.orchestra.run.smithi045.stdout: -1655> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_5 [2,head] auth (dversion lock) v=2100 ino=0x100000001fa state=1073741824 0x55cf61fdaf00] [inode 0x100000001fa [2,head] /dc-dir/dc-file_5 auth v2100 s=1 n(v0 rc2023-10-03T19:13:34.557444+0000 b1 1=1+0) (iversion lock) 0x55cf61fef600] 2023-10-03T19:20:56.097 INFO:teuthology.orchestra.run.smithi045.stdout: -1654> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000001fa [2,head] #100000001fa auth v2100 s=1 n(v0 rc2023-10-03T19:13:34.557444+0000 b1 1=1+0) (iversion lock) 0x55cf61fef600] 2023-10-03T19:20:56.097 INFO:teuthology.orchestra.run.smithi045.stdout: -1653> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_5 [2,head] auth NULL (dversion lock) v=2100 ino=(nil) state=1073741824 0x55cf61fdaf00] 2023-10-03T19:20:56.097 INFO:teuthology.orchestra.run.smithi045.stdout: -1652> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_4 [2,head] auth (dversion lock) v=2098 ino=0x100000001f9 state=1073741824 0x55cf61fdac80] 2023-10-03T19:20:56.097 INFO:teuthology.orchestra.run.smithi045.stdout: -1651> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.097 INFO:teuthology.orchestra.run.smithi045.stdout: -1650> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000001f9 [2,head] /dc-dir/dc-file_4 auth v2098 s=1 n(v0 rc2023-10-03T19:13:34.547699+0000 b1 1=1+0) (iversion lock) 0x55cf61fef080] 2023-10-03T19:20:56.097 INFO:teuthology.orchestra.run.smithi045.stdout: -1649> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_4 [2,head] auth (dversion lock) v=2098 ino=0x100000001f9 state=1073741824 0x55cf61fdac80] [inode 0x100000001f9 [2,head] /dc-dir/dc-file_4 auth v2098 s=1 n(v0 rc2023-10-03T19:13:34.547699+0000 b1 1=1+0) (iversion lock) 0x55cf61fef080] 2023-10-03T19:20:56.097 INFO:teuthology.orchestra.run.smithi045.stdout: -1648> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000001f9 [2,head] #100000001f9 auth v2098 s=1 n(v0 rc2023-10-03T19:13:34.547699+0000 b1 1=1+0) (iversion lock) 0x55cf61fef080] 2023-10-03T19:20:56.097 INFO:teuthology.orchestra.run.smithi045.stdout: -1647> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_4 [2,head] auth NULL (dversion lock) v=2098 ino=(nil) state=1073741824 0x55cf61fdac80] 2023-10-03T19:20:56.097 INFO:teuthology.orchestra.run.smithi045.stdout: -1646> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_3 [2,head] auth (dversion lock) v=2096 ino=0x100000001f8 state=1073741824 0x55cf61fdaa00] 2023-10-03T19:20:56.097 INFO:teuthology.orchestra.run.smithi045.stdout: -1645> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.097 INFO:teuthology.orchestra.run.smithi045.stdout: -1644> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000001f8 [2,head] /dc-dir/dc-file_3 auth v2096 s=1 n(v0 rc2023-10-03T19:13:34.538714+0000 b1 1=1+0) (iversion lock) 0x55cf61feeb00] 2023-10-03T19:20:56.097 INFO:teuthology.orchestra.run.smithi045.stdout: -1643> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_3 [2,head] auth (dversion lock) v=2096 ino=0x100000001f8 state=1073741824 0x55cf61fdaa00] [inode 0x100000001f8 [2,head] /dc-dir/dc-file_3 auth v2096 s=1 n(v0 rc2023-10-03T19:13:34.538714+0000 b1 1=1+0) (iversion lock) 0x55cf61feeb00] 2023-10-03T19:20:56.098 INFO:teuthology.orchestra.run.smithi045.stdout: -1642> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000001f8 [2,head] #100000001f8 auth v2096 s=1 n(v0 rc2023-10-03T19:13:34.538714+0000 b1 1=1+0) (iversion lock) 0x55cf61feeb00] 2023-10-03T19:20:56.098 INFO:teuthology.orchestra.run.smithi045.stdout: -1641> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_3 [2,head] auth NULL (dversion lock) v=2096 ino=(nil) state=1073741824 0x55cf61fdaa00] 2023-10-03T19:20:56.098 INFO:teuthology.orchestra.run.smithi045.stdout: -1640> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_2 [2,head] auth (dversion lock) v=2094 ino=0x100000001f7 state=1073741824 0x55cf61fda780] 2023-10-03T19:20:56.098 INFO:teuthology.orchestra.run.smithi045.stdout: -1639> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.098 INFO:teuthology.orchestra.run.smithi045.stdout: -1638> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000001f7 [2,head] /dc-dir/dc-file_2 auth v2094 s=1 n(v0 rc2023-10-03T19:13:34.529172+0000 b1 1=1+0) (iversion lock) 0x55cf61fee580] 2023-10-03T19:20:56.098 INFO:teuthology.orchestra.run.smithi045.stdout: -1637> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_2 [2,head] auth (dversion lock) v=2094 ino=0x100000001f7 state=1073741824 0x55cf61fda780] [inode 0x100000001f7 [2,head] /dc-dir/dc-file_2 auth v2094 s=1 n(v0 rc2023-10-03T19:13:34.529172+0000 b1 1=1+0) (iversion lock) 0x55cf61fee580] 2023-10-03T19:20:56.098 INFO:teuthology.orchestra.run.smithi045.stdout: -1636> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000001f7 [2,head] #100000001f7 auth v2094 s=1 n(v0 rc2023-10-03T19:13:34.529172+0000 b1 1=1+0) (iversion lock) 0x55cf61fee580] 2023-10-03T19:20:56.098 INFO:teuthology.orchestra.run.smithi045.stdout: -1635> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_2 [2,head] auth NULL (dversion lock) v=2094 ino=(nil) state=1073741824 0x55cf61fda780] 2023-10-03T19:20:56.098 INFO:teuthology.orchestra.run.smithi045.stdout: -1634> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_1 [2,head] auth (dversion lock) v=2092 ino=0x100000001f6 state=1073741824 0x55cf61fda500] 2023-10-03T19:20:56.098 INFO:teuthology.orchestra.run.smithi045.stdout: -1633> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.098 INFO:teuthology.orchestra.run.smithi045.stdout: -1632> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x100000001f6 [2,head] /dc-dir/dc-file_1 auth v2092 s=1 n(v0 rc2023-10-03T19:13:34.520024+0000 b1 1=1+0) (iversion lock) 0x55cf61fee000] 2023-10-03T19:20:56.099 INFO:teuthology.orchestra.run.smithi045.stdout: -1631> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_1 [2,head] auth (dversion lock) v=2092 ino=0x100000001f6 state=1073741824 0x55cf61fda500] [inode 0x100000001f6 [2,head] /dc-dir/dc-file_1 auth v2092 s=1 n(v0 rc2023-10-03T19:13:34.520024+0000 b1 1=1+0) (iversion lock) 0x55cf61fee000] 2023-10-03T19:20:56.209 INFO:teuthology.orchestra.run.smithi045.stdout: -1630> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x100000001f6 [2,head] #100000001f6 auth v2092 s=1 n(v0 rc2023-10-03T19:13:34.520024+0000 b1 1=1+0) (iversion lock) 0x55cf61fee000] 2023-10-03T19:20:56.209 INFO:teuthology.orchestra.run.smithi045.stdout: -1629> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_1 [2,head] auth NULL (dversion lock) v=2092 ino=(nil) state=1073741824 0x55cf61fda500] 2023-10-03T19:20:56.209 INFO:teuthology.orchestra.run.smithi045.stdout: -1628> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_0 [2,head] auth (dversion lock) v=2090 ino=0x10000000001 state=1073741824 0x55cf61fda280] 2023-10-03T19:20:56.209 INFO:teuthology.orchestra.run.smithi045.stdout: -1627> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.209 INFO:teuthology.orchestra.run.smithi045.stdout: -1626> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000001 [2,head] /dc-dir/dc-file_0 auth v2090 s=1 n(v0 rc2023-10-03T19:13:34.511237+0000 b1 1=1+0) (iversion lock) 0x55cf61f45700] 2023-10-03T19:20:56.209 INFO:teuthology.orchestra.run.smithi045.stdout: -1625> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_0 [2,head] auth (dversion lock) v=2090 ino=0x10000000001 state=1073741824 0x55cf61fda280] [inode 0x10000000001 [2,head] /dc-dir/dc-file_0 auth v2090 s=1 n(v0 rc2023-10-03T19:13:34.511237+0000 b1 1=1+0) (iversion lock) 0x55cf61f45700] 2023-10-03T19:20:56.209 INFO:teuthology.orchestra.run.smithi045.stdout: -1624> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000001 [2,head] #10000000001 auth v2090 s=1 n(v0 rc2023-10-03T19:13:34.511237+0000 b1 1=1+0) (iversion lock) 0x55cf61f45700] 2023-10-03T19:20:56.210 INFO:teuthology.orchestra.run.smithi045.stdout: -1623> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_0 [2,head] auth NULL (dversion lock) v=2090 ino=(nil) state=1073741824 0x55cf61fda280] 2023-10-03T19:20:56.210 INFO:teuthology.orchestra.run.smithi045.stdout: -1622> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_850 [2,head] auth (dversion lock) v=5702 ino=0x10000000547 state=1073741824 0x55cf62507b80] 2023-10-03T19:20:56.210 INFO:teuthology.orchestra.run.smithi045.stdout: -1621> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.210 INFO:teuthology.orchestra.run.smithi045.stdout: -1620> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000547 [2,head] /dc-dir/dc-file_850 auth v5702 s=3 n(v0 rc2023-10-03T19:13:44.916353+0000 b3 1=1+0) (iversion lock) 0x55cf6250cb00] 2023-10-03T19:20:56.210 INFO:teuthology.orchestra.run.smithi045.stdout: -1619> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_850 [2,head] auth (dversion lock) v=5702 ino=0x10000000547 state=1073741824 0x55cf62507b80] [inode 0x10000000547 [2,head] /dc-dir/dc-file_850 auth v5702 s=3 n(v0 rc2023-10-03T19:13:44.916353+0000 b3 1=1+0) (iversion lock) 0x55cf6250cb00] 2023-10-03T19:20:56.210 INFO:teuthology.orchestra.run.smithi045.stdout: -1618> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000547 [2,head] #10000000547 auth v5702 s=3 n(v0 rc2023-10-03T19:13:44.916353+0000 b3 1=1+0) (iversion lock) 0x55cf6250cb00] 2023-10-03T19:20:56.210 INFO:teuthology.orchestra.run.smithi045.stdout: -1617> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_850 [2,head] auth NULL (dversion lock) v=5702 ino=(nil) state=1073741824 0x55cf62507b80] 2023-10-03T19:20:56.210 INFO:teuthology.orchestra.run.smithi045.stdout: -1616> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_849 [2,head] auth (dversion lock) v=5700 ino=0x10000000546 state=1073741824 0x55cf62507900] 2023-10-03T19:20:56.211 INFO:teuthology.orchestra.run.smithi045.stdout: -1615> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.211 INFO:teuthology.orchestra.run.smithi045.stdout: -1614> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000546 [2,head] /dc-dir/dc-file_849 auth v5700 s=3 n(v0 rc2023-10-03T19:13:44.904896+0000 b3 1=1+0) (iversion lock) 0x55cf6250c580] 2023-10-03T19:20:56.211 INFO:teuthology.orchestra.run.smithi045.stdout: -1613> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_849 [2,head] auth (dversion lock) v=5700 ino=0x10000000546 state=1073741824 0x55cf62507900] [inode 0x10000000546 [2,head] /dc-dir/dc-file_849 auth v5700 s=3 n(v0 rc2023-10-03T19:13:44.904896+0000 b3 1=1+0) (iversion lock) 0x55cf6250c580] 2023-10-03T19:20:56.211 INFO:teuthology.orchestra.run.smithi045.stdout: -1612> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000546 [2,head] #10000000546 auth v5700 s=3 n(v0 rc2023-10-03T19:13:44.904896+0000 b3 1=1+0) (iversion lock) 0x55cf6250c580] 2023-10-03T19:20:56.211 INFO:teuthology.orchestra.run.smithi045.stdout: -1611> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_849 [2,head] auth NULL (dversion lock) v=5700 ino=(nil) state=1073741824 0x55cf62507900] 2023-10-03T19:20:56.211 INFO:teuthology.orchestra.run.smithi045.stdout: -1610> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_848 [2,head] auth (dversion lock) v=5698 ino=0x10000000545 state=1073741824 0x55cf62507680] 2023-10-03T19:20:56.211 INFO:teuthology.orchestra.run.smithi045.stdout: -1609> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.211 INFO:teuthology.orchestra.run.smithi045.stdout: -1608> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000545 [2,head] /dc-dir/dc-file_848 auth v5698 s=3 n(v0 rc2023-10-03T19:13:44.893454+0000 b3 1=1+0) (iversion lock) 0x55cf6250c000] 2023-10-03T19:20:56.211 INFO:teuthology.orchestra.run.smithi045.stdout: -1607> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_848 [2,head] auth (dversion lock) v=5698 ino=0x10000000545 state=1073741824 0x55cf62507680] [inode 0x10000000545 [2,head] /dc-dir/dc-file_848 auth v5698 s=3 n(v0 rc2023-10-03T19:13:44.893454+0000 b3 1=1+0) (iversion lock) 0x55cf6250c000] 2023-10-03T19:20:56.211 INFO:teuthology.orchestra.run.smithi045.stdout: -1606> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000545 [2,head] #10000000545 auth v5698 s=3 n(v0 rc2023-10-03T19:13:44.893454+0000 b3 1=1+0) (iversion lock) 0x55cf6250c000] 2023-10-03T19:20:56.211 INFO:teuthology.orchestra.run.smithi045.stdout: -1605> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_848 [2,head] auth NULL (dversion lock) v=5698 ino=(nil) state=1073741824 0x55cf62507680] 2023-10-03T19:20:56.212 INFO:teuthology.orchestra.run.smithi045.stdout: -1604> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_847 [2,head] auth (dversion lock) v=5696 ino=0x10000000544 state=1073741824 0x55cf62507400] 2023-10-03T19:20:56.212 INFO:teuthology.orchestra.run.smithi045.stdout: -1603> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.212 INFO:teuthology.orchestra.run.smithi045.stdout: -1602> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000544 [2,head] /dc-dir/dc-file_847 auth v5696 s=3 n(v0 rc2023-10-03T19:13:44.881244+0000 b3 1=1+0) (iversion lock) 0x55cf62505700] 2023-10-03T19:20:56.212 INFO:teuthology.orchestra.run.smithi045.stdout: -1601> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_847 [2,head] auth (dversion lock) v=5696 ino=0x10000000544 state=1073741824 0x55cf62507400] [inode 0x10000000544 [2,head] /dc-dir/dc-file_847 auth v5696 s=3 n(v0 rc2023-10-03T19:13:44.881244+0000 b3 1=1+0) (iversion lock) 0x55cf62505700] 2023-10-03T19:20:56.212 INFO:teuthology.orchestra.run.smithi045.stdout: -1600> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000544 [2,head] #10000000544 auth v5696 s=3 n(v0 rc2023-10-03T19:13:44.881244+0000 b3 1=1+0) (iversion lock) 0x55cf62505700] 2023-10-03T19:20:56.212 INFO:teuthology.orchestra.run.smithi045.stdout: -1599> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_847 [2,head] auth NULL (dversion lock) v=5696 ino=(nil) state=1073741824 0x55cf62507400] 2023-10-03T19:20:56.212 INFO:teuthology.orchestra.run.smithi045.stdout: -1598> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_846 [2,head] auth (dversion lock) v=5694 ino=0x10000000543 state=1073741824 0x55cf62507180] 2023-10-03T19:20:56.212 INFO:teuthology.orchestra.run.smithi045.stdout: -1597> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.212 INFO:teuthology.orchestra.run.smithi045.stdout: -1596> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000543 [2,head] /dc-dir/dc-file_846 auth v5694 s=3 n(v0 rc2023-10-03T19:13:44.868391+0000 b3 1=1+0) (iversion lock) 0x55cf62505180] 2023-10-03T19:20:56.212 INFO:teuthology.orchestra.run.smithi045.stdout: -1595> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_846 [2,head] auth (dversion lock) v=5694 ino=0x10000000543 state=1073741824 0x55cf62507180] [inode 0x10000000543 [2,head] /dc-dir/dc-file_846 auth v5694 s=3 n(v0 rc2023-10-03T19:13:44.868391+0000 b3 1=1+0) (iversion lock) 0x55cf62505180] 2023-10-03T19:20:56.212 INFO:teuthology.orchestra.run.smithi045.stdout: -1594> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000543 [2,head] #10000000543 auth v5694 s=3 n(v0 rc2023-10-03T19:13:44.868391+0000 b3 1=1+0) (iversion lock) 0x55cf62505180] 2023-10-03T19:20:56.213 INFO:teuthology.orchestra.run.smithi045.stdout: -1593> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_846 [2,head] auth NULL (dversion lock) v=5694 ino=(nil) state=1073741824 0x55cf62507180] 2023-10-03T19:20:56.213 INFO:teuthology.orchestra.run.smithi045.stdout: -1592> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_845 [2,head] auth (dversion lock) v=5692 ino=0x10000000542 state=1073741824 0x55cf62506f00] 2023-10-03T19:20:56.213 INFO:teuthology.orchestra.run.smithi045.stdout: -1591> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.213 INFO:teuthology.orchestra.run.smithi045.stdout: -1590> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000542 [2,head] /dc-dir/dc-file_845 auth v5692 s=3 n(v0 rc2023-10-03T19:13:44.854822+0000 b3 1=1+0) (iversion lock) 0x55cf62504c00] 2023-10-03T19:20:56.213 INFO:teuthology.orchestra.run.smithi045.stdout: -1589> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_845 [2,head] auth (dversion lock) v=5692 ino=0x10000000542 state=1073741824 0x55cf62506f00] [inode 0x10000000542 [2,head] /dc-dir/dc-file_845 auth v5692 s=3 n(v0 rc2023-10-03T19:13:44.854822+0000 b3 1=1+0) (iversion lock) 0x55cf62504c00] 2023-10-03T19:20:56.213 INFO:teuthology.orchestra.run.smithi045.stdout: -1588> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000542 [2,head] #10000000542 auth v5692 s=3 n(v0 rc2023-10-03T19:13:44.854822+0000 b3 1=1+0) (iversion lock) 0x55cf62504c00] 2023-10-03T19:20:56.213 INFO:teuthology.orchestra.run.smithi045.stdout: -1587> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_845 [2,head] auth NULL (dversion lock) v=5692 ino=(nil) state=1073741824 0x55cf62506f00] 2023-10-03T19:20:56.213 INFO:teuthology.orchestra.run.smithi045.stdout: -1586> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_844 [2,head] auth (dversion lock) v=5690 ino=0x10000000541 state=1073741824 0x55cf62506c80] 2023-10-03T19:20:56.213 INFO:teuthology.orchestra.run.smithi045.stdout: -1585> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.213 INFO:teuthology.orchestra.run.smithi045.stdout: -1584> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000541 [2,head] /dc-dir/dc-file_844 auth v5690 s=3 n(v0 rc2023-10-03T19:13:44.840935+0000 b3 1=1+0) (iversion lock) 0x55cf62504680] 2023-10-03T19:20:56.213 INFO:teuthology.orchestra.run.smithi045.stdout: -1583> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_844 [2,head] auth (dversion lock) v=5690 ino=0x10000000541 state=1073741824 0x55cf62506c80] [inode 0x10000000541 [2,head] /dc-dir/dc-file_844 auth v5690 s=3 n(v0 rc2023-10-03T19:13:44.840935+0000 b3 1=1+0) (iversion lock) 0x55cf62504680] 2023-10-03T19:20:56.214 INFO:teuthology.orchestra.run.smithi045.stdout: -1582> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000541 [2,head] #10000000541 auth v5690 s=3 n(v0 rc2023-10-03T19:13:44.840935+0000 b3 1=1+0) (iversion lock) 0x55cf62504680] 2023-10-03T19:20:56.214 INFO:teuthology.orchestra.run.smithi045.stdout: -1581> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_844 [2,head] auth NULL (dversion lock) v=5690 ino=(nil) state=1073741824 0x55cf62506c80] 2023-10-03T19:20:56.214 INFO:teuthology.orchestra.run.smithi045.stdout: -1580> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_843 [2,head] auth (dversion lock) v=5688 ino=0x10000000540 state=1073741824 0x55cf62506a00] 2023-10-03T19:20:56.214 INFO:teuthology.orchestra.run.smithi045.stdout: -1579> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.214 INFO:teuthology.orchestra.run.smithi045.stdout: -1578> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000540 [2,head] /dc-dir/dc-file_843 auth v5688 s=3 n(v0 rc2023-10-03T19:13:44.827078+0000 b3 1=1+0) (iversion lock) 0x55cf62504100] 2023-10-03T19:20:56.214 INFO:teuthology.orchestra.run.smithi045.stdout: -1577> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_843 [2,head] auth (dversion lock) v=5688 ino=0x10000000540 state=1073741824 0x55cf62506a00] [inode 0x10000000540 [2,head] /dc-dir/dc-file_843 auth v5688 s=3 n(v0 rc2023-10-03T19:13:44.827078+0000 b3 1=1+0) (iversion lock) 0x55cf62504100] 2023-10-03T19:20:56.214 INFO:teuthology.orchestra.run.smithi045.stdout: -1576> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000540 [2,head] #10000000540 auth v5688 s=3 n(v0 rc2023-10-03T19:13:44.827078+0000 b3 1=1+0) (iversion lock) 0x55cf62504100] 2023-10-03T19:20:56.214 INFO:teuthology.orchestra.run.smithi045.stdout: -1575> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_843 [2,head] auth NULL (dversion lock) v=5688 ino=(nil) state=1073741824 0x55cf62506a00] 2023-10-03T19:20:56.214 INFO:teuthology.orchestra.run.smithi045.stdout: -1574> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_842 [2,head] auth (dversion lock) v=5686 ino=0x1000000053f state=1073741824 0x55cf62506780] 2023-10-03T19:20:56.214 INFO:teuthology.orchestra.run.smithi045.stdout: -1573> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.214 INFO:teuthology.orchestra.run.smithi045.stdout: -1572> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000053f [2,head] /dc-dir/dc-file_842 auth v5686 s=3 n(v0 rc2023-10-03T19:13:44.813430+0000 b3 1=1+0) (iversion lock) 0x55cf62503b80] 2023-10-03T19:20:56.215 INFO:teuthology.orchestra.run.smithi045.stdout: -1571> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_842 [2,head] auth (dversion lock) v=5686 ino=0x1000000053f state=1073741824 0x55cf62506780] [inode 0x1000000053f [2,head] /dc-dir/dc-file_842 auth v5686 s=3 n(v0 rc2023-10-03T19:13:44.813430+0000 b3 1=1+0) (iversion lock) 0x55cf62503b80] 2023-10-03T19:20:56.215 INFO:teuthology.orchestra.run.smithi045.stdout: -1570> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000053f [2,head] #1000000053f auth v5686 s=3 n(v0 rc2023-10-03T19:13:44.813430+0000 b3 1=1+0) (iversion lock) 0x55cf62503b80] 2023-10-03T19:20:56.215 INFO:teuthology.orchestra.run.smithi045.stdout: -1569> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_842 [2,head] auth NULL (dversion lock) v=5686 ino=(nil) state=1073741824 0x55cf62506780] 2023-10-03T19:20:56.215 INFO:teuthology.orchestra.run.smithi045.stdout: -1568> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_841 [2,head] auth (dversion lock) v=5684 ino=0x1000000053e state=1073741824 0x55cf62506500] 2023-10-03T19:20:56.215 INFO:teuthology.orchestra.run.smithi045.stdout: -1567> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.215 INFO:teuthology.orchestra.run.smithi045.stdout: -1566> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000053e [2,head] /dc-dir/dc-file_841 auth v5684 s=3 n(v0 rc2023-10-03T19:13:44.800542+0000 b3 1=1+0) (iversion lock) 0x55cf62503600] 2023-10-03T19:20:56.215 INFO:teuthology.orchestra.run.smithi045.stdout: -1565> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_841 [2,head] auth (dversion lock) v=5684 ino=0x1000000053e state=1073741824 0x55cf62506500] [inode 0x1000000053e [2,head] /dc-dir/dc-file_841 auth v5684 s=3 n(v0 rc2023-10-03T19:13:44.800542+0000 b3 1=1+0) (iversion lock) 0x55cf62503600] 2023-10-03T19:20:56.215 INFO:teuthology.orchestra.run.smithi045.stdout: -1564> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000053e [2,head] #1000000053e auth v5684 s=3 n(v0 rc2023-10-03T19:13:44.800542+0000 b3 1=1+0) (iversion lock) 0x55cf62503600] 2023-10-03T19:20:56.215 INFO:teuthology.orchestra.run.smithi045.stdout: -1563> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_841 [2,head] auth NULL (dversion lock) v=5684 ino=(nil) state=1073741824 0x55cf62506500] 2023-10-03T19:20:56.215 INFO:teuthology.orchestra.run.smithi045.stdout: -1562> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_840 [2,head] auth (dversion lock) v=5682 ino=0x1000000053d state=1073741824 0x55cf62506280] 2023-10-03T19:20:56.215 INFO:teuthology.orchestra.run.smithi045.stdout: -1561> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.216 INFO:teuthology.orchestra.run.smithi045.stdout: -1560> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000053d [2,head] /dc-dir/dc-file_840 auth v5682 s=3 n(v0 rc2023-10-03T19:13:44.787173+0000 b3 1=1+0) (iversion lock) 0x55cf62503080] 2023-10-03T19:20:56.216 INFO:teuthology.orchestra.run.smithi045.stdout: -1559> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_840 [2,head] auth (dversion lock) v=5682 ino=0x1000000053d state=1073741824 0x55cf62506280] [inode 0x1000000053d [2,head] /dc-dir/dc-file_840 auth v5682 s=3 n(v0 rc2023-10-03T19:13:44.787173+0000 b3 1=1+0) (iversion lock) 0x55cf62503080] 2023-10-03T19:20:56.216 INFO:teuthology.orchestra.run.smithi045.stdout: -1558> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000053d [2,head] #1000000053d auth v5682 s=3 n(v0 rc2023-10-03T19:13:44.787173+0000 b3 1=1+0) (iversion lock) 0x55cf62503080] 2023-10-03T19:20:56.229 INFO:teuthology.orchestra.run.smithi045.stdout: -1557> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_840 [2,head] auth NULL (dversion lock) v=5682 ino=(nil) state=1073741824 0x55cf62506280] 2023-10-03T19:20:56.229 INFO:teuthology.orchestra.run.smithi045.stdout: -1556> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_839 [2,head] auth (dversion lock) v=5680 ino=0x1000000053c state=1073741824 0x55cf62506000] 2023-10-03T19:20:56.230 INFO:teuthology.orchestra.run.smithi045.stdout: -1555> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.230 INFO:teuthology.orchestra.run.smithi045.stdout: -1554> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000053c [2,head] /dc-dir/dc-file_839 auth v5680 s=3 n(v0 rc2023-10-03T19:13:44.775216+0000 b3 1=1+0) (iversion lock) 0x55cf62502b00] 2023-10-03T19:20:56.230 INFO:teuthology.orchestra.run.smithi045.stdout: -1553> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_839 [2,head] auth (dversion lock) v=5680 ino=0x1000000053c state=1073741824 0x55cf62506000] [inode 0x1000000053c [2,head] /dc-dir/dc-file_839 auth v5680 s=3 n(v0 rc2023-10-03T19:13:44.775216+0000 b3 1=1+0) (iversion lock) 0x55cf62502b00] 2023-10-03T19:20:56.230 INFO:teuthology.orchestra.run.smithi045.stdout: -1552> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000053c [2,head] #1000000053c auth v5680 s=3 n(v0 rc2023-10-03T19:13:44.775216+0000 b3 1=1+0) (iversion lock) 0x55cf62502b00] 2023-10-03T19:20:56.230 INFO:teuthology.orchestra.run.smithi045.stdout: -1551> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_839 [2,head] auth NULL (dversion lock) v=5680 ino=(nil) state=1073741824 0x55cf62506000] 2023-10-03T19:20:56.230 INFO:teuthology.orchestra.run.smithi045.stdout: -1550> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_838 [2,head] auth (dversion lock) v=5678 ino=0x1000000053b state=1073741824 0x55cf624ffb80] 2023-10-03T19:20:56.230 INFO:teuthology.orchestra.run.smithi045.stdout: -1549> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.230 INFO:teuthology.orchestra.run.smithi045.stdout: -1548> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000053b [2,head] /dc-dir/dc-file_838 auth v5678 s=3 n(v0 rc2023-10-03T19:13:44.761801+0000 b3 1=1+0) (iversion lock) 0x55cf62502580] 2023-10-03T19:20:56.230 INFO:teuthology.orchestra.run.smithi045.stdout: -1547> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_838 [2,head] auth (dversion lock) v=5678 ino=0x1000000053b state=1073741824 0x55cf624ffb80] [inode 0x1000000053b [2,head] /dc-dir/dc-file_838 auth v5678 s=3 n(v0 rc2023-10-03T19:13:44.761801+0000 b3 1=1+0) (iversion lock) 0x55cf62502580] 2023-10-03T19:20:56.230 INFO:teuthology.orchestra.run.smithi045.stdout: -1546> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000053b [2,head] #1000000053b auth v5678 s=3 n(v0 rc2023-10-03T19:13:44.761801+0000 b3 1=1+0) (iversion lock) 0x55cf62502580] 2023-10-03T19:20:56.231 INFO:teuthology.orchestra.run.smithi045.stdout: -1545> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_838 [2,head] auth NULL (dversion lock) v=5678 ino=(nil) state=1073741824 0x55cf624ffb80] 2023-10-03T19:20:56.231 INFO:teuthology.orchestra.run.smithi045.stdout: -1544> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_837 [2,head] auth (dversion lock) v=5676 ino=0x1000000053a state=1073741824 0x55cf624ff900] 2023-10-03T19:20:56.231 INFO:teuthology.orchestra.run.smithi045.stdout: -1543> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.231 INFO:teuthology.orchestra.run.smithi045.stdout: -1542> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x1000000053a [2,head] /dc-dir/dc-file_837 auth v5676 s=3 n(v0 rc2023-10-03T19:13:44.749491+0000 b3 1=1+0) (iversion lock) 0x55cf62502000] 2023-10-03T19:20:56.231 INFO:teuthology.orchestra.run.smithi045.stdout: -1541> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_837 [2,head] auth (dversion lock) v=5676 ino=0x1000000053a state=1073741824 0x55cf624ff900] [inode 0x1000000053a [2,head] /dc-dir/dc-file_837 auth v5676 s=3 n(v0 rc2023-10-03T19:13:44.749491+0000 b3 1=1+0) (iversion lock) 0x55cf62502000] 2023-10-03T19:20:56.231 INFO:teuthology.orchestra.run.smithi045.stdout: -1540> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x1000000053a [2,head] #1000000053a auth v5676 s=3 n(v0 rc2023-10-03T19:13:44.749491+0000 b3 1=1+0) (iversion lock) 0x55cf62502000] 2023-10-03T19:20:56.231 INFO:teuthology.orchestra.run.smithi045.stdout: -1539> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_837 [2,head] auth NULL (dversion lock) v=5676 ino=(nil) state=1073741824 0x55cf624ff900] 2023-10-03T19:20:56.231 INFO:teuthology.orchestra.run.smithi045.stdout: -1538> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_836 [2,head] auth (dversion lock) v=5674 ino=0x10000000539 state=1073741824 0x55cf624ff680] 2023-10-03T19:20:56.231 INFO:teuthology.orchestra.run.smithi045.stdout: -1537> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.231 INFO:teuthology.orchestra.run.smithi045.stdout: -1536> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000539 [2,head] /dc-dir/dc-file_836 auth v5674 s=3 n(v0 rc2023-10-03T19:13:44.737999+0000 b3 1=1+0) (iversion lock) 0x55cf6225f700] 2023-10-03T19:20:56.231 INFO:teuthology.orchestra.run.smithi045.stdout: -1535> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_836 [2,head] auth (dversion lock) v=5674 ino=0x10000000539 state=1073741824 0x55cf624ff680] [inode 0x10000000539 [2,head] /dc-dir/dc-file_836 auth v5674 s=3 n(v0 rc2023-10-03T19:13:44.737999+0000 b3 1=1+0) (iversion lock) 0x55cf6225f700] 2023-10-03T19:20:56.232 INFO:teuthology.orchestra.run.smithi045.stdout: -1534> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000539 [2,head] #10000000539 auth v5674 s=3 n(v0 rc2023-10-03T19:13:44.737999+0000 b3 1=1+0) (iversion lock) 0x55cf6225f700] 2023-10-03T19:20:56.232 INFO:teuthology.orchestra.run.smithi045.stdout: -1533> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_836 [2,head] auth NULL (dversion lock) v=5674 ino=(nil) state=1073741824 0x55cf624ff680] 2023-10-03T19:20:56.232 INFO:teuthology.orchestra.run.smithi045.stdout: -1532> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_835 [2,head] auth (dversion lock) v=5672 ino=0x10000000538 state=1073741824 0x55cf624ff400] 2023-10-03T19:20:56.232 INFO:teuthology.orchestra.run.smithi045.stdout: -1531> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.232 INFO:teuthology.orchestra.run.smithi045.stdout: -1530> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000538 [2,head] /dc-dir/dc-file_835 auth v5672 s=3 n(v0 rc2023-10-03T19:13:44.726430+0000 b3 1=1+0) (iversion lock) 0x55cf6225f180] 2023-10-03T19:20:56.232 INFO:teuthology.orchestra.run.smithi045.stdout: -1529> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_835 [2,head] auth (dversion lock) v=5672 ino=0x10000000538 state=1073741824 0x55cf624ff400] [inode 0x10000000538 [2,head] /dc-dir/dc-file_835 auth v5672 s=3 n(v0 rc2023-10-03T19:13:44.726430+0000 b3 1=1+0) (iversion lock) 0x55cf6225f180] 2023-10-03T19:20:56.232 INFO:teuthology.orchestra.run.smithi045.stdout: -1528> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000538 [2,head] #10000000538 auth v5672 s=3 n(v0 rc2023-10-03T19:13:44.726430+0000 b3 1=1+0) (iversion lock) 0x55cf6225f180] 2023-10-03T19:20:56.232 INFO:teuthology.orchestra.run.smithi045.stdout: -1527> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_835 [2,head] auth NULL (dversion lock) v=5672 ino=(nil) state=1073741824 0x55cf624ff400] 2023-10-03T19:20:56.232 INFO:teuthology.orchestra.run.smithi045.stdout: -1526> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_834 [2,head] auth (dversion lock) v=5670 ino=0x10000000537 state=1073741824 0x55cf624ff180] 2023-10-03T19:20:56.232 INFO:teuthology.orchestra.run.smithi045.stdout: -1525> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.232 INFO:teuthology.orchestra.run.smithi045.stdout: -1524> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000537 [2,head] /dc-dir/dc-file_834 auth v5670 s=3 n(v0 rc2023-10-03T19:13:44.714485+0000 b3 1=1+0) (iversion lock) 0x55cf6225ec00] 2023-10-03T19:20:56.233 INFO:teuthology.orchestra.run.smithi045.stdout: -1523> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_834 [2,head] auth (dversion lock) v=5670 ino=0x10000000537 state=1073741824 0x55cf624ff180] [inode 0x10000000537 [2,head] /dc-dir/dc-file_834 auth v5670 s=3 n(v0 rc2023-10-03T19:13:44.714485+0000 b3 1=1+0) (iversion lock) 0x55cf6225ec00] 2023-10-03T19:20:56.233 INFO:teuthology.orchestra.run.smithi045.stdout: -1522> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000537 [2,head] #10000000537 auth v5670 s=3 n(v0 rc2023-10-03T19:13:44.714485+0000 b3 1=1+0) (iversion lock) 0x55cf6225ec00] 2023-10-03T19:20:56.233 INFO:teuthology.orchestra.run.smithi045.stdout: -1521> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_834 [2,head] auth NULL (dversion lock) v=5670 ino=(nil) state=1073741824 0x55cf624ff180] 2023-10-03T19:20:56.233 INFO:teuthology.orchestra.run.smithi045.stdout: -1520> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_833 [2,head] auth (dversion lock) v=5668 ino=0x10000000536 state=1073741824 0x55cf624fef00] 2023-10-03T19:20:56.233 INFO:teuthology.orchestra.run.smithi045.stdout: -1519> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.233 INFO:teuthology.orchestra.run.smithi045.stdout: -1518> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000536 [2,head] /dc-dir/dc-file_833 auth v5668 s=3 n(v0 rc2023-10-03T19:13:44.702543+0000 b3 1=1+0) (iversion lock) 0x55cf6225e680] 2023-10-03T19:20:56.233 INFO:teuthology.orchestra.run.smithi045.stdout: -1517> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_833 [2,head] auth (dversion lock) v=5668 ino=0x10000000536 state=1073741824 0x55cf624fef00] [inode 0x10000000536 [2,head] /dc-dir/dc-file_833 auth v5668 s=3 n(v0 rc2023-10-03T19:13:44.702543+0000 b3 1=1+0) (iversion lock) 0x55cf6225e680] 2023-10-03T19:20:56.233 INFO:teuthology.orchestra.run.smithi045.stdout: -1516> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000536 [2,head] #10000000536 auth v5668 s=3 n(v0 rc2023-10-03T19:13:44.702543+0000 b3 1=1+0) (iversion lock) 0x55cf6225e680] 2023-10-03T19:20:56.233 INFO:teuthology.orchestra.run.smithi045.stdout: -1515> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_833 [2,head] auth NULL (dversion lock) v=5668 ino=(nil) state=1073741824 0x55cf624fef00] 2023-10-03T19:20:56.233 INFO:teuthology.orchestra.run.smithi045.stdout: -1514> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_832 [2,head] auth (dversion lock) v=5666 ino=0x10000000535 state=1073741824 0x55cf624fec80] 2023-10-03T19:20:56.233 INFO:teuthology.orchestra.run.smithi045.stdout: -1513> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.233 INFO:teuthology.orchestra.run.smithi045.stdout: -1512> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000535 [2,head] /dc-dir/dc-file_832 auth v5666 s=3 n(v0 rc2023-10-03T19:13:44.690688+0000 b3 1=1+0) (iversion lock) 0x55cf6225e100] 2023-10-03T19:20:56.234 INFO:teuthology.orchestra.run.smithi045.stdout: -1511> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_832 [2,head] auth (dversion lock) v=5666 ino=0x10000000535 state=1073741824 0x55cf624fec80] [inode 0x10000000535 [2,head] /dc-dir/dc-file_832 auth v5666 s=3 n(v0 rc2023-10-03T19:13:44.690688+0000 b3 1=1+0) (iversion lock) 0x55cf6225e100] 2023-10-03T19:20:56.234 INFO:teuthology.orchestra.run.smithi045.stdout: -1510> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000535 [2,head] #10000000535 auth v5666 s=3 n(v0 rc2023-10-03T19:13:44.690688+0000 b3 1=1+0) (iversion lock) 0x55cf6225e100] 2023-10-03T19:20:56.234 INFO:teuthology.orchestra.run.smithi045.stdout: -1509> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_832 [2,head] auth NULL (dversion lock) v=5666 ino=(nil) state=1073741824 0x55cf624fec80] 2023-10-03T19:20:56.234 INFO:teuthology.orchestra.run.smithi045.stdout: -1508> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_831 [2,head] auth (dversion lock) v=5664 ino=0x10000000534 state=1073741824 0x55cf624fea00] 2023-10-03T19:20:56.234 INFO:teuthology.orchestra.run.smithi045.stdout: -1507> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.234 INFO:teuthology.orchestra.run.smithi045.stdout: -1506> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000534 [2,head] /dc-dir/dc-file_831 auth v5664 s=3 n(v0 rc2023-10-03T19:13:44.679087+0000 b3 1=1+0) (iversion lock) 0x55cf6225db80] 2023-10-03T19:20:56.234 INFO:teuthology.orchestra.run.smithi045.stdout: -1505> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_831 [2,head] auth (dversion lock) v=5664 ino=0x10000000534 state=1073741824 0x55cf624fea00] [inode 0x10000000534 [2,head] /dc-dir/dc-file_831 auth v5664 s=3 n(v0 rc2023-10-03T19:13:44.679087+0000 b3 1=1+0) (iversion lock) 0x55cf6225db80] 2023-10-03T19:20:56.234 INFO:teuthology.orchestra.run.smithi045.stdout: -1504> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000534 [2,head] #10000000534 auth v5664 s=3 n(v0 rc2023-10-03T19:13:44.679087+0000 b3 1=1+0) (iversion lock) 0x55cf6225db80] 2023-10-03T19:20:56.234 INFO:teuthology.orchestra.run.smithi045.stdout: -1503> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_831 [2,head] auth NULL (dversion lock) v=5664 ino=(nil) state=1073741824 0x55cf624fea00] 2023-10-03T19:20:56.234 INFO:teuthology.orchestra.run.smithi045.stdout: -1502> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_830 [2,head] auth (dversion lock) v=5662 ino=0x10000000533 state=1073741824 0x55cf624fe780] 2023-10-03T19:20:56.234 INFO:teuthology.orchestra.run.smithi045.stdout: -1501> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.234 INFO:teuthology.orchestra.run.smithi045.stdout: -1500> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000533 [2,head] /dc-dir/dc-file_830 auth v5662 s=3 n(v0 rc2023-10-03T19:13:44.667205+0000 b3 1=1+0) (iversion lock) 0x55cf6225d600] 2023-10-03T19:20:56.235 INFO:teuthology.orchestra.run.smithi045.stdout: -1499> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_830 [2,head] auth (dversion lock) v=5662 ino=0x10000000533 state=1073741824 0x55cf624fe780] [inode 0x10000000533 [2,head] /dc-dir/dc-file_830 auth v5662 s=3 n(v0 rc2023-10-03T19:13:44.667205+0000 b3 1=1+0) (iversion lock) 0x55cf6225d600] 2023-10-03T19:20:56.235 INFO:teuthology.orchestra.run.smithi045.stdout: -1498> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000533 [2,head] #10000000533 auth v5662 s=3 n(v0 rc2023-10-03T19:13:44.667205+0000 b3 1=1+0) (iversion lock) 0x55cf6225d600] 2023-10-03T19:20:56.235 INFO:teuthology.orchestra.run.smithi045.stdout: -1497> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_830 [2,head] auth NULL (dversion lock) v=5662 ino=(nil) state=1073741824 0x55cf624fe780] 2023-10-03T19:20:56.235 INFO:teuthology.orchestra.run.smithi045.stdout: -1496> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_829 [2,head] auth (dversion lock) v=5660 ino=0x10000000532 state=1073741824 0x55cf624fe500] 2023-10-03T19:20:56.235 INFO:teuthology.orchestra.run.smithi045.stdout: -1495> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.235 INFO:teuthology.orchestra.run.smithi045.stdout: -1494> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000532 [2,head] /dc-dir/dc-file_829 auth v5660 s=3 n(v0 rc2023-10-03T19:13:44.655532+0000 b3 1=1+0) (iversion lock) 0x55cf6225d080] 2023-10-03T19:20:56.235 INFO:teuthology.orchestra.run.smithi045.stdout: -1493> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_829 [2,head] auth (dversion lock) v=5660 ino=0x10000000532 state=1073741824 0x55cf624fe500] [inode 0x10000000532 [2,head] /dc-dir/dc-file_829 auth v5660 s=3 n(v0 rc2023-10-03T19:13:44.655532+0000 b3 1=1+0) (iversion lock) 0x55cf6225d080] 2023-10-03T19:20:56.235 INFO:teuthology.orchestra.run.smithi045.stdout: -1492> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000532 [2,head] #10000000532 auth v5660 s=3 n(v0 rc2023-10-03T19:13:44.655532+0000 b3 1=1+0) (iversion lock) 0x55cf6225d080] 2023-10-03T19:20:56.235 INFO:teuthology.orchestra.run.smithi045.stdout: -1491> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_829 [2,head] auth NULL (dversion lock) v=5660 ino=(nil) state=1073741824 0x55cf624fe500] 2023-10-03T19:20:56.236 INFO:teuthology.orchestra.run.smithi045.stdout: -1490> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_828 [2,head] auth (dversion lock) v=5658 ino=0x10000000531 state=1073741824 0x55cf624fe280] 2023-10-03T19:20:56.236 INFO:teuthology.orchestra.run.smithi045.stdout: -1489> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.236 INFO:teuthology.orchestra.run.smithi045.stdout: -1488> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000531 [2,head] /dc-dir/dc-file_828 auth v5658 s=3 n(v0 rc2023-10-03T19:13:44.643121+0000 b3 1=1+0) (iversion lock) 0x55cf6225cb00] 2023-10-03T19:20:56.236 INFO:teuthology.orchestra.run.smithi045.stdout: -1487> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_828 [2,head] auth (dversion lock) v=5658 ino=0x10000000531 state=1073741824 0x55cf624fe280] [inode 0x10000000531 [2,head] /dc-dir/dc-file_828 auth v5658 s=3 n(v0 rc2023-10-03T19:13:44.643121+0000 b3 1=1+0) (iversion lock) 0x55cf6225cb00] 2023-10-03T19:20:56.236 INFO:teuthology.orchestra.run.smithi045.stdout: -1486> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000531 [2,head] #10000000531 auth v5658 s=3 n(v0 rc2023-10-03T19:13:44.643121+0000 b3 1=1+0) (iversion lock) 0x55cf6225cb00] 2023-10-03T19:20:56.236 INFO:teuthology.orchestra.run.smithi045.stdout: -1485> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_828 [2,head] auth NULL (dversion lock) v=5658 ino=(nil) state=1073741824 0x55cf624fe280] 2023-10-03T19:20:56.236 INFO:teuthology.orchestra.run.smithi045.stdout: -1484> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_827 [2,head] auth (dversion lock) v=5656 ino=0x10000000530 state=1073741824 0x55cf624fe000] 2023-10-03T19:20:56.236 INFO:teuthology.orchestra.run.smithi045.stdout: -1483> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.236 INFO:teuthology.orchestra.run.smithi045.stdout: -1482> 2023-10-03T19:15:17.723+0000 7f0f05562640 15 mds.0.cache trim_inode [inode 0x10000000530 [2,head] /dc-dir/dc-file_827 auth v5656 s=3 n(v0 rc2023-10-03T19:13:44.594476+0000 b3 1=1+0) (iversion lock) 0x55cf6225c580] 2023-10-03T19:20:56.236 INFO:teuthology.orchestra.run.smithi045.stdout: -1481> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_827 [2,head] auth (dversion lock) v=5656 ino=0x10000000530 state=1073741824 0x55cf624fe000] [inode 0x10000000530 [2,head] /dc-dir/dc-file_827 auth v5656 s=3 n(v0 rc2023-10-03T19:13:44.594476+0000 b3 1=1+0) (iversion lock) 0x55cf6225c580] 2023-10-03T19:20:56.236 INFO:teuthology.orchestra.run.smithi045.stdout: -1480> 2023-10-03T19:15:17.723+0000 7f0f05562640 14 mds.0.cache remove_inode [inode 0x10000000530 [2,head] #10000000530 auth v5656 s=3 n(v0 rc2023-10-03T19:13:44.594476+0000 b3 1=1+0) (iversion lock) 0x55cf6225c580] 2023-10-03T19:20:56.237 INFO:teuthology.orchestra.run.smithi045.stdout: -1479> 2023-10-03T19:15:17.723+0000 7f0f05562640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_827 [2,head] auth NULL (dversion lock) v=5656 ino=(nil) state=1073741824 0x55cf624fe000] 2023-10-03T19:20:56.237 INFO:teuthology.orchestra.run.smithi045.stdout: -1478> 2023-10-03T19:15:17.723+0000 7f0f05562640 7 mds.0.cache trim_lru trimmed 900 items 2023-10-03T19:20:56.237 INFO:teuthology.orchestra.run.smithi045.stdout: -1477> 2023-10-03T19:15:17.723+0000 7f0f05562640 10 mds.0.11 do_trim trimmed 900 caps 2023-10-03T19:20:56.237 INFO:teuthology.orchestra.run.smithi045.stdout: -1476> 2023-10-03T19:15:17.723+0000 7f0f05562640 20 mds.0.11 cache_status 2023-10-03T19:20:56.237 INFO:teuthology.orchestra.run.smithi045.stdout: -1475> 2023-10-03T19:15:17.723+0000 7f0f05562640 10 MDSContext::complete: 12C_Drop_Cache 2023-10-03T19:20:56.237 INFO:teuthology.orchestra.run.smithi045.stdout: -1474> 2023-10-03T19:15:17.723+0000 7f0f05562640 20 mds.0.11 finish: r=0 2023-10-03T19:20:56.237 INFO:teuthology.orchestra.run.smithi045.stdout: -1473> 2023-10-03T19:15:17.723+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> 172.21.15.45:0/2799686777 -- command_reply(tid 0: 0 ) v1 -- 0x55cf63c1da20 con 0x55cf625c2000 2023-10-03T19:20:56.237 INFO:teuthology.orchestra.run.smithi045.stdout: -1472> 2023-10-03T19:15:17.727+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] >> 172.21.15.45:0/2799686777 conn(0x55cf625c2000 msgr2=0x55cf625c4000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 40 2023-10-03T19:20:56.237 INFO:teuthology.orchestra.run.smithi045.stdout: -1471> 2023-10-03T19:15:17.727+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] >> 172.21.15.45:0/2799686777 conn(0x55cf625c2000 msgr2=0x55cf625c4000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-03T19:20:56.237 INFO:teuthology.orchestra.run.smithi045.stdout: -1470> 2023-10-03T19:15:17.727+0000 7f0f0ed75640 1 --2- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] >> 172.21.15.45:0/2799686777 conn(0x55cf625c2000 0x55cf625c4000 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T19:20:56.237 INFO:teuthology.orchestra.run.smithi045.stdout: -1469> 2023-10-03T19:15:17.727+0000 7f0f0ed75640 1 --2- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] >> 172.21.15.45:0/2799686777 conn(0x55cf625c2000 0x55cf625c4000 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:56.237 INFO:teuthology.orchestra.run.smithi045.stdout: -1468> 2023-10-03T19:15:17.727+0000 7f0f0b56e640 5 mds.a ms_handle_reset on 172.21.15.45:0/2799686777 2023-10-03T19:20:56.238 INFO:teuthology.orchestra.run.smithi045.stdout: -1467> 2023-10-03T19:15:17.727+0000 7f0f0b56e640 3 mds.a ms_handle_reset closing connection for session client.5334 172.21.15.45:0/2799686777 2023-10-03T19:20:56.238 INFO:teuthology.orchestra.run.smithi045.stdout: -1466> 2023-10-03T19:15:17.727+0000 7f0f0b56e640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] >> 172.21.15.45:0/2799686777 conn(0x55cf625c2000 msgr2=0x55cf625c4000 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-10-03T19:20:56.238 INFO:teuthology.orchestra.run.smithi045.stdout: -1465> 2023-10-03T19:15:17.727+0000 7f0f0b56e640 1 --2- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] >> 172.21.15.45:0/2799686777 conn(0x55cf625c2000 0x55cf625c4000 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:56.238 INFO:teuthology.orchestra.run.smithi045.stdout: -1464> 2023-10-03T19:15:18.051+0000 7f0f0a56c640 10 monclient: tick 2023-10-03T19:20:56.238 INFO:teuthology.orchestra.run.smithi045.stdout: -1463> 2023-10-03T19:15:18.051+0000 7f0f0a56c640 10 monclient: _check_auth_tickets 2023-10-03T19:20:56.238 INFO:teuthology.orchestra.run.smithi045.stdout: -1462> 2023-10-03T19:15:18.051+0000 7f0f0a56c640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:14:48.055486+0000) 2023-10-03T19:20:56.238 INFO:teuthology.orchestra.run.smithi045.stdout: -1461> 2023-10-03T19:15:18.319+0000 7f0f04560640 20 update_rank0: mds.metrics 2023-10-03T19:20:56.238 INFO:teuthology.orchestra.run.smithi045.stdout: -1460> 2023-10-03T19:15:18.319+0000 7f0f04560640 20 update_rank0: mds.metrics: sending metric updates for 1 clients to rank 0 (address: [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936]) with sequence number 23, last updated sequence number 56 2023-10-03T19:20:56.238 INFO:teuthology.orchestra.run.smithi045.stdout: -1459> 2023-10-03T19:15:18.319+0000 7f0f04560640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] send_to--> mds [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] -- mds_metrics from rank=0 carrying 1 metric updates v1 -- ?+0 0x55cf625cb080 2023-10-03T19:20:56.238 INFO:teuthology.orchestra.run.smithi045.stdout: -1458> 2023-10-03T19:15:18.319+0000 7f0f04560640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] -- mds_metrics from rank=0 carrying 1 metric updates v1 -- 0x55cf625cb080 con 0x55cf60ec9c00 2023-10-03T19:20:56.239 INFO:teuthology.orchestra.run.smithi045.stdout: -1457> 2023-10-03T19:15:18.319+0000 7f0f0ad6d640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== mds.0 v2:172.21.15.45:6833/252012936 0 ==== mds_metrics from rank=0 carrying 1 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x55cf625cb080 con 0x55cf60ec9c00 2023-10-03T19:20:56.239 INFO:teuthology.orchestra.run.smithi045.stdout: -1456> 2023-10-03T19:15:18.319+0000 7f0f0ad6d640 20 mds.metric.aggregator handle_mds_metrics: applying 1 updates for rank=0 with sequence number 23 2023-10-03T19:20:56.239 INFO:teuthology.orchestra.run.smithi045.stdout: -1455> 2023-10-03T19:15:18.319+0000 7f0f0ad6d640 10 mds.pinger pong_received: rank=0, sequence=23 2023-10-03T19:20:56.239 INFO:teuthology.orchestra.run.smithi045.stdout: -1454> 2023-10-03T19:15:18.319+0000 7f0f0ad6d640 20 mds.metric.aggregator refresh_metrics_for_rank: client=client.5304 172.21.15.146:0/2715925302, rank=0, metrics=[update_type=0, metrics={cap_hit_metric={hits=10053, misses=6}, read_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, write_latency={latency=0.120474, avg_latency=0.000120, sq_sum=26340558799758, count=1000}, metadata_latency={latency=2.696343, avg_latency=0.002677, sq_sum=23924304699116644, count=1007}, dentry_lease={hits=1001, misses=0}, opened_files_metric={opened_files=0, total_inodes=102}, pinned_icaps_metric={pinned_icaps=102, total_inodes=102}, opened_inodes_metric={opened_inodes=0, total_inodes=102}, read_io_sizes_metric={total_ops=0, total_size=0}, write_io_sizes_metric={total_ops=1000, total_size=2890}}] 2023-10-03T19:20:56.239 INFO:teuthology.orchestra.run.smithi045.stdout: -1453> 2023-10-03T19:15:18.415+0000 7f0f07566640 2 mds.0.cache Memory usage: total 302800, rss 76628, heap 207144, baseline 190760, 102 / 114 inodes have caps, 102 caps, 0.894737 caps per inode 2023-10-03T19:20:56.239 INFO:teuthology.orchestra.run.smithi045.stdout: -1452> 2023-10-03T19:15:18.415+0000 7f0f07566640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999990642s ago 2023-10-03T19:20:56.239 INFO:teuthology.orchestra.run.smithi045.stdout: -1451> 2023-10-03T19:15:18.415+0000 7f0f07566640 10 mds.0.cache trim_client_leases 2023-10-03T19:20:56.239 INFO:teuthology.orchestra.run.smithi045.stdout: -1450> 2023-10-03T19:15:18.415+0000 7f0f07566640 7 mds.0.cache trim bytes_used=363kB limit=4GB reservation=0.05% count=0 2023-10-03T19:20:56.239 INFO:teuthology.orchestra.run.smithi045.stdout: -1449> 2023-10-03T19:15:18.415+0000 7f0f07566640 7 mds.0.cache trim_lru trimming 0 items from LRU size=111 mid=0 pintail=111 pinned=111 2023-10-03T19:20:56.239 INFO:teuthology.orchestra.run.smithi045.stdout: -1448> 2023-10-03T19:15:18.415+0000 7f0f07566640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:20:56.239 INFO:teuthology.orchestra.run.smithi045.stdout: -1447> 2023-10-03T19:15:18.415+0000 7f0f07566640 7 mds.0.server recall_client_state: min=100 max=1048576 total=102 flags=0xa 2023-10-03T19:20:56.240 INFO:teuthology.orchestra.run.smithi045.stdout: -1446> 2023-10-03T19:15:18.415+0000 7f0f07566640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:20:56.240 INFO:teuthology.orchestra.run.smithi045.stdout: -1445> 2023-10-03T19:15:18.415+0000 7f0f07566640 10 mds.0.cache releasing free memory 2023-10-03T19:20:56.240 INFO:teuthology.orchestra.run.smithi045.stdout: -1444> 2023-10-03T19:15:18.419+0000 7f0f07566640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:20:56.240 INFO:teuthology.orchestra.run.smithi045.stdout: -1443> 2023-10-03T19:15:18.615+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== client.5304 172.21.15.146:0/2715925302 4258 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.120474, avg_latency: 0.000120, sq_sum: 26340558799758, count=1000][client_metric_type: METADATA_LATENCY latency: 2.696343, avg_latency: 0.002677, sq_sum: 23924304699116644, count=1007][client_metric_type: CAP_INFO cap_hits: 10053 cap_misses: 6 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 1001 dlease_misses: 0 num_dentries: 101][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 102][client_metric_type: PINNED_ICAPS pinned_icaps: 102 total_inodes: 102][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 102][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 1000 total_size: 2890] v1 ==== 328+0+0 (crc 0 0 0) 0x55cf63bde420 con 0x55cf61f84800 2023-10-03T19:20:56.240 INFO:teuthology.orchestra.run.smithi045.stdout: -1442> 2023-10-03T19:15:18.615+0000 7f0f0dd73640 20 mds.0.11 get_session have 0x55cf61ea5400 client.5304 172.21.15.146:0/2715925302 state open 2023-10-03T19:20:56.240 INFO:teuthology.orchestra.run.smithi045.stdout: -1441> 2023-10-03T19:15:18.615+0000 7f0f0dd73640 20 handle_client_metrics: mds.metrics: session=0x55cf61ea5400 2023-10-03T19:20:56.240 INFO:teuthology.orchestra.run.smithi045.stdout: -1440> 2023-10-03T19:15:18.615+0000 7f0f0dd73640 20 handle_payload: mds.metrics: type=READ_LATENCY, session=0x55cf61ea5400, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:20:56.240 INFO:teuthology.orchestra.run.smithi045.stdout: -1439> 2023-10-03T19:15:18.615+0000 7f0f0dd73640 20 handle_payload: mds.metrics: type=WRITE_LATENCY, session=0x55cf61ea5400, latency=0.120474, avg=0.000120, sq_sum=26340558799758, count=1000 2023-10-03T19:20:56.240 INFO:teuthology.orchestra.run.smithi045.stdout: -1438> 2023-10-03T19:15:18.615+0000 7f0f0dd73640 20 handle_payload: mds.metrics: type=METADATA_LATENCY, session=0x55cf61ea5400, latency=2.696343, avg=0.002677, sq_sum=23924304699116644, count=1007 2023-10-03T19:20:56.240 INFO:teuthology.orchestra.run.smithi045.stdout: -1437> 2023-10-03T19:15:18.615+0000 7f0f0dd73640 20 handle_payload: mds.metrics: type=CAP_INFO, session=0x55cf61ea5400, hits=10053, misses=6 2023-10-03T19:20:56.240 INFO:teuthology.orchestra.run.smithi045.stdout: -1436> 2023-10-03T19:15:18.615+0000 7f0f0dd73640 20 handle_payload: mds.metrics: type=DENTRY_LEASE, session=0x55cf61ea5400, hits=1001, misses=0 2023-10-03T19:20:56.240 INFO:teuthology.orchestra.run.smithi045.stdout: -1435> 2023-10-03T19:15:18.615+0000 7f0f0dd73640 20 handle_payload: mds.metrics: type=OPENED_FILES, session=0x55cf61ea5400, opened_files=0, total_inodes=102 2023-10-03T19:20:56.241 INFO:teuthology.orchestra.run.smithi045.stdout: -1434> 2023-10-03T19:15:18.615+0000 7f0f0dd73640 20 handle_payload: mds.metrics: type=PINNED_ICAPS, session=0x55cf61ea5400, pinned_icaps=102, total_inodes=102 2023-10-03T19:20:56.241 INFO:teuthology.orchestra.run.smithi045.stdout: -1433> 2023-10-03T19:15:18.615+0000 7f0f0dd73640 20 handle_payload: mds.metrics: type=OPENED_INODES, session=0x55cf61ea5400, opened_inodes=0, total_inodes=102 2023-10-03T19:20:56.241 INFO:teuthology.orchestra.run.smithi045.stdout: -1432> 2023-10-03T19:15:18.615+0000 7f0f0dd73640 20 handle_payload: mds.metrics: type=READ_IO_SIZES, session=0x55cf61ea5400, total_ops=0, total_size=0 2023-10-03T19:20:56.241 INFO:teuthology.orchestra.run.smithi045.stdout: -1431> 2023-10-03T19:15:18.615+0000 7f0f0dd73640 20 handle_payload: mds.metrics: type=WRITE_IO_SIZES, session=0x55cf61ea5400, total_ops=1000, total_size=2890 2023-10-03T19:20:56.241 INFO:teuthology.orchestra.run.smithi045.stdout: -1430> 2023-10-03T19:15:19.039+0000 7f0f09d6b640 10 mds.0.log trim 1 / 128 segments, 1 / -1 events, 0 (0) expiring, 0 (0) expired 2023-10-03T19:20:56.241 INFO:teuthology.orchestra.run.smithi045.stdout: -1429> 2023-10-03T19:15:19.039+0000 7f0f09d6b640 10 mds.0.log _trim_expired_segments waiting for 3011/10057300 to expire 2023-10-03T19:20:56.241 INFO:teuthology.orchestra.run.smithi045.stdout: -1428> 2023-10-03T19:15:19.039+0000 7f0f09d6b640 10 mds.0.server find_idle_sessions. last cleared laggy state 965.429s ago 2023-10-03T19:20:56.241 INFO:teuthology.orchestra.run.smithi045.stdout: -1427> 2023-10-03T19:15:19.039+0000 7f0f09d6b640 20 mds.0.server laggiest active session is client.5304 172.21.15.146:0/2715925302 and renewed caps recently (5.42795s ago) 2023-10-03T19:20:56.241 INFO:teuthology.orchestra.run.smithi045.stdout: -1426> 2023-10-03T19:15:19.039+0000 7f0f09d6b640 10 mds.0.locker scatter_tick 2023-10-03T19:20:56.241 INFO:teuthology.orchestra.run.smithi045.stdout: -1425> 2023-10-03T19:15:19.039+0000 7f0f09d6b640 20 mds.0.locker caps_tick 0 revoking caps 2023-10-03T19:20:56.250 INFO:teuthology.orchestra.run.smithi045.stdout: -1424> 2023-10-03T19:15:19.039+0000 7f0f09d6b640 20 mds.0.bal handle_export_pins export_pin_queue size=0 2023-10-03T19:20:56.250 INFO:teuthology.orchestra.run.smithi045.stdout: -1423> 2023-10-03T19:15:19.039+0000 7f0f09d6b640 15 mds.0.bal tick tick last_sample now 965.428922s 2023-10-03T19:20:56.250 INFO:teuthology.orchestra.run.smithi045.stdout: -1422> 2023-10-03T19:15:19.039+0000 7f0f09d6b640 15 mds.0.cache show_subtrees 2023-10-03T19:20:56.250 INFO:teuthology.orchestra.run.smithi045.stdout: -1421> 2023-10-03T19:15:19.039+0000 7f0f09d6b640 10 mds.0.cache |__ 0 auth [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:56.251 INFO:teuthology.orchestra.run.smithi045.stdout: -1420> 2023-10-03T19:15:19.039+0000 7f0f09d6b640 10 mds.0.cache |__ 0 auth [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:13:21.316686+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37a80] 2023-10-03T19:20:56.251 INFO:teuthology.orchestra.run.smithi045.stdout: -1419> 2023-10-03T19:15:19.039+0000 7f0f09d6b640 10 mds.0.cache find_stale_fragment_freeze 2023-10-03T19:20:56.251 INFO:teuthology.orchestra.run.smithi045.stdout: -1418> 2023-10-03T19:15:19.039+0000 7f0f09d6b640 10 mds.0.snap check_osd_map - version unchanged 2023-10-03T19:20:56.251 INFO:teuthology.orchestra.run.smithi045.stdout: -1417> 2023-10-03T19:15:19.039+0000 7f0f09d6b640 20 mds.0.11 updating export targets, currently 0 ranks are targets 2023-10-03T19:20:56.251 INFO:teuthology.orchestra.run.smithi045.stdout: -1416> 2023-10-03T19:15:19.051+0000 7f0f0a56c640 10 monclient: tick 2023-10-03T19:20:56.251 INFO:teuthology.orchestra.run.smithi045.stdout: -1415> 2023-10-03T19:15:19.051+0000 7f0f0a56c640 10 monclient: _check_auth_tickets 2023-10-03T19:20:56.251 INFO:teuthology.orchestra.run.smithi045.stdout: -1414> 2023-10-03T19:15:19.051+0000 7f0f0a56c640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:14:49.055577+0000) 2023-10-03T19:20:56.251 INFO:teuthology.orchestra.run.smithi045.stdout: -1413> 2023-10-03T19:15:19.315+0000 7f0f09d6b640 20 mds.0.11 get_task_status 2023-10-03T19:20:56.251 INFO:teuthology.orchestra.run.smithi045.stdout: -1412> 2023-10-03T19:15:19.315+0000 7f0f09d6b640 20 mds.0.11 schedule_update_timer_task 2023-10-03T19:20:56.251 INFO:teuthology.orchestra.run.smithi045.stdout: -1411> 2023-10-03T19:15:19.419+0000 7f0f07566640 2 mds.0.cache Memory usage: total 302800, rss 57276, heap 207144, baseline 190760, 102 / 114 inodes have caps, 102 caps, 0.894737 caps per inode 2023-10-03T19:20:56.251 INFO:teuthology.orchestra.run.smithi045.stdout: -1410> 2023-10-03T19:15:19.419+0000 7f0f07566640 20 mds.0.cache upkeep thread trimming cache; last trim 1.003990650s ago 2023-10-03T19:20:56.251 INFO:teuthology.orchestra.run.smithi045.stdout: -1409> 2023-10-03T19:15:19.419+0000 7f0f07566640 10 mds.0.cache trim_client_leases 2023-10-03T19:20:56.252 INFO:teuthology.orchestra.run.smithi045.stdout: -1408> 2023-10-03T19:15:19.419+0000 7f0f07566640 7 mds.0.cache trim bytes_used=363kB limit=4GB reservation=0.05% count=0 2023-10-03T19:20:56.252 INFO:teuthology.orchestra.run.smithi045.stdout: -1407> 2023-10-03T19:15:19.419+0000 7f0f07566640 7 mds.0.cache trim_lru trimming 0 items from LRU size=111 mid=0 pintail=111 pinned=111 2023-10-03T19:20:56.252 INFO:teuthology.orchestra.run.smithi045.stdout: -1406> 2023-10-03T19:15:19.419+0000 7f0f07566640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:20:56.252 INFO:teuthology.orchestra.run.smithi045.stdout: -1405> 2023-10-03T19:15:19.419+0000 7f0f07566640 7 mds.0.server recall_client_state: min=100 max=1048576 total=102 flags=0xa 2023-10-03T19:20:56.252 INFO:teuthology.orchestra.run.smithi045.stdout: -1404> 2023-10-03T19:15:19.419+0000 7f0f07566640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:20:56.252 INFO:teuthology.orchestra.run.smithi045.stdout: -1403> 2023-10-03T19:15:19.419+0000 7f0f07566640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:20:56.252 INFO:teuthology.orchestra.run.smithi045.stdout: -1402> 2023-10-03T19:15:19.615+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== client.5304 172.21.15.146:0/2715925302 4259 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.120474, avg_latency: 0.000120, sq_sum: 26340558799758, count=1000][client_metric_type: METADATA_LATENCY latency: 2.696343, avg_latency: 0.002677, sq_sum: 23924304699116644, count=1007][client_metric_type: CAP_INFO cap_hits: 10053 cap_misses: 6 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 1001 dlease_misses: 0 num_dentries: 101][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 102][client_metric_type: PINNED_ICAPS pinned_icaps: 102 total_inodes: 102][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 102][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 1000 total_size: 2890] v1 ==== 328+0+0 (crc 0 0 0) 0x55cf63bde420 con 0x55cf61f84800 2023-10-03T19:20:56.252 INFO:teuthology.orchestra.run.smithi045.stdout: -1401> 2023-10-03T19:15:19.615+0000 7f0f0dd73640 20 mds.0.11 get_session have 0x55cf61ea5400 client.5304 172.21.15.146:0/2715925302 state open 2023-10-03T19:20:56.252 INFO:teuthology.orchestra.run.smithi045.stdout: -1400> 2023-10-03T19:15:19.615+0000 7f0f0dd73640 20 handle_client_metrics: mds.metrics: session=0x55cf61ea5400 2023-10-03T19:20:56.252 INFO:teuthology.orchestra.run.smithi045.stdout: -1399> 2023-10-03T19:15:19.615+0000 7f0f0dd73640 20 handle_payload: mds.metrics: type=READ_LATENCY, session=0x55cf61ea5400, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:20:56.252 INFO:teuthology.orchestra.run.smithi045.stdout: -1398> 2023-10-03T19:15:19.615+0000 7f0f0dd73640 20 handle_payload: mds.metrics: type=WRITE_LATENCY, session=0x55cf61ea5400, latency=0.120474, avg=0.000120, sq_sum=26340558799758, count=1000 2023-10-03T19:20:56.252 INFO:teuthology.orchestra.run.smithi045.stdout: -1397> 2023-10-03T19:15:19.615+0000 7f0f0dd73640 20 handle_payload: mds.metrics: type=METADATA_LATENCY, session=0x55cf61ea5400, latency=2.696343, avg=0.002677, sq_sum=23924304699116644, count=1007 2023-10-03T19:20:56.253 INFO:teuthology.orchestra.run.smithi045.stdout: -1396> 2023-10-03T19:15:19.615+0000 7f0f0dd73640 20 handle_payload: mds.metrics: type=CAP_INFO, session=0x55cf61ea5400, hits=10053, misses=6 2023-10-03T19:20:56.253 INFO:teuthology.orchestra.run.smithi045.stdout: -1395> 2023-10-03T19:15:19.615+0000 7f0f0dd73640 20 handle_payload: mds.metrics: type=DENTRY_LEASE, session=0x55cf61ea5400, hits=1001, misses=0 2023-10-03T19:20:56.253 INFO:teuthology.orchestra.run.smithi045.stdout: -1394> 2023-10-03T19:15:19.615+0000 7f0f0dd73640 20 handle_payload: mds.metrics: type=OPENED_FILES, session=0x55cf61ea5400, opened_files=0, total_inodes=102 2023-10-03T19:20:56.253 INFO:teuthology.orchestra.run.smithi045.stdout: -1393> 2023-10-03T19:15:19.615+0000 7f0f0dd73640 20 handle_payload: mds.metrics: type=PINNED_ICAPS, session=0x55cf61ea5400, pinned_icaps=102, total_inodes=102 2023-10-03T19:20:56.253 INFO:teuthology.orchestra.run.smithi045.stdout: -1392> 2023-10-03T19:15:19.615+0000 7f0f0dd73640 20 handle_payload: mds.metrics: type=OPENED_INODES, session=0x55cf61ea5400, opened_inodes=0, total_inodes=102 2023-10-03T19:20:56.253 INFO:teuthology.orchestra.run.smithi045.stdout: -1391> 2023-10-03T19:15:19.615+0000 7f0f0dd73640 20 handle_payload: mds.metrics: type=READ_IO_SIZES, session=0x55cf61ea5400, total_ops=0, total_size=0 2023-10-03T19:20:56.253 INFO:teuthology.orchestra.run.smithi045.stdout: -1390> 2023-10-03T19:15:19.615+0000 7f0f0dd73640 20 handle_payload: mds.metrics: type=WRITE_IO_SIZES, session=0x55cf61ea5400, total_ops=1000, total_size=2890 2023-10-03T19:20:56.253 INFO:teuthology.orchestra.run.smithi045.stdout: -1389> 2023-10-03T19:15:19.875+0000 7f0f0b56e640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== client.5304 172.21.15.146:0/2715925302 4260 ==== client_session(request_close seq 2001) v1 ==== 28+0+0 (crc 0 0 0) 0x55cf626688c0 con 0x55cf61f84800 2023-10-03T19:20:56.253 INFO:teuthology.orchestra.run.smithi045.stdout: -1388> 2023-10-03T19:15:19.875+0000 7f0f0b56e640 20 mds.0.11 get_session have 0x55cf61ea5400 client.5304 172.21.15.146:0/2715925302 state open 2023-10-03T19:20:56.253 INFO:teuthology.orchestra.run.smithi045.stdout: -1387> 2023-10-03T19:15:19.875+0000 7f0f0b56e640 3 mds.0.server handle_client_session client_session(request_close seq 2001) v1 from client.5304 2023-10-03T19:20:56.253 INFO:teuthology.orchestra.run.smithi045.stdout: -1386> 2023-10-03T19:15:19.875+0000 7f0f0b56e640 10 mds.0.server journal_close_session : client.5304 172.21.15.146:0/2715925302 pending_prealloc_inos [] free_prealloc_inos [0x100000005dd~0x1f7] delegated_inos [0x10000000002~0x1f4] 2023-10-03T19:20:56.253 INFO:teuthology.orchestra.run.smithi045.stdout: -1385> 2023-10-03T19:15:19.875+0000 7f0f0b56e640 20 mds.0.sessionmap mark_projected s=0x55cf61ea5400 name=client.5304 pv=1004 -> 1005 2023-10-03T19:20:56.254 INFO:teuthology.orchestra.run.smithi045.stdout: -1384> 2023-10-03T19:15:19.875+0000 7f0f0b56e640 10 mds.0.inotable: project_release_ids [0x100000005dd~0x1f7] to [0x100000007d4~0xfffffff82c]/[0x100000007d4~0xfffffff82c] 2023-10-03T19:20:56.254 INFO:teuthology.orchestra.run.smithi045.stdout: -1383> 2023-10-03T19:15:19.875+0000 7f0f04d61640 5 mds.0.log _submit_thread 10058192~153 : ESession client.5304 172.21.15.146:0/2715925302 close cmapv 1005 (503 to free, v5, 500 to purge) 2023-10-03T19:20:56.254 INFO:teuthology.orchestra.run.smithi045.stdout: -1382> 2023-10-03T19:15:19.875+0000 7f0f04d61640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2073 5.1b 5:ddb4e4d7:::200.00000002:head [write 1669584~173 [fadvise_dontneed] in=173b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62020a80 con 0x55cf61c59000 2023-10-03T19:20:56.254 INFO:teuthology.orchestra.run.smithi045.stdout: -1381> 2023-10-03T19:15:19.879+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 328 ==== osd_op_reply(2073 200.00000002 [write 1669584~173 [fadvise_dontneed]] v37'160 uv160 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:56.254 INFO:teuthology.orchestra.run.smithi045.stdout: -1380> 2023-10-03T19:15:19.879+0000 7f0f05562640 10 MDSIOContextBase::complete: 20C_MDS_session_finish 2023-10-03T19:20:56.254 INFO:teuthology.orchestra.run.smithi045.stdout: -1379> 2023-10-03T19:15:19.879+0000 7f0f05562640 10 MDSContext::complete: 20C_MDS_session_finish 2023-10-03T19:20:56.254 INFO:teuthology.orchestra.run.smithi045.stdout: -1378> 2023-10-03T19:15:19.879+0000 7f0f05562640 10 mds.0.server _session_logged client.5304 172.21.15.146:0/2715925302 state_seq 3 close 1005 inos_to_free [0x100000005dd~0x1f7] inotablev 5 inos_to_purge [0x10000000002~0x1f4] 2023-10-03T19:20:56.254 INFO:teuthology.orchestra.run.smithi045.stdout: -1377> 2023-10-03T19:15:19.879+0000 7f0f05562640 10 mds.0.cache purge_inodes purging inos [0x10000000002~0x1f4] logseg 3011 2023-10-03T19:20:56.254 INFO:teuthology.orchestra.run.smithi045.stdout: -1376> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2074 6.12 6:4bec3886:::10000000002.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf60f1f880 con 0x55cf61df4c00 2023-10-03T19:20:56.254 INFO:teuthology.orchestra.run.smithi045.stdout: -1375> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2075 6.32 6:4def72d4:::10000000003.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62035500 con 0x55cf61df5400 2023-10-03T19:20:56.255 INFO:teuthology.orchestra.run.smithi045.stdout: -1374> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2076 6.5 6:a367a3e8:::10000000004.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf635c5500 con 0x55cf61df4c00 2023-10-03T19:20:56.255 INFO:teuthology.orchestra.run.smithi045.stdout: -1373> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2077 6.9 6:9258b67d:::10000000005.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61eac000 con 0x55cf61df5c00 2023-10-03T19:20:56.255 INFO:teuthology.orchestra.run.smithi045.stdout: -1372> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2078 6.25 6:a5feb6f3:::10000000006.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61fe8a80 con 0x55cf61df4800 2023-10-03T19:20:56.255 INFO:teuthology.orchestra.run.smithi045.stdout: -1371> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2079 6.1d 6:bbf5850a:::10000000007.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6243dc00 con 0x55cf61df5000 2023-10-03T19:20:56.255 INFO:teuthology.orchestra.run.smithi045.stdout: -1370> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2080 6.13 6:cabe77c1:::10000000008.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63bb8000 con 0x55cf61df4400 2023-10-03T19:20:56.255 INFO:teuthology.orchestra.run.smithi045.stdout: -1369> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2081 6.34 6:2eb4da2b:::10000000009.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b8b180 con 0x55cf61df5c00 2023-10-03T19:20:56.255 INFO:teuthology.orchestra.run.smithi045.stdout: -1368> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2082 6.22 6:45d72e17:::1000000000a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b8ae00 con 0x55cf61df4800 2023-10-03T19:20:56.255 INFO:teuthology.orchestra.run.smithi045.stdout: -1367> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2083 6.29 6:9752f43f:::1000000000b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b61180 con 0x55cf61df4c00 2023-10-03T19:20:56.255 INFO:teuthology.orchestra.run.smithi045.stdout: -1366> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2084 6.22 6:46cca9ab:::1000000000c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b60000 con 0x55cf61df4800 2023-10-03T19:20:56.255 INFO:teuthology.orchestra.run.smithi045.stdout: -1365> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2085 6.17 6:e9ecae36:::1000000000d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b06000 con 0x55cf61df5400 2023-10-03T19:20:56.255 INFO:teuthology.orchestra.run.smithi045.stdout: -1364> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2086 6.37 6:eefe613f:::1000000000e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63adbc00 con 0x55cf61df5c00 2023-10-03T19:20:56.256 INFO:teuthology.orchestra.run.smithi045.stdout: -1363> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2087 6.12 6:49e35fbc:::1000000000f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63adb880 con 0x55cf61df4c00 2023-10-03T19:20:56.256 INFO:teuthology.orchestra.run.smithi045.stdout: -1362> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2088 6.3b 6:dde6a3df:::10000000010.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a82a80 con 0x55cf61df5800 2023-10-03T19:20:56.256 INFO:teuthology.orchestra.run.smithi045.stdout: -1361> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2089 6.15 6:ab5910e2:::10000000011.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a82700 con 0x55cf61df4c00 2023-10-03T19:20:56.256 INFO:teuthology.orchestra.run.smithi045.stdout: -1360> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2090 6.d 6:b185e6e8:::10000000012.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a54700 con 0x55cf61c59000 2023-10-03T19:20:56.256 INFO:teuthology.orchestra.run.smithi045.stdout: -1359> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2091 6.22 6:44834937:::10000000013.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a2b500 con 0x55cf61df4800 2023-10-03T19:20:56.256 INFO:teuthology.orchestra.run.smithi045.stdout: -1358> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2092 6.10 6:0b7da9c3:::10000000014.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf639d5c00 con 0x55cf61df5c00 2023-10-03T19:20:56.256 INFO:teuthology.orchestra.run.smithi045.stdout: -1357> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2093 6.36 6:6dc1a442:::10000000015.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62020700 con 0x55cf61df5c00 2023-10-03T19:20:56.256 INFO:teuthology.orchestra.run.smithi045.stdout: -1356> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2094 6.38 6:1e20cbdb:::10000000016.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf623be700 con 0x55cf61df4400 2023-10-03T19:20:56.256 INFO:teuthology.orchestra.run.smithi045.stdout: -1355> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2095 6.1e 6:78cea7f0:::10000000017.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61feaa80 con 0x55cf61df5400 2023-10-03T19:20:56.256 INFO:teuthology.orchestra.run.smithi045.stdout: -1354> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2096 6.1a 6:5b3b19a5:::10000000018.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6208bc00 con 0x55cf61df5400 2023-10-03T19:20:57.399 INFO:teuthology.orchestra.run.smithi045.stdout: -1353> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2097 6.21 6:86d8200e:::10000000019.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6202ee00 con 0x55cf61df4c00 2023-10-03T19:20:57.399 INFO:teuthology.orchestra.run.smithi045.stdout: -1352> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2098 6.20 6:072a8150:::1000000001a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61eaca80 con 0x55cf61df5000 2023-10-03T19:20:57.399 INFO:teuthology.orchestra.run.smithi045.stdout: -1351> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2099 6.8 6:12420902:::1000000001b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62099500 con 0x55cf61df4c00 2023-10-03T19:20:57.399 INFO:teuthology.orchestra.run.smithi045.stdout: -1350> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2100 6.16 6:6a54d456:::1000000001c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6202e700 con 0x55cf61df5c00 2023-10-03T19:20:57.400 INFO:teuthology.orchestra.run.smithi045.stdout: -1349> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2101 6.33 6:cf746ac5:::1000000001d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61eb0a80 con 0x55cf61c59000 2023-10-03T19:20:57.400 INFO:teuthology.orchestra.run.smithi045.stdout: -1348> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2102 6.32 6:4f7da3cc:::1000000001e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61eb1880 con 0x55cf61df5400 2023-10-03T19:20:57.400 INFO:teuthology.orchestra.run.smithi045.stdout: -1347> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2103 6.3a 6:5f13809d:::1000000001f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63c12700 con 0x55cf61df5000 2023-10-03T19:20:57.401 INFO:teuthology.orchestra.run.smithi045.stdout: -1346> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2104 6.22 6:4503a7ea:::10000000020.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63c12380 con 0x55cf61df4800 2023-10-03T19:20:57.401 INFO:teuthology.orchestra.run.smithi045.stdout: -1345> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2105 6.b 6:d3d0d483:::10000000021.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63be5180 con 0x55cf61df4400 2023-10-03T19:20:57.401 INFO:teuthology.orchestra.run.smithi045.stdout: -1344> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2106 6.b 6:d2626379:::10000000022.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63be4e00 con 0x55cf61df4400 2023-10-03T19:20:57.401 INFO:teuthology.orchestra.run.smithi045.stdout: -1343> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2107 6.17 6:eb6757d1:::10000000023.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63be4700 con 0x55cf61df5400 2023-10-03T19:20:57.402 INFO:teuthology.orchestra.run.smithi045.stdout: -1342> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2108 6.2f 6:f6ddf183:::10000000024.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63be4000 con 0x55cf61df4c00 2023-10-03T19:20:57.402 INFO:teuthology.orchestra.run.smithi045.stdout: -1341> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2109 6.14 6:2a40c2ef:::10000000025.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63bb9880 con 0x55cf61df5800 2023-10-03T19:20:57.402 INFO:teuthology.orchestra.run.smithi045.stdout: -1340> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2110 6.3d 6:be1922a8:::10000000026.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63bb9500 con 0x55cf61df5c00 2023-10-03T19:20:57.402 INFO:teuthology.orchestra.run.smithi045.stdout: -1339> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2111 6.d 6:b0d15537:::10000000027.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63bb8a80 con 0x55cf61c59000 2023-10-03T19:20:57.402 INFO:teuthology.orchestra.run.smithi045.stdout: -1338> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2112 6.1d 6:ba3960b0:::10000000028.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b8b880 con 0x55cf61df5000 2023-10-03T19:20:57.403 INFO:teuthology.orchestra.run.smithi045.stdout: -1337> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2113 6.18 6:19311010:::10000000029.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b8a380 con 0x55cf61df5c00 2023-10-03T19:20:57.403 INFO:teuthology.orchestra.run.smithi045.stdout: -1336> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2114 6.3c 6:3d4c06c4:::1000000002a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b61c00 con 0x55cf61df5800 2023-10-03T19:20:57.403 INFO:teuthology.orchestra.run.smithi045.stdout: -1335> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2115 6.26 6:645408ac:::1000000002b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b33880 con 0x55cf61df5000 2023-10-03T19:20:57.404 INFO:teuthology.orchestra.run.smithi045.stdout: -1334> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2116 6.25 6:a622384a:::1000000002c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b06e00 con 0x55cf61df4800 2023-10-03T19:20:57.404 INFO:teuthology.orchestra.run.smithi045.stdout: -1333> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2117 6.26 6:660982fc:::1000000002d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63adae00 con 0x55cf61df5000 2023-10-03T19:20:57.404 INFO:teuthology.orchestra.run.smithi045.stdout: -1332> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2118 6.12 6:49ffa098:::1000000002e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63ada700 con 0x55cf61df4c00 2023-10-03T19:20:57.405 INFO:teuthology.orchestra.run.smithi045.stdout: -1331> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2119 6.23 6:c550f404:::1000000002f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63ada000 con 0x55cf61df4800 2023-10-03T19:20:57.405 INFO:teuthology.orchestra.run.smithi045.stdout: -1330> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2120 6.3 6:c1adcc3d:::10000000030.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63ab0380 con 0x55cf61df4c00 2023-10-03T19:20:57.405 INFO:teuthology.orchestra.run.smithi045.stdout: -1329> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2121 6.1b 6:d88bb762:::10000000031.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a54380 con 0x55cf61df4400 2023-10-03T19:20:57.406 INFO:teuthology.orchestra.run.smithi045.stdout: -1328> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2122 6.31 6:8ea80fc8:::10000000032.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a54000 con 0x55cf61c59000 2023-10-03T19:20:57.406 INFO:teuthology.orchestra.run.smithi045.stdout: -1327> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2123 6.3e 6:7e2d0da6:::10000000033.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63be4000 con 0x55cf61df4400 2023-10-03T19:20:57.406 INFO:teuthology.orchestra.run.smithi045.stdout: -1326> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2124 6.1 6:81df0dbf:::10000000034.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63be4e00 con 0x55cf61df5000 2023-10-03T19:20:57.407 INFO:teuthology.orchestra.run.smithi045.stdout: -1325> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2125 6.38 6:1e1620c8:::10000000035.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63be5180 con 0x55cf61df4400 2023-10-03T19:20:57.407 INFO:teuthology.orchestra.run.smithi045.stdout: -1324> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2126 6.2b 6:d747f723:::10000000036.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62099500 con 0x55cf61c59000 2023-10-03T19:20:57.407 INFO:teuthology.orchestra.run.smithi045.stdout: -1323> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2127 6.6 6:60a13eb4:::10000000037.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6202ee00 con 0x55cf61df4400 2023-10-03T19:20:57.408 INFO:teuthology.orchestra.run.smithi045.stdout: -1322> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2128 6.26 6:65f9ba37:::10000000038.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf623be700 con 0x55cf61df5000 2023-10-03T19:20:57.408 INFO:teuthology.orchestra.run.smithi045.stdout: -1321> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2129 6.22 6:44135715:::10000000039.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a82a80 con 0x55cf61df4800 2023-10-03T19:20:57.408 INFO:teuthology.orchestra.run.smithi045.stdout: -1320> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2130 6.f 6:f1a9c549:::1000000003a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a82700 con 0x55cf61df5800 2023-10-03T19:20:57.408 INFO:teuthology.orchestra.run.smithi045.stdout: -1319> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2131 6.3c 6:3c3d7520:::1000000003b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63adb880 con 0x55cf61df5800 2023-10-03T19:20:57.409 INFO:teuthology.orchestra.run.smithi045.stdout: -1318> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2132 6.8 6:12420646:::1000000003c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63bb8000 con 0x55cf61df4c00 2023-10-03T19:20:57.409 INFO:teuthology.orchestra.run.smithi045.stdout: -1317> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2133 6.6 6:614fee2a:::1000000003d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b61180 con 0x55cf61df4400 2023-10-03T19:20:57.409 INFO:teuthology.orchestra.run.smithi045.stdout: -1316> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2134 6.2c 6:3665eb52:::1000000003e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf635c5500 con 0x55cf61df4800 2023-10-03T19:20:57.410 INFO:teuthology.orchestra.run.smithi045.stdout: -1315> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2135 6.32 6:4ecb6bb7:::1000000003f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf60f1f880 con 0x55cf61df5400 2023-10-03T19:20:57.410 INFO:teuthology.orchestra.run.smithi045.stdout: -1314> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2136 6.23 6:c6a0a389:::10000000040.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63adb180 con 0x55cf61df4800 2023-10-03T19:20:57.410 INFO:teuthology.orchestra.run.smithi045.stdout: -1313> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2137 6.2b 6:d4b9b687:::10000000041.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63c13c00 con 0x55cf61c59000 2023-10-03T19:20:57.411 INFO:teuthology.orchestra.run.smithi045.stdout: -1312> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2138 6.6 6:61404748:::10000000042.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63c13880 con 0x55cf61df4400 2023-10-03T19:20:57.411 INFO:teuthology.orchestra.run.smithi045.stdout: -1311> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2139 6.16 6:6a415a36:::10000000043.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63c12000 con 0x55cf61df5c00 2023-10-03T19:20:57.411 INFO:teuthology.orchestra.run.smithi045.stdout: -1310> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2140 6.1a 6:5bd35317:::10000000044.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63be4a80 con 0x55cf61df5400 2023-10-03T19:20:57.411 INFO:teuthology.orchestra.run.smithi045.stdout: -1309> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2141 6.36 6:6f6f8b6e:::10000000045.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63bb8e00 con 0x55cf61df5c00 2023-10-03T19:20:57.412 INFO:teuthology.orchestra.run.smithi045.stdout: -1308> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2142 6.26 6:678705fb:::10000000046.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b60e00 con 0x55cf61df5000 2023-10-03T19:20:57.412 INFO:teuthology.orchestra.run.smithi045.stdout: -1307> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2143 6.8 6:1044c7a4:::10000000047.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b60380 con 0x55cf61df4c00 2023-10-03T19:20:57.412 INFO:teuthology.orchestra.run.smithi045.stdout: -1306> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2144 6.12 6:4899516f:::10000000048.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b33c00 con 0x55cf61df4c00 2023-10-03T19:20:57.412 INFO:teuthology.orchestra.run.smithi045.stdout: -1305> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2145 6.7 6:e2d50132:::10000000049.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b33500 con 0x55cf61c59000 2023-10-03T19:20:57.413 INFO:teuthology.orchestra.run.smithi045.stdout: -1304> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2146 6.2f 6:f7911ae7:::1000000004a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b33180 con 0x55cf61df4c00 2023-10-03T19:20:57.413 INFO:teuthology.orchestra.run.smithi045.stdout: -1303> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2147 6.31 6:8e5cc622:::1000000004b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b32000 con 0x55cf61c59000 2023-10-03T19:20:57.413 INFO:teuthology.orchestra.run.smithi045.stdout: -1302> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2148 6.21 6:844eae9e:::1000000004c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b07880 con 0x55cf61df4c00 2023-10-03T19:20:57.413 INFO:teuthology.orchestra.run.smithi045.stdout: -1301> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2149 6.36 6:6c82bb73:::1000000004d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b07180 con 0x55cf61df5c00 2023-10-03T19:20:57.413 INFO:teuthology.orchestra.run.smithi045.stdout: -1300> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2150 6.29 6:954bc910:::1000000004e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63adb500 con 0x55cf61df4c00 2023-10-03T19:20:57.413 INFO:teuthology.orchestra.run.smithi045.stdout: -1299> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2151 6.21 6:8660ae9f:::1000000004f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63adaa80 con 0x55cf61df4c00 2023-10-03T19:20:57.413 INFO:teuthology.orchestra.run.smithi045.stdout: -1298> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2152 6.16 6:69de5632:::10000000050.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63ada380 con 0x55cf61df5c00 2023-10-03T19:20:57.413 INFO:teuthology.orchestra.run.smithi045.stdout: -1297> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2153 6.19 6:9ae7aaf4:::10000000051.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63ab1180 con 0x55cf61c59000 2023-10-03T19:20:57.414 INFO:teuthology.orchestra.run.smithi045.stdout: -1296> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2154 6.b 6:d30f9a54:::10000000052.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a83880 con 0x55cf61df4400 2023-10-03T19:20:57.414 INFO:teuthology.orchestra.run.smithi045.stdout: -1295> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2155 6.16 6:6a23747e:::10000000053.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b07180 con 0x55cf61df5c00 2023-10-03T19:20:57.414 INFO:teuthology.orchestra.run.smithi045.stdout: -1294> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2156 6.0 6:03de5254:::10000000054.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63bb8e00 con 0x55cf61df5c00 2023-10-03T19:20:57.414 INFO:teuthology.orchestra.run.smithi045.stdout: -1293> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2157 6.32 6:4d757255:::10000000055.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63c12000 con 0x55cf61df5400 2023-10-03T19:20:57.414 INFO:teuthology.orchestra.run.smithi045.stdout: -1292> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2158 6.28 6:166e0f51:::10000000056.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b8a380 con 0x55cf61df5800 2023-10-03T19:20:57.414 INFO:teuthology.orchestra.run.smithi045.stdout: -1291> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2159 6.2e 6:74dc0bdf:::10000000057.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63bb9500 con 0x55cf61df4800 2023-10-03T19:20:57.415 INFO:teuthology.orchestra.run.smithi045.stdout: -1290> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2160 6.14 6:2b0a3bc5:::10000000058.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6202e700 con 0x55cf61df5800 2023-10-03T19:20:57.415 INFO:teuthology.orchestra.run.smithi045.stdout: -1289> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2161 6.31 6:8ff022d2:::10000000059.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b60e00 con 0x55cf61c59000 2023-10-03T19:20:57.415 INFO:teuthology.orchestra.run.smithi045.stdout: -1288> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2162 6.18 6:1ae6cdf3:::1000000005a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf623be700 con 0x55cf61df5c00 2023-10-03T19:20:57.415 INFO:teuthology.orchestra.run.smithi045.stdout: -1287> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2163 6.39 6:9fc48627:::1000000005b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63be4e00 con 0x55cf61c59000 2023-10-03T19:20:57.415 INFO:teuthology.orchestra.run.smithi045.stdout: -1286> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2164 6.30 6:0cbf7f79:::1000000005c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63adae00 con 0x55cf61df4c00 2023-10-03T19:20:57.415 INFO:teuthology.orchestra.run.smithi045.stdout: -1285> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2165 6.2d 6:b5236558:::1000000005d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b33880 con 0x55cf61df5800 2023-10-03T19:20:57.415 INFO:teuthology.orchestra.run.smithi045.stdout: -1284> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2166 6.21 6:870ac4b3:::1000000005e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b8b880 con 0x55cf61df4c00 2023-10-03T19:20:57.415 INFO:teuthology.orchestra.run.smithi045.stdout: -1283> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2167 6.2c 6:34658595:::1000000005f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63c12700 con 0x55cf61df4800 2023-10-03T19:20:57.416 INFO:teuthology.orchestra.run.smithi045.stdout: -1282> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2168 6.3 6:c001b242:::10000000060.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61eaca80 con 0x55cf61df4c00 2023-10-03T19:20:57.416 INFO:teuthology.orchestra.run.smithi045.stdout: -1281> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2169 6.0 6:0181e5f0:::10000000061.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62020700 con 0x55cf61df5c00 2023-10-03T19:20:57.416 INFO:teuthology.orchestra.run.smithi045.stdout: -1280> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2170 6.30 6:0d373645:::10000000062.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf639d5c00 con 0x55cf61df4c00 2023-10-03T19:20:57.416 INFO:teuthology.orchestra.run.smithi045.stdout: -1279> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2171 6.26 6:66f1e28f:::10000000063.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a54700 con 0x55cf61df5000 2023-10-03T19:20:57.416 INFO:teuthology.orchestra.run.smithi045.stdout: -1278> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2172 6.20 6:0699973a:::10000000064.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63adbc00 con 0x55cf61df5000 2023-10-03T19:20:57.416 INFO:teuthology.orchestra.run.smithi045.stdout: -1277> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2173 6.f 6:f2d196a0:::10000000065.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6243dc00 con 0x55cf61df5800 2023-10-03T19:20:57.416 INFO:teuthology.orchestra.run.smithi045.stdout: -1276> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2174 6.38 6:1cab634c:::10000000066.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b8b180 con 0x55cf61df4400 2023-10-03T19:20:57.416 INFO:teuthology.orchestra.run.smithi045.stdout: -1275> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2175 6.37 6:ef5f0c51:::10000000067.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61eac000 con 0x55cf61df5c00 2023-10-03T19:20:57.417 INFO:teuthology.orchestra.run.smithi045.stdout: -1274> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2176 6.1c 6:3b87fee9:::10000000068.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62020a80 con 0x55cf61df4c00 2023-10-03T19:20:57.417 INFO:teuthology.orchestra.run.smithi045.stdout: -1273> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2177 6.3 6:c2cd23b6:::10000000069.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63c13180 con 0x55cf61df4c00 2023-10-03T19:20:57.417 INFO:teuthology.orchestra.run.smithi045.stdout: -1272> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2178 6.c 6:31e782ee:::1000000006a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63c12e00 con 0x55cf61df4400 2023-10-03T19:20:57.417 INFO:teuthology.orchestra.run.smithi045.stdout: -1271> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2179 6.1d 6:bbf235fa:::1000000006b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63c12a80 con 0x55cf61df5000 2023-10-03T19:20:57.417 INFO:teuthology.orchestra.run.smithi045.stdout: -1270> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2180 6.2b 6:d50f8d72:::1000000006c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63be5c00 con 0x55cf61c59000 2023-10-03T19:20:57.417 INFO:teuthology.orchestra.run.smithi045.stdout: -1269> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2181 6.37 6:eeccecf9:::1000000006d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63be5880 con 0x55cf61df5c00 2023-10-03T19:20:57.417 INFO:teuthology.orchestra.run.smithi045.stdout: -1268> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2182 6.11 6:88725faf:::1000000006e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63bb8380 con 0x55cf61df4400 2023-10-03T19:20:57.418 INFO:teuthology.orchestra.run.smithi045.stdout: -1267> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2183 6.21 6:862b00fc:::1000000006f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b8b500 con 0x55cf61df4c00 2023-10-03T19:20:57.418 INFO:teuthology.orchestra.run.smithi045.stdout: -1266> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2184 6.1d 6:b941cebe:::10000000070.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b8a700 con 0x55cf61df5000 2023-10-03T19:20:57.418 INFO:teuthology.orchestra.run.smithi045.stdout: -1265> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2185 6.10 6:0b002978:::10000000071.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b60a80 con 0x55cf61df5c00 2023-10-03T19:20:57.418 INFO:teuthology.orchestra.run.smithi045.stdout: -1264> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2186 6.2e 6:74d940fa:::10000000072.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b60700 con 0x55cf61df4800 2023-10-03T19:20:57.418 INFO:teuthology.orchestra.run.smithi045.stdout: -1263> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2187 6.e 6:730aba89:::10000000073.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a00a80 con 0x55cf61df5400 2023-10-03T19:20:57.418 INFO:teuthology.orchestra.run.smithi045.stdout: -1262> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2188 6.22 6:46f2014a:::10000000074.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a00380 con 0x55cf61df4800 2023-10-03T19:20:57.418 INFO:teuthology.orchestra.run.smithi045.stdout: -1261> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2189 6.4 6:2045e544:::10000000075.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61eb0700 con 0x55cf61df5000 2023-10-03T19:20:57.418 INFO:teuthology.orchestra.run.smithi045.stdout: -1260> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2190 6.13 6:ca508270:::10000000076.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61eb0380 con 0x55cf61df4400 2023-10-03T19:20:57.419 INFO:teuthology.orchestra.run.smithi045.stdout: -1259> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2191 6.1d 6:bab01cd9:::10000000077.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6203c380 con 0x55cf61df5000 2023-10-03T19:20:57.419 INFO:teuthology.orchestra.run.smithi045.stdout: -1258> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2192 6.38 6:1da7f472:::10000000078.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61feb880 con 0x55cf61df4400 2023-10-03T19:20:57.419 INFO:teuthology.orchestra.run.smithi045.stdout: -1257> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2193 6.19 6:99ec5763:::10000000079.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62466e00 con 0x55cf61c59000 2023-10-03T19:20:57.419 INFO:teuthology.orchestra.run.smithi045.stdout: -1256> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2194 6.2 6:4211db15:::1000000007a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61fe9c00 con 0x55cf61df5400 2023-10-03T19:20:57.419 INFO:teuthology.orchestra.run.smithi045.stdout: -1255> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2195 6.a 6:51fb4558:::1000000007b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61eace00 con 0x55cf61c59000 2023-10-03T19:20:57.419 INFO:teuthology.orchestra.run.smithi045.stdout: -1254> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2196 6.1d 6:bb142d16:::1000000007c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6203ca80 con 0x55cf61df5000 2023-10-03T19:20:57.419 INFO:teuthology.orchestra.run.smithi045.stdout: -1253> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2197 6.1e 6:7ab9e14a:::1000000007d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61eb1500 con 0x55cf61df5400 2023-10-03T19:20:57.420 INFO:teuthology.orchestra.run.smithi045.stdout: -1252> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2198 6.3d 6:bf02216c:::1000000007e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62448700 con 0x55cf61df5c00 2023-10-03T19:20:57.420 INFO:teuthology.orchestra.run.smithi045.stdout: -1251> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2199 6.30 6:0ffe11ed:::1000000007f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62057c00 con 0x55cf61df4c00 2023-10-03T19:20:57.420 INFO:teuthology.orchestra.run.smithi045.stdout: -1250> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2200 6.30 6:0f444cf3:::10000000080.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6204d500 con 0x55cf61df4c00 2023-10-03T19:20:57.420 INFO:teuthology.orchestra.run.smithi045.stdout: -1249> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2201 6.3 6:c27cb132:::10000000081.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf620ac380 con 0x55cf61df4c00 2023-10-03T19:20:57.420 INFO:teuthology.orchestra.run.smithi045.stdout: -1248> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2202 6.39 6:9eab5bef:::10000000082.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf620aca80 con 0x55cf61c59000 2023-10-03T19:20:57.420 INFO:teuthology.orchestra.run.smithi045.stdout: -1247> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2203 6.26 6:67d353d7:::10000000083.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62466a80 con 0x55cf61df5000 2023-10-03T19:20:57.420 INFO:teuthology.orchestra.run.smithi045.stdout: -1246> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2204 6.4 6:21b748bd:::10000000084.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6208b180 con 0x55cf61df5000 2023-10-03T19:20:57.421 INFO:teuthology.orchestra.run.smithi045.stdout: -1245> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2205 6.10 6:0a074d4e:::10000000085.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61ecd880 con 0x55cf61df5c00 2023-10-03T19:20:57.421 INFO:teuthology.orchestra.run.smithi045.stdout: -1244> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2206 6.2e 6:74218cdb:::10000000086.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6203c700 con 0x55cf61df4800 2023-10-03T19:20:57.421 INFO:teuthology.orchestra.run.smithi045.stdout: -1243> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2207 6.8 6:10a36097:::10000000087.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6243d880 con 0x55cf61df4c00 2023-10-03T19:20:57.421 INFO:teuthology.orchestra.run.smithi045.stdout: -1242> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2208 6.2f 6:f7140720:::10000000088.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61fe0700 con 0x55cf61df4c00 2023-10-03T19:20:57.421 INFO:teuthology.orchestra.run.smithi045.stdout: -1241> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2209 6.34 6:2e115d36:::10000000089.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62501180 con 0x55cf61df5c00 2023-10-03T19:20:57.421 INFO:teuthology.orchestra.run.smithi045.stdout: -1240> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2210 6.35 6:ae88c9e9:::1000000008a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61febc00 con 0x55cf61c59000 2023-10-03T19:20:57.421 INFO:teuthology.orchestra.run.smithi045.stdout: -1239> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2211 6.8 6:13275b8b:::1000000008b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61f59500 con 0x55cf61df4c00 2023-10-03T19:20:57.421 INFO:teuthology.orchestra.run.smithi045.stdout: -1238> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2212 6.3c 6:3c2e7968:::1000000008c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62056e00 con 0x55cf61df5800 2023-10-03T19:20:57.422 INFO:teuthology.orchestra.run.smithi045.stdout: -1237> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2213 6.26 6:67acbfb4:::1000000008d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6202e000 con 0x55cf61df5000 2023-10-03T19:20:57.422 INFO:teuthology.orchestra.run.smithi045.stdout: -1236> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2214 6.36 6:6cf8d55a:::1000000008e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62057500 con 0x55cf61df5c00 2023-10-03T19:20:57.422 INFO:teuthology.orchestra.run.smithi045.stdout: -1235> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2215 6.2d 6:b6d5679c:::1000000008f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6200c700 con 0x55cf61df5800 2023-10-03T19:20:57.422 INFO:teuthology.orchestra.run.smithi045.stdout: -1234> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2216 6.23 6:c454cd7f:::10000000090.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf624b8e00 con 0x55cf61df4800 2023-10-03T19:20:57.422 INFO:teuthology.orchestra.run.smithi045.stdout: -1233> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2217 6.14 6:2b22960d:::10000000091.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf624b9180 con 0x55cf61df5800 2023-10-03T19:20:57.422 INFO:teuthology.orchestra.run.smithi045.stdout: -1232> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2218 6.c 6:317b49a4:::10000000092.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62501c00 con 0x55cf61df4400 2023-10-03T19:20:57.422 INFO:teuthology.orchestra.run.smithi045.stdout: -1231> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2219 6.c 6:30dd2ab9:::10000000093.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a83500 con 0x55cf61df4400 2023-10-03T19:20:57.422 INFO:teuthology.orchestra.run.smithi045.stdout: -1230> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2220 6.13 6:c844618d:::10000000094.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a2b880 con 0x55cf61df4400 2023-10-03T19:20:57.423 INFO:teuthology.orchestra.run.smithi045.stdout: -1229> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2221 6.12 6:4aa41a21:::10000000095.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a2aa80 con 0x55cf61df4c00 2023-10-03T19:20:57.423 INFO:teuthology.orchestra.run.smithi045.stdout: -1228> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2222 6.33 6:cee3daff:::10000000096.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a2a000 con 0x55cf61c59000 2023-10-03T19:20:57.423 INFO:teuthology.orchestra.run.smithi045.stdout: -1227> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2223 6.3f 6:fc8be962:::10000000097.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a01880 con 0x55cf61df4400 2023-10-03T19:20:57.423 INFO:teuthology.orchestra.run.smithi045.stdout: -1226> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2224 6.2e 6:77d1cb76:::10000000098.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62057880 con 0x55cf61df4800 2023-10-03T19:20:57.423 INFO:teuthology.orchestra.run.smithi045.stdout: -1225> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2225 6.32 6:4e69e568:::10000000099.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6204fc00 con 0x55cf61df5400 2023-10-03T19:20:57.423 INFO:teuthology.orchestra.run.smithi045.stdout: -1224> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2226 6.0 6:03c4ee74:::1000000009a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62098380 con 0x55cf61df5c00 2023-10-03T19:20:57.423 INFO:teuthology.orchestra.run.smithi045.stdout: -1223> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2227 6.37 6:eccff461:::1000000009b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61fe8700 con 0x55cf61df5c00 2023-10-03T19:20:57.424 INFO:teuthology.orchestra.run.smithi045.stdout: -1222> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2228 6.36 6:6c8b6cb2:::1000000009c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62387c00 con 0x55cf61df5c00 2023-10-03T19:20:57.424 INFO:teuthology.orchestra.run.smithi045.stdout: -1221> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2229 6.36 6:6f6a1eb0:::1000000009d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63c13500 con 0x55cf61df5c00 2023-10-03T19:20:57.424 INFO:teuthology.orchestra.run.smithi045.stdout: -1220> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2230 6.e 6:70913c6f:::1000000009e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63be5500 con 0x55cf61df5400 2023-10-03T19:20:57.424 INFO:teuthology.orchestra.run.smithi045.stdout: -1219> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2231 6.33 6:cf652552:::1000000009f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63bb9c00 con 0x55cf61c59000 2023-10-03T19:20:57.424 INFO:teuthology.orchestra.run.smithi045.stdout: -1218> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2232 6.2b 6:d4ac5e36:::100000000a0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63bb8700 con 0x55cf61c59000 2023-10-03T19:20:57.424 INFO:teuthology.orchestra.run.smithi045.stdout: -1217> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2233 6.4 6:23d81b1d:::100000000a1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b8bc00 con 0x55cf61df5000 2023-10-03T19:20:57.424 INFO:teuthology.orchestra.run.smithi045.stdout: -1216> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2234 6.2a 6:5644b0dd:::100000000a2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b32a80 con 0x55cf61df5400 2023-10-03T19:20:57.424 INFO:teuthology.orchestra.run.smithi045.stdout: -1215> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2235 6.14 6:2800edac:::100000000a3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b32380 con 0x55cf61df5800 2023-10-03T19:20:57.425 INFO:teuthology.orchestra.run.smithi045.stdout: -1214> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2236 6.c 6:33682534:::100000000a4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b07c00 con 0x55cf61df4400 2023-10-03T19:20:57.425 INFO:teuthology.orchestra.run.smithi045.stdout: -1213> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2237 6.1c 6:3948beee:::100000000a5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b07500 con 0x55cf61df4c00 2023-10-03T19:20:57.425 INFO:teuthology.orchestra.run.smithi045.stdout: -1212> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2238 6.1 6:82c5dbfa:::100000000a6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b06380 con 0x55cf61df5000 2023-10-03T19:20:57.425 INFO:teuthology.orchestra.run.smithi045.stdout: -1211> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2239 6.2d 6:b683ac1f:::100000000a7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63ab1c00 con 0x55cf61df5800 2023-10-03T19:20:57.425 INFO:teuthology.orchestra.run.smithi045.stdout: -1210> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2240 6.33 6:cf66c3a3:::100000000a8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63ab0700 con 0x55cf61c59000 2023-10-03T19:20:57.425 INFO:teuthology.orchestra.run.smithi045.stdout: -1209> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2241 6.12 6:496373b3:::100000000a9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a83180 con 0x55cf61df4c00 2023-10-03T19:20:57.425 INFO:teuthology.orchestra.run.smithi045.stdout: -1208> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2242 6.3b 6:dfd961c9:::100000000aa.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a82380 con 0x55cf61df5800 2023-10-03T19:20:57.426 INFO:teuthology.orchestra.run.smithi045.stdout: -1207> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2243 6.28 6:16ce2f56:::100000000ab.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a55c00 con 0x55cf61df5800 2023-10-03T19:20:57.426 INFO:teuthology.orchestra.run.smithi045.stdout: -1206> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2244 6.26 6:65e71c10:::100000000ac.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a54a80 con 0x55cf61df5000 2023-10-03T19:20:57.426 INFO:teuthology.orchestra.run.smithi045.stdout: -1205> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2245 6.3c 6:3ca8796c:::100000000ad.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a2a700 con 0x55cf61df5800 2023-10-03T19:20:57.426 INFO:teuthology.orchestra.run.smithi045.stdout: -1204> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2246 6.2b 6:d77b40aa:::100000000ae.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a00700 con 0x55cf61c59000 2023-10-03T19:20:57.426 INFO:teuthology.orchestra.run.smithi045.stdout: -1203> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2247 6.8 6:12260154:::100000000af.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a00000 con 0x55cf61df4c00 2023-10-03T19:20:57.426 INFO:teuthology.orchestra.run.smithi045.stdout: -1202> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2248 6.19 6:99a6d8b2:::100000000b0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf639d4e00 con 0x55cf61c59000 2023-10-03T19:20:57.426 INFO:teuthology.orchestra.run.smithi045.stdout: -1201> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2249 6.25 6:a4b351a2:::100000000b1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf639d4700 con 0x55cf61df4800 2023-10-03T19:20:57.427 INFO:teuthology.orchestra.run.smithi045.stdout: -1200> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2250 6.20 6:05e903ec:::100000000b2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62021c00 con 0x55cf61df5000 2023-10-03T19:20:57.427 INFO:teuthology.orchestra.run.smithi045.stdout: -1199> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2251 6.1d 6:bbfd17d2:::100000000b3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62057180 con 0x55cf61df5000 2023-10-03T19:20:57.427 INFO:teuthology.orchestra.run.smithi045.stdout: -1198> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2252 6.3f 6:fc47e501:::100000000b4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61e66a80 con 0x55cf61df4400 2023-10-03T19:20:57.427 INFO:teuthology.orchestra.run.smithi045.stdout: -1197> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2253 6.29 6:959d3147:::100000000b5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6204f180 con 0x55cf61df4c00 2023-10-03T19:20:57.427 INFO:teuthology.orchestra.run.smithi045.stdout: -1196> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2254 6.21 6:869f8614:::100000000b6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61fea700 con 0x55cf61df4c00 2023-10-03T19:20:57.427 INFO:teuthology.orchestra.run.smithi045.stdout: -1195> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2255 6.13 6:c826941c:::100000000b7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6204ce00 con 0x55cf61df4400 2023-10-03T19:20:57.427 INFO:teuthology.orchestra.run.smithi045.stdout: -1194> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2256 6.23 6:c7a7e7ed:::100000000b8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6239dc00 con 0x55cf61df4800 2023-10-03T19:20:57.427 INFO:teuthology.orchestra.run.smithi045.stdout: -1193> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2257 6.2a 6:576d20de:::100000000b9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62448a80 con 0x55cf61df5400 2023-10-03T19:20:57.900 INFO:teuthology.orchestra.run.smithi045.stdout: -1192> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2258 6.28 6:14bef4b2:::100000000ba.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf635c5c00 con 0x55cf61df5800 2023-10-03T19:20:57.900 INFO:teuthology.orchestra.run.smithi045.stdout: -1191> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2259 6.4 6:21fe71c4:::100000000bb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf620ac000 con 0x55cf61df5000 2023-10-03T19:20:57.900 INFO:teuthology.orchestra.run.smithi045.stdout: -1190> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2260 6.1d 6:ba036218:::100000000bc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62098e00 con 0x55cf61df5000 2023-10-03T19:20:57.901 INFO:teuthology.orchestra.run.smithi045.stdout: -1189> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2261 6.2 6:43b4b389:::100000000bd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62386380 con 0x55cf61df5400 2023-10-03T19:20:57.901 INFO:teuthology.orchestra.run.smithi045.stdout: -1188> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2262 6.18 6:196d4b2b:::100000000be.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62501500 con 0x55cf61df5c00 2023-10-03T19:20:57.901 INFO:teuthology.orchestra.run.smithi045.stdout: -1187> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2263 6.2f 6:f46eb3ed:::100000000bf.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6200d180 con 0x55cf61df4c00 2023-10-03T19:20:57.901 INFO:teuthology.orchestra.run.smithi045.stdout: -1186> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2264 6.2 6:42142be5:::100000000c0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62501880 con 0x55cf61df5400 2023-10-03T19:20:57.901 INFO:teuthology.orchestra.run.smithi045.stdout: -1185> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2265 6.18 6:18cb83ce:::100000000c1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b8a000 con 0x55cf61df5c00 2023-10-03T19:20:57.901 INFO:teuthology.orchestra.run.smithi045.stdout: -1184> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2266 6.36 6:6c9ae960:::100000000c2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b32e00 con 0x55cf61df5c00 2023-10-03T19:20:57.901 INFO:teuthology.orchestra.run.smithi045.stdout: -1183> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2267 6.1f 6:f8d20c92:::100000000c3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a55880 con 0x55cf61df4400 2023-10-03T19:20:57.901 INFO:teuthology.orchestra.run.smithi045.stdout: -1182> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2268 6.1c 6:3990871b:::100000000c4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a54e00 con 0x55cf61df4c00 2023-10-03T19:20:57.902 INFO:teuthology.orchestra.run.smithi045.stdout: -1181> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2269 6.16 6:680c46c7:::100000000c5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a2bc00 con 0x55cf61df5c00 2023-10-03T19:20:57.902 INFO:teuthology.orchestra.run.smithi045.stdout: -1180> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2270 6.17 6:eb7dd551:::100000000c6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a2ae00 con 0x55cf61df5400 2023-10-03T19:20:57.902 INFO:teuthology.orchestra.run.smithi045.stdout: -1179> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2271 6.36 6:6e30e37c:::100000000c7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a01c00 con 0x55cf61df5c00 2023-10-03T19:20:57.902 INFO:teuthology.orchestra.run.smithi045.stdout: -1178> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2272 6.f 6:f28dc9ad:::100000000c8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a01500 con 0x55cf61df5800 2023-10-03T19:20:57.902 INFO:teuthology.orchestra.run.smithi045.stdout: -1177> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2273 6.11 6:8a614455:::100000000c9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a01180 con 0x55cf61df4400 2023-10-03T19:20:57.903 INFO:teuthology.orchestra.run.smithi045.stdout: -1176> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2274 6.2 6:418539fe:::100000000ca.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf639d5880 con 0x55cf61df5400 2023-10-03T19:20:57.903 INFO:teuthology.orchestra.run.smithi045.stdout: -1175> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2275 6.3a 6:5e2665ab:::100000000cb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf639d4a80 con 0x55cf61df5000 2023-10-03T19:20:57.903 INFO:teuthology.orchestra.run.smithi045.stdout: -1174> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2276 6.3e 6:7db06380:::100000000cc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61eb1180 con 0x55cf61df4400 2023-10-03T19:20:57.904 INFO:teuthology.orchestra.run.smithi045.stdout: -1173> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2277 6.33 6:cc35cb30:::100000000cd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62466380 con 0x55cf61c59000 2023-10-03T19:20:57.904 INFO:teuthology.orchestra.run.smithi045.stdout: -1172> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2278 6.11 6:89a13bde:::100000000ce.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6239ce00 con 0x55cf61df4400 2023-10-03T19:20:57.904 INFO:teuthology.orchestra.run.smithi045.stdout: -1171> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2279 6.19 6:9baaf7f1:::100000000cf.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61f58380 con 0x55cf61c59000 2023-10-03T19:20:57.904 INFO:teuthology.orchestra.run.smithi045.stdout: -1170> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2280 6.1b 6:d9cb565c:::100000000d0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62098a80 con 0x55cf61df4400 2023-10-03T19:20:57.905 INFO:teuthology.orchestra.run.smithi045.stdout: -1169> 2023-10-03T19:15:19.879+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2281 6.5 6:a391cf2b:::100000000d1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62020e00 con 0x55cf61df4c00 2023-10-03T19:20:57.905 INFO:teuthology.orchestra.run.smithi045.stdout: -1168> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2282 6.38 6:1e907e28:::100000000d2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62500700 con 0x55cf61df4400 2023-10-03T19:20:57.905 INFO:teuthology.orchestra.run.smithi045.stdout: -1167> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2283 6.17 6:e88d3223:::100000000d3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf635c4380 con 0x55cf61df5400 2023-10-03T19:20:57.905 INFO:teuthology.orchestra.run.smithi045.stdout: -1166> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2284 6.b 6:d02f84b5:::100000000d4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61eb1c00 con 0x55cf61df4400 2023-10-03T19:20:57.905 INFO:teuthology.orchestra.run.smithi045.stdout: -1165> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2285 6.29 6:963c36ab:::100000000d5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6203ce00 con 0x55cf61df4c00 2023-10-03T19:20:57.906 INFO:teuthology.orchestra.run.smithi045.stdout: -1164> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2286 6.1c 6:38569cab:::100000000d6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62098000 con 0x55cf61df4c00 2023-10-03T19:20:57.906 INFO:teuthology.orchestra.run.smithi045.stdout: -1163> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2287 6.18 6:1bd5bb9e:::100000000d7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62449880 con 0x55cf61df5c00 2023-10-03T19:20:57.906 INFO:teuthology.orchestra.run.smithi045.stdout: -1162> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2288 6.1e 6:7b9ba906:::100000000d8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6200ca80 con 0x55cf61df5400 2023-10-03T19:20:57.906 INFO:teuthology.orchestra.run.smithi045.stdout: -1161> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2289 6.10 6:09e2658b:::100000000d9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6200c000 con 0x55cf61df5c00 2023-10-03T19:20:57.906 INFO:teuthology.orchestra.run.smithi045.stdout: -1160> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2290 6.21 6:84e04a5a:::100000000da.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6200ce00 con 0x55cf61df4c00 2023-10-03T19:20:57.906 INFO:teuthology.orchestra.run.smithi045.stdout: -1159> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2291 6.15 6:aa9378d8:::100000000db.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62387500 con 0x55cf61df4c00 2023-10-03T19:20:57.906 INFO:teuthology.orchestra.run.smithi045.stdout: -1158> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2292 6.13 6:c84cd983:::100000000dc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62500e00 con 0x55cf61df4400 2023-10-03T19:20:57.906 INFO:teuthology.orchestra.run.smithi045.stdout: -1157> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2293 6.26 6:65f6e386:::100000000dd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61fea380 con 0x55cf61df5000 2023-10-03T19:20:57.907 INFO:teuthology.orchestra.run.smithi045.stdout: -1156> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2294 6.f 6:f1207765:::100000000de.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61f58e00 con 0x55cf61df5800 2023-10-03T19:20:57.907 INFO:teuthology.orchestra.run.smithi045.stdout: -1155> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2295 6.2f 6:f71b5472:::100000000df.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62056a80 con 0x55cf61df4c00 2023-10-03T19:20:57.907 INFO:teuthology.orchestra.run.smithi045.stdout: -1154> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2296 6.3 6:c239e8b3:::100000000e0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61ecc700 con 0x55cf61df4c00 2023-10-03T19:20:57.907 INFO:teuthology.orchestra.run.smithi045.stdout: -1153> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2297 6.17 6:eba7c799:::100000000e1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61ecd500 con 0x55cf61df5400 2023-10-03T19:20:57.907 INFO:teuthology.orchestra.run.smithi045.stdout: -1152> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2298 6.12 6:4a996524:::100000000e2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61ecc000 con 0x55cf61df4c00 2023-10-03T19:20:57.907 INFO:teuthology.orchestra.run.smithi045.stdout: -1151> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2299 6.1f 6:f93d8c0a:::100000000e3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf623f6a80 con 0x55cf61df4400 2023-10-03T19:20:57.907 INFO:teuthology.orchestra.run.smithi045.stdout: -1150> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2300 6.39 6:9c66f7cb:::100000000e4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61feb180 con 0x55cf61c59000 2023-10-03T19:20:57.907 INFO:teuthology.orchestra.run.smithi045.stdout: -1149> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2301 6.1d 6:bba66d05:::100000000e5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6204e700 con 0x55cf61df5000 2023-10-03T19:20:57.908 INFO:teuthology.orchestra.run.smithi045.stdout: -1148> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2302 6.39 6:9de3e889:::100000000e6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62099c00 con 0x55cf61c59000 2023-10-03T19:20:57.908 INFO:teuthology.orchestra.run.smithi045.stdout: -1147> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2303 6.36 6:6c62f82b:::100000000e7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62500a80 con 0x55cf61df5c00 2023-10-03T19:20:57.908 INFO:teuthology.orchestra.run.smithi045.stdout: -1146> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2304 6.1b 6:dba0574f:::100000000e8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62452e00 con 0x55cf61df4400 2023-10-03T19:20:57.908 INFO:teuthology.orchestra.run.smithi045.stdout: -1145> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2305 6.4 6:235bfa30:::100000000e9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf635c4e00 con 0x55cf61df5000 2023-10-03T19:20:57.908 INFO:teuthology.orchestra.run.smithi045.stdout: -1144> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2306 6.2a 6:54beb349:::100000000ea.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf635c5880 con 0x55cf61df5400 2023-10-03T19:20:57.908 INFO:teuthology.orchestra.run.smithi045.stdout: -1143> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2307 6.5 6:a3215264:::100000000eb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6204c380 con 0x55cf61df4c00 2023-10-03T19:20:57.908 INFO:teuthology.orchestra.run.smithi045.stdout: -1142> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2308 6.4 6:20ceeb1e:::100000000ec.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf620ace00 con 0x55cf61df5000 2023-10-03T19:20:57.908 INFO:teuthology.orchestra.run.smithi045.stdout: -1141> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2309 6.1d 6:b9cee72b:::100000000ed.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62034380 con 0x55cf61df5000 2023-10-03T19:20:57.909 INFO:teuthology.orchestra.run.smithi045.stdout: -1140> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2310 6.30 6:0c88ada4:::100000000ee.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61e66000 con 0x55cf61df4c00 2023-10-03T19:20:57.909 INFO:teuthology.orchestra.run.smithi045.stdout: -1139> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2311 6.13 6:c8202536:::100000000ef.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62448e00 con 0x55cf61df4400 2023-10-03T19:20:57.909 INFO:teuthology.orchestra.run.smithi045.stdout: -1138> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2312 6.37 6:ef416527:::100000000f0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf623bf180 con 0x55cf61df5c00 2023-10-03T19:20:57.909 INFO:teuthology.orchestra.run.smithi045.stdout: -1137> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2313 6.3f 6:fea3f43b:::100000000f1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf635c5180 con 0x55cf61df4400 2023-10-03T19:20:57.909 INFO:teuthology.orchestra.run.smithi045.stdout: -1136> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2314 6.33 6:cff7f4bd:::100000000f2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf635c4a80 con 0x55cf61c59000 2023-10-03T19:20:57.909 INFO:teuthology.orchestra.run.smithi045.stdout: -1135> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2315 6.d 6:b0cc5b52:::100000000f3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62098e00 con 0x55cf61c59000 2023-10-03T19:20:57.910 INFO:teuthology.orchestra.run.smithi045.stdout: -1134> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2316 6.13 6:c97f6a48:::100000000f4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf620ac000 con 0x55cf61df4400 2023-10-03T19:20:57.910 INFO:teuthology.orchestra.run.smithi045.stdout: -1133> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2317 6.2b 6:d6a65225:::100000000f5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62057180 con 0x55cf61c59000 2023-10-03T19:20:57.910 INFO:teuthology.orchestra.run.smithi045.stdout: -1132> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2318 6.b 6:d1f1a6ab:::100000000f6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62021c00 con 0x55cf61df4400 2023-10-03T19:20:57.910 INFO:teuthology.orchestra.run.smithi045.stdout: -1131> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2319 6.12 6:482fe7bc:::100000000f7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a54a80 con 0x55cf61df4c00 2023-10-03T19:20:57.910 INFO:teuthology.orchestra.run.smithi045.stdout: -1130> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2320 6.1f 6:fa69016c:::100000000f8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b06380 con 0x55cf61df4400 2023-10-03T19:20:57.910 INFO:teuthology.orchestra.run.smithi045.stdout: -1129> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2321 6.f 6:f264201d:::100000000f9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b8bc00 con 0x55cf61df5800 2023-10-03T19:20:57.910 INFO:teuthology.orchestra.run.smithi045.stdout: -1128> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2322 6.2e 6:752cd5de:::100000000fa.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6202e000 con 0x55cf61df4800 2023-10-03T19:20:57.910 INFO:teuthology.orchestra.run.smithi045.stdout: -1127> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2323 6.0 6:00b77ae3:::100000000fb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6208b180 con 0x55cf61df5c00 2023-10-03T19:20:57.911 INFO:teuthology.orchestra.run.smithi045.stdout: -1126> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2324 6.36 6:6dd545dc:::100000000fc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62466a80 con 0x55cf61df5c00 2023-10-03T19:20:57.911 INFO:teuthology.orchestra.run.smithi045.stdout: -1125> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2325 6.2d 6:b6610622:::100000000fd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6203ca80 con 0x55cf61df5800 2023-10-03T19:20:57.911 INFO:teuthology.orchestra.run.smithi045.stdout: -1124> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2326 6.3d 6:be8dfa60:::100000000fe.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6203c380 con 0x55cf61df5c00 2023-10-03T19:20:57.911 INFO:teuthology.orchestra.run.smithi045.stdout: -1123> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2327 6.13 6:ca01a157:::100000000ff.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61eb0700 con 0x55cf61df4400 2023-10-03T19:20:57.911 INFO:teuthology.orchestra.run.smithi045.stdout: -1122> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2328 6.16 6:69f8b284:::10000000100.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b8a700 con 0x55cf61df5c00 2023-10-03T19:20:57.911 INFO:teuthology.orchestra.run.smithi045.stdout: -1121> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2329 6.3e 6:7d5083c7:::10000000101.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63c12a80 con 0x55cf61df4400 2023-10-03T19:20:57.911 INFO:teuthology.orchestra.run.smithi045.stdout: -1120> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2330 6.13 6:ca2b2f16:::10000000102.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63adbc00 con 0x55cf61df4400 2023-10-03T19:20:57.912 INFO:teuthology.orchestra.run.smithi045.stdout: -1119> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2331 6.31 6:8c3ca124:::10000000103.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a54700 con 0x55cf61c59000 2023-10-03T19:20:57.912 INFO:teuthology.orchestra.run.smithi045.stdout: -1118> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2332 6.36 6:6f4aafed:::10000000104.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62500a80 con 0x55cf61df5c00 2023-10-03T19:20:57.912 INFO:teuthology.orchestra.run.smithi045.stdout: -1117> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2333 6.10 6:088ef71a:::10000000105.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6200c000 con 0x55cf61df5c00 2023-10-03T19:20:57.912 INFO:teuthology.orchestra.run.smithi045.stdout: -1116> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2334 6.14 6:285116e2:::10000000106.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62449880 con 0x55cf61df5800 2023-10-03T19:20:57.912 INFO:teuthology.orchestra.run.smithi045.stdout: -1115> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2335 6.3f 6:fe10ede2:::10000000107.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a01c00 con 0x55cf61df4400 2023-10-03T19:20:57.912 INFO:teuthology.orchestra.run.smithi045.stdout: -1114> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2336 6.30 6:0fd9593b:::10000000108.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a2bc00 con 0x55cf61df4c00 2023-10-03T19:20:57.912 INFO:teuthology.orchestra.run.smithi045.stdout: -1113> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2337 6.37 6:ee98d4aa:::10000000109.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b32e00 con 0x55cf61df5c00 2023-10-03T19:20:57.913 INFO:teuthology.orchestra.run.smithi045.stdout: -1112> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2338 6.14 6:2b0c3f61:::1000000010a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b8a000 con 0x55cf61df5800 2023-10-03T19:20:57.913 INFO:teuthology.orchestra.run.smithi045.stdout: -1111> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2339 6.3f 6:fe23482d:::1000000010b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62501500 con 0x55cf61df4400 2023-10-03T19:20:57.913 INFO:teuthology.orchestra.run.smithi045.stdout: -1110> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2340 6.d 6:b247ee27:::1000000010c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63c13500 con 0x55cf61c59000 2023-10-03T19:20:57.913 INFO:teuthology.orchestra.run.smithi045.stdout: -1109> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2341 6.26 6:67d72c52:::1000000010d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62387c00 con 0x55cf61df5000 2023-10-03T19:20:57.913 INFO:teuthology.orchestra.run.smithi045.stdout: -1108> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2342 6.2a 6:542953c1:::1000000010e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61fe8700 con 0x55cf61df5400 2023-10-03T19:20:57.913 INFO:teuthology.orchestra.run.smithi045.stdout: -1107> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2343 6.30 6:0c13cd34:::1000000010f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62098380 con 0x55cf61df4c00 2023-10-03T19:20:57.913 INFO:teuthology.orchestra.run.smithi045.stdout: -1106> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2344 6.26 6:64ce44bf:::10000000110.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62057500 con 0x55cf61df5000 2023-10-03T19:20:57.914 INFO:teuthology.orchestra.run.smithi045.stdout: -1105> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2345 6.22 6:46c9ad04:::10000000111.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62501180 con 0x55cf61df4800 2023-10-03T19:20:57.914 INFO:teuthology.orchestra.run.smithi045.stdout: -1104> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2346 6.0 6:006fa129:::10000000112.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61ecd880 con 0x55cf61df5c00 2023-10-03T19:20:57.914 INFO:teuthology.orchestra.run.smithi045.stdout: -1103> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2347 6.1f 6:fa9b3804:::10000000113.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62448700 con 0x55cf61df4400 2023-10-03T19:20:57.914 INFO:teuthology.orchestra.run.smithi045.stdout: -1102> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2348 6.0 6:005b64bc:::10000000114.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b60a80 con 0x55cf61df5c00 2023-10-03T19:20:57.914 INFO:teuthology.orchestra.run.smithi045.stdout: -1101> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2349 6.2a 6:575ae04b:::10000000115.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63be5880 con 0x55cf61df5400 2023-10-03T19:20:57.914 INFO:teuthology.orchestra.run.smithi045.stdout: -1100> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2350 6.17 6:ea138f4d:::10000000116.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61eac000 con 0x55cf61df5400 2023-10-03T19:20:57.915 INFO:teuthology.orchestra.run.smithi045.stdout: -1099> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2351 6.23 6:c507b3c5:::10000000117.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62020700 con 0x55cf61df4800 2023-10-03T19:20:57.915 INFO:teuthology.orchestra.run.smithi045.stdout: -1098> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2352 6.25 6:a6db094f:::10000000118.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf623be700 con 0x55cf61df4800 2023-10-03T19:20:57.915 INFO:teuthology.orchestra.run.smithi045.stdout: -1097> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2353 6.3 6:c1b999d7:::10000000119.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61f58380 con 0x55cf61df4c00 2023-10-03T19:20:57.915 INFO:teuthology.orchestra.run.smithi045.stdout: -1096> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2354 6.2a 6:565108ac:::1000000011a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62466380 con 0x55cf61df5400 2023-10-03T19:20:57.915 INFO:teuthology.orchestra.run.smithi045.stdout: -1095> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2355 6.36 6:6e600286:::1000000011b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf639d4e00 con 0x55cf61df5c00 2023-10-03T19:20:57.915 INFO:teuthology.orchestra.run.smithi045.stdout: -1094> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2356 6.b 6:d200bef4:::1000000011c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a00700 con 0x55cf61df4400 2023-10-03T19:20:57.916 INFO:teuthology.orchestra.run.smithi045.stdout: -1093> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2357 6.3a 6:5d261264:::1000000011d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63ab0700 con 0x55cf61df5000 2023-10-03T19:20:57.916 INFO:teuthology.orchestra.run.smithi045.stdout: -1092> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2358 6.10 6:08a5cadf:::1000000011e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63bb8700 con 0x55cf61df5c00 2023-10-03T19:20:57.916 INFO:teuthology.orchestra.run.smithi045.stdout: -1091> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2359 6.2b 6:d6a4c2d3:::1000000011f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63bb9c00 con 0x55cf61c59000 2023-10-03T19:20:57.916 INFO:teuthology.orchestra.run.smithi045.stdout: -1090> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2360 6.15 6:a96960f2:::10000000120.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a2a000 con 0x55cf61df4c00 2023-10-03T19:20:57.916 INFO:teuthology.orchestra.run.smithi045.stdout: -1089> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2361 6.2d 6:b4f06a36:::10000000121.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61febc00 con 0x55cf61df5800 2023-10-03T19:20:57.916 INFO:teuthology.orchestra.run.smithi045.stdout: -1088> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2362 6.1e 6:7b093fa4:::10000000122.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf620aca80 con 0x55cf61df5400 2023-10-03T19:20:57.916 INFO:teuthology.orchestra.run.smithi045.stdout: -1087> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2363 6.36 6:6f395059:::10000000123.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61eace00 con 0x55cf61df5c00 2023-10-03T19:20:57.917 INFO:teuthology.orchestra.run.smithi045.stdout: -1086> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2364 6.27 6:e5c20fbc:::10000000124.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62466e00 con 0x55cf61df4800 2023-10-03T19:20:57.917 INFO:teuthology.orchestra.run.smithi045.stdout: -1085> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2365 6.14 6:2b82a036:::10000000125.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63be5c00 con 0x55cf61df5800 2023-10-03T19:20:57.917 INFO:teuthology.orchestra.run.smithi045.stdout: -1084> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2366 6.34 6:2f934c4e:::10000000126.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63be4e00 con 0x55cf61df5c00 2023-10-03T19:20:57.938 INFO:teuthology.orchestra.run.smithi045.stdout: -1083> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2367 6.0 6:03f08cc0:::10000000127.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b60e00 con 0x55cf61df5c00 2023-10-03T19:20:57.938 INFO:teuthology.orchestra.run.smithi045.stdout: -1082> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2368 6.2 6:4319aaa2:::10000000128.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63bb8e00 con 0x55cf61df5400 2023-10-03T19:20:57.938 INFO:teuthology.orchestra.run.smithi045.stdout: -1081> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2369 6.1 6:802a5bbd:::10000000129.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b07180 con 0x55cf61df5000 2023-10-03T19:20:57.938 INFO:teuthology.orchestra.run.smithi045.stdout: -1080> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2370 6.38 6:1c1bce02:::1000000012a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63ada380 con 0x55cf61df4400 2023-10-03T19:20:57.938 INFO:teuthology.orchestra.run.smithi045.stdout: -1079> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2371 6.9 6:930ba3bb:::1000000012b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63ab1180 con 0x55cf61df5c00 2023-10-03T19:20:57.938 INFO:teuthology.orchestra.run.smithi045.stdout: -1078> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2372 6.2d 6:b4fb9bd9:::1000000012c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b32000 con 0x55cf61df5800 2023-10-03T19:20:57.939 INFO:teuthology.orchestra.run.smithi045.stdout: -1077> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2373 6.37 6:ee6a6ac0:::1000000012d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b33500 con 0x55cf61df5c00 2023-10-03T19:20:57.939 INFO:teuthology.orchestra.run.smithi045.stdout: -1076> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2374 6.2 6:439e92fb:::1000000012e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63c13c00 con 0x55cf61df5400 2023-10-03T19:20:57.939 INFO:teuthology.orchestra.run.smithi045.stdout: -1075> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2375 6.4 6:23f83e86:::1000000012f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62099500 con 0x55cf61df5000 2023-10-03T19:20:57.939 INFO:teuthology.orchestra.run.smithi045.stdout: -1074> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2376 6.15 6:abaacf15:::10000000130.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a54000 con 0x55cf61df4c00 2023-10-03T19:20:57.939 INFO:teuthology.orchestra.run.smithi045.stdout: -1073> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2377 6.35 6:af7e9f79:::10000000131.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63bb8a80 con 0x55cf61c59000 2023-10-03T19:20:57.939 INFO:teuthology.orchestra.run.smithi045.stdout: -1072> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2378 6.28 6:14babc15:::10000000132.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61eb0a80 con 0x55cf61df5800 2023-10-03T19:20:57.939 INFO:teuthology.orchestra.run.smithi045.stdout: -1071> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2379 6.3d 6:beed21fb:::10000000133.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63ab0000 con 0x55cf61df5c00 2023-10-03T19:20:57.940 INFO:teuthology.orchestra.run.smithi045.stdout: -1070> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2380 6.2 6:40fdd18a:::10000000134.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63ab0a80 con 0x55cf61df5400 2023-10-03T19:20:57.940 INFO:teuthology.orchestra.run.smithi045.stdout: -1069> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2381 6.3f 6:fedcb8c2:::10000000135.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63ab0e00 con 0x55cf61df4400 2023-10-03T19:20:57.940 INFO:teuthology.orchestra.run.smithi045.stdout: -1068> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2382 6.18 6:1b569a42:::10000000136.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63ab1880 con 0x55cf61df5c00 2023-10-03T19:20:57.940 INFO:teuthology.orchestra.run.smithi045.stdout: -1067> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2383 6.17 6:e994506f:::10000000137.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a82e00 con 0x55cf61df5400 2023-10-03T19:20:57.940 INFO:teuthology.orchestra.run.smithi045.stdout: -1066> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2384 6.6 6:629cc6bc:::10000000138.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a83c00 con 0x55cf61df4400 2023-10-03T19:20:57.940 INFO:teuthology.orchestra.run.smithi045.stdout: -1065> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2385 6.8 6:1176dc39:::10000000139.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a55500 con 0x55cf61df4c00 2023-10-03T19:20:57.941 INFO:teuthology.orchestra.run.smithi045.stdout: -1064> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2386 6.1a 6:5997e84c:::1000000013a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a2b180 con 0x55cf61df5400 2023-10-03T19:20:57.941 INFO:teuthology.orchestra.run.smithi045.stdout: -1063> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2387 6.1c 6:3800373d:::1000000013b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf639d4380 con 0x55cf61df4c00 2023-10-03T19:20:57.941 INFO:teuthology.orchestra.run.smithi045.stdout: -1062> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2388 6.36 6:6c5ddb65:::1000000013c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf639d5180 con 0x55cf61df5c00 2023-10-03T19:20:57.941 INFO:teuthology.orchestra.run.smithi045.stdout: -1061> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2389 6.33 6:ce600bd1:::1000000013d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61eb0e00 con 0x55cf61c59000 2023-10-03T19:20:57.941 INFO:teuthology.orchestra.run.smithi045.stdout: -1060> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2390 6.35 6:ae56dbe9:::1000000013e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6203c000 con 0x55cf61c59000 2023-10-03T19:20:57.941 INFO:teuthology.orchestra.run.smithi045.stdout: -1059> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2391 6.2b 6:d47db6ab:::1000000013f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61ecd180 con 0x55cf61c59000 2023-10-03T19:20:57.941 INFO:teuthology.orchestra.run.smithi045.stdout: -1058> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2392 6.3b 6:dd7df288:::10000000140.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62467880 con 0x55cf61df5800 2023-10-03T19:20:57.941 INFO:teuthology.orchestra.run.smithi045.stdout: -1057> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2393 6.d 6:b296df2e:::10000000141.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62466000 con 0x55cf61c59000 2023-10-03T19:20:57.942 INFO:teuthology.orchestra.run.smithi045.stdout: -1056> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2394 6.1b 6:d9deb994:::10000000142.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf639d4380 con 0x55cf61df4400 2023-10-03T19:20:57.942 INFO:teuthology.orchestra.run.smithi045.stdout: -1055> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2395 6.2e 6:77f9b43c:::10000000143.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a55500 con 0x55cf61df4800 2023-10-03T19:20:57.942 INFO:teuthology.orchestra.run.smithi045.stdout: -1054> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2396 6.19 6:9ae704d2:::10000000144.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a54000 con 0x55cf61c59000 2023-10-03T19:20:57.942 INFO:teuthology.orchestra.run.smithi045.stdout: -1053> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2397 6.1a 6:587da770:::10000000145.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a2a000 con 0x55cf61df5400 2023-10-03T19:20:57.942 INFO:teuthology.orchestra.run.smithi045.stdout: -1052> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2398 6.3f 6:fd6fa633:::10000000146.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61f58380 con 0x55cf61df4400 2023-10-03T19:20:57.942 INFO:teuthology.orchestra.run.smithi045.stdout: -1051> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2399 6.2c 6:35111aed:::10000000147.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62098380 con 0x55cf61df4800 2023-10-03T19:20:57.942 INFO:teuthology.orchestra.run.smithi045.stdout: -1050> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2400 6.32 6:4eeada49:::10000000148.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a2bc00 con 0x55cf61df5400 2023-10-03T19:20:57.943 INFO:teuthology.orchestra.run.smithi045.stdout: -1049> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2401 6.11 6:8abfc0dc:::10000000149.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a54a80 con 0x55cf61df4400 2023-10-03T19:20:57.943 INFO:teuthology.orchestra.run.smithi045.stdout: -1048> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2402 6.17 6:e821ba07:::1000000014a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61e66000 con 0x55cf61df5400 2023-10-03T19:20:57.943 INFO:teuthology.orchestra.run.smithi045.stdout: -1047> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2403 6.3f 6:fc6ed777:::1000000014b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6204c380 con 0x55cf61df4400 2023-10-03T19:20:57.943 INFO:teuthology.orchestra.run.smithi045.stdout: -1046> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2404 6.b 6:d35c25ee:::1000000014c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61ecc000 con 0x55cf61df4400 2023-10-03T19:20:57.943 INFO:teuthology.orchestra.run.smithi045.stdout: -1045> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2405 6.c 6:31051922:::1000000014d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61ecc700 con 0x55cf61df4400 2023-10-03T19:20:57.943 INFO:teuthology.orchestra.run.smithi045.stdout: -1044> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2406 6.15 6:abf4da12:::1000000014e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62056a80 con 0x55cf61df4c00 2023-10-03T19:20:57.943 INFO:teuthology.orchestra.run.smithi045.stdout: -1043> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2407 6.2 6:42d137c4:::1000000014f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62387500 con 0x55cf61df5400 2023-10-03T19:20:57.944 INFO:teuthology.orchestra.run.smithi045.stdout: -1042> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2408 6.34 6:2dfce41c:::10000000150.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6200ce00 con 0x55cf61df5c00 2023-10-03T19:20:57.944 INFO:teuthology.orchestra.run.smithi045.stdout: -1041> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2409 6.31 6:8d77f5fc:::10000000151.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62098000 con 0x55cf61c59000 2023-10-03T19:20:57.944 INFO:teuthology.orchestra.run.smithi045.stdout: -1040> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2410 6.2a 6:553c495b:::10000000152.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6203ce00 con 0x55cf61df5400 2023-10-03T19:20:57.961 INFO:teuthology.orchestra.run.smithi045.stdout: -1039> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2411 6.a 6:512fb173:::10000000153.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62020e00 con 0x55cf61c59000 2023-10-03T19:20:58.059 INFO:teuthology.orchestra.run.smithi045.stdout: -1038> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2412 6.20 6:0654da44:::10000000154.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a54e00 con 0x55cf61df5000 2023-10-03T19:20:58.059 INFO:teuthology.orchestra.run.smithi045.stdout: -1037> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2413 6.31 6:8c35c3f8:::10000000155.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6200d180 con 0x55cf61c59000 2023-10-03T19:20:58.060 INFO:teuthology.orchestra.run.smithi045.stdout: -1036> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2414 6.29 6:96298894:::10000000156.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61fea700 con 0x55cf61df4c00 2023-10-03T19:20:58.060 INFO:teuthology.orchestra.run.smithi045.stdout: -1035> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2415 6.3c 6:3e33a224:::10000000157.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6204f180 con 0x55cf61df5800 2023-10-03T19:20:58.060 INFO:teuthology.orchestra.run.smithi045.stdout: -1034> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2416 6.11 6:885408d1:::10000000158.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a00000 con 0x55cf61df4400 2023-10-03T19:20:58.060 INFO:teuthology.orchestra.run.smithi045.stdout: -1033> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2417 6.35 6:ac4ca6af:::10000000159.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a83180 con 0x55cf61c59000 2023-10-03T19:20:58.060 INFO:teuthology.orchestra.run.smithi045.stdout: -1032> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2418 6.4 6:23cbca8f:::1000000015a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b07500 con 0x55cf61df5000 2023-10-03T19:20:58.060 INFO:teuthology.orchestra.run.smithi045.stdout: -1031> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2419 6.27 6:e6859628:::1000000015b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a2aa80 con 0x55cf61df4800 2023-10-03T19:20:58.061 INFO:teuthology.orchestra.run.smithi045.stdout: -1030> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2420 6.f 6:f04171b6:::1000000015c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61f59500 con 0x55cf61df5800 2023-10-03T19:20:58.061 INFO:teuthology.orchestra.run.smithi045.stdout: -1029> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2421 6.29 6:94a271f5:::1000000015d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61fe0700 con 0x55cf61df4c00 2023-10-03T19:20:58.061 INFO:teuthology.orchestra.run.smithi045.stdout: -1028> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2422 6.8 6:12dd7266:::1000000015e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6243d880 con 0x55cf61df4c00 2023-10-03T19:20:58.061 INFO:teuthology.orchestra.run.smithi045.stdout: -1027> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2423 6.f 6:f03d37e6:::1000000015f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf620ac380 con 0x55cf61df5800 2023-10-03T19:20:58.061 INFO:teuthology.orchestra.run.smithi045.stdout: -1026> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2424 6.e 6:71a8024a:::10000000160.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6204d500 con 0x55cf61df5400 2023-10-03T19:20:58.062 INFO:teuthology.orchestra.run.smithi045.stdout: -1025> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2425 6.3 6:c3d50dc8:::10000000161.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62057c00 con 0x55cf61df4c00 2023-10-03T19:20:58.062 INFO:teuthology.orchestra.run.smithi045.stdout: -1024> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2426 6.1a 6:581fb947:::10000000162.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b8b500 con 0x55cf61df5400 2023-10-03T19:20:58.062 INFO:teuthology.orchestra.run.smithi045.stdout: -1023> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2427 6.3d 6:bea1de3b:::10000000163.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63c13180 con 0x55cf61df5c00 2023-10-03T19:20:58.062 INFO:teuthology.orchestra.run.smithi045.stdout: -1022> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2428 6.26 6:679dc93b:::10000000164.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62020a80 con 0x55cf61df5000 2023-10-03T19:20:58.062 INFO:teuthology.orchestra.run.smithi045.stdout: -1021> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2429 6.2f 6:f477b060:::10000000165.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf639d5c00 con 0x55cf61df4c00 2023-10-03T19:20:58.062 INFO:teuthology.orchestra.run.smithi045.stdout: -1020> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2430 6.2f 6:f427aff4:::10000000166.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61eaca80 con 0x55cf61df4c00 2023-10-03T19:20:58.062 INFO:teuthology.orchestra.run.smithi045.stdout: -1019> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2431 6.7 6:e1d10967:::10000000167.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b8b880 con 0x55cf61c59000 2023-10-03T19:20:58.063 INFO:teuthology.orchestra.run.smithi045.stdout: -1018> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2432 6.28 6:157cd199:::10000000168.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63adae00 con 0x55cf61df5800 2023-10-03T19:20:58.063 INFO:teuthology.orchestra.run.smithi045.stdout: -1017> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2433 6.e 6:72fb549a:::10000000169.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63adaa80 con 0x55cf61df5400 2023-10-03T19:20:58.063 INFO:teuthology.orchestra.run.smithi045.stdout: -1016> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2434 6.31 6:8c4d6431:::1000000016a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63adb500 con 0x55cf61c59000 2023-10-03T19:20:58.063 INFO:teuthology.orchestra.run.smithi045.stdout: -1015> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2435 6.24 6:24468cab:::1000000016b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b07880 con 0x55cf61c59000 2023-10-03T19:20:58.063 INFO:teuthology.orchestra.run.smithi045.stdout: -1014> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2436 6.2b 6:d4621505:::1000000016c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b33180 con 0x55cf61c59000 2023-10-03T19:20:58.063 INFO:teuthology.orchestra.run.smithi045.stdout: -1013> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2437 6.3a 6:5e75abad:::1000000016d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b33c00 con 0x55cf61df5000 2023-10-03T19:20:58.063 INFO:teuthology.orchestra.run.smithi045.stdout: -1012> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2438 6.24 6:25a116fe:::1000000016e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b60380 con 0x55cf61c59000 2023-10-03T19:20:58.064 INFO:teuthology.orchestra.run.smithi045.stdout: -1011> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2439 6.29 6:9754688f:::1000000016f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a83c00 con 0x55cf61df4c00 2023-10-03T19:20:58.064 INFO:teuthology.orchestra.run.smithi045.stdout: -1010> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2440 6.21 6:865846d8:::10000000170.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63ab0e00 con 0x55cf61df4c00 2023-10-03T19:20:58.064 INFO:teuthology.orchestra.run.smithi045.stdout: -1009> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2441 6.26 6:67de5783:::10000000171.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63ada380 con 0x55cf61df5000 2023-10-03T19:20:58.064 INFO:teuthology.orchestra.run.smithi045.stdout: -1008> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2442 6.3a 6:5fae8ea4:::10000000172.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a00700 con 0x55cf61df5000 2023-10-03T19:20:58.064 INFO:teuthology.orchestra.run.smithi045.stdout: -1007> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2443 6.2f 6:f750f038:::10000000173.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62448700 con 0x55cf61df4c00 2023-10-03T19:20:58.064 INFO:teuthology.orchestra.run.smithi045.stdout: -1006> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2444 6.17 6:ea0d4bd4:::10000000174.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62501500 con 0x55cf61df5400 2023-10-03T19:20:58.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1005> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2445 6.2c 6:35de0157:::10000000175.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a01c00 con 0x55cf61df4800 2023-10-03T19:20:58.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1004> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2446 6.21 6:87d44640:::10000000176.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63adbc00 con 0x55cf61df4c00 2023-10-03T19:20:58.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1003> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2447 6.21 6:85136d15:::10000000177.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63c12a80 con 0x55cf61df4c00 2023-10-03T19:20:58.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1002> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2448 6.1b 6:d83df968:::10000000178.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61eb0700 con 0x55cf61df4400 2023-10-03T19:20:58.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1001> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2449 6.23 6:c468a694:::10000000179.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b06380 con 0x55cf61df4800 2023-10-03T19:20:58.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1000> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2450 6.1c 6:392ce431:::1000000017a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62021c00 con 0x55cf61df4c00 2023-10-03T19:20:58.492 INFO:teuthology.orchestra.run.smithi045.stdout: -999> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2451 6.23 6:c750a2e5:::1000000017b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf620ac000 con 0x55cf61df4800 2023-10-03T19:20:58.492 INFO:teuthology.orchestra.run.smithi045.stdout: -998> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2452 6.39 6:9d2c3550:::1000000017c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf635c5180 con 0x55cf61c59000 2023-10-03T19:20:58.493 INFO:teuthology.orchestra.run.smithi045.stdout: -997> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2453 6.38 6:1e3b0900:::1000000017d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62448e00 con 0x55cf61df4400 2023-10-03T19:20:58.493 INFO:teuthology.orchestra.run.smithi045.stdout: -996> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2454 6.15 6:aa02e122:::1000000017e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62452e00 con 0x55cf61df4c00 2023-10-03T19:20:58.493 INFO:teuthology.orchestra.run.smithi045.stdout: -995> 2023-10-03T19:15:19.883+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2455 6.18 6:1b505fc9:::1000000017f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf623f6a80 con 0x55cf61df5c00 2023-10-03T19:20:58.494 INFO:teuthology.orchestra.run.smithi045.stdout: -994> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2456 6.6 6:63fec8d1:::10000000180.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62500e00 con 0x55cf61df4400 2023-10-03T19:20:58.494 INFO:teuthology.orchestra.run.smithi045.stdout: -993> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2457 6.35 6:ae109857:::10000000181.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61eb1c00 con 0x55cf61c59000 2023-10-03T19:20:58.494 INFO:teuthology.orchestra.run.smithi045.stdout: -992> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2458 6.3c 6:3caa846b:::10000000182.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62500700 con 0x55cf61df5800 2023-10-03T19:20:58.494 INFO:teuthology.orchestra.run.smithi045.stdout: -991> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2459 6.6 6:60954073:::10000000183.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62098a80 con 0x55cf61df4400 2023-10-03T19:20:58.494 INFO:teuthology.orchestra.run.smithi045.stdout: -990> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2460 6.37 6:ee74be79:::10000000184.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6239ce00 con 0x55cf61df5c00 2023-10-03T19:20:58.494 INFO:teuthology.orchestra.run.smithi045.stdout: -989> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2461 6.2b 6:d44b7594:::10000000185.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61eb1180 con 0x55cf61c59000 2023-10-03T19:20:58.536 INFO:teuthology.orchestra.run.smithi045.stdout: -988> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2462 6.1b 6:dac0322e:::10000000186.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a01180 con 0x55cf61df4400 2023-10-03T19:20:58.536 INFO:teuthology.orchestra.run.smithi045.stdout: -987> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2463 6.2c 6:361d040c:::10000000187.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a55880 con 0x55cf61df4800 2023-10-03T19:20:58.536 INFO:teuthology.orchestra.run.smithi045.stdout: -986> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2464 6.2c 6:34fb46e8:::10000000188.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6204ce00 con 0x55cf61df4800 2023-10-03T19:20:58.537 INFO:teuthology.orchestra.run.smithi045.stdout: -985> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2465 6.18 6:1be1b9ec:::10000000189.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61e66a80 con 0x55cf61df5c00 2023-10-03T19:20:58.537 INFO:teuthology.orchestra.run.smithi045.stdout: -984> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2466 6.25 6:a628609b:::1000000018a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b07c00 con 0x55cf61df4800 2023-10-03T19:20:58.537 INFO:teuthology.orchestra.run.smithi045.stdout: -983> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2467 6.20 6:054a2542:::1000000018b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a01880 con 0x55cf61df5000 2023-10-03T19:20:58.537 INFO:teuthology.orchestra.run.smithi045.stdout: -982> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2468 6.20 6:0528cc08:::1000000018c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a2b880 con 0x55cf61df5000 2023-10-03T19:20:58.537 INFO:teuthology.orchestra.run.smithi045.stdout: -981> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2469 6.25 6:a72aac57:::1000000018d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a83500 con 0x55cf61df4800 2023-10-03T19:20:58.537 INFO:teuthology.orchestra.run.smithi045.stdout: -980> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2470 6.13 6:ca4de75d:::1000000018e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62501c00 con 0x55cf61df4400 2023-10-03T19:20:58.537 INFO:teuthology.orchestra.run.smithi045.stdout: -979> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2471 6.21 6:873de92c:::1000000018f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61feb880 con 0x55cf61df4c00 2023-10-03T19:20:58.537 INFO:teuthology.orchestra.run.smithi045.stdout: -978> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2472 6.5 6:a17921c8:::10000000190.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61eb0380 con 0x55cf61df4c00 2023-10-03T19:20:58.537 INFO:teuthology.orchestra.run.smithi045.stdout: -977> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2473 6.19 6:98be24f8:::10000000191.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63bb8380 con 0x55cf61c59000 2023-10-03T19:20:58.538 INFO:teuthology.orchestra.run.smithi045.stdout: -976> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2474 6.0 6:01a8c5ca:::10000000192.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63c12e00 con 0x55cf61df5c00 2023-10-03T19:20:58.538 INFO:teuthology.orchestra.run.smithi045.stdout: -975> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2475 6.1d 6:b9c448ca:::10000000193.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b8b180 con 0x55cf61df5000 2023-10-03T19:20:58.538 INFO:teuthology.orchestra.run.smithi045.stdout: -974> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2476 6.26 6:6669d7af:::10000000194.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a83880 con 0x55cf61df5000 2023-10-03T19:20:58.538 INFO:teuthology.orchestra.run.smithi045.stdout: -973> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2477 6.1b 6:d8c655bc:::10000000195.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63c13880 con 0x55cf61df4400 2023-10-03T19:20:58.538 INFO:teuthology.orchestra.run.smithi045.stdout: -972> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2478 6.1e 6:7894fe2e:::10000000196.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b61180 con 0x55cf61df5400 2023-10-03T19:20:58.539 INFO:teuthology.orchestra.run.smithi045.stdout: -971> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2479 6.12 6:4aa09692:::10000000197.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63bb8000 con 0x55cf61df4c00 2023-10-03T19:20:58.539 INFO:teuthology.orchestra.run.smithi045.stdout: -970> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2480 6.30 6:0cac0e23:::10000000198.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63adb880 con 0x55cf61df4c00 2023-10-03T19:20:58.539 INFO:teuthology.orchestra.run.smithi045.stdout: -969> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2481 6.33 6:cf2b08c7:::10000000199.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a82700 con 0x55cf61c59000 2023-10-03T19:20:58.539 INFO:teuthology.orchestra.run.smithi045.stdout: -968> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2482 6.20 6:068c0723:::1000000019a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6202ee00 con 0x55cf61df5000 2023-10-03T19:20:58.539 INFO:teuthology.orchestra.run.smithi045.stdout: -967> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2483 6.13 6:cad07b43:::1000000019b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63be5180 con 0x55cf61df4400 2023-10-03T19:20:58.539 INFO:teuthology.orchestra.run.smithi045.stdout: -966> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2484 6.7 6:e16233b5:::1000000019c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63be4000 con 0x55cf61c59000 2023-10-03T19:20:58.539 INFO:teuthology.orchestra.run.smithi045.stdout: -965> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2485 6.1d 6:ba9aa119:::1000000019d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a54380 con 0x55cf61df5000 2023-10-03T19:20:58.539 INFO:teuthology.orchestra.run.smithi045.stdout: -964> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2486 6.20 6:04059238:::1000000019e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63ab0380 con 0x55cf61df5000 2023-10-03T19:20:58.539 INFO:teuthology.orchestra.run.smithi045.stdout: -963> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2487 6.28 6:15089297:::1000000019f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63ada700 con 0x55cf61df5800 2023-10-03T19:20:58.540 INFO:teuthology.orchestra.run.smithi045.stdout: -962> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2488 6.3d 6:beda2349:::100000001a0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b61c00 con 0x55cf61df5c00 2023-10-03T19:20:58.540 INFO:teuthology.orchestra.run.smithi045.stdout: -961> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2489 6.1d 6:b947b1d0:::100000001a1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63bb9880 con 0x55cf61df5000 2023-10-03T19:20:58.540 INFO:teuthology.orchestra.run.smithi045.stdout: -960> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2490 6.c 6:3156bbd1:::100000001a2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a00700 con 0x55cf61df4400 2023-10-03T19:20:58.540 INFO:teuthology.orchestra.run.smithi045.stdout: -959> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2491 6.37 6:eefe3312:::100000001a3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63ada380 con 0x55cf61df5c00 2023-10-03T19:20:58.540 INFO:teuthology.orchestra.run.smithi045.stdout: -958> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2492 6.37 6:ec159c95:::100000001a4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b33c00 con 0x55cf61df5c00 2023-10-03T19:20:58.540 INFO:teuthology.orchestra.run.smithi045.stdout: -957> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2493 6.2b 6:d55466b4:::100000001a5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62020a80 con 0x55cf61c59000 2023-10-03T19:20:58.540 INFO:teuthology.orchestra.run.smithi045.stdout: -956> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2494 6.2e 6:775b9fb2:::100000001a6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b07500 con 0x55cf61df4800 2023-10-03T19:20:58.541 INFO:teuthology.orchestra.run.smithi045.stdout: -955> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2495 6.29 6:95eb4c87:::100000001a7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a54e00 con 0x55cf61df4c00 2023-10-03T19:20:58.541 INFO:teuthology.orchestra.run.smithi045.stdout: -954> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2496 6.35 6:af372925:::100000001a8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf623f6a80 con 0x55cf61c59000 2023-10-03T19:20:58.541 INFO:teuthology.orchestra.run.smithi045.stdout: -953> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2497 6.2c 6:3416e1ca:::100000001a9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63c13180 con 0x55cf61df4800 2023-10-03T19:20:58.541 INFO:teuthology.orchestra.run.smithi045.stdout: -952> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2498 6.13 6:caba0c50:::100000001aa.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6200ce00 con 0x55cf61df4400 2023-10-03T19:20:58.541 INFO:teuthology.orchestra.run.smithi045.stdout: -951> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2499 6.2e 6:76865fdc:::100000001ab.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf635c5180 con 0x55cf61df4800 2023-10-03T19:20:58.541 INFO:teuthology.orchestra.run.smithi045.stdout: -950> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2500 6.7 6:e255d6cd:::100000001ac.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b60380 con 0x55cf61c59000 2023-10-03T19:20:58.541 INFO:teuthology.orchestra.run.smithi045.stdout: -949> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2501 6.13 6:c8b8e906:::100000001ad.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b33180 con 0x55cf61df4400 2023-10-03T19:20:58.541 INFO:teuthology.orchestra.run.smithi045.stdout: -948> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2502 6.f 6:f18f2ceb:::100000001ae.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b07880 con 0x55cf61df5800 2023-10-03T19:20:58.541 INFO:teuthology.orchestra.run.smithi045.stdout: -947> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2503 6.2a 6:540014ba:::100000001af.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63adb500 con 0x55cf61df5400 2023-10-03T19:20:58.541 INFO:teuthology.orchestra.run.smithi045.stdout: -946> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2504 6.32 6:4d7ffadd:::100000001b0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b8b880 con 0x55cf61df5400 2023-10-03T19:20:58.542 INFO:teuthology.orchestra.run.smithi045.stdout: -945> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2505 6.1d 6:bafada3d:::100000001b1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a83180 con 0x55cf61df5000 2023-10-03T19:20:58.639 INFO:teuthology.orchestra.run.smithi045.stdout: -944> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2506 6.2e 6:76ff63fc:::100000001b2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6200d180 con 0x55cf61df4800 2023-10-03T19:20:58.639 INFO:teuthology.orchestra.run.smithi045.stdout: -943> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2507 6.2a 6:54062570:::100000001b3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62020e00 con 0x55cf61df5400 2023-10-03T19:20:58.640 INFO:teuthology.orchestra.run.smithi045.stdout: -942> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2508 6.7 6:e28d3c2b:::100000001b4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62098000 con 0x55cf61c59000 2023-10-03T19:20:58.640 INFO:teuthology.orchestra.run.smithi045.stdout: -941> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2509 6.38 6:1c92f375:::100000001b5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a54000 con 0x55cf61df4400 2023-10-03T19:20:58.640 INFO:teuthology.orchestra.run.smithi045.stdout: -940> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2510 6.34 6:2d6f3468:::100000001b6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62466000 con 0x55cf61df5c00 2023-10-03T19:20:58.640 INFO:teuthology.orchestra.run.smithi045.stdout: -939> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2511 6.19 6:99a7d964:::100000001b7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61ecd180 con 0x55cf61c59000 2023-10-03T19:20:58.640 INFO:teuthology.orchestra.run.smithi045.stdout: -938> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2512 6.d 6:b3fa8219:::100000001b8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6203c000 con 0x55cf61c59000 2023-10-03T19:20:58.640 INFO:teuthology.orchestra.run.smithi045.stdout: -937> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2513 6.2d 6:b7eb2f66:::100000001b9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62099500 con 0x55cf61df5800 2023-10-03T19:20:58.640 INFO:teuthology.orchestra.run.smithi045.stdout: -936> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2514 6.36 6:6d15073c:::100000001ba.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b07180 con 0x55cf61df5c00 2023-10-03T19:20:58.640 INFO:teuthology.orchestra.run.smithi045.stdout: -935> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2515 6.4 6:2118e87e:::100000001bb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63ab0700 con 0x55cf61df5000 2023-10-03T19:20:58.641 INFO:teuthology.orchestra.run.smithi045.stdout: -934> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2516 6.19 6:9b54a4b5:::100000001bc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62057500 con 0x55cf61c59000 2023-10-03T19:20:58.641 INFO:teuthology.orchestra.run.smithi045.stdout: -933> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2517 6.16 6:69256f6e:::100000001bd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62387c00 con 0x55cf61df5c00 2023-10-03T19:20:58.641 INFO:teuthology.orchestra.run.smithi045.stdout: -932> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2518 6.20 6:05a7fbbe:::100000001be.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61eb0e00 con 0x55cf61df5000 2023-10-03T19:20:58.641 INFO:teuthology.orchestra.run.smithi045.stdout: -931> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2519 6.19 6:9ab6d71b:::100000001bf.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63bb8a80 con 0x55cf61c59000 2023-10-03T19:20:58.641 INFO:teuthology.orchestra.run.smithi045.stdout: -930> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2520 6.19 6:98a8a8b3:::100000001c0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63bb9c00 con 0x55cf61c59000 2023-10-03T19:20:58.641 INFO:teuthology.orchestra.run.smithi045.stdout: -929> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2521 6.1 6:823476fa:::100000001c1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63c13500 con 0x55cf61df5000 2023-10-03T19:20:58.641 INFO:teuthology.orchestra.run.smithi045.stdout: -928> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2522 6.32 6:4c576489:::100000001c2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63a54700 con 0x55cf61df5400 2023-10-03T19:20:58.642 INFO:teuthology.orchestra.run.smithi045.stdout: -927> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2523 6.1f 6:fa06f62f:::100000001c3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf639d5180 con 0x55cf61df4400 2023-10-03T19:20:58.642 INFO:teuthology.orchestra.run.smithi045.stdout: -926> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2524 6.12 6:483471a4:::100000001c4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63ab1880 con 0x55cf61df4c00 2023-10-03T19:20:58.642 INFO:teuthology.orchestra.run.smithi045.stdout: -925> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2525 6.22 6:47177243:::100000001c5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63ab0000 con 0x55cf61df4800 2023-10-03T19:20:58.642 INFO:teuthology.orchestra.run.smithi045.stdout: -924> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2526 6.1f 6:f9e205e8:::100000001c6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b33500 con 0x55cf61df4400 2023-10-03T19:20:58.642 INFO:teuthology.orchestra.run.smithi045.stdout: -923> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2527 6.5 6:a07eb451:::100000001c7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63ab1180 con 0x55cf61df4c00 2023-10-03T19:20:58.642 INFO:teuthology.orchestra.run.smithi045.stdout: -922> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2528 6.1c 6:3b17a408:::100000001c8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b60e00 con 0x55cf61df4c00 2023-10-03T19:20:58.642 INFO:teuthology.orchestra.run.smithi045.stdout: -921> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2529 6.8 6:12d75f6c:::100000001c9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63be4e00 con 0x55cf61df4c00 2023-10-03T19:20:58.643 INFO:teuthology.orchestra.run.smithi045.stdout: -920> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2530 6.16 6:6b5900d3:::100000001ca.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61eace00 con 0x55cf61df5c00 2023-10-03T19:20:58.643 INFO:teuthology.orchestra.run.smithi045.stdout: -919> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2531 6.3d 6:bce74be0:::100000001cb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63bb8700 con 0x55cf61df5c00 2023-10-03T19:20:58.643 INFO:teuthology.orchestra.run.smithi045.stdout: -918> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2532 6.26 6:65df6efc:::100000001cc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf639d4e00 con 0x55cf61df5000 2023-10-03T19:20:58.643 INFO:teuthology.orchestra.run.smithi045.stdout: -917> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2533 6.21 6:86fbb64b:::100000001cd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b60a80 con 0x55cf61df4c00 2023-10-03T19:20:58.643 INFO:teuthology.orchestra.run.smithi045.stdout: -916> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2534 6.14 6:29519214:::100000001ce.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61ecd880 con 0x55cf61df5800 2023-10-03T19:20:58.643 INFO:teuthology.orchestra.run.smithi045.stdout: -915> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2535 6.e 6:71d3c486:::100000001cf.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b32e00 con 0x55cf61df5400 2023-10-03T19:20:58.643 INFO:teuthology.orchestra.run.smithi045.stdout: -914> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2536 6.1 6:81350243:::100000001d0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6200c000 con 0x55cf61df5000 2023-10-03T19:20:58.643 INFO:teuthology.orchestra.run.smithi045.stdout: -913> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2537 6.a 6:51da9383:::100000001d1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62500a80 con 0x55cf61c59000 2023-10-03T19:20:58.644 INFO:teuthology.orchestra.run.smithi045.stdout: -912> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2538 6.16 6:69d31978:::100000001d2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf63b8a700 con 0x55cf61df5c00 2023-10-03T19:20:58.644 INFO:teuthology.orchestra.run.smithi045.stdout: -911> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2539 6.3e 6:7c32b2c0:::100000001d3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6203c380 con 0x55cf61df4400 2023-10-03T19:20:58.644 INFO:teuthology.orchestra.run.smithi045.stdout: -910> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2540 6.34 6:2d665059:::100000001d4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62466a80 con 0x55cf61df5c00 2023-10-03T19:20:58.644 INFO:teuthology.orchestra.run.smithi045.stdout: -909> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2541 6.33 6:cfb1de4c:::100000001d5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6208b180 con 0x55cf61c59000 2023-10-03T19:20:58.644 INFO:teuthology.orchestra.run.smithi045.stdout: -908> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2542 6.16 6:6b2189d7:::100000001d6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf623bf180 con 0x55cf61df5c00 2023-10-03T19:20:58.644 INFO:teuthology.orchestra.run.smithi045.stdout: -907> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2543 6.1a 6:5b825d11:::100000001d7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62057180 con 0x55cf61df5400 2023-10-03T19:20:58.644 INFO:teuthology.orchestra.run.smithi045.stdout: -906> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2544 6.1d 6:b82de5f4:::100000001d8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62098e00 con 0x55cf61df5000 2023-10-03T19:20:58.644 INFO:teuthology.orchestra.run.smithi045.stdout: -905> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2545 6.6 6:61ce4130:::100000001d9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf635c4a80 con 0x55cf61df4400 2023-10-03T19:20:58.644 INFO:teuthology.orchestra.run.smithi045.stdout: -904> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2546 6.37 6:ec238bc7:::100000001da.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62099c00 con 0x55cf61df5c00 2023-10-03T19:20:58.645 INFO:teuthology.orchestra.run.smithi045.stdout: -903> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2547 6.24 6:24ebe6ca:::100000001db.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61feb180 con 0x55cf61c59000 2023-10-03T19:20:58.646 INFO:teuthology.orchestra.run.smithi045.stdout: -902> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2548 6.38 6:1fa836f3:::100000001dc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf62034380 con 0x55cf61df4400 2023-10-03T19:20:58.646 INFO:teuthology.orchestra.run.smithi045.stdout: -901> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2549 6.3b 6:dd6afadf:::100000001dd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf620ace00 con 0x55cf61df5800 2023-10-03T19:20:58.646 INFO:teuthology.orchestra.run.smithi045.stdout: -900> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2550 6.2e 6:77eaaa70:::100000001de.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf635c4e00 con 0x55cf61df4800 2023-10-03T19:20:58.646 INFO:teuthology.orchestra.run.smithi045.stdout: -899> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.11:2551 6.34 6:2de2f068:::100000001df.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6204e700 con 0x55cf61df5c00 2023-10-03T19:20:58.646 INFO:teuthology.orchestra.run.smithi045.stdout: -898> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2552 6.11 6:8b210d5a:::100000001e0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf61fea380 con 0x55cf61df4400 2023-10-03T19:20:58.646 INFO:teuthology.orchestra.run.smithi045.stdout: -897> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.11:2553 6.2c 6:3650da82:::100000001e1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf639d4a80 con 0x55cf61df4800 2023-10-03T19:20:58.646 INFO:teuthology.orchestra.run.smithi045.stdout: -896> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2554 6.3c 6:3d7caa99:::100000001e2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6206e000 con 0x55cf61df5800 2023-10-03T19:20:58.647 INFO:teuthology.orchestra.run.smithi045.stdout: -895> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2555 6.1b 6:da67b4c4:::100000001e3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6206e380 con 0x55cf61df4400 2023-10-03T19:20:58.647 INFO:teuthology.orchestra.run.smithi045.stdout: -894> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2556 6.13 6:c88cf2e1:::100000001e4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6206e700 con 0x55cf61df4400 2023-10-03T19:20:58.647 INFO:teuthology.orchestra.run.smithi045.stdout: -893> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.11:2557 6.1a 6:5bf55946:::100000001e5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6206ea80 con 0x55cf61df5400 2023-10-03T19:20:58.647 INFO:teuthology.orchestra.run.smithi045.stdout: -892> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2558 6.14 6:2bd99ea3:::100000001e6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6206ee00 con 0x55cf61df5800 2023-10-03T19:20:58.647 INFO:teuthology.orchestra.run.smithi045.stdout: -891> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2559 6.24 6:25319c2b:::100000001e7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6206f180 con 0x55cf61c59000 2023-10-03T19:20:58.647 INFO:teuthology.orchestra.run.smithi045.stdout: -890> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2560 6.1c 6:3915d86a:::100000001e8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6206f500 con 0x55cf61df4c00 2023-10-03T19:20:58.647 INFO:teuthology.orchestra.run.smithi045.stdout: -889> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2561 6.30 6:0def042e:::100000001e9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6206f880 con 0x55cf61df4c00 2023-10-03T19:20:58.648 INFO:teuthology.orchestra.run.smithi045.stdout: -888> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.11:2562 6.1c 6:3811fe79:::100000001ea.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6206fc00 con 0x55cf61df4c00 2023-10-03T19:20:58.648 INFO:teuthology.orchestra.run.smithi045.stdout: -887> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2563 6.f 6:f3be9911:::100000001eb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6227c000 con 0x55cf61df5800 2023-10-03T19:20:58.648 INFO:teuthology.orchestra.run.smithi045.stdout: -886> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2564 6.a 6:52e82f0e:::100000001ec.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6227c380 con 0x55cf61c59000 2023-10-03T19:20:58.648 INFO:teuthology.orchestra.run.smithi045.stdout: -885> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2565 6.14 6:2af56820:::100000001ed.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6227c700 con 0x55cf61df5800 2023-10-03T19:20:58.648 INFO:teuthology.orchestra.run.smithi045.stdout: -884> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.11:2566 6.3a 6:5c391605:::100000001ee.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6227ca80 con 0x55cf61df5000 2023-10-03T19:20:58.648 INFO:teuthology.orchestra.run.smithi045.stdout: -883> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2567 6.a 6:519c0e80:::100000001ef.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6227ce00 con 0x55cf61c59000 2023-10-03T19:20:58.648 INFO:teuthology.orchestra.run.smithi045.stdout: -882> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2568 6.13 6:ca7e1ea4:::100000001f0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6227d180 con 0x55cf61df4400 2023-10-03T19:20:58.648 INFO:teuthology.orchestra.run.smithi045.stdout: -881> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2569 6.33 6:ce8ed050:::100000001f1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6227d500 con 0x55cf61c59000 2023-10-03T19:20:58.648 INFO:teuthology.orchestra.run.smithi045.stdout: -880> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.11:2570 6.b 6:d079bd36:::100000001f2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6227d880 con 0x55cf61df4400 2023-10-03T19:20:58.649 INFO:teuthology.orchestra.run.smithi045.stdout: -879> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2571 6.3c 6:3d203daf:::100000001f3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6227dc00 con 0x55cf61df5800 2023-10-03T19:20:58.649 INFO:teuthology.orchestra.run.smithi045.stdout: -878> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2572 6.14 6:2959de71:::100000001f4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf621ce000 con 0x55cf61df5800 2023-10-03T19:20:58.649 INFO:teuthology.orchestra.run.smithi045.stdout: -877> 2023-10-03T19:15:19.887+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2573 6.d 6:b0d9c9f6:::100000001f5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf621ce380 con 0x55cf61c59000 2023-10-03T19:20:58.649 INFO:teuthology.orchestra.run.smithi045.stdout: -876> 2023-10-03T19:15:19.887+0000 7f0f05562640 10 mds.0.inotable: apply_release_ids [0x100000005dd~0x1f7] to [0x100000005dd~0xfffffffa23]/[0x100000007d4~0xfffffff82c] 2023-10-03T19:20:58.674 INFO:teuthology.orchestra.run.smithi045.stdout: -875> 2023-10-03T19:15:19.887+0000 7f0f05562640 20 mds.0.sessionmap mark_dirty s=0x55cf61ea5400 name=client.5304 v=1004 2023-10-03T19:20:58.675 INFO:teuthology.orchestra.run.smithi045.stdout: -874> 2023-10-03T19:15:19.887+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsx on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) caps={5304=pAsLsXsFsx/-@1002},l=5304 | request=0 lock=5 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cf61f44100] 2023-10-03T19:20:58.675 INFO:teuthology.orchestra.run.smithi045.stdout: -873> 2023-10-03T19:15:19.887+0000 7f0f08d69640 10 mds.pinger is_rank_lagging: rank=0 2023-10-03T19:20:58.675 INFO:teuthology.orchestra.run.smithi045.stdout: -872> 2023-10-03T19:15:19.887+0000 7f0f08d69640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgrreport(unknown.a +0-0 packed 1558) v9 -- 0x55cf60f1f500 con 0x55cf61df4000 2023-10-03T19:20:58.675 INFO:teuthology.orchestra.run.smithi045.stdout: -871> 2023-10-03T19:15:19.887+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000000) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.675 INFO:teuthology.orchestra.run.smithi045.stdout: -870> 2023-10-03T19:15:19.887+0000 7f0f05562640 10 mds.0.openfiles remove_dirfrag [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:58.675 INFO:teuthology.orchestra.run.smithi045.stdout: -869> 2023-10-03T19:15:19.887+0000 7f0f05562640 10 mds.0.locker eval 3648 [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=5 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cf61f44100] 2023-10-03T19:20:58.675 INFO:teuthology.orchestra.run.smithi045.stdout: -868> 2023-10-03T19:15:19.891+0000 7f0f05562640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl w=1) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=5 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cf61f44100] 2023-10-03T19:20:58.676 INFO:teuthology.orchestra.run.smithi045.stdout: -867> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.locker is excl 2023-10-03T19:20:58.676 INFO:teuthology.orchestra.run.smithi045.stdout: -866> 2023-10-03T19:15:19.891+0000 7f0f05562640 7 mds.0.locker file_eval loner_issued= other_issued= xlocker_issued= 2023-10-03T19:20:58.676 INFO:teuthology.orchestra.run.smithi045.stdout: -865> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.locker should lose it 2023-10-03T19:20:58.676 INFO:teuthology.orchestra.run.smithi045.stdout: -864> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.locker waiting for wrlock to drain 2023-10-03T19:20:58.676 INFO:teuthology.orchestra.run.smithi045.stdout: -863> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.locker simple_eval (iauth sync r=1) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=5 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cf61f44100] 2023-10-03T19:20:58.676 INFO:teuthology.orchestra.run.smithi045.stdout: -862> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.locker simple_eval (ilink sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=5 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cf61f44100] 2023-10-03T19:20:58.676 INFO:teuthology.orchestra.run.smithi045.stdout: -861> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.locker simple_eval (ixattr sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=5 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cf61f44100] 2023-10-03T19:20:58.676 INFO:teuthology.orchestra.run.smithi045.stdout: -860> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.locker eval done 2023-10-03T19:20:58.676 INFO:teuthology.orchestra.run.smithi045.stdout: -859> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFs on [inode 0x1 [...2,head] / auth v24 snaprealm=0x55cf61c558c0 f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:13:21.313332+0000 1=0+1) (isnap sync r=1) (inest lock) (ipolicy sync r=1) (iversion lock) caps={5304=pAsLsXsFs/-@7} | dirtyscattered=0 request=0 lock=2 dirfrag=1 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf60f56680] 2023-10-03T19:20:58.676 INFO:teuthology.orchestra.run.smithi045.stdout: -858> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.677 INFO:teuthology.orchestra.run.smithi045.stdout: -857> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000579 [2,head] /dc-dir/dc-file_900 auth v5802 s=3 n(v0 rc2023-10-03T19:13:45.510923+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62538c00] 2023-10-03T19:20:58.677 INFO:teuthology.orchestra.run.smithi045.stdout: -856> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000579) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.677 INFO:teuthology.orchestra.run.smithi045.stdout: -855> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000057a [2,head] /dc-dir/dc-file_901 auth v5804 s=3 n(v0 rc2023-10-03T19:13:45.605077+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62539180] 2023-10-03T19:20:58.677 INFO:teuthology.orchestra.run.smithi045.stdout: -854> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000057a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.677 INFO:teuthology.orchestra.run.smithi045.stdout: -853> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000057b [2,head] /dc-dir/dc-file_902 auth v5806 s=3 n(v0 rc2023-10-03T19:13:45.649354+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62539700] 2023-10-03T19:20:58.677 INFO:teuthology.orchestra.run.smithi045.stdout: -852> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000057b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.677 INFO:teuthology.orchestra.run.smithi045.stdout: -851> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000057c [2,head] /dc-dir/dc-file_903 auth v5808 s=3 n(v0 rc2023-10-03T19:13:45.660649+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62582000] 2023-10-03T19:20:58.677 INFO:teuthology.orchestra.run.smithi045.stdout: -850> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000057c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.677 INFO:teuthology.orchestra.run.smithi045.stdout: -849> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000057d [2,head] /dc-dir/dc-file_904 auth v5810 s=3 n(v0 rc2023-10-03T19:13:45.673422+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62582580] 2023-10-03T19:20:58.677 INFO:teuthology.orchestra.run.smithi045.stdout: -848> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000057d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.678 INFO:teuthology.orchestra.run.smithi045.stdout: -847> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000057e [2,head] /dc-dir/dc-file_905 auth v5812 s=3 n(v0 rc2023-10-03T19:13:45.685163+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62582b00] 2023-10-03T19:20:58.678 INFO:teuthology.orchestra.run.smithi045.stdout: -846> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000057e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.678 INFO:teuthology.orchestra.run.smithi045.stdout: -845> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000057f [2,head] /dc-dir/dc-file_906 auth v5814 s=3 n(v0 rc2023-10-03T19:13:45.696552+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62583080] 2023-10-03T19:20:58.678 INFO:teuthology.orchestra.run.smithi045.stdout: -844> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000057f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.678 INFO:teuthology.orchestra.run.smithi045.stdout: -843> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000580 [2,head] /dc-dir/dc-file_907 auth v5816 s=3 n(v0 rc2023-10-03T19:13:45.708613+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62583600] 2023-10-03T19:20:58.678 INFO:teuthology.orchestra.run.smithi045.stdout: -842> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000580) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.678 INFO:teuthology.orchestra.run.smithi045.stdout: -841> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000581 [2,head] /dc-dir/dc-file_908 auth v5818 s=3 n(v0 rc2023-10-03T19:13:45.720329+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62583b80] 2023-10-03T19:20:58.679 INFO:teuthology.orchestra.run.smithi045.stdout: -840> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000581) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.679 INFO:teuthology.orchestra.run.smithi045.stdout: -839> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000582 [2,head] /dc-dir/dc-file_909 auth v5820 s=3 n(v0 rc2023-10-03T19:13:45.731754+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62584100] 2023-10-03T19:20:58.679 INFO:teuthology.orchestra.run.smithi045.stdout: -838> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000582) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.679 INFO:teuthology.orchestra.run.smithi045.stdout: -837> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000583 [2,head] /dc-dir/dc-file_910 auth v5822 s=3 n(v0 rc2023-10-03T19:13:45.742946+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62584680] 2023-10-03T19:20:58.679 INFO:teuthology.orchestra.run.smithi045.stdout: -836> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000583) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.679 INFO:teuthology.orchestra.run.smithi045.stdout: -835> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000584 [2,head] /dc-dir/dc-file_911 auth v5824 s=3 n(v0 rc2023-10-03T19:13:45.754523+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62584c00] 2023-10-03T19:20:58.679 INFO:teuthology.orchestra.run.smithi045.stdout: -834> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000584) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.679 INFO:teuthology.orchestra.run.smithi045.stdout: -833> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000585 [2,head] /dc-dir/dc-file_912 auth v5826 s=3 n(v0 rc2023-10-03T19:13:45.765566+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62585180] 2023-10-03T19:20:58.679 INFO:teuthology.orchestra.run.smithi045.stdout: -832> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000585) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.680 INFO:teuthology.orchestra.run.smithi045.stdout: -831> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000586 [2,head] /dc-dir/dc-file_913 auth v5828 s=3 n(v0 rc2023-10-03T19:13:45.776598+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62585700] 2023-10-03T19:20:58.680 INFO:teuthology.orchestra.run.smithi045.stdout: -830> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000586) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.680 INFO:teuthology.orchestra.run.smithi045.stdout: -829> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000587 [2,head] /dc-dir/dc-file_914 auth v5830 s=3 n(v0 rc2023-10-03T19:13:45.787826+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62586000] 2023-10-03T19:20:58.680 INFO:teuthology.orchestra.run.smithi045.stdout: -828> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000587) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.680 INFO:teuthology.orchestra.run.smithi045.stdout: -827> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000588 [2,head] /dc-dir/dc-file_915 auth v5832 s=3 n(v0 rc2023-10-03T19:13:45.799547+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62586580] 2023-10-03T19:20:58.680 INFO:teuthology.orchestra.run.smithi045.stdout: -826> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000588) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.680 INFO:teuthology.orchestra.run.smithi045.stdout: -825> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000589 [2,head] /dc-dir/dc-file_916 auth v5834 s=3 n(v0 rc2023-10-03T19:13:45.811585+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62586b00] 2023-10-03T19:20:58.680 INFO:teuthology.orchestra.run.smithi045.stdout: -824> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000589) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.680 INFO:teuthology.orchestra.run.smithi045.stdout: -823> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000058a [2,head] /dc-dir/dc-file_917 auth v5836 s=3 n(v0 rc2023-10-03T19:13:45.822785+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62587080] 2023-10-03T19:20:58.681 INFO:teuthology.orchestra.run.smithi045.stdout: -822> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000058a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.681 INFO:teuthology.orchestra.run.smithi045.stdout: -821> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000058b [2,head] /dc-dir/dc-file_918 auth v5838 s=3 n(v0 rc2023-10-03T19:13:45.835343+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62587600] 2023-10-03T19:20:58.691 INFO:teuthology.orchestra.run.smithi045.stdout: -820> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000058b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.692 INFO:teuthology.orchestra.run.smithi045.stdout: -819> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000058c [2,head] /dc-dir/dc-file_919 auth v5840 s=3 n(v0 rc2023-10-03T19:13:45.849454+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62587b80] 2023-10-03T19:20:58.692 INFO:teuthology.orchestra.run.smithi045.stdout: -818> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000058c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.692 INFO:teuthology.orchestra.run.smithi045.stdout: -817> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000058d [2,head] /dc-dir/dc-file_920 auth v5842 s=3 n(v0 rc2023-10-03T19:13:45.863522+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62588100] 2023-10-03T19:20:58.692 INFO:teuthology.orchestra.run.smithi045.stdout: -816> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000058d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.692 INFO:teuthology.orchestra.run.smithi045.stdout: -815> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000058e [2,head] /dc-dir/dc-file_921 auth v5844 s=3 n(v0 rc2023-10-03T19:13:45.877080+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62588680] 2023-10-03T19:20:58.692 INFO:teuthology.orchestra.run.smithi045.stdout: -814> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000058e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.692 INFO:teuthology.orchestra.run.smithi045.stdout: -813> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000058f [2,head] /dc-dir/dc-file_922 auth v5846 s=3 n(v0 rc2023-10-03T19:13:45.890661+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62588c00] 2023-10-03T19:20:58.692 INFO:teuthology.orchestra.run.smithi045.stdout: -812> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000058f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.693 INFO:teuthology.orchestra.run.smithi045.stdout: -811> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000590 [2,head] /dc-dir/dc-file_923 auth v5848 s=3 n(v0 rc2023-10-03T19:13:45.904722+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62589180] 2023-10-03T19:20:58.693 INFO:teuthology.orchestra.run.smithi045.stdout: -810> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000590) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.693 INFO:teuthology.orchestra.run.smithi045.stdout: -809> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000591 [2,head] /dc-dir/dc-file_924 auth v5850 s=3 n(v0 rc2023-10-03T19:13:45.916141+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62589700] 2023-10-03T19:20:58.693 INFO:teuthology.orchestra.run.smithi045.stdout: -808> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000591) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.693 INFO:teuthology.orchestra.run.smithi045.stdout: -807> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000592 [2,head] /dc-dir/dc-file_925 auth v5852 s=3 n(v0 rc2023-10-03T19:13:45.927638+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf6258c000] 2023-10-03T19:20:58.693 INFO:teuthology.orchestra.run.smithi045.stdout: -806> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000592) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.693 INFO:teuthology.orchestra.run.smithi045.stdout: -805> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000593 [2,head] /dc-dir/dc-file_926 auth v5854 s=3 n(v0 rc2023-10-03T19:13:45.938963+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf6258c580] 2023-10-03T19:20:58.693 INFO:teuthology.orchestra.run.smithi045.stdout: -804> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000593) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.693 INFO:teuthology.orchestra.run.smithi045.stdout: -803> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000594 [2,head] /dc-dir/dc-file_927 auth v5856 s=3 n(v0 rc2023-10-03T19:13:45.952747+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf6258cb00] 2023-10-03T19:20:58.694 INFO:teuthology.orchestra.run.smithi045.stdout: -802> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000594) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.694 INFO:teuthology.orchestra.run.smithi045.stdout: -801> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000595 [2,head] /dc-dir/dc-file_928 auth v5858 s=3 n(v0 rc2023-10-03T19:13:45.964142+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf6258d080] 2023-10-03T19:20:58.694 INFO:teuthology.orchestra.run.smithi045.stdout: -800> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000595) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.694 INFO:teuthology.orchestra.run.smithi045.stdout: -799> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000596 [2,head] /dc-dir/dc-file_929 auth v5860 s=3 n(v0 rc2023-10-03T19:13:45.975622+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf6258d600] 2023-10-03T19:20:58.694 INFO:teuthology.orchestra.run.smithi045.stdout: -798> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000596) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.694 INFO:teuthology.orchestra.run.smithi045.stdout: -797> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000597 [2,head] /dc-dir/dc-file_930 auth v5862 s=3 n(v0 rc2023-10-03T19:13:45.988680+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf6258db80] 2023-10-03T19:20:58.694 INFO:teuthology.orchestra.run.smithi045.stdout: -796> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000597) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.695 INFO:teuthology.orchestra.run.smithi045.stdout: -795> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000598 [2,head] /dc-dir/dc-file_931 auth v5864 s=3 n(v0 rc2023-10-03T19:13:45.999959+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf6258e100] 2023-10-03T19:20:58.695 INFO:teuthology.orchestra.run.smithi045.stdout: -794> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000598) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.695 INFO:teuthology.orchestra.run.smithi045.stdout: -793> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000599 [2,head] /dc-dir/dc-file_932 auth v5866 s=3 n(v0 rc2023-10-03T19:13:46.012330+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf6258e680] 2023-10-03T19:20:58.695 INFO:teuthology.orchestra.run.smithi045.stdout: -792> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x10000000599) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.695 INFO:teuthology.orchestra.run.smithi045.stdout: -791> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000059a [2,head] /dc-dir/dc-file_933 auth v5868 s=3 n(v0 rc2023-10-03T19:13:46.023712+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf6258ec00] 2023-10-03T19:20:58.695 INFO:teuthology.orchestra.run.smithi045.stdout: -790> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000059a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.695 INFO:teuthology.orchestra.run.smithi045.stdout: -789> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000059b [2,head] /dc-dir/dc-file_934 auth v5870 s=3 n(v0 rc2023-10-03T19:13:46.036963+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf6258f180] 2023-10-03T19:20:58.695 INFO:teuthology.orchestra.run.smithi045.stdout: -788> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000059b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.696 INFO:teuthology.orchestra.run.smithi045.stdout: -787> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000059c [2,head] /dc-dir/dc-file_935 auth v5872 s=3 n(v0 rc2023-10-03T19:13:46.048305+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf6258f700] 2023-10-03T19:20:58.696 INFO:teuthology.orchestra.run.smithi045.stdout: -786> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000059c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.696 INFO:teuthology.orchestra.run.smithi045.stdout: -785> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000059d [2,head] /dc-dir/dc-file_936 auth v5874 s=3 n(v0 rc2023-10-03T19:13:46.059802+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62596000] 2023-10-03T19:20:58.696 INFO:teuthology.orchestra.run.smithi045.stdout: -784> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000059d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.696 INFO:teuthology.orchestra.run.smithi045.stdout: -783> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000059e [2,head] /dc-dir/dc-file_937 auth v5876 s=3 n(v0 rc2023-10-03T19:13:46.073285+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62596580] 2023-10-03T19:20:58.696 INFO:teuthology.orchestra.run.smithi045.stdout: -782> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000059e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.696 INFO:teuthology.orchestra.run.smithi045.stdout: -781> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000059f [2,head] /dc-dir/dc-file_938 auth v5878 s=3 n(v0 rc2023-10-03T19:13:46.085262+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62596b00] 2023-10-03T19:20:58.696 INFO:teuthology.orchestra.run.smithi045.stdout: -780> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x1000000059f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.697 INFO:teuthology.orchestra.run.smithi045.stdout: -779> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a0 [2,head] /dc-dir/dc-file_939 auth v5880 s=3 n(v0 rc2023-10-03T19:13:46.097881+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62597080] 2023-10-03T19:20:58.697 INFO:teuthology.orchestra.run.smithi045.stdout: -778> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.697 INFO:teuthology.orchestra.run.smithi045.stdout: -777> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a1 [2,head] /dc-dir/dc-file_940 auth v5882 s=3 n(v0 rc2023-10-03T19:13:46.109594+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62597600] 2023-10-03T19:20:58.697 INFO:teuthology.orchestra.run.smithi045.stdout: -776> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.697 INFO:teuthology.orchestra.run.smithi045.stdout: -775> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a2 [2,head] /dc-dir/dc-file_941 auth v5884 s=3 n(v0 rc2023-10-03T19:13:46.121334+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62597b80] 2023-10-03T19:20:58.697 INFO:teuthology.orchestra.run.smithi045.stdout: -774> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.697 INFO:teuthology.orchestra.run.smithi045.stdout: -773> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a3 [2,head] /dc-dir/dc-file_942 auth v5886 s=3 n(v0 rc2023-10-03T19:13:46.133565+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62598100] 2023-10-03T19:20:58.697 INFO:teuthology.orchestra.run.smithi045.stdout: -772> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.698 INFO:teuthology.orchestra.run.smithi045.stdout: -771> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a4 [2,head] /dc-dir/dc-file_943 auth v5888 s=3 n(v0 rc2023-10-03T19:13:46.145587+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62598680] 2023-10-03T19:20:58.698 INFO:teuthology.orchestra.run.smithi045.stdout: -770> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.698 INFO:teuthology.orchestra.run.smithi045.stdout: -769> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a5 [2,head] /dc-dir/dc-file_944 auth v5890 s=3 n(v0 rc2023-10-03T19:13:46.159098+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62598c00] 2023-10-03T19:20:58.698 INFO:teuthology.orchestra.run.smithi045.stdout: -768> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.698 INFO:teuthology.orchestra.run.smithi045.stdout: -767> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a6 [2,head] /dc-dir/dc-file_945 auth v5892 s=3 n(v0 rc2023-10-03T19:13:46.170290+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62599180] 2023-10-03T19:20:58.698 INFO:teuthology.orchestra.run.smithi045.stdout: -766> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.698 INFO:teuthology.orchestra.run.smithi045.stdout: -765> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a7 [2,head] /dc-dir/dc-file_946 auth v5894 s=3 n(v0 rc2023-10-03T19:13:46.181295+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62599700] 2023-10-03T19:20:58.698 INFO:teuthology.orchestra.run.smithi045.stdout: -764> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.698 INFO:teuthology.orchestra.run.smithi045.stdout: -763> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a8 [2,head] /dc-dir/dc-file_947 auth v5896 s=3 n(v0 rc2023-10-03T19:13:46.194044+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf624be000] 2023-10-03T19:20:58.698 INFO:teuthology.orchestra.run.smithi045.stdout: -762> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.699 INFO:teuthology.orchestra.run.smithi045.stdout: -761> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a9 [2,head] /dc-dir/dc-file_948 auth v5898 s=3 n(v0 rc2023-10-03T19:13:46.206451+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf624be580] 2023-10-03T19:20:58.699 INFO:teuthology.orchestra.run.smithi045.stdout: -760> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005a9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.699 INFO:teuthology.orchestra.run.smithi045.stdout: -759> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005aa [2,head] /dc-dir/dc-file_949 auth v5900 s=3 n(v0 rc2023-10-03T19:13:46.218584+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf624beb00] 2023-10-03T19:20:58.699 INFO:teuthology.orchestra.run.smithi045.stdout: -758> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005aa) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.699 INFO:teuthology.orchestra.run.smithi045.stdout: -757> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005ab [2,head] /dc-dir/dc-file_950 auth v5902 s=3 n(v0 rc2023-10-03T19:13:46.231068+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf624bf080] 2023-10-03T19:20:58.699 INFO:teuthology.orchestra.run.smithi045.stdout: -756> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005ab) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.699 INFO:teuthology.orchestra.run.smithi045.stdout: -755> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005ac [2,head] /dc-dir/dc-file_951 auth v5904 s=3 n(v0 rc2023-10-03T19:13:46.243324+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf624bf600] 2023-10-03T19:20:58.699 INFO:teuthology.orchestra.run.smithi045.stdout: -754> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005ac) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.700 INFO:teuthology.orchestra.run.smithi045.stdout: -753> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005ad [2,head] /dc-dir/dc-file_952 auth v5906 s=3 n(v0 rc2023-10-03T19:13:46.255576+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf624bfb80] 2023-10-03T19:20:58.700 INFO:teuthology.orchestra.run.smithi045.stdout: -752> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005ad) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.700 INFO:teuthology.orchestra.run.smithi045.stdout: -751> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005ae [2,head] /dc-dir/dc-file_953 auth v5908 s=3 n(v0 rc2023-10-03T19:13:46.269403+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf624c0100] 2023-10-03T19:20:58.700 INFO:teuthology.orchestra.run.smithi045.stdout: -750> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005ae) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.700 INFO:teuthology.orchestra.run.smithi045.stdout: -749> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005af [2,head] /dc-dir/dc-file_954 auth v5910 s=3 n(v0 rc2023-10-03T19:13:46.283326+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf624c0680] 2023-10-03T19:20:58.700 INFO:teuthology.orchestra.run.smithi045.stdout: -748> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005af) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.700 INFO:teuthology.orchestra.run.smithi045.stdout: -747> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b0 [2,head] /dc-dir/dc-file_955 auth v5912 s=3 n(v0 rc2023-10-03T19:13:46.297051+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf624c0c00] 2023-10-03T19:20:58.700 INFO:teuthology.orchestra.run.smithi045.stdout: -746> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.700 INFO:teuthology.orchestra.run.smithi045.stdout: -745> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b1 [2,head] /dc-dir/dc-file_956 auth v5914 s=3 n(v0 rc2023-10-03T19:13:46.308468+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf624c1180] 2023-10-03T19:20:58.701 INFO:teuthology.orchestra.run.smithi045.stdout: -744> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.701 INFO:teuthology.orchestra.run.smithi045.stdout: -743> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b2 [2,head] /dc-dir/dc-file_957 auth v5916 s=3 n(v0 rc2023-10-03T19:13:46.321869+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf624c1700] 2023-10-03T19:20:58.701 INFO:teuthology.orchestra.run.smithi045.stdout: -742> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.701 INFO:teuthology.orchestra.run.smithi045.stdout: -741> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b3 [2,head] /dc-dir/dc-file_958 auth v5918 s=3 n(v0 rc2023-10-03T19:13:46.334335+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf6259e000] 2023-10-03T19:20:58.701 INFO:teuthology.orchestra.run.smithi045.stdout: -740> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.701 INFO:teuthology.orchestra.run.smithi045.stdout: -739> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b4 [2,head] /dc-dir/dc-file_959 auth v5920 s=3 n(v0 rc2023-10-03T19:13:46.345966+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf6259e580] 2023-10-03T19:20:58.701 INFO:teuthology.orchestra.run.smithi045.stdout: -738> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.701 INFO:teuthology.orchestra.run.smithi045.stdout: -737> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b5 [2,head] /dc-dir/dc-file_960 auth v5922 s=3 n(v0 rc2023-10-03T19:13:46.356745+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf6259eb00] 2023-10-03T19:20:58.701 INFO:teuthology.orchestra.run.smithi045.stdout: -736> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.701 INFO:teuthology.orchestra.run.smithi045.stdout: -735> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b6 [2,head] /dc-dir/dc-file_961 auth v5924 s=3 n(v0 rc2023-10-03T19:13:46.368033+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf6259f080] 2023-10-03T19:20:58.702 INFO:teuthology.orchestra.run.smithi045.stdout: -734> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.702 INFO:teuthology.orchestra.run.smithi045.stdout: -733> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b7 [2,head] /dc-dir/dc-file_962 auth v5926 s=3 n(v0 rc2023-10-03T19:13:46.381385+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf6259f600] 2023-10-03T19:20:58.702 INFO:teuthology.orchestra.run.smithi045.stdout: -732> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.702 INFO:teuthology.orchestra.run.smithi045.stdout: -731> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b8 [2,head] /dc-dir/dc-file_963 auth v5928 s=3 n(v0 rc2023-10-03T19:13:46.393933+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf6259fb80] 2023-10-03T19:20:58.702 INFO:teuthology.orchestra.run.smithi045.stdout: -730> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.702 INFO:teuthology.orchestra.run.smithi045.stdout: -729> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b9 [2,head] /dc-dir/dc-file_964 auth v5930 s=3 n(v0 rc2023-10-03T19:13:46.405662+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf625a0100] 2023-10-03T19:20:58.702 INFO:teuthology.orchestra.run.smithi045.stdout: -728> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005b9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.702 INFO:teuthology.orchestra.run.smithi045.stdout: -727> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005ba [2,head] /dc-dir/dc-file_965 auth v5932 s=3 n(v0 rc2023-10-03T19:13:46.417957+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf625a0680] 2023-10-03T19:20:58.702 INFO:teuthology.orchestra.run.smithi045.stdout: -726> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005ba) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.703 INFO:teuthology.orchestra.run.smithi045.stdout: -725> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005bb [2,head] /dc-dir/dc-file_966 auth v5934 s=3 n(v0 rc2023-10-03T19:13:46.429871+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf625a0c00] 2023-10-03T19:20:58.797 INFO:teuthology.orchestra.run.smithi045.stdout: -724> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005bb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.797 INFO:teuthology.orchestra.run.smithi045.stdout: -723> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005bc [2,head] /dc-dir/dc-file_967 auth v5936 s=3 n(v0 rc2023-10-03T19:13:46.441933+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf625a1180] 2023-10-03T19:20:58.797 INFO:teuthology.orchestra.run.smithi045.stdout: -722> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005bc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.798 INFO:teuthology.orchestra.run.smithi045.stdout: -721> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005bd [2,head] /dc-dir/dc-file_968 auth v5938 s=3 n(v0 rc2023-10-03T19:13:46.454270+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf625a1700] 2023-10-03T19:20:58.798 INFO:teuthology.orchestra.run.smithi045.stdout: -720> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005bd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.798 INFO:teuthology.orchestra.run.smithi045.stdout: -719> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005be [2,head] /dc-dir/dc-file_969 auth v5940 s=3 n(v0 rc2023-10-03T19:13:46.465947+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf625a6000] 2023-10-03T19:20:58.798 INFO:teuthology.orchestra.run.smithi045.stdout: -718> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005be) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.798 INFO:teuthology.orchestra.run.smithi045.stdout: -717> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005bf [2,head] /dc-dir/dc-file_970 auth v5942 s=3 n(v0 rc2023-10-03T19:13:46.477521+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf625a6580] 2023-10-03T19:20:58.798 INFO:teuthology.orchestra.run.smithi045.stdout: -716> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005bf) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.798 INFO:teuthology.orchestra.run.smithi045.stdout: -715> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c0 [2,head] /dc-dir/dc-file_971 auth v5944 s=3 n(v0 rc2023-10-03T19:13:46.490445+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf625a6b00] 2023-10-03T19:20:58.798 INFO:teuthology.orchestra.run.smithi045.stdout: -714> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.799 INFO:teuthology.orchestra.run.smithi045.stdout: -713> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c1 [2,head] /dc-dir/dc-file_972 auth v5946 s=3 n(v0 rc2023-10-03T19:13:46.501626+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf625a7080] 2023-10-03T19:20:58.799 INFO:teuthology.orchestra.run.smithi045.stdout: -712> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.799 INFO:teuthology.orchestra.run.smithi045.stdout: -711> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c2 [2,head] /dc-dir/dc-file_973 auth v5948 s=3 n(v0 rc2023-10-03T19:13:46.513035+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf625a7600] 2023-10-03T19:20:58.799 INFO:teuthology.orchestra.run.smithi045.stdout: -710> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.799 INFO:teuthology.orchestra.run.smithi045.stdout: -709> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c3 [2,head] /dc-dir/dc-file_974 auth v5950 s=3 n(v0 rc2023-10-03T19:13:46.529374+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf625a7b80] 2023-10-03T19:20:58.799 INFO:teuthology.orchestra.run.smithi045.stdout: -708> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.799 INFO:teuthology.orchestra.run.smithi045.stdout: -707> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c4 [2,head] /dc-dir/dc-file_975 auth v5952 s=3 n(v0 rc2023-10-03T19:13:46.680771+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf625a8100] 2023-10-03T19:20:58.799 INFO:teuthology.orchestra.run.smithi045.stdout: -706> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.799 INFO:teuthology.orchestra.run.smithi045.stdout: -705> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c5 [2,head] /dc-dir/dc-file_976 auth v5954 s=3 n(v0 rc2023-10-03T19:13:46.691487+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf625a8680] 2023-10-03T19:20:58.800 INFO:teuthology.orchestra.run.smithi045.stdout: -704> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.800 INFO:teuthology.orchestra.run.smithi045.stdout: -703> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c6 [2,head] /dc-dir/dc-file_977 auth v5956 s=3 n(v0 rc2023-10-03T19:13:46.703556+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf625a8c00] 2023-10-03T19:20:58.800 INFO:teuthology.orchestra.run.smithi045.stdout: -702> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.800 INFO:teuthology.orchestra.run.smithi045.stdout: -701> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c7 [2,head] /dc-dir/dc-file_978 auth v5958 s=3 n(v0 rc2023-10-03T19:13:46.716323+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf625a9180] 2023-10-03T19:20:58.800 INFO:teuthology.orchestra.run.smithi045.stdout: -700> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.800 INFO:teuthology.orchestra.run.smithi045.stdout: -699> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c8 [2,head] /dc-dir/dc-file_979 auth v5960 s=3 n(v0 rc2023-10-03T19:13:46.729137+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf625a9700] 2023-10-03T19:20:58.800 INFO:teuthology.orchestra.run.smithi045.stdout: -698> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.800 INFO:teuthology.orchestra.run.smithi045.stdout: -697> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c9 [2,head] /dc-dir/dc-file_980 auth v5962 s=3 n(v0 rc2023-10-03T19:13:46.741348+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf625b4000] 2023-10-03T19:20:58.800 INFO:teuthology.orchestra.run.smithi045.stdout: -696> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005c9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.801 INFO:teuthology.orchestra.run.smithi045.stdout: -695> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005ca [2,head] /dc-dir/dc-file_981 auth v5964 s=3 n(v0 rc2023-10-03T19:13:46.752268+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf625b4580] 2023-10-03T19:20:58.801 INFO:teuthology.orchestra.run.smithi045.stdout: -694> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005ca) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.801 INFO:teuthology.orchestra.run.smithi045.stdout: -693> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005cb [2,head] /dc-dir/dc-file_982 auth v5966 s=3 n(v0 rc2023-10-03T19:13:46.763999+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf625b4b00] 2023-10-03T19:20:58.801 INFO:teuthology.orchestra.run.smithi045.stdout: -692> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005cb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.801 INFO:teuthology.orchestra.run.smithi045.stdout: -691> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005cc [2,head] /dc-dir/dc-file_983 auth v5968 s=3 n(v0 rc2023-10-03T19:13:46.775000+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf625b5080] 2023-10-03T19:20:58.801 INFO:teuthology.orchestra.run.smithi045.stdout: -690> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005cc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.801 INFO:teuthology.orchestra.run.smithi045.stdout: -689> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005cd [2,head] /dc-dir/dc-file_984 auth v5970 s=3 n(v0 rc2023-10-03T19:13:46.786235+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf625b5600] 2023-10-03T19:20:58.801 INFO:teuthology.orchestra.run.smithi045.stdout: -688> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005cd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.801 INFO:teuthology.orchestra.run.smithi045.stdout: -687> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005ce [2,head] /dc-dir/dc-file_985 auth v5972 s=3 n(v0 rc2023-10-03T19:13:46.797819+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf625b5b80] 2023-10-03T19:20:58.801 INFO:teuthology.orchestra.run.smithi045.stdout: -686> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005ce) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.802 INFO:teuthology.orchestra.run.smithi045.stdout: -685> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005cf [2,head] /dc-dir/dc-file_986 auth v5974 s=3 n(v0 rc2023-10-03T19:13:46.809773+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf625b6100] 2023-10-03T19:20:58.802 INFO:teuthology.orchestra.run.smithi045.stdout: -684> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005cf) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.802 INFO:teuthology.orchestra.run.smithi045.stdout: -683> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d0 [2,head] /dc-dir/dc-file_987 auth v5976 s=3 n(v0 rc2023-10-03T19:13:46.821940+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf625b6680] 2023-10-03T19:20:58.802 INFO:teuthology.orchestra.run.smithi045.stdout: -682> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.802 INFO:teuthology.orchestra.run.smithi045.stdout: -681> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d1 [2,head] /dc-dir/dc-file_988 auth v5978 s=3 n(v0 rc2023-10-03T19:13:46.834467+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf625b6c00] 2023-10-03T19:20:58.802 INFO:teuthology.orchestra.run.smithi045.stdout: -680> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.802 INFO:teuthology.orchestra.run.smithi045.stdout: -679> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d2 [2,head] /dc-dir/dc-file_989 auth v5980 s=3 n(v0 rc2023-10-03T19:13:46.845915+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf625b7180] 2023-10-03T19:20:58.802 INFO:teuthology.orchestra.run.smithi045.stdout: -678> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.803 INFO:teuthology.orchestra.run.smithi045.stdout: -677> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d3 [2,head] /dc-dir/dc-file_990 auth v5982 s=3 n(v0 rc2023-10-03T19:13:46.857969+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf625b7700] 2023-10-03T19:20:58.803 INFO:teuthology.orchestra.run.smithi045.stdout: -676> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.803 INFO:teuthology.orchestra.run.smithi045.stdout: -675> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d4 [2,head] /dc-dir/dc-file_991 auth v5984 s=3 n(v0 rc2023-10-03T19:13:46.869531+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62476000] 2023-10-03T19:20:58.803 INFO:teuthology.orchestra.run.smithi045.stdout: -674> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.803 INFO:teuthology.orchestra.run.smithi045.stdout: -673> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d5 [2,head] /dc-dir/dc-file_992 auth v5986 s=3 n(v0 rc2023-10-03T19:13:46.880760+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62476580] 2023-10-03T19:20:58.803 INFO:teuthology.orchestra.run.smithi045.stdout: -672> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.803 INFO:teuthology.orchestra.run.smithi045.stdout: -671> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d6 [2,head] /dc-dir/dc-file_993 auth v5988 s=3 n(v0 rc2023-10-03T19:13:46.892745+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62476b00] 2023-10-03T19:20:58.803 INFO:teuthology.orchestra.run.smithi045.stdout: -670> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.803 INFO:teuthology.orchestra.run.smithi045.stdout: -669> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d7 [2,head] /dc-dir/dc-file_994 auth v5990 s=3 n(v0 rc2023-10-03T19:13:46.906262+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62477080] 2023-10-03T19:20:58.803 INFO:teuthology.orchestra.run.smithi045.stdout: -668> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.805 INFO:teuthology.orchestra.run.smithi045.stdout: -667> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d8 [2,head] /dc-dir/dc-file_995 auth v5992 s=3 n(v0 rc2023-10-03T19:13:46.918717+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62477600] 2023-10-03T19:20:58.805 INFO:teuthology.orchestra.run.smithi045.stdout: -666> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.805 INFO:teuthology.orchestra.run.smithi045.stdout: -665> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d9 [2,head] /dc-dir/dc-file_996 auth v5994 s=3 n(v0 rc2023-10-03T19:13:46.930134+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62477b80] 2023-10-03T19:20:58.805 INFO:teuthology.orchestra.run.smithi045.stdout: -664> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005d9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.805 INFO:teuthology.orchestra.run.smithi045.stdout: -663> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005da [2,head] /dc-dir/dc-file_997 auth v5996 s=3 n(v0 rc2023-10-03T19:13:46.941392+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62478100] 2023-10-03T19:20:58.806 INFO:teuthology.orchestra.run.smithi045.stdout: -662> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005da) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.806 INFO:teuthology.orchestra.run.smithi045.stdout: -661> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005db [2,head] /dc-dir/dc-file_998 auth v5998 s=3 n(v0 rc2023-10-03T19:13:46.952724+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62478680] 2023-10-03T19:20:58.806 INFO:teuthology.orchestra.run.smithi045.stdout: -660> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005db) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.806 INFO:teuthology.orchestra.run.smithi045.stdout: -659> 2023-10-03T19:15:19.891+0000 7f0f05562640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005dc [2,head] /dc-dir/dc-file_999 auth v6000 s=3 n(v0 rc2023-10-03T19:13:46.964642+0000 b3 1=1+0) (iversion lock) caps={5304=pAsLsXsFsc/-@2},l=5304(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cf62478c00] 2023-10-03T19:20:58.806 INFO:teuthology.orchestra.run.smithi045.stdout: -658> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.cache.ino(0x100000005dc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:13:21.313332+0000 change_attr 0 0x55cf61c558c0) 2023-10-03T19:20:58.806 INFO:teuthology.orchestra.run.smithi045.stdout: -657> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.openfiles remove_dirfrag [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+0 state=1074003968 f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=100+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cf61e64d00] 2023-10-03T19:20:58.806 INFO:teuthology.orchestra.run.smithi045.stdout: -656> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.11 send_message_client client.5304 172.21.15.146:0/2715925302 client_session(close) v5 2023-10-03T19:20:58.806 INFO:teuthology.orchestra.run.smithi045.stdout: -655> 2023-10-03T19:15:19.891+0000 7f0f05562640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> 172.21.15.146:0/2715925302 -- client_session(close) v5 -- 0x55cf626676c0 con 0x55cf61f84800 2023-10-03T19:20:58.806 INFO:teuthology.orchestra.run.smithi045.stdout: -654> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 remove_session: mds.metrics: session=0x55cf61ea5400, client=client.5304 172.21.15.146:0/2715925302 2023-10-03T19:20:58.806 INFO:teuthology.orchestra.run.smithi045.stdout: -653> 2023-10-03T19:15:19.891+0000 7f0f05562640 10 mds.0.sessionmap remove_session s=0x55cf61ea5400 name=client.5304 2023-10-03T19:20:58.806 INFO:teuthology.orchestra.run.smithi045.stdout: -652> 2023-10-03T19:15:19.891+0000 7f0f06d65640 7 mds.0.11 mds has 1 queued contexts 2023-10-03T19:20:58.807 INFO:teuthology.orchestra.run.smithi045.stdout: -651> 2023-10-03T19:15:19.891+0000 7f0f06d65640 10 mds.0.11 finish 0x55cf6257c9a0 2023-10-03T19:20:58.807 INFO:teuthology.orchestra.run.smithi045.stdout: -650> 2023-10-03T19:15:19.891+0000 7f0f06d65640 10 MDSContext::complete: 15C_MDL_DropCache 2023-10-03T19:20:58.807 INFO:teuthology.orchestra.run.smithi045.stdout: -649> 2023-10-03T19:15:19.891+0000 7f0f06d65640 7 mds.0.locker rdlock_finish on (isnap sync) on [inode 0x1 [...2,head] / auth v24 snaprealm=0x55cf61c558c0 f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:13:21.313332+0000 1=0+1) (inest lock) (ipolicy sync r=1) (iversion lock) | dirtyscattered=0 request=0 lock=1 dirfrag=1 caps=0 dirtyparent=0 dirty=0 authpin=0 0x55cf60f56680] 2023-10-03T19:20:58.807 INFO:teuthology.orchestra.run.smithi045.stdout: -648> 2023-10-03T19:15:19.891+0000 7f0f06d65640 10 mds.0.locker simple_eval (isnap sync) on [inode 0x1 [...2,head] / auth v24 snaprealm=0x55cf61c558c0 f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:13:21.313332+0000 1=0+1) (inest lock) (ipolicy sync r=1) (iversion lock) | dirtyscattered=0 request=0 lock=1 dirfrag=1 caps=0 dirtyparent=0 dirty=0 authpin=0 0x55cf60f56680] 2023-10-03T19:20:58.807 INFO:teuthology.orchestra.run.smithi045.stdout: -647> 2023-10-03T19:15:19.891+0000 7f0f06d65640 7 mds.0.locker rdlock_finish on (ipolicy sync) on [inode 0x1 [...2,head] / auth v24 snaprealm=0x55cf61c558c0 f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:13:21.313332+0000 1=0+1) (inest lock) (iversion lock) | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=0 dirtyparent=0 dirty=0 authpin=0 0x55cf60f56680] 2023-10-03T19:20:58.807 INFO:teuthology.orchestra.run.smithi045.stdout: -646> 2023-10-03T19:15:19.891+0000 7f0f06d65640 10 mds.0.locker simple_eval (ipolicy sync) on [inode 0x1 [...2,head] / auth v24 snaprealm=0x55cf61c558c0 f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:13:21.313332+0000 1=0+1) (inest lock) (iversion lock) | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=0 dirtyparent=0 dirty=0 authpin=0 0x55cf60f56680] 2023-10-03T19:20:58.807 INFO:teuthology.orchestra.run.smithi045.stdout: -645> 2023-10-03T19:15:19.891+0000 7f0f06d65640 7 mds.0.locker rdlock_finish on (iauth sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=4 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cf61f44100] 2023-10-03T19:20:58.807 INFO:teuthology.orchestra.run.smithi045.stdout: -644> 2023-10-03T19:15:19.891+0000 7f0f06d65640 10 mds.0.locker simple_eval (iauth sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=4 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cf61f44100] 2023-10-03T19:20:58.808 INFO:teuthology.orchestra.run.smithi045.stdout: -643> 2023-10-03T19:15:19.891+0000 7f0f06d65640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=4 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cf61f44100] 2023-10-03T19:20:58.808 INFO:teuthology.orchestra.run.smithi045.stdout: -642> 2023-10-03T19:15:19.891+0000 7f0f06d65640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl) (iversion lock) | request=0 lock=3 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cf61f44100] 2023-10-03T19:20:58.808 INFO:teuthology.orchestra.run.smithi045.stdout: -641> 2023-10-03T19:15:19.891+0000 7f0f06d65640 20 mds.0.locker is excl 2023-10-03T19:20:58.808 INFO:teuthology.orchestra.run.smithi045.stdout: -640> 2023-10-03T19:15:19.891+0000 7f0f06d65640 7 mds.0.locker file_eval loner_issued= other_issued= xlocker_issued= 2023-10-03T19:20:58.808 INFO:teuthology.orchestra.run.smithi045.stdout: -639> 2023-10-03T19:15:19.891+0000 7f0f06d65640 20 mds.0.locker should lose it 2023-10-03T19:20:58.808 INFO:teuthology.orchestra.run.smithi045.stdout: -638> 2023-10-03T19:15:19.891+0000 7f0f06d65640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl) (iversion lock) | request=0 lock=3 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cf61f44100] 2023-10-03T19:20:58.808 INFO:teuthology.orchestra.run.smithi045.stdout: -637> 2023-10-03T19:15:19.891+0000 7f0f06d65640 7 mds.0.locker rdlock_finish on (isnap sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) (inest lock w=1) (ipolicy sync r=1) (iversion lock) | request=0 lock=2 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cf61f44100] 2023-10-03T19:20:58.808 INFO:teuthology.orchestra.run.smithi045.stdout: -636> 2023-10-03T19:15:19.891+0000 7f0f06d65640 10 mds.0.locker simple_eval (isnap sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) (inest lock w=1) (ipolicy sync r=1) (iversion lock) | request=0 lock=2 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cf61f44100] 2023-10-03T19:20:58.808 INFO:teuthology.orchestra.run.smithi045.stdout: -635> 2023-10-03T19:15:19.891+0000 7f0f06d65640 7 mds.0.locker wrlock_finish on (inest lock w=1) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) (inest lock w=1) (ipolicy sync r=1) (iversion lock) | request=0 lock=2 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cf61f44100] 2023-10-03T19:20:58.808 INFO:teuthology.orchestra.run.smithi045.stdout: -634> 2023-10-03T19:15:19.891+0000 7f0f06d65640 10 mds.0.locker scatter_eval (inest lock) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) (inest lock) (ipolicy sync r=1) (iversion lock) | request=0 lock=1 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cf61f44100] 2023-10-03T19:20:58.809 INFO:teuthology.orchestra.run.smithi045.stdout: -633> 2023-10-03T19:15:19.891+0000 7f0f06d65640 7 mds.0.locker rdlock_finish on (ipolicy sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) (inest lock) (iversion lock) | request=0 lock=0 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cf61f44100] 2023-10-03T19:20:58.809 INFO:teuthology.orchestra.run.smithi045.stdout: -632> 2023-10-03T19:15:19.891+0000 7f0f06d65640 10 mds.0.locker simple_eval (ipolicy sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) (inest lock) (iversion lock) | request=0 lock=0 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cf61f44100] 2023-10-03T19:20:58.809 INFO:teuthology.orchestra.run.smithi045.stdout: -631> 2023-10-03T19:15:19.891+0000 7f0f06d65640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55cf61f51080 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) (inest lock) (iversion lock) | request=0 lock=0 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=0 0x55cf61f44100] now 0 2023-10-03T19:20:58.809 INFO:teuthology.orchestra.run.smithi045.stdout: -630> 2023-10-03T19:15:19.891+0000 7f0f06d65640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 state=1073741825|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] by 0x55cf61f51080 count now 0/0 2023-10-03T19:20:58.809 INFO:teuthology.orchestra.run.smithi045.stdout: -629> 2023-10-03T19:15:19.891+0000 7f0f06d65640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55cf61f51080 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 state=1073741824 f(v0 m2023-10-03T19:13:46.961125+0000 1000=1000+0) n(v0 rc2023-10-03T19:13:46.964642+0000 b2890 1000=1000+0) hs=100+0,ss=0+0 | child=1 dirty=0 authpin=0 0x55cf61e64d00] count now 0 2023-10-03T19:20:58.809 INFO:teuthology.orchestra.run.smithi045.stdout: -628> 2023-10-03T19:15:19.891+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] >> 172.21.15.146:0/2715925302 conn(0x55cf61f84800 msgr2=0x55cf61f45180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 39 2023-10-03T19:20:58.809 INFO:teuthology.orchestra.run.smithi045.stdout: -627> 2023-10-03T19:15:19.891+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] >> 172.21.15.146:0/2715925302 conn(0x55cf61f84800 msgr2=0x55cf61f45180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-03T19:20:58.809 INFO:teuthology.orchestra.run.smithi045.stdout: -626> 2023-10-03T19:15:19.891+0000 7f0f0dd73640 1 --2- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] >> 172.21.15.146:0/2715925302 conn(0x55cf61f84800 0x55cf61f45180 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T19:20:58.809 INFO:teuthology.orchestra.run.smithi045.stdout: -625> 2023-10-03T19:15:19.891+0000 7f0f0dd73640 1 --2- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] >> 172.21.15.146:0/2715925302 conn(0x55cf61f84800 0x55cf61f45180 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:58.809 INFO:teuthology.orchestra.run.smithi045.stdout: -624> 2023-10-03T19:15:19.891+0000 7f0f0b56e640 5 mds.a ms_handle_reset on 172.21.15.146:0/2715925302 2023-10-03T19:20:58.810 INFO:teuthology.orchestra.run.smithi045.stdout: -623> 2023-10-03T19:15:19.891+0000 7f0f0b56e640 3 mds.a ms_handle_reset closing connection for session client.5304 172.21.15.146:0/2715925302 2023-10-03T19:20:58.810 INFO:teuthology.orchestra.run.smithi045.stdout: -622> 2023-10-03T19:15:19.891+0000 7f0f0b56e640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] >> 172.21.15.146:0/2715925302 conn(0x55cf61f84800 msgr2=0x55cf61f45180 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-10-03T19:20:58.810 INFO:teuthology.orchestra.run.smithi045.stdout: -621> 2023-10-03T19:15:19.891+0000 7f0f0b56e640 1 --2- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] >> 172.21.15.146:0/2715925302 conn(0x55cf61f84800 0x55cf61f45180 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:20:58.810 INFO:teuthology.orchestra.run.smithi045.stdout: -620> 2023-10-03T19:15:19.899+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 156 ==== osd_op_reply(2081 10000000009.00000000 [delete] v37'23 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:58.810 INFO:teuthology.orchestra.run.smithi045.stdout: -619> 2023-10-03T19:15:19.903+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 104 ==== osd_op_reply(2187 10000000073.00000000 [delete] v37'23 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:58.810 INFO:teuthology.orchestra.run.smithi045.stdout: -618> 2023-10-03T19:15:19.903+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 157 ==== osd_op_reply(2209 10000000089.00000000 [delete] v37'24 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:58.810 INFO:teuthology.orchestra.run.smithi045.stdout: -617> 2023-10-03T19:15:19.903+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 158 ==== osd_op_reply(2366 10000000126.00000000 [delete] v37'25 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:58.810 INFO:teuthology.orchestra.run.smithi045.stdout: -616> 2023-10-03T19:15:19.907+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 159 ==== osd_op_reply(2408 10000000150.00000000 [delete] v37'26 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:58.811 INFO:teuthology.orchestra.run.smithi045.stdout: -615> 2023-10-03T19:15:19.907+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 160 ==== osd_op_reply(2510 100000001b6.00000000 [delete] v37'27 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:58.811 INFO:teuthology.orchestra.run.smithi045.stdout: -614> 2023-10-03T19:15:19.907+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 161 ==== osd_op_reply(2540 100000001d4.00000000 [delete] v37'28 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:58.811 INFO:teuthology.orchestra.run.smithi045.stdout: -613> 2023-10-03T19:15:19.907+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 96 ==== osd_op_reply(2098 1000000001a.00000000 [delete] v37'45 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:58.811 INFO:teuthology.orchestra.run.smithi045.stdout: -612> 2023-10-03T19:15:19.907+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 106 ==== osd_op_reply(2078 10000000006.00000000 [delete] v37'25 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.811 INFO:teuthology.orchestra.run.smithi045.stdout: -611> 2023-10-03T19:15:19.907+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 97 ==== osd_op_reply(2172 10000000064.00000000 [delete] v37'46 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:58.811 INFO:teuthology.orchestra.run.smithi045.stdout: -610> 2023-10-03T19:15:19.907+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 98 ==== osd_op_reply(2250 100000000b2.00000000 [delete] v37'47 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:58.811 INFO:teuthology.orchestra.run.smithi045.stdout: -609> 2023-10-03T19:15:19.911+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 99 ==== osd_op_reply(2165 1000000005d.00000000 [delete] v37'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.811 INFO:teuthology.orchestra.run.smithi045.stdout: -608> 2023-10-03T19:15:19.911+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 100 ==== osd_op_reply(2215 1000000008f.00000000 [delete] v37'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.811 INFO:teuthology.orchestra.run.smithi045.stdout: -607> 2023-10-03T19:15:19.911+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 162 ==== osd_op_reply(2113 10000000029.00000000 [delete] v37'45 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:58.811 INFO:teuthology.orchestra.run.smithi045.stdout: -606> 2023-10-03T19:15:19.911+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 163 ==== osd_op_reply(2162 1000000005a.00000000 [delete] v37'46 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:58.811 INFO:teuthology.orchestra.run.smithi045.stdout: -605> 2023-10-03T19:15:19.911+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 164 ==== osd_op_reply(2262 100000000be.00000000 [delete] v37'47 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:58.812 INFO:teuthology.orchestra.run.smithi045.stdout: -604> 2023-10-03T19:15:19.911+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 165 ==== osd_op_reply(2265 100000000c1.00000000 [delete] v37'48 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:58.812 INFO:teuthology.orchestra.run.smithi045.stdout: -603> 2023-10-03T19:15:19.911+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 101 ==== osd_op_reply(2239 100000000a7.00000000 [delete] v37'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.812 INFO:teuthology.orchestra.run.smithi045.stdout: -602> 2023-10-03T19:15:19.911+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 102 ==== osd_op_reply(2325 100000000fd.00000000 [delete] v37'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.812 INFO:teuthology.orchestra.run.smithi045.stdout: -601> 2023-10-03T19:15:19.915+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 105 ==== osd_op_reply(2230 1000000009e.00000000 [delete] v37'24 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:58.812 INFO:teuthology.orchestra.run.smithi045.stdout: -600> 2023-10-03T19:15:19.915+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 106 ==== osd_op_reply(2424 10000000160.00000000 [delete] v37'25 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:58.812 INFO:teuthology.orchestra.run.smithi045.stdout: -599> 2023-10-03T19:15:19.915+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 107 ==== osd_op_reply(2433 10000000169.00000000 [delete] v37'26 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:58.812 INFO:teuthology.orchestra.run.smithi045.stdout: -598> 2023-10-03T19:15:19.915+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 108 ==== osd_op_reply(2535 100000001cf.00000000 [delete] v37'27 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:58.851 INFO:teuthology.orchestra.run.smithi045.stdout: -597> 2023-10-03T19:15:19.915+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 166 ==== osd_op_reply(2287 100000000d7.00000000 [delete] v37'49 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:58.851 INFO:teuthology.orchestra.run.smithi045.stdout: -596> 2023-10-03T19:15:19.915+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 167 ==== osd_op_reply(2551 100000001df.00000000 [delete] v37'29 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:58.851 INFO:teuthology.orchestra.run.smithi045.stdout: -595> 2023-10-03T19:15:19.915+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 168 ==== osd_op_reply(2382 10000000136.00000000 [delete] v37'50 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:58.851 INFO:teuthology.orchestra.run.smithi045.stdout: -594> 2023-10-03T19:15:19.915+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 169 ==== osd_op_reply(2455 1000000017f.00000000 [delete] v37'51 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:58.851 INFO:teuthology.orchestra.run.smithi045.stdout: -593> 2023-10-03T19:15:19.915+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 170 ==== osd_op_reply(2465 10000000189.00000000 [delete] v37'52 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:58.851 INFO:teuthology.orchestra.run.smithi045.stdout: -592> 2023-10-03T19:15:19.915+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 103 ==== osd_op_reply(2361 10000000121.00000000 [delete] v37'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.851 INFO:teuthology.orchestra.run.smithi045.stdout: -591> 2023-10-03T19:15:19.915+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 104 ==== osd_op_reply(2372 1000000012c.00000000 [delete] v37'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.852 INFO:teuthology.orchestra.run.smithi045.stdout: -590> 2023-10-03T19:15:19.915+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 105 ==== osd_op_reply(2513 100000001b9.00000000 [delete] v37'41 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.852 INFO:teuthology.orchestra.run.smithi045.stdout: -589> 2023-10-03T19:15:19.915+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 106 ==== osd_op_reply(2088 10000000010.00000000 [delete] v37'37 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.852 INFO:teuthology.orchestra.run.smithi045.stdout: -588> 2023-10-03T19:15:19.915+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 107 ==== osd_op_reply(2109 10000000025.00000000 [delete] v37'29 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.852 INFO:teuthology.orchestra.run.smithi045.stdout: -587> 2023-10-03T19:15:19.915+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 108 ==== osd_op_reply(2114 1000000002a.00000000 [delete] v37'19 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.852 INFO:teuthology.orchestra.run.smithi045.stdout: -586> 2023-10-03T19:15:19.915+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 109 ==== osd_op_reply(2242 100000000aa.00000000 [delete] v37'38 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.852 INFO:teuthology.orchestra.run.smithi045.stdout: -585> 2023-10-03T19:15:19.915+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 110 ==== osd_op_reply(2160 10000000058.00000000 [delete] v37'30 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.852 INFO:teuthology.orchestra.run.smithi045.stdout: -584> 2023-10-03T19:15:19.915+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 111 ==== osd_op_reply(2131 1000000003b.00000000 [delete] v37'20 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.852 INFO:teuthology.orchestra.run.smithi045.stdout: -583> 2023-10-03T19:15:19.915+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 112 ==== osd_op_reply(2392 10000000140.00000000 [delete] v37'39 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.852 INFO:teuthology.orchestra.run.smithi045.stdout: -582> 2023-10-03T19:15:19.915+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 113 ==== osd_op_reply(2217 10000000091.00000000 [delete] v37'31 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.852 INFO:teuthology.orchestra.run.smithi045.stdout: -581> 2023-10-03T19:15:19.915+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 114 ==== osd_op_reply(2235 100000000a3.00000000 [delete] v37'32 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.853 INFO:teuthology.orchestra.run.smithi045.stdout: -580> 2023-10-03T19:15:19.915+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 115 ==== osd_op_reply(2212 1000000008c.00000000 [delete] v37'21 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.853 INFO:teuthology.orchestra.run.smithi045.stdout: -579> 2023-10-03T19:15:19.915+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 116 ==== osd_op_reply(2245 100000000ad.00000000 [delete] v37'22 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.853 INFO:teuthology.orchestra.run.smithi045.stdout: -578> 2023-10-03T19:15:19.915+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 117 ==== osd_op_reply(2334 10000000106.00000000 [delete] v37'33 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.853 INFO:teuthology.orchestra.run.smithi045.stdout: -577> 2023-10-03T19:15:19.915+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 118 ==== osd_op_reply(2338 1000000010a.00000000 [delete] v37'34 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.853 INFO:teuthology.orchestra.run.smithi045.stdout: -576> 2023-10-03T19:15:19.915+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 119 ==== osd_op_reply(2549 100000001dd.00000000 [delete] v37'40 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.853 INFO:teuthology.orchestra.run.smithi045.stdout: -575> 2023-10-03T19:15:19.915+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 99 ==== osd_op_reply(2412 10000000154.00000000 [delete] v37'48 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:58.853 INFO:teuthology.orchestra.run.smithi045.stdout: -574> 2023-10-03T19:15:19.915+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 100 ==== osd_op_reply(2467 1000000018b.00000000 [delete] v37'49 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:58.853 INFO:teuthology.orchestra.run.smithi045.stdout: -573> 2023-10-03T19:15:19.915+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 101 ==== osd_op_reply(2468 1000000018c.00000000 [delete] v37'50 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:58.853 INFO:teuthology.orchestra.run.smithi045.stdout: -572> 2023-10-03T19:15:19.915+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 102 ==== osd_op_reply(2482 1000000019a.00000000 [delete] v37'51 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:58.854 INFO:teuthology.orchestra.run.smithi045.stdout: -571> 2023-10-03T19:15:19.915+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 103 ==== osd_op_reply(2486 1000000019e.00000000 [delete] v37'52 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:58.854 INFO:teuthology.orchestra.run.smithi045.stdout: -570> 2023-10-03T19:15:19.915+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 104 ==== osd_op_reply(2518 100000001be.00000000 [delete] v37'53 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:58.854 INFO:teuthology.orchestra.run.smithi045.stdout: -569> 2023-10-03T19:15:19.915+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 107 ==== osd_op_reply(2134 1000000003e.00000000 [delete] v37'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.854 INFO:teuthology.orchestra.run.smithi045.stdout: -568> 2023-10-03T19:15:19.915+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 108 ==== osd_op_reply(2167 1000000005f.00000000 [delete] v37'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.854 INFO:teuthology.orchestra.run.smithi045.stdout: -567> 2023-10-03T19:15:19.915+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 109 ==== osd_op_reply(2159 10000000057.00000000 [delete] v37'43 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.854 INFO:teuthology.orchestra.run.smithi045.stdout: -566> 2023-10-03T19:15:19.915+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 105 ==== osd_op_reply(2103 1000000001f.00000000 [delete] v37'33 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:58.854 INFO:teuthology.orchestra.run.smithi045.stdout: -565> 2023-10-03T19:15:19.915+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 106 ==== osd_op_reply(2275 100000000cb.00000000 [delete] v37'34 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:58.854 INFO:teuthology.orchestra.run.smithi045.stdout: -564> 2023-10-03T19:15:19.915+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 107 ==== osd_op_reply(2357 1000000011d.00000000 [delete] v37'35 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:58.854 INFO:teuthology.orchestra.run.smithi045.stdout: -563> 2023-10-03T19:15:19.915+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 108 ==== osd_op_reply(2124 10000000034.00000000 [delete] v37'17 uv16 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:58.854 INFO:teuthology.orchestra.run.smithi045.stdout: -562> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 110 ==== osd_op_reply(2186 10000000072.00000000 [delete] v37'44 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.855 INFO:teuthology.orchestra.run.smithi045.stdout: -561> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 111 ==== osd_op_reply(2206 10000000086.00000000 [delete] v37'45 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.855 INFO:teuthology.orchestra.run.smithi045.stdout: -560> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 112 ==== osd_op_reply(2224 10000000098.00000000 [delete] v37'46 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.855 INFO:teuthology.orchestra.run.smithi045.stdout: -559> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 113 ==== osd_op_reply(2119 1000000002f.00000000 [delete] v37'29 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.855 INFO:teuthology.orchestra.run.smithi045.stdout: -558> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 114 ==== osd_op_reply(2364 10000000124.00000000 [delete] v37'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.855 INFO:teuthology.orchestra.run.smithi045.stdout: -557> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 115 ==== osd_op_reply(2136 10000000040.00000000 [delete] v37'30 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.855 INFO:teuthology.orchestra.run.smithi045.stdout: -556> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 116 ==== osd_op_reply(2322 100000000fa.00000000 [delete] v37'47 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.855 INFO:teuthology.orchestra.run.smithi045.stdout: -555> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 117 ==== osd_op_reply(2419 1000000015b.00000000 [delete] v37'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.855 INFO:teuthology.orchestra.run.smithi045.stdout: -554> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 118 ==== osd_op_reply(2395 10000000143.00000000 [delete] v37'48 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.855 INFO:teuthology.orchestra.run.smithi045.stdout: -553> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 119 ==== osd_op_reply(2216 10000000090.00000000 [delete] v37'31 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.855 INFO:teuthology.orchestra.run.smithi045.stdout: -552> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 120 ==== osd_op_reply(2494 100000001a6.00000000 [delete] v37'49 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.856 INFO:teuthology.orchestra.run.smithi045.stdout: -551> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 121 ==== osd_op_reply(2256 100000000b8.00000000 [delete] v37'32 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.856 INFO:teuthology.orchestra.run.smithi045.stdout: -550> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 122 ==== osd_op_reply(2351 10000000117.00000000 [delete] v37'33 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.856 INFO:teuthology.orchestra.run.smithi045.stdout: -549> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 123 ==== osd_op_reply(2116 1000000002c.00000000 [delete] v37'26 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.856 INFO:teuthology.orchestra.run.smithi045.stdout: -548> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 124 ==== osd_op_reply(2399 10000000147.00000000 [delete] v37'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.856 INFO:teuthology.orchestra.run.smithi045.stdout: -547> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 125 ==== osd_op_reply(2249 100000000b1.00000000 [delete] v37'27 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.856 INFO:teuthology.orchestra.run.smithi045.stdout: -546> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 126 ==== osd_op_reply(2449 10000000179.00000000 [delete] v37'34 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.856 INFO:teuthology.orchestra.run.smithi045.stdout: -545> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 127 ==== osd_op_reply(2451 1000000017b.00000000 [delete] v37'35 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.856 INFO:teuthology.orchestra.run.smithi045.stdout: -544> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 128 ==== osd_op_reply(2082 1000000000a.00000000 [delete] v37'41 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.856 INFO:teuthology.orchestra.run.smithi045.stdout: -543> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 129 ==== osd_op_reply(2084 1000000000c.00000000 [delete] v37'42 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.857 INFO:teuthology.orchestra.run.smithi045.stdout: -542> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 130 ==== osd_op_reply(2352 10000000118.00000000 [delete] v37'28 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.857 INFO:teuthology.orchestra.run.smithi045.stdout: -541> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 131 ==== osd_op_reply(2466 1000000018a.00000000 [delete] v37'29 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.857 INFO:teuthology.orchestra.run.smithi045.stdout: -540> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 132 ==== osd_op_reply(2469 1000000018d.00000000 [delete] v37'30 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.857 INFO:teuthology.orchestra.run.smithi045.stdout: -539> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 109 ==== osd_op_reply(2085 1000000000d.00000000 [delete] v37'37 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:58.857 INFO:teuthology.orchestra.run.smithi045.stdout: -538> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 110 ==== osd_op_reply(2107 10000000023.00000000 [delete] v37'38 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:58.857 INFO:teuthology.orchestra.run.smithi045.stdout: -537> 2023-10-03T19:15:19.919+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1025 ==== osd_op_reply(2080 10000000008.00000000 [delete] v37'43 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.857 INFO:teuthology.orchestra.run.smithi045.stdout: -536> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 111 ==== osd_op_reply(2270 100000000c6.00000000 [delete] v37'39 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:58.857 INFO:teuthology.orchestra.run.smithi045.stdout: -535> 2023-10-03T19:15:19.919+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1026 ==== osd_op_reply(2105 10000000021.00000000 [delete] v37'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.857 INFO:teuthology.orchestra.run.smithi045.stdout: -534> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 112 ==== osd_op_reply(2283 100000000d3.00000000 [delete] v37'40 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:58.857 INFO:teuthology.orchestra.run.smithi045.stdout: -533> 2023-10-03T19:15:19.919+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1027 ==== osd_op_reply(2123 10000000033.00000000 [delete] v37'21 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.857 INFO:teuthology.orchestra.run.smithi045.stdout: -532> 2023-10-03T19:15:19.919+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1028 ==== osd_op_reply(2127 10000000037.00000000 [delete] v37'45 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.858 INFO:teuthology.orchestra.run.smithi045.stdout: -531> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 113 ==== osd_op_reply(2297 100000000e1.00000000 [delete] v37'41 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:58.951 INFO:teuthology.orchestra.run.smithi045.stdout: -530> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 114 ==== osd_op_reply(2350 10000000116.00000000 [delete] v37'42 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:58.952 INFO:teuthology.orchestra.run.smithi045.stdout: -529> 2023-10-03T19:15:19.919+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 120 ==== osd_op_reply(2365 10000000125.00000000 [delete] v37'35 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.952 INFO:teuthology.orchestra.run.smithi045.stdout: -528> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 115 ==== osd_op_reply(2383 10000000137.00000000 [delete] v37'43 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:58.952 INFO:teuthology.orchestra.run.smithi045.stdout: -527> 2023-10-03T19:15:19.919+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 121 ==== osd_op_reply(2415 10000000157.00000000 [delete] v37'23 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.952 INFO:teuthology.orchestra.run.smithi045.stdout: -526> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 133 ==== osd_op_reply(2445 10000000175.00000000 [delete] v37'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.952 INFO:teuthology.orchestra.run.smithi045.stdout: -525> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 134 ==== osd_op_reply(2463 10000000187.00000000 [delete] v37'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.952 INFO:teuthology.orchestra.run.smithi045.stdout: -524> 2023-10-03T19:15:19.919+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 122 ==== osd_op_reply(2534 100000001ce.00000000 [delete] v37'36 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.952 INFO:teuthology.orchestra.run.smithi045.stdout: -523> 2023-10-03T19:15:19.919+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1029 ==== osd_op_reply(2133 1000000003d.00000000 [delete] v37'46 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.952 INFO:teuthology.orchestra.run.smithi045.stdout: -522> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 135 ==== osd_op_reply(2464 10000000188.00000000 [delete] v37'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.953 INFO:teuthology.orchestra.run.smithi045.stdout: -521> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 116 ==== osd_op_reply(2402 1000000014a.00000000 [delete] v37'44 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:58.953 INFO:teuthology.orchestra.run.smithi045.stdout: -520> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 117 ==== osd_op_reply(2444 10000000174.00000000 [delete] v37'45 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:58.953 INFO:teuthology.orchestra.run.smithi045.stdout: -519> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 118 ==== osd_op_reply(2234 100000000a2.00000000 [delete] v37'33 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:58.953 INFO:teuthology.orchestra.run.smithi045.stdout: -518> 2023-10-03T19:15:19.919+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 109 ==== osd_op_reply(2238 100000000a6.00000000 [delete] v37'18 uv16 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:58.953 INFO:teuthology.orchestra.run.smithi045.stdout: -517> 2023-10-03T19:15:19.919+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 110 ==== osd_op_reply(2369 10000000129.00000000 [delete] v37'19 uv16 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:58.953 INFO:teuthology.orchestra.run.smithi045.stdout: -516> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 119 ==== osd_op_reply(2075 10000000003.00000000 [delete] v37'39 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:58.953 INFO:teuthology.orchestra.run.smithi045.stdout: -515> 2023-10-03T19:15:19.919+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 111 ==== osd_op_reply(2521 100000001c1.00000000 [delete] v37'20 uv16 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:58.953 INFO:teuthology.orchestra.run.smithi045.stdout: -514> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 120 ==== osd_op_reply(2257 100000000b9.00000000 [delete] v37'34 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:58.953 INFO:teuthology.orchestra.run.smithi045.stdout: -513> 2023-10-03T19:15:19.919+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 112 ==== osd_op_reply(2536 100000001d0.00000000 [delete] v37'21 uv16 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:58.953 INFO:teuthology.orchestra.run.smithi045.stdout: -512> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 121 ==== osd_op_reply(2102 1000000001e.00000000 [delete] v37'40 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:58.954 INFO:teuthology.orchestra.run.smithi045.stdout: -511> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 122 ==== osd_op_reply(2135 1000000003f.00000000 [delete] v37'41 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:58.954 INFO:teuthology.orchestra.run.smithi045.stdout: -510> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 123 ==== osd_op_reply(2157 10000000055.00000000 [delete] v37'42 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:58.954 INFO:teuthology.orchestra.run.smithi045.stdout: -509> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 124 ==== osd_op_reply(2095 10000000017.00000000 [delete] v37'21 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:58.954 INFO:teuthology.orchestra.run.smithi045.stdout: -508> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 125 ==== osd_op_reply(2197 1000000007d.00000000 [delete] v37'22 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:58.954 INFO:teuthology.orchestra.run.smithi045.stdout: -507> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 126 ==== osd_op_reply(2288 100000000d8.00000000 [delete] v37'23 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:58.954 INFO:teuthology.orchestra.run.smithi045.stdout: -506> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 127 ==== osd_op_reply(2362 10000000122.00000000 [delete] v37'24 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:58.954 INFO:teuthology.orchestra.run.smithi045.stdout: -505> 2023-10-03T19:15:19.919+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 123 ==== osd_op_reply(2130 1000000003a.00000000 [delete] v37'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.954 INFO:teuthology.orchestra.run.smithi045.stdout: -504> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 136 ==== osd_op_reply(2497 100000001a9.00000000 [delete] v37'41 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.954 INFO:teuthology.orchestra.run.smithi045.stdout: -503> 2023-10-03T19:15:19.919+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 171 ==== osd_op_reply(2156 10000000054.00000000 [delete] v37'37 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:58.955 INFO:teuthology.orchestra.run.smithi045.stdout: -502> 2023-10-03T19:15:19.919+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 137 ==== osd_op_reply(2553 100000001e1.00000000 [delete] v37'42 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.955 INFO:teuthology.orchestra.run.smithi045.stdout: -501> 2023-10-03T19:15:19.923+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 138 ==== osd_op_reply(2499 100000001ab.00000000 [delete] v37'50 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.955 INFO:teuthology.orchestra.run.smithi045.stdout: -500> 2023-10-03T19:15:19.923+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 128 ==== osd_op_reply(2306 100000000ea.00000000 [delete] v37'35 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:58.955 INFO:teuthology.orchestra.run.smithi045.stdout: -499> 2023-10-03T19:15:19.923+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 129 ==== osd_op_reply(2478 10000000196.00000000 [delete] v37'25 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:58.955 INFO:teuthology.orchestra.run.smithi045.stdout: -498> 2023-10-03T19:15:19.923+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 130 ==== osd_op_reply(2225 10000000099.00000000 [delete] v37'43 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:58.955 INFO:teuthology.orchestra.run.smithi045.stdout: -497> 2023-10-03T19:15:19.923+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 172 ==== osd_op_reply(2169 10000000061.00000000 [delete] v37'38 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:58.955 INFO:teuthology.orchestra.run.smithi045.stdout: -496> 2023-10-03T19:15:19.923+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 139 ==== osd_op_reply(2506 100000001b2.00000000 [delete] v37'51 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.955 INFO:teuthology.orchestra.run.smithi045.stdout: -495> 2023-10-03T19:15:19.923+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 173 ==== osd_op_reply(2226 1000000009a.00000000 [delete] v37'39 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:58.955 INFO:teuthology.orchestra.run.smithi045.stdout: -494> 2023-10-03T19:15:19.923+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 124 ==== osd_op_reply(2458 10000000182.00000000 [delete] v37'24 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.956 INFO:teuthology.orchestra.run.smithi045.stdout: -493> 2023-10-03T19:15:19.923+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 125 ==== osd_op_reply(2558 100000001e6.00000000 [delete] v37'37 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.956 INFO:teuthology.orchestra.run.smithi045.stdout: -492> 2023-10-03T19:15:19.923+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 140 ==== osd_op_reply(2550 100000001de.00000000 [delete] v37'52 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.956 INFO:teuthology.orchestra.run.smithi045.stdout: -491> 2023-10-03T19:15:19.923+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 126 ==== osd_op_reply(2554 100000001e2.00000000 [delete] v37'25 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.956 INFO:teuthology.orchestra.run.smithi045.stdout: -490> 2023-10-03T19:15:19.923+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1030 ==== osd_op_reply(2138 10000000042.00000000 [delete] v37'47 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.956 INFO:teuthology.orchestra.run.smithi045.stdout: -489> 2023-10-03T19:15:19.923+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 127 ==== osd_op_reply(2565 100000001ed.00000000 [delete] v37'38 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.956 INFO:teuthology.orchestra.run.smithi045.stdout: -488> 2023-10-03T19:15:19.923+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 128 ==== osd_op_reply(2571 100000001f3.00000000 [delete] v37'26 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.956 INFO:teuthology.orchestra.run.smithi045.stdout: -487> 2023-10-03T19:15:19.923+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 129 ==== osd_op_reply(2572 100000001f4.00000000 [delete] v37'39 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.956 INFO:teuthology.orchestra.run.smithi045.stdout: -486> 2023-10-03T19:15:19.923+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1031 ==== osd_op_reply(2276 100000000cc.00000000 [delete] v37'22 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.956 INFO:teuthology.orchestra.run.smithi045.stdout: -485> 2023-10-03T19:15:19.923+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1032 ==== osd_op_reply(2178 1000000006a.00000000 [delete] v37'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.957 INFO:teuthology.orchestra.run.smithi045.stdout: -484> 2023-10-03T19:15:19.923+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1033 ==== osd_op_reply(2182 1000000006e.00000000 [delete] v37'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.957 INFO:teuthology.orchestra.run.smithi045.stdout: -483> 2023-10-03T19:15:19.923+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 113 ==== osd_op_reply(2189 10000000075.00000000 [delete] v37'23 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:58.957 INFO:teuthology.orchestra.run.smithi045.stdout: -482> 2023-10-03T19:15:19.923+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1034 ==== osd_op_reply(2273 100000000c9.00000000 [delete] v37'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.957 INFO:teuthology.orchestra.run.smithi045.stdout: -481> 2023-10-03T19:15:19.923+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 114 ==== osd_op_reply(2204 10000000084.00000000 [delete] v37'24 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:58.957 INFO:teuthology.orchestra.run.smithi045.stdout: -480> 2023-10-03T19:15:19.923+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 115 ==== osd_op_reply(2115 1000000002b.00000000 [delete] v37'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:58.957 INFO:teuthology.orchestra.run.smithi045.stdout: -479> 2023-10-03T19:15:19.927+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 141 ==== osd_op_reply(2091 10000000013.00000000 [delete] v37'43 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.957 INFO:teuthology.orchestra.run.smithi045.stdout: -478> 2023-10-03T19:15:19.927+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 116 ==== osd_op_reply(2079 10000000007.00000000 [delete] v37'37 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:58.957 INFO:teuthology.orchestra.run.smithi045.stdout: -477> 2023-10-03T19:15:19.927+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 117 ==== osd_op_reply(2117 1000000002d.00000000 [delete] v37'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:58.957 INFO:teuthology.orchestra.run.smithi045.stdout: -476> 2023-10-03T19:15:19.927+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 118 ==== osd_op_reply(2128 10000000038.00000000 [delete] v37'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:58.958 INFO:teuthology.orchestra.run.smithi045.stdout: -475> 2023-10-03T19:15:19.927+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 174 ==== osd_op_reply(2086 1000000000e.00000000 [delete] v37'37 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:58.958 INFO:teuthology.orchestra.run.smithi045.stdout: -474> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1035 ==== osd_op_reply(2218 10000000092.00000000 [delete] v37'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.958 INFO:teuthology.orchestra.run.smithi045.stdout: -473> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1036 ==== osd_op_reply(2278 100000000ce.00000000 [delete] v37'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.958 INFO:teuthology.orchestra.run.smithi045.stdout: -472> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1037 ==== osd_op_reply(2219 10000000093.00000000 [delete] v37'33 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.958 INFO:teuthology.orchestra.run.smithi045.stdout: -471> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1038 ==== osd_op_reply(2121 10000000031.00000000 [delete] v37'29 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.958 INFO:teuthology.orchestra.run.smithi045.stdout: -470> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1039 ==== osd_op_reply(2329 10000000101.00000000 [delete] v37'23 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.958 INFO:teuthology.orchestra.run.smithi045.stdout: -469> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1040 ==== osd_op_reply(2106 10000000022.00000000 [delete] v37'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.958 INFO:teuthology.orchestra.run.smithi045.stdout: -468> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1041 ==== osd_op_reply(2236 100000000a4.00000000 [delete] v37'34 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.958 INFO:teuthology.orchestra.run.smithi045.stdout: -467> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1042 ==== osd_op_reply(2384 10000000138.00000000 [delete] v37'48 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.959 INFO:teuthology.orchestra.run.smithi045.stdout: -466> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1043 ==== osd_op_reply(2456 10000000180.00000000 [delete] v37'49 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.959 INFO:teuthology.orchestra.run.smithi045.stdout: -465> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1044 ==== osd_op_reply(2405 1000000014d.00000000 [delete] v37'35 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.959 INFO:teuthology.orchestra.run.smithi045.stdout: -464> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1045 ==== osd_op_reply(2401 10000000149.00000000 [delete] v37'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.959 INFO:teuthology.orchestra.run.smithi045.stdout: -463> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1046 ==== osd_op_reply(2459 10000000183.00000000 [delete] v37'50 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.959 INFO:teuthology.orchestra.run.smithi045.stdout: -462> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1047 ==== osd_op_reply(2490 100000001a2.00000000 [delete] v37'36 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.959 INFO:teuthology.orchestra.run.smithi045.stdout: -461> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1048 ==== osd_op_reply(2154 10000000052.00000000 [delete] v37'33 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.959 INFO:teuthology.orchestra.run.smithi045.stdout: -460> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1049 ==== osd_op_reply(2190 10000000076.00000000 [delete] v37'44 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.959 INFO:teuthology.orchestra.run.smithi045.stdout: -459> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1050 ==== osd_op_reply(2220 10000000094.00000000 [delete] v37'45 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.959 INFO:teuthology.orchestra.run.smithi045.stdout: -458> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1051 ==== osd_op_reply(2416 10000000158.00000000 [delete] v37'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.959 INFO:teuthology.orchestra.run.smithi045.stdout: -457> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1052 ==== osd_op_reply(2255 100000000b7.00000000 [delete] v37'46 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.960 INFO:teuthology.orchestra.run.smithi045.stdout: -456> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1053 ==== osd_op_reply(2280 100000000d0.00000000 [delete] v37'30 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.960 INFO:teuthology.orchestra.run.smithi045.stdout: -455> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1054 ==== osd_op_reply(2292 100000000dc.00000000 [delete] v37'47 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.960 INFO:teuthology.orchestra.run.smithi045.stdout: -454> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1055 ==== osd_op_reply(2304 100000000e8.00000000 [delete] v37'31 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.960 INFO:teuthology.orchestra.run.smithi045.stdout: -453> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1056 ==== osd_op_reply(2311 100000000ef.00000000 [delete] v37'48 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.960 INFO:teuthology.orchestra.run.smithi045.stdout: -452> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1057 ==== osd_op_reply(2316 100000000f4.00000000 [delete] v37'49 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.960 INFO:teuthology.orchestra.run.smithi045.stdout: -451> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1058 ==== osd_op_reply(2327 100000000ff.00000000 [delete] v37'50 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.960 INFO:teuthology.orchestra.run.smithi045.stdout: -450> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1059 ==== osd_op_reply(2330 10000000102.00000000 [delete] v37'51 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.960 INFO:teuthology.orchestra.run.smithi045.stdout: -449> 2023-10-03T19:15:19.927+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 329 ==== osd_op_reply(2122 10000000032.00000000 [delete] v37'39 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:58.961 INFO:teuthology.orchestra.run.smithi045.stdout: -448> 2023-10-03T19:15:19.927+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 330 ==== osd_op_reply(2090 10000000012.00000000 [delete] v37'33 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:58.961 INFO:teuthology.orchestra.run.smithi045.stdout: -447> 2023-10-03T19:15:19.927+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 331 ==== osd_op_reply(2195 1000000007b.00000000 [delete] v37'27 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:58.961 INFO:teuthology.orchestra.run.smithi045.stdout: -446> 2023-10-03T19:15:19.927+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 332 ==== osd_op_reply(2147 1000000004b.00000000 [delete] v37'40 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:58.961 INFO:teuthology.orchestra.run.smithi045.stdout: -445> 2023-10-03T19:15:19.927+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 333 ==== osd_op_reply(2161 10000000059.00000000 [delete] v37'41 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:58.961 INFO:teuthology.orchestra.run.smithi045.stdout: -444> 2023-10-03T19:15:19.927+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 334 ==== osd_op_reply(2126 10000000036.00000000 [delete] v37'45 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:58.961 INFO:teuthology.orchestra.run.smithi045.stdout: -443> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1060 ==== osd_op_reply(2552 100000001e0.00000000 [delete] v37'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.961 INFO:teuthology.orchestra.run.smithi045.stdout: -442> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1061 ==== osd_op_reply(2470 1000000018e.00000000 [delete] v37'52 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.961 INFO:teuthology.orchestra.run.smithi045.stdout: -441> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1062 ==== osd_op_reply(2539 100000001d3.00000000 [delete] v37'24 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.962 INFO:teuthology.orchestra.run.smithi045.stdout: -440> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1063 ==== osd_op_reply(2483 1000000019b.00000000 [delete] v37'53 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.962 INFO:teuthology.orchestra.run.smithi045.stdout: -439> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1064 ==== osd_op_reply(2545 100000001d9.00000000 [delete] v37'51 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.962 INFO:teuthology.orchestra.run.smithi045.stdout: -438> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1065 ==== osd_op_reply(2498 100000001aa.00000000 [delete] v37'54 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.962 INFO:teuthology.orchestra.run.smithi045.stdout: -437> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1066 ==== osd_op_reply(2501 100000001ad.00000000 [delete] v37'55 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.962 INFO:teuthology.orchestra.run.smithi045.stdout: -436> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1067 ==== osd_op_reply(2556 100000001e4.00000000 [delete] v37'56 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.962 INFO:teuthology.orchestra.run.smithi045.stdout: -435> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1068 ==== osd_op_reply(2568 100000001f0.00000000 [delete] v37'57 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.962 INFO:teuthology.orchestra.run.smithi045.stdout: -434> 2023-10-03T19:15:19.927+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1069 ==== osd_op_reply(2223 10000000097.00000000 [delete] v37'23 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.962 INFO:teuthology.orchestra.run.smithi045.stdout: -433> 2023-10-03T19:15:19.927+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 119 ==== osd_op_reply(2437 1000000016d.00000000 [delete] v37'36 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:58.962 INFO:teuthology.orchestra.run.smithi045.stdout: -432> 2023-10-03T19:15:19.927+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 120 ==== osd_op_reply(2442 10000000172.00000000 [delete] v37'37 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:58.962 INFO:teuthology.orchestra.run.smithi045.stdout: -431> 2023-10-03T19:15:19.927+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 121 ==== osd_op_reply(2566 100000001ee.00000000 [delete] v37'38 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:58.963 INFO:teuthology.orchestra.run.smithi045.stdout: -430> 2023-10-03T19:15:19.927+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 175 ==== osd_op_reply(2323 100000000fb.00000000 [delete] v37'40 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:58.963 INFO:teuthology.orchestra.run.smithi045.stdout: -429> 2023-10-03T19:15:19.927+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 176 ==== osd_op_reply(2346 10000000112.00000000 [delete] v37'41 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:58.963 INFO:teuthology.orchestra.run.smithi045.stdout: -428> 2023-10-03T19:15:19.927+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 177 ==== osd_op_reply(2348 10000000114.00000000 [delete] v37'42 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:58.963 INFO:teuthology.orchestra.run.smithi045.stdout: -427> 2023-10-03T19:15:19.927+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 178 ==== osd_op_reply(2367 10000000127.00000000 [delete] v37'43 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:58.963 INFO:teuthology.orchestra.run.smithi045.stdout: -426> 2023-10-03T19:15:19.927+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 179 ==== osd_op_reply(2474 10000000192.00000000 [delete] v37'44 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:58.963 INFO:teuthology.orchestra.run.smithi045.stdout: -425> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1070 ==== osd_op_reply(2267 100000000c3.00000000 [delete] v37'37 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.963 INFO:teuthology.orchestra.run.smithi045.stdout: -424> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1071 ==== osd_op_reply(2299 100000000e3.00000000 [delete] v37'38 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.963 INFO:teuthology.orchestra.run.smithi045.stdout: -423> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1072 ==== osd_op_reply(2252 100000000b4.00000000 [delete] v37'24 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.963 INFO:teuthology.orchestra.run.smithi045.stdout: -422> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1073 ==== osd_op_reply(2284 100000000d4.00000000 [delete] v37'34 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.964 INFO:teuthology.orchestra.run.smithi045.stdout: -421> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1074 ==== osd_op_reply(2313 100000000f1.00000000 [delete] v37'25 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.964 INFO:teuthology.orchestra.run.smithi045.stdout: -420> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1075 ==== osd_op_reply(2318 100000000f6.00000000 [delete] v37'35 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.964 INFO:teuthology.orchestra.run.smithi045.stdout: -419> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1076 ==== osd_op_reply(2320 100000000f8.00000000 [delete] v37'39 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.964 INFO:teuthology.orchestra.run.smithi045.stdout: -418> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1077 ==== osd_op_reply(2335 10000000107.00000000 [delete] v37'26 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.964 INFO:teuthology.orchestra.run.smithi045.stdout: -417> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1078 ==== osd_op_reply(2347 10000000113.00000000 [delete] v37'40 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.964 INFO:teuthology.orchestra.run.smithi045.stdout: -416> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1079 ==== osd_op_reply(2339 1000000010b.00000000 [delete] v37'27 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.964 INFO:teuthology.orchestra.run.smithi045.stdout: -415> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1080 ==== osd_op_reply(2523 100000001c3.00000000 [delete] v37'41 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.964 INFO:teuthology.orchestra.run.smithi045.stdout: -414> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1081 ==== osd_op_reply(2381 10000000135.00000000 [delete] v37'28 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.964 INFO:teuthology.orchestra.run.smithi045.stdout: -413> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1082 ==== osd_op_reply(2398 10000000146.00000000 [delete] v37'29 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.964 INFO:teuthology.orchestra.run.smithi045.stdout: -412> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1083 ==== osd_op_reply(2403 1000000014b.00000000 [delete] v37'30 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.965 INFO:teuthology.orchestra.run.smithi045.stdout: -411> 2023-10-03T19:15:19.931+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 142 ==== osd_op_reply(2104 10000000020.00000000 [delete] v37'44 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.965 INFO:teuthology.orchestra.run.smithi045.stdout: -410> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 130 ==== osd_op_reply(2173 10000000065.00000000 [delete] v37'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.965 INFO:teuthology.orchestra.run.smithi045.stdout: -409> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 131 ==== osd_op_reply(2272 100000000c8.00000000 [delete] v37'33 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.965 INFO:teuthology.orchestra.run.smithi045.stdout: -408> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 132 ==== osd_op_reply(2294 100000000de.00000000 [delete] v37'34 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.965 INFO:teuthology.orchestra.run.smithi045.stdout: -407> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 133 ==== osd_op_reply(2321 100000000f9.00000000 [delete] v37'35 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.965 INFO:teuthology.orchestra.run.smithi045.stdout: -406> 2023-10-03T19:15:19.931+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 143 ==== osd_op_reply(2129 10000000039.00000000 [delete] v37'45 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.965 INFO:teuthology.orchestra.run.smithi045.stdout: -405> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 180 ==== osd_op_reply(2110 10000000026.00000000 [delete] v37'39 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:58.965 INFO:teuthology.orchestra.run.smithi045.stdout: -404> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 122 ==== osd_op_reply(2142 10000000046.00000000 [delete] v37'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:58.965 INFO:teuthology.orchestra.run.smithi045.stdout: -403> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 123 ==== osd_op_reply(2233 100000000a1.00000000 [delete] v37'25 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:58.966 INFO:teuthology.orchestra.run.smithi045.stdout: -402> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 181 ==== osd_op_reply(2198 1000000007e.00000000 [delete] v37'40 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:58.966 INFO:teuthology.orchestra.run.smithi045.stdout: -401> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 182 ==== osd_op_reply(2326 100000000fe.00000000 [delete] v37'41 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:58.966 INFO:teuthology.orchestra.run.smithi045.stdout: -400> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 183 ==== osd_op_reply(2092 10000000014.00000000 [delete] v37'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:58.966 INFO:teuthology.orchestra.run.smithi045.stdout: -399> 2023-10-03T19:15:19.931+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 144 ==== osd_op_reply(2188 10000000074.00000000 [delete] v37'46 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.966 INFO:teuthology.orchestra.run.smithi045.stdout: -398> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 134 ==== osd_op_reply(2420 1000000015c.00000000 [delete] v37'36 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.966 INFO:teuthology.orchestra.run.smithi045.stdout: -397> 2023-10-03T19:15:19.931+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 145 ==== osd_op_reply(2345 10000000111.00000000 [delete] v37'47 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.966 INFO:teuthology.orchestra.run.smithi045.stdout: -396> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 135 ==== osd_op_reply(2423 1000000015f.00000000 [delete] v37'37 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.966 INFO:teuthology.orchestra.run.smithi045.stdout: -395> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 136 ==== osd_op_reply(2502 100000001ae.00000000 [delete] v37'38 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.966 INFO:teuthology.orchestra.run.smithi045.stdout: -394> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 137 ==== osd_op_reply(2563 100000001eb.00000000 [delete] v37'39 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:58.966 INFO:teuthology.orchestra.run.smithi045.stdout: -393> 2023-10-03T19:15:19.931+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.6 v2:172.21.15.79:6819/1486010128 146 ==== osd_op_reply(2525 100000001c5.00000000 [delete] v37'48 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df4800 2023-10-03T19:20:58.967 INFO:teuthology.orchestra.run.smithi045.stdout: -392> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1084 ==== osd_op_reply(2094 10000000016.00000000 [delete] v37'19 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.967 INFO:teuthology.orchestra.run.smithi045.stdout: -391> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1085 ==== osd_op_reply(2125 10000000035.00000000 [delete] v37'20 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:58.967 INFO:teuthology.orchestra.run.smithi045.stdout: -390> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 184 ==== osd_op_reply(2379 10000000133.00000000 [delete] v37'42 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.008 INFO:teuthology.orchestra.run.smithi045.stdout: -389> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 185 ==== osd_op_reply(2185 10000000071.00000000 [delete] v37'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.008 INFO:teuthology.orchestra.run.smithi045.stdout: -388> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 186 ==== osd_op_reply(2427 10000000163.00000000 [delete] v37'43 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.008 INFO:teuthology.orchestra.run.smithi045.stdout: -387> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 187 ==== osd_op_reply(2488 100000001a0.00000000 [delete] v37'44 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.008 INFO:teuthology.orchestra.run.smithi045.stdout: -386> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 188 ==== osd_op_reply(2205 10000000085.00000000 [delete] v37'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.008 INFO:teuthology.orchestra.run.smithi045.stdout: -385> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1086 ==== osd_op_reply(2394 10000000142.00000000 [delete] v37'32 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:59.008 INFO:teuthology.orchestra.run.smithi045.stdout: -384> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 189 ==== osd_op_reply(2531 100000001cb.00000000 [delete] v37'45 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.008 INFO:teuthology.orchestra.run.smithi045.stdout: -383> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1087 ==== osd_op_reply(2448 10000000178.00000000 [delete] v37'33 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:59.008 INFO:teuthology.orchestra.run.smithi045.stdout: -382> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1088 ==== osd_op_reply(2356 1000000011c.00000000 [delete] v37'36 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:59.009 INFO:teuthology.orchestra.run.smithi045.stdout: -381> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1089 ==== osd_op_reply(2404 1000000014c.00000000 [delete] v37'37 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:59.009 INFO:teuthology.orchestra.run.smithi045.stdout: -380> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 190 ==== osd_op_reply(2175 10000000067.00000000 [delete] v37'38 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.009 INFO:teuthology.orchestra.run.smithi045.stdout: -379> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 335 ==== osd_op_reply(2137 10000000041.00000000 [delete] v37'46 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.009 INFO:teuthology.orchestra.run.smithi045.stdout: -378> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 336 ==== osd_op_reply(2111 10000000027.00000000 [delete] v37'34 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.009 INFO:teuthology.orchestra.run.smithi045.stdout: -377> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 337 ==== osd_op_reply(2331 10000000103.00000000 [delete] v37'42 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.009 INFO:teuthology.orchestra.run.smithi045.stdout: -376> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 338 ==== osd_op_reply(2180 1000000006c.00000000 [delete] v37'47 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.009 INFO:teuthology.orchestra.run.smithi045.stdout: -375> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 339 ==== osd_op_reply(2232 100000000a0.00000000 [delete] v37'48 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.009 INFO:teuthology.orchestra.run.smithi045.stdout: -374> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 340 ==== osd_op_reply(2315 100000000f3.00000000 [delete] v37'35 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.010 INFO:teuthology.orchestra.run.smithi045.stdout: -373> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 341 ==== osd_op_reply(2246 100000000ae.00000000 [delete] v37'49 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.010 INFO:teuthology.orchestra.run.smithi045.stdout: -372> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 342 ==== osd_op_reply(2317 100000000f5.00000000 [delete] v37'50 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.010 INFO:teuthology.orchestra.run.smithi045.stdout: -371> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 343 ==== osd_op_reply(2340 1000000010c.00000000 [delete] v37'36 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.010 INFO:teuthology.orchestra.run.smithi045.stdout: -370> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 344 ==== osd_op_reply(2163 1000000005b.00000000 [delete] v37'25 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.010 INFO:teuthology.orchestra.run.smithi045.stdout: -369> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 345 ==== osd_op_reply(2202 10000000082.00000000 [delete] v37'26 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.010 INFO:teuthology.orchestra.run.smithi045.stdout: -368> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 346 ==== osd_op_reply(2300 100000000e4.00000000 [delete] v37'27 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.010 INFO:teuthology.orchestra.run.smithi045.stdout: -367> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 347 ==== osd_op_reply(2302 100000000e6.00000000 [delete] v37'28 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.010 INFO:teuthology.orchestra.run.smithi045.stdout: -366> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 348 ==== osd_op_reply(2145 10000000049.00000000 [delete] v37'36 uv35 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.010 INFO:teuthology.orchestra.run.smithi045.stdout: -365> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 349 ==== osd_op_reply(2153 10000000051.00000000 [delete] v37'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.011 INFO:teuthology.orchestra.run.smithi045.stdout: -364> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 191 ==== osd_op_reply(2181 1000000006d.00000000 [delete] v37'39 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.011 INFO:teuthology.orchestra.run.smithi045.stdout: -363> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 192 ==== osd_op_reply(2227 1000000009b.00000000 [delete] v37'40 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.011 INFO:teuthology.orchestra.run.smithi045.stdout: -362> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 193 ==== osd_op_reply(2312 100000000f0.00000000 [delete] v37'41 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.011 INFO:teuthology.orchestra.run.smithi045.stdout: -361> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 350 ==== osd_op_reply(2193 10000000079.00000000 [delete] v37'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.011 INFO:teuthology.orchestra.run.smithi045.stdout: -360> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 351 ==== osd_op_reply(2248 100000000b0.00000000 [delete] v37'33 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.011 INFO:teuthology.orchestra.run.smithi045.stdout: -359> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 352 ==== osd_op_reply(2210 1000000008a.00000000 [delete] v37'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.011 INFO:teuthology.orchestra.run.smithi045.stdout: -358> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 353 ==== osd_op_reply(2279 100000000cf.00000000 [delete] v37'34 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.011 INFO:teuthology.orchestra.run.smithi045.stdout: -357> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 354 ==== osd_op_reply(2377 10000000131.00000000 [delete] v37'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.011 INFO:teuthology.orchestra.run.smithi045.stdout: -356> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 194 ==== osd_op_reply(2337 10000000109.00000000 [delete] v37'42 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.012 INFO:teuthology.orchestra.run.smithi045.stdout: -355> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 195 ==== osd_op_reply(2373 1000000012d.00000000 [delete] v37'43 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.012 INFO:teuthology.orchestra.run.smithi045.stdout: -354> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 196 ==== osd_op_reply(2460 10000000184.00000000 [delete] v37'44 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.012 INFO:teuthology.orchestra.run.smithi045.stdout: -353> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 166 ==== osd_op_reply(2074 10000000002.00000000 [delete] v37'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.012 INFO:teuthology.orchestra.run.smithi045.stdout: -352> 2023-10-03T19:15:19.931+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 197 ==== osd_op_reply(2491 100000001a3.00000000 [delete] v37'45 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.012 INFO:teuthology.orchestra.run.smithi045.stdout: -351> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 167 ==== osd_op_reply(2076 10000000004.00000000 [delete] v37'33 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.012 INFO:teuthology.orchestra.run.smithi045.stdout: -350> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 168 ==== osd_op_reply(2120 10000000030.00000000 [delete] v37'27 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.012 INFO:teuthology.orchestra.run.smithi045.stdout: -349> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 169 ==== osd_op_reply(2168 10000000060.00000000 [delete] v37'28 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.012 INFO:teuthology.orchestra.run.smithi045.stdout: -348> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 170 ==== osd_op_reply(2177 10000000069.00000000 [delete] v37'29 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.012 INFO:teuthology.orchestra.run.smithi045.stdout: -347> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 171 ==== osd_op_reply(2281 100000000d1.00000000 [delete] v37'34 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.012 INFO:teuthology.orchestra.run.smithi045.stdout: -346> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 172 ==== osd_op_reply(2089 10000000011.00000000 [delete] v37'27 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.013 INFO:teuthology.orchestra.run.smithi045.stdout: -345> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 173 ==== osd_op_reply(2201 10000000081.00000000 [delete] v37'30 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.013 INFO:teuthology.orchestra.run.smithi045.stdout: -344> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 174 ==== osd_op_reply(2291 100000000db.00000000 [delete] v37'28 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.013 INFO:teuthology.orchestra.run.smithi045.stdout: -343> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 175 ==== osd_op_reply(2296 100000000e0.00000000 [delete] v37'31 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.013 INFO:teuthology.orchestra.run.smithi045.stdout: -342> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 176 ==== osd_op_reply(2307 100000000eb.00000000 [delete] v37'35 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.013 INFO:teuthology.orchestra.run.smithi045.stdout: -341> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 177 ==== osd_op_reply(2087 1000000000f.00000000 [delete] v37'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.013 INFO:teuthology.orchestra.run.smithi045.stdout: -340> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 178 ==== osd_op_reply(2099 1000000001b.00000000 [delete] v37'23 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.013 INFO:teuthology.orchestra.run.smithi045.stdout: -339> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 179 ==== osd_op_reply(2118 1000000002e.00000000 [delete] v37'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.013 INFO:teuthology.orchestra.run.smithi045.stdout: -338> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 180 ==== osd_op_reply(2360 10000000120.00000000 [delete] v37'29 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.013 INFO:teuthology.orchestra.run.smithi045.stdout: -337> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 181 ==== osd_op_reply(2376 10000000130.00000000 [delete] v37'30 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.013 INFO:teuthology.orchestra.run.smithi045.stdout: -336> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 182 ==== osd_op_reply(2083 1000000000b.00000000 [delete] v37'47 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.013 INFO:teuthology.orchestra.run.smithi045.stdout: -335> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 183 ==== osd_op_reply(2097 10000000019.00000000 [delete] v37'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.014 INFO:teuthology.orchestra.run.smithi045.stdout: -334> 2023-10-03T19:15:19.931+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1090 ==== osd_op_reply(2526 100000001c6.00000000 [delete] v37'42 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:59.014 INFO:teuthology.orchestra.run.smithi045.stdout: -333> 2023-10-03T19:15:19.935+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 198 ==== osd_op_reply(2077 10000000005.00000000 [delete] v37'27 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.014 INFO:teuthology.orchestra.run.smithi045.stdout: -332> 2023-10-03T19:15:19.935+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 355 ==== osd_op_reply(2101 1000000001d.00000000 [delete] v37'43 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.014 INFO:teuthology.orchestra.run.smithi045.stdout: -331> 2023-10-03T19:15:19.935+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 356 ==== osd_op_reply(2222 10000000096.00000000 [delete] v37'44 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.014 INFO:teuthology.orchestra.run.smithi045.stdout: -330> 2023-10-03T19:15:19.935+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 131 ==== osd_op_reply(2194 1000000007a.00000000 [delete] v37'19 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:59.014 INFO:teuthology.orchestra.run.smithi045.stdout: -329> 2023-10-03T19:15:19.935+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 132 ==== osd_op_reply(2261 100000000bd.00000000 [delete] v37'20 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:59.015 INFO:teuthology.orchestra.run.smithi045.stdout: -328> 2023-10-03T19:15:19.935+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 133 ==== osd_op_reply(2342 1000000010e.00000000 [delete] v37'36 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:59.015 INFO:teuthology.orchestra.run.smithi045.stdout: -327> 2023-10-03T19:15:19.935+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 134 ==== osd_op_reply(2264 100000000c0.00000000 [delete] v37'21 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:59.015 INFO:teuthology.orchestra.run.smithi045.stdout: -326> 2023-10-03T19:15:19.935+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 135 ==== osd_op_reply(2349 10000000115.00000000 [delete] v37'37 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:59.015 INFO:teuthology.orchestra.run.smithi045.stdout: -325> 2023-10-03T19:15:19.935+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 136 ==== osd_op_reply(2274 100000000ca.00000000 [delete] v37'22 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:59.015 INFO:teuthology.orchestra.run.smithi045.stdout: -324> 2023-10-03T19:15:19.935+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 184 ==== osd_op_reply(2132 1000000003c.00000000 [delete] v37'24 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.015 INFO:teuthology.orchestra.run.smithi045.stdout: -323> 2023-10-03T19:15:19.935+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 185 ==== osd_op_reply(2108 10000000024.00000000 [delete] v37'37 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.015 INFO:teuthology.orchestra.run.smithi045.stdout: -322> 2023-10-03T19:15:19.935+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 186 ==== osd_op_reply(2144 10000000048.00000000 [delete] v37'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.015 INFO:teuthology.orchestra.run.smithi045.stdout: -321> 2023-10-03T19:15:19.935+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 187 ==== osd_op_reply(2143 10000000047.00000000 [delete] v37'25 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.015 INFO:teuthology.orchestra.run.smithi045.stdout: -320> 2023-10-03T19:15:19.935+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 188 ==== osd_op_reply(2207 10000000087.00000000 [delete] v37'26 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.015 INFO:teuthology.orchestra.run.smithi045.stdout: -319> 2023-10-03T19:15:19.935+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 189 ==== osd_op_reply(2221 10000000095.00000000 [delete] v37'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.016 INFO:teuthology.orchestra.run.smithi045.stdout: -318> 2023-10-03T19:15:19.935+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 190 ==== osd_op_reply(2211 1000000008b.00000000 [delete] v37'27 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.016 INFO:teuthology.orchestra.run.smithi045.stdout: -317> 2023-10-03T19:15:19.935+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 191 ==== osd_op_reply(2247 100000000af.00000000 [delete] v37'28 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.016 INFO:teuthology.orchestra.run.smithi045.stdout: -316> 2023-10-03T19:15:19.935+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 192 ==== osd_op_reply(2148 1000000004c.00000000 [delete] v37'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.016 INFO:teuthology.orchestra.run.smithi045.stdout: -315> 2023-10-03T19:15:19.935+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 193 ==== osd_op_reply(2241 100000000a9.00000000 [delete] v37'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.016 INFO:teuthology.orchestra.run.smithi045.stdout: -314> 2023-10-03T19:15:19.935+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 194 ==== osd_op_reply(2150 1000000004e.00000000 [delete] v37'48 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.016 INFO:teuthology.orchestra.run.smithi045.stdout: -313> 2023-10-03T19:15:19.935+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 195 ==== osd_op_reply(2151 1000000004f.00000000 [delete] v37'33 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.016 INFO:teuthology.orchestra.run.smithi045.stdout: -312> 2023-10-03T19:15:19.935+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 196 ==== osd_op_reply(2385 10000000139.00000000 [delete] v37'29 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.016 INFO:teuthology.orchestra.run.smithi045.stdout: -311> 2023-10-03T19:15:19.935+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 197 ==== osd_op_reply(2298 100000000e2.00000000 [delete] v37'41 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.016 INFO:teuthology.orchestra.run.smithi045.stdout: -310> 2023-10-03T19:15:19.935+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 198 ==== osd_op_reply(2422 1000000015e.00000000 [delete] v37'30 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.016 INFO:teuthology.orchestra.run.smithi045.stdout: -309> 2023-10-03T19:15:19.935+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 199 ==== osd_op_reply(2319 100000000f7.00000000 [delete] v37'42 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.017 INFO:teuthology.orchestra.run.smithi045.stdout: -308> 2023-10-03T19:15:19.935+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 200 ==== osd_op_reply(2166 1000000005e.00000000 [delete] v37'34 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.017 INFO:teuthology.orchestra.run.smithi045.stdout: -307> 2023-10-03T19:15:19.935+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 201 ==== osd_op_reply(2253 100000000b5.00000000 [delete] v37'49 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.017 INFO:teuthology.orchestra.run.smithi045.stdout: -306> 2023-10-03T19:15:19.935+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 202 ==== osd_op_reply(2183 1000000006f.00000000 [delete] v37'35 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.017 INFO:teuthology.orchestra.run.smithi045.stdout: -305> 2023-10-03T19:15:19.939+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 203 ==== osd_op_reply(2285 100000000d5.00000000 [delete] v37'50 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.017 INFO:teuthology.orchestra.run.smithi045.stdout: -304> 2023-10-03T19:15:19.939+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 204 ==== osd_op_reply(2254 100000000b6.00000000 [delete] v37'36 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.017 INFO:teuthology.orchestra.run.smithi045.stdout: -303> 2023-10-03T19:15:19.939+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 205 ==== osd_op_reply(2290 100000000da.00000000 [delete] v37'37 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.017 INFO:teuthology.orchestra.run.smithi045.stdout: -302> 2023-10-03T19:15:19.939+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 206 ==== osd_op_reply(2414 10000000156.00000000 [delete] v37'51 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.017 INFO:teuthology.orchestra.run.smithi045.stdout: -301> 2023-10-03T19:15:19.939+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 207 ==== osd_op_reply(2421 1000000015d.00000000 [delete] v37'52 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.018 INFO:teuthology.orchestra.run.smithi045.stdout: -300> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 124 ==== osd_op_reply(2171 10000000063.00000000 [delete] v37'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.018 INFO:teuthology.orchestra.run.smithi045.stdout: -299> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 125 ==== osd_op_reply(2203 10000000083.00000000 [delete] v37'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.018 INFO:teuthology.orchestra.run.smithi045.stdout: -298> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 357 ==== osd_op_reply(2359 1000000011f.00000000 [delete] v37'51 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.018 INFO:teuthology.orchestra.run.smithi045.stdout: -297> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 358 ==== osd_op_reply(2396 10000000144.00000000 [delete] v37'35 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.018 INFO:teuthology.orchestra.run.smithi045.stdout: -296> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 359 ==== osd_op_reply(2390 1000000013e.00000000 [delete] v37'33 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.018 INFO:teuthology.orchestra.run.smithi045.stdout: -295> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 360 ==== osd_op_reply(2391 1000000013f.00000000 [delete] v37'52 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.018 INFO:teuthology.orchestra.run.smithi045.stdout: -294> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 361 ==== osd_op_reply(2393 10000000141.00000000 [delete] v37'37 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.018 INFO:teuthology.orchestra.run.smithi045.stdout: -293> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 362 ==== osd_op_reply(2436 1000000016c.00000000 [delete] v37'53 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.018 INFO:teuthology.orchestra.run.smithi045.stdout: -292> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 363 ==== osd_op_reply(2417 10000000159.00000000 [delete] v37'34 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.018 INFO:teuthology.orchestra.run.smithi045.stdout: -291> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 364 ==== osd_op_reply(2461 10000000185.00000000 [delete] v37'54 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.019 INFO:teuthology.orchestra.run.smithi045.stdout: -290> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 365 ==== osd_op_reply(2411 10000000153.00000000 [delete] v37'28 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.019 INFO:teuthology.orchestra.run.smithi045.stdout: -289> 2023-10-03T19:15:19.939+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1091 ==== osd_op_reply(2462 10000000186.00000000 [delete] v37'34 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:59.019 INFO:teuthology.orchestra.run.smithi045.stdout: -288> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 366 ==== osd_op_reply(2457 10000000181.00000000 [delete] v37'35 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.019 INFO:teuthology.orchestra.run.smithi045.stdout: -287> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 367 ==== osd_op_reply(2493 100000001a5.00000000 [delete] v37'55 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.019 INFO:teuthology.orchestra.run.smithi045.stdout: -286> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 368 ==== osd_op_reply(2512 100000001b8.00000000 [delete] v37'38 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.019 INFO:teuthology.orchestra.run.smithi045.stdout: -285> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 369 ==== osd_op_reply(2435 1000000016b.00000000 [delete] v37'25 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.019 INFO:teuthology.orchestra.run.smithi045.stdout: -284> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 370 ==== osd_op_reply(2496 100000001a8.00000000 [delete] v37'36 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.019 INFO:teuthology.orchestra.run.smithi045.stdout: -283> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 371 ==== osd_op_reply(2438 1000000016e.00000000 [delete] v37'26 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.020 INFO:teuthology.orchestra.run.smithi045.stdout: -282> 2023-10-03T19:15:19.939+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1092 ==== osd_op_reply(2477 10000000195.00000000 [delete] v37'35 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:59.020 INFO:teuthology.orchestra.run.smithi045.stdout: -281> 2023-10-03T19:15:19.939+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1093 ==== osd_op_reply(2570 100000001f2.00000000 [delete] v37'38 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:59.020 INFO:teuthology.orchestra.run.smithi045.stdout: -280> 2023-10-03T19:15:19.939+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1094 ==== osd_op_reply(2555 100000001e3.00000000 [delete] v37'36 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:59.020 INFO:teuthology.orchestra.run.smithi045.stdout: -279> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 126 ==== osd_op_reply(2213 1000000008d.00000000 [delete] v37'41 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.020 INFO:teuthology.orchestra.run.smithi045.stdout: -278> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 372 ==== osd_op_reply(2409 10000000151.00000000 [delete] v37'43 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.020 INFO:teuthology.orchestra.run.smithi045.stdout: -277> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 373 ==== osd_op_reply(2413 10000000155.00000000 [delete] v37'44 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.020 INFO:teuthology.orchestra.run.smithi045.stdout: -276> 2023-10-03T19:15:19.939+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 208 ==== osd_op_reply(2406 1000000014e.00000000 [delete] v37'31 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.020 INFO:teuthology.orchestra.run.smithi045.stdout: -275> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 374 ==== osd_op_reply(2547 100000001db.00000000 [delete] v37'27 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.020 INFO:teuthology.orchestra.run.smithi045.stdout: -274> 2023-10-03T19:15:19.939+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 209 ==== osd_op_reply(2353 10000000119.00000000 [delete] v37'32 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.020 INFO:teuthology.orchestra.run.smithi045.stdout: -273> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 375 ==== osd_op_reply(2452 1000000017c.00000000 [delete] v37'29 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.021 INFO:teuthology.orchestra.run.smithi045.stdout: -272> 2023-10-03T19:15:19.939+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 210 ==== osd_op_reply(2454 1000000017e.00000000 [delete] v37'32 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.021 INFO:teuthology.orchestra.run.smithi045.stdout: -271> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 376 ==== osd_op_reply(2559 100000001e7.00000000 [delete] v37'28 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.021 INFO:teuthology.orchestra.run.smithi045.stdout: -270> 2023-10-03T19:15:19.939+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 211 ==== osd_op_reply(2425 10000000161.00000000 [delete] v37'33 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.021 INFO:teuthology.orchestra.run.smithi045.stdout: -269> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 377 ==== osd_op_reply(2473 10000000191.00000000 [delete] v37'36 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.021 INFO:teuthology.orchestra.run.smithi045.stdout: -268> 2023-10-03T19:15:19.939+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 212 ==== osd_op_reply(2439 1000000016f.00000000 [delete] v37'53 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.021 INFO:teuthology.orchestra.run.smithi045.stdout: -267> 2023-10-03T19:15:19.939+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 213 ==== osd_op_reply(2440 10000000170.00000000 [delete] v37'38 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.021 INFO:teuthology.orchestra.run.smithi045.stdout: -266> 2023-10-03T19:15:19.939+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 214 ==== osd_op_reply(2446 10000000176.00000000 [delete] v37'39 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.021 INFO:teuthology.orchestra.run.smithi045.stdout: -265> 2023-10-03T19:15:19.939+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 215 ==== osd_op_reply(2447 10000000177.00000000 [delete] v37'40 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.021 INFO:teuthology.orchestra.run.smithi045.stdout: -264> 2023-10-03T19:15:19.939+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 137 ==== osd_op_reply(2354 1000000011a.00000000 [delete] v37'38 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:59.021 INFO:teuthology.orchestra.run.smithi045.stdout: -263> 2023-10-03T19:15:19.939+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 138 ==== osd_op_reply(2368 10000000128.00000000 [delete] v37'23 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:59.022 INFO:teuthology.orchestra.run.smithi045.stdout: -262> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 127 ==== osd_op_reply(2244 100000000ac.00000000 [delete] v37'42 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.022 INFO:teuthology.orchestra.run.smithi045.stdout: -261> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 378 ==== osd_op_reply(2511 100000001b7.00000000 [delete] v37'37 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.022 INFO:teuthology.orchestra.run.smithi045.stdout: -260> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 379 ==== osd_op_reply(2431 10000000167.00000000 [delete] v37'37 uv35 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.022 INFO:teuthology.orchestra.run.smithi045.stdout: -259> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 380 ==== osd_op_reply(2537 100000001d1.00000000 [delete] v37'29 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.022 INFO:teuthology.orchestra.run.smithi045.stdout: -258> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 381 ==== osd_op_reply(2484 1000000019c.00000000 [delete] v37'38 uv35 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.022 INFO:teuthology.orchestra.run.smithi045.stdout: -257> 2023-10-03T19:15:19.939+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 139 ==== osd_op_reply(2374 1000000012e.00000000 [delete] v37'24 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:59.022 INFO:teuthology.orchestra.run.smithi045.stdout: -256> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 382 ==== osd_op_reply(2564 100000001ec.00000000 [delete] v37'30 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.022 INFO:teuthology.orchestra.run.smithi045.stdout: -255> 2023-10-03T19:15:19.939+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 140 ==== osd_op_reply(2380 10000000134.00000000 [delete] v37'25 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:59.023 INFO:teuthology.orchestra.run.smithi045.stdout: -254> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 383 ==== osd_op_reply(2516 100000001bc.00000000 [delete] v37'38 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.023 INFO:teuthology.orchestra.run.smithi045.stdout: -253> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 384 ==== osd_op_reply(2567 100000001ef.00000000 [delete] v37'31 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.023 INFO:teuthology.orchestra.run.smithi045.stdout: -252> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 385 ==== osd_op_reply(2434 1000000016a.00000000 [delete] v37'45 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.023 INFO:teuthology.orchestra.run.smithi045.stdout: -251> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 128 ==== osd_op_reply(2293 100000000dd.00000000 [delete] v37'43 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.023 INFO:teuthology.orchestra.run.smithi045.stdout: -250> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 129 ==== osd_op_reply(2259 100000000bb.00000000 [delete] v37'26 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.023 INFO:teuthology.orchestra.run.smithi045.stdout: -249> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 130 ==== osd_op_reply(2341 1000000010d.00000000 [delete] v37'44 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.023 INFO:teuthology.orchestra.run.smithi045.stdout: -248> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 131 ==== osd_op_reply(2305 100000000e9.00000000 [delete] v37'27 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.023 INFO:teuthology.orchestra.run.smithi045.stdout: -247> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 132 ==== osd_op_reply(2308 100000000ec.00000000 [delete] v37'28 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.023 INFO:teuthology.orchestra.run.smithi045.stdout: -246> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 133 ==== osd_op_reply(2375 1000000012f.00000000 [delete] v37'29 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.023 INFO:teuthology.orchestra.run.smithi045.stdout: -245> 2023-10-03T19:15:19.939+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 141 ==== osd_op_reply(2400 10000000148.00000000 [delete] v37'44 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:59.023 INFO:teuthology.orchestra.run.smithi045.stdout: -244> 2023-10-03T19:15:19.939+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 142 ==== osd_op_reply(2407 1000000014f.00000000 [delete] v37'26 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:59.024 INFO:teuthology.orchestra.run.smithi045.stdout: -243> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 134 ==== osd_op_reply(2344 10000000110.00000000 [delete] v37'45 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.116 INFO:teuthology.orchestra.run.smithi045.stdout: -242> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 135 ==== osd_op_reply(2418 1000000015a.00000000 [delete] v37'30 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.116 INFO:teuthology.orchestra.run.smithi045.stdout: -241> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 136 ==== osd_op_reply(2428 10000000164.00000000 [delete] v37'46 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.116 INFO:teuthology.orchestra.run.smithi045.stdout: -240> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 137 ==== osd_op_reply(2515 100000001bb.00000000 [delete] v37'31 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.116 INFO:teuthology.orchestra.run.smithi045.stdout: -239> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 386 ==== osd_op_reply(2519 100000001bf.00000000 [delete] v37'39 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.116 INFO:teuthology.orchestra.run.smithi045.stdout: -238> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 387 ==== osd_op_reply(2573 100000001f5.00000000 [delete] v37'39 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.116 INFO:teuthology.orchestra.run.smithi045.stdout: -237> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 388 ==== osd_op_reply(2520 100000001c0.00000000 [delete] v37'40 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.116 INFO:teuthology.orchestra.run.smithi045.stdout: -236> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 389 ==== osd_op_reply(2500 100000001ac.00000000 [delete] v37'39 uv35 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.117 INFO:teuthology.orchestra.run.smithi045.stdout: -235> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 390 ==== osd_op_reply(2508 100000001b4.00000000 [delete] v37'40 uv35 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.117 INFO:teuthology.orchestra.run.smithi045.stdout: -234> 2023-10-03T19:15:19.939+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 143 ==== osd_op_reply(2096 10000000018.00000000 [delete] v37'33 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:59.117 INFO:teuthology.orchestra.run.smithi045.stdout: -233> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 138 ==== osd_op_reply(2441 10000000171.00000000 [delete] v37'47 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.117 INFO:teuthology.orchestra.run.smithi045.stdout: -232> 2023-10-03T19:15:19.939+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 144 ==== osd_op_reply(2410 10000000152.00000000 [delete] v37'39 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:59.117 INFO:teuthology.orchestra.run.smithi045.stdout: -231> 2023-10-03T19:15:19.939+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 145 ==== osd_op_reply(2140 10000000044.00000000 [delete] v37'34 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:59.117 INFO:teuthology.orchestra.run.smithi045.stdout: -230> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 139 ==== osd_op_reply(2476 10000000194.00000000 [delete] v37'48 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.117 INFO:teuthology.orchestra.run.smithi045.stdout: -229> 2023-10-03T19:15:19.939+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1095 ==== osd_op_reply(2174 10000000066.00000000 [delete] v37'21 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:59.117 INFO:teuthology.orchestra.run.smithi045.stdout: -228> 2023-10-03T19:15:19.939+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1096 ==== osd_op_reply(2192 10000000078.00000000 [delete] v37'22 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:59.117 INFO:teuthology.orchestra.run.smithi045.stdout: -227> 2023-10-03T19:15:19.939+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1097 ==== osd_op_reply(2282 100000000d2.00000000 [delete] v37'23 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:59.118 INFO:teuthology.orchestra.run.smithi045.stdout: -226> 2023-10-03T19:15:19.939+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 146 ==== osd_op_reply(2386 1000000013a.00000000 [delete] v37'35 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:59.118 INFO:teuthology.orchestra.run.smithi045.stdout: -225> 2023-10-03T19:15:19.939+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 147 ==== osd_op_reply(2397 10000000145.00000000 [delete] v37'36 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:59.118 INFO:teuthology.orchestra.run.smithi045.stdout: -224> 2023-10-03T19:15:19.939+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 148 ==== osd_op_reply(2503 100000001af.00000000 [delete] v37'40 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:59.118 INFO:teuthology.orchestra.run.smithi045.stdout: -223> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 140 ==== osd_op_reply(2112 10000000028.00000000 [delete] v37'38 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.118 INFO:teuthology.orchestra.run.smithi045.stdout: -222> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 141 ==== osd_op_reply(2532 100000001cc.00000000 [delete] v37'49 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.118 INFO:teuthology.orchestra.run.smithi045.stdout: -221> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 142 ==== osd_op_reply(2179 1000000006b.00000000 [delete] v37'39 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.118 INFO:teuthology.orchestra.run.smithi045.stdout: -220> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 143 ==== osd_op_reply(2184 10000000070.00000000 [delete] v37'40 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.118 INFO:teuthology.orchestra.run.smithi045.stdout: -219> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 144 ==== osd_op_reply(2191 10000000077.00000000 [delete] v37'41 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.118 INFO:teuthology.orchestra.run.smithi045.stdout: -218> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 145 ==== osd_op_reply(2196 1000000007c.00000000 [delete] v37'42 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.118 INFO:teuthology.orchestra.run.smithi045.stdout: -217> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 146 ==== osd_op_reply(2251 100000000b3.00000000 [delete] v37'43 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.118 INFO:teuthology.orchestra.run.smithi045.stdout: -216> 2023-10-03T19:15:19.939+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 149 ==== osd_op_reply(2504 100000001b0.00000000 [delete] v37'45 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:59.119 INFO:teuthology.orchestra.run.smithi045.stdout: -215> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 147 ==== osd_op_reply(2260 100000000bc.00000000 [delete] v37'44 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.119 INFO:teuthology.orchestra.run.smithi045.stdout: -214> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 148 ==== osd_op_reply(2301 100000000e5.00000000 [delete] v37'45 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.119 INFO:teuthology.orchestra.run.smithi045.stdout: -213> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 149 ==== osd_op_reply(2309 100000000ed.00000000 [delete] v37'46 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.119 INFO:teuthology.orchestra.run.smithi045.stdout: -212> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 150 ==== osd_op_reply(2475 10000000193.00000000 [delete] v37'47 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.119 INFO:teuthology.orchestra.run.smithi045.stdout: -211> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 199 ==== osd_op_reply(2492 100000001a4.00000000 [delete] v37'46 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.119 INFO:teuthology.orchestra.run.smithi045.stdout: -210> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 200 ==== osd_op_reply(2289 100000000d9.00000000 [delete] v37'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.119 INFO:teuthology.orchestra.run.smithi045.stdout: -209> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 201 ==== osd_op_reply(2546 100000001da.00000000 [delete] v37'47 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.119 INFO:teuthology.orchestra.run.smithi045.stdout: -208> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 202 ==== osd_op_reply(2333 10000000105.00000000 [delete] v37'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.119 INFO:teuthology.orchestra.run.smithi045.stdout: -207> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 203 ==== osd_op_reply(2358 1000000011e.00000000 [delete] v37'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.119 INFO:teuthology.orchestra.run.smithi045.stdout: -206> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 151 ==== osd_op_reply(2485 1000000019d.00000000 [delete] v37'48 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.120 INFO:teuthology.orchestra.run.smithi045.stdout: -205> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 152 ==== osd_op_reply(2489 100000001a1.00000000 [delete] v37'49 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.120 INFO:teuthology.orchestra.run.smithi045.stdout: -204> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 153 ==== osd_op_reply(2505 100000001b1.00000000 [delete] v37'50 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.120 INFO:teuthology.orchestra.run.smithi045.stdout: -203> 2023-10-03T19:15:19.939+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.1 v2:172.21.15.45:6808/1433143371 154 ==== osd_op_reply(2544 100000001d8.00000000 [delete] v37'51 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5000 2023-10-03T19:20:59.120 INFO:teuthology.orchestra.run.smithi045.stdout: -202> 2023-10-03T19:15:19.939+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 150 ==== osd_op_reply(2507 100000001b3.00000000 [delete] v37'41 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:59.120 INFO:teuthology.orchestra.run.smithi045.stdout: -201> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 216 ==== osd_op_reply(2529 100000001c9.00000000 [delete] v37'31 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.120 INFO:teuthology.orchestra.run.smithi045.stdout: -200> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 217 ==== osd_op_reply(2472 10000000190.00000000 [delete] v37'36 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.120 INFO:teuthology.orchestra.run.smithi045.stdout: -199> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 218 ==== osd_op_reply(2479 10000000197.00000000 [delete] v37'43 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.120 INFO:teuthology.orchestra.run.smithi045.stdout: -198> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 219 ==== osd_op_reply(2527 100000001c7.00000000 [delete] v37'37 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.120 INFO:teuthology.orchestra.run.smithi045.stdout: -197> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 220 ==== osd_op_reply(2524 100000001c4.00000000 [delete] v37'44 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.120 INFO:teuthology.orchestra.run.smithi045.stdout: -196> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 138 ==== osd_op_reply(2158 10000000056.00000000 [delete] v37'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:59.120 INFO:teuthology.orchestra.run.smithi045.stdout: -195> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 139 ==== osd_op_reply(2243 100000000ab.00000000 [delete] v37'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:59.121 INFO:teuthology.orchestra.run.smithi045.stdout: -194> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 204 ==== osd_op_reply(2100 1000000001c.00000000 [delete] v37'39 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.121 INFO:teuthology.orchestra.run.smithi045.stdout: -193> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 205 ==== osd_op_reply(2139 10000000043.00000000 [delete] v37'40 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.121 INFO:teuthology.orchestra.run.smithi045.stdout: -192> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 140 ==== osd_op_reply(2258 100000000ba.00000000 [delete] v37'33 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:59.121 INFO:teuthology.orchestra.run.smithi045.stdout: -191> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 206 ==== osd_op_reply(2093 10000000015.00000000 [delete] v37'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.121 INFO:teuthology.orchestra.run.smithi045.stdout: -190> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 207 ==== osd_op_reply(2141 10000000045.00000000 [delete] v37'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.121 INFO:teuthology.orchestra.run.smithi045.stdout: -189> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 141 ==== osd_op_reply(2378 10000000132.00000000 [delete] v37'34 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:59.121 INFO:teuthology.orchestra.run.smithi045.stdout: -188> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 142 ==== osd_op_reply(2432 10000000168.00000000 [delete] v37'35 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:59.121 INFO:teuthology.orchestra.run.smithi045.stdout: -187> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 221 ==== osd_op_reply(2471 1000000018f.00000000 [delete] v37'41 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.121 INFO:teuthology.orchestra.run.smithi045.stdout: -186> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 143 ==== osd_op_reply(2487 1000000019f.00000000 [delete] v37'36 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:59.121 INFO:teuthology.orchestra.run.smithi045.stdout: -185> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 222 ==== osd_op_reply(2495 100000001a7.00000000 [delete] v37'54 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.122 INFO:teuthology.orchestra.run.smithi045.stdout: -184> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 391 ==== osd_op_reply(2231 1000000009f.00000000 [delete] v37'45 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.122 INFO:teuthology.orchestra.run.smithi045.stdout: -183> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 223 ==== osd_op_reply(2533 100000001cd.00000000 [delete] v37'42 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.122 INFO:teuthology.orchestra.run.smithi045.stdout: -182> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 208 ==== osd_op_reply(2152 10000000050.00000000 [delete] v37'41 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.122 INFO:teuthology.orchestra.run.smithi045.stdout: -181> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 209 ==== osd_op_reply(2149 1000000004d.00000000 [delete] v37'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.122 INFO:teuthology.orchestra.run.smithi045.stdout: -180> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 210 ==== osd_op_reply(2155 10000000053.00000000 [delete] v37'42 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.122 INFO:teuthology.orchestra.run.smithi045.stdout: -179> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 211 ==== osd_op_reply(2214 1000000008e.00000000 [delete] v37'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.122 INFO:teuthology.orchestra.run.smithi045.stdout: -178> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 392 ==== osd_op_reply(2240 100000000a8.00000000 [delete] v37'46 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.122 INFO:teuthology.orchestra.run.smithi045.stdout: -177> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 212 ==== osd_op_reply(2371 1000000012b.00000000 [delete] v37'28 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.137 INFO:teuthology.orchestra.run.smithi045.stdout: -176> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1098 ==== osd_op_reply(2370 1000000012a.00000000 [delete] v37'24 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:59.137 INFO:teuthology.orchestra.run.smithi045.stdout: -175> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 393 ==== osd_op_reply(2277 100000000cd.00000000 [delete] v37'47 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.137 INFO:teuthology.orchestra.run.smithi045.stdout: -174> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1099 ==== osd_op_reply(2453 1000000017d.00000000 [delete] v37'25 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:59.137 INFO:teuthology.orchestra.run.smithi045.stdout: -173> 2023-10-03T19:15:19.943+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 151 ==== osd_op_reply(2426 10000000162.00000000 [delete] v37'37 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:59.137 INFO:teuthology.orchestra.run.smithi045.stdout: -172> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1100 ==== osd_op_reply(2509 100000001b5.00000000 [delete] v37'26 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:59.137 INFO:teuthology.orchestra.run.smithi045.stdout: -171> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 394 ==== osd_op_reply(2314 100000000f2.00000000 [delete] v37'48 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.137 INFO:teuthology.orchestra.run.smithi045.stdout: -170> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 395 ==== osd_op_reply(2389 1000000013d.00000000 [delete] v37'49 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.138 INFO:teuthology.orchestra.run.smithi045.stdout: -169> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.3 v2:172.21.15.45:6816/4227059688 1101 ==== osd_op_reply(2548 100000001dc.00000000 [delete] v37'27 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4400 2023-10-03T19:20:59.138 INFO:teuthology.orchestra.run.smithi045.stdout: -168> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 213 ==== osd_op_reply(2269 100000000c5.00000000 [delete] v37'43 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.138 INFO:teuthology.orchestra.run.smithi045.stdout: -167> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 214 ==== osd_op_reply(2228 1000000009c.00000000 [delete] v37'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.138 INFO:teuthology.orchestra.run.smithi045.stdout: -166> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 215 ==== osd_op_reply(2229 1000000009d.00000000 [delete] v37'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.138 INFO:teuthology.orchestra.run.smithi045.stdout: -165> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 216 ==== osd_op_reply(2266 100000000c2.00000000 [delete] v37'41 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.138 INFO:teuthology.orchestra.run.smithi045.stdout: -164> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 396 ==== osd_op_reply(2481 10000000199.00000000 [delete] v37'50 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.138 INFO:teuthology.orchestra.run.smithi045.stdout: -163> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 217 ==== osd_op_reply(2328 10000000100.00000000 [delete] v37'44 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.138 INFO:teuthology.orchestra.run.smithi045.stdout: -162> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 218 ==== osd_op_reply(2271 100000000c7.00000000 [delete] v37'42 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.138 INFO:teuthology.orchestra.run.smithi045.stdout: -161> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 397 ==== osd_op_reply(2541 100000001d5.00000000 [delete] v37'51 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.139 INFO:teuthology.orchestra.run.smithi045.stdout: -160> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 219 ==== osd_op_reply(2303 100000000e7.00000000 [delete] v37'43 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.139 INFO:teuthology.orchestra.run.smithi045.stdout: -159> 2023-10-03T19:15:19.943+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 152 ==== osd_op_reply(2522 100000001c2.00000000 [delete] v37'46 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:59.139 INFO:teuthology.orchestra.run.smithi045.stdout: -158> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 220 ==== osd_op_reply(2324 100000000fc.00000000 [delete] v37'44 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.139 INFO:teuthology.orchestra.run.smithi045.stdout: -157> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 398 ==== osd_op_reply(2569 100000001f1.00000000 [delete] v37'52 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.139 INFO:teuthology.orchestra.run.smithi045.stdout: -156> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 221 ==== osd_op_reply(2332 10000000104.00000000 [delete] v37'45 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.139 INFO:teuthology.orchestra.run.smithi045.stdout: -155> 2023-10-03T19:15:19.943+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 153 ==== osd_op_reply(2543 100000001d7.00000000 [delete] v37'38 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:59.139 INFO:teuthology.orchestra.run.smithi045.stdout: -154> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 222 ==== osd_op_reply(2355 1000000011b.00000000 [delete] v37'46 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.139 INFO:teuthology.orchestra.run.smithi045.stdout: -153> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 223 ==== osd_op_reply(2517 100000001bd.00000000 [delete] v37'45 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.139 INFO:teuthology.orchestra.run.smithi045.stdout: -152> 2023-10-03T19:15:19.943+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.4 v2:172.21.15.79:6810/2234162464 154 ==== osd_op_reply(2557 100000001e5.00000000 [delete] v37'39 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf6265fd40 con 0x55cf61df5400 2023-10-03T19:20:59.139 INFO:teuthology.orchestra.run.smithi045.stdout: -151> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 224 ==== osd_op_reply(2363 10000000123.00000000 [delete] v37'47 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.139 INFO:teuthology.orchestra.run.smithi045.stdout: -150> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 224 ==== osd_op_reply(2176 10000000068.00000000 [delete] v37'23 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.139 INFO:teuthology.orchestra.run.smithi045.stdout: -149> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 225 ==== osd_op_reply(2164 1000000005c.00000000 [delete] v37'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.140 INFO:teuthology.orchestra.run.smithi045.stdout: -148> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 225 ==== osd_op_reply(2388 1000000013c.00000000 [delete] v37'48 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.140 INFO:teuthology.orchestra.run.smithi045.stdout: -147> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 226 ==== osd_op_reply(2237 100000000a5.00000000 [delete] v37'24 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.140 INFO:teuthology.orchestra.run.smithi045.stdout: -146> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 226 ==== osd_op_reply(2530 100000001ca.00000000 [delete] v37'46 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.140 INFO:teuthology.orchestra.run.smithi045.stdout: -145> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 227 ==== osd_op_reply(2170 10000000062.00000000 [delete] v37'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.140 INFO:teuthology.orchestra.run.smithi045.stdout: -144> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 228 ==== osd_op_reply(2268 100000000c4.00000000 [delete] v37'25 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.140 INFO:teuthology.orchestra.run.smithi045.stdout: -143> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 227 ==== osd_op_reply(2538 100000001d2.00000000 [delete] v37'47 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.140 INFO:teuthology.orchestra.run.smithi045.stdout: -142> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 229 ==== osd_op_reply(2146 1000000004a.00000000 [delete] v37'38 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.140 INFO:teuthology.orchestra.run.smithi045.stdout: -141> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 228 ==== osd_op_reply(2514 100000001ba.00000000 [delete] v37'49 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.140 INFO:teuthology.orchestra.run.smithi045.stdout: -140> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 230 ==== osd_op_reply(2199 1000000007f.00000000 [delete] v37'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.140 INFO:teuthology.orchestra.run.smithi045.stdout: -139> 2023-10-03T19:15:19.943+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.0 v2:172.21.15.45:6800/1057586985 229 ==== osd_op_reply(2542 100000001d6.00000000 [delete] v37'48 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61df5c00 2023-10-03T19:20:59.141 INFO:teuthology.orchestra.run.smithi045.stdout: -138> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 231 ==== osd_op_reply(2286 100000000d6.00000000 [delete] v37'26 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.141 INFO:teuthology.orchestra.run.smithi045.stdout: -137> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 232 ==== osd_op_reply(2208 10000000088.00000000 [delete] v37'39 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.141 INFO:teuthology.orchestra.run.smithi045.stdout: -136> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 233 ==== osd_op_reply(2200 10000000080.00000000 [delete] v37'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.141 INFO:teuthology.orchestra.run.smithi045.stdout: -135> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 234 ==== osd_op_reply(2310 100000000ee.00000000 [delete] v37'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.141 INFO:teuthology.orchestra.run.smithi045.stdout: -134> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 235 ==== osd_op_reply(2263 100000000bf.00000000 [delete] v37'40 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.141 INFO:teuthology.orchestra.run.smithi045.stdout: -133> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 236 ==== osd_op_reply(2387 1000000013b.00000000 [delete] v37'27 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.141 INFO:teuthology.orchestra.run.smithi045.stdout: -132> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 237 ==== osd_op_reply(2336 10000000108.00000000 [delete] v37'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.141 INFO:teuthology.orchestra.run.smithi045.stdout: -131> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 238 ==== osd_op_reply(2295 100000000df.00000000 [delete] v37'41 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.141 INFO:teuthology.orchestra.run.smithi045.stdout: -130> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 239 ==== osd_op_reply(2450 1000000017a.00000000 [delete] v37'28 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.141 INFO:teuthology.orchestra.run.smithi045.stdout: -129> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 240 ==== osd_op_reply(2343 1000000010f.00000000 [delete] v37'41 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.141 INFO:teuthology.orchestra.run.smithi045.stdout: -128> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 241 ==== osd_op_reply(2429 10000000165.00000000 [delete] v37'42 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.142 INFO:teuthology.orchestra.run.smithi045.stdout: -127> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 242 ==== osd_op_reply(2480 10000000198.00000000 [delete] v37'42 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.142 INFO:teuthology.orchestra.run.smithi045.stdout: -126> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 243 ==== osd_op_reply(2528 100000001c8.00000000 [delete] v37'29 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.142 INFO:teuthology.orchestra.run.smithi045.stdout: -125> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 244 ==== osd_op_reply(2430 10000000166.00000000 [delete] v37'43 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.142 INFO:teuthology.orchestra.run.smithi045.stdout: -124> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 245 ==== osd_op_reply(2560 100000001e8.00000000 [delete] v37'30 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.142 INFO:teuthology.orchestra.run.smithi045.stdout: -123> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 246 ==== osd_op_reply(2561 100000001e9.00000000 [delete] v37'43 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.142 INFO:teuthology.orchestra.run.smithi045.stdout: -122> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 247 ==== osd_op_reply(2562 100000001ea.00000000 [delete] v37'31 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.145 INFO:teuthology.orchestra.run.smithi045.stdout: -121> 2023-10-03T19:15:19.943+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.7 v2:172.21.15.79:6818/3323397754 248 ==== osd_op_reply(2443 10000000173.00000000 [delete] v37'44 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df4c00 2023-10-03T19:20:59.145 INFO:teuthology.orchestra.run.smithi045.stdout: -120> 2023-10-03T19:15:19.943+0000 7f0f05562640 10 MDSIOContextBase::complete: 19MDSIOContextWrapper 2023-10-03T19:20:59.145 INFO:teuthology.orchestra.run.smithi045.stdout: -119> 2023-10-03T19:15:19.943+0000 7f0f05562640 10 MDSContext::complete: 19MDSIOContextWrapper 2023-10-03T19:20:59.145 INFO:teuthology.orchestra.run.smithi045.stdout: -118> 2023-10-03T19:15:19.943+0000 7f0f05562640 10 mds.0.inotable: project_release_ids [0x10000000002~0x1f4] to [0x100000005dd~0xfffffffa23]/[0x100000005dd~0xfffffffa23] 2023-10-03T19:20:59.145 INFO:teuthology.orchestra.run.smithi045.stdout: -117> 2023-10-03T19:15:19.943+0000 7f0f04d61640 5 mds.0.log _submit_thread 10058365~56 : Eurged 500 inos, inotable v6 2023-10-03T19:20:59.145 INFO:teuthology.orchestra.run.smithi045.stdout: -116> 2023-10-03T19:15:19.943+0000 7f0f04d61640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.11:2574 5.1b 5:ddb4e4d7:::200.00000002:head [write 1669757~76 [fadvise_dontneed] in=76b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e37) v8 -- 0x55cf6206fc00 con 0x55cf61c59000 2023-10-03T19:20:59.145 INFO:teuthology.orchestra.run.smithi045.stdout: -115> 2023-10-03T19:15:19.947+0000 7f0f0e574640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.5 v2:172.21.15.79:6802/2879380539 399 ==== osd_op_reply(2574 200.00000002 [write 1669757~76 [fadvise_dontneed]] v37'161 uv161 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55cf61c54fc0 con 0x55cf61c59000 2023-10-03T19:20:59.145 INFO:teuthology.orchestra.run.smithi045.stdout: -114> 2023-10-03T19:15:19.947+0000 7f0f05562640 10 MDSIOContextBase::complete: 28C_MDS_purge_completed_finish 2023-10-03T19:20:59.145 INFO:teuthology.orchestra.run.smithi045.stdout: -113> 2023-10-03T19:15:19.947+0000 7f0f05562640 10 MDSContext::complete: 28C_MDS_purge_completed_finish 2023-10-03T19:20:59.145 INFO:teuthology.orchestra.run.smithi045.stdout: -112> 2023-10-03T19:15:19.947+0000 7f0f05562640 10 mds.0.inotable: apply_release_ids [0x10000000002~0x1f4] to [0x10000000002~0x1f4,0x100000005dd~0xfffffffa23]/[0x100000005dd~0xfffffffa23] 2023-10-03T19:20:59.146 INFO:teuthology.orchestra.run.smithi045.stdout: -111> 2023-10-03T19:15:20.051+0000 7f0f0a56c640 10 monclient: tick 2023-10-03T19:20:59.146 INFO:teuthology.orchestra.run.smithi045.stdout: -110> 2023-10-03T19:15:20.051+0000 7f0f0a56c640 10 monclient: _check_auth_tickets 2023-10-03T19:20:59.146 INFO:teuthology.orchestra.run.smithi045.stdout: -109> 2023-10-03T19:15:20.051+0000 7f0f0a56c640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:14:50.055712+0000) 2023-10-03T19:20:59.146 INFO:teuthology.orchestra.run.smithi045.stdout: -108> 2023-10-03T19:15:20.319+0000 7f0f04560640 20 update_rank0: mds.metrics 2023-10-03T19:20:59.146 INFO:teuthology.orchestra.run.smithi045.stdout: -107> 2023-10-03T19:15:20.319+0000 7f0f04560640 20 update_rank0: mds.metrics: sending metric updates for 1 clients to rank 0 (address: [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936]) with sequence number 23, last updated sequence number 57 2023-10-03T19:20:59.146 INFO:teuthology.orchestra.run.smithi045.stdout: -106> 2023-10-03T19:15:20.319+0000 7f0f04560640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] send_to--> mds [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] -- mds_metrics from rank=0 carrying 1 metric updates v1 -- ?+0 0x55cf60f25c80 2023-10-03T19:20:59.146 INFO:teuthology.orchestra.run.smithi045.stdout: -105> 2023-10-03T19:15:20.319+0000 7f0f04560640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] -- mds_metrics from rank=0 carrying 1 metric updates v1 -- 0x55cf60f25c80 con 0x55cf60ec9c00 2023-10-03T19:20:59.146 INFO:teuthology.orchestra.run.smithi045.stdout: -104> 2023-10-03T19:15:20.319+0000 7f0f0ad6d640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== mds.0 v2:172.21.15.45:6833/252012936 0 ==== mds_metrics from rank=0 carrying 1 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x55cf60f25c80 con 0x55cf60ec9c00 2023-10-03T19:20:59.146 INFO:teuthology.orchestra.run.smithi045.stdout: -103> 2023-10-03T19:15:20.319+0000 7f0f0ad6d640 20 mds.metric.aggregator handle_mds_metrics: applying 1 updates for rank=0 with sequence number 23 2023-10-03T19:20:59.147 INFO:teuthology.orchestra.run.smithi045.stdout: -102> 2023-10-03T19:15:20.319+0000 7f0f0ad6d640 10 mds.pinger pong_received: rank=0, sequence=23 2023-10-03T19:20:59.147 INFO:teuthology.orchestra.run.smithi045.stdout: -101> 2023-10-03T19:15:20.319+0000 7f0f0ad6d640 20 mds.metric.aggregator remove_metrics_for_rank: client=client.5304 172.21.15.146:0/2715925302, rank=0 2023-10-03T19:20:59.147 INFO:teuthology.orchestra.run.smithi045.stdout: -100> 2023-10-03T19:15:20.319+0000 7f0f0ad6d640 20 mds.metric.aggregator remove_metrics_for_rank: rank=0 has 0 connected client(s) 2023-10-03T19:20:59.147 INFO:teuthology.orchestra.run.smithi045.stdout: -99> 2023-10-03T19:15:20.423+0000 7f0f07566640 2 mds.0.cache Memory usage: total 303824, rss 57540, heap 207144, baseline 190760, 0 / 114 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:20:59.147 INFO:teuthology.orchestra.run.smithi045.stdout: -98> 2023-10-03T19:15:20.423+0000 7f0f07566640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999990642s ago 2023-10-03T19:20:59.147 INFO:teuthology.orchestra.run.smithi045.stdout: -97> 2023-10-03T19:15:20.423+0000 7f0f07566640 10 mds.0.cache trim_client_leases 2023-10-03T19:20:59.147 INFO:teuthology.orchestra.run.smithi045.stdout: -96> 2023-10-03T19:15:20.423+0000 7f0f07566640 7 mds.0.cache trim bytes_used=327kB limit=4GB reservation=0.05% count=0 2023-10-03T19:20:59.147 INFO:teuthology.orchestra.run.smithi045.stdout: -95> 2023-10-03T19:15:20.423+0000 7f0f07566640 7 mds.0.cache trim_lru trimming 0 items from LRU size=111 mid=70 pintail=11 pinned=11 2023-10-03T19:20:59.147 INFO:teuthology.orchestra.run.smithi045.stdout: -94> 2023-10-03T19:15:20.423+0000 7f0f07566640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:20:59.147 INFO:teuthology.orchestra.run.smithi045.stdout: -93> 2023-10-03T19:15:20.423+0000 7f0f07566640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:20:59.147 INFO:teuthology.orchestra.run.smithi045.stdout: -92> 2023-10-03T19:15:20.423+0000 7f0f07566640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:20:59.147 INFO:teuthology.orchestra.run.smithi045.stdout: -91> 2023-10-03T19:15:20.423+0000 7f0f07566640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:20:59.148 INFO:teuthology.orchestra.run.smithi045.stdout: -90> 2023-10-03T19:15:21.051+0000 7f0f0a56c640 10 monclient: tick 2023-10-03T19:20:59.148 INFO:teuthology.orchestra.run.smithi045.stdout: -89> 2023-10-03T19:15:21.051+0000 7f0f0a56c640 10 monclient: _check_auth_tickets 2023-10-03T19:20:59.148 INFO:teuthology.orchestra.run.smithi045.stdout: -88> 2023-10-03T19:15:21.051+0000 7f0f0a56c640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:14:51.055817+0000) 2023-10-03T19:20:59.148 INFO:teuthology.orchestra.run.smithi045.stdout: -87> 2023-10-03T19:15:21.315+0000 7f0f09d6b640 20 mds.0.11 get_task_status 2023-10-03T19:20:59.163 INFO:teuthology.orchestra.run.smithi045.stdout: -86> 2023-10-03T19:15:21.315+0000 7f0f09d6b640 20 mds.0.11 schedule_update_timer_task 2023-10-03T19:20:59.163 INFO:teuthology.orchestra.run.smithi045.stdout: -85> 2023-10-03T19:15:21.387+0000 7f0f0956a640 5 mds.beacon.a Sending beacon up:active seq 33 2023-10-03T19:20:59.163 INFO:teuthology.orchestra.run.smithi045.stdout: -84> 2023-10-03T19:15:21.387+0000 7f0f0956a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:20:59.163 INFO:teuthology.orchestra.run.smithi045.stdout: -83> 2023-10-03T19:15:21.387+0000 7f0f0956a640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mdsbeacon(5076/a up:active seq=33 v15) v8 -- 0x55cf62671080 con 0x55cf60ec9400 2023-10-03T19:20:59.163 INFO:teuthology.orchestra.run.smithi045.stdout: -82> 2023-10-03T19:15:21.387+0000 7f0f0956a640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:20:59.164 INFO:teuthology.orchestra.run.smithi045.stdout: -81> 2023-10-03T19:15:21.387+0000 7f0f0dd73640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== mon.0 v2:172.21.15.45:3300/0 85 ==== mdsbeacon(5076/a up:active seq=33 v15) v8 ==== 130+0+0 (secure 0 0 0) 0x55cf62671080 con 0x55cf60ec9400 2023-10-03T19:20:59.164 INFO:teuthology.orchestra.run.smithi045.stdout: -80> 2023-10-03T19:15:21.387+0000 7f0f0dd73640 5 mds.beacon.a received beacon reply up:active seq 33 rtt 0 2023-10-03T19:20:59.164 INFO:teuthology.orchestra.run.smithi045.stdout: -79> 2023-10-03T19:15:21.387+0000 7f0f0956a640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:20:59.164 INFO:teuthology.orchestra.run.smithi045.stdout: -78> 2023-10-03T19:15:21.423+0000 7f0f07566640 2 mds.0.cache Memory usage: total 303824, rss 57540, heap 207144, baseline 190760, 0 / 114 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:20:59.164 INFO:teuthology.orchestra.run.smithi045.stdout: -77> 2023-10-03T19:15:21.423+0000 7f0f07566640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999990642s ago 2023-10-03T19:20:59.164 INFO:teuthology.orchestra.run.smithi045.stdout: -76> 2023-10-03T19:15:21.423+0000 7f0f07566640 10 mds.0.cache trim_client_leases 2023-10-03T19:20:59.164 INFO:teuthology.orchestra.run.smithi045.stdout: -75> 2023-10-03T19:15:21.423+0000 7f0f07566640 7 mds.0.cache trim bytes_used=327kB limit=4GB reservation=0.05% count=0 2023-10-03T19:20:59.164 INFO:teuthology.orchestra.run.smithi045.stdout: -74> 2023-10-03T19:15:21.423+0000 7f0f07566640 7 mds.0.cache trim_lru trimming 0 items from LRU size=111 mid=70 pintail=11 pinned=11 2023-10-03T19:20:59.164 INFO:teuthology.orchestra.run.smithi045.stdout: -73> 2023-10-03T19:15:21.423+0000 7f0f07566640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:20:59.164 INFO:teuthology.orchestra.run.smithi045.stdout: -72> 2023-10-03T19:15:21.423+0000 7f0f07566640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:20:59.164 INFO:teuthology.orchestra.run.smithi045.stdout: -71> 2023-10-03T19:15:21.423+0000 7f0f07566640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:20:59.164 INFO:teuthology.orchestra.run.smithi045.stdout: -70> 2023-10-03T19:15:21.423+0000 7f0f07566640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:20:59.165 INFO:teuthology.orchestra.run.smithi045.stdout: -69> 2023-10-03T19:15:22.051+0000 7f0f0a56c640 10 monclient: tick 2023-10-03T19:20:59.165 INFO:teuthology.orchestra.run.smithi045.stdout: -68> 2023-10-03T19:15:22.051+0000 7f0f0a56c640 10 monclient: _check_auth_tickets 2023-10-03T19:20:59.165 INFO:teuthology.orchestra.run.smithi045.stdout: -67> 2023-10-03T19:15:22.051+0000 7f0f0a56c640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:14:52.055958+0000) 2023-10-03T19:20:59.165 INFO:teuthology.orchestra.run.smithi045.stdout: -66> 2023-10-03T19:15:22.315+0000 7f0f03d5f640 10 mds.metric.aggregator ping_all_active_ranks: pinging 1 active mds(s) 2023-10-03T19:20:59.165 INFO:teuthology.orchestra.run.smithi045.stdout: -65> 2023-10-03T19:15:22.315+0000 7f0f03d5f640 20 mds.metric.aggregator ping_all_active_ranks: pinging rank=0 addr=[v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] 2023-10-03T19:20:59.165 INFO:teuthology.orchestra.run.smithi045.stdout: -64> 2023-10-03T19:15:22.315+0000 7f0f03d5f640 10 mds.pinger send_ping: rank=0 2023-10-03T19:20:59.165 INFO:teuthology.orchestra.run.smithi045.stdout: -63> 2023-10-03T19:15:22.315+0000 7f0f03d5f640 10 mds.pinger send_ping: sending ping with sequence=24 to rank=0 2023-10-03T19:20:59.165 INFO:teuthology.orchestra.run.smithi045.stdout: -62> 2023-10-03T19:15:22.315+0000 7f0f03d5f640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] send_to--> mds [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] -- mdsping v1 -- ?+0 0x55cf60f9a640 2023-10-03T19:20:59.165 INFO:teuthology.orchestra.run.smithi045.stdout: -61> 2023-10-03T19:15:22.315+0000 7f0f03d5f640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] -- mdsping v1 -- 0x55cf60f9a640 con 0x55cf60ec9c00 2023-10-03T19:20:59.165 INFO:teuthology.orchestra.run.smithi045.stdout: -60> 2023-10-03T19:15:22.315+0000 7f0f0ad6d640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== mds.0 v2:172.21.15.45:6833/252012936 0 ==== mdsping v1 ==== 0+0+0 (unknown 0 0 0) 0x55cf60f9a640 con 0x55cf60ec9c00 2023-10-03T19:20:59.165 INFO:teuthology.orchestra.run.smithi045.stdout: -59> 2023-10-03T19:15:22.315+0000 7f0f0ad6d640 20 set_next_seq: mds.metrics: current sequence number 23, setting next sequence number 24 2023-10-03T19:20:59.166 INFO:teuthology.orchestra.run.smithi045.stdout: -58> 2023-10-03T19:15:22.319+0000 7f0f04560640 20 update_rank0: mds.metrics 2023-10-03T19:20:59.166 INFO:teuthology.orchestra.run.smithi045.stdout: -57> 2023-10-03T19:15:22.319+0000 7f0f04560640 20 update_rank0: mds.metrics: sending metric updates for 0 clients to rank 0 (address: [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936]) with sequence number 24, last updated sequence number 58 2023-10-03T19:20:59.166 INFO:teuthology.orchestra.run.smithi045.stdout: -56> 2023-10-03T19:15:22.319+0000 7f0f04560640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] send_to--> mds [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] -- mds_metrics from rank=0 carrying 0 metric updates v1 -- ?+0 0x55cf60f25e00 2023-10-03T19:20:59.166 INFO:teuthology.orchestra.run.smithi045.stdout: -55> 2023-10-03T19:15:22.319+0000 7f0f04560640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] -- mds_metrics from rank=0 carrying 0 metric updates v1 -- 0x55cf60f25e00 con 0x55cf60ec9c00 2023-10-03T19:20:59.166 INFO:teuthology.orchestra.run.smithi045.stdout: -54> 2023-10-03T19:15:22.319+0000 7f0f0ad6d640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== mds.0 v2:172.21.15.45:6833/252012936 0 ==== mds_metrics from rank=0 carrying 0 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x55cf60f25e00 con 0x55cf60ec9c00 2023-10-03T19:20:59.166 INFO:teuthology.orchestra.run.smithi045.stdout: -53> 2023-10-03T19:15:22.319+0000 7f0f0ad6d640 20 mds.metric.aggregator handle_mds_metrics: applying 0 updates for rank=0 with sequence number 24 2023-10-03T19:20:59.166 INFO:teuthology.orchestra.run.smithi045.stdout: -52> 2023-10-03T19:15:22.319+0000 7f0f0ad6d640 10 mds.pinger pong_received: rank=0, sequence=24 2023-10-03T19:20:59.166 INFO:teuthology.orchestra.run.smithi045.stdout: -51> 2023-10-03T19:15:22.423+0000 7f0f07566640 2 mds.0.cache Memory usage: total 303824, rss 57540, heap 207144, baseline 190760, 0 / 114 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:20:59.166 INFO:teuthology.orchestra.run.smithi045.stdout: -50> 2023-10-03T19:15:22.423+0000 7f0f07566640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999990642s ago 2023-10-03T19:20:59.166 INFO:teuthology.orchestra.run.smithi045.stdout: -49> 2023-10-03T19:15:22.423+0000 7f0f07566640 10 mds.0.cache trim_client_leases 2023-10-03T19:20:59.167 INFO:teuthology.orchestra.run.smithi045.stdout: -48> 2023-10-03T19:15:22.423+0000 7f0f07566640 7 mds.0.cache trim bytes_used=327kB limit=4GB reservation=0.05% count=0 2023-10-03T19:20:59.167 INFO:teuthology.orchestra.run.smithi045.stdout: -47> 2023-10-03T19:15:22.423+0000 7f0f07566640 7 mds.0.cache trim_lru trimming 0 items from LRU size=111 mid=70 pintail=11 pinned=11 2023-10-03T19:20:59.167 INFO:teuthology.orchestra.run.smithi045.stdout: -46> 2023-10-03T19:15:22.423+0000 7f0f07566640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:20:59.167 INFO:teuthology.orchestra.run.smithi045.stdout: -45> 2023-10-03T19:15:22.423+0000 7f0f07566640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:20:59.167 INFO:teuthology.orchestra.run.smithi045.stdout: -44> 2023-10-03T19:15:22.423+0000 7f0f07566640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:20:59.167 INFO:teuthology.orchestra.run.smithi045.stdout: -43> 2023-10-03T19:15:22.423+0000 7f0f07566640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:20:59.167 INFO:teuthology.orchestra.run.smithi045.stdout: -42> 2023-10-03T19:15:23.051+0000 7f0f0a56c640 10 monclient: tick 2023-10-03T19:20:59.167 INFO:teuthology.orchestra.run.smithi045.stdout: -41> 2023-10-03T19:15:23.051+0000 7f0f0a56c640 10 monclient: _check_auth_tickets 2023-10-03T19:20:59.167 INFO:teuthology.orchestra.run.smithi045.stdout: -40> 2023-10-03T19:15:23.051+0000 7f0f0a56c640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:14:53.056109+0000) 2023-10-03T19:20:59.167 INFO:teuthology.orchestra.run.smithi045.stdout: -39> 2023-10-03T19:15:23.315+0000 7f0f09d6b640 20 mds.0.11 get_task_status 2023-10-03T19:20:59.167 INFO:teuthology.orchestra.run.smithi045.stdout: -38> 2023-10-03T19:15:23.315+0000 7f0f09d6b640 20 mds.0.11 schedule_update_timer_task 2023-10-03T19:20:59.167 INFO:teuthology.orchestra.run.smithi045.stdout: -37> 2023-10-03T19:15:23.423+0000 7f0f07566640 2 mds.0.cache Memory usage: total 303824, rss 57540, heap 207144, baseline 190760, 0 / 114 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:20:59.167 INFO:teuthology.orchestra.run.smithi045.stdout: -36> 2023-10-03T19:15:23.423+0000 7f0f07566640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999990642s ago 2023-10-03T19:20:59.168 INFO:teuthology.orchestra.run.smithi045.stdout: -35> 2023-10-03T19:15:23.423+0000 7f0f07566640 10 mds.0.cache trim_client_leases 2023-10-03T19:20:59.168 INFO:teuthology.orchestra.run.smithi045.stdout: -34> 2023-10-03T19:15:23.423+0000 7f0f07566640 7 mds.0.cache trim bytes_used=327kB limit=4GB reservation=0.05% count=0 2023-10-03T19:20:59.168 INFO:teuthology.orchestra.run.smithi045.stdout: -33> 2023-10-03T19:15:23.423+0000 7f0f07566640 7 mds.0.cache trim_lru trimming 0 items from LRU size=111 mid=70 pintail=11 pinned=11 2023-10-03T19:20:59.168 INFO:teuthology.orchestra.run.smithi045.stdout: -32> 2023-10-03T19:15:23.423+0000 7f0f07566640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:20:59.168 INFO:teuthology.orchestra.run.smithi045.stdout: -31> 2023-10-03T19:15:23.423+0000 7f0f07566640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:20:59.168 INFO:teuthology.orchestra.run.smithi045.stdout: -30> 2023-10-03T19:15:23.423+0000 7f0f07566640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:20:59.168 INFO:teuthology.orchestra.run.smithi045.stdout: -29> 2023-10-03T19:15:23.423+0000 7f0f07566640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:20:59.168 INFO:teuthology.orchestra.run.smithi045.stdout: -28> 2023-10-03T19:15:23.943+0000 7f0f0b56e640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== mon.0 v2:172.21.15.45:3300/0 86 ==== osd_map(38..38 src has 1..38) v4 ==== 403+0+0 (secure 0 0 0) 0x55cf626676c0 con 0x55cf60ec9400 2023-10-03T19:20:59.168 INFO:teuthology.orchestra.run.smithi045.stdout: -27> 2023-10-03T19:15:23.943+0000 7f0f0b56e640 10 mds.0.snap check_osd_map need_to_purge={} 2023-10-03T19:20:59.168 INFO:teuthology.orchestra.run.smithi045.stdout: -26> 2023-10-03T19:15:23.943+0000 7f0f0b56e640 7 mds.0.server operator(): full = 0 epoch = 38 2023-10-03T19:20:59.168 INFO:teuthology.orchestra.run.smithi045.stdout: -25> 2023-10-03T19:15:23.943+0000 7f0f0b56e640 10 mds.0.server apply_blocklist: killed 0 2023-10-03T19:20:59.168 INFO:teuthology.orchestra.run.smithi045.stdout: -24> 2023-10-03T19:15:23.943+0000 7f0f0b56e640 4 mds.0.11 apply_blocklist: killed 0, blocklisted sessions (2 blocklist entries, 0) 2023-10-03T19:20:59.169 INFO:teuthology.orchestra.run.smithi045.stdout: -23> 2023-10-03T19:15:23.943+0000 7f0f0b56e640 10 monclient: _renew_subs 2023-10-03T19:20:59.169 INFO:teuthology.orchestra.run.smithi045.stdout: -22> 2023-10-03T19:15:23.943+0000 7f0f0b56e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:20:59.169 INFO:teuthology.orchestra.run.smithi045.stdout: -21> 2023-10-03T19:15:23.943+0000 7f0f0b56e640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=39}) v3 -- 0x55cf61d631e0 con 0x55cf60ec9400 2023-10-03T19:20:59.169 INFO:teuthology.orchestra.run.smithi045.stdout: -20> 2023-10-03T19:15:24.039+0000 7f0f09d6b640 10 mds.0.log trim 1 / 128 segments, 3 / -1 events, 0 (0) expiring, 0 (0) expired 2023-10-03T19:20:59.169 INFO:teuthology.orchestra.run.smithi045.stdout: -19> 2023-10-03T19:15:24.039+0000 7f0f09d6b640 10 mds.0.openfiles commit log_seq 3011 committing_log_seq:3011 2023-10-03T19:20:59.169 INFO:teuthology.orchestra.run.smithi045.stdout: -18> 2023-10-03T19:15:24.039+0000 7f0f09d6b640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.11:2575 5.6 5:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b,omap-rm-keys in=24b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e38) v8 -- 0x55cf624b8000 con 0x55cf61df5800 2023-10-03T19:20:59.169 INFO:teuthology.orchestra.run.smithi045.stdout: -17> 2023-10-03T19:15:24.039+0000 7f0f09d6b640 10 mds.0.log _trim_expired_segments waiting for 3011/10057300 to expire 2023-10-03T19:20:59.169 INFO:teuthology.orchestra.run.smithi045.stdout: -16> 2023-10-03T19:15:24.039+0000 7f0f09d6b640 10 mds.0.server find_idle_sessions. last cleared laggy state 970.429s ago 2023-10-03T19:20:59.169 INFO:teuthology.orchestra.run.smithi045.stdout: -15> 2023-10-03T19:15:24.039+0000 7f0f09d6b640 10 mds.0.locker scatter_tick 2023-10-03T19:20:59.169 INFO:teuthology.orchestra.run.smithi045.stdout: -14> 2023-10-03T19:15:24.039+0000 7f0f09d6b640 20 mds.0.locker caps_tick 0 revoking caps 2023-10-03T19:20:59.169 INFO:teuthology.orchestra.run.smithi045.stdout: -13> 2023-10-03T19:15:24.039+0000 7f0f09d6b640 20 mds.0.bal handle_export_pins export_pin_queue size=0 2023-10-03T19:20:59.170 INFO:teuthology.orchestra.run.smithi045.stdout: -12> 2023-10-03T19:15:24.039+0000 7f0f09d6b640 15 mds.0.bal tick tick last_sample now 970.428875s 2023-10-03T19:20:59.170 INFO:teuthology.orchestra.run.smithi045.stdout: -11> 2023-10-03T19:15:24.039+0000 7f0f09d6b640 15 mds.0.bal get_load mdsload<[pop IRD:[C 0.00e+00] IWR:[C 0.00e+00] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 8.07e-01] *LOAD:3.2]/[pop IRD:[C 0.00e+00] IWR:[C 0.00e+00] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 8.07e-01] *LOAD:3.2], req 0, hr 0, qlen 0, cpu 2.73336> 2023-10-03T19:20:59.170 INFO:teuthology.orchestra.run.smithi045.stdout: -10> 2023-10-03T19:15:24.039+0000 7f0f09d6b640 3 mds.0.bal send_heartbeat epoch 9 load mdsload<[pop IRD:[C 0.00e+00] IWR:[C 0.00e+00] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 8.07e-01] *LOAD:3.2]/[pop IRD:[C 0.00e+00] IWR:[C 0.00e+00] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 8.07e-01] *LOAD:3.2], req 0, hr 0, qlen 0, cpu 2.73336> 2023-10-03T19:20:59.170 INFO:teuthology.orchestra.run.smithi045.stdout: -9> 2023-10-03T19:15:24.039+0000 7f0f09d6b640 15 mds.0.cache show_subtrees 2023-10-03T19:20:59.170 INFO:teuthology.orchestra.run.smithi045.stdout: -8> 2023-10-03T19:15:24.039+0000 7f0f09d6b640 10 mds.0.cache |__ 0 auth [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 state=1073741825|complete f(v0 m2023-10-03T19:13:34.494088+0000 1=0+1) n(v3 rc2023-10-03T19:13:46.964642+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37600] 2023-10-03T19:20:59.170 INFO:teuthology.orchestra.run.smithi045.stdout: -7> 2023-10-03T19:15:24.039+0000 7f0f09d6b640 10 mds.0.cache |__ 0 auth [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:13:21.316686+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cf60f37a80] 2023-10-03T19:20:59.170 INFO:teuthology.orchestra.run.smithi045.stdout: -6> 2023-10-03T19:15:24.039+0000 7f0f09d6b640 10 mds.0.cache find_stale_fragment_freeze 2023-10-03T19:20:59.170 INFO:teuthology.orchestra.run.smithi045.stdout: -5> 2023-10-03T19:15:24.039+0000 7f0f09d6b640 10 mds.0.snap check_osd_map - version unchanged 2023-10-03T19:20:59.170 INFO:teuthology.orchestra.run.smithi045.stdout: -4> 2023-10-03T19:15:24.039+0000 7f0f09d6b640 20 mds.0.11 updating export targets, currently 0 ranks are targets 2023-10-03T19:20:59.170 INFO:teuthology.orchestra.run.smithi045.stdout: -3> 2023-10-03T19:15:24.039+0000 7f0f0ed75640 1 -- [v2:172.21.15.45:6833/252012936,v1:172.21.15.45:6835/252012936] <== osd.2 v2:172.21.15.45:6817/964866005 144 ==== osd_op_reply(2575 mds0_openfiles.0 [omap-set-header,omap-rm-keys] v0'0 uv0 ondisk = -108 ((108) Cannot send after transport endpoint shutdown)) v8 ==== 202+0+0 (crc 0 0 0) 0x55cf62656900 con 0x55cf61df5800 2023-10-03T19:20:59.170 INFO:teuthology.orchestra.run.smithi045.stdout: -2> 2023-10-03T19:15:24.039+0000 7f0f05562640 10 MDSIOContextBase::complete: 13C_IO_OFT_Save 2023-10-03T19:20:59.171 INFO:teuthology.orchestra.run.smithi045.stdout: -1> 2023-10-03T19:15:24.039+0000 7f0f05562640 -1 MDSIOContextBase: failed with -108, restarting... 2023-10-03T19:20:59.171 INFO:teuthology.orchestra.run.smithi045.stdout: 0> 2023-10-03T19:15:24.039+0000 7f0f05562640 1 mds.a respawn! 2023-10-03T19:20:59.171 INFO:teuthology.orchestra.run.smithi045.stdout:--- logging levels --- 2023-10-03T19:20:59.171 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 none 2023-10-03T19:20:59.171 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 lockdep 2023-10-03T19:20:59.171 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 context 2023-10-03T19:20:59.261 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 1 crush 2023-10-03T19:20:59.261 INFO:teuthology.orchestra.run.smithi045.stdout: 20/20 mds 2023-10-03T19:20:59.261 INFO:teuthology.orchestra.run.smithi045.stdout: 20/20 mds_balancer 2023-10-03T19:20:59.261 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mds_locker 2023-10-03T19:20:59.261 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mds_log 2023-10-03T19:20:59.261 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mds_log_expire 2023-10-03T19:20:59.261 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mds_migrator 2023-10-03T19:20:59.261 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 buffer 2023-10-03T19:20:59.262 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 timer 2023-10-03T19:20:59.262 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 filer 2023-10-03T19:20:59.262 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 striper 2023-10-03T19:20:59.262 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 objecter 2023-10-03T19:20:59.262 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 rados 2023-10-03T19:20:59.262 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 rbd 2023-10-03T19:20:59.262 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 rbd_mirror 2023-10-03T19:20:59.262 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 rbd_replay 2023-10-03T19:20:59.262 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 rbd_pwl 2023-10-03T19:20:59.262 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 journaler 2023-10-03T19:20:59.262 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 objectcacher 2023-10-03T19:20:59.263 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 immutable_obj_cache 2023-10-03T19:20:59.263 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 client 2023-10-03T19:20:59.263 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 osd 2023-10-03T19:20:59.263 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 optracker 2023-10-03T19:20:59.263 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 objclass 2023-10-03T19:20:59.263 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 3 filestore 2023-10-03T19:20:59.263 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 3 journal 2023-10-03T19:20:59.263 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 1 ms 2023-10-03T19:20:59.263 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mon 2023-10-03T19:20:59.263 INFO:teuthology.orchestra.run.smithi045.stdout: 0/10 monc 2023-10-03T19:20:59.263 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 paxos 2023-10-03T19:20:59.264 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 tp 2023-10-03T19:20:59.264 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 auth 2023-10-03T19:20:59.264 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 crypto 2023-10-03T19:20:59.264 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 1 finisher 2023-10-03T19:20:59.264 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 1 reserver 2023-10-03T19:20:59.264 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 heartbeatmap 2023-10-03T19:20:59.264 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 perfcounter 2023-10-03T19:20:59.264 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw 2023-10-03T19:20:59.264 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw_sync 2023-10-03T19:20:59.264 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw_datacache 2023-10-03T19:20:59.264 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw_access 2023-10-03T19:20:59.264 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw_dbstore 2023-10-03T19:20:59.264 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw_flight 2023-10-03T19:20:59.265 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 javaclient 2023-10-03T19:20:59.265 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 asok 2023-10-03T19:20:59.265 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 1 throttle 2023-10-03T19:20:59.265 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 0 refs 2023-10-03T19:20:59.265 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 compressor 2023-10-03T19:20:59.265 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 bluestore 2023-10-03T19:20:59.265 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 bluefs 2023-10-03T19:20:59.265 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 3 bdev 2023-10-03T19:20:59.265 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 kstore 2023-10-03T19:20:59.265 INFO:teuthology.orchestra.run.smithi045.stdout: 4/ 5 rocksdb 2023-10-03T19:20:59.265 INFO:teuthology.orchestra.run.smithi045.stdout: 4/ 5 leveldb 2023-10-03T19:20:59.265 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 fuse 2023-10-03T19:20:59.266 INFO:teuthology.orchestra.run.smithi045.stdout: 2/ 5 mgr 2023-10-03T19:20:59.266 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mgrc 2023-10-03T19:20:59.266 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 dpdk 2023-10-03T19:20:59.266 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 eventtrace 2023-10-03T19:20:59.266 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 prioritycache 2023-10-03T19:20:59.266 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 test 2023-10-03T19:20:59.266 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 cephfs_mirror 2023-10-03T19:20:59.266 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 cephsqlite 2023-10-03T19:20:59.266 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore 2023-10-03T19:20:59.266 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_onode 2023-10-03T19:20:59.267 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_odata 2023-10-03T19:20:59.267 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_omap 2023-10-03T19:20:59.267 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_tm 2023-10-03T19:20:59.267 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_t 2023-10-03T19:20:59.267 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_cleaner 2023-10-03T19:20:59.267 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_epm 2023-10-03T19:20:59.267 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_lba 2023-10-03T19:20:59.267 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_fixedkv_tree 2023-10-03T19:20:59.267 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_cache 2023-10-03T19:20:59.267 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_journal 2023-10-03T19:20:59.267 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_device 2023-10-03T19:20:59.267 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_backref 2023-10-03T19:20:59.268 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 alienstore 2023-10-03T19:20:59.268 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mclock 2023-10-03T19:20:59.268 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 cyanstore 2023-10-03T19:20:59.268 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 ceph_exporter 2023-10-03T19:20:59.268 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 memstore 2023-10-03T19:20:59.268 INFO:teuthology.orchestra.run.smithi045.stdout: -2/-2 (syslog threshold) 2023-10-03T19:20:59.268 INFO:teuthology.orchestra.run.smithi045.stdout: -1/-1 (stderr threshold) 2023-10-03T19:20:59.268 INFO:teuthology.orchestra.run.smithi045.stdout:--- pthread ID / name mapping for recent threads --- 2023-10-03T19:20:59.268 INFO:teuthology.orchestra.run.smithi045.stdout: 7f0f03d5f640 / ms_dispatch 2023-10-03T19:20:59.268 INFO:teuthology.orchestra.run.smithi045.stdout: 7f0f04560640 / ms_dispatch 2023-10-03T19:20:59.268 INFO:teuthology.orchestra.run.smithi045.stdout: 7f0f04d61640 / md_submit 2023-10-03T19:20:59.268 INFO:teuthology.orchestra.run.smithi045.stdout: 7f0f05562640 / MR_Finisher 2023-10-03T19:20:59.269 INFO:teuthology.orchestra.run.smithi045.stdout: 7f0f06d65640 / mds_rank_progr 2023-10-03T19:20:59.269 INFO:teuthology.orchestra.run.smithi045.stdout: 7f0f07566640 / ms_dispatch 2023-10-03T19:20:59.269 INFO:teuthology.orchestra.run.smithi045.stdout: 7f0f08d69640 / safe_timer 2023-10-03T19:20:59.269 INFO:teuthology.orchestra.run.smithi045.stdout: 7f0f0956a640 / ceph-mds 2023-10-03T19:20:59.269 INFO:teuthology.orchestra.run.smithi045.stdout: 7f0f09d6b640 / safe_timer 2023-10-03T19:20:59.269 INFO:teuthology.orchestra.run.smithi045.stdout: 7f0f0a56c640 / safe_timer 2023-10-03T19:20:59.269 INFO:teuthology.orchestra.run.smithi045.stdout: 7f0f0ad6d640 / ms_local 2023-10-03T19:20:59.269 INFO:teuthology.orchestra.run.smithi045.stdout: 7f0f0b56e640 / ms_dispatch 2023-10-03T19:20:59.269 INFO:teuthology.orchestra.run.smithi045.stdout: 7f0f0dd73640 / msgr-worker-2 2023-10-03T19:20:59.269 INFO:teuthology.orchestra.run.smithi045.stdout: 7f0f0e574640 / msgr-worker-1 2023-10-03T19:20:59.269 INFO:teuthology.orchestra.run.smithi045.stdout: 7f0f0ed75640 / msgr-worker-0 2023-10-03T19:20:59.269 INFO:teuthology.orchestra.run.smithi045.stdout: max_recent 10000 2023-10-03T19:20:59.269 INFO:teuthology.orchestra.run.smithi045.stdout: max_new 1000 2023-10-03T19:20:59.270 INFO:teuthology.orchestra.run.smithi045.stdout: log_file /var/log/ceph/ceph-mds.a.log 2023-10-03T19:20:59.270 INFO:teuthology.orchestra.run.smithi045.stdout:--- end dump of recent events --- 2023-10-03T19:20:59.270 INFO:teuthology.orchestra.run.smithi045.stdout:--- begin dump of recent events --- 2023-10-03T19:20:59.270 INFO:teuthology.orchestra.run.smithi045.stdout: -9999> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000510 [2,head] /dc-dir/dc-file_795 auth v5592 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.835069+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b0b00] 2023-10-03T19:20:59.270 INFO:teuthology.orchestra.run.smithi045.stdout: -9998> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000510 [2,head] /dc-dir/dc-file_795 auth v5592 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.835069+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b0b00] 2023-10-03T19:20:59.270 INFO:teuthology.orchestra.run.smithi045.stdout: -9997> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:20:59.270 INFO:teuthology.orchestra.run.smithi045.stdout: -9996> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 210.161, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.10e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:423.3] 2023-10-03T19:20:59.270 INFO:teuthology.orchestra.run.smithi045.stdout: -9995> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2a4b40 on [dir 0x1 / [2,head] auth pv=6007 v=5599 cv=5559/5559 REP dir_auth=0 ap=204+206 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 204 2023-10-03T19:20:59.270 INFO:teuthology.orchestra.run.smithi045.stdout: -9994> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2a4b40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5598 pv6006 ap=205 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=205) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=204) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 205 2023-10-03T19:20:59.270 INFO:teuthology.orchestra.run.smithi045.stdout: -9993> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5599 cv=5559/5559 REP dir_auth=0 ap=204+205 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2a4b40 count now 204/205 2023-10-03T19:20:59.271 INFO:teuthology.orchestra.run.smithi045.stdout: -9992> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2a4b40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5593 cv=5553/5553 ap=205+205 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=20 | child=1 dirty=1 authpin=1 0x55576d056400] count now 205 2023-10-03T19:20:59.271 INFO:teuthology.orchestra.run.smithi045.stdout: -9991> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000510) auth_unpin by 0x55576d2a4b40 on [inode 0x10000000510 [2,head] /dc-dir/dc-file_795 auth v5592 s=3 n(v0 rc2023-10-03T19:16:10.835069+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6b0b00] now 0 2023-10-03T19:20:59.271 INFO:teuthology.orchestra.run.smithi045.stdout: -9990> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5593 cv=5553/5553 ap=205+204 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=20 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2a4b40 count now 205/204 2023-10-03T19:20:59.271 INFO:teuthology.orchestra.run.smithi045.stdout: -9989> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.271 INFO:teuthology.orchestra.run.smithi045.stdout: -9988> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.271 INFO:teuthology.orchestra.run.smithi045.stdout: -9987> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000511 [2,head] /dc-dir/dc-file_796 auth v3946 pv5594 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.848322+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:10.848322+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6b1080] 2023-10-03T19:20:59.271 INFO:teuthology.orchestra.run.smithi045.stdout: -9986> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5600 2023-10-03T19:20:59.271 INFO:teuthology.orchestra.run.smithi045.stdout: -9985> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5600 pv6006 ap=205 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=205) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=204) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.271 INFO:teuthology.orchestra.run.smithi045.stdout: -9984> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5598 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:20:59.271 INFO:teuthology.orchestra.run.smithi045.stdout: -9983> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5599 cv=5559/5559 REP dir_auth=0 ap=204+205 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5599 2023-10-03T19:20:59.271 INFO:teuthology.orchestra.run.smithi045.stdout: -9982> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000511) pop_and_dirty_projected_inode v5594 2023-10-03T19:20:59.272 INFO:teuthology.orchestra.run.smithi045.stdout: -9981> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000511) mark_dirty [inode 0x10000000511 [2,head] /dc-dir/dc-file_796 auth v5594 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.848322+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6b1080] 2023-10-03T19:20:59.272 INFO:teuthology.orchestra.run.smithi045.stdout: -9980> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_796) mark_dirty [dentry #0x1/dc-dir/dc-file_796 [2,head] auth (dversion lock) pv=5594 v=3946 ino=0x10000000511 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6aec80] 2023-10-03T19:20:59.272 INFO:teuthology.orchestra.run.smithi045.stdout: -9979> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5593 cv=5553/5553 ap=205+204 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=21 | child=1 dirty=1 authpin=1 0x55576d056400] version 5593 2023-10-03T19:20:59.272 INFO:teuthology.orchestra.run.smithi045.stdout: -9978> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d82cc80 v5601 2023-10-03T19:20:59.272 INFO:teuthology.orchestra.run.smithi045.stdout: -9977> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5601 cv=5559/5559 REP dir_auth=0 ap=204+205 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5601 2023-10-03T19:20:59.272 INFO:teuthology.orchestra.run.smithi045.stdout: -9976> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d82cb60 v5595 2023-10-03T19:20:59.272 INFO:teuthology.orchestra.run.smithi045.stdout: -9975> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5595 cv=5553/5553 ap=205+204 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=21 | child=1 dirty=1 authpin=1 0x55576d056400] version 5595 2023-10-03T19:20:59.272 INFO:teuthology.orchestra.run.smithi045.stdout: -9974> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=204 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=204 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:20:59.272 INFO:teuthology.orchestra.run.smithi045.stdout: -9973> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=204) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5600 pv6006 ap=205 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=205) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=204) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.272 INFO:teuthology.orchestra.run.smithi045.stdout: -9972> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=205) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5600 pv6006 ap=205 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=205) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=203) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.273 INFO:teuthology.orchestra.run.smithi045.stdout: -9971> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000511 [2,head] /dc-dir/dc-file_796 auth v5594 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.848322+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b1080] 2023-10-03T19:20:59.273 INFO:teuthology.orchestra.run.smithi045.stdout: -9970> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000511 [2,head] /dc-dir/dc-file_796 auth v5594 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.848322+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b1080] 2023-10-03T19:20:59.273 INFO:teuthology.orchestra.run.smithi045.stdout: -9969> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:20:59.273 INFO:teuthology.orchestra.run.smithi045.stdout: -9968> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:20:59.273 INFO:teuthology.orchestra.run.smithi045.stdout: -9967> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:20:59.273 INFO:teuthology.orchestra.run.smithi045.stdout: -9966> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000511 [2,head] /dc-dir/dc-file_796 auth v5594 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.848322+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b1080] 2023-10-03T19:20:59.273 INFO:teuthology.orchestra.run.smithi045.stdout: -9965> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000511 [2,head] /dc-dir/dc-file_796 auth v5594 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.848322+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b1080] 2023-10-03T19:20:59.273 INFO:teuthology.orchestra.run.smithi045.stdout: -9964> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:20:59.273 INFO:teuthology.orchestra.run.smithi045.stdout: -9963> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 211.161, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.11e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:425.3] 2023-10-03T19:20:59.273 INFO:teuthology.orchestra.run.smithi045.stdout: -9962> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2a4480 on [dir 0x1 / [2,head] auth pv=6007 v=5601 cv=5559/5559 REP dir_auth=0 ap=203+205 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 203 2023-10-03T19:20:59.273 INFO:teuthology.orchestra.run.smithi045.stdout: -9961> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2a4480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5600 pv6006 ap=204 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=204) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=203) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 204 2023-10-03T19:20:59.274 INFO:teuthology.orchestra.run.smithi045.stdout: -9960> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5601 cv=5559/5559 REP dir_auth=0 ap=203+204 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2a4480 count now 203/204 2023-10-03T19:20:59.274 INFO:teuthology.orchestra.run.smithi045.stdout: -9959> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2a4480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5595 cv=5553/5553 ap=204+204 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=21 | child=1 dirty=1 authpin=1 0x55576d056400] count now 204 2023-10-03T19:20:59.274 INFO:teuthology.orchestra.run.smithi045.stdout: -9958> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000511) auth_unpin by 0x55576d2a4480 on [inode 0x10000000511 [2,head] /dc-dir/dc-file_796 auth v5594 s=3 n(v0 rc2023-10-03T19:16:10.848322+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6b1080] now 0 2023-10-03T19:20:59.274 INFO:teuthology.orchestra.run.smithi045.stdout: -9957> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5595 cv=5553/5553 ap=204+203 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=21 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2a4480 count now 204/203 2023-10-03T19:20:59.274 INFO:teuthology.orchestra.run.smithi045.stdout: -9956> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.274 INFO:teuthology.orchestra.run.smithi045.stdout: -9955> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.274 INFO:teuthology.orchestra.run.smithi045.stdout: -9954> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000512 [2,head] /dc-dir/dc-file_797 auth v3950 pv5596 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.859897+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:10.859897+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6b1600] 2023-10-03T19:20:59.274 INFO:teuthology.orchestra.run.smithi045.stdout: -9953> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5602 2023-10-03T19:20:59.274 INFO:teuthology.orchestra.run.smithi045.stdout: -9952> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5602 pv6006 ap=204 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=204) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=203) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.274 INFO:teuthology.orchestra.run.smithi045.stdout: -9951> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5600 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:20:59.275 INFO:teuthology.orchestra.run.smithi045.stdout: -9950> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5601 cv=5559/5559 REP dir_auth=0 ap=203+204 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5601 2023-10-03T19:20:59.275 INFO:teuthology.orchestra.run.smithi045.stdout: -9949> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000512) pop_and_dirty_projected_inode v5596 2023-10-03T19:20:59.275 INFO:teuthology.orchestra.run.smithi045.stdout: -9948> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000512) mark_dirty [inode 0x10000000512 [2,head] /dc-dir/dc-file_797 auth v5596 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.859897+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6b1600] 2023-10-03T19:20:59.275 INFO:teuthology.orchestra.run.smithi045.stdout: -9947> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_797) mark_dirty [dentry #0x1/dc-dir/dc-file_797 [2,head] auth (dversion lock) pv=5596 v=3950 ino=0x10000000512 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6aef00] 2023-10-03T19:20:59.275 INFO:teuthology.orchestra.run.smithi045.stdout: -9946> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5595 cv=5553/5553 ap=204+203 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=22 | child=1 dirty=1 authpin=1 0x55576d056400] version 5595 2023-10-03T19:20:59.275 INFO:teuthology.orchestra.run.smithi045.stdout: -9945> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d82ca40 v5603 2023-10-03T19:20:59.275 INFO:teuthology.orchestra.run.smithi045.stdout: -9944> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5603 cv=5559/5559 REP dir_auth=0 ap=203+204 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5603 2023-10-03T19:20:59.275 INFO:teuthology.orchestra.run.smithi045.stdout: -9943> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d82c920 v5597 2023-10-03T19:20:59.275 INFO:teuthology.orchestra.run.smithi045.stdout: -9942> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5597 cv=5553/5553 ap=204+203 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=22 | child=1 dirty=1 authpin=1 0x55576d056400] version 5597 2023-10-03T19:20:59.275 INFO:teuthology.orchestra.run.smithi045.stdout: -9941> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=203 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=203 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:20:59.275 INFO:teuthology.orchestra.run.smithi045.stdout: -9940> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=203) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5602 pv6006 ap=204 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=204) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=203) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.276 INFO:teuthology.orchestra.run.smithi045.stdout: -9939> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=204) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5602 pv6006 ap=204 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=204) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=202) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.276 INFO:teuthology.orchestra.run.smithi045.stdout: -9938> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000512 [2,head] /dc-dir/dc-file_797 auth v5596 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.859897+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b1600] 2023-10-03T19:20:59.276 INFO:teuthology.orchestra.run.smithi045.stdout: -9937> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000512 [2,head] /dc-dir/dc-file_797 auth v5596 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.859897+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b1600] 2023-10-03T19:20:59.276 INFO:teuthology.orchestra.run.smithi045.stdout: -9936> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:20:59.276 INFO:teuthology.orchestra.run.smithi045.stdout: -9935> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:20:59.276 INFO:teuthology.orchestra.run.smithi045.stdout: -9934> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:20:59.295 INFO:teuthology.orchestra.run.smithi045.stdout: -9933> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000512 [2,head] /dc-dir/dc-file_797 auth v5596 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.859897+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b1600] 2023-10-03T19:20:59.295 INFO:teuthology.orchestra.run.smithi045.stdout: -9932> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000512 [2,head] /dc-dir/dc-file_797 auth v5596 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.859897+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b1600] 2023-10-03T19:20:59.295 INFO:teuthology.orchestra.run.smithi045.stdout: -9931> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:20:59.295 INFO:teuthology.orchestra.run.smithi045.stdout: -9930> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 212.161, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.12e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:427.3] 2023-10-03T19:20:59.295 INFO:teuthology.orchestra.run.smithi045.stdout: -9929> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d5478c0 on [dir 0x1 / [2,head] auth pv=6007 v=5603 cv=5559/5559 REP dir_auth=0 ap=202+204 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 202 2023-10-03T19:20:59.295 INFO:teuthology.orchestra.run.smithi045.stdout: -9928> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d5478c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5597 cv=5553/5553 ap=203+203 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=22 | child=1 dirty=1 authpin=1 0x55576d056400] count now 203 2023-10-03T19:20:59.295 INFO:teuthology.orchestra.run.smithi045.stdout: -9927> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d5478c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5602 pv6006 ap=203 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=203) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=202) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 203 2023-10-03T19:20:59.296 INFO:teuthology.orchestra.run.smithi045.stdout: -9926> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5603 cv=5559/5559 REP dir_auth=0 ap=202+203 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d5478c0 count now 202/203 2023-10-03T19:20:59.296 INFO:teuthology.orchestra.run.smithi045.stdout: -9925> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000512) auth_unpin by 0x55576d5478c0 on [inode 0x10000000512 [2,head] /dc-dir/dc-file_797 auth v5596 s=3 n(v0 rc2023-10-03T19:16:10.859897+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6b1600] now 0 2023-10-03T19:20:59.296 INFO:teuthology.orchestra.run.smithi045.stdout: -9924> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5597 cv=5553/5553 ap=203+202 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=22 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d5478c0 count now 203/202 2023-10-03T19:20:59.296 INFO:teuthology.orchestra.run.smithi045.stdout: -9923> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.296 INFO:teuthology.orchestra.run.smithi045.stdout: -9922> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.296 INFO:teuthology.orchestra.run.smithi045.stdout: -9921> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000513 [2,head] /dc-dir/dc-file_798 auth v3954 pv5598 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.872710+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:10.872710+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6b1b80] 2023-10-03T19:20:59.296 INFO:teuthology.orchestra.run.smithi045.stdout: -9920> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5604 2023-10-03T19:20:59.296 INFO:teuthology.orchestra.run.smithi045.stdout: -9919> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5604 pv6006 ap=203 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=203) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=202) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.296 INFO:teuthology.orchestra.run.smithi045.stdout: -9918> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5602 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:20:59.296 INFO:teuthology.orchestra.run.smithi045.stdout: -9917> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5603 cv=5559/5559 REP dir_auth=0 ap=202+203 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5603 2023-10-03T19:20:59.296 INFO:teuthology.orchestra.run.smithi045.stdout: -9916> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000513) pop_and_dirty_projected_inode v5598 2023-10-03T19:20:59.297 INFO:teuthology.orchestra.run.smithi045.stdout: -9915> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000513) mark_dirty [inode 0x10000000513 [2,head] /dc-dir/dc-file_798 auth v5598 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.872710+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6b1b80] 2023-10-03T19:20:59.297 INFO:teuthology.orchestra.run.smithi045.stdout: -9914> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_798) mark_dirty [dentry #0x1/dc-dir/dc-file_798 [2,head] auth (dversion lock) pv=5598 v=3954 ino=0x10000000513 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6af180] 2023-10-03T19:20:59.297 INFO:teuthology.orchestra.run.smithi045.stdout: -9913> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5597 cv=5553/5553 ap=203+202 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=23 | child=1 dirty=1 authpin=1 0x55576d056400] version 5597 2023-10-03T19:20:59.297 INFO:teuthology.orchestra.run.smithi045.stdout: -9912> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d82c800 v5605 2023-10-03T19:20:59.297 INFO:teuthology.orchestra.run.smithi045.stdout: -9911> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5605 cv=5559/5559 REP dir_auth=0 ap=202+203 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5605 2023-10-03T19:20:59.297 INFO:teuthology.orchestra.run.smithi045.stdout: -9910> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d82c6e0 v5599 2023-10-03T19:20:59.297 INFO:teuthology.orchestra.run.smithi045.stdout: -9909> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5599 cv=5553/5553 ap=203+202 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=23 | child=1 dirty=1 authpin=1 0x55576d056400] version 5599 2023-10-03T19:20:59.297 INFO:teuthology.orchestra.run.smithi045.stdout: -9908> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=202 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=202 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:20:59.298 INFO:teuthology.orchestra.run.smithi045.stdout: -9907> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=202) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5604 pv6006 ap=203 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=203) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=202) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.298 INFO:teuthology.orchestra.run.smithi045.stdout: -9906> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=203) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5604 pv6006 ap=203 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=203) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=201) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.298 INFO:teuthology.orchestra.run.smithi045.stdout: -9905> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000513 [2,head] /dc-dir/dc-file_798 auth v5598 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.872710+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b1b80] 2023-10-03T19:20:59.298 INFO:teuthology.orchestra.run.smithi045.stdout: -9904> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000513 [2,head] /dc-dir/dc-file_798 auth v5598 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.872710+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b1b80] 2023-10-03T19:20:59.298 INFO:teuthology.orchestra.run.smithi045.stdout: -9903> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:20:59.298 INFO:teuthology.orchestra.run.smithi045.stdout: -9902> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:20:59.298 INFO:teuthology.orchestra.run.smithi045.stdout: -9901> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:20:59.298 INFO:teuthology.orchestra.run.smithi045.stdout: -9900> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000513 [2,head] /dc-dir/dc-file_798 auth v5598 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.872710+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b1b80] 2023-10-03T19:20:59.298 INFO:teuthology.orchestra.run.smithi045.stdout: -9899> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000513 [2,head] /dc-dir/dc-file_798 auth v5598 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.872710+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b1b80] 2023-10-03T19:20:59.298 INFO:teuthology.orchestra.run.smithi045.stdout: -9898> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:20:59.298 INFO:teuthology.orchestra.run.smithi045.stdout: -9897> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 213.161, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.13e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:429.3] 2023-10-03T19:20:59.299 INFO:teuthology.orchestra.run.smithi045.stdout: -9896> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d5c6fc0 on [dir 0x1 / [2,head] auth pv=6007 v=5605 cv=5559/5559 REP dir_auth=0 ap=201+203 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 201 2023-10-03T19:20:59.299 INFO:teuthology.orchestra.run.smithi045.stdout: -9895> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d5c6fc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5604 pv6006 ap=202 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=202) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=201) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 202 2023-10-03T19:20:59.299 INFO:teuthology.orchestra.run.smithi045.stdout: -9894> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5605 cv=5559/5559 REP dir_auth=0 ap=201+202 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d5c6fc0 count now 201/202 2023-10-03T19:20:59.299 INFO:teuthology.orchestra.run.smithi045.stdout: -9893> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d5c6fc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5599 cv=5553/5553 ap=202+202 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=23 | child=1 dirty=1 authpin=1 0x55576d056400] count now 202 2023-10-03T19:20:59.299 INFO:teuthology.orchestra.run.smithi045.stdout: -9892> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000513) auth_unpin by 0x55576d5c6fc0 on [inode 0x10000000513 [2,head] /dc-dir/dc-file_798 auth v5598 s=3 n(v0 rc2023-10-03T19:16:10.872710+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6b1b80] now 0 2023-10-03T19:20:59.299 INFO:teuthology.orchestra.run.smithi045.stdout: -9891> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5599 cv=5553/5553 ap=202+201 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=23 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d5c6fc0 count now 202/201 2023-10-03T19:20:59.299 INFO:teuthology.orchestra.run.smithi045.stdout: -9890> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.299 INFO:teuthology.orchestra.run.smithi045.stdout: -9889> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.299 INFO:teuthology.orchestra.run.smithi045.stdout: -9888> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000514 [2,head] /dc-dir/dc-file_799 auth v3958 pv5600 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.884717+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:10.884717+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6b2100] 2023-10-03T19:20:59.300 INFO:teuthology.orchestra.run.smithi045.stdout: -9887> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5606 2023-10-03T19:20:59.300 INFO:teuthology.orchestra.run.smithi045.stdout: -9886> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5606 pv6006 ap=202 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=202) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=201) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.300 INFO:teuthology.orchestra.run.smithi045.stdout: -9885> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5604 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:20:59.300 INFO:teuthology.orchestra.run.smithi045.stdout: -9884> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5605 cv=5559/5559 REP dir_auth=0 ap=201+202 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5605 2023-10-03T19:20:59.300 INFO:teuthology.orchestra.run.smithi045.stdout: -9883> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000514) pop_and_dirty_projected_inode v5600 2023-10-03T19:20:59.300 INFO:teuthology.orchestra.run.smithi045.stdout: -9882> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000514) mark_dirty [inode 0x10000000514 [2,head] /dc-dir/dc-file_799 auth v5600 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.884717+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6b2100] 2023-10-03T19:20:59.300 INFO:teuthology.orchestra.run.smithi045.stdout: -9881> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_799) mark_dirty [dentry #0x1/dc-dir/dc-file_799 [2,head] auth (dversion lock) pv=5600 v=3958 ino=0x10000000514 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6af400] 2023-10-03T19:20:59.300 INFO:teuthology.orchestra.run.smithi045.stdout: -9880> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5599 cv=5553/5553 ap=202+201 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=24 | child=1 dirty=1 authpin=1 0x55576d056400] version 5599 2023-10-03T19:20:59.318 INFO:teuthology.orchestra.run.smithi045.stdout: -9879> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d82c5c0 v5607 2023-10-03T19:20:59.318 INFO:teuthology.orchestra.run.smithi045.stdout: -9878> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5607 cv=5559/5559 REP dir_auth=0 ap=201+202 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5607 2023-10-03T19:20:59.318 INFO:teuthology.orchestra.run.smithi045.stdout: -9877> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d82c4a0 v5601 2023-10-03T19:20:59.319 INFO:teuthology.orchestra.run.smithi045.stdout: -9876> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5601 cv=5553/5553 ap=202+201 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=24 | child=1 dirty=1 authpin=1 0x55576d056400] version 5601 2023-10-03T19:20:59.319 INFO:teuthology.orchestra.run.smithi045.stdout: -9875> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=201 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=201 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:20:59.319 INFO:teuthology.orchestra.run.smithi045.stdout: -9874> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=201) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5606 pv6006 ap=202 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=202) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=201) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.319 INFO:teuthology.orchestra.run.smithi045.stdout: -9873> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=202) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5606 pv6006 ap=202 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=202) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=200) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.319 INFO:teuthology.orchestra.run.smithi045.stdout: -9872> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000514 [2,head] /dc-dir/dc-file_799 auth v5600 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.884717+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b2100] 2023-10-03T19:20:59.319 INFO:teuthology.orchestra.run.smithi045.stdout: -9871> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000514 [2,head] /dc-dir/dc-file_799 auth v5600 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.884717+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b2100] 2023-10-03T19:20:59.319 INFO:teuthology.orchestra.run.smithi045.stdout: -9870> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:20:59.319 INFO:teuthology.orchestra.run.smithi045.stdout: -9869> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:20:59.319 INFO:teuthology.orchestra.run.smithi045.stdout: -9868> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:20:59.320 INFO:teuthology.orchestra.run.smithi045.stdout: -9867> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000514 [2,head] /dc-dir/dc-file_799 auth v5600 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.884717+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b2100] 2023-10-03T19:20:59.320 INFO:teuthology.orchestra.run.smithi045.stdout: -9866> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000514 [2,head] /dc-dir/dc-file_799 auth v5600 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.884717+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b2100] 2023-10-03T19:20:59.320 INFO:teuthology.orchestra.run.smithi045.stdout: -9865> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:20:59.320 INFO:teuthology.orchestra.run.smithi045.stdout: -9864> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 214.161, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.14e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:431.3] 2023-10-03T19:20:59.320 INFO:teuthology.orchestra.run.smithi045.stdout: -9863> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d097b00 on [dir 0x1 / [2,head] auth pv=6007 v=5607 cv=5559/5559 REP dir_auth=0 ap=200+202 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 200 2023-10-03T19:20:59.320 INFO:teuthology.orchestra.run.smithi045.stdout: -9862> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d097b00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5606 pv6006 ap=201 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=201) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=200) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 201 2023-10-03T19:20:59.320 INFO:teuthology.orchestra.run.smithi045.stdout: -9861> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5607 cv=5559/5559 REP dir_auth=0 ap=200+201 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d097b00 count now 200/201 2023-10-03T19:20:59.320 INFO:teuthology.orchestra.run.smithi045.stdout: -9860> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d097b00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5601 cv=5553/5553 ap=201+201 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=24 | child=1 dirty=1 authpin=1 0x55576d056400] count now 201 2023-10-03T19:20:59.320 INFO:teuthology.orchestra.run.smithi045.stdout: -9859> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000514) auth_unpin by 0x55576d097b00 on [inode 0x10000000514 [2,head] /dc-dir/dc-file_799 auth v5600 s=3 n(v0 rc2023-10-03T19:16:10.884717+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6b2100] now 0 2023-10-03T19:20:59.320 INFO:teuthology.orchestra.run.smithi045.stdout: -9858> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5601 cv=5553/5553 ap=201+200 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=24 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d097b00 count now 201/200 2023-10-03T19:20:59.320 INFO:teuthology.orchestra.run.smithi045.stdout: -9857> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.321 INFO:teuthology.orchestra.run.smithi045.stdout: -9856> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.321 INFO:teuthology.orchestra.run.smithi045.stdout: -9855> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000515 [2,head] /dc-dir/dc-file_800 auth v3962 pv5602 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.896866+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:10.896866+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6b2680] 2023-10-03T19:20:59.321 INFO:teuthology.orchestra.run.smithi045.stdout: -9854> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5608 2023-10-03T19:20:59.321 INFO:teuthology.orchestra.run.smithi045.stdout: -9853> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5608 pv6006 ap=201 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=201) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=200) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.321 INFO:teuthology.orchestra.run.smithi045.stdout: -9852> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5606 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:20:59.321 INFO:teuthology.orchestra.run.smithi045.stdout: -9851> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5607 cv=5559/5559 REP dir_auth=0 ap=200+201 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5607 2023-10-03T19:20:59.321 INFO:teuthology.orchestra.run.smithi045.stdout: -9850> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000515) pop_and_dirty_projected_inode v5602 2023-10-03T19:20:59.321 INFO:teuthology.orchestra.run.smithi045.stdout: -9849> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000515) mark_dirty [inode 0x10000000515 [2,head] /dc-dir/dc-file_800 auth v5602 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.896866+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6b2680] 2023-10-03T19:20:59.321 INFO:teuthology.orchestra.run.smithi045.stdout: -9848> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_800) mark_dirty [dentry #0x1/dc-dir/dc-file_800 [2,head] auth (dversion lock) pv=5602 v=3962 ino=0x10000000515 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6af680] 2023-10-03T19:20:59.321 INFO:teuthology.orchestra.run.smithi045.stdout: -9847> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5601 cv=5553/5553 ap=201+200 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=25 | child=1 dirty=1 authpin=1 0x55576d056400] version 5601 2023-10-03T19:20:59.321 INFO:teuthology.orchestra.run.smithi045.stdout: -9846> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d82c380 v5609 2023-10-03T19:20:59.322 INFO:teuthology.orchestra.run.smithi045.stdout: -9845> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5609 cv=5559/5559 REP dir_auth=0 ap=200+201 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5609 2023-10-03T19:20:59.322 INFO:teuthology.orchestra.run.smithi045.stdout: -9844> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d82c260 v5603 2023-10-03T19:20:59.322 INFO:teuthology.orchestra.run.smithi045.stdout: -9843> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5603 cv=5553/5553 ap=201+200 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=25 | child=1 dirty=1 authpin=1 0x55576d056400] version 5603 2023-10-03T19:20:59.322 INFO:teuthology.orchestra.run.smithi045.stdout: -9842> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=200 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=200 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:20:59.322 INFO:teuthology.orchestra.run.smithi045.stdout: -9841> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=200) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5608 pv6006 ap=201 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=201) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=200) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.322 INFO:teuthology.orchestra.run.smithi045.stdout: -9840> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=201) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5608 pv6006 ap=201 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=201) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=199) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.322 INFO:teuthology.orchestra.run.smithi045.stdout: -9839> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000515 [2,head] /dc-dir/dc-file_800 auth v5602 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.896866+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b2680] 2023-10-03T19:20:59.322 INFO:teuthology.orchestra.run.smithi045.stdout: -9838> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000515 [2,head] /dc-dir/dc-file_800 auth v5602 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.896866+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b2680] 2023-10-03T19:20:59.322 INFO:teuthology.orchestra.run.smithi045.stdout: -9837> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:20:59.322 INFO:teuthology.orchestra.run.smithi045.stdout: -9836> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:20:59.323 INFO:teuthology.orchestra.run.smithi045.stdout: -9835> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:20:59.323 INFO:teuthology.orchestra.run.smithi045.stdout: -9834> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000515 [2,head] /dc-dir/dc-file_800 auth v5602 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.896866+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b2680] 2023-10-03T19:20:59.323 INFO:teuthology.orchestra.run.smithi045.stdout: -9833> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000515 [2,head] /dc-dir/dc-file_800 auth v5602 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.896866+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b2680] 2023-10-03T19:20:59.323 INFO:teuthology.orchestra.run.smithi045.stdout: -9832> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:20:59.323 INFO:teuthology.orchestra.run.smithi045.stdout: -9831> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 215.161, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.15e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:433.3] 2023-10-03T19:20:59.323 INFO:teuthology.orchestra.run.smithi045.stdout: -9830> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d52f440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5608 pv6006 ap=200 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=200) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=199) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 200 2023-10-03T19:20:59.323 INFO:teuthology.orchestra.run.smithi045.stdout: -9829> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5609 cv=5559/5559 REP dir_auth=0 ap=200+200 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d52f440 count now 200/200 2023-10-03T19:20:59.323 INFO:teuthology.orchestra.run.smithi045.stdout: -9828> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d52f440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5603 cv=5553/5553 ap=200+200 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=25 | child=1 dirty=1 authpin=1 0x55576d056400] count now 200 2023-10-03T19:20:59.323 INFO:teuthology.orchestra.run.smithi045.stdout: -9827> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d52f440 on [dir 0x1 / [2,head] auth pv=6007 v=5609 cv=5559/5559 REP dir_auth=0 ap=199+200 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 199 2023-10-03T19:20:59.323 INFO:teuthology.orchestra.run.smithi045.stdout: -9826> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000515) auth_unpin by 0x55576d52f440 on [inode 0x10000000515 [2,head] /dc-dir/dc-file_800 auth v5602 s=3 n(v0 rc2023-10-03T19:16:10.896866+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6b2680] now 0 2023-10-03T19:20:59.323 INFO:teuthology.orchestra.run.smithi045.stdout: -9825> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5603 cv=5553/5553 ap=200+199 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=25 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d52f440 count now 200/199 2023-10-03T19:20:59.323 INFO:teuthology.orchestra.run.smithi045.stdout: -9824> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.324 INFO:teuthology.orchestra.run.smithi045.stdout: -9823> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.324 INFO:teuthology.orchestra.run.smithi045.stdout: -9822> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000516 [2,head] /dc-dir/dc-file_801 auth v3966 pv5604 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.908762+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:10.908762+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6b2c00] 2023-10-03T19:20:59.415 INFO:teuthology.orchestra.run.smithi045.stdout: -9821> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5610 2023-10-03T19:20:59.415 INFO:teuthology.orchestra.run.smithi045.stdout: -9820> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5610 pv6006 ap=200 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=200) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=199) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.416 INFO:teuthology.orchestra.run.smithi045.stdout: -9819> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5608 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:20:59.416 INFO:teuthology.orchestra.run.smithi045.stdout: -9818> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5609 cv=5559/5559 REP dir_auth=0 ap=199+200 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5609 2023-10-03T19:20:59.416 INFO:teuthology.orchestra.run.smithi045.stdout: -9817> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000516) pop_and_dirty_projected_inode v5604 2023-10-03T19:20:59.416 INFO:teuthology.orchestra.run.smithi045.stdout: -9816> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000516) mark_dirty [inode 0x10000000516 [2,head] /dc-dir/dc-file_801 auth v5604 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.908762+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6b2c00] 2023-10-03T19:20:59.416 INFO:teuthology.orchestra.run.smithi045.stdout: -9815> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_801) mark_dirty [dentry #0x1/dc-dir/dc-file_801 [2,head] auth (dversion lock) pv=5604 v=3966 ino=0x10000000516 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6af900] 2023-10-03T19:20:59.417 INFO:teuthology.orchestra.run.smithi045.stdout: -9814> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5603 cv=5553/5553 ap=200+199 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=26 | child=1 dirty=1 authpin=1 0x55576d056400] version 5603 2023-10-03T19:20:59.417 INFO:teuthology.orchestra.run.smithi045.stdout: -9813> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d82c140 v5611 2023-10-03T19:20:59.417 INFO:teuthology.orchestra.run.smithi045.stdout: -9812> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5611 cv=5559/5559 REP dir_auth=0 ap=199+200 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5611 2023-10-03T19:20:59.417 INFO:teuthology.orchestra.run.smithi045.stdout: -9811> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d82c020 v5605 2023-10-03T19:20:59.417 INFO:teuthology.orchestra.run.smithi045.stdout: -9810> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5605 cv=5553/5553 ap=200+199 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=26 | child=1 dirty=1 authpin=1 0x55576d056400] version 5605 2023-10-03T19:20:59.417 INFO:teuthology.orchestra.run.smithi045.stdout: -9809> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=199 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=199 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:20:59.418 INFO:teuthology.orchestra.run.smithi045.stdout: -9808> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=199) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5610 pv6006 ap=200 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=200) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=199) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.418 INFO:teuthology.orchestra.run.smithi045.stdout: -9807> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=200) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5610 pv6006 ap=200 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=200) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=198) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.418 INFO:teuthology.orchestra.run.smithi045.stdout: -9806> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000516 [2,head] /dc-dir/dc-file_801 auth v5604 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.908762+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b2c00] 2023-10-03T19:20:59.418 INFO:teuthology.orchestra.run.smithi045.stdout: -9805> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000516 [2,head] /dc-dir/dc-file_801 auth v5604 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.908762+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b2c00] 2023-10-03T19:20:59.418 INFO:teuthology.orchestra.run.smithi045.stdout: -9804> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:20:59.418 INFO:teuthology.orchestra.run.smithi045.stdout: -9803> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:20:59.418 INFO:teuthology.orchestra.run.smithi045.stdout: -9802> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:20:59.418 INFO:teuthology.orchestra.run.smithi045.stdout: -9801> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000516 [2,head] /dc-dir/dc-file_801 auth v5604 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.908762+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b2c00] 2023-10-03T19:20:59.418 INFO:teuthology.orchestra.run.smithi045.stdout: -9800> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000516 [2,head] /dc-dir/dc-file_801 auth v5604 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.908762+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b2c00] 2023-10-03T19:20:59.419 INFO:teuthology.orchestra.run.smithi045.stdout: -9799> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:20:59.419 INFO:teuthology.orchestra.run.smithi045.stdout: -9798> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 216.161, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.16e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:435.3] 2023-10-03T19:20:59.419 INFO:teuthology.orchestra.run.smithi045.stdout: -9797> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d5ca900 on [dir 0x1 / [2,head] auth pv=6007 v=5611 cv=5559/5559 REP dir_auth=0 ap=198+200 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 198 2023-10-03T19:20:59.419 INFO:teuthology.orchestra.run.smithi045.stdout: -9796> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d5ca900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5610 pv6006 ap=199 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=199) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=198) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 199 2023-10-03T19:20:59.419 INFO:teuthology.orchestra.run.smithi045.stdout: -9795> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5611 cv=5559/5559 REP dir_auth=0 ap=198+199 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d5ca900 count now 198/199 2023-10-03T19:20:59.419 INFO:teuthology.orchestra.run.smithi045.stdout: -9794> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d5ca900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5605 cv=5553/5553 ap=199+199 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=26 | child=1 dirty=1 authpin=1 0x55576d056400] count now 199 2023-10-03T19:20:59.419 INFO:teuthology.orchestra.run.smithi045.stdout: -9793> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000516) auth_unpin by 0x55576d5ca900 on [inode 0x10000000516 [2,head] /dc-dir/dc-file_801 auth v5604 s=3 n(v0 rc2023-10-03T19:16:10.908762+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6b2c00] now 0 2023-10-03T19:20:59.419 INFO:teuthology.orchestra.run.smithi045.stdout: -9792> 2023-10-03T19:16:28.766+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5605 cv=5553/5553 ap=199+198 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=26 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d5ca900 count now 199/198 2023-10-03T19:20:59.419 INFO:teuthology.orchestra.run.smithi045.stdout: -9791> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.419 INFO:teuthology.orchestra.run.smithi045.stdout: -9790> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.419 INFO:teuthology.orchestra.run.smithi045.stdout: -9789> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000517 [2,head] /dc-dir/dc-file_802 auth v3970 pv5606 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.920592+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:10.920592+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6b3180] 2023-10-03T19:20:59.419 INFO:teuthology.orchestra.run.smithi045.stdout: -9788> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5612 2023-10-03T19:20:59.420 INFO:teuthology.orchestra.run.smithi045.stdout: -9787> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5612 pv6006 ap=199 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=199) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=198) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.420 INFO:teuthology.orchestra.run.smithi045.stdout: -9786> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5610 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:20:59.420 INFO:teuthology.orchestra.run.smithi045.stdout: -9785> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5611 cv=5559/5559 REP dir_auth=0 ap=198+199 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5611 2023-10-03T19:20:59.420 INFO:teuthology.orchestra.run.smithi045.stdout: -9784> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000517) pop_and_dirty_projected_inode v5606 2023-10-03T19:20:59.420 INFO:teuthology.orchestra.run.smithi045.stdout: -9783> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000517) mark_dirty [inode 0x10000000517 [2,head] /dc-dir/dc-file_802 auth v5606 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.920592+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6b3180] 2023-10-03T19:20:59.420 INFO:teuthology.orchestra.run.smithi045.stdout: -9782> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_802) mark_dirty [dentry #0x1/dc-dir/dc-file_802 [2,head] auth (dversion lock) pv=5606 v=3970 ino=0x10000000517 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6afb80] 2023-10-03T19:20:59.420 INFO:teuthology.orchestra.run.smithi045.stdout: -9781> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5605 cv=5553/5553 ap=199+198 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=27 | child=1 dirty=1 authpin=1 0x55576d056400] version 5605 2023-10-03T19:20:59.420 INFO:teuthology.orchestra.run.smithi045.stdout: -9780> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d7f9e80 v5613 2023-10-03T19:20:59.420 INFO:teuthology.orchestra.run.smithi045.stdout: -9779> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5613 cv=5559/5559 REP dir_auth=0 ap=198+199 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5613 2023-10-03T19:20:59.420 INFO:teuthology.orchestra.run.smithi045.stdout: -9778> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d7f9d60 v5607 2023-10-03T19:20:59.421 INFO:teuthology.orchestra.run.smithi045.stdout: -9777> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5607 cv=5553/5553 ap=199+198 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=27 | child=1 dirty=1 authpin=1 0x55576d056400] version 5607 2023-10-03T19:20:59.421 INFO:teuthology.orchestra.run.smithi045.stdout: -9776> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=198 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=198 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:20:59.421 INFO:teuthology.orchestra.run.smithi045.stdout: -9775> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=198) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5612 pv6006 ap=199 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=199) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=198) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.421 INFO:teuthology.orchestra.run.smithi045.stdout: -9774> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=199) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5612 pv6006 ap=199 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=199) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=197) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.421 INFO:teuthology.orchestra.run.smithi045.stdout: -9773> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000517 [2,head] /dc-dir/dc-file_802 auth v5606 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.920592+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b3180] 2023-10-03T19:20:59.428 INFO:teuthology.orchestra.run.smithi045.stdout: -9772> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000517 [2,head] /dc-dir/dc-file_802 auth v5606 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.920592+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b3180] 2023-10-03T19:20:59.428 INFO:teuthology.orchestra.run.smithi045.stdout: -9771> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:20:59.428 INFO:teuthology.orchestra.run.smithi045.stdout: -9770> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:20:59.428 INFO:teuthology.orchestra.run.smithi045.stdout: -9769> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:20:59.428 INFO:teuthology.orchestra.run.smithi045.stdout: -9768> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000517 [2,head] /dc-dir/dc-file_802 auth v5606 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.920592+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b3180] 2023-10-03T19:20:59.428 INFO:teuthology.orchestra.run.smithi045.stdout: -9767> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000517 [2,head] /dc-dir/dc-file_802 auth v5606 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.920592+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b3180] 2023-10-03T19:20:59.429 INFO:teuthology.orchestra.run.smithi045.stdout: -9766> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:20:59.429 INFO:teuthology.orchestra.run.smithi045.stdout: -9765> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 217.041, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.17e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:437.1] 2023-10-03T19:20:59.429 INFO:teuthology.orchestra.run.smithi045.stdout: -9764> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d828000 on [dir 0x1 / [2,head] auth pv=6007 v=5613 cv=5559/5559 REP dir_auth=0 ap=197+199 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 197 2023-10-03T19:20:59.429 INFO:teuthology.orchestra.run.smithi045.stdout: -9763> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d828000 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5612 pv6006 ap=198 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=198) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=197) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 198 2023-10-03T19:20:59.429 INFO:teuthology.orchestra.run.smithi045.stdout: -9762> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5613 cv=5559/5559 REP dir_auth=0 ap=197+198 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d828000 count now 197/198 2023-10-03T19:20:59.429 INFO:teuthology.orchestra.run.smithi045.stdout: -9761> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d828000 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5607 cv=5553/5553 ap=198+198 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=27 | child=1 dirty=1 authpin=1 0x55576d056400] count now 198 2023-10-03T19:20:59.429 INFO:teuthology.orchestra.run.smithi045.stdout: -9760> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000517) auth_unpin by 0x55576d828000 on [inode 0x10000000517 [2,head] /dc-dir/dc-file_802 auth v5606 s=3 n(v0 rc2023-10-03T19:16:10.920592+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6b3180] now 0 2023-10-03T19:20:59.429 INFO:teuthology.orchestra.run.smithi045.stdout: -9759> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5607 cv=5553/5553 ap=198+197 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=27 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d828000 count now 198/197 2023-10-03T19:20:59.429 INFO:teuthology.orchestra.run.smithi045.stdout: -9758> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.429 INFO:teuthology.orchestra.run.smithi045.stdout: -9757> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.430 INFO:teuthology.orchestra.run.smithi045.stdout: -9756> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000518 [2,head] /dc-dir/dc-file_803 auth v3974 pv5608 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.932559+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:10.932559+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6b3700] 2023-10-03T19:20:59.430 INFO:teuthology.orchestra.run.smithi045.stdout: -9755> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5614 2023-10-03T19:20:59.430 INFO:teuthology.orchestra.run.smithi045.stdout: -9754> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5614 pv6006 ap=198 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=198) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=197) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.430 INFO:teuthology.orchestra.run.smithi045.stdout: -9753> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5612 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:20:59.430 INFO:teuthology.orchestra.run.smithi045.stdout: -9752> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5613 cv=5559/5559 REP dir_auth=0 ap=197+198 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5613 2023-10-03T19:20:59.430 INFO:teuthology.orchestra.run.smithi045.stdout: -9751> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000518) pop_and_dirty_projected_inode v5608 2023-10-03T19:20:59.430 INFO:teuthology.orchestra.run.smithi045.stdout: -9750> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000518) mark_dirty [inode 0x10000000518 [2,head] /dc-dir/dc-file_803 auth v5608 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.932559+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6b3700] 2023-10-03T19:20:59.430 INFO:teuthology.orchestra.run.smithi045.stdout: -9749> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_803) mark_dirty [dentry #0x1/dc-dir/dc-file_803 [2,head] auth (dversion lock) pv=5608 v=3974 ino=0x10000000518 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6b8000] 2023-10-03T19:20:59.430 INFO:teuthology.orchestra.run.smithi045.stdout: -9748> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5607 cv=5553/5553 ap=198+197 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=28 | child=1 dirty=1 authpin=1 0x55576d056400] version 5607 2023-10-03T19:20:59.431 INFO:teuthology.orchestra.run.smithi045.stdout: -9747> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d7f9c40 v5615 2023-10-03T19:20:59.431 INFO:teuthology.orchestra.run.smithi045.stdout: -9746> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5615 cv=5559/5559 REP dir_auth=0 ap=197+198 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5615 2023-10-03T19:20:59.431 INFO:teuthology.orchestra.run.smithi045.stdout: -9745> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d7f9b20 v5609 2023-10-03T19:20:59.431 INFO:teuthology.orchestra.run.smithi045.stdout: -9744> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5609 cv=5553/5553 ap=198+197 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=28 | child=1 dirty=1 authpin=1 0x55576d056400] version 5609 2023-10-03T19:20:59.431 INFO:teuthology.orchestra.run.smithi045.stdout: -9743> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=197 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=197 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:20:59.431 INFO:teuthology.orchestra.run.smithi045.stdout: -9742> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=197) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5614 pv6006 ap=198 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=198) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=197) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.431 INFO:teuthology.orchestra.run.smithi045.stdout: -9741> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=198) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5614 pv6006 ap=198 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=198) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=196) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.431 INFO:teuthology.orchestra.run.smithi045.stdout: -9740> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000518 [2,head] /dc-dir/dc-file_803 auth v5608 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.932559+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b3700] 2023-10-03T19:20:59.431 INFO:teuthology.orchestra.run.smithi045.stdout: -9739> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000518 [2,head] /dc-dir/dc-file_803 auth v5608 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.932559+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b3700] 2023-10-03T19:20:59.431 INFO:teuthology.orchestra.run.smithi045.stdout: -9738> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:20:59.431 INFO:teuthology.orchestra.run.smithi045.stdout: -9737> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:20:59.431 INFO:teuthology.orchestra.run.smithi045.stdout: -9736> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:20:59.432 INFO:teuthology.orchestra.run.smithi045.stdout: -9735> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000518 [2,head] /dc-dir/dc-file_803 auth v5608 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.932559+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b3700] 2023-10-03T19:20:59.432 INFO:teuthology.orchestra.run.smithi045.stdout: -9734> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000518 [2,head] /dc-dir/dc-file_803 auth v5608 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.932559+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6b3700] 2023-10-03T19:20:59.432 INFO:teuthology.orchestra.run.smithi045.stdout: -9733> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:20:59.432 INFO:teuthology.orchestra.run.smithi045.stdout: -9732> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 218.041, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.18e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:439.1] 2023-10-03T19:20:59.432 INFO:teuthology.orchestra.run.smithi045.stdout: -9731> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d547200 on [dir 0x1 / [2,head] auth pv=6007 v=5615 cv=5559/5559 REP dir_auth=0 ap=196+198 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 196 2023-10-03T19:20:59.432 INFO:teuthology.orchestra.run.smithi045.stdout: -9730> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d547200 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5614 pv6006 ap=197 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=197) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=196) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 197 2023-10-03T19:20:59.432 INFO:teuthology.orchestra.run.smithi045.stdout: -9729> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5615 cv=5559/5559 REP dir_auth=0 ap=196+197 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d547200 count now 196/197 2023-10-03T19:20:59.453 INFO:teuthology.orchestra.run.smithi045.stdout: -9728> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d547200 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5609 cv=5553/5553 ap=197+197 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=28 | child=1 dirty=1 authpin=1 0x55576d056400] count now 197 2023-10-03T19:20:59.453 INFO:teuthology.orchestra.run.smithi045.stdout: -9727> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000518) auth_unpin by 0x55576d547200 on [inode 0x10000000518 [2,head] /dc-dir/dc-file_803 auth v5608 s=3 n(v0 rc2023-10-03T19:16:10.932559+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6b3700] now 0 2023-10-03T19:20:59.453 INFO:teuthology.orchestra.run.smithi045.stdout: -9726> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5609 cv=5553/5553 ap=197+196 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=28 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d547200 count now 197/196 2023-10-03T19:20:59.453 INFO:teuthology.orchestra.run.smithi045.stdout: -9725> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.453 INFO:teuthology.orchestra.run.smithi045.stdout: -9724> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.453 INFO:teuthology.orchestra.run.smithi045.stdout: -9723> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000519 [2,head] /dc-dir/dc-file_804 auth v3978 pv5610 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.944266+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:10.944266+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6bc000] 2023-10-03T19:20:59.453 INFO:teuthology.orchestra.run.smithi045.stdout: -9722> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5616 2023-10-03T19:20:59.453 INFO:teuthology.orchestra.run.smithi045.stdout: -9721> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5616 pv6006 ap=197 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=197) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=196) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.453 INFO:teuthology.orchestra.run.smithi045.stdout: -9720> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5614 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:20:59.454 INFO:teuthology.orchestra.run.smithi045.stdout: -9719> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5615 cv=5559/5559 REP dir_auth=0 ap=196+197 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5615 2023-10-03T19:20:59.454 INFO:teuthology.orchestra.run.smithi045.stdout: -9718> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000519) pop_and_dirty_projected_inode v5610 2023-10-03T19:20:59.454 INFO:teuthology.orchestra.run.smithi045.stdout: -9717> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000519) mark_dirty [inode 0x10000000519 [2,head] /dc-dir/dc-file_804 auth v5610 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.944266+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6bc000] 2023-10-03T19:20:59.454 INFO:teuthology.orchestra.run.smithi045.stdout: -9716> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_804) mark_dirty [dentry #0x1/dc-dir/dc-file_804 [2,head] auth (dversion lock) pv=5610 v=3978 ino=0x10000000519 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6b8280] 2023-10-03T19:20:59.454 INFO:teuthology.orchestra.run.smithi045.stdout: -9715> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5609 cv=5553/5553 ap=197+196 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=29 | child=1 dirty=1 authpin=1 0x55576d056400] version 5609 2023-10-03T19:20:59.454 INFO:teuthology.orchestra.run.smithi045.stdout: -9714> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d7f9a00 v5617 2023-10-03T19:20:59.454 INFO:teuthology.orchestra.run.smithi045.stdout: -9713> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5617 cv=5559/5559 REP dir_auth=0 ap=196+197 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5617 2023-10-03T19:20:59.454 INFO:teuthology.orchestra.run.smithi045.stdout: -9712> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d7f98e0 v5611 2023-10-03T19:20:59.454 INFO:teuthology.orchestra.run.smithi045.stdout: -9711> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5611 cv=5553/5553 ap=197+196 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=29 | child=1 dirty=1 authpin=1 0x55576d056400] version 5611 2023-10-03T19:20:59.454 INFO:teuthology.orchestra.run.smithi045.stdout: -9710> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=196 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=196 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:20:59.455 INFO:teuthology.orchestra.run.smithi045.stdout: -9709> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=196) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5616 pv6006 ap=197 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=197) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=196) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.455 INFO:teuthology.orchestra.run.smithi045.stdout: -9708> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=197) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5616 pv6006 ap=197 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=197) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=195) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.455 INFO:teuthology.orchestra.run.smithi045.stdout: -9707> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000519 [2,head] /dc-dir/dc-file_804 auth v5610 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.944266+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bc000] 2023-10-03T19:20:59.455 INFO:teuthology.orchestra.run.smithi045.stdout: -9706> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000519 [2,head] /dc-dir/dc-file_804 auth v5610 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.944266+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bc000] 2023-10-03T19:20:59.455 INFO:teuthology.orchestra.run.smithi045.stdout: -9705> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:20:59.455 INFO:teuthology.orchestra.run.smithi045.stdout: -9704> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:20:59.455 INFO:teuthology.orchestra.run.smithi045.stdout: -9703> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:20:59.455 INFO:teuthology.orchestra.run.smithi045.stdout: -9702> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000519 [2,head] /dc-dir/dc-file_804 auth v5610 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.944266+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bc000] 2023-10-03T19:20:59.455 INFO:teuthology.orchestra.run.smithi045.stdout: -9701> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000519 [2,head] /dc-dir/dc-file_804 auth v5610 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.944266+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bc000] 2023-10-03T19:20:59.455 INFO:teuthology.orchestra.run.smithi045.stdout: -9700> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:20:59.455 INFO:teuthology.orchestra.run.smithi045.stdout: -9699> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 219.041, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.19e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:441.1] 2023-10-03T19:20:59.455 INFO:teuthology.orchestra.run.smithi045.stdout: -9698> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d3dc000 on [dir 0x1 / [2,head] auth pv=6007 v=5617 cv=5559/5559 REP dir_auth=0 ap=195+197 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 195 2023-10-03T19:20:59.456 INFO:teuthology.orchestra.run.smithi045.stdout: -9697> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d3dc000 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5616 pv6006 ap=196 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=196) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=195) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 196 2023-10-03T19:20:59.456 INFO:teuthology.orchestra.run.smithi045.stdout: -9696> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5617 cv=5559/5559 REP dir_auth=0 ap=195+196 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d3dc000 count now 195/196 2023-10-03T19:20:59.456 INFO:teuthology.orchestra.run.smithi045.stdout: -9695> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d3dc000 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5611 cv=5553/5553 ap=196+196 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=29 | child=1 dirty=1 authpin=1 0x55576d056400] count now 196 2023-10-03T19:20:59.456 INFO:teuthology.orchestra.run.smithi045.stdout: -9694> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000519) auth_unpin by 0x55576d3dc000 on [inode 0x10000000519 [2,head] /dc-dir/dc-file_804 auth v5610 s=3 n(v0 rc2023-10-03T19:16:10.944266+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6bc000] now 0 2023-10-03T19:20:59.456 INFO:teuthology.orchestra.run.smithi045.stdout: -9693> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5611 cv=5553/5553 ap=196+195 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=29 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d3dc000 count now 196/195 2023-10-03T19:20:59.456 INFO:teuthology.orchestra.run.smithi045.stdout: -9692> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.456 INFO:teuthology.orchestra.run.smithi045.stdout: -9691> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.456 INFO:teuthology.orchestra.run.smithi045.stdout: -9690> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000051a [2,head] /dc-dir/dc-file_805 auth v3982 pv5612 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.956944+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:10.956944+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6bc580] 2023-10-03T19:20:59.456 INFO:teuthology.orchestra.run.smithi045.stdout: -9689> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5618 2023-10-03T19:20:59.456 INFO:teuthology.orchestra.run.smithi045.stdout: -9688> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5618 pv6006 ap=196 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=196) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=195) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.457 INFO:teuthology.orchestra.run.smithi045.stdout: -9687> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5616 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:20:59.457 INFO:teuthology.orchestra.run.smithi045.stdout: -9686> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5617 cv=5559/5559 REP dir_auth=0 ap=195+196 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5617 2023-10-03T19:20:59.457 INFO:teuthology.orchestra.run.smithi045.stdout: -9685> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000051a) pop_and_dirty_projected_inode v5612 2023-10-03T19:20:59.457 INFO:teuthology.orchestra.run.smithi045.stdout: -9684> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000051a) mark_dirty [inode 0x1000000051a [2,head] /dc-dir/dc-file_805 auth v5612 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.956944+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6bc580] 2023-10-03T19:20:59.457 INFO:teuthology.orchestra.run.smithi045.stdout: -9683> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_805) mark_dirty [dentry #0x1/dc-dir/dc-file_805 [2,head] auth (dversion lock) pv=5612 v=3982 ino=0x1000000051a state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6b8500] 2023-10-03T19:20:59.457 INFO:teuthology.orchestra.run.smithi045.stdout: -9682> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5611 cv=5553/5553 ap=196+195 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=30 | child=1 dirty=1 authpin=1 0x55576d056400] version 5611 2023-10-03T19:20:59.457 INFO:teuthology.orchestra.run.smithi045.stdout: -9681> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d7f97c0 v5619 2023-10-03T19:20:59.457 INFO:teuthology.orchestra.run.smithi045.stdout: -9680> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5619 cv=5559/5559 REP dir_auth=0 ap=195+196 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5619 2023-10-03T19:20:59.457 INFO:teuthology.orchestra.run.smithi045.stdout: -9679> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d7f96a0 v5613 2023-10-03T19:20:59.457 INFO:teuthology.orchestra.run.smithi045.stdout: -9678> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5613 cv=5553/5553 ap=196+195 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=30 | child=1 dirty=1 authpin=1 0x55576d056400] version 5613 2023-10-03T19:20:59.478 INFO:teuthology.orchestra.run.smithi045.stdout: -9677> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=195 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=195 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:20:59.478 INFO:teuthology.orchestra.run.smithi045.stdout: -9676> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=195) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5618 pv6006 ap=196 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=196) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=195) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.478 INFO:teuthology.orchestra.run.smithi045.stdout: -9675> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=196) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5618 pv6006 ap=196 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=196) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=194) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.478 INFO:teuthology.orchestra.run.smithi045.stdout: -9674> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000051a [2,head] /dc-dir/dc-file_805 auth v5612 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.956944+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bc580] 2023-10-03T19:20:59.478 INFO:teuthology.orchestra.run.smithi045.stdout: -9673> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000051a [2,head] /dc-dir/dc-file_805 auth v5612 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.956944+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bc580] 2023-10-03T19:20:59.478 INFO:teuthology.orchestra.run.smithi045.stdout: -9672> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:20:59.478 INFO:teuthology.orchestra.run.smithi045.stdout: -9671> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:20:59.478 INFO:teuthology.orchestra.run.smithi045.stdout: -9670> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:20:59.479 INFO:teuthology.orchestra.run.smithi045.stdout: -9669> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000051a [2,head] /dc-dir/dc-file_805 auth v5612 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.956944+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bc580] 2023-10-03T19:20:59.479 INFO:teuthology.orchestra.run.smithi045.stdout: -9668> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000051a [2,head] /dc-dir/dc-file_805 auth v5612 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.956944+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bc580] 2023-10-03T19:20:59.479 INFO:teuthology.orchestra.run.smithi045.stdout: -9667> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:20:59.479 INFO:teuthology.orchestra.run.smithi045.stdout: -9666> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 220.041, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.20e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:443.1] 2023-10-03T19:20:59.479 INFO:teuthology.orchestra.run.smithi045.stdout: -9665> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d5cafc0 on [dir 0x1 / [2,head] auth pv=6007 v=5619 cv=5559/5559 REP dir_auth=0 ap=194+196 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 194 2023-10-03T19:20:59.480 INFO:teuthology.orchestra.run.smithi045.stdout: -9664> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d5cafc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5613 cv=5553/5553 ap=195+195 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=30 | child=1 dirty=1 authpin=1 0x55576d056400] count now 195 2023-10-03T19:20:59.480 INFO:teuthology.orchestra.run.smithi045.stdout: -9663> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d5cafc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5618 pv6006 ap=195 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=195) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=194) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 195 2023-10-03T19:20:59.480 INFO:teuthology.orchestra.run.smithi045.stdout: -9662> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5619 cv=5559/5559 REP dir_auth=0 ap=194+195 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d5cafc0 count now 194/195 2023-10-03T19:20:59.480 INFO:teuthology.orchestra.run.smithi045.stdout: -9661> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000051a) auth_unpin by 0x55576d5cafc0 on [inode 0x1000000051a [2,head] /dc-dir/dc-file_805 auth v5612 s=3 n(v0 rc2023-10-03T19:16:10.956944+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6bc580] now 0 2023-10-03T19:20:59.480 INFO:teuthology.orchestra.run.smithi045.stdout: -9660> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5613 cv=5553/5553 ap=195+194 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=30 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d5cafc0 count now 195/194 2023-10-03T19:20:59.480 INFO:teuthology.orchestra.run.smithi045.stdout: -9659> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.480 INFO:teuthology.orchestra.run.smithi045.stdout: -9658> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.480 INFO:teuthology.orchestra.run.smithi045.stdout: -9657> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000051b [2,head] /dc-dir/dc-file_806 auth v3986 pv5614 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.968941+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:10.968941+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6bcb00] 2023-10-03T19:20:59.480 INFO:teuthology.orchestra.run.smithi045.stdout: -9656> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5620 2023-10-03T19:20:59.480 INFO:teuthology.orchestra.run.smithi045.stdout: -9655> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5620 pv6006 ap=195 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=195) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=194) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.481 INFO:teuthology.orchestra.run.smithi045.stdout: -9654> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5618 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:20:59.481 INFO:teuthology.orchestra.run.smithi045.stdout: -9653> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5619 cv=5559/5559 REP dir_auth=0 ap=194+195 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5619 2023-10-03T19:20:59.481 INFO:teuthology.orchestra.run.smithi045.stdout: -9652> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000051b) pop_and_dirty_projected_inode v5614 2023-10-03T19:20:59.481 INFO:teuthology.orchestra.run.smithi045.stdout: -9651> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000051b) mark_dirty [inode 0x1000000051b [2,head] /dc-dir/dc-file_806 auth v5614 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.968941+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6bcb00] 2023-10-03T19:20:59.481 INFO:teuthology.orchestra.run.smithi045.stdout: -9650> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_806) mark_dirty [dentry #0x1/dc-dir/dc-file_806 [2,head] auth (dversion lock) pv=5614 v=3986 ino=0x1000000051b state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6b8780] 2023-10-03T19:20:59.481 INFO:teuthology.orchestra.run.smithi045.stdout: -9649> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5613 cv=5553/5553 ap=195+194 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=31 | child=1 dirty=1 authpin=1 0x55576d056400] version 5613 2023-10-03T19:20:59.481 INFO:teuthology.orchestra.run.smithi045.stdout: -9648> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d7f9580 v5621 2023-10-03T19:20:59.481 INFO:teuthology.orchestra.run.smithi045.stdout: -9647> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5621 cv=5559/5559 REP dir_auth=0 ap=194+195 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5621 2023-10-03T19:20:59.481 INFO:teuthology.orchestra.run.smithi045.stdout: -9646> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d7f9460 v5615 2023-10-03T19:20:59.482 INFO:teuthology.orchestra.run.smithi045.stdout: -9645> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5615 cv=5553/5553 ap=195+194 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=31 | child=1 dirty=1 authpin=1 0x55576d056400] version 5615 2023-10-03T19:20:59.482 INFO:teuthology.orchestra.run.smithi045.stdout: -9644> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=194 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=194 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:20:59.482 INFO:teuthology.orchestra.run.smithi045.stdout: -9643> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=194) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5620 pv6006 ap=195 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=195) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=194) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.482 INFO:teuthology.orchestra.run.smithi045.stdout: -9642> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=195) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5620 pv6006 ap=195 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=195) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=193) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.482 INFO:teuthology.orchestra.run.smithi045.stdout: -9641> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000051b [2,head] /dc-dir/dc-file_806 auth v5614 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.968941+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bcb00] 2023-10-03T19:20:59.482 INFO:teuthology.orchestra.run.smithi045.stdout: -9640> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000051b [2,head] /dc-dir/dc-file_806 auth v5614 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.968941+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bcb00] 2023-10-03T19:20:59.482 INFO:teuthology.orchestra.run.smithi045.stdout: -9639> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:20:59.482 INFO:teuthology.orchestra.run.smithi045.stdout: -9638> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:20:59.482 INFO:teuthology.orchestra.run.smithi045.stdout: -9637> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:20:59.483 INFO:teuthology.orchestra.run.smithi045.stdout: -9636> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000051b [2,head] /dc-dir/dc-file_806 auth v5614 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.968941+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bcb00] 2023-10-03T19:20:59.483 INFO:teuthology.orchestra.run.smithi045.stdout: -9635> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000051b [2,head] /dc-dir/dc-file_806 auth v5614 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.968941+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bcb00] 2023-10-03T19:20:59.483 INFO:teuthology.orchestra.run.smithi045.stdout: -9634> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:20:59.483 INFO:teuthology.orchestra.run.smithi045.stdout: -9633> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 221.041, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.21e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:445.1] 2023-10-03T19:20:59.483 INFO:teuthology.orchestra.run.smithi045.stdout: -9632> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d808000 on [dir 0x1 / [2,head] auth pv=6007 v=5621 cv=5559/5559 REP dir_auth=0 ap=193+195 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 193 2023-10-03T19:20:59.483 INFO:teuthology.orchestra.run.smithi045.stdout: -9631> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d808000 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5620 pv6006 ap=194 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=194) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=193) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 194 2023-10-03T19:20:59.483 INFO:teuthology.orchestra.run.smithi045.stdout: -9630> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5621 cv=5559/5559 REP dir_auth=0 ap=193+194 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d808000 count now 193/194 2023-10-03T19:20:59.483 INFO:teuthology.orchestra.run.smithi045.stdout: -9629> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d808000 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5615 cv=5553/5553 ap=194+194 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=31 | child=1 dirty=1 authpin=1 0x55576d056400] count now 194 2023-10-03T19:20:59.483 INFO:teuthology.orchestra.run.smithi045.stdout: -9628> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000051b) auth_unpin by 0x55576d808000 on [inode 0x1000000051b [2,head] /dc-dir/dc-file_806 auth v5614 s=3 n(v0 rc2023-10-03T19:16:10.968941+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6bcb00] now 0 2023-10-03T19:20:59.483 INFO:teuthology.orchestra.run.smithi045.stdout: -9627> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5615 cv=5553/5553 ap=194+193 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=31 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d808000 count now 194/193 2023-10-03T19:20:59.483 INFO:teuthology.orchestra.run.smithi045.stdout: -9626> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.483 INFO:teuthology.orchestra.run.smithi045.stdout: -9625> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.484 INFO:teuthology.orchestra.run.smithi045.stdout: -9624> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000051c [2,head] /dc-dir/dc-file_807 auth v3990 pv5616 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.981450+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:10.981450+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6bd080] 2023-10-03T19:20:59.573 INFO:teuthology.orchestra.run.smithi045.stdout: -9623> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5622 2023-10-03T19:20:59.573 INFO:teuthology.orchestra.run.smithi045.stdout: -9622> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5622 pv6006 ap=194 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=194) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=193) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.573 INFO:teuthology.orchestra.run.smithi045.stdout: -9621> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5620 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:20:59.574 INFO:teuthology.orchestra.run.smithi045.stdout: -9620> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5621 cv=5559/5559 REP dir_auth=0 ap=193+194 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5621 2023-10-03T19:20:59.574 INFO:teuthology.orchestra.run.smithi045.stdout: -9619> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000051c) pop_and_dirty_projected_inode v5616 2023-10-03T19:20:59.574 INFO:teuthology.orchestra.run.smithi045.stdout: -9618> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000051c) mark_dirty [inode 0x1000000051c [2,head] /dc-dir/dc-file_807 auth v5616 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.981450+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6bd080] 2023-10-03T19:20:59.574 INFO:teuthology.orchestra.run.smithi045.stdout: -9617> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_807) mark_dirty [dentry #0x1/dc-dir/dc-file_807 [2,head] auth (dversion lock) pv=5616 v=3990 ino=0x1000000051c state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6b8a00] 2023-10-03T19:20:59.574 INFO:teuthology.orchestra.run.smithi045.stdout: -9616> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5615 cv=5553/5553 ap=194+193 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=32 | child=1 dirty=1 authpin=1 0x55576d056400] version 5615 2023-10-03T19:20:59.574 INFO:teuthology.orchestra.run.smithi045.stdout: -9615> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d7f9340 v5623 2023-10-03T19:20:59.574 INFO:teuthology.orchestra.run.smithi045.stdout: -9614> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5623 cv=5559/5559 REP dir_auth=0 ap=193+194 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5623 2023-10-03T19:20:59.574 INFO:teuthology.orchestra.run.smithi045.stdout: -9613> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d7f9220 v5617 2023-10-03T19:20:59.575 INFO:teuthology.orchestra.run.smithi045.stdout: -9612> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5617 cv=5553/5553 ap=194+193 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=32 | child=1 dirty=1 authpin=1 0x55576d056400] version 5617 2023-10-03T19:20:59.575 INFO:teuthology.orchestra.run.smithi045.stdout: -9611> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=193 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=193 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:20:59.575 INFO:teuthology.orchestra.run.smithi045.stdout: -9610> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=193) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5622 pv6006 ap=194 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=194) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=193) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.575 INFO:teuthology.orchestra.run.smithi045.stdout: -9609> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=194) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5622 pv6006 ap=194 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=194) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=192) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.575 INFO:teuthology.orchestra.run.smithi045.stdout: -9608> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000051c [2,head] /dc-dir/dc-file_807 auth v5616 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.981450+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bd080] 2023-10-03T19:20:59.575 INFO:teuthology.orchestra.run.smithi045.stdout: -9607> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000051c [2,head] /dc-dir/dc-file_807 auth v5616 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.981450+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bd080] 2023-10-03T19:20:59.576 INFO:teuthology.orchestra.run.smithi045.stdout: -9606> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:20:59.576 INFO:teuthology.orchestra.run.smithi045.stdout: -9605> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:20:59.576 INFO:teuthology.orchestra.run.smithi045.stdout: -9604> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:20:59.576 INFO:teuthology.orchestra.run.smithi045.stdout: -9603> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000051c [2,head] /dc-dir/dc-file_807 auth v5616 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.981450+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bd080] 2023-10-03T19:20:59.576 INFO:teuthology.orchestra.run.smithi045.stdout: -9602> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000051c [2,head] /dc-dir/dc-file_807 auth v5616 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.981450+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bd080] 2023-10-03T19:20:59.576 INFO:teuthology.orchestra.run.smithi045.stdout: -9601> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:20:59.576 INFO:teuthology.orchestra.run.smithi045.stdout: -9600> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 222.041, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.22e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:447.1] 2023-10-03T19:20:59.577 INFO:teuthology.orchestra.run.smithi045.stdout: -9599> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d809200 on [dir 0x1 / [2,head] auth pv=6007 v=5623 cv=5559/5559 REP dir_auth=0 ap=192+194 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 192 2023-10-03T19:20:59.577 INFO:teuthology.orchestra.run.smithi045.stdout: -9598> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d809200 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5622 pv6006 ap=193 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=193) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=192) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 193 2023-10-03T19:20:59.577 INFO:teuthology.orchestra.run.smithi045.stdout: -9597> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5623 cv=5559/5559 REP dir_auth=0 ap=192+193 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d809200 count now 192/193 2023-10-03T19:20:59.577 INFO:teuthology.orchestra.run.smithi045.stdout: -9596> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d809200 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5617 cv=5553/5553 ap=193+193 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=32 | child=1 dirty=1 authpin=1 0x55576d056400] count now 193 2023-10-03T19:20:59.577 INFO:teuthology.orchestra.run.smithi045.stdout: -9595> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000051c) auth_unpin by 0x55576d809200 on [inode 0x1000000051c [2,head] /dc-dir/dc-file_807 auth v5616 s=3 n(v0 rc2023-10-03T19:16:10.981450+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6bd080] now 0 2023-10-03T19:20:59.577 INFO:teuthology.orchestra.run.smithi045.stdout: -9594> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5617 cv=5553/5553 ap=193+192 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=32 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d809200 count now 193/192 2023-10-03T19:20:59.577 INFO:teuthology.orchestra.run.smithi045.stdout: -9593> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.577 INFO:teuthology.orchestra.run.smithi045.stdout: -9592> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.577 INFO:teuthology.orchestra.run.smithi045.stdout: -9591> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000051d [2,head] /dc-dir/dc-file_808 auth v3994 pv5618 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.994441+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:10.994441+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6bd600] 2023-10-03T19:20:59.578 INFO:teuthology.orchestra.run.smithi045.stdout: -9590> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5624 2023-10-03T19:20:59.578 INFO:teuthology.orchestra.run.smithi045.stdout: -9589> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5624 pv6006 ap=193 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=193) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=192) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.578 INFO:teuthology.orchestra.run.smithi045.stdout: -9588> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5622 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:20:59.578 INFO:teuthology.orchestra.run.smithi045.stdout: -9587> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5623 cv=5559/5559 REP dir_auth=0 ap=192+193 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5623 2023-10-03T19:20:59.578 INFO:teuthology.orchestra.run.smithi045.stdout: -9586> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000051d) pop_and_dirty_projected_inode v5618 2023-10-03T19:20:59.578 INFO:teuthology.orchestra.run.smithi045.stdout: -9585> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000051d) mark_dirty [inode 0x1000000051d [2,head] /dc-dir/dc-file_808 auth v5618 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.994441+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6bd600] 2023-10-03T19:20:59.578 INFO:teuthology.orchestra.run.smithi045.stdout: -9584> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_808) mark_dirty [dentry #0x1/dc-dir/dc-file_808 [2,head] auth (dversion lock) pv=5618 v=3994 ino=0x1000000051d state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6b8c80] 2023-10-03T19:20:59.579 INFO:teuthology.orchestra.run.smithi045.stdout: -9583> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5617 cv=5553/5553 ap=193+192 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=33 | child=1 dirty=1 authpin=1 0x55576d056400] version 5617 2023-10-03T19:20:59.579 INFO:teuthology.orchestra.run.smithi045.stdout: -9582> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d7f9100 v5625 2023-10-03T19:20:59.579 INFO:teuthology.orchestra.run.smithi045.stdout: -9581> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5625 cv=5559/5559 REP dir_auth=0 ap=192+193 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5625 2023-10-03T19:20:59.579 INFO:teuthology.orchestra.run.smithi045.stdout: -9580> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d7f8fe0 v5619 2023-10-03T19:20:59.579 INFO:teuthology.orchestra.run.smithi045.stdout: -9579> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5619 cv=5553/5553 ap=193+192 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=33 | child=1 dirty=1 authpin=1 0x55576d056400] version 5619 2023-10-03T19:20:59.579 INFO:teuthology.orchestra.run.smithi045.stdout: -9578> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=192 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=192 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:20:59.579 INFO:teuthology.orchestra.run.smithi045.stdout: -9577> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=192) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5624 pv6006 ap=193 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=193) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=192) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.579 INFO:teuthology.orchestra.run.smithi045.stdout: -9576> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=193) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5624 pv6006 ap=193 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=193) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=191) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.580 INFO:teuthology.orchestra.run.smithi045.stdout: -9575> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000051d [2,head] /dc-dir/dc-file_808 auth v5618 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.994441+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bd600] 2023-10-03T19:20:59.580 INFO:teuthology.orchestra.run.smithi045.stdout: -9574> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000051d [2,head] /dc-dir/dc-file_808 auth v5618 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.994441+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bd600] 2023-10-03T19:20:59.582 INFO:teuthology.orchestra.run.smithi045.stdout: -9573> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:20:59.582 INFO:teuthology.orchestra.run.smithi045.stdout: -9572> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:20:59.583 INFO:teuthology.orchestra.run.smithi045.stdout: -9571> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:20:59.583 INFO:teuthology.orchestra.run.smithi045.stdout: -9570> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000051d [2,head] /dc-dir/dc-file_808 auth v5618 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.994441+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bd600] 2023-10-03T19:20:59.583 INFO:teuthology.orchestra.run.smithi045.stdout: -9569> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000051d [2,head] /dc-dir/dc-file_808 auth v5618 ap=1 s=3 n(v0 rc2023-10-03T19:16:10.994441+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bd600] 2023-10-03T19:20:59.583 INFO:teuthology.orchestra.run.smithi045.stdout: -9568> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:20:59.583 INFO:teuthology.orchestra.run.smithi045.stdout: -9567> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 223.041, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.23e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:449.1] 2023-10-03T19:20:59.583 INFO:teuthology.orchestra.run.smithi045.stdout: -9566> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d820480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5624 pv6006 ap=192 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=192) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=191) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 192 2023-10-03T19:20:59.583 INFO:teuthology.orchestra.run.smithi045.stdout: -9565> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5625 cv=5559/5559 REP dir_auth=0 ap=192+192 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d820480 count now 192/192 2023-10-03T19:20:59.583 INFO:teuthology.orchestra.run.smithi045.stdout: -9564> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d820480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5619 cv=5553/5553 ap=192+192 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=33 | child=1 dirty=1 authpin=1 0x55576d056400] count now 192 2023-10-03T19:20:59.583 INFO:teuthology.orchestra.run.smithi045.stdout: -9563> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d820480 on [dir 0x1 / [2,head] auth pv=6007 v=5625 cv=5559/5559 REP dir_auth=0 ap=191+192 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 191 2023-10-03T19:20:59.584 INFO:teuthology.orchestra.run.smithi045.stdout: -9562> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000051d) auth_unpin by 0x55576d820480 on [inode 0x1000000051d [2,head] /dc-dir/dc-file_808 auth v5618 s=3 n(v0 rc2023-10-03T19:16:10.994441+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6bd600] now 0 2023-10-03T19:20:59.584 INFO:teuthology.orchestra.run.smithi045.stdout: -9561> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5619 cv=5553/5553 ap=192+191 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=33 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d820480 count now 192/191 2023-10-03T19:20:59.584 INFO:teuthology.orchestra.run.smithi045.stdout: -9560> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.584 INFO:teuthology.orchestra.run.smithi045.stdout: -9559> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.584 INFO:teuthology.orchestra.run.smithi045.stdout: -9558> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000051e [2,head] /dc-dir/dc-file_809 auth v3998 pv5620 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.007056+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.007056+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6bdb80] 2023-10-03T19:20:59.584 INFO:teuthology.orchestra.run.smithi045.stdout: -9557> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5626 2023-10-03T19:20:59.585 INFO:teuthology.orchestra.run.smithi045.stdout: -9556> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5626 pv6006 ap=192 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=192) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=191) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.585 INFO:teuthology.orchestra.run.smithi045.stdout: -9555> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5624 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:20:59.585 INFO:teuthology.orchestra.run.smithi045.stdout: -9554> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5625 cv=5559/5559 REP dir_auth=0 ap=191+192 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5625 2023-10-03T19:20:59.585 INFO:teuthology.orchestra.run.smithi045.stdout: -9553> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000051e) pop_and_dirty_projected_inode v5620 2023-10-03T19:20:59.585 INFO:teuthology.orchestra.run.smithi045.stdout: -9552> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000051e) mark_dirty [inode 0x1000000051e [2,head] /dc-dir/dc-file_809 auth v5620 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.007056+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6bdb80] 2023-10-03T19:20:59.586 INFO:teuthology.orchestra.run.smithi045.stdout: -9551> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_809) mark_dirty [dentry #0x1/dc-dir/dc-file_809 [2,head] auth (dversion lock) pv=5620 v=3998 ino=0x1000000051e state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6b8f00] 2023-10-03T19:20:59.586 INFO:teuthology.orchestra.run.smithi045.stdout: -9550> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5619 cv=5553/5553 ap=192+191 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=34 | child=1 dirty=1 authpin=1 0x55576d056400] version 5619 2023-10-03T19:20:59.586 INFO:teuthology.orchestra.run.smithi045.stdout: -9549> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d7f8ec0 v5627 2023-10-03T19:20:59.586 INFO:teuthology.orchestra.run.smithi045.stdout: -9548> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5627 cv=5559/5559 REP dir_auth=0 ap=191+192 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5627 2023-10-03T19:20:59.586 INFO:teuthology.orchestra.run.smithi045.stdout: -9547> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d7f8da0 v5621 2023-10-03T19:20:59.586 INFO:teuthology.orchestra.run.smithi045.stdout: -9546> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5621 cv=5553/5553 ap=192+191 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=34 | child=1 dirty=1 authpin=1 0x55576d056400] version 5621 2023-10-03T19:20:59.587 INFO:teuthology.orchestra.run.smithi045.stdout: -9545> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=191 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=191 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:20:59.587 INFO:teuthology.orchestra.run.smithi045.stdout: -9544> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=191) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5626 pv6006 ap=192 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=192) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=191) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.587 INFO:teuthology.orchestra.run.smithi045.stdout: -9543> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=192) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5626 pv6006 ap=192 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=192) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=190) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.587 INFO:teuthology.orchestra.run.smithi045.stdout: -9542> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000051e [2,head] /dc-dir/dc-file_809 auth v5620 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.007056+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bdb80] 2023-10-03T19:20:59.587 INFO:teuthology.orchestra.run.smithi045.stdout: -9541> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000051e [2,head] /dc-dir/dc-file_809 auth v5620 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.007056+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bdb80] 2023-10-03T19:20:59.587 INFO:teuthology.orchestra.run.smithi045.stdout: -9540> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:20:59.588 INFO:teuthology.orchestra.run.smithi045.stdout: -9539> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:20:59.588 INFO:teuthology.orchestra.run.smithi045.stdout: -9538> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:20:59.588 INFO:teuthology.orchestra.run.smithi045.stdout: -9537> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000051e [2,head] /dc-dir/dc-file_809 auth v5620 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.007056+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bdb80] 2023-10-03T19:20:59.588 INFO:teuthology.orchestra.run.smithi045.stdout: -9536> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000051e [2,head] /dc-dir/dc-file_809 auth v5620 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.007056+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bdb80] 2023-10-03T19:20:59.588 INFO:teuthology.orchestra.run.smithi045.stdout: -9535> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:20:59.588 INFO:teuthology.orchestra.run.smithi045.stdout: -9534> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 224.041, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.24e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:451.1] 2023-10-03T19:20:59.588 INFO:teuthology.orchestra.run.smithi045.stdout: -9533> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d821b00 on [dir 0x1 / [2,head] auth pv=6007 v=5627 cv=5559/5559 REP dir_auth=0 ap=190+192 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 190 2023-10-03T19:20:59.588 INFO:teuthology.orchestra.run.smithi045.stdout: -9532> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d821b00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5626 pv6006 ap=191 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=191) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=190) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 191 2023-10-03T19:20:59.588 INFO:teuthology.orchestra.run.smithi045.stdout: -9531> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5627 cv=5559/5559 REP dir_auth=0 ap=190+191 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d821b00 count now 190/191 2023-10-03T19:20:59.588 INFO:teuthology.orchestra.run.smithi045.stdout: -9530> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d821b00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5621 cv=5553/5553 ap=191+191 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=34 | child=1 dirty=1 authpin=1 0x55576d056400] count now 191 2023-10-03T19:20:59.588 INFO:teuthology.orchestra.run.smithi045.stdout: -9529> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000051e) auth_unpin by 0x55576d821b00 on [inode 0x1000000051e [2,head] /dc-dir/dc-file_809 auth v5620 s=3 n(v0 rc2023-10-03T19:16:11.007056+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6bdb80] now 0 2023-10-03T19:20:59.589 INFO:teuthology.orchestra.run.smithi045.stdout: -9528> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5621 cv=5553/5553 ap=191+190 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=34 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d821b00 count now 191/190 2023-10-03T19:20:59.589 INFO:teuthology.orchestra.run.smithi045.stdout: -9527> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.589 INFO:teuthology.orchestra.run.smithi045.stdout: -9526> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.589 INFO:teuthology.orchestra.run.smithi045.stdout: -9525> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000051f [2,head] /dc-dir/dc-file_810 auth v4002 pv5622 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.019270+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.019270+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6be100] 2023-10-03T19:20:59.589 INFO:teuthology.orchestra.run.smithi045.stdout: -9524> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5628 2023-10-03T19:20:59.589 INFO:teuthology.orchestra.run.smithi045.stdout: -9523> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5628 pv6006 ap=191 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=191) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=190) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.589 INFO:teuthology.orchestra.run.smithi045.stdout: -9522> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5626 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:20:59.620 INFO:teuthology.orchestra.run.smithi045.stdout: -9521> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5627 cv=5559/5559 REP dir_auth=0 ap=190+191 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5627 2023-10-03T19:20:59.620 INFO:teuthology.orchestra.run.smithi045.stdout: -9520> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000051f) pop_and_dirty_projected_inode v5622 2023-10-03T19:20:59.621 INFO:teuthology.orchestra.run.smithi045.stdout: -9519> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000051f) mark_dirty [inode 0x1000000051f [2,head] /dc-dir/dc-file_810 auth v5622 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.019270+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6be100] 2023-10-03T19:20:59.621 INFO:teuthology.orchestra.run.smithi045.stdout: -9518> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_810) mark_dirty [dentry #0x1/dc-dir/dc-file_810 [2,head] auth (dversion lock) pv=5622 v=4002 ino=0x1000000051f state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6b9180] 2023-10-03T19:20:59.621 INFO:teuthology.orchestra.run.smithi045.stdout: -9517> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5621 cv=5553/5553 ap=191+190 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=35 | child=1 dirty=1 authpin=1 0x55576d056400] version 5621 2023-10-03T19:20:59.621 INFO:teuthology.orchestra.run.smithi045.stdout: -9516> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d7f8c80 v5629 2023-10-03T19:20:59.621 INFO:teuthology.orchestra.run.smithi045.stdout: -9515> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5629 cv=5559/5559 REP dir_auth=0 ap=190+191 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5629 2023-10-03T19:20:59.622 INFO:teuthology.orchestra.run.smithi045.stdout: -9514> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d7f8b60 v5623 2023-10-03T19:20:59.622 INFO:teuthology.orchestra.run.smithi045.stdout: -9513> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5623 cv=5553/5553 ap=191+190 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=35 | child=1 dirty=1 authpin=1 0x55576d056400] version 5623 2023-10-03T19:20:59.622 INFO:teuthology.orchestra.run.smithi045.stdout: -9512> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=190 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=190 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:20:59.622 INFO:teuthology.orchestra.run.smithi045.stdout: -9511> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=190) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5628 pv6006 ap=191 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=191) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=190) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.622 INFO:teuthology.orchestra.run.smithi045.stdout: -9510> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=191) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5628 pv6006 ap=191 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=191) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=189) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.622 INFO:teuthology.orchestra.run.smithi045.stdout: -9509> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000051f [2,head] /dc-dir/dc-file_810 auth v5622 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.019270+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6be100] 2023-10-03T19:20:59.623 INFO:teuthology.orchestra.run.smithi045.stdout: -9508> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000051f [2,head] /dc-dir/dc-file_810 auth v5622 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.019270+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6be100] 2023-10-03T19:20:59.623 INFO:teuthology.orchestra.run.smithi045.stdout: -9507> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:20:59.623 INFO:teuthology.orchestra.run.smithi045.stdout: -9506> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:20:59.623 INFO:teuthology.orchestra.run.smithi045.stdout: -9505> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:20:59.623 INFO:teuthology.orchestra.run.smithi045.stdout: -9504> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000051f [2,head] /dc-dir/dc-file_810 auth v5622 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.019270+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6be100] 2023-10-03T19:20:59.624 INFO:teuthology.orchestra.run.smithi045.stdout: -9503> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000051f [2,head] /dc-dir/dc-file_810 auth v5622 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.019270+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6be100] 2023-10-03T19:20:59.624 INFO:teuthology.orchestra.run.smithi045.stdout: -9502> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:20:59.624 INFO:teuthology.orchestra.run.smithi045.stdout: -9501> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 225.041, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.25e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:453.1] 2023-10-03T19:20:59.624 INFO:teuthology.orchestra.run.smithi045.stdout: -9500> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d821200 on [dir 0x1 / [2,head] auth pv=6007 v=5629 cv=5559/5559 REP dir_auth=0 ap=189+191 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 189 2023-10-03T19:20:59.624 INFO:teuthology.orchestra.run.smithi045.stdout: -9499> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d821200 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5628 pv6006 ap=190 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=190) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=189) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 190 2023-10-03T19:20:59.624 INFO:teuthology.orchestra.run.smithi045.stdout: -9498> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5629 cv=5559/5559 REP dir_auth=0 ap=189+190 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d821200 count now 189/190 2023-10-03T19:20:59.625 INFO:teuthology.orchestra.run.smithi045.stdout: -9497> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d821200 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5623 cv=5553/5553 ap=190+190 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=35 | child=1 dirty=1 authpin=1 0x55576d056400] count now 190 2023-10-03T19:20:59.625 INFO:teuthology.orchestra.run.smithi045.stdout: -9496> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000051f) auth_unpin by 0x55576d821200 on [inode 0x1000000051f [2,head] /dc-dir/dc-file_810 auth v5622 s=3 n(v0 rc2023-10-03T19:16:11.019270+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6be100] now 0 2023-10-03T19:20:59.625 INFO:teuthology.orchestra.run.smithi045.stdout: -9495> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5623 cv=5553/5553 ap=190+189 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=35 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d821200 count now 190/189 2023-10-03T19:20:59.625 INFO:teuthology.orchestra.run.smithi045.stdout: -9494> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.625 INFO:teuthology.orchestra.run.smithi045.stdout: -9493> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.625 INFO:teuthology.orchestra.run.smithi045.stdout: -9492> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000520 [2,head] /dc-dir/dc-file_811 auth v4006 pv5624 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.031590+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.031590+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6be680] 2023-10-03T19:20:59.625 INFO:teuthology.orchestra.run.smithi045.stdout: -9491> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5630 2023-10-03T19:20:59.625 INFO:teuthology.orchestra.run.smithi045.stdout: -9490> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5630 pv6006 ap=190 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=190) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=189) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.625 INFO:teuthology.orchestra.run.smithi045.stdout: -9489> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5628 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:20:59.625 INFO:teuthology.orchestra.run.smithi045.stdout: -9488> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5629 cv=5559/5559 REP dir_auth=0 ap=189+190 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5629 2023-10-03T19:20:59.625 INFO:teuthology.orchestra.run.smithi045.stdout: -9487> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000520) pop_and_dirty_projected_inode v5624 2023-10-03T19:20:59.625 INFO:teuthology.orchestra.run.smithi045.stdout: -9486> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000520) mark_dirty [inode 0x10000000520 [2,head] /dc-dir/dc-file_811 auth v5624 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.031590+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6be680] 2023-10-03T19:20:59.626 INFO:teuthology.orchestra.run.smithi045.stdout: -9485> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_811) mark_dirty [dentry #0x1/dc-dir/dc-file_811 [2,head] auth (dversion lock) pv=5624 v=4006 ino=0x10000000520 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6b9400] 2023-10-03T19:20:59.626 INFO:teuthology.orchestra.run.smithi045.stdout: -9484> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5623 cv=5553/5553 ap=190+189 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=36 | child=1 dirty=1 authpin=1 0x55576d056400] version 5623 2023-10-03T19:20:59.633 INFO:teuthology.orchestra.run.smithi045.stdout: -9483> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d7f8a40 v5631 2023-10-03T19:20:59.634 INFO:teuthology.orchestra.run.smithi045.stdout: -9482> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5631 cv=5559/5559 REP dir_auth=0 ap=189+190 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5631 2023-10-03T19:20:59.634 INFO:teuthology.orchestra.run.smithi045.stdout: -9481> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d7f8920 v5625 2023-10-03T19:20:59.634 INFO:teuthology.orchestra.run.smithi045.stdout: -9480> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5625 cv=5553/5553 ap=190+189 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=36 | child=1 dirty=1 authpin=1 0x55576d056400] version 5625 2023-10-03T19:20:59.634 INFO:teuthology.orchestra.run.smithi045.stdout: -9479> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=189 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=189 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:20:59.634 INFO:teuthology.orchestra.run.smithi045.stdout: -9478> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=189) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5630 pv6006 ap=190 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=190) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=189) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.634 INFO:teuthology.orchestra.run.smithi045.stdout: -9477> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=190) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5630 pv6006 ap=190 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=190) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=188) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.634 INFO:teuthology.orchestra.run.smithi045.stdout: -9476> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000520 [2,head] /dc-dir/dc-file_811 auth v5624 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.031590+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6be680] 2023-10-03T19:20:59.634 INFO:teuthology.orchestra.run.smithi045.stdout: -9475> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000520 [2,head] /dc-dir/dc-file_811 auth v5624 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.031590+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6be680] 2023-10-03T19:20:59.634 INFO:teuthology.orchestra.run.smithi045.stdout: -9474> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:20:59.634 INFO:teuthology.orchestra.run.smithi045.stdout: -9473> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:20:59.635 INFO:teuthology.orchestra.run.smithi045.stdout: -9472> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:20:59.635 INFO:teuthology.orchestra.run.smithi045.stdout: -9471> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000520 [2,head] /dc-dir/dc-file_811 auth v5624 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.031590+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6be680] 2023-10-03T19:20:59.635 INFO:teuthology.orchestra.run.smithi045.stdout: -9470> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000520 [2,head] /dc-dir/dc-file_811 auth v5624 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.031590+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6be680] 2023-10-03T19:20:59.635 INFO:teuthology.orchestra.run.smithi045.stdout: -9469> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:20:59.635 INFO:teuthology.orchestra.run.smithi045.stdout: -9468> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 226.041, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.26e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:455.1] 2023-10-03T19:20:59.635 INFO:teuthology.orchestra.run.smithi045.stdout: -9467> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2abb00 on [dir 0x1 / [2,head] auth pv=6007 v=5631 cv=5559/5559 REP dir_auth=0 ap=188+190 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 188 2023-10-03T19:20:59.635 INFO:teuthology.orchestra.run.smithi045.stdout: -9466> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2abb00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5630 pv6006 ap=189 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=189) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=188) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 189 2023-10-03T19:20:59.635 INFO:teuthology.orchestra.run.smithi045.stdout: -9465> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5631 cv=5559/5559 REP dir_auth=0 ap=188+189 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2abb00 count now 188/189 2023-10-03T19:20:59.635 INFO:teuthology.orchestra.run.smithi045.stdout: -9464> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2abb00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5625 cv=5553/5553 ap=189+189 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=36 | child=1 dirty=1 authpin=1 0x55576d056400] count now 189 2023-10-03T19:20:59.635 INFO:teuthology.orchestra.run.smithi045.stdout: -9463> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000520) auth_unpin by 0x55576d2abb00 on [inode 0x10000000520 [2,head] /dc-dir/dc-file_811 auth v5624 s=3 n(v0 rc2023-10-03T19:16:11.031590+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6be680] now 0 2023-10-03T19:20:59.636 INFO:teuthology.orchestra.run.smithi045.stdout: -9462> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5625 cv=5553/5553 ap=189+188 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=36 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2abb00 count now 189/188 2023-10-03T19:20:59.636 INFO:teuthology.orchestra.run.smithi045.stdout: -9461> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.636 INFO:teuthology.orchestra.run.smithi045.stdout: -9460> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.636 INFO:teuthology.orchestra.run.smithi045.stdout: -9459> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000521 [2,head] /dc-dir/dc-file_812 auth v4010 pv5626 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.043731+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.043731+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6bec00] 2023-10-03T19:20:59.636 INFO:teuthology.orchestra.run.smithi045.stdout: -9458> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5632 2023-10-03T19:20:59.636 INFO:teuthology.orchestra.run.smithi045.stdout: -9457> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5632 pv6006 ap=189 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=189) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=188) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.636 INFO:teuthology.orchestra.run.smithi045.stdout: -9456> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5630 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:20:59.636 INFO:teuthology.orchestra.run.smithi045.stdout: -9455> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5631 cv=5559/5559 REP dir_auth=0 ap=188+189 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5631 2023-10-03T19:20:59.636 INFO:teuthology.orchestra.run.smithi045.stdout: -9454> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000521) pop_and_dirty_projected_inode v5626 2023-10-03T19:20:59.637 INFO:teuthology.orchestra.run.smithi045.stdout: -9453> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000521) mark_dirty [inode 0x10000000521 [2,head] /dc-dir/dc-file_812 auth v5626 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.043731+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6bec00] 2023-10-03T19:20:59.637 INFO:teuthology.orchestra.run.smithi045.stdout: -9452> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_812) mark_dirty [dentry #0x1/dc-dir/dc-file_812 [2,head] auth (dversion lock) pv=5626 v=4010 ino=0x10000000521 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6b9680] 2023-10-03T19:20:59.637 INFO:teuthology.orchestra.run.smithi045.stdout: -9451> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5625 cv=5553/5553 ap=189+188 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=37 | child=1 dirty=1 authpin=1 0x55576d056400] version 5625 2023-10-03T19:20:59.637 INFO:teuthology.orchestra.run.smithi045.stdout: -9450> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d7f8800 v5633 2023-10-03T19:20:59.637 INFO:teuthology.orchestra.run.smithi045.stdout: -9449> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5633 cv=5559/5559 REP dir_auth=0 ap=188+189 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5633 2023-10-03T19:20:59.637 INFO:teuthology.orchestra.run.smithi045.stdout: -9448> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d7f86e0 v5627 2023-10-03T19:20:59.637 INFO:teuthology.orchestra.run.smithi045.stdout: -9447> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5627 cv=5553/5553 ap=189+188 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=37 | child=1 dirty=1 authpin=1 0x55576d056400] version 5627 2023-10-03T19:20:59.637 INFO:teuthology.orchestra.run.smithi045.stdout: -9446> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=188 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=188 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:20:59.637 INFO:teuthology.orchestra.run.smithi045.stdout: -9445> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=188) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5632 pv6006 ap=189 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=189) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=188) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.637 INFO:teuthology.orchestra.run.smithi045.stdout: -9444> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=189) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5632 pv6006 ap=189 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=189) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=187) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.637 INFO:teuthology.orchestra.run.smithi045.stdout: -9443> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000521 [2,head] /dc-dir/dc-file_812 auth v5626 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.043731+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bec00] 2023-10-03T19:20:59.638 INFO:teuthology.orchestra.run.smithi045.stdout: -9442> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000521 [2,head] /dc-dir/dc-file_812 auth v5626 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.043731+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bec00] 2023-10-03T19:20:59.638 INFO:teuthology.orchestra.run.smithi045.stdout: -9441> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:20:59.638 INFO:teuthology.orchestra.run.smithi045.stdout: -9440> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:20:59.638 INFO:teuthology.orchestra.run.smithi045.stdout: -9439> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:20:59.638 INFO:teuthology.orchestra.run.smithi045.stdout: -9438> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000521 [2,head] /dc-dir/dc-file_812 auth v5626 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.043731+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bec00] 2023-10-03T19:20:59.638 INFO:teuthology.orchestra.run.smithi045.stdout: -9437> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000521 [2,head] /dc-dir/dc-file_812 auth v5626 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.043731+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bec00] 2023-10-03T19:20:59.638 INFO:teuthology.orchestra.run.smithi045.stdout: -9436> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:20:59.638 INFO:teuthology.orchestra.run.smithi045.stdout: -9435> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 227.041, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.27e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:457.1] 2023-10-03T19:20:59.638 INFO:teuthology.orchestra.run.smithi045.stdout: -9434> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d54eb40 on [dir 0x1 / [2,head] auth pv=6007 v=5633 cv=5559/5559 REP dir_auth=0 ap=187+189 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 187 2023-10-03T19:20:59.638 INFO:teuthology.orchestra.run.smithi045.stdout: -9433> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d54eb40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5632 pv6006 ap=188 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=188) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=187) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 188 2023-10-03T19:20:59.639 INFO:teuthology.orchestra.run.smithi045.stdout: -9432> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5633 cv=5559/5559 REP dir_auth=0 ap=187+188 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d54eb40 count now 187/188 2023-10-03T19:20:59.639 INFO:teuthology.orchestra.run.smithi045.stdout: -9431> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d54eb40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5627 cv=5553/5553 ap=188+188 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=37 | child=1 dirty=1 authpin=1 0x55576d056400] count now 188 2023-10-03T19:20:59.639 INFO:teuthology.orchestra.run.smithi045.stdout: -9430> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000521) auth_unpin by 0x55576d54eb40 on [inode 0x10000000521 [2,head] /dc-dir/dc-file_812 auth v5626 s=3 n(v0 rc2023-10-03T19:16:11.043731+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6bec00] now 0 2023-10-03T19:20:59.639 INFO:teuthology.orchestra.run.smithi045.stdout: -9429> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5627 cv=5553/5553 ap=188+187 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=37 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d54eb40 count now 188/187 2023-10-03T19:20:59.639 INFO:teuthology.orchestra.run.smithi045.stdout: -9428> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.639 INFO:teuthology.orchestra.run.smithi045.stdout: -9427> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.728 INFO:teuthology.orchestra.run.smithi045.stdout: -9426> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000522 [2,head] /dc-dir/dc-file_813 auth v4014 pv5628 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.055611+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.055611+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6bf180] 2023-10-03T19:20:59.728 INFO:teuthology.orchestra.run.smithi045.stdout: -9425> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5634 2023-10-03T19:20:59.728 INFO:teuthology.orchestra.run.smithi045.stdout: -9424> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5634 pv6006 ap=188 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=188) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=187) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.729 INFO:teuthology.orchestra.run.smithi045.stdout: -9423> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5632 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:20:59.729 INFO:teuthology.orchestra.run.smithi045.stdout: -9422> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5633 cv=5559/5559 REP dir_auth=0 ap=187+188 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5633 2023-10-03T19:20:59.729 INFO:teuthology.orchestra.run.smithi045.stdout: -9421> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000522) pop_and_dirty_projected_inode v5628 2023-10-03T19:20:59.729 INFO:teuthology.orchestra.run.smithi045.stdout: -9420> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000522) mark_dirty [inode 0x10000000522 [2,head] /dc-dir/dc-file_813 auth v5628 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.055611+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6bf180] 2023-10-03T19:20:59.729 INFO:teuthology.orchestra.run.smithi045.stdout: -9419> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_813) mark_dirty [dentry #0x1/dc-dir/dc-file_813 [2,head] auth (dversion lock) pv=5628 v=4014 ino=0x10000000522 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6b9900] 2023-10-03T19:20:59.729 INFO:teuthology.orchestra.run.smithi045.stdout: -9418> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5627 cv=5553/5553 ap=188+187 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=38 | child=1 dirty=1 authpin=1 0x55576d056400] version 5627 2023-10-03T19:20:59.729 INFO:teuthology.orchestra.run.smithi045.stdout: -9417> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d7f85c0 v5635 2023-10-03T19:20:59.729 INFO:teuthology.orchestra.run.smithi045.stdout: -9416> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5635 cv=5559/5559 REP dir_auth=0 ap=187+188 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5635 2023-10-03T19:20:59.729 INFO:teuthology.orchestra.run.smithi045.stdout: -9415> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d7f84a0 v5629 2023-10-03T19:20:59.730 INFO:teuthology.orchestra.run.smithi045.stdout: -9414> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5629 cv=5553/5553 ap=188+187 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=38 | child=1 dirty=1 authpin=1 0x55576d056400] version 5629 2023-10-03T19:20:59.730 INFO:teuthology.orchestra.run.smithi045.stdout: -9413> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=187 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=187 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:20:59.730 INFO:teuthology.orchestra.run.smithi045.stdout: -9412> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=187) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5634 pv6006 ap=188 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=188) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=187) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.730 INFO:teuthology.orchestra.run.smithi045.stdout: -9411> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=188) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5634 pv6006 ap=188 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=188) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=186) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.730 INFO:teuthology.orchestra.run.smithi045.stdout: -9410> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000522 [2,head] /dc-dir/dc-file_813 auth v5628 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.055611+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bf180] 2023-10-03T19:20:59.730 INFO:teuthology.orchestra.run.smithi045.stdout: -9409> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000522 [2,head] /dc-dir/dc-file_813 auth v5628 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.055611+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bf180] 2023-10-03T19:20:59.730 INFO:teuthology.orchestra.run.smithi045.stdout: -9408> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:20:59.730 INFO:teuthology.orchestra.run.smithi045.stdout: -9407> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:20:59.730 INFO:teuthology.orchestra.run.smithi045.stdout: -9406> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:20:59.730 INFO:teuthology.orchestra.run.smithi045.stdout: -9405> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000522 [2,head] /dc-dir/dc-file_813 auth v5628 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.055611+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bf180] 2023-10-03T19:20:59.731 INFO:teuthology.orchestra.run.smithi045.stdout: -9404> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000522 [2,head] /dc-dir/dc-file_813 auth v5628 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.055611+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bf180] 2023-10-03T19:20:59.731 INFO:teuthology.orchestra.run.smithi045.stdout: -9403> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:20:59.731 INFO:teuthology.orchestra.run.smithi045.stdout: -9402> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 228.041, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.28e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:459.1] 2023-10-03T19:20:59.731 INFO:teuthology.orchestra.run.smithi045.stdout: -9401> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d546fc0 on [dir 0x1 / [2,head] auth pv=6007 v=5635 cv=5559/5559 REP dir_auth=0 ap=186+188 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 186 2023-10-03T19:20:59.731 INFO:teuthology.orchestra.run.smithi045.stdout: -9400> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d546fc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5634 pv6006 ap=187 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=187) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=186) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 187 2023-10-03T19:20:59.731 INFO:teuthology.orchestra.run.smithi045.stdout: -9399> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5635 cv=5559/5559 REP dir_auth=0 ap=186+187 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d546fc0 count now 186/187 2023-10-03T19:20:59.731 INFO:teuthology.orchestra.run.smithi045.stdout: -9398> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d546fc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5629 cv=5553/5553 ap=187+187 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=38 | child=1 dirty=1 authpin=1 0x55576d056400] count now 187 2023-10-03T19:20:59.731 INFO:teuthology.orchestra.run.smithi045.stdout: -9397> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000522) auth_unpin by 0x55576d546fc0 on [inode 0x10000000522 [2,head] /dc-dir/dc-file_813 auth v5628 s=3 n(v0 rc2023-10-03T19:16:11.055611+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6bf180] now 0 2023-10-03T19:20:59.731 INFO:teuthology.orchestra.run.smithi045.stdout: -9396> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5629 cv=5553/5553 ap=187+186 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=38 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d546fc0 count now 187/186 2023-10-03T19:20:59.731 INFO:teuthology.orchestra.run.smithi045.stdout: -9395> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.732 INFO:teuthology.orchestra.run.smithi045.stdout: -9394> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.732 INFO:teuthology.orchestra.run.smithi045.stdout: -9393> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000523 [2,head] /dc-dir/dc-file_814 auth v4018 pv5630 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.067921+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.067921+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6bf700] 2023-10-03T19:20:59.732 INFO:teuthology.orchestra.run.smithi045.stdout: -9392> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5636 2023-10-03T19:20:59.732 INFO:teuthology.orchestra.run.smithi045.stdout: -9391> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5636 pv6006 ap=187 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=187) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=186) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.732 INFO:teuthology.orchestra.run.smithi045.stdout: -9390> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5634 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:20:59.732 INFO:teuthology.orchestra.run.smithi045.stdout: -9389> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5635 cv=5559/5559 REP dir_auth=0 ap=186+187 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5635 2023-10-03T19:20:59.732 INFO:teuthology.orchestra.run.smithi045.stdout: -9388> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000523) pop_and_dirty_projected_inode v5630 2023-10-03T19:20:59.732 INFO:teuthology.orchestra.run.smithi045.stdout: -9387> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000523) mark_dirty [inode 0x10000000523 [2,head] /dc-dir/dc-file_814 auth v5630 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.067921+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6bf700] 2023-10-03T19:20:59.732 INFO:teuthology.orchestra.run.smithi045.stdout: -9386> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_814) mark_dirty [dentry #0x1/dc-dir/dc-file_814 [2,head] auth (dversion lock) pv=5630 v=4018 ino=0x10000000523 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6b9b80] 2023-10-03T19:20:59.733 INFO:teuthology.orchestra.run.smithi045.stdout: -9385> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5629 cv=5553/5553 ap=187+186 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=39 | child=1 dirty=1 authpin=1 0x55576d056400] version 5629 2023-10-03T19:20:59.733 INFO:teuthology.orchestra.run.smithi045.stdout: -9384> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d7f8380 v5637 2023-10-03T19:20:59.733 INFO:teuthology.orchestra.run.smithi045.stdout: -9383> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5637 cv=5559/5559 REP dir_auth=0 ap=186+187 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5637 2023-10-03T19:20:59.733 INFO:teuthology.orchestra.run.smithi045.stdout: -9382> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d7f8260 v5631 2023-10-03T19:20:59.733 INFO:teuthology.orchestra.run.smithi045.stdout: -9381> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5631 cv=5553/5553 ap=187+186 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=39 | child=1 dirty=1 authpin=1 0x55576d056400] version 5631 2023-10-03T19:20:59.733 INFO:teuthology.orchestra.run.smithi045.stdout: -9380> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=186 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=186 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:20:59.733 INFO:teuthology.orchestra.run.smithi045.stdout: -9379> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=186) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5636 pv6006 ap=187 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=187) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=186) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.733 INFO:teuthology.orchestra.run.smithi045.stdout: -9378> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=187) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5636 pv6006 ap=187 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=187) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=185) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.733 INFO:teuthology.orchestra.run.smithi045.stdout: -9377> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000523 [2,head] /dc-dir/dc-file_814 auth v5630 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.067921+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bf700] 2023-10-03T19:20:59.733 INFO:teuthology.orchestra.run.smithi045.stdout: -9376> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000523 [2,head] /dc-dir/dc-file_814 auth v5630 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.067921+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bf700] 2023-10-03T19:20:59.733 INFO:teuthology.orchestra.run.smithi045.stdout: -9375> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:20:59.734 INFO:teuthology.orchestra.run.smithi045.stdout: -9374> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:20:59.734 INFO:teuthology.orchestra.run.smithi045.stdout: -9373> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:20:59.740 INFO:teuthology.orchestra.run.smithi045.stdout: -9372> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000523 [2,head] /dc-dir/dc-file_814 auth v5630 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.067921+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bf700] 2023-10-03T19:20:59.740 INFO:teuthology.orchestra.run.smithi045.stdout: -9371> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000523 [2,head] /dc-dir/dc-file_814 auth v5630 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.067921+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6bf700] 2023-10-03T19:20:59.741 INFO:teuthology.orchestra.run.smithi045.stdout: -9370> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:20:59.741 INFO:teuthology.orchestra.run.smithi045.stdout: -9369> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 229.041, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.29e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:461.1] 2023-10-03T19:20:59.741 INFO:teuthology.orchestra.run.smithi045.stdout: -9368> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d5cbd40 on [dir 0x1 / [2,head] auth pv=6007 v=5637 cv=5559/5559 REP dir_auth=0 ap=185+187 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 185 2023-10-03T19:20:59.741 INFO:teuthology.orchestra.run.smithi045.stdout: -9367> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d5cbd40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5636 pv6006 ap=186 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=186) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=185) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 186 2023-10-03T19:20:59.741 INFO:teuthology.orchestra.run.smithi045.stdout: -9366> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5637 cv=5559/5559 REP dir_auth=0 ap=185+186 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d5cbd40 count now 185/186 2023-10-03T19:20:59.741 INFO:teuthology.orchestra.run.smithi045.stdout: -9365> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d5cbd40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5631 cv=5553/5553 ap=186+186 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=39 | child=1 dirty=1 authpin=1 0x55576d056400] count now 186 2023-10-03T19:20:59.741 INFO:teuthology.orchestra.run.smithi045.stdout: -9364> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000523) auth_unpin by 0x55576d5cbd40 on [inode 0x10000000523 [2,head] /dc-dir/dc-file_814 auth v5630 s=3 n(v0 rc2023-10-03T19:16:11.067921+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6bf700] now 0 2023-10-03T19:20:59.741 INFO:teuthology.orchestra.run.smithi045.stdout: -9363> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5631 cv=5553/5553 ap=186+185 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=39 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d5cbd40 count now 186/185 2023-10-03T19:20:59.741 INFO:teuthology.orchestra.run.smithi045.stdout: -9362> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.741 INFO:teuthology.orchestra.run.smithi045.stdout: -9361> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.741 INFO:teuthology.orchestra.run.smithi045.stdout: -9360> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000524 [2,head] /dc-dir/dc-file_815 auth v4022 pv5632 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.079518+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.079518+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6c4000] 2023-10-03T19:20:59.742 INFO:teuthology.orchestra.run.smithi045.stdout: -9359> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5638 2023-10-03T19:20:59.742 INFO:teuthology.orchestra.run.smithi045.stdout: -9358> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5638 pv6006 ap=186 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=186) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=185) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.742 INFO:teuthology.orchestra.run.smithi045.stdout: -9357> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5636 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:20:59.742 INFO:teuthology.orchestra.run.smithi045.stdout: -9356> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5637 cv=5559/5559 REP dir_auth=0 ap=185+186 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5637 2023-10-03T19:20:59.742 INFO:teuthology.orchestra.run.smithi045.stdout: -9355> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000524) pop_and_dirty_projected_inode v5632 2023-10-03T19:20:59.742 INFO:teuthology.orchestra.run.smithi045.stdout: -9354> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000524) mark_dirty [inode 0x10000000524 [2,head] /dc-dir/dc-file_815 auth v5632 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.079518+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6c4000] 2023-10-03T19:20:59.742 INFO:teuthology.orchestra.run.smithi045.stdout: -9353> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_815) mark_dirty [dentry #0x1/dc-dir/dc-file_815 [2,head] auth (dversion lock) pv=5632 v=4022 ino=0x10000000524 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6c2000] 2023-10-03T19:20:59.742 INFO:teuthology.orchestra.run.smithi045.stdout: -9352> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5631 cv=5553/5553 ap=186+185 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=40 | child=1 dirty=1 authpin=1 0x55576d056400] version 5631 2023-10-03T19:20:59.742 INFO:teuthology.orchestra.run.smithi045.stdout: -9351> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d7f8140 v5639 2023-10-03T19:20:59.742 INFO:teuthology.orchestra.run.smithi045.stdout: -9350> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5639 cv=5559/5559 REP dir_auth=0 ap=185+186 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5639 2023-10-03T19:20:59.742 INFO:teuthology.orchestra.run.smithi045.stdout: -9349> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d7f8020 v5633 2023-10-03T19:20:59.743 INFO:teuthology.orchestra.run.smithi045.stdout: -9348> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5633 cv=5553/5553 ap=186+185 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=40 | child=1 dirty=1 authpin=1 0x55576d056400] version 5633 2023-10-03T19:20:59.743 INFO:teuthology.orchestra.run.smithi045.stdout: -9347> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=185 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=185 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:20:59.743 INFO:teuthology.orchestra.run.smithi045.stdout: -9346> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=185) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5638 pv6006 ap=186 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=186) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=185) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.743 INFO:teuthology.orchestra.run.smithi045.stdout: -9345> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=186) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5638 pv6006 ap=186 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=186) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=184) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.743 INFO:teuthology.orchestra.run.smithi045.stdout: -9344> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000524 [2,head] /dc-dir/dc-file_815 auth v5632 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.079518+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c4000] 2023-10-03T19:20:59.743 INFO:teuthology.orchestra.run.smithi045.stdout: -9343> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000524 [2,head] /dc-dir/dc-file_815 auth v5632 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.079518+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c4000] 2023-10-03T19:20:59.743 INFO:teuthology.orchestra.run.smithi045.stdout: -9342> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:20:59.743 INFO:teuthology.orchestra.run.smithi045.stdout: -9341> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:20:59.743 INFO:teuthology.orchestra.run.smithi045.stdout: -9340> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:20:59.743 INFO:teuthology.orchestra.run.smithi045.stdout: -9339> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000524 [2,head] /dc-dir/dc-file_815 auth v5632 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.079518+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c4000] 2023-10-03T19:20:59.743 INFO:teuthology.orchestra.run.smithi045.stdout: -9338> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000524 [2,head] /dc-dir/dc-file_815 auth v5632 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.079518+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c4000] 2023-10-03T19:20:59.744 INFO:teuthology.orchestra.run.smithi045.stdout: -9337> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:20:59.744 INFO:teuthology.orchestra.run.smithi045.stdout: -9336> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 230.041, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.30e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:463.1] 2023-10-03T19:20:59.744 INFO:teuthology.orchestra.run.smithi045.stdout: -9335> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d5cbb00 on [dir 0x1 / [2,head] auth pv=6007 v=5639 cv=5559/5559 REP dir_auth=0 ap=184+186 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 184 2023-10-03T19:20:59.744 INFO:teuthology.orchestra.run.smithi045.stdout: -9334> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d5cbb00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5638 pv6006 ap=185 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=185) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=184) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 185 2023-10-03T19:20:59.744 INFO:teuthology.orchestra.run.smithi045.stdout: -9333> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5639 cv=5559/5559 REP dir_auth=0 ap=184+185 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d5cbb00 count now 184/185 2023-10-03T19:20:59.744 INFO:teuthology.orchestra.run.smithi045.stdout: -9332> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d5cbb00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5633 cv=5553/5553 ap=185+185 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=40 | child=1 dirty=1 authpin=1 0x55576d056400] count now 185 2023-10-03T19:20:59.744 INFO:teuthology.orchestra.run.smithi045.stdout: -9331> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000524) auth_unpin by 0x55576d5cbb00 on [inode 0x10000000524 [2,head] /dc-dir/dc-file_815 auth v5632 s=3 n(v0 rc2023-10-03T19:16:11.079518+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6c4000] now 0 2023-10-03T19:20:59.744 INFO:teuthology.orchestra.run.smithi045.stdout: -9330> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5633 cv=5553/5553 ap=185+184 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=40 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d5cbb00 count now 185/184 2023-10-03T19:20:59.744 INFO:teuthology.orchestra.run.smithi045.stdout: -9329> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.744 INFO:teuthology.orchestra.run.smithi045.stdout: -9328> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.744 INFO:teuthology.orchestra.run.smithi045.stdout: -9327> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000525 [2,head] /dc-dir/dc-file_816 auth v4026 pv5634 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.091954+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.091954+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6c4580] 2023-10-03T19:20:59.744 INFO:teuthology.orchestra.run.smithi045.stdout: -9326> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5640 2023-10-03T19:20:59.745 INFO:teuthology.orchestra.run.smithi045.stdout: -9325> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5640 pv6006 ap=185 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=185) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=184) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.745 INFO:teuthology.orchestra.run.smithi045.stdout: -9324> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5638 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:20:59.745 INFO:teuthology.orchestra.run.smithi045.stdout: -9323> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5639 cv=5559/5559 REP dir_auth=0 ap=184+185 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5639 2023-10-03T19:20:59.745 INFO:teuthology.orchestra.run.smithi045.stdout: -9322> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000525) pop_and_dirty_projected_inode v5634 2023-10-03T19:20:59.745 INFO:teuthology.orchestra.run.smithi045.stdout: -9321> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000525) mark_dirty [inode 0x10000000525 [2,head] /dc-dir/dc-file_816 auth v5634 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.091954+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6c4580] 2023-10-03T19:20:59.745 INFO:teuthology.orchestra.run.smithi045.stdout: -9320> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_816) mark_dirty [dentry #0x1/dc-dir/dc-file_816 [2,head] auth (dversion lock) pv=5634 v=4026 ino=0x10000000525 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6c2280] 2023-10-03T19:20:59.745 INFO:teuthology.orchestra.run.smithi045.stdout: -9319> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5633 cv=5553/5553 ap=185+184 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=41 | child=1 dirty=1 authpin=1 0x55576d056400] version 5633 2023-10-03T19:20:59.745 INFO:teuthology.orchestra.run.smithi045.stdout: -9318> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d697e80 v5641 2023-10-03T19:20:59.745 INFO:teuthology.orchestra.run.smithi045.stdout: -9317> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5641 cv=5559/5559 REP dir_auth=0 ap=184+185 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5641 2023-10-03T19:20:59.745 INFO:teuthology.orchestra.run.smithi045.stdout: -9316> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d697d60 v5635 2023-10-03T19:20:59.746 INFO:teuthology.orchestra.run.smithi045.stdout: -9315> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5635 cv=5553/5553 ap=185+184 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=41 | child=1 dirty=1 authpin=1 0x55576d056400] version 5635 2023-10-03T19:20:59.775 INFO:teuthology.orchestra.run.smithi045.stdout: -9314> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=184 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=184 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:20:59.776 INFO:teuthology.orchestra.run.smithi045.stdout: -9313> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=184) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5640 pv6006 ap=185 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=185) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=184) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.776 INFO:teuthology.orchestra.run.smithi045.stdout: -9312> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=185) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5640 pv6006 ap=185 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=185) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=183) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.776 INFO:teuthology.orchestra.run.smithi045.stdout: -9311> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000525 [2,head] /dc-dir/dc-file_816 auth v5634 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.091954+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c4580] 2023-10-03T19:20:59.776 INFO:teuthology.orchestra.run.smithi045.stdout: -9310> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000525 [2,head] /dc-dir/dc-file_816 auth v5634 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.091954+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c4580] 2023-10-03T19:20:59.776 INFO:teuthology.orchestra.run.smithi045.stdout: -9309> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:20:59.776 INFO:teuthology.orchestra.run.smithi045.stdout: -9308> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:20:59.776 INFO:teuthology.orchestra.run.smithi045.stdout: -9307> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:20:59.776 INFO:teuthology.orchestra.run.smithi045.stdout: -9306> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000525 [2,head] /dc-dir/dc-file_816 auth v5634 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.091954+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c4580] 2023-10-03T19:20:59.776 INFO:teuthology.orchestra.run.smithi045.stdout: -9305> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000525 [2,head] /dc-dir/dc-file_816 auth v5634 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.091954+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c4580] 2023-10-03T19:20:59.776 INFO:teuthology.orchestra.run.smithi045.stdout: -9304> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:20:59.776 INFO:teuthology.orchestra.run.smithi045.stdout: -9303> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 231.041, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.31e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:465.1] 2023-10-03T19:20:59.777 INFO:teuthology.orchestra.run.smithi045.stdout: -9302> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d539d40 on [dir 0x1 / [2,head] auth pv=6007 v=5641 cv=5559/5559 REP dir_auth=0 ap=183+185 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 183 2023-10-03T19:20:59.777 INFO:teuthology.orchestra.run.smithi045.stdout: -9301> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d539d40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5640 pv6006 ap=184 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=184) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=183) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 184 2023-10-03T19:20:59.777 INFO:teuthology.orchestra.run.smithi045.stdout: -9300> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5641 cv=5559/5559 REP dir_auth=0 ap=183+184 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d539d40 count now 183/184 2023-10-03T19:20:59.777 INFO:teuthology.orchestra.run.smithi045.stdout: -9299> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d539d40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5635 cv=5553/5553 ap=184+184 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=41 | child=1 dirty=1 authpin=1 0x55576d056400] count now 184 2023-10-03T19:20:59.777 INFO:teuthology.orchestra.run.smithi045.stdout: -9298> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000525) auth_unpin by 0x55576d539d40 on [inode 0x10000000525 [2,head] /dc-dir/dc-file_816 auth v5634 s=3 n(v0 rc2023-10-03T19:16:11.091954+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6c4580] now 0 2023-10-03T19:20:59.777 INFO:teuthology.orchestra.run.smithi045.stdout: -9297> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5635 cv=5553/5553 ap=184+183 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=41 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d539d40 count now 184/183 2023-10-03T19:20:59.777 INFO:teuthology.orchestra.run.smithi045.stdout: -9296> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.777 INFO:teuthology.orchestra.run.smithi045.stdout: -9295> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.777 INFO:teuthology.orchestra.run.smithi045.stdout: -9294> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000526 [2,head] /dc-dir/dc-file_817 auth v4030 pv5636 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.103458+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.103458+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6c4b00] 2023-10-03T19:20:59.777 INFO:teuthology.orchestra.run.smithi045.stdout: -9293> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5642 2023-10-03T19:20:59.778 INFO:teuthology.orchestra.run.smithi045.stdout: -9292> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5642 pv6006 ap=184 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=184) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=183) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.778 INFO:teuthology.orchestra.run.smithi045.stdout: -9291> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5640 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:20:59.778 INFO:teuthology.orchestra.run.smithi045.stdout: -9290> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5641 cv=5559/5559 REP dir_auth=0 ap=183+184 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5641 2023-10-03T19:20:59.778 INFO:teuthology.orchestra.run.smithi045.stdout: -9289> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000526) pop_and_dirty_projected_inode v5636 2023-10-03T19:20:59.778 INFO:teuthology.orchestra.run.smithi045.stdout: -9288> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000526) mark_dirty [inode 0x10000000526 [2,head] /dc-dir/dc-file_817 auth v5636 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.103458+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6c4b00] 2023-10-03T19:20:59.778 INFO:teuthology.orchestra.run.smithi045.stdout: -9287> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_817) mark_dirty [dentry #0x1/dc-dir/dc-file_817 [2,head] auth (dversion lock) pv=5636 v=4030 ino=0x10000000526 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6c2500] 2023-10-03T19:20:59.778 INFO:teuthology.orchestra.run.smithi045.stdout: -9286> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5635 cv=5553/5553 ap=184+183 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=42 | child=1 dirty=1 authpin=1 0x55576d056400] version 5635 2023-10-03T19:20:59.778 INFO:teuthology.orchestra.run.smithi045.stdout: -9285> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d697c40 v5643 2023-10-03T19:20:59.778 INFO:teuthology.orchestra.run.smithi045.stdout: -9284> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5643 cv=5559/5559 REP dir_auth=0 ap=183+184 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5643 2023-10-03T19:20:59.778 INFO:teuthology.orchestra.run.smithi045.stdout: -9283> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d697b20 v5637 2023-10-03T19:20:59.778 INFO:teuthology.orchestra.run.smithi045.stdout: -9282> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5637 cv=5553/5553 ap=184+183 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=42 | child=1 dirty=1 authpin=1 0x55576d056400] version 5637 2023-10-03T19:20:59.779 INFO:teuthology.orchestra.run.smithi045.stdout: -9281> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=183 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=183 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:20:59.779 INFO:teuthology.orchestra.run.smithi045.stdout: -9280> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=183) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5642 pv6006 ap=184 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=184) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=183) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.779 INFO:teuthology.orchestra.run.smithi045.stdout: -9279> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=184) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5642 pv6006 ap=184 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=184) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=182) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.779 INFO:teuthology.orchestra.run.smithi045.stdout: -9278> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000526 [2,head] /dc-dir/dc-file_817 auth v5636 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.103458+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c4b00] 2023-10-03T19:20:59.779 INFO:teuthology.orchestra.run.smithi045.stdout: -9277> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000526 [2,head] /dc-dir/dc-file_817 auth v5636 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.103458+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c4b00] 2023-10-03T19:20:59.779 INFO:teuthology.orchestra.run.smithi045.stdout: -9276> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:20:59.779 INFO:teuthology.orchestra.run.smithi045.stdout: -9275> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:20:59.779 INFO:teuthology.orchestra.run.smithi045.stdout: -9274> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:20:59.779 INFO:teuthology.orchestra.run.smithi045.stdout: -9273> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000526 [2,head] /dc-dir/dc-file_817 auth v5636 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.103458+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c4b00] 2023-10-03T19:20:59.779 INFO:teuthology.orchestra.run.smithi045.stdout: -9272> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000526 [2,head] /dc-dir/dc-file_817 auth v5636 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.103458+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c4b00] 2023-10-03T19:20:59.780 INFO:teuthology.orchestra.run.smithi045.stdout: -9271> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:20:59.780 INFO:teuthology.orchestra.run.smithi045.stdout: -9270> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 232.041, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.32e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:467.1] 2023-10-03T19:20:59.780 INFO:teuthology.orchestra.run.smithi045.stdout: -9269> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d547b00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5642 pv6006 ap=183 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=183) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=182) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 183 2023-10-03T19:20:59.780 INFO:teuthology.orchestra.run.smithi045.stdout: -9268> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5643 cv=5559/5559 REP dir_auth=0 ap=183+183 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d547b00 count now 183/183 2023-10-03T19:20:59.780 INFO:teuthology.orchestra.run.smithi045.stdout: -9267> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d547b00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5637 cv=5553/5553 ap=183+183 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=42 | child=1 dirty=1 authpin=1 0x55576d056400] count now 183 2023-10-03T19:20:59.780 INFO:teuthology.orchestra.run.smithi045.stdout: -9266> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d547b00 on [dir 0x1 / [2,head] auth pv=6007 v=5643 cv=5559/5559 REP dir_auth=0 ap=182+183 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 182 2023-10-03T19:20:59.780 INFO:teuthology.orchestra.run.smithi045.stdout: -9265> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000526) auth_unpin by 0x55576d547b00 on [inode 0x10000000526 [2,head] /dc-dir/dc-file_817 auth v5636 s=3 n(v0 rc2023-10-03T19:16:11.103458+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6c4b00] now 0 2023-10-03T19:20:59.780 INFO:teuthology.orchestra.run.smithi045.stdout: -9264> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5637 cv=5553/5553 ap=183+182 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=42 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d547b00 count now 183/182 2023-10-03T19:20:59.780 INFO:teuthology.orchestra.run.smithi045.stdout: -9263> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.780 INFO:teuthology.orchestra.run.smithi045.stdout: -9262> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.780 INFO:teuthology.orchestra.run.smithi045.stdout: -9261> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000527 [2,head] /dc-dir/dc-file_818 auth v4034 pv5638 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.114989+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.114989+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6c5080] 2023-10-03T19:20:59.780 INFO:teuthology.orchestra.run.smithi045.stdout: -9260> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5644 2023-10-03T19:20:59.780 INFO:teuthology.orchestra.run.smithi045.stdout: -9259> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5644 pv6006 ap=183 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=183) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=182) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.781 INFO:teuthology.orchestra.run.smithi045.stdout: -9258> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5642 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:20:59.791 INFO:teuthology.orchestra.run.smithi045.stdout: -9257> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5643 cv=5559/5559 REP dir_auth=0 ap=182+183 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5643 2023-10-03T19:20:59.791 INFO:teuthology.orchestra.run.smithi045.stdout: -9256> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000527) pop_and_dirty_projected_inode v5638 2023-10-03T19:20:59.791 INFO:teuthology.orchestra.run.smithi045.stdout: -9255> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000527) mark_dirty [inode 0x10000000527 [2,head] /dc-dir/dc-file_818 auth v5638 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.114989+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6c5080] 2023-10-03T19:20:59.791 INFO:teuthology.orchestra.run.smithi045.stdout: -9254> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_818) mark_dirty [dentry #0x1/dc-dir/dc-file_818 [2,head] auth (dversion lock) pv=5638 v=4034 ino=0x10000000527 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6c2780] 2023-10-03T19:20:59.791 INFO:teuthology.orchestra.run.smithi045.stdout: -9253> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5637 cv=5553/5553 ap=183+182 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=43 | child=1 dirty=1 authpin=1 0x55576d056400] version 5637 2023-10-03T19:20:59.791 INFO:teuthology.orchestra.run.smithi045.stdout: -9252> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d697a00 v5645 2023-10-03T19:20:59.792 INFO:teuthology.orchestra.run.smithi045.stdout: -9251> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5645 cv=5559/5559 REP dir_auth=0 ap=182+183 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5645 2023-10-03T19:20:59.792 INFO:teuthology.orchestra.run.smithi045.stdout: -9250> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d6978e0 v5639 2023-10-03T19:20:59.792 INFO:teuthology.orchestra.run.smithi045.stdout: -9249> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5639 cv=5553/5553 ap=183+182 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=43 | child=1 dirty=1 authpin=1 0x55576d056400] version 5639 2023-10-03T19:20:59.792 INFO:teuthology.orchestra.run.smithi045.stdout: -9248> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=182 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=182 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:20:59.792 INFO:teuthology.orchestra.run.smithi045.stdout: -9247> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=182) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5644 pv6006 ap=183 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=183) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=182) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.792 INFO:teuthology.orchestra.run.smithi045.stdout: -9246> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=183) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5644 pv6006 ap=183 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=183) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=181) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.792 INFO:teuthology.orchestra.run.smithi045.stdout: -9245> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000527 [2,head] /dc-dir/dc-file_818 auth v5638 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.114989+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c5080] 2023-10-03T19:20:59.792 INFO:teuthology.orchestra.run.smithi045.stdout: -9244> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000527 [2,head] /dc-dir/dc-file_818 auth v5638 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.114989+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c5080] 2023-10-03T19:20:59.792 INFO:teuthology.orchestra.run.smithi045.stdout: -9243> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:20:59.792 INFO:teuthology.orchestra.run.smithi045.stdout: -9242> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:20:59.792 INFO:teuthology.orchestra.run.smithi045.stdout: -9241> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:20:59.793 INFO:teuthology.orchestra.run.smithi045.stdout: -9240> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000527 [2,head] /dc-dir/dc-file_818 auth v5638 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.114989+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c5080] 2023-10-03T19:20:59.793 INFO:teuthology.orchestra.run.smithi045.stdout: -9239> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000527 [2,head] /dc-dir/dc-file_818 auth v5638 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.114989+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c5080] 2023-10-03T19:20:59.793 INFO:teuthology.orchestra.run.smithi045.stdout: -9238> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:20:59.793 INFO:teuthology.orchestra.run.smithi045.stdout: -9237> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 233.041, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.33e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:469.1] 2023-10-03T19:20:59.793 INFO:teuthology.orchestra.run.smithi045.stdout: -9236> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2aad80 on [dir 0x1 / [2,head] auth pv=6007 v=5645 cv=5559/5559 REP dir_auth=0 ap=181+183 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 181 2023-10-03T19:20:59.793 INFO:teuthology.orchestra.run.smithi045.stdout: -9235> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2aad80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5644 pv6006 ap=182 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=182) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=181) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 182 2023-10-03T19:20:59.793 INFO:teuthology.orchestra.run.smithi045.stdout: -9234> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5645 cv=5559/5559 REP dir_auth=0 ap=181+182 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2aad80 count now 181/182 2023-10-03T19:20:59.793 INFO:teuthology.orchestra.run.smithi045.stdout: -9233> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2aad80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5639 cv=5553/5553 ap=182+182 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=43 | child=1 dirty=1 authpin=1 0x55576d056400] count now 182 2023-10-03T19:20:59.793 INFO:teuthology.orchestra.run.smithi045.stdout: -9232> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000527) auth_unpin by 0x55576d2aad80 on [inode 0x10000000527 [2,head] /dc-dir/dc-file_818 auth v5638 s=3 n(v0 rc2023-10-03T19:16:11.114989+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6c5080] now 0 2023-10-03T19:20:59.793 INFO:teuthology.orchestra.run.smithi045.stdout: -9231> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5639 cv=5553/5553 ap=182+181 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=43 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2aad80 count now 182/181 2023-10-03T19:20:59.794 INFO:teuthology.orchestra.run.smithi045.stdout: -9230> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.794 INFO:teuthology.orchestra.run.smithi045.stdout: -9229> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.794 INFO:teuthology.orchestra.run.smithi045.stdout: -9228> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000528 [2,head] /dc-dir/dc-file_819 auth v4038 pv5640 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.126112+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.126112+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6c5600] 2023-10-03T19:20:59.794 INFO:teuthology.orchestra.run.smithi045.stdout: -9227> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5646 2023-10-03T19:20:59.794 INFO:teuthology.orchestra.run.smithi045.stdout: -9226> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5646 pv6006 ap=182 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=182) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=181) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.794 INFO:teuthology.orchestra.run.smithi045.stdout: -9225> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5644 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:20:59.794 INFO:teuthology.orchestra.run.smithi045.stdout: -9224> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5645 cv=5559/5559 REP dir_auth=0 ap=181+182 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5645 2023-10-03T19:20:59.794 INFO:teuthology.orchestra.run.smithi045.stdout: -9223> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000528) pop_and_dirty_projected_inode v5640 2023-10-03T19:20:59.794 INFO:teuthology.orchestra.run.smithi045.stdout: -9222> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000528) mark_dirty [inode 0x10000000528 [2,head] /dc-dir/dc-file_819 auth v5640 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.126112+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6c5600] 2023-10-03T19:20:59.794 INFO:teuthology.orchestra.run.smithi045.stdout: -9221> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_819) mark_dirty [dentry #0x1/dc-dir/dc-file_819 [2,head] auth (dversion lock) pv=5640 v=4038 ino=0x10000000528 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6c2a00] 2023-10-03T19:20:59.794 INFO:teuthology.orchestra.run.smithi045.stdout: -9220> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5639 cv=5553/5553 ap=182+181 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=44 | child=1 dirty=1 authpin=1 0x55576d056400] version 5639 2023-10-03T19:20:59.795 INFO:teuthology.orchestra.run.smithi045.stdout: -9219> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d6977c0 v5647 2023-10-03T19:20:59.795 INFO:teuthology.orchestra.run.smithi045.stdout: -9218> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5647 cv=5559/5559 REP dir_auth=0 ap=181+182 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5647 2023-10-03T19:20:59.795 INFO:teuthology.orchestra.run.smithi045.stdout: -9217> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d6976a0 v5641 2023-10-03T19:20:59.795 INFO:teuthology.orchestra.run.smithi045.stdout: -9216> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5641 cv=5553/5553 ap=182+181 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=44 | child=1 dirty=1 authpin=1 0x55576d056400] version 5641 2023-10-03T19:20:59.795 INFO:teuthology.orchestra.run.smithi045.stdout: -9215> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=181 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=181 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:20:59.795 INFO:teuthology.orchestra.run.smithi045.stdout: -9214> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=181) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5646 pv6006 ap=182 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=182) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=181) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.795 INFO:teuthology.orchestra.run.smithi045.stdout: -9213> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=182) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5646 pv6006 ap=182 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=182) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=180) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.795 INFO:teuthology.orchestra.run.smithi045.stdout: -9212> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000528 [2,head] /dc-dir/dc-file_819 auth v5640 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.126112+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c5600] 2023-10-03T19:20:59.795 INFO:teuthology.orchestra.run.smithi045.stdout: -9211> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000528 [2,head] /dc-dir/dc-file_819 auth v5640 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.126112+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c5600] 2023-10-03T19:20:59.887 INFO:teuthology.orchestra.run.smithi045.stdout: -9210> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:20:59.887 INFO:teuthology.orchestra.run.smithi045.stdout: -9209> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:20:59.887 INFO:teuthology.orchestra.run.smithi045.stdout: -9208> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:20:59.887 INFO:teuthology.orchestra.run.smithi045.stdout: -9207> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000528 [2,head] /dc-dir/dc-file_819 auth v5640 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.126112+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c5600] 2023-10-03T19:20:59.887 INFO:teuthology.orchestra.run.smithi045.stdout: -9206> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000528 [2,head] /dc-dir/dc-file_819 auth v5640 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.126112+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c5600] 2023-10-03T19:20:59.887 INFO:teuthology.orchestra.run.smithi045.stdout: -9205> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:20:59.887 INFO:teuthology.orchestra.run.smithi045.stdout: -9204> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 234.041, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.34e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:471.1] 2023-10-03T19:20:59.887 INFO:teuthology.orchestra.run.smithi045.stdout: -9203> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2a4d80 on [dir 0x1 / [2,head] auth pv=6007 v=5647 cv=5559/5559 REP dir_auth=0 ap=180+182 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 180 2023-10-03T19:20:59.887 INFO:teuthology.orchestra.run.smithi045.stdout: -9202> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2a4d80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5646 pv6006 ap=181 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=181) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=180) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 181 2023-10-03T19:20:59.888 INFO:teuthology.orchestra.run.smithi045.stdout: -9201> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5647 cv=5559/5559 REP dir_auth=0 ap=180+181 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2a4d80 count now 180/181 2023-10-03T19:20:59.888 INFO:teuthology.orchestra.run.smithi045.stdout: -9200> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2a4d80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5641 cv=5553/5553 ap=181+181 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=44 | child=1 dirty=1 authpin=1 0x55576d056400] count now 181 2023-10-03T19:20:59.888 INFO:teuthology.orchestra.run.smithi045.stdout: -9199> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000528) auth_unpin by 0x55576d2a4d80 on [inode 0x10000000528 [2,head] /dc-dir/dc-file_819 auth v5640 s=3 n(v0 rc2023-10-03T19:16:11.126112+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6c5600] now 0 2023-10-03T19:20:59.888 INFO:teuthology.orchestra.run.smithi045.stdout: -9198> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5641 cv=5553/5553 ap=181+180 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=44 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2a4d80 count now 181/180 2023-10-03T19:20:59.888 INFO:teuthology.orchestra.run.smithi045.stdout: -9197> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.888 INFO:teuthology.orchestra.run.smithi045.stdout: -9196> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.888 INFO:teuthology.orchestra.run.smithi045.stdout: -9195> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000529 [2,head] /dc-dir/dc-file_820 auth v4042 pv5642 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.138416+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.138416+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6c5b80] 2023-10-03T19:20:59.888 INFO:teuthology.orchestra.run.smithi045.stdout: -9194> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5648 2023-10-03T19:20:59.888 INFO:teuthology.orchestra.run.smithi045.stdout: -9193> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5648 pv6006 ap=181 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=181) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=180) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.888 INFO:teuthology.orchestra.run.smithi045.stdout: -9192> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5646 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:20:59.889 INFO:teuthology.orchestra.run.smithi045.stdout: -9191> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5647 cv=5559/5559 REP dir_auth=0 ap=180+181 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5647 2023-10-03T19:20:59.889 INFO:teuthology.orchestra.run.smithi045.stdout: -9190> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000529) pop_and_dirty_projected_inode v5642 2023-10-03T19:20:59.889 INFO:teuthology.orchestra.run.smithi045.stdout: -9189> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000529) mark_dirty [inode 0x10000000529 [2,head] /dc-dir/dc-file_820 auth v5642 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.138416+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6c5b80] 2023-10-03T19:20:59.889 INFO:teuthology.orchestra.run.smithi045.stdout: -9188> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_820) mark_dirty [dentry #0x1/dc-dir/dc-file_820 [2,head] auth (dversion lock) pv=5642 v=4042 ino=0x10000000529 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6c2c80] 2023-10-03T19:20:59.889 INFO:teuthology.orchestra.run.smithi045.stdout: -9187> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5641 cv=5553/5553 ap=181+180 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=45 | child=1 dirty=1 authpin=1 0x55576d056400] version 5641 2023-10-03T19:20:59.889 INFO:teuthology.orchestra.run.smithi045.stdout: -9186> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d697580 v5649 2023-10-03T19:20:59.889 INFO:teuthology.orchestra.run.smithi045.stdout: -9185> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5649 cv=5559/5559 REP dir_auth=0 ap=180+181 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5649 2023-10-03T19:20:59.889 INFO:teuthology.orchestra.run.smithi045.stdout: -9184> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d697460 v5643 2023-10-03T19:20:59.889 INFO:teuthology.orchestra.run.smithi045.stdout: -9183> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5643 cv=5553/5553 ap=181+180 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=45 | child=1 dirty=1 authpin=1 0x55576d056400] version 5643 2023-10-03T19:20:59.889 INFO:teuthology.orchestra.run.smithi045.stdout: -9182> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=180 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=180 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:20:59.890 INFO:teuthology.orchestra.run.smithi045.stdout: -9181> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=180) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5648 pv6006 ap=181 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=181) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=180) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.890 INFO:teuthology.orchestra.run.smithi045.stdout: -9180> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=181) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5648 pv6006 ap=181 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=181) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=179) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.890 INFO:teuthology.orchestra.run.smithi045.stdout: -9179> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000529 [2,head] /dc-dir/dc-file_820 auth v5642 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.138416+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c5b80] 2023-10-03T19:20:59.890 INFO:teuthology.orchestra.run.smithi045.stdout: -9178> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000529 [2,head] /dc-dir/dc-file_820 auth v5642 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.138416+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c5b80] 2023-10-03T19:20:59.890 INFO:teuthology.orchestra.run.smithi045.stdout: -9177> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:20:59.890 INFO:teuthology.orchestra.run.smithi045.stdout: -9176> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:20:59.890 INFO:teuthology.orchestra.run.smithi045.stdout: -9175> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:20:59.890 INFO:teuthology.orchestra.run.smithi045.stdout: -9174> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000529 [2,head] /dc-dir/dc-file_820 auth v5642 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.138416+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c5b80] 2023-10-03T19:20:59.890 INFO:teuthology.orchestra.run.smithi045.stdout: -9173> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000529 [2,head] /dc-dir/dc-file_820 auth v5642 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.138416+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c5b80] 2023-10-03T19:20:59.890 INFO:teuthology.orchestra.run.smithi045.stdout: -9172> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:20:59.890 INFO:teuthology.orchestra.run.smithi045.stdout: -9171> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 235.041, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.35e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:473.1] 2023-10-03T19:20:59.890 INFO:teuthology.orchestra.run.smithi045.stdout: -9170> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d5ca000 on [dir 0x1 / [2,head] auth pv=6007 v=5649 cv=5559/5559 REP dir_auth=0 ap=179+181 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 179 2023-10-03T19:20:59.890 INFO:teuthology.orchestra.run.smithi045.stdout: -9169> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d5ca000 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5648 pv6006 ap=180 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=180) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=179) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 180 2023-10-03T19:20:59.891 INFO:teuthology.orchestra.run.smithi045.stdout: -9168> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5649 cv=5559/5559 REP dir_auth=0 ap=179+180 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d5ca000 count now 179/180 2023-10-03T19:20:59.891 INFO:teuthology.orchestra.run.smithi045.stdout: -9167> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d5ca000 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5643 cv=5553/5553 ap=180+180 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=45 | child=1 dirty=1 authpin=1 0x55576d056400] count now 180 2023-10-03T19:20:59.891 INFO:teuthology.orchestra.run.smithi045.stdout: -9166> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000529) auth_unpin by 0x55576d5ca000 on [inode 0x10000000529 [2,head] /dc-dir/dc-file_820 auth v5642 s=3 n(v0 rc2023-10-03T19:16:11.138416+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6c5b80] now 0 2023-10-03T19:20:59.891 INFO:teuthology.orchestra.run.smithi045.stdout: -9165> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5643 cv=5553/5553 ap=180+179 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=45 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d5ca000 count now 180/179 2023-10-03T19:20:59.897 INFO:teuthology.orchestra.run.smithi045.stdout: -9164> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.897 INFO:teuthology.orchestra.run.smithi045.stdout: -9163> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.897 INFO:teuthology.orchestra.run.smithi045.stdout: -9162> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000052a [2,head] /dc-dir/dc-file_821 auth v4046 pv5644 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.152448+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.152448+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6c6100] 2023-10-03T19:20:59.897 INFO:teuthology.orchestra.run.smithi045.stdout: -9161> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5650 2023-10-03T19:20:59.897 INFO:teuthology.orchestra.run.smithi045.stdout: -9160> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5650 pv6006 ap=180 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=180) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=179) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.897 INFO:teuthology.orchestra.run.smithi045.stdout: -9159> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5648 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:20:59.898 INFO:teuthology.orchestra.run.smithi045.stdout: -9158> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5649 cv=5559/5559 REP dir_auth=0 ap=179+180 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5649 2023-10-03T19:20:59.898 INFO:teuthology.orchestra.run.smithi045.stdout: -9157> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000052a) pop_and_dirty_projected_inode v5644 2023-10-03T19:20:59.898 INFO:teuthology.orchestra.run.smithi045.stdout: -9156> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000052a) mark_dirty [inode 0x1000000052a [2,head] /dc-dir/dc-file_821 auth v5644 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.152448+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6c6100] 2023-10-03T19:20:59.898 INFO:teuthology.orchestra.run.smithi045.stdout: -9155> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_821) mark_dirty [dentry #0x1/dc-dir/dc-file_821 [2,head] auth (dversion lock) pv=5644 v=4046 ino=0x1000000052a state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6c2f00] 2023-10-03T19:20:59.898 INFO:teuthology.orchestra.run.smithi045.stdout: -9154> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5643 cv=5553/5553 ap=180+179 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=46 | child=1 dirty=1 authpin=1 0x55576d056400] version 5643 2023-10-03T19:20:59.898 INFO:teuthology.orchestra.run.smithi045.stdout: -9153> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d697340 v5651 2023-10-03T19:20:59.898 INFO:teuthology.orchestra.run.smithi045.stdout: -9152> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5651 cv=5559/5559 REP dir_auth=0 ap=179+180 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5651 2023-10-03T19:20:59.898 INFO:teuthology.orchestra.run.smithi045.stdout: -9151> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d697220 v5645 2023-10-03T19:20:59.898 INFO:teuthology.orchestra.run.smithi045.stdout: -9150> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5645 cv=5553/5553 ap=180+179 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=46 | child=1 dirty=1 authpin=1 0x55576d056400] version 5645 2023-10-03T19:20:59.898 INFO:teuthology.orchestra.run.smithi045.stdout: -9149> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=179 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=179 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:20:59.898 INFO:teuthology.orchestra.run.smithi045.stdout: -9148> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=179) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5650 pv6006 ap=180 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=180) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=179) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.899 INFO:teuthology.orchestra.run.smithi045.stdout: -9147> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=180) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5650 pv6006 ap=180 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=180) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=178) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.899 INFO:teuthology.orchestra.run.smithi045.stdout: -9146> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000052a [2,head] /dc-dir/dc-file_821 auth v5644 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.152448+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c6100] 2023-10-03T19:20:59.899 INFO:teuthology.orchestra.run.smithi045.stdout: -9145> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000052a [2,head] /dc-dir/dc-file_821 auth v5644 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.152448+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c6100] 2023-10-03T19:20:59.899 INFO:teuthology.orchestra.run.smithi045.stdout: -9144> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:20:59.899 INFO:teuthology.orchestra.run.smithi045.stdout: -9143> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:20:59.899 INFO:teuthology.orchestra.run.smithi045.stdout: -9142> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:20:59.899 INFO:teuthology.orchestra.run.smithi045.stdout: -9141> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000052a [2,head] /dc-dir/dc-file_821 auth v5644 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.152448+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c6100] 2023-10-03T19:20:59.899 INFO:teuthology.orchestra.run.smithi045.stdout: -9140> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000052a [2,head] /dc-dir/dc-file_821 auth v5644 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.152448+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c6100] 2023-10-03T19:20:59.899 INFO:teuthology.orchestra.run.smithi045.stdout: -9139> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:20:59.899 INFO:teuthology.orchestra.run.smithi045.stdout: -9138> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 236.041, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.36e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:475.1] 2023-10-03T19:20:59.899 INFO:teuthology.orchestra.run.smithi045.stdout: -9137> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d52ed80 on [dir 0x1 / [2,head] auth pv=6007 v=5651 cv=5559/5559 REP dir_auth=0 ap=178+180 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 178 2023-10-03T19:20:59.900 INFO:teuthology.orchestra.run.smithi045.stdout: -9136> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d52ed80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5650 pv6006 ap=179 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=179) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=178) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 179 2023-10-03T19:20:59.900 INFO:teuthology.orchestra.run.smithi045.stdout: -9135> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5651 cv=5559/5559 REP dir_auth=0 ap=178+179 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d52ed80 count now 178/179 2023-10-03T19:20:59.900 INFO:teuthology.orchestra.run.smithi045.stdout: -9134> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d52ed80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5645 cv=5553/5553 ap=179+179 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=46 | child=1 dirty=1 authpin=1 0x55576d056400] count now 179 2023-10-03T19:20:59.900 INFO:teuthology.orchestra.run.smithi045.stdout: -9133> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000052a) auth_unpin by 0x55576d52ed80 on [inode 0x1000000052a [2,head] /dc-dir/dc-file_821 auth v5644 s=3 n(v0 rc2023-10-03T19:16:11.152448+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6c6100] now 0 2023-10-03T19:20:59.900 INFO:teuthology.orchestra.run.smithi045.stdout: -9132> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5645 cv=5553/5553 ap=179+178 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=46 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d52ed80 count now 179/178 2023-10-03T19:20:59.900 INFO:teuthology.orchestra.run.smithi045.stdout: -9131> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.900 INFO:teuthology.orchestra.run.smithi045.stdout: -9130> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.900 INFO:teuthology.orchestra.run.smithi045.stdout: -9129> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000052b [2,head] /dc-dir/dc-file_822 auth v4050 pv5646 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.166160+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.166160+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6c6680] 2023-10-03T19:20:59.900 INFO:teuthology.orchestra.run.smithi045.stdout: -9128> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5652 2023-10-03T19:20:59.900 INFO:teuthology.orchestra.run.smithi045.stdout: -9127> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5652 pv6006 ap=179 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=179) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=178) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.900 INFO:teuthology.orchestra.run.smithi045.stdout: -9126> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5650 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:20:59.901 INFO:teuthology.orchestra.run.smithi045.stdout: -9125> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5651 cv=5559/5559 REP dir_auth=0 ap=178+179 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5651 2023-10-03T19:20:59.901 INFO:teuthology.orchestra.run.smithi045.stdout: -9124> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000052b) pop_and_dirty_projected_inode v5646 2023-10-03T19:20:59.931 INFO:teuthology.orchestra.run.smithi045.stdout: -9123> 2023-10-03T19:16:28.770+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000052b) mark_dirty [inode 0x1000000052b [2,head] /dc-dir/dc-file_822 auth v5646 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.166160+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6c6680] 2023-10-03T19:20:59.931 INFO:teuthology.orchestra.run.smithi045.stdout: -9122> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_822) mark_dirty [dentry #0x1/dc-dir/dc-file_822 [2,head] auth (dversion lock) pv=5646 v=4050 ino=0x1000000052b state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6c3180] 2023-10-03T19:20:59.931 INFO:teuthology.orchestra.run.smithi045.stdout: -9121> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5645 cv=5553/5553 ap=179+178 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=47 | child=1 dirty=1 authpin=1 0x55576d056400] version 5645 2023-10-03T19:20:59.931 INFO:teuthology.orchestra.run.smithi045.stdout: -9120> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d697100 v5653 2023-10-03T19:20:59.932 INFO:teuthology.orchestra.run.smithi045.stdout: -9119> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5653 cv=5559/5559 REP dir_auth=0 ap=178+179 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5653 2023-10-03T19:20:59.932 INFO:teuthology.orchestra.run.smithi045.stdout: -9118> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d696fe0 v5647 2023-10-03T19:20:59.932 INFO:teuthology.orchestra.run.smithi045.stdout: -9117> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5647 cv=5553/5553 ap=179+178 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=47 | child=1 dirty=1 authpin=1 0x55576d056400] version 5647 2023-10-03T19:20:59.932 INFO:teuthology.orchestra.run.smithi045.stdout: -9116> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=178 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=178 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:20:59.932 INFO:teuthology.orchestra.run.smithi045.stdout: -9115> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=178) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5652 pv6006 ap=179 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=179) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=178) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.932 INFO:teuthology.orchestra.run.smithi045.stdout: -9114> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=179) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5652 pv6006 ap=179 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=179) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=177) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.932 INFO:teuthology.orchestra.run.smithi045.stdout: -9113> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000052b [2,head] /dc-dir/dc-file_822 auth v5646 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.166160+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c6680] 2023-10-03T19:20:59.932 INFO:teuthology.orchestra.run.smithi045.stdout: -9112> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000052b [2,head] /dc-dir/dc-file_822 auth v5646 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.166160+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c6680] 2023-10-03T19:20:59.932 INFO:teuthology.orchestra.run.smithi045.stdout: -9111> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:20:59.932 INFO:teuthology.orchestra.run.smithi045.stdout: -9110> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:20:59.932 INFO:teuthology.orchestra.run.smithi045.stdout: -9109> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:20:59.933 INFO:teuthology.orchestra.run.smithi045.stdout: -9108> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000052b [2,head] /dc-dir/dc-file_822 auth v5646 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.166160+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c6680] 2023-10-03T19:20:59.933 INFO:teuthology.orchestra.run.smithi045.stdout: -9107> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000052b [2,head] /dc-dir/dc-file_822 auth v5646 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.166160+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c6680] 2023-10-03T19:20:59.933 INFO:teuthology.orchestra.run.smithi045.stdout: -9106> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:20:59.933 INFO:teuthology.orchestra.run.smithi045.stdout: -9105> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 236.91, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.37e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:476.8] 2023-10-03T19:20:59.933 INFO:teuthology.orchestra.run.smithi045.stdout: -9104> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d52fd40 on [dir 0x1 / [2,head] auth pv=6007 v=5653 cv=5559/5559 REP dir_auth=0 ap=177+179 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 177 2023-10-03T19:20:59.933 INFO:teuthology.orchestra.run.smithi045.stdout: -9103> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d52fd40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5652 pv6006 ap=178 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=178) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=177) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 178 2023-10-03T19:20:59.933 INFO:teuthology.orchestra.run.smithi045.stdout: -9102> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5653 cv=5559/5559 REP dir_auth=0 ap=177+178 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d52fd40 count now 177/178 2023-10-03T19:20:59.933 INFO:teuthology.orchestra.run.smithi045.stdout: -9101> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d52fd40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5647 cv=5553/5553 ap=178+178 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=47 | child=1 dirty=1 authpin=1 0x55576d056400] count now 178 2023-10-03T19:20:59.933 INFO:teuthology.orchestra.run.smithi045.stdout: -9100> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000052b) auth_unpin by 0x55576d52fd40 on [inode 0x1000000052b [2,head] /dc-dir/dc-file_822 auth v5646 s=3 n(v0 rc2023-10-03T19:16:11.166160+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6c6680] now 0 2023-10-03T19:20:59.933 INFO:teuthology.orchestra.run.smithi045.stdout: -9099> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5647 cv=5553/5553 ap=178+177 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=47 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d52fd40 count now 178/177 2023-10-03T19:20:59.933 INFO:teuthology.orchestra.run.smithi045.stdout: -9098> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.934 INFO:teuthology.orchestra.run.smithi045.stdout: -9097> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.934 INFO:teuthology.orchestra.run.smithi045.stdout: -9096> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000052c [2,head] /dc-dir/dc-file_823 auth v4054 pv5648 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.181422+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.181422+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6c6c00] 2023-10-03T19:20:59.934 INFO:teuthology.orchestra.run.smithi045.stdout: -9095> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5654 2023-10-03T19:20:59.934 INFO:teuthology.orchestra.run.smithi045.stdout: -9094> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5654 pv6006 ap=178 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=178) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=177) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.934 INFO:teuthology.orchestra.run.smithi045.stdout: -9093> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5652 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:20:59.934 INFO:teuthology.orchestra.run.smithi045.stdout: -9092> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5653 cv=5559/5559 REP dir_auth=0 ap=177+178 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5653 2023-10-03T19:20:59.934 INFO:teuthology.orchestra.run.smithi045.stdout: -9091> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000052c) pop_and_dirty_projected_inode v5648 2023-10-03T19:20:59.934 INFO:teuthology.orchestra.run.smithi045.stdout: -9090> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000052c) mark_dirty [inode 0x1000000052c [2,head] /dc-dir/dc-file_823 auth v5648 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.181422+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6c6c00] 2023-10-03T19:20:59.934 INFO:teuthology.orchestra.run.smithi045.stdout: -9089> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_823) mark_dirty [dentry #0x1/dc-dir/dc-file_823 [2,head] auth (dversion lock) pv=5648 v=4054 ino=0x1000000052c state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6c3400] 2023-10-03T19:20:59.934 INFO:teuthology.orchestra.run.smithi045.stdout: -9088> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5647 cv=5553/5553 ap=178+177 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=48 | child=1 dirty=1 authpin=1 0x55576d056400] version 5647 2023-10-03T19:20:59.934 INFO:teuthology.orchestra.run.smithi045.stdout: -9087> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d696ec0 v5655 2023-10-03T19:20:59.934 INFO:teuthology.orchestra.run.smithi045.stdout: -9086> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5655 cv=5559/5559 REP dir_auth=0 ap=177+178 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5655 2023-10-03T19:20:59.935 INFO:teuthology.orchestra.run.smithi045.stdout: -9085> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d696da0 v5649 2023-10-03T19:20:59.935 INFO:teuthology.orchestra.run.smithi045.stdout: -9084> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5649 cv=5553/5553 ap=178+177 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=48 | child=1 dirty=1 authpin=1 0x55576d056400] version 5649 2023-10-03T19:20:59.935 INFO:teuthology.orchestra.run.smithi045.stdout: -9083> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=177 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=177 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:20:59.935 INFO:teuthology.orchestra.run.smithi045.stdout: -9082> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=177) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5654 pv6006 ap=178 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=178) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=177) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.946 INFO:teuthology.orchestra.run.smithi045.stdout: -9081> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=178) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5654 pv6006 ap=178 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=178) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=176) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.947 INFO:teuthology.orchestra.run.smithi045.stdout: -9080> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000052c [2,head] /dc-dir/dc-file_823 auth v5648 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.181422+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c6c00] 2023-10-03T19:20:59.947 INFO:teuthology.orchestra.run.smithi045.stdout: -9079> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000052c [2,head] /dc-dir/dc-file_823 auth v5648 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.181422+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c6c00] 2023-10-03T19:20:59.947 INFO:teuthology.orchestra.run.smithi045.stdout: -9078> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:20:59.947 INFO:teuthology.orchestra.run.smithi045.stdout: -9077> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:20:59.947 INFO:teuthology.orchestra.run.smithi045.stdout: -9076> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:20:59.947 INFO:teuthology.orchestra.run.smithi045.stdout: -9075> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000052c [2,head] /dc-dir/dc-file_823 auth v5648 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.181422+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c6c00] 2023-10-03T19:20:59.947 INFO:teuthology.orchestra.run.smithi045.stdout: -9074> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000052c [2,head] /dc-dir/dc-file_823 auth v5648 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.181422+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c6c00] 2023-10-03T19:20:59.947 INFO:teuthology.orchestra.run.smithi045.stdout: -9073> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:20:59.948 INFO:teuthology.orchestra.run.smithi045.stdout: -9072> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 237.91, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.38e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:478.8] 2023-10-03T19:20:59.948 INFO:teuthology.orchestra.run.smithi045.stdout: -9071> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d5c7680 on [dir 0x1 / [2,head] auth pv=6007 v=5655 cv=5559/5559 REP dir_auth=0 ap=176+178 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 176 2023-10-03T19:20:59.948 INFO:teuthology.orchestra.run.smithi045.stdout: -9070> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d5c7680 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5654 pv6006 ap=177 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=177) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=176) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 177 2023-10-03T19:20:59.948 INFO:teuthology.orchestra.run.smithi045.stdout: -9069> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5655 cv=5559/5559 REP dir_auth=0 ap=176+177 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d5c7680 count now 176/177 2023-10-03T19:20:59.948 INFO:teuthology.orchestra.run.smithi045.stdout: -9068> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d5c7680 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5649 cv=5553/5553 ap=177+177 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=48 | child=1 dirty=1 authpin=1 0x55576d056400] count now 177 2023-10-03T19:20:59.948 INFO:teuthology.orchestra.run.smithi045.stdout: -9067> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000052c) auth_unpin by 0x55576d5c7680 on [inode 0x1000000052c [2,head] /dc-dir/dc-file_823 auth v5648 s=3 n(v0 rc2023-10-03T19:16:11.181422+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6c6c00] now 0 2023-10-03T19:20:59.948 INFO:teuthology.orchestra.run.smithi045.stdout: -9066> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5649 cv=5553/5553 ap=177+176 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=48 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d5c7680 count now 177/176 2023-10-03T19:20:59.948 INFO:teuthology.orchestra.run.smithi045.stdout: -9065> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.948 INFO:teuthology.orchestra.run.smithi045.stdout: -9064> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:20:59.948 INFO:teuthology.orchestra.run.smithi045.stdout: -9063> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000052d [2,head] /dc-dir/dc-file_824 auth v4058 pv5650 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.196046+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.196046+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6c7180] 2023-10-03T19:20:59.948 INFO:teuthology.orchestra.run.smithi045.stdout: -9062> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5656 2023-10-03T19:20:59.949 INFO:teuthology.orchestra.run.smithi045.stdout: -9061> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5656 pv6006 ap=177 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=177) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=176) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.949 INFO:teuthology.orchestra.run.smithi045.stdout: -9060> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5654 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:20:59.949 INFO:teuthology.orchestra.run.smithi045.stdout: -9059> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5655 cv=5559/5559 REP dir_auth=0 ap=176+177 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5655 2023-10-03T19:20:59.949 INFO:teuthology.orchestra.run.smithi045.stdout: -9058> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000052d) pop_and_dirty_projected_inode v5650 2023-10-03T19:20:59.949 INFO:teuthology.orchestra.run.smithi045.stdout: -9057> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000052d) mark_dirty [inode 0x1000000052d [2,head] /dc-dir/dc-file_824 auth v5650 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.196046+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6c7180] 2023-10-03T19:20:59.949 INFO:teuthology.orchestra.run.smithi045.stdout: -9056> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_824) mark_dirty [dentry #0x1/dc-dir/dc-file_824 [2,head] auth (dversion lock) pv=5650 v=4058 ino=0x1000000052d state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6c3680] 2023-10-03T19:20:59.949 INFO:teuthology.orchestra.run.smithi045.stdout: -9055> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5649 cv=5553/5553 ap=177+176 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=49 | child=1 dirty=1 authpin=1 0x55576d056400] version 5649 2023-10-03T19:20:59.949 INFO:teuthology.orchestra.run.smithi045.stdout: -9054> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d696c80 v5657 2023-10-03T19:20:59.949 INFO:teuthology.orchestra.run.smithi045.stdout: -9053> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5657 cv=5559/5559 REP dir_auth=0 ap=176+177 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5657 2023-10-03T19:20:59.949 INFO:teuthology.orchestra.run.smithi045.stdout: -9052> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d696b60 v5651 2023-10-03T19:20:59.950 INFO:teuthology.orchestra.run.smithi045.stdout: -9051> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5651 cv=5553/5553 ap=177+176 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=49 | child=1 dirty=1 authpin=1 0x55576d056400] version 5651 2023-10-03T19:20:59.950 INFO:teuthology.orchestra.run.smithi045.stdout: -9050> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=176 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=176 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:20:59.950 INFO:teuthology.orchestra.run.smithi045.stdout: -9049> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=176) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5656 pv6006 ap=177 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=177) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=176) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.950 INFO:teuthology.orchestra.run.smithi045.stdout: -9048> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=177) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5656 pv6006 ap=177 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=177) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=175) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:20:59.950 INFO:teuthology.orchestra.run.smithi045.stdout: -9047> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000052d [2,head] /dc-dir/dc-file_824 auth v5650 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.196046+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c7180] 2023-10-03T19:20:59.950 INFO:teuthology.orchestra.run.smithi045.stdout: -9046> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000052d [2,head] /dc-dir/dc-file_824 auth v5650 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.196046+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c7180] 2023-10-03T19:20:59.950 INFO:teuthology.orchestra.run.smithi045.stdout: -9045> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:20:59.950 INFO:teuthology.orchestra.run.smithi045.stdout: -9044> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:20:59.950 INFO:teuthology.orchestra.run.smithi045.stdout: -9043> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:20:59.950 INFO:teuthology.orchestra.run.smithi045.stdout: -9042> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000052d [2,head] /dc-dir/dc-file_824 auth v5650 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.196046+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c7180] 2023-10-03T19:21:00.041 INFO:teuthology.orchestra.run.smithi045.stdout: -9041> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000052d [2,head] /dc-dir/dc-file_824 auth v5650 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.196046+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c7180] 2023-10-03T19:21:00.041 INFO:teuthology.orchestra.run.smithi045.stdout: -9040> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.041 INFO:teuthology.orchestra.run.smithi045.stdout: -9039> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 238.91, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.39e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:480.8] 2023-10-03T19:21:00.041 INFO:teuthology.orchestra.run.smithi045.stdout: -9038> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d5466c0 on [dir 0x1 / [2,head] auth pv=6007 v=5657 cv=5559/5559 REP dir_auth=0 ap=175+177 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 175 2023-10-03T19:21:00.041 INFO:teuthology.orchestra.run.smithi045.stdout: -9037> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d5466c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5656 pv6006 ap=176 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=176) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=175) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 176 2023-10-03T19:21:00.041 INFO:teuthology.orchestra.run.smithi045.stdout: -9036> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5657 cv=5559/5559 REP dir_auth=0 ap=175+176 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d5466c0 count now 175/176 2023-10-03T19:21:00.042 INFO:teuthology.orchestra.run.smithi045.stdout: -9035> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d5466c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5651 cv=5553/5553 ap=176+176 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=49 | child=1 dirty=1 authpin=1 0x55576d056400] count now 176 2023-10-03T19:21:00.042 INFO:teuthology.orchestra.run.smithi045.stdout: -9034> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000052d) auth_unpin by 0x55576d5466c0 on [inode 0x1000000052d [2,head] /dc-dir/dc-file_824 auth v5650 s=3 n(v0 rc2023-10-03T19:16:11.196046+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6c7180] now 0 2023-10-03T19:21:00.042 INFO:teuthology.orchestra.run.smithi045.stdout: -9033> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5651 cv=5553/5553 ap=176+175 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=49 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d5466c0 count now 176/175 2023-10-03T19:21:00.042 INFO:teuthology.orchestra.run.smithi045.stdout: -9032> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.042 INFO:teuthology.orchestra.run.smithi045.stdout: -9031> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.042 INFO:teuthology.orchestra.run.smithi045.stdout: -9030> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000052e [2,head] /dc-dir/dc-file_825 auth v4062 pv5652 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.207573+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.207573+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6c7700] 2023-10-03T19:21:00.042 INFO:teuthology.orchestra.run.smithi045.stdout: -9029> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5658 2023-10-03T19:21:00.042 INFO:teuthology.orchestra.run.smithi045.stdout: -9028> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5658 pv6006 ap=176 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=176) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=175) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.042 INFO:teuthology.orchestra.run.smithi045.stdout: -9027> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5656 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.043 INFO:teuthology.orchestra.run.smithi045.stdout: -9026> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5657 cv=5559/5559 REP dir_auth=0 ap=175+176 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5657 2023-10-03T19:21:00.043 INFO:teuthology.orchestra.run.smithi045.stdout: -9025> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000052e) pop_and_dirty_projected_inode v5652 2023-10-03T19:21:00.043 INFO:teuthology.orchestra.run.smithi045.stdout: -9024> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000052e) mark_dirty [inode 0x1000000052e [2,head] /dc-dir/dc-file_825 auth v5652 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.207573+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6c7700] 2023-10-03T19:21:00.043 INFO:teuthology.orchestra.run.smithi045.stdout: -9023> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_825) mark_dirty [dentry #0x1/dc-dir/dc-file_825 [2,head] auth (dversion lock) pv=5652 v=4062 ino=0x1000000052e state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6c3900] 2023-10-03T19:21:00.043 INFO:teuthology.orchestra.run.smithi045.stdout: -9022> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5651 cv=5553/5553 ap=176+175 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=50 | child=1 dirty=1 authpin=1 0x55576d056400] version 5651 2023-10-03T19:21:00.043 INFO:teuthology.orchestra.run.smithi045.stdout: -9021> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d696a40 v5659 2023-10-03T19:21:00.043 INFO:teuthology.orchestra.run.smithi045.stdout: -9020> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5659 cv=5559/5559 REP dir_auth=0 ap=175+176 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5659 2023-10-03T19:21:00.043 INFO:teuthology.orchestra.run.smithi045.stdout: -9019> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d696920 v5653 2023-10-03T19:21:00.043 INFO:teuthology.orchestra.run.smithi045.stdout: -9018> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5653 cv=5553/5553 ap=176+175 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=50 | child=1 dirty=1 authpin=1 0x55576d056400] version 5653 2023-10-03T19:21:00.043 INFO:teuthology.orchestra.run.smithi045.stdout: -9017> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=175 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=175 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.044 INFO:teuthology.orchestra.run.smithi045.stdout: -9016> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=175) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5658 pv6006 ap=176 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=176) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=175) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.044 INFO:teuthology.orchestra.run.smithi045.stdout: -9015> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=176) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5658 pv6006 ap=176 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=176) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=174) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.044 INFO:teuthology.orchestra.run.smithi045.stdout: -9014> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000052e [2,head] /dc-dir/dc-file_825 auth v5652 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.207573+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c7700] 2023-10-03T19:21:00.044 INFO:teuthology.orchestra.run.smithi045.stdout: -9013> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000052e [2,head] /dc-dir/dc-file_825 auth v5652 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.207573+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c7700] 2023-10-03T19:21:00.044 INFO:teuthology.orchestra.run.smithi045.stdout: -9012> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.044 INFO:teuthology.orchestra.run.smithi045.stdout: -9011> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.044 INFO:teuthology.orchestra.run.smithi045.stdout: -9010> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.052 INFO:teuthology.orchestra.run.smithi045.stdout: -9009> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000052e [2,head] /dc-dir/dc-file_825 auth v5652 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.207573+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c7700] 2023-10-03T19:21:00.052 INFO:teuthology.orchestra.run.smithi045.stdout: -9008> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000052e [2,head] /dc-dir/dc-file_825 auth v5652 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.207573+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6c7700] 2023-10-03T19:21:00.052 INFO:teuthology.orchestra.run.smithi045.stdout: -9007> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.052 INFO:teuthology.orchestra.run.smithi045.stdout: -9006> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 239.91, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.40e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:482.8] 2023-10-03T19:21:00.052 INFO:teuthology.orchestra.run.smithi045.stdout: -9005> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d546240 on [dir 0x1 / [2,head] auth pv=6007 v=5659 cv=5559/5559 REP dir_auth=0 ap=174+176 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 174 2023-10-03T19:21:00.052 INFO:teuthology.orchestra.run.smithi045.stdout: -9004> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d546240 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5658 pv6006 ap=175 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=175) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=174) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 175 2023-10-03T19:21:00.052 INFO:teuthology.orchestra.run.smithi045.stdout: -9003> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5659 cv=5559/5559 REP dir_auth=0 ap=174+175 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d546240 count now 174/175 2023-10-03T19:21:00.052 INFO:teuthology.orchestra.run.smithi045.stdout: -9002> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d546240 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5653 cv=5553/5553 ap=175+175 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=50 | child=1 dirty=1 authpin=1 0x55576d056400] count now 175 2023-10-03T19:21:00.053 INFO:teuthology.orchestra.run.smithi045.stdout: -9001> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000052e) auth_unpin by 0x55576d546240 on [inode 0x1000000052e [2,head] /dc-dir/dc-file_825 auth v5652 s=3 n(v0 rc2023-10-03T19:16:11.207573+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6c7700] now 0 2023-10-03T19:21:00.053 INFO:teuthology.orchestra.run.smithi045.stdout: -9000> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5653 cv=5553/5553 ap=175+174 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=50 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d546240 count now 175/174 2023-10-03T19:21:00.053 INFO:teuthology.orchestra.run.smithi045.stdout: -8999> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.053 INFO:teuthology.orchestra.run.smithi045.stdout: -8998> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.053 INFO:teuthology.orchestra.run.smithi045.stdout: -8997> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000052f [2,head] /dc-dir/dc-file_826 auth v4066 pv5654 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.219917+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.219917+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6cc000] 2023-10-03T19:21:00.053 INFO:teuthology.orchestra.run.smithi045.stdout: -8996> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5660 2023-10-03T19:21:00.053 INFO:teuthology.orchestra.run.smithi045.stdout: -8995> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5660 pv6006 ap=175 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=175) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=174) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.053 INFO:teuthology.orchestra.run.smithi045.stdout: -8994> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5658 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.053 INFO:teuthology.orchestra.run.smithi045.stdout: -8993> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5659 cv=5559/5559 REP dir_auth=0 ap=174+175 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5659 2023-10-03T19:21:00.053 INFO:teuthology.orchestra.run.smithi045.stdout: -8992> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000052f) pop_and_dirty_projected_inode v5654 2023-10-03T19:21:00.054 INFO:teuthology.orchestra.run.smithi045.stdout: -8991> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000052f) mark_dirty [inode 0x1000000052f [2,head] /dc-dir/dc-file_826 auth v5654 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.219917+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6cc000] 2023-10-03T19:21:00.054 INFO:teuthology.orchestra.run.smithi045.stdout: -8990> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_826) mark_dirty [dentry #0x1/dc-dir/dc-file_826 [2,head] auth (dversion lock) pv=5654 v=4066 ino=0x1000000052f state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6c3b80] 2023-10-03T19:21:00.054 INFO:teuthology.orchestra.run.smithi045.stdout: -8989> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5653 cv=5553/5553 ap=175+174 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=51 | child=1 dirty=1 authpin=1 0x55576d056400] version 5653 2023-10-03T19:21:00.054 INFO:teuthology.orchestra.run.smithi045.stdout: -8988> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d696800 v5661 2023-10-03T19:21:00.054 INFO:teuthology.orchestra.run.smithi045.stdout: -8987> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5661 cv=5559/5559 REP dir_auth=0 ap=174+175 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5661 2023-10-03T19:21:00.054 INFO:teuthology.orchestra.run.smithi045.stdout: -8986> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d6966e0 v5655 2023-10-03T19:21:00.054 INFO:teuthology.orchestra.run.smithi045.stdout: -8985> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5655 cv=5553/5553 ap=175+174 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=51 | child=1 dirty=1 authpin=1 0x55576d056400] version 5655 2023-10-03T19:21:00.090 INFO:teuthology.orchestra.run.smithi045.stdout: -8984> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=174 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=174 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.091 INFO:teuthology.orchestra.run.smithi045.stdout: -8983> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=174) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5660 pv6006 ap=175 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=175) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=174) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.091 INFO:teuthology.orchestra.run.smithi045.stdout: -8982> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=175) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5660 pv6006 ap=175 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=175) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=173) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.091 INFO:teuthology.orchestra.run.smithi045.stdout: -8981> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000052f [2,head] /dc-dir/dc-file_826 auth v5654 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.219917+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cc000] 2023-10-03T19:21:00.091 INFO:teuthology.orchestra.run.smithi045.stdout: -8980> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000052f [2,head] /dc-dir/dc-file_826 auth v5654 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.219917+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cc000] 2023-10-03T19:21:00.091 INFO:teuthology.orchestra.run.smithi045.stdout: -8979> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.091 INFO:teuthology.orchestra.run.smithi045.stdout: -8978> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.091 INFO:teuthology.orchestra.run.smithi045.stdout: -8977> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.091 INFO:teuthology.orchestra.run.smithi045.stdout: -8976> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000052f [2,head] /dc-dir/dc-file_826 auth v5654 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.219917+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cc000] 2023-10-03T19:21:00.091 INFO:teuthology.orchestra.run.smithi045.stdout: -8975> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000052f [2,head] /dc-dir/dc-file_826 auth v5654 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.219917+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cc000] 2023-10-03T19:21:00.091 INFO:teuthology.orchestra.run.smithi045.stdout: -8974> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.092 INFO:teuthology.orchestra.run.smithi045.stdout: -8973> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 240.91, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.41e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:484.8] 2023-10-03T19:21:00.092 INFO:teuthology.orchestra.run.smithi045.stdout: -8972> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d3ddd40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5660 pv6006 ap=174 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=174) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=173) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 174 2023-10-03T19:21:00.092 INFO:teuthology.orchestra.run.smithi045.stdout: -8971> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5661 cv=5559/5559 REP dir_auth=0 ap=174+174 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d3ddd40 count now 174/174 2023-10-03T19:21:00.092 INFO:teuthology.orchestra.run.smithi045.stdout: -8970> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d3ddd40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5655 cv=5553/5553 ap=174+174 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=51 | child=1 dirty=1 authpin=1 0x55576d056400] count now 174 2023-10-03T19:21:00.092 INFO:teuthology.orchestra.run.smithi045.stdout: -8969> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d3ddd40 on [dir 0x1 / [2,head] auth pv=6007 v=5661 cv=5559/5559 REP dir_auth=0 ap=173+174 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 173 2023-10-03T19:21:00.092 INFO:teuthology.orchestra.run.smithi045.stdout: -8968> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000052f) auth_unpin by 0x55576d3ddd40 on [inode 0x1000000052f [2,head] /dc-dir/dc-file_826 auth v5654 s=3 n(v0 rc2023-10-03T19:16:11.219917+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6cc000] now 0 2023-10-03T19:21:00.092 INFO:teuthology.orchestra.run.smithi045.stdout: -8967> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5655 cv=5553/5553 ap=174+173 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=51 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d3ddd40 count now 174/173 2023-10-03T19:21:00.093 INFO:teuthology.orchestra.run.smithi045.stdout: -8966> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.093 INFO:teuthology.orchestra.run.smithi045.stdout: -8965> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.093 INFO:teuthology.orchestra.run.smithi045.stdout: -8964> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000530 [2,head] /dc-dir/dc-file_827 auth v4070 pv5656 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.232165+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.232165+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6cc580] 2023-10-03T19:21:00.101 INFO:teuthology.orchestra.run.smithi045.stdout: -8963> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5662 2023-10-03T19:21:00.101 INFO:teuthology.orchestra.run.smithi045.stdout: -8962> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5662 pv6006 ap=174 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=174) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=173) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.101 INFO:teuthology.orchestra.run.smithi045.stdout: -8961> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5660 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.101 INFO:teuthology.orchestra.run.smithi045.stdout: -8960> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5661 cv=5559/5559 REP dir_auth=0 ap=173+174 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5661 2023-10-03T19:21:00.101 INFO:teuthology.orchestra.run.smithi045.stdout: -8959> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000530) pop_and_dirty_projected_inode v5656 2023-10-03T19:21:00.101 INFO:teuthology.orchestra.run.smithi045.stdout: -8958> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000530) mark_dirty [inode 0x10000000530 [2,head] /dc-dir/dc-file_827 auth v5656 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.232165+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6cc580] 2023-10-03T19:21:00.102 INFO:teuthology.orchestra.run.smithi045.stdout: -8957> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_827) mark_dirty [dentry #0x1/dc-dir/dc-file_827 [2,head] auth (dversion lock) pv=5656 v=4070 ino=0x10000000530 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6d4000] 2023-10-03T19:21:00.102 INFO:teuthology.orchestra.run.smithi045.stdout: -8956> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5655 cv=5553/5553 ap=174+173 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=52 | child=1 dirty=1 authpin=1 0x55576d056400] version 5655 2023-10-03T19:21:00.103 INFO:teuthology.orchestra.run.smithi045.stdout: -8955> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d6965c0 v5663 2023-10-03T19:21:00.103 INFO:teuthology.orchestra.run.smithi045.stdout: -8954> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5663 cv=5559/5559 REP dir_auth=0 ap=173+174 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5663 2023-10-03T19:21:00.103 INFO:teuthology.orchestra.run.smithi045.stdout: -8953> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d6964a0 v5657 2023-10-03T19:21:00.103 INFO:teuthology.orchestra.run.smithi045.stdout: -8952> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5657 cv=5553/5553 ap=174+173 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=52 | child=1 dirty=1 authpin=1 0x55576d056400] version 5657 2023-10-03T19:21:00.103 INFO:teuthology.orchestra.run.smithi045.stdout: -8951> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=173 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=173 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.103 INFO:teuthology.orchestra.run.smithi045.stdout: -8950> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=173) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5662 pv6006 ap=174 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=174) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=173) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.103 INFO:teuthology.orchestra.run.smithi045.stdout: -8949> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=174) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5662 pv6006 ap=174 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=174) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=172) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.103 INFO:teuthology.orchestra.run.smithi045.stdout: -8948> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000530 [2,head] /dc-dir/dc-file_827 auth v5656 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.232165+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cc580] 2023-10-03T19:21:00.103 INFO:teuthology.orchestra.run.smithi045.stdout: -8947> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000530 [2,head] /dc-dir/dc-file_827 auth v5656 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.232165+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cc580] 2023-10-03T19:21:00.103 INFO:teuthology.orchestra.run.smithi045.stdout: -8946> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.104 INFO:teuthology.orchestra.run.smithi045.stdout: -8945> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.104 INFO:teuthology.orchestra.run.smithi045.stdout: -8944> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.104 INFO:teuthology.orchestra.run.smithi045.stdout: -8943> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000530 [2,head] /dc-dir/dc-file_827 auth v5656 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.232165+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cc580] 2023-10-03T19:21:00.196 INFO:teuthology.orchestra.run.smithi045.stdout: -8942> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000530 [2,head] /dc-dir/dc-file_827 auth v5656 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.232165+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cc580] 2023-10-03T19:21:00.197 INFO:teuthology.orchestra.run.smithi045.stdout: -8941> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.197 INFO:teuthology.orchestra.run.smithi045.stdout: -8940> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 241.91, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.42e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:486.8] 2023-10-03T19:21:00.197 INFO:teuthology.orchestra.run.smithi045.stdout: -8939> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d5c7440 on [dir 0x1 / [2,head] auth pv=6007 v=5663 cv=5559/5559 REP dir_auth=0 ap=172+174 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 172 2023-10-03T19:21:00.197 INFO:teuthology.orchestra.run.smithi045.stdout: -8938> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d5c7440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5662 pv6006 ap=173 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=173) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=172) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 173 2023-10-03T19:21:00.197 INFO:teuthology.orchestra.run.smithi045.stdout: -8937> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5663 cv=5559/5559 REP dir_auth=0 ap=172+173 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d5c7440 count now 172/173 2023-10-03T19:21:00.197 INFO:teuthology.orchestra.run.smithi045.stdout: -8936> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d5c7440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5657 cv=5553/5553 ap=173+173 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=52 | child=1 dirty=1 authpin=1 0x55576d056400] count now 173 2023-10-03T19:21:00.197 INFO:teuthology.orchestra.run.smithi045.stdout: -8935> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000530) auth_unpin by 0x55576d5c7440 on [inode 0x10000000530 [2,head] /dc-dir/dc-file_827 auth v5656 s=3 n(v0 rc2023-10-03T19:16:11.232165+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6cc580] now 0 2023-10-03T19:21:00.198 INFO:teuthology.orchestra.run.smithi045.stdout: -8934> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5657 cv=5553/5553 ap=173+172 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=52 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d5c7440 count now 173/172 2023-10-03T19:21:00.198 INFO:teuthology.orchestra.run.smithi045.stdout: -8933> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.198 INFO:teuthology.orchestra.run.smithi045.stdout: -8932> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.198 INFO:teuthology.orchestra.run.smithi045.stdout: -8931> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000531 [2,head] /dc-dir/dc-file_828 auth v4074 pv5658 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.244013+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.244013+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6ccb00] 2023-10-03T19:21:00.198 INFO:teuthology.orchestra.run.smithi045.stdout: -8930> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5664 2023-10-03T19:21:00.198 INFO:teuthology.orchestra.run.smithi045.stdout: -8929> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5664 pv6006 ap=173 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=173) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=172) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.198 INFO:teuthology.orchestra.run.smithi045.stdout: -8928> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5662 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.199 INFO:teuthology.orchestra.run.smithi045.stdout: -8927> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5663 cv=5559/5559 REP dir_auth=0 ap=172+173 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5663 2023-10-03T19:21:00.199 INFO:teuthology.orchestra.run.smithi045.stdout: -8926> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000531) pop_and_dirty_projected_inode v5658 2023-10-03T19:21:00.199 INFO:teuthology.orchestra.run.smithi045.stdout: -8925> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000531) mark_dirty [inode 0x10000000531 [2,head] /dc-dir/dc-file_828 auth v5658 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.244013+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6ccb00] 2023-10-03T19:21:00.199 INFO:teuthology.orchestra.run.smithi045.stdout: -8924> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_828) mark_dirty [dentry #0x1/dc-dir/dc-file_828 [2,head] auth (dversion lock) pv=5658 v=4074 ino=0x10000000531 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6d4280] 2023-10-03T19:21:00.199 INFO:teuthology.orchestra.run.smithi045.stdout: -8923> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5657 cv=5553/5553 ap=173+172 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=53 | child=1 dirty=1 authpin=1 0x55576d056400] version 5657 2023-10-03T19:21:00.199 INFO:teuthology.orchestra.run.smithi045.stdout: -8922> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d696380 v5665 2023-10-03T19:21:00.199 INFO:teuthology.orchestra.run.smithi045.stdout: -8921> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5665 cv=5559/5559 REP dir_auth=0 ap=172+173 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5665 2023-10-03T19:21:00.199 INFO:teuthology.orchestra.run.smithi045.stdout: -8920> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d696260 v5659 2023-10-03T19:21:00.199 INFO:teuthology.orchestra.run.smithi045.stdout: -8919> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5659 cv=5553/5553 ap=173+172 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=53 | child=1 dirty=1 authpin=1 0x55576d056400] version 5659 2023-10-03T19:21:00.200 INFO:teuthology.orchestra.run.smithi045.stdout: -8918> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=172 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=172 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.200 INFO:teuthology.orchestra.run.smithi045.stdout: -8917> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=172) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5664 pv6006 ap=173 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=173) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=172) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.200 INFO:teuthology.orchestra.run.smithi045.stdout: -8916> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=173) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5664 pv6006 ap=173 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=173) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=171) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.200 INFO:teuthology.orchestra.run.smithi045.stdout: -8915> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000531 [2,head] /dc-dir/dc-file_828 auth v5658 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.244013+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6ccb00] 2023-10-03T19:21:00.200 INFO:teuthology.orchestra.run.smithi045.stdout: -8914> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000531 [2,head] /dc-dir/dc-file_828 auth v5658 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.244013+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6ccb00] 2023-10-03T19:21:00.209 INFO:teuthology.orchestra.run.smithi045.stdout: -8913> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.209 INFO:teuthology.orchestra.run.smithi045.stdout: -8912> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.209 INFO:teuthology.orchestra.run.smithi045.stdout: -8911> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.210 INFO:teuthology.orchestra.run.smithi045.stdout: -8910> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000531 [2,head] /dc-dir/dc-file_828 auth v5658 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.244013+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6ccb00] 2023-10-03T19:21:00.210 INFO:teuthology.orchestra.run.smithi045.stdout: -8909> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000531 [2,head] /dc-dir/dc-file_828 auth v5658 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.244013+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6ccb00] 2023-10-03T19:21:00.210 INFO:teuthology.orchestra.run.smithi045.stdout: -8908> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.210 INFO:teuthology.orchestra.run.smithi045.stdout: -8907> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 242.91, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.43e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:488.8] 2023-10-03T19:21:00.210 INFO:teuthology.orchestra.run.smithi045.stdout: -8906> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d3dd200 on [dir 0x1 / [2,head] auth pv=6007 v=5665 cv=5559/5559 REP dir_auth=0 ap=171+173 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 171 2023-10-03T19:21:00.210 INFO:teuthology.orchestra.run.smithi045.stdout: -8905> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d3dd200 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5664 pv6006 ap=172 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=172) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=171) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 172 2023-10-03T19:21:00.210 INFO:teuthology.orchestra.run.smithi045.stdout: -8904> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5665 cv=5559/5559 REP dir_auth=0 ap=171+172 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d3dd200 count now 171/172 2023-10-03T19:21:00.210 INFO:teuthology.orchestra.run.smithi045.stdout: -8903> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d3dd200 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5659 cv=5553/5553 ap=172+172 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=53 | child=1 dirty=1 authpin=1 0x55576d056400] count now 172 2023-10-03T19:21:00.210 INFO:teuthology.orchestra.run.smithi045.stdout: -8902> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000531) auth_unpin by 0x55576d3dd200 on [inode 0x10000000531 [2,head] /dc-dir/dc-file_828 auth v5658 s=3 n(v0 rc2023-10-03T19:16:11.244013+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6ccb00] now 0 2023-10-03T19:21:00.210 INFO:teuthology.orchestra.run.smithi045.stdout: -8901> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5659 cv=5553/5553 ap=172+171 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=53 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d3dd200 count now 172/171 2023-10-03T19:21:00.210 INFO:teuthology.orchestra.run.smithi045.stdout: -8900> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.211 INFO:teuthology.orchestra.run.smithi045.stdout: -8899> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.211 INFO:teuthology.orchestra.run.smithi045.stdout: -8898> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000532 [2,head] /dc-dir/dc-file_829 auth v4078 pv5660 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.256008+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.256008+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6cd080] 2023-10-03T19:21:00.211 INFO:teuthology.orchestra.run.smithi045.stdout: -8897> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5666 2023-10-03T19:21:00.211 INFO:teuthology.orchestra.run.smithi045.stdout: -8896> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5666 pv6006 ap=172 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=172) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=171) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.211 INFO:teuthology.orchestra.run.smithi045.stdout: -8895> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5664 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.211 INFO:teuthology.orchestra.run.smithi045.stdout: -8894> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5665 cv=5559/5559 REP dir_auth=0 ap=171+172 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5665 2023-10-03T19:21:00.211 INFO:teuthology.orchestra.run.smithi045.stdout: -8893> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000532) pop_and_dirty_projected_inode v5660 2023-10-03T19:21:00.211 INFO:teuthology.orchestra.run.smithi045.stdout: -8892> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000532) mark_dirty [inode 0x10000000532 [2,head] /dc-dir/dc-file_829 auth v5660 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.256008+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6cd080] 2023-10-03T19:21:00.211 INFO:teuthology.orchestra.run.smithi045.stdout: -8891> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_829) mark_dirty [dentry #0x1/dc-dir/dc-file_829 [2,head] auth (dversion lock) pv=5660 v=4078 ino=0x10000000532 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6d4500] 2023-10-03T19:21:00.211 INFO:teuthology.orchestra.run.smithi045.stdout: -8890> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5659 cv=5553/5553 ap=172+171 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=54 | child=1 dirty=1 authpin=1 0x55576d056400] version 5659 2023-10-03T19:21:00.212 INFO:teuthology.orchestra.run.smithi045.stdout: -8889> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d696140 v5667 2023-10-03T19:21:00.212 INFO:teuthology.orchestra.run.smithi045.stdout: -8888> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5667 cv=5559/5559 REP dir_auth=0 ap=171+172 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5667 2023-10-03T19:21:00.212 INFO:teuthology.orchestra.run.smithi045.stdout: -8887> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d53eec0 v5661 2023-10-03T19:21:00.212 INFO:teuthology.orchestra.run.smithi045.stdout: -8886> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5661 cv=5553/5553 ap=172+171 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=54 | child=1 dirty=1 authpin=1 0x55576d056400] version 5661 2023-10-03T19:21:00.212 INFO:teuthology.orchestra.run.smithi045.stdout: -8885> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=171 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=171 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.212 INFO:teuthology.orchestra.run.smithi045.stdout: -8884> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=171) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5666 pv6006 ap=172 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=172) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=171) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.212 INFO:teuthology.orchestra.run.smithi045.stdout: -8883> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=172) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5666 pv6006 ap=172 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=172) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=170) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.212 INFO:teuthology.orchestra.run.smithi045.stdout: -8882> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000532 [2,head] /dc-dir/dc-file_829 auth v5660 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.256008+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cd080] 2023-10-03T19:21:00.212 INFO:teuthology.orchestra.run.smithi045.stdout: -8881> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000532 [2,head] /dc-dir/dc-file_829 auth v5660 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.256008+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cd080] 2023-10-03T19:21:00.212 INFO:teuthology.orchestra.run.smithi045.stdout: -8880> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.212 INFO:teuthology.orchestra.run.smithi045.stdout: -8879> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.213 INFO:teuthology.orchestra.run.smithi045.stdout: -8878> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.213 INFO:teuthology.orchestra.run.smithi045.stdout: -8877> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000532 [2,head] /dc-dir/dc-file_829 auth v5660 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.256008+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cd080] 2023-10-03T19:21:00.213 INFO:teuthology.orchestra.run.smithi045.stdout: -8876> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000532 [2,head] /dc-dir/dc-file_829 auth v5660 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.256008+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cd080] 2023-10-03T19:21:00.213 INFO:teuthology.orchestra.run.smithi045.stdout: -8875> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.213 INFO:teuthology.orchestra.run.smithi045.stdout: -8874> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 243.91, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.44e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:490.8] 2023-10-03T19:21:00.213 INFO:teuthology.orchestra.run.smithi045.stdout: -8873> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d096480 on [dir 0x1 / [2,head] auth pv=6007 v=5667 cv=5559/5559 REP dir_auth=0 ap=170+172 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 170 2023-10-03T19:21:00.213 INFO:teuthology.orchestra.run.smithi045.stdout: -8872> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d096480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5666 pv6006 ap=171 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=171) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=170) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 171 2023-10-03T19:21:00.213 INFO:teuthology.orchestra.run.smithi045.stdout: -8871> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5667 cv=5559/5559 REP dir_auth=0 ap=170+171 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d096480 count now 170/171 2023-10-03T19:21:00.213 INFO:teuthology.orchestra.run.smithi045.stdout: -8870> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d096480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5661 cv=5553/5553 ap=171+171 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=54 | child=1 dirty=1 authpin=1 0x55576d056400] count now 171 2023-10-03T19:21:00.213 INFO:teuthology.orchestra.run.smithi045.stdout: -8869> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000532) auth_unpin by 0x55576d096480 on [inode 0x10000000532 [2,head] /dc-dir/dc-file_829 auth v5660 s=3 n(v0 rc2023-10-03T19:16:11.256008+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6cd080] now 0 2023-10-03T19:21:00.214 INFO:teuthology.orchestra.run.smithi045.stdout: -8868> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5661 cv=5553/5553 ap=171+170 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=54 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d096480 count now 171/170 2023-10-03T19:21:00.214 INFO:teuthology.orchestra.run.smithi045.stdout: -8867> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.214 INFO:teuthology.orchestra.run.smithi045.stdout: -8866> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.214 INFO:teuthology.orchestra.run.smithi045.stdout: -8865> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000533 [2,head] /dc-dir/dc-file_830 auth v4082 pv5662 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.268635+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.268635+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6cd600] 2023-10-03T19:21:00.214 INFO:teuthology.orchestra.run.smithi045.stdout: -8864> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5668 2023-10-03T19:21:00.214 INFO:teuthology.orchestra.run.smithi045.stdout: -8863> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5668 pv6006 ap=171 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=171) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=170) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.214 INFO:teuthology.orchestra.run.smithi045.stdout: -8862> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5666 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.214 INFO:teuthology.orchestra.run.smithi045.stdout: -8861> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5667 cv=5559/5559 REP dir_auth=0 ap=170+171 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5667 2023-10-03T19:21:00.214 INFO:teuthology.orchestra.run.smithi045.stdout: -8860> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000533) pop_and_dirty_projected_inode v5662 2023-10-03T19:21:00.214 INFO:teuthology.orchestra.run.smithi045.stdout: -8859> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000533) mark_dirty [inode 0x10000000533 [2,head] /dc-dir/dc-file_830 auth v5662 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.268635+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6cd600] 2023-10-03T19:21:00.214 INFO:teuthology.orchestra.run.smithi045.stdout: -8858> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_830) mark_dirty [dentry #0x1/dc-dir/dc-file_830 [2,head] auth (dversion lock) pv=5662 v=4082 ino=0x10000000533 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6d4780] 2023-10-03T19:21:00.215 INFO:teuthology.orchestra.run.smithi045.stdout: -8857> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5661 cv=5553/5553 ap=171+170 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=55 | child=1 dirty=1 authpin=1 0x55576d056400] version 5661 2023-10-03T19:21:00.215 INFO:teuthology.orchestra.run.smithi045.stdout: -8856> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d54a020 v5669 2023-10-03T19:21:00.215 INFO:teuthology.orchestra.run.smithi045.stdout: -8855> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5669 cv=5559/5559 REP dir_auth=0 ap=170+171 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5669 2023-10-03T19:21:00.247 INFO:teuthology.orchestra.run.smithi045.stdout: -8854> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d53ec80 v5663 2023-10-03T19:21:00.247 INFO:teuthology.orchestra.run.smithi045.stdout: -8853> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5663 cv=5553/5553 ap=171+170 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=55 | child=1 dirty=1 authpin=1 0x55576d056400] version 5663 2023-10-03T19:21:00.247 INFO:teuthology.orchestra.run.smithi045.stdout: -8852> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=170 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=170 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.247 INFO:teuthology.orchestra.run.smithi045.stdout: -8851> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=170) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5668 pv6006 ap=171 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=171) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=170) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.247 INFO:teuthology.orchestra.run.smithi045.stdout: -8850> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=171) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5668 pv6006 ap=171 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=171) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=169) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.248 INFO:teuthology.orchestra.run.smithi045.stdout: -8849> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000533 [2,head] /dc-dir/dc-file_830 auth v5662 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.268635+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cd600] 2023-10-03T19:21:00.248 INFO:teuthology.orchestra.run.smithi045.stdout: -8848> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000533 [2,head] /dc-dir/dc-file_830 auth v5662 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.268635+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cd600] 2023-10-03T19:21:00.248 INFO:teuthology.orchestra.run.smithi045.stdout: -8847> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.248 INFO:teuthology.orchestra.run.smithi045.stdout: -8846> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.248 INFO:teuthology.orchestra.run.smithi045.stdout: -8845> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.248 INFO:teuthology.orchestra.run.smithi045.stdout: -8844> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000533 [2,head] /dc-dir/dc-file_830 auth v5662 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.268635+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cd600] 2023-10-03T19:21:00.248 INFO:teuthology.orchestra.run.smithi045.stdout: -8843> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000533 [2,head] /dc-dir/dc-file_830 auth v5662 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.268635+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cd600] 2023-10-03T19:21:00.248 INFO:teuthology.orchestra.run.smithi045.stdout: -8842> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.248 INFO:teuthology.orchestra.run.smithi045.stdout: -8841> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 244.91, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.45e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:492.8] 2023-10-03T19:21:00.248 INFO:teuthology.orchestra.run.smithi045.stdout: -8840> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d3dcd80 on [dir 0x1 / [2,head] auth pv=6007 v=5669 cv=5559/5559 REP dir_auth=0 ap=169+171 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 169 2023-10-03T19:21:00.248 INFO:teuthology.orchestra.run.smithi045.stdout: -8839> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d3dcd80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5668 pv6006 ap=170 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=170) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=169) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 170 2023-10-03T19:21:00.248 INFO:teuthology.orchestra.run.smithi045.stdout: -8838> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5669 cv=5559/5559 REP dir_auth=0 ap=169+170 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d3dcd80 count now 169/170 2023-10-03T19:21:00.249 INFO:teuthology.orchestra.run.smithi045.stdout: -8837> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d3dcd80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5663 cv=5553/5553 ap=170+170 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=55 | child=1 dirty=1 authpin=1 0x55576d056400] count now 170 2023-10-03T19:21:00.249 INFO:teuthology.orchestra.run.smithi045.stdout: -8836> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000533) auth_unpin by 0x55576d3dcd80 on [inode 0x10000000533 [2,head] /dc-dir/dc-file_830 auth v5662 s=3 n(v0 rc2023-10-03T19:16:11.268635+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6cd600] now 0 2023-10-03T19:21:00.249 INFO:teuthology.orchestra.run.smithi045.stdout: -8835> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5663 cv=5553/5553 ap=170+169 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=55 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d3dcd80 count now 170/169 2023-10-03T19:21:00.249 INFO:teuthology.orchestra.run.smithi045.stdout: -8834> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.249 INFO:teuthology.orchestra.run.smithi045.stdout: -8833> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.249 INFO:teuthology.orchestra.run.smithi045.stdout: -8832> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000534 [2,head] /dc-dir/dc-file_831 auth v4086 pv5664 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.280602+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.280602+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6cdb80] 2023-10-03T19:21:00.249 INFO:teuthology.orchestra.run.smithi045.stdout: -8831> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5670 2023-10-03T19:21:00.249 INFO:teuthology.orchestra.run.smithi045.stdout: -8830> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5670 pv6006 ap=170 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=170) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=169) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.249 INFO:teuthology.orchestra.run.smithi045.stdout: -8829> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5668 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.250 INFO:teuthology.orchestra.run.smithi045.stdout: -8828> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5669 cv=5559/5559 REP dir_auth=0 ap=169+170 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5669 2023-10-03T19:21:00.250 INFO:teuthology.orchestra.run.smithi045.stdout: -8827> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000534) pop_and_dirty_projected_inode v5664 2023-10-03T19:21:00.250 INFO:teuthology.orchestra.run.smithi045.stdout: -8826> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000534) mark_dirty [inode 0x10000000534 [2,head] /dc-dir/dc-file_831 auth v5664 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.280602+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6cdb80] 2023-10-03T19:21:00.250 INFO:teuthology.orchestra.run.smithi045.stdout: -8825> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_831) mark_dirty [dentry #0x1/dc-dir/dc-file_831 [2,head] auth (dversion lock) pv=5664 v=4086 ino=0x10000000534 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6d4a00] 2023-10-03T19:21:00.250 INFO:teuthology.orchestra.run.smithi045.stdout: -8824> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5663 cv=5553/5553 ap=170+169 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=56 | child=1 dirty=1 authpin=1 0x55576d056400] version 5663 2023-10-03T19:21:00.250 INFO:teuthology.orchestra.run.smithi045.stdout: -8823> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d53fb20 v5671 2023-10-03T19:21:00.250 INFO:teuthology.orchestra.run.smithi045.stdout: -8822> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5671 cv=5559/5559 REP dir_auth=0 ap=169+170 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5671 2023-10-03T19:21:00.250 INFO:teuthology.orchestra.run.smithi045.stdout: -8821> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d53ea40 v5665 2023-10-03T19:21:00.250 INFO:teuthology.orchestra.run.smithi045.stdout: -8820> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5665 cv=5553/5553 ap=170+169 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=56 | child=1 dirty=1 authpin=1 0x55576d056400] version 5665 2023-10-03T19:21:00.250 INFO:teuthology.orchestra.run.smithi045.stdout: -8819> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=169 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=169 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.250 INFO:teuthology.orchestra.run.smithi045.stdout: -8818> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=169) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5670 pv6006 ap=170 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=170) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=169) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.251 INFO:teuthology.orchestra.run.smithi045.stdout: -8817> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=170) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5670 pv6006 ap=170 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=170) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=168) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.251 INFO:teuthology.orchestra.run.smithi045.stdout: -8816> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000534 [2,head] /dc-dir/dc-file_831 auth v5664 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.280602+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cdb80] 2023-10-03T19:21:00.251 INFO:teuthology.orchestra.run.smithi045.stdout: -8815> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000534 [2,head] /dc-dir/dc-file_831 auth v5664 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.280602+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cdb80] 2023-10-03T19:21:00.251 INFO:teuthology.orchestra.run.smithi045.stdout: -8814> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.251 INFO:teuthology.orchestra.run.smithi045.stdout: -8813> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.251 INFO:teuthology.orchestra.run.smithi045.stdout: -8812> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.251 INFO:teuthology.orchestra.run.smithi045.stdout: -8811> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000534 [2,head] /dc-dir/dc-file_831 auth v5664 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.280602+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cdb80] 2023-10-03T19:21:00.251 INFO:teuthology.orchestra.run.smithi045.stdout: -8810> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000534 [2,head] /dc-dir/dc-file_831 auth v5664 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.280602+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cdb80] 2023-10-03T19:21:00.251 INFO:teuthology.orchestra.run.smithi045.stdout: -8809> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.251 INFO:teuthology.orchestra.run.smithi045.stdout: -8808> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 245.91, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.46e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:494.8] 2023-10-03T19:21:00.251 INFO:teuthology.orchestra.run.smithi045.stdout: -8807> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2ab440 on [dir 0x1 / [2,head] auth pv=6007 v=5671 cv=5559/5559 REP dir_auth=0 ap=168+170 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 168 2023-10-03T19:21:00.252 INFO:teuthology.orchestra.run.smithi045.stdout: -8806> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2ab440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5670 pv6006 ap=169 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=169) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=168) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 169 2023-10-03T19:21:00.252 INFO:teuthology.orchestra.run.smithi045.stdout: -8805> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5671 cv=5559/5559 REP dir_auth=0 ap=168+169 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2ab440 count now 168/169 2023-10-03T19:21:00.252 INFO:teuthology.orchestra.run.smithi045.stdout: -8804> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2ab440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5665 cv=5553/5553 ap=169+169 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=56 | child=1 dirty=1 authpin=1 0x55576d056400] count now 169 2023-10-03T19:21:00.252 INFO:teuthology.orchestra.run.smithi045.stdout: -8803> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000534) auth_unpin by 0x55576d2ab440 on [inode 0x10000000534 [2,head] /dc-dir/dc-file_831 auth v5664 s=3 n(v0 rc2023-10-03T19:16:11.280602+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6cdb80] now 0 2023-10-03T19:21:00.252 INFO:teuthology.orchestra.run.smithi045.stdout: -8802> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5665 cv=5553/5553 ap=169+168 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=56 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2ab440 count now 169/168 2023-10-03T19:21:00.252 INFO:teuthology.orchestra.run.smithi045.stdout: -8801> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.252 INFO:teuthology.orchestra.run.smithi045.stdout: -8800> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.252 INFO:teuthology.orchestra.run.smithi045.stdout: -8799> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000535 [2,head] /dc-dir/dc-file_832 auth v4090 pv5666 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.292142+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.292142+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6ce100] 2023-10-03T19:21:00.252 INFO:teuthology.orchestra.run.smithi045.stdout: -8798> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5672 2023-10-03T19:21:00.252 INFO:teuthology.orchestra.run.smithi045.stdout: -8797> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5672 pv6006 ap=169 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=169) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=168) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.252 INFO:teuthology.orchestra.run.smithi045.stdout: -8796> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5670 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.253 INFO:teuthology.orchestra.run.smithi045.stdout: -8795> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5671 cv=5559/5559 REP dir_auth=0 ap=168+169 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5671 2023-10-03T19:21:00.253 INFO:teuthology.orchestra.run.smithi045.stdout: -8794> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000535) pop_and_dirty_projected_inode v5666 2023-10-03T19:21:00.253 INFO:teuthology.orchestra.run.smithi045.stdout: -8793> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000535) mark_dirty [inode 0x10000000535 [2,head] /dc-dir/dc-file_832 auth v5666 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.292142+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6ce100] 2023-10-03T19:21:00.253 INFO:teuthology.orchestra.run.smithi045.stdout: -8792> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_832) mark_dirty [dentry #0x1/dc-dir/dc-file_832 [2,head] auth (dversion lock) pv=5666 v=4090 ino=0x10000000535 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6d4c80] 2023-10-03T19:21:00.253 INFO:teuthology.orchestra.run.smithi045.stdout: -8791> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5665 cv=5553/5553 ap=169+168 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=57 | child=1 dirty=1 authpin=1 0x55576d056400] version 5665 2023-10-03T19:21:00.259 INFO:teuthology.orchestra.run.smithi045.stdout: -8790> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d53f6a0 v5673 2023-10-03T19:21:00.259 INFO:teuthology.orchestra.run.smithi045.stdout: -8789> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5673 cv=5559/5559 REP dir_auth=0 ap=168+169 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5673 2023-10-03T19:21:00.259 INFO:teuthology.orchestra.run.smithi045.stdout: -8788> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d53f8e0 v5667 2023-10-03T19:21:00.259 INFO:teuthology.orchestra.run.smithi045.stdout: -8787> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5667 cv=5553/5553 ap=169+168 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=57 | child=1 dirty=1 authpin=1 0x55576d056400] version 5667 2023-10-03T19:21:00.259 INFO:teuthology.orchestra.run.smithi045.stdout: -8786> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=168 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=168 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.259 INFO:teuthology.orchestra.run.smithi045.stdout: -8785> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=168) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5672 pv6006 ap=169 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=169) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=168) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.259 INFO:teuthology.orchestra.run.smithi045.stdout: -8784> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=169) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5672 pv6006 ap=169 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=169) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=167) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.259 INFO:teuthology.orchestra.run.smithi045.stdout: -8783> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000535 [2,head] /dc-dir/dc-file_832 auth v5666 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.292142+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6ce100] 2023-10-03T19:21:00.260 INFO:teuthology.orchestra.run.smithi045.stdout: -8782> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000535 [2,head] /dc-dir/dc-file_832 auth v5666 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.292142+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6ce100] 2023-10-03T19:21:00.260 INFO:teuthology.orchestra.run.smithi045.stdout: -8781> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.260 INFO:teuthology.orchestra.run.smithi045.stdout: -8780> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.260 INFO:teuthology.orchestra.run.smithi045.stdout: -8779> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.260 INFO:teuthology.orchestra.run.smithi045.stdout: -8778> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000535 [2,head] /dc-dir/dc-file_832 auth v5666 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.292142+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6ce100] 2023-10-03T19:21:00.260 INFO:teuthology.orchestra.run.smithi045.stdout: -8777> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000535 [2,head] /dc-dir/dc-file_832 auth v5666 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.292142+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6ce100] 2023-10-03T19:21:00.260 INFO:teuthology.orchestra.run.smithi045.stdout: -8776> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.260 INFO:teuthology.orchestra.run.smithi045.stdout: -8775> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 246.91, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.47e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:496.8] 2023-10-03T19:21:00.260 INFO:teuthology.orchestra.run.smithi045.stdout: -8774> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d821680 on [dir 0x1 / [2,head] auth pv=6007 v=5673 cv=5559/5559 REP dir_auth=0 ap=167+169 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 167 2023-10-03T19:21:00.260 INFO:teuthology.orchestra.run.smithi045.stdout: -8773> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d821680 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5672 pv6006 ap=168 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=168) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=167) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 168 2023-10-03T19:21:00.260 INFO:teuthology.orchestra.run.smithi045.stdout: -8772> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5673 cv=5559/5559 REP dir_auth=0 ap=167+168 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d821680 count now 167/168 2023-10-03T19:21:00.260 INFO:teuthology.orchestra.run.smithi045.stdout: -8771> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d821680 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5667 cv=5553/5553 ap=168+168 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=57 | child=1 dirty=1 authpin=1 0x55576d056400] count now 168 2023-10-03T19:21:00.261 INFO:teuthology.orchestra.run.smithi045.stdout: -8770> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000535) auth_unpin by 0x55576d821680 on [inode 0x10000000535 [2,head] /dc-dir/dc-file_832 auth v5666 s=3 n(v0 rc2023-10-03T19:16:11.292142+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6ce100] now 0 2023-10-03T19:21:00.261 INFO:teuthology.orchestra.run.smithi045.stdout: -8769> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5667 cv=5553/5553 ap=168+167 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=57 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d821680 count now 168/167 2023-10-03T19:21:00.261 INFO:teuthology.orchestra.run.smithi045.stdout: -8768> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.261 INFO:teuthology.orchestra.run.smithi045.stdout: -8767> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.261 INFO:teuthology.orchestra.run.smithi045.stdout: -8766> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000536 [2,head] /dc-dir/dc-file_833 auth v4094 pv5668 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.304306+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.304306+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6ce680] 2023-10-03T19:21:00.261 INFO:teuthology.orchestra.run.smithi045.stdout: -8765> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5674 2023-10-03T19:21:00.261 INFO:teuthology.orchestra.run.smithi045.stdout: -8764> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5674 pv6006 ap=168 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=168) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=167) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.261 INFO:teuthology.orchestra.run.smithi045.stdout: -8763> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5672 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.261 INFO:teuthology.orchestra.run.smithi045.stdout: -8762> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5673 cv=5559/5559 REP dir_auth=0 ap=167+168 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5673 2023-10-03T19:21:00.261 INFO:teuthology.orchestra.run.smithi045.stdout: -8761> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000536) pop_and_dirty_projected_inode v5668 2023-10-03T19:21:00.261 INFO:teuthology.orchestra.run.smithi045.stdout: -8760> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000536) mark_dirty [inode 0x10000000536 [2,head] /dc-dir/dc-file_833 auth v5668 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.304306+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6ce680] 2023-10-03T19:21:00.262 INFO:teuthology.orchestra.run.smithi045.stdout: -8759> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_833) mark_dirty [dentry #0x1/dc-dir/dc-file_833 [2,head] auth (dversion lock) pv=5668 v=4094 ino=0x10000000536 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6d4f00] 2023-10-03T19:21:00.262 INFO:teuthology.orchestra.run.smithi045.stdout: -8758> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5667 cv=5553/5553 ap=168+167 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=58 | child=1 dirty=1 authpin=1 0x55576d056400] version 5667 2023-10-03T19:21:00.262 INFO:teuthology.orchestra.run.smithi045.stdout: -8757> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d53f460 v5675 2023-10-03T19:21:00.262 INFO:teuthology.orchestra.run.smithi045.stdout: -8756> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5675 cv=5559/5559 REP dir_auth=0 ap=167+168 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5675 2023-10-03T19:21:00.262 INFO:teuthology.orchestra.run.smithi045.stdout: -8755> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d53fd60 v5669 2023-10-03T19:21:00.262 INFO:teuthology.orchestra.run.smithi045.stdout: -8754> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5669 cv=5553/5553 ap=168+167 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=58 | child=1 dirty=1 authpin=1 0x55576d056400] version 5669 2023-10-03T19:21:00.262 INFO:teuthology.orchestra.run.smithi045.stdout: -8753> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=167 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=167 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.262 INFO:teuthology.orchestra.run.smithi045.stdout: -8752> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=167) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5674 pv6006 ap=168 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=168) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=167) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.262 INFO:teuthology.orchestra.run.smithi045.stdout: -8751> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=168) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5674 pv6006 ap=168 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=168) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=166) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.262 INFO:teuthology.orchestra.run.smithi045.stdout: -8750> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000536 [2,head] /dc-dir/dc-file_833 auth v5668 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.304306+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6ce680] 2023-10-03T19:21:00.262 INFO:teuthology.orchestra.run.smithi045.stdout: -8749> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000536 [2,head] /dc-dir/dc-file_833 auth v5668 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.304306+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6ce680] 2023-10-03T19:21:00.262 INFO:teuthology.orchestra.run.smithi045.stdout: -8748> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.263 INFO:teuthology.orchestra.run.smithi045.stdout: -8747> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.263 INFO:teuthology.orchestra.run.smithi045.stdout: -8746> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.263 INFO:teuthology.orchestra.run.smithi045.stdout: -8745> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000536 [2,head] /dc-dir/dc-file_833 auth v5668 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.304306+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6ce680] 2023-10-03T19:21:00.263 INFO:teuthology.orchestra.run.smithi045.stdout: -8744> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000536 [2,head] /dc-dir/dc-file_833 auth v5668 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.304306+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6ce680] 2023-10-03T19:21:00.263 INFO:teuthology.orchestra.run.smithi045.stdout: -8743> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.263 INFO:teuthology.orchestra.run.smithi045.stdout: -8742> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 247.91, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.48e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:498.8] 2023-10-03T19:21:00.263 INFO:teuthology.orchestra.run.smithi045.stdout: -8741> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d809b00 on [dir 0x1 / [2,head] auth pv=6007 v=5675 cv=5559/5559 REP dir_auth=0 ap=166+168 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 166 2023-10-03T19:21:00.263 INFO:teuthology.orchestra.run.smithi045.stdout: -8740> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d809b00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5674 pv6006 ap=167 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=167) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=166) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 167 2023-10-03T19:21:00.263 INFO:teuthology.orchestra.run.smithi045.stdout: -8739> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5675 cv=5559/5559 REP dir_auth=0 ap=166+167 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d809b00 count now 166/167 2023-10-03T19:21:00.263 INFO:teuthology.orchestra.run.smithi045.stdout: -8738> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d809b00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5669 cv=5553/5553 ap=167+167 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=58 | child=1 dirty=1 authpin=1 0x55576d056400] count now 167 2023-10-03T19:21:00.263 INFO:teuthology.orchestra.run.smithi045.stdout: -8737> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000536) auth_unpin by 0x55576d809b00 on [inode 0x10000000536 [2,head] /dc-dir/dc-file_833 auth v5668 s=3 n(v0 rc2023-10-03T19:16:11.304306+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6ce680] now 0 2023-10-03T19:21:00.264 INFO:teuthology.orchestra.run.smithi045.stdout: -8736> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5669 cv=5553/5553 ap=167+166 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=58 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d809b00 count now 167/166 2023-10-03T19:21:00.264 INFO:teuthology.orchestra.run.smithi045.stdout: -8735> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.264 INFO:teuthology.orchestra.run.smithi045.stdout: -8734> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.264 INFO:teuthology.orchestra.run.smithi045.stdout: -8733> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000537 [2,head] /dc-dir/dc-file_834 auth v4098 pv5670 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.316389+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.316389+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6cec00] 2023-10-03T19:21:00.264 INFO:teuthology.orchestra.run.smithi045.stdout: -8732> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5676 2023-10-03T19:21:00.264 INFO:teuthology.orchestra.run.smithi045.stdout: -8731> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5676 pv6006 ap=167 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=167) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=166) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.356 INFO:teuthology.orchestra.run.smithi045.stdout: -8730> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5674 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.356 INFO:teuthology.orchestra.run.smithi045.stdout: -8729> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5675 cv=5559/5559 REP dir_auth=0 ap=166+167 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5675 2023-10-03T19:21:00.356 INFO:teuthology.orchestra.run.smithi045.stdout: -8728> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000537) pop_and_dirty_projected_inode v5670 2023-10-03T19:21:00.356 INFO:teuthology.orchestra.run.smithi045.stdout: -8727> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000537) mark_dirty [inode 0x10000000537 [2,head] /dc-dir/dc-file_834 auth v5670 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.316389+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6cec00] 2023-10-03T19:21:00.356 INFO:teuthology.orchestra.run.smithi045.stdout: -8726> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_834) mark_dirty [dentry #0x1/dc-dir/dc-file_834 [2,head] auth (dversion lock) pv=5670 v=4098 ino=0x10000000537 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6d5180] 2023-10-03T19:21:00.356 INFO:teuthology.orchestra.run.smithi045.stdout: -8725> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5669 cv=5553/5553 ap=167+166 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=59 | child=1 dirty=1 authpin=1 0x55576d056400] version 5669 2023-10-03T19:21:00.356 INFO:teuthology.orchestra.run.smithi045.stdout: -8724> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d53f220 v5677 2023-10-03T19:21:00.356 INFO:teuthology.orchestra.run.smithi045.stdout: -8723> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5677 cv=5559/5559 REP dir_auth=0 ap=166+167 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5677 2023-10-03T19:21:00.356 INFO:teuthology.orchestra.run.smithi045.stdout: -8722> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d54a260 v5671 2023-10-03T19:21:00.356 INFO:teuthology.orchestra.run.smithi045.stdout: -8721> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5671 cv=5553/5553 ap=167+166 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=59 | child=1 dirty=1 authpin=1 0x55576d056400] version 5671 2023-10-03T19:21:00.356 INFO:teuthology.orchestra.run.smithi045.stdout: -8720> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=166 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=166 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.357 INFO:teuthology.orchestra.run.smithi045.stdout: -8719> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=166) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5676 pv6006 ap=167 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=167) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=166) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.357 INFO:teuthology.orchestra.run.smithi045.stdout: -8718> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=167) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5676 pv6006 ap=167 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=167) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=165) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.357 INFO:teuthology.orchestra.run.smithi045.stdout: -8717> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000537 [2,head] /dc-dir/dc-file_834 auth v5670 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.316389+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cec00] 2023-10-03T19:21:00.357 INFO:teuthology.orchestra.run.smithi045.stdout: -8716> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000537 [2,head] /dc-dir/dc-file_834 auth v5670 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.316389+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cec00] 2023-10-03T19:21:00.357 INFO:teuthology.orchestra.run.smithi045.stdout: -8715> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.357 INFO:teuthology.orchestra.run.smithi045.stdout: -8714> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.357 INFO:teuthology.orchestra.run.smithi045.stdout: -8713> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.357 INFO:teuthology.orchestra.run.smithi045.stdout: -8712> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000537 [2,head] /dc-dir/dc-file_834 auth v5670 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.316389+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cec00] 2023-10-03T19:21:00.357 INFO:teuthology.orchestra.run.smithi045.stdout: -8711> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000537 [2,head] /dc-dir/dc-file_834 auth v5670 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.316389+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cec00] 2023-10-03T19:21:00.357 INFO:teuthology.orchestra.run.smithi045.stdout: -8710> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.358 INFO:teuthology.orchestra.run.smithi045.stdout: -8709> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 248.91, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.49e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:500.8] 2023-10-03T19:21:00.358 INFO:teuthology.orchestra.run.smithi045.stdout: -8708> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d693680 on [dir 0x1 / [2,head] auth pv=6007 v=5677 cv=5559/5559 REP dir_auth=0 ap=165+167 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 165 2023-10-03T19:21:00.358 INFO:teuthology.orchestra.run.smithi045.stdout: -8707> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d693680 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5676 pv6006 ap=166 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=166) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=165) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 166 2023-10-03T19:21:00.358 INFO:teuthology.orchestra.run.smithi045.stdout: -8706> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5677 cv=5559/5559 REP dir_auth=0 ap=165+166 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d693680 count now 165/166 2023-10-03T19:21:00.358 INFO:teuthology.orchestra.run.smithi045.stdout: -8705> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d693680 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5671 cv=5553/5553 ap=166+166 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=59 | child=1 dirty=1 authpin=1 0x55576d056400] count now 166 2023-10-03T19:21:00.358 INFO:teuthology.orchestra.run.smithi045.stdout: -8704> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000537) auth_unpin by 0x55576d693680 on [inode 0x10000000537 [2,head] /dc-dir/dc-file_834 auth v5670 s=3 n(v0 rc2023-10-03T19:16:11.316389+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6cec00] now 0 2023-10-03T19:21:00.358 INFO:teuthology.orchestra.run.smithi045.stdout: -8703> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5671 cv=5553/5553 ap=166+165 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=59 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d693680 count now 166/165 2023-10-03T19:21:00.358 INFO:teuthology.orchestra.run.smithi045.stdout: -8702> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.358 INFO:teuthology.orchestra.run.smithi045.stdout: -8701> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.358 INFO:teuthology.orchestra.run.smithi045.stdout: -8700> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000538 [2,head] /dc-dir/dc-file_835 auth v4102 pv5672 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.328728+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.328728+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6cf180] 2023-10-03T19:21:00.359 INFO:teuthology.orchestra.run.smithi045.stdout: -8699> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5678 2023-10-03T19:21:00.359 INFO:teuthology.orchestra.run.smithi045.stdout: -8698> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5678 pv6006 ap=166 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=166) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=165) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.359 INFO:teuthology.orchestra.run.smithi045.stdout: -8697> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5676 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.359 INFO:teuthology.orchestra.run.smithi045.stdout: -8696> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5677 cv=5559/5559 REP dir_auth=0 ap=165+166 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5677 2023-10-03T19:21:00.359 INFO:teuthology.orchestra.run.smithi045.stdout: -8695> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000538) pop_and_dirty_projected_inode v5672 2023-10-03T19:21:00.359 INFO:teuthology.orchestra.run.smithi045.stdout: -8694> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000538) mark_dirty [inode 0x10000000538 [2,head] /dc-dir/dc-file_835 auth v5672 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.328728+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6cf180] 2023-10-03T19:21:00.359 INFO:teuthology.orchestra.run.smithi045.stdout: -8693> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_835) mark_dirty [dentry #0x1/dc-dir/dc-file_835 [2,head] auth (dversion lock) pv=5672 v=4102 ino=0x10000000538 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6d5400] 2023-10-03T19:21:00.359 INFO:teuthology.orchestra.run.smithi045.stdout: -8692> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5671 cv=5553/5553 ap=166+165 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=60 | child=1 dirty=1 authpin=1 0x55576d056400] version 5671 2023-10-03T19:21:00.359 INFO:teuthology.orchestra.run.smithi045.stdout: -8691> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d53efe0 v5679 2023-10-03T19:21:00.359 INFO:teuthology.orchestra.run.smithi045.stdout: -8690> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5679 cv=5559/5559 REP dir_auth=0 ap=165+166 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5679 2023-10-03T19:21:00.360 INFO:teuthology.orchestra.run.smithi045.stdout: -8689> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d54a4a0 v5673 2023-10-03T19:21:00.360 INFO:teuthology.orchestra.run.smithi045.stdout: -8688> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5673 cv=5553/5553 ap=166+165 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=60 | child=1 dirty=1 authpin=1 0x55576d056400] version 5673 2023-10-03T19:21:00.360 INFO:teuthology.orchestra.run.smithi045.stdout: -8687> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=165 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=165 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.360 INFO:teuthology.orchestra.run.smithi045.stdout: -8686> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=165) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5678 pv6006 ap=166 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=166) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=165) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.360 INFO:teuthology.orchestra.run.smithi045.stdout: -8685> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=166) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5678 pv6006 ap=166 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=166) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=164) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.360 INFO:teuthology.orchestra.run.smithi045.stdout: -8684> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000538 [2,head] /dc-dir/dc-file_835 auth v5672 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.328728+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cf180] 2023-10-03T19:21:00.360 INFO:teuthology.orchestra.run.smithi045.stdout: -8683> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000538 [2,head] /dc-dir/dc-file_835 auth v5672 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.328728+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cf180] 2023-10-03T19:21:00.360 INFO:teuthology.orchestra.run.smithi045.stdout: -8682> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.360 INFO:teuthology.orchestra.run.smithi045.stdout: -8681> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.360 INFO:teuthology.orchestra.run.smithi045.stdout: -8680> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.360 INFO:teuthology.orchestra.run.smithi045.stdout: -8679> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000538 [2,head] /dc-dir/dc-file_835 auth v5672 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.328728+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cf180] 2023-10-03T19:21:00.361 INFO:teuthology.orchestra.run.smithi045.stdout: -8678> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000538 [2,head] /dc-dir/dc-file_835 auth v5672 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.328728+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cf180] 2023-10-03T19:21:00.371 INFO:teuthology.orchestra.run.smithi045.stdout: -8677> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.371 INFO:teuthology.orchestra.run.smithi045.stdout: -8676> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 249.91, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.50e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:502.8] 2023-10-03T19:21:00.371 INFO:teuthology.orchestra.run.smithi045.stdout: -8675> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d5386c0 on [dir 0x1 / [2,head] auth pv=6007 v=5679 cv=5559/5559 REP dir_auth=0 ap=164+166 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 164 2023-10-03T19:21:00.371 INFO:teuthology.orchestra.run.smithi045.stdout: -8674> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d5386c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5678 pv6006 ap=165 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=165) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=164) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 165 2023-10-03T19:21:00.372 INFO:teuthology.orchestra.run.smithi045.stdout: -8673> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5679 cv=5559/5559 REP dir_auth=0 ap=164+165 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d5386c0 count now 164/165 2023-10-03T19:21:00.372 INFO:teuthology.orchestra.run.smithi045.stdout: -8672> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d5386c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5673 cv=5553/5553 ap=165+165 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=60 | child=1 dirty=1 authpin=1 0x55576d056400] count now 165 2023-10-03T19:21:00.372 INFO:teuthology.orchestra.run.smithi045.stdout: -8671> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000538) auth_unpin by 0x55576d5386c0 on [inode 0x10000000538 [2,head] /dc-dir/dc-file_835 auth v5672 s=3 n(v0 rc2023-10-03T19:16:11.328728+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6cf180] now 0 2023-10-03T19:21:00.372 INFO:teuthology.orchestra.run.smithi045.stdout: -8670> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5673 cv=5553/5553 ap=165+164 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=60 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d5386c0 count now 165/164 2023-10-03T19:21:00.372 INFO:teuthology.orchestra.run.smithi045.stdout: -8669> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.372 INFO:teuthology.orchestra.run.smithi045.stdout: -8668> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.372 INFO:teuthology.orchestra.run.smithi045.stdout: -8667> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000539 [2,head] /dc-dir/dc-file_836 auth v4106 pv5674 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.341069+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.341069+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6cf700] 2023-10-03T19:21:00.372 INFO:teuthology.orchestra.run.smithi045.stdout: -8666> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5680 2023-10-03T19:21:00.372 INFO:teuthology.orchestra.run.smithi045.stdout: -8665> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5680 pv6006 ap=165 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=165) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=164) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.372 INFO:teuthology.orchestra.run.smithi045.stdout: -8664> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5678 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.373 INFO:teuthology.orchestra.run.smithi045.stdout: -8663> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5679 cv=5559/5559 REP dir_auth=0 ap=164+165 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5679 2023-10-03T19:21:00.373 INFO:teuthology.orchestra.run.smithi045.stdout: -8662> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000539) pop_and_dirty_projected_inode v5674 2023-10-03T19:21:00.373 INFO:teuthology.orchestra.run.smithi045.stdout: -8661> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000539) mark_dirty [inode 0x10000000539 [2,head] /dc-dir/dc-file_836 auth v5674 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.341069+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6cf700] 2023-10-03T19:21:00.373 INFO:teuthology.orchestra.run.smithi045.stdout: -8660> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_836) mark_dirty [dentry #0x1/dc-dir/dc-file_836 [2,head] auth (dversion lock) pv=5674 v=4106 ino=0x10000000539 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6d5680] 2023-10-03T19:21:00.373 INFO:teuthology.orchestra.run.smithi045.stdout: -8659> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5673 cv=5553/5553 ap=165+164 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=61 | child=1 dirty=1 authpin=1 0x55576d056400] version 5673 2023-10-03T19:21:00.373 INFO:teuthology.orchestra.run.smithi045.stdout: -8658> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d53f100 v5681 2023-10-03T19:21:00.373 INFO:teuthology.orchestra.run.smithi045.stdout: -8657> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5681 cv=5559/5559 REP dir_auth=0 ap=164+165 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5681 2023-10-03T19:21:00.373 INFO:teuthology.orchestra.run.smithi045.stdout: -8656> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d54a6e0 v5675 2023-10-03T19:21:00.373 INFO:teuthology.orchestra.run.smithi045.stdout: -8655> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5675 cv=5553/5553 ap=165+164 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=61 | child=1 dirty=1 authpin=1 0x55576d056400] version 5675 2023-10-03T19:21:00.373 INFO:teuthology.orchestra.run.smithi045.stdout: -8654> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=164 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=164 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.373 INFO:teuthology.orchestra.run.smithi045.stdout: -8653> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=164) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5680 pv6006 ap=165 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=165) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=164) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.373 INFO:teuthology.orchestra.run.smithi045.stdout: -8652> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=165) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5680 pv6006 ap=165 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=165) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=163) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.374 INFO:teuthology.orchestra.run.smithi045.stdout: -8651> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000539 [2,head] /dc-dir/dc-file_836 auth v5674 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.341069+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cf700] 2023-10-03T19:21:00.374 INFO:teuthology.orchestra.run.smithi045.stdout: -8650> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000539 [2,head] /dc-dir/dc-file_836 auth v5674 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.341069+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cf700] 2023-10-03T19:21:00.374 INFO:teuthology.orchestra.run.smithi045.stdout: -8649> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.374 INFO:teuthology.orchestra.run.smithi045.stdout: -8648> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.374 INFO:teuthology.orchestra.run.smithi045.stdout: -8647> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.374 INFO:teuthology.orchestra.run.smithi045.stdout: -8646> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000539 [2,head] /dc-dir/dc-file_836 auth v5674 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.341069+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cf700] 2023-10-03T19:21:00.374 INFO:teuthology.orchestra.run.smithi045.stdout: -8645> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000539 [2,head] /dc-dir/dc-file_836 auth v5674 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.341069+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6cf700] 2023-10-03T19:21:00.374 INFO:teuthology.orchestra.run.smithi045.stdout: -8644> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.374 INFO:teuthology.orchestra.run.smithi045.stdout: -8643> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 250.91, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.51e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:504.8] 2023-10-03T19:21:00.374 INFO:teuthology.orchestra.run.smithi045.stdout: -8642> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d828480 on [dir 0x1 / [2,head] auth pv=6007 v=5681 cv=5559/5559 REP dir_auth=0 ap=163+165 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 163 2023-10-03T19:21:00.375 INFO:teuthology.orchestra.run.smithi045.stdout: -8641> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d828480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5675 cv=5553/5553 ap=164+164 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=61 | child=1 dirty=1 authpin=1 0x55576d056400] count now 164 2023-10-03T19:21:00.375 INFO:teuthology.orchestra.run.smithi045.stdout: -8640> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d828480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5680 pv6006 ap=164 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=164) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=163) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 164 2023-10-03T19:21:00.375 INFO:teuthology.orchestra.run.smithi045.stdout: -8639> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5681 cv=5559/5559 REP dir_auth=0 ap=163+164 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d828480 count now 163/164 2023-10-03T19:21:00.375 INFO:teuthology.orchestra.run.smithi045.stdout: -8638> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000539) auth_unpin by 0x55576d828480 on [inode 0x10000000539 [2,head] /dc-dir/dc-file_836 auth v5674 s=3 n(v0 rc2023-10-03T19:16:11.341069+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6cf700] now 0 2023-10-03T19:21:00.375 INFO:teuthology.orchestra.run.smithi045.stdout: -8637> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5675 cv=5553/5553 ap=164+163 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=61 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d828480 count now 164/163 2023-10-03T19:21:00.375 INFO:teuthology.orchestra.run.smithi045.stdout: -8636> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.375 INFO:teuthology.orchestra.run.smithi045.stdout: -8635> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.375 INFO:teuthology.orchestra.run.smithi045.stdout: -8634> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000053a [2,head] /dc-dir/dc-file_837 auth v4110 pv5676 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.353385+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.353385+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6d8000] 2023-10-03T19:21:00.375 INFO:teuthology.orchestra.run.smithi045.stdout: -8633> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5682 2023-10-03T19:21:00.375 INFO:teuthology.orchestra.run.smithi045.stdout: -8632> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5682 pv6006 ap=164 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=164) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=163) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.375 INFO:teuthology.orchestra.run.smithi045.stdout: -8631> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5680 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.409 INFO:teuthology.orchestra.run.smithi045.stdout: -8630> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5681 cv=5559/5559 REP dir_auth=0 ap=163+164 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5681 2023-10-03T19:21:00.409 INFO:teuthology.orchestra.run.smithi045.stdout: -8629> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000053a) pop_and_dirty_projected_inode v5676 2023-10-03T19:21:00.409 INFO:teuthology.orchestra.run.smithi045.stdout: -8628> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000053a) mark_dirty [inode 0x1000000053a [2,head] /dc-dir/dc-file_837 auth v5676 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.353385+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6d8000] 2023-10-03T19:21:00.409 INFO:teuthology.orchestra.run.smithi045.stdout: -8627> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_837) mark_dirty [dentry #0x1/dc-dir/dc-file_837 [2,head] auth (dversion lock) pv=5676 v=4110 ino=0x1000000053a state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6d5900] 2023-10-03T19:21:00.409 INFO:teuthology.orchestra.run.smithi045.stdout: -8626> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5675 cv=5553/5553 ap=164+163 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=62 | child=1 dirty=1 authpin=1 0x55576d056400] version 5675 2023-10-03T19:21:00.410 INFO:teuthology.orchestra.run.smithi045.stdout: -8625> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d53eda0 v5683 2023-10-03T19:21:00.410 INFO:teuthology.orchestra.run.smithi045.stdout: -8624> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5683 cv=5559/5559 REP dir_auth=0 ap=163+164 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5683 2023-10-03T19:21:00.410 INFO:teuthology.orchestra.run.smithi045.stdout: -8623> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d54a920 v5677 2023-10-03T19:21:00.410 INFO:teuthology.orchestra.run.smithi045.stdout: -8622> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5677 cv=5553/5553 ap=164+163 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=62 | child=1 dirty=1 authpin=1 0x55576d056400] version 5677 2023-10-03T19:21:00.410 INFO:teuthology.orchestra.run.smithi045.stdout: -8621> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=163 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=163 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.410 INFO:teuthology.orchestra.run.smithi045.stdout: -8620> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=163) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5682 pv6006 ap=164 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=164) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=163) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.410 INFO:teuthology.orchestra.run.smithi045.stdout: -8619> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=164) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5682 pv6006 ap=164 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=164) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=162) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.410 INFO:teuthology.orchestra.run.smithi045.stdout: -8618> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000053a [2,head] /dc-dir/dc-file_837 auth v5676 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.353385+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6d8000] 2023-10-03T19:21:00.410 INFO:teuthology.orchestra.run.smithi045.stdout: -8617> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000053a [2,head] /dc-dir/dc-file_837 auth v5676 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.353385+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6d8000] 2023-10-03T19:21:00.410 INFO:teuthology.orchestra.run.smithi045.stdout: -8616> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.410 INFO:teuthology.orchestra.run.smithi045.stdout: -8615> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.411 INFO:teuthology.orchestra.run.smithi045.stdout: -8614> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.411 INFO:teuthology.orchestra.run.smithi045.stdout: -8613> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000053a [2,head] /dc-dir/dc-file_837 auth v5676 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.353385+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6d8000] 2023-10-03T19:21:00.411 INFO:teuthology.orchestra.run.smithi045.stdout: -8612> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000053a [2,head] /dc-dir/dc-file_837 auth v5676 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.353385+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6d8000] 2023-10-03T19:21:00.411 INFO:teuthology.orchestra.run.smithi045.stdout: -8611> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.411 INFO:teuthology.orchestra.run.smithi045.stdout: -8610> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 251.91, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.52e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:506.8] 2023-10-03T19:21:00.411 INFO:teuthology.orchestra.run.smithi045.stdout: -8609> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d5cb680 on [dir 0x1 / [2,head] auth pv=6007 v=5683 cv=5559/5559 REP dir_auth=0 ap=162+164 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 162 2023-10-03T19:21:00.411 INFO:teuthology.orchestra.run.smithi045.stdout: -8608> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d5cb680 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5682 pv6006 ap=163 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=163) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=162) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 163 2023-10-03T19:21:00.411 INFO:teuthology.orchestra.run.smithi045.stdout: -8607> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5683 cv=5559/5559 REP dir_auth=0 ap=162+163 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d5cb680 count now 162/163 2023-10-03T19:21:00.411 INFO:teuthology.orchestra.run.smithi045.stdout: -8606> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d5cb680 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5677 cv=5553/5553 ap=163+163 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=62 | child=1 dirty=1 authpin=1 0x55576d056400] count now 163 2023-10-03T19:21:00.411 INFO:teuthology.orchestra.run.smithi045.stdout: -8605> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000053a) auth_unpin by 0x55576d5cb680 on [inode 0x1000000053a [2,head] /dc-dir/dc-file_837 auth v5676 s=3 n(v0 rc2023-10-03T19:16:11.353385+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6d8000] now 0 2023-10-03T19:21:00.412 INFO:teuthology.orchestra.run.smithi045.stdout: -8604> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5677 cv=5553/5553 ap=163+162 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=62 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d5cb680 count now 163/162 2023-10-03T19:21:00.412 INFO:teuthology.orchestra.run.smithi045.stdout: -8603> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.412 INFO:teuthology.orchestra.run.smithi045.stdout: -8602> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.412 INFO:teuthology.orchestra.run.smithi045.stdout: -8601> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000053b [2,head] /dc-dir/dc-file_838 auth v4114 pv5678 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.365644+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.365644+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6d8580] 2023-10-03T19:21:00.412 INFO:teuthology.orchestra.run.smithi045.stdout: -8600> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5684 2023-10-03T19:21:00.412 INFO:teuthology.orchestra.run.smithi045.stdout: -8599> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5684 pv6006 ap=163 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=163) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=162) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.412 INFO:teuthology.orchestra.run.smithi045.stdout: -8598> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5682 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.412 INFO:teuthology.orchestra.run.smithi045.stdout: -8597> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5683 cv=5559/5559 REP dir_auth=0 ap=162+163 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5683 2023-10-03T19:21:00.412 INFO:teuthology.orchestra.run.smithi045.stdout: -8596> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000053b) pop_and_dirty_projected_inode v5678 2023-10-03T19:21:00.412 INFO:teuthology.orchestra.run.smithi045.stdout: -8595> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000053b) mark_dirty [inode 0x1000000053b [2,head] /dc-dir/dc-file_838 auth v5678 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.365644+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6d8580] 2023-10-03T19:21:00.412 INFO:teuthology.orchestra.run.smithi045.stdout: -8594> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_838) mark_dirty [dentry #0x1/dc-dir/dc-file_838 [2,head] auth (dversion lock) pv=5678 v=4114 ino=0x1000000053b state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6d5b80] 2023-10-03T19:21:00.413 INFO:teuthology.orchestra.run.smithi045.stdout: -8593> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5677 cv=5553/5553 ap=163+162 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=63 | child=1 dirty=1 authpin=1 0x55576d056400] version 5677 2023-10-03T19:21:00.413 INFO:teuthology.orchestra.run.smithi045.stdout: -8592> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d53f340 v5685 2023-10-03T19:21:00.413 INFO:teuthology.orchestra.run.smithi045.stdout: -8591> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5685 cv=5559/5559 REP dir_auth=0 ap=162+163 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5685 2023-10-03T19:21:00.413 INFO:teuthology.orchestra.run.smithi045.stdout: -8590> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d54ab60 v5679 2023-10-03T19:21:00.413 INFO:teuthology.orchestra.run.smithi045.stdout: -8589> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5679 cv=5553/5553 ap=163+162 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=63 | child=1 dirty=1 authpin=1 0x55576d056400] version 5679 2023-10-03T19:21:00.413 INFO:teuthology.orchestra.run.smithi045.stdout: -8588> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=162 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=162 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.413 INFO:teuthology.orchestra.run.smithi045.stdout: -8587> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=162) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5684 pv6006 ap=163 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=163) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=162) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.413 INFO:teuthology.orchestra.run.smithi045.stdout: -8586> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=163) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5684 pv6006 ap=163 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=163) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=161) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.413 INFO:teuthology.orchestra.run.smithi045.stdout: -8585> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000053b [2,head] /dc-dir/dc-file_838 auth v5678 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.365644+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6d8580] 2023-10-03T19:21:00.413 INFO:teuthology.orchestra.run.smithi045.stdout: -8584> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000053b [2,head] /dc-dir/dc-file_838 auth v5678 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.365644+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6d8580] 2023-10-03T19:21:00.413 INFO:teuthology.orchestra.run.smithi045.stdout: -8583> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.413 INFO:teuthology.orchestra.run.smithi045.stdout: -8582> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.414 INFO:teuthology.orchestra.run.smithi045.stdout: -8581> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.414 INFO:teuthology.orchestra.run.smithi045.stdout: -8580> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000053b [2,head] /dc-dir/dc-file_838 auth v5678 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.365644+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6d8580] 2023-10-03T19:21:00.414 INFO:teuthology.orchestra.run.smithi045.stdout: -8579> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000053b [2,head] /dc-dir/dc-file_838 auth v5678 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.365644+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6d8580] 2023-10-03T19:21:00.414 INFO:teuthology.orchestra.run.smithi045.stdout: -8578> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.414 INFO:teuthology.orchestra.run.smithi045.stdout: -8577> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 252.91, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.53e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:508.8] 2023-10-03T19:21:00.414 INFO:teuthology.orchestra.run.smithi045.stdout: -8576> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d54efc0 on [dir 0x1 / [2,head] auth pv=6007 v=5685 cv=5559/5559 REP dir_auth=0 ap=161+163 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 161 2023-10-03T19:21:00.423 INFO:teuthology.orchestra.run.smithi045.stdout: -8575> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d54efc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5684 pv6006 ap=162 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=162) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=161) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 162 2023-10-03T19:21:00.423 INFO:teuthology.orchestra.run.smithi045.stdout: -8574> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5685 cv=5559/5559 REP dir_auth=0 ap=161+162 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d54efc0 count now 161/162 2023-10-03T19:21:00.423 INFO:teuthology.orchestra.run.smithi045.stdout: -8573> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d54efc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5679 cv=5553/5553 ap=162+162 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=63 | child=1 dirty=1 authpin=1 0x55576d056400] count now 162 2023-10-03T19:21:00.424 INFO:teuthology.orchestra.run.smithi045.stdout: -8572> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000053b) auth_unpin by 0x55576d54efc0 on [inode 0x1000000053b [2,head] /dc-dir/dc-file_838 auth v5678 s=3 n(v0 rc2023-10-03T19:16:11.365644+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6d8580] now 0 2023-10-03T19:21:00.424 INFO:teuthology.orchestra.run.smithi045.stdout: -8571> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5679 cv=5553/5553 ap=162+161 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=63 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d54efc0 count now 162/161 2023-10-03T19:21:00.424 INFO:teuthology.orchestra.run.smithi045.stdout: -8570> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.424 INFO:teuthology.orchestra.run.smithi045.stdout: -8569> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.424 INFO:teuthology.orchestra.run.smithi045.stdout: -8568> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000053c [2,head] /dc-dir/dc-file_839 auth v4118 pv5680 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.377860+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.377860+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6d8b00] 2023-10-03T19:21:00.424 INFO:teuthology.orchestra.run.smithi045.stdout: -8567> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5686 2023-10-03T19:21:00.424 INFO:teuthology.orchestra.run.smithi045.stdout: -8566> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5686 pv6006 ap=162 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=162) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=161) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.424 INFO:teuthology.orchestra.run.smithi045.stdout: -8565> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5684 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.424 INFO:teuthology.orchestra.run.smithi045.stdout: -8564> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5685 cv=5559/5559 REP dir_auth=0 ap=161+162 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5685 2023-10-03T19:21:00.424 INFO:teuthology.orchestra.run.smithi045.stdout: -8563> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000053c) pop_and_dirty_projected_inode v5680 2023-10-03T19:21:00.424 INFO:teuthology.orchestra.run.smithi045.stdout: -8562> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000053c) mark_dirty [inode 0x1000000053c [2,head] /dc-dir/dc-file_839 auth v5680 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.377860+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6d8b00] 2023-10-03T19:21:00.424 INFO:teuthology.orchestra.run.smithi045.stdout: -8561> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_839) mark_dirty [dentry #0x1/dc-dir/dc-file_839 [2,head] auth (dversion lock) pv=5680 v=4118 ino=0x1000000053c state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6dc000] 2023-10-03T19:21:00.425 INFO:teuthology.orchestra.run.smithi045.stdout: -8560> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5679 cv=5553/5553 ap=162+161 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=64 | child=1 dirty=1 authpin=1 0x55576d056400] version 5679 2023-10-03T19:21:00.425 INFO:teuthology.orchestra.run.smithi045.stdout: -8559> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d53eb60 v5687 2023-10-03T19:21:00.425 INFO:teuthology.orchestra.run.smithi045.stdout: -8558> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5687 cv=5559/5559 REP dir_auth=0 ap=161+162 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5687 2023-10-03T19:21:00.425 INFO:teuthology.orchestra.run.smithi045.stdout: -8557> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d555220 v5681 2023-10-03T19:21:00.425 INFO:teuthology.orchestra.run.smithi045.stdout: -8556> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5681 cv=5553/5553 ap=162+161 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=64 | child=1 dirty=1 authpin=1 0x55576d056400] version 5681 2023-10-03T19:21:00.425 INFO:teuthology.orchestra.run.smithi045.stdout: -8555> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=161 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=161 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.425 INFO:teuthology.orchestra.run.smithi045.stdout: -8554> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=161) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5686 pv6006 ap=162 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=162) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=161) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.425 INFO:teuthology.orchestra.run.smithi045.stdout: -8553> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=162) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5686 pv6006 ap=162 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=162) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=160) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.425 INFO:teuthology.orchestra.run.smithi045.stdout: -8552> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000053c [2,head] /dc-dir/dc-file_839 auth v5680 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.377860+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6d8b00] 2023-10-03T19:21:00.425 INFO:teuthology.orchestra.run.smithi045.stdout: -8551> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000053c [2,head] /dc-dir/dc-file_839 auth v5680 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.377860+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6d8b00] 2023-10-03T19:21:00.426 INFO:teuthology.orchestra.run.smithi045.stdout: -8550> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.426 INFO:teuthology.orchestra.run.smithi045.stdout: -8549> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.426 INFO:teuthology.orchestra.run.smithi045.stdout: -8548> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.426 INFO:teuthology.orchestra.run.smithi045.stdout: -8547> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000053c [2,head] /dc-dir/dc-file_839 auth v5680 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.377860+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6d8b00] 2023-10-03T19:21:00.426 INFO:teuthology.orchestra.run.smithi045.stdout: -8546> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000053c [2,head] /dc-dir/dc-file_839 auth v5680 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.377860+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6d8b00] 2023-10-03T19:21:00.426 INFO:teuthology.orchestra.run.smithi045.stdout: -8545> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.426 INFO:teuthology.orchestra.run.smithi045.stdout: -8544> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 253.91, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.54e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:510.8] 2023-10-03T19:21:00.426 INFO:teuthology.orchestra.run.smithi045.stdout: -8543> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2b3d40 on [dir 0x1 / [2,head] auth pv=6007 v=5687 cv=5559/5559 REP dir_auth=0 ap=160+162 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 160 2023-10-03T19:21:00.426 INFO:teuthology.orchestra.run.smithi045.stdout: -8542> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2b3d40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5686 pv6006 ap=161 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=161) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=160) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 161 2023-10-03T19:21:00.426 INFO:teuthology.orchestra.run.smithi045.stdout: -8541> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5687 cv=5559/5559 REP dir_auth=0 ap=160+161 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2b3d40 count now 160/161 2023-10-03T19:21:00.426 INFO:teuthology.orchestra.run.smithi045.stdout: -8540> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2b3d40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5681 cv=5553/5553 ap=161+161 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=64 | child=1 dirty=1 authpin=1 0x55576d056400] count now 161 2023-10-03T19:21:00.426 INFO:teuthology.orchestra.run.smithi045.stdout: -8539> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000053c) auth_unpin by 0x55576d2b3d40 on [inode 0x1000000053c [2,head] /dc-dir/dc-file_839 auth v5680 s=3 n(v0 rc2023-10-03T19:16:11.377860+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6d8b00] now 0 2023-10-03T19:21:00.427 INFO:teuthology.orchestra.run.smithi045.stdout: -8538> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5681 cv=5553/5553 ap=161+160 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=64 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2b3d40 count now 161/160 2023-10-03T19:21:00.427 INFO:teuthology.orchestra.run.smithi045.stdout: -8537> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.427 INFO:teuthology.orchestra.run.smithi045.stdout: -8536> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.427 INFO:teuthology.orchestra.run.smithi045.stdout: -8535> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000053d [2,head] /dc-dir/dc-file_840 auth v4122 pv5682 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.390392+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.390392+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6d9080] 2023-10-03T19:21:00.427 INFO:teuthology.orchestra.run.smithi045.stdout: -8534> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5688 2023-10-03T19:21:00.427 INFO:teuthology.orchestra.run.smithi045.stdout: -8533> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5688 pv6006 ap=161 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=161) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=160) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.427 INFO:teuthology.orchestra.run.smithi045.stdout: -8532> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5686 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.427 INFO:teuthology.orchestra.run.smithi045.stdout: -8531> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5687 cv=5559/5559 REP dir_auth=0 ap=160+161 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5687 2023-10-03T19:21:00.427 INFO:teuthology.orchestra.run.smithi045.stdout: -8530> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000053d) pop_and_dirty_projected_inode v5682 2023-10-03T19:21:00.427 INFO:teuthology.orchestra.run.smithi045.stdout: -8529> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000053d) mark_dirty [inode 0x1000000053d [2,head] /dc-dir/dc-file_840 auth v5682 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.390392+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6d9080] 2023-10-03T19:21:00.427 INFO:teuthology.orchestra.run.smithi045.stdout: -8528> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_840) mark_dirty [dentry #0x1/dc-dir/dc-file_840 [2,head] auth (dversion lock) pv=5682 v=4122 ino=0x1000000053d state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6dc280] 2023-10-03T19:21:00.428 INFO:teuthology.orchestra.run.smithi045.stdout: -8527> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5681 cv=5553/5553 ap=161+160 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=65 | child=1 dirty=1 authpin=1 0x55576d056400] version 5681 2023-10-03T19:21:00.428 INFO:teuthology.orchestra.run.smithi045.stdout: -8526> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d53f580 v5689 2023-10-03T19:21:00.428 INFO:teuthology.orchestra.run.smithi045.stdout: -8525> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5689 cv=5559/5559 REP dir_auth=0 ap=160+161 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5689 2023-10-03T19:21:00.428 INFO:teuthology.orchestra.run.smithi045.stdout: -8524> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d555e80 v5683 2023-10-03T19:21:00.428 INFO:teuthology.orchestra.run.smithi045.stdout: -8523> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5683 cv=5553/5553 ap=161+160 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=65 | child=1 dirty=1 authpin=1 0x55576d056400] version 5683 2023-10-03T19:21:00.428 INFO:teuthology.orchestra.run.smithi045.stdout: -8522> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=160 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=160 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.428 INFO:teuthology.orchestra.run.smithi045.stdout: -8521> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=160) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5688 pv6006 ap=161 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=161) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=160) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.428 INFO:teuthology.orchestra.run.smithi045.stdout: -8520> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=161) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5688 pv6006 ap=161 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=161) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=159) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.428 INFO:teuthology.orchestra.run.smithi045.stdout: -8519> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000053d [2,head] /dc-dir/dc-file_840 auth v5682 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.390392+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6d9080] 2023-10-03T19:21:00.428 INFO:teuthology.orchestra.run.smithi045.stdout: -8518> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000053d [2,head] /dc-dir/dc-file_840 auth v5682 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.390392+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6d9080] 2023-10-03T19:21:00.428 INFO:teuthology.orchestra.run.smithi045.stdout: -8517> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.428 INFO:teuthology.orchestra.run.smithi045.stdout: -8516> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.514 INFO:teuthology.orchestra.run.smithi045.stdout: -8515> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.514 INFO:teuthology.orchestra.run.smithi045.stdout: -8514> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000053d [2,head] /dc-dir/dc-file_840 auth v5682 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.390392+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6d9080] 2023-10-03T19:21:00.514 INFO:teuthology.orchestra.run.smithi045.stdout: -8513> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000053d [2,head] /dc-dir/dc-file_840 auth v5682 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.390392+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6d9080] 2023-10-03T19:21:00.514 INFO:teuthology.orchestra.run.smithi045.stdout: -8512> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.514 INFO:teuthology.orchestra.run.smithi045.stdout: -8511> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 254.91, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.55e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:512.8] 2023-10-03T19:21:00.514 INFO:teuthology.orchestra.run.smithi045.stdout: -8510> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d52e900 on [dir 0x1 / [2,head] auth pv=6007 v=5689 cv=5559/5559 REP dir_auth=0 ap=159+161 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 159 2023-10-03T19:21:00.514 INFO:teuthology.orchestra.run.smithi045.stdout: -8509> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d52e900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5688 pv6006 ap=160 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=160) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=159) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 160 2023-10-03T19:21:00.514 INFO:teuthology.orchestra.run.smithi045.stdout: -8508> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5689 cv=5559/5559 REP dir_auth=0 ap=159+160 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d52e900 count now 159/160 2023-10-03T19:21:00.514 INFO:teuthology.orchestra.run.smithi045.stdout: -8507> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d52e900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5683 cv=5553/5553 ap=160+160 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=65 | child=1 dirty=1 authpin=1 0x55576d056400] count now 160 2023-10-03T19:21:00.515 INFO:teuthology.orchestra.run.smithi045.stdout: -8506> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000053d) auth_unpin by 0x55576d52e900 on [inode 0x1000000053d [2,head] /dc-dir/dc-file_840 auth v5682 s=3 n(v0 rc2023-10-03T19:16:11.390392+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6d9080] now 0 2023-10-03T19:21:00.515 INFO:teuthology.orchestra.run.smithi045.stdout: -8505> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5683 cv=5553/5553 ap=160+159 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=65 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d52e900 count now 160/159 2023-10-03T19:21:00.515 INFO:teuthology.orchestra.run.smithi045.stdout: -8504> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.515 INFO:teuthology.orchestra.run.smithi045.stdout: -8503> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.515 INFO:teuthology.orchestra.run.smithi045.stdout: -8502> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000053e [2,head] /dc-dir/dc-file_841 auth v4126 pv5684 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.402500+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.402500+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6d9600] 2023-10-03T19:21:00.515 INFO:teuthology.orchestra.run.smithi045.stdout: -8501> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5690 2023-10-03T19:21:00.515 INFO:teuthology.orchestra.run.smithi045.stdout: -8500> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5690 pv6006 ap=160 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=160) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=159) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.515 INFO:teuthology.orchestra.run.smithi045.stdout: -8499> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5688 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.515 INFO:teuthology.orchestra.run.smithi045.stdout: -8498> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5689 cv=5559/5559 REP dir_auth=0 ap=159+160 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5689 2023-10-03T19:21:00.515 INFO:teuthology.orchestra.run.smithi045.stdout: -8497> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000053e) pop_and_dirty_projected_inode v5684 2023-10-03T19:21:00.515 INFO:teuthology.orchestra.run.smithi045.stdout: -8496> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000053e) mark_dirty [inode 0x1000000053e [2,head] /dc-dir/dc-file_841 auth v5684 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.402500+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6d9600] 2023-10-03T19:21:00.516 INFO:teuthology.orchestra.run.smithi045.stdout: -8495> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_841) mark_dirty [dentry #0x1/dc-dir/dc-file_841 [2,head] auth (dversion lock) pv=5684 v=4126 ino=0x1000000053e state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6dc500] 2023-10-03T19:21:00.516 INFO:teuthology.orchestra.run.smithi045.stdout: -8494> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5683 cv=5553/5553 ap=160+159 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=66 | child=1 dirty=1 authpin=1 0x55576d056400] version 5683 2023-10-03T19:21:00.516 INFO:teuthology.orchestra.run.smithi045.stdout: -8493> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d53f7c0 v5691 2023-10-03T19:21:00.516 INFO:teuthology.orchestra.run.smithi045.stdout: -8492> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5691 cv=5559/5559 REP dir_auth=0 ap=159+160 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5691 2023-10-03T19:21:00.516 INFO:teuthology.orchestra.run.smithi045.stdout: -8491> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d555460 v5685 2023-10-03T19:21:00.516 INFO:teuthology.orchestra.run.smithi045.stdout: -8490> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5685 cv=5553/5553 ap=160+159 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=66 | child=1 dirty=1 authpin=1 0x55576d056400] version 5685 2023-10-03T19:21:00.516 INFO:teuthology.orchestra.run.smithi045.stdout: -8489> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=159 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=159 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.516 INFO:teuthology.orchestra.run.smithi045.stdout: -8488> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=159) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5690 pv6006 ap=160 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=160) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=159) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.517 INFO:teuthology.orchestra.run.smithi045.stdout: -8487> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=160) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5690 pv6006 ap=160 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=160) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=158) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.517 INFO:teuthology.orchestra.run.smithi045.stdout: -8486> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000053e [2,head] /dc-dir/dc-file_841 auth v5684 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.402500+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6d9600] 2023-10-03T19:21:00.517 INFO:teuthology.orchestra.run.smithi045.stdout: -8485> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000053e [2,head] /dc-dir/dc-file_841 auth v5684 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.402500+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6d9600] 2023-10-03T19:21:00.517 INFO:teuthology.orchestra.run.smithi045.stdout: -8484> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.517 INFO:teuthology.orchestra.run.smithi045.stdout: -8483> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.517 INFO:teuthology.orchestra.run.smithi045.stdout: -8482> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.517 INFO:teuthology.orchestra.run.smithi045.stdout: -8481> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000053e [2,head] /dc-dir/dc-file_841 auth v5684 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.402500+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6d9600] 2023-10-03T19:21:00.517 INFO:teuthology.orchestra.run.smithi045.stdout: -8480> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000053e [2,head] /dc-dir/dc-file_841 auth v5684 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.402500+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6d9600] 2023-10-03T19:21:00.517 INFO:teuthology.orchestra.run.smithi045.stdout: -8479> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.517 INFO:teuthology.orchestra.run.smithi045.stdout: -8478> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 255.91, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.56e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:514.8] 2023-10-03T19:21:00.517 INFO:teuthology.orchestra.run.smithi045.stdout: -8477> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d5c6d80 on [dir 0x1 / [2,head] auth pv=6007 v=5691 cv=5559/5559 REP dir_auth=0 ap=158+160 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 158 2023-10-03T19:21:00.518 INFO:teuthology.orchestra.run.smithi045.stdout: -8476> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d5c6d80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5690 pv6006 ap=159 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=159) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=158) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 159 2023-10-03T19:21:00.518 INFO:teuthology.orchestra.run.smithi045.stdout: -8475> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5691 cv=5559/5559 REP dir_auth=0 ap=158+159 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d5c6d80 count now 158/159 2023-10-03T19:21:00.518 INFO:teuthology.orchestra.run.smithi045.stdout: -8474> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d5c6d80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5685 cv=5553/5553 ap=159+159 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=66 | child=1 dirty=1 authpin=1 0x55576d056400] count now 159 2023-10-03T19:21:00.518 INFO:teuthology.orchestra.run.smithi045.stdout: -8473> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000053e) auth_unpin by 0x55576d5c6d80 on [inode 0x1000000053e [2,head] /dc-dir/dc-file_841 auth v5684 s=3 n(v0 rc2023-10-03T19:16:11.402500+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6d9600] now 0 2023-10-03T19:21:00.518 INFO:teuthology.orchestra.run.smithi045.stdout: -8472> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5685 cv=5553/5553 ap=159+158 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=66 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d5c6d80 count now 159/158 2023-10-03T19:21:00.518 INFO:teuthology.orchestra.run.smithi045.stdout: -8471> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.518 INFO:teuthology.orchestra.run.smithi045.stdout: -8470> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.518 INFO:teuthology.orchestra.run.smithi045.stdout: -8469> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000053f [2,head] /dc-dir/dc-file_842 auth v4130 pv5686 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.414840+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.414840+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6d9b80] 2023-10-03T19:21:00.518 INFO:teuthology.orchestra.run.smithi045.stdout: -8468> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5692 2023-10-03T19:21:00.518 INFO:teuthology.orchestra.run.smithi045.stdout: -8467> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5692 pv6006 ap=159 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=159) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=158) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.519 INFO:teuthology.orchestra.run.smithi045.stdout: -8466> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5690 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.519 INFO:teuthology.orchestra.run.smithi045.stdout: -8465> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5691 cv=5559/5559 REP dir_auth=0 ap=158+159 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5691 2023-10-03T19:21:00.526 INFO:teuthology.orchestra.run.smithi045.stdout: -8464> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000053f) pop_and_dirty_projected_inode v5686 2023-10-03T19:21:00.526 INFO:teuthology.orchestra.run.smithi045.stdout: -8463> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000053f) mark_dirty [inode 0x1000000053f [2,head] /dc-dir/dc-file_842 auth v5686 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.414840+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6d9b80] 2023-10-03T19:21:00.527 INFO:teuthology.orchestra.run.smithi045.stdout: -8462> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_842) mark_dirty [dentry #0x1/dc-dir/dc-file_842 [2,head] auth (dversion lock) pv=5686 v=4130 ino=0x1000000053f state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6dc780] 2023-10-03T19:21:00.527 INFO:teuthology.orchestra.run.smithi045.stdout: -8461> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5685 cv=5553/5553 ap=159+158 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=67 | child=1 dirty=1 authpin=1 0x55576d056400] version 5685 2023-10-03T19:21:00.527 INFO:teuthology.orchestra.run.smithi045.stdout: -8460> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d53fa00 v5693 2023-10-03T19:21:00.527 INFO:teuthology.orchestra.run.smithi045.stdout: -8459> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5693 cv=5559/5559 REP dir_auth=0 ap=158+159 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5693 2023-10-03T19:21:00.527 INFO:teuthology.orchestra.run.smithi045.stdout: -8458> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d555c40 v5687 2023-10-03T19:21:00.527 INFO:teuthology.orchestra.run.smithi045.stdout: -8457> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5687 cv=5553/5553 ap=159+158 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=67 | child=1 dirty=1 authpin=1 0x55576d056400] version 5687 2023-10-03T19:21:00.527 INFO:teuthology.orchestra.run.smithi045.stdout: -8456> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=158 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=158 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.527 INFO:teuthology.orchestra.run.smithi045.stdout: -8455> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=158) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5692 pv6006 ap=159 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=159) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=158) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.527 INFO:teuthology.orchestra.run.smithi045.stdout: -8454> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=159) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5692 pv6006 ap=159 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=159) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=157) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.527 INFO:teuthology.orchestra.run.smithi045.stdout: -8453> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000053f [2,head] /dc-dir/dc-file_842 auth v5686 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.414840+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6d9b80] 2023-10-03T19:21:00.527 INFO:teuthology.orchestra.run.smithi045.stdout: -8452> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000053f [2,head] /dc-dir/dc-file_842 auth v5686 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.414840+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6d9b80] 2023-10-03T19:21:00.528 INFO:teuthology.orchestra.run.smithi045.stdout: -8451> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.528 INFO:teuthology.orchestra.run.smithi045.stdout: -8450> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.528 INFO:teuthology.orchestra.run.smithi045.stdout: -8449> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.528 INFO:teuthology.orchestra.run.smithi045.stdout: -8448> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000053f [2,head] /dc-dir/dc-file_842 auth v5686 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.414840+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6d9b80] 2023-10-03T19:21:00.528 INFO:teuthology.orchestra.run.smithi045.stdout: -8447> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000053f [2,head] /dc-dir/dc-file_842 auth v5686 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.414840+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6d9b80] 2023-10-03T19:21:00.528 INFO:teuthology.orchestra.run.smithi045.stdout: -8446> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.528 INFO:teuthology.orchestra.run.smithi045.stdout: -8445> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 256.91, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.57e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.52e-01] *LOAD:516.8] 2023-10-03T19:21:00.528 INFO:teuthology.orchestra.run.smithi045.stdout: -8444> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2b3200 on [dir 0x1 / [2,head] auth pv=6007 v=5693 cv=5559/5559 REP dir_auth=0 ap=157+159 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 157 2023-10-03T19:21:00.528 INFO:teuthology.orchestra.run.smithi045.stdout: -8443> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2b3200 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5692 pv6006 ap=158 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=158) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=157) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 158 2023-10-03T19:21:00.528 INFO:teuthology.orchestra.run.smithi045.stdout: -8442> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5693 cv=5559/5559 REP dir_auth=0 ap=157+158 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2b3200 count now 157/158 2023-10-03T19:21:00.528 INFO:teuthology.orchestra.run.smithi045.stdout: -8441> 2023-10-03T19:16:28.774+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2b3200 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5687 cv=5553/5553 ap=158+158 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=67 | child=1 dirty=1 authpin=1 0x55576d056400] count now 158 2023-10-03T19:21:00.529 INFO:teuthology.orchestra.run.smithi045.stdout: -8440> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000053f) auth_unpin by 0x55576d2b3200 on [inode 0x1000000053f [2,head] /dc-dir/dc-file_842 auth v5686 s=3 n(v0 rc2023-10-03T19:16:11.414840+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6d9b80] now 0 2023-10-03T19:21:00.529 INFO:teuthology.orchestra.run.smithi045.stdout: -8439> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5687 cv=5553/5553 ap=158+157 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=67 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2b3200 count now 158/157 2023-10-03T19:21:00.529 INFO:teuthology.orchestra.run.smithi045.stdout: -8438> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.529 INFO:teuthology.orchestra.run.smithi045.stdout: -8437> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.529 INFO:teuthology.orchestra.run.smithi045.stdout: -8436> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000540 [2,head] /dc-dir/dc-file_843 auth v4134 pv5688 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.427532+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.427532+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6da100] 2023-10-03T19:21:00.529 INFO:teuthology.orchestra.run.smithi045.stdout: -8435> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5694 2023-10-03T19:21:00.529 INFO:teuthology.orchestra.run.smithi045.stdout: -8434> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5694 pv6006 ap=158 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=158) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=157) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.529 INFO:teuthology.orchestra.run.smithi045.stdout: -8433> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5692 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.529 INFO:teuthology.orchestra.run.smithi045.stdout: -8432> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5693 cv=5559/5559 REP dir_auth=0 ap=157+158 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5693 2023-10-03T19:21:00.529 INFO:teuthology.orchestra.run.smithi045.stdout: -8431> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000540) pop_and_dirty_projected_inode v5688 2023-10-03T19:21:00.529 INFO:teuthology.orchestra.run.smithi045.stdout: -8430> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000540) mark_dirty [inode 0x10000000540 [2,head] /dc-dir/dc-file_843 auth v5688 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.427532+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6da100] 2023-10-03T19:21:00.529 INFO:teuthology.orchestra.run.smithi045.stdout: -8429> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_843) mark_dirty [dentry #0x1/dc-dir/dc-file_843 [2,head] auth (dversion lock) pv=5688 v=4134 ino=0x10000000540 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6dca00] 2023-10-03T19:21:00.530 INFO:teuthology.orchestra.run.smithi045.stdout: -8428> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5687 cv=5553/5553 ap=158+157 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=68 | child=1 dirty=1 authpin=1 0x55576d056400] version 5687 2023-10-03T19:21:00.530 INFO:teuthology.orchestra.run.smithi045.stdout: -8427> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d53fc40 v5695 2023-10-03T19:21:00.530 INFO:teuthology.orchestra.run.smithi045.stdout: -8426> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5695 cv=5559/5559 REP dir_auth=0 ap=157+158 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5695 2023-10-03T19:21:00.530 INFO:teuthology.orchestra.run.smithi045.stdout: -8425> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d5556a0 v5689 2023-10-03T19:21:00.530 INFO:teuthology.orchestra.run.smithi045.stdout: -8424> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5689 cv=5553/5553 ap=158+157 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=68 | child=1 dirty=1 authpin=1 0x55576d056400] version 5689 2023-10-03T19:21:00.530 INFO:teuthology.orchestra.run.smithi045.stdout: -8423> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=157 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=157 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.530 INFO:teuthology.orchestra.run.smithi045.stdout: -8422> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=157) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5694 pv6006 ap=158 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=158) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=157) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.530 INFO:teuthology.orchestra.run.smithi045.stdout: -8421> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=158) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5694 pv6006 ap=158 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=158) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=156) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.562 INFO:teuthology.orchestra.run.smithi045.stdout: -8420> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000540 [2,head] /dc-dir/dc-file_843 auth v5688 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.427532+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6da100] 2023-10-03T19:21:00.562 INFO:teuthology.orchestra.run.smithi045.stdout: -8419> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000540 [2,head] /dc-dir/dc-file_843 auth v5688 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.427532+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6da100] 2023-10-03T19:21:00.562 INFO:teuthology.orchestra.run.smithi045.stdout: -8418> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.562 INFO:teuthology.orchestra.run.smithi045.stdout: -8417> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.562 INFO:teuthology.orchestra.run.smithi045.stdout: -8416> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.562 INFO:teuthology.orchestra.run.smithi045.stdout: -8415> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000540 [2,head] /dc-dir/dc-file_843 auth v5688 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.427532+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6da100] 2023-10-03T19:21:00.562 INFO:teuthology.orchestra.run.smithi045.stdout: -8414> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000540 [2,head] /dc-dir/dc-file_843 auth v5688 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.427532+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6da100] 2023-10-03T19:21:00.562 INFO:teuthology.orchestra.run.smithi045.stdout: -8413> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.563 INFO:teuthology.orchestra.run.smithi045.stdout: -8412> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 257.768, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.58e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:518.5] 2023-10-03T19:21:00.563 INFO:teuthology.orchestra.run.smithi045.stdout: -8411> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2a4240 on [dir 0x1 / [2,head] auth pv=6007 v=5695 cv=5559/5559 REP dir_auth=0 ap=156+158 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 156 2023-10-03T19:21:00.563 INFO:teuthology.orchestra.run.smithi045.stdout: -8410> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2a4240 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5694 pv6006 ap=157 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=157) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=156) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 157 2023-10-03T19:21:00.563 INFO:teuthology.orchestra.run.smithi045.stdout: -8409> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5695 cv=5559/5559 REP dir_auth=0 ap=156+157 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2a4240 count now 156/157 2023-10-03T19:21:00.563 INFO:teuthology.orchestra.run.smithi045.stdout: -8408> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2a4240 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5689 cv=5553/5553 ap=157+157 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=68 | child=1 dirty=1 authpin=1 0x55576d056400] count now 157 2023-10-03T19:21:00.563 INFO:teuthology.orchestra.run.smithi045.stdout: -8407> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000540) auth_unpin by 0x55576d2a4240 on [inode 0x10000000540 [2,head] /dc-dir/dc-file_843 auth v5688 s=3 n(v0 rc2023-10-03T19:16:11.427532+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6da100] now 0 2023-10-03T19:21:00.563 INFO:teuthology.orchestra.run.smithi045.stdout: -8406> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5689 cv=5553/5553 ap=157+156 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=68 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2a4240 count now 157/156 2023-10-03T19:21:00.563 INFO:teuthology.orchestra.run.smithi045.stdout: -8405> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.563 INFO:teuthology.orchestra.run.smithi045.stdout: -8404> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.563 INFO:teuthology.orchestra.run.smithi045.stdout: -8403> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000541 [2,head] /dc-dir/dc-file_844 auth v4138 pv5690 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.440481+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.440481+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6da680] 2023-10-03T19:21:00.563 INFO:teuthology.orchestra.run.smithi045.stdout: -8402> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5696 2023-10-03T19:21:00.564 INFO:teuthology.orchestra.run.smithi045.stdout: -8401> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5696 pv6006 ap=157 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=157) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=156) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.564 INFO:teuthology.orchestra.run.smithi045.stdout: -8400> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5694 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.564 INFO:teuthology.orchestra.run.smithi045.stdout: -8399> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5695 cv=5559/5559 REP dir_auth=0 ap=156+157 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5695 2023-10-03T19:21:00.564 INFO:teuthology.orchestra.run.smithi045.stdout: -8398> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000541) pop_and_dirty_projected_inode v5690 2023-10-03T19:21:00.564 INFO:teuthology.orchestra.run.smithi045.stdout: -8397> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000541) mark_dirty [inode 0x10000000541 [2,head] /dc-dir/dc-file_844 auth v5690 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.440481+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6da680] 2023-10-03T19:21:00.564 INFO:teuthology.orchestra.run.smithi045.stdout: -8396> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_844) mark_dirty [dentry #0x1/dc-dir/dc-file_844 [2,head] auth (dversion lock) pv=5690 v=4138 ino=0x10000000541 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6dcc80] 2023-10-03T19:21:00.564 INFO:teuthology.orchestra.run.smithi045.stdout: -8395> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5689 cv=5553/5553 ap=157+156 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=69 | child=1 dirty=1 authpin=1 0x55576d056400] version 5689 2023-10-03T19:21:00.564 INFO:teuthology.orchestra.run.smithi045.stdout: -8394> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d53fe80 v5697 2023-10-03T19:21:00.564 INFO:teuthology.orchestra.run.smithi045.stdout: -8393> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5697 cv=5559/5559 REP dir_auth=0 ap=156+157 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5697 2023-10-03T19:21:00.564 INFO:teuthology.orchestra.run.smithi045.stdout: -8392> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d555a00 v5691 2023-10-03T19:21:00.564 INFO:teuthology.orchestra.run.smithi045.stdout: -8391> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5691 cv=5553/5553 ap=157+156 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=69 | child=1 dirty=1 authpin=1 0x55576d056400] version 5691 2023-10-03T19:21:00.565 INFO:teuthology.orchestra.run.smithi045.stdout: -8390> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=156 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=156 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.565 INFO:teuthology.orchestra.run.smithi045.stdout: -8389> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=156) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5696 pv6006 ap=157 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=157) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=156) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.565 INFO:teuthology.orchestra.run.smithi045.stdout: -8388> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=157) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5696 pv6006 ap=157 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=157) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=155) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.565 INFO:teuthology.orchestra.run.smithi045.stdout: -8387> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000541 [2,head] /dc-dir/dc-file_844 auth v5690 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.440481+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6da680] 2023-10-03T19:21:00.565 INFO:teuthology.orchestra.run.smithi045.stdout: -8386> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000541 [2,head] /dc-dir/dc-file_844 auth v5690 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.440481+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6da680] 2023-10-03T19:21:00.565 INFO:teuthology.orchestra.run.smithi045.stdout: -8385> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.565 INFO:teuthology.orchestra.run.smithi045.stdout: -8384> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.565 INFO:teuthology.orchestra.run.smithi045.stdout: -8383> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.576 INFO:teuthology.orchestra.run.smithi045.stdout: -8382> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000541 [2,head] /dc-dir/dc-file_844 auth v5690 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.440481+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6da680] 2023-10-03T19:21:00.576 INFO:teuthology.orchestra.run.smithi045.stdout: -8381> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000541 [2,head] /dc-dir/dc-file_844 auth v5690 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.440481+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6da680] 2023-10-03T19:21:00.576 INFO:teuthology.orchestra.run.smithi045.stdout: -8380> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.576 INFO:teuthology.orchestra.run.smithi045.stdout: -8379> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 258.768, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.59e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:520.5] 2023-10-03T19:21:00.576 INFO:teuthology.orchestra.run.smithi045.stdout: -8378> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d538000 on [dir 0x1 / [2,head] auth pv=6007 v=5697 cv=5559/5559 REP dir_auth=0 ap=155+157 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 155 2023-10-03T19:21:00.577 INFO:teuthology.orchestra.run.smithi045.stdout: -8377> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d538000 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5691 cv=5553/5553 ap=156+156 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=69 | child=1 dirty=1 authpin=1 0x55576d056400] count now 156 2023-10-03T19:21:00.577 INFO:teuthology.orchestra.run.smithi045.stdout: -8376> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d538000 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5696 pv6006 ap=156 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=156) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=155) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 156 2023-10-03T19:21:00.577 INFO:teuthology.orchestra.run.smithi045.stdout: -8375> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5697 cv=5559/5559 REP dir_auth=0 ap=155+156 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d538000 count now 155/156 2023-10-03T19:21:00.577 INFO:teuthology.orchestra.run.smithi045.stdout: -8374> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000541) auth_unpin by 0x55576d538000 on [inode 0x10000000541 [2,head] /dc-dir/dc-file_844 auth v5690 s=3 n(v0 rc2023-10-03T19:16:11.440481+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6da680] now 0 2023-10-03T19:21:00.577 INFO:teuthology.orchestra.run.smithi045.stdout: -8373> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5691 cv=5553/5553 ap=156+155 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=69 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d538000 count now 156/155 2023-10-03T19:21:00.577 INFO:teuthology.orchestra.run.smithi045.stdout: -8372> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.577 INFO:teuthology.orchestra.run.smithi045.stdout: -8371> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.577 INFO:teuthology.orchestra.run.smithi045.stdout: -8370> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000542 [2,head] /dc-dir/dc-file_845 auth v4142 pv5692 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.452122+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.452122+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6dac00] 2023-10-03T19:21:00.577 INFO:teuthology.orchestra.run.smithi045.stdout: -8369> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5698 2023-10-03T19:21:00.577 INFO:teuthology.orchestra.run.smithi045.stdout: -8368> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5698 pv6006 ap=156 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=156) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=155) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.578 INFO:teuthology.orchestra.run.smithi045.stdout: -8367> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5696 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.578 INFO:teuthology.orchestra.run.smithi045.stdout: -8366> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5697 cv=5559/5559 REP dir_auth=0 ap=155+156 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5697 2023-10-03T19:21:00.578 INFO:teuthology.orchestra.run.smithi045.stdout: -8365> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000542) pop_and_dirty_projected_inode v5692 2023-10-03T19:21:00.578 INFO:teuthology.orchestra.run.smithi045.stdout: -8364> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000542) mark_dirty [inode 0x10000000542 [2,head] /dc-dir/dc-file_845 auth v5692 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.452122+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6dac00] 2023-10-03T19:21:00.578 INFO:teuthology.orchestra.run.smithi045.stdout: -8363> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_845) mark_dirty [dentry #0x1/dc-dir/dc-file_845 [2,head] auth (dversion lock) pv=5692 v=4142 ino=0x10000000542 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6dcf00] 2023-10-03T19:21:00.578 INFO:teuthology.orchestra.run.smithi045.stdout: -8362> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5691 cv=5553/5553 ap=156+155 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=70 | child=1 dirty=1 authpin=1 0x55576d056400] version 5691 2023-10-03T19:21:00.578 INFO:teuthology.orchestra.run.smithi045.stdout: -8361> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d54a140 v5699 2023-10-03T19:21:00.578 INFO:teuthology.orchestra.run.smithi045.stdout: -8360> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5699 cv=5559/5559 REP dir_auth=0 ap=155+156 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5699 2023-10-03T19:21:00.578 INFO:teuthology.orchestra.run.smithi045.stdout: -8359> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d536800 v5693 2023-10-03T19:21:00.578 INFO:teuthology.orchestra.run.smithi045.stdout: -8358> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5693 cv=5553/5553 ap=156+155 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=70 | child=1 dirty=1 authpin=1 0x55576d056400] version 5693 2023-10-03T19:21:00.579 INFO:teuthology.orchestra.run.smithi045.stdout: -8357> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=155 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=155 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.579 INFO:teuthology.orchestra.run.smithi045.stdout: -8356> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=155) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5698 pv6006 ap=156 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=156) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=155) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.579 INFO:teuthology.orchestra.run.smithi045.stdout: -8355> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=156) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5698 pv6006 ap=156 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=156) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=154) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.579 INFO:teuthology.orchestra.run.smithi045.stdout: -8354> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000542 [2,head] /dc-dir/dc-file_845 auth v5692 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.452122+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6dac00] 2023-10-03T19:21:00.579 INFO:teuthology.orchestra.run.smithi045.stdout: -8353> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000542 [2,head] /dc-dir/dc-file_845 auth v5692 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.452122+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6dac00] 2023-10-03T19:21:00.579 INFO:teuthology.orchestra.run.smithi045.stdout: -8352> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.579 INFO:teuthology.orchestra.run.smithi045.stdout: -8351> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.579 INFO:teuthology.orchestra.run.smithi045.stdout: -8350> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.579 INFO:teuthology.orchestra.run.smithi045.stdout: -8349> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000542 [2,head] /dc-dir/dc-file_845 auth v5692 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.452122+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6dac00] 2023-10-03T19:21:00.579 INFO:teuthology.orchestra.run.smithi045.stdout: -8348> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000542 [2,head] /dc-dir/dc-file_845 auth v5692 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.452122+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6dac00] 2023-10-03T19:21:00.579 INFO:teuthology.orchestra.run.smithi045.stdout: -8347> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.580 INFO:teuthology.orchestra.run.smithi045.stdout: -8346> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 259.768, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.60e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:522.5] 2023-10-03T19:21:00.580 INFO:teuthology.orchestra.run.smithi045.stdout: -8345> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d096000 on [dir 0x1 / [2,head] auth pv=6007 v=5699 cv=5559/5559 REP dir_auth=0 ap=154+156 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 154 2023-10-03T19:21:00.580 INFO:teuthology.orchestra.run.smithi045.stdout: -8344> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d096000 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5698 pv6006 ap=155 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=155) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=154) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 155 2023-10-03T19:21:00.580 INFO:teuthology.orchestra.run.smithi045.stdout: -8343> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5699 cv=5559/5559 REP dir_auth=0 ap=154+155 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d096000 count now 154/155 2023-10-03T19:21:00.580 INFO:teuthology.orchestra.run.smithi045.stdout: -8342> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d096000 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5693 cv=5553/5553 ap=155+155 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=70 | child=1 dirty=1 authpin=1 0x55576d056400] count now 155 2023-10-03T19:21:00.580 INFO:teuthology.orchestra.run.smithi045.stdout: -8341> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000542) auth_unpin by 0x55576d096000 on [inode 0x10000000542 [2,head] /dc-dir/dc-file_845 auth v5692 s=3 n(v0 rc2023-10-03T19:16:11.452122+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6dac00] now 0 2023-10-03T19:21:00.580 INFO:teuthology.orchestra.run.smithi045.stdout: -8340> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5693 cv=5553/5553 ap=155+154 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=70 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d096000 count now 155/154 2023-10-03T19:21:00.580 INFO:teuthology.orchestra.run.smithi045.stdout: -8339> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.580 INFO:teuthology.orchestra.run.smithi045.stdout: -8338> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.580 INFO:teuthology.orchestra.run.smithi045.stdout: -8337> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000543 [2,head] /dc-dir/dc-file_846 auth v4146 pv5694 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.463867+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.463867+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6db180] 2023-10-03T19:21:00.675 INFO:teuthology.orchestra.run.smithi045.stdout: -8336> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5700 2023-10-03T19:21:00.675 INFO:teuthology.orchestra.run.smithi045.stdout: -8335> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5700 pv6006 ap=155 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=155) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=154) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.676 INFO:teuthology.orchestra.run.smithi045.stdout: -8334> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5698 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.676 INFO:teuthology.orchestra.run.smithi045.stdout: -8333> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5699 cv=5559/5559 REP dir_auth=0 ap=154+155 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5699 2023-10-03T19:21:00.676 INFO:teuthology.orchestra.run.smithi045.stdout: -8332> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000543) pop_and_dirty_projected_inode v5694 2023-10-03T19:21:00.676 INFO:teuthology.orchestra.run.smithi045.stdout: -8331> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000543) mark_dirty [inode 0x10000000543 [2,head] /dc-dir/dc-file_846 auth v5694 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.463867+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6db180] 2023-10-03T19:21:00.676 INFO:teuthology.orchestra.run.smithi045.stdout: -8330> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_846) mark_dirty [dentry #0x1/dc-dir/dc-file_846 [2,head] auth (dversion lock) pv=5694 v=4146 ino=0x10000000543 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6dd180] 2023-10-03T19:21:00.676 INFO:teuthology.orchestra.run.smithi045.stdout: -8329> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5693 cv=5553/5553 ap=155+154 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=71 | child=1 dirty=1 authpin=1 0x55576d056400] version 5693 2023-10-03T19:21:00.676 INFO:teuthology.orchestra.run.smithi045.stdout: -8328> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d54bb20 v5701 2023-10-03T19:21:00.676 INFO:teuthology.orchestra.run.smithi045.stdout: -8327> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5701 cv=5559/5559 REP dir_auth=0 ap=154+155 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5701 2023-10-03T19:21:00.676 INFO:teuthology.orchestra.run.smithi045.stdout: -8326> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d5365c0 v5695 2023-10-03T19:21:00.677 INFO:teuthology.orchestra.run.smithi045.stdout: -8325> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5695 cv=5553/5553 ap=155+154 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=71 | child=1 dirty=1 authpin=1 0x55576d056400] version 5695 2023-10-03T19:21:00.677 INFO:teuthology.orchestra.run.smithi045.stdout: -8324> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=154 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=154 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.677 INFO:teuthology.orchestra.run.smithi045.stdout: -8323> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=154) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5700 pv6006 ap=155 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=155) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=154) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.677 INFO:teuthology.orchestra.run.smithi045.stdout: -8322> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=155) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5700 pv6006 ap=155 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=155) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=153) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.677 INFO:teuthology.orchestra.run.smithi045.stdout: -8321> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000543 [2,head] /dc-dir/dc-file_846 auth v5694 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.463867+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6db180] 2023-10-03T19:21:00.677 INFO:teuthology.orchestra.run.smithi045.stdout: -8320> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000543 [2,head] /dc-dir/dc-file_846 auth v5694 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.463867+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6db180] 2023-10-03T19:21:00.677 INFO:teuthology.orchestra.run.smithi045.stdout: -8319> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.677 INFO:teuthology.orchestra.run.smithi045.stdout: -8318> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.677 INFO:teuthology.orchestra.run.smithi045.stdout: -8317> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.677 INFO:teuthology.orchestra.run.smithi045.stdout: -8316> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000543 [2,head] /dc-dir/dc-file_846 auth v5694 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.463867+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6db180] 2023-10-03T19:21:00.677 INFO:teuthology.orchestra.run.smithi045.stdout: -8315> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000543 [2,head] /dc-dir/dc-file_846 auth v5694 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.463867+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6db180] 2023-10-03T19:21:00.677 INFO:teuthology.orchestra.run.smithi045.stdout: -8314> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.678 INFO:teuthology.orchestra.run.smithi045.stdout: -8313> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 260.768, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.61e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:524.5] 2023-10-03T19:21:00.678 INFO:teuthology.orchestra.run.smithi045.stdout: -8312> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2a46c0 on [dir 0x1 / [2,head] auth pv=6007 v=5701 cv=5559/5559 REP dir_auth=0 ap=153+155 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 153 2023-10-03T19:21:00.678 INFO:teuthology.orchestra.run.smithi045.stdout: -8311> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2a46c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5700 pv6006 ap=154 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=154) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=153) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 154 2023-10-03T19:21:00.678 INFO:teuthology.orchestra.run.smithi045.stdout: -8310> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5701 cv=5559/5559 REP dir_auth=0 ap=153+154 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2a46c0 count now 153/154 2023-10-03T19:21:00.678 INFO:teuthology.orchestra.run.smithi045.stdout: -8309> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2a46c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5695 cv=5553/5553 ap=154+154 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=71 | child=1 dirty=1 authpin=1 0x55576d056400] count now 154 2023-10-03T19:21:00.678 INFO:teuthology.orchestra.run.smithi045.stdout: -8308> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000543) auth_unpin by 0x55576d2a46c0 on [inode 0x10000000543 [2,head] /dc-dir/dc-file_846 auth v5694 s=3 n(v0 rc2023-10-03T19:16:11.463867+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6db180] now 0 2023-10-03T19:21:00.678 INFO:teuthology.orchestra.run.smithi045.stdout: -8307> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5695 cv=5553/5553 ap=154+153 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=71 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2a46c0 count now 154/153 2023-10-03T19:21:00.678 INFO:teuthology.orchestra.run.smithi045.stdout: -8306> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.678 INFO:teuthology.orchestra.run.smithi045.stdout: -8305> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.678 INFO:teuthology.orchestra.run.smithi045.stdout: -8304> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000544 [2,head] /dc-dir/dc-file_847 auth v4150 pv5696 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.476229+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.476229+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6db700] 2023-10-03T19:21:00.679 INFO:teuthology.orchestra.run.smithi045.stdout: -8303> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5702 2023-10-03T19:21:00.679 INFO:teuthology.orchestra.run.smithi045.stdout: -8302> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5702 pv6006 ap=154 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=154) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=153) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.679 INFO:teuthology.orchestra.run.smithi045.stdout: -8301> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5700 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.679 INFO:teuthology.orchestra.run.smithi045.stdout: -8300> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5701 cv=5559/5559 REP dir_auth=0 ap=153+154 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5701 2023-10-03T19:21:00.679 INFO:teuthology.orchestra.run.smithi045.stdout: -8299> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000544) pop_and_dirty_projected_inode v5696 2023-10-03T19:21:00.679 INFO:teuthology.orchestra.run.smithi045.stdout: -8298> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000544) mark_dirty [inode 0x10000000544 [2,head] /dc-dir/dc-file_847 auth v5696 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.476229+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6db700] 2023-10-03T19:21:00.679 INFO:teuthology.orchestra.run.smithi045.stdout: -8297> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_847) mark_dirty [dentry #0x1/dc-dir/dc-file_847 [2,head] auth (dversion lock) pv=5696 v=4150 ino=0x10000000544 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6dd400] 2023-10-03T19:21:00.679 INFO:teuthology.orchestra.run.smithi045.stdout: -8296> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5695 cv=5553/5553 ap=154+153 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=72 | child=1 dirty=1 authpin=1 0x55576d056400] version 5695 2023-10-03T19:21:00.679 INFO:teuthology.orchestra.run.smithi045.stdout: -8295> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d554020 v5703 2023-10-03T19:21:00.679 INFO:teuthology.orchestra.run.smithi045.stdout: -8294> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5703 cv=5559/5559 REP dir_auth=0 ap=153+154 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5703 2023-10-03T19:21:00.679 INFO:teuthology.orchestra.run.smithi045.stdout: -8293> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d536380 v5697 2023-10-03T19:21:00.680 INFO:teuthology.orchestra.run.smithi045.stdout: -8292> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5697 cv=5553/5553 ap=154+153 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=72 | child=1 dirty=1 authpin=1 0x55576d056400] version 5697 2023-10-03T19:21:00.680 INFO:teuthology.orchestra.run.smithi045.stdout: -8291> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=153 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=153 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.680 INFO:teuthology.orchestra.run.smithi045.stdout: -8290> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=153) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5702 pv6006 ap=154 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=154) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=153) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.680 INFO:teuthology.orchestra.run.smithi045.stdout: -8289> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=154) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5702 pv6006 ap=154 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=154) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=152) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.691 INFO:teuthology.orchestra.run.smithi045.stdout: -8288> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000544 [2,head] /dc-dir/dc-file_847 auth v5696 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.476229+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6db700] 2023-10-03T19:21:00.691 INFO:teuthology.orchestra.run.smithi045.stdout: -8287> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000544 [2,head] /dc-dir/dc-file_847 auth v5696 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.476229+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6db700] 2023-10-03T19:21:00.691 INFO:teuthology.orchestra.run.smithi045.stdout: -8286> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.691 INFO:teuthology.orchestra.run.smithi045.stdout: -8285> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.691 INFO:teuthology.orchestra.run.smithi045.stdout: -8284> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.691 INFO:teuthology.orchestra.run.smithi045.stdout: -8283> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000544 [2,head] /dc-dir/dc-file_847 auth v5696 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.476229+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6db700] 2023-10-03T19:21:00.691 INFO:teuthology.orchestra.run.smithi045.stdout: -8282> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000544 [2,head] /dc-dir/dc-file_847 auth v5696 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.476229+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6db700] 2023-10-03T19:21:00.692 INFO:teuthology.orchestra.run.smithi045.stdout: -8281> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.692 INFO:teuthology.orchestra.run.smithi045.stdout: -8280> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 261.768, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.62e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:526.5] 2023-10-03T19:21:00.692 INFO:teuthology.orchestra.run.smithi045.stdout: -8279> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d5c6480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5702 pv6006 ap=153 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=153) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=152) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 153 2023-10-03T19:21:00.692 INFO:teuthology.orchestra.run.smithi045.stdout: -8278> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5703 cv=5559/5559 REP dir_auth=0 ap=153+153 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d5c6480 count now 153/153 2023-10-03T19:21:00.692 INFO:teuthology.orchestra.run.smithi045.stdout: -8277> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d5c6480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5697 cv=5553/5553 ap=153+153 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=72 | child=1 dirty=1 authpin=1 0x55576d056400] count now 153 2023-10-03T19:21:00.692 INFO:teuthology.orchestra.run.smithi045.stdout: -8276> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d5c6480 on [dir 0x1 / [2,head] auth pv=6007 v=5703 cv=5559/5559 REP dir_auth=0 ap=152+153 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 152 2023-10-03T19:21:00.692 INFO:teuthology.orchestra.run.smithi045.stdout: -8275> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000544) auth_unpin by 0x55576d5c6480 on [inode 0x10000000544 [2,head] /dc-dir/dc-file_847 auth v5696 s=3 n(v0 rc2023-10-03T19:16:11.476229+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6db700] now 0 2023-10-03T19:21:00.692 INFO:teuthology.orchestra.run.smithi045.stdout: -8274> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5697 cv=5553/5553 ap=153+152 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=72 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d5c6480 count now 153/152 2023-10-03T19:21:00.692 INFO:teuthology.orchestra.run.smithi045.stdout: -8273> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.692 INFO:teuthology.orchestra.run.smithi045.stdout: -8272> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.692 INFO:teuthology.orchestra.run.smithi045.stdout: -8271> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000545 [2,head] /dc-dir/dc-file_848 auth v4154 pv5698 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.488215+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.488215+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6e2000] 2023-10-03T19:21:00.693 INFO:teuthology.orchestra.run.smithi045.stdout: -8270> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5704 2023-10-03T19:21:00.693 INFO:teuthology.orchestra.run.smithi045.stdout: -8269> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5704 pv6006 ap=153 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=153) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=152) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.693 INFO:teuthology.orchestra.run.smithi045.stdout: -8268> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5702 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.693 INFO:teuthology.orchestra.run.smithi045.stdout: -8267> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5703 cv=5559/5559 REP dir_auth=0 ap=152+153 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5703 2023-10-03T19:21:00.693 INFO:teuthology.orchestra.run.smithi045.stdout: -8266> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000545) pop_and_dirty_projected_inode v5698 2023-10-03T19:21:00.693 INFO:teuthology.orchestra.run.smithi045.stdout: -8265> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000545) mark_dirty [inode 0x10000000545 [2,head] /dc-dir/dc-file_848 auth v5698 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.488215+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6e2000] 2023-10-03T19:21:00.693 INFO:teuthology.orchestra.run.smithi045.stdout: -8264> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_848) mark_dirty [dentry #0x1/dc-dir/dc-file_848 [2,head] auth (dversion lock) pv=5698 v=4154 ino=0x10000000545 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6dd680] 2023-10-03T19:21:00.693 INFO:teuthology.orchestra.run.smithi045.stdout: -8263> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5697 cv=5553/5553 ap=153+152 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=73 | child=1 dirty=1 authpin=1 0x55576d056400] version 5697 2023-10-03T19:21:00.693 INFO:teuthology.orchestra.run.smithi045.stdout: -8262> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d5544a0 v5705 2023-10-03T19:21:00.693 INFO:teuthology.orchestra.run.smithi045.stdout: -8261> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5705 cv=5559/5559 REP dir_auth=0 ap=152+153 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5705 2023-10-03T19:21:00.693 INFO:teuthology.orchestra.run.smithi045.stdout: -8260> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d554260 v5699 2023-10-03T19:21:00.694 INFO:teuthology.orchestra.run.smithi045.stdout: -8259> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5699 cv=5553/5553 ap=153+152 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=73 | child=1 dirty=1 authpin=1 0x55576d056400] version 5699 2023-10-03T19:21:00.694 INFO:teuthology.orchestra.run.smithi045.stdout: -8258> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=152 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=152 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.694 INFO:teuthology.orchestra.run.smithi045.stdout: -8257> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=152) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5704 pv6006 ap=153 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=153) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=152) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.694 INFO:teuthology.orchestra.run.smithi045.stdout: -8256> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=153) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5704 pv6006 ap=153 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=153) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=151) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.694 INFO:teuthology.orchestra.run.smithi045.stdout: -8255> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000545 [2,head] /dc-dir/dc-file_848 auth v5698 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.488215+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e2000] 2023-10-03T19:21:00.694 INFO:teuthology.orchestra.run.smithi045.stdout: -8254> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000545 [2,head] /dc-dir/dc-file_848 auth v5698 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.488215+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e2000] 2023-10-03T19:21:00.694 INFO:teuthology.orchestra.run.smithi045.stdout: -8253> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.694 INFO:teuthology.orchestra.run.smithi045.stdout: -8252> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.694 INFO:teuthology.orchestra.run.smithi045.stdout: -8251> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.694 INFO:teuthology.orchestra.run.smithi045.stdout: -8250> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000545 [2,head] /dc-dir/dc-file_848 auth v5698 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.488215+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e2000] 2023-10-03T19:21:00.694 INFO:teuthology.orchestra.run.smithi045.stdout: -8249> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000545 [2,head] /dc-dir/dc-file_848 auth v5698 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.488215+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e2000] 2023-10-03T19:21:00.695 INFO:teuthology.orchestra.run.smithi045.stdout: -8248> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.695 INFO:teuthology.orchestra.run.smithi045.stdout: -8247> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 262.768, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.63e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:528.5] 2023-10-03T19:21:00.695 INFO:teuthology.orchestra.run.smithi045.stdout: -8246> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d5cb8c0 on [dir 0x1 / [2,head] auth pv=6007 v=5705 cv=5559/5559 REP dir_auth=0 ap=151+153 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 151 2023-10-03T19:21:00.695 INFO:teuthology.orchestra.run.smithi045.stdout: -8245> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d5cb8c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5704 pv6006 ap=152 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=152) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=151) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 152 2023-10-03T19:21:00.719 INFO:teuthology.orchestra.run.smithi045.stdout: -8244> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5705 cv=5559/5559 REP dir_auth=0 ap=151+152 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d5cb8c0 count now 151/152 2023-10-03T19:21:00.719 INFO:teuthology.orchestra.run.smithi045.stdout: -8243> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d5cb8c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5699 cv=5553/5553 ap=152+152 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=73 | child=1 dirty=1 authpin=1 0x55576d056400] count now 152 2023-10-03T19:21:00.719 INFO:teuthology.orchestra.run.smithi045.stdout: -8242> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000545) auth_unpin by 0x55576d5cb8c0 on [inode 0x10000000545 [2,head] /dc-dir/dc-file_848 auth v5698 s=3 n(v0 rc2023-10-03T19:16:11.488215+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6e2000] now 0 2023-10-03T19:21:00.719 INFO:teuthology.orchestra.run.smithi045.stdout: -8241> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5699 cv=5553/5553 ap=152+151 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=73 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d5cb8c0 count now 152/151 2023-10-03T19:21:00.719 INFO:teuthology.orchestra.run.smithi045.stdout: -8240> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.719 INFO:teuthology.orchestra.run.smithi045.stdout: -8239> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.719 INFO:teuthology.orchestra.run.smithi045.stdout: -8238> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000546 [2,head] /dc-dir/dc-file_849 auth v4338 pv5700 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.595221+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.595221+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6e2580] 2023-10-03T19:21:00.719 INFO:teuthology.orchestra.run.smithi045.stdout: -8237> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5706 2023-10-03T19:21:00.719 INFO:teuthology.orchestra.run.smithi045.stdout: -8236> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5706 pv6006 ap=152 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=152) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=151) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.719 INFO:teuthology.orchestra.run.smithi045.stdout: -8235> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5704 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.719 INFO:teuthology.orchestra.run.smithi045.stdout: -8234> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5705 cv=5559/5559 REP dir_auth=0 ap=151+152 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5705 2023-10-03T19:21:00.720 INFO:teuthology.orchestra.run.smithi045.stdout: -8233> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000546) pop_and_dirty_projected_inode v5700 2023-10-03T19:21:00.720 INFO:teuthology.orchestra.run.smithi045.stdout: -8232> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000546) mark_dirty [inode 0x10000000546 [2,head] /dc-dir/dc-file_849 auth v5700 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.595221+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6e2580] 2023-10-03T19:21:00.720 INFO:teuthology.orchestra.run.smithi045.stdout: -8231> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_849) mark_dirty [dentry #0x1/dc-dir/dc-file_849 [2,head] auth (dversion lock) pv=5700 v=4338 ino=0x10000000546 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6dd900] 2023-10-03T19:21:00.720 INFO:teuthology.orchestra.run.smithi045.stdout: -8230> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5699 cv=5553/5553 ap=152+151 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=74 | child=1 dirty=1 authpin=1 0x55576d056400] version 5699 2023-10-03T19:21:00.720 INFO:teuthology.orchestra.run.smithi045.stdout: -8229> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d537220 v5707 2023-10-03T19:21:00.720 INFO:teuthology.orchestra.run.smithi045.stdout: -8228> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5707 cv=5559/5559 REP dir_auth=0 ap=151+152 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5707 2023-10-03T19:21:00.720 INFO:teuthology.orchestra.run.smithi045.stdout: -8227> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d54bd60 v5701 2023-10-03T19:21:00.720 INFO:teuthology.orchestra.run.smithi045.stdout: -8226> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5701 cv=5553/5553 ap=152+151 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=74 | child=1 dirty=1 authpin=1 0x55576d056400] version 5701 2023-10-03T19:21:00.720 INFO:teuthology.orchestra.run.smithi045.stdout: -8225> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=151 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=151 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.720 INFO:teuthology.orchestra.run.smithi045.stdout: -8224> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=151) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5706 pv6006 ap=152 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=152) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=151) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.720 INFO:teuthology.orchestra.run.smithi045.stdout: -8223> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=152) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5706 pv6006 ap=152 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=152) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=150) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.721 INFO:teuthology.orchestra.run.smithi045.stdout: -8222> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000546 [2,head] /dc-dir/dc-file_849 auth v5700 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.595221+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e2580] 2023-10-03T19:21:00.721 INFO:teuthology.orchestra.run.smithi045.stdout: -8221> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000546 [2,head] /dc-dir/dc-file_849 auth v5700 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.595221+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e2580] 2023-10-03T19:21:00.721 INFO:teuthology.orchestra.run.smithi045.stdout: -8220> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.721 INFO:teuthology.orchestra.run.smithi045.stdout: -8219> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.721 INFO:teuthology.orchestra.run.smithi045.stdout: -8218> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.721 INFO:teuthology.orchestra.run.smithi045.stdout: -8217> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000546 [2,head] /dc-dir/dc-file_849 auth v5700 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.595221+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e2580] 2023-10-03T19:21:00.721 INFO:teuthology.orchestra.run.smithi045.stdout: -8216> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000546 [2,head] /dc-dir/dc-file_849 auth v5700 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.595221+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e2580] 2023-10-03T19:21:00.721 INFO:teuthology.orchestra.run.smithi045.stdout: -8215> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.721 INFO:teuthology.orchestra.run.smithi045.stdout: -8214> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 263.768, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.64e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:530.5] 2023-10-03T19:21:00.721 INFO:teuthology.orchestra.run.smithi045.stdout: -8213> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d096900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5706 pv6006 ap=151 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=151) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=150) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 151 2023-10-03T19:21:00.722 INFO:teuthology.orchestra.run.smithi045.stdout: -8212> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5707 cv=5559/5559 REP dir_auth=0 ap=151+151 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d096900 count now 151/151 2023-10-03T19:21:00.722 INFO:teuthology.orchestra.run.smithi045.stdout: -8211> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d096900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5701 cv=5553/5553 ap=151+151 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=74 | child=1 dirty=1 authpin=1 0x55576d056400] count now 151 2023-10-03T19:21:00.722 INFO:teuthology.orchestra.run.smithi045.stdout: -8210> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d096900 on [dir 0x1 / [2,head] auth pv=6007 v=5707 cv=5559/5559 REP dir_auth=0 ap=150+151 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 150 2023-10-03T19:21:00.722 INFO:teuthology.orchestra.run.smithi045.stdout: -8209> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000546) auth_unpin by 0x55576d096900 on [inode 0x10000000546 [2,head] /dc-dir/dc-file_849 auth v5700 s=3 n(v0 rc2023-10-03T19:16:11.595221+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6e2580] now 0 2023-10-03T19:21:00.722 INFO:teuthology.orchestra.run.smithi045.stdout: -8208> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5701 cv=5553/5553 ap=151+150 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=74 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d096900 count now 151/150 2023-10-03T19:21:00.722 INFO:teuthology.orchestra.run.smithi045.stdout: -8207> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.722 INFO:teuthology.orchestra.run.smithi045.stdout: -8206> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.722 INFO:teuthology.orchestra.run.smithi045.stdout: -8205> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000547 [2,head] /dc-dir/dc-file_850 auth v4342 pv5702 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.625130+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.625130+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6e2b00] 2023-10-03T19:21:00.722 INFO:teuthology.orchestra.run.smithi045.stdout: -8204> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5708 2023-10-03T19:21:00.722 INFO:teuthology.orchestra.run.smithi045.stdout: -8203> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5708 pv6006 ap=151 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=151) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=150) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.722 INFO:teuthology.orchestra.run.smithi045.stdout: -8202> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5706 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.723 INFO:teuthology.orchestra.run.smithi045.stdout: -8201> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5707 cv=5559/5559 REP dir_auth=0 ap=150+151 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5707 2023-10-03T19:21:00.723 INFO:teuthology.orchestra.run.smithi045.stdout: -8200> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000547) pop_and_dirty_projected_inode v5702 2023-10-03T19:21:00.723 INFO:teuthology.orchestra.run.smithi045.stdout: -8199> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000547) mark_dirty [inode 0x10000000547 [2,head] /dc-dir/dc-file_850 auth v5702 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.625130+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6e2b00] 2023-10-03T19:21:00.723 INFO:teuthology.orchestra.run.smithi045.stdout: -8198> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_850) mark_dirty [dentry #0x1/dc-dir/dc-file_850 [2,head] auth (dversion lock) pv=5702 v=4342 ino=0x10000000547 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d6ddb80] 2023-10-03T19:21:00.723 INFO:teuthology.orchestra.run.smithi045.stdout: -8197> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5701 cv=5553/5553 ap=151+150 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=75 | child=1 dirty=1 authpin=1 0x55576d056400] version 5701 2023-10-03T19:21:00.723 INFO:teuthology.orchestra.run.smithi045.stdout: -8196> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d536fe0 v5709 2023-10-03T19:21:00.723 INFO:teuthology.orchestra.run.smithi045.stdout: -8195> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5709 cv=5559/5559 REP dir_auth=0 ap=150+151 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5709 2023-10-03T19:21:00.742 INFO:teuthology.orchestra.run.smithi045.stdout: -8194> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d54ada0 v5703 2023-10-03T19:21:00.742 INFO:teuthology.orchestra.run.smithi045.stdout: -8193> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5703 cv=5553/5553 ap=151+150 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=75 | child=1 dirty=1 authpin=1 0x55576d056400] version 5703 2023-10-03T19:21:00.742 INFO:teuthology.orchestra.run.smithi045.stdout: -8192> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=150 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=150 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.742 INFO:teuthology.orchestra.run.smithi045.stdout: -8191> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=150) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5708 pv6006 ap=151 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=151) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=150) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.743 INFO:teuthology.orchestra.run.smithi045.stdout: -8190> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=151) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5708 pv6006 ap=151 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=151) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=149) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.743 INFO:teuthology.orchestra.run.smithi045.stdout: -8189> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000547 [2,head] /dc-dir/dc-file_850 auth v5702 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.625130+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e2b00] 2023-10-03T19:21:00.743 INFO:teuthology.orchestra.run.smithi045.stdout: -8188> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000547 [2,head] /dc-dir/dc-file_850 auth v5702 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.625130+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e2b00] 2023-10-03T19:21:00.743 INFO:teuthology.orchestra.run.smithi045.stdout: -8187> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.743 INFO:teuthology.orchestra.run.smithi045.stdout: -8186> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.743 INFO:teuthology.orchestra.run.smithi045.stdout: -8185> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.743 INFO:teuthology.orchestra.run.smithi045.stdout: -8184> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000547 [2,head] /dc-dir/dc-file_850 auth v5702 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.625130+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e2b00] 2023-10-03T19:21:00.743 INFO:teuthology.orchestra.run.smithi045.stdout: -8183> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000547 [2,head] /dc-dir/dc-file_850 auth v5702 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.625130+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e2b00] 2023-10-03T19:21:00.743 INFO:teuthology.orchestra.run.smithi045.stdout: -8182> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.743 INFO:teuthology.orchestra.run.smithi045.stdout: -8181> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 264.768, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.65e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:532.5] 2023-10-03T19:21:00.744 INFO:teuthology.orchestra.run.smithi045.stdout: -8180> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d5c7200 on [dir 0x1 / [2,head] auth pv=6007 v=5709 cv=5559/5559 REP dir_auth=0 ap=149+151 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 149 2023-10-03T19:21:00.744 INFO:teuthology.orchestra.run.smithi045.stdout: -8179> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d5c7200 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5708 pv6006 ap=150 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=150) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=149) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 150 2023-10-03T19:21:00.744 INFO:teuthology.orchestra.run.smithi045.stdout: -8178> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5709 cv=5559/5559 REP dir_auth=0 ap=149+150 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d5c7200 count now 149/150 2023-10-03T19:21:00.744 INFO:teuthology.orchestra.run.smithi045.stdout: -8177> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d5c7200 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5703 cv=5553/5553 ap=150+150 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=75 | child=1 dirty=1 authpin=1 0x55576d056400] count now 150 2023-10-03T19:21:00.744 INFO:teuthology.orchestra.run.smithi045.stdout: -8176> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000547) auth_unpin by 0x55576d5c7200 on [inode 0x10000000547 [2,head] /dc-dir/dc-file_850 auth v5702 s=3 n(v0 rc2023-10-03T19:16:11.625130+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6e2b00] now 0 2023-10-03T19:21:00.744 INFO:teuthology.orchestra.run.smithi045.stdout: -8175> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5703 cv=5553/5553 ap=150+149 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=75 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d5c7200 count now 150/149 2023-10-03T19:21:00.744 INFO:teuthology.orchestra.run.smithi045.stdout: -8174> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.744 INFO:teuthology.orchestra.run.smithi045.stdout: -8173> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.744 INFO:teuthology.orchestra.run.smithi045.stdout: -8172> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000548 [2,head] /dc-dir/dc-file_851 auth v4346 pv5704 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.636347+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.636347+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6e3080] 2023-10-03T19:21:00.744 INFO:teuthology.orchestra.run.smithi045.stdout: -8171> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5710 2023-10-03T19:21:00.744 INFO:teuthology.orchestra.run.smithi045.stdout: -8170> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5710 pv6006 ap=150 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=150) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=149) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.745 INFO:teuthology.orchestra.run.smithi045.stdout: -8169> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5708 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.745 INFO:teuthology.orchestra.run.smithi045.stdout: -8168> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5709 cv=5559/5559 REP dir_auth=0 ap=149+150 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5709 2023-10-03T19:21:00.745 INFO:teuthology.orchestra.run.smithi045.stdout: -8167> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000548) pop_and_dirty_projected_inode v5704 2023-10-03T19:21:00.745 INFO:teuthology.orchestra.run.smithi045.stdout: -8166> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000548) mark_dirty [inode 0x10000000548 [2,head] /dc-dir/dc-file_851 auth v5704 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.636347+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6e3080] 2023-10-03T19:21:00.745 INFO:teuthology.orchestra.run.smithi045.stdout: -8165> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_851) mark_dirty [dentry #0x1/dc-dir/dc-file_851 [2,head] auth (dversion lock) pv=5704 v=4346 ino=0x10000000548 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d710000] 2023-10-03T19:21:00.745 INFO:teuthology.orchestra.run.smithi045.stdout: -8164> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5703 cv=5553/5553 ap=150+149 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=76 | child=1 dirty=1 authpin=1 0x55576d056400] version 5703 2023-10-03T19:21:00.745 INFO:teuthology.orchestra.run.smithi045.stdout: -8163> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d536da0 v5711 2023-10-03T19:21:00.745 INFO:teuthology.orchestra.run.smithi045.stdout: -8162> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5711 cv=5559/5559 REP dir_auth=0 ap=149+150 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5711 2023-10-03T19:21:00.745 INFO:teuthology.orchestra.run.smithi045.stdout: -8161> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d54ba00 v5705 2023-10-03T19:21:00.745 INFO:teuthology.orchestra.run.smithi045.stdout: -8160> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5705 cv=5553/5553 ap=150+149 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=76 | child=1 dirty=1 authpin=1 0x55576d056400] version 5705 2023-10-03T19:21:00.745 INFO:teuthology.orchestra.run.smithi045.stdout: -8159> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=149 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=149 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.746 INFO:teuthology.orchestra.run.smithi045.stdout: -8158> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=149) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5710 pv6006 ap=150 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=150) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=149) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.746 INFO:teuthology.orchestra.run.smithi045.stdout: -8157> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=150) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5710 pv6006 ap=150 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=150) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=148) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.746 INFO:teuthology.orchestra.run.smithi045.stdout: -8156> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000548 [2,head] /dc-dir/dc-file_851 auth v5704 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.636347+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e3080] 2023-10-03T19:21:00.746 INFO:teuthology.orchestra.run.smithi045.stdout: -8155> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000548 [2,head] /dc-dir/dc-file_851 auth v5704 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.636347+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e3080] 2023-10-03T19:21:00.746 INFO:teuthology.orchestra.run.smithi045.stdout: -8154> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.746 INFO:teuthology.orchestra.run.smithi045.stdout: -8153> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.746 INFO:teuthology.orchestra.run.smithi045.stdout: -8152> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.746 INFO:teuthology.orchestra.run.smithi045.stdout: -8151> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000548 [2,head] /dc-dir/dc-file_851 auth v5704 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.636347+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e3080] 2023-10-03T19:21:00.746 INFO:teuthology.orchestra.run.smithi045.stdout: -8150> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000548 [2,head] /dc-dir/dc-file_851 auth v5704 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.636347+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e3080] 2023-10-03T19:21:00.746 INFO:teuthology.orchestra.run.smithi045.stdout: -8149> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.747 INFO:teuthology.orchestra.run.smithi045.stdout: -8148> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 265.768, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.66e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:534.5] 2023-10-03T19:21:00.747 INFO:teuthology.orchestra.run.smithi045.stdout: -8147> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2b3b00 on [dir 0x1 / [2,head] auth pv=6007 v=5711 cv=5559/5559 REP dir_auth=0 ap=148+150 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 148 2023-10-03T19:21:00.747 INFO:teuthology.orchestra.run.smithi045.stdout: -8146> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2b3b00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5710 pv6006 ap=149 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=149) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=148) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 149 2023-10-03T19:21:00.747 INFO:teuthology.orchestra.run.smithi045.stdout: -8145> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5711 cv=5559/5559 REP dir_auth=0 ap=148+149 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2b3b00 count now 148/149 2023-10-03T19:21:00.747 INFO:teuthology.orchestra.run.smithi045.stdout: -8144> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2b3b00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5705 cv=5553/5553 ap=149+149 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=76 | child=1 dirty=1 authpin=1 0x55576d056400] count now 149 2023-10-03T19:21:00.747 INFO:teuthology.orchestra.run.smithi045.stdout: -8143> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000548) auth_unpin by 0x55576d2b3b00 on [inode 0x10000000548 [2,head] /dc-dir/dc-file_851 auth v5704 s=3 n(v0 rc2023-10-03T19:16:11.636347+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6e3080] now 0 2023-10-03T19:21:00.747 INFO:teuthology.orchestra.run.smithi045.stdout: -8142> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5705 cv=5553/5553 ap=149+148 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=76 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2b3b00 count now 149/148 2023-10-03T19:21:00.747 INFO:teuthology.orchestra.run.smithi045.stdout: -8141> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.747 INFO:teuthology.orchestra.run.smithi045.stdout: -8140> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.747 INFO:teuthology.orchestra.run.smithi045.stdout: -8139> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000549 [2,head] /dc-dir/dc-file_852 auth v4350 pv5706 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.646990+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.646990+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6e3600] 2023-10-03T19:21:00.839 INFO:teuthology.orchestra.run.smithi045.stdout: -8138> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5712 2023-10-03T19:21:00.839 INFO:teuthology.orchestra.run.smithi045.stdout: -8137> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5712 pv6006 ap=149 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=149) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=148) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.839 INFO:teuthology.orchestra.run.smithi045.stdout: -8136> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5710 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.839 INFO:teuthology.orchestra.run.smithi045.stdout: -8135> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5711 cv=5559/5559 REP dir_auth=0 ap=148+149 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5711 2023-10-03T19:21:00.839 INFO:teuthology.orchestra.run.smithi045.stdout: -8134> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000549) pop_and_dirty_projected_inode v5706 2023-10-03T19:21:00.839 INFO:teuthology.orchestra.run.smithi045.stdout: -8133> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000549) mark_dirty [inode 0x10000000549 [2,head] /dc-dir/dc-file_852 auth v5706 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.646990+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6e3600] 2023-10-03T19:21:00.839 INFO:teuthology.orchestra.run.smithi045.stdout: -8132> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_852) mark_dirty [dentry #0x1/dc-dir/dc-file_852 [2,head] auth (dversion lock) pv=5706 v=4350 ino=0x10000000549 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d710280] 2023-10-03T19:21:00.839 INFO:teuthology.orchestra.run.smithi045.stdout: -8131> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5705 cv=5553/5553 ap=149+148 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=77 | child=1 dirty=1 authpin=1 0x55576d056400] version 5705 2023-10-03T19:21:00.839 INFO:teuthology.orchestra.run.smithi045.stdout: -8130> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d536a40 v5713 2023-10-03T19:21:00.840 INFO:teuthology.orchestra.run.smithi045.stdout: -8129> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5713 cv=5559/5559 REP dir_auth=0 ap=148+149 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5713 2023-10-03T19:21:00.840 INFO:teuthology.orchestra.run.smithi045.stdout: -8128> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d54afe0 v5707 2023-10-03T19:21:00.840 INFO:teuthology.orchestra.run.smithi045.stdout: -8127> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5707 cv=5553/5553 ap=149+148 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=77 | child=1 dirty=1 authpin=1 0x55576d056400] version 5707 2023-10-03T19:21:00.840 INFO:teuthology.orchestra.run.smithi045.stdout: -8126> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=148 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=148 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.840 INFO:teuthology.orchestra.run.smithi045.stdout: -8125> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=148) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5712 pv6006 ap=149 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=149) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=148) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.840 INFO:teuthology.orchestra.run.smithi045.stdout: -8124> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=149) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5712 pv6006 ap=149 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=149) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=147) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.840 INFO:teuthology.orchestra.run.smithi045.stdout: -8123> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000549 [2,head] /dc-dir/dc-file_852 auth v5706 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.646990+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e3600] 2023-10-03T19:21:00.840 INFO:teuthology.orchestra.run.smithi045.stdout: -8122> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000549 [2,head] /dc-dir/dc-file_852 auth v5706 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.646990+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e3600] 2023-10-03T19:21:00.840 INFO:teuthology.orchestra.run.smithi045.stdout: -8121> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.841 INFO:teuthology.orchestra.run.smithi045.stdout: -8120> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.841 INFO:teuthology.orchestra.run.smithi045.stdout: -8119> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.841 INFO:teuthology.orchestra.run.smithi045.stdout: -8118> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000549 [2,head] /dc-dir/dc-file_852 auth v5706 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.646990+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e3600] 2023-10-03T19:21:00.841 INFO:teuthology.orchestra.run.smithi045.stdout: -8117> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000549 [2,head] /dc-dir/dc-file_852 auth v5706 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.646990+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e3600] 2023-10-03T19:21:00.841 INFO:teuthology.orchestra.run.smithi045.stdout: -8116> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.841 INFO:teuthology.orchestra.run.smithi045.stdout: -8115> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 266.768, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.67e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:536.5] 2023-10-03T19:21:00.841 INFO:teuthology.orchestra.run.smithi045.stdout: -8114> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d3dc900 on [dir 0x1 / [2,head] auth pv=6007 v=5713 cv=5559/5559 REP dir_auth=0 ap=147+149 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 147 2023-10-03T19:21:00.841 INFO:teuthology.orchestra.run.smithi045.stdout: -8113> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d3dc900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5712 pv6006 ap=148 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=148) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=147) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 148 2023-10-03T19:21:00.841 INFO:teuthology.orchestra.run.smithi045.stdout: -8112> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5713 cv=5559/5559 REP dir_auth=0 ap=147+148 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d3dc900 count now 147/148 2023-10-03T19:21:00.841 INFO:teuthology.orchestra.run.smithi045.stdout: -8111> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d3dc900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5707 cv=5553/5553 ap=148+148 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=77 | child=1 dirty=1 authpin=1 0x55576d056400] count now 148 2023-10-03T19:21:00.841 INFO:teuthology.orchestra.run.smithi045.stdout: -8110> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000549) auth_unpin by 0x55576d3dc900 on [inode 0x10000000549 [2,head] /dc-dir/dc-file_852 auth v5706 s=3 n(v0 rc2023-10-03T19:16:11.646990+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6e3600] now 0 2023-10-03T19:21:00.841 INFO:teuthology.orchestra.run.smithi045.stdout: -8109> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5707 cv=5553/5553 ap=148+147 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=77 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d3dc900 count now 148/147 2023-10-03T19:21:00.842 INFO:teuthology.orchestra.run.smithi045.stdout: -8108> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.842 INFO:teuthology.orchestra.run.smithi045.stdout: -8107> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.842 INFO:teuthology.orchestra.run.smithi045.stdout: -8106> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000054a [2,head] /dc-dir/dc-file_853 auth v4354 pv5708 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.658540+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.658540+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6e3b80] 2023-10-03T19:21:00.842 INFO:teuthology.orchestra.run.smithi045.stdout: -8105> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5714 2023-10-03T19:21:00.842 INFO:teuthology.orchestra.run.smithi045.stdout: -8104> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5714 pv6006 ap=148 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=148) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=147) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.842 INFO:teuthology.orchestra.run.smithi045.stdout: -8103> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5712 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.842 INFO:teuthology.orchestra.run.smithi045.stdout: -8102> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5713 cv=5559/5559 REP dir_auth=0 ap=147+148 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5713 2023-10-03T19:21:00.842 INFO:teuthology.orchestra.run.smithi045.stdout: -8101> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000054a) pop_and_dirty_projected_inode v5708 2023-10-03T19:21:00.842 INFO:teuthology.orchestra.run.smithi045.stdout: -8100> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000054a) mark_dirty [inode 0x1000000054a [2,head] /dc-dir/dc-file_853 auth v5708 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.658540+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6e3b80] 2023-10-03T19:21:00.842 INFO:teuthology.orchestra.run.smithi045.stdout: -8099> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_853) mark_dirty [dentry #0x1/dc-dir/dc-file_853 [2,head] auth (dversion lock) pv=5708 v=4354 ino=0x1000000054a state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d710500] 2023-10-03T19:21:00.843 INFO:teuthology.orchestra.run.smithi045.stdout: -8098> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5707 cv=5553/5553 ap=148+147 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=78 | child=1 dirty=1 authpin=1 0x55576d056400] version 5707 2023-10-03T19:21:00.843 INFO:teuthology.orchestra.run.smithi045.stdout: -8097> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d536b60 v5715 2023-10-03T19:21:00.843 INFO:teuthology.orchestra.run.smithi045.stdout: -8096> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5715 cv=5559/5559 REP dir_auth=0 ap=147+148 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5715 2023-10-03T19:21:00.843 INFO:teuthology.orchestra.run.smithi045.stdout: -8095> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d54b7c0 v5709 2023-10-03T19:21:00.843 INFO:teuthology.orchestra.run.smithi045.stdout: -8094> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5709 cv=5553/5553 ap=148+147 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=78 | child=1 dirty=1 authpin=1 0x55576d056400] version 5709 2023-10-03T19:21:00.843 INFO:teuthology.orchestra.run.smithi045.stdout: -8093> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=147 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=147 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.843 INFO:teuthology.orchestra.run.smithi045.stdout: -8092> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=147) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5714 pv6006 ap=148 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=148) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=147) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.843 INFO:teuthology.orchestra.run.smithi045.stdout: -8091> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=148) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5714 pv6006 ap=148 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=148) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=146) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.843 INFO:teuthology.orchestra.run.smithi045.stdout: -8090> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000054a [2,head] /dc-dir/dc-file_853 auth v5708 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.658540+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e3b80] 2023-10-03T19:21:00.843 INFO:teuthology.orchestra.run.smithi045.stdout: -8089> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000054a [2,head] /dc-dir/dc-file_853 auth v5708 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.658540+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e3b80] 2023-10-03T19:21:00.843 INFO:teuthology.orchestra.run.smithi045.stdout: -8088> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.844 INFO:teuthology.orchestra.run.smithi045.stdout: -8087> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.844 INFO:teuthology.orchestra.run.smithi045.stdout: -8086> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.844 INFO:teuthology.orchestra.run.smithi045.stdout: -8085> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000054a [2,head] /dc-dir/dc-file_853 auth v5708 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.658540+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e3b80] 2023-10-03T19:21:00.848 INFO:teuthology.orchestra.run.smithi045.stdout: -8084> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000054a [2,head] /dc-dir/dc-file_853 auth v5708 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.658540+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e3b80] 2023-10-03T19:21:00.848 INFO:teuthology.orchestra.run.smithi045.stdout: -8083> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.848 INFO:teuthology.orchestra.run.smithi045.stdout: -8082> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 267.768, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.68e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:538.5] 2023-10-03T19:21:00.848 INFO:teuthology.orchestra.run.smithi045.stdout: -8081> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d5c6900 on [dir 0x1 / [2,head] auth pv=6007 v=5715 cv=5559/5559 REP dir_auth=0 ap=146+148 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 146 2023-10-03T19:21:00.848 INFO:teuthology.orchestra.run.smithi045.stdout: -8080> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d5c6900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5714 pv6006 ap=147 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=147) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=146) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 147 2023-10-03T19:21:00.848 INFO:teuthology.orchestra.run.smithi045.stdout: -8079> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5715 cv=5559/5559 REP dir_auth=0 ap=146+147 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d5c6900 count now 146/147 2023-10-03T19:21:00.848 INFO:teuthology.orchestra.run.smithi045.stdout: -8078> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d5c6900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5709 cv=5553/5553 ap=147+147 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=78 | child=1 dirty=1 authpin=1 0x55576d056400] count now 147 2023-10-03T19:21:00.849 INFO:teuthology.orchestra.run.smithi045.stdout: -8077> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000054a) auth_unpin by 0x55576d5c6900 on [inode 0x1000000054a [2,head] /dc-dir/dc-file_853 auth v5708 s=3 n(v0 rc2023-10-03T19:16:11.658540+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6e3b80] now 0 2023-10-03T19:21:00.849 INFO:teuthology.orchestra.run.smithi045.stdout: -8076> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5709 cv=5553/5553 ap=147+146 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=78 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d5c6900 count now 147/146 2023-10-03T19:21:00.849 INFO:teuthology.orchestra.run.smithi045.stdout: -8075> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.849 INFO:teuthology.orchestra.run.smithi045.stdout: -8074> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.849 INFO:teuthology.orchestra.run.smithi045.stdout: -8073> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000054b [2,head] /dc-dir/dc-file_854 auth v4358 pv5710 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.669517+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.669517+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6e4100] 2023-10-03T19:21:00.849 INFO:teuthology.orchestra.run.smithi045.stdout: -8072> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5716 2023-10-03T19:21:00.849 INFO:teuthology.orchestra.run.smithi045.stdout: -8071> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5716 pv6006 ap=147 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=147) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=146) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.849 INFO:teuthology.orchestra.run.smithi045.stdout: -8070> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5714 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.849 INFO:teuthology.orchestra.run.smithi045.stdout: -8069> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5715 cv=5559/5559 REP dir_auth=0 ap=146+147 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5715 2023-10-03T19:21:00.849 INFO:teuthology.orchestra.run.smithi045.stdout: -8068> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000054b) pop_and_dirty_projected_inode v5710 2023-10-03T19:21:00.849 INFO:teuthology.orchestra.run.smithi045.stdout: -8067> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000054b) mark_dirty [inode 0x1000000054b [2,head] /dc-dir/dc-file_854 auth v5710 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.669517+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6e4100] 2023-10-03T19:21:00.849 INFO:teuthology.orchestra.run.smithi045.stdout: -8066> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_854) mark_dirty [dentry #0x1/dc-dir/dc-file_854 [2,head] auth (dversion lock) pv=5710 v=4358 ino=0x1000000054b state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d710780] 2023-10-03T19:21:00.850 INFO:teuthology.orchestra.run.smithi045.stdout: -8065> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5709 cv=5553/5553 ap=147+146 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=79 | child=1 dirty=1 authpin=1 0x55576d056400] version 5709 2023-10-03T19:21:00.850 INFO:teuthology.orchestra.run.smithi045.stdout: -8064> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d536c80 v5717 2023-10-03T19:21:00.850 INFO:teuthology.orchestra.run.smithi045.stdout: -8063> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5717 cv=5559/5559 REP dir_auth=0 ap=146+147 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5717 2023-10-03T19:21:00.850 INFO:teuthology.orchestra.run.smithi045.stdout: -8062> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d54b220 v5711 2023-10-03T19:21:00.850 INFO:teuthology.orchestra.run.smithi045.stdout: -8061> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5711 cv=5553/5553 ap=147+146 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=79 | child=1 dirty=1 authpin=1 0x55576d056400] version 5711 2023-10-03T19:21:00.850 INFO:teuthology.orchestra.run.smithi045.stdout: -8060> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=146 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=146 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.850 INFO:teuthology.orchestra.run.smithi045.stdout: -8059> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=146) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5716 pv6006 ap=147 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=147) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=146) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.850 INFO:teuthology.orchestra.run.smithi045.stdout: -8058> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=147) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5716 pv6006 ap=147 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=147) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=145) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.851 INFO:teuthology.orchestra.run.smithi045.stdout: -8057> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000054b [2,head] /dc-dir/dc-file_854 auth v5710 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.669517+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e4100] 2023-10-03T19:21:00.851 INFO:teuthology.orchestra.run.smithi045.stdout: -8056> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000054b [2,head] /dc-dir/dc-file_854 auth v5710 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.669517+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e4100] 2023-10-03T19:21:00.851 INFO:teuthology.orchestra.run.smithi045.stdout: -8055> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.851 INFO:teuthology.orchestra.run.smithi045.stdout: -8054> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.851 INFO:teuthology.orchestra.run.smithi045.stdout: -8053> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.851 INFO:teuthology.orchestra.run.smithi045.stdout: -8052> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000054b [2,head] /dc-dir/dc-file_854 auth v5710 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.669517+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e4100] 2023-10-03T19:21:00.851 INFO:teuthology.orchestra.run.smithi045.stdout: -8051> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000054b [2,head] /dc-dir/dc-file_854 auth v5710 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.669517+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e4100] 2023-10-03T19:21:00.851 INFO:teuthology.orchestra.run.smithi045.stdout: -8050> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.851 INFO:teuthology.orchestra.run.smithi045.stdout: -8049> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 268.768, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.69e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:540.5] 2023-10-03T19:21:00.851 INFO:teuthology.orchestra.run.smithi045.stdout: -8048> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d5c6000 on [dir 0x1 / [2,head] auth pv=6007 v=5717 cv=5559/5559 REP dir_auth=0 ap=145+147 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 145 2023-10-03T19:21:00.851 INFO:teuthology.orchestra.run.smithi045.stdout: -8047> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d5c6000 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5716 pv6006 ap=146 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=146) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=145) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 146 2023-10-03T19:21:00.851 INFO:teuthology.orchestra.run.smithi045.stdout: -8046> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5717 cv=5559/5559 REP dir_auth=0 ap=145+146 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d5c6000 count now 145/146 2023-10-03T19:21:00.852 INFO:teuthology.orchestra.run.smithi045.stdout: -8045> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d5c6000 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5711 cv=5553/5553 ap=146+146 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=79 | child=1 dirty=1 authpin=1 0x55576d056400] count now 146 2023-10-03T19:21:00.852 INFO:teuthology.orchestra.run.smithi045.stdout: -8044> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000054b) auth_unpin by 0x55576d5c6000 on [inode 0x1000000054b [2,head] /dc-dir/dc-file_854 auth v5710 s=3 n(v0 rc2023-10-03T19:16:11.669517+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6e4100] now 0 2023-10-03T19:21:00.852 INFO:teuthology.orchestra.run.smithi045.stdout: -8043> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5711 cv=5553/5553 ap=146+145 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=79 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d5c6000 count now 146/145 2023-10-03T19:21:00.852 INFO:teuthology.orchestra.run.smithi045.stdout: -8042> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.852 INFO:teuthology.orchestra.run.smithi045.stdout: -8041> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.852 INFO:teuthology.orchestra.run.smithi045.stdout: -8040> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000054c [2,head] /dc-dir/dc-file_855 auth v4362 pv5712 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.680284+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.680284+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6e4680] 2023-10-03T19:21:00.852 INFO:teuthology.orchestra.run.smithi045.stdout: -8039> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5718 2023-10-03T19:21:00.852 INFO:teuthology.orchestra.run.smithi045.stdout: -8038> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5718 pv6006 ap=146 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=146) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=145) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.852 INFO:teuthology.orchestra.run.smithi045.stdout: -8037> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5716 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.852 INFO:teuthology.orchestra.run.smithi045.stdout: -8036> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5717 cv=5559/5559 REP dir_auth=0 ap=145+146 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5717 2023-10-03T19:21:00.853 INFO:teuthology.orchestra.run.smithi045.stdout: -8035> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000054c) pop_and_dirty_projected_inode v5712 2023-10-03T19:21:00.853 INFO:teuthology.orchestra.run.smithi045.stdout: -8034> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000054c) mark_dirty [inode 0x1000000054c [2,head] /dc-dir/dc-file_855 auth v5712 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.680284+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6e4680] 2023-10-03T19:21:00.853 INFO:teuthology.orchestra.run.smithi045.stdout: -8033> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_855) mark_dirty [dentry #0x1/dc-dir/dc-file_855 [2,head] auth (dversion lock) pv=5712 v=4362 ino=0x1000000054c state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d710a00] 2023-10-03T19:21:00.853 INFO:teuthology.orchestra.run.smithi045.stdout: -8032> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5711 cv=5553/5553 ap=146+145 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=80 | child=1 dirty=1 authpin=1 0x55576d056400] version 5711 2023-10-03T19:21:00.853 INFO:teuthology.orchestra.run.smithi045.stdout: -8031> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d536920 v5719 2023-10-03T19:21:00.853 INFO:teuthology.orchestra.run.smithi045.stdout: -8030> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5719 cv=5559/5559 REP dir_auth=0 ap=145+146 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5719 2023-10-03T19:21:00.853 INFO:teuthology.orchestra.run.smithi045.stdout: -8029> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d54b580 v5713 2023-10-03T19:21:00.853 INFO:teuthology.orchestra.run.smithi045.stdout: -8028> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5713 cv=5553/5553 ap=146+145 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=80 | child=1 dirty=1 authpin=1 0x55576d056400] version 5713 2023-10-03T19:21:00.853 INFO:teuthology.orchestra.run.smithi045.stdout: -8027> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=145 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=145 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.853 INFO:teuthology.orchestra.run.smithi045.stdout: -8026> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=145) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5718 pv6006 ap=146 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=146) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=145) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.853 INFO:teuthology.orchestra.run.smithi045.stdout: -8025> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=146) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5718 pv6006 ap=146 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=146) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=144) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.854 INFO:teuthology.orchestra.run.smithi045.stdout: -8024> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000054c [2,head] /dc-dir/dc-file_855 auth v5712 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.680284+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e4680] 2023-10-03T19:21:00.854 INFO:teuthology.orchestra.run.smithi045.stdout: -8023> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000054c [2,head] /dc-dir/dc-file_855 auth v5712 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.680284+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e4680] 2023-10-03T19:21:00.854 INFO:teuthology.orchestra.run.smithi045.stdout: -8022> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.854 INFO:teuthology.orchestra.run.smithi045.stdout: -8021> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.854 INFO:teuthology.orchestra.run.smithi045.stdout: -8020> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.854 INFO:teuthology.orchestra.run.smithi045.stdout: -8019> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000054c [2,head] /dc-dir/dc-file_855 auth v5712 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.680284+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e4680] 2023-10-03T19:21:00.854 INFO:teuthology.orchestra.run.smithi045.stdout: -8018> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000054c [2,head] /dc-dir/dc-file_855 auth v5712 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.680284+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e4680] 2023-10-03T19:21:00.854 INFO:teuthology.orchestra.run.smithi045.stdout: -8017> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.854 INFO:teuthology.orchestra.run.smithi045.stdout: -8016> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 269.768, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.70e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:542.5] 2023-10-03T19:21:00.854 INFO:teuthology.orchestra.run.smithi045.stdout: -8015> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d096fc0 on [dir 0x1 / [2,head] auth pv=6007 v=5719 cv=5559/5559 REP dir_auth=0 ap=144+146 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 144 2023-10-03T19:21:00.855 INFO:teuthology.orchestra.run.smithi045.stdout: -8014> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d096fc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5718 pv6006 ap=145 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=145) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=144) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 145 2023-10-03T19:21:00.855 INFO:teuthology.orchestra.run.smithi045.stdout: -8013> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5719 cv=5559/5559 REP dir_auth=0 ap=144+145 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d096fc0 count now 144/145 2023-10-03T19:21:00.855 INFO:teuthology.orchestra.run.smithi045.stdout: -8012> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d096fc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5713 cv=5553/5553 ap=145+145 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=80 | child=1 dirty=1 authpin=1 0x55576d056400] count now 145 2023-10-03T19:21:00.855 INFO:teuthology.orchestra.run.smithi045.stdout: -8011> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000054c) auth_unpin by 0x55576d096fc0 on [inode 0x1000000054c [2,head] /dc-dir/dc-file_855 auth v5712 s=3 n(v0 rc2023-10-03T19:16:11.680284+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6e4680] now 0 2023-10-03T19:21:00.855 INFO:teuthology.orchestra.run.smithi045.stdout: -8010> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5713 cv=5553/5553 ap=145+144 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=80 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d096fc0 count now 145/144 2023-10-03T19:21:00.855 INFO:teuthology.orchestra.run.smithi045.stdout: -8009> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.855 INFO:teuthology.orchestra.run.smithi045.stdout: -8008> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.855 INFO:teuthology.orchestra.run.smithi045.stdout: -8007> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000054d [2,head] /dc-dir/dc-file_856 auth v4366 pv5714 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.691578+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.691578+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6e4c00] 2023-10-03T19:21:00.855 INFO:teuthology.orchestra.run.smithi045.stdout: -8006> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5720 2023-10-03T19:21:00.855 INFO:teuthology.orchestra.run.smithi045.stdout: -8005> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5720 pv6006 ap=145 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=145) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=144) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.855 INFO:teuthology.orchestra.run.smithi045.stdout: -8004> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5718 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.856 INFO:teuthology.orchestra.run.smithi045.stdout: -8003> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5719 cv=5559/5559 REP dir_auth=0 ap=144+145 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5719 2023-10-03T19:21:00.856 INFO:teuthology.orchestra.run.smithi045.stdout: -8002> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000054d) pop_and_dirty_projected_inode v5714 2023-10-03T19:21:00.856 INFO:teuthology.orchestra.run.smithi045.stdout: -8001> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000054d) mark_dirty [inode 0x1000000054d [2,head] /dc-dir/dc-file_856 auth v5714 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.691578+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6e4c00] 2023-10-03T19:21:00.856 INFO:teuthology.orchestra.run.smithi045.stdout: -8000> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_856) mark_dirty [dentry #0x1/dc-dir/dc-file_856 [2,head] auth (dversion lock) pv=5714 v=4366 ino=0x1000000054d state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d710c80] 2023-10-03T19:21:00.856 INFO:teuthology.orchestra.run.smithi045.stdout: -7999> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5713 cv=5553/5553 ap=145+144 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=81 | child=1 dirty=1 authpin=1 0x55576d056400] version 5713 2023-10-03T19:21:00.856 INFO:teuthology.orchestra.run.smithi045.stdout: -7998> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d536ec0 v5721 2023-10-03T19:21:00.856 INFO:teuthology.orchestra.run.smithi045.stdout: -7997> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5721 cv=5559/5559 REP dir_auth=0 ap=144+145 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5721 2023-10-03T19:21:00.856 INFO:teuthology.orchestra.run.smithi045.stdout: -7996> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d54b460 v5715 2023-10-03T19:21:00.856 INFO:teuthology.orchestra.run.smithi045.stdout: -7995> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5715 cv=5553/5553 ap=145+144 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=81 | child=1 dirty=1 authpin=1 0x55576d056400] version 5715 2023-10-03T19:21:00.856 INFO:teuthology.orchestra.run.smithi045.stdout: -7994> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=144 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=144 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.857 INFO:teuthology.orchestra.run.smithi045.stdout: -7993> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=144) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5720 pv6006 ap=145 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=145) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=144) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.857 INFO:teuthology.orchestra.run.smithi045.stdout: -7992> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=145) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5720 pv6006 ap=145 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=145) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=143) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.857 INFO:teuthology.orchestra.run.smithi045.stdout: -7991> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000054d [2,head] /dc-dir/dc-file_856 auth v5714 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.691578+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e4c00] 2023-10-03T19:21:00.857 INFO:teuthology.orchestra.run.smithi045.stdout: -7990> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000054d [2,head] /dc-dir/dc-file_856 auth v5714 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.691578+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e4c00] 2023-10-03T19:21:00.857 INFO:teuthology.orchestra.run.smithi045.stdout: -7989> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.857 INFO:teuthology.orchestra.run.smithi045.stdout: -7988> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.857 INFO:teuthology.orchestra.run.smithi045.stdout: -7987> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.857 INFO:teuthology.orchestra.run.smithi045.stdout: -7986> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000054d [2,head] /dc-dir/dc-file_856 auth v5714 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.691578+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e4c00] 2023-10-03T19:21:00.857 INFO:teuthology.orchestra.run.smithi045.stdout: -7985> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000054d [2,head] /dc-dir/dc-file_856 auth v5714 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.691578+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e4c00] 2023-10-03T19:21:00.857 INFO:teuthology.orchestra.run.smithi045.stdout: -7984> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.857 INFO:teuthology.orchestra.run.smithi045.stdout: -7983> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 270.768, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.71e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:544.5] 2023-10-03T19:21:00.858 INFO:teuthology.orchestra.run.smithi045.stdout: -7982> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2a4900 on [dir 0x1 / [2,head] auth pv=6007 v=5721 cv=5559/5559 REP dir_auth=0 ap=143+145 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 143 2023-10-03T19:21:00.858 INFO:teuthology.orchestra.run.smithi045.stdout: -7981> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2a4900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5720 pv6006 ap=144 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=144) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=143) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 144 2023-10-03T19:21:00.858 INFO:teuthology.orchestra.run.smithi045.stdout: -7980> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5721 cv=5559/5559 REP dir_auth=0 ap=143+144 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2a4900 count now 143/144 2023-10-03T19:21:00.858 INFO:teuthology.orchestra.run.smithi045.stdout: -7979> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2a4900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5715 cv=5553/5553 ap=144+144 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=81 | child=1 dirty=1 authpin=1 0x55576d056400] count now 144 2023-10-03T19:21:00.858 INFO:teuthology.orchestra.run.smithi045.stdout: -7978> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000054d) auth_unpin by 0x55576d2a4900 on [inode 0x1000000054d [2,head] /dc-dir/dc-file_856 auth v5714 s=3 n(v0 rc2023-10-03T19:16:11.691578+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6e4c00] now 0 2023-10-03T19:21:00.858 INFO:teuthology.orchestra.run.smithi045.stdout: -7977> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5715 cv=5553/5553 ap=144+143 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=81 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2a4900 count now 144/143 2023-10-03T19:21:00.858 INFO:teuthology.orchestra.run.smithi045.stdout: -7976> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.858 INFO:teuthology.orchestra.run.smithi045.stdout: -7975> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.858 INFO:teuthology.orchestra.run.smithi045.stdout: -7974> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000054e [2,head] /dc-dir/dc-file_857 auth v4370 pv5716 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.702601+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.702601+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6e5180] 2023-10-03T19:21:00.858 INFO:teuthology.orchestra.run.smithi045.stdout: -7973> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5722 2023-10-03T19:21:00.858 INFO:teuthology.orchestra.run.smithi045.stdout: -7972> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5722 pv6006 ap=144 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=144) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=143) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.859 INFO:teuthology.orchestra.run.smithi045.stdout: -7971> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5720 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.859 INFO:teuthology.orchestra.run.smithi045.stdout: -7970> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5721 cv=5559/5559 REP dir_auth=0 ap=143+144 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5721 2023-10-03T19:21:00.895 INFO:teuthology.orchestra.run.smithi045.stdout: -7969> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000054e) pop_and_dirty_projected_inode v5716 2023-10-03T19:21:00.895 INFO:teuthology.orchestra.run.smithi045.stdout: -7968> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000054e) mark_dirty [inode 0x1000000054e [2,head] /dc-dir/dc-file_857 auth v5716 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.702601+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6e5180] 2023-10-03T19:21:00.895 INFO:teuthology.orchestra.run.smithi045.stdout: -7967> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_857) mark_dirty [dentry #0x1/dc-dir/dc-file_857 [2,head] auth (dversion lock) pv=5716 v=4370 ino=0x1000000054e state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d710f00] 2023-10-03T19:21:00.895 INFO:teuthology.orchestra.run.smithi045.stdout: -7966> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5715 cv=5553/5553 ap=144+143 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=82 | child=1 dirty=1 authpin=1 0x55576d056400] version 5715 2023-10-03T19:21:00.895 INFO:teuthology.orchestra.run.smithi045.stdout: -7965> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d5d7c40 v5723 2023-10-03T19:21:00.895 INFO:teuthology.orchestra.run.smithi045.stdout: -7964> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5723 cv=5559/5559 REP dir_auth=0 ap=143+144 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5723 2023-10-03T19:21:00.895 INFO:teuthology.orchestra.run.smithi045.stdout: -7963> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d54b340 v5717 2023-10-03T19:21:00.896 INFO:teuthology.orchestra.run.smithi045.stdout: -7962> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5717 cv=5553/5553 ap=144+143 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=82 | child=1 dirty=1 authpin=1 0x55576d056400] version 5717 2023-10-03T19:21:00.896 INFO:teuthology.orchestra.run.smithi045.stdout: -7961> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=143 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=143 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.896 INFO:teuthology.orchestra.run.smithi045.stdout: -7960> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=143) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5722 pv6006 ap=144 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=144) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=143) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.896 INFO:teuthology.orchestra.run.smithi045.stdout: -7959> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=144) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5722 pv6006 ap=144 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=144) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=142) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.896 INFO:teuthology.orchestra.run.smithi045.stdout: -7958> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000054e [2,head] /dc-dir/dc-file_857 auth v5716 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.702601+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e5180] 2023-10-03T19:21:00.896 INFO:teuthology.orchestra.run.smithi045.stdout: -7957> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000054e [2,head] /dc-dir/dc-file_857 auth v5716 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.702601+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e5180] 2023-10-03T19:21:00.896 INFO:teuthology.orchestra.run.smithi045.stdout: -7956> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.896 INFO:teuthology.orchestra.run.smithi045.stdout: -7955> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.896 INFO:teuthology.orchestra.run.smithi045.stdout: -7954> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.896 INFO:teuthology.orchestra.run.smithi045.stdout: -7953> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000054e [2,head] /dc-dir/dc-file_857 auth v5716 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.702601+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e5180] 2023-10-03T19:21:00.896 INFO:teuthology.orchestra.run.smithi045.stdout: -7952> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000054e [2,head] /dc-dir/dc-file_857 auth v5716 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.702601+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e5180] 2023-10-03T19:21:00.897 INFO:teuthology.orchestra.run.smithi045.stdout: -7951> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.897 INFO:teuthology.orchestra.run.smithi045.stdout: -7950> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 271.768, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.72e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:546.5] 2023-10-03T19:21:00.897 INFO:teuthology.orchestra.run.smithi045.stdout: -7949> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d5c6240 on [dir 0x1 / [2,head] auth pv=6007 v=5723 cv=5559/5559 REP dir_auth=0 ap=142+144 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 142 2023-10-03T19:21:00.897 INFO:teuthology.orchestra.run.smithi045.stdout: -7948> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d5c6240 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5722 pv6006 ap=143 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=143) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=142) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 143 2023-10-03T19:21:00.897 INFO:teuthology.orchestra.run.smithi045.stdout: -7947> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5723 cv=5559/5559 REP dir_auth=0 ap=142+143 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d5c6240 count now 142/143 2023-10-03T19:21:00.897 INFO:teuthology.orchestra.run.smithi045.stdout: -7946> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d5c6240 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5717 cv=5553/5553 ap=143+143 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=82 | child=1 dirty=1 authpin=1 0x55576d056400] count now 143 2023-10-03T19:21:00.897 INFO:teuthology.orchestra.run.smithi045.stdout: -7945> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000054e) auth_unpin by 0x55576d5c6240 on [inode 0x1000000054e [2,head] /dc-dir/dc-file_857 auth v5716 s=3 n(v0 rc2023-10-03T19:16:11.702601+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6e5180] now 0 2023-10-03T19:21:00.897 INFO:teuthology.orchestra.run.smithi045.stdout: -7944> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5717 cv=5553/5553 ap=143+142 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=82 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d5c6240 count now 143/142 2023-10-03T19:21:00.897 INFO:teuthology.orchestra.run.smithi045.stdout: -7943> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.898 INFO:teuthology.orchestra.run.smithi045.stdout: -7942> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.898 INFO:teuthology.orchestra.run.smithi045.stdout: -7941> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000054f [2,head] /dc-dir/dc-file_858 auth v4374 pv5718 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.713477+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.713477+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6e5700] 2023-10-03T19:21:00.898 INFO:teuthology.orchestra.run.smithi045.stdout: -7940> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5724 2023-10-03T19:21:00.898 INFO:teuthology.orchestra.run.smithi045.stdout: -7939> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5724 pv6006 ap=143 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=143) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=142) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.898 INFO:teuthology.orchestra.run.smithi045.stdout: -7938> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5722 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.898 INFO:teuthology.orchestra.run.smithi045.stdout: -7937> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5723 cv=5559/5559 REP dir_auth=0 ap=142+143 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5723 2023-10-03T19:21:00.898 INFO:teuthology.orchestra.run.smithi045.stdout: -7936> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000054f) pop_and_dirty_projected_inode v5718 2023-10-03T19:21:00.898 INFO:teuthology.orchestra.run.smithi045.stdout: -7935> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000054f) mark_dirty [inode 0x1000000054f [2,head] /dc-dir/dc-file_858 auth v5718 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.713477+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d6e5700] 2023-10-03T19:21:00.898 INFO:teuthology.orchestra.run.smithi045.stdout: -7934> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_858) mark_dirty [dentry #0x1/dc-dir/dc-file_858 [2,head] auth (dversion lock) pv=5718 v=4374 ino=0x1000000054f state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d711180] 2023-10-03T19:21:00.898 INFO:teuthology.orchestra.run.smithi045.stdout: -7933> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5717 cv=5553/5553 ap=143+142 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=83 | child=1 dirty=1 authpin=1 0x55576d056400] version 5717 2023-10-03T19:21:00.898 INFO:teuthology.orchestra.run.smithi045.stdout: -7932> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d5d78e0 v5725 2023-10-03T19:21:00.899 INFO:teuthology.orchestra.run.smithi045.stdout: -7931> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5725 cv=5559/5559 REP dir_auth=0 ap=142+143 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5725 2023-10-03T19:21:00.899 INFO:teuthology.orchestra.run.smithi045.stdout: -7930> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d54b6a0 v5719 2023-10-03T19:21:00.899 INFO:teuthology.orchestra.run.smithi045.stdout: -7929> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5719 cv=5553/5553 ap=143+142 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=83 | child=1 dirty=1 authpin=1 0x55576d056400] version 5719 2023-10-03T19:21:00.899 INFO:teuthology.orchestra.run.smithi045.stdout: -7928> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=142 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=142 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.899 INFO:teuthology.orchestra.run.smithi045.stdout: -7927> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=142) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5724 pv6006 ap=143 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=143) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=142) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.899 INFO:teuthology.orchestra.run.smithi045.stdout: -7926> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=143) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5724 pv6006 ap=143 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=143) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=141) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.899 INFO:teuthology.orchestra.run.smithi045.stdout: -7925> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000054f [2,head] /dc-dir/dc-file_858 auth v5718 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.713477+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e5700] 2023-10-03T19:21:00.899 INFO:teuthology.orchestra.run.smithi045.stdout: -7924> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000054f [2,head] /dc-dir/dc-file_858 auth v5718 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.713477+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e5700] 2023-10-03T19:21:00.899 INFO:teuthology.orchestra.run.smithi045.stdout: -7923> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.899 INFO:teuthology.orchestra.run.smithi045.stdout: -7922> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.900 INFO:teuthology.orchestra.run.smithi045.stdout: -7921> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.900 INFO:teuthology.orchestra.run.smithi045.stdout: -7920> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000054f [2,head] /dc-dir/dc-file_858 auth v5718 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.713477+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e5700] 2023-10-03T19:21:00.900 INFO:teuthology.orchestra.run.smithi045.stdout: -7919> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000054f [2,head] /dc-dir/dc-file_858 auth v5718 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.713477+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d6e5700] 2023-10-03T19:21:00.900 INFO:teuthology.orchestra.run.smithi045.stdout: -7918> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.900 INFO:teuthology.orchestra.run.smithi045.stdout: -7917> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 272.768, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.73e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:548.5] 2023-10-03T19:21:00.900 INFO:teuthology.orchestra.run.smithi045.stdout: -7916> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d539b00 on [dir 0x1 / [2,head] auth pv=6007 v=5725 cv=5559/5559 REP dir_auth=0 ap=141+143 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 141 2023-10-03T19:21:00.900 INFO:teuthology.orchestra.run.smithi045.stdout: -7915> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d539b00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5724 pv6006 ap=142 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=142) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=141) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 142 2023-10-03T19:21:00.900 INFO:teuthology.orchestra.run.smithi045.stdout: -7914> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5725 cv=5559/5559 REP dir_auth=0 ap=141+142 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d539b00 count now 141/142 2023-10-03T19:21:00.900 INFO:teuthology.orchestra.run.smithi045.stdout: -7913> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d539b00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5719 cv=5553/5553 ap=142+142 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=83 | child=1 dirty=1 authpin=1 0x55576d056400] count now 142 2023-10-03T19:21:00.900 INFO:teuthology.orchestra.run.smithi045.stdout: -7912> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000054f) auth_unpin by 0x55576d539b00 on [inode 0x1000000054f [2,head] /dc-dir/dc-file_858 auth v5718 s=3 n(v0 rc2023-10-03T19:16:11.713477+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6e5700] now 0 2023-10-03T19:21:00.900 INFO:teuthology.orchestra.run.smithi045.stdout: -7911> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5719 cv=5553/5553 ap=142+141 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=83 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d539b00 count now 142/141 2023-10-03T19:21:00.901 INFO:teuthology.orchestra.run.smithi045.stdout: -7910> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.901 INFO:teuthology.orchestra.run.smithi045.stdout: -7909> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.901 INFO:teuthology.orchestra.run.smithi045.stdout: -7908> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000550 [2,head] /dc-dir/dc-file_859 auth v4378 pv5720 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.725442+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.725442+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d714000] 2023-10-03T19:21:00.901 INFO:teuthology.orchestra.run.smithi045.stdout: -7907> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5726 2023-10-03T19:21:00.901 INFO:teuthology.orchestra.run.smithi045.stdout: -7906> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5726 pv6006 ap=142 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=142) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=141) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.901 INFO:teuthology.orchestra.run.smithi045.stdout: -7905> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5724 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.901 INFO:teuthology.orchestra.run.smithi045.stdout: -7904> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5725 cv=5559/5559 REP dir_auth=0 ap=141+142 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5725 2023-10-03T19:21:00.901 INFO:teuthology.orchestra.run.smithi045.stdout: -7903> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000550) pop_and_dirty_projected_inode v5720 2023-10-03T19:21:00.902 INFO:teuthology.orchestra.run.smithi045.stdout: -7902> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000550) mark_dirty [inode 0x10000000550 [2,head] /dc-dir/dc-file_859 auth v5720 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.725442+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d714000] 2023-10-03T19:21:00.902 INFO:teuthology.orchestra.run.smithi045.stdout: -7901> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_859) mark_dirty [dentry #0x1/dc-dir/dc-file_859 [2,head] auth (dversion lock) pv=5720 v=4378 ino=0x10000000550 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d711400] 2023-10-03T19:21:00.902 INFO:teuthology.orchestra.run.smithi045.stdout: -7900> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5719 cv=5553/5553 ap=142+141 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=84 | child=1 dirty=1 authpin=1 0x55576d056400] version 5719 2023-10-03T19:21:00.902 INFO:teuthology.orchestra.run.smithi045.stdout: -7899> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d5d7a00 v5727 2023-10-03T19:21:00.902 INFO:teuthology.orchestra.run.smithi045.stdout: -7898> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5727 cv=5559/5559 REP dir_auth=0 ap=141+142 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5727 2023-10-03T19:21:00.902 INFO:teuthology.orchestra.run.smithi045.stdout: -7897> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d54b100 v5721 2023-10-03T19:21:00.902 INFO:teuthology.orchestra.run.smithi045.stdout: -7896> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5721 cv=5553/5553 ap=142+141 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=84 | child=1 dirty=1 authpin=1 0x55576d056400] version 5721 2023-10-03T19:21:00.902 INFO:teuthology.orchestra.run.smithi045.stdout: -7895> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=141 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=141 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.902 INFO:teuthology.orchestra.run.smithi045.stdout: -7894> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=141) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5726 pv6006 ap=142 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=142) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=141) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.902 INFO:teuthology.orchestra.run.smithi045.stdout: -7893> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=142) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5726 pv6006 ap=142 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=142) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=140) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.903 INFO:teuthology.orchestra.run.smithi045.stdout: -7892> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000550 [2,head] /dc-dir/dc-file_859 auth v5720 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.725442+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d714000] 2023-10-03T19:21:00.903 INFO:teuthology.orchestra.run.smithi045.stdout: -7891> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000550 [2,head] /dc-dir/dc-file_859 auth v5720 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.725442+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d714000] 2023-10-03T19:21:00.903 INFO:teuthology.orchestra.run.smithi045.stdout: -7890> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.903 INFO:teuthology.orchestra.run.smithi045.stdout: -7889> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.903 INFO:teuthology.orchestra.run.smithi045.stdout: -7888> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.903 INFO:teuthology.orchestra.run.smithi045.stdout: -7887> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000550 [2,head] /dc-dir/dc-file_859 auth v5720 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.725442+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d714000] 2023-10-03T19:21:00.903 INFO:teuthology.orchestra.run.smithi045.stdout: -7886> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000550 [2,head] /dc-dir/dc-file_859 auth v5720 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.725442+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d714000] 2023-10-03T19:21:00.903 INFO:teuthology.orchestra.run.smithi045.stdout: -7885> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.903 INFO:teuthology.orchestra.run.smithi045.stdout: -7884> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 273.768, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.74e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:550.5] 2023-10-03T19:21:00.903 INFO:teuthology.orchestra.run.smithi045.stdout: -7883> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d538b40 on [dir 0x1 / [2,head] auth pv=6007 v=5727 cv=5559/5559 REP dir_auth=0 ap=140+142 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 140 2023-10-03T19:21:00.903 INFO:teuthology.orchestra.run.smithi045.stdout: -7882> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d538b40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5726 pv6006 ap=141 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=141) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=140) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 141 2023-10-03T19:21:00.904 INFO:teuthology.orchestra.run.smithi045.stdout: -7881> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5727 cv=5559/5559 REP dir_auth=0 ap=140+141 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d538b40 count now 140/141 2023-10-03T19:21:00.904 INFO:teuthology.orchestra.run.smithi045.stdout: -7880> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d538b40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5721 cv=5553/5553 ap=141+141 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=84 | child=1 dirty=1 authpin=1 0x55576d056400] count now 141 2023-10-03T19:21:00.904 INFO:teuthology.orchestra.run.smithi045.stdout: -7879> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000550) auth_unpin by 0x55576d538b40 on [inode 0x10000000550 [2,head] /dc-dir/dc-file_859 auth v5720 s=3 n(v0 rc2023-10-03T19:16:11.725442+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d714000] now 0 2023-10-03T19:21:00.904 INFO:teuthology.orchestra.run.smithi045.stdout: -7878> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5721 cv=5553/5553 ap=141+140 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=84 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d538b40 count now 141/140 2023-10-03T19:21:00.904 INFO:teuthology.orchestra.run.smithi045.stdout: -7877> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.904 INFO:teuthology.orchestra.run.smithi045.stdout: -7876> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.904 INFO:teuthology.orchestra.run.smithi045.stdout: -7875> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000551 [2,head] /dc-dir/dc-file_860 auth v4382 pv5722 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.737733+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.737733+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d714580] 2023-10-03T19:21:00.904 INFO:teuthology.orchestra.run.smithi045.stdout: -7874> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5728 2023-10-03T19:21:00.904 INFO:teuthology.orchestra.run.smithi045.stdout: -7873> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5728 pv6006 ap=141 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=141) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=140) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.904 INFO:teuthology.orchestra.run.smithi045.stdout: -7872> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5726 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.905 INFO:teuthology.orchestra.run.smithi045.stdout: -7871> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5727 cv=5559/5559 REP dir_auth=0 ap=140+141 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5727 2023-10-03T19:21:00.905 INFO:teuthology.orchestra.run.smithi045.stdout: -7870> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000551) pop_and_dirty_projected_inode v5722 2023-10-03T19:21:00.905 INFO:teuthology.orchestra.run.smithi045.stdout: -7869> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000551) mark_dirty [inode 0x10000000551 [2,head] /dc-dir/dc-file_860 auth v5722 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.737733+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d714580] 2023-10-03T19:21:00.905 INFO:teuthology.orchestra.run.smithi045.stdout: -7868> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_860) mark_dirty [dentry #0x1/dc-dir/dc-file_860 [2,head] auth (dversion lock) pv=5722 v=4382 ino=0x10000000551 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d711680] 2023-10-03T19:21:00.905 INFO:teuthology.orchestra.run.smithi045.stdout: -7867> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5721 cv=5553/5553 ap=141+140 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=85 | child=1 dirty=1 authpin=1 0x55576d056400] version 5721 2023-10-03T19:21:00.905 INFO:teuthology.orchestra.run.smithi045.stdout: -7866> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d5d7b20 v5729 2023-10-03T19:21:00.905 INFO:teuthology.orchestra.run.smithi045.stdout: -7865> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5729 cv=5559/5559 REP dir_auth=0 ap=140+141 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5729 2023-10-03T19:21:00.905 INFO:teuthology.orchestra.run.smithi045.stdout: -7864> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d54b8e0 v5723 2023-10-03T19:21:00.905 INFO:teuthology.orchestra.run.smithi045.stdout: -7863> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5723 cv=5553/5553 ap=141+140 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=85 | child=1 dirty=1 authpin=1 0x55576d056400] version 5723 2023-10-03T19:21:00.905 INFO:teuthology.orchestra.run.smithi045.stdout: -7862> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=140 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=140 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.905 INFO:teuthology.orchestra.run.smithi045.stdout: -7861> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=140) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5728 pv6006 ap=141 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=141) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=140) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.906 INFO:teuthology.orchestra.run.smithi045.stdout: -7860> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=141) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5728 pv6006 ap=141 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=141) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=139) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.906 INFO:teuthology.orchestra.run.smithi045.stdout: -7859> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000551 [2,head] /dc-dir/dc-file_860 auth v5722 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.737733+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d714580] 2023-10-03T19:21:00.994 INFO:teuthology.orchestra.run.smithi045.stdout: -7858> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000551 [2,head] /dc-dir/dc-file_860 auth v5722 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.737733+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d714580] 2023-10-03T19:21:00.994 INFO:teuthology.orchestra.run.smithi045.stdout: -7857> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.995 INFO:teuthology.orchestra.run.smithi045.stdout: -7856> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.995 INFO:teuthology.orchestra.run.smithi045.stdout: -7855> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.995 INFO:teuthology.orchestra.run.smithi045.stdout: -7854> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000551 [2,head] /dc-dir/dc-file_860 auth v5722 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.737733+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d714580] 2023-10-03T19:21:00.995 INFO:teuthology.orchestra.run.smithi045.stdout: -7853> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000551 [2,head] /dc-dir/dc-file_860 auth v5722 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.737733+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d714580] 2023-10-03T19:21:00.995 INFO:teuthology.orchestra.run.smithi045.stdout: -7852> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.995 INFO:teuthology.orchestra.run.smithi045.stdout: -7851> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 274.768, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.75e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:552.5] 2023-10-03T19:21:00.995 INFO:teuthology.orchestra.run.smithi045.stdout: -7850> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2a5680 on [dir 0x1 / [2,head] auth pv=6007 v=5729 cv=5559/5559 REP dir_auth=0 ap=139+141 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 139 2023-10-03T19:21:00.995 INFO:teuthology.orchestra.run.smithi045.stdout: -7849> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2a5680 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5728 pv6006 ap=140 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=140) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=139) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 140 2023-10-03T19:21:00.995 INFO:teuthology.orchestra.run.smithi045.stdout: -7848> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5729 cv=5559/5559 REP dir_auth=0 ap=139+140 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2a5680 count now 139/140 2023-10-03T19:21:00.995 INFO:teuthology.orchestra.run.smithi045.stdout: -7847> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2a5680 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5723 cv=5553/5553 ap=140+140 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=85 | child=1 dirty=1 authpin=1 0x55576d056400] count now 140 2023-10-03T19:21:00.995 INFO:teuthology.orchestra.run.smithi045.stdout: -7846> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000551) auth_unpin by 0x55576d2a5680 on [inode 0x10000000551 [2,head] /dc-dir/dc-file_860 auth v5722 s=3 n(v0 rc2023-10-03T19:16:11.737733+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d714580] now 0 2023-10-03T19:21:00.995 INFO:teuthology.orchestra.run.smithi045.stdout: -7845> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5723 cv=5553/5553 ap=140+139 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=85 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2a5680 count now 140/139 2023-10-03T19:21:00.996 INFO:teuthology.orchestra.run.smithi045.stdout: -7844> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.996 INFO:teuthology.orchestra.run.smithi045.stdout: -7843> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.996 INFO:teuthology.orchestra.run.smithi045.stdout: -7842> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000552 [2,head] /dc-dir/dc-file_861 auth v4386 pv5724 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.749466+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.749466+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d714b00] 2023-10-03T19:21:00.996 INFO:teuthology.orchestra.run.smithi045.stdout: -7841> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5730 2023-10-03T19:21:00.996 INFO:teuthology.orchestra.run.smithi045.stdout: -7840> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5730 pv6006 ap=140 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=140) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=139) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.996 INFO:teuthology.orchestra.run.smithi045.stdout: -7839> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5728 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.996 INFO:teuthology.orchestra.run.smithi045.stdout: -7838> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5729 cv=5559/5559 REP dir_auth=0 ap=139+140 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5729 2023-10-03T19:21:00.996 INFO:teuthology.orchestra.run.smithi045.stdout: -7837> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000552) pop_and_dirty_projected_inode v5724 2023-10-03T19:21:00.996 INFO:teuthology.orchestra.run.smithi045.stdout: -7836> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000552) mark_dirty [inode 0x10000000552 [2,head] /dc-dir/dc-file_861 auth v5724 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.749466+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d714b00] 2023-10-03T19:21:00.996 INFO:teuthology.orchestra.run.smithi045.stdout: -7835> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_861) mark_dirty [dentry #0x1/dc-dir/dc-file_861 [2,head] auth (dversion lock) pv=5724 v=4386 ino=0x10000000552 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d711900] 2023-10-03T19:21:00.997 INFO:teuthology.orchestra.run.smithi045.stdout: -7834> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5723 cv=5553/5553 ap=140+139 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=86 | child=1 dirty=1 authpin=1 0x55576d056400] version 5723 2023-10-03T19:21:00.997 INFO:teuthology.orchestra.run.smithi045.stdout: -7833> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d5d77c0 v5731 2023-10-03T19:21:00.997 INFO:teuthology.orchestra.run.smithi045.stdout: -7832> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5731 cv=5559/5559 REP dir_auth=0 ap=139+140 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5731 2023-10-03T19:21:00.997 INFO:teuthology.orchestra.run.smithi045.stdout: -7831> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d5d6ec0 v5725 2023-10-03T19:21:00.997 INFO:teuthology.orchestra.run.smithi045.stdout: -7830> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5725 cv=5553/5553 ap=140+139 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=86 | child=1 dirty=1 authpin=1 0x55576d056400] version 5725 2023-10-03T19:21:00.997 INFO:teuthology.orchestra.run.smithi045.stdout: -7829> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=139 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=139 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:00.997 INFO:teuthology.orchestra.run.smithi045.stdout: -7828> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=139) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5730 pv6006 ap=140 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=140) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=139) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.997 INFO:teuthology.orchestra.run.smithi045.stdout: -7827> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=140) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5730 pv6006 ap=140 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=140) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=138) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.997 INFO:teuthology.orchestra.run.smithi045.stdout: -7826> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000552 [2,head] /dc-dir/dc-file_861 auth v5724 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.749466+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d714b00] 2023-10-03T19:21:00.997 INFO:teuthology.orchestra.run.smithi045.stdout: -7825> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000552 [2,head] /dc-dir/dc-file_861 auth v5724 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.749466+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d714b00] 2023-10-03T19:21:00.997 INFO:teuthology.orchestra.run.smithi045.stdout: -7824> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:00.998 INFO:teuthology.orchestra.run.smithi045.stdout: -7823> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:00.998 INFO:teuthology.orchestra.run.smithi045.stdout: -7822> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:00.998 INFO:teuthology.orchestra.run.smithi045.stdout: -7821> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000552 [2,head] /dc-dir/dc-file_861 auth v5724 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.749466+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d714b00] 2023-10-03T19:21:00.998 INFO:teuthology.orchestra.run.smithi045.stdout: -7820> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000552 [2,head] /dc-dir/dc-file_861 auth v5724 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.749466+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d714b00] 2023-10-03T19:21:00.998 INFO:teuthology.orchestra.run.smithi045.stdout: -7819> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:00.998 INFO:teuthology.orchestra.run.smithi045.stdout: -7818> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 275.768, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.76e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:554.5] 2023-10-03T19:21:00.998 INFO:teuthology.orchestra.run.smithi045.stdout: -7817> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2aa900 on [dir 0x1 / [2,head] auth pv=6007 v=5731 cv=5559/5559 REP dir_auth=0 ap=138+140 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 138 2023-10-03T19:21:00.998 INFO:teuthology.orchestra.run.smithi045.stdout: -7816> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2aa900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5730 pv6006 ap=139 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=139) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=138) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 139 2023-10-03T19:21:00.998 INFO:teuthology.orchestra.run.smithi045.stdout: -7815> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5731 cv=5559/5559 REP dir_auth=0 ap=138+139 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2aa900 count now 138/139 2023-10-03T19:21:00.998 INFO:teuthology.orchestra.run.smithi045.stdout: -7814> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2aa900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5725 cv=5553/5553 ap=139+139 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=86 | child=1 dirty=1 authpin=1 0x55576d056400] count now 139 2023-10-03T19:21:00.999 INFO:teuthology.orchestra.run.smithi045.stdout: -7813> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000552) auth_unpin by 0x55576d2aa900 on [inode 0x10000000552 [2,head] /dc-dir/dc-file_861 auth v5724 s=3 n(v0 rc2023-10-03T19:16:11.749466+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d714b00] now 0 2023-10-03T19:21:00.999 INFO:teuthology.orchestra.run.smithi045.stdout: -7812> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5725 cv=5553/5553 ap=139+138 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=86 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2aa900 count now 139/138 2023-10-03T19:21:00.999 INFO:teuthology.orchestra.run.smithi045.stdout: -7811> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.999 INFO:teuthology.orchestra.run.smithi045.stdout: -7810> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:00.999 INFO:teuthology.orchestra.run.smithi045.stdout: -7809> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000553 [2,head] /dc-dir/dc-file_862 auth v4390 pv5726 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.760678+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.760678+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d715080] 2023-10-03T19:21:00.999 INFO:teuthology.orchestra.run.smithi045.stdout: -7808> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5732 2023-10-03T19:21:00.999 INFO:teuthology.orchestra.run.smithi045.stdout: -7807> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5732 pv6006 ap=139 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=139) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=138) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:00.999 INFO:teuthology.orchestra.run.smithi045.stdout: -7806> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5730 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:00.999 INFO:teuthology.orchestra.run.smithi045.stdout: -7805> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5731 cv=5559/5559 REP dir_auth=0 ap=138+139 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5731 2023-10-03T19:21:00.999 INFO:teuthology.orchestra.run.smithi045.stdout: -7804> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000553) pop_and_dirty_projected_inode v5726 2023-10-03T19:21:00.999 INFO:teuthology.orchestra.run.smithi045.stdout: -7803> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000553) mark_dirty [inode 0x10000000553 [2,head] /dc-dir/dc-file_862 auth v5726 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.760678+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d715080] 2023-10-03T19:21:01.000 INFO:teuthology.orchestra.run.smithi045.stdout: -7802> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_862) mark_dirty [dentry #0x1/dc-dir/dc-file_862 [2,head] auth (dversion lock) pv=5726 v=4390 ino=0x10000000553 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d711b80] 2023-10-03T19:21:01.000 INFO:teuthology.orchestra.run.smithi045.stdout: -7801> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5725 cv=5553/5553 ap=139+138 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=87 | child=1 dirty=1 authpin=1 0x55576d056400] version 5725 2023-10-03T19:21:01.006 INFO:teuthology.orchestra.run.smithi045.stdout: -7800> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d537460 v5733 2023-10-03T19:21:01.006 INFO:teuthology.orchestra.run.smithi045.stdout: -7799> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5733 cv=5559/5559 REP dir_auth=0 ap=138+139 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5733 2023-10-03T19:21:01.006 INFO:teuthology.orchestra.run.smithi045.stdout: -7798> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d5d6a40 v5727 2023-10-03T19:21:01.006 INFO:teuthology.orchestra.run.smithi045.stdout: -7797> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5727 cv=5553/5553 ap=139+138 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=87 | child=1 dirty=1 authpin=1 0x55576d056400] version 5727 2023-10-03T19:21:01.006 INFO:teuthology.orchestra.run.smithi045.stdout: -7796> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=138 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=138 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.006 INFO:teuthology.orchestra.run.smithi045.stdout: -7795> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=138) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5732 pv6006 ap=139 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=139) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=138) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.006 INFO:teuthology.orchestra.run.smithi045.stdout: -7794> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=139) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5732 pv6006 ap=139 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=139) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=137) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.007 INFO:teuthology.orchestra.run.smithi045.stdout: -7793> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000553 [2,head] /dc-dir/dc-file_862 auth v5726 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.760678+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d715080] 2023-10-03T19:21:01.007 INFO:teuthology.orchestra.run.smithi045.stdout: -7792> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000553 [2,head] /dc-dir/dc-file_862 auth v5726 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.760678+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d715080] 2023-10-03T19:21:01.007 INFO:teuthology.orchestra.run.smithi045.stdout: -7791> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.007 INFO:teuthology.orchestra.run.smithi045.stdout: -7790> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.007 INFO:teuthology.orchestra.run.smithi045.stdout: -7789> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.007 INFO:teuthology.orchestra.run.smithi045.stdout: -7788> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000553 [2,head] /dc-dir/dc-file_862 auth v5726 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.760678+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d715080] 2023-10-03T19:21:01.007 INFO:teuthology.orchestra.run.smithi045.stdout: -7787> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000553 [2,head] /dc-dir/dc-file_862 auth v5726 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.760678+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d715080] 2023-10-03T19:21:01.007 INFO:teuthology.orchestra.run.smithi045.stdout: -7786> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.007 INFO:teuthology.orchestra.run.smithi045.stdout: -7785> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 276.768, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.77e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:556.5] 2023-10-03T19:21:01.008 INFO:teuthology.orchestra.run.smithi045.stdout: -7784> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2aa240 on [dir 0x1 / [2,head] auth pv=6007 v=5733 cv=5559/5559 REP dir_auth=0 ap=137+139 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 137 2023-10-03T19:21:01.008 INFO:teuthology.orchestra.run.smithi045.stdout: -7783> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2aa240 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5732 pv6006 ap=138 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=138) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=137) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 138 2023-10-03T19:21:01.008 INFO:teuthology.orchestra.run.smithi045.stdout: -7782> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5733 cv=5559/5559 REP dir_auth=0 ap=137+138 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2aa240 count now 137/138 2023-10-03T19:21:01.008 INFO:teuthology.orchestra.run.smithi045.stdout: -7781> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2aa240 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5727 cv=5553/5553 ap=138+138 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=87 | child=1 dirty=1 authpin=1 0x55576d056400] count now 138 2023-10-03T19:21:01.008 INFO:teuthology.orchestra.run.smithi045.stdout: -7780> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000553) auth_unpin by 0x55576d2aa240 on [inode 0x10000000553 [2,head] /dc-dir/dc-file_862 auth v5726 s=3 n(v0 rc2023-10-03T19:16:11.760678+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d715080] now 0 2023-10-03T19:21:01.008 INFO:teuthology.orchestra.run.smithi045.stdout: -7779> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5727 cv=5553/5553 ap=138+137 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=87 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2aa240 count now 138/137 2023-10-03T19:21:01.008 INFO:teuthology.orchestra.run.smithi045.stdout: -7778> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.008 INFO:teuthology.orchestra.run.smithi045.stdout: -7777> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.008 INFO:teuthology.orchestra.run.smithi045.stdout: -7776> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000554 [2,head] /dc-dir/dc-file_863 auth v4394 pv5728 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.773179+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.773179+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d715600] 2023-10-03T19:21:01.008 INFO:teuthology.orchestra.run.smithi045.stdout: -7775> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5734 2023-10-03T19:21:01.008 INFO:teuthology.orchestra.run.smithi045.stdout: -7774> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5734 pv6006 ap=138 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=138) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=137) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.008 INFO:teuthology.orchestra.run.smithi045.stdout: -7773> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5732 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.009 INFO:teuthology.orchestra.run.smithi045.stdout: -7772> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5733 cv=5559/5559 REP dir_auth=0 ap=137+138 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5733 2023-10-03T19:21:01.009 INFO:teuthology.orchestra.run.smithi045.stdout: -7771> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000554) pop_and_dirty_projected_inode v5728 2023-10-03T19:21:01.009 INFO:teuthology.orchestra.run.smithi045.stdout: -7770> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000554) mark_dirty [inode 0x10000000554 [2,head] /dc-dir/dc-file_863 auth v5728 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.773179+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d715600] 2023-10-03T19:21:01.009 INFO:teuthology.orchestra.run.smithi045.stdout: -7769> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_863) mark_dirty [dentry #0x1/dc-dir/dc-file_863 [2,head] auth (dversion lock) pv=5728 v=4394 ino=0x10000000554 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d718000] 2023-10-03T19:21:01.009 INFO:teuthology.orchestra.run.smithi045.stdout: -7768> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5727 cv=5553/5553 ap=138+137 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=88 | child=1 dirty=1 authpin=1 0x55576d056400] version 5727 2023-10-03T19:21:01.009 INFO:teuthology.orchestra.run.smithi045.stdout: -7767> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d5546e0 v5735 2023-10-03T19:21:01.009 INFO:teuthology.orchestra.run.smithi045.stdout: -7766> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5735 cv=5559/5559 REP dir_auth=0 ap=137+138 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5735 2023-10-03T19:21:01.009 INFO:teuthology.orchestra.run.smithi045.stdout: -7765> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d554da0 v5729 2023-10-03T19:21:01.009 INFO:teuthology.orchestra.run.smithi045.stdout: -7764> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5729 cv=5553/5553 ap=138+137 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=88 | child=1 dirty=1 authpin=1 0x55576d056400] version 5729 2023-10-03T19:21:01.009 INFO:teuthology.orchestra.run.smithi045.stdout: -7763> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=137 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=137 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.010 INFO:teuthology.orchestra.run.smithi045.stdout: -7762> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=137) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5734 pv6006 ap=138 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=138) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=137) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.010 INFO:teuthology.orchestra.run.smithi045.stdout: -7761> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=138) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5734 pv6006 ap=138 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=138) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=136) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.010 INFO:teuthology.orchestra.run.smithi045.stdout: -7760> 2023-10-03T19:16:28.778+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000554 [2,head] /dc-dir/dc-file_863 auth v5728 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.773179+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d715600] 2023-10-03T19:21:01.010 INFO:teuthology.orchestra.run.smithi045.stdout: -7759> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000554 [2,head] /dc-dir/dc-file_863 auth v5728 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.773179+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d715600] 2023-10-03T19:21:01.010 INFO:teuthology.orchestra.run.smithi045.stdout: -7758> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.010 INFO:teuthology.orchestra.run.smithi045.stdout: -7757> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.010 INFO:teuthology.orchestra.run.smithi045.stdout: -7756> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.010 INFO:teuthology.orchestra.run.smithi045.stdout: -7755> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000554 [2,head] /dc-dir/dc-file_863 auth v5728 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.773179+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d715600] 2023-10-03T19:21:01.010 INFO:teuthology.orchestra.run.smithi045.stdout: -7754> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000554 [2,head] /dc-dir/dc-file_863 auth v5728 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.773179+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d715600] 2023-10-03T19:21:01.010 INFO:teuthology.orchestra.run.smithi045.stdout: -7753> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.010 INFO:teuthology.orchestra.run.smithi045.stdout: -7752> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 277.614, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.78e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:558.2] 2023-10-03T19:21:01.011 INFO:teuthology.orchestra.run.smithi045.stdout: -7751> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d547440 on [dir 0x1 / [2,head] auth pv=6007 v=5735 cv=5559/5559 REP dir_auth=0 ap=136+138 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 136 2023-10-03T19:21:01.011 INFO:teuthology.orchestra.run.smithi045.stdout: -7750> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d547440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5734 pv6006 ap=137 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=137) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=136) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 137 2023-10-03T19:21:01.011 INFO:teuthology.orchestra.run.smithi045.stdout: -7749> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5735 cv=5559/5559 REP dir_auth=0 ap=136+137 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d547440 count now 136/137 2023-10-03T19:21:01.011 INFO:teuthology.orchestra.run.smithi045.stdout: -7748> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d547440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5729 cv=5553/5553 ap=137+137 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=88 | child=1 dirty=1 authpin=1 0x55576d056400] count now 137 2023-10-03T19:21:01.011 INFO:teuthology.orchestra.run.smithi045.stdout: -7747> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000554) auth_unpin by 0x55576d547440 on [inode 0x10000000554 [2,head] /dc-dir/dc-file_863 auth v5728 s=3 n(v0 rc2023-10-03T19:16:11.773179+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d715600] now 0 2023-10-03T19:21:01.011 INFO:teuthology.orchestra.run.smithi045.stdout: -7746> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5729 cv=5553/5553 ap=137+136 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=88 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d547440 count now 137/136 2023-10-03T19:21:01.049 INFO:teuthology.orchestra.run.smithi045.stdout: -7745> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.049 INFO:teuthology.orchestra.run.smithi045.stdout: -7744> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.049 INFO:teuthology.orchestra.run.smithi045.stdout: -7743> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000555 [2,head] /dc-dir/dc-file_864 auth v4398 pv5730 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.784212+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.784212+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d715b80] 2023-10-03T19:21:01.049 INFO:teuthology.orchestra.run.smithi045.stdout: -7742> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5736 2023-10-03T19:21:01.049 INFO:teuthology.orchestra.run.smithi045.stdout: -7741> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5736 pv6006 ap=137 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=137) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=136) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.050 INFO:teuthology.orchestra.run.smithi045.stdout: -7740> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5734 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.050 INFO:teuthology.orchestra.run.smithi045.stdout: -7739> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5735 cv=5559/5559 REP dir_auth=0 ap=136+137 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5735 2023-10-03T19:21:01.050 INFO:teuthology.orchestra.run.smithi045.stdout: -7738> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000555) pop_and_dirty_projected_inode v5730 2023-10-03T19:21:01.050 INFO:teuthology.orchestra.run.smithi045.stdout: -7737> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000555) mark_dirty [inode 0x10000000555 [2,head] /dc-dir/dc-file_864 auth v5730 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.784212+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d715b80] 2023-10-03T19:21:01.050 INFO:teuthology.orchestra.run.smithi045.stdout: -7736> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_864) mark_dirty [dentry #0x1/dc-dir/dc-file_864 [2,head] auth (dversion lock) pv=5730 v=4398 ino=0x10000000555 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d718280] 2023-10-03T19:21:01.050 INFO:teuthology.orchestra.run.smithi045.stdout: -7735> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5729 cv=5553/5553 ap=137+136 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=89 | child=1 dirty=1 authpin=1 0x55576d056400] version 5729 2023-10-03T19:21:01.050 INFO:teuthology.orchestra.run.smithi045.stdout: -7734> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d554b60 v5737 2023-10-03T19:21:01.050 INFO:teuthology.orchestra.run.smithi045.stdout: -7733> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5737 cv=5559/5559 REP dir_auth=0 ap=136+137 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5737 2023-10-03T19:21:01.050 INFO:teuthology.orchestra.run.smithi045.stdout: -7732> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d554920 v5731 2023-10-03T19:21:01.050 INFO:teuthology.orchestra.run.smithi045.stdout: -7731> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5731 cv=5553/5553 ap=137+136 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=89 | child=1 dirty=1 authpin=1 0x55576d056400] version 5731 2023-10-03T19:21:01.050 INFO:teuthology.orchestra.run.smithi045.stdout: -7730> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=136 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=136 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.050 INFO:teuthology.orchestra.run.smithi045.stdout: -7729> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=136) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5736 pv6006 ap=137 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=137) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=136) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.051 INFO:teuthology.orchestra.run.smithi045.stdout: -7728> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=137) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5736 pv6006 ap=137 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=137) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=135) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.051 INFO:teuthology.orchestra.run.smithi045.stdout: -7727> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000555 [2,head] /dc-dir/dc-file_864 auth v5730 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.784212+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d715b80] 2023-10-03T19:21:01.051 INFO:teuthology.orchestra.run.smithi045.stdout: -7726> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000555 [2,head] /dc-dir/dc-file_864 auth v5730 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.784212+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d715b80] 2023-10-03T19:21:01.051 INFO:teuthology.orchestra.run.smithi045.stdout: -7725> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.051 INFO:teuthology.orchestra.run.smithi045.stdout: -7724> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.051 INFO:teuthology.orchestra.run.smithi045.stdout: -7723> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.051 INFO:teuthology.orchestra.run.smithi045.stdout: -7722> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000555 [2,head] /dc-dir/dc-file_864 auth v5730 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.784212+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d715b80] 2023-10-03T19:21:01.051 INFO:teuthology.orchestra.run.smithi045.stdout: -7721> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000555 [2,head] /dc-dir/dc-file_864 auth v5730 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.784212+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d715b80] 2023-10-03T19:21:01.051 INFO:teuthology.orchestra.run.smithi045.stdout: -7720> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.051 INFO:teuthology.orchestra.run.smithi045.stdout: -7719> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 278.614, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.79e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:560.2] 2023-10-03T19:21:01.052 INFO:teuthology.orchestra.run.smithi045.stdout: -7718> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d538fc0 on [dir 0x1 / [2,head] auth pv=6007 v=5737 cv=5559/5559 REP dir_auth=0 ap=135+137 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 135 2023-10-03T19:21:01.052 INFO:teuthology.orchestra.run.smithi045.stdout: -7717> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d538fc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5731 cv=5553/5553 ap=136+136 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=89 | child=1 dirty=1 authpin=1 0x55576d056400] count now 136 2023-10-03T19:21:01.052 INFO:teuthology.orchestra.run.smithi045.stdout: -7716> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d538fc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5736 pv6006 ap=136 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=136) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=135) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 136 2023-10-03T19:21:01.052 INFO:teuthology.orchestra.run.smithi045.stdout: -7715> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5737 cv=5559/5559 REP dir_auth=0 ap=135+136 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d538fc0 count now 135/136 2023-10-03T19:21:01.052 INFO:teuthology.orchestra.run.smithi045.stdout: -7714> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000555) auth_unpin by 0x55576d538fc0 on [inode 0x10000000555 [2,head] /dc-dir/dc-file_864 auth v5730 s=3 n(v0 rc2023-10-03T19:16:11.784212+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d715b80] now 0 2023-10-03T19:21:01.052 INFO:teuthology.orchestra.run.smithi045.stdout: -7713> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5731 cv=5553/5553 ap=136+135 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=89 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d538fc0 count now 136/135 2023-10-03T19:21:01.052 INFO:teuthology.orchestra.run.smithi045.stdout: -7712> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.052 INFO:teuthology.orchestra.run.smithi045.stdout: -7711> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.052 INFO:teuthology.orchestra.run.smithi045.stdout: -7710> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000556 [2,head] /dc-dir/dc-file_865 auth v4402 pv5732 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.796101+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.796101+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d716100] 2023-10-03T19:21:01.052 INFO:teuthology.orchestra.run.smithi045.stdout: -7709> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5738 2023-10-03T19:21:01.052 INFO:teuthology.orchestra.run.smithi045.stdout: -7708> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5738 pv6006 ap=136 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=136) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=135) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.053 INFO:teuthology.orchestra.run.smithi045.stdout: -7707> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5736 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.053 INFO:teuthology.orchestra.run.smithi045.stdout: -7706> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5737 cv=5559/5559 REP dir_auth=0 ap=135+136 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5737 2023-10-03T19:21:01.053 INFO:teuthology.orchestra.run.smithi045.stdout: -7705> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000556) pop_and_dirty_projected_inode v5732 2023-10-03T19:21:01.053 INFO:teuthology.orchestra.run.smithi045.stdout: -7704> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000556) mark_dirty [inode 0x10000000556 [2,head] /dc-dir/dc-file_865 auth v5732 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.796101+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d716100] 2023-10-03T19:21:01.053 INFO:teuthology.orchestra.run.smithi045.stdout: -7703> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_865) mark_dirty [dentry #0x1/dc-dir/dc-file_865 [2,head] auth (dversion lock) pv=5732 v=4402 ino=0x10000000556 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d718500] 2023-10-03T19:21:01.053 INFO:teuthology.orchestra.run.smithi045.stdout: -7702> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5731 cv=5553/5553 ap=136+135 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=90 | child=1 dirty=1 authpin=1 0x55576d056400] version 5731 2023-10-03T19:21:01.053 INFO:teuthology.orchestra.run.smithi045.stdout: -7701> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d554fe0 v5739 2023-10-03T19:21:01.053 INFO:teuthology.orchestra.run.smithi045.stdout: -7700> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5739 cv=5559/5559 REP dir_auth=0 ap=135+136 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5739 2023-10-03T19:21:01.053 INFO:teuthology.orchestra.run.smithi045.stdout: -7699> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d5d6800 v5733 2023-10-03T19:21:01.053 INFO:teuthology.orchestra.run.smithi045.stdout: -7698> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5733 cv=5553/5553 ap=136+135 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=90 | child=1 dirty=1 authpin=1 0x55576d056400] version 5733 2023-10-03T19:21:01.053 INFO:teuthology.orchestra.run.smithi045.stdout: -7697> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=135 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=135 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.054 INFO:teuthology.orchestra.run.smithi045.stdout: -7696> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=135) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5738 pv6006 ap=136 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=136) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=135) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.054 INFO:teuthology.orchestra.run.smithi045.stdout: -7695> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=136) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5738 pv6006 ap=136 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=136) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=134) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.054 INFO:teuthology.orchestra.run.smithi045.stdout: -7694> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000556 [2,head] /dc-dir/dc-file_865 auth v5732 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.796101+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d716100] 2023-10-03T19:21:01.054 INFO:teuthology.orchestra.run.smithi045.stdout: -7693> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000556 [2,head] /dc-dir/dc-file_865 auth v5732 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.796101+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d716100] 2023-10-03T19:21:01.054 INFO:teuthology.orchestra.run.smithi045.stdout: -7692> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.054 INFO:teuthology.orchestra.run.smithi045.stdout: -7691> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.054 INFO:teuthology.orchestra.run.smithi045.stdout: -7690> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.054 INFO:teuthology.orchestra.run.smithi045.stdout: -7689> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000556 [2,head] /dc-dir/dc-file_865 auth v5732 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.796101+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d716100] 2023-10-03T19:21:01.054 INFO:teuthology.orchestra.run.smithi045.stdout: -7688> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000556 [2,head] /dc-dir/dc-file_865 auth v5732 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.796101+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d716100] 2023-10-03T19:21:01.054 INFO:teuthology.orchestra.run.smithi045.stdout: -7687> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.054 INFO:teuthology.orchestra.run.smithi045.stdout: -7686> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 279.614, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.80e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:562.2] 2023-10-03T19:21:01.055 INFO:teuthology.orchestra.run.smithi045.stdout: -7685> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2a4000 on [dir 0x1 / [2,head] auth pv=6007 v=5739 cv=5559/5559 REP dir_auth=0 ap=134+136 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 134 2023-10-03T19:21:01.055 INFO:teuthology.orchestra.run.smithi045.stdout: -7684> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2a4000 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5738 pv6006 ap=135 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=135) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=134) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 135 2023-10-03T19:21:01.056 INFO:teuthology.orchestra.run.smithi045.stdout: -7683> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5739 cv=5559/5559 REP dir_auth=0 ap=134+135 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2a4000 count now 134/135 2023-10-03T19:21:01.056 INFO:teuthology.orchestra.run.smithi045.stdout: -7682> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2a4000 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5733 cv=5553/5553 ap=135+135 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=90 | child=1 dirty=1 authpin=1 0x55576d056400] count now 135 2023-10-03T19:21:01.056 INFO:teuthology.orchestra.run.smithi045.stdout: -7681> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000556) auth_unpin by 0x55576d2a4000 on [inode 0x10000000556 [2,head] /dc-dir/dc-file_865 auth v5732 s=3 n(v0 rc2023-10-03T19:16:11.796101+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d716100] now 0 2023-10-03T19:21:01.056 INFO:teuthology.orchestra.run.smithi045.stdout: -7680> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5733 cv=5553/5553 ap=135+134 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=90 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2a4000 count now 135/134 2023-10-03T19:21:01.056 INFO:teuthology.orchestra.run.smithi045.stdout: -7679> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.056 INFO:teuthology.orchestra.run.smithi045.stdout: -7678> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.056 INFO:teuthology.orchestra.run.smithi045.stdout: -7677> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000557 [2,head] /dc-dir/dc-file_866 auth v4406 pv5734 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.808151+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.808151+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d716680] 2023-10-03T19:21:01.056 INFO:teuthology.orchestra.run.smithi045.stdout: -7676> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5740 2023-10-03T19:21:01.056 INFO:teuthology.orchestra.run.smithi045.stdout: -7675> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5740 pv6006 ap=135 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=135) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=134) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.056 INFO:teuthology.orchestra.run.smithi045.stdout: -7674> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5738 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.056 INFO:teuthology.orchestra.run.smithi045.stdout: -7673> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5739 cv=5559/5559 REP dir_auth=0 ap=134+135 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5739 2023-10-03T19:21:01.057 INFO:teuthology.orchestra.run.smithi045.stdout: -7672> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000557) pop_and_dirty_projected_inode v5734 2023-10-03T19:21:01.057 INFO:teuthology.orchestra.run.smithi045.stdout: -7671> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000557) mark_dirty [inode 0x10000000557 [2,head] /dc-dir/dc-file_866 auth v5734 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.808151+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d716680] 2023-10-03T19:21:01.057 INFO:teuthology.orchestra.run.smithi045.stdout: -7670> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_866) mark_dirty [dentry #0x1/dc-dir/dc-file_866 [2,head] auth (dversion lock) pv=5734 v=4406 ino=0x10000000557 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d718780] 2023-10-03T19:21:01.057 INFO:teuthology.orchestra.run.smithi045.stdout: -7669> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5733 cv=5553/5553 ap=135+134 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=91 | child=1 dirty=1 authpin=1 0x55576d056400] version 5733 2023-10-03T19:21:01.057 INFO:teuthology.orchestra.run.smithi045.stdout: -7668> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d5d6c80 v5741 2023-10-03T19:21:01.057 INFO:teuthology.orchestra.run.smithi045.stdout: -7667> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5741 cv=5559/5559 REP dir_auth=0 ap=134+135 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5741 2023-10-03T19:21:01.057 INFO:teuthology.orchestra.run.smithi045.stdout: -7666> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d5376a0 v5735 2023-10-03T19:21:01.057 INFO:teuthology.orchestra.run.smithi045.stdout: -7665> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5735 cv=5553/5553 ap=135+134 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=91 | child=1 dirty=1 authpin=1 0x55576d056400] version 5735 2023-10-03T19:21:01.057 INFO:teuthology.orchestra.run.smithi045.stdout: -7664> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=134 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=134 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.057 INFO:teuthology.orchestra.run.smithi045.stdout: -7663> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=134) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5740 pv6006 ap=135 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=135) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=134) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.057 INFO:teuthology.orchestra.run.smithi045.stdout: -7662> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=135) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5740 pv6006 ap=135 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=135) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=133) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.057 INFO:teuthology.orchestra.run.smithi045.stdout: -7661> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000557 [2,head] /dc-dir/dc-file_866 auth v5734 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.808151+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d716680] 2023-10-03T19:21:01.058 INFO:teuthology.orchestra.run.smithi045.stdout: -7660> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000557 [2,head] /dc-dir/dc-file_866 auth v5734 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.808151+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d716680] 2023-10-03T19:21:01.058 INFO:teuthology.orchestra.run.smithi045.stdout: -7659> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.058 INFO:teuthology.orchestra.run.smithi045.stdout: -7658> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.058 INFO:teuthology.orchestra.run.smithi045.stdout: -7657> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.058 INFO:teuthology.orchestra.run.smithi045.stdout: -7656> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000557 [2,head] /dc-dir/dc-file_866 auth v5734 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.808151+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d716680] 2023-10-03T19:21:01.058 INFO:teuthology.orchestra.run.smithi045.stdout: -7655> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000557 [2,head] /dc-dir/dc-file_866 auth v5734 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.808151+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d716680] 2023-10-03T19:21:01.058 INFO:teuthology.orchestra.run.smithi045.stdout: -7654> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.058 INFO:teuthology.orchestra.run.smithi045.stdout: -7653> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 280.614, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.81e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:564.2] 2023-10-03T19:21:01.058 INFO:teuthology.orchestra.run.smithi045.stdout: -7652> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d096b40 on [dir 0x1 / [2,head] auth pv=6007 v=5741 cv=5559/5559 REP dir_auth=0 ap=133+135 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 133 2023-10-03T19:21:01.058 INFO:teuthology.orchestra.run.smithi045.stdout: -7651> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d096b40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5740 pv6006 ap=134 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=134) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=133) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 134 2023-10-03T19:21:01.059 INFO:teuthology.orchestra.run.smithi045.stdout: -7650> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5741 cv=5559/5559 REP dir_auth=0 ap=133+134 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d096b40 count now 133/134 2023-10-03T19:21:01.059 INFO:teuthology.orchestra.run.smithi045.stdout: -7649> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d096b40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5735 cv=5553/5553 ap=134+134 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=91 | child=1 dirty=1 authpin=1 0x55576d056400] count now 134 2023-10-03T19:21:01.059 INFO:teuthology.orchestra.run.smithi045.stdout: -7648> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000557) auth_unpin by 0x55576d096b40 on [inode 0x10000000557 [2,head] /dc-dir/dc-file_866 auth v5734 s=3 n(v0 rc2023-10-03T19:16:11.808151+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d716680] now 0 2023-10-03T19:21:01.059 INFO:teuthology.orchestra.run.smithi045.stdout: -7647> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5735 cv=5553/5553 ap=134+133 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=91 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d096b40 count now 134/133 2023-10-03T19:21:01.059 INFO:teuthology.orchestra.run.smithi045.stdout: -7646> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.059 INFO:teuthology.orchestra.run.smithi045.stdout: -7645> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.059 INFO:teuthology.orchestra.run.smithi045.stdout: -7644> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000558 [2,head] /dc-dir/dc-file_867 auth v4410 pv5736 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.819523+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.819523+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d716c00] 2023-10-03T19:21:01.059 INFO:teuthology.orchestra.run.smithi045.stdout: -7643> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5742 2023-10-03T19:21:01.059 INFO:teuthology.orchestra.run.smithi045.stdout: -7642> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5742 pv6006 ap=134 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=134) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=133) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.059 INFO:teuthology.orchestra.run.smithi045.stdout: -7641> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5740 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.059 INFO:teuthology.orchestra.run.smithi045.stdout: -7640> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5741 cv=5559/5559 REP dir_auth=0 ap=133+134 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5741 2023-10-03T19:21:01.059 INFO:teuthology.orchestra.run.smithi045.stdout: -7639> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000558) pop_and_dirty_projected_inode v5736 2023-10-03T19:21:01.060 INFO:teuthology.orchestra.run.smithi045.stdout: -7638> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000558) mark_dirty [inode 0x10000000558 [2,head] /dc-dir/dc-file_867 auth v5736 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.819523+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d716c00] 2023-10-03T19:21:01.060 INFO:teuthology.orchestra.run.smithi045.stdout: -7637> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_867) mark_dirty [dentry #0x1/dc-dir/dc-file_867 [2,head] auth (dversion lock) pv=5736 v=4410 ino=0x10000000558 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d718a00] 2023-10-03T19:21:01.060 INFO:teuthology.orchestra.run.smithi045.stdout: -7636> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5735 cv=5553/5553 ap=134+133 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=92 | child=1 dirty=1 authpin=1 0x55576d056400] version 5735 2023-10-03T19:21:01.060 INFO:teuthology.orchestra.run.smithi045.stdout: -7635> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d5d7100 v5743 2023-10-03T19:21:01.060 INFO:teuthology.orchestra.run.smithi045.stdout: -7634> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5743 cv=5559/5559 REP dir_auth=0 ap=133+134 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5743 2023-10-03T19:21:01.060 INFO:teuthology.orchestra.run.smithi045.stdout: -7633> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d5378e0 v5737 2023-10-03T19:21:01.060 INFO:teuthology.orchestra.run.smithi045.stdout: -7632> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5737 cv=5553/5553 ap=134+133 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=92 | child=1 dirty=1 authpin=1 0x55576d056400] version 5737 2023-10-03T19:21:01.060 INFO:teuthology.orchestra.run.smithi045.stdout: -7631> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=133 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=133 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.060 INFO:teuthology.orchestra.run.smithi045.stdout: -7630> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=133) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5742 pv6006 ap=134 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=134) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=133) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.060 INFO:teuthology.orchestra.run.smithi045.stdout: -7629> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=134) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5742 pv6006 ap=134 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=134) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=132) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.061 INFO:teuthology.orchestra.run.smithi045.stdout: -7628> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000558 [2,head] /dc-dir/dc-file_867 auth v5736 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.819523+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d716c00] 2023-10-03T19:21:01.061 INFO:teuthology.orchestra.run.smithi045.stdout: -7627> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000558 [2,head] /dc-dir/dc-file_867 auth v5736 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.819523+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d716c00] 2023-10-03T19:21:01.061 INFO:teuthology.orchestra.run.smithi045.stdout: -7626> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.061 INFO:teuthology.orchestra.run.smithi045.stdout: -7625> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.061 INFO:teuthology.orchestra.run.smithi045.stdout: -7624> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.061 INFO:teuthology.orchestra.run.smithi045.stdout: -7623> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000558 [2,head] /dc-dir/dc-file_867 auth v5736 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.819523+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d716c00] 2023-10-03T19:21:01.061 INFO:teuthology.orchestra.run.smithi045.stdout: -7622> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000558 [2,head] /dc-dir/dc-file_867 auth v5736 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.819523+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d716c00] 2023-10-03T19:21:01.061 INFO:teuthology.orchestra.run.smithi045.stdout: -7621> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.155 INFO:teuthology.orchestra.run.smithi045.stdout: -7620> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 281.614, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.82e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:566.2] 2023-10-03T19:21:01.155 INFO:teuthology.orchestra.run.smithi045.stdout: -7619> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d3dd8c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5742 pv6006 ap=133 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=133) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=132) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 133 2023-10-03T19:21:01.155 INFO:teuthology.orchestra.run.smithi045.stdout: -7618> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5743 cv=5559/5559 REP dir_auth=0 ap=133+133 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d3dd8c0 count now 133/133 2023-10-03T19:21:01.155 INFO:teuthology.orchestra.run.smithi045.stdout: -7617> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d3dd8c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5737 cv=5553/5553 ap=133+133 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=92 | child=1 dirty=1 authpin=1 0x55576d056400] count now 133 2023-10-03T19:21:01.155 INFO:teuthology.orchestra.run.smithi045.stdout: -7616> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d3dd8c0 on [dir 0x1 / [2,head] auth pv=6007 v=5743 cv=5559/5559 REP dir_auth=0 ap=132+133 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 132 2023-10-03T19:21:01.155 INFO:teuthology.orchestra.run.smithi045.stdout: -7615> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000558) auth_unpin by 0x55576d3dd8c0 on [inode 0x10000000558 [2,head] /dc-dir/dc-file_867 auth v5736 s=3 n(v0 rc2023-10-03T19:16:11.819523+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d716c00] now 0 2023-10-03T19:21:01.155 INFO:teuthology.orchestra.run.smithi045.stdout: -7614> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5737 cv=5553/5553 ap=133+132 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=92 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d3dd8c0 count now 133/132 2023-10-03T19:21:01.156 INFO:teuthology.orchestra.run.smithi045.stdout: -7613> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.156 INFO:teuthology.orchestra.run.smithi045.stdout: -7612> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.156 INFO:teuthology.orchestra.run.smithi045.stdout: -7611> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000559 [2,head] /dc-dir/dc-file_868 auth v4414 pv5738 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.831122+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.831122+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d717180] 2023-10-03T19:21:01.156 INFO:teuthology.orchestra.run.smithi045.stdout: -7610> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5744 2023-10-03T19:21:01.156 INFO:teuthology.orchestra.run.smithi045.stdout: -7609> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5744 pv6006 ap=133 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=133) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=132) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.156 INFO:teuthology.orchestra.run.smithi045.stdout: -7608> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5742 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.156 INFO:teuthology.orchestra.run.smithi045.stdout: -7607> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5743 cv=5559/5559 REP dir_auth=0 ap=132+133 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5743 2023-10-03T19:21:01.156 INFO:teuthology.orchestra.run.smithi045.stdout: -7606> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000559) pop_and_dirty_projected_inode v5738 2023-10-03T19:21:01.156 INFO:teuthology.orchestra.run.smithi045.stdout: -7605> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000559) mark_dirty [inode 0x10000000559 [2,head] /dc-dir/dc-file_868 auth v5738 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.831122+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d717180] 2023-10-03T19:21:01.156 INFO:teuthology.orchestra.run.smithi045.stdout: -7604> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_868) mark_dirty [dentry #0x1/dc-dir/dc-file_868 [2,head] auth (dversion lock) pv=5738 v=4414 ino=0x10000000559 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d718c80] 2023-10-03T19:21:01.157 INFO:teuthology.orchestra.run.smithi045.stdout: -7603> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5737 cv=5553/5553 ap=133+132 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=93 | child=1 dirty=1 authpin=1 0x55576d056400] version 5737 2023-10-03T19:21:01.157 INFO:teuthology.orchestra.run.smithi045.stdout: -7602> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d5d7e80 v5745 2023-10-03T19:21:01.157 INFO:teuthology.orchestra.run.smithi045.stdout: -7601> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5745 cv=5559/5559 REP dir_auth=0 ap=132+133 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5745 2023-10-03T19:21:01.157 INFO:teuthology.orchestra.run.smithi045.stdout: -7600> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d537b20 v5739 2023-10-03T19:21:01.157 INFO:teuthology.orchestra.run.smithi045.stdout: -7599> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5739 cv=5553/5553 ap=133+132 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=93 | child=1 dirty=1 authpin=1 0x55576d056400] version 5739 2023-10-03T19:21:01.157 INFO:teuthology.orchestra.run.smithi045.stdout: -7598> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=132 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=132 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.157 INFO:teuthology.orchestra.run.smithi045.stdout: -7597> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=132) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5744 pv6006 ap=133 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=133) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=132) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.157 INFO:teuthology.orchestra.run.smithi045.stdout: -7596> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=133) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5744 pv6006 ap=133 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=133) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=131) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.157 INFO:teuthology.orchestra.run.smithi045.stdout: -7595> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000559 [2,head] /dc-dir/dc-file_868 auth v5738 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.831122+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d717180] 2023-10-03T19:21:01.157 INFO:teuthology.orchestra.run.smithi045.stdout: -7594> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000559 [2,head] /dc-dir/dc-file_868 auth v5738 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.831122+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d717180] 2023-10-03T19:21:01.157 INFO:teuthology.orchestra.run.smithi045.stdout: -7593> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.158 INFO:teuthology.orchestra.run.smithi045.stdout: -7592> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.158 INFO:teuthology.orchestra.run.smithi045.stdout: -7591> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.158 INFO:teuthology.orchestra.run.smithi045.stdout: -7590> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000559 [2,head] /dc-dir/dc-file_868 auth v5738 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.831122+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d717180] 2023-10-03T19:21:01.158 INFO:teuthology.orchestra.run.smithi045.stdout: -7589> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000559 [2,head] /dc-dir/dc-file_868 auth v5738 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.831122+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d717180] 2023-10-03T19:21:01.158 INFO:teuthology.orchestra.run.smithi045.stdout: -7588> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.158 INFO:teuthology.orchestra.run.smithi045.stdout: -7587> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 282.614, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.83e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:568.2] 2023-10-03T19:21:01.158 INFO:teuthology.orchestra.run.smithi045.stdout: -7586> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d808900 on [dir 0x1 / [2,head] auth pv=6007 v=5745 cv=5559/5559 REP dir_auth=0 ap=131+133 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 131 2023-10-03T19:21:01.158 INFO:teuthology.orchestra.run.smithi045.stdout: -7585> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d808900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5744 pv6006 ap=132 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=132) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=131) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 132 2023-10-03T19:21:01.158 INFO:teuthology.orchestra.run.smithi045.stdout: -7584> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5745 cv=5559/5559 REP dir_auth=0 ap=131+132 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d808900 count now 131/132 2023-10-03T19:21:01.158 INFO:teuthology.orchestra.run.smithi045.stdout: -7583> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d808900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5739 cv=5553/5553 ap=132+132 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=93 | child=1 dirty=1 authpin=1 0x55576d056400] count now 132 2023-10-03T19:21:01.159 INFO:teuthology.orchestra.run.smithi045.stdout: -7582> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000559) auth_unpin by 0x55576d808900 on [inode 0x10000000559 [2,head] /dc-dir/dc-file_868 auth v5738 s=3 n(v0 rc2023-10-03T19:16:11.831122+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d717180] now 0 2023-10-03T19:21:01.159 INFO:teuthology.orchestra.run.smithi045.stdout: -7581> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5739 cv=5553/5553 ap=132+131 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=93 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d808900 count now 132/131 2023-10-03T19:21:01.159 INFO:teuthology.orchestra.run.smithi045.stdout: -7580> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.159 INFO:teuthology.orchestra.run.smithi045.stdout: -7579> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.159 INFO:teuthology.orchestra.run.smithi045.stdout: -7578> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000055a [2,head] /dc-dir/dc-file_869 auth v4418 pv5740 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.841896+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.841896+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d717700] 2023-10-03T19:21:01.159 INFO:teuthology.orchestra.run.smithi045.stdout: -7577> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5746 2023-10-03T19:21:01.159 INFO:teuthology.orchestra.run.smithi045.stdout: -7576> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5746 pv6006 ap=132 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=132) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=131) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.159 INFO:teuthology.orchestra.run.smithi045.stdout: -7575> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5744 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.159 INFO:teuthology.orchestra.run.smithi045.stdout: -7574> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5745 cv=5559/5559 REP dir_auth=0 ap=131+132 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5745 2023-10-03T19:21:01.159 INFO:teuthology.orchestra.run.smithi045.stdout: -7573> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000055a) pop_and_dirty_projected_inode v5740 2023-10-03T19:21:01.159 INFO:teuthology.orchestra.run.smithi045.stdout: -7572> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000055a) mark_dirty [inode 0x1000000055a [2,head] /dc-dir/dc-file_869 auth v5740 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.841896+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d717700] 2023-10-03T19:21:01.160 INFO:teuthology.orchestra.run.smithi045.stdout: -7571> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_869) mark_dirty [dentry #0x1/dc-dir/dc-file_869 [2,head] auth (dversion lock) pv=5740 v=4418 ino=0x1000000055a state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d718f00] 2023-10-03T19:21:01.160 INFO:teuthology.orchestra.run.smithi045.stdout: -7570> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5739 cv=5553/5553 ap=132+131 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=94 | child=1 dirty=1 authpin=1 0x55576d056400] version 5739 2023-10-03T19:21:01.160 INFO:teuthology.orchestra.run.smithi045.stdout: -7569> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d537100 v5747 2023-10-03T19:21:01.160 INFO:teuthology.orchestra.run.smithi045.stdout: -7568> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5747 cv=5559/5559 REP dir_auth=0 ap=131+132 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5747 2023-10-03T19:21:01.160 INFO:teuthology.orchestra.run.smithi045.stdout: -7567> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d537d60 v5741 2023-10-03T19:21:01.160 INFO:teuthology.orchestra.run.smithi045.stdout: -7566> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5741 cv=5553/5553 ap=132+131 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=94 | child=1 dirty=1 authpin=1 0x55576d056400] version 5741 2023-10-03T19:21:01.166 INFO:teuthology.orchestra.run.smithi045.stdout: -7565> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=131 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=131 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.167 INFO:teuthology.orchestra.run.smithi045.stdout: -7564> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=131) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5746 pv6006 ap=132 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=132) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=131) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.167 INFO:teuthology.orchestra.run.smithi045.stdout: -7563> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=132) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5746 pv6006 ap=132 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=132) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=130) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.167 INFO:teuthology.orchestra.run.smithi045.stdout: -7562> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000055a [2,head] /dc-dir/dc-file_869 auth v5740 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.841896+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d717700] 2023-10-03T19:21:01.167 INFO:teuthology.orchestra.run.smithi045.stdout: -7561> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000055a [2,head] /dc-dir/dc-file_869 auth v5740 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.841896+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d717700] 2023-10-03T19:21:01.167 INFO:teuthology.orchestra.run.smithi045.stdout: -7560> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.167 INFO:teuthology.orchestra.run.smithi045.stdout: -7559> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.167 INFO:teuthology.orchestra.run.smithi045.stdout: -7558> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.167 INFO:teuthology.orchestra.run.smithi045.stdout: -7557> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000055a [2,head] /dc-dir/dc-file_869 auth v5740 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.841896+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d717700] 2023-10-03T19:21:01.167 INFO:teuthology.orchestra.run.smithi045.stdout: -7556> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000055a [2,head] /dc-dir/dc-file_869 auth v5740 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.841896+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d717700] 2023-10-03T19:21:01.167 INFO:teuthology.orchestra.run.smithi045.stdout: -7555> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.167 INFO:teuthology.orchestra.run.smithi045.stdout: -7554> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 283.614, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.84e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:570.2] 2023-10-03T19:21:01.168 INFO:teuthology.orchestra.run.smithi045.stdout: -7553> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2b2240 on [dir 0x1 / [2,head] auth pv=6007 v=5747 cv=5559/5559 REP dir_auth=0 ap=130+132 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 130 2023-10-03T19:21:01.168 INFO:teuthology.orchestra.run.smithi045.stdout: -7552> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2b2240 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5746 pv6006 ap=131 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=131) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=130) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 131 2023-10-03T19:21:01.168 INFO:teuthology.orchestra.run.smithi045.stdout: -7551> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5747 cv=5559/5559 REP dir_auth=0 ap=130+131 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2b2240 count now 130/131 2023-10-03T19:21:01.168 INFO:teuthology.orchestra.run.smithi045.stdout: -7550> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2b2240 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5741 cv=5553/5553 ap=131+131 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=94 | child=1 dirty=1 authpin=1 0x55576d056400] count now 131 2023-10-03T19:21:01.168 INFO:teuthology.orchestra.run.smithi045.stdout: -7549> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000055a) auth_unpin by 0x55576d2b2240 on [inode 0x1000000055a [2,head] /dc-dir/dc-file_869 auth v5740 s=3 n(v0 rc2023-10-03T19:16:11.841896+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d717700] now 0 2023-10-03T19:21:01.168 INFO:teuthology.orchestra.run.smithi045.stdout: -7548> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5741 cv=5553/5553 ap=131+130 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=94 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2b2240 count now 131/130 2023-10-03T19:21:01.168 INFO:teuthology.orchestra.run.smithi045.stdout: -7547> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.168 INFO:teuthology.orchestra.run.smithi045.stdout: -7546> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.168 INFO:teuthology.orchestra.run.smithi045.stdout: -7545> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000055b [2,head] /dc-dir/dc-file_870 auth v4422 pv5742 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.853718+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.853718+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d71e000] 2023-10-03T19:21:01.168 INFO:teuthology.orchestra.run.smithi045.stdout: -7544> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5748 2023-10-03T19:21:01.169 INFO:teuthology.orchestra.run.smithi045.stdout: -7543> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5748 pv6006 ap=131 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=131) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=130) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.169 INFO:teuthology.orchestra.run.smithi045.stdout: -7542> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5746 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.169 INFO:teuthology.orchestra.run.smithi045.stdout: -7541> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5747 cv=5559/5559 REP dir_auth=0 ap=130+131 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5747 2023-10-03T19:21:01.169 INFO:teuthology.orchestra.run.smithi045.stdout: -7540> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000055b) pop_and_dirty_projected_inode v5742 2023-10-03T19:21:01.169 INFO:teuthology.orchestra.run.smithi045.stdout: -7539> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000055b) mark_dirty [inode 0x1000000055b [2,head] /dc-dir/dc-file_870 auth v5742 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.853718+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d71e000] 2023-10-03T19:21:01.169 INFO:teuthology.orchestra.run.smithi045.stdout: -7538> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_870) mark_dirty [dentry #0x1/dc-dir/dc-file_870 [2,head] auth (dversion lock) pv=5742 v=4422 ino=0x1000000055b state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d719180] 2023-10-03T19:21:01.169 INFO:teuthology.orchestra.run.smithi045.stdout: -7537> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5741 cv=5553/5553 ap=131+130 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=95 | child=1 dirty=1 authpin=1 0x55576d056400] version 5741 2023-10-03T19:21:01.169 INFO:teuthology.orchestra.run.smithi045.stdout: -7536> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d537340 v5749 2023-10-03T19:21:01.169 INFO:teuthology.orchestra.run.smithi045.stdout: -7535> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5749 cv=5559/5559 REP dir_auth=0 ap=130+131 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5749 2023-10-03T19:21:01.169 INFO:teuthology.orchestra.run.smithi045.stdout: -7534> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d53e020 v5743 2023-10-03T19:21:01.169 INFO:teuthology.orchestra.run.smithi045.stdout: -7533> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5743 cv=5553/5553 ap=131+130 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=95 | child=1 dirty=1 authpin=1 0x55576d056400] version 5743 2023-10-03T19:21:01.170 INFO:teuthology.orchestra.run.smithi045.stdout: -7532> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=130 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=130 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.170 INFO:teuthology.orchestra.run.smithi045.stdout: -7531> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=130) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5748 pv6006 ap=131 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=131) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=130) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.170 INFO:teuthology.orchestra.run.smithi045.stdout: -7530> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=131) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5748 pv6006 ap=131 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=131) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=129) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.170 INFO:teuthology.orchestra.run.smithi045.stdout: -7529> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000055b [2,head] /dc-dir/dc-file_870 auth v5742 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.853718+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d71e000] 2023-10-03T19:21:01.170 INFO:teuthology.orchestra.run.smithi045.stdout: -7528> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000055b [2,head] /dc-dir/dc-file_870 auth v5742 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.853718+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d71e000] 2023-10-03T19:21:01.170 INFO:teuthology.orchestra.run.smithi045.stdout: -7527> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.170 INFO:teuthology.orchestra.run.smithi045.stdout: -7526> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.170 INFO:teuthology.orchestra.run.smithi045.stdout: -7525> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.170 INFO:teuthology.orchestra.run.smithi045.stdout: -7524> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000055b [2,head] /dc-dir/dc-file_870 auth v5742 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.853718+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d71e000] 2023-10-03T19:21:01.170 INFO:teuthology.orchestra.run.smithi045.stdout: -7523> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000055b [2,head] /dc-dir/dc-file_870 auth v5742 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.853718+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d71e000] 2023-10-03T19:21:01.170 INFO:teuthology.orchestra.run.smithi045.stdout: -7522> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.171 INFO:teuthology.orchestra.run.smithi045.stdout: -7521> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 284.614, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.85e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:572.2] 2023-10-03T19:21:01.171 INFO:teuthology.orchestra.run.smithi045.stdout: -7520> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2a5440 on [dir 0x1 / [2,head] auth pv=6007 v=5749 cv=5559/5559 REP dir_auth=0 ap=129+131 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 129 2023-10-03T19:21:01.171 INFO:teuthology.orchestra.run.smithi045.stdout: -7519> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2a5440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5748 pv6006 ap=130 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=130) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=129) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 130 2023-10-03T19:21:01.171 INFO:teuthology.orchestra.run.smithi045.stdout: -7518> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5749 cv=5559/5559 REP dir_auth=0 ap=129+130 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2a5440 count now 129/130 2023-10-03T19:21:01.171 INFO:teuthology.orchestra.run.smithi045.stdout: -7517> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2a5440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5743 cv=5553/5553 ap=130+130 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=95 | child=1 dirty=1 authpin=1 0x55576d056400] count now 130 2023-10-03T19:21:01.171 INFO:teuthology.orchestra.run.smithi045.stdout: -7516> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000055b) auth_unpin by 0x55576d2a5440 on [inode 0x1000000055b [2,head] /dc-dir/dc-file_870 auth v5742 s=3 n(v0 rc2023-10-03T19:16:11.853718+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d71e000] now 0 2023-10-03T19:21:01.171 INFO:teuthology.orchestra.run.smithi045.stdout: -7515> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5743 cv=5553/5553 ap=130+129 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=95 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2a5440 count now 130/129 2023-10-03T19:21:01.171 INFO:teuthology.orchestra.run.smithi045.stdout: -7514> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.171 INFO:teuthology.orchestra.run.smithi045.stdout: -7513> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.171 INFO:teuthology.orchestra.run.smithi045.stdout: -7512> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000055c [2,head] /dc-dir/dc-file_871 auth v4426 pv5744 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.867502+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.867502+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d71e580] 2023-10-03T19:21:01.171 INFO:teuthology.orchestra.run.smithi045.stdout: -7511> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5750 2023-10-03T19:21:01.172 INFO:teuthology.orchestra.run.smithi045.stdout: -7510> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5750 pv6006 ap=130 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=130) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=129) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.198 INFO:teuthology.orchestra.run.smithi045.stdout: -7509> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5748 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.198 INFO:teuthology.orchestra.run.smithi045.stdout: -7508> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5749 cv=5559/5559 REP dir_auth=0 ap=129+130 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5749 2023-10-03T19:21:01.198 INFO:teuthology.orchestra.run.smithi045.stdout: -7507> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000055c) pop_and_dirty_projected_inode v5744 2023-10-03T19:21:01.198 INFO:teuthology.orchestra.run.smithi045.stdout: -7506> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000055c) mark_dirty [inode 0x1000000055c [2,head] /dc-dir/dc-file_871 auth v5744 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.867502+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d71e580] 2023-10-03T19:21:01.198 INFO:teuthology.orchestra.run.smithi045.stdout: -7505> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_871) mark_dirty [dentry #0x1/dc-dir/dc-file_871 [2,head] auth (dversion lock) pv=5744 v=4426 ino=0x1000000055c state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d719400] 2023-10-03T19:21:01.198 INFO:teuthology.orchestra.run.smithi045.stdout: -7504> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5743 cv=5553/5553 ap=130+129 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=96 | child=1 dirty=1 authpin=1 0x55576d056400] version 5743 2023-10-03T19:21:01.198 INFO:teuthology.orchestra.run.smithi045.stdout: -7503> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d537580 v5751 2023-10-03T19:21:01.198 INFO:teuthology.orchestra.run.smithi045.stdout: -7502> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5751 cv=5559/5559 REP dir_auth=0 ap=129+130 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5751 2023-10-03T19:21:01.199 INFO:teuthology.orchestra.run.smithi045.stdout: -7501> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d53e260 v5745 2023-10-03T19:21:01.199 INFO:teuthology.orchestra.run.smithi045.stdout: -7500> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5745 cv=5553/5553 ap=130+129 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=96 | child=1 dirty=1 authpin=1 0x55576d056400] version 5745 2023-10-03T19:21:01.199 INFO:teuthology.orchestra.run.smithi045.stdout: -7499> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=129 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=129 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.199 INFO:teuthology.orchestra.run.smithi045.stdout: -7498> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=129) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5750 pv6006 ap=130 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=130) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=129) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.199 INFO:teuthology.orchestra.run.smithi045.stdout: -7497> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=130) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5750 pv6006 ap=130 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=130) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=128) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.199 INFO:teuthology.orchestra.run.smithi045.stdout: -7496> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000055c [2,head] /dc-dir/dc-file_871 auth v5744 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.867502+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d71e580] 2023-10-03T19:21:01.199 INFO:teuthology.orchestra.run.smithi045.stdout: -7495> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000055c [2,head] /dc-dir/dc-file_871 auth v5744 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.867502+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d71e580] 2023-10-03T19:21:01.199 INFO:teuthology.orchestra.run.smithi045.stdout: -7494> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.199 INFO:teuthology.orchestra.run.smithi045.stdout: -7493> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.199 INFO:teuthology.orchestra.run.smithi045.stdout: -7492> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.200 INFO:teuthology.orchestra.run.smithi045.stdout: -7491> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000055c [2,head] /dc-dir/dc-file_871 auth v5744 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.867502+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d71e580] 2023-10-03T19:21:01.200 INFO:teuthology.orchestra.run.smithi045.stdout: -7490> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000055c [2,head] /dc-dir/dc-file_871 auth v5744 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.867502+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d71e580] 2023-10-03T19:21:01.200 INFO:teuthology.orchestra.run.smithi045.stdout: -7489> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.200 INFO:teuthology.orchestra.run.smithi045.stdout: -7488> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 285.614, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.86e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:574.2] 2023-10-03T19:21:01.200 INFO:teuthology.orchestra.run.smithi045.stdout: -7487> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d52efc0 on [dir 0x1 / [2,head] auth pv=6007 v=5751 cv=5559/5559 REP dir_auth=0 ap=128+130 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 128 2023-10-03T19:21:01.200 INFO:teuthology.orchestra.run.smithi045.stdout: -7486> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d52efc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5750 pv6006 ap=129 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=129) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=128) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 129 2023-10-03T19:21:01.200 INFO:teuthology.orchestra.run.smithi045.stdout: -7485> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5751 cv=5559/5559 REP dir_auth=0 ap=128+129 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d52efc0 count now 128/129 2023-10-03T19:21:01.200 INFO:teuthology.orchestra.run.smithi045.stdout: -7484> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d52efc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5745 cv=5553/5553 ap=129+129 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=96 | child=1 dirty=1 authpin=1 0x55576d056400] count now 129 2023-10-03T19:21:01.200 INFO:teuthology.orchestra.run.smithi045.stdout: -7483> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000055c) auth_unpin by 0x55576d52efc0 on [inode 0x1000000055c [2,head] /dc-dir/dc-file_871 auth v5744 s=3 n(v0 rc2023-10-03T19:16:11.867502+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d71e580] now 0 2023-10-03T19:21:01.200 INFO:teuthology.orchestra.run.smithi045.stdout: -7482> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5745 cv=5553/5553 ap=129+128 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=96 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d52efc0 count now 129/128 2023-10-03T19:21:01.200 INFO:teuthology.orchestra.run.smithi045.stdout: -7481> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.200 INFO:teuthology.orchestra.run.smithi045.stdout: -7480> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.201 INFO:teuthology.orchestra.run.smithi045.stdout: -7479> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000055d [2,head] /dc-dir/dc-file_872 auth v4430 pv5746 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.879026+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.879026+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d71eb00] 2023-10-03T19:21:01.201 INFO:teuthology.orchestra.run.smithi045.stdout: -7478> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5752 2023-10-03T19:21:01.201 INFO:teuthology.orchestra.run.smithi045.stdout: -7477> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5752 pv6006 ap=129 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=129) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=128) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.201 INFO:teuthology.orchestra.run.smithi045.stdout: -7476> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5750 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.201 INFO:teuthology.orchestra.run.smithi045.stdout: -7475> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5751 cv=5559/5559 REP dir_auth=0 ap=128+129 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5751 2023-10-03T19:21:01.201 INFO:teuthology.orchestra.run.smithi045.stdout: -7474> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000055d) pop_and_dirty_projected_inode v5746 2023-10-03T19:21:01.201 INFO:teuthology.orchestra.run.smithi045.stdout: -7473> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000055d) mark_dirty [inode 0x1000000055d [2,head] /dc-dir/dc-file_872 auth v5746 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.879026+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d71eb00] 2023-10-03T19:21:01.201 INFO:teuthology.orchestra.run.smithi045.stdout: -7472> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_872) mark_dirty [dentry #0x1/dc-dir/dc-file_872 [2,head] auth (dversion lock) pv=5746 v=4430 ino=0x1000000055d state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d719680] 2023-10-03T19:21:01.201 INFO:teuthology.orchestra.run.smithi045.stdout: -7471> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5745 cv=5553/5553 ap=129+128 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=97 | child=1 dirty=1 authpin=1 0x55576d056400] version 5745 2023-10-03T19:21:01.201 INFO:teuthology.orchestra.run.smithi045.stdout: -7470> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d5377c0 v5753 2023-10-03T19:21:01.202 INFO:teuthology.orchestra.run.smithi045.stdout: -7469> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5753 cv=5559/5559 REP dir_auth=0 ap=128+129 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5753 2023-10-03T19:21:01.202 INFO:teuthology.orchestra.run.smithi045.stdout: -7468> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d53e4a0 v5747 2023-10-03T19:21:01.202 INFO:teuthology.orchestra.run.smithi045.stdout: -7467> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5747 cv=5553/5553 ap=129+128 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=97 | child=1 dirty=1 authpin=1 0x55576d056400] version 5747 2023-10-03T19:21:01.202 INFO:teuthology.orchestra.run.smithi045.stdout: -7466> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=128 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=128 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.202 INFO:teuthology.orchestra.run.smithi045.stdout: -7465> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=128) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5752 pv6006 ap=129 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=129) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=128) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.202 INFO:teuthology.orchestra.run.smithi045.stdout: -7464> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=129) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5752 pv6006 ap=129 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=129) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=127) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.202 INFO:teuthology.orchestra.run.smithi045.stdout: -7463> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000055d [2,head] /dc-dir/dc-file_872 auth v5746 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.879026+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d71eb00] 2023-10-03T19:21:01.202 INFO:teuthology.orchestra.run.smithi045.stdout: -7462> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000055d [2,head] /dc-dir/dc-file_872 auth v5746 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.879026+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d71eb00] 2023-10-03T19:21:01.202 INFO:teuthology.orchestra.run.smithi045.stdout: -7461> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.202 INFO:teuthology.orchestra.run.smithi045.stdout: -7460> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.202 INFO:teuthology.orchestra.run.smithi045.stdout: -7459> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.203 INFO:teuthology.orchestra.run.smithi045.stdout: -7458> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000055d [2,head] /dc-dir/dc-file_872 auth v5746 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.879026+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d71eb00] 2023-10-03T19:21:01.203 INFO:teuthology.orchestra.run.smithi045.stdout: -7457> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000055d [2,head] /dc-dir/dc-file_872 auth v5746 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.879026+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d71eb00] 2023-10-03T19:21:01.203 INFO:teuthology.orchestra.run.smithi045.stdout: -7456> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.203 INFO:teuthology.orchestra.run.smithi045.stdout: -7455> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 286.614, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.87e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:576.2] 2023-10-03T19:21:01.203 INFO:teuthology.orchestra.run.smithi045.stdout: -7454> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2b26c0 on [dir 0x1 / [2,head] auth pv=6007 v=5753 cv=5559/5559 REP dir_auth=0 ap=127+129 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 127 2023-10-03T19:21:01.214 INFO:teuthology.orchestra.run.smithi045.stdout: -7453> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2b26c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5752 pv6006 ap=128 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=128) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=127) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 128 2023-10-03T19:21:01.214 INFO:teuthology.orchestra.run.smithi045.stdout: -7452> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5753 cv=5559/5559 REP dir_auth=0 ap=127+128 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2b26c0 count now 127/128 2023-10-03T19:21:01.214 INFO:teuthology.orchestra.run.smithi045.stdout: -7451> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2b26c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5747 cv=5553/5553 ap=128+128 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=97 | child=1 dirty=1 authpin=1 0x55576d056400] count now 128 2023-10-03T19:21:01.214 INFO:teuthology.orchestra.run.smithi045.stdout: -7450> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000055d) auth_unpin by 0x55576d2b26c0 on [inode 0x1000000055d [2,head] /dc-dir/dc-file_872 auth v5746 s=3 n(v0 rc2023-10-03T19:16:11.879026+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d71eb00] now 0 2023-10-03T19:21:01.214 INFO:teuthology.orchestra.run.smithi045.stdout: -7449> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5747 cv=5553/5553 ap=128+127 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=97 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2b26c0 count now 128/127 2023-10-03T19:21:01.214 INFO:teuthology.orchestra.run.smithi045.stdout: -7448> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.214 INFO:teuthology.orchestra.run.smithi045.stdout: -7447> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.214 INFO:teuthology.orchestra.run.smithi045.stdout: -7446> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000055e [2,head] /dc-dir/dc-file_873 auth v4434 pv5748 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.889904+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.889904+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d71f080] 2023-10-03T19:21:01.215 INFO:teuthology.orchestra.run.smithi045.stdout: -7445> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5754 2023-10-03T19:21:01.215 INFO:teuthology.orchestra.run.smithi045.stdout: -7444> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5754 pv6006 ap=128 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=128) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=127) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.215 INFO:teuthology.orchestra.run.smithi045.stdout: -7443> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5752 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.215 INFO:teuthology.orchestra.run.smithi045.stdout: -7442> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5753 cv=5559/5559 REP dir_auth=0 ap=127+128 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5753 2023-10-03T19:21:01.215 INFO:teuthology.orchestra.run.smithi045.stdout: -7441> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000055e) pop_and_dirty_projected_inode v5748 2023-10-03T19:21:01.215 INFO:teuthology.orchestra.run.smithi045.stdout: -7440> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000055e) mark_dirty [inode 0x1000000055e [2,head] /dc-dir/dc-file_873 auth v5748 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.889904+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d71f080] 2023-10-03T19:21:01.215 INFO:teuthology.orchestra.run.smithi045.stdout: -7439> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_873) mark_dirty [dentry #0x1/dc-dir/dc-file_873 [2,head] auth (dversion lock) pv=5748 v=4434 ino=0x1000000055e state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d719900] 2023-10-03T19:21:01.215 INFO:teuthology.orchestra.run.smithi045.stdout: -7438> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5747 cv=5553/5553 ap=128+127 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=98 | child=1 dirty=1 authpin=1 0x55576d056400] version 5747 2023-10-03T19:21:01.215 INFO:teuthology.orchestra.run.smithi045.stdout: -7437> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d537a00 v5755 2023-10-03T19:21:01.215 INFO:teuthology.orchestra.run.smithi045.stdout: -7436> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5755 cv=5559/5559 REP dir_auth=0 ap=127+128 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5755 2023-10-03T19:21:01.215 INFO:teuthology.orchestra.run.smithi045.stdout: -7435> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d53e6e0 v5749 2023-10-03T19:21:01.215 INFO:teuthology.orchestra.run.smithi045.stdout: -7434> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5749 cv=5553/5553 ap=128+127 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=98 | child=1 dirty=1 authpin=1 0x55576d056400] version 5749 2023-10-03T19:21:01.216 INFO:teuthology.orchestra.run.smithi045.stdout: -7433> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=127 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=127 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.216 INFO:teuthology.orchestra.run.smithi045.stdout: -7432> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=127) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5754 pv6006 ap=128 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=128) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=127) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.216 INFO:teuthology.orchestra.run.smithi045.stdout: -7431> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=128) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5754 pv6006 ap=128 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=128) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=126) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.216 INFO:teuthology.orchestra.run.smithi045.stdout: -7430> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000055e [2,head] /dc-dir/dc-file_873 auth v5748 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.889904+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d71f080] 2023-10-03T19:21:01.216 INFO:teuthology.orchestra.run.smithi045.stdout: -7429> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000055e [2,head] /dc-dir/dc-file_873 auth v5748 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.889904+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d71f080] 2023-10-03T19:21:01.216 INFO:teuthology.orchestra.run.smithi045.stdout: -7428> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.216 INFO:teuthology.orchestra.run.smithi045.stdout: -7427> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.216 INFO:teuthology.orchestra.run.smithi045.stdout: -7426> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.216 INFO:teuthology.orchestra.run.smithi045.stdout: -7425> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000055e [2,head] /dc-dir/dc-file_873 auth v5748 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.889904+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d71f080] 2023-10-03T19:21:01.216 INFO:teuthology.orchestra.run.smithi045.stdout: -7424> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000055e [2,head] /dc-dir/dc-file_873 auth v5748 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.889904+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d71f080] 2023-10-03T19:21:01.216 INFO:teuthology.orchestra.run.smithi045.stdout: -7423> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.217 INFO:teuthology.orchestra.run.smithi045.stdout: -7422> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 287.614, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.88e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:578.2] 2023-10-03T19:21:01.217 INFO:teuthology.orchestra.run.smithi045.stdout: -7421> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d538d80 on [dir 0x1 / [2,head] auth pv=6007 v=5755 cv=5559/5559 REP dir_auth=0 ap=126+128 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 126 2023-10-03T19:21:01.217 INFO:teuthology.orchestra.run.smithi045.stdout: -7420> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d538d80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5754 pv6006 ap=127 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=127) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=126) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 127 2023-10-03T19:21:01.217 INFO:teuthology.orchestra.run.smithi045.stdout: -7419> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5755 cv=5559/5559 REP dir_auth=0 ap=126+127 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d538d80 count now 126/127 2023-10-03T19:21:01.217 INFO:teuthology.orchestra.run.smithi045.stdout: -7418> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d538d80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5749 cv=5553/5553 ap=127+127 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=98 | child=1 dirty=1 authpin=1 0x55576d056400] count now 127 2023-10-03T19:21:01.217 INFO:teuthology.orchestra.run.smithi045.stdout: -7417> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000055e) auth_unpin by 0x55576d538d80 on [inode 0x1000000055e [2,head] /dc-dir/dc-file_873 auth v5748 s=3 n(v0 rc2023-10-03T19:16:11.889904+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d71f080] now 0 2023-10-03T19:21:01.217 INFO:teuthology.orchestra.run.smithi045.stdout: -7416> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5749 cv=5553/5553 ap=127+126 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=98 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d538d80 count now 127/126 2023-10-03T19:21:01.217 INFO:teuthology.orchestra.run.smithi045.stdout: -7415> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.217 INFO:teuthology.orchestra.run.smithi045.stdout: -7414> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.217 INFO:teuthology.orchestra.run.smithi045.stdout: -7413> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000055f [2,head] /dc-dir/dc-file_874 auth v4438 pv5750 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.901444+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.901444+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d71f600] 2023-10-03T19:21:01.217 INFO:teuthology.orchestra.run.smithi045.stdout: -7412> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5756 2023-10-03T19:21:01.217 INFO:teuthology.orchestra.run.smithi045.stdout: -7411> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5756 pv6006 ap=127 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=127) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=126) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.218 INFO:teuthology.orchestra.run.smithi045.stdout: -7410> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5754 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.218 INFO:teuthology.orchestra.run.smithi045.stdout: -7409> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5755 cv=5559/5559 REP dir_auth=0 ap=126+127 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5755 2023-10-03T19:21:01.218 INFO:teuthology.orchestra.run.smithi045.stdout: -7408> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000055f) pop_and_dirty_projected_inode v5750 2023-10-03T19:21:01.218 INFO:teuthology.orchestra.run.smithi045.stdout: -7407> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000055f) mark_dirty [inode 0x1000000055f [2,head] /dc-dir/dc-file_874 auth v5750 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.901444+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d71f600] 2023-10-03T19:21:01.218 INFO:teuthology.orchestra.run.smithi045.stdout: -7406> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_874) mark_dirty [dentry #0x1/dc-dir/dc-file_874 [2,head] auth (dversion lock) pv=5750 v=4438 ino=0x1000000055f state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d719b80] 2023-10-03T19:21:01.218 INFO:teuthology.orchestra.run.smithi045.stdout: -7405> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5749 cv=5553/5553 ap=127+126 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=99 | child=1 dirty=1 authpin=1 0x55576d056400] version 5749 2023-10-03T19:21:01.218 INFO:teuthology.orchestra.run.smithi045.stdout: -7404> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d537c40 v5757 2023-10-03T19:21:01.218 INFO:teuthology.orchestra.run.smithi045.stdout: -7403> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5757 cv=5559/5559 REP dir_auth=0 ap=126+127 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5757 2023-10-03T19:21:01.218 INFO:teuthology.orchestra.run.smithi045.stdout: -7402> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d53e920 v5751 2023-10-03T19:21:01.218 INFO:teuthology.orchestra.run.smithi045.stdout: -7401> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5751 cv=5553/5553 ap=127+126 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=99 | child=1 dirty=1 authpin=1 0x55576d056400] version 5751 2023-10-03T19:21:01.219 INFO:teuthology.orchestra.run.smithi045.stdout: -7400> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=126 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=126 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.219 INFO:teuthology.orchestra.run.smithi045.stdout: -7399> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=126) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5756 pv6006 ap=127 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=127) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=126) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.219 INFO:teuthology.orchestra.run.smithi045.stdout: -7398> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=127) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5756 pv6006 ap=127 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=127) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=125) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.219 INFO:teuthology.orchestra.run.smithi045.stdout: -7397> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000055f [2,head] /dc-dir/dc-file_874 auth v5750 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.901444+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d71f600] 2023-10-03T19:21:01.315 INFO:teuthology.orchestra.run.smithi045.stdout: -7396> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000055f [2,head] /dc-dir/dc-file_874 auth v5750 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.901444+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d71f600] 2023-10-03T19:21:01.316 INFO:teuthology.orchestra.run.smithi045.stdout: -7395> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.316 INFO:teuthology.orchestra.run.smithi045.stdout: -7394> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.316 INFO:teuthology.orchestra.run.smithi045.stdout: -7393> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.316 INFO:teuthology.orchestra.run.smithi045.stdout: -7392> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000055f [2,head] /dc-dir/dc-file_874 auth v5750 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.901444+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d71f600] 2023-10-03T19:21:01.316 INFO:teuthology.orchestra.run.smithi045.stdout: -7391> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000055f [2,head] /dc-dir/dc-file_874 auth v5750 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.901444+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d71f600] 2023-10-03T19:21:01.316 INFO:teuthology.orchestra.run.smithi045.stdout: -7390> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.316 INFO:teuthology.orchestra.run.smithi045.stdout: -7389> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 288.614, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.89e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:580.2] 2023-10-03T19:21:01.316 INFO:teuthology.orchestra.run.smithi045.stdout: -7388> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d3dc240 on [dir 0x1 / [2,head] auth pv=6007 v=5757 cv=5559/5559 REP dir_auth=0 ap=125+127 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 125 2023-10-03T19:21:01.316 INFO:teuthology.orchestra.run.smithi045.stdout: -7387> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d3dc240 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5756 pv6006 ap=126 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=126) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=125) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 126 2023-10-03T19:21:01.316 INFO:teuthology.orchestra.run.smithi045.stdout: -7386> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5757 cv=5559/5559 REP dir_auth=0 ap=125+126 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d3dc240 count now 125/126 2023-10-03T19:21:01.316 INFO:teuthology.orchestra.run.smithi045.stdout: -7385> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d3dc240 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5751 cv=5553/5553 ap=126+126 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=99 | child=1 dirty=1 authpin=1 0x55576d056400] count now 126 2023-10-03T19:21:01.317 INFO:teuthology.orchestra.run.smithi045.stdout: -7384> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000055f) auth_unpin by 0x55576d3dc240 on [inode 0x1000000055f [2,head] /dc-dir/dc-file_874 auth v5750 s=3 n(v0 rc2023-10-03T19:16:11.901444+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d71f600] now 0 2023-10-03T19:21:01.317 INFO:teuthology.orchestra.run.smithi045.stdout: -7383> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5751 cv=5553/5553 ap=126+125 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=99 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d3dc240 count now 126/125 2023-10-03T19:21:01.317 INFO:teuthology.orchestra.run.smithi045.stdout: -7382> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.317 INFO:teuthology.orchestra.run.smithi045.stdout: -7381> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.317 INFO:teuthology.orchestra.run.smithi045.stdout: -7380> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000560 [2,head] /dc-dir/dc-file_875 auth v4442 pv5752 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.912533+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.912533+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d71fb80] 2023-10-03T19:21:01.317 INFO:teuthology.orchestra.run.smithi045.stdout: -7379> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5758 2023-10-03T19:21:01.317 INFO:teuthology.orchestra.run.smithi045.stdout: -7378> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5758 pv6006 ap=126 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=126) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=125) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.317 INFO:teuthology.orchestra.run.smithi045.stdout: -7377> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5756 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.317 INFO:teuthology.orchestra.run.smithi045.stdout: -7376> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5757 cv=5559/5559 REP dir_auth=0 ap=125+126 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5757 2023-10-03T19:21:01.317 INFO:teuthology.orchestra.run.smithi045.stdout: -7375> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000560) pop_and_dirty_projected_inode v5752 2023-10-03T19:21:01.318 INFO:teuthology.orchestra.run.smithi045.stdout: -7374> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000560) mark_dirty [inode 0x10000000560 [2,head] /dc-dir/dc-file_875 auth v5752 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.912533+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d71fb80] 2023-10-03T19:21:01.318 INFO:teuthology.orchestra.run.smithi045.stdout: -7373> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_875) mark_dirty [dentry #0x1/dc-dir/dc-file_875 [2,head] auth (dversion lock) pv=5752 v=4442 ino=0x10000000560 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d722000] 2023-10-03T19:21:01.318 INFO:teuthology.orchestra.run.smithi045.stdout: -7372> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5751 cv=5553/5553 ap=126+125 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=100 | child=1 dirty=1 authpin=1 0x55576d056400] version 5751 2023-10-03T19:21:01.318 INFO:teuthology.orchestra.run.smithi045.stdout: -7371> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d537e80 v5759 2023-10-03T19:21:01.318 INFO:teuthology.orchestra.run.smithi045.stdout: -7370> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5759 cv=5559/5559 REP dir_auth=0 ap=125+126 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5759 2023-10-03T19:21:01.318 INFO:teuthology.orchestra.run.smithi045.stdout: -7369> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d5558e0 v5753 2023-10-03T19:21:01.318 INFO:teuthology.orchestra.run.smithi045.stdout: -7368> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5753 cv=5553/5553 ap=126+125 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=100 | child=1 dirty=1 authpin=1 0x55576d056400] version 5753 2023-10-03T19:21:01.318 INFO:teuthology.orchestra.run.smithi045.stdout: -7367> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=125 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=125 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.318 INFO:teuthology.orchestra.run.smithi045.stdout: -7366> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=125) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5758 pv6006 ap=126 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=126) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=125) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.318 INFO:teuthology.orchestra.run.smithi045.stdout: -7365> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=126) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5758 pv6006 ap=126 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=126) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=124) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.319 INFO:teuthology.orchestra.run.smithi045.stdout: -7364> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000560 [2,head] /dc-dir/dc-file_875 auth v5752 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.912533+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d71fb80] 2023-10-03T19:21:01.319 INFO:teuthology.orchestra.run.smithi045.stdout: -7363> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000560 [2,head] /dc-dir/dc-file_875 auth v5752 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.912533+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d71fb80] 2023-10-03T19:21:01.319 INFO:teuthology.orchestra.run.smithi045.stdout: -7362> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.319 INFO:teuthology.orchestra.run.smithi045.stdout: -7361> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.319 INFO:teuthology.orchestra.run.smithi045.stdout: -7360> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.319 INFO:teuthology.orchestra.run.smithi045.stdout: -7359> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000560 [2,head] /dc-dir/dc-file_875 auth v5752 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.912533+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d71fb80] 2023-10-03T19:21:01.319 INFO:teuthology.orchestra.run.smithi045.stdout: -7358> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000560 [2,head] /dc-dir/dc-file_875 auth v5752 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.912533+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d71fb80] 2023-10-03T19:21:01.319 INFO:teuthology.orchestra.run.smithi045.stdout: -7357> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.319 INFO:teuthology.orchestra.run.smithi045.stdout: -7356> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 289.614, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.90e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:582.2] 2023-10-03T19:21:01.319 INFO:teuthology.orchestra.run.smithi045.stdout: -7355> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d5c7b00 on [dir 0x1 / [2,head] auth pv=6007 v=5759 cv=5559/5559 REP dir_auth=0 ap=124+126 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 124 2023-10-03T19:21:01.319 INFO:teuthology.orchestra.run.smithi045.stdout: -7354> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d5c7b00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5758 pv6006 ap=125 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=125) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=124) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 125 2023-10-03T19:21:01.320 INFO:teuthology.orchestra.run.smithi045.stdout: -7353> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5759 cv=5559/5559 REP dir_auth=0 ap=124+125 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d5c7b00 count now 124/125 2023-10-03T19:21:01.320 INFO:teuthology.orchestra.run.smithi045.stdout: -7352> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d5c7b00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5753 cv=5553/5553 ap=125+125 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=100 | child=1 dirty=1 authpin=1 0x55576d056400] count now 125 2023-10-03T19:21:01.320 INFO:teuthology.orchestra.run.smithi045.stdout: -7351> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000560) auth_unpin by 0x55576d5c7b00 on [inode 0x10000000560 [2,head] /dc-dir/dc-file_875 auth v5752 s=3 n(v0 rc2023-10-03T19:16:11.912533+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d71fb80] now 0 2023-10-03T19:21:01.320 INFO:teuthology.orchestra.run.smithi045.stdout: -7350> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5753 cv=5553/5553 ap=125+124 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=100 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d5c7b00 count now 125/124 2023-10-03T19:21:01.320 INFO:teuthology.orchestra.run.smithi045.stdout: -7349> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.320 INFO:teuthology.orchestra.run.smithi045.stdout: -7348> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.320 INFO:teuthology.orchestra.run.smithi045.stdout: -7347> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000561 [2,head] /dc-dir/dc-file_876 auth v4446 pv5754 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.924662+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.924662+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d720100] 2023-10-03T19:21:01.320 INFO:teuthology.orchestra.run.smithi045.stdout: -7346> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5760 2023-10-03T19:21:01.320 INFO:teuthology.orchestra.run.smithi045.stdout: -7345> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5760 pv6006 ap=125 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=125) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=124) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.320 INFO:teuthology.orchestra.run.smithi045.stdout: -7344> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5758 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.320 INFO:teuthology.orchestra.run.smithi045.stdout: -7343> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5759 cv=5559/5559 REP dir_auth=0 ap=124+125 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5759 2023-10-03T19:21:01.323 INFO:teuthology.orchestra.run.smithi045.stdout: -7342> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000561) pop_and_dirty_projected_inode v5754 2023-10-03T19:21:01.323 INFO:teuthology.orchestra.run.smithi045.stdout: -7341> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000561) mark_dirty [inode 0x10000000561 [2,head] /dc-dir/dc-file_876 auth v5754 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.924662+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d720100] 2023-10-03T19:21:01.323 INFO:teuthology.orchestra.run.smithi045.stdout: -7340> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_876) mark_dirty [dentry #0x1/dc-dir/dc-file_876 [2,head] auth (dversion lock) pv=5754 v=4446 ino=0x10000000561 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d722280] 2023-10-03T19:21:01.323 INFO:teuthology.orchestra.run.smithi045.stdout: -7339> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5753 cv=5553/5553 ap=125+124 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=101 | child=1 dirty=1 authpin=1 0x55576d056400] version 5753 2023-10-03T19:21:01.324 INFO:teuthology.orchestra.run.smithi045.stdout: -7338> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d53e140 v5761 2023-10-03T19:21:01.324 INFO:teuthology.orchestra.run.smithi045.stdout: -7337> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5761 cv=5559/5559 REP dir_auth=0 ap=124+125 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5761 2023-10-03T19:21:01.324 INFO:teuthology.orchestra.run.smithi045.stdout: -7336> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d5557c0 v5755 2023-10-03T19:21:01.324 INFO:teuthology.orchestra.run.smithi045.stdout: -7335> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5755 cv=5553/5553 ap=125+124 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=101 | child=1 dirty=1 authpin=1 0x55576d056400] version 5755 2023-10-03T19:21:01.324 INFO:teuthology.orchestra.run.smithi045.stdout: -7334> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=124 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=124 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.324 INFO:teuthology.orchestra.run.smithi045.stdout: -7333> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=124) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5760 pv6006 ap=125 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=125) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=124) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.324 INFO:teuthology.orchestra.run.smithi045.stdout: -7332> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=125) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5760 pv6006 ap=125 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=125) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=123) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.324 INFO:teuthology.orchestra.run.smithi045.stdout: -7331> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000561 [2,head] /dc-dir/dc-file_876 auth v5754 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.924662+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d720100] 2023-10-03T19:21:01.324 INFO:teuthology.orchestra.run.smithi045.stdout: -7330> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000561 [2,head] /dc-dir/dc-file_876 auth v5754 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.924662+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d720100] 2023-10-03T19:21:01.324 INFO:teuthology.orchestra.run.smithi045.stdout: -7329> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.324 INFO:teuthology.orchestra.run.smithi045.stdout: -7328> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.325 INFO:teuthology.orchestra.run.smithi045.stdout: -7327> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.325 INFO:teuthology.orchestra.run.smithi045.stdout: -7326> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000561 [2,head] /dc-dir/dc-file_876 auth v5754 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.924662+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d720100] 2023-10-03T19:21:01.325 INFO:teuthology.orchestra.run.smithi045.stdout: -7325> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000561 [2,head] /dc-dir/dc-file_876 auth v5754 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.924662+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d720100] 2023-10-03T19:21:01.325 INFO:teuthology.orchestra.run.smithi045.stdout: -7324> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.325 INFO:teuthology.orchestra.run.smithi045.stdout: -7323> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 290.614, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.91e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:584.2] 2023-10-03T19:21:01.325 INFO:teuthology.orchestra.run.smithi045.stdout: -7322> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d546900 on [dir 0x1 / [2,head] auth pv=6007 v=5761 cv=5559/5559 REP dir_auth=0 ap=123+125 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 123 2023-10-03T19:21:01.325 INFO:teuthology.orchestra.run.smithi045.stdout: -7321> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d546900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5760 pv6006 ap=124 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=124) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=123) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 124 2023-10-03T19:21:01.325 INFO:teuthology.orchestra.run.smithi045.stdout: -7320> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5761 cv=5559/5559 REP dir_auth=0 ap=123+124 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d546900 count now 123/124 2023-10-03T19:21:01.325 INFO:teuthology.orchestra.run.smithi045.stdout: -7319> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d546900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5755 cv=5553/5553 ap=124+124 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=101 | child=1 dirty=1 authpin=1 0x55576d056400] count now 124 2023-10-03T19:21:01.326 INFO:teuthology.orchestra.run.smithi045.stdout: -7318> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000561) auth_unpin by 0x55576d546900 on [inode 0x10000000561 [2,head] /dc-dir/dc-file_876 auth v5754 s=3 n(v0 rc2023-10-03T19:16:11.924662+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d720100] now 0 2023-10-03T19:21:01.326 INFO:teuthology.orchestra.run.smithi045.stdout: -7317> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5755 cv=5553/5553 ap=124+123 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=101 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d546900 count now 124/123 2023-10-03T19:21:01.326 INFO:teuthology.orchestra.run.smithi045.stdout: -7316> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.326 INFO:teuthology.orchestra.run.smithi045.stdout: -7315> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.326 INFO:teuthology.orchestra.run.smithi045.stdout: -7314> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000562 [2,head] /dc-dir/dc-file_877 auth v4450 pv5756 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.935807+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.935807+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d720680] 2023-10-03T19:21:01.326 INFO:teuthology.orchestra.run.smithi045.stdout: -7313> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5762 2023-10-03T19:21:01.326 INFO:teuthology.orchestra.run.smithi045.stdout: -7312> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5762 pv6006 ap=124 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=124) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=123) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.326 INFO:teuthology.orchestra.run.smithi045.stdout: -7311> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5760 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.326 INFO:teuthology.orchestra.run.smithi045.stdout: -7310> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5761 cv=5559/5559 REP dir_auth=0 ap=123+124 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5761 2023-10-03T19:21:01.327 INFO:teuthology.orchestra.run.smithi045.stdout: -7309> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000562) pop_and_dirty_projected_inode v5756 2023-10-03T19:21:01.327 INFO:teuthology.orchestra.run.smithi045.stdout: -7308> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000562) mark_dirty [inode 0x10000000562 [2,head] /dc-dir/dc-file_877 auth v5756 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.935807+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d720680] 2023-10-03T19:21:01.327 INFO:teuthology.orchestra.run.smithi045.stdout: -7307> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_877) mark_dirty [dentry #0x1/dc-dir/dc-file_877 [2,head] auth (dversion lock) pv=5756 v=4450 ino=0x10000000562 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d722500] 2023-10-03T19:21:01.327 INFO:teuthology.orchestra.run.smithi045.stdout: -7306> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5755 cv=5553/5553 ap=124+123 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=102 | child=1 dirty=1 authpin=1 0x55576d056400] version 5755 2023-10-03T19:21:01.327 INFO:teuthology.orchestra.run.smithi045.stdout: -7305> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d53e380 v5763 2023-10-03T19:21:01.327 INFO:teuthology.orchestra.run.smithi045.stdout: -7304> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5763 cv=5559/5559 REP dir_auth=0 ap=123+124 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5763 2023-10-03T19:21:01.327 INFO:teuthology.orchestra.run.smithi045.stdout: -7303> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d555580 v5757 2023-10-03T19:21:01.327 INFO:teuthology.orchestra.run.smithi045.stdout: -7302> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5757 cv=5553/5553 ap=124+123 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=102 | child=1 dirty=1 authpin=1 0x55576d056400] version 5757 2023-10-03T19:21:01.327 INFO:teuthology.orchestra.run.smithi045.stdout: -7301> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=123 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=123 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.327 INFO:teuthology.orchestra.run.smithi045.stdout: -7300> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=123) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5762 pv6006 ap=124 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=124) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=123) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.327 INFO:teuthology.orchestra.run.smithi045.stdout: -7299> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=124) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5762 pv6006 ap=124 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=124) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=122) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.328 INFO:teuthology.orchestra.run.smithi045.stdout: -7298> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000562 [2,head] /dc-dir/dc-file_877 auth v5756 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.935807+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d720680] 2023-10-03T19:21:01.351 INFO:teuthology.orchestra.run.smithi045.stdout: -7297> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000562 [2,head] /dc-dir/dc-file_877 auth v5756 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.935807+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d720680] 2023-10-03T19:21:01.351 INFO:teuthology.orchestra.run.smithi045.stdout: -7296> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.351 INFO:teuthology.orchestra.run.smithi045.stdout: -7295> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.351 INFO:teuthology.orchestra.run.smithi045.stdout: -7294> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.351 INFO:teuthology.orchestra.run.smithi045.stdout: -7293> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000562 [2,head] /dc-dir/dc-file_877 auth v5756 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.935807+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d720680] 2023-10-03T19:21:01.351 INFO:teuthology.orchestra.run.smithi045.stdout: -7292> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000562 [2,head] /dc-dir/dc-file_877 auth v5756 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.935807+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d720680] 2023-10-03T19:21:01.352 INFO:teuthology.orchestra.run.smithi045.stdout: -7291> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.352 INFO:teuthology.orchestra.run.smithi045.stdout: -7290> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 291.614, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.92e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:586.2] 2023-10-03T19:21:01.352 INFO:teuthology.orchestra.run.smithi045.stdout: -7289> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d54fd40 on [dir 0x1 / [2,head] auth pv=6007 v=5763 cv=5559/5559 REP dir_auth=0 ap=122+124 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 122 2023-10-03T19:21:01.352 INFO:teuthology.orchestra.run.smithi045.stdout: -7288> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d54fd40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5762 pv6006 ap=123 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=123) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=122) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 123 2023-10-03T19:21:01.352 INFO:teuthology.orchestra.run.smithi045.stdout: -7287> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5763 cv=5559/5559 REP dir_auth=0 ap=122+123 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d54fd40 count now 122/123 2023-10-03T19:21:01.352 INFO:teuthology.orchestra.run.smithi045.stdout: -7286> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d54fd40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5757 cv=5553/5553 ap=123+123 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=102 | child=1 dirty=1 authpin=1 0x55576d056400] count now 123 2023-10-03T19:21:01.352 INFO:teuthology.orchestra.run.smithi045.stdout: -7285> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000562) auth_unpin by 0x55576d54fd40 on [inode 0x10000000562 [2,head] /dc-dir/dc-file_877 auth v5756 s=3 n(v0 rc2023-10-03T19:16:11.935807+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d720680] now 0 2023-10-03T19:21:01.352 INFO:teuthology.orchestra.run.smithi045.stdout: -7284> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5757 cv=5553/5553 ap=123+122 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=102 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d54fd40 count now 123/122 2023-10-03T19:21:01.352 INFO:teuthology.orchestra.run.smithi045.stdout: -7283> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.352 INFO:teuthology.orchestra.run.smithi045.stdout: -7282> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.352 INFO:teuthology.orchestra.run.smithi045.stdout: -7281> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000563 [2,head] /dc-dir/dc-file_878 auth v4454 pv5758 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.947528+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.947528+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d720c00] 2023-10-03T19:21:01.353 INFO:teuthology.orchestra.run.smithi045.stdout: -7280> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5764 2023-10-03T19:21:01.353 INFO:teuthology.orchestra.run.smithi045.stdout: -7279> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5764 pv6006 ap=123 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=123) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=122) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.353 INFO:teuthology.orchestra.run.smithi045.stdout: -7278> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5762 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.353 INFO:teuthology.orchestra.run.smithi045.stdout: -7277> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5763 cv=5559/5559 REP dir_auth=0 ap=122+123 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5763 2023-10-03T19:21:01.353 INFO:teuthology.orchestra.run.smithi045.stdout: -7276> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000563) pop_and_dirty_projected_inode v5758 2023-10-03T19:21:01.353 INFO:teuthology.orchestra.run.smithi045.stdout: -7275> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000563) mark_dirty [inode 0x10000000563 [2,head] /dc-dir/dc-file_878 auth v5758 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.947528+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d720c00] 2023-10-03T19:21:01.353 INFO:teuthology.orchestra.run.smithi045.stdout: -7274> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_878) mark_dirty [dentry #0x1/dc-dir/dc-file_878 [2,head] auth (dversion lock) pv=5758 v=4454 ino=0x10000000563 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d722780] 2023-10-03T19:21:01.353 INFO:teuthology.orchestra.run.smithi045.stdout: -7273> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5757 cv=5553/5553 ap=123+122 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=103 | child=1 dirty=1 authpin=1 0x55576d056400] version 5757 2023-10-03T19:21:01.353 INFO:teuthology.orchestra.run.smithi045.stdout: -7272> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d53e5c0 v5765 2023-10-03T19:21:01.353 INFO:teuthology.orchestra.run.smithi045.stdout: -7271> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5765 cv=5559/5559 REP dir_auth=0 ap=122+123 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5765 2023-10-03T19:21:01.353 INFO:teuthology.orchestra.run.smithi045.stdout: -7270> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d555340 v5759 2023-10-03T19:21:01.354 INFO:teuthology.orchestra.run.smithi045.stdout: -7269> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5759 cv=5553/5553 ap=123+122 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=103 | child=1 dirty=1 authpin=1 0x55576d056400] version 5759 2023-10-03T19:21:01.354 INFO:teuthology.orchestra.run.smithi045.stdout: -7268> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=122 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=122 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.354 INFO:teuthology.orchestra.run.smithi045.stdout: -7267> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=122) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5764 pv6006 ap=123 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=123) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=122) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.354 INFO:teuthology.orchestra.run.smithi045.stdout: -7266> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=123) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5764 pv6006 ap=123 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=123) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=121) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.354 INFO:teuthology.orchestra.run.smithi045.stdout: -7265> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000563 [2,head] /dc-dir/dc-file_878 auth v5758 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.947528+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d720c00] 2023-10-03T19:21:01.354 INFO:teuthology.orchestra.run.smithi045.stdout: -7264> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000563 [2,head] /dc-dir/dc-file_878 auth v5758 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.947528+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d720c00] 2023-10-03T19:21:01.354 INFO:teuthology.orchestra.run.smithi045.stdout: -7263> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.354 INFO:teuthology.orchestra.run.smithi045.stdout: -7262> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.354 INFO:teuthology.orchestra.run.smithi045.stdout: -7261> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.354 INFO:teuthology.orchestra.run.smithi045.stdout: -7260> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000563 [2,head] /dc-dir/dc-file_878 auth v5758 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.947528+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d720c00] 2023-10-03T19:21:01.354 INFO:teuthology.orchestra.run.smithi045.stdout: -7259> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000563 [2,head] /dc-dir/dc-file_878 auth v5758 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.947528+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d720c00] 2023-10-03T19:21:01.354 INFO:teuthology.orchestra.run.smithi045.stdout: -7258> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.355 INFO:teuthology.orchestra.run.smithi045.stdout: -7257> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 292.614, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.93e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:588.2] 2023-10-03T19:21:01.355 INFO:teuthology.orchestra.run.smithi045.stdout: -7256> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2ab680 on [dir 0x1 / [2,head] auth pv=6007 v=5765 cv=5559/5559 REP dir_auth=0 ap=121+123 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 121 2023-10-03T19:21:01.355 INFO:teuthology.orchestra.run.smithi045.stdout: -7255> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2ab680 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5764 pv6006 ap=122 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=122) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=121) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 122 2023-10-03T19:21:01.355 INFO:teuthology.orchestra.run.smithi045.stdout: -7254> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5765 cv=5559/5559 REP dir_auth=0 ap=121+122 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2ab680 count now 121/122 2023-10-03T19:21:01.355 INFO:teuthology.orchestra.run.smithi045.stdout: -7253> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2ab680 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5759 cv=5553/5553 ap=122+122 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=103 | child=1 dirty=1 authpin=1 0x55576d056400] count now 122 2023-10-03T19:21:01.355 INFO:teuthology.orchestra.run.smithi045.stdout: -7252> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000563) auth_unpin by 0x55576d2ab680 on [inode 0x10000000563 [2,head] /dc-dir/dc-file_878 auth v5758 s=3 n(v0 rc2023-10-03T19:16:11.947528+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d720c00] now 0 2023-10-03T19:21:01.355 INFO:teuthology.orchestra.run.smithi045.stdout: -7251> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5759 cv=5553/5553 ap=122+121 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=103 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2ab680 count now 122/121 2023-10-03T19:21:01.355 INFO:teuthology.orchestra.run.smithi045.stdout: -7250> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.355 INFO:teuthology.orchestra.run.smithi045.stdout: -7249> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.355 INFO:teuthology.orchestra.run.smithi045.stdout: -7248> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000564 [2,head] /dc-dir/dc-file_879 auth v4458 pv5760 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.958487+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.958487+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d721180] 2023-10-03T19:21:01.355 INFO:teuthology.orchestra.run.smithi045.stdout: -7247> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5766 2023-10-03T19:21:01.356 INFO:teuthology.orchestra.run.smithi045.stdout: -7246> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5766 pv6006 ap=122 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=122) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=121) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.356 INFO:teuthology.orchestra.run.smithi045.stdout: -7245> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5764 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.356 INFO:teuthology.orchestra.run.smithi045.stdout: -7244> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5765 cv=5559/5559 REP dir_auth=0 ap=121+122 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5765 2023-10-03T19:21:01.356 INFO:teuthology.orchestra.run.smithi045.stdout: -7243> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000564) pop_and_dirty_projected_inode v5760 2023-10-03T19:21:01.356 INFO:teuthology.orchestra.run.smithi045.stdout: -7242> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000564) mark_dirty [inode 0x10000000564 [2,head] /dc-dir/dc-file_879 auth v5760 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.958487+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d721180] 2023-10-03T19:21:01.356 INFO:teuthology.orchestra.run.smithi045.stdout: -7241> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_879) mark_dirty [dentry #0x1/dc-dir/dc-file_879 [2,head] auth (dversion lock) pv=5760 v=4458 ino=0x10000000564 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d722a00] 2023-10-03T19:21:01.356 INFO:teuthology.orchestra.run.smithi045.stdout: -7240> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5759 cv=5553/5553 ap=122+121 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=104 | child=1 dirty=1 authpin=1 0x55576d056400] version 5759 2023-10-03T19:21:01.370 INFO:teuthology.orchestra.run.smithi045.stdout: -7239> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d54a380 v5767 2023-10-03T19:21:01.370 INFO:teuthology.orchestra.run.smithi045.stdout: -7238> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5767 cv=5559/5559 REP dir_auth=0 ap=121+122 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5767 2023-10-03T19:21:01.370 INFO:teuthology.orchestra.run.smithi045.stdout: -7237> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d554ec0 v5761 2023-10-03T19:21:01.371 INFO:teuthology.orchestra.run.smithi045.stdout: -7236> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5761 cv=5553/5553 ap=122+121 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=104 | child=1 dirty=1 authpin=1 0x55576d056400] version 5761 2023-10-03T19:21:01.371 INFO:teuthology.orchestra.run.smithi045.stdout: -7235> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=121 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=121 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.371 INFO:teuthology.orchestra.run.smithi045.stdout: -7234> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=121) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5766 pv6006 ap=122 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=122) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=121) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.371 INFO:teuthology.orchestra.run.smithi045.stdout: -7233> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=122) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5766 pv6006 ap=122 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=122) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=120) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.371 INFO:teuthology.orchestra.run.smithi045.stdout: -7232> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000564 [2,head] /dc-dir/dc-file_879 auth v5760 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.958487+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d721180] 2023-10-03T19:21:01.371 INFO:teuthology.orchestra.run.smithi045.stdout: -7231> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000564 [2,head] /dc-dir/dc-file_879 auth v5760 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.958487+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d721180] 2023-10-03T19:21:01.371 INFO:teuthology.orchestra.run.smithi045.stdout: -7230> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.371 INFO:teuthology.orchestra.run.smithi045.stdout: -7229> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.371 INFO:teuthology.orchestra.run.smithi045.stdout: -7228> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.371 INFO:teuthology.orchestra.run.smithi045.stdout: -7227> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000564 [2,head] /dc-dir/dc-file_879 auth v5760 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.958487+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d721180] 2023-10-03T19:21:01.372 INFO:teuthology.orchestra.run.smithi045.stdout: -7226> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000564 [2,head] /dc-dir/dc-file_879 auth v5760 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.958487+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d721180] 2023-10-03T19:21:01.372 INFO:teuthology.orchestra.run.smithi045.stdout: -7225> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.372 INFO:teuthology.orchestra.run.smithi045.stdout: -7224> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 293.614, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.94e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:590.2] 2023-10-03T19:21:01.372 INFO:teuthology.orchestra.run.smithi045.stdout: -7223> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d54f8c0 on [dir 0x1 / [2,head] auth pv=6007 v=5767 cv=5559/5559 REP dir_auth=0 ap=120+122 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 120 2023-10-03T19:21:01.372 INFO:teuthology.orchestra.run.smithi045.stdout: -7222> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d54f8c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5761 cv=5553/5553 ap=121+121 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=104 | child=1 dirty=1 authpin=1 0x55576d056400] count now 121 2023-10-03T19:21:01.372 INFO:teuthology.orchestra.run.smithi045.stdout: -7221> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d54f8c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5766 pv6006 ap=121 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=121) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=120) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 121 2023-10-03T19:21:01.372 INFO:teuthology.orchestra.run.smithi045.stdout: -7220> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5767 cv=5559/5559 REP dir_auth=0 ap=120+121 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d54f8c0 count now 120/121 2023-10-03T19:21:01.372 INFO:teuthology.orchestra.run.smithi045.stdout: -7219> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000564) auth_unpin by 0x55576d54f8c0 on [inode 0x10000000564 [2,head] /dc-dir/dc-file_879 auth v5760 s=3 n(v0 rc2023-10-03T19:16:11.958487+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d721180] now 0 2023-10-03T19:21:01.372 INFO:teuthology.orchestra.run.smithi045.stdout: -7218> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5761 cv=5553/5553 ap=121+120 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=104 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d54f8c0 count now 121/120 2023-10-03T19:21:01.372 INFO:teuthology.orchestra.run.smithi045.stdout: -7217> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.372 INFO:teuthology.orchestra.run.smithi045.stdout: -7216> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.372 INFO:teuthology.orchestra.run.smithi045.stdout: -7215> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000565 [2,head] /dc-dir/dc-file_880 auth v4462 pv5762 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.970644+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.970644+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d721700] 2023-10-03T19:21:01.373 INFO:teuthology.orchestra.run.smithi045.stdout: -7214> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5768 2023-10-03T19:21:01.373 INFO:teuthology.orchestra.run.smithi045.stdout: -7213> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5768 pv6006 ap=121 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=121) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=120) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.373 INFO:teuthology.orchestra.run.smithi045.stdout: -7212> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5766 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.373 INFO:teuthology.orchestra.run.smithi045.stdout: -7211> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5767 cv=5559/5559 REP dir_auth=0 ap=120+121 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5767 2023-10-03T19:21:01.373 INFO:teuthology.orchestra.run.smithi045.stdout: -7210> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000565) pop_and_dirty_projected_inode v5762 2023-10-03T19:21:01.373 INFO:teuthology.orchestra.run.smithi045.stdout: -7209> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000565) mark_dirty [inode 0x10000000565 [2,head] /dc-dir/dc-file_880 auth v5762 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.970644+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d721700] 2023-10-03T19:21:01.373 INFO:teuthology.orchestra.run.smithi045.stdout: -7208> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_880) mark_dirty [dentry #0x1/dc-dir/dc-file_880 [2,head] auth (dversion lock) pv=5762 v=4462 ino=0x10000000565 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d722c80] 2023-10-03T19:21:01.373 INFO:teuthology.orchestra.run.smithi045.stdout: -7207> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5761 cv=5553/5553 ap=121+120 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=105 | child=1 dirty=1 authpin=1 0x55576d056400] version 5761 2023-10-03T19:21:01.373 INFO:teuthology.orchestra.run.smithi045.stdout: -7206> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d54a800 v5769 2023-10-03T19:21:01.373 INFO:teuthology.orchestra.run.smithi045.stdout: -7205> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5769 cv=5559/5559 REP dir_auth=0 ap=120+121 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5769 2023-10-03T19:21:01.373 INFO:teuthology.orchestra.run.smithi045.stdout: -7204> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d54a5c0 v5763 2023-10-03T19:21:01.374 INFO:teuthology.orchestra.run.smithi045.stdout: -7203> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5763 cv=5553/5553 ap=121+120 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=105 | child=1 dirty=1 authpin=1 0x55576d056400] version 5763 2023-10-03T19:21:01.374 INFO:teuthology.orchestra.run.smithi045.stdout: -7202> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=120 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=120 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.374 INFO:teuthology.orchestra.run.smithi045.stdout: -7201> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=120) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5768 pv6006 ap=121 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=121) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=120) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.374 INFO:teuthology.orchestra.run.smithi045.stdout: -7200> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=121) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5768 pv6006 ap=121 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=121) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=119) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.374 INFO:teuthology.orchestra.run.smithi045.stdout: -7199> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000565 [2,head] /dc-dir/dc-file_880 auth v5762 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.970644+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d721700] 2023-10-03T19:21:01.374 INFO:teuthology.orchestra.run.smithi045.stdout: -7198> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000565 [2,head] /dc-dir/dc-file_880 auth v5762 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.970644+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d721700] 2023-10-03T19:21:01.374 INFO:teuthology.orchestra.run.smithi045.stdout: -7197> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.374 INFO:teuthology.orchestra.run.smithi045.stdout: -7196> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.374 INFO:teuthology.orchestra.run.smithi045.stdout: -7195> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.374 INFO:teuthology.orchestra.run.smithi045.stdout: -7194> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000565 [2,head] /dc-dir/dc-file_880 auth v5762 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.970644+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d721700] 2023-10-03T19:21:01.374 INFO:teuthology.orchestra.run.smithi045.stdout: -7193> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000565 [2,head] /dc-dir/dc-file_880 auth v5762 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.970644+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d721700] 2023-10-03T19:21:01.375 INFO:teuthology.orchestra.run.smithi045.stdout: -7192> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.375 INFO:teuthology.orchestra.run.smithi045.stdout: -7191> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 294.614, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.95e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:592.2] 2023-10-03T19:21:01.375 INFO:teuthology.orchestra.run.smithi045.stdout: -7190> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2abd40 on [dir 0x1 / [2,head] auth pv=6007 v=5769 cv=5559/5559 REP dir_auth=0 ap=119+121 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 119 2023-10-03T19:21:01.375 INFO:teuthology.orchestra.run.smithi045.stdout: -7189> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2abd40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5768 pv6006 ap=120 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=120) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=119) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 120 2023-10-03T19:21:01.375 INFO:teuthology.orchestra.run.smithi045.stdout: -7188> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5769 cv=5559/5559 REP dir_auth=0 ap=119+120 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2abd40 count now 119/120 2023-10-03T19:21:01.375 INFO:teuthology.orchestra.run.smithi045.stdout: -7187> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2abd40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5763 cv=5553/5553 ap=120+120 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=105 | child=1 dirty=1 authpin=1 0x55576d056400] count now 120 2023-10-03T19:21:01.375 INFO:teuthology.orchestra.run.smithi045.stdout: -7186> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000565) auth_unpin by 0x55576d2abd40 on [inode 0x10000000565 [2,head] /dc-dir/dc-file_880 auth v5762 s=3 n(v0 rc2023-10-03T19:16:11.970644+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d721700] now 0 2023-10-03T19:21:01.375 INFO:teuthology.orchestra.run.smithi045.stdout: -7185> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5763 cv=5553/5553 ap=120+119 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=105 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2abd40 count now 120/119 2023-10-03T19:21:01.375 INFO:teuthology.orchestra.run.smithi045.stdout: -7184> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.375 INFO:teuthology.orchestra.run.smithi045.stdout: -7183> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.471 INFO:teuthology.orchestra.run.smithi045.stdout: -7182> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000566 [2,head] /dc-dir/dc-file_881 auth v4466 pv5764 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.981827+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.981827+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d726000] 2023-10-03T19:21:01.471 INFO:teuthology.orchestra.run.smithi045.stdout: -7181> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5770 2023-10-03T19:21:01.471 INFO:teuthology.orchestra.run.smithi045.stdout: -7180> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5770 pv6006 ap=120 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=120) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=119) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.471 INFO:teuthology.orchestra.run.smithi045.stdout: -7179> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5768 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.471 INFO:teuthology.orchestra.run.smithi045.stdout: -7178> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5769 cv=5559/5559 REP dir_auth=0 ap=119+120 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5769 2023-10-03T19:21:01.471 INFO:teuthology.orchestra.run.smithi045.stdout: -7177> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000566) pop_and_dirty_projected_inode v5764 2023-10-03T19:21:01.471 INFO:teuthology.orchestra.run.smithi045.stdout: -7176> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000566) mark_dirty [inode 0x10000000566 [2,head] /dc-dir/dc-file_881 auth v5764 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.981827+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d726000] 2023-10-03T19:21:01.472 INFO:teuthology.orchestra.run.smithi045.stdout: -7175> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_881) mark_dirty [dentry #0x1/dc-dir/dc-file_881 [2,head] auth (dversion lock) pv=5764 v=4466 ino=0x10000000566 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d722f00] 2023-10-03T19:21:01.472 INFO:teuthology.orchestra.run.smithi045.stdout: -7174> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5763 cv=5553/5553 ap=120+119 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=106 | child=1 dirty=1 authpin=1 0x55576d056400] version 5763 2023-10-03T19:21:01.472 INFO:teuthology.orchestra.run.smithi045.stdout: -7173> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d555100 v5771 2023-10-03T19:21:01.472 INFO:teuthology.orchestra.run.smithi045.stdout: -7172> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5771 cv=5559/5559 REP dir_auth=0 ap=119+120 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5771 2023-10-03T19:21:01.472 INFO:teuthology.orchestra.run.smithi045.stdout: -7171> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d53e800 v5765 2023-10-03T19:21:01.472 INFO:teuthology.orchestra.run.smithi045.stdout: -7170> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5765 cv=5553/5553 ap=120+119 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=106 | child=1 dirty=1 authpin=1 0x55576d056400] version 5765 2023-10-03T19:21:01.472 INFO:teuthology.orchestra.run.smithi045.stdout: -7169> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=119 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=119 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.472 INFO:teuthology.orchestra.run.smithi045.stdout: -7168> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=119) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5770 pv6006 ap=120 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=120) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=119) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.472 INFO:teuthology.orchestra.run.smithi045.stdout: -7167> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=120) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5770 pv6006 ap=120 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=120) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=118) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.472 INFO:teuthology.orchestra.run.smithi045.stdout: -7166> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000566 [2,head] /dc-dir/dc-file_881 auth v5764 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.981827+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d726000] 2023-10-03T19:21:01.472 INFO:teuthology.orchestra.run.smithi045.stdout: -7165> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000566 [2,head] /dc-dir/dc-file_881 auth v5764 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.981827+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d726000] 2023-10-03T19:21:01.473 INFO:teuthology.orchestra.run.smithi045.stdout: -7164> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.473 INFO:teuthology.orchestra.run.smithi045.stdout: -7163> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.473 INFO:teuthology.orchestra.run.smithi045.stdout: -7162> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.473 INFO:teuthology.orchestra.run.smithi045.stdout: -7161> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000566 [2,head] /dc-dir/dc-file_881 auth v5764 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.981827+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d726000] 2023-10-03T19:21:01.473 INFO:teuthology.orchestra.run.smithi045.stdout: -7160> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000566 [2,head] /dc-dir/dc-file_881 auth v5764 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.981827+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d726000] 2023-10-03T19:21:01.473 INFO:teuthology.orchestra.run.smithi045.stdout: -7159> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.473 INFO:teuthology.orchestra.run.smithi045.stdout: -7158> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 295.614, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.96e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:594.2] 2023-10-03T19:21:01.473 INFO:teuthology.orchestra.run.smithi045.stdout: -7157> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d097d40 on [dir 0x1 / [2,head] auth pv=6007 v=5771 cv=5559/5559 REP dir_auth=0 ap=118+120 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 118 2023-10-03T19:21:01.473 INFO:teuthology.orchestra.run.smithi045.stdout: -7156> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d097d40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5770 pv6006 ap=119 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=119) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=118) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 119 2023-10-03T19:21:01.473 INFO:teuthology.orchestra.run.smithi045.stdout: -7155> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5771 cv=5559/5559 REP dir_auth=0 ap=118+119 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d097d40 count now 118/119 2023-10-03T19:21:01.473 INFO:teuthology.orchestra.run.smithi045.stdout: -7154> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d097d40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5765 cv=5553/5553 ap=119+119 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=106 | child=1 dirty=1 authpin=1 0x55576d056400] count now 119 2023-10-03T19:21:01.474 INFO:teuthology.orchestra.run.smithi045.stdout: -7153> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000566) auth_unpin by 0x55576d097d40 on [inode 0x10000000566 [2,head] /dc-dir/dc-file_881 auth v5764 s=3 n(v0 rc2023-10-03T19:16:11.981827+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d726000] now 0 2023-10-03T19:21:01.474 INFO:teuthology.orchestra.run.smithi045.stdout: -7152> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5765 cv=5553/5553 ap=119+118 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=106 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d097d40 count now 119/118 2023-10-03T19:21:01.474 INFO:teuthology.orchestra.run.smithi045.stdout: -7151> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.474 INFO:teuthology.orchestra.run.smithi045.stdout: -7150> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.474 INFO:teuthology.orchestra.run.smithi045.stdout: -7149> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000567 [2,head] /dc-dir/dc-file_882 auth v4470 pv5766 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.993369+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:11.993369+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d726580] 2023-10-03T19:21:01.474 INFO:teuthology.orchestra.run.smithi045.stdout: -7148> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5772 2023-10-03T19:21:01.474 INFO:teuthology.orchestra.run.smithi045.stdout: -7147> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5772 pv6006 ap=119 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=119) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=118) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.474 INFO:teuthology.orchestra.run.smithi045.stdout: -7146> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5770 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.474 INFO:teuthology.orchestra.run.smithi045.stdout: -7145> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5771 cv=5559/5559 REP dir_auth=0 ap=118+119 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5771 2023-10-03T19:21:01.474 INFO:teuthology.orchestra.run.smithi045.stdout: -7144> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000567) pop_and_dirty_projected_inode v5766 2023-10-03T19:21:01.475 INFO:teuthology.orchestra.run.smithi045.stdout: -7143> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000567) mark_dirty [inode 0x10000000567 [2,head] /dc-dir/dc-file_882 auth v5766 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.993369+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d726580] 2023-10-03T19:21:01.475 INFO:teuthology.orchestra.run.smithi045.stdout: -7142> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_882) mark_dirty [dentry #0x1/dc-dir/dc-file_882 [2,head] auth (dversion lock) pv=5766 v=4470 ino=0x10000000567 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d723180] 2023-10-03T19:21:01.475 INFO:teuthology.orchestra.run.smithi045.stdout: -7141> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5765 cv=5553/5553 ap=119+118 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=107 | child=1 dirty=1 authpin=1 0x55576d056400] version 5765 2023-10-03T19:21:01.475 INFO:teuthology.orchestra.run.smithi045.stdout: -7140> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d555d60 v5773 2023-10-03T19:21:01.475 INFO:teuthology.orchestra.run.smithi045.stdout: -7139> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5773 cv=5559/5559 REP dir_auth=0 ap=118+119 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5773 2023-10-03T19:21:01.475 INFO:teuthology.orchestra.run.smithi045.stdout: -7138> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d5d65c0 v5767 2023-10-03T19:21:01.475 INFO:teuthology.orchestra.run.smithi045.stdout: -7137> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5767 cv=5553/5553 ap=119+118 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=107 | child=1 dirty=1 authpin=1 0x55576d056400] version 5767 2023-10-03T19:21:01.475 INFO:teuthology.orchestra.run.smithi045.stdout: -7136> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=118 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=118 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.475 INFO:teuthology.orchestra.run.smithi045.stdout: -7135> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=118) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5772 pv6006 ap=119 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=119) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=118) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.475 INFO:teuthology.orchestra.run.smithi045.stdout: -7134> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=119) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5772 pv6006 ap=119 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=119) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=117) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.475 INFO:teuthology.orchestra.run.smithi045.stdout: -7133> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000567 [2,head] /dc-dir/dc-file_882 auth v5766 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.993369+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d726580] 2023-10-03T19:21:01.476 INFO:teuthology.orchestra.run.smithi045.stdout: -7132> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000567 [2,head] /dc-dir/dc-file_882 auth v5766 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.993369+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d726580] 2023-10-03T19:21:01.476 INFO:teuthology.orchestra.run.smithi045.stdout: -7131> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.476 INFO:teuthology.orchestra.run.smithi045.stdout: -7130> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.476 INFO:teuthology.orchestra.run.smithi045.stdout: -7129> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.476 INFO:teuthology.orchestra.run.smithi045.stdout: -7128> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000567 [2,head] /dc-dir/dc-file_882 auth v5766 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.993369+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d726580] 2023-10-03T19:21:01.476 INFO:teuthology.orchestra.run.smithi045.stdout: -7127> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000567 [2,head] /dc-dir/dc-file_882 auth v5766 ap=1 s=3 n(v0 rc2023-10-03T19:16:11.993369+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d726580] 2023-10-03T19:21:01.476 INFO:teuthology.orchestra.run.smithi045.stdout: -7126> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.476 INFO:teuthology.orchestra.run.smithi045.stdout: -7125> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 296.614, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.97e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:596.2] 2023-10-03T19:21:01.476 INFO:teuthology.orchestra.run.smithi045.stdout: -7124> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2ab8c0 on [dir 0x1 / [2,head] auth pv=6007 v=5773 cv=5559/5559 REP dir_auth=0 ap=117+119 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 117 2023-10-03T19:21:01.476 INFO:teuthology.orchestra.run.smithi045.stdout: -7123> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2ab8c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5772 pv6006 ap=118 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=118) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=117) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 118 2023-10-03T19:21:01.477 INFO:teuthology.orchestra.run.smithi045.stdout: -7122> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5773 cv=5559/5559 REP dir_auth=0 ap=117+118 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2ab8c0 count now 117/118 2023-10-03T19:21:01.477 INFO:teuthology.orchestra.run.smithi045.stdout: -7121> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2ab8c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5767 cv=5553/5553 ap=118+118 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=107 | child=1 dirty=1 authpin=1 0x55576d056400] count now 118 2023-10-03T19:21:01.477 INFO:teuthology.orchestra.run.smithi045.stdout: -7120> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000567) auth_unpin by 0x55576d2ab8c0 on [inode 0x10000000567 [2,head] /dc-dir/dc-file_882 auth v5766 s=3 n(v0 rc2023-10-03T19:16:11.993369+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d726580] now 0 2023-10-03T19:21:01.477 INFO:teuthology.orchestra.run.smithi045.stdout: -7119> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5767 cv=5553/5553 ap=118+117 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=107 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2ab8c0 count now 118/117 2023-10-03T19:21:01.477 INFO:teuthology.orchestra.run.smithi045.stdout: -7118> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.477 INFO:teuthology.orchestra.run.smithi045.stdout: -7117> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.477 INFO:teuthology.orchestra.run.smithi045.stdout: -7116> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000568 [2,head] /dc-dir/dc-file_883 auth v4474 pv5768 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.005101+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.005101+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d726b00] 2023-10-03T19:21:01.477 INFO:teuthology.orchestra.run.smithi045.stdout: -7115> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5774 2023-10-03T19:21:01.477 INFO:teuthology.orchestra.run.smithi045.stdout: -7114> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5774 pv6006 ap=118 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=118) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=117) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.477 INFO:teuthology.orchestra.run.smithi045.stdout: -7113> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5772 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.478 INFO:teuthology.orchestra.run.smithi045.stdout: -7112> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5773 cv=5559/5559 REP dir_auth=0 ap=117+118 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5773 2023-10-03T19:21:01.478 INFO:teuthology.orchestra.run.smithi045.stdout: -7111> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000568) pop_and_dirty_projected_inode v5768 2023-10-03T19:21:01.478 INFO:teuthology.orchestra.run.smithi045.stdout: -7110> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000568) mark_dirty [inode 0x10000000568 [2,head] /dc-dir/dc-file_883 auth v5768 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.005101+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d726b00] 2023-10-03T19:21:01.478 INFO:teuthology.orchestra.run.smithi045.stdout: -7109> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_883) mark_dirty [dentry #0x1/dc-dir/dc-file_883 [2,head] auth (dversion lock) pv=5768 v=4474 ino=0x10000000568 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d723400] 2023-10-03T19:21:01.478 INFO:teuthology.orchestra.run.smithi045.stdout: -7108> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5767 cv=5553/5553 ap=118+117 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=108 | child=1 dirty=1 authpin=1 0x55576d056400] version 5767 2023-10-03T19:21:01.478 INFO:teuthology.orchestra.run.smithi045.stdout: -7107> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d555b20 v5775 2023-10-03T19:21:01.478 INFO:teuthology.orchestra.run.smithi045.stdout: -7106> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5775 cv=5559/5559 REP dir_auth=0 ap=117+118 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5775 2023-10-03T19:21:01.478 INFO:teuthology.orchestra.run.smithi045.stdout: -7105> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d5d6380 v5769 2023-10-03T19:21:01.478 INFO:teuthology.orchestra.run.smithi045.stdout: -7104> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5769 cv=5553/5553 ap=118+117 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=108 | child=1 dirty=1 authpin=1 0x55576d056400] version 5769 2023-10-03T19:21:01.478 INFO:teuthology.orchestra.run.smithi045.stdout: -7103> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=117 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=117 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.478 INFO:teuthology.orchestra.run.smithi045.stdout: -7102> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=117) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5774 pv6006 ap=118 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=118) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=117) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.479 INFO:teuthology.orchestra.run.smithi045.stdout: -7101> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=118) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5774 pv6006 ap=118 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=118) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=116) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.479 INFO:teuthology.orchestra.run.smithi045.stdout: -7100> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000568 [2,head] /dc-dir/dc-file_883 auth v5768 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.005101+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d726b00] 2023-10-03T19:21:01.479 INFO:teuthology.orchestra.run.smithi045.stdout: -7099> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000568 [2,head] /dc-dir/dc-file_883 auth v5768 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.005101+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d726b00] 2023-10-03T19:21:01.479 INFO:teuthology.orchestra.run.smithi045.stdout: -7098> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.479 INFO:teuthology.orchestra.run.smithi045.stdout: -7097> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.479 INFO:teuthology.orchestra.run.smithi045.stdout: -7096> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.479 INFO:teuthology.orchestra.run.smithi045.stdout: -7095> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000568 [2,head] /dc-dir/dc-file_883 auth v5768 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.005101+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d726b00] 2023-10-03T19:21:01.479 INFO:teuthology.orchestra.run.smithi045.stdout: -7094> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000568 [2,head] /dc-dir/dc-file_883 auth v5768 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.005101+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d726b00] 2023-10-03T19:21:01.479 INFO:teuthology.orchestra.run.smithi045.stdout: -7093> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.479 INFO:teuthology.orchestra.run.smithi045.stdout: -7092> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 297.614, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.98e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.51e-01] *LOAD:598.2] 2023-10-03T19:21:01.479 INFO:teuthology.orchestra.run.smithi045.stdout: -7091> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2ab200 on [dir 0x1 / [2,head] auth pv=6007 v=5775 cv=5559/5559 REP dir_auth=0 ap=116+118 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 116 2023-10-03T19:21:01.480 INFO:teuthology.orchestra.run.smithi045.stdout: -7090> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2ab200 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5774 pv6006 ap=117 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=117) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=116) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 117 2023-10-03T19:21:01.480 INFO:teuthology.orchestra.run.smithi045.stdout: -7089> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5775 cv=5559/5559 REP dir_auth=0 ap=116+117 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2ab200 count now 116/117 2023-10-03T19:21:01.480 INFO:teuthology.orchestra.run.smithi045.stdout: -7088> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2ab200 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5769 cv=5553/5553 ap=117+117 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=108 | child=1 dirty=1 authpin=1 0x55576d056400] count now 117 2023-10-03T19:21:01.480 INFO:teuthology.orchestra.run.smithi045.stdout: -7087> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000568) auth_unpin by 0x55576d2ab200 on [inode 0x10000000568 [2,head] /dc-dir/dc-file_883 auth v5768 s=3 n(v0 rc2023-10-03T19:16:12.005101+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d726b00] now 0 2023-10-03T19:21:01.480 INFO:teuthology.orchestra.run.smithi045.stdout: -7086> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5769 cv=5553/5553 ap=117+116 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=108 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2ab200 count now 117/116 2023-10-03T19:21:01.480 INFO:teuthology.orchestra.run.smithi045.stdout: -7085> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.480 INFO:teuthology.orchestra.run.smithi045.stdout: -7084> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.480 INFO:teuthology.orchestra.run.smithi045.stdout: -7083> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000569 [2,head] /dc-dir/dc-file_884 auth v4478 pv5770 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.016050+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.016050+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d727080] 2023-10-03T19:21:01.480 INFO:teuthology.orchestra.run.smithi045.stdout: -7082> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5776 2023-10-03T19:21:01.480 INFO:teuthology.orchestra.run.smithi045.stdout: -7081> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5776 pv6006 ap=117 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=117) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=116) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.480 INFO:teuthology.orchestra.run.smithi045.stdout: -7080> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5774 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.481 INFO:teuthology.orchestra.run.smithi045.stdout: -7079> 2023-10-03T19:16:28.782+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5775 cv=5559/5559 REP dir_auth=0 ap=116+117 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5775 2023-10-03T19:21:01.481 INFO:teuthology.orchestra.run.smithi045.stdout: -7078> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000569) pop_and_dirty_projected_inode v5770 2023-10-03T19:21:01.481 INFO:teuthology.orchestra.run.smithi045.stdout: -7077> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000569) mark_dirty [inode 0x10000000569 [2,head] /dc-dir/dc-file_884 auth v5770 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.016050+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d727080] 2023-10-03T19:21:01.481 INFO:teuthology.orchestra.run.smithi045.stdout: -7076> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_884) mark_dirty [dentry #0x1/dc-dir/dc-file_884 [2,head] auth (dversion lock) pv=5770 v=4478 ino=0x10000000569 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d723680] 2023-10-03T19:21:01.481 INFO:teuthology.orchestra.run.smithi045.stdout: -7075> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5769 cv=5553/5553 ap=117+116 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=109 | child=1 dirty=1 authpin=1 0x55576d056400] version 5769 2023-10-03T19:21:01.481 INFO:teuthology.orchestra.run.smithi045.stdout: -7074> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d5d76a0 v5777 2023-10-03T19:21:01.481 INFO:teuthology.orchestra.run.smithi045.stdout: -7073> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5777 cv=5559/5559 REP dir_auth=0 ap=116+117 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5777 2023-10-03T19:21:01.481 INFO:teuthology.orchestra.run.smithi045.stdout: -7072> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d5d6140 v5771 2023-10-03T19:21:01.481 INFO:teuthology.orchestra.run.smithi045.stdout: -7071> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5771 cv=5553/5553 ap=117+116 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=109 | child=1 dirty=1 authpin=1 0x55576d056400] version 5771 2023-10-03T19:21:01.481 INFO:teuthology.orchestra.run.smithi045.stdout: -7070> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=116 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=116 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.481 INFO:teuthology.orchestra.run.smithi045.stdout: -7069> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=116) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5776 pv6006 ap=117 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=117) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=116) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.482 INFO:teuthology.orchestra.run.smithi045.stdout: -7068> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=117) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5776 pv6006 ap=117 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=117) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=115) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.482 INFO:teuthology.orchestra.run.smithi045.stdout: -7067> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000569 [2,head] /dc-dir/dc-file_884 auth v5770 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.016050+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d727080] 2023-10-03T19:21:01.482 INFO:teuthology.orchestra.run.smithi045.stdout: -7066> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000569 [2,head] /dc-dir/dc-file_884 auth v5770 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.016050+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d727080] 2023-10-03T19:21:01.482 INFO:teuthology.orchestra.run.smithi045.stdout: -7065> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.482 INFO:teuthology.orchestra.run.smithi045.stdout: -7064> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.482 INFO:teuthology.orchestra.run.smithi045.stdout: -7063> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.482 INFO:teuthology.orchestra.run.smithi045.stdout: -7062> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000569 [2,head] /dc-dir/dc-file_884 auth v5770 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.016050+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d727080] 2023-10-03T19:21:01.482 INFO:teuthology.orchestra.run.smithi045.stdout: -7061> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000569 [2,head] /dc-dir/dc-file_884 auth v5770 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.016050+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d727080] 2023-10-03T19:21:01.482 INFO:teuthology.orchestra.run.smithi045.stdout: -7060> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.482 INFO:teuthology.orchestra.run.smithi045.stdout: -7059> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 298.449, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.98e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:599.9] 2023-10-03T19:21:01.482 INFO:teuthology.orchestra.run.smithi045.stdout: -7058> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d538480 on [dir 0x1 / [2,head] auth pv=6007 v=5777 cv=5559/5559 REP dir_auth=0 ap=115+117 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 115 2023-10-03T19:21:01.483 INFO:teuthology.orchestra.run.smithi045.stdout: -7057> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d538480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5776 pv6006 ap=116 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=116) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=115) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 116 2023-10-03T19:21:01.483 INFO:teuthology.orchestra.run.smithi045.stdout: -7056> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5777 cv=5559/5559 REP dir_auth=0 ap=115+116 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d538480 count now 115/116 2023-10-03T19:21:01.483 INFO:teuthology.orchestra.run.smithi045.stdout: -7055> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d538480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5771 cv=5553/5553 ap=116+116 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=109 | child=1 dirty=1 authpin=1 0x55576d056400] count now 116 2023-10-03T19:21:01.483 INFO:teuthology.orchestra.run.smithi045.stdout: -7054> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000569) auth_unpin by 0x55576d538480 on [inode 0x10000000569 [2,head] /dc-dir/dc-file_884 auth v5770 s=3 n(v0 rc2023-10-03T19:16:12.016050+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d727080] now 0 2023-10-03T19:21:01.483 INFO:teuthology.orchestra.run.smithi045.stdout: -7053> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5771 cv=5553/5553 ap=116+115 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=109 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d538480 count now 116/115 2023-10-03T19:21:01.483 INFO:teuthology.orchestra.run.smithi045.stdout: -7052> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.483 INFO:teuthology.orchestra.run.smithi045.stdout: -7051> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.483 INFO:teuthology.orchestra.run.smithi045.stdout: -7050> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000056a [2,head] /dc-dir/dc-file_885 auth v4482 pv5772 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.027827+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.027827+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d727600] 2023-10-03T19:21:01.483 INFO:teuthology.orchestra.run.smithi045.stdout: -7049> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5778 2023-10-03T19:21:01.483 INFO:teuthology.orchestra.run.smithi045.stdout: -7048> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5778 pv6006 ap=116 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=116) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=115) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.483 INFO:teuthology.orchestra.run.smithi045.stdout: -7047> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5776 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.484 INFO:teuthology.orchestra.run.smithi045.stdout: -7046> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5777 cv=5559/5559 REP dir_auth=0 ap=115+116 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5777 2023-10-03T19:21:01.484 INFO:teuthology.orchestra.run.smithi045.stdout: -7045> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000056a) pop_and_dirty_projected_inode v5772 2023-10-03T19:21:01.484 INFO:teuthology.orchestra.run.smithi045.stdout: -7044> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000056a) mark_dirty [inode 0x1000000056a [2,head] /dc-dir/dc-file_885 auth v5772 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.027827+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d727600] 2023-10-03T19:21:01.484 INFO:teuthology.orchestra.run.smithi045.stdout: -7043> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_885) mark_dirty [dentry #0x1/dc-dir/dc-file_885 [2,head] auth (dversion lock) pv=5772 v=4482 ino=0x1000000056a state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d723900] 2023-10-03T19:21:01.484 INFO:teuthology.orchestra.run.smithi045.stdout: -7042> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5771 cv=5553/5553 ap=116+115 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=110 | child=1 dirty=1 authpin=1 0x55576d056400] version 5771 2023-10-03T19:21:01.484 INFO:teuthology.orchestra.run.smithi045.stdout: -7041> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d5d7d60 v5779 2023-10-03T19:21:01.484 INFO:teuthology.orchestra.run.smithi045.stdout: -7040> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5779 cv=5559/5559 REP dir_auth=0 ap=115+116 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5779 2023-10-03T19:21:01.484 INFO:teuthology.orchestra.run.smithi045.stdout: -7039> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d1b3580 v5773 2023-10-03T19:21:01.484 INFO:teuthology.orchestra.run.smithi045.stdout: -7038> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5773 cv=5553/5553 ap=116+115 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=110 | child=1 dirty=1 authpin=1 0x55576d056400] version 5773 2023-10-03T19:21:01.484 INFO:teuthology.orchestra.run.smithi045.stdout: -7037> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=115 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=115 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.485 INFO:teuthology.orchestra.run.smithi045.stdout: -7036> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=115) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5778 pv6006 ap=116 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=116) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=115) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.485 INFO:teuthology.orchestra.run.smithi045.stdout: -7035> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=116) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5778 pv6006 ap=116 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=116) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=114) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.485 INFO:teuthology.orchestra.run.smithi045.stdout: -7034> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000056a [2,head] /dc-dir/dc-file_885 auth v5772 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.027827+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d727600] 2023-10-03T19:21:01.485 INFO:teuthology.orchestra.run.smithi045.stdout: -7033> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000056a [2,head] /dc-dir/dc-file_885 auth v5772 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.027827+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d727600] 2023-10-03T19:21:01.485 INFO:teuthology.orchestra.run.smithi045.stdout: -7032> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.485 INFO:teuthology.orchestra.run.smithi045.stdout: -7031> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.485 INFO:teuthology.orchestra.run.smithi045.stdout: -7030> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.485 INFO:teuthology.orchestra.run.smithi045.stdout: -7029> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000056a [2,head] /dc-dir/dc-file_885 auth v5772 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.027827+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d727600] 2023-10-03T19:21:01.485 INFO:teuthology.orchestra.run.smithi045.stdout: -7028> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000056a [2,head] /dc-dir/dc-file_885 auth v5772 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.027827+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d727600] 2023-10-03T19:21:01.485 INFO:teuthology.orchestra.run.smithi045.stdout: -7027> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.485 INFO:teuthology.orchestra.run.smithi045.stdout: -7026> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 299.449, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 2.99e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:601.9] 2023-10-03T19:21:01.486 INFO:teuthology.orchestra.run.smithi045.stdout: -7025> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d54e000 on [dir 0x1 / [2,head] auth pv=6007 v=5779 cv=5559/5559 REP dir_auth=0 ap=114+116 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 114 2023-10-03T19:21:01.486 INFO:teuthology.orchestra.run.smithi045.stdout: -7024> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d54e000 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5778 pv6006 ap=115 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=115) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=114) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 115 2023-10-03T19:21:01.486 INFO:teuthology.orchestra.run.smithi045.stdout: -7023> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5779 cv=5559/5559 REP dir_auth=0 ap=114+115 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d54e000 count now 114/115 2023-10-03T19:21:01.486 INFO:teuthology.orchestra.run.smithi045.stdout: -7022> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d54e000 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5773 cv=5553/5553 ap=115+115 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=110 | child=1 dirty=1 authpin=1 0x55576d056400] count now 115 2023-10-03T19:21:01.486 INFO:teuthology.orchestra.run.smithi045.stdout: -7021> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000056a) auth_unpin by 0x55576d54e000 on [inode 0x1000000056a [2,head] /dc-dir/dc-file_885 auth v5772 s=3 n(v0 rc2023-10-03T19:16:12.027827+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d727600] now 0 2023-10-03T19:21:01.486 INFO:teuthology.orchestra.run.smithi045.stdout: -7020> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5773 cv=5553/5553 ap=115+114 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=110 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d54e000 count now 115/114 2023-10-03T19:21:01.486 INFO:teuthology.orchestra.run.smithi045.stdout: -7019> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.486 INFO:teuthology.orchestra.run.smithi045.stdout: -7018> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.486 INFO:teuthology.orchestra.run.smithi045.stdout: -7017> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000056b [2,head] /dc-dir/dc-file_886 auth v4486 pv5774 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.039349+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.039349+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d727b80] 2023-10-03T19:21:01.486 INFO:teuthology.orchestra.run.smithi045.stdout: -7016> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5780 2023-10-03T19:21:01.487 INFO:teuthology.orchestra.run.smithi045.stdout: -7015> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5780 pv6006 ap=115 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=115) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=114) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.487 INFO:teuthology.orchestra.run.smithi045.stdout: -7014> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5778 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.487 INFO:teuthology.orchestra.run.smithi045.stdout: -7013> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5779 cv=5559/5559 REP dir_auth=0 ap=114+115 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5779 2023-10-03T19:21:01.487 INFO:teuthology.orchestra.run.smithi045.stdout: -7012> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000056b) pop_and_dirty_projected_inode v5774 2023-10-03T19:21:01.487 INFO:teuthology.orchestra.run.smithi045.stdout: -7011> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000056b) mark_dirty [inode 0x1000000056b [2,head] /dc-dir/dc-file_886 auth v5774 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.039349+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d727b80] 2023-10-03T19:21:01.487 INFO:teuthology.orchestra.run.smithi045.stdout: -7010> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_886) mark_dirty [dentry #0x1/dc-dir/dc-file_886 [2,head] auth (dversion lock) pv=5774 v=4486 ino=0x1000000056b state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d723b80] 2023-10-03T19:21:01.487 INFO:teuthology.orchestra.run.smithi045.stdout: -7009> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5773 cv=5553/5553 ap=115+114 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=111 | child=1 dirty=1 authpin=1 0x55576d056400] version 5773 2023-10-03T19:21:01.518 INFO:teuthology.orchestra.run.smithi045.stdout: -7008> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d5d7580 v5781 2023-10-03T19:21:01.518 INFO:teuthology.orchestra.run.smithi045.stdout: -7007> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5781 cv=5559/5559 REP dir_auth=0 ap=114+115 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5781 2023-10-03T19:21:01.518 INFO:teuthology.orchestra.run.smithi045.stdout: -7006> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d1b38e0 v5775 2023-10-03T19:21:01.518 INFO:teuthology.orchestra.run.smithi045.stdout: -7005> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5775 cv=5553/5553 ap=115+114 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=111 | child=1 dirty=1 authpin=1 0x55576d056400] version 5775 2023-10-03T19:21:01.518 INFO:teuthology.orchestra.run.smithi045.stdout: -7004> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=114 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=114 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.518 INFO:teuthology.orchestra.run.smithi045.stdout: -7003> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=114) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5780 pv6006 ap=115 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=115) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=114) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.518 INFO:teuthology.orchestra.run.smithi045.stdout: -7002> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=115) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5780 pv6006 ap=115 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=115) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=113) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.518 INFO:teuthology.orchestra.run.smithi045.stdout: -7001> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000056b [2,head] /dc-dir/dc-file_886 auth v5774 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.039349+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d727b80] 2023-10-03T19:21:01.519 INFO:teuthology.orchestra.run.smithi045.stdout: -7000> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000056b [2,head] /dc-dir/dc-file_886 auth v5774 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.039349+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d727b80] 2023-10-03T19:21:01.519 INFO:teuthology.orchestra.run.smithi045.stdout: -6999> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.519 INFO:teuthology.orchestra.run.smithi045.stdout: -6998> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.519 INFO:teuthology.orchestra.run.smithi045.stdout: -6997> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.519 INFO:teuthology.orchestra.run.smithi045.stdout: -6996> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000056b [2,head] /dc-dir/dc-file_886 auth v5774 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.039349+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d727b80] 2023-10-03T19:21:01.519 INFO:teuthology.orchestra.run.smithi045.stdout: -6995> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000056b [2,head] /dc-dir/dc-file_886 auth v5774 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.039349+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d727b80] 2023-10-03T19:21:01.519 INFO:teuthology.orchestra.run.smithi045.stdout: -6994> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.519 INFO:teuthology.orchestra.run.smithi045.stdout: -6993> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 300.449, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.00e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:603.9] 2023-10-03T19:21:01.519 INFO:teuthology.orchestra.run.smithi045.stdout: -6992> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d52e6c0 on [dir 0x1 / [2,head] auth pv=6007 v=5781 cv=5559/5559 REP dir_auth=0 ap=113+115 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 113 2023-10-03T19:21:01.519 INFO:teuthology.orchestra.run.smithi045.stdout: -6991> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d52e6c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5780 pv6006 ap=114 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=114) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=113) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 114 2023-10-03T19:21:01.519 INFO:teuthology.orchestra.run.smithi045.stdout: -6990> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5781 cv=5559/5559 REP dir_auth=0 ap=113+114 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d52e6c0 count now 113/114 2023-10-03T19:21:01.520 INFO:teuthology.orchestra.run.smithi045.stdout: -6989> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d52e6c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5775 cv=5553/5553 ap=114+114 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=111 | child=1 dirty=1 authpin=1 0x55576d056400] count now 114 2023-10-03T19:21:01.520 INFO:teuthology.orchestra.run.smithi045.stdout: -6988> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000056b) auth_unpin by 0x55576d52e6c0 on [inode 0x1000000056b [2,head] /dc-dir/dc-file_886 auth v5774 s=3 n(v0 rc2023-10-03T19:16:12.039349+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d727b80] now 0 2023-10-03T19:21:01.520 INFO:teuthology.orchestra.run.smithi045.stdout: -6987> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5775 cv=5553/5553 ap=114+113 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=111 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d52e6c0 count now 114/113 2023-10-03T19:21:01.520 INFO:teuthology.orchestra.run.smithi045.stdout: -6986> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.520 INFO:teuthology.orchestra.run.smithi045.stdout: -6985> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.520 INFO:teuthology.orchestra.run.smithi045.stdout: -6984> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000056c [2,head] /dc-dir/dc-file_887 auth v4490 pv5776 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.051113+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.051113+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d728100] 2023-10-03T19:21:01.520 INFO:teuthology.orchestra.run.smithi045.stdout: -6983> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5782 2023-10-03T19:21:01.520 INFO:teuthology.orchestra.run.smithi045.stdout: -6982> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5782 pv6006 ap=114 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=114) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=113) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.520 INFO:teuthology.orchestra.run.smithi045.stdout: -6981> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5780 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.520 INFO:teuthology.orchestra.run.smithi045.stdout: -6980> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5781 cv=5559/5559 REP dir_auth=0 ap=113+114 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5781 2023-10-03T19:21:01.523 INFO:teuthology.orchestra.run.smithi045.stdout: -6979> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000056c) pop_and_dirty_projected_inode v5776 2023-10-03T19:21:01.523 INFO:teuthology.orchestra.run.smithi045.stdout: -6978> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000056c) mark_dirty [inode 0x1000000056c [2,head] /dc-dir/dc-file_887 auth v5776 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.051113+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d728100] 2023-10-03T19:21:01.524 INFO:teuthology.orchestra.run.smithi045.stdout: -6977> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_887) mark_dirty [dentry #0x1/dc-dir/dc-file_887 [2,head] auth (dversion lock) pv=5776 v=4490 ino=0x1000000056c state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d72c000] 2023-10-03T19:21:01.524 INFO:teuthology.orchestra.run.smithi045.stdout: -6976> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5775 cv=5553/5553 ap=114+113 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=112 | child=1 dirty=1 authpin=1 0x55576d056400] version 5775 2023-10-03T19:21:01.524 INFO:teuthology.orchestra.run.smithi045.stdout: -6975> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d5d7460 v5783 2023-10-03T19:21:01.524 INFO:teuthology.orchestra.run.smithi045.stdout: -6974> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5783 cv=5559/5559 REP dir_auth=0 ap=113+114 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5783 2023-10-03T19:21:01.524 INFO:teuthology.orchestra.run.smithi045.stdout: -6973> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d1b3220 v5777 2023-10-03T19:21:01.524 INFO:teuthology.orchestra.run.smithi045.stdout: -6972> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5777 cv=5553/5553 ap=114+113 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=112 | child=1 dirty=1 authpin=1 0x55576d056400] version 5777 2023-10-03T19:21:01.524 INFO:teuthology.orchestra.run.smithi045.stdout: -6971> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=113 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=113 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.524 INFO:teuthology.orchestra.run.smithi045.stdout: -6970> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=113) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5782 pv6006 ap=114 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=114) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=113) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.524 INFO:teuthology.orchestra.run.smithi045.stdout: -6969> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=114) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5782 pv6006 ap=114 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=114) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=112) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.524 INFO:teuthology.orchestra.run.smithi045.stdout: -6968> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000056c [2,head] /dc-dir/dc-file_887 auth v5776 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.051113+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d728100] 2023-10-03T19:21:01.524 INFO:teuthology.orchestra.run.smithi045.stdout: -6967> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000056c [2,head] /dc-dir/dc-file_887 auth v5776 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.051113+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d728100] 2023-10-03T19:21:01.525 INFO:teuthology.orchestra.run.smithi045.stdout: -6966> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.525 INFO:teuthology.orchestra.run.smithi045.stdout: -6965> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.525 INFO:teuthology.orchestra.run.smithi045.stdout: -6964> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.525 INFO:teuthology.orchestra.run.smithi045.stdout: -6963> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000056c [2,head] /dc-dir/dc-file_887 auth v5776 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.051113+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d728100] 2023-10-03T19:21:01.525 INFO:teuthology.orchestra.run.smithi045.stdout: -6962> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000056c [2,head] /dc-dir/dc-file_887 auth v5776 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.051113+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d728100] 2023-10-03T19:21:01.525 INFO:teuthology.orchestra.run.smithi045.stdout: -6961> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.525 INFO:teuthology.orchestra.run.smithi045.stdout: -6960> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 301.449, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.01e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:605.9] 2023-10-03T19:21:01.525 INFO:teuthology.orchestra.run.smithi045.stdout: -6959> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d54ed80 on [dir 0x1 / [2,head] auth pv=6007 v=5783 cv=5559/5559 REP dir_auth=0 ap=112+114 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 112 2023-10-03T19:21:01.525 INFO:teuthology.orchestra.run.smithi045.stdout: -6958> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d54ed80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5782 pv6006 ap=113 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=113) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=112) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 113 2023-10-03T19:21:01.525 INFO:teuthology.orchestra.run.smithi045.stdout: -6957> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5783 cv=5559/5559 REP dir_auth=0 ap=112+113 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d54ed80 count now 112/113 2023-10-03T19:21:01.525 INFO:teuthology.orchestra.run.smithi045.stdout: -6956> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d54ed80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5777 cv=5553/5553 ap=113+113 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=112 | child=1 dirty=1 authpin=1 0x55576d056400] count now 113 2023-10-03T19:21:01.526 INFO:teuthology.orchestra.run.smithi045.stdout: -6955> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000056c) auth_unpin by 0x55576d54ed80 on [inode 0x1000000056c [2,head] /dc-dir/dc-file_887 auth v5776 s=3 n(v0 rc2023-10-03T19:16:12.051113+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d728100] now 0 2023-10-03T19:21:01.526 INFO:teuthology.orchestra.run.smithi045.stdout: -6954> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5777 cv=5553/5553 ap=113+112 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=112 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d54ed80 count now 113/112 2023-10-03T19:21:01.526 INFO:teuthology.orchestra.run.smithi045.stdout: -6953> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.526 INFO:teuthology.orchestra.run.smithi045.stdout: -6952> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.526 INFO:teuthology.orchestra.run.smithi045.stdout: -6951> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000056d [2,head] /dc-dir/dc-file_888 auth v4494 pv5778 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.062547+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.062547+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d728680] 2023-10-03T19:21:01.526 INFO:teuthology.orchestra.run.smithi045.stdout: -6950> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5784 2023-10-03T19:21:01.526 INFO:teuthology.orchestra.run.smithi045.stdout: -6949> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5784 pv6006 ap=113 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=113) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=112) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.526 INFO:teuthology.orchestra.run.smithi045.stdout: -6948> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5782 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.526 INFO:teuthology.orchestra.run.smithi045.stdout: -6947> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5783 cv=5559/5559 REP dir_auth=0 ap=112+113 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5783 2023-10-03T19:21:01.526 INFO:teuthology.orchestra.run.smithi045.stdout: -6946> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000056d) pop_and_dirty_projected_inode v5778 2023-10-03T19:21:01.526 INFO:teuthology.orchestra.run.smithi045.stdout: -6945> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000056d) mark_dirty [inode 0x1000000056d [2,head] /dc-dir/dc-file_888 auth v5778 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.062547+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d728680] 2023-10-03T19:21:01.527 INFO:teuthology.orchestra.run.smithi045.stdout: -6944> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_888) mark_dirty [dentry #0x1/dc-dir/dc-file_888 [2,head] auth (dversion lock) pv=5778 v=4494 ino=0x1000000056d state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d72c280] 2023-10-03T19:21:01.527 INFO:teuthology.orchestra.run.smithi045.stdout: -6943> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5777 cv=5553/5553 ap=113+112 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=113 | child=1 dirty=1 authpin=1 0x55576d056400] version 5777 2023-10-03T19:21:01.527 INFO:teuthology.orchestra.run.smithi045.stdout: -6942> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d5d7340 v5785 2023-10-03T19:21:01.527 INFO:teuthology.orchestra.run.smithi045.stdout: -6941> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5785 cv=5559/5559 REP dir_auth=0 ap=112+113 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5785 2023-10-03T19:21:01.527 INFO:teuthology.orchestra.run.smithi045.stdout: -6940> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d5d6020 v5779 2023-10-03T19:21:01.527 INFO:teuthology.orchestra.run.smithi045.stdout: -6939> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5779 cv=5553/5553 ap=113+112 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=113 | child=1 dirty=1 authpin=1 0x55576d056400] version 5779 2023-10-03T19:21:01.527 INFO:teuthology.orchestra.run.smithi045.stdout: -6938> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=112 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=112 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.527 INFO:teuthology.orchestra.run.smithi045.stdout: -6937> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=112) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5784 pv6006 ap=113 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=113) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=112) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.527 INFO:teuthology.orchestra.run.smithi045.stdout: -6936> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=113) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5784 pv6006 ap=113 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=113) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=111) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.527 INFO:teuthology.orchestra.run.smithi045.stdout: -6935> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000056d [2,head] /dc-dir/dc-file_888 auth v5778 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.062547+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d728680] 2023-10-03T19:21:01.528 INFO:teuthology.orchestra.run.smithi045.stdout: -6934> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000056d [2,head] /dc-dir/dc-file_888 auth v5778 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.062547+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d728680] 2023-10-03T19:21:01.528 INFO:teuthology.orchestra.run.smithi045.stdout: -6933> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.528 INFO:teuthology.orchestra.run.smithi045.stdout: -6932> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.528 INFO:teuthology.orchestra.run.smithi045.stdout: -6931> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.528 INFO:teuthology.orchestra.run.smithi045.stdout: -6930> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000056d [2,head] /dc-dir/dc-file_888 auth v5778 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.062547+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d728680] 2023-10-03T19:21:01.528 INFO:teuthology.orchestra.run.smithi045.stdout: -6929> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000056d [2,head] /dc-dir/dc-file_888 auth v5778 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.062547+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d728680] 2023-10-03T19:21:01.528 INFO:teuthology.orchestra.run.smithi045.stdout: -6928> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.528 INFO:teuthology.orchestra.run.smithi045.stdout: -6927> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 302.449, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.02e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:607.9] 2023-10-03T19:21:01.528 INFO:teuthology.orchestra.run.smithi045.stdout: -6926> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d52e480 on [dir 0x1 / [2,head] auth pv=6007 v=5785 cv=5559/5559 REP dir_auth=0 ap=111+113 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 111 2023-10-03T19:21:01.528 INFO:teuthology.orchestra.run.smithi045.stdout: -6925> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d52e480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5779 cv=5553/5553 ap=112+112 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=113 | child=1 dirty=1 authpin=1 0x55576d056400] count now 112 2023-10-03T19:21:01.528 INFO:teuthology.orchestra.run.smithi045.stdout: -6924> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d52e480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5784 pv6006 ap=112 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=112) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=111) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 112 2023-10-03T19:21:01.626 INFO:teuthology.orchestra.run.smithi045.stdout: -6923> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5785 cv=5559/5559 REP dir_auth=0 ap=111+112 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d52e480 count now 111/112 2023-10-03T19:21:01.627 INFO:teuthology.orchestra.run.smithi045.stdout: -6922> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000056d) auth_unpin by 0x55576d52e480 on [inode 0x1000000056d [2,head] /dc-dir/dc-file_888 auth v5778 s=3 n(v0 rc2023-10-03T19:16:12.062547+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d728680] now 0 2023-10-03T19:21:01.627 INFO:teuthology.orchestra.run.smithi045.stdout: -6921> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5779 cv=5553/5553 ap=112+111 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=113 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d52e480 count now 112/111 2023-10-03T19:21:01.627 INFO:teuthology.orchestra.run.smithi045.stdout: -6920> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.627 INFO:teuthology.orchestra.run.smithi045.stdout: -6919> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.627 INFO:teuthology.orchestra.run.smithi045.stdout: -6918> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000056e [2,head] /dc-dir/dc-file_889 auth v4498 pv5780 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.074082+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.074082+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d728c00] 2023-10-03T19:21:01.627 INFO:teuthology.orchestra.run.smithi045.stdout: -6917> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5786 2023-10-03T19:21:01.627 INFO:teuthology.orchestra.run.smithi045.stdout: -6916> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5786 pv6006 ap=112 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=112) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=111) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.627 INFO:teuthology.orchestra.run.smithi045.stdout: -6915> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5784 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.627 INFO:teuthology.orchestra.run.smithi045.stdout: -6914> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5785 cv=5559/5559 REP dir_auth=0 ap=111+112 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5785 2023-10-03T19:21:01.627 INFO:teuthology.orchestra.run.smithi045.stdout: -6913> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000056e) pop_and_dirty_projected_inode v5780 2023-10-03T19:21:01.628 INFO:teuthology.orchestra.run.smithi045.stdout: -6912> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000056e) mark_dirty [inode 0x1000000056e [2,head] /dc-dir/dc-file_889 auth v5780 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.074082+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d728c00] 2023-10-03T19:21:01.628 INFO:teuthology.orchestra.run.smithi045.stdout: -6911> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_889) mark_dirty [dentry #0x1/dc-dir/dc-file_889 [2,head] auth (dversion lock) pv=5780 v=4498 ino=0x1000000056e state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d72c500] 2023-10-03T19:21:01.628 INFO:teuthology.orchestra.run.smithi045.stdout: -6910> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5779 cv=5553/5553 ap=112+111 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=114 | child=1 dirty=1 authpin=1 0x55576d056400] version 5779 2023-10-03T19:21:01.628 INFO:teuthology.orchestra.run.smithi045.stdout: -6909> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d5d7220 v5787 2023-10-03T19:21:01.628 INFO:teuthology.orchestra.run.smithi045.stdout: -6908> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5787 cv=5559/5559 REP dir_auth=0 ap=111+112 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5787 2023-10-03T19:21:01.628 INFO:teuthology.orchestra.run.smithi045.stdout: -6907> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d1b3460 v5781 2023-10-03T19:21:01.628 INFO:teuthology.orchestra.run.smithi045.stdout: -6906> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5781 cv=5553/5553 ap=112+111 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=114 | child=1 dirty=1 authpin=1 0x55576d056400] version 5781 2023-10-03T19:21:01.628 INFO:teuthology.orchestra.run.smithi045.stdout: -6905> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=111 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=111 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.628 INFO:teuthology.orchestra.run.smithi045.stdout: -6904> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=111) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5786 pv6006 ap=112 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=112) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=111) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.628 INFO:teuthology.orchestra.run.smithi045.stdout: -6903> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=112) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5786 pv6006 ap=112 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=112) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=110) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.629 INFO:teuthology.orchestra.run.smithi045.stdout: -6902> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000056e [2,head] /dc-dir/dc-file_889 auth v5780 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.074082+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d728c00] 2023-10-03T19:21:01.629 INFO:teuthology.orchestra.run.smithi045.stdout: -6901> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000056e [2,head] /dc-dir/dc-file_889 auth v5780 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.074082+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d728c00] 2023-10-03T19:21:01.629 INFO:teuthology.orchestra.run.smithi045.stdout: -6900> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.629 INFO:teuthology.orchestra.run.smithi045.stdout: -6899> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.629 INFO:teuthology.orchestra.run.smithi045.stdout: -6898> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.629 INFO:teuthology.orchestra.run.smithi045.stdout: -6897> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000056e [2,head] /dc-dir/dc-file_889 auth v5780 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.074082+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d728c00] 2023-10-03T19:21:01.629 INFO:teuthology.orchestra.run.smithi045.stdout: -6896> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000056e [2,head] /dc-dir/dc-file_889 auth v5780 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.074082+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d728c00] 2023-10-03T19:21:01.629 INFO:teuthology.orchestra.run.smithi045.stdout: -6895> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.629 INFO:teuthology.orchestra.run.smithi045.stdout: -6894> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 303.449, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.03e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:609.9] 2023-10-03T19:21:01.629 INFO:teuthology.orchestra.run.smithi045.stdout: -6893> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d692000 on [dir 0x1 / [2,head] auth pv=6007 v=5787 cv=5559/5559 REP dir_auth=0 ap=110+112 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 110 2023-10-03T19:21:01.629 INFO:teuthology.orchestra.run.smithi045.stdout: -6892> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d692000 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5786 pv6006 ap=111 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=111) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=110) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 111 2023-10-03T19:21:01.630 INFO:teuthology.orchestra.run.smithi045.stdout: -6891> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5787 cv=5559/5559 REP dir_auth=0 ap=110+111 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d692000 count now 110/111 2023-10-03T19:21:01.630 INFO:teuthology.orchestra.run.smithi045.stdout: -6890> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d692000 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5781 cv=5553/5553 ap=111+111 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=114 | child=1 dirty=1 authpin=1 0x55576d056400] count now 111 2023-10-03T19:21:01.630 INFO:teuthology.orchestra.run.smithi045.stdout: -6889> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000056e) auth_unpin by 0x55576d692000 on [inode 0x1000000056e [2,head] /dc-dir/dc-file_889 auth v5780 s=3 n(v0 rc2023-10-03T19:16:12.074082+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d728c00] now 0 2023-10-03T19:21:01.630 INFO:teuthology.orchestra.run.smithi045.stdout: -6888> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5781 cv=5553/5553 ap=111+110 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=114 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d692000 count now 111/110 2023-10-03T19:21:01.630 INFO:teuthology.orchestra.run.smithi045.stdout: -6887> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.630 INFO:teuthology.orchestra.run.smithi045.stdout: -6886> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.630 INFO:teuthology.orchestra.run.smithi045.stdout: -6885> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000056f [2,head] /dc-dir/dc-file_890 auth v4502 pv5782 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.085564+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.085564+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d729180] 2023-10-03T19:21:01.630 INFO:teuthology.orchestra.run.smithi045.stdout: -6884> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5788 2023-10-03T19:21:01.630 INFO:teuthology.orchestra.run.smithi045.stdout: -6883> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5788 pv6006 ap=111 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=111) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=110) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.630 INFO:teuthology.orchestra.run.smithi045.stdout: -6882> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5786 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.631 INFO:teuthology.orchestra.run.smithi045.stdout: -6881> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5787 cv=5559/5559 REP dir_auth=0 ap=110+111 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5787 2023-10-03T19:21:01.631 INFO:teuthology.orchestra.run.smithi045.stdout: -6880> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000056f) pop_and_dirty_projected_inode v5782 2023-10-03T19:21:01.631 INFO:teuthology.orchestra.run.smithi045.stdout: -6879> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000056f) mark_dirty [inode 0x1000000056f [2,head] /dc-dir/dc-file_890 auth v5782 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.085564+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d729180] 2023-10-03T19:21:01.631 INFO:teuthology.orchestra.run.smithi045.stdout: -6878> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_890) mark_dirty [dentry #0x1/dc-dir/dc-file_890 [2,head] auth (dversion lock) pv=5782 v=4502 ino=0x1000000056f state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d72c780] 2023-10-03T19:21:01.631 INFO:teuthology.orchestra.run.smithi045.stdout: -6877> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5781 cv=5553/5553 ap=111+110 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=115 | child=1 dirty=1 authpin=1 0x55576d056400] version 5781 2023-10-03T19:21:01.631 INFO:teuthology.orchestra.run.smithi045.stdout: -6876> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d5d6fe0 v5789 2023-10-03T19:21:01.631 INFO:teuthology.orchestra.run.smithi045.stdout: -6875> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5789 cv=5559/5559 REP dir_auth=0 ap=110+111 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5789 2023-10-03T19:21:01.631 INFO:teuthology.orchestra.run.smithi045.stdout: -6874> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d1b3340 v5783 2023-10-03T19:21:01.631 INFO:teuthology.orchestra.run.smithi045.stdout: -6873> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5783 cv=5553/5553 ap=111+110 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=115 | child=1 dirty=1 authpin=1 0x55576d056400] version 5783 2023-10-03T19:21:01.631 INFO:teuthology.orchestra.run.smithi045.stdout: -6872> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=110 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=110 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.631 INFO:teuthology.orchestra.run.smithi045.stdout: -6871> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=110) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5788 pv6006 ap=111 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=111) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=110) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.632 INFO:teuthology.orchestra.run.smithi045.stdout: -6870> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=111) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5788 pv6006 ap=111 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=111) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=109) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.632 INFO:teuthology.orchestra.run.smithi045.stdout: -6869> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000056f [2,head] /dc-dir/dc-file_890 auth v5782 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.085564+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d729180] 2023-10-03T19:21:01.632 INFO:teuthology.orchestra.run.smithi045.stdout: -6868> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000056f [2,head] /dc-dir/dc-file_890 auth v5782 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.085564+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d729180] 2023-10-03T19:21:01.632 INFO:teuthology.orchestra.run.smithi045.stdout: -6867> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.632 INFO:teuthology.orchestra.run.smithi045.stdout: -6866> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.632 INFO:teuthology.orchestra.run.smithi045.stdout: -6865> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.632 INFO:teuthology.orchestra.run.smithi045.stdout: -6864> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000056f [2,head] /dc-dir/dc-file_890 auth v5782 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.085564+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d729180] 2023-10-03T19:21:01.632 INFO:teuthology.orchestra.run.smithi045.stdout: -6863> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000056f [2,head] /dc-dir/dc-file_890 auth v5782 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.085564+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d729180] 2023-10-03T19:21:01.632 INFO:teuthology.orchestra.run.smithi045.stdout: -6862> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.632 INFO:teuthology.orchestra.run.smithi045.stdout: -6861> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 304.449, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.04e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:611.9] 2023-10-03T19:21:01.632 INFO:teuthology.orchestra.run.smithi045.stdout: -6860> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2aa480 on [dir 0x1 / [2,head] auth pv=6007 v=5789 cv=5559/5559 REP dir_auth=0 ap=109+111 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 109 2023-10-03T19:21:01.633 INFO:teuthology.orchestra.run.smithi045.stdout: -6859> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2aa480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5788 pv6006 ap=110 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=110) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=109) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 110 2023-10-03T19:21:01.633 INFO:teuthology.orchestra.run.smithi045.stdout: -6858> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5789 cv=5559/5559 REP dir_auth=0 ap=109+110 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2aa480 count now 109/110 2023-10-03T19:21:01.633 INFO:teuthology.orchestra.run.smithi045.stdout: -6857> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2aa480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5783 cv=5553/5553 ap=110+110 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=115 | child=1 dirty=1 authpin=1 0x55576d056400] count now 110 2023-10-03T19:21:01.633 INFO:teuthology.orchestra.run.smithi045.stdout: -6856> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000056f) auth_unpin by 0x55576d2aa480 on [inode 0x1000000056f [2,head] /dc-dir/dc-file_890 auth v5782 s=3 n(v0 rc2023-10-03T19:16:12.085564+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d729180] now 0 2023-10-03T19:21:01.633 INFO:teuthology.orchestra.run.smithi045.stdout: -6855> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5783 cv=5553/5553 ap=110+109 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=115 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2aa480 count now 110/109 2023-10-03T19:21:01.633 INFO:teuthology.orchestra.run.smithi045.stdout: -6854> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.633 INFO:teuthology.orchestra.run.smithi045.stdout: -6853> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.633 INFO:teuthology.orchestra.run.smithi045.stdout: -6852> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000570 [2,head] /dc-dir/dc-file_891 auth v4506 pv5784 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.097049+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.097049+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d729700] 2023-10-03T19:21:01.633 INFO:teuthology.orchestra.run.smithi045.stdout: -6851> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5790 2023-10-03T19:21:01.633 INFO:teuthology.orchestra.run.smithi045.stdout: -6850> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5790 pv6006 ap=110 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=110) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=109) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.634 INFO:teuthology.orchestra.run.smithi045.stdout: -6849> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5788 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.634 INFO:teuthology.orchestra.run.smithi045.stdout: -6848> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5789 cv=5559/5559 REP dir_auth=0 ap=109+110 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5789 2023-10-03T19:21:01.634 INFO:teuthology.orchestra.run.smithi045.stdout: -6847> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000570) pop_and_dirty_projected_inode v5784 2023-10-03T19:21:01.634 INFO:teuthology.orchestra.run.smithi045.stdout: -6846> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000570) mark_dirty [inode 0x10000000570 [2,head] /dc-dir/dc-file_891 auth v5784 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.097049+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d729700] 2023-10-03T19:21:01.634 INFO:teuthology.orchestra.run.smithi045.stdout: -6845> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_891) mark_dirty [dentry #0x1/dc-dir/dc-file_891 [2,head] auth (dversion lock) pv=5784 v=4506 ino=0x10000000570 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d72ca00] 2023-10-03T19:21:01.634 INFO:teuthology.orchestra.run.smithi045.stdout: -6844> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5783 cv=5553/5553 ap=110+109 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=116 | child=1 dirty=1 authpin=1 0x55576d056400] version 5783 2023-10-03T19:21:01.634 INFO:teuthology.orchestra.run.smithi045.stdout: -6843> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d5d6da0 v5791 2023-10-03T19:21:01.634 INFO:teuthology.orchestra.run.smithi045.stdout: -6842> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5791 cv=5559/5559 REP dir_auth=0 ap=109+110 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5791 2023-10-03T19:21:01.634 INFO:teuthology.orchestra.run.smithi045.stdout: -6841> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d1b3100 v5785 2023-10-03T19:21:01.634 INFO:teuthology.orchestra.run.smithi045.stdout: -6840> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5785 cv=5553/5553 ap=110+109 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=116 | child=1 dirty=1 authpin=1 0x55576d056400] version 5785 2023-10-03T19:21:01.635 INFO:teuthology.orchestra.run.smithi045.stdout: -6839> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=109 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=109 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.635 INFO:teuthology.orchestra.run.smithi045.stdout: -6838> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=109) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5790 pv6006 ap=110 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=110) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=109) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.635 INFO:teuthology.orchestra.run.smithi045.stdout: -6837> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=110) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5790 pv6006 ap=110 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=110) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=108) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.635 INFO:teuthology.orchestra.run.smithi045.stdout: -6836> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000570 [2,head] /dc-dir/dc-file_891 auth v5784 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.097049+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d729700] 2023-10-03T19:21:01.635 INFO:teuthology.orchestra.run.smithi045.stdout: -6835> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000570 [2,head] /dc-dir/dc-file_891 auth v5784 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.097049+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d729700] 2023-10-03T19:21:01.635 INFO:teuthology.orchestra.run.smithi045.stdout: -6834> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.635 INFO:teuthology.orchestra.run.smithi045.stdout: -6833> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.635 INFO:teuthology.orchestra.run.smithi045.stdout: -6832> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.635 INFO:teuthology.orchestra.run.smithi045.stdout: -6831> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000570 [2,head] /dc-dir/dc-file_891 auth v5784 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.097049+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d729700] 2023-10-03T19:21:01.635 INFO:teuthology.orchestra.run.smithi045.stdout: -6830> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000570 [2,head] /dc-dir/dc-file_891 auth v5784 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.097049+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d729700] 2023-10-03T19:21:01.635 INFO:teuthology.orchestra.run.smithi045.stdout: -6829> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.636 INFO:teuthology.orchestra.run.smithi045.stdout: -6828> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 305.449, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.05e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:613.9] 2023-10-03T19:21:01.636 INFO:teuthology.orchestra.run.smithi045.stdout: -6827> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d54f440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5790 pv6006 ap=109 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=109) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=108) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 109 2023-10-03T19:21:01.636 INFO:teuthology.orchestra.run.smithi045.stdout: -6826> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5791 cv=5559/5559 REP dir_auth=0 ap=109+109 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d54f440 count now 109/109 2023-10-03T19:21:01.636 INFO:teuthology.orchestra.run.smithi045.stdout: -6825> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d54f440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5785 cv=5553/5553 ap=109+109 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=116 | child=1 dirty=1 authpin=1 0x55576d056400] count now 109 2023-10-03T19:21:01.636 INFO:teuthology.orchestra.run.smithi045.stdout: -6824> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d54f440 on [dir 0x1 / [2,head] auth pv=6007 v=5791 cv=5559/5559 REP dir_auth=0 ap=108+109 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 108 2023-10-03T19:21:01.636 INFO:teuthology.orchestra.run.smithi045.stdout: -6823> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000570) auth_unpin by 0x55576d54f440 on [inode 0x10000000570 [2,head] /dc-dir/dc-file_891 auth v5784 s=3 n(v0 rc2023-10-03T19:16:12.097049+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d729700] now 0 2023-10-03T19:21:01.636 INFO:teuthology.orchestra.run.smithi045.stdout: -6822> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5785 cv=5553/5553 ap=109+108 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=116 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d54f440 count now 109/108 2023-10-03T19:21:01.636 INFO:teuthology.orchestra.run.smithi045.stdout: -6821> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.636 INFO:teuthology.orchestra.run.smithi045.stdout: -6820> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.636 INFO:teuthology.orchestra.run.smithi045.stdout: -6819> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000571 [2,head] /dc-dir/dc-file_892 auth v4510 pv5786 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.108169+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.108169+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d730000] 2023-10-03T19:21:01.636 INFO:teuthology.orchestra.run.smithi045.stdout: -6818> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5792 2023-10-03T19:21:01.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6817> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5792 pv6006 ap=109 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=109) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=108) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6816> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5790 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6815> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5791 cv=5559/5559 REP dir_auth=0 ap=108+109 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5791 2023-10-03T19:21:01.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6814> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000571) pop_and_dirty_projected_inode v5786 2023-10-03T19:21:01.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6813> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000571) mark_dirty [inode 0x10000000571 [2,head] /dc-dir/dc-file_892 auth v5786 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.108169+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d730000] 2023-10-03T19:21:01.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6812> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_892) mark_dirty [dentry #0x1/dc-dir/dc-file_892 [2,head] auth (dversion lock) pv=5786 v=4510 ino=0x10000000571 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d72cc80] 2023-10-03T19:21:01.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6811> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5785 cv=5553/5553 ap=109+108 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=117 | child=1 dirty=1 authpin=1 0x55576d056400] version 5785 2023-10-03T19:21:01.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6810> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d5d6b60 v5793 2023-10-03T19:21:01.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6809> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5793 cv=5559/5559 REP dir_auth=0 ap=108+109 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5793 2023-10-03T19:21:01.659 INFO:teuthology.orchestra.run.smithi045.stdout: -6808> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d1b2ec0 v5787 2023-10-03T19:21:01.659 INFO:teuthology.orchestra.run.smithi045.stdout: -6807> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5787 cv=5553/5553 ap=109+108 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=117 | child=1 dirty=1 authpin=1 0x55576d056400] version 5787 2023-10-03T19:21:01.659 INFO:teuthology.orchestra.run.smithi045.stdout: -6806> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=108 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=108 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.659 INFO:teuthology.orchestra.run.smithi045.stdout: -6805> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=108) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5792 pv6006 ap=109 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=109) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=108) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.659 INFO:teuthology.orchestra.run.smithi045.stdout: -6804> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=109) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5792 pv6006 ap=109 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=109) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=107) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.659 INFO:teuthology.orchestra.run.smithi045.stdout: -6803> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000571 [2,head] /dc-dir/dc-file_892 auth v5786 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.108169+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d730000] 2023-10-03T19:21:01.659 INFO:teuthology.orchestra.run.smithi045.stdout: -6802> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000571 [2,head] /dc-dir/dc-file_892 auth v5786 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.108169+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d730000] 2023-10-03T19:21:01.660 INFO:teuthology.orchestra.run.smithi045.stdout: -6801> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.660 INFO:teuthology.orchestra.run.smithi045.stdout: -6800> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.660 INFO:teuthology.orchestra.run.smithi045.stdout: -6799> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.660 INFO:teuthology.orchestra.run.smithi045.stdout: -6798> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000571 [2,head] /dc-dir/dc-file_892 auth v5786 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.108169+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d730000] 2023-10-03T19:21:01.660 INFO:teuthology.orchestra.run.smithi045.stdout: -6797> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000571 [2,head] /dc-dir/dc-file_892 auth v5786 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.108169+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d730000] 2023-10-03T19:21:01.660 INFO:teuthology.orchestra.run.smithi045.stdout: -6796> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.660 INFO:teuthology.orchestra.run.smithi045.stdout: -6795> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 306.449, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.06e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:615.9] 2023-10-03T19:21:01.660 INFO:teuthology.orchestra.run.smithi045.stdout: -6794> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d5c7d40 on [dir 0x1 / [2,head] auth pv=6007 v=5793 cv=5559/5559 REP dir_auth=0 ap=107+109 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 107 2023-10-03T19:21:01.660 INFO:teuthology.orchestra.run.smithi045.stdout: -6793> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d5c7d40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5792 pv6006 ap=108 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=108) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=107) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 108 2023-10-03T19:21:01.660 INFO:teuthology.orchestra.run.smithi045.stdout: -6792> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5793 cv=5559/5559 REP dir_auth=0 ap=107+108 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d5c7d40 count now 107/108 2023-10-03T19:21:01.661 INFO:teuthology.orchestra.run.smithi045.stdout: -6791> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d5c7d40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5787 cv=5553/5553 ap=108+108 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=117 | child=1 dirty=1 authpin=1 0x55576d056400] count now 108 2023-10-03T19:21:01.661 INFO:teuthology.orchestra.run.smithi045.stdout: -6790> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000571) auth_unpin by 0x55576d5c7d40 on [inode 0x10000000571 [2,head] /dc-dir/dc-file_892 auth v5786 s=3 n(v0 rc2023-10-03T19:16:12.108169+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d730000] now 0 2023-10-03T19:21:01.661 INFO:teuthology.orchestra.run.smithi045.stdout: -6789> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5787 cv=5553/5553 ap=108+107 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=117 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d5c7d40 count now 108/107 2023-10-03T19:21:01.661 INFO:teuthology.orchestra.run.smithi045.stdout: -6788> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.661 INFO:teuthology.orchestra.run.smithi045.stdout: -6787> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.661 INFO:teuthology.orchestra.run.smithi045.stdout: -6786> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000572 [2,head] /dc-dir/dc-file_893 auth v4514 pv5788 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.120326+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.120326+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d730580] 2023-10-03T19:21:01.661 INFO:teuthology.orchestra.run.smithi045.stdout: -6785> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5794 2023-10-03T19:21:01.661 INFO:teuthology.orchestra.run.smithi045.stdout: -6784> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5794 pv6006 ap=108 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=108) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=107) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.661 INFO:teuthology.orchestra.run.smithi045.stdout: -6783> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5792 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.661 INFO:teuthology.orchestra.run.smithi045.stdout: -6782> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5793 cv=5559/5559 REP dir_auth=0 ap=107+108 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5793 2023-10-03T19:21:01.661 INFO:teuthology.orchestra.run.smithi045.stdout: -6781> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000572) pop_and_dirty_projected_inode v5788 2023-10-03T19:21:01.662 INFO:teuthology.orchestra.run.smithi045.stdout: -6780> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000572) mark_dirty [inode 0x10000000572 [2,head] /dc-dir/dc-file_893 auth v5788 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.120326+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d730580] 2023-10-03T19:21:01.662 INFO:teuthology.orchestra.run.smithi045.stdout: -6779> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_893) mark_dirty [dentry #0x1/dc-dir/dc-file_893 [2,head] auth (dversion lock) pv=5788 v=4514 ino=0x10000000572 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d72cf00] 2023-10-03T19:21:01.662 INFO:teuthology.orchestra.run.smithi045.stdout: -6778> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5787 cv=5553/5553 ap=108+107 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=118 | child=1 dirty=1 authpin=1 0x55576d056400] version 5787 2023-10-03T19:21:01.662 INFO:teuthology.orchestra.run.smithi045.stdout: -6777> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d5d6920 v5795 2023-10-03T19:21:01.662 INFO:teuthology.orchestra.run.smithi045.stdout: -6776> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5795 cv=5559/5559 REP dir_auth=0 ap=107+108 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5795 2023-10-03T19:21:01.662 INFO:teuthology.orchestra.run.smithi045.stdout: -6775> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d1b2c80 v5789 2023-10-03T19:21:01.662 INFO:teuthology.orchestra.run.smithi045.stdout: -6774> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5789 cv=5553/5553 ap=108+107 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=118 | child=1 dirty=1 authpin=1 0x55576d056400] version 5789 2023-10-03T19:21:01.662 INFO:teuthology.orchestra.run.smithi045.stdout: -6773> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=107 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=107 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.662 INFO:teuthology.orchestra.run.smithi045.stdout: -6772> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=107) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5794 pv6006 ap=108 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=108) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=107) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.663 INFO:teuthology.orchestra.run.smithi045.stdout: -6771> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=108) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5794 pv6006 ap=108 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=108) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=106) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.663 INFO:teuthology.orchestra.run.smithi045.stdout: -6770> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000572 [2,head] /dc-dir/dc-file_893 auth v5788 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.120326+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d730580] 2023-10-03T19:21:01.663 INFO:teuthology.orchestra.run.smithi045.stdout: -6769> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000572 [2,head] /dc-dir/dc-file_893 auth v5788 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.120326+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d730580] 2023-10-03T19:21:01.663 INFO:teuthology.orchestra.run.smithi045.stdout: -6768> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.663 INFO:teuthology.orchestra.run.smithi045.stdout: -6767> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.663 INFO:teuthology.orchestra.run.smithi045.stdout: -6766> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.663 INFO:teuthology.orchestra.run.smithi045.stdout: -6765> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000572 [2,head] /dc-dir/dc-file_893 auth v5788 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.120326+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d730580] 2023-10-03T19:21:01.663 INFO:teuthology.orchestra.run.smithi045.stdout: -6764> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000572 [2,head] /dc-dir/dc-file_893 auth v5788 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.120326+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d730580] 2023-10-03T19:21:01.663 INFO:teuthology.orchestra.run.smithi045.stdout: -6763> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.663 INFO:teuthology.orchestra.run.smithi045.stdout: -6762> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 307.449, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.07e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:617.9] 2023-10-03T19:21:01.663 INFO:teuthology.orchestra.run.smithi045.stdout: -6761> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d539680 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5794 pv6006 ap=107 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=107) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=106) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 107 2023-10-03T19:21:01.663 INFO:teuthology.orchestra.run.smithi045.stdout: -6760> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5795 cv=5559/5559 REP dir_auth=0 ap=107+107 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d539680 count now 107/107 2023-10-03T19:21:01.664 INFO:teuthology.orchestra.run.smithi045.stdout: -6759> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d539680 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5789 cv=5553/5553 ap=107+107 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=118 | child=1 dirty=1 authpin=1 0x55576d056400] count now 107 2023-10-03T19:21:01.664 INFO:teuthology.orchestra.run.smithi045.stdout: -6758> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d539680 on [dir 0x1 / [2,head] auth pv=6007 v=5795 cv=5559/5559 REP dir_auth=0 ap=106+107 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 106 2023-10-03T19:21:01.664 INFO:teuthology.orchestra.run.smithi045.stdout: -6757> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000572) auth_unpin by 0x55576d539680 on [inode 0x10000000572 [2,head] /dc-dir/dc-file_893 auth v5788 s=3 n(v0 rc2023-10-03T19:16:12.120326+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d730580] now 0 2023-10-03T19:21:01.664 INFO:teuthology.orchestra.run.smithi045.stdout: -6756> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5789 cv=5553/5553 ap=107+106 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=118 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d539680 count now 107/106 2023-10-03T19:21:01.664 INFO:teuthology.orchestra.run.smithi045.stdout: -6755> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.664 INFO:teuthology.orchestra.run.smithi045.stdout: -6754> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.664 INFO:teuthology.orchestra.run.smithi045.stdout: -6753> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000573 [2,head] /dc-dir/dc-file_894 auth v4518 pv5790 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.131658+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.131658+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d730b00] 2023-10-03T19:21:01.664 INFO:teuthology.orchestra.run.smithi045.stdout: -6752> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5796 2023-10-03T19:21:01.664 INFO:teuthology.orchestra.run.smithi045.stdout: -6751> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5796 pv6006 ap=107 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=107) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=106) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.677 INFO:teuthology.orchestra.run.smithi045.stdout: -6750> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5794 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.678 INFO:teuthology.orchestra.run.smithi045.stdout: -6749> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5795 cv=5559/5559 REP dir_auth=0 ap=106+107 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5795 2023-10-03T19:21:01.678 INFO:teuthology.orchestra.run.smithi045.stdout: -6748> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000573) pop_and_dirty_projected_inode v5790 2023-10-03T19:21:01.678 INFO:teuthology.orchestra.run.smithi045.stdout: -6747> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000573) mark_dirty [inode 0x10000000573 [2,head] /dc-dir/dc-file_894 auth v5790 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.131658+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d730b00] 2023-10-03T19:21:01.678 INFO:teuthology.orchestra.run.smithi045.stdout: -6746> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_894) mark_dirty [dentry #0x1/dc-dir/dc-file_894 [2,head] auth (dversion lock) pv=5790 v=4518 ino=0x10000000573 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d72d180] 2023-10-03T19:21:01.678 INFO:teuthology.orchestra.run.smithi045.stdout: -6745> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5789 cv=5553/5553 ap=107+106 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=119 | child=1 dirty=1 authpin=1 0x55576d056400] version 5789 2023-10-03T19:21:01.678 INFO:teuthology.orchestra.run.smithi045.stdout: -6744> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d5d66e0 v5797 2023-10-03T19:21:01.678 INFO:teuthology.orchestra.run.smithi045.stdout: -6743> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5797 cv=5559/5559 REP dir_auth=0 ap=106+107 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5797 2023-10-03T19:21:01.678 INFO:teuthology.orchestra.run.smithi045.stdout: -6742> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d1b37c0 v5791 2023-10-03T19:21:01.678 INFO:teuthology.orchestra.run.smithi045.stdout: -6741> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5791 cv=5553/5553 ap=107+106 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=119 | child=1 dirty=1 authpin=1 0x55576d056400] version 5791 2023-10-03T19:21:01.678 INFO:teuthology.orchestra.run.smithi045.stdout: -6740> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=106 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=106 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.678 INFO:teuthology.orchestra.run.smithi045.stdout: -6739> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=106) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5796 pv6006 ap=107 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=107) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=106) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.679 INFO:teuthology.orchestra.run.smithi045.stdout: -6738> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=107) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5796 pv6006 ap=107 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=107) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=105) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.679 INFO:teuthology.orchestra.run.smithi045.stdout: -6737> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000573 [2,head] /dc-dir/dc-file_894 auth v5790 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.131658+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d730b00] 2023-10-03T19:21:01.679 INFO:teuthology.orchestra.run.smithi045.stdout: -6736> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000573 [2,head] /dc-dir/dc-file_894 auth v5790 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.131658+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d730b00] 2023-10-03T19:21:01.679 INFO:teuthology.orchestra.run.smithi045.stdout: -6735> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.679 INFO:teuthology.orchestra.run.smithi045.stdout: -6734> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.679 INFO:teuthology.orchestra.run.smithi045.stdout: -6733> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.679 INFO:teuthology.orchestra.run.smithi045.stdout: -6732> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000573 [2,head] /dc-dir/dc-file_894 auth v5790 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.131658+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d730b00] 2023-10-03T19:21:01.679 INFO:teuthology.orchestra.run.smithi045.stdout: -6731> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000573 [2,head] /dc-dir/dc-file_894 auth v5790 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.131658+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d730b00] 2023-10-03T19:21:01.679 INFO:teuthology.orchestra.run.smithi045.stdout: -6730> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.680 INFO:teuthology.orchestra.run.smithi045.stdout: -6729> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 308.449, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.08e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:619.9] 2023-10-03T19:21:01.680 INFO:teuthology.orchestra.run.smithi045.stdout: -6728> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d3dd440 on [dir 0x1 / [2,head] auth pv=6007 v=5797 cv=5559/5559 REP dir_auth=0 ap=105+107 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 105 2023-10-03T19:21:01.680 INFO:teuthology.orchestra.run.smithi045.stdout: -6727> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d3dd440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5796 pv6006 ap=106 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=106) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=105) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 106 2023-10-03T19:21:01.680 INFO:teuthology.orchestra.run.smithi045.stdout: -6726> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5797 cv=5559/5559 REP dir_auth=0 ap=105+106 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d3dd440 count now 105/106 2023-10-03T19:21:01.680 INFO:teuthology.orchestra.run.smithi045.stdout: -6725> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d3dd440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5791 cv=5553/5553 ap=106+106 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=119 | child=1 dirty=1 authpin=1 0x55576d056400] count now 106 2023-10-03T19:21:01.680 INFO:teuthology.orchestra.run.smithi045.stdout: -6724> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000573) auth_unpin by 0x55576d3dd440 on [inode 0x10000000573 [2,head] /dc-dir/dc-file_894 auth v5790 s=3 n(v0 rc2023-10-03T19:16:12.131658+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d730b00] now 0 2023-10-03T19:21:01.680 INFO:teuthology.orchestra.run.smithi045.stdout: -6723> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5791 cv=5553/5553 ap=106+105 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=119 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d3dd440 count now 106/105 2023-10-03T19:21:01.680 INFO:teuthology.orchestra.run.smithi045.stdout: -6722> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.680 INFO:teuthology.orchestra.run.smithi045.stdout: -6721> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.681 INFO:teuthology.orchestra.run.smithi045.stdout: -6720> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000574 [2,head] /dc-dir/dc-file_895 auth v4522 pv5792 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.142822+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.142822+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d731080] 2023-10-03T19:21:01.681 INFO:teuthology.orchestra.run.smithi045.stdout: -6719> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5798 2023-10-03T19:21:01.681 INFO:teuthology.orchestra.run.smithi045.stdout: -6718> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5798 pv6006 ap=106 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=106) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=105) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.681 INFO:teuthology.orchestra.run.smithi045.stdout: -6717> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5796 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.681 INFO:teuthology.orchestra.run.smithi045.stdout: -6716> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5797 cv=5559/5559 REP dir_auth=0 ap=105+106 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5797 2023-10-03T19:21:01.681 INFO:teuthology.orchestra.run.smithi045.stdout: -6715> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000574) pop_and_dirty_projected_inode v5792 2023-10-03T19:21:01.681 INFO:teuthology.orchestra.run.smithi045.stdout: -6714> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000574) mark_dirty [inode 0x10000000574 [2,head] /dc-dir/dc-file_895 auth v5792 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.142822+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d731080] 2023-10-03T19:21:01.681 INFO:teuthology.orchestra.run.smithi045.stdout: -6713> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_895) mark_dirty [dentry #0x1/dc-dir/dc-file_895 [2,head] auth (dversion lock) pv=5792 v=4522 ino=0x10000000574 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d72d400] 2023-10-03T19:21:01.681 INFO:teuthology.orchestra.run.smithi045.stdout: -6712> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5791 cv=5553/5553 ap=106+105 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=120 | child=1 dirty=1 authpin=1 0x55576d056400] version 5791 2023-10-03T19:21:01.681 INFO:teuthology.orchestra.run.smithi045.stdout: -6711> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d5d64a0 v5799 2023-10-03T19:21:01.681 INFO:teuthology.orchestra.run.smithi045.stdout: -6710> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5799 cv=5559/5559 REP dir_auth=0 ap=105+106 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5799 2023-10-03T19:21:01.682 INFO:teuthology.orchestra.run.smithi045.stdout: -6709> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d696020 v5793 2023-10-03T19:21:01.682 INFO:teuthology.orchestra.run.smithi045.stdout: -6708> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5793 cv=5553/5553 ap=106+105 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=120 | child=1 dirty=1 authpin=1 0x55576d056400] version 5793 2023-10-03T19:21:01.682 INFO:teuthology.orchestra.run.smithi045.stdout: -6707> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=105 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=105 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.682 INFO:teuthology.orchestra.run.smithi045.stdout: -6706> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=105) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5798 pv6006 ap=106 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=106) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=105) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.682 INFO:teuthology.orchestra.run.smithi045.stdout: -6705> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=106) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5798 pv6006 ap=106 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=106) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=104) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.682 INFO:teuthology.orchestra.run.smithi045.stdout: -6704> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000574 [2,head] /dc-dir/dc-file_895 auth v5792 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.142822+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d731080] 2023-10-03T19:21:01.682 INFO:teuthology.orchestra.run.smithi045.stdout: -6703> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000574 [2,head] /dc-dir/dc-file_895 auth v5792 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.142822+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d731080] 2023-10-03T19:21:01.682 INFO:teuthology.orchestra.run.smithi045.stdout: -6702> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.682 INFO:teuthology.orchestra.run.smithi045.stdout: -6701> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.682 INFO:teuthology.orchestra.run.smithi045.stdout: -6700> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.683 INFO:teuthology.orchestra.run.smithi045.stdout: -6699> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000574 [2,head] /dc-dir/dc-file_895 auth v5792 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.142822+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d731080] 2023-10-03T19:21:01.683 INFO:teuthology.orchestra.run.smithi045.stdout: -6698> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000574 [2,head] /dc-dir/dc-file_895 auth v5792 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.142822+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d731080] 2023-10-03T19:21:01.683 INFO:teuthology.orchestra.run.smithi045.stdout: -6697> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.683 INFO:teuthology.orchestra.run.smithi045.stdout: -6696> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 309.449, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.09e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:621.9] 2023-10-03T19:21:01.683 INFO:teuthology.orchestra.run.smithi045.stdout: -6695> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2b2fc0 on [dir 0x1 / [2,head] auth pv=6007 v=5799 cv=5559/5559 REP dir_auth=0 ap=104+106 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 104 2023-10-03T19:21:01.683 INFO:teuthology.orchestra.run.smithi045.stdout: -6694> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2b2fc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5798 pv6006 ap=105 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=105) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=104) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 105 2023-10-03T19:21:01.683 INFO:teuthology.orchestra.run.smithi045.stdout: -6693> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5799 cv=5559/5559 REP dir_auth=0 ap=104+105 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2b2fc0 count now 104/105 2023-10-03T19:21:01.779 INFO:teuthology.orchestra.run.smithi045.stdout: -6692> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2b2fc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5793 cv=5553/5553 ap=105+105 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=120 | child=1 dirty=1 authpin=1 0x55576d056400] count now 105 2023-10-03T19:21:01.779 INFO:teuthology.orchestra.run.smithi045.stdout: -6691> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000574) auth_unpin by 0x55576d2b2fc0 on [inode 0x10000000574 [2,head] /dc-dir/dc-file_895 auth v5792 s=3 n(v0 rc2023-10-03T19:16:12.142822+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d731080] now 0 2023-10-03T19:21:01.779 INFO:teuthology.orchestra.run.smithi045.stdout: -6690> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5793 cv=5553/5553 ap=105+104 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=120 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2b2fc0 count now 105/104 2023-10-03T19:21:01.779 INFO:teuthology.orchestra.run.smithi045.stdout: -6689> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.779 INFO:teuthology.orchestra.run.smithi045.stdout: -6688> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.779 INFO:teuthology.orchestra.run.smithi045.stdout: -6687> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000575 [2,head] /dc-dir/dc-file_896 auth v4526 pv5794 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.154331+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.154331+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d731600] 2023-10-03T19:21:01.780 INFO:teuthology.orchestra.run.smithi045.stdout: -6686> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5800 2023-10-03T19:21:01.780 INFO:teuthology.orchestra.run.smithi045.stdout: -6685> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5800 pv6006 ap=105 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=105) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=104) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.780 INFO:teuthology.orchestra.run.smithi045.stdout: -6684> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5798 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.780 INFO:teuthology.orchestra.run.smithi045.stdout: -6683> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5799 cv=5559/5559 REP dir_auth=0 ap=104+105 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5799 2023-10-03T19:21:01.780 INFO:teuthology.orchestra.run.smithi045.stdout: -6682> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000575) pop_and_dirty_projected_inode v5794 2023-10-03T19:21:01.780 INFO:teuthology.orchestra.run.smithi045.stdout: -6681> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000575) mark_dirty [inode 0x10000000575 [2,head] /dc-dir/dc-file_896 auth v5794 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.154331+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d731600] 2023-10-03T19:21:01.780 INFO:teuthology.orchestra.run.smithi045.stdout: -6680> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_896) mark_dirty [dentry #0x1/dc-dir/dc-file_896 [2,head] auth (dversion lock) pv=5794 v=4526 ino=0x10000000575 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d72d680] 2023-10-03T19:21:01.780 INFO:teuthology.orchestra.run.smithi045.stdout: -6679> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5793 cv=5553/5553 ap=105+104 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=121 | child=1 dirty=1 authpin=1 0x55576d056400] version 5793 2023-10-03T19:21:01.780 INFO:teuthology.orchestra.run.smithi045.stdout: -6678> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d5d6260 v5801 2023-10-03T19:21:01.780 INFO:teuthology.orchestra.run.smithi045.stdout: -6677> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5801 cv=5559/5559 REP dir_auth=0 ap=104+105 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5801 2023-10-03T19:21:01.781 INFO:teuthology.orchestra.run.smithi045.stdout: -6676> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d1b2a40 v5795 2023-10-03T19:21:01.781 INFO:teuthology.orchestra.run.smithi045.stdout: -6675> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5795 cv=5553/5553 ap=105+104 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=121 | child=1 dirty=1 authpin=1 0x55576d056400] version 5795 2023-10-03T19:21:01.781 INFO:teuthology.orchestra.run.smithi045.stdout: -6674> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=104 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=104 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.781 INFO:teuthology.orchestra.run.smithi045.stdout: -6673> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=104) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5800 pv6006 ap=105 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=105) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=104) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.781 INFO:teuthology.orchestra.run.smithi045.stdout: -6672> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=105) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5800 pv6006 ap=105 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=105) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=103) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.781 INFO:teuthology.orchestra.run.smithi045.stdout: -6671> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000575 [2,head] /dc-dir/dc-file_896 auth v5794 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.154331+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d731600] 2023-10-03T19:21:01.781 INFO:teuthology.orchestra.run.smithi045.stdout: -6670> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000575 [2,head] /dc-dir/dc-file_896 auth v5794 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.154331+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d731600] 2023-10-03T19:21:01.781 INFO:teuthology.orchestra.run.smithi045.stdout: -6669> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.781 INFO:teuthology.orchestra.run.smithi045.stdout: -6668> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.781 INFO:teuthology.orchestra.run.smithi045.stdout: -6667> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.782 INFO:teuthology.orchestra.run.smithi045.stdout: -6666> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000575 [2,head] /dc-dir/dc-file_896 auth v5794 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.154331+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d731600] 2023-10-03T19:21:01.782 INFO:teuthology.orchestra.run.smithi045.stdout: -6665> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000575 [2,head] /dc-dir/dc-file_896 auth v5794 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.154331+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d731600] 2023-10-03T19:21:01.782 INFO:teuthology.orchestra.run.smithi045.stdout: -6664> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.782 INFO:teuthology.orchestra.run.smithi045.stdout: -6663> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 310.449, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.10e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:623.9] 2023-10-03T19:21:01.782 INFO:teuthology.orchestra.run.smithi045.stdout: -6662> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2b2000 on [dir 0x1 / [2,head] auth pv=6007 v=5801 cv=5559/5559 REP dir_auth=0 ap=103+105 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 103 2023-10-03T19:21:01.782 INFO:teuthology.orchestra.run.smithi045.stdout: -6661> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2b2000 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5800 pv6006 ap=104 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=104) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=103) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 104 2023-10-03T19:21:01.782 INFO:teuthology.orchestra.run.smithi045.stdout: -6660> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5801 cv=5559/5559 REP dir_auth=0 ap=103+104 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2b2000 count now 103/104 2023-10-03T19:21:01.782 INFO:teuthology.orchestra.run.smithi045.stdout: -6659> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2b2000 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5795 cv=5553/5553 ap=104+104 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=121 | child=1 dirty=1 authpin=1 0x55576d056400] count now 104 2023-10-03T19:21:01.782 INFO:teuthology.orchestra.run.smithi045.stdout: -6658> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000575) auth_unpin by 0x55576d2b2000 on [inode 0x10000000575 [2,head] /dc-dir/dc-file_896 auth v5794 s=3 n(v0 rc2023-10-03T19:16:12.154331+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d731600] now 0 2023-10-03T19:21:01.782 INFO:teuthology.orchestra.run.smithi045.stdout: -6657> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5795 cv=5553/5553 ap=104+103 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=121 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2b2000 count now 104/103 2023-10-03T19:21:01.783 INFO:teuthology.orchestra.run.smithi045.stdout: -6656> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.783 INFO:teuthology.orchestra.run.smithi045.stdout: -6655> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.783 INFO:teuthology.orchestra.run.smithi045.stdout: -6654> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000576 [2,head] /dc-dir/dc-file_897 auth v4530 pv5796 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.165323+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.165323+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d731b80] 2023-10-03T19:21:01.783 INFO:teuthology.orchestra.run.smithi045.stdout: -6653> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5802 2023-10-03T19:21:01.783 INFO:teuthology.orchestra.run.smithi045.stdout: -6652> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5802 pv6006 ap=104 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=104) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=103) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.783 INFO:teuthology.orchestra.run.smithi045.stdout: -6651> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5800 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.783 INFO:teuthology.orchestra.run.smithi045.stdout: -6650> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5801 cv=5559/5559 REP dir_auth=0 ap=103+104 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5801 2023-10-03T19:21:01.783 INFO:teuthology.orchestra.run.smithi045.stdout: -6649> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000576) pop_and_dirty_projected_inode v5796 2023-10-03T19:21:01.783 INFO:teuthology.orchestra.run.smithi045.stdout: -6648> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000576) mark_dirty [inode 0x10000000576 [2,head] /dc-dir/dc-file_897 auth v5796 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.165323+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d731b80] 2023-10-03T19:21:01.783 INFO:teuthology.orchestra.run.smithi045.stdout: -6647> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_897) mark_dirty [dentry #0x1/dc-dir/dc-file_897 [2,head] auth (dversion lock) pv=5796 v=4530 ino=0x10000000576 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d72d900] 2023-10-03T19:21:01.784 INFO:teuthology.orchestra.run.smithi045.stdout: -6646> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5795 cv=5553/5553 ap=104+103 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=122 | child=1 dirty=1 authpin=1 0x55576d056400] version 5795 2023-10-03T19:21:01.784 INFO:teuthology.orchestra.run.smithi045.stdout: -6645> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d1b3e80 v5803 2023-10-03T19:21:01.784 INFO:teuthology.orchestra.run.smithi045.stdout: -6644> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5803 cv=5559/5559 REP dir_auth=0 ap=103+104 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5803 2023-10-03T19:21:01.784 INFO:teuthology.orchestra.run.smithi045.stdout: -6643> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d1b2800 v5797 2023-10-03T19:21:01.784 INFO:teuthology.orchestra.run.smithi045.stdout: -6642> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5797 cv=5553/5553 ap=104+103 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=122 | child=1 dirty=1 authpin=1 0x55576d056400] version 5797 2023-10-03T19:21:01.784 INFO:teuthology.orchestra.run.smithi045.stdout: -6641> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=103 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=103 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.784 INFO:teuthology.orchestra.run.smithi045.stdout: -6640> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=103) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5802 pv6006 ap=104 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=104) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=103) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.784 INFO:teuthology.orchestra.run.smithi045.stdout: -6639> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=104) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5802 pv6006 ap=104 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=104) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=102) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.784 INFO:teuthology.orchestra.run.smithi045.stdout: -6638> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000576 [2,head] /dc-dir/dc-file_897 auth v5796 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.165323+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d731b80] 2023-10-03T19:21:01.784 INFO:teuthology.orchestra.run.smithi045.stdout: -6637> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000576 [2,head] /dc-dir/dc-file_897 auth v5796 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.165323+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d731b80] 2023-10-03T19:21:01.784 INFO:teuthology.orchestra.run.smithi045.stdout: -6636> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.785 INFO:teuthology.orchestra.run.smithi045.stdout: -6635> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.785 INFO:teuthology.orchestra.run.smithi045.stdout: -6634> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.785 INFO:teuthology.orchestra.run.smithi045.stdout: -6633> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000576 [2,head] /dc-dir/dc-file_897 auth v5796 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.165323+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d731b80] 2023-10-03T19:21:01.785 INFO:teuthology.orchestra.run.smithi045.stdout: -6632> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000576 [2,head] /dc-dir/dc-file_897 auth v5796 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.165323+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d731b80] 2023-10-03T19:21:01.785 INFO:teuthology.orchestra.run.smithi045.stdout: -6631> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.785 INFO:teuthology.orchestra.run.smithi045.stdout: -6630> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 311.449, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.11e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:625.9] 2023-10-03T19:21:01.785 INFO:teuthology.orchestra.run.smithi045.stdout: -6629> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d546b40 on [dir 0x1 / [2,head] auth pv=6007 v=5803 cv=5559/5559 REP dir_auth=0 ap=102+104 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 102 2023-10-03T19:21:01.785 INFO:teuthology.orchestra.run.smithi045.stdout: -6628> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d546b40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5802 pv6006 ap=103 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=103) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=102) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 103 2023-10-03T19:21:01.785 INFO:teuthology.orchestra.run.smithi045.stdout: -6627> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5803 cv=5559/5559 REP dir_auth=0 ap=102+103 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d546b40 count now 102/103 2023-10-03T19:21:01.785 INFO:teuthology.orchestra.run.smithi045.stdout: -6626> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d546b40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5797 cv=5553/5553 ap=103+103 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=122 | child=1 dirty=1 authpin=1 0x55576d056400] count now 103 2023-10-03T19:21:01.785 INFO:teuthology.orchestra.run.smithi045.stdout: -6625> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000576) auth_unpin by 0x55576d546b40 on [inode 0x10000000576 [2,head] /dc-dir/dc-file_897 auth v5796 s=3 n(v0 rc2023-10-03T19:16:12.165323+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d731b80] now 0 2023-10-03T19:21:01.786 INFO:teuthology.orchestra.run.smithi045.stdout: -6624> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5797 cv=5553/5553 ap=103+102 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=122 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d546b40 count now 103/102 2023-10-03T19:21:01.786 INFO:teuthology.orchestra.run.smithi045.stdout: -6623> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.786 INFO:teuthology.orchestra.run.smithi045.stdout: -6622> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.786 INFO:teuthology.orchestra.run.smithi045.stdout: -6621> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000577 [2,head] /dc-dir/dc-file_898 auth v4534 pv5798 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.176673+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.176673+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d732100] 2023-10-03T19:21:01.786 INFO:teuthology.orchestra.run.smithi045.stdout: -6620> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5804 2023-10-03T19:21:01.786 INFO:teuthology.orchestra.run.smithi045.stdout: -6619> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5804 pv6006 ap=103 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=103) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=102) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.786 INFO:teuthology.orchestra.run.smithi045.stdout: -6618> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5802 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.786 INFO:teuthology.orchestra.run.smithi045.stdout: -6617> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5803 cv=5559/5559 REP dir_auth=0 ap=102+103 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5803 2023-10-03T19:21:01.786 INFO:teuthology.orchestra.run.smithi045.stdout: -6616> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000577) pop_and_dirty_projected_inode v5798 2023-10-03T19:21:01.786 INFO:teuthology.orchestra.run.smithi045.stdout: -6615> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000577) mark_dirty [inode 0x10000000577 [2,head] /dc-dir/dc-file_898 auth v5798 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.176673+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d732100] 2023-10-03T19:21:01.787 INFO:teuthology.orchestra.run.smithi045.stdout: -6614> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_898) mark_dirty [dentry #0x1/dc-dir/dc-file_898 [2,head] auth (dversion lock) pv=5798 v=4534 ino=0x10000000577 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d72db80] 2023-10-03T19:21:01.787 INFO:teuthology.orchestra.run.smithi045.stdout: -6613> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5797 cv=5553/5553 ap=103+102 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=123 | child=1 dirty=1 authpin=1 0x55576d056400] version 5797 2023-10-03T19:21:01.787 INFO:teuthology.orchestra.run.smithi045.stdout: -6612> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d1b3b20 v5805 2023-10-03T19:21:01.787 INFO:teuthology.orchestra.run.smithi045.stdout: -6611> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5805 cv=5559/5559 REP dir_auth=0 ap=102+103 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5805 2023-10-03T19:21:01.787 INFO:teuthology.orchestra.run.smithi045.stdout: -6610> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d1b25c0 v5799 2023-10-03T19:21:01.787 INFO:teuthology.orchestra.run.smithi045.stdout: -6609> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5799 cv=5553/5553 ap=103+102 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=123 | child=1 dirty=1 authpin=1 0x55576d056400] version 5799 2023-10-03T19:21:01.787 INFO:teuthology.orchestra.run.smithi045.stdout: -6608> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=102 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=102 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.787 INFO:teuthology.orchestra.run.smithi045.stdout: -6607> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=102) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5804 pv6006 ap=103 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=103) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=102) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.787 INFO:teuthology.orchestra.run.smithi045.stdout: -6606> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=103) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5804 pv6006 ap=103 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=103) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=101) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.787 INFO:teuthology.orchestra.run.smithi045.stdout: -6605> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000577 [2,head] /dc-dir/dc-file_898 auth v5798 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.176673+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d732100] 2023-10-03T19:21:01.787 INFO:teuthology.orchestra.run.smithi045.stdout: -6604> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000577 [2,head] /dc-dir/dc-file_898 auth v5798 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.176673+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d732100] 2023-10-03T19:21:01.788 INFO:teuthology.orchestra.run.smithi045.stdout: -6603> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.788 INFO:teuthology.orchestra.run.smithi045.stdout: -6602> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.788 INFO:teuthology.orchestra.run.smithi045.stdout: -6601> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.788 INFO:teuthology.orchestra.run.smithi045.stdout: -6600> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000577 [2,head] /dc-dir/dc-file_898 auth v5798 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.176673+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d732100] 2023-10-03T19:21:01.788 INFO:teuthology.orchestra.run.smithi045.stdout: -6599> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000577 [2,head] /dc-dir/dc-file_898 auth v5798 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.176673+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d732100] 2023-10-03T19:21:01.788 INFO:teuthology.orchestra.run.smithi045.stdout: -6598> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.788 INFO:teuthology.orchestra.run.smithi045.stdout: -6597> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 312.449, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.12e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:627.9] 2023-10-03T19:21:01.788 INFO:teuthology.orchestra.run.smithi045.stdout: -6596> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d5cb200 on [dir 0x1 / [2,head] auth pv=6007 v=5805 cv=5559/5559 REP dir_auth=0 ap=101+103 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 101 2023-10-03T19:21:01.788 INFO:teuthology.orchestra.run.smithi045.stdout: -6595> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d5cb200 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5804 pv6006 ap=102 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=102) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=101) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 102 2023-10-03T19:21:01.788 INFO:teuthology.orchestra.run.smithi045.stdout: -6594> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5805 cv=5559/5559 REP dir_auth=0 ap=101+102 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d5cb200 count now 101/102 2023-10-03T19:21:01.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6593> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d5cb200 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5799 cv=5553/5553 ap=102+102 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=123 | child=1 dirty=1 authpin=1 0x55576d056400] count now 102 2023-10-03T19:21:01.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6592> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000577) auth_unpin by 0x55576d5cb200 on [inode 0x10000000577 [2,head] /dc-dir/dc-file_898 auth v5798 s=3 n(v0 rc2023-10-03T19:16:12.176673+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d732100] now 0 2023-10-03T19:21:01.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6591> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5799 cv=5553/5553 ap=102+101 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=123 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d5cb200 count now 102/101 2023-10-03T19:21:01.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6590> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6589> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6588> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000578 [2,head] /dc-dir/dc-file_899 auth v4538 pv5800 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.188184+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.188184+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d732680] 2023-10-03T19:21:01.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6587> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5806 2023-10-03T19:21:01.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6586> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5806 pv6006 ap=102 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=102) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=101) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6585> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5804 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6584> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5805 cv=5559/5559 REP dir_auth=0 ap=101+102 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5805 2023-10-03T19:21:01.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6583> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000578) pop_and_dirty_projected_inode v5800 2023-10-03T19:21:01.790 INFO:teuthology.orchestra.run.smithi045.stdout: -6582> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000578) mark_dirty [inode 0x10000000578 [2,head] /dc-dir/dc-file_899 auth v5800 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.188184+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d732680] 2023-10-03T19:21:01.790 INFO:teuthology.orchestra.run.smithi045.stdout: -6581> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_899) mark_dirty [dentry #0x1/dc-dir/dc-file_899 [2,head] auth (dversion lock) pv=5800 v=4538 ino=0x10000000578 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d736000] 2023-10-03T19:21:01.790 INFO:teuthology.orchestra.run.smithi045.stdout: -6580> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5799 cv=5553/5553 ap=102+101 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=124 | child=1 dirty=1 authpin=1 0x55576d056400] version 5799 2023-10-03T19:21:01.790 INFO:teuthology.orchestra.run.smithi045.stdout: -6579> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d1b3c40 v5807 2023-10-03T19:21:01.790 INFO:teuthology.orchestra.run.smithi045.stdout: -6578> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5807 cv=5559/5559 REP dir_auth=0 ap=101+102 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5807 2023-10-03T19:21:01.790 INFO:teuthology.orchestra.run.smithi045.stdout: -6577> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d1b2380 v5801 2023-10-03T19:21:01.790 INFO:teuthology.orchestra.run.smithi045.stdout: -6576> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5801 cv=5553/5553 ap=102+101 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=124 | child=1 dirty=1 authpin=1 0x55576d056400] version 5801 2023-10-03T19:21:01.790 INFO:teuthology.orchestra.run.smithi045.stdout: -6575> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=101 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=101 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.797 INFO:teuthology.orchestra.run.smithi045.stdout: -6574> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=101) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5806 pv6006 ap=102 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=102) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=101) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.797 INFO:teuthology.orchestra.run.smithi045.stdout: -6573> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=102) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5806 pv6006 ap=102 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=102) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=100) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.797 INFO:teuthology.orchestra.run.smithi045.stdout: -6572> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000578 [2,head] /dc-dir/dc-file_899 auth v5800 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.188184+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d732680] 2023-10-03T19:21:01.798 INFO:teuthology.orchestra.run.smithi045.stdout: -6571> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000578 [2,head] /dc-dir/dc-file_899 auth v5800 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.188184+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d732680] 2023-10-03T19:21:01.798 INFO:teuthology.orchestra.run.smithi045.stdout: -6570> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.798 INFO:teuthology.orchestra.run.smithi045.stdout: -6569> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.798 INFO:teuthology.orchestra.run.smithi045.stdout: -6568> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.798 INFO:teuthology.orchestra.run.smithi045.stdout: -6567> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000578 [2,head] /dc-dir/dc-file_899 auth v5800 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.188184+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d732680] 2023-10-03T19:21:01.798 INFO:teuthology.orchestra.run.smithi045.stdout: -6566> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000578 [2,head] /dc-dir/dc-file_899 auth v5800 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.188184+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d732680] 2023-10-03T19:21:01.798 INFO:teuthology.orchestra.run.smithi045.stdout: -6565> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.798 INFO:teuthology.orchestra.run.smithi045.stdout: -6564> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 313.449, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.13e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:629.9] 2023-10-03T19:21:01.798 INFO:teuthology.orchestra.run.smithi045.stdout: -6563> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2a58c0 on [dir 0x1 / [2,head] auth pv=6007 v=5807 cv=5559/5559 REP dir_auth=0 ap=100+102 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 100 2023-10-03T19:21:01.798 INFO:teuthology.orchestra.run.smithi045.stdout: -6562> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2a58c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5806 pv6006 ap=101 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=101) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=100) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 101 2023-10-03T19:21:01.799 INFO:teuthology.orchestra.run.smithi045.stdout: -6561> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5807 cv=5559/5559 REP dir_auth=0 ap=100+101 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2a58c0 count now 100/101 2023-10-03T19:21:01.799 INFO:teuthology.orchestra.run.smithi045.stdout: -6560> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2a58c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5801 cv=5553/5553 ap=101+101 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=124 | child=1 dirty=1 authpin=1 0x55576d056400] count now 101 2023-10-03T19:21:01.799 INFO:teuthology.orchestra.run.smithi045.stdout: -6559> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000578) auth_unpin by 0x55576d2a58c0 on [inode 0x10000000578 [2,head] /dc-dir/dc-file_899 auth v5800 s=3 n(v0 rc2023-10-03T19:16:12.188184+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d732680] now 0 2023-10-03T19:21:01.799 INFO:teuthology.orchestra.run.smithi045.stdout: -6558> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5801 cv=5553/5553 ap=101+100 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=124 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2a58c0 count now 101/100 2023-10-03T19:21:01.799 INFO:teuthology.orchestra.run.smithi045.stdout: -6557> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.799 INFO:teuthology.orchestra.run.smithi045.stdout: -6556> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.799 INFO:teuthology.orchestra.run.smithi045.stdout: -6555> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000579 [2,head] /dc-dir/dc-file_900 auth v4542 pv5802 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.199415+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.199415+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d732c00] 2023-10-03T19:21:01.799 INFO:teuthology.orchestra.run.smithi045.stdout: -6554> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5808 2023-10-03T19:21:01.799 INFO:teuthology.orchestra.run.smithi045.stdout: -6553> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5808 pv6006 ap=101 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=101) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=100) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.799 INFO:teuthology.orchestra.run.smithi045.stdout: -6552> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5806 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.799 INFO:teuthology.orchestra.run.smithi045.stdout: -6551> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5807 cv=5559/5559 REP dir_auth=0 ap=100+101 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5807 2023-10-03T19:21:01.800 INFO:teuthology.orchestra.run.smithi045.stdout: -6550> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000579) pop_and_dirty_projected_inode v5802 2023-10-03T19:21:01.800 INFO:teuthology.orchestra.run.smithi045.stdout: -6549> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000579) mark_dirty [inode 0x10000000579 [2,head] /dc-dir/dc-file_900 auth v5802 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.199415+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d732c00] 2023-10-03T19:21:01.800 INFO:teuthology.orchestra.run.smithi045.stdout: -6548> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_900) mark_dirty [dentry #0x1/dc-dir/dc-file_900 [2,head] auth (dversion lock) pv=5802 v=4542 ino=0x10000000579 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d736280] 2023-10-03T19:21:01.800 INFO:teuthology.orchestra.run.smithi045.stdout: -6547> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5801 cv=5553/5553 ap=101+100 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=125 | child=1 dirty=1 authpin=1 0x55576d056400] version 5801 2023-10-03T19:21:01.800 INFO:teuthology.orchestra.run.smithi045.stdout: -6546> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d1b3d60 v5809 2023-10-03T19:21:01.800 INFO:teuthology.orchestra.run.smithi045.stdout: -6545> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5809 cv=5559/5559 REP dir_auth=0 ap=100+101 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5809 2023-10-03T19:21:01.800 INFO:teuthology.orchestra.run.smithi045.stdout: -6544> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d1b2140 v5803 2023-10-03T19:21:01.800 INFO:teuthology.orchestra.run.smithi045.stdout: -6543> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5803 cv=5553/5553 ap=101+100 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=125 | child=1 dirty=1 authpin=1 0x55576d056400] version 5803 2023-10-03T19:21:01.800 INFO:teuthology.orchestra.run.smithi045.stdout: -6542> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=100 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=100 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.800 INFO:teuthology.orchestra.run.smithi045.stdout: -6541> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=100) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5808 pv6006 ap=101 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=101) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=100) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.801 INFO:teuthology.orchestra.run.smithi045.stdout: -6540> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=101) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5808 pv6006 ap=101 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=101) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=99) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.801 INFO:teuthology.orchestra.run.smithi045.stdout: -6539> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000579 [2,head] /dc-dir/dc-file_900 auth v5802 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.199415+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d732c00] 2023-10-03T19:21:01.801 INFO:teuthology.orchestra.run.smithi045.stdout: -6538> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000579 [2,head] /dc-dir/dc-file_900 auth v5802 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.199415+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d732c00] 2023-10-03T19:21:01.801 INFO:teuthology.orchestra.run.smithi045.stdout: -6537> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.801 INFO:teuthology.orchestra.run.smithi045.stdout: -6536> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.801 INFO:teuthology.orchestra.run.smithi045.stdout: -6535> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.801 INFO:teuthology.orchestra.run.smithi045.stdout: -6534> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000579 [2,head] /dc-dir/dc-file_900 auth v5802 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.199415+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d732c00] 2023-10-03T19:21:01.801 INFO:teuthology.orchestra.run.smithi045.stdout: -6533> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000579 [2,head] /dc-dir/dc-file_900 auth v5802 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.199415+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d732c00] 2023-10-03T19:21:01.801 INFO:teuthology.orchestra.run.smithi045.stdout: -6532> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.801 INFO:teuthology.orchestra.run.smithi045.stdout: -6531> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 314.449, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.14e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:631.9] 2023-10-03T19:21:01.801 INFO:teuthology.orchestra.run.smithi045.stdout: -6530> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d54f200 on [dir 0x1 / [2,head] auth pv=6007 v=5809 cv=5559/5559 REP dir_auth=0 ap=99+101 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 99 2023-10-03T19:21:01.802 INFO:teuthology.orchestra.run.smithi045.stdout: -6529> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d54f200 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5808 pv6006 ap=100 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=100) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=99) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 100 2023-10-03T19:21:01.802 INFO:teuthology.orchestra.run.smithi045.stdout: -6528> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5809 cv=5559/5559 REP dir_auth=0 ap=99+100 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d54f200 count now 99/100 2023-10-03T19:21:01.802 INFO:teuthology.orchestra.run.smithi045.stdout: -6527> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d54f200 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5803 cv=5553/5553 ap=100+100 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=125 | child=1 dirty=1 authpin=1 0x55576d056400] count now 100 2023-10-03T19:21:01.802 INFO:teuthology.orchestra.run.smithi045.stdout: -6526> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000579) auth_unpin by 0x55576d54f200 on [inode 0x10000000579 [2,head] /dc-dir/dc-file_900 auth v5802 s=3 n(v0 rc2023-10-03T19:16:12.199415+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d732c00] now 0 2023-10-03T19:21:01.802 INFO:teuthology.orchestra.run.smithi045.stdout: -6525> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5803 cv=5553/5553 ap=100+99 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=125 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d54f200 count now 100/99 2023-10-03T19:21:01.802 INFO:teuthology.orchestra.run.smithi045.stdout: -6524> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.802 INFO:teuthology.orchestra.run.smithi045.stdout: -6523> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.802 INFO:teuthology.orchestra.run.smithi045.stdout: -6522> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000057a [2,head] /dc-dir/dc-file_901 auth v4546 pv5804 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.210853+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.210853+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d733180] 2023-10-03T19:21:01.802 INFO:teuthology.orchestra.run.smithi045.stdout: -6521> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5810 2023-10-03T19:21:01.802 INFO:teuthology.orchestra.run.smithi045.stdout: -6520> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5810 pv6006 ap=100 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=100) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=99) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.802 INFO:teuthology.orchestra.run.smithi045.stdout: -6519> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5808 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.803 INFO:teuthology.orchestra.run.smithi045.stdout: -6518> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5809 cv=5559/5559 REP dir_auth=0 ap=99+100 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5809 2023-10-03T19:21:01.803 INFO:teuthology.orchestra.run.smithi045.stdout: -6517> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000057a) pop_and_dirty_projected_inode v5804 2023-10-03T19:21:01.829 INFO:teuthology.orchestra.run.smithi045.stdout: -6516> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000057a) mark_dirty [inode 0x1000000057a [2,head] /dc-dir/dc-file_901 auth v5804 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.210853+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d733180] 2023-10-03T19:21:01.829 INFO:teuthology.orchestra.run.smithi045.stdout: -6515> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_901) mark_dirty [dentry #0x1/dc-dir/dc-file_901 [2,head] auth (dversion lock) pv=5804 v=4546 ino=0x1000000057a state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d736500] 2023-10-03T19:21:01.829 INFO:teuthology.orchestra.run.smithi045.stdout: -6514> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5803 cv=5553/5553 ap=100+99 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=126 | child=1 dirty=1 authpin=1 0x55576d056400] version 5803 2023-10-03T19:21:01.829 INFO:teuthology.orchestra.run.smithi045.stdout: -6513> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d1b36a0 v5811 2023-10-03T19:21:01.829 INFO:teuthology.orchestra.run.smithi045.stdout: -6512> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5811 cv=5559/5559 REP dir_auth=0 ap=99+100 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5811 2023-10-03T19:21:01.829 INFO:teuthology.orchestra.run.smithi045.stdout: -6511> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576cf48260 v5805 2023-10-03T19:21:01.829 INFO:teuthology.orchestra.run.smithi045.stdout: -6510> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5805 cv=5553/5553 ap=100+99 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=126 | child=1 dirty=1 authpin=1 0x55576d056400] version 5805 2023-10-03T19:21:01.829 INFO:teuthology.orchestra.run.smithi045.stdout: -6509> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=99 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=99 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.829 INFO:teuthology.orchestra.run.smithi045.stdout: -6508> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=99) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5810 pv6006 ap=100 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=100) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=99) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.830 INFO:teuthology.orchestra.run.smithi045.stdout: -6507> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=100) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5810 pv6006 ap=100 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=100) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=98) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.830 INFO:teuthology.orchestra.run.smithi045.stdout: -6506> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000057a [2,head] /dc-dir/dc-file_901 auth v5804 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.210853+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d733180] 2023-10-03T19:21:01.830 INFO:teuthology.orchestra.run.smithi045.stdout: -6505> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000057a [2,head] /dc-dir/dc-file_901 auth v5804 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.210853+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d733180] 2023-10-03T19:21:01.830 INFO:teuthology.orchestra.run.smithi045.stdout: -6504> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.830 INFO:teuthology.orchestra.run.smithi045.stdout: -6503> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.830 INFO:teuthology.orchestra.run.smithi045.stdout: -6502> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.830 INFO:teuthology.orchestra.run.smithi045.stdout: -6501> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000057a [2,head] /dc-dir/dc-file_901 auth v5804 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.210853+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d733180] 2023-10-03T19:21:01.830 INFO:teuthology.orchestra.run.smithi045.stdout: -6500> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000057a [2,head] /dc-dir/dc-file_901 auth v5804 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.210853+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d733180] 2023-10-03T19:21:01.830 INFO:teuthology.orchestra.run.smithi045.stdout: -6499> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.830 INFO:teuthology.orchestra.run.smithi045.stdout: -6498> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 315.449, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.15e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:633.9] 2023-10-03T19:21:01.831 INFO:teuthology.orchestra.run.smithi045.stdout: -6497> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2b3440 on [dir 0x1 / [2,head] auth pv=6007 v=5811 cv=5559/5559 REP dir_auth=0 ap=98+100 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 98 2023-10-03T19:21:01.831 INFO:teuthology.orchestra.run.smithi045.stdout: -6496> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2b3440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5810 pv6006 ap=99 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=99) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=98) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 99 2023-10-03T19:21:01.831 INFO:teuthology.orchestra.run.smithi045.stdout: -6495> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5811 cv=5559/5559 REP dir_auth=0 ap=98+99 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2b3440 count now 98/99 2023-10-03T19:21:01.831 INFO:teuthology.orchestra.run.smithi045.stdout: -6494> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2b3440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5805 cv=5553/5553 ap=99+99 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=126 | child=1 dirty=1 authpin=1 0x55576d056400] count now 99 2023-10-03T19:21:01.831 INFO:teuthology.orchestra.run.smithi045.stdout: -6493> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000057a) auth_unpin by 0x55576d2b3440 on [inode 0x1000000057a [2,head] /dc-dir/dc-file_901 auth v5804 s=3 n(v0 rc2023-10-03T19:16:12.210853+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d733180] now 0 2023-10-03T19:21:01.831 INFO:teuthology.orchestra.run.smithi045.stdout: -6492> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5805 cv=5553/5553 ap=99+98 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=126 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2b3440 count now 99/98 2023-10-03T19:21:01.831 INFO:teuthology.orchestra.run.smithi045.stdout: -6491> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.831 INFO:teuthology.orchestra.run.smithi045.stdout: -6490> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.831 INFO:teuthology.orchestra.run.smithi045.stdout: -6489> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000057b [2,head] /dc-dir/dc-file_902 auth v4550 pv5806 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.222270+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.222270+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d733700] 2023-10-03T19:21:01.831 INFO:teuthology.orchestra.run.smithi045.stdout: -6488> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5812 2023-10-03T19:21:01.831 INFO:teuthology.orchestra.run.smithi045.stdout: -6487> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5812 pv6006 ap=99 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=99) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=98) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.831 INFO:teuthology.orchestra.run.smithi045.stdout: -6486> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5810 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.832 INFO:teuthology.orchestra.run.smithi045.stdout: -6485> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5811 cv=5559/5559 REP dir_auth=0 ap=98+99 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5811 2023-10-03T19:21:01.832 INFO:teuthology.orchestra.run.smithi045.stdout: -6484> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000057b) pop_and_dirty_projected_inode v5806 2023-10-03T19:21:01.832 INFO:teuthology.orchestra.run.smithi045.stdout: -6483> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000057b) mark_dirty [inode 0x1000000057b [2,head] /dc-dir/dc-file_902 auth v5806 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.222270+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d733700] 2023-10-03T19:21:01.832 INFO:teuthology.orchestra.run.smithi045.stdout: -6482> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_902) mark_dirty [dentry #0x1/dc-dir/dc-file_902 [2,head] auth (dversion lock) pv=5806 v=4550 ino=0x1000000057b state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d736780] 2023-10-03T19:21:01.832 INFO:teuthology.orchestra.run.smithi045.stdout: -6481> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5805 cv=5553/5553 ap=99+98 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=127 | child=1 dirty=1 authpin=1 0x55576d056400] version 5805 2023-10-03T19:21:01.832 INFO:teuthology.orchestra.run.smithi045.stdout: -6480> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d1b2fe0 v5813 2023-10-03T19:21:01.832 INFO:teuthology.orchestra.run.smithi045.stdout: -6479> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5813 cv=5559/5559 REP dir_auth=0 ap=98+99 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5813 2023-10-03T19:21:01.832 INFO:teuthology.orchestra.run.smithi045.stdout: -6478> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576cf48140 v5807 2023-10-03T19:21:01.832 INFO:teuthology.orchestra.run.smithi045.stdout: -6477> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5807 cv=5553/5553 ap=99+98 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=127 | child=1 dirty=1 authpin=1 0x55576d056400] version 5807 2023-10-03T19:21:01.832 INFO:teuthology.orchestra.run.smithi045.stdout: -6476> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=98 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=98 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.833 INFO:teuthology.orchestra.run.smithi045.stdout: -6475> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=98) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5812 pv6006 ap=99 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=99) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=98) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.833 INFO:teuthology.orchestra.run.smithi045.stdout: -6474> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=99) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5812 pv6006 ap=99 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=99) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=97) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.833 INFO:teuthology.orchestra.run.smithi045.stdout: -6473> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000057b [2,head] /dc-dir/dc-file_902 auth v5806 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.222270+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d733700] 2023-10-03T19:21:01.833 INFO:teuthology.orchestra.run.smithi045.stdout: -6472> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000057b [2,head] /dc-dir/dc-file_902 auth v5806 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.222270+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d733700] 2023-10-03T19:21:01.833 INFO:teuthology.orchestra.run.smithi045.stdout: -6471> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.833 INFO:teuthology.orchestra.run.smithi045.stdout: -6470> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.833 INFO:teuthology.orchestra.run.smithi045.stdout: -6469> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.833 INFO:teuthology.orchestra.run.smithi045.stdout: -6468> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000057b [2,head] /dc-dir/dc-file_902 auth v5806 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.222270+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d733700] 2023-10-03T19:21:01.833 INFO:teuthology.orchestra.run.smithi045.stdout: -6467> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000057b [2,head] /dc-dir/dc-file_902 auth v5806 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.222270+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d733700] 2023-10-03T19:21:01.833 INFO:teuthology.orchestra.run.smithi045.stdout: -6466> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.833 INFO:teuthology.orchestra.run.smithi045.stdout: -6465> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 316.449, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.16e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:635.9] 2023-10-03T19:21:01.834 INFO:teuthology.orchestra.run.smithi045.stdout: -6464> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2b2900 on [dir 0x1 / [2,head] auth pv=6007 v=5813 cv=5559/5559 REP dir_auth=0 ap=97+99 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 97 2023-10-03T19:21:01.834 INFO:teuthology.orchestra.run.smithi045.stdout: -6463> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2b2900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5812 pv6006 ap=98 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=98) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=97) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 98 2023-10-03T19:21:01.834 INFO:teuthology.orchestra.run.smithi045.stdout: -6462> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5813 cv=5559/5559 REP dir_auth=0 ap=97+98 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2b2900 count now 97/98 2023-10-03T19:21:01.910 INFO:teuthology.orchestra.run.smithi045.stdout: -6461> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2b2900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5807 cv=5553/5553 ap=98+98 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=127 | child=1 dirty=1 authpin=1 0x55576d056400] count now 98 2023-10-03T19:21:01.910 INFO:teuthology.orchestra.run.smithi045.stdout: -6460> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000057b) auth_unpin by 0x55576d2b2900 on [inode 0x1000000057b [2,head] /dc-dir/dc-file_902 auth v5806 s=3 n(v0 rc2023-10-03T19:16:12.222270+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d733700] now 0 2023-10-03T19:21:01.910 INFO:teuthology.orchestra.run.smithi045.stdout: -6459> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5807 cv=5553/5553 ap=98+97 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=127 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2b2900 count now 98/97 2023-10-03T19:21:01.910 INFO:teuthology.orchestra.run.smithi045.stdout: -6458> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.910 INFO:teuthology.orchestra.run.smithi045.stdout: -6457> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.910 INFO:teuthology.orchestra.run.smithi045.stdout: -6456> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000057c [2,head] /dc-dir/dc-file_903 auth v4554 pv5808 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.234211+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.234211+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d738000] 2023-10-03T19:21:01.910 INFO:teuthology.orchestra.run.smithi045.stdout: -6455> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5814 2023-10-03T19:21:01.911 INFO:teuthology.orchestra.run.smithi045.stdout: -6454> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5814 pv6006 ap=98 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=98) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=97) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.911 INFO:teuthology.orchestra.run.smithi045.stdout: -6453> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5812 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.911 INFO:teuthology.orchestra.run.smithi045.stdout: -6452> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5813 cv=5559/5559 REP dir_auth=0 ap=97+98 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5813 2023-10-03T19:21:01.911 INFO:teuthology.orchestra.run.smithi045.stdout: -6451> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000057c) pop_and_dirty_projected_inode v5808 2023-10-03T19:21:01.911 INFO:teuthology.orchestra.run.smithi045.stdout: -6450> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000057c) mark_dirty [inode 0x1000000057c [2,head] /dc-dir/dc-file_903 auth v5808 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.234211+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d738000] 2023-10-03T19:21:01.911 INFO:teuthology.orchestra.run.smithi045.stdout: -6449> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_903) mark_dirty [dentry #0x1/dc-dir/dc-file_903 [2,head] auth (dversion lock) pv=5808 v=4554 ino=0x1000000057c state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d736a00] 2023-10-03T19:21:01.911 INFO:teuthology.orchestra.run.smithi045.stdout: -6448> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5807 cv=5553/5553 ap=98+97 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=128 | child=1 dirty=1 authpin=1 0x55576d056400] version 5807 2023-10-03T19:21:01.911 INFO:teuthology.orchestra.run.smithi045.stdout: -6447> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d1b2da0 v5815 2023-10-03T19:21:01.911 INFO:teuthology.orchestra.run.smithi045.stdout: -6446> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5815 cv=5559/5559 REP dir_auth=0 ap=97+98 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5815 2023-10-03T19:21:01.911 INFO:teuthology.orchestra.run.smithi045.stdout: -6445> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576cf49b20 v5809 2023-10-03T19:21:01.912 INFO:teuthology.orchestra.run.smithi045.stdout: -6444> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5809 cv=5553/5553 ap=98+97 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=128 | child=1 dirty=1 authpin=1 0x55576d056400] version 5809 2023-10-03T19:21:01.912 INFO:teuthology.orchestra.run.smithi045.stdout: -6443> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=97 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=97 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.912 INFO:teuthology.orchestra.run.smithi045.stdout: -6442> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=97) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5814 pv6006 ap=98 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=98) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=97) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.912 INFO:teuthology.orchestra.run.smithi045.stdout: -6441> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=98) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5814 pv6006 ap=98 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=98) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=96) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.912 INFO:teuthology.orchestra.run.smithi045.stdout: -6440> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000057c [2,head] /dc-dir/dc-file_903 auth v5808 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.234211+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d738000] 2023-10-03T19:21:01.912 INFO:teuthology.orchestra.run.smithi045.stdout: -6439> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000057c [2,head] /dc-dir/dc-file_903 auth v5808 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.234211+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d738000] 2023-10-03T19:21:01.912 INFO:teuthology.orchestra.run.smithi045.stdout: -6438> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.912 INFO:teuthology.orchestra.run.smithi045.stdout: -6437> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.912 INFO:teuthology.orchestra.run.smithi045.stdout: -6436> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.912 INFO:teuthology.orchestra.run.smithi045.stdout: -6435> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000057c [2,head] /dc-dir/dc-file_903 auth v5808 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.234211+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d738000] 2023-10-03T19:21:01.913 INFO:teuthology.orchestra.run.smithi045.stdout: -6434> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000057c [2,head] /dc-dir/dc-file_903 auth v5808 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.234211+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d738000] 2023-10-03T19:21:01.913 INFO:teuthology.orchestra.run.smithi045.stdout: -6433> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.913 INFO:teuthology.orchestra.run.smithi045.stdout: -6432> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 317.449, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.17e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:637.9] 2023-10-03T19:21:01.913 INFO:teuthology.orchestra.run.smithi045.stdout: -6431> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d5c78c0 on [dir 0x1 / [2,head] auth pv=6007 v=5815 cv=5559/5559 REP dir_auth=0 ap=96+98 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 96 2023-10-03T19:21:01.913 INFO:teuthology.orchestra.run.smithi045.stdout: -6430> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d5c78c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5814 pv6006 ap=97 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=97) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=96) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 97 2023-10-03T19:21:01.913 INFO:teuthology.orchestra.run.smithi045.stdout: -6429> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5815 cv=5559/5559 REP dir_auth=0 ap=96+97 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d5c78c0 count now 96/97 2023-10-03T19:21:01.913 INFO:teuthology.orchestra.run.smithi045.stdout: -6428> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d5c78c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5809 cv=5553/5553 ap=97+97 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=128 | child=1 dirty=1 authpin=1 0x55576d056400] count now 97 2023-10-03T19:21:01.913 INFO:teuthology.orchestra.run.smithi045.stdout: -6427> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000057c) auth_unpin by 0x55576d5c78c0 on [inode 0x1000000057c [2,head] /dc-dir/dc-file_903 auth v5808 s=3 n(v0 rc2023-10-03T19:16:12.234211+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d738000] now 0 2023-10-03T19:21:01.913 INFO:teuthology.orchestra.run.smithi045.stdout: -6426> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5809 cv=5553/5553 ap=97+96 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=128 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d5c78c0 count now 97/96 2023-10-03T19:21:01.913 INFO:teuthology.orchestra.run.smithi045.stdout: -6425> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.914 INFO:teuthology.orchestra.run.smithi045.stdout: -6424> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.914 INFO:teuthology.orchestra.run.smithi045.stdout: -6423> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000057d [2,head] /dc-dir/dc-file_904 auth v4558 pv5810 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.245637+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.245637+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d738580] 2023-10-03T19:21:01.914 INFO:teuthology.orchestra.run.smithi045.stdout: -6422> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5816 2023-10-03T19:21:01.914 INFO:teuthology.orchestra.run.smithi045.stdout: -6421> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5816 pv6006 ap=97 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=97) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=96) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.914 INFO:teuthology.orchestra.run.smithi045.stdout: -6420> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5814 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.914 INFO:teuthology.orchestra.run.smithi045.stdout: -6419> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5815 cv=5559/5559 REP dir_auth=0 ap=96+97 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5815 2023-10-03T19:21:01.914 INFO:teuthology.orchestra.run.smithi045.stdout: -6418> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000057d) pop_and_dirty_projected_inode v5810 2023-10-03T19:21:01.914 INFO:teuthology.orchestra.run.smithi045.stdout: -6417> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000057d) mark_dirty [inode 0x1000000057d [2,head] /dc-dir/dc-file_904 auth v5810 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.245637+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d738580] 2023-10-03T19:21:01.914 INFO:teuthology.orchestra.run.smithi045.stdout: -6416> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_904) mark_dirty [dentry #0x1/dc-dir/dc-file_904 [2,head] auth (dversion lock) pv=5810 v=4558 ino=0x1000000057d state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d736c80] 2023-10-03T19:21:01.914 INFO:teuthology.orchestra.run.smithi045.stdout: -6415> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5809 cv=5553/5553 ap=97+96 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=129 | child=1 dirty=1 authpin=1 0x55576d056400] version 5809 2023-10-03T19:21:01.915 INFO:teuthology.orchestra.run.smithi045.stdout: -6414> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d1b2b60 v5817 2023-10-03T19:21:01.915 INFO:teuthology.orchestra.run.smithi045.stdout: -6413> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5817 cv=5559/5559 REP dir_auth=0 ap=96+97 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5817 2023-10-03T19:21:01.915 INFO:teuthology.orchestra.run.smithi045.stdout: -6412> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576cf498e0 v5811 2023-10-03T19:21:01.915 INFO:teuthology.orchestra.run.smithi045.stdout: -6411> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5811 cv=5553/5553 ap=97+96 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=129 | child=1 dirty=1 authpin=1 0x55576d056400] version 5811 2023-10-03T19:21:01.915 INFO:teuthology.orchestra.run.smithi045.stdout: -6410> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=96 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=96 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.915 INFO:teuthology.orchestra.run.smithi045.stdout: -6409> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=96) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5816 pv6006 ap=97 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=97) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=96) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.915 INFO:teuthology.orchestra.run.smithi045.stdout: -6408> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=97) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5816 pv6006 ap=97 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=97) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=95) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.915 INFO:teuthology.orchestra.run.smithi045.stdout: -6407> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000057d [2,head] /dc-dir/dc-file_904 auth v5810 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.245637+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d738580] 2023-10-03T19:21:01.915 INFO:teuthology.orchestra.run.smithi045.stdout: -6406> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000057d [2,head] /dc-dir/dc-file_904 auth v5810 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.245637+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d738580] 2023-10-03T19:21:01.915 INFO:teuthology.orchestra.run.smithi045.stdout: -6405> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.916 INFO:teuthology.orchestra.run.smithi045.stdout: -6404> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.943 INFO:teuthology.orchestra.run.smithi045.stdout: -6403> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.944 INFO:teuthology.orchestra.run.smithi045.stdout: -6402> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000057d [2,head] /dc-dir/dc-file_904 auth v5810 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.245637+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d738580] 2023-10-03T19:21:01.944 INFO:teuthology.orchestra.run.smithi045.stdout: -6401> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000057d [2,head] /dc-dir/dc-file_904 auth v5810 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.245637+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d738580] 2023-10-03T19:21:01.944 INFO:teuthology.orchestra.run.smithi045.stdout: -6400> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.944 INFO:teuthology.orchestra.run.smithi045.stdout: -6399> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 318.449, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.18e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:639.9] 2023-10-03T19:21:01.944 INFO:teuthology.orchestra.run.smithi045.stdout: -6398> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2b2d80 on [dir 0x1 / [2,head] auth pv=6007 v=5817 cv=5559/5559 REP dir_auth=0 ap=95+97 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 95 2023-10-03T19:21:01.944 INFO:teuthology.orchestra.run.smithi045.stdout: -6397> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2b2d80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5816 pv6006 ap=96 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=96) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=95) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 96 2023-10-03T19:21:01.944 INFO:teuthology.orchestra.run.smithi045.stdout: -6396> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5817 cv=5559/5559 REP dir_auth=0 ap=95+96 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2b2d80 count now 95/96 2023-10-03T19:21:01.944 INFO:teuthology.orchestra.run.smithi045.stdout: -6395> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2b2d80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5811 cv=5553/5553 ap=96+96 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=129 | child=1 dirty=1 authpin=1 0x55576d056400] count now 96 2023-10-03T19:21:01.944 INFO:teuthology.orchestra.run.smithi045.stdout: -6394> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000057d) auth_unpin by 0x55576d2b2d80 on [inode 0x1000000057d [2,head] /dc-dir/dc-file_904 auth v5810 s=3 n(v0 rc2023-10-03T19:16:12.245637+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d738580] now 0 2023-10-03T19:21:01.944 INFO:teuthology.orchestra.run.smithi045.stdout: -6393> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5811 cv=5553/5553 ap=96+95 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=129 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2b2d80 count now 96/95 2023-10-03T19:21:01.945 INFO:teuthology.orchestra.run.smithi045.stdout: -6392> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.945 INFO:teuthology.orchestra.run.smithi045.stdout: -6391> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.945 INFO:teuthology.orchestra.run.smithi045.stdout: -6390> 2023-10-03T19:16:28.786+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000057e [2,head] /dc-dir/dc-file_905 auth v4562 pv5812 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.256429+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.256429+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d738b00] 2023-10-03T19:21:01.945 INFO:teuthology.orchestra.run.smithi045.stdout: -6389> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5818 2023-10-03T19:21:01.945 INFO:teuthology.orchestra.run.smithi045.stdout: -6388> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5818 pv6006 ap=96 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=96) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=95) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.945 INFO:teuthology.orchestra.run.smithi045.stdout: -6387> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5816 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.945 INFO:teuthology.orchestra.run.smithi045.stdout: -6386> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5817 cv=5559/5559 REP dir_auth=0 ap=95+96 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5817 2023-10-03T19:21:01.945 INFO:teuthology.orchestra.run.smithi045.stdout: -6385> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000057e) pop_and_dirty_projected_inode v5812 2023-10-03T19:21:01.945 INFO:teuthology.orchestra.run.smithi045.stdout: -6384> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000057e) mark_dirty [inode 0x1000000057e [2,head] /dc-dir/dc-file_905 auth v5812 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.256429+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d738b00] 2023-10-03T19:21:01.946 INFO:teuthology.orchestra.run.smithi045.stdout: -6383> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_905) mark_dirty [dentry #0x1/dc-dir/dc-file_905 [2,head] auth (dversion lock) pv=5812 v=4562 ino=0x1000000057e state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d736f00] 2023-10-03T19:21:01.946 INFO:teuthology.orchestra.run.smithi045.stdout: -6382> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5811 cv=5553/5553 ap=96+95 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=130 | child=1 dirty=1 authpin=1 0x55576d056400] version 5811 2023-10-03T19:21:01.946 INFO:teuthology.orchestra.run.smithi045.stdout: -6381> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d1b2920 v5819 2023-10-03T19:21:01.946 INFO:teuthology.orchestra.run.smithi045.stdout: -6380> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5819 cv=5559/5559 REP dir_auth=0 ap=95+96 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5819 2023-10-03T19:21:01.946 INFO:teuthology.orchestra.run.smithi045.stdout: -6379> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576cf49a00 v5813 2023-10-03T19:21:01.946 INFO:teuthology.orchestra.run.smithi045.stdout: -6378> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5813 cv=5553/5553 ap=96+95 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=130 | child=1 dirty=1 authpin=1 0x55576d056400] version 5813 2023-10-03T19:21:01.946 INFO:teuthology.orchestra.run.smithi045.stdout: -6377> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=95 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=95 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.946 INFO:teuthology.orchestra.run.smithi045.stdout: -6376> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=95) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5818 pv6006 ap=96 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=96) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=95) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.946 INFO:teuthology.orchestra.run.smithi045.stdout: -6375> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=96) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5818 pv6006 ap=96 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=96) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=94) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.946 INFO:teuthology.orchestra.run.smithi045.stdout: -6374> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000057e [2,head] /dc-dir/dc-file_905 auth v5812 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.256429+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d738b00] 2023-10-03T19:21:01.947 INFO:teuthology.orchestra.run.smithi045.stdout: -6373> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000057e [2,head] /dc-dir/dc-file_905 auth v5812 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.256429+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d738b00] 2023-10-03T19:21:01.947 INFO:teuthology.orchestra.run.smithi045.stdout: -6372> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.947 INFO:teuthology.orchestra.run.smithi045.stdout: -6371> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.947 INFO:teuthology.orchestra.run.smithi045.stdout: -6370> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.947 INFO:teuthology.orchestra.run.smithi045.stdout: -6369> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000057e [2,head] /dc-dir/dc-file_905 auth v5812 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.256429+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d738b00] 2023-10-03T19:21:01.947 INFO:teuthology.orchestra.run.smithi045.stdout: -6368> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000057e [2,head] /dc-dir/dc-file_905 auth v5812 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.256429+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d738b00] 2023-10-03T19:21:01.947 INFO:teuthology.orchestra.run.smithi045.stdout: -6367> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.947 INFO:teuthology.orchestra.run.smithi045.stdout: -6366> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 319.273, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.19e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:641.5] 2023-10-03T19:21:01.947 INFO:teuthology.orchestra.run.smithi045.stdout: -6365> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d3ddb00 on [dir 0x1 / [2,head] auth pv=6007 v=5819 cv=5559/5559 REP dir_auth=0 ap=94+96 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 94 2023-10-03T19:21:01.947 INFO:teuthology.orchestra.run.smithi045.stdout: -6364> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d3ddb00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5818 pv6006 ap=95 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=95) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=94) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 95 2023-10-03T19:21:01.948 INFO:teuthology.orchestra.run.smithi045.stdout: -6363> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5819 cv=5559/5559 REP dir_auth=0 ap=94+95 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d3ddb00 count now 94/95 2023-10-03T19:21:01.948 INFO:teuthology.orchestra.run.smithi045.stdout: -6362> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d3ddb00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5813 cv=5553/5553 ap=95+95 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=130 | child=1 dirty=1 authpin=1 0x55576d056400] count now 95 2023-10-03T19:21:01.948 INFO:teuthology.orchestra.run.smithi045.stdout: -6361> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000057e) auth_unpin by 0x55576d3ddb00 on [inode 0x1000000057e [2,head] /dc-dir/dc-file_905 auth v5812 s=3 n(v0 rc2023-10-03T19:16:12.256429+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d738b00] now 0 2023-10-03T19:21:01.948 INFO:teuthology.orchestra.run.smithi045.stdout: -6360> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5813 cv=5553/5553 ap=95+94 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=130 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d3ddb00 count now 95/94 2023-10-03T19:21:01.948 INFO:teuthology.orchestra.run.smithi045.stdout: -6359> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.948 INFO:teuthology.orchestra.run.smithi045.stdout: -6358> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.948 INFO:teuthology.orchestra.run.smithi045.stdout: -6357> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000057f [2,head] /dc-dir/dc-file_906 auth v4566 pv5814 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.268662+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.268662+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d739080] 2023-10-03T19:21:01.948 INFO:teuthology.orchestra.run.smithi045.stdout: -6356> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5820 2023-10-03T19:21:01.948 INFO:teuthology.orchestra.run.smithi045.stdout: -6355> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5820 pv6006 ap=95 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=95) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=94) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.948 INFO:teuthology.orchestra.run.smithi045.stdout: -6354> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5818 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.948 INFO:teuthology.orchestra.run.smithi045.stdout: -6353> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5819 cv=5559/5559 REP dir_auth=0 ap=94+95 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5819 2023-10-03T19:21:01.949 INFO:teuthology.orchestra.run.smithi045.stdout: -6352> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000057f) pop_and_dirty_projected_inode v5814 2023-10-03T19:21:01.949 INFO:teuthology.orchestra.run.smithi045.stdout: -6351> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000057f) mark_dirty [inode 0x1000000057f [2,head] /dc-dir/dc-file_906 auth v5814 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.268662+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d739080] 2023-10-03T19:21:01.949 INFO:teuthology.orchestra.run.smithi045.stdout: -6350> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_906) mark_dirty [dentry #0x1/dc-dir/dc-file_906 [2,head] auth (dversion lock) pv=5814 v=4566 ino=0x1000000057f state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d737180] 2023-10-03T19:21:01.949 INFO:teuthology.orchestra.run.smithi045.stdout: -6349> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5813 cv=5553/5553 ap=95+94 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=131 | child=1 dirty=1 authpin=1 0x55576d056400] version 5813 2023-10-03T19:21:01.949 INFO:teuthology.orchestra.run.smithi045.stdout: -6348> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d1b26e0 v5821 2023-10-03T19:21:01.949 INFO:teuthology.orchestra.run.smithi045.stdout: -6347> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5821 cv=5559/5559 REP dir_auth=0 ap=94+95 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5821 2023-10-03T19:21:01.949 INFO:teuthology.orchestra.run.smithi045.stdout: -6346> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576cf49d60 v5815 2023-10-03T19:21:01.949 INFO:teuthology.orchestra.run.smithi045.stdout: -6345> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5815 cv=5553/5553 ap=95+94 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=131 | child=1 dirty=1 authpin=1 0x55576d056400] version 5815 2023-10-03T19:21:01.949 INFO:teuthology.orchestra.run.smithi045.stdout: -6344> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=94 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=94 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.950 INFO:teuthology.orchestra.run.smithi045.stdout: -6343> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=94) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5820 pv6006 ap=95 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=95) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=94) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.950 INFO:teuthology.orchestra.run.smithi045.stdout: -6342> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=95) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5820 pv6006 ap=95 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=95) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=93) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.950 INFO:teuthology.orchestra.run.smithi045.stdout: -6341> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000057f [2,head] /dc-dir/dc-file_906 auth v5814 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.268662+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d739080] 2023-10-03T19:21:01.950 INFO:teuthology.orchestra.run.smithi045.stdout: -6340> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000057f [2,head] /dc-dir/dc-file_906 auth v5814 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.268662+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d739080] 2023-10-03T19:21:01.950 INFO:teuthology.orchestra.run.smithi045.stdout: -6339> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.950 INFO:teuthology.orchestra.run.smithi045.stdout: -6338> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.950 INFO:teuthology.orchestra.run.smithi045.stdout: -6337> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.950 INFO:teuthology.orchestra.run.smithi045.stdout: -6336> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000057f [2,head] /dc-dir/dc-file_906 auth v5814 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.268662+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d739080] 2023-10-03T19:21:01.950 INFO:teuthology.orchestra.run.smithi045.stdout: -6335> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000057f [2,head] /dc-dir/dc-file_906 auth v5814 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.268662+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d739080] 2023-10-03T19:21:01.950 INFO:teuthology.orchestra.run.smithi045.stdout: -6334> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.951 INFO:teuthology.orchestra.run.smithi045.stdout: -6333> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 320.273, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.20e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:643.5] 2023-10-03T19:21:01.951 INFO:teuthology.orchestra.run.smithi045.stdout: -6332> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d3dcfc0 on [dir 0x1 / [2,head] auth pv=6007 v=5821 cv=5559/5559 REP dir_auth=0 ap=93+95 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 93 2023-10-03T19:21:01.951 INFO:teuthology.orchestra.run.smithi045.stdout: -6331> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d3dcfc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5820 pv6006 ap=94 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=94) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=93) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 94 2023-10-03T19:21:01.951 INFO:teuthology.orchestra.run.smithi045.stdout: -6330> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5821 cv=5559/5559 REP dir_auth=0 ap=93+94 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d3dcfc0 count now 93/94 2023-10-03T19:21:01.951 INFO:teuthology.orchestra.run.smithi045.stdout: -6329> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d3dcfc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5815 cv=5553/5553 ap=94+94 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=131 | child=1 dirty=1 authpin=1 0x55576d056400] count now 94 2023-10-03T19:21:01.951 INFO:teuthology.orchestra.run.smithi045.stdout: -6328> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000057f) auth_unpin by 0x55576d3dcfc0 on [inode 0x1000000057f [2,head] /dc-dir/dc-file_906 auth v5814 s=3 n(v0 rc2023-10-03T19:16:12.268662+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d739080] now 0 2023-10-03T19:21:01.951 INFO:teuthology.orchestra.run.smithi045.stdout: -6327> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5815 cv=5553/5553 ap=94+93 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=131 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d3dcfc0 count now 94/93 2023-10-03T19:21:01.951 INFO:teuthology.orchestra.run.smithi045.stdout: -6326> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.951 INFO:teuthology.orchestra.run.smithi045.stdout: -6325> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.951 INFO:teuthology.orchestra.run.smithi045.stdout: -6324> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000580 [2,head] /dc-dir/dc-file_907 auth v4570 pv5816 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.280678+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.280678+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d739600] 2023-10-03T19:21:01.951 INFO:teuthology.orchestra.run.smithi045.stdout: -6323> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5822 2023-10-03T19:21:01.952 INFO:teuthology.orchestra.run.smithi045.stdout: -6322> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5822 pv6006 ap=94 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=94) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=93) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.952 INFO:teuthology.orchestra.run.smithi045.stdout: -6321> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5820 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.952 INFO:teuthology.orchestra.run.smithi045.stdout: -6320> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5821 cv=5559/5559 REP dir_auth=0 ap=93+94 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5821 2023-10-03T19:21:01.952 INFO:teuthology.orchestra.run.smithi045.stdout: -6319> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000580) pop_and_dirty_projected_inode v5816 2023-10-03T19:21:01.952 INFO:teuthology.orchestra.run.smithi045.stdout: -6318> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000580) mark_dirty [inode 0x10000000580 [2,head] /dc-dir/dc-file_907 auth v5816 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.280678+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d739600] 2023-10-03T19:21:01.952 INFO:teuthology.orchestra.run.smithi045.stdout: -6317> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_907) mark_dirty [dentry #0x1/dc-dir/dc-file_907 [2,head] auth (dversion lock) pv=5816 v=4570 ino=0x10000000580 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d737400] 2023-10-03T19:21:01.952 INFO:teuthology.orchestra.run.smithi045.stdout: -6316> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5815 cv=5553/5553 ap=94+93 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=132 | child=1 dirty=1 authpin=1 0x55576d056400] version 5815 2023-10-03T19:21:01.952 INFO:teuthology.orchestra.run.smithi045.stdout: -6315> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d1b24a0 v5823 2023-10-03T19:21:01.952 INFO:teuthology.orchestra.run.smithi045.stdout: -6314> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5823 cv=5559/5559 REP dir_auth=0 ap=93+94 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5823 2023-10-03T19:21:01.952 INFO:teuthology.orchestra.run.smithi045.stdout: -6313> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576cf49c40 v5817 2023-10-03T19:21:01.953 INFO:teuthology.orchestra.run.smithi045.stdout: -6312> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5817 cv=5553/5553 ap=94+93 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=132 | child=1 dirty=1 authpin=1 0x55576d056400] version 5817 2023-10-03T19:21:01.953 INFO:teuthology.orchestra.run.smithi045.stdout: -6311> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=93 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=93 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.953 INFO:teuthology.orchestra.run.smithi045.stdout: -6310> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=93) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5822 pv6006 ap=94 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=94) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=93) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.953 INFO:teuthology.orchestra.run.smithi045.stdout: -6309> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=94) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5822 pv6006 ap=94 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=94) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=92) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.953 INFO:teuthology.orchestra.run.smithi045.stdout: -6308> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000580 [2,head] /dc-dir/dc-file_907 auth v5816 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.280678+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d739600] 2023-10-03T19:21:01.953 INFO:teuthology.orchestra.run.smithi045.stdout: -6307> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000580 [2,head] /dc-dir/dc-file_907 auth v5816 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.280678+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d739600] 2023-10-03T19:21:01.953 INFO:teuthology.orchestra.run.smithi045.stdout: -6306> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.953 INFO:teuthology.orchestra.run.smithi045.stdout: -6305> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.953 INFO:teuthology.orchestra.run.smithi045.stdout: -6304> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.953 INFO:teuthology.orchestra.run.smithi045.stdout: -6303> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000580 [2,head] /dc-dir/dc-file_907 auth v5816 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.280678+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d739600] 2023-10-03T19:21:01.954 INFO:teuthology.orchestra.run.smithi045.stdout: -6302> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000580 [2,head] /dc-dir/dc-file_907 auth v5816 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.280678+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d739600] 2023-10-03T19:21:01.954 INFO:teuthology.orchestra.run.smithi045.stdout: -6301> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.954 INFO:teuthology.orchestra.run.smithi045.stdout: -6300> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 321.273, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.21e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:645.5] 2023-10-03T19:21:01.954 INFO:teuthology.orchestra.run.smithi045.stdout: -6299> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d828b40 on [dir 0x1 / [2,head] auth pv=6007 v=5823 cv=5559/5559 REP dir_auth=0 ap=92+94 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 92 2023-10-03T19:21:01.954 INFO:teuthology.orchestra.run.smithi045.stdout: -6298> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d828b40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5822 pv6006 ap=93 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=93) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=92) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 93 2023-10-03T19:21:01.954 INFO:teuthology.orchestra.run.smithi045.stdout: -6297> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5823 cv=5559/5559 REP dir_auth=0 ap=92+93 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d828b40 count now 92/93 2023-10-03T19:21:01.954 INFO:teuthology.orchestra.run.smithi045.stdout: -6296> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d828b40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5817 cv=5553/5553 ap=93+93 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=132 | child=1 dirty=1 authpin=1 0x55576d056400] count now 93 2023-10-03T19:21:01.954 INFO:teuthology.orchestra.run.smithi045.stdout: -6295> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000580) auth_unpin by 0x55576d828b40 on [inode 0x10000000580 [2,head] /dc-dir/dc-file_907 auth v5816 s=3 n(v0 rc2023-10-03T19:16:12.280678+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d739600] now 0 2023-10-03T19:21:01.954 INFO:teuthology.orchestra.run.smithi045.stdout: -6294> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5817 cv=5553/5553 ap=93+92 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=132 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d828b40 count now 93/92 2023-10-03T19:21:01.954 INFO:teuthology.orchestra.run.smithi045.stdout: -6293> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.955 INFO:teuthology.orchestra.run.smithi045.stdout: -6292> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.955 INFO:teuthology.orchestra.run.smithi045.stdout: -6291> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000581 [2,head] /dc-dir/dc-file_908 auth v4574 pv5818 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.293015+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.293015+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d739b80] 2023-10-03T19:21:01.955 INFO:teuthology.orchestra.run.smithi045.stdout: -6290> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5824 2023-10-03T19:21:01.955 INFO:teuthology.orchestra.run.smithi045.stdout: -6289> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5824 pv6006 ap=93 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=93) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=92) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.955 INFO:teuthology.orchestra.run.smithi045.stdout: -6288> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5822 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.987 INFO:teuthology.orchestra.run.smithi045.stdout: -6287> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5823 cv=5559/5559 REP dir_auth=0 ap=92+93 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5823 2023-10-03T19:21:01.987 INFO:teuthology.orchestra.run.smithi045.stdout: -6286> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000581) pop_and_dirty_projected_inode v5818 2023-10-03T19:21:01.987 INFO:teuthology.orchestra.run.smithi045.stdout: -6285> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000581) mark_dirty [inode 0x10000000581 [2,head] /dc-dir/dc-file_908 auth v5818 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.293015+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d739b80] 2023-10-03T19:21:01.987 INFO:teuthology.orchestra.run.smithi045.stdout: -6284> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_908) mark_dirty [dentry #0x1/dc-dir/dc-file_908 [2,head] auth (dversion lock) pv=5818 v=4574 ino=0x10000000581 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d737680] 2023-10-03T19:21:01.987 INFO:teuthology.orchestra.run.smithi045.stdout: -6283> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5817 cv=5553/5553 ap=93+92 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=133 | child=1 dirty=1 authpin=1 0x55576d056400] version 5817 2023-10-03T19:21:01.987 INFO:teuthology.orchestra.run.smithi045.stdout: -6282> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d1b2260 v5825 2023-10-03T19:21:01.987 INFO:teuthology.orchestra.run.smithi045.stdout: -6281> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5825 cv=5559/5559 REP dir_auth=0 ap=92+93 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5825 2023-10-03T19:21:01.987 INFO:teuthology.orchestra.run.smithi045.stdout: -6280> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d4a8020 v5819 2023-10-03T19:21:01.987 INFO:teuthology.orchestra.run.smithi045.stdout: -6279> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5819 cv=5553/5553 ap=93+92 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=133 | child=1 dirty=1 authpin=1 0x55576d056400] version 5819 2023-10-03T19:21:01.988 INFO:teuthology.orchestra.run.smithi045.stdout: -6278> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=92 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=92 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.988 INFO:teuthology.orchestra.run.smithi045.stdout: -6277> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=92) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5824 pv6006 ap=93 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=93) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=92) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.988 INFO:teuthology.orchestra.run.smithi045.stdout: -6276> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=93) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5824 pv6006 ap=93 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=93) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=91) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.988 INFO:teuthology.orchestra.run.smithi045.stdout: -6275> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000581 [2,head] /dc-dir/dc-file_908 auth v5818 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.293015+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d739b80] 2023-10-03T19:21:01.988 INFO:teuthology.orchestra.run.smithi045.stdout: -6274> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000581 [2,head] /dc-dir/dc-file_908 auth v5818 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.293015+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d739b80] 2023-10-03T19:21:01.988 INFO:teuthology.orchestra.run.smithi045.stdout: -6273> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.988 INFO:teuthology.orchestra.run.smithi045.stdout: -6272> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.988 INFO:teuthology.orchestra.run.smithi045.stdout: -6271> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.988 INFO:teuthology.orchestra.run.smithi045.stdout: -6270> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000581 [2,head] /dc-dir/dc-file_908 auth v5818 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.293015+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d739b80] 2023-10-03T19:21:01.988 INFO:teuthology.orchestra.run.smithi045.stdout: -6269> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000581 [2,head] /dc-dir/dc-file_908 auth v5818 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.293015+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d739b80] 2023-10-03T19:21:01.988 INFO:teuthology.orchestra.run.smithi045.stdout: -6268> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.989 INFO:teuthology.orchestra.run.smithi045.stdout: -6267> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 322.273, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.22e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:647.5] 2023-10-03T19:21:01.989 INFO:teuthology.orchestra.run.smithi045.stdout: -6266> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d828fc0 on [dir 0x1 / [2,head] auth pv=6007 v=5825 cv=5559/5559 REP dir_auth=0 ap=91+93 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 91 2023-10-03T19:21:01.989 INFO:teuthology.orchestra.run.smithi045.stdout: -6265> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d828fc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5824 pv6006 ap=92 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=92) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=91) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 92 2023-10-03T19:21:01.989 INFO:teuthology.orchestra.run.smithi045.stdout: -6264> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5825 cv=5559/5559 REP dir_auth=0 ap=91+92 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d828fc0 count now 91/92 2023-10-03T19:21:01.989 INFO:teuthology.orchestra.run.smithi045.stdout: -6263> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d828fc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5819 cv=5553/5553 ap=92+92 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=133 | child=1 dirty=1 authpin=1 0x55576d056400] count now 92 2023-10-03T19:21:01.989 INFO:teuthology.orchestra.run.smithi045.stdout: -6262> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000581) auth_unpin by 0x55576d828fc0 on [inode 0x10000000581 [2,head] /dc-dir/dc-file_908 auth v5818 s=3 n(v0 rc2023-10-03T19:16:12.293015+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d739b80] now 0 2023-10-03T19:21:01.989 INFO:teuthology.orchestra.run.smithi045.stdout: -6261> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5819 cv=5553/5553 ap=92+91 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=133 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d828fc0 count now 92/91 2023-10-03T19:21:01.989 INFO:teuthology.orchestra.run.smithi045.stdout: -6260> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.989 INFO:teuthology.orchestra.run.smithi045.stdout: -6259> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.989 INFO:teuthology.orchestra.run.smithi045.stdout: -6258> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000582 [2,head] /dc-dir/dc-file_909 auth v4578 pv5820 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.304411+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.304411+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d73a100] 2023-10-03T19:21:01.989 INFO:teuthology.orchestra.run.smithi045.stdout: -6257> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5826 2023-10-03T19:21:01.990 INFO:teuthology.orchestra.run.smithi045.stdout: -6256> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5826 pv6006 ap=92 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=92) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=91) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.990 INFO:teuthology.orchestra.run.smithi045.stdout: -6255> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5824 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:01.990 INFO:teuthology.orchestra.run.smithi045.stdout: -6254> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5825 cv=5559/5559 REP dir_auth=0 ap=91+92 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5825 2023-10-03T19:21:01.990 INFO:teuthology.orchestra.run.smithi045.stdout: -6253> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000582) pop_and_dirty_projected_inode v5820 2023-10-03T19:21:01.990 INFO:teuthology.orchestra.run.smithi045.stdout: -6252> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000582) mark_dirty [inode 0x10000000582 [2,head] /dc-dir/dc-file_909 auth v5820 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.304411+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d73a100] 2023-10-03T19:21:01.990 INFO:teuthology.orchestra.run.smithi045.stdout: -6251> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_909) mark_dirty [dentry #0x1/dc-dir/dc-file_909 [2,head] auth (dversion lock) pv=5820 v=4578 ino=0x10000000582 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d737900] 2023-10-03T19:21:01.990 INFO:teuthology.orchestra.run.smithi045.stdout: -6250> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5819 cv=5553/5553 ap=92+91 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=134 | child=1 dirty=1 authpin=1 0x55576d056400] version 5819 2023-10-03T19:21:01.990 INFO:teuthology.orchestra.run.smithi045.stdout: -6249> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d1b2020 v5827 2023-10-03T19:21:01.990 INFO:teuthology.orchestra.run.smithi045.stdout: -6248> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5827 cv=5559/5559 REP dir_auth=0 ap=91+92 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5827 2023-10-03T19:21:01.997 INFO:teuthology.orchestra.run.smithi045.stdout: -6247> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d4a8260 v5821 2023-10-03T19:21:01.997 INFO:teuthology.orchestra.run.smithi045.stdout: -6246> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5821 cv=5553/5553 ap=92+91 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=134 | child=1 dirty=1 authpin=1 0x55576d056400] version 5821 2023-10-03T19:21:01.997 INFO:teuthology.orchestra.run.smithi045.stdout: -6245> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=91 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=91 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:01.997 INFO:teuthology.orchestra.run.smithi045.stdout: -6244> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=91) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5826 pv6006 ap=92 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=92) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=91) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.997 INFO:teuthology.orchestra.run.smithi045.stdout: -6243> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=92) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5826 pv6006 ap=92 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=92) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=90) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.998 INFO:teuthology.orchestra.run.smithi045.stdout: -6242> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000582 [2,head] /dc-dir/dc-file_909 auth v5820 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.304411+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d73a100] 2023-10-03T19:21:01.998 INFO:teuthology.orchestra.run.smithi045.stdout: -6241> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000582 [2,head] /dc-dir/dc-file_909 auth v5820 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.304411+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d73a100] 2023-10-03T19:21:01.998 INFO:teuthology.orchestra.run.smithi045.stdout: -6240> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:01.998 INFO:teuthology.orchestra.run.smithi045.stdout: -6239> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:01.998 INFO:teuthology.orchestra.run.smithi045.stdout: -6238> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:01.998 INFO:teuthology.orchestra.run.smithi045.stdout: -6237> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000582 [2,head] /dc-dir/dc-file_909 auth v5820 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.304411+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d73a100] 2023-10-03T19:21:01.998 INFO:teuthology.orchestra.run.smithi045.stdout: -6236> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000582 [2,head] /dc-dir/dc-file_909 auth v5820 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.304411+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d73a100] 2023-10-03T19:21:01.998 INFO:teuthology.orchestra.run.smithi045.stdout: -6235> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:01.998 INFO:teuthology.orchestra.run.smithi045.stdout: -6234> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 323.273, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.23e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:649.5] 2023-10-03T19:21:01.998 INFO:teuthology.orchestra.run.smithi045.stdout: -6233> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d829440 on [dir 0x1 / [2,head] auth pv=6007 v=5827 cv=5559/5559 REP dir_auth=0 ap=90+92 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 90 2023-10-03T19:21:01.999 INFO:teuthology.orchestra.run.smithi045.stdout: -6232> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d829440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5826 pv6006 ap=91 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=91) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=90) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 91 2023-10-03T19:21:01.999 INFO:teuthology.orchestra.run.smithi045.stdout: -6231> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5827 cv=5559/5559 REP dir_auth=0 ap=90+91 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d829440 count now 90/91 2023-10-03T19:21:01.999 INFO:teuthology.orchestra.run.smithi045.stdout: -6230> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d829440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5821 cv=5553/5553 ap=91+91 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=134 | child=1 dirty=1 authpin=1 0x55576d056400] count now 91 2023-10-03T19:21:01.999 INFO:teuthology.orchestra.run.smithi045.stdout: -6229> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000582) auth_unpin by 0x55576d829440 on [inode 0x10000000582 [2,head] /dc-dir/dc-file_909 auth v5820 s=3 n(v0 rc2023-10-03T19:16:12.304411+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d73a100] now 0 2023-10-03T19:21:01.999 INFO:teuthology.orchestra.run.smithi045.stdout: -6228> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5821 cv=5553/5553 ap=91+90 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=134 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d829440 count now 91/90 2023-10-03T19:21:01.999 INFO:teuthology.orchestra.run.smithi045.stdout: -6227> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.999 INFO:teuthology.orchestra.run.smithi045.stdout: -6226> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:01.999 INFO:teuthology.orchestra.run.smithi045.stdout: -6225> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000583 [2,head] /dc-dir/dc-file_910 auth v4582 pv5822 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.315558+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.315558+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d73a680] 2023-10-03T19:21:01.999 INFO:teuthology.orchestra.run.smithi045.stdout: -6224> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5828 2023-10-03T19:21:01.999 INFO:teuthology.orchestra.run.smithi045.stdout: -6223> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5828 pv6006 ap=91 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=91) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=90) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:01.999 INFO:teuthology.orchestra.run.smithi045.stdout: -6222> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5826 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.000 INFO:teuthology.orchestra.run.smithi045.stdout: -6221> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5827 cv=5559/5559 REP dir_auth=0 ap=90+91 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5827 2023-10-03T19:21:02.000 INFO:teuthology.orchestra.run.smithi045.stdout: -6220> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000583) pop_and_dirty_projected_inode v5822 2023-10-03T19:21:02.000 INFO:teuthology.orchestra.run.smithi045.stdout: -6219> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000583) mark_dirty [inode 0x10000000583 [2,head] /dc-dir/dc-file_910 auth v5822 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.315558+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d73a680] 2023-10-03T19:21:02.000 INFO:teuthology.orchestra.run.smithi045.stdout: -6218> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_910) mark_dirty [dentry #0x1/dc-dir/dc-file_910 [2,head] auth (dversion lock) pv=5822 v=4582 ino=0x10000000583 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d737b80] 2023-10-03T19:21:02.000 INFO:teuthology.orchestra.run.smithi045.stdout: -6217> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5821 cv=5553/5553 ap=91+90 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=135 | child=1 dirty=1 authpin=1 0x55576d056400] version 5821 2023-10-03T19:21:02.000 INFO:teuthology.orchestra.run.smithi045.stdout: -6216> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576cf49e80 v5829 2023-10-03T19:21:02.000 INFO:teuthology.orchestra.run.smithi045.stdout: -6215> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5829 cv=5559/5559 REP dir_auth=0 ap=90+91 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5829 2023-10-03T19:21:02.000 INFO:teuthology.orchestra.run.smithi045.stdout: -6214> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d4a84a0 v5823 2023-10-03T19:21:02.000 INFO:teuthology.orchestra.run.smithi045.stdout: -6213> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5823 cv=5553/5553 ap=91+90 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=135 | child=1 dirty=1 authpin=1 0x55576d056400] version 5823 2023-10-03T19:21:02.001 INFO:teuthology.orchestra.run.smithi045.stdout: -6212> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=90 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=90 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.001 INFO:teuthology.orchestra.run.smithi045.stdout: -6211> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=90) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5828 pv6006 ap=91 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=91) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=90) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.001 INFO:teuthology.orchestra.run.smithi045.stdout: -6210> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=91) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5828 pv6006 ap=91 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=91) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=89) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.001 INFO:teuthology.orchestra.run.smithi045.stdout: -6209> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000583 [2,head] /dc-dir/dc-file_910 auth v5822 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.315558+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d73a680] 2023-10-03T19:21:02.001 INFO:teuthology.orchestra.run.smithi045.stdout: -6208> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000583 [2,head] /dc-dir/dc-file_910 auth v5822 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.315558+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d73a680] 2023-10-03T19:21:02.001 INFO:teuthology.orchestra.run.smithi045.stdout: -6207> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.002 INFO:teuthology.orchestra.run.smithi045.stdout: -6206> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.002 INFO:teuthology.orchestra.run.smithi045.stdout: -6205> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.002 INFO:teuthology.orchestra.run.smithi045.stdout: -6204> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000583 [2,head] /dc-dir/dc-file_910 auth v5822 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.315558+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d73a680] 2023-10-03T19:21:02.002 INFO:teuthology.orchestra.run.smithi045.stdout: -6203> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000583 [2,head] /dc-dir/dc-file_910 auth v5822 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.315558+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d73a680] 2023-10-03T19:21:02.002 INFO:teuthology.orchestra.run.smithi045.stdout: -6202> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.002 INFO:teuthology.orchestra.run.smithi045.stdout: -6201> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 324.273, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.24e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:651.5] 2023-10-03T19:21:02.002 INFO:teuthology.orchestra.run.smithi045.stdout: -6200> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d8298c0 on [dir 0x1 / [2,head] auth pv=6007 v=5829 cv=5559/5559 REP dir_auth=0 ap=89+91 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 89 2023-10-03T19:21:02.002 INFO:teuthology.orchestra.run.smithi045.stdout: -6199> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d8298c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5828 pv6006 ap=90 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=90) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=89) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 90 2023-10-03T19:21:02.002 INFO:teuthology.orchestra.run.smithi045.stdout: -6198> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5829 cv=5559/5559 REP dir_auth=0 ap=89+90 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d8298c0 count now 89/90 2023-10-03T19:21:02.002 INFO:teuthology.orchestra.run.smithi045.stdout: -6197> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d8298c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5823 cv=5553/5553 ap=90+90 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=135 | child=1 dirty=1 authpin=1 0x55576d056400] count now 90 2023-10-03T19:21:02.002 INFO:teuthology.orchestra.run.smithi045.stdout: -6196> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000583) auth_unpin by 0x55576d8298c0 on [inode 0x10000000583 [2,head] /dc-dir/dc-file_910 auth v5822 s=3 n(v0 rc2023-10-03T19:16:12.315558+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d73a680] now 0 2023-10-03T19:21:02.003 INFO:teuthology.orchestra.run.smithi045.stdout: -6195> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5823 cv=5553/5553 ap=90+89 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=135 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d8298c0 count now 90/89 2023-10-03T19:21:02.003 INFO:teuthology.orchestra.run.smithi045.stdout: -6194> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.003 INFO:teuthology.orchestra.run.smithi045.stdout: -6193> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.003 INFO:teuthology.orchestra.run.smithi045.stdout: -6192> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000584 [2,head] /dc-dir/dc-file_911 auth v4586 pv5824 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.327316+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.327316+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d73ac00] 2023-10-03T19:21:02.003 INFO:teuthology.orchestra.run.smithi045.stdout: -6191> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5830 2023-10-03T19:21:02.003 INFO:teuthology.orchestra.run.smithi045.stdout: -6190> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5830 pv6006 ap=90 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=90) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=89) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.003 INFO:teuthology.orchestra.run.smithi045.stdout: -6189> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5828 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.003 INFO:teuthology.orchestra.run.smithi045.stdout: -6188> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5829 cv=5559/5559 REP dir_auth=0 ap=89+90 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5829 2023-10-03T19:21:02.003 INFO:teuthology.orchestra.run.smithi045.stdout: -6187> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000584) pop_and_dirty_projected_inode v5824 2023-10-03T19:21:02.003 INFO:teuthology.orchestra.run.smithi045.stdout: -6186> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000584) mark_dirty [inode 0x10000000584 [2,head] /dc-dir/dc-file_911 auth v5824 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.327316+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d73ac00] 2023-10-03T19:21:02.004 INFO:teuthology.orchestra.run.smithi045.stdout: -6185> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_911) mark_dirty [dentry #0x1/dc-dir/dc-file_911 [2,head] auth (dversion lock) pv=5824 v=4586 ino=0x10000000584 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d73e000] 2023-10-03T19:21:02.004 INFO:teuthology.orchestra.run.smithi045.stdout: -6184> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5823 cv=5553/5553 ap=90+89 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=136 | child=1 dirty=1 authpin=1 0x55576d056400] version 5823 2023-10-03T19:21:02.004 INFO:teuthology.orchestra.run.smithi045.stdout: -6183> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576cf49100 v5831 2023-10-03T19:21:02.004 INFO:teuthology.orchestra.run.smithi045.stdout: -6182> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5831 cv=5559/5559 REP dir_auth=0 ap=89+90 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5831 2023-10-03T19:21:02.004 INFO:teuthology.orchestra.run.smithi045.stdout: -6181> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d4a86e0 v5825 2023-10-03T19:21:02.004 INFO:teuthology.orchestra.run.smithi045.stdout: -6180> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5825 cv=5553/5553 ap=90+89 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=136 | child=1 dirty=1 authpin=1 0x55576d056400] version 5825 2023-10-03T19:21:02.004 INFO:teuthology.orchestra.run.smithi045.stdout: -6179> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=89 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=89 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.004 INFO:teuthology.orchestra.run.smithi045.stdout: -6178> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=89) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5830 pv6006 ap=90 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=90) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=89) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.004 INFO:teuthology.orchestra.run.smithi045.stdout: -6177> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=90) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5830 pv6006 ap=90 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=90) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=88) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.106 INFO:teuthology.orchestra.run.smithi045.stdout: -6176> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000584 [2,head] /dc-dir/dc-file_911 auth v5824 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.327316+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d73ac00] 2023-10-03T19:21:02.106 INFO:teuthology.orchestra.run.smithi045.stdout: -6175> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000584 [2,head] /dc-dir/dc-file_911 auth v5824 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.327316+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d73ac00] 2023-10-03T19:21:02.106 INFO:teuthology.orchestra.run.smithi045.stdout: -6174> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.106 INFO:teuthology.orchestra.run.smithi045.stdout: -6173> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.106 INFO:teuthology.orchestra.run.smithi045.stdout: -6172> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.106 INFO:teuthology.orchestra.run.smithi045.stdout: -6171> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000584 [2,head] /dc-dir/dc-file_911 auth v5824 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.327316+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d73ac00] 2023-10-03T19:21:02.106 INFO:teuthology.orchestra.run.smithi045.stdout: -6170> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000584 [2,head] /dc-dir/dc-file_911 auth v5824 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.327316+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d73ac00] 2023-10-03T19:21:02.106 INFO:teuthology.orchestra.run.smithi045.stdout: -6169> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.106 INFO:teuthology.orchestra.run.smithi045.stdout: -6168> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 325.273, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.25e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:653.5] 2023-10-03T19:21:02.107 INFO:teuthology.orchestra.run.smithi045.stdout: -6167> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d829d40 on [dir 0x1 / [2,head] auth pv=6007 v=5831 cv=5559/5559 REP dir_auth=0 ap=88+90 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 88 2023-10-03T19:21:02.107 INFO:teuthology.orchestra.run.smithi045.stdout: -6166> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d829d40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5830 pv6006 ap=89 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=89) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=88) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 89 2023-10-03T19:21:02.107 INFO:teuthology.orchestra.run.smithi045.stdout: -6165> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5831 cv=5559/5559 REP dir_auth=0 ap=88+89 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d829d40 count now 88/89 2023-10-03T19:21:02.107 INFO:teuthology.orchestra.run.smithi045.stdout: -6164> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d829d40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5825 cv=5553/5553 ap=89+89 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=136 | child=1 dirty=1 authpin=1 0x55576d056400] count now 89 2023-10-03T19:21:02.107 INFO:teuthology.orchestra.run.smithi045.stdout: -6163> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000584) auth_unpin by 0x55576d829d40 on [inode 0x10000000584 [2,head] /dc-dir/dc-file_911 auth v5824 s=3 n(v0 rc2023-10-03T19:16:12.327316+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d73ac00] now 0 2023-10-03T19:21:02.107 INFO:teuthology.orchestra.run.smithi045.stdout: -6162> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5825 cv=5553/5553 ap=89+88 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=136 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d829d40 count now 89/88 2023-10-03T19:21:02.107 INFO:teuthology.orchestra.run.smithi045.stdout: -6161> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.107 INFO:teuthology.orchestra.run.smithi045.stdout: -6160> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.107 INFO:teuthology.orchestra.run.smithi045.stdout: -6159> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000585 [2,head] /dc-dir/dc-file_912 auth v4590 pv5826 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.338150+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.338150+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d73b180] 2023-10-03T19:21:02.107 INFO:teuthology.orchestra.run.smithi045.stdout: -6158> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5832 2023-10-03T19:21:02.107 INFO:teuthology.orchestra.run.smithi045.stdout: -6157> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5832 pv6006 ap=89 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=89) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=88) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.108 INFO:teuthology.orchestra.run.smithi045.stdout: -6156> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5830 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.108 INFO:teuthology.orchestra.run.smithi045.stdout: -6155> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5831 cv=5559/5559 REP dir_auth=0 ap=88+89 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5831 2023-10-03T19:21:02.108 INFO:teuthology.orchestra.run.smithi045.stdout: -6154> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000585) pop_and_dirty_projected_inode v5826 2023-10-03T19:21:02.108 INFO:teuthology.orchestra.run.smithi045.stdout: -6153> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000585) mark_dirty [inode 0x10000000585 [2,head] /dc-dir/dc-file_912 auth v5826 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.338150+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d73b180] 2023-10-03T19:21:02.108 INFO:teuthology.orchestra.run.smithi045.stdout: -6152> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_912) mark_dirty [dentry #0x1/dc-dir/dc-file_912 [2,head] auth (dversion lock) pv=5826 v=4590 ino=0x10000000585 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d73e280] 2023-10-03T19:21:02.108 INFO:teuthology.orchestra.run.smithi045.stdout: -6151> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5825 cv=5553/5553 ap=89+88 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=137 | child=1 dirty=1 authpin=1 0x55576d056400] version 5825 2023-10-03T19:21:02.108 INFO:teuthology.orchestra.run.smithi045.stdout: -6150> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576cf49580 v5833 2023-10-03T19:21:02.108 INFO:teuthology.orchestra.run.smithi045.stdout: -6149> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5833 cv=5559/5559 REP dir_auth=0 ap=88+89 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5833 2023-10-03T19:21:02.108 INFO:teuthology.orchestra.run.smithi045.stdout: -6148> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d4a8920 v5827 2023-10-03T19:21:02.108 INFO:teuthology.orchestra.run.smithi045.stdout: -6147> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5827 cv=5553/5553 ap=89+88 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=137 | child=1 dirty=1 authpin=1 0x55576d056400] version 5827 2023-10-03T19:21:02.108 INFO:teuthology.orchestra.run.smithi045.stdout: -6146> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=88 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=88 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.109 INFO:teuthology.orchestra.run.smithi045.stdout: -6145> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=88) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5832 pv6006 ap=89 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=89) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=88) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.109 INFO:teuthology.orchestra.run.smithi045.stdout: -6144> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=89) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5832 pv6006 ap=89 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=89) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=87) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.109 INFO:teuthology.orchestra.run.smithi045.stdout: -6143> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000585 [2,head] /dc-dir/dc-file_912 auth v5826 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.338150+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d73b180] 2023-10-03T19:21:02.109 INFO:teuthology.orchestra.run.smithi045.stdout: -6142> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000585 [2,head] /dc-dir/dc-file_912 auth v5826 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.338150+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d73b180] 2023-10-03T19:21:02.109 INFO:teuthology.orchestra.run.smithi045.stdout: -6141> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.109 INFO:teuthology.orchestra.run.smithi045.stdout: -6140> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.109 INFO:teuthology.orchestra.run.smithi045.stdout: -6139> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.109 INFO:teuthology.orchestra.run.smithi045.stdout: -6138> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000585 [2,head] /dc-dir/dc-file_912 auth v5826 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.338150+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d73b180] 2023-10-03T19:21:02.109 INFO:teuthology.orchestra.run.smithi045.stdout: -6137> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000585 [2,head] /dc-dir/dc-file_912 auth v5826 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.338150+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d73b180] 2023-10-03T19:21:02.110 INFO:teuthology.orchestra.run.smithi045.stdout: -6136> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.110 INFO:teuthology.orchestra.run.smithi045.stdout: -6135> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 326.273, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.26e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:655.5] 2023-10-03T19:21:02.110 INFO:teuthology.orchestra.run.smithi045.stdout: -6134> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e31c240 on [dir 0x1 / [2,head] auth pv=6007 v=5833 cv=5559/5559 REP dir_auth=0 ap=87+89 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 87 2023-10-03T19:21:02.110 INFO:teuthology.orchestra.run.smithi045.stdout: -6133> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e31c240 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5827 cv=5553/5553 ap=88+88 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=137 | child=1 dirty=1 authpin=1 0x55576d056400] count now 88 2023-10-03T19:21:02.110 INFO:teuthology.orchestra.run.smithi045.stdout: -6132> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e31c240 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5832 pv6006 ap=88 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=88) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=87) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 88 2023-10-03T19:21:02.110 INFO:teuthology.orchestra.run.smithi045.stdout: -6131> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5833 cv=5559/5559 REP dir_auth=0 ap=87+88 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e31c240 count now 87/88 2023-10-03T19:21:02.110 INFO:teuthology.orchestra.run.smithi045.stdout: -6130> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000585) auth_unpin by 0x55576e31c240 on [inode 0x10000000585 [2,head] /dc-dir/dc-file_912 auth v5826 s=3 n(v0 rc2023-10-03T19:16:12.338150+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d73b180] now 0 2023-10-03T19:21:02.110 INFO:teuthology.orchestra.run.smithi045.stdout: -6129> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5827 cv=5553/5553 ap=88+87 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=137 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e31c240 count now 88/87 2023-10-03T19:21:02.110 INFO:teuthology.orchestra.run.smithi045.stdout: -6128> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.110 INFO:teuthology.orchestra.run.smithi045.stdout: -6127> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.110 INFO:teuthology.orchestra.run.smithi045.stdout: -6126> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000586 [2,head] /dc-dir/dc-file_913 auth v4594 pv5828 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.349543+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.349543+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d73b700] 2023-10-03T19:21:02.111 INFO:teuthology.orchestra.run.smithi045.stdout: -6125> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5834 2023-10-03T19:21:02.111 INFO:teuthology.orchestra.run.smithi045.stdout: -6124> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5834 pv6006 ap=88 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=88) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=87) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.111 INFO:teuthology.orchestra.run.smithi045.stdout: -6123> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5832 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.111 INFO:teuthology.orchestra.run.smithi045.stdout: -6122> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5833 cv=5559/5559 REP dir_auth=0 ap=87+88 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5833 2023-10-03T19:21:02.111 INFO:teuthology.orchestra.run.smithi045.stdout: -6121> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000586) pop_and_dirty_projected_inode v5828 2023-10-03T19:21:02.111 INFO:teuthology.orchestra.run.smithi045.stdout: -6120> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000586) mark_dirty [inode 0x10000000586 [2,head] /dc-dir/dc-file_913 auth v5828 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.349543+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d73b700] 2023-10-03T19:21:02.111 INFO:teuthology.orchestra.run.smithi045.stdout: -6119> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_913) mark_dirty [dentry #0x1/dc-dir/dc-file_913 [2,head] auth (dversion lock) pv=5828 v=4594 ino=0x10000000586 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d73e500] 2023-10-03T19:21:02.111 INFO:teuthology.orchestra.run.smithi045.stdout: -6118> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5827 cv=5553/5553 ap=88+87 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=138 | child=1 dirty=1 authpin=1 0x55576d056400] version 5827 2023-10-03T19:21:02.111 INFO:teuthology.orchestra.run.smithi045.stdout: -6117> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576cf49340 v5835 2023-10-03T19:21:02.111 INFO:teuthology.orchestra.run.smithi045.stdout: -6116> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5835 cv=5559/5559 REP dir_auth=0 ap=87+88 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5835 2023-10-03T19:21:02.111 INFO:teuthology.orchestra.run.smithi045.stdout: -6115> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d4a8b60 v5829 2023-10-03T19:21:02.112 INFO:teuthology.orchestra.run.smithi045.stdout: -6114> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5829 cv=5553/5553 ap=88+87 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=138 | child=1 dirty=1 authpin=1 0x55576d056400] version 5829 2023-10-03T19:21:02.112 INFO:teuthology.orchestra.run.smithi045.stdout: -6113> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=87 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=87 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.112 INFO:teuthology.orchestra.run.smithi045.stdout: -6112> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=87) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5834 pv6006 ap=88 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=88) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=87) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.112 INFO:teuthology.orchestra.run.smithi045.stdout: -6111> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=88) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5834 pv6006 ap=88 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=88) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=86) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.112 INFO:teuthology.orchestra.run.smithi045.stdout: -6110> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000586 [2,head] /dc-dir/dc-file_913 auth v5828 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.349543+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d73b700] 2023-10-03T19:21:02.112 INFO:teuthology.orchestra.run.smithi045.stdout: -6109> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000586 [2,head] /dc-dir/dc-file_913 auth v5828 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.349543+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d73b700] 2023-10-03T19:21:02.112 INFO:teuthology.orchestra.run.smithi045.stdout: -6108> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.112 INFO:teuthology.orchestra.run.smithi045.stdout: -6107> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.112 INFO:teuthology.orchestra.run.smithi045.stdout: -6106> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.112 INFO:teuthology.orchestra.run.smithi045.stdout: -6105> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000586 [2,head] /dc-dir/dc-file_913 auth v5828 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.349543+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d73b700] 2023-10-03T19:21:02.112 INFO:teuthology.orchestra.run.smithi045.stdout: -6104> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000586 [2,head] /dc-dir/dc-file_913 auth v5828 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.349543+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d73b700] 2023-10-03T19:21:02.113 INFO:teuthology.orchestra.run.smithi045.stdout: -6103> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.113 INFO:teuthology.orchestra.run.smithi045.stdout: -6102> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 327.273, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.27e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:657.5] 2023-10-03T19:21:02.113 INFO:teuthology.orchestra.run.smithi045.stdout: -6101> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e31c6c0 on [dir 0x1 / [2,head] auth pv=6007 v=5835 cv=5559/5559 REP dir_auth=0 ap=86+88 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 86 2023-10-03T19:21:02.113 INFO:teuthology.orchestra.run.smithi045.stdout: -6100> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e31c6c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5834 pv6006 ap=87 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=87) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=86) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 87 2023-10-03T19:21:02.113 INFO:teuthology.orchestra.run.smithi045.stdout: -6099> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5835 cv=5559/5559 REP dir_auth=0 ap=86+87 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e31c6c0 count now 86/87 2023-10-03T19:21:02.113 INFO:teuthology.orchestra.run.smithi045.stdout: -6098> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e31c6c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5829 cv=5553/5553 ap=87+87 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=138 | child=1 dirty=1 authpin=1 0x55576d056400] count now 87 2023-10-03T19:21:02.113 INFO:teuthology.orchestra.run.smithi045.stdout: -6097> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000586) auth_unpin by 0x55576e31c6c0 on [inode 0x10000000586 [2,head] /dc-dir/dc-file_913 auth v5828 s=3 n(v0 rc2023-10-03T19:16:12.349543+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d73b700] now 0 2023-10-03T19:21:02.113 INFO:teuthology.orchestra.run.smithi045.stdout: -6096> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5829 cv=5553/5553 ap=87+86 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=138 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e31c6c0 count now 87/86 2023-10-03T19:21:02.113 INFO:teuthology.orchestra.run.smithi045.stdout: -6095> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.113 INFO:teuthology.orchestra.run.smithi045.stdout: -6094> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.113 INFO:teuthology.orchestra.run.smithi045.stdout: -6093> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000587 [2,head] /dc-dir/dc-file_914 auth v4598 pv5830 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.360907+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.360907+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d740000] 2023-10-03T19:21:02.114 INFO:teuthology.orchestra.run.smithi045.stdout: -6092> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5836 2023-10-03T19:21:02.114 INFO:teuthology.orchestra.run.smithi045.stdout: -6091> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5836 pv6006 ap=87 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=87) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=86) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.114 INFO:teuthology.orchestra.run.smithi045.stdout: -6090> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5834 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.114 INFO:teuthology.orchestra.run.smithi045.stdout: -6089> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5835 cv=5559/5559 REP dir_auth=0 ap=86+87 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5835 2023-10-03T19:21:02.114 INFO:teuthology.orchestra.run.smithi045.stdout: -6088> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000587) pop_and_dirty_projected_inode v5830 2023-10-03T19:21:02.114 INFO:teuthology.orchestra.run.smithi045.stdout: -6087> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000587) mark_dirty [inode 0x10000000587 [2,head] /dc-dir/dc-file_914 auth v5830 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.360907+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d740000] 2023-10-03T19:21:02.114 INFO:teuthology.orchestra.run.smithi045.stdout: -6086> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_914) mark_dirty [dentry #0x1/dc-dir/dc-file_914 [2,head] auth (dversion lock) pv=5830 v=4598 ino=0x10000000587 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d73e780] 2023-10-03T19:21:02.114 INFO:teuthology.orchestra.run.smithi045.stdout: -6085> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5829 cv=5553/5553 ap=87+86 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=139 | child=1 dirty=1 authpin=1 0x55576d056400] version 5829 2023-10-03T19:21:02.114 INFO:teuthology.orchestra.run.smithi045.stdout: -6084> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d4a8140 v5837 2023-10-03T19:21:02.114 INFO:teuthology.orchestra.run.smithi045.stdout: -6083> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5837 cv=5559/5559 REP dir_auth=0 ap=86+87 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5837 2023-10-03T19:21:02.115 INFO:teuthology.orchestra.run.smithi045.stdout: -6082> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d4a8da0 v5831 2023-10-03T19:21:02.115 INFO:teuthology.orchestra.run.smithi045.stdout: -6081> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5831 cv=5553/5553 ap=87+86 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=139 | child=1 dirty=1 authpin=1 0x55576d056400] version 5831 2023-10-03T19:21:02.115 INFO:teuthology.orchestra.run.smithi045.stdout: -6080> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=86 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=86 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.115 INFO:teuthology.orchestra.run.smithi045.stdout: -6079> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=86) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5836 pv6006 ap=87 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=87) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=86) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.115 INFO:teuthology.orchestra.run.smithi045.stdout: -6078> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=87) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5836 pv6006 ap=87 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=87) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=85) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.115 INFO:teuthology.orchestra.run.smithi045.stdout: -6077> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000587 [2,head] /dc-dir/dc-file_914 auth v5830 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.360907+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d740000] 2023-10-03T19:21:02.115 INFO:teuthology.orchestra.run.smithi045.stdout: -6076> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000587 [2,head] /dc-dir/dc-file_914 auth v5830 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.360907+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d740000] 2023-10-03T19:21:02.115 INFO:teuthology.orchestra.run.smithi045.stdout: -6075> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.115 INFO:teuthology.orchestra.run.smithi045.stdout: -6074> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.115 INFO:teuthology.orchestra.run.smithi045.stdout: -6073> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.116 INFO:teuthology.orchestra.run.smithi045.stdout: -6072> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000587 [2,head] /dc-dir/dc-file_914 auth v5830 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.360907+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d740000] 2023-10-03T19:21:02.116 INFO:teuthology.orchestra.run.smithi045.stdout: -6071> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000587 [2,head] /dc-dir/dc-file_914 auth v5830 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.360907+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d740000] 2023-10-03T19:21:02.116 INFO:teuthology.orchestra.run.smithi045.stdout: -6070> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.116 INFO:teuthology.orchestra.run.smithi045.stdout: -6069> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 328.273, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.28e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:659.5] 2023-10-03T19:21:02.116 INFO:teuthology.orchestra.run.smithi045.stdout: -6068> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e31cb40 on [dir 0x1 / [2,head] auth pv=6007 v=5837 cv=5559/5559 REP dir_auth=0 ap=85+87 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 85 2023-10-03T19:21:02.128 INFO:teuthology.orchestra.run.smithi045.stdout: -6067> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e31cb40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5836 pv6006 ap=86 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=86) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=85) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 86 2023-10-03T19:21:02.128 INFO:teuthology.orchestra.run.smithi045.stdout: -6066> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5837 cv=5559/5559 REP dir_auth=0 ap=85+86 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e31cb40 count now 85/86 2023-10-03T19:21:02.128 INFO:teuthology.orchestra.run.smithi045.stdout: -6065> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e31cb40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5831 cv=5553/5553 ap=86+86 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=139 | child=1 dirty=1 authpin=1 0x55576d056400] count now 86 2023-10-03T19:21:02.128 INFO:teuthology.orchestra.run.smithi045.stdout: -6064> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000587) auth_unpin by 0x55576e31cb40 on [inode 0x10000000587 [2,head] /dc-dir/dc-file_914 auth v5830 s=3 n(v0 rc2023-10-03T19:16:12.360907+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d740000] now 0 2023-10-03T19:21:02.128 INFO:teuthology.orchestra.run.smithi045.stdout: -6063> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5831 cv=5553/5553 ap=86+85 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=139 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e31cb40 count now 86/85 2023-10-03T19:21:02.128 INFO:teuthology.orchestra.run.smithi045.stdout: -6062> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.128 INFO:teuthology.orchestra.run.smithi045.stdout: -6061> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.128 INFO:teuthology.orchestra.run.smithi045.stdout: -6060> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000588 [2,head] /dc-dir/dc-file_915 auth v4602 pv5832 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.372392+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.372392+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d740580] 2023-10-03T19:21:02.128 INFO:teuthology.orchestra.run.smithi045.stdout: -6059> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5838 2023-10-03T19:21:02.129 INFO:teuthology.orchestra.run.smithi045.stdout: -6058> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5838 pv6006 ap=86 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=86) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=85) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.129 INFO:teuthology.orchestra.run.smithi045.stdout: -6057> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5836 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.129 INFO:teuthology.orchestra.run.smithi045.stdout: -6056> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5837 cv=5559/5559 REP dir_auth=0 ap=85+86 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5837 2023-10-03T19:21:02.129 INFO:teuthology.orchestra.run.smithi045.stdout: -6055> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000588) pop_and_dirty_projected_inode v5832 2023-10-03T19:21:02.129 INFO:teuthology.orchestra.run.smithi045.stdout: -6054> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000588) mark_dirty [inode 0x10000000588 [2,head] /dc-dir/dc-file_915 auth v5832 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.372392+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d740580] 2023-10-03T19:21:02.129 INFO:teuthology.orchestra.run.smithi045.stdout: -6053> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_915) mark_dirty [dentry #0x1/dc-dir/dc-file_915 [2,head] auth (dversion lock) pv=5832 v=4602 ino=0x10000000588 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d73ea00] 2023-10-03T19:21:02.129 INFO:teuthology.orchestra.run.smithi045.stdout: -6052> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5831 cv=5553/5553 ap=86+85 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=140 | child=1 dirty=1 authpin=1 0x55576d056400] version 5831 2023-10-03T19:21:02.129 INFO:teuthology.orchestra.run.smithi045.stdout: -6051> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d4a8380 v5839 2023-10-03T19:21:02.129 INFO:teuthology.orchestra.run.smithi045.stdout: -6050> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5839 cv=5559/5559 REP dir_auth=0 ap=85+86 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5839 2023-10-03T19:21:02.129 INFO:teuthology.orchestra.run.smithi045.stdout: -6049> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d4a8fe0 v5833 2023-10-03T19:21:02.129 INFO:teuthology.orchestra.run.smithi045.stdout: -6048> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5833 cv=5553/5553 ap=86+85 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=140 | child=1 dirty=1 authpin=1 0x55576d056400] version 5833 2023-10-03T19:21:02.130 INFO:teuthology.orchestra.run.smithi045.stdout: -6047> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=85 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=85 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.130 INFO:teuthology.orchestra.run.smithi045.stdout: -6046> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=85) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5838 pv6006 ap=86 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=86) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=85) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.130 INFO:teuthology.orchestra.run.smithi045.stdout: -6045> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=86) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5838 pv6006 ap=86 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=86) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=84) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.130 INFO:teuthology.orchestra.run.smithi045.stdout: -6044> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000588 [2,head] /dc-dir/dc-file_915 auth v5832 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.372392+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d740580] 2023-10-03T19:21:02.130 INFO:teuthology.orchestra.run.smithi045.stdout: -6043> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000588 [2,head] /dc-dir/dc-file_915 auth v5832 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.372392+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d740580] 2023-10-03T19:21:02.130 INFO:teuthology.orchestra.run.smithi045.stdout: -6042> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.130 INFO:teuthology.orchestra.run.smithi045.stdout: -6041> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.130 INFO:teuthology.orchestra.run.smithi045.stdout: -6040> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.130 INFO:teuthology.orchestra.run.smithi045.stdout: -6039> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000588 [2,head] /dc-dir/dc-file_915 auth v5832 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.372392+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d740580] 2023-10-03T19:21:02.130 INFO:teuthology.orchestra.run.smithi045.stdout: -6038> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000588 [2,head] /dc-dir/dc-file_915 auth v5832 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.372392+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d740580] 2023-10-03T19:21:02.130 INFO:teuthology.orchestra.run.smithi045.stdout: -6037> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.131 INFO:teuthology.orchestra.run.smithi045.stdout: -6036> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 329.273, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.29e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:661.5] 2023-10-03T19:21:02.131 INFO:teuthology.orchestra.run.smithi045.stdout: -6035> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e31cfc0 on [dir 0x1 / [2,head] auth pv=6007 v=5839 cv=5559/5559 REP dir_auth=0 ap=84+86 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 84 2023-10-03T19:21:02.131 INFO:teuthology.orchestra.run.smithi045.stdout: -6034> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e31cfc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5838 pv6006 ap=85 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=85) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=84) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 85 2023-10-03T19:21:02.131 INFO:teuthology.orchestra.run.smithi045.stdout: -6033> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5839 cv=5559/5559 REP dir_auth=0 ap=84+85 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e31cfc0 count now 84/85 2023-10-03T19:21:02.131 INFO:teuthology.orchestra.run.smithi045.stdout: -6032> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e31cfc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5833 cv=5553/5553 ap=85+85 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=140 | child=1 dirty=1 authpin=1 0x55576d056400] count now 85 2023-10-03T19:21:02.131 INFO:teuthology.orchestra.run.smithi045.stdout: -6031> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000588) auth_unpin by 0x55576e31cfc0 on [inode 0x10000000588 [2,head] /dc-dir/dc-file_915 auth v5832 s=3 n(v0 rc2023-10-03T19:16:12.372392+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d740580] now 0 2023-10-03T19:21:02.131 INFO:teuthology.orchestra.run.smithi045.stdout: -6030> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5833 cv=5553/5553 ap=85+84 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=140 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e31cfc0 count now 85/84 2023-10-03T19:21:02.131 INFO:teuthology.orchestra.run.smithi045.stdout: -6029> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.131 INFO:teuthology.orchestra.run.smithi045.stdout: -6028> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.131 INFO:teuthology.orchestra.run.smithi045.stdout: -6027> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000589 [2,head] /dc-dir/dc-file_916 auth v4606 pv5834 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.383391+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.383391+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d740b00] 2023-10-03T19:21:02.131 INFO:teuthology.orchestra.run.smithi045.stdout: -6026> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5840 2023-10-03T19:21:02.132 INFO:teuthology.orchestra.run.smithi045.stdout: -6025> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5840 pv6006 ap=85 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=85) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=84) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.132 INFO:teuthology.orchestra.run.smithi045.stdout: -6024> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5838 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.132 INFO:teuthology.orchestra.run.smithi045.stdout: -6023> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5839 cv=5559/5559 REP dir_auth=0 ap=84+85 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5839 2023-10-03T19:21:02.132 INFO:teuthology.orchestra.run.smithi045.stdout: -6022> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000589) pop_and_dirty_projected_inode v5834 2023-10-03T19:21:02.132 INFO:teuthology.orchestra.run.smithi045.stdout: -6021> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000589) mark_dirty [inode 0x10000000589 [2,head] /dc-dir/dc-file_916 auth v5834 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.383391+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d740b00] 2023-10-03T19:21:02.132 INFO:teuthology.orchestra.run.smithi045.stdout: -6020> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_916) mark_dirty [dentry #0x1/dc-dir/dc-file_916 [2,head] auth (dversion lock) pv=5834 v=4606 ino=0x10000000589 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d73ec80] 2023-10-03T19:21:02.132 INFO:teuthology.orchestra.run.smithi045.stdout: -6019> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5833 cv=5553/5553 ap=85+84 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=141 | child=1 dirty=1 authpin=1 0x55576d056400] version 5833 2023-10-03T19:21:02.132 INFO:teuthology.orchestra.run.smithi045.stdout: -6018> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d4a85c0 v5841 2023-10-03T19:21:02.132 INFO:teuthology.orchestra.run.smithi045.stdout: -6017> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5841 cv=5559/5559 REP dir_auth=0 ap=84+85 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5841 2023-10-03T19:21:02.132 INFO:teuthology.orchestra.run.smithi045.stdout: -6016> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d4a9220 v5835 2023-10-03T19:21:02.132 INFO:teuthology.orchestra.run.smithi045.stdout: -6015> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5835 cv=5553/5553 ap=85+84 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=141 | child=1 dirty=1 authpin=1 0x55576d056400] version 5835 2023-10-03T19:21:02.132 INFO:teuthology.orchestra.run.smithi045.stdout: -6014> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=84 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=84 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.133 INFO:teuthology.orchestra.run.smithi045.stdout: -6013> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=84) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5840 pv6006 ap=85 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=85) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=84) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.133 INFO:teuthology.orchestra.run.smithi045.stdout: -6012> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=85) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5840 pv6006 ap=85 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=85) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=83) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.133 INFO:teuthology.orchestra.run.smithi045.stdout: -6011> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000589 [2,head] /dc-dir/dc-file_916 auth v5834 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.383391+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d740b00] 2023-10-03T19:21:02.154 INFO:teuthology.orchestra.run.smithi045.stdout: -6010> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000589 [2,head] /dc-dir/dc-file_916 auth v5834 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.383391+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d740b00] 2023-10-03T19:21:02.154 INFO:teuthology.orchestra.run.smithi045.stdout: -6009> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.154 INFO:teuthology.orchestra.run.smithi045.stdout: -6008> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.154 INFO:teuthology.orchestra.run.smithi045.stdout: -6007> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.154 INFO:teuthology.orchestra.run.smithi045.stdout: -6006> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000589 [2,head] /dc-dir/dc-file_916 auth v5834 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.383391+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d740b00] 2023-10-03T19:21:02.155 INFO:teuthology.orchestra.run.smithi045.stdout: -6005> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000589 [2,head] /dc-dir/dc-file_916 auth v5834 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.383391+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d740b00] 2023-10-03T19:21:02.155 INFO:teuthology.orchestra.run.smithi045.stdout: -6004> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.155 INFO:teuthology.orchestra.run.smithi045.stdout: -6003> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 330.273, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.30e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:663.5] 2023-10-03T19:21:02.155 INFO:teuthology.orchestra.run.smithi045.stdout: -6002> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e31d440 on [dir 0x1 / [2,head] auth pv=6007 v=5841 cv=5559/5559 REP dir_auth=0 ap=83+85 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 83 2023-10-03T19:21:02.155 INFO:teuthology.orchestra.run.smithi045.stdout: -6001> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e31d440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5840 pv6006 ap=84 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=84) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=83) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 84 2023-10-03T19:21:02.155 INFO:teuthology.orchestra.run.smithi045.stdout: -6000> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5841 cv=5559/5559 REP dir_auth=0 ap=83+84 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e31d440 count now 83/84 2023-10-03T19:21:02.155 INFO:teuthology.orchestra.run.smithi045.stdout: -5999> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e31d440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5835 cv=5553/5553 ap=84+84 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=141 | child=1 dirty=1 authpin=1 0x55576d056400] count now 84 2023-10-03T19:21:02.155 INFO:teuthology.orchestra.run.smithi045.stdout: -5998> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000589) auth_unpin by 0x55576e31d440 on [inode 0x10000000589 [2,head] /dc-dir/dc-file_916 auth v5834 s=3 n(v0 rc2023-10-03T19:16:12.383391+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d740b00] now 0 2023-10-03T19:21:02.155 INFO:teuthology.orchestra.run.smithi045.stdout: -5997> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5835 cv=5553/5553 ap=84+83 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=141 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e31d440 count now 84/83 2023-10-03T19:21:02.155 INFO:teuthology.orchestra.run.smithi045.stdout: -5996> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.155 INFO:teuthology.orchestra.run.smithi045.stdout: -5995> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.155 INFO:teuthology.orchestra.run.smithi045.stdout: -5994> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000058a [2,head] /dc-dir/dc-file_917 auth v4610 pv5836 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.394808+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.394808+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d741080] 2023-10-03T19:21:02.156 INFO:teuthology.orchestra.run.smithi045.stdout: -5993> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5842 2023-10-03T19:21:02.156 INFO:teuthology.orchestra.run.smithi045.stdout: -5992> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5842 pv6006 ap=84 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=84) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=83) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.162 INFO:teuthology.orchestra.run.smithi045.stdout: -5991> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5840 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.162 INFO:teuthology.orchestra.run.smithi045.stdout: -5990> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5841 cv=5559/5559 REP dir_auth=0 ap=83+84 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5841 2023-10-03T19:21:02.162 INFO:teuthology.orchestra.run.smithi045.stdout: -5989> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000058a) pop_and_dirty_projected_inode v5836 2023-10-03T19:21:02.162 INFO:teuthology.orchestra.run.smithi045.stdout: -5988> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000058a) mark_dirty [inode 0x1000000058a [2,head] /dc-dir/dc-file_917 auth v5836 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.394808+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d741080] 2023-10-03T19:21:02.162 INFO:teuthology.orchestra.run.smithi045.stdout: -5987> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_917) mark_dirty [dentry #0x1/dc-dir/dc-file_917 [2,head] auth (dversion lock) pv=5836 v=4610 ino=0x1000000058a state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d73ef00] 2023-10-03T19:21:02.162 INFO:teuthology.orchestra.run.smithi045.stdout: -5986> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5835 cv=5553/5553 ap=84+83 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=142 | child=1 dirty=1 authpin=1 0x55576d056400] version 5835 2023-10-03T19:21:02.162 INFO:teuthology.orchestra.run.smithi045.stdout: -5985> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d4a8800 v5843 2023-10-03T19:21:02.162 INFO:teuthology.orchestra.run.smithi045.stdout: -5984> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5843 cv=5559/5559 REP dir_auth=0 ap=83+84 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5843 2023-10-03T19:21:02.163 INFO:teuthology.orchestra.run.smithi045.stdout: -5983> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d4a9460 v5837 2023-10-03T19:21:02.163 INFO:teuthology.orchestra.run.smithi045.stdout: -5982> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5837 cv=5553/5553 ap=84+83 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=142 | child=1 dirty=1 authpin=1 0x55576d056400] version 5837 2023-10-03T19:21:02.163 INFO:teuthology.orchestra.run.smithi045.stdout: -5981> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=83 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=83 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.163 INFO:teuthology.orchestra.run.smithi045.stdout: -5980> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=83) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5842 pv6006 ap=84 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=84) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=83) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.163 INFO:teuthology.orchestra.run.smithi045.stdout: -5979> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=84) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5842 pv6006 ap=84 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=84) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=82) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.163 INFO:teuthology.orchestra.run.smithi045.stdout: -5978> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000058a [2,head] /dc-dir/dc-file_917 auth v5836 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.394808+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d741080] 2023-10-03T19:21:02.163 INFO:teuthology.orchestra.run.smithi045.stdout: -5977> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000058a [2,head] /dc-dir/dc-file_917 auth v5836 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.394808+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d741080] 2023-10-03T19:21:02.163 INFO:teuthology.orchestra.run.smithi045.stdout: -5976> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.163 INFO:teuthology.orchestra.run.smithi045.stdout: -5975> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.163 INFO:teuthology.orchestra.run.smithi045.stdout: -5974> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.163 INFO:teuthology.orchestra.run.smithi045.stdout: -5973> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000058a [2,head] /dc-dir/dc-file_917 auth v5836 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.394808+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d741080] 2023-10-03T19:21:02.164 INFO:teuthology.orchestra.run.smithi045.stdout: -5972> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000058a [2,head] /dc-dir/dc-file_917 auth v5836 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.394808+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d741080] 2023-10-03T19:21:02.164 INFO:teuthology.orchestra.run.smithi045.stdout: -5971> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.164 INFO:teuthology.orchestra.run.smithi045.stdout: -5970> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 331.273, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.31e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:665.5] 2023-10-03T19:21:02.164 INFO:teuthology.orchestra.run.smithi045.stdout: -5969> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e31d8c0 on [dir 0x1 / [2,head] auth pv=6007 v=5843 cv=5559/5559 REP dir_auth=0 ap=82+84 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 82 2023-10-03T19:21:02.164 INFO:teuthology.orchestra.run.smithi045.stdout: -5968> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e31d8c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5842 pv6006 ap=83 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=83) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=82) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 83 2023-10-03T19:21:02.164 INFO:teuthology.orchestra.run.smithi045.stdout: -5967> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5843 cv=5559/5559 REP dir_auth=0 ap=82+83 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e31d8c0 count now 82/83 2023-10-03T19:21:02.164 INFO:teuthology.orchestra.run.smithi045.stdout: -5966> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e31d8c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5837 cv=5553/5553 ap=83+83 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=142 | child=1 dirty=1 authpin=1 0x55576d056400] count now 83 2023-10-03T19:21:02.164 INFO:teuthology.orchestra.run.smithi045.stdout: -5965> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000058a) auth_unpin by 0x55576e31d8c0 on [inode 0x1000000058a [2,head] /dc-dir/dc-file_917 auth v5836 s=3 n(v0 rc2023-10-03T19:16:12.394808+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d741080] now 0 2023-10-03T19:21:02.164 INFO:teuthology.orchestra.run.smithi045.stdout: -5964> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5837 cv=5553/5553 ap=83+82 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=142 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e31d8c0 count now 83/82 2023-10-03T19:21:02.164 INFO:teuthology.orchestra.run.smithi045.stdout: -5963> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.164 INFO:teuthology.orchestra.run.smithi045.stdout: -5962> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.164 INFO:teuthology.orchestra.run.smithi045.stdout: -5961> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000058b [2,head] /dc-dir/dc-file_918 auth v4614 pv5838 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.405870+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.405870+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d741600] 2023-10-03T19:21:02.165 INFO:teuthology.orchestra.run.smithi045.stdout: -5960> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5844 2023-10-03T19:21:02.165 INFO:teuthology.orchestra.run.smithi045.stdout: -5959> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5844 pv6006 ap=83 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=83) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=82) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.165 INFO:teuthology.orchestra.run.smithi045.stdout: -5958> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5842 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.165 INFO:teuthology.orchestra.run.smithi045.stdout: -5957> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5843 cv=5559/5559 REP dir_auth=0 ap=82+83 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5843 2023-10-03T19:21:02.165 INFO:teuthology.orchestra.run.smithi045.stdout: -5956> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000058b) pop_and_dirty_projected_inode v5838 2023-10-03T19:21:02.165 INFO:teuthology.orchestra.run.smithi045.stdout: -5955> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000058b) mark_dirty [inode 0x1000000058b [2,head] /dc-dir/dc-file_918 auth v5838 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.405870+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d741600] 2023-10-03T19:21:02.165 INFO:teuthology.orchestra.run.smithi045.stdout: -5954> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_918) mark_dirty [dentry #0x1/dc-dir/dc-file_918 [2,head] auth (dversion lock) pv=5838 v=4614 ino=0x1000000058b state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d73f180] 2023-10-03T19:21:02.165 INFO:teuthology.orchestra.run.smithi045.stdout: -5953> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5837 cv=5553/5553 ap=83+82 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=143 | child=1 dirty=1 authpin=1 0x55576d056400] version 5837 2023-10-03T19:21:02.165 INFO:teuthology.orchestra.run.smithi045.stdout: -5952> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d4a8a40 v5845 2023-10-03T19:21:02.165 INFO:teuthology.orchestra.run.smithi045.stdout: -5951> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5845 cv=5559/5559 REP dir_auth=0 ap=82+83 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5845 2023-10-03T19:21:02.165 INFO:teuthology.orchestra.run.smithi045.stdout: -5950> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d4a96a0 v5839 2023-10-03T19:21:02.166 INFO:teuthology.orchestra.run.smithi045.stdout: -5949> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5839 cv=5553/5553 ap=83+82 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=143 | child=1 dirty=1 authpin=1 0x55576d056400] version 5839 2023-10-03T19:21:02.166 INFO:teuthology.orchestra.run.smithi045.stdout: -5948> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=82 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=82 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.166 INFO:teuthology.orchestra.run.smithi045.stdout: -5947> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=82) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5844 pv6006 ap=83 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=83) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=82) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.166 INFO:teuthology.orchestra.run.smithi045.stdout: -5946> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=83) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5844 pv6006 ap=83 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=83) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=81) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.166 INFO:teuthology.orchestra.run.smithi045.stdout: -5945> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000058b [2,head] /dc-dir/dc-file_918 auth v5838 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.405870+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d741600] 2023-10-03T19:21:02.166 INFO:teuthology.orchestra.run.smithi045.stdout: -5944> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000058b [2,head] /dc-dir/dc-file_918 auth v5838 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.405870+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d741600] 2023-10-03T19:21:02.166 INFO:teuthology.orchestra.run.smithi045.stdout: -5943> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.166 INFO:teuthology.orchestra.run.smithi045.stdout: -5942> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.166 INFO:teuthology.orchestra.run.smithi045.stdout: -5941> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.166 INFO:teuthology.orchestra.run.smithi045.stdout: -5940> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000058b [2,head] /dc-dir/dc-file_918 auth v5838 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.405870+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d741600] 2023-10-03T19:21:02.166 INFO:teuthology.orchestra.run.smithi045.stdout: -5939> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000058b [2,head] /dc-dir/dc-file_918 auth v5838 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.405870+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d741600] 2023-10-03T19:21:02.167 INFO:teuthology.orchestra.run.smithi045.stdout: -5938> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.167 INFO:teuthology.orchestra.run.smithi045.stdout: -5937> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 332.273, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.32e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:667.5] 2023-10-03T19:21:02.167 INFO:teuthology.orchestra.run.smithi045.stdout: -5936> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e31dd40 on [dir 0x1 / [2,head] auth pv=6007 v=5845 cv=5559/5559 REP dir_auth=0 ap=81+83 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 81 2023-10-03T19:21:02.167 INFO:teuthology.orchestra.run.smithi045.stdout: -5935> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e31dd40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5844 pv6006 ap=82 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=82) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=81) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 82 2023-10-03T19:21:02.273 INFO:teuthology.orchestra.run.smithi045.stdout: -5934> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5845 cv=5559/5559 REP dir_auth=0 ap=81+82 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e31dd40 count now 81/82 2023-10-03T19:21:02.273 INFO:teuthology.orchestra.run.smithi045.stdout: -5933> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e31dd40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5839 cv=5553/5553 ap=82+82 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=143 | child=1 dirty=1 authpin=1 0x55576d056400] count now 82 2023-10-03T19:21:02.273 INFO:teuthology.orchestra.run.smithi045.stdout: -5932> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000058b) auth_unpin by 0x55576e31dd40 on [inode 0x1000000058b [2,head] /dc-dir/dc-file_918 auth v5838 s=3 n(v0 rc2023-10-03T19:16:12.405870+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d741600] now 0 2023-10-03T19:21:02.273 INFO:teuthology.orchestra.run.smithi045.stdout: -5931> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5839 cv=5553/5553 ap=82+81 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=143 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e31dd40 count now 82/81 2023-10-03T19:21:02.273 INFO:teuthology.orchestra.run.smithi045.stdout: -5930> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.274 INFO:teuthology.orchestra.run.smithi045.stdout: -5929> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.274 INFO:teuthology.orchestra.run.smithi045.stdout: -5928> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000058c [2,head] /dc-dir/dc-file_919 auth v4618 pv5840 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.418120+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.418120+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d741b80] 2023-10-03T19:21:02.274 INFO:teuthology.orchestra.run.smithi045.stdout: -5927> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5846 2023-10-03T19:21:02.274 INFO:teuthology.orchestra.run.smithi045.stdout: -5926> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5846 pv6006 ap=82 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=82) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=81) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.274 INFO:teuthology.orchestra.run.smithi045.stdout: -5925> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5844 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.274 INFO:teuthology.orchestra.run.smithi045.stdout: -5924> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5845 cv=5559/5559 REP dir_auth=0 ap=81+82 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5845 2023-10-03T19:21:02.274 INFO:teuthology.orchestra.run.smithi045.stdout: -5923> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000058c) pop_and_dirty_projected_inode v5840 2023-10-03T19:21:02.274 INFO:teuthology.orchestra.run.smithi045.stdout: -5922> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000058c) mark_dirty [inode 0x1000000058c [2,head] /dc-dir/dc-file_919 auth v5840 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.418120+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d741b80] 2023-10-03T19:21:02.274 INFO:teuthology.orchestra.run.smithi045.stdout: -5921> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_919) mark_dirty [dentry #0x1/dc-dir/dc-file_919 [2,head] auth (dversion lock) pv=5840 v=4618 ino=0x1000000058c state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d73f400] 2023-10-03T19:21:02.274 INFO:teuthology.orchestra.run.smithi045.stdout: -5920> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5839 cv=5553/5553 ap=82+81 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=144 | child=1 dirty=1 authpin=1 0x55576d056400] version 5839 2023-10-03T19:21:02.275 INFO:teuthology.orchestra.run.smithi045.stdout: -5919> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d4a8c80 v5847 2023-10-03T19:21:02.275 INFO:teuthology.orchestra.run.smithi045.stdout: -5918> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5847 cv=5559/5559 REP dir_auth=0 ap=81+82 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5847 2023-10-03T19:21:02.275 INFO:teuthology.orchestra.run.smithi045.stdout: -5917> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d4a98e0 v5841 2023-10-03T19:21:02.275 INFO:teuthology.orchestra.run.smithi045.stdout: -5916> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5841 cv=5553/5553 ap=82+81 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=144 | child=1 dirty=1 authpin=1 0x55576d056400] version 5841 2023-10-03T19:21:02.275 INFO:teuthology.orchestra.run.smithi045.stdout: -5915> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=81 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=81 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.275 INFO:teuthology.orchestra.run.smithi045.stdout: -5914> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=81) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5846 pv6006 ap=82 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=82) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=81) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.275 INFO:teuthology.orchestra.run.smithi045.stdout: -5913> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=82) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5846 pv6006 ap=82 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=82) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=80) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.275 INFO:teuthology.orchestra.run.smithi045.stdout: -5912> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000058c [2,head] /dc-dir/dc-file_919 auth v5840 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.418120+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d741b80] 2023-10-03T19:21:02.275 INFO:teuthology.orchestra.run.smithi045.stdout: -5911> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000058c [2,head] /dc-dir/dc-file_919 auth v5840 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.418120+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d741b80] 2023-10-03T19:21:02.275 INFO:teuthology.orchestra.run.smithi045.stdout: -5910> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.276 INFO:teuthology.orchestra.run.smithi045.stdout: -5909> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.276 INFO:teuthology.orchestra.run.smithi045.stdout: -5908> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.276 INFO:teuthology.orchestra.run.smithi045.stdout: -5907> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000058c [2,head] /dc-dir/dc-file_919 auth v5840 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.418120+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d741b80] 2023-10-03T19:21:02.276 INFO:teuthology.orchestra.run.smithi045.stdout: -5906> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000058c [2,head] /dc-dir/dc-file_919 auth v5840 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.418120+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d741b80] 2023-10-03T19:21:02.276 INFO:teuthology.orchestra.run.smithi045.stdout: -5905> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.276 INFO:teuthology.orchestra.run.smithi045.stdout: -5904> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 333.273, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.33e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:669.5] 2023-10-03T19:21:02.276 INFO:teuthology.orchestra.run.smithi045.stdout: -5903> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e31d200 on [dir 0x1 / [2,head] auth pv=6007 v=5847 cv=5559/5559 REP dir_auth=0 ap=80+82 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 80 2023-10-03T19:21:02.276 INFO:teuthology.orchestra.run.smithi045.stdout: -5902> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e31d200 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5846 pv6006 ap=81 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=81) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=80) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 81 2023-10-03T19:21:02.276 INFO:teuthology.orchestra.run.smithi045.stdout: -5901> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5847 cv=5559/5559 REP dir_auth=0 ap=80+81 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e31d200 count now 80/81 2023-10-03T19:21:02.276 INFO:teuthology.orchestra.run.smithi045.stdout: -5900> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e31d200 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5841 cv=5553/5553 ap=81+81 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=144 | child=1 dirty=1 authpin=1 0x55576d056400] count now 81 2023-10-03T19:21:02.276 INFO:teuthology.orchestra.run.smithi045.stdout: -5899> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000058c) auth_unpin by 0x55576e31d200 on [inode 0x1000000058c [2,head] /dc-dir/dc-file_919 auth v5840 s=3 n(v0 rc2023-10-03T19:16:12.418120+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d741b80] now 0 2023-10-03T19:21:02.277 INFO:teuthology.orchestra.run.smithi045.stdout: -5898> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5841 cv=5553/5553 ap=81+80 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=144 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e31d200 count now 81/80 2023-10-03T19:21:02.277 INFO:teuthology.orchestra.run.smithi045.stdout: -5897> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.277 INFO:teuthology.orchestra.run.smithi045.stdout: -5896> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.277 INFO:teuthology.orchestra.run.smithi045.stdout: -5895> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000058d [2,head] /dc-dir/dc-file_920 auth v4622 pv5842 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.429338+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.429338+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d742100] 2023-10-03T19:21:02.277 INFO:teuthology.orchestra.run.smithi045.stdout: -5894> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5848 2023-10-03T19:21:02.277 INFO:teuthology.orchestra.run.smithi045.stdout: -5893> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5848 pv6006 ap=81 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=81) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=80) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.277 INFO:teuthology.orchestra.run.smithi045.stdout: -5892> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5846 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.277 INFO:teuthology.orchestra.run.smithi045.stdout: -5891> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5847 cv=5559/5559 REP dir_auth=0 ap=80+81 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5847 2023-10-03T19:21:02.277 INFO:teuthology.orchestra.run.smithi045.stdout: -5890> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000058d) pop_and_dirty_projected_inode v5842 2023-10-03T19:21:02.277 INFO:teuthology.orchestra.run.smithi045.stdout: -5889> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000058d) mark_dirty [inode 0x1000000058d [2,head] /dc-dir/dc-file_920 auth v5842 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.429338+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d742100] 2023-10-03T19:21:02.277 INFO:teuthology.orchestra.run.smithi045.stdout: -5888> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_920) mark_dirty [dentry #0x1/dc-dir/dc-file_920 [2,head] auth (dversion lock) pv=5842 v=4622 ino=0x1000000058d state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d73f680] 2023-10-03T19:21:02.278 INFO:teuthology.orchestra.run.smithi045.stdout: -5887> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5841 cv=5553/5553 ap=81+80 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=145 | child=1 dirty=1 authpin=1 0x55576d056400] version 5841 2023-10-03T19:21:02.278 INFO:teuthology.orchestra.run.smithi045.stdout: -5886> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d4a8ec0 v5849 2023-10-03T19:21:02.278 INFO:teuthology.orchestra.run.smithi045.stdout: -5885> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5849 cv=5559/5559 REP dir_auth=0 ap=80+81 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5849 2023-10-03T19:21:02.278 INFO:teuthology.orchestra.run.smithi045.stdout: -5884> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d4a9b20 v5843 2023-10-03T19:21:02.278 INFO:teuthology.orchestra.run.smithi045.stdout: -5883> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5843 cv=5553/5553 ap=81+80 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=145 | child=1 dirty=1 authpin=1 0x55576d056400] version 5843 2023-10-03T19:21:02.278 INFO:teuthology.orchestra.run.smithi045.stdout: -5882> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=80 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=80 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.278 INFO:teuthology.orchestra.run.smithi045.stdout: -5881> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=80) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5848 pv6006 ap=81 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=81) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=80) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.278 INFO:teuthology.orchestra.run.smithi045.stdout: -5880> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=81) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5848 pv6006 ap=81 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=81) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=79) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.278 INFO:teuthology.orchestra.run.smithi045.stdout: -5879> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000058d [2,head] /dc-dir/dc-file_920 auth v5842 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.429338+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d742100] 2023-10-03T19:21:02.278 INFO:teuthology.orchestra.run.smithi045.stdout: -5878> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000058d [2,head] /dc-dir/dc-file_920 auth v5842 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.429338+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d742100] 2023-10-03T19:21:02.278 INFO:teuthology.orchestra.run.smithi045.stdout: -5877> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.279 INFO:teuthology.orchestra.run.smithi045.stdout: -5876> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.279 INFO:teuthology.orchestra.run.smithi045.stdout: -5875> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.279 INFO:teuthology.orchestra.run.smithi045.stdout: -5874> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000058d [2,head] /dc-dir/dc-file_920 auth v5842 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.429338+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d742100] 2023-10-03T19:21:02.279 INFO:teuthology.orchestra.run.smithi045.stdout: -5873> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000058d [2,head] /dc-dir/dc-file_920 auth v5842 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.429338+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d742100] 2023-10-03T19:21:02.279 INFO:teuthology.orchestra.run.smithi045.stdout: -5872> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.279 INFO:teuthology.orchestra.run.smithi045.stdout: -5871> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 334.273, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.34e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:671.5] 2023-10-03T19:21:02.279 INFO:teuthology.orchestra.run.smithi045.stdout: -5870> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e31c900 on [dir 0x1 / [2,head] auth pv=6007 v=5849 cv=5559/5559 REP dir_auth=0 ap=79+81 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 79 2023-10-03T19:21:02.279 INFO:teuthology.orchestra.run.smithi045.stdout: -5869> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e31c900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5848 pv6006 ap=80 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=80) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=79) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 80 2023-10-03T19:21:02.279 INFO:teuthology.orchestra.run.smithi045.stdout: -5868> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5849 cv=5559/5559 REP dir_auth=0 ap=79+80 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e31c900 count now 79/80 2023-10-03T19:21:02.279 INFO:teuthology.orchestra.run.smithi045.stdout: -5867> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e31c900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5843 cv=5553/5553 ap=80+80 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=145 | child=1 dirty=1 authpin=1 0x55576d056400] count now 80 2023-10-03T19:21:02.279 INFO:teuthology.orchestra.run.smithi045.stdout: -5866> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000058d) auth_unpin by 0x55576e31c900 on [inode 0x1000000058d [2,head] /dc-dir/dc-file_920 auth v5842 s=3 n(v0 rc2023-10-03T19:16:12.429338+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d742100] now 0 2023-10-03T19:21:02.280 INFO:teuthology.orchestra.run.smithi045.stdout: -5865> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5843 cv=5553/5553 ap=80+79 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=145 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e31c900 count now 80/79 2023-10-03T19:21:02.280 INFO:teuthology.orchestra.run.smithi045.stdout: -5864> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.280 INFO:teuthology.orchestra.run.smithi045.stdout: -5863> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.280 INFO:teuthology.orchestra.run.smithi045.stdout: -5862> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000058e [2,head] /dc-dir/dc-file_921 auth v4626 pv5844 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.440341+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.440341+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d742680] 2023-10-03T19:21:02.280 INFO:teuthology.orchestra.run.smithi045.stdout: -5861> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5850 2023-10-03T19:21:02.280 INFO:teuthology.orchestra.run.smithi045.stdout: -5860> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5850 pv6006 ap=80 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=80) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=79) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.280 INFO:teuthology.orchestra.run.smithi045.stdout: -5859> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5848 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.280 INFO:teuthology.orchestra.run.smithi045.stdout: -5858> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5849 cv=5559/5559 REP dir_auth=0 ap=79+80 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5849 2023-10-03T19:21:02.280 INFO:teuthology.orchestra.run.smithi045.stdout: -5857> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000058e) pop_and_dirty_projected_inode v5844 2023-10-03T19:21:02.280 INFO:teuthology.orchestra.run.smithi045.stdout: -5856> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000058e) mark_dirty [inode 0x1000000058e [2,head] /dc-dir/dc-file_921 auth v5844 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.440341+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d742680] 2023-10-03T19:21:02.280 INFO:teuthology.orchestra.run.smithi045.stdout: -5855> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_921) mark_dirty [dentry #0x1/dc-dir/dc-file_921 [2,head] auth (dversion lock) pv=5844 v=4626 ino=0x1000000058e state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d73f900] 2023-10-03T19:21:02.280 INFO:teuthology.orchestra.run.smithi045.stdout: -5854> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5843 cv=5553/5553 ap=80+79 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=146 | child=1 dirty=1 authpin=1 0x55576d056400] version 5843 2023-10-03T19:21:02.281 INFO:teuthology.orchestra.run.smithi045.stdout: -5853> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d4a9100 v5851 2023-10-03T19:21:02.281 INFO:teuthology.orchestra.run.smithi045.stdout: -5852> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5851 cv=5559/5559 REP dir_auth=0 ap=79+80 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5851 2023-10-03T19:21:02.281 INFO:teuthology.orchestra.run.smithi045.stdout: -5851> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d4a9d60 v5845 2023-10-03T19:21:02.281 INFO:teuthology.orchestra.run.smithi045.stdout: -5850> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5845 cv=5553/5553 ap=80+79 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=146 | child=1 dirty=1 authpin=1 0x55576d056400] version 5845 2023-10-03T19:21:02.281 INFO:teuthology.orchestra.run.smithi045.stdout: -5849> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=79 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=79 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.281 INFO:teuthology.orchestra.run.smithi045.stdout: -5848> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=79) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5850 pv6006 ap=80 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=80) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=79) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.281 INFO:teuthology.orchestra.run.smithi045.stdout: -5847> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=80) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5850 pv6006 ap=80 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=80) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=78) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.281 INFO:teuthology.orchestra.run.smithi045.stdout: -5846> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000058e [2,head] /dc-dir/dc-file_921 auth v5844 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.440341+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d742680] 2023-10-03T19:21:02.281 INFO:teuthology.orchestra.run.smithi045.stdout: -5845> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000058e [2,head] /dc-dir/dc-file_921 auth v5844 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.440341+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d742680] 2023-10-03T19:21:02.281 INFO:teuthology.orchestra.run.smithi045.stdout: -5844> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.282 INFO:teuthology.orchestra.run.smithi045.stdout: -5843> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.282 INFO:teuthology.orchestra.run.smithi045.stdout: -5842> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.282 INFO:teuthology.orchestra.run.smithi045.stdout: -5841> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000058e [2,head] /dc-dir/dc-file_921 auth v5844 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.440341+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d742680] 2023-10-03T19:21:02.282 INFO:teuthology.orchestra.run.smithi045.stdout: -5840> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000058e [2,head] /dc-dir/dc-file_921 auth v5844 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.440341+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d742680] 2023-10-03T19:21:02.282 INFO:teuthology.orchestra.run.smithi045.stdout: -5839> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.282 INFO:teuthology.orchestra.run.smithi045.stdout: -5838> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 335.273, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.35e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:673.5] 2023-10-03T19:21:02.282 INFO:teuthology.orchestra.run.smithi045.stdout: -5837> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e31c000 on [dir 0x1 / [2,head] auth pv=6007 v=5851 cv=5559/5559 REP dir_auth=0 ap=78+80 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 78 2023-10-03T19:21:02.282 INFO:teuthology.orchestra.run.smithi045.stdout: -5836> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e31c000 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5845 cv=5553/5553 ap=79+79 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=146 | child=1 dirty=1 authpin=1 0x55576d056400] count now 79 2023-10-03T19:21:02.282 INFO:teuthology.orchestra.run.smithi045.stdout: -5835> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e31c000 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5850 pv6006 ap=79 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=79) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=78) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 79 2023-10-03T19:21:02.282 INFO:teuthology.orchestra.run.smithi045.stdout: -5834> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5851 cv=5559/5559 REP dir_auth=0 ap=78+79 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e31c000 count now 78/79 2023-10-03T19:21:02.282 INFO:teuthology.orchestra.run.smithi045.stdout: -5833> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000058e) auth_unpin by 0x55576e31c000 on [inode 0x1000000058e [2,head] /dc-dir/dc-file_921 auth v5844 s=3 n(v0 rc2023-10-03T19:16:12.440341+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d742680] now 0 2023-10-03T19:21:02.283 INFO:teuthology.orchestra.run.smithi045.stdout: -5832> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5845 cv=5553/5553 ap=79+78 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=146 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e31c000 count now 79/78 2023-10-03T19:21:02.283 INFO:teuthology.orchestra.run.smithi045.stdout: -5831> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.283 INFO:teuthology.orchestra.run.smithi045.stdout: -5830> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.283 INFO:teuthology.orchestra.run.smithi045.stdout: -5829> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000058f [2,head] /dc-dir/dc-file_922 auth v4630 pv5846 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.451291+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.451291+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d742c00] 2023-10-03T19:21:02.283 INFO:teuthology.orchestra.run.smithi045.stdout: -5828> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5852 2023-10-03T19:21:02.283 INFO:teuthology.orchestra.run.smithi045.stdout: -5827> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5852 pv6006 ap=79 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=79) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=78) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.283 INFO:teuthology.orchestra.run.smithi045.stdout: -5826> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5850 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.283 INFO:teuthology.orchestra.run.smithi045.stdout: -5825> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5851 cv=5559/5559 REP dir_auth=0 ap=78+79 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5851 2023-10-03T19:21:02.283 INFO:teuthology.orchestra.run.smithi045.stdout: -5824> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000058f) pop_and_dirty_projected_inode v5846 2023-10-03T19:21:02.283 INFO:teuthology.orchestra.run.smithi045.stdout: -5823> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000058f) mark_dirty [inode 0x1000000058f [2,head] /dc-dir/dc-file_922 auth v5846 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.451291+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d742c00] 2023-10-03T19:21:02.283 INFO:teuthology.orchestra.run.smithi045.stdout: -5822> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_922) mark_dirty [dentry #0x1/dc-dir/dc-file_922 [2,head] auth (dversion lock) pv=5846 v=4630 ino=0x1000000058f state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d73fb80] 2023-10-03T19:21:02.284 INFO:teuthology.orchestra.run.smithi045.stdout: -5821> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5845 cv=5553/5553 ap=79+78 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=147 | child=1 dirty=1 authpin=1 0x55576d056400] version 5845 2023-10-03T19:21:02.284 INFO:teuthology.orchestra.run.smithi045.stdout: -5820> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d4a9340 v5853 2023-10-03T19:21:02.284 INFO:teuthology.orchestra.run.smithi045.stdout: -5819> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5853 cv=5559/5559 REP dir_auth=0 ap=78+79 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5853 2023-10-03T19:21:02.284 INFO:teuthology.orchestra.run.smithi045.stdout: -5818> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d528020 v5847 2023-10-03T19:21:02.284 INFO:teuthology.orchestra.run.smithi045.stdout: -5817> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5847 cv=5553/5553 ap=79+78 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=147 | child=1 dirty=1 authpin=1 0x55576d056400] version 5847 2023-10-03T19:21:02.284 INFO:teuthology.orchestra.run.smithi045.stdout: -5816> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=78 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=78 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.284 INFO:teuthology.orchestra.run.smithi045.stdout: -5815> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=78) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5852 pv6006 ap=79 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=79) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=78) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.294 INFO:teuthology.orchestra.run.smithi045.stdout: -5814> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=79) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5852 pv6006 ap=79 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=79) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=77) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.294 INFO:teuthology.orchestra.run.smithi045.stdout: -5813> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000058f [2,head] /dc-dir/dc-file_922 auth v5846 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.451291+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d742c00] 2023-10-03T19:21:02.294 INFO:teuthology.orchestra.run.smithi045.stdout: -5812> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000058f [2,head] /dc-dir/dc-file_922 auth v5846 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.451291+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d742c00] 2023-10-03T19:21:02.294 INFO:teuthology.orchestra.run.smithi045.stdout: -5811> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.294 INFO:teuthology.orchestra.run.smithi045.stdout: -5810> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.294 INFO:teuthology.orchestra.run.smithi045.stdout: -5809> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.294 INFO:teuthology.orchestra.run.smithi045.stdout: -5808> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000058f [2,head] /dc-dir/dc-file_922 auth v5846 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.451291+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d742c00] 2023-10-03T19:21:02.294 INFO:teuthology.orchestra.run.smithi045.stdout: -5807> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000058f [2,head] /dc-dir/dc-file_922 auth v5846 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.451291+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d742c00] 2023-10-03T19:21:02.294 INFO:teuthology.orchestra.run.smithi045.stdout: -5806> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.294 INFO:teuthology.orchestra.run.smithi045.stdout: -5805> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 336.273, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.36e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:675.5] 2023-10-03T19:21:02.295 INFO:teuthology.orchestra.run.smithi045.stdout: -5804> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d829680 on [dir 0x1 / [2,head] auth pv=6007 v=5853 cv=5559/5559 REP dir_auth=0 ap=77+79 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 77 2023-10-03T19:21:02.295 INFO:teuthology.orchestra.run.smithi045.stdout: -5803> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d829680 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5852 pv6006 ap=78 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=78) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=77) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 78 2023-10-03T19:21:02.295 INFO:teuthology.orchestra.run.smithi045.stdout: -5802> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5853 cv=5559/5559 REP dir_auth=0 ap=77+78 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d829680 count now 77/78 2023-10-03T19:21:02.295 INFO:teuthology.orchestra.run.smithi045.stdout: -5801> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d829680 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5847 cv=5553/5553 ap=78+78 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=147 | child=1 dirty=1 authpin=1 0x55576d056400] count now 78 2023-10-03T19:21:02.295 INFO:teuthology.orchestra.run.smithi045.stdout: -5800> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000058f) auth_unpin by 0x55576d829680 on [inode 0x1000000058f [2,head] /dc-dir/dc-file_922 auth v5846 s=3 n(v0 rc2023-10-03T19:16:12.451291+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d742c00] now 0 2023-10-03T19:21:02.295 INFO:teuthology.orchestra.run.smithi045.stdout: -5799> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5847 cv=5553/5553 ap=78+77 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=147 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d829680 count now 78/77 2023-10-03T19:21:02.295 INFO:teuthology.orchestra.run.smithi045.stdout: -5798> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.295 INFO:teuthology.orchestra.run.smithi045.stdout: -5797> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.295 INFO:teuthology.orchestra.run.smithi045.stdout: -5796> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000590 [2,head] /dc-dir/dc-file_923 auth v4634 pv5848 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.462885+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.462885+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d743180] 2023-10-03T19:21:02.295 INFO:teuthology.orchestra.run.smithi045.stdout: -5795> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5854 2023-10-03T19:21:02.295 INFO:teuthology.orchestra.run.smithi045.stdout: -5794> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5854 pv6006 ap=78 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=78) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=77) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.296 INFO:teuthology.orchestra.run.smithi045.stdout: -5793> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5852 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.296 INFO:teuthology.orchestra.run.smithi045.stdout: -5792> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5853 cv=5559/5559 REP dir_auth=0 ap=77+78 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5853 2023-10-03T19:21:02.296 INFO:teuthology.orchestra.run.smithi045.stdout: -5791> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000590) pop_and_dirty_projected_inode v5848 2023-10-03T19:21:02.296 INFO:teuthology.orchestra.run.smithi045.stdout: -5790> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000590) mark_dirty [inode 0x10000000590 [2,head] /dc-dir/dc-file_923 auth v5848 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.462885+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d743180] 2023-10-03T19:21:02.296 INFO:teuthology.orchestra.run.smithi045.stdout: -5789> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_923) mark_dirty [dentry #0x1/dc-dir/dc-file_923 [2,head] auth (dversion lock) pv=5848 v=4634 ino=0x10000000590 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d746000] 2023-10-03T19:21:02.296 INFO:teuthology.orchestra.run.smithi045.stdout: -5788> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5847 cv=5553/5553 ap=78+77 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=148 | child=1 dirty=1 authpin=1 0x55576d056400] version 5847 2023-10-03T19:21:02.296 INFO:teuthology.orchestra.run.smithi045.stdout: -5787> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d4a9580 v5855 2023-10-03T19:21:02.296 INFO:teuthology.orchestra.run.smithi045.stdout: -5786> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5855 cv=5559/5559 REP dir_auth=0 ap=77+78 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5855 2023-10-03T19:21:02.296 INFO:teuthology.orchestra.run.smithi045.stdout: -5785> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d528260 v5849 2023-10-03T19:21:02.296 INFO:teuthology.orchestra.run.smithi045.stdout: -5784> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5849 cv=5553/5553 ap=78+77 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=148 | child=1 dirty=1 authpin=1 0x55576d056400] version 5849 2023-10-03T19:21:02.296 INFO:teuthology.orchestra.run.smithi045.stdout: -5783> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=77 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=77 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.296 INFO:teuthology.orchestra.run.smithi045.stdout: -5782> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=77) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5854 pv6006 ap=78 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=78) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=77) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.297 INFO:teuthology.orchestra.run.smithi045.stdout: -5781> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=78) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5854 pv6006 ap=78 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=78) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=76) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.297 INFO:teuthology.orchestra.run.smithi045.stdout: -5780> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000590 [2,head] /dc-dir/dc-file_923 auth v5848 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.462885+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d743180] 2023-10-03T19:21:02.297 INFO:teuthology.orchestra.run.smithi045.stdout: -5779> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000590 [2,head] /dc-dir/dc-file_923 auth v5848 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.462885+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d743180] 2023-10-03T19:21:02.297 INFO:teuthology.orchestra.run.smithi045.stdout: -5778> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.297 INFO:teuthology.orchestra.run.smithi045.stdout: -5777> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.297 INFO:teuthology.orchestra.run.smithi045.stdout: -5776> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.297 INFO:teuthology.orchestra.run.smithi045.stdout: -5775> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000590 [2,head] /dc-dir/dc-file_923 auth v5848 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.462885+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d743180] 2023-10-03T19:21:02.297 INFO:teuthology.orchestra.run.smithi045.stdout: -5774> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000590 [2,head] /dc-dir/dc-file_923 auth v5848 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.462885+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d743180] 2023-10-03T19:21:02.297 INFO:teuthology.orchestra.run.smithi045.stdout: -5773> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.297 INFO:teuthology.orchestra.run.smithi045.stdout: -5772> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 337.273, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.37e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:677.5] 2023-10-03T19:21:02.297 INFO:teuthology.orchestra.run.smithi045.stdout: -5771> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d828d80 on [dir 0x1 / [2,head] auth pv=6007 v=5855 cv=5559/5559 REP dir_auth=0 ap=76+78 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 76 2023-10-03T19:21:02.298 INFO:teuthology.orchestra.run.smithi045.stdout: -5770> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d828d80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5854 pv6006 ap=77 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=77) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=76) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 77 2023-10-03T19:21:02.298 INFO:teuthology.orchestra.run.smithi045.stdout: -5769> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5855 cv=5559/5559 REP dir_auth=0 ap=76+77 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d828d80 count now 76/77 2023-10-03T19:21:02.298 INFO:teuthology.orchestra.run.smithi045.stdout: -5768> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d828d80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5849 cv=5553/5553 ap=77+77 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=148 | child=1 dirty=1 authpin=1 0x55576d056400] count now 77 2023-10-03T19:21:02.298 INFO:teuthology.orchestra.run.smithi045.stdout: -5767> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000590) auth_unpin by 0x55576d828d80 on [inode 0x10000000590 [2,head] /dc-dir/dc-file_923 auth v5848 s=3 n(v0 rc2023-10-03T19:16:12.462885+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d743180] now 0 2023-10-03T19:21:02.298 INFO:teuthology.orchestra.run.smithi045.stdout: -5766> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5849 cv=5553/5553 ap=77+76 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=148 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d828d80 count now 77/76 2023-10-03T19:21:02.298 INFO:teuthology.orchestra.run.smithi045.stdout: -5765> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.298 INFO:teuthology.orchestra.run.smithi045.stdout: -5764> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.298 INFO:teuthology.orchestra.run.smithi045.stdout: -5763> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000591 [2,head] /dc-dir/dc-file_924 auth v4638 pv5850 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.475000+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.475000+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d743700] 2023-10-03T19:21:02.298 INFO:teuthology.orchestra.run.smithi045.stdout: -5762> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5856 2023-10-03T19:21:02.298 INFO:teuthology.orchestra.run.smithi045.stdout: -5761> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5856 pv6006 ap=77 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=77) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=76) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.298 INFO:teuthology.orchestra.run.smithi045.stdout: -5760> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5854 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.299 INFO:teuthology.orchestra.run.smithi045.stdout: -5759> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5855 cv=5559/5559 REP dir_auth=0 ap=76+77 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5855 2023-10-03T19:21:02.299 INFO:teuthology.orchestra.run.smithi045.stdout: -5758> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000591) pop_and_dirty_projected_inode v5850 2023-10-03T19:21:02.299 INFO:teuthology.orchestra.run.smithi045.stdout: -5757> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000591) mark_dirty [inode 0x10000000591 [2,head] /dc-dir/dc-file_924 auth v5850 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.475000+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d743700] 2023-10-03T19:21:02.321 INFO:teuthology.orchestra.run.smithi045.stdout: -5756> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_924) mark_dirty [dentry #0x1/dc-dir/dc-file_924 [2,head] auth (dversion lock) pv=5850 v=4638 ino=0x10000000591 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d746280] 2023-10-03T19:21:02.321 INFO:teuthology.orchestra.run.smithi045.stdout: -5755> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5849 cv=5553/5553 ap=77+76 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=149 | child=1 dirty=1 authpin=1 0x55576d056400] version 5849 2023-10-03T19:21:02.321 INFO:teuthology.orchestra.run.smithi045.stdout: -5754> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d4a97c0 v5857 2023-10-03T19:21:02.321 INFO:teuthology.orchestra.run.smithi045.stdout: -5753> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5857 cv=5559/5559 REP dir_auth=0 ap=76+77 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5857 2023-10-03T19:21:02.322 INFO:teuthology.orchestra.run.smithi045.stdout: -5752> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d5284a0 v5851 2023-10-03T19:21:02.322 INFO:teuthology.orchestra.run.smithi045.stdout: -5751> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5851 cv=5553/5553 ap=77+76 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=149 | child=1 dirty=1 authpin=1 0x55576d056400] version 5851 2023-10-03T19:21:02.322 INFO:teuthology.orchestra.run.smithi045.stdout: -5750> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=76 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=76 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.322 INFO:teuthology.orchestra.run.smithi045.stdout: -5749> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=76) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5856 pv6006 ap=77 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=77) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=76) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.322 INFO:teuthology.orchestra.run.smithi045.stdout: -5748> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=77) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5856 pv6006 ap=77 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=77) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=75) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.322 INFO:teuthology.orchestra.run.smithi045.stdout: -5747> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000591 [2,head] /dc-dir/dc-file_924 auth v5850 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.475000+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d743700] 2023-10-03T19:21:02.322 INFO:teuthology.orchestra.run.smithi045.stdout: -5746> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000591 [2,head] /dc-dir/dc-file_924 auth v5850 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.475000+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d743700] 2023-10-03T19:21:02.322 INFO:teuthology.orchestra.run.smithi045.stdout: -5745> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.322 INFO:teuthology.orchestra.run.smithi045.stdout: -5744> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.322 INFO:teuthology.orchestra.run.smithi045.stdout: -5743> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.322 INFO:teuthology.orchestra.run.smithi045.stdout: -5742> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000591 [2,head] /dc-dir/dc-file_924 auth v5850 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.475000+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d743700] 2023-10-03T19:21:02.323 INFO:teuthology.orchestra.run.smithi045.stdout: -5741> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000591 [2,head] /dc-dir/dc-file_924 auth v5850 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.475000+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d743700] 2023-10-03T19:21:02.323 INFO:teuthology.orchestra.run.smithi045.stdout: -5740> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.323 INFO:teuthology.orchestra.run.smithi045.stdout: -5739> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 338.273, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.38e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:679.5] 2023-10-03T19:21:02.323 INFO:teuthology.orchestra.run.smithi045.stdout: -5738> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d54f680 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5856 pv6006 ap=76 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=76) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=75) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 76 2023-10-03T19:21:02.323 INFO:teuthology.orchestra.run.smithi045.stdout: -5737> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5857 cv=5559/5559 REP dir_auth=0 ap=76+76 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d54f680 count now 76/76 2023-10-03T19:21:02.323 INFO:teuthology.orchestra.run.smithi045.stdout: -5736> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d54f680 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5851 cv=5553/5553 ap=76+76 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=149 | child=1 dirty=1 authpin=1 0x55576d056400] count now 76 2023-10-03T19:21:02.323 INFO:teuthology.orchestra.run.smithi045.stdout: -5735> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d54f680 on [dir 0x1 / [2,head] auth pv=6007 v=5857 cv=5559/5559 REP dir_auth=0 ap=75+76 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 75 2023-10-03T19:21:02.323 INFO:teuthology.orchestra.run.smithi045.stdout: -5734> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000591) auth_unpin by 0x55576d54f680 on [inode 0x10000000591 [2,head] /dc-dir/dc-file_924 auth v5850 s=3 n(v0 rc2023-10-03T19:16:12.475000+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d743700] now 0 2023-10-03T19:21:02.323 INFO:teuthology.orchestra.run.smithi045.stdout: -5733> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5851 cv=5553/5553 ap=76+75 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=149 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d54f680 count now 76/75 2023-10-03T19:21:02.323 INFO:teuthology.orchestra.run.smithi045.stdout: -5732> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.323 INFO:teuthology.orchestra.run.smithi045.stdout: -5731> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.323 INFO:teuthology.orchestra.run.smithi045.stdout: -5730> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000592 [2,head] /dc-dir/dc-file_925 auth v4642 pv5852 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.486873+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.486873+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d748000] 2023-10-03T19:21:02.324 INFO:teuthology.orchestra.run.smithi045.stdout: -5729> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5858 2023-10-03T19:21:02.324 INFO:teuthology.orchestra.run.smithi045.stdout: -5728> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5858 pv6006 ap=76 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=76) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=75) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.324 INFO:teuthology.orchestra.run.smithi045.stdout: -5727> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5856 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.324 INFO:teuthology.orchestra.run.smithi045.stdout: -5726> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5857 cv=5559/5559 REP dir_auth=0 ap=75+76 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5857 2023-10-03T19:21:02.324 INFO:teuthology.orchestra.run.smithi045.stdout: -5725> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000592) pop_and_dirty_projected_inode v5852 2023-10-03T19:21:02.324 INFO:teuthology.orchestra.run.smithi045.stdout: -5724> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000592) mark_dirty [inode 0x10000000592 [2,head] /dc-dir/dc-file_925 auth v5852 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.486873+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d748000] 2023-10-03T19:21:02.324 INFO:teuthology.orchestra.run.smithi045.stdout: -5723> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_925) mark_dirty [dentry #0x1/dc-dir/dc-file_925 [2,head] auth (dversion lock) pv=5852 v=4642 ino=0x10000000592 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d746500] 2023-10-03T19:21:02.324 INFO:teuthology.orchestra.run.smithi045.stdout: -5722> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5851 cv=5553/5553 ap=76+75 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=150 | child=1 dirty=1 authpin=1 0x55576d056400] version 5851 2023-10-03T19:21:02.324 INFO:teuthology.orchestra.run.smithi045.stdout: -5721> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d4a9a00 v5859 2023-10-03T19:21:02.324 INFO:teuthology.orchestra.run.smithi045.stdout: -5720> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5859 cv=5559/5559 REP dir_auth=0 ap=75+76 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5859 2023-10-03T19:21:02.324 INFO:teuthology.orchestra.run.smithi045.stdout: -5719> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d554140 v5853 2023-10-03T19:21:02.325 INFO:teuthology.orchestra.run.smithi045.stdout: -5718> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5853 cv=5553/5553 ap=76+75 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=150 | child=1 dirty=1 authpin=1 0x55576d056400] version 5853 2023-10-03T19:21:02.325 INFO:teuthology.orchestra.run.smithi045.stdout: -5717> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=75 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=75 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.325 INFO:teuthology.orchestra.run.smithi045.stdout: -5716> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=75) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5858 pv6006 ap=76 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=76) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=75) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.325 INFO:teuthology.orchestra.run.smithi045.stdout: -5715> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=76) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5858 pv6006 ap=76 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=76) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=74) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.325 INFO:teuthology.orchestra.run.smithi045.stdout: -5714> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000592 [2,head] /dc-dir/dc-file_925 auth v5852 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.486873+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d748000] 2023-10-03T19:21:02.325 INFO:teuthology.orchestra.run.smithi045.stdout: -5713> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000592 [2,head] /dc-dir/dc-file_925 auth v5852 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.486873+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d748000] 2023-10-03T19:21:02.325 INFO:teuthology.orchestra.run.smithi045.stdout: -5712> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.325 INFO:teuthology.orchestra.run.smithi045.stdout: -5711> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.325 INFO:teuthology.orchestra.run.smithi045.stdout: -5710> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.325 INFO:teuthology.orchestra.run.smithi045.stdout: -5709> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000592 [2,head] /dc-dir/dc-file_925 auth v5852 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.486873+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d748000] 2023-10-03T19:21:02.325 INFO:teuthology.orchestra.run.smithi045.stdout: -5708> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000592 [2,head] /dc-dir/dc-file_925 auth v5852 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.486873+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d748000] 2023-10-03T19:21:02.326 INFO:teuthology.orchestra.run.smithi045.stdout: -5707> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.326 INFO:teuthology.orchestra.run.smithi045.stdout: -5706> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 339.273, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.39e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:681.5] 2023-10-03T19:21:02.326 INFO:teuthology.orchestra.run.smithi045.stdout: -5705> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2a5200 on [dir 0x1 / [2,head] auth pv=6007 v=5859 cv=5559/5559 REP dir_auth=0 ap=74+76 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 74 2023-10-03T19:21:02.326 INFO:teuthology.orchestra.run.smithi045.stdout: -5704> 2023-10-03T19:16:28.790+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2a5200 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5858 pv6006 ap=75 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=75) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=74) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 75 2023-10-03T19:21:02.326 INFO:teuthology.orchestra.run.smithi045.stdout: -5703> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5859 cv=5559/5559 REP dir_auth=0 ap=74+75 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2a5200 count now 74/75 2023-10-03T19:21:02.326 INFO:teuthology.orchestra.run.smithi045.stdout: -5702> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2a5200 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5853 cv=5553/5553 ap=75+75 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=150 | child=1 dirty=1 authpin=1 0x55576d056400] count now 75 2023-10-03T19:21:02.326 INFO:teuthology.orchestra.run.smithi045.stdout: -5701> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000592) auth_unpin by 0x55576d2a5200 on [inode 0x10000000592 [2,head] /dc-dir/dc-file_925 auth v5852 s=3 n(v0 rc2023-10-03T19:16:12.486873+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d748000] now 0 2023-10-03T19:21:02.326 INFO:teuthology.orchestra.run.smithi045.stdout: -5700> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5853 cv=5553/5553 ap=75+74 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=150 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2a5200 count now 75/74 2023-10-03T19:21:02.431 INFO:teuthology.orchestra.run.smithi045.stdout: -5699> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.431 INFO:teuthology.orchestra.run.smithi045.stdout: -5698> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.431 INFO:teuthology.orchestra.run.smithi045.stdout: -5697> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000593 [2,head] /dc-dir/dc-file_926 auth v4816 pv5854 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.498507+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.498507+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d748580] 2023-10-03T19:21:02.431 INFO:teuthology.orchestra.run.smithi045.stdout: -5696> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5860 2023-10-03T19:21:02.431 INFO:teuthology.orchestra.run.smithi045.stdout: -5695> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5860 pv6006 ap=75 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=75) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=74) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.431 INFO:teuthology.orchestra.run.smithi045.stdout: -5694> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5858 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.431 INFO:teuthology.orchestra.run.smithi045.stdout: -5693> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5859 cv=5559/5559 REP dir_auth=0 ap=74+75 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5859 2023-10-03T19:21:02.432 INFO:teuthology.orchestra.run.smithi045.stdout: -5692> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000593) pop_and_dirty_projected_inode v5854 2023-10-03T19:21:02.432 INFO:teuthology.orchestra.run.smithi045.stdout: -5691> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000593) mark_dirty [inode 0x10000000593 [2,head] /dc-dir/dc-file_926 auth v5854 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.498507+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d748580] 2023-10-03T19:21:02.432 INFO:teuthology.orchestra.run.smithi045.stdout: -5690> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_926) mark_dirty [dentry #0x1/dc-dir/dc-file_926 [2,head] auth (dversion lock) pv=5854 v=4816 ino=0x10000000593 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d746780] 2023-10-03T19:21:02.432 INFO:teuthology.orchestra.run.smithi045.stdout: -5689> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5853 cv=5553/5553 ap=75+74 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=151 | child=1 dirty=1 authpin=1 0x55576d056400] version 5853 2023-10-03T19:21:02.432 INFO:teuthology.orchestra.run.smithi045.stdout: -5688> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d529a00 v5861 2023-10-03T19:21:02.432 INFO:teuthology.orchestra.run.smithi045.stdout: -5687> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5861 cv=5559/5559 REP dir_auth=0 ap=74+75 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5861 2023-10-03T19:21:02.432 INFO:teuthology.orchestra.run.smithi045.stdout: -5686> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d5545c0 v5855 2023-10-03T19:21:02.432 INFO:teuthology.orchestra.run.smithi045.stdout: -5685> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5855 cv=5553/5553 ap=75+74 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=151 | child=1 dirty=1 authpin=1 0x55576d056400] version 5855 2023-10-03T19:21:02.432 INFO:teuthology.orchestra.run.smithi045.stdout: -5684> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=74 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=74 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.432 INFO:teuthology.orchestra.run.smithi045.stdout: -5683> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=74) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5860 pv6006 ap=75 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=75) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=74) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.433 INFO:teuthology.orchestra.run.smithi045.stdout: -5682> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=75) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5860 pv6006 ap=75 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=75) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=73) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.433 INFO:teuthology.orchestra.run.smithi045.stdout: -5681> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000593 [2,head] /dc-dir/dc-file_926 auth v5854 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.498507+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d748580] 2023-10-03T19:21:02.433 INFO:teuthology.orchestra.run.smithi045.stdout: -5680> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000593 [2,head] /dc-dir/dc-file_926 auth v5854 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.498507+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d748580] 2023-10-03T19:21:02.433 INFO:teuthology.orchestra.run.smithi045.stdout: -5679> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.433 INFO:teuthology.orchestra.run.smithi045.stdout: -5678> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.433 INFO:teuthology.orchestra.run.smithi045.stdout: -5677> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.433 INFO:teuthology.orchestra.run.smithi045.stdout: -5676> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000593 [2,head] /dc-dir/dc-file_926 auth v5854 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.498507+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d748580] 2023-10-03T19:21:02.433 INFO:teuthology.orchestra.run.smithi045.stdout: -5675> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000593 [2,head] /dc-dir/dc-file_926 auth v5854 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.498507+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d748580] 2023-10-03T19:21:02.433 INFO:teuthology.orchestra.run.smithi045.stdout: -5674> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.433 INFO:teuthology.orchestra.run.smithi045.stdout: -5673> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 340.085, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.40e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:683.2] 2023-10-03T19:21:02.433 INFO:teuthology.orchestra.run.smithi045.stdout: -5672> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d54e900 on [dir 0x1 / [2,head] auth pv=6007 v=5861 cv=5559/5559 REP dir_auth=0 ap=73+75 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 73 2023-10-03T19:21:02.434 INFO:teuthology.orchestra.run.smithi045.stdout: -5671> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d54e900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5860 pv6006 ap=74 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=74) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=73) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 74 2023-10-03T19:21:02.434 INFO:teuthology.orchestra.run.smithi045.stdout: -5670> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5861 cv=5559/5559 REP dir_auth=0 ap=73+74 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d54e900 count now 73/74 2023-10-03T19:21:02.434 INFO:teuthology.orchestra.run.smithi045.stdout: -5669> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d54e900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5855 cv=5553/5553 ap=74+74 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=151 | child=1 dirty=1 authpin=1 0x55576d056400] count now 74 2023-10-03T19:21:02.434 INFO:teuthology.orchestra.run.smithi045.stdout: -5668> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000593) auth_unpin by 0x55576d54e900 on [inode 0x10000000593 [2,head] /dc-dir/dc-file_926 auth v5854 s=3 n(v0 rc2023-10-03T19:16:12.498507+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d748580] now 0 2023-10-03T19:21:02.434 INFO:teuthology.orchestra.run.smithi045.stdout: -5667> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5855 cv=5553/5553 ap=74+73 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=151 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d54e900 count now 74/73 2023-10-03T19:21:02.434 INFO:teuthology.orchestra.run.smithi045.stdout: -5666> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.434 INFO:teuthology.orchestra.run.smithi045.stdout: -5665> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.434 INFO:teuthology.orchestra.run.smithi045.stdout: -5664> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000594 [2,head] /dc-dir/dc-file_927 auth v4820 pv5856 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.621771+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.621771+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d748b00] 2023-10-03T19:21:02.434 INFO:teuthology.orchestra.run.smithi045.stdout: -5663> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5862 2023-10-03T19:21:02.435 INFO:teuthology.orchestra.run.smithi045.stdout: -5662> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5862 pv6006 ap=74 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=74) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=73) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.435 INFO:teuthology.orchestra.run.smithi045.stdout: -5661> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5860 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.435 INFO:teuthology.orchestra.run.smithi045.stdout: -5660> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5861 cv=5559/5559 REP dir_auth=0 ap=73+74 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5861 2023-10-03T19:21:02.435 INFO:teuthology.orchestra.run.smithi045.stdout: -5659> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000594) pop_and_dirty_projected_inode v5856 2023-10-03T19:21:02.435 INFO:teuthology.orchestra.run.smithi045.stdout: -5658> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000594) mark_dirty [inode 0x10000000594 [2,head] /dc-dir/dc-file_927 auth v5856 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.621771+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d748b00] 2023-10-03T19:21:02.435 INFO:teuthology.orchestra.run.smithi045.stdout: -5657> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_927) mark_dirty [dentry #0x1/dc-dir/dc-file_927 [2,head] auth (dversion lock) pv=5856 v=4820 ino=0x10000000594 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d746a00] 2023-10-03T19:21:02.435 INFO:teuthology.orchestra.run.smithi045.stdout: -5656> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5855 cv=5553/5553 ap=74+73 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=152 | child=1 dirty=1 authpin=1 0x55576d056400] version 5855 2023-10-03T19:21:02.435 INFO:teuthology.orchestra.run.smithi045.stdout: -5655> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d529e80 v5863 2023-10-03T19:21:02.435 INFO:teuthology.orchestra.run.smithi045.stdout: -5654> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5863 cv=5559/5559 REP dir_auth=0 ap=73+74 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5863 2023-10-03T19:21:02.435 INFO:teuthology.orchestra.run.smithi045.stdout: -5653> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d554a40 v5857 2023-10-03T19:21:02.435 INFO:teuthology.orchestra.run.smithi045.stdout: -5652> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5857 cv=5553/5553 ap=74+73 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=152 | child=1 dirty=1 authpin=1 0x55576d056400] version 5857 2023-10-03T19:21:02.436 INFO:teuthology.orchestra.run.smithi045.stdout: -5651> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=73 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=73 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.436 INFO:teuthology.orchestra.run.smithi045.stdout: -5650> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=73) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5862 pv6006 ap=74 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=74) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=73) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.436 INFO:teuthology.orchestra.run.smithi045.stdout: -5649> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=74) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5862 pv6006 ap=74 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=74) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=72) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.436 INFO:teuthology.orchestra.run.smithi045.stdout: -5648> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000594 [2,head] /dc-dir/dc-file_927 auth v5856 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.621771+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d748b00] 2023-10-03T19:21:02.436 INFO:teuthology.orchestra.run.smithi045.stdout: -5647> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000594 [2,head] /dc-dir/dc-file_927 auth v5856 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.621771+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d748b00] 2023-10-03T19:21:02.436 INFO:teuthology.orchestra.run.smithi045.stdout: -5646> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.436 INFO:teuthology.orchestra.run.smithi045.stdout: -5645> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.436 INFO:teuthology.orchestra.run.smithi045.stdout: -5644> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.436 INFO:teuthology.orchestra.run.smithi045.stdout: -5643> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000594 [2,head] /dc-dir/dc-file_927 auth v5856 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.621771+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d748b00] 2023-10-03T19:21:02.436 INFO:teuthology.orchestra.run.smithi045.stdout: -5642> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000594 [2,head] /dc-dir/dc-file_927 auth v5856 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.621771+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d748b00] 2023-10-03T19:21:02.440 INFO:teuthology.orchestra.run.smithi045.stdout: -5641> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.440 INFO:teuthology.orchestra.run.smithi045.stdout: -5640> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 341.085, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.41e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:685.2] 2023-10-03T19:21:02.440 INFO:teuthology.orchestra.run.smithi045.stdout: -5639> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2b2b40 on [dir 0x1 / [2,head] auth pv=6007 v=5863 cv=5559/5559 REP dir_auth=0 ap=72+74 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 72 2023-10-03T19:21:02.440 INFO:teuthology.orchestra.run.smithi045.stdout: -5638> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2b2b40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5862 pv6006 ap=73 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=73) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=72) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 73 2023-10-03T19:21:02.441 INFO:teuthology.orchestra.run.smithi045.stdout: -5637> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5863 cv=5559/5559 REP dir_auth=0 ap=72+73 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2b2b40 count now 72/73 2023-10-03T19:21:02.441 INFO:teuthology.orchestra.run.smithi045.stdout: -5636> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2b2b40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5857 cv=5553/5553 ap=73+73 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=152 | child=1 dirty=1 authpin=1 0x55576d056400] count now 73 2023-10-03T19:21:02.441 INFO:teuthology.orchestra.run.smithi045.stdout: -5635> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000594) auth_unpin by 0x55576d2b2b40 on [inode 0x10000000594 [2,head] /dc-dir/dc-file_927 auth v5856 s=3 n(v0 rc2023-10-03T19:16:12.621771+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d748b00] now 0 2023-10-03T19:21:02.441 INFO:teuthology.orchestra.run.smithi045.stdout: -5634> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5857 cv=5553/5553 ap=73+72 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=152 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2b2b40 count now 73/72 2023-10-03T19:21:02.441 INFO:teuthology.orchestra.run.smithi045.stdout: -5633> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.441 INFO:teuthology.orchestra.run.smithi045.stdout: -5632> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.441 INFO:teuthology.orchestra.run.smithi045.stdout: -5631> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000595 [2,head] /dc-dir/dc-file_928 auth v4824 pv5858 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.632834+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.632834+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d749080] 2023-10-03T19:21:02.441 INFO:teuthology.orchestra.run.smithi045.stdout: -5630> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5864 2023-10-03T19:21:02.441 INFO:teuthology.orchestra.run.smithi045.stdout: -5629> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5864 pv6006 ap=73 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=73) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=72) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.441 INFO:teuthology.orchestra.run.smithi045.stdout: -5628> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5862 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.442 INFO:teuthology.orchestra.run.smithi045.stdout: -5627> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5863 cv=5559/5559 REP dir_auth=0 ap=72+73 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5863 2023-10-03T19:21:02.442 INFO:teuthology.orchestra.run.smithi045.stdout: -5626> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000595) pop_and_dirty_projected_inode v5858 2023-10-03T19:21:02.442 INFO:teuthology.orchestra.run.smithi045.stdout: -5625> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000595) mark_dirty [inode 0x10000000595 [2,head] /dc-dir/dc-file_928 auth v5858 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.632834+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d749080] 2023-10-03T19:21:02.442 INFO:teuthology.orchestra.run.smithi045.stdout: -5624> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_928) mark_dirty [dentry #0x1/dc-dir/dc-file_928 [2,head] auth (dversion lock) pv=5858 v=4824 ino=0x10000000595 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d746c80] 2023-10-03T19:21:02.442 INFO:teuthology.orchestra.run.smithi045.stdout: -5623> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5857 cv=5553/5553 ap=73+72 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=153 | child=1 dirty=1 authpin=1 0x55576d056400] version 5857 2023-10-03T19:21:02.442 INFO:teuthology.orchestra.run.smithi045.stdout: -5622> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d554c80 v5865 2023-10-03T19:21:02.459 INFO:teuthology.orchestra.run.smithi045.stdout: -5621> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5865 cv=5559/5559 REP dir_auth=0 ap=72+73 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5865 2023-10-03T19:21:02.459 INFO:teuthology.orchestra.run.smithi045.stdout: -5620> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d536140 v5859 2023-10-03T19:21:02.459 INFO:teuthology.orchestra.run.smithi045.stdout: -5619> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5859 cv=5553/5553 ap=73+72 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=153 | child=1 dirty=1 authpin=1 0x55576d056400] version 5859 2023-10-03T19:21:02.459 INFO:teuthology.orchestra.run.smithi045.stdout: -5618> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=72 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=72 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.459 INFO:teuthology.orchestra.run.smithi045.stdout: -5617> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=72) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5864 pv6006 ap=73 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=73) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=72) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.459 INFO:teuthology.orchestra.run.smithi045.stdout: -5616> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=73) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5864 pv6006 ap=73 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=73) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=71) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.459 INFO:teuthology.orchestra.run.smithi045.stdout: -5615> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000595 [2,head] /dc-dir/dc-file_928 auth v5858 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.632834+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d749080] 2023-10-03T19:21:02.459 INFO:teuthology.orchestra.run.smithi045.stdout: -5614> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000595 [2,head] /dc-dir/dc-file_928 auth v5858 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.632834+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d749080] 2023-10-03T19:21:02.482 INFO:teuthology.orchestra.run.smithi045.stdout: -5613> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.482 INFO:teuthology.orchestra.run.smithi045.stdout: -5612> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.482 INFO:teuthology.orchestra.run.smithi045.stdout: -5611> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.482 INFO:teuthology.orchestra.run.smithi045.stdout: -5610> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000595 [2,head] /dc-dir/dc-file_928 auth v5858 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.632834+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d749080] 2023-10-03T19:21:02.482 INFO:teuthology.orchestra.run.smithi045.stdout: -5609> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000595 [2,head] /dc-dir/dc-file_928 auth v5858 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.632834+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d749080] 2023-10-03T19:21:02.482 INFO:teuthology.orchestra.run.smithi045.stdout: -5608> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.483 INFO:teuthology.orchestra.run.smithi045.stdout: -5607> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 342.085, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.42e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:687.2] 2023-10-03T19:21:02.483 INFO:teuthology.orchestra.run.smithi045.stdout: -5606> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d52e240 on [dir 0x1 / [2,head] auth pv=6007 v=5865 cv=5559/5559 REP dir_auth=0 ap=71+73 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 71 2023-10-03T19:21:02.483 INFO:teuthology.orchestra.run.smithi045.stdout: -5605> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d52e240 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5864 pv6006 ap=72 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=72) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=71) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 72 2023-10-03T19:21:02.483 INFO:teuthology.orchestra.run.smithi045.stdout: -5604> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5865 cv=5559/5559 REP dir_auth=0 ap=71+72 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d52e240 count now 71/72 2023-10-03T19:21:02.483 INFO:teuthology.orchestra.run.smithi045.stdout: -5603> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d52e240 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5859 cv=5553/5553 ap=72+72 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=153 | child=1 dirty=1 authpin=1 0x55576d056400] count now 72 2023-10-03T19:21:02.483 INFO:teuthology.orchestra.run.smithi045.stdout: -5602> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000595) auth_unpin by 0x55576d52e240 on [inode 0x10000000595 [2,head] /dc-dir/dc-file_928 auth v5858 s=3 n(v0 rc2023-10-03T19:16:12.632834+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d749080] now 0 2023-10-03T19:21:02.483 INFO:teuthology.orchestra.run.smithi045.stdout: -5601> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5859 cv=5553/5553 ap=72+71 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=153 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d52e240 count now 72/71 2023-10-03T19:21:02.483 INFO:teuthology.orchestra.run.smithi045.stdout: -5600> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.483 INFO:teuthology.orchestra.run.smithi045.stdout: -5599> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.483 INFO:teuthology.orchestra.run.smithi045.stdout: -5598> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000596 [2,head] /dc-dir/dc-file_929 auth v4828 pv5860 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.644045+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.644045+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d749600] 2023-10-03T19:21:02.484 INFO:teuthology.orchestra.run.smithi045.stdout: -5597> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5866 2023-10-03T19:21:02.484 INFO:teuthology.orchestra.run.smithi045.stdout: -5596> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5866 pv6006 ap=72 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=72) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=71) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.484 INFO:teuthology.orchestra.run.smithi045.stdout: -5595> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5864 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.484 INFO:teuthology.orchestra.run.smithi045.stdout: -5594> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5865 cv=5559/5559 REP dir_auth=0 ap=71+72 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5865 2023-10-03T19:21:02.484 INFO:teuthology.orchestra.run.smithi045.stdout: -5593> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000596) pop_and_dirty_projected_inode v5860 2023-10-03T19:21:02.484 INFO:teuthology.orchestra.run.smithi045.stdout: -5592> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000596) mark_dirty [inode 0x10000000596 [2,head] /dc-dir/dc-file_929 auth v5860 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.644045+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d749600] 2023-10-03T19:21:02.484 INFO:teuthology.orchestra.run.smithi045.stdout: -5591> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_929) mark_dirty [dentry #0x1/dc-dir/dc-file_929 [2,head] auth (dversion lock) pv=5860 v=4828 ino=0x10000000596 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d746f00] 2023-10-03T19:21:02.484 INFO:teuthology.orchestra.run.smithi045.stdout: -5590> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5859 cv=5553/5553 ap=72+71 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=154 | child=1 dirty=1 authpin=1 0x55576d056400] version 5859 2023-10-03T19:21:02.484 INFO:teuthology.orchestra.run.smithi045.stdout: -5589> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d554800 v5867 2023-10-03T19:21:02.484 INFO:teuthology.orchestra.run.smithi045.stdout: -5588> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5867 cv=5559/5559 REP dir_auth=0 ap=71+72 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5867 2023-10-03T19:21:02.485 INFO:teuthology.orchestra.run.smithi045.stdout: -5587> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d529c40 v5861 2023-10-03T19:21:02.485 INFO:teuthology.orchestra.run.smithi045.stdout: -5586> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5861 cv=5553/5553 ap=72+71 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=154 | child=1 dirty=1 authpin=1 0x55576d056400] version 5861 2023-10-03T19:21:02.485 INFO:teuthology.orchestra.run.smithi045.stdout: -5585> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=71 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=71 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.485 INFO:teuthology.orchestra.run.smithi045.stdout: -5584> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=71) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5866 pv6006 ap=72 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=72) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=71) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.485 INFO:teuthology.orchestra.run.smithi045.stdout: -5583> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=72) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5866 pv6006 ap=72 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=72) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=70) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.485 INFO:teuthology.orchestra.run.smithi045.stdout: -5582> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000596 [2,head] /dc-dir/dc-file_929 auth v5860 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.644045+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d749600] 2023-10-03T19:21:02.485 INFO:teuthology.orchestra.run.smithi045.stdout: -5581> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000596 [2,head] /dc-dir/dc-file_929 auth v5860 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.644045+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d749600] 2023-10-03T19:21:02.485 INFO:teuthology.orchestra.run.smithi045.stdout: -5580> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.485 INFO:teuthology.orchestra.run.smithi045.stdout: -5579> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.485 INFO:teuthology.orchestra.run.smithi045.stdout: -5578> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.485 INFO:teuthology.orchestra.run.smithi045.stdout: -5577> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000596 [2,head] /dc-dir/dc-file_929 auth v5860 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.644045+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d749600] 2023-10-03T19:21:02.486 INFO:teuthology.orchestra.run.smithi045.stdout: -5576> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000596 [2,head] /dc-dir/dc-file_929 auth v5860 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.644045+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d749600] 2023-10-03T19:21:02.486 INFO:teuthology.orchestra.run.smithi045.stdout: -5575> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.486 INFO:teuthology.orchestra.run.smithi045.stdout: -5574> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 343.085, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.43e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:689.2] 2023-10-03T19:21:02.486 INFO:teuthology.orchestra.run.smithi045.stdout: -5573> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d5ca480 on [dir 0x1 / [2,head] auth pv=6007 v=5867 cv=5559/5559 REP dir_auth=0 ap=70+72 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 70 2023-10-03T19:21:02.486 INFO:teuthology.orchestra.run.smithi045.stdout: -5572> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d5ca480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5866 pv6006 ap=71 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=71) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=70) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 71 2023-10-03T19:21:02.486 INFO:teuthology.orchestra.run.smithi045.stdout: -5571> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5867 cv=5559/5559 REP dir_auth=0 ap=70+71 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d5ca480 count now 70/71 2023-10-03T19:21:02.486 INFO:teuthology.orchestra.run.smithi045.stdout: -5570> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d5ca480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5861 cv=5553/5553 ap=71+71 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=154 | child=1 dirty=1 authpin=1 0x55576d056400] count now 71 2023-10-03T19:21:02.486 INFO:teuthology.orchestra.run.smithi045.stdout: -5569> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000596) auth_unpin by 0x55576d5ca480 on [inode 0x10000000596 [2,head] /dc-dir/dc-file_929 auth v5860 s=3 n(v0 rc2023-10-03T19:16:12.644045+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d749600] now 0 2023-10-03T19:21:02.486 INFO:teuthology.orchestra.run.smithi045.stdout: -5568> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5861 cv=5553/5553 ap=71+70 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=154 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d5ca480 count now 71/70 2023-10-03T19:21:02.487 INFO:teuthology.orchestra.run.smithi045.stdout: -5567> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.487 INFO:teuthology.orchestra.run.smithi045.stdout: -5566> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.487 INFO:teuthology.orchestra.run.smithi045.stdout: -5565> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000597 [2,head] /dc-dir/dc-file_930 auth v4832 pv5862 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.656159+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.656159+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d749b80] 2023-10-03T19:21:02.487 INFO:teuthology.orchestra.run.smithi045.stdout: -5564> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5868 2023-10-03T19:21:02.487 INFO:teuthology.orchestra.run.smithi045.stdout: -5563> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5868 pv6006 ap=71 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=71) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=70) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.487 INFO:teuthology.orchestra.run.smithi045.stdout: -5562> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5866 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.487 INFO:teuthology.orchestra.run.smithi045.stdout: -5561> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5867 cv=5559/5559 REP dir_auth=0 ap=70+71 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5867 2023-10-03T19:21:02.487 INFO:teuthology.orchestra.run.smithi045.stdout: -5560> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000597) pop_and_dirty_projected_inode v5862 2023-10-03T19:21:02.487 INFO:teuthology.orchestra.run.smithi045.stdout: -5559> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000597) mark_dirty [inode 0x10000000597 [2,head] /dc-dir/dc-file_930 auth v5862 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.656159+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d749b80] 2023-10-03T19:21:02.487 INFO:teuthology.orchestra.run.smithi045.stdout: -5558> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_930) mark_dirty [dentry #0x1/dc-dir/dc-file_930 [2,head] auth (dversion lock) pv=5862 v=4832 ino=0x10000000597 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d747180] 2023-10-03T19:21:02.487 INFO:teuthology.orchestra.run.smithi045.stdout: -5557> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5861 cv=5553/5553 ap=71+70 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=155 | child=1 dirty=1 authpin=1 0x55576d056400] version 5861 2023-10-03T19:21:02.525 INFO:teuthology.orchestra.run.smithi045.stdout: -5556> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d554380 v5869 2023-10-03T19:21:02.525 INFO:teuthology.orchestra.run.smithi045.stdout: -5555> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5869 cv=5559/5559 REP dir_auth=0 ap=70+71 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5869 2023-10-03T19:21:02.525 INFO:teuthology.orchestra.run.smithi045.stdout: -5554> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d5297c0 v5863 2023-10-03T19:21:02.526 INFO:teuthology.orchestra.run.smithi045.stdout: -5553> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5863 cv=5553/5553 ap=71+70 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=155 | child=1 dirty=1 authpin=1 0x55576d056400] version 5863 2023-10-03T19:21:02.526 INFO:teuthology.orchestra.run.smithi045.stdout: -5552> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=70 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=70 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.526 INFO:teuthology.orchestra.run.smithi045.stdout: -5551> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=70) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5868 pv6006 ap=71 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=71) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=70) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.526 INFO:teuthology.orchestra.run.smithi045.stdout: -5550> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=71) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5868 pv6006 ap=71 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=71) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=69) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.526 INFO:teuthology.orchestra.run.smithi045.stdout: -5549> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000597 [2,head] /dc-dir/dc-file_930 auth v5862 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.656159+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d749b80] 2023-10-03T19:21:02.526 INFO:teuthology.orchestra.run.smithi045.stdout: -5548> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000597 [2,head] /dc-dir/dc-file_930 auth v5862 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.656159+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d749b80] 2023-10-03T19:21:02.526 INFO:teuthology.orchestra.run.smithi045.stdout: -5547> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.526 INFO:teuthology.orchestra.run.smithi045.stdout: -5546> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.526 INFO:teuthology.orchestra.run.smithi045.stdout: -5545> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.527 INFO:teuthology.orchestra.run.smithi045.stdout: -5544> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000597 [2,head] /dc-dir/dc-file_930 auth v5862 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.656159+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d749b80] 2023-10-03T19:21:02.527 INFO:teuthology.orchestra.run.smithi045.stdout: -5543> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000597 [2,head] /dc-dir/dc-file_930 auth v5862 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.656159+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d749b80] 2023-10-03T19:21:02.527 INFO:teuthology.orchestra.run.smithi045.stdout: -5542> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.527 INFO:teuthology.orchestra.run.smithi045.stdout: -5541> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 344.085, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.44e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:691.2] 2023-10-03T19:21:02.527 INFO:teuthology.orchestra.run.smithi045.stdout: -5540> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d538240 on [dir 0x1 / [2,head] auth pv=6007 v=5869 cv=5559/5559 REP dir_auth=0 ap=69+71 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 69 2023-10-03T19:21:02.527 INFO:teuthology.orchestra.run.smithi045.stdout: -5539> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d538240 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5863 cv=5553/5553 ap=70+70 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=155 | child=1 dirty=1 authpin=1 0x55576d056400] count now 70 2023-10-03T19:21:02.527 INFO:teuthology.orchestra.run.smithi045.stdout: -5538> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d538240 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5868 pv6006 ap=70 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=70) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=69) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 70 2023-10-03T19:21:02.527 INFO:teuthology.orchestra.run.smithi045.stdout: -5537> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5869 cv=5559/5559 REP dir_auth=0 ap=69+70 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d538240 count now 69/70 2023-10-03T19:21:02.527 INFO:teuthology.orchestra.run.smithi045.stdout: -5536> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000597) auth_unpin by 0x55576d538240 on [inode 0x10000000597 [2,head] /dc-dir/dc-file_930 auth v5862 s=3 n(v0 rc2023-10-03T19:16:12.656159+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d749b80] now 0 2023-10-03T19:21:02.527 INFO:teuthology.orchestra.run.smithi045.stdout: -5535> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5863 cv=5553/5553 ap=70+69 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=155 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d538240 count now 70/69 2023-10-03T19:21:02.528 INFO:teuthology.orchestra.run.smithi045.stdout: -5534> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.528 INFO:teuthology.orchestra.run.smithi045.stdout: -5533> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.528 INFO:teuthology.orchestra.run.smithi045.stdout: -5532> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000598 [2,head] /dc-dir/dc-file_931 auth v4836 pv5864 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.668535+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.668535+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d74a100] 2023-10-03T19:21:02.528 INFO:teuthology.orchestra.run.smithi045.stdout: -5531> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5870 2023-10-03T19:21:02.528 INFO:teuthology.orchestra.run.smithi045.stdout: -5530> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5870 pv6006 ap=70 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=70) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=69) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.528 INFO:teuthology.orchestra.run.smithi045.stdout: -5529> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5868 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.528 INFO:teuthology.orchestra.run.smithi045.stdout: -5528> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5869 cv=5559/5559 REP dir_auth=0 ap=69+70 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5869 2023-10-03T19:21:02.528 INFO:teuthology.orchestra.run.smithi045.stdout: -5527> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000598) pop_and_dirty_projected_inode v5864 2023-10-03T19:21:02.529 INFO:teuthology.orchestra.run.smithi045.stdout: -5526> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000598) mark_dirty [inode 0x10000000598 [2,head] /dc-dir/dc-file_931 auth v5864 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.668535+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d74a100] 2023-10-03T19:21:02.529 INFO:teuthology.orchestra.run.smithi045.stdout: -5525> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_931) mark_dirty [dentry #0x1/dc-dir/dc-file_931 [2,head] auth (dversion lock) pv=5864 v=4836 ino=0x10000000598 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d747400] 2023-10-03T19:21:02.529 INFO:teuthology.orchestra.run.smithi045.stdout: -5524> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5863 cv=5553/5553 ap=70+69 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=156 | child=1 dirty=1 authpin=1 0x55576d056400] version 5863 2023-10-03T19:21:02.529 INFO:teuthology.orchestra.run.smithi045.stdout: -5523> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d54be80 v5871 2023-10-03T19:21:02.529 INFO:teuthology.orchestra.run.smithi045.stdout: -5522> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5871 cv=5559/5559 REP dir_auth=0 ap=69+70 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5871 2023-10-03T19:21:02.529 INFO:teuthology.orchestra.run.smithi045.stdout: -5521> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d529580 v5865 2023-10-03T19:21:02.529 INFO:teuthology.orchestra.run.smithi045.stdout: -5520> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5865 cv=5553/5553 ap=70+69 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=156 | child=1 dirty=1 authpin=1 0x55576d056400] version 5865 2023-10-03T19:21:02.529 INFO:teuthology.orchestra.run.smithi045.stdout: -5519> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=69 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=69 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.529 INFO:teuthology.orchestra.run.smithi045.stdout: -5518> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=69) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5870 pv6006 ap=70 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=70) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=69) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.529 INFO:teuthology.orchestra.run.smithi045.stdout: -5517> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=70) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5870 pv6006 ap=70 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=70) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=68) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.529 INFO:teuthology.orchestra.run.smithi045.stdout: -5516> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000598 [2,head] /dc-dir/dc-file_931 auth v5864 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.668535+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d74a100] 2023-10-03T19:21:02.530 INFO:teuthology.orchestra.run.smithi045.stdout: -5515> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000598 [2,head] /dc-dir/dc-file_931 auth v5864 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.668535+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d74a100] 2023-10-03T19:21:02.530 INFO:teuthology.orchestra.run.smithi045.stdout: -5514> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.530 INFO:teuthology.orchestra.run.smithi045.stdout: -5513> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.530 INFO:teuthology.orchestra.run.smithi045.stdout: -5512> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.530 INFO:teuthology.orchestra.run.smithi045.stdout: -5511> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000598 [2,head] /dc-dir/dc-file_931 auth v5864 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.668535+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d74a100] 2023-10-03T19:21:02.530 INFO:teuthology.orchestra.run.smithi045.stdout: -5510> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000598 [2,head] /dc-dir/dc-file_931 auth v5864 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.668535+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d74a100] 2023-10-03T19:21:02.530 INFO:teuthology.orchestra.run.smithi045.stdout: -5509> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.530 INFO:teuthology.orchestra.run.smithi045.stdout: -5508> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 345.085, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.45e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:693.2] 2023-10-03T19:21:02.530 INFO:teuthology.orchestra.run.smithi045.stdout: -5507> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2b2480 on [dir 0x1 / [2,head] auth pv=6007 v=5871 cv=5559/5559 REP dir_auth=0 ap=68+70 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 68 2023-10-03T19:21:02.531 INFO:teuthology.orchestra.run.smithi045.stdout: -5506> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2b2480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5870 pv6006 ap=69 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=69) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=68) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 69 2023-10-03T19:21:02.599 INFO:teuthology.orchestra.run.smithi045.stdout: -5505> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5871 cv=5559/5559 REP dir_auth=0 ap=68+69 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2b2480 count now 68/69 2023-10-03T19:21:02.600 INFO:teuthology.orchestra.run.smithi045.stdout: -5504> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2b2480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5865 cv=5553/5553 ap=69+69 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=156 | child=1 dirty=1 authpin=1 0x55576d056400] count now 69 2023-10-03T19:21:02.600 INFO:teuthology.orchestra.run.smithi045.stdout: -5503> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000598) auth_unpin by 0x55576d2b2480 on [inode 0x10000000598 [2,head] /dc-dir/dc-file_931 auth v5864 s=3 n(v0 rc2023-10-03T19:16:12.668535+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d74a100] now 0 2023-10-03T19:21:02.600 INFO:teuthology.orchestra.run.smithi045.stdout: -5502> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5865 cv=5553/5553 ap=69+68 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=156 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2b2480 count now 69/68 2023-10-03T19:21:02.600 INFO:teuthology.orchestra.run.smithi045.stdout: -5501> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.600 INFO:teuthology.orchestra.run.smithi045.stdout: -5500> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.600 INFO:teuthology.orchestra.run.smithi045.stdout: -5499> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x10000000599 [2,head] /dc-dir/dc-file_932 auth v4840 pv5866 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.685440+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.685440+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d74a680] 2023-10-03T19:21:02.601 INFO:teuthology.orchestra.run.smithi045.stdout: -5498> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5872 2023-10-03T19:21:02.601 INFO:teuthology.orchestra.run.smithi045.stdout: -5497> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5872 pv6006 ap=69 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=69) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=68) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.601 INFO:teuthology.orchestra.run.smithi045.stdout: -5496> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5870 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.601 INFO:teuthology.orchestra.run.smithi045.stdout: -5495> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5871 cv=5559/5559 REP dir_auth=0 ap=68+69 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5871 2023-10-03T19:21:02.601 INFO:teuthology.orchestra.run.smithi045.stdout: -5494> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000599) pop_and_dirty_projected_inode v5866 2023-10-03T19:21:02.601 INFO:teuthology.orchestra.run.smithi045.stdout: -5493> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000599) mark_dirty [inode 0x10000000599 [2,head] /dc-dir/dc-file_932 auth v5866 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.685440+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d74a680] 2023-10-03T19:21:02.602 INFO:teuthology.orchestra.run.smithi045.stdout: -5492> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_932) mark_dirty [dentry #0x1/dc-dir/dc-file_932 [2,head] auth (dversion lock) pv=5866 v=4840 ino=0x10000000599 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d747680] 2023-10-03T19:21:02.602 INFO:teuthology.orchestra.run.smithi045.stdout: -5491> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5865 cv=5553/5553 ap=69+68 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=157 | child=1 dirty=1 authpin=1 0x55576d056400] version 5865 2023-10-03T19:21:02.602 INFO:teuthology.orchestra.run.smithi045.stdout: -5490> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d54bc40 v5873 2023-10-03T19:21:02.602 INFO:teuthology.orchestra.run.smithi045.stdout: -5489> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5873 cv=5559/5559 REP dir_auth=0 ap=68+69 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5873 2023-10-03T19:21:02.602 INFO:teuthology.orchestra.run.smithi045.stdout: -5488> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d529340 v5867 2023-10-03T19:21:02.602 INFO:teuthology.orchestra.run.smithi045.stdout: -5487> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5867 cv=5553/5553 ap=69+68 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=157 | child=1 dirty=1 authpin=1 0x55576d056400] version 5867 2023-10-03T19:21:02.603 INFO:teuthology.orchestra.run.smithi045.stdout: -5486> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=68 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=68 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.603 INFO:teuthology.orchestra.run.smithi045.stdout: -5485> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=68) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5872 pv6006 ap=69 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=69) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=68) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.603 INFO:teuthology.orchestra.run.smithi045.stdout: -5484> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=69) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5872 pv6006 ap=69 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=69) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=67) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.603 INFO:teuthology.orchestra.run.smithi045.stdout: -5483> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000599 [2,head] /dc-dir/dc-file_932 auth v5866 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.685440+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d74a680] 2023-10-03T19:21:02.604 INFO:teuthology.orchestra.run.smithi045.stdout: -5482> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000599 [2,head] /dc-dir/dc-file_932 auth v5866 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.685440+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d74a680] 2023-10-03T19:21:02.604 INFO:teuthology.orchestra.run.smithi045.stdout: -5481> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.604 INFO:teuthology.orchestra.run.smithi045.stdout: -5480> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.604 INFO:teuthology.orchestra.run.smithi045.stdout: -5479> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.604 INFO:teuthology.orchestra.run.smithi045.stdout: -5478> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000599 [2,head] /dc-dir/dc-file_932 auth v5866 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.685440+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d74a680] 2023-10-03T19:21:02.605 INFO:teuthology.orchestra.run.smithi045.stdout: -5477> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000599 [2,head] /dc-dir/dc-file_932 auth v5866 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.685440+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d74a680] 2023-10-03T19:21:02.605 INFO:teuthology.orchestra.run.smithi045.stdout: -5476> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.605 INFO:teuthology.orchestra.run.smithi045.stdout: -5475> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 346.085, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.46e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:695.2] 2023-10-03T19:21:02.605 INFO:teuthology.orchestra.run.smithi045.stdout: -5474> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d692240 on [dir 0x1 / [2,head] auth pv=6007 v=5873 cv=5559/5559 REP dir_auth=0 ap=67+69 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 67 2023-10-03T19:21:02.605 INFO:teuthology.orchestra.run.smithi045.stdout: -5473> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d692240 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5872 pv6006 ap=68 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=68) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=67) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 68 2023-10-03T19:21:02.605 INFO:teuthology.orchestra.run.smithi045.stdout: -5472> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5873 cv=5559/5559 REP dir_auth=0 ap=67+68 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d692240 count now 67/68 2023-10-03T19:21:02.606 INFO:teuthology.orchestra.run.smithi045.stdout: -5471> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d692240 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5867 cv=5553/5553 ap=68+68 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=157 | child=1 dirty=1 authpin=1 0x55576d056400] count now 68 2023-10-03T19:21:02.606 INFO:teuthology.orchestra.run.smithi045.stdout: -5470> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000599) auth_unpin by 0x55576d692240 on [inode 0x10000000599 [2,head] /dc-dir/dc-file_932 auth v5866 s=3 n(v0 rc2023-10-03T19:16:12.685440+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d74a680] now 0 2023-10-03T19:21:02.606 INFO:teuthology.orchestra.run.smithi045.stdout: -5469> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5867 cv=5553/5553 ap=68+67 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=157 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d692240 count now 68/67 2023-10-03T19:21:02.606 INFO:teuthology.orchestra.run.smithi045.stdout: -5468> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.606 INFO:teuthology.orchestra.run.smithi045.stdout: -5467> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.606 INFO:teuthology.orchestra.run.smithi045.stdout: -5466> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000059a [2,head] /dc-dir/dc-file_933 auth v4844 pv5868 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.697354+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.697354+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d74ac00] 2023-10-03T19:21:02.607 INFO:teuthology.orchestra.run.smithi045.stdout: -5465> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5874 2023-10-03T19:21:02.607 INFO:teuthology.orchestra.run.smithi045.stdout: -5464> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5874 pv6006 ap=68 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=68) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=67) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.607 INFO:teuthology.orchestra.run.smithi045.stdout: -5463> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5872 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.607 INFO:teuthology.orchestra.run.smithi045.stdout: -5462> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5873 cv=5559/5559 REP dir_auth=0 ap=67+68 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5873 2023-10-03T19:21:02.607 INFO:teuthology.orchestra.run.smithi045.stdout: -5461> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000059a) pop_and_dirty_projected_inode v5868 2023-10-03T19:21:02.608 INFO:teuthology.orchestra.run.smithi045.stdout: -5460> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000059a) mark_dirty [inode 0x1000000059a [2,head] /dc-dir/dc-file_933 auth v5868 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.697354+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d74ac00] 2023-10-03T19:21:02.608 INFO:teuthology.orchestra.run.smithi045.stdout: -5459> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_933) mark_dirty [dentry #0x1/dc-dir/dc-file_933 [2,head] auth (dversion lock) pv=5868 v=4844 ino=0x1000000059a state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d747900] 2023-10-03T19:21:02.608 INFO:teuthology.orchestra.run.smithi045.stdout: -5458> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5867 cv=5553/5553 ap=68+67 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=158 | child=1 dirty=1 authpin=1 0x55576d056400] version 5867 2023-10-03T19:21:02.608 INFO:teuthology.orchestra.run.smithi045.stdout: -5457> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d54aa40 v5875 2023-10-03T19:21:02.608 INFO:teuthology.orchestra.run.smithi045.stdout: -5456> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5875 cv=5559/5559 REP dir_auth=0 ap=67+68 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5875 2023-10-03T19:21:02.608 INFO:teuthology.orchestra.run.smithi045.stdout: -5455> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d529100 v5869 2023-10-03T19:21:02.609 INFO:teuthology.orchestra.run.smithi045.stdout: -5454> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5869 cv=5553/5553 ap=68+67 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=158 | child=1 dirty=1 authpin=1 0x55576d056400] version 5869 2023-10-03T19:21:02.609 INFO:teuthology.orchestra.run.smithi045.stdout: -5453> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=67 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=67 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.609 INFO:teuthology.orchestra.run.smithi045.stdout: -5452> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=67) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5874 pv6006 ap=68 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=68) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=67) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.609 INFO:teuthology.orchestra.run.smithi045.stdout: -5451> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=68) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5874 pv6006 ap=68 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=68) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=66) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.609 INFO:teuthology.orchestra.run.smithi045.stdout: -5450> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000059a [2,head] /dc-dir/dc-file_933 auth v5868 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.697354+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d74ac00] 2023-10-03T19:21:02.609 INFO:teuthology.orchestra.run.smithi045.stdout: -5449> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000059a [2,head] /dc-dir/dc-file_933 auth v5868 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.697354+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d74ac00] 2023-10-03T19:21:02.610 INFO:teuthology.orchestra.run.smithi045.stdout: -5448> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.610 INFO:teuthology.orchestra.run.smithi045.stdout: -5447> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.610 INFO:teuthology.orchestra.run.smithi045.stdout: -5446> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.610 INFO:teuthology.orchestra.run.smithi045.stdout: -5445> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000059a [2,head] /dc-dir/dc-file_933 auth v5868 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.697354+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d74ac00] 2023-10-03T19:21:02.613 INFO:teuthology.orchestra.run.smithi045.stdout: -5444> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000059a [2,head] /dc-dir/dc-file_933 auth v5868 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.697354+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d74ac00] 2023-10-03T19:21:02.613 INFO:teuthology.orchestra.run.smithi045.stdout: -5443> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.613 INFO:teuthology.orchestra.run.smithi045.stdout: -5442> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 347.085, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.47e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:697.2] 2023-10-03T19:21:02.613 INFO:teuthology.orchestra.run.smithi045.stdout: -5441> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d5c66c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5874 pv6006 ap=67 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=67) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=66) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 67 2023-10-03T19:21:02.613 INFO:teuthology.orchestra.run.smithi045.stdout: -5440> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5875 cv=5559/5559 REP dir_auth=0 ap=67+67 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d5c66c0 count now 67/67 2023-10-03T19:21:02.613 INFO:teuthology.orchestra.run.smithi045.stdout: -5439> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d5c66c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5869 cv=5553/5553 ap=67+67 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=158 | child=1 dirty=1 authpin=1 0x55576d056400] count now 67 2023-10-03T19:21:02.614 INFO:teuthology.orchestra.run.smithi045.stdout: -5438> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d5c66c0 on [dir 0x1 / [2,head] auth pv=6007 v=5875 cv=5559/5559 REP dir_auth=0 ap=66+67 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 66 2023-10-03T19:21:02.614 INFO:teuthology.orchestra.run.smithi045.stdout: -5437> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000059a) auth_unpin by 0x55576d5c66c0 on [inode 0x1000000059a [2,head] /dc-dir/dc-file_933 auth v5868 s=3 n(v0 rc2023-10-03T19:16:12.697354+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d74ac00] now 0 2023-10-03T19:21:02.614 INFO:teuthology.orchestra.run.smithi045.stdout: -5436> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5869 cv=5553/5553 ap=67+66 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=158 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d5c66c0 count now 67/66 2023-10-03T19:21:02.614 INFO:teuthology.orchestra.run.smithi045.stdout: -5435> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.614 INFO:teuthology.orchestra.run.smithi045.stdout: -5434> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.614 INFO:teuthology.orchestra.run.smithi045.stdout: -5433> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000059b [2,head] /dc-dir/dc-file_934 auth v4848 pv5870 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.708954+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:12.708954+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d74b180] 2023-10-03T19:21:02.614 INFO:teuthology.orchestra.run.smithi045.stdout: -5432> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5876 2023-10-03T19:21:02.614 INFO:teuthology.orchestra.run.smithi045.stdout: -5431> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5876 pv6006 ap=67 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=67) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=66) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.614 INFO:teuthology.orchestra.run.smithi045.stdout: -5430> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5874 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.614 INFO:teuthology.orchestra.run.smithi045.stdout: -5429> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5875 cv=5559/5559 REP dir_auth=0 ap=66+67 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5875 2023-10-03T19:21:02.615 INFO:teuthology.orchestra.run.smithi045.stdout: -5428> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000059b) pop_and_dirty_projected_inode v5870 2023-10-03T19:21:02.615 INFO:teuthology.orchestra.run.smithi045.stdout: -5427> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000059b) mark_dirty [inode 0x1000000059b [2,head] /dc-dir/dc-file_934 auth v5870 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.708954+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d74b180] 2023-10-03T19:21:02.615 INFO:teuthology.orchestra.run.smithi045.stdout: -5426> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_934) mark_dirty [dentry #0x1/dc-dir/dc-file_934 [2,head] auth (dversion lock) pv=5870 v=4848 ino=0x1000000059b state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d747b80] 2023-10-03T19:21:02.615 INFO:teuthology.orchestra.run.smithi045.stdout: -5425> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5869 cv=5553/5553 ap=67+66 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=159 | child=1 dirty=1 authpin=1 0x55576d056400] version 5869 2023-10-03T19:21:02.615 INFO:teuthology.orchestra.run.smithi045.stdout: -5424> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d54ac80 v5877 2023-10-03T19:21:02.615 INFO:teuthology.orchestra.run.smithi045.stdout: -5423> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5877 cv=5559/5559 REP dir_auth=0 ap=66+67 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5877 2023-10-03T19:21:02.632 INFO:teuthology.orchestra.run.smithi045.stdout: -5422> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d528ec0 v5871 2023-10-03T19:21:02.632 INFO:teuthology.orchestra.run.smithi045.stdout: -5421> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5871 cv=5553/5553 ap=67+66 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=159 | child=1 dirty=1 authpin=1 0x55576d056400] version 5871 2023-10-03T19:21:02.632 INFO:teuthology.orchestra.run.smithi045.stdout: -5420> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=66 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=66 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.633 INFO:teuthology.orchestra.run.smithi045.stdout: -5419> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=66) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5876 pv6006 ap=67 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=67) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=66) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.633 INFO:teuthology.orchestra.run.smithi045.stdout: -5418> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=67) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5876 pv6006 ap=67 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=67) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=65) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.633 INFO:teuthology.orchestra.run.smithi045.stdout: -5417> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000059b [2,head] /dc-dir/dc-file_934 auth v5870 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.708954+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d74b180] 2023-10-03T19:21:02.633 INFO:teuthology.orchestra.run.smithi045.stdout: -5416> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000059b [2,head] /dc-dir/dc-file_934 auth v5870 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.708954+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d74b180] 2023-10-03T19:21:02.634 INFO:teuthology.orchestra.run.smithi045.stdout: -5415> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.634 INFO:teuthology.orchestra.run.smithi045.stdout: -5414> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.634 INFO:teuthology.orchestra.run.smithi045.stdout: -5413> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.634 INFO:teuthology.orchestra.run.smithi045.stdout: -5412> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000059b [2,head] /dc-dir/dc-file_934 auth v5870 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.708954+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d74b180] 2023-10-03T19:21:02.634 INFO:teuthology.orchestra.run.smithi045.stdout: -5411> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000059b [2,head] /dc-dir/dc-file_934 auth v5870 ap=1 s=3 n(v0 rc2023-10-03T19:16:12.708954+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d74b180] 2023-10-03T19:21:02.634 INFO:teuthology.orchestra.run.smithi045.stdout: -5410> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.635 INFO:teuthology.orchestra.run.smithi045.stdout: -5409> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 348.085, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.48e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:699.2] 2023-10-03T19:21:02.635 INFO:teuthology.orchestra.run.smithi045.stdout: -5408> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2aab40 on [dir 0x1 / [2,head] auth pv=6007 v=5877 cv=5559/5559 REP dir_auth=0 ap=65+67 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 65 2023-10-03T19:21:02.635 INFO:teuthology.orchestra.run.smithi045.stdout: -5407> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2aab40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5876 pv6006 ap=66 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=66) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=65) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 66 2023-10-03T19:21:02.635 INFO:teuthology.orchestra.run.smithi045.stdout: -5406> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5877 cv=5559/5559 REP dir_auth=0 ap=65+66 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2aab40 count now 65/66 2023-10-03T19:21:02.635 INFO:teuthology.orchestra.run.smithi045.stdout: -5405> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2aab40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5871 cv=5553/5553 ap=66+66 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=159 | child=1 dirty=1 authpin=1 0x55576d056400] count now 66 2023-10-03T19:21:02.636 INFO:teuthology.orchestra.run.smithi045.stdout: -5404> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000059b) auth_unpin by 0x55576d2aab40 on [inode 0x1000000059b [2,head] /dc-dir/dc-file_934 auth v5870 s=3 n(v0 rc2023-10-03T19:16:12.708954+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d74b180] now 0 2023-10-03T19:21:02.636 INFO:teuthology.orchestra.run.smithi045.stdout: -5403> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5871 cv=5553/5553 ap=66+65 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=159 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2aab40 count now 66/65 2023-10-03T19:21:02.636 INFO:teuthology.orchestra.run.smithi045.stdout: -5402> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.636 INFO:teuthology.orchestra.run.smithi045.stdout: -5401> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.636 INFO:teuthology.orchestra.run.smithi045.stdout: -5400> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000059c [2,head] /dc-dir/dc-file_935 auth v5002 pv5872 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.713112+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:13.713112+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d74b700] 2023-10-03T19:21:02.636 INFO:teuthology.orchestra.run.smithi045.stdout: -5399> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5878 2023-10-03T19:21:02.637 INFO:teuthology.orchestra.run.smithi045.stdout: -5398> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5878 pv6006 ap=66 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=66) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=65) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.637 INFO:teuthology.orchestra.run.smithi045.stdout: -5397> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5876 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.637 INFO:teuthology.orchestra.run.smithi045.stdout: -5396> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5877 cv=5559/5559 REP dir_auth=0 ap=65+66 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5877 2023-10-03T19:21:02.637 INFO:teuthology.orchestra.run.smithi045.stdout: -5395> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000059c) pop_and_dirty_projected_inode v5872 2023-10-03T19:21:02.637 INFO:teuthology.orchestra.run.smithi045.stdout: -5394> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000059c) mark_dirty [inode 0x1000000059c [2,head] /dc-dir/dc-file_935 auth v5872 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.713112+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d74b700] 2023-10-03T19:21:02.637 INFO:teuthology.orchestra.run.smithi045.stdout: -5393> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_935) mark_dirty [dentry #0x1/dc-dir/dc-file_935 [2,head] auth (dversion lock) pv=5872 v=5002 ino=0x1000000059c state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d766000] 2023-10-03T19:21:02.637 INFO:teuthology.orchestra.run.smithi045.stdout: -5392> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5871 cv=5553/5553 ap=66+65 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=160 | child=1 dirty=1 authpin=1 0x55576d056400] version 5871 2023-10-03T19:21:02.637 INFO:teuthology.orchestra.run.smithi045.stdout: -5391> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d54aec0 v5879 2023-10-03T19:21:02.638 INFO:teuthology.orchestra.run.smithi045.stdout: -5390> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5879 cv=5559/5559 REP dir_auth=0 ap=65+66 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5879 2023-10-03T19:21:02.638 INFO:teuthology.orchestra.run.smithi045.stdout: -5389> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d528c80 v5873 2023-10-03T19:21:02.638 INFO:teuthology.orchestra.run.smithi045.stdout: -5388> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5873 cv=5553/5553 ap=66+65 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=160 | child=1 dirty=1 authpin=1 0x55576d056400] version 5873 2023-10-03T19:21:02.638 INFO:teuthology.orchestra.run.smithi045.stdout: -5387> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=65 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=65 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.638 INFO:teuthology.orchestra.run.smithi045.stdout: -5386> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=65) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5878 pv6006 ap=66 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=66) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=65) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.638 INFO:teuthology.orchestra.run.smithi045.stdout: -5385> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=66) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5878 pv6006 ap=66 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=66) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=64) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.638 INFO:teuthology.orchestra.run.smithi045.stdout: -5384> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000059c [2,head] /dc-dir/dc-file_935 auth v5872 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.713112+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d74b700] 2023-10-03T19:21:02.638 INFO:teuthology.orchestra.run.smithi045.stdout: -5383> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000059c [2,head] /dc-dir/dc-file_935 auth v5872 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.713112+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d74b700] 2023-10-03T19:21:02.638 INFO:teuthology.orchestra.run.smithi045.stdout: -5382> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.638 INFO:teuthology.orchestra.run.smithi045.stdout: -5381> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.645 INFO:teuthology.orchestra.run.smithi045.stdout: -5380> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.645 INFO:teuthology.orchestra.run.smithi045.stdout: -5379> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000059c [2,head] /dc-dir/dc-file_935 auth v5872 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.713112+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d74b700] 2023-10-03T19:21:02.645 INFO:teuthology.orchestra.run.smithi045.stdout: -5378> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000059c [2,head] /dc-dir/dc-file_935 auth v5872 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.713112+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d74b700] 2023-10-03T19:21:02.646 INFO:teuthology.orchestra.run.smithi045.stdout: -5377> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.646 INFO:teuthology.orchestra.run.smithi045.stdout: -5376> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 349.085, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.49e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:701.2] 2023-10-03T19:21:02.646 INFO:teuthology.orchestra.run.smithi045.stdout: -5375> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e1c8240 on [dir 0x1 / [2,head] auth pv=6007 v=5879 cv=5559/5559 REP dir_auth=0 ap=64+66 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 64 2023-10-03T19:21:02.646 INFO:teuthology.orchestra.run.smithi045.stdout: -5374> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e1c8240 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5878 pv6006 ap=65 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=65) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=64) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 65 2023-10-03T19:21:02.646 INFO:teuthology.orchestra.run.smithi045.stdout: -5373> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5879 cv=5559/5559 REP dir_auth=0 ap=64+65 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e1c8240 count now 64/65 2023-10-03T19:21:02.646 INFO:teuthology.orchestra.run.smithi045.stdout: -5372> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e1c8240 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5873 cv=5553/5553 ap=65+65 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=160 | child=1 dirty=1 authpin=1 0x55576d056400] count now 65 2023-10-03T19:21:02.647 INFO:teuthology.orchestra.run.smithi045.stdout: -5371> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000059c) auth_unpin by 0x55576e1c8240 on [inode 0x1000000059c [2,head] /dc-dir/dc-file_935 auth v5872 s=3 n(v0 rc2023-10-03T19:16:13.713112+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d74b700] now 0 2023-10-03T19:21:02.647 INFO:teuthology.orchestra.run.smithi045.stdout: -5370> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5873 cv=5553/5553 ap=65+64 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=160 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e1c8240 count now 65/64 2023-10-03T19:21:02.647 INFO:teuthology.orchestra.run.smithi045.stdout: -5369> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.647 INFO:teuthology.orchestra.run.smithi045.stdout: -5368> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.647 INFO:teuthology.orchestra.run.smithi045.stdout: -5367> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000059d [2,head] /dc-dir/dc-file_936 auth v5006 pv5874 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.754462+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:13.754462+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d768000] 2023-10-03T19:21:02.647 INFO:teuthology.orchestra.run.smithi045.stdout: -5366> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5880 2023-10-03T19:21:02.647 INFO:teuthology.orchestra.run.smithi045.stdout: -5365> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5880 pv6006 ap=65 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=65) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=64) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.647 INFO:teuthology.orchestra.run.smithi045.stdout: -5364> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5878 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.647 INFO:teuthology.orchestra.run.smithi045.stdout: -5363> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5879 cv=5559/5559 REP dir_auth=0 ap=64+65 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5879 2023-10-03T19:21:02.647 INFO:teuthology.orchestra.run.smithi045.stdout: -5362> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000059d) pop_and_dirty_projected_inode v5874 2023-10-03T19:21:02.648 INFO:teuthology.orchestra.run.smithi045.stdout: -5361> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000059d) mark_dirty [inode 0x1000000059d [2,head] /dc-dir/dc-file_936 auth v5874 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.754462+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d768000] 2023-10-03T19:21:02.648 INFO:teuthology.orchestra.run.smithi045.stdout: -5360> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_936) mark_dirty [dentry #0x1/dc-dir/dc-file_936 [2,head] auth (dversion lock) pv=5874 v=5006 ino=0x1000000059d state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d766280] 2023-10-03T19:21:02.648 INFO:teuthology.orchestra.run.smithi045.stdout: -5359> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5873 cv=5553/5553 ap=65+64 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=161 | child=1 dirty=1 authpin=1 0x55576d056400] version 5873 2023-10-03T19:21:02.648 INFO:teuthology.orchestra.run.smithi045.stdout: -5358> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d5366e0 v5881 2023-10-03T19:21:02.648 INFO:teuthology.orchestra.run.smithi045.stdout: -5357> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5881 cv=5559/5559 REP dir_auth=0 ap=64+65 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5881 2023-10-03T19:21:02.648 INFO:teuthology.orchestra.run.smithi045.stdout: -5356> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d528a40 v5875 2023-10-03T19:21:02.648 INFO:teuthology.orchestra.run.smithi045.stdout: -5355> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5875 cv=5553/5553 ap=65+64 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=161 | child=1 dirty=1 authpin=1 0x55576d056400] version 5875 2023-10-03T19:21:02.648 INFO:teuthology.orchestra.run.smithi045.stdout: -5354> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=64 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=64 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.648 INFO:teuthology.orchestra.run.smithi045.stdout: -5353> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=64) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5880 pv6006 ap=65 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=65) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=64) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.649 INFO:teuthology.orchestra.run.smithi045.stdout: -5352> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=65) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5880 pv6006 ap=65 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=65) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=63) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.649 INFO:teuthology.orchestra.run.smithi045.stdout: -5351> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000059d [2,head] /dc-dir/dc-file_936 auth v5874 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.754462+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d768000] 2023-10-03T19:21:02.649 INFO:teuthology.orchestra.run.smithi045.stdout: -5350> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000059d [2,head] /dc-dir/dc-file_936 auth v5874 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.754462+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d768000] 2023-10-03T19:21:02.649 INFO:teuthology.orchestra.run.smithi045.stdout: -5349> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.649 INFO:teuthology.orchestra.run.smithi045.stdout: -5348> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.649 INFO:teuthology.orchestra.run.smithi045.stdout: -5347> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.650 INFO:teuthology.orchestra.run.smithi045.stdout: -5346> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000059d [2,head] /dc-dir/dc-file_936 auth v5874 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.754462+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d768000] 2023-10-03T19:21:02.650 INFO:teuthology.orchestra.run.smithi045.stdout: -5345> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000059d [2,head] /dc-dir/dc-file_936 auth v5874 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.754462+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d768000] 2023-10-03T19:21:02.650 INFO:teuthology.orchestra.run.smithi045.stdout: -5344> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.650 INFO:teuthology.orchestra.run.smithi045.stdout: -5343> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 350.085, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.50e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:703.2] 2023-10-03T19:21:02.650 INFO:teuthology.orchestra.run.smithi045.stdout: -5342> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e1c86c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5880 pv6006 ap=64 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=64) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=63) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 64 2023-10-03T19:21:02.650 INFO:teuthology.orchestra.run.smithi045.stdout: -5341> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5881 cv=5559/5559 REP dir_auth=0 ap=64+64 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e1c86c0 count now 64/64 2023-10-03T19:21:02.650 INFO:teuthology.orchestra.run.smithi045.stdout: -5340> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e1c86c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5875 cv=5553/5553 ap=64+64 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=161 | child=1 dirty=1 authpin=1 0x55576d056400] count now 64 2023-10-03T19:21:02.650 INFO:teuthology.orchestra.run.smithi045.stdout: -5339> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e1c86c0 on [dir 0x1 / [2,head] auth pv=6007 v=5881 cv=5559/5559 REP dir_auth=0 ap=63+64 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 63 2023-10-03T19:21:02.650 INFO:teuthology.orchestra.run.smithi045.stdout: -5338> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000059d) auth_unpin by 0x55576e1c86c0 on [inode 0x1000000059d [2,head] /dc-dir/dc-file_936 auth v5874 s=3 n(v0 rc2023-10-03T19:16:13.754462+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d768000] now 0 2023-10-03T19:21:02.650 INFO:teuthology.orchestra.run.smithi045.stdout: -5337> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5875 cv=5553/5553 ap=64+63 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=161 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e1c86c0 count now 64/63 2023-10-03T19:21:02.651 INFO:teuthology.orchestra.run.smithi045.stdout: -5336> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.651 INFO:teuthology.orchestra.run.smithi045.stdout: -5335> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.651 INFO:teuthology.orchestra.run.smithi045.stdout: -5334> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000059e [2,head] /dc-dir/dc-file_937 auth v5010 pv5876 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.770696+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:13.770696+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d768580] 2023-10-03T19:21:02.651 INFO:teuthology.orchestra.run.smithi045.stdout: -5333> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5882 2023-10-03T19:21:02.651 INFO:teuthology.orchestra.run.smithi045.stdout: -5332> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5882 pv6006 ap=64 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=64) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=63) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.651 INFO:teuthology.orchestra.run.smithi045.stdout: -5331> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5880 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.651 INFO:teuthology.orchestra.run.smithi045.stdout: -5330> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5881 cv=5559/5559 REP dir_auth=0 ap=63+64 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5881 2023-10-03T19:21:02.751 INFO:teuthology.orchestra.run.smithi045.stdout: -5329> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000059e) pop_and_dirty_projected_inode v5876 2023-10-03T19:21:02.751 INFO:teuthology.orchestra.run.smithi045.stdout: -5328> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000059e) mark_dirty [inode 0x1000000059e [2,head] /dc-dir/dc-file_937 auth v5876 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.770696+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d768580] 2023-10-03T19:21:02.752 INFO:teuthology.orchestra.run.smithi045.stdout: -5327> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_937) mark_dirty [dentry #0x1/dc-dir/dc-file_937 [2,head] auth (dversion lock) pv=5876 v=5010 ino=0x1000000059e state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d766500] 2023-10-03T19:21:02.752 INFO:teuthology.orchestra.run.smithi045.stdout: -5326> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5875 cv=5553/5553 ap=64+63 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=162 | child=1 dirty=1 authpin=1 0x55576d056400] version 5875 2023-10-03T19:21:02.752 INFO:teuthology.orchestra.run.smithi045.stdout: -5325> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d5364a0 v5883 2023-10-03T19:21:02.752 INFO:teuthology.orchestra.run.smithi045.stdout: -5324> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5883 cv=5559/5559 REP dir_auth=0 ap=63+64 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5883 2023-10-03T19:21:02.752 INFO:teuthology.orchestra.run.smithi045.stdout: -5323> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d528800 v5877 2023-10-03T19:21:02.753 INFO:teuthology.orchestra.run.smithi045.stdout: -5322> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5877 cv=5553/5553 ap=64+63 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=162 | child=1 dirty=1 authpin=1 0x55576d056400] version 5877 2023-10-03T19:21:02.753 INFO:teuthology.orchestra.run.smithi045.stdout: -5321> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=63 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=63 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.753 INFO:teuthology.orchestra.run.smithi045.stdout: -5320> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=63) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5882 pv6006 ap=64 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=64) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=63) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.753 INFO:teuthology.orchestra.run.smithi045.stdout: -5319> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=64) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5882 pv6006 ap=64 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=64) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=62) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.753 INFO:teuthology.orchestra.run.smithi045.stdout: -5318> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000059e [2,head] /dc-dir/dc-file_937 auth v5876 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.770696+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d768580] 2023-10-03T19:21:02.753 INFO:teuthology.orchestra.run.smithi045.stdout: -5317> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000059e [2,head] /dc-dir/dc-file_937 auth v5876 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.770696+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d768580] 2023-10-03T19:21:02.753 INFO:teuthology.orchestra.run.smithi045.stdout: -5316> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.753 INFO:teuthology.orchestra.run.smithi045.stdout: -5315> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.753 INFO:teuthology.orchestra.run.smithi045.stdout: -5314> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.754 INFO:teuthology.orchestra.run.smithi045.stdout: -5313> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000059e [2,head] /dc-dir/dc-file_937 auth v5876 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.770696+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d768580] 2023-10-03T19:21:02.754 INFO:teuthology.orchestra.run.smithi045.stdout: -5312> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000059e [2,head] /dc-dir/dc-file_937 auth v5876 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.770696+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d768580] 2023-10-03T19:21:02.754 INFO:teuthology.orchestra.run.smithi045.stdout: -5311> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.754 INFO:teuthology.orchestra.run.smithi045.stdout: -5310> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 351.085, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.51e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:705.2] 2023-10-03T19:21:02.754 INFO:teuthology.orchestra.run.smithi045.stdout: -5309> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e1c8b40 on [dir 0x1 / [2,head] auth pv=6007 v=5883 cv=5559/5559 REP dir_auth=0 ap=62+64 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 62 2023-10-03T19:21:02.754 INFO:teuthology.orchestra.run.smithi045.stdout: -5308> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e1c8b40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5882 pv6006 ap=63 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=63) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=62) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 63 2023-10-03T19:21:02.754 INFO:teuthology.orchestra.run.smithi045.stdout: -5307> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5883 cv=5559/5559 REP dir_auth=0 ap=62+63 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e1c8b40 count now 62/63 2023-10-03T19:21:02.754 INFO:teuthology.orchestra.run.smithi045.stdout: -5306> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e1c8b40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5877 cv=5553/5553 ap=63+63 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=162 | child=1 dirty=1 authpin=1 0x55576d056400] count now 63 2023-10-03T19:21:02.755 INFO:teuthology.orchestra.run.smithi045.stdout: -5305> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000059e) auth_unpin by 0x55576e1c8b40 on [inode 0x1000000059e [2,head] /dc-dir/dc-file_937 auth v5876 s=3 n(v0 rc2023-10-03T19:16:13.770696+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d768580] now 0 2023-10-03T19:21:02.755 INFO:teuthology.orchestra.run.smithi045.stdout: -5304> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5877 cv=5553/5553 ap=63+62 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=162 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e1c8b40 count now 63/62 2023-10-03T19:21:02.755 INFO:teuthology.orchestra.run.smithi045.stdout: -5303> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.755 INFO:teuthology.orchestra.run.smithi045.stdout: -5302> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.755 INFO:teuthology.orchestra.run.smithi045.stdout: -5301> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x1000000059f [2,head] /dc-dir/dc-file_938 auth v5014 pv5878 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.786243+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:13.786243+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d768b00] 2023-10-03T19:21:02.755 INFO:teuthology.orchestra.run.smithi045.stdout: -5300> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5884 2023-10-03T19:21:02.755 INFO:teuthology.orchestra.run.smithi045.stdout: -5299> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5884 pv6006 ap=63 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=63) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=62) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.755 INFO:teuthology.orchestra.run.smithi045.stdout: -5298> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5882 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.755 INFO:teuthology.orchestra.run.smithi045.stdout: -5297> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5883 cv=5559/5559 REP dir_auth=0 ap=62+63 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5883 2023-10-03T19:21:02.755 INFO:teuthology.orchestra.run.smithi045.stdout: -5296> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x1000000059f) pop_and_dirty_projected_inode v5878 2023-10-03T19:21:02.756 INFO:teuthology.orchestra.run.smithi045.stdout: -5295> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000059f) mark_dirty [inode 0x1000000059f [2,head] /dc-dir/dc-file_938 auth v5878 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.786243+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d768b00] 2023-10-03T19:21:02.756 INFO:teuthology.orchestra.run.smithi045.stdout: -5294> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_938) mark_dirty [dentry #0x1/dc-dir/dc-file_938 [2,head] auth (dversion lock) pv=5878 v=5014 ino=0x1000000059f state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d766780] 2023-10-03T19:21:02.756 INFO:teuthology.orchestra.run.smithi045.stdout: -5293> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5877 cv=5553/5553 ap=63+62 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=163 | child=1 dirty=1 authpin=1 0x55576d056400] version 5877 2023-10-03T19:21:02.756 INFO:teuthology.orchestra.run.smithi045.stdout: -5292> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d536260 v5885 2023-10-03T19:21:02.756 INFO:teuthology.orchestra.run.smithi045.stdout: -5291> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5885 cv=5559/5559 REP dir_auth=0 ap=62+63 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5885 2023-10-03T19:21:02.756 INFO:teuthology.orchestra.run.smithi045.stdout: -5290> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d5286e0 v5879 2023-10-03T19:21:02.756 INFO:teuthology.orchestra.run.smithi045.stdout: -5289> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5879 cv=5553/5553 ap=63+62 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=163 | child=1 dirty=1 authpin=1 0x55576d056400] version 5879 2023-10-03T19:21:02.756 INFO:teuthology.orchestra.run.smithi045.stdout: -5288> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=62 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=62 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.756 INFO:teuthology.orchestra.run.smithi045.stdout: -5287> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=62) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5884 pv6006 ap=63 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=63) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=62) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.756 INFO:teuthology.orchestra.run.smithi045.stdout: -5286> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=63) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5884 pv6006 ap=63 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=63) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=61) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.757 INFO:teuthology.orchestra.run.smithi045.stdout: -5285> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000059f [2,head] /dc-dir/dc-file_938 auth v5878 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.786243+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d768b00] 2023-10-03T19:21:02.757 INFO:teuthology.orchestra.run.smithi045.stdout: -5284> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000059f [2,head] /dc-dir/dc-file_938 auth v5878 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.786243+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d768b00] 2023-10-03T19:21:02.759 INFO:teuthology.orchestra.run.smithi045.stdout: -5283> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.759 INFO:teuthology.orchestra.run.smithi045.stdout: -5282> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.759 INFO:teuthology.orchestra.run.smithi045.stdout: -5281> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.759 INFO:teuthology.orchestra.run.smithi045.stdout: -5280> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000059f [2,head] /dc-dir/dc-file_938 auth v5878 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.786243+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d768b00] 2023-10-03T19:21:02.759 INFO:teuthology.orchestra.run.smithi045.stdout: -5279> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000059f [2,head] /dc-dir/dc-file_938 auth v5878 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.786243+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d768b00] 2023-10-03T19:21:02.759 INFO:teuthology.orchestra.run.smithi045.stdout: -5278> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.759 INFO:teuthology.orchestra.run.smithi045.stdout: -5277> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 352.085, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.52e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:707.2] 2023-10-03T19:21:02.759 INFO:teuthology.orchestra.run.smithi045.stdout: -5276> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e1c8fc0 on [dir 0x1 / [2,head] auth pv=6007 v=5885 cv=5559/5559 REP dir_auth=0 ap=61+63 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 61 2023-10-03T19:21:02.759 INFO:teuthology.orchestra.run.smithi045.stdout: -5275> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e1c8fc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5884 pv6006 ap=62 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=62) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=61) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 62 2023-10-03T19:21:02.759 INFO:teuthology.orchestra.run.smithi045.stdout: -5274> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5885 cv=5559/5559 REP dir_auth=0 ap=61+62 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e1c8fc0 count now 61/62 2023-10-03T19:21:02.760 INFO:teuthology.orchestra.run.smithi045.stdout: -5273> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e1c8fc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5879 cv=5553/5553 ap=62+62 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=163 | child=1 dirty=1 authpin=1 0x55576d056400] count now 62 2023-10-03T19:21:02.760 INFO:teuthology.orchestra.run.smithi045.stdout: -5272> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000059f) auth_unpin by 0x55576e1c8fc0 on [inode 0x1000000059f [2,head] /dc-dir/dc-file_938 auth v5878 s=3 n(v0 rc2023-10-03T19:16:13.786243+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d768b00] now 0 2023-10-03T19:21:02.760 INFO:teuthology.orchestra.run.smithi045.stdout: -5271> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5879 cv=5553/5553 ap=62+61 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=163 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e1c8fc0 count now 62/61 2023-10-03T19:21:02.760 INFO:teuthology.orchestra.run.smithi045.stdout: -5270> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.760 INFO:teuthology.orchestra.run.smithi045.stdout: -5269> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.760 INFO:teuthology.orchestra.run.smithi045.stdout: -5268> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005a0 [2,head] /dc-dir/dc-file_939 auth v5018 pv5880 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.798243+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:13.798243+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d769080] 2023-10-03T19:21:02.760 INFO:teuthology.orchestra.run.smithi045.stdout: -5267> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5886 2023-10-03T19:21:02.760 INFO:teuthology.orchestra.run.smithi045.stdout: -5266> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5886 pv6006 ap=62 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=62) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=61) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.760 INFO:teuthology.orchestra.run.smithi045.stdout: -5265> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5884 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.761 INFO:teuthology.orchestra.run.smithi045.stdout: -5264> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5885 cv=5559/5559 REP dir_auth=0 ap=61+62 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5885 2023-10-03T19:21:02.761 INFO:teuthology.orchestra.run.smithi045.stdout: -5263> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005a0) pop_and_dirty_projected_inode v5880 2023-10-03T19:21:02.761 INFO:teuthology.orchestra.run.smithi045.stdout: -5262> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005a0) mark_dirty [inode 0x100000005a0 [2,head] /dc-dir/dc-file_939 auth v5880 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.798243+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d769080] 2023-10-03T19:21:02.761 INFO:teuthology.orchestra.run.smithi045.stdout: -5261> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_939) mark_dirty [dentry #0x1/dc-dir/dc-file_939 [2,head] auth (dversion lock) pv=5880 v=5018 ino=0x100000005a0 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d766a00] 2023-10-03T19:21:02.761 INFO:teuthology.orchestra.run.smithi045.stdout: -5260> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5879 cv=5553/5553 ap=62+61 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=164 | child=1 dirty=1 authpin=1 0x55576d056400] version 5879 2023-10-03T19:21:02.761 INFO:teuthology.orchestra.run.smithi045.stdout: -5259> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d536020 v5887 2023-10-03T19:21:02.761 INFO:teuthology.orchestra.run.smithi045.stdout: -5258> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5887 cv=5559/5559 REP dir_auth=0 ap=61+62 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5887 2023-10-03T19:21:02.761 INFO:teuthology.orchestra.run.smithi045.stdout: -5257> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d5285c0 v5881 2023-10-03T19:21:02.761 INFO:teuthology.orchestra.run.smithi045.stdout: -5256> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5881 cv=5553/5553 ap=62+61 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=164 | child=1 dirty=1 authpin=1 0x55576d056400] version 5881 2023-10-03T19:21:02.761 INFO:teuthology.orchestra.run.smithi045.stdout: -5255> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=61 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=61 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.762 INFO:teuthology.orchestra.run.smithi045.stdout: -5254> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=61) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5886 pv6006 ap=62 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=62) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=61) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.762 INFO:teuthology.orchestra.run.smithi045.stdout: -5253> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=62) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5886 pv6006 ap=62 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=62) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=60) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.762 INFO:teuthology.orchestra.run.smithi045.stdout: -5252> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005a0 [2,head] /dc-dir/dc-file_939 auth v5880 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.798243+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d769080] 2023-10-03T19:21:02.762 INFO:teuthology.orchestra.run.smithi045.stdout: -5251> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005a0 [2,head] /dc-dir/dc-file_939 auth v5880 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.798243+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d769080] 2023-10-03T19:21:02.762 INFO:teuthology.orchestra.run.smithi045.stdout: -5250> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.762 INFO:teuthology.orchestra.run.smithi045.stdout: -5249> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.762 INFO:teuthology.orchestra.run.smithi045.stdout: -5248> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.762 INFO:teuthology.orchestra.run.smithi045.stdout: -5247> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005a0 [2,head] /dc-dir/dc-file_939 auth v5880 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.798243+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d769080] 2023-10-03T19:21:02.762 INFO:teuthology.orchestra.run.smithi045.stdout: -5246> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005a0 [2,head] /dc-dir/dc-file_939 auth v5880 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.798243+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d769080] 2023-10-03T19:21:02.762 INFO:teuthology.orchestra.run.smithi045.stdout: -5245> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.763 INFO:teuthology.orchestra.run.smithi045.stdout: -5244> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 353.085, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.53e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:709.2] 2023-10-03T19:21:02.763 INFO:teuthology.orchestra.run.smithi045.stdout: -5243> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e1c9440 on [dir 0x1 / [2,head] auth pv=6007 v=5887 cv=5559/5559 REP dir_auth=0 ap=60+62 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 60 2023-10-03T19:21:02.763 INFO:teuthology.orchestra.run.smithi045.stdout: -5242> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e1c9440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5886 pv6006 ap=61 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=61) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=60) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 61 2023-10-03T19:21:02.763 INFO:teuthology.orchestra.run.smithi045.stdout: -5241> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5887 cv=5559/5559 REP dir_auth=0 ap=60+61 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e1c9440 count now 60/61 2023-10-03T19:21:02.763 INFO:teuthology.orchestra.run.smithi045.stdout: -5240> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e1c9440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5881 cv=5553/5553 ap=61+61 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=164 | child=1 dirty=1 authpin=1 0x55576d056400] count now 61 2023-10-03T19:21:02.763 INFO:teuthology.orchestra.run.smithi045.stdout: -5239> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005a0) auth_unpin by 0x55576e1c9440 on [inode 0x100000005a0 [2,head] /dc-dir/dc-file_939 auth v5880 s=3 n(v0 rc2023-10-03T19:16:13.798243+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d769080] now 0 2023-10-03T19:21:02.763 INFO:teuthology.orchestra.run.smithi045.stdout: -5238> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5881 cv=5553/5553 ap=61+60 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=164 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e1c9440 count now 61/60 2023-10-03T19:21:02.763 INFO:teuthology.orchestra.run.smithi045.stdout: -5237> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.763 INFO:teuthology.orchestra.run.smithi045.stdout: -5236> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.763 INFO:teuthology.orchestra.run.smithi045.stdout: -5235> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005a1 [2,head] /dc-dir/dc-file_940 auth v5022 pv5882 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.811427+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:13.811427+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d769600] 2023-10-03T19:21:02.764 INFO:teuthology.orchestra.run.smithi045.stdout: -5234> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5888 2023-10-03T19:21:02.764 INFO:teuthology.orchestra.run.smithi045.stdout: -5233> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5888 pv6006 ap=61 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=61) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=60) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.764 INFO:teuthology.orchestra.run.smithi045.stdout: -5232> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5886 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.764 INFO:teuthology.orchestra.run.smithi045.stdout: -5231> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5887 cv=5559/5559 REP dir_auth=0 ap=60+61 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5887 2023-10-03T19:21:02.764 INFO:teuthology.orchestra.run.smithi045.stdout: -5230> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005a1) pop_and_dirty_projected_inode v5882 2023-10-03T19:21:02.764 INFO:teuthology.orchestra.run.smithi045.stdout: -5229> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005a1) mark_dirty [inode 0x100000005a1 [2,head] /dc-dir/dc-file_940 auth v5882 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.811427+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d769600] 2023-10-03T19:21:02.764 INFO:teuthology.orchestra.run.smithi045.stdout: -5228> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_940) mark_dirty [dentry #0x1/dc-dir/dc-file_940 [2,head] auth (dversion lock) pv=5882 v=5022 ino=0x100000005a1 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d766c80] 2023-10-03T19:21:02.764 INFO:teuthology.orchestra.run.smithi045.stdout: -5227> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5881 cv=5553/5553 ap=61+60 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=165 | child=1 dirty=1 authpin=1 0x55576d056400] version 5881 2023-10-03T19:21:02.784 INFO:teuthology.orchestra.run.smithi045.stdout: -5226> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d529d60 v5889 2023-10-03T19:21:02.784 INFO:teuthology.orchestra.run.smithi045.stdout: -5225> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5889 cv=5559/5559 REP dir_auth=0 ap=60+61 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5889 2023-10-03T19:21:02.784 INFO:teuthology.orchestra.run.smithi045.stdout: -5224> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d528920 v5883 2023-10-03T19:21:02.784 INFO:teuthology.orchestra.run.smithi045.stdout: -5223> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5883 cv=5553/5553 ap=61+60 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=165 | child=1 dirty=1 authpin=1 0x55576d056400] version 5883 2023-10-03T19:21:02.784 INFO:teuthology.orchestra.run.smithi045.stdout: -5222> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=60 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=60 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.785 INFO:teuthology.orchestra.run.smithi045.stdout: -5221> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=60) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5888 pv6006 ap=61 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=61) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=60) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.785 INFO:teuthology.orchestra.run.smithi045.stdout: -5220> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=61) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5888 pv6006 ap=61 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=61) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=59) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.785 INFO:teuthology.orchestra.run.smithi045.stdout: -5219> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005a1 [2,head] /dc-dir/dc-file_940 auth v5882 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.811427+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d769600] 2023-10-03T19:21:02.785 INFO:teuthology.orchestra.run.smithi045.stdout: -5218> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005a1 [2,head] /dc-dir/dc-file_940 auth v5882 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.811427+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d769600] 2023-10-03T19:21:02.785 INFO:teuthology.orchestra.run.smithi045.stdout: -5217> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.786 INFO:teuthology.orchestra.run.smithi045.stdout: -5216> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.786 INFO:teuthology.orchestra.run.smithi045.stdout: -5215> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.786 INFO:teuthology.orchestra.run.smithi045.stdout: -5214> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005a1 [2,head] /dc-dir/dc-file_940 auth v5882 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.811427+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d769600] 2023-10-03T19:21:02.786 INFO:teuthology.orchestra.run.smithi045.stdout: -5213> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005a1 [2,head] /dc-dir/dc-file_940 auth v5882 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.811427+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d769600] 2023-10-03T19:21:02.787 INFO:teuthology.orchestra.run.smithi045.stdout: -5212> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.787 INFO:teuthology.orchestra.run.smithi045.stdout: -5211> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 354.085, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.54e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:711.2] 2023-10-03T19:21:02.787 INFO:teuthology.orchestra.run.smithi045.stdout: -5210> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e1c98c0 on [dir 0x1 / [2,head] auth pv=6007 v=5889 cv=5559/5559 REP dir_auth=0 ap=59+61 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 59 2023-10-03T19:21:02.787 INFO:teuthology.orchestra.run.smithi045.stdout: -5209> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e1c98c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5888 pv6006 ap=60 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=60) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=59) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 60 2023-10-03T19:21:02.787 INFO:teuthology.orchestra.run.smithi045.stdout: -5208> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5889 cv=5559/5559 REP dir_auth=0 ap=59+60 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e1c98c0 count now 59/60 2023-10-03T19:21:02.787 INFO:teuthology.orchestra.run.smithi045.stdout: -5207> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e1c98c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5883 cv=5553/5553 ap=60+60 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=165 | child=1 dirty=1 authpin=1 0x55576d056400] count now 60 2023-10-03T19:21:02.787 INFO:teuthology.orchestra.run.smithi045.stdout: -5206> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005a1) auth_unpin by 0x55576e1c98c0 on [inode 0x100000005a1 [2,head] /dc-dir/dc-file_940 auth v5882 s=3 n(v0 rc2023-10-03T19:16:13.811427+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d769600] now 0 2023-10-03T19:21:02.787 INFO:teuthology.orchestra.run.smithi045.stdout: -5205> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5883 cv=5553/5553 ap=60+59 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=165 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e1c98c0 count now 60/59 2023-10-03T19:21:02.787 INFO:teuthology.orchestra.run.smithi045.stdout: -5204> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.788 INFO:teuthology.orchestra.run.smithi045.stdout: -5203> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.788 INFO:teuthology.orchestra.run.smithi045.stdout: -5202> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005a2 [2,head] /dc-dir/dc-file_941 auth v5026 pv5884 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.822872+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:13.822872+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d769b80] 2023-10-03T19:21:02.788 INFO:teuthology.orchestra.run.smithi045.stdout: -5201> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5890 2023-10-03T19:21:02.788 INFO:teuthology.orchestra.run.smithi045.stdout: -5200> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5890 pv6006 ap=60 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=60) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=59) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.788 INFO:teuthology.orchestra.run.smithi045.stdout: -5199> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5888 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.788 INFO:teuthology.orchestra.run.smithi045.stdout: -5198> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5889 cv=5559/5559 REP dir_auth=0 ap=59+60 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5889 2023-10-03T19:21:02.788 INFO:teuthology.orchestra.run.smithi045.stdout: -5197> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005a2) pop_and_dirty_projected_inode v5884 2023-10-03T19:21:02.788 INFO:teuthology.orchestra.run.smithi045.stdout: -5196> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005a2) mark_dirty [inode 0x100000005a2 [2,head] /dc-dir/dc-file_941 auth v5884 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.822872+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d769b80] 2023-10-03T19:21:02.788 INFO:teuthology.orchestra.run.smithi045.stdout: -5195> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_941) mark_dirty [dentry #0x1/dc-dir/dc-file_941 [2,head] auth (dversion lock) pv=5884 v=5026 ino=0x100000005a2 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d766f00] 2023-10-03T19:21:02.788 INFO:teuthology.orchestra.run.smithi045.stdout: -5194> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5883 cv=5553/5553 ap=60+59 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=166 | child=1 dirty=1 authpin=1 0x55576d056400] version 5883 2023-10-03T19:21:02.788 INFO:teuthology.orchestra.run.smithi045.stdout: -5193> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d529b20 v5891 2023-10-03T19:21:02.789 INFO:teuthology.orchestra.run.smithi045.stdout: -5192> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5891 cv=5559/5559 REP dir_auth=0 ap=59+60 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5891 2023-10-03T19:21:02.789 INFO:teuthology.orchestra.run.smithi045.stdout: -5191> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d528380 v5885 2023-10-03T19:21:02.789 INFO:teuthology.orchestra.run.smithi045.stdout: -5190> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5885 cv=5553/5553 ap=60+59 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=166 | child=1 dirty=1 authpin=1 0x55576d056400] version 5885 2023-10-03T19:21:02.789 INFO:teuthology.orchestra.run.smithi045.stdout: -5189> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=59 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=59 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.789 INFO:teuthology.orchestra.run.smithi045.stdout: -5188> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=59) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5890 pv6006 ap=60 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=60) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=59) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.789 INFO:teuthology.orchestra.run.smithi045.stdout: -5187> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=60) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5890 pv6006 ap=60 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=60) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=58) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.789 INFO:teuthology.orchestra.run.smithi045.stdout: -5186> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005a2 [2,head] /dc-dir/dc-file_941 auth v5884 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.822872+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d769b80] 2023-10-03T19:21:02.789 INFO:teuthology.orchestra.run.smithi045.stdout: -5185> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005a2 [2,head] /dc-dir/dc-file_941 auth v5884 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.822872+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d769b80] 2023-10-03T19:21:02.789 INFO:teuthology.orchestra.run.smithi045.stdout: -5184> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.790 INFO:teuthology.orchestra.run.smithi045.stdout: -5183> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.790 INFO:teuthology.orchestra.run.smithi045.stdout: -5182> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.790 INFO:teuthology.orchestra.run.smithi045.stdout: -5181> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005a2 [2,head] /dc-dir/dc-file_941 auth v5884 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.822872+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d769b80] 2023-10-03T19:21:02.790 INFO:teuthology.orchestra.run.smithi045.stdout: -5180> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005a2 [2,head] /dc-dir/dc-file_941 auth v5884 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.822872+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d769b80] 2023-10-03T19:21:02.790 INFO:teuthology.orchestra.run.smithi045.stdout: -5179> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.790 INFO:teuthology.orchestra.run.smithi045.stdout: -5178> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 355.085, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.55e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:713.2] 2023-10-03T19:21:02.797 INFO:teuthology.orchestra.run.smithi045.stdout: -5177> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e1c9d40 on [dir 0x1 / [2,head] auth pv=6007 v=5891 cv=5559/5559 REP dir_auth=0 ap=58+60 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 58 2023-10-03T19:21:02.797 INFO:teuthology.orchestra.run.smithi045.stdout: -5176> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e1c9d40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5890 pv6006 ap=59 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=59) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=58) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 59 2023-10-03T19:21:02.797 INFO:teuthology.orchestra.run.smithi045.stdout: -5175> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5891 cv=5559/5559 REP dir_auth=0 ap=58+59 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e1c9d40 count now 58/59 2023-10-03T19:21:02.797 INFO:teuthology.orchestra.run.smithi045.stdout: -5174> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e1c9d40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5885 cv=5553/5553 ap=59+59 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=166 | child=1 dirty=1 authpin=1 0x55576d056400] count now 59 2023-10-03T19:21:02.797 INFO:teuthology.orchestra.run.smithi045.stdout: -5173> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005a2) auth_unpin by 0x55576e1c9d40 on [inode 0x100000005a2 [2,head] /dc-dir/dc-file_941 auth v5884 s=3 n(v0 rc2023-10-03T19:16:13.822872+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d769b80] now 0 2023-10-03T19:21:02.797 INFO:teuthology.orchestra.run.smithi045.stdout: -5172> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5885 cv=5553/5553 ap=59+58 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=166 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e1c9d40 count now 59/58 2023-10-03T19:21:02.797 INFO:teuthology.orchestra.run.smithi045.stdout: -5171> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.797 INFO:teuthology.orchestra.run.smithi045.stdout: -5170> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.797 INFO:teuthology.orchestra.run.smithi045.stdout: -5169> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005a3 [2,head] /dc-dir/dc-file_942 auth v5030 pv5886 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.834397+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:13.834397+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d76a100] 2023-10-03T19:21:02.798 INFO:teuthology.orchestra.run.smithi045.stdout: -5168> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5892 2023-10-03T19:21:02.798 INFO:teuthology.orchestra.run.smithi045.stdout: -5167> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5892 pv6006 ap=59 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=59) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=58) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.798 INFO:teuthology.orchestra.run.smithi045.stdout: -5166> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5890 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.798 INFO:teuthology.orchestra.run.smithi045.stdout: -5165> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5891 cv=5559/5559 REP dir_auth=0 ap=58+59 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5891 2023-10-03T19:21:02.798 INFO:teuthology.orchestra.run.smithi045.stdout: -5164> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005a3) pop_and_dirty_projected_inode v5886 2023-10-03T19:21:02.798 INFO:teuthology.orchestra.run.smithi045.stdout: -5163> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005a3) mark_dirty [inode 0x100000005a3 [2,head] /dc-dir/dc-file_942 auth v5886 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.834397+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d76a100] 2023-10-03T19:21:02.798 INFO:teuthology.orchestra.run.smithi045.stdout: -5162> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_942) mark_dirty [dentry #0x1/dc-dir/dc-file_942 [2,head] auth (dversion lock) pv=5886 v=5030 ino=0x100000005a3 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d767180] 2023-10-03T19:21:02.798 INFO:teuthology.orchestra.run.smithi045.stdout: -5161> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5885 cv=5553/5553 ap=59+58 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=167 | child=1 dirty=1 authpin=1 0x55576d056400] version 5885 2023-10-03T19:21:02.798 INFO:teuthology.orchestra.run.smithi045.stdout: -5160> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d5296a0 v5893 2023-10-03T19:21:02.799 INFO:teuthology.orchestra.run.smithi045.stdout: -5159> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5893 cv=5559/5559 REP dir_auth=0 ap=58+59 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5893 2023-10-03T19:21:02.799 INFO:teuthology.orchestra.run.smithi045.stdout: -5158> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d528140 v5887 2023-10-03T19:21:02.799 INFO:teuthology.orchestra.run.smithi045.stdout: -5157> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5887 cv=5553/5553 ap=59+58 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=167 | child=1 dirty=1 authpin=1 0x55576d056400] version 5887 2023-10-03T19:21:02.799 INFO:teuthology.orchestra.run.smithi045.stdout: -5156> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=58 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=58 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.799 INFO:teuthology.orchestra.run.smithi045.stdout: -5155> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=58) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5892 pv6006 ap=59 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=59) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=58) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.799 INFO:teuthology.orchestra.run.smithi045.stdout: -5154> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=59) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5892 pv6006 ap=59 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=59) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=57) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.799 INFO:teuthology.orchestra.run.smithi045.stdout: -5153> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005a3 [2,head] /dc-dir/dc-file_942 auth v5886 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.834397+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d76a100] 2023-10-03T19:21:02.799 INFO:teuthology.orchestra.run.smithi045.stdout: -5152> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005a3 [2,head] /dc-dir/dc-file_942 auth v5886 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.834397+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d76a100] 2023-10-03T19:21:02.799 INFO:teuthology.orchestra.run.smithi045.stdout: -5151> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.799 INFO:teuthology.orchestra.run.smithi045.stdout: -5150> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.800 INFO:teuthology.orchestra.run.smithi045.stdout: -5149> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.800 INFO:teuthology.orchestra.run.smithi045.stdout: -5148> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005a3 [2,head] /dc-dir/dc-file_942 auth v5886 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.834397+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d76a100] 2023-10-03T19:21:02.800 INFO:teuthology.orchestra.run.smithi045.stdout: -5147> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005a3 [2,head] /dc-dir/dc-file_942 auth v5886 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.834397+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d76a100] 2023-10-03T19:21:02.800 INFO:teuthology.orchestra.run.smithi045.stdout: -5146> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.800 INFO:teuthology.orchestra.run.smithi045.stdout: -5145> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 356.085, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.56e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:715.2] 2023-10-03T19:21:02.800 INFO:teuthology.orchestra.run.smithi045.stdout: -5144> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e2e6240 on [dir 0x1 / [2,head] auth pv=6007 v=5893 cv=5559/5559 REP dir_auth=0 ap=57+59 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 57 2023-10-03T19:21:02.800 INFO:teuthology.orchestra.run.smithi045.stdout: -5143> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e2e6240 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5892 pv6006 ap=58 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=58) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=57) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 58 2023-10-03T19:21:02.800 INFO:teuthology.orchestra.run.smithi045.stdout: -5142> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5893 cv=5559/5559 REP dir_auth=0 ap=57+58 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e2e6240 count now 57/58 2023-10-03T19:21:02.800 INFO:teuthology.orchestra.run.smithi045.stdout: -5141> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e2e6240 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5887 cv=5553/5553 ap=58+58 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=167 | child=1 dirty=1 authpin=1 0x55576d056400] count now 58 2023-10-03T19:21:02.801 INFO:teuthology.orchestra.run.smithi045.stdout: -5140> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005a3) auth_unpin by 0x55576e2e6240 on [inode 0x100000005a3 [2,head] /dc-dir/dc-file_942 auth v5886 s=3 n(v0 rc2023-10-03T19:16:13.834397+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d76a100] now 0 2023-10-03T19:21:02.801 INFO:teuthology.orchestra.run.smithi045.stdout: -5139> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5887 cv=5553/5553 ap=58+57 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=167 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e2e6240 count now 58/57 2023-10-03T19:21:02.801 INFO:teuthology.orchestra.run.smithi045.stdout: -5138> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.801 INFO:teuthology.orchestra.run.smithi045.stdout: -5137> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.801 INFO:teuthology.orchestra.run.smithi045.stdout: -5136> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005a4 [2,head] /dc-dir/dc-file_943 auth v5034 pv5888 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.846350+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:13.846350+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d76a680] 2023-10-03T19:21:02.801 INFO:teuthology.orchestra.run.smithi045.stdout: -5135> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5894 2023-10-03T19:21:02.801 INFO:teuthology.orchestra.run.smithi045.stdout: -5134> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5894 pv6006 ap=58 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=58) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=57) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.801 INFO:teuthology.orchestra.run.smithi045.stdout: -5133> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5892 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.801 INFO:teuthology.orchestra.run.smithi045.stdout: -5132> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5893 cv=5559/5559 REP dir_auth=0 ap=57+58 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5893 2023-10-03T19:21:02.801 INFO:teuthology.orchestra.run.smithi045.stdout: -5131> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005a4) pop_and_dirty_projected_inode v5888 2023-10-03T19:21:02.801 INFO:teuthology.orchestra.run.smithi045.stdout: -5130> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005a4) mark_dirty [inode 0x100000005a4 [2,head] /dc-dir/dc-file_943 auth v5888 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.846350+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d76a680] 2023-10-03T19:21:02.802 INFO:teuthology.orchestra.run.smithi045.stdout: -5129> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_943) mark_dirty [dentry #0x1/dc-dir/dc-file_943 [2,head] auth (dversion lock) pv=5888 v=5034 ino=0x100000005a4 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d767400] 2023-10-03T19:21:02.802 INFO:teuthology.orchestra.run.smithi045.stdout: -5128> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5887 cv=5553/5553 ap=58+57 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=168 | child=1 dirty=1 authpin=1 0x55576d056400] version 5887 2023-10-03T19:21:02.802 INFO:teuthology.orchestra.run.smithi045.stdout: -5127> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d529220 v5895 2023-10-03T19:21:02.802 INFO:teuthology.orchestra.run.smithi045.stdout: -5126> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5895 cv=5559/5559 REP dir_auth=0 ap=57+58 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5895 2023-10-03T19:21:02.802 INFO:teuthology.orchestra.run.smithi045.stdout: -5125> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d4a9e80 v5889 2023-10-03T19:21:02.802 INFO:teuthology.orchestra.run.smithi045.stdout: -5124> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5889 cv=5553/5553 ap=58+57 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=168 | child=1 dirty=1 authpin=1 0x55576d056400] version 5889 2023-10-03T19:21:02.802 INFO:teuthology.orchestra.run.smithi045.stdout: -5123> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=57 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=57 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.910 INFO:teuthology.orchestra.run.smithi045.stdout: -5122> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=57) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5894 pv6006 ap=58 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=58) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=57) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.911 INFO:teuthology.orchestra.run.smithi045.stdout: -5121> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=58) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5894 pv6006 ap=58 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=58) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=56) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.911 INFO:teuthology.orchestra.run.smithi045.stdout: -5120> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005a4 [2,head] /dc-dir/dc-file_943 auth v5888 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.846350+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d76a680] 2023-10-03T19:21:02.911 INFO:teuthology.orchestra.run.smithi045.stdout: -5119> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005a4 [2,head] /dc-dir/dc-file_943 auth v5888 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.846350+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d76a680] 2023-10-03T19:21:02.912 INFO:teuthology.orchestra.run.smithi045.stdout: -5118> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.912 INFO:teuthology.orchestra.run.smithi045.stdout: -5117> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.912 INFO:teuthology.orchestra.run.smithi045.stdout: -5116> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.912 INFO:teuthology.orchestra.run.smithi045.stdout: -5115> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005a4 [2,head] /dc-dir/dc-file_943 auth v5888 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.846350+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d76a680] 2023-10-03T19:21:02.912 INFO:teuthology.orchestra.run.smithi045.stdout: -5114> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005a4 [2,head] /dc-dir/dc-file_943 auth v5888 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.846350+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d76a680] 2023-10-03T19:21:02.912 INFO:teuthology.orchestra.run.smithi045.stdout: -5113> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.913 INFO:teuthology.orchestra.run.smithi045.stdout: -5112> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 357.085, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.57e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:717.2] 2023-10-03T19:21:02.913 INFO:teuthology.orchestra.run.smithi045.stdout: -5111> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e2e66c0 on [dir 0x1 / [2,head] auth pv=6007 v=5895 cv=5559/5559 REP dir_auth=0 ap=56+58 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 56 2023-10-03T19:21:02.913 INFO:teuthology.orchestra.run.smithi045.stdout: -5110> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e2e66c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5894 pv6006 ap=57 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=57) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=56) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 57 2023-10-03T19:21:02.913 INFO:teuthology.orchestra.run.smithi045.stdout: -5109> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5895 cv=5559/5559 REP dir_auth=0 ap=56+57 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e2e66c0 count now 56/57 2023-10-03T19:21:02.913 INFO:teuthology.orchestra.run.smithi045.stdout: -5108> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e2e66c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5889 cv=5553/5553 ap=57+57 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=168 | child=1 dirty=1 authpin=1 0x55576d056400] count now 57 2023-10-03T19:21:02.913 INFO:teuthology.orchestra.run.smithi045.stdout: -5107> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005a4) auth_unpin by 0x55576e2e66c0 on [inode 0x100000005a4 [2,head] /dc-dir/dc-file_943 auth v5888 s=3 n(v0 rc2023-10-03T19:16:13.846350+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d76a680] now 0 2023-10-03T19:21:02.913 INFO:teuthology.orchestra.run.smithi045.stdout: -5106> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5889 cv=5553/5553 ap=57+56 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=168 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e2e66c0 count now 57/56 2023-10-03T19:21:02.913 INFO:teuthology.orchestra.run.smithi045.stdout: -5105> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.913 INFO:teuthology.orchestra.run.smithi045.stdout: -5104> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.914 INFO:teuthology.orchestra.run.smithi045.stdout: -5103> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005a5 [2,head] /dc-dir/dc-file_944 auth v5038 pv5890 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.858807+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:13.858807+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d76ac00] 2023-10-03T19:21:02.914 INFO:teuthology.orchestra.run.smithi045.stdout: -5102> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5896 2023-10-03T19:21:02.914 INFO:teuthology.orchestra.run.smithi045.stdout: -5101> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5896 pv6006 ap=57 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=57) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=56) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.914 INFO:teuthology.orchestra.run.smithi045.stdout: -5100> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5894 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.915 INFO:teuthology.orchestra.run.smithi045.stdout: -5099> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5895 cv=5559/5559 REP dir_auth=0 ap=56+57 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5895 2023-10-03T19:21:02.915 INFO:teuthology.orchestra.run.smithi045.stdout: -5098> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005a5) pop_and_dirty_projected_inode v5890 2023-10-03T19:21:02.915 INFO:teuthology.orchestra.run.smithi045.stdout: -5097> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005a5) mark_dirty [inode 0x100000005a5 [2,head] /dc-dir/dc-file_944 auth v5890 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.858807+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d76ac00] 2023-10-03T19:21:02.915 INFO:teuthology.orchestra.run.smithi045.stdout: -5096> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_944) mark_dirty [dentry #0x1/dc-dir/dc-file_944 [2,head] auth (dversion lock) pv=5890 v=5038 ino=0x100000005a5 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d767680] 2023-10-03T19:21:02.915 INFO:teuthology.orchestra.run.smithi045.stdout: -5095> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5889 cv=5553/5553 ap=57+56 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=169 | child=1 dirty=1 authpin=1 0x55576d056400] version 5889 2023-10-03T19:21:02.915 INFO:teuthology.orchestra.run.smithi045.stdout: -5094> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d528fe0 v5897 2023-10-03T19:21:02.915 INFO:teuthology.orchestra.run.smithi045.stdout: -5093> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5897 cv=5559/5559 REP dir_auth=0 ap=56+57 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5897 2023-10-03T19:21:02.915 INFO:teuthology.orchestra.run.smithi045.stdout: -5092> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d4a9c40 v5891 2023-10-03T19:21:02.916 INFO:teuthology.orchestra.run.smithi045.stdout: -5091> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5891 cv=5553/5553 ap=57+56 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=169 | child=1 dirty=1 authpin=1 0x55576d056400] version 5891 2023-10-03T19:21:02.916 INFO:teuthology.orchestra.run.smithi045.stdout: -5090> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=56 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=56 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.916 INFO:teuthology.orchestra.run.smithi045.stdout: -5089> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=56) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5896 pv6006 ap=57 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=57) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=56) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.916 INFO:teuthology.orchestra.run.smithi045.stdout: -5088> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=57) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5896 pv6006 ap=57 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=57) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=55) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.916 INFO:teuthology.orchestra.run.smithi045.stdout: -5087> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005a5 [2,head] /dc-dir/dc-file_944 auth v5890 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.858807+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d76ac00] 2023-10-03T19:21:02.916 INFO:teuthology.orchestra.run.smithi045.stdout: -5086> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005a5 [2,head] /dc-dir/dc-file_944 auth v5890 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.858807+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d76ac00] 2023-10-03T19:21:02.916 INFO:teuthology.orchestra.run.smithi045.stdout: -5085> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.916 INFO:teuthology.orchestra.run.smithi045.stdout: -5084> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.916 INFO:teuthology.orchestra.run.smithi045.stdout: -5083> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.916 INFO:teuthology.orchestra.run.smithi045.stdout: -5082> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005a5 [2,head] /dc-dir/dc-file_944 auth v5890 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.858807+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d76ac00] 2023-10-03T19:21:02.916 INFO:teuthology.orchestra.run.smithi045.stdout: -5081> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005a5 [2,head] /dc-dir/dc-file_944 auth v5890 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.858807+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d76ac00] 2023-10-03T19:21:02.917 INFO:teuthology.orchestra.run.smithi045.stdout: -5080> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.917 INFO:teuthology.orchestra.run.smithi045.stdout: -5079> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 358.085, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.58e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:719.2] 2023-10-03T19:21:02.917 INFO:teuthology.orchestra.run.smithi045.stdout: -5078> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e2e6b40 on [dir 0x1 / [2,head] auth pv=6007 v=5897 cv=5559/5559 REP dir_auth=0 ap=55+57 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 55 2023-10-03T19:21:02.917 INFO:teuthology.orchestra.run.smithi045.stdout: -5077> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e2e6b40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5896 pv6006 ap=56 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=56) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=55) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 56 2023-10-03T19:21:02.925 INFO:teuthology.orchestra.run.smithi045.stdout: -5076> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5897 cv=5559/5559 REP dir_auth=0 ap=55+56 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e2e6b40 count now 55/56 2023-10-03T19:21:02.925 INFO:teuthology.orchestra.run.smithi045.stdout: -5075> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e2e6b40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5891 cv=5553/5553 ap=56+56 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=169 | child=1 dirty=1 authpin=1 0x55576d056400] count now 56 2023-10-03T19:21:02.925 INFO:teuthology.orchestra.run.smithi045.stdout: -5074> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005a5) auth_unpin by 0x55576e2e6b40 on [inode 0x100000005a5 [2,head] /dc-dir/dc-file_944 auth v5890 s=3 n(v0 rc2023-10-03T19:16:13.858807+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d76ac00] now 0 2023-10-03T19:21:02.925 INFO:teuthology.orchestra.run.smithi045.stdout: -5073> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5891 cv=5553/5553 ap=56+55 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=169 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e2e6b40 count now 56/55 2023-10-03T19:21:02.925 INFO:teuthology.orchestra.run.smithi045.stdout: -5072> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.925 INFO:teuthology.orchestra.run.smithi045.stdout: -5071> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.926 INFO:teuthology.orchestra.run.smithi045.stdout: -5070> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005a6 [2,head] /dc-dir/dc-file_945 auth v5042 pv5892 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.870402+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:13.870402+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d76b180] 2023-10-03T19:21:02.926 INFO:teuthology.orchestra.run.smithi045.stdout: -5069> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5898 2023-10-03T19:21:02.926 INFO:teuthology.orchestra.run.smithi045.stdout: -5068> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5898 pv6006 ap=56 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=56) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=55) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.926 INFO:teuthology.orchestra.run.smithi045.stdout: -5067> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5896 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.926 INFO:teuthology.orchestra.run.smithi045.stdout: -5066> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5897 cv=5559/5559 REP dir_auth=0 ap=55+56 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5897 2023-10-03T19:21:02.926 INFO:teuthology.orchestra.run.smithi045.stdout: -5065> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005a6) pop_and_dirty_projected_inode v5892 2023-10-03T19:21:02.927 INFO:teuthology.orchestra.run.smithi045.stdout: -5064> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005a6) mark_dirty [inode 0x100000005a6 [2,head] /dc-dir/dc-file_945 auth v5892 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.870402+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d76b180] 2023-10-03T19:21:02.927 INFO:teuthology.orchestra.run.smithi045.stdout: -5063> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_945) mark_dirty [dentry #0x1/dc-dir/dc-file_945 [2,head] auth (dversion lock) pv=5892 v=5042 ino=0x100000005a6 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d767900] 2023-10-03T19:21:02.927 INFO:teuthology.orchestra.run.smithi045.stdout: -5062> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5891 cv=5553/5553 ap=56+55 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=170 | child=1 dirty=1 authpin=1 0x55576d056400] version 5891 2023-10-03T19:21:02.927 INFO:teuthology.orchestra.run.smithi045.stdout: -5061> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d528da0 v5899 2023-10-03T19:21:02.927 INFO:teuthology.orchestra.run.smithi045.stdout: -5060> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5899 cv=5559/5559 REP dir_auth=0 ap=55+56 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5899 2023-10-03T19:21:02.927 INFO:teuthology.orchestra.run.smithi045.stdout: -5059> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d529460 v5893 2023-10-03T19:21:02.927 INFO:teuthology.orchestra.run.smithi045.stdout: -5058> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5893 cv=5553/5553 ap=56+55 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=170 | child=1 dirty=1 authpin=1 0x55576d056400] version 5893 2023-10-03T19:21:02.927 INFO:teuthology.orchestra.run.smithi045.stdout: -5057> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=55 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=55 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.928 INFO:teuthology.orchestra.run.smithi045.stdout: -5056> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=55) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5898 pv6006 ap=56 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=56) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=55) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.928 INFO:teuthology.orchestra.run.smithi045.stdout: -5055> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=56) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5898 pv6006 ap=56 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=56) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=54) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.928 INFO:teuthology.orchestra.run.smithi045.stdout: -5054> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005a6 [2,head] /dc-dir/dc-file_945 auth v5892 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.870402+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d76b180] 2023-10-03T19:21:02.928 INFO:teuthology.orchestra.run.smithi045.stdout: -5053> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005a6 [2,head] /dc-dir/dc-file_945 auth v5892 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.870402+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d76b180] 2023-10-03T19:21:02.928 INFO:teuthology.orchestra.run.smithi045.stdout: -5052> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.928 INFO:teuthology.orchestra.run.smithi045.stdout: -5051> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.928 INFO:teuthology.orchestra.run.smithi045.stdout: -5050> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.929 INFO:teuthology.orchestra.run.smithi045.stdout: -5049> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005a6 [2,head] /dc-dir/dc-file_945 auth v5892 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.870402+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d76b180] 2023-10-03T19:21:02.929 INFO:teuthology.orchestra.run.smithi045.stdout: -5048> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005a6 [2,head] /dc-dir/dc-file_945 auth v5892 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.870402+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d76b180] 2023-10-03T19:21:02.929 INFO:teuthology.orchestra.run.smithi045.stdout: -5047> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.929 INFO:teuthology.orchestra.run.smithi045.stdout: -5046> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 359.085, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.59e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.50e-01] *LOAD:721.2] 2023-10-03T19:21:02.929 INFO:teuthology.orchestra.run.smithi045.stdout: -5045> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e2e6fc0 on [dir 0x1 / [2,head] auth pv=6007 v=5899 cv=5559/5559 REP dir_auth=0 ap=54+56 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 54 2023-10-03T19:21:02.929 INFO:teuthology.orchestra.run.smithi045.stdout: -5044> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e2e6fc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5898 pv6006 ap=55 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=55) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=54) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 55 2023-10-03T19:21:02.930 INFO:teuthology.orchestra.run.smithi045.stdout: -5043> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5899 cv=5559/5559 REP dir_auth=0 ap=54+55 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e2e6fc0 count now 54/55 2023-10-03T19:21:02.930 INFO:teuthology.orchestra.run.smithi045.stdout: -5042> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e2e6fc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5893 cv=5553/5553 ap=55+55 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=170 | child=1 dirty=1 authpin=1 0x55576d056400] count now 55 2023-10-03T19:21:02.930 INFO:teuthology.orchestra.run.smithi045.stdout: -5041> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005a6) auth_unpin by 0x55576e2e6fc0 on [inode 0x100000005a6 [2,head] /dc-dir/dc-file_945 auth v5892 s=3 n(v0 rc2023-10-03T19:16:13.870402+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d76b180] now 0 2023-10-03T19:21:02.930 INFO:teuthology.orchestra.run.smithi045.stdout: -5040> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5893 cv=5553/5553 ap=55+54 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=170 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e2e6fc0 count now 55/54 2023-10-03T19:21:02.930 INFO:teuthology.orchestra.run.smithi045.stdout: -5039> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.930 INFO:teuthology.orchestra.run.smithi045.stdout: -5038> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.931 INFO:teuthology.orchestra.run.smithi045.stdout: -5037> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005a7 [2,head] /dc-dir/dc-file_946 auth v5046 pv5894 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.883834+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:13.883834+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d76b700] 2023-10-03T19:21:02.931 INFO:teuthology.orchestra.run.smithi045.stdout: -5036> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5900 2023-10-03T19:21:02.931 INFO:teuthology.orchestra.run.smithi045.stdout: -5035> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5900 pv6006 ap=55 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=55) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=54) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.931 INFO:teuthology.orchestra.run.smithi045.stdout: -5034> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5898 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.931 INFO:teuthology.orchestra.run.smithi045.stdout: -5033> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5899 cv=5559/5559 REP dir_auth=0 ap=54+55 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5899 2023-10-03T19:21:02.931 INFO:teuthology.orchestra.run.smithi045.stdout: -5032> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005a7) pop_and_dirty_projected_inode v5894 2023-10-03T19:21:02.931 INFO:teuthology.orchestra.run.smithi045.stdout: -5031> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005a7) mark_dirty [inode 0x100000005a7 [2,head] /dc-dir/dc-file_946 auth v5894 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.883834+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d76b700] 2023-10-03T19:21:02.932 INFO:teuthology.orchestra.run.smithi045.stdout: -5030> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_946) mark_dirty [dentry #0x1/dc-dir/dc-file_946 [2,head] auth (dversion lock) pv=5894 v=5046 ino=0x100000005a7 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d767b80] 2023-10-03T19:21:02.932 INFO:teuthology.orchestra.run.smithi045.stdout: -5029> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5893 cv=5553/5553 ap=55+54 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=171 | child=1 dirty=1 authpin=1 0x55576d056400] version 5893 2023-10-03T19:21:02.932 INFO:teuthology.orchestra.run.smithi045.stdout: -5028> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d528b60 v5901 2023-10-03T19:21:02.932 INFO:teuthology.orchestra.run.smithi045.stdout: -5027> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5901 cv=5559/5559 REP dir_auth=0 ap=54+55 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5901 2023-10-03T19:21:02.932 INFO:teuthology.orchestra.run.smithi045.stdout: -5026> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d5298e0 v5895 2023-10-03T19:21:02.932 INFO:teuthology.orchestra.run.smithi045.stdout: -5025> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5895 cv=5553/5553 ap=55+54 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=171 | child=1 dirty=1 authpin=1 0x55576d056400] version 5895 2023-10-03T19:21:02.932 INFO:teuthology.orchestra.run.smithi045.stdout: -5024> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=54 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=54 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.932 INFO:teuthology.orchestra.run.smithi045.stdout: -5023> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=54) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5900 pv6006 ap=55 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=55) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=54) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.933 INFO:teuthology.orchestra.run.smithi045.stdout: -5022> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=55) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5900 pv6006 ap=55 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=55) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=53) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.933 INFO:teuthology.orchestra.run.smithi045.stdout: -5021> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005a7 [2,head] /dc-dir/dc-file_946 auth v5894 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.883834+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d76b700] 2023-10-03T19:21:02.933 INFO:teuthology.orchestra.run.smithi045.stdout: -5020> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005a7 [2,head] /dc-dir/dc-file_946 auth v5894 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.883834+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d76b700] 2023-10-03T19:21:02.933 INFO:teuthology.orchestra.run.smithi045.stdout: -5019> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.933 INFO:teuthology.orchestra.run.smithi045.stdout: -5018> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.933 INFO:teuthology.orchestra.run.smithi045.stdout: -5017> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.933 INFO:teuthology.orchestra.run.smithi045.stdout: -5016> 2023-10-03T19:16:28.794+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005a7 [2,head] /dc-dir/dc-file_946 auth v5894 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.883834+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d76b700] 2023-10-03T19:21:02.934 INFO:teuthology.orchestra.run.smithi045.stdout: -5015> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005a7 [2,head] /dc-dir/dc-file_946 auth v5894 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.883834+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d76b700] 2023-10-03T19:21:02.934 INFO:teuthology.orchestra.run.smithi045.stdout: -5014> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.934 INFO:teuthology.orchestra.run.smithi045.stdout: -5013> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 359.885, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.60e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:722.8] 2023-10-03T19:21:02.934 INFO:teuthology.orchestra.run.smithi045.stdout: -5012> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e2e7440 on [dir 0x1 / [2,head] auth pv=6007 v=5901 cv=5559/5559 REP dir_auth=0 ap=53+55 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 53 2023-10-03T19:21:02.934 INFO:teuthology.orchestra.run.smithi045.stdout: -5011> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e2e7440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5895 cv=5553/5553 ap=54+54 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=171 | child=1 dirty=1 authpin=1 0x55576d056400] count now 54 2023-10-03T19:21:02.935 INFO:teuthology.orchestra.run.smithi045.stdout: -5010> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e2e7440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5900 pv6006 ap=54 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=54) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=53) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 54 2023-10-03T19:21:02.935 INFO:teuthology.orchestra.run.smithi045.stdout: -5009> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5901 cv=5559/5559 REP dir_auth=0 ap=53+54 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e2e7440 count now 53/54 2023-10-03T19:21:02.935 INFO:teuthology.orchestra.run.smithi045.stdout: -5008> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005a7) auth_unpin by 0x55576e2e7440 on [inode 0x100000005a7 [2,head] /dc-dir/dc-file_946 auth v5894 s=3 n(v0 rc2023-10-03T19:16:13.883834+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d76b700] now 0 2023-10-03T19:21:02.935 INFO:teuthology.orchestra.run.smithi045.stdout: -5007> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5895 cv=5553/5553 ap=54+53 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=171 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e2e7440 count now 54/53 2023-10-03T19:21:02.935 INFO:teuthology.orchestra.run.smithi045.stdout: -5006> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.935 INFO:teuthology.orchestra.run.smithi045.stdout: -5005> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.935 INFO:teuthology.orchestra.run.smithi045.stdout: -5004> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005a8 [2,head] /dc-dir/dc-file_947 auth v5050 pv5896 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.895684+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:13.895684+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d770000] 2023-10-03T19:21:02.935 INFO:teuthology.orchestra.run.smithi045.stdout: -5003> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5902 2023-10-03T19:21:02.935 INFO:teuthology.orchestra.run.smithi045.stdout: -5002> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5902 pv6006 ap=54 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=54) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=53) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.935 INFO:teuthology.orchestra.run.smithi045.stdout: -5001> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5900 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.935 INFO:teuthology.orchestra.run.smithi045.stdout: -5000> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5901 cv=5559/5559 REP dir_auth=0 ap=53+54 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5901 2023-10-03T19:21:02.936 INFO:teuthology.orchestra.run.smithi045.stdout: -4999> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005a8) pop_and_dirty_projected_inode v5896 2023-10-03T19:21:02.936 INFO:teuthology.orchestra.run.smithi045.stdout: -4998> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005a8) mark_dirty [inode 0x100000005a8 [2,head] /dc-dir/dc-file_947 auth v5896 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.895684+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d770000] 2023-10-03T19:21:02.936 INFO:teuthology.orchestra.run.smithi045.stdout: -4997> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_947) mark_dirty [dentry #0x1/dc-dir/dc-file_947 [2,head] auth (dversion lock) pv=5896 v=5050 ino=0x100000005a8 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d76e000] 2023-10-03T19:21:02.936 INFO:teuthology.orchestra.run.smithi045.stdout: -4996> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5895 cv=5553/5553 ap=54+53 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=172 | child=1 dirty=1 authpin=1 0x55576d056400] version 5895 2023-10-03T19:21:02.936 INFO:teuthology.orchestra.run.smithi045.stdout: -4995> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d826380 v5903 2023-10-03T19:21:02.936 INFO:teuthology.orchestra.run.smithi045.stdout: -4994> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5903 cv=5559/5559 REP dir_auth=0 ap=53+54 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5903 2023-10-03T19:21:02.936 INFO:teuthology.orchestra.run.smithi045.stdout: -4993> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d826260 v5897 2023-10-03T19:21:02.936 INFO:teuthology.orchestra.run.smithi045.stdout: -4992> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5897 cv=5553/5553 ap=54+53 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=172 | child=1 dirty=1 authpin=1 0x55576d056400] version 5897 2023-10-03T19:21:02.936 INFO:teuthology.orchestra.run.smithi045.stdout: -4991> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=53 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=53 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.936 INFO:teuthology.orchestra.run.smithi045.stdout: -4990> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=53) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5902 pv6006 ap=54 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=54) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=53) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.937 INFO:teuthology.orchestra.run.smithi045.stdout: -4989> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=54) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5902 pv6006 ap=54 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=54) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=52) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.937 INFO:teuthology.orchestra.run.smithi045.stdout: -4988> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005a8 [2,head] /dc-dir/dc-file_947 auth v5896 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.895684+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d770000] 2023-10-03T19:21:02.937 INFO:teuthology.orchestra.run.smithi045.stdout: -4987> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005a8 [2,head] /dc-dir/dc-file_947 auth v5896 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.895684+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d770000] 2023-10-03T19:21:02.937 INFO:teuthology.orchestra.run.smithi045.stdout: -4986> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.937 INFO:teuthology.orchestra.run.smithi045.stdout: -4985> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.937 INFO:teuthology.orchestra.run.smithi045.stdout: -4984> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.937 INFO:teuthology.orchestra.run.smithi045.stdout: -4983> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005a8 [2,head] /dc-dir/dc-file_947 auth v5896 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.895684+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d770000] 2023-10-03T19:21:02.937 INFO:teuthology.orchestra.run.smithi045.stdout: -4982> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005a8 [2,head] /dc-dir/dc-file_947 auth v5896 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.895684+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d770000] 2023-10-03T19:21:02.937 INFO:teuthology.orchestra.run.smithi045.stdout: -4981> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.937 INFO:teuthology.orchestra.run.smithi045.stdout: -4980> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 360.885, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.61e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:724.8] 2023-10-03T19:21:02.937 INFO:teuthology.orchestra.run.smithi045.stdout: -4979> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e2e78c0 on [dir 0x1 / [2,head] auth pv=6007 v=5903 cv=5559/5559 REP dir_auth=0 ap=52+54 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 52 2023-10-03T19:21:02.938 INFO:teuthology.orchestra.run.smithi045.stdout: -4978> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e2e78c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5902 pv6006 ap=53 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=53) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=52) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 53 2023-10-03T19:21:02.938 INFO:teuthology.orchestra.run.smithi045.stdout: -4977> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5903 cv=5559/5559 REP dir_auth=0 ap=52+53 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e2e78c0 count now 52/53 2023-10-03T19:21:02.938 INFO:teuthology.orchestra.run.smithi045.stdout: -4976> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e2e78c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5897 cv=5553/5553 ap=53+53 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=172 | child=1 dirty=1 authpin=1 0x55576d056400] count now 53 2023-10-03T19:21:02.938 INFO:teuthology.orchestra.run.smithi045.stdout: -4975> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005a8) auth_unpin by 0x55576e2e78c0 on [inode 0x100000005a8 [2,head] /dc-dir/dc-file_947 auth v5896 s=3 n(v0 rc2023-10-03T19:16:13.895684+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d770000] now 0 2023-10-03T19:21:02.938 INFO:teuthology.orchestra.run.smithi045.stdout: -4974> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5897 cv=5553/5553 ap=53+52 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=172 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e2e78c0 count now 53/52 2023-10-03T19:21:02.938 INFO:teuthology.orchestra.run.smithi045.stdout: -4973> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.938 INFO:teuthology.orchestra.run.smithi045.stdout: -4972> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.938 INFO:teuthology.orchestra.run.smithi045.stdout: -4971> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005a9 [2,head] /dc-dir/dc-file_948 auth v5054 pv5898 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.907952+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:13.907952+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d770580] 2023-10-03T19:21:02.938 INFO:teuthology.orchestra.run.smithi045.stdout: -4970> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5904 2023-10-03T19:21:02.938 INFO:teuthology.orchestra.run.smithi045.stdout: -4969> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5904 pv6006 ap=53 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=53) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=52) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.938 INFO:teuthology.orchestra.run.smithi045.stdout: -4968> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5902 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.939 INFO:teuthology.orchestra.run.smithi045.stdout: -4967> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5903 cv=5559/5559 REP dir_auth=0 ap=52+53 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5903 2023-10-03T19:21:02.939 INFO:teuthology.orchestra.run.smithi045.stdout: -4966> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005a9) pop_and_dirty_projected_inode v5898 2023-10-03T19:21:02.939 INFO:teuthology.orchestra.run.smithi045.stdout: -4965> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005a9) mark_dirty [inode 0x100000005a9 [2,head] /dc-dir/dc-file_948 auth v5898 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.907952+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d770580] 2023-10-03T19:21:02.939 INFO:teuthology.orchestra.run.smithi045.stdout: -4964> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_948) mark_dirty [dentry #0x1/dc-dir/dc-file_948 [2,head] auth (dversion lock) pv=5898 v=5054 ino=0x100000005a9 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d76e280] 2023-10-03T19:21:02.939 INFO:teuthology.orchestra.run.smithi045.stdout: -4963> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5897 cv=5553/5553 ap=53+52 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=173 | child=1 dirty=1 authpin=1 0x55576d056400] version 5897 2023-10-03T19:21:02.939 INFO:teuthology.orchestra.run.smithi045.stdout: -4962> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d8265c0 v5905 2023-10-03T19:21:02.939 INFO:teuthology.orchestra.run.smithi045.stdout: -4961> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5905 cv=5559/5559 REP dir_auth=0 ap=52+53 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5905 2023-10-03T19:21:02.940 INFO:teuthology.orchestra.run.smithi045.stdout: -4960> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d8264a0 v5899 2023-10-03T19:21:02.940 INFO:teuthology.orchestra.run.smithi045.stdout: -4959> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5899 cv=5553/5553 ap=53+52 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=173 | child=1 dirty=1 authpin=1 0x55576d056400] version 5899 2023-10-03T19:21:02.940 INFO:teuthology.orchestra.run.smithi045.stdout: -4958> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=52 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=52 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.952 INFO:teuthology.orchestra.run.smithi045.stdout: -4957> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=52) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5904 pv6006 ap=53 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=53) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=52) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.952 INFO:teuthology.orchestra.run.smithi045.stdout: -4956> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=53) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5904 pv6006 ap=53 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=53) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=51) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.952 INFO:teuthology.orchestra.run.smithi045.stdout: -4955> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005a9 [2,head] /dc-dir/dc-file_948 auth v5898 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.907952+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d770580] 2023-10-03T19:21:02.952 INFO:teuthology.orchestra.run.smithi045.stdout: -4954> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005a9 [2,head] /dc-dir/dc-file_948 auth v5898 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.907952+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d770580] 2023-10-03T19:21:02.952 INFO:teuthology.orchestra.run.smithi045.stdout: -4953> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.952 INFO:teuthology.orchestra.run.smithi045.stdout: -4952> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.953 INFO:teuthology.orchestra.run.smithi045.stdout: -4951> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.953 INFO:teuthology.orchestra.run.smithi045.stdout: -4950> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005a9 [2,head] /dc-dir/dc-file_948 auth v5898 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.907952+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d770580] 2023-10-03T19:21:02.953 INFO:teuthology.orchestra.run.smithi045.stdout: -4949> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005a9 [2,head] /dc-dir/dc-file_948 auth v5898 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.907952+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d770580] 2023-10-03T19:21:02.953 INFO:teuthology.orchestra.run.smithi045.stdout: -4948> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.953 INFO:teuthology.orchestra.run.smithi045.stdout: -4947> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 361.885, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.62e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:726.8] 2023-10-03T19:21:02.953 INFO:teuthology.orchestra.run.smithi045.stdout: -4946> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e2e7d40 on [dir 0x1 / [2,head] auth pv=6007 v=5905 cv=5559/5559 REP dir_auth=0 ap=51+53 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 51 2023-10-03T19:21:02.953 INFO:teuthology.orchestra.run.smithi045.stdout: -4945> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e2e7d40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5904 pv6006 ap=52 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=52) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=51) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 52 2023-10-03T19:21:02.953 INFO:teuthology.orchestra.run.smithi045.stdout: -4944> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5905 cv=5559/5559 REP dir_auth=0 ap=51+52 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e2e7d40 count now 51/52 2023-10-03T19:21:02.953 INFO:teuthology.orchestra.run.smithi045.stdout: -4943> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e2e7d40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5899 cv=5553/5553 ap=52+52 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=173 | child=1 dirty=1 authpin=1 0x55576d056400] count now 52 2023-10-03T19:21:02.954 INFO:teuthology.orchestra.run.smithi045.stdout: -4942> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005a9) auth_unpin by 0x55576e2e7d40 on [inode 0x100000005a9 [2,head] /dc-dir/dc-file_948 auth v5898 s=3 n(v0 rc2023-10-03T19:16:13.907952+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d770580] now 0 2023-10-03T19:21:02.954 INFO:teuthology.orchestra.run.smithi045.stdout: -4941> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5899 cv=5553/5553 ap=52+51 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=173 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e2e7d40 count now 52/51 2023-10-03T19:21:02.957 INFO:teuthology.orchestra.run.smithi045.stdout: -4940> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.957 INFO:teuthology.orchestra.run.smithi045.stdout: -4939> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.957 INFO:teuthology.orchestra.run.smithi045.stdout: -4938> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005aa [2,head] /dc-dir/dc-file_949 auth v5058 pv5900 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.918957+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:13.918957+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d770b00] 2023-10-03T19:21:02.957 INFO:teuthology.orchestra.run.smithi045.stdout: -4937> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5906 2023-10-03T19:21:02.958 INFO:teuthology.orchestra.run.smithi045.stdout: -4936> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5906 pv6006 ap=52 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=52) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=51) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.958 INFO:teuthology.orchestra.run.smithi045.stdout: -4935> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5904 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.958 INFO:teuthology.orchestra.run.smithi045.stdout: -4934> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5905 cv=5559/5559 REP dir_auth=0 ap=51+52 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5905 2023-10-03T19:21:02.958 INFO:teuthology.orchestra.run.smithi045.stdout: -4933> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005aa) pop_and_dirty_projected_inode v5900 2023-10-03T19:21:02.958 INFO:teuthology.orchestra.run.smithi045.stdout: -4932> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005aa) mark_dirty [inode 0x100000005aa [2,head] /dc-dir/dc-file_949 auth v5900 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.918957+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d770b00] 2023-10-03T19:21:02.958 INFO:teuthology.orchestra.run.smithi045.stdout: -4931> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_949) mark_dirty [dentry #0x1/dc-dir/dc-file_949 [2,head] auth (dversion lock) pv=5900 v=5058 ino=0x100000005aa state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d76e500] 2023-10-03T19:21:02.958 INFO:teuthology.orchestra.run.smithi045.stdout: -4930> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5899 cv=5553/5553 ap=52+51 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=174 | child=1 dirty=1 authpin=1 0x55576d056400] version 5899 2023-10-03T19:21:02.959 INFO:teuthology.orchestra.run.smithi045.stdout: -4929> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d826800 v5907 2023-10-03T19:21:02.959 INFO:teuthology.orchestra.run.smithi045.stdout: -4928> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5907 cv=5559/5559 REP dir_auth=0 ap=51+52 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5907 2023-10-03T19:21:02.959 INFO:teuthology.orchestra.run.smithi045.stdout: -4927> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d8266e0 v5901 2023-10-03T19:21:02.959 INFO:teuthology.orchestra.run.smithi045.stdout: -4926> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5901 cv=5553/5553 ap=52+51 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=174 | child=1 dirty=1 authpin=1 0x55576d056400] version 5901 2023-10-03T19:21:02.959 INFO:teuthology.orchestra.run.smithi045.stdout: -4925> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=51 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=51 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.959 INFO:teuthology.orchestra.run.smithi045.stdout: -4924> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=51) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5906 pv6006 ap=52 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=52) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=51) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.959 INFO:teuthology.orchestra.run.smithi045.stdout: -4923> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=52) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5906 pv6006 ap=52 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=52) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=50) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.959 INFO:teuthology.orchestra.run.smithi045.stdout: -4922> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005aa [2,head] /dc-dir/dc-file_949 auth v5900 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.918957+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d770b00] 2023-10-03T19:21:02.959 INFO:teuthology.orchestra.run.smithi045.stdout: -4921> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005aa [2,head] /dc-dir/dc-file_949 auth v5900 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.918957+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d770b00] 2023-10-03T19:21:02.960 INFO:teuthology.orchestra.run.smithi045.stdout: -4920> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:02.960 INFO:teuthology.orchestra.run.smithi045.stdout: -4919> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:02.960 INFO:teuthology.orchestra.run.smithi045.stdout: -4918> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:02.960 INFO:teuthology.orchestra.run.smithi045.stdout: -4917> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005aa [2,head] /dc-dir/dc-file_949 auth v5900 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.918957+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d770b00] 2023-10-03T19:21:02.960 INFO:teuthology.orchestra.run.smithi045.stdout: -4916> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005aa [2,head] /dc-dir/dc-file_949 auth v5900 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.918957+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d770b00] 2023-10-03T19:21:02.960 INFO:teuthology.orchestra.run.smithi045.stdout: -4915> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:02.960 INFO:teuthology.orchestra.run.smithi045.stdout: -4914> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 362.885, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.63e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:728.8] 2023-10-03T19:21:02.960 INFO:teuthology.orchestra.run.smithi045.stdout: -4913> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576ddca240 on [dir 0x1 / [2,head] auth pv=6007 v=5907 cv=5559/5559 REP dir_auth=0 ap=50+52 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 50 2023-10-03T19:21:02.961 INFO:teuthology.orchestra.run.smithi045.stdout: -4912> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576ddca240 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5906 pv6006 ap=51 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=51) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=50) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 51 2023-10-03T19:21:02.961 INFO:teuthology.orchestra.run.smithi045.stdout: -4911> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5907 cv=5559/5559 REP dir_auth=0 ap=50+51 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576ddca240 count now 50/51 2023-10-03T19:21:02.961 INFO:teuthology.orchestra.run.smithi045.stdout: -4910> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576ddca240 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5901 cv=5553/5553 ap=51+51 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=174 | child=1 dirty=1 authpin=1 0x55576d056400] count now 51 2023-10-03T19:21:02.961 INFO:teuthology.orchestra.run.smithi045.stdout: -4909> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005aa) auth_unpin by 0x55576ddca240 on [inode 0x100000005aa [2,head] /dc-dir/dc-file_949 auth v5900 s=3 n(v0 rc2023-10-03T19:16:13.918957+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d770b00] now 0 2023-10-03T19:21:02.961 INFO:teuthology.orchestra.run.smithi045.stdout: -4908> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5901 cv=5553/5553 ap=51+50 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=174 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576ddca240 count now 51/50 2023-10-03T19:21:02.961 INFO:teuthology.orchestra.run.smithi045.stdout: -4907> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.961 INFO:teuthology.orchestra.run.smithi045.stdout: -4906> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:02.961 INFO:teuthology.orchestra.run.smithi045.stdout: -4905> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005ab [2,head] /dc-dir/dc-file_950 auth v5062 pv5902 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.931301+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:13.931301+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d771080] 2023-10-03T19:21:02.961 INFO:teuthology.orchestra.run.smithi045.stdout: -4904> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5908 2023-10-03T19:21:02.961 INFO:teuthology.orchestra.run.smithi045.stdout: -4903> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5908 pv6006 ap=51 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=51) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=50) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.962 INFO:teuthology.orchestra.run.smithi045.stdout: -4902> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5906 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:02.962 INFO:teuthology.orchestra.run.smithi045.stdout: -4901> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5907 cv=5559/5559 REP dir_auth=0 ap=50+51 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5907 2023-10-03T19:21:02.962 INFO:teuthology.orchestra.run.smithi045.stdout: -4900> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005ab) pop_and_dirty_projected_inode v5902 2023-10-03T19:21:02.962 INFO:teuthology.orchestra.run.smithi045.stdout: -4899> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005ab) mark_dirty [inode 0x100000005ab [2,head] /dc-dir/dc-file_950 auth v5902 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.931301+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d771080] 2023-10-03T19:21:02.962 INFO:teuthology.orchestra.run.smithi045.stdout: -4898> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_950) mark_dirty [dentry #0x1/dc-dir/dc-file_950 [2,head] auth (dversion lock) pv=5902 v=5062 ino=0x100000005ab state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d76e780] 2023-10-03T19:21:02.963 INFO:teuthology.orchestra.run.smithi045.stdout: -4897> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5901 cv=5553/5553 ap=51+50 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=175 | child=1 dirty=1 authpin=1 0x55576d056400] version 5901 2023-10-03T19:21:02.963 INFO:teuthology.orchestra.run.smithi045.stdout: -4896> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d826a40 v5909 2023-10-03T19:21:02.963 INFO:teuthology.orchestra.run.smithi045.stdout: -4895> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5909 cv=5559/5559 REP dir_auth=0 ap=50+51 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5909 2023-10-03T19:21:02.963 INFO:teuthology.orchestra.run.smithi045.stdout: -4894> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d826920 v5903 2023-10-03T19:21:02.963 INFO:teuthology.orchestra.run.smithi045.stdout: -4893> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5903 cv=5553/5553 ap=51+50 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=175 | child=1 dirty=1 authpin=1 0x55576d056400] version 5903 2023-10-03T19:21:02.963 INFO:teuthology.orchestra.run.smithi045.stdout: -4892> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=50 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=50 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:02.963 INFO:teuthology.orchestra.run.smithi045.stdout: -4891> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=50) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5908 pv6006 ap=51 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=51) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=50) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.964 INFO:teuthology.orchestra.run.smithi045.stdout: -4890> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=51) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5908 pv6006 ap=51 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=51) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=49) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:02.964 INFO:teuthology.orchestra.run.smithi045.stdout: -4889> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005ab [2,head] /dc-dir/dc-file_950 auth v5902 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.931301+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d771080] 2023-10-03T19:21:02.964 INFO:teuthology.orchestra.run.smithi045.stdout: -4888> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005ab [2,head] /dc-dir/dc-file_950 auth v5902 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.931301+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d771080] 2023-10-03T19:21:02.964 INFO:teuthology.orchestra.run.smithi045.stdout: -4887> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.074 INFO:teuthology.orchestra.run.smithi045.stdout: -4886> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.074 INFO:teuthology.orchestra.run.smithi045.stdout: -4885> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.074 INFO:teuthology.orchestra.run.smithi045.stdout: -4884> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005ab [2,head] /dc-dir/dc-file_950 auth v5902 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.931301+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d771080] 2023-10-03T19:21:03.074 INFO:teuthology.orchestra.run.smithi045.stdout: -4883> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005ab [2,head] /dc-dir/dc-file_950 auth v5902 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.931301+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d771080] 2023-10-03T19:21:03.074 INFO:teuthology.orchestra.run.smithi045.stdout: -4882> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.074 INFO:teuthology.orchestra.run.smithi045.stdout: -4881> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 363.885, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.64e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:730.8] 2023-10-03T19:21:03.074 INFO:teuthology.orchestra.run.smithi045.stdout: -4880> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576ddca6c0 on [dir 0x1 / [2,head] auth pv=6007 v=5909 cv=5559/5559 REP dir_auth=0 ap=49+51 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 49 2023-10-03T19:21:03.074 INFO:teuthology.orchestra.run.smithi045.stdout: -4879> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576ddca6c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5908 pv6006 ap=50 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=50) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=49) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 50 2023-10-03T19:21:03.075 INFO:teuthology.orchestra.run.smithi045.stdout: -4878> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5909 cv=5559/5559 REP dir_auth=0 ap=49+50 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576ddca6c0 count now 49/50 2023-10-03T19:21:03.075 INFO:teuthology.orchestra.run.smithi045.stdout: -4877> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576ddca6c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5903 cv=5553/5553 ap=50+50 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=175 | child=1 dirty=1 authpin=1 0x55576d056400] count now 50 2023-10-03T19:21:03.075 INFO:teuthology.orchestra.run.smithi045.stdout: -4876> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005ab) auth_unpin by 0x55576ddca6c0 on [inode 0x100000005ab [2,head] /dc-dir/dc-file_950 auth v5902 s=3 n(v0 rc2023-10-03T19:16:13.931301+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d771080] now 0 2023-10-03T19:21:03.075 INFO:teuthology.orchestra.run.smithi045.stdout: -4875> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5903 cv=5553/5553 ap=50+49 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=175 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576ddca6c0 count now 50/49 2023-10-03T19:21:03.075 INFO:teuthology.orchestra.run.smithi045.stdout: -4874> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.075 INFO:teuthology.orchestra.run.smithi045.stdout: -4873> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.075 INFO:teuthology.orchestra.run.smithi045.stdout: -4872> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005ac [2,head] /dc-dir/dc-file_951 auth v5066 pv5904 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.942462+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:13.942462+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d771600] 2023-10-03T19:21:03.075 INFO:teuthology.orchestra.run.smithi045.stdout: -4871> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5910 2023-10-03T19:21:03.076 INFO:teuthology.orchestra.run.smithi045.stdout: -4870> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5910 pv6006 ap=50 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=50) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=49) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.076 INFO:teuthology.orchestra.run.smithi045.stdout: -4869> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5908 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.076 INFO:teuthology.orchestra.run.smithi045.stdout: -4868> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5909 cv=5559/5559 REP dir_auth=0 ap=49+50 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5909 2023-10-03T19:21:03.076 INFO:teuthology.orchestra.run.smithi045.stdout: -4867> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005ac) pop_and_dirty_projected_inode v5904 2023-10-03T19:21:03.076 INFO:teuthology.orchestra.run.smithi045.stdout: -4866> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005ac) mark_dirty [inode 0x100000005ac [2,head] /dc-dir/dc-file_951 auth v5904 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.942462+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d771600] 2023-10-03T19:21:03.076 INFO:teuthology.orchestra.run.smithi045.stdout: -4865> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_951) mark_dirty [dentry #0x1/dc-dir/dc-file_951 [2,head] auth (dversion lock) pv=5904 v=5066 ino=0x100000005ac state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d76ea00] 2023-10-03T19:21:03.076 INFO:teuthology.orchestra.run.smithi045.stdout: -4864> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5903 cv=5553/5553 ap=50+49 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=176 | child=1 dirty=1 authpin=1 0x55576d056400] version 5903 2023-10-03T19:21:03.076 INFO:teuthology.orchestra.run.smithi045.stdout: -4863> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d826c80 v5911 2023-10-03T19:21:03.076 INFO:teuthology.orchestra.run.smithi045.stdout: -4862> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5911 cv=5559/5559 REP dir_auth=0 ap=49+50 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5911 2023-10-03T19:21:03.076 INFO:teuthology.orchestra.run.smithi045.stdout: -4861> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d826b60 v5905 2023-10-03T19:21:03.076 INFO:teuthology.orchestra.run.smithi045.stdout: -4860> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5905 cv=5553/5553 ap=50+49 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=176 | child=1 dirty=1 authpin=1 0x55576d056400] version 5905 2023-10-03T19:21:03.077 INFO:teuthology.orchestra.run.smithi045.stdout: -4859> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=49 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=49 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.077 INFO:teuthology.orchestra.run.smithi045.stdout: -4858> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=49) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5910 pv6006 ap=50 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=50) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=49) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.077 INFO:teuthology.orchestra.run.smithi045.stdout: -4857> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=50) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5910 pv6006 ap=50 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=50) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=48) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.077 INFO:teuthology.orchestra.run.smithi045.stdout: -4856> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005ac [2,head] /dc-dir/dc-file_951 auth v5904 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.942462+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d771600] 2023-10-03T19:21:03.077 INFO:teuthology.orchestra.run.smithi045.stdout: -4855> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005ac [2,head] /dc-dir/dc-file_951 auth v5904 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.942462+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d771600] 2023-10-03T19:21:03.077 INFO:teuthology.orchestra.run.smithi045.stdout: -4854> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.077 INFO:teuthology.orchestra.run.smithi045.stdout: -4853> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.077 INFO:teuthology.orchestra.run.smithi045.stdout: -4852> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.078 INFO:teuthology.orchestra.run.smithi045.stdout: -4851> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005ac [2,head] /dc-dir/dc-file_951 auth v5904 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.942462+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d771600] 2023-10-03T19:21:03.078 INFO:teuthology.orchestra.run.smithi045.stdout: -4850> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005ac [2,head] /dc-dir/dc-file_951 auth v5904 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.942462+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d771600] 2023-10-03T19:21:03.078 INFO:teuthology.orchestra.run.smithi045.stdout: -4849> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.078 INFO:teuthology.orchestra.run.smithi045.stdout: -4848> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 364.885, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.65e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:732.8] 2023-10-03T19:21:03.078 INFO:teuthology.orchestra.run.smithi045.stdout: -4847> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576ddcab40 on [dir 0x1 / [2,head] auth pv=6007 v=5911 cv=5559/5559 REP dir_auth=0 ap=48+50 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 48 2023-10-03T19:21:03.078 INFO:teuthology.orchestra.run.smithi045.stdout: -4846> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576ddcab40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5910 pv6006 ap=49 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=49) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=48) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 49 2023-10-03T19:21:03.078 INFO:teuthology.orchestra.run.smithi045.stdout: -4845> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5911 cv=5559/5559 REP dir_auth=0 ap=48+49 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576ddcab40 count now 48/49 2023-10-03T19:21:03.078 INFO:teuthology.orchestra.run.smithi045.stdout: -4844> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576ddcab40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5905 cv=5553/5553 ap=49+49 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=176 | child=1 dirty=1 authpin=1 0x55576d056400] count now 49 2023-10-03T19:21:03.078 INFO:teuthology.orchestra.run.smithi045.stdout: -4843> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005ac) auth_unpin by 0x55576ddcab40 on [inode 0x100000005ac [2,head] /dc-dir/dc-file_951 auth v5904 s=3 n(v0 rc2023-10-03T19:16:13.942462+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d771600] now 0 2023-10-03T19:21:03.079 INFO:teuthology.orchestra.run.smithi045.stdout: -4842> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5905 cv=5553/5553 ap=49+48 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=176 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576ddcab40 count now 49/48 2023-10-03T19:21:03.079 INFO:teuthology.orchestra.run.smithi045.stdout: -4841> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.079 INFO:teuthology.orchestra.run.smithi045.stdout: -4840> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.079 INFO:teuthology.orchestra.run.smithi045.stdout: -4839> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005ad [2,head] /dc-dir/dc-file_952 auth v5070 pv5906 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.953829+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:13.953829+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d771b80] 2023-10-03T19:21:03.079 INFO:teuthology.orchestra.run.smithi045.stdout: -4838> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5912 2023-10-03T19:21:03.079 INFO:teuthology.orchestra.run.smithi045.stdout: -4837> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5912 pv6006 ap=49 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=49) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=48) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.079 INFO:teuthology.orchestra.run.smithi045.stdout: -4836> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5910 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.079 INFO:teuthology.orchestra.run.smithi045.stdout: -4835> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5911 cv=5559/5559 REP dir_auth=0 ap=48+49 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5911 2023-10-03T19:21:03.079 INFO:teuthology.orchestra.run.smithi045.stdout: -4834> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005ad) pop_and_dirty_projected_inode v5906 2023-10-03T19:21:03.079 INFO:teuthology.orchestra.run.smithi045.stdout: -4833> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005ad) mark_dirty [inode 0x100000005ad [2,head] /dc-dir/dc-file_952 auth v5906 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.953829+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d771b80] 2023-10-03T19:21:03.080 INFO:teuthology.orchestra.run.smithi045.stdout: -4832> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_952) mark_dirty [dentry #0x1/dc-dir/dc-file_952 [2,head] auth (dversion lock) pv=5906 v=5070 ino=0x100000005ad state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d76ec80] 2023-10-03T19:21:03.088 INFO:teuthology.orchestra.run.smithi045.stdout: -4831> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5905 cv=5553/5553 ap=49+48 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=177 | child=1 dirty=1 authpin=1 0x55576d056400] version 5905 2023-10-03T19:21:03.088 INFO:teuthology.orchestra.run.smithi045.stdout: -4830> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d826ec0 v5913 2023-10-03T19:21:03.088 INFO:teuthology.orchestra.run.smithi045.stdout: -4829> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5913 cv=5559/5559 REP dir_auth=0 ap=48+49 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5913 2023-10-03T19:21:03.088 INFO:teuthology.orchestra.run.smithi045.stdout: -4828> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d826da0 v5907 2023-10-03T19:21:03.088 INFO:teuthology.orchestra.run.smithi045.stdout: -4827> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5907 cv=5553/5553 ap=49+48 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=177 | child=1 dirty=1 authpin=1 0x55576d056400] version 5907 2023-10-03T19:21:03.088 INFO:teuthology.orchestra.run.smithi045.stdout: -4826> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=48 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=48 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.089 INFO:teuthology.orchestra.run.smithi045.stdout: -4825> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=48) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5912 pv6006 ap=49 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=49) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=48) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.089 INFO:teuthology.orchestra.run.smithi045.stdout: -4824> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=49) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5912 pv6006 ap=49 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=49) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=47) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.089 INFO:teuthology.orchestra.run.smithi045.stdout: -4823> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005ad [2,head] /dc-dir/dc-file_952 auth v5906 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.953829+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d771b80] 2023-10-03T19:21:03.089 INFO:teuthology.orchestra.run.smithi045.stdout: -4822> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005ad [2,head] /dc-dir/dc-file_952 auth v5906 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.953829+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d771b80] 2023-10-03T19:21:03.089 INFO:teuthology.orchestra.run.smithi045.stdout: -4821> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.089 INFO:teuthology.orchestra.run.smithi045.stdout: -4820> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.089 INFO:teuthology.orchestra.run.smithi045.stdout: -4819> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.089 INFO:teuthology.orchestra.run.smithi045.stdout: -4818> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005ad [2,head] /dc-dir/dc-file_952 auth v5906 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.953829+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d771b80] 2023-10-03T19:21:03.089 INFO:teuthology.orchestra.run.smithi045.stdout: -4817> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005ad [2,head] /dc-dir/dc-file_952 auth v5906 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.953829+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d771b80] 2023-10-03T19:21:03.089 INFO:teuthology.orchestra.run.smithi045.stdout: -4816> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.089 INFO:teuthology.orchestra.run.smithi045.stdout: -4815> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 365.885, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.66e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:734.8] 2023-10-03T19:21:03.089 INFO:teuthology.orchestra.run.smithi045.stdout: -4814> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576ddcafc0 on [dir 0x1 / [2,head] auth pv=6007 v=5913 cv=5559/5559 REP dir_auth=0 ap=47+49 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 47 2023-10-03T19:21:03.090 INFO:teuthology.orchestra.run.smithi045.stdout: -4813> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576ddcafc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5912 pv6006 ap=48 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=48) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=47) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 48 2023-10-03T19:21:03.090 INFO:teuthology.orchestra.run.smithi045.stdout: -4812> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5913 cv=5559/5559 REP dir_auth=0 ap=47+48 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576ddcafc0 count now 47/48 2023-10-03T19:21:03.090 INFO:teuthology.orchestra.run.smithi045.stdout: -4811> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576ddcafc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5907 cv=5553/5553 ap=48+48 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=177 | child=1 dirty=1 authpin=1 0x55576d056400] count now 48 2023-10-03T19:21:03.090 INFO:teuthology.orchestra.run.smithi045.stdout: -4810> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005ad) auth_unpin by 0x55576ddcafc0 on [inode 0x100000005ad [2,head] /dc-dir/dc-file_952 auth v5906 s=3 n(v0 rc2023-10-03T19:16:13.953829+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d771b80] now 0 2023-10-03T19:21:03.090 INFO:teuthology.orchestra.run.smithi045.stdout: -4809> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5907 cv=5553/5553 ap=48+47 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=177 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576ddcafc0 count now 48/47 2023-10-03T19:21:03.090 INFO:teuthology.orchestra.run.smithi045.stdout: -4808> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.090 INFO:teuthology.orchestra.run.smithi045.stdout: -4807> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.090 INFO:teuthology.orchestra.run.smithi045.stdout: -4806> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005ae [2,head] /dc-dir/dc-file_953 auth v5074 pv5908 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.965768+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:13.965768+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d772100] 2023-10-03T19:21:03.090 INFO:teuthology.orchestra.run.smithi045.stdout: -4805> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5914 2023-10-03T19:21:03.091 INFO:teuthology.orchestra.run.smithi045.stdout: -4804> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5914 pv6006 ap=48 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=48) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=47) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.091 INFO:teuthology.orchestra.run.smithi045.stdout: -4803> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5912 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.091 INFO:teuthology.orchestra.run.smithi045.stdout: -4802> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5913 cv=5559/5559 REP dir_auth=0 ap=47+48 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5913 2023-10-03T19:21:03.091 INFO:teuthology.orchestra.run.smithi045.stdout: -4801> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005ae) pop_and_dirty_projected_inode v5908 2023-10-03T19:21:03.091 INFO:teuthology.orchestra.run.smithi045.stdout: -4800> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005ae) mark_dirty [inode 0x100000005ae [2,head] /dc-dir/dc-file_953 auth v5908 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.965768+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d772100] 2023-10-03T19:21:03.091 INFO:teuthology.orchestra.run.smithi045.stdout: -4799> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_953) mark_dirty [dentry #0x1/dc-dir/dc-file_953 [2,head] auth (dversion lock) pv=5908 v=5074 ino=0x100000005ae state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d76ef00] 2023-10-03T19:21:03.091 INFO:teuthology.orchestra.run.smithi045.stdout: -4798> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5907 cv=5553/5553 ap=48+47 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=178 | child=1 dirty=1 authpin=1 0x55576d056400] version 5907 2023-10-03T19:21:03.091 INFO:teuthology.orchestra.run.smithi045.stdout: -4797> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d827100 v5915 2023-10-03T19:21:03.091 INFO:teuthology.orchestra.run.smithi045.stdout: -4796> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5915 cv=5559/5559 REP dir_auth=0 ap=47+48 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5915 2023-10-03T19:21:03.091 INFO:teuthology.orchestra.run.smithi045.stdout: -4795> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d826fe0 v5909 2023-10-03T19:21:03.091 INFO:teuthology.orchestra.run.smithi045.stdout: -4794> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5909 cv=5553/5553 ap=48+47 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=178 | child=1 dirty=1 authpin=1 0x55576d056400] version 5909 2023-10-03T19:21:03.092 INFO:teuthology.orchestra.run.smithi045.stdout: -4793> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=47 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=47 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.092 INFO:teuthology.orchestra.run.smithi045.stdout: -4792> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=47) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5914 pv6006 ap=48 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=48) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=47) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.092 INFO:teuthology.orchestra.run.smithi045.stdout: -4791> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=48) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5914 pv6006 ap=48 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=48) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=46) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.092 INFO:teuthology.orchestra.run.smithi045.stdout: -4790> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005ae [2,head] /dc-dir/dc-file_953 auth v5908 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.965768+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d772100] 2023-10-03T19:21:03.092 INFO:teuthology.orchestra.run.smithi045.stdout: -4789> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005ae [2,head] /dc-dir/dc-file_953 auth v5908 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.965768+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d772100] 2023-10-03T19:21:03.092 INFO:teuthology.orchestra.run.smithi045.stdout: -4788> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.092 INFO:teuthology.orchestra.run.smithi045.stdout: -4787> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.092 INFO:teuthology.orchestra.run.smithi045.stdout: -4786> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.092 INFO:teuthology.orchestra.run.smithi045.stdout: -4785> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005ae [2,head] /dc-dir/dc-file_953 auth v5908 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.965768+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d772100] 2023-10-03T19:21:03.092 INFO:teuthology.orchestra.run.smithi045.stdout: -4784> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005ae [2,head] /dc-dir/dc-file_953 auth v5908 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.965768+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d772100] 2023-10-03T19:21:03.093 INFO:teuthology.orchestra.run.smithi045.stdout: -4783> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.093 INFO:teuthology.orchestra.run.smithi045.stdout: -4782> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 366.885, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.67e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:736.8] 2023-10-03T19:21:03.093 INFO:teuthology.orchestra.run.smithi045.stdout: -4781> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576ddcb440 on [dir 0x1 / [2,head] auth pv=6007 v=5915 cv=5559/5559 REP dir_auth=0 ap=46+48 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 46 2023-10-03T19:21:03.093 INFO:teuthology.orchestra.run.smithi045.stdout: -4780> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576ddcb440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5914 pv6006 ap=47 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=47) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=46) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 47 2023-10-03T19:21:03.097 INFO:teuthology.orchestra.run.smithi045.stdout: -4779> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5915 cv=5559/5559 REP dir_auth=0 ap=46+47 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576ddcb440 count now 46/47 2023-10-03T19:21:03.097 INFO:teuthology.orchestra.run.smithi045.stdout: -4778> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576ddcb440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5909 cv=5553/5553 ap=47+47 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=178 | child=1 dirty=1 authpin=1 0x55576d056400] count now 47 2023-10-03T19:21:03.275 INFO:teuthology.orchestra.run.smithi045.stdout: -4777> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005ae) auth_unpin by 0x55576ddcb440 on [inode 0x100000005ae [2,head] /dc-dir/dc-file_953 auth v5908 s=3 n(v0 rc2023-10-03T19:16:13.965768+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d772100] now 0 2023-10-03T19:21:03.275 INFO:teuthology.orchestra.run.smithi045.stdout: -4776> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5909 cv=5553/5553 ap=47+46 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=178 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576ddcb440 count now 47/46 2023-10-03T19:21:03.275 INFO:teuthology.orchestra.run.smithi045.stdout: -4775> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.275 INFO:teuthology.orchestra.run.smithi045.stdout: -4774> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.275 INFO:teuthology.orchestra.run.smithi045.stdout: -4773> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005af [2,head] /dc-dir/dc-file_954 auth v5078 pv5910 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.980171+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:13.980171+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d772680] 2023-10-03T19:21:03.276 INFO:teuthology.orchestra.run.smithi045.stdout: -4772> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5916 2023-10-03T19:21:03.276 INFO:teuthology.orchestra.run.smithi045.stdout: -4771> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5916 pv6006 ap=47 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=47) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=46) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.276 INFO:teuthology.orchestra.run.smithi045.stdout: -4770> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5914 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.276 INFO:teuthology.orchestra.run.smithi045.stdout: -4769> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5915 cv=5559/5559 REP dir_auth=0 ap=46+47 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5915 2023-10-03T19:21:03.276 INFO:teuthology.orchestra.run.smithi045.stdout: -4768> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005af) pop_and_dirty_projected_inode v5910 2023-10-03T19:21:03.276 INFO:teuthology.orchestra.run.smithi045.stdout: -4767> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005af) mark_dirty [inode 0x100000005af [2,head] /dc-dir/dc-file_954 auth v5910 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.980171+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d772680] 2023-10-03T19:21:03.276 INFO:teuthology.orchestra.run.smithi045.stdout: -4766> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_954) mark_dirty [dentry #0x1/dc-dir/dc-file_954 [2,head] auth (dversion lock) pv=5910 v=5078 ino=0x100000005af state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d76f180] 2023-10-03T19:21:03.276 INFO:teuthology.orchestra.run.smithi045.stdout: -4765> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5909 cv=5553/5553 ap=47+46 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=179 | child=1 dirty=1 authpin=1 0x55576d056400] version 5909 2023-10-03T19:21:03.277 INFO:teuthology.orchestra.run.smithi045.stdout: -4764> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d827340 v5917 2023-10-03T19:21:03.277 INFO:teuthology.orchestra.run.smithi045.stdout: -4763> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5917 cv=5559/5559 REP dir_auth=0 ap=46+47 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5917 2023-10-03T19:21:03.277 INFO:teuthology.orchestra.run.smithi045.stdout: -4762> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d827220 v5911 2023-10-03T19:21:03.277 INFO:teuthology.orchestra.run.smithi045.stdout: -4761> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5911 cv=5553/5553 ap=47+46 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=179 | child=1 dirty=1 authpin=1 0x55576d056400] version 5911 2023-10-03T19:21:03.277 INFO:teuthology.orchestra.run.smithi045.stdout: -4760> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=46 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=46 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.277 INFO:teuthology.orchestra.run.smithi045.stdout: -4759> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=46) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5916 pv6006 ap=47 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=47) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=46) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.277 INFO:teuthology.orchestra.run.smithi045.stdout: -4758> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=47) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5916 pv6006 ap=47 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=47) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=45) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.278 INFO:teuthology.orchestra.run.smithi045.stdout: -4757> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005af [2,head] /dc-dir/dc-file_954 auth v5910 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.980171+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d772680] 2023-10-03T19:21:03.278 INFO:teuthology.orchestra.run.smithi045.stdout: -4756> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005af [2,head] /dc-dir/dc-file_954 auth v5910 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.980171+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d772680] 2023-10-03T19:21:03.278 INFO:teuthology.orchestra.run.smithi045.stdout: -4755> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.278 INFO:teuthology.orchestra.run.smithi045.stdout: -4754> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.278 INFO:teuthology.orchestra.run.smithi045.stdout: -4753> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.278 INFO:teuthology.orchestra.run.smithi045.stdout: -4752> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005af [2,head] /dc-dir/dc-file_954 auth v5910 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.980171+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d772680] 2023-10-03T19:21:03.278 INFO:teuthology.orchestra.run.smithi045.stdout: -4751> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005af [2,head] /dc-dir/dc-file_954 auth v5910 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.980171+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d772680] 2023-10-03T19:21:03.278 INFO:teuthology.orchestra.run.smithi045.stdout: -4750> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.278 INFO:teuthology.orchestra.run.smithi045.stdout: -4749> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 367.885, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.68e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:738.8] 2023-10-03T19:21:03.279 INFO:teuthology.orchestra.run.smithi045.stdout: -4748> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576ddcb8c0 on [dir 0x1 / [2,head] auth pv=6007 v=5917 cv=5559/5559 REP dir_auth=0 ap=45+47 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 45 2023-10-03T19:21:03.279 INFO:teuthology.orchestra.run.smithi045.stdout: -4747> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576ddcb8c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5916 pv6006 ap=46 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=46) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=45) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 46 2023-10-03T19:21:03.279 INFO:teuthology.orchestra.run.smithi045.stdout: -4746> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5917 cv=5559/5559 REP dir_auth=0 ap=45+46 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576ddcb8c0 count now 45/46 2023-10-03T19:21:03.279 INFO:teuthology.orchestra.run.smithi045.stdout: -4745> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576ddcb8c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5911 cv=5553/5553 ap=46+46 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=179 | child=1 dirty=1 authpin=1 0x55576d056400] count now 46 2023-10-03T19:21:03.279 INFO:teuthology.orchestra.run.smithi045.stdout: -4744> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005af) auth_unpin by 0x55576ddcb8c0 on [inode 0x100000005af [2,head] /dc-dir/dc-file_954 auth v5910 s=3 n(v0 rc2023-10-03T19:16:13.980171+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d772680] now 0 2023-10-03T19:21:03.387 INFO:teuthology.orchestra.run.smithi045.stdout: -4743> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5911 cv=5553/5553 ap=46+45 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=179 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576ddcb8c0 count now 46/45 2023-10-03T19:21:03.387 INFO:teuthology.orchestra.run.smithi045.stdout: -4742> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.388 INFO:teuthology.orchestra.run.smithi045.stdout: -4741> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.388 INFO:teuthology.orchestra.run.smithi045.stdout: -4740> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005b0 [2,head] /dc-dir/dc-file_955 auth v5082 pv5912 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.993298+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:13.993298+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d772c00] 2023-10-03T19:21:03.388 INFO:teuthology.orchestra.run.smithi045.stdout: -4739> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5918 2023-10-03T19:21:03.388 INFO:teuthology.orchestra.run.smithi045.stdout: -4738> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5918 pv6006 ap=46 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=46) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=45) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.388 INFO:teuthology.orchestra.run.smithi045.stdout: -4737> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5916 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.388 INFO:teuthology.orchestra.run.smithi045.stdout: -4736> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5917 cv=5559/5559 REP dir_auth=0 ap=45+46 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5917 2023-10-03T19:21:03.388 INFO:teuthology.orchestra.run.smithi045.stdout: -4735> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005b0) pop_and_dirty_projected_inode v5912 2023-10-03T19:21:03.389 INFO:teuthology.orchestra.run.smithi045.stdout: -4734> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005b0) mark_dirty [inode 0x100000005b0 [2,head] /dc-dir/dc-file_955 auth v5912 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.993298+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d772c00] 2023-10-03T19:21:03.389 INFO:teuthology.orchestra.run.smithi045.stdout: -4733> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_955) mark_dirty [dentry #0x1/dc-dir/dc-file_955 [2,head] auth (dversion lock) pv=5912 v=5082 ino=0x100000005b0 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d76f400] 2023-10-03T19:21:03.389 INFO:teuthology.orchestra.run.smithi045.stdout: -4732> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5911 cv=5553/5553 ap=46+45 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=180 | child=1 dirty=1 authpin=1 0x55576d056400] version 5911 2023-10-03T19:21:03.389 INFO:teuthology.orchestra.run.smithi045.stdout: -4731> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d827580 v5919 2023-10-03T19:21:03.389 INFO:teuthology.orchestra.run.smithi045.stdout: -4730> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5919 cv=5559/5559 REP dir_auth=0 ap=45+46 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5919 2023-10-03T19:21:03.389 INFO:teuthology.orchestra.run.smithi045.stdout: -4729> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d827460 v5913 2023-10-03T19:21:03.389 INFO:teuthology.orchestra.run.smithi045.stdout: -4728> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5913 cv=5553/5553 ap=46+45 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=180 | child=1 dirty=1 authpin=1 0x55576d056400] version 5913 2023-10-03T19:21:03.390 INFO:teuthology.orchestra.run.smithi045.stdout: -4727> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=45 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=45 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.390 INFO:teuthology.orchestra.run.smithi045.stdout: -4726> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=45) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5918 pv6006 ap=46 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=46) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=45) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.390 INFO:teuthology.orchestra.run.smithi045.stdout: -4725> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=46) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5918 pv6006 ap=46 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=46) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=44) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.390 INFO:teuthology.orchestra.run.smithi045.stdout: -4724> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005b0 [2,head] /dc-dir/dc-file_955 auth v5912 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.993298+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d772c00] 2023-10-03T19:21:03.390 INFO:teuthology.orchestra.run.smithi045.stdout: -4723> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005b0 [2,head] /dc-dir/dc-file_955 auth v5912 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.993298+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d772c00] 2023-10-03T19:21:03.390 INFO:teuthology.orchestra.run.smithi045.stdout: -4722> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.390 INFO:teuthology.orchestra.run.smithi045.stdout: -4721> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.390 INFO:teuthology.orchestra.run.smithi045.stdout: -4720> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.391 INFO:teuthology.orchestra.run.smithi045.stdout: -4719> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005b0 [2,head] /dc-dir/dc-file_955 auth v5912 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.993298+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d772c00] 2023-10-03T19:21:03.391 INFO:teuthology.orchestra.run.smithi045.stdout: -4718> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005b0 [2,head] /dc-dir/dc-file_955 auth v5912 ap=1 s=3 n(v0 rc2023-10-03T19:16:13.993298+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d772c00] 2023-10-03T19:21:03.391 INFO:teuthology.orchestra.run.smithi045.stdout: -4717> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.391 INFO:teuthology.orchestra.run.smithi045.stdout: -4716> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 368.885, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.69e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:740.8] 2023-10-03T19:21:03.391 INFO:teuthology.orchestra.run.smithi045.stdout: -4715> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576ddcbd40 on [dir 0x1 / [2,head] auth pv=6007 v=5919 cv=5559/5559 REP dir_auth=0 ap=44+46 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 44 2023-10-03T19:21:03.391 INFO:teuthology.orchestra.run.smithi045.stdout: -4714> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576ddcbd40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5913 cv=5553/5553 ap=45+45 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=180 | child=1 dirty=1 authpin=1 0x55576d056400] count now 45 2023-10-03T19:21:03.391 INFO:teuthology.orchestra.run.smithi045.stdout: -4713> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576ddcbd40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5918 pv6006 ap=45 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=45) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=44) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 45 2023-10-03T19:21:03.392 INFO:teuthology.orchestra.run.smithi045.stdout: -4712> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5919 cv=5559/5559 REP dir_auth=0 ap=44+45 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576ddcbd40 count now 44/45 2023-10-03T19:21:03.392 INFO:teuthology.orchestra.run.smithi045.stdout: -4711> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005b0) auth_unpin by 0x55576ddcbd40 on [inode 0x100000005b0 [2,head] /dc-dir/dc-file_955 auth v5912 s=3 n(v0 rc2023-10-03T19:16:13.993298+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d772c00] now 0 2023-10-03T19:21:03.392 INFO:teuthology.orchestra.run.smithi045.stdout: -4710> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5913 cv=5553/5553 ap=45+44 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=180 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576ddcbd40 count now 45/44 2023-10-03T19:21:03.392 INFO:teuthology.orchestra.run.smithi045.stdout: -4709> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.392 INFO:teuthology.orchestra.run.smithi045.stdout: -4708> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.392 INFO:teuthology.orchestra.run.smithi045.stdout: -4707> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005b1 [2,head] /dc-dir/dc-file_956 auth v5086 pv5914 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.005526+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.005526+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d773180] 2023-10-03T19:21:03.392 INFO:teuthology.orchestra.run.smithi045.stdout: -4706> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5920 2023-10-03T19:21:03.392 INFO:teuthology.orchestra.run.smithi045.stdout: -4705> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5920 pv6006 ap=45 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=45) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=44) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.393 INFO:teuthology.orchestra.run.smithi045.stdout: -4704> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5918 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.393 INFO:teuthology.orchestra.run.smithi045.stdout: -4703> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5919 cv=5559/5559 REP dir_auth=0 ap=44+45 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5919 2023-10-03T19:21:03.393 INFO:teuthology.orchestra.run.smithi045.stdout: -4702> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005b1) pop_and_dirty_projected_inode v5914 2023-10-03T19:21:03.393 INFO:teuthology.orchestra.run.smithi045.stdout: -4701> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005b1) mark_dirty [inode 0x100000005b1 [2,head] /dc-dir/dc-file_956 auth v5914 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.005526+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d773180] 2023-10-03T19:21:03.393 INFO:teuthology.orchestra.run.smithi045.stdout: -4700> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_956) mark_dirty [dentry #0x1/dc-dir/dc-file_956 [2,head] auth (dversion lock) pv=5914 v=5086 ino=0x100000005b1 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d76f680] 2023-10-03T19:21:03.393 INFO:teuthology.orchestra.run.smithi045.stdout: -4699> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5913 cv=5553/5553 ap=45+44 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=181 | child=1 dirty=1 authpin=1 0x55576d056400] version 5913 2023-10-03T19:21:03.393 INFO:teuthology.orchestra.run.smithi045.stdout: -4698> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d8277c0 v5921 2023-10-03T19:21:03.393 INFO:teuthology.orchestra.run.smithi045.stdout: -4697> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5921 cv=5559/5559 REP dir_auth=0 ap=44+45 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5921 2023-10-03T19:21:03.394 INFO:teuthology.orchestra.run.smithi045.stdout: -4696> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d8276a0 v5915 2023-10-03T19:21:03.394 INFO:teuthology.orchestra.run.smithi045.stdout: -4695> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5915 cv=5553/5553 ap=45+44 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=181 | child=1 dirty=1 authpin=1 0x55576d056400] version 5915 2023-10-03T19:21:03.394 INFO:teuthology.orchestra.run.smithi045.stdout: -4694> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=44 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=44 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.394 INFO:teuthology.orchestra.run.smithi045.stdout: -4693> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=44) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5920 pv6006 ap=45 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=45) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=44) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.394 INFO:teuthology.orchestra.run.smithi045.stdout: -4692> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=45) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5920 pv6006 ap=45 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=45) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=43) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.400 INFO:teuthology.orchestra.run.smithi045.stdout: -4691> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005b1 [2,head] /dc-dir/dc-file_956 auth v5914 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.005526+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d773180] 2023-10-03T19:21:03.400 INFO:teuthology.orchestra.run.smithi045.stdout: -4690> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005b1 [2,head] /dc-dir/dc-file_956 auth v5914 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.005526+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d773180] 2023-10-03T19:21:03.400 INFO:teuthology.orchestra.run.smithi045.stdout: -4689> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.400 INFO:teuthology.orchestra.run.smithi045.stdout: -4688> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.401 INFO:teuthology.orchestra.run.smithi045.stdout: -4687> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.401 INFO:teuthology.orchestra.run.smithi045.stdout: -4686> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005b1 [2,head] /dc-dir/dc-file_956 auth v5914 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.005526+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d773180] 2023-10-03T19:21:03.401 INFO:teuthology.orchestra.run.smithi045.stdout: -4685> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005b1 [2,head] /dc-dir/dc-file_956 auth v5914 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.005526+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d773180] 2023-10-03T19:21:03.401 INFO:teuthology.orchestra.run.smithi045.stdout: -4684> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.401 INFO:teuthology.orchestra.run.smithi045.stdout: -4683> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 369.885, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.70e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:742.8] 2023-10-03T19:21:03.401 INFO:teuthology.orchestra.run.smithi045.stdout: -4682> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e2e7b00 on [dir 0x1 / [2,head] auth pv=6007 v=5921 cv=5559/5559 REP dir_auth=0 ap=43+45 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 43 2023-10-03T19:21:03.401 INFO:teuthology.orchestra.run.smithi045.stdout: -4681> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e2e7b00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5920 pv6006 ap=44 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=44) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=43) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 44 2023-10-03T19:21:03.401 INFO:teuthology.orchestra.run.smithi045.stdout: -4680> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5921 cv=5559/5559 REP dir_auth=0 ap=43+44 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e2e7b00 count now 43/44 2023-10-03T19:21:03.402 INFO:teuthology.orchestra.run.smithi045.stdout: -4679> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e2e7b00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5915 cv=5553/5553 ap=44+44 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=181 | child=1 dirty=1 authpin=1 0x55576d056400] count now 44 2023-10-03T19:21:03.402 INFO:teuthology.orchestra.run.smithi045.stdout: -4678> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005b1) auth_unpin by 0x55576e2e7b00 on [inode 0x100000005b1 [2,head] /dc-dir/dc-file_956 auth v5914 s=3 n(v0 rc2023-10-03T19:16:14.005526+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d773180] now 0 2023-10-03T19:21:03.402 INFO:teuthology.orchestra.run.smithi045.stdout: -4677> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5915 cv=5553/5553 ap=44+43 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=181 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e2e7b00 count now 44/43 2023-10-03T19:21:03.402 INFO:teuthology.orchestra.run.smithi045.stdout: -4676> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.402 INFO:teuthology.orchestra.run.smithi045.stdout: -4675> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.402 INFO:teuthology.orchestra.run.smithi045.stdout: -4674> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005b2 [2,head] /dc-dir/dc-file_957 auth v5090 pv5916 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.018837+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.018837+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d773700] 2023-10-03T19:21:03.402 INFO:teuthology.orchestra.run.smithi045.stdout: -4673> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5922 2023-10-03T19:21:03.402 INFO:teuthology.orchestra.run.smithi045.stdout: -4672> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5922 pv6006 ap=44 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=44) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=43) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.403 INFO:teuthology.orchestra.run.smithi045.stdout: -4671> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5920 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.403 INFO:teuthology.orchestra.run.smithi045.stdout: -4670> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5921 cv=5559/5559 REP dir_auth=0 ap=43+44 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5921 2023-10-03T19:21:03.403 INFO:teuthology.orchestra.run.smithi045.stdout: -4669> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005b2) pop_and_dirty_projected_inode v5916 2023-10-03T19:21:03.403 INFO:teuthology.orchestra.run.smithi045.stdout: -4668> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005b2) mark_dirty [inode 0x100000005b2 [2,head] /dc-dir/dc-file_957 auth v5916 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.018837+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d773700] 2023-10-03T19:21:03.403 INFO:teuthology.orchestra.run.smithi045.stdout: -4667> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_957) mark_dirty [dentry #0x1/dc-dir/dc-file_957 [2,head] auth (dversion lock) pv=5916 v=5090 ino=0x100000005b2 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d76f900] 2023-10-03T19:21:03.403 INFO:teuthology.orchestra.run.smithi045.stdout: -4666> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5915 cv=5553/5553 ap=44+43 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=182 | child=1 dirty=1 authpin=1 0x55576d056400] version 5915 2023-10-03T19:21:03.403 INFO:teuthology.orchestra.run.smithi045.stdout: -4665> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d827a00 v5923 2023-10-03T19:21:03.403 INFO:teuthology.orchestra.run.smithi045.stdout: -4664> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5923 cv=5559/5559 REP dir_auth=0 ap=43+44 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5923 2023-10-03T19:21:03.404 INFO:teuthology.orchestra.run.smithi045.stdout: -4663> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d8278e0 v5917 2023-10-03T19:21:03.404 INFO:teuthology.orchestra.run.smithi045.stdout: -4662> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5917 cv=5553/5553 ap=44+43 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=182 | child=1 dirty=1 authpin=1 0x55576d056400] version 5917 2023-10-03T19:21:03.404 INFO:teuthology.orchestra.run.smithi045.stdout: -4661> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=43 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=43 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.404 INFO:teuthology.orchestra.run.smithi045.stdout: -4660> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=43) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5922 pv6006 ap=44 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=44) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=43) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.404 INFO:teuthology.orchestra.run.smithi045.stdout: -4659> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=44) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5922 pv6006 ap=44 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=44) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=42) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.404 INFO:teuthology.orchestra.run.smithi045.stdout: -4658> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005b2 [2,head] /dc-dir/dc-file_957 auth v5916 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.018837+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d773700] 2023-10-03T19:21:03.404 INFO:teuthology.orchestra.run.smithi045.stdout: -4657> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005b2 [2,head] /dc-dir/dc-file_957 auth v5916 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.018837+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d773700] 2023-10-03T19:21:03.404 INFO:teuthology.orchestra.run.smithi045.stdout: -4656> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.404 INFO:teuthology.orchestra.run.smithi045.stdout: -4655> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.405 INFO:teuthology.orchestra.run.smithi045.stdout: -4654> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.405 INFO:teuthology.orchestra.run.smithi045.stdout: -4653> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005b2 [2,head] /dc-dir/dc-file_957 auth v5916 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.018837+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d773700] 2023-10-03T19:21:03.405 INFO:teuthology.orchestra.run.smithi045.stdout: -4652> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005b2 [2,head] /dc-dir/dc-file_957 auth v5916 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.018837+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d773700] 2023-10-03T19:21:03.405 INFO:teuthology.orchestra.run.smithi045.stdout: -4651> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.405 INFO:teuthology.orchestra.run.smithi045.stdout: -4650> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 370.885, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.71e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:744.8] 2023-10-03T19:21:03.405 INFO:teuthology.orchestra.run.smithi045.stdout: -4649> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e2e7200 on [dir 0x1 / [2,head] auth pv=6007 v=5923 cv=5559/5559 REP dir_auth=0 ap=42+44 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 42 2023-10-03T19:21:03.405 INFO:teuthology.orchestra.run.smithi045.stdout: -4648> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e2e7200 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5922 pv6006 ap=43 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=43) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=42) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 43 2023-10-03T19:21:03.405 INFO:teuthology.orchestra.run.smithi045.stdout: -4647> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5923 cv=5559/5559 REP dir_auth=0 ap=42+43 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e2e7200 count now 42/43 2023-10-03T19:21:03.406 INFO:teuthology.orchestra.run.smithi045.stdout: -4646> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e2e7200 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5917 cv=5553/5553 ap=43+43 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=182 | child=1 dirty=1 authpin=1 0x55576d056400] count now 43 2023-10-03T19:21:03.406 INFO:teuthology.orchestra.run.smithi045.stdout: -4645> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005b2) auth_unpin by 0x55576e2e7200 on [inode 0x100000005b2 [2,head] /dc-dir/dc-file_957 auth v5916 s=3 n(v0 rc2023-10-03T19:16:14.018837+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d773700] now 0 2023-10-03T19:21:03.406 INFO:teuthology.orchestra.run.smithi045.stdout: -4644> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5917 cv=5553/5553 ap=43+42 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=182 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e2e7200 count now 43/42 2023-10-03T19:21:03.406 INFO:teuthology.orchestra.run.smithi045.stdout: -4643> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.406 INFO:teuthology.orchestra.run.smithi045.stdout: -4642> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.406 INFO:teuthology.orchestra.run.smithi045.stdout: -4641> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005b3 [2,head] /dc-dir/dc-file_958 auth v5094 pv5918 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.031775+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.031775+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d77e000] 2023-10-03T19:21:03.406 INFO:teuthology.orchestra.run.smithi045.stdout: -4640> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5924 2023-10-03T19:21:03.406 INFO:teuthology.orchestra.run.smithi045.stdout: -4639> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5924 pv6006 ap=43 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=43) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=42) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.407 INFO:teuthology.orchestra.run.smithi045.stdout: -4638> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5922 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.407 INFO:teuthology.orchestra.run.smithi045.stdout: -4637> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5923 cv=5559/5559 REP dir_auth=0 ap=42+43 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5923 2023-10-03T19:21:03.407 INFO:teuthology.orchestra.run.smithi045.stdout: -4636> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005b3) pop_and_dirty_projected_inode v5918 2023-10-03T19:21:03.407 INFO:teuthology.orchestra.run.smithi045.stdout: -4635> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005b3) mark_dirty [inode 0x100000005b3 [2,head] /dc-dir/dc-file_958 auth v5918 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.031775+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d77e000] 2023-10-03T19:21:03.407 INFO:teuthology.orchestra.run.smithi045.stdout: -4634> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_958) mark_dirty [dentry #0x1/dc-dir/dc-file_958 [2,head] auth (dversion lock) pv=5918 v=5094 ino=0x100000005b3 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d76fb80] 2023-10-03T19:21:03.422 INFO:teuthology.orchestra.run.smithi045.stdout: -4633> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5917 cv=5553/5553 ap=43+42 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=183 | child=1 dirty=1 authpin=1 0x55576d056400] version 5917 2023-10-03T19:21:03.423 INFO:teuthology.orchestra.run.smithi045.stdout: -4632> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d827c40 v5925 2023-10-03T19:21:03.423 INFO:teuthology.orchestra.run.smithi045.stdout: -4631> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5925 cv=5559/5559 REP dir_auth=0 ap=42+43 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5925 2023-10-03T19:21:03.423 INFO:teuthology.orchestra.run.smithi045.stdout: -4630> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d827b20 v5919 2023-10-03T19:21:03.423 INFO:teuthology.orchestra.run.smithi045.stdout: -4629> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5919 cv=5553/5553 ap=43+42 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=183 | child=1 dirty=1 authpin=1 0x55576d056400] version 5919 2023-10-03T19:21:03.423 INFO:teuthology.orchestra.run.smithi045.stdout: -4628> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=42 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=42 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.423 INFO:teuthology.orchestra.run.smithi045.stdout: -4627> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=42) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5924 pv6006 ap=43 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=43) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=42) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.423 INFO:teuthology.orchestra.run.smithi045.stdout: -4626> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=43) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5924 pv6006 ap=43 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=43) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=41) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.424 INFO:teuthology.orchestra.run.smithi045.stdout: -4625> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005b3 [2,head] /dc-dir/dc-file_958 auth v5918 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.031775+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d77e000] 2023-10-03T19:21:03.424 INFO:teuthology.orchestra.run.smithi045.stdout: -4624> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005b3 [2,head] /dc-dir/dc-file_958 auth v5918 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.031775+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d77e000] 2023-10-03T19:21:03.424 INFO:teuthology.orchestra.run.smithi045.stdout: -4623> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.424 INFO:teuthology.orchestra.run.smithi045.stdout: -4622> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.424 INFO:teuthology.orchestra.run.smithi045.stdout: -4621> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.424 INFO:teuthology.orchestra.run.smithi045.stdout: -4620> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005b3 [2,head] /dc-dir/dc-file_958 auth v5918 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.031775+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d77e000] 2023-10-03T19:21:03.424 INFO:teuthology.orchestra.run.smithi045.stdout: -4619> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005b3 [2,head] /dc-dir/dc-file_958 auth v5918 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.031775+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d77e000] 2023-10-03T19:21:03.424 INFO:teuthology.orchestra.run.smithi045.stdout: -4618> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.425 INFO:teuthology.orchestra.run.smithi045.stdout: -4617> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 371.885, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.72e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:746.8] 2023-10-03T19:21:03.425 INFO:teuthology.orchestra.run.smithi045.stdout: -4616> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e2e6900 on [dir 0x1 / [2,head] auth pv=6007 v=5925 cv=5559/5559 REP dir_auth=0 ap=41+43 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 41 2023-10-03T19:21:03.425 INFO:teuthology.orchestra.run.smithi045.stdout: -4615> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e2e6900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5924 pv6006 ap=42 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=42) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=41) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 42 2023-10-03T19:21:03.425 INFO:teuthology.orchestra.run.smithi045.stdout: -4614> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5925 cv=5559/5559 REP dir_auth=0 ap=41+42 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e2e6900 count now 41/42 2023-10-03T19:21:03.425 INFO:teuthology.orchestra.run.smithi045.stdout: -4613> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e2e6900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5919 cv=5553/5553 ap=42+42 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=183 | child=1 dirty=1 authpin=1 0x55576d056400] count now 42 2023-10-03T19:21:03.425 INFO:teuthology.orchestra.run.smithi045.stdout: -4612> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005b3) auth_unpin by 0x55576e2e6900 on [inode 0x100000005b3 [2,head] /dc-dir/dc-file_958 auth v5918 s=3 n(v0 rc2023-10-03T19:16:14.031775+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d77e000] now 0 2023-10-03T19:21:03.425 INFO:teuthology.orchestra.run.smithi045.stdout: -4611> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5919 cv=5553/5553 ap=42+41 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=183 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e2e6900 count now 42/41 2023-10-03T19:21:03.425 INFO:teuthology.orchestra.run.smithi045.stdout: -4610> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.425 INFO:teuthology.orchestra.run.smithi045.stdout: -4609> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.426 INFO:teuthology.orchestra.run.smithi045.stdout: -4608> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005b4 [2,head] /dc-dir/dc-file_959 auth v5098 pv5920 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.044706+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.044706+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d77e580] 2023-10-03T19:21:03.426 INFO:teuthology.orchestra.run.smithi045.stdout: -4607> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5926 2023-10-03T19:21:03.426 INFO:teuthology.orchestra.run.smithi045.stdout: -4606> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5926 pv6006 ap=42 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=42) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=41) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.426 INFO:teuthology.orchestra.run.smithi045.stdout: -4605> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5924 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.426 INFO:teuthology.orchestra.run.smithi045.stdout: -4604> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5925 cv=5559/5559 REP dir_auth=0 ap=41+42 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5925 2023-10-03T19:21:03.426 INFO:teuthology.orchestra.run.smithi045.stdout: -4603> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005b4) pop_and_dirty_projected_inode v5920 2023-10-03T19:21:03.426 INFO:teuthology.orchestra.run.smithi045.stdout: -4602> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005b4) mark_dirty [inode 0x100000005b4 [2,head] /dc-dir/dc-file_959 auth v5920 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.044706+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d77e580] 2023-10-03T19:21:03.427 INFO:teuthology.orchestra.run.smithi045.stdout: -4601> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_959) mark_dirty [dentry #0x1/dc-dir/dc-file_959 [2,head] auth (dversion lock) pv=5920 v=5098 ino=0x100000005b4 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d778000] 2023-10-03T19:21:03.427 INFO:teuthology.orchestra.run.smithi045.stdout: -4600> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5919 cv=5553/5553 ap=42+41 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=184 | child=1 dirty=1 authpin=1 0x55576d056400] version 5919 2023-10-03T19:21:03.427 INFO:teuthology.orchestra.run.smithi045.stdout: -4599> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d827e80 v5927 2023-10-03T19:21:03.427 INFO:teuthology.orchestra.run.smithi045.stdout: -4598> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5927 cv=5559/5559 REP dir_auth=0 ap=41+42 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5927 2023-10-03T19:21:03.427 INFO:teuthology.orchestra.run.smithi045.stdout: -4597> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d827d60 v5921 2023-10-03T19:21:03.427 INFO:teuthology.orchestra.run.smithi045.stdout: -4596> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5921 cv=5553/5553 ap=42+41 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=184 | child=1 dirty=1 authpin=1 0x55576d056400] version 5921 2023-10-03T19:21:03.427 INFO:teuthology.orchestra.run.smithi045.stdout: -4595> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=41 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=41 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.427 INFO:teuthology.orchestra.run.smithi045.stdout: -4594> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=41) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5926 pv6006 ap=42 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=42) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=41) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.427 INFO:teuthology.orchestra.run.smithi045.stdout: -4593> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=42) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5926 pv6006 ap=42 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=42) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=40) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.428 INFO:teuthology.orchestra.run.smithi045.stdout: -4592> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005b4 [2,head] /dc-dir/dc-file_959 auth v5920 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.044706+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d77e580] 2023-10-03T19:21:03.428 INFO:teuthology.orchestra.run.smithi045.stdout: -4591> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005b4 [2,head] /dc-dir/dc-file_959 auth v5920 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.044706+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d77e580] 2023-10-03T19:21:03.428 INFO:teuthology.orchestra.run.smithi045.stdout: -4590> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.428 INFO:teuthology.orchestra.run.smithi045.stdout: -4589> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.428 INFO:teuthology.orchestra.run.smithi045.stdout: -4588> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.428 INFO:teuthology.orchestra.run.smithi045.stdout: -4587> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005b4 [2,head] /dc-dir/dc-file_959 auth v5920 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.044706+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d77e580] 2023-10-03T19:21:03.428 INFO:teuthology.orchestra.run.smithi045.stdout: -4586> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005b4 [2,head] /dc-dir/dc-file_959 auth v5920 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.044706+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d77e580] 2023-10-03T19:21:03.428 INFO:teuthology.orchestra.run.smithi045.stdout: -4585> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.428 INFO:teuthology.orchestra.run.smithi045.stdout: -4584> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 372.885, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.73e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:748.8] 2023-10-03T19:21:03.429 INFO:teuthology.orchestra.run.smithi045.stdout: -4583> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e2e6000 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5926 pv6006 ap=41 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=41) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=40) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 41 2023-10-03T19:21:03.429 INFO:teuthology.orchestra.run.smithi045.stdout: -4582> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5927 cv=5559/5559 REP dir_auth=0 ap=41+41 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e2e6000 count now 41/41 2023-10-03T19:21:03.429 INFO:teuthology.orchestra.run.smithi045.stdout: -4581> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e2e6000 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5921 cv=5553/5553 ap=41+41 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=184 | child=1 dirty=1 authpin=1 0x55576d056400] count now 41 2023-10-03T19:21:03.429 INFO:teuthology.orchestra.run.smithi045.stdout: -4580> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e2e6000 on [dir 0x1 / [2,head] auth pv=6007 v=5927 cv=5559/5559 REP dir_auth=0 ap=40+41 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 40 2023-10-03T19:21:03.429 INFO:teuthology.orchestra.run.smithi045.stdout: -4579> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005b4) auth_unpin by 0x55576e2e6000 on [inode 0x100000005b4 [2,head] /dc-dir/dc-file_959 auth v5920 s=3 n(v0 rc2023-10-03T19:16:14.044706+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d77e580] now 0 2023-10-03T19:21:03.429 INFO:teuthology.orchestra.run.smithi045.stdout: -4578> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5921 cv=5553/5553 ap=41+40 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=184 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e2e6000 count now 41/40 2023-10-03T19:21:03.429 INFO:teuthology.orchestra.run.smithi045.stdout: -4577> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.429 INFO:teuthology.orchestra.run.smithi045.stdout: -4576> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.430 INFO:teuthology.orchestra.run.smithi045.stdout: -4575> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005b5 [2,head] /dc-dir/dc-file_960 auth v5102 pv5922 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.057778+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.057778+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d77eb00] 2023-10-03T19:21:03.430 INFO:teuthology.orchestra.run.smithi045.stdout: -4574> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5928 2023-10-03T19:21:03.430 INFO:teuthology.orchestra.run.smithi045.stdout: -4573> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5928 pv6006 ap=41 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=41) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=40) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.430 INFO:teuthology.orchestra.run.smithi045.stdout: -4572> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5926 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.430 INFO:teuthology.orchestra.run.smithi045.stdout: -4571> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5927 cv=5559/5559 REP dir_auth=0 ap=40+41 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5927 2023-10-03T19:21:03.430 INFO:teuthology.orchestra.run.smithi045.stdout: -4570> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005b5) pop_and_dirty_projected_inode v5922 2023-10-03T19:21:03.430 INFO:teuthology.orchestra.run.smithi045.stdout: -4569> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005b5) mark_dirty [inode 0x100000005b5 [2,head] /dc-dir/dc-file_960 auth v5922 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.057778+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d77eb00] 2023-10-03T19:21:03.430 INFO:teuthology.orchestra.run.smithi045.stdout: -4568> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_960) mark_dirty [dentry #0x1/dc-dir/dc-file_960 [2,head] auth (dversion lock) pv=5922 v=5102 ino=0x100000005b5 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d778280] 2023-10-03T19:21:03.431 INFO:teuthology.orchestra.run.smithi045.stdout: -4567> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5921 cv=5553/5553 ap=41+40 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=185 | child=1 dirty=1 authpin=1 0x55576d056400] version 5921 2023-10-03T19:21:03.431 INFO:teuthology.orchestra.run.smithi045.stdout: -4566> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d860260 v5929 2023-10-03T19:21:03.431 INFO:teuthology.orchestra.run.smithi045.stdout: -4565> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5929 cv=5559/5559 REP dir_auth=0 ap=40+41 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5929 2023-10-03T19:21:03.431 INFO:teuthology.orchestra.run.smithi045.stdout: -4564> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d860380 v5923 2023-10-03T19:21:03.431 INFO:teuthology.orchestra.run.smithi045.stdout: -4563> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5923 cv=5553/5553 ap=41+40 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=185 | child=1 dirty=1 authpin=1 0x55576d056400] version 5923 2023-10-03T19:21:03.431 INFO:teuthology.orchestra.run.smithi045.stdout: -4562> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=40 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=40 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.431 INFO:teuthology.orchestra.run.smithi045.stdout: -4561> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=40) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5928 pv6006 ap=41 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=41) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=40) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.431 INFO:teuthology.orchestra.run.smithi045.stdout: -4560> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=41) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5928 pv6006 ap=41 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=41) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=39) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.432 INFO:teuthology.orchestra.run.smithi045.stdout: -4559> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005b5 [2,head] /dc-dir/dc-file_960 auth v5922 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.057778+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d77eb00] 2023-10-03T19:21:03.432 INFO:teuthology.orchestra.run.smithi045.stdout: -4558> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005b5 [2,head] /dc-dir/dc-file_960 auth v5922 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.057778+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d77eb00] 2023-10-03T19:21:03.432 INFO:teuthology.orchestra.run.smithi045.stdout: -4557> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.432 INFO:teuthology.orchestra.run.smithi045.stdout: -4556> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.432 INFO:teuthology.orchestra.run.smithi045.stdout: -4555> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.489 INFO:teuthology.orchestra.run.smithi045.stdout: -4554> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005b5 [2,head] /dc-dir/dc-file_960 auth v5922 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.057778+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d77eb00] 2023-10-03T19:21:03.489 INFO:teuthology.orchestra.run.smithi045.stdout: -4553> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005b5 [2,head] /dc-dir/dc-file_960 auth v5922 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.057778+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d77eb00] 2023-10-03T19:21:03.489 INFO:teuthology.orchestra.run.smithi045.stdout: -4552> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.489 INFO:teuthology.orchestra.run.smithi045.stdout: -4551> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 373.885, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.74e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:750.8] 2023-10-03T19:21:03.490 INFO:teuthology.orchestra.run.smithi045.stdout: -4550> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e1c9680 on [dir 0x1 / [2,head] auth pv=6007 v=5929 cv=5559/5559 REP dir_auth=0 ap=39+41 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 39 2023-10-03T19:21:03.490 INFO:teuthology.orchestra.run.smithi045.stdout: -4549> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e1c9680 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5928 pv6006 ap=40 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=40) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=39) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 40 2023-10-03T19:21:03.490 INFO:teuthology.orchestra.run.smithi045.stdout: -4548> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5929 cv=5559/5559 REP dir_auth=0 ap=39+40 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e1c9680 count now 39/40 2023-10-03T19:21:03.490 INFO:teuthology.orchestra.run.smithi045.stdout: -4547> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e1c9680 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5923 cv=5553/5553 ap=40+40 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=185 | child=1 dirty=1 authpin=1 0x55576d056400] count now 40 2023-10-03T19:21:03.490 INFO:teuthology.orchestra.run.smithi045.stdout: -4546> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005b5) auth_unpin by 0x55576e1c9680 on [inode 0x100000005b5 [2,head] /dc-dir/dc-file_960 auth v5922 s=3 n(v0 rc2023-10-03T19:16:14.057778+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d77eb00] now 0 2023-10-03T19:21:03.490 INFO:teuthology.orchestra.run.smithi045.stdout: -4545> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5923 cv=5553/5553 ap=40+39 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=185 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e1c9680 count now 40/39 2023-10-03T19:21:03.490 INFO:teuthology.orchestra.run.smithi045.stdout: -4544> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.491 INFO:teuthology.orchestra.run.smithi045.stdout: -4543> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.491 INFO:teuthology.orchestra.run.smithi045.stdout: -4542> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005b6 [2,head] /dc-dir/dc-file_961 auth v5106 pv5924 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.070797+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.070797+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d77f080] 2023-10-03T19:21:03.491 INFO:teuthology.orchestra.run.smithi045.stdout: -4541> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5930 2023-10-03T19:21:03.491 INFO:teuthology.orchestra.run.smithi045.stdout: -4540> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5930 pv6006 ap=40 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=40) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=39) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.491 INFO:teuthology.orchestra.run.smithi045.stdout: -4539> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5928 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.491 INFO:teuthology.orchestra.run.smithi045.stdout: -4538> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5929 cv=5559/5559 REP dir_auth=0 ap=39+40 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5929 2023-10-03T19:21:03.491 INFO:teuthology.orchestra.run.smithi045.stdout: -4537> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005b6) pop_and_dirty_projected_inode v5924 2023-10-03T19:21:03.491 INFO:teuthology.orchestra.run.smithi045.stdout: -4536> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005b6) mark_dirty [inode 0x100000005b6 [2,head] /dc-dir/dc-file_961 auth v5924 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.070797+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d77f080] 2023-10-03T19:21:03.491 INFO:teuthology.orchestra.run.smithi045.stdout: -4535> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_961) mark_dirty [dentry #0x1/dc-dir/dc-file_961 [2,head] auth (dversion lock) pv=5924 v=5106 ino=0x100000005b6 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d778500] 2023-10-03T19:21:03.492 INFO:teuthology.orchestra.run.smithi045.stdout: -4534> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5923 cv=5553/5553 ap=40+39 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=186 | child=1 dirty=1 authpin=1 0x55576d056400] version 5923 2023-10-03T19:21:03.492 INFO:teuthology.orchestra.run.smithi045.stdout: -4533> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576cf49220 v5931 2023-10-03T19:21:03.492 INFO:teuthology.orchestra.run.smithi045.stdout: -4532> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5931 cv=5559/5559 REP dir_auth=0 ap=39+40 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5931 2023-10-03T19:21:03.492 INFO:teuthology.orchestra.run.smithi045.stdout: -4531> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d8605c0 v5925 2023-10-03T19:21:03.492 INFO:teuthology.orchestra.run.smithi045.stdout: -4530> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5925 cv=5553/5553 ap=40+39 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=186 | child=1 dirty=1 authpin=1 0x55576d056400] version 5925 2023-10-03T19:21:03.492 INFO:teuthology.orchestra.run.smithi045.stdout: -4529> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=39 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=39 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.493 INFO:teuthology.orchestra.run.smithi045.stdout: -4528> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=39) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5930 pv6006 ap=40 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=40) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=39) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.493 INFO:teuthology.orchestra.run.smithi045.stdout: -4527> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=40) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5930 pv6006 ap=40 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=40) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=38) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.493 INFO:teuthology.orchestra.run.smithi045.stdout: -4526> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005b6 [2,head] /dc-dir/dc-file_961 auth v5924 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.070797+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d77f080] 2023-10-03T19:21:03.493 INFO:teuthology.orchestra.run.smithi045.stdout: -4525> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005b6 [2,head] /dc-dir/dc-file_961 auth v5924 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.070797+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d77f080] 2023-10-03T19:21:03.493 INFO:teuthology.orchestra.run.smithi045.stdout: -4524> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.493 INFO:teuthology.orchestra.run.smithi045.stdout: -4523> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.493 INFO:teuthology.orchestra.run.smithi045.stdout: -4522> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.493 INFO:teuthology.orchestra.run.smithi045.stdout: -4521> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005b6 [2,head] /dc-dir/dc-file_961 auth v5924 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.070797+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d77f080] 2023-10-03T19:21:03.493 INFO:teuthology.orchestra.run.smithi045.stdout: -4520> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005b6 [2,head] /dc-dir/dc-file_961 auth v5924 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.070797+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d77f080] 2023-10-03T19:21:03.494 INFO:teuthology.orchestra.run.smithi045.stdout: -4519> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.494 INFO:teuthology.orchestra.run.smithi045.stdout: -4518> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 374.885, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.75e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:752.8] 2023-10-03T19:21:03.494 INFO:teuthology.orchestra.run.smithi045.stdout: -4517> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e1c8d80 on [dir 0x1 / [2,head] auth pv=6007 v=5931 cv=5559/5559 REP dir_auth=0 ap=38+40 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 38 2023-10-03T19:21:03.494 INFO:teuthology.orchestra.run.smithi045.stdout: -4516> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e1c8d80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5930 pv6006 ap=39 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=39) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=38) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 39 2023-10-03T19:21:03.494 INFO:teuthology.orchestra.run.smithi045.stdout: -4515> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5931 cv=5559/5559 REP dir_auth=0 ap=38+39 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e1c8d80 count now 38/39 2023-10-03T19:21:03.494 INFO:teuthology.orchestra.run.smithi045.stdout: -4514> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e1c8d80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5925 cv=5553/5553 ap=39+39 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=186 | child=1 dirty=1 authpin=1 0x55576d056400] count now 39 2023-10-03T19:21:03.494 INFO:teuthology.orchestra.run.smithi045.stdout: -4513> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005b6) auth_unpin by 0x55576e1c8d80 on [inode 0x100000005b6 [2,head] /dc-dir/dc-file_961 auth v5924 s=3 n(v0 rc2023-10-03T19:16:14.070797+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d77f080] now 0 2023-10-03T19:21:03.494 INFO:teuthology.orchestra.run.smithi045.stdout: -4512> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5925 cv=5553/5553 ap=39+38 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=186 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e1c8d80 count now 39/38 2023-10-03T19:21:03.495 INFO:teuthology.orchestra.run.smithi045.stdout: -4511> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.495 INFO:teuthology.orchestra.run.smithi045.stdout: -4510> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.495 INFO:teuthology.orchestra.run.smithi045.stdout: -4509> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005b7 [2,head] /dc-dir/dc-file_962 auth v5110 pv5926 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.082388+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.082388+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d77f600] 2023-10-03T19:21:03.495 INFO:teuthology.orchestra.run.smithi045.stdout: -4508> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5932 2023-10-03T19:21:03.495 INFO:teuthology.orchestra.run.smithi045.stdout: -4507> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5932 pv6006 ap=39 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=39) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=38) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.495 INFO:teuthology.orchestra.run.smithi045.stdout: -4506> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5930 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.495 INFO:teuthology.orchestra.run.smithi045.stdout: -4505> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5931 cv=5559/5559 REP dir_auth=0 ap=38+39 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5931 2023-10-03T19:21:03.495 INFO:teuthology.orchestra.run.smithi045.stdout: -4504> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005b7) pop_and_dirty_projected_inode v5926 2023-10-03T19:21:03.495 INFO:teuthology.orchestra.run.smithi045.stdout: -4503> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005b7) mark_dirty [inode 0x100000005b7 [2,head] /dc-dir/dc-file_962 auth v5926 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.082388+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d77f600] 2023-10-03T19:21:03.551 INFO:teuthology.orchestra.run.smithi045.stdout: -4502> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_962) mark_dirty [dentry #0x1/dc-dir/dc-file_962 [2,head] auth (dversion lock) pv=5926 v=5110 ino=0x100000005b7 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d778780] 2023-10-03T19:21:03.551 INFO:teuthology.orchestra.run.smithi045.stdout: -4501> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5925 cv=5553/5553 ap=39+38 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=187 | child=1 dirty=1 authpin=1 0x55576d056400] version 5925 2023-10-03T19:21:03.551 INFO:teuthology.orchestra.run.smithi045.stdout: -4500> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d04a020 v5933 2023-10-03T19:21:03.551 INFO:teuthology.orchestra.run.smithi045.stdout: -4499> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5933 cv=5559/5559 REP dir_auth=0 ap=38+39 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5933 2023-10-03T19:21:03.551 INFO:teuthology.orchestra.run.smithi045.stdout: -4498> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d1b3a00 v5927 2023-10-03T19:21:03.551 INFO:teuthology.orchestra.run.smithi045.stdout: -4497> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5927 cv=5553/5553 ap=39+38 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=187 | child=1 dirty=1 authpin=1 0x55576d056400] version 5927 2023-10-03T19:21:03.551 INFO:teuthology.orchestra.run.smithi045.stdout: -4496> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=38 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=38 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.551 INFO:teuthology.orchestra.run.smithi045.stdout: -4495> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=38) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5932 pv6006 ap=39 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=39) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=38) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.552 INFO:teuthology.orchestra.run.smithi045.stdout: -4494> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=39) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5932 pv6006 ap=39 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=39) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=37) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.552 INFO:teuthology.orchestra.run.smithi045.stdout: -4493> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005b7 [2,head] /dc-dir/dc-file_962 auth v5926 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.082388+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d77f600] 2023-10-03T19:21:03.552 INFO:teuthology.orchestra.run.smithi045.stdout: -4492> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005b7 [2,head] /dc-dir/dc-file_962 auth v5926 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.082388+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d77f600] 2023-10-03T19:21:03.552 INFO:teuthology.orchestra.run.smithi045.stdout: -4491> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.552 INFO:teuthology.orchestra.run.smithi045.stdout: -4490> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.552 INFO:teuthology.orchestra.run.smithi045.stdout: -4489> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.552 INFO:teuthology.orchestra.run.smithi045.stdout: -4488> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005b7 [2,head] /dc-dir/dc-file_962 auth v5926 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.082388+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d77f600] 2023-10-03T19:21:03.553 INFO:teuthology.orchestra.run.smithi045.stdout: -4487> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005b7 [2,head] /dc-dir/dc-file_962 auth v5926 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.082388+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d77f600] 2023-10-03T19:21:03.553 INFO:teuthology.orchestra.run.smithi045.stdout: -4486> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.553 INFO:teuthology.orchestra.run.smithi045.stdout: -4485> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 375.885, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.76e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:754.8] 2023-10-03T19:21:03.553 INFO:teuthology.orchestra.run.smithi045.stdout: -4484> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e1c8480 on [dir 0x1 / [2,head] auth pv=6007 v=5933 cv=5559/5559 REP dir_auth=0 ap=37+39 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 37 2023-10-03T19:21:03.553 INFO:teuthology.orchestra.run.smithi045.stdout: -4483> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e1c8480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5932 pv6006 ap=38 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=38) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=37) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 38 2023-10-03T19:21:03.553 INFO:teuthology.orchestra.run.smithi045.stdout: -4482> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5933 cv=5559/5559 REP dir_auth=0 ap=37+38 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e1c8480 count now 37/38 2023-10-03T19:21:03.553 INFO:teuthology.orchestra.run.smithi045.stdout: -4481> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e1c8480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5927 cv=5553/5553 ap=38+38 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=187 | child=1 dirty=1 authpin=1 0x55576d056400] count now 38 2023-10-03T19:21:03.553 INFO:teuthology.orchestra.run.smithi045.stdout: -4480> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005b7) auth_unpin by 0x55576e1c8480 on [inode 0x100000005b7 [2,head] /dc-dir/dc-file_962 auth v5926 s=3 n(v0 rc2023-10-03T19:16:14.082388+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d77f600] now 0 2023-10-03T19:21:03.554 INFO:teuthology.orchestra.run.smithi045.stdout: -4479> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5927 cv=5553/5553 ap=38+37 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=187 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e1c8480 count now 38/37 2023-10-03T19:21:03.554 INFO:teuthology.orchestra.run.smithi045.stdout: -4478> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.554 INFO:teuthology.orchestra.run.smithi045.stdout: -4477> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.554 INFO:teuthology.orchestra.run.smithi045.stdout: -4476> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005b8 [2,head] /dc-dir/dc-file_963 auth v5114 pv5928 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.093491+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.093491+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d77fb80] 2023-10-03T19:21:03.554 INFO:teuthology.orchestra.run.smithi045.stdout: -4475> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5934 2023-10-03T19:21:03.554 INFO:teuthology.orchestra.run.smithi045.stdout: -4474> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5934 pv6006 ap=38 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=38) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=37) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.555 INFO:teuthology.orchestra.run.smithi045.stdout: -4473> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5932 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.555 INFO:teuthology.orchestra.run.smithi045.stdout: -4472> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5933 cv=5559/5559 REP dir_auth=0 ap=37+38 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5933 2023-10-03T19:21:03.555 INFO:teuthology.orchestra.run.smithi045.stdout: -4471> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005b8) pop_and_dirty_projected_inode v5928 2023-10-03T19:21:03.555 INFO:teuthology.orchestra.run.smithi045.stdout: -4470> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005b8) mark_dirty [inode 0x100000005b8 [2,head] /dc-dir/dc-file_963 auth v5928 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.093491+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d77fb80] 2023-10-03T19:21:03.555 INFO:teuthology.orchestra.run.smithi045.stdout: -4469> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_963) mark_dirty [dentry #0x1/dc-dir/dc-file_963 [2,head] auth (dversion lock) pv=5928 v=5114 ino=0x100000005b8 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d778a00] 2023-10-03T19:21:03.555 INFO:teuthology.orchestra.run.smithi045.stdout: -4468> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5927 cv=5553/5553 ap=38+37 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=188 | child=1 dirty=1 authpin=1 0x55576d056400] version 5927 2023-10-03T19:21:03.555 INFO:teuthology.orchestra.run.smithi045.stdout: -4467> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d04a260 v5935 2023-10-03T19:21:03.556 INFO:teuthology.orchestra.run.smithi045.stdout: -4466> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5935 cv=5559/5559 REP dir_auth=0 ap=37+38 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5935 2023-10-03T19:21:03.556 INFO:teuthology.orchestra.run.smithi045.stdout: -4465> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d04a140 v5929 2023-10-03T19:21:03.556 INFO:teuthology.orchestra.run.smithi045.stdout: -4464> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5929 cv=5553/5553 ap=38+37 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=188 | child=1 dirty=1 authpin=1 0x55576d056400] version 5929 2023-10-03T19:21:03.556 INFO:teuthology.orchestra.run.smithi045.stdout: -4463> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=37 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=37 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.556 INFO:teuthology.orchestra.run.smithi045.stdout: -4462> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=37) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5934 pv6006 ap=38 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=38) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=37) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.556 INFO:teuthology.orchestra.run.smithi045.stdout: -4461> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=38) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5934 pv6006 ap=38 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=38) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=36) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.557 INFO:teuthology.orchestra.run.smithi045.stdout: -4460> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005b8 [2,head] /dc-dir/dc-file_963 auth v5928 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.093491+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d77fb80] 2023-10-03T19:21:03.557 INFO:teuthology.orchestra.run.smithi045.stdout: -4459> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005b8 [2,head] /dc-dir/dc-file_963 auth v5928 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.093491+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d77fb80] 2023-10-03T19:21:03.557 INFO:teuthology.orchestra.run.smithi045.stdout: -4458> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.557 INFO:teuthology.orchestra.run.smithi045.stdout: -4457> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.557 INFO:teuthology.orchestra.run.smithi045.stdout: -4456> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.557 INFO:teuthology.orchestra.run.smithi045.stdout: -4455> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005b8 [2,head] /dc-dir/dc-file_963 auth v5928 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.093491+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d77fb80] 2023-10-03T19:21:03.557 INFO:teuthology.orchestra.run.smithi045.stdout: -4454> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005b8 [2,head] /dc-dir/dc-file_963 auth v5928 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.093491+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d77fb80] 2023-10-03T19:21:03.558 INFO:teuthology.orchestra.run.smithi045.stdout: -4453> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.558 INFO:teuthology.orchestra.run.smithi045.stdout: -4452> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 376.885, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.77e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:756.8] 2023-10-03T19:21:03.558 INFO:teuthology.orchestra.run.smithi045.stdout: -4451> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d5cb440 on [dir 0x1 / [2,head] auth pv=6007 v=5935 cv=5559/5559 REP dir_auth=0 ap=36+38 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 36 2023-10-03T19:21:03.558 INFO:teuthology.orchestra.run.smithi045.stdout: -4450> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d5cb440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5934 pv6006 ap=37 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=37) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=36) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 37 2023-10-03T19:21:03.562 INFO:teuthology.orchestra.run.smithi045.stdout: -4449> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5935 cv=5559/5559 REP dir_auth=0 ap=36+37 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d5cb440 count now 36/37 2023-10-03T19:21:03.562 INFO:teuthology.orchestra.run.smithi045.stdout: -4448> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d5cb440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5929 cv=5553/5553 ap=37+37 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=188 | child=1 dirty=1 authpin=1 0x55576d056400] count now 37 2023-10-03T19:21:03.562 INFO:teuthology.orchestra.run.smithi045.stdout: -4447> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005b8) auth_unpin by 0x55576d5cb440 on [inode 0x100000005b8 [2,head] /dc-dir/dc-file_963 auth v5928 s=3 n(v0 rc2023-10-03T19:16:14.093491+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d77fb80] now 0 2023-10-03T19:21:03.563 INFO:teuthology.orchestra.run.smithi045.stdout: -4446> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5929 cv=5553/5553 ap=37+36 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=188 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d5cb440 count now 37/36 2023-10-03T19:21:03.563 INFO:teuthology.orchestra.run.smithi045.stdout: -4445> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.563 INFO:teuthology.orchestra.run.smithi045.stdout: -4444> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.563 INFO:teuthology.orchestra.run.smithi045.stdout: -4443> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005b9 [2,head] /dc-dir/dc-file_964 auth v5118 pv5930 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.104499+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.104499+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d780100] 2023-10-03T19:21:03.563 INFO:teuthology.orchestra.run.smithi045.stdout: -4442> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5936 2023-10-03T19:21:03.563 INFO:teuthology.orchestra.run.smithi045.stdout: -4441> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5936 pv6006 ap=37 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=37) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=36) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.563 INFO:teuthology.orchestra.run.smithi045.stdout: -4440> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5934 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.564 INFO:teuthology.orchestra.run.smithi045.stdout: -4439> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5935 cv=5559/5559 REP dir_auth=0 ap=36+37 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5935 2023-10-03T19:21:03.564 INFO:teuthology.orchestra.run.smithi045.stdout: -4438> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005b9) pop_and_dirty_projected_inode v5930 2023-10-03T19:21:03.564 INFO:teuthology.orchestra.run.smithi045.stdout: -4437> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005b9) mark_dirty [inode 0x100000005b9 [2,head] /dc-dir/dc-file_964 auth v5930 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.104499+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d780100] 2023-10-03T19:21:03.564 INFO:teuthology.orchestra.run.smithi045.stdout: -4436> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_964) mark_dirty [dentry #0x1/dc-dir/dc-file_964 [2,head] auth (dversion lock) pv=5930 v=5118 ino=0x100000005b9 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d778c80] 2023-10-03T19:21:03.564 INFO:teuthology.orchestra.run.smithi045.stdout: -4435> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5929 cv=5553/5553 ap=37+36 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=189 | child=1 dirty=1 authpin=1 0x55576d056400] version 5929 2023-10-03T19:21:03.564 INFO:teuthology.orchestra.run.smithi045.stdout: -4434> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d04a4a0 v5937 2023-10-03T19:21:03.564 INFO:teuthology.orchestra.run.smithi045.stdout: -4433> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5937 cv=5559/5559 REP dir_auth=0 ap=36+37 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5937 2023-10-03T19:21:03.564 INFO:teuthology.orchestra.run.smithi045.stdout: -4432> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d04a380 v5931 2023-10-03T19:21:03.565 INFO:teuthology.orchestra.run.smithi045.stdout: -4431> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5931 cv=5553/5553 ap=37+36 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=189 | child=1 dirty=1 authpin=1 0x55576d056400] version 5931 2023-10-03T19:21:03.565 INFO:teuthology.orchestra.run.smithi045.stdout: -4430> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=36 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=36 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.565 INFO:teuthology.orchestra.run.smithi045.stdout: -4429> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=36) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5936 pv6006 ap=37 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=37) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=36) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.565 INFO:teuthology.orchestra.run.smithi045.stdout: -4428> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=37) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5936 pv6006 ap=37 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=37) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=35) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.565 INFO:teuthology.orchestra.run.smithi045.stdout: -4427> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005b9 [2,head] /dc-dir/dc-file_964 auth v5930 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.104499+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d780100] 2023-10-03T19:21:03.565 INFO:teuthology.orchestra.run.smithi045.stdout: -4426> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005b9 [2,head] /dc-dir/dc-file_964 auth v5930 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.104499+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d780100] 2023-10-03T19:21:03.565 INFO:teuthology.orchestra.run.smithi045.stdout: -4425> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.565 INFO:teuthology.orchestra.run.smithi045.stdout: -4424> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.566 INFO:teuthology.orchestra.run.smithi045.stdout: -4423> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.566 INFO:teuthology.orchestra.run.smithi045.stdout: -4422> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005b9 [2,head] /dc-dir/dc-file_964 auth v5930 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.104499+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d780100] 2023-10-03T19:21:03.566 INFO:teuthology.orchestra.run.smithi045.stdout: -4421> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005b9 [2,head] /dc-dir/dc-file_964 auth v5930 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.104499+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d780100] 2023-10-03T19:21:03.566 INFO:teuthology.orchestra.run.smithi045.stdout: -4420> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.566 INFO:teuthology.orchestra.run.smithi045.stdout: -4419> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 377.885, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.78e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:758.8] 2023-10-03T19:21:03.566 INFO:teuthology.orchestra.run.smithi045.stdout: -4418> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d0966c0 on [dir 0x1 / [2,head] auth pv=6007 v=5937 cv=5559/5559 REP dir_auth=0 ap=35+37 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 35 2023-10-03T19:21:03.566 INFO:teuthology.orchestra.run.smithi045.stdout: -4417> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d0966c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5936 pv6006 ap=36 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=36) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=35) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 36 2023-10-03T19:21:03.567 INFO:teuthology.orchestra.run.smithi045.stdout: -4416> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5937 cv=5559/5559 REP dir_auth=0 ap=35+36 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d0966c0 count now 35/36 2023-10-03T19:21:03.567 INFO:teuthology.orchestra.run.smithi045.stdout: -4415> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d0966c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5931 cv=5553/5553 ap=36+36 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=189 | child=1 dirty=1 authpin=1 0x55576d056400] count now 36 2023-10-03T19:21:03.567 INFO:teuthology.orchestra.run.smithi045.stdout: -4414> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005b9) auth_unpin by 0x55576d0966c0 on [inode 0x100000005b9 [2,head] /dc-dir/dc-file_964 auth v5930 s=3 n(v0 rc2023-10-03T19:16:14.104499+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d780100] now 0 2023-10-03T19:21:03.567 INFO:teuthology.orchestra.run.smithi045.stdout: -4413> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5931 cv=5553/5553 ap=36+35 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=189 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d0966c0 count now 36/35 2023-10-03T19:21:03.567 INFO:teuthology.orchestra.run.smithi045.stdout: -4412> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.567 INFO:teuthology.orchestra.run.smithi045.stdout: -4411> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.567 INFO:teuthology.orchestra.run.smithi045.stdout: -4410> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005ba [2,head] /dc-dir/dc-file_965 auth v5122 pv5932 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.115361+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.115361+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d780680] 2023-10-03T19:21:03.567 INFO:teuthology.orchestra.run.smithi045.stdout: -4409> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5938 2023-10-03T19:21:03.567 INFO:teuthology.orchestra.run.smithi045.stdout: -4408> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5938 pv6006 ap=36 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=36) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=35) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.568 INFO:teuthology.orchestra.run.smithi045.stdout: -4407> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5936 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.568 INFO:teuthology.orchestra.run.smithi045.stdout: -4406> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5937 cv=5559/5559 REP dir_auth=0 ap=35+36 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5937 2023-10-03T19:21:03.568 INFO:teuthology.orchestra.run.smithi045.stdout: -4405> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005ba) pop_and_dirty_projected_inode v5932 2023-10-03T19:21:03.568 INFO:teuthology.orchestra.run.smithi045.stdout: -4404> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005ba) mark_dirty [inode 0x100000005ba [2,head] /dc-dir/dc-file_965 auth v5932 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.115361+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d780680] 2023-10-03T19:21:03.568 INFO:teuthology.orchestra.run.smithi045.stdout: -4403> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_965) mark_dirty [dentry #0x1/dc-dir/dc-file_965 [2,head] auth (dversion lock) pv=5932 v=5122 ino=0x100000005ba state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d778f00] 2023-10-03T19:21:03.568 INFO:teuthology.orchestra.run.smithi045.stdout: -4402> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5931 cv=5553/5553 ap=36+35 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=190 | child=1 dirty=1 authpin=1 0x55576d056400] version 5931 2023-10-03T19:21:03.568 INFO:teuthology.orchestra.run.smithi045.stdout: -4401> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d04a6e0 v5939 2023-10-03T19:21:03.568 INFO:teuthology.orchestra.run.smithi045.stdout: -4400> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5939 cv=5559/5559 REP dir_auth=0 ap=35+36 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5939 2023-10-03T19:21:03.568 INFO:teuthology.orchestra.run.smithi045.stdout: -4399> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d04a5c0 v5933 2023-10-03T19:21:03.569 INFO:teuthology.orchestra.run.smithi045.stdout: -4398> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5933 cv=5553/5553 ap=36+35 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=190 | child=1 dirty=1 authpin=1 0x55576d056400] version 5933 2023-10-03T19:21:03.569 INFO:teuthology.orchestra.run.smithi045.stdout: -4397> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=35 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=35 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.569 INFO:teuthology.orchestra.run.smithi045.stdout: -4396> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=35) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5938 pv6006 ap=36 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=36) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=35) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.569 INFO:teuthology.orchestra.run.smithi045.stdout: -4395> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=36) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5938 pv6006 ap=36 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=36) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=34) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.569 INFO:teuthology.orchestra.run.smithi045.stdout: -4394> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005ba [2,head] /dc-dir/dc-file_965 auth v5932 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.115361+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d780680] 2023-10-03T19:21:03.580 INFO:teuthology.orchestra.run.smithi045.stdout: -4393> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005ba [2,head] /dc-dir/dc-file_965 auth v5932 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.115361+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d780680] 2023-10-03T19:21:03.580 INFO:teuthology.orchestra.run.smithi045.stdout: -4392> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.580 INFO:teuthology.orchestra.run.smithi045.stdout: -4391> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.580 INFO:teuthology.orchestra.run.smithi045.stdout: -4390> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.581 INFO:teuthology.orchestra.run.smithi045.stdout: -4389> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005ba [2,head] /dc-dir/dc-file_965 auth v5932 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.115361+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d780680] 2023-10-03T19:21:03.581 INFO:teuthology.orchestra.run.smithi045.stdout: -4388> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005ba [2,head] /dc-dir/dc-file_965 auth v5932 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.115361+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d780680] 2023-10-03T19:21:03.581 INFO:teuthology.orchestra.run.smithi045.stdout: -4387> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.581 INFO:teuthology.orchestra.run.smithi045.stdout: -4386> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 378.885, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.79e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:760.8] 2023-10-03T19:21:03.581 INFO:teuthology.orchestra.run.smithi045.stdout: -4385> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d547d40 on [dir 0x1 / [2,head] auth pv=6007 v=5939 cv=5559/5559 REP dir_auth=0 ap=34+36 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 34 2023-10-03T19:21:03.581 INFO:teuthology.orchestra.run.smithi045.stdout: -4384> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d547d40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5938 pv6006 ap=35 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=35) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=34) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 35 2023-10-03T19:21:03.581 INFO:teuthology.orchestra.run.smithi045.stdout: -4383> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5939 cv=5559/5559 REP dir_auth=0 ap=34+35 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d547d40 count now 34/35 2023-10-03T19:21:03.581 INFO:teuthology.orchestra.run.smithi045.stdout: -4382> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d547d40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5933 cv=5553/5553 ap=35+35 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=190 | child=1 dirty=1 authpin=1 0x55576d056400] count now 35 2023-10-03T19:21:03.582 INFO:teuthology.orchestra.run.smithi045.stdout: -4381> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005ba) auth_unpin by 0x55576d547d40 on [inode 0x100000005ba [2,head] /dc-dir/dc-file_965 auth v5932 s=3 n(v0 rc2023-10-03T19:16:14.115361+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d780680] now 0 2023-10-03T19:21:03.582 INFO:teuthology.orchestra.run.smithi045.stdout: -4380> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5933 cv=5553/5553 ap=35+34 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=190 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d547d40 count now 35/34 2023-10-03T19:21:03.582 INFO:teuthology.orchestra.run.smithi045.stdout: -4379> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.582 INFO:teuthology.orchestra.run.smithi045.stdout: -4378> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.582 INFO:teuthology.orchestra.run.smithi045.stdout: -4377> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005bb [2,head] /dc-dir/dc-file_966 auth v5126 pv5934 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.127815+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.127815+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d780c00] 2023-10-03T19:21:03.583 INFO:teuthology.orchestra.run.smithi045.stdout: -4376> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5940 2023-10-03T19:21:03.583 INFO:teuthology.orchestra.run.smithi045.stdout: -4375> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5940 pv6006 ap=35 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=35) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=34) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.583 INFO:teuthology.orchestra.run.smithi045.stdout: -4374> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5938 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.583 INFO:teuthology.orchestra.run.smithi045.stdout: -4373> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5939 cv=5559/5559 REP dir_auth=0 ap=34+35 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5939 2023-10-03T19:21:03.583 INFO:teuthology.orchestra.run.smithi045.stdout: -4372> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005bb) pop_and_dirty_projected_inode v5934 2023-10-03T19:21:03.583 INFO:teuthology.orchestra.run.smithi045.stdout: -4371> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005bb) mark_dirty [inode 0x100000005bb [2,head] /dc-dir/dc-file_966 auth v5934 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.127815+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d780c00] 2023-10-03T19:21:03.583 INFO:teuthology.orchestra.run.smithi045.stdout: -4370> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_966) mark_dirty [dentry #0x1/dc-dir/dc-file_966 [2,head] auth (dversion lock) pv=5934 v=5126 ino=0x100000005bb state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d779180] 2023-10-03T19:21:03.584 INFO:teuthology.orchestra.run.smithi045.stdout: -4369> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5933 cv=5553/5553 ap=35+34 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=191 | child=1 dirty=1 authpin=1 0x55576d056400] version 5933 2023-10-03T19:21:03.584 INFO:teuthology.orchestra.run.smithi045.stdout: -4368> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d04a920 v5941 2023-10-03T19:21:03.584 INFO:teuthology.orchestra.run.smithi045.stdout: -4367> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5941 cv=5559/5559 REP dir_auth=0 ap=34+35 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5941 2023-10-03T19:21:03.584 INFO:teuthology.orchestra.run.smithi045.stdout: -4366> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d04a800 v5935 2023-10-03T19:21:03.584 INFO:teuthology.orchestra.run.smithi045.stdout: -4365> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5935 cv=5553/5553 ap=35+34 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=191 | child=1 dirty=1 authpin=1 0x55576d056400] version 5935 2023-10-03T19:21:03.584 INFO:teuthology.orchestra.run.smithi045.stdout: -4364> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=34 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=34 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.584 INFO:teuthology.orchestra.run.smithi045.stdout: -4363> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=34) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5940 pv6006 ap=35 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=35) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=34) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.584 INFO:teuthology.orchestra.run.smithi045.stdout: -4362> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=35) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5940 pv6006 ap=35 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=35) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=33) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.585 INFO:teuthology.orchestra.run.smithi045.stdout: -4361> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005bb [2,head] /dc-dir/dc-file_966 auth v5934 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.127815+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d780c00] 2023-10-03T19:21:03.585 INFO:teuthology.orchestra.run.smithi045.stdout: -4360> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005bb [2,head] /dc-dir/dc-file_966 auth v5934 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.127815+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d780c00] 2023-10-03T19:21:03.585 INFO:teuthology.orchestra.run.smithi045.stdout: -4359> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.585 INFO:teuthology.orchestra.run.smithi045.stdout: -4358> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.585 INFO:teuthology.orchestra.run.smithi045.stdout: -4357> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.585 INFO:teuthology.orchestra.run.smithi045.stdout: -4356> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005bb [2,head] /dc-dir/dc-file_966 auth v5934 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.127815+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d780c00] 2023-10-03T19:21:03.585 INFO:teuthology.orchestra.run.smithi045.stdout: -4355> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005bb [2,head] /dc-dir/dc-file_966 auth v5934 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.127815+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d780c00] 2023-10-03T19:21:03.585 INFO:teuthology.orchestra.run.smithi045.stdout: -4354> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.586 INFO:teuthology.orchestra.run.smithi045.stdout: -4353> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 379.885, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.80e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:762.8] 2023-10-03T19:21:03.586 INFO:teuthology.orchestra.run.smithi045.stdout: -4352> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d820d80 on [dir 0x1 / [2,head] auth pv=6007 v=5941 cv=5559/5559 REP dir_auth=0 ap=33+35 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 33 2023-10-03T19:21:03.586 INFO:teuthology.orchestra.run.smithi045.stdout: -4351> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d820d80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5940 pv6006 ap=34 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=34) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=33) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 34 2023-10-03T19:21:03.586 INFO:teuthology.orchestra.run.smithi045.stdout: -4350> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5941 cv=5559/5559 REP dir_auth=0 ap=33+34 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d820d80 count now 33/34 2023-10-03T19:21:03.586 INFO:teuthology.orchestra.run.smithi045.stdout: -4349> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d820d80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5935 cv=5553/5553 ap=34+34 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=191 | child=1 dirty=1 authpin=1 0x55576d056400] count now 34 2023-10-03T19:21:03.586 INFO:teuthology.orchestra.run.smithi045.stdout: -4348> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005bb) auth_unpin by 0x55576d820d80 on [inode 0x100000005bb [2,head] /dc-dir/dc-file_966 auth v5934 s=3 n(v0 rc2023-10-03T19:16:14.127815+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d780c00] now 0 2023-10-03T19:21:03.586 INFO:teuthology.orchestra.run.smithi045.stdout: -4347> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5935 cv=5553/5553 ap=34+33 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=191 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d820d80 count now 34/33 2023-10-03T19:21:03.586 INFO:teuthology.orchestra.run.smithi045.stdout: -4346> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.587 INFO:teuthology.orchestra.run.smithi045.stdout: -4345> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.587 INFO:teuthology.orchestra.run.smithi045.stdout: -4344> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005bc [2,head] /dc-dir/dc-file_967 auth v5130 pv5936 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.138386+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.138386+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d781180] 2023-10-03T19:21:03.587 INFO:teuthology.orchestra.run.smithi045.stdout: -4343> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5942 2023-10-03T19:21:03.587 INFO:teuthology.orchestra.run.smithi045.stdout: -4342> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5942 pv6006 ap=34 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=34) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=33) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.587 INFO:teuthology.orchestra.run.smithi045.stdout: -4341> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5940 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.587 INFO:teuthology.orchestra.run.smithi045.stdout: -4340> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5941 cv=5559/5559 REP dir_auth=0 ap=33+34 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5941 2023-10-03T19:21:03.587 INFO:teuthology.orchestra.run.smithi045.stdout: -4339> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005bc) pop_and_dirty_projected_inode v5936 2023-10-03T19:21:03.587 INFO:teuthology.orchestra.run.smithi045.stdout: -4338> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005bc) mark_dirty [inode 0x100000005bc [2,head] /dc-dir/dc-file_967 auth v5936 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.138386+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d781180] 2023-10-03T19:21:03.587 INFO:teuthology.orchestra.run.smithi045.stdout: -4337> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_967) mark_dirty [dentry #0x1/dc-dir/dc-file_967 [2,head] auth (dversion lock) pv=5936 v=5130 ino=0x100000005bc state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d779400] 2023-10-03T19:21:03.588 INFO:teuthology.orchestra.run.smithi045.stdout: -4336> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5935 cv=5553/5553 ap=34+33 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=192 | child=1 dirty=1 authpin=1 0x55576d056400] version 5935 2023-10-03T19:21:03.589 INFO:teuthology.orchestra.run.smithi045.stdout: -4335> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d04ab60 v5943 2023-10-03T19:21:03.590 INFO:teuthology.orchestra.run.smithi045.stdout: -4334> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5943 cv=5559/5559 REP dir_auth=0 ap=33+34 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5943 2023-10-03T19:21:03.590 INFO:teuthology.orchestra.run.smithi045.stdout: -4333> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d04aa40 v5937 2023-10-03T19:21:03.590 INFO:teuthology.orchestra.run.smithi045.stdout: -4332> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5937 cv=5553/5553 ap=34+33 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=192 | child=1 dirty=1 authpin=1 0x55576d056400] version 5937 2023-10-03T19:21:03.590 INFO:teuthology.orchestra.run.smithi045.stdout: -4331> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=33 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=33 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.590 INFO:teuthology.orchestra.run.smithi045.stdout: -4330> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=33) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5942 pv6006 ap=34 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=34) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=33) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.590 INFO:teuthology.orchestra.run.smithi045.stdout: -4329> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=34) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5942 pv6006 ap=34 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=34) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=32) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.591 INFO:teuthology.orchestra.run.smithi045.stdout: -4328> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005bc [2,head] /dc-dir/dc-file_967 auth v5936 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.138386+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d781180] 2023-10-03T19:21:03.591 INFO:teuthology.orchestra.run.smithi045.stdout: -4327> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005bc [2,head] /dc-dir/dc-file_967 auth v5936 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.138386+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d781180] 2023-10-03T19:21:03.591 INFO:teuthology.orchestra.run.smithi045.stdout: -4326> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.591 INFO:teuthology.orchestra.run.smithi045.stdout: -4325> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.591 INFO:teuthology.orchestra.run.smithi045.stdout: -4324> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.591 INFO:teuthology.orchestra.run.smithi045.stdout: -4323> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005bc [2,head] /dc-dir/dc-file_967 auth v5936 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.138386+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d781180] 2023-10-03T19:21:03.591 INFO:teuthology.orchestra.run.smithi045.stdout: -4322> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005bc [2,head] /dc-dir/dc-file_967 auth v5936 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.138386+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d781180] 2023-10-03T19:21:03.591 INFO:teuthology.orchestra.run.smithi045.stdout: -4321> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.591 INFO:teuthology.orchestra.run.smithi045.stdout: -4320> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 380.885, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.81e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:764.8] 2023-10-03T19:21:03.591 INFO:teuthology.orchestra.run.smithi045.stdout: -4319> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d538900 on [dir 0x1 / [2,head] auth pv=6007 v=5943 cv=5559/5559 REP dir_auth=0 ap=32+34 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 32 2023-10-03T19:21:03.592 INFO:teuthology.orchestra.run.smithi045.stdout: -4318> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d538900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5942 pv6006 ap=33 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=33) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=32) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 33 2023-10-03T19:21:03.592 INFO:teuthology.orchestra.run.smithi045.stdout: -4317> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5943 cv=5559/5559 REP dir_auth=0 ap=32+33 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d538900 count now 32/33 2023-10-03T19:21:03.592 INFO:teuthology.orchestra.run.smithi045.stdout: -4316> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d538900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5937 cv=5553/5553 ap=33+33 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=192 | child=1 dirty=1 authpin=1 0x55576d056400] count now 33 2023-10-03T19:21:03.592 INFO:teuthology.orchestra.run.smithi045.stdout: -4315> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005bc) auth_unpin by 0x55576d538900 on [inode 0x100000005bc [2,head] /dc-dir/dc-file_967 auth v5936 s=3 n(v0 rc2023-10-03T19:16:14.138386+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d781180] now 0 2023-10-03T19:21:03.592 INFO:teuthology.orchestra.run.smithi045.stdout: -4314> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5937 cv=5553/5553 ap=33+32 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=192 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d538900 count now 33/32 2023-10-03T19:21:03.592 INFO:teuthology.orchestra.run.smithi045.stdout: -4313> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.592 INFO:teuthology.orchestra.run.smithi045.stdout: -4312> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.592 INFO:teuthology.orchestra.run.smithi045.stdout: -4311> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005bd [2,head] /dc-dir/dc-file_968 auth v5134 pv5938 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.149799+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.149799+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d781700] 2023-10-03T19:21:03.592 INFO:teuthology.orchestra.run.smithi045.stdout: -4310> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5944 2023-10-03T19:21:03.593 INFO:teuthology.orchestra.run.smithi045.stdout: -4309> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5944 pv6006 ap=33 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=33) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=32) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.593 INFO:teuthology.orchestra.run.smithi045.stdout: -4308> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5942 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.593 INFO:teuthology.orchestra.run.smithi045.stdout: -4307> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5943 cv=5559/5559 REP dir_auth=0 ap=32+33 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5943 2023-10-03T19:21:03.593 INFO:teuthology.orchestra.run.smithi045.stdout: -4306> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005bd) pop_and_dirty_projected_inode v5938 2023-10-03T19:21:03.593 INFO:teuthology.orchestra.run.smithi045.stdout: -4305> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005bd) mark_dirty [inode 0x100000005bd [2,head] /dc-dir/dc-file_968 auth v5938 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.149799+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d781700] 2023-10-03T19:21:03.593 INFO:teuthology.orchestra.run.smithi045.stdout: -4304> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_968) mark_dirty [dentry #0x1/dc-dir/dc-file_968 [2,head] auth (dversion lock) pv=5938 v=5134 ino=0x100000005bd state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d779680] 2023-10-03T19:21:03.593 INFO:teuthology.orchestra.run.smithi045.stdout: -4303> 2023-10-03T19:16:28.798+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5937 cv=5553/5553 ap=33+32 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=193 | child=1 dirty=1 authpin=1 0x55576d056400] version 5937 2023-10-03T19:21:03.593 INFO:teuthology.orchestra.run.smithi045.stdout: -4302> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d04ada0 v5945 2023-10-03T19:21:03.594 INFO:teuthology.orchestra.run.smithi045.stdout: -4301> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5945 cv=5559/5559 REP dir_auth=0 ap=32+33 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5945 2023-10-03T19:21:03.594 INFO:teuthology.orchestra.run.smithi045.stdout: -4300> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d04ac80 v5939 2023-10-03T19:21:03.594 INFO:teuthology.orchestra.run.smithi045.stdout: -4299> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5939 cv=5553/5553 ap=33+32 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=193 | child=1 dirty=1 authpin=1 0x55576d056400] version 5939 2023-10-03T19:21:03.594 INFO:teuthology.orchestra.run.smithi045.stdout: -4298> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=32 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=32 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.594 INFO:teuthology.orchestra.run.smithi045.stdout: -4297> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=32) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5944 pv6006 ap=33 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=33) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=32) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.594 INFO:teuthology.orchestra.run.smithi045.stdout: -4296> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=33) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5944 pv6006 ap=33 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=33) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=31) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.594 INFO:teuthology.orchestra.run.smithi045.stdout: -4295> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005bd [2,head] /dc-dir/dc-file_968 auth v5938 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.149799+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d781700] 2023-10-03T19:21:03.594 INFO:teuthology.orchestra.run.smithi045.stdout: -4294> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005bd [2,head] /dc-dir/dc-file_968 auth v5938 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.149799+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d781700] 2023-10-03T19:21:03.594 INFO:teuthology.orchestra.run.smithi045.stdout: -4293> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.595 INFO:teuthology.orchestra.run.smithi045.stdout: -4292> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.595 INFO:teuthology.orchestra.run.smithi045.stdout: -4291> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.595 INFO:teuthology.orchestra.run.smithi045.stdout: -4290> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005bd [2,head] /dc-dir/dc-file_968 auth v5938 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.149799+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d781700] 2023-10-03T19:21:03.595 INFO:teuthology.orchestra.run.smithi045.stdout: -4289> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005bd [2,head] /dc-dir/dc-file_968 auth v5938 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.149799+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d781700] 2023-10-03T19:21:03.595 INFO:teuthology.orchestra.run.smithi045.stdout: -4288> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.595 INFO:teuthology.orchestra.run.smithi045.stdout: -4287> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 381.674, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.82e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:766.3] 2023-10-03T19:21:03.595 INFO:teuthology.orchestra.run.smithi045.stdout: -4286> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d828900 on [dir 0x1 / [2,head] auth pv=6007 v=5945 cv=5559/5559 REP dir_auth=0 ap=31+33 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 31 2023-10-03T19:21:03.595 INFO:teuthology.orchestra.run.smithi045.stdout: -4285> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d828900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5944 pv6006 ap=32 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=32) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=31) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 32 2023-10-03T19:21:03.595 INFO:teuthology.orchestra.run.smithi045.stdout: -4284> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5945 cv=5559/5559 REP dir_auth=0 ap=31+32 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d828900 count now 31/32 2023-10-03T19:21:03.596 INFO:teuthology.orchestra.run.smithi045.stdout: -4283> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d828900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5939 cv=5553/5553 ap=32+32 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=193 | child=1 dirty=1 authpin=1 0x55576d056400] count now 32 2023-10-03T19:21:03.596 INFO:teuthology.orchestra.run.smithi045.stdout: -4282> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005bd) auth_unpin by 0x55576d828900 on [inode 0x100000005bd [2,head] /dc-dir/dc-file_968 auth v5938 s=3 n(v0 rc2023-10-03T19:16:14.149799+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d781700] now 0 2023-10-03T19:21:03.596 INFO:teuthology.orchestra.run.smithi045.stdout: -4281> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5939 cv=5553/5553 ap=32+31 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=193 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d828900 count now 32/31 2023-10-03T19:21:03.596 INFO:teuthology.orchestra.run.smithi045.stdout: -4280> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.596 INFO:teuthology.orchestra.run.smithi045.stdout: -4279> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.596 INFO:teuthology.orchestra.run.smithi045.stdout: -4278> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005be [2,head] /dc-dir/dc-file_969 auth v5138 pv5940 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.162160+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.162160+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d784000] 2023-10-03T19:21:03.596 INFO:teuthology.orchestra.run.smithi045.stdout: -4277> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5946 2023-10-03T19:21:03.596 INFO:teuthology.orchestra.run.smithi045.stdout: -4276> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5946 pv6006 ap=32 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=32) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=31) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.702 INFO:teuthology.orchestra.run.smithi045.stdout: -4275> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5944 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.702 INFO:teuthology.orchestra.run.smithi045.stdout: -4274> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5945 cv=5559/5559 REP dir_auth=0 ap=31+32 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5945 2023-10-03T19:21:03.702 INFO:teuthology.orchestra.run.smithi045.stdout: -4273> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005be) pop_and_dirty_projected_inode v5940 2023-10-03T19:21:03.702 INFO:teuthology.orchestra.run.smithi045.stdout: -4272> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005be) mark_dirty [inode 0x100000005be [2,head] /dc-dir/dc-file_969 auth v5940 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.162160+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d784000] 2023-10-03T19:21:03.702 INFO:teuthology.orchestra.run.smithi045.stdout: -4271> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_969) mark_dirty [dentry #0x1/dc-dir/dc-file_969 [2,head] auth (dversion lock) pv=5940 v=5138 ino=0x100000005be state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d779900] 2023-10-03T19:21:03.703 INFO:teuthology.orchestra.run.smithi045.stdout: -4270> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5939 cv=5553/5553 ap=32+31 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=194 | child=1 dirty=1 authpin=1 0x55576d056400] version 5939 2023-10-03T19:21:03.703 INFO:teuthology.orchestra.run.smithi045.stdout: -4269> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d04afe0 v5947 2023-10-03T19:21:03.703 INFO:teuthology.orchestra.run.smithi045.stdout: -4268> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5947 cv=5559/5559 REP dir_auth=0 ap=31+32 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5947 2023-10-03T19:21:03.703 INFO:teuthology.orchestra.run.smithi045.stdout: -4267> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d04aec0 v5941 2023-10-03T19:21:03.703 INFO:teuthology.orchestra.run.smithi045.stdout: -4266> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5941 cv=5553/5553 ap=32+31 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=194 | child=1 dirty=1 authpin=1 0x55576d056400] version 5941 2023-10-03T19:21:03.703 INFO:teuthology.orchestra.run.smithi045.stdout: -4265> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=31 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=31 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.704 INFO:teuthology.orchestra.run.smithi045.stdout: -4264> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=31) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5946 pv6006 ap=32 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=32) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=31) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.704 INFO:teuthology.orchestra.run.smithi045.stdout: -4263> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=32) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5946 pv6006 ap=32 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=32) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=30) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.704 INFO:teuthology.orchestra.run.smithi045.stdout: -4262> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005be [2,head] /dc-dir/dc-file_969 auth v5940 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.162160+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d784000] 2023-10-03T19:21:03.704 INFO:teuthology.orchestra.run.smithi045.stdout: -4261> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005be [2,head] /dc-dir/dc-file_969 auth v5940 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.162160+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d784000] 2023-10-03T19:21:03.704 INFO:teuthology.orchestra.run.smithi045.stdout: -4260> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.704 INFO:teuthology.orchestra.run.smithi045.stdout: -4259> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.704 INFO:teuthology.orchestra.run.smithi045.stdout: -4258> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.704 INFO:teuthology.orchestra.run.smithi045.stdout: -4257> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005be [2,head] /dc-dir/dc-file_969 auth v5940 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.162160+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d784000] 2023-10-03T19:21:03.705 INFO:teuthology.orchestra.run.smithi045.stdout: -4256> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005be [2,head] /dc-dir/dc-file_969 auth v5940 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.162160+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d784000] 2023-10-03T19:21:03.705 INFO:teuthology.orchestra.run.smithi045.stdout: -4255> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.705 INFO:teuthology.orchestra.run.smithi045.stdout: -4254> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 382.674, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.83e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:768.3] 2023-10-03T19:21:03.705 INFO:teuthology.orchestra.run.smithi045.stdout: -4253> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d829b00 on [dir 0x1 / [2,head] auth pv=6007 v=5947 cv=5559/5559 REP dir_auth=0 ap=30+32 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 30 2023-10-03T19:21:03.705 INFO:teuthology.orchestra.run.smithi045.stdout: -4252> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d829b00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5946 pv6006 ap=31 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=31) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=30) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 31 2023-10-03T19:21:03.705 INFO:teuthology.orchestra.run.smithi045.stdout: -4251> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5947 cv=5559/5559 REP dir_auth=0 ap=30+31 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d829b00 count now 30/31 2023-10-03T19:21:03.705 INFO:teuthology.orchestra.run.smithi045.stdout: -4250> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d829b00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5941 cv=5553/5553 ap=31+31 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=194 | child=1 dirty=1 authpin=1 0x55576d056400] count now 31 2023-10-03T19:21:03.705 INFO:teuthology.orchestra.run.smithi045.stdout: -4249> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005be) auth_unpin by 0x55576d829b00 on [inode 0x100000005be [2,head] /dc-dir/dc-file_969 auth v5940 s=3 n(v0 rc2023-10-03T19:16:14.162160+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d784000] now 0 2023-10-03T19:21:03.705 INFO:teuthology.orchestra.run.smithi045.stdout: -4248> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5941 cv=5553/5553 ap=31+30 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=194 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d829b00 count now 31/30 2023-10-03T19:21:03.706 INFO:teuthology.orchestra.run.smithi045.stdout: -4247> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.706 INFO:teuthology.orchestra.run.smithi045.stdout: -4246> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.706 INFO:teuthology.orchestra.run.smithi045.stdout: -4245> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005bf [2,head] /dc-dir/dc-file_970 auth v5142 pv5942 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.173756+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.173756+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d784580] 2023-10-03T19:21:03.706 INFO:teuthology.orchestra.run.smithi045.stdout: -4244> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5948 2023-10-03T19:21:03.706 INFO:teuthology.orchestra.run.smithi045.stdout: -4243> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5948 pv6006 ap=31 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=31) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=30) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.706 INFO:teuthology.orchestra.run.smithi045.stdout: -4242> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5946 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.707 INFO:teuthology.orchestra.run.smithi045.stdout: -4241> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5947 cv=5559/5559 REP dir_auth=0 ap=30+31 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5947 2023-10-03T19:21:03.707 INFO:teuthology.orchestra.run.smithi045.stdout: -4240> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005bf) pop_and_dirty_projected_inode v5942 2023-10-03T19:21:03.707 INFO:teuthology.orchestra.run.smithi045.stdout: -4239> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005bf) mark_dirty [inode 0x100000005bf [2,head] /dc-dir/dc-file_970 auth v5942 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.173756+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d784580] 2023-10-03T19:21:03.707 INFO:teuthology.orchestra.run.smithi045.stdout: -4238> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_970) mark_dirty [dentry #0x1/dc-dir/dc-file_970 [2,head] auth (dversion lock) pv=5942 v=5142 ino=0x100000005bf state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d779b80] 2023-10-03T19:21:03.707 INFO:teuthology.orchestra.run.smithi045.stdout: -4237> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5941 cv=5553/5553 ap=31+30 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=195 | child=1 dirty=1 authpin=1 0x55576d056400] version 5941 2023-10-03T19:21:03.707 INFO:teuthology.orchestra.run.smithi045.stdout: -4236> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d04b220 v5949 2023-10-03T19:21:03.707 INFO:teuthology.orchestra.run.smithi045.stdout: -4235> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5949 cv=5559/5559 REP dir_auth=0 ap=30+31 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5949 2023-10-03T19:21:03.707 INFO:teuthology.orchestra.run.smithi045.stdout: -4234> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d04b100 v5943 2023-10-03T19:21:03.707 INFO:teuthology.orchestra.run.smithi045.stdout: -4233> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5943 cv=5553/5553 ap=31+30 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=195 | child=1 dirty=1 authpin=1 0x55576d056400] version 5943 2023-10-03T19:21:03.708 INFO:teuthology.orchestra.run.smithi045.stdout: -4232> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=30 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=30 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.708 INFO:teuthology.orchestra.run.smithi045.stdout: -4231> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=30) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5948 pv6006 ap=31 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=31) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=30) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.708 INFO:teuthology.orchestra.run.smithi045.stdout: -4230> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=31) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5948 pv6006 ap=31 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=31) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=29) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.708 INFO:teuthology.orchestra.run.smithi045.stdout: -4229> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005bf [2,head] /dc-dir/dc-file_970 auth v5942 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.173756+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d784580] 2023-10-03T19:21:03.708 INFO:teuthology.orchestra.run.smithi045.stdout: -4228> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005bf [2,head] /dc-dir/dc-file_970 auth v5942 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.173756+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d784580] 2023-10-03T19:21:03.708 INFO:teuthology.orchestra.run.smithi045.stdout: -4227> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.708 INFO:teuthology.orchestra.run.smithi045.stdout: -4226> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.708 INFO:teuthology.orchestra.run.smithi045.stdout: -4225> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.709 INFO:teuthology.orchestra.run.smithi045.stdout: -4224> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005bf [2,head] /dc-dir/dc-file_970 auth v5942 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.173756+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d784580] 2023-10-03T19:21:03.709 INFO:teuthology.orchestra.run.smithi045.stdout: -4223> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005bf [2,head] /dc-dir/dc-file_970 auth v5942 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.173756+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d784580] 2023-10-03T19:21:03.709 INFO:teuthology.orchestra.run.smithi045.stdout: -4222> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.709 INFO:teuthology.orchestra.run.smithi045.stdout: -4221> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 383.674, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.84e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:770.3] 2023-10-03T19:21:03.709 INFO:teuthology.orchestra.run.smithi045.stdout: -4220> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e31cd80 on [dir 0x1 / [2,head] auth pv=6007 v=5949 cv=5559/5559 REP dir_auth=0 ap=29+31 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 29 2023-10-03T19:21:03.709 INFO:teuthology.orchestra.run.smithi045.stdout: -4219> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e31cd80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5948 pv6006 ap=30 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=30) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=29) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 30 2023-10-03T19:21:03.710 INFO:teuthology.orchestra.run.smithi045.stdout: -4218> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5949 cv=5559/5559 REP dir_auth=0 ap=29+30 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e31cd80 count now 29/30 2023-10-03T19:21:03.710 INFO:teuthology.orchestra.run.smithi045.stdout: -4217> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e31cd80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5943 cv=5553/5553 ap=30+30 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=195 | child=1 dirty=1 authpin=1 0x55576d056400] count now 30 2023-10-03T19:21:03.710 INFO:teuthology.orchestra.run.smithi045.stdout: -4216> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005bf) auth_unpin by 0x55576e31cd80 on [inode 0x100000005bf [2,head] /dc-dir/dc-file_970 auth v5942 s=3 n(v0 rc2023-10-03T19:16:14.173756+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d784580] now 0 2023-10-03T19:21:03.710 INFO:teuthology.orchestra.run.smithi045.stdout: -4215> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5943 cv=5553/5553 ap=30+29 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=195 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e31cd80 count now 30/29 2023-10-03T19:21:03.710 INFO:teuthology.orchestra.run.smithi045.stdout: -4214> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.710 INFO:teuthology.orchestra.run.smithi045.stdout: -4213> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.710 INFO:teuthology.orchestra.run.smithi045.stdout: -4212> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005c0 [2,head] /dc-dir/dc-file_971 auth v5146 pv5944 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.185336+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.185336+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d784b00] 2023-10-03T19:21:03.710 INFO:teuthology.orchestra.run.smithi045.stdout: -4211> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5950 2023-10-03T19:21:03.711 INFO:teuthology.orchestra.run.smithi045.stdout: -4210> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5950 pv6006 ap=30 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=30) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=29) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.715 INFO:teuthology.orchestra.run.smithi045.stdout: -4209> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5948 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.715 INFO:teuthology.orchestra.run.smithi045.stdout: -4208> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5949 cv=5559/5559 REP dir_auth=0 ap=29+30 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5949 2023-10-03T19:21:03.715 INFO:teuthology.orchestra.run.smithi045.stdout: -4207> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005c0) pop_and_dirty_projected_inode v5944 2023-10-03T19:21:03.715 INFO:teuthology.orchestra.run.smithi045.stdout: -4206> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005c0) mark_dirty [inode 0x100000005c0 [2,head] /dc-dir/dc-file_971 auth v5944 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.185336+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d784b00] 2023-10-03T19:21:03.715 INFO:teuthology.orchestra.run.smithi045.stdout: -4205> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_971) mark_dirty [dentry #0x1/dc-dir/dc-file_971 [2,head] auth (dversion lock) pv=5944 v=5146 ino=0x100000005c0 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d5fa000] 2023-10-03T19:21:03.715 INFO:teuthology.orchestra.run.smithi045.stdout: -4204> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5943 cv=5553/5553 ap=30+29 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=196 | child=1 dirty=1 authpin=1 0x55576d056400] version 5943 2023-10-03T19:21:03.716 INFO:teuthology.orchestra.run.smithi045.stdout: -4203> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d04b460 v5951 2023-10-03T19:21:03.716 INFO:teuthology.orchestra.run.smithi045.stdout: -4202> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5951 cv=5559/5559 REP dir_auth=0 ap=29+30 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5951 2023-10-03T19:21:03.716 INFO:teuthology.orchestra.run.smithi045.stdout: -4201> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d04b340 v5945 2023-10-03T19:21:03.716 INFO:teuthology.orchestra.run.smithi045.stdout: -4200> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5945 cv=5553/5553 ap=30+29 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=196 | child=1 dirty=1 authpin=1 0x55576d056400] version 5945 2023-10-03T19:21:03.716 INFO:teuthology.orchestra.run.smithi045.stdout: -4199> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=29 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=29 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.716 INFO:teuthology.orchestra.run.smithi045.stdout: -4198> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=29) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5950 pv6006 ap=30 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=30) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=29) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.716 INFO:teuthology.orchestra.run.smithi045.stdout: -4197> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=30) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5950 pv6006 ap=30 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=30) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=28) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.716 INFO:teuthology.orchestra.run.smithi045.stdout: -4196> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005c0 [2,head] /dc-dir/dc-file_971 auth v5944 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.185336+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d784b00] 2023-10-03T19:21:03.717 INFO:teuthology.orchestra.run.smithi045.stdout: -4195> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005c0 [2,head] /dc-dir/dc-file_971 auth v5944 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.185336+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d784b00] 2023-10-03T19:21:03.717 INFO:teuthology.orchestra.run.smithi045.stdout: -4194> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.717 INFO:teuthology.orchestra.run.smithi045.stdout: -4193> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.717 INFO:teuthology.orchestra.run.smithi045.stdout: -4192> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.717 INFO:teuthology.orchestra.run.smithi045.stdout: -4191> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005c0 [2,head] /dc-dir/dc-file_971 auth v5944 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.185336+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d784b00] 2023-10-03T19:21:03.717 INFO:teuthology.orchestra.run.smithi045.stdout: -4190> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005c0 [2,head] /dc-dir/dc-file_971 auth v5944 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.185336+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d784b00] 2023-10-03T19:21:03.717 INFO:teuthology.orchestra.run.smithi045.stdout: -4189> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.717 INFO:teuthology.orchestra.run.smithi045.stdout: -4188> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 384.674, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.85e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:772.3] 2023-10-03T19:21:03.718 INFO:teuthology.orchestra.run.smithi045.stdout: -4187> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e31db00 on [dir 0x1 / [2,head] auth pv=6007 v=5951 cv=5559/5559 REP dir_auth=0 ap=28+30 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 28 2023-10-03T19:21:03.718 INFO:teuthology.orchestra.run.smithi045.stdout: -4186> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e31db00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5950 pv6006 ap=29 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=29) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=28) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 29 2023-10-03T19:21:03.718 INFO:teuthology.orchestra.run.smithi045.stdout: -4185> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5951 cv=5559/5559 REP dir_auth=0 ap=28+29 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e31db00 count now 28/29 2023-10-03T19:21:03.718 INFO:teuthology.orchestra.run.smithi045.stdout: -4184> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e31db00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5945 cv=5553/5553 ap=29+29 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=196 | child=1 dirty=1 authpin=1 0x55576d056400] count now 29 2023-10-03T19:21:03.718 INFO:teuthology.orchestra.run.smithi045.stdout: -4183> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005c0) auth_unpin by 0x55576e31db00 on [inode 0x100000005c0 [2,head] /dc-dir/dc-file_971 auth v5944 s=3 n(v0 rc2023-10-03T19:16:14.185336+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d784b00] now 0 2023-10-03T19:21:03.718 INFO:teuthology.orchestra.run.smithi045.stdout: -4182> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5945 cv=5553/5553 ap=29+28 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=196 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e31db00 count now 29/28 2023-10-03T19:21:03.718 INFO:teuthology.orchestra.run.smithi045.stdout: -4181> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.718 INFO:teuthology.orchestra.run.smithi045.stdout: -4180> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.718 INFO:teuthology.orchestra.run.smithi045.stdout: -4179> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005c1 [2,head] /dc-dir/dc-file_972 auth v5150 pv5946 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.196905+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.196905+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d785080] 2023-10-03T19:21:03.719 INFO:teuthology.orchestra.run.smithi045.stdout: -4178> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5952 2023-10-03T19:21:03.719 INFO:teuthology.orchestra.run.smithi045.stdout: -4177> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5952 pv6006 ap=29 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=29) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=28) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.719 INFO:teuthology.orchestra.run.smithi045.stdout: -4176> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5950 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.719 INFO:teuthology.orchestra.run.smithi045.stdout: -4175> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5951 cv=5559/5559 REP dir_auth=0 ap=28+29 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5951 2023-10-03T19:21:03.719 INFO:teuthology.orchestra.run.smithi045.stdout: -4174> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005c1) pop_and_dirty_projected_inode v5946 2023-10-03T19:21:03.719 INFO:teuthology.orchestra.run.smithi045.stdout: -4173> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005c1) mark_dirty [inode 0x100000005c1 [2,head] /dc-dir/dc-file_972 auth v5946 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.196905+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d785080] 2023-10-03T19:21:03.719 INFO:teuthology.orchestra.run.smithi045.stdout: -4172> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_972) mark_dirty [dentry #0x1/dc-dir/dc-file_972 [2,head] auth (dversion lock) pv=5946 v=5150 ino=0x100000005c1 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d5fa280] 2023-10-03T19:21:03.719 INFO:teuthology.orchestra.run.smithi045.stdout: -4171> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5945 cv=5553/5553 ap=29+28 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=197 | child=1 dirty=1 authpin=1 0x55576d056400] version 5945 2023-10-03T19:21:03.720 INFO:teuthology.orchestra.run.smithi045.stdout: -4170> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d04b6a0 v5953 2023-10-03T19:21:03.720 INFO:teuthology.orchestra.run.smithi045.stdout: -4169> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5953 cv=5559/5559 REP dir_auth=0 ap=28+29 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5953 2023-10-03T19:21:03.720 INFO:teuthology.orchestra.run.smithi045.stdout: -4168> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d04b580 v5947 2023-10-03T19:21:03.720 INFO:teuthology.orchestra.run.smithi045.stdout: -4167> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5947 cv=5553/5553 ap=29+28 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=197 | child=1 dirty=1 authpin=1 0x55576d056400] version 5947 2023-10-03T19:21:03.720 INFO:teuthology.orchestra.run.smithi045.stdout: -4166> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=28 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=28 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.720 INFO:teuthology.orchestra.run.smithi045.stdout: -4165> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=28) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5952 pv6006 ap=29 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=29) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=28) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.724 INFO:teuthology.orchestra.run.smithi045.stdout: -4164> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=29) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5952 pv6006 ap=29 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=29) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=27) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.724 INFO:teuthology.orchestra.run.smithi045.stdout: -4163> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005c1 [2,head] /dc-dir/dc-file_972 auth v5946 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.196905+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d785080] 2023-10-03T19:21:03.724 INFO:teuthology.orchestra.run.smithi045.stdout: -4162> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005c1 [2,head] /dc-dir/dc-file_972 auth v5946 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.196905+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d785080] 2023-10-03T19:21:03.724 INFO:teuthology.orchestra.run.smithi045.stdout: -4161> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.724 INFO:teuthology.orchestra.run.smithi045.stdout: -4160> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.725 INFO:teuthology.orchestra.run.smithi045.stdout: -4159> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.725 INFO:teuthology.orchestra.run.smithi045.stdout: -4158> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005c1 [2,head] /dc-dir/dc-file_972 auth v5946 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.196905+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d785080] 2023-10-03T19:21:03.725 INFO:teuthology.orchestra.run.smithi045.stdout: -4157> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005c1 [2,head] /dc-dir/dc-file_972 auth v5946 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.196905+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d785080] 2023-10-03T19:21:03.725 INFO:teuthology.orchestra.run.smithi045.stdout: -4156> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.725 INFO:teuthology.orchestra.run.smithi045.stdout: -4155> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 385.674, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.86e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:774.3] 2023-10-03T19:21:03.725 INFO:teuthology.orchestra.run.smithi045.stdout: -4154> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576df52240 on [dir 0x1 / [2,head] auth pv=6007 v=5953 cv=5559/5559 REP dir_auth=0 ap=27+29 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 27 2023-10-03T19:21:03.725 INFO:teuthology.orchestra.run.smithi045.stdout: -4153> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576df52240 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5947 cv=5553/5553 ap=28+28 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=197 | child=1 dirty=1 authpin=1 0x55576d056400] count now 28 2023-10-03T19:21:03.725 INFO:teuthology.orchestra.run.smithi045.stdout: -4152> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576df52240 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5952 pv6006 ap=28 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=28) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=27) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 28 2023-10-03T19:21:03.726 INFO:teuthology.orchestra.run.smithi045.stdout: -4151> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5953 cv=5559/5559 REP dir_auth=0 ap=27+28 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576df52240 count now 27/28 2023-10-03T19:21:03.726 INFO:teuthology.orchestra.run.smithi045.stdout: -4150> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005c1) auth_unpin by 0x55576df52240 on [inode 0x100000005c1 [2,head] /dc-dir/dc-file_972 auth v5946 s=3 n(v0 rc2023-10-03T19:16:14.196905+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d785080] now 0 2023-10-03T19:21:03.726 INFO:teuthology.orchestra.run.smithi045.stdout: -4149> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5947 cv=5553/5553 ap=28+27 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=197 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576df52240 count now 28/27 2023-10-03T19:21:03.726 INFO:teuthology.orchestra.run.smithi045.stdout: -4148> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.726 INFO:teuthology.orchestra.run.smithi045.stdout: -4147> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.726 INFO:teuthology.orchestra.run.smithi045.stdout: -4146> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005c2 [2,head] /dc-dir/dc-file_973 auth v5154 pv5948 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.208247+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.208247+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d785600] 2023-10-03T19:21:03.726 INFO:teuthology.orchestra.run.smithi045.stdout: -4145> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5954 2023-10-03T19:21:03.727 INFO:teuthology.orchestra.run.smithi045.stdout: -4144> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5954 pv6006 ap=28 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=28) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=27) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.727 INFO:teuthology.orchestra.run.smithi045.stdout: -4143> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5952 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.727 INFO:teuthology.orchestra.run.smithi045.stdout: -4142> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5953 cv=5559/5559 REP dir_auth=0 ap=27+28 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5953 2023-10-03T19:21:03.727 INFO:teuthology.orchestra.run.smithi045.stdout: -4141> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005c2) pop_and_dirty_projected_inode v5948 2023-10-03T19:21:03.727 INFO:teuthology.orchestra.run.smithi045.stdout: -4140> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005c2) mark_dirty [inode 0x100000005c2 [2,head] /dc-dir/dc-file_973 auth v5948 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.208247+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d785600] 2023-10-03T19:21:03.727 INFO:teuthology.orchestra.run.smithi045.stdout: -4139> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_973) mark_dirty [dentry #0x1/dc-dir/dc-file_973 [2,head] auth (dversion lock) pv=5948 v=5154 ino=0x100000005c2 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d5fa500] 2023-10-03T19:21:03.727 INFO:teuthology.orchestra.run.smithi045.stdout: -4138> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5947 cv=5553/5553 ap=28+27 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=198 | child=1 dirty=1 authpin=1 0x55576d056400] version 5947 2023-10-03T19:21:03.727 INFO:teuthology.orchestra.run.smithi045.stdout: -4137> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d04b8e0 v5955 2023-10-03T19:21:03.727 INFO:teuthology.orchestra.run.smithi045.stdout: -4136> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5955 cv=5559/5559 REP dir_auth=0 ap=27+28 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5955 2023-10-03T19:21:03.728 INFO:teuthology.orchestra.run.smithi045.stdout: -4135> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d04b7c0 v5949 2023-10-03T19:21:03.728 INFO:teuthology.orchestra.run.smithi045.stdout: -4134> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5949 cv=5553/5553 ap=28+27 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=198 | child=1 dirty=1 authpin=1 0x55576d056400] version 5949 2023-10-03T19:21:03.728 INFO:teuthology.orchestra.run.smithi045.stdout: -4133> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=27 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=27 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.728 INFO:teuthology.orchestra.run.smithi045.stdout: -4132> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=27) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5954 pv6006 ap=28 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=28) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=27) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.728 INFO:teuthology.orchestra.run.smithi045.stdout: -4131> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=28) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5954 pv6006 ap=28 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=28) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=26) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.728 INFO:teuthology.orchestra.run.smithi045.stdout: -4130> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005c2 [2,head] /dc-dir/dc-file_973 auth v5948 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.208247+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d785600] 2023-10-03T19:21:03.728 INFO:teuthology.orchestra.run.smithi045.stdout: -4129> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005c2 [2,head] /dc-dir/dc-file_973 auth v5948 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.208247+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d785600] 2023-10-03T19:21:03.729 INFO:teuthology.orchestra.run.smithi045.stdout: -4128> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.729 INFO:teuthology.orchestra.run.smithi045.stdout: -4127> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.729 INFO:teuthology.orchestra.run.smithi045.stdout: -4126> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.729 INFO:teuthology.orchestra.run.smithi045.stdout: -4125> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005c2 [2,head] /dc-dir/dc-file_973 auth v5948 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.208247+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d785600] 2023-10-03T19:21:03.729 INFO:teuthology.orchestra.run.smithi045.stdout: -4124> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005c2 [2,head] /dc-dir/dc-file_973 auth v5948 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.208247+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d785600] 2023-10-03T19:21:03.729 INFO:teuthology.orchestra.run.smithi045.stdout: -4123> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.729 INFO:teuthology.orchestra.run.smithi045.stdout: -4122> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 386.674, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.87e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:776.3] 2023-10-03T19:21:03.729 INFO:teuthology.orchestra.run.smithi045.stdout: -4121> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576df526c0 on [dir 0x1 / [2,head] auth pv=6007 v=5955 cv=5559/5559 REP dir_auth=0 ap=26+28 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 26 2023-10-03T19:21:03.729 INFO:teuthology.orchestra.run.smithi045.stdout: -4120> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576df526c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5954 pv6006 ap=27 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=27) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=26) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 27 2023-10-03T19:21:03.729 INFO:teuthology.orchestra.run.smithi045.stdout: -4119> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5955 cv=5559/5559 REP dir_auth=0 ap=26+27 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576df526c0 count now 26/27 2023-10-03T19:21:03.730 INFO:teuthology.orchestra.run.smithi045.stdout: -4118> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576df526c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5949 cv=5553/5553 ap=27+27 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=198 | child=1 dirty=1 authpin=1 0x55576d056400] count now 27 2023-10-03T19:21:03.730 INFO:teuthology.orchestra.run.smithi045.stdout: -4117> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005c2) auth_unpin by 0x55576df526c0 on [inode 0x100000005c2 [2,head] /dc-dir/dc-file_973 auth v5948 s=3 n(v0 rc2023-10-03T19:16:14.208247+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d785600] now 0 2023-10-03T19:21:03.730 INFO:teuthology.orchestra.run.smithi045.stdout: -4116> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5949 cv=5553/5553 ap=27+26 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=198 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576df526c0 count now 27/26 2023-10-03T19:21:03.730 INFO:teuthology.orchestra.run.smithi045.stdout: -4115> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.730 INFO:teuthology.orchestra.run.smithi045.stdout: -4114> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.730 INFO:teuthology.orchestra.run.smithi045.stdout: -4113> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005c3 [2,head] /dc-dir/dc-file_974 auth v5158 pv5950 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.219552+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.219552+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d785b80] 2023-10-03T19:21:03.730 INFO:teuthology.orchestra.run.smithi045.stdout: -4112> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5956 2023-10-03T19:21:03.730 INFO:teuthology.orchestra.run.smithi045.stdout: -4111> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5956 pv6006 ap=27 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=27) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=26) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.731 INFO:teuthology.orchestra.run.smithi045.stdout: -4110> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5954 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.731 INFO:teuthology.orchestra.run.smithi045.stdout: -4109> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5955 cv=5559/5559 REP dir_auth=0 ap=26+27 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5955 2023-10-03T19:21:03.731 INFO:teuthology.orchestra.run.smithi045.stdout: -4108> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005c3) pop_and_dirty_projected_inode v5950 2023-10-03T19:21:03.731 INFO:teuthology.orchestra.run.smithi045.stdout: -4107> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005c3) mark_dirty [inode 0x100000005c3 [2,head] /dc-dir/dc-file_974 auth v5950 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.219552+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d785b80] 2023-10-03T19:21:03.731 INFO:teuthology.orchestra.run.smithi045.stdout: -4106> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_974) mark_dirty [dentry #0x1/dc-dir/dc-file_974 [2,head] auth (dversion lock) pv=5950 v=5158 ino=0x100000005c3 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d5fa780] 2023-10-03T19:21:03.731 INFO:teuthology.orchestra.run.smithi045.stdout: -4105> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5949 cv=5553/5553 ap=27+26 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=199 | child=1 dirty=1 authpin=1 0x55576d056400] version 5949 2023-10-03T19:21:03.731 INFO:teuthology.orchestra.run.smithi045.stdout: -4104> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d04bb20 v5957 2023-10-03T19:21:03.731 INFO:teuthology.orchestra.run.smithi045.stdout: -4103> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5957 cv=5559/5559 REP dir_auth=0 ap=26+27 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5957 2023-10-03T19:21:03.732 INFO:teuthology.orchestra.run.smithi045.stdout: -4102> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d04ba00 v5951 2023-10-03T19:21:03.732 INFO:teuthology.orchestra.run.smithi045.stdout: -4101> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5951 cv=5553/5553 ap=27+26 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=199 | child=1 dirty=1 authpin=1 0x55576d056400] version 5951 2023-10-03T19:21:03.732 INFO:teuthology.orchestra.run.smithi045.stdout: -4100> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=26 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=26 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.742 INFO:teuthology.orchestra.run.smithi045.stdout: -4099> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=26) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5956 pv6006 ap=27 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=27) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=26) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.742 INFO:teuthology.orchestra.run.smithi045.stdout: -4098> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=27) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5956 pv6006 ap=27 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=27) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=25) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.742 INFO:teuthology.orchestra.run.smithi045.stdout: -4097> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005c3 [2,head] /dc-dir/dc-file_974 auth v5950 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.219552+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d785b80] 2023-10-03T19:21:03.743 INFO:teuthology.orchestra.run.smithi045.stdout: -4096> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005c3 [2,head] /dc-dir/dc-file_974 auth v5950 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.219552+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d785b80] 2023-10-03T19:21:03.743 INFO:teuthology.orchestra.run.smithi045.stdout: -4095> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.743 INFO:teuthology.orchestra.run.smithi045.stdout: -4094> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.743 INFO:teuthology.orchestra.run.smithi045.stdout: -4093> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.743 INFO:teuthology.orchestra.run.smithi045.stdout: -4092> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005c3 [2,head] /dc-dir/dc-file_974 auth v5950 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.219552+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d785b80] 2023-10-03T19:21:03.743 INFO:teuthology.orchestra.run.smithi045.stdout: -4091> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005c3 [2,head] /dc-dir/dc-file_974 auth v5950 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.219552+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d785b80] 2023-10-03T19:21:03.743 INFO:teuthology.orchestra.run.smithi045.stdout: -4090> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.743 INFO:teuthology.orchestra.run.smithi045.stdout: -4089> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 387.674, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.88e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:778.3] 2023-10-03T19:21:03.744 INFO:teuthology.orchestra.run.smithi045.stdout: -4088> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576df52b40 on [dir 0x1 / [2,head] auth pv=6007 v=5957 cv=5559/5559 REP dir_auth=0 ap=25+27 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 25 2023-10-03T19:21:03.744 INFO:teuthology.orchestra.run.smithi045.stdout: -4087> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576df52b40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5956 pv6006 ap=26 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=26) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=25) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 26 2023-10-03T19:21:03.744 INFO:teuthology.orchestra.run.smithi045.stdout: -4086> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5957 cv=5559/5559 REP dir_auth=0 ap=25+26 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576df52b40 count now 25/26 2023-10-03T19:21:03.744 INFO:teuthology.orchestra.run.smithi045.stdout: -4085> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576df52b40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5951 cv=5553/5553 ap=26+26 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=199 | child=1 dirty=1 authpin=1 0x55576d056400] count now 26 2023-10-03T19:21:03.744 INFO:teuthology.orchestra.run.smithi045.stdout: -4084> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005c3) auth_unpin by 0x55576df52b40 on [inode 0x100000005c3 [2,head] /dc-dir/dc-file_974 auth v5950 s=3 n(v0 rc2023-10-03T19:16:14.219552+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d785b80] now 0 2023-10-03T19:21:03.744 INFO:teuthology.orchestra.run.smithi045.stdout: -4083> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5951 cv=5553/5553 ap=26+25 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=199 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576df52b40 count now 26/25 2023-10-03T19:21:03.744 INFO:teuthology.orchestra.run.smithi045.stdout: -4082> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.744 INFO:teuthology.orchestra.run.smithi045.stdout: -4081> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.745 INFO:teuthology.orchestra.run.smithi045.stdout: -4080> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005c4 [2,head] /dc-dir/dc-file_975 auth v5162 pv5952 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.230341+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.230341+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d786100] 2023-10-03T19:21:03.745 INFO:teuthology.orchestra.run.smithi045.stdout: -4079> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5958 2023-10-03T19:21:03.745 INFO:teuthology.orchestra.run.smithi045.stdout: -4078> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5958 pv6006 ap=26 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=26) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=25) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.745 INFO:teuthology.orchestra.run.smithi045.stdout: -4077> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5956 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.745 INFO:teuthology.orchestra.run.smithi045.stdout: -4076> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5957 cv=5559/5559 REP dir_auth=0 ap=25+26 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5957 2023-10-03T19:21:03.745 INFO:teuthology.orchestra.run.smithi045.stdout: -4075> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005c4) pop_and_dirty_projected_inode v5952 2023-10-03T19:21:03.745 INFO:teuthology.orchestra.run.smithi045.stdout: -4074> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005c4) mark_dirty [inode 0x100000005c4 [2,head] /dc-dir/dc-file_975 auth v5952 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.230341+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d786100] 2023-10-03T19:21:03.745 INFO:teuthology.orchestra.run.smithi045.stdout: -4073> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_975) mark_dirty [dentry #0x1/dc-dir/dc-file_975 [2,head] auth (dversion lock) pv=5952 v=5162 ino=0x100000005c4 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d5faa00] 2023-10-03T19:21:03.745 INFO:teuthology.orchestra.run.smithi045.stdout: -4072> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5951 cv=5553/5553 ap=26+25 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=200 | child=1 dirty=1 authpin=1 0x55576d056400] version 5951 2023-10-03T19:21:03.746 INFO:teuthology.orchestra.run.smithi045.stdout: -4071> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576d04bd60 v5959 2023-10-03T19:21:03.746 INFO:teuthology.orchestra.run.smithi045.stdout: -4070> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5959 cv=5559/5559 REP dir_auth=0 ap=25+26 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5959 2023-10-03T19:21:03.746 INFO:teuthology.orchestra.run.smithi045.stdout: -4069> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d04bc40 v5953 2023-10-03T19:21:03.746 INFO:teuthology.orchestra.run.smithi045.stdout: -4068> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5953 cv=5553/5553 ap=26+25 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=200 | child=1 dirty=1 authpin=1 0x55576d056400] version 5953 2023-10-03T19:21:03.746 INFO:teuthology.orchestra.run.smithi045.stdout: -4067> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=25 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=25 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.746 INFO:teuthology.orchestra.run.smithi045.stdout: -4066> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=25) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5958 pv6006 ap=26 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=26) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=25) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.746 INFO:teuthology.orchestra.run.smithi045.stdout: -4065> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=26) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5958 pv6006 ap=26 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=26) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=24) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.746 INFO:teuthology.orchestra.run.smithi045.stdout: -4064> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005c4 [2,head] /dc-dir/dc-file_975 auth v5952 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.230341+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d786100] 2023-10-03T19:21:03.746 INFO:teuthology.orchestra.run.smithi045.stdout: -4063> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005c4 [2,head] /dc-dir/dc-file_975 auth v5952 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.230341+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d786100] 2023-10-03T19:21:03.747 INFO:teuthology.orchestra.run.smithi045.stdout: -4062> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.747 INFO:teuthology.orchestra.run.smithi045.stdout: -4061> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.747 INFO:teuthology.orchestra.run.smithi045.stdout: -4060> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.747 INFO:teuthology.orchestra.run.smithi045.stdout: -4059> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005c4 [2,head] /dc-dir/dc-file_975 auth v5952 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.230341+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d786100] 2023-10-03T19:21:03.747 INFO:teuthology.orchestra.run.smithi045.stdout: -4058> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005c4 [2,head] /dc-dir/dc-file_975 auth v5952 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.230341+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d786100] 2023-10-03T19:21:03.747 INFO:teuthology.orchestra.run.smithi045.stdout: -4057> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.747 INFO:teuthology.orchestra.run.smithi045.stdout: -4056> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 388.674, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.89e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:780.3] 2023-10-03T19:21:03.747 INFO:teuthology.orchestra.run.smithi045.stdout: -4055> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576df52fc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5958 pv6006 ap=25 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=25) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=24) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 25 2023-10-03T19:21:03.748 INFO:teuthology.orchestra.run.smithi045.stdout: -4054> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5959 cv=5559/5559 REP dir_auth=0 ap=25+25 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576df52fc0 count now 25/25 2023-10-03T19:21:03.748 INFO:teuthology.orchestra.run.smithi045.stdout: -4053> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576df52fc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5953 cv=5553/5553 ap=25+25 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=200 | child=1 dirty=1 authpin=1 0x55576d056400] count now 25 2023-10-03T19:21:03.748 INFO:teuthology.orchestra.run.smithi045.stdout: -4052> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576df52fc0 on [dir 0x1 / [2,head] auth pv=6007 v=5959 cv=5559/5559 REP dir_auth=0 ap=24+25 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 24 2023-10-03T19:21:03.748 INFO:teuthology.orchestra.run.smithi045.stdout: -4051> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005c4) auth_unpin by 0x55576df52fc0 on [inode 0x100000005c4 [2,head] /dc-dir/dc-file_975 auth v5952 s=3 n(v0 rc2023-10-03T19:16:14.230341+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d786100] now 0 2023-10-03T19:21:03.748 INFO:teuthology.orchestra.run.smithi045.stdout: -4050> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5953 cv=5553/5553 ap=25+24 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=200 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576df52fc0 count now 25/24 2023-10-03T19:21:03.748 INFO:teuthology.orchestra.run.smithi045.stdout: -4049> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.748 INFO:teuthology.orchestra.run.smithi045.stdout: -4048> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.748 INFO:teuthology.orchestra.run.smithi045.stdout: -4047> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005c5 [2,head] /dc-dir/dc-file_976 auth v5166 pv5954 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.241714+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.241714+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d786680] 2023-10-03T19:21:03.748 INFO:teuthology.orchestra.run.smithi045.stdout: -4046> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5960 2023-10-03T19:21:03.748 INFO:teuthology.orchestra.run.smithi045.stdout: -4045> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5960 pv6006 ap=25 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=25) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=24) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.749 INFO:teuthology.orchestra.run.smithi045.stdout: -4044> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5958 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.749 INFO:teuthology.orchestra.run.smithi045.stdout: -4043> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5959 cv=5559/5559 REP dir_auth=0 ap=24+25 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5959 2023-10-03T19:21:03.749 INFO:teuthology.orchestra.run.smithi045.stdout: -4042> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005c5) pop_and_dirty_projected_inode v5954 2023-10-03T19:21:03.749 INFO:teuthology.orchestra.run.smithi045.stdout: -4041> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005c5) mark_dirty [inode 0x100000005c5 [2,head] /dc-dir/dc-file_976 auth v5954 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.241714+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d786680] 2023-10-03T19:21:03.749 INFO:teuthology.orchestra.run.smithi045.stdout: -4040> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_976) mark_dirty [dentry #0x1/dc-dir/dc-file_976 [2,head] auth (dversion lock) pv=5954 v=5166 ino=0x100000005c5 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d5fac80] 2023-10-03T19:21:03.749 INFO:teuthology.orchestra.run.smithi045.stdout: -4039> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5953 cv=5553/5553 ap=25+24 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=201 | child=1 dirty=1 authpin=1 0x55576d056400] version 5953 2023-10-03T19:21:03.749 INFO:teuthology.orchestra.run.smithi045.stdout: -4038> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576df54020 v5961 2023-10-03T19:21:03.749 INFO:teuthology.orchestra.run.smithi045.stdout: -4037> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5961 cv=5559/5559 REP dir_auth=0 ap=24+25 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5961 2023-10-03T19:21:03.749 INFO:teuthology.orchestra.run.smithi045.stdout: -4036> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576d04be80 v5955 2023-10-03T19:21:03.750 INFO:teuthology.orchestra.run.smithi045.stdout: -4035> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5955 cv=5553/5553 ap=25+24 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=201 | child=1 dirty=1 authpin=1 0x55576d056400] version 5955 2023-10-03T19:21:03.750 INFO:teuthology.orchestra.run.smithi045.stdout: -4034> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=24 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=24 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.750 INFO:teuthology.orchestra.run.smithi045.stdout: -4033> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=24) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5960 pv6006 ap=25 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=25) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=24) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.819 INFO:teuthology.orchestra.run.smithi045.stdout: -4032> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=25) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5960 pv6006 ap=25 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=25) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=23) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.819 INFO:teuthology.orchestra.run.smithi045.stdout: -4031> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005c5 [2,head] /dc-dir/dc-file_976 auth v5954 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.241714+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d786680] 2023-10-03T19:21:03.820 INFO:teuthology.orchestra.run.smithi045.stdout: -4030> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005c5 [2,head] /dc-dir/dc-file_976 auth v5954 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.241714+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d786680] 2023-10-03T19:21:03.820 INFO:teuthology.orchestra.run.smithi045.stdout: -4029> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.820 INFO:teuthology.orchestra.run.smithi045.stdout: -4028> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.820 INFO:teuthology.orchestra.run.smithi045.stdout: -4027> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.820 INFO:teuthology.orchestra.run.smithi045.stdout: -4026> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005c5 [2,head] /dc-dir/dc-file_976 auth v5954 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.241714+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d786680] 2023-10-03T19:21:03.820 INFO:teuthology.orchestra.run.smithi045.stdout: -4025> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005c5 [2,head] /dc-dir/dc-file_976 auth v5954 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.241714+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d786680] 2023-10-03T19:21:03.820 INFO:teuthology.orchestra.run.smithi045.stdout: -4024> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.820 INFO:teuthology.orchestra.run.smithi045.stdout: -4023> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 389.674, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.90e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:782.3] 2023-10-03T19:21:03.821 INFO:teuthology.orchestra.run.smithi045.stdout: -4022> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576df53440 on [dir 0x1 / [2,head] auth pv=6007 v=5961 cv=5559/5559 REP dir_auth=0 ap=23+25 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 23 2023-10-03T19:21:03.821 INFO:teuthology.orchestra.run.smithi045.stdout: -4021> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576df53440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5960 pv6006 ap=24 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=24) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=23) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 24 2023-10-03T19:21:03.821 INFO:teuthology.orchestra.run.smithi045.stdout: -4020> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5961 cv=5559/5559 REP dir_auth=0 ap=23+24 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576df53440 count now 23/24 2023-10-03T19:21:03.821 INFO:teuthology.orchestra.run.smithi045.stdout: -4019> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576df53440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5955 cv=5553/5553 ap=24+24 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=201 | child=1 dirty=1 authpin=1 0x55576d056400] count now 24 2023-10-03T19:21:03.821 INFO:teuthology.orchestra.run.smithi045.stdout: -4018> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005c5) auth_unpin by 0x55576df53440 on [inode 0x100000005c5 [2,head] /dc-dir/dc-file_976 auth v5954 s=3 n(v0 rc2023-10-03T19:16:14.241714+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d786680] now 0 2023-10-03T19:21:03.821 INFO:teuthology.orchestra.run.smithi045.stdout: -4017> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5955 cv=5553/5553 ap=24+23 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=201 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576df53440 count now 24/23 2023-10-03T19:21:03.821 INFO:teuthology.orchestra.run.smithi045.stdout: -4016> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.821 INFO:teuthology.orchestra.run.smithi045.stdout: -4015> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.822 INFO:teuthology.orchestra.run.smithi045.stdout: -4014> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005c6 [2,head] /dc-dir/dc-file_977 auth v5170 pv5956 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.253489+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.253489+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d786c00] 2023-10-03T19:21:03.822 INFO:teuthology.orchestra.run.smithi045.stdout: -4013> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5962 2023-10-03T19:21:03.822 INFO:teuthology.orchestra.run.smithi045.stdout: -4012> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5962 pv6006 ap=24 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=24) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=23) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.822 INFO:teuthology.orchestra.run.smithi045.stdout: -4011> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5960 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.822 INFO:teuthology.orchestra.run.smithi045.stdout: -4010> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5961 cv=5559/5559 REP dir_auth=0 ap=23+24 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5961 2023-10-03T19:21:03.822 INFO:teuthology.orchestra.run.smithi045.stdout: -4009> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005c6) pop_and_dirty_projected_inode v5956 2023-10-03T19:21:03.822 INFO:teuthology.orchestra.run.smithi045.stdout: -4008> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005c6) mark_dirty [inode 0x100000005c6 [2,head] /dc-dir/dc-file_977 auth v5956 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.253489+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d786c00] 2023-10-03T19:21:03.823 INFO:teuthology.orchestra.run.smithi045.stdout: -4007> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_977) mark_dirty [dentry #0x1/dc-dir/dc-file_977 [2,head] auth (dversion lock) pv=5956 v=5170 ino=0x100000005c6 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d5faf00] 2023-10-03T19:21:03.823 INFO:teuthology.orchestra.run.smithi045.stdout: -4006> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5955 cv=5553/5553 ap=24+23 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=202 | child=1 dirty=1 authpin=1 0x55576d056400] version 5955 2023-10-03T19:21:03.823 INFO:teuthology.orchestra.run.smithi045.stdout: -4005> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576df54260 v5963 2023-10-03T19:21:03.823 INFO:teuthology.orchestra.run.smithi045.stdout: -4004> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5963 cv=5559/5559 REP dir_auth=0 ap=23+24 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5963 2023-10-03T19:21:03.823 INFO:teuthology.orchestra.run.smithi045.stdout: -4003> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576df54140 v5957 2023-10-03T19:21:03.823 INFO:teuthology.orchestra.run.smithi045.stdout: -4002> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5957 cv=5553/5553 ap=24+23 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=202 | child=1 dirty=1 authpin=1 0x55576d056400] version 5957 2023-10-03T19:21:03.823 INFO:teuthology.orchestra.run.smithi045.stdout: -4001> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=23 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=23 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.823 INFO:teuthology.orchestra.run.smithi045.stdout: -4000> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=23) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5962 pv6006 ap=24 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=24) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=23) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.823 INFO:teuthology.orchestra.run.smithi045.stdout: -3999> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=24) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5962 pv6006 ap=24 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=24) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=22) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.824 INFO:teuthology.orchestra.run.smithi045.stdout: -3998> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005c6 [2,head] /dc-dir/dc-file_977 auth v5956 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.253489+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d786c00] 2023-10-03T19:21:03.824 INFO:teuthology.orchestra.run.smithi045.stdout: -3997> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005c6 [2,head] /dc-dir/dc-file_977 auth v5956 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.253489+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d786c00] 2023-10-03T19:21:03.824 INFO:teuthology.orchestra.run.smithi045.stdout: -3996> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.824 INFO:teuthology.orchestra.run.smithi045.stdout: -3995> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.824 INFO:teuthology.orchestra.run.smithi045.stdout: -3994> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.824 INFO:teuthology.orchestra.run.smithi045.stdout: -3993> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005c6 [2,head] /dc-dir/dc-file_977 auth v5956 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.253489+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d786c00] 2023-10-03T19:21:03.824 INFO:teuthology.orchestra.run.smithi045.stdout: -3992> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005c6 [2,head] /dc-dir/dc-file_977 auth v5956 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.253489+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d786c00] 2023-10-03T19:21:03.824 INFO:teuthology.orchestra.run.smithi045.stdout: -3991> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.825 INFO:teuthology.orchestra.run.smithi045.stdout: -3990> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 390.674, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.91e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:784.3] 2023-10-03T19:21:03.825 INFO:teuthology.orchestra.run.smithi045.stdout: -3989> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576df538c0 on [dir 0x1 / [2,head] auth pv=6007 v=5963 cv=5559/5559 REP dir_auth=0 ap=22+24 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 22 2023-10-03T19:21:03.825 INFO:teuthology.orchestra.run.smithi045.stdout: -3988> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576df538c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5962 pv6006 ap=23 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=23) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=22) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 23 2023-10-03T19:21:03.825 INFO:teuthology.orchestra.run.smithi045.stdout: -3987> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5963 cv=5559/5559 REP dir_auth=0 ap=22+23 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576df538c0 count now 22/23 2023-10-03T19:21:03.825 INFO:teuthology.orchestra.run.smithi045.stdout: -3986> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576df538c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5957 cv=5553/5553 ap=23+23 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=202 | child=1 dirty=1 authpin=1 0x55576d056400] count now 23 2023-10-03T19:21:03.825 INFO:teuthology.orchestra.run.smithi045.stdout: -3985> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005c6) auth_unpin by 0x55576df538c0 on [inode 0x100000005c6 [2,head] /dc-dir/dc-file_977 auth v5956 s=3 n(v0 rc2023-10-03T19:16:14.253489+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d786c00] now 0 2023-10-03T19:21:03.825 INFO:teuthology.orchestra.run.smithi045.stdout: -3984> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5957 cv=5553/5553 ap=23+22 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=202 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576df538c0 count now 23/22 2023-10-03T19:21:03.825 INFO:teuthology.orchestra.run.smithi045.stdout: -3983> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.825 INFO:teuthology.orchestra.run.smithi045.stdout: -3982> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.825 INFO:teuthology.orchestra.run.smithi045.stdout: -3981> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005c7 [2,head] /dc-dir/dc-file_978 auth v5174 pv5958 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.264541+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.264541+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d787180] 2023-10-03T19:21:03.826 INFO:teuthology.orchestra.run.smithi045.stdout: -3980> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5964 2023-10-03T19:21:03.826 INFO:teuthology.orchestra.run.smithi045.stdout: -3979> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5964 pv6006 ap=23 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=23) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=22) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.826 INFO:teuthology.orchestra.run.smithi045.stdout: -3978> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5962 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.826 INFO:teuthology.orchestra.run.smithi045.stdout: -3977> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5963 cv=5559/5559 REP dir_auth=0 ap=22+23 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5963 2023-10-03T19:21:03.826 INFO:teuthology.orchestra.run.smithi045.stdout: -3976> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005c7) pop_and_dirty_projected_inode v5958 2023-10-03T19:21:03.826 INFO:teuthology.orchestra.run.smithi045.stdout: -3975> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005c7) mark_dirty [inode 0x100000005c7 [2,head] /dc-dir/dc-file_978 auth v5958 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.264541+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d787180] 2023-10-03T19:21:03.826 INFO:teuthology.orchestra.run.smithi045.stdout: -3974> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_978) mark_dirty [dentry #0x1/dc-dir/dc-file_978 [2,head] auth (dversion lock) pv=5958 v=5174 ino=0x100000005c7 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d5fb180] 2023-10-03T19:21:03.864 INFO:teuthology.orchestra.run.smithi045.stdout: -3973> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5957 cv=5553/5553 ap=23+22 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=203 | child=1 dirty=1 authpin=1 0x55576d056400] version 5957 2023-10-03T19:21:03.864 INFO:teuthology.orchestra.run.smithi045.stdout: -3972> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576df544a0 v5965 2023-10-03T19:21:03.864 INFO:teuthology.orchestra.run.smithi045.stdout: -3971> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5965 cv=5559/5559 REP dir_auth=0 ap=22+23 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5965 2023-10-03T19:21:03.864 INFO:teuthology.orchestra.run.smithi045.stdout: -3970> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576df54380 v5959 2023-10-03T19:21:03.864 INFO:teuthology.orchestra.run.smithi045.stdout: -3969> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5959 cv=5553/5553 ap=23+22 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=203 | child=1 dirty=1 authpin=1 0x55576d056400] version 5959 2023-10-03T19:21:03.865 INFO:teuthology.orchestra.run.smithi045.stdout: -3968> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=22 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=22 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.865 INFO:teuthology.orchestra.run.smithi045.stdout: -3967> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=22) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5964 pv6006 ap=23 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=23) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=22) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.865 INFO:teuthology.orchestra.run.smithi045.stdout: -3966> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=23) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5964 pv6006 ap=23 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=23) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=21) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.865 INFO:teuthology.orchestra.run.smithi045.stdout: -3965> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005c7 [2,head] /dc-dir/dc-file_978 auth v5958 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.264541+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d787180] 2023-10-03T19:21:03.865 INFO:teuthology.orchestra.run.smithi045.stdout: -3964> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005c7 [2,head] /dc-dir/dc-file_978 auth v5958 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.264541+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d787180] 2023-10-03T19:21:03.865 INFO:teuthology.orchestra.run.smithi045.stdout: -3963> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.865 INFO:teuthology.orchestra.run.smithi045.stdout: -3962> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.865 INFO:teuthology.orchestra.run.smithi045.stdout: -3961> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.865 INFO:teuthology.orchestra.run.smithi045.stdout: -3960> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005c7 [2,head] /dc-dir/dc-file_978 auth v5958 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.264541+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d787180] 2023-10-03T19:21:03.866 INFO:teuthology.orchestra.run.smithi045.stdout: -3959> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005c7 [2,head] /dc-dir/dc-file_978 auth v5958 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.264541+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d787180] 2023-10-03T19:21:03.866 INFO:teuthology.orchestra.run.smithi045.stdout: -3958> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.866 INFO:teuthology.orchestra.run.smithi045.stdout: -3957> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 391.674, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.92e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:786.3] 2023-10-03T19:21:03.866 INFO:teuthology.orchestra.run.smithi045.stdout: -3956> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576df53d40 on [dir 0x1 / [2,head] auth pv=6007 v=5965 cv=5559/5559 REP dir_auth=0 ap=21+23 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 21 2023-10-03T19:21:03.866 INFO:teuthology.orchestra.run.smithi045.stdout: -3955> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576df53d40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5964 pv6006 ap=22 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=22) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=21) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 22 2023-10-03T19:21:03.866 INFO:teuthology.orchestra.run.smithi045.stdout: -3954> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5965 cv=5559/5559 REP dir_auth=0 ap=21+22 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576df53d40 count now 21/22 2023-10-03T19:21:03.866 INFO:teuthology.orchestra.run.smithi045.stdout: -3953> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576df53d40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5959 cv=5553/5553 ap=22+22 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=203 | child=1 dirty=1 authpin=1 0x55576d056400] count now 22 2023-10-03T19:21:03.866 INFO:teuthology.orchestra.run.smithi045.stdout: -3952> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005c7) auth_unpin by 0x55576df53d40 on [inode 0x100000005c7 [2,head] /dc-dir/dc-file_978 auth v5958 s=3 n(v0 rc2023-10-03T19:16:14.264541+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d787180] now 0 2023-10-03T19:21:03.866 INFO:teuthology.orchestra.run.smithi045.stdout: -3951> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5959 cv=5553/5553 ap=22+21 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=203 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576df53d40 count now 22/21 2023-10-03T19:21:03.867 INFO:teuthology.orchestra.run.smithi045.stdout: -3950> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.867 INFO:teuthology.orchestra.run.smithi045.stdout: -3949> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.867 INFO:teuthology.orchestra.run.smithi045.stdout: -3948> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005c8 [2,head] /dc-dir/dc-file_979 auth v5178 pv5960 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.276806+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.276806+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d787700] 2023-10-03T19:21:03.867 INFO:teuthology.orchestra.run.smithi045.stdout: -3947> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5966 2023-10-03T19:21:03.867 INFO:teuthology.orchestra.run.smithi045.stdout: -3946> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5966 pv6006 ap=22 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=22) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=21) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.867 INFO:teuthology.orchestra.run.smithi045.stdout: -3945> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5964 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.867 INFO:teuthology.orchestra.run.smithi045.stdout: -3944> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5965 cv=5559/5559 REP dir_auth=0 ap=21+22 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5965 2023-10-03T19:21:03.867 INFO:teuthology.orchestra.run.smithi045.stdout: -3943> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005c8) pop_and_dirty_projected_inode v5960 2023-10-03T19:21:03.868 INFO:teuthology.orchestra.run.smithi045.stdout: -3942> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005c8) mark_dirty [inode 0x100000005c8 [2,head] /dc-dir/dc-file_979 auth v5960 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.276806+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d787700] 2023-10-03T19:21:03.868 INFO:teuthology.orchestra.run.smithi045.stdout: -3941> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_979) mark_dirty [dentry #0x1/dc-dir/dc-file_979 [2,head] auth (dversion lock) pv=5960 v=5178 ino=0x100000005c8 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d5fb400] 2023-10-03T19:21:03.868 INFO:teuthology.orchestra.run.smithi045.stdout: -3940> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5959 cv=5553/5553 ap=22+21 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=204 | child=1 dirty=1 authpin=1 0x55576d056400] version 5959 2023-10-03T19:21:03.868 INFO:teuthology.orchestra.run.smithi045.stdout: -3939> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576df546e0 v5967 2023-10-03T19:21:03.868 INFO:teuthology.orchestra.run.smithi045.stdout: -3938> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5967 cv=5559/5559 REP dir_auth=0 ap=21+22 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5967 2023-10-03T19:21:03.868 INFO:teuthology.orchestra.run.smithi045.stdout: -3937> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576df545c0 v5961 2023-10-03T19:21:03.868 INFO:teuthology.orchestra.run.smithi045.stdout: -3936> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5961 cv=5553/5553 ap=22+21 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=204 | child=1 dirty=1 authpin=1 0x55576d056400] version 5961 2023-10-03T19:21:03.868 INFO:teuthology.orchestra.run.smithi045.stdout: -3935> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=21 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=21 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.868 INFO:teuthology.orchestra.run.smithi045.stdout: -3934> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=21) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5966 pv6006 ap=22 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=22) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=21) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.868 INFO:teuthology.orchestra.run.smithi045.stdout: -3933> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=22) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5966 pv6006 ap=22 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=22) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=20) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.869 INFO:teuthology.orchestra.run.smithi045.stdout: -3932> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005c8 [2,head] /dc-dir/dc-file_979 auth v5960 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.276806+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d787700] 2023-10-03T19:21:03.869 INFO:teuthology.orchestra.run.smithi045.stdout: -3931> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005c8 [2,head] /dc-dir/dc-file_979 auth v5960 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.276806+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d787700] 2023-10-03T19:21:03.869 INFO:teuthology.orchestra.run.smithi045.stdout: -3930> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.869 INFO:teuthology.orchestra.run.smithi045.stdout: -3929> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.869 INFO:teuthology.orchestra.run.smithi045.stdout: -3928> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.869 INFO:teuthology.orchestra.run.smithi045.stdout: -3927> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005c8 [2,head] /dc-dir/dc-file_979 auth v5960 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.276806+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d787700] 2023-10-03T19:21:03.869 INFO:teuthology.orchestra.run.smithi045.stdout: -3926> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005c8 [2,head] /dc-dir/dc-file_979 auth v5960 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.276806+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d787700] 2023-10-03T19:21:03.869 INFO:teuthology.orchestra.run.smithi045.stdout: -3925> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.869 INFO:teuthology.orchestra.run.smithi045.stdout: -3924> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 392.674, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.93e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:788.3] 2023-10-03T19:21:03.869 INFO:teuthology.orchestra.run.smithi045.stdout: -3923> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e9d8240 on [dir 0x1 / [2,head] auth pv=6007 v=5967 cv=5559/5559 REP dir_auth=0 ap=20+22 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 20 2023-10-03T19:21:03.870 INFO:teuthology.orchestra.run.smithi045.stdout: -3922> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e9d8240 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5966 pv6006 ap=21 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=21) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=20) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 21 2023-10-03T19:21:03.870 INFO:teuthology.orchestra.run.smithi045.stdout: -3921> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5967 cv=5559/5559 REP dir_auth=0 ap=20+21 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e9d8240 count now 20/21 2023-10-03T19:21:03.870 INFO:teuthology.orchestra.run.smithi045.stdout: -3920> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e9d8240 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5961 cv=5553/5553 ap=21+21 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=204 | child=1 dirty=1 authpin=1 0x55576d056400] count now 21 2023-10-03T19:21:03.870 INFO:teuthology.orchestra.run.smithi045.stdout: -3919> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005c8) auth_unpin by 0x55576e9d8240 on [inode 0x100000005c8 [2,head] /dc-dir/dc-file_979 auth v5960 s=3 n(v0 rc2023-10-03T19:16:14.276806+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d787700] now 0 2023-10-03T19:21:03.870 INFO:teuthology.orchestra.run.smithi045.stdout: -3918> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5961 cv=5553/5553 ap=21+20 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=204 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e9d8240 count now 21/20 2023-10-03T19:21:03.870 INFO:teuthology.orchestra.run.smithi045.stdout: -3917> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.870 INFO:teuthology.orchestra.run.smithi045.stdout: -3916> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.870 INFO:teuthology.orchestra.run.smithi045.stdout: -3915> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005c9 [2,head] /dc-dir/dc-file_980 auth v5182 pv5962 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.288396+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.288396+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d2ee000] 2023-10-03T19:21:03.878 INFO:teuthology.orchestra.run.smithi045.stdout: -3914> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5968 2023-10-03T19:21:03.878 INFO:teuthology.orchestra.run.smithi045.stdout: -3913> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5968 pv6006 ap=21 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=21) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=20) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.878 INFO:teuthology.orchestra.run.smithi045.stdout: -3912> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5966 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.878 INFO:teuthology.orchestra.run.smithi045.stdout: -3911> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5967 cv=5559/5559 REP dir_auth=0 ap=20+21 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5967 2023-10-03T19:21:03.878 INFO:teuthology.orchestra.run.smithi045.stdout: -3910> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005c9) pop_and_dirty_projected_inode v5962 2023-10-03T19:21:03.878 INFO:teuthology.orchestra.run.smithi045.stdout: -3909> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005c9) mark_dirty [inode 0x100000005c9 [2,head] /dc-dir/dc-file_980 auth v5962 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.288396+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d2ee000] 2023-10-03T19:21:03.879 INFO:teuthology.orchestra.run.smithi045.stdout: -3908> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_980) mark_dirty [dentry #0x1/dc-dir/dc-file_980 [2,head] auth (dversion lock) pv=5962 v=5182 ino=0x100000005c9 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d5fb680] 2023-10-03T19:21:03.879 INFO:teuthology.orchestra.run.smithi045.stdout: -3907> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5961 cv=5553/5553 ap=21+20 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=205 | child=1 dirty=1 authpin=1 0x55576d056400] version 5961 2023-10-03T19:21:03.879 INFO:teuthology.orchestra.run.smithi045.stdout: -3906> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576df54920 v5969 2023-10-03T19:21:03.879 INFO:teuthology.orchestra.run.smithi045.stdout: -3905> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5969 cv=5559/5559 REP dir_auth=0 ap=20+21 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5969 2023-10-03T19:21:03.879 INFO:teuthology.orchestra.run.smithi045.stdout: -3904> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576df54800 v5963 2023-10-03T19:21:03.879 INFO:teuthology.orchestra.run.smithi045.stdout: -3903> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5963 cv=5553/5553 ap=21+20 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=205 | child=1 dirty=1 authpin=1 0x55576d056400] version 5963 2023-10-03T19:21:03.879 INFO:teuthology.orchestra.run.smithi045.stdout: -3902> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=20 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=20 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.879 INFO:teuthology.orchestra.run.smithi045.stdout: -3901> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=20) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5968 pv6006 ap=21 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=21) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=20) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.880 INFO:teuthology.orchestra.run.smithi045.stdout: -3900> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=21) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5968 pv6006 ap=21 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=21) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=19) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.880 INFO:teuthology.orchestra.run.smithi045.stdout: -3899> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005c9 [2,head] /dc-dir/dc-file_980 auth v5962 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.288396+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2ee000] 2023-10-03T19:21:03.880 INFO:teuthology.orchestra.run.smithi045.stdout: -3898> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005c9 [2,head] /dc-dir/dc-file_980 auth v5962 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.288396+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2ee000] 2023-10-03T19:21:03.880 INFO:teuthology.orchestra.run.smithi045.stdout: -3897> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.880 INFO:teuthology.orchestra.run.smithi045.stdout: -3896> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.880 INFO:teuthology.orchestra.run.smithi045.stdout: -3895> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.880 INFO:teuthology.orchestra.run.smithi045.stdout: -3894> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005c9 [2,head] /dc-dir/dc-file_980 auth v5962 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.288396+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2ee000] 2023-10-03T19:21:03.880 INFO:teuthology.orchestra.run.smithi045.stdout: -3893> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005c9 [2,head] /dc-dir/dc-file_980 auth v5962 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.288396+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2ee000] 2023-10-03T19:21:03.880 INFO:teuthology.orchestra.run.smithi045.stdout: -3892> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.880 INFO:teuthology.orchestra.run.smithi045.stdout: -3891> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 393.674, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.94e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:790.3] 2023-10-03T19:21:03.881 INFO:teuthology.orchestra.run.smithi045.stdout: -3890> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e9d86c0 on [dir 0x1 / [2,head] auth pv=6007 v=5969 cv=5559/5559 REP dir_auth=0 ap=19+21 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 19 2023-10-03T19:21:03.881 INFO:teuthology.orchestra.run.smithi045.stdout: -3889> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e9d86c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5968 pv6006 ap=20 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=20) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=19) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 20 2023-10-03T19:21:03.881 INFO:teuthology.orchestra.run.smithi045.stdout: -3888> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5969 cv=5559/5559 REP dir_auth=0 ap=19+20 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e9d86c0 count now 19/20 2023-10-03T19:21:03.881 INFO:teuthology.orchestra.run.smithi045.stdout: -3887> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e9d86c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5963 cv=5553/5553 ap=20+20 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=205 | child=1 dirty=1 authpin=1 0x55576d056400] count now 20 2023-10-03T19:21:03.881 INFO:teuthology.orchestra.run.smithi045.stdout: -3886> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005c9) auth_unpin by 0x55576e9d86c0 on [inode 0x100000005c9 [2,head] /dc-dir/dc-file_980 auth v5962 s=3 n(v0 rc2023-10-03T19:16:14.288396+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d2ee000] now 0 2023-10-03T19:21:03.881 INFO:teuthology.orchestra.run.smithi045.stdout: -3885> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5963 cv=5553/5553 ap=20+19 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=205 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e9d86c0 count now 20/19 2023-10-03T19:21:03.881 INFO:teuthology.orchestra.run.smithi045.stdout: -3884> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.881 INFO:teuthology.orchestra.run.smithi045.stdout: -3883> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.881 INFO:teuthology.orchestra.run.smithi045.stdout: -3882> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005ca [2,head] /dc-dir/dc-file_981 auth v5186 pv5964 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.300414+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.300414+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d2ee580] 2023-10-03T19:21:03.881 INFO:teuthology.orchestra.run.smithi045.stdout: -3881> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5970 2023-10-03T19:21:03.882 INFO:teuthology.orchestra.run.smithi045.stdout: -3880> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5970 pv6006 ap=20 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=20) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=19) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.882 INFO:teuthology.orchestra.run.smithi045.stdout: -3879> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5968 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.882 INFO:teuthology.orchestra.run.smithi045.stdout: -3878> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5969 cv=5559/5559 REP dir_auth=0 ap=19+20 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5969 2023-10-03T19:21:03.882 INFO:teuthology.orchestra.run.smithi045.stdout: -3877> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005ca) pop_and_dirty_projected_inode v5964 2023-10-03T19:21:03.882 INFO:teuthology.orchestra.run.smithi045.stdout: -3876> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005ca) mark_dirty [inode 0x100000005ca [2,head] /dc-dir/dc-file_981 auth v5964 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.300414+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d2ee580] 2023-10-03T19:21:03.882 INFO:teuthology.orchestra.run.smithi045.stdout: -3875> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_981) mark_dirty [dentry #0x1/dc-dir/dc-file_981 [2,head] auth (dversion lock) pv=5964 v=5186 ino=0x100000005ca state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d5fb900] 2023-10-03T19:21:03.882 INFO:teuthology.orchestra.run.smithi045.stdout: -3874> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5963 cv=5553/5553 ap=20+19 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=206 | child=1 dirty=1 authpin=1 0x55576d056400] version 5963 2023-10-03T19:21:03.882 INFO:teuthology.orchestra.run.smithi045.stdout: -3873> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576df54b60 v5971 2023-10-03T19:21:03.882 INFO:teuthology.orchestra.run.smithi045.stdout: -3872> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5971 cv=5559/5559 REP dir_auth=0 ap=19+20 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5971 2023-10-03T19:21:03.895 INFO:teuthology.orchestra.run.smithi045.stdout: -3871> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576df54a40 v5965 2023-10-03T19:21:03.895 INFO:teuthology.orchestra.run.smithi045.stdout: -3870> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5965 cv=5553/5553 ap=20+19 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=206 | child=1 dirty=1 authpin=1 0x55576d056400] version 5965 2023-10-03T19:21:03.895 INFO:teuthology.orchestra.run.smithi045.stdout: -3869> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=19 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=19 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.896 INFO:teuthology.orchestra.run.smithi045.stdout: -3868> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=19) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5970 pv6006 ap=20 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=20) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=19) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.896 INFO:teuthology.orchestra.run.smithi045.stdout: -3867> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=20) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5970 pv6006 ap=20 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=20) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=18) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.896 INFO:teuthology.orchestra.run.smithi045.stdout: -3866> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005ca [2,head] /dc-dir/dc-file_981 auth v5964 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.300414+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2ee580] 2023-10-03T19:21:03.896 INFO:teuthology.orchestra.run.smithi045.stdout: -3865> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005ca [2,head] /dc-dir/dc-file_981 auth v5964 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.300414+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2ee580] 2023-10-03T19:21:03.896 INFO:teuthology.orchestra.run.smithi045.stdout: -3864> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.896 INFO:teuthology.orchestra.run.smithi045.stdout: -3863> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.896 INFO:teuthology.orchestra.run.smithi045.stdout: -3862> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.896 INFO:teuthology.orchestra.run.smithi045.stdout: -3861> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005ca [2,head] /dc-dir/dc-file_981 auth v5964 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.300414+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2ee580] 2023-10-03T19:21:03.896 INFO:teuthology.orchestra.run.smithi045.stdout: -3860> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005ca [2,head] /dc-dir/dc-file_981 auth v5964 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.300414+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2ee580] 2023-10-03T19:21:03.897 INFO:teuthology.orchestra.run.smithi045.stdout: -3859> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.897 INFO:teuthology.orchestra.run.smithi045.stdout: -3858> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 394.674, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.95e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:792.3] 2023-10-03T19:21:03.897 INFO:teuthology.orchestra.run.smithi045.stdout: -3857> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e9d8b40 on [dir 0x1 / [2,head] auth pv=6007 v=5971 cv=5559/5559 REP dir_auth=0 ap=18+20 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 18 2023-10-03T19:21:03.897 INFO:teuthology.orchestra.run.smithi045.stdout: -3856> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e9d8b40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5970 pv6006 ap=19 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=19) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=18) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 19 2023-10-03T19:21:03.897 INFO:teuthology.orchestra.run.smithi045.stdout: -3855> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5971 cv=5559/5559 REP dir_auth=0 ap=18+19 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e9d8b40 count now 18/19 2023-10-03T19:21:03.897 INFO:teuthology.orchestra.run.smithi045.stdout: -3854> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e9d8b40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5965 cv=5553/5553 ap=19+19 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=206 | child=1 dirty=1 authpin=1 0x55576d056400] count now 19 2023-10-03T19:21:03.897 INFO:teuthology.orchestra.run.smithi045.stdout: -3853> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005ca) auth_unpin by 0x55576e9d8b40 on [inode 0x100000005ca [2,head] /dc-dir/dc-file_981 auth v5964 s=3 n(v0 rc2023-10-03T19:16:14.300414+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d2ee580] now 0 2023-10-03T19:21:03.897 INFO:teuthology.orchestra.run.smithi045.stdout: -3852> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5965 cv=5553/5553 ap=19+18 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=206 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e9d8b40 count now 19/18 2023-10-03T19:21:03.897 INFO:teuthology.orchestra.run.smithi045.stdout: -3851> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.898 INFO:teuthology.orchestra.run.smithi045.stdout: -3850> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.898 INFO:teuthology.orchestra.run.smithi045.stdout: -3849> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005cb [2,head] /dc-dir/dc-file_982 auth v5190 pv5966 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.311690+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.311690+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d2eeb00] 2023-10-03T19:21:03.898 INFO:teuthology.orchestra.run.smithi045.stdout: -3848> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5972 2023-10-03T19:21:03.898 INFO:teuthology.orchestra.run.smithi045.stdout: -3847> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5972 pv6006 ap=19 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=19) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=18) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.898 INFO:teuthology.orchestra.run.smithi045.stdout: -3846> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5970 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.898 INFO:teuthology.orchestra.run.smithi045.stdout: -3845> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5971 cv=5559/5559 REP dir_auth=0 ap=18+19 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5971 2023-10-03T19:21:03.898 INFO:teuthology.orchestra.run.smithi045.stdout: -3844> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005cb) pop_and_dirty_projected_inode v5966 2023-10-03T19:21:03.898 INFO:teuthology.orchestra.run.smithi045.stdout: -3843> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005cb) mark_dirty [inode 0x100000005cb [2,head] /dc-dir/dc-file_982 auth v5966 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.311690+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d2eeb00] 2023-10-03T19:21:03.898 INFO:teuthology.orchestra.run.smithi045.stdout: -3842> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_982) mark_dirty [dentry #0x1/dc-dir/dc-file_982 [2,head] auth (dversion lock) pv=5966 v=5190 ino=0x100000005cb state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d5fbb80] 2023-10-03T19:21:03.898 INFO:teuthology.orchestra.run.smithi045.stdout: -3841> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5965 cv=5553/5553 ap=19+18 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=207 | child=1 dirty=1 authpin=1 0x55576d056400] version 5965 2023-10-03T19:21:03.899 INFO:teuthology.orchestra.run.smithi045.stdout: -3840> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576df54da0 v5973 2023-10-03T19:21:03.899 INFO:teuthology.orchestra.run.smithi045.stdout: -3839> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5973 cv=5559/5559 REP dir_auth=0 ap=18+19 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5973 2023-10-03T19:21:03.899 INFO:teuthology.orchestra.run.smithi045.stdout: -3838> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576df54c80 v5967 2023-10-03T19:21:03.899 INFO:teuthology.orchestra.run.smithi045.stdout: -3837> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5967 cv=5553/5553 ap=19+18 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=207 | child=1 dirty=1 authpin=1 0x55576d056400] version 5967 2023-10-03T19:21:03.899 INFO:teuthology.orchestra.run.smithi045.stdout: -3836> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=18 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=18 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.899 INFO:teuthology.orchestra.run.smithi045.stdout: -3835> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=18) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5972 pv6006 ap=19 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=19) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=18) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.899 INFO:teuthology.orchestra.run.smithi045.stdout: -3834> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=19) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5972 pv6006 ap=19 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=19) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=17) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.899 INFO:teuthology.orchestra.run.smithi045.stdout: -3833> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005cb [2,head] /dc-dir/dc-file_982 auth v5966 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.311690+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2eeb00] 2023-10-03T19:21:03.899 INFO:teuthology.orchestra.run.smithi045.stdout: -3832> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005cb [2,head] /dc-dir/dc-file_982 auth v5966 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.311690+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2eeb00] 2023-10-03T19:21:03.899 INFO:teuthology.orchestra.run.smithi045.stdout: -3831> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.900 INFO:teuthology.orchestra.run.smithi045.stdout: -3830> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.900 INFO:teuthology.orchestra.run.smithi045.stdout: -3829> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.900 INFO:teuthology.orchestra.run.smithi045.stdout: -3828> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005cb [2,head] /dc-dir/dc-file_982 auth v5966 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.311690+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2eeb00] 2023-10-03T19:21:03.900 INFO:teuthology.orchestra.run.smithi045.stdout: -3827> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005cb [2,head] /dc-dir/dc-file_982 auth v5966 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.311690+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2eeb00] 2023-10-03T19:21:03.900 INFO:teuthology.orchestra.run.smithi045.stdout: -3826> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.900 INFO:teuthology.orchestra.run.smithi045.stdout: -3825> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 395.674, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.96e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:794.3] 2023-10-03T19:21:03.900 INFO:teuthology.orchestra.run.smithi045.stdout: -3824> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e9d8fc0 on [dir 0x1 / [2,head] auth pv=6007 v=5973 cv=5559/5559 REP dir_auth=0 ap=17+19 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 17 2023-10-03T19:21:03.900 INFO:teuthology.orchestra.run.smithi045.stdout: -3823> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e9d8fc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5972 pv6006 ap=18 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=18) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=17) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 18 2023-10-03T19:21:03.901 INFO:teuthology.orchestra.run.smithi045.stdout: -3822> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5973 cv=5559/5559 REP dir_auth=0 ap=17+18 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e9d8fc0 count now 17/18 2023-10-03T19:21:03.901 INFO:teuthology.orchestra.run.smithi045.stdout: -3821> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e9d8fc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5967 cv=5553/5553 ap=18+18 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=207 | child=1 dirty=1 authpin=1 0x55576d056400] count now 18 2023-10-03T19:21:03.901 INFO:teuthology.orchestra.run.smithi045.stdout: -3820> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005cb) auth_unpin by 0x55576e9d8fc0 on [inode 0x100000005cb [2,head] /dc-dir/dc-file_982 auth v5966 s=3 n(v0 rc2023-10-03T19:16:14.311690+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d2eeb00] now 0 2023-10-03T19:21:03.901 INFO:teuthology.orchestra.run.smithi045.stdout: -3819> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5967 cv=5553/5553 ap=18+17 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=207 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e9d8fc0 count now 18/17 2023-10-03T19:21:03.901 INFO:teuthology.orchestra.run.smithi045.stdout: -3818> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.901 INFO:teuthology.orchestra.run.smithi045.stdout: -3817> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.901 INFO:teuthology.orchestra.run.smithi045.stdout: -3816> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005cc [2,head] /dc-dir/dc-file_983 auth v5194 pv5968 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.322972+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.322972+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d2ef080] 2023-10-03T19:21:03.901 INFO:teuthology.orchestra.run.smithi045.stdout: -3815> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5974 2023-10-03T19:21:03.901 INFO:teuthology.orchestra.run.smithi045.stdout: -3814> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5974 pv6006 ap=18 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=18) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=17) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.901 INFO:teuthology.orchestra.run.smithi045.stdout: -3813> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5972 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.901 INFO:teuthology.orchestra.run.smithi045.stdout: -3812> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5973 cv=5559/5559 REP dir_auth=0 ap=17+18 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5973 2023-10-03T19:21:03.902 INFO:teuthology.orchestra.run.smithi045.stdout: -3811> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005cc) pop_and_dirty_projected_inode v5968 2023-10-03T19:21:03.902 INFO:teuthology.orchestra.run.smithi045.stdout: -3810> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005cc) mark_dirty [inode 0x100000005cc [2,head] /dc-dir/dc-file_983 auth v5968 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.322972+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d2ef080] 2023-10-03T19:21:03.902 INFO:teuthology.orchestra.run.smithi045.stdout: -3809> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_983) mark_dirty [dentry #0x1/dc-dir/dc-file_983 [2,head] auth (dversion lock) pv=5968 v=5194 ino=0x100000005cc state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d78a000] 2023-10-03T19:21:03.902 INFO:teuthology.orchestra.run.smithi045.stdout: -3808> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5967 cv=5553/5553 ap=18+17 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=208 | child=1 dirty=1 authpin=1 0x55576d056400] version 5967 2023-10-03T19:21:03.902 INFO:teuthology.orchestra.run.smithi045.stdout: -3807> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576df54fe0 v5975 2023-10-03T19:21:03.902 INFO:teuthology.orchestra.run.smithi045.stdout: -3806> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5975 cv=5559/5559 REP dir_auth=0 ap=17+18 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5975 2023-10-03T19:21:03.902 INFO:teuthology.orchestra.run.smithi045.stdout: -3805> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576df54ec0 v5969 2023-10-03T19:21:03.902 INFO:teuthology.orchestra.run.smithi045.stdout: -3804> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5969 cv=5553/5553 ap=18+17 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=208 | child=1 dirty=1 authpin=1 0x55576d056400] version 5969 2023-10-03T19:21:03.902 INFO:teuthology.orchestra.run.smithi045.stdout: -3803> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=17 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=17 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.903 INFO:teuthology.orchestra.run.smithi045.stdout: -3802> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=17) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5974 pv6006 ap=18 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=18) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=17) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.903 INFO:teuthology.orchestra.run.smithi045.stdout: -3801> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=18) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5974 pv6006 ap=18 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=18) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=16) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.903 INFO:teuthology.orchestra.run.smithi045.stdout: -3800> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005cc [2,head] /dc-dir/dc-file_983 auth v5968 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.322972+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2ef080] 2023-10-03T19:21:03.903 INFO:teuthology.orchestra.run.smithi045.stdout: -3799> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005cc [2,head] /dc-dir/dc-file_983 auth v5968 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.322972+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2ef080] 2023-10-03T19:21:03.903 INFO:teuthology.orchestra.run.smithi045.stdout: -3798> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.903 INFO:teuthology.orchestra.run.smithi045.stdout: -3797> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.903 INFO:teuthology.orchestra.run.smithi045.stdout: -3796> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.903 INFO:teuthology.orchestra.run.smithi045.stdout: -3795> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005cc [2,head] /dc-dir/dc-file_983 auth v5968 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.322972+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2ef080] 2023-10-03T19:21:03.903 INFO:teuthology.orchestra.run.smithi045.stdout: -3794> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005cc [2,head] /dc-dir/dc-file_983 auth v5968 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.322972+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2ef080] 2023-10-03T19:21:03.903 INFO:teuthology.orchestra.run.smithi045.stdout: -3793> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.903 INFO:teuthology.orchestra.run.smithi045.stdout: -3792> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 396.674, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.97e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:796.3] 2023-10-03T19:21:03.904 INFO:teuthology.orchestra.run.smithi045.stdout: -3791> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e9d9440 on [dir 0x1 / [2,head] auth pv=6007 v=5975 cv=5559/5559 REP dir_auth=0 ap=16+18 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 16 2023-10-03T19:21:03.904 INFO:teuthology.orchestra.run.smithi045.stdout: -3790> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e9d9440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5974 pv6006 ap=17 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=17) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=16) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 17 2023-10-03T19:21:03.904 INFO:teuthology.orchestra.run.smithi045.stdout: -3789> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5975 cv=5559/5559 REP dir_auth=0 ap=16+17 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e9d9440 count now 16/17 2023-10-03T19:21:03.904 INFO:teuthology.orchestra.run.smithi045.stdout: -3788> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e9d9440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5969 cv=5553/5553 ap=17+17 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=208 | child=1 dirty=1 authpin=1 0x55576d056400] count now 17 2023-10-03T19:21:03.904 INFO:teuthology.orchestra.run.smithi045.stdout: -3787> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005cc) auth_unpin by 0x55576e9d9440 on [inode 0x100000005cc [2,head] /dc-dir/dc-file_983 auth v5968 s=3 n(v0 rc2023-10-03T19:16:14.322972+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d2ef080] now 0 2023-10-03T19:21:03.904 INFO:teuthology.orchestra.run.smithi045.stdout: -3786> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5969 cv=5553/5553 ap=17+16 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=208 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e9d9440 count now 17/16 2023-10-03T19:21:03.904 INFO:teuthology.orchestra.run.smithi045.stdout: -3785> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.905 INFO:teuthology.orchestra.run.smithi045.stdout: -3784> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.905 INFO:teuthology.orchestra.run.smithi045.stdout: -3783> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005cd [2,head] /dc-dir/dc-file_984 auth v5198 pv5970 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.333889+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.333889+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d2ef600] 2023-10-03T19:21:03.905 INFO:teuthology.orchestra.run.smithi045.stdout: -3782> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5976 2023-10-03T19:21:03.905 INFO:teuthology.orchestra.run.smithi045.stdout: -3781> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5976 pv6006 ap=17 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=17) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=16) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.905 INFO:teuthology.orchestra.run.smithi045.stdout: -3780> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5974 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.905 INFO:teuthology.orchestra.run.smithi045.stdout: -3779> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5975 cv=5559/5559 REP dir_auth=0 ap=16+17 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5975 2023-10-03T19:21:03.905 INFO:teuthology.orchestra.run.smithi045.stdout: -3778> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005cd) pop_and_dirty_projected_inode v5970 2023-10-03T19:21:03.905 INFO:teuthology.orchestra.run.smithi045.stdout: -3777> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005cd) mark_dirty [inode 0x100000005cd [2,head] /dc-dir/dc-file_984 auth v5970 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.333889+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d2ef600] 2023-10-03T19:21:03.905 INFO:teuthology.orchestra.run.smithi045.stdout: -3776> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_984) mark_dirty [dentry #0x1/dc-dir/dc-file_984 [2,head] auth (dversion lock) pv=5970 v=5198 ino=0x100000005cd state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d78a280] 2023-10-03T19:21:03.905 INFO:teuthology.orchestra.run.smithi045.stdout: -3775> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5969 cv=5553/5553 ap=17+16 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=209 | child=1 dirty=1 authpin=1 0x55576d056400] version 5969 2023-10-03T19:21:03.906 INFO:teuthology.orchestra.run.smithi045.stdout: -3774> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576df55220 v5977 2023-10-03T19:21:03.906 INFO:teuthology.orchestra.run.smithi045.stdout: -3773> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5977 cv=5559/5559 REP dir_auth=0 ap=16+17 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5977 2023-10-03T19:21:03.906 INFO:teuthology.orchestra.run.smithi045.stdout: -3772> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576df55100 v5971 2023-10-03T19:21:03.906 INFO:teuthology.orchestra.run.smithi045.stdout: -3771> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5971 cv=5553/5553 ap=17+16 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=209 | child=1 dirty=1 authpin=1 0x55576d056400] version 5971 2023-10-03T19:21:03.906 INFO:teuthology.orchestra.run.smithi045.stdout: -3770> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=16 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=16 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:03.906 INFO:teuthology.orchestra.run.smithi045.stdout: -3769> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=16) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5976 pv6006 ap=17 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=17) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=16) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.906 INFO:teuthology.orchestra.run.smithi045.stdout: -3768> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=17) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5976 pv6006 ap=17 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=17) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=15) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.906 INFO:teuthology.orchestra.run.smithi045.stdout: -3767> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005cd [2,head] /dc-dir/dc-file_984 auth v5970 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.333889+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2ef600] 2023-10-03T19:21:03.906 INFO:teuthology.orchestra.run.smithi045.stdout: -3766> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005cd [2,head] /dc-dir/dc-file_984 auth v5970 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.333889+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2ef600] 2023-10-03T19:21:03.907 INFO:teuthology.orchestra.run.smithi045.stdout: -3765> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:03.907 INFO:teuthology.orchestra.run.smithi045.stdout: -3764> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:03.907 INFO:teuthology.orchestra.run.smithi045.stdout: -3763> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:03.907 INFO:teuthology.orchestra.run.smithi045.stdout: -3762> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005cd [2,head] /dc-dir/dc-file_984 auth v5970 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.333889+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2ef600] 2023-10-03T19:21:03.907 INFO:teuthology.orchestra.run.smithi045.stdout: -3761> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005cd [2,head] /dc-dir/dc-file_984 auth v5970 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.333889+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2ef600] 2023-10-03T19:21:03.907 INFO:teuthology.orchestra.run.smithi045.stdout: -3760> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:03.907 INFO:teuthology.orchestra.run.smithi045.stdout: -3759> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 397.674, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.98e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:798.3] 2023-10-03T19:21:03.907 INFO:teuthology.orchestra.run.smithi045.stdout: -3758> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e9d98c0 on [dir 0x1 / [2,head] auth pv=6007 v=5977 cv=5559/5559 REP dir_auth=0 ap=15+17 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 15 2023-10-03T19:21:03.907 INFO:teuthology.orchestra.run.smithi045.stdout: -3757> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e9d98c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5971 cv=5553/5553 ap=16+16 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=209 | child=1 dirty=1 authpin=1 0x55576d056400] count now 16 2023-10-03T19:21:03.907 INFO:teuthology.orchestra.run.smithi045.stdout: -3756> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e9d98c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5976 pv6006 ap=16 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=16) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=15) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 16 2023-10-03T19:21:03.908 INFO:teuthology.orchestra.run.smithi045.stdout: -3755> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5977 cv=5559/5559 REP dir_auth=0 ap=15+16 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e9d98c0 count now 15/16 2023-10-03T19:21:03.908 INFO:teuthology.orchestra.run.smithi045.stdout: -3754> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005cd) auth_unpin by 0x55576e9d98c0 on [inode 0x100000005cd [2,head] /dc-dir/dc-file_984 auth v5970 s=3 n(v0 rc2023-10-03T19:16:14.333889+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d2ef600] now 0 2023-10-03T19:21:03.908 INFO:teuthology.orchestra.run.smithi045.stdout: -3753> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5971 cv=5553/5553 ap=16+15 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=209 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e9d98c0 count now 16/15 2023-10-03T19:21:03.908 INFO:teuthology.orchestra.run.smithi045.stdout: -3752> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.908 INFO:teuthology.orchestra.run.smithi045.stdout: -3751> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:03.908 INFO:teuthology.orchestra.run.smithi045.stdout: -3750> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005ce [2,head] /dc-dir/dc-file_985 auth v5202 pv5972 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.347410+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.347410+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d2efb80] 2023-10-03T19:21:03.908 INFO:teuthology.orchestra.run.smithi045.stdout: -3749> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5978 2023-10-03T19:21:03.908 INFO:teuthology.orchestra.run.smithi045.stdout: -3748> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5978 pv6006 ap=16 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=16) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=15) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:03.908 INFO:teuthology.orchestra.run.smithi045.stdout: -3747> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5976 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:03.908 INFO:teuthology.orchestra.run.smithi045.stdout: -3746> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5977 cv=5559/5559 REP dir_auth=0 ap=15+16 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5977 2023-10-03T19:21:04.006 INFO:teuthology.orchestra.run.smithi045.stdout: -3745> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005ce) pop_and_dirty_projected_inode v5972 2023-10-03T19:21:04.006 INFO:teuthology.orchestra.run.smithi045.stdout: -3744> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005ce) mark_dirty [inode 0x100000005ce [2,head] /dc-dir/dc-file_985 auth v5972 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.347410+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d2efb80] 2023-10-03T19:21:04.006 INFO:teuthology.orchestra.run.smithi045.stdout: -3743> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_985) mark_dirty [dentry #0x1/dc-dir/dc-file_985 [2,head] auth (dversion lock) pv=5972 v=5202 ino=0x100000005ce state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d78a500] 2023-10-03T19:21:04.007 INFO:teuthology.orchestra.run.smithi045.stdout: -3742> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5971 cv=5553/5553 ap=16+15 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=210 | child=1 dirty=1 authpin=1 0x55576d056400] version 5971 2023-10-03T19:21:04.007 INFO:teuthology.orchestra.run.smithi045.stdout: -3741> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576df55460 v5979 2023-10-03T19:21:04.007 INFO:teuthology.orchestra.run.smithi045.stdout: -3740> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5979 cv=5559/5559 REP dir_auth=0 ap=15+16 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5979 2023-10-03T19:21:04.007 INFO:teuthology.orchestra.run.smithi045.stdout: -3739> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576df55340 v5973 2023-10-03T19:21:04.008 INFO:teuthology.orchestra.run.smithi045.stdout: -3738> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5973 cv=5553/5553 ap=16+15 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=210 | child=1 dirty=1 authpin=1 0x55576d056400] version 5973 2023-10-03T19:21:04.008 INFO:teuthology.orchestra.run.smithi045.stdout: -3737> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=15 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=15 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:04.008 INFO:teuthology.orchestra.run.smithi045.stdout: -3736> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=15) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5978 pv6006 ap=16 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=16) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=15) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.008 INFO:teuthology.orchestra.run.smithi045.stdout: -3735> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=16) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5978 pv6006 ap=16 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=16) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=14) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.008 INFO:teuthology.orchestra.run.smithi045.stdout: -3734> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005ce [2,head] /dc-dir/dc-file_985 auth v5972 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.347410+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2efb80] 2023-10-03T19:21:04.009 INFO:teuthology.orchestra.run.smithi045.stdout: -3733> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005ce [2,head] /dc-dir/dc-file_985 auth v5972 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.347410+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2efb80] 2023-10-03T19:21:04.009 INFO:teuthology.orchestra.run.smithi045.stdout: -3732> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:04.009 INFO:teuthology.orchestra.run.smithi045.stdout: -3731> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:04.009 INFO:teuthology.orchestra.run.smithi045.stdout: -3730> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:04.010 INFO:teuthology.orchestra.run.smithi045.stdout: -3729> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005ce [2,head] /dc-dir/dc-file_985 auth v5972 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.347410+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2efb80] 2023-10-03T19:21:04.010 INFO:teuthology.orchestra.run.smithi045.stdout: -3728> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005ce [2,head] /dc-dir/dc-file_985 auth v5972 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.347410+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2efb80] 2023-10-03T19:21:04.010 INFO:teuthology.orchestra.run.smithi045.stdout: -3727> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:04.010 INFO:teuthology.orchestra.run.smithi045.stdout: -3726> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 398.674, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 3.99e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:800.3] 2023-10-03T19:21:04.010 INFO:teuthology.orchestra.run.smithi045.stdout: -3725> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e9d9d40 on [dir 0x1 / [2,head] auth pv=6007 v=5979 cv=5559/5559 REP dir_auth=0 ap=14+16 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 14 2023-10-03T19:21:04.011 INFO:teuthology.orchestra.run.smithi045.stdout: -3724> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e9d9d40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5978 pv6006 ap=15 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=15) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=14) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 15 2023-10-03T19:21:04.011 INFO:teuthology.orchestra.run.smithi045.stdout: -3723> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5979 cv=5559/5559 REP dir_auth=0 ap=14+15 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e9d9d40 count now 14/15 2023-10-03T19:21:04.011 INFO:teuthology.orchestra.run.smithi045.stdout: -3722> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e9d9d40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5973 cv=5553/5553 ap=15+15 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=210 | child=1 dirty=1 authpin=1 0x55576d056400] count now 15 2023-10-03T19:21:04.011 INFO:teuthology.orchestra.run.smithi045.stdout: -3721> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005ce) auth_unpin by 0x55576e9d9d40 on [inode 0x100000005ce [2,head] /dc-dir/dc-file_985 auth v5972 s=3 n(v0 rc2023-10-03T19:16:14.347410+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d2efb80] now 0 2023-10-03T19:21:04.012 INFO:teuthology.orchestra.run.smithi045.stdout: -3720> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5973 cv=5553/5553 ap=15+14 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=210 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e9d9d40 count now 15/14 2023-10-03T19:21:04.012 INFO:teuthology.orchestra.run.smithi045.stdout: -3719> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:04.012 INFO:teuthology.orchestra.run.smithi045.stdout: -3718> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:04.012 INFO:teuthology.orchestra.run.smithi045.stdout: -3717> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005cf [2,head] /dc-dir/dc-file_986 auth v5206 pv5974 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.358977+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.358977+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d2f0100] 2023-10-03T19:21:04.012 INFO:teuthology.orchestra.run.smithi045.stdout: -3716> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5980 2023-10-03T19:21:04.012 INFO:teuthology.orchestra.run.smithi045.stdout: -3715> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5980 pv6006 ap=15 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=15) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=14) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.012 INFO:teuthology.orchestra.run.smithi045.stdout: -3714> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5978 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:04.012 INFO:teuthology.orchestra.run.smithi045.stdout: -3713> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5979 cv=5559/5559 REP dir_auth=0 ap=14+15 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5979 2023-10-03T19:21:04.013 INFO:teuthology.orchestra.run.smithi045.stdout: -3712> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005cf) pop_and_dirty_projected_inode v5974 2023-10-03T19:21:04.013 INFO:teuthology.orchestra.run.smithi045.stdout: -3711> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005cf) mark_dirty [inode 0x100000005cf [2,head] /dc-dir/dc-file_986 auth v5974 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.358977+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d2f0100] 2023-10-03T19:21:04.013 INFO:teuthology.orchestra.run.smithi045.stdout: -3710> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_986) mark_dirty [dentry #0x1/dc-dir/dc-file_986 [2,head] auth (dversion lock) pv=5974 v=5206 ino=0x100000005cf state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d78a780] 2023-10-03T19:21:04.013 INFO:teuthology.orchestra.run.smithi045.stdout: -3709> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5973 cv=5553/5553 ap=15+14 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=211 | child=1 dirty=1 authpin=1 0x55576d056400] version 5973 2023-10-03T19:21:04.013 INFO:teuthology.orchestra.run.smithi045.stdout: -3708> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576df556a0 v5981 2023-10-03T19:21:04.013 INFO:teuthology.orchestra.run.smithi045.stdout: -3707> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5981 cv=5559/5559 REP dir_auth=0 ap=14+15 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5981 2023-10-03T19:21:04.013 INFO:teuthology.orchestra.run.smithi045.stdout: -3706> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576df55580 v5975 2023-10-03T19:21:04.013 INFO:teuthology.orchestra.run.smithi045.stdout: -3705> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5975 cv=5553/5553 ap=15+14 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=211 | child=1 dirty=1 authpin=1 0x55576d056400] version 5975 2023-10-03T19:21:04.013 INFO:teuthology.orchestra.run.smithi045.stdout: -3704> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=14 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=14 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:04.013 INFO:teuthology.orchestra.run.smithi045.stdout: -3703> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=14) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5980 pv6006 ap=15 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=15) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=14) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.014 INFO:teuthology.orchestra.run.smithi045.stdout: -3702> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=15) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5980 pv6006 ap=15 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=15) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=13) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.014 INFO:teuthology.orchestra.run.smithi045.stdout: -3701> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005cf [2,head] /dc-dir/dc-file_986 auth v5974 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.358977+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2f0100] 2023-10-03T19:21:04.014 INFO:teuthology.orchestra.run.smithi045.stdout: -3700> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005cf [2,head] /dc-dir/dc-file_986 auth v5974 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.358977+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2f0100] 2023-10-03T19:21:04.014 INFO:teuthology.orchestra.run.smithi045.stdout: -3699> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:04.014 INFO:teuthology.orchestra.run.smithi045.stdout: -3698> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:04.019 INFO:teuthology.orchestra.run.smithi045.stdout: -3697> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:04.019 INFO:teuthology.orchestra.run.smithi045.stdout: -3696> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005cf [2,head] /dc-dir/dc-file_986 auth v5974 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.358977+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2f0100] 2023-10-03T19:21:04.019 INFO:teuthology.orchestra.run.smithi045.stdout: -3695> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005cf [2,head] /dc-dir/dc-file_986 auth v5974 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.358977+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2f0100] 2023-10-03T19:21:04.019 INFO:teuthology.orchestra.run.smithi045.stdout: -3694> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:04.020 INFO:teuthology.orchestra.run.smithi045.stdout: -3693> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 399.674, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 4.00e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:802.3] 2023-10-03T19:21:04.020 INFO:teuthology.orchestra.run.smithi045.stdout: -3692> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e9d8480 on [dir 0x1 / [2,head] auth pv=6007 v=5981 cv=5559/5559 REP dir_auth=0 ap=13+15 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 13 2023-10-03T19:21:04.020 INFO:teuthology.orchestra.run.smithi045.stdout: -3691> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e9d8480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5980 pv6006 ap=14 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=14) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=13) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 14 2023-10-03T19:21:04.020 INFO:teuthology.orchestra.run.smithi045.stdout: -3690> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5981 cv=5559/5559 REP dir_auth=0 ap=13+14 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e9d8480 count now 13/14 2023-10-03T19:21:04.020 INFO:teuthology.orchestra.run.smithi045.stdout: -3689> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e9d8480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5975 cv=5553/5553 ap=14+14 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=211 | child=1 dirty=1 authpin=1 0x55576d056400] count now 14 2023-10-03T19:21:04.020 INFO:teuthology.orchestra.run.smithi045.stdout: -3688> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005cf) auth_unpin by 0x55576e9d8480 on [inode 0x100000005cf [2,head] /dc-dir/dc-file_986 auth v5974 s=3 n(v0 rc2023-10-03T19:16:14.358977+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d2f0100] now 0 2023-10-03T19:21:04.020 INFO:teuthology.orchestra.run.smithi045.stdout: -3687> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5975 cv=5553/5553 ap=14+13 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=211 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e9d8480 count now 14/13 2023-10-03T19:21:04.020 INFO:teuthology.orchestra.run.smithi045.stdout: -3686> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:04.020 INFO:teuthology.orchestra.run.smithi045.stdout: -3685> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:04.021 INFO:teuthology.orchestra.run.smithi045.stdout: -3684> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005d0 [2,head] /dc-dir/dc-file_987 auth v5210 pv5976 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.370854+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.370854+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d2f0680] 2023-10-03T19:21:04.021 INFO:teuthology.orchestra.run.smithi045.stdout: -3683> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5982 2023-10-03T19:21:04.021 INFO:teuthology.orchestra.run.smithi045.stdout: -3682> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5982 pv6006 ap=14 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=14) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=13) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.021 INFO:teuthology.orchestra.run.smithi045.stdout: -3681> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5980 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:04.021 INFO:teuthology.orchestra.run.smithi045.stdout: -3680> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5981 cv=5559/5559 REP dir_auth=0 ap=13+14 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5981 2023-10-03T19:21:04.021 INFO:teuthology.orchestra.run.smithi045.stdout: -3679> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005d0) pop_and_dirty_projected_inode v5976 2023-10-03T19:21:04.021 INFO:teuthology.orchestra.run.smithi045.stdout: -3678> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005d0) mark_dirty [inode 0x100000005d0 [2,head] /dc-dir/dc-file_987 auth v5976 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.370854+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d2f0680] 2023-10-03T19:21:04.021 INFO:teuthology.orchestra.run.smithi045.stdout: -3677> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_987) mark_dirty [dentry #0x1/dc-dir/dc-file_987 [2,head] auth (dversion lock) pv=5976 v=5210 ino=0x100000005d0 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d78aa00] 2023-10-03T19:21:04.021 INFO:teuthology.orchestra.run.smithi045.stdout: -3676> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5975 cv=5553/5553 ap=14+13 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=212 | child=1 dirty=1 authpin=1 0x55576d056400] version 5975 2023-10-03T19:21:04.021 INFO:teuthology.orchestra.run.smithi045.stdout: -3675> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576df558e0 v5983 2023-10-03T19:21:04.022 INFO:teuthology.orchestra.run.smithi045.stdout: -3674> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5983 cv=5559/5559 REP dir_auth=0 ap=13+14 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5983 2023-10-03T19:21:04.022 INFO:teuthology.orchestra.run.smithi045.stdout: -3673> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576df557c0 v5977 2023-10-03T19:21:04.022 INFO:teuthology.orchestra.run.smithi045.stdout: -3672> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5977 cv=5553/5553 ap=14+13 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=212 | child=1 dirty=1 authpin=1 0x55576d056400] version 5977 2023-10-03T19:21:04.022 INFO:teuthology.orchestra.run.smithi045.stdout: -3671> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=13 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=13 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:04.022 INFO:teuthology.orchestra.run.smithi045.stdout: -3670> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=13) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5982 pv6006 ap=14 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=14) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=13) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.022 INFO:teuthology.orchestra.run.smithi045.stdout: -3669> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=14) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5982 pv6006 ap=14 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=14) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=12) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.022 INFO:teuthology.orchestra.run.smithi045.stdout: -3668> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005d0 [2,head] /dc-dir/dc-file_987 auth v5976 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.370854+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2f0680] 2023-10-03T19:21:04.022 INFO:teuthology.orchestra.run.smithi045.stdout: -3667> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005d0 [2,head] /dc-dir/dc-file_987 auth v5976 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.370854+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2f0680] 2023-10-03T19:21:04.022 INFO:teuthology.orchestra.run.smithi045.stdout: -3666> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:04.023 INFO:teuthology.orchestra.run.smithi045.stdout: -3665> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:04.023 INFO:teuthology.orchestra.run.smithi045.stdout: -3664> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:04.023 INFO:teuthology.orchestra.run.smithi045.stdout: -3663> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005d0 [2,head] /dc-dir/dc-file_987 auth v5976 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.370854+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2f0680] 2023-10-03T19:21:04.023 INFO:teuthology.orchestra.run.smithi045.stdout: -3662> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005d0 [2,head] /dc-dir/dc-file_987 auth v5976 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.370854+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2f0680] 2023-10-03T19:21:04.023 INFO:teuthology.orchestra.run.smithi045.stdout: -3661> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:04.023 INFO:teuthology.orchestra.run.smithi045.stdout: -3660> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 400.674, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 4.01e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:804.3] 2023-10-03T19:21:04.023 INFO:teuthology.orchestra.run.smithi045.stdout: -3659> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576df53b00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5982 pv6006 ap=13 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=13) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=12) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 13 2023-10-03T19:21:04.023 INFO:teuthology.orchestra.run.smithi045.stdout: -3658> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5983 cv=5559/5559 REP dir_auth=0 ap=13+13 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576df53b00 count now 13/13 2023-10-03T19:21:04.023 INFO:teuthology.orchestra.run.smithi045.stdout: -3657> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576df53b00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5977 cv=5553/5553 ap=13+13 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=212 | child=1 dirty=1 authpin=1 0x55576d056400] count now 13 2023-10-03T19:21:04.023 INFO:teuthology.orchestra.run.smithi045.stdout: -3656> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576df53b00 on [dir 0x1 / [2,head] auth pv=6007 v=5983 cv=5559/5559 REP dir_auth=0 ap=12+13 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 12 2023-10-03T19:21:04.024 INFO:teuthology.orchestra.run.smithi045.stdout: -3655> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005d0) auth_unpin by 0x55576df53b00 on [inode 0x100000005d0 [2,head] /dc-dir/dc-file_987 auth v5976 s=3 n(v0 rc2023-10-03T19:16:14.370854+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d2f0680] now 0 2023-10-03T19:21:04.024 INFO:teuthology.orchestra.run.smithi045.stdout: -3654> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5977 cv=5553/5553 ap=13+12 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=212 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576df53b00 count now 13/12 2023-10-03T19:21:04.024 INFO:teuthology.orchestra.run.smithi045.stdout: -3653> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:04.024 INFO:teuthology.orchestra.run.smithi045.stdout: -3652> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:04.024 INFO:teuthology.orchestra.run.smithi045.stdout: -3651> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005d1 [2,head] /dc-dir/dc-file_988 auth v5214 pv5978 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.382418+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.382418+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d2f0c00] 2023-10-03T19:21:04.024 INFO:teuthology.orchestra.run.smithi045.stdout: -3650> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5984 2023-10-03T19:21:04.024 INFO:teuthology.orchestra.run.smithi045.stdout: -3649> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5984 pv6006 ap=13 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=13) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=12) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.024 INFO:teuthology.orchestra.run.smithi045.stdout: -3648> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5982 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:04.025 INFO:teuthology.orchestra.run.smithi045.stdout: -3647> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5983 cv=5559/5559 REP dir_auth=0 ap=12+13 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5983 2023-10-03T19:21:04.025 INFO:teuthology.orchestra.run.smithi045.stdout: -3646> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005d1) pop_and_dirty_projected_inode v5978 2023-10-03T19:21:04.025 INFO:teuthology.orchestra.run.smithi045.stdout: -3645> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005d1) mark_dirty [inode 0x100000005d1 [2,head] /dc-dir/dc-file_988 auth v5978 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.382418+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d2f0c00] 2023-10-03T19:21:04.025 INFO:teuthology.orchestra.run.smithi045.stdout: -3644> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_988) mark_dirty [dentry #0x1/dc-dir/dc-file_988 [2,head] auth (dversion lock) pv=5978 v=5214 ino=0x100000005d1 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d78ac80] 2023-10-03T19:21:04.025 INFO:teuthology.orchestra.run.smithi045.stdout: -3643> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5977 cv=5553/5553 ap=13+12 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=213 | child=1 dirty=1 authpin=1 0x55576d056400] version 5977 2023-10-03T19:21:04.025 INFO:teuthology.orchestra.run.smithi045.stdout: -3642> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576df55b20 v5985 2023-10-03T19:21:04.025 INFO:teuthology.orchestra.run.smithi045.stdout: -3641> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5985 cv=5559/5559 REP dir_auth=0 ap=12+13 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5985 2023-10-03T19:21:04.025 INFO:teuthology.orchestra.run.smithi045.stdout: -3640> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576df55a00 v5979 2023-10-03T19:21:04.025 INFO:teuthology.orchestra.run.smithi045.stdout: -3639> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5979 cv=5553/5553 ap=13+12 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=213 | child=1 dirty=1 authpin=1 0x55576d056400] version 5979 2023-10-03T19:21:04.025 INFO:teuthology.orchestra.run.smithi045.stdout: -3638> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=12 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=12 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:04.026 INFO:teuthology.orchestra.run.smithi045.stdout: -3637> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=12) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5984 pv6006 ap=13 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=13) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=12) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.026 INFO:teuthology.orchestra.run.smithi045.stdout: -3636> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=13) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5984 pv6006 ap=13 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=13) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=11) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.026 INFO:teuthology.orchestra.run.smithi045.stdout: -3635> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005d1 [2,head] /dc-dir/dc-file_988 auth v5978 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.382418+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2f0c00] 2023-10-03T19:21:04.032 INFO:teuthology.orchestra.run.smithi045.stdout: -3634> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005d1 [2,head] /dc-dir/dc-file_988 auth v5978 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.382418+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2f0c00] 2023-10-03T19:21:04.032 INFO:teuthology.orchestra.run.smithi045.stdout: -3633> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:04.032 INFO:teuthology.orchestra.run.smithi045.stdout: -3632> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:04.032 INFO:teuthology.orchestra.run.smithi045.stdout: -3631> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:04.032 INFO:teuthology.orchestra.run.smithi045.stdout: -3630> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005d1 [2,head] /dc-dir/dc-file_988 auth v5978 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.382418+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2f0c00] 2023-10-03T19:21:04.033 INFO:teuthology.orchestra.run.smithi045.stdout: -3629> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005d1 [2,head] /dc-dir/dc-file_988 auth v5978 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.382418+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2f0c00] 2023-10-03T19:21:04.033 INFO:teuthology.orchestra.run.smithi045.stdout: -3628> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:04.033 INFO:teuthology.orchestra.run.smithi045.stdout: -3627> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 401.674, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 4.02e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:806.3] 2023-10-03T19:21:04.033 INFO:teuthology.orchestra.run.smithi045.stdout: -3626> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576df53200 on [dir 0x1 / [2,head] auth pv=6007 v=5985 cv=5559/5559 REP dir_auth=0 ap=11+13 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 11 2023-10-03T19:21:04.033 INFO:teuthology.orchestra.run.smithi045.stdout: -3625> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576df53200 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5984 pv6006 ap=12 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=12) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=11) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 12 2023-10-03T19:21:04.033 INFO:teuthology.orchestra.run.smithi045.stdout: -3624> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5985 cv=5559/5559 REP dir_auth=0 ap=11+12 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576df53200 count now 11/12 2023-10-03T19:21:04.033 INFO:teuthology.orchestra.run.smithi045.stdout: -3623> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576df53200 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5979 cv=5553/5553 ap=12+12 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=213 | child=1 dirty=1 authpin=1 0x55576d056400] count now 12 2023-10-03T19:21:04.033 INFO:teuthology.orchestra.run.smithi045.stdout: -3622> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005d1) auth_unpin by 0x55576df53200 on [inode 0x100000005d1 [2,head] /dc-dir/dc-file_988 auth v5978 s=3 n(v0 rc2023-10-03T19:16:14.382418+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d2f0c00] now 0 2023-10-03T19:21:04.034 INFO:teuthology.orchestra.run.smithi045.stdout: -3621> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5979 cv=5553/5553 ap=12+11 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=213 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576df53200 count now 12/11 2023-10-03T19:21:04.034 INFO:teuthology.orchestra.run.smithi045.stdout: -3620> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:04.034 INFO:teuthology.orchestra.run.smithi045.stdout: -3619> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:04.034 INFO:teuthology.orchestra.run.smithi045.stdout: -3618> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005d2 [2,head] /dc-dir/dc-file_989 auth v5218 pv5980 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.394971+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.394971+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d2f1180] 2023-10-03T19:21:04.034 INFO:teuthology.orchestra.run.smithi045.stdout: -3617> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5986 2023-10-03T19:21:04.034 INFO:teuthology.orchestra.run.smithi045.stdout: -3616> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5986 pv6006 ap=12 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=12) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=11) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.034 INFO:teuthology.orchestra.run.smithi045.stdout: -3615> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5984 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:04.034 INFO:teuthology.orchestra.run.smithi045.stdout: -3614> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5985 cv=5559/5559 REP dir_auth=0 ap=11+12 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5985 2023-10-03T19:21:04.035 INFO:teuthology.orchestra.run.smithi045.stdout: -3613> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005d2) pop_and_dirty_projected_inode v5980 2023-10-03T19:21:04.035 INFO:teuthology.orchestra.run.smithi045.stdout: -3612> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005d2) mark_dirty [inode 0x100000005d2 [2,head] /dc-dir/dc-file_989 auth v5980 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.394971+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d2f1180] 2023-10-03T19:21:04.035 INFO:teuthology.orchestra.run.smithi045.stdout: -3611> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_989) mark_dirty [dentry #0x1/dc-dir/dc-file_989 [2,head] auth (dversion lock) pv=5980 v=5218 ino=0x100000005d2 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d78af00] 2023-10-03T19:21:04.035 INFO:teuthology.orchestra.run.smithi045.stdout: -3610> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5979 cv=5553/5553 ap=12+11 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=214 | child=1 dirty=1 authpin=1 0x55576d056400] version 5979 2023-10-03T19:21:04.035 INFO:teuthology.orchestra.run.smithi045.stdout: -3609> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576df55d60 v5987 2023-10-03T19:21:04.035 INFO:teuthology.orchestra.run.smithi045.stdout: -3608> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5987 cv=5559/5559 REP dir_auth=0 ap=11+12 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5987 2023-10-03T19:21:04.035 INFO:teuthology.orchestra.run.smithi045.stdout: -3607> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576df55c40 v5981 2023-10-03T19:21:04.035 INFO:teuthology.orchestra.run.smithi045.stdout: -3606> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5981 cv=5553/5553 ap=12+11 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=214 | child=1 dirty=1 authpin=1 0x55576d056400] version 5981 2023-10-03T19:21:04.035 INFO:teuthology.orchestra.run.smithi045.stdout: -3605> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=11 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=11 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:04.036 INFO:teuthology.orchestra.run.smithi045.stdout: -3604> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=11) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5986 pv6006 ap=12 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=12) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=11) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.036 INFO:teuthology.orchestra.run.smithi045.stdout: -3603> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=12) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5986 pv6006 ap=12 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=12) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=10) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.036 INFO:teuthology.orchestra.run.smithi045.stdout: -3602> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005d2 [2,head] /dc-dir/dc-file_989 auth v5980 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.394971+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2f1180] 2023-10-03T19:21:04.036 INFO:teuthology.orchestra.run.smithi045.stdout: -3601> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005d2 [2,head] /dc-dir/dc-file_989 auth v5980 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.394971+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2f1180] 2023-10-03T19:21:04.036 INFO:teuthology.orchestra.run.smithi045.stdout: -3600> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:04.036 INFO:teuthology.orchestra.run.smithi045.stdout: -3599> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:04.036 INFO:teuthology.orchestra.run.smithi045.stdout: -3598> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:04.036 INFO:teuthology.orchestra.run.smithi045.stdout: -3597> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005d2 [2,head] /dc-dir/dc-file_989 auth v5980 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.394971+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2f1180] 2023-10-03T19:21:04.036 INFO:teuthology.orchestra.run.smithi045.stdout: -3596> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005d2 [2,head] /dc-dir/dc-file_989 auth v5980 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.394971+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2f1180] 2023-10-03T19:21:04.036 INFO:teuthology.orchestra.run.smithi045.stdout: -3595> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:04.037 INFO:teuthology.orchestra.run.smithi045.stdout: -3594> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 402.674, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 4.03e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:808.3] 2023-10-03T19:21:04.037 INFO:teuthology.orchestra.run.smithi045.stdout: -3593> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576df52900 on [dir 0x1 / [2,head] auth pv=6007 v=5987 cv=5559/5559 REP dir_auth=0 ap=10+12 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 10 2023-10-03T19:21:04.037 INFO:teuthology.orchestra.run.smithi045.stdout: -3592> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576df52900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5986 pv6006 ap=11 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=11) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=10) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 11 2023-10-03T19:21:04.037 INFO:teuthology.orchestra.run.smithi045.stdout: -3591> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5987 cv=5559/5559 REP dir_auth=0 ap=10+11 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576df52900 count now 10/11 2023-10-03T19:21:04.037 INFO:teuthology.orchestra.run.smithi045.stdout: -3590> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576df52900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5981 cv=5553/5553 ap=11+11 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=214 | child=1 dirty=1 authpin=1 0x55576d056400] count now 11 2023-10-03T19:21:04.037 INFO:teuthology.orchestra.run.smithi045.stdout: -3589> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005d2) auth_unpin by 0x55576df52900 on [inode 0x100000005d2 [2,head] /dc-dir/dc-file_989 auth v5980 s=3 n(v0 rc2023-10-03T19:16:14.394971+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d2f1180] now 0 2023-10-03T19:21:04.037 INFO:teuthology.orchestra.run.smithi045.stdout: -3588> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5981 cv=5553/5553 ap=11+10 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=214 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576df52900 count now 11/10 2023-10-03T19:21:04.037 INFO:teuthology.orchestra.run.smithi045.stdout: -3587> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:04.037 INFO:teuthology.orchestra.run.smithi045.stdout: -3586> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:04.037 INFO:teuthology.orchestra.run.smithi045.stdout: -3585> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005d3 [2,head] /dc-dir/dc-file_990 auth v5222 pv5982 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.406435+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.406435+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d2f1700] 2023-10-03T19:21:04.038 INFO:teuthology.orchestra.run.smithi045.stdout: -3584> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5988 2023-10-03T19:21:04.038 INFO:teuthology.orchestra.run.smithi045.stdout: -3583> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5988 pv6006 ap=11 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=11) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=10) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.038 INFO:teuthology.orchestra.run.smithi045.stdout: -3582> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5986 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:04.038 INFO:teuthology.orchestra.run.smithi045.stdout: -3581> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5987 cv=5559/5559 REP dir_auth=0 ap=10+11 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5987 2023-10-03T19:21:04.038 INFO:teuthology.orchestra.run.smithi045.stdout: -3580> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005d3) pop_and_dirty_projected_inode v5982 2023-10-03T19:21:04.038 INFO:teuthology.orchestra.run.smithi045.stdout: -3579> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005d3) mark_dirty [inode 0x100000005d3 [2,head] /dc-dir/dc-file_990 auth v5982 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.406435+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d2f1700] 2023-10-03T19:21:04.038 INFO:teuthology.orchestra.run.smithi045.stdout: -3578> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_990) mark_dirty [dentry #0x1/dc-dir/dc-file_990 [2,head] auth (dversion lock) pv=5982 v=5222 ino=0x100000005d3 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d78b180] 2023-10-03T19:21:04.038 INFO:teuthology.orchestra.run.smithi045.stdout: -3577> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5981 cv=5553/5553 ap=11+10 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=215 | child=1 dirty=1 authpin=1 0x55576d056400] version 5981 2023-10-03T19:21:04.041 INFO:teuthology.orchestra.run.smithi045.stdout: -3576> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576eaac020 v5989 2023-10-03T19:21:04.055 INFO:teuthology.orchestra.run.smithi045.stdout: -3575> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5989 cv=5559/5559 REP dir_auth=0 ap=10+11 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5989 2023-10-03T19:21:04.055 INFO:teuthology.orchestra.run.smithi045.stdout: -3574> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576df55e80 v5983 2023-10-03T19:21:04.055 INFO:teuthology.orchestra.run.smithi045.stdout: -3573> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5983 cv=5553/5553 ap=11+10 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=215 | child=1 dirty=1 authpin=1 0x55576d056400] version 5983 2023-10-03T19:21:04.055 INFO:teuthology.orchestra.run.smithi045.stdout: -3572> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=10 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=10 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:04.055 INFO:teuthology.orchestra.run.smithi045.stdout: -3571> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=10) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5988 pv6006 ap=11 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=11) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=10) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.055 INFO:teuthology.orchestra.run.smithi045.stdout: -3570> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=11) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5988 pv6006 ap=11 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=11) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=9) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.055 INFO:teuthology.orchestra.run.smithi045.stdout: -3569> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005d3 [2,head] /dc-dir/dc-file_990 auth v5982 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.406435+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2f1700] 2023-10-03T19:21:04.055 INFO:teuthology.orchestra.run.smithi045.stdout: -3568> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005d3 [2,head] /dc-dir/dc-file_990 auth v5982 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.406435+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2f1700] 2023-10-03T19:21:04.055 INFO:teuthology.orchestra.run.smithi045.stdout: -3567> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:04.056 INFO:teuthology.orchestra.run.smithi045.stdout: -3566> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:04.056 INFO:teuthology.orchestra.run.smithi045.stdout: -3565> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:04.056 INFO:teuthology.orchestra.run.smithi045.stdout: -3564> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005d3 [2,head] /dc-dir/dc-file_990 auth v5982 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.406435+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2f1700] 2023-10-03T19:21:04.056 INFO:teuthology.orchestra.run.smithi045.stdout: -3563> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005d3 [2,head] /dc-dir/dc-file_990 auth v5982 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.406435+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d2f1700] 2023-10-03T19:21:04.056 INFO:teuthology.orchestra.run.smithi045.stdout: -3562> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:04.056 INFO:teuthology.orchestra.run.smithi045.stdout: -3561> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 403.674, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 4.04e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.49e-01] *LOAD:810.3] 2023-10-03T19:21:04.056 INFO:teuthology.orchestra.run.smithi045.stdout: -3560> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576df52000 on [dir 0x1 / [2,head] auth pv=6007 v=5989 cv=5559/5559 REP dir_auth=0 ap=9+11 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 9 2023-10-03T19:21:04.056 INFO:teuthology.orchestra.run.smithi045.stdout: -3559> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576df52000 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5988 pv6006 ap=10 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=10) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=9) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 10 2023-10-03T19:21:04.056 INFO:teuthology.orchestra.run.smithi045.stdout: -3558> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5989 cv=5559/5559 REP dir_auth=0 ap=9+10 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576df52000 count now 9/10 2023-10-03T19:21:04.057 INFO:teuthology.orchestra.run.smithi045.stdout: -3557> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576df52000 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5983 cv=5553/5553 ap=10+10 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=215 | child=1 dirty=1 authpin=1 0x55576d056400] count now 10 2023-10-03T19:21:04.057 INFO:teuthology.orchestra.run.smithi045.stdout: -3556> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005d3) auth_unpin by 0x55576df52000 on [inode 0x100000005d3 [2,head] /dc-dir/dc-file_990 auth v5982 s=3 n(v0 rc2023-10-03T19:16:14.406435+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d2f1700] now 0 2023-10-03T19:21:04.057 INFO:teuthology.orchestra.run.smithi045.stdout: -3555> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5983 cv=5553/5553 ap=10+9 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=215 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576df52000 count now 10/9 2023-10-03T19:21:04.057 INFO:teuthology.orchestra.run.smithi045.stdout: -3554> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:04.057 INFO:teuthology.orchestra.run.smithi045.stdout: -3553> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:04.057 INFO:teuthology.orchestra.run.smithi045.stdout: -3552> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005d4 [2,head] /dc-dir/dc-file_991 auth v5226 pv5984 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.417602+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.417602+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d58a000] 2023-10-03T19:21:04.057 INFO:teuthology.orchestra.run.smithi045.stdout: -3551> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5990 2023-10-03T19:21:04.057 INFO:teuthology.orchestra.run.smithi045.stdout: -3550> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5990 pv6006 ap=10 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=10) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=9) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.057 INFO:teuthology.orchestra.run.smithi045.stdout: -3549> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5988 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:04.058 INFO:teuthology.orchestra.run.smithi045.stdout: -3548> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5989 cv=5559/5559 REP dir_auth=0 ap=9+10 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5989 2023-10-03T19:21:04.058 INFO:teuthology.orchestra.run.smithi045.stdout: -3547> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005d4) pop_and_dirty_projected_inode v5984 2023-10-03T19:21:04.058 INFO:teuthology.orchestra.run.smithi045.stdout: -3546> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005d4) mark_dirty [inode 0x100000005d4 [2,head] /dc-dir/dc-file_991 auth v5984 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.417602+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d58a000] 2023-10-03T19:21:04.058 INFO:teuthology.orchestra.run.smithi045.stdout: -3545> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_991) mark_dirty [dentry #0x1/dc-dir/dc-file_991 [2,head] auth (dversion lock) pv=5984 v=5226 ino=0x100000005d4 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d78b400] 2023-10-03T19:21:04.058 INFO:teuthology.orchestra.run.smithi045.stdout: -3544> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5983 cv=5553/5553 ap=10+9 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=216 | child=1 dirty=1 authpin=1 0x55576d056400] version 5983 2023-10-03T19:21:04.058 INFO:teuthology.orchestra.run.smithi045.stdout: -3543> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576eaac260 v5991 2023-10-03T19:21:04.058 INFO:teuthology.orchestra.run.smithi045.stdout: -3542> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5991 cv=5559/5559 REP dir_auth=0 ap=9+10 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5991 2023-10-03T19:21:04.059 INFO:teuthology.orchestra.run.smithi045.stdout: -3541> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576eaac140 v5985 2023-10-03T19:21:04.059 INFO:teuthology.orchestra.run.smithi045.stdout: -3540> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5985 cv=5553/5553 ap=10+9 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=216 | child=1 dirty=1 authpin=1 0x55576d056400] version 5985 2023-10-03T19:21:04.059 INFO:teuthology.orchestra.run.smithi045.stdout: -3539> 2023-10-03T19:16:28.802+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=9 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=9 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:04.059 INFO:teuthology.orchestra.run.smithi045.stdout: -3538> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=9) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5990 pv6006 ap=10 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=10) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=9) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.059 INFO:teuthology.orchestra.run.smithi045.stdout: -3537> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=10) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5990 pv6006 ap=10 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=10) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=8) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.059 INFO:teuthology.orchestra.run.smithi045.stdout: -3536> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005d4 [2,head] /dc-dir/dc-file_991 auth v5984 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.417602+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58a000] 2023-10-03T19:21:04.059 INFO:teuthology.orchestra.run.smithi045.stdout: -3535> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005d4 [2,head] /dc-dir/dc-file_991 auth v5984 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.417602+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58a000] 2023-10-03T19:21:04.059 INFO:teuthology.orchestra.run.smithi045.stdout: -3534> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:04.059 INFO:teuthology.orchestra.run.smithi045.stdout: -3533> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:04.060 INFO:teuthology.orchestra.run.smithi045.stdout: -3532> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:04.060 INFO:teuthology.orchestra.run.smithi045.stdout: -3531> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005d4 [2,head] /dc-dir/dc-file_991 auth v5984 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.417602+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58a000] 2023-10-03T19:21:04.060 INFO:teuthology.orchestra.run.smithi045.stdout: -3530> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005d4 [2,head] /dc-dir/dc-file_991 auth v5984 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.417602+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58a000] 2023-10-03T19:21:04.060 INFO:teuthology.orchestra.run.smithi045.stdout: -3529> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:04.060 INFO:teuthology.orchestra.run.smithi045.stdout: -3528> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 404.451, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 4.04e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.48e-01] *LOAD:811.9] 2023-10-03T19:21:04.060 INFO:teuthology.orchestra.run.smithi045.stdout: -3527> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e31c480 on [dir 0x1 / [2,head] auth pv=6007 v=5991 cv=5559/5559 REP dir_auth=0 ap=8+10 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 8 2023-10-03T19:21:04.060 INFO:teuthology.orchestra.run.smithi045.stdout: -3526> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e31c480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5990 pv6006 ap=9 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=9) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=8) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 9 2023-10-03T19:21:04.060 INFO:teuthology.orchestra.run.smithi045.stdout: -3525> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5991 cv=5559/5559 REP dir_auth=0 ap=8+9 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e31c480 count now 8/9 2023-10-03T19:21:04.060 INFO:teuthology.orchestra.run.smithi045.stdout: -3524> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e31c480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5985 cv=5553/5553 ap=9+9 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=216 | child=1 dirty=1 authpin=1 0x55576d056400] count now 9 2023-10-03T19:21:04.060 INFO:teuthology.orchestra.run.smithi045.stdout: -3523> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005d4) auth_unpin by 0x55576e31c480 on [inode 0x100000005d4 [2,head] /dc-dir/dc-file_991 auth v5984 s=3 n(v0 rc2023-10-03T19:16:14.417602+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d58a000] now 0 2023-10-03T19:21:04.061 INFO:teuthology.orchestra.run.smithi045.stdout: -3522> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5985 cv=5553/5553 ap=9+8 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=216 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e31c480 count now 9/8 2023-10-03T19:21:04.061 INFO:teuthology.orchestra.run.smithi045.stdout: -3521> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:04.061 INFO:teuthology.orchestra.run.smithi045.stdout: -3520> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:04.061 INFO:teuthology.orchestra.run.smithi045.stdout: -3519> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005d5 [2,head] /dc-dir/dc-file_992 auth v5230 pv5986 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.428662+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.428662+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d58a580] 2023-10-03T19:21:04.061 INFO:teuthology.orchestra.run.smithi045.stdout: -3518> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5992 2023-10-03T19:21:04.061 INFO:teuthology.orchestra.run.smithi045.stdout: -3517> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5992 pv6006 ap=9 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=9) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=8) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.061 INFO:teuthology.orchestra.run.smithi045.stdout: -3516> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5990 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:04.061 INFO:teuthology.orchestra.run.smithi045.stdout: -3515> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5991 cv=5559/5559 REP dir_auth=0 ap=8+9 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5991 2023-10-03T19:21:04.061 INFO:teuthology.orchestra.run.smithi045.stdout: -3514> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005d5) pop_and_dirty_projected_inode v5986 2023-10-03T19:21:04.061 INFO:teuthology.orchestra.run.smithi045.stdout: -3513> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005d5) mark_dirty [inode 0x100000005d5 [2,head] /dc-dir/dc-file_992 auth v5986 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.428662+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d58a580] 2023-10-03T19:21:04.062 INFO:teuthology.orchestra.run.smithi045.stdout: -3512> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_992) mark_dirty [dentry #0x1/dc-dir/dc-file_992 [2,head] auth (dversion lock) pv=5986 v=5230 ino=0x100000005d5 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d78b680] 2023-10-03T19:21:04.062 INFO:teuthology.orchestra.run.smithi045.stdout: -3511> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5985 cv=5553/5553 ap=9+8 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=217 | child=1 dirty=1 authpin=1 0x55576d056400] version 5985 2023-10-03T19:21:04.062 INFO:teuthology.orchestra.run.smithi045.stdout: -3510> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576eaac4a0 v5993 2023-10-03T19:21:04.062 INFO:teuthology.orchestra.run.smithi045.stdout: -3509> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5993 cv=5559/5559 REP dir_auth=0 ap=8+9 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5993 2023-10-03T19:21:04.062 INFO:teuthology.orchestra.run.smithi045.stdout: -3508> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576eaac380 v5987 2023-10-03T19:21:04.062 INFO:teuthology.orchestra.run.smithi045.stdout: -3507> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5987 cv=5553/5553 ap=9+8 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=217 | child=1 dirty=1 authpin=1 0x55576d056400] version 5987 2023-10-03T19:21:04.062 INFO:teuthology.orchestra.run.smithi045.stdout: -3506> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=8 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=8 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:04.062 INFO:teuthology.orchestra.run.smithi045.stdout: -3505> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=8) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5992 pv6006 ap=9 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=9) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=8) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.062 INFO:teuthology.orchestra.run.smithi045.stdout: -3504> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=9) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5992 pv6006 ap=9 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=9) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=7) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.062 INFO:teuthology.orchestra.run.smithi045.stdout: -3503> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005d5 [2,head] /dc-dir/dc-file_992 auth v5986 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.428662+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58a580] 2023-10-03T19:21:04.063 INFO:teuthology.orchestra.run.smithi045.stdout: -3502> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005d5 [2,head] /dc-dir/dc-file_992 auth v5986 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.428662+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58a580] 2023-10-03T19:21:04.063 INFO:teuthology.orchestra.run.smithi045.stdout: -3501> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:04.063 INFO:teuthology.orchestra.run.smithi045.stdout: -3500> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:04.063 INFO:teuthology.orchestra.run.smithi045.stdout: -3499> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:04.063 INFO:teuthology.orchestra.run.smithi045.stdout: -3498> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005d5 [2,head] /dc-dir/dc-file_992 auth v5986 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.428662+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58a580] 2023-10-03T19:21:04.063 INFO:teuthology.orchestra.run.smithi045.stdout: -3497> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005d5 [2,head] /dc-dir/dc-file_992 auth v5986 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.428662+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58a580] 2023-10-03T19:21:04.063 INFO:teuthology.orchestra.run.smithi045.stdout: -3496> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:04.063 INFO:teuthology.orchestra.run.smithi045.stdout: -3495> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 405.451, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 4.05e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.48e-01] *LOAD:813.9] 2023-10-03T19:21:04.063 INFO:teuthology.orchestra.run.smithi045.stdout: -3494> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d54e480 on [dir 0x1 / [2,head] auth pv=6007 v=5993 cv=5559/5559 REP dir_auth=0 ap=7+9 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 7 2023-10-03T19:21:04.063 INFO:teuthology.orchestra.run.smithi045.stdout: -3493> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d54e480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5992 pv6006 ap=8 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=8) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=7) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 8 2023-10-03T19:21:04.064 INFO:teuthology.orchestra.run.smithi045.stdout: -3492> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5993 cv=5559/5559 REP dir_auth=0 ap=7+8 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d54e480 count now 7/8 2023-10-03T19:21:04.064 INFO:teuthology.orchestra.run.smithi045.stdout: -3491> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d54e480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5987 cv=5553/5553 ap=8+8 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=217 | child=1 dirty=1 authpin=1 0x55576d056400] count now 8 2023-10-03T19:21:04.064 INFO:teuthology.orchestra.run.smithi045.stdout: -3490> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005d5) auth_unpin by 0x55576d54e480 on [inode 0x100000005d5 [2,head] /dc-dir/dc-file_992 auth v5986 s=3 n(v0 rc2023-10-03T19:16:14.428662+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d58a580] now 0 2023-10-03T19:21:04.064 INFO:teuthology.orchestra.run.smithi045.stdout: -3489> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5987 cv=5553/5553 ap=8+7 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=217 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d54e480 count now 8/7 2023-10-03T19:21:04.064 INFO:teuthology.orchestra.run.smithi045.stdout: -3488> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:04.064 INFO:teuthology.orchestra.run.smithi045.stdout: -3487> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:04.064 INFO:teuthology.orchestra.run.smithi045.stdout: -3486> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005d6 [2,head] /dc-dir/dc-file_993 auth v5234 pv5988 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.440845+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.440845+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d58ab00] 2023-10-03T19:21:04.064 INFO:teuthology.orchestra.run.smithi045.stdout: -3485> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5994 2023-10-03T19:21:04.064 INFO:teuthology.orchestra.run.smithi045.stdout: -3484> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5994 pv6006 ap=8 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=8) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=7) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.064 INFO:teuthology.orchestra.run.smithi045.stdout: -3483> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5992 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:04.065 INFO:teuthology.orchestra.run.smithi045.stdout: -3482> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5993 cv=5559/5559 REP dir_auth=0 ap=7+8 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5993 2023-10-03T19:21:04.065 INFO:teuthology.orchestra.run.smithi045.stdout: -3481> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005d6) pop_and_dirty_projected_inode v5988 2023-10-03T19:21:04.065 INFO:teuthology.orchestra.run.smithi045.stdout: -3480> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005d6) mark_dirty [inode 0x100000005d6 [2,head] /dc-dir/dc-file_993 auth v5988 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.440845+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d58ab00] 2023-10-03T19:21:04.065 INFO:teuthology.orchestra.run.smithi045.stdout: -3479> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_993) mark_dirty [dentry #0x1/dc-dir/dc-file_993 [2,head] auth (dversion lock) pv=5988 v=5234 ino=0x100000005d6 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d78b900] 2023-10-03T19:21:04.065 INFO:teuthology.orchestra.run.smithi045.stdout: -3478> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5987 cv=5553/5553 ap=8+7 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=218 | child=1 dirty=1 authpin=1 0x55576d056400] version 5987 2023-10-03T19:21:04.065 INFO:teuthology.orchestra.run.smithi045.stdout: -3477> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576eaac6e0 v5995 2023-10-03T19:21:04.065 INFO:teuthology.orchestra.run.smithi045.stdout: -3476> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5995 cv=5559/5559 REP dir_auth=0 ap=7+8 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5995 2023-10-03T19:21:04.065 INFO:teuthology.orchestra.run.smithi045.stdout: -3475> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576eaac5c0 v5989 2023-10-03T19:21:04.065 INFO:teuthology.orchestra.run.smithi045.stdout: -3474> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5989 cv=5553/5553 ap=8+7 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=218 | child=1 dirty=1 authpin=1 0x55576d056400] version 5989 2023-10-03T19:21:04.065 INFO:teuthology.orchestra.run.smithi045.stdout: -3473> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=7 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=7 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:04.066 INFO:teuthology.orchestra.run.smithi045.stdout: -3472> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=7) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5994 pv6006 ap=8 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=8) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=7) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.066 INFO:teuthology.orchestra.run.smithi045.stdout: -3471> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=8) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5994 pv6006 ap=8 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=8) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=6) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.066 INFO:teuthology.orchestra.run.smithi045.stdout: -3470> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005d6 [2,head] /dc-dir/dc-file_993 auth v5988 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.440845+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58ab00] 2023-10-03T19:21:04.066 INFO:teuthology.orchestra.run.smithi045.stdout: -3469> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005d6 [2,head] /dc-dir/dc-file_993 auth v5988 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.440845+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58ab00] 2023-10-03T19:21:04.066 INFO:teuthology.orchestra.run.smithi045.stdout: -3468> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:04.066 INFO:teuthology.orchestra.run.smithi045.stdout: -3467> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:04.066 INFO:teuthology.orchestra.run.smithi045.stdout: -3466> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:04.066 INFO:teuthology.orchestra.run.smithi045.stdout: -3465> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005d6 [2,head] /dc-dir/dc-file_993 auth v5988 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.440845+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58ab00] 2023-10-03T19:21:04.066 INFO:teuthology.orchestra.run.smithi045.stdout: -3464> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005d6 [2,head] /dc-dir/dc-file_993 auth v5988 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.440845+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58ab00] 2023-10-03T19:21:04.066 INFO:teuthology.orchestra.run.smithi045.stdout: -3463> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:04.067 INFO:teuthology.orchestra.run.smithi045.stdout: -3462> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 406.451, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 4.06e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.48e-01] *LOAD:815.9] 2023-10-03T19:21:04.067 INFO:teuthology.orchestra.run.smithi045.stdout: -3461> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d2a5b00 on [dir 0x1 / [2,head] auth pv=6007 v=5995 cv=5559/5559 REP dir_auth=0 ap=6+8 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 6 2023-10-03T19:21:04.067 INFO:teuthology.orchestra.run.smithi045.stdout: -3460> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d2a5b00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5994 pv6006 ap=7 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=7) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=6) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 7 2023-10-03T19:21:04.067 INFO:teuthology.orchestra.run.smithi045.stdout: -3459> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5995 cv=5559/5559 REP dir_auth=0 ap=6+7 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d2a5b00 count now 6/7 2023-10-03T19:21:04.067 INFO:teuthology.orchestra.run.smithi045.stdout: -3458> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d2a5b00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5989 cv=5553/5553 ap=7+7 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=218 | child=1 dirty=1 authpin=1 0x55576d056400] count now 7 2023-10-03T19:21:04.067 INFO:teuthology.orchestra.run.smithi045.stdout: -3457> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005d6) auth_unpin by 0x55576d2a5b00 on [inode 0x100000005d6 [2,head] /dc-dir/dc-file_993 auth v5988 s=3 n(v0 rc2023-10-03T19:16:14.440845+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d58ab00] now 0 2023-10-03T19:21:04.067 INFO:teuthology.orchestra.run.smithi045.stdout: -3456> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5989 cv=5553/5553 ap=7+6 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=218 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d2a5b00 count now 7/6 2023-10-03T19:21:04.067 INFO:teuthology.orchestra.run.smithi045.stdout: -3455> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:04.168 INFO:teuthology.orchestra.run.smithi045.stdout: -3454> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:04.168 INFO:teuthology.orchestra.run.smithi045.stdout: -3453> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005d7 [2,head] /dc-dir/dc-file_994 auth v5238 pv5990 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.452407+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.452407+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d58b080] 2023-10-03T19:21:04.169 INFO:teuthology.orchestra.run.smithi045.stdout: -3452> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5996 2023-10-03T19:21:04.169 INFO:teuthology.orchestra.run.smithi045.stdout: -3451> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5996 pv6006 ap=7 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=7) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=6) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.169 INFO:teuthology.orchestra.run.smithi045.stdout: -3450> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5994 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:04.169 INFO:teuthology.orchestra.run.smithi045.stdout: -3449> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5995 cv=5559/5559 REP dir_auth=0 ap=6+7 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5995 2023-10-03T19:21:04.170 INFO:teuthology.orchestra.run.smithi045.stdout: -3448> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005d7) pop_and_dirty_projected_inode v5990 2023-10-03T19:21:04.170 INFO:teuthology.orchestra.run.smithi045.stdout: -3447> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005d7) mark_dirty [inode 0x100000005d7 [2,head] /dc-dir/dc-file_994 auth v5990 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.452407+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d58b080] 2023-10-03T19:21:04.170 INFO:teuthology.orchestra.run.smithi045.stdout: -3446> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_994) mark_dirty [dentry #0x1/dc-dir/dc-file_994 [2,head] auth (dversion lock) pv=5990 v=5238 ino=0x100000005d7 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d78bb80] 2023-10-03T19:21:04.170 INFO:teuthology.orchestra.run.smithi045.stdout: -3445> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5989 cv=5553/5553 ap=7+6 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=219 | child=1 dirty=1 authpin=1 0x55576d056400] version 5989 2023-10-03T19:21:04.170 INFO:teuthology.orchestra.run.smithi045.stdout: -3444> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576eaac920 v5997 2023-10-03T19:21:04.171 INFO:teuthology.orchestra.run.smithi045.stdout: -3443> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5997 cv=5559/5559 REP dir_auth=0 ap=6+7 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5997 2023-10-03T19:21:04.171 INFO:teuthology.orchestra.run.smithi045.stdout: -3442> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576eaac800 v5991 2023-10-03T19:21:04.171 INFO:teuthology.orchestra.run.smithi045.stdout: -3441> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5991 cv=5553/5553 ap=7+6 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=219 | child=1 dirty=1 authpin=1 0x55576d056400] version 5991 2023-10-03T19:21:04.171 INFO:teuthology.orchestra.run.smithi045.stdout: -3440> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=6 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=6 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:04.171 INFO:teuthology.orchestra.run.smithi045.stdout: -3439> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=6) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5996 pv6006 ap=7 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=7) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=6) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.172 INFO:teuthology.orchestra.run.smithi045.stdout: -3438> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=7) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5996 pv6006 ap=7 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=7) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=5) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.172 INFO:teuthology.orchestra.run.smithi045.stdout: -3437> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005d7 [2,head] /dc-dir/dc-file_994 auth v5990 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.452407+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58b080] 2023-10-03T19:21:04.172 INFO:teuthology.orchestra.run.smithi045.stdout: -3436> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005d7 [2,head] /dc-dir/dc-file_994 auth v5990 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.452407+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58b080] 2023-10-03T19:21:04.172 INFO:teuthology.orchestra.run.smithi045.stdout: -3435> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:04.172 INFO:teuthology.orchestra.run.smithi045.stdout: -3434> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:04.172 INFO:teuthology.orchestra.run.smithi045.stdout: -3433> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:04.173 INFO:teuthology.orchestra.run.smithi045.stdout: -3432> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005d7 [2,head] /dc-dir/dc-file_994 auth v5990 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.452407+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58b080] 2023-10-03T19:21:04.173 INFO:teuthology.orchestra.run.smithi045.stdout: -3431> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005d7 [2,head] /dc-dir/dc-file_994 auth v5990 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.452407+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58b080] 2023-10-03T19:21:04.173 INFO:teuthology.orchestra.run.smithi045.stdout: -3430> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:04.173 INFO:teuthology.orchestra.run.smithi045.stdout: -3429> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 407.451, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 4.07e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.48e-01] *LOAD:817.9] 2023-10-03T19:21:04.173 INFO:teuthology.orchestra.run.smithi045.stdout: -3428> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576d5398c0 on [dir 0x1 / [2,head] auth pv=6007 v=5997 cv=5559/5559 REP dir_auth=0 ap=5+7 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 5 2023-10-03T19:21:04.173 INFO:teuthology.orchestra.run.smithi045.stdout: -3427> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d5398c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5996 pv6006 ap=6 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=6) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=5) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 6 2023-10-03T19:21:04.173 INFO:teuthology.orchestra.run.smithi045.stdout: -3426> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5997 cv=5559/5559 REP dir_auth=0 ap=5+6 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576d5398c0 count now 5/6 2023-10-03T19:21:04.173 INFO:teuthology.orchestra.run.smithi045.stdout: -3425> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d5398c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5991 cv=5553/5553 ap=6+6 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=219 | child=1 dirty=1 authpin=1 0x55576d056400] count now 6 2023-10-03T19:21:04.173 INFO:teuthology.orchestra.run.smithi045.stdout: -3424> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005d7) auth_unpin by 0x55576d5398c0 on [inode 0x100000005d7 [2,head] /dc-dir/dc-file_994 auth v5990 s=3 n(v0 rc2023-10-03T19:16:14.452407+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d58b080] now 0 2023-10-03T19:21:04.174 INFO:teuthology.orchestra.run.smithi045.stdout: -3423> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5991 cv=5553/5553 ap=6+5 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=219 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576d5398c0 count now 6/5 2023-10-03T19:21:04.174 INFO:teuthology.orchestra.run.smithi045.stdout: -3422> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:04.174 INFO:teuthology.orchestra.run.smithi045.stdout: -3421> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:04.174 INFO:teuthology.orchestra.run.smithi045.stdout: -3420> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005d8 [2,head] /dc-dir/dc-file_995 auth v5242 pv5992 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.464151+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.464151+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d58b600] 2023-10-03T19:21:04.174 INFO:teuthology.orchestra.run.smithi045.stdout: -3419> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5998 2023-10-03T19:21:04.174 INFO:teuthology.orchestra.run.smithi045.stdout: -3418> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5998 pv6006 ap=6 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=6) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=5) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.174 INFO:teuthology.orchestra.run.smithi045.stdout: -3417> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5996 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:04.174 INFO:teuthology.orchestra.run.smithi045.stdout: -3416> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5997 cv=5559/5559 REP dir_auth=0 ap=5+6 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5997 2023-10-03T19:21:04.175 INFO:teuthology.orchestra.run.smithi045.stdout: -3415> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005d8) pop_and_dirty_projected_inode v5992 2023-10-03T19:21:04.175 INFO:teuthology.orchestra.run.smithi045.stdout: -3414> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005d8) mark_dirty [inode 0x100000005d8 [2,head] /dc-dir/dc-file_995 auth v5992 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.464151+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d58b600] 2023-10-03T19:21:04.175 INFO:teuthology.orchestra.run.smithi045.stdout: -3413> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_995) mark_dirty [dentry #0x1/dc-dir/dc-file_995 [2,head] auth (dversion lock) pv=5992 v=5242 ino=0x100000005d8 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d78e000] 2023-10-03T19:21:04.175 INFO:teuthology.orchestra.run.smithi045.stdout: -3412> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5991 cv=5553/5553 ap=6+5 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=220 | child=1 dirty=1 authpin=1 0x55576d056400] version 5991 2023-10-03T19:21:04.175 INFO:teuthology.orchestra.run.smithi045.stdout: -3411> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576eaacb60 v5999 2023-10-03T19:21:04.175 INFO:teuthology.orchestra.run.smithi045.stdout: -3410> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5999 cv=5559/5559 REP dir_auth=0 ap=5+6 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5999 2023-10-03T19:21:04.175 INFO:teuthology.orchestra.run.smithi045.stdout: -3409> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576eaaca40 v5993 2023-10-03T19:21:04.175 INFO:teuthology.orchestra.run.smithi045.stdout: -3408> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5993 cv=5553/5553 ap=6+5 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=220 | child=1 dirty=1 authpin=1 0x55576d056400] version 5993 2023-10-03T19:21:04.175 INFO:teuthology.orchestra.run.smithi045.stdout: -3407> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=5 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=5 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:04.175 INFO:teuthology.orchestra.run.smithi045.stdout: -3406> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=5) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5998 pv6006 ap=6 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=6) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=5) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.182 INFO:teuthology.orchestra.run.smithi045.stdout: -3405> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=6) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5998 pv6006 ap=6 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=6) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=4) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.183 INFO:teuthology.orchestra.run.smithi045.stdout: -3404> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005d8 [2,head] /dc-dir/dc-file_995 auth v5992 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.464151+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58b600] 2023-10-03T19:21:04.183 INFO:teuthology.orchestra.run.smithi045.stdout: -3403> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005d8 [2,head] /dc-dir/dc-file_995 auth v5992 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.464151+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58b600] 2023-10-03T19:21:04.183 INFO:teuthology.orchestra.run.smithi045.stdout: -3402> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:04.183 INFO:teuthology.orchestra.run.smithi045.stdout: -3401> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:04.183 INFO:teuthology.orchestra.run.smithi045.stdout: -3400> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:04.183 INFO:teuthology.orchestra.run.smithi045.stdout: -3399> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005d8 [2,head] /dc-dir/dc-file_995 auth v5992 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.464151+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58b600] 2023-10-03T19:21:04.183 INFO:teuthology.orchestra.run.smithi045.stdout: -3398> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005d8 [2,head] /dc-dir/dc-file_995 auth v5992 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.464151+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58b600] 2023-10-03T19:21:04.183 INFO:teuthology.orchestra.run.smithi045.stdout: -3397> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:04.183 INFO:teuthology.orchestra.run.smithi045.stdout: -3396> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 408.451, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 4.08e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.48e-01] *LOAD:819.9] 2023-10-03T19:21:04.183 INFO:teuthology.orchestra.run.smithi045.stdout: -3395> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e1c8900 on [dir 0x1 / [2,head] auth pv=6007 v=5999 cv=5559/5559 REP dir_auth=0 ap=4+6 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 4 2023-10-03T19:21:04.183 INFO:teuthology.orchestra.run.smithi045.stdout: -3394> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e1c8900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5998 pv6006 ap=5 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=5) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=4) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 5 2023-10-03T19:21:04.184 INFO:teuthology.orchestra.run.smithi045.stdout: -3393> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=5999 cv=5559/5559 REP dir_auth=0 ap=4+5 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e1c8900 count now 4/5 2023-10-03T19:21:04.184 INFO:teuthology.orchestra.run.smithi045.stdout: -3392> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e1c8900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5993 cv=5553/5553 ap=5+5 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=220 | child=1 dirty=1 authpin=1 0x55576d056400] count now 5 2023-10-03T19:21:04.184 INFO:teuthology.orchestra.run.smithi045.stdout: -3391> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005d8) auth_unpin by 0x55576e1c8900 on [inode 0x100000005d8 [2,head] /dc-dir/dc-file_995 auth v5992 s=3 n(v0 rc2023-10-03T19:16:14.464151+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d58b600] now 0 2023-10-03T19:21:04.184 INFO:teuthology.orchestra.run.smithi045.stdout: -3390> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5993 cv=5553/5553 ap=5+4 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=220 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e1c8900 count now 5/4 2023-10-03T19:21:04.184 INFO:teuthology.orchestra.run.smithi045.stdout: -3389> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:04.184 INFO:teuthology.orchestra.run.smithi045.stdout: -3388> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:04.184 INFO:teuthology.orchestra.run.smithi045.stdout: -3387> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005d9 [2,head] /dc-dir/dc-file_996 auth v5246 pv5994 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.475749+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.475749+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d58bb80] 2023-10-03T19:21:04.184 INFO:teuthology.orchestra.run.smithi045.stdout: -3386> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v6000 2023-10-03T19:21:04.184 INFO:teuthology.orchestra.run.smithi045.stdout: -3385> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v6000 pv6006 ap=5 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=5) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=4) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.184 INFO:teuthology.orchestra.run.smithi045.stdout: -3384> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=5998 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:04.185 INFO:teuthology.orchestra.run.smithi045.stdout: -3383> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=5999 cv=5559/5559 REP dir_auth=0 ap=4+5 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 5999 2023-10-03T19:21:04.185 INFO:teuthology.orchestra.run.smithi045.stdout: -3382> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005d9) pop_and_dirty_projected_inode v5994 2023-10-03T19:21:04.185 INFO:teuthology.orchestra.run.smithi045.stdout: -3381> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005d9) mark_dirty [inode 0x100000005d9 [2,head] /dc-dir/dc-file_996 auth v5994 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.475749+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d58bb80] 2023-10-03T19:21:04.185 INFO:teuthology.orchestra.run.smithi045.stdout: -3380> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_996) mark_dirty [dentry #0x1/dc-dir/dc-file_996 [2,head] auth (dversion lock) pv=5994 v=5246 ino=0x100000005d9 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d78e280] 2023-10-03T19:21:04.185 INFO:teuthology.orchestra.run.smithi045.stdout: -3379> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5993 cv=5553/5553 ap=5+4 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=221 | child=1 dirty=1 authpin=1 0x55576d056400] version 5993 2023-10-03T19:21:04.185 INFO:teuthology.orchestra.run.smithi045.stdout: -3378> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576eaacda0 v6001 2023-10-03T19:21:04.185 INFO:teuthology.orchestra.run.smithi045.stdout: -3377> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=6001 cv=5559/5559 REP dir_auth=0 ap=4+5 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 6001 2023-10-03T19:21:04.185 INFO:teuthology.orchestra.run.smithi045.stdout: -3376> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576eaacc80 v5995 2023-10-03T19:21:04.185 INFO:teuthology.orchestra.run.smithi045.stdout: -3375> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5995 cv=5553/5553 ap=5+4 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=221 | child=1 dirty=1 authpin=1 0x55576d056400] version 5995 2023-10-03T19:21:04.185 INFO:teuthology.orchestra.run.smithi045.stdout: -3374> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=4 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=4 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:04.186 INFO:teuthology.orchestra.run.smithi045.stdout: -3373> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=4) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6000 pv6006 ap=5 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=5) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=4) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.186 INFO:teuthology.orchestra.run.smithi045.stdout: -3372> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=5) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6000 pv6006 ap=5 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=5) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=3) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.186 INFO:teuthology.orchestra.run.smithi045.stdout: -3371> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005d9 [2,head] /dc-dir/dc-file_996 auth v5994 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.475749+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58bb80] 2023-10-03T19:21:04.186 INFO:teuthology.orchestra.run.smithi045.stdout: -3370> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005d9 [2,head] /dc-dir/dc-file_996 auth v5994 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.475749+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58bb80] 2023-10-03T19:21:04.186 INFO:teuthology.orchestra.run.smithi045.stdout: -3369> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:04.186 INFO:teuthology.orchestra.run.smithi045.stdout: -3368> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:04.186 INFO:teuthology.orchestra.run.smithi045.stdout: -3367> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:04.186 INFO:teuthology.orchestra.run.smithi045.stdout: -3366> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005d9 [2,head] /dc-dir/dc-file_996 auth v5994 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.475749+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58bb80] 2023-10-03T19:21:04.186 INFO:teuthology.orchestra.run.smithi045.stdout: -3365> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005d9 [2,head] /dc-dir/dc-file_996 auth v5994 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.475749+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58bb80] 2023-10-03T19:21:04.186 INFO:teuthology.orchestra.run.smithi045.stdout: -3364> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:04.187 INFO:teuthology.orchestra.run.smithi045.stdout: -3363> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 409.451, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 4.09e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.48e-01] *LOAD:821.9] 2023-10-03T19:21:04.187 INFO:teuthology.orchestra.run.smithi045.stdout: -3362> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e1c9b00 on [dir 0x1 / [2,head] auth pv=6007 v=6001 cv=5559/5559 REP dir_auth=0 ap=3+5 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 3 2023-10-03T19:21:04.187 INFO:teuthology.orchestra.run.smithi045.stdout: -3361> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e1c9b00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6000 pv6006 ap=4 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=4) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=3) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 4 2023-10-03T19:21:04.187 INFO:teuthology.orchestra.run.smithi045.stdout: -3360> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=6001 cv=5559/5559 REP dir_auth=0 ap=3+4 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e1c9b00 count now 3/4 2023-10-03T19:21:04.187 INFO:teuthology.orchestra.run.smithi045.stdout: -3359> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e1c9b00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5995 cv=5553/5553 ap=4+4 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=221 | child=1 dirty=1 authpin=1 0x55576d056400] count now 4 2023-10-03T19:21:04.187 INFO:teuthology.orchestra.run.smithi045.stdout: -3358> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005d9) auth_unpin by 0x55576e1c9b00 on [inode 0x100000005d9 [2,head] /dc-dir/dc-file_996 auth v5994 s=3 n(v0 rc2023-10-03T19:16:14.475749+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d58bb80] now 0 2023-10-03T19:21:04.187 INFO:teuthology.orchestra.run.smithi045.stdout: -3357> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5995 cv=5553/5553 ap=4+3 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=221 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e1c9b00 count now 4/3 2023-10-03T19:21:04.187 INFO:teuthology.orchestra.run.smithi045.stdout: -3356> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:04.187 INFO:teuthology.orchestra.run.smithi045.stdout: -3355> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:04.187 INFO:teuthology.orchestra.run.smithi045.stdout: -3354> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005da [2,head] /dc-dir/dc-file_997 auth v5250 pv5996 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.487300+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.487300+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d58c100] 2023-10-03T19:21:04.187 INFO:teuthology.orchestra.run.smithi045.stdout: -3353> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v6002 2023-10-03T19:21:04.188 INFO:teuthology.orchestra.run.smithi045.stdout: -3352> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v6002 pv6006 ap=4 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=4) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=3) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.188 INFO:teuthology.orchestra.run.smithi045.stdout: -3351> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=6000 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:04.188 INFO:teuthology.orchestra.run.smithi045.stdout: -3350> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=6001 cv=5559/5559 REP dir_auth=0 ap=3+4 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 6001 2023-10-03T19:21:04.188 INFO:teuthology.orchestra.run.smithi045.stdout: -3349> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005da) pop_and_dirty_projected_inode v5996 2023-10-03T19:21:04.188 INFO:teuthology.orchestra.run.smithi045.stdout: -3348> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005da) mark_dirty [inode 0x100000005da [2,head] /dc-dir/dc-file_997 auth v5996 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.487300+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d58c100] 2023-10-03T19:21:04.188 INFO:teuthology.orchestra.run.smithi045.stdout: -3347> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_997) mark_dirty [dentry #0x1/dc-dir/dc-file_997 [2,head] auth (dversion lock) pv=5996 v=5250 ino=0x100000005da state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d78e500] 2023-10-03T19:21:04.188 INFO:teuthology.orchestra.run.smithi045.stdout: -3346> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5995 cv=5553/5553 ap=4+3 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=222 | child=1 dirty=1 authpin=1 0x55576d056400] version 5995 2023-10-03T19:21:04.188 INFO:teuthology.orchestra.run.smithi045.stdout: -3345> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576eaacfe0 v6003 2023-10-03T19:21:04.188 INFO:teuthology.orchestra.run.smithi045.stdout: -3344> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=6003 cv=5559/5559 REP dir_auth=0 ap=3+4 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 6003 2023-10-03T19:21:04.188 INFO:teuthology.orchestra.run.smithi045.stdout: -3343> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576eaacec0 v5997 2023-10-03T19:21:04.208 INFO:teuthology.orchestra.run.smithi045.stdout: -3342> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5997 cv=5553/5553 ap=4+3 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=222 | child=1 dirty=1 authpin=1 0x55576d056400] version 5997 2023-10-03T19:21:04.209 INFO:teuthology.orchestra.run.smithi045.stdout: -3341> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=3 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=3 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:04.209 INFO:teuthology.orchestra.run.smithi045.stdout: -3340> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=3) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6002 pv6006 ap=4 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=4) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=3) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.209 INFO:teuthology.orchestra.run.smithi045.stdout: -3339> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=4) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6002 pv6006 ap=4 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=4) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=2) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.209 INFO:teuthology.orchestra.run.smithi045.stdout: -3338> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005da [2,head] /dc-dir/dc-file_997 auth v5996 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.487300+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58c100] 2023-10-03T19:21:04.209 INFO:teuthology.orchestra.run.smithi045.stdout: -3337> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005da [2,head] /dc-dir/dc-file_997 auth v5996 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.487300+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58c100] 2023-10-03T19:21:04.209 INFO:teuthology.orchestra.run.smithi045.stdout: -3336> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:04.209 INFO:teuthology.orchestra.run.smithi045.stdout: -3335> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:04.209 INFO:teuthology.orchestra.run.smithi045.stdout: -3334> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:04.209 INFO:teuthology.orchestra.run.smithi045.stdout: -3333> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005da [2,head] /dc-dir/dc-file_997 auth v5996 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.487300+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58c100] 2023-10-03T19:21:04.210 INFO:teuthology.orchestra.run.smithi045.stdout: -3332> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005da [2,head] /dc-dir/dc-file_997 auth v5996 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.487300+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58c100] 2023-10-03T19:21:04.210 INFO:teuthology.orchestra.run.smithi045.stdout: -3331> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:04.210 INFO:teuthology.orchestra.run.smithi045.stdout: -3330> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 410.451, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 4.10e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.48e-01] *LOAD:823.9] 2023-10-03T19:21:04.210 INFO:teuthology.orchestra.run.smithi045.stdout: -3329> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576e2e6d80 on [dir 0x1 / [2,head] auth pv=6007 v=6003 cv=5559/5559 REP dir_auth=0 ap=2+4 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 2 2023-10-03T19:21:04.210 INFO:teuthology.orchestra.run.smithi045.stdout: -3328> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576e2e6d80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5997 cv=5553/5553 ap=3+3 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=222 | child=1 dirty=1 authpin=1 0x55576d056400] count now 3 2023-10-03T19:21:04.210 INFO:teuthology.orchestra.run.smithi045.stdout: -3327> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576e2e6d80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6002 pv6006 ap=3 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=3) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=2) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 3 2023-10-03T19:21:04.210 INFO:teuthology.orchestra.run.smithi045.stdout: -3326> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=6003 cv=5559/5559 REP dir_auth=0 ap=2+3 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576e2e6d80 count now 2/3 2023-10-03T19:21:04.210 INFO:teuthology.orchestra.run.smithi045.stdout: -3325> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005da) auth_unpin by 0x55576e2e6d80 on [inode 0x100000005da [2,head] /dc-dir/dc-file_997 auth v5996 s=3 n(v0 rc2023-10-03T19:16:14.487300+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d58c100] now 0 2023-10-03T19:21:04.210 INFO:teuthology.orchestra.run.smithi045.stdout: -3324> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5997 cv=5553/5553 ap=3+2 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=222 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576e2e6d80 count now 3/2 2023-10-03T19:21:04.210 INFO:teuthology.orchestra.run.smithi045.stdout: -3323> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:04.211 INFO:teuthology.orchestra.run.smithi045.stdout: -3322> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:04.211 INFO:teuthology.orchestra.run.smithi045.stdout: -3321> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005db [2,head] /dc-dir/dc-file_998 auth v5254 pv5998 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.499563+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.499563+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d58c680] 2023-10-03T19:21:04.211 INFO:teuthology.orchestra.run.smithi045.stdout: -3320> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v6004 2023-10-03T19:21:04.211 INFO:teuthology.orchestra.run.smithi045.stdout: -3319> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v6004 pv6006 ap=3 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=3) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=2) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.211 INFO:teuthology.orchestra.run.smithi045.stdout: -3318> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=6002 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:04.211 INFO:teuthology.orchestra.run.smithi045.stdout: -3317> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=6003 cv=5559/5559 REP dir_auth=0 ap=2+3 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 6003 2023-10-03T19:21:04.211 INFO:teuthology.orchestra.run.smithi045.stdout: -3316> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005db) pop_and_dirty_projected_inode v5998 2023-10-03T19:21:04.211 INFO:teuthology.orchestra.run.smithi045.stdout: -3315> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005db) mark_dirty [inode 0x100000005db [2,head] /dc-dir/dc-file_998 auth v5998 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.499563+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d58c680] 2023-10-03T19:21:04.211 INFO:teuthology.orchestra.run.smithi045.stdout: -3314> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_998) mark_dirty [dentry #0x1/dc-dir/dc-file_998 [2,head] auth (dversion lock) pv=5998 v=5254 ino=0x100000005db state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d78e780] 2023-10-03T19:21:04.211 INFO:teuthology.orchestra.run.smithi045.stdout: -3313> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5997 cv=5553/5553 ap=3+2 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=223 | child=1 dirty=1 authpin=1 0x55576d056400] version 5997 2023-10-03T19:21:04.211 INFO:teuthology.orchestra.run.smithi045.stdout: -3312> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576eaad220 v6005 2023-10-03T19:21:04.212 INFO:teuthology.orchestra.run.smithi045.stdout: -3311> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=6005 cv=5559/5559 REP dir_auth=0 ap=2+3 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 6005 2023-10-03T19:21:04.212 INFO:teuthology.orchestra.run.smithi045.stdout: -3310> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576eaad100 v5999 2023-10-03T19:21:04.212 INFO:teuthology.orchestra.run.smithi045.stdout: -3309> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5999 cv=5553/5553 ap=3+2 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=223 | child=1 dirty=1 authpin=1 0x55576d056400] version 5999 2023-10-03T19:21:04.212 INFO:teuthology.orchestra.run.smithi045.stdout: -3308> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=2 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=2 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:04.212 INFO:teuthology.orchestra.run.smithi045.stdout: -3307> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=2) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6004 pv6006 ap=3 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=3) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=2) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.212 INFO:teuthology.orchestra.run.smithi045.stdout: -3306> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=3) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6004 pv6006 ap=3 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=3) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=1) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.212 INFO:teuthology.orchestra.run.smithi045.stdout: -3305> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005db [2,head] /dc-dir/dc-file_998 auth v5998 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.499563+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58c680] 2023-10-03T19:21:04.212 INFO:teuthology.orchestra.run.smithi045.stdout: -3304> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005db [2,head] /dc-dir/dc-file_998 auth v5998 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.499563+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58c680] 2023-10-03T19:21:04.212 INFO:teuthology.orchestra.run.smithi045.stdout: -3303> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:04.212 INFO:teuthology.orchestra.run.smithi045.stdout: -3302> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:04.212 INFO:teuthology.orchestra.run.smithi045.stdout: -3301> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:04.213 INFO:teuthology.orchestra.run.smithi045.stdout: -3300> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005db [2,head] /dc-dir/dc-file_998 auth v5998 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.499563+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58c680] 2023-10-03T19:21:04.213 INFO:teuthology.orchestra.run.smithi045.stdout: -3299> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005db [2,head] /dc-dir/dc-file_998 auth v5998 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.499563+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58c680] 2023-10-03T19:21:04.213 INFO:teuthology.orchestra.run.smithi045.stdout: -3298> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:04.213 INFO:teuthology.orchestra.run.smithi045.stdout: -3297> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 411.451, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 4.11e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.48e-01] *LOAD:825.9] 2023-10-03T19:21:04.213 INFO:teuthology.orchestra.run.smithi045.stdout: -3296> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576ddca000 on [dir 0x1 / [2,head] auth pv=6007 v=6005 cv=5559/5559 REP dir_auth=0 ap=1+3 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 1 2023-10-03T19:21:04.213 INFO:teuthology.orchestra.run.smithi045.stdout: -3295> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576ddca000 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6004 pv6006 ap=2 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=2) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=1) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 2 2023-10-03T19:21:04.213 INFO:teuthology.orchestra.run.smithi045.stdout: -3294> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6007 v=6005 cv=5559/5559 REP dir_auth=0 ap=1+2 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] by 0x55576ddca000 count now 1/2 2023-10-03T19:21:04.213 INFO:teuthology.orchestra.run.smithi045.stdout: -3293> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576ddca000 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5999 cv=5553/5553 ap=2+2 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=223 | child=1 dirty=1 authpin=1 0x55576d056400] count now 2 2023-10-03T19:21:04.213 INFO:teuthology.orchestra.run.smithi045.stdout: -3292> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005db) auth_unpin by 0x55576ddca000 on [inode 0x100000005db [2,head] /dc-dir/dc-file_998 auth v5998 s=3 n(v0 rc2023-10-03T19:16:14.499563+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d58c680] now 0 2023-10-03T19:21:04.213 INFO:teuthology.orchestra.run.smithi045.stdout: -3291> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5999 cv=5553/5553 ap=2+1 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=223 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576ddca000 count now 2/1 2023-10-03T19:21:04.213 INFO:teuthology.orchestra.run.smithi045.stdout: -3290> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:04.214 INFO:teuthology.orchestra.run.smithi045.stdout: -3289> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:04.214 INFO:teuthology.orchestra.run.smithi045.stdout: -3288> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.locker file_update_finish on [inode 0x100000005dc [2,head] /dc-dir/dc-file_999 auth v5258 pv6000 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.509983+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={5697=0-4194304@1} caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d58cc00] 2023-10-03T19:21:04.214 INFO:teuthology.orchestra.run.smithi045.stdout: -3287> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v6006 2023-10-03T19:21:04.214 INFO:teuthology.orchestra.run.smithi045.stdout: -3286> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v6006 ap=2 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=2) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=1) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.214 INFO:teuthology.orchestra.run.smithi045.stdout: -3285> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6006 v=6004 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:04.214 INFO:teuthology.orchestra.run.smithi045.stdout: -3284> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6007 v=6005 cv=5559/5559 REP dir_auth=0 ap=1+2 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 6005 2023-10-03T19:21:04.214 INFO:teuthology.orchestra.run.smithi045.stdout: -3283> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.ino(0x100000005dc) pop_and_dirty_projected_inode v6000 2023-10-03T19:21:04.214 INFO:teuthology.orchestra.run.smithi045.stdout: -3282> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005dc) mark_dirty [inode 0x100000005dc [2,head] /dc-dir/dc-file_999 auth v6000 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.509983+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x55576d58cc00] 2023-10-03T19:21:04.214 INFO:teuthology.orchestra.run.smithi045.stdout: -3281> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.den(0x10000000000 dc-file_999) mark_dirty [dentry #0x1/dc-dir/dc-file_999 [2,head] auth (dversion lock) pv=6000 v=5258 ino=0x100000005dc state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x55576d78ea00] 2023-10-03T19:21:04.214 INFO:teuthology.orchestra.run.smithi045.stdout: -3280> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5999 cv=5553/5553 ap=2+1 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0)->f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=224 | child=1 dirty=1 authpin=1 0x55576d056400] version 5999 2023-10-03T19:21:04.215 INFO:teuthology.orchestra.run.smithi045.stdout: -3279> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55576eaad460 v6007 2023-10-03T19:21:04.215 INFO:teuthology.orchestra.run.smithi045.stdout: -3278> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth v=6007 cv=5559/5559 REP dir_auth=0 ap=1+2 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] version 6007 2023-10-03T19:21:04.215 INFO:teuthology.orchestra.run.smithi045.stdout: -3277> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55576eaad340 v6001 2023-10-03T19:21:04.215 INFO:teuthology.orchestra.run.smithi045.stdout: -3276> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=5553/5553 ap=2+1 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=224 | child=1 dirty=1 authpin=1 0x55576d056400] version 6001 2023-10-03T19:21:04.215 INFO:teuthology.orchestra.run.smithi045.stdout: -3275> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=1 dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock w=1 dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:04.215 INFO:teuthology.orchestra.run.smithi045.stdout: -3274> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.locker scatter_eval (inest lock dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=2 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:04.215 INFO:teuthology.orchestra.run.smithi045.stdout: -3273> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker local_wrlock_finish on (iversion lock w=1) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6006 ap=2 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=2) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=1) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.215 INFO:teuthology.orchestra.run.smithi045.stdout: -3272> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (inest lock w=2) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6006 ap=2 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=2) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=5 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.215 INFO:teuthology.orchestra.run.smithi045.stdout: -3271> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005dc [2,head] /dc-dir/dc-file_999 auth v6000 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.509983+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58cc00] 2023-10-03T19:21:04.215 INFO:teuthology.orchestra.run.smithi045.stdout: -3270> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005dc [2,head] /dc-dir/dc-file_999 auth v6000 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.509983+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58cc00] 2023-10-03T19:21:04.215 INFO:teuthology.orchestra.run.smithi045.stdout: -3269> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:04.216 INFO:teuthology.orchestra.run.smithi045.stdout: -3268> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:04.216 INFO:teuthology.orchestra.run.smithi045.stdout: -3267> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:04.216 INFO:teuthology.orchestra.run.smithi045.stdout: -3266> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005dc [2,head] /dc-dir/dc-file_999 auth v6000 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.509983+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58cc00] 2023-10-03T19:21:04.216 INFO:teuthology.orchestra.run.smithi045.stdout: -3265> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 7 mds.0.locker get_allowed_caps loner client.5697 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005dc [2,head] /dc-dir/dc-file_999 auth v6000 ap=1 s=3 n(v0 rc2023-10-03T19:16:14.509983+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x55576d58cc00] 2023-10-03T19:21:04.216 INFO:teuthology.orchestra.run.smithi045.stdout: -3264> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.locker client.5697 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:04.216 INFO:teuthology.orchestra.run.smithi045.stdout: -3263> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 20 mds.0.bal hit_dir 1 pop is 412.451, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 4.12e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.48e-01] *LOAD:827.9] 2023-10-03T19:21:04.216 INFO:teuthology.orchestra.run.smithi045.stdout: -3262> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55576ddcb680 on [dir 0x1 / [2,head] auth v=6007 cv=5559/5559 REP dir_auth=0 ap=0+2 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=0 0x55576c12ad00] count now 0 2023-10-03T19:21:04.216 INFO:teuthology.orchestra.run.smithi045.stdout: -3261> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576ddcb680 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6006 ap=1 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=5 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] now 1 2023-10-03T19:21:04.216 INFO:teuthology.orchestra.run.smithi045.stdout: -3260> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth v=6007 cv=5559/5559 REP dir_auth=0 ap=0+1 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=0 0x55576c12ad00] by 0x55576ddcb680 count now 0/1 2023-10-03T19:21:04.216 INFO:teuthology.orchestra.run.smithi045.stdout: -3259> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576ddcb680 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=5553/5553 ap=1+1 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=224 | child=1 dirty=1 authpin=1 0x55576d056400] count now 1 2023-10-03T19:21:04.216 INFO:teuthology.orchestra.run.smithi045.stdout: -3258> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005dc) auth_unpin by 0x55576ddcb680 on [inode 0x100000005dc [2,head] /dc-dir/dc-file_999 auth v6000 s=3 n(v0 rc2023-10-03T19:16:14.509983+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d58cc00] now 0 2023-10-03T19:21:04.217 INFO:teuthology.orchestra.run.smithi045.stdout: -3257> 2023-10-03T19:16:28.806+0000 7f3ed53bd640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=5553/5553 ap=1+0 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=224 | child=1 dirty=1 authpin=1 0x55576d056400] by 0x55576ddcb680 count now 1/0 2023-10-03T19:21:04.217 INFO:teuthology.orchestra.run.smithi045.stdout: -3256> 2023-10-03T19:16:29.322+0000 7f3edb3c9640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== client.5697 172.21.15.146:0/3677171105 4053 ==== client_session(request_close seq 2001) v1 ==== 28+0+0 (crc 0 0 0) 0x55576d80bc00 con 0x55576c23b000 2023-10-03T19:21:04.217 INFO:teuthology.orchestra.run.smithi045.stdout: -3255> 2023-10-03T19:16:29.322+0000 7f3edb3c9640 20 mds.0.19 get_session have 0x55576c0dcd00 client.5697 172.21.15.146:0/3677171105 state open 2023-10-03T19:21:04.217 INFO:teuthology.orchestra.run.smithi045.stdout: -3254> 2023-10-03T19:16:29.322+0000 7f3edb3c9640 3 mds.0.server handle_client_session client_session(request_close seq 2001) v1 from client.5697 2023-10-03T19:21:04.217 INFO:teuthology.orchestra.run.smithi045.stdout: -3253> 2023-10-03T19:16:29.322+0000 7f3edb3c9640 10 mds.0.server journal_close_session : client.5697 172.21.15.146:0/3677171105 pending_prealloc_inos [] free_prealloc_inos [0x100000005dd~0x1f7] delegated_inos [0x10000000002~0x1f4] 2023-10-03T19:21:04.217 INFO:teuthology.orchestra.run.smithi045.stdout: -3252> 2023-10-03T19:16:29.322+0000 7f3edb3c9640 20 mds.0.sessionmap mark_projected s=0x55576c0dcd00 name=client.5697 pv=1004 -> 1005 2023-10-03T19:21:04.217 INFO:teuthology.orchestra.run.smithi045.stdout: -3251> 2023-10-03T19:16:29.322+0000 7f3edb3c9640 10 mds.0.inotable: project_release_ids [0x100000005dd~0x1f7] to [0x100000007d4~0xfffffff82c]/[0x100000007d4~0xfffffff82c] 2023-10-03T19:21:04.217 INFO:teuthology.orchestra.run.smithi045.stdout: -3250> 2023-10-03T19:16:29.322+0000 7f3ed4bbc640 5 mds.0.log _submit_thread 10056437~153 : ESession client.5697 172.21.15.146:0/3677171105 close cmapv 1005 (503 to free, v5, 500 to purge) 2023-10-03T19:21:04.217 INFO:teuthology.orchestra.run.smithi045.stdout: -3249> 2023-10-03T19:16:29.322+0000 7f3ed4bbc640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2069 7.1b 7:ddb4e4d7:::200.00000002:head [write 1667829~173 [fadvise_dontneed] in=173b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d0f7180 con 0x55576cfe9000 2023-10-03T19:21:04.217 INFO:teuthology.orchestra.run.smithi045.stdout: -3248> 2023-10-03T19:16:29.326+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 375 ==== osd_op_reply(2069 200.00000002 [write 1667829~173 [fadvise_dontneed]] v50'157 uv157 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:04.217 INFO:teuthology.orchestra.run.smithi045.stdout: -3247> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 20C_MDS_session_finish 2023-10-03T19:21:04.218 INFO:teuthology.orchestra.run.smithi045.stdout: -3246> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 10 MDSContext::complete: 20C_MDS_session_finish 2023-10-03T19:21:04.218 INFO:teuthology.orchestra.run.smithi045.stdout: -3245> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 10 mds.0.server _session_logged client.5697 172.21.15.146:0/3677171105 state_seq 3 close 1005 inos_to_free [0x100000005dd~0x1f7] inotablev 5 inos_to_purge [0x10000000002~0x1f4] 2023-10-03T19:21:04.218 INFO:teuthology.orchestra.run.smithi045.stdout: -3244> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 10 mds.0.cache purge_inodes purging inos [0x10000000002~0x1f4] logseg 2787 2023-10-03T19:21:04.218 INFO:teuthology.orchestra.run.smithi045.stdout: -3243> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2070 8.12 8:4bec3886:::10000000002.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1fd880 con 0x55576cfe9400 2023-10-03T19:21:04.218 INFO:teuthology.orchestra.run.smithi045.stdout: -3242> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2071 8.32 8:4def72d4:::10000000003.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1fc380 con 0x55576cfe9000 2023-10-03T19:21:04.218 INFO:teuthology.orchestra.run.smithi045.stdout: -3241> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2072 8.5 8:a367a3e8:::10000000004.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d515c00 con 0x55576cfe9400 2023-10-03T19:21:04.218 INFO:teuthology.orchestra.run.smithi045.stdout: -3240> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2073 8.9 8:9258b67d:::10000000005.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1aee00 con 0x55576cfe9400 2023-10-03T19:21:04.218 INFO:teuthology.orchestra.run.smithi045.stdout: -3239> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2074 8.25 8:a5feb6f3:::10000000006.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d274e00 con 0x55576cfe9c00 2023-10-03T19:21:04.218 INFO:teuthology.orchestra.run.smithi045.stdout: -3238> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2075 8.1d 8:bbf5850a:::10000000007.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d3d3180 con 0x55576cfe9400 2023-10-03T19:21:04.218 INFO:teuthology.orchestra.run.smithi045.stdout: -3237> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2076 8.13 8:cabe77c1:::10000000008.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d51bc00 con 0x55576cfe8c00 2023-10-03T19:21:04.219 INFO:teuthology.orchestra.run.smithi045.stdout: -3236> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2077 8.34 8:2eb4da2b:::10000000009.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d5dca80 con 0x55576cfe8c00 2023-10-03T19:21:04.219 INFO:teuthology.orchestra.run.smithi045.stdout: -3235> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2078 8.22 8:45d72e17:::1000000000a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1b6380 con 0x55576cfe9800 2023-10-03T19:21:04.219 INFO:teuthology.orchestra.run.smithi045.stdout: -3234> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.19:2079 8.29 8:9752f43f:::1000000000b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d519500 con 0x55576d0f0400 2023-10-03T19:21:04.219 INFO:teuthology.orchestra.run.smithi045.stdout: -3233> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2080 8.22 8:46cca9ab:::1000000000c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d274a80 con 0x55576cfe9800 2023-10-03T19:21:04.219 INFO:teuthology.orchestra.run.smithi045.stdout: -3232> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2081 8.17 8:e9ecae36:::1000000000d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1ec000 con 0x55576cfe9800 2023-10-03T19:21:04.219 INFO:teuthology.orchestra.run.smithi045.stdout: -3231> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2082 8.37 8:eefe613f:::1000000000e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1f0700 con 0x55576cfe8c00 2023-10-03T19:21:04.219 INFO:teuthology.orchestra.run.smithi045.stdout: -3230> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2083 8.12 8:49e35fbc:::1000000000f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d61e380 con 0x55576cfe9400 2023-10-03T19:21:04.219 INFO:teuthology.orchestra.run.smithi045.stdout: -3229> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2084 8.3b 8:dde6a3df:::10000000010.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1f0a80 con 0x55576d0f0800 2023-10-03T19:21:04.219 INFO:teuthology.orchestra.run.smithi045.stdout: -3228> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2085 8.15 8:ab5910e2:::10000000011.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d589c00 con 0x55576cfe9800 2023-10-03T19:21:04.219 INFO:teuthology.orchestra.run.smithi045.stdout: -3227> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2086 8.d 8:b185e6e8:::10000000012.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d51c700 con 0x55576d0f0000 2023-10-03T19:21:04.219 INFO:teuthology.orchestra.run.smithi045.stdout: -3226> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2087 8.22 8:44834937:::10000000013.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d515880 con 0x55576cfe9800 2023-10-03T19:21:04.220 INFO:teuthology.orchestra.run.smithi045.stdout: -3225> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2088 8.10 8:0b7da9c3:::10000000014.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d256000 con 0x55576cfe9800 2023-10-03T19:21:04.220 INFO:teuthology.orchestra.run.smithi045.stdout: -3224> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2089 8.36 8:6dc1a442:::10000000015.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea05c00 con 0x55576cfe9c00 2023-10-03T19:21:04.220 INFO:teuthology.orchestra.run.smithi045.stdout: -3223> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2090 8.38 8:1e20cbdb:::10000000016.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e8d1180 con 0x55576cfe8c00 2023-10-03T19:21:04.220 INFO:teuthology.orchestra.run.smithi045.stdout: -3222> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2091 8.1e 8:78cea7f0:::10000000017.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e8d0000 con 0x55576cfe8c00 2023-10-03T19:21:04.220 INFO:teuthology.orchestra.run.smithi045.stdout: -3221> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2092 8.1a 8:5b3b19a5:::10000000018.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1b7500 con 0x55576cfe9000 2023-10-03T19:21:04.220 INFO:teuthology.orchestra.run.smithi045.stdout: -3220> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2093 8.21 8:86d8200e:::10000000019.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d0e9500 con 0x55576cfe9000 2023-10-03T19:21:04.220 INFO:teuthology.orchestra.run.smithi045.stdout: -3219> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2094 8.20 8:072a8150:::1000000001a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e9ac000 con 0x55576d0f0000 2023-10-03T19:21:04.220 INFO:teuthology.orchestra.run.smithi045.stdout: -3218> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2095 8.8 8:12420902:::1000000001b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d51dc00 con 0x55576d0f0000 2023-10-03T19:21:04.220 INFO:teuthology.orchestra.run.smithi045.stdout: -3217> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2096 8.16 8:6a54d456:::1000000001c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1b7180 con 0x55576cfe8c00 2023-10-03T19:21:04.220 INFO:teuthology.orchestra.run.smithi045.stdout: -3216> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2097 8.33 8:cf746ac5:::1000000001d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea04000 con 0x55576cfe9c00 2023-10-03T19:21:04.220 INFO:teuthology.orchestra.run.smithi045.stdout: -3215> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2098 8.32 8:4f7da3cc:::1000000001e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea31180 con 0x55576cfe9000 2023-10-03T19:21:04.221 INFO:teuthology.orchestra.run.smithi045.stdout: -3214> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2099 8.3a 8:5f13809d:::1000000001f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1b4700 con 0x55576cfe9c00 2023-10-03T19:21:04.221 INFO:teuthology.orchestra.run.smithi045.stdout: -3213> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2100 8.22 8:4503a7ea:::10000000020.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d515500 con 0x55576cfe9800 2023-10-03T19:21:04.221 INFO:teuthology.orchestra.run.smithi045.stdout: -3212> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2101 8.b 8:d3d0d483:::10000000021.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea30380 con 0x55576cfe8c00 2023-10-03T19:21:04.221 INFO:teuthology.orchestra.run.smithi045.stdout: -3211> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2102 8.b 8:d2626379:::10000000022.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e9ad500 con 0x55576cfe8c00 2023-10-03T19:21:04.221 INFO:teuthology.orchestra.run.smithi045.stdout: -3210> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2103 8.17 8:eb6757d1:::10000000023.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e8d0e00 con 0x55576cfe9800 2023-10-03T19:21:04.221 INFO:teuthology.orchestra.run.smithi045.stdout: -3209> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2104 8.2f 8:f6ddf183:::10000000024.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d257500 con 0x55576cfe9000 2023-10-03T19:21:04.221 INFO:teuthology.orchestra.run.smithi045.stdout: -3208> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2105 8.14 8:2a40c2ef:::10000000025.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e954000 con 0x55576d0f0800 2023-10-03T19:21:04.326 INFO:teuthology.orchestra.run.smithi045.stdout: -3207> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2106 8.3d 8:be1922a8:::10000000026.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea05880 con 0x55576cfe9400 2023-10-03T19:21:04.326 INFO:teuthology.orchestra.run.smithi045.stdout: -3206> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2107 8.d 8:b0d15537:::10000000027.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e954a80 con 0x55576d0f0000 2023-10-03T19:21:04.326 INFO:teuthology.orchestra.run.smithi045.stdout: -3205> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2108 8.1d 8:ba3960b0:::10000000028.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e8fd500 con 0x55576cfe9400 2023-10-03T19:21:04.327 INFO:teuthology.orchestra.run.smithi045.stdout: -3204> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2109 8.18 8:19311010:::10000000029.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea04e00 con 0x55576d0f0800 2023-10-03T19:21:04.327 INFO:teuthology.orchestra.run.smithi045.stdout: -3203> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2110 8.3c 8:3d4c06c4:::1000000002a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e9ace00 con 0x55576cfe9800 2023-10-03T19:21:04.327 INFO:teuthology.orchestra.run.smithi045.stdout: -3202> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2111 8.26 8:645408ac:::1000000002b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e981c00 con 0x55576cfe8c00 2023-10-03T19:21:04.327 INFO:teuthology.orchestra.run.smithi045.stdout: -3201> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2112 8.25 8:a622384a:::1000000002c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e8d1c00 con 0x55576cfe9c00 2023-10-03T19:21:04.327 INFO:teuthology.orchestra.run.smithi045.stdout: -3200> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2113 8.26 8:660982fc:::1000000002d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea30a80 con 0x55576cfe8c00 2023-10-03T19:21:04.327 INFO:teuthology.orchestra.run.smithi045.stdout: -3199> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2114 8.12 8:49ffa098:::1000000002e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e9dbc00 con 0x55576cfe9400 2023-10-03T19:21:04.327 INFO:teuthology.orchestra.run.smithi045.stdout: -3198> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2115 8.23 8:c550f404:::1000000002f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e9db500 con 0x55576cfe9000 2023-10-03T19:21:04.327 INFO:teuthology.orchestra.run.smithi045.stdout: -3197> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2116 8.3 8:c1adcc3d:::10000000030.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7b6380 con 0x55576cfe9c00 2023-10-03T19:21:04.327 INFO:teuthology.orchestra.run.smithi045.stdout: -3196> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2117 8.1b 8:d88bb762:::10000000031.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d274000 con 0x55576d0f0800 2023-10-03T19:21:04.328 INFO:teuthology.orchestra.run.smithi045.stdout: -3195> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2118 8.31 8:8ea80fc8:::10000000032.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e9ac380 con 0x55576cfe9800 2023-10-03T19:21:04.328 INFO:teuthology.orchestra.run.smithi045.stdout: -3194> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2119 8.3e 8:7e2d0da6:::10000000033.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e981180 con 0x55576cfe9800 2023-10-03T19:21:04.328 INFO:teuthology.orchestra.run.smithi045.stdout: -3193> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2120 8.1 8:81df0dbf:::10000000034.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e954e00 con 0x55576cfe9c00 2023-10-03T19:21:04.328 INFO:teuthology.orchestra.run.smithi045.stdout: -3192> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2121 8.38 8:1e1620c8:::10000000035.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d6d7500 con 0x55576cfe8c00 2023-10-03T19:21:04.328 INFO:teuthology.orchestra.run.smithi045.stdout: -3191> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2122 8.2b 8:d747f723:::10000000036.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e955500 con 0x55576cfe9400 2023-10-03T19:21:04.328 INFO:teuthology.orchestra.run.smithi045.stdout: -3190> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2123 8.6 8:60a13eb4:::10000000037.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e980700 con 0x55576cfe9000 2023-10-03T19:21:04.328 INFO:teuthology.orchestra.run.smithi045.stdout: -3189> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2124 8.26 8:65f9ba37:::10000000038.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea30700 con 0x55576cfe8c00 2023-10-03T19:21:04.329 INFO:teuthology.orchestra.run.smithi045.stdout: -3188> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2125 8.22 8:44135715:::10000000039.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e9da000 con 0x55576cfe9800 2023-10-03T19:21:04.329 INFO:teuthology.orchestra.run.smithi045.stdout: -3187> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2126 8.f 8:f1a9c549:::1000000003a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d274380 con 0x55576cfe8c00 2023-10-03T19:21:04.329 INFO:teuthology.orchestra.run.smithi045.stdout: -3186> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2127 8.3c 8:3c3d7520:::1000000003b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d256e00 con 0x55576cfe9800 2023-10-03T19:21:04.329 INFO:teuthology.orchestra.run.smithi045.stdout: -3185> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2128 8.8 8:12420646:::1000000003c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e926e00 con 0x55576d0f0000 2023-10-03T19:21:04.329 INFO:teuthology.orchestra.run.smithi045.stdout: -3184> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2129 8.6 8:614fee2a:::1000000003d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d51d180 con 0x55576cfe9000 2023-10-03T19:21:04.329 INFO:teuthology.orchestra.run.smithi045.stdout: -3183> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2130 8.2c 8:3665eb52:::1000000003e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d5f0000 con 0x55576cfe9400 2023-10-03T19:21:04.329 INFO:teuthology.orchestra.run.smithi045.stdout: -3182> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2131 8.32 8:4ecb6bb7:::1000000003f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1b4a80 con 0x55576cfe9000 2023-10-03T19:21:04.329 INFO:teuthology.orchestra.run.smithi045.stdout: -3181> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2132 8.23 8:c6a0a389:::10000000040.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1b1c00 con 0x55576cfe9000 2023-10-03T19:21:04.329 INFO:teuthology.orchestra.run.smithi045.stdout: -3180> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2133 8.2b 8:d4b9b687:::10000000041.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d519880 con 0x55576cfe9400 2023-10-03T19:21:04.329 INFO:teuthology.orchestra.run.smithi045.stdout: -3179> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2134 8.6 8:61404748:::10000000042.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d61f180 con 0x55576cfe9000 2023-10-03T19:21:04.330 INFO:teuthology.orchestra.run.smithi045.stdout: -3178> 2023-10-03T19:16:29.326+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2135 8.16 8:6a415a36:::10000000043.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d514000 con 0x55576cfe8c00 2023-10-03T19:21:04.330 INFO:teuthology.orchestra.run.smithi045.stdout: -3177> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2136 8.1a 8:5bd35317:::10000000044.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d212e00 con 0x55576cfe9000 2023-10-03T19:21:04.330 INFO:teuthology.orchestra.run.smithi045.stdout: -3176> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2137 8.36 8:6f6f8b6e:::10000000045.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d266000 con 0x55576cfe9c00 2023-10-03T19:21:04.330 INFO:teuthology.orchestra.run.smithi045.stdout: -3175> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2138 8.26 8:678705fb:::10000000046.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1f1500 con 0x55576cfe8c00 2023-10-03T19:21:04.330 INFO:teuthology.orchestra.run.smithi045.stdout: -3174> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2139 8.8 8:1044c7a4:::10000000047.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d80ce00 con 0x55576d0f0000 2023-10-03T19:21:04.330 INFO:teuthology.orchestra.run.smithi045.stdout: -3173> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2140 8.12 8:4899516f:::10000000048.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e9da380 con 0x55576cfe9400 2023-10-03T19:21:04.330 INFO:teuthology.orchestra.run.smithi045.stdout: -3172> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2141 8.7 8:e2d50132:::10000000049.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e8fd880 con 0x55576cfe9c00 2023-10-03T19:21:04.331 INFO:teuthology.orchestra.run.smithi045.stdout: -3171> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2142 8.2f 8:f7911ae7:::1000000004a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e981880 con 0x55576cfe9000 2023-10-03T19:21:04.331 INFO:teuthology.orchestra.run.smithi045.stdout: -3170> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2143 8.31 8:8e5cc622:::1000000004b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e980000 con 0x55576cfe9800 2023-10-03T19:21:04.331 INFO:teuthology.orchestra.run.smithi045.stdout: -3169> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2144 8.21 8:844eae9e:::1000000004c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e955880 con 0x55576cfe9000 2023-10-03T19:21:04.331 INFO:teuthology.orchestra.run.smithi045.stdout: -3168> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2145 8.36 8:6c82bb73:::1000000004d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d0f8a80 con 0x55576cfe9c00 2023-10-03T19:21:04.331 INFO:teuthology.orchestra.run.smithi045.stdout: -3167> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.19:2146 8.29 8:954bc910:::1000000004e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d61ea80 con 0x55576d0f0400 2023-10-03T19:21:04.331 INFO:teuthology.orchestra.run.smithi045.stdout: -3166> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2147 8.21 8:8660ae9f:::1000000004f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea05500 con 0x55576cfe9000 2023-10-03T19:21:04.331 INFO:teuthology.orchestra.run.smithi045.stdout: -3165> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2148 8.16 8:69de5632:::10000000050.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e9adc00 con 0x55576cfe8c00 2023-10-03T19:21:04.331 INFO:teuthology.orchestra.run.smithi045.stdout: -3164> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2149 8.19 8:9ae7aaf4:::10000000051.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e8fc000 con 0x55576d0f0000 2023-10-03T19:21:04.331 INFO:teuthology.orchestra.run.smithi045.stdout: -3163> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2150 8.b 8:d30f9a54:::10000000052.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d0e9c00 con 0x55576cfe8c00 2023-10-03T19:21:04.331 INFO:teuthology.orchestra.run.smithi045.stdout: -3162> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2151 8.16 8:6a23747e:::10000000053.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d656000 con 0x55576cfe8c00 2023-10-03T19:21:04.331 INFO:teuthology.orchestra.run.smithi045.stdout: -3161> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2152 8.0 8:03de5254:::10000000054.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d656700 con 0x55576cfe8c00 2023-10-03T19:21:04.332 INFO:teuthology.orchestra.run.smithi045.stdout: -3160> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2153 8.32 8:4d757255:::10000000055.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1cb180 con 0x55576cfe9000 2023-10-03T19:21:04.332 INFO:teuthology.orchestra.run.smithi045.stdout: -3159> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2154 8.28 8:166e0f51:::10000000056.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7b9c00 con 0x55576cfe9000 2023-10-03T19:21:04.332 INFO:teuthology.orchestra.run.smithi045.stdout: -3158> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2155 8.2e 8:74dc0bdf:::10000000057.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7b9880 con 0x55576cfe9800 2023-10-03T19:21:04.332 INFO:teuthology.orchestra.run.smithi045.stdout: -3157> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2156 8.14 8:2b0a3bc5:::10000000058.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7b9500 con 0x55576d0f0800 2023-10-03T19:21:04.332 INFO:teuthology.orchestra.run.smithi045.stdout: -3156> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2157 8.31 8:8ff022d2:::10000000059.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7b9180 con 0x55576cfe9800 2023-10-03T19:21:04.332 INFO:teuthology.orchestra.run.smithi045.stdout: -3155> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2158 8.18 8:1ae6cdf3:::1000000005a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7b8e00 con 0x55576d0f0800 2023-10-03T19:21:04.332 INFO:teuthology.orchestra.run.smithi045.stdout: -3154> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2159 8.39 8:9fc48627:::1000000005b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7b8a80 con 0x55576cfe9000 2023-10-03T19:21:04.332 INFO:teuthology.orchestra.run.smithi045.stdout: -3153> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2160 8.30 8:0cbf7f79:::1000000005c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7b8700 con 0x55576cfe9c00 2023-10-03T19:21:04.338 INFO:teuthology.orchestra.run.smithi045.stdout: -3152> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2161 8.2d 8:b5236558:::1000000005d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7b6000 con 0x55576cfe9000 2023-10-03T19:21:04.338 INFO:teuthology.orchestra.run.smithi045.stdout: -3151> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2162 8.21 8:870ac4b3:::1000000005e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d518700 con 0x55576cfe9000 2023-10-03T19:21:04.338 INFO:teuthology.orchestra.run.smithi045.stdout: -3150> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2163 8.2c 8:34658595:::1000000005f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d275c00 con 0x55576cfe9400 2023-10-03T19:21:04.338 INFO:teuthology.orchestra.run.smithi045.stdout: -3149> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2164 8.3 8:c001b242:::10000000060.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d212380 con 0x55576cfe9c00 2023-10-03T19:21:04.338 INFO:teuthology.orchestra.run.smithi045.stdout: -3148> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2165 8.0 8:0181e5f0:::10000000061.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d212700 con 0x55576cfe8c00 2023-10-03T19:21:04.338 INFO:teuthology.orchestra.run.smithi045.stdout: -3147> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2166 8.30 8:0d373645:::10000000062.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d213500 con 0x55576cfe9c00 2023-10-03T19:21:04.339 INFO:teuthology.orchestra.run.smithi045.stdout: -3146> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2167 8.26 8:66f1e28f:::10000000063.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d5f1500 con 0x55576cfe8c00 2023-10-03T19:21:04.339 INFO:teuthology.orchestra.run.smithi045.stdout: -3145> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2168 8.20 8:0699973a:::10000000064.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d5f0700 con 0x55576d0f0000 2023-10-03T19:21:04.339 INFO:teuthology.orchestra.run.smithi045.stdout: -3144> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2169 8.f 8:f2d196a0:::10000000065.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d0e8e00 con 0x55576cfe8c00 2023-10-03T19:21:04.339 INFO:teuthology.orchestra.run.smithi045.stdout: -3143> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2170 8.38 8:1cab634c:::10000000066.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1b5180 con 0x55576cfe8c00 2023-10-03T19:21:04.339 INFO:teuthology.orchestra.run.smithi045.stdout: -3142> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2171 8.37 8:ef5f0c51:::10000000067.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d257880 con 0x55576cfe8c00 2023-10-03T19:21:04.339 INFO:teuthology.orchestra.run.smithi045.stdout: -3141> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2172 8.1c 8:3b87fee9:::10000000068.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d6d7880 con 0x55576d0f0000 2023-10-03T19:21:04.339 INFO:teuthology.orchestra.run.smithi045.stdout: -3140> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2173 8.3 8:c2cd23b6:::10000000069.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d514700 con 0x55576cfe9c00 2023-10-03T19:21:04.339 INFO:teuthology.orchestra.run.smithi045.stdout: -3139> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2174 8.c 8:31e782ee:::1000000006a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d218a80 con 0x55576cfe9000 2023-10-03T19:21:04.339 INFO:teuthology.orchestra.run.smithi045.stdout: -3138> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2175 8.1d 8:bbf235fa:::1000000006b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d51a380 con 0x55576cfe9400 2023-10-03T19:21:04.339 INFO:teuthology.orchestra.run.smithi045.stdout: -3137> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2176 8.2b 8:d50f8d72:::1000000006c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d0f8700 con 0x55576cfe9400 2023-10-03T19:21:04.339 INFO:teuthology.orchestra.run.smithi045.stdout: -3136> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2177 8.37 8:eeccecf9:::1000000006d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1fdc00 con 0x55576cfe8c00 2023-10-03T19:21:04.340 INFO:teuthology.orchestra.run.smithi045.stdout: -3135> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2178 8.11 8:88725faf:::1000000006e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d3d2a80 con 0x55576d0f0000 2023-10-03T19:21:04.340 INFO:teuthology.orchestra.run.smithi045.stdout: -3134> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2179 8.21 8:862b00fc:::1000000006f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d5dc700 con 0x55576cfe9000 2023-10-03T19:21:04.340 INFO:teuthology.orchestra.run.smithi045.stdout: -3133> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2180 8.1d 8:b941cebe:::10000000070.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1b5500 con 0x55576cfe9400 2023-10-03T19:21:04.340 INFO:teuthology.orchestra.run.smithi045.stdout: -3132> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2181 8.10 8:0b002978:::10000000071.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d6ba000 con 0x55576cfe9800 2023-10-03T19:21:04.340 INFO:teuthology.orchestra.run.smithi045.stdout: -3131> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2182 8.2e 8:74d940fa:::10000000072.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d3d2000 con 0x55576cfe9800 2023-10-03T19:21:04.340 INFO:teuthology.orchestra.run.smithi045.stdout: -3130> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2183 8.e 8:730aba89:::10000000073.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d51a700 con 0x55576cfe9000 2023-10-03T19:21:04.340 INFO:teuthology.orchestra.run.smithi045.stdout: -3129> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2184 8.22 8:46f2014a:::10000000074.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1b6a80 con 0x55576cfe9800 2023-10-03T19:21:04.340 INFO:teuthology.orchestra.run.smithi045.stdout: -3128> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2185 8.4 8:2045e544:::10000000075.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d588e00 con 0x55576d0f0000 2023-10-03T19:21:04.340 INFO:teuthology.orchestra.run.smithi045.stdout: -3127> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2186 8.13 8:ca508270:::10000000076.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1cae00 con 0x55576cfe8c00 2023-10-03T19:21:04.340 INFO:teuthology.orchestra.run.smithi045.stdout: -3126> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2187 8.1d 8:bab01cd9:::10000000077.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d59e000 con 0x55576cfe9400 2023-10-03T19:21:04.341 INFO:teuthology.orchestra.run.smithi045.stdout: -3125> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2188 8.38 8:1da7f472:::10000000078.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d266380 con 0x55576cfe8c00 2023-10-03T19:21:04.341 INFO:teuthology.orchestra.run.smithi045.stdout: -3124> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2189 8.19 8:99ec5763:::10000000079.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d218e00 con 0x55576d0f0000 2023-10-03T19:21:04.341 INFO:teuthology.orchestra.run.smithi045.stdout: -3123> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2190 8.2 8:4211db15:::1000000007a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d219880 con 0x55576d0f0800 2023-10-03T19:21:04.341 INFO:teuthology.orchestra.run.smithi045.stdout: -3122> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2191 8.a 8:51fb4558:::1000000007b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d656a80 con 0x55576cfe9c00 2023-10-03T19:21:04.341 INFO:teuthology.orchestra.run.smithi045.stdout: -3121> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2192 8.1d 8:bb142d16:::1000000007c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d657c00 con 0x55576cfe9400 2023-10-03T19:21:04.341 INFO:teuthology.orchestra.run.smithi045.stdout: -3120> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2193 8.1e 8:7ab9e14a:::1000000007d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1b0e00 con 0x55576cfe8c00 2023-10-03T19:21:04.341 INFO:teuthology.orchestra.run.smithi045.stdout: -3119> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2194 8.3d 8:bf02216c:::1000000007e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d589500 con 0x55576cfe9400 2023-10-03T19:21:04.341 INFO:teuthology.orchestra.run.smithi045.stdout: -3118> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2195 8.30 8:0ffe11ed:::1000000007f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d0f6e00 con 0x55576cfe9c00 2023-10-03T19:21:04.341 INFO:teuthology.orchestra.run.smithi045.stdout: -3117> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2196 8.30 8:0f444cf3:::10000000080.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d218700 con 0x55576cfe9c00 2023-10-03T19:21:04.341 INFO:teuthology.orchestra.run.smithi045.stdout: -3116> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2197 8.3 8:c27cb132:::10000000081.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d6bb180 con 0x55576cfe9c00 2023-10-03T19:21:04.341 INFO:teuthology.orchestra.run.smithi045.stdout: -3115> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2198 8.39 8:9eab5bef:::10000000082.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d656380 con 0x55576cfe9000 2023-10-03T19:21:04.342 INFO:teuthology.orchestra.run.smithi045.stdout: -3114> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2199 8.26 8:67d353d7:::10000000083.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1fc700 con 0x55576cfe8c00 2023-10-03T19:21:04.342 INFO:teuthology.orchestra.run.smithi045.stdout: -3113> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2200 8.4 8:21b748bd:::10000000084.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d257180 con 0x55576d0f0000 2023-10-03T19:21:04.342 INFO:teuthology.orchestra.run.smithi045.stdout: -3112> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2201 8.10 8:0a074d4e:::10000000085.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1b5880 con 0x55576cfe9800 2023-10-03T19:21:04.342 INFO:teuthology.orchestra.run.smithi045.stdout: -3111> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2202 8.2e 8:74218cdb:::10000000086.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1b4e00 con 0x55576cfe9800 2023-10-03T19:21:04.342 INFO:teuthology.orchestra.run.smithi045.stdout: -3110> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2203 8.8 8:10a36097:::10000000087.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d61e700 con 0x55576d0f0000 2023-10-03T19:21:04.342 INFO:teuthology.orchestra.run.smithi045.stdout: -3109> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2204 8.2f 8:f7140720:::10000000088.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d61f500 con 0x55576cfe9000 2023-10-03T19:21:04.342 INFO:teuthology.orchestra.run.smithi045.stdout: -3108> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2205 8.34 8:2e115d36:::10000000089.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576c113500 con 0x55576cfe8c00 2023-10-03T19:21:04.342 INFO:teuthology.orchestra.run.smithi045.stdout: -3107> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.19:2206 8.35 8:ae88c9e9:::1000000008a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d589880 con 0x55576d0f0400 2023-10-03T19:21:04.342 INFO:teuthology.orchestra.run.smithi045.stdout: -3106> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2207 8.8 8:13275b8b:::1000000008b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1cbc00 con 0x55576d0f0000 2023-10-03T19:21:04.343 INFO:teuthology.orchestra.run.smithi045.stdout: -3105> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2208 8.3c 8:3c2e7968:::1000000008c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d691c00 con 0x55576cfe9800 2023-10-03T19:21:04.343 INFO:teuthology.orchestra.run.smithi045.stdout: -3104> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2209 8.26 8:67acbfb4:::1000000008d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d691880 con 0x55576cfe8c00 2023-10-03T19:21:04.343 INFO:teuthology.orchestra.run.smithi045.stdout: -3103> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2210 8.36 8:6cf8d55a:::1000000008e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d6d7c00 con 0x55576cfe9c00 2023-10-03T19:21:04.343 INFO:teuthology.orchestra.run.smithi045.stdout: -3102> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2211 8.2d 8:b6d5679c:::1000000008f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1b6000 con 0x55576cfe9000 2023-10-03T19:21:04.343 INFO:teuthology.orchestra.run.smithi045.stdout: -3101> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2212 8.23 8:c454cd7f:::10000000090.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1af500 con 0x55576cfe9000 2023-10-03T19:21:04.343 INFO:teuthology.orchestra.run.smithi045.stdout: -3100> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2213 8.14 8:2b22960d:::10000000091.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1ae700 con 0x55576d0f0800 2023-10-03T19:21:04.343 INFO:teuthology.orchestra.run.smithi045.stdout: -3099> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2214 8.c 8:317b49a4:::10000000092.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1fce00 con 0x55576cfe9000 2023-10-03T19:21:04.343 INFO:teuthology.orchestra.run.smithi045.stdout: -3098> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2215 8.c 8:30dd2ab9:::10000000093.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d690e00 con 0x55576cfe9000 2023-10-03T19:21:04.343 INFO:teuthology.orchestra.run.smithi045.stdout: -3097> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2216 8.13 8:c844618d:::10000000094.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1b4000 con 0x55576cfe8c00 2023-10-03T19:21:04.343 INFO:teuthology.orchestra.run.smithi045.stdout: -3096> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2217 8.12 8:4aa41a21:::10000000095.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d3d3c00 con 0x55576cfe9400 2023-10-03T19:21:04.343 INFO:teuthology.orchestra.run.smithi045.stdout: -3095> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2218 8.33 8:cee3daff:::10000000096.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d690a80 con 0x55576cfe9c00 2023-10-03T19:21:04.343 INFO:teuthology.orchestra.run.smithi045.stdout: -3094> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2219 8.3f 8:fc8be962:::10000000097.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d275180 con 0x55576cfe9c00 2023-10-03T19:21:04.344 INFO:teuthology.orchestra.run.smithi045.stdout: -3093> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2220 8.2e 8:77d1cb76:::10000000098.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d518e00 con 0x55576cfe9800 2023-10-03T19:21:04.344 INFO:teuthology.orchestra.run.smithi045.stdout: -3092> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2221 8.32 8:4e69e568:::10000000099.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d5f1880 con 0x55576cfe9000 2023-10-03T19:21:04.344 INFO:teuthology.orchestra.run.smithi045.stdout: -3091> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2222 8.0 8:03c4ee74:::1000000009a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d275500 con 0x55576cfe8c00 2023-10-03T19:21:04.366 INFO:teuthology.orchestra.run.smithi045.stdout: -3090> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2223 8.37 8:eccff461:::1000000009b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d5dd880 con 0x55576cfe8c00 2023-10-03T19:21:04.367 INFO:teuthology.orchestra.run.smithi045.stdout: -3089> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2224 8.36 8:6c8b6cb2:::1000000009c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d3d3880 con 0x55576cfe9c00 2023-10-03T19:21:04.367 INFO:teuthology.orchestra.run.smithi045.stdout: -3088> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2225 8.36 8:6f6a1eb0:::1000000009d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1ca000 con 0x55576cfe9c00 2023-10-03T19:21:04.367 INFO:teuthology.orchestra.run.smithi045.stdout: -3087> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2226 8.e 8:70913c6f:::1000000009e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d5dce00 con 0x55576cfe9000 2023-10-03T19:21:04.367 INFO:teuthology.orchestra.run.smithi045.stdout: -3086> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2227 8.33 8:cf652552:::1000000009f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d5f1c00 con 0x55576cfe9c00 2023-10-03T19:21:04.367 INFO:teuthology.orchestra.run.smithi045.stdout: -3085> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2228 8.2b 8:d4ac5e36:::100000000a0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d51a000 con 0x55576cfe9400 2023-10-03T19:21:04.367 INFO:teuthology.orchestra.run.smithi045.stdout: -3084> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2229 8.4 8:23d81b1d:::100000000a1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d267c00 con 0x55576d0f0000 2023-10-03T19:21:04.367 INFO:teuthology.orchestra.run.smithi045.stdout: -3083> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2230 8.2a 8:5644b0dd:::100000000a2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d3d3500 con 0x55576cfe8c00 2023-10-03T19:21:04.367 INFO:teuthology.orchestra.run.smithi045.stdout: -3082> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2231 8.14 8:2800edac:::100000000a3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d5f0a80 con 0x55576d0f0800 2023-10-03T19:21:04.367 INFO:teuthology.orchestra.run.smithi045.stdout: -3081> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2232 8.c 8:33682534:::100000000a4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d6d6a80 con 0x55576cfe9000 2023-10-03T19:21:04.367 INFO:teuthology.orchestra.run.smithi045.stdout: -3080> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2233 8.1c 8:3948beee:::100000000a5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d51ae00 con 0x55576d0f0000 2023-10-03T19:21:04.367 INFO:teuthology.orchestra.run.smithi045.stdout: -3079> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2234 8.1 8:82c5dbfa:::100000000a6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d6d6000 con 0x55576cfe9c00 2023-10-03T19:21:04.368 INFO:teuthology.orchestra.run.smithi045.stdout: -3078> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2235 8.2d 8:b683ac1f:::100000000a7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d6bb500 con 0x55576cfe9000 2023-10-03T19:21:04.368 INFO:teuthology.orchestra.run.smithi045.stdout: -3077> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2236 8.33 8:cf66c3a3:::100000000a8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d5f1180 con 0x55576cfe9c00 2023-10-03T19:21:04.368 INFO:teuthology.orchestra.run.smithi045.stdout: -3076> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2237 8.12 8:496373b3:::100000000a9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d5f0380 con 0x55576cfe9400 2023-10-03T19:21:04.368 INFO:teuthology.orchestra.run.smithi045.stdout: -3075> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2238 8.3b 8:dfd961c9:::100000000aa.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d257c00 con 0x55576d0f0800 2023-10-03T19:21:04.368 INFO:teuthology.orchestra.run.smithi045.stdout: -3074> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2239 8.28 8:16ce2f56:::100000000ab.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d256380 con 0x55576cfe9000 2023-10-03T19:21:04.368 INFO:teuthology.orchestra.run.smithi045.stdout: -3073> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2240 8.26 8:65e71c10:::100000000ac.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d3d2700 con 0x55576cfe8c00 2023-10-03T19:21:04.368 INFO:teuthology.orchestra.run.smithi045.stdout: -3072> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2241 8.3c 8:3ca8796c:::100000000ad.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d657500 con 0x55576cfe9800 2023-10-03T19:21:04.368 INFO:teuthology.orchestra.run.smithi045.stdout: -3071> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2242 8.2b 8:d77b40aa:::100000000ae.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1b6700 con 0x55576cfe9400 2023-10-03T19:21:04.368 INFO:teuthology.orchestra.run.smithi045.stdout: -3070> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2243 8.8 8:12260154:::100000000af.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1fc000 con 0x55576d0f0000 2023-10-03T19:21:04.368 INFO:teuthology.orchestra.run.smithi045.stdout: -3069> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2244 8.19 8:99a6d8b2:::100000000b0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d6d6700 con 0x55576d0f0000 2023-10-03T19:21:04.368 INFO:teuthology.orchestra.run.smithi045.stdout: -3068> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2245 8.25 8:a4b351a2:::100000000b1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d256700 con 0x55576cfe9c00 2023-10-03T19:21:04.369 INFO:teuthology.orchestra.run.smithi045.stdout: -3067> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2246 8.20 8:05e903ec:::100000000b2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d0f6700 con 0x55576d0f0000 2023-10-03T19:21:04.369 INFO:teuthology.orchestra.run.smithi045.stdout: -3066> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2247 8.1d 8:bbfd17d2:::100000000b3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1b7880 con 0x55576cfe9400 2023-10-03T19:21:04.369 INFO:teuthology.orchestra.run.smithi045.stdout: -3065> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2248 8.3f 8:fc47e501:::100000000b4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d5dd180 con 0x55576cfe9c00 2023-10-03T19:21:04.369 INFO:teuthology.orchestra.run.smithi045.stdout: -3064> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.19:2249 8.29 8:959d3147:::100000000b5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d51d500 con 0x55576d0f0400 2023-10-03T19:21:04.369 INFO:teuthology.orchestra.run.smithi045.stdout: -3063> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2250 8.21 8:869f8614:::100000000b6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1ed500 con 0x55576cfe9000 2023-10-03T19:21:04.369 INFO:teuthology.orchestra.run.smithi045.stdout: -3062> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2251 8.13 8:c826941c:::100000000b7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d51ce00 con 0x55576cfe8c00 2023-10-03T19:21:04.369 INFO:teuthology.orchestra.run.smithi045.stdout: -3061> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2252 8.23 8:c7a7e7ed:::100000000b8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d0e8380 con 0x55576cfe9000 2023-10-03T19:21:04.369 INFO:teuthology.orchestra.run.smithi045.stdout: -3060> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2253 8.2a 8:576d20de:::100000000b9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d691500 con 0x55576cfe8c00 2023-10-03T19:21:04.369 INFO:teuthology.orchestra.run.smithi045.stdout: -3059> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2254 8.28 8:14bef4b2:::100000000ba.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d51c000 con 0x55576cfe9000 2023-10-03T19:21:04.369 INFO:teuthology.orchestra.run.smithi045.stdout: -3058> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2255 8.4 8:21fe71c4:::100000000bb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1cb500 con 0x55576d0f0000 2023-10-03T19:21:04.369 INFO:teuthology.orchestra.run.smithi045.stdout: -3057> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2256 8.1d 8:ba036218:::100000000bc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d3d2380 con 0x55576cfe9400 2023-10-03T19:21:04.370 INFO:teuthology.orchestra.run.smithi045.stdout: -3056> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2257 8.2 8:43b4b389:::100000000bd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1b6e00 con 0x55576d0f0800 2023-10-03T19:21:04.370 INFO:teuthology.orchestra.run.smithi045.stdout: -3055> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2258 8.18 8:196d4b2b:::100000000be.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d588a80 con 0x55576d0f0800 2023-10-03T19:21:04.370 INFO:teuthology.orchestra.run.smithi045.stdout: -3054> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2259 8.2f 8:f46eb3ed:::100000000bf.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d690700 con 0x55576cfe9000 2023-10-03T19:21:04.370 INFO:teuthology.orchestra.run.smithi045.stdout: -3053> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2260 8.2 8:42142be5:::100000000c0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d0f7c00 con 0x55576d0f0800 2023-10-03T19:21:04.370 INFO:teuthology.orchestra.run.smithi045.stdout: -3052> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2261 8.18 8:18cb83ce:::100000000c1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e8fce00 con 0x55576d0f0800 2023-10-03T19:21:04.370 INFO:teuthology.orchestra.run.smithi045.stdout: -3051> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2262 8.36 8:6c9ae960:::100000000c2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e927180 con 0x55576cfe9c00 2023-10-03T19:21:04.370 INFO:teuthology.orchestra.run.smithi045.stdout: -3050> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2263 8.1f 8:f8d20c92:::100000000c3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e927880 con 0x55576cfe9000 2023-10-03T19:21:04.370 INFO:teuthology.orchestra.run.smithi045.stdout: -3049> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2264 8.1c 8:3990871b:::100000000c4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e927c00 con 0x55576d0f0000 2023-10-03T19:21:04.370 INFO:teuthology.orchestra.run.smithi045.stdout: -3048> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2265 8.16 8:680c46c7:::100000000c5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e954380 con 0x55576cfe8c00 2023-10-03T19:21:04.370 INFO:teuthology.orchestra.run.smithi045.stdout: -3047> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2266 8.17 8:eb7dd551:::100000000c6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e955180 con 0x55576cfe9800 2023-10-03T19:21:04.371 INFO:teuthology.orchestra.run.smithi045.stdout: -3046> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2267 8.36 8:6e30e37c:::100000000c7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e955c00 con 0x55576cfe9c00 2023-10-03T19:21:04.371 INFO:teuthology.orchestra.run.smithi045.stdout: -3045> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2268 8.f 8:f28dc9ad:::100000000c8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e981500 con 0x55576cfe8c00 2023-10-03T19:21:04.371 INFO:teuthology.orchestra.run.smithi045.stdout: -3044> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2269 8.11 8:8a614455:::100000000c9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e9ac700 con 0x55576d0f0000 2023-10-03T19:21:04.371 INFO:teuthology.orchestra.run.smithi045.stdout: -3043> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2270 8.2 8:418539fe:::100000000ca.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea04380 con 0x55576d0f0800 2023-10-03T19:21:04.371 INFO:teuthology.orchestra.run.smithi045.stdout: -3042> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2271 8.3a 8:5e2665ab:::100000000cb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea04700 con 0x55576cfe9c00 2023-10-03T19:21:04.371 INFO:teuthology.orchestra.run.smithi045.stdout: -3041> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2272 8.3e 8:7db06380:::100000000cc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea04a80 con 0x55576cfe9800 2023-10-03T19:21:04.371 INFO:teuthology.orchestra.run.smithi045.stdout: -3040> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2273 8.33 8:cc35cb30:::100000000cd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea05180 con 0x55576cfe9c00 2023-10-03T19:21:04.371 INFO:teuthology.orchestra.run.smithi045.stdout: -3039> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2274 8.11 8:89a13bde:::100000000ce.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea30e00 con 0x55576d0f0000 2023-10-03T19:21:04.371 INFO:teuthology.orchestra.run.smithi045.stdout: -3038> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2275 8.19 8:9baaf7f1:::100000000cf.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7b8380 con 0x55576d0f0000 2023-10-03T19:21:04.371 INFO:teuthology.orchestra.run.smithi045.stdout: -3037> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2276 8.1b 8:d9cb565c:::100000000d0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d0f8380 con 0x55576d0f0800 2023-10-03T19:21:04.371 INFO:teuthology.orchestra.run.smithi045.stdout: -3036> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2277 8.5 8:a391cf2b:::100000000d1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d0e9880 con 0x55576cfe9400 2023-10-03T19:21:04.372 INFO:teuthology.orchestra.run.smithi045.stdout: -3035> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2278 8.38 8:1e907e28:::100000000d2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1b0380 con 0x55576cfe8c00 2023-10-03T19:21:04.372 INFO:teuthology.orchestra.run.smithi045.stdout: -3034> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2279 8.17 8:e88d3223:::100000000d3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d690380 con 0x55576cfe9800 2023-10-03T19:21:04.372 INFO:teuthology.orchestra.run.smithi045.stdout: -3033> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2280 8.b 8:d02f84b5:::100000000d4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7b6e00 con 0x55576cfe8c00 2023-10-03T19:21:04.372 INFO:teuthology.orchestra.run.smithi045.stdout: -3032> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.19:2281 8.29 8:963c36ab:::100000000d5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d518a80 con 0x55576d0f0400 2023-10-03T19:21:04.372 INFO:teuthology.orchestra.run.smithi045.stdout: -3031> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2282 8.1c 8:38569cab:::100000000d6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d519c00 con 0x55576d0f0000 2023-10-03T19:21:04.372 INFO:teuthology.orchestra.run.smithi045.stdout: -3030> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2283 8.18 8:1bd5bb9e:::100000000d7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d275880 con 0x55576d0f0800 2023-10-03T19:21:04.377 INFO:teuthology.orchestra.run.smithi045.stdout: -3029> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2284 8.1e 8:7b9ba906:::100000000d8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e980e00 con 0x55576cfe8c00 2023-10-03T19:21:04.377 INFO:teuthology.orchestra.run.smithi045.stdout: -3028> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2285 8.10 8:09e2658b:::100000000d9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e980380 con 0x55576cfe9800 2023-10-03T19:21:04.377 INFO:teuthology.orchestra.run.smithi045.stdout: -3027> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2286 8.21 8:84e04a5a:::100000000da.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e954700 con 0x55576cfe9000 2023-10-03T19:21:04.377 INFO:teuthology.orchestra.run.smithi045.stdout: -3026> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2287 8.15 8:aa9378d8:::100000000db.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e926000 con 0x55576cfe9800 2023-10-03T19:21:04.377 INFO:teuthology.orchestra.run.smithi045.stdout: -3025> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2288 8.13 8:c84cd983:::100000000dc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e926380 con 0x55576cfe8c00 2023-10-03T19:21:04.377 INFO:teuthology.orchestra.run.smithi045.stdout: -3024> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2289 8.26 8:65f6e386:::100000000dd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e926700 con 0x55576cfe8c00 2023-10-03T19:21:04.377 INFO:teuthology.orchestra.run.smithi045.stdout: -3023> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2290 8.f 8:f1207765:::100000000de.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e927500 con 0x55576cfe8c00 2023-10-03T19:21:04.378 INFO:teuthology.orchestra.run.smithi045.stdout: -3022> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2291 8.2f 8:f71b5472:::100000000df.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e8fd180 con 0x55576cfe9000 2023-10-03T19:21:04.378 INFO:teuthology.orchestra.run.smithi045.stdout: -3021> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2292 8.3 8:c239e8b3:::100000000e0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e8fc380 con 0x55576cfe9c00 2023-10-03T19:21:04.378 INFO:teuthology.orchestra.run.smithi045.stdout: -3020> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2293 8.17 8:eba7c799:::100000000e1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e8fca80 con 0x55576cfe9800 2023-10-03T19:21:04.378 INFO:teuthology.orchestra.run.smithi045.stdout: -3019> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2294 8.12 8:4a996524:::100000000e2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e8d0700 con 0x55576cfe9400 2023-10-03T19:21:04.378 INFO:teuthology.orchestra.run.smithi045.stdout: -3018> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2295 8.1f 8:f93d8c0a:::100000000e3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e8d1500 con 0x55576cfe9000 2023-10-03T19:21:04.378 INFO:teuthology.orchestra.run.smithi045.stdout: -3017> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2296 8.39 8:9c66f7cb:::100000000e4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e8d0380 con 0x55576cfe9000 2023-10-03T19:21:04.378 INFO:teuthology.orchestra.run.smithi045.stdout: -3016> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2297 8.1d 8:bba66d05:::100000000e5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e8d0a80 con 0x55576cfe9400 2023-10-03T19:21:04.378 INFO:teuthology.orchestra.run.smithi045.stdout: -3015> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2298 8.39 8:9de3e889:::100000000e6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e8d1880 con 0x55576cfe9000 2023-10-03T19:21:04.378 INFO:teuthology.orchestra.run.smithi045.stdout: -3014> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2299 8.36 8:6c62f82b:::100000000e7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d5dc000 con 0x55576cfe9c00 2023-10-03T19:21:04.379 INFO:teuthology.orchestra.run.smithi045.stdout: -3013> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2300 8.1b 8:dba0574f:::100000000e8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d5dd500 con 0x55576d0f0800 2023-10-03T19:21:04.379 INFO:teuthology.orchestra.run.smithi045.stdout: -3012> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2301 8.4 8:235bfa30:::100000000e9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d5dc380 con 0x55576d0f0000 2023-10-03T19:21:04.379 INFO:teuthology.orchestra.run.smithi045.stdout: -3011> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2302 8.2a 8:54beb349:::100000000ea.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d514e00 con 0x55576cfe8c00 2023-10-03T19:21:04.379 INFO:teuthology.orchestra.run.smithi045.stdout: -3010> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2303 8.5 8:a3215264:::100000000eb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d514380 con 0x55576cfe9400 2023-10-03T19:21:04.379 INFO:teuthology.orchestra.run.smithi045.stdout: -3009> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2304 8.4 8:20ceeb1e:::100000000ec.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d515180 con 0x55576d0f0000 2023-10-03T19:21:04.379 INFO:teuthology.orchestra.run.smithi045.stdout: -3008> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2305 8.1d 8:b9cee72b:::100000000ed.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d0e8000 con 0x55576cfe9400 2023-10-03T19:21:04.379 INFO:teuthology.orchestra.run.smithi045.stdout: -3007> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2306 8.30 8:0c88ada4:::100000000ee.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d6bae00 con 0x55576cfe9c00 2023-10-03T19:21:04.379 INFO:teuthology.orchestra.run.smithi045.stdout: -3006> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2307 8.13 8:c8202536:::100000000ef.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1af880 con 0x55576cfe8c00 2023-10-03T19:21:04.379 INFO:teuthology.orchestra.run.smithi045.stdout: -3005> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2308 8.37 8:ef416527:::100000000f0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d59e380 con 0x55576cfe8c00 2023-10-03T19:21:04.379 INFO:teuthology.orchestra.run.smithi045.stdout: -3004> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2309 8.3f 8:fea3f43b:::100000000f1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7b7180 con 0x55576cfe9c00 2023-10-03T19:21:04.379 INFO:teuthology.orchestra.run.smithi045.stdout: -3003> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2310 8.33 8:cff7f4bd:::100000000f2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea31c00 con 0x55576cfe9c00 2023-10-03T19:21:04.380 INFO:teuthology.orchestra.run.smithi045.stdout: -3002> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2311 8.d 8:b0cc5b52:::100000000f3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d519180 con 0x55576d0f0000 2023-10-03T19:21:04.380 INFO:teuthology.orchestra.run.smithi045.stdout: -3001> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2312 8.13 8:c97f6a48:::100000000f4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1ec380 con 0x55576cfe8c00 2023-10-03T19:21:04.380 INFO:teuthology.orchestra.run.smithi045.stdout: -3000> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2313 8.2b 8:d6a65225:::100000000f5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1ca700 con 0x55576cfe9400 2023-10-03T19:21:04.380 INFO:teuthology.orchestra.run.smithi045.stdout: -2999> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2314 8.b 8:d1f1a6ab:::100000000f6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576c113880 con 0x55576cfe8c00 2023-10-03T19:21:04.380 INFO:teuthology.orchestra.run.smithi045.stdout: -2998> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2315 8.12 8:482fe7bc:::100000000f7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d267880 con 0x55576cfe9400 2023-10-03T19:21:04.380 INFO:teuthology.orchestra.run.smithi045.stdout: -2997> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2316 8.1f 8:fa69016c:::100000000f8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1f0e00 con 0x55576cfe9000 2023-10-03T19:21:04.380 INFO:teuthology.orchestra.run.smithi045.stdout: -2996> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2317 8.f 8:f264201d:::100000000f9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1f1880 con 0x55576cfe8c00 2023-10-03T19:21:04.380 INFO:teuthology.orchestra.run.smithi045.stdout: -2995> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2318 8.2e 8:752cd5de:::100000000fa.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d6d6e00 con 0x55576cfe9800 2023-10-03T19:21:04.380 INFO:teuthology.orchestra.run.smithi045.stdout: -2994> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2319 8.0 8:00b77ae3:::100000000fb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d6d7180 con 0x55576cfe8c00 2023-10-03T19:21:04.380 INFO:teuthology.orchestra.run.smithi045.stdout: -2993> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2320 8.36 8:6dd545dc:::100000000fc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d5f0e00 con 0x55576cfe9c00 2023-10-03T19:21:04.381 INFO:teuthology.orchestra.run.smithi045.stdout: -2992> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2321 8.2d 8:b6610622:::100000000fd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e9dae00 con 0x55576cfe9000 2023-10-03T19:21:04.381 INFO:teuthology.orchestra.run.smithi045.stdout: -2991> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2322 8.3d 8:be8dfa60:::100000000fe.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e9db180 con 0x55576cfe9400 2023-10-03T19:21:04.381 INFO:teuthology.orchestra.run.smithi045.stdout: -2990> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2323 8.13 8:ca01a157:::100000000ff.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e9db880 con 0x55576cfe8c00 2023-10-03T19:21:04.381 INFO:teuthology.orchestra.run.smithi045.stdout: -2989> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2324 8.16 8:69f8b284:::10000000100.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e9ad180 con 0x55576cfe8c00 2023-10-03T19:21:04.381 INFO:teuthology.orchestra.run.smithi045.stdout: -2988> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2325 8.3e 8:7d5083c7:::10000000101.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e9aca80 con 0x55576cfe9800 2023-10-03T19:21:04.381 INFO:teuthology.orchestra.run.smithi045.stdout: -2987> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2326 8.13 8:ca2b2f16:::10000000102.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e980a80 con 0x55576cfe8c00 2023-10-03T19:21:04.381 INFO:teuthology.orchestra.run.smithi045.stdout: -2986> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2327 8.31 8:8c3ca124:::10000000103.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d432000 con 0x55576cfe9800 2023-10-03T19:21:04.381 INFO:teuthology.orchestra.run.smithi045.stdout: -2985> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2328 8.36 8:6f4aafed:::10000000104.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d432380 con 0x55576cfe9c00 2023-10-03T19:21:04.381 INFO:teuthology.orchestra.run.smithi045.stdout: -2984> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2329 8.10 8:088ef71a:::10000000105.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d432700 con 0x55576cfe9800 2023-10-03T19:21:04.381 INFO:teuthology.orchestra.run.smithi045.stdout: -2983> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2330 8.14 8:285116e2:::10000000106.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d432a80 con 0x55576d0f0800 2023-10-03T19:21:04.381 INFO:teuthology.orchestra.run.smithi045.stdout: -2982> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2331 8.3f 8:fe10ede2:::10000000107.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d432e00 con 0x55576cfe9c00 2023-10-03T19:21:04.382 INFO:teuthology.orchestra.run.smithi045.stdout: -2981> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2332 8.30 8:0fd9593b:::10000000108.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d433180 con 0x55576cfe9c00 2023-10-03T19:21:04.382 INFO:teuthology.orchestra.run.smithi045.stdout: -2980> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2333 8.37 8:ee98d4aa:::10000000109.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d433500 con 0x55576cfe8c00 2023-10-03T19:21:04.382 INFO:teuthology.orchestra.run.smithi045.stdout: -2979> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2334 8.14 8:2b0c3f61:::1000000010a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d433880 con 0x55576d0f0800 2023-10-03T19:21:04.382 INFO:teuthology.orchestra.run.smithi045.stdout: -2978> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2335 8.3f 8:fe23482d:::1000000010b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d433c00 con 0x55576cfe9c00 2023-10-03T19:21:04.382 INFO:teuthology.orchestra.run.smithi045.stdout: -2977> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2336 8.d 8:b247ee27:::1000000010c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7f2000 con 0x55576d0f0000 2023-10-03T19:21:04.382 INFO:teuthology.orchestra.run.smithi045.stdout: -2976> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2337 8.26 8:67d72c52:::1000000010d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7f2380 con 0x55576cfe8c00 2023-10-03T19:21:04.382 INFO:teuthology.orchestra.run.smithi045.stdout: -2975> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2338 8.2a 8:542953c1:::1000000010e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7f2700 con 0x55576cfe8c00 2023-10-03T19:21:04.382 INFO:teuthology.orchestra.run.smithi045.stdout: -2974> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2339 8.30 8:0c13cd34:::1000000010f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7f2a80 con 0x55576cfe9c00 2023-10-03T19:21:04.382 INFO:teuthology.orchestra.run.smithi045.stdout: -2973> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2340 8.26 8:64ce44bf:::10000000110.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7f2e00 con 0x55576cfe8c00 2023-10-03T19:21:04.382 INFO:teuthology.orchestra.run.smithi045.stdout: -2972> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2341 8.22 8:46c9ad04:::10000000111.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7f3180 con 0x55576cfe9800 2023-10-03T19:21:04.382 INFO:teuthology.orchestra.run.smithi045.stdout: -2971> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2342 8.0 8:006fa129:::10000000112.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7f3500 con 0x55576cfe8c00 2023-10-03T19:21:04.382 INFO:teuthology.orchestra.run.smithi045.stdout: -2970> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2343 8.1f 8:fa9b3804:::10000000113.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7f3880 con 0x55576cfe9000 2023-10-03T19:21:04.383 INFO:teuthology.orchestra.run.smithi045.stdout: -2969> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2344 8.0 8:005b64bc:::10000000114.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7f3c00 con 0x55576cfe8c00 2023-10-03T19:21:04.480 INFO:teuthology.orchestra.run.smithi045.stdout: -2968> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2345 8.2a 8:575ae04b:::10000000115.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7f4000 con 0x55576cfe8c00 2023-10-03T19:21:04.480 INFO:teuthology.orchestra.run.smithi045.stdout: -2967> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2346 8.17 8:ea138f4d:::10000000116.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7f4380 con 0x55576cfe9800 2023-10-03T19:21:04.480 INFO:teuthology.orchestra.run.smithi045.stdout: -2966> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2347 8.23 8:c507b3c5:::10000000117.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7f4700 con 0x55576cfe9000 2023-10-03T19:21:04.480 INFO:teuthology.orchestra.run.smithi045.stdout: -2965> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2348 8.25 8:a6db094f:::10000000118.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7f4a80 con 0x55576cfe9c00 2023-10-03T19:21:04.481 INFO:teuthology.orchestra.run.smithi045.stdout: -2964> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2349 8.3 8:c1b999d7:::10000000119.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7f4e00 con 0x55576cfe9c00 2023-10-03T19:21:04.481 INFO:teuthology.orchestra.run.smithi045.stdout: -2963> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2350 8.2a 8:565108ac:::1000000011a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7f5180 con 0x55576cfe8c00 2023-10-03T19:21:04.481 INFO:teuthology.orchestra.run.smithi045.stdout: -2962> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2351 8.36 8:6e600286:::1000000011b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7f5500 con 0x55576cfe9c00 2023-10-03T19:21:04.481 INFO:teuthology.orchestra.run.smithi045.stdout: -2961> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2352 8.b 8:d200bef4:::1000000011c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7f5880 con 0x55576cfe8c00 2023-10-03T19:21:04.481 INFO:teuthology.orchestra.run.smithi045.stdout: -2960> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2353 8.3a 8:5d261264:::1000000011d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7f5c00 con 0x55576cfe9c00 2023-10-03T19:21:04.481 INFO:teuthology.orchestra.run.smithi045.stdout: -2959> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2354 8.10 8:08a5cadf:::1000000011e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea68000 con 0x55576cfe9800 2023-10-03T19:21:04.481 INFO:teuthology.orchestra.run.smithi045.stdout: -2958> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2355 8.2b 8:d6a4c2d3:::1000000011f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea68380 con 0x55576cfe9400 2023-10-03T19:21:04.481 INFO:teuthology.orchestra.run.smithi045.stdout: -2957> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2356 8.15 8:a96960f2:::10000000120.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea68700 con 0x55576cfe9800 2023-10-03T19:21:04.481 INFO:teuthology.orchestra.run.smithi045.stdout: -2956> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2357 8.2d 8:b4f06a36:::10000000121.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea68a80 con 0x55576cfe9000 2023-10-03T19:21:04.481 INFO:teuthology.orchestra.run.smithi045.stdout: -2955> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2358 8.1e 8:7b093fa4:::10000000122.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea68e00 con 0x55576cfe8c00 2023-10-03T19:21:04.482 INFO:teuthology.orchestra.run.smithi045.stdout: -2954> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2359 8.36 8:6f395059:::10000000123.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea69180 con 0x55576cfe9c00 2023-10-03T19:21:04.482 INFO:teuthology.orchestra.run.smithi045.stdout: -2953> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2360 8.27 8:e5c20fbc:::10000000124.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea69500 con 0x55576cfe9000 2023-10-03T19:21:04.482 INFO:teuthology.orchestra.run.smithi045.stdout: -2952> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2361 8.14 8:2b82a036:::10000000125.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea69880 con 0x55576d0f0800 2023-10-03T19:21:04.482 INFO:teuthology.orchestra.run.smithi045.stdout: -2951> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2362 8.34 8:2f934c4e:::10000000126.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea69c00 con 0x55576cfe8c00 2023-10-03T19:21:04.482 INFO:teuthology.orchestra.run.smithi045.stdout: -2950> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2363 8.0 8:03f08cc0:::10000000127.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea6a000 con 0x55576cfe8c00 2023-10-03T19:21:04.482 INFO:teuthology.orchestra.run.smithi045.stdout: -2949> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2364 8.2 8:4319aaa2:::10000000128.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea6a380 con 0x55576d0f0800 2023-10-03T19:21:04.482 INFO:teuthology.orchestra.run.smithi045.stdout: -2948> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2365 8.1 8:802a5bbd:::10000000129.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea6a700 con 0x55576cfe9c00 2023-10-03T19:21:04.482 INFO:teuthology.orchestra.run.smithi045.stdout: -2947> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2366 8.38 8:1c1bce02:::1000000012a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea6aa80 con 0x55576cfe8c00 2023-10-03T19:21:04.482 INFO:teuthology.orchestra.run.smithi045.stdout: -2946> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2367 8.9 8:930ba3bb:::1000000012b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea6ae00 con 0x55576cfe9400 2023-10-03T19:21:04.482 INFO:teuthology.orchestra.run.smithi045.stdout: -2945> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2368 8.2d 8:b4fb9bd9:::1000000012c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea6b180 con 0x55576cfe9000 2023-10-03T19:21:04.482 INFO:teuthology.orchestra.run.smithi045.stdout: -2944> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2369 8.37 8:ee6a6ac0:::1000000012d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea6b500 con 0x55576cfe8c00 2023-10-03T19:21:04.483 INFO:teuthology.orchestra.run.smithi045.stdout: -2943> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2370 8.2 8:439e92fb:::1000000012e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea6b880 con 0x55576d0f0800 2023-10-03T19:21:04.483 INFO:teuthology.orchestra.run.smithi045.stdout: -2942> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2371 8.4 8:23f83e86:::1000000012f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea6bc00 con 0x55576d0f0000 2023-10-03T19:21:04.483 INFO:teuthology.orchestra.run.smithi045.stdout: -2941> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2372 8.15 8:abaacf15:::10000000130.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576eaa8000 con 0x55576cfe9800 2023-10-03T19:21:04.483 INFO:teuthology.orchestra.run.smithi045.stdout: -2940> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.19:2373 8.35 8:af7e9f79:::10000000131.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576eaa8380 con 0x55576d0f0400 2023-10-03T19:21:04.483 INFO:teuthology.orchestra.run.smithi045.stdout: -2939> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2374 8.28 8:14babc15:::10000000132.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576eaa8700 con 0x55576cfe9000 2023-10-03T19:21:04.483 INFO:teuthology.orchestra.run.smithi045.stdout: -2938> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2375 8.3d 8:beed21fb:::10000000133.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576eaa8a80 con 0x55576cfe9400 2023-10-03T19:21:04.483 INFO:teuthology.orchestra.run.smithi045.stdout: -2937> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2376 8.2 8:40fdd18a:::10000000134.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576eaa8e00 con 0x55576d0f0800 2023-10-03T19:21:04.483 INFO:teuthology.orchestra.run.smithi045.stdout: -2936> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2377 8.3f 8:fedcb8c2:::10000000135.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576eaa9180 con 0x55576cfe9c00 2023-10-03T19:21:04.483 INFO:teuthology.orchestra.run.smithi045.stdout: -2935> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2378 8.18 8:1b569a42:::10000000136.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576eaa9500 con 0x55576d0f0800 2023-10-03T19:21:04.483 INFO:teuthology.orchestra.run.smithi045.stdout: -2934> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2379 8.17 8:e994506f:::10000000137.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576eaa9880 con 0x55576cfe9800 2023-10-03T19:21:04.483 INFO:teuthology.orchestra.run.smithi045.stdout: -2933> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2380 8.6 8:629cc6bc:::10000000138.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576eaa9c00 con 0x55576cfe9000 2023-10-03T19:21:04.484 INFO:teuthology.orchestra.run.smithi045.stdout: -2932> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2381 8.8 8:1176dc39:::10000000139.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576eaaa000 con 0x55576d0f0000 2023-10-03T19:21:04.484 INFO:teuthology.orchestra.run.smithi045.stdout: -2931> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2382 8.1a 8:5997e84c:::1000000013a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576eaaa380 con 0x55576cfe9000 2023-10-03T19:21:04.484 INFO:teuthology.orchestra.run.smithi045.stdout: -2930> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2383 8.1c 8:3800373d:::1000000013b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576eaaa700 con 0x55576d0f0000 2023-10-03T19:21:04.484 INFO:teuthology.orchestra.run.smithi045.stdout: -2929> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2384 8.36 8:6c5ddb65:::1000000013c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576eaaaa80 con 0x55576cfe9c00 2023-10-03T19:21:04.484 INFO:teuthology.orchestra.run.smithi045.stdout: -2928> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2385 8.33 8:ce600bd1:::1000000013d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576eaaae00 con 0x55576cfe9c00 2023-10-03T19:21:04.484 INFO:teuthology.orchestra.run.smithi045.stdout: -2927> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.19:2386 8.35 8:ae56dbe9:::1000000013e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576eaab180 con 0x55576d0f0400 2023-10-03T19:21:04.484 INFO:teuthology.orchestra.run.smithi045.stdout: -2926> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2387 8.2b 8:d47db6ab:::1000000013f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576eaab500 con 0x55576cfe9400 2023-10-03T19:21:04.484 INFO:teuthology.orchestra.run.smithi045.stdout: -2925> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2388 8.3b 8:dd7df288:::10000000140.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576eaab880 con 0x55576d0f0800 2023-10-03T19:21:04.484 INFO:teuthology.orchestra.run.smithi045.stdout: -2924> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2389 8.d 8:b296df2e:::10000000141.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576eaabc00 con 0x55576d0f0000 2023-10-03T19:21:04.484 INFO:teuthology.orchestra.run.smithi045.stdout: -2923> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2390 8.1b 8:d9deb994:::10000000142.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576dee8000 con 0x55576d0f0800 2023-10-03T19:21:04.484 INFO:teuthology.orchestra.run.smithi045.stdout: -2922> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2391 8.2e 8:77f9b43c:::10000000143.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576dee8380 con 0x55576cfe9800 2023-10-03T19:21:04.485 INFO:teuthology.orchestra.run.smithi045.stdout: -2921> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2392 8.19 8:9ae704d2:::10000000144.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576dee8700 con 0x55576d0f0000 2023-10-03T19:21:04.485 INFO:teuthology.orchestra.run.smithi045.stdout: -2920> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2393 8.1a 8:587da770:::10000000145.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576dee8a80 con 0x55576cfe9000 2023-10-03T19:21:04.485 INFO:teuthology.orchestra.run.smithi045.stdout: -2919> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2394 8.3f 8:fd6fa633:::10000000146.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576dee8e00 con 0x55576cfe9c00 2023-10-03T19:21:04.485 INFO:teuthology.orchestra.run.smithi045.stdout: -2918> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2395 8.2c 8:35111aed:::10000000147.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576dee9180 con 0x55576cfe9400 2023-10-03T19:21:04.485 INFO:teuthology.orchestra.run.smithi045.stdout: -2917> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2396 8.32 8:4eeada49:::10000000148.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576dee9500 con 0x55576cfe9000 2023-10-03T19:21:04.485 INFO:teuthology.orchestra.run.smithi045.stdout: -2916> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2397 8.11 8:8abfc0dc:::10000000149.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576dee9880 con 0x55576d0f0000 2023-10-03T19:21:04.485 INFO:teuthology.orchestra.run.smithi045.stdout: -2915> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2398 8.17 8:e821ba07:::1000000014a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576dee9c00 con 0x55576cfe9800 2023-10-03T19:21:04.485 INFO:teuthology.orchestra.run.smithi045.stdout: -2914> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2399 8.3f 8:fc6ed777:::1000000014b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576deea000 con 0x55576cfe9c00 2023-10-03T19:21:04.485 INFO:teuthology.orchestra.run.smithi045.stdout: -2913> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2400 8.b 8:d35c25ee:::1000000014c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576deea380 con 0x55576cfe8c00 2023-10-03T19:21:04.485 INFO:teuthology.orchestra.run.smithi045.stdout: -2912> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2401 8.c 8:31051922:::1000000014d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576deea700 con 0x55576cfe9000 2023-10-03T19:21:04.485 INFO:teuthology.orchestra.run.smithi045.stdout: -2911> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2402 8.15 8:abf4da12:::1000000014e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576deeaa80 con 0x55576cfe9800 2023-10-03T19:21:04.485 INFO:teuthology.orchestra.run.smithi045.stdout: -2910> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2403 8.2 8:42d137c4:::1000000014f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576deeae00 con 0x55576d0f0800 2023-10-03T19:21:04.486 INFO:teuthology.orchestra.run.smithi045.stdout: -2909> 2023-10-03T19:16:29.330+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 376 ==== osd_op_reply(2071 10000000003.00000000 [delete] v50'39 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:04.486 INFO:teuthology.orchestra.run.smithi045.stdout: -2908> 2023-10-03T19:16:29.334+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1047 ==== osd_op_reply(2077 10000000009.00000000 [delete] v50'23 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:04.486 INFO:teuthology.orchestra.run.smithi045.stdout: -2907> 2023-10-03T19:16:29.330+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2404 8.34 8:2dfce41c:::10000000150.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576deeb180 con 0x55576cfe8c00 2023-10-03T19:21:04.496 INFO:teuthology.orchestra.run.smithi045.stdout: -2906> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2405 8.31 8:8d77f5fc:::10000000151.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576deeb500 con 0x55576cfe9800 2023-10-03T19:21:04.496 INFO:teuthology.orchestra.run.smithi045.stdout: -2905> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2406 8.2a 8:553c495b:::10000000152.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576deeb880 con 0x55576cfe8c00 2023-10-03T19:21:04.496 INFO:teuthology.orchestra.run.smithi045.stdout: -2904> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2407 8.a 8:512fb173:::10000000153.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576deebc00 con 0x55576cfe9c00 2023-10-03T19:21:04.496 INFO:teuthology.orchestra.run.smithi045.stdout: -2903> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2408 8.20 8:0654da44:::10000000154.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576dee8a80 con 0x55576d0f0000 2023-10-03T19:21:04.496 INFO:teuthology.orchestra.run.smithi045.stdout: -2902> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2409 8.31 8:8c35c3f8:::10000000155.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576eaaa380 con 0x55576cfe9800 2023-10-03T19:21:04.496 INFO:teuthology.orchestra.run.smithi045.stdout: -2901> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.19:2410 8.29 8:96298894:::10000000156.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576eaa9c00 con 0x55576d0f0400 2023-10-03T19:21:04.496 INFO:teuthology.orchestra.run.smithi045.stdout: -2900> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2411 8.3c 8:3e33a224:::10000000157.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576eaa8700 con 0x55576cfe9800 2023-10-03T19:21:04.497 INFO:teuthology.orchestra.run.smithi045.stdout: -2899> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2412 8.11 8:885408d1:::10000000158.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea6b180 con 0x55576d0f0000 2023-10-03T19:21:04.497 INFO:teuthology.orchestra.run.smithi045.stdout: -2898> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.19:2413 8.35 8:ac4ca6af:::10000000159.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea69500 con 0x55576d0f0400 2023-10-03T19:21:04.497 INFO:teuthology.orchestra.run.smithi045.stdout: -2897> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2414 8.4 8:23cbca8f:::1000000015a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea68a80 con 0x55576d0f0000 2023-10-03T19:21:04.497 INFO:teuthology.orchestra.run.smithi045.stdout: -2896> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2415 8.27 8:e6859628:::1000000015b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7f4700 con 0x55576cfe9000 2023-10-03T19:21:04.497 INFO:teuthology.orchestra.run.smithi045.stdout: -2895> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2416 8.f 8:f04171b6:::1000000015c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7f3880 con 0x55576cfe8c00 2023-10-03T19:21:04.497 INFO:teuthology.orchestra.run.smithi045.stdout: -2894> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.19:2417 8.29 8:94a271f5:::1000000015d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e9dae00 con 0x55576d0f0400 2023-10-03T19:21:04.497 INFO:teuthology.orchestra.run.smithi045.stdout: -2893> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2418 8.8 8:12dd7266:::1000000015e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1f0e00 con 0x55576d0f0000 2023-10-03T19:21:04.497 INFO:teuthology.orchestra.run.smithi045.stdout: -2892> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2419 8.f 8:f03d37e6:::1000000015f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e8d1880 con 0x55576cfe8c00 2023-10-03T19:21:04.497 INFO:teuthology.orchestra.run.smithi045.stdout: -2891> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2420 8.e 8:71a8024a:::10000000160.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e8d0380 con 0x55576cfe9000 2023-10-03T19:21:04.497 INFO:teuthology.orchestra.run.smithi045.stdout: -2890> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2421 8.3 8:c3d50dc8:::10000000161.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e8d1500 con 0x55576cfe9c00 2023-10-03T19:21:04.497 INFO:teuthology.orchestra.run.smithi045.stdout: -2889> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2422 8.1a 8:581fb947:::10000000162.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e8fd180 con 0x55576cfe9000 2023-10-03T19:21:04.498 INFO:teuthology.orchestra.run.smithi045.stdout: -2888> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2423 8.3d 8:bea1de3b:::10000000163.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e954700 con 0x55576cfe9400 2023-10-03T19:21:04.498 INFO:teuthology.orchestra.run.smithi045.stdout: -2887> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2424 8.26 8:679dc93b:::10000000164.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e927880 con 0x55576cfe8c00 2023-10-03T19:21:04.498 INFO:teuthology.orchestra.run.smithi045.stdout: -2886> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2425 8.2f 8:f477b060:::10000000165.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d690700 con 0x55576cfe9000 2023-10-03T19:21:04.498 INFO:teuthology.orchestra.run.smithi045.stdout: -2885> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2426 8.2f 8:f427aff4:::10000000166.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d51c000 con 0x55576cfe9000 2023-10-03T19:21:04.498 INFO:teuthology.orchestra.run.smithi045.stdout: -2884> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2427 8.7 8:e1d10967:::10000000167.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d0e8380 con 0x55576cfe9c00 2023-10-03T19:21:04.498 INFO:teuthology.orchestra.run.smithi045.stdout: -2883> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2428 8.28 8:157cd199:::10000000168.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1ed500 con 0x55576cfe9000 2023-10-03T19:21:04.498 INFO:teuthology.orchestra.run.smithi045.stdout: -2882> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2429 8.e 8:72fb549a:::10000000169.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d256380 con 0x55576cfe9000 2023-10-03T19:21:04.498 INFO:teuthology.orchestra.run.smithi045.stdout: -2881> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2430 8.31 8:8c4d6431:::1000000016a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d6bb500 con 0x55576cfe9800 2023-10-03T19:21:04.498 INFO:teuthology.orchestra.run.smithi045.stdout: -2880> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2431 8.24 8:24468cab:::1000000016b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d6d6a80 con 0x55576cfe9400 2023-10-03T19:21:04.498 INFO:teuthology.orchestra.run.smithi045.stdout: -2879> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2432 8.2b 8:d4621505:::1000000016c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d5dce00 con 0x55576cfe9400 2023-10-03T19:21:04.498 INFO:teuthology.orchestra.run.smithi045.stdout: -2878> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2433 8.3a 8:5e75abad:::1000000016d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d5f1880 con 0x55576cfe9c00 2023-10-03T19:21:04.499 INFO:teuthology.orchestra.run.smithi045.stdout: -2877> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2434 8.24 8:25a116fe:::1000000016e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d690e00 con 0x55576cfe9400 2023-10-03T19:21:04.499 INFO:teuthology.orchestra.run.smithi045.stdout: -2876> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.19:2435 8.29 8:9754688f:::1000000016f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1fce00 con 0x55576d0f0400 2023-10-03T19:21:04.499 INFO:teuthology.orchestra.run.smithi045.stdout: -2875> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2436 8.21 8:865846d8:::10000000170.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1af500 con 0x55576cfe9000 2023-10-03T19:21:04.499 INFO:teuthology.orchestra.run.smithi045.stdout: -2874> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2437 8.26 8:67de5783:::10000000171.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1b6000 con 0x55576cfe8c00 2023-10-03T19:21:04.499 INFO:teuthology.orchestra.run.smithi045.stdout: -2873> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2438 8.3a 8:5fae8ea4:::10000000172.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d61f500 con 0x55576cfe9c00 2023-10-03T19:21:04.499 INFO:teuthology.orchestra.run.smithi045.stdout: -2872> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2439 8.2f 8:f750f038:::10000000173.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d656380 con 0x55576cfe9000 2023-10-03T19:21:04.499 INFO:teuthology.orchestra.run.smithi045.stdout: -2871> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2440 8.17 8:ea0d4bd4:::10000000174.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d51a700 con 0x55576cfe9800 2023-10-03T19:21:04.499 INFO:teuthology.orchestra.run.smithi045.stdout: -2870> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2441 8.2c 8:35de0157:::10000000175.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d5dc700 con 0x55576cfe9400 2023-10-03T19:21:04.499 INFO:teuthology.orchestra.run.smithi045.stdout: -2869> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2442 8.21 8:87d44640:::10000000176.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d218a80 con 0x55576cfe9000 2023-10-03T19:21:04.499 INFO:teuthology.orchestra.run.smithi045.stdout: -2868> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2443 8.21 8:85136d15:::10000000177.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d518700 con 0x55576cfe9000 2023-10-03T19:21:04.499 INFO:teuthology.orchestra.run.smithi045.stdout: -2867> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2444 8.1b 8:d83df968:::10000000178.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7b6000 con 0x55576d0f0800 2023-10-03T19:21:04.499 INFO:teuthology.orchestra.run.smithi045.stdout: -2866> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2445 8.23 8:c468a694:::10000000179.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7b8a80 con 0x55576cfe9000 2023-10-03T19:21:04.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2865> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2446 8.1c 8:392ce431:::1000000017a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7b9c00 con 0x55576d0f0000 2023-10-03T19:21:04.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2864> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2447 8.23 8:c750a2e5:::1000000017b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1cb180 con 0x55576cfe9000 2023-10-03T19:21:04.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2863> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2448 8.39 8:9d2c3550:::1000000017c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea05500 con 0x55576cfe9000 2023-10-03T19:21:04.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2862> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2449 8.38 8:1e3b0900:::1000000017d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e955880 con 0x55576cfe8c00 2023-10-03T19:21:04.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2861> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2450 8.15 8:aa02e122:::1000000017e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e981880 con 0x55576cfe9800 2023-10-03T19:21:04.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2860> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2451 8.18 8:1b505fc9:::1000000017f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d212e00 con 0x55576d0f0800 2023-10-03T19:21:04.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2859> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2452 8.6 8:63fec8d1:::10000000180.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d61f180 con 0x55576cfe9000 2023-10-03T19:21:04.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2858> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.19:2453 8.35 8:ae109857:::10000000181.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1b1c00 con 0x55576d0f0400 2023-10-03T19:21:04.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2857> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2454 8.3c 8:3caa846b:::10000000182.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1b4a80 con 0x55576cfe9800 2023-10-03T19:21:04.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2856> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2455 8.6 8:60954073:::10000000183.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d51d180 con 0x55576cfe9000 2023-10-03T19:21:04.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2855> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2456 8.37 8:ee74be79:::10000000184.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e980700 con 0x55576cfe8c00 2023-10-03T19:21:04.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2854> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2457 8.2b 8:d44b7594:::10000000185.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e9db500 con 0x55576cfe9400 2023-10-03T19:21:04.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2853> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2458 8.1b 8:dac0322e:::10000000186.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d257500 con 0x55576d0f0800 2023-10-03T19:21:04.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2852> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2459 8.2c 8:361d040c:::10000000187.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea31180 con 0x55576cfe9400 2023-10-03T19:21:04.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2851> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2460 8.2c 8:34fb46e8:::10000000188.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d0e9500 con 0x55576cfe9400 2023-10-03T19:21:04.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2850> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2461 8.18 8:1be1b9ec:::10000000189.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1b7500 con 0x55576d0f0800 2023-10-03T19:21:04.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2849> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2462 8.25 8:a628609b:::1000000018a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576deea000 con 0x55576cfe9c00 2023-10-03T19:21:04.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2848> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2463 8.20 8:054a2542:::1000000018b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576dee8e00 con 0x55576d0f0000 2023-10-03T19:21:04.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2847> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2464 8.20 8:0528cc08:::1000000018c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576eaaae00 con 0x55576d0f0000 2023-10-03T19:21:04.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2846> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2465 8.25 8:a72aac57:::1000000018d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576eaaaa80 con 0x55576cfe9c00 2023-10-03T19:21:04.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2845> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2466 8.13 8:ca4de75d:::1000000018e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576eaa9180 con 0x55576cfe8c00 2023-10-03T19:21:04.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2844> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2467 8.21 8:873de92c:::1000000018f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea6a700 con 0x55576cfe9000 2023-10-03T19:21:04.522 INFO:teuthology.orchestra.run.smithi045.stdout: -2843> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2468 8.5 8:a17921c8:::10000000190.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea69180 con 0x55576cfe9400 2023-10-03T19:21:04.522 INFO:teuthology.orchestra.run.smithi045.stdout: -2842> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2469 8.19 8:98be24f8:::10000000191.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7f5c00 con 0x55576d0f0000 2023-10-03T19:21:04.522 INFO:teuthology.orchestra.run.smithi045.stdout: -2841> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2470 8.0 8:01a8c5ca:::10000000192.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7f5500 con 0x55576cfe8c00 2023-10-03T19:21:04.522 INFO:teuthology.orchestra.run.smithi045.stdout: -2840> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2471 8.1d 8:b9c448ca:::10000000193.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7f4e00 con 0x55576cfe9400 2023-10-03T19:21:04.522 INFO:teuthology.orchestra.run.smithi045.stdout: -2839> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2472 8.26 8:6669d7af:::10000000194.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7f4a80 con 0x55576cfe8c00 2023-10-03T19:21:04.522 INFO:teuthology.orchestra.run.smithi045.stdout: -2838> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2473 8.1b 8:d8c655bc:::10000000195.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7f2a80 con 0x55576d0f0800 2023-10-03T19:21:04.523 INFO:teuthology.orchestra.run.smithi045.stdout: -2837> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2474 8.1e 8:7894fe2e:::10000000196.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d433c00 con 0x55576cfe8c00 2023-10-03T19:21:04.523 INFO:teuthology.orchestra.run.smithi045.stdout: -2836> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2475 8.12 8:4aa09692:::10000000197.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d433180 con 0x55576cfe9400 2023-10-03T19:21:04.523 INFO:teuthology.orchestra.run.smithi045.stdout: -2835> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2476 8.30 8:0cac0e23:::10000000198.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d432e00 con 0x55576cfe9c00 2023-10-03T19:21:04.523 INFO:teuthology.orchestra.run.smithi045.stdout: -2834> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2477 8.33 8:cf2b08c7:::10000000199.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d432380 con 0x55576cfe9c00 2023-10-03T19:21:04.523 INFO:teuthology.orchestra.run.smithi045.stdout: -2833> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2478 8.20 8:068c0723:::1000000019a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d5f0e00 con 0x55576d0f0000 2023-10-03T19:21:04.523 INFO:teuthology.orchestra.run.smithi045.stdout: -2832> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2479 8.13 8:cad07b43:::1000000019b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea31c00 con 0x55576cfe8c00 2023-10-03T19:21:04.523 INFO:teuthology.orchestra.run.smithi045.stdout: -2831> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2480 8.7 8:e16233b5:::1000000019c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7b7180 con 0x55576cfe9c00 2023-10-03T19:21:04.523 INFO:teuthology.orchestra.run.smithi045.stdout: -2830> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2481 8.1d 8:ba9aa119:::1000000019d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d6bae00 con 0x55576cfe9400 2023-10-03T19:21:04.523 INFO:teuthology.orchestra.run.smithi045.stdout: -2829> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2482 8.20 8:04059238:::1000000019e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d5dc000 con 0x55576d0f0000 2023-10-03T19:21:04.523 INFO:teuthology.orchestra.run.smithi045.stdout: -2828> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2483 8.28 8:15089297:::1000000019f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e8fc380 con 0x55576cfe9000 2023-10-03T19:21:04.523 INFO:teuthology.orchestra.run.smithi045.stdout: -2827> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2484 8.3d 8:beda2349:::100000001a0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea05180 con 0x55576cfe9400 2023-10-03T19:21:04.524 INFO:teuthology.orchestra.run.smithi045.stdout: -2826> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2485 8.1d 8:b947b1d0:::100000001a1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea04700 con 0x55576cfe9400 2023-10-03T19:21:04.524 INFO:teuthology.orchestra.run.smithi045.stdout: -2825> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2486 8.c 8:3156bbd1:::100000001a2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e955c00 con 0x55576cfe9000 2023-10-03T19:21:04.524 INFO:teuthology.orchestra.run.smithi045.stdout: -2824> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2487 8.37 8:eefe3312:::100000001a3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e927180 con 0x55576cfe8c00 2023-10-03T19:21:04.524 INFO:teuthology.orchestra.run.smithi045.stdout: -2823> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2488 8.37 8:ec159c95:::100000001a4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d5dd180 con 0x55576cfe8c00 2023-10-03T19:21:04.524 INFO:teuthology.orchestra.run.smithi045.stdout: -2822> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2489 8.2b 8:d55466b4:::100000001a5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d256700 con 0x55576cfe9400 2023-10-03T19:21:04.524 INFO:teuthology.orchestra.run.smithi045.stdout: -2821> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2490 8.2e 8:775b9fb2:::100000001a6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d5f1180 con 0x55576cfe9800 2023-10-03T19:21:04.524 INFO:teuthology.orchestra.run.smithi045.stdout: -2820> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.19:2491 8.29 8:95eb4c87:::100000001a7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d6d6000 con 0x55576d0f0400 2023-10-03T19:21:04.524 INFO:teuthology.orchestra.run.smithi045.stdout: -2819> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.19:2492 8.35 8:af372925:::100000001a8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d5f1c00 con 0x55576d0f0400 2023-10-03T19:21:04.524 INFO:teuthology.orchestra.run.smithi045.stdout: -2818> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2493 8.2c 8:3416e1ca:::100000001a9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1ca000 con 0x55576cfe9400 2023-10-03T19:21:04.524 INFO:teuthology.orchestra.run.smithi045.stdout: -2817> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2494 8.13 8:caba0c50:::100000001aa.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d3d3880 con 0x55576cfe8c00 2023-10-03T19:21:04.524 INFO:teuthology.orchestra.run.smithi045.stdout: -2816> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2495 8.2e 8:76865fdc:::100000001ab.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d275180 con 0x55576cfe9800 2023-10-03T19:21:04.525 INFO:teuthology.orchestra.run.smithi045.stdout: -2815> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2496 8.7 8:e255d6cd:::100000001ac.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d690a80 con 0x55576cfe9c00 2023-10-03T19:21:04.525 INFO:teuthology.orchestra.run.smithi045.stdout: -2814> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2497 8.13 8:c8b8e906:::100000001ad.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d6d7c00 con 0x55576cfe8c00 2023-10-03T19:21:04.525 INFO:teuthology.orchestra.run.smithi045.stdout: -2813> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2498 8.f 8:f18f2ceb:::100000001ae.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d6bb180 con 0x55576cfe8c00 2023-10-03T19:21:04.525 INFO:teuthology.orchestra.run.smithi045.stdout: -2812> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2499 8.2a 8:540014ba:::100000001af.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d218700 con 0x55576cfe8c00 2023-10-03T19:21:04.525 INFO:teuthology.orchestra.run.smithi045.stdout: -2811> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2500 8.32 8:4d7ffadd:::100000001b0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d0f6e00 con 0x55576cfe9000 2023-10-03T19:21:04.525 INFO:teuthology.orchestra.run.smithi045.stdout: -2810> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2501 8.1d 8:bafada3d:::100000001b1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d656a80 con 0x55576cfe9400 2023-10-03T19:21:04.525 INFO:teuthology.orchestra.run.smithi045.stdout: -2809> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2502 8.2e 8:76ff63fc:::100000001b2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d514700 con 0x55576cfe9800 2023-10-03T19:21:04.525 INFO:teuthology.orchestra.run.smithi045.stdout: -2808> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2503 8.2a 8:54062570:::100000001b3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d213500 con 0x55576cfe8c00 2023-10-03T19:21:04.525 INFO:teuthology.orchestra.run.smithi045.stdout: -2807> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2504 8.7 8:e28d3c2b:::100000001b4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d212380 con 0x55576cfe9c00 2023-10-03T19:21:04.525 INFO:teuthology.orchestra.run.smithi045.stdout: -2806> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2505 8.38 8:1c92f375:::100000001b5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7b8700 con 0x55576cfe8c00 2023-10-03T19:21:04.525 INFO:teuthology.orchestra.run.smithi045.stdout: -2805> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2506 8.34 8:2d6f3468:::100000001b6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d0f8a80 con 0x55576cfe8c00 2023-10-03T19:21:04.525 INFO:teuthology.orchestra.run.smithi045.stdout: -2804> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2507 8.19 8:99a7d964:::100000001b7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e8fd880 con 0x55576d0f0000 2023-10-03T19:21:04.526 INFO:teuthology.orchestra.run.smithi045.stdout: -2803> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2508 8.d 8:b3fa8219:::100000001b8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d266000 con 0x55576d0f0000 2023-10-03T19:21:04.526 INFO:teuthology.orchestra.run.smithi045.stdout: -2802> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2509 8.2d 8:b7eb2f66:::100000001b9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e954e00 con 0x55576cfe9000 2023-10-03T19:21:04.526 INFO:teuthology.orchestra.run.smithi045.stdout: -2801> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2510 8.36 8:6d15073c:::100000001ba.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7b6380 con 0x55576cfe9c00 2023-10-03T19:21:04.526 INFO:teuthology.orchestra.run.smithi045.stdout: -2800> 2023-10-03T19:16:29.334+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2511 8.4 8:2118e87e:::100000001bb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e8d1c00 con 0x55576d0f0000 2023-10-03T19:21:04.526 INFO:teuthology.orchestra.run.smithi045.stdout: -2799> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2512 8.19 8:9b54a4b5:::100000001bc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1b4700 con 0x55576d0f0000 2023-10-03T19:21:04.526 INFO:teuthology.orchestra.run.smithi045.stdout: -2798> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2513 8.16 8:69256f6e:::100000001bd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea04000 con 0x55576cfe8c00 2023-10-03T19:21:04.526 INFO:teuthology.orchestra.run.smithi045.stdout: -2797> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2514 8.20 8:05a7fbbe:::100000001be.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea05c00 con 0x55576d0f0000 2023-10-03T19:21:04.526 INFO:teuthology.orchestra.run.smithi045.stdout: -2796> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2515 8.19 8:9ab6d71b:::100000001bf.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576deeae00 con 0x55576d0f0000 2023-10-03T19:21:04.526 INFO:teuthology.orchestra.run.smithi045.stdout: -2795> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2516 8.19 8:98a8a8b3:::100000001c0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576dee8000 con 0x55576d0f0000 2023-10-03T19:21:04.526 INFO:teuthology.orchestra.run.smithi045.stdout: -2794> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2517 8.1 8:823476fa:::100000001c1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576eaab880 con 0x55576cfe9c00 2023-10-03T19:21:04.527 INFO:teuthology.orchestra.run.smithi045.stdout: -2793> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2518 8.32 8:4c576489:::100000001c2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576eaa9500 con 0x55576cfe9000 2023-10-03T19:21:04.527 INFO:teuthology.orchestra.run.smithi045.stdout: -2792> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2519 8.1f 8:fa06f62f:::100000001c3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576eaa8e00 con 0x55576cfe9000 2023-10-03T19:21:04.527 INFO:teuthology.orchestra.run.smithi045.stdout: -2791> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2520 8.12 8:483471a4:::100000001c4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea6b880 con 0x55576cfe9400 2023-10-03T19:21:04.527 INFO:teuthology.orchestra.run.smithi045.stdout: -2790> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2521 8.22 8:47177243:::100000001c5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea6a380 con 0x55576cfe9800 2023-10-03T19:21:04.527 INFO:teuthology.orchestra.run.smithi045.stdout: -2789> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2522 8.1f 8:f9e205e8:::100000001c6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea69880 con 0x55576cfe9000 2023-10-03T19:21:04.527 INFO:teuthology.orchestra.run.smithi045.stdout: -2788> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2523 8.5 8:a07eb451:::100000001c7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d433880 con 0x55576cfe9400 2023-10-03T19:21:04.527 INFO:teuthology.orchestra.run.smithi045.stdout: -2787> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2524 8.1c 8:3b17a408:::100000001c8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d432a80 con 0x55576d0f0000 2023-10-03T19:21:04.527 INFO:teuthology.orchestra.run.smithi045.stdout: -2786> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2525 8.8 8:12d75f6c:::100000001c9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d5dd500 con 0x55576d0f0000 2023-10-03T19:21:04.527 INFO:teuthology.orchestra.run.smithi045.stdout: -2785> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2526 8.16 8:6b5900d3:::100000001ca.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d275880 con 0x55576cfe8c00 2023-10-03T19:21:04.527 INFO:teuthology.orchestra.run.smithi045.stdout: -2784> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2527 8.3d 8:bce74be0:::100000001cb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d0f8380 con 0x55576cfe9400 2023-10-03T19:21:04.527 INFO:teuthology.orchestra.run.smithi045.stdout: -2783> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2528 8.26 8:65df6efc:::100000001cc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea04380 con 0x55576cfe8c00 2023-10-03T19:21:04.540 INFO:teuthology.orchestra.run.smithi045.stdout: -2782> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2529 8.21 8:86fbb64b:::100000001cd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e8fce00 con 0x55576cfe9000 2023-10-03T19:21:04.541 INFO:teuthology.orchestra.run.smithi045.stdout: -2781> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2530 8.14 8:29519214:::100000001ce.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d0f7c00 con 0x55576d0f0800 2023-10-03T19:21:04.541 INFO:teuthology.orchestra.run.smithi045.stdout: -2780> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2531 8.e 8:71d3c486:::100000001cf.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d588a80 con 0x55576cfe9000 2023-10-03T19:21:04.541 INFO:teuthology.orchestra.run.smithi045.stdout: -2779> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2532 8.1 8:81350243:::100000001d0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1b6e00 con 0x55576cfe9c00 2023-10-03T19:21:04.541 INFO:teuthology.orchestra.run.smithi045.stdout: -2778> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2533 8.a 8:51da9383:::100000001d1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d257c00 con 0x55576cfe9c00 2023-10-03T19:21:04.541 INFO:teuthology.orchestra.run.smithi045.stdout: -2777> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2534 8.16 8:69d31978:::100000001d2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d5f0a80 con 0x55576cfe8c00 2023-10-03T19:21:04.541 INFO:teuthology.orchestra.run.smithi045.stdout: -2776> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2535 8.3e 8:7c32b2c0:::100000001d3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1ae700 con 0x55576cfe9800 2023-10-03T19:21:04.541 INFO:teuthology.orchestra.run.smithi045.stdout: -2775> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2536 8.34 8:2d665059:::100000001d4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d219880 con 0x55576cfe8c00 2023-10-03T19:21:04.541 INFO:teuthology.orchestra.run.smithi045.stdout: -2774> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2537 8.33 8:cfb1de4c:::100000001d5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7b8e00 con 0x55576cfe9c00 2023-10-03T19:21:04.541 INFO:teuthology.orchestra.run.smithi045.stdout: -2773> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2538 8.16 8:6b2189d7:::100000001d6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7b9500 con 0x55576cfe8c00 2023-10-03T19:21:04.541 INFO:teuthology.orchestra.run.smithi045.stdout: -2772> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2539 8.1a 8:5b825d11:::100000001d7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d274000 con 0x55576cfe9000 2023-10-03T19:21:04.542 INFO:teuthology.orchestra.run.smithi045.stdout: -2771> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2540 8.1d 8:b82de5f4:::100000001d8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea04e00 con 0x55576cfe9400 2023-10-03T19:21:04.542 INFO:teuthology.orchestra.run.smithi045.stdout: -2770> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2541 8.6 8:61ce4130:::100000001d9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e954000 con 0x55576cfe9000 2023-10-03T19:21:04.542 INFO:teuthology.orchestra.run.smithi045.stdout: -2769> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2542 8.37 8:ec238bc7:::100000001da.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1f0a80 con 0x55576cfe8c00 2023-10-03T19:21:04.542 INFO:teuthology.orchestra.run.smithi045.stdout: -2768> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2543 8.24 8:24ebe6ca:::100000001db.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d274e00 con 0x55576cfe9400 2023-10-03T19:21:04.542 INFO:teuthology.orchestra.run.smithi045.stdout: -2767> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2544 8.38 8:1fa836f3:::100000001dc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1fc380 con 0x55576cfe8c00 2023-10-03T19:21:04.542 INFO:teuthology.orchestra.run.smithi045.stdout: -2766> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2545 8.3b 8:dd6afadf:::100000001dd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d0f7180 con 0x55576d0f0800 2023-10-03T19:21:04.542 INFO:teuthology.orchestra.run.smithi045.stdout: -2765> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2546 8.2e 8:77eaaa70:::100000001de.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d80ca80 con 0x55576cfe9800 2023-10-03T19:21:04.542 INFO:teuthology.orchestra.run.smithi045.stdout: -2764> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2547 8.34 8:2de2f068:::100000001df.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d80c700 con 0x55576cfe8c00 2023-10-03T19:21:04.542 INFO:teuthology.orchestra.run.smithi045.stdout: -2763> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2548 8.11 8:8b210d5a:::100000001e0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1f0000 con 0x55576d0f0000 2023-10-03T19:21:04.542 INFO:teuthology.orchestra.run.smithi045.stdout: -2762> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2549 8.2c 8:3650da82:::100000001e1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7b8000 con 0x55576cfe9400 2023-10-03T19:21:04.542 INFO:teuthology.orchestra.run.smithi045.stdout: -2761> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2550 8.3c 8:3d7caa99:::100000001e2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576ea30000 con 0x55576cfe9800 2023-10-03T19:21:04.543 INFO:teuthology.orchestra.run.smithi045.stdout: -2760> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2551 8.1b 8:da67b4c4:::100000001e3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e9da700 con 0x55576d0f0800 2023-10-03T19:21:04.543 INFO:teuthology.orchestra.run.smithi045.stdout: -2759> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2552 8.13 8:c88cf2e1:::100000001e4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7b7880 con 0x55576cfe8c00 2023-10-03T19:21:04.543 INFO:teuthology.orchestra.run.smithi045.stdout: -2758> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2553 8.1a 8:5bf55946:::100000001e5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d213c00 con 0x55576cfe9000 2023-10-03T19:21:04.543 INFO:teuthology.orchestra.run.smithi045.stdout: -2757> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2554 8.14 8:2bd99ea3:::100000001e6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e926a80 con 0x55576d0f0800 2023-10-03T19:21:04.543 INFO:teuthology.orchestra.run.smithi045.stdout: -2756> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.19:2555 8.24 8:25319c2b:::100000001e7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e9daa80 con 0x55576cfe9400 2023-10-03T19:21:04.543 INFO:teuthology.orchestra.run.smithi045.stdout: -2755> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2556 8.1c 8:3915d86a:::100000001e8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e8fdc00 con 0x55576d0f0000 2023-10-03T19:21:04.543 INFO:teuthology.orchestra.run.smithi045.stdout: -2754> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2557 8.30 8:0def042e:::100000001e9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d6d6380 con 0x55576cfe9c00 2023-10-03T19:21:04.543 INFO:teuthology.orchestra.run.smithi045.stdout: -2753> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2558 8.1c 8:3811fe79:::100000001ea.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1f0380 con 0x55576d0f0000 2023-10-03T19:21:04.543 INFO:teuthology.orchestra.run.smithi045.stdout: -2752> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2559 8.f 8:f3be9911:::100000001eb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d213180 con 0x55576cfe8c00 2023-10-03T19:21:04.543 INFO:teuthology.orchestra.run.smithi045.stdout: -2751> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2560 8.a 8:52e82f0e:::100000001ec.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7b7500 con 0x55576cfe9c00 2023-10-03T19:21:04.543 INFO:teuthology.orchestra.run.smithi045.stdout: -2750> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2561 8.14 8:2af56820:::100000001ed.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d1fd180 con 0x55576d0f0800 2023-10-03T19:21:04.543 INFO:teuthology.orchestra.run.smithi045.stdout: -2749> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2562 8.3a 8:5c391605:::100000001ee.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d691180 con 0x55576cfe9c00 2023-10-03T19:21:04.544 INFO:teuthology.orchestra.run.smithi045.stdout: -2748> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2563 8.a 8:519c0e80:::100000001ef.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d80d180 con 0x55576cfe9c00 2023-10-03T19:21:04.544 INFO:teuthology.orchestra.run.smithi045.stdout: -2747> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2564 8.13 8:ca7e1ea4:::100000001f0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d80dc00 con 0x55576cfe8c00 2023-10-03T19:21:04.544 INFO:teuthology.orchestra.run.smithi045.stdout: -2746> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.19:2565 8.33 8:ce8ed050:::100000001f1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e8fc700 con 0x55576cfe9c00 2023-10-03T19:21:04.544 INFO:teuthology.orchestra.run.smithi045.stdout: -2745> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.19:2566 8.b 8:d079bd36:::100000001f2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576e9ad880 con 0x55576cfe8c00 2023-10-03T19:21:04.544 INFO:teuthology.orchestra.run.smithi045.stdout: -2744> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.19:2567 8.3c 8:3d203daf:::100000001f3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d7b6700 con 0x55576cfe9800 2023-10-03T19:21:04.544 INFO:teuthology.orchestra.run.smithi045.stdout: -2743> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.19:2568 8.14 8:2959de71:::100000001f4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576de2c000 con 0x55576d0f0800 2023-10-03T19:21:04.544 INFO:teuthology.orchestra.run.smithi045.stdout: -2742> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.19:2569 8.d 8:b0d9c9f6:::100000001f5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576de2c380 con 0x55576d0f0000 2023-10-03T19:21:04.544 INFO:teuthology.orchestra.run.smithi045.stdout: -2741> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.inotable: apply_release_ids [0x100000005dd~0x1f7] to [0x100000005dd~0xfffffffa23]/[0x100000007d4~0xfffffff82c] 2023-10-03T19:21:04.544 INFO:teuthology.orchestra.run.smithi045.stdout: -2740> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.sessionmap mark_dirty s=0x55576c0dcd00 name=client.5697 v=1004 2023-10-03T19:21:04.544 INFO:teuthology.orchestra.run.smithi045.stdout: -2739> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsx on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6006 ap=1 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) caps={5697=pAsLsXsFsx/-@1002},l=5697 | request=0 lock=5 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.544 INFO:teuthology.orchestra.run.smithi045.stdout: -2738> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000000) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.545 INFO:teuthology.orchestra.run.smithi045.stdout: -2737> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.openfiles remove_dirfrag [dir 0x1 / [2,head] auth v=6007 cv=5559/5559 REP dir_auth=0 ap=0+1 state=1610874881|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=0 0x55576c12ad00] 2023-10-03T19:21:04.545 INFO:teuthology.orchestra.run.smithi045.stdout: -2736> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.locker eval 3648 [inode 0x10000000000 [...2,head] /dc-dir/ auth v6006 ap=1 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=5 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.545 INFO:teuthology.orchestra.run.smithi045.stdout: -2735> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl w=1) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6006 ap=1 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=5 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.545 INFO:teuthology.orchestra.run.smithi045.stdout: -2734> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.locker is excl 2023-10-03T19:21:04.545 INFO:teuthology.orchestra.run.smithi045.stdout: -2733> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 7 mds.0.locker file_eval loner_issued= other_issued= xlocker_issued= 2023-10-03T19:21:04.545 INFO:teuthology.orchestra.run.smithi045.stdout: -2732> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.locker should lose it 2023-10-03T19:21:04.545 INFO:teuthology.orchestra.run.smithi045.stdout: -2731> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.locker waiting for wrlock to drain 2023-10-03T19:21:04.545 INFO:teuthology.orchestra.run.smithi045.stdout: -2730> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.locker simple_eval (iauth sync r=1) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6006 ap=1 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=5 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.545 INFO:teuthology.orchestra.run.smithi045.stdout: -2729> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.locker simple_eval (ilink sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6006 ap=1 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=5 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.545 INFO:teuthology.orchestra.run.smithi045.stdout: -2728> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.locker simple_eval (ixattr sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6006 ap=1 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=5 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:04.545 INFO:teuthology.orchestra.run.smithi045.stdout: -2727> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.locker eval done 2023-10-03T19:21:04.546 INFO:teuthology.orchestra.run.smithi045.stdout: -2726> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFs on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (isnap sync r=1) (inest lock dirty) (ipolicy sync r=1) (iversion lock) caps={5697=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=2 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:04.546 INFO:teuthology.orchestra.run.smithi045.stdout: -2725> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.546 INFO:teuthology.orchestra.run.smithi045.stdout: -2724> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000001 [2,head] /dc-dir/dc-file_0 auth v1866 s=1 n(v0 rc2023-10-03T19:16:01.377432+0000 b1 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d0e1700] 2023-10-03T19:21:04.546 INFO:teuthology.orchestra.run.smithi045.stdout: -2723> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000001) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.627 INFO:teuthology.orchestra.run.smithi045.stdout: -2722> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000001f6 [2,head] /dc-dir/dc-file_1 auth v1868 s=1 n(v0 rc2023-10-03T19:16:01.387690+0000 b1 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d19e000] 2023-10-03T19:21:04.627 INFO:teuthology.orchestra.run.smithi045.stdout: -2721> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000001f6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.627 INFO:teuthology.orchestra.run.smithi045.stdout: -2720> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000001f7 [2,head] /dc-dir/dc-file_2 auth v1870 s=1 n(v0 rc2023-10-03T19:16:01.398434+0000 b1 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d19e580] 2023-10-03T19:21:04.627 INFO:teuthology.orchestra.run.smithi045.stdout: -2719> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000001f7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.627 INFO:teuthology.orchestra.run.smithi045.stdout: -2718> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000001f8 [2,head] /dc-dir/dc-file_3 auth v1872 s=1 n(v0 rc2023-10-03T19:16:01.408693+0000 b1 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d19eb00] 2023-10-03T19:21:04.627 INFO:teuthology.orchestra.run.smithi045.stdout: -2717> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000001f8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.627 INFO:teuthology.orchestra.run.smithi045.stdout: -2716> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000001f9 [2,head] /dc-dir/dc-file_4 auth v1874 s=1 n(v0 rc2023-10-03T19:16:01.418268+0000 b1 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d19f080] 2023-10-03T19:21:04.627 INFO:teuthology.orchestra.run.smithi045.stdout: -2715> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000001f9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.627 INFO:teuthology.orchestra.run.smithi045.stdout: -2714> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000001fa [2,head] /dc-dir/dc-file_5 auth v1876 s=1 n(v0 rc2023-10-03T19:16:01.428851+0000 b1 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d19f600] 2023-10-03T19:21:04.628 INFO:teuthology.orchestra.run.smithi045.stdout: -2713> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000001fa) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.628 INFO:teuthology.orchestra.run.smithi045.stdout: -2712> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000001fb [2,head] /dc-dir/dc-file_6 auth v2230 s=1 n(v0 rc2023-10-03T19:16:01.438866+0000 b1 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d19fb80] 2023-10-03T19:21:04.628 INFO:teuthology.orchestra.run.smithi045.stdout: -2711> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000001fb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.628 INFO:teuthology.orchestra.run.smithi045.stdout: -2710> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000001fc [2,head] /dc-dir/dc-file_7 auth v2232 s=1 n(v0 rc2023-10-03T19:16:01.450285+0000 b1 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1a0100] 2023-10-03T19:21:04.628 INFO:teuthology.orchestra.run.smithi045.stdout: -2709> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000001fc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.628 INFO:teuthology.orchestra.run.smithi045.stdout: -2708> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000001fd [2,head] /dc-dir/dc-file_8 auth v2234 s=1 n(v0 rc2023-10-03T19:16:01.460852+0000 b1 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1a0680] 2023-10-03T19:21:04.628 INFO:teuthology.orchestra.run.smithi045.stdout: -2707> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000001fd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.628 INFO:teuthology.orchestra.run.smithi045.stdout: -2706> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000001fe [2,head] /dc-dir/dc-file_9 auth v2236 s=1 n(v0 rc2023-10-03T19:16:01.470833+0000 b1 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1a0c00] 2023-10-03T19:21:04.628 INFO:teuthology.orchestra.run.smithi045.stdout: -2705> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000001fe) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.628 INFO:teuthology.orchestra.run.smithi045.stdout: -2704> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000001ff [2,head] /dc-dir/dc-file_10 auth v2238 s=2 n(v0 rc2023-10-03T19:16:01.481258+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1a1180] 2023-10-03T19:21:04.628 INFO:teuthology.orchestra.run.smithi045.stdout: -2703> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000001ff) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.629 INFO:teuthology.orchestra.run.smithi045.stdout: -2702> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000200 [2,head] /dc-dir/dc-file_11 auth v2240 s=2 n(v0 rc2023-10-03T19:16:01.492311+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1a1700] 2023-10-03T19:21:04.629 INFO:teuthology.orchestra.run.smithi045.stdout: -2701> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000200) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.629 INFO:teuthology.orchestra.run.smithi045.stdout: -2700> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000201 [2,head] /dc-dir/dc-file_12 auth v2242 s=2 n(v0 rc2023-10-03T19:16:01.503038+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1ce000] 2023-10-03T19:21:04.629 INFO:teuthology.orchestra.run.smithi045.stdout: -2699> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000201) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.629 INFO:teuthology.orchestra.run.smithi045.stdout: -2698> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000202 [2,head] /dc-dir/dc-file_13 auth v2244 s=2 n(v0 rc2023-10-03T19:16:01.514864+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1ce580] 2023-10-03T19:21:04.629 INFO:teuthology.orchestra.run.smithi045.stdout: -2697> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000202) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.629 INFO:teuthology.orchestra.run.smithi045.stdout: -2696> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000203 [2,head] /dc-dir/dc-file_14 auth v2246 s=2 n(v0 rc2023-10-03T19:16:01.528580+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1ceb00] 2023-10-03T19:21:04.629 INFO:teuthology.orchestra.run.smithi045.stdout: -2695> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000203) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.629 INFO:teuthology.orchestra.run.smithi045.stdout: -2694> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000204 [2,head] /dc-dir/dc-file_15 auth v2248 s=2 n(v0 rc2023-10-03T19:16:01.541154+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1cf080] 2023-10-03T19:21:04.629 INFO:teuthology.orchestra.run.smithi045.stdout: -2693> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000204) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.629 INFO:teuthology.orchestra.run.smithi045.stdout: -2692> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000205 [2,head] /dc-dir/dc-file_16 auth v2250 s=2 n(v0 rc2023-10-03T19:16:01.553331+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1cf600] 2023-10-03T19:21:04.630 INFO:teuthology.orchestra.run.smithi045.stdout: -2691> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000205) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.630 INFO:teuthology.orchestra.run.smithi045.stdout: -2690> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000206 [2,head] /dc-dir/dc-file_17 auth v2252 s=2 n(v0 rc2023-10-03T19:16:01.564111+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1cfb80] 2023-10-03T19:21:04.630 INFO:teuthology.orchestra.run.smithi045.stdout: -2689> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000206) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.630 INFO:teuthology.orchestra.run.smithi045.stdout: -2688> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000207 [2,head] /dc-dir/dc-file_18 auth v2254 s=2 n(v0 rc2023-10-03T19:16:01.575232+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1d0100] 2023-10-03T19:21:04.630 INFO:teuthology.orchestra.run.smithi045.stdout: -2687> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000207) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.630 INFO:teuthology.orchestra.run.smithi045.stdout: -2686> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000208 [2,head] /dc-dir/dc-file_19 auth v2256 s=2 n(v0 rc2023-10-03T19:16:01.585891+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1d0680] 2023-10-03T19:21:04.630 INFO:teuthology.orchestra.run.smithi045.stdout: -2685> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000208) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.630 INFO:teuthology.orchestra.run.smithi045.stdout: -2684> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000209 [2,head] /dc-dir/dc-file_20 auth v2258 s=2 n(v0 rc2023-10-03T19:16:01.596551+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1d0c00] 2023-10-03T19:21:04.630 INFO:teuthology.orchestra.run.smithi045.stdout: -2683> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000209) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.630 INFO:teuthology.orchestra.run.smithi045.stdout: -2682> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000020a [2,head] /dc-dir/dc-file_21 auth v2260 s=2 n(v0 rc2023-10-03T19:16:01.607106+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1d1180] 2023-10-03T19:21:04.630 INFO:teuthology.orchestra.run.smithi045.stdout: -2681> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000020a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.631 INFO:teuthology.orchestra.run.smithi045.stdout: -2680> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000020b [2,head] /dc-dir/dc-file_22 auth v2262 s=2 n(v0 rc2023-10-03T19:16:01.618718+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1d1700] 2023-10-03T19:21:04.631 INFO:teuthology.orchestra.run.smithi045.stdout: -2679> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000020b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.631 INFO:teuthology.orchestra.run.smithi045.stdout: -2678> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000020c [2,head] /dc-dir/dc-file_23 auth v2264 s=2 n(v0 rc2023-10-03T19:16:01.629557+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1e2000] 2023-10-03T19:21:04.631 INFO:teuthology.orchestra.run.smithi045.stdout: -2677> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000020c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.631 INFO:teuthology.orchestra.run.smithi045.stdout: -2676> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000020d [2,head] /dc-dir/dc-file_24 auth v2266 s=2 n(v0 rc2023-10-03T19:16:01.640783+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1e2580] 2023-10-03T19:21:04.631 INFO:teuthology.orchestra.run.smithi045.stdout: -2675> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000020d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.631 INFO:teuthology.orchestra.run.smithi045.stdout: -2674> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000020e [2,head] /dc-dir/dc-file_25 auth v2268 s=2 n(v0 rc2023-10-03T19:16:01.651328+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1e2b00] 2023-10-03T19:21:04.631 INFO:teuthology.orchestra.run.smithi045.stdout: -2673> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000020e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.631 INFO:teuthology.orchestra.run.smithi045.stdout: -2672> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000020f [2,head] /dc-dir/dc-file_26 auth v2270 s=2 n(v0 rc2023-10-03T19:16:01.661762+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1e3080] 2023-10-03T19:21:04.631 INFO:teuthology.orchestra.run.smithi045.stdout: -2671> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000020f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.631 INFO:teuthology.orchestra.run.smithi045.stdout: -2670> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000210 [2,head] /dc-dir/dc-file_27 auth v2272 s=2 n(v0 rc2023-10-03T19:16:01.672901+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1e3600] 2023-10-03T19:21:04.631 INFO:teuthology.orchestra.run.smithi045.stdout: -2669> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000210) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.632 INFO:teuthology.orchestra.run.smithi045.stdout: -2668> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000211 [2,head] /dc-dir/dc-file_28 auth v2274 s=2 n(v0 rc2023-10-03T19:16:01.683762+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1e3b80] 2023-10-03T19:21:04.632 INFO:teuthology.orchestra.run.smithi045.stdout: -2667> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000211) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.632 INFO:teuthology.orchestra.run.smithi045.stdout: -2666> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000212 [2,head] /dc-dir/dc-file_29 auth v2276 s=2 n(v0 rc2023-10-03T19:16:01.694798+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1e4100] 2023-10-03T19:21:04.632 INFO:teuthology.orchestra.run.smithi045.stdout: -2665> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000212) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.632 INFO:teuthology.orchestra.run.smithi045.stdout: -2664> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000213 [2,head] /dc-dir/dc-file_30 auth v2278 s=2 n(v0 rc2023-10-03T19:16:01.706177+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1e4680] 2023-10-03T19:21:04.632 INFO:teuthology.orchestra.run.smithi045.stdout: -2663> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000213) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.632 INFO:teuthology.orchestra.run.smithi045.stdout: -2662> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000214 [2,head] /dc-dir/dc-file_31 auth v2280 s=2 n(v0 rc2023-10-03T19:16:01.717247+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1e4c00] 2023-10-03T19:21:04.649 INFO:teuthology.orchestra.run.smithi045.stdout: -2661> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000214) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.649 INFO:teuthology.orchestra.run.smithi045.stdout: -2660> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000215 [2,head] /dc-dir/dc-file_32 auth v2282 s=2 n(v0 rc2023-10-03T19:16:01.728084+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1e5180] 2023-10-03T19:21:04.649 INFO:teuthology.orchestra.run.smithi045.stdout: -2659> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000215) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.649 INFO:teuthology.orchestra.run.smithi045.stdout: -2658> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000216 [2,head] /dc-dir/dc-file_33 auth v2284 s=2 n(v0 rc2023-10-03T19:16:01.738960+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1e5700] 2023-10-03T19:21:04.649 INFO:teuthology.orchestra.run.smithi045.stdout: -2657> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000216) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.649 INFO:teuthology.orchestra.run.smithi045.stdout: -2656> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000217 [2,head] /dc-dir/dc-file_34 auth v2286 s=2 n(v0 rc2023-10-03T19:16:01.749482+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1f2000] 2023-10-03T19:21:04.649 INFO:teuthology.orchestra.run.smithi045.stdout: -2655> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000217) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.649 INFO:teuthology.orchestra.run.smithi045.stdout: -2654> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000218 [2,head] /dc-dir/dc-file_35 auth v2288 s=2 n(v0 rc2023-10-03T19:16:01.760078+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1f2580] 2023-10-03T19:21:04.650 INFO:teuthology.orchestra.run.smithi045.stdout: -2653> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000218) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.650 INFO:teuthology.orchestra.run.smithi045.stdout: -2652> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000219 [2,head] /dc-dir/dc-file_36 auth v2290 s=2 n(v0 rc2023-10-03T19:16:01.770691+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1f2b00] 2023-10-03T19:21:04.650 INFO:teuthology.orchestra.run.smithi045.stdout: -2651> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000219) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.650 INFO:teuthology.orchestra.run.smithi045.stdout: -2650> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000021a [2,head] /dc-dir/dc-file_37 auth v2292 s=2 n(v0 rc2023-10-03T19:16:01.781592+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1f3080] 2023-10-03T19:21:04.650 INFO:teuthology.orchestra.run.smithi045.stdout: -2649> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000021a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.650 INFO:teuthology.orchestra.run.smithi045.stdout: -2648> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000021b [2,head] /dc-dir/dc-file_38 auth v2294 s=2 n(v0 rc2023-10-03T19:16:01.791990+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1f3600] 2023-10-03T19:21:04.650 INFO:teuthology.orchestra.run.smithi045.stdout: -2647> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000021b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.650 INFO:teuthology.orchestra.run.smithi045.stdout: -2646> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000021c [2,head] /dc-dir/dc-file_39 auth v2296 s=2 n(v0 rc2023-10-03T19:16:01.802363+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1f3b80] 2023-10-03T19:21:04.650 INFO:teuthology.orchestra.run.smithi045.stdout: -2645> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000021c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.651 INFO:teuthology.orchestra.run.smithi045.stdout: -2644> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000021d [2,head] /dc-dir/dc-file_40 auth v2298 s=2 n(v0 rc2023-10-03T19:16:01.812762+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1f4100] 2023-10-03T19:21:04.651 INFO:teuthology.orchestra.run.smithi045.stdout: -2643> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000021d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.651 INFO:teuthology.orchestra.run.smithi045.stdout: -2642> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000021e [2,head] /dc-dir/dc-file_41 auth v2300 s=2 n(v0 rc2023-10-03T19:16:01.823326+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1f4680] 2023-10-03T19:21:04.651 INFO:teuthology.orchestra.run.smithi045.stdout: -2641> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000021e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.651 INFO:teuthology.orchestra.run.smithi045.stdout: -2640> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000021f [2,head] /dc-dir/dc-file_42 auth v2302 s=2 n(v0 rc2023-10-03T19:16:01.833835+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1f4c00] 2023-10-03T19:21:04.651 INFO:teuthology.orchestra.run.smithi045.stdout: -2639> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000021f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.651 INFO:teuthology.orchestra.run.smithi045.stdout: -2638> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000220 [2,head] /dc-dir/dc-file_43 auth v2304 s=2 n(v0 rc2023-10-03T19:16:01.845862+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1f5180] 2023-10-03T19:21:04.651 INFO:teuthology.orchestra.run.smithi045.stdout: -2637> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000220) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.651 INFO:teuthology.orchestra.run.smithi045.stdout: -2636> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000221 [2,head] /dc-dir/dc-file_44 auth v2306 s=2 n(v0 rc2023-10-03T19:16:01.857477+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d1f5700] 2023-10-03T19:21:04.651 INFO:teuthology.orchestra.run.smithi045.stdout: -2635> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000221) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.651 INFO:teuthology.orchestra.run.smithi045.stdout: -2634> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000222 [2,head] /dc-dir/dc-file_45 auth v2308 s=2 n(v0 rc2023-10-03T19:16:01.868690+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d202000] 2023-10-03T19:21:04.651 INFO:teuthology.orchestra.run.smithi045.stdout: -2633> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000222) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.652 INFO:teuthology.orchestra.run.smithi045.stdout: -2632> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000223 [2,head] /dc-dir/dc-file_46 auth v2310 s=2 n(v0 rc2023-10-03T19:16:01.879694+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d202580] 2023-10-03T19:21:04.652 INFO:teuthology.orchestra.run.smithi045.stdout: -2631> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000223) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.653 INFO:teuthology.orchestra.run.smithi045.stdout: -2630> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000224 [2,head] /dc-dir/dc-file_47 auth v2312 s=2 n(v0 rc2023-10-03T19:16:01.890810+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d202b00] 2023-10-03T19:21:04.653 INFO:teuthology.orchestra.run.smithi045.stdout: -2629> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000224) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.653 INFO:teuthology.orchestra.run.smithi045.stdout: -2628> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000225 [2,head] /dc-dir/dc-file_48 auth v2314 s=2 n(v0 rc2023-10-03T19:16:01.903603+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d203080] 2023-10-03T19:21:04.653 INFO:teuthology.orchestra.run.smithi045.stdout: -2627> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000225) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.653 INFO:teuthology.orchestra.run.smithi045.stdout: -2626> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000226 [2,head] /dc-dir/dc-file_49 auth v2316 s=2 n(v0 rc2023-10-03T19:16:01.916070+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d203600] 2023-10-03T19:21:04.653 INFO:teuthology.orchestra.run.smithi045.stdout: -2625> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000226) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.653 INFO:teuthology.orchestra.run.smithi045.stdout: -2624> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000227 [2,head] /dc-dir/dc-file_50 auth v2318 s=2 n(v0 rc2023-10-03T19:16:01.927369+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d203b80] 2023-10-03T19:21:04.653 INFO:teuthology.orchestra.run.smithi045.stdout: -2623> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000227) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.654 INFO:teuthology.orchestra.run.smithi045.stdout: -2622> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000228 [2,head] /dc-dir/dc-file_51 auth v2320 s=2 n(v0 rc2023-10-03T19:16:01.937025+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d204100] 2023-10-03T19:21:04.654 INFO:teuthology.orchestra.run.smithi045.stdout: -2621> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000228) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.654 INFO:teuthology.orchestra.run.smithi045.stdout: -2620> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000229 [2,head] /dc-dir/dc-file_52 auth v2322 s=2 n(v0 rc2023-10-03T19:16:01.948181+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d204680] 2023-10-03T19:21:04.654 INFO:teuthology.orchestra.run.smithi045.stdout: -2619> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000229) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.654 INFO:teuthology.orchestra.run.smithi045.stdout: -2618> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000022a [2,head] /dc-dir/dc-file_53 auth v2324 s=2 n(v0 rc2023-10-03T19:16:01.958561+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d204c00] 2023-10-03T19:21:04.654 INFO:teuthology.orchestra.run.smithi045.stdout: -2617> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000022a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.654 INFO:teuthology.orchestra.run.smithi045.stdout: -2616> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000022b [2,head] /dc-dir/dc-file_54 auth v2326 s=2 n(v0 rc2023-10-03T19:16:01.968814+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d205180] 2023-10-03T19:21:04.654 INFO:teuthology.orchestra.run.smithi045.stdout: -2615> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000022b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.655 INFO:teuthology.orchestra.run.smithi045.stdout: -2614> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000022c [2,head] /dc-dir/dc-file_55 auth v2328 s=2 n(v0 rc2023-10-03T19:16:01.979916+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d205700] 2023-10-03T19:21:04.655 INFO:teuthology.orchestra.run.smithi045.stdout: -2613> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000022c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.655 INFO:teuthology.orchestra.run.smithi045.stdout: -2612> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000022d [2,head] /dc-dir/dc-file_56 auth v2330 s=2 n(v0 rc2023-10-03T19:16:01.990677+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d076000] 2023-10-03T19:21:04.655 INFO:teuthology.orchestra.run.smithi045.stdout: -2611> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000022d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.655 INFO:teuthology.orchestra.run.smithi045.stdout: -2610> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000022e [2,head] /dc-dir/dc-file_57 auth v2332 s=2 n(v0 rc2023-10-03T19:16:02.001261+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d076580] 2023-10-03T19:21:04.655 INFO:teuthology.orchestra.run.smithi045.stdout: -2609> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000022e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.655 INFO:teuthology.orchestra.run.smithi045.stdout: -2608> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000022f [2,head] /dc-dir/dc-file_58 auth v2334 s=2 n(v0 rc2023-10-03T19:16:02.011705+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d076b00] 2023-10-03T19:21:04.655 INFO:teuthology.orchestra.run.smithi045.stdout: -2607> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000022f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.655 INFO:teuthology.orchestra.run.smithi045.stdout: -2606> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000230 [2,head] /dc-dir/dc-file_59 auth v2336 s=2 n(v0 rc2023-10-03T19:16:02.022705+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d077080] 2023-10-03T19:21:04.655 INFO:teuthology.orchestra.run.smithi045.stdout: -2605> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000230) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.655 INFO:teuthology.orchestra.run.smithi045.stdout: -2604> 2023-10-03T19:16:29.338+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1048 ==== osd_op_reply(2076 10000000008.00000000 [delete] v50'43 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:04.656 INFO:teuthology.orchestra.run.smithi045.stdout: -2603> 2023-10-03T19:16:29.338+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000231 [2,head] /dc-dir/dc-file_60 auth v2338 s=2 n(v0 rc2023-10-03T19:16:02.032813+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d077600] 2023-10-03T19:21:04.656 INFO:teuthology.orchestra.run.smithi045.stdout: -2602> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000231) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.656 INFO:teuthology.orchestra.run.smithi045.stdout: -2601> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000232 [2,head] /dc-dir/dc-file_61 auth v2340 s=2 n(v0 rc2023-10-03T19:16:02.043776+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d077b80] 2023-10-03T19:21:04.656 INFO:teuthology.orchestra.run.smithi045.stdout: -2600> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000232) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.658 INFO:teuthology.orchestra.run.smithi045.stdout: -2599> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000233 [2,head] /dc-dir/dc-file_62 auth v2342 s=2 n(v0 rc2023-10-03T19:16:02.054308+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d078100] 2023-10-03T19:21:04.658 INFO:teuthology.orchestra.run.smithi045.stdout: -2598> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000233) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.658 INFO:teuthology.orchestra.run.smithi045.stdout: -2597> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000234 [2,head] /dc-dir/dc-file_63 auth v2344 s=2 n(v0 rc2023-10-03T19:16:02.066269+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d078680] 2023-10-03T19:21:04.658 INFO:teuthology.orchestra.run.smithi045.stdout: -2596> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000234) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.658 INFO:teuthology.orchestra.run.smithi045.stdout: -2595> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000235 [2,head] /dc-dir/dc-file_64 auth v2346 s=2 n(v0 rc2023-10-03T19:16:02.077248+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d078c00] 2023-10-03T19:21:04.658 INFO:teuthology.orchestra.run.smithi045.stdout: -2594> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000235) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.658 INFO:teuthology.orchestra.run.smithi045.stdout: -2593> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000236 [2,head] /dc-dir/dc-file_65 auth v2348 s=2 n(v0 rc2023-10-03T19:16:02.087724+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d079180] 2023-10-03T19:21:04.658 INFO:teuthology.orchestra.run.smithi045.stdout: -2592> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000236) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.658 INFO:teuthology.orchestra.run.smithi045.stdout: -2591> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000237 [2,head] /dc-dir/dc-file_66 auth v2350 s=2 n(v0 rc2023-10-03T19:16:02.097943+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d079700] 2023-10-03T19:21:04.658 INFO:teuthology.orchestra.run.smithi045.stdout: -2590> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000237) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.659 INFO:teuthology.orchestra.run.smithi045.stdout: -2589> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000238 [2,head] /dc-dir/dc-file_67 auth v2352 s=2 n(v0 rc2023-10-03T19:16:02.108882+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d21a000] 2023-10-03T19:21:04.659 INFO:teuthology.orchestra.run.smithi045.stdout: -2588> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000238) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.659 INFO:teuthology.orchestra.run.smithi045.stdout: -2587> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000239 [2,head] /dc-dir/dc-file_68 auth v2354 s=2 n(v0 rc2023-10-03T19:16:02.119336+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d21a580] 2023-10-03T19:21:04.659 INFO:teuthology.orchestra.run.smithi045.stdout: -2586> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000239) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.659 INFO:teuthology.orchestra.run.smithi045.stdout: -2585> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000023a [2,head] /dc-dir/dc-file_69 auth v2356 s=2 n(v0 rc2023-10-03T19:16:02.130245+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d21ab00] 2023-10-03T19:21:04.659 INFO:teuthology.orchestra.run.smithi045.stdout: -2584> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000023a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.659 INFO:teuthology.orchestra.run.smithi045.stdout: -2583> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000023b [2,head] /dc-dir/dc-file_70 auth v2358 s=2 n(v0 rc2023-10-03T19:16:02.140967+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d21b080] 2023-10-03T19:21:04.659 INFO:teuthology.orchestra.run.smithi045.stdout: -2582> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000023b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.659 INFO:teuthology.orchestra.run.smithi045.stdout: -2581> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000023c [2,head] /dc-dir/dc-file_71 auth v2360 s=2 n(v0 rc2023-10-03T19:16:02.151265+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d21b600] 2023-10-03T19:21:04.659 INFO:teuthology.orchestra.run.smithi045.stdout: -2580> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000023c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.659 INFO:teuthology.orchestra.run.smithi045.stdout: -2579> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000023d [2,head] /dc-dir/dc-file_72 auth v2362 s=2 n(v0 rc2023-10-03T19:16:02.161908+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d21bb80] 2023-10-03T19:21:04.659 INFO:teuthology.orchestra.run.smithi045.stdout: -2578> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000023d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.660 INFO:teuthology.orchestra.run.smithi045.stdout: -2577> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000023e [2,head] /dc-dir/dc-file_73 auth v2364 s=2 n(v0 rc2023-10-03T19:16:02.172216+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d21c100] 2023-10-03T19:21:04.660 INFO:teuthology.orchestra.run.smithi045.stdout: -2576> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000023e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.660 INFO:teuthology.orchestra.run.smithi045.stdout: -2575> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000023f [2,head] /dc-dir/dc-file_74 auth v2366 s=2 n(v0 rc2023-10-03T19:16:02.182029+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d21c680] 2023-10-03T19:21:04.660 INFO:teuthology.orchestra.run.smithi045.stdout: -2574> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000023f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.660 INFO:teuthology.orchestra.run.smithi045.stdout: -2573> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000240 [2,head] /dc-dir/dc-file_75 auth v2368 s=2 n(v0 rc2023-10-03T19:16:02.192925+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d21cc00] 2023-10-03T19:21:04.660 INFO:teuthology.orchestra.run.smithi045.stdout: -2572> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000240) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.660 INFO:teuthology.orchestra.run.smithi045.stdout: -2571> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000241 [2,head] /dc-dir/dc-file_76 auth v2370 s=2 n(v0 rc2023-10-03T19:16:02.203493+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d21d180] 2023-10-03T19:21:04.660 INFO:teuthology.orchestra.run.smithi045.stdout: -2570> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000241) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.660 INFO:teuthology.orchestra.run.smithi045.stdout: -2569> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000242 [2,head] /dc-dir/dc-file_77 auth v2372 s=2 n(v0 rc2023-10-03T19:16:02.214365+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d21d700] 2023-10-03T19:21:04.660 INFO:teuthology.orchestra.run.smithi045.stdout: -2568> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000242) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.661 INFO:teuthology.orchestra.run.smithi045.stdout: -2567> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000243 [2,head] /dc-dir/dc-file_78 auth v2374 s=2 n(v0 rc2023-10-03T19:16:02.226028+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d18e000] 2023-10-03T19:21:04.661 INFO:teuthology.orchestra.run.smithi045.stdout: -2566> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000243) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.661 INFO:teuthology.orchestra.run.smithi045.stdout: -2565> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000244 [2,head] /dc-dir/dc-file_79 auth v2376 s=2 n(v0 rc2023-10-03T19:16:02.236741+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d18e580] 2023-10-03T19:21:04.661 INFO:teuthology.orchestra.run.smithi045.stdout: -2564> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000244) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.661 INFO:teuthology.orchestra.run.smithi045.stdout: -2563> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000245 [2,head] /dc-dir/dc-file_80 auth v2378 s=2 n(v0 rc2023-10-03T19:16:02.247519+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d18eb00] 2023-10-03T19:21:04.661 INFO:teuthology.orchestra.run.smithi045.stdout: -2562> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000245) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.661 INFO:teuthology.orchestra.run.smithi045.stdout: -2561> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000246 [2,head] /dc-dir/dc-file_81 auth v2380 s=2 n(v0 rc2023-10-03T19:16:02.258829+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d18f080] 2023-10-03T19:21:04.661 INFO:teuthology.orchestra.run.smithi045.stdout: -2560> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000246) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.661 INFO:teuthology.orchestra.run.smithi045.stdout: -2559> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000247 [2,head] /dc-dir/dc-file_82 auth v2382 s=2 n(v0 rc2023-10-03T19:16:02.269567+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d18f600] 2023-10-03T19:21:04.661 INFO:teuthology.orchestra.run.smithi045.stdout: -2558> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000247) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.662 INFO:teuthology.orchestra.run.smithi045.stdout: -2557> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000248 [2,head] /dc-dir/dc-file_83 auth v2384 s=2 n(v0 rc2023-10-03T19:16:02.280959+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d18fb80] 2023-10-03T19:21:04.662 INFO:teuthology.orchestra.run.smithi045.stdout: -2556> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000248) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.662 INFO:teuthology.orchestra.run.smithi045.stdout: -2555> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000249 [2,head] /dc-dir/dc-file_84 auth v2386 s=2 n(v0 rc2023-10-03T19:16:02.291423+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d190100] 2023-10-03T19:21:04.662 INFO:teuthology.orchestra.run.smithi045.stdout: -2554> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000249) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.662 INFO:teuthology.orchestra.run.smithi045.stdout: -2553> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000024a [2,head] /dc-dir/dc-file_85 auth v2388 s=2 n(v0 rc2023-10-03T19:16:02.301769+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d190680] 2023-10-03T19:21:04.662 INFO:teuthology.orchestra.run.smithi045.stdout: -2552> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000024a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.662 INFO:teuthology.orchestra.run.smithi045.stdout: -2551> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000024b [2,head] /dc-dir/dc-file_86 auth v2390 s=2 n(v0 rc2023-10-03T19:16:02.313215+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d190c00] 2023-10-03T19:21:04.662 INFO:teuthology.orchestra.run.smithi045.stdout: -2550> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000024b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.662 INFO:teuthology.orchestra.run.smithi045.stdout: -2549> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000024c [2,head] /dc-dir/dc-file_87 auth v2392 s=2 n(v0 rc2023-10-03T19:16:02.323712+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d191180] 2023-10-03T19:21:04.662 INFO:teuthology.orchestra.run.smithi045.stdout: -2548> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000024c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.663 INFO:teuthology.orchestra.run.smithi045.stdout: -2547> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000024d [2,head] /dc-dir/dc-file_88 auth v2394 s=2 n(v0 rc2023-10-03T19:16:02.335135+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d191700] 2023-10-03T19:21:04.663 INFO:teuthology.orchestra.run.smithi045.stdout: -2546> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000024d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.663 INFO:teuthology.orchestra.run.smithi045.stdout: -2545> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000024e [2,head] /dc-dir/dc-file_89 auth v2396 s=2 n(v0 rc2023-10-03T19:16:02.344544+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576ce1c000] 2023-10-03T19:21:04.663 INFO:teuthology.orchestra.run.smithi045.stdout: -2544> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000024e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.663 INFO:teuthology.orchestra.run.smithi045.stdout: -2543> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000024f [2,head] /dc-dir/dc-file_90 auth v2398 s=2 n(v0 rc2023-10-03T19:16:02.352383+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576ce1c580] 2023-10-03T19:21:04.663 INFO:teuthology.orchestra.run.smithi045.stdout: -2542> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000024f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.663 INFO:teuthology.orchestra.run.smithi045.stdout: -2541> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000250 [2,head] /dc-dir/dc-file_91 auth v2400 s=2 n(v0 rc2023-10-03T19:16:02.363258+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576ce1cb00] 2023-10-03T19:21:04.663 INFO:teuthology.orchestra.run.smithi045.stdout: -2540> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000250) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.663 INFO:teuthology.orchestra.run.smithi045.stdout: -2539> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000251 [2,head] /dc-dir/dc-file_92 auth v2402 s=2 n(v0 rc2023-10-03T19:16:02.372114+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576ce1d080] 2023-10-03T19:21:04.663 INFO:teuthology.orchestra.run.smithi045.stdout: -2538> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000251) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.663 INFO:teuthology.orchestra.run.smithi045.stdout: -2537> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000252 [2,head] /dc-dir/dc-file_93 auth v2404 s=2 n(v0 rc2023-10-03T19:16:02.381221+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576ce1d600] 2023-10-03T19:21:04.695 INFO:teuthology.orchestra.run.smithi045.stdout: -2536> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000252) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.695 INFO:teuthology.orchestra.run.smithi045.stdout: -2535> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000253 [2,head] /dc-dir/dc-file_94 auth v2406 s=2 n(v0 rc2023-10-03T19:16:02.390854+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576ce1db80] 2023-10-03T19:21:04.695 INFO:teuthology.orchestra.run.smithi045.stdout: -2534> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000253) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.695 INFO:teuthology.orchestra.run.smithi045.stdout: -2533> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000254 [2,head] /dc-dir/dc-file_95 auth v2408 s=2 n(v0 rc2023-10-03T19:16:02.400309+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576ce1e100] 2023-10-03T19:21:04.695 INFO:teuthology.orchestra.run.smithi045.stdout: -2532> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000254) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.695 INFO:teuthology.orchestra.run.smithi045.stdout: -2531> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000255 [2,head] /dc-dir/dc-file_96 auth v2410 s=2 n(v0 rc2023-10-03T19:16:02.409341+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576ce1e680] 2023-10-03T19:21:04.695 INFO:teuthology.orchestra.run.smithi045.stdout: -2530> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000255) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.695 INFO:teuthology.orchestra.run.smithi045.stdout: -2529> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000256 [2,head] /dc-dir/dc-file_97 auth v2412 s=2 n(v0 rc2023-10-03T19:16:02.418426+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576ce1ec00] 2023-10-03T19:21:04.695 INFO:teuthology.orchestra.run.smithi045.stdout: -2528> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000256) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.695 INFO:teuthology.orchestra.run.smithi045.stdout: -2527> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000257 [2,head] /dc-dir/dc-file_98 auth v2414 s=2 n(v0 rc2023-10-03T19:16:02.427094+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576ce1f180] 2023-10-03T19:21:04.695 INFO:teuthology.orchestra.run.smithi045.stdout: -2526> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000257) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.696 INFO:teuthology.orchestra.run.smithi045.stdout: -2525> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000258 [2,head] /dc-dir/dc-file_99 auth v2416 s=2 n(v0 rc2023-10-03T19:16:02.435775+0000 b2 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576ce1f700] 2023-10-03T19:21:04.696 INFO:teuthology.orchestra.run.smithi045.stdout: -2524> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000258) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.696 INFO:teuthology.orchestra.run.smithi045.stdout: -2523> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000259 [2,head] /dc-dir/dc-file_100 auth v2718 s=3 n(v0 rc2023-10-03T19:16:02.445089+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576cf1a000] 2023-10-03T19:21:04.696 INFO:teuthology.orchestra.run.smithi045.stdout: -2522> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000259) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.696 INFO:teuthology.orchestra.run.smithi045.stdout: -2521> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000025a [2,head] /dc-dir/dc-file_101 auth v2720 s=3 n(v0 rc2023-10-03T19:16:02.454639+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576cf1a580] 2023-10-03T19:21:04.696 INFO:teuthology.orchestra.run.smithi045.stdout: -2520> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000025a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.696 INFO:teuthology.orchestra.run.smithi045.stdout: -2519> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000025b [2,head] /dc-dir/dc-file_102 auth v2722 s=3 n(v0 rc2023-10-03T19:16:02.464001+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576cf1ab00] 2023-10-03T19:21:04.696 INFO:teuthology.orchestra.run.smithi045.stdout: -2518> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000025b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.696 INFO:teuthology.orchestra.run.smithi045.stdout: -2517> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000025c [2,head] /dc-dir/dc-file_103 auth v2724 s=3 n(v0 rc2023-10-03T19:16:02.472943+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576cf1b080] 2023-10-03T19:21:04.696 INFO:teuthology.orchestra.run.smithi045.stdout: -2516> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000025c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.696 INFO:teuthology.orchestra.run.smithi045.stdout: -2515> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000025d [2,head] /dc-dir/dc-file_104 auth v2726 s=3 n(v0 rc2023-10-03T19:16:02.481630+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576cf1b600] 2023-10-03T19:21:04.696 INFO:teuthology.orchestra.run.smithi045.stdout: -2514> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000025d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.697 INFO:teuthology.orchestra.run.smithi045.stdout: -2513> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000025e [2,head] /dc-dir/dc-file_105 auth v2728 s=3 n(v0 rc2023-10-03T19:16:02.489926+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576cf1bb80] 2023-10-03T19:21:04.697 INFO:teuthology.orchestra.run.smithi045.stdout: -2512> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000025e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.697 INFO:teuthology.orchestra.run.smithi045.stdout: -2511> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000025f [2,head] /dc-dir/dc-file_106 auth v2730 s=3 n(v0 rc2023-10-03T19:16:02.499416+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576cf1c100] 2023-10-03T19:21:04.697 INFO:teuthology.orchestra.run.smithi045.stdout: -2510> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000025f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.697 INFO:teuthology.orchestra.run.smithi045.stdout: -2509> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000260 [2,head] /dc-dir/dc-file_107 auth v2732 s=3 n(v0 rc2023-10-03T19:16:02.507801+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576cf1c680] 2023-10-03T19:21:04.697 INFO:teuthology.orchestra.run.smithi045.stdout: -2508> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000260) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.697 INFO:teuthology.orchestra.run.smithi045.stdout: -2507> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000261 [2,head] /dc-dir/dc-file_108 auth v2734 s=3 n(v0 rc2023-10-03T19:16:02.516002+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576cf1cc00] 2023-10-03T19:21:04.697 INFO:teuthology.orchestra.run.smithi045.stdout: -2506> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000261) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.697 INFO:teuthology.orchestra.run.smithi045.stdout: -2505> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000262 [2,head] /dc-dir/dc-file_109 auth v2736 s=3 n(v0 rc2023-10-03T19:16:02.525607+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576cf1d180] 2023-10-03T19:21:04.697 INFO:teuthology.orchestra.run.smithi045.stdout: -2504> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000262) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.697 INFO:teuthology.orchestra.run.smithi045.stdout: -2503> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000263 [2,head] /dc-dir/dc-file_110 auth v2738 s=3 n(v0 rc2023-10-03T19:16:02.536311+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576cf1d700] 2023-10-03T19:21:04.697 INFO:teuthology.orchestra.run.smithi045.stdout: -2502> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000263) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.698 INFO:teuthology.orchestra.run.smithi045.stdout: -2501> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000264 [2,head] /dc-dir/dc-file_111 auth v2740 s=3 n(v0 rc2023-10-03T19:16:02.547074+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576cf22000] 2023-10-03T19:21:04.698 INFO:teuthology.orchestra.run.smithi045.stdout: -2500> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000264) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.698 INFO:teuthology.orchestra.run.smithi045.stdout: -2499> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000265 [2,head] /dc-dir/dc-file_112 auth v2742 s=3 n(v0 rc2023-10-03T19:16:02.557713+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576cf22580] 2023-10-03T19:21:04.698 INFO:teuthology.orchestra.run.smithi045.stdout: -2498> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000265) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.698 INFO:teuthology.orchestra.run.smithi045.stdout: -2497> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000266 [2,head] /dc-dir/dc-file_113 auth v2744 s=3 n(v0 rc2023-10-03T19:16:02.567744+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576cf22b00] 2023-10-03T19:21:04.698 INFO:teuthology.orchestra.run.smithi045.stdout: -2496> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000266) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.698 INFO:teuthology.orchestra.run.smithi045.stdout: -2495> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000267 [2,head] /dc-dir/dc-file_114 auth v2746 s=3 n(v0 rc2023-10-03T19:16:02.577835+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576cf23080] 2023-10-03T19:21:04.698 INFO:teuthology.orchestra.run.smithi045.stdout: -2494> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000267) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.698 INFO:teuthology.orchestra.run.smithi045.stdout: -2493> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000268 [2,head] /dc-dir/dc-file_115 auth v2748 s=3 n(v0 rc2023-10-03T19:16:02.588332+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576cf23600] 2023-10-03T19:21:04.698 INFO:teuthology.orchestra.run.smithi045.stdout: -2492> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000268) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.698 INFO:teuthology.orchestra.run.smithi045.stdout: -2491> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000269 [2,head] /dc-dir/dc-file_116 auth v2750 s=3 n(v0 rc2023-10-03T19:16:02.599497+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576cf23b80] 2023-10-03T19:21:04.699 INFO:teuthology.orchestra.run.smithi045.stdout: -2490> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000269) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.699 INFO:teuthology.orchestra.run.smithi045.stdout: -2489> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000026a [2,head] /dc-dir/dc-file_117 auth v2752 s=3 n(v0 rc2023-10-03T19:16:02.609688+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576cf24100] 2023-10-03T19:21:04.699 INFO:teuthology.orchestra.run.smithi045.stdout: -2488> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000026a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.699 INFO:teuthology.orchestra.run.smithi045.stdout: -2487> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000026b [2,head] /dc-dir/dc-file_118 auth v2754 s=3 n(v0 rc2023-10-03T19:16:02.620865+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576cf24680] 2023-10-03T19:21:04.699 INFO:teuthology.orchestra.run.smithi045.stdout: -2486> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000026b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.699 INFO:teuthology.orchestra.run.smithi045.stdout: -2485> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000026c [2,head] /dc-dir/dc-file_119 auth v2756 s=3 n(v0 rc2023-10-03T19:16:02.631010+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576cf24c00] 2023-10-03T19:21:04.699 INFO:teuthology.orchestra.run.smithi045.stdout: -2484> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000026c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.699 INFO:teuthology.orchestra.run.smithi045.stdout: -2483> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000026d [2,head] /dc-dir/dc-file_120 auth v2758 s=3 n(v0 rc2023-10-03T19:16:02.641609+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576cf25180] 2023-10-03T19:21:04.699 INFO:teuthology.orchestra.run.smithi045.stdout: -2482> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000026d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.699 INFO:teuthology.orchestra.run.smithi045.stdout: -2481> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000026e [2,head] /dc-dir/dc-file_121 auth v2760 s=3 n(v0 rc2023-10-03T19:16:02.651839+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576cf25700] 2023-10-03T19:21:04.699 INFO:teuthology.orchestra.run.smithi045.stdout: -2480> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000026e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.700 INFO:teuthology.orchestra.run.smithi045.stdout: -2479> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000026f [2,head] /dc-dir/dc-file_122 auth v2762 s=3 n(v0 rc2023-10-03T19:16:02.662415+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d252000] 2023-10-03T19:21:04.700 INFO:teuthology.orchestra.run.smithi045.stdout: -2478> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000026f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.700 INFO:teuthology.orchestra.run.smithi045.stdout: -2477> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000270 [2,head] /dc-dir/dc-file_123 auth v2764 s=3 n(v0 rc2023-10-03T19:16:02.672314+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d252580] 2023-10-03T19:21:04.700 INFO:teuthology.orchestra.run.smithi045.stdout: -2476> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000270) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.700 INFO:teuthology.orchestra.run.smithi045.stdout: -2475> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000271 [2,head] /dc-dir/dc-file_124 auth v2766 s=3 n(v0 rc2023-10-03T19:16:02.682757+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d252b00] 2023-10-03T19:21:04.700 INFO:teuthology.orchestra.run.smithi045.stdout: -2474> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000271) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.700 INFO:teuthology.orchestra.run.smithi045.stdout: -2473> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000272 [2,head] /dc-dir/dc-file_125 auth v2768 s=3 n(v0 rc2023-10-03T19:16:02.692491+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d253080] 2023-10-03T19:21:04.700 INFO:teuthology.orchestra.run.smithi045.stdout: -2472> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000272) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.700 INFO:teuthology.orchestra.run.smithi045.stdout: -2471> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000273 [2,head] /dc-dir/dc-file_126 auth v2770 s=3 n(v0 rc2023-10-03T19:16:02.703361+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d253600] 2023-10-03T19:21:04.700 INFO:teuthology.orchestra.run.smithi045.stdout: -2470> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000273) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.700 INFO:teuthology.orchestra.run.smithi045.stdout: -2469> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000274 [2,head] /dc-dir/dc-file_127 auth v2772 s=3 n(v0 rc2023-10-03T19:16:02.714883+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d253b80] 2023-10-03T19:21:04.700 INFO:teuthology.orchestra.run.smithi045.stdout: -2468> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000274) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.701 INFO:teuthology.orchestra.run.smithi045.stdout: -2467> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000275 [2,head] /dc-dir/dc-file_128 auth v2774 s=3 n(v0 rc2023-10-03T19:16:02.726737+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d254100] 2023-10-03T19:21:04.701 INFO:teuthology.orchestra.run.smithi045.stdout: -2466> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000275) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.702 INFO:teuthology.orchestra.run.smithi045.stdout: -2465> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000276 [2,head] /dc-dir/dc-file_129 auth v2776 s=3 n(v0 rc2023-10-03T19:16:02.738323+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d254680] 2023-10-03T19:21:04.703 INFO:teuthology.orchestra.run.smithi045.stdout: -2464> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000276) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.703 INFO:teuthology.orchestra.run.smithi045.stdout: -2463> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000277 [2,head] /dc-dir/dc-file_130 auth v2778 s=3 n(v0 rc2023-10-03T19:16:02.748067+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d254c00] 2023-10-03T19:21:04.703 INFO:teuthology.orchestra.run.smithi045.stdout: -2462> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000277) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.703 INFO:teuthology.orchestra.run.smithi045.stdout: -2461> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000278 [2,head] /dc-dir/dc-file_131 auth v2780 s=3 n(v0 rc2023-10-03T19:16:02.759225+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d255180] 2023-10-03T19:21:04.703 INFO:teuthology.orchestra.run.smithi045.stdout: -2460> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000278) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.703 INFO:teuthology.orchestra.run.smithi045.stdout: -2459> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000279 [2,head] /dc-dir/dc-file_132 auth v2782 s=3 n(v0 rc2023-10-03T19:16:02.770426+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d255700] 2023-10-03T19:21:04.703 INFO:teuthology.orchestra.run.smithi045.stdout: -2458> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000279) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.703 INFO:teuthology.orchestra.run.smithi045.stdout: -2457> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000027a [2,head] /dc-dir/dc-file_133 auth v2784 s=3 n(v0 rc2023-10-03T19:16:02.782320+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d25e000] 2023-10-03T19:21:04.703 INFO:teuthology.orchestra.run.smithi045.stdout: -2456> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000027a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.703 INFO:teuthology.orchestra.run.smithi045.stdout: -2455> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000027b [2,head] /dc-dir/dc-file_134 auth v2786 s=3 n(v0 rc2023-10-03T19:16:02.794123+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d25e580] 2023-10-03T19:21:04.704 INFO:teuthology.orchestra.run.smithi045.stdout: -2454> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000027b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.704 INFO:teuthology.orchestra.run.smithi045.stdout: -2453> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000027c [2,head] /dc-dir/dc-file_135 auth v2788 s=3 n(v0 rc2023-10-03T19:16:02.804965+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d25eb00] 2023-10-03T19:21:04.704 INFO:teuthology.orchestra.run.smithi045.stdout: -2452> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000027c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.704 INFO:teuthology.orchestra.run.smithi045.stdout: -2451> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000027d [2,head] /dc-dir/dc-file_136 auth v2790 s=3 n(v0 rc2023-10-03T19:16:02.815456+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d25f080] 2023-10-03T19:21:04.704 INFO:teuthology.orchestra.run.smithi045.stdout: -2450> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000027d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.704 INFO:teuthology.orchestra.run.smithi045.stdout: -2449> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000027e [2,head] /dc-dir/dc-file_137 auth v2792 s=3 n(v0 rc2023-10-03T19:16:02.826399+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d25f600] 2023-10-03T19:21:04.704 INFO:teuthology.orchestra.run.smithi045.stdout: -2448> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000027e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.704 INFO:teuthology.orchestra.run.smithi045.stdout: -2447> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000027f [2,head] /dc-dir/dc-file_138 auth v2794 s=3 n(v0 rc2023-10-03T19:16:02.836408+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d25fb80] 2023-10-03T19:21:04.704 INFO:teuthology.orchestra.run.smithi045.stdout: -2446> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000027f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.704 INFO:teuthology.orchestra.run.smithi045.stdout: -2445> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000280 [2,head] /dc-dir/dc-file_139 auth v2796 s=3 n(v0 rc2023-10-03T19:16:02.846940+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d260100] 2023-10-03T19:21:04.704 INFO:teuthology.orchestra.run.smithi045.stdout: -2444> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000280) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.704 INFO:teuthology.orchestra.run.smithi045.stdout: -2443> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000281 [2,head] /dc-dir/dc-file_140 auth v2798 s=3 n(v0 rc2023-10-03T19:16:02.858322+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d260680] 2023-10-03T19:21:04.705 INFO:teuthology.orchestra.run.smithi045.stdout: -2442> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000281) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.705 INFO:teuthology.orchestra.run.smithi045.stdout: -2441> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000282 [2,head] /dc-dir/dc-file_141 auth v2800 s=3 n(v0 rc2023-10-03T19:16:02.868618+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d260c00] 2023-10-03T19:21:04.705 INFO:teuthology.orchestra.run.smithi045.stdout: -2440> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000282) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.705 INFO:teuthology.orchestra.run.smithi045.stdout: -2439> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000283 [2,head] /dc-dir/dc-file_142 auth v2802 s=3 n(v0 rc2023-10-03T19:16:02.880218+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d261180] 2023-10-03T19:21:04.705 INFO:teuthology.orchestra.run.smithi045.stdout: -2438> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000283) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.705 INFO:teuthology.orchestra.run.smithi045.stdout: -2437> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000284 [2,head] /dc-dir/dc-file_143 auth v2804 s=3 n(v0 rc2023-10-03T19:16:02.891483+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d261700] 2023-10-03T19:21:04.705 INFO:teuthology.orchestra.run.smithi045.stdout: -2436> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000284) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.705 INFO:teuthology.orchestra.run.smithi045.stdout: -2435> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000285 [2,head] /dc-dir/dc-file_144 auth v2806 s=3 n(v0 rc2023-10-03T19:16:02.902523+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d26c000] 2023-10-03T19:21:04.705 INFO:teuthology.orchestra.run.smithi045.stdout: -2434> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000285) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.705 INFO:teuthology.orchestra.run.smithi045.stdout: -2433> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000286 [2,head] /dc-dir/dc-file_145 auth v2808 s=3 n(v0 rc2023-10-03T19:16:02.913510+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d26c580] 2023-10-03T19:21:04.705 INFO:teuthology.orchestra.run.smithi045.stdout: -2432> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000286) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.705 INFO:teuthology.orchestra.run.smithi045.stdout: -2431> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000287 [2,head] /dc-dir/dc-file_146 auth v2810 s=3 n(v0 rc2023-10-03T19:16:02.924572+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d26cb00] 2023-10-03T19:21:04.706 INFO:teuthology.orchestra.run.smithi045.stdout: -2430> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000287) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.706 INFO:teuthology.orchestra.run.smithi045.stdout: -2429> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000288 [2,head] /dc-dir/dc-file_147 auth v2812 s=3 n(v0 rc2023-10-03T19:16:02.935565+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d26d080] 2023-10-03T19:21:04.706 INFO:teuthology.orchestra.run.smithi045.stdout: -2428> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000288) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.706 INFO:teuthology.orchestra.run.smithi045.stdout: -2427> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000289 [2,head] /dc-dir/dc-file_148 auth v2814 s=3 n(v0 rc2023-10-03T19:16:02.945394+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d26d600] 2023-10-03T19:21:04.706 INFO:teuthology.orchestra.run.smithi045.stdout: -2426> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000289) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.706 INFO:teuthology.orchestra.run.smithi045.stdout: -2425> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000028a [2,head] /dc-dir/dc-file_149 auth v2816 s=3 n(v0 rc2023-10-03T19:16:02.957154+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d26db80] 2023-10-03T19:21:04.706 INFO:teuthology.orchestra.run.smithi045.stdout: -2424> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000028a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.706 INFO:teuthology.orchestra.run.smithi045.stdout: -2423> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000028b [2,head] /dc-dir/dc-file_150 auth v2818 s=3 n(v0 rc2023-10-03T19:16:02.968645+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d26e100] 2023-10-03T19:21:04.706 INFO:teuthology.orchestra.run.smithi045.stdout: -2422> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000028b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.706 INFO:teuthology.orchestra.run.smithi045.stdout: -2421> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000028c [2,head] /dc-dir/dc-file_151 auth v2820 s=3 n(v0 rc2023-10-03T19:16:02.979391+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d26e680] 2023-10-03T19:21:04.707 INFO:teuthology.orchestra.run.smithi045.stdout: -2420> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000028c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.707 INFO:teuthology.orchestra.run.smithi045.stdout: -2419> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000028d [2,head] /dc-dir/dc-file_152 auth v2822 s=3 n(v0 rc2023-10-03T19:16:02.990071+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d26ec00] 2023-10-03T19:21:04.707 INFO:teuthology.orchestra.run.smithi045.stdout: -2418> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000028d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.707 INFO:teuthology.orchestra.run.smithi045.stdout: -2417> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000028e [2,head] /dc-dir/dc-file_153 auth v2824 s=3 n(v0 rc2023-10-03T19:16:03.000661+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d26f180] 2023-10-03T19:21:04.707 INFO:teuthology.orchestra.run.smithi045.stdout: -2416> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000028e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.707 INFO:teuthology.orchestra.run.smithi045.stdout: -2415> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000028f [2,head] /dc-dir/dc-file_154 auth v2826 s=3 n(v0 rc2023-10-03T19:16:03.011929+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d26f700] 2023-10-03T19:21:04.707 INFO:teuthology.orchestra.run.smithi045.stdout: -2414> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000028f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.707 INFO:teuthology.orchestra.run.smithi045.stdout: -2413> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000290 [2,head] /dc-dir/dc-file_155 auth v2828 s=3 n(v0 rc2023-10-03T19:16:03.022833+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d27e000] 2023-10-03T19:21:04.707 INFO:teuthology.orchestra.run.smithi045.stdout: -2412> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000290) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.707 INFO:teuthology.orchestra.run.smithi045.stdout: -2411> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000291 [2,head] /dc-dir/dc-file_156 auth v2830 s=3 n(v0 rc2023-10-03T19:16:03.034833+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d27e580] 2023-10-03T19:21:04.707 INFO:teuthology.orchestra.run.smithi045.stdout: -2410> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000291) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.707 INFO:teuthology.orchestra.run.smithi045.stdout: -2409> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000292 [2,head] /dc-dir/dc-file_157 auth v2832 s=3 n(v0 rc2023-10-03T19:16:03.045883+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d27eb00] 2023-10-03T19:21:04.708 INFO:teuthology.orchestra.run.smithi045.stdout: -2408> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000292) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.708 INFO:teuthology.orchestra.run.smithi045.stdout: -2407> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000293 [2,head] /dc-dir/dc-file_158 auth v2834 s=3 n(v0 rc2023-10-03T19:16:03.056538+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d27f080] 2023-10-03T19:21:04.708 INFO:teuthology.orchestra.run.smithi045.stdout: -2406> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000293) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.708 INFO:teuthology.orchestra.run.smithi045.stdout: -2405> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000294 [2,head] /dc-dir/dc-file_159 auth v2836 s=3 n(v0 rc2023-10-03T19:16:03.067154+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d27f600] 2023-10-03T19:21:04.708 INFO:teuthology.orchestra.run.smithi045.stdout: -2404> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000294) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.708 INFO:teuthology.orchestra.run.smithi045.stdout: -2403> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000295 [2,head] /dc-dir/dc-file_160 auth v2838 s=3 n(v0 rc2023-10-03T19:16:03.077328+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d27fb80] 2023-10-03T19:21:04.708 INFO:teuthology.orchestra.run.smithi045.stdout: -2402> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000295) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.708 INFO:teuthology.orchestra.run.smithi045.stdout: -2401> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000296 [2,head] /dc-dir/dc-file_161 auth v2840 s=3 n(v0 rc2023-10-03T19:16:03.087698+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d280100] 2023-10-03T19:21:04.708 INFO:teuthology.orchestra.run.smithi045.stdout: -2400> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000296) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.708 INFO:teuthology.orchestra.run.smithi045.stdout: -2399> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000297 [2,head] /dc-dir/dc-file_162 auth v2842 s=3 n(v0 rc2023-10-03T19:16:03.099022+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d280680] 2023-10-03T19:21:04.708 INFO:teuthology.orchestra.run.smithi045.stdout: -2398> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000297) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.802 INFO:teuthology.orchestra.run.smithi045.stdout: -2397> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000298 [2,head] /dc-dir/dc-file_163 auth v2844 s=3 n(v0 rc2023-10-03T19:16:03.109351+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d280c00] 2023-10-03T19:21:04.802 INFO:teuthology.orchestra.run.smithi045.stdout: -2396> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000298) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.802 INFO:teuthology.orchestra.run.smithi045.stdout: -2395> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000299 [2,head] /dc-dir/dc-file_164 auth v2846 s=3 n(v0 rc2023-10-03T19:16:03.119633+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d281180] 2023-10-03T19:21:04.802 INFO:teuthology.orchestra.run.smithi045.stdout: -2394> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000299) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.802 INFO:teuthology.orchestra.run.smithi045.stdout: -2393> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000029a [2,head] /dc-dir/dc-file_165 auth v2848 s=3 n(v0 rc2023-10-03T19:16:03.130370+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d281700] 2023-10-03T19:21:04.802 INFO:teuthology.orchestra.run.smithi045.stdout: -2392> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000029a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.802 INFO:teuthology.orchestra.run.smithi045.stdout: -2391> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000029b [2,head] /dc-dir/dc-file_166 auth v2850 s=3 n(v0 rc2023-10-03T19:16:03.140883+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d28a000] 2023-10-03T19:21:04.802 INFO:teuthology.orchestra.run.smithi045.stdout: -2390> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000029b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.802 INFO:teuthology.orchestra.run.smithi045.stdout: -2389> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000029c [2,head] /dc-dir/dc-file_167 auth v2852 s=3 n(v0 rc2023-10-03T19:16:03.152544+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d28a580] 2023-10-03T19:21:04.803 INFO:teuthology.orchestra.run.smithi045.stdout: -2388> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000029c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.803 INFO:teuthology.orchestra.run.smithi045.stdout: -2387> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000029d [2,head] /dc-dir/dc-file_168 auth v2854 s=3 n(v0 rc2023-10-03T19:16:03.163479+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d28ab00] 2023-10-03T19:21:04.803 INFO:teuthology.orchestra.run.smithi045.stdout: -2386> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000029d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.803 INFO:teuthology.orchestra.run.smithi045.stdout: -2385> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000029e [2,head] /dc-dir/dc-file_169 auth v2856 s=3 n(v0 rc2023-10-03T19:16:03.174279+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d28b080] 2023-10-03T19:21:04.803 INFO:teuthology.orchestra.run.smithi045.stdout: -2384> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000029e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.803 INFO:teuthology.orchestra.run.smithi045.stdout: -2383> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000029f [2,head] /dc-dir/dc-file_170 auth v2858 s=3 n(v0 rc2023-10-03T19:16:03.184888+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d28b600] 2023-10-03T19:21:04.803 INFO:teuthology.orchestra.run.smithi045.stdout: -2382> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000029f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.803 INFO:teuthology.orchestra.run.smithi045.stdout: -2381> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002a0 [2,head] /dc-dir/dc-file_171 auth v2860 s=3 n(v0 rc2023-10-03T19:16:03.195646+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d28bb80] 2023-10-03T19:21:04.803 INFO:teuthology.orchestra.run.smithi045.stdout: -2380> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002a0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.803 INFO:teuthology.orchestra.run.smithi045.stdout: -2379> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002a1 [2,head] /dc-dir/dc-file_172 auth v2862 s=3 n(v0 rc2023-10-03T19:16:03.206654+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d28c100] 2023-10-03T19:21:04.804 INFO:teuthology.orchestra.run.smithi045.stdout: -2378> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002a1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.804 INFO:teuthology.orchestra.run.smithi045.stdout: -2377> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002a2 [2,head] /dc-dir/dc-file_173 auth v2864 s=3 n(v0 rc2023-10-03T19:16:03.217488+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d28c680] 2023-10-03T19:21:04.804 INFO:teuthology.orchestra.run.smithi045.stdout: -2376> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002a2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.804 INFO:teuthology.orchestra.run.smithi045.stdout: -2375> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002a3 [2,head] /dc-dir/dc-file_174 auth v2866 s=3 n(v0 rc2023-10-03T19:16:03.228645+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d28cc00] 2023-10-03T19:21:04.804 INFO:teuthology.orchestra.run.smithi045.stdout: -2374> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002a3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.804 INFO:teuthology.orchestra.run.smithi045.stdout: -2373> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002a4 [2,head] /dc-dir/dc-file_175 auth v2868 s=3 n(v0 rc2023-10-03T19:16:03.239372+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d28d180] 2023-10-03T19:21:04.804 INFO:teuthology.orchestra.run.smithi045.stdout: -2372> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002a4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.804 INFO:teuthology.orchestra.run.smithi045.stdout: -2371> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002a5 [2,head] /dc-dir/dc-file_176 auth v2870 s=3 n(v0 rc2023-10-03T19:16:03.250002+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d28d700] 2023-10-03T19:21:04.804 INFO:teuthology.orchestra.run.smithi045.stdout: -2370> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002a5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.804 INFO:teuthology.orchestra.run.smithi045.stdout: -2369> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002a6 [2,head] /dc-dir/dc-file_177 auth v2872 s=3 n(v0 rc2023-10-03T19:16:03.260790+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d29a000] 2023-10-03T19:21:04.804 INFO:teuthology.orchestra.run.smithi045.stdout: -2368> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002a6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.805 INFO:teuthology.orchestra.run.smithi045.stdout: -2367> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002a7 [2,head] /dc-dir/dc-file_178 auth v2874 s=3 n(v0 rc2023-10-03T19:16:03.271320+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d29a580] 2023-10-03T19:21:04.805 INFO:teuthology.orchestra.run.smithi045.stdout: -2366> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002a7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.805 INFO:teuthology.orchestra.run.smithi045.stdout: -2365> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002a8 [2,head] /dc-dir/dc-file_179 auth v2876 s=3 n(v0 rc2023-10-03T19:16:03.281855+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d29ab00] 2023-10-03T19:21:04.805 INFO:teuthology.orchestra.run.smithi045.stdout: -2364> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002a8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.805 INFO:teuthology.orchestra.run.smithi045.stdout: -2363> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002a9 [2,head] /dc-dir/dc-file_180 auth v2878 s=3 n(v0 rc2023-10-03T19:16:03.292683+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d29b080] 2023-10-03T19:21:04.805 INFO:teuthology.orchestra.run.smithi045.stdout: -2362> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002a9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.805 INFO:teuthology.orchestra.run.smithi045.stdout: -2361> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002aa [2,head] /dc-dir/dc-file_181 auth v2880 s=3 n(v0 rc2023-10-03T19:16:03.303560+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d29b600] 2023-10-03T19:21:04.805 INFO:teuthology.orchestra.run.smithi045.stdout: -2360> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002aa) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.805 INFO:teuthology.orchestra.run.smithi045.stdout: -2359> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ab [2,head] /dc-dir/dc-file_182 auth v2882 s=3 n(v0 rc2023-10-03T19:16:03.314724+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d29bb80] 2023-10-03T19:21:04.805 INFO:teuthology.orchestra.run.smithi045.stdout: -2358> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002ab) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.805 INFO:teuthology.orchestra.run.smithi045.stdout: -2357> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ac [2,head] /dc-dir/dc-file_183 auth v2884 s=3 n(v0 rc2023-10-03T19:16:03.324895+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d29c100] 2023-10-03T19:21:04.805 INFO:teuthology.orchestra.run.smithi045.stdout: -2356> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002ac) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.806 INFO:teuthology.orchestra.run.smithi045.stdout: -2355> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ad [2,head] /dc-dir/dc-file_184 auth v2886 s=3 n(v0 rc2023-10-03T19:16:03.335342+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d29c680] 2023-10-03T19:21:04.806 INFO:teuthology.orchestra.run.smithi045.stdout: -2354> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002ad) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.806 INFO:teuthology.orchestra.run.smithi045.stdout: -2353> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ae [2,head] /dc-dir/dc-file_185 auth v2888 s=3 n(v0 rc2023-10-03T19:16:03.346012+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d29cc00] 2023-10-03T19:21:04.806 INFO:teuthology.orchestra.run.smithi045.stdout: -2352> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002ae) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.806 INFO:teuthology.orchestra.run.smithi045.stdout: -2351> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002af [2,head] /dc-dir/dc-file_186 auth v2890 s=3 n(v0 rc2023-10-03T19:16:03.357874+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d29d180] 2023-10-03T19:21:04.806 INFO:teuthology.orchestra.run.smithi045.stdout: -2350> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002af) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.806 INFO:teuthology.orchestra.run.smithi045.stdout: -2349> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002b0 [2,head] /dc-dir/dc-file_187 auth v2892 s=3 n(v0 rc2023-10-03T19:16:03.369947+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d29d700] 2023-10-03T19:21:04.806 INFO:teuthology.orchestra.run.smithi045.stdout: -2348> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002b0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.806 INFO:teuthology.orchestra.run.smithi045.stdout: -2347> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002b1 [2,head] /dc-dir/dc-file_188 auth v2894 s=3 n(v0 rc2023-10-03T19:16:03.381857+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d270000] 2023-10-03T19:21:04.806 INFO:teuthology.orchestra.run.smithi045.stdout: -2346> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002b1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.806 INFO:teuthology.orchestra.run.smithi045.stdout: -2345> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002b2 [2,head] /dc-dir/dc-file_189 auth v2896 s=3 n(v0 rc2023-10-03T19:16:03.393897+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d270580] 2023-10-03T19:21:04.807 INFO:teuthology.orchestra.run.smithi045.stdout: -2344> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002b2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.807 INFO:teuthology.orchestra.run.smithi045.stdout: -2343> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002b3 [2,head] /dc-dir/dc-file_190 auth v2898 s=3 n(v0 rc2023-10-03T19:16:03.404940+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d270b00] 2023-10-03T19:21:04.807 INFO:teuthology.orchestra.run.smithi045.stdout: -2342> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002b3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.807 INFO:teuthology.orchestra.run.smithi045.stdout: -2341> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002b4 [2,head] /dc-dir/dc-file_191 auth v2900 s=3 n(v0 rc2023-10-03T19:16:03.414534+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d271080] 2023-10-03T19:21:04.807 INFO:teuthology.orchestra.run.smithi045.stdout: -2340> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002b4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.807 INFO:teuthology.orchestra.run.smithi045.stdout: -2339> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002b5 [2,head] /dc-dir/dc-file_192 auth v2902 s=3 n(v0 rc2023-10-03T19:16:03.425745+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d271600] 2023-10-03T19:21:04.807 INFO:teuthology.orchestra.run.smithi045.stdout: -2338> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002b5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.807 INFO:teuthology.orchestra.run.smithi045.stdout: -2337> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002b6 [2,head] /dc-dir/dc-file_193 auth v2904 s=3 n(v0 rc2023-10-03T19:16:03.437116+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d271b80] 2023-10-03T19:21:04.807 INFO:teuthology.orchestra.run.smithi045.stdout: -2336> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002b6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.807 INFO:teuthology.orchestra.run.smithi045.stdout: -2335> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002b7 [2,head] /dc-dir/dc-file_194 auth v2906 s=3 n(v0 rc2023-10-03T19:16:03.448451+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d272100] 2023-10-03T19:21:04.807 INFO:teuthology.orchestra.run.smithi045.stdout: -2334> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002b7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.817 INFO:teuthology.orchestra.run.smithi045.stdout: -2333> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002b8 [2,head] /dc-dir/dc-file_195 auth v3194 s=3 n(v0 rc2023-10-03T19:16:03.460157+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d272680] 2023-10-03T19:21:04.817 INFO:teuthology.orchestra.run.smithi045.stdout: -2332> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002b8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.817 INFO:teuthology.orchestra.run.smithi045.stdout: -2331> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002b9 [2,head] /dc-dir/dc-file_196 auth v3196 s=3 n(v0 rc2023-10-03T19:16:03.472067+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d272c00] 2023-10-03T19:21:04.817 INFO:teuthology.orchestra.run.smithi045.stdout: -2330> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002b9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.817 INFO:teuthology.orchestra.run.smithi045.stdout: -2329> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ba [2,head] /dc-dir/dc-file_197 auth v3198 s=3 n(v0 rc2023-10-03T19:16:03.484137+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d273180] 2023-10-03T19:21:04.817 INFO:teuthology.orchestra.run.smithi045.stdout: -2328> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002ba) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.818 INFO:teuthology.orchestra.run.smithi045.stdout: -2327> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002bb [2,head] /dc-dir/dc-file_198 auth v3200 s=3 n(v0 rc2023-10-03T19:16:03.495468+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d273700] 2023-10-03T19:21:04.818 INFO:teuthology.orchestra.run.smithi045.stdout: -2326> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002bb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.818 INFO:teuthology.orchestra.run.smithi045.stdout: -2325> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002bc [2,head] /dc-dir/dc-file_199 auth v3202 s=3 n(v0 rc2023-10-03T19:16:03.506974+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2ae000] 2023-10-03T19:21:04.818 INFO:teuthology.orchestra.run.smithi045.stdout: -2324> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002bc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.818 INFO:teuthology.orchestra.run.smithi045.stdout: -2323> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002bd [2,head] /dc-dir/dc-file_200 auth v3204 s=3 n(v0 rc2023-10-03T19:16:03.517254+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2ae580] 2023-10-03T19:21:04.818 INFO:teuthology.orchestra.run.smithi045.stdout: -2322> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002bd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.818 INFO:teuthology.orchestra.run.smithi045.stdout: -2321> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002be [2,head] /dc-dir/dc-file_201 auth v3206 s=3 n(v0 rc2023-10-03T19:16:03.527476+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2aeb00] 2023-10-03T19:21:04.818 INFO:teuthology.orchestra.run.smithi045.stdout: -2320> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002be) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.818 INFO:teuthology.orchestra.run.smithi045.stdout: -2319> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002bf [2,head] /dc-dir/dc-file_202 auth v3208 s=3 n(v0 rc2023-10-03T19:16:03.538618+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2af080] 2023-10-03T19:21:04.818 INFO:teuthology.orchestra.run.smithi045.stdout: -2318> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002bf) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.819 INFO:teuthology.orchestra.run.smithi045.stdout: -2317> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002c0 [2,head] /dc-dir/dc-file_203 auth v3210 s=3 n(v0 rc2023-10-03T19:16:03.548724+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2af600] 2023-10-03T19:21:04.819 INFO:teuthology.orchestra.run.smithi045.stdout: -2316> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002c0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.819 INFO:teuthology.orchestra.run.smithi045.stdout: -2315> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002c1 [2,head] /dc-dir/dc-file_204 auth v3212 s=3 n(v0 rc2023-10-03T19:16:03.559161+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2afb80] 2023-10-03T19:21:04.819 INFO:teuthology.orchestra.run.smithi045.stdout: -2314> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002c1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.819 INFO:teuthology.orchestra.run.smithi045.stdout: -2313> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002c2 [2,head] /dc-dir/dc-file_205 auth v3214 s=3 n(v0 rc2023-10-03T19:16:03.569699+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2b0100] 2023-10-03T19:21:04.819 INFO:teuthology.orchestra.run.smithi045.stdout: -2312> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002c2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.819 INFO:teuthology.orchestra.run.smithi045.stdout: -2311> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002c3 [2,head] /dc-dir/dc-file_206 auth v3216 s=3 n(v0 rc2023-10-03T19:16:03.580739+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2b0680] 2023-10-03T19:21:04.819 INFO:teuthology.orchestra.run.smithi045.stdout: -2310> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002c3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.819 INFO:teuthology.orchestra.run.smithi045.stdout: -2309> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002c4 [2,head] /dc-dir/dc-file_207 auth v3218 s=3 n(v0 rc2023-10-03T19:16:03.590733+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2b0c00] 2023-10-03T19:21:04.819 INFO:teuthology.orchestra.run.smithi045.stdout: -2308> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002c4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.819 INFO:teuthology.orchestra.run.smithi045.stdout: -2307> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002c5 [2,head] /dc-dir/dc-file_208 auth v3220 s=3 n(v0 rc2023-10-03T19:16:03.601756+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2b1180] 2023-10-03T19:21:04.819 INFO:teuthology.orchestra.run.smithi045.stdout: -2306> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002c5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.820 INFO:teuthology.orchestra.run.smithi045.stdout: -2305> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002c6 [2,head] /dc-dir/dc-file_209 auth v3222 s=3 n(v0 rc2023-10-03T19:16:03.612144+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2b1700] 2023-10-03T19:21:04.820 INFO:teuthology.orchestra.run.smithi045.stdout: -2304> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002c6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.820 INFO:teuthology.orchestra.run.smithi045.stdout: -2303> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002c7 [2,head] /dc-dir/dc-file_210 auth v3224 s=3 n(v0 rc2023-10-03T19:16:03.622419+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2bc000] 2023-10-03T19:21:04.820 INFO:teuthology.orchestra.run.smithi045.stdout: -2302> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002c7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.820 INFO:teuthology.orchestra.run.smithi045.stdout: -2301> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002c8 [2,head] /dc-dir/dc-file_211 auth v3226 s=3 n(v0 rc2023-10-03T19:16:03.633262+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2bc580] 2023-10-03T19:21:04.820 INFO:teuthology.orchestra.run.smithi045.stdout: -2300> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002c8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.820 INFO:teuthology.orchestra.run.smithi045.stdout: -2299> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002c9 [2,head] /dc-dir/dc-file_212 auth v3228 s=3 n(v0 rc2023-10-03T19:16:03.644230+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2bcb00] 2023-10-03T19:21:04.820 INFO:teuthology.orchestra.run.smithi045.stdout: -2298> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002c9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.820 INFO:teuthology.orchestra.run.smithi045.stdout: -2297> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ca [2,head] /dc-dir/dc-file_213 auth v3230 s=3 n(v0 rc2023-10-03T19:16:03.653560+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2bd080] 2023-10-03T19:21:04.820 INFO:teuthology.orchestra.run.smithi045.stdout: -2296> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002ca) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.820 INFO:teuthology.orchestra.run.smithi045.stdout: -2295> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002cb [2,head] /dc-dir/dc-file_214 auth v3232 s=3 n(v0 rc2023-10-03T19:16:03.662908+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2bd600] 2023-10-03T19:21:04.821 INFO:teuthology.orchestra.run.smithi045.stdout: -2294> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002cb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.821 INFO:teuthology.orchestra.run.smithi045.stdout: -2293> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002cc [2,head] /dc-dir/dc-file_215 auth v3234 s=3 n(v0 rc2023-10-03T19:16:03.674231+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2bdb80] 2023-10-03T19:21:04.821 INFO:teuthology.orchestra.run.smithi045.stdout: -2292> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002cc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.821 INFO:teuthology.orchestra.run.smithi045.stdout: -2291> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002cd [2,head] /dc-dir/dc-file_216 auth v3236 s=3 n(v0 rc2023-10-03T19:16:03.684827+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2be100] 2023-10-03T19:21:04.821 INFO:teuthology.orchestra.run.smithi045.stdout: -2290> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002cd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.821 INFO:teuthology.orchestra.run.smithi045.stdout: -2289> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ce [2,head] /dc-dir/dc-file_217 auth v3238 s=3 n(v0 rc2023-10-03T19:16:03.695190+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2be680] 2023-10-03T19:21:04.821 INFO:teuthology.orchestra.run.smithi045.stdout: -2288> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002ce) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.821 INFO:teuthology.orchestra.run.smithi045.stdout: -2287> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002cf [2,head] /dc-dir/dc-file_218 auth v3240 s=3 n(v0 rc2023-10-03T19:16:03.705655+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2bec00] 2023-10-03T19:21:04.821 INFO:teuthology.orchestra.run.smithi045.stdout: -2286> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002cf) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.822 INFO:teuthology.orchestra.run.smithi045.stdout: -2285> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002d0 [2,head] /dc-dir/dc-file_219 auth v3242 s=3 n(v0 rc2023-10-03T19:16:03.715888+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2bf180] 2023-10-03T19:21:04.822 INFO:teuthology.orchestra.run.smithi045.stdout: -2284> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002d0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.822 INFO:teuthology.orchestra.run.smithi045.stdout: -2283> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002d1 [2,head] /dc-dir/dc-file_220 auth v3244 s=3 n(v0 rc2023-10-03T19:16:03.726027+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2bf700] 2023-10-03T19:21:04.822 INFO:teuthology.orchestra.run.smithi045.stdout: -2282> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002d1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.822 INFO:teuthology.orchestra.run.smithi045.stdout: -2281> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002d2 [2,head] /dc-dir/dc-file_221 auth v3246 s=3 n(v0 rc2023-10-03T19:16:03.735963+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2c8000] 2023-10-03T19:21:04.822 INFO:teuthology.orchestra.run.smithi045.stdout: -2280> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002d2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.822 INFO:teuthology.orchestra.run.smithi045.stdout: -2279> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002d3 [2,head] /dc-dir/dc-file_222 auth v3248 s=3 n(v0 rc2023-10-03T19:16:03.746244+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2c8580] 2023-10-03T19:21:04.822 INFO:teuthology.orchestra.run.smithi045.stdout: -2278> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002d3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.822 INFO:teuthology.orchestra.run.smithi045.stdout: -2277> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002d4 [2,head] /dc-dir/dc-file_223 auth v3250 s=3 n(v0 rc2023-10-03T19:16:03.757223+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2c8b00] 2023-10-03T19:21:04.822 INFO:teuthology.orchestra.run.smithi045.stdout: -2276> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002d4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.822 INFO:teuthology.orchestra.run.smithi045.stdout: -2275> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002d5 [2,head] /dc-dir/dc-file_224 auth v3252 s=3 n(v0 rc2023-10-03T19:16:03.770430+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2c9080] 2023-10-03T19:21:04.823 INFO:teuthology.orchestra.run.smithi045.stdout: -2274> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002d5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.823 INFO:teuthology.orchestra.run.smithi045.stdout: -2273> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002d6 [2,head] /dc-dir/dc-file_225 auth v3254 s=3 n(v0 rc2023-10-03T19:16:03.781761+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2c9600] 2023-10-03T19:21:04.823 INFO:teuthology.orchestra.run.smithi045.stdout: -2272> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002d6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.823 INFO:teuthology.orchestra.run.smithi045.stdout: -2271> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002d7 [2,head] /dc-dir/dc-file_226 auth v3256 s=3 n(v0 rc2023-10-03T19:16:03.792135+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2c9b80] 2023-10-03T19:21:04.823 INFO:teuthology.orchestra.run.smithi045.stdout: -2270> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002d7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.823 INFO:teuthology.orchestra.run.smithi045.stdout: -2269> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002d8 [2,head] /dc-dir/dc-file_227 auth v3258 s=3 n(v0 rc2023-10-03T19:16:03.802763+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2ca100] 2023-10-03T19:21:04.823 INFO:teuthology.orchestra.run.smithi045.stdout: -2268> 2023-10-03T19:16:29.346+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002d8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.823 INFO:teuthology.orchestra.run.smithi045.stdout: -2267> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002d9 [2,head] /dc-dir/dc-file_228 auth v3260 s=3 n(v0 rc2023-10-03T19:16:03.813044+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2ca680] 2023-10-03T19:21:04.823 INFO:teuthology.orchestra.run.smithi045.stdout: -2266> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002d9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.852 INFO:teuthology.orchestra.run.smithi045.stdout: -2265> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002da [2,head] /dc-dir/dc-file_229 auth v3262 s=3 n(v0 rc2023-10-03T19:16:03.823015+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2cac00] 2023-10-03T19:21:04.852 INFO:teuthology.orchestra.run.smithi045.stdout: -2264> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002da) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.853 INFO:teuthology.orchestra.run.smithi045.stdout: -2263> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002db [2,head] /dc-dir/dc-file_230 auth v3264 s=3 n(v0 rc2023-10-03T19:16:03.832719+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2cb180] 2023-10-03T19:21:04.853 INFO:teuthology.orchestra.run.smithi045.stdout: -2262> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002db) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.853 INFO:teuthology.orchestra.run.smithi045.stdout: -2261> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002dc [2,head] /dc-dir/dc-file_231 auth v3266 s=3 n(v0 rc2023-10-03T19:16:03.843111+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d2cb700] 2023-10-03T19:21:04.853 INFO:teuthology.orchestra.run.smithi045.stdout: -2260> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002dc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.853 INFO:teuthology.orchestra.run.smithi045.stdout: -2259> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002dd [2,head] /dc-dir/dc-file_232 auth v3268 s=3 n(v0 rc2023-10-03T19:16:03.853147+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d142000] 2023-10-03T19:21:04.853 INFO:teuthology.orchestra.run.smithi045.stdout: -2258> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002dd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.853 INFO:teuthology.orchestra.run.smithi045.stdout: -2257> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002de [2,head] /dc-dir/dc-file_233 auth v3270 s=3 n(v0 rc2023-10-03T19:16:03.863144+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d142580] 2023-10-03T19:21:04.853 INFO:teuthology.orchestra.run.smithi045.stdout: -2256> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002de) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.853 INFO:teuthology.orchestra.run.smithi045.stdout: -2255> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002df [2,head] /dc-dir/dc-file_234 auth v3272 s=3 n(v0 rc2023-10-03T19:16:03.872724+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d142b00] 2023-10-03T19:21:04.853 INFO:teuthology.orchestra.run.smithi045.stdout: -2254> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002df) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.853 INFO:teuthology.orchestra.run.smithi045.stdout: -2253> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002e0 [2,head] /dc-dir/dc-file_235 auth v3274 s=3 n(v0 rc2023-10-03T19:16:03.883112+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d143080] 2023-10-03T19:21:04.853 INFO:teuthology.orchestra.run.smithi045.stdout: -2252> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002e0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.854 INFO:teuthology.orchestra.run.smithi045.stdout: -2251> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002e1 [2,head] /dc-dir/dc-file_236 auth v3276 s=3 n(v0 rc2023-10-03T19:16:03.892950+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d143600] 2023-10-03T19:21:04.854 INFO:teuthology.orchestra.run.smithi045.stdout: -2250> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002e1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.854 INFO:teuthology.orchestra.run.smithi045.stdout: -2249> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002e2 [2,head] /dc-dir/dc-file_237 auth v3278 s=3 n(v0 rc2023-10-03T19:16:03.903716+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d143b80] 2023-10-03T19:21:04.854 INFO:teuthology.orchestra.run.smithi045.stdout: -2248> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002e2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.854 INFO:teuthology.orchestra.run.smithi045.stdout: -2247> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002e3 [2,head] /dc-dir/dc-file_238 auth v3280 s=3 n(v0 rc2023-10-03T19:16:03.913805+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d144100] 2023-10-03T19:21:04.854 INFO:teuthology.orchestra.run.smithi045.stdout: -2246> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002e3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.854 INFO:teuthology.orchestra.run.smithi045.stdout: -2245> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002e4 [2,head] /dc-dir/dc-file_239 auth v3282 s=3 n(v0 rc2023-10-03T19:16:03.924502+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d144680] 2023-10-03T19:21:04.854 INFO:teuthology.orchestra.run.smithi045.stdout: -2244> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002e4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.854 INFO:teuthology.orchestra.run.smithi045.stdout: -2243> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002e5 [2,head] /dc-dir/dc-file_240 auth v3284 s=3 n(v0 rc2023-10-03T19:16:03.935138+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d144c00] 2023-10-03T19:21:04.854 INFO:teuthology.orchestra.run.smithi045.stdout: -2242> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002e5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.854 INFO:teuthology.orchestra.run.smithi045.stdout: -2241> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002e6 [2,head] /dc-dir/dc-file_241 auth v3286 s=3 n(v0 rc2023-10-03T19:16:03.945185+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d145180] 2023-10-03T19:21:04.854 INFO:teuthology.orchestra.run.smithi045.stdout: -2240> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002e6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.855 INFO:teuthology.orchestra.run.smithi045.stdout: -2239> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002e7 [2,head] /dc-dir/dc-file_242 auth v3288 s=3 n(v0 rc2023-10-03T19:16:03.955820+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d145700] 2023-10-03T19:21:04.855 INFO:teuthology.orchestra.run.smithi045.stdout: -2238> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002e7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.855 INFO:teuthology.orchestra.run.smithi045.stdout: -2237> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002e8 [2,head] /dc-dir/dc-file_243 auth v3290 s=3 n(v0 rc2023-10-03T19:16:03.965223+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d148000] 2023-10-03T19:21:04.855 INFO:teuthology.orchestra.run.smithi045.stdout: -2236> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002e8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.855 INFO:teuthology.orchestra.run.smithi045.stdout: -2235> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002e9 [2,head] /dc-dir/dc-file_244 auth v3292 s=3 n(v0 rc2023-10-03T19:16:03.975853+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d148580] 2023-10-03T19:21:04.855 INFO:teuthology.orchestra.run.smithi045.stdout: -2234> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002e9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.855 INFO:teuthology.orchestra.run.smithi045.stdout: -2233> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ea [2,head] /dc-dir/dc-file_245 auth v3294 s=3 n(v0 rc2023-10-03T19:16:03.987035+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d148b00] 2023-10-03T19:21:04.857 INFO:teuthology.orchestra.run.smithi045.stdout: -2232> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002ea) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.857 INFO:teuthology.orchestra.run.smithi045.stdout: -2231> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002eb [2,head] /dc-dir/dc-file_246 auth v3296 s=3 n(v0 rc2023-10-03T19:16:03.996686+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d149080] 2023-10-03T19:21:04.857 INFO:teuthology.orchestra.run.smithi045.stdout: -2230> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002eb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.857 INFO:teuthology.orchestra.run.smithi045.stdout: -2229> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ec [2,head] /dc-dir/dc-file_247 auth v3298 s=3 n(v0 rc2023-10-03T19:16:04.006529+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d149600] 2023-10-03T19:21:04.857 INFO:teuthology.orchestra.run.smithi045.stdout: -2228> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002ec) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.857 INFO:teuthology.orchestra.run.smithi045.stdout: -2227> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ed [2,head] /dc-dir/dc-file_248 auth v3300 s=3 n(v0 rc2023-10-03T19:16:04.016009+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d149b80] 2023-10-03T19:21:04.857 INFO:teuthology.orchestra.run.smithi045.stdout: -2226> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002ed) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.857 INFO:teuthology.orchestra.run.smithi045.stdout: -2225> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ee [2,head] /dc-dir/dc-file_249 auth v3302 s=3 n(v0 rc2023-10-03T19:16:04.027335+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d14a100] 2023-10-03T19:21:04.858 INFO:teuthology.orchestra.run.smithi045.stdout: -2224> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002ee) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.858 INFO:teuthology.orchestra.run.smithi045.stdout: -2223> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ef [2,head] /dc-dir/dc-file_250 auth v3304 s=3 n(v0 rc2023-10-03T19:16:04.038559+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d14a680] 2023-10-03T19:21:04.858 INFO:teuthology.orchestra.run.smithi045.stdout: -2222> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002ef) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.858 INFO:teuthology.orchestra.run.smithi045.stdout: -2221> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002f0 [2,head] /dc-dir/dc-file_251 auth v3306 s=3 n(v0 rc2023-10-03T19:16:04.048788+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d14ac00] 2023-10-03T19:21:04.858 INFO:teuthology.orchestra.run.smithi045.stdout: -2220> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002f0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.858 INFO:teuthology.orchestra.run.smithi045.stdout: -2219> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002f1 [2,head] /dc-dir/dc-file_252 auth v3308 s=3 n(v0 rc2023-10-03T19:16:04.059132+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d14b180] 2023-10-03T19:21:04.858 INFO:teuthology.orchestra.run.smithi045.stdout: -2218> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002f1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.858 INFO:teuthology.orchestra.run.smithi045.stdout: -2217> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002f2 [2,head] /dc-dir/dc-file_253 auth v3310 s=3 n(v0 rc2023-10-03T19:16:04.069547+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d14b700] 2023-10-03T19:21:04.858 INFO:teuthology.orchestra.run.smithi045.stdout: -2216> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002f2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.858 INFO:teuthology.orchestra.run.smithi045.stdout: -2215> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002f3 [2,head] /dc-dir/dc-file_254 auth v3312 s=3 n(v0 rc2023-10-03T19:16:04.080953+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3b2000] 2023-10-03T19:21:04.858 INFO:teuthology.orchestra.run.smithi045.stdout: -2214> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002f3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.859 INFO:teuthology.orchestra.run.smithi045.stdout: -2213> 2023-10-03T19:16:29.350+0000 7f3ed43bb640 20 update_rank0: mds.metrics 2023-10-03T19:21:04.859 INFO:teuthology.orchestra.run.smithi045.stdout: -2212> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002f4 [2,head] /dc-dir/dc-file_255 auth v3314 s=3 n(v0 rc2023-10-03T19:16:04.091712+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3b2580] 2023-10-03T19:21:04.859 INFO:teuthology.orchestra.run.smithi045.stdout: -2211> 2023-10-03T19:16:29.350+0000 7f3ed43bb640 20 update_rank0: mds.metrics: sending metric updates for 1 clients to rank 0 (address: [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866]) with sequence number 8, last updated sequence number 19 2023-10-03T19:21:04.859 INFO:teuthology.orchestra.run.smithi045.stdout: -2210> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002f4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.859 INFO:teuthology.orchestra.run.smithi045.stdout: -2209> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002f5 [2,head] /dc-dir/dc-file_256 auth v3316 s=3 n(v0 rc2023-10-03T19:16:04.103102+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3b2b00] 2023-10-03T19:21:04.859 INFO:teuthology.orchestra.run.smithi045.stdout: -2208> 2023-10-03T19:16:29.350+0000 7f3ed43bb640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] send_to--> mds [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] -- mds_metrics from rank=0 carrying 1 metric updates v1 -- ?+0 0x55576d7b3500 2023-10-03T19:21:04.859 INFO:teuthology.orchestra.run.smithi045.stdout: -2207> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002f5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.859 INFO:teuthology.orchestra.run.smithi045.stdout: -2206> 2023-10-03T19:16:29.350+0000 7f3ed43bb640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] -- mds_metrics from rank=0 carrying 1 metric updates v1 -- 0x55576d7b3500 con 0x55576c0bdc00 2023-10-03T19:21:04.859 INFO:teuthology.orchestra.run.smithi045.stdout: -2205> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002f6 [2,head] /dc-dir/dc-file_257 auth v3318 s=3 n(v0 rc2023-10-03T19:16:04.114106+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3b3080] 2023-10-03T19:21:04.859 INFO:teuthology.orchestra.run.smithi045.stdout: -2204> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002f6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.859 INFO:teuthology.orchestra.run.smithi045.stdout: -2203> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002f7 [2,head] /dc-dir/dc-file_258 auth v3320 s=3 n(v0 rc2023-10-03T19:16:04.124839+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3b3600] 2023-10-03T19:21:04.860 INFO:teuthology.orchestra.run.smithi045.stdout: -2202> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002f7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.860 INFO:teuthology.orchestra.run.smithi045.stdout: -2201> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002f8 [2,head] /dc-dir/dc-file_259 auth v3322 s=3 n(v0 rc2023-10-03T19:16:04.136705+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3b3b80] 2023-10-03T19:21:04.860 INFO:teuthology.orchestra.run.smithi045.stdout: -2200> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002f8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.860 INFO:teuthology.orchestra.run.smithi045.stdout: -2199> 2023-10-03T19:16:29.350+0000 7f3edabc8640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== mds.0 v2:172.21.15.45:6833/1319730866 0 ==== mds_metrics from rank=0 carrying 1 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x55576d7b3500 con 0x55576c0bdc00 2023-10-03T19:21:04.860 INFO:teuthology.orchestra.run.smithi045.stdout: -2198> 2023-10-03T19:16:29.350+0000 7f3edabc8640 20 mds.metric.aggregator handle_mds_metrics: applying 1 updates for rank=0 with sequence number 8 2023-10-03T19:21:04.860 INFO:teuthology.orchestra.run.smithi045.stdout: -2197> 2023-10-03T19:16:29.350+0000 7f3edabc8640 10 mds.pinger pong_received: rank=0, sequence=8 2023-10-03T19:21:04.860 INFO:teuthology.orchestra.run.smithi045.stdout: -2196> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002f9 [2,head] /dc-dir/dc-file_260 auth v3324 s=3 n(v0 rc2023-10-03T19:16:04.147590+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3b4100] 2023-10-03T19:21:04.860 INFO:teuthology.orchestra.run.smithi045.stdout: -2195> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002f9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.860 INFO:teuthology.orchestra.run.smithi045.stdout: -2194> 2023-10-03T19:16:29.350+0000 7f3edabc8640 20 mds.metric.aggregator refresh_metrics_for_rank: client=client.5697 172.21.15.146:0/3677171105, rank=0, metrics=[update_type=0, metrics={cap_hit_metric={hits=10018, misses=6}, read_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, write_latency={latency=0.121955, avg_latency=0.000121, sq_sum=27830957479192, count=1000}, metadata_latency={latency=2.670506, avg_latency=0.002651, sq_sum=35857584395686272, count=1007}, dentry_lease={hits=1001, misses=0}, opened_files_metric={opened_files=0, total_inodes=1002}, pinned_icaps_metric={pinned_icaps=1002, total_inodes=1002}, opened_inodes_metric={opened_inodes=0, total_inodes=1002}, read_io_sizes_metric={total_ops=0, total_size=0}, write_io_sizes_metric={total_ops=1000, total_size=2890}}] 2023-10-03T19:21:04.867 INFO:teuthology.orchestra.run.smithi045.stdout: -2193> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002fa [2,head] /dc-dir/dc-file_261 auth v3326 s=3 n(v0 rc2023-10-03T19:16:04.157455+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3b4680] 2023-10-03T19:21:04.867 INFO:teuthology.orchestra.run.smithi045.stdout: -2192> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002fa) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.867 INFO:teuthology.orchestra.run.smithi045.stdout: -2191> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002fb [2,head] /dc-dir/dc-file_262 auth v3328 s=3 n(v0 rc2023-10-03T19:16:04.167649+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3b4c00] 2023-10-03T19:21:04.867 INFO:teuthology.orchestra.run.smithi045.stdout: -2190> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002fb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.867 INFO:teuthology.orchestra.run.smithi045.stdout: -2189> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002fc [2,head] /dc-dir/dc-file_263 auth v3330 s=3 n(v0 rc2023-10-03T19:16:04.177664+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3b5180] 2023-10-03T19:21:04.867 INFO:teuthology.orchestra.run.smithi045.stdout: -2188> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002fc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.867 INFO:teuthology.orchestra.run.smithi045.stdout: -2187> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002fd [2,head] /dc-dir/dc-file_264 auth v3332 s=3 n(v0 rc2023-10-03T19:16:04.189991+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3b5700] 2023-10-03T19:21:04.867 INFO:teuthology.orchestra.run.smithi045.stdout: -2186> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002fd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.867 INFO:teuthology.orchestra.run.smithi045.stdout: -2185> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002fe [2,head] /dc-dir/dc-file_265 auth v3334 s=3 n(v0 rc2023-10-03T19:16:04.203270+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3ba000] 2023-10-03T19:21:04.868 INFO:teuthology.orchestra.run.smithi045.stdout: -2184> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002fe) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.868 INFO:teuthology.orchestra.run.smithi045.stdout: -2183> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ff [2,head] /dc-dir/dc-file_266 auth v3336 s=3 n(v0 rc2023-10-03T19:16:04.214355+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3ba580] 2023-10-03T19:21:04.868 INFO:teuthology.orchestra.run.smithi045.stdout: -2182> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000002ff) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.868 INFO:teuthology.orchestra.run.smithi045.stdout: -2181> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000300 [2,head] /dc-dir/dc-file_267 auth v3338 s=3 n(v0 rc2023-10-03T19:16:04.224567+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3bab00] 2023-10-03T19:21:04.868 INFO:teuthology.orchestra.run.smithi045.stdout: -2180> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000300) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.868 INFO:teuthology.orchestra.run.smithi045.stdout: -2179> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000301 [2,head] /dc-dir/dc-file_268 auth v3340 s=3 n(v0 rc2023-10-03T19:16:04.235621+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3bb080] 2023-10-03T19:21:04.868 INFO:teuthology.orchestra.run.smithi045.stdout: -2178> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000301) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.868 INFO:teuthology.orchestra.run.smithi045.stdout: -2177> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000302 [2,head] /dc-dir/dc-file_269 auth v3342 s=3 n(v0 rc2023-10-03T19:16:04.246658+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3bb600] 2023-10-03T19:21:04.868 INFO:teuthology.orchestra.run.smithi045.stdout: -2176> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000302) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.868 INFO:teuthology.orchestra.run.smithi045.stdout: -2175> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000303 [2,head] /dc-dir/dc-file_270 auth v3344 s=3 n(v0 rc2023-10-03T19:16:04.257515+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3bbb80] 2023-10-03T19:21:04.868 INFO:teuthology.orchestra.run.smithi045.stdout: -2174> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000303) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.869 INFO:teuthology.orchestra.run.smithi045.stdout: -2173> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000304 [2,head] /dc-dir/dc-file_271 auth v3346 s=3 n(v0 rc2023-10-03T19:16:04.267631+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3bc100] 2023-10-03T19:21:04.869 INFO:teuthology.orchestra.run.smithi045.stdout: -2172> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000304) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.869 INFO:teuthology.orchestra.run.smithi045.stdout: -2171> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000305 [2,head] /dc-dir/dc-file_272 auth v3348 s=3 n(v0 rc2023-10-03T19:16:04.278832+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3bc680] 2023-10-03T19:21:04.869 INFO:teuthology.orchestra.run.smithi045.stdout: -2170> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000305) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.869 INFO:teuthology.orchestra.run.smithi045.stdout: -2169> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000306 [2,head] /dc-dir/dc-file_273 auth v3350 s=3 n(v0 rc2023-10-03T19:16:04.289267+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3bcc00] 2023-10-03T19:21:04.869 INFO:teuthology.orchestra.run.smithi045.stdout: -2168> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000306) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.869 INFO:teuthology.orchestra.run.smithi045.stdout: -2167> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000307 [2,head] /dc-dir/dc-file_274 auth v3352 s=3 n(v0 rc2023-10-03T19:16:04.299368+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3bd180] 2023-10-03T19:21:04.869 INFO:teuthology.orchestra.run.smithi045.stdout: -2166> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000307) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.869 INFO:teuthology.orchestra.run.smithi045.stdout: -2165> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000308 [2,head] /dc-dir/dc-file_275 auth v3354 s=3 n(v0 rc2023-10-03T19:16:04.309412+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3bd700] 2023-10-03T19:21:04.869 INFO:teuthology.orchestra.run.smithi045.stdout: -2164> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000308) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.869 INFO:teuthology.orchestra.run.smithi045.stdout: -2163> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000309 [2,head] /dc-dir/dc-file_276 auth v3356 s=3 n(v0 rc2023-10-03T19:16:04.319614+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3c4000] 2023-10-03T19:21:04.869 INFO:teuthology.orchestra.run.smithi045.stdout: -2162> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000309) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.870 INFO:teuthology.orchestra.run.smithi045.stdout: -2161> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000030a [2,head] /dc-dir/dc-file_277 auth v3358 s=3 n(v0 rc2023-10-03T19:16:04.331662+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3c4580] 2023-10-03T19:21:04.870 INFO:teuthology.orchestra.run.smithi045.stdout: -2160> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000030a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.870 INFO:teuthology.orchestra.run.smithi045.stdout: -2159> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000030b [2,head] /dc-dir/dc-file_278 auth v3360 s=3 n(v0 rc2023-10-03T19:16:04.343984+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3c4b00] 2023-10-03T19:21:04.870 INFO:teuthology.orchestra.run.smithi045.stdout: -2158> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000030b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.870 INFO:teuthology.orchestra.run.smithi045.stdout: -2157> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000030c [2,head] /dc-dir/dc-file_279 auth v3362 s=3 n(v0 rc2023-10-03T19:16:04.357303+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3c5080] 2023-10-03T19:21:04.870 INFO:teuthology.orchestra.run.smithi045.stdout: -2156> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000030c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.870 INFO:teuthology.orchestra.run.smithi045.stdout: -2155> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000030d [2,head] /dc-dir/dc-file_280 auth v3364 s=3 n(v0 rc2023-10-03T19:16:04.369923+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3c5600] 2023-10-03T19:21:04.870 INFO:teuthology.orchestra.run.smithi045.stdout: -2154> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000030d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.870 INFO:teuthology.orchestra.run.smithi045.stdout: -2153> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000030e [2,head] /dc-dir/dc-file_281 auth v3366 s=3 n(v0 rc2023-10-03T19:16:04.382027+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3c5b80] 2023-10-03T19:21:04.870 INFO:teuthology.orchestra.run.smithi045.stdout: -2152> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000030e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.871 INFO:teuthology.orchestra.run.smithi045.stdout: -2151> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000030f [2,head] /dc-dir/dc-file_282 auth v3368 s=3 n(v0 rc2023-10-03T19:16:04.392343+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3c6100] 2023-10-03T19:21:04.871 INFO:teuthology.orchestra.run.smithi045.stdout: -2150> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000030f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.871 INFO:teuthology.orchestra.run.smithi045.stdout: -2149> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000310 [2,head] /dc-dir/dc-file_283 auth v3370 s=3 n(v0 rc2023-10-03T19:16:04.403138+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3c6680] 2023-10-03T19:21:04.871 INFO:teuthology.orchestra.run.smithi045.stdout: -2148> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000310) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.871 INFO:teuthology.orchestra.run.smithi045.stdout: -2147> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000311 [2,head] /dc-dir/dc-file_284 auth v3372 s=3 n(v0 rc2023-10-03T19:16:04.413939+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3c6c00] 2023-10-03T19:21:04.871 INFO:teuthology.orchestra.run.smithi045.stdout: -2146> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000311) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.871 INFO:teuthology.orchestra.run.smithi045.stdout: -2145> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000312 [2,head] /dc-dir/dc-file_285 auth v3374 s=3 n(v0 rc2023-10-03T19:16:04.424915+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3c7180] 2023-10-03T19:21:04.871 INFO:teuthology.orchestra.run.smithi045.stdout: -2144> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000312) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.871 INFO:teuthology.orchestra.run.smithi045.stdout: -2143> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000313 [2,head] /dc-dir/dc-file_286 auth v3376 s=3 n(v0 rc2023-10-03T19:16:04.435806+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3c7700] 2023-10-03T19:21:04.871 INFO:teuthology.orchestra.run.smithi045.stdout: -2142> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000313) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.871 INFO:teuthology.orchestra.run.smithi045.stdout: -2141> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000314 [2,head] /dc-dir/dc-file_287 auth v3378 s=3 n(v0 rc2023-10-03T19:16:04.446564+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3d8000] 2023-10-03T19:21:04.871 INFO:teuthology.orchestra.run.smithi045.stdout: -2140> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000314) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.872 INFO:teuthology.orchestra.run.smithi045.stdout: -2139> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000315 [2,head] /dc-dir/dc-file_288 auth v3380 s=3 n(v0 rc2023-10-03T19:16:04.457060+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3d8580] 2023-10-03T19:21:04.872 INFO:teuthology.orchestra.run.smithi045.stdout: -2138> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000315) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.872 INFO:teuthology.orchestra.run.smithi045.stdout: -2137> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000316 [2,head] /dc-dir/dc-file_289 auth v3684 s=3 n(v0 rc2023-10-03T19:16:04.467335+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3d8b00] 2023-10-03T19:21:04.872 INFO:teuthology.orchestra.run.smithi045.stdout: -2136> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000316) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.872 INFO:teuthology.orchestra.run.smithi045.stdout: -2135> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000317 [2,head] /dc-dir/dc-file_290 auth v3686 s=3 n(v0 rc2023-10-03T19:16:04.477203+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3d9080] 2023-10-03T19:21:04.872 INFO:teuthology.orchestra.run.smithi045.stdout: -2134> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000317) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.872 INFO:teuthology.orchestra.run.smithi045.stdout: -2133> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000318 [2,head] /dc-dir/dc-file_291 auth v3688 s=3 n(v0 rc2023-10-03T19:16:04.488592+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3d9600] 2023-10-03T19:21:04.872 INFO:teuthology.orchestra.run.smithi045.stdout: -2132> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000318) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.872 INFO:teuthology.orchestra.run.smithi045.stdout: -2131> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000319 [2,head] /dc-dir/dc-file_292 auth v3690 s=3 n(v0 rc2023-10-03T19:16:04.499241+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3d9b80] 2023-10-03T19:21:04.872 INFO:teuthology.orchestra.run.smithi045.stdout: -2130> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000319) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.957 INFO:teuthology.orchestra.run.smithi045.stdout: -2129> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000031a [2,head] /dc-dir/dc-file_293 auth v3692 s=3 n(v0 rc2023-10-03T19:16:04.509901+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3da100] 2023-10-03T19:21:04.957 INFO:teuthology.orchestra.run.smithi045.stdout: -2128> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000031a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.957 INFO:teuthology.orchestra.run.smithi045.stdout: -2127> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000031b [2,head] /dc-dir/dc-file_294 auth v3694 s=3 n(v0 rc2023-10-03T19:16:04.520661+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3da680] 2023-10-03T19:21:04.957 INFO:teuthology.orchestra.run.smithi045.stdout: -2126> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000031b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.957 INFO:teuthology.orchestra.run.smithi045.stdout: -2125> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000031c [2,head] /dc-dir/dc-file_295 auth v3696 s=3 n(v0 rc2023-10-03T19:16:04.532613+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3dac00] 2023-10-03T19:21:04.957 INFO:teuthology.orchestra.run.smithi045.stdout: -2124> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000031c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.957 INFO:teuthology.orchestra.run.smithi045.stdout: -2123> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000031d [2,head] /dc-dir/dc-file_296 auth v3698 s=3 n(v0 rc2023-10-03T19:16:04.544296+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3db180] 2023-10-03T19:21:04.957 INFO:teuthology.orchestra.run.smithi045.stdout: -2122> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000031d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.958 INFO:teuthology.orchestra.run.smithi045.stdout: -2121> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000031e [2,head] /dc-dir/dc-file_297 auth v3700 s=3 n(v0 rc2023-10-03T19:16:04.555700+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3db700] 2023-10-03T19:21:04.958 INFO:teuthology.orchestra.run.smithi045.stdout: -2120> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000031e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.958 INFO:teuthology.orchestra.run.smithi045.stdout: -2119> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000031f [2,head] /dc-dir/dc-file_298 auth v3702 s=3 n(v0 rc2023-10-03T19:16:04.566579+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3e0000] 2023-10-03T19:21:04.958 INFO:teuthology.orchestra.run.smithi045.stdout: -2118> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000031f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.958 INFO:teuthology.orchestra.run.smithi045.stdout: -2117> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000320 [2,head] /dc-dir/dc-file_299 auth v3704 s=3 n(v0 rc2023-10-03T19:16:04.577571+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3e0580] 2023-10-03T19:21:04.958 INFO:teuthology.orchestra.run.smithi045.stdout: -2116> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000320) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.958 INFO:teuthology.orchestra.run.smithi045.stdout: -2115> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000321 [2,head] /dc-dir/dc-file_300 auth v3706 s=3 n(v0 rc2023-10-03T19:16:04.589899+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3e0b00] 2023-10-03T19:21:04.958 INFO:teuthology.orchestra.run.smithi045.stdout: -2114> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000321) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.958 INFO:teuthology.orchestra.run.smithi045.stdout: -2113> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000322 [2,head] /dc-dir/dc-file_301 auth v3708 s=3 n(v0 rc2023-10-03T19:16:04.603170+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3e1080] 2023-10-03T19:21:04.958 INFO:teuthology.orchestra.run.smithi045.stdout: -2112> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000322) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.959 INFO:teuthology.orchestra.run.smithi045.stdout: -2111> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000323 [2,head] /dc-dir/dc-file_302 auth v3710 s=3 n(v0 rc2023-10-03T19:16:04.614072+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3e1600] 2023-10-03T19:21:04.959 INFO:teuthology.orchestra.run.smithi045.stdout: -2110> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000323) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.959 INFO:teuthology.orchestra.run.smithi045.stdout: -2109> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000324 [2,head] /dc-dir/dc-file_303 auth v3712 s=3 n(v0 rc2023-10-03T19:16:04.624479+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3e1b80] 2023-10-03T19:21:04.959 INFO:teuthology.orchestra.run.smithi045.stdout: -2108> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000324) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.959 INFO:teuthology.orchestra.run.smithi045.stdout: -2107> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000325 [2,head] /dc-dir/dc-file_304 auth v3714 s=3 n(v0 rc2023-10-03T19:16:04.636550+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3e2100] 2023-10-03T19:21:04.959 INFO:teuthology.orchestra.run.smithi045.stdout: -2106> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000325) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.959 INFO:teuthology.orchestra.run.smithi045.stdout: -2105> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000326 [2,head] /dc-dir/dc-file_305 auth v3716 s=3 n(v0 rc2023-10-03T19:16:04.648679+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3e2680] 2023-10-03T19:21:04.959 INFO:teuthology.orchestra.run.smithi045.stdout: -2104> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000326) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.959 INFO:teuthology.orchestra.run.smithi045.stdout: -2103> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000327 [2,head] /dc-dir/dc-file_306 auth v3718 s=3 n(v0 rc2023-10-03T19:16:04.660380+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3e2c00] 2023-10-03T19:21:04.959 INFO:teuthology.orchestra.run.smithi045.stdout: -2102> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000327) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.959 INFO:teuthology.orchestra.run.smithi045.stdout: -2101> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000328 [2,head] /dc-dir/dc-file_307 auth v3720 s=3 n(v0 rc2023-10-03T19:16:04.673286+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3e3180] 2023-10-03T19:21:04.960 INFO:teuthology.orchestra.run.smithi045.stdout: -2100> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000328) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.960 INFO:teuthology.orchestra.run.smithi045.stdout: -2099> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000329 [2,head] /dc-dir/dc-file_308 auth v3722 s=3 n(v0 rc2023-10-03T19:16:04.685885+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3e3700] 2023-10-03T19:21:04.960 INFO:teuthology.orchestra.run.smithi045.stdout: -2098> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000329) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.960 INFO:teuthology.orchestra.run.smithi045.stdout: -2097> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000032a [2,head] /dc-dir/dc-file_309 auth v3724 s=3 n(v0 rc2023-10-03T19:16:04.697327+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3ee000] 2023-10-03T19:21:04.960 INFO:teuthology.orchestra.run.smithi045.stdout: -2096> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000032a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.960 INFO:teuthology.orchestra.run.smithi045.stdout: -2095> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000032b [2,head] /dc-dir/dc-file_310 auth v3726 s=3 n(v0 rc2023-10-03T19:16:04.709175+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3ee580] 2023-10-03T19:21:04.960 INFO:teuthology.orchestra.run.smithi045.stdout: -2094> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000032b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.960 INFO:teuthology.orchestra.run.smithi045.stdout: -2093> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000032c [2,head] /dc-dir/dc-file_311 auth v3728 s=3 n(v0 rc2023-10-03T19:16:04.722044+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3eeb00] 2023-10-03T19:21:04.960 INFO:teuthology.orchestra.run.smithi045.stdout: -2092> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000032c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.960 INFO:teuthology.orchestra.run.smithi045.stdout: -2091> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000032d [2,head] /dc-dir/dc-file_312 auth v3730 s=3 n(v0 rc2023-10-03T19:16:04.733944+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3ef080] 2023-10-03T19:21:04.960 INFO:teuthology.orchestra.run.smithi045.stdout: -2090> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000032d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.961 INFO:teuthology.orchestra.run.smithi045.stdout: -2089> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000032e [2,head] /dc-dir/dc-file_313 auth v3732 s=3 n(v0 rc2023-10-03T19:16:04.746271+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3ef600] 2023-10-03T19:21:04.961 INFO:teuthology.orchestra.run.smithi045.stdout: -2088> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000032e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.961 INFO:teuthology.orchestra.run.smithi045.stdout: -2087> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000032f [2,head] /dc-dir/dc-file_314 auth v3734 s=3 n(v0 rc2023-10-03T19:16:04.758939+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3efb80] 2023-10-03T19:21:04.961 INFO:teuthology.orchestra.run.smithi045.stdout: -2086> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000032f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.961 INFO:teuthology.orchestra.run.smithi045.stdout: -2085> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000330 [2,head] /dc-dir/dc-file_315 auth v3736 s=3 n(v0 rc2023-10-03T19:16:04.770045+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3f0100] 2023-10-03T19:21:04.961 INFO:teuthology.orchestra.run.smithi045.stdout: -2084> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000330) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.961 INFO:teuthology.orchestra.run.smithi045.stdout: -2083> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000331 [2,head] /dc-dir/dc-file_316 auth v3738 s=3 n(v0 rc2023-10-03T19:16:04.780314+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3f0680] 2023-10-03T19:21:04.961 INFO:teuthology.orchestra.run.smithi045.stdout: -2082> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000331) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.961 INFO:teuthology.orchestra.run.smithi045.stdout: -2081> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000332 [2,head] /dc-dir/dc-file_317 auth v3740 s=3 n(v0 rc2023-10-03T19:16:04.791491+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3f0c00] 2023-10-03T19:21:04.961 INFO:teuthology.orchestra.run.smithi045.stdout: -2080> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000332) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.961 INFO:teuthology.orchestra.run.smithi045.stdout: -2079> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000333 [2,head] /dc-dir/dc-file_318 auth v3742 s=3 n(v0 rc2023-10-03T19:16:04.802746+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3f1180] 2023-10-03T19:21:04.962 INFO:teuthology.orchestra.run.smithi045.stdout: -2078> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000333) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.962 INFO:teuthology.orchestra.run.smithi045.stdout: -2077> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000334 [2,head] /dc-dir/dc-file_319 auth v3744 s=3 n(v0 rc2023-10-03T19:16:04.812861+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3f1700] 2023-10-03T19:21:04.962 INFO:teuthology.orchestra.run.smithi045.stdout: -2076> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000334) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.962 INFO:teuthology.orchestra.run.smithi045.stdout: -2075> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000335 [2,head] /dc-dir/dc-file_320 auth v3746 s=3 n(v0 rc2023-10-03T19:16:04.824558+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3fa000] 2023-10-03T19:21:04.962 INFO:teuthology.orchestra.run.smithi045.stdout: -2074> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000335) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.962 INFO:teuthology.orchestra.run.smithi045.stdout: -2073> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000336 [2,head] /dc-dir/dc-file_321 auth v3748 s=3 n(v0 rc2023-10-03T19:16:04.835706+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3fa580] 2023-10-03T19:21:04.962 INFO:teuthology.orchestra.run.smithi045.stdout: -2072> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000336) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.962 INFO:teuthology.orchestra.run.smithi045.stdout: -2071> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000337 [2,head] /dc-dir/dc-file_322 auth v3750 s=3 n(v0 rc2023-10-03T19:16:04.847460+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3fab00] 2023-10-03T19:21:04.962 INFO:teuthology.orchestra.run.smithi045.stdout: -2070> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000337) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.962 INFO:teuthology.orchestra.run.smithi045.stdout: -2069> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000338 [2,head] /dc-dir/dc-file_323 auth v3752 s=3 n(v0 rc2023-10-03T19:16:04.859098+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3fb080] 2023-10-03T19:21:04.976 INFO:teuthology.orchestra.run.smithi045.stdout: -2068> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000338) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.976 INFO:teuthology.orchestra.run.smithi045.stdout: -2067> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000339 [2,head] /dc-dir/dc-file_324 auth v3754 s=3 n(v0 rc2023-10-03T19:16:04.870374+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3fb600] 2023-10-03T19:21:04.976 INFO:teuthology.orchestra.run.smithi045.stdout: -2066> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000339) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.976 INFO:teuthology.orchestra.run.smithi045.stdout: -2065> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000033a [2,head] /dc-dir/dc-file_325 auth v3756 s=3 n(v0 rc2023-10-03T19:16:04.880948+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3fbb80] 2023-10-03T19:21:04.977 INFO:teuthology.orchestra.run.smithi045.stdout: -2064> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000033a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.977 INFO:teuthology.orchestra.run.smithi045.stdout: -2063> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000033b [2,head] /dc-dir/dc-file_326 auth v3758 s=3 n(v0 rc2023-10-03T19:16:04.891679+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3fc100] 2023-10-03T19:21:04.977 INFO:teuthology.orchestra.run.smithi045.stdout: -2062> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000033b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.977 INFO:teuthology.orchestra.run.smithi045.stdout: -2061> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000033c [2,head] /dc-dir/dc-file_327 auth v3760 s=3 n(v0 rc2023-10-03T19:16:04.903095+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3fc680] 2023-10-03T19:21:04.977 INFO:teuthology.orchestra.run.smithi045.stdout: -2060> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000033c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.977 INFO:teuthology.orchestra.run.smithi045.stdout: -2059> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000033d [2,head] /dc-dir/dc-file_328 auth v3762 s=3 n(v0 rc2023-10-03T19:16:04.914075+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3fcc00] 2023-10-03T19:21:04.977 INFO:teuthology.orchestra.run.smithi045.stdout: -2058> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000033d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.977 INFO:teuthology.orchestra.run.smithi045.stdout: -2057> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000033e [2,head] /dc-dir/dc-file_329 auth v3764 s=3 n(v0 rc2023-10-03T19:16:04.924653+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3fd180] 2023-10-03T19:21:04.977 INFO:teuthology.orchestra.run.smithi045.stdout: -2056> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000033e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.977 INFO:teuthology.orchestra.run.smithi045.stdout: -2055> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000033f [2,head] /dc-dir/dc-file_330 auth v3766 s=3 n(v0 rc2023-10-03T19:16:04.935712+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d3fd700] 2023-10-03T19:21:04.977 INFO:teuthology.orchestra.run.smithi045.stdout: -2054> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000033f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.978 INFO:teuthology.orchestra.run.smithi045.stdout: -2053> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000340 [2,head] /dc-dir/dc-file_331 auth v3768 s=3 n(v0 rc2023-10-03T19:16:04.946645+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d406000] 2023-10-03T19:21:04.978 INFO:teuthology.orchestra.run.smithi045.stdout: -2052> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000340) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.978 INFO:teuthology.orchestra.run.smithi045.stdout: -2051> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000341 [2,head] /dc-dir/dc-file_332 auth v3770 s=3 n(v0 rc2023-10-03T19:16:04.957927+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d406580] 2023-10-03T19:21:04.978 INFO:teuthology.orchestra.run.smithi045.stdout: -2050> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000341) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.978 INFO:teuthology.orchestra.run.smithi045.stdout: -2049> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000342 [2,head] /dc-dir/dc-file_333 auth v3772 s=3 n(v0 rc2023-10-03T19:16:04.969355+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d406b00] 2023-10-03T19:21:04.978 INFO:teuthology.orchestra.run.smithi045.stdout: -2048> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000342) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.978 INFO:teuthology.orchestra.run.smithi045.stdout: -2047> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000343 [2,head] /dc-dir/dc-file_334 auth v3774 s=3 n(v0 rc2023-10-03T19:16:04.979692+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d407080] 2023-10-03T19:21:04.978 INFO:teuthology.orchestra.run.smithi045.stdout: -2046> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000343) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.978 INFO:teuthology.orchestra.run.smithi045.stdout: -2045> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000344 [2,head] /dc-dir/dc-file_335 auth v3776 s=3 n(v0 rc2023-10-03T19:16:04.991657+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d407600] 2023-10-03T19:21:04.978 INFO:teuthology.orchestra.run.smithi045.stdout: -2044> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000344) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.978 INFO:teuthology.orchestra.run.smithi045.stdout: -2043> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000345 [2,head] /dc-dir/dc-file_336 auth v3778 s=3 n(v0 rc2023-10-03T19:16:05.001891+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d407b80] 2023-10-03T19:21:04.979 INFO:teuthology.orchestra.run.smithi045.stdout: -2042> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000345) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.979 INFO:teuthology.orchestra.run.smithi045.stdout: -2041> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000346 [2,head] /dc-dir/dc-file_337 auth v3780 s=3 n(v0 rc2023-10-03T19:16:05.012124+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d408100] 2023-10-03T19:21:04.979 INFO:teuthology.orchestra.run.smithi045.stdout: -2040> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000346) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.979 INFO:teuthology.orchestra.run.smithi045.stdout: -2039> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000347 [2,head] /dc-dir/dc-file_338 auth v3782 s=3 n(v0 rc2023-10-03T19:16:05.024464+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d408680] 2023-10-03T19:21:04.979 INFO:teuthology.orchestra.run.smithi045.stdout: -2038> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000347) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.979 INFO:teuthology.orchestra.run.smithi045.stdout: -2037> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000348 [2,head] /dc-dir/dc-file_339 auth v3784 s=3 n(v0 rc2023-10-03T19:16:05.036366+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d408c00] 2023-10-03T19:21:04.979 INFO:teuthology.orchestra.run.smithi045.stdout: -2036> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000348) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.979 INFO:teuthology.orchestra.run.smithi045.stdout: -2035> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000349 [2,head] /dc-dir/dc-file_340 auth v3786 s=3 n(v0 rc2023-10-03T19:16:05.047627+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d409180] 2023-10-03T19:21:04.979 INFO:teuthology.orchestra.run.smithi045.stdout: -2034> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000349) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.979 INFO:teuthology.orchestra.run.smithi045.stdout: -2033> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000034a [2,head] /dc-dir/dc-file_341 auth v3788 s=3 n(v0 rc2023-10-03T19:16:05.058596+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d409700] 2023-10-03T19:21:04.979 INFO:teuthology.orchestra.run.smithi045.stdout: -2032> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000034a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.980 INFO:teuthology.orchestra.run.smithi045.stdout: -2031> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000034b [2,head] /dc-dir/dc-file_342 auth v3790 s=3 n(v0 rc2023-10-03T19:16:05.069366+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d418000] 2023-10-03T19:21:04.980 INFO:teuthology.orchestra.run.smithi045.stdout: -2030> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000034b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.980 INFO:teuthology.orchestra.run.smithi045.stdout: -2029> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000034c [2,head] /dc-dir/dc-file_343 auth v3792 s=3 n(v0 rc2023-10-03T19:16:05.081590+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d418580] 2023-10-03T19:21:04.980 INFO:teuthology.orchestra.run.smithi045.stdout: -2028> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000034c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.980 INFO:teuthology.orchestra.run.smithi045.stdout: -2027> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000034d [2,head] /dc-dir/dc-file_344 auth v3794 s=3 n(v0 rc2023-10-03T19:16:05.093107+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d418b00] 2023-10-03T19:21:04.980 INFO:teuthology.orchestra.run.smithi045.stdout: -2026> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000034d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.980 INFO:teuthology.orchestra.run.smithi045.stdout: -2025> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000034e [2,head] /dc-dir/dc-file_345 auth v3796 s=3 n(v0 rc2023-10-03T19:16:05.103712+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d419080] 2023-10-03T19:21:04.980 INFO:teuthology.orchestra.run.smithi045.stdout: -2024> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000034e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.980 INFO:teuthology.orchestra.run.smithi045.stdout: -2023> 2023-10-03T19:16:29.350+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 144 ==== osd_op_reply(2130 1000000003e.00000000 [delete] v50'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:04.980 INFO:teuthology.orchestra.run.smithi045.stdout: -2022> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000034f [2,head] /dc-dir/dc-file_346 auth v3798 s=3 n(v0 rc2023-10-03T19:16:05.115796+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d419600] 2023-10-03T19:21:04.980 INFO:teuthology.orchestra.run.smithi045.stdout: -2021> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000034f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.981 INFO:teuthology.orchestra.run.smithi045.stdout: -2020> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000350 [2,head] /dc-dir/dc-file_347 auth v3800 s=3 n(v0 rc2023-10-03T19:16:05.126316+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d419b80] 2023-10-03T19:21:04.981 INFO:teuthology.orchestra.run.smithi045.stdout: -2019> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000350) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.981 INFO:teuthology.orchestra.run.smithi045.stdout: -2018> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000351 [2,head] /dc-dir/dc-file_348 auth v3802 s=3 n(v0 rc2023-10-03T19:16:05.137080+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d41a100] 2023-10-03T19:21:04.981 INFO:teuthology.orchestra.run.smithi045.stdout: -2017> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000351) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.981 INFO:teuthology.orchestra.run.smithi045.stdout: -2016> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000352 [2,head] /dc-dir/dc-file_349 auth v3804 s=3 n(v0 rc2023-10-03T19:16:05.148660+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d41a680] 2023-10-03T19:21:04.981 INFO:teuthology.orchestra.run.smithi045.stdout: -2015> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000352) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.981 INFO:teuthology.orchestra.run.smithi045.stdout: -2014> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000353 [2,head] /dc-dir/dc-file_350 auth v3806 s=3 n(v0 rc2023-10-03T19:16:05.159906+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d41ac00] 2023-10-03T19:21:04.981 INFO:teuthology.orchestra.run.smithi045.stdout: -2013> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000353) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.981 INFO:teuthology.orchestra.run.smithi045.stdout: -2012> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000354 [2,head] /dc-dir/dc-file_351 auth v3808 s=3 n(v0 rc2023-10-03T19:16:05.170701+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d41b180] 2023-10-03T19:21:04.981 INFO:teuthology.orchestra.run.smithi045.stdout: -2011> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000354) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.981 INFO:teuthology.orchestra.run.smithi045.stdout: -2010> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000355 [2,head] /dc-dir/dc-file_352 auth v3810 s=3 n(v0 rc2023-10-03T19:16:05.181728+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d41b700] 2023-10-03T19:21:04.982 INFO:teuthology.orchestra.run.smithi045.stdout: -2009> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000355) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.982 INFO:teuthology.orchestra.run.smithi045.stdout: -2008> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000356 [2,head] /dc-dir/dc-file_353 auth v3812 s=3 n(v0 rc2023-10-03T19:16:05.192734+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d426000] 2023-10-03T19:21:04.982 INFO:teuthology.orchestra.run.smithi045.stdout: -2007> 2023-10-03T19:16:29.350+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 145 ==== osd_op_reply(2072 10000000004.00000000 [delete] v50'33 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:04.982 INFO:teuthology.orchestra.run.smithi045.stdout: -2006> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000356) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.982 INFO:teuthology.orchestra.run.smithi045.stdout: -2005> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000357 [2,head] /dc-dir/dc-file_354 auth v3814 s=3 n(v0 rc2023-10-03T19:16:05.203573+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d426580] 2023-10-03T19:21:04.982 INFO:teuthology.orchestra.run.smithi045.stdout: -2004> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000357) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:04.982 INFO:teuthology.orchestra.run.smithi045.stdout: -2003> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000358 [2,head] /dc-dir/dc-file_355 auth v3816 s=3 n(v0 rc2023-10-03T19:16:05.214099+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d426b00] 2023-10-03T19:21:05.009 INFO:teuthology.orchestra.run.smithi045.stdout: -2002> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000358) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.009 INFO:teuthology.orchestra.run.smithi045.stdout: -2001> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000359 [2,head] /dc-dir/dc-file_356 auth v3818 s=3 n(v0 rc2023-10-03T19:16:05.224977+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d427080] 2023-10-03T19:21:05.009 INFO:teuthology.orchestra.run.smithi045.stdout: -2000> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000359) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.009 INFO:teuthology.orchestra.run.smithi045.stdout: -1999> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000035a [2,head] /dc-dir/dc-file_357 auth v3820 s=3 n(v0 rc2023-10-03T19:16:05.235750+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d427600] 2023-10-03T19:21:05.010 INFO:teuthology.orchestra.run.smithi045.stdout: -1998> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000035a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.010 INFO:teuthology.orchestra.run.smithi045.stdout: -1997> 2023-10-03T19:16:29.350+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 106 ==== osd_op_reply(2094 1000000001a.00000000 [delete] v50'45 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.010 INFO:teuthology.orchestra.run.smithi045.stdout: -1996> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000035b [2,head] /dc-dir/dc-file_358 auth v3822 s=3 n(v0 rc2023-10-03T19:16:05.246770+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d427b80] 2023-10-03T19:21:05.010 INFO:teuthology.orchestra.run.smithi045.stdout: -1995> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000035b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.010 INFO:teuthology.orchestra.run.smithi045.stdout: -1994> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000035c [2,head] /dc-dir/dc-file_359 auth v3824 s=3 n(v0 rc2023-10-03T19:16:05.257923+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d428100] 2023-10-03T19:21:05.010 INFO:teuthology.orchestra.run.smithi045.stdout: -1993> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000035c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.010 INFO:teuthology.orchestra.run.smithi045.stdout: -1992> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000035d [2,head] /dc-dir/dc-file_360 auth v3826 s=3 n(v0 rc2023-10-03T19:16:05.268453+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d428680] 2023-10-03T19:21:05.010 INFO:teuthology.orchestra.run.smithi045.stdout: -1991> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000035d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.010 INFO:teuthology.orchestra.run.smithi045.stdout: -1990> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000035e [2,head] /dc-dir/dc-file_361 auth v3828 s=3 n(v0 rc2023-10-03T19:16:05.279758+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d428c00] 2023-10-03T19:21:05.010 INFO:teuthology.orchestra.run.smithi045.stdout: -1989> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000035e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.010 INFO:teuthology.orchestra.run.smithi045.stdout: -1988> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000035f [2,head] /dc-dir/dc-file_362 auth v3830 s=3 n(v0 rc2023-10-03T19:16:05.290899+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d429180] 2023-10-03T19:21:05.011 INFO:teuthology.orchestra.run.smithi045.stdout: -1987> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000035f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.011 INFO:teuthology.orchestra.run.smithi045.stdout: -1986> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000360 [2,head] /dc-dir/dc-file_363 auth v3832 s=3 n(v0 rc2023-10-03T19:16:05.301899+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d429700] 2023-10-03T19:21:05.011 INFO:teuthology.orchestra.run.smithi045.stdout: -1985> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000360) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.011 INFO:teuthology.orchestra.run.smithi045.stdout: -1984> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000361 [2,head] /dc-dir/dc-file_364 auth v3834 s=3 n(v0 rc2023-10-03T19:16:05.312798+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d434000] 2023-10-03T19:21:05.011 INFO:teuthology.orchestra.run.smithi045.stdout: -1983> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000361) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.011 INFO:teuthology.orchestra.run.smithi045.stdout: -1982> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000362 [2,head] /dc-dir/dc-file_365 auth v3836 s=3 n(v0 rc2023-10-03T19:16:05.324712+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d434580] 2023-10-03T19:21:05.011 INFO:teuthology.orchestra.run.smithi045.stdout: -1981> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000362) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.011 INFO:teuthology.orchestra.run.smithi045.stdout: -1980> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000363 [2,head] /dc-dir/dc-file_366 auth v3838 s=3 n(v0 rc2023-10-03T19:16:05.336142+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d434b00] 2023-10-03T19:21:05.011 INFO:teuthology.orchestra.run.smithi045.stdout: -1979> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000363) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.011 INFO:teuthology.orchestra.run.smithi045.stdout: -1978> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000364 [2,head] /dc-dir/dc-file_367 auth v3840 s=3 n(v0 rc2023-10-03T19:16:05.347035+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d435080] 2023-10-03T19:21:05.011 INFO:teuthology.orchestra.run.smithi045.stdout: -1977> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000364) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.011 INFO:teuthology.orchestra.run.smithi045.stdout: -1976> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000365 [2,head] /dc-dir/dc-file_368 auth v3842 s=3 n(v0 rc2023-10-03T19:16:05.357503+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d435600] 2023-10-03T19:21:05.012 INFO:teuthology.orchestra.run.smithi045.stdout: -1975> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000365) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.012 INFO:teuthology.orchestra.run.smithi045.stdout: -1974> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000366 [2,head] /dc-dir/dc-file_369 auth v3844 s=3 n(v0 rc2023-10-03T19:16:05.368336+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d435b80] 2023-10-03T19:21:05.012 INFO:teuthology.orchestra.run.smithi045.stdout: -1973> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000366) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.012 INFO:teuthology.orchestra.run.smithi045.stdout: -1972> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000367 [2,head] /dc-dir/dc-file_370 auth v3846 s=3 n(v0 rc2023-10-03T19:16:05.379295+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d436100] 2023-10-03T19:21:05.012 INFO:teuthology.orchestra.run.smithi045.stdout: -1971> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000367) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.012 INFO:teuthology.orchestra.run.smithi045.stdout: -1970> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000368 [2,head] /dc-dir/dc-file_371 auth v3848 s=3 n(v0 rc2023-10-03T19:16:05.390137+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d436680] 2023-10-03T19:21:05.012 INFO:teuthology.orchestra.run.smithi045.stdout: -1969> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000368) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.012 INFO:teuthology.orchestra.run.smithi045.stdout: -1968> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000369 [2,head] /dc-dir/dc-file_372 auth v3850 s=3 n(v0 rc2023-10-03T19:16:05.401695+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d436c00] 2023-10-03T19:21:05.012 INFO:teuthology.orchestra.run.smithi045.stdout: -1967> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000369) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.012 INFO:teuthology.orchestra.run.smithi045.stdout: -1966> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000036a [2,head] /dc-dir/dc-file_373 auth v3852 s=3 n(v0 rc2023-10-03T19:16:05.412222+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d437180] 2023-10-03T19:21:05.012 INFO:teuthology.orchestra.run.smithi045.stdout: -1965> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000036a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.013 INFO:teuthology.orchestra.run.smithi045.stdout: -1964> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000036b [2,head] /dc-dir/dc-file_374 auth v3854 s=3 n(v0 rc2023-10-03T19:16:05.422986+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d437700] 2023-10-03T19:21:05.013 INFO:teuthology.orchestra.run.smithi045.stdout: -1963> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000036b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.013 INFO:teuthology.orchestra.run.smithi045.stdout: -1962> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000036c [2,head] /dc-dir/dc-file_375 auth v3856 s=3 n(v0 rc2023-10-03T19:16:05.433720+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d43e000] 2023-10-03T19:21:05.013 INFO:teuthology.orchestra.run.smithi045.stdout: -1961> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000036c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.013 INFO:teuthology.orchestra.run.smithi045.stdout: -1960> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000036d [2,head] /dc-dir/dc-file_376 auth v3858 s=3 n(v0 rc2023-10-03T19:16:05.445182+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d43e580] 2023-10-03T19:21:05.013 INFO:teuthology.orchestra.run.smithi045.stdout: -1959> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000036d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.013 INFO:teuthology.orchestra.run.smithi045.stdout: -1958> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000036e [2,head] /dc-dir/dc-file_377 auth v3860 s=3 n(v0 rc2023-10-03T19:16:05.455671+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d43eb00] 2023-10-03T19:21:05.013 INFO:teuthology.orchestra.run.smithi045.stdout: -1957> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000036e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.013 INFO:teuthology.orchestra.run.smithi045.stdout: -1956> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000036f [2,head] /dc-dir/dc-file_378 auth v3862 s=3 n(v0 rc2023-10-03T19:16:05.466247+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d43f080] 2023-10-03T19:21:05.013 INFO:teuthology.orchestra.run.smithi045.stdout: -1955> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000036f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.014 INFO:teuthology.orchestra.run.smithi045.stdout: -1954> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000370 [2,head] /dc-dir/dc-file_379 auth v4156 s=3 n(v0 rc2023-10-03T19:16:05.477539+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d43f600] 2023-10-03T19:21:05.014 INFO:teuthology.orchestra.run.smithi045.stdout: -1953> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000370) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.014 INFO:teuthology.orchestra.run.smithi045.stdout: -1952> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000371 [2,head] /dc-dir/dc-file_380 auth v4158 s=3 n(v0 rc2023-10-03T19:16:05.488208+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d43fb80] 2023-10-03T19:21:05.014 INFO:teuthology.orchestra.run.smithi045.stdout: -1951> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000371) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.014 INFO:teuthology.orchestra.run.smithi045.stdout: -1950> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000372 [2,head] /dc-dir/dc-file_381 auth v4160 s=3 n(v0 rc2023-10-03T19:16:05.499710+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d440100] 2023-10-03T19:21:05.014 INFO:teuthology.orchestra.run.smithi045.stdout: -1949> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000372) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.014 INFO:teuthology.orchestra.run.smithi045.stdout: -1948> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000373 [2,head] /dc-dir/dc-file_382 auth v4162 s=3 n(v0 rc2023-10-03T19:16:05.511445+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d440680] 2023-10-03T19:21:05.014 INFO:teuthology.orchestra.run.smithi045.stdout: -1947> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000373) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.014 INFO:teuthology.orchestra.run.smithi045.stdout: -1946> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000374 [2,head] /dc-dir/dc-file_383 auth v4164 s=3 n(v0 rc2023-10-03T19:16:05.523081+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d440c00] 2023-10-03T19:21:05.014 INFO:teuthology.orchestra.run.smithi045.stdout: -1945> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000374) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.014 INFO:teuthology.orchestra.run.smithi045.stdout: -1944> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000375 [2,head] /dc-dir/dc-file_384 auth v4166 s=3 n(v0 rc2023-10-03T19:16:05.534172+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d441180] 2023-10-03T19:21:05.015 INFO:teuthology.orchestra.run.smithi045.stdout: -1943> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000375) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.033 INFO:teuthology.orchestra.run.smithi045.stdout: -1942> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000376 [2,head] /dc-dir/dc-file_385 auth v4168 s=3 n(v0 rc2023-10-03T19:16:05.545038+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d441700] 2023-10-03T19:21:05.033 INFO:teuthology.orchestra.run.smithi045.stdout: -1941> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000376) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.033 INFO:teuthology.orchestra.run.smithi045.stdout: -1940> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000377 [2,head] /dc-dir/dc-file_386 auth v4170 s=3 n(v0 rc2023-10-03T19:16:05.555623+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d44a000] 2023-10-03T19:21:05.033 INFO:teuthology.orchestra.run.smithi045.stdout: -1939> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000377) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.033 INFO:teuthology.orchestra.run.smithi045.stdout: -1938> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000378 [2,head] /dc-dir/dc-file_387 auth v4172 s=3 n(v0 rc2023-10-03T19:16:05.566292+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d44a580] 2023-10-03T19:21:05.033 INFO:teuthology.orchestra.run.smithi045.stdout: -1937> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000378) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.033 INFO:teuthology.orchestra.run.smithi045.stdout: -1936> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000379 [2,head] /dc-dir/dc-file_388 auth v4174 s=3 n(v0 rc2023-10-03T19:16:05.576869+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d44ab00] 2023-10-03T19:21:05.033 INFO:teuthology.orchestra.run.smithi045.stdout: -1935> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000379) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.033 INFO:teuthology.orchestra.run.smithi045.stdout: -1934> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000037a [2,head] /dc-dir/dc-file_389 auth v4176 s=3 n(v0 rc2023-10-03T19:16:05.587136+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d44b080] 2023-10-03T19:21:05.033 INFO:teuthology.orchestra.run.smithi045.stdout: -1933> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000037a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.034 INFO:teuthology.orchestra.run.smithi045.stdout: -1932> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000037b [2,head] /dc-dir/dc-file_390 auth v4178 s=3 n(v0 rc2023-10-03T19:16:05.597962+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d44b600] 2023-10-03T19:21:05.034 INFO:teuthology.orchestra.run.smithi045.stdout: -1931> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000037b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.034 INFO:teuthology.orchestra.run.smithi045.stdout: -1930> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000037c [2,head] /dc-dir/dc-file_391 auth v4180 s=3 n(v0 rc2023-10-03T19:16:05.611294+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d44bb80] 2023-10-03T19:21:05.034 INFO:teuthology.orchestra.run.smithi045.stdout: -1929> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000037c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.034 INFO:teuthology.orchestra.run.smithi045.stdout: -1928> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000037d [2,head] /dc-dir/dc-file_392 auth v4182 s=3 n(v0 rc2023-10-03T19:16:05.622706+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d44c100] 2023-10-03T19:21:05.034 INFO:teuthology.orchestra.run.smithi045.stdout: -1927> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000037d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.034 INFO:teuthology.orchestra.run.smithi045.stdout: -1926> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000037e [2,head] /dc-dir/dc-file_393 auth v4184 s=3 n(v0 rc2023-10-03T19:16:05.633443+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d44c680] 2023-10-03T19:21:05.034 INFO:teuthology.orchestra.run.smithi045.stdout: -1925> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000037e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.034 INFO:teuthology.orchestra.run.smithi045.stdout: -1924> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000037f [2,head] /dc-dir/dc-file_394 auth v4186 s=3 n(v0 rc2023-10-03T19:16:05.644783+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d44cc00] 2023-10-03T19:21:05.034 INFO:teuthology.orchestra.run.smithi045.stdout: -1923> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000037f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.034 INFO:teuthology.orchestra.run.smithi045.stdout: -1922> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000380 [2,head] /dc-dir/dc-file_395 auth v4188 s=3 n(v0 rc2023-10-03T19:16:05.655741+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d44d180] 2023-10-03T19:21:05.035 INFO:teuthology.orchestra.run.smithi045.stdout: -1921> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000380) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.035 INFO:teuthology.orchestra.run.smithi045.stdout: -1920> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000381 [2,head] /dc-dir/dc-file_396 auth v4190 s=3 n(v0 rc2023-10-03T19:16:05.666146+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d44d700] 2023-10-03T19:21:05.035 INFO:teuthology.orchestra.run.smithi045.stdout: -1919> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000381) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.035 INFO:teuthology.orchestra.run.smithi045.stdout: -1918> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000382 [2,head] /dc-dir/dc-file_397 auth v4192 s=3 n(v0 rc2023-10-03T19:16:05.678034+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d456000] 2023-10-03T19:21:05.035 INFO:teuthology.orchestra.run.smithi045.stdout: -1917> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000382) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.035 INFO:teuthology.orchestra.run.smithi045.stdout: -1916> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000383 [2,head] /dc-dir/dc-file_398 auth v4194 s=3 n(v0 rc2023-10-03T19:16:05.688886+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d456580] 2023-10-03T19:21:05.035 INFO:teuthology.orchestra.run.smithi045.stdout: -1915> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000383) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.035 INFO:teuthology.orchestra.run.smithi045.stdout: -1914> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000384 [2,head] /dc-dir/dc-file_399 auth v4196 s=3 n(v0 rc2023-10-03T19:16:05.699459+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d456b00] 2023-10-03T19:21:05.035 INFO:teuthology.orchestra.run.smithi045.stdout: -1913> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000384) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.035 INFO:teuthology.orchestra.run.smithi045.stdout: -1912> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000385 [2,head] /dc-dir/dc-file_400 auth v4198 s=3 n(v0 rc2023-10-03T19:16:05.709731+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d457080] 2023-10-03T19:21:05.036 INFO:teuthology.orchestra.run.smithi045.stdout: -1911> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000385) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.036 INFO:teuthology.orchestra.run.smithi045.stdout: -1910> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000386 [2,head] /dc-dir/dc-file_401 auth v4200 s=3 n(v0 rc2023-10-03T19:16:05.720883+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d457600] 2023-10-03T19:21:05.036 INFO:teuthology.orchestra.run.smithi045.stdout: -1909> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000386) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.036 INFO:teuthology.orchestra.run.smithi045.stdout: -1908> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000387 [2,head] /dc-dir/dc-file_402 auth v4202 s=3 n(v0 rc2023-10-03T19:16:05.732287+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d457b80] 2023-10-03T19:21:05.036 INFO:teuthology.orchestra.run.smithi045.stdout: -1907> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000387) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.036 INFO:teuthology.orchestra.run.smithi045.stdout: -1906> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000388 [2,head] /dc-dir/dc-file_403 auth v4204 s=3 n(v0 rc2023-10-03T19:16:05.743698+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d458100] 2023-10-03T19:21:05.036 INFO:teuthology.orchestra.run.smithi045.stdout: -1905> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000388) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.036 INFO:teuthology.orchestra.run.smithi045.stdout: -1904> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000389 [2,head] /dc-dir/dc-file_404 auth v4206 s=3 n(v0 rc2023-10-03T19:16:05.754484+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d458680] 2023-10-03T19:21:05.036 INFO:teuthology.orchestra.run.smithi045.stdout: -1903> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000389) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.036 INFO:teuthology.orchestra.run.smithi045.stdout: -1902> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000038a [2,head] /dc-dir/dc-file_405 auth v4208 s=3 n(v0 rc2023-10-03T19:16:05.765659+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d458c00] 2023-10-03T19:21:05.036 INFO:teuthology.orchestra.run.smithi045.stdout: -1901> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000038a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.037 INFO:teuthology.orchestra.run.smithi045.stdout: -1900> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000038b [2,head] /dc-dir/dc-file_406 auth v4210 s=3 n(v0 rc2023-10-03T19:16:05.777247+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d459180] 2023-10-03T19:21:05.037 INFO:teuthology.orchestra.run.smithi045.stdout: -1899> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000038b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.037 INFO:teuthology.orchestra.run.smithi045.stdout: -1898> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000038c [2,head] /dc-dir/dc-file_407 auth v4212 s=3 n(v0 rc2023-10-03T19:16:05.788908+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d459700] 2023-10-03T19:21:05.037 INFO:teuthology.orchestra.run.smithi045.stdout: -1897> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000038c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.037 INFO:teuthology.orchestra.run.smithi045.stdout: -1896> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000038d [2,head] /dc-dir/dc-file_408 auth v4214 s=3 n(v0 rc2023-10-03T19:16:05.801230+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d468000] 2023-10-03T19:21:05.037 INFO:teuthology.orchestra.run.smithi045.stdout: -1895> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000038d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.037 INFO:teuthology.orchestra.run.smithi045.stdout: -1894> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000038e [2,head] /dc-dir/dc-file_409 auth v4216 s=3 n(v0 rc2023-10-03T19:16:05.812218+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d468580] 2023-10-03T19:21:05.037 INFO:teuthology.orchestra.run.smithi045.stdout: -1893> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000038e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.037 INFO:teuthology.orchestra.run.smithi045.stdout: -1892> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000038f [2,head] /dc-dir/dc-file_410 auth v4218 s=3 n(v0 rc2023-10-03T19:16:05.823288+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d468b00] 2023-10-03T19:21:05.037 INFO:teuthology.orchestra.run.smithi045.stdout: -1891> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000038f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.037 INFO:teuthology.orchestra.run.smithi045.stdout: -1890> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000390 [2,head] /dc-dir/dc-file_411 auth v4220 s=3 n(v0 rc2023-10-03T19:16:05.834018+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d469080] 2023-10-03T19:21:05.037 INFO:teuthology.orchestra.run.smithi045.stdout: -1889> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000390) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.038 INFO:teuthology.orchestra.run.smithi045.stdout: -1888> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000391 [2,head] /dc-dir/dc-file_412 auth v4222 s=3 n(v0 rc2023-10-03T19:16:05.845108+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d469600] 2023-10-03T19:21:05.038 INFO:teuthology.orchestra.run.smithi045.stdout: -1887> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000391) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.038 INFO:teuthology.orchestra.run.smithi045.stdout: -1886> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000392 [2,head] /dc-dir/dc-file_413 auth v4224 s=3 n(v0 rc2023-10-03T19:16:05.856227+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d469b80] 2023-10-03T19:21:05.038 INFO:teuthology.orchestra.run.smithi045.stdout: -1885> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000392) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.038 INFO:teuthology.orchestra.run.smithi045.stdout: -1884> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000393 [2,head] /dc-dir/dc-file_414 auth v4226 s=3 n(v0 rc2023-10-03T19:16:05.868229+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d46a100] 2023-10-03T19:21:05.038 INFO:teuthology.orchestra.run.smithi045.stdout: -1883> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000393) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.038 INFO:teuthology.orchestra.run.smithi045.stdout: -1882> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000394 [2,head] /dc-dir/dc-file_415 auth v4228 s=3 n(v0 rc2023-10-03T19:16:05.880902+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d46a680] 2023-10-03T19:21:05.038 INFO:teuthology.orchestra.run.smithi045.stdout: -1881> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000394) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.038 INFO:teuthology.orchestra.run.smithi045.stdout: -1880> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000395 [2,head] /dc-dir/dc-file_416 auth v4230 s=3 n(v0 rc2023-10-03T19:16:05.893422+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d46ac00] 2023-10-03T19:21:05.038 INFO:teuthology.orchestra.run.smithi045.stdout: -1879> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000395) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.039 INFO:teuthology.orchestra.run.smithi045.stdout: -1878> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000396 [2,head] /dc-dir/dc-file_417 auth v4232 s=3 n(v0 rc2023-10-03T19:16:05.905527+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d46b180] 2023-10-03T19:21:05.039 INFO:teuthology.orchestra.run.smithi045.stdout: -1877> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000396) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.110 INFO:teuthology.orchestra.run.smithi045.stdout: -1876> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000397 [2,head] /dc-dir/dc-file_418 auth v4234 s=3 n(v0 rc2023-10-03T19:16:05.916729+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d46b700] 2023-10-03T19:21:05.110 INFO:teuthology.orchestra.run.smithi045.stdout: -1875> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000397) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.110 INFO:teuthology.orchestra.run.smithi045.stdout: -1874> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000398 [2,head] /dc-dir/dc-file_419 auth v4236 s=3 n(v0 rc2023-10-03T19:16:05.927795+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d470000] 2023-10-03T19:21:05.110 INFO:teuthology.orchestra.run.smithi045.stdout: -1873> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000398) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.110 INFO:teuthology.orchestra.run.smithi045.stdout: -1872> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000399 [2,head] /dc-dir/dc-file_420 auth v4238 s=3 n(v0 rc2023-10-03T19:16:05.938530+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d470580] 2023-10-03T19:21:05.110 INFO:teuthology.orchestra.run.smithi045.stdout: -1871> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000399) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.110 INFO:teuthology.orchestra.run.smithi045.stdout: -1870> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000039a [2,head] /dc-dir/dc-file_421 auth v4240 s=3 n(v0 rc2023-10-03T19:16:05.949207+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d470b00] 2023-10-03T19:21:05.110 INFO:teuthology.orchestra.run.smithi045.stdout: -1869> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000039a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.111 INFO:teuthology.orchestra.run.smithi045.stdout: -1868> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000039b [2,head] /dc-dir/dc-file_422 auth v4242 s=3 n(v0 rc2023-10-03T19:16:05.959742+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d471080] 2023-10-03T19:21:05.111 INFO:teuthology.orchestra.run.smithi045.stdout: -1867> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000039b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.111 INFO:teuthology.orchestra.run.smithi045.stdout: -1866> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000039c [2,head] /dc-dir/dc-file_423 auth v4244 s=3 n(v0 rc2023-10-03T19:16:05.970822+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d471600] 2023-10-03T19:21:05.111 INFO:teuthology.orchestra.run.smithi045.stdout: -1865> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000039c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.111 INFO:teuthology.orchestra.run.smithi045.stdout: -1864> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000039d [2,head] /dc-dir/dc-file_424 auth v4246 s=3 n(v0 rc2023-10-03T19:16:05.981787+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d471b80] 2023-10-03T19:21:05.111 INFO:teuthology.orchestra.run.smithi045.stdout: -1863> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000039d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.111 INFO:teuthology.orchestra.run.smithi045.stdout: -1862> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000039e [2,head] /dc-dir/dc-file_425 auth v4248 s=3 n(v0 rc2023-10-03T19:16:05.992179+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d472100] 2023-10-03T19:21:05.111 INFO:teuthology.orchestra.run.smithi045.stdout: -1861> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000039e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.111 INFO:teuthology.orchestra.run.smithi045.stdout: -1860> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000039f [2,head] /dc-dir/dc-file_426 auth v4250 s=3 n(v0 rc2023-10-03T19:16:06.003236+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d472680] 2023-10-03T19:21:05.111 INFO:teuthology.orchestra.run.smithi045.stdout: -1859> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000039f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.111 INFO:teuthology.orchestra.run.smithi045.stdout: -1858> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003a0 [2,head] /dc-dir/dc-file_427 auth v4252 s=3 n(v0 rc2023-10-03T19:16:06.013914+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d472c00] 2023-10-03T19:21:05.112 INFO:teuthology.orchestra.run.smithi045.stdout: -1857> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003a0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.112 INFO:teuthology.orchestra.run.smithi045.stdout: -1856> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003a1 [2,head] /dc-dir/dc-file_428 auth v4254 s=3 n(v0 rc2023-10-03T19:16:06.025225+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d473180] 2023-10-03T19:21:05.112 INFO:teuthology.orchestra.run.smithi045.stdout: -1855> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003a1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.112 INFO:teuthology.orchestra.run.smithi045.stdout: -1854> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003a2 [2,head] /dc-dir/dc-file_429 auth v4256 s=3 n(v0 rc2023-10-03T19:16:06.037247+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d473700] 2023-10-03T19:21:05.112 INFO:teuthology.orchestra.run.smithi045.stdout: -1853> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003a2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.112 INFO:teuthology.orchestra.run.smithi045.stdout: -1852> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003a3 [2,head] /dc-dir/dc-file_430 auth v4258 s=3 n(v0 rc2023-10-03T19:16:06.048545+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d47c000] 2023-10-03T19:21:05.112 INFO:teuthology.orchestra.run.smithi045.stdout: -1851> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003a3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.112 INFO:teuthology.orchestra.run.smithi045.stdout: -1850> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003a4 [2,head] /dc-dir/dc-file_431 auth v4260 s=3 n(v0 rc2023-10-03T19:16:06.060366+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d47c580] 2023-10-03T19:21:05.112 INFO:teuthology.orchestra.run.smithi045.stdout: -1849> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003a4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.112 INFO:teuthology.orchestra.run.smithi045.stdout: -1848> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003a5 [2,head] /dc-dir/dc-file_432 auth v4262 s=3 n(v0 rc2023-10-03T19:16:06.071903+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d47cb00] 2023-10-03T19:21:05.112 INFO:teuthology.orchestra.run.smithi045.stdout: -1847> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003a5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.112 INFO:teuthology.orchestra.run.smithi045.stdout: -1846> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003a6 [2,head] /dc-dir/dc-file_433 auth v4264 s=3 n(v0 rc2023-10-03T19:16:06.083598+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d47d080] 2023-10-03T19:21:05.113 INFO:teuthology.orchestra.run.smithi045.stdout: -1845> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003a6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.113 INFO:teuthology.orchestra.run.smithi045.stdout: -1844> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003a7 [2,head] /dc-dir/dc-file_434 auth v4266 s=3 n(v0 rc2023-10-03T19:16:06.094867+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d47d600] 2023-10-03T19:21:05.113 INFO:teuthology.orchestra.run.smithi045.stdout: -1843> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003a7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.113 INFO:teuthology.orchestra.run.smithi045.stdout: -1842> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003a8 [2,head] /dc-dir/dc-file_435 auth v4268 s=3 n(v0 rc2023-10-03T19:16:06.106068+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d47db80] 2023-10-03T19:21:05.113 INFO:teuthology.orchestra.run.smithi045.stdout: -1841> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003a8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.113 INFO:teuthology.orchestra.run.smithi045.stdout: -1840> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003a9 [2,head] /dc-dir/dc-file_436 auth v4270 s=3 n(v0 rc2023-10-03T19:16:06.116708+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d47e100] 2023-10-03T19:21:05.113 INFO:teuthology.orchestra.run.smithi045.stdout: -1839> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003a9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.113 INFO:teuthology.orchestra.run.smithi045.stdout: -1838> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003aa [2,head] /dc-dir/dc-file_437 auth v4272 s=3 n(v0 rc2023-10-03T19:16:06.128787+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d47e680] 2023-10-03T19:21:05.113 INFO:teuthology.orchestra.run.smithi045.stdout: -1837> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003aa) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.113 INFO:teuthology.orchestra.run.smithi045.stdout: -1836> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ab [2,head] /dc-dir/dc-file_438 auth v4274 s=3 n(v0 rc2023-10-03T19:16:06.139580+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d47ec00] 2023-10-03T19:21:05.113 INFO:teuthology.orchestra.run.smithi045.stdout: -1835> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003ab) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.114 INFO:teuthology.orchestra.run.smithi045.stdout: -1834> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ac [2,head] /dc-dir/dc-file_439 auth v4276 s=3 n(v0 rc2023-10-03T19:16:06.150658+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d47f180] 2023-10-03T19:21:05.114 INFO:teuthology.orchestra.run.smithi045.stdout: -1833> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003ac) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.114 INFO:teuthology.orchestra.run.smithi045.stdout: -1832> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ad [2,head] /dc-dir/dc-file_440 auth v4278 s=3 n(v0 rc2023-10-03T19:16:06.162089+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d47f700] 2023-10-03T19:21:05.114 INFO:teuthology.orchestra.run.smithi045.stdout: -1831> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003ad) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.114 INFO:teuthology.orchestra.run.smithi045.stdout: -1830> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ae [2,head] /dc-dir/dc-file_441 auth v4280 s=3 n(v0 rc2023-10-03T19:16:06.172807+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d48a000] 2023-10-03T19:21:05.114 INFO:teuthology.orchestra.run.smithi045.stdout: -1829> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003ae) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.114 INFO:teuthology.orchestra.run.smithi045.stdout: -1828> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003af [2,head] /dc-dir/dc-file_442 auth v4282 s=3 n(v0 rc2023-10-03T19:16:06.184223+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d48a580] 2023-10-03T19:21:05.114 INFO:teuthology.orchestra.run.smithi045.stdout: -1827> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003af) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.114 INFO:teuthology.orchestra.run.smithi045.stdout: -1826> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003b0 [2,head] /dc-dir/dc-file_443 auth v4284 s=3 n(v0 rc2023-10-03T19:16:06.194713+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d48ab00] 2023-10-03T19:21:05.114 INFO:teuthology.orchestra.run.smithi045.stdout: -1825> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003b0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.115 INFO:teuthology.orchestra.run.smithi045.stdout: -1824> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003b1 [2,head] /dc-dir/dc-file_444 auth v4286 s=3 n(v0 rc2023-10-03T19:16:06.206446+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d48b080] 2023-10-03T19:21:05.115 INFO:teuthology.orchestra.run.smithi045.stdout: -1823> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003b1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.115 INFO:teuthology.orchestra.run.smithi045.stdout: -1822> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003b2 [2,head] /dc-dir/dc-file_445 auth v4288 s=3 n(v0 rc2023-10-03T19:16:06.218578+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d48b600] 2023-10-03T19:21:05.115 INFO:teuthology.orchestra.run.smithi045.stdout: -1821> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003b2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.115 INFO:teuthology.orchestra.run.smithi045.stdout: -1820> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003b3 [2,head] /dc-dir/dc-file_446 auth v4290 s=3 n(v0 rc2023-10-03T19:16:06.230687+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d48bb80] 2023-10-03T19:21:05.115 INFO:teuthology.orchestra.run.smithi045.stdout: -1819> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003b3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.115 INFO:teuthology.orchestra.run.smithi045.stdout: -1818> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003b4 [2,head] /dc-dir/dc-file_447 auth v4292 s=3 n(v0 rc2023-10-03T19:16:06.241709+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d48c100] 2023-10-03T19:21:05.115 INFO:teuthology.orchestra.run.smithi045.stdout: -1817> 2023-10-03T19:16:29.350+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003b4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.135 INFO:teuthology.orchestra.run.smithi045.stdout: -1816> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003b5 [2,head] /dc-dir/dc-file_448 auth v4294 s=3 n(v0 rc2023-10-03T19:16:06.253084+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d48c680] 2023-10-03T19:21:05.135 INFO:teuthology.orchestra.run.smithi045.stdout: -1815> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003b5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.135 INFO:teuthology.orchestra.run.smithi045.stdout: -1814> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003b6 [2,head] /dc-dir/dc-file_449 auth v4296 s=3 n(v0 rc2023-10-03T19:16:06.263843+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d48cc00] 2023-10-03T19:21:05.135 INFO:teuthology.orchestra.run.smithi045.stdout: -1813> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003b6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.135 INFO:teuthology.orchestra.run.smithi045.stdout: -1812> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003b7 [2,head] /dc-dir/dc-file_450 auth v4298 s=3 n(v0 rc2023-10-03T19:16:06.274656+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d48d180] 2023-10-03T19:21:05.135 INFO:teuthology.orchestra.run.smithi045.stdout: -1811> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003b7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.135 INFO:teuthology.orchestra.run.smithi045.stdout: -1810> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003b8 [2,head] /dc-dir/dc-file_451 auth v4300 s=3 n(v0 rc2023-10-03T19:16:06.285017+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d48d700] 2023-10-03T19:21:05.135 INFO:teuthology.orchestra.run.smithi045.stdout: -1809> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003b8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.135 INFO:teuthology.orchestra.run.smithi045.stdout: -1808> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003b9 [2,head] /dc-dir/dc-file_452 auth v4302 s=3 n(v0 rc2023-10-03T19:16:06.296744+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d498000] 2023-10-03T19:21:05.136 INFO:teuthology.orchestra.run.smithi045.stdout: -1807> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003b9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.136 INFO:teuthology.orchestra.run.smithi045.stdout: -1806> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ba [2,head] /dc-dir/dc-file_453 auth v4304 s=3 n(v0 rc2023-10-03T19:16:06.307334+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d498580] 2023-10-03T19:21:05.136 INFO:teuthology.orchestra.run.smithi045.stdout: -1805> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003ba) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.136 INFO:teuthology.orchestra.run.smithi045.stdout: -1804> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003bb [2,head] /dc-dir/dc-file_454 auth v4306 s=3 n(v0 rc2023-10-03T19:16:06.318488+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d498b00] 2023-10-03T19:21:05.136 INFO:teuthology.orchestra.run.smithi045.stdout: -1803> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003bb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.136 INFO:teuthology.orchestra.run.smithi045.stdout: -1802> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003bc [2,head] /dc-dir/dc-file_455 auth v4308 s=3 n(v0 rc2023-10-03T19:16:06.329581+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d499080] 2023-10-03T19:21:05.136 INFO:teuthology.orchestra.run.smithi045.stdout: -1801> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003bc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.136 INFO:teuthology.orchestra.run.smithi045.stdout: -1800> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003bd [2,head] /dc-dir/dc-file_456 auth v4310 s=3 n(v0 rc2023-10-03T19:16:06.340019+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d499600] 2023-10-03T19:21:05.136 INFO:teuthology.orchestra.run.smithi045.stdout: -1799> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003bd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.136 INFO:teuthology.orchestra.run.smithi045.stdout: -1798> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003be [2,head] /dc-dir/dc-file_457 auth v4312 s=3 n(v0 rc2023-10-03T19:16:06.350324+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d499b80] 2023-10-03T19:21:05.136 INFO:teuthology.orchestra.run.smithi045.stdout: -1797> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003be) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.137 INFO:teuthology.orchestra.run.smithi045.stdout: -1796> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003bf [2,head] /dc-dir/dc-file_458 auth v4314 s=3 n(v0 rc2023-10-03T19:16:06.361631+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d49a100] 2023-10-03T19:21:05.137 INFO:teuthology.orchestra.run.smithi045.stdout: -1795> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003bf) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.137 INFO:teuthology.orchestra.run.smithi045.stdout: -1794> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003c0 [2,head] /dc-dir/dc-file_459 auth v4316 s=3 n(v0 rc2023-10-03T19:16:06.374659+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d49a680] 2023-10-03T19:21:05.137 INFO:teuthology.orchestra.run.smithi045.stdout: -1793> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003c0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.137 INFO:teuthology.orchestra.run.smithi045.stdout: -1792> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003c1 [2,head] /dc-dir/dc-file_460 auth v4318 s=3 n(v0 rc2023-10-03T19:16:06.386229+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d49ac00] 2023-10-03T19:21:05.137 INFO:teuthology.orchestra.run.smithi045.stdout: -1791> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003c1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.137 INFO:teuthology.orchestra.run.smithi045.stdout: -1790> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003c2 [2,head] /dc-dir/dc-file_461 auth v4320 s=3 n(v0 rc2023-10-03T19:16:06.397276+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d49b180] 2023-10-03T19:21:05.137 INFO:teuthology.orchestra.run.smithi045.stdout: -1789> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003c2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.137 INFO:teuthology.orchestra.run.smithi045.stdout: -1788> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003c3 [2,head] /dc-dir/dc-file_462 auth v4322 s=3 n(v0 rc2023-10-03T19:16:06.408275+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d49b700] 2023-10-03T19:21:05.137 INFO:teuthology.orchestra.run.smithi045.stdout: -1787> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003c3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.137 INFO:teuthology.orchestra.run.smithi045.stdout: -1786> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003c4 [2,head] /dc-dir/dc-file_463 auth v4324 s=3 n(v0 rc2023-10-03T19:16:06.419526+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4a4000] 2023-10-03T19:21:05.137 INFO:teuthology.orchestra.run.smithi045.stdout: -1785> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003c4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1784> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003c5 [2,head] /dc-dir/dc-file_464 auth v4326 s=3 n(v0 rc2023-10-03T19:16:06.430348+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4a4580] 2023-10-03T19:21:05.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1783> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003c5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1782> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003c6 [2,head] /dc-dir/dc-file_465 auth v4328 s=3 n(v0 rc2023-10-03T19:16:06.441611+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4a4b00] 2023-10-03T19:21:05.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1781> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003c6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1780> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003c7 [2,head] /dc-dir/dc-file_466 auth v4330 s=3 n(v0 rc2023-10-03T19:16:06.455805+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4a5080] 2023-10-03T19:21:05.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1779> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003c7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1778> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003c8 [2,head] /dc-dir/dc-file_467 auth v4332 s=3 n(v0 rc2023-10-03T19:16:06.469102+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4a5600] 2023-10-03T19:21:05.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1777> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003c8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1776> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003c9 [2,head] /dc-dir/dc-file_468 auth v4334 s=3 n(v0 rc2023-10-03T19:16:06.479874+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4a5b80] 2023-10-03T19:21:05.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1775> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003c9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1774> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ca [2,head] /dc-dir/dc-file_469 auth v4646 s=3 n(v0 rc2023-10-03T19:16:06.489735+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4a6100] 2023-10-03T19:21:05.139 INFO:teuthology.orchestra.run.smithi045.stdout: -1773> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003ca) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.139 INFO:teuthology.orchestra.run.smithi045.stdout: -1772> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003cb [2,head] /dc-dir/dc-file_470 auth v4648 s=3 n(v0 rc2023-10-03T19:16:06.499057+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4a6680] 2023-10-03T19:21:05.139 INFO:teuthology.orchestra.run.smithi045.stdout: -1771> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003cb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.139 INFO:teuthology.orchestra.run.smithi045.stdout: -1770> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003cc [2,head] /dc-dir/dc-file_471 auth v4650 s=3 n(v0 rc2023-10-03T19:16:06.509073+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4a6c00] 2023-10-03T19:21:05.139 INFO:teuthology.orchestra.run.smithi045.stdout: -1769> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003cc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.139 INFO:teuthology.orchestra.run.smithi045.stdout: -1768> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003cd [2,head] /dc-dir/dc-file_472 auth v4652 s=3 n(v0 rc2023-10-03T19:16:06.518923+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4a7180] 2023-10-03T19:21:05.139 INFO:teuthology.orchestra.run.smithi045.stdout: -1767> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003cd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.139 INFO:teuthology.orchestra.run.smithi045.stdout: -1766> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ce [2,head] /dc-dir/dc-file_473 auth v4654 s=3 n(v0 rc2023-10-03T19:16:06.529468+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4a7700] 2023-10-03T19:21:05.139 INFO:teuthology.orchestra.run.smithi045.stdout: -1765> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003ce) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.139 INFO:teuthology.orchestra.run.smithi045.stdout: -1764> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003cf [2,head] /dc-dir/dc-file_474 auth v4656 s=3 n(v0 rc2023-10-03T19:16:06.540071+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4b0000] 2023-10-03T19:21:05.139 INFO:teuthology.orchestra.run.smithi045.stdout: -1763> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003cf) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.139 INFO:teuthology.orchestra.run.smithi045.stdout: -1762> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003d0 [2,head] /dc-dir/dc-file_475 auth v4658 s=3 n(v0 rc2023-10-03T19:16:06.550435+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4b0580] 2023-10-03T19:21:05.140 INFO:teuthology.orchestra.run.smithi045.stdout: -1761> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003d0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.140 INFO:teuthology.orchestra.run.smithi045.stdout: -1760> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003d1 [2,head] /dc-dir/dc-file_476 auth v4660 s=3 n(v0 rc2023-10-03T19:16:06.561292+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4b0b00] 2023-10-03T19:21:05.140 INFO:teuthology.orchestra.run.smithi045.stdout: -1759> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003d1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.140 INFO:teuthology.orchestra.run.smithi045.stdout: -1758> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003d2 [2,head] /dc-dir/dc-file_477 auth v4662 s=3 n(v0 rc2023-10-03T19:16:06.573382+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4b1080] 2023-10-03T19:21:05.140 INFO:teuthology.orchestra.run.smithi045.stdout: -1757> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003d2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.140 INFO:teuthology.orchestra.run.smithi045.stdout: -1756> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003d3 [2,head] /dc-dir/dc-file_478 auth v4664 s=3 n(v0 rc2023-10-03T19:16:06.584978+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4b1600] 2023-10-03T19:21:05.140 INFO:teuthology.orchestra.run.smithi045.stdout: -1755> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003d3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.161 INFO:teuthology.orchestra.run.smithi045.stdout: -1754> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003d4 [2,head] /dc-dir/dc-file_479 auth v4666 s=3 n(v0 rc2023-10-03T19:16:06.597289+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4b1b80] 2023-10-03T19:21:05.161 INFO:teuthology.orchestra.run.smithi045.stdout: -1753> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003d4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.161 INFO:teuthology.orchestra.run.smithi045.stdout: -1752> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003d5 [2,head] /dc-dir/dc-file_480 auth v4668 s=3 n(v0 rc2023-10-03T19:16:06.610686+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4b2100] 2023-10-03T19:21:05.161 INFO:teuthology.orchestra.run.smithi045.stdout: -1751> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003d5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.161 INFO:teuthology.orchestra.run.smithi045.stdout: -1750> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003d6 [2,head] /dc-dir/dc-file_481 auth v4670 s=3 n(v0 rc2023-10-03T19:16:06.622242+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4b2680] 2023-10-03T19:21:05.161 INFO:teuthology.orchestra.run.smithi045.stdout: -1749> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003d6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.161 INFO:teuthology.orchestra.run.smithi045.stdout: -1748> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003d7 [2,head] /dc-dir/dc-file_482 auth v4672 s=3 n(v0 rc2023-10-03T19:16:06.634298+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4b2c00] 2023-10-03T19:21:05.161 INFO:teuthology.orchestra.run.smithi045.stdout: -1747> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003d7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.161 INFO:teuthology.orchestra.run.smithi045.stdout: -1746> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003d8 [2,head] /dc-dir/dc-file_483 auth v4674 s=3 n(v0 rc2023-10-03T19:16:06.645904+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4b3180] 2023-10-03T19:21:05.161 INFO:teuthology.orchestra.run.smithi045.stdout: -1745> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003d8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.162 INFO:teuthology.orchestra.run.smithi045.stdout: -1744> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003d9 [2,head] /dc-dir/dc-file_484 auth v4676 s=3 n(v0 rc2023-10-03T19:16:06.656287+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4b3700] 2023-10-03T19:21:05.162 INFO:teuthology.orchestra.run.smithi045.stdout: -1743> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003d9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.162 INFO:teuthology.orchestra.run.smithi045.stdout: -1742> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003da [2,head] /dc-dir/dc-file_485 auth v4678 s=3 n(v0 rc2023-10-03T19:16:06.667082+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4b6000] 2023-10-03T19:21:05.162 INFO:teuthology.orchestra.run.smithi045.stdout: -1741> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003da) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.162 INFO:teuthology.orchestra.run.smithi045.stdout: -1740> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003db [2,head] /dc-dir/dc-file_486 auth v4680 s=3 n(v0 rc2023-10-03T19:16:06.679753+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4b6580] 2023-10-03T19:21:05.162 INFO:teuthology.orchestra.run.smithi045.stdout: -1739> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003db) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.162 INFO:teuthology.orchestra.run.smithi045.stdout: -1738> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003dc [2,head] /dc-dir/dc-file_487 auth v4682 s=3 n(v0 rc2023-10-03T19:16:06.691471+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4b6b00] 2023-10-03T19:21:05.162 INFO:teuthology.orchestra.run.smithi045.stdout: -1737> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003dc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.162 INFO:teuthology.orchestra.run.smithi045.stdout: -1736> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003dd [2,head] /dc-dir/dc-file_488 auth v4684 s=3 n(v0 rc2023-10-03T19:16:06.703233+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4b7080] 2023-10-03T19:21:05.162 INFO:teuthology.orchestra.run.smithi045.stdout: -1735> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003dd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.163 INFO:teuthology.orchestra.run.smithi045.stdout: -1734> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003de [2,head] /dc-dir/dc-file_489 auth v4686 s=3 n(v0 rc2023-10-03T19:16:06.715450+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4b7600] 2023-10-03T19:21:05.163 INFO:teuthology.orchestra.run.smithi045.stdout: -1733> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003de) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.163 INFO:teuthology.orchestra.run.smithi045.stdout: -1732> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003df [2,head] /dc-dir/dc-file_490 auth v4688 s=3 n(v0 rc2023-10-03T19:16:06.726580+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4b7b80] 2023-10-03T19:21:05.163 INFO:teuthology.orchestra.run.smithi045.stdout: -1731> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003df) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.163 INFO:teuthology.orchestra.run.smithi045.stdout: -1730> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003e0 [2,head] /dc-dir/dc-file_491 auth v4690 s=3 n(v0 rc2023-10-03T19:16:06.737198+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4b8100] 2023-10-03T19:21:05.163 INFO:teuthology.orchestra.run.smithi045.stdout: -1729> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003e0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.163 INFO:teuthology.orchestra.run.smithi045.stdout: -1728> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003e1 [2,head] /dc-dir/dc-file_492 auth v4692 s=3 n(v0 rc2023-10-03T19:16:06.747690+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4b8680] 2023-10-03T19:21:05.163 INFO:teuthology.orchestra.run.smithi045.stdout: -1727> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003e1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.163 INFO:teuthology.orchestra.run.smithi045.stdout: -1726> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003e2 [2,head] /dc-dir/dc-file_493 auth v4694 s=3 n(v0 rc2023-10-03T19:16:06.759108+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4b8c00] 2023-10-03T19:21:05.163 INFO:teuthology.orchestra.run.smithi045.stdout: -1725> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003e2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.163 INFO:teuthology.orchestra.run.smithi045.stdout: -1724> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003e3 [2,head] /dc-dir/dc-file_494 auth v4696 s=3 n(v0 rc2023-10-03T19:16:06.770257+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4b9180] 2023-10-03T19:21:05.164 INFO:teuthology.orchestra.run.smithi045.stdout: -1723> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003e3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.164 INFO:teuthology.orchestra.run.smithi045.stdout: -1722> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003e4 [2,head] /dc-dir/dc-file_495 auth v4698 s=3 n(v0 rc2023-10-03T19:16:06.780829+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4b9700] 2023-10-03T19:21:05.164 INFO:teuthology.orchestra.run.smithi045.stdout: -1721> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003e4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.164 INFO:teuthology.orchestra.run.smithi045.stdout: -1720> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003e5 [2,head] /dc-dir/dc-file_496 auth v4700 s=3 n(v0 rc2023-10-03T19:16:06.791154+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4c2000] 2023-10-03T19:21:05.164 INFO:teuthology.orchestra.run.smithi045.stdout: -1719> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003e5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.164 INFO:teuthology.orchestra.run.smithi045.stdout: -1718> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003e6 [2,head] /dc-dir/dc-file_497 auth v4702 s=3 n(v0 rc2023-10-03T19:16:06.801635+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4c2580] 2023-10-03T19:21:05.164 INFO:teuthology.orchestra.run.smithi045.stdout: -1717> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003e6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.164 INFO:teuthology.orchestra.run.smithi045.stdout: -1716> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003e7 [2,head] /dc-dir/dc-file_498 auth v4704 s=3 n(v0 rc2023-10-03T19:16:06.812009+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4c2b00] 2023-10-03T19:21:05.164 INFO:teuthology.orchestra.run.smithi045.stdout: -1715> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003e7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.164 INFO:teuthology.orchestra.run.smithi045.stdout: -1714> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003e8 [2,head] /dc-dir/dc-file_499 auth v4706 s=3 n(v0 rc2023-10-03T19:16:06.822688+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4c3080] 2023-10-03T19:21:05.164 INFO:teuthology.orchestra.run.smithi045.stdout: -1713> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003e8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.165 INFO:teuthology.orchestra.run.smithi045.stdout: -1712> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003e9 [2,head] /dc-dir/dc-file_500 auth v4708 s=3 n(v0 rc2023-10-03T19:16:06.833896+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4c3600] 2023-10-03T19:21:05.165 INFO:teuthology.orchestra.run.smithi045.stdout: -1711> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003e9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.165 INFO:teuthology.orchestra.run.smithi045.stdout: -1710> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ea [2,head] /dc-dir/dc-file_501 auth v4710 s=3 n(v0 rc2023-10-03T19:16:06.844369+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4c3b80] 2023-10-03T19:21:05.165 INFO:teuthology.orchestra.run.smithi045.stdout: -1709> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003ea) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.165 INFO:teuthology.orchestra.run.smithi045.stdout: -1708> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003eb [2,head] /dc-dir/dc-file_502 auth v4712 s=3 n(v0 rc2023-10-03T19:16:06.855696+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4c4100] 2023-10-03T19:21:05.165 INFO:teuthology.orchestra.run.smithi045.stdout: -1707> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003eb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.165 INFO:teuthology.orchestra.run.smithi045.stdout: -1706> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ec [2,head] /dc-dir/dc-file_503 auth v4714 s=3 n(v0 rc2023-10-03T19:16:06.866923+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4c4680] 2023-10-03T19:21:05.165 INFO:teuthology.orchestra.run.smithi045.stdout: -1705> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003ec) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.165 INFO:teuthology.orchestra.run.smithi045.stdout: -1704> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ed [2,head] /dc-dir/dc-file_504 auth v4716 s=3 n(v0 rc2023-10-03T19:16:06.878204+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4c4c00] 2023-10-03T19:21:05.165 INFO:teuthology.orchestra.run.smithi045.stdout: -1703> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003ed) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.165 INFO:teuthology.orchestra.run.smithi045.stdout: -1702> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ee [2,head] /dc-dir/dc-file_505 auth v4718 s=3 n(v0 rc2023-10-03T19:16:06.889419+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4c5180] 2023-10-03T19:21:05.165 INFO:teuthology.orchestra.run.smithi045.stdout: -1701> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003ee) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.166 INFO:teuthology.orchestra.run.smithi045.stdout: -1700> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ef [2,head] /dc-dir/dc-file_506 auth v4720 s=3 n(v0 rc2023-10-03T19:16:06.900823+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4c5700] 2023-10-03T19:21:05.166 INFO:teuthology.orchestra.run.smithi045.stdout: -1699> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003ef) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.166 INFO:teuthology.orchestra.run.smithi045.stdout: -1698> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003f0 [2,head] /dc-dir/dc-file_507 auth v4722 s=3 n(v0 rc2023-10-03T19:16:06.911775+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4d2000] 2023-10-03T19:21:05.166 INFO:teuthology.orchestra.run.smithi045.stdout: -1697> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003f0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.166 INFO:teuthology.orchestra.run.smithi045.stdout: -1696> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003f1 [2,head] /dc-dir/dc-file_508 auth v4724 s=3 n(v0 rc2023-10-03T19:16:06.922512+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4d2580] 2023-10-03T19:21:05.166 INFO:teuthology.orchestra.run.smithi045.stdout: -1695> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003f1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.166 INFO:teuthology.orchestra.run.smithi045.stdout: -1694> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003f2 [2,head] /dc-dir/dc-file_509 auth v4726 s=3 n(v0 rc2023-10-03T19:16:06.933924+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4d2b00] 2023-10-03T19:21:05.166 INFO:teuthology.orchestra.run.smithi045.stdout: -1693> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003f2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.166 INFO:teuthology.orchestra.run.smithi045.stdout: -1692> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003f3 [2,head] /dc-dir/dc-file_510 auth v4728 s=3 n(v0 rc2023-10-03T19:16:06.944631+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4d3080] 2023-10-03T19:21:05.166 INFO:teuthology.orchestra.run.smithi045.stdout: -1691> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003f3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.166 INFO:teuthology.orchestra.run.smithi045.stdout: -1690> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003f4 [2,head] /dc-dir/dc-file_511 auth v4730 s=3 n(v0 rc2023-10-03T19:16:06.956330+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4d3600] 2023-10-03T19:21:05.167 INFO:teuthology.orchestra.run.smithi045.stdout: -1689> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003f4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.167 INFO:teuthology.orchestra.run.smithi045.stdout: -1688> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003f5 [2,head] /dc-dir/dc-file_512 auth v4732 s=3 n(v0 rc2023-10-03T19:16:06.966268+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4d3b80] 2023-10-03T19:21:05.167 INFO:teuthology.orchestra.run.smithi045.stdout: -1687> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003f5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.167 INFO:teuthology.orchestra.run.smithi045.stdout: -1686> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003f6 [2,head] /dc-dir/dc-file_513 auth v4734 s=3 n(v0 rc2023-10-03T19:16:06.976706+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4d4100] 2023-10-03T19:21:05.167 INFO:teuthology.orchestra.run.smithi045.stdout: -1685> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003f6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.167 INFO:teuthology.orchestra.run.smithi045.stdout: -1684> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003f7 [2,head] /dc-dir/dc-file_514 auth v4736 s=3 n(v0 rc2023-10-03T19:16:06.987296+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4d4680] 2023-10-03T19:21:05.167 INFO:teuthology.orchestra.run.smithi045.stdout: -1683> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003f7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.167 INFO:teuthology.orchestra.run.smithi045.stdout: -1682> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003f8 [2,head] /dc-dir/dc-file_515 auth v4738 s=3 n(v0 rc2023-10-03T19:16:06.998715+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4d4c00] 2023-10-03T19:21:05.167 INFO:teuthology.orchestra.run.smithi045.stdout: -1681> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003f8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.167 INFO:teuthology.orchestra.run.smithi045.stdout: -1680> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003f9 [2,head] /dc-dir/dc-file_516 auth v4740 s=3 n(v0 rc2023-10-03T19:16:07.009439+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4d5180] 2023-10-03T19:21:05.167 INFO:teuthology.orchestra.run.smithi045.stdout: -1679> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003f9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.167 INFO:teuthology.orchestra.run.smithi045.stdout: -1678> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003fa [2,head] /dc-dir/dc-file_517 auth v4742 s=3 n(v0 rc2023-10-03T19:16:07.020016+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4d5700] 2023-10-03T19:21:05.168 INFO:teuthology.orchestra.run.smithi045.stdout: -1677> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003fa) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.168 INFO:teuthology.orchestra.run.smithi045.stdout: -1676> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003fb [2,head] /dc-dir/dc-file_518 auth v4744 s=3 n(v0 rc2023-10-03T19:16:07.030951+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4de000] 2023-10-03T19:21:05.168 INFO:teuthology.orchestra.run.smithi045.stdout: -1675> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003fb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.168 INFO:teuthology.orchestra.run.smithi045.stdout: -1674> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003fc [2,head] /dc-dir/dc-file_519 auth v4746 s=3 n(v0 rc2023-10-03T19:16:07.042646+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4de580] 2023-10-03T19:21:05.168 INFO:teuthology.orchestra.run.smithi045.stdout: -1673> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003fc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.179 INFO:teuthology.orchestra.run.smithi045.stdout: -1672> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003fd [2,head] /dc-dir/dc-file_520 auth v4748 s=3 n(v0 rc2023-10-03T19:16:07.053148+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4deb00] 2023-10-03T19:21:05.179 INFO:teuthology.orchestra.run.smithi045.stdout: -1671> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003fd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.179 INFO:teuthology.orchestra.run.smithi045.stdout: -1670> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003fe [2,head] /dc-dir/dc-file_521 auth v4750 s=3 n(v0 rc2023-10-03T19:16:07.064345+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4df080] 2023-10-03T19:21:05.179 INFO:teuthology.orchestra.run.smithi045.stdout: -1669> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003fe) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.179 INFO:teuthology.orchestra.run.smithi045.stdout: -1668> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ff [2,head] /dc-dir/dc-file_522 auth v4752 s=3 n(v0 rc2023-10-03T19:16:07.075359+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4df600] 2023-10-03T19:21:05.179 INFO:teuthology.orchestra.run.smithi045.stdout: -1667> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000003ff) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.180 INFO:teuthology.orchestra.run.smithi045.stdout: -1666> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000400 [2,head] /dc-dir/dc-file_523 auth v4754 s=3 n(v0 rc2023-10-03T19:16:07.086215+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4dfb80] 2023-10-03T19:21:05.180 INFO:teuthology.orchestra.run.smithi045.stdout: -1665> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000400) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.180 INFO:teuthology.orchestra.run.smithi045.stdout: -1664> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000401 [2,head] /dc-dir/dc-file_524 auth v4756 s=3 n(v0 rc2023-10-03T19:16:07.097780+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4e0100] 2023-10-03T19:21:05.180 INFO:teuthology.orchestra.run.smithi045.stdout: -1663> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000401) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.180 INFO:teuthology.orchestra.run.smithi045.stdout: -1662> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000402 [2,head] /dc-dir/dc-file_525 auth v4758 s=3 n(v0 rc2023-10-03T19:16:07.108817+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4e0680] 2023-10-03T19:21:05.180 INFO:teuthology.orchestra.run.smithi045.stdout: -1661> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000402) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.180 INFO:teuthology.orchestra.run.smithi045.stdout: -1660> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000403 [2,head] /dc-dir/dc-file_526 auth v4760 s=3 n(v0 rc2023-10-03T19:16:07.119743+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4e0c00] 2023-10-03T19:21:05.180 INFO:teuthology.orchestra.run.smithi045.stdout: -1659> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000403) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.180 INFO:teuthology.orchestra.run.smithi045.stdout: -1658> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000404 [2,head] /dc-dir/dc-file_527 auth v4762 s=3 n(v0 rc2023-10-03T19:16:07.130430+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4e1180] 2023-10-03T19:21:05.180 INFO:teuthology.orchestra.run.smithi045.stdout: -1657> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000404) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.180 INFO:teuthology.orchestra.run.smithi045.stdout: -1656> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000405 [2,head] /dc-dir/dc-file_528 auth v4764 s=3 n(v0 rc2023-10-03T19:16:07.142171+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4e1700] 2023-10-03T19:21:05.180 INFO:teuthology.orchestra.run.smithi045.stdout: -1655> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000405) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.181 INFO:teuthology.orchestra.run.smithi045.stdout: -1654> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000406 [2,head] /dc-dir/dc-file_529 auth v4766 s=3 n(v0 rc2023-10-03T19:16:07.154510+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4ee000] 2023-10-03T19:21:05.181 INFO:teuthology.orchestra.run.smithi045.stdout: -1653> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000406) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.181 INFO:teuthology.orchestra.run.smithi045.stdout: -1652> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000407 [2,head] /dc-dir/dc-file_530 auth v4768 s=3 n(v0 rc2023-10-03T19:16:07.167201+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4ee580] 2023-10-03T19:21:05.181 INFO:teuthology.orchestra.run.smithi045.stdout: -1651> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000407) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.181 INFO:teuthology.orchestra.run.smithi045.stdout: -1650> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000408 [2,head] /dc-dir/dc-file_531 auth v4770 s=3 n(v0 rc2023-10-03T19:16:07.178639+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4eeb00] 2023-10-03T19:21:05.181 INFO:teuthology.orchestra.run.smithi045.stdout: -1649> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000408) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.181 INFO:teuthology.orchestra.run.smithi045.stdout: -1648> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000409 [2,head] /dc-dir/dc-file_532 auth v4772 s=3 n(v0 rc2023-10-03T19:16:07.189759+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4ef080] 2023-10-03T19:21:05.181 INFO:teuthology.orchestra.run.smithi045.stdout: -1647> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000409) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.181 INFO:teuthology.orchestra.run.smithi045.stdout: -1646> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000040a [2,head] /dc-dir/dc-file_533 auth v4774 s=3 n(v0 rc2023-10-03T19:16:07.200437+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4ef600] 2023-10-03T19:21:05.181 INFO:teuthology.orchestra.run.smithi045.stdout: -1645> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000040a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.181 INFO:teuthology.orchestra.run.smithi045.stdout: -1644> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000040b [2,head] /dc-dir/dc-file_534 auth v4776 s=3 n(v0 rc2023-10-03T19:16:07.213220+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4efb80] 2023-10-03T19:21:05.182 INFO:teuthology.orchestra.run.smithi045.stdout: -1643> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000040b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.182 INFO:teuthology.orchestra.run.smithi045.stdout: -1642> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000040c [2,head] /dc-dir/dc-file_535 auth v4778 s=3 n(v0 rc2023-10-03T19:16:07.224905+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4f0100] 2023-10-03T19:21:05.182 INFO:teuthology.orchestra.run.smithi045.stdout: -1641> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000040c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.182 INFO:teuthology.orchestra.run.smithi045.stdout: -1640> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000040d [2,head] /dc-dir/dc-file_536 auth v4780 s=3 n(v0 rc2023-10-03T19:16:07.236553+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4f0680] 2023-10-03T19:21:05.182 INFO:teuthology.orchestra.run.smithi045.stdout: -1639> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000040d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.182 INFO:teuthology.orchestra.run.smithi045.stdout: -1638> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000040e [2,head] /dc-dir/dc-file_537 auth v4782 s=3 n(v0 rc2023-10-03T19:16:07.247880+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4f0c00] 2023-10-03T19:21:05.182 INFO:teuthology.orchestra.run.smithi045.stdout: -1637> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000040e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.182 INFO:teuthology.orchestra.run.smithi045.stdout: -1636> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000040f [2,head] /dc-dir/dc-file_538 auth v4784 s=3 n(v0 rc2023-10-03T19:16:07.258990+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4f1180] 2023-10-03T19:21:05.182 INFO:teuthology.orchestra.run.smithi045.stdout: -1635> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000040f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.182 INFO:teuthology.orchestra.run.smithi045.stdout: -1634> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000410 [2,head] /dc-dir/dc-file_539 auth v4786 s=3 n(v0 rc2023-10-03T19:16:07.270209+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4f1700] 2023-10-03T19:21:05.182 INFO:teuthology.orchestra.run.smithi045.stdout: -1633> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000410) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.183 INFO:teuthology.orchestra.run.smithi045.stdout: -1632> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000411 [2,head] /dc-dir/dc-file_540 auth v4788 s=3 n(v0 rc2023-10-03T19:16:07.281873+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4fa000] 2023-10-03T19:21:05.183 INFO:teuthology.orchestra.run.smithi045.stdout: -1631> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000411) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.183 INFO:teuthology.orchestra.run.smithi045.stdout: -1630> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000412 [2,head] /dc-dir/dc-file_541 auth v4790 s=3 n(v0 rc2023-10-03T19:16:07.294319+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4fa580] 2023-10-03T19:21:05.183 INFO:teuthology.orchestra.run.smithi045.stdout: -1629> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000412) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.183 INFO:teuthology.orchestra.run.smithi045.stdout: -1628> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000413 [2,head] /dc-dir/dc-file_542 auth v4792 s=3 n(v0 rc2023-10-03T19:16:07.306856+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4fab00] 2023-10-03T19:21:05.183 INFO:teuthology.orchestra.run.smithi045.stdout: -1627> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000413) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.183 INFO:teuthology.orchestra.run.smithi045.stdout: -1626> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000414 [2,head] /dc-dir/dc-file_543 auth v4794 s=3 n(v0 rc2023-10-03T19:16:07.318345+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4fb080] 2023-10-03T19:21:05.183 INFO:teuthology.orchestra.run.smithi045.stdout: -1625> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000414) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.183 INFO:teuthology.orchestra.run.smithi045.stdout: -1624> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000415 [2,head] /dc-dir/dc-file_544 auth v4796 s=3 n(v0 rc2023-10-03T19:16:07.330302+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4fb600] 2023-10-03T19:21:05.183 INFO:teuthology.orchestra.run.smithi045.stdout: -1623> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000415) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.183 INFO:teuthology.orchestra.run.smithi045.stdout: -1622> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000416 [2,head] /dc-dir/dc-file_545 auth v4798 s=3 n(v0 rc2023-10-03T19:16:07.342919+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4fbb80] 2023-10-03T19:21:05.183 INFO:teuthology.orchestra.run.smithi045.stdout: -1621> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000416) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.184 INFO:teuthology.orchestra.run.smithi045.stdout: -1620> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000417 [2,head] /dc-dir/dc-file_546 auth v4800 s=3 n(v0 rc2023-10-03T19:16:07.355512+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4fc100] 2023-10-03T19:21:05.184 INFO:teuthology.orchestra.run.smithi045.stdout: -1619> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000417) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.184 INFO:teuthology.orchestra.run.smithi045.stdout: -1618> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000418 [2,head] /dc-dir/dc-file_547 auth v4802 s=3 n(v0 rc2023-10-03T19:16:07.368151+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4fc680] 2023-10-03T19:21:05.184 INFO:teuthology.orchestra.run.smithi045.stdout: -1617> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000418) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.184 INFO:teuthology.orchestra.run.smithi045.stdout: -1616> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000419 [2,head] /dc-dir/dc-file_548 auth v4804 s=3 n(v0 rc2023-10-03T19:16:07.381512+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4fcc00] 2023-10-03T19:21:05.184 INFO:teuthology.orchestra.run.smithi045.stdout: -1615> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000419) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.184 INFO:teuthology.orchestra.run.smithi045.stdout: -1614> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000041a [2,head] /dc-dir/dc-file_549 auth v4806 s=3 n(v0 rc2023-10-03T19:16:07.393927+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4fd180] 2023-10-03T19:21:05.184 INFO:teuthology.orchestra.run.smithi045.stdout: -1613> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000041a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.184 INFO:teuthology.orchestra.run.smithi045.stdout: -1612> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000041b [2,head] /dc-dir/dc-file_550 auth v4808 s=3 n(v0 rc2023-10-03T19:16:07.405612+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d4fd700] 2023-10-03T19:21:05.184 INFO:teuthology.orchestra.run.smithi045.stdout: -1611> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000041b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.184 INFO:teuthology.orchestra.run.smithi045.stdout: -1610> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000041c [2,head] /dc-dir/dc-file_551 auth v4810 s=3 n(v0 rc2023-10-03T19:16:07.416928+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d508000] 2023-10-03T19:21:05.184 INFO:teuthology.orchestra.run.smithi045.stdout: -1609> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000041c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.185 INFO:teuthology.orchestra.run.smithi045.stdout: -1608> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000041d [2,head] /dc-dir/dc-file_552 auth v4812 s=3 n(v0 rc2023-10-03T19:16:07.429606+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d508580] 2023-10-03T19:21:05.185 INFO:teuthology.orchestra.run.smithi045.stdout: -1607> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000041d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.185 INFO:teuthology.orchestra.run.smithi045.stdout: -1606> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000041e [2,head] /dc-dir/dc-file_553 auth v4814 s=3 n(v0 rc2023-10-03T19:16:07.441256+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d508b00] 2023-10-03T19:21:05.185 INFO:teuthology.orchestra.run.smithi045.stdout: -1605> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000041e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.185 INFO:teuthology.orchestra.run.smithi045.stdout: -1604> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000041f [2,head] /dc-dir/dc-file_554 auth v4850 s=3 n(v0 rc2023-10-03T19:16:07.535151+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d509080] 2023-10-03T19:21:05.185 INFO:teuthology.orchestra.run.smithi045.stdout: -1603> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000041f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.185 INFO:teuthology.orchestra.run.smithi045.stdout: -1602> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000420 [2,head] /dc-dir/dc-file_555 auth v4852 s=3 n(v0 rc2023-10-03T19:16:07.582729+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d509600] 2023-10-03T19:21:05.185 INFO:teuthology.orchestra.run.smithi045.stdout: -1601> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000420) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.185 INFO:teuthology.orchestra.run.smithi045.stdout: -1600> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000421 [2,head] /dc-dir/dc-file_556 auth v4854 s=3 n(v0 rc2023-10-03T19:16:07.594500+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d509b80] 2023-10-03T19:21:05.185 INFO:teuthology.orchestra.run.smithi045.stdout: -1599> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000421) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.185 INFO:teuthology.orchestra.run.smithi045.stdout: -1598> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000422 [2,head] /dc-dir/dc-file_557 auth v4856 s=3 n(v0 rc2023-10-03T19:16:07.606977+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d50a100] 2023-10-03T19:21:05.185 INFO:teuthology.orchestra.run.smithi045.stdout: -1597> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000422) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.186 INFO:teuthology.orchestra.run.smithi045.stdout: -1596> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000423 [2,head] /dc-dir/dc-file_558 auth v4858 s=3 n(v0 rc2023-10-03T19:16:07.618415+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d50a680] 2023-10-03T19:21:05.186 INFO:teuthology.orchestra.run.smithi045.stdout: -1595> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000423) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.186 INFO:teuthology.orchestra.run.smithi045.stdout: -1594> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000424 [2,head] /dc-dir/dc-file_559 auth v4860 s=3 n(v0 rc2023-10-03T19:16:07.630224+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d50ac00] 2023-10-03T19:21:05.186 INFO:teuthology.orchestra.run.smithi045.stdout: -1593> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000424) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.186 INFO:teuthology.orchestra.run.smithi045.stdout: -1592> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000425 [2,head] /dc-dir/dc-file_560 auth v4862 s=3 n(v0 rc2023-10-03T19:16:07.641472+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d50b180] 2023-10-03T19:21:05.186 INFO:teuthology.orchestra.run.smithi045.stdout: -1591> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000425) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.186 INFO:teuthology.orchestra.run.smithi045.stdout: -1590> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000426 [2,head] /dc-dir/dc-file_561 auth v4864 s=3 n(v0 rc2023-10-03T19:16:07.653671+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d50b700] 2023-10-03T19:21:05.186 INFO:teuthology.orchestra.run.smithi045.stdout: -1589> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000426) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.205 INFO:teuthology.orchestra.run.smithi045.stdout: -1588> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000427 [2,head] /dc-dir/dc-file_562 auth v4866 s=3 n(v0 rc2023-10-03T19:16:07.665162+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d55a000] 2023-10-03T19:21:05.205 INFO:teuthology.orchestra.run.smithi045.stdout: -1587> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000427) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.205 INFO:teuthology.orchestra.run.smithi045.stdout: -1586> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000428 [2,head] /dc-dir/dc-file_563 auth v4868 s=3 n(v0 rc2023-10-03T19:16:07.676623+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d55a580] 2023-10-03T19:21:05.205 INFO:teuthology.orchestra.run.smithi045.stdout: -1585> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000428) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.205 INFO:teuthology.orchestra.run.smithi045.stdout: -1584> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000429 [2,head] /dc-dir/dc-file_564 auth v4870 s=3 n(v0 rc2023-10-03T19:16:07.688305+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d55ab00] 2023-10-03T19:21:05.206 INFO:teuthology.orchestra.run.smithi045.stdout: -1583> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000429) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.206 INFO:teuthology.orchestra.run.smithi045.stdout: -1582> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000042a [2,head] /dc-dir/dc-file_565 auth v4872 s=3 n(v0 rc2023-10-03T19:16:07.700158+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d55b080] 2023-10-03T19:21:05.206 INFO:teuthology.orchestra.run.smithi045.stdout: -1581> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000042a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.206 INFO:teuthology.orchestra.run.smithi045.stdout: -1580> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000042b [2,head] /dc-dir/dc-file_566 auth v4874 s=3 n(v0 rc2023-10-03T19:16:07.711553+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d55b600] 2023-10-03T19:21:05.206 INFO:teuthology.orchestra.run.smithi045.stdout: -1579> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000042b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.206 INFO:teuthology.orchestra.run.smithi045.stdout: -1578> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000042c [2,head] /dc-dir/dc-file_567 auth v4876 s=3 n(v0 rc2023-10-03T19:16:07.724328+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d55bb80] 2023-10-03T19:21:05.206 INFO:teuthology.orchestra.run.smithi045.stdout: -1577> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000042c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.206 INFO:teuthology.orchestra.run.smithi045.stdout: -1576> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000042d [2,head] /dc-dir/dc-file_568 auth v4878 s=3 n(v0 rc2023-10-03T19:16:07.736687+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d55c100] 2023-10-03T19:21:05.206 INFO:teuthology.orchestra.run.smithi045.stdout: -1575> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000042d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.206 INFO:teuthology.orchestra.run.smithi045.stdout: -1574> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000042e [2,head] /dc-dir/dc-file_569 auth v4880 s=3 n(v0 rc2023-10-03T19:16:07.748975+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d55c680] 2023-10-03T19:21:05.206 INFO:teuthology.orchestra.run.smithi045.stdout: -1573> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000042e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.207 INFO:teuthology.orchestra.run.smithi045.stdout: -1572> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000042f [2,head] /dc-dir/dc-file_570 auth v4882 s=3 n(v0 rc2023-10-03T19:16:07.760756+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d55cc00] 2023-10-03T19:21:05.207 INFO:teuthology.orchestra.run.smithi045.stdout: -1571> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000042f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.207 INFO:teuthology.orchestra.run.smithi045.stdout: -1570> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000430 [2,head] /dc-dir/dc-file_571 auth v4884 s=3 n(v0 rc2023-10-03T19:16:07.772317+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d55d180] 2023-10-03T19:21:05.207 INFO:teuthology.orchestra.run.smithi045.stdout: -1569> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000430) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.207 INFO:teuthology.orchestra.run.smithi045.stdout: -1568> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000431 [2,head] /dc-dir/dc-file_572 auth v4886 s=3 n(v0 rc2023-10-03T19:16:07.783553+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d55d700] 2023-10-03T19:21:05.207 INFO:teuthology.orchestra.run.smithi045.stdout: -1567> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000431) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.207 INFO:teuthology.orchestra.run.smithi045.stdout: -1566> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000432 [2,head] /dc-dir/dc-file_573 auth v4888 s=3 n(v0 rc2023-10-03T19:16:07.796511+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d562000] 2023-10-03T19:21:05.207 INFO:teuthology.orchestra.run.smithi045.stdout: -1565> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000432) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.207 INFO:teuthology.orchestra.run.smithi045.stdout: -1564> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000433 [2,head] /dc-dir/dc-file_574 auth v4890 s=3 n(v0 rc2023-10-03T19:16:07.808477+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d562580] 2023-10-03T19:21:05.207 INFO:teuthology.orchestra.run.smithi045.stdout: -1563> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000433) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.207 INFO:teuthology.orchestra.run.smithi045.stdout: -1562> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000434 [2,head] /dc-dir/dc-file_575 auth v4892 s=3 n(v0 rc2023-10-03T19:16:07.819573+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d562b00] 2023-10-03T19:21:05.207 INFO:teuthology.orchestra.run.smithi045.stdout: -1561> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000434) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.208 INFO:teuthology.orchestra.run.smithi045.stdout: -1560> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000435 [2,head] /dc-dir/dc-file_576 auth v4894 s=3 n(v0 rc2023-10-03T19:16:07.832603+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d563080] 2023-10-03T19:21:05.208 INFO:teuthology.orchestra.run.smithi045.stdout: -1559> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000435) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.208 INFO:teuthology.orchestra.run.smithi045.stdout: -1558> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000436 [2,head] /dc-dir/dc-file_577 auth v4896 s=3 n(v0 rc2023-10-03T19:16:07.844366+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d563600] 2023-10-03T19:21:05.208 INFO:teuthology.orchestra.run.smithi045.stdout: -1557> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000436) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.208 INFO:teuthology.orchestra.run.smithi045.stdout: -1556> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000437 [2,head] /dc-dir/dc-file_578 auth v4898 s=3 n(v0 rc2023-10-03T19:16:07.857830+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d563b80] 2023-10-03T19:21:05.208 INFO:teuthology.orchestra.run.smithi045.stdout: -1555> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000437) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.208 INFO:teuthology.orchestra.run.smithi045.stdout: -1554> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000438 [2,head] /dc-dir/dc-file_579 auth v4900 s=3 n(v0 rc2023-10-03T19:16:07.869466+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d564100] 2023-10-03T19:21:05.208 INFO:teuthology.orchestra.run.smithi045.stdout: -1553> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000438) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.208 INFO:teuthology.orchestra.run.smithi045.stdout: -1552> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000439 [2,head] /dc-dir/dc-file_580 auth v4902 s=3 n(v0 rc2023-10-03T19:16:07.881978+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d564680] 2023-10-03T19:21:05.208 INFO:teuthology.orchestra.run.smithi045.stdout: -1551> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000439) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.208 INFO:teuthology.orchestra.run.smithi045.stdout: -1550> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000043a [2,head] /dc-dir/dc-file_581 auth v4904 s=3 n(v0 rc2023-10-03T19:16:07.894437+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d564c00] 2023-10-03T19:21:05.209 INFO:teuthology.orchestra.run.smithi045.stdout: -1549> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000043a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.209 INFO:teuthology.orchestra.run.smithi045.stdout: -1548> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000043b [2,head] /dc-dir/dc-file_582 auth v4906 s=3 n(v0 rc2023-10-03T19:16:07.906239+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d565180] 2023-10-03T19:21:05.209 INFO:teuthology.orchestra.run.smithi045.stdout: -1547> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000043b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.209 INFO:teuthology.orchestra.run.smithi045.stdout: -1546> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000043c [2,head] /dc-dir/dc-file_583 auth v4908 s=3 n(v0 rc2023-10-03T19:16:07.917504+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d565700] 2023-10-03T19:21:05.209 INFO:teuthology.orchestra.run.smithi045.stdout: -1545> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000043c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.209 INFO:teuthology.orchestra.run.smithi045.stdout: -1544> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000043d [2,head] /dc-dir/dc-file_584 auth v4910 s=3 n(v0 rc2023-10-03T19:16:07.928542+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d582000] 2023-10-03T19:21:05.209 INFO:teuthology.orchestra.run.smithi045.stdout: -1543> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000043d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.209 INFO:teuthology.orchestra.run.smithi045.stdout: -1542> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000043e [2,head] /dc-dir/dc-file_585 auth v4912 s=3 n(v0 rc2023-10-03T19:16:07.939588+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d582580] 2023-10-03T19:21:05.209 INFO:teuthology.orchestra.run.smithi045.stdout: -1541> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000043e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.209 INFO:teuthology.orchestra.run.smithi045.stdout: -1540> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000043f [2,head] /dc-dir/dc-file_586 auth v4914 s=3 n(v0 rc2023-10-03T19:16:07.951197+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d582b00] 2023-10-03T19:21:05.209 INFO:teuthology.orchestra.run.smithi045.stdout: -1539> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000043f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.210 INFO:teuthology.orchestra.run.smithi045.stdout: -1538> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000440 [2,head] /dc-dir/dc-file_587 auth v4916 s=3 n(v0 rc2023-10-03T19:16:07.962897+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d583080] 2023-10-03T19:21:05.210 INFO:teuthology.orchestra.run.smithi045.stdout: -1537> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000440) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.210 INFO:teuthology.orchestra.run.smithi045.stdout: -1536> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000441 [2,head] /dc-dir/dc-file_588 auth v4918 s=3 n(v0 rc2023-10-03T19:16:07.974374+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d583600] 2023-10-03T19:21:05.210 INFO:teuthology.orchestra.run.smithi045.stdout: -1535> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000441) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.210 INFO:teuthology.orchestra.run.smithi045.stdout: -1534> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000442 [2,head] /dc-dir/dc-file_589 auth v4920 s=3 n(v0 rc2023-10-03T19:16:07.985599+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d583b80] 2023-10-03T19:21:05.210 INFO:teuthology.orchestra.run.smithi045.stdout: -1533> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000442) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.210 INFO:teuthology.orchestra.run.smithi045.stdout: -1532> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000443 [2,head] /dc-dir/dc-file_590 auth v4922 s=3 n(v0 rc2023-10-03T19:16:07.997494+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d584100] 2023-10-03T19:21:05.210 INFO:teuthology.orchestra.run.smithi045.stdout: -1531> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000443) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.210 INFO:teuthology.orchestra.run.smithi045.stdout: -1530> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000444 [2,head] /dc-dir/dc-file_591 auth v4924 s=3 n(v0 rc2023-10-03T19:16:08.009354+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d584680] 2023-10-03T19:21:05.210 INFO:teuthology.orchestra.run.smithi045.stdout: -1529> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000444) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.210 INFO:teuthology.orchestra.run.smithi045.stdout: -1528> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000445 [2,head] /dc-dir/dc-file_592 auth v4926 s=3 n(v0 rc2023-10-03T19:16:08.020941+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d584c00] 2023-10-03T19:21:05.211 INFO:teuthology.orchestra.run.smithi045.stdout: -1527> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000445) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.211 INFO:teuthology.orchestra.run.smithi045.stdout: -1526> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000446 [2,head] /dc-dir/dc-file_593 auth v4928 s=3 n(v0 rc2023-10-03T19:16:08.032604+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d585180] 2023-10-03T19:21:05.211 INFO:teuthology.orchestra.run.smithi045.stdout: -1525> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000446) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.211 INFO:teuthology.orchestra.run.smithi045.stdout: -1524> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000447 [2,head] /dc-dir/dc-file_594 auth v4930 s=3 n(v0 rc2023-10-03T19:16:08.043980+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d585700] 2023-10-03T19:21:05.211 INFO:teuthology.orchestra.run.smithi045.stdout: -1523> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000447) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.211 INFO:teuthology.orchestra.run.smithi045.stdout: -1522> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000448 [2,head] /dc-dir/dc-file_595 auth v4932 s=3 n(v0 rc2023-10-03T19:16:08.055500+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d590000] 2023-10-03T19:21:05.211 INFO:teuthology.orchestra.run.smithi045.stdout: -1521> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000448) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.211 INFO:teuthology.orchestra.run.smithi045.stdout: -1520> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000449 [2,head] /dc-dir/dc-file_596 auth v4934 s=3 n(v0 rc2023-10-03T19:16:08.068532+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d590580] 2023-10-03T19:21:05.211 INFO:teuthology.orchestra.run.smithi045.stdout: -1519> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000449) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.211 INFO:teuthology.orchestra.run.smithi045.stdout: -1518> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000044a [2,head] /dc-dir/dc-file_597 auth v4936 s=3 n(v0 rc2023-10-03T19:16:08.081321+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d590b00] 2023-10-03T19:21:05.212 INFO:teuthology.orchestra.run.smithi045.stdout: -1517> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000044a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.212 INFO:teuthology.orchestra.run.smithi045.stdout: -1516> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000044b [2,head] /dc-dir/dc-file_598 auth v4938 s=3 n(v0 rc2023-10-03T19:16:08.095608+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d591080] 2023-10-03T19:21:05.212 INFO:teuthology.orchestra.run.smithi045.stdout: -1515> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000044b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.212 INFO:teuthology.orchestra.run.smithi045.stdout: -1514> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000044c [2,head] /dc-dir/dc-file_599 auth v4940 s=3 n(v0 rc2023-10-03T19:16:08.108017+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d591600] 2023-10-03T19:21:05.212 INFO:teuthology.orchestra.run.smithi045.stdout: -1513> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000044c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.212 INFO:teuthology.orchestra.run.smithi045.stdout: -1512> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000044d [2,head] /dc-dir/dc-file_600 auth v4942 s=3 n(v0 rc2023-10-03T19:16:08.119535+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d591b80] 2023-10-03T19:21:05.212 INFO:teuthology.orchestra.run.smithi045.stdout: -1511> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000044d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.212 INFO:teuthology.orchestra.run.smithi045.stdout: -1510> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000044e [2,head] /dc-dir/dc-file_601 auth v4944 s=3 n(v0 rc2023-10-03T19:16:08.130748+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d592100] 2023-10-03T19:21:05.212 INFO:teuthology.orchestra.run.smithi045.stdout: -1509> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000044e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.212 INFO:teuthology.orchestra.run.smithi045.stdout: -1508> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000044f [2,head] /dc-dir/dc-file_602 auth v4946 s=3 n(v0 rc2023-10-03T19:16:08.141964+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d592680] 2023-10-03T19:21:05.212 INFO:teuthology.orchestra.run.smithi045.stdout: -1507> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000044f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.212 INFO:teuthology.orchestra.run.smithi045.stdout: -1506> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000450 [2,head] /dc-dir/dc-file_603 auth v4948 s=3 n(v0 rc2023-10-03T19:16:08.153513+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d592c00] 2023-10-03T19:21:05.213 INFO:teuthology.orchestra.run.smithi045.stdout: -1505> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000450) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.213 INFO:teuthology.orchestra.run.smithi045.stdout: -1504> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000451 [2,head] /dc-dir/dc-file_604 auth v4950 s=3 n(v0 rc2023-10-03T19:16:08.165521+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d593180] 2023-10-03T19:21:05.213 INFO:teuthology.orchestra.run.smithi045.stdout: -1503> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000451) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.213 INFO:teuthology.orchestra.run.smithi045.stdout: -1502> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000452 [2,head] /dc-dir/dc-file_605 auth v4952 s=3 n(v0 rc2023-10-03T19:16:08.176951+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d593700] 2023-10-03T19:21:05.213 INFO:teuthology.orchestra.run.smithi045.stdout: -1501> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000452) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.213 INFO:teuthology.orchestra.run.smithi045.stdout: -1500> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000453 [2,head] /dc-dir/dc-file_606 auth v4954 s=3 n(v0 rc2023-10-03T19:16:08.188195+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d59a000] 2023-10-03T19:21:05.213 INFO:teuthology.orchestra.run.smithi045.stdout: -1499> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000453) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.213 INFO:teuthology.orchestra.run.smithi045.stdout: -1498> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000454 [2,head] /dc-dir/dc-file_607 auth v4956 s=3 n(v0 rc2023-10-03T19:16:08.200485+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d59a580] 2023-10-03T19:21:05.213 INFO:teuthology.orchestra.run.smithi045.stdout: -1497> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000454) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.213 INFO:teuthology.orchestra.run.smithi045.stdout: -1496> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000455 [2,head] /dc-dir/dc-file_608 auth v4958 s=3 n(v0 rc2023-10-03T19:16:08.211887+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d59ab00] 2023-10-03T19:21:05.213 INFO:teuthology.orchestra.run.smithi045.stdout: -1495> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000455) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.214 INFO:teuthology.orchestra.run.smithi045.stdout: -1494> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000456 [2,head] /dc-dir/dc-file_609 auth v4960 s=3 n(v0 rc2023-10-03T19:16:08.223279+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d59b080] 2023-10-03T19:21:05.214 INFO:teuthology.orchestra.run.smithi045.stdout: -1493> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000456) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.214 INFO:teuthology.orchestra.run.smithi045.stdout: -1492> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000457 [2,head] /dc-dir/dc-file_610 auth v4962 s=3 n(v0 rc2023-10-03T19:16:08.234312+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d59b600] 2023-10-03T19:21:05.214 INFO:teuthology.orchestra.run.smithi045.stdout: -1491> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000457) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.214 INFO:teuthology.orchestra.run.smithi045.stdout: -1490> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000458 [2,head] /dc-dir/dc-file_611 auth v4964 s=3 n(v0 rc2023-10-03T19:16:08.245512+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d59bb80] 2023-10-03T19:21:05.214 INFO:teuthology.orchestra.run.smithi045.stdout: -1489> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000458) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.214 INFO:teuthology.orchestra.run.smithi045.stdout: -1488> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000459 [2,head] /dc-dir/dc-file_612 auth v4966 s=3 n(v0 rc2023-10-03T19:16:08.256841+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d59c100] 2023-10-03T19:21:05.214 INFO:teuthology.orchestra.run.smithi045.stdout: -1487> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000459) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.214 INFO:teuthology.orchestra.run.smithi045.stdout: -1486> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000045a [2,head] /dc-dir/dc-file_613 auth v4968 s=3 n(v0 rc2023-10-03T19:16:08.268321+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d59c680] 2023-10-03T19:21:05.214 INFO:teuthology.orchestra.run.smithi045.stdout: -1485> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000045a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.214 INFO:teuthology.orchestra.run.smithi045.stdout: -1484> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000045b [2,head] /dc-dir/dc-file_614 auth v4970 s=3 n(v0 rc2023-10-03T19:16:08.280172+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d59cc00] 2023-10-03T19:21:05.214 INFO:teuthology.orchestra.run.smithi045.stdout: -1483> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000045b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.279 INFO:teuthology.orchestra.run.smithi045.stdout: -1482> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000045c [2,head] /dc-dir/dc-file_615 auth v4972 s=3 n(v0 rc2023-10-03T19:16:08.292975+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d59d180] 2023-10-03T19:21:05.279 INFO:teuthology.orchestra.run.smithi045.stdout: -1481> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000045c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.280 INFO:teuthology.orchestra.run.smithi045.stdout: -1480> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000045d [2,head] /dc-dir/dc-file_616 auth v4974 s=3 n(v0 rc2023-10-03T19:16:08.304584+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d59d700] 2023-10-03T19:21:05.280 INFO:teuthology.orchestra.run.smithi045.stdout: -1479> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000045d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.280 INFO:teuthology.orchestra.run.smithi045.stdout: -1478> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000045e [2,head] /dc-dir/dc-file_617 auth v4976 s=3 n(v0 rc2023-10-03T19:16:08.316137+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5a8000] 2023-10-03T19:21:05.280 INFO:teuthology.orchestra.run.smithi045.stdout: -1477> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000045e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.280 INFO:teuthology.orchestra.run.smithi045.stdout: -1476> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000045f [2,head] /dc-dir/dc-file_618 auth v4978 s=3 n(v0 rc2023-10-03T19:16:08.327965+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5a8580] 2023-10-03T19:21:05.280 INFO:teuthology.orchestra.run.smithi045.stdout: -1475> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000045f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.280 INFO:teuthology.orchestra.run.smithi045.stdout: -1474> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000460 [2,head] /dc-dir/dc-file_619 auth v4980 s=3 n(v0 rc2023-10-03T19:16:08.339293+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5a8b00] 2023-10-03T19:21:05.280 INFO:teuthology.orchestra.run.smithi045.stdout: -1473> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000460) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.280 INFO:teuthology.orchestra.run.smithi045.stdout: -1472> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000461 [2,head] /dc-dir/dc-file_620 auth v4982 s=3 n(v0 rc2023-10-03T19:16:08.350658+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5a9080] 2023-10-03T19:21:05.280 INFO:teuthology.orchestra.run.smithi045.stdout: -1471> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000461) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.281 INFO:teuthology.orchestra.run.smithi045.stdout: -1470> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000462 [2,head] /dc-dir/dc-file_621 auth v4984 s=3 n(v0 rc2023-10-03T19:16:08.364006+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5a9600] 2023-10-03T19:21:05.281 INFO:teuthology.orchestra.run.smithi045.stdout: -1469> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000462) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.281 INFO:teuthology.orchestra.run.smithi045.stdout: -1468> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000463 [2,head] /dc-dir/dc-file_622 auth v4986 s=3 n(v0 rc2023-10-03T19:16:08.377226+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5a9b80] 2023-10-03T19:21:05.281 INFO:teuthology.orchestra.run.smithi045.stdout: -1467> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000463) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.281 INFO:teuthology.orchestra.run.smithi045.stdout: -1466> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000464 [2,head] /dc-dir/dc-file_623 auth v4988 s=3 n(v0 rc2023-10-03T19:16:08.388204+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5aa100] 2023-10-03T19:21:05.281 INFO:teuthology.orchestra.run.smithi045.stdout: -1465> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000464) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.281 INFO:teuthology.orchestra.run.smithi045.stdout: -1464> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000465 [2,head] /dc-dir/dc-file_624 auth v4990 s=3 n(v0 rc2023-10-03T19:16:08.400181+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5aa680] 2023-10-03T19:21:05.281 INFO:teuthology.orchestra.run.smithi045.stdout: -1463> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000465) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.281 INFO:teuthology.orchestra.run.smithi045.stdout: -1462> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000466 [2,head] /dc-dir/dc-file_625 auth v4992 s=3 n(v0 rc2023-10-03T19:16:08.411460+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5aac00] 2023-10-03T19:21:05.281 INFO:teuthology.orchestra.run.smithi045.stdout: -1461> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000466) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.281 INFO:teuthology.orchestra.run.smithi045.stdout: -1460> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000467 [2,head] /dc-dir/dc-file_626 auth v4994 s=3 n(v0 rc2023-10-03T19:16:08.423308+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5ab180] 2023-10-03T19:21:05.281 INFO:teuthology.orchestra.run.smithi045.stdout: -1459> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000467) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.282 INFO:teuthology.orchestra.run.smithi045.stdout: -1458> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000468 [2,head] /dc-dir/dc-file_627 auth v4996 s=3 n(v0 rc2023-10-03T19:16:08.435728+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5ab700] 2023-10-03T19:21:05.282 INFO:teuthology.orchestra.run.smithi045.stdout: -1457> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000468) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.282 INFO:teuthology.orchestra.run.smithi045.stdout: -1456> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000469 [2,head] /dc-dir/dc-file_628 auth v4998 s=3 n(v0 rc2023-10-03T19:16:08.450395+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5b0000] 2023-10-03T19:21:05.282 INFO:teuthology.orchestra.run.smithi045.stdout: -1455> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000469) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.282 INFO:teuthology.orchestra.run.smithi045.stdout: -1454> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000046a [2,head] /dc-dir/dc-file_629 auth v5260 s=3 n(v0 rc2023-10-03T19:16:08.556197+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5b0580] 2023-10-03T19:21:05.282 INFO:teuthology.orchestra.run.smithi045.stdout: -1453> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000046a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.282 INFO:teuthology.orchestra.run.smithi045.stdout: -1452> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000046b [2,head] /dc-dir/dc-file_630 auth v5262 s=3 n(v0 rc2023-10-03T19:16:08.630890+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5b0b00] 2023-10-03T19:21:05.282 INFO:teuthology.orchestra.run.smithi045.stdout: -1451> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000046b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.282 INFO:teuthology.orchestra.run.smithi045.stdout: -1450> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000046c [2,head] /dc-dir/dc-file_631 auth v5264 s=3 n(v0 rc2023-10-03T19:16:08.642031+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5b1080] 2023-10-03T19:21:05.282 INFO:teuthology.orchestra.run.smithi045.stdout: -1449> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000046c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.283 INFO:teuthology.orchestra.run.smithi045.stdout: -1448> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000046d [2,head] /dc-dir/dc-file_632 auth v5266 s=3 n(v0 rc2023-10-03T19:16:08.654717+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5b1600] 2023-10-03T19:21:05.283 INFO:teuthology.orchestra.run.smithi045.stdout: -1447> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000046d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.283 INFO:teuthology.orchestra.run.smithi045.stdout: -1446> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000046e [2,head] /dc-dir/dc-file_633 auth v5268 s=3 n(v0 rc2023-10-03T19:16:08.666103+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5b1b80] 2023-10-03T19:21:05.283 INFO:teuthology.orchestra.run.smithi045.stdout: -1445> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000046e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.283 INFO:teuthology.orchestra.run.smithi045.stdout: -1444> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000046f [2,head] /dc-dir/dc-file_634 auth v5270 s=3 n(v0 rc2023-10-03T19:16:08.677068+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5b2100] 2023-10-03T19:21:05.283 INFO:teuthology.orchestra.run.smithi045.stdout: -1443> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000046f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.283 INFO:teuthology.orchestra.run.smithi045.stdout: -1442> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000470 [2,head] /dc-dir/dc-file_635 auth v5272 s=3 n(v0 rc2023-10-03T19:16:08.689084+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5b2680] 2023-10-03T19:21:05.283 INFO:teuthology.orchestra.run.smithi045.stdout: -1441> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000470) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.283 INFO:teuthology.orchestra.run.smithi045.stdout: -1440> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000471 [2,head] /dc-dir/dc-file_636 auth v5274 s=3 n(v0 rc2023-10-03T19:16:08.701022+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5b2c00] 2023-10-03T19:21:05.283 INFO:teuthology.orchestra.run.smithi045.stdout: -1439> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000471) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.283 INFO:teuthology.orchestra.run.smithi045.stdout: -1438> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000472 [2,head] /dc-dir/dc-file_637 auth v5276 s=3 n(v0 rc2023-10-03T19:16:08.713078+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5b3180] 2023-10-03T19:21:05.283 INFO:teuthology.orchestra.run.smithi045.stdout: -1437> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000472) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.284 INFO:teuthology.orchestra.run.smithi045.stdout: -1436> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000473 [2,head] /dc-dir/dc-file_638 auth v5278 s=3 n(v0 rc2023-10-03T19:16:08.725343+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5b3700] 2023-10-03T19:21:05.284 INFO:teuthology.orchestra.run.smithi045.stdout: -1435> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000473) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.284 INFO:teuthology.orchestra.run.smithi045.stdout: -1434> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000474 [2,head] /dc-dir/dc-file_639 auth v5280 s=3 n(v0 rc2023-10-03T19:16:08.737134+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5d2000] 2023-10-03T19:21:05.284 INFO:teuthology.orchestra.run.smithi045.stdout: -1433> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000474) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.284 INFO:teuthology.orchestra.run.smithi045.stdout: -1432> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000475 [2,head] /dc-dir/dc-file_640 auth v5282 s=3 n(v0 rc2023-10-03T19:16:08.749544+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5d2580] 2023-10-03T19:21:05.284 INFO:teuthology.orchestra.run.smithi045.stdout: -1431> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000475) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.284 INFO:teuthology.orchestra.run.smithi045.stdout: -1430> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000476 [2,head] /dc-dir/dc-file_641 auth v5284 s=3 n(v0 rc2023-10-03T19:16:08.763200+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5d2b00] 2023-10-03T19:21:05.284 INFO:teuthology.orchestra.run.smithi045.stdout: -1429> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000476) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.284 INFO:teuthology.orchestra.run.smithi045.stdout: -1428> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000477 [2,head] /dc-dir/dc-file_642 auth v5286 s=3 n(v0 rc2023-10-03T19:16:08.780151+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5d3080] 2023-10-03T19:21:05.284 INFO:teuthology.orchestra.run.smithi045.stdout: -1427> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000477) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.284 INFO:teuthology.orchestra.run.smithi045.stdout: -1426> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000478 [2,head] /dc-dir/dc-file_643 auth v5288 s=3 n(v0 rc2023-10-03T19:16:08.792625+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5d3600] 2023-10-03T19:21:05.284 INFO:teuthology.orchestra.run.smithi045.stdout: -1425> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000478) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.285 INFO:teuthology.orchestra.run.smithi045.stdout: -1424> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000479 [2,head] /dc-dir/dc-file_644 auth v5290 s=3 n(v0 rc2023-10-03T19:16:08.804184+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5d3b80] 2023-10-03T19:21:05.285 INFO:teuthology.orchestra.run.smithi045.stdout: -1423> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000479) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.296 INFO:teuthology.orchestra.run.smithi045.stdout: -1422> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000047a [2,head] /dc-dir/dc-file_645 auth v5292 s=3 n(v0 rc2023-10-03T19:16:08.815629+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5d4100] 2023-10-03T19:21:05.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1421> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000047a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1420> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000047b [2,head] /dc-dir/dc-file_646 auth v5294 s=3 n(v0 rc2023-10-03T19:16:08.827997+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5d4680] 2023-10-03T19:21:05.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1419> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000047b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1418> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000047c [2,head] /dc-dir/dc-file_647 auth v5296 s=3 n(v0 rc2023-10-03T19:16:08.840583+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5d4c00] 2023-10-03T19:21:05.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1417> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000047c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1416> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000047d [2,head] /dc-dir/dc-file_648 auth v5298 s=3 n(v0 rc2023-10-03T19:16:08.852503+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5d5180] 2023-10-03T19:21:05.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1415> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000047d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1414> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000047e [2,head] /dc-dir/dc-file_649 auth v5300 s=3 n(v0 rc2023-10-03T19:16:08.864930+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5d5700] 2023-10-03T19:21:05.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1413> 2023-10-03T19:16:29.354+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 107 ==== osd_op_reply(2095 1000000001b.00000000 [delete] v50'23 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1412> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000047e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1411> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000047f [2,head] /dc-dir/dc-file_650 auth v5302 s=3 n(v0 rc2023-10-03T19:16:08.876811+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d666000] 2023-10-03T19:21:05.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1410> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000047f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1409> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000480 [2,head] /dc-dir/dc-file_651 auth v5304 s=3 n(v0 rc2023-10-03T19:16:08.888657+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d666580] 2023-10-03T19:21:05.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1408> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000480) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1407> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000481 [2,head] /dc-dir/dc-file_652 auth v5306 s=3 n(v0 rc2023-10-03T19:16:08.900020+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d666b00] 2023-10-03T19:21:05.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1406> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000481) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1405> 2023-10-03T19:16:29.354+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 108 ==== osd_op_reply(2128 1000000003c.00000000 [delete] v50'24 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1404> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000482 [2,head] /dc-dir/dc-file_653 auth v5308 s=3 n(v0 rc2023-10-03T19:16:08.911331+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d667080] 2023-10-03T19:21:05.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1403> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000482) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1402> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000483 [2,head] /dc-dir/dc-file_654 auth v5310 s=3 n(v0 rc2023-10-03T19:16:08.922839+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d667600] 2023-10-03T19:21:05.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1401> 2023-10-03T19:16:29.354+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 109 ==== osd_op_reply(2139 10000000047.00000000 [delete] v50'25 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1400> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000483) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1399> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000484 [2,head] /dc-dir/dc-file_655 auth v5312 s=3 n(v0 rc2023-10-03T19:16:08.934511+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d667b80] 2023-10-03T19:21:05.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1398> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000484) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1397> 2023-10-03T19:16:29.354+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 110 ==== osd_op_reply(2168 10000000064.00000000 [delete] v50'46 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1396> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000485 [2,head] /dc-dir/dc-file_656 auth v5314 s=3 n(v0 rc2023-10-03T19:16:08.945836+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d668100] 2023-10-03T19:21:05.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1395> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000485) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1394> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000486 [2,head] /dc-dir/dc-file_657 auth v5316 s=3 n(v0 rc2023-10-03T19:16:08.956874+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d668680] 2023-10-03T19:21:05.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1393> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000486) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1392> 2023-10-03T19:16:29.354+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 111 ==== osd_op_reply(2203 10000000087.00000000 [delete] v50'26 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1391> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000487 [2,head] /dc-dir/dc-file_658 auth v5318 s=3 n(v0 rc2023-10-03T19:16:08.967686+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d668c00] 2023-10-03T19:21:05.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1390> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000487) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1389> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000488 [2,head] /dc-dir/dc-file_659 auth v5320 s=3 n(v0 rc2023-10-03T19:16:08.979865+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d669180] 2023-10-03T19:21:05.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1388> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000488) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1387> 2023-10-03T19:16:29.354+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 112 ==== osd_op_reply(2207 1000000008b.00000000 [delete] v50'27 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1386> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000489 [2,head] /dc-dir/dc-file_660 auth v5322 s=3 n(v0 rc2023-10-03T19:16:08.991084+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d669700] 2023-10-03T19:21:05.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1385> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000489) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1384> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000048a [2,head] /dc-dir/dc-file_661 auth v5324 s=3 n(v0 rc2023-10-03T19:16:09.003844+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d66e000] 2023-10-03T19:21:05.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1383> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000048a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1382> 2023-10-03T19:16:29.354+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 113 ==== osd_op_reply(2243 100000000af.00000000 [delete] v50'28 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1381> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000048b [2,head] /dc-dir/dc-file_662 auth v5326 s=3 n(v0 rc2023-10-03T19:16:09.016810+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d66e580] 2023-10-03T19:21:05.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1380> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000048b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1379> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000048c [2,head] /dc-dir/dc-file_663 auth v5328 s=3 n(v0 rc2023-10-03T19:16:09.028233+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d66eb00] 2023-10-03T19:21:05.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1378> 2023-10-03T19:16:29.354+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 114 ==== osd_op_reply(2381 10000000139.00000000 [delete] v50'29 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1377> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000048c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1376> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000048d [2,head] /dc-dir/dc-file_664 auth v5330 s=3 n(v0 rc2023-10-03T19:16:09.039722+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d66f080] 2023-10-03T19:21:05.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1375> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000048d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1374> 2023-10-03T19:16:29.354+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 115 ==== osd_op_reply(2246 100000000b2.00000000 [delete] v50'47 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1373> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000048e [2,head] /dc-dir/dc-file_665 auth v5332 s=3 n(v0 rc2023-10-03T19:16:09.051084+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d66f600] 2023-10-03T19:21:05.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1372> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000048e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1371> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000048f [2,head] /dc-dir/dc-file_666 auth v5334 s=3 n(v0 rc2023-10-03T19:16:09.063357+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d66fb80] 2023-10-03T19:21:05.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1370> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000048f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1369> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000490 [2,head] /dc-dir/dc-file_667 auth v5336 s=3 n(v0 rc2023-10-03T19:16:09.075580+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d670100] 2023-10-03T19:21:05.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1368> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000490) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1367> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000491 [2,head] /dc-dir/dc-file_668 auth v5338 s=3 n(v0 rc2023-10-03T19:16:09.087980+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d670680] 2023-10-03T19:21:05.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1366> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000491) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1365> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000492 [2,head] /dc-dir/dc-file_669 auth v5340 s=3 n(v0 rc2023-10-03T19:16:09.099900+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d670c00] 2023-10-03T19:21:05.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1364> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000492) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1363> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000493 [2,head] /dc-dir/dc-file_670 auth v5342 s=3 n(v0 rc2023-10-03T19:16:09.111529+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d671180] 2023-10-03T19:21:05.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1362> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000493) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1361> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000494 [2,head] /dc-dir/dc-file_671 auth v5344 s=3 n(v0 rc2023-10-03T19:16:09.123229+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d671700] 2023-10-03T19:21:05.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1360> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000494) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1359> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000495 [2,head] /dc-dir/dc-file_672 auth v5346 s=3 n(v0 rc2023-10-03T19:16:09.135166+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5ec000] 2023-10-03T19:21:05.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1358> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000495) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1357> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000496 [2,head] /dc-dir/dc-file_673 auth v5348 s=3 n(v0 rc2023-10-03T19:16:09.146989+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5ec580] 2023-10-03T19:21:05.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1356> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000496) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1355> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000497 [2,head] /dc-dir/dc-file_674 auth v5350 s=3 n(v0 rc2023-10-03T19:16:09.159653+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5ecb00] 2023-10-03T19:21:05.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1354> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000497) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.332 INFO:teuthology.orchestra.run.smithi045.stdout: -1353> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000498 [2,head] /dc-dir/dc-file_675 auth v5352 s=3 n(v0 rc2023-10-03T19:16:09.171798+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5ed080] 2023-10-03T19:21:05.332 INFO:teuthology.orchestra.run.smithi045.stdout: -1352> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000498) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.332 INFO:teuthology.orchestra.run.smithi045.stdout: -1351> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000499 [2,head] /dc-dir/dc-file_676 auth v5354 s=3 n(v0 rc2023-10-03T19:16:09.183050+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5ed600] 2023-10-03T19:21:05.332 INFO:teuthology.orchestra.run.smithi045.stdout: -1350> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000499) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.332 INFO:teuthology.orchestra.run.smithi045.stdout: -1349> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000049a [2,head] /dc-dir/dc-file_677 auth v5356 s=3 n(v0 rc2023-10-03T19:16:09.195866+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5edb80] 2023-10-03T19:21:05.332 INFO:teuthology.orchestra.run.smithi045.stdout: -1348> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000049a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.333 INFO:teuthology.orchestra.run.smithi045.stdout: -1347> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000049b [2,head] /dc-dir/dc-file_678 auth v5358 s=3 n(v0 rc2023-10-03T19:16:09.207485+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5ee100] 2023-10-03T19:21:05.333 INFO:teuthology.orchestra.run.smithi045.stdout: -1346> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000049b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.333 INFO:teuthology.orchestra.run.smithi045.stdout: -1345> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000049c [2,head] /dc-dir/dc-file_679 auth v5360 s=3 n(v0 rc2023-10-03T19:16:09.219235+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5ee680] 2023-10-03T19:21:05.333 INFO:teuthology.orchestra.run.smithi045.stdout: -1344> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000049c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.333 INFO:teuthology.orchestra.run.smithi045.stdout: -1343> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000049d [2,head] /dc-dir/dc-file_680 auth v5362 s=3 n(v0 rc2023-10-03T19:16:09.231107+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5eec00] 2023-10-03T19:21:05.333 INFO:teuthology.orchestra.run.smithi045.stdout: -1342> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000049d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.333 INFO:teuthology.orchestra.run.smithi045.stdout: -1341> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000049e [2,head] /dc-dir/dc-file_681 auth v5364 s=3 n(v0 rc2023-10-03T19:16:09.243171+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5ef180] 2023-10-03T19:21:05.333 INFO:teuthology.orchestra.run.smithi045.stdout: -1340> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000049e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.333 INFO:teuthology.orchestra.run.smithi045.stdout: -1339> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000049f [2,head] /dc-dir/dc-file_682 auth v5366 s=3 n(v0 rc2023-10-03T19:16:09.254951+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5ef700] 2023-10-03T19:21:05.333 INFO:teuthology.orchestra.run.smithi045.stdout: -1338> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000049f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.333 INFO:teuthology.orchestra.run.smithi045.stdout: -1337> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004a0 [2,head] /dc-dir/dc-file_683 auth v5368 s=3 n(v0 rc2023-10-03T19:16:09.267306+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5f6000] 2023-10-03T19:21:05.334 INFO:teuthology.orchestra.run.smithi045.stdout: -1336> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004a0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.334 INFO:teuthology.orchestra.run.smithi045.stdout: -1335> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004a1 [2,head] /dc-dir/dc-file_684 auth v5370 s=3 n(v0 rc2023-10-03T19:16:09.279440+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5f6580] 2023-10-03T19:21:05.334 INFO:teuthology.orchestra.run.smithi045.stdout: -1334> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004a1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.334 INFO:teuthology.orchestra.run.smithi045.stdout: -1333> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004a2 [2,head] /dc-dir/dc-file_685 auth v5372 s=3 n(v0 rc2023-10-03T19:16:09.291930+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5f6b00] 2023-10-03T19:21:05.334 INFO:teuthology.orchestra.run.smithi045.stdout: -1332> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004a2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.334 INFO:teuthology.orchestra.run.smithi045.stdout: -1331> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004a3 [2,head] /dc-dir/dc-file_686 auth v5374 s=3 n(v0 rc2023-10-03T19:16:09.303946+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5f7080] 2023-10-03T19:21:05.334 INFO:teuthology.orchestra.run.smithi045.stdout: -1330> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004a3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.334 INFO:teuthology.orchestra.run.smithi045.stdout: -1329> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004a4 [2,head] /dc-dir/dc-file_687 auth v5376 s=3 n(v0 rc2023-10-03T19:16:09.315088+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5f7600] 2023-10-03T19:21:05.334 INFO:teuthology.orchestra.run.smithi045.stdout: -1328> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004a4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.334 INFO:teuthology.orchestra.run.smithi045.stdout: -1327> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004a5 [2,head] /dc-dir/dc-file_688 auth v5378 s=3 n(v0 rc2023-10-03T19:16:09.326223+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5f7b80] 2023-10-03T19:21:05.334 INFO:teuthology.orchestra.run.smithi045.stdout: -1326> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004a5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.335 INFO:teuthology.orchestra.run.smithi045.stdout: -1325> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004a6 [2,head] /dc-dir/dc-file_689 auth v5380 s=3 n(v0 rc2023-10-03T19:16:09.337411+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5f8100] 2023-10-03T19:21:05.335 INFO:teuthology.orchestra.run.smithi045.stdout: -1324> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004a6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.335 INFO:teuthology.orchestra.run.smithi045.stdout: -1323> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004a7 [2,head] /dc-dir/dc-file_690 auth v5382 s=3 n(v0 rc2023-10-03T19:16:09.348941+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5f8680] 2023-10-03T19:21:05.335 INFO:teuthology.orchestra.run.smithi045.stdout: -1322> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004a7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.335 INFO:teuthology.orchestra.run.smithi045.stdout: -1321> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004a8 [2,head] /dc-dir/dc-file_691 auth v5384 s=3 n(v0 rc2023-10-03T19:16:09.359950+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5f8c00] 2023-10-03T19:21:05.335 INFO:teuthology.orchestra.run.smithi045.stdout: -1320> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004a8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.335 INFO:teuthology.orchestra.run.smithi045.stdout: -1319> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004a9 [2,head] /dc-dir/dc-file_692 auth v5386 s=3 n(v0 rc2023-10-03T19:16:09.371731+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5f9180] 2023-10-03T19:21:05.335 INFO:teuthology.orchestra.run.smithi045.stdout: -1318> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004a9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.335 INFO:teuthology.orchestra.run.smithi045.stdout: -1317> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004aa [2,head] /dc-dir/dc-file_693 auth v5388 s=3 n(v0 rc2023-10-03T19:16:09.383152+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d5f9700] 2023-10-03T19:21:05.335 INFO:teuthology.orchestra.run.smithi045.stdout: -1316> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004aa) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.335 INFO:teuthology.orchestra.run.smithi045.stdout: -1315> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ab [2,head] /dc-dir/dc-file_694 auth v5390 s=3 n(v0 rc2023-10-03T19:16:09.394444+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d602000] 2023-10-03T19:21:05.336 INFO:teuthology.orchestra.run.smithi045.stdout: -1314> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004ab) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.336 INFO:teuthology.orchestra.run.smithi045.stdout: -1313> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ac [2,head] /dc-dir/dc-file_695 auth v5392 s=3 n(v0 rc2023-10-03T19:16:09.405767+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d602580] 2023-10-03T19:21:05.336 INFO:teuthology.orchestra.run.smithi045.stdout: -1312> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004ac) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.336 INFO:teuthology.orchestra.run.smithi045.stdout: -1311> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ad [2,head] /dc-dir/dc-file_696 auth v5394 s=3 n(v0 rc2023-10-03T19:16:09.417533+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d602b00] 2023-10-03T19:21:05.336 INFO:teuthology.orchestra.run.smithi045.stdout: -1310> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004ad) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.336 INFO:teuthology.orchestra.run.smithi045.stdout: -1309> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ae [2,head] /dc-dir/dc-file_697 auth v5396 s=3 n(v0 rc2023-10-03T19:16:09.430135+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d603080] 2023-10-03T19:21:05.336 INFO:teuthology.orchestra.run.smithi045.stdout: -1308> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004ae) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.336 INFO:teuthology.orchestra.run.smithi045.stdout: -1307> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004af [2,head] /dc-dir/dc-file_698 auth v5398 s=3 n(v0 rc2023-10-03T19:16:09.442017+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d603600] 2023-10-03T19:21:05.336 INFO:teuthology.orchestra.run.smithi045.stdout: -1306> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004af) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.336 INFO:teuthology.orchestra.run.smithi045.stdout: -1305> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004b0 [2,head] /dc-dir/dc-file_699 auth v5400 s=3 n(v0 rc2023-10-03T19:16:09.455124+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d603b80] 2023-10-03T19:21:05.336 INFO:teuthology.orchestra.run.smithi045.stdout: -1304> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004b0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.336 INFO:teuthology.orchestra.run.smithi045.stdout: -1303> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004b1 [2,head] /dc-dir/dc-file_700 auth v5402 s=3 n(v0 rc2023-10-03T19:16:09.482396+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d604100] 2023-10-03T19:21:05.337 INFO:teuthology.orchestra.run.smithi045.stdout: -1302> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004b1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.337 INFO:teuthology.orchestra.run.smithi045.stdout: -1301> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004b2 [2,head] /dc-dir/dc-file_701 auth v5404 s=3 n(v0 rc2023-10-03T19:16:09.609243+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d604680] 2023-10-03T19:21:05.337 INFO:teuthology.orchestra.run.smithi045.stdout: -1300> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004b2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.337 INFO:teuthology.orchestra.run.smithi045.stdout: -1299> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004b3 [2,head] /dc-dir/dc-file_702 auth v5406 s=3 n(v0 rc2023-10-03T19:16:09.621790+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d604c00] 2023-10-03T19:21:05.337 INFO:teuthology.orchestra.run.smithi045.stdout: -1298> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004b3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.337 INFO:teuthology.orchestra.run.smithi045.stdout: -1297> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004b4 [2,head] /dc-dir/dc-file_703 auth v5408 s=3 n(v0 rc2023-10-03T19:16:09.632658+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d605180] 2023-10-03T19:21:05.337 INFO:teuthology.orchestra.run.smithi045.stdout: -1296> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004b4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.337 INFO:teuthology.orchestra.run.smithi045.stdout: -1295> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004b5 [2,head] /dc-dir/dc-file_704 auth v5410 s=3 n(v0 rc2023-10-03T19:16:09.644115+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d605700] 2023-10-03T19:21:05.337 INFO:teuthology.orchestra.run.smithi045.stdout: -1294> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004b5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.337 INFO:teuthology.orchestra.run.smithi045.stdout: -1293> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004b6 [2,head] /dc-dir/dc-file_705 auth v5412 s=3 n(v0 rc2023-10-03T19:16:09.657037+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d626000] 2023-10-03T19:21:05.337 INFO:teuthology.orchestra.run.smithi045.stdout: -1292> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004b6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.338 INFO:teuthology.orchestra.run.smithi045.stdout: -1291> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004b7 [2,head] /dc-dir/dc-file_706 auth v5414 s=3 n(v0 rc2023-10-03T19:16:09.669220+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d626580] 2023-10-03T19:21:05.338 INFO:teuthology.orchestra.run.smithi045.stdout: -1290> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004b7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.338 INFO:teuthology.orchestra.run.smithi045.stdout: -1289> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004b8 [2,head] /dc-dir/dc-file_707 auth v5416 s=3 n(v0 rc2023-10-03T19:16:09.680522+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d626b00] 2023-10-03T19:21:05.338 INFO:teuthology.orchestra.run.smithi045.stdout: -1288> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004b8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.338 INFO:teuthology.orchestra.run.smithi045.stdout: -1287> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004b9 [2,head] /dc-dir/dc-file_708 auth v5418 s=3 n(v0 rc2023-10-03T19:16:09.692132+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d627080] 2023-10-03T19:21:05.338 INFO:teuthology.orchestra.run.smithi045.stdout: -1286> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004b9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.338 INFO:teuthology.orchestra.run.smithi045.stdout: -1285> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ba [2,head] /dc-dir/dc-file_709 auth v5420 s=3 n(v0 rc2023-10-03T19:16:09.703633+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d627600] 2023-10-03T19:21:05.346 INFO:teuthology.orchestra.run.smithi045.stdout: -1284> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004ba) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.346 INFO:teuthology.orchestra.run.smithi045.stdout: -1283> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004bb [2,head] /dc-dir/dc-file_710 auth v5422 s=3 n(v0 rc2023-10-03T19:16:09.715677+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d627b80] 2023-10-03T19:21:05.346 INFO:teuthology.orchestra.run.smithi045.stdout: -1282> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004bb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.346 INFO:teuthology.orchestra.run.smithi045.stdout: -1281> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004bc [2,head] /dc-dir/dc-file_711 auth v5424 s=3 n(v0 rc2023-10-03T19:16:09.727661+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d628100] 2023-10-03T19:21:05.346 INFO:teuthology.orchestra.run.smithi045.stdout: -1280> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004bc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.347 INFO:teuthology.orchestra.run.smithi045.stdout: -1279> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004bd [2,head] /dc-dir/dc-file_712 auth v5426 s=3 n(v0 rc2023-10-03T19:16:09.739997+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d628680] 2023-10-03T19:21:05.347 INFO:teuthology.orchestra.run.smithi045.stdout: -1278> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004bd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.347 INFO:teuthology.orchestra.run.smithi045.stdout: -1277> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004be [2,head] /dc-dir/dc-file_713 auth v5428 s=3 n(v0 rc2023-10-03T19:16:09.751510+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d628c00] 2023-10-03T19:21:05.347 INFO:teuthology.orchestra.run.smithi045.stdout: -1276> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004be) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.347 INFO:teuthology.orchestra.run.smithi045.stdout: -1275> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004bf [2,head] /dc-dir/dc-file_714 auth v5430 s=3 n(v0 rc2023-10-03T19:16:09.763341+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d629180] 2023-10-03T19:21:05.347 INFO:teuthology.orchestra.run.smithi045.stdout: -1274> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004bf) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.347 INFO:teuthology.orchestra.run.smithi045.stdout: -1273> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004c0 [2,head] /dc-dir/dc-file_715 auth v5432 s=3 n(v0 rc2023-10-03T19:16:09.775858+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d629700] 2023-10-03T19:21:05.347 INFO:teuthology.orchestra.run.smithi045.stdout: -1272> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004c0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.347 INFO:teuthology.orchestra.run.smithi045.stdout: -1271> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004c1 [2,head] /dc-dir/dc-file_716 auth v5434 s=3 n(v0 rc2023-10-03T19:16:09.787876+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d630000] 2023-10-03T19:21:05.347 INFO:teuthology.orchestra.run.smithi045.stdout: -1270> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004c1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.347 INFO:teuthology.orchestra.run.smithi045.stdout: -1269> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004c2 [2,head] /dc-dir/dc-file_717 auth v5436 s=3 n(v0 rc2023-10-03T19:16:09.800440+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d630580] 2023-10-03T19:21:05.348 INFO:teuthology.orchestra.run.smithi045.stdout: -1268> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004c2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.348 INFO:teuthology.orchestra.run.smithi045.stdout: -1267> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004c3 [2,head] /dc-dir/dc-file_718 auth v5438 s=3 n(v0 rc2023-10-03T19:16:09.812211+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d630b00] 2023-10-03T19:21:05.348 INFO:teuthology.orchestra.run.smithi045.stdout: -1266> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004c3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.348 INFO:teuthology.orchestra.run.smithi045.stdout: -1265> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004c4 [2,head] /dc-dir/dc-file_719 auth v5440 s=3 n(v0 rc2023-10-03T19:16:09.823599+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d631080] 2023-10-03T19:21:05.348 INFO:teuthology.orchestra.run.smithi045.stdout: -1264> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004c4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.348 INFO:teuthology.orchestra.run.smithi045.stdout: -1263> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004c5 [2,head] /dc-dir/dc-file_720 auth v5442 s=3 n(v0 rc2023-10-03T19:16:09.836041+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d631600] 2023-10-03T19:21:05.348 INFO:teuthology.orchestra.run.smithi045.stdout: -1262> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004c5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.348 INFO:teuthology.orchestra.run.smithi045.stdout: -1261> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004c6 [2,head] /dc-dir/dc-file_721 auth v5444 s=3 n(v0 rc2023-10-03T19:16:09.848471+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d631b80] 2023-10-03T19:21:05.348 INFO:teuthology.orchestra.run.smithi045.stdout: -1260> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004c6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.348 INFO:teuthology.orchestra.run.smithi045.stdout: -1259> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004c7 [2,head] /dc-dir/dc-file_722 auth v5446 s=3 n(v0 rc2023-10-03T19:16:09.860746+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d632100] 2023-10-03T19:21:05.348 INFO:teuthology.orchestra.run.smithi045.stdout: -1258> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004c7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.348 INFO:teuthology.orchestra.run.smithi045.stdout: -1257> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004c8 [2,head] /dc-dir/dc-file_723 auth v5448 s=3 n(v0 rc2023-10-03T19:16:09.872255+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d632680] 2023-10-03T19:21:05.349 INFO:teuthology.orchestra.run.smithi045.stdout: -1256> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004c8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.349 INFO:teuthology.orchestra.run.smithi045.stdout: -1255> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004c9 [2,head] /dc-dir/dc-file_724 auth v5450 s=3 n(v0 rc2023-10-03T19:16:09.884089+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d632c00] 2023-10-03T19:21:05.349 INFO:teuthology.orchestra.run.smithi045.stdout: -1254> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004c9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.349 INFO:teuthology.orchestra.run.smithi045.stdout: -1253> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ca [2,head] /dc-dir/dc-file_725 auth v5452 s=3 n(v0 rc2023-10-03T19:16:09.896253+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d633180] 2023-10-03T19:21:05.349 INFO:teuthology.orchestra.run.smithi045.stdout: -1252> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004ca) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.349 INFO:teuthology.orchestra.run.smithi045.stdout: -1251> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004cb [2,head] /dc-dir/dc-file_726 auth v5454 s=3 n(v0 rc2023-10-03T19:16:09.908343+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d633700] 2023-10-03T19:21:05.349 INFO:teuthology.orchestra.run.smithi045.stdout: -1250> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004cb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.349 INFO:teuthology.orchestra.run.smithi045.stdout: -1249> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004cc [2,head] /dc-dir/dc-file_727 auth v5456 s=3 n(v0 rc2023-10-03T19:16:09.919921+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d634000] 2023-10-03T19:21:05.349 INFO:teuthology.orchestra.run.smithi045.stdout: -1248> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004cc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.349 INFO:teuthology.orchestra.run.smithi045.stdout: -1247> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004cd [2,head] /dc-dir/dc-file_728 auth v5458 s=3 n(v0 rc2023-10-03T19:16:09.931596+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d634580] 2023-10-03T19:21:05.349 INFO:teuthology.orchestra.run.smithi045.stdout: -1246> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004cd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.349 INFO:teuthology.orchestra.run.smithi045.stdout: -1245> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ce [2,head] /dc-dir/dc-file_729 auth v5460 s=3 n(v0 rc2023-10-03T19:16:09.945123+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d634b00] 2023-10-03T19:21:05.350 INFO:teuthology.orchestra.run.smithi045.stdout: -1244> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004ce) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.350 INFO:teuthology.orchestra.run.smithi045.stdout: -1243> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004cf [2,head] /dc-dir/dc-file_730 auth v5462 s=3 n(v0 rc2023-10-03T19:16:09.957973+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d635080] 2023-10-03T19:21:05.350 INFO:teuthology.orchestra.run.smithi045.stdout: -1242> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004cf) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.350 INFO:teuthology.orchestra.run.smithi045.stdout: -1241> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004d0 [2,head] /dc-dir/dc-file_731 auth v5464 s=3 n(v0 rc2023-10-03T19:16:09.969784+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d635600] 2023-10-03T19:21:05.350 INFO:teuthology.orchestra.run.smithi045.stdout: -1240> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004d0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.350 INFO:teuthology.orchestra.run.smithi045.stdout: -1239> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004d1 [2,head] /dc-dir/dc-file_732 auth v5466 s=3 n(v0 rc2023-10-03T19:16:09.981958+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d635b80] 2023-10-03T19:21:05.350 INFO:teuthology.orchestra.run.smithi045.stdout: -1238> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004d1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.350 INFO:teuthology.orchestra.run.smithi045.stdout: -1237> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004d2 [2,head] /dc-dir/dc-file_733 auth v5468 s=3 n(v0 rc2023-10-03T19:16:09.992971+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d636100] 2023-10-03T19:21:05.350 INFO:teuthology.orchestra.run.smithi045.stdout: -1236> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004d2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.350 INFO:teuthology.orchestra.run.smithi045.stdout: -1235> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004d3 [2,head] /dc-dir/dc-file_734 auth v5470 s=3 n(v0 rc2023-10-03T19:16:10.005223+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d636680] 2023-10-03T19:21:05.350 INFO:teuthology.orchestra.run.smithi045.stdout: -1234> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004d3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.351 INFO:teuthology.orchestra.run.smithi045.stdout: -1233> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004d4 [2,head] /dc-dir/dc-file_735 auth v5472 s=3 n(v0 rc2023-10-03T19:16:10.015849+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d636c00] 2023-10-03T19:21:05.351 INFO:teuthology.orchestra.run.smithi045.stdout: -1232> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004d4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.351 INFO:teuthology.orchestra.run.smithi045.stdout: -1231> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004d5 [2,head] /dc-dir/dc-file_736 auth v5474 s=3 n(v0 rc2023-10-03T19:16:10.026905+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d637180] 2023-10-03T19:21:05.351 INFO:teuthology.orchestra.run.smithi045.stdout: -1230> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004d5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.351 INFO:teuthology.orchestra.run.smithi045.stdout: -1229> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004d6 [2,head] /dc-dir/dc-file_737 auth v5476 s=3 n(v0 rc2023-10-03T19:16:10.036869+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d637700] 2023-10-03T19:21:05.351 INFO:teuthology.orchestra.run.smithi045.stdout: -1228> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004d6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.351 INFO:teuthology.orchestra.run.smithi045.stdout: -1227> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004d7 [2,head] /dc-dir/dc-file_738 auth v5478 s=3 n(v0 rc2023-10-03T19:16:10.047434+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d63c000] 2023-10-03T19:21:05.351 INFO:teuthology.orchestra.run.smithi045.stdout: -1226> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004d7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.351 INFO:teuthology.orchestra.run.smithi045.stdout: -1225> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004d8 [2,head] /dc-dir/dc-file_739 auth v5480 s=3 n(v0 rc2023-10-03T19:16:10.058232+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d63c580] 2023-10-03T19:21:05.351 INFO:teuthology.orchestra.run.smithi045.stdout: -1224> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004d8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.351 INFO:teuthology.orchestra.run.smithi045.stdout: -1223> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004d9 [2,head] /dc-dir/dc-file_740 auth v5482 s=3 n(v0 rc2023-10-03T19:16:10.069185+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d63cb00] 2023-10-03T19:21:05.351 INFO:teuthology.orchestra.run.smithi045.stdout: -1222> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004d9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.352 INFO:teuthology.orchestra.run.smithi045.stdout: -1221> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004da [2,head] /dc-dir/dc-file_741 auth v5484 s=3 n(v0 rc2023-10-03T19:16:10.081472+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d63d080] 2023-10-03T19:21:05.352 INFO:teuthology.orchestra.run.smithi045.stdout: -1220> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004da) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.352 INFO:teuthology.orchestra.run.smithi045.stdout: -1219> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004db [2,head] /dc-dir/dc-file_742 auth v5486 s=3 n(v0 rc2023-10-03T19:16:10.092520+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d63d600] 2023-10-03T19:21:05.352 INFO:teuthology.orchestra.run.smithi045.stdout: -1218> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004db) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.423 INFO:teuthology.orchestra.run.smithi045.stdout: -1217> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004dc [2,head] /dc-dir/dc-file_743 auth v5488 s=3 n(v0 rc2023-10-03T19:16:10.103103+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d63db80] 2023-10-03T19:21:05.423 INFO:teuthology.orchestra.run.smithi045.stdout: -1216> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004dc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.423 INFO:teuthology.orchestra.run.smithi045.stdout: -1215> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004dd [2,head] /dc-dir/dc-file_744 auth v5490 s=3 n(v0 rc2023-10-03T19:16:10.114900+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d63e100] 2023-10-03T19:21:05.423 INFO:teuthology.orchestra.run.smithi045.stdout: -1214> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004dd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.424 INFO:teuthology.orchestra.run.smithi045.stdout: -1213> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004de [2,head] /dc-dir/dc-file_745 auth v5492 s=3 n(v0 rc2023-10-03T19:16:10.125998+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d63e680] 2023-10-03T19:21:05.424 INFO:teuthology.orchestra.run.smithi045.stdout: -1212> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004de) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.424 INFO:teuthology.orchestra.run.smithi045.stdout: -1211> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004df [2,head] /dc-dir/dc-file_746 auth v5494 s=3 n(v0 rc2023-10-03T19:16:10.136626+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d63ec00] 2023-10-03T19:21:05.424 INFO:teuthology.orchestra.run.smithi045.stdout: -1210> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004df) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.424 INFO:teuthology.orchestra.run.smithi045.stdout: -1209> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004e0 [2,head] /dc-dir/dc-file_747 auth v5496 s=3 n(v0 rc2023-10-03T19:16:10.149383+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d63f180] 2023-10-03T19:21:05.424 INFO:teuthology.orchestra.run.smithi045.stdout: -1208> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004e0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.424 INFO:teuthology.orchestra.run.smithi045.stdout: -1207> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004e1 [2,head] /dc-dir/dc-file_748 auth v5498 s=3 n(v0 rc2023-10-03T19:16:10.160600+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d63f700] 2023-10-03T19:21:05.424 INFO:teuthology.orchestra.run.smithi045.stdout: -1206> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004e1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.425 INFO:teuthology.orchestra.run.smithi045.stdout: -1205> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004e2 [2,head] /dc-dir/dc-file_749 auth v5500 s=3 n(v0 rc2023-10-03T19:16:10.170987+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d646000] 2023-10-03T19:21:05.425 INFO:teuthology.orchestra.run.smithi045.stdout: -1204> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004e2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.425 INFO:teuthology.orchestra.run.smithi045.stdout: -1203> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004e3 [2,head] /dc-dir/dc-file_750 auth v5502 s=3 n(v0 rc2023-10-03T19:16:10.181475+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d646580] 2023-10-03T19:21:05.425 INFO:teuthology.orchestra.run.smithi045.stdout: -1202> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004e3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.425 INFO:teuthology.orchestra.run.smithi045.stdout: -1201> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004e4 [2,head] /dc-dir/dc-file_751 auth v5504 s=3 n(v0 rc2023-10-03T19:16:10.191401+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d646b00] 2023-10-03T19:21:05.425 INFO:teuthology.orchestra.run.smithi045.stdout: -1200> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004e4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.425 INFO:teuthology.orchestra.run.smithi045.stdout: -1199> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004e5 [2,head] /dc-dir/dc-file_752 auth v5506 s=3 n(v0 rc2023-10-03T19:16:10.201939+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d647080] 2023-10-03T19:21:05.425 INFO:teuthology.orchestra.run.smithi045.stdout: -1198> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004e5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.425 INFO:teuthology.orchestra.run.smithi045.stdout: -1197> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004e6 [2,head] /dc-dir/dc-file_753 auth v5508 s=3 n(v0 rc2023-10-03T19:16:10.212912+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d647600] 2023-10-03T19:21:05.425 INFO:teuthology.orchestra.run.smithi045.stdout: -1196> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004e6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.425 INFO:teuthology.orchestra.run.smithi045.stdout: -1195> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004e7 [2,head] /dc-dir/dc-file_754 auth v5510 s=3 n(v0 rc2023-10-03T19:16:10.223794+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d647b80] 2023-10-03T19:21:05.426 INFO:teuthology.orchestra.run.smithi045.stdout: -1194> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004e7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.426 INFO:teuthology.orchestra.run.smithi045.stdout: -1193> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004e8 [2,head] /dc-dir/dc-file_755 auth v5512 s=3 n(v0 rc2023-10-03T19:16:10.235963+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d648100] 2023-10-03T19:21:05.426 INFO:teuthology.orchestra.run.smithi045.stdout: -1192> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004e8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.426 INFO:teuthology.orchestra.run.smithi045.stdout: -1191> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004e9 [2,head] /dc-dir/dc-file_756 auth v5514 s=3 n(v0 rc2023-10-03T19:16:10.247633+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d648680] 2023-10-03T19:21:05.426 INFO:teuthology.orchestra.run.smithi045.stdout: -1190> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004e9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.426 INFO:teuthology.orchestra.run.smithi045.stdout: -1189> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ea [2,head] /dc-dir/dc-file_757 auth v5516 s=3 n(v0 rc2023-10-03T19:16:10.260265+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d648c00] 2023-10-03T19:21:05.426 INFO:teuthology.orchestra.run.smithi045.stdout: -1188> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004ea) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.426 INFO:teuthology.orchestra.run.smithi045.stdout: -1187> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004eb [2,head] /dc-dir/dc-file_758 auth v5518 s=3 n(v0 rc2023-10-03T19:16:10.271901+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d649180] 2023-10-03T19:21:05.426 INFO:teuthology.orchestra.run.smithi045.stdout: -1186> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004eb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.426 INFO:teuthology.orchestra.run.smithi045.stdout: -1185> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ec [2,head] /dc-dir/dc-file_759 auth v5520 s=3 n(v0 rc2023-10-03T19:16:10.284560+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d649700] 2023-10-03T19:21:05.427 INFO:teuthology.orchestra.run.smithi045.stdout: -1184> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004ec) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.427 INFO:teuthology.orchestra.run.smithi045.stdout: -1183> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ed [2,head] /dc-dir/dc-file_760 auth v5522 s=3 n(v0 rc2023-10-03T19:16:10.296438+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d650000] 2023-10-03T19:21:05.427 INFO:teuthology.orchestra.run.smithi045.stdout: -1182> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004ed) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.427 INFO:teuthology.orchestra.run.smithi045.stdout: -1181> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ee [2,head] /dc-dir/dc-file_761 auth v5524 s=3 n(v0 rc2023-10-03T19:16:10.307620+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d650580] 2023-10-03T19:21:05.427 INFO:teuthology.orchestra.run.smithi045.stdout: -1180> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004ee) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.427 INFO:teuthology.orchestra.run.smithi045.stdout: -1179> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ef [2,head] /dc-dir/dc-file_762 auth v5526 s=3 n(v0 rc2023-10-03T19:16:10.318900+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d650b00] 2023-10-03T19:21:05.427 INFO:teuthology.orchestra.run.smithi045.stdout: -1178> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004ef) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.427 INFO:teuthology.orchestra.run.smithi045.stdout: -1177> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004f0 [2,head] /dc-dir/dc-file_763 auth v5528 s=3 n(v0 rc2023-10-03T19:16:10.330849+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d651080] 2023-10-03T19:21:05.427 INFO:teuthology.orchestra.run.smithi045.stdout: -1176> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004f0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.427 INFO:teuthology.orchestra.run.smithi045.stdout: -1175> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004f1 [2,head] /dc-dir/dc-file_764 auth v5530 s=3 n(v0 rc2023-10-03T19:16:10.342546+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d651600] 2023-10-03T19:21:05.427 INFO:teuthology.orchestra.run.smithi045.stdout: -1174> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004f1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.428 INFO:teuthology.orchestra.run.smithi045.stdout: -1173> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004f2 [2,head] /dc-dir/dc-file_765 auth v5532 s=3 n(v0 rc2023-10-03T19:16:10.356015+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d651b80] 2023-10-03T19:21:05.428 INFO:teuthology.orchestra.run.smithi045.stdout: -1172> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004f2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.428 INFO:teuthology.orchestra.run.smithi045.stdout: -1171> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004f3 [2,head] /dc-dir/dc-file_766 auth v5534 s=3 n(v0 rc2023-10-03T19:16:10.370865+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d652100] 2023-10-03T19:21:05.428 INFO:teuthology.orchestra.run.smithi045.stdout: -1170> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004f3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.428 INFO:teuthology.orchestra.run.smithi045.stdout: -1169> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004f4 [2,head] /dc-dir/dc-file_767 auth v5536 s=3 n(v0 rc2023-10-03T19:16:10.384070+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d652680] 2023-10-03T19:21:05.428 INFO:teuthology.orchestra.run.smithi045.stdout: -1168> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004f4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.428 INFO:teuthology.orchestra.run.smithi045.stdout: -1167> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004f5 [2,head] /dc-dir/dc-file_768 auth v5538 s=3 n(v0 rc2023-10-03T19:16:10.395991+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d652c00] 2023-10-03T19:21:05.428 INFO:teuthology.orchestra.run.smithi045.stdout: -1166> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004f5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.428 INFO:teuthology.orchestra.run.smithi045.stdout: -1165> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004f6 [2,head] /dc-dir/dc-file_769 auth v5540 s=3 n(v0 rc2023-10-03T19:16:10.407816+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d653180] 2023-10-03T19:21:05.428 INFO:teuthology.orchestra.run.smithi045.stdout: -1164> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004f6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.428 INFO:teuthology.orchestra.run.smithi045.stdout: -1163> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004f7 [2,head] /dc-dir/dc-file_770 auth v5542 s=3 n(v0 rc2023-10-03T19:16:10.420739+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d653700] 2023-10-03T19:21:05.428 INFO:teuthology.orchestra.run.smithi045.stdout: -1162> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004f7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.429 INFO:teuthology.orchestra.run.smithi045.stdout: -1161> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004f8 [2,head] /dc-dir/dc-file_771 auth v5544 s=3 n(v0 rc2023-10-03T19:16:10.432200+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d65a000] 2023-10-03T19:21:05.429 INFO:teuthology.orchestra.run.smithi045.stdout: -1160> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004f8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.429 INFO:teuthology.orchestra.run.smithi045.stdout: -1159> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004f9 [2,head] /dc-dir/dc-file_772 auth v5546 s=3 n(v0 rc2023-10-03T19:16:10.443952+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d65a580] 2023-10-03T19:21:05.429 INFO:teuthology.orchestra.run.smithi045.stdout: -1158> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004f9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.452 INFO:teuthology.orchestra.run.smithi045.stdout: -1157> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004fa [2,head] /dc-dir/dc-file_773 auth v5548 s=3 n(v0 rc2023-10-03T19:16:10.455677+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d65ab00] 2023-10-03T19:21:05.452 INFO:teuthology.orchestra.run.smithi045.stdout: -1156> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004fa) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.452 INFO:teuthology.orchestra.run.smithi045.stdout: -1155> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004fb [2,head] /dc-dir/dc-file_774 auth v5550 s=3 n(v0 rc2023-10-03T19:16:10.467483+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d65b080] 2023-10-03T19:21:05.452 INFO:teuthology.orchestra.run.smithi045.stdout: -1154> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004fb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.452 INFO:teuthology.orchestra.run.smithi045.stdout: -1153> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004fc [2,head] /dc-dir/dc-file_775 auth v5552 s=3 n(v0 rc2023-10-03T19:16:10.479435+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55576d65b600] 2023-10-03T19:21:05.452 INFO:teuthology.orchestra.run.smithi045.stdout: -1152> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004fc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.452 INFO:teuthology.orchestra.run.smithi045.stdout: -1151> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004fd [2,head] /dc-dir/dc-file_776 auth v5554 s=3 n(v0 rc2023-10-03T19:16:10.570016+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d65bb80] 2023-10-03T19:21:05.453 INFO:teuthology.orchestra.run.smithi045.stdout: -1150> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004fd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.453 INFO:teuthology.orchestra.run.smithi045.stdout: -1149> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004fe [2,head] /dc-dir/dc-file_777 auth v5556 s=3 n(v0 rc2023-10-03T19:16:10.616240+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d65c100] 2023-10-03T19:21:05.453 INFO:teuthology.orchestra.run.smithi045.stdout: -1148> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004fe) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.453 INFO:teuthology.orchestra.run.smithi045.stdout: -1147> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ff [2,head] /dc-dir/dc-file_778 auth v5558 s=3 n(v0 rc2023-10-03T19:16:10.628650+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d65c680] 2023-10-03T19:21:05.453 INFO:teuthology.orchestra.run.smithi045.stdout: -1146> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000004ff) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.453 INFO:teuthology.orchestra.run.smithi045.stdout: -1145> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000500 [2,head] /dc-dir/dc-file_779 auth v5560 s=3 n(v0 rc2023-10-03T19:16:10.640234+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d65cc00] 2023-10-03T19:21:05.453 INFO:teuthology.orchestra.run.smithi045.stdout: -1144> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000500) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.453 INFO:teuthology.orchestra.run.smithi045.stdout: -1143> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000501 [2,head] /dc-dir/dc-file_780 auth v5562 s=3 n(v0 rc2023-10-03T19:16:10.652296+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d65d180] 2023-10-03T19:21:05.453 INFO:teuthology.orchestra.run.smithi045.stdout: -1142> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000501) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.453 INFO:teuthology.orchestra.run.smithi045.stdout: -1141> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000502 [2,head] /dc-dir/dc-file_781 auth v5564 s=3 n(v0 rc2023-10-03T19:16:10.665109+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d65d700] 2023-10-03T19:21:05.453 INFO:teuthology.orchestra.run.smithi045.stdout: -1140> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000502) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.453 INFO:teuthology.orchestra.run.smithi045.stdout: -1139> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000503 [2,head] /dc-dir/dc-file_782 auth v5566 s=3 n(v0 rc2023-10-03T19:16:10.676516+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6aa000] 2023-10-03T19:21:05.454 INFO:teuthology.orchestra.run.smithi045.stdout: -1138> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000503) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.454 INFO:teuthology.orchestra.run.smithi045.stdout: -1137> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000504 [2,head] /dc-dir/dc-file_783 auth v5568 s=3 n(v0 rc2023-10-03T19:16:10.687824+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6aa580] 2023-10-03T19:21:05.454 INFO:teuthology.orchestra.run.smithi045.stdout: -1136> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000504) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.454 INFO:teuthology.orchestra.run.smithi045.stdout: -1135> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000505 [2,head] /dc-dir/dc-file_784 auth v5570 s=3 n(v0 rc2023-10-03T19:16:10.700339+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6aab00] 2023-10-03T19:21:05.454 INFO:teuthology.orchestra.run.smithi045.stdout: -1134> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000505) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.454 INFO:teuthology.orchestra.run.smithi045.stdout: -1133> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000506 [2,head] /dc-dir/dc-file_785 auth v5572 s=3 n(v0 rc2023-10-03T19:16:10.712207+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6ab080] 2023-10-03T19:21:05.454 INFO:teuthology.orchestra.run.smithi045.stdout: -1132> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000506) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.454 INFO:teuthology.orchestra.run.smithi045.stdout: -1131> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000507 [2,head] /dc-dir/dc-file_786 auth v5574 s=3 n(v0 rc2023-10-03T19:16:10.723953+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6ab600] 2023-10-03T19:21:05.454 INFO:teuthology.orchestra.run.smithi045.stdout: -1130> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000507) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.454 INFO:teuthology.orchestra.run.smithi045.stdout: -1129> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000508 [2,head] /dc-dir/dc-file_787 auth v5576 s=3 n(v0 rc2023-10-03T19:16:10.736107+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6abb80] 2023-10-03T19:21:05.455 INFO:teuthology.orchestra.run.smithi045.stdout: -1128> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000508) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.455 INFO:teuthology.orchestra.run.smithi045.stdout: -1127> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000509 [2,head] /dc-dir/dc-file_788 auth v5578 s=3 n(v0 rc2023-10-03T19:16:10.749154+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6ac100] 2023-10-03T19:21:05.455 INFO:teuthology.orchestra.run.smithi045.stdout: -1126> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000509) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.455 INFO:teuthology.orchestra.run.smithi045.stdout: -1125> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000050a [2,head] /dc-dir/dc-file_789 auth v5580 s=3 n(v0 rc2023-10-03T19:16:10.760773+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6ac680] 2023-10-03T19:21:05.455 INFO:teuthology.orchestra.run.smithi045.stdout: -1124> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000050a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.455 INFO:teuthology.orchestra.run.smithi045.stdout: -1123> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000050b [2,head] /dc-dir/dc-file_790 auth v5582 s=3 n(v0 rc2023-10-03T19:16:10.772976+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6acc00] 2023-10-03T19:21:05.455 INFO:teuthology.orchestra.run.smithi045.stdout: -1122> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000050b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.455 INFO:teuthology.orchestra.run.smithi045.stdout: -1121> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000050c [2,head] /dc-dir/dc-file_791 auth v5584 s=3 n(v0 rc2023-10-03T19:16:10.785495+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6ad180] 2023-10-03T19:21:05.455 INFO:teuthology.orchestra.run.smithi045.stdout: -1120> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000050c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.455 INFO:teuthology.orchestra.run.smithi045.stdout: -1119> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000050d [2,head] /dc-dir/dc-file_792 auth v5586 s=3 n(v0 rc2023-10-03T19:16:10.798397+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6ad700] 2023-10-03T19:21:05.455 INFO:teuthology.orchestra.run.smithi045.stdout: -1118> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000050d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.455 INFO:teuthology.orchestra.run.smithi045.stdout: -1117> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000050e [2,head] /dc-dir/dc-file_793 auth v5588 s=3 n(v0 rc2023-10-03T19:16:10.811907+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6b0000] 2023-10-03T19:21:05.456 INFO:teuthology.orchestra.run.smithi045.stdout: -1116> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000050e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.456 INFO:teuthology.orchestra.run.smithi045.stdout: -1115> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000050f [2,head] /dc-dir/dc-file_794 auth v5590 s=3 n(v0 rc2023-10-03T19:16:10.823592+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6b0580] 2023-10-03T19:21:05.456 INFO:teuthology.orchestra.run.smithi045.stdout: -1114> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000050f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.456 INFO:teuthology.orchestra.run.smithi045.stdout: -1113> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000510 [2,head] /dc-dir/dc-file_795 auth v5592 s=3 n(v0 rc2023-10-03T19:16:10.835069+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6b0b00] 2023-10-03T19:21:05.456 INFO:teuthology.orchestra.run.smithi045.stdout: -1112> 2023-10-03T19:16:29.354+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 116 ==== osd_op_reply(2149 10000000051.00000000 [delete] v50'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.456 INFO:teuthology.orchestra.run.smithi045.stdout: -1111> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000510) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.456 INFO:teuthology.orchestra.run.smithi045.stdout: -1110> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000511 [2,head] /dc-dir/dc-file_796 auth v5594 s=3 n(v0 rc2023-10-03T19:16:10.848322+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6b1080] 2023-10-03T19:21:05.456 INFO:teuthology.orchestra.run.smithi045.stdout: -1109> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000511) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.456 INFO:teuthology.orchestra.run.smithi045.stdout: -1108> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000512 [2,head] /dc-dir/dc-file_797 auth v5596 s=3 n(v0 rc2023-10-03T19:16:10.859897+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6b1600] 2023-10-03T19:21:05.456 INFO:teuthology.orchestra.run.smithi045.stdout: -1107> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000512) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.456 INFO:teuthology.orchestra.run.smithi045.stdout: -1106> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000513 [2,head] /dc-dir/dc-file_798 auth v5598 s=3 n(v0 rc2023-10-03T19:16:10.872710+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6b1b80] 2023-10-03T19:21:05.457 INFO:teuthology.orchestra.run.smithi045.stdout: -1105> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000513) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.457 INFO:teuthology.orchestra.run.smithi045.stdout: -1104> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000514 [2,head] /dc-dir/dc-file_799 auth v5600 s=3 n(v0 rc2023-10-03T19:16:10.884717+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6b2100] 2023-10-03T19:21:05.457 INFO:teuthology.orchestra.run.smithi045.stdout: -1103> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000514) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.457 INFO:teuthology.orchestra.run.smithi045.stdout: -1102> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000515 [2,head] /dc-dir/dc-file_800 auth v5602 s=3 n(v0 rc2023-10-03T19:16:10.896866+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6b2680] 2023-10-03T19:21:05.457 INFO:teuthology.orchestra.run.smithi045.stdout: -1101> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000515) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.457 INFO:teuthology.orchestra.run.smithi045.stdout: -1100> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000516 [2,head] /dc-dir/dc-file_801 auth v5604 s=3 n(v0 rc2023-10-03T19:16:10.908762+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6b2c00] 2023-10-03T19:21:05.457 INFO:teuthology.orchestra.run.smithi045.stdout: -1099> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000516) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.457 INFO:teuthology.orchestra.run.smithi045.stdout: -1098> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000517 [2,head] /dc-dir/dc-file_802 auth v5606 s=3 n(v0 rc2023-10-03T19:16:10.920592+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6b3180] 2023-10-03T19:21:05.457 INFO:teuthology.orchestra.run.smithi045.stdout: -1097> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000517) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.457 INFO:teuthology.orchestra.run.smithi045.stdout: -1096> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000518 [2,head] /dc-dir/dc-file_803 auth v5608 s=3 n(v0 rc2023-10-03T19:16:10.932559+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6b3700] 2023-10-03T19:21:05.457 INFO:teuthology.orchestra.run.smithi045.stdout: -1095> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000518) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.458 INFO:teuthology.orchestra.run.smithi045.stdout: -1094> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000519 [2,head] /dc-dir/dc-file_804 auth v5610 s=3 n(v0 rc2023-10-03T19:16:10.944266+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6bc000] 2023-10-03T19:21:05.458 INFO:teuthology.orchestra.run.smithi045.stdout: -1093> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000519) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.458 INFO:teuthology.orchestra.run.smithi045.stdout: -1092> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000051a [2,head] /dc-dir/dc-file_805 auth v5612 s=3 n(v0 rc2023-10-03T19:16:10.956944+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6bc580] 2023-10-03T19:21:05.458 INFO:teuthology.orchestra.run.smithi045.stdout: -1091> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000051a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.458 INFO:teuthology.orchestra.run.smithi045.stdout: -1090> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000051b [2,head] /dc-dir/dc-file_806 auth v5614 s=3 n(v0 rc2023-10-03T19:16:10.968941+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6bcb00] 2023-10-03T19:21:05.488 INFO:teuthology.orchestra.run.smithi045.stdout: -1089> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000051b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.489 INFO:teuthology.orchestra.run.smithi045.stdout: -1088> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000051c [2,head] /dc-dir/dc-file_807 auth v5616 s=3 n(v0 rc2023-10-03T19:16:10.981450+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6bd080] 2023-10-03T19:21:05.489 INFO:teuthology.orchestra.run.smithi045.stdout: -1087> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000051c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.489 INFO:teuthology.orchestra.run.smithi045.stdout: -1086> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000051d [2,head] /dc-dir/dc-file_808 auth v5618 s=3 n(v0 rc2023-10-03T19:16:10.994441+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6bd600] 2023-10-03T19:21:05.489 INFO:teuthology.orchestra.run.smithi045.stdout: -1085> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000051d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.489 INFO:teuthology.orchestra.run.smithi045.stdout: -1084> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000051e [2,head] /dc-dir/dc-file_809 auth v5620 s=3 n(v0 rc2023-10-03T19:16:11.007056+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6bdb80] 2023-10-03T19:21:05.489 INFO:teuthology.orchestra.run.smithi045.stdout: -1083> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000051e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.489 INFO:teuthology.orchestra.run.smithi045.stdout: -1082> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000051f [2,head] /dc-dir/dc-file_810 auth v5622 s=3 n(v0 rc2023-10-03T19:16:11.019270+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6be100] 2023-10-03T19:21:05.489 INFO:teuthology.orchestra.run.smithi045.stdout: -1081> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000051f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.489 INFO:teuthology.orchestra.run.smithi045.stdout: -1080> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000520 [2,head] /dc-dir/dc-file_811 auth v5624 s=3 n(v0 rc2023-10-03T19:16:11.031590+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6be680] 2023-10-03T19:21:05.489 INFO:teuthology.orchestra.run.smithi045.stdout: -1079> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000520) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.489 INFO:teuthology.orchestra.run.smithi045.stdout: -1078> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000521 [2,head] /dc-dir/dc-file_812 auth v5626 s=3 n(v0 rc2023-10-03T19:16:11.043731+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6bec00] 2023-10-03T19:21:05.490 INFO:teuthology.orchestra.run.smithi045.stdout: -1077> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000521) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.490 INFO:teuthology.orchestra.run.smithi045.stdout: -1076> 2023-10-03T19:16:29.354+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000522 [2,head] /dc-dir/dc-file_813 auth v5628 s=3 n(v0 rc2023-10-03T19:16:11.055611+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6bf180] 2023-10-03T19:21:05.490 INFO:teuthology.orchestra.run.smithi045.stdout: -1075> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000522) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.490 INFO:teuthology.orchestra.run.smithi045.stdout: -1074> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000523 [2,head] /dc-dir/dc-file_814 auth v5630 s=3 n(v0 rc2023-10-03T19:16:11.067921+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6bf700] 2023-10-03T19:21:05.490 INFO:teuthology.orchestra.run.smithi045.stdout: -1073> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000523) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.490 INFO:teuthology.orchestra.run.smithi045.stdout: -1072> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000524 [2,head] /dc-dir/dc-file_815 auth v5632 s=3 n(v0 rc2023-10-03T19:16:11.079518+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6c4000] 2023-10-03T19:21:05.490 INFO:teuthology.orchestra.run.smithi045.stdout: -1071> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000524) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.490 INFO:teuthology.orchestra.run.smithi045.stdout: -1070> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000525 [2,head] /dc-dir/dc-file_816 auth v5634 s=3 n(v0 rc2023-10-03T19:16:11.091954+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6c4580] 2023-10-03T19:21:05.490 INFO:teuthology.orchestra.run.smithi045.stdout: -1069> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000525) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.490 INFO:teuthology.orchestra.run.smithi045.stdout: -1068> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000526 [2,head] /dc-dir/dc-file_817 auth v5636 s=3 n(v0 rc2023-10-03T19:16:11.103458+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6c4b00] 2023-10-03T19:21:05.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1067> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000526) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1066> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000527 [2,head] /dc-dir/dc-file_818 auth v5638 s=3 n(v0 rc2023-10-03T19:16:11.114989+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6c5080] 2023-10-03T19:21:05.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1065> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000527) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1064> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000528 [2,head] /dc-dir/dc-file_819 auth v5640 s=3 n(v0 rc2023-10-03T19:16:11.126112+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6c5600] 2023-10-03T19:21:05.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1063> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000528) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1062> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000529 [2,head] /dc-dir/dc-file_820 auth v5642 s=3 n(v0 rc2023-10-03T19:16:11.138416+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6c5b80] 2023-10-03T19:21:05.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1061> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000529) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1060> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000052a [2,head] /dc-dir/dc-file_821 auth v5644 s=3 n(v0 rc2023-10-03T19:16:11.152448+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6c6100] 2023-10-03T19:21:05.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1059> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000052a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1058> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000052b [2,head] /dc-dir/dc-file_822 auth v5646 s=3 n(v0 rc2023-10-03T19:16:11.166160+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6c6680] 2023-10-03T19:21:05.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1057> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000052b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1056> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000052c [2,head] /dc-dir/dc-file_823 auth v5648 s=3 n(v0 rc2023-10-03T19:16:11.181422+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6c6c00] 2023-10-03T19:21:05.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1055> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000052c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1054> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000052d [2,head] /dc-dir/dc-file_824 auth v5650 s=3 n(v0 rc2023-10-03T19:16:11.196046+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6c7180] 2023-10-03T19:21:05.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1053> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000052d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1052> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000052e [2,head] /dc-dir/dc-file_825 auth v5652 s=3 n(v0 rc2023-10-03T19:16:11.207573+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6c7700] 2023-10-03T19:21:05.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1051> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000052e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1050> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000052f [2,head] /dc-dir/dc-file_826 auth v5654 s=3 n(v0 rc2023-10-03T19:16:11.219917+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6cc000] 2023-10-03T19:21:05.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1049> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000052f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1048> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000530 [2,head] /dc-dir/dc-file_827 auth v5656 s=3 n(v0 rc2023-10-03T19:16:11.232165+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6cc580] 2023-10-03T19:21:05.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1047> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000530) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1046> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000531 [2,head] /dc-dir/dc-file_828 auth v5658 s=3 n(v0 rc2023-10-03T19:16:11.244013+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6ccb00] 2023-10-03T19:21:05.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1045> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000531) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1044> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000532 [2,head] /dc-dir/dc-file_829 auth v5660 s=3 n(v0 rc2023-10-03T19:16:11.256008+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6cd080] 2023-10-03T19:21:05.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1043> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000532) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1042> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000533 [2,head] /dc-dir/dc-file_830 auth v5662 s=3 n(v0 rc2023-10-03T19:16:11.268635+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6cd600] 2023-10-03T19:21:05.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1041> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000533) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1040> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000534 [2,head] /dc-dir/dc-file_831 auth v5664 s=3 n(v0 rc2023-10-03T19:16:11.280602+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6cdb80] 2023-10-03T19:21:05.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1039> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000534) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1038> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000535 [2,head] /dc-dir/dc-file_832 auth v5666 s=3 n(v0 rc2023-10-03T19:16:11.292142+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6ce100] 2023-10-03T19:21:05.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1037> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000535) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1036> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000536 [2,head] /dc-dir/dc-file_833 auth v5668 s=3 n(v0 rc2023-10-03T19:16:11.304306+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6ce680] 2023-10-03T19:21:05.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1035> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000536) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1034> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000537 [2,head] /dc-dir/dc-file_834 auth v5670 s=3 n(v0 rc2023-10-03T19:16:11.316389+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6cec00] 2023-10-03T19:21:05.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1033> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000537) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1032> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000538 [2,head] /dc-dir/dc-file_835 auth v5672 s=3 n(v0 rc2023-10-03T19:16:11.328728+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6cf180] 2023-10-03T19:21:05.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1031> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000538) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1030> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000539 [2,head] /dc-dir/dc-file_836 auth v5674 s=3 n(v0 rc2023-10-03T19:16:11.341069+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6cf700] 2023-10-03T19:21:05.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1029> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000539) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1028> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000053a [2,head] /dc-dir/dc-file_837 auth v5676 s=3 n(v0 rc2023-10-03T19:16:11.353385+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6d8000] 2023-10-03T19:21:05.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1027> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000053a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1026> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000053b [2,head] /dc-dir/dc-file_838 auth v5678 s=3 n(v0 rc2023-10-03T19:16:11.365644+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6d8580] 2023-10-03T19:21:05.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1025> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000053b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1024> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000053c [2,head] /dc-dir/dc-file_839 auth v5680 s=3 n(v0 rc2023-10-03T19:16:11.377860+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6d8b00] 2023-10-03T19:21:05.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1023> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000053c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1022> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000053d [2,head] /dc-dir/dc-file_840 auth v5682 s=3 n(v0 rc2023-10-03T19:16:11.390392+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6d9080] 2023-10-03T19:21:05.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1021> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000053d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.509 INFO:teuthology.orchestra.run.smithi045.stdout: -1020> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000053e [2,head] /dc-dir/dc-file_841 auth v5684 s=3 n(v0 rc2023-10-03T19:16:11.402500+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6d9600] 2023-10-03T19:21:05.509 INFO:teuthology.orchestra.run.smithi045.stdout: -1019> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000053e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.510 INFO:teuthology.orchestra.run.smithi045.stdout: -1018> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000053f [2,head] /dc-dir/dc-file_842 auth v5686 s=3 n(v0 rc2023-10-03T19:16:11.414840+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6d9b80] 2023-10-03T19:21:05.510 INFO:teuthology.orchestra.run.smithi045.stdout: -1017> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000053f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.510 INFO:teuthology.orchestra.run.smithi045.stdout: -1016> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000540 [2,head] /dc-dir/dc-file_843 auth v5688 s=3 n(v0 rc2023-10-03T19:16:11.427532+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6da100] 2023-10-03T19:21:05.510 INFO:teuthology.orchestra.run.smithi045.stdout: -1015> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000540) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.510 INFO:teuthology.orchestra.run.smithi045.stdout: -1014> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000541 [2,head] /dc-dir/dc-file_844 auth v5690 s=3 n(v0 rc2023-10-03T19:16:11.440481+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6da680] 2023-10-03T19:21:05.510 INFO:teuthology.orchestra.run.smithi045.stdout: -1013> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000541) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.510 INFO:teuthology.orchestra.run.smithi045.stdout: -1012> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000542 [2,head] /dc-dir/dc-file_845 auth v5692 s=3 n(v0 rc2023-10-03T19:16:11.452122+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6dac00] 2023-10-03T19:21:05.510 INFO:teuthology.orchestra.run.smithi045.stdout: -1011> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000542) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.510 INFO:teuthology.orchestra.run.smithi045.stdout: -1010> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000543 [2,head] /dc-dir/dc-file_846 auth v5694 s=3 n(v0 rc2023-10-03T19:16:11.463867+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6db180] 2023-10-03T19:21:05.510 INFO:teuthology.orchestra.run.smithi045.stdout: -1009> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000543) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.510 INFO:teuthology.orchestra.run.smithi045.stdout: -1008> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000544 [2,head] /dc-dir/dc-file_847 auth v5696 s=3 n(v0 rc2023-10-03T19:16:11.476229+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6db700] 2023-10-03T19:21:05.511 INFO:teuthology.orchestra.run.smithi045.stdout: -1007> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000544) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.511 INFO:teuthology.orchestra.run.smithi045.stdout: -1006> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000545 [2,head] /dc-dir/dc-file_848 auth v5698 s=3 n(v0 rc2023-10-03T19:16:11.488215+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6e2000] 2023-10-03T19:21:05.511 INFO:teuthology.orchestra.run.smithi045.stdout: -1005> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000545) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.511 INFO:teuthology.orchestra.run.smithi045.stdout: -1004> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000546 [2,head] /dc-dir/dc-file_849 auth v5700 s=3 n(v0 rc2023-10-03T19:16:11.595221+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6e2580] 2023-10-03T19:21:05.511 INFO:teuthology.orchestra.run.smithi045.stdout: -1003> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000546) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.511 INFO:teuthology.orchestra.run.smithi045.stdout: -1002> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000547 [2,head] /dc-dir/dc-file_850 auth v5702 s=3 n(v0 rc2023-10-03T19:16:11.625130+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6e2b00] 2023-10-03T19:21:05.511 INFO:teuthology.orchestra.run.smithi045.stdout: -1001> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000547) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.511 INFO:teuthology.orchestra.run.smithi045.stdout: -1000> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000548 [2,head] /dc-dir/dc-file_851 auth v5704 s=3 n(v0 rc2023-10-03T19:16:11.636347+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6e3080] 2023-10-03T19:21:05.511 INFO:teuthology.orchestra.run.smithi045.stdout: -999> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000548) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.511 INFO:teuthology.orchestra.run.smithi045.stdout: -998> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000549 [2,head] /dc-dir/dc-file_852 auth v5706 s=3 n(v0 rc2023-10-03T19:16:11.646990+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6e3600] 2023-10-03T19:21:05.511 INFO:teuthology.orchestra.run.smithi045.stdout: -997> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000549) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.511 INFO:teuthology.orchestra.run.smithi045.stdout: -996> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000054a [2,head] /dc-dir/dc-file_853 auth v5708 s=3 n(v0 rc2023-10-03T19:16:11.658540+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6e3b80] 2023-10-03T19:21:05.512 INFO:teuthology.orchestra.run.smithi045.stdout: -995> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000054a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.512 INFO:teuthology.orchestra.run.smithi045.stdout: -994> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000054b [2,head] /dc-dir/dc-file_854 auth v5710 s=3 n(v0 rc2023-10-03T19:16:11.669517+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6e4100] 2023-10-03T19:21:05.512 INFO:teuthology.orchestra.run.smithi045.stdout: -993> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000054b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.512 INFO:teuthology.orchestra.run.smithi045.stdout: -992> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000054c [2,head] /dc-dir/dc-file_855 auth v5712 s=3 n(v0 rc2023-10-03T19:16:11.680284+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6e4680] 2023-10-03T19:21:05.512 INFO:teuthology.orchestra.run.smithi045.stdout: -991> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000054c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.512 INFO:teuthology.orchestra.run.smithi045.stdout: -990> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000054d [2,head] /dc-dir/dc-file_856 auth v5714 s=3 n(v0 rc2023-10-03T19:16:11.691578+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6e4c00] 2023-10-03T19:21:05.512 INFO:teuthology.orchestra.run.smithi045.stdout: -989> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000054d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.512 INFO:teuthology.orchestra.run.smithi045.stdout: -988> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000054e [2,head] /dc-dir/dc-file_857 auth v5716 s=3 n(v0 rc2023-10-03T19:16:11.702601+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6e5180] 2023-10-03T19:21:05.512 INFO:teuthology.orchestra.run.smithi045.stdout: -987> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000054e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.513 INFO:teuthology.orchestra.run.smithi045.stdout: -986> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000054f [2,head] /dc-dir/dc-file_858 auth v5718 s=3 n(v0 rc2023-10-03T19:16:11.713477+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d6e5700] 2023-10-03T19:21:05.513 INFO:teuthology.orchestra.run.smithi045.stdout: -985> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000054f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.513 INFO:teuthology.orchestra.run.smithi045.stdout: -984> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000550 [2,head] /dc-dir/dc-file_859 auth v5720 s=3 n(v0 rc2023-10-03T19:16:11.725442+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d714000] 2023-10-03T19:21:05.513 INFO:teuthology.orchestra.run.smithi045.stdout: -983> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000550) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.513 INFO:teuthology.orchestra.run.smithi045.stdout: -982> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000551 [2,head] /dc-dir/dc-file_860 auth v5722 s=3 n(v0 rc2023-10-03T19:16:11.737733+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d714580] 2023-10-03T19:21:05.513 INFO:teuthology.orchestra.run.smithi045.stdout: -981> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000551) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.513 INFO:teuthology.orchestra.run.smithi045.stdout: -980> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000552 [2,head] /dc-dir/dc-file_861 auth v5724 s=3 n(v0 rc2023-10-03T19:16:11.749466+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d714b00] 2023-10-03T19:21:05.513 INFO:teuthology.orchestra.run.smithi045.stdout: -979> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000552) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.513 INFO:teuthology.orchestra.run.smithi045.stdout: -978> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000553 [2,head] /dc-dir/dc-file_862 auth v5726 s=3 n(v0 rc2023-10-03T19:16:11.760678+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d715080] 2023-10-03T19:21:05.513 INFO:teuthology.orchestra.run.smithi045.stdout: -977> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000553) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.513 INFO:teuthology.orchestra.run.smithi045.stdout: -976> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000554 [2,head] /dc-dir/dc-file_863 auth v5728 s=3 n(v0 rc2023-10-03T19:16:11.773179+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d715600] 2023-10-03T19:21:05.513 INFO:teuthology.orchestra.run.smithi045.stdout: -975> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000554) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.514 INFO:teuthology.orchestra.run.smithi045.stdout: -974> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000555 [2,head] /dc-dir/dc-file_864 auth v5730 s=3 n(v0 rc2023-10-03T19:16:11.784212+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d715b80] 2023-10-03T19:21:05.514 INFO:teuthology.orchestra.run.smithi045.stdout: -973> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000555) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.514 INFO:teuthology.orchestra.run.smithi045.stdout: -972> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000556 [2,head] /dc-dir/dc-file_865 auth v5732 s=3 n(v0 rc2023-10-03T19:16:11.796101+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d716100] 2023-10-03T19:21:05.514 INFO:teuthology.orchestra.run.smithi045.stdout: -971> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000556) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.514 INFO:teuthology.orchestra.run.smithi045.stdout: -970> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000557 [2,head] /dc-dir/dc-file_866 auth v5734 s=3 n(v0 rc2023-10-03T19:16:11.808151+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d716680] 2023-10-03T19:21:05.514 INFO:teuthology.orchestra.run.smithi045.stdout: -969> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000557) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.514 INFO:teuthology.orchestra.run.smithi045.stdout: -968> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000558 [2,head] /dc-dir/dc-file_867 auth v5736 s=3 n(v0 rc2023-10-03T19:16:11.819523+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d716c00] 2023-10-03T19:21:05.514 INFO:teuthology.orchestra.run.smithi045.stdout: -967> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000558) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.514 INFO:teuthology.orchestra.run.smithi045.stdout: -966> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000559 [2,head] /dc-dir/dc-file_868 auth v5738 s=3 n(v0 rc2023-10-03T19:16:11.831122+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d717180] 2023-10-03T19:21:05.514 INFO:teuthology.orchestra.run.smithi045.stdout: -965> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000559) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.514 INFO:teuthology.orchestra.run.smithi045.stdout: -964> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000055a [2,head] /dc-dir/dc-file_869 auth v5740 s=3 n(v0 rc2023-10-03T19:16:11.841896+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d717700] 2023-10-03T19:21:05.515 INFO:teuthology.orchestra.run.smithi045.stdout: -963> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000055a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.515 INFO:teuthology.orchestra.run.smithi045.stdout: -962> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000055b [2,head] /dc-dir/dc-file_870 auth v5742 s=3 n(v0 rc2023-10-03T19:16:11.853718+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d71e000] 2023-10-03T19:21:05.515 INFO:teuthology.orchestra.run.smithi045.stdout: -961> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000055b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.515 INFO:teuthology.orchestra.run.smithi045.stdout: -960> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000055c [2,head] /dc-dir/dc-file_871 auth v5744 s=3 n(v0 rc2023-10-03T19:16:11.867502+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d71e580] 2023-10-03T19:21:05.515 INFO:teuthology.orchestra.run.smithi045.stdout: -959> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000055c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.583 INFO:teuthology.orchestra.run.smithi045.stdout: -958> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000055d [2,head] /dc-dir/dc-file_872 auth v5746 s=3 n(v0 rc2023-10-03T19:16:11.879026+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d71eb00] 2023-10-03T19:21:05.583 INFO:teuthology.orchestra.run.smithi045.stdout: -957> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000055d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.583 INFO:teuthology.orchestra.run.smithi045.stdout: -956> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000055e [2,head] /dc-dir/dc-file_873 auth v5748 s=3 n(v0 rc2023-10-03T19:16:11.889904+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d71f080] 2023-10-03T19:21:05.583 INFO:teuthology.orchestra.run.smithi045.stdout: -955> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000055e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.583 INFO:teuthology.orchestra.run.smithi045.stdout: -954> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000055f [2,head] /dc-dir/dc-file_874 auth v5750 s=3 n(v0 rc2023-10-03T19:16:11.901444+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d71f600] 2023-10-03T19:21:05.583 INFO:teuthology.orchestra.run.smithi045.stdout: -953> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000055f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.583 INFO:teuthology.orchestra.run.smithi045.stdout: -952> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000560 [2,head] /dc-dir/dc-file_875 auth v5752 s=3 n(v0 rc2023-10-03T19:16:11.912533+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d71fb80] 2023-10-03T19:21:05.583 INFO:teuthology.orchestra.run.smithi045.stdout: -951> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000560) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.583 INFO:teuthology.orchestra.run.smithi045.stdout: -950> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000561 [2,head] /dc-dir/dc-file_876 auth v5754 s=3 n(v0 rc2023-10-03T19:16:11.924662+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d720100] 2023-10-03T19:21:05.583 INFO:teuthology.orchestra.run.smithi045.stdout: -949> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000561) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.584 INFO:teuthology.orchestra.run.smithi045.stdout: -948> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000562 [2,head] /dc-dir/dc-file_877 auth v5756 s=3 n(v0 rc2023-10-03T19:16:11.935807+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d720680] 2023-10-03T19:21:05.584 INFO:teuthology.orchestra.run.smithi045.stdout: -947> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000562) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.584 INFO:teuthology.orchestra.run.smithi045.stdout: -946> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000563 [2,head] /dc-dir/dc-file_878 auth v5758 s=3 n(v0 rc2023-10-03T19:16:11.947528+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d720c00] 2023-10-03T19:21:05.584 INFO:teuthology.orchestra.run.smithi045.stdout: -945> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000563) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.584 INFO:teuthology.orchestra.run.smithi045.stdout: -944> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000564 [2,head] /dc-dir/dc-file_879 auth v5760 s=3 n(v0 rc2023-10-03T19:16:11.958487+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d721180] 2023-10-03T19:21:05.584 INFO:teuthology.orchestra.run.smithi045.stdout: -943> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000564) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.584 INFO:teuthology.orchestra.run.smithi045.stdout: -942> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000565 [2,head] /dc-dir/dc-file_880 auth v5762 s=3 n(v0 rc2023-10-03T19:16:11.970644+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d721700] 2023-10-03T19:21:05.584 INFO:teuthology.orchestra.run.smithi045.stdout: -941> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000565) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.584 INFO:teuthology.orchestra.run.smithi045.stdout: -940> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000566 [2,head] /dc-dir/dc-file_881 auth v5764 s=3 n(v0 rc2023-10-03T19:16:11.981827+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d726000] 2023-10-03T19:21:05.584 INFO:teuthology.orchestra.run.smithi045.stdout: -939> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000566) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.584 INFO:teuthology.orchestra.run.smithi045.stdout: -938> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000567 [2,head] /dc-dir/dc-file_882 auth v5766 s=3 n(v0 rc2023-10-03T19:16:11.993369+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d726580] 2023-10-03T19:21:05.585 INFO:teuthology.orchestra.run.smithi045.stdout: -937> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000567) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.585 INFO:teuthology.orchestra.run.smithi045.stdout: -936> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000568 [2,head] /dc-dir/dc-file_883 auth v5768 s=3 n(v0 rc2023-10-03T19:16:12.005101+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d726b00] 2023-10-03T19:21:05.585 INFO:teuthology.orchestra.run.smithi045.stdout: -935> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000568) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.585 INFO:teuthology.orchestra.run.smithi045.stdout: -934> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000569 [2,head] /dc-dir/dc-file_884 auth v5770 s=3 n(v0 rc2023-10-03T19:16:12.016050+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d727080] 2023-10-03T19:21:05.585 INFO:teuthology.orchestra.run.smithi045.stdout: -933> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000569) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.585 INFO:teuthology.orchestra.run.smithi045.stdout: -932> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000056a [2,head] /dc-dir/dc-file_885 auth v5772 s=3 n(v0 rc2023-10-03T19:16:12.027827+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d727600] 2023-10-03T19:21:05.585 INFO:teuthology.orchestra.run.smithi045.stdout: -931> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000056a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.585 INFO:teuthology.orchestra.run.smithi045.stdout: -930> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000056b [2,head] /dc-dir/dc-file_886 auth v5774 s=3 n(v0 rc2023-10-03T19:16:12.039349+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d727b80] 2023-10-03T19:21:05.585 INFO:teuthology.orchestra.run.smithi045.stdout: -929> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000056b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.585 INFO:teuthology.orchestra.run.smithi045.stdout: -928> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000056c [2,head] /dc-dir/dc-file_887 auth v5776 s=3 n(v0 rc2023-10-03T19:16:12.051113+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d728100] 2023-10-03T19:21:05.585 INFO:teuthology.orchestra.run.smithi045.stdout: -927> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000056c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.585 INFO:teuthology.orchestra.run.smithi045.stdout: -926> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000056d [2,head] /dc-dir/dc-file_888 auth v5778 s=3 n(v0 rc2023-10-03T19:16:12.062547+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d728680] 2023-10-03T19:21:05.586 INFO:teuthology.orchestra.run.smithi045.stdout: -925> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000056d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.586 INFO:teuthology.orchestra.run.smithi045.stdout: -924> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000056e [2,head] /dc-dir/dc-file_889 auth v5780 s=3 n(v0 rc2023-10-03T19:16:12.074082+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d728c00] 2023-10-03T19:21:05.586 INFO:teuthology.orchestra.run.smithi045.stdout: -923> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000056e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.586 INFO:teuthology.orchestra.run.smithi045.stdout: -922> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000056f [2,head] /dc-dir/dc-file_890 auth v5782 s=3 n(v0 rc2023-10-03T19:16:12.085564+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d729180] 2023-10-03T19:21:05.586 INFO:teuthology.orchestra.run.smithi045.stdout: -921> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000056f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.586 INFO:teuthology.orchestra.run.smithi045.stdout: -920> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000570 [2,head] /dc-dir/dc-file_891 auth v5784 s=3 n(v0 rc2023-10-03T19:16:12.097049+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d729700] 2023-10-03T19:21:05.586 INFO:teuthology.orchestra.run.smithi045.stdout: -919> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000570) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.586 INFO:teuthology.orchestra.run.smithi045.stdout: -918> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000571 [2,head] /dc-dir/dc-file_892 auth v5786 s=3 n(v0 rc2023-10-03T19:16:12.108169+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d730000] 2023-10-03T19:21:05.586 INFO:teuthology.orchestra.run.smithi045.stdout: -917> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000571) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.586 INFO:teuthology.orchestra.run.smithi045.stdout: -916> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000572 [2,head] /dc-dir/dc-file_893 auth v5788 s=3 n(v0 rc2023-10-03T19:16:12.120326+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d730580] 2023-10-03T19:21:05.586 INFO:teuthology.orchestra.run.smithi045.stdout: -915> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000572) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.587 INFO:teuthology.orchestra.run.smithi045.stdout: -914> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000573 [2,head] /dc-dir/dc-file_894 auth v5790 s=3 n(v0 rc2023-10-03T19:16:12.131658+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d730b00] 2023-10-03T19:21:05.587 INFO:teuthology.orchestra.run.smithi045.stdout: -913> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000573) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.587 INFO:teuthology.orchestra.run.smithi045.stdout: -912> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000574 [2,head] /dc-dir/dc-file_895 auth v5792 s=3 n(v0 rc2023-10-03T19:16:12.142822+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d731080] 2023-10-03T19:21:05.587 INFO:teuthology.orchestra.run.smithi045.stdout: -911> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000574) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.587 INFO:teuthology.orchestra.run.smithi045.stdout: -910> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000575 [2,head] /dc-dir/dc-file_896 auth v5794 s=3 n(v0 rc2023-10-03T19:16:12.154331+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d731600] 2023-10-03T19:21:05.587 INFO:teuthology.orchestra.run.smithi045.stdout: -909> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000575) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.587 INFO:teuthology.orchestra.run.smithi045.stdout: -908> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000576 [2,head] /dc-dir/dc-file_897 auth v5796 s=3 n(v0 rc2023-10-03T19:16:12.165323+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d731b80] 2023-10-03T19:21:05.587 INFO:teuthology.orchestra.run.smithi045.stdout: -907> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000576) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.587 INFO:teuthology.orchestra.run.smithi045.stdout: -906> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000577 [2,head] /dc-dir/dc-file_898 auth v5798 s=3 n(v0 rc2023-10-03T19:16:12.176673+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d732100] 2023-10-03T19:21:05.587 INFO:teuthology.orchestra.run.smithi045.stdout: -905> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000577) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.587 INFO:teuthology.orchestra.run.smithi045.stdout: -904> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000578 [2,head] /dc-dir/dc-file_899 auth v5800 s=3 n(v0 rc2023-10-03T19:16:12.188184+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d732680] 2023-10-03T19:21:05.588 INFO:teuthology.orchestra.run.smithi045.stdout: -903> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000578) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.588 INFO:teuthology.orchestra.run.smithi045.stdout: -902> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000579 [2,head] /dc-dir/dc-file_900 auth v5802 s=3 n(v0 rc2023-10-03T19:16:12.199415+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d732c00] 2023-10-03T19:21:05.588 INFO:teuthology.orchestra.run.smithi045.stdout: -901> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000579) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.588 INFO:teuthology.orchestra.run.smithi045.stdout: -900> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000057a [2,head] /dc-dir/dc-file_901 auth v5804 s=3 n(v0 rc2023-10-03T19:16:12.210853+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d733180] 2023-10-03T19:21:05.588 INFO:teuthology.orchestra.run.smithi045.stdout: -899> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000057a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.588 INFO:teuthology.orchestra.run.smithi045.stdout: -898> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000057b [2,head] /dc-dir/dc-file_902 auth v5806 s=3 n(v0 rc2023-10-03T19:16:12.222270+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d733700] 2023-10-03T19:21:05.588 INFO:teuthology.orchestra.run.smithi045.stdout: -897> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000057b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.588 INFO:teuthology.orchestra.run.smithi045.stdout: -896> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000057c [2,head] /dc-dir/dc-file_903 auth v5808 s=3 n(v0 rc2023-10-03T19:16:12.234211+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d738000] 2023-10-03T19:21:05.588 INFO:teuthology.orchestra.run.smithi045.stdout: -895> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000057c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.588 INFO:teuthology.orchestra.run.smithi045.stdout: -894> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000057d [2,head] /dc-dir/dc-file_904 auth v5810 s=3 n(v0 rc2023-10-03T19:16:12.245637+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d738580] 2023-10-03T19:21:05.588 INFO:teuthology.orchestra.run.smithi045.stdout: -893> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000057d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.589 INFO:teuthology.orchestra.run.smithi045.stdout: -892> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000057e [2,head] /dc-dir/dc-file_905 auth v5812 s=3 n(v0 rc2023-10-03T19:16:12.256429+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d738b00] 2023-10-03T19:21:05.589 INFO:teuthology.orchestra.run.smithi045.stdout: -891> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000057e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.589 INFO:teuthology.orchestra.run.smithi045.stdout: -890> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000057f [2,head] /dc-dir/dc-file_906 auth v5814 s=3 n(v0 rc2023-10-03T19:16:12.268662+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d739080] 2023-10-03T19:21:05.614 INFO:teuthology.orchestra.run.smithi045.stdout: -889> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000057f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.614 INFO:teuthology.orchestra.run.smithi045.stdout: -888> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000580 [2,head] /dc-dir/dc-file_907 auth v5816 s=3 n(v0 rc2023-10-03T19:16:12.280678+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d739600] 2023-10-03T19:21:05.614 INFO:teuthology.orchestra.run.smithi045.stdout: -887> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000580) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.614 INFO:teuthology.orchestra.run.smithi045.stdout: -886> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000581 [2,head] /dc-dir/dc-file_908 auth v5818 s=3 n(v0 rc2023-10-03T19:16:12.293015+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d739b80] 2023-10-03T19:21:05.615 INFO:teuthology.orchestra.run.smithi045.stdout: -885> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000581) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.615 INFO:teuthology.orchestra.run.smithi045.stdout: -884> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000582 [2,head] /dc-dir/dc-file_909 auth v5820 s=3 n(v0 rc2023-10-03T19:16:12.304411+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d73a100] 2023-10-03T19:21:05.615 INFO:teuthology.orchestra.run.smithi045.stdout: -883> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000582) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.615 INFO:teuthology.orchestra.run.smithi045.stdout: -882> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000583 [2,head] /dc-dir/dc-file_910 auth v5822 s=3 n(v0 rc2023-10-03T19:16:12.315558+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d73a680] 2023-10-03T19:21:05.615 INFO:teuthology.orchestra.run.smithi045.stdout: -881> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000583) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.615 INFO:teuthology.orchestra.run.smithi045.stdout: -880> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000584 [2,head] /dc-dir/dc-file_911 auth v5824 s=3 n(v0 rc2023-10-03T19:16:12.327316+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d73ac00] 2023-10-03T19:21:05.615 INFO:teuthology.orchestra.run.smithi045.stdout: -879> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000584) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.615 INFO:teuthology.orchestra.run.smithi045.stdout: -878> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000585 [2,head] /dc-dir/dc-file_912 auth v5826 s=3 n(v0 rc2023-10-03T19:16:12.338150+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d73b180] 2023-10-03T19:21:05.615 INFO:teuthology.orchestra.run.smithi045.stdout: -877> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000585) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.615 INFO:teuthology.orchestra.run.smithi045.stdout: -876> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000586 [2,head] /dc-dir/dc-file_913 auth v5828 s=3 n(v0 rc2023-10-03T19:16:12.349543+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d73b700] 2023-10-03T19:21:05.616 INFO:teuthology.orchestra.run.smithi045.stdout: -875> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000586) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.616 INFO:teuthology.orchestra.run.smithi045.stdout: -874> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000587 [2,head] /dc-dir/dc-file_914 auth v5830 s=3 n(v0 rc2023-10-03T19:16:12.360907+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d740000] 2023-10-03T19:21:05.616 INFO:teuthology.orchestra.run.smithi045.stdout: -873> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000587) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.616 INFO:teuthology.orchestra.run.smithi045.stdout: -872> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000588 [2,head] /dc-dir/dc-file_915 auth v5832 s=3 n(v0 rc2023-10-03T19:16:12.372392+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d740580] 2023-10-03T19:21:05.616 INFO:teuthology.orchestra.run.smithi045.stdout: -871> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000588) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.616 INFO:teuthology.orchestra.run.smithi045.stdout: -870> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000589 [2,head] /dc-dir/dc-file_916 auth v5834 s=3 n(v0 rc2023-10-03T19:16:12.383391+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d740b00] 2023-10-03T19:21:05.616 INFO:teuthology.orchestra.run.smithi045.stdout: -869> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000589) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.616 INFO:teuthology.orchestra.run.smithi045.stdout: -868> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000058a [2,head] /dc-dir/dc-file_917 auth v5836 s=3 n(v0 rc2023-10-03T19:16:12.394808+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d741080] 2023-10-03T19:21:05.616 INFO:teuthology.orchestra.run.smithi045.stdout: -867> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000058a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.616 INFO:teuthology.orchestra.run.smithi045.stdout: -866> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000058b [2,head] /dc-dir/dc-file_918 auth v5838 s=3 n(v0 rc2023-10-03T19:16:12.405870+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d741600] 2023-10-03T19:21:05.616 INFO:teuthology.orchestra.run.smithi045.stdout: -865> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000058b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.616 INFO:teuthology.orchestra.run.smithi045.stdout: -864> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000058c [2,head] /dc-dir/dc-file_919 auth v5840 s=3 n(v0 rc2023-10-03T19:16:12.418120+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d741b80] 2023-10-03T19:21:05.617 INFO:teuthology.orchestra.run.smithi045.stdout: -863> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000058c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.617 INFO:teuthology.orchestra.run.smithi045.stdout: -862> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000058d [2,head] /dc-dir/dc-file_920 auth v5842 s=3 n(v0 rc2023-10-03T19:16:12.429338+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d742100] 2023-10-03T19:21:05.617 INFO:teuthology.orchestra.run.smithi045.stdout: -861> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000058d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.617 INFO:teuthology.orchestra.run.smithi045.stdout: -860> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000058e [2,head] /dc-dir/dc-file_921 auth v5844 s=3 n(v0 rc2023-10-03T19:16:12.440341+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d742680] 2023-10-03T19:21:05.617 INFO:teuthology.orchestra.run.smithi045.stdout: -859> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000058e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.617 INFO:teuthology.orchestra.run.smithi045.stdout: -858> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000058f [2,head] /dc-dir/dc-file_922 auth v5846 s=3 n(v0 rc2023-10-03T19:16:12.451291+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d742c00] 2023-10-03T19:21:05.617 INFO:teuthology.orchestra.run.smithi045.stdout: -857> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000058f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.617 INFO:teuthology.orchestra.run.smithi045.stdout: -856> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000590 [2,head] /dc-dir/dc-file_923 auth v5848 s=3 n(v0 rc2023-10-03T19:16:12.462885+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d743180] 2023-10-03T19:21:05.617 INFO:teuthology.orchestra.run.smithi045.stdout: -855> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000590) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.617 INFO:teuthology.orchestra.run.smithi045.stdout: -854> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000591 [2,head] /dc-dir/dc-file_924 auth v5850 s=3 n(v0 rc2023-10-03T19:16:12.475000+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d743700] 2023-10-03T19:21:05.617 INFO:teuthology.orchestra.run.smithi045.stdout: -853> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000591) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.617 INFO:teuthology.orchestra.run.smithi045.stdout: -852> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000592 [2,head] /dc-dir/dc-file_925 auth v5852 s=3 n(v0 rc2023-10-03T19:16:12.486873+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d748000] 2023-10-03T19:21:05.618 INFO:teuthology.orchestra.run.smithi045.stdout: -851> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000592) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.618 INFO:teuthology.orchestra.run.smithi045.stdout: -850> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000593 [2,head] /dc-dir/dc-file_926 auth v5854 s=3 n(v0 rc2023-10-03T19:16:12.498507+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d748580] 2023-10-03T19:21:05.618 INFO:teuthology.orchestra.run.smithi045.stdout: -849> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000593) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.618 INFO:teuthology.orchestra.run.smithi045.stdout: -848> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000594 [2,head] /dc-dir/dc-file_927 auth v5856 s=3 n(v0 rc2023-10-03T19:16:12.621771+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d748b00] 2023-10-03T19:21:05.618 INFO:teuthology.orchestra.run.smithi045.stdout: -847> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000594) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.618 INFO:teuthology.orchestra.run.smithi045.stdout: -846> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000595 [2,head] /dc-dir/dc-file_928 auth v5858 s=3 n(v0 rc2023-10-03T19:16:12.632834+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d749080] 2023-10-03T19:21:05.618 INFO:teuthology.orchestra.run.smithi045.stdout: -845> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000595) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.618 INFO:teuthology.orchestra.run.smithi045.stdout: -844> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000596 [2,head] /dc-dir/dc-file_929 auth v5860 s=3 n(v0 rc2023-10-03T19:16:12.644045+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d749600] 2023-10-03T19:21:05.618 INFO:teuthology.orchestra.run.smithi045.stdout: -843> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000596) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.618 INFO:teuthology.orchestra.run.smithi045.stdout: -842> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000597 [2,head] /dc-dir/dc-file_930 auth v5862 s=3 n(v0 rc2023-10-03T19:16:12.656159+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d749b80] 2023-10-03T19:21:05.618 INFO:teuthology.orchestra.run.smithi045.stdout: -841> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000597) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.619 INFO:teuthology.orchestra.run.smithi045.stdout: -840> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000598 [2,head] /dc-dir/dc-file_931 auth v5864 s=3 n(v0 rc2023-10-03T19:16:12.668535+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d74a100] 2023-10-03T19:21:05.619 INFO:teuthology.orchestra.run.smithi045.stdout: -839> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000598) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.619 INFO:teuthology.orchestra.run.smithi045.stdout: -838> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000599 [2,head] /dc-dir/dc-file_932 auth v5866 s=3 n(v0 rc2023-10-03T19:16:12.685440+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d74a680] 2023-10-03T19:21:05.619 INFO:teuthology.orchestra.run.smithi045.stdout: -837> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x10000000599) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.619 INFO:teuthology.orchestra.run.smithi045.stdout: -836> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000059a [2,head] /dc-dir/dc-file_933 auth v5868 s=3 n(v0 rc2023-10-03T19:16:12.697354+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d74ac00] 2023-10-03T19:21:05.619 INFO:teuthology.orchestra.run.smithi045.stdout: -835> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000059a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.619 INFO:teuthology.orchestra.run.smithi045.stdout: -834> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000059b [2,head] /dc-dir/dc-file_934 auth v5870 s=3 n(v0 rc2023-10-03T19:16:12.708954+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d74b180] 2023-10-03T19:21:05.619 INFO:teuthology.orchestra.run.smithi045.stdout: -833> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000059b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.619 INFO:teuthology.orchestra.run.smithi045.stdout: -832> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000059c [2,head] /dc-dir/dc-file_935 auth v5872 s=3 n(v0 rc2023-10-03T19:16:13.713112+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d74b700] 2023-10-03T19:21:05.619 INFO:teuthology.orchestra.run.smithi045.stdout: -831> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000059c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.619 INFO:teuthology.orchestra.run.smithi045.stdout: -830> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000059d [2,head] /dc-dir/dc-file_936 auth v5874 s=3 n(v0 rc2023-10-03T19:16:13.754462+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d768000] 2023-10-03T19:21:05.620 INFO:teuthology.orchestra.run.smithi045.stdout: -829> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000059d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.620 INFO:teuthology.orchestra.run.smithi045.stdout: -828> 2023-10-03T19:16:29.358+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 146 ==== osd_op_reply(2106 10000000026.00000000 [delete] v50'39 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.620 INFO:teuthology.orchestra.run.smithi045.stdout: -827> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000059e [2,head] /dc-dir/dc-file_937 auth v5876 s=3 n(v0 rc2023-10-03T19:16:13.770696+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d768580] 2023-10-03T19:21:05.620 INFO:teuthology.orchestra.run.smithi045.stdout: -826> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000059e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.620 INFO:teuthology.orchestra.run.smithi045.stdout: -825> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000059f [2,head] /dc-dir/dc-file_938 auth v5878 s=3 n(v0 rc2023-10-03T19:16:13.786243+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d768b00] 2023-10-03T19:21:05.620 INFO:teuthology.orchestra.run.smithi045.stdout: -824> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x1000000059f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.620 INFO:teuthology.orchestra.run.smithi045.stdout: -823> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a0 [2,head] /dc-dir/dc-file_939 auth v5880 s=3 n(v0 rc2023-10-03T19:16:13.798243+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d769080] 2023-10-03T19:21:05.620 INFO:teuthology.orchestra.run.smithi045.stdout: -822> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005a0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.640 INFO:teuthology.orchestra.run.smithi045.stdout: -821> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a1 [2,head] /dc-dir/dc-file_940 auth v5882 s=3 n(v0 rc2023-10-03T19:16:13.811427+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d769600] 2023-10-03T19:21:05.640 INFO:teuthology.orchestra.run.smithi045.stdout: -820> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005a1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.640 INFO:teuthology.orchestra.run.smithi045.stdout: -819> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a2 [2,head] /dc-dir/dc-file_941 auth v5884 s=3 n(v0 rc2023-10-03T19:16:13.822872+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d769b80] 2023-10-03T19:21:05.641 INFO:teuthology.orchestra.run.smithi045.stdout: -818> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005a2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.641 INFO:teuthology.orchestra.run.smithi045.stdout: -817> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a3 [2,head] /dc-dir/dc-file_942 auth v5886 s=3 n(v0 rc2023-10-03T19:16:13.834397+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d76a100] 2023-10-03T19:21:05.641 INFO:teuthology.orchestra.run.smithi045.stdout: -816> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005a3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.641 INFO:teuthology.orchestra.run.smithi045.stdout: -815> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a4 [2,head] /dc-dir/dc-file_943 auth v5888 s=3 n(v0 rc2023-10-03T19:16:13.846350+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d76a680] 2023-10-03T19:21:05.641 INFO:teuthology.orchestra.run.smithi045.stdout: -814> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005a4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.641 INFO:teuthology.orchestra.run.smithi045.stdout: -813> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a5 [2,head] /dc-dir/dc-file_944 auth v5890 s=3 n(v0 rc2023-10-03T19:16:13.858807+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d76ac00] 2023-10-03T19:21:05.641 INFO:teuthology.orchestra.run.smithi045.stdout: -812> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005a5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.641 INFO:teuthology.orchestra.run.smithi045.stdout: -811> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a6 [2,head] /dc-dir/dc-file_945 auth v5892 s=3 n(v0 rc2023-10-03T19:16:13.870402+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d76b180] 2023-10-03T19:21:05.641 INFO:teuthology.orchestra.run.smithi045.stdout: -810> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005a6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.641 INFO:teuthology.orchestra.run.smithi045.stdout: -809> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a7 [2,head] /dc-dir/dc-file_946 auth v5894 s=3 n(v0 rc2023-10-03T19:16:13.883834+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d76b700] 2023-10-03T19:21:05.641 INFO:teuthology.orchestra.run.smithi045.stdout: -808> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005a7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.641 INFO:teuthology.orchestra.run.smithi045.stdout: -807> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a8 [2,head] /dc-dir/dc-file_947 auth v5896 s=3 n(v0 rc2023-10-03T19:16:13.895684+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d770000] 2023-10-03T19:21:05.642 INFO:teuthology.orchestra.run.smithi045.stdout: -806> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005a8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.642 INFO:teuthology.orchestra.run.smithi045.stdout: -805> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a9 [2,head] /dc-dir/dc-file_948 auth v5898 s=3 n(v0 rc2023-10-03T19:16:13.907952+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d770580] 2023-10-03T19:21:05.642 INFO:teuthology.orchestra.run.smithi045.stdout: -804> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005a9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.642 INFO:teuthology.orchestra.run.smithi045.stdout: -803> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005aa [2,head] /dc-dir/dc-file_949 auth v5900 s=3 n(v0 rc2023-10-03T19:16:13.918957+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d770b00] 2023-10-03T19:21:05.642 INFO:teuthology.orchestra.run.smithi045.stdout: -802> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005aa) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.642 INFO:teuthology.orchestra.run.smithi045.stdout: -801> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005ab [2,head] /dc-dir/dc-file_950 auth v5902 s=3 n(v0 rc2023-10-03T19:16:13.931301+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d771080] 2023-10-03T19:21:05.642 INFO:teuthology.orchestra.run.smithi045.stdout: -800> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005ab) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.642 INFO:teuthology.orchestra.run.smithi045.stdout: -799> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005ac [2,head] /dc-dir/dc-file_951 auth v5904 s=3 n(v0 rc2023-10-03T19:16:13.942462+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d771600] 2023-10-03T19:21:05.642 INFO:teuthology.orchestra.run.smithi045.stdout: -798> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005ac) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.642 INFO:teuthology.orchestra.run.smithi045.stdout: -797> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005ad [2,head] /dc-dir/dc-file_952 auth v5906 s=3 n(v0 rc2023-10-03T19:16:13.953829+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d771b80] 2023-10-03T19:21:05.642 INFO:teuthology.orchestra.run.smithi045.stdout: -796> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005ad) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.643 INFO:teuthology.orchestra.run.smithi045.stdout: -795> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005ae [2,head] /dc-dir/dc-file_953 auth v5908 s=3 n(v0 rc2023-10-03T19:16:13.965768+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d772100] 2023-10-03T19:21:05.643 INFO:teuthology.orchestra.run.smithi045.stdout: -794> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005ae) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.643 INFO:teuthology.orchestra.run.smithi045.stdout: -793> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005af [2,head] /dc-dir/dc-file_954 auth v5910 s=3 n(v0 rc2023-10-03T19:16:13.980171+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d772680] 2023-10-03T19:21:05.643 INFO:teuthology.orchestra.run.smithi045.stdout: -792> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005af) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.643 INFO:teuthology.orchestra.run.smithi045.stdout: -791> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b0 [2,head] /dc-dir/dc-file_955 auth v5912 s=3 n(v0 rc2023-10-03T19:16:13.993298+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d772c00] 2023-10-03T19:21:05.643 INFO:teuthology.orchestra.run.smithi045.stdout: -790> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005b0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.643 INFO:teuthology.orchestra.run.smithi045.stdout: -789> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b1 [2,head] /dc-dir/dc-file_956 auth v5914 s=3 n(v0 rc2023-10-03T19:16:14.005526+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d773180] 2023-10-03T19:21:05.643 INFO:teuthology.orchestra.run.smithi045.stdout: -788> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005b1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.643 INFO:teuthology.orchestra.run.smithi045.stdout: -787> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b2 [2,head] /dc-dir/dc-file_957 auth v5916 s=3 n(v0 rc2023-10-03T19:16:14.018837+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d773700] 2023-10-03T19:21:05.643 INFO:teuthology.orchestra.run.smithi045.stdout: -786> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005b2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.643 INFO:teuthology.orchestra.run.smithi045.stdout: -785> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b3 [2,head] /dc-dir/dc-file_958 auth v5918 s=3 n(v0 rc2023-10-03T19:16:14.031775+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d77e000] 2023-10-03T19:21:05.644 INFO:teuthology.orchestra.run.smithi045.stdout: -784> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005b3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.644 INFO:teuthology.orchestra.run.smithi045.stdout: -783> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b4 [2,head] /dc-dir/dc-file_959 auth v5920 s=3 n(v0 rc2023-10-03T19:16:14.044706+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d77e580] 2023-10-03T19:21:05.644 INFO:teuthology.orchestra.run.smithi045.stdout: -782> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005b4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.644 INFO:teuthology.orchestra.run.smithi045.stdout: -781> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b5 [2,head] /dc-dir/dc-file_960 auth v5922 s=3 n(v0 rc2023-10-03T19:16:14.057778+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d77eb00] 2023-10-03T19:21:05.644 INFO:teuthology.orchestra.run.smithi045.stdout: -780> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005b5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.644 INFO:teuthology.orchestra.run.smithi045.stdout: -779> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b6 [2,head] /dc-dir/dc-file_961 auth v5924 s=3 n(v0 rc2023-10-03T19:16:14.070797+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d77f080] 2023-10-03T19:21:05.644 INFO:teuthology.orchestra.run.smithi045.stdout: -778> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005b6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.644 INFO:teuthology.orchestra.run.smithi045.stdout: -777> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b7 [2,head] /dc-dir/dc-file_962 auth v5926 s=3 n(v0 rc2023-10-03T19:16:14.082388+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d77f600] 2023-10-03T19:21:05.644 INFO:teuthology.orchestra.run.smithi045.stdout: -776> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005b7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.644 INFO:teuthology.orchestra.run.smithi045.stdout: -775> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b8 [2,head] /dc-dir/dc-file_963 auth v5928 s=3 n(v0 rc2023-10-03T19:16:14.093491+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d77fb80] 2023-10-03T19:21:05.644 INFO:teuthology.orchestra.run.smithi045.stdout: -774> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005b8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.644 INFO:teuthology.orchestra.run.smithi045.stdout: -773> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b9 [2,head] /dc-dir/dc-file_964 auth v5930 s=3 n(v0 rc2023-10-03T19:16:14.104499+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d780100] 2023-10-03T19:21:05.645 INFO:teuthology.orchestra.run.smithi045.stdout: -772> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005b9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.645 INFO:teuthology.orchestra.run.smithi045.stdout: -771> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005ba [2,head] /dc-dir/dc-file_965 auth v5932 s=3 n(v0 rc2023-10-03T19:16:14.115361+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d780680] 2023-10-03T19:21:05.645 INFO:teuthology.orchestra.run.smithi045.stdout: -770> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005ba) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.645 INFO:teuthology.orchestra.run.smithi045.stdout: -769> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005bb [2,head] /dc-dir/dc-file_966 auth v5934 s=3 n(v0 rc2023-10-03T19:16:14.127815+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d780c00] 2023-10-03T19:21:05.645 INFO:teuthology.orchestra.run.smithi045.stdout: -768> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005bb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.645 INFO:teuthology.orchestra.run.smithi045.stdout: -767> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005bc [2,head] /dc-dir/dc-file_967 auth v5936 s=3 n(v0 rc2023-10-03T19:16:14.138386+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d781180] 2023-10-03T19:21:05.645 INFO:teuthology.orchestra.run.smithi045.stdout: -766> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005bc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.645 INFO:teuthology.orchestra.run.smithi045.stdout: -765> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005bd [2,head] /dc-dir/dc-file_968 auth v5938 s=3 n(v0 rc2023-10-03T19:16:14.149799+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d781700] 2023-10-03T19:21:05.645 INFO:teuthology.orchestra.run.smithi045.stdout: -764> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005bd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.645 INFO:teuthology.orchestra.run.smithi045.stdout: -763> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005be [2,head] /dc-dir/dc-file_969 auth v5940 s=3 n(v0 rc2023-10-03T19:16:14.162160+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d784000] 2023-10-03T19:21:05.645 INFO:teuthology.orchestra.run.smithi045.stdout: -762> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005be) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.645 INFO:teuthology.orchestra.run.smithi045.stdout: -761> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005bf [2,head] /dc-dir/dc-file_970 auth v5942 s=3 n(v0 rc2023-10-03T19:16:14.173756+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d784580] 2023-10-03T19:21:05.657 INFO:teuthology.orchestra.run.smithi045.stdout: -760> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005bf) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.657 INFO:teuthology.orchestra.run.smithi045.stdout: -759> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c0 [2,head] /dc-dir/dc-file_971 auth v5944 s=3 n(v0 rc2023-10-03T19:16:14.185336+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d784b00] 2023-10-03T19:21:05.657 INFO:teuthology.orchestra.run.smithi045.stdout: -758> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005c0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.657 INFO:teuthology.orchestra.run.smithi045.stdout: -757> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c1 [2,head] /dc-dir/dc-file_972 auth v5946 s=3 n(v0 rc2023-10-03T19:16:14.196905+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d785080] 2023-10-03T19:21:05.657 INFO:teuthology.orchestra.run.smithi045.stdout: -756> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005c1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.657 INFO:teuthology.orchestra.run.smithi045.stdout: -755> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c2 [2,head] /dc-dir/dc-file_973 auth v5948 s=3 n(v0 rc2023-10-03T19:16:14.208247+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d785600] 2023-10-03T19:21:05.657 INFO:teuthology.orchestra.run.smithi045.stdout: -754> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005c2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.657 INFO:teuthology.orchestra.run.smithi045.stdout: -753> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c3 [2,head] /dc-dir/dc-file_974 auth v5950 s=3 n(v0 rc2023-10-03T19:16:14.219552+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d785b80] 2023-10-03T19:21:05.658 INFO:teuthology.orchestra.run.smithi045.stdout: -752> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005c3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.658 INFO:teuthology.orchestra.run.smithi045.stdout: -751> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c4 [2,head] /dc-dir/dc-file_975 auth v5952 s=3 n(v0 rc2023-10-03T19:16:14.230341+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d786100] 2023-10-03T19:21:05.658 INFO:teuthology.orchestra.run.smithi045.stdout: -750> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005c4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.658 INFO:teuthology.orchestra.run.smithi045.stdout: -749> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c5 [2,head] /dc-dir/dc-file_976 auth v5954 s=3 n(v0 rc2023-10-03T19:16:14.241714+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d786680] 2023-10-03T19:21:05.658 INFO:teuthology.orchestra.run.smithi045.stdout: -748> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005c5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.658 INFO:teuthology.orchestra.run.smithi045.stdout: -747> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c6 [2,head] /dc-dir/dc-file_977 auth v5956 s=3 n(v0 rc2023-10-03T19:16:14.253489+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d786c00] 2023-10-03T19:21:05.658 INFO:teuthology.orchestra.run.smithi045.stdout: -746> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005c6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.658 INFO:teuthology.orchestra.run.smithi045.stdout: -745> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c7 [2,head] /dc-dir/dc-file_978 auth v5958 s=3 n(v0 rc2023-10-03T19:16:14.264541+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d787180] 2023-10-03T19:21:05.658 INFO:teuthology.orchestra.run.smithi045.stdout: -744> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005c7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.658 INFO:teuthology.orchestra.run.smithi045.stdout: -743> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c8 [2,head] /dc-dir/dc-file_979 auth v5960 s=3 n(v0 rc2023-10-03T19:16:14.276806+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d787700] 2023-10-03T19:21:05.658 INFO:teuthology.orchestra.run.smithi045.stdout: -742> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005c8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.659 INFO:teuthology.orchestra.run.smithi045.stdout: -741> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c9 [2,head] /dc-dir/dc-file_980 auth v5962 s=3 n(v0 rc2023-10-03T19:16:14.288396+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d2ee000] 2023-10-03T19:21:05.659 INFO:teuthology.orchestra.run.smithi045.stdout: -740> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005c9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.659 INFO:teuthology.orchestra.run.smithi045.stdout: -739> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005ca [2,head] /dc-dir/dc-file_981 auth v5964 s=3 n(v0 rc2023-10-03T19:16:14.300414+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d2ee580] 2023-10-03T19:21:05.659 INFO:teuthology.orchestra.run.smithi045.stdout: -738> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005ca) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.659 INFO:teuthology.orchestra.run.smithi045.stdout: -737> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005cb [2,head] /dc-dir/dc-file_982 auth v5966 s=3 n(v0 rc2023-10-03T19:16:14.311690+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d2eeb00] 2023-10-03T19:21:05.659 INFO:teuthology.orchestra.run.smithi045.stdout: -736> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005cb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.659 INFO:teuthology.orchestra.run.smithi045.stdout: -735> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005cc [2,head] /dc-dir/dc-file_983 auth v5968 s=3 n(v0 rc2023-10-03T19:16:14.322972+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d2ef080] 2023-10-03T19:21:05.659 INFO:teuthology.orchestra.run.smithi045.stdout: -734> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005cc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.659 INFO:teuthology.orchestra.run.smithi045.stdout: -733> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005cd [2,head] /dc-dir/dc-file_984 auth v5970 s=3 n(v0 rc2023-10-03T19:16:14.333889+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d2ef600] 2023-10-03T19:21:05.659 INFO:teuthology.orchestra.run.smithi045.stdout: -732> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005cd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.659 INFO:teuthology.orchestra.run.smithi045.stdout: -731> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005ce [2,head] /dc-dir/dc-file_985 auth v5972 s=3 n(v0 rc2023-10-03T19:16:14.347410+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d2efb80] 2023-10-03T19:21:05.660 INFO:teuthology.orchestra.run.smithi045.stdout: -730> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005ce) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.660 INFO:teuthology.orchestra.run.smithi045.stdout: -729> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005cf [2,head] /dc-dir/dc-file_986 auth v5974 s=3 n(v0 rc2023-10-03T19:16:14.358977+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d2f0100] 2023-10-03T19:21:05.661 INFO:teuthology.orchestra.run.smithi045.stdout: -728> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005cf) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.661 INFO:teuthology.orchestra.run.smithi045.stdout: -727> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d0 [2,head] /dc-dir/dc-file_987 auth v5976 s=3 n(v0 rc2023-10-03T19:16:14.370854+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d2f0680] 2023-10-03T19:21:05.661 INFO:teuthology.orchestra.run.smithi045.stdout: -726> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005d0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.661 INFO:teuthology.orchestra.run.smithi045.stdout: -725> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d1 [2,head] /dc-dir/dc-file_988 auth v5978 s=3 n(v0 rc2023-10-03T19:16:14.382418+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d2f0c00] 2023-10-03T19:21:05.661 INFO:teuthology.orchestra.run.smithi045.stdout: -724> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005d1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.661 INFO:teuthology.orchestra.run.smithi045.stdout: -723> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d2 [2,head] /dc-dir/dc-file_989 auth v5980 s=3 n(v0 rc2023-10-03T19:16:14.394971+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d2f1180] 2023-10-03T19:21:05.661 INFO:teuthology.orchestra.run.smithi045.stdout: -722> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005d2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.661 INFO:teuthology.orchestra.run.smithi045.stdout: -721> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d3 [2,head] /dc-dir/dc-file_990 auth v5982 s=3 n(v0 rc2023-10-03T19:16:14.406435+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d2f1700] 2023-10-03T19:21:05.661 INFO:teuthology.orchestra.run.smithi045.stdout: -720> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005d3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.662 INFO:teuthology.orchestra.run.smithi045.stdout: -719> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d4 [2,head] /dc-dir/dc-file_991 auth v5984 s=3 n(v0 rc2023-10-03T19:16:14.417602+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d58a000] 2023-10-03T19:21:05.662 INFO:teuthology.orchestra.run.smithi045.stdout: -718> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005d4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.662 INFO:teuthology.orchestra.run.smithi045.stdout: -717> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d5 [2,head] /dc-dir/dc-file_992 auth v5986 s=3 n(v0 rc2023-10-03T19:16:14.428662+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d58a580] 2023-10-03T19:21:05.662 INFO:teuthology.orchestra.run.smithi045.stdout: -716> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005d5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.662 INFO:teuthology.orchestra.run.smithi045.stdout: -715> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d6 [2,head] /dc-dir/dc-file_993 auth v5988 s=3 n(v0 rc2023-10-03T19:16:14.440845+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d58ab00] 2023-10-03T19:21:05.662 INFO:teuthology.orchestra.run.smithi045.stdout: -714> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005d6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.662 INFO:teuthology.orchestra.run.smithi045.stdout: -713> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d7 [2,head] /dc-dir/dc-file_994 auth v5990 s=3 n(v0 rc2023-10-03T19:16:14.452407+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d58b080] 2023-10-03T19:21:05.662 INFO:teuthology.orchestra.run.smithi045.stdout: -712> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005d7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.662 INFO:teuthology.orchestra.run.smithi045.stdout: -711> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d8 [2,head] /dc-dir/dc-file_995 auth v5992 s=3 n(v0 rc2023-10-03T19:16:14.464151+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d58b600] 2023-10-03T19:21:05.662 INFO:teuthology.orchestra.run.smithi045.stdout: -710> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005d8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.663 INFO:teuthology.orchestra.run.smithi045.stdout: -709> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d9 [2,head] /dc-dir/dc-file_996 auth v5994 s=3 n(v0 rc2023-10-03T19:16:14.475749+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d58bb80] 2023-10-03T19:21:05.663 INFO:teuthology.orchestra.run.smithi045.stdout: -708> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005d9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.663 INFO:teuthology.orchestra.run.smithi045.stdout: -707> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005da [2,head] /dc-dir/dc-file_997 auth v5996 s=3 n(v0 rc2023-10-03T19:16:14.487300+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d58c100] 2023-10-03T19:21:05.663 INFO:teuthology.orchestra.run.smithi045.stdout: -706> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005da) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.663 INFO:teuthology.orchestra.run.smithi045.stdout: -705> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005db [2,head] /dc-dir/dc-file_998 auth v5998 s=3 n(v0 rc2023-10-03T19:16:14.499563+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d58c680] 2023-10-03T19:21:05.663 INFO:teuthology.orchestra.run.smithi045.stdout: -704> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005db) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.663 INFO:teuthology.orchestra.run.smithi045.stdout: -703> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005dc [2,head] /dc-dir/dc-file_999 auth v6000 s=3 n(v0 rc2023-10-03T19:16:14.509983+0000 b3 1=1+0) (iversion lock) caps={5697=pAsLsXsFsc/-@2},l=5697(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x55576d58cc00] 2023-10-03T19:21:05.663 INFO:teuthology.orchestra.run.smithi045.stdout: -702> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.cache.ino(0x100000005dc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:15:46.333910+0000 change_attr 0 0x55576c2398c0) 2023-10-03T19:21:05.663 INFO:teuthology.orchestra.run.smithi045.stdout: -701> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.openfiles remove_dirfrag [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=5553/5553 ap=1+0 state=1610874881|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=224 | child=1 dirty=1 authpin=1 0x55576d056400] 2023-10-03T19:21:05.663 INFO:teuthology.orchestra.run.smithi045.stdout: -700> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.server killing client lease of [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) v=6006 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55576d182000] 2023-10-03T19:21:05.663 INFO:teuthology.orchestra.run.smithi045.stdout: -699> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 20 mds.0.cache.den(0x1 dc-dir) remove_client_lease client.5697 on (dn sync l) 2023-10-03T19:21:05.663 INFO:teuthology.orchestra.run.smithi045.stdout: -698> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.19 send_message_client client.5697 172.21.15.146:0/3677171105 client_session(close) v5 2023-10-03T19:21:05.664 INFO:teuthology.orchestra.run.smithi045.stdout: -697> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> 172.21.15.146:0/3677171105 -- client_session(close) v5 -- 0x55576d3cac40 con 0x55576c23b000 2023-10-03T19:21:05.664 INFO:teuthology.orchestra.run.smithi045.stdout: -696> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 remove_session: mds.metrics: session=0x55576c0dcd00, client=client.5697 172.21.15.146:0/3677171105 2023-10-03T19:21:05.664 INFO:teuthology.orchestra.run.smithi045.stdout: -695> 2023-10-03T19:16:29.358+0000 7f3ed53bd640 10 mds.0.sessionmap remove_session s=0x55576c0dcd00 name=client.5697 2023-10-03T19:21:05.664 INFO:teuthology.orchestra.run.smithi045.stdout: -694> 2023-10-03T19:16:29.362+0000 7f3ed6bc0640 7 mds.0.19 mds has 1 queued contexts 2023-10-03T19:21:05.664 INFO:teuthology.orchestra.run.smithi045.stdout: -693> 2023-10-03T19:16:29.362+0000 7f3ed6bc0640 10 mds.0.19 finish 0x55576ed97d00 2023-10-03T19:21:05.664 INFO:teuthology.orchestra.run.smithi045.stdout: -692> 2023-10-03T19:16:29.362+0000 7f3ed6bc0640 10 MDSContext::complete: 15C_MDL_DropCache 2023-10-03T19:21:05.664 INFO:teuthology.orchestra.run.smithi045.stdout: -691> 2023-10-03T19:16:29.362+0000 7f3ed6bc0640 7 mds.0.locker rdlock_finish on (isnap sync) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (inest lock dirty) (ipolicy sync r=1) (iversion lock) | dirtyscattered=1 request=0 lock=1 dirfrag=1 caps=0 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:05.664 INFO:teuthology.orchestra.run.smithi045.stdout: -690> 2023-10-03T19:16:29.362+0000 7f3ed6bc0640 10 mds.0.locker simple_eval (isnap sync) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (inest lock dirty) (ipolicy sync r=1) (iversion lock) | dirtyscattered=1 request=0 lock=1 dirfrag=1 caps=0 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:05.664 INFO:teuthology.orchestra.run.smithi045.stdout: -689> 2023-10-03T19:16:29.362+0000 7f3ed6bc0640 7 mds.0.locker rdlock_finish on (ipolicy sync) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (inest lock dirty) (iversion lock) | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=0 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:05.664 INFO:teuthology.orchestra.run.smithi045.stdout: -688> 2023-10-03T19:16:29.362+0000 7f3ed6bc0640 10 mds.0.locker simple_eval (ipolicy sync) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (inest lock dirty) (iversion lock) | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=0 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:05.669 INFO:teuthology.orchestra.run.smithi045.stdout: -687> 2023-10-03T19:16:29.362+0000 7f3ed6bc0640 7 mds.0.locker rdlock_finish on (iauth sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6006 ap=1 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=4 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:05.669 INFO:teuthology.orchestra.run.smithi045.stdout: -686> 2023-10-03T19:16:29.362+0000 7f3ed6bc0640 10 mds.0.locker simple_eval (iauth sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6006 ap=1 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=4 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:05.669 INFO:teuthology.orchestra.run.smithi045.stdout: -685> 2023-10-03T19:16:29.362+0000 7f3ed6bc0640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6006 ap=1 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=4 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:05.669 INFO:teuthology.orchestra.run.smithi045.stdout: -684> 2023-10-03T19:16:29.362+0000 7f3ed6bc0640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6006 ap=1 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl) (iversion lock) | request=0 lock=3 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:05.669 INFO:teuthology.orchestra.run.smithi045.stdout: -683> 2023-10-03T19:16:29.362+0000 7f3ed6bc0640 20 mds.0.locker is excl 2023-10-03T19:21:05.669 INFO:teuthology.orchestra.run.smithi045.stdout: -682> 2023-10-03T19:16:29.362+0000 7f3ed6bc0640 7 mds.0.locker file_eval loner_issued= other_issued= xlocker_issued= 2023-10-03T19:21:05.669 INFO:teuthology.orchestra.run.smithi045.stdout: -681> 2023-10-03T19:16:29.362+0000 7f3ed6bc0640 20 mds.0.locker should lose it 2023-10-03T19:21:05.670 INFO:teuthology.orchestra.run.smithi045.stdout: -680> 2023-10-03T19:16:29.362+0000 7f3ed6bc0640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6006 ap=1 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl) (iversion lock) | request=0 lock=3 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:05.670 INFO:teuthology.orchestra.run.smithi045.stdout: -679> 2023-10-03T19:16:29.362+0000 7f3ed6bc0640 7 mds.0.locker rdlock_finish on (isnap sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6006 ap=1 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (inest lock w=1) (ipolicy sync r=1) (iversion lock) | request=0 lock=2 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:05.670 INFO:teuthology.orchestra.run.smithi045.stdout: -678> 2023-10-03T19:16:29.362+0000 7f3ed6bc0640 10 mds.0.locker simple_eval (isnap sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6006 ap=1 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (inest lock w=1) (ipolicy sync r=1) (iversion lock) | request=0 lock=2 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:05.670 INFO:teuthology.orchestra.run.smithi045.stdout: -677> 2023-10-03T19:16:29.362+0000 7f3ed6bc0640 7 mds.0.locker wrlock_finish on (inest lock w=1) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6006 ap=1 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (inest lock w=1) (ipolicy sync r=1) (iversion lock) | request=0 lock=2 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:05.670 INFO:teuthology.orchestra.run.smithi045.stdout: -676> 2023-10-03T19:16:29.362+0000 7f3ed6bc0640 10 mds.0.locker scatter_eval (inest lock) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6006 ap=1 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (inest lock) (ipolicy sync r=1) (iversion lock) | request=0 lock=1 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:05.670 INFO:teuthology.orchestra.run.smithi045.stdout: -675> 2023-10-03T19:16:29.362+0000 7f3ed6bc0640 7 mds.0.locker rdlock_finish on (ipolicy sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6006 ap=1 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (inest lock) (iversion lock) | request=0 lock=0 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:05.670 INFO:teuthology.orchestra.run.smithi045.stdout: -674> 2023-10-03T19:16:29.362+0000 7f3ed6bc0640 10 mds.0.locker simple_eval (ipolicy sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6006 ap=1 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (inest lock) (iversion lock) | request=0 lock=0 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x55576d0e0100] 2023-10-03T19:21:05.671 INFO:teuthology.orchestra.run.smithi045.stdout: -673> 2023-10-03T19:16:29.362+0000 7f3ed6bc0640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55576d146dc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6006 f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) (inest lock) (iversion lock) | request=0 lock=0 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=0 0x55576d0e0100] now 0 2023-10-03T19:21:05.671 INFO:teuthology.orchestra.run.smithi045.stdout: -672> 2023-10-03T19:16:29.362+0000 7f3ed6bc0640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth v=6007 cv=5559/5559 REP dir_auth=0 state=1610612737|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=0 0x55576c12ad00] by 0x55576d146dc0 count now 0/0 2023-10-03T19:21:05.671 INFO:teuthology.orchestra.run.smithi045.stdout: -671> 2023-10-03T19:16:29.362+0000 7f3ed6bc0640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55576d146dc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=5553/5553 state=1610612737|complete f(v0 m2023-10-03T19:16:14.507174+0000 1000=1000+0) n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=224 | child=1 dirty=1 authpin=0 0x55576d056400] count now 0 2023-10-03T19:21:05.671 INFO:teuthology.orchestra.run.smithi045.stdout: -670> 2023-10-03T19:16:29.362+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 117 ==== osd_op_reply(2185 10000000075.00000000 [delete] v50'23 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.671 INFO:teuthology.orchestra.run.smithi045.stdout: -669> 2023-10-03T19:16:29.362+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 118 ==== osd_op_reply(2200 10000000084.00000000 [delete] v50'24 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.671 INFO:teuthology.orchestra.run.smithi045.stdout: -668> 2023-10-03T19:16:29.362+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 119 ==== osd_op_reply(2229 100000000a1.00000000 [delete] v50'25 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.671 INFO:teuthology.orchestra.run.smithi045.stdout: -667> 2023-10-03T19:16:29.362+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 120 ==== osd_op_reply(2255 100000000bb.00000000 [delete] v50'26 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.671 INFO:teuthology.orchestra.run.smithi045.stdout: -666> 2023-10-03T19:16:29.362+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 121 ==== osd_op_reply(2301 100000000e9.00000000 [delete] v50'27 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.671 INFO:teuthology.orchestra.run.smithi045.stdout: -665> 2023-10-03T19:16:29.362+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 79 ==== osd_op_reply(2117 10000000031.00000000 [delete] v50'29 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.672 INFO:teuthology.orchestra.run.smithi045.stdout: -664> 2023-10-03T19:16:29.362+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] >> 172.21.15.146:0/3677171105 conn(0x55576c23b000 msgr2=0x55576d0e1180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 39 2023-10-03T19:21:05.672 INFO:teuthology.orchestra.run.smithi045.stdout: -663> 2023-10-03T19:16:29.362+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] >> 172.21.15.146:0/3677171105 conn(0x55576c23b000 msgr2=0x55576d0e1180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-03T19:21:05.672 INFO:teuthology.orchestra.run.smithi045.stdout: -662> 2023-10-03T19:16:29.362+0000 7f3eddbce640 1 --2- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] >> 172.21.15.146:0/3677171105 conn(0x55576c23b000 0x55576d0e1180 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T19:21:05.672 INFO:teuthology.orchestra.run.smithi045.stdout: -661> 2023-10-03T19:16:29.362+0000 7f3eddbce640 1 --2- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] >> 172.21.15.146:0/3677171105 conn(0x55576c23b000 0x55576d0e1180 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:05.672 INFO:teuthology.orchestra.run.smithi045.stdout: -660> 2023-10-03T19:16:29.362+0000 7f3edb3c9640 5 mds.a ms_handle_reset on 172.21.15.146:0/3677171105 2023-10-03T19:21:05.672 INFO:teuthology.orchestra.run.smithi045.stdout: -659> 2023-10-03T19:16:29.362+0000 7f3edb3c9640 3 mds.a ms_handle_reset closing connection for session client.5697 172.21.15.146:0/3677171105 2023-10-03T19:21:05.672 INFO:teuthology.orchestra.run.smithi045.stdout: -658> 2023-10-03T19:16:29.362+0000 7f3edb3c9640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] >> 172.21.15.146:0/3677171105 conn(0x55576c23b000 msgr2=0x55576d0e1180 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-10-03T19:21:05.672 INFO:teuthology.orchestra.run.smithi045.stdout: -657> 2023-10-03T19:16:29.362+0000 7f3edb3c9640 1 --2- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] >> 172.21.15.146:0/3677171105 conn(0x55576c23b000 0x55576d0e1180 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:05.672 INFO:teuthology.orchestra.run.smithi045.stdout: -656> 2023-10-03T19:16:29.362+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 122 ==== osd_op_reply(2189 10000000079.00000000 [delete] v50'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.672 INFO:teuthology.orchestra.run.smithi045.stdout: -655> 2023-10-03T19:16:29.362+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 123 ==== osd_op_reply(2244 100000000b0.00000000 [delete] v50'33 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.672 INFO:teuthology.orchestra.run.smithi045.stdout: -654> 2023-10-03T19:16:29.366+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 80 ==== osd_op_reply(2276 100000000d0.00000000 [delete] v50'30 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.673 INFO:teuthology.orchestra.run.smithi045.stdout: -653> 2023-10-03T19:16:29.366+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 153 ==== osd_op_reply(2219 10000000097.00000000 [delete] v50'23 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.673 INFO:teuthology.orchestra.run.smithi045.stdout: -652> 2023-10-03T19:16:29.366+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 154 ==== osd_op_reply(2141 10000000049.00000000 [delete] v50'36 uv35 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.673 INFO:teuthology.orchestra.run.smithi045.stdout: -651> 2023-10-03T19:16:29.366+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 124 ==== osd_op_reply(2275 100000000cf.00000000 [delete] v50'34 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.673 INFO:teuthology.orchestra.run.smithi045.stdout: -650> 2023-10-03T19:16:29.366+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 125 ==== osd_op_reply(2304 100000000ec.00000000 [delete] v50'28 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.673 INFO:teuthology.orchestra.run.smithi045.stdout: -649> 2023-10-03T19:16:29.366+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 126 ==== osd_op_reply(2371 1000000012f.00000000 [delete] v50'29 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.673 INFO:teuthology.orchestra.run.smithi045.stdout: -648> 2023-10-03T19:16:29.366+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 127 ==== osd_op_reply(2414 1000000015a.00000000 [delete] v50'30 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.673 INFO:teuthology.orchestra.run.smithi045.stdout: -647> 2023-10-03T19:16:29.366+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 147 ==== osd_op_reply(2073 10000000005.00000000 [delete] v50'27 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.673 INFO:teuthology.orchestra.run.smithi045.stdout: -646> 2023-10-03T19:16:29.366+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 148 ==== osd_op_reply(2163 1000000005f.00000000 [delete] v50'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.673 INFO:teuthology.orchestra.run.smithi045.stdout: -645> 2023-10-03T19:16:29.366+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 149 ==== osd_op_reply(2395 10000000147.00000000 [delete] v50'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.673 INFO:teuthology.orchestra.run.smithi045.stdout: -644> 2023-10-03T19:16:29.366+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 150 ==== osd_op_reply(2367 1000000012b.00000000 [delete] v50'28 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.673 INFO:teuthology.orchestra.run.smithi045.stdout: -643> 2023-10-03T19:16:29.366+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 151 ==== osd_op_reply(2075 10000000007.00000000 [delete] v50'37 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.674 INFO:teuthology.orchestra.run.smithi045.stdout: -642> 2023-10-03T19:16:29.370+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 128 ==== osd_op_reply(2511 100000001bb.00000000 [delete] v50'31 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.674 INFO:teuthology.orchestra.run.smithi045.stdout: -641> 2023-10-03T19:16:29.370+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 129 ==== osd_op_reply(2392 10000000144.00000000 [delete] v50'35 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.674 INFO:teuthology.orchestra.run.smithi045.stdout: -640> 2023-10-03T19:16:29.370+0000 7f3ed73c1640 2 mds.0.cache Memory usage: total 303832, rss 75940, heap 207144, baseline 190760, 0 / 1014 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:05.674 INFO:teuthology.orchestra.run.smithi045.stdout: -639> 2023-10-03T19:16:29.370+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 130 ==== osd_op_reply(2469 10000000191.00000000 [delete] v50'36 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.674 INFO:teuthology.orchestra.run.smithi045.stdout: -638> 2023-10-03T19:16:29.370+0000 7f3ed73c1640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999990702s ago 2023-10-03T19:21:05.674 INFO:teuthology.orchestra.run.smithi045.stdout: -637> 2023-10-03T19:16:29.370+0000 7f3ed73c1640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:05.674 INFO:teuthology.orchestra.run.smithi045.stdout: -636> 2023-10-03T19:16:29.370+0000 7f3ed73c1640 7 mds.0.cache trim bytes_used=2MB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:05.674 INFO:teuthology.orchestra.run.smithi045.stdout: -635> 2023-10-03T19:16:29.370+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 131 ==== osd_op_reply(2507 100000001b7.00000000 [delete] v50'37 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.674 INFO:teuthology.orchestra.run.smithi045.stdout: -634> 2023-10-03T19:16:29.370+0000 7f3ed73c1640 7 mds.0.cache trim_lru trimming 0 items from LRU size=1011 mid=543 pintail=235 pinned=235 2023-10-03T19:21:05.674 INFO:teuthology.orchestra.run.smithi045.stdout: -633> 2023-10-03T19:16:29.370+0000 7f3ed73c1640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:05.674 INFO:teuthology.orchestra.run.smithi045.stdout: -632> 2023-10-03T19:16:29.370+0000 7f3ed73c1640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:05.675 INFO:teuthology.orchestra.run.smithi045.stdout: -631> 2023-10-03T19:16:29.370+0000 7f3ed73c1640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:05.675 INFO:teuthology.orchestra.run.smithi045.stdout: -630> 2023-10-03T19:16:29.370+0000 7f3ed73c1640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:05.675 INFO:teuthology.orchestra.run.smithi045.stdout: -629> 2023-10-03T19:16:29.370+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 155 ==== osd_op_reply(2097 1000000001d.00000000 [delete] v50'43 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.675 INFO:teuthology.orchestra.run.smithi045.stdout: -628> 2023-10-03T19:16:29.370+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 132 ==== osd_op_reply(2512 100000001bc.00000000 [delete] v50'38 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.744 INFO:teuthology.orchestra.run.smithi045.stdout: -627> 2023-10-03T19:16:29.370+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 156 ==== osd_op_reply(2116 10000000030.00000000 [delete] v50'27 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.745 INFO:teuthology.orchestra.run.smithi045.stdout: -626> 2023-10-03T19:16:29.374+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 133 ==== osd_op_reply(2515 100000001bf.00000000 [delete] v50'39 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.745 INFO:teuthology.orchestra.run.smithi045.stdout: -625> 2023-10-03T19:16:29.374+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 134 ==== osd_op_reply(2516 100000001c0.00000000 [delete] v50'40 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.745 INFO:teuthology.orchestra.run.smithi045.stdout: -624> 2023-10-03T19:16:29.374+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 131 ==== osd_op_reply(2088 10000000014.00000000 [delete] v50'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.745 INFO:teuthology.orchestra.run.smithi045.stdout: -623> 2023-10-03T19:16:29.378+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 152 ==== osd_op_reply(2070 10000000002.00000000 [delete] v50'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.746 INFO:teuthology.orchestra.run.smithi045.stdout: -622> 2023-10-03T19:16:29.378+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 153 ==== osd_op_reply(2083 1000000000f.00000000 [delete] v50'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.746 INFO:teuthology.orchestra.run.smithi045.stdout: -621> 2023-10-03T19:16:29.378+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 132 ==== osd_op_reply(2110 1000000002a.00000000 [delete] v50'19 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.746 INFO:teuthology.orchestra.run.smithi045.stdout: -620> 2023-10-03T19:16:29.378+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 154 ==== osd_op_reply(2114 1000000002e.00000000 [delete] v50'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.746 INFO:teuthology.orchestra.run.smithi045.stdout: -619> 2023-10-03T19:16:29.378+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 155 ==== osd_op_reply(2140 10000000048.00000000 [delete] v50'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.746 INFO:teuthology.orchestra.run.smithi045.stdout: -618> 2023-10-03T19:16:29.378+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 133 ==== osd_op_reply(2127 1000000003b.00000000 [delete] v50'20 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.747 INFO:teuthology.orchestra.run.smithi045.stdout: -617> 2023-10-03T19:16:29.378+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 156 ==== osd_op_reply(2217 10000000095.00000000 [delete] v50'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.747 INFO:teuthology.orchestra.run.smithi045.stdout: -616> 2023-10-03T19:16:29.378+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 157 ==== osd_op_reply(2237 100000000a9.00000000 [delete] v50'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.747 INFO:teuthology.orchestra.run.smithi045.stdout: -615> 2023-10-03T19:16:29.378+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 158 ==== osd_op_reply(2294 100000000e2.00000000 [delete] v50'41 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.747 INFO:teuthology.orchestra.run.smithi045.stdout: -614> 2023-10-03T19:16:29.378+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 159 ==== osd_op_reply(2122 10000000036.00000000 [delete] v50'45 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.747 INFO:teuthology.orchestra.run.smithi045.stdout: -613> 2023-10-03T19:16:29.378+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 160 ==== osd_op_reply(2133 10000000041.00000000 [delete] v50'46 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.748 INFO:teuthology.orchestra.run.smithi045.stdout: -612> 2023-10-03T19:16:29.378+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 161 ==== osd_op_reply(2176 1000000006c.00000000 [delete] v50'47 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.748 INFO:teuthology.orchestra.run.smithi045.stdout: -611> 2023-10-03T19:16:29.378+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 162 ==== osd_op_reply(2228 100000000a0.00000000 [delete] v50'48 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.748 INFO:teuthology.orchestra.run.smithi045.stdout: -610> 2023-10-03T19:16:29.378+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 163 ==== osd_op_reply(2242 100000000ae.00000000 [delete] v50'49 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.748 INFO:teuthology.orchestra.run.smithi045.stdout: -609> 2023-10-03T19:16:29.378+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 135 ==== osd_op_reply(2172 10000000068.00000000 [delete] v50'23 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.748 INFO:teuthology.orchestra.run.smithi045.stdout: -608> 2023-10-03T19:16:29.378+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 136 ==== osd_op_reply(2086 10000000012.00000000 [delete] v50'33 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.748 INFO:teuthology.orchestra.run.smithi045.stdout: -607> 2023-10-03T19:16:29.378+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 137 ==== osd_op_reply(2107 10000000027.00000000 [delete] v50'34 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.748 INFO:teuthology.orchestra.run.smithi045.stdout: -606> 2023-10-03T19:16:29.378+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 138 ==== osd_op_reply(2311 100000000f3.00000000 [delete] v50'35 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.748 INFO:teuthology.orchestra.run.smithi045.stdout: -605> 2023-10-03T19:16:29.378+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 139 ==== osd_op_reply(2336 1000000010c.00000000 [delete] v50'36 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.748 INFO:teuthology.orchestra.run.smithi045.stdout: -604> 2023-10-03T19:16:29.378+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 157 ==== osd_op_reply(2164 10000000060.00000000 [delete] v50'28 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.748 INFO:teuthology.orchestra.run.smithi045.stdout: -603> 2023-10-03T19:16:29.378+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 134 ==== osd_op_reply(2181 10000000071.00000000 [delete] v50'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.749 INFO:teuthology.orchestra.run.smithi045.stdout: -602> 2023-10-03T19:16:29.378+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 158 ==== osd_op_reply(2173 10000000069.00000000 [delete] v50'29 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.749 INFO:teuthology.orchestra.run.smithi045.stdout: -601> 2023-10-03T19:16:29.378+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 135 ==== osd_op_reply(2119 10000000033.00000000 [delete] v50'21 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.749 INFO:teuthology.orchestra.run.smithi045.stdout: -600> 2023-10-03T19:16:29.378+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 136 ==== osd_op_reply(2155 10000000057.00000000 [delete] v50'43 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.749 INFO:teuthology.orchestra.run.smithi045.stdout: -599> 2023-10-03T19:16:29.378+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 137 ==== osd_op_reply(2182 10000000072.00000000 [delete] v50'44 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.749 INFO:teuthology.orchestra.run.smithi045.stdout: -598> 2023-10-03T19:16:29.378+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 138 ==== osd_op_reply(2078 1000000000a.00000000 [delete] v50'41 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.749 INFO:teuthology.orchestra.run.smithi045.stdout: -597> 2023-10-03T19:16:29.378+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 140 ==== osd_op_reply(2178 1000000006e.00000000 [delete] v50'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.749 INFO:teuthology.orchestra.run.smithi045.stdout: -596> 2023-10-03T19:16:29.378+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 139 ==== osd_op_reply(2080 1000000000c.00000000 [delete] v50'42 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.749 INFO:teuthology.orchestra.run.smithi045.stdout: -595> 2023-10-03T19:16:29.378+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 140 ==== osd_op_reply(2087 10000000013.00000000 [delete] v50'43 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.749 INFO:teuthology.orchestra.run.smithi045.stdout: -594> 2023-10-03T19:16:29.378+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 159 ==== osd_op_reply(2089 10000000015.00000000 [delete] v50'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.749 INFO:teuthology.orchestra.run.smithi045.stdout: -593> 2023-10-03T19:16:29.378+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 160 ==== osd_op_reply(2137 10000000045.00000000 [delete] v50'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.749 INFO:teuthology.orchestra.run.smithi045.stdout: -592> 2023-10-03T19:16:29.378+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 161 ==== osd_op_reply(2191 1000000007b.00000000 [delete] v50'27 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.750 INFO:teuthology.orchestra.run.smithi045.stdout: -591> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 162 ==== osd_op_reply(2145 1000000004d.00000000 [delete] v50'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.750 INFO:teuthology.orchestra.run.smithi045.stdout: -590> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 163 ==== osd_op_reply(2210 1000000008e.00000000 [delete] v50'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.750 INFO:teuthology.orchestra.run.smithi045.stdout: -589> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 164 ==== osd_op_reply(2224 1000000009c.00000000 [delete] v50'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.750 INFO:teuthology.orchestra.run.smithi045.stdout: -588> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 81 ==== osd_op_reply(2300 100000000e8.00000000 [delete] v50'31 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.750 INFO:teuthology.orchestra.run.smithi045.stdout: -587> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 82 ==== osd_op_reply(2390 10000000142.00000000 [delete] v50'32 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.750 INFO:teuthology.orchestra.run.smithi045.stdout: -586> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 83 ==== osd_op_reply(2444 10000000178.00000000 [delete] v50'33 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.750 INFO:teuthology.orchestra.run.smithi045.stdout: -585> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 84 ==== osd_op_reply(2458 10000000186.00000000 [delete] v50'34 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.750 INFO:teuthology.orchestra.run.smithi045.stdout: -584> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 85 ==== osd_op_reply(2473 10000000195.00000000 [delete] v50'35 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.750 INFO:teuthology.orchestra.run.smithi045.stdout: -583> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 86 ==== osd_op_reply(2551 100000001e3.00000000 [delete] v50'36 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.750 INFO:teuthology.orchestra.run.smithi045.stdout: -582> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 377 ==== osd_op_reply(2174 1000000006a.00000000 [delete] v50'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.750 INFO:teuthology.orchestra.run.smithi045.stdout: -581> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 378 ==== osd_op_reply(2214 10000000092.00000000 [delete] v50'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.751 INFO:teuthology.orchestra.run.smithi045.stdout: -580> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 379 ==== osd_op_reply(2123 10000000037.00000000 [delete] v50'45 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.751 INFO:teuthology.orchestra.run.smithi045.stdout: -579> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 380 ==== osd_op_reply(2104 10000000024.00000000 [delete] v50'37 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.751 INFO:teuthology.orchestra.run.smithi045.stdout: -578> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 381 ==== osd_op_reply(2215 10000000093.00000000 [delete] v50'33 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.751 INFO:teuthology.orchestra.run.smithi045.stdout: -577> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 382 ==== osd_op_reply(2154 10000000056.00000000 [delete] v50'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.769 INFO:teuthology.orchestra.run.smithi045.stdout: -576> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 383 ==== osd_op_reply(2129 1000000003d.00000000 [delete] v50'46 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.769 INFO:teuthology.orchestra.run.smithi045.stdout: -575> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 384 ==== osd_op_reply(2093 10000000019.00000000 [delete] v50'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.769 INFO:teuthology.orchestra.run.smithi045.stdout: -574> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 385 ==== osd_op_reply(2183 10000000073.00000000 [delete] v50'23 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.770 INFO:teuthology.orchestra.run.smithi045.stdout: -573> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 386 ==== osd_op_reply(2134 10000000042.00000000 [delete] v50'47 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.770 INFO:teuthology.orchestra.run.smithi045.stdout: -572> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 387 ==== osd_op_reply(2115 1000000002f.00000000 [delete] v50'29 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.770 INFO:teuthology.orchestra.run.smithi045.stdout: -571> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 388 ==== osd_op_reply(2132 10000000040.00000000 [delete] v50'30 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.770 INFO:teuthology.orchestra.run.smithi045.stdout: -570> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 389 ==== osd_op_reply(2226 1000000009e.00000000 [delete] v50'24 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.770 INFO:teuthology.orchestra.run.smithi045.stdout: -569> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 390 ==== osd_op_reply(2144 1000000004c.00000000 [delete] v50'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.770 INFO:teuthology.orchestra.run.smithi045.stdout: -568> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 391 ==== osd_op_reply(2159 1000000005b.00000000 [delete] v50'25 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.770 INFO:teuthology.orchestra.run.smithi045.stdout: -567> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 392 ==== osd_op_reply(2232 100000000a4.00000000 [delete] v50'34 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.770 INFO:teuthology.orchestra.run.smithi045.stdout: -566> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 393 ==== osd_op_reply(2092 10000000018.00000000 [delete] v50'33 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.770 INFO:teuthology.orchestra.run.smithi045.stdout: -565> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 394 ==== osd_op_reply(2098 1000000001e.00000000 [delete] v50'40 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.770 INFO:teuthology.orchestra.run.smithi045.stdout: -564> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 395 ==== osd_op_reply(2136 10000000044.00000000 [delete] v50'34 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.771 INFO:teuthology.orchestra.run.smithi045.stdout: -563> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 396 ==== osd_op_reply(2131 1000000003f.00000000 [delete] v50'41 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.771 INFO:teuthology.orchestra.run.smithi045.stdout: -562> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 397 ==== osd_op_reply(2153 10000000055.00000000 [delete] v50'42 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.771 INFO:teuthology.orchestra.run.smithi045.stdout: -561> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 398 ==== osd_op_reply(2221 10000000099.00000000 [delete] v50'43 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.771 INFO:teuthology.orchestra.run.smithi045.stdout: -560> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 399 ==== osd_op_reply(2142 1000000004a.00000000 [delete] v50'38 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.771 INFO:teuthology.orchestra.run.smithi045.stdout: -559> 2023-10-03T19:16:29.382+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 400 ==== osd_op_reply(2204 10000000088.00000000 [delete] v50'39 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.771 INFO:teuthology.orchestra.run.smithi045.stdout: -558> 2023-10-03T19:16:29.382+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 164 ==== osd_op_reply(2431 1000000016b.00000000 [delete] v50'25 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.771 INFO:teuthology.orchestra.run.smithi045.stdout: -557> 2023-10-03T19:16:29.382+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 165 ==== osd_op_reply(2441 10000000175.00000000 [delete] v50'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.771 INFO:teuthology.orchestra.run.smithi045.stdout: -556> 2023-10-03T19:16:29.382+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 166 ==== osd_op_reply(2434 1000000016e.00000000 [delete] v50'26 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.771 INFO:teuthology.orchestra.run.smithi045.stdout: -555> 2023-10-03T19:16:29.382+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 167 ==== osd_op_reply(2459 10000000187.00000000 [delete] v50'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.771 INFO:teuthology.orchestra.run.smithi045.stdout: -554> 2023-10-03T19:16:29.382+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 168 ==== osd_op_reply(2460 10000000188.00000000 [delete] v50'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.771 INFO:teuthology.orchestra.run.smithi045.stdout: -553> 2023-10-03T19:16:29.382+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 169 ==== osd_op_reply(2493 100000001a9.00000000 [delete] v50'41 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.772 INFO:teuthology.orchestra.run.smithi045.stdout: -552> 2023-10-03T19:16:29.382+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 170 ==== osd_op_reply(2549 100000001e1.00000000 [delete] v50'42 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.772 INFO:teuthology.orchestra.run.smithi045.stdout: -551> 2023-10-03T19:16:29.382+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 171 ==== osd_op_reply(2543 100000001db.00000000 [delete] v50'27 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.789 INFO:teuthology.orchestra.run.smithi045.stdout: -550> 2023-10-03T19:16:29.382+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 172 ==== osd_op_reply(2555 100000001e7.00000000 [delete] v50'28 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.789 INFO:teuthology.orchestra.run.smithi045.stdout: -549> 2023-10-03T19:16:29.382+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 173 ==== osd_op_reply(2194 1000000007e.00000000 [delete] v50'40 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.789 INFO:teuthology.orchestra.run.smithi045.stdout: -548> 2023-10-03T19:16:29.382+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 174 ==== osd_op_reply(2277 100000000d1.00000000 [delete] v50'34 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.789 INFO:teuthology.orchestra.run.smithi045.stdout: -547> 2023-10-03T19:16:29.386+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 175 ==== osd_op_reply(2303 100000000eb.00000000 [delete] v50'35 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.789 INFO:teuthology.orchestra.run.smithi045.stdout: -546> 2023-10-03T19:16:29.386+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 176 ==== osd_op_reply(2322 100000000fe.00000000 [delete] v50'41 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.789 INFO:teuthology.orchestra.run.smithi045.stdout: -545> 2023-10-03T19:16:29.386+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 177 ==== osd_op_reply(2375 10000000133.00000000 [delete] v50'42 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.790 INFO:teuthology.orchestra.run.smithi045.stdout: -544> 2023-10-03T19:16:29.386+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 178 ==== osd_op_reply(2468 10000000190.00000000 [delete] v50'36 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.790 INFO:teuthology.orchestra.run.smithi045.stdout: -543> 2023-10-03T19:16:29.386+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 179 ==== osd_op_reply(2423 10000000163.00000000 [delete] v50'43 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.790 INFO:teuthology.orchestra.run.smithi045.stdout: -542> 2023-10-03T19:16:29.386+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 180 ==== osd_op_reply(2523 100000001c7.00000000 [delete] v50'37 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.790 INFO:teuthology.orchestra.run.smithi045.stdout: -541> 2023-10-03T19:16:29.386+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 141 ==== osd_op_reply(2100 10000000020.00000000 [delete] v50'44 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.790 INFO:teuthology.orchestra.run.smithi045.stdout: -540> 2023-10-03T19:16:29.386+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 165 ==== osd_op_reply(2160 1000000005c.00000000 [delete] v50'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.790 INFO:teuthology.orchestra.run.smithi045.stdout: -539> 2023-10-03T19:16:29.386+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 166 ==== osd_op_reply(2166 10000000062.00000000 [delete] v50'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.790 INFO:teuthology.orchestra.run.smithi045.stdout: -538> 2023-10-03T19:16:29.386+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 167 ==== osd_op_reply(2195 1000000007f.00000000 [delete] v50'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.790 INFO:teuthology.orchestra.run.smithi045.stdout: -537> 2023-10-03T19:16:29.386+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 168 ==== osd_op_reply(2196 10000000080.00000000 [delete] v50'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.790 INFO:teuthology.orchestra.run.smithi045.stdout: -536> 2023-10-03T19:16:29.386+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 169 ==== osd_op_reply(2225 1000000009d.00000000 [delete] v50'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.790 INFO:teuthology.orchestra.run.smithi045.stdout: -535> 2023-10-03T19:16:29.386+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 142 ==== osd_op_reply(2118 10000000032.00000000 [delete] v50'39 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.790 INFO:teuthology.orchestra.run.smithi045.stdout: -534> 2023-10-03T19:16:29.386+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 170 ==== osd_op_reply(2218 10000000096.00000000 [delete] v50'44 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.791 INFO:teuthology.orchestra.run.smithi045.stdout: -533> 2023-10-03T19:16:29.386+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 171 ==== osd_op_reply(2407 10000000153.00000000 [delete] v50'28 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.791 INFO:teuthology.orchestra.run.smithi045.stdout: -532> 2023-10-03T19:16:29.386+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 143 ==== osd_op_reply(2201 10000000085.00000000 [delete] v50'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.791 INFO:teuthology.orchestra.run.smithi045.stdout: -531> 2023-10-03T19:16:29.386+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 172 ==== osd_op_reply(2262 100000000c2.00000000 [delete] v50'41 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.791 INFO:teuthology.orchestra.run.smithi045.stdout: -530> 2023-10-03T19:16:29.386+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 144 ==== osd_op_reply(2143 1000000004b.00000000 [delete] v50'40 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.791 INFO:teuthology.orchestra.run.smithi045.stdout: -529> 2023-10-03T19:16:29.386+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 173 ==== osd_op_reply(2227 1000000009f.00000000 [delete] v50'45 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.791 INFO:teuthology.orchestra.run.smithi045.stdout: -528> 2023-10-03T19:16:29.386+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 145 ==== osd_op_reply(2285 100000000d9.00000000 [delete] v50'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.791 INFO:teuthology.orchestra.run.smithi045.stdout: -527> 2023-10-03T19:16:29.386+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 174 ==== osd_op_reply(2306 100000000ee.00000000 [delete] v50'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.791 INFO:teuthology.orchestra.run.smithi045.stdout: -526> 2023-10-03T19:16:29.386+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 146 ==== osd_op_reply(2329 10000000105.00000000 [delete] v50'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.791 INFO:teuthology.orchestra.run.smithi045.stdout: -525> 2023-10-03T19:16:29.386+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 175 ==== osd_op_reply(2267 100000000c7.00000000 [delete] v50'42 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.791 INFO:teuthology.orchestra.run.smithi045.stdout: -524> 2023-10-03T19:16:29.386+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 176 ==== osd_op_reply(2299 100000000e7.00000000 [delete] v50'43 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.791 INFO:teuthology.orchestra.run.smithi045.stdout: -523> 2023-10-03T19:16:29.386+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 147 ==== osd_op_reply(2202 10000000086.00000000 [delete] v50'45 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.792 INFO:teuthology.orchestra.run.smithi045.stdout: -522> 2023-10-03T19:16:29.386+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 177 ==== osd_op_reply(2320 100000000fc.00000000 [delete] v50'44 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.792 INFO:teuthology.orchestra.run.smithi045.stdout: -521> 2023-10-03T19:16:29.386+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 178 ==== osd_op_reply(2248 100000000b4.00000000 [delete] v50'24 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.792 INFO:teuthology.orchestra.run.smithi045.stdout: -520> 2023-10-03T19:16:29.386+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 179 ==== osd_op_reply(2309 100000000f1.00000000 [delete] v50'25 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.792 INFO:teuthology.orchestra.run.smithi045.stdout: -519> 2023-10-03T19:16:29.386+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 180 ==== osd_op_reply(2331 10000000107.00000000 [delete] v50'26 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.792 INFO:teuthology.orchestra.run.smithi045.stdout: -518> 2023-10-03T19:16:29.386+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 87 ==== osd_op_reply(2084 10000000010.00000000 [delete] v50'37 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.792 INFO:teuthology.orchestra.run.smithi045.stdout: -517> 2023-10-03T19:16:29.386+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 181 ==== osd_op_reply(2335 1000000010b.00000000 [delete] v50'27 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.792 INFO:teuthology.orchestra.run.smithi045.stdout: -516> 2023-10-03T19:16:29.386+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 148 ==== osd_op_reply(2354 1000000011e.00000000 [delete] v50'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.792 INFO:teuthology.orchestra.run.smithi045.stdout: -515> 2023-10-03T19:16:29.386+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 149 ==== osd_op_reply(2157 10000000059.00000000 [delete] v50'41 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.792 INFO:teuthology.orchestra.run.smithi045.stdout: -514> 2023-10-03T19:16:29.386+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.2 v2:172.21.15.45:6817/964866005 41 ==== osd_op_reply(2079 1000000000b.00000000 [delete] v50'47 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576d0f0400 2023-10-03T19:21:05.792 INFO:teuthology.orchestra.run.smithi045.stdout: -513> 2023-10-03T19:16:29.386+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 150 ==== osd_op_reply(2220 10000000098.00000000 [delete] v50'46 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.792 INFO:teuthology.orchestra.run.smithi045.stdout: -512> 2023-10-03T19:16:29.386+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 151 ==== osd_op_reply(2327 10000000103.00000000 [delete] v50'42 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.793 INFO:teuthology.orchestra.run.smithi045.stdout: -511> 2023-10-03T19:16:29.386+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 152 ==== osd_op_reply(2318 100000000fa.00000000 [delete] v50'47 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.793 INFO:teuthology.orchestra.run.smithi045.stdout: -510> 2023-10-03T19:16:29.386+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 153 ==== osd_op_reply(2272 100000000cc.00000000 [delete] v50'22 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.793 INFO:teuthology.orchestra.run.smithi045.stdout: -509> 2023-10-03T19:16:29.386+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 154 ==== osd_op_reply(2325 10000000101.00000000 [delete] v50'23 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.793 INFO:teuthology.orchestra.run.smithi045.stdout: -508> 2023-10-03T19:16:29.386+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.2 v2:172.21.15.45:6817/964866005 42 ==== osd_op_reply(2206 1000000008a.00000000 [delete] v50'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576d0f0400 2023-10-03T19:21:05.793 INFO:teuthology.orchestra.run.smithi045.stdout: -507> 2023-10-03T19:16:29.386+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 88 ==== osd_op_reply(2238 100000000aa.00000000 [delete] v50'38 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.793 INFO:teuthology.orchestra.run.smithi045.stdout: -506> 2023-10-03T19:16:29.386+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 89 ==== osd_op_reply(2388 10000000140.00000000 [delete] v50'39 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.793 INFO:teuthology.orchestra.run.smithi045.stdout: -505> 2023-10-03T19:16:29.390+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 90 ==== osd_op_reply(2545 100000001dd.00000000 [delete] v50'40 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.793 INFO:teuthology.orchestra.run.smithi045.stdout: -504> 2023-10-03T19:16:29.390+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 181 ==== osd_op_reply(2315 100000000f7.00000000 [delete] v50'42 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.794 INFO:teuthology.orchestra.run.smithi045.stdout: -503> 2023-10-03T19:16:29.390+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 182 ==== osd_op_reply(2313 100000000f5.00000000 [delete] v50'50 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.794 INFO:teuthology.orchestra.run.smithi045.stdout: -502> 2023-10-03T19:16:29.390+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 141 ==== osd_op_reply(2269 100000000c9.00000000 [delete] v50'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.794 INFO:teuthology.orchestra.run.smithi045.stdout: -501> 2023-10-03T19:16:29.390+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 142 ==== osd_op_reply(2274 100000000ce.00000000 [delete] v50'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.794 INFO:teuthology.orchestra.run.smithi045.stdout: -500> 2023-10-03T19:16:29.390+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 143 ==== osd_op_reply(2233 100000000a5.00000000 [delete] v50'24 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.794 INFO:teuthology.orchestra.run.smithi045.stdout: -499> 2023-10-03T19:16:29.390+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 144 ==== osd_op_reply(2264 100000000c4.00000000 [delete] v50'25 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.794 INFO:teuthology.orchestra.run.smithi045.stdout: -498> 2023-10-03T19:16:29.390+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 145 ==== osd_op_reply(2282 100000000d6.00000000 [delete] v50'26 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.794 INFO:teuthology.orchestra.run.smithi045.stdout: -497> 2023-10-03T19:16:29.390+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 146 ==== osd_op_reply(2389 10000000141.00000000 [delete] v50'37 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.794 INFO:teuthology.orchestra.run.smithi045.stdout: -496> 2023-10-03T19:16:29.390+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 147 ==== osd_op_reply(2383 1000000013b.00000000 [delete] v50'27 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.794 INFO:teuthology.orchestra.run.smithi045.stdout: -495> 2023-10-03T19:16:29.390+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 148 ==== osd_op_reply(2508 100000001b8.00000000 [delete] v50'38 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.794 INFO:teuthology.orchestra.run.smithi045.stdout: -494> 2023-10-03T19:16:29.390+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 149 ==== osd_op_reply(2446 1000000017a.00000000 [delete] v50'28 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.794 INFO:teuthology.orchestra.run.smithi045.stdout: -493> 2023-10-03T19:16:29.390+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 150 ==== osd_op_reply(2569 100000001f5.00000000 [delete] v50'39 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.795 INFO:teuthology.orchestra.run.smithi045.stdout: -492> 2023-10-03T19:16:29.390+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 151 ==== osd_op_reply(2397 10000000149.00000000 [delete] v50'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.795 INFO:teuthology.orchestra.run.smithi045.stdout: -491> 2023-10-03T19:16:29.390+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 152 ==== osd_op_reply(2524 100000001c8.00000000 [delete] v50'29 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.795 INFO:teuthology.orchestra.run.smithi045.stdout: -490> 2023-10-03T19:16:29.390+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 153 ==== osd_op_reply(2556 100000001e8.00000000 [delete] v50'30 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.795 INFO:teuthology.orchestra.run.smithi045.stdout: -489> 2023-10-03T19:16:29.390+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 183 ==== osd_op_reply(2355 1000000011f.00000000 [delete] v50'51 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.811 INFO:teuthology.orchestra.run.smithi045.stdout: -488> 2023-10-03T19:16:29.390+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 184 ==== osd_op_reply(2475 10000000197.00000000 [delete] v50'43 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.811 INFO:teuthology.orchestra.run.smithi045.stdout: -487> 2023-10-03T19:16:29.390+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 185 ==== osd_op_reply(2387 1000000013f.00000000 [delete] v50'52 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.811 INFO:teuthology.orchestra.run.smithi045.stdout: -486> 2023-10-03T19:16:29.390+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 186 ==== osd_op_reply(2432 1000000016c.00000000 [delete] v50'53 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.812 INFO:teuthology.orchestra.run.smithi045.stdout: -485> 2023-10-03T19:16:29.390+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 187 ==== osd_op_reply(2457 10000000185.00000000 [delete] v50'54 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.812 INFO:teuthology.orchestra.run.smithi045.stdout: -484> 2023-10-03T19:16:29.390+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 188 ==== osd_op_reply(2489 100000001a5.00000000 [delete] v50'55 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.812 INFO:teuthology.orchestra.run.smithi045.stdout: -483> 2023-10-03T19:16:29.390+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 189 ==== osd_op_reply(2520 100000001c4.00000000 [delete] v50'44 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.812 INFO:teuthology.orchestra.run.smithi045.stdout: -482> 2023-10-03T19:16:29.390+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 154 ==== osd_op_reply(2558 100000001ea.00000000 [delete] v50'31 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.812 INFO:teuthology.orchestra.run.smithi045.stdout: -481> 2023-10-03T19:16:29.390+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 401 ==== osd_op_reply(2212 10000000090.00000000 [delete] v50'31 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.812 INFO:teuthology.orchestra.run.smithi045.stdout: -480> 2023-10-03T19:16:29.390+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 402 ==== osd_op_reply(2147 1000000004f.00000000 [delete] v50'33 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.812 INFO:teuthology.orchestra.run.smithi045.stdout: -479> 2023-10-03T19:16:29.390+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 403 ==== osd_op_reply(2162 1000000005e.00000000 [delete] v50'34 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.812 INFO:teuthology.orchestra.run.smithi045.stdout: -478> 2023-10-03T19:16:29.390+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 404 ==== osd_op_reply(2252 100000000b8.00000000 [delete] v50'32 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.812 INFO:teuthology.orchestra.run.smithi045.stdout: -477> 2023-10-03T19:16:29.390+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 405 ==== osd_op_reply(2347 10000000117.00000000 [delete] v50'33 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.812 INFO:teuthology.orchestra.run.smithi045.stdout: -476> 2023-10-03T19:16:29.390+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 406 ==== osd_op_reply(2380 10000000138.00000000 [delete] v50'48 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.812 INFO:teuthology.orchestra.run.smithi045.stdout: -475> 2023-10-03T19:16:29.390+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 407 ==== osd_op_reply(2259 100000000bf.00000000 [delete] v50'40 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.813 INFO:teuthology.orchestra.run.smithi045.stdout: -474> 2023-10-03T19:16:29.390+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 408 ==== osd_op_reply(2291 100000000df.00000000 [delete] v50'41 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.813 INFO:teuthology.orchestra.run.smithi045.stdout: -473> 2023-10-03T19:16:29.390+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 409 ==== osd_op_reply(2445 10000000179.00000000 [delete] v50'34 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.813 INFO:teuthology.orchestra.run.smithi045.stdout: -472> 2023-10-03T19:16:29.390+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 410 ==== osd_op_reply(2198 10000000082.00000000 [delete] v50'26 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.813 INFO:teuthology.orchestra.run.smithi045.stdout: -471> 2023-10-03T19:16:29.390+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 411 ==== osd_op_reply(2263 100000000c3.00000000 [delete] v50'37 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.813 INFO:teuthology.orchestra.run.smithi045.stdout: -470> 2023-10-03T19:16:29.390+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 412 ==== osd_op_reply(2295 100000000e3.00000000 [delete] v50'38 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.813 INFO:teuthology.orchestra.run.smithi045.stdout: -469> 2023-10-03T19:16:29.390+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 413 ==== osd_op_reply(2447 1000000017b.00000000 [delete] v50'35 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.813 INFO:teuthology.orchestra.run.smithi045.stdout: -468> 2023-10-03T19:16:29.390+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 414 ==== osd_op_reply(2179 1000000006f.00000000 [delete] v50'35 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.813 INFO:teuthology.orchestra.run.smithi045.stdout: -467> 2023-10-03T19:16:29.390+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 415 ==== osd_op_reply(2316 100000000f8.00000000 [delete] v50'39 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.813 INFO:teuthology.orchestra.run.smithi045.stdout: -466> 2023-10-03T19:16:29.390+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 155 ==== osd_op_reply(2391 10000000143.00000000 [delete] v50'48 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.813 INFO:teuthology.orchestra.run.smithi045.stdout: -465> 2023-10-03T19:16:29.390+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 156 ==== osd_op_reply(2490 100000001a6.00000000 [delete] v50'49 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.813 INFO:teuthology.orchestra.run.smithi045.stdout: -464> 2023-10-03T19:16:29.390+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 157 ==== osd_op_reply(2495 100000001ab.00000000 [delete] v50'50 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.813 INFO:teuthology.orchestra.run.smithi045.stdout: -463> 2023-10-03T19:16:29.390+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 158 ==== osd_op_reply(2535 100000001d3.00000000 [delete] v50'24 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.814 INFO:teuthology.orchestra.run.smithi045.stdout: -462> 2023-10-03T19:16:29.390+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 159 ==== osd_op_reply(2502 100000001b2.00000000 [delete] v50'51 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.814 INFO:teuthology.orchestra.run.smithi045.stdout: -461> 2023-10-03T19:16:29.390+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 160 ==== osd_op_reply(2546 100000001de.00000000 [delete] v50'52 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.814 INFO:teuthology.orchestra.run.smithi045.stdout: -460> 2023-10-03T19:16:29.390+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 161 ==== osd_op_reply(2405 10000000151.00000000 [delete] v50'43 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.814 INFO:teuthology.orchestra.run.smithi045.stdout: -459> 2023-10-03T19:16:29.390+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 162 ==== osd_op_reply(2409 10000000155.00000000 [delete] v50'44 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.814 INFO:teuthology.orchestra.run.smithi045.stdout: -458> 2023-10-03T19:16:29.390+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 163 ==== osd_op_reply(2430 1000000016a.00000000 [delete] v50'45 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.814 INFO:teuthology.orchestra.run.smithi045.stdout: -457> 2023-10-03T19:16:29.390+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.2 v2:172.21.15.45:6817/964866005 43 ==== osd_op_reply(2146 1000000004e.00000000 [delete] v50'48 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576d0f0400 2023-10-03T19:21:05.814 INFO:teuthology.orchestra.run.smithi045.stdout: -456> 2023-10-03T19:16:29.390+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.2 v2:172.21.15.45:6817/964866005 44 ==== osd_op_reply(2373 10000000131.00000000 [delete] v50'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576d0f0400 2023-10-03T19:21:05.814 INFO:teuthology.orchestra.run.smithi045.stdout: -455> 2023-10-03T19:16:29.390+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.2 v2:172.21.15.45:6817/964866005 45 ==== osd_op_reply(2386 1000000013e.00000000 [delete] v50'33 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576d0f0400 2023-10-03T19:21:05.814 INFO:teuthology.orchestra.run.smithi045.stdout: -454> 2023-10-03T19:16:29.390+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.2 v2:172.21.15.45:6817/964866005 46 ==== osd_op_reply(2413 10000000159.00000000 [delete] v50'34 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576d0f0400 2023-10-03T19:21:05.814 INFO:teuthology.orchestra.run.smithi045.stdout: -453> 2023-10-03T19:16:29.390+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.2 v2:172.21.15.45:6817/964866005 47 ==== osd_op_reply(2249 100000000b5.00000000 [delete] v50'49 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576d0f0400 2023-10-03T19:21:05.814 INFO:teuthology.orchestra.run.smithi045.stdout: -452> 2023-10-03T19:16:29.390+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 182 ==== osd_op_reply(2074 10000000006.00000000 [delete] v50'25 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.815 INFO:teuthology.orchestra.run.smithi045.stdout: -451> 2023-10-03T19:16:29.394+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 155 ==== osd_op_reply(2412 10000000158.00000000 [delete] v50'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.815 INFO:teuthology.orchestra.run.smithi045.stdout: -450> 2023-10-03T19:16:29.394+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 156 ==== osd_op_reply(2548 100000001e0.00000000 [delete] v50'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.815 INFO:teuthology.orchestra.run.smithi045.stdout: -449> 2023-10-03T19:16:29.394+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 157 ==== osd_op_reply(2408 10000000154.00000000 [delete] v50'48 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.815 INFO:teuthology.orchestra.run.smithi045.stdout: -448> 2023-10-03T19:16:29.394+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 190 ==== osd_op_reply(2108 10000000028.00000000 [delete] v50'38 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.815 INFO:teuthology.orchestra.run.smithi045.stdout: -447> 2023-10-03T19:16:29.394+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 191 ==== osd_op_reply(2175 1000000006b.00000000 [delete] v50'39 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.815 INFO:teuthology.orchestra.run.smithi045.stdout: -446> 2023-10-03T19:16:29.394+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 416 ==== osd_op_reply(2425 10000000165.00000000 [delete] v50'42 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.815 INFO:teuthology.orchestra.run.smithi045.stdout: -445> 2023-10-03T19:16:29.394+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 417 ==== osd_op_reply(2343 10000000113.00000000 [delete] v50'40 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.815 INFO:teuthology.orchestra.run.smithi045.stdout: -444> 2023-10-03T19:16:29.394+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 418 ==== osd_op_reply(2426 10000000166.00000000 [delete] v50'43 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.815 INFO:teuthology.orchestra.run.smithi045.stdout: -443> 2023-10-03T19:16:29.394+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 419 ==== osd_op_reply(2161 1000000005d.00000000 [delete] v50'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.815 INFO:teuthology.orchestra.run.smithi045.stdout: -442> 2023-10-03T19:16:29.394+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 420 ==== osd_op_reply(2211 1000000008f.00000000 [delete] v50'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.815 INFO:teuthology.orchestra.run.smithi045.stdout: -441> 2023-10-03T19:16:29.394+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 421 ==== osd_op_reply(2235 100000000a7.00000000 [delete] v50'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.824 INFO:teuthology.orchestra.run.smithi045.stdout: -440> 2023-10-03T19:16:29.394+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 422 ==== osd_op_reply(2321 100000000fd.00000000 [delete] v50'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.824 INFO:teuthology.orchestra.run.smithi045.stdout: -439> 2023-10-03T19:16:29.394+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 423 ==== osd_op_reply(2452 10000000180.00000000 [delete] v50'49 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.825 INFO:teuthology.orchestra.run.smithi045.stdout: -438> 2023-10-03T19:16:29.394+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 424 ==== osd_op_reply(2357 10000000121.00000000 [delete] v50'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.825 INFO:teuthology.orchestra.run.smithi045.stdout: -437> 2023-10-03T19:16:29.394+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 425 ==== osd_op_reply(2368 1000000012c.00000000 [delete] v50'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.825 INFO:teuthology.orchestra.run.smithi045.stdout: -436> 2023-10-03T19:16:29.394+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 426 ==== osd_op_reply(2382 1000000013a.00000000 [delete] v50'35 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.825 INFO:teuthology.orchestra.run.smithi045.stdout: -435> 2023-10-03T19:16:29.394+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 427 ==== osd_op_reply(2393 10000000145.00000000 [delete] v50'36 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.825 INFO:teuthology.orchestra.run.smithi045.stdout: -434> 2023-10-03T19:16:29.394+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.2 v2:172.21.15.45:6817/964866005 48 ==== osd_op_reply(2453 10000000181.00000000 [delete] v50'35 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576d0f0400 2023-10-03T19:21:05.825 INFO:teuthology.orchestra.run.smithi045.stdout: -433> 2023-10-03T19:16:29.394+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.2 v2:172.21.15.45:6817/964866005 49 ==== osd_op_reply(2281 100000000d5.00000000 [delete] v50'50 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576d0f0400 2023-10-03T19:21:05.825 INFO:teuthology.orchestra.run.smithi045.stdout: -432> 2023-10-03T19:16:29.394+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.2 v2:172.21.15.45:6817/964866005 50 ==== osd_op_reply(2492 100000001a8.00000000 [delete] v50'36 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576d0f0400 2023-10-03T19:21:05.825 INFO:teuthology.orchestra.run.smithi045.stdout: -431> 2023-10-03T19:16:29.394+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.2 v2:172.21.15.45:6817/964866005 51 ==== osd_op_reply(2410 10000000156.00000000 [delete] v50'51 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576d0f0400 2023-10-03T19:21:05.825 INFO:teuthology.orchestra.run.smithi045.stdout: -430> 2023-10-03T19:16:29.394+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.2 v2:172.21.15.45:6817/964866005 52 ==== osd_op_reply(2417 1000000015d.00000000 [delete] v50'52 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576d0f0400 2023-10-03T19:21:05.825 INFO:teuthology.orchestra.run.smithi045.stdout: -429> 2023-10-03T19:16:29.394+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.2 v2:172.21.15.45:6817/964866005 53 ==== osd_op_reply(2435 1000000016f.00000000 [delete] v50'53 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576d0f0400 2023-10-03T19:21:05.825 INFO:teuthology.orchestra.run.smithi045.stdout: -428> 2023-10-03T19:16:29.394+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.2 v2:172.21.15.45:6817/964866005 54 ==== osd_op_reply(2491 100000001a7.00000000 [delete] v50'54 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576d0f0400 2023-10-03T19:21:05.826 INFO:teuthology.orchestra.run.smithi045.stdout: -427> 2023-10-03T19:16:29.394+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 164 ==== osd_op_reply(2085 10000000011.00000000 [delete] v50'27 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.826 INFO:teuthology.orchestra.run.smithi045.stdout: -426> 2023-10-03T19:16:29.394+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 183 ==== osd_op_reply(2099 1000000001f.00000000 [delete] v50'33 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.826 INFO:teuthology.orchestra.run.smithi045.stdout: -425> 2023-10-03T19:16:29.394+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 184 ==== osd_op_reply(2271 100000000cb.00000000 [delete] v50'34 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.826 INFO:teuthology.orchestra.run.smithi045.stdout: -424> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 185 ==== osd_op_reply(2353 1000000011d.00000000 [delete] v50'35 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.826 INFO:teuthology.orchestra.run.smithi045.stdout: -423> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 186 ==== osd_op_reply(2433 1000000016d.00000000 [delete] v50'36 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.826 INFO:teuthology.orchestra.run.smithi045.stdout: -422> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 187 ==== osd_op_reply(2438 10000000172.00000000 [delete] v50'37 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.826 INFO:teuthology.orchestra.run.smithi045.stdout: -421> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 428 ==== osd_op_reply(2439 10000000173.00000000 [delete] v50'44 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.826 INFO:teuthology.orchestra.run.smithi045.stdout: -420> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 429 ==== osd_op_reply(2455 10000000183.00000000 [delete] v50'50 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.826 INFO:teuthology.orchestra.run.smithi045.stdout: -419> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 430 ==== osd_op_reply(2422 10000000162.00000000 [delete] v50'37 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.826 INFO:teuthology.orchestra.run.smithi045.stdout: -418> 2023-10-03T19:16:29.398+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 192 ==== osd_op_reply(2484 100000001a0.00000000 [delete] v50'44 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.826 INFO:teuthology.orchestra.run.smithi045.stdout: -417> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 431 ==== osd_op_reply(2396 10000000148.00000000 [delete] v50'44 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.826 INFO:teuthology.orchestra.run.smithi045.stdout: -416> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 432 ==== osd_op_reply(2239 100000000ab.00000000 [delete] v50'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.827 INFO:teuthology.orchestra.run.smithi045.stdout: -415> 2023-10-03T19:16:29.398+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 193 ==== osd_op_reply(2527 100000001cb.00000000 [delete] v50'45 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.827 INFO:teuthology.orchestra.run.smithi045.stdout: -414> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 433 ==== osd_op_reply(2254 100000000ba.00000000 [delete] v50'33 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.827 INFO:teuthology.orchestra.run.smithi045.stdout: -413> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 434 ==== osd_op_reply(2250 100000000b6.00000000 [delete] v50'36 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.827 INFO:teuthology.orchestra.run.smithi045.stdout: -412> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 435 ==== osd_op_reply(2374 10000000132.00000000 [delete] v50'34 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.827 INFO:teuthology.orchestra.run.smithi045.stdout: -411> 2023-10-03T19:16:29.398+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1049 ==== osd_op_reply(2090 10000000016.00000000 [delete] v50'19 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.827 INFO:teuthology.orchestra.run.smithi045.stdout: -410> 2023-10-03T19:16:29.398+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1050 ==== osd_op_reply(2096 1000000001c.00000000 [delete] v50'39 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.827 INFO:teuthology.orchestra.run.smithi045.stdout: -409> 2023-10-03T19:16:29.398+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1051 ==== osd_op_reply(2082 1000000000e.00000000 [delete] v50'37 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.827 INFO:teuthology.orchestra.run.smithi045.stdout: -408> 2023-10-03T19:16:29.398+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1052 ==== osd_op_reply(2101 10000000021.00000000 [delete] v50'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.827 INFO:teuthology.orchestra.run.smithi045.stdout: -407> 2023-10-03T19:16:29.398+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1053 ==== osd_op_reply(2102 10000000022.00000000 [delete] v50'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.827 INFO:teuthology.orchestra.run.smithi045.stdout: -406> 2023-10-03T19:16:29.398+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1054 ==== osd_op_reply(2126 1000000003a.00000000 [delete] v50'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.827 INFO:teuthology.orchestra.run.smithi045.stdout: -405> 2023-10-03T19:16:29.398+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1055 ==== osd_op_reply(2091 10000000017.00000000 [delete] v50'21 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.828 INFO:teuthology.orchestra.run.smithi045.stdout: -404> 2023-10-03T19:16:29.398+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1056 ==== osd_op_reply(2111 1000000002b.00000000 [delete] v50'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.828 INFO:teuthology.orchestra.run.smithi045.stdout: -403> 2023-10-03T19:16:29.398+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1057 ==== osd_op_reply(2205 10000000089.00000000 [delete] v50'24 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.828 INFO:teuthology.orchestra.run.smithi045.stdout: -402> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 188 ==== osd_op_reply(2377 10000000135.00000000 [delete] v50'28 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.828 INFO:teuthology.orchestra.run.smithi045.stdout: -401> 2023-10-03T19:16:29.398+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1058 ==== osd_op_reply(2113 1000000002d.00000000 [delete] v50'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.828 INFO:teuthology.orchestra.run.smithi045.stdout: -400> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 189 ==== osd_op_reply(2394 10000000146.00000000 [delete] v50'29 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.828 INFO:teuthology.orchestra.run.smithi045.stdout: -399> 2023-10-03T19:16:29.398+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1059 ==== osd_op_reply(2135 10000000043.00000000 [delete] v50'40 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.828 INFO:teuthology.orchestra.run.smithi045.stdout: -398> 2023-10-03T19:16:29.398+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1060 ==== osd_op_reply(2124 10000000038.00000000 [delete] v50'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.828 INFO:teuthology.orchestra.run.smithi045.stdout: -397> 2023-10-03T19:16:29.398+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1061 ==== osd_op_reply(2148 10000000050.00000000 [delete] v50'41 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.828 INFO:teuthology.orchestra.run.smithi045.stdout: -396> 2023-10-03T19:16:29.398+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1062 ==== osd_op_reply(2169 10000000065.00000000 [delete] v50'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.828 INFO:teuthology.orchestra.run.smithi045.stdout: -395> 2023-10-03T19:16:29.398+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1063 ==== osd_op_reply(2362 10000000126.00000000 [delete] v50'25 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.828 INFO:teuthology.orchestra.run.smithi045.stdout: -394> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 190 ==== osd_op_reply(2533 100000001d1.00000000 [delete] v50'29 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.828 INFO:teuthology.orchestra.run.smithi045.stdout: -393> 2023-10-03T19:16:29.398+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1064 ==== osd_op_reply(2152 10000000054.00000000 [delete] v50'37 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.829 INFO:teuthology.orchestra.run.smithi045.stdout: -392> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 191 ==== osd_op_reply(2399 1000000014b.00000000 [delete] v50'30 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.896 INFO:teuthology.orchestra.run.smithi045.stdout: -391> 2023-10-03T19:16:29.398+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1065 ==== osd_op_reply(2165 10000000061.00000000 [delete] v50'38 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.896 INFO:teuthology.orchestra.run.smithi045.stdout: -390> 2023-10-03T19:16:29.398+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1066 ==== osd_op_reply(2186 10000000076.00000000 [delete] v50'44 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.896 INFO:teuthology.orchestra.run.smithi045.stdout: -389> 2023-10-03T19:16:29.398+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1067 ==== osd_op_reply(2151 10000000053.00000000 [delete] v50'42 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.896 INFO:teuthology.orchestra.run.smithi045.stdout: -388> 2023-10-03T19:16:29.398+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1068 ==== osd_op_reply(2138 10000000046.00000000 [delete] v50'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.896 INFO:teuthology.orchestra.run.smithi045.stdout: -387> 2023-10-03T19:16:29.398+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1069 ==== osd_op_reply(2193 1000000007d.00000000 [delete] v50'22 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.897 INFO:teuthology.orchestra.run.smithi045.stdout: -386> 2023-10-03T19:16:29.398+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1070 ==== osd_op_reply(2222 1000000009a.00000000 [delete] v50'39 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.897 INFO:teuthology.orchestra.run.smithi045.stdout: -385> 2023-10-03T19:16:29.398+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1071 ==== osd_op_reply(2171 10000000067.00000000 [delete] v50'38 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.897 INFO:teuthology.orchestra.run.smithi045.stdout: -384> 2023-10-03T19:16:29.398+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1072 ==== osd_op_reply(2230 100000000a2.00000000 [delete] v50'33 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.897 INFO:teuthology.orchestra.run.smithi045.stdout: -383> 2023-10-03T19:16:29.398+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1073 ==== osd_op_reply(2253 100000000b9.00000000 [delete] v50'34 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.897 INFO:teuthology.orchestra.run.smithi045.stdout: -382> 2023-10-03T19:16:29.398+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1074 ==== osd_op_reply(2177 1000000006d.00000000 [delete] v50'39 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.897 INFO:teuthology.orchestra.run.smithi045.stdout: -381> 2023-10-03T19:16:29.398+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1075 ==== osd_op_reply(2223 1000000009b.00000000 [delete] v50'40 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.897 INFO:teuthology.orchestra.run.smithi045.stdout: -380> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 192 ==== osd_op_reply(2562 100000001ee.00000000 [delete] v50'38 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.897 INFO:teuthology.orchestra.run.smithi045.stdout: -379> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 193 ==== osd_op_reply(2328 10000000104.00000000 [delete] v50'45 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.897 INFO:teuthology.orchestra.run.smithi045.stdout: -378> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 194 ==== osd_op_reply(2351 1000000011b.00000000 [delete] v50'46 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.897 INFO:teuthology.orchestra.run.smithi045.stdout: -377> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 195 ==== osd_op_reply(2560 100000001ec.00000000 [delete] v50'30 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.897 INFO:teuthology.orchestra.run.smithi045.stdout: -376> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 196 ==== osd_op_reply(2332 10000000108.00000000 [delete] v50'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.897 INFO:teuthology.orchestra.run.smithi045.stdout: -375> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 197 ==== osd_op_reply(2359 10000000123.00000000 [delete] v50'47 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.898 INFO:teuthology.orchestra.run.smithi045.stdout: -374> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 198 ==== osd_op_reply(2563 100000001ef.00000000 [delete] v50'31 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.898 INFO:teuthology.orchestra.run.smithi045.stdout: -373> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 199 ==== osd_op_reply(2339 1000000010f.00000000 [delete] v50'41 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.898 INFO:teuthology.orchestra.run.smithi045.stdout: -372> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 200 ==== osd_op_reply(2384 1000000013c.00000000 [delete] v50'48 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.898 INFO:teuthology.orchestra.run.smithi045.stdout: -371> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 201 ==== osd_op_reply(2510 100000001ba.00000000 [delete] v50'49 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.898 INFO:teuthology.orchestra.run.smithi045.stdout: -370> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 436 ==== osd_op_reply(2428 10000000168.00000000 [delete] v50'35 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.898 INFO:teuthology.orchestra.run.smithi045.stdout: -369> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 437 ==== osd_op_reply(2296 100000000e4.00000000 [delete] v50'27 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.898 INFO:teuthology.orchestra.run.smithi045.stdout: -368> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 438 ==== osd_op_reply(2298 100000000e6.00000000 [delete] v50'28 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.898 INFO:teuthology.orchestra.run.smithi045.stdout: -367> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 439 ==== osd_op_reply(2286 100000000da.00000000 [delete] v50'37 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.898 INFO:teuthology.orchestra.run.smithi045.stdout: -366> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 440 ==== osd_op_reply(2436 10000000170.00000000 [delete] v50'38 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.898 INFO:teuthology.orchestra.run.smithi045.stdout: -365> 2023-10-03T19:16:29.398+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 441 ==== osd_op_reply(2442 10000000176.00000000 [delete] v50'39 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.898 INFO:teuthology.orchestra.run.smithi045.stdout: -364> 2023-10-03T19:16:29.402+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 442 ==== osd_op_reply(2420 10000000160.00000000 [delete] v50'25 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.899 INFO:teuthology.orchestra.run.smithi045.stdout: -363> 2023-10-03T19:16:29.402+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 443 ==== osd_op_reply(2429 10000000169.00000000 [delete] v50'26 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.899 INFO:teuthology.orchestra.run.smithi045.stdout: -362> 2023-10-03T19:16:29.402+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 194 ==== osd_op_reply(2180 10000000070.00000000 [delete] v50'40 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.899 INFO:teuthology.orchestra.run.smithi045.stdout: -361> 2023-10-03T19:16:29.402+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 195 ==== osd_op_reply(2187 10000000077.00000000 [delete] v50'41 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.899 INFO:teuthology.orchestra.run.smithi045.stdout: -360> 2023-10-03T19:16:29.402+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 444 ==== osd_op_reply(2443 10000000177.00000000 [delete] v50'40 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.899 INFO:teuthology.orchestra.run.smithi045.stdout: -359> 2023-10-03T19:16:29.402+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 196 ==== osd_op_reply(2192 1000000007c.00000000 [delete] v50'42 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.899 INFO:teuthology.orchestra.run.smithi045.stdout: -358> 2023-10-03T19:16:29.402+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 445 ==== osd_op_reply(2448 1000000017c.00000000 [delete] v50'29 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.899 INFO:teuthology.orchestra.run.smithi045.stdout: -357> 2023-10-03T19:16:29.402+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 197 ==== osd_op_reply(2247 100000000b3.00000000 [delete] v50'43 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.899 INFO:teuthology.orchestra.run.smithi045.stdout: -356> 2023-10-03T19:16:29.402+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 446 ==== osd_op_reply(2467 1000000018f.00000000 [delete] v50'41 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.899 INFO:teuthology.orchestra.run.smithi045.stdout: -355> 2023-10-03T19:16:29.402+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 198 ==== osd_op_reply(2256 100000000bc.00000000 [delete] v50'44 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.899 INFO:teuthology.orchestra.run.smithi045.stdout: -354> 2023-10-03T19:16:29.402+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 199 ==== osd_op_reply(2297 100000000e5.00000000 [delete] v50'45 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.899 INFO:teuthology.orchestra.run.smithi045.stdout: -353> 2023-10-03T19:16:29.402+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 200 ==== osd_op_reply(2305 100000000ed.00000000 [delete] v50'46 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.900 INFO:teuthology.orchestra.run.smithi045.stdout: -352> 2023-10-03T19:16:29.402+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1076 ==== osd_op_reply(2121 10000000035.00000000 [delete] v50'20 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.900 INFO:teuthology.orchestra.run.smithi045.stdout: -351> 2023-10-03T19:16:29.402+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 201 ==== osd_op_reply(2471 10000000193.00000000 [delete] v50'47 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.900 INFO:teuthology.orchestra.run.smithi045.stdout: -350> 2023-10-03T19:16:29.402+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 202 ==== osd_op_reply(2481 1000000019d.00000000 [delete] v50'48 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.900 INFO:teuthology.orchestra.run.smithi045.stdout: -349> 2023-10-03T19:16:29.402+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 203 ==== osd_op_reply(2485 100000001a1.00000000 [delete] v50'49 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.900 INFO:teuthology.orchestra.run.smithi045.stdout: -348> 2023-10-03T19:16:29.402+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 204 ==== osd_op_reply(2501 100000001b1.00000000 [delete] v50'50 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.900 INFO:teuthology.orchestra.run.smithi045.stdout: -347> 2023-10-03T19:16:29.402+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 202 ==== osd_op_reply(2197 10000000081.00000000 [delete] v50'30 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.900 INFO:teuthology.orchestra.run.smithi045.stdout: -346> 2023-10-03T19:16:29.402+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.6 v2:172.21.15.79:6819/1486010128 205 ==== osd_op_reply(2540 100000001d8.00000000 [delete] v50'51 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576cfe9400 2023-10-03T19:21:05.900 INFO:teuthology.orchestra.run.smithi045.stdout: -345> 2023-10-03T19:16:29.402+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 203 ==== osd_op_reply(2236 100000000a8.00000000 [delete] v50'46 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.900 INFO:teuthology.orchestra.run.smithi045.stdout: -344> 2023-10-03T19:16:29.402+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 204 ==== osd_op_reply(2292 100000000e0.00000000 [delete] v50'31 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.900 INFO:teuthology.orchestra.run.smithi045.stdout: -343> 2023-10-03T19:16:29.402+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 205 ==== osd_op_reply(2273 100000000cd.00000000 [delete] v50'47 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.900 INFO:teuthology.orchestra.run.smithi045.stdout: -342> 2023-10-03T19:16:29.402+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 447 ==== osd_op_reply(2483 1000000019f.00000000 [delete] v50'36 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.901 INFO:teuthology.orchestra.run.smithi045.stdout: -341> 2023-10-03T19:16:29.402+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 448 ==== osd_op_reply(2519 100000001c3.00000000 [delete] v50'41 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.901 INFO:teuthology.orchestra.run.smithi045.stdout: -340> 2023-10-03T19:16:29.402+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 449 ==== osd_op_reply(2531 100000001cf.00000000 [delete] v50'27 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.901 INFO:teuthology.orchestra.run.smithi045.stdout: -339> 2023-10-03T19:16:29.402+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 450 ==== osd_op_reply(2522 100000001c6.00000000 [delete] v50'42 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.901 INFO:teuthology.orchestra.run.smithi045.stdout: -338> 2023-10-03T19:16:29.402+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 451 ==== osd_op_reply(2529 100000001cd.00000000 [delete] v50'42 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.925 INFO:teuthology.orchestra.run.smithi045.stdout: -337> 2023-10-03T19:16:29.402+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 452 ==== osd_op_reply(2541 100000001d9.00000000 [delete] v50'51 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.925 INFO:teuthology.orchestra.run.smithi045.stdout: -336> 2023-10-03T19:16:29.402+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 206 ==== osd_op_reply(2476 10000000198.00000000 [delete] v50'42 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.925 INFO:teuthology.orchestra.run.smithi045.stdout: -335> 2023-10-03T19:16:29.402+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 207 ==== osd_op_reply(2557 100000001e9.00000000 [delete] v50'43 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.925 INFO:teuthology.orchestra.run.smithi045.stdout: -334> 2023-10-03T19:16:29.402+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 208 ==== osd_op_reply(2310 100000000f2.00000000 [delete] v50'48 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.925 INFO:teuthology.orchestra.run.smithi045.stdout: -333> 2023-10-03T19:16:29.402+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 209 ==== osd_op_reply(2349 10000000119.00000000 [delete] v50'32 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.925 INFO:teuthology.orchestra.run.smithi045.stdout: -332> 2023-10-03T19:16:29.402+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 210 ==== osd_op_reply(2385 1000000013d.00000000 [delete] v50'49 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.925 INFO:teuthology.orchestra.run.smithi045.stdout: -331> 2023-10-03T19:16:29.402+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 91 ==== osd_op_reply(2105 10000000025.00000000 [delete] v50'29 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.925 INFO:teuthology.orchestra.run.smithi045.stdout: -330> 2023-10-03T19:16:29.402+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 211 ==== osd_op_reply(2421 10000000161.00000000 [delete] v50'33 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.925 INFO:teuthology.orchestra.run.smithi045.stdout: -329> 2023-10-03T19:16:29.402+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 453 ==== osd_op_reply(2509 100000001b9.00000000 [delete] v50'41 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.926 INFO:teuthology.orchestra.run.smithi045.stdout: -328> 2023-10-03T19:16:29.402+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 212 ==== osd_op_reply(2477 10000000199.00000000 [delete] v50'50 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.926 INFO:teuthology.orchestra.run.smithi045.stdout: -327> 2023-10-03T19:16:29.406+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 92 ==== osd_op_reply(2156 10000000058.00000000 [delete] v50'30 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.926 INFO:teuthology.orchestra.run.smithi045.stdout: -326> 2023-10-03T19:16:29.406+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 93 ==== osd_op_reply(2213 10000000091.00000000 [delete] v50'31 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.926 INFO:teuthology.orchestra.run.smithi045.stdout: -325> 2023-10-03T19:16:29.406+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 213 ==== osd_op_reply(2537 100000001d5.00000000 [delete] v50'51 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.926 INFO:teuthology.orchestra.run.smithi045.stdout: -324> 2023-10-03T19:16:29.406+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 214 ==== osd_op_reply(2565 100000001f1.00000000 [delete] v50'52 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.926 INFO:teuthology.orchestra.run.smithi045.stdout: -323> 2023-10-03T19:16:29.406+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 454 ==== osd_op_reply(2500 100000001b0.00000000 [delete] v50'45 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.926 INFO:teuthology.orchestra.run.smithi045.stdout: -322> 2023-10-03T19:16:29.406+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 455 ==== osd_op_reply(2518 100000001c2.00000000 [delete] v50'46 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.926 INFO:teuthology.orchestra.run.smithi045.stdout: -321> 2023-10-03T19:16:29.406+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 94 ==== osd_op_reply(2231 100000000a3.00000000 [delete] v50'32 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.926 INFO:teuthology.orchestra.run.smithi045.stdout: -320> 2023-10-03T19:16:29.406+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 456 ==== osd_op_reply(2539 100000001d7.00000000 [delete] v50'38 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.926 INFO:teuthology.orchestra.run.smithi045.stdout: -319> 2023-10-03T19:16:29.406+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 215 ==== osd_op_reply(2112 1000000002c.00000000 [delete] v50'26 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.927 INFO:teuthology.orchestra.run.smithi045.stdout: -318> 2023-10-03T19:16:29.406+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 216 ==== osd_op_reply(2245 100000000b1.00000000 [delete] v50'27 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.927 INFO:teuthology.orchestra.run.smithi045.stdout: -317> 2023-10-03T19:16:29.406+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 217 ==== osd_op_reply(2348 10000000118.00000000 [delete] v50'28 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.927 INFO:teuthology.orchestra.run.smithi045.stdout: -316> 2023-10-03T19:16:29.406+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 165 ==== osd_op_reply(2125 10000000039.00000000 [delete] v50'45 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.927 INFO:teuthology.orchestra.run.smithi045.stdout: -315> 2023-10-03T19:16:29.406+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 166 ==== osd_op_reply(2184 10000000074.00000000 [delete] v50'46 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.927 INFO:teuthology.orchestra.run.smithi045.stdout: -314> 2023-10-03T19:16:29.406+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 167 ==== osd_op_reply(2287 100000000db.00000000 [delete] v50'28 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.927 INFO:teuthology.orchestra.run.smithi045.stdout: -313> 2023-10-03T19:16:29.406+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 168 ==== osd_op_reply(2341 10000000111.00000000 [delete] v50'47 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.927 INFO:teuthology.orchestra.run.smithi045.stdout: -312> 2023-10-03T19:16:29.406+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 169 ==== osd_op_reply(2356 10000000120.00000000 [delete] v50'29 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.927 INFO:teuthology.orchestra.run.smithi045.stdout: -311> 2023-10-03T19:16:29.406+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 170 ==== osd_op_reply(2081 1000000000d.00000000 [delete] v50'37 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.927 INFO:teuthology.orchestra.run.smithi045.stdout: -310> 2023-10-03T19:16:29.406+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 171 ==== osd_op_reply(2372 10000000130.00000000 [delete] v50'30 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.927 INFO:teuthology.orchestra.run.smithi045.stdout: -309> 2023-10-03T19:16:29.406+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 172 ==== osd_op_reply(2521 100000001c5.00000000 [delete] v50'48 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.927 INFO:teuthology.orchestra.run.smithi045.stdout: -308> 2023-10-03T19:16:29.406+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 173 ==== osd_op_reply(2103 10000000023.00000000 [delete] v50'38 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.927 INFO:teuthology.orchestra.run.smithi045.stdout: -307> 2023-10-03T19:16:29.406+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 174 ==== osd_op_reply(2402 1000000014e.00000000 [delete] v50'31 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.928 INFO:teuthology.orchestra.run.smithi045.stdout: -306> 2023-10-03T19:16:29.406+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 175 ==== osd_op_reply(2450 1000000017e.00000000 [delete] v50'32 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.928 INFO:teuthology.orchestra.run.smithi045.stdout: -305> 2023-10-03T19:16:29.406+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 176 ==== osd_op_reply(2266 100000000c6.00000000 [delete] v50'39 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.928 INFO:teuthology.orchestra.run.smithi045.stdout: -304> 2023-10-03T19:16:29.406+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1077 ==== osd_op_reply(2170 10000000066.00000000 [delete] v50'21 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.928 INFO:teuthology.orchestra.run.smithi045.stdout: -303> 2023-10-03T19:16:29.406+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1078 ==== osd_op_reply(2150 10000000052.00000000 [delete] v50'33 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.928 INFO:teuthology.orchestra.run.smithi045.stdout: -302> 2023-10-03T19:16:29.406+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1079 ==== osd_op_reply(2268 100000000c8.00000000 [delete] v50'33 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.928 INFO:teuthology.orchestra.run.smithi045.stdout: -301> 2023-10-03T19:16:29.406+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1080 ==== osd_op_reply(2188 10000000078.00000000 [delete] v50'22 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.928 INFO:teuthology.orchestra.run.smithi045.stdout: -300> 2023-10-03T19:16:29.406+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1081 ==== osd_op_reply(2216 10000000094.00000000 [delete] v50'45 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.928 INFO:teuthology.orchestra.run.smithi045.stdout: -299> 2023-10-03T19:16:29.406+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1082 ==== osd_op_reply(2280 100000000d4.00000000 [delete] v50'34 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.928 INFO:teuthology.orchestra.run.smithi045.stdout: -298> 2023-10-03T19:16:29.406+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1083 ==== osd_op_reply(2167 10000000063.00000000 [delete] v50'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.928 INFO:teuthology.orchestra.run.smithi045.stdout: -297> 2023-10-03T19:16:29.406+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1084 ==== osd_op_reply(2251 100000000b7.00000000 [delete] v50'46 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.928 INFO:teuthology.orchestra.run.smithi045.stdout: -296> 2023-10-03T19:16:29.406+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1085 ==== osd_op_reply(2199 10000000083.00000000 [delete] v50'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.929 INFO:teuthology.orchestra.run.smithi045.stdout: -295> 2023-10-03T19:16:29.406+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1086 ==== osd_op_reply(2209 1000000008d.00000000 [delete] v50'41 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.929 INFO:teuthology.orchestra.run.smithi045.stdout: -294> 2023-10-03T19:16:29.406+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1087 ==== osd_op_reply(2278 100000000d2.00000000 [delete] v50'23 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.929 INFO:teuthology.orchestra.run.smithi045.stdout: -293> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1088 ==== osd_op_reply(2404 10000000150.00000000 [delete] v50'26 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.929 INFO:teuthology.orchestra.run.smithi045.stdout: -292> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1089 ==== osd_op_reply(2265 100000000c5.00000000 [delete] v50'43 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.929 INFO:teuthology.orchestra.run.smithi045.stdout: -291> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1090 ==== osd_op_reply(2308 100000000f0.00000000 [delete] v50'41 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.929 INFO:teuthology.orchestra.run.smithi045.stdout: -290> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1091 ==== osd_op_reply(2302 100000000ea.00000000 [delete] v50'35 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.929 INFO:teuthology.orchestra.run.smithi045.stdout: -289> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1092 ==== osd_op_reply(2290 100000000de.00000000 [delete] v50'34 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.929 INFO:teuthology.orchestra.run.smithi045.stdout: -288> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1093 ==== osd_op_reply(2338 1000000010e.00000000 [delete] v50'36 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.929 INFO:teuthology.orchestra.run.smithi045.stdout: -287> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 177 ==== osd_op_reply(2208 1000000008c.00000000 [delete] v50'21 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.929 INFO:teuthology.orchestra.run.smithi045.stdout: -286> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1094 ==== osd_op_reply(2288 100000000dc.00000000 [delete] v50'47 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.929 INFO:teuthology.orchestra.run.smithi045.stdout: -285> 2023-10-03T19:16:29.410+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 457 ==== osd_op_reply(2360 10000000124.00000000 [delete] v50'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.930 INFO:teuthology.orchestra.run.smithi045.stdout: -284> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 178 ==== osd_op_reply(2241 100000000ad.00000000 [delete] v50'22 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.930 INFO:teuthology.orchestra.run.smithi045.stdout: -283> 2023-10-03T19:16:29.410+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 458 ==== osd_op_reply(2401 1000000014d.00000000 [delete] v50'35 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.930 INFO:teuthology.orchestra.run.smithi045.stdout: -282> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 179 ==== osd_op_reply(2411 10000000157.00000000 [delete] v50'23 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.930 INFO:teuthology.orchestra.run.smithi045.stdout: -281> 2023-10-03T19:16:29.410+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 459 ==== osd_op_reply(2415 1000000015b.00000000 [delete] v50'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.930 INFO:teuthology.orchestra.run.smithi045.stdout: -280> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 180 ==== osd_op_reply(2454 10000000182.00000000 [delete] v50'24 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.930 INFO:teuthology.orchestra.run.smithi045.stdout: -279> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1095 ==== osd_op_reply(2307 100000000ef.00000000 [delete] v50'48 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.930 INFO:teuthology.orchestra.run.smithi045.stdout: -278> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1096 ==== osd_op_reply(2314 100000000f6.00000000 [delete] v50'35 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.930 INFO:teuthology.orchestra.run.smithi045.stdout: -277> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1097 ==== osd_op_reply(2312 100000000f4.00000000 [delete] v50'49 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.930 INFO:teuthology.orchestra.run.smithi045.stdout: -276> 2023-10-03T19:16:29.410+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 460 ==== osd_op_reply(2486 100000001a2.00000000 [delete] v50'36 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.957 INFO:teuthology.orchestra.run.smithi045.stdout: -275> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1098 ==== osd_op_reply(2506 100000001b6.00000000 [delete] v50'27 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.958 INFO:teuthology.orchestra.run.smithi045.stdout: -274> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1099 ==== osd_op_reply(2323 100000000ff.00000000 [delete] v50'50 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.958 INFO:teuthology.orchestra.run.smithi045.stdout: -273> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1100 ==== osd_op_reply(2536 100000001d4.00000000 [delete] v50'28 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.958 INFO:teuthology.orchestra.run.smithi045.stdout: -272> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1101 ==== osd_op_reply(2352 1000000011c.00000000 [delete] v50'36 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.958 INFO:teuthology.orchestra.run.smithi045.stdout: -271> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1102 ==== osd_op_reply(2317 100000000f9.00000000 [delete] v50'35 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.958 INFO:teuthology.orchestra.run.smithi045.stdout: -270> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1103 ==== osd_op_reply(2333 10000000109.00000000 [delete] v50'42 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.958 INFO:teuthology.orchestra.run.smithi045.stdout: -269> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1104 ==== osd_op_reply(2319 100000000fb.00000000 [delete] v50'40 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.958 INFO:teuthology.orchestra.run.smithi045.stdout: -268> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1105 ==== osd_op_reply(2416 1000000015c.00000000 [delete] v50'36 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.958 INFO:teuthology.orchestra.run.smithi045.stdout: -267> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1106 ==== osd_op_reply(2419 1000000015f.00000000 [delete] v50'37 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.958 INFO:teuthology.orchestra.run.smithi045.stdout: -266> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1107 ==== osd_op_reply(2342 10000000112.00000000 [delete] v50'41 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.958 INFO:teuthology.orchestra.run.smithi045.stdout: -265> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 181 ==== osd_op_reply(2550 100000001e2.00000000 [delete] v50'25 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.959 INFO:teuthology.orchestra.run.smithi045.stdout: -264> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 182 ==== osd_op_reply(2567 100000001f3.00000000 [delete] v50'26 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.959 INFO:teuthology.orchestra.run.smithi045.stdout: -263> 2023-10-03T19:16:29.410+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 95 ==== osd_op_reply(2330 10000000106.00000000 [delete] v50'33 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.959 INFO:teuthology.orchestra.run.smithi045.stdout: -262> 2023-10-03T19:16:29.410+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 96 ==== osd_op_reply(2334 1000000010a.00000000 [delete] v50'34 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.959 INFO:teuthology.orchestra.run.smithi045.stdout: -261> 2023-10-03T19:16:29.410+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 97 ==== osd_op_reply(2190 1000000007a.00000000 [delete] v50'19 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.959 INFO:teuthology.orchestra.run.smithi045.stdout: -260> 2023-10-03T19:16:29.410+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 98 ==== osd_op_reply(2361 10000000125.00000000 [delete] v50'35 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.959 INFO:teuthology.orchestra.run.smithi045.stdout: -259> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 183 ==== osd_op_reply(2279 100000000d3.00000000 [delete] v50'40 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.959 INFO:teuthology.orchestra.run.smithi045.stdout: -258> 2023-10-03T19:16:29.410+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 99 ==== osd_op_reply(2530 100000001ce.00000000 [delete] v50'36 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.959 INFO:teuthology.orchestra.run.smithi045.stdout: -257> 2023-10-03T19:16:29.410+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 218 ==== osd_op_reply(2120 10000000034.00000000 [delete] v50'17 uv16 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.959 INFO:teuthology.orchestra.run.smithi045.stdout: -256> 2023-10-03T19:16:29.410+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 219 ==== osd_op_reply(2234 100000000a6.00000000 [delete] v50'18 uv16 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.959 INFO:teuthology.orchestra.run.smithi045.stdout: -255> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1108 ==== osd_op_reply(2240 100000000ac.00000000 [delete] v50'42 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.959 INFO:teuthology.orchestra.run.smithi045.stdout: -254> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1109 ==== osd_op_reply(2289 100000000dd.00000000 [delete] v50'43 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.959 INFO:teuthology.orchestra.run.smithi045.stdout: -253> 2023-10-03T19:16:29.410+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 220 ==== osd_op_reply(2365 10000000129.00000000 [delete] v50'19 uv16 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.960 INFO:teuthology.orchestra.run.smithi045.stdout: -252> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1110 ==== osd_op_reply(2284 100000000d8.00000000 [delete] v50'23 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.960 INFO:teuthology.orchestra.run.smithi045.stdout: -251> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1111 ==== osd_op_reply(2324 10000000100.00000000 [delete] v50'44 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.960 INFO:teuthology.orchestra.run.smithi045.stdout: -250> 2023-10-03T19:16:29.410+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 100 ==== osd_op_reply(2257 100000000bd.00000000 [delete] v50'20 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.960 INFO:teuthology.orchestra.run.smithi045.stdout: -249> 2023-10-03T19:16:29.410+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 101 ==== osd_op_reply(2554 100000001e6.00000000 [delete] v50'37 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.960 INFO:teuthology.orchestra.run.smithi045.stdout: -248> 2023-10-03T19:16:29.410+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 461 ==== osd_op_reply(2553 100000001e5.00000000 [delete] v50'39 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.960 INFO:teuthology.orchestra.run.smithi045.stdout: -247> 2023-10-03T19:16:29.410+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 102 ==== osd_op_reply(2561 100000001ed.00000000 [delete] v50'38 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.960 INFO:teuthology.orchestra.run.smithi045.stdout: -246> 2023-10-03T19:16:29.410+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 103 ==== osd_op_reply(2260 100000000c0.00000000 [delete] v50'21 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.960 INFO:teuthology.orchestra.run.smithi045.stdout: -245> 2023-10-03T19:16:29.410+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 104 ==== osd_op_reply(2568 100000001f4.00000000 [delete] v50'39 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.960 INFO:teuthology.orchestra.run.smithi045.stdout: -244> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 184 ==== osd_op_reply(2293 100000000e1.00000000 [delete] v50'41 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.960 INFO:teuthology.orchestra.run.smithi045.stdout: -243> 2023-10-03T19:16:29.410+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 105 ==== osd_op_reply(2270 100000000ca.00000000 [delete] v50'22 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.961 INFO:teuthology.orchestra.run.smithi045.stdout: -242> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1112 ==== osd_op_reply(2369 1000000012d.00000000 [delete] v50'43 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.961 INFO:teuthology.orchestra.run.smithi045.stdout: -241> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1113 ==== osd_op_reply(2345 10000000115.00000000 [delete] v50'37 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.961 INFO:teuthology.orchestra.run.smithi045.stdout: -240> 2023-10-03T19:16:29.410+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 221 ==== osd_op_reply(2517 100000001c1.00000000 [delete] v50'20 uv16 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.961 INFO:teuthology.orchestra.run.smithi045.stdout: -239> 2023-10-03T19:16:29.410+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 222 ==== osd_op_reply(2462 1000000018a.00000000 [delete] v50'29 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.961 INFO:teuthology.orchestra.run.smithi045.stdout: -238> 2023-10-03T19:16:29.410+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 223 ==== osd_op_reply(2532 100000001d0.00000000 [delete] v50'21 uv16 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.961 INFO:teuthology.orchestra.run.smithi045.stdout: -237> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 185 ==== osd_op_reply(2346 10000000116.00000000 [delete] v50'42 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.961 INFO:teuthology.orchestra.run.smithi045.stdout: -236> 2023-10-03T19:16:29.410+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 224 ==== osd_op_reply(2465 1000000018d.00000000 [delete] v50'30 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.961 INFO:teuthology.orchestra.run.smithi045.stdout: -235> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1114 ==== osd_op_reply(2350 1000000011a.00000000 [delete] v50'38 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.961 INFO:teuthology.orchestra.run.smithi045.stdout: -234> 2023-10-03T19:16:29.410+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 106 ==== osd_op_reply(2364 10000000128.00000000 [delete] v50'23 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.961 INFO:teuthology.orchestra.run.smithi045.stdout: -233> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1115 ==== osd_op_reply(2406 10000000152.00000000 [delete] v50'39 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.961 INFO:teuthology.orchestra.run.smithi045.stdout: -232> 2023-10-03T19:16:29.410+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 107 ==== osd_op_reply(2370 1000000012e.00000000 [delete] v50'24 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.961 INFO:teuthology.orchestra.run.smithi045.stdout: -231> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1116 ==== osd_op_reply(2499 100000001af.00000000 [delete] v50'40 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.962 INFO:teuthology.orchestra.run.smithi045.stdout: -230> 2023-10-03T19:16:29.410+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 108 ==== osd_op_reply(2376 10000000134.00000000 [delete] v50'25 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.962 INFO:teuthology.orchestra.run.smithi045.stdout: -229> 2023-10-03T19:16:29.410+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 109 ==== osd_op_reply(2403 1000000014f.00000000 [delete] v50'26 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.962 INFO:teuthology.orchestra.run.smithi045.stdout: -228> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 186 ==== osd_op_reply(2379 10000000137.00000000 [delete] v50'43 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.962 INFO:teuthology.orchestra.run.smithi045.stdout: -227> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1117 ==== osd_op_reply(2503 100000001b3.00000000 [delete] v50'41 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.962 INFO:teuthology.orchestra.run.smithi045.stdout: -226> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1118 ==== osd_op_reply(2456 10000000184.00000000 [delete] v50'44 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.962 INFO:teuthology.orchestra.run.smithi045.stdout: -225> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 187 ==== osd_op_reply(2398 1000000014a.00000000 [delete] v50'44 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.962 INFO:teuthology.orchestra.run.smithi045.stdout: -224> 2023-10-03T19:16:29.410+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.7 v2:172.21.15.79:6818/3323397754 188 ==== osd_op_reply(2440 10000000174.00000000 [delete] v50'45 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe9800 2023-10-03T19:21:05.962 INFO:teuthology.orchestra.run.smithi045.stdout: -223> 2023-10-03T19:16:29.410+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 158 ==== osd_op_reply(2463 1000000018b.00000000 [delete] v50'49 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.962 INFO:teuthology.orchestra.run.smithi045.stdout: -222> 2023-10-03T19:16:29.410+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 159 ==== osd_op_reply(2418 1000000015e.00000000 [delete] v50'30 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.962 INFO:teuthology.orchestra.run.smithi045.stdout: -221> 2023-10-03T19:16:29.410+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 160 ==== osd_op_reply(2464 1000000018c.00000000 [delete] v50'50 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.962 INFO:teuthology.orchestra.run.smithi045.stdout: -220> 2023-10-03T19:16:29.410+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 161 ==== osd_op_reply(2478 1000000019a.00000000 [delete] v50'51 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.963 INFO:teuthology.orchestra.run.smithi045.stdout: -219> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1119 ==== osd_op_reply(2487 100000001a3.00000000 [delete] v50'45 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.963 INFO:teuthology.orchestra.run.smithi045.stdout: -218> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1120 ==== osd_op_reply(2400 1000000014c.00000000 [delete] v50'37 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.963 INFO:teuthology.orchestra.run.smithi045.stdout: -217> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1121 ==== osd_op_reply(2498 100000001ae.00000000 [delete] v50'38 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.963 INFO:teuthology.orchestra.run.smithi045.stdout: -216> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1122 ==== osd_op_reply(2326 10000000102.00000000 [delete] v50'51 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.963 INFO:teuthology.orchestra.run.smithi045.stdout: -215> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1123 ==== osd_op_reply(2337 1000000010d.00000000 [delete] v50'44 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.979 INFO:teuthology.orchestra.run.smithi045.stdout: -214> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1124 ==== osd_op_reply(2547 100000001df.00000000 [delete] v50'29 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.980 INFO:teuthology.orchestra.run.smithi045.stdout: -213> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1125 ==== osd_op_reply(2488 100000001a4.00000000 [delete] v50'46 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.980 INFO:teuthology.orchestra.run.smithi045.stdout: -212> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1126 ==== osd_op_reply(2466 1000000018e.00000000 [delete] v50'52 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.980 INFO:teuthology.orchestra.run.smithi045.stdout: -211> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1127 ==== osd_op_reply(2340 10000000110.00000000 [delete] v50'45 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.980 INFO:teuthology.orchestra.run.smithi045.stdout: -210> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1128 ==== osd_op_reply(2479 1000000019b.00000000 [delete] v50'53 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.980 INFO:teuthology.orchestra.run.smithi045.stdout: -209> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1129 ==== osd_op_reply(2542 100000001da.00000000 [delete] v50'47 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.980 INFO:teuthology.orchestra.run.smithi045.stdout: -208> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1130 ==== osd_op_reply(2358 10000000122.00000000 [delete] v50'24 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.980 INFO:teuthology.orchestra.run.smithi045.stdout: -207> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1131 ==== osd_op_reply(2494 100000001aa.00000000 [delete] v50'54 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.980 INFO:teuthology.orchestra.run.smithi045.stdout: -206> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1132 ==== osd_op_reply(2424 10000000164.00000000 [delete] v50'46 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.980 INFO:teuthology.orchestra.run.smithi045.stdout: -205> 2023-10-03T19:16:29.414+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 225 ==== osd_op_reply(2427 10000000167.00000000 [delete] v50'37 uv35 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.980 INFO:teuthology.orchestra.run.smithi045.stdout: -204> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1133 ==== osd_op_reply(2559 100000001eb.00000000 [delete] v50'39 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.981 INFO:teuthology.orchestra.run.smithi045.stdout: -203> 2023-10-03T19:16:29.414+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 226 ==== osd_op_reply(2480 1000000019c.00000000 [delete] v50'38 uv35 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.981 INFO:teuthology.orchestra.run.smithi045.stdout: -202> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1134 ==== osd_op_reply(2497 100000001ad.00000000 [delete] v50'55 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.981 INFO:teuthology.orchestra.run.smithi045.stdout: -201> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1135 ==== osd_op_reply(2437 10000000171.00000000 [delete] v50'47 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.981 INFO:teuthology.orchestra.run.smithi045.stdout: -200> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1136 ==== osd_op_reply(2472 10000000194.00000000 [delete] v50'48 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.981 INFO:teuthology.orchestra.run.smithi045.stdout: -199> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1137 ==== osd_op_reply(2344 10000000114.00000000 [delete] v50'42 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.981 INFO:teuthology.orchestra.run.smithi045.stdout: -198> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1138 ==== osd_op_reply(2552 100000001e4.00000000 [delete] v50'56 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.981 INFO:teuthology.orchestra.run.smithi045.stdout: -197> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1139 ==== osd_op_reply(2474 10000000196.00000000 [delete] v50'25 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.981 INFO:teuthology.orchestra.run.smithi045.stdout: -196> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1140 ==== osd_op_reply(2363 10000000127.00000000 [delete] v50'43 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.981 INFO:teuthology.orchestra.run.smithi045.stdout: -195> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1141 ==== osd_op_reply(2564 100000001f0.00000000 [delete] v50'57 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.981 INFO:teuthology.orchestra.run.smithi045.stdout: -194> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1142 ==== osd_op_reply(2513 100000001bd.00000000 [delete] v50'45 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.981 INFO:teuthology.orchestra.run.smithi045.stdout: -193> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1143 ==== osd_op_reply(2526 100000001ca.00000000 [delete] v50'46 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.982 INFO:teuthology.orchestra.run.smithi045.stdout: -192> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1144 ==== osd_op_reply(2366 1000000012a.00000000 [delete] v50'24 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.982 INFO:teuthology.orchestra.run.smithi045.stdout: -191> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1145 ==== osd_op_reply(2566 100000001f2.00000000 [delete] v50'38 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.982 INFO:teuthology.orchestra.run.smithi045.stdout: -190> 2023-10-03T19:16:29.414+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 162 ==== osd_op_reply(2482 1000000019e.00000000 [delete] v50'52 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.982 INFO:teuthology.orchestra.run.smithi045.stdout: -189> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1146 ==== osd_op_reply(2528 100000001cc.00000000 [delete] v50'49 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.982 INFO:teuthology.orchestra.run.smithi045.stdout: -188> 2023-10-03T19:16:29.414+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 163 ==== osd_op_reply(2514 100000001be.00000000 [delete] v50'53 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.982 INFO:teuthology.orchestra.run.smithi045.stdout: -187> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1147 ==== osd_op_reply(2534 100000001d2.00000000 [delete] v50'47 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.982 INFO:teuthology.orchestra.run.smithi045.stdout: -186> 2023-10-03T19:16:29.414+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.5 v2:172.21.15.79:6802/2879380539 164 ==== osd_op_reply(2525 100000001c9.00000000 [delete] v50'31 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d0978c0 con 0x55576d0f0000 2023-10-03T19:21:05.982 INFO:teuthology.orchestra.run.smithi045.stdout: -185> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1148 ==== osd_op_reply(2538 100000001d6.00000000 [delete] v50'48 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.982 INFO:teuthology.orchestra.run.smithi045.stdout: -184> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1149 ==== osd_op_reply(2449 1000000017d.00000000 [delete] v50'25 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.982 INFO:teuthology.orchestra.run.smithi045.stdout: -183> 2023-10-03T19:16:29.414+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 227 ==== osd_op_reply(2496 100000001ac.00000000 [delete] v50'39 uv35 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.982 INFO:teuthology.orchestra.run.smithi045.stdout: -182> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1150 ==== osd_op_reply(2470 10000000192.00000000 [delete] v50'44 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.982 INFO:teuthology.orchestra.run.smithi045.stdout: -181> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1151 ==== osd_op_reply(2505 100000001b5.00000000 [delete] v50'26 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.983 INFO:teuthology.orchestra.run.smithi045.stdout: -180> 2023-10-03T19:16:29.414+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.1 v2:172.21.15.45:6808/1433143371 228 ==== osd_op_reply(2504 100000001b4.00000000 [delete] v50'40 uv35 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9c00 2023-10-03T19:21:05.983 INFO:teuthology.orchestra.run.smithi045.stdout: -179> 2023-10-03T19:16:29.414+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 110 ==== osd_op_reply(2109 10000000029.00000000 [delete] v50'45 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.983 INFO:teuthology.orchestra.run.smithi045.stdout: -178> 2023-10-03T19:16:29.414+0000 7f3edebd0640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.3 v2:172.21.15.45:6816/4227059688 1152 ==== osd_op_reply(2544 100000001dc.00000000 [delete] v50'27 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576d2aa000 con 0x55576cfe8c00 2023-10-03T19:21:05.983 INFO:teuthology.orchestra.run.smithi045.stdout: -177> 2023-10-03T19:16:29.414+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 111 ==== osd_op_reply(2158 1000000005a.00000000 [delete] v50'46 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.983 INFO:teuthology.orchestra.run.smithi045.stdout: -176> 2023-10-03T19:16:29.414+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 112 ==== osd_op_reply(2258 100000000be.00000000 [delete] v50'47 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.983 INFO:teuthology.orchestra.run.smithi045.stdout: -175> 2023-10-03T19:16:29.414+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 113 ==== osd_op_reply(2261 100000000c1.00000000 [delete] v50'48 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.983 INFO:teuthology.orchestra.run.smithi045.stdout: -174> 2023-10-03T19:16:29.414+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 114 ==== osd_op_reply(2283 100000000d7.00000000 [delete] v50'49 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.983 INFO:teuthology.orchestra.run.smithi045.stdout: -173> 2023-10-03T19:16:29.414+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 115 ==== osd_op_reply(2378 10000000136.00000000 [delete] v50'50 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.983 INFO:teuthology.orchestra.run.smithi045.stdout: -172> 2023-10-03T19:16:29.414+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 116 ==== osd_op_reply(2451 1000000017f.00000000 [delete] v50'51 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.983 INFO:teuthology.orchestra.run.smithi045.stdout: -171> 2023-10-03T19:16:29.414+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.4 v2:172.21.15.79:6810/2234162464 117 ==== osd_op_reply(2461 10000000189.00000000 [delete] v50'52 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576d0f0800 2023-10-03T19:21:05.983 INFO:teuthology.orchestra.run.smithi045.stdout: -170> 2023-10-03T19:16:29.414+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 19MDSIOContextWrapper 2023-10-03T19:21:05.983 INFO:teuthology.orchestra.run.smithi045.stdout: -169> 2023-10-03T19:16:29.414+0000 7f3ed53bd640 10 MDSContext::complete: 19MDSIOContextWrapper 2023-10-03T19:21:05.984 INFO:teuthology.orchestra.run.smithi045.stdout: -168> 2023-10-03T19:16:29.414+0000 7f3ed53bd640 10 mds.0.inotable: project_release_ids [0x10000000002~0x1f4] to [0x100000005dd~0xfffffffa23]/[0x100000005dd~0xfffffffa23] 2023-10-03T19:21:05.984 INFO:teuthology.orchestra.run.smithi045.stdout: -167> 2023-10-03T19:16:29.414+0000 7f3ed4bbc640 5 mds.0.log _submit_thread 10056610~56 : Eurged 500 inos, inotable v6 2023-10-03T19:21:05.984 INFO:teuthology.orchestra.run.smithi045.stdout: -166> 2023-10-03T19:16:29.414+0000 7f3ed4bbc640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2570 7.1b 7:ddb4e4d7:::200.00000002:head [write 1668002~76 [fadvise_dontneed] in=76b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50) v8 -- 0x55576d0f6380 con 0x55576cfe9000 2023-10-03T19:21:05.984 INFO:teuthology.orchestra.run.smithi045.stdout: -165> 2023-10-03T19:16:29.418+0000 7f3ede3cf640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== osd.0 v2:172.21.15.45:6800/1057586985 462 ==== osd_op_reply(2570 200.00000002 [write 1668002~76 [fadvise_dontneed]] v50'158 uv158 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55576c238fc0 con 0x55576cfe9000 2023-10-03T19:21:05.984 INFO:teuthology.orchestra.run.smithi045.stdout: -164> 2023-10-03T19:16:29.418+0000 7f3ed53bd640 10 MDSIOContextBase::complete: 28C_MDS_purge_completed_finish 2023-10-03T19:21:05.984 INFO:teuthology.orchestra.run.smithi045.stdout: -163> 2023-10-03T19:16:29.418+0000 7f3ed53bd640 10 MDSContext::complete: 28C_MDS_purge_completed_finish 2023-10-03T19:21:05.984 INFO:teuthology.orchestra.run.smithi045.stdout: -162> 2023-10-03T19:16:29.418+0000 7f3ed53bd640 10 mds.0.inotable: apply_release_ids [0x10000000002~0x1f4] to [0x10000000002~0x1f4,0x100000005dd~0xfffffffa23]/[0x100000005dd~0xfffffffa23] 2023-10-03T19:21:05.984 INFO:teuthology.orchestra.run.smithi045.stdout: -161> 2023-10-03T19:16:29.742+0000 7f3ed8bc4640 10 mds.pinger is_rank_lagging: rank=0 2023-10-03T19:21:05.984 INFO:teuthology.orchestra.run.smithi045.stdout: -160> 2023-10-03T19:16:29.742+0000 7f3ed8bc4640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgrreport(unknown.a +0-0 packed 1558) v9 -- 0x55576d1fca80 con 0x55576cfe8000 2023-10-03T19:21:05.984 INFO:teuthology.orchestra.run.smithi045.stdout: -159> 2023-10-03T19:16:29.754+0000 7f3eda3c7640 10 monclient: tick 2023-10-03T19:21:05.984 INFO:teuthology.orchestra.run.smithi045.stdout: -158> 2023-10-03T19:16:29.754+0000 7f3eda3c7640 10 monclient: _check_auth_tickets 2023-10-03T19:21:05.984 INFO:teuthology.orchestra.run.smithi045.stdout: -157> 2023-10-03T19:16:29.754+0000 7f3eda3c7640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:15:59.761996+0000) 2023-10-03T19:21:05.985 INFO:teuthology.orchestra.run.smithi045.stdout: -156> 2023-10-03T19:16:30.330+0000 7f3ed9bc6640 20 mds.0.19 get_task_status 2023-10-03T19:21:05.985 INFO:teuthology.orchestra.run.smithi045.stdout: -155> 2023-10-03T19:16:30.330+0000 7f3ed9bc6640 20 mds.0.19 schedule_update_timer_task 2023-10-03T19:21:05.985 INFO:teuthology.orchestra.run.smithi045.stdout: -154> 2023-10-03T19:16:30.370+0000 7f3ed73c1640 2 mds.0.cache Memory usage: total 303832, rss 75940, heap 207144, baseline 190760, 0 / 1014 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:05.985 INFO:teuthology.orchestra.run.smithi045.stdout: -153> 2023-10-03T19:16:30.370+0000 7f3ed73c1640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999990702s ago 2023-10-03T19:21:05.985 INFO:teuthology.orchestra.run.smithi045.stdout: -152> 2023-10-03T19:16:30.370+0000 7f3ed73c1640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:05.985 INFO:teuthology.orchestra.run.smithi045.stdout: -151> 2023-10-03T19:16:30.370+0000 7f3ed73c1640 7 mds.0.cache trim bytes_used=2MB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:05.985 INFO:teuthology.orchestra.run.smithi045.stdout: -150> 2023-10-03T19:16:30.370+0000 7f3ed73c1640 7 mds.0.cache trim_lru trimming 0 items from LRU size=1011 mid=543 pintail=235 pinned=235 2023-10-03T19:21:05.985 INFO:teuthology.orchestra.run.smithi045.stdout: -149> 2023-10-03T19:16:30.370+0000 7f3ed73c1640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:05.985 INFO:teuthology.orchestra.run.smithi045.stdout: -148> 2023-10-03T19:16:30.370+0000 7f3ed73c1640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:05.985 INFO:teuthology.orchestra.run.smithi045.stdout: -147> 2023-10-03T19:16:30.370+0000 7f3ed73c1640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:05.985 INFO:teuthology.orchestra.run.smithi045.stdout: -146> 2023-10-03T19:16:30.370+0000 7f3ed73c1640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:05.986 INFO:teuthology.orchestra.run.smithi045.stdout: -145> 2023-10-03T19:16:30.390+0000 7f3ed93c5640 5 mds.beacon.a Sending beacon up:active seq 14 2023-10-03T19:21:05.986 INFO:teuthology.orchestra.run.smithi045.stdout: -144> 2023-10-03T19:16:30.390+0000 7f3ed93c5640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:06.055 INFO:teuthology.orchestra.run.smithi045.stdout: -143> 2023-10-03T19:16:30.390+0000 7f3ed93c5640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mdsbeacon(5514/a up:active seq=14 v23) v8 -- 0x55576d824b00 con 0x55576c0bd400 2023-10-03T19:21:06.055 INFO:teuthology.orchestra.run.smithi045.stdout: -142> 2023-10-03T19:16:30.390+0000 7f3ed93c5640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:06.056 INFO:teuthology.orchestra.run.smithi045.stdout: -141> 2023-10-03T19:16:30.390+0000 7f3eddbce640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== mon.0 v2:172.21.15.45:3300/0 66 ==== mdsbeacon(5514/a up:active seq=14 v23) v8 ==== 130+0+0 (secure 0 0 0) 0x55576d824b00 con 0x55576c0bd400 2023-10-03T19:21:06.056 INFO:teuthology.orchestra.run.smithi045.stdout: -140> 2023-10-03T19:16:30.390+0000 7f3eddbce640 5 mds.beacon.a received beacon reply up:active seq 14 rtt 0 2023-10-03T19:21:06.056 INFO:teuthology.orchestra.run.smithi045.stdout: -139> 2023-10-03T19:16:30.390+0000 7f3ed93c5640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:06.056 INFO:teuthology.orchestra.run.smithi045.stdout: -138> 2023-10-03T19:16:30.754+0000 7f3eda3c7640 10 monclient: tick 2023-10-03T19:21:06.056 INFO:teuthology.orchestra.run.smithi045.stdout: -137> 2023-10-03T19:16:30.754+0000 7f3eda3c7640 10 monclient: _check_auth_tickets 2023-10-03T19:21:06.056 INFO:teuthology.orchestra.run.smithi045.stdout: -136> 2023-10-03T19:16:30.754+0000 7f3eda3c7640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:16:00.762098+0000) 2023-10-03T19:21:06.056 INFO:teuthology.orchestra.run.smithi045.stdout: -135> 2023-10-03T19:16:31.350+0000 7f3ed43bb640 20 update_rank0: mds.metrics 2023-10-03T19:21:06.056 INFO:teuthology.orchestra.run.smithi045.stdout: -134> 2023-10-03T19:16:31.350+0000 7f3ed43bb640 20 update_rank0: mds.metrics: sending metric updates for 1 clients to rank 0 (address: [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866]) with sequence number 8, last updated sequence number 20 2023-10-03T19:21:06.056 INFO:teuthology.orchestra.run.smithi045.stdout: -133> 2023-10-03T19:16:31.350+0000 7f3ed43bb640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] send_to--> mds [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] -- mds_metrics from rank=0 carrying 1 metric updates v1 -- ?+0 0x55576c118480 2023-10-03T19:21:06.056 INFO:teuthology.orchestra.run.smithi045.stdout: -132> 2023-10-03T19:16:31.350+0000 7f3ed43bb640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] -- mds_metrics from rank=0 carrying 1 metric updates v1 -- 0x55576c118480 con 0x55576c0bdc00 2023-10-03T19:21:06.056 INFO:teuthology.orchestra.run.smithi045.stdout: -131> 2023-10-03T19:16:31.350+0000 7f3edabc8640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== mds.0 v2:172.21.15.45:6833/1319730866 0 ==== mds_metrics from rank=0 carrying 1 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x55576c118480 con 0x55576c0bdc00 2023-10-03T19:21:06.056 INFO:teuthology.orchestra.run.smithi045.stdout: -130> 2023-10-03T19:16:31.350+0000 7f3edabc8640 20 mds.metric.aggregator handle_mds_metrics: applying 1 updates for rank=0 with sequence number 8 2023-10-03T19:21:06.057 INFO:teuthology.orchestra.run.smithi045.stdout: -129> 2023-10-03T19:16:31.350+0000 7f3edabc8640 10 mds.pinger pong_received: rank=0, sequence=8 2023-10-03T19:21:06.057 INFO:teuthology.orchestra.run.smithi045.stdout: -128> 2023-10-03T19:16:31.350+0000 7f3edabc8640 20 mds.metric.aggregator remove_metrics_for_rank: client=client.5697 172.21.15.146:0/3677171105, rank=0 2023-10-03T19:21:06.057 INFO:teuthology.orchestra.run.smithi045.stdout: -127> 2023-10-03T19:16:31.350+0000 7f3edabc8640 20 mds.metric.aggregator remove_metrics_for_rank: rank=0 has 0 connected client(s) 2023-10-03T19:21:06.057 INFO:teuthology.orchestra.run.smithi045.stdout: -126> 2023-10-03T19:16:31.370+0000 7f3ed73c1640 2 mds.0.cache Memory usage: total 303832, rss 75940, heap 207144, baseline 190760, 0 / 1014 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:06.057 INFO:teuthology.orchestra.run.smithi045.stdout: -125> 2023-10-03T19:16:31.370+0000 7f3ed73c1640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999990702s ago 2023-10-03T19:21:06.057 INFO:teuthology.orchestra.run.smithi045.stdout: -124> 2023-10-03T19:16:31.370+0000 7f3ed73c1640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:06.057 INFO:teuthology.orchestra.run.smithi045.stdout: -123> 2023-10-03T19:16:31.370+0000 7f3ed73c1640 7 mds.0.cache trim bytes_used=2MB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:06.057 INFO:teuthology.orchestra.run.smithi045.stdout: -122> 2023-10-03T19:16:31.370+0000 7f3ed73c1640 7 mds.0.cache trim_lru trimming 0 items from LRU size=1011 mid=543 pintail=235 pinned=235 2023-10-03T19:21:06.057 INFO:teuthology.orchestra.run.smithi045.stdout: -121> 2023-10-03T19:16:31.370+0000 7f3ed73c1640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:06.057 INFO:teuthology.orchestra.run.smithi045.stdout: -120> 2023-10-03T19:16:31.370+0000 7f3ed73c1640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:06.057 INFO:teuthology.orchestra.run.smithi045.stdout: -119> 2023-10-03T19:16:31.370+0000 7f3ed73c1640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:06.058 INFO:teuthology.orchestra.run.smithi045.stdout: -118> 2023-10-03T19:16:31.370+0000 7f3ed73c1640 10 mds.0.cache releasing free memory 2023-10-03T19:21:06.058 INFO:teuthology.orchestra.run.smithi045.stdout: -117> 2023-10-03T19:16:31.374+0000 7f3ed73c1640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:06.058 INFO:teuthology.orchestra.run.smithi045.stdout: -116> 2023-10-03T19:16:31.754+0000 7f3eda3c7640 10 monclient: tick 2023-10-03T19:21:06.058 INFO:teuthology.orchestra.run.smithi045.stdout: -115> 2023-10-03T19:16:31.754+0000 7f3eda3c7640 10 monclient: _check_auth_tickets 2023-10-03T19:21:06.058 INFO:teuthology.orchestra.run.smithi045.stdout: -114> 2023-10-03T19:16:31.754+0000 7f3eda3c7640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:16:01.762217+0000) 2023-10-03T19:21:06.058 INFO:teuthology.orchestra.run.smithi045.stdout: -113> 2023-10-03T19:16:32.334+0000 7f3ed9bc6640 20 mds.0.19 get_task_status 2023-10-03T19:21:06.058 INFO:teuthology.orchestra.run.smithi045.stdout: -112> 2023-10-03T19:16:32.334+0000 7f3ed9bc6640 20 mds.0.19 schedule_update_timer_task 2023-10-03T19:21:06.058 INFO:teuthology.orchestra.run.smithi045.stdout: -111> 2023-10-03T19:16:32.346+0000 7f3ed3bba640 10 mds.metric.aggregator ping_all_active_ranks: pinging 1 active mds(s) 2023-10-03T19:21:06.058 INFO:teuthology.orchestra.run.smithi045.stdout: -110> 2023-10-03T19:16:32.346+0000 7f3ed3bba640 20 mds.metric.aggregator ping_all_active_ranks: pinging rank=0 addr=[v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] 2023-10-03T19:21:06.058 INFO:teuthology.orchestra.run.smithi045.stdout: -109> 2023-10-03T19:16:32.346+0000 7f3ed3bba640 10 mds.pinger send_ping: rank=0 2023-10-03T19:21:06.058 INFO:teuthology.orchestra.run.smithi045.stdout: -108> 2023-10-03T19:16:32.346+0000 7f3ed3bba640 10 mds.pinger send_ping: sending ping with sequence=9 to rank=0 2023-10-03T19:21:06.058 INFO:teuthology.orchestra.run.smithi045.stdout: -107> 2023-10-03T19:16:32.346+0000 7f3ed3bba640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] send_to--> mds [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] -- mdsping v1 -- ?+0 0x55576c102f00 2023-10-03T19:21:06.059 INFO:teuthology.orchestra.run.smithi045.stdout: -106> 2023-10-03T19:16:32.346+0000 7f3ed3bba640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] -- mdsping v1 -- 0x55576c102f00 con 0x55576c0bdc00 2023-10-03T19:21:06.059 INFO:teuthology.orchestra.run.smithi045.stdout: -105> 2023-10-03T19:16:32.346+0000 7f3edabc8640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== mds.0 v2:172.21.15.45:6833/1319730866 0 ==== mdsping v1 ==== 0+0+0 (unknown 0 0 0) 0x55576c102f00 con 0x55576c0bdc00 2023-10-03T19:21:06.059 INFO:teuthology.orchestra.run.smithi045.stdout: -104> 2023-10-03T19:16:32.346+0000 7f3edabc8640 20 set_next_seq: mds.metrics: current sequence number 8, setting next sequence number 9 2023-10-03T19:21:06.059 INFO:teuthology.orchestra.run.smithi045.stdout: -103> 2023-10-03T19:16:32.374+0000 7f3ed73c1640 2 mds.0.cache Memory usage: total 303832, rss 57444, heap 207144, baseline 190760, 0 / 1014 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:06.059 INFO:teuthology.orchestra.run.smithi045.stdout: -102> 2023-10-03T19:16:32.374+0000 7f3ed73c1640 20 mds.0.cache upkeep thread trimming cache; last trim 1.003990769s ago 2023-10-03T19:21:06.059 INFO:teuthology.orchestra.run.smithi045.stdout: -101> 2023-10-03T19:16:32.374+0000 7f3ed73c1640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:06.059 INFO:teuthology.orchestra.run.smithi045.stdout: -100> 2023-10-03T19:16:32.374+0000 7f3ed73c1640 7 mds.0.cache trim bytes_used=2MB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:06.059 INFO:teuthology.orchestra.run.smithi045.stdout: -99> 2023-10-03T19:16:32.374+0000 7f3ed73c1640 7 mds.0.cache trim_lru trimming 0 items from LRU size=1011 mid=543 pintail=235 pinned=235 2023-10-03T19:21:06.059 INFO:teuthology.orchestra.run.smithi045.stdout: -98> 2023-10-03T19:16:32.374+0000 7f3ed73c1640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:06.059 INFO:teuthology.orchestra.run.smithi045.stdout: -97> 2023-10-03T19:16:32.374+0000 7f3ed73c1640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:06.059 INFO:teuthology.orchestra.run.smithi045.stdout: -96> 2023-10-03T19:16:32.374+0000 7f3ed73c1640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:06.060 INFO:teuthology.orchestra.run.smithi045.stdout: -95> 2023-10-03T19:16:32.374+0000 7f3ed73c1640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:06.060 INFO:teuthology.orchestra.run.smithi045.stdout: -94> 2023-10-03T19:16:32.754+0000 7f3eda3c7640 10 monclient: tick 2023-10-03T19:21:06.060 INFO:teuthology.orchestra.run.smithi045.stdout: -93> 2023-10-03T19:16:32.754+0000 7f3eda3c7640 10 monclient: _check_auth_tickets 2023-10-03T19:21:06.060 INFO:teuthology.orchestra.run.smithi045.stdout: -92> 2023-10-03T19:16:32.754+0000 7f3eda3c7640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:16:02.762341+0000) 2023-10-03T19:21:06.060 INFO:teuthology.orchestra.run.smithi045.stdout: -91> 2023-10-03T19:16:33.350+0000 7f3ed43bb640 20 update_rank0: mds.metrics 2023-10-03T19:21:06.060 INFO:teuthology.orchestra.run.smithi045.stdout: -90> 2023-10-03T19:16:33.350+0000 7f3ed43bb640 20 update_rank0: mds.metrics: sending metric updates for 0 clients to rank 0 (address: [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866]) with sequence number 9, last updated sequence number 21 2023-10-03T19:21:06.060 INFO:teuthology.orchestra.run.smithi045.stdout: -89> 2023-10-03T19:16:33.350+0000 7f3ed43bb640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] send_to--> mds [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] -- mds_metrics from rank=0 carrying 0 metric updates v1 -- ?+0 0x55576d017980 2023-10-03T19:21:06.060 INFO:teuthology.orchestra.run.smithi045.stdout: -88> 2023-10-03T19:16:33.350+0000 7f3ed43bb640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] -- mds_metrics from rank=0 carrying 0 metric updates v1 -- 0x55576d017980 con 0x55576c0bdc00 2023-10-03T19:21:06.060 INFO:teuthology.orchestra.run.smithi045.stdout: -87> 2023-10-03T19:16:33.350+0000 7f3edabc8640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== mds.0 v2:172.21.15.45:6833/1319730866 0 ==== mds_metrics from rank=0 carrying 0 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x55576d017980 con 0x55576c0bdc00 2023-10-03T19:21:06.060 INFO:teuthology.orchestra.run.smithi045.stdout: -86> 2023-10-03T19:16:33.350+0000 7f3edabc8640 20 mds.metric.aggregator handle_mds_metrics: applying 0 updates for rank=0 with sequence number 9 2023-10-03T19:21:06.060 INFO:teuthology.orchestra.run.smithi045.stdout: -85> 2023-10-03T19:16:33.350+0000 7f3edabc8640 10 mds.pinger pong_received: rank=0, sequence=9 2023-10-03T19:21:06.061 INFO:teuthology.orchestra.run.smithi045.stdout: -84> 2023-10-03T19:16:33.358+0000 7f3edb3c9640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== mon.0 v2:172.21.15.45:3300/0 67 ==== osd_map(51..51 src has 1..51) v4 ==== 432+0+0 (secure 0 0 0) 0x55576d3cac40 con 0x55576c0bd400 2023-10-03T19:21:06.061 INFO:teuthology.orchestra.run.smithi045.stdout: -83> 2023-10-03T19:16:33.358+0000 7f3edb3c9640 10 mds.0.snap check_osd_map need_to_purge={} 2023-10-03T19:21:06.061 INFO:teuthology.orchestra.run.smithi045.stdout: -82> 2023-10-03T19:16:33.358+0000 7f3edb3c9640 7 mds.0.server operator(): full = 0 epoch = 51 2023-10-03T19:21:06.061 INFO:teuthology.orchestra.run.smithi045.stdout: -81> 2023-10-03T19:16:33.358+0000 7f3edb3c9640 10 mds.0.server apply_blocklist: killed 0 2023-10-03T19:21:06.061 INFO:teuthology.orchestra.run.smithi045.stdout: -80> 2023-10-03T19:16:33.358+0000 7f3edb3c9640 4 mds.0.19 apply_blocklist: killed 0, blocklisted sessions (2 blocklist entries, 0) 2023-10-03T19:21:06.061 INFO:teuthology.orchestra.run.smithi045.stdout: -79> 2023-10-03T19:16:33.358+0000 7f3edb3c9640 10 monclient: _renew_subs 2023-10-03T19:21:06.061 INFO:teuthology.orchestra.run.smithi045.stdout: -78> 2023-10-03T19:16:33.358+0000 7f3edb3c9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:06.061 INFO:teuthology.orchestra.run.smithi045.stdout: -77> 2023-10-03T19:16:33.358+0000 7f3edb3c9640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=52}) v3 -- 0x55576cf6ad00 con 0x55576c0bd400 2023-10-03T19:21:06.061 INFO:teuthology.orchestra.run.smithi045.stdout: -76> 2023-10-03T19:16:33.374+0000 7f3ed73c1640 2 mds.0.cache Memory usage: total 303832, rss 57444, heap 207144, baseline 190760, 0 / 1014 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:06.061 INFO:teuthology.orchestra.run.smithi045.stdout: -75> 2023-10-03T19:16:33.374+0000 7f3ed73c1640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999990702s ago 2023-10-03T19:21:06.061 INFO:teuthology.orchestra.run.smithi045.stdout: -74> 2023-10-03T19:16:33.374+0000 7f3ed73c1640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:06.062 INFO:teuthology.orchestra.run.smithi045.stdout: -73> 2023-10-03T19:16:33.374+0000 7f3ed73c1640 7 mds.0.cache trim bytes_used=2MB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:06.062 INFO:teuthology.orchestra.run.smithi045.stdout: -72> 2023-10-03T19:16:33.374+0000 7f3ed73c1640 7 mds.0.cache trim_lru trimming 0 items from LRU size=1011 mid=543 pintail=235 pinned=235 2023-10-03T19:21:06.062 INFO:teuthology.orchestra.run.smithi045.stdout: -71> 2023-10-03T19:16:33.374+0000 7f3ed73c1640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:06.062 INFO:teuthology.orchestra.run.smithi045.stdout: -70> 2023-10-03T19:16:33.374+0000 7f3ed73c1640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:06.062 INFO:teuthology.orchestra.run.smithi045.stdout: -69> 2023-10-03T19:16:33.374+0000 7f3ed73c1640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:06.062 INFO:teuthology.orchestra.run.smithi045.stdout: -68> 2023-10-03T19:16:33.374+0000 7f3ed73c1640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:06.062 INFO:teuthology.orchestra.run.smithi045.stdout: -67> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 10 mds.0.log trim 1 / 128 segments, 227 / -1 events, 0 (0) expiring, 0 (0) expired 2023-10-03T19:21:06.062 INFO:teuthology.orchestra.run.smithi045.stdout: -66> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 10 mds.0.openfiles commit log_seq 2787 committing_log_seq:2787 2023-10-03T19:21:06.062 INFO:teuthology.orchestra.run.smithi045.stdout: -65> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2571 7.6 7:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b,omap-rm-keys in=24b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51) v8 -- 0x55576d492000 con 0x55576cfe9000 2023-10-03T19:21:06.062 INFO:teuthology.orchestra.run.smithi045.stdout: -64> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 10 mds.0.log _trim_expired_segments waiting for 2787/9627792 to expire 2023-10-03T19:21:06.084 INFO:teuthology.orchestra.run.smithi045.stdout: -63> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 10 mds.0.server find_idle_sessions. last cleared laggy state 1040.14s ago 2023-10-03T19:21:06.084 INFO:teuthology.orchestra.run.smithi045.stdout: -62> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 10 mds.0.locker scatter_tick 2023-10-03T19:21:06.084 INFO:teuthology.orchestra.run.smithi045.stdout: -61> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 10 mds.0.locker scatter_nudge auth, scatter/unscattering (inest lock dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (inest lock dirty) (iversion lock) | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=0 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:06.084 INFO:teuthology.orchestra.run.smithi045.stdout: -60> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 7 mds.0.locker simple_sync on (inest lock dirty) on [inode 0x1 [...2,head] / auth v21 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (inest lock dirty) (iversion lock) | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=0 dirtyparent=0 dirty=1 authpin=0 0x55576c14a680] 2023-10-03T19:21:06.084 INFO:teuthology.orchestra.run.smithi045.stdout: -59> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 10 mds.0.cache.ino(0x1) auth_pin by 0x55576c14aa10 on [inode 0x1 [...2,head] / auth v21 ap=1 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (inest lock->sync dirty) (iversion lock) | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=0 dirtyparent=0 dirty=1 authpin=1 0x55576c14a680] now 1 2023-10-03T19:21:06.085 INFO:teuthology.orchestra.run.smithi045.stdout: -58> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 10 mds.0.locker scatter_writebehind 2023-10-03T19:16:01.359696+0000 on (inest lock->sync dirty) on [inode 0x1 [...2,head] / auth v21 ap=1 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (inest lock->sync dirty) (iversion lock) | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=0 dirtyparent=0 dirty=1 authpin=1 0x55576c14a680] 2023-10-03T19:21:06.085 INFO:teuthology.orchestra.run.smithi045.stdout: -57> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 20 mds.0.cache.ino(0x1) pre_cow_old_inode follows 1 on [inode 0x1 [...2,head] / auth v21 ap=1 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (inest lock->sync w=1 dirty) (iversion lock) | dirtyscattered=1 request=0 lock=1 dirfrag=1 caps=0 dirtyparent=0 dirty=1 authpin=1 0x55576c14a680] 2023-10-03T19:21:06.085 INFO:teuthology.orchestra.run.smithi045.stdout: -56> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 15 mds.0.cache.ino(0x1) project_inode 0x1 2023-10-03T19:21:06.085 INFO:teuthology.orchestra.run.smithi045.stdout: -55> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 10 mds.0.cache.ino(0x1) finish_scatter_gather_update 128 on [inode 0x1 [...2,head] / auth v21 pv22 ap=1 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1)->n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (inest lock->sync w=1 dirty) (iversion lock) | dirtyscattered=1 request=0 lock=1 dirfrag=1 caps=0 dirtyparent=0 dirty=1 authpin=1 0x55576c14a680] 2023-10-03T19:21:06.085 INFO:teuthology.orchestra.run.smithi045.stdout: -54> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 20 mds.0.cache.ino(0x1) orig rstat n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2) 2023-10-03T19:21:06.085 INFO:teuthology.orchestra.run.smithi045.stdout: -53> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 20 mds.0.cache.ino(0x1) * [dir 0x1 / [2,head] auth v=6007 cv=5559/5559 REP dir_auth=0 state=1610612737|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=0 0x55576c12ad00] 2023-10-03T19:21:06.085 INFO:teuthology.orchestra.run.smithi045.stdout: -52> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 10 mds.0.cache.dir(0x1) auth_pin by 0x55576d4aa000 on [dir 0x1 / [2,head] auth v=6007 cv=5559/5559 REP dir_auth=0 ap=1+0 state=1610612737|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] count now 1 2023-10-03T19:21:06.085 INFO:teuthology.orchestra.run.smithi045.stdout: -51> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 10 mds.0.cache.dir(0x1) project_fnode 0x55576d826140 2023-10-03T19:21:06.085 INFO:teuthology.orchestra.run.smithi045.stdout: -50> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 10 mds.0.cache.dir(0x1) assimilate_dirty_rstat_inodes 2023-10-03T19:21:06.085 INFO:teuthology.orchestra.run.smithi045.stdout: -49> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 10 mds.0.cache.dir(0x1) assimilate_dirty_rstat_inodes done 2023-10-03T19:21:06.085 INFO:teuthology.orchestra.run.smithi045.stdout: -48> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 20 mds.0.cache.ino(0x1) * rstat n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) 2023-10-03T19:21:06.086 INFO:teuthology.orchestra.run.smithi045.stdout: -47> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 20 mds.0.cache.ino(0x1) * accounted_rstat n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) 2023-10-03T19:21:06.086 INFO:teuthology.orchestra.run.smithi045.stdout: -46> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 20 mds.0.cache.ino(0x1) * dirty_old_rstat {} 2023-10-03T19:21:06.086 INFO:teuthology.orchestra.run.smithi045.stdout: -45> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 10 mds.0.cache project_rstat_frag_to_inode [2,head] 2023-10-03T19:21:06.086 INFO:teuthology.orchestra.run.smithi045.stdout: -44> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 20 mds.0.cache frag rstat n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) 2023-10-03T19:21:06.086 INFO:teuthology.orchestra.run.smithi045.stdout: -43> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 20 mds.0.cache frag accounted_rstat n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) 2023-10-03T19:21:06.086 INFO:teuthology.orchestra.run.smithi045.stdout: -42> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 20 mds.0.cache delta n(v3 rc2023-10-03T19:16:14.509983+0000) 2023-10-03T19:21:06.086 INFO:teuthology.orchestra.run.smithi045.stdout: -41> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 20 mds.0.cache projecting to [2,head] n(v4 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2) 2023-10-03T19:21:06.086 INFO:teuthology.orchestra.run.smithi045.stdout: -40> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 20 mds.0.cache result [2,head] n(v4 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2) 2023-10-03T19:21:06.625 INFO:teuthology.orchestra.run.smithi045.stdout: -39> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 20 mds.0.cache.dir(0x1) get_num_head_items() = 1; fnode.fragstat.nfiles=0 fnode.fragstat.nsubdirs=1 2023-10-03T19:21:06.626 INFO:teuthology.orchestra.run.smithi045.stdout: -38> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 20 mds.0.cache.dir(0x1) total of child dentries: n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) 2023-10-03T19:21:06.626 INFO:teuthology.orchestra.run.smithi045.stdout: -37> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 20 mds.0.cache.dir(0x1) my rstats: n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) 2023-10-03T19:21:06.626 INFO:teuthology.orchestra.run.smithi045.stdout: -36> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 10 mds.0.cache.dir(0x1) check_rstats complete on 0x55576c12ad00 2023-10-03T19:21:06.626 INFO:teuthology.orchestra.run.smithi045.stdout: -35> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 10 mds.0.cache.dir(0x1) pre_dirty 6008 2023-10-03T19:21:06.626 INFO:teuthology.orchestra.run.smithi045.stdout: -34> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 20 mds.0.cache.dir(0x1) get_num_head_items() = 1; fnode.fragstat.nfiles=0 fnode.fragstat.nsubdirs=1 2023-10-03T19:21:06.626 INFO:teuthology.orchestra.run.smithi045.stdout: -33> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 20 mds.0.cache.dir(0x1) total of child dentries: n(v0 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) 2023-10-03T19:21:06.626 INFO:teuthology.orchestra.run.smithi045.stdout: -32> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 20 mds.0.cache.dir(0x1) my rstats: n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) 2023-10-03T19:21:06.627 INFO:teuthology.orchestra.run.smithi045.stdout: -31> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 10 mds.0.cache.dir(0x1) check_rstats complete on 0x55576c12ad00 2023-10-03T19:21:06.627 INFO:teuthology.orchestra.run.smithi045.stdout: -30> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 10 mds.0.cache.ino(0x1) * updated accounted_rstat n(v4 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) on [dir 0x1 / [2,head] auth pv=6008 v=6007 cv=5559/5559 REP dir_auth=0 ap=1+0 state=1610645505|complete|assimrstat f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v4 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] 2023-10-03T19:21:06.627 INFO:teuthology.orchestra.run.smithi045.stdout: -29> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 20 mds.0.cache.ino(0x1) final rstat n(v4 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2) 2023-10-03T19:21:06.627 INFO:teuthology.orchestra.run.smithi045.stdout: -28> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 10 mds.0.cache.ino(0x1) finish_scatter_gather_update_accounted 128 on [inode 0x1 [...2,head] / auth v21 pv22 ap=1 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1)->n(v4 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (inest lock->sync w=1 flushing) (iversion lock) | dirtyscattered=1 request=0 lock=1 dirfrag=1 caps=0 dirtyparent=0 dirty=1 authpin=1 0x55576c14a680] 2023-10-03T19:21:06.627 INFO:teuthology.orchestra.run.smithi045.stdout: -27> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 10 mds.0.cache.dir(0x1) assimilate_dirty_rstat_inodes_finish 2023-10-03T19:21:06.627 INFO:teuthology.orchestra.run.smithi045.stdout: -26> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 10 mds.0.cache.ino(0x1) journaling updated frag accounted_ on [dir 0x1 / [2,head] auth pv=6008 v=6007 cv=5559/5559 REP dir_auth=0 ap=1+0 state=1610612737|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v4 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] 2023-10-03T19:21:06.627 INFO:teuthology.orchestra.run.smithi045.stdout: -25> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 10 mds.0.locker scatter_nudge auth, waiting for stable (inest lock->sync w=1 flushing) on [inode 0x1 [...2,head] / auth v21 pv22 ap=1 snaprealm=0x55576c2398c0 f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1)->n(v4 rc2023-10-03T19:16:14.509983+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:15:46.333910+0000 1=0+1) (inest lock->sync w=1 flushing) (iversion lock) | dirtyscattered=1 request=0 lock=1 dirfrag=1 caps=0 dirtyparent=0 dirty=1 authpin=1 0x55576c14a680] 2023-10-03T19:21:06.628 INFO:teuthology.orchestra.run.smithi045.stdout: -24> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 20 mds.0.locker caps_tick 0 revoking caps 2023-10-03T19:21:06.628 INFO:teuthology.orchestra.run.smithi045.stdout: -23> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 20 mds.0.bal handle_export_pins export_pin_queue size=0 2023-10-03T19:21:06.628 INFO:teuthology.orchestra.run.smithi045.stdout: -22> 2023-10-03T19:16:33.754+0000 7f3ed4bbc640 5 mds.0.log _submit_thread 10056686~1118 : EUpdate scatter_writebehind [metablob 0x1, 1 dirs] 2023-10-03T19:21:06.628 INFO:teuthology.orchestra.run.smithi045.stdout: -21> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 15 mds.0.bal tick tick last_sample now 1040.144226s 2023-10-03T19:21:06.628 INFO:teuthology.orchestra.run.smithi045.stdout: -20> 2023-10-03T19:16:33.754+0000 7f3ed4bbc640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.19:2572 7.1b 7:ddb4e4d7:::200.00000002:head [write 1668078~1138 [fadvise_dontneed] in=1138b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51) v8 -- 0x55576d0f6a80 con 0x55576cfe9000 2023-10-03T19:21:06.628 INFO:teuthology.orchestra.run.smithi045.stdout: -19> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 15 mds.0.bal get_load mdsload<[pop IRD:[C 0.00e+00] IWR:[C 2.08e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.60e-01] *LOAD:418.5]/[pop IRD:[C 0.00e+00] IWR:[C 2.08e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.60e-01] *LOAD:418.5], req 0.0666673, hr 1, qlen 0, cpu 5.13338> 2023-10-03T19:21:06.628 INFO:teuthology.orchestra.run.smithi045.stdout: -18> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 3 mds.0.bal send_heartbeat epoch 4 load mdsload<[pop IRD:[C 0.00e+00] IWR:[C 2.08e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.60e-01] *LOAD:418.5]/[pop IRD:[C 0.00e+00] IWR:[C 2.08e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.60e-01] *LOAD:418.5], req 0.0666673, hr 1, qlen 0, cpu 5.13338> 2023-10-03T19:21:06.629 INFO:teuthology.orchestra.run.smithi045.stdout: -17> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 15 mds.0.cache show_subtrees 2023-10-03T19:21:06.629 INFO:teuthology.orchestra.run.smithi045.stdout: -16> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 10 mds.0.cache |__ 0 auth [dir 0x1 / [2,head] auth pv=6008 v=6007 cv=5559/5559 REP dir_auth=0 ap=1+0 state=1610612737|complete f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1)->f(v0 m2023-10-03T19:16:01.359696+0000 1=0+1) n(v3 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1)->n(v4 rc2023-10-03T19:16:14.509983+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55576c12ad00] 2023-10-03T19:21:06.629 INFO:teuthology.orchestra.run.smithi045.stdout: -15> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 10 mds.0.cache |__ 0 auth [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:15:46.335564+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55576c12b180] 2023-10-03T19:21:06.629 INFO:teuthology.orchestra.run.smithi045.stdout: -14> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 10 mds.0.cache find_stale_fragment_freeze 2023-10-03T19:21:06.629 INFO:teuthology.orchestra.run.smithi045.stdout: -13> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 10 mds.0.snap check_osd_map - version unchanged 2023-10-03T19:21:06.629 INFO:teuthology.orchestra.run.smithi045.stdout: -12> 2023-10-03T19:16:33.754+0000 7f3ed9bc6640 20 mds.0.19 updating export targets, currently 0 ranks are targets 2023-10-03T19:21:06.629 INFO:teuthology.orchestra.run.smithi045.stdout: -11> 2023-10-03T19:16:33.754+0000 7f3eda3c7640 10 monclient: tick 2023-10-03T19:21:06.629 INFO:teuthology.orchestra.run.smithi045.stdout: -10> 2023-10-03T19:16:33.754+0000 7f3eda3c7640 10 monclient: _check_auth_tickets 2023-10-03T19:21:06.630 INFO:teuthology.orchestra.run.smithi045.stdout: -9> 2023-10-03T19:16:33.754+0000 7f3eda3c7640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:16:03.762435+0000) 2023-10-03T19:21:06.630 INFO:teuthology.orchestra.run.smithi045.stdout: -8> 2023-10-03T19:16:33.758+0000 7f3edb3c9640 1 -- [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] <== mon.0 v2:172.21.15.45:3300/0 68 ==== mdsmap(e 24) v2 ==== 225+0+0 (secure 0 0 0) 0x55576cf6ad00 con 0x55576c0bd400 2023-10-03T19:21:06.630 INFO:teuthology.orchestra.run.smithi045.stdout: -7> 2023-10-03T19:16:33.758+0000 7f3edb3c9640 1 mds.a Updating MDS map to version 24 from mon.0 2023-10-03T19:21:06.630 INFO:teuthology.orchestra.run.smithi045.stdout: -6> 2023-10-03T19:16:33.758+0000 7f3edb3c9640 10 mds.a my compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-03T19:21:06.630 INFO:teuthology.orchestra.run.smithi045.stdout: -5> 2023-10-03T19:16:33.758+0000 7f3edb3c9640 10 mds.a mdsmap compat compat={},rocompat={},incompat={7=mds uses inline data} 2023-10-03T19:21:06.630 INFO:teuthology.orchestra.run.smithi045.stdout: -4> 2023-10-03T19:16:33.758+0000 7f3edb3c9640 10 mds.a my gid is 5514 2023-10-03T19:21:06.630 INFO:teuthology.orchestra.run.smithi045.stdout: -3> 2023-10-03T19:16:33.758+0000 7f3edb3c9640 10 mds.a map says I am mds.-1.-1 state null 2023-10-03T19:21:06.630 INFO:teuthology.orchestra.run.smithi045.stdout: -2> 2023-10-03T19:16:33.758+0000 7f3edb3c9640 10 mds.a msgr says I am [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] 2023-10-03T19:21:06.631 INFO:teuthology.orchestra.run.smithi045.stdout: -1> 2023-10-03T19:16:33.758+0000 7f3edb3c9640 1 mds.a Map removed me [mds.a{0:5514} state up:active seq 3 addr [v2:172.21.15.45:6833/1319730866,v1:172.21.15.45:6835/1319730866] compat {c=[1],r=[1],i=[7ff]}] from cluster; respawning! See cluster/monitor logs for details. 2023-10-03T19:21:06.631 INFO:teuthology.orchestra.run.smithi045.stdout: 0> 2023-10-03T19:16:33.758+0000 7f3edb3c9640 1 mds.a respawn! 2023-10-03T19:21:06.631 INFO:teuthology.orchestra.run.smithi045.stdout:--- logging levels --- 2023-10-03T19:21:06.631 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 none 2023-10-03T19:21:06.631 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 lockdep 2023-10-03T19:21:06.631 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 context 2023-10-03T19:21:06.631 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 1 crush 2023-10-03T19:21:06.631 INFO:teuthology.orchestra.run.smithi045.stdout: 20/20 mds 2023-10-03T19:21:06.632 INFO:teuthology.orchestra.run.smithi045.stdout: 20/20 mds_balancer 2023-10-03T19:21:06.632 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mds_locker 2023-10-03T19:21:06.632 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mds_log 2023-10-03T19:21:06.632 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mds_log_expire 2023-10-03T19:21:06.632 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mds_migrator 2023-10-03T19:21:06.632 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 buffer 2023-10-03T19:21:06.632 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 timer 2023-10-03T19:21:06.632 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 filer 2023-10-03T19:21:06.633 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 striper 2023-10-03T19:21:06.633 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 objecter 2023-10-03T19:21:06.633 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 rados 2023-10-03T19:21:06.633 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 rbd 2023-10-03T19:21:06.633 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 rbd_mirror 2023-10-03T19:21:06.633 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 rbd_replay 2023-10-03T19:21:06.633 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 rbd_pwl 2023-10-03T19:21:06.633 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 journaler 2023-10-03T19:21:06.634 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 objectcacher 2023-10-03T19:21:06.634 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 immutable_obj_cache 2023-10-03T19:21:06.634 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 client 2023-10-03T19:21:06.634 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 osd 2023-10-03T19:21:06.634 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 optracker 2023-10-03T19:21:06.634 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 objclass 2023-10-03T19:21:06.634 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 3 filestore 2023-10-03T19:21:06.634 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 3 journal 2023-10-03T19:21:06.635 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 1 ms 2023-10-03T19:21:06.635 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mon 2023-10-03T19:21:06.635 INFO:teuthology.orchestra.run.smithi045.stdout: 0/10 monc 2023-10-03T19:21:06.635 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 paxos 2023-10-03T19:21:06.635 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 tp 2023-10-03T19:21:06.635 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 auth 2023-10-03T19:21:06.635 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 crypto 2023-10-03T19:21:06.635 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 1 finisher 2023-10-03T19:21:06.635 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 1 reserver 2023-10-03T19:21:06.636 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 heartbeatmap 2023-10-03T19:21:06.636 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 perfcounter 2023-10-03T19:21:06.636 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw 2023-10-03T19:21:06.636 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw_sync 2023-10-03T19:21:06.636 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw_datacache 2023-10-03T19:21:06.636 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw_access 2023-10-03T19:21:06.636 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw_dbstore 2023-10-03T19:21:06.636 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw_flight 2023-10-03T19:21:06.637 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 javaclient 2023-10-03T19:21:06.637 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 asok 2023-10-03T19:21:06.637 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 1 throttle 2023-10-03T19:21:06.637 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 0 refs 2023-10-03T19:21:06.637 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 compressor 2023-10-03T19:21:06.637 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 bluestore 2023-10-03T19:21:06.637 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 bluefs 2023-10-03T19:21:06.637 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 3 bdev 2023-10-03T19:21:06.637 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 kstore 2023-10-03T19:21:06.638 INFO:teuthology.orchestra.run.smithi045.stdout: 4/ 5 rocksdb 2023-10-03T19:21:06.638 INFO:teuthology.orchestra.run.smithi045.stdout: 4/ 5 leveldb 2023-10-03T19:21:06.638 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 fuse 2023-10-03T19:21:06.638 INFO:teuthology.orchestra.run.smithi045.stdout: 2/ 5 mgr 2023-10-03T19:21:06.638 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mgrc 2023-10-03T19:21:06.638 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 dpdk 2023-10-03T19:21:06.638 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 eventtrace 2023-10-03T19:21:06.638 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 prioritycache 2023-10-03T19:21:06.639 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 test 2023-10-03T19:21:06.639 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 cephfs_mirror 2023-10-03T19:21:06.639 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 cephsqlite 2023-10-03T19:21:06.639 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore 2023-10-03T19:21:06.639 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_onode 2023-10-03T19:21:06.639 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_odata 2023-10-03T19:21:06.639 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_omap 2023-10-03T19:21:06.639 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_tm 2023-10-03T19:21:06.639 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_t 2023-10-03T19:21:06.640 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_cleaner 2023-10-03T19:21:06.640 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_epm 2023-10-03T19:21:06.640 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_lba 2023-10-03T19:21:06.640 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_fixedkv_tree 2023-10-03T19:21:06.640 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_cache 2023-10-03T19:21:06.640 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_journal 2023-10-03T19:21:06.640 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_device 2023-10-03T19:21:06.640 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_backref 2023-10-03T19:21:06.641 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 alienstore 2023-10-03T19:21:06.641 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mclock 2023-10-03T19:21:06.641 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 cyanstore 2023-10-03T19:21:06.641 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 ceph_exporter 2023-10-03T19:21:06.641 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 memstore 2023-10-03T19:21:06.641 INFO:teuthology.orchestra.run.smithi045.stdout: -2/-2 (syslog threshold) 2023-10-03T19:21:06.641 INFO:teuthology.orchestra.run.smithi045.stdout: -1/-1 (stderr threshold) 2023-10-03T19:21:06.641 INFO:teuthology.orchestra.run.smithi045.stdout:--- pthread ID / name mapping for recent threads --- 2023-10-03T19:21:06.641 INFO:teuthology.orchestra.run.smithi045.stdout: 7f3ed3bba640 / ms_dispatch 2023-10-03T19:21:06.642 INFO:teuthology.orchestra.run.smithi045.stdout: 7f3ed43bb640 / ms_dispatch 2023-10-03T19:21:06.642 INFO:teuthology.orchestra.run.smithi045.stdout: 7f3ed4bbc640 / md_submit 2023-10-03T19:21:06.642 INFO:teuthology.orchestra.run.smithi045.stdout: 7f3ed53bd640 / MR_Finisher 2023-10-03T19:21:06.642 INFO:teuthology.orchestra.run.smithi045.stdout: 7f3ed6bc0640 / mds_rank_progr 2023-10-03T19:21:06.642 INFO:teuthology.orchestra.run.smithi045.stdout: 7f3ed73c1640 / ms_dispatch 2023-10-03T19:21:06.642 INFO:teuthology.orchestra.run.smithi045.stdout: 7f3ed8bc4640 / safe_timer 2023-10-03T19:21:06.642 INFO:teuthology.orchestra.run.smithi045.stdout: 7f3ed93c5640 / ceph-mds 2023-10-03T19:21:06.642 INFO:teuthology.orchestra.run.smithi045.stdout: 7f3ed9bc6640 / safe_timer 2023-10-03T19:21:06.643 INFO:teuthology.orchestra.run.smithi045.stdout: 7f3eda3c7640 / safe_timer 2023-10-03T19:21:06.643 INFO:teuthology.orchestra.run.smithi045.stdout: 7f3edabc8640 / ms_local 2023-10-03T19:21:06.643 INFO:teuthology.orchestra.run.smithi045.stdout: 7f3edb3c9640 / ms_dispatch 2023-10-03T19:21:06.643 INFO:teuthology.orchestra.run.smithi045.stdout: 7f3eddbce640 / msgr-worker-2 2023-10-03T19:21:06.643 INFO:teuthology.orchestra.run.smithi045.stdout: 7f3ede3cf640 / msgr-worker-1 2023-10-03T19:21:06.643 INFO:teuthology.orchestra.run.smithi045.stdout: 7f3edebd0640 / msgr-worker-0 2023-10-03T19:21:06.643 INFO:teuthology.orchestra.run.smithi045.stdout: max_recent 10000 2023-10-03T19:21:06.643 INFO:teuthology.orchestra.run.smithi045.stdout: max_new 1000 2023-10-03T19:21:06.644 INFO:teuthology.orchestra.run.smithi045.stdout: log_file /var/log/ceph/ceph-mds.a.log 2023-10-03T19:21:06.644 INFO:teuthology.orchestra.run.smithi045.stdout:--- end dump of recent events --- 2023-10-03T19:21:06.644 INFO:teuthology.orchestra.run.smithi045.stdout:--- begin dump of recent events --- 2023-10-03T19:21:06.644 INFO:teuthology.orchestra.run.smithi045.stdout: -9999> 2023-10-03T19:17:19.506+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:06.644 INFO:teuthology.orchestra.run.smithi045.stdout: -9998> 2023-10-03T19:17:19.506+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:06.644 INFO:teuthology.orchestra.run.smithi045.stdout: -9997> 2023-10-03T19:17:19.506+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000050e [2,head] /dc-dir/dc-file_793 auth v5588 ap=1 s=3 n(v0 rc2023-10-03T19:17:07.968684+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355f5180] 2023-10-03T19:21:06.644 INFO:teuthology.orchestra.run.smithi045.stdout: -9996> 2023-10-03T19:17:19.506+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000050e [2,head] /dc-dir/dc-file_793 auth v5588 ap=1 s=3 n(v0 rc2023-10-03T19:17:07.968684+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355f5180] 2023-10-03T19:21:06.644 INFO:teuthology.orchestra.run.smithi045.stdout: -9995> 2023-10-03T19:17:19.506+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:06.645 INFO:teuthology.orchestra.run.smithi045.stdout: -9994> 2023-10-03T19:17:19.506+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 523.548, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.24e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1049.9] 2023-10-03T19:21:06.645 INFO:teuthology.orchestra.run.smithi045.stdout: -9993> 2023-10-03T19:17:19.506+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535299b00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5595 pv6007 ap=207 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=207) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=206) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 207 2023-10-03T19:21:06.645 INFO:teuthology.orchestra.run.smithi045.stdout: -9992> 2023-10-03T19:17:19.506+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5596 cv=5384/5384 REP dir_auth=0 ap=207+207 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535299b00 count now 207/207 2023-10-03T19:21:06.645 INFO:teuthology.orchestra.run.smithi045.stdout: -9991> 2023-10-03T19:17:19.506+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535299b00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5589 cv=5377/5377 ap=207+207 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=106 | child=1 dirty=1 authpin=1 0x565534f82400] count now 207 2023-10-03T19:21:06.645 INFO:teuthology.orchestra.run.smithi045.stdout: -9990> 2023-10-03T19:17:19.506+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535299b00 on [dir 0x1 / [2,head] auth pv=6008 v=5596 cv=5384/5384 REP dir_auth=0 ap=206+207 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 206 2023-10-03T19:21:06.645 INFO:teuthology.orchestra.run.smithi045.stdout: -9989> 2023-10-03T19:17:19.506+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000050e) auth_unpin by 0x565535299b00 on [inode 0x1000000050e [2,head] /dc-dir/dc-file_793 auth v5588 s=3 n(v0 rc2023-10-03T19:17:07.968684+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355f5180] now 0 2023-10-03T19:21:06.645 INFO:teuthology.orchestra.run.smithi045.stdout: -9988> 2023-10-03T19:17:19.506+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5589 cv=5377/5377 ap=207+206 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=106 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535299b00 count now 207/206 2023-10-03T19:21:06.646 INFO:teuthology.orchestra.run.smithi045.stdout: -9987> 2023-10-03T19:17:19.506+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.646 INFO:teuthology.orchestra.run.smithi045.stdout: -9986> 2023-10-03T19:17:19.506+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.646 INFO:teuthology.orchestra.run.smithi045.stdout: -9985> 2023-10-03T19:17:19.506+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000050f [2,head] /dc-dir/dc-file_794 auth v3922 pv5590 ap=1 s=3 n(v0 rc2023-10-03T19:17:07.980394+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:07.980394+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655355f5700] 2023-10-03T19:21:06.646 INFO:teuthology.orchestra.run.smithi045.stdout: -9984> 2023-10-03T19:17:19.506+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5597 2023-10-03T19:21:06.646 INFO:teuthology.orchestra.run.smithi045.stdout: -9983> 2023-10-03T19:17:19.506+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5597 pv6007 ap=207 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=207) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=206) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.646 INFO:teuthology.orchestra.run.smithi045.stdout: -9982> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5595 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:06.646 INFO:teuthology.orchestra.run.smithi045.stdout: -9981> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5596 cv=5384/5384 REP dir_auth=0 ap=206+207 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5596 2023-10-03T19:21:06.646 INFO:teuthology.orchestra.run.smithi045.stdout: -9980> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000050f) pop_and_dirty_projected_inode v5590 2023-10-03T19:21:06.647 INFO:teuthology.orchestra.run.smithi045.stdout: -9979> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000050f) mark_dirty [inode 0x1000000050f [2,head] /dc-dir/dc-file_794 auth v5590 ap=1 s=3 n(v0 rc2023-10-03T19:17:07.980394+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655355f5700] 2023-10-03T19:21:06.647 INFO:teuthology.orchestra.run.smithi045.stdout: -9978> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_794) mark_dirty [dentry #0x1/dc-dir/dc-file_794 [2,head] auth (dversion lock) pv=5590 v=3922 ino=0x1000000050f state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x5655355f6780] 2023-10-03T19:21:06.647 INFO:teuthology.orchestra.run.smithi045.stdout: -9977> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5589 cv=5377/5377 ap=207+206 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=107 | child=1 dirty=1 authpin=1 0x565534f82400] version 5589 2023-10-03T19:21:06.647 INFO:teuthology.orchestra.run.smithi045.stdout: -9976> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x5655353a44a0 v5598 2023-10-03T19:21:06.647 INFO:teuthology.orchestra.run.smithi045.stdout: -9975> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5598 cv=5384/5384 REP dir_auth=0 ap=206+207 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5598 2023-10-03T19:21:06.647 INFO:teuthology.orchestra.run.smithi045.stdout: -9974> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565534e53c40 v5591 2023-10-03T19:21:06.647 INFO:teuthology.orchestra.run.smithi045.stdout: -9973> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5591 cv=5377/5377 ap=207+206 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=107 | child=1 dirty=1 authpin=1 0x565534f82400] version 5591 2023-10-03T19:21:06.647 INFO:teuthology.orchestra.run.smithi045.stdout: -9972> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=206 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=206 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:06.648 INFO:teuthology.orchestra.run.smithi045.stdout: -9971> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=206) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5597 pv6007 ap=207 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=207) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=206) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.648 INFO:teuthology.orchestra.run.smithi045.stdout: -9970> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=207) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5597 pv6007 ap=207 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=207) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=205) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.648 INFO:teuthology.orchestra.run.smithi045.stdout: -9969> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000050f [2,head] /dc-dir/dc-file_794 auth v5590 ap=1 s=3 n(v0 rc2023-10-03T19:17:07.980394+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355f5700] 2023-10-03T19:21:06.648 INFO:teuthology.orchestra.run.smithi045.stdout: -9968> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000050f [2,head] /dc-dir/dc-file_794 auth v5590 ap=1 s=3 n(v0 rc2023-10-03T19:17:07.980394+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355f5700] 2023-10-03T19:21:06.648 INFO:teuthology.orchestra.run.smithi045.stdout: -9967> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:06.648 INFO:teuthology.orchestra.run.smithi045.stdout: -9966> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:06.648 INFO:teuthology.orchestra.run.smithi045.stdout: -9965> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:06.648 INFO:teuthology.orchestra.run.smithi045.stdout: -9964> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000050f [2,head] /dc-dir/dc-file_794 auth v5590 ap=1 s=3 n(v0 rc2023-10-03T19:17:07.980394+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355f5700] 2023-10-03T19:21:06.649 INFO:teuthology.orchestra.run.smithi045.stdout: -9963> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000050f [2,head] /dc-dir/dc-file_794 auth v5590 ap=1 s=3 n(v0 rc2023-10-03T19:17:07.980394+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355f5700] 2023-10-03T19:21:06.649 INFO:teuthology.orchestra.run.smithi045.stdout: -9962> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:06.649 INFO:teuthology.orchestra.run.smithi045.stdout: -9961> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 524.258, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.24e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1051.3] 2023-10-03T19:21:06.649 INFO:teuthology.orchestra.run.smithi045.stdout: -9960> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655352a7440 on [dir 0x1 / [2,head] auth pv=6008 v=5598 cv=5384/5384 REP dir_auth=0 ap=205+207 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 205 2023-10-03T19:21:06.649 INFO:teuthology.orchestra.run.smithi045.stdout: -9959> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655352a7440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5597 pv6007 ap=206 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=206) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=205) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 206 2023-10-03T19:21:06.649 INFO:teuthology.orchestra.run.smithi045.stdout: -9958> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5598 cv=5384/5384 REP dir_auth=0 ap=205+206 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655352a7440 count now 205/206 2023-10-03T19:21:06.649 INFO:teuthology.orchestra.run.smithi045.stdout: -9957> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655352a7440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5591 cv=5377/5377 ap=206+206 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=107 | child=1 dirty=1 authpin=1 0x565534f82400] count now 206 2023-10-03T19:21:06.649 INFO:teuthology.orchestra.run.smithi045.stdout: -9956> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000050f) auth_unpin by 0x5655352a7440 on [inode 0x1000000050f [2,head] /dc-dir/dc-file_794 auth v5590 s=3 n(v0 rc2023-10-03T19:17:07.980394+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355f5700] now 0 2023-10-03T19:21:06.650 INFO:teuthology.orchestra.run.smithi045.stdout: -9955> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5591 cv=5377/5377 ap=206+205 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=107 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655352a7440 count now 206/205 2023-10-03T19:21:06.650 INFO:teuthology.orchestra.run.smithi045.stdout: -9954> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.650 INFO:teuthology.orchestra.run.smithi045.stdout: -9953> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.650 INFO:teuthology.orchestra.run.smithi045.stdout: -9952> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000510 [2,head] /dc-dir/dc-file_795 auth v3926 pv5592 ap=1 s=3 n(v0 rc2023-10-03T19:17:07.992563+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:07.992563+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655355f8000] 2023-10-03T19:21:06.650 INFO:teuthology.orchestra.run.smithi045.stdout: -9951> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5599 2023-10-03T19:21:06.650 INFO:teuthology.orchestra.run.smithi045.stdout: -9950> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5599 pv6007 ap=206 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=206) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=205) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.651 INFO:teuthology.orchestra.run.smithi045.stdout: -9949> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5597 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:06.651 INFO:teuthology.orchestra.run.smithi045.stdout: -9948> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5598 cv=5384/5384 REP dir_auth=0 ap=205+206 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5598 2023-10-03T19:21:06.651 INFO:teuthology.orchestra.run.smithi045.stdout: -9947> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000510) pop_and_dirty_projected_inode v5592 2023-10-03T19:21:06.651 INFO:teuthology.orchestra.run.smithi045.stdout: -9946> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000510) mark_dirty [inode 0x10000000510 [2,head] /dc-dir/dc-file_795 auth v5592 ap=1 s=3 n(v0 rc2023-10-03T19:17:07.992563+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655355f8000] 2023-10-03T19:21:06.651 INFO:teuthology.orchestra.run.smithi045.stdout: -9945> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_795) mark_dirty [dentry #0x1/dc-dir/dc-file_795 [2,head] auth (dversion lock) pv=5592 v=3926 ino=0x10000000510 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x5655355f6a00] 2023-10-03T19:21:06.651 INFO:teuthology.orchestra.run.smithi045.stdout: -9944> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5591 cv=5377/5377 ap=206+205 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=108 | child=1 dirty=1 authpin=1 0x565534f82400] version 5591 2023-10-03T19:21:06.651 INFO:teuthology.orchestra.run.smithi045.stdout: -9943> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535417b20 v5600 2023-10-03T19:21:06.651 INFO:teuthology.orchestra.run.smithi045.stdout: -9942> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5600 cv=5384/5384 REP dir_auth=0 ap=205+206 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5600 2023-10-03T19:21:06.652 INFO:teuthology.orchestra.run.smithi045.stdout: -9941> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535417d60 v5593 2023-10-03T19:21:06.652 INFO:teuthology.orchestra.run.smithi045.stdout: -9940> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5593 cv=5377/5377 ap=206+205 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=108 | child=1 dirty=1 authpin=1 0x565534f82400] version 5593 2023-10-03T19:21:06.652 INFO:teuthology.orchestra.run.smithi045.stdout: -9939> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=205 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=205 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:06.652 INFO:teuthology.orchestra.run.smithi045.stdout: -9938> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=205) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5599 pv6007 ap=206 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=206) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=205) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.652 INFO:teuthology.orchestra.run.smithi045.stdout: -9937> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=206) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5599 pv6007 ap=206 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=206) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=204) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.652 INFO:teuthology.orchestra.run.smithi045.stdout: -9936> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000510 [2,head] /dc-dir/dc-file_795 auth v5592 ap=1 s=3 n(v0 rc2023-10-03T19:17:07.992563+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355f8000] 2023-10-03T19:21:06.652 INFO:teuthology.orchestra.run.smithi045.stdout: -9935> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000510 [2,head] /dc-dir/dc-file_795 auth v5592 ap=1 s=3 n(v0 rc2023-10-03T19:17:07.992563+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355f8000] 2023-10-03T19:21:06.652 INFO:teuthology.orchestra.run.smithi045.stdout: -9934> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:06.653 INFO:teuthology.orchestra.run.smithi045.stdout: -9933> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:06.653 INFO:teuthology.orchestra.run.smithi045.stdout: -9932> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:06.653 INFO:teuthology.orchestra.run.smithi045.stdout: -9931> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000510 [2,head] /dc-dir/dc-file_795 auth v5592 ap=1 s=3 n(v0 rc2023-10-03T19:17:07.992563+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355f8000] 2023-10-03T19:21:06.653 INFO:teuthology.orchestra.run.smithi045.stdout: -9930> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000510 [2,head] /dc-dir/dc-file_795 auth v5592 ap=1 s=3 n(v0 rc2023-10-03T19:17:07.992563+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355f8000] 2023-10-03T19:21:06.653 INFO:teuthology.orchestra.run.smithi045.stdout: -9929> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:06.653 INFO:teuthology.orchestra.run.smithi045.stdout: -9928> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 525.258, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.25e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1053.3] 2023-10-03T19:21:06.653 INFO:teuthology.orchestra.run.smithi045.stdout: -9927> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655352e8fc0 on [dir 0x1 / [2,head] auth pv=6008 v=5600 cv=5384/5384 REP dir_auth=0 ap=204+206 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 204 2023-10-03T19:21:06.653 INFO:teuthology.orchestra.run.smithi045.stdout: -9926> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655352e8fc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5599 pv6007 ap=205 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=205) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=204) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 205 2023-10-03T19:21:06.654 INFO:teuthology.orchestra.run.smithi045.stdout: -9925> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5600 cv=5384/5384 REP dir_auth=0 ap=204+205 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655352e8fc0 count now 204/205 2023-10-03T19:21:06.654 INFO:teuthology.orchestra.run.smithi045.stdout: -9924> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655352e8fc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5593 cv=5377/5377 ap=205+205 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=108 | child=1 dirty=1 authpin=1 0x565534f82400] count now 205 2023-10-03T19:21:06.654 INFO:teuthology.orchestra.run.smithi045.stdout: -9923> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000510) auth_unpin by 0x5655352e8fc0 on [inode 0x10000000510 [2,head] /dc-dir/dc-file_795 auth v5592 s=3 n(v0 rc2023-10-03T19:17:07.992563+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355f8000] now 0 2023-10-03T19:21:06.654 INFO:teuthology.orchestra.run.smithi045.stdout: -9922> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5593 cv=5377/5377 ap=205+204 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=108 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655352e8fc0 count now 205/204 2023-10-03T19:21:06.654 INFO:teuthology.orchestra.run.smithi045.stdout: -9921> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.654 INFO:teuthology.orchestra.run.smithi045.stdout: -9920> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.654 INFO:teuthology.orchestra.run.smithi045.stdout: -9919> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000511 [2,head] /dc-dir/dc-file_796 auth v3930 pv5594 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.005519+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.005519+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655355f8580] 2023-10-03T19:21:06.654 INFO:teuthology.orchestra.run.smithi045.stdout: -9918> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5601 2023-10-03T19:21:06.655 INFO:teuthology.orchestra.run.smithi045.stdout: -9917> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5601 pv6007 ap=205 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=205) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=204) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.655 INFO:teuthology.orchestra.run.smithi045.stdout: -9916> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5599 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:06.655 INFO:teuthology.orchestra.run.smithi045.stdout: -9915> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5600 cv=5384/5384 REP dir_auth=0 ap=204+205 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5600 2023-10-03T19:21:06.655 INFO:teuthology.orchestra.run.smithi045.stdout: -9914> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000511) pop_and_dirty_projected_inode v5594 2023-10-03T19:21:06.655 INFO:teuthology.orchestra.run.smithi045.stdout: -9913> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000511) mark_dirty [inode 0x10000000511 [2,head] /dc-dir/dc-file_796 auth v5594 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.005519+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655355f8580] 2023-10-03T19:21:06.655 INFO:teuthology.orchestra.run.smithi045.stdout: -9912> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_796) mark_dirty [dentry #0x1/dc-dir/dc-file_796 [2,head] auth (dversion lock) pv=5594 v=3930 ino=0x10000000511 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x5655355f6c80] 2023-10-03T19:21:06.655 INFO:teuthology.orchestra.run.smithi045.stdout: -9911> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5593 cv=5377/5377 ap=205+204 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=109 | child=1 dirty=1 authpin=1 0x565534f82400] version 5593 2023-10-03T19:21:06.655 INFO:teuthology.orchestra.run.smithi045.stdout: -9910> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535417220 v5602 2023-10-03T19:21:06.655 INFO:teuthology.orchestra.run.smithi045.stdout: -9909> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5602 cv=5384/5384 REP dir_auth=0 ap=204+205 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5602 2023-10-03T19:21:06.656 INFO:teuthology.orchestra.run.smithi045.stdout: -9908> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535417460 v5595 2023-10-03T19:21:06.656 INFO:teuthology.orchestra.run.smithi045.stdout: -9907> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5595 cv=5377/5377 ap=205+204 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=109 | child=1 dirty=1 authpin=1 0x565534f82400] version 5595 2023-10-03T19:21:06.656 INFO:teuthology.orchestra.run.smithi045.stdout: -9906> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=204 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=204 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:06.656 INFO:teuthology.orchestra.run.smithi045.stdout: -9905> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=204) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5601 pv6007 ap=205 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=205) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=204) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.656 INFO:teuthology.orchestra.run.smithi045.stdout: -9904> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=205) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5601 pv6007 ap=205 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=205) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=203) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.656 INFO:teuthology.orchestra.run.smithi045.stdout: -9903> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000511 [2,head] /dc-dir/dc-file_796 auth v5594 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.005519+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355f8580] 2023-10-03T19:21:06.656 INFO:teuthology.orchestra.run.smithi045.stdout: -9902> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000511 [2,head] /dc-dir/dc-file_796 auth v5594 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.005519+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355f8580] 2023-10-03T19:21:06.656 INFO:teuthology.orchestra.run.smithi045.stdout: -9901> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:06.657 INFO:teuthology.orchestra.run.smithi045.stdout: -9900> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:06.657 INFO:teuthology.orchestra.run.smithi045.stdout: -9899> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:06.657 INFO:teuthology.orchestra.run.smithi045.stdout: -9898> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000511 [2,head] /dc-dir/dc-file_796 auth v5594 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.005519+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355f8580] 2023-10-03T19:21:06.657 INFO:teuthology.orchestra.run.smithi045.stdout: -9897> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000511 [2,head] /dc-dir/dc-file_796 auth v5594 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.005519+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355f8580] 2023-10-03T19:21:06.657 INFO:teuthology.orchestra.run.smithi045.stdout: -9896> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:06.657 INFO:teuthology.orchestra.run.smithi045.stdout: -9895> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 526.258, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.26e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1055.3] 2023-10-03T19:21:06.657 INFO:teuthology.orchestra.run.smithi045.stdout: -9894> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655352acfc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5601 pv6007 ap=204 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=204) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=203) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 204 2023-10-03T19:21:06.657 INFO:teuthology.orchestra.run.smithi045.stdout: -9893> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5602 cv=5384/5384 REP dir_auth=0 ap=204+204 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655352acfc0 count now 204/204 2023-10-03T19:21:06.658 INFO:teuthology.orchestra.run.smithi045.stdout: -9892> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655352acfc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5595 cv=5377/5377 ap=204+204 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=109 | child=1 dirty=1 authpin=1 0x565534f82400] count now 204 2023-10-03T19:21:06.658 INFO:teuthology.orchestra.run.smithi045.stdout: -9891> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655352acfc0 on [dir 0x1 / [2,head] auth pv=6008 v=5602 cv=5384/5384 REP dir_auth=0 ap=203+204 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 203 2023-10-03T19:21:06.658 INFO:teuthology.orchestra.run.smithi045.stdout: -9890> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000511) auth_unpin by 0x5655352acfc0 on [inode 0x10000000511 [2,head] /dc-dir/dc-file_796 auth v5594 s=3 n(v0 rc2023-10-03T19:17:08.005519+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355f8580] now 0 2023-10-03T19:21:06.658 INFO:teuthology.orchestra.run.smithi045.stdout: -9889> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5595 cv=5377/5377 ap=204+203 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=109 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655352acfc0 count now 204/203 2023-10-03T19:21:06.658 INFO:teuthology.orchestra.run.smithi045.stdout: -9888> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.658 INFO:teuthology.orchestra.run.smithi045.stdout: -9887> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.658 INFO:teuthology.orchestra.run.smithi045.stdout: -9886> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000512 [2,head] /dc-dir/dc-file_797 auth v3934 pv5596 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.019036+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.019036+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655355f8b00] 2023-10-03T19:21:06.658 INFO:teuthology.orchestra.run.smithi045.stdout: -9885> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5603 2023-10-03T19:21:06.660 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:21:06.678 INFO:teuthology.orchestra.run.smithi045.stdout: -9884> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5603 pv6007 ap=204 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=204) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=203) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.678 INFO:teuthology.orchestra.run.smithi045.stdout: -9883> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5601 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:06.678 INFO:teuthology.orchestra.run.smithi045.stdout: -9882> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5602 cv=5384/5384 REP dir_auth=0 ap=203+204 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5602 2023-10-03T19:21:06.678 INFO:teuthology.orchestra.run.smithi045.stdout: -9881> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000512) pop_and_dirty_projected_inode v5596 2023-10-03T19:21:06.679 INFO:teuthology.orchestra.run.smithi045.stdout: -9880> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000512) mark_dirty [inode 0x10000000512 [2,head] /dc-dir/dc-file_797 auth v5596 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.019036+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655355f8b00] 2023-10-03T19:21:06.679 INFO:teuthology.orchestra.run.smithi045.stdout: -9879> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_797) mark_dirty [dentry #0x1/dc-dir/dc-file_797 [2,head] auth (dversion lock) pv=5596 v=3934 ino=0x10000000512 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x5655355f6f00] 2023-10-03T19:21:06.679 INFO:teuthology.orchestra.run.smithi045.stdout: -9878> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5595 cv=5377/5377 ap=204+203 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=110 | child=1 dirty=1 authpin=1 0x565534f82400] version 5595 2023-10-03T19:21:06.679 INFO:teuthology.orchestra.run.smithi045.stdout: -9877> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535425340 v5604 2023-10-03T19:21:06.679 INFO:teuthology.orchestra.run.smithi045.stdout: -9876> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5604 cv=5384/5384 REP dir_auth=0 ap=203+204 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5604 2023-10-03T19:21:06.679 INFO:teuthology.orchestra.run.smithi045.stdout: -9875> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535416fe0 v5597 2023-10-03T19:21:06.679 INFO:teuthology.orchestra.run.smithi045.stdout: -9874> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5597 cv=5377/5377 ap=204+203 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=110 | child=1 dirty=1 authpin=1 0x565534f82400] version 5597 2023-10-03T19:21:06.679 INFO:teuthology.orchestra.run.smithi045.stdout: -9873> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=203 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=203 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:06.680 INFO:teuthology.orchestra.run.smithi045.stdout: -9872> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=203) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5603 pv6007 ap=204 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=204) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=203) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.680 INFO:teuthology.orchestra.run.smithi045.stdout: -9871> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=204) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5603 pv6007 ap=204 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=204) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=202) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.680 INFO:teuthology.orchestra.run.smithi045.stdout: -9870> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000512 [2,head] /dc-dir/dc-file_797 auth v5596 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.019036+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355f8b00] 2023-10-03T19:21:06.680 INFO:teuthology.orchestra.run.smithi045.stdout: -9869> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000512 [2,head] /dc-dir/dc-file_797 auth v5596 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.019036+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355f8b00] 2023-10-03T19:21:06.680 INFO:teuthology.orchestra.run.smithi045.stdout: -9868> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:06.680 INFO:teuthology.orchestra.run.smithi045.stdout: -9867> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:06.680 INFO:teuthology.orchestra.run.smithi045.stdout: -9866> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:06.680 INFO:teuthology.orchestra.run.smithi045.stdout: -9865> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000512 [2,head] /dc-dir/dc-file_797 auth v5596 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.019036+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355f8b00] 2023-10-03T19:21:06.680 INFO:teuthology.orchestra.run.smithi045.stdout: -9864> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000512 [2,head] /dc-dir/dc-file_797 auth v5596 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.019036+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355f8b00] 2023-10-03T19:21:06.681 INFO:teuthology.orchestra.run.smithi045.stdout: -9863> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:06.681 INFO:teuthology.orchestra.run.smithi045.stdout: -9862> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 527.258, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.27e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1057.3] 2023-10-03T19:21:06.681 INFO:teuthology.orchestra.run.smithi045.stdout: -9861> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535298b40 on [dir 0x1 / [2,head] auth pv=6008 v=5604 cv=5384/5384 REP dir_auth=0 ap=202+204 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 202 2023-10-03T19:21:06.681 INFO:teuthology.orchestra.run.smithi045.stdout: -9860> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535298b40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5603 pv6007 ap=203 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=203) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=202) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 203 2023-10-03T19:21:06.681 INFO:teuthology.orchestra.run.smithi045.stdout: -9859> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5604 cv=5384/5384 REP dir_auth=0 ap=202+203 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535298b40 count now 202/203 2023-10-03T19:21:06.681 INFO:teuthology.orchestra.run.smithi045.stdout: -9858> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535298b40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5597 cv=5377/5377 ap=203+203 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=110 | child=1 dirty=1 authpin=1 0x565534f82400] count now 203 2023-10-03T19:21:06.681 INFO:teuthology.orchestra.run.smithi045.stdout: -9857> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000512) auth_unpin by 0x565535298b40 on [inode 0x10000000512 [2,head] /dc-dir/dc-file_797 auth v5596 s=3 n(v0 rc2023-10-03T19:17:08.019036+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355f8b00] now 0 2023-10-03T19:21:06.682 INFO:teuthology.orchestra.run.smithi045.stdout: -9856> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5597 cv=5377/5377 ap=203+202 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=110 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535298b40 count now 203/202 2023-10-03T19:21:06.682 INFO:teuthology.orchestra.run.smithi045.stdout: -9855> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.682 INFO:teuthology.orchestra.run.smithi045.stdout: -9854> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.682 INFO:teuthology.orchestra.run.smithi045.stdout: -9853> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000513 [2,head] /dc-dir/dc-file_798 auth v3938 pv5598 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.030555+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.030555+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655355f9080] 2023-10-03T19:21:06.682 INFO:teuthology.orchestra.run.smithi045.stdout: -9852> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5605 2023-10-03T19:21:06.682 INFO:teuthology.orchestra.run.smithi045.stdout: -9851> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5605 pv6007 ap=203 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=203) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=202) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.682 INFO:teuthology.orchestra.run.smithi045.stdout: -9850> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5603 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:06.682 INFO:teuthology.orchestra.run.smithi045.stdout: -9849> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5604 cv=5384/5384 REP dir_auth=0 ap=202+203 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5604 2023-10-03T19:21:06.683 INFO:teuthology.orchestra.run.smithi045.stdout: -9848> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000513) pop_and_dirty_projected_inode v5598 2023-10-03T19:21:06.683 INFO:teuthology.orchestra.run.smithi045.stdout: -9847> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000513) mark_dirty [inode 0x10000000513 [2,head] /dc-dir/dc-file_798 auth v5598 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.030555+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655355f9080] 2023-10-03T19:21:06.683 INFO:teuthology.orchestra.run.smithi045.stdout: -9846> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_798) mark_dirty [dentry #0x1/dc-dir/dc-file_798 [2,head] auth (dversion lock) pv=5598 v=3938 ino=0x10000000513 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x5655355f7180] 2023-10-03T19:21:06.683 INFO:teuthology.orchestra.run.smithi045.stdout: -9845> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5597 cv=5377/5377 ap=203+202 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=111 | child=1 dirty=1 authpin=1 0x565534f82400] version 5597 2023-10-03T19:21:06.683 INFO:teuthology.orchestra.run.smithi045.stdout: -9844> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535424800 v5606 2023-10-03T19:21:06.683 INFO:teuthology.orchestra.run.smithi045.stdout: -9843> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5606 cv=5384/5384 REP dir_auth=0 ap=202+203 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5606 2023-10-03T19:21:06.683 INFO:teuthology.orchestra.run.smithi045.stdout: -9842> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535424020 v5599 2023-10-03T19:21:06.683 INFO:teuthology.orchestra.run.smithi045.stdout: -9841> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5599 cv=5377/5377 ap=203+202 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=111 | child=1 dirty=1 authpin=1 0x565534f82400] version 5599 2023-10-03T19:21:06.683 INFO:teuthology.orchestra.run.smithi045.stdout: -9840> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=202 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=202 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:06.684 INFO:teuthology.orchestra.run.smithi045.stdout: -9839> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=202) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5605 pv6007 ap=203 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=203) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=202) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.684 INFO:teuthology.orchestra.run.smithi045.stdout: -9838> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=203) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5605 pv6007 ap=203 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=203) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=201) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.684 INFO:teuthology.orchestra.run.smithi045.stdout: -9837> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000513 [2,head] /dc-dir/dc-file_798 auth v5598 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.030555+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355f9080] 2023-10-03T19:21:06.684 INFO:teuthology.orchestra.run.smithi045.stdout: -9836> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000513 [2,head] /dc-dir/dc-file_798 auth v5598 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.030555+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355f9080] 2023-10-03T19:21:06.684 INFO:teuthology.orchestra.run.smithi045.stdout: -9835> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:06.684 INFO:teuthology.orchestra.run.smithi045.stdout: -9834> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:06.684 INFO:teuthology.orchestra.run.smithi045.stdout: -9833> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:06.685 INFO:teuthology.orchestra.run.smithi045.stdout: -9832> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000513 [2,head] /dc-dir/dc-file_798 auth v5598 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.030555+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355f9080] 2023-10-03T19:21:06.685 INFO:teuthology.orchestra.run.smithi045.stdout: -9831> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000513 [2,head] /dc-dir/dc-file_798 auth v5598 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.030555+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355f9080] 2023-10-03T19:21:06.685 INFO:teuthology.orchestra.run.smithi045.stdout: -9830> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:06.685 INFO:teuthology.orchestra.run.smithi045.stdout: -9829> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 528.258, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.28e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1059.3] 2023-10-03T19:21:06.685 INFO:teuthology.orchestra.run.smithi045.stdout: -9828> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565534fd6480 on [dir 0x1 / [2,head] auth pv=6008 v=5606 cv=5384/5384 REP dir_auth=0 ap=201+203 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 201 2023-10-03T19:21:06.685 INFO:teuthology.orchestra.run.smithi045.stdout: -9827> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565534fd6480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5605 pv6007 ap=202 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=202) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=201) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 202 2023-10-03T19:21:06.685 INFO:teuthology.orchestra.run.smithi045.stdout: -9826> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5606 cv=5384/5384 REP dir_auth=0 ap=201+202 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565534fd6480 count now 201/202 2023-10-03T19:21:06.685 INFO:teuthology.orchestra.run.smithi045.stdout: -9825> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565534fd6480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5599 cv=5377/5377 ap=202+202 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=111 | child=1 dirty=1 authpin=1 0x565534f82400] count now 202 2023-10-03T19:21:06.685 INFO:teuthology.orchestra.run.smithi045.stdout: -9824> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000513) auth_unpin by 0x565534fd6480 on [inode 0x10000000513 [2,head] /dc-dir/dc-file_798 auth v5598 s=3 n(v0 rc2023-10-03T19:17:08.030555+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355f9080] now 0 2023-10-03T19:21:06.685 INFO:teuthology.orchestra.run.smithi045.stdout: -9823> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5599 cv=5377/5377 ap=202+201 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=111 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565534fd6480 count now 202/201 2023-10-03T19:21:06.686 INFO:teuthology.orchestra.run.smithi045.stdout: -9822> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.686 INFO:teuthology.orchestra.run.smithi045.stdout: -9821> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.686 INFO:teuthology.orchestra.run.smithi045.stdout: -9820> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000514 [2,head] /dc-dir/dc-file_799 auth v3942 pv5600 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.042012+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.042012+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655355f9600] 2023-10-03T19:21:06.686 INFO:teuthology.orchestra.run.smithi045.stdout: -9819> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5607 2023-10-03T19:21:06.686 INFO:teuthology.orchestra.run.smithi045.stdout: -9818> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5607 pv6007 ap=202 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=202) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=201) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.686 INFO:teuthology.orchestra.run.smithi045.stdout: -9817> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5605 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:06.687 INFO:teuthology.orchestra.run.smithi045.stdout: -9816> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5606 cv=5384/5384 REP dir_auth=0 ap=201+202 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5606 2023-10-03T19:21:06.687 INFO:teuthology.orchestra.run.smithi045.stdout: -9815> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000514) pop_and_dirty_projected_inode v5600 2023-10-03T19:21:06.687 INFO:teuthology.orchestra.run.smithi045.stdout: -9814> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000514) mark_dirty [inode 0x10000000514 [2,head] /dc-dir/dc-file_799 auth v5600 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.042012+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655355f9600] 2023-10-03T19:21:06.687 INFO:teuthology.orchestra.run.smithi045.stdout: -9813> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_799) mark_dirty [dentry #0x1/dc-dir/dc-file_799 [2,head] auth (dversion lock) pv=5600 v=3942 ino=0x10000000514 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x5655355f7400] 2023-10-03T19:21:06.687 INFO:teuthology.orchestra.run.smithi045.stdout: -9812> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5599 cv=5377/5377 ap=202+201 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=112 | child=1 dirty=1 authpin=1 0x565534f82400] version 5599 2023-10-03T19:21:06.687 INFO:teuthology.orchestra.run.smithi045.stdout: -9811> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535425100 v5608 2023-10-03T19:21:06.687 INFO:teuthology.orchestra.run.smithi045.stdout: -9810> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5608 cv=5384/5384 REP dir_auth=0 ap=201+202 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5608 2023-10-03T19:21:06.687 INFO:teuthology.orchestra.run.smithi045.stdout: -9809> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535424a40 v5601 2023-10-03T19:21:06.688 INFO:teuthology.orchestra.run.smithi045.stdout: -9808> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5601 cv=5377/5377 ap=202+201 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=112 | child=1 dirty=1 authpin=1 0x565534f82400] version 5601 2023-10-03T19:21:06.688 INFO:teuthology.orchestra.run.smithi045.stdout: -9807> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=201 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=201 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:06.688 INFO:teuthology.orchestra.run.smithi045.stdout: -9806> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=201) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5607 pv6007 ap=202 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=202) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=201) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.688 INFO:teuthology.orchestra.run.smithi045.stdout: -9805> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=202) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5607 pv6007 ap=202 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=202) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=200) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.688 INFO:teuthology.orchestra.run.smithi045.stdout: -9804> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000514 [2,head] /dc-dir/dc-file_799 auth v5600 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.042012+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355f9600] 2023-10-03T19:21:06.688 INFO:teuthology.orchestra.run.smithi045.stdout: -9803> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000514 [2,head] /dc-dir/dc-file_799 auth v5600 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.042012+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355f9600] 2023-10-03T19:21:06.688 INFO:teuthology.orchestra.run.smithi045.stdout: -9802> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:06.688 INFO:teuthology.orchestra.run.smithi045.stdout: -9801> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:06.688 INFO:teuthology.orchestra.run.smithi045.stdout: -9800> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:06.689 INFO:teuthology.orchestra.run.smithi045.stdout: -9799> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000514 [2,head] /dc-dir/dc-file_799 auth v5600 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.042012+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355f9600] 2023-10-03T19:21:06.689 INFO:teuthology.orchestra.run.smithi045.stdout: -9798> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000514 [2,head] /dc-dir/dc-file_799 auth v5600 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.042012+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355f9600] 2023-10-03T19:21:06.689 INFO:teuthology.orchestra.run.smithi045.stdout: -9797> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:06.689 INFO:teuthology.orchestra.run.smithi045.stdout: -9796> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 529.258, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.29e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1061.3] 2023-10-03T19:21:06.689 INFO:teuthology.orchestra.run.smithi045.stdout: -9795> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655352e9b00 on [dir 0x1 / [2,head] auth pv=6008 v=5608 cv=5384/5384 REP dir_auth=0 ap=200+202 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 200 2023-10-03T19:21:06.689 INFO:teuthology.orchestra.run.smithi045.stdout: -9794> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655352e9b00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5601 cv=5377/5377 ap=201+201 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=112 | child=1 dirty=1 authpin=1 0x565534f82400] count now 201 2023-10-03T19:21:06.689 INFO:teuthology.orchestra.run.smithi045.stdout: -9793> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655352e9b00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5607 pv6007 ap=201 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=201) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=200) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 201 2023-10-03T19:21:06.690 INFO:teuthology.orchestra.run.smithi045.stdout: -9792> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5608 cv=5384/5384 REP dir_auth=0 ap=200+201 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655352e9b00 count now 200/201 2023-10-03T19:21:06.690 INFO:teuthology.orchestra.run.smithi045.stdout: -9791> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000514) auth_unpin by 0x5655352e9b00 on [inode 0x10000000514 [2,head] /dc-dir/dc-file_799 auth v5600 s=3 n(v0 rc2023-10-03T19:17:08.042012+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355f9600] now 0 2023-10-03T19:21:06.690 INFO:teuthology.orchestra.run.smithi045.stdout: -9790> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5601 cv=5377/5377 ap=201+200 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=112 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655352e9b00 count now 201/200 2023-10-03T19:21:06.690 INFO:teuthology.orchestra.run.smithi045.stdout: -9789> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.690 INFO:teuthology.orchestra.run.smithi045.stdout: -9788> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.690 INFO:teuthology.orchestra.run.smithi045.stdout: -9787> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000515 [2,head] /dc-dir/dc-file_800 auth v3946 pv5602 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.053240+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.053240+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655355f9b80] 2023-10-03T19:21:06.690 INFO:teuthology.orchestra.run.smithi045.stdout: -9786> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5609 2023-10-03T19:21:06.690 INFO:teuthology.orchestra.run.smithi045.stdout: -9785> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5609 pv6007 ap=201 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=201) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=200) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.690 INFO:teuthology.orchestra.run.smithi045.stdout: -9784> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5607 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:06.691 INFO:teuthology.orchestra.run.smithi045.stdout: -9783> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5608 cv=5384/5384 REP dir_auth=0 ap=200+201 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5608 2023-10-03T19:21:06.691 INFO:teuthology.orchestra.run.smithi045.stdout: -9782> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000515) pop_and_dirty_projected_inode v5602 2023-10-03T19:21:06.691 INFO:teuthology.orchestra.run.smithi045.stdout: -9781> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000515) mark_dirty [inode 0x10000000515 [2,head] /dc-dir/dc-file_800 auth v5602 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.053240+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655355f9b80] 2023-10-03T19:21:06.691 INFO:teuthology.orchestra.run.smithi045.stdout: -9780> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_800) mark_dirty [dentry #0x1/dc-dir/dc-file_800 [2,head] auth (dversion lock) pv=5602 v=3946 ino=0x10000000515 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x5655355f7680] 2023-10-03T19:21:06.691 INFO:teuthology.orchestra.run.smithi045.stdout: -9779> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5601 cv=5377/5377 ap=201+200 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=113 | child=1 dirty=1 authpin=1 0x565534f82400] version 5601 2023-10-03T19:21:06.691 INFO:teuthology.orchestra.run.smithi045.stdout: -9778> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535424c80 v5610 2023-10-03T19:21:06.691 INFO:teuthology.orchestra.run.smithi045.stdout: -9777> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5610 cv=5384/5384 REP dir_auth=0 ap=200+201 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5610 2023-10-03T19:21:06.691 INFO:teuthology.orchestra.run.smithi045.stdout: -9776> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535424ec0 v5603 2023-10-03T19:21:06.691 INFO:teuthology.orchestra.run.smithi045.stdout: -9775> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5603 cv=5377/5377 ap=201+200 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=113 | child=1 dirty=1 authpin=1 0x565534f82400] version 5603 2023-10-03T19:21:06.691 INFO:teuthology.orchestra.run.smithi045.stdout: -9774> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=200 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=200 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:06.692 INFO:teuthology.orchestra.run.smithi045.stdout: -9773> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=200) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5609 pv6007 ap=201 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=201) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=200) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.692 INFO:teuthology.orchestra.run.smithi045.stdout: -9772> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=201) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5609 pv6007 ap=201 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=201) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=199) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.692 INFO:teuthology.orchestra.run.smithi045.stdout: -9771> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000515 [2,head] /dc-dir/dc-file_800 auth v5602 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.053240+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355f9b80] 2023-10-03T19:21:06.692 INFO:teuthology.orchestra.run.smithi045.stdout: -9770> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000515 [2,head] /dc-dir/dc-file_800 auth v5602 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.053240+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355f9b80] 2023-10-03T19:21:06.692 INFO:teuthology.orchestra.run.smithi045.stdout: -9769> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:06.692 INFO:teuthology.orchestra.run.smithi045.stdout: -9768> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:06.692 INFO:teuthology.orchestra.run.smithi045.stdout: -9767> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:06.692 INFO:teuthology.orchestra.run.smithi045.stdout: -9766> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000515 [2,head] /dc-dir/dc-file_800 auth v5602 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.053240+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355f9b80] 2023-10-03T19:21:06.693 INFO:teuthology.orchestra.run.smithi045.stdout: -9765> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000515 [2,head] /dc-dir/dc-file_800 auth v5602 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.053240+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355f9b80] 2023-10-03T19:21:06.693 INFO:teuthology.orchestra.run.smithi045.stdout: -9764> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:06.693 INFO:teuthology.orchestra.run.smithi045.stdout: -9763> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 530.258, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.30e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1063.3] 2023-10-03T19:21:06.693 INFO:teuthology.orchestra.run.smithi045.stdout: -9762> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535299200 on [dir 0x1 / [2,head] auth pv=6008 v=5610 cv=5384/5384 REP dir_auth=0 ap=199+201 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 199 2023-10-03T19:21:06.693 INFO:teuthology.orchestra.run.smithi045.stdout: -9761> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535299200 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5609 pv6007 ap=200 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=200) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=199) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 200 2023-10-03T19:21:06.693 INFO:teuthology.orchestra.run.smithi045.stdout: -9760> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5610 cv=5384/5384 REP dir_auth=0 ap=199+200 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535299200 count now 199/200 2023-10-03T19:21:06.693 INFO:teuthology.orchestra.run.smithi045.stdout: -9759> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535299200 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5603 cv=5377/5377 ap=200+200 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=113 | child=1 dirty=1 authpin=1 0x565534f82400] count now 200 2023-10-03T19:21:06.693 INFO:teuthology.orchestra.run.smithi045.stdout: -9758> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000515) auth_unpin by 0x565535299200 on [inode 0x10000000515 [2,head] /dc-dir/dc-file_800 auth v5602 s=3 n(v0 rc2023-10-03T19:17:08.053240+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355f9b80] now 0 2023-10-03T19:21:06.693 INFO:teuthology.orchestra.run.smithi045.stdout: -9757> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5603 cv=5377/5377 ap=200+199 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=113 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535299200 count now 200/199 2023-10-03T19:21:06.694 INFO:teuthology.orchestra.run.smithi045.stdout: -9756> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.694 INFO:teuthology.orchestra.run.smithi045.stdout: -9755> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.694 INFO:teuthology.orchestra.run.smithi045.stdout: -9754> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000516 [2,head] /dc-dir/dc-file_801 auth v3950 pv5604 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.064696+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.064696+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655355fa100] 2023-10-03T19:21:06.694 INFO:teuthology.orchestra.run.smithi045.stdout: -9753> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5611 2023-10-03T19:21:06.694 INFO:teuthology.orchestra.run.smithi045.stdout: -9752> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5611 pv6007 ap=200 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=200) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=199) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.694 INFO:teuthology.orchestra.run.smithi045.stdout: -9751> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5609 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:06.694 INFO:teuthology.orchestra.run.smithi045.stdout: -9750> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5610 cv=5384/5384 REP dir_auth=0 ap=199+200 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5610 2023-10-03T19:21:06.694 INFO:teuthology.orchestra.run.smithi045.stdout: -9749> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000516) pop_and_dirty_projected_inode v5604 2023-10-03T19:21:06.695 INFO:teuthology.orchestra.run.smithi045.stdout: -9748> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000516) mark_dirty [inode 0x10000000516 [2,head] /dc-dir/dc-file_801 auth v5604 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.064696+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655355fa100] 2023-10-03T19:21:06.695 INFO:teuthology.orchestra.run.smithi045.stdout: -9747> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_801) mark_dirty [dentry #0x1/dc-dir/dc-file_801 [2,head] auth (dversion lock) pv=5604 v=3950 ino=0x10000000516 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x5655355f7900] 2023-10-03T19:21:06.695 INFO:teuthology.orchestra.run.smithi045.stdout: -9746> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5603 cv=5377/5377 ap=200+199 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=114 | child=1 dirty=1 authpin=1 0x565534f82400] version 5603 2023-10-03T19:21:06.695 INFO:teuthology.orchestra.run.smithi045.stdout: -9745> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535468140 v5612 2023-10-03T19:21:06.695 INFO:teuthology.orchestra.run.smithi045.stdout: -9744> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5612 cv=5384/5384 REP dir_auth=0 ap=199+200 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5612 2023-10-03T19:21:06.695 INFO:teuthology.orchestra.run.smithi045.stdout: -9743> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535468020 v5605 2023-10-03T19:21:06.695 INFO:teuthology.orchestra.run.smithi045.stdout: -9742> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5605 cv=5377/5377 ap=200+199 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=114 | child=1 dirty=1 authpin=1 0x565534f82400] version 5605 2023-10-03T19:21:06.695 INFO:teuthology.orchestra.run.smithi045.stdout: -9741> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=199 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=199 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:06.695 INFO:teuthology.orchestra.run.smithi045.stdout: -9740> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=199) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5611 pv6007 ap=200 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=200) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=199) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.696 INFO:teuthology.orchestra.run.smithi045.stdout: -9739> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=200) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5611 pv6007 ap=200 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=200) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=198) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.696 INFO:teuthology.orchestra.run.smithi045.stdout: -9738> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000516 [2,head] /dc-dir/dc-file_801 auth v5604 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.064696+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355fa100] 2023-10-03T19:21:06.696 INFO:teuthology.orchestra.run.smithi045.stdout: -9737> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000516 [2,head] /dc-dir/dc-file_801 auth v5604 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.064696+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355fa100] 2023-10-03T19:21:06.696 INFO:teuthology.orchestra.run.smithi045.stdout: -9736> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:06.696 INFO:teuthology.orchestra.run.smithi045.stdout: -9735> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:06.696 INFO:teuthology.orchestra.run.smithi045.stdout: -9734> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:06.696 INFO:teuthology.orchestra.run.smithi045.stdout: -9733> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000516 [2,head] /dc-dir/dc-file_801 auth v5604 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.064696+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355fa100] 2023-10-03T19:21:06.696 INFO:teuthology.orchestra.run.smithi045.stdout: -9732> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000516 [2,head] /dc-dir/dc-file_801 auth v5604 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.064696+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355fa100] 2023-10-03T19:21:06.696 INFO:teuthology.orchestra.run.smithi045.stdout: -9731> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:06.697 INFO:teuthology.orchestra.run.smithi045.stdout: -9730> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 531.258, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.31e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1065.3] 2023-10-03T19:21:06.697 INFO:teuthology.orchestra.run.smithi045.stdout: -9729> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565534fd6900 on [dir 0x1 / [2,head] auth pv=6008 v=5612 cv=5384/5384 REP dir_auth=0 ap=198+200 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 198 2023-10-03T19:21:06.697 INFO:teuthology.orchestra.run.smithi045.stdout: -9728> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565534fd6900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5611 pv6007 ap=199 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=199) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=198) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 199 2023-10-03T19:21:06.697 INFO:teuthology.orchestra.run.smithi045.stdout: -9727> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5612 cv=5384/5384 REP dir_auth=0 ap=198+199 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565534fd6900 count now 198/199 2023-10-03T19:21:06.697 INFO:teuthology.orchestra.run.smithi045.stdout: -9726> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565534fd6900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5605 cv=5377/5377 ap=199+199 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=114 | child=1 dirty=1 authpin=1 0x565534f82400] count now 199 2023-10-03T19:21:06.697 INFO:teuthology.orchestra.run.smithi045.stdout: -9725> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000516) auth_unpin by 0x565534fd6900 on [inode 0x10000000516 [2,head] /dc-dir/dc-file_801 auth v5604 s=3 n(v0 rc2023-10-03T19:17:08.064696+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355fa100] now 0 2023-10-03T19:21:06.697 INFO:teuthology.orchestra.run.smithi045.stdout: -9724> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5605 cv=5377/5377 ap=199+198 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=114 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565534fd6900 count now 199/198 2023-10-03T19:21:06.697 INFO:teuthology.orchestra.run.smithi045.stdout: -9723> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.698 INFO:teuthology.orchestra.run.smithi045.stdout: -9722> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.698 INFO:teuthology.orchestra.run.smithi045.stdout: -9721> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000517 [2,head] /dc-dir/dc-file_802 auth v3954 pv5606 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.076101+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.076101+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655355fa680] 2023-10-03T19:21:06.698 INFO:teuthology.orchestra.run.smithi045.stdout: -9720> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5613 2023-10-03T19:21:06.698 INFO:teuthology.orchestra.run.smithi045.stdout: -9719> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5613 pv6007 ap=199 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=199) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=198) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.698 INFO:teuthology.orchestra.run.smithi045.stdout: -9718> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5611 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:06.698 INFO:teuthology.orchestra.run.smithi045.stdout: -9717> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5612 cv=5384/5384 REP dir_auth=0 ap=198+199 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5612 2023-10-03T19:21:06.698 INFO:teuthology.orchestra.run.smithi045.stdout: -9716> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000517) pop_and_dirty_projected_inode v5606 2023-10-03T19:21:06.698 INFO:teuthology.orchestra.run.smithi045.stdout: -9715> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000517) mark_dirty [inode 0x10000000517 [2,head] /dc-dir/dc-file_802 auth v5606 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.076101+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655355fa680] 2023-10-03T19:21:06.698 INFO:teuthology.orchestra.run.smithi045.stdout: -9714> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_802) mark_dirty [dentry #0x1/dc-dir/dc-file_802 [2,head] auth (dversion lock) pv=5606 v=3954 ino=0x10000000517 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x5655355f7b80] 2023-10-03T19:21:06.698 INFO:teuthology.orchestra.run.smithi045.stdout: -9713> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5605 cv=5377/5377 ap=199+198 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=115 | child=1 dirty=1 authpin=1 0x565534f82400] version 5605 2023-10-03T19:21:06.699 INFO:teuthology.orchestra.run.smithi045.stdout: -9712> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535468380 v5614 2023-10-03T19:21:06.699 INFO:teuthology.orchestra.run.smithi045.stdout: -9711> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5614 cv=5384/5384 REP dir_auth=0 ap=198+199 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5614 2023-10-03T19:21:06.699 INFO:teuthology.orchestra.run.smithi045.stdout: -9710> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535468260 v5607 2023-10-03T19:21:06.699 INFO:teuthology.orchestra.run.smithi045.stdout: -9709> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5607 cv=5377/5377 ap=199+198 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=115 | child=1 dirty=1 authpin=1 0x565534f82400] version 5607 2023-10-03T19:21:06.699 INFO:teuthology.orchestra.run.smithi045.stdout: -9708> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=198 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=198 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:06.699 INFO:teuthology.orchestra.run.smithi045.stdout: -9707> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=198) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5613 pv6007 ap=199 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=199) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=198) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.699 INFO:teuthology.orchestra.run.smithi045.stdout: -9706> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=199) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5613 pv6007 ap=199 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=199) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=197) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.699 INFO:teuthology.orchestra.run.smithi045.stdout: -9705> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000517 [2,head] /dc-dir/dc-file_802 auth v5606 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.076101+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355fa680] 2023-10-03T19:21:06.700 INFO:teuthology.orchestra.run.smithi045.stdout: -9704> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000517 [2,head] /dc-dir/dc-file_802 auth v5606 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.076101+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355fa680] 2023-10-03T19:21:06.700 INFO:teuthology.orchestra.run.smithi045.stdout: -9703> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:06.700 INFO:teuthology.orchestra.run.smithi045.stdout: -9702> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:06.700 INFO:teuthology.orchestra.run.smithi045.stdout: -9701> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:06.700 INFO:teuthology.orchestra.run.smithi045.stdout: -9700> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000517 [2,head] /dc-dir/dc-file_802 auth v5606 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.076101+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355fa680] 2023-10-03T19:21:06.700 INFO:teuthology.orchestra.run.smithi045.stdout: -9699> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000517 [2,head] /dc-dir/dc-file_802 auth v5606 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.076101+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355fa680] 2023-10-03T19:21:06.700 INFO:teuthology.orchestra.run.smithi045.stdout: -9698> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:06.700 INFO:teuthology.orchestra.run.smithi045.stdout: -9697> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 532.258, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.32e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1067.3] 2023-10-03T19:21:06.700 INFO:teuthology.orchestra.run.smithi045.stdout: -9696> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655352e8d80 on [dir 0x1 / [2,head] auth pv=6008 v=5614 cv=5384/5384 REP dir_auth=0 ap=197+199 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 197 2023-10-03T19:21:06.701 INFO:teuthology.orchestra.run.smithi045.stdout: -9695> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655352e8d80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5613 pv6007 ap=198 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=198) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=197) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 198 2023-10-03T19:21:06.701 INFO:teuthology.orchestra.run.smithi045.stdout: -9694> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5614 cv=5384/5384 REP dir_auth=0 ap=197+198 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655352e8d80 count now 197/198 2023-10-03T19:21:06.701 INFO:teuthology.orchestra.run.smithi045.stdout: -9693> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655352e8d80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5607 cv=5377/5377 ap=198+198 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=115 | child=1 dirty=1 authpin=1 0x565534f82400] count now 198 2023-10-03T19:21:06.701 INFO:teuthology.orchestra.run.smithi045.stdout: -9692> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000517) auth_unpin by 0x5655352e8d80 on [inode 0x10000000517 [2,head] /dc-dir/dc-file_802 auth v5606 s=3 n(v0 rc2023-10-03T19:17:08.076101+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355fa680] now 0 2023-10-03T19:21:06.701 INFO:teuthology.orchestra.run.smithi045.stdout: -9691> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5607 cv=5377/5377 ap=198+197 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=115 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655352e8d80 count now 198/197 2023-10-03T19:21:06.701 INFO:teuthology.orchestra.run.smithi045.stdout: -9690> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.701 INFO:teuthology.orchestra.run.smithi045.stdout: -9689> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.701 INFO:teuthology.orchestra.run.smithi045.stdout: -9688> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000518 [2,head] /dc-dir/dc-file_803 auth v3958 pv5608 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.089527+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.089527+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655355fac00] 2023-10-03T19:21:06.701 INFO:teuthology.orchestra.run.smithi045.stdout: -9687> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5615 2023-10-03T19:21:06.701 INFO:teuthology.orchestra.run.smithi045.stdout: -9686> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5615 pv6007 ap=198 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=198) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=197) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.702 INFO:teuthology.orchestra.run.smithi045.stdout: -9685> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5613 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:06.702 INFO:teuthology.orchestra.run.smithi045.stdout: -9684> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5614 cv=5384/5384 REP dir_auth=0 ap=197+198 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5614 2023-10-03T19:21:06.702 INFO:teuthology.orchestra.run.smithi045.stdout: -9683> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000518) pop_and_dirty_projected_inode v5608 2023-10-03T19:21:06.702 INFO:teuthology.orchestra.run.smithi045.stdout: -9682> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000518) mark_dirty [inode 0x10000000518 [2,head] /dc-dir/dc-file_803 auth v5608 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.089527+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655355fac00] 2023-10-03T19:21:06.702 INFO:teuthology.orchestra.run.smithi045.stdout: -9681> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_803) mark_dirty [dentry #0x1/dc-dir/dc-file_803 [2,head] auth (dversion lock) pv=5608 v=3958 ino=0x10000000518 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535604000] 2023-10-03T19:21:06.702 INFO:teuthology.orchestra.run.smithi045.stdout: -9680> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5607 cv=5377/5377 ap=198+197 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=116 | child=1 dirty=1 authpin=1 0x565534f82400] version 5607 2023-10-03T19:21:06.702 INFO:teuthology.orchestra.run.smithi045.stdout: -9679> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x5655354685c0 v5616 2023-10-03T19:21:06.703 INFO:teuthology.orchestra.run.smithi045.stdout: -9678> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5616 cv=5384/5384 REP dir_auth=0 ap=197+198 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5616 2023-10-03T19:21:06.703 INFO:teuthology.orchestra.run.smithi045.stdout: -9677> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655354684a0 v5609 2023-10-03T19:21:06.703 INFO:teuthology.orchestra.run.smithi045.stdout: -9676> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5609 cv=5377/5377 ap=198+197 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=116 | child=1 dirty=1 authpin=1 0x565534f82400] version 5609 2023-10-03T19:21:06.703 INFO:teuthology.orchestra.run.smithi045.stdout: -9675> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=197 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=197 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:06.703 INFO:teuthology.orchestra.run.smithi045.stdout: -9674> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=197) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5615 pv6007 ap=198 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=198) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=197) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.703 INFO:teuthology.orchestra.run.smithi045.stdout: -9673> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=198) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5615 pv6007 ap=198 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=198) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=196) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.703 INFO:teuthology.orchestra.run.smithi045.stdout: -9672> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000518 [2,head] /dc-dir/dc-file_803 auth v5608 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.089527+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355fac00] 2023-10-03T19:21:06.703 INFO:teuthology.orchestra.run.smithi045.stdout: -9671> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000518 [2,head] /dc-dir/dc-file_803 auth v5608 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.089527+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355fac00] 2023-10-03T19:21:06.703 INFO:teuthology.orchestra.run.smithi045.stdout: -9670> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:06.703 INFO:teuthology.orchestra.run.smithi045.stdout: -9669> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:06.704 INFO:teuthology.orchestra.run.smithi045.stdout: -9668> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:06.704 INFO:teuthology.orchestra.run.smithi045.stdout: -9667> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000518 [2,head] /dc-dir/dc-file_803 auth v5608 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.089527+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355fac00] 2023-10-03T19:21:06.704 INFO:teuthology.orchestra.run.smithi045.stdout: -9666> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000518 [2,head] /dc-dir/dc-file_803 auth v5608 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.089527+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355fac00] 2023-10-03T19:21:06.704 INFO:teuthology.orchestra.run.smithi045.stdout: -9665> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:06.704 INFO:teuthology.orchestra.run.smithi045.stdout: -9664> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 533.258, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.33e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1069.3] 2023-10-03T19:21:06.704 INFO:teuthology.orchestra.run.smithi045.stdout: -9663> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565534fd7d40 on [dir 0x1 / [2,head] auth pv=6008 v=5616 cv=5384/5384 REP dir_auth=0 ap=196+198 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 196 2023-10-03T19:21:06.704 INFO:teuthology.orchestra.run.smithi045.stdout: -9662> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565534fd7d40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5615 pv6007 ap=197 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=197) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=196) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 197 2023-10-03T19:21:06.704 INFO:teuthology.orchestra.run.smithi045.stdout: -9661> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5616 cv=5384/5384 REP dir_auth=0 ap=196+197 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565534fd7d40 count now 196/197 2023-10-03T19:21:06.704 INFO:teuthology.orchestra.run.smithi045.stdout: -9660> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565534fd7d40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5609 cv=5377/5377 ap=197+197 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=116 | child=1 dirty=1 authpin=1 0x565534f82400] count now 197 2023-10-03T19:21:06.705 INFO:teuthology.orchestra.run.smithi045.stdout: -9659> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000518) auth_unpin by 0x565534fd7d40 on [inode 0x10000000518 [2,head] /dc-dir/dc-file_803 auth v5608 s=3 n(v0 rc2023-10-03T19:17:08.089527+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355fac00] now 0 2023-10-03T19:21:06.705 INFO:teuthology.orchestra.run.smithi045.stdout: -9658> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5609 cv=5377/5377 ap=197+196 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=116 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565534fd7d40 count now 197/196 2023-10-03T19:21:06.705 INFO:teuthology.orchestra.run.smithi045.stdout: -9657> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.705 INFO:teuthology.orchestra.run.smithi045.stdout: -9656> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.705 INFO:teuthology.orchestra.run.smithi045.stdout: -9655> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000519 [2,head] /dc-dir/dc-file_804 auth v3962 pv5610 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.101210+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.101210+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655355fb180] 2023-10-03T19:21:06.705 INFO:teuthology.orchestra.run.smithi045.stdout: -9654> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5617 2023-10-03T19:21:06.705 INFO:teuthology.orchestra.run.smithi045.stdout: -9653> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5617 pv6007 ap=197 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=197) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=196) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.705 INFO:teuthology.orchestra.run.smithi045.stdout: -9652> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5615 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:06.705 INFO:teuthology.orchestra.run.smithi045.stdout: -9651> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5616 cv=5384/5384 REP dir_auth=0 ap=196+197 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5616 2023-10-03T19:21:06.705 INFO:teuthology.orchestra.run.smithi045.stdout: -9650> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000519) pop_and_dirty_projected_inode v5610 2023-10-03T19:21:06.706 INFO:teuthology.orchestra.run.smithi045.stdout: -9649> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000519) mark_dirty [inode 0x10000000519 [2,head] /dc-dir/dc-file_804 auth v5610 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.101210+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655355fb180] 2023-10-03T19:21:06.706 INFO:teuthology.orchestra.run.smithi045.stdout: -9648> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_804) mark_dirty [dentry #0x1/dc-dir/dc-file_804 [2,head] auth (dversion lock) pv=5610 v=3962 ino=0x10000000519 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535604280] 2023-10-03T19:21:06.706 INFO:teuthology.orchestra.run.smithi045.stdout: -9647> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5609 cv=5377/5377 ap=197+196 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=117 | child=1 dirty=1 authpin=1 0x565534f82400] version 5609 2023-10-03T19:21:06.706 INFO:teuthology.orchestra.run.smithi045.stdout: -9646> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535468800 v5618 2023-10-03T19:21:06.706 INFO:teuthology.orchestra.run.smithi045.stdout: -9645> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5618 cv=5384/5384 REP dir_auth=0 ap=196+197 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5618 2023-10-03T19:21:06.706 INFO:teuthology.orchestra.run.smithi045.stdout: -9644> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655354686e0 v5611 2023-10-03T19:21:06.706 INFO:teuthology.orchestra.run.smithi045.stdout: -9643> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5611 cv=5377/5377 ap=197+196 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=117 | child=1 dirty=1 authpin=1 0x565534f82400] version 5611 2023-10-03T19:21:06.706 INFO:teuthology.orchestra.run.smithi045.stdout: -9642> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=196 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=196 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:06.712 INFO:teuthology.orchestra.run.smithi045.stdout: -9641> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=196) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5617 pv6007 ap=197 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=197) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=196) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.712 INFO:teuthology.orchestra.run.smithi045.stdout: -9640> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=197) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5617 pv6007 ap=197 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=197) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=195) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.712 INFO:teuthology.orchestra.run.smithi045.stdout: -9639> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000519 [2,head] /dc-dir/dc-file_804 auth v5610 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.101210+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355fb180] 2023-10-03T19:21:06.713 INFO:teuthology.orchestra.run.smithi045.stdout: -9638> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000519 [2,head] /dc-dir/dc-file_804 auth v5610 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.101210+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355fb180] 2023-10-03T19:21:06.713 INFO:teuthology.orchestra.run.smithi045.stdout: -9637> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:06.713 INFO:teuthology.orchestra.run.smithi045.stdout: -9636> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:06.713 INFO:teuthology.orchestra.run.smithi045.stdout: -9635> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:06.713 INFO:teuthology.orchestra.run.smithi045.stdout: -9634> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000519 [2,head] /dc-dir/dc-file_804 auth v5610 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.101210+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355fb180] 2023-10-03T19:21:06.713 INFO:teuthology.orchestra.run.smithi045.stdout: -9633> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000519 [2,head] /dc-dir/dc-file_804 auth v5610 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.101210+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355fb180] 2023-10-03T19:21:06.713 INFO:teuthology.orchestra.run.smithi045.stdout: -9632> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:06.714 INFO:teuthology.orchestra.run.smithi045.stdout: -9631> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 534.258, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.34e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1071.3] 2023-10-03T19:21:06.714 INFO:teuthology.orchestra.run.smithi045.stdout: -9630> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655352a7b00 on [dir 0x1 / [2,head] auth pv=6008 v=5618 cv=5384/5384 REP dir_auth=0 ap=195+197 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 195 2023-10-03T19:21:06.714 INFO:teuthology.orchestra.run.smithi045.stdout: -9629> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655352a7b00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5617 pv6007 ap=196 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=196) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=195) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 196 2023-10-03T19:21:06.714 INFO:teuthology.orchestra.run.smithi045.stdout: -9628> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5618 cv=5384/5384 REP dir_auth=0 ap=195+196 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655352a7b00 count now 195/196 2023-10-03T19:21:06.714 INFO:teuthology.orchestra.run.smithi045.stdout: -9627> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655352a7b00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5611 cv=5377/5377 ap=196+196 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=117 | child=1 dirty=1 authpin=1 0x565534f82400] count now 196 2023-10-03T19:21:06.714 INFO:teuthology.orchestra.run.smithi045.stdout: -9626> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000519) auth_unpin by 0x5655352a7b00 on [inode 0x10000000519 [2,head] /dc-dir/dc-file_804 auth v5610 s=3 n(v0 rc2023-10-03T19:17:08.101210+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355fb180] now 0 2023-10-03T19:21:06.714 INFO:teuthology.orchestra.run.smithi045.stdout: -9625> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5611 cv=5377/5377 ap=196+195 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=117 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655352a7b00 count now 196/195 2023-10-03T19:21:06.714 INFO:teuthology.orchestra.run.smithi045.stdout: -9624> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.714 INFO:teuthology.orchestra.run.smithi045.stdout: -9623> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.714 INFO:teuthology.orchestra.run.smithi045.stdout: -9622> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000051a [2,head] /dc-dir/dc-file_805 auth v3966 pv5612 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.112672+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.112672+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655355fb700] 2023-10-03T19:21:06.715 INFO:teuthology.orchestra.run.smithi045.stdout: -9621> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5619 2023-10-03T19:21:06.715 INFO:teuthology.orchestra.run.smithi045.stdout: -9620> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5619 pv6007 ap=196 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=196) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=195) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.715 INFO:teuthology.orchestra.run.smithi045.stdout: -9619> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5617 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:06.715 INFO:teuthology.orchestra.run.smithi045.stdout: -9618> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5618 cv=5384/5384 REP dir_auth=0 ap=195+196 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5618 2023-10-03T19:21:06.715 INFO:teuthology.orchestra.run.smithi045.stdout: -9617> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000051a) pop_and_dirty_projected_inode v5612 2023-10-03T19:21:06.715 INFO:teuthology.orchestra.run.smithi045.stdout: -9616> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000051a) mark_dirty [inode 0x1000000051a [2,head] /dc-dir/dc-file_805 auth v5612 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.112672+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655355fb700] 2023-10-03T19:21:06.715 INFO:teuthology.orchestra.run.smithi045.stdout: -9615> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_805) mark_dirty [dentry #0x1/dc-dir/dc-file_805 [2,head] auth (dversion lock) pv=5612 v=3966 ino=0x1000000051a state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535604500] 2023-10-03T19:21:06.715 INFO:teuthology.orchestra.run.smithi045.stdout: -9614> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5611 cv=5377/5377 ap=196+195 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=118 | child=1 dirty=1 authpin=1 0x565534f82400] version 5611 2023-10-03T19:21:06.716 INFO:teuthology.orchestra.run.smithi045.stdout: -9613> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535468a40 v5620 2023-10-03T19:21:06.716 INFO:teuthology.orchestra.run.smithi045.stdout: -9612> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5620 cv=5384/5384 REP dir_auth=0 ap=195+196 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5620 2023-10-03T19:21:06.716 INFO:teuthology.orchestra.run.smithi045.stdout: -9611> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535468920 v5613 2023-10-03T19:21:06.716 INFO:teuthology.orchestra.run.smithi045.stdout: -9610> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5613 cv=5377/5377 ap=196+195 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=118 | child=1 dirty=1 authpin=1 0x565534f82400] version 5613 2023-10-03T19:21:06.716 INFO:teuthology.orchestra.run.smithi045.stdout: -9609> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=195 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=195 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:06.716 INFO:teuthology.orchestra.run.smithi045.stdout: -9608> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=195) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5619 pv6007 ap=196 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=196) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=195) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.716 INFO:teuthology.orchestra.run.smithi045.stdout: -9607> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=196) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5619 pv6007 ap=196 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=196) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=194) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.716 INFO:teuthology.orchestra.run.smithi045.stdout: -9606> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000051a [2,head] /dc-dir/dc-file_805 auth v5612 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.112672+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355fb700] 2023-10-03T19:21:06.716 INFO:teuthology.orchestra.run.smithi045.stdout: -9605> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000051a [2,head] /dc-dir/dc-file_805 auth v5612 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.112672+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355fb700] 2023-10-03T19:21:06.716 INFO:teuthology.orchestra.run.smithi045.stdout: -9604> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:06.717 INFO:teuthology.orchestra.run.smithi045.stdout: -9603> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:06.717 INFO:teuthology.orchestra.run.smithi045.stdout: -9602> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:06.717 INFO:teuthology.orchestra.run.smithi045.stdout: -9601> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000051a [2,head] /dc-dir/dc-file_805 auth v5612 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.112672+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355fb700] 2023-10-03T19:21:06.717 INFO:teuthology.orchestra.run.smithi045.stdout: -9600> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000051a [2,head] /dc-dir/dc-file_805 auth v5612 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.112672+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655355fb700] 2023-10-03T19:21:06.717 INFO:teuthology.orchestra.run.smithi045.stdout: -9599> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:06.717 INFO:teuthology.orchestra.run.smithi045.stdout: -9598> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 535.258, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.35e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1073.3] 2023-10-03T19:21:06.717 INFO:teuthology.orchestra.run.smithi045.stdout: -9597> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x56553541b440 on [dir 0x1 / [2,head] auth pv=6008 v=5620 cv=5384/5384 REP dir_auth=0 ap=194+196 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 194 2023-10-03T19:21:06.717 INFO:teuthology.orchestra.run.smithi045.stdout: -9596> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x56553541b440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5619 pv6007 ap=195 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=195) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=194) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 195 2023-10-03T19:21:06.717 INFO:teuthology.orchestra.run.smithi045.stdout: -9595> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5620 cv=5384/5384 REP dir_auth=0 ap=194+195 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x56553541b440 count now 194/195 2023-10-03T19:21:06.718 INFO:teuthology.orchestra.run.smithi045.stdout: -9594> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x56553541b440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5613 cv=5377/5377 ap=195+195 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=118 | child=1 dirty=1 authpin=1 0x565534f82400] count now 195 2023-10-03T19:21:06.718 INFO:teuthology.orchestra.run.smithi045.stdout: -9593> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000051a) auth_unpin by 0x56553541b440 on [inode 0x1000000051a [2,head] /dc-dir/dc-file_805 auth v5612 s=3 n(v0 rc2023-10-03T19:17:08.112672+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355fb700] now 0 2023-10-03T19:21:06.718 INFO:teuthology.orchestra.run.smithi045.stdout: -9592> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5613 cv=5377/5377 ap=195+194 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=118 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x56553541b440 count now 195/194 2023-10-03T19:21:06.718 INFO:teuthology.orchestra.run.smithi045.stdout: -9591> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.718 INFO:teuthology.orchestra.run.smithi045.stdout: -9590> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.718 INFO:teuthology.orchestra.run.smithi045.stdout: -9589> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000051b [2,head] /dc-dir/dc-file_806 auth v3970 pv5614 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.124181+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.124181+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535608000] 2023-10-03T19:21:06.718 INFO:teuthology.orchestra.run.smithi045.stdout: -9588> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5621 2023-10-03T19:21:06.718 INFO:teuthology.orchestra.run.smithi045.stdout: -9587> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5621 pv6007 ap=195 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=195) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=194) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.719 INFO:teuthology.orchestra.run.smithi045.stdout: -9586> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5619 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:06.780 INFO:teuthology.orchestra.run.smithi045.stdout: -9585> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5620 cv=5384/5384 REP dir_auth=0 ap=194+195 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5620 2023-10-03T19:21:06.780 INFO:teuthology.orchestra.run.smithi045.stdout: -9584> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000051b) pop_and_dirty_projected_inode v5614 2023-10-03T19:21:06.781 INFO:teuthology.orchestra.run.smithi045.stdout: -9583> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000051b) mark_dirty [inode 0x1000000051b [2,head] /dc-dir/dc-file_806 auth v5614 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.124181+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535608000] 2023-10-03T19:21:06.781 INFO:teuthology.orchestra.run.smithi045.stdout: -9582> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_806) mark_dirty [dentry #0x1/dc-dir/dc-file_806 [2,head] auth (dversion lock) pv=5614 v=3970 ino=0x1000000051b state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535604780] 2023-10-03T19:21:06.781 INFO:teuthology.orchestra.run.smithi045.stdout: -9581> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5613 cv=5377/5377 ap=195+194 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=119 | child=1 dirty=1 authpin=1 0x565534f82400] version 5613 2023-10-03T19:21:06.781 INFO:teuthology.orchestra.run.smithi045.stdout: -9580> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535468c80 v5622 2023-10-03T19:21:06.781 INFO:teuthology.orchestra.run.smithi045.stdout: -9579> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5622 cv=5384/5384 REP dir_auth=0 ap=194+195 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5622 2023-10-03T19:21:06.781 INFO:teuthology.orchestra.run.smithi045.stdout: -9578> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535468b60 v5615 2023-10-03T19:21:06.781 INFO:teuthology.orchestra.run.smithi045.stdout: -9577> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5615 cv=5377/5377 ap=195+194 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=119 | child=1 dirty=1 authpin=1 0x565534f82400] version 5615 2023-10-03T19:21:06.781 INFO:teuthology.orchestra.run.smithi045.stdout: -9576> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=194 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=194 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:06.781 INFO:teuthology.orchestra.run.smithi045.stdout: -9575> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=194) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5621 pv6007 ap=195 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=195) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=194) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.782 INFO:teuthology.orchestra.run.smithi045.stdout: -9574> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=195) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5621 pv6007 ap=195 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=195) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=193) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.782 INFO:teuthology.orchestra.run.smithi045.stdout: -9573> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000051b [2,head] /dc-dir/dc-file_806 auth v5614 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.124181+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535608000] 2023-10-03T19:21:06.782 INFO:teuthology.orchestra.run.smithi045.stdout: -9572> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000051b [2,head] /dc-dir/dc-file_806 auth v5614 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.124181+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535608000] 2023-10-03T19:21:06.782 INFO:teuthology.orchestra.run.smithi045.stdout: -9571> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:06.782 INFO:teuthology.orchestra.run.smithi045.stdout: -9570> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:06.782 INFO:teuthology.orchestra.run.smithi045.stdout: -9569> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:06.782 INFO:teuthology.orchestra.run.smithi045.stdout: -9568> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000051b [2,head] /dc-dir/dc-file_806 auth v5614 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.124181+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535608000] 2023-10-03T19:21:06.782 INFO:teuthology.orchestra.run.smithi045.stdout: -9567> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000051b [2,head] /dc-dir/dc-file_806 auth v5614 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.124181+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535608000] 2023-10-03T19:21:06.783 INFO:teuthology.orchestra.run.smithi045.stdout: -9566> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:06.783 INFO:teuthology.orchestra.run.smithi045.stdout: -9565> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 536.258, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.36e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1075.3] 2023-10-03T19:21:06.783 INFO:teuthology.orchestra.run.smithi045.stdout: -9564> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535421d40 on [dir 0x1 / [2,head] auth pv=6008 v=5622 cv=5384/5384 REP dir_auth=0 ap=193+195 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 193 2023-10-03T19:21:06.783 INFO:teuthology.orchestra.run.smithi045.stdout: -9563> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535421d40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5615 cv=5377/5377 ap=194+194 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=119 | child=1 dirty=1 authpin=1 0x565534f82400] count now 194 2023-10-03T19:21:06.783 INFO:teuthology.orchestra.run.smithi045.stdout: -9562> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535421d40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5621 pv6007 ap=194 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=194) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=193) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 194 2023-10-03T19:21:06.783 INFO:teuthology.orchestra.run.smithi045.stdout: -9561> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5622 cv=5384/5384 REP dir_auth=0 ap=193+194 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535421d40 count now 193/194 2023-10-03T19:21:06.783 INFO:teuthology.orchestra.run.smithi045.stdout: -9560> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000051b) auth_unpin by 0x565535421d40 on [inode 0x1000000051b [2,head] /dc-dir/dc-file_806 auth v5614 s=3 n(v0 rc2023-10-03T19:17:08.124181+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535608000] now 0 2023-10-03T19:21:06.783 INFO:teuthology.orchestra.run.smithi045.stdout: -9559> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5615 cv=5377/5377 ap=194+193 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=119 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535421d40 count now 194/193 2023-10-03T19:21:06.783 INFO:teuthology.orchestra.run.smithi045.stdout: -9558> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.784 INFO:teuthology.orchestra.run.smithi045.stdout: -9557> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.784 INFO:teuthology.orchestra.run.smithi045.stdout: -9556> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000051c [2,head] /dc-dir/dc-file_807 auth v3974 pv5616 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.135495+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.135495+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535608580] 2023-10-03T19:21:06.784 INFO:teuthology.orchestra.run.smithi045.stdout: -9555> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5623 2023-10-03T19:21:06.784 INFO:teuthology.orchestra.run.smithi045.stdout: -9554> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5623 pv6007 ap=194 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=194) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=193) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.784 INFO:teuthology.orchestra.run.smithi045.stdout: -9553> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5621 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:06.784 INFO:teuthology.orchestra.run.smithi045.stdout: -9552> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5622 cv=5384/5384 REP dir_auth=0 ap=193+194 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5622 2023-10-03T19:21:06.784 INFO:teuthology.orchestra.run.smithi045.stdout: -9551> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000051c) pop_and_dirty_projected_inode v5616 2023-10-03T19:21:06.784 INFO:teuthology.orchestra.run.smithi045.stdout: -9550> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000051c) mark_dirty [inode 0x1000000051c [2,head] /dc-dir/dc-file_807 auth v5616 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.135495+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535608580] 2023-10-03T19:21:06.785 INFO:teuthology.orchestra.run.smithi045.stdout: -9549> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_807) mark_dirty [dentry #0x1/dc-dir/dc-file_807 [2,head] auth (dversion lock) pv=5616 v=3974 ino=0x1000000051c state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535604a00] 2023-10-03T19:21:06.785 INFO:teuthology.orchestra.run.smithi045.stdout: -9548> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5615 cv=5377/5377 ap=194+193 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=120 | child=1 dirty=1 authpin=1 0x565534f82400] version 5615 2023-10-03T19:21:06.785 INFO:teuthology.orchestra.run.smithi045.stdout: -9547> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535468ec0 v5624 2023-10-03T19:21:06.785 INFO:teuthology.orchestra.run.smithi045.stdout: -9546> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5624 cv=5384/5384 REP dir_auth=0 ap=193+194 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5624 2023-10-03T19:21:06.785 INFO:teuthology.orchestra.run.smithi045.stdout: -9545> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535468da0 v5617 2023-10-03T19:21:06.785 INFO:teuthology.orchestra.run.smithi045.stdout: -9544> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5617 cv=5377/5377 ap=194+193 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=120 | child=1 dirty=1 authpin=1 0x565534f82400] version 5617 2023-10-03T19:21:06.786 INFO:teuthology.orchestra.run.smithi045.stdout: -9543> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=193 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=193 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:06.786 INFO:teuthology.orchestra.run.smithi045.stdout: -9542> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=193) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5623 pv6007 ap=194 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=194) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=193) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.786 INFO:teuthology.orchestra.run.smithi045.stdout: -9541> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=194) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5623 pv6007 ap=194 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=194) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=192) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.786 INFO:teuthology.orchestra.run.smithi045.stdout: -9540> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000051c [2,head] /dc-dir/dc-file_807 auth v5616 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.135495+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535608580] 2023-10-03T19:21:06.786 INFO:teuthology.orchestra.run.smithi045.stdout: -9539> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000051c [2,head] /dc-dir/dc-file_807 auth v5616 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.135495+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535608580] 2023-10-03T19:21:06.786 INFO:teuthology.orchestra.run.smithi045.stdout: -9538> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:06.786 INFO:teuthology.orchestra.run.smithi045.stdout: -9537> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:06.786 INFO:teuthology.orchestra.run.smithi045.stdout: -9536> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:06.787 INFO:teuthology.orchestra.run.smithi045.stdout: -9535> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000051c [2,head] /dc-dir/dc-file_807 auth v5616 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.135495+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535608580] 2023-10-03T19:21:06.787 INFO:teuthology.orchestra.run.smithi045.stdout: -9534> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000051c [2,head] /dc-dir/dc-file_807 auth v5616 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.135495+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535608580] 2023-10-03T19:21:06.787 INFO:teuthology.orchestra.run.smithi045.stdout: -9533> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:06.787 INFO:teuthology.orchestra.run.smithi045.stdout: -9532> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 537.258, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.37e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1077.3] 2023-10-03T19:21:06.787 INFO:teuthology.orchestra.run.smithi045.stdout: -9531> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535443d40 on [dir 0x1 / [2,head] auth pv=6008 v=5624 cv=5384/5384 REP dir_auth=0 ap=192+194 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 192 2023-10-03T19:21:06.787 INFO:teuthology.orchestra.run.smithi045.stdout: -9530> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535443d40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5623 pv6007 ap=193 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=193) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=192) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 193 2023-10-03T19:21:06.787 INFO:teuthology.orchestra.run.smithi045.stdout: -9529> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5624 cv=5384/5384 REP dir_auth=0 ap=192+193 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535443d40 count now 192/193 2023-10-03T19:21:06.787 INFO:teuthology.orchestra.run.smithi045.stdout: -9528> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535443d40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5617 cv=5377/5377 ap=193+193 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=120 | child=1 dirty=1 authpin=1 0x565534f82400] count now 193 2023-10-03T19:21:06.788 INFO:teuthology.orchestra.run.smithi045.stdout: -9527> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000051c) auth_unpin by 0x565535443d40 on [inode 0x1000000051c [2,head] /dc-dir/dc-file_807 auth v5616 s=3 n(v0 rc2023-10-03T19:17:08.135495+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535608580] now 0 2023-10-03T19:21:06.788 INFO:teuthology.orchestra.run.smithi045.stdout: -9526> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5617 cv=5377/5377 ap=193+192 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=120 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535443d40 count now 193/192 2023-10-03T19:21:06.788 INFO:teuthology.orchestra.run.smithi045.stdout: -9525> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.788 INFO:teuthology.orchestra.run.smithi045.stdout: -9524> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.788 INFO:teuthology.orchestra.run.smithi045.stdout: -9523> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000051d [2,head] /dc-dir/dc-file_808 auth v3978 pv5618 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.146973+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.146973+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535608b00] 2023-10-03T19:21:06.788 INFO:teuthology.orchestra.run.smithi045.stdout: -9522> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5625 2023-10-03T19:21:06.788 INFO:teuthology.orchestra.run.smithi045.stdout: -9521> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5625 pv6007 ap=193 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=193) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=192) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.789 INFO:teuthology.orchestra.run.smithi045.stdout: -9520> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5623 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:06.789 INFO:teuthology.orchestra.run.smithi045.stdout: -9519> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5624 cv=5384/5384 REP dir_auth=0 ap=192+193 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5624 2023-10-03T19:21:06.789 INFO:teuthology.orchestra.run.smithi045.stdout: -9518> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000051d) pop_and_dirty_projected_inode v5618 2023-10-03T19:21:06.789 INFO:teuthology.orchestra.run.smithi045.stdout: -9517> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000051d) mark_dirty [inode 0x1000000051d [2,head] /dc-dir/dc-file_808 auth v5618 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.146973+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535608b00] 2023-10-03T19:21:06.789 INFO:teuthology.orchestra.run.smithi045.stdout: -9516> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_808) mark_dirty [dentry #0x1/dc-dir/dc-file_808 [2,head] auth (dversion lock) pv=5618 v=3978 ino=0x1000000051d state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535604c80] 2023-10-03T19:21:06.789 INFO:teuthology.orchestra.run.smithi045.stdout: -9515> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5617 cv=5377/5377 ap=193+192 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=121 | child=1 dirty=1 authpin=1 0x565534f82400] version 5617 2023-10-03T19:21:06.789 INFO:teuthology.orchestra.run.smithi045.stdout: -9514> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535469100 v5626 2023-10-03T19:21:06.790 INFO:teuthology.orchestra.run.smithi045.stdout: -9513> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5626 cv=5384/5384 REP dir_auth=0 ap=192+193 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5626 2023-10-03T19:21:06.790 INFO:teuthology.orchestra.run.smithi045.stdout: -9512> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535468fe0 v5619 2023-10-03T19:21:06.790 INFO:teuthology.orchestra.run.smithi045.stdout: -9511> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5619 cv=5377/5377 ap=193+192 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=121 | child=1 dirty=1 authpin=1 0x565534f82400] version 5619 2023-10-03T19:21:06.790 INFO:teuthology.orchestra.run.smithi045.stdout: -9510> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=192 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=192 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:06.790 INFO:teuthology.orchestra.run.smithi045.stdout: -9509> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=192) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5625 pv6007 ap=193 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=193) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=192) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.790 INFO:teuthology.orchestra.run.smithi045.stdout: -9508> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=193) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5625 pv6007 ap=193 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=193) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=191) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.790 INFO:teuthology.orchestra.run.smithi045.stdout: -9507> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000051d [2,head] /dc-dir/dc-file_808 auth v5618 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.146973+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535608b00] 2023-10-03T19:21:06.790 INFO:teuthology.orchestra.run.smithi045.stdout: -9506> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000051d [2,head] /dc-dir/dc-file_808 auth v5618 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.146973+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535608b00] 2023-10-03T19:21:06.791 INFO:teuthology.orchestra.run.smithi045.stdout: -9505> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:06.791 INFO:teuthology.orchestra.run.smithi045.stdout: -9504> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:06.791 INFO:teuthology.orchestra.run.smithi045.stdout: -9503> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:06.791 INFO:teuthology.orchestra.run.smithi045.stdout: -9502> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000051d [2,head] /dc-dir/dc-file_808 auth v5618 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.146973+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535608b00] 2023-10-03T19:21:06.791 INFO:teuthology.orchestra.run.smithi045.stdout: -9501> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000051d [2,head] /dc-dir/dc-file_808 auth v5618 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.146973+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535608b00] 2023-10-03T19:21:06.791 INFO:teuthology.orchestra.run.smithi045.stdout: -9500> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:06.791 INFO:teuthology.orchestra.run.smithi045.stdout: -9499> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 538.258, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.38e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1079.3] 2023-10-03T19:21:06.792 INFO:teuthology.orchestra.run.smithi045.stdout: -9498> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655354b6480 on [dir 0x1 / [2,head] auth pv=6008 v=5626 cv=5384/5384 REP dir_auth=0 ap=191+193 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 191 2023-10-03T19:21:06.792 INFO:teuthology.orchestra.run.smithi045.stdout: -9497> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655354b6480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5625 pv6007 ap=192 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=192) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=191) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 192 2023-10-03T19:21:06.792 INFO:teuthology.orchestra.run.smithi045.stdout: -9496> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5626 cv=5384/5384 REP dir_auth=0 ap=191+192 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655354b6480 count now 191/192 2023-10-03T19:21:06.792 INFO:teuthology.orchestra.run.smithi045.stdout: -9495> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655354b6480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5619 cv=5377/5377 ap=192+192 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=121 | child=1 dirty=1 authpin=1 0x565534f82400] count now 192 2023-10-03T19:21:06.792 INFO:teuthology.orchestra.run.smithi045.stdout: -9494> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000051d) auth_unpin by 0x5655354b6480 on [inode 0x1000000051d [2,head] /dc-dir/dc-file_808 auth v5618 s=3 n(v0 rc2023-10-03T19:17:08.146973+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535608b00] now 0 2023-10-03T19:21:06.792 INFO:teuthology.orchestra.run.smithi045.stdout: -9493> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5619 cv=5377/5377 ap=192+191 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=121 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655354b6480 count now 192/191 2023-10-03T19:21:06.792 INFO:teuthology.orchestra.run.smithi045.stdout: -9492> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.792 INFO:teuthology.orchestra.run.smithi045.stdout: -9491> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.792 INFO:teuthology.orchestra.run.smithi045.stdout: -9490> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000051e [2,head] /dc-dir/dc-file_809 auth v3982 pv5620 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.158332+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.158332+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535609080] 2023-10-03T19:21:06.792 INFO:teuthology.orchestra.run.smithi045.stdout: -9489> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5627 2023-10-03T19:21:06.793 INFO:teuthology.orchestra.run.smithi045.stdout: -9488> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5627 pv6007 ap=192 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=192) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=191) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.793 INFO:teuthology.orchestra.run.smithi045.stdout: -9487> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5625 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:06.793 INFO:teuthology.orchestra.run.smithi045.stdout: -9486> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5626 cv=5384/5384 REP dir_auth=0 ap=191+192 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5626 2023-10-03T19:21:06.793 INFO:teuthology.orchestra.run.smithi045.stdout: -9485> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000051e) pop_and_dirty_projected_inode v5620 2023-10-03T19:21:06.793 INFO:teuthology.orchestra.run.smithi045.stdout: -9484> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000051e) mark_dirty [inode 0x1000000051e [2,head] /dc-dir/dc-file_809 auth v5620 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.158332+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535609080] 2023-10-03T19:21:06.793 INFO:teuthology.orchestra.run.smithi045.stdout: -9483> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_809) mark_dirty [dentry #0x1/dc-dir/dc-file_809 [2,head] auth (dversion lock) pv=5620 v=3982 ino=0x1000000051e state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535604f00] 2023-10-03T19:21:06.793 INFO:teuthology.orchestra.run.smithi045.stdout: -9482> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5619 cv=5377/5377 ap=192+191 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=122 | child=1 dirty=1 authpin=1 0x565534f82400] version 5619 2023-10-03T19:21:06.793 INFO:teuthology.orchestra.run.smithi045.stdout: -9481> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535469340 v5628 2023-10-03T19:21:06.793 INFO:teuthology.orchestra.run.smithi045.stdout: -9480> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5628 cv=5384/5384 REP dir_auth=0 ap=191+192 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5628 2023-10-03T19:21:06.794 INFO:teuthology.orchestra.run.smithi045.stdout: -9479> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535469220 v5621 2023-10-03T19:21:06.794 INFO:teuthology.orchestra.run.smithi045.stdout: -9478> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5621 cv=5377/5377 ap=192+191 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=122 | child=1 dirty=1 authpin=1 0x565534f82400] version 5621 2023-10-03T19:21:06.794 INFO:teuthology.orchestra.run.smithi045.stdout: -9477> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=191 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=191 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:06.794 INFO:teuthology.orchestra.run.smithi045.stdout: -9476> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=191) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5627 pv6007 ap=192 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=192) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=191) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.794 INFO:teuthology.orchestra.run.smithi045.stdout: -9475> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=192) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5627 pv6007 ap=192 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=192) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=190) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.794 INFO:teuthology.orchestra.run.smithi045.stdout: -9474> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000051e [2,head] /dc-dir/dc-file_809 auth v5620 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.158332+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535609080] 2023-10-03T19:21:06.794 INFO:teuthology.orchestra.run.smithi045.stdout: -9473> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000051e [2,head] /dc-dir/dc-file_809 auth v5620 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.158332+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535609080] 2023-10-03T19:21:06.865 INFO:teuthology.orchestra.run.smithi045.stdout: -9472> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:06.865 INFO:teuthology.orchestra.run.smithi045.stdout: -9471> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:06.866 INFO:teuthology.orchestra.run.smithi045.stdout: -9470> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:06.866 INFO:teuthology.orchestra.run.smithi045.stdout: -9469> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000051e [2,head] /dc-dir/dc-file_809 auth v5620 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.158332+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535609080] 2023-10-03T19:21:06.866 INFO:teuthology.orchestra.run.smithi045.stdout: -9468> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000051e [2,head] /dc-dir/dc-file_809 auth v5620 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.158332+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535609080] 2023-10-03T19:21:06.866 INFO:teuthology.orchestra.run.smithi045.stdout: -9467> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:06.866 INFO:teuthology.orchestra.run.smithi045.stdout: -9466> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 539.258, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.39e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1081.3] 2023-10-03T19:21:06.866 INFO:teuthology.orchestra.run.smithi045.stdout: -9465> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535428d80 on [dir 0x1 / [2,head] auth pv=6008 v=5628 cv=5384/5384 REP dir_auth=0 ap=190+192 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 190 2023-10-03T19:21:06.866 INFO:teuthology.orchestra.run.smithi045.stdout: -9464> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535428d80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5627 pv6007 ap=191 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=191) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=190) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 191 2023-10-03T19:21:06.866 INFO:teuthology.orchestra.run.smithi045.stdout: -9463> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5628 cv=5384/5384 REP dir_auth=0 ap=190+191 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535428d80 count now 190/191 2023-10-03T19:21:06.867 INFO:teuthology.orchestra.run.smithi045.stdout: -9462> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535428d80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5621 cv=5377/5377 ap=191+191 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=122 | child=1 dirty=1 authpin=1 0x565534f82400] count now 191 2023-10-03T19:21:06.867 INFO:teuthology.orchestra.run.smithi045.stdout: -9461> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000051e) auth_unpin by 0x565535428d80 on [inode 0x1000000051e [2,head] /dc-dir/dc-file_809 auth v5620 s=3 n(v0 rc2023-10-03T19:17:08.158332+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535609080] now 0 2023-10-03T19:21:06.867 INFO:teuthology.orchestra.run.smithi045.stdout: -9460> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5621 cv=5377/5377 ap=191+190 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=122 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535428d80 count now 191/190 2023-10-03T19:21:06.867 INFO:teuthology.orchestra.run.smithi045.stdout: -9459> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.867 INFO:teuthology.orchestra.run.smithi045.stdout: -9458> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.867 INFO:teuthology.orchestra.run.smithi045.stdout: -9457> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000051f [2,head] /dc-dir/dc-file_810 auth v3986 pv5622 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.170002+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.170002+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535609600] 2023-10-03T19:21:06.867 INFO:teuthology.orchestra.run.smithi045.stdout: -9456> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5629 2023-10-03T19:21:06.868 INFO:teuthology.orchestra.run.smithi045.stdout: -9455> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5629 pv6007 ap=191 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=191) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=190) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.868 INFO:teuthology.orchestra.run.smithi045.stdout: -9454> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5627 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:06.868 INFO:teuthology.orchestra.run.smithi045.stdout: -9453> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5628 cv=5384/5384 REP dir_auth=0 ap=190+191 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5628 2023-10-03T19:21:06.868 INFO:teuthology.orchestra.run.smithi045.stdout: -9452> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000051f) pop_and_dirty_projected_inode v5622 2023-10-03T19:21:06.868 INFO:teuthology.orchestra.run.smithi045.stdout: -9451> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000051f) mark_dirty [inode 0x1000000051f [2,head] /dc-dir/dc-file_810 auth v5622 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.170002+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535609600] 2023-10-03T19:21:06.868 INFO:teuthology.orchestra.run.smithi045.stdout: -9450> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_810) mark_dirty [dentry #0x1/dc-dir/dc-file_810 [2,head] auth (dversion lock) pv=5622 v=3986 ino=0x1000000051f state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535605180] 2023-10-03T19:21:06.868 INFO:teuthology.orchestra.run.smithi045.stdout: -9449> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5621 cv=5377/5377 ap=191+190 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=123 | child=1 dirty=1 authpin=1 0x565534f82400] version 5621 2023-10-03T19:21:06.868 INFO:teuthology.orchestra.run.smithi045.stdout: -9448> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535469580 v5630 2023-10-03T19:21:06.869 INFO:teuthology.orchestra.run.smithi045.stdout: -9447> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5630 cv=5384/5384 REP dir_auth=0 ap=190+191 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5630 2023-10-03T19:21:06.869 INFO:teuthology.orchestra.run.smithi045.stdout: -9446> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535469460 v5623 2023-10-03T19:21:06.869 INFO:teuthology.orchestra.run.smithi045.stdout: -9445> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5623 cv=5377/5377 ap=191+190 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=123 | child=1 dirty=1 authpin=1 0x565534f82400] version 5623 2023-10-03T19:21:06.869 INFO:teuthology.orchestra.run.smithi045.stdout: -9444> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=190 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=190 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:06.869 INFO:teuthology.orchestra.run.smithi045.stdout: -9443> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=190) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5629 pv6007 ap=191 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=191) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=190) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.869 INFO:teuthology.orchestra.run.smithi045.stdout: -9442> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=191) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5629 pv6007 ap=191 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=191) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=189) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.869 INFO:teuthology.orchestra.run.smithi045.stdout: -9441> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000051f [2,head] /dc-dir/dc-file_810 auth v5622 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.170002+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535609600] 2023-10-03T19:21:06.869 INFO:teuthology.orchestra.run.smithi045.stdout: -9440> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000051f [2,head] /dc-dir/dc-file_810 auth v5622 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.170002+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535609600] 2023-10-03T19:21:06.869 INFO:teuthology.orchestra.run.smithi045.stdout: -9439> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:06.870 INFO:teuthology.orchestra.run.smithi045.stdout: -9438> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:06.870 INFO:teuthology.orchestra.run.smithi045.stdout: -9437> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:06.870 INFO:teuthology.orchestra.run.smithi045.stdout: -9436> 2023-10-03T19:17:19.510+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000051f [2,head] /dc-dir/dc-file_810 auth v5622 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.170002+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535609600] 2023-10-03T19:21:06.870 INFO:teuthology.orchestra.run.smithi045.stdout: -9435> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000051f [2,head] /dc-dir/dc-file_810 auth v5622 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.170002+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535609600] 2023-10-03T19:21:06.870 INFO:teuthology.orchestra.run.smithi045.stdout: -9434> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:06.870 INFO:teuthology.orchestra.run.smithi045.stdout: -9433> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 539.959, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.40e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1082.7] 2023-10-03T19:21:06.870 INFO:teuthology.orchestra.run.smithi045.stdout: -9432> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535299d40 on [dir 0x1 / [2,head] auth pv=6008 v=5630 cv=5384/5384 REP dir_auth=0 ap=189+191 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 189 2023-10-03T19:21:06.871 INFO:teuthology.orchestra.run.smithi045.stdout: -9431> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535299d40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5629 pv6007 ap=190 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=190) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=189) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 190 2023-10-03T19:21:06.871 INFO:teuthology.orchestra.run.smithi045.stdout: -9430> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5630 cv=5384/5384 REP dir_auth=0 ap=189+190 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535299d40 count now 189/190 2023-10-03T19:21:06.871 INFO:teuthology.orchestra.run.smithi045.stdout: -9429> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535299d40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5623 cv=5377/5377 ap=190+190 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=123 | child=1 dirty=1 authpin=1 0x565534f82400] count now 190 2023-10-03T19:21:06.871 INFO:teuthology.orchestra.run.smithi045.stdout: -9428> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000051f) auth_unpin by 0x565535299d40 on [inode 0x1000000051f [2,head] /dc-dir/dc-file_810 auth v5622 s=3 n(v0 rc2023-10-03T19:17:08.170002+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535609600] now 0 2023-10-03T19:21:06.871 INFO:teuthology.orchestra.run.smithi045.stdout: -9427> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5623 cv=5377/5377 ap=190+189 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=123 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535299d40 count now 190/189 2023-10-03T19:21:06.871 INFO:teuthology.orchestra.run.smithi045.stdout: -9426> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.872 INFO:teuthology.orchestra.run.smithi045.stdout: -9425> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.872 INFO:teuthology.orchestra.run.smithi045.stdout: -9424> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000520 [2,head] /dc-dir/dc-file_811 auth v3990 pv5624 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.181641+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.181641+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535609b80] 2023-10-03T19:21:06.872 INFO:teuthology.orchestra.run.smithi045.stdout: -9423> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5631 2023-10-03T19:21:06.872 INFO:teuthology.orchestra.run.smithi045.stdout: -9422> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5631 pv6007 ap=190 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=190) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=189) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.872 INFO:teuthology.orchestra.run.smithi045.stdout: -9421> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5629 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:06.872 INFO:teuthology.orchestra.run.smithi045.stdout: -9420> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5630 cv=5384/5384 REP dir_auth=0 ap=189+190 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5630 2023-10-03T19:21:06.872 INFO:teuthology.orchestra.run.smithi045.stdout: -9419> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000520) pop_and_dirty_projected_inode v5624 2023-10-03T19:21:06.872 INFO:teuthology.orchestra.run.smithi045.stdout: -9418> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000520) mark_dirty [inode 0x10000000520 [2,head] /dc-dir/dc-file_811 auth v5624 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.181641+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535609b80] 2023-10-03T19:21:06.872 INFO:teuthology.orchestra.run.smithi045.stdout: -9417> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_811) mark_dirty [dentry #0x1/dc-dir/dc-file_811 [2,head] auth (dversion lock) pv=5624 v=3990 ino=0x10000000520 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535605400] 2023-10-03T19:21:06.873 INFO:teuthology.orchestra.run.smithi045.stdout: -9416> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5623 cv=5377/5377 ap=190+189 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=124 | child=1 dirty=1 authpin=1 0x565534f82400] version 5623 2023-10-03T19:21:06.873 INFO:teuthology.orchestra.run.smithi045.stdout: -9415> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x5655354697c0 v5632 2023-10-03T19:21:06.873 INFO:teuthology.orchestra.run.smithi045.stdout: -9414> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5632 cv=5384/5384 REP dir_auth=0 ap=189+190 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5632 2023-10-03T19:21:06.873 INFO:teuthology.orchestra.run.smithi045.stdout: -9413> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655354696a0 v5625 2023-10-03T19:21:06.873 INFO:teuthology.orchestra.run.smithi045.stdout: -9412> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5625 cv=5377/5377 ap=190+189 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=124 | child=1 dirty=1 authpin=1 0x565534f82400] version 5625 2023-10-03T19:21:06.912 INFO:teuthology.orchestra.run.smithi045.stdout: -9411> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=189 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=189 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:06.913 INFO:teuthology.orchestra.run.smithi045.stdout: -9410> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=189) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5631 pv6007 ap=190 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=190) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=189) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.913 INFO:teuthology.orchestra.run.smithi045.stdout: -9409> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=190) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5631 pv6007 ap=190 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=190) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=188) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.913 INFO:teuthology.orchestra.run.smithi045.stdout: -9408> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000520 [2,head] /dc-dir/dc-file_811 auth v5624 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.181641+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535609b80] 2023-10-03T19:21:06.913 INFO:teuthology.orchestra.run.smithi045.stdout: -9407> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000520 [2,head] /dc-dir/dc-file_811 auth v5624 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.181641+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535609b80] 2023-10-03T19:21:06.913 INFO:teuthology.orchestra.run.smithi045.stdout: -9406> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:06.913 INFO:teuthology.orchestra.run.smithi045.stdout: -9405> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:06.913 INFO:teuthology.orchestra.run.smithi045.stdout: -9404> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:06.913 INFO:teuthology.orchestra.run.smithi045.stdout: -9403> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000520 [2,head] /dc-dir/dc-file_811 auth v5624 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.181641+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535609b80] 2023-10-03T19:21:06.913 INFO:teuthology.orchestra.run.smithi045.stdout: -9402> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000520 [2,head] /dc-dir/dc-file_811 auth v5624 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.181641+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535609b80] 2023-10-03T19:21:06.914 INFO:teuthology.orchestra.run.smithi045.stdout: -9401> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:06.914 INFO:teuthology.orchestra.run.smithi045.stdout: -9400> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 540.959, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.41e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1084.7] 2023-10-03T19:21:06.914 INFO:teuthology.orchestra.run.smithi045.stdout: -9399> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655354b78c0 on [dir 0x1 / [2,head] auth pv=6008 v=5632 cv=5384/5384 REP dir_auth=0 ap=188+190 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 188 2023-10-03T19:21:06.914 INFO:teuthology.orchestra.run.smithi045.stdout: -9398> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655354b78c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5631 pv6007 ap=189 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=189) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=188) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 189 2023-10-03T19:21:06.914 INFO:teuthology.orchestra.run.smithi045.stdout: -9397> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5632 cv=5384/5384 REP dir_auth=0 ap=188+189 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655354b78c0 count now 188/189 2023-10-03T19:21:06.914 INFO:teuthology.orchestra.run.smithi045.stdout: -9396> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655354b78c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5625 cv=5377/5377 ap=189+189 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=124 | child=1 dirty=1 authpin=1 0x565534f82400] count now 189 2023-10-03T19:21:06.914 INFO:teuthology.orchestra.run.smithi045.stdout: -9395> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000520) auth_unpin by 0x5655354b78c0 on [inode 0x10000000520 [2,head] /dc-dir/dc-file_811 auth v5624 s=3 n(v0 rc2023-10-03T19:17:08.181641+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535609b80] now 0 2023-10-03T19:21:06.914 INFO:teuthology.orchestra.run.smithi045.stdout: -9394> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5625 cv=5377/5377 ap=189+188 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=124 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655354b78c0 count now 189/188 2023-10-03T19:21:06.915 INFO:teuthology.orchestra.run.smithi045.stdout: -9393> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.915 INFO:teuthology.orchestra.run.smithi045.stdout: -9392> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.915 INFO:teuthology.orchestra.run.smithi045.stdout: -9391> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000521 [2,head] /dc-dir/dc-file_812 auth v3994 pv5626 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.193974+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.193974+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553560a100] 2023-10-03T19:21:06.915 INFO:teuthology.orchestra.run.smithi045.stdout: -9390> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5633 2023-10-03T19:21:06.915 INFO:teuthology.orchestra.run.smithi045.stdout: -9389> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5633 pv6007 ap=189 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=189) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=188) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.915 INFO:teuthology.orchestra.run.smithi045.stdout: -9388> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5631 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:06.915 INFO:teuthology.orchestra.run.smithi045.stdout: -9387> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5632 cv=5384/5384 REP dir_auth=0 ap=188+189 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5632 2023-10-03T19:21:06.915 INFO:teuthology.orchestra.run.smithi045.stdout: -9386> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000521) pop_and_dirty_projected_inode v5626 2023-10-03T19:21:06.916 INFO:teuthology.orchestra.run.smithi045.stdout: -9385> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000521) mark_dirty [inode 0x10000000521 [2,head] /dc-dir/dc-file_812 auth v5626 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.193974+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553560a100] 2023-10-03T19:21:06.916 INFO:teuthology.orchestra.run.smithi045.stdout: -9384> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_812) mark_dirty [dentry #0x1/dc-dir/dc-file_812 [2,head] auth (dversion lock) pv=5626 v=3994 ino=0x10000000521 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535605680] 2023-10-03T19:21:06.916 INFO:teuthology.orchestra.run.smithi045.stdout: -9383> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5625 cv=5377/5377 ap=189+188 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=125 | child=1 dirty=1 authpin=1 0x565534f82400] version 5625 2023-10-03T19:21:06.916 INFO:teuthology.orchestra.run.smithi045.stdout: -9382> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535469a00 v5634 2023-10-03T19:21:06.916 INFO:teuthology.orchestra.run.smithi045.stdout: -9381> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5634 cv=5384/5384 REP dir_auth=0 ap=188+189 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5634 2023-10-03T19:21:06.916 INFO:teuthology.orchestra.run.smithi045.stdout: -9380> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655354698e0 v5627 2023-10-03T19:21:06.916 INFO:teuthology.orchestra.run.smithi045.stdout: -9379> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5627 cv=5377/5377 ap=189+188 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=125 | child=1 dirty=1 authpin=1 0x565534f82400] version 5627 2023-10-03T19:21:06.916 INFO:teuthology.orchestra.run.smithi045.stdout: -9378> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=188 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=188 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:06.916 INFO:teuthology.orchestra.run.smithi045.stdout: -9377> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=188) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5633 pv6007 ap=189 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=189) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=188) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.916 INFO:teuthology.orchestra.run.smithi045.stdout: -9376> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=189) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5633 pv6007 ap=189 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=189) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=187) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.917 INFO:teuthology.orchestra.run.smithi045.stdout: -9375> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000521 [2,head] /dc-dir/dc-file_812 auth v5626 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.193974+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553560a100] 2023-10-03T19:21:06.917 INFO:teuthology.orchestra.run.smithi045.stdout: -9374> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000521 [2,head] /dc-dir/dc-file_812 auth v5626 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.193974+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553560a100] 2023-10-03T19:21:06.917 INFO:teuthology.orchestra.run.smithi045.stdout: -9373> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:06.917 INFO:teuthology.orchestra.run.smithi045.stdout: -9372> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:06.917 INFO:teuthology.orchestra.run.smithi045.stdout: -9371> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:06.917 INFO:teuthology.orchestra.run.smithi045.stdout: -9370> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000521 [2,head] /dc-dir/dc-file_812 auth v5626 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.193974+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553560a100] 2023-10-03T19:21:06.917 INFO:teuthology.orchestra.run.smithi045.stdout: -9369> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000521 [2,head] /dc-dir/dc-file_812 auth v5626 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.193974+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553560a100] 2023-10-03T19:21:06.917 INFO:teuthology.orchestra.run.smithi045.stdout: -9368> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:06.917 INFO:teuthology.orchestra.run.smithi045.stdout: -9367> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 541.959, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.42e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1086.7] 2023-10-03T19:21:06.918 INFO:teuthology.orchestra.run.smithi045.stdout: -9366> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535429d40 on [dir 0x1 / [2,head] auth pv=6008 v=5634 cv=5384/5384 REP dir_auth=0 ap=187+189 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 187 2023-10-03T19:21:06.918 INFO:teuthology.orchestra.run.smithi045.stdout: -9365> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535429d40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5633 pv6007 ap=188 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=188) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=187) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 188 2023-10-03T19:21:06.918 INFO:teuthology.orchestra.run.smithi045.stdout: -9364> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5634 cv=5384/5384 REP dir_auth=0 ap=187+188 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535429d40 count now 187/188 2023-10-03T19:21:06.918 INFO:teuthology.orchestra.run.smithi045.stdout: -9363> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535429d40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5627 cv=5377/5377 ap=188+188 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=125 | child=1 dirty=1 authpin=1 0x565534f82400] count now 188 2023-10-03T19:21:06.918 INFO:teuthology.orchestra.run.smithi045.stdout: -9362> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000521) auth_unpin by 0x565535429d40 on [inode 0x10000000521 [2,head] /dc-dir/dc-file_812 auth v5626 s=3 n(v0 rc2023-10-03T19:17:08.193974+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553560a100] now 0 2023-10-03T19:21:06.918 INFO:teuthology.orchestra.run.smithi045.stdout: -9361> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5627 cv=5377/5377 ap=188+187 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=125 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535429d40 count now 188/187 2023-10-03T19:21:06.918 INFO:teuthology.orchestra.run.smithi045.stdout: -9360> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.918 INFO:teuthology.orchestra.run.smithi045.stdout: -9359> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.919 INFO:teuthology.orchestra.run.smithi045.stdout: -9358> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000522 [2,head] /dc-dir/dc-file_813 auth v3998 pv5628 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.205686+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.205686+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553560a680] 2023-10-03T19:21:06.919 INFO:teuthology.orchestra.run.smithi045.stdout: -9357> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5635 2023-10-03T19:21:06.919 INFO:teuthology.orchestra.run.smithi045.stdout: -9356> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5635 pv6007 ap=188 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=188) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=187) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.919 INFO:teuthology.orchestra.run.smithi045.stdout: -9355> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5633 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:06.919 INFO:teuthology.orchestra.run.smithi045.stdout: -9354> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5634 cv=5384/5384 REP dir_auth=0 ap=187+188 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5634 2023-10-03T19:21:06.919 INFO:teuthology.orchestra.run.smithi045.stdout: -9353> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000522) pop_and_dirty_projected_inode v5628 2023-10-03T19:21:06.919 INFO:teuthology.orchestra.run.smithi045.stdout: -9352> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000522) mark_dirty [inode 0x10000000522 [2,head] /dc-dir/dc-file_813 auth v5628 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.205686+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553560a680] 2023-10-03T19:21:06.919 INFO:teuthology.orchestra.run.smithi045.stdout: -9351> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_813) mark_dirty [dentry #0x1/dc-dir/dc-file_813 [2,head] auth (dversion lock) pv=5628 v=3998 ino=0x10000000522 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535605900] 2023-10-03T19:21:06.919 INFO:teuthology.orchestra.run.smithi045.stdout: -9350> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5627 cv=5377/5377 ap=188+187 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=126 | child=1 dirty=1 authpin=1 0x565534f82400] version 5627 2023-10-03T19:21:06.919 INFO:teuthology.orchestra.run.smithi045.stdout: -9349> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535469c40 v5636 2023-10-03T19:21:06.920 INFO:teuthology.orchestra.run.smithi045.stdout: -9348> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5636 cv=5384/5384 REP dir_auth=0 ap=187+188 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5636 2023-10-03T19:21:06.936 INFO:teuthology.orchestra.run.smithi045.stdout: -9347> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535469b20 v5629 2023-10-03T19:21:06.936 INFO:teuthology.orchestra.run.smithi045.stdout: -9346> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5629 cv=5377/5377 ap=188+187 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=126 | child=1 dirty=1 authpin=1 0x565534f82400] version 5629 2023-10-03T19:21:06.936 INFO:teuthology.orchestra.run.smithi045.stdout: -9345> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=187 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=187 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:06.936 INFO:teuthology.orchestra.run.smithi045.stdout: -9344> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=187) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5635 pv6007 ap=188 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=188) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=187) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.936 INFO:teuthology.orchestra.run.smithi045.stdout: -9343> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=188) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5635 pv6007 ap=188 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=188) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=186) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.937 INFO:teuthology.orchestra.run.smithi045.stdout: -9342> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000522 [2,head] /dc-dir/dc-file_813 auth v5628 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.205686+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553560a680] 2023-10-03T19:21:06.937 INFO:teuthology.orchestra.run.smithi045.stdout: -9341> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000522 [2,head] /dc-dir/dc-file_813 auth v5628 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.205686+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553560a680] 2023-10-03T19:21:06.937 INFO:teuthology.orchestra.run.smithi045.stdout: -9340> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:06.937 INFO:teuthology.orchestra.run.smithi045.stdout: -9339> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:06.937 INFO:teuthology.orchestra.run.smithi045.stdout: -9338> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:06.937 INFO:teuthology.orchestra.run.smithi045.stdout: -9337> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000522 [2,head] /dc-dir/dc-file_813 auth v5628 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.205686+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553560a680] 2023-10-03T19:21:06.938 INFO:teuthology.orchestra.run.smithi045.stdout: -9336> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000522 [2,head] /dc-dir/dc-file_813 auth v5628 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.205686+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553560a680] 2023-10-03T19:21:06.938 INFO:teuthology.orchestra.run.smithi045.stdout: -9335> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:06.938 INFO:teuthology.orchestra.run.smithi045.stdout: -9334> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 542.959, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.43e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1088.7] 2023-10-03T19:21:06.938 INFO:teuthology.orchestra.run.smithi045.stdout: -9333> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535439440 on [dir 0x1 / [2,head] auth pv=6008 v=5636 cv=5384/5384 REP dir_auth=0 ap=186+188 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 186 2023-10-03T19:21:06.938 INFO:teuthology.orchestra.run.smithi045.stdout: -9332> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535439440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5635 pv6007 ap=187 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=187) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=186) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 187 2023-10-03T19:21:06.939 INFO:teuthology.orchestra.run.smithi045.stdout: -9331> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5636 cv=5384/5384 REP dir_auth=0 ap=186+187 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535439440 count now 186/187 2023-10-03T19:21:06.939 INFO:teuthology.orchestra.run.smithi045.stdout: -9330> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535439440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5629 cv=5377/5377 ap=187+187 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=126 | child=1 dirty=1 authpin=1 0x565534f82400] count now 187 2023-10-03T19:21:06.939 INFO:teuthology.orchestra.run.smithi045.stdout: -9329> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000522) auth_unpin by 0x565535439440 on [inode 0x10000000522 [2,head] /dc-dir/dc-file_813 auth v5628 s=3 n(v0 rc2023-10-03T19:17:08.205686+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553560a680] now 0 2023-10-03T19:21:06.939 INFO:teuthology.orchestra.run.smithi045.stdout: -9328> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5629 cv=5377/5377 ap=187+186 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=126 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535439440 count now 187/186 2023-10-03T19:21:06.939 INFO:teuthology.orchestra.run.smithi045.stdout: -9327> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.939 INFO:teuthology.orchestra.run.smithi045.stdout: -9326> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:06.939 INFO:teuthology.orchestra.run.smithi045.stdout: -9325> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000523 [2,head] /dc-dir/dc-file_814 auth v4002 pv5630 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.217390+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.217390+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553560ac00] 2023-10-03T19:21:06.939 INFO:teuthology.orchestra.run.smithi045.stdout: -9324> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5637 2023-10-03T19:21:06.939 INFO:teuthology.orchestra.run.smithi045.stdout: -9323> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5637 pv6007 ap=187 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=187) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=186) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:06.939 INFO:teuthology.orchestra.run.smithi045.stdout: -9322> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5635 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:06.940 INFO:teuthology.orchestra.run.smithi045.stdout: -9321> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5636 cv=5384/5384 REP dir_auth=0 ap=186+187 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5636 2023-10-03T19:21:07.028 INFO:teuthology.orchestra.run.smithi045.stdout: -9320> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000523) pop_and_dirty_projected_inode v5630 2023-10-03T19:21:07.028 INFO:teuthology.orchestra.run.smithi045.stdout: -9319> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000523) mark_dirty [inode 0x10000000523 [2,head] /dc-dir/dc-file_814 auth v5630 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.217390+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553560ac00] 2023-10-03T19:21:07.028 INFO:teuthology.orchestra.run.smithi045.stdout: -9318> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_814) mark_dirty [dentry #0x1/dc-dir/dc-file_814 [2,head] auth (dversion lock) pv=5630 v=4002 ino=0x10000000523 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535605b80] 2023-10-03T19:21:07.028 INFO:teuthology.orchestra.run.smithi045.stdout: -9317> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5629 cv=5377/5377 ap=187+186 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=127 | child=1 dirty=1 authpin=1 0x565534f82400] version 5629 2023-10-03T19:21:07.028 INFO:teuthology.orchestra.run.smithi045.stdout: -9316> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535469e80 v5638 2023-10-03T19:21:07.028 INFO:teuthology.orchestra.run.smithi045.stdout: -9315> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5638 cv=5384/5384 REP dir_auth=0 ap=186+187 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5638 2023-10-03T19:21:07.028 INFO:teuthology.orchestra.run.smithi045.stdout: -9314> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535469d60 v5631 2023-10-03T19:21:07.028 INFO:teuthology.orchestra.run.smithi045.stdout: -9313> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5631 cv=5377/5377 ap=187+186 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=127 | child=1 dirty=1 authpin=1 0x565534f82400] version 5631 2023-10-03T19:21:07.029 INFO:teuthology.orchestra.run.smithi045.stdout: -9312> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=186 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=186 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.029 INFO:teuthology.orchestra.run.smithi045.stdout: -9311> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=186) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5637 pv6007 ap=187 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=187) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=186) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.029 INFO:teuthology.orchestra.run.smithi045.stdout: -9310> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=187) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5637 pv6007 ap=187 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=187) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=185) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.029 INFO:teuthology.orchestra.run.smithi045.stdout: -9309> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000523 [2,head] /dc-dir/dc-file_814 auth v5630 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.217390+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553560ac00] 2023-10-03T19:21:07.029 INFO:teuthology.orchestra.run.smithi045.stdout: -9308> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000523 [2,head] /dc-dir/dc-file_814 auth v5630 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.217390+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553560ac00] 2023-10-03T19:21:07.029 INFO:teuthology.orchestra.run.smithi045.stdout: -9307> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.029 INFO:teuthology.orchestra.run.smithi045.stdout: -9306> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.029 INFO:teuthology.orchestra.run.smithi045.stdout: -9305> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.029 INFO:teuthology.orchestra.run.smithi045.stdout: -9304> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000523 [2,head] /dc-dir/dc-file_814 auth v5630 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.217390+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553560ac00] 2023-10-03T19:21:07.029 INFO:teuthology.orchestra.run.smithi045.stdout: -9303> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000523 [2,head] /dc-dir/dc-file_814 auth v5630 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.217390+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553560ac00] 2023-10-03T19:21:07.030 INFO:teuthology.orchestra.run.smithi045.stdout: -9302> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.030 INFO:teuthology.orchestra.run.smithi045.stdout: -9301> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 543.959, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.44e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1090.7] 2023-10-03T19:21:07.030 INFO:teuthology.orchestra.run.smithi045.stdout: -9300> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x56553541a240 on [dir 0x1 / [2,head] auth pv=6008 v=5638 cv=5384/5384 REP dir_auth=0 ap=185+187 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 185 2023-10-03T19:21:07.030 INFO:teuthology.orchestra.run.smithi045.stdout: -9299> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x56553541a240 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5637 pv6007 ap=186 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=186) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=185) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 186 2023-10-03T19:21:07.030 INFO:teuthology.orchestra.run.smithi045.stdout: -9298> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5638 cv=5384/5384 REP dir_auth=0 ap=185+186 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x56553541a240 count now 185/186 2023-10-03T19:21:07.030 INFO:teuthology.orchestra.run.smithi045.stdout: -9297> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x56553541a240 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5631 cv=5377/5377 ap=186+186 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=127 | child=1 dirty=1 authpin=1 0x565534f82400] count now 186 2023-10-03T19:21:07.030 INFO:teuthology.orchestra.run.smithi045.stdout: -9296> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000523) auth_unpin by 0x56553541a240 on [inode 0x10000000523 [2,head] /dc-dir/dc-file_814 auth v5630 s=3 n(v0 rc2023-10-03T19:17:08.217390+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553560ac00] now 0 2023-10-03T19:21:07.030 INFO:teuthology.orchestra.run.smithi045.stdout: -9295> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5631 cv=5377/5377 ap=186+185 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=127 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x56553541a240 count now 186/185 2023-10-03T19:21:07.031 INFO:teuthology.orchestra.run.smithi045.stdout: -9294> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.031 INFO:teuthology.orchestra.run.smithi045.stdout: -9293> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.031 INFO:teuthology.orchestra.run.smithi045.stdout: -9292> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000524 [2,head] /dc-dir/dc-file_815 auth v4006 pv5632 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.228899+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.228899+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553560b180] 2023-10-03T19:21:07.031 INFO:teuthology.orchestra.run.smithi045.stdout: -9291> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5639 2023-10-03T19:21:07.031 INFO:teuthology.orchestra.run.smithi045.stdout: -9290> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5639 pv6007 ap=186 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=186) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=185) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.031 INFO:teuthology.orchestra.run.smithi045.stdout: -9289> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5637 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.031 INFO:teuthology.orchestra.run.smithi045.stdout: -9288> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5638 cv=5384/5384 REP dir_auth=0 ap=185+186 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5638 2023-10-03T19:21:07.031 INFO:teuthology.orchestra.run.smithi045.stdout: -9287> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000524) pop_and_dirty_projected_inode v5632 2023-10-03T19:21:07.031 INFO:teuthology.orchestra.run.smithi045.stdout: -9286> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000524) mark_dirty [inode 0x10000000524 [2,head] /dc-dir/dc-file_815 auth v5632 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.228899+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553560b180] 2023-10-03T19:21:07.031 INFO:teuthology.orchestra.run.smithi045.stdout: -9285> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_815) mark_dirty [dentry #0x1/dc-dir/dc-file_815 [2,head] auth (dversion lock) pv=5632 v=4006 ino=0x10000000524 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553560e000] 2023-10-03T19:21:07.031 INFO:teuthology.orchestra.run.smithi045.stdout: -9284> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5631 cv=5377/5377 ap=186+185 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=128 | child=1 dirty=1 authpin=1 0x565534f82400] version 5631 2023-10-03T19:21:07.032 INFO:teuthology.orchestra.run.smithi045.stdout: -9283> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536aa6140 v5640 2023-10-03T19:21:07.032 INFO:teuthology.orchestra.run.smithi045.stdout: -9282> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5640 cv=5384/5384 REP dir_auth=0 ap=185+186 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5640 2023-10-03T19:21:07.032 INFO:teuthology.orchestra.run.smithi045.stdout: -9281> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536aa6020 v5633 2023-10-03T19:21:07.032 INFO:teuthology.orchestra.run.smithi045.stdout: -9280> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5633 cv=5377/5377 ap=186+185 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=128 | child=1 dirty=1 authpin=1 0x565534f82400] version 5633 2023-10-03T19:21:07.073 INFO:teuthology.orchestra.run.smithi045.stdout: -9279> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=185 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=185 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.073 INFO:teuthology.orchestra.run.smithi045.stdout: -9278> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=185) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5639 pv6007 ap=186 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=186) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=185) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.073 INFO:teuthology.orchestra.run.smithi045.stdout: -9277> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=186) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5639 pv6007 ap=186 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=186) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=184) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.073 INFO:teuthology.orchestra.run.smithi045.stdout: -9276> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000524 [2,head] /dc-dir/dc-file_815 auth v5632 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.228899+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553560b180] 2023-10-03T19:21:07.073 INFO:teuthology.orchestra.run.smithi045.stdout: -9275> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000524 [2,head] /dc-dir/dc-file_815 auth v5632 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.228899+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553560b180] 2023-10-03T19:21:07.073 INFO:teuthology.orchestra.run.smithi045.stdout: -9274> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.073 INFO:teuthology.orchestra.run.smithi045.stdout: -9273> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.074 INFO:teuthology.orchestra.run.smithi045.stdout: -9272> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.074 INFO:teuthology.orchestra.run.smithi045.stdout: -9271> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000524 [2,head] /dc-dir/dc-file_815 auth v5632 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.228899+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553560b180] 2023-10-03T19:21:07.074 INFO:teuthology.orchestra.run.smithi045.stdout: -9270> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000524 [2,head] /dc-dir/dc-file_815 auth v5632 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.228899+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553560b180] 2023-10-03T19:21:07.074 INFO:teuthology.orchestra.run.smithi045.stdout: -9269> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.074 INFO:teuthology.orchestra.run.smithi045.stdout: -9268> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 544.959, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.45e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1092.7] 2023-10-03T19:21:07.074 INFO:teuthology.orchestra.run.smithi045.stdout: -9267> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655354b6fc0 on [dir 0x1 / [2,head] auth pv=6008 v=5640 cv=5384/5384 REP dir_auth=0 ap=184+186 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 184 2023-10-03T19:21:07.074 INFO:teuthology.orchestra.run.smithi045.stdout: -9266> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655354b6fc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5639 pv6007 ap=185 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=185) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=184) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 185 2023-10-03T19:21:07.074 INFO:teuthology.orchestra.run.smithi045.stdout: -9265> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5640 cv=5384/5384 REP dir_auth=0 ap=184+185 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655354b6fc0 count now 184/185 2023-10-03T19:21:07.074 INFO:teuthology.orchestra.run.smithi045.stdout: -9264> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655354b6fc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5633 cv=5377/5377 ap=185+185 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=128 | child=1 dirty=1 authpin=1 0x565534f82400] count now 185 2023-10-03T19:21:07.074 INFO:teuthology.orchestra.run.smithi045.stdout: -9263> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000524) auth_unpin by 0x5655354b6fc0 on [inode 0x10000000524 [2,head] /dc-dir/dc-file_815 auth v5632 s=3 n(v0 rc2023-10-03T19:17:08.228899+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553560b180] now 0 2023-10-03T19:21:07.075 INFO:teuthology.orchestra.run.smithi045.stdout: -9262> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5633 cv=5377/5377 ap=185+184 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=128 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655354b6fc0 count now 185/184 2023-10-03T19:21:07.075 INFO:teuthology.orchestra.run.smithi045.stdout: -9261> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.075 INFO:teuthology.orchestra.run.smithi045.stdout: -9260> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.075 INFO:teuthology.orchestra.run.smithi045.stdout: -9259> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000525 [2,head] /dc-dir/dc-file_816 auth v4010 pv5634 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.240739+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.240739+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553560b700] 2023-10-03T19:21:07.075 INFO:teuthology.orchestra.run.smithi045.stdout: -9258> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5641 2023-10-03T19:21:07.075 INFO:teuthology.orchestra.run.smithi045.stdout: -9257> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5641 pv6007 ap=185 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=185) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=184) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.075 INFO:teuthology.orchestra.run.smithi045.stdout: -9256> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5639 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.075 INFO:teuthology.orchestra.run.smithi045.stdout: -9255> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5640 cv=5384/5384 REP dir_auth=0 ap=184+185 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5640 2023-10-03T19:21:07.075 INFO:teuthology.orchestra.run.smithi045.stdout: -9254> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000525) pop_and_dirty_projected_inode v5634 2023-10-03T19:21:07.075 INFO:teuthology.orchestra.run.smithi045.stdout: -9253> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000525) mark_dirty [inode 0x10000000525 [2,head] /dc-dir/dc-file_816 auth v5634 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.240739+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553560b700] 2023-10-03T19:21:07.075 INFO:teuthology.orchestra.run.smithi045.stdout: -9252> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_816) mark_dirty [dentry #0x1/dc-dir/dc-file_816 [2,head] auth (dversion lock) pv=5634 v=4010 ino=0x10000000525 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553560e280] 2023-10-03T19:21:07.076 INFO:teuthology.orchestra.run.smithi045.stdout: -9251> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5633 cv=5377/5377 ap=185+184 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=129 | child=1 dirty=1 authpin=1 0x565534f82400] version 5633 2023-10-03T19:21:07.076 INFO:teuthology.orchestra.run.smithi045.stdout: -9250> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536aa6380 v5642 2023-10-03T19:21:07.076 INFO:teuthology.orchestra.run.smithi045.stdout: -9249> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5642 cv=5384/5384 REP dir_auth=0 ap=184+185 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5642 2023-10-03T19:21:07.076 INFO:teuthology.orchestra.run.smithi045.stdout: -9248> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536aa6260 v5635 2023-10-03T19:21:07.076 INFO:teuthology.orchestra.run.smithi045.stdout: -9247> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5635 cv=5377/5377 ap=185+184 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=129 | child=1 dirty=1 authpin=1 0x565534f82400] version 5635 2023-10-03T19:21:07.076 INFO:teuthology.orchestra.run.smithi045.stdout: -9246> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=184 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=184 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.076 INFO:teuthology.orchestra.run.smithi045.stdout: -9245> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=184) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5641 pv6007 ap=185 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=185) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=184) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.076 INFO:teuthology.orchestra.run.smithi045.stdout: -9244> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=185) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5641 pv6007 ap=185 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=185) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=183) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.076 INFO:teuthology.orchestra.run.smithi045.stdout: -9243> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000525 [2,head] /dc-dir/dc-file_816 auth v5634 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.240739+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553560b700] 2023-10-03T19:21:07.076 INFO:teuthology.orchestra.run.smithi045.stdout: -9242> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000525 [2,head] /dc-dir/dc-file_816 auth v5634 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.240739+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553560b700] 2023-10-03T19:21:07.077 INFO:teuthology.orchestra.run.smithi045.stdout: -9241> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.077 INFO:teuthology.orchestra.run.smithi045.stdout: -9240> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.077 INFO:teuthology.orchestra.run.smithi045.stdout: -9239> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.077 INFO:teuthology.orchestra.run.smithi045.stdout: -9238> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000525 [2,head] /dc-dir/dc-file_816 auth v5634 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.240739+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553560b700] 2023-10-03T19:21:07.077 INFO:teuthology.orchestra.run.smithi045.stdout: -9237> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000525 [2,head] /dc-dir/dc-file_816 auth v5634 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.240739+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553560b700] 2023-10-03T19:21:07.077 INFO:teuthology.orchestra.run.smithi045.stdout: -9236> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.077 INFO:teuthology.orchestra.run.smithi045.stdout: -9235> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 545.959, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.46e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1094.7] 2023-10-03T19:21:07.077 INFO:teuthology.orchestra.run.smithi045.stdout: -9234> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565534fd6000 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5641 pv6007 ap=184 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=184) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=183) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 184 2023-10-03T19:21:07.077 INFO:teuthology.orchestra.run.smithi045.stdout: -9233> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5642 cv=5384/5384 REP dir_auth=0 ap=184+184 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565534fd6000 count now 184/184 2023-10-03T19:21:07.077 INFO:teuthology.orchestra.run.smithi045.stdout: -9232> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565534fd6000 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5635 cv=5377/5377 ap=184+184 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=129 | child=1 dirty=1 authpin=1 0x565534f82400] count now 184 2023-10-03T19:21:07.078 INFO:teuthology.orchestra.run.smithi045.stdout: -9231> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565534fd6000 on [dir 0x1 / [2,head] auth pv=6008 v=5642 cv=5384/5384 REP dir_auth=0 ap=183+184 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 183 2023-10-03T19:21:07.078 INFO:teuthology.orchestra.run.smithi045.stdout: -9230> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000525) auth_unpin by 0x565534fd6000 on [inode 0x10000000525 [2,head] /dc-dir/dc-file_816 auth v5634 s=3 n(v0 rc2023-10-03T19:17:08.240739+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553560b700] now 0 2023-10-03T19:21:07.078 INFO:teuthology.orchestra.run.smithi045.stdout: -9229> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5635 cv=5377/5377 ap=184+183 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=129 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565534fd6000 count now 184/183 2023-10-03T19:21:07.078 INFO:teuthology.orchestra.run.smithi045.stdout: -9228> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.078 INFO:teuthology.orchestra.run.smithi045.stdout: -9227> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.078 INFO:teuthology.orchestra.run.smithi045.stdout: -9226> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000526 [2,head] /dc-dir/dc-file_817 auth v4014 pv5636 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.252019+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.252019+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535614000] 2023-10-03T19:21:07.078 INFO:teuthology.orchestra.run.smithi045.stdout: -9225> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5643 2023-10-03T19:21:07.078 INFO:teuthology.orchestra.run.smithi045.stdout: -9224> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5643 pv6007 ap=184 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=184) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=183) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.078 INFO:teuthology.orchestra.run.smithi045.stdout: -9223> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5641 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.079 INFO:teuthology.orchestra.run.smithi045.stdout: -9222> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5642 cv=5384/5384 REP dir_auth=0 ap=183+184 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5642 2023-10-03T19:21:07.079 INFO:teuthology.orchestra.run.smithi045.stdout: -9221> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000526) pop_and_dirty_projected_inode v5636 2023-10-03T19:21:07.079 INFO:teuthology.orchestra.run.smithi045.stdout: -9220> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000526) mark_dirty [inode 0x10000000526 [2,head] /dc-dir/dc-file_817 auth v5636 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.252019+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535614000] 2023-10-03T19:21:07.079 INFO:teuthology.orchestra.run.smithi045.stdout: -9219> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_817) mark_dirty [dentry #0x1/dc-dir/dc-file_817 [2,head] auth (dversion lock) pv=5636 v=4014 ino=0x10000000526 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553560e500] 2023-10-03T19:21:07.079 INFO:teuthology.orchestra.run.smithi045.stdout: -9218> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5635 cv=5377/5377 ap=184+183 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=130 | child=1 dirty=1 authpin=1 0x565534f82400] version 5635 2023-10-03T19:21:07.079 INFO:teuthology.orchestra.run.smithi045.stdout: -9217> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536aa65c0 v5644 2023-10-03T19:21:07.079 INFO:teuthology.orchestra.run.smithi045.stdout: -9216> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5644 cv=5384/5384 REP dir_auth=0 ap=183+184 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5644 2023-10-03T19:21:07.079 INFO:teuthology.orchestra.run.smithi045.stdout: -9215> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536aa64a0 v5637 2023-10-03T19:21:07.079 INFO:teuthology.orchestra.run.smithi045.stdout: -9214> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5637 cv=5377/5377 ap=184+183 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=130 | child=1 dirty=1 authpin=1 0x565534f82400] version 5637 2023-10-03T19:21:07.079 INFO:teuthology.orchestra.run.smithi045.stdout: -9213> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=183 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=183 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.080 INFO:teuthology.orchestra.run.smithi045.stdout: -9212> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=183) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5643 pv6007 ap=184 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=184) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=183) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.080 INFO:teuthology.orchestra.run.smithi045.stdout: -9211> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=184) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5643 pv6007 ap=184 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=184) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=182) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.080 INFO:teuthology.orchestra.run.smithi045.stdout: -9210> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000526 [2,head] /dc-dir/dc-file_817 auth v5636 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.252019+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535614000] 2023-10-03T19:21:07.080 INFO:teuthology.orchestra.run.smithi045.stdout: -9209> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000526 [2,head] /dc-dir/dc-file_817 auth v5636 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.252019+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535614000] 2023-10-03T19:21:07.080 INFO:teuthology.orchestra.run.smithi045.stdout: -9208> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.080 INFO:teuthology.orchestra.run.smithi045.stdout: -9207> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.080 INFO:teuthology.orchestra.run.smithi045.stdout: -9206> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.080 INFO:teuthology.orchestra.run.smithi045.stdout: -9205> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000526 [2,head] /dc-dir/dc-file_817 auth v5636 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.252019+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535614000] 2023-10-03T19:21:07.080 INFO:teuthology.orchestra.run.smithi045.stdout: -9204> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000526 [2,head] /dc-dir/dc-file_817 auth v5636 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.252019+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535614000] 2023-10-03T19:21:07.081 INFO:teuthology.orchestra.run.smithi045.stdout: -9203> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.081 INFO:teuthology.orchestra.run.smithi045.stdout: -9202> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 546.959, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.47e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1096.7] 2023-10-03T19:21:07.081 INFO:teuthology.orchestra.run.smithi045.stdout: -9201> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655352e8480 on [dir 0x1 / [2,head] auth pv=6008 v=5644 cv=5384/5384 REP dir_auth=0 ap=182+184 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 182 2023-10-03T19:21:07.081 INFO:teuthology.orchestra.run.smithi045.stdout: -9200> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655352e8480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5643 pv6007 ap=183 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=183) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=182) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 183 2023-10-03T19:21:07.081 INFO:teuthology.orchestra.run.smithi045.stdout: -9199> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5644 cv=5384/5384 REP dir_auth=0 ap=182+183 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655352e8480 count now 182/183 2023-10-03T19:21:07.081 INFO:teuthology.orchestra.run.smithi045.stdout: -9198> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655352e8480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5637 cv=5377/5377 ap=183+183 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=130 | child=1 dirty=1 authpin=1 0x565534f82400] count now 183 2023-10-03T19:21:07.081 INFO:teuthology.orchestra.run.smithi045.stdout: -9197> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000526) auth_unpin by 0x5655352e8480 on [inode 0x10000000526 [2,head] /dc-dir/dc-file_817 auth v5636 s=3 n(v0 rc2023-10-03T19:17:08.252019+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535614000] now 0 2023-10-03T19:21:07.081 INFO:teuthology.orchestra.run.smithi045.stdout: -9196> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5637 cv=5377/5377 ap=183+182 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=130 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655352e8480 count now 183/182 2023-10-03T19:21:07.081 INFO:teuthology.orchestra.run.smithi045.stdout: -9195> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.081 INFO:teuthology.orchestra.run.smithi045.stdout: -9194> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.081 INFO:teuthology.orchestra.run.smithi045.stdout: -9193> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000527 [2,head] /dc-dir/dc-file_818 auth v4018 pv5638 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.264369+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.264369+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535614580] 2023-10-03T19:21:07.081 INFO:teuthology.orchestra.run.smithi045.stdout: -9192> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5645 2023-10-03T19:21:07.082 INFO:teuthology.orchestra.run.smithi045.stdout: -9191> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5645 pv6007 ap=183 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=183) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=182) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.082 INFO:teuthology.orchestra.run.smithi045.stdout: -9190> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5643 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.082 INFO:teuthology.orchestra.run.smithi045.stdout: -9189> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5644 cv=5384/5384 REP dir_auth=0 ap=182+183 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5644 2023-10-03T19:21:07.082 INFO:teuthology.orchestra.run.smithi045.stdout: -9188> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000527) pop_and_dirty_projected_inode v5638 2023-10-03T19:21:07.082 INFO:teuthology.orchestra.run.smithi045.stdout: -9187> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000527) mark_dirty [inode 0x10000000527 [2,head] /dc-dir/dc-file_818 auth v5638 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.264369+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535614580] 2023-10-03T19:21:07.082 INFO:teuthology.orchestra.run.smithi045.stdout: -9186> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_818) mark_dirty [dentry #0x1/dc-dir/dc-file_818 [2,head] auth (dversion lock) pv=5638 v=4018 ino=0x10000000527 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553560e780] 2023-10-03T19:21:07.082 INFO:teuthology.orchestra.run.smithi045.stdout: -9185> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5637 cv=5377/5377 ap=183+182 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=131 | child=1 dirty=1 authpin=1 0x565534f82400] version 5637 2023-10-03T19:21:07.082 INFO:teuthology.orchestra.run.smithi045.stdout: -9184> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536aa6800 v5646 2023-10-03T19:21:07.082 INFO:teuthology.orchestra.run.smithi045.stdout: -9183> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5646 cv=5384/5384 REP dir_auth=0 ap=182+183 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5646 2023-10-03T19:21:07.082 INFO:teuthology.orchestra.run.smithi045.stdout: -9182> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536aa66e0 v5639 2023-10-03T19:21:07.083 INFO:teuthology.orchestra.run.smithi045.stdout: -9181> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5639 cv=5377/5377 ap=183+182 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=131 | child=1 dirty=1 authpin=1 0x565534f82400] version 5639 2023-10-03T19:21:07.083 INFO:teuthology.orchestra.run.smithi045.stdout: -9180> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=182 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=182 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.083 INFO:teuthology.orchestra.run.smithi045.stdout: -9179> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=182) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5645 pv6007 ap=183 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=183) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=182) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.083 INFO:teuthology.orchestra.run.smithi045.stdout: -9178> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=183) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5645 pv6007 ap=183 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=183) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=181) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.091 INFO:teuthology.orchestra.run.smithi045.stdout: -9177> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000527 [2,head] /dc-dir/dc-file_818 auth v5638 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.264369+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535614580] 2023-10-03T19:21:07.092 INFO:teuthology.orchestra.run.smithi045.stdout: -9176> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000527 [2,head] /dc-dir/dc-file_818 auth v5638 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.264369+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535614580] 2023-10-03T19:21:07.092 INFO:teuthology.orchestra.run.smithi045.stdout: -9175> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.092 INFO:teuthology.orchestra.run.smithi045.stdout: -9174> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.092 INFO:teuthology.orchestra.run.smithi045.stdout: -9173> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.092 INFO:teuthology.orchestra.run.smithi045.stdout: -9172> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000527 [2,head] /dc-dir/dc-file_818 auth v5638 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.264369+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535614580] 2023-10-03T19:21:07.092 INFO:teuthology.orchestra.run.smithi045.stdout: -9171> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000527 [2,head] /dc-dir/dc-file_818 auth v5638 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.264369+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535614580] 2023-10-03T19:21:07.092 INFO:teuthology.orchestra.run.smithi045.stdout: -9170> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.092 INFO:teuthology.orchestra.run.smithi045.stdout: -9169> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 547.959, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.48e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1098.7] 2023-10-03T19:21:07.092 INFO:teuthology.orchestra.run.smithi045.stdout: -9168> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x56553575c480 on [dir 0x1 / [2,head] auth pv=6008 v=5646 cv=5384/5384 REP dir_auth=0 ap=181+183 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 181 2023-10-03T19:21:07.092 INFO:teuthology.orchestra.run.smithi045.stdout: -9167> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x56553575c480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5645 pv6007 ap=182 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=182) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=181) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 182 2023-10-03T19:21:07.092 INFO:teuthology.orchestra.run.smithi045.stdout: -9166> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5646 cv=5384/5384 REP dir_auth=0 ap=181+182 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x56553575c480 count now 181/182 2023-10-03T19:21:07.093 INFO:teuthology.orchestra.run.smithi045.stdout: -9165> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x56553575c480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5639 cv=5377/5377 ap=182+182 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=131 | child=1 dirty=1 authpin=1 0x565534f82400] count now 182 2023-10-03T19:21:07.093 INFO:teuthology.orchestra.run.smithi045.stdout: -9164> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000527) auth_unpin by 0x56553575c480 on [inode 0x10000000527 [2,head] /dc-dir/dc-file_818 auth v5638 s=3 n(v0 rc2023-10-03T19:17:08.264369+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535614580] now 0 2023-10-03T19:21:07.093 INFO:teuthology.orchestra.run.smithi045.stdout: -9163> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5639 cv=5377/5377 ap=182+181 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=131 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x56553575c480 count now 182/181 2023-10-03T19:21:07.093 INFO:teuthology.orchestra.run.smithi045.stdout: -9162> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.093 INFO:teuthology.orchestra.run.smithi045.stdout: -9161> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.093 INFO:teuthology.orchestra.run.smithi045.stdout: -9160> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000528 [2,head] /dc-dir/dc-file_819 auth v4022 pv5640 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.277918+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.277918+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535614b00] 2023-10-03T19:21:07.093 INFO:teuthology.orchestra.run.smithi045.stdout: -9159> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5647 2023-10-03T19:21:07.093 INFO:teuthology.orchestra.run.smithi045.stdout: -9158> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5647 pv6007 ap=182 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=182) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=181) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.093 INFO:teuthology.orchestra.run.smithi045.stdout: -9157> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5645 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.094 INFO:teuthology.orchestra.run.smithi045.stdout: -9156> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5646 cv=5384/5384 REP dir_auth=0 ap=181+182 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5646 2023-10-03T19:21:07.094 INFO:teuthology.orchestra.run.smithi045.stdout: -9155> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000528) pop_and_dirty_projected_inode v5640 2023-10-03T19:21:07.094 INFO:teuthology.orchestra.run.smithi045.stdout: -9154> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000528) mark_dirty [inode 0x10000000528 [2,head] /dc-dir/dc-file_819 auth v5640 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.277918+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535614b00] 2023-10-03T19:21:07.094 INFO:teuthology.orchestra.run.smithi045.stdout: -9153> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_819) mark_dirty [dentry #0x1/dc-dir/dc-file_819 [2,head] auth (dversion lock) pv=5640 v=4022 ino=0x10000000528 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553560ea00] 2023-10-03T19:21:07.094 INFO:teuthology.orchestra.run.smithi045.stdout: -9152> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5639 cv=5377/5377 ap=182+181 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=132 | child=1 dirty=1 authpin=1 0x565534f82400] version 5639 2023-10-03T19:21:07.094 INFO:teuthology.orchestra.run.smithi045.stdout: -9151> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536aa6a40 v5648 2023-10-03T19:21:07.094 INFO:teuthology.orchestra.run.smithi045.stdout: -9150> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5648 cv=5384/5384 REP dir_auth=0 ap=181+182 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5648 2023-10-03T19:21:07.094 INFO:teuthology.orchestra.run.smithi045.stdout: -9149> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536aa6920 v5641 2023-10-03T19:21:07.094 INFO:teuthology.orchestra.run.smithi045.stdout: -9148> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5641 cv=5377/5377 ap=182+181 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=132 | child=1 dirty=1 authpin=1 0x565534f82400] version 5641 2023-10-03T19:21:07.094 INFO:teuthology.orchestra.run.smithi045.stdout: -9147> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=181 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=181 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.094 INFO:teuthology.orchestra.run.smithi045.stdout: -9146> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=181) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5647 pv6007 ap=182 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=182) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=181) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.095 INFO:teuthology.orchestra.run.smithi045.stdout: -9145> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=182) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5647 pv6007 ap=182 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=182) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=180) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.095 INFO:teuthology.orchestra.run.smithi045.stdout: -9144> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000528 [2,head] /dc-dir/dc-file_819 auth v5640 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.277918+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535614b00] 2023-10-03T19:21:07.095 INFO:teuthology.orchestra.run.smithi045.stdout: -9143> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000528 [2,head] /dc-dir/dc-file_819 auth v5640 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.277918+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535614b00] 2023-10-03T19:21:07.095 INFO:teuthology.orchestra.run.smithi045.stdout: -9142> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.095 INFO:teuthology.orchestra.run.smithi045.stdout: -9141> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.095 INFO:teuthology.orchestra.run.smithi045.stdout: -9140> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.095 INFO:teuthology.orchestra.run.smithi045.stdout: -9139> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000528 [2,head] /dc-dir/dc-file_819 auth v5640 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.277918+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535614b00] 2023-10-03T19:21:07.095 INFO:teuthology.orchestra.run.smithi045.stdout: -9138> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000528 [2,head] /dc-dir/dc-file_819 auth v5640 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.277918+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535614b00] 2023-10-03T19:21:07.095 INFO:teuthology.orchestra.run.smithi045.stdout: -9137> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.095 INFO:teuthology.orchestra.run.smithi045.stdout: -9136> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 548.959, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.49e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1100.7] 2023-10-03T19:21:07.095 INFO:teuthology.orchestra.run.smithi045.stdout: -9135> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x56553575dd40 on [dir 0x1 / [2,head] auth pv=6008 v=5648 cv=5384/5384 REP dir_auth=0 ap=180+182 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 180 2023-10-03T19:21:07.096 INFO:teuthology.orchestra.run.smithi045.stdout: -9134> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x56553575dd40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5647 pv6007 ap=181 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=181) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=180) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 181 2023-10-03T19:21:07.096 INFO:teuthology.orchestra.run.smithi045.stdout: -9133> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5648 cv=5384/5384 REP dir_auth=0 ap=180+181 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x56553575dd40 count now 180/181 2023-10-03T19:21:07.096 INFO:teuthology.orchestra.run.smithi045.stdout: -9132> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x56553575dd40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5641 cv=5377/5377 ap=181+181 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=132 | child=1 dirty=1 authpin=1 0x565534f82400] count now 181 2023-10-03T19:21:07.096 INFO:teuthology.orchestra.run.smithi045.stdout: -9131> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000528) auth_unpin by 0x56553575dd40 on [inode 0x10000000528 [2,head] /dc-dir/dc-file_819 auth v5640 s=3 n(v0 rc2023-10-03T19:17:08.277918+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535614b00] now 0 2023-10-03T19:21:07.096 INFO:teuthology.orchestra.run.smithi045.stdout: -9130> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5641 cv=5377/5377 ap=181+180 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=132 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x56553575dd40 count now 181/180 2023-10-03T19:21:07.096 INFO:teuthology.orchestra.run.smithi045.stdout: -9129> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.096 INFO:teuthology.orchestra.run.smithi045.stdout: -9128> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.096 INFO:teuthology.orchestra.run.smithi045.stdout: -9127> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000529 [2,head] /dc-dir/dc-file_820 auth v4026 pv5642 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.289621+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.289621+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535615080] 2023-10-03T19:21:07.096 INFO:teuthology.orchestra.run.smithi045.stdout: -9126> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5649 2023-10-03T19:21:07.096 INFO:teuthology.orchestra.run.smithi045.stdout: -9125> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5649 pv6007 ap=181 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=181) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=180) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.096 INFO:teuthology.orchestra.run.smithi045.stdout: -9124> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5647 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.097 INFO:teuthology.orchestra.run.smithi045.stdout: -9123> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5648 cv=5384/5384 REP dir_auth=0 ap=180+181 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5648 2023-10-03T19:21:07.097 INFO:teuthology.orchestra.run.smithi045.stdout: -9122> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000529) pop_and_dirty_projected_inode v5642 2023-10-03T19:21:07.097 INFO:teuthology.orchestra.run.smithi045.stdout: -9121> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000529) mark_dirty [inode 0x10000000529 [2,head] /dc-dir/dc-file_820 auth v5642 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.289621+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535615080] 2023-10-03T19:21:07.097 INFO:teuthology.orchestra.run.smithi045.stdout: -9120> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_820) mark_dirty [dentry #0x1/dc-dir/dc-file_820 [2,head] auth (dversion lock) pv=5642 v=4026 ino=0x10000000529 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553560ec80] 2023-10-03T19:21:07.097 INFO:teuthology.orchestra.run.smithi045.stdout: -9119> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5641 cv=5377/5377 ap=181+180 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=133 | child=1 dirty=1 authpin=1 0x565534f82400] version 5641 2023-10-03T19:21:07.097 INFO:teuthology.orchestra.run.smithi045.stdout: -9118> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536aa6c80 v5650 2023-10-03T19:21:07.097 INFO:teuthology.orchestra.run.smithi045.stdout: -9117> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5650 cv=5384/5384 REP dir_auth=0 ap=180+181 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5650 2023-10-03T19:21:07.097 INFO:teuthology.orchestra.run.smithi045.stdout: -9116> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536aa6b60 v5643 2023-10-03T19:21:07.097 INFO:teuthology.orchestra.run.smithi045.stdout: -9115> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5643 cv=5377/5377 ap=181+180 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=133 | child=1 dirty=1 authpin=1 0x565534f82400] version 5643 2023-10-03T19:21:07.097 INFO:teuthology.orchestra.run.smithi045.stdout: -9114> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=180 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=180 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.167 INFO:teuthology.orchestra.run.smithi045.stdout: -9113> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=180) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5649 pv6007 ap=181 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=181) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=180) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.167 INFO:teuthology.orchestra.run.smithi045.stdout: -9112> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=181) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5649 pv6007 ap=181 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=181) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=179) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.167 INFO:teuthology.orchestra.run.smithi045.stdout: -9111> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000529 [2,head] /dc-dir/dc-file_820 auth v5642 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.289621+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535615080] 2023-10-03T19:21:07.167 INFO:teuthology.orchestra.run.smithi045.stdout: -9110> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000529 [2,head] /dc-dir/dc-file_820 auth v5642 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.289621+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535615080] 2023-10-03T19:21:07.167 INFO:teuthology.orchestra.run.smithi045.stdout: -9109> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.168 INFO:teuthology.orchestra.run.smithi045.stdout: -9108> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.168 INFO:teuthology.orchestra.run.smithi045.stdout: -9107> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.168 INFO:teuthology.orchestra.run.smithi045.stdout: -9106> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000529 [2,head] /dc-dir/dc-file_820 auth v5642 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.289621+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535615080] 2023-10-03T19:21:07.168 INFO:teuthology.orchestra.run.smithi045.stdout: -9105> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000529 [2,head] /dc-dir/dc-file_820 auth v5642 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.289621+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535615080] 2023-10-03T19:21:07.168 INFO:teuthology.orchestra.run.smithi045.stdout: -9104> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.168 INFO:teuthology.orchestra.run.smithi045.stdout: -9103> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 549.959, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.50e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1102.7] 2023-10-03T19:21:07.168 INFO:teuthology.orchestra.run.smithi045.stdout: -9102> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565534fd7200 on [dir 0x1 / [2,head] auth pv=6008 v=5650 cv=5384/5384 REP dir_auth=0 ap=179+181 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 179 2023-10-03T19:21:07.168 INFO:teuthology.orchestra.run.smithi045.stdout: -9101> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565534fd7200 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5649 pv6007 ap=180 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=180) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=179) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 180 2023-10-03T19:21:07.168 INFO:teuthology.orchestra.run.smithi045.stdout: -9100> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5650 cv=5384/5384 REP dir_auth=0 ap=179+180 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565534fd7200 count now 179/180 2023-10-03T19:21:07.168 INFO:teuthology.orchestra.run.smithi045.stdout: -9099> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565534fd7200 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5643 cv=5377/5377 ap=180+180 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=133 | child=1 dirty=1 authpin=1 0x565534f82400] count now 180 2023-10-03T19:21:07.168 INFO:teuthology.orchestra.run.smithi045.stdout: -9098> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000529) auth_unpin by 0x565534fd7200 on [inode 0x10000000529 [2,head] /dc-dir/dc-file_820 auth v5642 s=3 n(v0 rc2023-10-03T19:17:08.289621+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535615080] now 0 2023-10-03T19:21:07.169 INFO:teuthology.orchestra.run.smithi045.stdout: -9097> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5643 cv=5377/5377 ap=180+179 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=133 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565534fd7200 count now 180/179 2023-10-03T19:21:07.169 INFO:teuthology.orchestra.run.smithi045.stdout: -9096> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.169 INFO:teuthology.orchestra.run.smithi045.stdout: -9095> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.169 INFO:teuthology.orchestra.run.smithi045.stdout: -9094> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000052a [2,head] /dc-dir/dc-file_821 auth v4030 pv5644 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.301419+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.301419+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535615600] 2023-10-03T19:21:07.169 INFO:teuthology.orchestra.run.smithi045.stdout: -9093> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5651 2023-10-03T19:21:07.169 INFO:teuthology.orchestra.run.smithi045.stdout: -9092> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5651 pv6007 ap=180 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=180) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=179) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.169 INFO:teuthology.orchestra.run.smithi045.stdout: -9091> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5649 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.169 INFO:teuthology.orchestra.run.smithi045.stdout: -9090> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5650 cv=5384/5384 REP dir_auth=0 ap=179+180 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5650 2023-10-03T19:21:07.169 INFO:teuthology.orchestra.run.smithi045.stdout: -9089> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000052a) pop_and_dirty_projected_inode v5644 2023-10-03T19:21:07.170 INFO:teuthology.orchestra.run.smithi045.stdout: -9088> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000052a) mark_dirty [inode 0x1000000052a [2,head] /dc-dir/dc-file_821 auth v5644 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.301419+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535615600] 2023-10-03T19:21:07.170 INFO:teuthology.orchestra.run.smithi045.stdout: -9087> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_821) mark_dirty [dentry #0x1/dc-dir/dc-file_821 [2,head] auth (dversion lock) pv=5644 v=4030 ino=0x1000000052a state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553560ef00] 2023-10-03T19:21:07.170 INFO:teuthology.orchestra.run.smithi045.stdout: -9086> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5643 cv=5377/5377 ap=180+179 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=134 | child=1 dirty=1 authpin=1 0x565534f82400] version 5643 2023-10-03T19:21:07.170 INFO:teuthology.orchestra.run.smithi045.stdout: -9085> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536aa6ec0 v5652 2023-10-03T19:21:07.170 INFO:teuthology.orchestra.run.smithi045.stdout: -9084> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5652 cv=5384/5384 REP dir_auth=0 ap=179+180 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5652 2023-10-03T19:21:07.170 INFO:teuthology.orchestra.run.smithi045.stdout: -9083> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536aa6da0 v5645 2023-10-03T19:21:07.170 INFO:teuthology.orchestra.run.smithi045.stdout: -9082> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5645 cv=5377/5377 ap=180+179 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=134 | child=1 dirty=1 authpin=1 0x565534f82400] version 5645 2023-10-03T19:21:07.170 INFO:teuthology.orchestra.run.smithi045.stdout: -9081> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=179 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=179 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.170 INFO:teuthology.orchestra.run.smithi045.stdout: -9080> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=179) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5651 pv6007 ap=180 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=180) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=179) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.170 INFO:teuthology.orchestra.run.smithi045.stdout: -9079> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=180) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5651 pv6007 ap=180 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=180) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=178) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.170 INFO:teuthology.orchestra.run.smithi045.stdout: -9078> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000052a [2,head] /dc-dir/dc-file_821 auth v5644 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.301419+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535615600] 2023-10-03T19:21:07.171 INFO:teuthology.orchestra.run.smithi045.stdout: -9077> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000052a [2,head] /dc-dir/dc-file_821 auth v5644 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.301419+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535615600] 2023-10-03T19:21:07.171 INFO:teuthology.orchestra.run.smithi045.stdout: -9076> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.171 INFO:teuthology.orchestra.run.smithi045.stdout: -9075> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.171 INFO:teuthology.orchestra.run.smithi045.stdout: -9074> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.171 INFO:teuthology.orchestra.run.smithi045.stdout: -9073> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000052a [2,head] /dc-dir/dc-file_821 auth v5644 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.301419+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535615600] 2023-10-03T19:21:07.171 INFO:teuthology.orchestra.run.smithi045.stdout: -9072> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000052a [2,head] /dc-dir/dc-file_821 auth v5644 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.301419+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535615600] 2023-10-03T19:21:07.171 INFO:teuthology.orchestra.run.smithi045.stdout: -9071> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.171 INFO:teuthology.orchestra.run.smithi045.stdout: -9070> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 550.959, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.51e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1104.7] 2023-10-03T19:21:07.171 INFO:teuthology.orchestra.run.smithi045.stdout: -9069> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536386000 on [dir 0x1 / [2,head] auth pv=6008 v=5652 cv=5384/5384 REP dir_auth=0 ap=178+180 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 178 2023-10-03T19:21:07.171 INFO:teuthology.orchestra.run.smithi045.stdout: -9068> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536386000 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5651 pv6007 ap=179 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=179) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=178) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 179 2023-10-03T19:21:07.172 INFO:teuthology.orchestra.run.smithi045.stdout: -9067> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5652 cv=5384/5384 REP dir_auth=0 ap=178+179 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536386000 count now 178/179 2023-10-03T19:21:07.172 INFO:teuthology.orchestra.run.smithi045.stdout: -9066> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536386000 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5645 cv=5377/5377 ap=179+179 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=134 | child=1 dirty=1 authpin=1 0x565534f82400] count now 179 2023-10-03T19:21:07.172 INFO:teuthology.orchestra.run.smithi045.stdout: -9065> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000052a) auth_unpin by 0x565536386000 on [inode 0x1000000052a [2,head] /dc-dir/dc-file_821 auth v5644 s=3 n(v0 rc2023-10-03T19:17:08.301419+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535615600] now 0 2023-10-03T19:21:07.172 INFO:teuthology.orchestra.run.smithi045.stdout: -9064> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5645 cv=5377/5377 ap=179+178 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=134 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536386000 count now 179/178 2023-10-03T19:21:07.172 INFO:teuthology.orchestra.run.smithi045.stdout: -9063> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.172 INFO:teuthology.orchestra.run.smithi045.stdout: -9062> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.172 INFO:teuthology.orchestra.run.smithi045.stdout: -9061> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000052b [2,head] /dc-dir/dc-file_822 auth v4034 pv5646 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.315886+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.315886+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535615b80] 2023-10-03T19:21:07.172 INFO:teuthology.orchestra.run.smithi045.stdout: -9060> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5653 2023-10-03T19:21:07.172 INFO:teuthology.orchestra.run.smithi045.stdout: -9059> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5653 pv6007 ap=179 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=179) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=178) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.172 INFO:teuthology.orchestra.run.smithi045.stdout: -9058> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5651 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.172 INFO:teuthology.orchestra.run.smithi045.stdout: -9057> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5652 cv=5384/5384 REP dir_auth=0 ap=178+179 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5652 2023-10-03T19:21:07.173 INFO:teuthology.orchestra.run.smithi045.stdout: -9056> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000052b) pop_and_dirty_projected_inode v5646 2023-10-03T19:21:07.173 INFO:teuthology.orchestra.run.smithi045.stdout: -9055> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000052b) mark_dirty [inode 0x1000000052b [2,head] /dc-dir/dc-file_822 auth v5646 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.315886+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535615b80] 2023-10-03T19:21:07.173 INFO:teuthology.orchestra.run.smithi045.stdout: -9054> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_822) mark_dirty [dentry #0x1/dc-dir/dc-file_822 [2,head] auth (dversion lock) pv=5646 v=4034 ino=0x1000000052b state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553560f180] 2023-10-03T19:21:07.173 INFO:teuthology.orchestra.run.smithi045.stdout: -9053> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5645 cv=5377/5377 ap=179+178 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=135 | child=1 dirty=1 authpin=1 0x565534f82400] version 5645 2023-10-03T19:21:07.173 INFO:teuthology.orchestra.run.smithi045.stdout: -9052> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536aa7100 v5654 2023-10-03T19:21:07.173 INFO:teuthology.orchestra.run.smithi045.stdout: -9051> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5654 cv=5384/5384 REP dir_auth=0 ap=178+179 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5654 2023-10-03T19:21:07.199 INFO:teuthology.orchestra.run.smithi045.stdout: -9050> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536aa6fe0 v5647 2023-10-03T19:21:07.200 INFO:teuthology.orchestra.run.smithi045.stdout: -9049> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5647 cv=5377/5377 ap=179+178 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=135 | child=1 dirty=1 authpin=1 0x565534f82400] version 5647 2023-10-03T19:21:07.200 INFO:teuthology.orchestra.run.smithi045.stdout: -9048> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=178 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=178 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.200 INFO:teuthology.orchestra.run.smithi045.stdout: -9047> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=178) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5653 pv6007 ap=179 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=179) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=178) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.200 INFO:teuthology.orchestra.run.smithi045.stdout: -9046> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=179) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5653 pv6007 ap=179 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=179) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=177) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.200 INFO:teuthology.orchestra.run.smithi045.stdout: -9045> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000052b [2,head] /dc-dir/dc-file_822 auth v5646 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.315886+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535615b80] 2023-10-03T19:21:07.200 INFO:teuthology.orchestra.run.smithi045.stdout: -9044> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000052b [2,head] /dc-dir/dc-file_822 auth v5646 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.315886+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535615b80] 2023-10-03T19:21:07.200 INFO:teuthology.orchestra.run.smithi045.stdout: -9043> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.200 INFO:teuthology.orchestra.run.smithi045.stdout: -9042> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.200 INFO:teuthology.orchestra.run.smithi045.stdout: -9041> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.201 INFO:teuthology.orchestra.run.smithi045.stdout: -9040> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000052b [2,head] /dc-dir/dc-file_822 auth v5646 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.315886+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535615b80] 2023-10-03T19:21:07.201 INFO:teuthology.orchestra.run.smithi045.stdout: -9039> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000052b [2,head] /dc-dir/dc-file_822 auth v5646 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.315886+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535615b80] 2023-10-03T19:21:07.201 INFO:teuthology.orchestra.run.smithi045.stdout: -9038> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.201 INFO:teuthology.orchestra.run.smithi045.stdout: -9037> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 551.959, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.52e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1106.7] 2023-10-03T19:21:07.201 INFO:teuthology.orchestra.run.smithi045.stdout: -9036> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536386480 on [dir 0x1 / [2,head] auth pv=6008 v=5654 cv=5384/5384 REP dir_auth=0 ap=177+179 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 177 2023-10-03T19:21:07.201 INFO:teuthology.orchestra.run.smithi045.stdout: -9035> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536386480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5653 pv6007 ap=178 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=178) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=177) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 178 2023-10-03T19:21:07.201 INFO:teuthology.orchestra.run.smithi045.stdout: -9034> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5654 cv=5384/5384 REP dir_auth=0 ap=177+178 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536386480 count now 177/178 2023-10-03T19:21:07.201 INFO:teuthology.orchestra.run.smithi045.stdout: -9033> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536386480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5647 cv=5377/5377 ap=178+178 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=135 | child=1 dirty=1 authpin=1 0x565534f82400] count now 178 2023-10-03T19:21:07.201 INFO:teuthology.orchestra.run.smithi045.stdout: -9032> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000052b) auth_unpin by 0x565536386480 on [inode 0x1000000052b [2,head] /dc-dir/dc-file_822 auth v5646 s=3 n(v0 rc2023-10-03T19:17:08.315886+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535615b80] now 0 2023-10-03T19:21:07.201 INFO:teuthology.orchestra.run.smithi045.stdout: -9031> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5647 cv=5377/5377 ap=178+177 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=135 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536386480 count now 178/177 2023-10-03T19:21:07.201 INFO:teuthology.orchestra.run.smithi045.stdout: -9030> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.202 INFO:teuthology.orchestra.run.smithi045.stdout: -9029> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.202 INFO:teuthology.orchestra.run.smithi045.stdout: -9028> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000052c [2,head] /dc-dir/dc-file_823 auth v4038 pv5648 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.330033+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.330033+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535616100] 2023-10-03T19:21:07.202 INFO:teuthology.orchestra.run.smithi045.stdout: -9027> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5655 2023-10-03T19:21:07.202 INFO:teuthology.orchestra.run.smithi045.stdout: -9026> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5655 pv6007 ap=178 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=178) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=177) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.202 INFO:teuthology.orchestra.run.smithi045.stdout: -9025> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5653 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.202 INFO:teuthology.orchestra.run.smithi045.stdout: -9024> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5654 cv=5384/5384 REP dir_auth=0 ap=177+178 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5654 2023-10-03T19:21:07.202 INFO:teuthology.orchestra.run.smithi045.stdout: -9023> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000052c) pop_and_dirty_projected_inode v5648 2023-10-03T19:21:07.202 INFO:teuthology.orchestra.run.smithi045.stdout: -9022> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000052c) mark_dirty [inode 0x1000000052c [2,head] /dc-dir/dc-file_823 auth v5648 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.330033+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535616100] 2023-10-03T19:21:07.202 INFO:teuthology.orchestra.run.smithi045.stdout: -9021> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_823) mark_dirty [dentry #0x1/dc-dir/dc-file_823 [2,head] auth (dversion lock) pv=5648 v=4038 ino=0x1000000052c state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553560f400] 2023-10-03T19:21:07.203 INFO:teuthology.orchestra.run.smithi045.stdout: -9020> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5647 cv=5377/5377 ap=178+177 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=136 | child=1 dirty=1 authpin=1 0x565534f82400] version 5647 2023-10-03T19:21:07.203 INFO:teuthology.orchestra.run.smithi045.stdout: -9019> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536aa7340 v5656 2023-10-03T19:21:07.203 INFO:teuthology.orchestra.run.smithi045.stdout: -9018> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5656 cv=5384/5384 REP dir_auth=0 ap=177+178 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5656 2023-10-03T19:21:07.203 INFO:teuthology.orchestra.run.smithi045.stdout: -9017> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536aa7220 v5649 2023-10-03T19:21:07.203 INFO:teuthology.orchestra.run.smithi045.stdout: -9016> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5649 cv=5377/5377 ap=178+177 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=136 | child=1 dirty=1 authpin=1 0x565534f82400] version 5649 2023-10-03T19:21:07.203 INFO:teuthology.orchestra.run.smithi045.stdout: -9015> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=177 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=177 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.203 INFO:teuthology.orchestra.run.smithi045.stdout: -9014> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=177) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5655 pv6007 ap=178 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=178) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=177) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.203 INFO:teuthology.orchestra.run.smithi045.stdout: -9013> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=178) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5655 pv6007 ap=178 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=178) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=176) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.203 INFO:teuthology.orchestra.run.smithi045.stdout: -9012> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000052c [2,head] /dc-dir/dc-file_823 auth v5648 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.330033+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535616100] 2023-10-03T19:21:07.203 INFO:teuthology.orchestra.run.smithi045.stdout: -9011> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000052c [2,head] /dc-dir/dc-file_823 auth v5648 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.330033+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535616100] 2023-10-03T19:21:07.203 INFO:teuthology.orchestra.run.smithi045.stdout: -9010> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.204 INFO:teuthology.orchestra.run.smithi045.stdout: -9009> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.204 INFO:teuthology.orchestra.run.smithi045.stdout: -9008> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.204 INFO:teuthology.orchestra.run.smithi045.stdout: -9007> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000052c [2,head] /dc-dir/dc-file_823 auth v5648 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.330033+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535616100] 2023-10-03T19:21:07.204 INFO:teuthology.orchestra.run.smithi045.stdout: -9006> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000052c [2,head] /dc-dir/dc-file_823 auth v5648 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.330033+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535616100] 2023-10-03T19:21:07.204 INFO:teuthology.orchestra.run.smithi045.stdout: -9005> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.204 INFO:teuthology.orchestra.run.smithi045.stdout: -9004> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 552.959, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.53e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1108.7] 2023-10-03T19:21:07.204 INFO:teuthology.orchestra.run.smithi045.stdout: -9003> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536386900 on [dir 0x1 / [2,head] auth pv=6008 v=5656 cv=5384/5384 REP dir_auth=0 ap=176+178 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 176 2023-10-03T19:21:07.204 INFO:teuthology.orchestra.run.smithi045.stdout: -9002> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536386900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5655 pv6007 ap=177 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=177) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=176) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 177 2023-10-03T19:21:07.204 INFO:teuthology.orchestra.run.smithi045.stdout: -9001> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5656 cv=5384/5384 REP dir_auth=0 ap=176+177 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536386900 count now 176/177 2023-10-03T19:21:07.205 INFO:teuthology.orchestra.run.smithi045.stdout: -9000> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536386900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5649 cv=5377/5377 ap=177+177 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=136 | child=1 dirty=1 authpin=1 0x565534f82400] count now 177 2023-10-03T19:21:07.205 INFO:teuthology.orchestra.run.smithi045.stdout: -8999> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000052c) auth_unpin by 0x565536386900 on [inode 0x1000000052c [2,head] /dc-dir/dc-file_823 auth v5648 s=3 n(v0 rc2023-10-03T19:17:08.330033+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535616100] now 0 2023-10-03T19:21:07.205 INFO:teuthology.orchestra.run.smithi045.stdout: -8998> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5649 cv=5377/5377 ap=177+176 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=136 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536386900 count now 177/176 2023-10-03T19:21:07.205 INFO:teuthology.orchestra.run.smithi045.stdout: -8997> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.205 INFO:teuthology.orchestra.run.smithi045.stdout: -8996> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.205 INFO:teuthology.orchestra.run.smithi045.stdout: -8995> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000052d [2,head] /dc-dir/dc-file_824 auth v4042 pv5650 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.343965+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.343965+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535616680] 2023-10-03T19:21:07.205 INFO:teuthology.orchestra.run.smithi045.stdout: -8994> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5657 2023-10-03T19:21:07.205 INFO:teuthology.orchestra.run.smithi045.stdout: -8993> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5657 pv6007 ap=177 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=177) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=176) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.205 INFO:teuthology.orchestra.run.smithi045.stdout: -8992> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5655 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.205 INFO:teuthology.orchestra.run.smithi045.stdout: -8991> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5656 cv=5384/5384 REP dir_auth=0 ap=176+177 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5656 2023-10-03T19:21:07.205 INFO:teuthology.orchestra.run.smithi045.stdout: -8990> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000052d) pop_and_dirty_projected_inode v5650 2023-10-03T19:21:07.205 INFO:teuthology.orchestra.run.smithi045.stdout: -8989> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000052d) mark_dirty [inode 0x1000000052d [2,head] /dc-dir/dc-file_824 auth v5650 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.343965+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535616680] 2023-10-03T19:21:07.206 INFO:teuthology.orchestra.run.smithi045.stdout: -8988> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_824) mark_dirty [dentry #0x1/dc-dir/dc-file_824 [2,head] auth (dversion lock) pv=5650 v=4042 ino=0x1000000052d state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553560f680] 2023-10-03T19:21:07.238 INFO:teuthology.orchestra.run.smithi045.stdout: -8987> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5649 cv=5377/5377 ap=177+176 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=137 | child=1 dirty=1 authpin=1 0x565534f82400] version 5649 2023-10-03T19:21:07.238 INFO:teuthology.orchestra.run.smithi045.stdout: -8986> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536aa7580 v5658 2023-10-03T19:21:07.238 INFO:teuthology.orchestra.run.smithi045.stdout: -8985> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5658 cv=5384/5384 REP dir_auth=0 ap=176+177 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5658 2023-10-03T19:21:07.238 INFO:teuthology.orchestra.run.smithi045.stdout: -8984> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536aa7460 v5651 2023-10-03T19:21:07.238 INFO:teuthology.orchestra.run.smithi045.stdout: -8983> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5651 cv=5377/5377 ap=177+176 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=137 | child=1 dirty=1 authpin=1 0x565534f82400] version 5651 2023-10-03T19:21:07.238 INFO:teuthology.orchestra.run.smithi045.stdout: -8982> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=176 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=176 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.238 INFO:teuthology.orchestra.run.smithi045.stdout: -8981> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=176) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5657 pv6007 ap=177 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=177) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=176) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.238 INFO:teuthology.orchestra.run.smithi045.stdout: -8980> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=177) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5657 pv6007 ap=177 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=177) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=175) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.239 INFO:teuthology.orchestra.run.smithi045.stdout: -8979> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000052d [2,head] /dc-dir/dc-file_824 auth v5650 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.343965+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535616680] 2023-10-03T19:21:07.239 INFO:teuthology.orchestra.run.smithi045.stdout: -8978> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000052d [2,head] /dc-dir/dc-file_824 auth v5650 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.343965+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535616680] 2023-10-03T19:21:07.239 INFO:teuthology.orchestra.run.smithi045.stdout: -8977> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.239 INFO:teuthology.orchestra.run.smithi045.stdout: -8976> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.239 INFO:teuthology.orchestra.run.smithi045.stdout: -8975> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.239 INFO:teuthology.orchestra.run.smithi045.stdout: -8974> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000052d [2,head] /dc-dir/dc-file_824 auth v5650 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.343965+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535616680] 2023-10-03T19:21:07.239 INFO:teuthology.orchestra.run.smithi045.stdout: -8973> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000052d [2,head] /dc-dir/dc-file_824 auth v5650 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.343965+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535616680] 2023-10-03T19:21:07.239 INFO:teuthology.orchestra.run.smithi045.stdout: -8972> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.239 INFO:teuthology.orchestra.run.smithi045.stdout: -8971> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 553.959, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.54e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1110.7] 2023-10-03T19:21:07.239 INFO:teuthology.orchestra.run.smithi045.stdout: -8970> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536386d80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5657 pv6007 ap=176 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=176) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=175) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 176 2023-10-03T19:21:07.240 INFO:teuthology.orchestra.run.smithi045.stdout: -8969> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5658 cv=5384/5384 REP dir_auth=0 ap=176+176 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536386d80 count now 176/176 2023-10-03T19:21:07.240 INFO:teuthology.orchestra.run.smithi045.stdout: -8968> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536386d80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5651 cv=5377/5377 ap=176+176 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=137 | child=1 dirty=1 authpin=1 0x565534f82400] count now 176 2023-10-03T19:21:07.240 INFO:teuthology.orchestra.run.smithi045.stdout: -8967> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536386d80 on [dir 0x1 / [2,head] auth pv=6008 v=5658 cv=5384/5384 REP dir_auth=0 ap=175+176 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 175 2023-10-03T19:21:07.240 INFO:teuthology.orchestra.run.smithi045.stdout: -8966> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000052d) auth_unpin by 0x565536386d80 on [inode 0x1000000052d [2,head] /dc-dir/dc-file_824 auth v5650 s=3 n(v0 rc2023-10-03T19:17:08.343965+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535616680] now 0 2023-10-03T19:21:07.240 INFO:teuthology.orchestra.run.smithi045.stdout: -8965> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5651 cv=5377/5377 ap=176+175 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=137 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536386d80 count now 176/175 2023-10-03T19:21:07.240 INFO:teuthology.orchestra.run.smithi045.stdout: -8964> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.240 INFO:teuthology.orchestra.run.smithi045.stdout: -8963> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.240 INFO:teuthology.orchestra.run.smithi045.stdout: -8962> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000052e [2,head] /dc-dir/dc-file_825 auth v4046 pv5652 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.357648+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.357648+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535616c00] 2023-10-03T19:21:07.240 INFO:teuthology.orchestra.run.smithi045.stdout: -8961> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5659 2023-10-03T19:21:07.240 INFO:teuthology.orchestra.run.smithi045.stdout: -8960> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5659 pv6007 ap=176 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=176) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=175) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.241 INFO:teuthology.orchestra.run.smithi045.stdout: -8959> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5657 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.241 INFO:teuthology.orchestra.run.smithi045.stdout: -8958> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5658 cv=5384/5384 REP dir_auth=0 ap=175+176 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5658 2023-10-03T19:21:07.241 INFO:teuthology.orchestra.run.smithi045.stdout: -8957> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000052e) pop_and_dirty_projected_inode v5652 2023-10-03T19:21:07.241 INFO:teuthology.orchestra.run.smithi045.stdout: -8956> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000052e) mark_dirty [inode 0x1000000052e [2,head] /dc-dir/dc-file_825 auth v5652 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.357648+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535616c00] 2023-10-03T19:21:07.241 INFO:teuthology.orchestra.run.smithi045.stdout: -8955> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_825) mark_dirty [dentry #0x1/dc-dir/dc-file_825 [2,head] auth (dversion lock) pv=5652 v=4046 ino=0x1000000052e state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553560f900] 2023-10-03T19:21:07.241 INFO:teuthology.orchestra.run.smithi045.stdout: -8954> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5651 cv=5377/5377 ap=176+175 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=138 | child=1 dirty=1 authpin=1 0x565534f82400] version 5651 2023-10-03T19:21:07.241 INFO:teuthology.orchestra.run.smithi045.stdout: -8953> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536aa77c0 v5660 2023-10-03T19:21:07.241 INFO:teuthology.orchestra.run.smithi045.stdout: -8952> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5660 cv=5384/5384 REP dir_auth=0 ap=175+176 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5660 2023-10-03T19:21:07.241 INFO:teuthology.orchestra.run.smithi045.stdout: -8951> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536aa76a0 v5653 2023-10-03T19:21:07.241 INFO:teuthology.orchestra.run.smithi045.stdout: -8950> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5653 cv=5377/5377 ap=176+175 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=138 | child=1 dirty=1 authpin=1 0x565534f82400] version 5653 2023-10-03T19:21:07.242 INFO:teuthology.orchestra.run.smithi045.stdout: -8949> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=175 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=175 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.242 INFO:teuthology.orchestra.run.smithi045.stdout: -8948> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=175) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5659 pv6007 ap=176 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=176) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=175) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.242 INFO:teuthology.orchestra.run.smithi045.stdout: -8947> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=176) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5659 pv6007 ap=176 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=176) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=174) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.242 INFO:teuthology.orchestra.run.smithi045.stdout: -8946> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000052e [2,head] /dc-dir/dc-file_825 auth v5652 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.357648+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535616c00] 2023-10-03T19:21:07.242 INFO:teuthology.orchestra.run.smithi045.stdout: -8945> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000052e [2,head] /dc-dir/dc-file_825 auth v5652 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.357648+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535616c00] 2023-10-03T19:21:07.242 INFO:teuthology.orchestra.run.smithi045.stdout: -8944> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.242 INFO:teuthology.orchestra.run.smithi045.stdout: -8943> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.242 INFO:teuthology.orchestra.run.smithi045.stdout: -8942> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.242 INFO:teuthology.orchestra.run.smithi045.stdout: -8941> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000052e [2,head] /dc-dir/dc-file_825 auth v5652 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.357648+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535616c00] 2023-10-03T19:21:07.242 INFO:teuthology.orchestra.run.smithi045.stdout: -8940> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000052e [2,head] /dc-dir/dc-file_825 auth v5652 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.357648+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535616c00] 2023-10-03T19:21:07.243 INFO:teuthology.orchestra.run.smithi045.stdout: -8939> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.243 INFO:teuthology.orchestra.run.smithi045.stdout: -8938> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 554.959, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.55e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1112.7] 2023-10-03T19:21:07.243 INFO:teuthology.orchestra.run.smithi045.stdout: -8937> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536387200 on [dir 0x1 / [2,head] auth pv=6008 v=5660 cv=5384/5384 REP dir_auth=0 ap=174+176 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 174 2023-10-03T19:21:07.243 INFO:teuthology.orchestra.run.smithi045.stdout: -8936> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536387200 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5659 pv6007 ap=175 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=175) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=174) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 175 2023-10-03T19:21:07.243 INFO:teuthology.orchestra.run.smithi045.stdout: -8935> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5660 cv=5384/5384 REP dir_auth=0 ap=174+175 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536387200 count now 174/175 2023-10-03T19:21:07.243 INFO:teuthology.orchestra.run.smithi045.stdout: -8934> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536387200 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5653 cv=5377/5377 ap=175+175 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=138 | child=1 dirty=1 authpin=1 0x565534f82400] count now 175 2023-10-03T19:21:07.243 INFO:teuthology.orchestra.run.smithi045.stdout: -8933> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000052e) auth_unpin by 0x565536387200 on [inode 0x1000000052e [2,head] /dc-dir/dc-file_825 auth v5652 s=3 n(v0 rc2023-10-03T19:17:08.357648+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535616c00] now 0 2023-10-03T19:21:07.243 INFO:teuthology.orchestra.run.smithi045.stdout: -8932> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5653 cv=5377/5377 ap=175+174 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=138 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536387200 count now 175/174 2023-10-03T19:21:07.243 INFO:teuthology.orchestra.run.smithi045.stdout: -8931> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.243 INFO:teuthology.orchestra.run.smithi045.stdout: -8930> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.244 INFO:teuthology.orchestra.run.smithi045.stdout: -8929> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000052f [2,head] /dc-dir/dc-file_826 auth v4050 pv5654 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.369735+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.369735+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535617180] 2023-10-03T19:21:07.244 INFO:teuthology.orchestra.run.smithi045.stdout: -8928> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5661 2023-10-03T19:21:07.244 INFO:teuthology.orchestra.run.smithi045.stdout: -8927> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5661 pv6007 ap=175 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=175) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=174) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.249 INFO:teuthology.orchestra.run.smithi045.stdout: -8926> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5659 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.249 INFO:teuthology.orchestra.run.smithi045.stdout: -8925> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5660 cv=5384/5384 REP dir_auth=0 ap=174+175 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5660 2023-10-03T19:21:07.249 INFO:teuthology.orchestra.run.smithi045.stdout: -8924> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000052f) pop_and_dirty_projected_inode v5654 2023-10-03T19:21:07.250 INFO:teuthology.orchestra.run.smithi045.stdout: -8923> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000052f) mark_dirty [inode 0x1000000052f [2,head] /dc-dir/dc-file_826 auth v5654 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.369735+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535617180] 2023-10-03T19:21:07.250 INFO:teuthology.orchestra.run.smithi045.stdout: -8922> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_826) mark_dirty [dentry #0x1/dc-dir/dc-file_826 [2,head] auth (dversion lock) pv=5654 v=4050 ino=0x1000000052f state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553560fb80] 2023-10-03T19:21:07.250 INFO:teuthology.orchestra.run.smithi045.stdout: -8921> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5653 cv=5377/5377 ap=175+174 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=139 | child=1 dirty=1 authpin=1 0x565534f82400] version 5653 2023-10-03T19:21:07.250 INFO:teuthology.orchestra.run.smithi045.stdout: -8920> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536aa7a00 v5662 2023-10-03T19:21:07.250 INFO:teuthology.orchestra.run.smithi045.stdout: -8919> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5662 cv=5384/5384 REP dir_auth=0 ap=174+175 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5662 2023-10-03T19:21:07.250 INFO:teuthology.orchestra.run.smithi045.stdout: -8918> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536aa78e0 v5655 2023-10-03T19:21:07.250 INFO:teuthology.orchestra.run.smithi045.stdout: -8917> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5655 cv=5377/5377 ap=175+174 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=139 | child=1 dirty=1 authpin=1 0x565534f82400] version 5655 2023-10-03T19:21:07.250 INFO:teuthology.orchestra.run.smithi045.stdout: -8916> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=174 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=174 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.250 INFO:teuthology.orchestra.run.smithi045.stdout: -8915> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=174) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5661 pv6007 ap=175 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=175) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=174) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.251 INFO:teuthology.orchestra.run.smithi045.stdout: -8914> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=175) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5661 pv6007 ap=175 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=175) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=173) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.251 INFO:teuthology.orchestra.run.smithi045.stdout: -8913> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000052f [2,head] /dc-dir/dc-file_826 auth v5654 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.369735+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535617180] 2023-10-03T19:21:07.251 INFO:teuthology.orchestra.run.smithi045.stdout: -8912> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000052f [2,head] /dc-dir/dc-file_826 auth v5654 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.369735+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535617180] 2023-10-03T19:21:07.251 INFO:teuthology.orchestra.run.smithi045.stdout: -8911> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.251 INFO:teuthology.orchestra.run.smithi045.stdout: -8910> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.251 INFO:teuthology.orchestra.run.smithi045.stdout: -8909> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.251 INFO:teuthology.orchestra.run.smithi045.stdout: -8908> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000052f [2,head] /dc-dir/dc-file_826 auth v5654 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.369735+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535617180] 2023-10-03T19:21:07.251 INFO:teuthology.orchestra.run.smithi045.stdout: -8907> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000052f [2,head] /dc-dir/dc-file_826 auth v5654 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.369735+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535617180] 2023-10-03T19:21:07.251 INFO:teuthology.orchestra.run.smithi045.stdout: -8906> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.251 INFO:teuthology.orchestra.run.smithi045.stdout: -8905> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 555.959, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.56e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.02e-01] *LOAD:1114.7] 2023-10-03T19:21:07.251 INFO:teuthology.orchestra.run.smithi045.stdout: -8904> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536387680 on [dir 0x1 / [2,head] auth pv=6008 v=5662 cv=5384/5384 REP dir_auth=0 ap=173+175 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 173 2023-10-03T19:21:07.252 INFO:teuthology.orchestra.run.smithi045.stdout: -8903> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536387680 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5661 pv6007 ap=174 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=174) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=173) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 174 2023-10-03T19:21:07.252 INFO:teuthology.orchestra.run.smithi045.stdout: -8902> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5662 cv=5384/5384 REP dir_auth=0 ap=173+174 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536387680 count now 173/174 2023-10-03T19:21:07.252 INFO:teuthology.orchestra.run.smithi045.stdout: -8901> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536387680 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5655 cv=5377/5377 ap=174+174 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=139 | child=1 dirty=1 authpin=1 0x565534f82400] count now 174 2023-10-03T19:21:07.252 INFO:teuthology.orchestra.run.smithi045.stdout: -8900> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000052f) auth_unpin by 0x565536387680 on [inode 0x1000000052f [2,head] /dc-dir/dc-file_826 auth v5654 s=3 n(v0 rc2023-10-03T19:17:08.369735+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535617180] now 0 2023-10-03T19:21:07.252 INFO:teuthology.orchestra.run.smithi045.stdout: -8899> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5655 cv=5377/5377 ap=174+173 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=139 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536387680 count now 174/173 2023-10-03T19:21:07.252 INFO:teuthology.orchestra.run.smithi045.stdout: -8898> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.252 INFO:teuthology.orchestra.run.smithi045.stdout: -8897> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.252 INFO:teuthology.orchestra.run.smithi045.stdout: -8896> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000530 [2,head] /dc-dir/dc-file_827 auth v4054 pv5656 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.381633+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.381633+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535617700] 2023-10-03T19:21:07.252 INFO:teuthology.orchestra.run.smithi045.stdout: -8895> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5663 2023-10-03T19:21:07.252 INFO:teuthology.orchestra.run.smithi045.stdout: -8894> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5663 pv6007 ap=174 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=174) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=173) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.252 INFO:teuthology.orchestra.run.smithi045.stdout: -8893> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5661 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.253 INFO:teuthology.orchestra.run.smithi045.stdout: -8892> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5662 cv=5384/5384 REP dir_auth=0 ap=173+174 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5662 2023-10-03T19:21:07.253 INFO:teuthology.orchestra.run.smithi045.stdout: -8891> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000530) pop_and_dirty_projected_inode v5656 2023-10-03T19:21:07.253 INFO:teuthology.orchestra.run.smithi045.stdout: -8890> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000530) mark_dirty [inode 0x10000000530 [2,head] /dc-dir/dc-file_827 auth v5656 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.381633+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535617700] 2023-10-03T19:21:07.253 INFO:teuthology.orchestra.run.smithi045.stdout: -8889> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_827) mark_dirty [dentry #0x1/dc-dir/dc-file_827 [2,head] auth (dversion lock) pv=5656 v=4054 ino=0x10000000530 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553561e000] 2023-10-03T19:21:07.253 INFO:teuthology.orchestra.run.smithi045.stdout: -8888> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5655 cv=5377/5377 ap=174+173 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=140 | child=1 dirty=1 authpin=1 0x565534f82400] version 5655 2023-10-03T19:21:07.253 INFO:teuthology.orchestra.run.smithi045.stdout: -8887> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536aa7c40 v5664 2023-10-03T19:21:07.253 INFO:teuthology.orchestra.run.smithi045.stdout: -8886> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5664 cv=5384/5384 REP dir_auth=0 ap=173+174 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5664 2023-10-03T19:21:07.253 INFO:teuthology.orchestra.run.smithi045.stdout: -8885> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536aa7b20 v5657 2023-10-03T19:21:07.253 INFO:teuthology.orchestra.run.smithi045.stdout: -8884> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5657 cv=5377/5377 ap=174+173 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=140 | child=1 dirty=1 authpin=1 0x565534f82400] version 5657 2023-10-03T19:21:07.254 INFO:teuthology.orchestra.run.smithi045.stdout: -8883> 2023-10-03T19:17:19.514+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=173 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=173 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.254 INFO:teuthology.orchestra.run.smithi045.stdout: -8882> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=173) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5663 pv6007 ap=174 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=174) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=173) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.254 INFO:teuthology.orchestra.run.smithi045.stdout: -8881> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=174) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5663 pv6007 ap=174 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=174) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=172) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.254 INFO:teuthology.orchestra.run.smithi045.stdout: -8880> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000530 [2,head] /dc-dir/dc-file_827 auth v5656 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.381633+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535617700] 2023-10-03T19:21:07.254 INFO:teuthology.orchestra.run.smithi045.stdout: -8879> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000530 [2,head] /dc-dir/dc-file_827 auth v5656 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.381633+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535617700] 2023-10-03T19:21:07.254 INFO:teuthology.orchestra.run.smithi045.stdout: -8878> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.254 INFO:teuthology.orchestra.run.smithi045.stdout: -8877> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.254 INFO:teuthology.orchestra.run.smithi045.stdout: -8876> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.254 INFO:teuthology.orchestra.run.smithi045.stdout: -8875> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000530 [2,head] /dc-dir/dc-file_827 auth v5656 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.381633+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535617700] 2023-10-03T19:21:07.254 INFO:teuthology.orchestra.run.smithi045.stdout: -8874> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000530 [2,head] /dc-dir/dc-file_827 auth v5656 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.381633+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535617700] 2023-10-03T19:21:07.255 INFO:teuthology.orchestra.run.smithi045.stdout: -8873> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.255 INFO:teuthology.orchestra.run.smithi045.stdout: -8872> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 556.651, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.57e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1116.1] 2023-10-03T19:21:07.255 INFO:teuthology.orchestra.run.smithi045.stdout: -8871> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536387b00 on [dir 0x1 / [2,head] auth pv=6008 v=5664 cv=5384/5384 REP dir_auth=0 ap=172+174 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 172 2023-10-03T19:21:07.255 INFO:teuthology.orchestra.run.smithi045.stdout: -8870> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536387b00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5657 cv=5377/5377 ap=173+173 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=140 | child=1 dirty=1 authpin=1 0x565534f82400] count now 173 2023-10-03T19:21:07.255 INFO:teuthology.orchestra.run.smithi045.stdout: -8869> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536387b00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5663 pv6007 ap=173 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=173) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=172) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 173 2023-10-03T19:21:07.255 INFO:teuthology.orchestra.run.smithi045.stdout: -8868> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5664 cv=5384/5384 REP dir_auth=0 ap=172+173 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536387b00 count now 172/173 2023-10-03T19:21:07.255 INFO:teuthology.orchestra.run.smithi045.stdout: -8867> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000530) auth_unpin by 0x565536387b00 on [inode 0x10000000530 [2,head] /dc-dir/dc-file_827 auth v5656 s=3 n(v0 rc2023-10-03T19:17:08.381633+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535617700] now 0 2023-10-03T19:21:07.255 INFO:teuthology.orchestra.run.smithi045.stdout: -8866> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5657 cv=5377/5377 ap=173+172 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=140 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536387b00 count now 173/172 2023-10-03T19:21:07.331 INFO:teuthology.orchestra.run.smithi045.stdout: -8865> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.331 INFO:teuthology.orchestra.run.smithi045.stdout: -8864> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.331 INFO:teuthology.orchestra.run.smithi045.stdout: -8863> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000531 [2,head] /dc-dir/dc-file_828 auth v4058 pv5658 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.393814+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.393814+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535620000] 2023-10-03T19:21:07.331 INFO:teuthology.orchestra.run.smithi045.stdout: -8862> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5665 2023-10-03T19:21:07.331 INFO:teuthology.orchestra.run.smithi045.stdout: -8861> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5665 pv6007 ap=173 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=173) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=172) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.331 INFO:teuthology.orchestra.run.smithi045.stdout: -8860> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5663 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.331 INFO:teuthology.orchestra.run.smithi045.stdout: -8859> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5664 cv=5384/5384 REP dir_auth=0 ap=172+173 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5664 2023-10-03T19:21:07.331 INFO:teuthology.orchestra.run.smithi045.stdout: -8858> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000531) pop_and_dirty_projected_inode v5658 2023-10-03T19:21:07.331 INFO:teuthology.orchestra.run.smithi045.stdout: -8857> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000531) mark_dirty [inode 0x10000000531 [2,head] /dc-dir/dc-file_828 auth v5658 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.393814+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535620000] 2023-10-03T19:21:07.331 INFO:teuthology.orchestra.run.smithi045.stdout: -8856> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_828) mark_dirty [dentry #0x1/dc-dir/dc-file_828 [2,head] auth (dversion lock) pv=5658 v=4058 ino=0x10000000531 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553561e280] 2023-10-03T19:21:07.332 INFO:teuthology.orchestra.run.smithi045.stdout: -8855> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5657 cv=5377/5377 ap=173+172 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=141 | child=1 dirty=1 authpin=1 0x565534f82400] version 5657 2023-10-03T19:21:07.332 INFO:teuthology.orchestra.run.smithi045.stdout: -8854> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536aa7e80 v5666 2023-10-03T19:21:07.332 INFO:teuthology.orchestra.run.smithi045.stdout: -8853> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5666 cv=5384/5384 REP dir_auth=0 ap=172+173 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5666 2023-10-03T19:21:07.332 INFO:teuthology.orchestra.run.smithi045.stdout: -8852> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536aa7d60 v5659 2023-10-03T19:21:07.332 INFO:teuthology.orchestra.run.smithi045.stdout: -8851> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5659 cv=5377/5377 ap=173+172 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=141 | child=1 dirty=1 authpin=1 0x565534f82400] version 5659 2023-10-03T19:21:07.332 INFO:teuthology.orchestra.run.smithi045.stdout: -8850> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=172 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=172 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.332 INFO:teuthology.orchestra.run.smithi045.stdout: -8849> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=172) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5665 pv6007 ap=173 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=173) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=172) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.332 INFO:teuthology.orchestra.run.smithi045.stdout: -8848> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=173) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5665 pv6007 ap=173 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=173) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=171) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.332 INFO:teuthology.orchestra.run.smithi045.stdout: -8847> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000531 [2,head] /dc-dir/dc-file_828 auth v5658 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.393814+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535620000] 2023-10-03T19:21:07.333 INFO:teuthology.orchestra.run.smithi045.stdout: -8846> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000531 [2,head] /dc-dir/dc-file_828 auth v5658 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.393814+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535620000] 2023-10-03T19:21:07.333 INFO:teuthology.orchestra.run.smithi045.stdout: -8845> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.333 INFO:teuthology.orchestra.run.smithi045.stdout: -8844> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.333 INFO:teuthology.orchestra.run.smithi045.stdout: -8843> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.333 INFO:teuthology.orchestra.run.smithi045.stdout: -8842> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000531 [2,head] /dc-dir/dc-file_828 auth v5658 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.393814+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535620000] 2023-10-03T19:21:07.333 INFO:teuthology.orchestra.run.smithi045.stdout: -8841> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000531 [2,head] /dc-dir/dc-file_828 auth v5658 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.393814+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535620000] 2023-10-03T19:21:07.333 INFO:teuthology.orchestra.run.smithi045.stdout: -8840> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.333 INFO:teuthology.orchestra.run.smithi045.stdout: -8839> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 557.651, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.58e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1118.1] 2023-10-03T19:21:07.333 INFO:teuthology.orchestra.run.smithi045.stdout: -8838> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535438900 on [dir 0x1 / [2,head] auth pv=6008 v=5666 cv=5384/5384 REP dir_auth=0 ap=171+173 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 171 2023-10-03T19:21:07.333 INFO:teuthology.orchestra.run.smithi045.stdout: -8837> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535438900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5665 pv6007 ap=172 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=172) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=171) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 172 2023-10-03T19:21:07.333 INFO:teuthology.orchestra.run.smithi045.stdout: -8836> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5666 cv=5384/5384 REP dir_auth=0 ap=171+172 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535438900 count now 171/172 2023-10-03T19:21:07.334 INFO:teuthology.orchestra.run.smithi045.stdout: -8835> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535438900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5659 cv=5377/5377 ap=172+172 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=141 | child=1 dirty=1 authpin=1 0x565534f82400] count now 172 2023-10-03T19:21:07.334 INFO:teuthology.orchestra.run.smithi045.stdout: -8834> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000531) auth_unpin by 0x565535438900 on [inode 0x10000000531 [2,head] /dc-dir/dc-file_828 auth v5658 s=3 n(v0 rc2023-10-03T19:17:08.393814+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535620000] now 0 2023-10-03T19:21:07.334 INFO:teuthology.orchestra.run.smithi045.stdout: -8833> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5659 cv=5377/5377 ap=172+171 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=141 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535438900 count now 172/171 2023-10-03T19:21:07.334 INFO:teuthology.orchestra.run.smithi045.stdout: -8832> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.334 INFO:teuthology.orchestra.run.smithi045.stdout: -8831> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.334 INFO:teuthology.orchestra.run.smithi045.stdout: -8830> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000532 [2,head] /dc-dir/dc-file_829 auth v4062 pv5660 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.405135+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.405135+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535620580] 2023-10-03T19:21:07.334 INFO:teuthology.orchestra.run.smithi045.stdout: -8829> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5667 2023-10-03T19:21:07.334 INFO:teuthology.orchestra.run.smithi045.stdout: -8828> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5667 pv6007 ap=172 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=172) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=171) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.334 INFO:teuthology.orchestra.run.smithi045.stdout: -8827> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5665 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.334 INFO:teuthology.orchestra.run.smithi045.stdout: -8826> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5666 cv=5384/5384 REP dir_auth=0 ap=171+172 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5666 2023-10-03T19:21:07.335 INFO:teuthology.orchestra.run.smithi045.stdout: -8825> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000532) pop_and_dirty_projected_inode v5660 2023-10-03T19:21:07.335 INFO:teuthology.orchestra.run.smithi045.stdout: -8824> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000532) mark_dirty [inode 0x10000000532 [2,head] /dc-dir/dc-file_829 auth v5660 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.405135+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535620580] 2023-10-03T19:21:07.335 INFO:teuthology.orchestra.run.smithi045.stdout: -8823> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_829) mark_dirty [dentry #0x1/dc-dir/dc-file_829 [2,head] auth (dversion lock) pv=5660 v=4062 ino=0x10000000532 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553561e500] 2023-10-03T19:21:07.335 INFO:teuthology.orchestra.run.smithi045.stdout: -8822> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5659 cv=5377/5377 ap=172+171 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=142 | child=1 dirty=1 authpin=1 0x565534f82400] version 5659 2023-10-03T19:21:07.335 INFO:teuthology.orchestra.run.smithi045.stdout: -8821> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565534fc2140 v5668 2023-10-03T19:21:07.335 INFO:teuthology.orchestra.run.smithi045.stdout: -8820> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5668 cv=5384/5384 REP dir_auth=0 ap=171+172 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5668 2023-10-03T19:21:07.335 INFO:teuthology.orchestra.run.smithi045.stdout: -8819> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565534fc2020 v5661 2023-10-03T19:21:07.335 INFO:teuthology.orchestra.run.smithi045.stdout: -8818> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5661 cv=5377/5377 ap=172+171 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=142 | child=1 dirty=1 authpin=1 0x565534f82400] version 5661 2023-10-03T19:21:07.335 INFO:teuthology.orchestra.run.smithi045.stdout: -8817> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=171 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=171 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.335 INFO:teuthology.orchestra.run.smithi045.stdout: -8816> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=171) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5667 pv6007 ap=172 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=172) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=171) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.336 INFO:teuthology.orchestra.run.smithi045.stdout: -8815> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=172) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5667 pv6007 ap=172 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=172) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=170) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.336 INFO:teuthology.orchestra.run.smithi045.stdout: -8814> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000532 [2,head] /dc-dir/dc-file_829 auth v5660 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.405135+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535620580] 2023-10-03T19:21:07.336 INFO:teuthology.orchestra.run.smithi045.stdout: -8813> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000532 [2,head] /dc-dir/dc-file_829 auth v5660 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.405135+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535620580] 2023-10-03T19:21:07.336 INFO:teuthology.orchestra.run.smithi045.stdout: -8812> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.336 INFO:teuthology.orchestra.run.smithi045.stdout: -8811> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.336 INFO:teuthology.orchestra.run.smithi045.stdout: -8810> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.336 INFO:teuthology.orchestra.run.smithi045.stdout: -8809> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000532 [2,head] /dc-dir/dc-file_829 auth v5660 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.405135+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535620580] 2023-10-03T19:21:07.336 INFO:teuthology.orchestra.run.smithi045.stdout: -8808> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000532 [2,head] /dc-dir/dc-file_829 auth v5660 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.405135+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535620580] 2023-10-03T19:21:07.336 INFO:teuthology.orchestra.run.smithi045.stdout: -8807> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.336 INFO:teuthology.orchestra.run.smithi045.stdout: -8806> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 558.651, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.59e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1120.1] 2023-10-03T19:21:07.336 INFO:teuthology.orchestra.run.smithi045.stdout: -8805> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x56553575db00 on [dir 0x1 / [2,head] auth pv=6008 v=5668 cv=5384/5384 REP dir_auth=0 ap=170+172 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 170 2023-10-03T19:21:07.337 INFO:teuthology.orchestra.run.smithi045.stdout: -8804> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x56553575db00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5667 pv6007 ap=171 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=171) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=170) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 171 2023-10-03T19:21:07.337 INFO:teuthology.orchestra.run.smithi045.stdout: -8803> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5668 cv=5384/5384 REP dir_auth=0 ap=170+171 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x56553575db00 count now 170/171 2023-10-03T19:21:07.375 INFO:teuthology.orchestra.run.smithi045.stdout: -8802> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x56553575db00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5661 cv=5377/5377 ap=171+171 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=142 | child=1 dirty=1 authpin=1 0x565534f82400] count now 171 2023-10-03T19:21:07.375 INFO:teuthology.orchestra.run.smithi045.stdout: -8801> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000532) auth_unpin by 0x56553575db00 on [inode 0x10000000532 [2,head] /dc-dir/dc-file_829 auth v5660 s=3 n(v0 rc2023-10-03T19:17:08.405135+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535620580] now 0 2023-10-03T19:21:07.375 INFO:teuthology.orchestra.run.smithi045.stdout: -8800> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5661 cv=5377/5377 ap=171+170 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=142 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x56553575db00 count now 171/170 2023-10-03T19:21:07.375 INFO:teuthology.orchestra.run.smithi045.stdout: -8799> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.375 INFO:teuthology.orchestra.run.smithi045.stdout: -8798> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.375 INFO:teuthology.orchestra.run.smithi045.stdout: -8797> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000533 [2,head] /dc-dir/dc-file_830 auth v4066 pv5662 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.416650+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.416650+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535620b00] 2023-10-03T19:21:07.375 INFO:teuthology.orchestra.run.smithi045.stdout: -8796> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5669 2023-10-03T19:21:07.375 INFO:teuthology.orchestra.run.smithi045.stdout: -8795> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5669 pv6007 ap=171 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=171) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=170) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.375 INFO:teuthology.orchestra.run.smithi045.stdout: -8794> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5667 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.375 INFO:teuthology.orchestra.run.smithi045.stdout: -8793> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5668 cv=5384/5384 REP dir_auth=0 ap=170+171 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5668 2023-10-03T19:21:07.376 INFO:teuthology.orchestra.run.smithi045.stdout: -8792> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000533) pop_and_dirty_projected_inode v5662 2023-10-03T19:21:07.376 INFO:teuthology.orchestra.run.smithi045.stdout: -8791> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000533) mark_dirty [inode 0x10000000533 [2,head] /dc-dir/dc-file_830 auth v5662 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.416650+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535620b00] 2023-10-03T19:21:07.376 INFO:teuthology.orchestra.run.smithi045.stdout: -8790> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_830) mark_dirty [dentry #0x1/dc-dir/dc-file_830 [2,head] auth (dversion lock) pv=5662 v=4066 ino=0x10000000533 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553561e780] 2023-10-03T19:21:07.376 INFO:teuthology.orchestra.run.smithi045.stdout: -8789> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5661 cv=5377/5377 ap=171+170 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=143 | child=1 dirty=1 authpin=1 0x565534f82400] version 5661 2023-10-03T19:21:07.376 INFO:teuthology.orchestra.run.smithi045.stdout: -8788> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565534fc2380 v5670 2023-10-03T19:21:07.376 INFO:teuthology.orchestra.run.smithi045.stdout: -8787> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5670 cv=5384/5384 REP dir_auth=0 ap=170+171 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5670 2023-10-03T19:21:07.376 INFO:teuthology.orchestra.run.smithi045.stdout: -8786> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565534fc2260 v5663 2023-10-03T19:21:07.376 INFO:teuthology.orchestra.run.smithi045.stdout: -8785> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5663 cv=5377/5377 ap=171+170 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=143 | child=1 dirty=1 authpin=1 0x565534f82400] version 5663 2023-10-03T19:21:07.376 INFO:teuthology.orchestra.run.smithi045.stdout: -8784> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=170 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=170 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.376 INFO:teuthology.orchestra.run.smithi045.stdout: -8783> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=170) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5669 pv6007 ap=171 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=171) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=170) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.376 INFO:teuthology.orchestra.run.smithi045.stdout: -8782> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=171) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5669 pv6007 ap=171 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=171) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=169) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.377 INFO:teuthology.orchestra.run.smithi045.stdout: -8781> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000533 [2,head] /dc-dir/dc-file_830 auth v5662 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.416650+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535620b00] 2023-10-03T19:21:07.377 INFO:teuthology.orchestra.run.smithi045.stdout: -8780> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000533 [2,head] /dc-dir/dc-file_830 auth v5662 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.416650+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535620b00] 2023-10-03T19:21:07.377 INFO:teuthology.orchestra.run.smithi045.stdout: -8779> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.377 INFO:teuthology.orchestra.run.smithi045.stdout: -8778> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.377 INFO:teuthology.orchestra.run.smithi045.stdout: -8777> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.377 INFO:teuthology.orchestra.run.smithi045.stdout: -8776> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000533 [2,head] /dc-dir/dc-file_830 auth v5662 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.416650+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535620b00] 2023-10-03T19:21:07.377 INFO:teuthology.orchestra.run.smithi045.stdout: -8775> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000533 [2,head] /dc-dir/dc-file_830 auth v5662 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.416650+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535620b00] 2023-10-03T19:21:07.377 INFO:teuthology.orchestra.run.smithi045.stdout: -8774> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.377 INFO:teuthology.orchestra.run.smithi045.stdout: -8773> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 559.651, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.60e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1122.1] 2023-10-03T19:21:07.378 INFO:teuthology.orchestra.run.smithi045.stdout: -8772> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535429440 on [dir 0x1 / [2,head] auth pv=6008 v=5670 cv=5384/5384 REP dir_auth=0 ap=169+171 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 169 2023-10-03T19:21:07.378 INFO:teuthology.orchestra.run.smithi045.stdout: -8771> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535429440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5669 pv6007 ap=170 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=170) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=169) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 170 2023-10-03T19:21:07.378 INFO:teuthology.orchestra.run.smithi045.stdout: -8770> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5670 cv=5384/5384 REP dir_auth=0 ap=169+170 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535429440 count now 169/170 2023-10-03T19:21:07.378 INFO:teuthology.orchestra.run.smithi045.stdout: -8769> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535429440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5663 cv=5377/5377 ap=170+170 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=143 | child=1 dirty=1 authpin=1 0x565534f82400] count now 170 2023-10-03T19:21:07.378 INFO:teuthology.orchestra.run.smithi045.stdout: -8768> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000533) auth_unpin by 0x565535429440 on [inode 0x10000000533 [2,head] /dc-dir/dc-file_830 auth v5662 s=3 n(v0 rc2023-10-03T19:17:08.416650+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535620b00] now 0 2023-10-03T19:21:07.378 INFO:teuthology.orchestra.run.smithi045.stdout: -8767> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5663 cv=5377/5377 ap=170+169 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=143 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535429440 count now 170/169 2023-10-03T19:21:07.378 INFO:teuthology.orchestra.run.smithi045.stdout: -8766> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.378 INFO:teuthology.orchestra.run.smithi045.stdout: -8765> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.378 INFO:teuthology.orchestra.run.smithi045.stdout: -8764> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000534 [2,head] /dc-dir/dc-file_831 auth v4070 pv5664 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.429086+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.429086+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535621080] 2023-10-03T19:21:07.378 INFO:teuthology.orchestra.run.smithi045.stdout: -8763> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5671 2023-10-03T19:21:07.378 INFO:teuthology.orchestra.run.smithi045.stdout: -8762> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5671 pv6007 ap=170 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=170) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=169) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.379 INFO:teuthology.orchestra.run.smithi045.stdout: -8761> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5669 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.379 INFO:teuthology.orchestra.run.smithi045.stdout: -8760> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5670 cv=5384/5384 REP dir_auth=0 ap=169+170 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5670 2023-10-03T19:21:07.379 INFO:teuthology.orchestra.run.smithi045.stdout: -8759> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000534) pop_and_dirty_projected_inode v5664 2023-10-03T19:21:07.379 INFO:teuthology.orchestra.run.smithi045.stdout: -8758> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000534) mark_dirty [inode 0x10000000534 [2,head] /dc-dir/dc-file_831 auth v5664 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.429086+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535621080] 2023-10-03T19:21:07.379 INFO:teuthology.orchestra.run.smithi045.stdout: -8757> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_831) mark_dirty [dentry #0x1/dc-dir/dc-file_831 [2,head] auth (dversion lock) pv=5664 v=4070 ino=0x10000000534 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553561ea00] 2023-10-03T19:21:07.379 INFO:teuthology.orchestra.run.smithi045.stdout: -8756> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5663 cv=5377/5377 ap=170+169 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=144 | child=1 dirty=1 authpin=1 0x565534f82400] version 5663 2023-10-03T19:21:07.379 INFO:teuthology.orchestra.run.smithi045.stdout: -8755> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565534fc25c0 v5672 2023-10-03T19:21:07.379 INFO:teuthology.orchestra.run.smithi045.stdout: -8754> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5672 cv=5384/5384 REP dir_auth=0 ap=169+170 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5672 2023-10-03T19:21:07.379 INFO:teuthology.orchestra.run.smithi045.stdout: -8753> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565534fc24a0 v5665 2023-10-03T19:21:07.380 INFO:teuthology.orchestra.run.smithi045.stdout: -8752> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5665 cv=5377/5377 ap=170+169 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=144 | child=1 dirty=1 authpin=1 0x565534f82400] version 5665 2023-10-03T19:21:07.380 INFO:teuthology.orchestra.run.smithi045.stdout: -8751> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=169 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=169 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.380 INFO:teuthology.orchestra.run.smithi045.stdout: -8750> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=169) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5671 pv6007 ap=170 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=170) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=169) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.380 INFO:teuthology.orchestra.run.smithi045.stdout: -8749> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=170) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5671 pv6007 ap=170 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=170) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=168) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.380 INFO:teuthology.orchestra.run.smithi045.stdout: -8748> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000534 [2,head] /dc-dir/dc-file_831 auth v5664 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.429086+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535621080] 2023-10-03T19:21:07.380 INFO:teuthology.orchestra.run.smithi045.stdout: -8747> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000534 [2,head] /dc-dir/dc-file_831 auth v5664 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.429086+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535621080] 2023-10-03T19:21:07.380 INFO:teuthology.orchestra.run.smithi045.stdout: -8746> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.380 INFO:teuthology.orchestra.run.smithi045.stdout: -8745> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.380 INFO:teuthology.orchestra.run.smithi045.stdout: -8744> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.380 INFO:teuthology.orchestra.run.smithi045.stdout: -8743> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000534 [2,head] /dc-dir/dc-file_831 auth v5664 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.429086+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535621080] 2023-10-03T19:21:07.380 INFO:teuthology.orchestra.run.smithi045.stdout: -8742> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000534 [2,head] /dc-dir/dc-file_831 auth v5664 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.429086+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535621080] 2023-10-03T19:21:07.381 INFO:teuthology.orchestra.run.smithi045.stdout: -8741> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.381 INFO:teuthology.orchestra.run.smithi045.stdout: -8740> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 560.651, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.61e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1124.1] 2023-10-03T19:21:07.381 INFO:teuthology.orchestra.run.smithi045.stdout: -8739> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535429200 on [dir 0x1 / [2,head] auth pv=6008 v=5672 cv=5384/5384 REP dir_auth=0 ap=168+170 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 168 2023-10-03T19:21:07.381 INFO:teuthology.orchestra.run.smithi045.stdout: -8738> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535429200 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5671 pv6007 ap=169 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=169) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=168) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 169 2023-10-03T19:21:07.381 INFO:teuthology.orchestra.run.smithi045.stdout: -8737> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5672 cv=5384/5384 REP dir_auth=0 ap=168+169 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535429200 count now 168/169 2023-10-03T19:21:07.381 INFO:teuthology.orchestra.run.smithi045.stdout: -8736> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535429200 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5665 cv=5377/5377 ap=169+169 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=144 | child=1 dirty=1 authpin=1 0x565534f82400] count now 169 2023-10-03T19:21:07.399 INFO:teuthology.orchestra.run.smithi045.stdout: -8735> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000534) auth_unpin by 0x565535429200 on [inode 0x10000000534 [2,head] /dc-dir/dc-file_831 auth v5664 s=3 n(v0 rc2023-10-03T19:17:08.429086+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535621080] now 0 2023-10-03T19:21:07.399 INFO:teuthology.orchestra.run.smithi045.stdout: -8734> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5665 cv=5377/5377 ap=169+168 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=144 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535429200 count now 169/168 2023-10-03T19:21:07.400 INFO:teuthology.orchestra.run.smithi045.stdout: -8733> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.400 INFO:teuthology.orchestra.run.smithi045.stdout: -8732> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.400 INFO:teuthology.orchestra.run.smithi045.stdout: -8731> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000535 [2,head] /dc-dir/dc-file_832 auth v4074 pv5666 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.440688+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.440688+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535621600] 2023-10-03T19:21:07.400 INFO:teuthology.orchestra.run.smithi045.stdout: -8730> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5673 2023-10-03T19:21:07.400 INFO:teuthology.orchestra.run.smithi045.stdout: -8729> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5673 pv6007 ap=169 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=169) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=168) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.400 INFO:teuthology.orchestra.run.smithi045.stdout: -8728> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5671 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.400 INFO:teuthology.orchestra.run.smithi045.stdout: -8727> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5672 cv=5384/5384 REP dir_auth=0 ap=168+169 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5672 2023-10-03T19:21:07.400 INFO:teuthology.orchestra.run.smithi045.stdout: -8726> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000535) pop_and_dirty_projected_inode v5666 2023-10-03T19:21:07.400 INFO:teuthology.orchestra.run.smithi045.stdout: -8725> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000535) mark_dirty [inode 0x10000000535 [2,head] /dc-dir/dc-file_832 auth v5666 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.440688+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535621600] 2023-10-03T19:21:07.400 INFO:teuthology.orchestra.run.smithi045.stdout: -8724> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_832) mark_dirty [dentry #0x1/dc-dir/dc-file_832 [2,head] auth (dversion lock) pv=5666 v=4074 ino=0x10000000535 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553561ec80] 2023-10-03T19:21:07.400 INFO:teuthology.orchestra.run.smithi045.stdout: -8723> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5665 cv=5377/5377 ap=169+168 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=145 | child=1 dirty=1 authpin=1 0x565534f82400] version 5665 2023-10-03T19:21:07.401 INFO:teuthology.orchestra.run.smithi045.stdout: -8722> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565534fc2800 v5674 2023-10-03T19:21:07.401 INFO:teuthology.orchestra.run.smithi045.stdout: -8721> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5674 cv=5384/5384 REP dir_auth=0 ap=168+169 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5674 2023-10-03T19:21:07.401 INFO:teuthology.orchestra.run.smithi045.stdout: -8720> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565534fc26e0 v5667 2023-10-03T19:21:07.401 INFO:teuthology.orchestra.run.smithi045.stdout: -8719> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5667 cv=5377/5377 ap=169+168 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=145 | child=1 dirty=1 authpin=1 0x565534f82400] version 5667 2023-10-03T19:21:07.401 INFO:teuthology.orchestra.run.smithi045.stdout: -8718> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=168 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=168 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.401 INFO:teuthology.orchestra.run.smithi045.stdout: -8717> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=168) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5673 pv6007 ap=169 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=169) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=168) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.401 INFO:teuthology.orchestra.run.smithi045.stdout: -8716> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=169) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5673 pv6007 ap=169 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=169) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=167) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.401 INFO:teuthology.orchestra.run.smithi045.stdout: -8715> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000535 [2,head] /dc-dir/dc-file_832 auth v5666 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.440688+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535621600] 2023-10-03T19:21:07.401 INFO:teuthology.orchestra.run.smithi045.stdout: -8714> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000535 [2,head] /dc-dir/dc-file_832 auth v5666 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.440688+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535621600] 2023-10-03T19:21:07.401 INFO:teuthology.orchestra.run.smithi045.stdout: -8713> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.402 INFO:teuthology.orchestra.run.smithi045.stdout: -8712> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.402 INFO:teuthology.orchestra.run.smithi045.stdout: -8711> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.402 INFO:teuthology.orchestra.run.smithi045.stdout: -8710> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000535 [2,head] /dc-dir/dc-file_832 auth v5666 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.440688+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535621600] 2023-10-03T19:21:07.402 INFO:teuthology.orchestra.run.smithi045.stdout: -8709> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000535 [2,head] /dc-dir/dc-file_832 auth v5666 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.440688+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535621600] 2023-10-03T19:21:07.402 INFO:teuthology.orchestra.run.smithi045.stdout: -8708> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.402 INFO:teuthology.orchestra.run.smithi045.stdout: -8707> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 561.651, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.62e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1126.1] 2023-10-03T19:21:07.402 INFO:teuthology.orchestra.run.smithi045.stdout: -8706> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655354b66c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5673 pv6007 ap=168 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=168) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=167) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 168 2023-10-03T19:21:07.402 INFO:teuthology.orchestra.run.smithi045.stdout: -8705> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5674 cv=5384/5384 REP dir_auth=0 ap=168+168 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655354b66c0 count now 168/168 2023-10-03T19:21:07.402 INFO:teuthology.orchestra.run.smithi045.stdout: -8704> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655354b66c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5667 cv=5377/5377 ap=168+168 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=145 | child=1 dirty=1 authpin=1 0x565534f82400] count now 168 2023-10-03T19:21:07.402 INFO:teuthology.orchestra.run.smithi045.stdout: -8703> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655354b66c0 on [dir 0x1 / [2,head] auth pv=6008 v=5674 cv=5384/5384 REP dir_auth=0 ap=167+168 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 167 2023-10-03T19:21:07.403 INFO:teuthology.orchestra.run.smithi045.stdout: -8702> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000535) auth_unpin by 0x5655354b66c0 on [inode 0x10000000535 [2,head] /dc-dir/dc-file_832 auth v5666 s=3 n(v0 rc2023-10-03T19:17:08.440688+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535621600] now 0 2023-10-03T19:21:07.403 INFO:teuthology.orchestra.run.smithi045.stdout: -8701> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5667 cv=5377/5377 ap=168+167 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=145 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655354b66c0 count now 168/167 2023-10-03T19:21:07.403 INFO:teuthology.orchestra.run.smithi045.stdout: -8700> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.403 INFO:teuthology.orchestra.run.smithi045.stdout: -8699> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.403 INFO:teuthology.orchestra.run.smithi045.stdout: -8698> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000536 [2,head] /dc-dir/dc-file_833 auth v4078 pv5668 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.452631+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.452631+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535621b80] 2023-10-03T19:21:07.403 INFO:teuthology.orchestra.run.smithi045.stdout: -8697> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5675 2023-10-03T19:21:07.403 INFO:teuthology.orchestra.run.smithi045.stdout: -8696> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5675 pv6007 ap=168 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=168) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=167) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.403 INFO:teuthology.orchestra.run.smithi045.stdout: -8695> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5673 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.403 INFO:teuthology.orchestra.run.smithi045.stdout: -8694> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5674 cv=5384/5384 REP dir_auth=0 ap=167+168 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5674 2023-10-03T19:21:07.403 INFO:teuthology.orchestra.run.smithi045.stdout: -8693> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000536) pop_and_dirty_projected_inode v5668 2023-10-03T19:21:07.403 INFO:teuthology.orchestra.run.smithi045.stdout: -8692> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000536) mark_dirty [inode 0x10000000536 [2,head] /dc-dir/dc-file_833 auth v5668 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.452631+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535621b80] 2023-10-03T19:21:07.404 INFO:teuthology.orchestra.run.smithi045.stdout: -8691> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_833) mark_dirty [dentry #0x1/dc-dir/dc-file_833 [2,head] auth (dversion lock) pv=5668 v=4078 ino=0x10000000536 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553561ef00] 2023-10-03T19:21:07.404 INFO:teuthology.orchestra.run.smithi045.stdout: -8690> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5667 cv=5377/5377 ap=168+167 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=146 | child=1 dirty=1 authpin=1 0x565534f82400] version 5667 2023-10-03T19:21:07.404 INFO:teuthology.orchestra.run.smithi045.stdout: -8689> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565534fc2a40 v5676 2023-10-03T19:21:07.404 INFO:teuthology.orchestra.run.smithi045.stdout: -8688> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5676 cv=5384/5384 REP dir_auth=0 ap=167+168 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5676 2023-10-03T19:21:07.404 INFO:teuthology.orchestra.run.smithi045.stdout: -8687> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565534fc2920 v5669 2023-10-03T19:21:07.404 INFO:teuthology.orchestra.run.smithi045.stdout: -8686> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5669 cv=5377/5377 ap=168+167 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=146 | child=1 dirty=1 authpin=1 0x565534f82400] version 5669 2023-10-03T19:21:07.404 INFO:teuthology.orchestra.run.smithi045.stdout: -8685> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=167 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=167 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.404 INFO:teuthology.orchestra.run.smithi045.stdout: -8684> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=167) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5675 pv6007 ap=168 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=168) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=167) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.404 INFO:teuthology.orchestra.run.smithi045.stdout: -8683> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=168) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5675 pv6007 ap=168 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=168) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=166) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.404 INFO:teuthology.orchestra.run.smithi045.stdout: -8682> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000536 [2,head] /dc-dir/dc-file_833 auth v5668 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.452631+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535621b80] 2023-10-03T19:21:07.405 INFO:teuthology.orchestra.run.smithi045.stdout: -8681> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000536 [2,head] /dc-dir/dc-file_833 auth v5668 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.452631+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535621b80] 2023-10-03T19:21:07.405 INFO:teuthology.orchestra.run.smithi045.stdout: -8680> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.405 INFO:teuthology.orchestra.run.smithi045.stdout: -8679> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.405 INFO:teuthology.orchestra.run.smithi045.stdout: -8678> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.405 INFO:teuthology.orchestra.run.smithi045.stdout: -8677> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000536 [2,head] /dc-dir/dc-file_833 auth v5668 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.452631+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535621b80] 2023-10-03T19:21:07.405 INFO:teuthology.orchestra.run.smithi045.stdout: -8676> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000536 [2,head] /dc-dir/dc-file_833 auth v5668 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.452631+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535621b80] 2023-10-03T19:21:07.405 INFO:teuthology.orchestra.run.smithi045.stdout: -8675> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.405 INFO:teuthology.orchestra.run.smithi045.stdout: -8674> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 562.651, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.63e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1128.1] 2023-10-03T19:21:07.405 INFO:teuthology.orchestra.run.smithi045.stdout: -8673> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655354298c0 on [dir 0x1 / [2,head] auth pv=6008 v=5676 cv=5384/5384 REP dir_auth=0 ap=166+168 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 166 2023-10-03T19:21:07.405 INFO:teuthology.orchestra.run.smithi045.stdout: -8672> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655354298c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5675 pv6007 ap=167 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=167) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=166) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 167 2023-10-03T19:21:07.444 INFO:teuthology.orchestra.run.smithi045.stdout: -8671> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5676 cv=5384/5384 REP dir_auth=0 ap=166+167 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655354298c0 count now 166/167 2023-10-03T19:21:07.444 INFO:teuthology.orchestra.run.smithi045.stdout: -8670> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655354298c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5669 cv=5377/5377 ap=167+167 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=146 | child=1 dirty=1 authpin=1 0x565534f82400] count now 167 2023-10-03T19:21:07.444 INFO:teuthology.orchestra.run.smithi045.stdout: -8669> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000536) auth_unpin by 0x5655354298c0 on [inode 0x10000000536 [2,head] /dc-dir/dc-file_833 auth v5668 s=3 n(v0 rc2023-10-03T19:17:08.452631+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535621b80] now 0 2023-10-03T19:21:07.444 INFO:teuthology.orchestra.run.smithi045.stdout: -8668> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5669 cv=5377/5377 ap=167+166 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=146 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655354298c0 count now 167/166 2023-10-03T19:21:07.444 INFO:teuthology.orchestra.run.smithi045.stdout: -8667> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.444 INFO:teuthology.orchestra.run.smithi045.stdout: -8666> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.444 INFO:teuthology.orchestra.run.smithi045.stdout: -8665> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000537 [2,head] /dc-dir/dc-file_834 auth v4082 pv5670 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.463917+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.463917+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535622100] 2023-10-03T19:21:07.445 INFO:teuthology.orchestra.run.smithi045.stdout: -8664> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5677 2023-10-03T19:21:07.445 INFO:teuthology.orchestra.run.smithi045.stdout: -8663> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5677 pv6007 ap=167 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=167) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=166) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.445 INFO:teuthology.orchestra.run.smithi045.stdout: -8662> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5675 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.445 INFO:teuthology.orchestra.run.smithi045.stdout: -8661> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5676 cv=5384/5384 REP dir_auth=0 ap=166+167 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5676 2023-10-03T19:21:07.445 INFO:teuthology.orchestra.run.smithi045.stdout: -8660> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000537) pop_and_dirty_projected_inode v5670 2023-10-03T19:21:07.445 INFO:teuthology.orchestra.run.smithi045.stdout: -8659> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000537) mark_dirty [inode 0x10000000537 [2,head] /dc-dir/dc-file_834 auth v5670 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.463917+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535622100] 2023-10-03T19:21:07.445 INFO:teuthology.orchestra.run.smithi045.stdout: -8658> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_834) mark_dirty [dentry #0x1/dc-dir/dc-file_834 [2,head] auth (dversion lock) pv=5670 v=4082 ino=0x10000000537 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553561f180] 2023-10-03T19:21:07.445 INFO:teuthology.orchestra.run.smithi045.stdout: -8657> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5669 cv=5377/5377 ap=167+166 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=147 | child=1 dirty=1 authpin=1 0x565534f82400] version 5669 2023-10-03T19:21:07.445 INFO:teuthology.orchestra.run.smithi045.stdout: -8656> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565534fc2c80 v5678 2023-10-03T19:21:07.445 INFO:teuthology.orchestra.run.smithi045.stdout: -8655> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5678 cv=5384/5384 REP dir_auth=0 ap=166+167 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5678 2023-10-03T19:21:07.446 INFO:teuthology.orchestra.run.smithi045.stdout: -8654> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565534fc2b60 v5671 2023-10-03T19:21:07.446 INFO:teuthology.orchestra.run.smithi045.stdout: -8653> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5671 cv=5377/5377 ap=167+166 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=147 | child=1 dirty=1 authpin=1 0x565534f82400] version 5671 2023-10-03T19:21:07.446 INFO:teuthology.orchestra.run.smithi045.stdout: -8652> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=166 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=166 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.446 INFO:teuthology.orchestra.run.smithi045.stdout: -8651> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=166) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5677 pv6007 ap=167 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=167) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=166) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.446 INFO:teuthology.orchestra.run.smithi045.stdout: -8650> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=167) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5677 pv6007 ap=167 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=167) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=165) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.446 INFO:teuthology.orchestra.run.smithi045.stdout: -8649> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000537 [2,head] /dc-dir/dc-file_834 auth v5670 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.463917+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535622100] 2023-10-03T19:21:07.446 INFO:teuthology.orchestra.run.smithi045.stdout: -8648> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000537 [2,head] /dc-dir/dc-file_834 auth v5670 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.463917+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535622100] 2023-10-03T19:21:07.446 INFO:teuthology.orchestra.run.smithi045.stdout: -8647> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.446 INFO:teuthology.orchestra.run.smithi045.stdout: -8646> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.446 INFO:teuthology.orchestra.run.smithi045.stdout: -8645> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.446 INFO:teuthology.orchestra.run.smithi045.stdout: -8644> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000537 [2,head] /dc-dir/dc-file_834 auth v5670 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.463917+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535622100] 2023-10-03T19:21:07.447 INFO:teuthology.orchestra.run.smithi045.stdout: -8643> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000537 [2,head] /dc-dir/dc-file_834 auth v5670 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.463917+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535622100] 2023-10-03T19:21:07.447 INFO:teuthology.orchestra.run.smithi045.stdout: -8642> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.447 INFO:teuthology.orchestra.run.smithi045.stdout: -8641> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 563.651, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.64e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1130.1] 2023-10-03T19:21:07.447 INFO:teuthology.orchestra.run.smithi045.stdout: -8640> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x56553549b8c0 on [dir 0x1 / [2,head] auth pv=6008 v=5678 cv=5384/5384 REP dir_auth=0 ap=165+167 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 165 2023-10-03T19:21:07.447 INFO:teuthology.orchestra.run.smithi045.stdout: -8639> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x56553549b8c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5677 pv6007 ap=166 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=166) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=165) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 166 2023-10-03T19:21:07.447 INFO:teuthology.orchestra.run.smithi045.stdout: -8638> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5678 cv=5384/5384 REP dir_auth=0 ap=165+166 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x56553549b8c0 count now 165/166 2023-10-03T19:21:07.447 INFO:teuthology.orchestra.run.smithi045.stdout: -8637> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x56553549b8c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5671 cv=5377/5377 ap=166+166 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=147 | child=1 dirty=1 authpin=1 0x565534f82400] count now 166 2023-10-03T19:21:07.448 INFO:teuthology.orchestra.run.smithi045.stdout: -8636> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000537) auth_unpin by 0x56553549b8c0 on [inode 0x10000000537 [2,head] /dc-dir/dc-file_834 auth v5670 s=3 n(v0 rc2023-10-03T19:17:08.463917+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535622100] now 0 2023-10-03T19:21:07.448 INFO:teuthology.orchestra.run.smithi045.stdout: -8635> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5671 cv=5377/5377 ap=166+165 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=147 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x56553549b8c0 count now 166/165 2023-10-03T19:21:07.448 INFO:teuthology.orchestra.run.smithi045.stdout: -8634> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.448 INFO:teuthology.orchestra.run.smithi045.stdout: -8633> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.448 INFO:teuthology.orchestra.run.smithi045.stdout: -8632> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000538 [2,head] /dc-dir/dc-file_835 auth v4086 pv5672 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.475760+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.475760+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535622680] 2023-10-03T19:21:07.448 INFO:teuthology.orchestra.run.smithi045.stdout: -8631> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5679 2023-10-03T19:21:07.448 INFO:teuthology.orchestra.run.smithi045.stdout: -8630> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5679 pv6007 ap=166 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=166) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=165) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.448 INFO:teuthology.orchestra.run.smithi045.stdout: -8629> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5677 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.448 INFO:teuthology.orchestra.run.smithi045.stdout: -8628> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5678 cv=5384/5384 REP dir_auth=0 ap=165+166 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5678 2023-10-03T19:21:07.448 INFO:teuthology.orchestra.run.smithi045.stdout: -8627> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000538) pop_and_dirty_projected_inode v5672 2023-10-03T19:21:07.449 INFO:teuthology.orchestra.run.smithi045.stdout: -8626> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000538) mark_dirty [inode 0x10000000538 [2,head] /dc-dir/dc-file_835 auth v5672 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.475760+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535622680] 2023-10-03T19:21:07.449 INFO:teuthology.orchestra.run.smithi045.stdout: -8625> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_835) mark_dirty [dentry #0x1/dc-dir/dc-file_835 [2,head] auth (dversion lock) pv=5672 v=4086 ino=0x10000000538 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553561f400] 2023-10-03T19:21:07.449 INFO:teuthology.orchestra.run.smithi045.stdout: -8624> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5671 cv=5377/5377 ap=166+165 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=148 | child=1 dirty=1 authpin=1 0x565534f82400] version 5671 2023-10-03T19:21:07.449 INFO:teuthology.orchestra.run.smithi045.stdout: -8623> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565534fc2ec0 v5680 2023-10-03T19:21:07.449 INFO:teuthology.orchestra.run.smithi045.stdout: -8622> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5680 cv=5384/5384 REP dir_auth=0 ap=165+166 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5680 2023-10-03T19:21:07.449 INFO:teuthology.orchestra.run.smithi045.stdout: -8621> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565534fc2da0 v5673 2023-10-03T19:21:07.449 INFO:teuthology.orchestra.run.smithi045.stdout: -8620> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5673 cv=5377/5377 ap=166+165 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=148 | child=1 dirty=1 authpin=1 0x565534f82400] version 5673 2023-10-03T19:21:07.449 INFO:teuthology.orchestra.run.smithi045.stdout: -8619> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=165 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=165 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.449 INFO:teuthology.orchestra.run.smithi045.stdout: -8618> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=165) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5679 pv6007 ap=166 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=166) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=165) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.450 INFO:teuthology.orchestra.run.smithi045.stdout: -8617> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=166) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5679 pv6007 ap=166 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=166) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=164) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.450 INFO:teuthology.orchestra.run.smithi045.stdout: -8616> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000538 [2,head] /dc-dir/dc-file_835 auth v5672 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.475760+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535622680] 2023-10-03T19:21:07.450 INFO:teuthology.orchestra.run.smithi045.stdout: -8615> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000538 [2,head] /dc-dir/dc-file_835 auth v5672 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.475760+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535622680] 2023-10-03T19:21:07.450 INFO:teuthology.orchestra.run.smithi045.stdout: -8614> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.450 INFO:teuthology.orchestra.run.smithi045.stdout: -8613> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.450 INFO:teuthology.orchestra.run.smithi045.stdout: -8612> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.450 INFO:teuthology.orchestra.run.smithi045.stdout: -8611> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000538 [2,head] /dc-dir/dc-file_835 auth v5672 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.475760+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535622680] 2023-10-03T19:21:07.490 INFO:teuthology.orchestra.run.smithi045.stdout: -8610> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000538 [2,head] /dc-dir/dc-file_835 auth v5672 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.475760+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535622680] 2023-10-03T19:21:07.490 INFO:teuthology.orchestra.run.smithi045.stdout: -8609> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.490 INFO:teuthology.orchestra.run.smithi045.stdout: -8608> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 564.651, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.65e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1132.1] 2023-10-03T19:21:07.490 INFO:teuthology.orchestra.run.smithi045.stdout: -8607> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535438b40 on [dir 0x1 / [2,head] auth pv=6008 v=5680 cv=5384/5384 REP dir_auth=0 ap=164+166 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 164 2023-10-03T19:21:07.490 INFO:teuthology.orchestra.run.smithi045.stdout: -8606> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535438b40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5673 cv=5377/5377 ap=165+165 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=148 | child=1 dirty=1 authpin=1 0x565534f82400] count now 165 2023-10-03T19:21:07.490 INFO:teuthology.orchestra.run.smithi045.stdout: -8605> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535438b40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5679 pv6007 ap=165 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=165) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=164) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 165 2023-10-03T19:21:07.490 INFO:teuthology.orchestra.run.smithi045.stdout: -8604> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5680 cv=5384/5384 REP dir_auth=0 ap=164+165 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535438b40 count now 164/165 2023-10-03T19:21:07.490 INFO:teuthology.orchestra.run.smithi045.stdout: -8603> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000538) auth_unpin by 0x565535438b40 on [inode 0x10000000538 [2,head] /dc-dir/dc-file_835 auth v5672 s=3 n(v0 rc2023-10-03T19:17:08.475760+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535622680] now 0 2023-10-03T19:21:07.490 INFO:teuthology.orchestra.run.smithi045.stdout: -8602> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5673 cv=5377/5377 ap=165+164 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=148 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535438b40 count now 165/164 2023-10-03T19:21:07.491 INFO:teuthology.orchestra.run.smithi045.stdout: -8601> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.491 INFO:teuthology.orchestra.run.smithi045.stdout: -8600> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.491 INFO:teuthology.orchestra.run.smithi045.stdout: -8599> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000539 [2,head] /dc-dir/dc-file_836 auth v4090 pv5674 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.488193+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.488193+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535622c00] 2023-10-03T19:21:07.491 INFO:teuthology.orchestra.run.smithi045.stdout: -8598> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5681 2023-10-03T19:21:07.491 INFO:teuthology.orchestra.run.smithi045.stdout: -8597> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5681 pv6007 ap=165 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=165) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=164) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.491 INFO:teuthology.orchestra.run.smithi045.stdout: -8596> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5679 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.491 INFO:teuthology.orchestra.run.smithi045.stdout: -8595> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5680 cv=5384/5384 REP dir_auth=0 ap=164+165 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5680 2023-10-03T19:21:07.491 INFO:teuthology.orchestra.run.smithi045.stdout: -8594> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000539) pop_and_dirty_projected_inode v5674 2023-10-03T19:21:07.491 INFO:teuthology.orchestra.run.smithi045.stdout: -8593> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000539) mark_dirty [inode 0x10000000539 [2,head] /dc-dir/dc-file_836 auth v5674 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.488193+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535622c00] 2023-10-03T19:21:07.491 INFO:teuthology.orchestra.run.smithi045.stdout: -8592> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_836) mark_dirty [dentry #0x1/dc-dir/dc-file_836 [2,head] auth (dversion lock) pv=5674 v=4090 ino=0x10000000539 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553561f680] 2023-10-03T19:21:07.492 INFO:teuthology.orchestra.run.smithi045.stdout: -8591> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5673 cv=5377/5377 ap=165+164 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=149 | child=1 dirty=1 authpin=1 0x565534f82400] version 5673 2023-10-03T19:21:07.492 INFO:teuthology.orchestra.run.smithi045.stdout: -8590> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565534fc3100 v5682 2023-10-03T19:21:07.492 INFO:teuthology.orchestra.run.smithi045.stdout: -8589> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5682 cv=5384/5384 REP dir_auth=0 ap=164+165 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5682 2023-10-03T19:21:07.492 INFO:teuthology.orchestra.run.smithi045.stdout: -8588> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565534fc2fe0 v5675 2023-10-03T19:21:07.492 INFO:teuthology.orchestra.run.smithi045.stdout: -8587> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5675 cv=5377/5377 ap=165+164 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=149 | child=1 dirty=1 authpin=1 0x565534f82400] version 5675 2023-10-03T19:21:07.492 INFO:teuthology.orchestra.run.smithi045.stdout: -8586> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=164 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=164 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.492 INFO:teuthology.orchestra.run.smithi045.stdout: -8585> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=164) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5681 pv6007 ap=165 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=165) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=164) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.492 INFO:teuthology.orchestra.run.smithi045.stdout: -8584> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=165) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5681 pv6007 ap=165 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=165) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=163) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.492 INFO:teuthology.orchestra.run.smithi045.stdout: -8583> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000539 [2,head] /dc-dir/dc-file_836 auth v5674 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.488193+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535622c00] 2023-10-03T19:21:07.492 INFO:teuthology.orchestra.run.smithi045.stdout: -8582> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000539 [2,head] /dc-dir/dc-file_836 auth v5674 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.488193+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535622c00] 2023-10-03T19:21:07.493 INFO:teuthology.orchestra.run.smithi045.stdout: -8581> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.493 INFO:teuthology.orchestra.run.smithi045.stdout: -8580> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.493 INFO:teuthology.orchestra.run.smithi045.stdout: -8579> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.493 INFO:teuthology.orchestra.run.smithi045.stdout: -8578> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000539 [2,head] /dc-dir/dc-file_836 auth v5674 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.488193+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535622c00] 2023-10-03T19:21:07.493 INFO:teuthology.orchestra.run.smithi045.stdout: -8577> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000539 [2,head] /dc-dir/dc-file_836 auth v5674 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.488193+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535622c00] 2023-10-03T19:21:07.493 INFO:teuthology.orchestra.run.smithi045.stdout: -8576> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.493 INFO:teuthology.orchestra.run.smithi045.stdout: -8575> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 565.651, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.66e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1134.1] 2023-10-03T19:21:07.493 INFO:teuthology.orchestra.run.smithi045.stdout: -8574> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535442d80 on [dir 0x1 / [2,head] auth pv=6008 v=5682 cv=5384/5384 REP dir_auth=0 ap=163+165 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 163 2023-10-03T19:21:07.493 INFO:teuthology.orchestra.run.smithi045.stdout: -8573> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535442d80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5681 pv6007 ap=164 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=164) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=163) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 164 2023-10-03T19:21:07.493 INFO:teuthology.orchestra.run.smithi045.stdout: -8572> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5682 cv=5384/5384 REP dir_auth=0 ap=163+164 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535442d80 count now 163/164 2023-10-03T19:21:07.494 INFO:teuthology.orchestra.run.smithi045.stdout: -8571> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535442d80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5675 cv=5377/5377 ap=164+164 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=149 | child=1 dirty=1 authpin=1 0x565534f82400] count now 164 2023-10-03T19:21:07.494 INFO:teuthology.orchestra.run.smithi045.stdout: -8570> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000539) auth_unpin by 0x565535442d80 on [inode 0x10000000539 [2,head] /dc-dir/dc-file_836 auth v5674 s=3 n(v0 rc2023-10-03T19:17:08.488193+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535622c00] now 0 2023-10-03T19:21:07.494 INFO:teuthology.orchestra.run.smithi045.stdout: -8569> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5675 cv=5377/5377 ap=164+163 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=149 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535442d80 count now 164/163 2023-10-03T19:21:07.494 INFO:teuthology.orchestra.run.smithi045.stdout: -8568> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.494 INFO:teuthology.orchestra.run.smithi045.stdout: -8567> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.494 INFO:teuthology.orchestra.run.smithi045.stdout: -8566> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000053a [2,head] /dc-dir/dc-file_837 auth v4270 pv5676 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.505621+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.505621+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535623180] 2023-10-03T19:21:07.494 INFO:teuthology.orchestra.run.smithi045.stdout: -8565> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5683 2023-10-03T19:21:07.494 INFO:teuthology.orchestra.run.smithi045.stdout: -8564> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5683 pv6007 ap=164 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=164) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=163) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.494 INFO:teuthology.orchestra.run.smithi045.stdout: -8563> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5681 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.494 INFO:teuthology.orchestra.run.smithi045.stdout: -8562> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5682 cv=5384/5384 REP dir_auth=0 ap=163+164 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5682 2023-10-03T19:21:07.494 INFO:teuthology.orchestra.run.smithi045.stdout: -8561> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000053a) pop_and_dirty_projected_inode v5676 2023-10-03T19:21:07.494 INFO:teuthology.orchestra.run.smithi045.stdout: -8560> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000053a) mark_dirty [inode 0x1000000053a [2,head] /dc-dir/dc-file_837 auth v5676 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.505621+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535623180] 2023-10-03T19:21:07.495 INFO:teuthology.orchestra.run.smithi045.stdout: -8559> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_837) mark_dirty [dentry #0x1/dc-dir/dc-file_837 [2,head] auth (dversion lock) pv=5676 v=4270 ino=0x1000000053a state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553561f900] 2023-10-03T19:21:07.495 INFO:teuthology.orchestra.run.smithi045.stdout: -8558> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5675 cv=5377/5377 ap=164+163 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=150 | child=1 dirty=1 authpin=1 0x565534f82400] version 5675 2023-10-03T19:21:07.495 INFO:teuthology.orchestra.run.smithi045.stdout: -8557> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565534fc3340 v5684 2023-10-03T19:21:07.495 INFO:teuthology.orchestra.run.smithi045.stdout: -8556> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5684 cv=5384/5384 REP dir_auth=0 ap=163+164 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5684 2023-10-03T19:21:07.495 INFO:teuthology.orchestra.run.smithi045.stdout: -8555> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565534fc3220 v5677 2023-10-03T19:21:07.495 INFO:teuthology.orchestra.run.smithi045.stdout: -8554> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5677 cv=5377/5377 ap=164+163 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=150 | child=1 dirty=1 authpin=1 0x565534f82400] version 5677 2023-10-03T19:21:07.495 INFO:teuthology.orchestra.run.smithi045.stdout: -8553> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=163 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=163 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.534 INFO:teuthology.orchestra.run.smithi045.stdout: -8552> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=163) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5683 pv6007 ap=164 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=164) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=163) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.534 INFO:teuthology.orchestra.run.smithi045.stdout: -8551> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=164) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5683 pv6007 ap=164 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=164) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=162) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.534 INFO:teuthology.orchestra.run.smithi045.stdout: -8550> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000053a [2,head] /dc-dir/dc-file_837 auth v5676 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.505621+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535623180] 2023-10-03T19:21:07.534 INFO:teuthology.orchestra.run.smithi045.stdout: -8549> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000053a [2,head] /dc-dir/dc-file_837 auth v5676 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.505621+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535623180] 2023-10-03T19:21:07.534 INFO:teuthology.orchestra.run.smithi045.stdout: -8548> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.534 INFO:teuthology.orchestra.run.smithi045.stdout: -8547> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.534 INFO:teuthology.orchestra.run.smithi045.stdout: -8546> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.535 INFO:teuthology.orchestra.run.smithi045.stdout: -8545> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000053a [2,head] /dc-dir/dc-file_837 auth v5676 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.505621+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535623180] 2023-10-03T19:21:07.535 INFO:teuthology.orchestra.run.smithi045.stdout: -8544> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000053a [2,head] /dc-dir/dc-file_837 auth v5676 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.505621+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535623180] 2023-10-03T19:21:07.535 INFO:teuthology.orchestra.run.smithi045.stdout: -8543> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.535 INFO:teuthology.orchestra.run.smithi045.stdout: -8542> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 566.651, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.67e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1136.1] 2023-10-03T19:21:07.535 INFO:teuthology.orchestra.run.smithi045.stdout: -8541> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655352ac6c0 on [dir 0x1 / [2,head] auth pv=6008 v=5684 cv=5384/5384 REP dir_auth=0 ap=162+164 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 162 2023-10-03T19:21:07.535 INFO:teuthology.orchestra.run.smithi045.stdout: -8540> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655352ac6c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5683 pv6007 ap=163 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=163) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=162) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 163 2023-10-03T19:21:07.535 INFO:teuthology.orchestra.run.smithi045.stdout: -8539> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5684 cv=5384/5384 REP dir_auth=0 ap=162+163 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655352ac6c0 count now 162/163 2023-10-03T19:21:07.535 INFO:teuthology.orchestra.run.smithi045.stdout: -8538> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655352ac6c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5677 cv=5377/5377 ap=163+163 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=150 | child=1 dirty=1 authpin=1 0x565534f82400] count now 163 2023-10-03T19:21:07.535 INFO:teuthology.orchestra.run.smithi045.stdout: -8537> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000053a) auth_unpin by 0x5655352ac6c0 on [inode 0x1000000053a [2,head] /dc-dir/dc-file_837 auth v5676 s=3 n(v0 rc2023-10-03T19:17:08.505621+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535623180] now 0 2023-10-03T19:21:07.535 INFO:teuthology.orchestra.run.smithi045.stdout: -8536> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5677 cv=5377/5377 ap=163+162 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=150 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655352ac6c0 count now 163/162 2023-10-03T19:21:07.535 INFO:teuthology.orchestra.run.smithi045.stdout: -8535> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.536 INFO:teuthology.orchestra.run.smithi045.stdout: -8534> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.536 INFO:teuthology.orchestra.run.smithi045.stdout: -8533> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000053b [2,head] /dc-dir/dc-file_838 auth v4274 pv5678 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.616373+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.616373+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535623700] 2023-10-03T19:21:07.536 INFO:teuthology.orchestra.run.smithi045.stdout: -8532> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5685 2023-10-03T19:21:07.536 INFO:teuthology.orchestra.run.smithi045.stdout: -8531> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5685 pv6007 ap=163 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=163) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=162) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.536 INFO:teuthology.orchestra.run.smithi045.stdout: -8530> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5683 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.536 INFO:teuthology.orchestra.run.smithi045.stdout: -8529> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5684 cv=5384/5384 REP dir_auth=0 ap=162+163 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5684 2023-10-03T19:21:07.536 INFO:teuthology.orchestra.run.smithi045.stdout: -8528> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000053b) pop_and_dirty_projected_inode v5678 2023-10-03T19:21:07.536 INFO:teuthology.orchestra.run.smithi045.stdout: -8527> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000053b) mark_dirty [inode 0x1000000053b [2,head] /dc-dir/dc-file_838 auth v5678 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.616373+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535623700] 2023-10-03T19:21:07.536 INFO:teuthology.orchestra.run.smithi045.stdout: -8526> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_838) mark_dirty [dentry #0x1/dc-dir/dc-file_838 [2,head] auth (dversion lock) pv=5678 v=4274 ino=0x1000000053b state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553561fb80] 2023-10-03T19:21:07.536 INFO:teuthology.orchestra.run.smithi045.stdout: -8525> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5677 cv=5377/5377 ap=163+162 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=151 | child=1 dirty=1 authpin=1 0x565534f82400] version 5677 2023-10-03T19:21:07.537 INFO:teuthology.orchestra.run.smithi045.stdout: -8524> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565534fc3580 v5686 2023-10-03T19:21:07.537 INFO:teuthology.orchestra.run.smithi045.stdout: -8523> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5686 cv=5384/5384 REP dir_auth=0 ap=162+163 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5686 2023-10-03T19:21:07.537 INFO:teuthology.orchestra.run.smithi045.stdout: -8522> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565534fc3460 v5679 2023-10-03T19:21:07.537 INFO:teuthology.orchestra.run.smithi045.stdout: -8521> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5679 cv=5377/5377 ap=163+162 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=151 | child=1 dirty=1 authpin=1 0x565534f82400] version 5679 2023-10-03T19:21:07.537 INFO:teuthology.orchestra.run.smithi045.stdout: -8520> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=162 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=162 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.537 INFO:teuthology.orchestra.run.smithi045.stdout: -8519> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=162) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5685 pv6007 ap=163 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=163) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=162) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.537 INFO:teuthology.orchestra.run.smithi045.stdout: -8518> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=163) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5685 pv6007 ap=163 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=163) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=161) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.537 INFO:teuthology.orchestra.run.smithi045.stdout: -8517> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000053b [2,head] /dc-dir/dc-file_838 auth v5678 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.616373+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535623700] 2023-10-03T19:21:07.537 INFO:teuthology.orchestra.run.smithi045.stdout: -8516> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000053b [2,head] /dc-dir/dc-file_838 auth v5678 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.616373+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535623700] 2023-10-03T19:21:07.537 INFO:teuthology.orchestra.run.smithi045.stdout: -8515> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.538 INFO:teuthology.orchestra.run.smithi045.stdout: -8514> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.538 INFO:teuthology.orchestra.run.smithi045.stdout: -8513> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.538 INFO:teuthology.orchestra.run.smithi045.stdout: -8512> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000053b [2,head] /dc-dir/dc-file_838 auth v5678 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.616373+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535623700] 2023-10-03T19:21:07.538 INFO:teuthology.orchestra.run.smithi045.stdout: -8511> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000053b [2,head] /dc-dir/dc-file_838 auth v5678 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.616373+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535623700] 2023-10-03T19:21:07.538 INFO:teuthology.orchestra.run.smithi045.stdout: -8510> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.538 INFO:teuthology.orchestra.run.smithi045.stdout: -8509> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 567.651, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.68e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1138.1] 2023-10-03T19:21:07.538 INFO:teuthology.orchestra.run.smithi045.stdout: -8508> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655352acb40 on [dir 0x1 / [2,head] auth pv=6008 v=5686 cv=5384/5384 REP dir_auth=0 ap=161+163 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 161 2023-10-03T19:21:07.538 INFO:teuthology.orchestra.run.smithi045.stdout: -8507> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655352acb40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5685 pv6007 ap=162 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=162) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=161) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 162 2023-10-03T19:21:07.538 INFO:teuthology.orchestra.run.smithi045.stdout: -8506> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5686 cv=5384/5384 REP dir_auth=0 ap=161+162 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655352acb40 count now 161/162 2023-10-03T19:21:07.538 INFO:teuthology.orchestra.run.smithi045.stdout: -8505> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655352acb40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5679 cv=5377/5377 ap=162+162 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=151 | child=1 dirty=1 authpin=1 0x565534f82400] count now 162 2023-10-03T19:21:07.539 INFO:teuthology.orchestra.run.smithi045.stdout: -8504> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000053b) auth_unpin by 0x5655352acb40 on [inode 0x1000000053b [2,head] /dc-dir/dc-file_838 auth v5678 s=3 n(v0 rc2023-10-03T19:17:08.616373+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535623700] now 0 2023-10-03T19:21:07.539 INFO:teuthology.orchestra.run.smithi045.stdout: -8503> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5679 cv=5377/5377 ap=162+161 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=151 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655352acb40 count now 162/161 2023-10-03T19:21:07.539 INFO:teuthology.orchestra.run.smithi045.stdout: -8502> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.539 INFO:teuthology.orchestra.run.smithi045.stdout: -8501> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.539 INFO:teuthology.orchestra.run.smithi045.stdout: -8500> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000053c [2,head] /dc-dir/dc-file_839 auth v4278 pv5680 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.627898+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.627898+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535634000] 2023-10-03T19:21:07.539 INFO:teuthology.orchestra.run.smithi045.stdout: -8499> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5687 2023-10-03T19:21:07.539 INFO:teuthology.orchestra.run.smithi045.stdout: -8498> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5687 pv6007 ap=162 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=162) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=161) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.539 INFO:teuthology.orchestra.run.smithi045.stdout: -8497> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5685 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.539 INFO:teuthology.orchestra.run.smithi045.stdout: -8496> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5686 cv=5384/5384 REP dir_auth=0 ap=161+162 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5686 2023-10-03T19:21:07.561 INFO:teuthology.orchestra.run.smithi045.stdout: -8495> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000053c) pop_and_dirty_projected_inode v5680 2023-10-03T19:21:07.561 INFO:teuthology.orchestra.run.smithi045.stdout: -8494> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000053c) mark_dirty [inode 0x1000000053c [2,head] /dc-dir/dc-file_839 auth v5680 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.627898+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535634000] 2023-10-03T19:21:07.562 INFO:teuthology.orchestra.run.smithi045.stdout: -8493> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_839) mark_dirty [dentry #0x1/dc-dir/dc-file_839 [2,head] auth (dversion lock) pv=5680 v=4278 ino=0x1000000053c state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535632000] 2023-10-03T19:21:07.562 INFO:teuthology.orchestra.run.smithi045.stdout: -8492> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5679 cv=5377/5377 ap=162+161 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=152 | child=1 dirty=1 authpin=1 0x565534f82400] version 5679 2023-10-03T19:21:07.562 INFO:teuthology.orchestra.run.smithi045.stdout: -8491> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565534fc37c0 v5688 2023-10-03T19:21:07.562 INFO:teuthology.orchestra.run.smithi045.stdout: -8490> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5688 cv=5384/5384 REP dir_auth=0 ap=161+162 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5688 2023-10-03T19:21:07.562 INFO:teuthology.orchestra.run.smithi045.stdout: -8489> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565534fc36a0 v5681 2023-10-03T19:21:07.562 INFO:teuthology.orchestra.run.smithi045.stdout: -8488> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5681 cv=5377/5377 ap=162+161 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=152 | child=1 dirty=1 authpin=1 0x565534f82400] version 5681 2023-10-03T19:21:07.562 INFO:teuthology.orchestra.run.smithi045.stdout: -8487> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=161 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=161 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.562 INFO:teuthology.orchestra.run.smithi045.stdout: -8486> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=161) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5687 pv6007 ap=162 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=162) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=161) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.563 INFO:teuthology.orchestra.run.smithi045.stdout: -8485> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=162) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5687 pv6007 ap=162 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=162) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=160) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.563 INFO:teuthology.orchestra.run.smithi045.stdout: -8484> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000053c [2,head] /dc-dir/dc-file_839 auth v5680 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.627898+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535634000] 2023-10-03T19:21:07.563 INFO:teuthology.orchestra.run.smithi045.stdout: -8483> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000053c [2,head] /dc-dir/dc-file_839 auth v5680 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.627898+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535634000] 2023-10-03T19:21:07.563 INFO:teuthology.orchestra.run.smithi045.stdout: -8482> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.563 INFO:teuthology.orchestra.run.smithi045.stdout: -8481> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.563 INFO:teuthology.orchestra.run.smithi045.stdout: -8480> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.563 INFO:teuthology.orchestra.run.smithi045.stdout: -8479> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000053c [2,head] /dc-dir/dc-file_839 auth v5680 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.627898+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535634000] 2023-10-03T19:21:07.563 INFO:teuthology.orchestra.run.smithi045.stdout: -8478> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000053c [2,head] /dc-dir/dc-file_839 auth v5680 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.627898+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535634000] 2023-10-03T19:21:07.563 INFO:teuthology.orchestra.run.smithi045.stdout: -8477> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.563 INFO:teuthology.orchestra.run.smithi045.stdout: -8476> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 568.651, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.69e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1140.1] 2023-10-03T19:21:07.563 INFO:teuthology.orchestra.run.smithi045.stdout: -8475> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655352ac000 on [dir 0x1 / [2,head] auth pv=6008 v=5688 cv=5384/5384 REP dir_auth=0 ap=160+162 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 160 2023-10-03T19:21:07.564 INFO:teuthology.orchestra.run.smithi045.stdout: -8474> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655352ac000 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5687 pv6007 ap=161 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=161) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=160) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 161 2023-10-03T19:21:07.564 INFO:teuthology.orchestra.run.smithi045.stdout: -8473> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5688 cv=5384/5384 REP dir_auth=0 ap=160+161 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655352ac000 count now 160/161 2023-10-03T19:21:07.564 INFO:teuthology.orchestra.run.smithi045.stdout: -8472> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655352ac000 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5681 cv=5377/5377 ap=161+161 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=152 | child=1 dirty=1 authpin=1 0x565534f82400] count now 161 2023-10-03T19:21:07.564 INFO:teuthology.orchestra.run.smithi045.stdout: -8471> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000053c) auth_unpin by 0x5655352ac000 on [inode 0x1000000053c [2,head] /dc-dir/dc-file_839 auth v5680 s=3 n(v0 rc2023-10-03T19:17:08.627898+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535634000] now 0 2023-10-03T19:21:07.564 INFO:teuthology.orchestra.run.smithi045.stdout: -8470> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5681 cv=5377/5377 ap=161+160 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=152 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655352ac000 count now 161/160 2023-10-03T19:21:07.564 INFO:teuthology.orchestra.run.smithi045.stdout: -8469> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.564 INFO:teuthology.orchestra.run.smithi045.stdout: -8468> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.564 INFO:teuthology.orchestra.run.smithi045.stdout: -8467> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000053d [2,head] /dc-dir/dc-file_840 auth v4282 pv5682 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.639602+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.639602+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535634580] 2023-10-03T19:21:07.564 INFO:teuthology.orchestra.run.smithi045.stdout: -8466> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5689 2023-10-03T19:21:07.564 INFO:teuthology.orchestra.run.smithi045.stdout: -8465> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5689 pv6007 ap=161 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=161) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=160) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.564 INFO:teuthology.orchestra.run.smithi045.stdout: -8464> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5687 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.565 INFO:teuthology.orchestra.run.smithi045.stdout: -8463> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5688 cv=5384/5384 REP dir_auth=0 ap=160+161 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5688 2023-10-03T19:21:07.565 INFO:teuthology.orchestra.run.smithi045.stdout: -8462> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000053d) pop_and_dirty_projected_inode v5682 2023-10-03T19:21:07.565 INFO:teuthology.orchestra.run.smithi045.stdout: -8461> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000053d) mark_dirty [inode 0x1000000053d [2,head] /dc-dir/dc-file_840 auth v5682 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.639602+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535634580] 2023-10-03T19:21:07.565 INFO:teuthology.orchestra.run.smithi045.stdout: -8460> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_840) mark_dirty [dentry #0x1/dc-dir/dc-file_840 [2,head] auth (dversion lock) pv=5682 v=4282 ino=0x1000000053d state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535632280] 2023-10-03T19:21:07.565 INFO:teuthology.orchestra.run.smithi045.stdout: -8459> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5681 cv=5377/5377 ap=161+160 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=153 | child=1 dirty=1 authpin=1 0x565534f82400] version 5681 2023-10-03T19:21:07.565 INFO:teuthology.orchestra.run.smithi045.stdout: -8458> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565534fc3a00 v5690 2023-10-03T19:21:07.565 INFO:teuthology.orchestra.run.smithi045.stdout: -8457> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5690 cv=5384/5384 REP dir_auth=0 ap=160+161 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5690 2023-10-03T19:21:07.565 INFO:teuthology.orchestra.run.smithi045.stdout: -8456> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565534fc38e0 v5683 2023-10-03T19:21:07.565 INFO:teuthology.orchestra.run.smithi045.stdout: -8455> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5683 cv=5377/5377 ap=161+160 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=153 | child=1 dirty=1 authpin=1 0x565534f82400] version 5683 2023-10-03T19:21:07.565 INFO:teuthology.orchestra.run.smithi045.stdout: -8454> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=160 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=160 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.566 INFO:teuthology.orchestra.run.smithi045.stdout: -8453> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=160) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5689 pv6007 ap=161 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=161) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=160) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.566 INFO:teuthology.orchestra.run.smithi045.stdout: -8452> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=161) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5689 pv6007 ap=161 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=161) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=159) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.566 INFO:teuthology.orchestra.run.smithi045.stdout: -8451> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000053d [2,head] /dc-dir/dc-file_840 auth v5682 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.639602+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535634580] 2023-10-03T19:21:07.566 INFO:teuthology.orchestra.run.smithi045.stdout: -8450> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000053d [2,head] /dc-dir/dc-file_840 auth v5682 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.639602+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535634580] 2023-10-03T19:21:07.566 INFO:teuthology.orchestra.run.smithi045.stdout: -8449> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.566 INFO:teuthology.orchestra.run.smithi045.stdout: -8448> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.566 INFO:teuthology.orchestra.run.smithi045.stdout: -8447> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.566 INFO:teuthology.orchestra.run.smithi045.stdout: -8446> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000053d [2,head] /dc-dir/dc-file_840 auth v5682 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.639602+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535634580] 2023-10-03T19:21:07.566 INFO:teuthology.orchestra.run.smithi045.stdout: -8445> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000053d [2,head] /dc-dir/dc-file_840 auth v5682 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.639602+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535634580] 2023-10-03T19:21:07.566 INFO:teuthology.orchestra.run.smithi045.stdout: -8444> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.566 INFO:teuthology.orchestra.run.smithi045.stdout: -8443> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 569.651, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.70e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1142.1] 2023-10-03T19:21:07.567 INFO:teuthology.orchestra.run.smithi045.stdout: -8442> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655352ac240 on [dir 0x1 / [2,head] auth pv=6008 v=5690 cv=5384/5384 REP dir_auth=0 ap=159+161 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 159 2023-10-03T19:21:07.567 INFO:teuthology.orchestra.run.smithi045.stdout: -8441> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655352ac240 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5689 pv6007 ap=160 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=160) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=159) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 160 2023-10-03T19:21:07.567 INFO:teuthology.orchestra.run.smithi045.stdout: -8440> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5690 cv=5384/5384 REP dir_auth=0 ap=159+160 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655352ac240 count now 159/160 2023-10-03T19:21:07.567 INFO:teuthology.orchestra.run.smithi045.stdout: -8439> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655352ac240 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5683 cv=5377/5377 ap=160+160 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=153 | child=1 dirty=1 authpin=1 0x565534f82400] count now 160 2023-10-03T19:21:07.567 INFO:teuthology.orchestra.run.smithi045.stdout: -8438> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000053d) auth_unpin by 0x5655352ac240 on [inode 0x1000000053d [2,head] /dc-dir/dc-file_840 auth v5682 s=3 n(v0 rc2023-10-03T19:17:08.639602+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535634580] now 0 2023-10-03T19:21:07.567 INFO:teuthology.orchestra.run.smithi045.stdout: -8437> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5683 cv=5377/5377 ap=160+159 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=153 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655352ac240 count now 160/159 2023-10-03T19:21:07.567 INFO:teuthology.orchestra.run.smithi045.stdout: -8436> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.567 INFO:teuthology.orchestra.run.smithi045.stdout: -8435> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.567 INFO:teuthology.orchestra.run.smithi045.stdout: -8434> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000053e [2,head] /dc-dir/dc-file_841 auth v4286 pv5684 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.651219+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.651219+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535634b00] 2023-10-03T19:21:07.567 INFO:teuthology.orchestra.run.smithi045.stdout: -8433> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5691 2023-10-03T19:21:07.602 INFO:teuthology.orchestra.run.smithi045.stdout: -8432> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5691 pv6007 ap=160 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=160) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=159) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.602 INFO:teuthology.orchestra.run.smithi045.stdout: -8431> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5689 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.602 INFO:teuthology.orchestra.run.smithi045.stdout: -8430> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5690 cv=5384/5384 REP dir_auth=0 ap=159+160 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5690 2023-10-03T19:21:07.602 INFO:teuthology.orchestra.run.smithi045.stdout: -8429> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000053e) pop_and_dirty_projected_inode v5684 2023-10-03T19:21:07.602 INFO:teuthology.orchestra.run.smithi045.stdout: -8428> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000053e) mark_dirty [inode 0x1000000053e [2,head] /dc-dir/dc-file_841 auth v5684 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.651219+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535634b00] 2023-10-03T19:21:07.602 INFO:teuthology.orchestra.run.smithi045.stdout: -8427> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_841) mark_dirty [dentry #0x1/dc-dir/dc-file_841 [2,head] auth (dversion lock) pv=5684 v=4286 ino=0x1000000053e state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535632500] 2023-10-03T19:21:07.602 INFO:teuthology.orchestra.run.smithi045.stdout: -8426> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5683 cv=5377/5377 ap=160+159 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=154 | child=1 dirty=1 authpin=1 0x565534f82400] version 5683 2023-10-03T19:21:07.603 INFO:teuthology.orchestra.run.smithi045.stdout: -8425> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565534fc3c40 v5692 2023-10-03T19:21:07.603 INFO:teuthology.orchestra.run.smithi045.stdout: -8424> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5692 cv=5384/5384 REP dir_auth=0 ap=159+160 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5692 2023-10-03T19:21:07.603 INFO:teuthology.orchestra.run.smithi045.stdout: -8423> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565534fc3b20 v5685 2023-10-03T19:21:07.603 INFO:teuthology.orchestra.run.smithi045.stdout: -8422> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5685 cv=5377/5377 ap=160+159 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=154 | child=1 dirty=1 authpin=1 0x565534f82400] version 5685 2023-10-03T19:21:07.603 INFO:teuthology.orchestra.run.smithi045.stdout: -8421> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=159 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=159 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.603 INFO:teuthology.orchestra.run.smithi045.stdout: -8420> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=159) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5691 pv6007 ap=160 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=160) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=159) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.603 INFO:teuthology.orchestra.run.smithi045.stdout: -8419> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=160) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5691 pv6007 ap=160 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=160) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=158) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.603 INFO:teuthology.orchestra.run.smithi045.stdout: -8418> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000053e [2,head] /dc-dir/dc-file_841 auth v5684 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.651219+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535634b00] 2023-10-03T19:21:07.603 INFO:teuthology.orchestra.run.smithi045.stdout: -8417> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000053e [2,head] /dc-dir/dc-file_841 auth v5684 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.651219+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535634b00] 2023-10-03T19:21:07.604 INFO:teuthology.orchestra.run.smithi045.stdout: -8416> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.604 INFO:teuthology.orchestra.run.smithi045.stdout: -8415> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.604 INFO:teuthology.orchestra.run.smithi045.stdout: -8414> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.604 INFO:teuthology.orchestra.run.smithi045.stdout: -8413> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000053e [2,head] /dc-dir/dc-file_841 auth v5684 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.651219+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535634b00] 2023-10-03T19:21:07.604 INFO:teuthology.orchestra.run.smithi045.stdout: -8412> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000053e [2,head] /dc-dir/dc-file_841 auth v5684 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.651219+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535634b00] 2023-10-03T19:21:07.604 INFO:teuthology.orchestra.run.smithi045.stdout: -8411> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.604 INFO:teuthology.orchestra.run.smithi045.stdout: -8410> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 570.651, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.71e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1144.1] 2023-10-03T19:21:07.604 INFO:teuthology.orchestra.run.smithi045.stdout: -8409> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655352a6000 on [dir 0x1 / [2,head] auth pv=6008 v=5692 cv=5384/5384 REP dir_auth=0 ap=158+160 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 158 2023-10-03T19:21:07.604 INFO:teuthology.orchestra.run.smithi045.stdout: -8408> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655352a6000 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5685 cv=5377/5377 ap=159+159 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=154 | child=1 dirty=1 authpin=1 0x565534f82400] count now 159 2023-10-03T19:21:07.604 INFO:teuthology.orchestra.run.smithi045.stdout: -8407> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655352a6000 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5691 pv6007 ap=159 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=159) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=158) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 159 2023-10-03T19:21:07.605 INFO:teuthology.orchestra.run.smithi045.stdout: -8406> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5692 cv=5384/5384 REP dir_auth=0 ap=158+159 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655352a6000 count now 158/159 2023-10-03T19:21:07.605 INFO:teuthology.orchestra.run.smithi045.stdout: -8405> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000053e) auth_unpin by 0x5655352a6000 on [inode 0x1000000053e [2,head] /dc-dir/dc-file_841 auth v5684 s=3 n(v0 rc2023-10-03T19:17:08.651219+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535634b00] now 0 2023-10-03T19:21:07.605 INFO:teuthology.orchestra.run.smithi045.stdout: -8404> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5685 cv=5377/5377 ap=159+158 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=154 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655352a6000 count now 159/158 2023-10-03T19:21:07.605 INFO:teuthology.orchestra.run.smithi045.stdout: -8403> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.605 INFO:teuthology.orchestra.run.smithi045.stdout: -8402> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.605 INFO:teuthology.orchestra.run.smithi045.stdout: -8401> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000053f [2,head] /dc-dir/dc-file_842 auth v4290 pv5686 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.662881+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.662881+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535635080] 2023-10-03T19:21:07.605 INFO:teuthology.orchestra.run.smithi045.stdout: -8400> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5693 2023-10-03T19:21:07.605 INFO:teuthology.orchestra.run.smithi045.stdout: -8399> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5693 pv6007 ap=159 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=159) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=158) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.605 INFO:teuthology.orchestra.run.smithi045.stdout: -8398> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5691 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.605 INFO:teuthology.orchestra.run.smithi045.stdout: -8397> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5692 cv=5384/5384 REP dir_auth=0 ap=158+159 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5692 2023-10-03T19:21:07.605 INFO:teuthology.orchestra.run.smithi045.stdout: -8396> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000053f) pop_and_dirty_projected_inode v5686 2023-10-03T19:21:07.606 INFO:teuthology.orchestra.run.smithi045.stdout: -8395> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000053f) mark_dirty [inode 0x1000000053f [2,head] /dc-dir/dc-file_842 auth v5686 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.662881+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535635080] 2023-10-03T19:21:07.606 INFO:teuthology.orchestra.run.smithi045.stdout: -8394> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_842) mark_dirty [dentry #0x1/dc-dir/dc-file_842 [2,head] auth (dversion lock) pv=5686 v=4290 ino=0x1000000053f state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535632780] 2023-10-03T19:21:07.606 INFO:teuthology.orchestra.run.smithi045.stdout: -8393> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5685 cv=5377/5377 ap=159+158 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=155 | child=1 dirty=1 authpin=1 0x565534f82400] version 5685 2023-10-03T19:21:07.606 INFO:teuthology.orchestra.run.smithi045.stdout: -8392> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565534fc3e80 v5694 2023-10-03T19:21:07.606 INFO:teuthology.orchestra.run.smithi045.stdout: -8391> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5694 cv=5384/5384 REP dir_auth=0 ap=158+159 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5694 2023-10-03T19:21:07.606 INFO:teuthology.orchestra.run.smithi045.stdout: -8390> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565534fc3d60 v5687 2023-10-03T19:21:07.606 INFO:teuthology.orchestra.run.smithi045.stdout: -8389> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5687 cv=5377/5377 ap=159+158 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=155 | child=1 dirty=1 authpin=1 0x565534f82400] version 5687 2023-10-03T19:21:07.606 INFO:teuthology.orchestra.run.smithi045.stdout: -8388> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=158 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=158 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.606 INFO:teuthology.orchestra.run.smithi045.stdout: -8387> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=158) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5693 pv6007 ap=159 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=159) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=158) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.606 INFO:teuthology.orchestra.run.smithi045.stdout: -8386> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=159) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5693 pv6007 ap=159 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=159) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=157) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.607 INFO:teuthology.orchestra.run.smithi045.stdout: -8385> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000053f [2,head] /dc-dir/dc-file_842 auth v5686 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.662881+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535635080] 2023-10-03T19:21:07.607 INFO:teuthology.orchestra.run.smithi045.stdout: -8384> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000053f [2,head] /dc-dir/dc-file_842 auth v5686 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.662881+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535635080] 2023-10-03T19:21:07.607 INFO:teuthology.orchestra.run.smithi045.stdout: -8383> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.607 INFO:teuthology.orchestra.run.smithi045.stdout: -8382> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.607 INFO:teuthology.orchestra.run.smithi045.stdout: -8381> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.607 INFO:teuthology.orchestra.run.smithi045.stdout: -8380> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000053f [2,head] /dc-dir/dc-file_842 auth v5686 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.662881+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535635080] 2023-10-03T19:21:07.607 INFO:teuthology.orchestra.run.smithi045.stdout: -8379> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000053f [2,head] /dc-dir/dc-file_842 auth v5686 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.662881+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535635080] 2023-10-03T19:21:07.607 INFO:teuthology.orchestra.run.smithi045.stdout: -8378> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.607 INFO:teuthology.orchestra.run.smithi045.stdout: -8377> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 571.651, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.72e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1146.1] 2023-10-03T19:21:07.607 INFO:teuthology.orchestra.run.smithi045.stdout: -8376> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655352e9680 on [dir 0x1 / [2,head] auth pv=6008 v=5694 cv=5384/5384 REP dir_auth=0 ap=157+159 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 157 2023-10-03T19:21:07.607 INFO:teuthology.orchestra.run.smithi045.stdout: -8375> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655352e9680 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5693 pv6007 ap=158 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=158) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=157) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 158 2023-10-03T19:21:07.608 INFO:teuthology.orchestra.run.smithi045.stdout: -8374> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5694 cv=5384/5384 REP dir_auth=0 ap=157+158 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655352e9680 count now 157/158 2023-10-03T19:21:07.608 INFO:teuthology.orchestra.run.smithi045.stdout: -8373> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655352e9680 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5687 cv=5377/5377 ap=158+158 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=155 | child=1 dirty=1 authpin=1 0x565534f82400] count now 158 2023-10-03T19:21:07.608 INFO:teuthology.orchestra.run.smithi045.stdout: -8372> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000053f) auth_unpin by 0x5655352e9680 on [inode 0x1000000053f [2,head] /dc-dir/dc-file_842 auth v5686 s=3 n(v0 rc2023-10-03T19:17:08.662881+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535635080] now 0 2023-10-03T19:21:07.608 INFO:teuthology.orchestra.run.smithi045.stdout: -8371> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5687 cv=5377/5377 ap=158+157 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=155 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655352e9680 count now 158/157 2023-10-03T19:21:07.608 INFO:teuthology.orchestra.run.smithi045.stdout: -8370> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.608 INFO:teuthology.orchestra.run.smithi045.stdout: -8369> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.608 INFO:teuthology.orchestra.run.smithi045.stdout: -8368> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000540 [2,head] /dc-dir/dc-file_843 auth v4294 pv5688 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.674152+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.674152+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535635600] 2023-10-03T19:21:07.653 INFO:teuthology.orchestra.run.smithi045.stdout: -8367> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5695 2023-10-03T19:21:07.653 INFO:teuthology.orchestra.run.smithi045.stdout: -8366> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5695 pv6007 ap=158 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=158) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=157) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.653 INFO:teuthology.orchestra.run.smithi045.stdout: -8365> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5693 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.653 INFO:teuthology.orchestra.run.smithi045.stdout: -8364> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5694 cv=5384/5384 REP dir_auth=0 ap=157+158 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5694 2023-10-03T19:21:07.653 INFO:teuthology.orchestra.run.smithi045.stdout: -8363> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000540) pop_and_dirty_projected_inode v5688 2023-10-03T19:21:07.654 INFO:teuthology.orchestra.run.smithi045.stdout: -8362> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000540) mark_dirty [inode 0x10000000540 [2,head] /dc-dir/dc-file_843 auth v5688 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.674152+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535635600] 2023-10-03T19:21:07.654 INFO:teuthology.orchestra.run.smithi045.stdout: -8361> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_843) mark_dirty [dentry #0x1/dc-dir/dc-file_843 [2,head] auth (dversion lock) pv=5688 v=4294 ino=0x10000000540 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535632a00] 2023-10-03T19:21:07.654 INFO:teuthology.orchestra.run.smithi045.stdout: -8360> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5687 cv=5377/5377 ap=158+157 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=156 | child=1 dirty=1 authpin=1 0x565534f82400] version 5687 2023-10-03T19:21:07.654 INFO:teuthology.orchestra.run.smithi045.stdout: -8359> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535da6140 v5696 2023-10-03T19:21:07.654 INFO:teuthology.orchestra.run.smithi045.stdout: -8358> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5696 cv=5384/5384 REP dir_auth=0 ap=157+158 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5696 2023-10-03T19:21:07.654 INFO:teuthology.orchestra.run.smithi045.stdout: -8357> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535da6020 v5689 2023-10-03T19:21:07.654 INFO:teuthology.orchestra.run.smithi045.stdout: -8356> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5689 cv=5377/5377 ap=158+157 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=156 | child=1 dirty=1 authpin=1 0x565534f82400] version 5689 2023-10-03T19:21:07.654 INFO:teuthology.orchestra.run.smithi045.stdout: -8355> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=157 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=157 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.654 INFO:teuthology.orchestra.run.smithi045.stdout: -8354> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=157) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5695 pv6007 ap=158 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=158) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=157) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.654 INFO:teuthology.orchestra.run.smithi045.stdout: -8353> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=158) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5695 pv6007 ap=158 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=158) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=156) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.654 INFO:teuthology.orchestra.run.smithi045.stdout: -8352> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000540 [2,head] /dc-dir/dc-file_843 auth v5688 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.674152+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535635600] 2023-10-03T19:21:07.655 INFO:teuthology.orchestra.run.smithi045.stdout: -8351> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000540 [2,head] /dc-dir/dc-file_843 auth v5688 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.674152+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535635600] 2023-10-03T19:21:07.655 INFO:teuthology.orchestra.run.smithi045.stdout: -8350> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.655 INFO:teuthology.orchestra.run.smithi045.stdout: -8349> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.655 INFO:teuthology.orchestra.run.smithi045.stdout: -8348> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.655 INFO:teuthology.orchestra.run.smithi045.stdout: -8347> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000540 [2,head] /dc-dir/dc-file_843 auth v5688 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.674152+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535635600] 2023-10-03T19:21:07.655 INFO:teuthology.orchestra.run.smithi045.stdout: -8346> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000540 [2,head] /dc-dir/dc-file_843 auth v5688 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.674152+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535635600] 2023-10-03T19:21:07.655 INFO:teuthology.orchestra.run.smithi045.stdout: -8345> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.655 INFO:teuthology.orchestra.run.smithi045.stdout: -8344> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 572.651, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.73e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1148.1] 2023-10-03T19:21:07.655 INFO:teuthology.orchestra.run.smithi045.stdout: -8343> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655352acd80 on [dir 0x1 / [2,head] auth pv=6008 v=5696 cv=5384/5384 REP dir_auth=0 ap=156+158 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 156 2023-10-03T19:21:07.656 INFO:teuthology.orchestra.run.smithi045.stdout: -8342> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655352acd80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5695 pv6007 ap=157 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=157) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=156) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 157 2023-10-03T19:21:07.656 INFO:teuthology.orchestra.run.smithi045.stdout: -8341> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5696 cv=5384/5384 REP dir_auth=0 ap=156+157 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655352acd80 count now 156/157 2023-10-03T19:21:07.656 INFO:teuthology.orchestra.run.smithi045.stdout: -8340> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655352acd80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5689 cv=5377/5377 ap=157+157 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=156 | child=1 dirty=1 authpin=1 0x565534f82400] count now 157 2023-10-03T19:21:07.656 INFO:teuthology.orchestra.run.smithi045.stdout: -8339> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000540) auth_unpin by 0x5655352acd80 on [inode 0x10000000540 [2,head] /dc-dir/dc-file_843 auth v5688 s=3 n(v0 rc2023-10-03T19:17:08.674152+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535635600] now 0 2023-10-03T19:21:07.656 INFO:teuthology.orchestra.run.smithi045.stdout: -8338> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5689 cv=5377/5377 ap=157+156 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=156 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655352acd80 count now 157/156 2023-10-03T19:21:07.656 INFO:teuthology.orchestra.run.smithi045.stdout: -8337> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.656 INFO:teuthology.orchestra.run.smithi045.stdout: -8336> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.656 INFO:teuthology.orchestra.run.smithi045.stdout: -8335> 2023-10-03T19:17:19.518+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000541 [2,head] /dc-dir/dc-file_844 auth v4298 pv5690 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.685162+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.685162+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535635b80] 2023-10-03T19:21:07.656 INFO:teuthology.orchestra.run.smithi045.stdout: -8334> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5697 2023-10-03T19:21:07.656 INFO:teuthology.orchestra.run.smithi045.stdout: -8333> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5697 pv6007 ap=157 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=157) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=156) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.656 INFO:teuthology.orchestra.run.smithi045.stdout: -8332> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5695 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.657 INFO:teuthology.orchestra.run.smithi045.stdout: -8331> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5696 cv=5384/5384 REP dir_auth=0 ap=156+157 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5696 2023-10-03T19:21:07.657 INFO:teuthology.orchestra.run.smithi045.stdout: -8330> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000541) pop_and_dirty_projected_inode v5690 2023-10-03T19:21:07.657 INFO:teuthology.orchestra.run.smithi045.stdout: -8329> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000541) mark_dirty [inode 0x10000000541 [2,head] /dc-dir/dc-file_844 auth v5690 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.685162+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535635b80] 2023-10-03T19:21:07.657 INFO:teuthology.orchestra.run.smithi045.stdout: -8328> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_844) mark_dirty [dentry #0x1/dc-dir/dc-file_844 [2,head] auth (dversion lock) pv=5690 v=4298 ino=0x10000000541 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535632c80] 2023-10-03T19:21:07.657 INFO:teuthology.orchestra.run.smithi045.stdout: -8327> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5689 cv=5377/5377 ap=157+156 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=157 | child=1 dirty=1 authpin=1 0x565534f82400] version 5689 2023-10-03T19:21:07.657 INFO:teuthology.orchestra.run.smithi045.stdout: -8326> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535da6380 v5698 2023-10-03T19:21:07.657 INFO:teuthology.orchestra.run.smithi045.stdout: -8325> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5698 cv=5384/5384 REP dir_auth=0 ap=156+157 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5698 2023-10-03T19:21:07.657 INFO:teuthology.orchestra.run.smithi045.stdout: -8324> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535da6260 v5691 2023-10-03T19:21:07.657 INFO:teuthology.orchestra.run.smithi045.stdout: -8323> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5691 cv=5377/5377 ap=157+156 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=157 | child=1 dirty=1 authpin=1 0x565534f82400] version 5691 2023-10-03T19:21:07.657 INFO:teuthology.orchestra.run.smithi045.stdout: -8322> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=156 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=156 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.658 INFO:teuthology.orchestra.run.smithi045.stdout: -8321> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=156) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5697 pv6007 ap=157 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=157) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=156) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.658 INFO:teuthology.orchestra.run.smithi045.stdout: -8320> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=157) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5697 pv6007 ap=157 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=157) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=155) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.658 INFO:teuthology.orchestra.run.smithi045.stdout: -8319> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000541 [2,head] /dc-dir/dc-file_844 auth v5690 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.685162+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535635b80] 2023-10-03T19:21:07.658 INFO:teuthology.orchestra.run.smithi045.stdout: -8318> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000541 [2,head] /dc-dir/dc-file_844 auth v5690 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.685162+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535635b80] 2023-10-03T19:21:07.658 INFO:teuthology.orchestra.run.smithi045.stdout: -8317> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.658 INFO:teuthology.orchestra.run.smithi045.stdout: -8316> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.658 INFO:teuthology.orchestra.run.smithi045.stdout: -8315> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.658 INFO:teuthology.orchestra.run.smithi045.stdout: -8314> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000541 [2,head] /dc-dir/dc-file_844 auth v5690 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.685162+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535635b80] 2023-10-03T19:21:07.658 INFO:teuthology.orchestra.run.smithi045.stdout: -8313> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000541 [2,head] /dc-dir/dc-file_844 auth v5690 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.685162+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535635b80] 2023-10-03T19:21:07.658 INFO:teuthology.orchestra.run.smithi045.stdout: -8312> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.658 INFO:teuthology.orchestra.run.smithi045.stdout: -8311> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 573.334, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.73e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1149.5] 2023-10-03T19:21:07.659 INFO:teuthology.orchestra.run.smithi045.stdout: -8310> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655363fa000 on [dir 0x1 / [2,head] auth pv=6008 v=5698 cv=5384/5384 REP dir_auth=0 ap=155+157 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 155 2023-10-03T19:21:07.659 INFO:teuthology.orchestra.run.smithi045.stdout: -8309> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655363fa000 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5697 pv6007 ap=156 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=156) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=155) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 156 2023-10-03T19:21:07.659 INFO:teuthology.orchestra.run.smithi045.stdout: -8308> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5698 cv=5384/5384 REP dir_auth=0 ap=155+156 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655363fa000 count now 155/156 2023-10-03T19:21:07.659 INFO:teuthology.orchestra.run.smithi045.stdout: -8307> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655363fa000 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5691 cv=5377/5377 ap=156+156 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=157 | child=1 dirty=1 authpin=1 0x565534f82400] count now 156 2023-10-03T19:21:07.659 INFO:teuthology.orchestra.run.smithi045.stdout: -8306> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000541) auth_unpin by 0x5655363fa000 on [inode 0x10000000541 [2,head] /dc-dir/dc-file_844 auth v5690 s=3 n(v0 rc2023-10-03T19:17:08.685162+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535635b80] now 0 2023-10-03T19:21:07.659 INFO:teuthology.orchestra.run.smithi045.stdout: -8305> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5691 cv=5377/5377 ap=156+155 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=157 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655363fa000 count now 156/155 2023-10-03T19:21:07.693 INFO:teuthology.orchestra.run.smithi045.stdout: -8304> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.693 INFO:teuthology.orchestra.run.smithi045.stdout: -8303> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.693 INFO:teuthology.orchestra.run.smithi045.stdout: -8302> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000542 [2,head] /dc-dir/dc-file_845 auth v4302 pv5692 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.696423+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.696423+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535636100] 2023-10-03T19:21:07.693 INFO:teuthology.orchestra.run.smithi045.stdout: -8301> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5699 2023-10-03T19:21:07.693 INFO:teuthology.orchestra.run.smithi045.stdout: -8300> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5699 pv6007 ap=156 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=156) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=155) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.694 INFO:teuthology.orchestra.run.smithi045.stdout: -8299> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5697 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.694 INFO:teuthology.orchestra.run.smithi045.stdout: -8298> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5698 cv=5384/5384 REP dir_auth=0 ap=155+156 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5698 2023-10-03T19:21:07.694 INFO:teuthology.orchestra.run.smithi045.stdout: -8297> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000542) pop_and_dirty_projected_inode v5692 2023-10-03T19:21:07.694 INFO:teuthology.orchestra.run.smithi045.stdout: -8296> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000542) mark_dirty [inode 0x10000000542 [2,head] /dc-dir/dc-file_845 auth v5692 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.696423+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535636100] 2023-10-03T19:21:07.694 INFO:teuthology.orchestra.run.smithi045.stdout: -8295> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_845) mark_dirty [dentry #0x1/dc-dir/dc-file_845 [2,head] auth (dversion lock) pv=5692 v=4302 ino=0x10000000542 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535632f00] 2023-10-03T19:21:07.694 INFO:teuthology.orchestra.run.smithi045.stdout: -8294> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5691 cv=5377/5377 ap=156+155 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=158 | child=1 dirty=1 authpin=1 0x565534f82400] version 5691 2023-10-03T19:21:07.694 INFO:teuthology.orchestra.run.smithi045.stdout: -8293> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535da65c0 v5700 2023-10-03T19:21:07.694 INFO:teuthology.orchestra.run.smithi045.stdout: -8292> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5700 cv=5384/5384 REP dir_auth=0 ap=155+156 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5700 2023-10-03T19:21:07.694 INFO:teuthology.orchestra.run.smithi045.stdout: -8291> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535da64a0 v5693 2023-10-03T19:21:07.694 INFO:teuthology.orchestra.run.smithi045.stdout: -8290> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5693 cv=5377/5377 ap=156+155 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=158 | child=1 dirty=1 authpin=1 0x565534f82400] version 5693 2023-10-03T19:21:07.695 INFO:teuthology.orchestra.run.smithi045.stdout: -8289> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=155 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=155 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.695 INFO:teuthology.orchestra.run.smithi045.stdout: -8288> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=155) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5699 pv6007 ap=156 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=156) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=155) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.695 INFO:teuthology.orchestra.run.smithi045.stdout: -8287> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=156) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5699 pv6007 ap=156 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=156) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=154) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.695 INFO:teuthology.orchestra.run.smithi045.stdout: -8286> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000542 [2,head] /dc-dir/dc-file_845 auth v5692 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.696423+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535636100] 2023-10-03T19:21:07.695 INFO:teuthology.orchestra.run.smithi045.stdout: -8285> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000542 [2,head] /dc-dir/dc-file_845 auth v5692 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.696423+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535636100] 2023-10-03T19:21:07.695 INFO:teuthology.orchestra.run.smithi045.stdout: -8284> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.695 INFO:teuthology.orchestra.run.smithi045.stdout: -8283> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.695 INFO:teuthology.orchestra.run.smithi045.stdout: -8282> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.695 INFO:teuthology.orchestra.run.smithi045.stdout: -8281> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000542 [2,head] /dc-dir/dc-file_845 auth v5692 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.696423+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535636100] 2023-10-03T19:21:07.695 INFO:teuthology.orchestra.run.smithi045.stdout: -8280> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000542 [2,head] /dc-dir/dc-file_845 auth v5692 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.696423+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535636100] 2023-10-03T19:21:07.696 INFO:teuthology.orchestra.run.smithi045.stdout: -8279> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.696 INFO:teuthology.orchestra.run.smithi045.stdout: -8278> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 574.334, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.74e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1151.5] 2023-10-03T19:21:07.696 INFO:teuthology.orchestra.run.smithi045.stdout: -8277> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655363fa480 on [dir 0x1 / [2,head] auth pv=6008 v=5700 cv=5384/5384 REP dir_auth=0 ap=154+156 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 154 2023-10-03T19:21:07.696 INFO:teuthology.orchestra.run.smithi045.stdout: -8276> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655363fa480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5699 pv6007 ap=155 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=155) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=154) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 155 2023-10-03T19:21:07.696 INFO:teuthology.orchestra.run.smithi045.stdout: -8275> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5700 cv=5384/5384 REP dir_auth=0 ap=154+155 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655363fa480 count now 154/155 2023-10-03T19:21:07.696 INFO:teuthology.orchestra.run.smithi045.stdout: -8274> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655363fa480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5693 cv=5377/5377 ap=155+155 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=158 | child=1 dirty=1 authpin=1 0x565534f82400] count now 155 2023-10-03T19:21:07.696 INFO:teuthology.orchestra.run.smithi045.stdout: -8273> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000542) auth_unpin by 0x5655363fa480 on [inode 0x10000000542 [2,head] /dc-dir/dc-file_845 auth v5692 s=3 n(v0 rc2023-10-03T19:17:08.696423+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535636100] now 0 2023-10-03T19:21:07.696 INFO:teuthology.orchestra.run.smithi045.stdout: -8272> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5693 cv=5377/5377 ap=155+154 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=158 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655363fa480 count now 155/154 2023-10-03T19:21:07.696 INFO:teuthology.orchestra.run.smithi045.stdout: -8271> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.696 INFO:teuthology.orchestra.run.smithi045.stdout: -8270> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.696 INFO:teuthology.orchestra.run.smithi045.stdout: -8269> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000543 [2,head] /dc-dir/dc-file_846 auth v4306 pv5694 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.707685+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.707685+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535636680] 2023-10-03T19:21:07.697 INFO:teuthology.orchestra.run.smithi045.stdout: -8268> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5701 2023-10-03T19:21:07.697 INFO:teuthology.orchestra.run.smithi045.stdout: -8267> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5701 pv6007 ap=155 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=155) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=154) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.697 INFO:teuthology.orchestra.run.smithi045.stdout: -8266> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5699 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.697 INFO:teuthology.orchestra.run.smithi045.stdout: -8265> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5700 cv=5384/5384 REP dir_auth=0 ap=154+155 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5700 2023-10-03T19:21:07.697 INFO:teuthology.orchestra.run.smithi045.stdout: -8264> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000543) pop_and_dirty_projected_inode v5694 2023-10-03T19:21:07.697 INFO:teuthology.orchestra.run.smithi045.stdout: -8263> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000543) mark_dirty [inode 0x10000000543 [2,head] /dc-dir/dc-file_846 auth v5694 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.707685+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535636680] 2023-10-03T19:21:07.697 INFO:teuthology.orchestra.run.smithi045.stdout: -8262> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_846) mark_dirty [dentry #0x1/dc-dir/dc-file_846 [2,head] auth (dversion lock) pv=5694 v=4306 ino=0x10000000543 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535633180] 2023-10-03T19:21:07.697 INFO:teuthology.orchestra.run.smithi045.stdout: -8261> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5693 cv=5377/5377 ap=155+154 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=159 | child=1 dirty=1 authpin=1 0x565534f82400] version 5693 2023-10-03T19:21:07.697 INFO:teuthology.orchestra.run.smithi045.stdout: -8260> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535da6800 v5702 2023-10-03T19:21:07.697 INFO:teuthology.orchestra.run.smithi045.stdout: -8259> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5702 cv=5384/5384 REP dir_auth=0 ap=154+155 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5702 2023-10-03T19:21:07.698 INFO:teuthology.orchestra.run.smithi045.stdout: -8258> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535da66e0 v5695 2023-10-03T19:21:07.698 INFO:teuthology.orchestra.run.smithi045.stdout: -8257> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5695 cv=5377/5377 ap=155+154 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=159 | child=1 dirty=1 authpin=1 0x565534f82400] version 5695 2023-10-03T19:21:07.698 INFO:teuthology.orchestra.run.smithi045.stdout: -8256> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=154 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=154 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.698 INFO:teuthology.orchestra.run.smithi045.stdout: -8255> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=154) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5701 pv6007 ap=155 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=155) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=154) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.698 INFO:teuthology.orchestra.run.smithi045.stdout: -8254> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=155) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5701 pv6007 ap=155 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=155) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=153) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.698 INFO:teuthology.orchestra.run.smithi045.stdout: -8253> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000543 [2,head] /dc-dir/dc-file_846 auth v5694 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.707685+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535636680] 2023-10-03T19:21:07.698 INFO:teuthology.orchestra.run.smithi045.stdout: -8252> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000543 [2,head] /dc-dir/dc-file_846 auth v5694 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.707685+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535636680] 2023-10-03T19:21:07.698 INFO:teuthology.orchestra.run.smithi045.stdout: -8251> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.698 INFO:teuthology.orchestra.run.smithi045.stdout: -8250> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.698 INFO:teuthology.orchestra.run.smithi045.stdout: -8249> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.698 INFO:teuthology.orchestra.run.smithi045.stdout: -8248> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000543 [2,head] /dc-dir/dc-file_846 auth v5694 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.707685+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535636680] 2023-10-03T19:21:07.699 INFO:teuthology.orchestra.run.smithi045.stdout: -8247> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000543 [2,head] /dc-dir/dc-file_846 auth v5694 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.707685+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535636680] 2023-10-03T19:21:07.699 INFO:teuthology.orchestra.run.smithi045.stdout: -8246> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.699 INFO:teuthology.orchestra.run.smithi045.stdout: -8245> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 575.334, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.75e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1153.5] 2023-10-03T19:21:07.699 INFO:teuthology.orchestra.run.smithi045.stdout: -8244> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655363fa900 on [dir 0x1 / [2,head] auth pv=6008 v=5702 cv=5384/5384 REP dir_auth=0 ap=153+155 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 153 2023-10-03T19:21:07.699 INFO:teuthology.orchestra.run.smithi045.stdout: -8243> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655363fa900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5701 pv6007 ap=154 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=154) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=153) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 154 2023-10-03T19:21:07.699 INFO:teuthology.orchestra.run.smithi045.stdout: -8242> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5702 cv=5384/5384 REP dir_auth=0 ap=153+154 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655363fa900 count now 153/154 2023-10-03T19:21:07.699 INFO:teuthology.orchestra.run.smithi045.stdout: -8241> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655363fa900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5695 cv=5377/5377 ap=154+154 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=159 | child=1 dirty=1 authpin=1 0x565534f82400] count now 154 2023-10-03T19:21:07.699 INFO:teuthology.orchestra.run.smithi045.stdout: -8240> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000543) auth_unpin by 0x5655363fa900 on [inode 0x10000000543 [2,head] /dc-dir/dc-file_846 auth v5694 s=3 n(v0 rc2023-10-03T19:17:08.707685+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535636680] now 0 2023-10-03T19:21:07.699 INFO:teuthology.orchestra.run.smithi045.stdout: -8239> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5695 cv=5377/5377 ap=154+153 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=159 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655363fa900 count now 154/153 2023-10-03T19:21:07.699 INFO:teuthology.orchestra.run.smithi045.stdout: -8238> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.700 INFO:teuthology.orchestra.run.smithi045.stdout: -8237> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.725 INFO:teuthology.orchestra.run.smithi045.stdout: -8236> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000544 [2,head] /dc-dir/dc-file_847 auth v4310 pv5696 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.718908+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.718908+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535636c00] 2023-10-03T19:21:07.725 INFO:teuthology.orchestra.run.smithi045.stdout: -8235> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5703 2023-10-03T19:21:07.725 INFO:teuthology.orchestra.run.smithi045.stdout: -8234> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5703 pv6007 ap=154 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=154) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=153) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.725 INFO:teuthology.orchestra.run.smithi045.stdout: -8233> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5701 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.725 INFO:teuthology.orchestra.run.smithi045.stdout: -8232> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5702 cv=5384/5384 REP dir_auth=0 ap=153+154 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5702 2023-10-03T19:21:07.725 INFO:teuthology.orchestra.run.smithi045.stdout: -8231> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000544) pop_and_dirty_projected_inode v5696 2023-10-03T19:21:07.725 INFO:teuthology.orchestra.run.smithi045.stdout: -8230> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000544) mark_dirty [inode 0x10000000544 [2,head] /dc-dir/dc-file_847 auth v5696 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.718908+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535636c00] 2023-10-03T19:21:07.725 INFO:teuthology.orchestra.run.smithi045.stdout: -8229> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_847) mark_dirty [dentry #0x1/dc-dir/dc-file_847 [2,head] auth (dversion lock) pv=5696 v=4310 ino=0x10000000544 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535633400] 2023-10-03T19:21:07.725 INFO:teuthology.orchestra.run.smithi045.stdout: -8228> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5695 cv=5377/5377 ap=154+153 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=160 | child=1 dirty=1 authpin=1 0x565534f82400] version 5695 2023-10-03T19:21:07.726 INFO:teuthology.orchestra.run.smithi045.stdout: -8227> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535da6a40 v5704 2023-10-03T19:21:07.726 INFO:teuthology.orchestra.run.smithi045.stdout: -8226> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5704 cv=5384/5384 REP dir_auth=0 ap=153+154 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5704 2023-10-03T19:21:07.726 INFO:teuthology.orchestra.run.smithi045.stdout: -8225> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535da6920 v5697 2023-10-03T19:21:07.726 INFO:teuthology.orchestra.run.smithi045.stdout: -8224> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5697 cv=5377/5377 ap=154+153 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=160 | child=1 dirty=1 authpin=1 0x565534f82400] version 5697 2023-10-03T19:21:07.726 INFO:teuthology.orchestra.run.smithi045.stdout: -8223> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=153 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=153 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.726 INFO:teuthology.orchestra.run.smithi045.stdout: -8222> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=153) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5703 pv6007 ap=154 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=154) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=153) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.726 INFO:teuthology.orchestra.run.smithi045.stdout: -8221> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=154) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5703 pv6007 ap=154 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=154) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=152) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.726 INFO:teuthology.orchestra.run.smithi045.stdout: -8220> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000544 [2,head] /dc-dir/dc-file_847 auth v5696 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.718908+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535636c00] 2023-10-03T19:21:07.726 INFO:teuthology.orchestra.run.smithi045.stdout: -8219> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000544 [2,head] /dc-dir/dc-file_847 auth v5696 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.718908+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535636c00] 2023-10-03T19:21:07.726 INFO:teuthology.orchestra.run.smithi045.stdout: -8218> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.726 INFO:teuthology.orchestra.run.smithi045.stdout: -8217> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.726 INFO:teuthology.orchestra.run.smithi045.stdout: -8216> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.727 INFO:teuthology.orchestra.run.smithi045.stdout: -8215> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000544 [2,head] /dc-dir/dc-file_847 auth v5696 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.718908+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535636c00] 2023-10-03T19:21:07.727 INFO:teuthology.orchestra.run.smithi045.stdout: -8214> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000544 [2,head] /dc-dir/dc-file_847 auth v5696 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.718908+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535636c00] 2023-10-03T19:21:07.727 INFO:teuthology.orchestra.run.smithi045.stdout: -8213> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.727 INFO:teuthology.orchestra.run.smithi045.stdout: -8212> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 576.334, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.76e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1155.5] 2023-10-03T19:21:07.727 INFO:teuthology.orchestra.run.smithi045.stdout: -8211> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655363fad80 on [dir 0x1 / [2,head] auth pv=6008 v=5704 cv=5384/5384 REP dir_auth=0 ap=152+154 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 152 2023-10-03T19:21:07.727 INFO:teuthology.orchestra.run.smithi045.stdout: -8210> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655363fad80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5703 pv6007 ap=153 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=153) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=152) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 153 2023-10-03T19:21:07.727 INFO:teuthology.orchestra.run.smithi045.stdout: -8209> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5704 cv=5384/5384 REP dir_auth=0 ap=152+153 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655363fad80 count now 152/153 2023-10-03T19:21:07.727 INFO:teuthology.orchestra.run.smithi045.stdout: -8208> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655363fad80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5697 cv=5377/5377 ap=153+153 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=160 | child=1 dirty=1 authpin=1 0x565534f82400] count now 153 2023-10-03T19:21:07.727 INFO:teuthology.orchestra.run.smithi045.stdout: -8207> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000544) auth_unpin by 0x5655363fad80 on [inode 0x10000000544 [2,head] /dc-dir/dc-file_847 auth v5696 s=3 n(v0 rc2023-10-03T19:17:08.718908+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535636c00] now 0 2023-10-03T19:21:07.727 INFO:teuthology.orchestra.run.smithi045.stdout: -8206> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5697 cv=5377/5377 ap=153+152 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=160 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655363fad80 count now 153/152 2023-10-03T19:21:07.728 INFO:teuthology.orchestra.run.smithi045.stdout: -8205> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.728 INFO:teuthology.orchestra.run.smithi045.stdout: -8204> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.728 INFO:teuthology.orchestra.run.smithi045.stdout: -8203> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000545 [2,head] /dc-dir/dc-file_848 auth v4314 pv5698 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.730080+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.730080+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535637180] 2023-10-03T19:21:07.728 INFO:teuthology.orchestra.run.smithi045.stdout: -8202> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5705 2023-10-03T19:21:07.728 INFO:teuthology.orchestra.run.smithi045.stdout: -8201> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5705 pv6007 ap=153 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=153) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=152) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.728 INFO:teuthology.orchestra.run.smithi045.stdout: -8200> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5703 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.728 INFO:teuthology.orchestra.run.smithi045.stdout: -8199> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5704 cv=5384/5384 REP dir_auth=0 ap=152+153 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5704 2023-10-03T19:21:07.728 INFO:teuthology.orchestra.run.smithi045.stdout: -8198> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000545) pop_and_dirty_projected_inode v5698 2023-10-03T19:21:07.728 INFO:teuthology.orchestra.run.smithi045.stdout: -8197> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000545) mark_dirty [inode 0x10000000545 [2,head] /dc-dir/dc-file_848 auth v5698 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.730080+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535637180] 2023-10-03T19:21:07.728 INFO:teuthology.orchestra.run.smithi045.stdout: -8196> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_848) mark_dirty [dentry #0x1/dc-dir/dc-file_848 [2,head] auth (dversion lock) pv=5698 v=4314 ino=0x10000000545 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535633680] 2023-10-03T19:21:07.728 INFO:teuthology.orchestra.run.smithi045.stdout: -8195> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5697 cv=5377/5377 ap=153+152 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=161 | child=1 dirty=1 authpin=1 0x565534f82400] version 5697 2023-10-03T19:21:07.728 INFO:teuthology.orchestra.run.smithi045.stdout: -8194> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535da6c80 v5706 2023-10-03T19:21:07.729 INFO:teuthology.orchestra.run.smithi045.stdout: -8193> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5706 cv=5384/5384 REP dir_auth=0 ap=152+153 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5706 2023-10-03T19:21:07.729 INFO:teuthology.orchestra.run.smithi045.stdout: -8192> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535da6b60 v5699 2023-10-03T19:21:07.729 INFO:teuthology.orchestra.run.smithi045.stdout: -8191> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5699 cv=5377/5377 ap=153+152 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=161 | child=1 dirty=1 authpin=1 0x565534f82400] version 5699 2023-10-03T19:21:07.729 INFO:teuthology.orchestra.run.smithi045.stdout: -8190> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=152 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=152 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.729 INFO:teuthology.orchestra.run.smithi045.stdout: -8189> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=152) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5705 pv6007 ap=153 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=153) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=152) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.729 INFO:teuthology.orchestra.run.smithi045.stdout: -8188> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=153) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5705 pv6007 ap=153 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=153) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=151) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.729 INFO:teuthology.orchestra.run.smithi045.stdout: -8187> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000545 [2,head] /dc-dir/dc-file_848 auth v5698 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.730080+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535637180] 2023-10-03T19:21:07.729 INFO:teuthology.orchestra.run.smithi045.stdout: -8186> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000545 [2,head] /dc-dir/dc-file_848 auth v5698 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.730080+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535637180] 2023-10-03T19:21:07.729 INFO:teuthology.orchestra.run.smithi045.stdout: -8185> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.729 INFO:teuthology.orchestra.run.smithi045.stdout: -8184> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.759 INFO:teuthology.orchestra.run.smithi045.stdout: -8183> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.759 INFO:teuthology.orchestra.run.smithi045.stdout: -8182> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000545 [2,head] /dc-dir/dc-file_848 auth v5698 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.730080+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535637180] 2023-10-03T19:21:07.759 INFO:teuthology.orchestra.run.smithi045.stdout: -8181> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000545 [2,head] /dc-dir/dc-file_848 auth v5698 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.730080+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535637180] 2023-10-03T19:21:07.759 INFO:teuthology.orchestra.run.smithi045.stdout: -8180> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.759 INFO:teuthology.orchestra.run.smithi045.stdout: -8179> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 577.334, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.77e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1157.5] 2023-10-03T19:21:07.759 INFO:teuthology.orchestra.run.smithi045.stdout: -8178> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655363fb200 on [dir 0x1 / [2,head] auth pv=6008 v=5706 cv=5384/5384 REP dir_auth=0 ap=151+153 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 151 2023-10-03T19:21:07.759 INFO:teuthology.orchestra.run.smithi045.stdout: -8177> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655363fb200 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5705 pv6007 ap=152 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=152) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=151) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 152 2023-10-03T19:21:07.759 INFO:teuthology.orchestra.run.smithi045.stdout: -8176> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5706 cv=5384/5384 REP dir_auth=0 ap=151+152 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655363fb200 count now 151/152 2023-10-03T19:21:07.759 INFO:teuthology.orchestra.run.smithi045.stdout: -8175> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655363fb200 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5699 cv=5377/5377 ap=152+152 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=161 | child=1 dirty=1 authpin=1 0x565534f82400] count now 152 2023-10-03T19:21:07.760 INFO:teuthology.orchestra.run.smithi045.stdout: -8174> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000545) auth_unpin by 0x5655363fb200 on [inode 0x10000000545 [2,head] /dc-dir/dc-file_848 auth v5698 s=3 n(v0 rc2023-10-03T19:17:08.730080+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535637180] now 0 2023-10-03T19:21:07.760 INFO:teuthology.orchestra.run.smithi045.stdout: -8173> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5699 cv=5377/5377 ap=152+151 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=161 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655363fb200 count now 152/151 2023-10-03T19:21:07.760 INFO:teuthology.orchestra.run.smithi045.stdout: -8172> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.760 INFO:teuthology.orchestra.run.smithi045.stdout: -8171> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.760 INFO:teuthology.orchestra.run.smithi045.stdout: -8170> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000546 [2,head] /dc-dir/dc-file_849 auth v4318 pv5700 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.741248+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.741248+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535637700] 2023-10-03T19:21:07.760 INFO:teuthology.orchestra.run.smithi045.stdout: -8169> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5707 2023-10-03T19:21:07.760 INFO:teuthology.orchestra.run.smithi045.stdout: -8168> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5707 pv6007 ap=152 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=152) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=151) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.760 INFO:teuthology.orchestra.run.smithi045.stdout: -8167> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5705 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.760 INFO:teuthology.orchestra.run.smithi045.stdout: -8166> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5706 cv=5384/5384 REP dir_auth=0 ap=151+152 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5706 2023-10-03T19:21:07.760 INFO:teuthology.orchestra.run.smithi045.stdout: -8165> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000546) pop_and_dirty_projected_inode v5700 2023-10-03T19:21:07.761 INFO:teuthology.orchestra.run.smithi045.stdout: -8164> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000546) mark_dirty [inode 0x10000000546 [2,head] /dc-dir/dc-file_849 auth v5700 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.741248+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535637700] 2023-10-03T19:21:07.761 INFO:teuthology.orchestra.run.smithi045.stdout: -8163> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_849) mark_dirty [dentry #0x1/dc-dir/dc-file_849 [2,head] auth (dversion lock) pv=5700 v=4318 ino=0x10000000546 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535633900] 2023-10-03T19:21:07.761 INFO:teuthology.orchestra.run.smithi045.stdout: -8162> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5699 cv=5377/5377 ap=152+151 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=162 | child=1 dirty=1 authpin=1 0x565534f82400] version 5699 2023-10-03T19:21:07.761 INFO:teuthology.orchestra.run.smithi045.stdout: -8161> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535da6ec0 v5708 2023-10-03T19:21:07.761 INFO:teuthology.orchestra.run.smithi045.stdout: -8160> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5708 cv=5384/5384 REP dir_auth=0 ap=151+152 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5708 2023-10-03T19:21:07.761 INFO:teuthology.orchestra.run.smithi045.stdout: -8159> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535da6da0 v5701 2023-10-03T19:21:07.761 INFO:teuthology.orchestra.run.smithi045.stdout: -8158> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5701 cv=5377/5377 ap=152+151 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=162 | child=1 dirty=1 authpin=1 0x565534f82400] version 5701 2023-10-03T19:21:07.761 INFO:teuthology.orchestra.run.smithi045.stdout: -8157> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=151 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=151 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.761 INFO:teuthology.orchestra.run.smithi045.stdout: -8156> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=151) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5707 pv6007 ap=152 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=152) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=151) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.761 INFO:teuthology.orchestra.run.smithi045.stdout: -8155> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=152) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5707 pv6007 ap=152 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=152) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=150) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.761 INFO:teuthology.orchestra.run.smithi045.stdout: -8154> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000546 [2,head] /dc-dir/dc-file_849 auth v5700 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.741248+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535637700] 2023-10-03T19:21:07.762 INFO:teuthology.orchestra.run.smithi045.stdout: -8153> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000546 [2,head] /dc-dir/dc-file_849 auth v5700 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.741248+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535637700] 2023-10-03T19:21:07.762 INFO:teuthology.orchestra.run.smithi045.stdout: -8152> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.762 INFO:teuthology.orchestra.run.smithi045.stdout: -8151> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.762 INFO:teuthology.orchestra.run.smithi045.stdout: -8150> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.762 INFO:teuthology.orchestra.run.smithi045.stdout: -8149> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000546 [2,head] /dc-dir/dc-file_849 auth v5700 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.741248+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535637700] 2023-10-03T19:21:07.762 INFO:teuthology.orchestra.run.smithi045.stdout: -8148> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000546 [2,head] /dc-dir/dc-file_849 auth v5700 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.741248+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535637700] 2023-10-03T19:21:07.762 INFO:teuthology.orchestra.run.smithi045.stdout: -8147> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.762 INFO:teuthology.orchestra.run.smithi045.stdout: -8146> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 578.334, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.78e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1159.5] 2023-10-03T19:21:07.762 INFO:teuthology.orchestra.run.smithi045.stdout: -8145> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655363fb680 on [dir 0x1 / [2,head] auth pv=6008 v=5708 cv=5384/5384 REP dir_auth=0 ap=150+152 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 150 2023-10-03T19:21:07.762 INFO:teuthology.orchestra.run.smithi045.stdout: -8144> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655363fb680 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5707 pv6007 ap=151 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=151) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=150) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 151 2023-10-03T19:21:07.763 INFO:teuthology.orchestra.run.smithi045.stdout: -8143> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5708 cv=5384/5384 REP dir_auth=0 ap=150+151 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655363fb680 count now 150/151 2023-10-03T19:21:07.763 INFO:teuthology.orchestra.run.smithi045.stdout: -8142> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655363fb680 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5701 cv=5377/5377 ap=151+151 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=162 | child=1 dirty=1 authpin=1 0x565534f82400] count now 151 2023-10-03T19:21:07.763 INFO:teuthology.orchestra.run.smithi045.stdout: -8141> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000546) auth_unpin by 0x5655363fb680 on [inode 0x10000000546 [2,head] /dc-dir/dc-file_849 auth v5700 s=3 n(v0 rc2023-10-03T19:17:08.741248+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535637700] now 0 2023-10-03T19:21:07.763 INFO:teuthology.orchestra.run.smithi045.stdout: -8140> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5701 cv=5377/5377 ap=151+150 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=162 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655363fb680 count now 151/150 2023-10-03T19:21:07.763 INFO:teuthology.orchestra.run.smithi045.stdout: -8139> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.763 INFO:teuthology.orchestra.run.smithi045.stdout: -8138> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.763 INFO:teuthology.orchestra.run.smithi045.stdout: -8137> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000547 [2,head] /dc-dir/dc-file_850 auth v4322 pv5702 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.752238+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.752238+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535640000] 2023-10-03T19:21:07.763 INFO:teuthology.orchestra.run.smithi045.stdout: -8136> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5709 2023-10-03T19:21:07.763 INFO:teuthology.orchestra.run.smithi045.stdout: -8135> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5709 pv6007 ap=151 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=151) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=150) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.763 INFO:teuthology.orchestra.run.smithi045.stdout: -8134> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5707 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.763 INFO:teuthology.orchestra.run.smithi045.stdout: -8133> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5708 cv=5384/5384 REP dir_auth=0 ap=150+151 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5708 2023-10-03T19:21:07.764 INFO:teuthology.orchestra.run.smithi045.stdout: -8132> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000547) pop_and_dirty_projected_inode v5702 2023-10-03T19:21:07.764 INFO:teuthology.orchestra.run.smithi045.stdout: -8131> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000547) mark_dirty [inode 0x10000000547 [2,head] /dc-dir/dc-file_850 auth v5702 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.752238+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535640000] 2023-10-03T19:21:07.764 INFO:teuthology.orchestra.run.smithi045.stdout: -8130> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_850) mark_dirty [dentry #0x1/dc-dir/dc-file_850 [2,head] auth (dversion lock) pv=5702 v=4322 ino=0x10000000547 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535633b80] 2023-10-03T19:21:07.764 INFO:teuthology.orchestra.run.smithi045.stdout: -8129> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5701 cv=5377/5377 ap=151+150 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=163 | child=1 dirty=1 authpin=1 0x565534f82400] version 5701 2023-10-03T19:21:07.764 INFO:teuthology.orchestra.run.smithi045.stdout: -8128> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535da7100 v5710 2023-10-03T19:21:07.764 INFO:teuthology.orchestra.run.smithi045.stdout: -8127> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5710 cv=5384/5384 REP dir_auth=0 ap=150+151 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5710 2023-10-03T19:21:07.764 INFO:teuthology.orchestra.run.smithi045.stdout: -8126> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535da6fe0 v5703 2023-10-03T19:21:07.764 INFO:teuthology.orchestra.run.smithi045.stdout: -8125> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5703 cv=5377/5377 ap=151+150 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=163 | child=1 dirty=1 authpin=1 0x565534f82400] version 5703 2023-10-03T19:21:07.764 INFO:teuthology.orchestra.run.smithi045.stdout: -8124> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=150 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=150 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.764 INFO:teuthology.orchestra.run.smithi045.stdout: -8123> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=150) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5709 pv6007 ap=151 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=151) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=150) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.764 INFO:teuthology.orchestra.run.smithi045.stdout: -8122> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=151) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5709 pv6007 ap=151 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=151) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=149) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.765 INFO:teuthology.orchestra.run.smithi045.stdout: -8121> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000547 [2,head] /dc-dir/dc-file_850 auth v5702 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.752238+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535640000] 2023-10-03T19:21:07.765 INFO:teuthology.orchestra.run.smithi045.stdout: -8120> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000547 [2,head] /dc-dir/dc-file_850 auth v5702 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.752238+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535640000] 2023-10-03T19:21:07.815 INFO:teuthology.orchestra.run.smithi045.stdout: -8119> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.815 INFO:teuthology.orchestra.run.smithi045.stdout: -8118> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.815 INFO:teuthology.orchestra.run.smithi045.stdout: -8117> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.815 INFO:teuthology.orchestra.run.smithi045.stdout: -8116> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000547 [2,head] /dc-dir/dc-file_850 auth v5702 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.752238+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535640000] 2023-10-03T19:21:07.815 INFO:teuthology.orchestra.run.smithi045.stdout: -8115> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000547 [2,head] /dc-dir/dc-file_850 auth v5702 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.752238+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535640000] 2023-10-03T19:21:07.815 INFO:teuthology.orchestra.run.smithi045.stdout: -8114> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.815 INFO:teuthology.orchestra.run.smithi045.stdout: -8113> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 579.334, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.79e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1161.5] 2023-10-03T19:21:07.815 INFO:teuthology.orchestra.run.smithi045.stdout: -8112> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655363fbb00 on [dir 0x1 / [2,head] auth pv=6008 v=5710 cv=5384/5384 REP dir_auth=0 ap=149+151 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 149 2023-10-03T19:21:07.816 INFO:teuthology.orchestra.run.smithi045.stdout: -8111> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655363fbb00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5709 pv6007 ap=150 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=150) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=149) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 150 2023-10-03T19:21:07.816 INFO:teuthology.orchestra.run.smithi045.stdout: -8110> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5710 cv=5384/5384 REP dir_auth=0 ap=149+150 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655363fbb00 count now 149/150 2023-10-03T19:21:07.816 INFO:teuthology.orchestra.run.smithi045.stdout: -8109> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655363fbb00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5703 cv=5377/5377 ap=150+150 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=163 | child=1 dirty=1 authpin=1 0x565534f82400] count now 150 2023-10-03T19:21:07.816 INFO:teuthology.orchestra.run.smithi045.stdout: -8108> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000547) auth_unpin by 0x5655363fbb00 on [inode 0x10000000547 [2,head] /dc-dir/dc-file_850 auth v5702 s=3 n(v0 rc2023-10-03T19:17:08.752238+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535640000] now 0 2023-10-03T19:21:07.816 INFO:teuthology.orchestra.run.smithi045.stdout: -8107> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5703 cv=5377/5377 ap=150+149 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=163 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655363fbb00 count now 150/149 2023-10-03T19:21:07.816 INFO:teuthology.orchestra.run.smithi045.stdout: -8106> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.816 INFO:teuthology.orchestra.run.smithi045.stdout: -8105> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.816 INFO:teuthology.orchestra.run.smithi045.stdout: -8104> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000548 [2,head] /dc-dir/dc-file_851 auth v4326 pv5704 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.763647+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.763647+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535640580] 2023-10-03T19:21:07.816 INFO:teuthology.orchestra.run.smithi045.stdout: -8103> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5711 2023-10-03T19:21:07.817 INFO:teuthology.orchestra.run.smithi045.stdout: -8102> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5711 pv6007 ap=150 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=150) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=149) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.817 INFO:teuthology.orchestra.run.smithi045.stdout: -8101> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5709 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.817 INFO:teuthology.orchestra.run.smithi045.stdout: -8100> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5710 cv=5384/5384 REP dir_auth=0 ap=149+150 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5710 2023-10-03T19:21:07.817 INFO:teuthology.orchestra.run.smithi045.stdout: -8099> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000548) pop_and_dirty_projected_inode v5704 2023-10-03T19:21:07.817 INFO:teuthology.orchestra.run.smithi045.stdout: -8098> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000548) mark_dirty [inode 0x10000000548 [2,head] /dc-dir/dc-file_851 auth v5704 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.763647+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535640580] 2023-10-03T19:21:07.817 INFO:teuthology.orchestra.run.smithi045.stdout: -8097> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_851) mark_dirty [dentry #0x1/dc-dir/dc-file_851 [2,head] auth (dversion lock) pv=5704 v=4326 ino=0x10000000548 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535644000] 2023-10-03T19:21:07.817 INFO:teuthology.orchestra.run.smithi045.stdout: -8096> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5703 cv=5377/5377 ap=150+149 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=164 | child=1 dirty=1 authpin=1 0x565534f82400] version 5703 2023-10-03T19:21:07.817 INFO:teuthology.orchestra.run.smithi045.stdout: -8095> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535da7340 v5712 2023-10-03T19:21:07.817 INFO:teuthology.orchestra.run.smithi045.stdout: -8094> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5712 cv=5384/5384 REP dir_auth=0 ap=149+150 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5712 2023-10-03T19:21:07.817 INFO:teuthology.orchestra.run.smithi045.stdout: -8093> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535da7220 v5705 2023-10-03T19:21:07.818 INFO:teuthology.orchestra.run.smithi045.stdout: -8092> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5705 cv=5377/5377 ap=150+149 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=164 | child=1 dirty=1 authpin=1 0x565534f82400] version 5705 2023-10-03T19:21:07.818 INFO:teuthology.orchestra.run.smithi045.stdout: -8091> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=149 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=149 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.818 INFO:teuthology.orchestra.run.smithi045.stdout: -8090> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=149) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5711 pv6007 ap=150 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=150) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=149) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.818 INFO:teuthology.orchestra.run.smithi045.stdout: -8089> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=150) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5711 pv6007 ap=150 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=150) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=148) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.818 INFO:teuthology.orchestra.run.smithi045.stdout: -8088> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000548 [2,head] /dc-dir/dc-file_851 auth v5704 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.763647+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535640580] 2023-10-03T19:21:07.818 INFO:teuthology.orchestra.run.smithi045.stdout: -8087> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000548 [2,head] /dc-dir/dc-file_851 auth v5704 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.763647+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535640580] 2023-10-03T19:21:07.818 INFO:teuthology.orchestra.run.smithi045.stdout: -8086> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.818 INFO:teuthology.orchestra.run.smithi045.stdout: -8085> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.818 INFO:teuthology.orchestra.run.smithi045.stdout: -8084> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.818 INFO:teuthology.orchestra.run.smithi045.stdout: -8083> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000548 [2,head] /dc-dir/dc-file_851 auth v5704 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.763647+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535640580] 2023-10-03T19:21:07.818 INFO:teuthology.orchestra.run.smithi045.stdout: -8082> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000548 [2,head] /dc-dir/dc-file_851 auth v5704 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.763647+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535640580] 2023-10-03T19:21:07.819 INFO:teuthology.orchestra.run.smithi045.stdout: -8081> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.819 INFO:teuthology.orchestra.run.smithi045.stdout: -8080> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 580.334, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.80e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1163.5] 2023-10-03T19:21:07.819 INFO:teuthology.orchestra.run.smithi045.stdout: -8079> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535ebc000 on [dir 0x1 / [2,head] auth pv=6008 v=5712 cv=5384/5384 REP dir_auth=0 ap=148+150 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 148 2023-10-03T19:21:07.819 INFO:teuthology.orchestra.run.smithi045.stdout: -8078> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535ebc000 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5711 pv6007 ap=149 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=149) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=148) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 149 2023-10-03T19:21:07.819 INFO:teuthology.orchestra.run.smithi045.stdout: -8077> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5712 cv=5384/5384 REP dir_auth=0 ap=148+149 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535ebc000 count now 148/149 2023-10-03T19:21:07.819 INFO:teuthology.orchestra.run.smithi045.stdout: -8076> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535ebc000 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5705 cv=5377/5377 ap=149+149 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=164 | child=1 dirty=1 authpin=1 0x565534f82400] count now 149 2023-10-03T19:21:07.819 INFO:teuthology.orchestra.run.smithi045.stdout: -8075> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000548) auth_unpin by 0x565535ebc000 on [inode 0x10000000548 [2,head] /dc-dir/dc-file_851 auth v5704 s=3 n(v0 rc2023-10-03T19:17:08.763647+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535640580] now 0 2023-10-03T19:21:07.819 INFO:teuthology.orchestra.run.smithi045.stdout: -8074> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5705 cv=5377/5377 ap=149+148 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=164 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535ebc000 count now 149/148 2023-10-03T19:21:07.819 INFO:teuthology.orchestra.run.smithi045.stdout: -8073> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.819 INFO:teuthology.orchestra.run.smithi045.stdout: -8072> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.820 INFO:teuthology.orchestra.run.smithi045.stdout: -8071> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000549 [2,head] /dc-dir/dc-file_852 auth v4330 pv5706 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.774833+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.774833+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535640b00] 2023-10-03T19:21:07.820 INFO:teuthology.orchestra.run.smithi045.stdout: -8070> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5713 2023-10-03T19:21:07.820 INFO:teuthology.orchestra.run.smithi045.stdout: -8069> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5713 pv6007 ap=149 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=149) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=148) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.820 INFO:teuthology.orchestra.run.smithi045.stdout: -8068> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5711 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.820 INFO:teuthology.orchestra.run.smithi045.stdout: -8067> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5712 cv=5384/5384 REP dir_auth=0 ap=148+149 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5712 2023-10-03T19:21:07.820 INFO:teuthology.orchestra.run.smithi045.stdout: -8066> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000549) pop_and_dirty_projected_inode v5706 2023-10-03T19:21:07.820 INFO:teuthology.orchestra.run.smithi045.stdout: -8065> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000549) mark_dirty [inode 0x10000000549 [2,head] /dc-dir/dc-file_852 auth v5706 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.774833+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535640b00] 2023-10-03T19:21:07.820 INFO:teuthology.orchestra.run.smithi045.stdout: -8064> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_852) mark_dirty [dentry #0x1/dc-dir/dc-file_852 [2,head] auth (dversion lock) pv=5706 v=4330 ino=0x10000000549 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535644280] 2023-10-03T19:21:07.820 INFO:teuthology.orchestra.run.smithi045.stdout: -8063> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5705 cv=5377/5377 ap=149+148 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=165 | child=1 dirty=1 authpin=1 0x565534f82400] version 5705 2023-10-03T19:21:07.820 INFO:teuthology.orchestra.run.smithi045.stdout: -8062> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535da7580 v5714 2023-10-03T19:21:07.820 INFO:teuthology.orchestra.run.smithi045.stdout: -8061> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5714 cv=5384/5384 REP dir_auth=0 ap=148+149 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5714 2023-10-03T19:21:07.821 INFO:teuthology.orchestra.run.smithi045.stdout: -8060> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535da7460 v5707 2023-10-03T19:21:07.821 INFO:teuthology.orchestra.run.smithi045.stdout: -8059> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5707 cv=5377/5377 ap=149+148 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=165 | child=1 dirty=1 authpin=1 0x565534f82400] version 5707 2023-10-03T19:21:07.854 INFO:teuthology.orchestra.run.smithi045.stdout: -8058> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=148 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=148 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.854 INFO:teuthology.orchestra.run.smithi045.stdout: -8057> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=148) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5713 pv6007 ap=149 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=149) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=148) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.854 INFO:teuthology.orchestra.run.smithi045.stdout: -8056> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=149) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5713 pv6007 ap=149 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=149) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=147) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.855 INFO:teuthology.orchestra.run.smithi045.stdout: -8055> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000549 [2,head] /dc-dir/dc-file_852 auth v5706 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.774833+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535640b00] 2023-10-03T19:21:07.855 INFO:teuthology.orchestra.run.smithi045.stdout: -8054> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000549 [2,head] /dc-dir/dc-file_852 auth v5706 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.774833+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535640b00] 2023-10-03T19:21:07.855 INFO:teuthology.orchestra.run.smithi045.stdout: -8053> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.855 INFO:teuthology.orchestra.run.smithi045.stdout: -8052> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.855 INFO:teuthology.orchestra.run.smithi045.stdout: -8051> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.855 INFO:teuthology.orchestra.run.smithi045.stdout: -8050> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000549 [2,head] /dc-dir/dc-file_852 auth v5706 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.774833+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535640b00] 2023-10-03T19:21:07.855 INFO:teuthology.orchestra.run.smithi045.stdout: -8049> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000549 [2,head] /dc-dir/dc-file_852 auth v5706 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.774833+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535640b00] 2023-10-03T19:21:07.855 INFO:teuthology.orchestra.run.smithi045.stdout: -8048> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.855 INFO:teuthology.orchestra.run.smithi045.stdout: -8047> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 581.334, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.81e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1165.5] 2023-10-03T19:21:07.855 INFO:teuthology.orchestra.run.smithi045.stdout: -8046> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535ebc480 on [dir 0x1 / [2,head] auth pv=6008 v=5714 cv=5384/5384 REP dir_auth=0 ap=147+149 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 147 2023-10-03T19:21:07.855 INFO:teuthology.orchestra.run.smithi045.stdout: -8045> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535ebc480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5713 pv6007 ap=148 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=148) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=147) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 148 2023-10-03T19:21:07.856 INFO:teuthology.orchestra.run.smithi045.stdout: -8044> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5714 cv=5384/5384 REP dir_auth=0 ap=147+148 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535ebc480 count now 147/148 2023-10-03T19:21:07.856 INFO:teuthology.orchestra.run.smithi045.stdout: -8043> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535ebc480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5707 cv=5377/5377 ap=148+148 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=165 | child=1 dirty=1 authpin=1 0x565534f82400] count now 148 2023-10-03T19:21:07.856 INFO:teuthology.orchestra.run.smithi045.stdout: -8042> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000549) auth_unpin by 0x565535ebc480 on [inode 0x10000000549 [2,head] /dc-dir/dc-file_852 auth v5706 s=3 n(v0 rc2023-10-03T19:17:08.774833+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535640b00] now 0 2023-10-03T19:21:07.856 INFO:teuthology.orchestra.run.smithi045.stdout: -8041> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5707 cv=5377/5377 ap=148+147 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=165 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535ebc480 count now 148/147 2023-10-03T19:21:07.856 INFO:teuthology.orchestra.run.smithi045.stdout: -8040> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.856 INFO:teuthology.orchestra.run.smithi045.stdout: -8039> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.856 INFO:teuthology.orchestra.run.smithi045.stdout: -8038> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000054a [2,head] /dc-dir/dc-file_853 auth v4334 pv5708 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.786143+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.786143+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535641080] 2023-10-03T19:21:07.856 INFO:teuthology.orchestra.run.smithi045.stdout: -8037> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5715 2023-10-03T19:21:07.856 INFO:teuthology.orchestra.run.smithi045.stdout: -8036> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5715 pv6007 ap=148 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=148) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=147) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.856 INFO:teuthology.orchestra.run.smithi045.stdout: -8035> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5713 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.857 INFO:teuthology.orchestra.run.smithi045.stdout: -8034> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5714 cv=5384/5384 REP dir_auth=0 ap=147+148 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5714 2023-10-03T19:21:07.857 INFO:teuthology.orchestra.run.smithi045.stdout: -8033> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000054a) pop_and_dirty_projected_inode v5708 2023-10-03T19:21:07.857 INFO:teuthology.orchestra.run.smithi045.stdout: -8032> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000054a) mark_dirty [inode 0x1000000054a [2,head] /dc-dir/dc-file_853 auth v5708 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.786143+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535641080] 2023-10-03T19:21:07.857 INFO:teuthology.orchestra.run.smithi045.stdout: -8031> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_853) mark_dirty [dentry #0x1/dc-dir/dc-file_853 [2,head] auth (dversion lock) pv=5708 v=4334 ino=0x1000000054a state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535644500] 2023-10-03T19:21:07.857 INFO:teuthology.orchestra.run.smithi045.stdout: -8030> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5707 cv=5377/5377 ap=148+147 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=166 | child=1 dirty=1 authpin=1 0x565534f82400] version 5707 2023-10-03T19:21:07.857 INFO:teuthology.orchestra.run.smithi045.stdout: -8029> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535da77c0 v5716 2023-10-03T19:21:07.857 INFO:teuthology.orchestra.run.smithi045.stdout: -8028> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5716 cv=5384/5384 REP dir_auth=0 ap=147+148 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5716 2023-10-03T19:21:07.857 INFO:teuthology.orchestra.run.smithi045.stdout: -8027> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535da76a0 v5709 2023-10-03T19:21:07.857 INFO:teuthology.orchestra.run.smithi045.stdout: -8026> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5709 cv=5377/5377 ap=148+147 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=166 | child=1 dirty=1 authpin=1 0x565534f82400] version 5709 2023-10-03T19:21:07.857 INFO:teuthology.orchestra.run.smithi045.stdout: -8025> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=147 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=147 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.857 INFO:teuthology.orchestra.run.smithi045.stdout: -8024> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=147) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5715 pv6007 ap=148 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=148) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=147) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.858 INFO:teuthology.orchestra.run.smithi045.stdout: -8023> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=148) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5715 pv6007 ap=148 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=148) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=146) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.858 INFO:teuthology.orchestra.run.smithi045.stdout: -8022> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000054a [2,head] /dc-dir/dc-file_853 auth v5708 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.786143+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535641080] 2023-10-03T19:21:07.858 INFO:teuthology.orchestra.run.smithi045.stdout: -8021> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000054a [2,head] /dc-dir/dc-file_853 auth v5708 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.786143+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535641080] 2023-10-03T19:21:07.858 INFO:teuthology.orchestra.run.smithi045.stdout: -8020> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.858 INFO:teuthology.orchestra.run.smithi045.stdout: -8019> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.858 INFO:teuthology.orchestra.run.smithi045.stdout: -8018> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.858 INFO:teuthology.orchestra.run.smithi045.stdout: -8017> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000054a [2,head] /dc-dir/dc-file_853 auth v5708 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.786143+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535641080] 2023-10-03T19:21:07.858 INFO:teuthology.orchestra.run.smithi045.stdout: -8016> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000054a [2,head] /dc-dir/dc-file_853 auth v5708 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.786143+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535641080] 2023-10-03T19:21:07.858 INFO:teuthology.orchestra.run.smithi045.stdout: -8015> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.858 INFO:teuthology.orchestra.run.smithi045.stdout: -8014> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 582.334, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.82e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1167.5] 2023-10-03T19:21:07.858 INFO:teuthology.orchestra.run.smithi045.stdout: -8013> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535ebc900 on [dir 0x1 / [2,head] auth pv=6008 v=5716 cv=5384/5384 REP dir_auth=0 ap=146+148 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 146 2023-10-03T19:21:07.859 INFO:teuthology.orchestra.run.smithi045.stdout: -8012> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535ebc900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5715 pv6007 ap=147 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=147) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=146) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 147 2023-10-03T19:21:07.859 INFO:teuthology.orchestra.run.smithi045.stdout: -8011> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5716 cv=5384/5384 REP dir_auth=0 ap=146+147 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535ebc900 count now 146/147 2023-10-03T19:21:07.859 INFO:teuthology.orchestra.run.smithi045.stdout: -8010> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535ebc900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5709 cv=5377/5377 ap=147+147 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=166 | child=1 dirty=1 authpin=1 0x565534f82400] count now 147 2023-10-03T19:21:07.859 INFO:teuthology.orchestra.run.smithi045.stdout: -8009> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000054a) auth_unpin by 0x565535ebc900 on [inode 0x1000000054a [2,head] /dc-dir/dc-file_853 auth v5708 s=3 n(v0 rc2023-10-03T19:17:08.786143+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535641080] now 0 2023-10-03T19:21:07.859 INFO:teuthology.orchestra.run.smithi045.stdout: -8008> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5709 cv=5377/5377 ap=147+146 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=166 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535ebc900 count now 147/146 2023-10-03T19:21:07.859 INFO:teuthology.orchestra.run.smithi045.stdout: -8007> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.859 INFO:teuthology.orchestra.run.smithi045.stdout: -8006> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.859 INFO:teuthology.orchestra.run.smithi045.stdout: -8005> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000054b [2,head] /dc-dir/dc-file_854 auth v4338 pv5710 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.797045+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.797045+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535641600] 2023-10-03T19:21:07.859 INFO:teuthology.orchestra.run.smithi045.stdout: -8004> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5717 2023-10-03T19:21:07.859 INFO:teuthology.orchestra.run.smithi045.stdout: -8003> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5717 pv6007 ap=147 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=147) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=146) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.860 INFO:teuthology.orchestra.run.smithi045.stdout: -8002> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5715 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.860 INFO:teuthology.orchestra.run.smithi045.stdout: -8001> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5716 cv=5384/5384 REP dir_auth=0 ap=146+147 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5716 2023-10-03T19:21:07.860 INFO:teuthology.orchestra.run.smithi045.stdout: -8000> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000054b) pop_and_dirty_projected_inode v5710 2023-10-03T19:21:07.860 INFO:teuthology.orchestra.run.smithi045.stdout: -7999> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000054b) mark_dirty [inode 0x1000000054b [2,head] /dc-dir/dc-file_854 auth v5710 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.797045+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535641600] 2023-10-03T19:21:07.860 INFO:teuthology.orchestra.run.smithi045.stdout: -7998> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_854) mark_dirty [dentry #0x1/dc-dir/dc-file_854 [2,head] auth (dversion lock) pv=5710 v=4338 ino=0x1000000054b state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535644780] 2023-10-03T19:21:07.860 INFO:teuthology.orchestra.run.smithi045.stdout: -7997> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5709 cv=5377/5377 ap=147+146 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=167 | child=1 dirty=1 authpin=1 0x565534f82400] version 5709 2023-10-03T19:21:07.860 INFO:teuthology.orchestra.run.smithi045.stdout: -7996> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535da7a00 v5718 2023-10-03T19:21:07.860 INFO:teuthology.orchestra.run.smithi045.stdout: -7995> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5718 cv=5384/5384 REP dir_auth=0 ap=146+147 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5718 2023-10-03T19:21:07.860 INFO:teuthology.orchestra.run.smithi045.stdout: -7994> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535da78e0 v5711 2023-10-03T19:21:07.860 INFO:teuthology.orchestra.run.smithi045.stdout: -7993> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5711 cv=5377/5377 ap=147+146 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=167 | child=1 dirty=1 authpin=1 0x565534f82400] version 5711 2023-10-03T19:21:07.884 INFO:teuthology.orchestra.run.smithi045.stdout: -7992> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=146 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=146 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.884 INFO:teuthology.orchestra.run.smithi045.stdout: -7991> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=146) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5717 pv6007 ap=147 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=147) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=146) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.884 INFO:teuthology.orchestra.run.smithi045.stdout: -7990> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=147) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5717 pv6007 ap=147 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=147) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=145) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.884 INFO:teuthology.orchestra.run.smithi045.stdout: -7989> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000054b [2,head] /dc-dir/dc-file_854 auth v5710 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.797045+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535641600] 2023-10-03T19:21:07.884 INFO:teuthology.orchestra.run.smithi045.stdout: -7988> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000054b [2,head] /dc-dir/dc-file_854 auth v5710 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.797045+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535641600] 2023-10-03T19:21:07.884 INFO:teuthology.orchestra.run.smithi045.stdout: -7987> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.884 INFO:teuthology.orchestra.run.smithi045.stdout: -7986> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.885 INFO:teuthology.orchestra.run.smithi045.stdout: -7985> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.885 INFO:teuthology.orchestra.run.smithi045.stdout: -7984> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000054b [2,head] /dc-dir/dc-file_854 auth v5710 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.797045+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535641600] 2023-10-03T19:21:07.885 INFO:teuthology.orchestra.run.smithi045.stdout: -7983> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000054b [2,head] /dc-dir/dc-file_854 auth v5710 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.797045+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535641600] 2023-10-03T19:21:07.885 INFO:teuthology.orchestra.run.smithi045.stdout: -7982> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.885 INFO:teuthology.orchestra.run.smithi045.stdout: -7981> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 583.334, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.83e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1169.5] 2023-10-03T19:21:07.885 INFO:teuthology.orchestra.run.smithi045.stdout: -7980> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535ebcd80 on [dir 0x1 / [2,head] auth pv=6008 v=5718 cv=5384/5384 REP dir_auth=0 ap=145+147 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 145 2023-10-03T19:21:07.885 INFO:teuthology.orchestra.run.smithi045.stdout: -7979> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535ebcd80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5717 pv6007 ap=146 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=146) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=145) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 146 2023-10-03T19:21:07.885 INFO:teuthology.orchestra.run.smithi045.stdout: -7978> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5718 cv=5384/5384 REP dir_auth=0 ap=145+146 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535ebcd80 count now 145/146 2023-10-03T19:21:07.885 INFO:teuthology.orchestra.run.smithi045.stdout: -7977> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535ebcd80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5711 cv=5377/5377 ap=146+146 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=167 | child=1 dirty=1 authpin=1 0x565534f82400] count now 146 2023-10-03T19:21:07.885 INFO:teuthology.orchestra.run.smithi045.stdout: -7976> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000054b) auth_unpin by 0x565535ebcd80 on [inode 0x1000000054b [2,head] /dc-dir/dc-file_854 auth v5710 s=3 n(v0 rc2023-10-03T19:17:08.797045+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535641600] now 0 2023-10-03T19:21:07.885 INFO:teuthology.orchestra.run.smithi045.stdout: -7975> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5711 cv=5377/5377 ap=146+145 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=167 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535ebcd80 count now 146/145 2023-10-03T19:21:07.886 INFO:teuthology.orchestra.run.smithi045.stdout: -7974> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.886 INFO:teuthology.orchestra.run.smithi045.stdout: -7973> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.886 INFO:teuthology.orchestra.run.smithi045.stdout: -7972> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000054c [2,head] /dc-dir/dc-file_855 auth v4342 pv5712 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.808959+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.808959+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535641b80] 2023-10-03T19:21:07.886 INFO:teuthology.orchestra.run.smithi045.stdout: -7971> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5719 2023-10-03T19:21:07.886 INFO:teuthology.orchestra.run.smithi045.stdout: -7970> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5719 pv6007 ap=146 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=146) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=145) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.886 INFO:teuthology.orchestra.run.smithi045.stdout: -7969> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5717 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.886 INFO:teuthology.orchestra.run.smithi045.stdout: -7968> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5718 cv=5384/5384 REP dir_auth=0 ap=145+146 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5718 2023-10-03T19:21:07.886 INFO:teuthology.orchestra.run.smithi045.stdout: -7967> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000054c) pop_and_dirty_projected_inode v5712 2023-10-03T19:21:07.886 INFO:teuthology.orchestra.run.smithi045.stdout: -7966> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000054c) mark_dirty [inode 0x1000000054c [2,head] /dc-dir/dc-file_855 auth v5712 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.808959+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535641b80] 2023-10-03T19:21:07.887 INFO:teuthology.orchestra.run.smithi045.stdout: -7965> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_855) mark_dirty [dentry #0x1/dc-dir/dc-file_855 [2,head] auth (dversion lock) pv=5712 v=4342 ino=0x1000000054c state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535644a00] 2023-10-03T19:21:07.887 INFO:teuthology.orchestra.run.smithi045.stdout: -7964> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5711 cv=5377/5377 ap=146+145 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=168 | child=1 dirty=1 authpin=1 0x565534f82400] version 5711 2023-10-03T19:21:07.887 INFO:teuthology.orchestra.run.smithi045.stdout: -7963> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535da7c40 v5720 2023-10-03T19:21:07.887 INFO:teuthology.orchestra.run.smithi045.stdout: -7962> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5720 cv=5384/5384 REP dir_auth=0 ap=145+146 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5720 2023-10-03T19:21:07.887 INFO:teuthology.orchestra.run.smithi045.stdout: -7961> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535da7b20 v5713 2023-10-03T19:21:07.887 INFO:teuthology.orchestra.run.smithi045.stdout: -7960> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5713 cv=5377/5377 ap=146+145 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=168 | child=1 dirty=1 authpin=1 0x565534f82400] version 5713 2023-10-03T19:21:07.887 INFO:teuthology.orchestra.run.smithi045.stdout: -7959> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=145 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=145 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.887 INFO:teuthology.orchestra.run.smithi045.stdout: -7958> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=145) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5719 pv6007 ap=146 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=146) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=145) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.887 INFO:teuthology.orchestra.run.smithi045.stdout: -7957> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=146) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5719 pv6007 ap=146 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=146) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=144) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.887 INFO:teuthology.orchestra.run.smithi045.stdout: -7956> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000054c [2,head] /dc-dir/dc-file_855 auth v5712 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.808959+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535641b80] 2023-10-03T19:21:07.887 INFO:teuthology.orchestra.run.smithi045.stdout: -7955> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000054c [2,head] /dc-dir/dc-file_855 auth v5712 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.808959+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535641b80] 2023-10-03T19:21:07.887 INFO:teuthology.orchestra.run.smithi045.stdout: -7954> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.888 INFO:teuthology.orchestra.run.smithi045.stdout: -7953> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.888 INFO:teuthology.orchestra.run.smithi045.stdout: -7952> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.888 INFO:teuthology.orchestra.run.smithi045.stdout: -7951> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000054c [2,head] /dc-dir/dc-file_855 auth v5712 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.808959+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535641b80] 2023-10-03T19:21:07.888 INFO:teuthology.orchestra.run.smithi045.stdout: -7950> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000054c [2,head] /dc-dir/dc-file_855 auth v5712 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.808959+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535641b80] 2023-10-03T19:21:07.888 INFO:teuthology.orchestra.run.smithi045.stdout: -7949> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.888 INFO:teuthology.orchestra.run.smithi045.stdout: -7948> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 584.334, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.84e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1171.5] 2023-10-03T19:21:07.888 INFO:teuthology.orchestra.run.smithi045.stdout: -7947> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535ebd200 on [dir 0x1 / [2,head] auth pv=6008 v=5720 cv=5384/5384 REP dir_auth=0 ap=144+146 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 144 2023-10-03T19:21:07.888 INFO:teuthology.orchestra.run.smithi045.stdout: -7946> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535ebd200 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5719 pv6007 ap=145 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=145) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=144) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 145 2023-10-03T19:21:07.888 INFO:teuthology.orchestra.run.smithi045.stdout: -7945> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5720 cv=5384/5384 REP dir_auth=0 ap=144+145 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535ebd200 count now 144/145 2023-10-03T19:21:07.888 INFO:teuthology.orchestra.run.smithi045.stdout: -7944> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535ebd200 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5713 cv=5377/5377 ap=145+145 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=168 | child=1 dirty=1 authpin=1 0x565534f82400] count now 145 2023-10-03T19:21:07.889 INFO:teuthology.orchestra.run.smithi045.stdout: -7943> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000054c) auth_unpin by 0x565535ebd200 on [inode 0x1000000054c [2,head] /dc-dir/dc-file_855 auth v5712 s=3 n(v0 rc2023-10-03T19:17:08.808959+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535641b80] now 0 2023-10-03T19:21:07.889 INFO:teuthology.orchestra.run.smithi045.stdout: -7942> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5713 cv=5377/5377 ap=145+144 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=168 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535ebd200 count now 145/144 2023-10-03T19:21:07.889 INFO:teuthology.orchestra.run.smithi045.stdout: -7941> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.889 INFO:teuthology.orchestra.run.smithi045.stdout: -7940> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.889 INFO:teuthology.orchestra.run.smithi045.stdout: -7939> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000054d [2,head] /dc-dir/dc-file_856 auth v4346 pv5714 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.819962+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.819962+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535642100] 2023-10-03T19:21:07.889 INFO:teuthology.orchestra.run.smithi045.stdout: -7938> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5721 2023-10-03T19:21:07.889 INFO:teuthology.orchestra.run.smithi045.stdout: -7937> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5721 pv6007 ap=145 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=145) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=144) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.889 INFO:teuthology.orchestra.run.smithi045.stdout: -7936> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5719 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.889 INFO:teuthology.orchestra.run.smithi045.stdout: -7935> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5720 cv=5384/5384 REP dir_auth=0 ap=144+145 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5720 2023-10-03T19:21:07.890 INFO:teuthology.orchestra.run.smithi045.stdout: -7934> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000054d) pop_and_dirty_projected_inode v5714 2023-10-03T19:21:07.890 INFO:teuthology.orchestra.run.smithi045.stdout: -7933> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000054d) mark_dirty [inode 0x1000000054d [2,head] /dc-dir/dc-file_856 auth v5714 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.819962+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535642100] 2023-10-03T19:21:07.890 INFO:teuthology.orchestra.run.smithi045.stdout: -7932> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_856) mark_dirty [dentry #0x1/dc-dir/dc-file_856 [2,head] auth (dversion lock) pv=5714 v=4346 ino=0x1000000054d state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535644c80] 2023-10-03T19:21:07.922 INFO:teuthology.orchestra.run.smithi045.stdout: -7931> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5713 cv=5377/5377 ap=145+144 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=169 | child=1 dirty=1 authpin=1 0x565534f82400] version 5713 2023-10-03T19:21:07.922 INFO:teuthology.orchestra.run.smithi045.stdout: -7930> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535da7e80 v5722 2023-10-03T19:21:07.922 INFO:teuthology.orchestra.run.smithi045.stdout: -7929> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5722 cv=5384/5384 REP dir_auth=0 ap=144+145 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5722 2023-10-03T19:21:07.922 INFO:teuthology.orchestra.run.smithi045.stdout: -7928> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535da7d60 v5715 2023-10-03T19:21:07.922 INFO:teuthology.orchestra.run.smithi045.stdout: -7927> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5715 cv=5377/5377 ap=145+144 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=169 | child=1 dirty=1 authpin=1 0x565534f82400] version 5715 2023-10-03T19:21:07.922 INFO:teuthology.orchestra.run.smithi045.stdout: -7926> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=144 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=144 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.922 INFO:teuthology.orchestra.run.smithi045.stdout: -7925> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=144) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5721 pv6007 ap=145 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=145) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=144) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.922 INFO:teuthology.orchestra.run.smithi045.stdout: -7924> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=145) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5721 pv6007 ap=145 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=145) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=143) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.923 INFO:teuthology.orchestra.run.smithi045.stdout: -7923> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000054d [2,head] /dc-dir/dc-file_856 auth v5714 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.819962+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535642100] 2023-10-03T19:21:07.923 INFO:teuthology.orchestra.run.smithi045.stdout: -7922> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000054d [2,head] /dc-dir/dc-file_856 auth v5714 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.819962+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535642100] 2023-10-03T19:21:07.923 INFO:teuthology.orchestra.run.smithi045.stdout: -7921> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.923 INFO:teuthology.orchestra.run.smithi045.stdout: -7920> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.923 INFO:teuthology.orchestra.run.smithi045.stdout: -7919> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.923 INFO:teuthology.orchestra.run.smithi045.stdout: -7918> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000054d [2,head] /dc-dir/dc-file_856 auth v5714 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.819962+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535642100] 2023-10-03T19:21:07.923 INFO:teuthology.orchestra.run.smithi045.stdout: -7917> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000054d [2,head] /dc-dir/dc-file_856 auth v5714 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.819962+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535642100] 2023-10-03T19:21:07.923 INFO:teuthology.orchestra.run.smithi045.stdout: -7916> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.923 INFO:teuthology.orchestra.run.smithi045.stdout: -7915> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 585.334, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.85e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1173.5] 2023-10-03T19:21:07.923 INFO:teuthology.orchestra.run.smithi045.stdout: -7914> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535ebd680 on [dir 0x1 / [2,head] auth pv=6008 v=5722 cv=5384/5384 REP dir_auth=0 ap=143+145 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 143 2023-10-03T19:21:07.923 INFO:teuthology.orchestra.run.smithi045.stdout: -7913> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535ebd680 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5721 pv6007 ap=144 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=144) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=143) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 144 2023-10-03T19:21:07.924 INFO:teuthology.orchestra.run.smithi045.stdout: -7912> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5722 cv=5384/5384 REP dir_auth=0 ap=143+144 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535ebd680 count now 143/144 2023-10-03T19:21:07.924 INFO:teuthology.orchestra.run.smithi045.stdout: -7911> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535ebd680 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5715 cv=5377/5377 ap=144+144 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=169 | child=1 dirty=1 authpin=1 0x565534f82400] count now 144 2023-10-03T19:21:07.924 INFO:teuthology.orchestra.run.smithi045.stdout: -7910> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000054d) auth_unpin by 0x565535ebd680 on [inode 0x1000000054d [2,head] /dc-dir/dc-file_856 auth v5714 s=3 n(v0 rc2023-10-03T19:17:08.819962+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535642100] now 0 2023-10-03T19:21:07.924 INFO:teuthology.orchestra.run.smithi045.stdout: -7909> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5715 cv=5377/5377 ap=144+143 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=169 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535ebd680 count now 144/143 2023-10-03T19:21:07.924 INFO:teuthology.orchestra.run.smithi045.stdout: -7908> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.924 INFO:teuthology.orchestra.run.smithi045.stdout: -7907> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.924 INFO:teuthology.orchestra.run.smithi045.stdout: -7906> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000054e [2,head] /dc-dir/dc-file_857 auth v4350 pv5716 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.831916+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.831916+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535642680] 2023-10-03T19:21:07.924 INFO:teuthology.orchestra.run.smithi045.stdout: -7905> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5723 2023-10-03T19:21:07.924 INFO:teuthology.orchestra.run.smithi045.stdout: -7904> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5723 pv6007 ap=144 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=144) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=143) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.924 INFO:teuthology.orchestra.run.smithi045.stdout: -7903> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5721 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.924 INFO:teuthology.orchestra.run.smithi045.stdout: -7902> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5722 cv=5384/5384 REP dir_auth=0 ap=143+144 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5722 2023-10-03T19:21:07.925 INFO:teuthology.orchestra.run.smithi045.stdout: -7901> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000054e) pop_and_dirty_projected_inode v5716 2023-10-03T19:21:07.925 INFO:teuthology.orchestra.run.smithi045.stdout: -7900> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000054e) mark_dirty [inode 0x1000000054e [2,head] /dc-dir/dc-file_857 auth v5716 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.831916+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535642680] 2023-10-03T19:21:07.925 INFO:teuthology.orchestra.run.smithi045.stdout: -7899> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_857) mark_dirty [dentry #0x1/dc-dir/dc-file_857 [2,head] auth (dversion lock) pv=5716 v=4350 ino=0x1000000054e state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535644f00] 2023-10-03T19:21:07.925 INFO:teuthology.orchestra.run.smithi045.stdout: -7898> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5715 cv=5377/5377 ap=144+143 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=170 | child=1 dirty=1 authpin=1 0x565534f82400] version 5715 2023-10-03T19:21:07.925 INFO:teuthology.orchestra.run.smithi045.stdout: -7897> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536548140 v5724 2023-10-03T19:21:07.925 INFO:teuthology.orchestra.run.smithi045.stdout: -7896> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5724 cv=5384/5384 REP dir_auth=0 ap=143+144 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5724 2023-10-03T19:21:07.925 INFO:teuthology.orchestra.run.smithi045.stdout: -7895> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536548020 v5717 2023-10-03T19:21:07.925 INFO:teuthology.orchestra.run.smithi045.stdout: -7894> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5717 cv=5377/5377 ap=144+143 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=170 | child=1 dirty=1 authpin=1 0x565534f82400] version 5717 2023-10-03T19:21:07.925 INFO:teuthology.orchestra.run.smithi045.stdout: -7893> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=143 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=143 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.925 INFO:teuthology.orchestra.run.smithi045.stdout: -7892> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=143) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5723 pv6007 ap=144 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=144) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=143) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.925 INFO:teuthology.orchestra.run.smithi045.stdout: -7891> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=144) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5723 pv6007 ap=144 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=144) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=142) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.926 INFO:teuthology.orchestra.run.smithi045.stdout: -7890> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000054e [2,head] /dc-dir/dc-file_857 auth v5716 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.831916+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535642680] 2023-10-03T19:21:07.926 INFO:teuthology.orchestra.run.smithi045.stdout: -7889> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000054e [2,head] /dc-dir/dc-file_857 auth v5716 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.831916+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535642680] 2023-10-03T19:21:07.926 INFO:teuthology.orchestra.run.smithi045.stdout: -7888> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.926 INFO:teuthology.orchestra.run.smithi045.stdout: -7887> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.926 INFO:teuthology.orchestra.run.smithi045.stdout: -7886> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.926 INFO:teuthology.orchestra.run.smithi045.stdout: -7885> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000054e [2,head] /dc-dir/dc-file_857 auth v5716 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.831916+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535642680] 2023-10-03T19:21:07.926 INFO:teuthology.orchestra.run.smithi045.stdout: -7884> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000054e [2,head] /dc-dir/dc-file_857 auth v5716 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.831916+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535642680] 2023-10-03T19:21:07.926 INFO:teuthology.orchestra.run.smithi045.stdout: -7883> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.926 INFO:teuthology.orchestra.run.smithi045.stdout: -7882> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 586.334, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.86e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1175.5] 2023-10-03T19:21:07.926 INFO:teuthology.orchestra.run.smithi045.stdout: -7881> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535ebdb00 on [dir 0x1 / [2,head] auth pv=6008 v=5724 cv=5384/5384 REP dir_auth=0 ap=142+144 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 142 2023-10-03T19:21:07.926 INFO:teuthology.orchestra.run.smithi045.stdout: -7880> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535ebdb00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5723 pv6007 ap=143 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=143) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=142) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 143 2023-10-03T19:21:07.927 INFO:teuthology.orchestra.run.smithi045.stdout: -7879> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5724 cv=5384/5384 REP dir_auth=0 ap=142+143 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535ebdb00 count now 142/143 2023-10-03T19:21:07.927 INFO:teuthology.orchestra.run.smithi045.stdout: -7878> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535ebdb00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5717 cv=5377/5377 ap=143+143 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=170 | child=1 dirty=1 authpin=1 0x565534f82400] count now 143 2023-10-03T19:21:07.927 INFO:teuthology.orchestra.run.smithi045.stdout: -7877> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000054e) auth_unpin by 0x565535ebdb00 on [inode 0x1000000054e [2,head] /dc-dir/dc-file_857 auth v5716 s=3 n(v0 rc2023-10-03T19:17:08.831916+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535642680] now 0 2023-10-03T19:21:07.927 INFO:teuthology.orchestra.run.smithi045.stdout: -7876> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5717 cv=5377/5377 ap=143+142 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=170 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535ebdb00 count now 143/142 2023-10-03T19:21:07.927 INFO:teuthology.orchestra.run.smithi045.stdout: -7875> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.927 INFO:teuthology.orchestra.run.smithi045.stdout: -7874> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.927 INFO:teuthology.orchestra.run.smithi045.stdout: -7873> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000054f [2,head] /dc-dir/dc-file_858 auth v4354 pv5718 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.843552+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.843552+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535642c00] 2023-10-03T19:21:07.927 INFO:teuthology.orchestra.run.smithi045.stdout: -7872> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5725 2023-10-03T19:21:07.927 INFO:teuthology.orchestra.run.smithi045.stdout: -7871> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5725 pv6007 ap=143 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=143) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=142) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.927 INFO:teuthology.orchestra.run.smithi045.stdout: -7870> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5723 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.927 INFO:teuthology.orchestra.run.smithi045.stdout: -7869> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5724 cv=5384/5384 REP dir_auth=0 ap=142+143 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5724 2023-10-03T19:21:07.928 INFO:teuthology.orchestra.run.smithi045.stdout: -7868> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000054f) pop_and_dirty_projected_inode v5718 2023-10-03T19:21:07.928 INFO:teuthology.orchestra.run.smithi045.stdout: -7867> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000054f) mark_dirty [inode 0x1000000054f [2,head] /dc-dir/dc-file_858 auth v5718 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.843552+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535642c00] 2023-10-03T19:21:07.928 INFO:teuthology.orchestra.run.smithi045.stdout: -7866> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_858) mark_dirty [dentry #0x1/dc-dir/dc-file_858 [2,head] auth (dversion lock) pv=5718 v=4354 ino=0x1000000054f state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535645180] 2023-10-03T19:21:07.928 INFO:teuthology.orchestra.run.smithi045.stdout: -7865> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5717 cv=5377/5377 ap=143+142 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=171 | child=1 dirty=1 authpin=1 0x565534f82400] version 5717 2023-10-03T19:21:07.928 INFO:teuthology.orchestra.run.smithi045.stdout: -7864> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536548380 v5726 2023-10-03T19:21:07.928 INFO:teuthology.orchestra.run.smithi045.stdout: -7863> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5726 cv=5384/5384 REP dir_auth=0 ap=142+143 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5726 2023-10-03T19:21:07.981 INFO:teuthology.orchestra.run.smithi045.stdout: -7862> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536548260 v5719 2023-10-03T19:21:07.981 INFO:teuthology.orchestra.run.smithi045.stdout: -7861> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5719 cv=5377/5377 ap=143+142 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=171 | child=1 dirty=1 authpin=1 0x565534f82400] version 5719 2023-10-03T19:21:07.981 INFO:teuthology.orchestra.run.smithi045.stdout: -7860> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=142 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=142 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.981 INFO:teuthology.orchestra.run.smithi045.stdout: -7859> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=142) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5725 pv6007 ap=143 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=143) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=142) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.981 INFO:teuthology.orchestra.run.smithi045.stdout: -7858> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=143) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5725 pv6007 ap=143 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=143) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=141) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.981 INFO:teuthology.orchestra.run.smithi045.stdout: -7857> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000054f [2,head] /dc-dir/dc-file_858 auth v5718 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.843552+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535642c00] 2023-10-03T19:21:07.981 INFO:teuthology.orchestra.run.smithi045.stdout: -7856> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000054f [2,head] /dc-dir/dc-file_858 auth v5718 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.843552+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535642c00] 2023-10-03T19:21:07.981 INFO:teuthology.orchestra.run.smithi045.stdout: -7855> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.981 INFO:teuthology.orchestra.run.smithi045.stdout: -7854> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.982 INFO:teuthology.orchestra.run.smithi045.stdout: -7853> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.982 INFO:teuthology.orchestra.run.smithi045.stdout: -7852> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000054f [2,head] /dc-dir/dc-file_858 auth v5718 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.843552+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535642c00] 2023-10-03T19:21:07.982 INFO:teuthology.orchestra.run.smithi045.stdout: -7851> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000054f [2,head] /dc-dir/dc-file_858 auth v5718 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.843552+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535642c00] 2023-10-03T19:21:07.982 INFO:teuthology.orchestra.run.smithi045.stdout: -7850> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.982 INFO:teuthology.orchestra.run.smithi045.stdout: -7849> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 587.334, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.87e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1177.5] 2023-10-03T19:21:07.982 INFO:teuthology.orchestra.run.smithi045.stdout: -7848> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535ebc6c0 on [dir 0x1 / [2,head] auth pv=6008 v=5726 cv=5384/5384 REP dir_auth=0 ap=141+143 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 141 2023-10-03T19:21:07.982 INFO:teuthology.orchestra.run.smithi045.stdout: -7847> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535ebc6c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5725 pv6007 ap=142 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=142) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=141) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 142 2023-10-03T19:21:07.982 INFO:teuthology.orchestra.run.smithi045.stdout: -7846> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5726 cv=5384/5384 REP dir_auth=0 ap=141+142 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535ebc6c0 count now 141/142 2023-10-03T19:21:07.982 INFO:teuthology.orchestra.run.smithi045.stdout: -7845> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535ebc6c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5719 cv=5377/5377 ap=142+142 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=171 | child=1 dirty=1 authpin=1 0x565534f82400] count now 142 2023-10-03T19:21:07.982 INFO:teuthology.orchestra.run.smithi045.stdout: -7844> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000054f) auth_unpin by 0x565535ebc6c0 on [inode 0x1000000054f [2,head] /dc-dir/dc-file_858 auth v5718 s=3 n(v0 rc2023-10-03T19:17:08.843552+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535642c00] now 0 2023-10-03T19:21:07.982 INFO:teuthology.orchestra.run.smithi045.stdout: -7843> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5719 cv=5377/5377 ap=142+141 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=171 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535ebc6c0 count now 142/141 2023-10-03T19:21:07.983 INFO:teuthology.orchestra.run.smithi045.stdout: -7842> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.983 INFO:teuthology.orchestra.run.smithi045.stdout: -7841> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.983 INFO:teuthology.orchestra.run.smithi045.stdout: -7840> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000550 [2,head] /dc-dir/dc-file_859 auth v4358 pv5720 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.854764+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.854764+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535643180] 2023-10-03T19:21:07.983 INFO:teuthology.orchestra.run.smithi045.stdout: -7839> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5727 2023-10-03T19:21:07.983 INFO:teuthology.orchestra.run.smithi045.stdout: -7838> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5727 pv6007 ap=142 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=142) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=141) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.983 INFO:teuthology.orchestra.run.smithi045.stdout: -7837> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5725 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.983 INFO:teuthology.orchestra.run.smithi045.stdout: -7836> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5726 cv=5384/5384 REP dir_auth=0 ap=141+142 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5726 2023-10-03T19:21:07.983 INFO:teuthology.orchestra.run.smithi045.stdout: -7835> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000550) pop_and_dirty_projected_inode v5720 2023-10-03T19:21:07.983 INFO:teuthology.orchestra.run.smithi045.stdout: -7834> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000550) mark_dirty [inode 0x10000000550 [2,head] /dc-dir/dc-file_859 auth v5720 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.854764+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535643180] 2023-10-03T19:21:07.983 INFO:teuthology.orchestra.run.smithi045.stdout: -7833> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_859) mark_dirty [dentry #0x1/dc-dir/dc-file_859 [2,head] auth (dversion lock) pv=5720 v=4358 ino=0x10000000550 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535645400] 2023-10-03T19:21:07.983 INFO:teuthology.orchestra.run.smithi045.stdout: -7832> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5719 cv=5377/5377 ap=142+141 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=172 | child=1 dirty=1 authpin=1 0x565534f82400] version 5719 2023-10-03T19:21:07.984 INFO:teuthology.orchestra.run.smithi045.stdout: -7831> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x5655365485c0 v5728 2023-10-03T19:21:07.984 INFO:teuthology.orchestra.run.smithi045.stdout: -7830> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5728 cv=5384/5384 REP dir_auth=0 ap=141+142 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5728 2023-10-03T19:21:07.984 INFO:teuthology.orchestra.run.smithi045.stdout: -7829> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655365484a0 v5721 2023-10-03T19:21:07.984 INFO:teuthology.orchestra.run.smithi045.stdout: -7828> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5721 cv=5377/5377 ap=142+141 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=172 | child=1 dirty=1 authpin=1 0x565534f82400] version 5721 2023-10-03T19:21:07.984 INFO:teuthology.orchestra.run.smithi045.stdout: -7827> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=141 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=141 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:07.984 INFO:teuthology.orchestra.run.smithi045.stdout: -7826> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=141) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5727 pv6007 ap=142 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=142) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=141) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.984 INFO:teuthology.orchestra.run.smithi045.stdout: -7825> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=142) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5727 pv6007 ap=142 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=142) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=140) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.984 INFO:teuthology.orchestra.run.smithi045.stdout: -7824> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000550 [2,head] /dc-dir/dc-file_859 auth v5720 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.854764+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535643180] 2023-10-03T19:21:07.984 INFO:teuthology.orchestra.run.smithi045.stdout: -7823> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000550 [2,head] /dc-dir/dc-file_859 auth v5720 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.854764+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535643180] 2023-10-03T19:21:07.984 INFO:teuthology.orchestra.run.smithi045.stdout: -7822> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:07.985 INFO:teuthology.orchestra.run.smithi045.stdout: -7821> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:07.985 INFO:teuthology.orchestra.run.smithi045.stdout: -7820> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:07.985 INFO:teuthology.orchestra.run.smithi045.stdout: -7819> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000550 [2,head] /dc-dir/dc-file_859 auth v5720 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.854764+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535643180] 2023-10-03T19:21:07.985 INFO:teuthology.orchestra.run.smithi045.stdout: -7818> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000550 [2,head] /dc-dir/dc-file_859 auth v5720 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.854764+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535643180] 2023-10-03T19:21:07.985 INFO:teuthology.orchestra.run.smithi045.stdout: -7817> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:07.985 INFO:teuthology.orchestra.run.smithi045.stdout: -7816> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 588.334, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.88e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1179.5] 2023-10-03T19:21:07.985 INFO:teuthology.orchestra.run.smithi045.stdout: -7815> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655363fbd40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5727 pv6007 ap=141 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=141) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=140) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 141 2023-10-03T19:21:07.985 INFO:teuthology.orchestra.run.smithi045.stdout: -7814> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5728 cv=5384/5384 REP dir_auth=0 ap=141+141 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655363fbd40 count now 141/141 2023-10-03T19:21:07.985 INFO:teuthology.orchestra.run.smithi045.stdout: -7813> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655363fbd40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5721 cv=5377/5377 ap=141+141 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=172 | child=1 dirty=1 authpin=1 0x565534f82400] count now 141 2023-10-03T19:21:07.985 INFO:teuthology.orchestra.run.smithi045.stdout: -7812> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655363fbd40 on [dir 0x1 / [2,head] auth pv=6008 v=5728 cv=5384/5384 REP dir_auth=0 ap=140+141 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 140 2023-10-03T19:21:07.985 INFO:teuthology.orchestra.run.smithi045.stdout: -7811> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000550) auth_unpin by 0x5655363fbd40 on [inode 0x10000000550 [2,head] /dc-dir/dc-file_859 auth v5720 s=3 n(v0 rc2023-10-03T19:17:08.854764+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535643180] now 0 2023-10-03T19:21:07.986 INFO:teuthology.orchestra.run.smithi045.stdout: -7810> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5721 cv=5377/5377 ap=141+140 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=172 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655363fbd40 count now 141/140 2023-10-03T19:21:07.986 INFO:teuthology.orchestra.run.smithi045.stdout: -7809> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.986 INFO:teuthology.orchestra.run.smithi045.stdout: -7808> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:07.986 INFO:teuthology.orchestra.run.smithi045.stdout: -7807> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000551 [2,head] /dc-dir/dc-file_860 auth v4362 pv5722 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.865600+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.865600+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535643700] 2023-10-03T19:21:07.986 INFO:teuthology.orchestra.run.smithi045.stdout: -7806> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5729 2023-10-03T19:21:07.986 INFO:teuthology.orchestra.run.smithi045.stdout: -7805> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5729 pv6007 ap=141 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=141) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=140) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:07.986 INFO:teuthology.orchestra.run.smithi045.stdout: -7804> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5727 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:07.986 INFO:teuthology.orchestra.run.smithi045.stdout: -7803> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5728 cv=5384/5384 REP dir_auth=0 ap=140+141 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5728 2023-10-03T19:21:07.986 INFO:teuthology.orchestra.run.smithi045.stdout: -7802> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000551) pop_and_dirty_projected_inode v5722 2023-10-03T19:21:07.986 INFO:teuthology.orchestra.run.smithi045.stdout: -7801> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000551) mark_dirty [inode 0x10000000551 [2,head] /dc-dir/dc-file_860 auth v5722 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.865600+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535643700] 2023-10-03T19:21:07.986 INFO:teuthology.orchestra.run.smithi045.stdout: -7800> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_860) mark_dirty [dentry #0x1/dc-dir/dc-file_860 [2,head] auth (dversion lock) pv=5722 v=4362 ino=0x10000000551 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535645680] 2023-10-03T19:21:07.987 INFO:teuthology.orchestra.run.smithi045.stdout: -7799> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5721 cv=5377/5377 ap=141+140 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=173 | child=1 dirty=1 authpin=1 0x565534f82400] version 5721 2023-10-03T19:21:07.987 INFO:teuthology.orchestra.run.smithi045.stdout: -7798> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536548800 v5730 2023-10-03T19:21:07.987 INFO:teuthology.orchestra.run.smithi045.stdout: -7797> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5730 cv=5384/5384 REP dir_auth=0 ap=140+141 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5730 2023-10-03T19:21:07.987 INFO:teuthology.orchestra.run.smithi045.stdout: -7796> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655365486e0 v5723 2023-10-03T19:21:07.987 INFO:teuthology.orchestra.run.smithi045.stdout: -7795> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5723 cv=5377/5377 ap=141+140 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=173 | child=1 dirty=1 authpin=1 0x565534f82400] version 5723 2023-10-03T19:21:08.026 INFO:teuthology.orchestra.run.smithi045.stdout: -7794> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=140 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=140 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.026 INFO:teuthology.orchestra.run.smithi045.stdout: -7793> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=140) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5729 pv6007 ap=141 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=141) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=140) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.026 INFO:teuthology.orchestra.run.smithi045.stdout: -7792> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=141) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5729 pv6007 ap=141 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=141) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=139) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.027 INFO:teuthology.orchestra.run.smithi045.stdout: -7791> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000551 [2,head] /dc-dir/dc-file_860 auth v5722 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.865600+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535643700] 2023-10-03T19:21:08.027 INFO:teuthology.orchestra.run.smithi045.stdout: -7790> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000551 [2,head] /dc-dir/dc-file_860 auth v5722 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.865600+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535643700] 2023-10-03T19:21:08.027 INFO:teuthology.orchestra.run.smithi045.stdout: -7789> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.027 INFO:teuthology.orchestra.run.smithi045.stdout: -7788> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.027 INFO:teuthology.orchestra.run.smithi045.stdout: -7787> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.027 INFO:teuthology.orchestra.run.smithi045.stdout: -7786> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000551 [2,head] /dc-dir/dc-file_860 auth v5722 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.865600+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535643700] 2023-10-03T19:21:08.027 INFO:teuthology.orchestra.run.smithi045.stdout: -7785> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000551 [2,head] /dc-dir/dc-file_860 auth v5722 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.865600+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535643700] 2023-10-03T19:21:08.027 INFO:teuthology.orchestra.run.smithi045.stdout: -7784> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.027 INFO:teuthology.orchestra.run.smithi045.stdout: -7783> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 589.334, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.89e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.01e-01] *LOAD:1181.5] 2023-10-03T19:21:08.027 INFO:teuthology.orchestra.run.smithi045.stdout: -7782> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655363fb440 on [dir 0x1 / [2,head] auth pv=6008 v=5730 cv=5384/5384 REP dir_auth=0 ap=139+141 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 139 2023-10-03T19:21:08.028 INFO:teuthology.orchestra.run.smithi045.stdout: -7781> 2023-10-03T19:17:19.522+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655363fb440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5729 pv6007 ap=140 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=140) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=139) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 140 2023-10-03T19:21:08.028 INFO:teuthology.orchestra.run.smithi045.stdout: -7780> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5730 cv=5384/5384 REP dir_auth=0 ap=139+140 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655363fb440 count now 139/140 2023-10-03T19:21:08.028 INFO:teuthology.orchestra.run.smithi045.stdout: -7779> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655363fb440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5723 cv=5377/5377 ap=140+140 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=173 | child=1 dirty=1 authpin=1 0x565534f82400] count now 140 2023-10-03T19:21:08.028 INFO:teuthology.orchestra.run.smithi045.stdout: -7778> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000551) auth_unpin by 0x5655363fb440 on [inode 0x10000000551 [2,head] /dc-dir/dc-file_860 auth v5722 s=3 n(v0 rc2023-10-03T19:17:08.865600+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535643700] now 0 2023-10-03T19:21:08.028 INFO:teuthology.orchestra.run.smithi045.stdout: -7777> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5723 cv=5377/5377 ap=140+139 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=173 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655363fb440 count now 140/139 2023-10-03T19:21:08.028 INFO:teuthology.orchestra.run.smithi045.stdout: -7776> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.028 INFO:teuthology.orchestra.run.smithi045.stdout: -7775> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.028 INFO:teuthology.orchestra.run.smithi045.stdout: -7774> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000552 [2,head] /dc-dir/dc-file_861 auth v4366 pv5724 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.876693+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.876693+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553564a000] 2023-10-03T19:21:08.028 INFO:teuthology.orchestra.run.smithi045.stdout: -7773> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5731 2023-10-03T19:21:08.028 INFO:teuthology.orchestra.run.smithi045.stdout: -7772> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5731 pv6007 ap=140 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=140) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=139) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.028 INFO:teuthology.orchestra.run.smithi045.stdout: -7771> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5729 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.029 INFO:teuthology.orchestra.run.smithi045.stdout: -7770> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5730 cv=5384/5384 REP dir_auth=0 ap=139+140 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5730 2023-10-03T19:21:08.029 INFO:teuthology.orchestra.run.smithi045.stdout: -7769> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000552) pop_and_dirty_projected_inode v5724 2023-10-03T19:21:08.029 INFO:teuthology.orchestra.run.smithi045.stdout: -7768> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000552) mark_dirty [inode 0x10000000552 [2,head] /dc-dir/dc-file_861 auth v5724 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.876693+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553564a000] 2023-10-03T19:21:08.029 INFO:teuthology.orchestra.run.smithi045.stdout: -7767> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_861) mark_dirty [dentry #0x1/dc-dir/dc-file_861 [2,head] auth (dversion lock) pv=5724 v=4366 ino=0x10000000552 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535645900] 2023-10-03T19:21:08.029 INFO:teuthology.orchestra.run.smithi045.stdout: -7766> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5723 cv=5377/5377 ap=140+139 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=174 | child=1 dirty=1 authpin=1 0x565534f82400] version 5723 2023-10-03T19:21:08.029 INFO:teuthology.orchestra.run.smithi045.stdout: -7765> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536548a40 v5732 2023-10-03T19:21:08.029 INFO:teuthology.orchestra.run.smithi045.stdout: -7764> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5732 cv=5384/5384 REP dir_auth=0 ap=139+140 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5732 2023-10-03T19:21:08.029 INFO:teuthology.orchestra.run.smithi045.stdout: -7763> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536548920 v5725 2023-10-03T19:21:08.029 INFO:teuthology.orchestra.run.smithi045.stdout: -7762> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5725 cv=5377/5377 ap=140+139 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=174 | child=1 dirty=1 authpin=1 0x565534f82400] version 5725 2023-10-03T19:21:08.029 INFO:teuthology.orchestra.run.smithi045.stdout: -7761> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=139 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=139 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.030 INFO:teuthology.orchestra.run.smithi045.stdout: -7760> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=139) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5731 pv6007 ap=140 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=140) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=139) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.030 INFO:teuthology.orchestra.run.smithi045.stdout: -7759> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=140) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5731 pv6007 ap=140 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=140) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=138) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.030 INFO:teuthology.orchestra.run.smithi045.stdout: -7758> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000552 [2,head] /dc-dir/dc-file_861 auth v5724 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.876693+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564a000] 2023-10-03T19:21:08.030 INFO:teuthology.orchestra.run.smithi045.stdout: -7757> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000552 [2,head] /dc-dir/dc-file_861 auth v5724 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.876693+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564a000] 2023-10-03T19:21:08.030 INFO:teuthology.orchestra.run.smithi045.stdout: -7756> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.030 INFO:teuthology.orchestra.run.smithi045.stdout: -7755> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.030 INFO:teuthology.orchestra.run.smithi045.stdout: -7754> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.030 INFO:teuthology.orchestra.run.smithi045.stdout: -7753> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000552 [2,head] /dc-dir/dc-file_861 auth v5724 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.876693+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564a000] 2023-10-03T19:21:08.030 INFO:teuthology.orchestra.run.smithi045.stdout: -7752> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000552 [2,head] /dc-dir/dc-file_861 auth v5724 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.876693+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564a000] 2023-10-03T19:21:08.030 INFO:teuthology.orchestra.run.smithi045.stdout: -7751> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.030 INFO:teuthology.orchestra.run.smithi045.stdout: -7750> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 590.007, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.90e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1182.8] 2023-10-03T19:21:08.031 INFO:teuthology.orchestra.run.smithi045.stdout: -7749> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655363fab40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5731 pv6007 ap=139 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=139) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=138) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 139 2023-10-03T19:21:08.031 INFO:teuthology.orchestra.run.smithi045.stdout: -7748> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5732 cv=5384/5384 REP dir_auth=0 ap=139+139 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655363fab40 count now 139/139 2023-10-03T19:21:08.031 INFO:teuthology.orchestra.run.smithi045.stdout: -7747> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655363fab40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5725 cv=5377/5377 ap=139+139 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=174 | child=1 dirty=1 authpin=1 0x565534f82400] count now 139 2023-10-03T19:21:08.031 INFO:teuthology.orchestra.run.smithi045.stdout: -7746> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655363fab40 on [dir 0x1 / [2,head] auth pv=6008 v=5732 cv=5384/5384 REP dir_auth=0 ap=138+139 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 138 2023-10-03T19:21:08.031 INFO:teuthology.orchestra.run.smithi045.stdout: -7745> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000552) auth_unpin by 0x5655363fab40 on [inode 0x10000000552 [2,head] /dc-dir/dc-file_861 auth v5724 s=3 n(v0 rc2023-10-03T19:17:08.876693+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553564a000] now 0 2023-10-03T19:21:08.031 INFO:teuthology.orchestra.run.smithi045.stdout: -7744> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5725 cv=5377/5377 ap=139+138 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=174 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655363fab40 count now 139/138 2023-10-03T19:21:08.031 INFO:teuthology.orchestra.run.smithi045.stdout: -7743> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.031 INFO:teuthology.orchestra.run.smithi045.stdout: -7742> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.031 INFO:teuthology.orchestra.run.smithi045.stdout: -7741> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000553 [2,head] /dc-dir/dc-file_862 auth v4370 pv5726 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.887862+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.887862+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553564a580] 2023-10-03T19:21:08.031 INFO:teuthology.orchestra.run.smithi045.stdout: -7740> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5733 2023-10-03T19:21:08.032 INFO:teuthology.orchestra.run.smithi045.stdout: -7739> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5733 pv6007 ap=139 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=139) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=138) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.032 INFO:teuthology.orchestra.run.smithi045.stdout: -7738> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5731 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.032 INFO:teuthology.orchestra.run.smithi045.stdout: -7737> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5732 cv=5384/5384 REP dir_auth=0 ap=138+139 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5732 2023-10-03T19:21:08.032 INFO:teuthology.orchestra.run.smithi045.stdout: -7736> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000553) pop_and_dirty_projected_inode v5726 2023-10-03T19:21:08.032 INFO:teuthology.orchestra.run.smithi045.stdout: -7735> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000553) mark_dirty [inode 0x10000000553 [2,head] /dc-dir/dc-file_862 auth v5726 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.887862+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553564a580] 2023-10-03T19:21:08.032 INFO:teuthology.orchestra.run.smithi045.stdout: -7734> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_862) mark_dirty [dentry #0x1/dc-dir/dc-file_862 [2,head] auth (dversion lock) pv=5726 v=4370 ino=0x10000000553 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535645b80] 2023-10-03T19:21:08.032 INFO:teuthology.orchestra.run.smithi045.stdout: -7733> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5725 cv=5377/5377 ap=139+138 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=175 | child=1 dirty=1 authpin=1 0x565534f82400] version 5725 2023-10-03T19:21:08.032 INFO:teuthology.orchestra.run.smithi045.stdout: -7732> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536548c80 v5734 2023-10-03T19:21:08.032 INFO:teuthology.orchestra.run.smithi045.stdout: -7731> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5734 cv=5384/5384 REP dir_auth=0 ap=138+139 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5734 2023-10-03T19:21:08.032 INFO:teuthology.orchestra.run.smithi045.stdout: -7730> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536548b60 v5727 2023-10-03T19:21:08.032 INFO:teuthology.orchestra.run.smithi045.stdout: -7729> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5727 cv=5377/5377 ap=139+138 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=175 | child=1 dirty=1 authpin=1 0x565534f82400] version 5727 2023-10-03T19:21:08.032 INFO:teuthology.orchestra.run.smithi045.stdout: -7728> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=138 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=138 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.033 INFO:teuthology.orchestra.run.smithi045.stdout: -7727> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=138) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5733 pv6007 ap=139 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=139) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=138) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.316 INFO:teuthology.orchestra.run.smithi045.stdout: -7726> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=139) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5733 pv6007 ap=139 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=139) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=137) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.316 INFO:teuthology.orchestra.run.smithi045.stdout: -7725> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000553 [2,head] /dc-dir/dc-file_862 auth v5726 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.887862+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564a580] 2023-10-03T19:21:08.316 INFO:teuthology.orchestra.run.smithi045.stdout: -7724> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000553 [2,head] /dc-dir/dc-file_862 auth v5726 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.887862+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564a580] 2023-10-03T19:21:08.317 INFO:teuthology.orchestra.run.smithi045.stdout: -7723> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.317 INFO:teuthology.orchestra.run.smithi045.stdout: -7722> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.317 INFO:teuthology.orchestra.run.smithi045.stdout: -7721> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.317 INFO:teuthology.orchestra.run.smithi045.stdout: -7720> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000553 [2,head] /dc-dir/dc-file_862 auth v5726 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.887862+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564a580] 2023-10-03T19:21:08.317 INFO:teuthology.orchestra.run.smithi045.stdout: -7719> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000553 [2,head] /dc-dir/dc-file_862 auth v5726 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.887862+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564a580] 2023-10-03T19:21:08.317 INFO:teuthology.orchestra.run.smithi045.stdout: -7718> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.317 INFO:teuthology.orchestra.run.smithi045.stdout: -7717> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 591.007, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.91e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1184.8] 2023-10-03T19:21:08.317 INFO:teuthology.orchestra.run.smithi045.stdout: -7716> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655363fa240 on [dir 0x1 / [2,head] auth pv=6008 v=5734 cv=5384/5384 REP dir_auth=0 ap=137+139 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 137 2023-10-03T19:21:08.318 INFO:teuthology.orchestra.run.smithi045.stdout: -7715> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655363fa240 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5733 pv6007 ap=138 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=138) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=137) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 138 2023-10-03T19:21:08.318 INFO:teuthology.orchestra.run.smithi045.stdout: -7714> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5734 cv=5384/5384 REP dir_auth=0 ap=137+138 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655363fa240 count now 137/138 2023-10-03T19:21:08.318 INFO:teuthology.orchestra.run.smithi045.stdout: -7713> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655363fa240 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5727 cv=5377/5377 ap=138+138 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=175 | child=1 dirty=1 authpin=1 0x565534f82400] count now 138 2023-10-03T19:21:08.318 INFO:teuthology.orchestra.run.smithi045.stdout: -7712> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000553) auth_unpin by 0x5655363fa240 on [inode 0x10000000553 [2,head] /dc-dir/dc-file_862 auth v5726 s=3 n(v0 rc2023-10-03T19:17:08.887862+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553564a580] now 0 2023-10-03T19:21:08.318 INFO:teuthology.orchestra.run.smithi045.stdout: -7711> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5727 cv=5377/5377 ap=138+137 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=175 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655363fa240 count now 138/137 2023-10-03T19:21:08.318 INFO:teuthology.orchestra.run.smithi045.stdout: -7710> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.318 INFO:teuthology.orchestra.run.smithi045.stdout: -7709> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.318 INFO:teuthology.orchestra.run.smithi045.stdout: -7708> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000554 [2,head] /dc-dir/dc-file_863 auth v4374 pv5728 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.899009+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.899009+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553564ab00] 2023-10-03T19:21:08.318 INFO:teuthology.orchestra.run.smithi045.stdout: -7707> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5735 2023-10-03T19:21:08.319 INFO:teuthology.orchestra.run.smithi045.stdout: -7706> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5735 pv6007 ap=138 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=138) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=137) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.319 INFO:teuthology.orchestra.run.smithi045.stdout: -7705> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5733 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.319 INFO:teuthology.orchestra.run.smithi045.stdout: -7704> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5734 cv=5384/5384 REP dir_auth=0 ap=137+138 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5734 2023-10-03T19:21:08.319 INFO:teuthology.orchestra.run.smithi045.stdout: -7703> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000554) pop_and_dirty_projected_inode v5728 2023-10-03T19:21:08.319 INFO:teuthology.orchestra.run.smithi045.stdout: -7702> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000554) mark_dirty [inode 0x10000000554 [2,head] /dc-dir/dc-file_863 auth v5728 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.899009+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553564ab00] 2023-10-03T19:21:08.319 INFO:teuthology.orchestra.run.smithi045.stdout: -7701> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_863) mark_dirty [dentry #0x1/dc-dir/dc-file_863 [2,head] auth (dversion lock) pv=5728 v=4374 ino=0x10000000554 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553564e000] 2023-10-03T19:21:08.319 INFO:teuthology.orchestra.run.smithi045.stdout: -7700> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5727 cv=5377/5377 ap=138+137 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=176 | child=1 dirty=1 authpin=1 0x565534f82400] version 5727 2023-10-03T19:21:08.319 INFO:teuthology.orchestra.run.smithi045.stdout: -7699> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536548ec0 v5736 2023-10-03T19:21:08.319 INFO:teuthology.orchestra.run.smithi045.stdout: -7698> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5736 cv=5384/5384 REP dir_auth=0 ap=137+138 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5736 2023-10-03T19:21:08.319 INFO:teuthology.orchestra.run.smithi045.stdout: -7697> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536548da0 v5729 2023-10-03T19:21:08.319 INFO:teuthology.orchestra.run.smithi045.stdout: -7696> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5729 cv=5377/5377 ap=138+137 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=176 | child=1 dirty=1 authpin=1 0x565534f82400] version 5729 2023-10-03T19:21:08.320 INFO:teuthology.orchestra.run.smithi045.stdout: -7695> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=137 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=137 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.320 INFO:teuthology.orchestra.run.smithi045.stdout: -7694> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=137) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5735 pv6007 ap=138 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=138) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=137) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.320 INFO:teuthology.orchestra.run.smithi045.stdout: -7693> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=138) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5735 pv6007 ap=138 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=138) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=136) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.320 INFO:teuthology.orchestra.run.smithi045.stdout: -7692> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000554 [2,head] /dc-dir/dc-file_863 auth v5728 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.899009+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564ab00] 2023-10-03T19:21:08.320 INFO:teuthology.orchestra.run.smithi045.stdout: -7691> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000554 [2,head] /dc-dir/dc-file_863 auth v5728 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.899009+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564ab00] 2023-10-03T19:21:08.320 INFO:teuthology.orchestra.run.smithi045.stdout: -7690> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.320 INFO:teuthology.orchestra.run.smithi045.stdout: -7689> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.320 INFO:teuthology.orchestra.run.smithi045.stdout: -7688> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.320 INFO:teuthology.orchestra.run.smithi045.stdout: -7687> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000554 [2,head] /dc-dir/dc-file_863 auth v5728 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.899009+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564ab00] 2023-10-03T19:21:08.320 INFO:teuthology.orchestra.run.smithi045.stdout: -7686> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000554 [2,head] /dc-dir/dc-file_863 auth v5728 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.899009+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564ab00] 2023-10-03T19:21:08.321 INFO:teuthology.orchestra.run.smithi045.stdout: -7685> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.321 INFO:teuthology.orchestra.run.smithi045.stdout: -7684> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 592.007, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.92e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1186.8] 2023-10-03T19:21:08.321 INFO:teuthology.orchestra.run.smithi045.stdout: -7683> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535299680 on [dir 0x1 / [2,head] auth pv=6008 v=5736 cv=5384/5384 REP dir_auth=0 ap=136+138 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 136 2023-10-03T19:21:08.321 INFO:teuthology.orchestra.run.smithi045.stdout: -7682> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535299680 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5735 pv6007 ap=137 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=137) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=136) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 137 2023-10-03T19:21:08.321 INFO:teuthology.orchestra.run.smithi045.stdout: -7681> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5736 cv=5384/5384 REP dir_auth=0 ap=136+137 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535299680 count now 136/137 2023-10-03T19:21:08.321 INFO:teuthology.orchestra.run.smithi045.stdout: -7680> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535299680 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5729 cv=5377/5377 ap=137+137 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=176 | child=1 dirty=1 authpin=1 0x565534f82400] count now 137 2023-10-03T19:21:08.321 INFO:teuthology.orchestra.run.smithi045.stdout: -7679> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000554) auth_unpin by 0x565535299680 on [inode 0x10000000554 [2,head] /dc-dir/dc-file_863 auth v5728 s=3 n(v0 rc2023-10-03T19:17:08.899009+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553564ab00] now 0 2023-10-03T19:21:08.321 INFO:teuthology.orchestra.run.smithi045.stdout: -7678> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5729 cv=5377/5377 ap=137+136 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=176 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535299680 count now 137/136 2023-10-03T19:21:08.321 INFO:teuthology.orchestra.run.smithi045.stdout: -7677> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.321 INFO:teuthology.orchestra.run.smithi045.stdout: -7676> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.321 INFO:teuthology.orchestra.run.smithi045.stdout: -7675> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000555 [2,head] /dc-dir/dc-file_864 auth v4378 pv5730 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.910108+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.910108+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553564b080] 2023-10-03T19:21:08.322 INFO:teuthology.orchestra.run.smithi045.stdout: -7674> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5737 2023-10-03T19:21:08.322 INFO:teuthology.orchestra.run.smithi045.stdout: -7673> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5737 pv6007 ap=137 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=137) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=136) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.322 INFO:teuthology.orchestra.run.smithi045.stdout: -7672> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5735 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.322 INFO:teuthology.orchestra.run.smithi045.stdout: -7671> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5736 cv=5384/5384 REP dir_auth=0 ap=136+137 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5736 2023-10-03T19:21:08.322 INFO:teuthology.orchestra.run.smithi045.stdout: -7670> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000555) pop_and_dirty_projected_inode v5730 2023-10-03T19:21:08.322 INFO:teuthology.orchestra.run.smithi045.stdout: -7669> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000555) mark_dirty [inode 0x10000000555 [2,head] /dc-dir/dc-file_864 auth v5730 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.910108+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553564b080] 2023-10-03T19:21:08.322 INFO:teuthology.orchestra.run.smithi045.stdout: -7668> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_864) mark_dirty [dentry #0x1/dc-dir/dc-file_864 [2,head] auth (dversion lock) pv=5730 v=4378 ino=0x10000000555 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553564e280] 2023-10-03T19:21:08.322 INFO:teuthology.orchestra.run.smithi045.stdout: -7667> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5729 cv=5377/5377 ap=137+136 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=177 | child=1 dirty=1 authpin=1 0x565534f82400] version 5729 2023-10-03T19:21:08.322 INFO:teuthology.orchestra.run.smithi045.stdout: -7666> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536549100 v5738 2023-10-03T19:21:08.323 INFO:teuthology.orchestra.run.smithi045.stdout: -7665> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5738 cv=5384/5384 REP dir_auth=0 ap=136+137 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5738 2023-10-03T19:21:08.323 INFO:teuthology.orchestra.run.smithi045.stdout: -7664> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536548fe0 v5731 2023-10-03T19:21:08.323 INFO:teuthology.orchestra.run.smithi045.stdout: -7663> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5731 cv=5377/5377 ap=137+136 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=177 | child=1 dirty=1 authpin=1 0x565534f82400] version 5731 2023-10-03T19:21:08.323 INFO:teuthology.orchestra.run.smithi045.stdout: -7662> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=136 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=136 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.323 INFO:teuthology.orchestra.run.smithi045.stdout: -7661> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=136) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5737 pv6007 ap=137 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=137) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=136) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.323 INFO:teuthology.orchestra.run.smithi045.stdout: -7660> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=137) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5737 pv6007 ap=137 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=137) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=135) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.323 INFO:teuthology.orchestra.run.smithi045.stdout: -7659> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000555 [2,head] /dc-dir/dc-file_864 auth v5730 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.910108+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564b080] 2023-10-03T19:21:08.323 INFO:teuthology.orchestra.run.smithi045.stdout: -7658> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000555 [2,head] /dc-dir/dc-file_864 auth v5730 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.910108+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564b080] 2023-10-03T19:21:08.323 INFO:teuthology.orchestra.run.smithi045.stdout: -7657> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.323 INFO:teuthology.orchestra.run.smithi045.stdout: -7656> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.323 INFO:teuthology.orchestra.run.smithi045.stdout: -7655> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.324 INFO:teuthology.orchestra.run.smithi045.stdout: -7654> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000555 [2,head] /dc-dir/dc-file_864 auth v5730 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.910108+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564b080] 2023-10-03T19:21:08.324 INFO:teuthology.orchestra.run.smithi045.stdout: -7653> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000555 [2,head] /dc-dir/dc-file_864 auth v5730 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.910108+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564b080] 2023-10-03T19:21:08.324 INFO:teuthology.orchestra.run.smithi045.stdout: -7652> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.324 INFO:teuthology.orchestra.run.smithi045.stdout: -7651> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 593.007, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.93e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1188.8] 2023-10-03T19:21:08.324 INFO:teuthology.orchestra.run.smithi045.stdout: -7650> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535299440 on [dir 0x1 / [2,head] auth pv=6008 v=5738 cv=5384/5384 REP dir_auth=0 ap=135+137 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 135 2023-10-03T19:21:08.324 INFO:teuthology.orchestra.run.smithi045.stdout: -7649> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535299440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5731 cv=5377/5377 ap=136+136 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=177 | child=1 dirty=1 authpin=1 0x565534f82400] count now 136 2023-10-03T19:21:08.324 INFO:teuthology.orchestra.run.smithi045.stdout: -7648> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535299440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5737 pv6007 ap=136 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=136) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=135) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 136 2023-10-03T19:21:08.324 INFO:teuthology.orchestra.run.smithi045.stdout: -7647> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5738 cv=5384/5384 REP dir_auth=0 ap=135+136 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535299440 count now 135/136 2023-10-03T19:21:08.324 INFO:teuthology.orchestra.run.smithi045.stdout: -7646> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000555) auth_unpin by 0x565535299440 on [inode 0x10000000555 [2,head] /dc-dir/dc-file_864 auth v5730 s=3 n(v0 rc2023-10-03T19:17:08.910108+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553564b080] now 0 2023-10-03T19:21:08.325 INFO:teuthology.orchestra.run.smithi045.stdout: -7645> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5731 cv=5377/5377 ap=136+135 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=177 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535299440 count now 136/135 2023-10-03T19:21:08.325 INFO:teuthology.orchestra.run.smithi045.stdout: -7644> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.325 INFO:teuthology.orchestra.run.smithi045.stdout: -7643> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.325 INFO:teuthology.orchestra.run.smithi045.stdout: -7642> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000556 [2,head] /dc-dir/dc-file_865 auth v4382 pv5732 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.922309+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.922309+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553564b600] 2023-10-03T19:21:08.325 INFO:teuthology.orchestra.run.smithi045.stdout: -7641> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5739 2023-10-03T19:21:08.325 INFO:teuthology.orchestra.run.smithi045.stdout: -7640> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5739 pv6007 ap=136 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=136) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=135) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.325 INFO:teuthology.orchestra.run.smithi045.stdout: -7639> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5737 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.325 INFO:teuthology.orchestra.run.smithi045.stdout: -7638> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5738 cv=5384/5384 REP dir_auth=0 ap=135+136 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5738 2023-10-03T19:21:08.325 INFO:teuthology.orchestra.run.smithi045.stdout: -7637> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000556) pop_and_dirty_projected_inode v5732 2023-10-03T19:21:08.325 INFO:teuthology.orchestra.run.smithi045.stdout: -7636> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000556) mark_dirty [inode 0x10000000556 [2,head] /dc-dir/dc-file_865 auth v5732 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.922309+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553564b600] 2023-10-03T19:21:08.325 INFO:teuthology.orchestra.run.smithi045.stdout: -7635> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_865) mark_dirty [dentry #0x1/dc-dir/dc-file_865 [2,head] auth (dversion lock) pv=5732 v=4382 ino=0x10000000556 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553564e500] 2023-10-03T19:21:08.326 INFO:teuthology.orchestra.run.smithi045.stdout: -7634> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5731 cv=5377/5377 ap=136+135 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=178 | child=1 dirty=1 authpin=1 0x565534f82400] version 5731 2023-10-03T19:21:08.326 INFO:teuthology.orchestra.run.smithi045.stdout: -7633> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536549340 v5740 2023-10-03T19:21:08.326 INFO:teuthology.orchestra.run.smithi045.stdout: -7632> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5740 cv=5384/5384 REP dir_auth=0 ap=135+136 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5740 2023-10-03T19:21:08.326 INFO:teuthology.orchestra.run.smithi045.stdout: -7631> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536549220 v5733 2023-10-03T19:21:08.326 INFO:teuthology.orchestra.run.smithi045.stdout: -7630> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5733 cv=5377/5377 ap=136+135 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=178 | child=1 dirty=1 authpin=1 0x565534f82400] version 5733 2023-10-03T19:21:08.326 INFO:teuthology.orchestra.run.smithi045.stdout: -7629> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=135 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=135 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.326 INFO:teuthology.orchestra.run.smithi045.stdout: -7628> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=135) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5739 pv6007 ap=136 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=136) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=135) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.326 INFO:teuthology.orchestra.run.smithi045.stdout: -7627> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=136) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5739 pv6007 ap=136 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=136) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=134) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.326 INFO:teuthology.orchestra.run.smithi045.stdout: -7626> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000556 [2,head] /dc-dir/dc-file_865 auth v5732 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.922309+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564b600] 2023-10-03T19:21:08.326 INFO:teuthology.orchestra.run.smithi045.stdout: -7625> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000556 [2,head] /dc-dir/dc-file_865 auth v5732 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.922309+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564b600] 2023-10-03T19:21:08.326 INFO:teuthology.orchestra.run.smithi045.stdout: -7624> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.327 INFO:teuthology.orchestra.run.smithi045.stdout: -7623> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.327 INFO:teuthology.orchestra.run.smithi045.stdout: -7622> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.327 INFO:teuthology.orchestra.run.smithi045.stdout: -7621> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000556 [2,head] /dc-dir/dc-file_865 auth v5732 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.922309+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564b600] 2023-10-03T19:21:08.327 INFO:teuthology.orchestra.run.smithi045.stdout: -7620> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000556 [2,head] /dc-dir/dc-file_865 auth v5732 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.922309+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564b600] 2023-10-03T19:21:08.327 INFO:teuthology.orchestra.run.smithi045.stdout: -7619> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.327 INFO:teuthology.orchestra.run.smithi045.stdout: -7618> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 594.007, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.94e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1190.8] 2023-10-03T19:21:08.327 INFO:teuthology.orchestra.run.smithi045.stdout: -7617> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535298d80 on [dir 0x1 / [2,head] auth pv=6008 v=5740 cv=5384/5384 REP dir_auth=0 ap=134+136 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 134 2023-10-03T19:21:08.327 INFO:teuthology.orchestra.run.smithi045.stdout: -7616> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535298d80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5739 pv6007 ap=135 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=135) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=134) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 135 2023-10-03T19:21:08.327 INFO:teuthology.orchestra.run.smithi045.stdout: -7615> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5740 cv=5384/5384 REP dir_auth=0 ap=134+135 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535298d80 count now 134/135 2023-10-03T19:21:08.327 INFO:teuthology.orchestra.run.smithi045.stdout: -7614> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535298d80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5733 cv=5377/5377 ap=135+135 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=178 | child=1 dirty=1 authpin=1 0x565534f82400] count now 135 2023-10-03T19:21:08.327 INFO:teuthology.orchestra.run.smithi045.stdout: -7613> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000556) auth_unpin by 0x565535298d80 on [inode 0x10000000556 [2,head] /dc-dir/dc-file_865 auth v5732 s=3 n(v0 rc2023-10-03T19:17:08.922309+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553564b600] now 0 2023-10-03T19:21:08.328 INFO:teuthology.orchestra.run.smithi045.stdout: -7612> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5733 cv=5377/5377 ap=135+134 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=178 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535298d80 count now 135/134 2023-10-03T19:21:08.328 INFO:teuthology.orchestra.run.smithi045.stdout: -7611> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.328 INFO:teuthology.orchestra.run.smithi045.stdout: -7610> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.328 INFO:teuthology.orchestra.run.smithi045.stdout: -7609> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000557 [2,head] /dc-dir/dc-file_866 auth v4386 pv5734 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.935040+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.935040+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553564bb80] 2023-10-03T19:21:08.328 INFO:teuthology.orchestra.run.smithi045.stdout: -7608> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5741 2023-10-03T19:21:08.328 INFO:teuthology.orchestra.run.smithi045.stdout: -7607> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5741 pv6007 ap=135 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=135) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=134) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.328 INFO:teuthology.orchestra.run.smithi045.stdout: -7606> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5739 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.328 INFO:teuthology.orchestra.run.smithi045.stdout: -7605> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5740 cv=5384/5384 REP dir_auth=0 ap=134+135 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5740 2023-10-03T19:21:08.328 INFO:teuthology.orchestra.run.smithi045.stdout: -7604> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000557) pop_and_dirty_projected_inode v5734 2023-10-03T19:21:08.328 INFO:teuthology.orchestra.run.smithi045.stdout: -7603> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000557) mark_dirty [inode 0x10000000557 [2,head] /dc-dir/dc-file_866 auth v5734 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.935040+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553564bb80] 2023-10-03T19:21:08.328 INFO:teuthology.orchestra.run.smithi045.stdout: -7602> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_866) mark_dirty [dentry #0x1/dc-dir/dc-file_866 [2,head] auth (dversion lock) pv=5734 v=4386 ino=0x10000000557 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553564e780] 2023-10-03T19:21:08.329 INFO:teuthology.orchestra.run.smithi045.stdout: -7601> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5733 cv=5377/5377 ap=135+134 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=179 | child=1 dirty=1 authpin=1 0x565534f82400] version 5733 2023-10-03T19:21:08.329 INFO:teuthology.orchestra.run.smithi045.stdout: -7600> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536549580 v5742 2023-10-03T19:21:08.329 INFO:teuthology.orchestra.run.smithi045.stdout: -7599> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5742 cv=5384/5384 REP dir_auth=0 ap=134+135 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5742 2023-10-03T19:21:08.329 INFO:teuthology.orchestra.run.smithi045.stdout: -7598> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536549460 v5735 2023-10-03T19:21:08.329 INFO:teuthology.orchestra.run.smithi045.stdout: -7597> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5735 cv=5377/5377 ap=135+134 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=179 | child=1 dirty=1 authpin=1 0x565534f82400] version 5735 2023-10-03T19:21:08.329 INFO:teuthology.orchestra.run.smithi045.stdout: -7596> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=134 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=134 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.329 INFO:teuthology.orchestra.run.smithi045.stdout: -7595> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=134) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5741 pv6007 ap=135 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=135) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=134) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.329 INFO:teuthology.orchestra.run.smithi045.stdout: -7594> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=135) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5741 pv6007 ap=135 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=135) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=133) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.329 INFO:teuthology.orchestra.run.smithi045.stdout: -7593> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000557 [2,head] /dc-dir/dc-file_866 auth v5734 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.935040+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564bb80] 2023-10-03T19:21:08.329 INFO:teuthology.orchestra.run.smithi045.stdout: -7592> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000557 [2,head] /dc-dir/dc-file_866 auth v5734 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.935040+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564bb80] 2023-10-03T19:21:08.329 INFO:teuthology.orchestra.run.smithi045.stdout: -7591> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.329 INFO:teuthology.orchestra.run.smithi045.stdout: -7590> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.330 INFO:teuthology.orchestra.run.smithi045.stdout: -7589> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.330 INFO:teuthology.orchestra.run.smithi045.stdout: -7588> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000557 [2,head] /dc-dir/dc-file_866 auth v5734 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.935040+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564bb80] 2023-10-03T19:21:08.330 INFO:teuthology.orchestra.run.smithi045.stdout: -7587> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000557 [2,head] /dc-dir/dc-file_866 auth v5734 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.935040+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564bb80] 2023-10-03T19:21:08.330 INFO:teuthology.orchestra.run.smithi045.stdout: -7586> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.330 INFO:teuthology.orchestra.run.smithi045.stdout: -7585> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 595.007, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.95e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1192.8] 2023-10-03T19:21:08.330 INFO:teuthology.orchestra.run.smithi045.stdout: -7584> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x56553541bd40 on [dir 0x1 / [2,head] auth pv=6008 v=5742 cv=5384/5384 REP dir_auth=0 ap=133+135 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 133 2023-10-03T19:21:08.330 INFO:teuthology.orchestra.run.smithi045.stdout: -7583> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x56553541bd40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5741 pv6007 ap=134 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=134) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=133) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 134 2023-10-03T19:21:08.330 INFO:teuthology.orchestra.run.smithi045.stdout: -7582> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5742 cv=5384/5384 REP dir_auth=0 ap=133+134 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x56553541bd40 count now 133/134 2023-10-03T19:21:08.330 INFO:teuthology.orchestra.run.smithi045.stdout: -7581> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x56553541bd40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5735 cv=5377/5377 ap=134+134 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=179 | child=1 dirty=1 authpin=1 0x565534f82400] count now 134 2023-10-03T19:21:08.330 INFO:teuthology.orchestra.run.smithi045.stdout: -7580> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000557) auth_unpin by 0x56553541bd40 on [inode 0x10000000557 [2,head] /dc-dir/dc-file_866 auth v5734 s=3 n(v0 rc2023-10-03T19:17:08.935040+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553564bb80] now 0 2023-10-03T19:21:08.331 INFO:teuthology.orchestra.run.smithi045.stdout: -7579> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5735 cv=5377/5377 ap=134+133 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=179 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x56553541bd40 count now 134/133 2023-10-03T19:21:08.331 INFO:teuthology.orchestra.run.smithi045.stdout: -7578> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.331 INFO:teuthology.orchestra.run.smithi045.stdout: -7577> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.331 INFO:teuthology.orchestra.run.smithi045.stdout: -7576> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000558 [2,head] /dc-dir/dc-file_867 auth v4390 pv5736 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.946919+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.946919+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553564c100] 2023-10-03T19:21:08.331 INFO:teuthology.orchestra.run.smithi045.stdout: -7575> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5743 2023-10-03T19:21:08.331 INFO:teuthology.orchestra.run.smithi045.stdout: -7574> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5743 pv6007 ap=134 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=134) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=133) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.331 INFO:teuthology.orchestra.run.smithi045.stdout: -7573> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5741 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.331 INFO:teuthology.orchestra.run.smithi045.stdout: -7572> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5742 cv=5384/5384 REP dir_auth=0 ap=133+134 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5742 2023-10-03T19:21:08.331 INFO:teuthology.orchestra.run.smithi045.stdout: -7571> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000558) pop_and_dirty_projected_inode v5736 2023-10-03T19:21:08.331 INFO:teuthology.orchestra.run.smithi045.stdout: -7570> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000558) mark_dirty [inode 0x10000000558 [2,head] /dc-dir/dc-file_867 auth v5736 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.946919+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553564c100] 2023-10-03T19:21:08.331 INFO:teuthology.orchestra.run.smithi045.stdout: -7569> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_867) mark_dirty [dentry #0x1/dc-dir/dc-file_867 [2,head] auth (dversion lock) pv=5736 v=4390 ino=0x10000000558 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553564ea00] 2023-10-03T19:21:08.331 INFO:teuthology.orchestra.run.smithi045.stdout: -7568> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5735 cv=5377/5377 ap=134+133 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=180 | child=1 dirty=1 authpin=1 0x565534f82400] version 5735 2023-10-03T19:21:08.332 INFO:teuthology.orchestra.run.smithi045.stdout: -7567> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x5655365497c0 v5744 2023-10-03T19:21:08.332 INFO:teuthology.orchestra.run.smithi045.stdout: -7566> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5744 cv=5384/5384 REP dir_auth=0 ap=133+134 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5744 2023-10-03T19:21:08.332 INFO:teuthology.orchestra.run.smithi045.stdout: -7565> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655365496a0 v5737 2023-10-03T19:21:08.332 INFO:teuthology.orchestra.run.smithi045.stdout: -7564> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5737 cv=5377/5377 ap=134+133 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=180 | child=1 dirty=1 authpin=1 0x565534f82400] version 5737 2023-10-03T19:21:08.332 INFO:teuthology.orchestra.run.smithi045.stdout: -7563> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=133 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=133 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.332 INFO:teuthology.orchestra.run.smithi045.stdout: -7562> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=133) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5743 pv6007 ap=134 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=134) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=133) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.332 INFO:teuthology.orchestra.run.smithi045.stdout: -7561> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=134) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5743 pv6007 ap=134 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=134) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=132) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.332 INFO:teuthology.orchestra.run.smithi045.stdout: -7560> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000558 [2,head] /dc-dir/dc-file_867 auth v5736 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.946919+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564c100] 2023-10-03T19:21:08.332 INFO:teuthology.orchestra.run.smithi045.stdout: -7559> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000558 [2,head] /dc-dir/dc-file_867 auth v5736 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.946919+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564c100] 2023-10-03T19:21:08.332 INFO:teuthology.orchestra.run.smithi045.stdout: -7558> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.332 INFO:teuthology.orchestra.run.smithi045.stdout: -7557> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.333 INFO:teuthology.orchestra.run.smithi045.stdout: -7556> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.333 INFO:teuthology.orchestra.run.smithi045.stdout: -7555> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000558 [2,head] /dc-dir/dc-file_867 auth v5736 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.946919+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564c100] 2023-10-03T19:21:08.333 INFO:teuthology.orchestra.run.smithi045.stdout: -7554> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000558 [2,head] /dc-dir/dc-file_867 auth v5736 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.946919+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564c100] 2023-10-03T19:21:08.333 INFO:teuthology.orchestra.run.smithi045.stdout: -7553> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.333 INFO:teuthology.orchestra.run.smithi045.stdout: -7552> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 596.007, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.96e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1194.8] 2023-10-03T19:21:08.333 INFO:teuthology.orchestra.run.smithi045.stdout: -7551> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x56553549a900 on [dir 0x1 / [2,head] auth pv=6008 v=5744 cv=5384/5384 REP dir_auth=0 ap=132+134 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 132 2023-10-03T19:21:08.333 INFO:teuthology.orchestra.run.smithi045.stdout: -7550> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x56553549a900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5743 pv6007 ap=133 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=133) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=132) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 133 2023-10-03T19:21:08.333 INFO:teuthology.orchestra.run.smithi045.stdout: -7549> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5744 cv=5384/5384 REP dir_auth=0 ap=132+133 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x56553549a900 count now 132/133 2023-10-03T19:21:08.333 INFO:teuthology.orchestra.run.smithi045.stdout: -7548> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x56553549a900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5737 cv=5377/5377 ap=133+133 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=180 | child=1 dirty=1 authpin=1 0x565534f82400] count now 133 2023-10-03T19:21:08.333 INFO:teuthology.orchestra.run.smithi045.stdout: -7547> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000558) auth_unpin by 0x56553549a900 on [inode 0x10000000558 [2,head] /dc-dir/dc-file_867 auth v5736 s=3 n(v0 rc2023-10-03T19:17:08.946919+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553564c100] now 0 2023-10-03T19:21:08.333 INFO:teuthology.orchestra.run.smithi045.stdout: -7546> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5737 cv=5377/5377 ap=133+132 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=180 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x56553549a900 count now 133/132 2023-10-03T19:21:08.333 INFO:teuthology.orchestra.run.smithi045.stdout: -7545> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.334 INFO:teuthology.orchestra.run.smithi045.stdout: -7544> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.334 INFO:teuthology.orchestra.run.smithi045.stdout: -7543> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000559 [2,head] /dc-dir/dc-file_868 auth v4394 pv5738 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.959408+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.959408+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553564c680] 2023-10-03T19:21:08.334 INFO:teuthology.orchestra.run.smithi045.stdout: -7542> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5745 2023-10-03T19:21:08.334 INFO:teuthology.orchestra.run.smithi045.stdout: -7541> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5745 pv6007 ap=133 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=133) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=132) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.334 INFO:teuthology.orchestra.run.smithi045.stdout: -7540> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5743 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.334 INFO:teuthology.orchestra.run.smithi045.stdout: -7539> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5744 cv=5384/5384 REP dir_auth=0 ap=132+133 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5744 2023-10-03T19:21:08.334 INFO:teuthology.orchestra.run.smithi045.stdout: -7538> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000559) pop_and_dirty_projected_inode v5738 2023-10-03T19:21:08.334 INFO:teuthology.orchestra.run.smithi045.stdout: -7537> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000559) mark_dirty [inode 0x10000000559 [2,head] /dc-dir/dc-file_868 auth v5738 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.959408+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553564c680] 2023-10-03T19:21:08.334 INFO:teuthology.orchestra.run.smithi045.stdout: -7536> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_868) mark_dirty [dentry #0x1/dc-dir/dc-file_868 [2,head] auth (dversion lock) pv=5738 v=4394 ino=0x10000000559 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553564ec80] 2023-10-03T19:21:08.334 INFO:teuthology.orchestra.run.smithi045.stdout: -7535> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5737 cv=5377/5377 ap=133+132 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=181 | child=1 dirty=1 authpin=1 0x565534f82400] version 5737 2023-10-03T19:21:08.335 INFO:teuthology.orchestra.run.smithi045.stdout: -7534> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536549a00 v5746 2023-10-03T19:21:08.335 INFO:teuthology.orchestra.run.smithi045.stdout: -7533> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5746 cv=5384/5384 REP dir_auth=0 ap=132+133 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5746 2023-10-03T19:21:08.335 INFO:teuthology.orchestra.run.smithi045.stdout: -7532> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655365498e0 v5739 2023-10-03T19:21:08.335 INFO:teuthology.orchestra.run.smithi045.stdout: -7531> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5739 cv=5377/5377 ap=133+132 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=181 | child=1 dirty=1 authpin=1 0x565534f82400] version 5739 2023-10-03T19:21:08.335 INFO:teuthology.orchestra.run.smithi045.stdout: -7530> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=132 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=132 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.335 INFO:teuthology.orchestra.run.smithi045.stdout: -7529> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=132) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5745 pv6007 ap=133 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=133) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=132) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.335 INFO:teuthology.orchestra.run.smithi045.stdout: -7528> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=133) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5745 pv6007 ap=133 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=133) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=131) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.335 INFO:teuthology.orchestra.run.smithi045.stdout: -7527> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000559 [2,head] /dc-dir/dc-file_868 auth v5738 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.959408+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564c680] 2023-10-03T19:21:08.335 INFO:teuthology.orchestra.run.smithi045.stdout: -7526> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000559 [2,head] /dc-dir/dc-file_868 auth v5738 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.959408+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564c680] 2023-10-03T19:21:08.335 INFO:teuthology.orchestra.run.smithi045.stdout: -7525> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.335 INFO:teuthology.orchestra.run.smithi045.stdout: -7524> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.336 INFO:teuthology.orchestra.run.smithi045.stdout: -7523> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.336 INFO:teuthology.orchestra.run.smithi045.stdout: -7522> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000559 [2,head] /dc-dir/dc-file_868 auth v5738 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.959408+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564c680] 2023-10-03T19:21:08.336 INFO:teuthology.orchestra.run.smithi045.stdout: -7521> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000559 [2,head] /dc-dir/dc-file_868 auth v5738 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.959408+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564c680] 2023-10-03T19:21:08.336 INFO:teuthology.orchestra.run.smithi045.stdout: -7520> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.336 INFO:teuthology.orchestra.run.smithi045.stdout: -7519> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 597.007, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.97e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1196.8] 2023-10-03T19:21:08.336 INFO:teuthology.orchestra.run.smithi045.stdout: -7518> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535439680 on [dir 0x1 / [2,head] auth pv=6008 v=5746 cv=5384/5384 REP dir_auth=0 ap=131+133 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 131 2023-10-03T19:21:08.336 INFO:teuthology.orchestra.run.smithi045.stdout: -7517> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535439680 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5745 pv6007 ap=132 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=132) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=131) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 132 2023-10-03T19:21:08.336 INFO:teuthology.orchestra.run.smithi045.stdout: -7516> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5746 cv=5384/5384 REP dir_auth=0 ap=131+132 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535439680 count now 131/132 2023-10-03T19:21:08.336 INFO:teuthology.orchestra.run.smithi045.stdout: -7515> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535439680 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5739 cv=5377/5377 ap=132+132 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=181 | child=1 dirty=1 authpin=1 0x565534f82400] count now 132 2023-10-03T19:21:08.336 INFO:teuthology.orchestra.run.smithi045.stdout: -7514> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000559) auth_unpin by 0x565535439680 on [inode 0x10000000559 [2,head] /dc-dir/dc-file_868 auth v5738 s=3 n(v0 rc2023-10-03T19:17:08.959408+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553564c680] now 0 2023-10-03T19:21:08.336 INFO:teuthology.orchestra.run.smithi045.stdout: -7513> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5739 cv=5377/5377 ap=132+131 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=181 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535439680 count now 132/131 2023-10-03T19:21:08.336 INFO:teuthology.orchestra.run.smithi045.stdout: -7512> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.337 INFO:teuthology.orchestra.run.smithi045.stdout: -7511> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.337 INFO:teuthology.orchestra.run.smithi045.stdout: -7510> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000055a [2,head] /dc-dir/dc-file_869 auth v4398 pv5740 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.970555+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.970555+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553564cc00] 2023-10-03T19:21:08.337 INFO:teuthology.orchestra.run.smithi045.stdout: -7509> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5747 2023-10-03T19:21:08.337 INFO:teuthology.orchestra.run.smithi045.stdout: -7508> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5747 pv6007 ap=132 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=132) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=131) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.337 INFO:teuthology.orchestra.run.smithi045.stdout: -7507> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5745 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.337 INFO:teuthology.orchestra.run.smithi045.stdout: -7506> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5746 cv=5384/5384 REP dir_auth=0 ap=131+132 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5746 2023-10-03T19:21:08.337 INFO:teuthology.orchestra.run.smithi045.stdout: -7505> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000055a) pop_and_dirty_projected_inode v5740 2023-10-03T19:21:08.337 INFO:teuthology.orchestra.run.smithi045.stdout: -7504> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000055a) mark_dirty [inode 0x1000000055a [2,head] /dc-dir/dc-file_869 auth v5740 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.970555+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553564cc00] 2023-10-03T19:21:08.337 INFO:teuthology.orchestra.run.smithi045.stdout: -7503> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_869) mark_dirty [dentry #0x1/dc-dir/dc-file_869 [2,head] auth (dversion lock) pv=5740 v=4398 ino=0x1000000055a state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553564ef00] 2023-10-03T19:21:08.337 INFO:teuthology.orchestra.run.smithi045.stdout: -7502> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5739 cv=5377/5377 ap=132+131 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=182 | child=1 dirty=1 authpin=1 0x565534f82400] version 5739 2023-10-03T19:21:08.337 INFO:teuthology.orchestra.run.smithi045.stdout: -7501> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536549c40 v5748 2023-10-03T19:21:08.337 INFO:teuthology.orchestra.run.smithi045.stdout: -7500> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5748 cv=5384/5384 REP dir_auth=0 ap=131+132 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5748 2023-10-03T19:21:08.338 INFO:teuthology.orchestra.run.smithi045.stdout: -7499> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536549b20 v5741 2023-10-03T19:21:08.338 INFO:teuthology.orchestra.run.smithi045.stdout: -7498> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5741 cv=5377/5377 ap=132+131 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=182 | child=1 dirty=1 authpin=1 0x565534f82400] version 5741 2023-10-03T19:21:08.338 INFO:teuthology.orchestra.run.smithi045.stdout: -7497> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=131 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=131 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.338 INFO:teuthology.orchestra.run.smithi045.stdout: -7496> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=131) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5747 pv6007 ap=132 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=132) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=131) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.338 INFO:teuthology.orchestra.run.smithi045.stdout: -7495> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=132) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5747 pv6007 ap=132 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=132) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=130) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.338 INFO:teuthology.orchestra.run.smithi045.stdout: -7494> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000055a [2,head] /dc-dir/dc-file_869 auth v5740 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.970555+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564cc00] 2023-10-03T19:21:08.338 INFO:teuthology.orchestra.run.smithi045.stdout: -7493> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000055a [2,head] /dc-dir/dc-file_869 auth v5740 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.970555+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564cc00] 2023-10-03T19:21:08.338 INFO:teuthology.orchestra.run.smithi045.stdout: -7492> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.338 INFO:teuthology.orchestra.run.smithi045.stdout: -7491> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.338 INFO:teuthology.orchestra.run.smithi045.stdout: -7490> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.339 INFO:teuthology.orchestra.run.smithi045.stdout: -7489> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000055a [2,head] /dc-dir/dc-file_869 auth v5740 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.970555+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564cc00] 2023-10-03T19:21:08.339 INFO:teuthology.orchestra.run.smithi045.stdout: -7488> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000055a [2,head] /dc-dir/dc-file_869 auth v5740 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.970555+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564cc00] 2023-10-03T19:21:08.339 INFO:teuthology.orchestra.run.smithi045.stdout: -7487> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.339 INFO:teuthology.orchestra.run.smithi045.stdout: -7486> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 598.007, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.98e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1198.8] 2023-10-03T19:21:08.339 INFO:teuthology.orchestra.run.smithi045.stdout: -7485> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565534fd6fc0 on [dir 0x1 / [2,head] auth pv=6008 v=5748 cv=5384/5384 REP dir_auth=0 ap=130+132 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 130 2023-10-03T19:21:08.339 INFO:teuthology.orchestra.run.smithi045.stdout: -7484> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565534fd6fc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5747 pv6007 ap=131 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=131) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=130) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 131 2023-10-03T19:21:08.339 INFO:teuthology.orchestra.run.smithi045.stdout: -7483> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5748 cv=5384/5384 REP dir_auth=0 ap=130+131 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565534fd6fc0 count now 130/131 2023-10-03T19:21:08.339 INFO:teuthology.orchestra.run.smithi045.stdout: -7482> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565534fd6fc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5741 cv=5377/5377 ap=131+131 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=182 | child=1 dirty=1 authpin=1 0x565534f82400] count now 131 2023-10-03T19:21:08.339 INFO:teuthology.orchestra.run.smithi045.stdout: -7481> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000055a) auth_unpin by 0x565534fd6fc0 on [inode 0x1000000055a [2,head] /dc-dir/dc-file_869 auth v5740 s=3 n(v0 rc2023-10-03T19:17:08.970555+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553564cc00] now 0 2023-10-03T19:21:08.339 INFO:teuthology.orchestra.run.smithi045.stdout: -7480> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5741 cv=5377/5377 ap=131+130 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=182 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565534fd6fc0 count now 131/130 2023-10-03T19:21:08.339 INFO:teuthology.orchestra.run.smithi045.stdout: -7479> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.340 INFO:teuthology.orchestra.run.smithi045.stdout: -7478> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.340 INFO:teuthology.orchestra.run.smithi045.stdout: -7477> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000055b [2,head] /dc-dir/dc-file_870 auth v4402 pv5742 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.981914+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.981914+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553564d180] 2023-10-03T19:21:08.340 INFO:teuthology.orchestra.run.smithi045.stdout: -7476> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5749 2023-10-03T19:21:08.340 INFO:teuthology.orchestra.run.smithi045.stdout: -7475> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5749 pv6007 ap=131 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=131) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=130) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.340 INFO:teuthology.orchestra.run.smithi045.stdout: -7474> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5747 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.340 INFO:teuthology.orchestra.run.smithi045.stdout: -7473> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5748 cv=5384/5384 REP dir_auth=0 ap=130+131 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5748 2023-10-03T19:21:08.340 INFO:teuthology.orchestra.run.smithi045.stdout: -7472> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000055b) pop_and_dirty_projected_inode v5742 2023-10-03T19:21:08.340 INFO:teuthology.orchestra.run.smithi045.stdout: -7471> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000055b) mark_dirty [inode 0x1000000055b [2,head] /dc-dir/dc-file_870 auth v5742 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.981914+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553564d180] 2023-10-03T19:21:08.340 INFO:teuthology.orchestra.run.smithi045.stdout: -7470> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_870) mark_dirty [dentry #0x1/dc-dir/dc-file_870 [2,head] auth (dversion lock) pv=5742 v=4402 ino=0x1000000055b state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553564f180] 2023-10-03T19:21:08.341 INFO:teuthology.orchestra.run.smithi045.stdout: -7469> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5741 cv=5377/5377 ap=131+130 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=183 | child=1 dirty=1 authpin=1 0x565534f82400] version 5741 2023-10-03T19:21:08.341 INFO:teuthology.orchestra.run.smithi045.stdout: -7468> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536549e80 v5750 2023-10-03T19:21:08.341 INFO:teuthology.orchestra.run.smithi045.stdout: -7467> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5750 cv=5384/5384 REP dir_auth=0 ap=130+131 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5750 2023-10-03T19:21:08.341 INFO:teuthology.orchestra.run.smithi045.stdout: -7466> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536549d60 v5743 2023-10-03T19:21:08.341 INFO:teuthology.orchestra.run.smithi045.stdout: -7465> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5743 cv=5377/5377 ap=131+130 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=183 | child=1 dirty=1 authpin=1 0x565534f82400] version 5743 2023-10-03T19:21:08.341 INFO:teuthology.orchestra.run.smithi045.stdout: -7464> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=130 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=130 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.341 INFO:teuthology.orchestra.run.smithi045.stdout: -7463> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=130) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5749 pv6007 ap=131 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=131) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=130) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.341 INFO:teuthology.orchestra.run.smithi045.stdout: -7462> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=131) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5749 pv6007 ap=131 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=131) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=129) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.341 INFO:teuthology.orchestra.run.smithi045.stdout: -7461> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000055b [2,head] /dc-dir/dc-file_870 auth v5742 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.981914+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564d180] 2023-10-03T19:21:08.341 INFO:teuthology.orchestra.run.smithi045.stdout: -7460> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000055b [2,head] /dc-dir/dc-file_870 auth v5742 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.981914+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564d180] 2023-10-03T19:21:08.341 INFO:teuthology.orchestra.run.smithi045.stdout: -7459> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.342 INFO:teuthology.orchestra.run.smithi045.stdout: -7458> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.342 INFO:teuthology.orchestra.run.smithi045.stdout: -7457> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.342 INFO:teuthology.orchestra.run.smithi045.stdout: -7456> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000055b [2,head] /dc-dir/dc-file_870 auth v5742 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.981914+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564d180] 2023-10-03T19:21:08.342 INFO:teuthology.orchestra.run.smithi045.stdout: -7455> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000055b [2,head] /dc-dir/dc-file_870 auth v5742 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.981914+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564d180] 2023-10-03T19:21:08.342 INFO:teuthology.orchestra.run.smithi045.stdout: -7454> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.342 INFO:teuthology.orchestra.run.smithi045.stdout: -7453> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 599.007, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 5.99e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1200.8] 2023-10-03T19:21:08.342 INFO:teuthology.orchestra.run.smithi045.stdout: -7452> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565534d4afc0 on [dir 0x1 / [2,head] auth pv=6008 v=5750 cv=5384/5384 REP dir_auth=0 ap=129+131 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 129 2023-10-03T19:21:08.342 INFO:teuthology.orchestra.run.smithi045.stdout: -7451> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565534d4afc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5749 pv6007 ap=130 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=130) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=129) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 130 2023-10-03T19:21:08.342 INFO:teuthology.orchestra.run.smithi045.stdout: -7450> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5750 cv=5384/5384 REP dir_auth=0 ap=129+130 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565534d4afc0 count now 129/130 2023-10-03T19:21:08.342 INFO:teuthology.orchestra.run.smithi045.stdout: -7449> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565534d4afc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5743 cv=5377/5377 ap=130+130 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=183 | child=1 dirty=1 authpin=1 0x565534f82400] count now 130 2023-10-03T19:21:08.343 INFO:teuthology.orchestra.run.smithi045.stdout: -7448> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000055b) auth_unpin by 0x565534d4afc0 on [inode 0x1000000055b [2,head] /dc-dir/dc-file_870 auth v5742 s=3 n(v0 rc2023-10-03T19:17:08.981914+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553564d180] now 0 2023-10-03T19:21:08.343 INFO:teuthology.orchestra.run.smithi045.stdout: -7447> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5743 cv=5377/5377 ap=130+129 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=183 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565534d4afc0 count now 130/129 2023-10-03T19:21:08.343 INFO:teuthology.orchestra.run.smithi045.stdout: -7446> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.343 INFO:teuthology.orchestra.run.smithi045.stdout: -7445> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.343 INFO:teuthology.orchestra.run.smithi045.stdout: -7444> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000055c [2,head] /dc-dir/dc-file_871 auth v4406 pv5744 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.994043+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:08.994043+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553564d700] 2023-10-03T19:21:08.343 INFO:teuthology.orchestra.run.smithi045.stdout: -7443> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5751 2023-10-03T19:21:08.343 INFO:teuthology.orchestra.run.smithi045.stdout: -7442> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5751 pv6007 ap=130 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=130) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=129) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.343 INFO:teuthology.orchestra.run.smithi045.stdout: -7441> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5749 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.343 INFO:teuthology.orchestra.run.smithi045.stdout: -7440> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5750 cv=5384/5384 REP dir_auth=0 ap=129+130 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5750 2023-10-03T19:21:08.343 INFO:teuthology.orchestra.run.smithi045.stdout: -7439> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000055c) pop_and_dirty_projected_inode v5744 2023-10-03T19:21:08.344 INFO:teuthology.orchestra.run.smithi045.stdout: -7438> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000055c) mark_dirty [inode 0x1000000055c [2,head] /dc-dir/dc-file_871 auth v5744 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.994043+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553564d700] 2023-10-03T19:21:08.344 INFO:teuthology.orchestra.run.smithi045.stdout: -7437> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_871) mark_dirty [dentry #0x1/dc-dir/dc-file_871 [2,head] auth (dversion lock) pv=5744 v=4406 ino=0x1000000055c state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553564f400] 2023-10-03T19:21:08.344 INFO:teuthology.orchestra.run.smithi045.stdout: -7436> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5743 cv=5377/5377 ap=130+129 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=184 | child=1 dirty=1 authpin=1 0x565534f82400] version 5743 2023-10-03T19:21:08.344 INFO:teuthology.orchestra.run.smithi045.stdout: -7435> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535dc4140 v5752 2023-10-03T19:21:08.344 INFO:teuthology.orchestra.run.smithi045.stdout: -7434> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5752 cv=5384/5384 REP dir_auth=0 ap=129+130 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5752 2023-10-03T19:21:08.344 INFO:teuthology.orchestra.run.smithi045.stdout: -7433> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535dc4020 v5745 2023-10-03T19:21:08.344 INFO:teuthology.orchestra.run.smithi045.stdout: -7432> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5745 cv=5377/5377 ap=130+129 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=184 | child=1 dirty=1 authpin=1 0x565534f82400] version 5745 2023-10-03T19:21:08.344 INFO:teuthology.orchestra.run.smithi045.stdout: -7431> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=129 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=129 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.344 INFO:teuthology.orchestra.run.smithi045.stdout: -7430> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=129) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5751 pv6007 ap=130 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=130) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=129) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.344 INFO:teuthology.orchestra.run.smithi045.stdout: -7429> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=130) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5751 pv6007 ap=130 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=130) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=128) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.344 INFO:teuthology.orchestra.run.smithi045.stdout: -7428> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000055c [2,head] /dc-dir/dc-file_871 auth v5744 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.994043+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564d700] 2023-10-03T19:21:08.345 INFO:teuthology.orchestra.run.smithi045.stdout: -7427> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000055c [2,head] /dc-dir/dc-file_871 auth v5744 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.994043+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564d700] 2023-10-03T19:21:08.345 INFO:teuthology.orchestra.run.smithi045.stdout: -7426> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.345 INFO:teuthology.orchestra.run.smithi045.stdout: -7425> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.345 INFO:teuthology.orchestra.run.smithi045.stdout: -7424> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.345 INFO:teuthology.orchestra.run.smithi045.stdout: -7423> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000055c [2,head] /dc-dir/dc-file_871 auth v5744 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.994043+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564d700] 2023-10-03T19:21:08.345 INFO:teuthology.orchestra.run.smithi045.stdout: -7422> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000055c [2,head] /dc-dir/dc-file_871 auth v5744 ap=1 s=3 n(v0 rc2023-10-03T19:17:08.994043+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553564d700] 2023-10-03T19:21:08.345 INFO:teuthology.orchestra.run.smithi045.stdout: -7421> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.345 INFO:teuthology.orchestra.run.smithi045.stdout: -7420> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 600.007, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.00e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1202.8] 2023-10-03T19:21:08.345 INFO:teuthology.orchestra.run.smithi045.stdout: -7419> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655363878c0 on [dir 0x1 / [2,head] auth pv=6008 v=5752 cv=5384/5384 REP dir_auth=0 ap=128+130 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 128 2023-10-03T19:21:08.345 INFO:teuthology.orchestra.run.smithi045.stdout: -7418> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655363878c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5751 pv6007 ap=129 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=129) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=128) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 129 2023-10-03T19:21:08.346 INFO:teuthology.orchestra.run.smithi045.stdout: -7417> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5752 cv=5384/5384 REP dir_auth=0 ap=128+129 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655363878c0 count now 128/129 2023-10-03T19:21:08.346 INFO:teuthology.orchestra.run.smithi045.stdout: -7416> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655363878c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5745 cv=5377/5377 ap=129+129 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=184 | child=1 dirty=1 authpin=1 0x565534f82400] count now 129 2023-10-03T19:21:08.346 INFO:teuthology.orchestra.run.smithi045.stdout: -7415> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000055c) auth_unpin by 0x5655363878c0 on [inode 0x1000000055c [2,head] /dc-dir/dc-file_871 auth v5744 s=3 n(v0 rc2023-10-03T19:17:08.994043+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553564d700] now 0 2023-10-03T19:21:08.346 INFO:teuthology.orchestra.run.smithi045.stdout: -7414> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5745 cv=5377/5377 ap=129+128 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=184 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655363878c0 count now 129/128 2023-10-03T19:21:08.346 INFO:teuthology.orchestra.run.smithi045.stdout: -7413> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.346 INFO:teuthology.orchestra.run.smithi045.stdout: -7412> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.346 INFO:teuthology.orchestra.run.smithi045.stdout: -7411> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000055d [2,head] /dc-dir/dc-file_872 auth v4410 pv5746 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.005615+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.005615+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535654000] 2023-10-03T19:21:08.346 INFO:teuthology.orchestra.run.smithi045.stdout: -7410> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5753 2023-10-03T19:21:08.346 INFO:teuthology.orchestra.run.smithi045.stdout: -7409> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5753 pv6007 ap=129 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=129) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=128) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.347 INFO:teuthology.orchestra.run.smithi045.stdout: -7408> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5751 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.347 INFO:teuthology.orchestra.run.smithi045.stdout: -7407> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5752 cv=5384/5384 REP dir_auth=0 ap=128+129 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5752 2023-10-03T19:21:08.347 INFO:teuthology.orchestra.run.smithi045.stdout: -7406> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000055d) pop_and_dirty_projected_inode v5746 2023-10-03T19:21:08.347 INFO:teuthology.orchestra.run.smithi045.stdout: -7405> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000055d) mark_dirty [inode 0x1000000055d [2,head] /dc-dir/dc-file_872 auth v5746 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.005615+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535654000] 2023-10-03T19:21:08.347 INFO:teuthology.orchestra.run.smithi045.stdout: -7404> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_872) mark_dirty [dentry #0x1/dc-dir/dc-file_872 [2,head] auth (dversion lock) pv=5746 v=4410 ino=0x1000000055d state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553564f680] 2023-10-03T19:21:08.347 INFO:teuthology.orchestra.run.smithi045.stdout: -7403> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5745 cv=5377/5377 ap=129+128 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=185 | child=1 dirty=1 authpin=1 0x565534f82400] version 5745 2023-10-03T19:21:08.347 INFO:teuthology.orchestra.run.smithi045.stdout: -7402> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535dc4380 v5754 2023-10-03T19:21:08.347 INFO:teuthology.orchestra.run.smithi045.stdout: -7401> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5754 cv=5384/5384 REP dir_auth=0 ap=128+129 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5754 2023-10-03T19:21:08.347 INFO:teuthology.orchestra.run.smithi045.stdout: -7400> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535dc4260 v5747 2023-10-03T19:21:08.347 INFO:teuthology.orchestra.run.smithi045.stdout: -7399> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5747 cv=5377/5377 ap=129+128 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=185 | child=1 dirty=1 authpin=1 0x565534f82400] version 5747 2023-10-03T19:21:08.348 INFO:teuthology.orchestra.run.smithi045.stdout: -7398> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=128 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=128 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.348 INFO:teuthology.orchestra.run.smithi045.stdout: -7397> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=128) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5753 pv6007 ap=129 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=129) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=128) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.348 INFO:teuthology.orchestra.run.smithi045.stdout: -7396> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=129) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5753 pv6007 ap=129 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=129) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=127) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.348 INFO:teuthology.orchestra.run.smithi045.stdout: -7395> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000055d [2,head] /dc-dir/dc-file_872 auth v5746 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.005615+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535654000] 2023-10-03T19:21:08.348 INFO:teuthology.orchestra.run.smithi045.stdout: -7394> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000055d [2,head] /dc-dir/dc-file_872 auth v5746 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.005615+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535654000] 2023-10-03T19:21:08.348 INFO:teuthology.orchestra.run.smithi045.stdout: -7393> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.348 INFO:teuthology.orchestra.run.smithi045.stdout: -7392> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.348 INFO:teuthology.orchestra.run.smithi045.stdout: -7391> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.348 INFO:teuthology.orchestra.run.smithi045.stdout: -7390> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000055d [2,head] /dc-dir/dc-file_872 auth v5746 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.005615+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535654000] 2023-10-03T19:21:08.348 INFO:teuthology.orchestra.run.smithi045.stdout: -7389> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000055d [2,head] /dc-dir/dc-file_872 auth v5746 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.005615+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535654000] 2023-10-03T19:21:08.348 INFO:teuthology.orchestra.run.smithi045.stdout: -7388> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.348 INFO:teuthology.orchestra.run.smithi045.stdout: -7387> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 601.007, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.01e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1204.8] 2023-10-03T19:21:08.349 INFO:teuthology.orchestra.run.smithi045.stdout: -7386> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536386fc0 on [dir 0x1 / [2,head] auth pv=6008 v=5754 cv=5384/5384 REP dir_auth=0 ap=127+129 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 127 2023-10-03T19:21:08.349 INFO:teuthology.orchestra.run.smithi045.stdout: -7385> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536386fc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5753 pv6007 ap=128 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=128) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=127) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 128 2023-10-03T19:21:08.349 INFO:teuthology.orchestra.run.smithi045.stdout: -7384> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5754 cv=5384/5384 REP dir_auth=0 ap=127+128 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536386fc0 count now 127/128 2023-10-03T19:21:08.349 INFO:teuthology.orchestra.run.smithi045.stdout: -7383> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536386fc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5747 cv=5377/5377 ap=128+128 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=185 | child=1 dirty=1 authpin=1 0x565534f82400] count now 128 2023-10-03T19:21:08.349 INFO:teuthology.orchestra.run.smithi045.stdout: -7382> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000055d) auth_unpin by 0x565536386fc0 on [inode 0x1000000055d [2,head] /dc-dir/dc-file_872 auth v5746 s=3 n(v0 rc2023-10-03T19:17:09.005615+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535654000] now 0 2023-10-03T19:21:08.349 INFO:teuthology.orchestra.run.smithi045.stdout: -7381> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5747 cv=5377/5377 ap=128+127 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=185 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536386fc0 count now 128/127 2023-10-03T19:21:08.349 INFO:teuthology.orchestra.run.smithi045.stdout: -7380> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.349 INFO:teuthology.orchestra.run.smithi045.stdout: -7379> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.349 INFO:teuthology.orchestra.run.smithi045.stdout: -7378> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000055e [2,head] /dc-dir/dc-file_873 auth v4414 pv5748 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.019465+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.019465+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535654580] 2023-10-03T19:21:08.349 INFO:teuthology.orchestra.run.smithi045.stdout: -7377> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5755 2023-10-03T19:21:08.349 INFO:teuthology.orchestra.run.smithi045.stdout: -7376> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5755 pv6007 ap=128 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=128) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=127) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.350 INFO:teuthology.orchestra.run.smithi045.stdout: -7375> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5753 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.350 INFO:teuthology.orchestra.run.smithi045.stdout: -7374> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5754 cv=5384/5384 REP dir_auth=0 ap=127+128 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5754 2023-10-03T19:21:08.350 INFO:teuthology.orchestra.run.smithi045.stdout: -7373> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000055e) pop_and_dirty_projected_inode v5748 2023-10-03T19:21:08.350 INFO:teuthology.orchestra.run.smithi045.stdout: -7372> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000055e) mark_dirty [inode 0x1000000055e [2,head] /dc-dir/dc-file_873 auth v5748 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.019465+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535654580] 2023-10-03T19:21:08.350 INFO:teuthology.orchestra.run.smithi045.stdout: -7371> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_873) mark_dirty [dentry #0x1/dc-dir/dc-file_873 [2,head] auth (dversion lock) pv=5748 v=4414 ino=0x1000000055e state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553564f900] 2023-10-03T19:21:08.350 INFO:teuthology.orchestra.run.smithi045.stdout: -7370> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5747 cv=5377/5377 ap=128+127 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=186 | child=1 dirty=1 authpin=1 0x565534f82400] version 5747 2023-10-03T19:21:08.350 INFO:teuthology.orchestra.run.smithi045.stdout: -7369> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535dc45c0 v5756 2023-10-03T19:21:08.350 INFO:teuthology.orchestra.run.smithi045.stdout: -7368> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5756 cv=5384/5384 REP dir_auth=0 ap=127+128 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5756 2023-10-03T19:21:08.350 INFO:teuthology.orchestra.run.smithi045.stdout: -7367> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535dc44a0 v5749 2023-10-03T19:21:08.350 INFO:teuthology.orchestra.run.smithi045.stdout: -7366> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5749 cv=5377/5377 ap=128+127 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=186 | child=1 dirty=1 authpin=1 0x565534f82400] version 5749 2023-10-03T19:21:08.350 INFO:teuthology.orchestra.run.smithi045.stdout: -7365> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=127 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=127 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.351 INFO:teuthology.orchestra.run.smithi045.stdout: -7364> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=127) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5755 pv6007 ap=128 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=128) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=127) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.351 INFO:teuthology.orchestra.run.smithi045.stdout: -7363> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=128) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5755 pv6007 ap=128 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=128) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=126) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.351 INFO:teuthology.orchestra.run.smithi045.stdout: -7362> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000055e [2,head] /dc-dir/dc-file_873 auth v5748 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.019465+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535654580] 2023-10-03T19:21:08.351 INFO:teuthology.orchestra.run.smithi045.stdout: -7361> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000055e [2,head] /dc-dir/dc-file_873 auth v5748 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.019465+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535654580] 2023-10-03T19:21:08.351 INFO:teuthology.orchestra.run.smithi045.stdout: -7360> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.351 INFO:teuthology.orchestra.run.smithi045.stdout: -7359> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.351 INFO:teuthology.orchestra.run.smithi045.stdout: -7358> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.351 INFO:teuthology.orchestra.run.smithi045.stdout: -7357> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000055e [2,head] /dc-dir/dc-file_873 auth v5748 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.019465+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535654580] 2023-10-03T19:21:08.351 INFO:teuthology.orchestra.run.smithi045.stdout: -7356> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000055e [2,head] /dc-dir/dc-file_873 auth v5748 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.019465+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535654580] 2023-10-03T19:21:08.351 INFO:teuthology.orchestra.run.smithi045.stdout: -7355> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.352 INFO:teuthology.orchestra.run.smithi045.stdout: -7354> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 602.007, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.02e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1206.8] 2023-10-03T19:21:08.352 INFO:teuthology.orchestra.run.smithi045.stdout: -7353> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655363866c0 on [dir 0x1 / [2,head] auth pv=6008 v=5756 cv=5384/5384 REP dir_auth=0 ap=126+128 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 126 2023-10-03T19:21:08.352 INFO:teuthology.orchestra.run.smithi045.stdout: -7352> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655363866c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5755 pv6007 ap=127 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=127) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=126) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 127 2023-10-03T19:21:08.352 INFO:teuthology.orchestra.run.smithi045.stdout: -7351> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5756 cv=5384/5384 REP dir_auth=0 ap=126+127 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655363866c0 count now 126/127 2023-10-03T19:21:08.352 INFO:teuthology.orchestra.run.smithi045.stdout: -7350> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655363866c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5749 cv=5377/5377 ap=127+127 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=186 | child=1 dirty=1 authpin=1 0x565534f82400] count now 127 2023-10-03T19:21:08.352 INFO:teuthology.orchestra.run.smithi045.stdout: -7349> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000055e) auth_unpin by 0x5655363866c0 on [inode 0x1000000055e [2,head] /dc-dir/dc-file_873 auth v5748 s=3 n(v0 rc2023-10-03T19:17:09.019465+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535654580] now 0 2023-10-03T19:21:08.352 INFO:teuthology.orchestra.run.smithi045.stdout: -7348> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5749 cv=5377/5377 ap=127+126 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=186 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655363866c0 count now 127/126 2023-10-03T19:21:08.352 INFO:teuthology.orchestra.run.smithi045.stdout: -7347> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.352 INFO:teuthology.orchestra.run.smithi045.stdout: -7346> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.352 INFO:teuthology.orchestra.run.smithi045.stdout: -7345> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000055f [2,head] /dc-dir/dc-file_874 auth v4418 pv5750 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.031035+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.031035+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535654b00] 2023-10-03T19:21:08.352 INFO:teuthology.orchestra.run.smithi045.stdout: -7344> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5757 2023-10-03T19:21:08.352 INFO:teuthology.orchestra.run.smithi045.stdout: -7343> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5757 pv6007 ap=127 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=127) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=126) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.353 INFO:teuthology.orchestra.run.smithi045.stdout: -7342> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5755 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.353 INFO:teuthology.orchestra.run.smithi045.stdout: -7341> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5756 cv=5384/5384 REP dir_auth=0 ap=126+127 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5756 2023-10-03T19:21:08.353 INFO:teuthology.orchestra.run.smithi045.stdout: -7340> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000055f) pop_and_dirty_projected_inode v5750 2023-10-03T19:21:08.353 INFO:teuthology.orchestra.run.smithi045.stdout: -7339> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000055f) mark_dirty [inode 0x1000000055f [2,head] /dc-dir/dc-file_874 auth v5750 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.031035+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535654b00] 2023-10-03T19:21:08.353 INFO:teuthology.orchestra.run.smithi045.stdout: -7338> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_874) mark_dirty [dentry #0x1/dc-dir/dc-file_874 [2,head] auth (dversion lock) pv=5750 v=4418 ino=0x1000000055f state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553564fb80] 2023-10-03T19:21:08.353 INFO:teuthology.orchestra.run.smithi045.stdout: -7337> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5749 cv=5377/5377 ap=127+126 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=187 | child=1 dirty=1 authpin=1 0x565534f82400] version 5749 2023-10-03T19:21:08.353 INFO:teuthology.orchestra.run.smithi045.stdout: -7336> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535dc4800 v5758 2023-10-03T19:21:08.353 INFO:teuthology.orchestra.run.smithi045.stdout: -7335> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5758 cv=5384/5384 REP dir_auth=0 ap=126+127 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5758 2023-10-03T19:21:08.353 INFO:teuthology.orchestra.run.smithi045.stdout: -7334> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535dc46e0 v5751 2023-10-03T19:21:08.353 INFO:teuthology.orchestra.run.smithi045.stdout: -7333> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5751 cv=5377/5377 ap=127+126 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=187 | child=1 dirty=1 authpin=1 0x565534f82400] version 5751 2023-10-03T19:21:08.353 INFO:teuthology.orchestra.run.smithi045.stdout: -7332> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=126 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=126 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.354 INFO:teuthology.orchestra.run.smithi045.stdout: -7331> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=126) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5757 pv6007 ap=127 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=127) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=126) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.354 INFO:teuthology.orchestra.run.smithi045.stdout: -7330> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=127) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5757 pv6007 ap=127 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=127) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=125) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.354 INFO:teuthology.orchestra.run.smithi045.stdout: -7329> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000055f [2,head] /dc-dir/dc-file_874 auth v5750 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.031035+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535654b00] 2023-10-03T19:21:08.354 INFO:teuthology.orchestra.run.smithi045.stdout: -7328> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000055f [2,head] /dc-dir/dc-file_874 auth v5750 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.031035+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535654b00] 2023-10-03T19:21:08.354 INFO:teuthology.orchestra.run.smithi045.stdout: -7327> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.354 INFO:teuthology.orchestra.run.smithi045.stdout: -7326> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.354 INFO:teuthology.orchestra.run.smithi045.stdout: -7325> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.354 INFO:teuthology.orchestra.run.smithi045.stdout: -7324> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000055f [2,head] /dc-dir/dc-file_874 auth v5750 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.031035+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535654b00] 2023-10-03T19:21:08.354 INFO:teuthology.orchestra.run.smithi045.stdout: -7323> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000055f [2,head] /dc-dir/dc-file_874 auth v5750 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.031035+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535654b00] 2023-10-03T19:21:08.354 INFO:teuthology.orchestra.run.smithi045.stdout: -7322> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.354 INFO:teuthology.orchestra.run.smithi045.stdout: -7321> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 603.007, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.03e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1208.8] 2023-10-03T19:21:08.355 INFO:teuthology.orchestra.run.smithi045.stdout: -7320> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655356b6000 on [dir 0x1 / [2,head] auth pv=6008 v=5758 cv=5384/5384 REP dir_auth=0 ap=125+127 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 125 2023-10-03T19:21:08.355 INFO:teuthology.orchestra.run.smithi045.stdout: -7319> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655356b6000 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5757 pv6007 ap=126 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=126) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=125) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 126 2023-10-03T19:21:08.355 INFO:teuthology.orchestra.run.smithi045.stdout: -7318> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5758 cv=5384/5384 REP dir_auth=0 ap=125+126 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655356b6000 count now 125/126 2023-10-03T19:21:08.355 INFO:teuthology.orchestra.run.smithi045.stdout: -7317> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655356b6000 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5751 cv=5377/5377 ap=126+126 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=187 | child=1 dirty=1 authpin=1 0x565534f82400] count now 126 2023-10-03T19:21:08.355 INFO:teuthology.orchestra.run.smithi045.stdout: -7316> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000055f) auth_unpin by 0x5655356b6000 on [inode 0x1000000055f [2,head] /dc-dir/dc-file_874 auth v5750 s=3 n(v0 rc2023-10-03T19:17:09.031035+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535654b00] now 0 2023-10-03T19:21:08.355 INFO:teuthology.orchestra.run.smithi045.stdout: -7315> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5751 cv=5377/5377 ap=126+125 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=187 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655356b6000 count now 126/125 2023-10-03T19:21:08.355 INFO:teuthology.orchestra.run.smithi045.stdout: -7314> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.355 INFO:teuthology.orchestra.run.smithi045.stdout: -7313> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.355 INFO:teuthology.orchestra.run.smithi045.stdout: -7312> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000560 [2,head] /dc-dir/dc-file_875 auth v4422 pv5752 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.043153+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.043153+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535655080] 2023-10-03T19:21:08.355 INFO:teuthology.orchestra.run.smithi045.stdout: -7311> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5759 2023-10-03T19:21:08.355 INFO:teuthology.orchestra.run.smithi045.stdout: -7310> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5759 pv6007 ap=126 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=126) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=125) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.356 INFO:teuthology.orchestra.run.smithi045.stdout: -7309> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5757 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.356 INFO:teuthology.orchestra.run.smithi045.stdout: -7308> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5758 cv=5384/5384 REP dir_auth=0 ap=125+126 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5758 2023-10-03T19:21:08.356 INFO:teuthology.orchestra.run.smithi045.stdout: -7307> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000560) pop_and_dirty_projected_inode v5752 2023-10-03T19:21:08.356 INFO:teuthology.orchestra.run.smithi045.stdout: -7306> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000560) mark_dirty [inode 0x10000000560 [2,head] /dc-dir/dc-file_875 auth v5752 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.043153+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535655080] 2023-10-03T19:21:08.356 INFO:teuthology.orchestra.run.smithi045.stdout: -7305> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_875) mark_dirty [dentry #0x1/dc-dir/dc-file_875 [2,head] auth (dversion lock) pv=5752 v=4422 ino=0x10000000560 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535658000] 2023-10-03T19:21:08.356 INFO:teuthology.orchestra.run.smithi045.stdout: -7304> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5751 cv=5377/5377 ap=126+125 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=188 | child=1 dirty=1 authpin=1 0x565534f82400] version 5751 2023-10-03T19:21:08.356 INFO:teuthology.orchestra.run.smithi045.stdout: -7303> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535dc4a40 v5760 2023-10-03T19:21:08.356 INFO:teuthology.orchestra.run.smithi045.stdout: -7302> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5760 cv=5384/5384 REP dir_auth=0 ap=125+126 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5760 2023-10-03T19:21:08.356 INFO:teuthology.orchestra.run.smithi045.stdout: -7301> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535dc4920 v5753 2023-10-03T19:21:08.356 INFO:teuthology.orchestra.run.smithi045.stdout: -7300> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5753 cv=5377/5377 ap=126+125 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=188 | child=1 dirty=1 authpin=1 0x565534f82400] version 5753 2023-10-03T19:21:08.356 INFO:teuthology.orchestra.run.smithi045.stdout: -7299> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=125 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=125 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.356 INFO:teuthology.orchestra.run.smithi045.stdout: -7298> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=125) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5759 pv6007 ap=126 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=126) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=125) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.357 INFO:teuthology.orchestra.run.smithi045.stdout: -7297> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=126) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5759 pv6007 ap=126 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=126) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=124) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.357 INFO:teuthology.orchestra.run.smithi045.stdout: -7296> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000560 [2,head] /dc-dir/dc-file_875 auth v5752 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.043153+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535655080] 2023-10-03T19:21:08.357 INFO:teuthology.orchestra.run.smithi045.stdout: -7295> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000560 [2,head] /dc-dir/dc-file_875 auth v5752 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.043153+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535655080] 2023-10-03T19:21:08.357 INFO:teuthology.orchestra.run.smithi045.stdout: -7294> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.357 INFO:teuthology.orchestra.run.smithi045.stdout: -7293> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.357 INFO:teuthology.orchestra.run.smithi045.stdout: -7292> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.357 INFO:teuthology.orchestra.run.smithi045.stdout: -7291> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000560 [2,head] /dc-dir/dc-file_875 auth v5752 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.043153+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535655080] 2023-10-03T19:21:08.357 INFO:teuthology.orchestra.run.smithi045.stdout: -7290> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000560 [2,head] /dc-dir/dc-file_875 auth v5752 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.043153+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535655080] 2023-10-03T19:21:08.357 INFO:teuthology.orchestra.run.smithi045.stdout: -7289> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.357 INFO:teuthology.orchestra.run.smithi045.stdout: -7288> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 604.007, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.04e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1210.8] 2023-10-03T19:21:08.358 INFO:teuthology.orchestra.run.smithi045.stdout: -7287> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655356b6480 on [dir 0x1 / [2,head] auth pv=6008 v=5760 cv=5384/5384 REP dir_auth=0 ap=124+126 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 124 2023-10-03T19:21:08.358 INFO:teuthology.orchestra.run.smithi045.stdout: -7286> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655356b6480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5759 pv6007 ap=125 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=125) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=124) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 125 2023-10-03T19:21:08.358 INFO:teuthology.orchestra.run.smithi045.stdout: -7285> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5760 cv=5384/5384 REP dir_auth=0 ap=124+125 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655356b6480 count now 124/125 2023-10-03T19:21:08.358 INFO:teuthology.orchestra.run.smithi045.stdout: -7284> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655356b6480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5753 cv=5377/5377 ap=125+125 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=188 | child=1 dirty=1 authpin=1 0x565534f82400] count now 125 2023-10-03T19:21:08.358 INFO:teuthology.orchestra.run.smithi045.stdout: -7283> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000560) auth_unpin by 0x5655356b6480 on [inode 0x10000000560 [2,head] /dc-dir/dc-file_875 auth v5752 s=3 n(v0 rc2023-10-03T19:17:09.043153+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535655080] now 0 2023-10-03T19:21:08.358 INFO:teuthology.orchestra.run.smithi045.stdout: -7282> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5753 cv=5377/5377 ap=125+124 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=188 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655356b6480 count now 125/124 2023-10-03T19:21:08.358 INFO:teuthology.orchestra.run.smithi045.stdout: -7281> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.358 INFO:teuthology.orchestra.run.smithi045.stdout: -7280> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.358 INFO:teuthology.orchestra.run.smithi045.stdout: -7279> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000561 [2,head] /dc-dir/dc-file_876 auth v4426 pv5754 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.054235+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.054235+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535655600] 2023-10-03T19:21:08.358 INFO:teuthology.orchestra.run.smithi045.stdout: -7278> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5761 2023-10-03T19:21:08.358 INFO:teuthology.orchestra.run.smithi045.stdout: -7277> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5761 pv6007 ap=125 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=125) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=124) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.359 INFO:teuthology.orchestra.run.smithi045.stdout: -7276> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5759 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.359 INFO:teuthology.orchestra.run.smithi045.stdout: -7275> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5760 cv=5384/5384 REP dir_auth=0 ap=124+125 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5760 2023-10-03T19:21:08.359 INFO:teuthology.orchestra.run.smithi045.stdout: -7274> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000561) pop_and_dirty_projected_inode v5754 2023-10-03T19:21:08.359 INFO:teuthology.orchestra.run.smithi045.stdout: -7273> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000561) mark_dirty [inode 0x10000000561 [2,head] /dc-dir/dc-file_876 auth v5754 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.054235+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535655600] 2023-10-03T19:21:08.359 INFO:teuthology.orchestra.run.smithi045.stdout: -7272> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_876) mark_dirty [dentry #0x1/dc-dir/dc-file_876 [2,head] auth (dversion lock) pv=5754 v=4426 ino=0x10000000561 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535658280] 2023-10-03T19:21:08.359 INFO:teuthology.orchestra.run.smithi045.stdout: -7271> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5753 cv=5377/5377 ap=125+124 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=189 | child=1 dirty=1 authpin=1 0x565534f82400] version 5753 2023-10-03T19:21:08.359 INFO:teuthology.orchestra.run.smithi045.stdout: -7270> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535dc4c80 v5762 2023-10-03T19:21:08.359 INFO:teuthology.orchestra.run.smithi045.stdout: -7269> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5762 cv=5384/5384 REP dir_auth=0 ap=124+125 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5762 2023-10-03T19:21:08.359 INFO:teuthology.orchestra.run.smithi045.stdout: -7268> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535dc4b60 v5755 2023-10-03T19:21:08.359 INFO:teuthology.orchestra.run.smithi045.stdout: -7267> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5755 cv=5377/5377 ap=125+124 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=189 | child=1 dirty=1 authpin=1 0x565534f82400] version 5755 2023-10-03T19:21:08.359 INFO:teuthology.orchestra.run.smithi045.stdout: -7266> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=124 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=124 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.360 INFO:teuthology.orchestra.run.smithi045.stdout: -7265> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=124) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5761 pv6007 ap=125 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=125) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=124) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.360 INFO:teuthology.orchestra.run.smithi045.stdout: -7264> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=125) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5761 pv6007 ap=125 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=125) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=123) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.360 INFO:teuthology.orchestra.run.smithi045.stdout: -7263> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000561 [2,head] /dc-dir/dc-file_876 auth v5754 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.054235+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535655600] 2023-10-03T19:21:08.360 INFO:teuthology.orchestra.run.smithi045.stdout: -7262> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000561 [2,head] /dc-dir/dc-file_876 auth v5754 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.054235+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535655600] 2023-10-03T19:21:08.360 INFO:teuthology.orchestra.run.smithi045.stdout: -7261> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.360 INFO:teuthology.orchestra.run.smithi045.stdout: -7260> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.360 INFO:teuthology.orchestra.run.smithi045.stdout: -7259> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.360 INFO:teuthology.orchestra.run.smithi045.stdout: -7258> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000561 [2,head] /dc-dir/dc-file_876 auth v5754 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.054235+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535655600] 2023-10-03T19:21:08.360 INFO:teuthology.orchestra.run.smithi045.stdout: -7257> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000561 [2,head] /dc-dir/dc-file_876 auth v5754 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.054235+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535655600] 2023-10-03T19:21:08.360 INFO:teuthology.orchestra.run.smithi045.stdout: -7256> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.360 INFO:teuthology.orchestra.run.smithi045.stdout: -7255> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 605.007, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.05e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1212.8] 2023-10-03T19:21:08.360 INFO:teuthology.orchestra.run.smithi045.stdout: -7254> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655356b6900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5761 pv6007 ap=124 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=124) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=123) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 124 2023-10-03T19:21:08.361 INFO:teuthology.orchestra.run.smithi045.stdout: -7253> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5762 cv=5384/5384 REP dir_auth=0 ap=124+124 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655356b6900 count now 124/124 2023-10-03T19:21:08.361 INFO:teuthology.orchestra.run.smithi045.stdout: -7252> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655356b6900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5755 cv=5377/5377 ap=124+124 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=189 | child=1 dirty=1 authpin=1 0x565534f82400] count now 124 2023-10-03T19:21:08.361 INFO:teuthology.orchestra.run.smithi045.stdout: -7251> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655356b6900 on [dir 0x1 / [2,head] auth pv=6008 v=5762 cv=5384/5384 REP dir_auth=0 ap=123+124 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 123 2023-10-03T19:21:08.361 INFO:teuthology.orchestra.run.smithi045.stdout: -7250> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000561) auth_unpin by 0x5655356b6900 on [inode 0x10000000561 [2,head] /dc-dir/dc-file_876 auth v5754 s=3 n(v0 rc2023-10-03T19:17:09.054235+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535655600] now 0 2023-10-03T19:21:08.361 INFO:teuthology.orchestra.run.smithi045.stdout: -7249> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5755 cv=5377/5377 ap=124+123 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=189 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655356b6900 count now 124/123 2023-10-03T19:21:08.361 INFO:teuthology.orchestra.run.smithi045.stdout: -7248> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.361 INFO:teuthology.orchestra.run.smithi045.stdout: -7247> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.361 INFO:teuthology.orchestra.run.smithi045.stdout: -7246> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000562 [2,head] /dc-dir/dc-file_877 auth v4430 pv5756 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.065109+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.065109+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535655b80] 2023-10-03T19:21:08.370 INFO:teuthology.orchestra.run.smithi045.stdout: -7245> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5763 2023-10-03T19:21:08.370 INFO:teuthology.orchestra.run.smithi045.stdout: -7244> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5763 pv6007 ap=124 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=124) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=123) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.370 INFO:teuthology.orchestra.run.smithi045.stdout: -7243> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5761 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.370 INFO:teuthology.orchestra.run.smithi045.stdout: -7242> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5762 cv=5384/5384 REP dir_auth=0 ap=123+124 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5762 2023-10-03T19:21:08.370 INFO:teuthology.orchestra.run.smithi045.stdout: -7241> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000562) pop_and_dirty_projected_inode v5756 2023-10-03T19:21:08.370 INFO:teuthology.orchestra.run.smithi045.stdout: -7240> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000562) mark_dirty [inode 0x10000000562 [2,head] /dc-dir/dc-file_877 auth v5756 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.065109+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535655b80] 2023-10-03T19:21:08.370 INFO:teuthology.orchestra.run.smithi045.stdout: -7239> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_877) mark_dirty [dentry #0x1/dc-dir/dc-file_877 [2,head] auth (dversion lock) pv=5756 v=4430 ino=0x10000000562 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535658500] 2023-10-03T19:21:08.370 INFO:teuthology.orchestra.run.smithi045.stdout: -7238> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5755 cv=5377/5377 ap=124+123 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=190 | child=1 dirty=1 authpin=1 0x565534f82400] version 5755 2023-10-03T19:21:08.371 INFO:teuthology.orchestra.run.smithi045.stdout: -7237> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535dc4ec0 v5764 2023-10-03T19:21:08.371 INFO:teuthology.orchestra.run.smithi045.stdout: -7236> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5764 cv=5384/5384 REP dir_auth=0 ap=123+124 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5764 2023-10-03T19:21:08.371 INFO:teuthology.orchestra.run.smithi045.stdout: -7235> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535dc4da0 v5757 2023-10-03T19:21:08.371 INFO:teuthology.orchestra.run.smithi045.stdout: -7234> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5757 cv=5377/5377 ap=124+123 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=190 | child=1 dirty=1 authpin=1 0x565534f82400] version 5757 2023-10-03T19:21:08.371 INFO:teuthology.orchestra.run.smithi045.stdout: -7233> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=123 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=123 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.371 INFO:teuthology.orchestra.run.smithi045.stdout: -7232> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=123) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5763 pv6007 ap=124 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=124) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=123) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.371 INFO:teuthology.orchestra.run.smithi045.stdout: -7231> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=124) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5763 pv6007 ap=124 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=124) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=122) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.371 INFO:teuthology.orchestra.run.smithi045.stdout: -7230> 2023-10-03T19:17:19.526+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000562 [2,head] /dc-dir/dc-file_877 auth v5756 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.065109+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535655b80] 2023-10-03T19:21:08.371 INFO:teuthology.orchestra.run.smithi045.stdout: -7229> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000562 [2,head] /dc-dir/dc-file_877 auth v5756 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.065109+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535655b80] 2023-10-03T19:21:08.371 INFO:teuthology.orchestra.run.smithi045.stdout: -7228> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.372 INFO:teuthology.orchestra.run.smithi045.stdout: -7227> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.372 INFO:teuthology.orchestra.run.smithi045.stdout: -7226> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.372 INFO:teuthology.orchestra.run.smithi045.stdout: -7225> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000562 [2,head] /dc-dir/dc-file_877 auth v5756 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.065109+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535655b80] 2023-10-03T19:21:08.372 INFO:teuthology.orchestra.run.smithi045.stdout: -7224> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000562 [2,head] /dc-dir/dc-file_877 auth v5756 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.065109+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535655b80] 2023-10-03T19:21:08.372 INFO:teuthology.orchestra.run.smithi045.stdout: -7223> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.372 INFO:teuthology.orchestra.run.smithi045.stdout: -7222> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 605.671, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.06e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1214.1] 2023-10-03T19:21:08.372 INFO:teuthology.orchestra.run.smithi045.stdout: -7221> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655356b6d80 on [dir 0x1 / [2,head] auth pv=6008 v=5764 cv=5384/5384 REP dir_auth=0 ap=122+124 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 122 2023-10-03T19:21:08.372 INFO:teuthology.orchestra.run.smithi045.stdout: -7220> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655356b6d80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5763 pv6007 ap=123 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=123) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=122) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 123 2023-10-03T19:21:08.372 INFO:teuthology.orchestra.run.smithi045.stdout: -7219> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5764 cv=5384/5384 REP dir_auth=0 ap=122+123 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655356b6d80 count now 122/123 2023-10-03T19:21:08.372 INFO:teuthology.orchestra.run.smithi045.stdout: -7218> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655356b6d80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5757 cv=5377/5377 ap=123+123 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=190 | child=1 dirty=1 authpin=1 0x565534f82400] count now 123 2023-10-03T19:21:08.372 INFO:teuthology.orchestra.run.smithi045.stdout: -7217> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000562) auth_unpin by 0x5655356b6d80 on [inode 0x10000000562 [2,head] /dc-dir/dc-file_877 auth v5756 s=3 n(v0 rc2023-10-03T19:17:09.065109+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535655b80] now 0 2023-10-03T19:21:08.373 INFO:teuthology.orchestra.run.smithi045.stdout: -7216> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5757 cv=5377/5377 ap=123+122 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=190 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655356b6d80 count now 123/122 2023-10-03T19:21:08.373 INFO:teuthology.orchestra.run.smithi045.stdout: -7215> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.373 INFO:teuthology.orchestra.run.smithi045.stdout: -7214> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.373 INFO:teuthology.orchestra.run.smithi045.stdout: -7213> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000563 [2,head] /dc-dir/dc-file_878 auth v4434 pv5758 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.077570+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.077570+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535656100] 2023-10-03T19:21:08.373 INFO:teuthology.orchestra.run.smithi045.stdout: -7212> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5765 2023-10-03T19:21:08.373 INFO:teuthology.orchestra.run.smithi045.stdout: -7211> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5765 pv6007 ap=123 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=123) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=122) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.373 INFO:teuthology.orchestra.run.smithi045.stdout: -7210> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5763 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.373 INFO:teuthology.orchestra.run.smithi045.stdout: -7209> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5764 cv=5384/5384 REP dir_auth=0 ap=122+123 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5764 2023-10-03T19:21:08.373 INFO:teuthology.orchestra.run.smithi045.stdout: -7208> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000563) pop_and_dirty_projected_inode v5758 2023-10-03T19:21:08.373 INFO:teuthology.orchestra.run.smithi045.stdout: -7207> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000563) mark_dirty [inode 0x10000000563 [2,head] /dc-dir/dc-file_878 auth v5758 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.077570+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535656100] 2023-10-03T19:21:08.373 INFO:teuthology.orchestra.run.smithi045.stdout: -7206> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_878) mark_dirty [dentry #0x1/dc-dir/dc-file_878 [2,head] auth (dversion lock) pv=5758 v=4434 ino=0x10000000563 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535658780] 2023-10-03T19:21:08.373 INFO:teuthology.orchestra.run.smithi045.stdout: -7205> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5757 cv=5377/5377 ap=123+122 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=191 | child=1 dirty=1 authpin=1 0x565534f82400] version 5757 2023-10-03T19:21:08.374 INFO:teuthology.orchestra.run.smithi045.stdout: -7204> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535dc5100 v5766 2023-10-03T19:21:08.374 INFO:teuthology.orchestra.run.smithi045.stdout: -7203> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5766 cv=5384/5384 REP dir_auth=0 ap=122+123 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5766 2023-10-03T19:21:08.374 INFO:teuthology.orchestra.run.smithi045.stdout: -7202> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535dc4fe0 v5759 2023-10-03T19:21:08.374 INFO:teuthology.orchestra.run.smithi045.stdout: -7201> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5759 cv=5377/5377 ap=123+122 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=191 | child=1 dirty=1 authpin=1 0x565534f82400] version 5759 2023-10-03T19:21:08.374 INFO:teuthology.orchestra.run.smithi045.stdout: -7200> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=122 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=122 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.374 INFO:teuthology.orchestra.run.smithi045.stdout: -7199> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=122) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5765 pv6007 ap=123 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=123) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=122) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.374 INFO:teuthology.orchestra.run.smithi045.stdout: -7198> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=123) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5765 pv6007 ap=123 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=123) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=121) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.374 INFO:teuthology.orchestra.run.smithi045.stdout: -7197> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000563 [2,head] /dc-dir/dc-file_878 auth v5758 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.077570+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535656100] 2023-10-03T19:21:08.374 INFO:teuthology.orchestra.run.smithi045.stdout: -7196> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000563 [2,head] /dc-dir/dc-file_878 auth v5758 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.077570+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535656100] 2023-10-03T19:21:08.374 INFO:teuthology.orchestra.run.smithi045.stdout: -7195> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.375 INFO:teuthology.orchestra.run.smithi045.stdout: -7194> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.375 INFO:teuthology.orchestra.run.smithi045.stdout: -7193> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.375 INFO:teuthology.orchestra.run.smithi045.stdout: -7192> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000563 [2,head] /dc-dir/dc-file_878 auth v5758 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.077570+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535656100] 2023-10-03T19:21:08.375 INFO:teuthology.orchestra.run.smithi045.stdout: -7191> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000563 [2,head] /dc-dir/dc-file_878 auth v5758 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.077570+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535656100] 2023-10-03T19:21:08.375 INFO:teuthology.orchestra.run.smithi045.stdout: -7190> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.375 INFO:teuthology.orchestra.run.smithi045.stdout: -7189> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 606.671, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.07e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1216.1] 2023-10-03T19:21:08.375 INFO:teuthology.orchestra.run.smithi045.stdout: -7188> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655356b7200 on [dir 0x1 / [2,head] auth pv=6008 v=5766 cv=5384/5384 REP dir_auth=0 ap=121+123 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 121 2023-10-03T19:21:08.375 INFO:teuthology.orchestra.run.smithi045.stdout: -7187> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655356b7200 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5765 pv6007 ap=122 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=122) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=121) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 122 2023-10-03T19:21:08.375 INFO:teuthology.orchestra.run.smithi045.stdout: -7186> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5766 cv=5384/5384 REP dir_auth=0 ap=121+122 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655356b7200 count now 121/122 2023-10-03T19:21:08.375 INFO:teuthology.orchestra.run.smithi045.stdout: -7185> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655356b7200 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5759 cv=5377/5377 ap=122+122 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=191 | child=1 dirty=1 authpin=1 0x565534f82400] count now 122 2023-10-03T19:21:08.375 INFO:teuthology.orchestra.run.smithi045.stdout: -7184> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000563) auth_unpin by 0x5655356b7200 on [inode 0x10000000563 [2,head] /dc-dir/dc-file_878 auth v5758 s=3 n(v0 rc2023-10-03T19:17:09.077570+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535656100] now 0 2023-10-03T19:21:08.375 INFO:teuthology.orchestra.run.smithi045.stdout: -7183> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5759 cv=5377/5377 ap=122+121 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=191 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655356b7200 count now 122/121 2023-10-03T19:21:08.376 INFO:teuthology.orchestra.run.smithi045.stdout: -7182> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.376 INFO:teuthology.orchestra.run.smithi045.stdout: -7181> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.376 INFO:teuthology.orchestra.run.smithi045.stdout: -7180> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000564 [2,head] /dc-dir/dc-file_879 auth v4438 pv5760 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.090152+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.090152+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535656680] 2023-10-03T19:21:08.376 INFO:teuthology.orchestra.run.smithi045.stdout: -7179> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5767 2023-10-03T19:21:08.416 INFO:teuthology.orchestra.run.smithi045.stdout: -7178> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5767 pv6007 ap=122 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=122) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=121) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.416 INFO:teuthology.orchestra.run.smithi045.stdout: -7177> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5765 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.416 INFO:teuthology.orchestra.run.smithi045.stdout: -7176> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5766 cv=5384/5384 REP dir_auth=0 ap=121+122 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5766 2023-10-03T19:21:08.416 INFO:teuthology.orchestra.run.smithi045.stdout: -7175> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000564) pop_and_dirty_projected_inode v5760 2023-10-03T19:21:08.416 INFO:teuthology.orchestra.run.smithi045.stdout: -7174> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000564) mark_dirty [inode 0x10000000564 [2,head] /dc-dir/dc-file_879 auth v5760 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.090152+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535656680] 2023-10-03T19:21:08.416 INFO:teuthology.orchestra.run.smithi045.stdout: -7173> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_879) mark_dirty [dentry #0x1/dc-dir/dc-file_879 [2,head] auth (dversion lock) pv=5760 v=4438 ino=0x10000000564 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535658a00] 2023-10-03T19:21:08.416 INFO:teuthology.orchestra.run.smithi045.stdout: -7172> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5759 cv=5377/5377 ap=122+121 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=192 | child=1 dirty=1 authpin=1 0x565534f82400] version 5759 2023-10-03T19:21:08.416 INFO:teuthology.orchestra.run.smithi045.stdout: -7171> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535dc5340 v5768 2023-10-03T19:21:08.416 INFO:teuthology.orchestra.run.smithi045.stdout: -7170> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5768 cv=5384/5384 REP dir_auth=0 ap=121+122 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5768 2023-10-03T19:21:08.417 INFO:teuthology.orchestra.run.smithi045.stdout: -7169> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535dc5220 v5761 2023-10-03T19:21:08.417 INFO:teuthology.orchestra.run.smithi045.stdout: -7168> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5761 cv=5377/5377 ap=122+121 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=192 | child=1 dirty=1 authpin=1 0x565534f82400] version 5761 2023-10-03T19:21:08.417 INFO:teuthology.orchestra.run.smithi045.stdout: -7167> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=121 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=121 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.417 INFO:teuthology.orchestra.run.smithi045.stdout: -7166> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=121) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5767 pv6007 ap=122 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=122) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=121) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.417 INFO:teuthology.orchestra.run.smithi045.stdout: -7165> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=122) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5767 pv6007 ap=122 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=122) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=120) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.417 INFO:teuthology.orchestra.run.smithi045.stdout: -7164> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000564 [2,head] /dc-dir/dc-file_879 auth v5760 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.090152+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535656680] 2023-10-03T19:21:08.417 INFO:teuthology.orchestra.run.smithi045.stdout: -7163> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000564 [2,head] /dc-dir/dc-file_879 auth v5760 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.090152+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535656680] 2023-10-03T19:21:08.417 INFO:teuthology.orchestra.run.smithi045.stdout: -7162> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.417 INFO:teuthology.orchestra.run.smithi045.stdout: -7161> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.417 INFO:teuthology.orchestra.run.smithi045.stdout: -7160> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.417 INFO:teuthology.orchestra.run.smithi045.stdout: -7159> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000564 [2,head] /dc-dir/dc-file_879 auth v5760 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.090152+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535656680] 2023-10-03T19:21:08.418 INFO:teuthology.orchestra.run.smithi045.stdout: -7158> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000564 [2,head] /dc-dir/dc-file_879 auth v5760 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.090152+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535656680] 2023-10-03T19:21:08.418 INFO:teuthology.orchestra.run.smithi045.stdout: -7157> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.418 INFO:teuthology.orchestra.run.smithi045.stdout: -7156> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 607.671, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.08e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1218.1] 2023-10-03T19:21:08.418 INFO:teuthology.orchestra.run.smithi045.stdout: -7155> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655356b7680 on [dir 0x1 / [2,head] auth pv=6008 v=5768 cv=5384/5384 REP dir_auth=0 ap=120+122 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 120 2023-10-03T19:21:08.418 INFO:teuthology.orchestra.run.smithi045.stdout: -7154> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655356b7680 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5761 cv=5377/5377 ap=121+121 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=192 | child=1 dirty=1 authpin=1 0x565534f82400] count now 121 2023-10-03T19:21:08.418 INFO:teuthology.orchestra.run.smithi045.stdout: -7153> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655356b7680 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5767 pv6007 ap=121 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=121) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=120) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 121 2023-10-03T19:21:08.418 INFO:teuthology.orchestra.run.smithi045.stdout: -7152> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5768 cv=5384/5384 REP dir_auth=0 ap=120+121 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655356b7680 count now 120/121 2023-10-03T19:21:08.418 INFO:teuthology.orchestra.run.smithi045.stdout: -7151> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000564) auth_unpin by 0x5655356b7680 on [inode 0x10000000564 [2,head] /dc-dir/dc-file_879 auth v5760 s=3 n(v0 rc2023-10-03T19:17:09.090152+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535656680] now 0 2023-10-03T19:21:08.418 INFO:teuthology.orchestra.run.smithi045.stdout: -7150> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5761 cv=5377/5377 ap=121+120 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=192 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655356b7680 count now 121/120 2023-10-03T19:21:08.418 INFO:teuthology.orchestra.run.smithi045.stdout: -7149> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.419 INFO:teuthology.orchestra.run.smithi045.stdout: -7148> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.419 INFO:teuthology.orchestra.run.smithi045.stdout: -7147> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000565 [2,head] /dc-dir/dc-file_880 auth v4442 pv5762 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.103529+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.103529+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535656c00] 2023-10-03T19:21:08.419 INFO:teuthology.orchestra.run.smithi045.stdout: -7146> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5769 2023-10-03T19:21:08.419 INFO:teuthology.orchestra.run.smithi045.stdout: -7145> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5769 pv6007 ap=121 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=121) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=120) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.419 INFO:teuthology.orchestra.run.smithi045.stdout: -7144> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5767 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.419 INFO:teuthology.orchestra.run.smithi045.stdout: -7143> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5768 cv=5384/5384 REP dir_auth=0 ap=120+121 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5768 2023-10-03T19:21:08.419 INFO:teuthology.orchestra.run.smithi045.stdout: -7142> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000565) pop_and_dirty_projected_inode v5762 2023-10-03T19:21:08.419 INFO:teuthology.orchestra.run.smithi045.stdout: -7141> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000565) mark_dirty [inode 0x10000000565 [2,head] /dc-dir/dc-file_880 auth v5762 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.103529+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535656c00] 2023-10-03T19:21:08.419 INFO:teuthology.orchestra.run.smithi045.stdout: -7140> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_880) mark_dirty [dentry #0x1/dc-dir/dc-file_880 [2,head] auth (dversion lock) pv=5762 v=4442 ino=0x10000000565 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535658c80] 2023-10-03T19:21:08.419 INFO:teuthology.orchestra.run.smithi045.stdout: -7139> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5761 cv=5377/5377 ap=121+120 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=193 | child=1 dirty=1 authpin=1 0x565534f82400] version 5761 2023-10-03T19:21:08.419 INFO:teuthology.orchestra.run.smithi045.stdout: -7138> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535dc5580 v5770 2023-10-03T19:21:08.420 INFO:teuthology.orchestra.run.smithi045.stdout: -7137> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5770 cv=5384/5384 REP dir_auth=0 ap=120+121 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5770 2023-10-03T19:21:08.420 INFO:teuthology.orchestra.run.smithi045.stdout: -7136> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535dc5460 v5763 2023-10-03T19:21:08.420 INFO:teuthology.orchestra.run.smithi045.stdout: -7135> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5763 cv=5377/5377 ap=121+120 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=193 | child=1 dirty=1 authpin=1 0x565534f82400] version 5763 2023-10-03T19:21:08.420 INFO:teuthology.orchestra.run.smithi045.stdout: -7134> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=120 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=120 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.420 INFO:teuthology.orchestra.run.smithi045.stdout: -7133> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=120) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5769 pv6007 ap=121 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=121) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=120) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.420 INFO:teuthology.orchestra.run.smithi045.stdout: -7132> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=121) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5769 pv6007 ap=121 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=121) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=119) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.420 INFO:teuthology.orchestra.run.smithi045.stdout: -7131> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000565 [2,head] /dc-dir/dc-file_880 auth v5762 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.103529+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535656c00] 2023-10-03T19:21:08.420 INFO:teuthology.orchestra.run.smithi045.stdout: -7130> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000565 [2,head] /dc-dir/dc-file_880 auth v5762 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.103529+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535656c00] 2023-10-03T19:21:08.420 INFO:teuthology.orchestra.run.smithi045.stdout: -7129> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.420 INFO:teuthology.orchestra.run.smithi045.stdout: -7128> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.421 INFO:teuthology.orchestra.run.smithi045.stdout: -7127> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.421 INFO:teuthology.orchestra.run.smithi045.stdout: -7126> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000565 [2,head] /dc-dir/dc-file_880 auth v5762 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.103529+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535656c00] 2023-10-03T19:21:08.421 INFO:teuthology.orchestra.run.smithi045.stdout: -7125> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000565 [2,head] /dc-dir/dc-file_880 auth v5762 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.103529+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535656c00] 2023-10-03T19:21:08.421 INFO:teuthology.orchestra.run.smithi045.stdout: -7124> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.421 INFO:teuthology.orchestra.run.smithi045.stdout: -7123> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 608.671, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.09e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1220.1] 2023-10-03T19:21:08.421 INFO:teuthology.orchestra.run.smithi045.stdout: -7122> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655356b7b00 on [dir 0x1 / [2,head] auth pv=6008 v=5770 cv=5384/5384 REP dir_auth=0 ap=119+121 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 119 2023-10-03T19:21:08.421 INFO:teuthology.orchestra.run.smithi045.stdout: -7121> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655356b7b00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5769 pv6007 ap=120 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=120) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=119) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 120 2023-10-03T19:21:08.421 INFO:teuthology.orchestra.run.smithi045.stdout: -7120> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5770 cv=5384/5384 REP dir_auth=0 ap=119+120 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655356b7b00 count now 119/120 2023-10-03T19:21:08.421 INFO:teuthology.orchestra.run.smithi045.stdout: -7119> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655356b7b00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5763 cv=5377/5377 ap=120+120 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=193 | child=1 dirty=1 authpin=1 0x565534f82400] count now 120 2023-10-03T19:21:08.421 INFO:teuthology.orchestra.run.smithi045.stdout: -7118> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000565) auth_unpin by 0x5655356b7b00 on [inode 0x10000000565 [2,head] /dc-dir/dc-file_880 auth v5762 s=3 n(v0 rc2023-10-03T19:17:09.103529+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535656c00] now 0 2023-10-03T19:21:08.421 INFO:teuthology.orchestra.run.smithi045.stdout: -7117> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5763 cv=5377/5377 ap=120+119 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=193 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655356b7b00 count now 120/119 2023-10-03T19:21:08.476 INFO:teuthology.orchestra.run.smithi045.stdout: -7116> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.476 INFO:teuthology.orchestra.run.smithi045.stdout: -7115> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.476 INFO:teuthology.orchestra.run.smithi045.stdout: -7114> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000566 [2,head] /dc-dir/dc-file_881 auth v4446 pv5764 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.116353+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.116353+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535657180] 2023-10-03T19:21:08.476 INFO:teuthology.orchestra.run.smithi045.stdout: -7113> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5771 2023-10-03T19:21:08.476 INFO:teuthology.orchestra.run.smithi045.stdout: -7112> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5771 pv6007 ap=120 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=120) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=119) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.476 INFO:teuthology.orchestra.run.smithi045.stdout: -7111> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5769 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.476 INFO:teuthology.orchestra.run.smithi045.stdout: -7110> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5770 cv=5384/5384 REP dir_auth=0 ap=119+120 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5770 2023-10-03T19:21:08.476 INFO:teuthology.orchestra.run.smithi045.stdout: -7109> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000566) pop_and_dirty_projected_inode v5764 2023-10-03T19:21:08.476 INFO:teuthology.orchestra.run.smithi045.stdout: -7108> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000566) mark_dirty [inode 0x10000000566 [2,head] /dc-dir/dc-file_881 auth v5764 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.116353+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535657180] 2023-10-03T19:21:08.476 INFO:teuthology.orchestra.run.smithi045.stdout: -7107> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_881) mark_dirty [dentry #0x1/dc-dir/dc-file_881 [2,head] auth (dversion lock) pv=5764 v=4446 ino=0x10000000566 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535658f00] 2023-10-03T19:21:08.477 INFO:teuthology.orchestra.run.smithi045.stdout: -7106> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5763 cv=5377/5377 ap=120+119 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=194 | child=1 dirty=1 authpin=1 0x565534f82400] version 5763 2023-10-03T19:21:08.477 INFO:teuthology.orchestra.run.smithi045.stdout: -7105> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535dc57c0 v5772 2023-10-03T19:21:08.477 INFO:teuthology.orchestra.run.smithi045.stdout: -7104> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5772 cv=5384/5384 REP dir_auth=0 ap=119+120 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5772 2023-10-03T19:21:08.477 INFO:teuthology.orchestra.run.smithi045.stdout: -7103> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535dc56a0 v5765 2023-10-03T19:21:08.477 INFO:teuthology.orchestra.run.smithi045.stdout: -7102> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5765 cv=5377/5377 ap=120+119 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=194 | child=1 dirty=1 authpin=1 0x565534f82400] version 5765 2023-10-03T19:21:08.477 INFO:teuthology.orchestra.run.smithi045.stdout: -7101> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=119 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=119 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.477 INFO:teuthology.orchestra.run.smithi045.stdout: -7100> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=119) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5771 pv6007 ap=120 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=120) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=119) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.477 INFO:teuthology.orchestra.run.smithi045.stdout: -7099> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=120) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5771 pv6007 ap=120 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=120) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=118) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.477 INFO:teuthology.orchestra.run.smithi045.stdout: -7098> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000566 [2,head] /dc-dir/dc-file_881 auth v5764 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.116353+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535657180] 2023-10-03T19:21:08.477 INFO:teuthology.orchestra.run.smithi045.stdout: -7097> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000566 [2,head] /dc-dir/dc-file_881 auth v5764 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.116353+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535657180] 2023-10-03T19:21:08.477 INFO:teuthology.orchestra.run.smithi045.stdout: -7096> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.478 INFO:teuthology.orchestra.run.smithi045.stdout: -7095> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.478 INFO:teuthology.orchestra.run.smithi045.stdout: -7094> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.478 INFO:teuthology.orchestra.run.smithi045.stdout: -7093> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000566 [2,head] /dc-dir/dc-file_881 auth v5764 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.116353+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535657180] 2023-10-03T19:21:08.478 INFO:teuthology.orchestra.run.smithi045.stdout: -7092> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000566 [2,head] /dc-dir/dc-file_881 auth v5764 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.116353+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535657180] 2023-10-03T19:21:08.478 INFO:teuthology.orchestra.run.smithi045.stdout: -7091> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.478 INFO:teuthology.orchestra.run.smithi045.stdout: -7090> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 609.671, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.10e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1222.1] 2023-10-03T19:21:08.478 INFO:teuthology.orchestra.run.smithi045.stdout: -7089> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536d9c000 on [dir 0x1 / [2,head] auth pv=6008 v=5772 cv=5384/5384 REP dir_auth=0 ap=118+120 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 118 2023-10-03T19:21:08.478 INFO:teuthology.orchestra.run.smithi045.stdout: -7088> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536d9c000 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5771 pv6007 ap=119 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=119) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=118) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 119 2023-10-03T19:21:08.478 INFO:teuthology.orchestra.run.smithi045.stdout: -7087> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5772 cv=5384/5384 REP dir_auth=0 ap=118+119 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536d9c000 count now 118/119 2023-10-03T19:21:08.478 INFO:teuthology.orchestra.run.smithi045.stdout: -7086> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536d9c000 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5765 cv=5377/5377 ap=119+119 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=194 | child=1 dirty=1 authpin=1 0x565534f82400] count now 119 2023-10-03T19:21:08.479 INFO:teuthology.orchestra.run.smithi045.stdout: -7085> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000566) auth_unpin by 0x565536d9c000 on [inode 0x10000000566 [2,head] /dc-dir/dc-file_881 auth v5764 s=3 n(v0 rc2023-10-03T19:17:09.116353+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535657180] now 0 2023-10-03T19:21:08.479 INFO:teuthology.orchestra.run.smithi045.stdout: -7084> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5765 cv=5377/5377 ap=119+118 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=194 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536d9c000 count now 119/118 2023-10-03T19:21:08.479 INFO:teuthology.orchestra.run.smithi045.stdout: -7083> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.479 INFO:teuthology.orchestra.run.smithi045.stdout: -7082> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.479 INFO:teuthology.orchestra.run.smithi045.stdout: -7081> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000567 [2,head] /dc-dir/dc-file_882 auth v4450 pv5766 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.128256+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.128256+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535657700] 2023-10-03T19:21:08.479 INFO:teuthology.orchestra.run.smithi045.stdout: -7080> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5773 2023-10-03T19:21:08.479 INFO:teuthology.orchestra.run.smithi045.stdout: -7079> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5773 pv6007 ap=119 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=119) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=118) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.479 INFO:teuthology.orchestra.run.smithi045.stdout: -7078> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5771 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.479 INFO:teuthology.orchestra.run.smithi045.stdout: -7077> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5772 cv=5384/5384 REP dir_auth=0 ap=118+119 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5772 2023-10-03T19:21:08.479 INFO:teuthology.orchestra.run.smithi045.stdout: -7076> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000567) pop_and_dirty_projected_inode v5766 2023-10-03T19:21:08.479 INFO:teuthology.orchestra.run.smithi045.stdout: -7075> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000567) mark_dirty [inode 0x10000000567 [2,head] /dc-dir/dc-file_882 auth v5766 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.128256+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535657700] 2023-10-03T19:21:08.479 INFO:teuthology.orchestra.run.smithi045.stdout: -7074> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_882) mark_dirty [dentry #0x1/dc-dir/dc-file_882 [2,head] auth (dversion lock) pv=5766 v=4450 ino=0x10000000567 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535659180] 2023-10-03T19:21:08.480 INFO:teuthology.orchestra.run.smithi045.stdout: -7073> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5765 cv=5377/5377 ap=119+118 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=195 | child=1 dirty=1 authpin=1 0x565534f82400] version 5765 2023-10-03T19:21:08.480 INFO:teuthology.orchestra.run.smithi045.stdout: -7072> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535dc5a00 v5774 2023-10-03T19:21:08.480 INFO:teuthology.orchestra.run.smithi045.stdout: -7071> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5774 cv=5384/5384 REP dir_auth=0 ap=118+119 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5774 2023-10-03T19:21:08.480 INFO:teuthology.orchestra.run.smithi045.stdout: -7070> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535dc58e0 v5767 2023-10-03T19:21:08.480 INFO:teuthology.orchestra.run.smithi045.stdout: -7069> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5767 cv=5377/5377 ap=119+118 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=195 | child=1 dirty=1 authpin=1 0x565534f82400] version 5767 2023-10-03T19:21:08.480 INFO:teuthology.orchestra.run.smithi045.stdout: -7068> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=118 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=118 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.480 INFO:teuthology.orchestra.run.smithi045.stdout: -7067> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=118) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5773 pv6007 ap=119 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=119) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=118) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.480 INFO:teuthology.orchestra.run.smithi045.stdout: -7066> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=119) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5773 pv6007 ap=119 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=119) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=117) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.480 INFO:teuthology.orchestra.run.smithi045.stdout: -7065> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000567 [2,head] /dc-dir/dc-file_882 auth v5766 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.128256+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535657700] 2023-10-03T19:21:08.480 INFO:teuthology.orchestra.run.smithi045.stdout: -7064> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000567 [2,head] /dc-dir/dc-file_882 auth v5766 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.128256+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535657700] 2023-10-03T19:21:08.481 INFO:teuthology.orchestra.run.smithi045.stdout: -7063> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.481 INFO:teuthology.orchestra.run.smithi045.stdout: -7062> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.481 INFO:teuthology.orchestra.run.smithi045.stdout: -7061> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.481 INFO:teuthology.orchestra.run.smithi045.stdout: -7060> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000567 [2,head] /dc-dir/dc-file_882 auth v5766 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.128256+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535657700] 2023-10-03T19:21:08.481 INFO:teuthology.orchestra.run.smithi045.stdout: -7059> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000567 [2,head] /dc-dir/dc-file_882 auth v5766 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.128256+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535657700] 2023-10-03T19:21:08.481 INFO:teuthology.orchestra.run.smithi045.stdout: -7058> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.481 INFO:teuthology.orchestra.run.smithi045.stdout: -7057> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 610.671, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.11e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1224.1] 2023-10-03T19:21:08.481 INFO:teuthology.orchestra.run.smithi045.stdout: -7056> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536d9c480 on [dir 0x1 / [2,head] auth pv=6008 v=5774 cv=5384/5384 REP dir_auth=0 ap=117+119 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 117 2023-10-03T19:21:08.481 INFO:teuthology.orchestra.run.smithi045.stdout: -7055> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536d9c480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5773 pv6007 ap=118 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=118) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=117) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 118 2023-10-03T19:21:08.481 INFO:teuthology.orchestra.run.smithi045.stdout: -7054> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5774 cv=5384/5384 REP dir_auth=0 ap=117+118 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536d9c480 count now 117/118 2023-10-03T19:21:08.481 INFO:teuthology.orchestra.run.smithi045.stdout: -7053> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536d9c480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5767 cv=5377/5377 ap=118+118 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=195 | child=1 dirty=1 authpin=1 0x565534f82400] count now 118 2023-10-03T19:21:08.529 INFO:teuthology.orchestra.run.smithi045.stdout: -7052> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000567) auth_unpin by 0x565536d9c480 on [inode 0x10000000567 [2,head] /dc-dir/dc-file_882 auth v5766 s=3 n(v0 rc2023-10-03T19:17:09.128256+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535657700] now 0 2023-10-03T19:21:08.529 INFO:teuthology.orchestra.run.smithi045.stdout: -7051> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5767 cv=5377/5377 ap=118+117 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=195 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536d9c480 count now 118/117 2023-10-03T19:21:08.529 INFO:teuthology.orchestra.run.smithi045.stdout: -7050> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.529 INFO:teuthology.orchestra.run.smithi045.stdout: -7049> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.529 INFO:teuthology.orchestra.run.smithi045.stdout: -7048> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000568 [2,head] /dc-dir/dc-file_883 auth v4454 pv5768 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.139955+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.139955+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553565a000] 2023-10-03T19:21:08.529 INFO:teuthology.orchestra.run.smithi045.stdout: -7047> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5775 2023-10-03T19:21:08.530 INFO:teuthology.orchestra.run.smithi045.stdout: -7046> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5775 pv6007 ap=118 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=118) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=117) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.530 INFO:teuthology.orchestra.run.smithi045.stdout: -7045> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5773 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.530 INFO:teuthology.orchestra.run.smithi045.stdout: -7044> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5774 cv=5384/5384 REP dir_auth=0 ap=117+118 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5774 2023-10-03T19:21:08.530 INFO:teuthology.orchestra.run.smithi045.stdout: -7043> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000568) pop_and_dirty_projected_inode v5768 2023-10-03T19:21:08.530 INFO:teuthology.orchestra.run.smithi045.stdout: -7042> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000568) mark_dirty [inode 0x10000000568 [2,head] /dc-dir/dc-file_883 auth v5768 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.139955+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553565a000] 2023-10-03T19:21:08.530 INFO:teuthology.orchestra.run.smithi045.stdout: -7041> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_883) mark_dirty [dentry #0x1/dc-dir/dc-file_883 [2,head] auth (dversion lock) pv=5768 v=4454 ino=0x10000000568 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535659400] 2023-10-03T19:21:08.530 INFO:teuthology.orchestra.run.smithi045.stdout: -7040> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5767 cv=5377/5377 ap=118+117 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=196 | child=1 dirty=1 authpin=1 0x565534f82400] version 5767 2023-10-03T19:21:08.530 INFO:teuthology.orchestra.run.smithi045.stdout: -7039> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535dc5c40 v5776 2023-10-03T19:21:08.530 INFO:teuthology.orchestra.run.smithi045.stdout: -7038> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5776 cv=5384/5384 REP dir_auth=0 ap=117+118 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5776 2023-10-03T19:21:08.530 INFO:teuthology.orchestra.run.smithi045.stdout: -7037> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535dc5b20 v5769 2023-10-03T19:21:08.531 INFO:teuthology.orchestra.run.smithi045.stdout: -7036> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5769 cv=5377/5377 ap=118+117 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=196 | child=1 dirty=1 authpin=1 0x565534f82400] version 5769 2023-10-03T19:21:08.531 INFO:teuthology.orchestra.run.smithi045.stdout: -7035> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=117 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=117 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.531 INFO:teuthology.orchestra.run.smithi045.stdout: -7034> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=117) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5775 pv6007 ap=118 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=118) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=117) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.531 INFO:teuthology.orchestra.run.smithi045.stdout: -7033> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=118) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5775 pv6007 ap=118 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=118) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=116) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.531 INFO:teuthology.orchestra.run.smithi045.stdout: -7032> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000568 [2,head] /dc-dir/dc-file_883 auth v5768 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.139955+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565a000] 2023-10-03T19:21:08.531 INFO:teuthology.orchestra.run.smithi045.stdout: -7031> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000568 [2,head] /dc-dir/dc-file_883 auth v5768 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.139955+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565a000] 2023-10-03T19:21:08.531 INFO:teuthology.orchestra.run.smithi045.stdout: -7030> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.531 INFO:teuthology.orchestra.run.smithi045.stdout: -7029> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.531 INFO:teuthology.orchestra.run.smithi045.stdout: -7028> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.531 INFO:teuthology.orchestra.run.smithi045.stdout: -7027> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000568 [2,head] /dc-dir/dc-file_883 auth v5768 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.139955+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565a000] 2023-10-03T19:21:08.531 INFO:teuthology.orchestra.run.smithi045.stdout: -7026> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000568 [2,head] /dc-dir/dc-file_883 auth v5768 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.139955+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565a000] 2023-10-03T19:21:08.532 INFO:teuthology.orchestra.run.smithi045.stdout: -7025> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.532 INFO:teuthology.orchestra.run.smithi045.stdout: -7024> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 611.671, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.12e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1226.1] 2023-10-03T19:21:08.532 INFO:teuthology.orchestra.run.smithi045.stdout: -7023> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536d9c900 on [dir 0x1 / [2,head] auth pv=6008 v=5776 cv=5384/5384 REP dir_auth=0 ap=116+118 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 116 2023-10-03T19:21:08.532 INFO:teuthology.orchestra.run.smithi045.stdout: -7022> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536d9c900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5775 pv6007 ap=117 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=117) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=116) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 117 2023-10-03T19:21:08.532 INFO:teuthology.orchestra.run.smithi045.stdout: -7021> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5776 cv=5384/5384 REP dir_auth=0 ap=116+117 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536d9c900 count now 116/117 2023-10-03T19:21:08.532 INFO:teuthology.orchestra.run.smithi045.stdout: -7020> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536d9c900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5769 cv=5377/5377 ap=117+117 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=196 | child=1 dirty=1 authpin=1 0x565534f82400] count now 117 2023-10-03T19:21:08.532 INFO:teuthology.orchestra.run.smithi045.stdout: -7019> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000568) auth_unpin by 0x565536d9c900 on [inode 0x10000000568 [2,head] /dc-dir/dc-file_883 auth v5768 s=3 n(v0 rc2023-10-03T19:17:09.139955+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553565a000] now 0 2023-10-03T19:21:08.532 INFO:teuthology.orchestra.run.smithi045.stdout: -7018> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5769 cv=5377/5377 ap=117+116 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=196 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536d9c900 count now 117/116 2023-10-03T19:21:08.532 INFO:teuthology.orchestra.run.smithi045.stdout: -7017> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.532 INFO:teuthology.orchestra.run.smithi045.stdout: -7016> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.532 INFO:teuthology.orchestra.run.smithi045.stdout: -7015> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000569 [2,head] /dc-dir/dc-file_884 auth v4458 pv5770 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.151288+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.151288+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553565a580] 2023-10-03T19:21:08.533 INFO:teuthology.orchestra.run.smithi045.stdout: -7014> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5777 2023-10-03T19:21:08.533 INFO:teuthology.orchestra.run.smithi045.stdout: -7013> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5777 pv6007 ap=117 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=117) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=116) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.533 INFO:teuthology.orchestra.run.smithi045.stdout: -7012> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5775 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.533 INFO:teuthology.orchestra.run.smithi045.stdout: -7011> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5776 cv=5384/5384 REP dir_auth=0 ap=116+117 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5776 2023-10-03T19:21:08.533 INFO:teuthology.orchestra.run.smithi045.stdout: -7010> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000569) pop_and_dirty_projected_inode v5770 2023-10-03T19:21:08.533 INFO:teuthology.orchestra.run.smithi045.stdout: -7009> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000569) mark_dirty [inode 0x10000000569 [2,head] /dc-dir/dc-file_884 auth v5770 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.151288+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553565a580] 2023-10-03T19:21:08.533 INFO:teuthology.orchestra.run.smithi045.stdout: -7008> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_884) mark_dirty [dentry #0x1/dc-dir/dc-file_884 [2,head] auth (dversion lock) pv=5770 v=4458 ino=0x10000000569 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535659680] 2023-10-03T19:21:08.533 INFO:teuthology.orchestra.run.smithi045.stdout: -7007> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5769 cv=5377/5377 ap=117+116 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=197 | child=1 dirty=1 authpin=1 0x565534f82400] version 5769 2023-10-03T19:21:08.533 INFO:teuthology.orchestra.run.smithi045.stdout: -7006> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565535dc5e80 v5778 2023-10-03T19:21:08.533 INFO:teuthology.orchestra.run.smithi045.stdout: -7005> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5778 cv=5384/5384 REP dir_auth=0 ap=116+117 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5778 2023-10-03T19:21:08.533 INFO:teuthology.orchestra.run.smithi045.stdout: -7004> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565535dc5d60 v5771 2023-10-03T19:21:08.534 INFO:teuthology.orchestra.run.smithi045.stdout: -7003> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5771 cv=5377/5377 ap=117+116 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=197 | child=1 dirty=1 authpin=1 0x565534f82400] version 5771 2023-10-03T19:21:08.534 INFO:teuthology.orchestra.run.smithi045.stdout: -7002> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=116 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=116 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.534 INFO:teuthology.orchestra.run.smithi045.stdout: -7001> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=116) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5777 pv6007 ap=117 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=117) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=116) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.534 INFO:teuthology.orchestra.run.smithi045.stdout: -7000> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=117) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5777 pv6007 ap=117 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=117) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=115) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.534 INFO:teuthology.orchestra.run.smithi045.stdout: -6999> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000569 [2,head] /dc-dir/dc-file_884 auth v5770 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.151288+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565a580] 2023-10-03T19:21:08.534 INFO:teuthology.orchestra.run.smithi045.stdout: -6998> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000569 [2,head] /dc-dir/dc-file_884 auth v5770 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.151288+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565a580] 2023-10-03T19:21:08.534 INFO:teuthology.orchestra.run.smithi045.stdout: -6997> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.534 INFO:teuthology.orchestra.run.smithi045.stdout: -6996> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.534 INFO:teuthology.orchestra.run.smithi045.stdout: -6995> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.534 INFO:teuthology.orchestra.run.smithi045.stdout: -6994> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000569 [2,head] /dc-dir/dc-file_884 auth v5770 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.151288+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565a580] 2023-10-03T19:21:08.534 INFO:teuthology.orchestra.run.smithi045.stdout: -6993> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000569 [2,head] /dc-dir/dc-file_884 auth v5770 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.151288+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565a580] 2023-10-03T19:21:08.535 INFO:teuthology.orchestra.run.smithi045.stdout: -6992> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.535 INFO:teuthology.orchestra.run.smithi045.stdout: -6991> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 612.671, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.13e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1228.1] 2023-10-03T19:21:08.535 INFO:teuthology.orchestra.run.smithi045.stdout: -6990> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536d9cd80 on [dir 0x1 / [2,head] auth pv=6008 v=5778 cv=5384/5384 REP dir_auth=0 ap=115+117 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 115 2023-10-03T19:21:08.535 INFO:teuthology.orchestra.run.smithi045.stdout: -6989> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536d9cd80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5777 pv6007 ap=116 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=116) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=115) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 116 2023-10-03T19:21:08.535 INFO:teuthology.orchestra.run.smithi045.stdout: -6988> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5778 cv=5384/5384 REP dir_auth=0 ap=115+116 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536d9cd80 count now 115/116 2023-10-03T19:21:08.535 INFO:teuthology.orchestra.run.smithi045.stdout: -6987> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536d9cd80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5771 cv=5377/5377 ap=116+116 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=197 | child=1 dirty=1 authpin=1 0x565534f82400] count now 116 2023-10-03T19:21:08.535 INFO:teuthology.orchestra.run.smithi045.stdout: -6986> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000569) auth_unpin by 0x565536d9cd80 on [inode 0x10000000569 [2,head] /dc-dir/dc-file_884 auth v5770 s=3 n(v0 rc2023-10-03T19:17:09.151288+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553565a580] now 0 2023-10-03T19:21:08.535 INFO:teuthology.orchestra.run.smithi045.stdout: -6985> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5771 cv=5377/5377 ap=116+115 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=197 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536d9cd80 count now 116/115 2023-10-03T19:21:08.535 INFO:teuthology.orchestra.run.smithi045.stdout: -6984> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.535 INFO:teuthology.orchestra.run.smithi045.stdout: -6983> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.608 INFO:teuthology.orchestra.run.smithi045.stdout: -6982> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000056a [2,head] /dc-dir/dc-file_885 auth v4462 pv5772 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.163626+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.163626+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553565ab00] 2023-10-03T19:21:08.608 INFO:teuthology.orchestra.run.smithi045.stdout: -6981> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5779 2023-10-03T19:21:08.608 INFO:teuthology.orchestra.run.smithi045.stdout: -6980> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5779 pv6007 ap=116 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=116) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=115) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.608 INFO:teuthology.orchestra.run.smithi045.stdout: -6979> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5777 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.608 INFO:teuthology.orchestra.run.smithi045.stdout: -6978> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5778 cv=5384/5384 REP dir_auth=0 ap=115+116 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5778 2023-10-03T19:21:08.608 INFO:teuthology.orchestra.run.smithi045.stdout: -6977> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000056a) pop_and_dirty_projected_inode v5772 2023-10-03T19:21:08.608 INFO:teuthology.orchestra.run.smithi045.stdout: -6976> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000056a) mark_dirty [inode 0x1000000056a [2,head] /dc-dir/dc-file_885 auth v5772 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.163626+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553565ab00] 2023-10-03T19:21:08.608 INFO:teuthology.orchestra.run.smithi045.stdout: -6975> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_885) mark_dirty [dentry #0x1/dc-dir/dc-file_885 [2,head] auth (dversion lock) pv=5772 v=4462 ino=0x1000000056a state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535659900] 2023-10-03T19:21:08.609 INFO:teuthology.orchestra.run.smithi045.stdout: -6974> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5771 cv=5377/5377 ap=116+115 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=198 | child=1 dirty=1 authpin=1 0x565534f82400] version 5771 2023-10-03T19:21:08.609 INFO:teuthology.orchestra.run.smithi045.stdout: -6973> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536a06140 v5780 2023-10-03T19:21:08.609 INFO:teuthology.orchestra.run.smithi045.stdout: -6972> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5780 cv=5384/5384 REP dir_auth=0 ap=115+116 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5780 2023-10-03T19:21:08.609 INFO:teuthology.orchestra.run.smithi045.stdout: -6971> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536a06020 v5773 2023-10-03T19:21:08.609 INFO:teuthology.orchestra.run.smithi045.stdout: -6970> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5773 cv=5377/5377 ap=116+115 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=198 | child=1 dirty=1 authpin=1 0x565534f82400] version 5773 2023-10-03T19:21:08.609 INFO:teuthology.orchestra.run.smithi045.stdout: -6969> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=115 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=115 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.609 INFO:teuthology.orchestra.run.smithi045.stdout: -6968> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=115) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5779 pv6007 ap=116 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=116) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=115) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.609 INFO:teuthology.orchestra.run.smithi045.stdout: -6967> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=116) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5779 pv6007 ap=116 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=116) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=114) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.609 INFO:teuthology.orchestra.run.smithi045.stdout: -6966> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000056a [2,head] /dc-dir/dc-file_885 auth v5772 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.163626+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565ab00] 2023-10-03T19:21:08.609 INFO:teuthology.orchestra.run.smithi045.stdout: -6965> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000056a [2,head] /dc-dir/dc-file_885 auth v5772 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.163626+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565ab00] 2023-10-03T19:21:08.610 INFO:teuthology.orchestra.run.smithi045.stdout: -6964> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.610 INFO:teuthology.orchestra.run.smithi045.stdout: -6963> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.610 INFO:teuthology.orchestra.run.smithi045.stdout: -6962> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.610 INFO:teuthology.orchestra.run.smithi045.stdout: -6961> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000056a [2,head] /dc-dir/dc-file_885 auth v5772 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.163626+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565ab00] 2023-10-03T19:21:08.610 INFO:teuthology.orchestra.run.smithi045.stdout: -6960> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000056a [2,head] /dc-dir/dc-file_885 auth v5772 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.163626+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565ab00] 2023-10-03T19:21:08.610 INFO:teuthology.orchestra.run.smithi045.stdout: -6959> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.610 INFO:teuthology.orchestra.run.smithi045.stdout: -6958> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 613.671, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.14e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1230.1] 2023-10-03T19:21:08.610 INFO:teuthology.orchestra.run.smithi045.stdout: -6957> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536d9d200 on [dir 0x1 / [2,head] auth pv=6008 v=5780 cv=5384/5384 REP dir_auth=0 ap=114+116 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 114 2023-10-03T19:21:08.611 INFO:teuthology.orchestra.run.smithi045.stdout: -6956> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536d9d200 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5779 pv6007 ap=115 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=115) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=114) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 115 2023-10-03T19:21:08.611 INFO:teuthology.orchestra.run.smithi045.stdout: -6955> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5780 cv=5384/5384 REP dir_auth=0 ap=114+115 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536d9d200 count now 114/115 2023-10-03T19:21:08.611 INFO:teuthology.orchestra.run.smithi045.stdout: -6954> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536d9d200 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5773 cv=5377/5377 ap=115+115 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=198 | child=1 dirty=1 authpin=1 0x565534f82400] count now 115 2023-10-03T19:21:08.611 INFO:teuthology.orchestra.run.smithi045.stdout: -6953> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000056a) auth_unpin by 0x565536d9d200 on [inode 0x1000000056a [2,head] /dc-dir/dc-file_885 auth v5772 s=3 n(v0 rc2023-10-03T19:17:09.163626+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553565ab00] now 0 2023-10-03T19:21:08.611 INFO:teuthology.orchestra.run.smithi045.stdout: -6952> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5773 cv=5377/5377 ap=115+114 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=198 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536d9d200 count now 115/114 2023-10-03T19:21:08.611 INFO:teuthology.orchestra.run.smithi045.stdout: -6951> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.611 INFO:teuthology.orchestra.run.smithi045.stdout: -6950> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.611 INFO:teuthology.orchestra.run.smithi045.stdout: -6949> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000056b [2,head] /dc-dir/dc-file_886 auth v4466 pv5774 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.176499+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.176499+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553565b080] 2023-10-03T19:21:08.611 INFO:teuthology.orchestra.run.smithi045.stdout: -6948> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5781 2023-10-03T19:21:08.612 INFO:teuthology.orchestra.run.smithi045.stdout: -6947> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5781 pv6007 ap=115 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=115) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=114) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.612 INFO:teuthology.orchestra.run.smithi045.stdout: -6946> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5779 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.612 INFO:teuthology.orchestra.run.smithi045.stdout: -6945> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5780 cv=5384/5384 REP dir_auth=0 ap=114+115 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5780 2023-10-03T19:21:08.612 INFO:teuthology.orchestra.run.smithi045.stdout: -6944> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000056b) pop_and_dirty_projected_inode v5774 2023-10-03T19:21:08.612 INFO:teuthology.orchestra.run.smithi045.stdout: -6943> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000056b) mark_dirty [inode 0x1000000056b [2,head] /dc-dir/dc-file_886 auth v5774 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.176499+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553565b080] 2023-10-03T19:21:08.612 INFO:teuthology.orchestra.run.smithi045.stdout: -6942> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_886) mark_dirty [dentry #0x1/dc-dir/dc-file_886 [2,head] auth (dversion lock) pv=5774 v=4466 ino=0x1000000056b state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535659b80] 2023-10-03T19:21:08.612 INFO:teuthology.orchestra.run.smithi045.stdout: -6941> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5773 cv=5377/5377 ap=115+114 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=199 | child=1 dirty=1 authpin=1 0x565534f82400] version 5773 2023-10-03T19:21:08.612 INFO:teuthology.orchestra.run.smithi045.stdout: -6940> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536a06380 v5782 2023-10-03T19:21:08.612 INFO:teuthology.orchestra.run.smithi045.stdout: -6939> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5782 cv=5384/5384 REP dir_auth=0 ap=114+115 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5782 2023-10-03T19:21:08.612 INFO:teuthology.orchestra.run.smithi045.stdout: -6938> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536a06260 v5775 2023-10-03T19:21:08.612 INFO:teuthology.orchestra.run.smithi045.stdout: -6937> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5775 cv=5377/5377 ap=115+114 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=199 | child=1 dirty=1 authpin=1 0x565534f82400] version 5775 2023-10-03T19:21:08.613 INFO:teuthology.orchestra.run.smithi045.stdout: -6936> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=114 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=114 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.613 INFO:teuthology.orchestra.run.smithi045.stdout: -6935> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=114) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5781 pv6007 ap=115 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=115) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=114) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.613 INFO:teuthology.orchestra.run.smithi045.stdout: -6934> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=115) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5781 pv6007 ap=115 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=115) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=113) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.613 INFO:teuthology.orchestra.run.smithi045.stdout: -6933> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000056b [2,head] /dc-dir/dc-file_886 auth v5774 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.176499+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565b080] 2023-10-03T19:21:08.613 INFO:teuthology.orchestra.run.smithi045.stdout: -6932> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000056b [2,head] /dc-dir/dc-file_886 auth v5774 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.176499+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565b080] 2023-10-03T19:21:08.613 INFO:teuthology.orchestra.run.smithi045.stdout: -6931> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.613 INFO:teuthology.orchestra.run.smithi045.stdout: -6930> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.613 INFO:teuthology.orchestra.run.smithi045.stdout: -6929> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.613 INFO:teuthology.orchestra.run.smithi045.stdout: -6928> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000056b [2,head] /dc-dir/dc-file_886 auth v5774 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.176499+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565b080] 2023-10-03T19:21:08.613 INFO:teuthology.orchestra.run.smithi045.stdout: -6927> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000056b [2,head] /dc-dir/dc-file_886 auth v5774 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.176499+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565b080] 2023-10-03T19:21:08.613 INFO:teuthology.orchestra.run.smithi045.stdout: -6926> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.614 INFO:teuthology.orchestra.run.smithi045.stdout: -6925> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 614.671, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.15e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1232.1] 2023-10-03T19:21:08.614 INFO:teuthology.orchestra.run.smithi045.stdout: -6924> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536d9d680 on [dir 0x1 / [2,head] auth pv=6008 v=5782 cv=5384/5384 REP dir_auth=0 ap=113+115 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 113 2023-10-03T19:21:08.614 INFO:teuthology.orchestra.run.smithi045.stdout: -6923> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536d9d680 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5781 pv6007 ap=114 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=114) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=113) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 114 2023-10-03T19:21:08.636 INFO:teuthology.orchestra.run.smithi045.stdout: -6922> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5782 cv=5384/5384 REP dir_auth=0 ap=113+114 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536d9d680 count now 113/114 2023-10-03T19:21:08.636 INFO:teuthology.orchestra.run.smithi045.stdout: -6921> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536d9d680 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5775 cv=5377/5377 ap=114+114 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=199 | child=1 dirty=1 authpin=1 0x565534f82400] count now 114 2023-10-03T19:21:08.636 INFO:teuthology.orchestra.run.smithi045.stdout: -6920> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000056b) auth_unpin by 0x565536d9d680 on [inode 0x1000000056b [2,head] /dc-dir/dc-file_886 auth v5774 s=3 n(v0 rc2023-10-03T19:17:09.176499+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553565b080] now 0 2023-10-03T19:21:08.636 INFO:teuthology.orchestra.run.smithi045.stdout: -6919> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5775 cv=5377/5377 ap=114+113 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=199 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536d9d680 count now 114/113 2023-10-03T19:21:08.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6918> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6917> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6916> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000056c [2,head] /dc-dir/dc-file_887 auth v4470 pv5776 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.188601+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.188601+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553565b600] 2023-10-03T19:21:08.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6915> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5783 2023-10-03T19:21:08.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6914> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5783 pv6007 ap=114 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=114) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=113) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6913> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5781 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6912> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5782 cv=5384/5384 REP dir_auth=0 ap=113+114 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5782 2023-10-03T19:21:08.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6911> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000056c) pop_and_dirty_projected_inode v5776 2023-10-03T19:21:08.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6910> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000056c) mark_dirty [inode 0x1000000056c [2,head] /dc-dir/dc-file_887 auth v5776 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.188601+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553565b600] 2023-10-03T19:21:08.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6909> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_887) mark_dirty [dentry #0x1/dc-dir/dc-file_887 [2,head] auth (dversion lock) pv=5776 v=4470 ino=0x1000000056c state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535662000] 2023-10-03T19:21:08.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6908> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5775 cv=5377/5377 ap=114+113 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=200 | child=1 dirty=1 authpin=1 0x565534f82400] version 5775 2023-10-03T19:21:08.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6907> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536a065c0 v5784 2023-10-03T19:21:08.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6906> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5784 cv=5384/5384 REP dir_auth=0 ap=113+114 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5784 2023-10-03T19:21:08.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6905> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536a064a0 v5777 2023-10-03T19:21:08.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6904> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5777 cv=5377/5377 ap=114+113 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=200 | child=1 dirty=1 authpin=1 0x565534f82400] version 5777 2023-10-03T19:21:08.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6903> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=113 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=113 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6902> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=113) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5783 pv6007 ap=114 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=114) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=113) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6901> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=114) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5783 pv6007 ap=114 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=114) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=112) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6900> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000056c [2,head] /dc-dir/dc-file_887 auth v5776 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.188601+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565b600] 2023-10-03T19:21:08.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6899> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000056c [2,head] /dc-dir/dc-file_887 auth v5776 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.188601+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565b600] 2023-10-03T19:21:08.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6898> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6897> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6896> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6895> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000056c [2,head] /dc-dir/dc-file_887 auth v5776 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.188601+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565b600] 2023-10-03T19:21:08.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6894> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000056c [2,head] /dc-dir/dc-file_887 auth v5776 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.188601+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565b600] 2023-10-03T19:21:08.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6893> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6892> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 615.671, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.16e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1234.1] 2023-10-03T19:21:08.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6891> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536d9db00 on [dir 0x1 / [2,head] auth pv=6008 v=5784 cv=5384/5384 REP dir_auth=0 ap=112+114 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 112 2023-10-03T19:21:08.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6890> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536d9db00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5783 pv6007 ap=113 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=113) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=112) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 113 2023-10-03T19:21:08.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6889> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5784 cv=5384/5384 REP dir_auth=0 ap=112+113 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536d9db00 count now 112/113 2023-10-03T19:21:08.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6888> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536d9db00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5777 cv=5377/5377 ap=113+113 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=200 | child=1 dirty=1 authpin=1 0x565534f82400] count now 113 2023-10-03T19:21:08.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6887> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000056c) auth_unpin by 0x565536d9db00 on [inode 0x1000000056c [2,head] /dc-dir/dc-file_887 auth v5776 s=3 n(v0 rc2023-10-03T19:17:09.188601+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553565b600] now 0 2023-10-03T19:21:08.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6886> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5777 cv=5377/5377 ap=113+112 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=200 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536d9db00 count now 113/112 2023-10-03T19:21:08.640 INFO:teuthology.orchestra.run.smithi045.stdout: -6885> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.640 INFO:teuthology.orchestra.run.smithi045.stdout: -6884> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.640 INFO:teuthology.orchestra.run.smithi045.stdout: -6883> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000056d [2,head] /dc-dir/dc-file_888 auth v4474 pv5778 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.200771+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.200771+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553565bb80] 2023-10-03T19:21:08.640 INFO:teuthology.orchestra.run.smithi045.stdout: -6882> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5785 2023-10-03T19:21:08.640 INFO:teuthology.orchestra.run.smithi045.stdout: -6881> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5785 pv6007 ap=113 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=113) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=112) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.640 INFO:teuthology.orchestra.run.smithi045.stdout: -6880> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5783 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.640 INFO:teuthology.orchestra.run.smithi045.stdout: -6879> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5784 cv=5384/5384 REP dir_auth=0 ap=112+113 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5784 2023-10-03T19:21:08.640 INFO:teuthology.orchestra.run.smithi045.stdout: -6878> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000056d) pop_and_dirty_projected_inode v5778 2023-10-03T19:21:08.640 INFO:teuthology.orchestra.run.smithi045.stdout: -6877> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000056d) mark_dirty [inode 0x1000000056d [2,head] /dc-dir/dc-file_888 auth v5778 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.200771+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553565bb80] 2023-10-03T19:21:08.641 INFO:teuthology.orchestra.run.smithi045.stdout: -6876> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_888) mark_dirty [dentry #0x1/dc-dir/dc-file_888 [2,head] auth (dversion lock) pv=5778 v=4474 ino=0x1000000056d state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535662280] 2023-10-03T19:21:08.641 INFO:teuthology.orchestra.run.smithi045.stdout: -6875> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5777 cv=5377/5377 ap=113+112 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=201 | child=1 dirty=1 authpin=1 0x565534f82400] version 5777 2023-10-03T19:21:08.641 INFO:teuthology.orchestra.run.smithi045.stdout: -6874> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536a06800 v5786 2023-10-03T19:21:08.641 INFO:teuthology.orchestra.run.smithi045.stdout: -6873> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5786 cv=5384/5384 REP dir_auth=0 ap=112+113 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5786 2023-10-03T19:21:08.641 INFO:teuthology.orchestra.run.smithi045.stdout: -6872> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536a066e0 v5779 2023-10-03T19:21:08.641 INFO:teuthology.orchestra.run.smithi045.stdout: -6871> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5779 cv=5377/5377 ap=113+112 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=201 | child=1 dirty=1 authpin=1 0x565534f82400] version 5779 2023-10-03T19:21:08.641 INFO:teuthology.orchestra.run.smithi045.stdout: -6870> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=112 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=112 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.641 INFO:teuthology.orchestra.run.smithi045.stdout: -6869> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=112) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5785 pv6007 ap=113 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=113) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=112) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.641 INFO:teuthology.orchestra.run.smithi045.stdout: -6868> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=113) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5785 pv6007 ap=113 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=113) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=111) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.641 INFO:teuthology.orchestra.run.smithi045.stdout: -6867> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000056d [2,head] /dc-dir/dc-file_888 auth v5778 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.200771+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565bb80] 2023-10-03T19:21:08.641 INFO:teuthology.orchestra.run.smithi045.stdout: -6866> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000056d [2,head] /dc-dir/dc-file_888 auth v5778 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.200771+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565bb80] 2023-10-03T19:21:08.642 INFO:teuthology.orchestra.run.smithi045.stdout: -6865> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.642 INFO:teuthology.orchestra.run.smithi045.stdout: -6864> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.642 INFO:teuthology.orchestra.run.smithi045.stdout: -6863> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.642 INFO:teuthology.orchestra.run.smithi045.stdout: -6862> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000056d [2,head] /dc-dir/dc-file_888 auth v5778 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.200771+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565bb80] 2023-10-03T19:21:08.642 INFO:teuthology.orchestra.run.smithi045.stdout: -6861> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000056d [2,head] /dc-dir/dc-file_888 auth v5778 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.200771+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565bb80] 2023-10-03T19:21:08.642 INFO:teuthology.orchestra.run.smithi045.stdout: -6860> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.642 INFO:teuthology.orchestra.run.smithi045.stdout: -6859> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 616.671, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.17e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1236.1] 2023-10-03T19:21:08.642 INFO:teuthology.orchestra.run.smithi045.stdout: -6858> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536d9cfc0 on [dir 0x1 / [2,head] auth pv=6008 v=5786 cv=5384/5384 REP dir_auth=0 ap=111+113 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 111 2023-10-03T19:21:08.685 INFO:teuthology.orchestra.run.smithi045.stdout: -6857> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536d9cfc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5785 pv6007 ap=112 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=112) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=111) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 112 2023-10-03T19:21:08.685 INFO:teuthology.orchestra.run.smithi045.stdout: -6856> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5786 cv=5384/5384 REP dir_auth=0 ap=111+112 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536d9cfc0 count now 111/112 2023-10-03T19:21:08.685 INFO:teuthology.orchestra.run.smithi045.stdout: -6855> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536d9cfc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5779 cv=5377/5377 ap=112+112 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=201 | child=1 dirty=1 authpin=1 0x565534f82400] count now 112 2023-10-03T19:21:08.685 INFO:teuthology.orchestra.run.smithi045.stdout: -6854> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000056d) auth_unpin by 0x565536d9cfc0 on [inode 0x1000000056d [2,head] /dc-dir/dc-file_888 auth v5778 s=3 n(v0 rc2023-10-03T19:17:09.200771+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553565bb80] now 0 2023-10-03T19:21:08.685 INFO:teuthology.orchestra.run.smithi045.stdout: -6853> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5779 cv=5377/5377 ap=112+111 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=201 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536d9cfc0 count now 112/111 2023-10-03T19:21:08.685 INFO:teuthology.orchestra.run.smithi045.stdout: -6852> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.685 INFO:teuthology.orchestra.run.smithi045.stdout: -6851> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.685 INFO:teuthology.orchestra.run.smithi045.stdout: -6850> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000056e [2,head] /dc-dir/dc-file_889 auth v4478 pv5780 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.213369+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.213369+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553565c100] 2023-10-03T19:21:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: -6849> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5787 2023-10-03T19:21:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: -6848> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5787 pv6007 ap=112 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=112) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=111) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: -6847> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5785 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: -6846> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5786 cv=5384/5384 REP dir_auth=0 ap=111+112 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5786 2023-10-03T19:21:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: -6845> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000056e) pop_and_dirty_projected_inode v5780 2023-10-03T19:21:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: -6844> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000056e) mark_dirty [inode 0x1000000056e [2,head] /dc-dir/dc-file_889 auth v5780 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.213369+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553565c100] 2023-10-03T19:21:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: -6843> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_889) mark_dirty [dentry #0x1/dc-dir/dc-file_889 [2,head] auth (dversion lock) pv=5780 v=4478 ino=0x1000000056e state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535662500] 2023-10-03T19:21:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: -6842> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5779 cv=5377/5377 ap=112+111 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=202 | child=1 dirty=1 authpin=1 0x565534f82400] version 5779 2023-10-03T19:21:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: -6841> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536a06a40 v5788 2023-10-03T19:21:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: -6840> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5788 cv=5384/5384 REP dir_auth=0 ap=111+112 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5788 2023-10-03T19:21:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: -6839> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536a06920 v5781 2023-10-03T19:21:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: -6838> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5781 cv=5377/5377 ap=112+111 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=202 | child=1 dirty=1 authpin=1 0x565534f82400] version 5781 2023-10-03T19:21:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: -6837> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=111 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=111 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: -6836> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=111) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5787 pv6007 ap=112 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=112) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=111) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: -6835> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=112) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5787 pv6007 ap=112 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=112) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=110) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: -6834> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000056e [2,head] /dc-dir/dc-file_889 auth v5780 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.213369+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565c100] 2023-10-03T19:21:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: -6833> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000056e [2,head] /dc-dir/dc-file_889 auth v5780 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.213369+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565c100] 2023-10-03T19:21:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: -6832> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: -6831> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: -6830> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: -6829> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000056e [2,head] /dc-dir/dc-file_889 auth v5780 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.213369+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565c100] 2023-10-03T19:21:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: -6828> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000056e [2,head] /dc-dir/dc-file_889 auth v5780 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.213369+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565c100] 2023-10-03T19:21:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: -6827> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: -6826> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 617.671, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.18e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1238.1] 2023-10-03T19:21:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: -6825> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536d9c6c0 on [dir 0x1 / [2,head] auth pv=6008 v=5788 cv=5384/5384 REP dir_auth=0 ap=110+112 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 110 2023-10-03T19:21:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: -6824> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536d9c6c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5787 pv6007 ap=111 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=111) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=110) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 111 2023-10-03T19:21:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: -6823> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5788 cv=5384/5384 REP dir_auth=0 ap=110+111 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536d9c6c0 count now 110/111 2023-10-03T19:21:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: -6822> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536d9c6c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5781 cv=5377/5377 ap=111+111 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=202 | child=1 dirty=1 authpin=1 0x565534f82400] count now 111 2023-10-03T19:21:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: -6821> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000056e) auth_unpin by 0x565536d9c6c0 on [inode 0x1000000056e [2,head] /dc-dir/dc-file_889 auth v5780 s=3 n(v0 rc2023-10-03T19:17:09.213369+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553565c100] now 0 2023-10-03T19:21:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: -6820> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5781 cv=5377/5377 ap=111+110 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=202 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536d9c6c0 count now 111/110 2023-10-03T19:21:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: -6819> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: -6818> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: -6817> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000056f [2,head] /dc-dir/dc-file_890 auth v4482 pv5782 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.225167+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.225167+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553565c680] 2023-10-03T19:21:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: -6816> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5789 2023-10-03T19:21:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: -6815> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5789 pv6007 ap=111 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=111) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=110) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: -6814> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5787 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: -6813> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5788 cv=5384/5384 REP dir_auth=0 ap=110+111 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5788 2023-10-03T19:21:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: -6812> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000056f) pop_and_dirty_projected_inode v5782 2023-10-03T19:21:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: -6811> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000056f) mark_dirty [inode 0x1000000056f [2,head] /dc-dir/dc-file_890 auth v5782 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.225167+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553565c680] 2023-10-03T19:21:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: -6810> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_890) mark_dirty [dentry #0x1/dc-dir/dc-file_890 [2,head] auth (dversion lock) pv=5782 v=4482 ino=0x1000000056f state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535662780] 2023-10-03T19:21:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: -6809> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5781 cv=5377/5377 ap=111+110 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=203 | child=1 dirty=1 authpin=1 0x565534f82400] version 5781 2023-10-03T19:21:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: -6808> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536a06c80 v5790 2023-10-03T19:21:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: -6807> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5790 cv=5384/5384 REP dir_auth=0 ap=110+111 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5790 2023-10-03T19:21:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: -6806> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536a06b60 v5783 2023-10-03T19:21:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: -6805> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5783 cv=5377/5377 ap=111+110 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=203 | child=1 dirty=1 authpin=1 0x565534f82400] version 5783 2023-10-03T19:21:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: -6804> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=110 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=110 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: -6803> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=110) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5789 pv6007 ap=111 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=111) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=110) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: -6802> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=111) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5789 pv6007 ap=111 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=111) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=109) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: -6801> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000056f [2,head] /dc-dir/dc-file_890 auth v5782 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.225167+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565c680] 2023-10-03T19:21:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: -6800> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000056f [2,head] /dc-dir/dc-file_890 auth v5782 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.225167+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565c680] 2023-10-03T19:21:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: -6799> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: -6798> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: -6797> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: -6796> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000056f [2,head] /dc-dir/dc-file_890 auth v5782 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.225167+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565c680] 2023-10-03T19:21:08.691 INFO:teuthology.orchestra.run.smithi045.stdout: -6795> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000056f [2,head] /dc-dir/dc-file_890 auth v5782 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.225167+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565c680] 2023-10-03T19:21:08.730 INFO:teuthology.orchestra.run.smithi045.stdout: -6794> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.730 INFO:teuthology.orchestra.run.smithi045.stdout: -6793> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 618.671, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.19e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1240.1] 2023-10-03T19:21:08.731 INFO:teuthology.orchestra.run.smithi045.stdout: -6792> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655356b7d40 on [dir 0x1 / [2,head] auth pv=6008 v=5790 cv=5384/5384 REP dir_auth=0 ap=109+111 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 109 2023-10-03T19:21:08.731 INFO:teuthology.orchestra.run.smithi045.stdout: -6791> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655356b7d40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5789 pv6007 ap=110 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=110) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=109) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 110 2023-10-03T19:21:08.731 INFO:teuthology.orchestra.run.smithi045.stdout: -6790> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5790 cv=5384/5384 REP dir_auth=0 ap=109+110 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655356b7d40 count now 109/110 2023-10-03T19:21:08.731 INFO:teuthology.orchestra.run.smithi045.stdout: -6789> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655356b7d40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5783 cv=5377/5377 ap=110+110 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=203 | child=1 dirty=1 authpin=1 0x565534f82400] count now 110 2023-10-03T19:21:08.731 INFO:teuthology.orchestra.run.smithi045.stdout: -6788> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000056f) auth_unpin by 0x5655356b7d40 on [inode 0x1000000056f [2,head] /dc-dir/dc-file_890 auth v5782 s=3 n(v0 rc2023-10-03T19:17:09.225167+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553565c680] now 0 2023-10-03T19:21:08.731 INFO:teuthology.orchestra.run.smithi045.stdout: -6787> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5783 cv=5377/5377 ap=110+109 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=203 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655356b7d40 count now 110/109 2023-10-03T19:21:08.732 INFO:teuthology.orchestra.run.smithi045.stdout: -6786> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.732 INFO:teuthology.orchestra.run.smithi045.stdout: -6785> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.732 INFO:teuthology.orchestra.run.smithi045.stdout: -6784> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000570 [2,head] /dc-dir/dc-file_891 auth v4486 pv5784 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.236008+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.236008+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553565cc00] 2023-10-03T19:21:08.732 INFO:teuthology.orchestra.run.smithi045.stdout: -6783> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5791 2023-10-03T19:21:08.733 INFO:teuthology.orchestra.run.smithi045.stdout: -6782> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5791 pv6007 ap=110 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=110) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=109) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.733 INFO:teuthology.orchestra.run.smithi045.stdout: -6781> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5789 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.733 INFO:teuthology.orchestra.run.smithi045.stdout: -6780> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5790 cv=5384/5384 REP dir_auth=0 ap=109+110 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5790 2023-10-03T19:21:08.733 INFO:teuthology.orchestra.run.smithi045.stdout: -6779> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000570) pop_and_dirty_projected_inode v5784 2023-10-03T19:21:08.733 INFO:teuthology.orchestra.run.smithi045.stdout: -6778> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000570) mark_dirty [inode 0x10000000570 [2,head] /dc-dir/dc-file_891 auth v5784 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.236008+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553565cc00] 2023-10-03T19:21:08.733 INFO:teuthology.orchestra.run.smithi045.stdout: -6777> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_891) mark_dirty [dentry #0x1/dc-dir/dc-file_891 [2,head] auth (dversion lock) pv=5784 v=4486 ino=0x10000000570 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535662a00] 2023-10-03T19:21:08.733 INFO:teuthology.orchestra.run.smithi045.stdout: -6776> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5783 cv=5377/5377 ap=110+109 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=204 | child=1 dirty=1 authpin=1 0x565534f82400] version 5783 2023-10-03T19:21:08.733 INFO:teuthology.orchestra.run.smithi045.stdout: -6775> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536a06ec0 v5792 2023-10-03T19:21:08.734 INFO:teuthology.orchestra.run.smithi045.stdout: -6774> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5792 cv=5384/5384 REP dir_auth=0 ap=109+110 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5792 2023-10-03T19:21:08.734 INFO:teuthology.orchestra.run.smithi045.stdout: -6773> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536a06da0 v5785 2023-10-03T19:21:08.734 INFO:teuthology.orchestra.run.smithi045.stdout: -6772> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5785 cv=5377/5377 ap=110+109 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=204 | child=1 dirty=1 authpin=1 0x565534f82400] version 5785 2023-10-03T19:21:08.734 INFO:teuthology.orchestra.run.smithi045.stdout: -6771> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=109 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=109 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.734 INFO:teuthology.orchestra.run.smithi045.stdout: -6770> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=109) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5791 pv6007 ap=110 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=110) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=109) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.734 INFO:teuthology.orchestra.run.smithi045.stdout: -6769> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=110) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5791 pv6007 ap=110 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=110) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=108) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.734 INFO:teuthology.orchestra.run.smithi045.stdout: -6768> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000570 [2,head] /dc-dir/dc-file_891 auth v5784 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.236008+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565cc00] 2023-10-03T19:21:08.734 INFO:teuthology.orchestra.run.smithi045.stdout: -6767> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000570 [2,head] /dc-dir/dc-file_891 auth v5784 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.236008+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565cc00] 2023-10-03T19:21:08.734 INFO:teuthology.orchestra.run.smithi045.stdout: -6766> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.734 INFO:teuthology.orchestra.run.smithi045.stdout: -6765> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.735 INFO:teuthology.orchestra.run.smithi045.stdout: -6764> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.735 INFO:teuthology.orchestra.run.smithi045.stdout: -6763> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000570 [2,head] /dc-dir/dc-file_891 auth v5784 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.236008+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565cc00] 2023-10-03T19:21:08.735 INFO:teuthology.orchestra.run.smithi045.stdout: -6762> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000570 [2,head] /dc-dir/dc-file_891 auth v5784 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.236008+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565cc00] 2023-10-03T19:21:08.735 INFO:teuthology.orchestra.run.smithi045.stdout: -6761> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.735 INFO:teuthology.orchestra.run.smithi045.stdout: -6760> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 619.671, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.20e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1242.1] 2023-10-03T19:21:08.735 INFO:teuthology.orchestra.run.smithi045.stdout: -6759> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655356b7440 on [dir 0x1 / [2,head] auth pv=6008 v=5792 cv=5384/5384 REP dir_auth=0 ap=108+110 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 108 2023-10-03T19:21:08.735 INFO:teuthology.orchestra.run.smithi045.stdout: -6758> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655356b7440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5791 pv6007 ap=109 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=109) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=108) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 109 2023-10-03T19:21:08.735 INFO:teuthology.orchestra.run.smithi045.stdout: -6757> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5792 cv=5384/5384 REP dir_auth=0 ap=108+109 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655356b7440 count now 108/109 2023-10-03T19:21:08.735 INFO:teuthology.orchestra.run.smithi045.stdout: -6756> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655356b7440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5785 cv=5377/5377 ap=109+109 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=204 | child=1 dirty=1 authpin=1 0x565534f82400] count now 109 2023-10-03T19:21:08.735 INFO:teuthology.orchestra.run.smithi045.stdout: -6755> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000570) auth_unpin by 0x5655356b7440 on [inode 0x10000000570 [2,head] /dc-dir/dc-file_891 auth v5784 s=3 n(v0 rc2023-10-03T19:17:09.236008+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553565cc00] now 0 2023-10-03T19:21:08.735 INFO:teuthology.orchestra.run.smithi045.stdout: -6754> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5785 cv=5377/5377 ap=109+108 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=204 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655356b7440 count now 109/108 2023-10-03T19:21:08.735 INFO:teuthology.orchestra.run.smithi045.stdout: -6753> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.736 INFO:teuthology.orchestra.run.smithi045.stdout: -6752> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.736 INFO:teuthology.orchestra.run.smithi045.stdout: -6751> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000571 [2,head] /dc-dir/dc-file_892 auth v4490 pv5786 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.247321+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.247321+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553565d180] 2023-10-03T19:21:08.736 INFO:teuthology.orchestra.run.smithi045.stdout: -6750> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5793 2023-10-03T19:21:08.736 INFO:teuthology.orchestra.run.smithi045.stdout: -6749> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5793 pv6007 ap=109 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=109) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=108) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.736 INFO:teuthology.orchestra.run.smithi045.stdout: -6748> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5791 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.736 INFO:teuthology.orchestra.run.smithi045.stdout: -6747> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5792 cv=5384/5384 REP dir_auth=0 ap=108+109 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5792 2023-10-03T19:21:08.736 INFO:teuthology.orchestra.run.smithi045.stdout: -6746> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000571) pop_and_dirty_projected_inode v5786 2023-10-03T19:21:08.736 INFO:teuthology.orchestra.run.smithi045.stdout: -6745> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000571) mark_dirty [inode 0x10000000571 [2,head] /dc-dir/dc-file_892 auth v5786 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.247321+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553565d180] 2023-10-03T19:21:08.736 INFO:teuthology.orchestra.run.smithi045.stdout: -6744> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_892) mark_dirty [dentry #0x1/dc-dir/dc-file_892 [2,head] auth (dversion lock) pv=5786 v=4490 ino=0x10000000571 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535662c80] 2023-10-03T19:21:08.736 INFO:teuthology.orchestra.run.smithi045.stdout: -6743> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5785 cv=5377/5377 ap=109+108 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=205 | child=1 dirty=1 authpin=1 0x565534f82400] version 5785 2023-10-03T19:21:08.736 INFO:teuthology.orchestra.run.smithi045.stdout: -6742> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536a07100 v5794 2023-10-03T19:21:08.737 INFO:teuthology.orchestra.run.smithi045.stdout: -6741> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5794 cv=5384/5384 REP dir_auth=0 ap=108+109 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5794 2023-10-03T19:21:08.737 INFO:teuthology.orchestra.run.smithi045.stdout: -6740> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536a06fe0 v5787 2023-10-03T19:21:08.737 INFO:teuthology.orchestra.run.smithi045.stdout: -6739> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5787 cv=5377/5377 ap=109+108 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=205 | child=1 dirty=1 authpin=1 0x565534f82400] version 5787 2023-10-03T19:21:08.737 INFO:teuthology.orchestra.run.smithi045.stdout: -6738> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=108 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=108 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.737 INFO:teuthology.orchestra.run.smithi045.stdout: -6737> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=108) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5793 pv6007 ap=109 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=109) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=108) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.737 INFO:teuthology.orchestra.run.smithi045.stdout: -6736> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=109) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5793 pv6007 ap=109 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=109) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=107) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.737 INFO:teuthology.orchestra.run.smithi045.stdout: -6735> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000571 [2,head] /dc-dir/dc-file_892 auth v5786 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.247321+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565d180] 2023-10-03T19:21:08.737 INFO:teuthology.orchestra.run.smithi045.stdout: -6734> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000571 [2,head] /dc-dir/dc-file_892 auth v5786 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.247321+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565d180] 2023-10-03T19:21:08.737 INFO:teuthology.orchestra.run.smithi045.stdout: -6733> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.737 INFO:teuthology.orchestra.run.smithi045.stdout: -6732> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.737 INFO:teuthology.orchestra.run.smithi045.stdout: -6731> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.738 INFO:teuthology.orchestra.run.smithi045.stdout: -6730> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000571 [2,head] /dc-dir/dc-file_892 auth v5786 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.247321+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565d180] 2023-10-03T19:21:08.738 INFO:teuthology.orchestra.run.smithi045.stdout: -6729> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000571 [2,head] /dc-dir/dc-file_892 auth v5786 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.247321+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565d180] 2023-10-03T19:21:08.738 INFO:teuthology.orchestra.run.smithi045.stdout: -6728> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.738 INFO:teuthology.orchestra.run.smithi045.stdout: -6727> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 620.671, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.21e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1244.1] 2023-10-03T19:21:08.788 INFO:teuthology.orchestra.run.smithi045.stdout: -6726> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655356b6b40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5793 pv6007 ap=108 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=108) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=107) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 108 2023-10-03T19:21:08.788 INFO:teuthology.orchestra.run.smithi045.stdout: -6725> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5794 cv=5384/5384 REP dir_auth=0 ap=108+108 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655356b6b40 count now 108/108 2023-10-03T19:21:08.788 INFO:teuthology.orchestra.run.smithi045.stdout: -6724> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655356b6b40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5787 cv=5377/5377 ap=108+108 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=205 | child=1 dirty=1 authpin=1 0x565534f82400] count now 108 2023-10-03T19:21:08.788 INFO:teuthology.orchestra.run.smithi045.stdout: -6723> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655356b6b40 on [dir 0x1 / [2,head] auth pv=6008 v=5794 cv=5384/5384 REP dir_auth=0 ap=107+108 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 107 2023-10-03T19:21:08.788 INFO:teuthology.orchestra.run.smithi045.stdout: -6722> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000571) auth_unpin by 0x5655356b6b40 on [inode 0x10000000571 [2,head] /dc-dir/dc-file_892 auth v5786 s=3 n(v0 rc2023-10-03T19:17:09.247321+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553565d180] now 0 2023-10-03T19:21:08.788 INFO:teuthology.orchestra.run.smithi045.stdout: -6721> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5787 cv=5377/5377 ap=108+107 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=205 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655356b6b40 count now 108/107 2023-10-03T19:21:08.788 INFO:teuthology.orchestra.run.smithi045.stdout: -6720> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.788 INFO:teuthology.orchestra.run.smithi045.stdout: -6719> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6718> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000572 [2,head] /dc-dir/dc-file_893 auth v4494 pv5788 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.258402+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.258402+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553565d700] 2023-10-03T19:21:08.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6717> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5795 2023-10-03T19:21:08.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6716> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5795 pv6007 ap=108 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=108) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=107) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6715> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5793 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6714> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5794 cv=5384/5384 REP dir_auth=0 ap=107+108 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5794 2023-10-03T19:21:08.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6713> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000572) pop_and_dirty_projected_inode v5788 2023-10-03T19:21:08.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6712> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000572) mark_dirty [inode 0x10000000572 [2,head] /dc-dir/dc-file_893 auth v5788 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.258402+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553565d700] 2023-10-03T19:21:08.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6711> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_893) mark_dirty [dentry #0x1/dc-dir/dc-file_893 [2,head] auth (dversion lock) pv=5788 v=4494 ino=0x10000000572 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535662f00] 2023-10-03T19:21:08.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6710> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5787 cv=5377/5377 ap=108+107 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=206 | child=1 dirty=1 authpin=1 0x565534f82400] version 5787 2023-10-03T19:21:08.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6709> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536a07340 v5796 2023-10-03T19:21:08.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6708> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5796 cv=5384/5384 REP dir_auth=0 ap=107+108 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5796 2023-10-03T19:21:08.790 INFO:teuthology.orchestra.run.smithi045.stdout: -6707> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536a07220 v5789 2023-10-03T19:21:08.790 INFO:teuthology.orchestra.run.smithi045.stdout: -6706> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5789 cv=5377/5377 ap=108+107 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=206 | child=1 dirty=1 authpin=1 0x565534f82400] version 5789 2023-10-03T19:21:08.790 INFO:teuthology.orchestra.run.smithi045.stdout: -6705> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=107 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=107 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.790 INFO:teuthology.orchestra.run.smithi045.stdout: -6704> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=107) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5795 pv6007 ap=108 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=108) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=107) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.790 INFO:teuthology.orchestra.run.smithi045.stdout: -6703> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=108) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5795 pv6007 ap=108 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=108) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=106) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.790 INFO:teuthology.orchestra.run.smithi045.stdout: -6702> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000572 [2,head] /dc-dir/dc-file_893 auth v5788 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.258402+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565d700] 2023-10-03T19:21:08.790 INFO:teuthology.orchestra.run.smithi045.stdout: -6701> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000572 [2,head] /dc-dir/dc-file_893 auth v5788 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.258402+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565d700] 2023-10-03T19:21:08.790 INFO:teuthology.orchestra.run.smithi045.stdout: -6700> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.790 INFO:teuthology.orchestra.run.smithi045.stdout: -6699> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.790 INFO:teuthology.orchestra.run.smithi045.stdout: -6698> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.791 INFO:teuthology.orchestra.run.smithi045.stdout: -6697> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000572 [2,head] /dc-dir/dc-file_893 auth v5788 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.258402+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565d700] 2023-10-03T19:21:08.791 INFO:teuthology.orchestra.run.smithi045.stdout: -6696> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000572 [2,head] /dc-dir/dc-file_893 auth v5788 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.258402+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553565d700] 2023-10-03T19:21:08.791 INFO:teuthology.orchestra.run.smithi045.stdout: -6695> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.791 INFO:teuthology.orchestra.run.smithi045.stdout: -6694> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 621.671, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.22e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1246.1] 2023-10-03T19:21:08.791 INFO:teuthology.orchestra.run.smithi045.stdout: -6693> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655356b6240 on [dir 0x1 / [2,head] auth pv=6008 v=5796 cv=5384/5384 REP dir_auth=0 ap=106+108 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 106 2023-10-03T19:21:08.791 INFO:teuthology.orchestra.run.smithi045.stdout: -6692> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655356b6240 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5795 pv6007 ap=107 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=107) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=106) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 107 2023-10-03T19:21:08.791 INFO:teuthology.orchestra.run.smithi045.stdout: -6691> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5796 cv=5384/5384 REP dir_auth=0 ap=106+107 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655356b6240 count now 106/107 2023-10-03T19:21:08.791 INFO:teuthology.orchestra.run.smithi045.stdout: -6690> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655356b6240 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5789 cv=5377/5377 ap=107+107 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=206 | child=1 dirty=1 authpin=1 0x565534f82400] count now 107 2023-10-03T19:21:08.791 INFO:teuthology.orchestra.run.smithi045.stdout: -6689> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000572) auth_unpin by 0x5655356b6240 on [inode 0x10000000572 [2,head] /dc-dir/dc-file_893 auth v5788 s=3 n(v0 rc2023-10-03T19:17:09.258402+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553565d700] now 0 2023-10-03T19:21:08.791 INFO:teuthology.orchestra.run.smithi045.stdout: -6688> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5789 cv=5377/5377 ap=107+106 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=206 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655356b6240 count now 107/106 2023-10-03T19:21:08.791 INFO:teuthology.orchestra.run.smithi045.stdout: -6687> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.791 INFO:teuthology.orchestra.run.smithi045.stdout: -6686> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.792 INFO:teuthology.orchestra.run.smithi045.stdout: -6685> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000573 [2,head] /dc-dir/dc-file_894 auth v4498 pv5790 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.270588+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.270588+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535664000] 2023-10-03T19:21:08.792 INFO:teuthology.orchestra.run.smithi045.stdout: -6684> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5797 2023-10-03T19:21:08.792 INFO:teuthology.orchestra.run.smithi045.stdout: -6683> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5797 pv6007 ap=107 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=107) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=106) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.792 INFO:teuthology.orchestra.run.smithi045.stdout: -6682> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5795 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.792 INFO:teuthology.orchestra.run.smithi045.stdout: -6681> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5796 cv=5384/5384 REP dir_auth=0 ap=106+107 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5796 2023-10-03T19:21:08.792 INFO:teuthology.orchestra.run.smithi045.stdout: -6680> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000573) pop_and_dirty_projected_inode v5790 2023-10-03T19:21:08.792 INFO:teuthology.orchestra.run.smithi045.stdout: -6679> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000573) mark_dirty [inode 0x10000000573 [2,head] /dc-dir/dc-file_894 auth v5790 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.270588+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535664000] 2023-10-03T19:21:08.792 INFO:teuthology.orchestra.run.smithi045.stdout: -6678> 2023-10-03T19:17:19.530+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_894) mark_dirty [dentry #0x1/dc-dir/dc-file_894 [2,head] auth (dversion lock) pv=5790 v=4498 ino=0x10000000573 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535663180] 2023-10-03T19:21:08.792 INFO:teuthology.orchestra.run.smithi045.stdout: -6677> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5789 cv=5377/5377 ap=107+106 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=207 | child=1 dirty=1 authpin=1 0x565534f82400] version 5789 2023-10-03T19:21:08.792 INFO:teuthology.orchestra.run.smithi045.stdout: -6676> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536a07580 v5798 2023-10-03T19:21:08.793 INFO:teuthology.orchestra.run.smithi045.stdout: -6675> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5798 cv=5384/5384 REP dir_auth=0 ap=106+107 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5798 2023-10-03T19:21:08.793 INFO:teuthology.orchestra.run.smithi045.stdout: -6674> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536a07460 v5791 2023-10-03T19:21:08.793 INFO:teuthology.orchestra.run.smithi045.stdout: -6673> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5791 cv=5377/5377 ap=107+106 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=207 | child=1 dirty=1 authpin=1 0x565534f82400] version 5791 2023-10-03T19:21:08.793 INFO:teuthology.orchestra.run.smithi045.stdout: -6672> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=106 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=106 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.793 INFO:teuthology.orchestra.run.smithi045.stdout: -6671> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=106) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5797 pv6007 ap=107 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=107) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=106) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.793 INFO:teuthology.orchestra.run.smithi045.stdout: -6670> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=107) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5797 pv6007 ap=107 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=107) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=105) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.793 INFO:teuthology.orchestra.run.smithi045.stdout: -6669> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000573 [2,head] /dc-dir/dc-file_894 auth v5790 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.270588+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535664000] 2023-10-03T19:21:08.844 INFO:teuthology.orchestra.run.smithi045.stdout: -6668> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000573 [2,head] /dc-dir/dc-file_894 auth v5790 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.270588+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535664000] 2023-10-03T19:21:08.844 INFO:teuthology.orchestra.run.smithi045.stdout: -6667> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.844 INFO:teuthology.orchestra.run.smithi045.stdout: -6666> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.844 INFO:teuthology.orchestra.run.smithi045.stdout: -6665> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.844 INFO:teuthology.orchestra.run.smithi045.stdout: -6664> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000573 [2,head] /dc-dir/dc-file_894 auth v5790 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.270588+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535664000] 2023-10-03T19:21:08.844 INFO:teuthology.orchestra.run.smithi045.stdout: -6663> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000573 [2,head] /dc-dir/dc-file_894 auth v5790 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.270588+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535664000] 2023-10-03T19:21:08.845 INFO:teuthology.orchestra.run.smithi045.stdout: -6662> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.845 INFO:teuthology.orchestra.run.smithi045.stdout: -6661> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 622.327, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.22e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1247.5] 2023-10-03T19:21:08.845 INFO:teuthology.orchestra.run.smithi045.stdout: -6660> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536386b40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5797 pv6007 ap=106 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=106) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=105) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 106 2023-10-03T19:21:08.845 INFO:teuthology.orchestra.run.smithi045.stdout: -6659> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5798 cv=5384/5384 REP dir_auth=0 ap=106+106 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536386b40 count now 106/106 2023-10-03T19:21:08.845 INFO:teuthology.orchestra.run.smithi045.stdout: -6658> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536386b40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5791 cv=5377/5377 ap=106+106 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=207 | child=1 dirty=1 authpin=1 0x565534f82400] count now 106 2023-10-03T19:21:08.845 INFO:teuthology.orchestra.run.smithi045.stdout: -6657> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536386b40 on [dir 0x1 / [2,head] auth pv=6008 v=5798 cv=5384/5384 REP dir_auth=0 ap=105+106 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 105 2023-10-03T19:21:08.845 INFO:teuthology.orchestra.run.smithi045.stdout: -6656> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000573) auth_unpin by 0x565536386b40 on [inode 0x10000000573 [2,head] /dc-dir/dc-file_894 auth v5790 s=3 n(v0 rc2023-10-03T19:17:09.270588+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535664000] now 0 2023-10-03T19:21:08.845 INFO:teuthology.orchestra.run.smithi045.stdout: -6655> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5791 cv=5377/5377 ap=106+105 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=207 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536386b40 count now 106/105 2023-10-03T19:21:08.845 INFO:teuthology.orchestra.run.smithi045.stdout: -6654> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.845 INFO:teuthology.orchestra.run.smithi045.stdout: -6653> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.846 INFO:teuthology.orchestra.run.smithi045.stdout: -6652> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000574 [2,head] /dc-dir/dc-file_895 auth v4502 pv5792 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.284343+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.284343+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535664580] 2023-10-03T19:21:08.846 INFO:teuthology.orchestra.run.smithi045.stdout: -6651> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5799 2023-10-03T19:21:08.846 INFO:teuthology.orchestra.run.smithi045.stdout: -6650> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5799 pv6007 ap=106 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=106) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=105) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.846 INFO:teuthology.orchestra.run.smithi045.stdout: -6649> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5797 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.846 INFO:teuthology.orchestra.run.smithi045.stdout: -6648> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5798 cv=5384/5384 REP dir_auth=0 ap=105+106 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5798 2023-10-03T19:21:08.847 INFO:teuthology.orchestra.run.smithi045.stdout: -6647> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000574) pop_and_dirty_projected_inode v5792 2023-10-03T19:21:08.847 INFO:teuthology.orchestra.run.smithi045.stdout: -6646> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000574) mark_dirty [inode 0x10000000574 [2,head] /dc-dir/dc-file_895 auth v5792 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.284343+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535664580] 2023-10-03T19:21:08.847 INFO:teuthology.orchestra.run.smithi045.stdout: -6645> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_895) mark_dirty [dentry #0x1/dc-dir/dc-file_895 [2,head] auth (dversion lock) pv=5792 v=4502 ino=0x10000000574 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535663400] 2023-10-03T19:21:08.847 INFO:teuthology.orchestra.run.smithi045.stdout: -6644> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5791 cv=5377/5377 ap=106+105 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=208 | child=1 dirty=1 authpin=1 0x565534f82400] version 5791 2023-10-03T19:21:08.847 INFO:teuthology.orchestra.run.smithi045.stdout: -6643> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536a077c0 v5800 2023-10-03T19:21:08.847 INFO:teuthology.orchestra.run.smithi045.stdout: -6642> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5800 cv=5384/5384 REP dir_auth=0 ap=105+106 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5800 2023-10-03T19:21:08.847 INFO:teuthology.orchestra.run.smithi045.stdout: -6641> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536a076a0 v5793 2023-10-03T19:21:08.847 INFO:teuthology.orchestra.run.smithi045.stdout: -6640> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5793 cv=5377/5377 ap=106+105 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=208 | child=1 dirty=1 authpin=1 0x565534f82400] version 5793 2023-10-03T19:21:08.848 INFO:teuthology.orchestra.run.smithi045.stdout: -6639> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=105 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=105 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.848 INFO:teuthology.orchestra.run.smithi045.stdout: -6638> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=105) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5799 pv6007 ap=106 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=106) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=105) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.848 INFO:teuthology.orchestra.run.smithi045.stdout: -6637> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=106) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5799 pv6007 ap=106 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=106) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=104) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.848 INFO:teuthology.orchestra.run.smithi045.stdout: -6636> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000574 [2,head] /dc-dir/dc-file_895 auth v5792 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.284343+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535664580] 2023-10-03T19:21:08.848 INFO:teuthology.orchestra.run.smithi045.stdout: -6635> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000574 [2,head] /dc-dir/dc-file_895 auth v5792 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.284343+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535664580] 2023-10-03T19:21:08.848 INFO:teuthology.orchestra.run.smithi045.stdout: -6634> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.848 INFO:teuthology.orchestra.run.smithi045.stdout: -6633> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.848 INFO:teuthology.orchestra.run.smithi045.stdout: -6632> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.848 INFO:teuthology.orchestra.run.smithi045.stdout: -6631> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000574 [2,head] /dc-dir/dc-file_895 auth v5792 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.284343+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535664580] 2023-10-03T19:21:08.849 INFO:teuthology.orchestra.run.smithi045.stdout: -6630> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000574 [2,head] /dc-dir/dc-file_895 auth v5792 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.284343+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535664580] 2023-10-03T19:21:08.849 INFO:teuthology.orchestra.run.smithi045.stdout: -6629> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.849 INFO:teuthology.orchestra.run.smithi045.stdout: -6628> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 623.327, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.23e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1249.5] 2023-10-03T19:21:08.849 INFO:teuthology.orchestra.run.smithi045.stdout: -6627> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536387d40 on [dir 0x1 / [2,head] auth pv=6008 v=5800 cv=5384/5384 REP dir_auth=0 ap=104+106 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 104 2023-10-03T19:21:08.849 INFO:teuthology.orchestra.run.smithi045.stdout: -6626> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536387d40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5799 pv6007 ap=105 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=105) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=104) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 105 2023-10-03T19:21:08.849 INFO:teuthology.orchestra.run.smithi045.stdout: -6625> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5800 cv=5384/5384 REP dir_auth=0 ap=104+105 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536387d40 count now 104/105 2023-10-03T19:21:08.849 INFO:teuthology.orchestra.run.smithi045.stdout: -6624> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536387d40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5793 cv=5377/5377 ap=105+105 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=208 | child=1 dirty=1 authpin=1 0x565534f82400] count now 105 2023-10-03T19:21:08.849 INFO:teuthology.orchestra.run.smithi045.stdout: -6623> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000574) auth_unpin by 0x565536387d40 on [inode 0x10000000574 [2,head] /dc-dir/dc-file_895 auth v5792 s=3 n(v0 rc2023-10-03T19:17:09.284343+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535664580] now 0 2023-10-03T19:21:08.849 INFO:teuthology.orchestra.run.smithi045.stdout: -6622> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5793 cv=5377/5377 ap=105+104 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=208 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536387d40 count now 105/104 2023-10-03T19:21:08.849 INFO:teuthology.orchestra.run.smithi045.stdout: -6621> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.849 INFO:teuthology.orchestra.run.smithi045.stdout: -6620> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.849 INFO:teuthology.orchestra.run.smithi045.stdout: -6619> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000575 [2,head] /dc-dir/dc-file_896 auth v4506 pv5794 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.296188+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.296188+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535664b00] 2023-10-03T19:21:08.850 INFO:teuthology.orchestra.run.smithi045.stdout: -6618> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5801 2023-10-03T19:21:08.850 INFO:teuthology.orchestra.run.smithi045.stdout: -6617> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5801 pv6007 ap=105 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=105) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=104) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.850 INFO:teuthology.orchestra.run.smithi045.stdout: -6616> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5799 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.850 INFO:teuthology.orchestra.run.smithi045.stdout: -6615> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5800 cv=5384/5384 REP dir_auth=0 ap=104+105 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5800 2023-10-03T19:21:08.850 INFO:teuthology.orchestra.run.smithi045.stdout: -6614> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000575) pop_and_dirty_projected_inode v5794 2023-10-03T19:21:08.850 INFO:teuthology.orchestra.run.smithi045.stdout: -6613> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000575) mark_dirty [inode 0x10000000575 [2,head] /dc-dir/dc-file_896 auth v5794 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.296188+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535664b00] 2023-10-03T19:21:08.850 INFO:teuthology.orchestra.run.smithi045.stdout: -6612> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_896) mark_dirty [dentry #0x1/dc-dir/dc-file_896 [2,head] auth (dversion lock) pv=5794 v=4506 ino=0x10000000575 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535663680] 2023-10-03T19:21:08.850 INFO:teuthology.orchestra.run.smithi045.stdout: -6611> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5793 cv=5377/5377 ap=105+104 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=209 | child=1 dirty=1 authpin=1 0x565534f82400] version 5793 2023-10-03T19:21:08.850 INFO:teuthology.orchestra.run.smithi045.stdout: -6610> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536a07a00 v5802 2023-10-03T19:21:08.850 INFO:teuthology.orchestra.run.smithi045.stdout: -6609> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5802 cv=5384/5384 REP dir_auth=0 ap=104+105 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5802 2023-10-03T19:21:08.851 INFO:teuthology.orchestra.run.smithi045.stdout: -6608> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536a078e0 v5795 2023-10-03T19:21:08.851 INFO:teuthology.orchestra.run.smithi045.stdout: -6607> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5795 cv=5377/5377 ap=105+104 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=209 | child=1 dirty=1 authpin=1 0x565534f82400] version 5795 2023-10-03T19:21:08.851 INFO:teuthology.orchestra.run.smithi045.stdout: -6606> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=104 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=104 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.851 INFO:teuthology.orchestra.run.smithi045.stdout: -6605> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=104) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5801 pv6007 ap=105 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=105) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=104) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.879 INFO:teuthology.orchestra.run.smithi045.stdout: -6604> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=105) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5801 pv6007 ap=105 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=105) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=103) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.879 INFO:teuthology.orchestra.run.smithi045.stdout: -6603> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000575 [2,head] /dc-dir/dc-file_896 auth v5794 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.296188+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535664b00] 2023-10-03T19:21:08.880 INFO:teuthology.orchestra.run.smithi045.stdout: -6602> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000575 [2,head] /dc-dir/dc-file_896 auth v5794 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.296188+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535664b00] 2023-10-03T19:21:08.880 INFO:teuthology.orchestra.run.smithi045.stdout: -6601> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.880 INFO:teuthology.orchestra.run.smithi045.stdout: -6600> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.880 INFO:teuthology.orchestra.run.smithi045.stdout: -6599> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.880 INFO:teuthology.orchestra.run.smithi045.stdout: -6598> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000575 [2,head] /dc-dir/dc-file_896 auth v5794 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.296188+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535664b00] 2023-10-03T19:21:08.880 INFO:teuthology.orchestra.run.smithi045.stdout: -6597> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000575 [2,head] /dc-dir/dc-file_896 auth v5794 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.296188+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535664b00] 2023-10-03T19:21:08.880 INFO:teuthology.orchestra.run.smithi045.stdout: -6596> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.880 INFO:teuthology.orchestra.run.smithi045.stdout: -6595> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 624.327, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.24e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1251.5] 2023-10-03T19:21:08.880 INFO:teuthology.orchestra.run.smithi045.stdout: -6594> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535428480 on [dir 0x1 / [2,head] auth pv=6008 v=5802 cv=5384/5384 REP dir_auth=0 ap=103+105 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 103 2023-10-03T19:21:08.880 INFO:teuthology.orchestra.run.smithi045.stdout: -6593> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535428480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5801 pv6007 ap=104 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=104) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=103) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 104 2023-10-03T19:21:08.880 INFO:teuthology.orchestra.run.smithi045.stdout: -6592> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5802 cv=5384/5384 REP dir_auth=0 ap=103+104 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535428480 count now 103/104 2023-10-03T19:21:08.881 INFO:teuthology.orchestra.run.smithi045.stdout: -6591> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535428480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5795 cv=5377/5377 ap=104+104 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=209 | child=1 dirty=1 authpin=1 0x565534f82400] count now 104 2023-10-03T19:21:08.881 INFO:teuthology.orchestra.run.smithi045.stdout: -6590> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000575) auth_unpin by 0x565535428480 on [inode 0x10000000575 [2,head] /dc-dir/dc-file_896 auth v5794 s=3 n(v0 rc2023-10-03T19:17:09.296188+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535664b00] now 0 2023-10-03T19:21:08.881 INFO:teuthology.orchestra.run.smithi045.stdout: -6589> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5795 cv=5377/5377 ap=104+103 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=209 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535428480 count now 104/103 2023-10-03T19:21:08.881 INFO:teuthology.orchestra.run.smithi045.stdout: -6588> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.881 INFO:teuthology.orchestra.run.smithi045.stdout: -6587> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.881 INFO:teuthology.orchestra.run.smithi045.stdout: -6586> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000576 [2,head] /dc-dir/dc-file_897 auth v4510 pv5796 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.307467+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.307467+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535665080] 2023-10-03T19:21:08.881 INFO:teuthology.orchestra.run.smithi045.stdout: -6585> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5803 2023-10-03T19:21:08.881 INFO:teuthology.orchestra.run.smithi045.stdout: -6584> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5803 pv6007 ap=104 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=104) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=103) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.881 INFO:teuthology.orchestra.run.smithi045.stdout: -6583> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5801 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.881 INFO:teuthology.orchestra.run.smithi045.stdout: -6582> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5802 cv=5384/5384 REP dir_auth=0 ap=103+104 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5802 2023-10-03T19:21:08.882 INFO:teuthology.orchestra.run.smithi045.stdout: -6581> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000576) pop_and_dirty_projected_inode v5796 2023-10-03T19:21:08.882 INFO:teuthology.orchestra.run.smithi045.stdout: -6580> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000576) mark_dirty [inode 0x10000000576 [2,head] /dc-dir/dc-file_897 auth v5796 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.307467+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535665080] 2023-10-03T19:21:08.882 INFO:teuthology.orchestra.run.smithi045.stdout: -6579> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_897) mark_dirty [dentry #0x1/dc-dir/dc-file_897 [2,head] auth (dversion lock) pv=5796 v=4510 ino=0x10000000576 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535663900] 2023-10-03T19:21:08.882 INFO:teuthology.orchestra.run.smithi045.stdout: -6578> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5795 cv=5377/5377 ap=104+103 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=210 | child=1 dirty=1 authpin=1 0x565534f82400] version 5795 2023-10-03T19:21:08.882 INFO:teuthology.orchestra.run.smithi045.stdout: -6577> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536a07c40 v5804 2023-10-03T19:21:08.882 INFO:teuthology.orchestra.run.smithi045.stdout: -6576> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5804 cv=5384/5384 REP dir_auth=0 ap=103+104 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5804 2023-10-03T19:21:08.882 INFO:teuthology.orchestra.run.smithi045.stdout: -6575> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536a07b20 v5797 2023-10-03T19:21:08.882 INFO:teuthology.orchestra.run.smithi045.stdout: -6574> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5797 cv=5377/5377 ap=104+103 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=210 | child=1 dirty=1 authpin=1 0x565534f82400] version 5797 2023-10-03T19:21:08.882 INFO:teuthology.orchestra.run.smithi045.stdout: -6573> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=103 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=103 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.882 INFO:teuthology.orchestra.run.smithi045.stdout: -6572> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=103) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5803 pv6007 ap=104 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=104) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=103) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.883 INFO:teuthology.orchestra.run.smithi045.stdout: -6571> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=104) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5803 pv6007 ap=104 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=104) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=102) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.883 INFO:teuthology.orchestra.run.smithi045.stdout: -6570> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000576 [2,head] /dc-dir/dc-file_897 auth v5796 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.307467+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535665080] 2023-10-03T19:21:08.883 INFO:teuthology.orchestra.run.smithi045.stdout: -6569> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000576 [2,head] /dc-dir/dc-file_897 auth v5796 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.307467+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535665080] 2023-10-03T19:21:08.883 INFO:teuthology.orchestra.run.smithi045.stdout: -6568> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.883 INFO:teuthology.orchestra.run.smithi045.stdout: -6567> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.883 INFO:teuthology.orchestra.run.smithi045.stdout: -6566> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.883 INFO:teuthology.orchestra.run.smithi045.stdout: -6565> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000576 [2,head] /dc-dir/dc-file_897 auth v5796 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.307467+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535665080] 2023-10-03T19:21:08.883 INFO:teuthology.orchestra.run.smithi045.stdout: -6564> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000576 [2,head] /dc-dir/dc-file_897 auth v5796 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.307467+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535665080] 2023-10-03T19:21:08.883 INFO:teuthology.orchestra.run.smithi045.stdout: -6563> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.883 INFO:teuthology.orchestra.run.smithi045.stdout: -6562> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 625.327, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.25e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1253.5] 2023-10-03T19:21:08.884 INFO:teuthology.orchestra.run.smithi045.stdout: -6561> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655354b6900 on [dir 0x1 / [2,head] auth pv=6008 v=5804 cv=5384/5384 REP dir_auth=0 ap=102+104 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 102 2023-10-03T19:21:08.884 INFO:teuthology.orchestra.run.smithi045.stdout: -6560> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655354b6900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5797 cv=5377/5377 ap=103+103 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=210 | child=1 dirty=1 authpin=1 0x565534f82400] count now 103 2023-10-03T19:21:08.884 INFO:teuthology.orchestra.run.smithi045.stdout: -6559> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655354b6900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5803 pv6007 ap=103 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=103) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=102) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 103 2023-10-03T19:21:08.884 INFO:teuthology.orchestra.run.smithi045.stdout: -6558> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5804 cv=5384/5384 REP dir_auth=0 ap=102+103 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655354b6900 count now 102/103 2023-10-03T19:21:08.884 INFO:teuthology.orchestra.run.smithi045.stdout: -6557> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000576) auth_unpin by 0x5655354b6900 on [inode 0x10000000576 [2,head] /dc-dir/dc-file_897 auth v5796 s=3 n(v0 rc2023-10-03T19:17:09.307467+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535665080] now 0 2023-10-03T19:21:08.884 INFO:teuthology.orchestra.run.smithi045.stdout: -6556> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5797 cv=5377/5377 ap=103+102 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=210 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655354b6900 count now 103/102 2023-10-03T19:21:08.884 INFO:teuthology.orchestra.run.smithi045.stdout: -6555> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.884 INFO:teuthology.orchestra.run.smithi045.stdout: -6554> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.884 INFO:teuthology.orchestra.run.smithi045.stdout: -6553> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000577 [2,head] /dc-dir/dc-file_898 auth v4514 pv5798 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.319393+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.319393+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535665600] 2023-10-03T19:21:08.884 INFO:teuthology.orchestra.run.smithi045.stdout: -6552> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5805 2023-10-03T19:21:08.884 INFO:teuthology.orchestra.run.smithi045.stdout: -6551> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5805 pv6007 ap=103 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=103) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=102) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.885 INFO:teuthology.orchestra.run.smithi045.stdout: -6550> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5803 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.885 INFO:teuthology.orchestra.run.smithi045.stdout: -6549> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5804 cv=5384/5384 REP dir_auth=0 ap=102+103 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5804 2023-10-03T19:21:08.885 INFO:teuthology.orchestra.run.smithi045.stdout: -6548> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000577) pop_and_dirty_projected_inode v5798 2023-10-03T19:21:08.885 INFO:teuthology.orchestra.run.smithi045.stdout: -6547> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000577) mark_dirty [inode 0x10000000577 [2,head] /dc-dir/dc-file_898 auth v5798 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.319393+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535665600] 2023-10-03T19:21:08.885 INFO:teuthology.orchestra.run.smithi045.stdout: -6546> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_898) mark_dirty [dentry #0x1/dc-dir/dc-file_898 [2,head] auth (dversion lock) pv=5798 v=4514 ino=0x10000000577 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535663b80] 2023-10-03T19:21:08.885 INFO:teuthology.orchestra.run.smithi045.stdout: -6545> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5797 cv=5377/5377 ap=103+102 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=211 | child=1 dirty=1 authpin=1 0x565534f82400] version 5797 2023-10-03T19:21:08.885 INFO:teuthology.orchestra.run.smithi045.stdout: -6544> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536a07e80 v5806 2023-10-03T19:21:08.885 INFO:teuthology.orchestra.run.smithi045.stdout: -6543> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5806 cv=5384/5384 REP dir_auth=0 ap=102+103 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5806 2023-10-03T19:21:08.885 INFO:teuthology.orchestra.run.smithi045.stdout: -6542> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536a07d60 v5799 2023-10-03T19:21:08.885 INFO:teuthology.orchestra.run.smithi045.stdout: -6541> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5799 cv=5377/5377 ap=103+102 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=211 | child=1 dirty=1 authpin=1 0x565534f82400] version 5799 2023-10-03T19:21:08.934 INFO:teuthology.orchestra.run.smithi045.stdout: -6540> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=102 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=102 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.934 INFO:teuthology.orchestra.run.smithi045.stdout: -6539> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=102) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5805 pv6007 ap=103 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=103) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=102) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.934 INFO:teuthology.orchestra.run.smithi045.stdout: -6538> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=103) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5805 pv6007 ap=103 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=103) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=101) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.934 INFO:teuthology.orchestra.run.smithi045.stdout: -6537> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000577 [2,head] /dc-dir/dc-file_898 auth v5798 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.319393+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535665600] 2023-10-03T19:21:08.934 INFO:teuthology.orchestra.run.smithi045.stdout: -6536> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000577 [2,head] /dc-dir/dc-file_898 auth v5798 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.319393+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535665600] 2023-10-03T19:21:08.935 INFO:teuthology.orchestra.run.smithi045.stdout: -6535> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.935 INFO:teuthology.orchestra.run.smithi045.stdout: -6534> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.935 INFO:teuthology.orchestra.run.smithi045.stdout: -6533> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.935 INFO:teuthology.orchestra.run.smithi045.stdout: -6532> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000577 [2,head] /dc-dir/dc-file_898 auth v5798 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.319393+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535665600] 2023-10-03T19:21:08.935 INFO:teuthology.orchestra.run.smithi045.stdout: -6531> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000577 [2,head] /dc-dir/dc-file_898 auth v5798 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.319393+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535665600] 2023-10-03T19:21:08.935 INFO:teuthology.orchestra.run.smithi045.stdout: -6530> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.935 INFO:teuthology.orchestra.run.smithi045.stdout: -6529> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 626.327, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.26e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1255.5] 2023-10-03T19:21:08.935 INFO:teuthology.orchestra.run.smithi045.stdout: -6528> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655352a6d80 on [dir 0x1 / [2,head] auth pv=6008 v=5806 cv=5384/5384 REP dir_auth=0 ap=101+103 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 101 2023-10-03T19:21:08.935 INFO:teuthology.orchestra.run.smithi045.stdout: -6527> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655352a6d80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5805 pv6007 ap=102 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=102) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=101) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 102 2023-10-03T19:21:08.935 INFO:teuthology.orchestra.run.smithi045.stdout: -6526> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5806 cv=5384/5384 REP dir_auth=0 ap=101+102 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655352a6d80 count now 101/102 2023-10-03T19:21:08.935 INFO:teuthology.orchestra.run.smithi045.stdout: -6525> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655352a6d80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5799 cv=5377/5377 ap=102+102 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=211 | child=1 dirty=1 authpin=1 0x565534f82400] count now 102 2023-10-03T19:21:08.936 INFO:teuthology.orchestra.run.smithi045.stdout: -6524> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000577) auth_unpin by 0x5655352a6d80 on [inode 0x10000000577 [2,head] /dc-dir/dc-file_898 auth v5798 s=3 n(v0 rc2023-10-03T19:17:09.319393+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535665600] now 0 2023-10-03T19:21:08.936 INFO:teuthology.orchestra.run.smithi045.stdout: -6523> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5799 cv=5377/5377 ap=102+101 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=211 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655352a6d80 count now 102/101 2023-10-03T19:21:08.936 INFO:teuthology.orchestra.run.smithi045.stdout: -6522> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.936 INFO:teuthology.orchestra.run.smithi045.stdout: -6521> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.936 INFO:teuthology.orchestra.run.smithi045.stdout: -6520> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000578 [2,head] /dc-dir/dc-file_899 auth v4518 pv5800 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.331832+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.331832+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535665b80] 2023-10-03T19:21:08.936 INFO:teuthology.orchestra.run.smithi045.stdout: -6519> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5807 2023-10-03T19:21:08.938 INFO:teuthology.orchestra.run.smithi045.stdout: -6518> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5807 pv6007 ap=102 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=102) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=101) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.938 INFO:teuthology.orchestra.run.smithi045.stdout: -6517> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5805 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.938 INFO:teuthology.orchestra.run.smithi045.stdout: -6516> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5806 cv=5384/5384 REP dir_auth=0 ap=101+102 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5806 2023-10-03T19:21:08.938 INFO:teuthology.orchestra.run.smithi045.stdout: -6515> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000578) pop_and_dirty_projected_inode v5800 2023-10-03T19:21:08.938 INFO:teuthology.orchestra.run.smithi045.stdout: -6514> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000578) mark_dirty [inode 0x10000000578 [2,head] /dc-dir/dc-file_899 auth v5800 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.331832+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535665b80] 2023-10-03T19:21:08.939 INFO:teuthology.orchestra.run.smithi045.stdout: -6513> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_899) mark_dirty [dentry #0x1/dc-dir/dc-file_899 [2,head] auth (dversion lock) pv=5800 v=4518 ino=0x10000000578 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535668000] 2023-10-03T19:21:08.939 INFO:teuthology.orchestra.run.smithi045.stdout: -6512> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5799 cv=5377/5377 ap=102+101 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=212 | child=1 dirty=1 authpin=1 0x565534f82400] version 5799 2023-10-03T19:21:08.939 INFO:teuthology.orchestra.run.smithi045.stdout: -6511> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565534fb4140 v5808 2023-10-03T19:21:08.939 INFO:teuthology.orchestra.run.smithi045.stdout: -6510> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5808 cv=5384/5384 REP dir_auth=0 ap=101+102 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5808 2023-10-03T19:21:08.939 INFO:teuthology.orchestra.run.smithi045.stdout: -6509> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565534fb4020 v5801 2023-10-03T19:21:08.939 INFO:teuthology.orchestra.run.smithi045.stdout: -6508> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5801 cv=5377/5377 ap=102+101 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=212 | child=1 dirty=1 authpin=1 0x565534f82400] version 5801 2023-10-03T19:21:08.939 INFO:teuthology.orchestra.run.smithi045.stdout: -6507> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=101 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=101 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.939 INFO:teuthology.orchestra.run.smithi045.stdout: -6506> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=101) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5807 pv6007 ap=102 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=102) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=101) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.939 INFO:teuthology.orchestra.run.smithi045.stdout: -6505> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=102) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5807 pv6007 ap=102 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=102) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=100) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.939 INFO:teuthology.orchestra.run.smithi045.stdout: -6504> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000578 [2,head] /dc-dir/dc-file_899 auth v5800 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.331832+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535665b80] 2023-10-03T19:21:08.939 INFO:teuthology.orchestra.run.smithi045.stdout: -6503> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000578 [2,head] /dc-dir/dc-file_899 auth v5800 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.331832+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535665b80] 2023-10-03T19:21:08.940 INFO:teuthology.orchestra.run.smithi045.stdout: -6502> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.940 INFO:teuthology.orchestra.run.smithi045.stdout: -6501> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.940 INFO:teuthology.orchestra.run.smithi045.stdout: -6500> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.940 INFO:teuthology.orchestra.run.smithi045.stdout: -6499> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000578 [2,head] /dc-dir/dc-file_899 auth v5800 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.331832+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535665b80] 2023-10-03T19:21:08.940 INFO:teuthology.orchestra.run.smithi045.stdout: -6498> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000578 [2,head] /dc-dir/dc-file_899 auth v5800 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.331832+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535665b80] 2023-10-03T19:21:08.940 INFO:teuthology.orchestra.run.smithi045.stdout: -6497> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.940 INFO:teuthology.orchestra.run.smithi045.stdout: -6496> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 627.327, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.27e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1257.5] 2023-10-03T19:21:08.940 INFO:teuthology.orchestra.run.smithi045.stdout: -6495> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655352ad8c0 on [dir 0x1 / [2,head] auth pv=6008 v=5808 cv=5384/5384 REP dir_auth=0 ap=100+102 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 100 2023-10-03T19:21:08.940 INFO:teuthology.orchestra.run.smithi045.stdout: -6494> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655352ad8c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5807 pv6007 ap=101 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=101) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=100) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 101 2023-10-03T19:21:08.940 INFO:teuthology.orchestra.run.smithi045.stdout: -6493> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5808 cv=5384/5384 REP dir_auth=0 ap=100+101 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655352ad8c0 count now 100/101 2023-10-03T19:21:08.941 INFO:teuthology.orchestra.run.smithi045.stdout: -6492> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655352ad8c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5801 cv=5377/5377 ap=101+101 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=212 | child=1 dirty=1 authpin=1 0x565534f82400] count now 101 2023-10-03T19:21:08.941 INFO:teuthology.orchestra.run.smithi045.stdout: -6491> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000578) auth_unpin by 0x5655352ad8c0 on [inode 0x10000000578 [2,head] /dc-dir/dc-file_899 auth v5800 s=3 n(v0 rc2023-10-03T19:17:09.331832+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535665b80] now 0 2023-10-03T19:21:08.941 INFO:teuthology.orchestra.run.smithi045.stdout: -6490> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5801 cv=5377/5377 ap=101+100 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=212 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655352ad8c0 count now 101/100 2023-10-03T19:21:08.941 INFO:teuthology.orchestra.run.smithi045.stdout: -6489> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.941 INFO:teuthology.orchestra.run.smithi045.stdout: -6488> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.941 INFO:teuthology.orchestra.run.smithi045.stdout: -6487> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000579 [2,head] /dc-dir/dc-file_900 auth v4522 pv5802 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.344427+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.344427+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535666100] 2023-10-03T19:21:08.941 INFO:teuthology.orchestra.run.smithi045.stdout: -6486> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5809 2023-10-03T19:21:08.941 INFO:teuthology.orchestra.run.smithi045.stdout: -6485> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5809 pv6007 ap=101 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=101) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=100) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.941 INFO:teuthology.orchestra.run.smithi045.stdout: -6484> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5807 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.941 INFO:teuthology.orchestra.run.smithi045.stdout: -6483> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5808 cv=5384/5384 REP dir_auth=0 ap=100+101 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5808 2023-10-03T19:21:08.941 INFO:teuthology.orchestra.run.smithi045.stdout: -6482> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000579) pop_and_dirty_projected_inode v5802 2023-10-03T19:21:08.941 INFO:teuthology.orchestra.run.smithi045.stdout: -6481> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000579) mark_dirty [inode 0x10000000579 [2,head] /dc-dir/dc-file_900 auth v5802 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.344427+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535666100] 2023-10-03T19:21:08.942 INFO:teuthology.orchestra.run.smithi045.stdout: -6480> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_900) mark_dirty [dentry #0x1/dc-dir/dc-file_900 [2,head] auth (dversion lock) pv=5802 v=4522 ino=0x10000000579 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535668280] 2023-10-03T19:21:08.942 INFO:teuthology.orchestra.run.smithi045.stdout: -6479> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5801 cv=5377/5377 ap=101+100 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=213 | child=1 dirty=1 authpin=1 0x565534f82400] version 5801 2023-10-03T19:21:08.942 INFO:teuthology.orchestra.run.smithi045.stdout: -6478> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565534fb4380 v5810 2023-10-03T19:21:08.942 INFO:teuthology.orchestra.run.smithi045.stdout: -6477> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5810 cv=5384/5384 REP dir_auth=0 ap=100+101 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5810 2023-10-03T19:21:08.942 INFO:teuthology.orchestra.run.smithi045.stdout: -6476> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565534fb4260 v5803 2023-10-03T19:21:08.942 INFO:teuthology.orchestra.run.smithi045.stdout: -6475> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5803 cv=5377/5377 ap=101+100 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=213 | child=1 dirty=1 authpin=1 0x565534f82400] version 5803 2023-10-03T19:21:08.942 INFO:teuthology.orchestra.run.smithi045.stdout: -6474> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=100 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=100 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:08.942 INFO:teuthology.orchestra.run.smithi045.stdout: -6473> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=100) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5809 pv6007 ap=101 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=101) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=100) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.942 INFO:teuthology.orchestra.run.smithi045.stdout: -6472> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=101) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5809 pv6007 ap=101 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=101) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=99) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.942 INFO:teuthology.orchestra.run.smithi045.stdout: -6471> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000579 [2,head] /dc-dir/dc-file_900 auth v5802 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.344427+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535666100] 2023-10-03T19:21:08.942 INFO:teuthology.orchestra.run.smithi045.stdout: -6470> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000579 [2,head] /dc-dir/dc-file_900 auth v5802 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.344427+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535666100] 2023-10-03T19:21:08.943 INFO:teuthology.orchestra.run.smithi045.stdout: -6469> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:08.996 INFO:teuthology.orchestra.run.smithi045.stdout: -6468> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:08.996 INFO:teuthology.orchestra.run.smithi045.stdout: -6467> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:08.996 INFO:teuthology.orchestra.run.smithi045.stdout: -6466> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000579 [2,head] /dc-dir/dc-file_900 auth v5802 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.344427+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535666100] 2023-10-03T19:21:08.996 INFO:teuthology.orchestra.run.smithi045.stdout: -6465> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000579 [2,head] /dc-dir/dc-file_900 auth v5802 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.344427+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535666100] 2023-10-03T19:21:08.996 INFO:teuthology.orchestra.run.smithi045.stdout: -6464> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:08.997 INFO:teuthology.orchestra.run.smithi045.stdout: -6463> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 628.327, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.28e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1259.5] 2023-10-03T19:21:08.997 INFO:teuthology.orchestra.run.smithi045.stdout: -6462> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655363fafc0 on [dir 0x1 / [2,head] auth pv=6008 v=5810 cv=5384/5384 REP dir_auth=0 ap=99+101 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 99 2023-10-03T19:21:08.997 INFO:teuthology.orchestra.run.smithi045.stdout: -6461> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655363fafc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5809 pv6007 ap=100 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=100) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=99) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 100 2023-10-03T19:21:08.997 INFO:teuthology.orchestra.run.smithi045.stdout: -6460> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5810 cv=5384/5384 REP dir_auth=0 ap=99+100 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655363fafc0 count now 99/100 2023-10-03T19:21:08.997 INFO:teuthology.orchestra.run.smithi045.stdout: -6459> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655363fafc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5803 cv=5377/5377 ap=100+100 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=213 | child=1 dirty=1 authpin=1 0x565534f82400] count now 100 2023-10-03T19:21:08.997 INFO:teuthology.orchestra.run.smithi045.stdout: -6458> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000579) auth_unpin by 0x5655363fafc0 on [inode 0x10000000579 [2,head] /dc-dir/dc-file_900 auth v5802 s=3 n(v0 rc2023-10-03T19:17:09.344427+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535666100] now 0 2023-10-03T19:21:08.998 INFO:teuthology.orchestra.run.smithi045.stdout: -6457> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5803 cv=5377/5377 ap=100+99 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=213 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655363fafc0 count now 100/99 2023-10-03T19:21:08.998 INFO:teuthology.orchestra.run.smithi045.stdout: -6456> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.998 INFO:teuthology.orchestra.run.smithi045.stdout: -6455> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:08.998 INFO:teuthology.orchestra.run.smithi045.stdout: -6454> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000057a [2,head] /dc-dir/dc-file_901 auth v4526 pv5804 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.356902+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.356902+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535666680] 2023-10-03T19:21:08.998 INFO:teuthology.orchestra.run.smithi045.stdout: -6453> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5811 2023-10-03T19:21:08.999 INFO:teuthology.orchestra.run.smithi045.stdout: -6452> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5811 pv6007 ap=100 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=100) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=99) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:08.999 INFO:teuthology.orchestra.run.smithi045.stdout: -6451> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5809 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:08.999 INFO:teuthology.orchestra.run.smithi045.stdout: -6450> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5810 cv=5384/5384 REP dir_auth=0 ap=99+100 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5810 2023-10-03T19:21:08.999 INFO:teuthology.orchestra.run.smithi045.stdout: -6449> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000057a) pop_and_dirty_projected_inode v5804 2023-10-03T19:21:08.999 INFO:teuthology.orchestra.run.smithi045.stdout: -6448> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000057a) mark_dirty [inode 0x1000000057a [2,head] /dc-dir/dc-file_901 auth v5804 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.356902+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535666680] 2023-10-03T19:21:08.999 INFO:teuthology.orchestra.run.smithi045.stdout: -6447> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_901) mark_dirty [dentry #0x1/dc-dir/dc-file_901 [2,head] auth (dversion lock) pv=5804 v=4526 ino=0x1000000057a state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535668500] 2023-10-03T19:21:09.000 INFO:teuthology.orchestra.run.smithi045.stdout: -6446> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5803 cv=5377/5377 ap=100+99 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=214 | child=1 dirty=1 authpin=1 0x565534f82400] version 5803 2023-10-03T19:21:09.000 INFO:teuthology.orchestra.run.smithi045.stdout: -6445> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565534fb45c0 v5812 2023-10-03T19:21:09.000 INFO:teuthology.orchestra.run.smithi045.stdout: -6444> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5812 cv=5384/5384 REP dir_auth=0 ap=99+100 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5812 2023-10-03T19:21:09.000 INFO:teuthology.orchestra.run.smithi045.stdout: -6443> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565534fb44a0 v5805 2023-10-03T19:21:09.000 INFO:teuthology.orchestra.run.smithi045.stdout: -6442> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5805 cv=5377/5377 ap=100+99 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=214 | child=1 dirty=1 authpin=1 0x565534f82400] version 5805 2023-10-03T19:21:09.001 INFO:teuthology.orchestra.run.smithi045.stdout: -6441> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=99 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=99 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.001 INFO:teuthology.orchestra.run.smithi045.stdout: -6440> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=99) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5811 pv6007 ap=100 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=100) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=99) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.001 INFO:teuthology.orchestra.run.smithi045.stdout: -6439> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=100) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5811 pv6007 ap=100 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=100) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=98) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.001 INFO:teuthology.orchestra.run.smithi045.stdout: -6438> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000057a [2,head] /dc-dir/dc-file_901 auth v5804 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.356902+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535666680] 2023-10-03T19:21:09.001 INFO:teuthology.orchestra.run.smithi045.stdout: -6437> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000057a [2,head] /dc-dir/dc-file_901 auth v5804 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.356902+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535666680] 2023-10-03T19:21:09.001 INFO:teuthology.orchestra.run.smithi045.stdout: -6436> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.002 INFO:teuthology.orchestra.run.smithi045.stdout: -6435> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.002 INFO:teuthology.orchestra.run.smithi045.stdout: -6434> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.002 INFO:teuthology.orchestra.run.smithi045.stdout: -6433> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000057a [2,head] /dc-dir/dc-file_901 auth v5804 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.356902+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535666680] 2023-10-03T19:21:09.002 INFO:teuthology.orchestra.run.smithi045.stdout: -6432> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000057a [2,head] /dc-dir/dc-file_901 auth v5804 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.356902+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535666680] 2023-10-03T19:21:09.002 INFO:teuthology.orchestra.run.smithi045.stdout: -6431> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.002 INFO:teuthology.orchestra.run.smithi045.stdout: -6430> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 629.327, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.29e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1261.5] 2023-10-03T19:21:09.003 INFO:teuthology.orchestra.run.smithi045.stdout: -6429> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535ebc240 on [dir 0x1 / [2,head] auth pv=6008 v=5812 cv=5384/5384 REP dir_auth=0 ap=98+100 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 98 2023-10-03T19:21:09.003 INFO:teuthology.orchestra.run.smithi045.stdout: -6428> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535ebc240 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5811 pv6007 ap=99 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=99) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=98) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 99 2023-10-03T19:21:09.003 INFO:teuthology.orchestra.run.smithi045.stdout: -6427> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5812 cv=5384/5384 REP dir_auth=0 ap=98+99 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535ebc240 count now 98/99 2023-10-03T19:21:09.003 INFO:teuthology.orchestra.run.smithi045.stdout: -6426> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535ebc240 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5805 cv=5377/5377 ap=99+99 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=214 | child=1 dirty=1 authpin=1 0x565534f82400] count now 99 2023-10-03T19:21:09.003 INFO:teuthology.orchestra.run.smithi045.stdout: -6425> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000057a) auth_unpin by 0x565535ebc240 on [inode 0x1000000057a [2,head] /dc-dir/dc-file_901 auth v5804 s=3 n(v0 rc2023-10-03T19:17:09.356902+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535666680] now 0 2023-10-03T19:21:09.003 INFO:teuthology.orchestra.run.smithi045.stdout: -6424> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5805 cv=5377/5377 ap=99+98 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=214 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535ebc240 count now 99/98 2023-10-03T19:21:09.004 INFO:teuthology.orchestra.run.smithi045.stdout: -6423> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.004 INFO:teuthology.orchestra.run.smithi045.stdout: -6422> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.019 INFO:teuthology.orchestra.run.smithi045.stdout: -6421> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000057b [2,head] /dc-dir/dc-file_902 auth v4530 pv5806 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.369480+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.369480+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535666c00] 2023-10-03T19:21:09.019 INFO:teuthology.orchestra.run.smithi045.stdout: -6420> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5813 2023-10-03T19:21:09.020 INFO:teuthology.orchestra.run.smithi045.stdout: -6419> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5813 pv6007 ap=99 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=99) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=98) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.020 INFO:teuthology.orchestra.run.smithi045.stdout: -6418> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5811 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.020 INFO:teuthology.orchestra.run.smithi045.stdout: -6417> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5812 cv=5384/5384 REP dir_auth=0 ap=98+99 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5812 2023-10-03T19:21:09.020 INFO:teuthology.orchestra.run.smithi045.stdout: -6416> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000057b) pop_and_dirty_projected_inode v5806 2023-10-03T19:21:09.021 INFO:teuthology.orchestra.run.smithi045.stdout: -6415> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000057b) mark_dirty [inode 0x1000000057b [2,head] /dc-dir/dc-file_902 auth v5806 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.369480+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535666c00] 2023-10-03T19:21:09.021 INFO:teuthology.orchestra.run.smithi045.stdout: -6414> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_902) mark_dirty [dentry #0x1/dc-dir/dc-file_902 [2,head] auth (dversion lock) pv=5806 v=4530 ino=0x1000000057b state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535668780] 2023-10-03T19:21:09.021 INFO:teuthology.orchestra.run.smithi045.stdout: -6413> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5805 cv=5377/5377 ap=99+98 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=215 | child=1 dirty=1 authpin=1 0x565534f82400] version 5805 2023-10-03T19:21:09.021 INFO:teuthology.orchestra.run.smithi045.stdout: -6412> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565534fb4800 v5814 2023-10-03T19:21:09.021 INFO:teuthology.orchestra.run.smithi045.stdout: -6411> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5814 cv=5384/5384 REP dir_auth=0 ap=98+99 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5814 2023-10-03T19:21:09.022 INFO:teuthology.orchestra.run.smithi045.stdout: -6410> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565534fb46e0 v5807 2023-10-03T19:21:09.022 INFO:teuthology.orchestra.run.smithi045.stdout: -6409> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5807 cv=5377/5377 ap=99+98 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=215 | child=1 dirty=1 authpin=1 0x565534f82400] version 5807 2023-10-03T19:21:09.022 INFO:teuthology.orchestra.run.smithi045.stdout: -6408> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=98 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=98 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.022 INFO:teuthology.orchestra.run.smithi045.stdout: -6407> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=98) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5813 pv6007 ap=99 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=99) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=98) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.023 INFO:teuthology.orchestra.run.smithi045.stdout: -6406> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=99) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5813 pv6007 ap=99 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=99) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=97) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.023 INFO:teuthology.orchestra.run.smithi045.stdout: -6405> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000057b [2,head] /dc-dir/dc-file_902 auth v5806 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.369480+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535666c00] 2023-10-03T19:21:09.023 INFO:teuthology.orchestra.run.smithi045.stdout: -6404> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000057b [2,head] /dc-dir/dc-file_902 auth v5806 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.369480+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535666c00] 2023-10-03T19:21:09.023 INFO:teuthology.orchestra.run.smithi045.stdout: -6403> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.023 INFO:teuthology.orchestra.run.smithi045.stdout: -6402> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.023 INFO:teuthology.orchestra.run.smithi045.stdout: -6401> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.024 INFO:teuthology.orchestra.run.smithi045.stdout: -6400> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000057b [2,head] /dc-dir/dc-file_902 auth v5806 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.369480+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535666c00] 2023-10-03T19:21:09.024 INFO:teuthology.orchestra.run.smithi045.stdout: -6399> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000057b [2,head] /dc-dir/dc-file_902 auth v5806 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.369480+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535666c00] 2023-10-03T19:21:09.024 INFO:teuthology.orchestra.run.smithi045.stdout: -6398> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.024 INFO:teuthology.orchestra.run.smithi045.stdout: -6397> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 630.327, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.30e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1263.5] 2023-10-03T19:21:09.024 INFO:teuthology.orchestra.run.smithi045.stdout: -6396> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535ebd8c0 on [dir 0x1 / [2,head] auth pv=6008 v=5814 cv=5384/5384 REP dir_auth=0 ap=97+99 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 97 2023-10-03T19:21:09.025 INFO:teuthology.orchestra.run.smithi045.stdout: -6395> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535ebd8c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5813 pv6007 ap=98 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=98) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=97) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 98 2023-10-03T19:21:09.025 INFO:teuthology.orchestra.run.smithi045.stdout: -6394> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5814 cv=5384/5384 REP dir_auth=0 ap=97+98 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535ebd8c0 count now 97/98 2023-10-03T19:21:09.025 INFO:teuthology.orchestra.run.smithi045.stdout: -6393> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535ebd8c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5807 cv=5377/5377 ap=98+98 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=215 | child=1 dirty=1 authpin=1 0x565534f82400] count now 98 2023-10-03T19:21:09.025 INFO:teuthology.orchestra.run.smithi045.stdout: -6392> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000057b) auth_unpin by 0x565535ebd8c0 on [inode 0x1000000057b [2,head] /dc-dir/dc-file_902 auth v5806 s=3 n(v0 rc2023-10-03T19:17:09.369480+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535666c00] now 0 2023-10-03T19:21:09.025 INFO:teuthology.orchestra.run.smithi045.stdout: -6391> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5807 cv=5377/5377 ap=98+97 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=215 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535ebd8c0 count now 98/97 2023-10-03T19:21:09.025 INFO:teuthology.orchestra.run.smithi045.stdout: -6390> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.025 INFO:teuthology.orchestra.run.smithi045.stdout: -6389> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.026 INFO:teuthology.orchestra.run.smithi045.stdout: -6388> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000057c [2,head] /dc-dir/dc-file_903 auth v4534 pv5808 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.381441+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.381441+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535667180] 2023-10-03T19:21:09.026 INFO:teuthology.orchestra.run.smithi045.stdout: -6387> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5815 2023-10-03T19:21:09.026 INFO:teuthology.orchestra.run.smithi045.stdout: -6386> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5815 pv6007 ap=98 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=98) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=97) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.026 INFO:teuthology.orchestra.run.smithi045.stdout: -6385> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5813 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.026 INFO:teuthology.orchestra.run.smithi045.stdout: -6384> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5814 cv=5384/5384 REP dir_auth=0 ap=97+98 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5814 2023-10-03T19:21:09.027 INFO:teuthology.orchestra.run.smithi045.stdout: -6383> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000057c) pop_and_dirty_projected_inode v5808 2023-10-03T19:21:09.027 INFO:teuthology.orchestra.run.smithi045.stdout: -6382> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000057c) mark_dirty [inode 0x1000000057c [2,head] /dc-dir/dc-file_903 auth v5808 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.381441+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535667180] 2023-10-03T19:21:09.027 INFO:teuthology.orchestra.run.smithi045.stdout: -6381> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_903) mark_dirty [dentry #0x1/dc-dir/dc-file_903 [2,head] auth (dversion lock) pv=5808 v=4534 ino=0x1000000057c state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535668a00] 2023-10-03T19:21:09.027 INFO:teuthology.orchestra.run.smithi045.stdout: -6380> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5807 cv=5377/5377 ap=98+97 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=216 | child=1 dirty=1 authpin=1 0x565534f82400] version 5807 2023-10-03T19:21:09.099 INFO:teuthology.orchestra.run.smithi045.stdout: -6379> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565534fb4a40 v5816 2023-10-03T19:21:09.099 INFO:teuthology.orchestra.run.smithi045.stdout: -6378> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5816 cv=5384/5384 REP dir_auth=0 ap=97+98 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5816 2023-10-03T19:21:09.099 INFO:teuthology.orchestra.run.smithi045.stdout: -6377> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565534fb4920 v5809 2023-10-03T19:21:09.099 INFO:teuthology.orchestra.run.smithi045.stdout: -6376> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5809 cv=5377/5377 ap=98+97 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=216 | child=1 dirty=1 authpin=1 0x565534f82400] version 5809 2023-10-03T19:21:09.099 INFO:teuthology.orchestra.run.smithi045.stdout: -6375> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=97 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=97 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.100 INFO:teuthology.orchestra.run.smithi045.stdout: -6374> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=97) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5815 pv6007 ap=98 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=98) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=97) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.100 INFO:teuthology.orchestra.run.smithi045.stdout: -6373> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=98) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5815 pv6007 ap=98 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=98) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=96) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.100 INFO:teuthology.orchestra.run.smithi045.stdout: -6372> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000057c [2,head] /dc-dir/dc-file_903 auth v5808 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.381441+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535667180] 2023-10-03T19:21:09.100 INFO:teuthology.orchestra.run.smithi045.stdout: -6371> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000057c [2,head] /dc-dir/dc-file_903 auth v5808 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.381441+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535667180] 2023-10-03T19:21:09.100 INFO:teuthology.orchestra.run.smithi045.stdout: -6370> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.100 INFO:teuthology.orchestra.run.smithi045.stdout: -6369> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.101 INFO:teuthology.orchestra.run.smithi045.stdout: -6368> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.101 INFO:teuthology.orchestra.run.smithi045.stdout: -6367> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000057c [2,head] /dc-dir/dc-file_903 auth v5808 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.381441+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535667180] 2023-10-03T19:21:09.101 INFO:teuthology.orchestra.run.smithi045.stdout: -6366> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000057c [2,head] /dc-dir/dc-file_903 auth v5808 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.381441+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535667180] 2023-10-03T19:21:09.101 INFO:teuthology.orchestra.run.smithi045.stdout: -6365> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.101 INFO:teuthology.orchestra.run.smithi045.stdout: -6364> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 631.327, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.31e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1265.5] 2023-10-03T19:21:09.102 INFO:teuthology.orchestra.run.smithi045.stdout: -6363> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535ebcfc0 on [dir 0x1 / [2,head] auth pv=6008 v=5816 cv=5384/5384 REP dir_auth=0 ap=96+98 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 96 2023-10-03T19:21:09.102 INFO:teuthology.orchestra.run.smithi045.stdout: -6362> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535ebcfc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5815 pv6007 ap=97 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=97) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=96) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 97 2023-10-03T19:21:09.102 INFO:teuthology.orchestra.run.smithi045.stdout: -6361> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5816 cv=5384/5384 REP dir_auth=0 ap=96+97 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535ebcfc0 count now 96/97 2023-10-03T19:21:09.102 INFO:teuthology.orchestra.run.smithi045.stdout: -6360> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535ebcfc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5809 cv=5377/5377 ap=97+97 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=216 | child=1 dirty=1 authpin=1 0x565534f82400] count now 97 2023-10-03T19:21:09.102 INFO:teuthology.orchestra.run.smithi045.stdout: -6359> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000057c) auth_unpin by 0x565535ebcfc0 on [inode 0x1000000057c [2,head] /dc-dir/dc-file_903 auth v5808 s=3 n(v0 rc2023-10-03T19:17:09.381441+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535667180] now 0 2023-10-03T19:21:09.103 INFO:teuthology.orchestra.run.smithi045.stdout: -6358> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5809 cv=5377/5377 ap=97+96 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=216 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535ebcfc0 count now 97/96 2023-10-03T19:21:09.103 INFO:teuthology.orchestra.run.smithi045.stdout: -6357> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.103 INFO:teuthology.orchestra.run.smithi045.stdout: -6356> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.103 INFO:teuthology.orchestra.run.smithi045.stdout: -6355> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000057d [2,head] /dc-dir/dc-file_904 auth v4538 pv5810 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.393246+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.393246+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535667700] 2023-10-03T19:21:09.103 INFO:teuthology.orchestra.run.smithi045.stdout: -6354> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5817 2023-10-03T19:21:09.103 INFO:teuthology.orchestra.run.smithi045.stdout: -6353> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5817 pv6007 ap=97 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=97) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=96) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.104 INFO:teuthology.orchestra.run.smithi045.stdout: -6352> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5815 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.104 INFO:teuthology.orchestra.run.smithi045.stdout: -6351> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5816 cv=5384/5384 REP dir_auth=0 ap=96+97 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5816 2023-10-03T19:21:09.104 INFO:teuthology.orchestra.run.smithi045.stdout: -6350> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000057d) pop_and_dirty_projected_inode v5810 2023-10-03T19:21:09.104 INFO:teuthology.orchestra.run.smithi045.stdout: -6349> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000057d) mark_dirty [inode 0x1000000057d [2,head] /dc-dir/dc-file_904 auth v5810 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.393246+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535667700] 2023-10-03T19:21:09.104 INFO:teuthology.orchestra.run.smithi045.stdout: -6348> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_904) mark_dirty [dentry #0x1/dc-dir/dc-file_904 [2,head] auth (dversion lock) pv=5810 v=4538 ino=0x1000000057d state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535668c80] 2023-10-03T19:21:09.105 INFO:teuthology.orchestra.run.smithi045.stdout: -6347> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5809 cv=5377/5377 ap=97+96 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=217 | child=1 dirty=1 authpin=1 0x565534f82400] version 5809 2023-10-03T19:21:09.105 INFO:teuthology.orchestra.run.smithi045.stdout: -6346> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565534fb4c80 v5818 2023-10-03T19:21:09.105 INFO:teuthology.orchestra.run.smithi045.stdout: -6345> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5818 cv=5384/5384 REP dir_auth=0 ap=96+97 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5818 2023-10-03T19:21:09.105 INFO:teuthology.orchestra.run.smithi045.stdout: -6344> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565534fb4b60 v5811 2023-10-03T19:21:09.106 INFO:teuthology.orchestra.run.smithi045.stdout: -6343> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5811 cv=5377/5377 ap=97+96 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=217 | child=1 dirty=1 authpin=1 0x565534f82400] version 5811 2023-10-03T19:21:09.106 INFO:teuthology.orchestra.run.smithi045.stdout: -6342> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=96 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=96 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.106 INFO:teuthology.orchestra.run.smithi045.stdout: -6341> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=96) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5817 pv6007 ap=97 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=97) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=96) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.106 INFO:teuthology.orchestra.run.smithi045.stdout: -6340> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=97) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5817 pv6007 ap=97 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=97) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=95) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.107 INFO:teuthology.orchestra.run.smithi045.stdout: -6339> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000057d [2,head] /dc-dir/dc-file_904 auth v5810 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.393246+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535667700] 2023-10-03T19:21:09.107 INFO:teuthology.orchestra.run.smithi045.stdout: -6338> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000057d [2,head] /dc-dir/dc-file_904 auth v5810 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.393246+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535667700] 2023-10-03T19:21:09.107 INFO:teuthology.orchestra.run.smithi045.stdout: -6337> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.107 INFO:teuthology.orchestra.run.smithi045.stdout: -6336> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.161 INFO:teuthology.orchestra.run.smithi045.stdout: -6335> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.162 INFO:teuthology.orchestra.run.smithi045.stdout: -6334> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000057d [2,head] /dc-dir/dc-file_904 auth v5810 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.393246+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535667700] 2023-10-03T19:21:09.162 INFO:teuthology.orchestra.run.smithi045.stdout: -6333> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000057d [2,head] /dc-dir/dc-file_904 auth v5810 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.393246+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535667700] 2023-10-03T19:21:09.162 INFO:teuthology.orchestra.run.smithi045.stdout: -6332> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.162 INFO:teuthology.orchestra.run.smithi045.stdout: -6331> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 632.327, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.32e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1267.5] 2023-10-03T19:21:09.162 INFO:teuthology.orchestra.run.smithi045.stdout: -6330> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655351dc000 on [dir 0x1 / [2,head] auth pv=6008 v=5818 cv=5384/5384 REP dir_auth=0 ap=95+97 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 95 2023-10-03T19:21:09.162 INFO:teuthology.orchestra.run.smithi045.stdout: -6329> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655351dc000 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5817 pv6007 ap=96 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=96) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=95) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 96 2023-10-03T19:21:09.162 INFO:teuthology.orchestra.run.smithi045.stdout: -6328> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5818 cv=5384/5384 REP dir_auth=0 ap=95+96 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655351dc000 count now 95/96 2023-10-03T19:21:09.162 INFO:teuthology.orchestra.run.smithi045.stdout: -6327> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655351dc000 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5811 cv=5377/5377 ap=96+96 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=217 | child=1 dirty=1 authpin=1 0x565534f82400] count now 96 2023-10-03T19:21:09.162 INFO:teuthology.orchestra.run.smithi045.stdout: -6326> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000057d) auth_unpin by 0x5655351dc000 on [inode 0x1000000057d [2,head] /dc-dir/dc-file_904 auth v5810 s=3 n(v0 rc2023-10-03T19:17:09.393246+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535667700] now 0 2023-10-03T19:21:09.163 INFO:teuthology.orchestra.run.smithi045.stdout: -6325> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5811 cv=5377/5377 ap=96+95 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=217 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655351dc000 count now 96/95 2023-10-03T19:21:09.163 INFO:teuthology.orchestra.run.smithi045.stdout: -6324> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.163 INFO:teuthology.orchestra.run.smithi045.stdout: -6323> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.163 INFO:teuthology.orchestra.run.smithi045.stdout: -6322> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000057e [2,head] /dc-dir/dc-file_905 auth v4542 pv5812 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.405334+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.405334+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553566a000] 2023-10-03T19:21:09.163 INFO:teuthology.orchestra.run.smithi045.stdout: -6321> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5819 2023-10-03T19:21:09.163 INFO:teuthology.orchestra.run.smithi045.stdout: -6320> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5819 pv6007 ap=96 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=96) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=95) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.163 INFO:teuthology.orchestra.run.smithi045.stdout: -6319> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5817 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.163 INFO:teuthology.orchestra.run.smithi045.stdout: -6318> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5818 cv=5384/5384 REP dir_auth=0 ap=95+96 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5818 2023-10-03T19:21:09.163 INFO:teuthology.orchestra.run.smithi045.stdout: -6317> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000057e) pop_and_dirty_projected_inode v5812 2023-10-03T19:21:09.163 INFO:teuthology.orchestra.run.smithi045.stdout: -6316> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000057e) mark_dirty [inode 0x1000000057e [2,head] /dc-dir/dc-file_905 auth v5812 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.405334+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553566a000] 2023-10-03T19:21:09.164 INFO:teuthology.orchestra.run.smithi045.stdout: -6315> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_905) mark_dirty [dentry #0x1/dc-dir/dc-file_905 [2,head] auth (dversion lock) pv=5812 v=4542 ino=0x1000000057e state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535668f00] 2023-10-03T19:21:09.164 INFO:teuthology.orchestra.run.smithi045.stdout: -6314> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5811 cv=5377/5377 ap=96+95 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=218 | child=1 dirty=1 authpin=1 0x565534f82400] version 5811 2023-10-03T19:21:09.164 INFO:teuthology.orchestra.run.smithi045.stdout: -6313> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565534fb4ec0 v5820 2023-10-03T19:21:09.164 INFO:teuthology.orchestra.run.smithi045.stdout: -6312> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5820 cv=5384/5384 REP dir_auth=0 ap=95+96 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5820 2023-10-03T19:21:09.164 INFO:teuthology.orchestra.run.smithi045.stdout: -6311> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565534fb4da0 v5813 2023-10-03T19:21:09.164 INFO:teuthology.orchestra.run.smithi045.stdout: -6310> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5813 cv=5377/5377 ap=96+95 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=218 | child=1 dirty=1 authpin=1 0x565534f82400] version 5813 2023-10-03T19:21:09.164 INFO:teuthology.orchestra.run.smithi045.stdout: -6309> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=95 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=95 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.164 INFO:teuthology.orchestra.run.smithi045.stdout: -6308> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=95) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5819 pv6007 ap=96 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=96) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=95) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.164 INFO:teuthology.orchestra.run.smithi045.stdout: -6307> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=96) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5819 pv6007 ap=96 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=96) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=94) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.164 INFO:teuthology.orchestra.run.smithi045.stdout: -6306> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000057e [2,head] /dc-dir/dc-file_905 auth v5812 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.405334+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566a000] 2023-10-03T19:21:09.164 INFO:teuthology.orchestra.run.smithi045.stdout: -6305> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000057e [2,head] /dc-dir/dc-file_905 auth v5812 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.405334+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566a000] 2023-10-03T19:21:09.165 INFO:teuthology.orchestra.run.smithi045.stdout: -6304> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.165 INFO:teuthology.orchestra.run.smithi045.stdout: -6303> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.165 INFO:teuthology.orchestra.run.smithi045.stdout: -6302> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.165 INFO:teuthology.orchestra.run.smithi045.stdout: -6301> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000057e [2,head] /dc-dir/dc-file_905 auth v5812 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.405334+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566a000] 2023-10-03T19:21:09.165 INFO:teuthology.orchestra.run.smithi045.stdout: -6300> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000057e [2,head] /dc-dir/dc-file_905 auth v5812 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.405334+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566a000] 2023-10-03T19:21:09.165 INFO:teuthology.orchestra.run.smithi045.stdout: -6299> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.165 INFO:teuthology.orchestra.run.smithi045.stdout: -6298> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 633.327, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.33e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1269.5] 2023-10-03T19:21:09.165 INFO:teuthology.orchestra.run.smithi045.stdout: -6297> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655351dc480 on [dir 0x1 / [2,head] auth pv=6008 v=5820 cv=5384/5384 REP dir_auth=0 ap=94+96 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 94 2023-10-03T19:21:09.166 INFO:teuthology.orchestra.run.smithi045.stdout: -6296> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655351dc480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5819 pv6007 ap=95 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=95) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=94) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 95 2023-10-03T19:21:09.166 INFO:teuthology.orchestra.run.smithi045.stdout: -6295> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5820 cv=5384/5384 REP dir_auth=0 ap=94+95 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655351dc480 count now 94/95 2023-10-03T19:21:09.166 INFO:teuthology.orchestra.run.smithi045.stdout: -6294> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655351dc480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5813 cv=5377/5377 ap=95+95 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=218 | child=1 dirty=1 authpin=1 0x565534f82400] count now 95 2023-10-03T19:21:09.166 INFO:teuthology.orchestra.run.smithi045.stdout: -6293> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000057e) auth_unpin by 0x5655351dc480 on [inode 0x1000000057e [2,head] /dc-dir/dc-file_905 auth v5812 s=3 n(v0 rc2023-10-03T19:17:09.405334+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553566a000] now 0 2023-10-03T19:21:09.166 INFO:teuthology.orchestra.run.smithi045.stdout: -6292> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5813 cv=5377/5377 ap=95+94 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=218 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655351dc480 count now 95/94 2023-10-03T19:21:09.166 INFO:teuthology.orchestra.run.smithi045.stdout: -6291> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.166 INFO:teuthology.orchestra.run.smithi045.stdout: -6290> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.166 INFO:teuthology.orchestra.run.smithi045.stdout: -6289> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000057f [2,head] /dc-dir/dc-file_906 auth v4546 pv5814 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.417046+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.417046+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553566a580] 2023-10-03T19:21:09.166 INFO:teuthology.orchestra.run.smithi045.stdout: -6288> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5821 2023-10-03T19:21:09.166 INFO:teuthology.orchestra.run.smithi045.stdout: -6287> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5821 pv6007 ap=95 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=95) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=94) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.166 INFO:teuthology.orchestra.run.smithi045.stdout: -6286> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5819 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.167 INFO:teuthology.orchestra.run.smithi045.stdout: -6285> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5820 cv=5384/5384 REP dir_auth=0 ap=94+95 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5820 2023-10-03T19:21:09.167 INFO:teuthology.orchestra.run.smithi045.stdout: -6284> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000057f) pop_and_dirty_projected_inode v5814 2023-10-03T19:21:09.167 INFO:teuthology.orchestra.run.smithi045.stdout: -6283> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000057f) mark_dirty [inode 0x1000000057f [2,head] /dc-dir/dc-file_906 auth v5814 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.417046+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553566a580] 2023-10-03T19:21:09.167 INFO:teuthology.orchestra.run.smithi045.stdout: -6282> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_906) mark_dirty [dentry #0x1/dc-dir/dc-file_906 [2,head] auth (dversion lock) pv=5814 v=4546 ino=0x1000000057f state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535669180] 2023-10-03T19:21:09.167 INFO:teuthology.orchestra.run.smithi045.stdout: -6281> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5813 cv=5377/5377 ap=95+94 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=219 | child=1 dirty=1 authpin=1 0x565534f82400] version 5813 2023-10-03T19:21:09.167 INFO:teuthology.orchestra.run.smithi045.stdout: -6280> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565534fb5100 v5822 2023-10-03T19:21:09.167 INFO:teuthology.orchestra.run.smithi045.stdout: -6279> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5822 cv=5384/5384 REP dir_auth=0 ap=94+95 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5822 2023-10-03T19:21:09.167 INFO:teuthology.orchestra.run.smithi045.stdout: -6278> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565534fb4fe0 v5815 2023-10-03T19:21:09.167 INFO:teuthology.orchestra.run.smithi045.stdout: -6277> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5815 cv=5377/5377 ap=95+94 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=219 | child=1 dirty=1 authpin=1 0x565534f82400] version 5815 2023-10-03T19:21:09.167 INFO:teuthology.orchestra.run.smithi045.stdout: -6276> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=94 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=94 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.183 INFO:teuthology.orchestra.run.smithi045.stdout: -6275> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=94) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5821 pv6007 ap=95 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=95) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=94) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.184 INFO:teuthology.orchestra.run.smithi045.stdout: -6274> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=95) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5821 pv6007 ap=95 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=95) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=93) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.184 INFO:teuthology.orchestra.run.smithi045.stdout: -6273> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000057f [2,head] /dc-dir/dc-file_906 auth v5814 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.417046+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566a580] 2023-10-03T19:21:09.184 INFO:teuthology.orchestra.run.smithi045.stdout: -6272> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000057f [2,head] /dc-dir/dc-file_906 auth v5814 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.417046+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566a580] 2023-10-03T19:21:09.184 INFO:teuthology.orchestra.run.smithi045.stdout: -6271> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.184 INFO:teuthology.orchestra.run.smithi045.stdout: -6270> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.184 INFO:teuthology.orchestra.run.smithi045.stdout: -6269> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.184 INFO:teuthology.orchestra.run.smithi045.stdout: -6268> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000057f [2,head] /dc-dir/dc-file_906 auth v5814 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.417046+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566a580] 2023-10-03T19:21:09.184 INFO:teuthology.orchestra.run.smithi045.stdout: -6267> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000057f [2,head] /dc-dir/dc-file_906 auth v5814 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.417046+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566a580] 2023-10-03T19:21:09.184 INFO:teuthology.orchestra.run.smithi045.stdout: -6266> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.184 INFO:teuthology.orchestra.run.smithi045.stdout: -6265> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 634.327, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.34e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1271.5] 2023-10-03T19:21:09.184 INFO:teuthology.orchestra.run.smithi045.stdout: -6264> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655351dc900 on [dir 0x1 / [2,head] auth pv=6008 v=5822 cv=5384/5384 REP dir_auth=0 ap=93+95 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 93 2023-10-03T19:21:09.185 INFO:teuthology.orchestra.run.smithi045.stdout: -6263> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655351dc900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5821 pv6007 ap=94 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=94) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=93) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 94 2023-10-03T19:21:09.185 INFO:teuthology.orchestra.run.smithi045.stdout: -6262> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5822 cv=5384/5384 REP dir_auth=0 ap=93+94 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655351dc900 count now 93/94 2023-10-03T19:21:09.185 INFO:teuthology.orchestra.run.smithi045.stdout: -6261> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655351dc900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5815 cv=5377/5377 ap=94+94 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=219 | child=1 dirty=1 authpin=1 0x565534f82400] count now 94 2023-10-03T19:21:09.185 INFO:teuthology.orchestra.run.smithi045.stdout: -6260> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000057f) auth_unpin by 0x5655351dc900 on [inode 0x1000000057f [2,head] /dc-dir/dc-file_906 auth v5814 s=3 n(v0 rc2023-10-03T19:17:09.417046+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553566a580] now 0 2023-10-03T19:21:09.185 INFO:teuthology.orchestra.run.smithi045.stdout: -6259> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5815 cv=5377/5377 ap=94+93 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=219 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655351dc900 count now 94/93 2023-10-03T19:21:09.185 INFO:teuthology.orchestra.run.smithi045.stdout: -6258> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.185 INFO:teuthology.orchestra.run.smithi045.stdout: -6257> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.185 INFO:teuthology.orchestra.run.smithi045.stdout: -6256> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000580 [2,head] /dc-dir/dc-file_907 auth v4550 pv5816 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.429573+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.429573+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553566ab00] 2023-10-03T19:21:09.185 INFO:teuthology.orchestra.run.smithi045.stdout: -6255> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5823 2023-10-03T19:21:09.185 INFO:teuthology.orchestra.run.smithi045.stdout: -6254> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5823 pv6007 ap=94 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=94) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=93) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.185 INFO:teuthology.orchestra.run.smithi045.stdout: -6253> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5821 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.185 INFO:teuthology.orchestra.run.smithi045.stdout: -6252> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5822 cv=5384/5384 REP dir_auth=0 ap=93+94 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5822 2023-10-03T19:21:09.186 INFO:teuthology.orchestra.run.smithi045.stdout: -6251> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000580) pop_and_dirty_projected_inode v5816 2023-10-03T19:21:09.186 INFO:teuthology.orchestra.run.smithi045.stdout: -6250> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000580) mark_dirty [inode 0x10000000580 [2,head] /dc-dir/dc-file_907 auth v5816 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.429573+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553566ab00] 2023-10-03T19:21:09.186 INFO:teuthology.orchestra.run.smithi045.stdout: -6249> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_907) mark_dirty [dentry #0x1/dc-dir/dc-file_907 [2,head] auth (dversion lock) pv=5816 v=4550 ino=0x10000000580 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535669400] 2023-10-03T19:21:09.186 INFO:teuthology.orchestra.run.smithi045.stdout: -6248> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5815 cv=5377/5377 ap=94+93 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=220 | child=1 dirty=1 authpin=1 0x565534f82400] version 5815 2023-10-03T19:21:09.186 INFO:teuthology.orchestra.run.smithi045.stdout: -6247> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565534fb5340 v5824 2023-10-03T19:21:09.186 INFO:teuthology.orchestra.run.smithi045.stdout: -6246> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5824 cv=5384/5384 REP dir_auth=0 ap=93+94 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5824 2023-10-03T19:21:09.186 INFO:teuthology.orchestra.run.smithi045.stdout: -6245> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565534fb5220 v5817 2023-10-03T19:21:09.186 INFO:teuthology.orchestra.run.smithi045.stdout: -6244> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5817 cv=5377/5377 ap=94+93 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=220 | child=1 dirty=1 authpin=1 0x565534f82400] version 5817 2023-10-03T19:21:09.186 INFO:teuthology.orchestra.run.smithi045.stdout: -6243> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=93 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=93 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.186 INFO:teuthology.orchestra.run.smithi045.stdout: -6242> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=93) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5823 pv6007 ap=94 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=94) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=93) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.187 INFO:teuthology.orchestra.run.smithi045.stdout: -6241> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=94) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5823 pv6007 ap=94 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=94) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=92) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.187 INFO:teuthology.orchestra.run.smithi045.stdout: -6240> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000580 [2,head] /dc-dir/dc-file_907 auth v5816 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.429573+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566ab00] 2023-10-03T19:21:09.187 INFO:teuthology.orchestra.run.smithi045.stdout: -6239> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000580 [2,head] /dc-dir/dc-file_907 auth v5816 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.429573+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566ab00] 2023-10-03T19:21:09.187 INFO:teuthology.orchestra.run.smithi045.stdout: -6238> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.187 INFO:teuthology.orchestra.run.smithi045.stdout: -6237> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.187 INFO:teuthology.orchestra.run.smithi045.stdout: -6236> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.187 INFO:teuthology.orchestra.run.smithi045.stdout: -6235> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000580 [2,head] /dc-dir/dc-file_907 auth v5816 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.429573+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566ab00] 2023-10-03T19:21:09.187 INFO:teuthology.orchestra.run.smithi045.stdout: -6234> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000580 [2,head] /dc-dir/dc-file_907 auth v5816 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.429573+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566ab00] 2023-10-03T19:21:09.187 INFO:teuthology.orchestra.run.smithi045.stdout: -6233> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.187 INFO:teuthology.orchestra.run.smithi045.stdout: -6232> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 635.327, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.35e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1273.5] 2023-10-03T19:21:09.187 INFO:teuthology.orchestra.run.smithi045.stdout: -6231> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655351dcd80 on [dir 0x1 / [2,head] auth pv=6008 v=5824 cv=5384/5384 REP dir_auth=0 ap=92+94 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 92 2023-10-03T19:21:09.188 INFO:teuthology.orchestra.run.smithi045.stdout: -6230> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655351dcd80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5823 pv6007 ap=93 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=93) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=92) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 93 2023-10-03T19:21:09.188 INFO:teuthology.orchestra.run.smithi045.stdout: -6229> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5824 cv=5384/5384 REP dir_auth=0 ap=92+93 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655351dcd80 count now 92/93 2023-10-03T19:21:09.188 INFO:teuthology.orchestra.run.smithi045.stdout: -6228> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655351dcd80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5817 cv=5377/5377 ap=93+93 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=220 | child=1 dirty=1 authpin=1 0x565534f82400] count now 93 2023-10-03T19:21:09.188 INFO:teuthology.orchestra.run.smithi045.stdout: -6227> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000580) auth_unpin by 0x5655351dcd80 on [inode 0x10000000580 [2,head] /dc-dir/dc-file_907 auth v5816 s=3 n(v0 rc2023-10-03T19:17:09.429573+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553566ab00] now 0 2023-10-03T19:21:09.188 INFO:teuthology.orchestra.run.smithi045.stdout: -6226> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5817 cv=5377/5377 ap=93+92 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=220 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655351dcd80 count now 93/92 2023-10-03T19:21:09.188 INFO:teuthology.orchestra.run.smithi045.stdout: -6225> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.188 INFO:teuthology.orchestra.run.smithi045.stdout: -6224> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.188 INFO:teuthology.orchestra.run.smithi045.stdout: -6223> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000581 [2,head] /dc-dir/dc-file_908 auth v4554 pv5818 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.441394+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.441394+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553566b080] 2023-10-03T19:21:09.188 INFO:teuthology.orchestra.run.smithi045.stdout: -6222> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5825 2023-10-03T19:21:09.188 INFO:teuthology.orchestra.run.smithi045.stdout: -6221> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5825 pv6007 ap=93 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=93) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=92) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.188 INFO:teuthology.orchestra.run.smithi045.stdout: -6220> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5823 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.189 INFO:teuthology.orchestra.run.smithi045.stdout: -6219> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5824 cv=5384/5384 REP dir_auth=0 ap=92+93 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5824 2023-10-03T19:21:09.189 INFO:teuthology.orchestra.run.smithi045.stdout: -6218> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000581) pop_and_dirty_projected_inode v5818 2023-10-03T19:21:09.189 INFO:teuthology.orchestra.run.smithi045.stdout: -6217> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000581) mark_dirty [inode 0x10000000581 [2,head] /dc-dir/dc-file_908 auth v5818 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.441394+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553566b080] 2023-10-03T19:21:09.189 INFO:teuthology.orchestra.run.smithi045.stdout: -6216> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_908) mark_dirty [dentry #0x1/dc-dir/dc-file_908 [2,head] auth (dversion lock) pv=5818 v=4554 ino=0x10000000581 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535669680] 2023-10-03T19:21:09.189 INFO:teuthology.orchestra.run.smithi045.stdout: -6215> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5817 cv=5377/5377 ap=93+92 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=221 | child=1 dirty=1 authpin=1 0x565534f82400] version 5817 2023-10-03T19:21:09.189 INFO:teuthology.orchestra.run.smithi045.stdout: -6214> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565534fb5580 v5826 2023-10-03T19:21:09.189 INFO:teuthology.orchestra.run.smithi045.stdout: -6213> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5826 cv=5384/5384 REP dir_auth=0 ap=92+93 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5826 2023-10-03T19:21:09.189 INFO:teuthology.orchestra.run.smithi045.stdout: -6212> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565534fb5460 v5819 2023-10-03T19:21:09.189 INFO:teuthology.orchestra.run.smithi045.stdout: -6211> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5819 cv=5377/5377 ap=93+92 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=221 | child=1 dirty=1 authpin=1 0x565534f82400] version 5819 2023-10-03T19:21:09.189 INFO:teuthology.orchestra.run.smithi045.stdout: -6210> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=92 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=92 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.257 INFO:teuthology.orchestra.run.smithi045.stdout: -6209> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=92) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5825 pv6007 ap=93 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=93) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=92) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.257 INFO:teuthology.orchestra.run.smithi045.stdout: -6208> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=93) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5825 pv6007 ap=93 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=93) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=91) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.257 INFO:teuthology.orchestra.run.smithi045.stdout: -6207> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000581 [2,head] /dc-dir/dc-file_908 auth v5818 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.441394+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566b080] 2023-10-03T19:21:09.257 INFO:teuthology.orchestra.run.smithi045.stdout: -6206> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000581 [2,head] /dc-dir/dc-file_908 auth v5818 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.441394+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566b080] 2023-10-03T19:21:09.257 INFO:teuthology.orchestra.run.smithi045.stdout: -6205> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.257 INFO:teuthology.orchestra.run.smithi045.stdout: -6204> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.257 INFO:teuthology.orchestra.run.smithi045.stdout: -6203> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.257 INFO:teuthology.orchestra.run.smithi045.stdout: -6202> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000581 [2,head] /dc-dir/dc-file_908 auth v5818 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.441394+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566b080] 2023-10-03T19:21:09.257 INFO:teuthology.orchestra.run.smithi045.stdout: -6201> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000581 [2,head] /dc-dir/dc-file_908 auth v5818 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.441394+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566b080] 2023-10-03T19:21:09.258 INFO:teuthology.orchestra.run.smithi045.stdout: -6200> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.258 INFO:teuthology.orchestra.run.smithi045.stdout: -6199> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 636.327, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.36e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1275.5] 2023-10-03T19:21:09.258 INFO:teuthology.orchestra.run.smithi045.stdout: -6198> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655351dd200 on [dir 0x1 / [2,head] auth pv=6008 v=5826 cv=5384/5384 REP dir_auth=0 ap=91+93 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 91 2023-10-03T19:21:09.258 INFO:teuthology.orchestra.run.smithi045.stdout: -6197> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655351dd200 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5825 pv6007 ap=92 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=92) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=91) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 92 2023-10-03T19:21:09.258 INFO:teuthology.orchestra.run.smithi045.stdout: -6196> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5826 cv=5384/5384 REP dir_auth=0 ap=91+92 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655351dd200 count now 91/92 2023-10-03T19:21:09.258 INFO:teuthology.orchestra.run.smithi045.stdout: -6195> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655351dd200 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5819 cv=5377/5377 ap=92+92 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=221 | child=1 dirty=1 authpin=1 0x565534f82400] count now 92 2023-10-03T19:21:09.258 INFO:teuthology.orchestra.run.smithi045.stdout: -6194> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000581) auth_unpin by 0x5655351dd200 on [inode 0x10000000581 [2,head] /dc-dir/dc-file_908 auth v5818 s=3 n(v0 rc2023-10-03T19:17:09.441394+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553566b080] now 0 2023-10-03T19:21:09.258 INFO:teuthology.orchestra.run.smithi045.stdout: -6193> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5819 cv=5377/5377 ap=92+91 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=221 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655351dd200 count now 92/91 2023-10-03T19:21:09.258 INFO:teuthology.orchestra.run.smithi045.stdout: -6192> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.258 INFO:teuthology.orchestra.run.smithi045.stdout: -6191> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.259 INFO:teuthology.orchestra.run.smithi045.stdout: -6190> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000582 [2,head] /dc-dir/dc-file_909 auth v4558 pv5820 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.453515+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.453515+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553566b600] 2023-10-03T19:21:09.259 INFO:teuthology.orchestra.run.smithi045.stdout: -6189> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5827 2023-10-03T19:21:09.259 INFO:teuthology.orchestra.run.smithi045.stdout: -6188> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5827 pv6007 ap=92 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=92) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=91) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.259 INFO:teuthology.orchestra.run.smithi045.stdout: -6187> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5825 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.259 INFO:teuthology.orchestra.run.smithi045.stdout: -6186> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5826 cv=5384/5384 REP dir_auth=0 ap=91+92 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5826 2023-10-03T19:21:09.259 INFO:teuthology.orchestra.run.smithi045.stdout: -6185> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000582) pop_and_dirty_projected_inode v5820 2023-10-03T19:21:09.259 INFO:teuthology.orchestra.run.smithi045.stdout: -6184> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000582) mark_dirty [inode 0x10000000582 [2,head] /dc-dir/dc-file_909 auth v5820 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.453515+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553566b600] 2023-10-03T19:21:09.259 INFO:teuthology.orchestra.run.smithi045.stdout: -6183> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_909) mark_dirty [dentry #0x1/dc-dir/dc-file_909 [2,head] auth (dversion lock) pv=5820 v=4558 ino=0x10000000582 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535669900] 2023-10-03T19:21:09.259 INFO:teuthology.orchestra.run.smithi045.stdout: -6182> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5819 cv=5377/5377 ap=92+91 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=222 | child=1 dirty=1 authpin=1 0x565534f82400] version 5819 2023-10-03T19:21:09.259 INFO:teuthology.orchestra.run.smithi045.stdout: -6181> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565534fb57c0 v5828 2023-10-03T19:21:09.259 INFO:teuthology.orchestra.run.smithi045.stdout: -6180> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5828 cv=5384/5384 REP dir_auth=0 ap=91+92 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5828 2023-10-03T19:21:09.260 INFO:teuthology.orchestra.run.smithi045.stdout: -6179> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565534fb56a0 v5821 2023-10-03T19:21:09.260 INFO:teuthology.orchestra.run.smithi045.stdout: -6178> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5821 cv=5377/5377 ap=92+91 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=222 | child=1 dirty=1 authpin=1 0x565534f82400] version 5821 2023-10-03T19:21:09.260 INFO:teuthology.orchestra.run.smithi045.stdout: -6177> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=91 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=91 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.260 INFO:teuthology.orchestra.run.smithi045.stdout: -6176> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=91) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5827 pv6007 ap=92 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=92) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=91) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.260 INFO:teuthology.orchestra.run.smithi045.stdout: -6175> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=92) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5827 pv6007 ap=92 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=92) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=90) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.260 INFO:teuthology.orchestra.run.smithi045.stdout: -6174> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000582 [2,head] /dc-dir/dc-file_909 auth v5820 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.453515+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566b600] 2023-10-03T19:21:09.260 INFO:teuthology.orchestra.run.smithi045.stdout: -6173> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000582 [2,head] /dc-dir/dc-file_909 auth v5820 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.453515+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566b600] 2023-10-03T19:21:09.260 INFO:teuthology.orchestra.run.smithi045.stdout: -6172> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.260 INFO:teuthology.orchestra.run.smithi045.stdout: -6171> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.260 INFO:teuthology.orchestra.run.smithi045.stdout: -6170> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.260 INFO:teuthology.orchestra.run.smithi045.stdout: -6169> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000582 [2,head] /dc-dir/dc-file_909 auth v5820 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.453515+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566b600] 2023-10-03T19:21:09.261 INFO:teuthology.orchestra.run.smithi045.stdout: -6168> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000582 [2,head] /dc-dir/dc-file_909 auth v5820 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.453515+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566b600] 2023-10-03T19:21:09.261 INFO:teuthology.orchestra.run.smithi045.stdout: -6167> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.261 INFO:teuthology.orchestra.run.smithi045.stdout: -6166> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 637.327, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.37e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1277.5] 2023-10-03T19:21:09.261 INFO:teuthology.orchestra.run.smithi045.stdout: -6165> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655351dd680 on [dir 0x1 / [2,head] auth pv=6008 v=5828 cv=5384/5384 REP dir_auth=0 ap=90+92 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 90 2023-10-03T19:21:09.261 INFO:teuthology.orchestra.run.smithi045.stdout: -6164> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655351dd680 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5827 pv6007 ap=91 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=91) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=90) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 91 2023-10-03T19:21:09.261 INFO:teuthology.orchestra.run.smithi045.stdout: -6163> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5828 cv=5384/5384 REP dir_auth=0 ap=90+91 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655351dd680 count now 90/91 2023-10-03T19:21:09.261 INFO:teuthology.orchestra.run.smithi045.stdout: -6162> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655351dd680 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5821 cv=5377/5377 ap=91+91 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=222 | child=1 dirty=1 authpin=1 0x565534f82400] count now 91 2023-10-03T19:21:09.261 INFO:teuthology.orchestra.run.smithi045.stdout: -6161> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000582) auth_unpin by 0x5655351dd680 on [inode 0x10000000582 [2,head] /dc-dir/dc-file_909 auth v5820 s=3 n(v0 rc2023-10-03T19:17:09.453515+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553566b600] now 0 2023-10-03T19:21:09.261 INFO:teuthology.orchestra.run.smithi045.stdout: -6160> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5821 cv=5377/5377 ap=91+90 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=222 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655351dd680 count now 91/90 2023-10-03T19:21:09.261 INFO:teuthology.orchestra.run.smithi045.stdout: -6159> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.262 INFO:teuthology.orchestra.run.smithi045.stdout: -6158> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.262 INFO:teuthology.orchestra.run.smithi045.stdout: -6157> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000583 [2,head] /dc-dir/dc-file_910 auth v4562 pv5822 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.465045+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.465045+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553566bb80] 2023-10-03T19:21:09.262 INFO:teuthology.orchestra.run.smithi045.stdout: -6156> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5829 2023-10-03T19:21:09.262 INFO:teuthology.orchestra.run.smithi045.stdout: -6155> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5829 pv6007 ap=91 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=91) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=90) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.262 INFO:teuthology.orchestra.run.smithi045.stdout: -6154> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5827 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.262 INFO:teuthology.orchestra.run.smithi045.stdout: -6153> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5828 cv=5384/5384 REP dir_auth=0 ap=90+91 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5828 2023-10-03T19:21:09.262 INFO:teuthology.orchestra.run.smithi045.stdout: -6152> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000583) pop_and_dirty_projected_inode v5822 2023-10-03T19:21:09.262 INFO:teuthology.orchestra.run.smithi045.stdout: -6151> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000583) mark_dirty [inode 0x10000000583 [2,head] /dc-dir/dc-file_910 auth v5822 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.465045+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553566bb80] 2023-10-03T19:21:09.262 INFO:teuthology.orchestra.run.smithi045.stdout: -6150> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_910) mark_dirty [dentry #0x1/dc-dir/dc-file_910 [2,head] auth (dversion lock) pv=5822 v=4562 ino=0x10000000583 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535669b80] 2023-10-03T19:21:09.262 INFO:teuthology.orchestra.run.smithi045.stdout: -6149> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5821 cv=5377/5377 ap=91+90 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=223 | child=1 dirty=1 authpin=1 0x565534f82400] version 5821 2023-10-03T19:21:09.262 INFO:teuthology.orchestra.run.smithi045.stdout: -6148> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565534fb5a00 v5830 2023-10-03T19:21:09.263 INFO:teuthology.orchestra.run.smithi045.stdout: -6147> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5830 cv=5384/5384 REP dir_auth=0 ap=90+91 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5830 2023-10-03T19:21:09.318 INFO:teuthology.orchestra.run.smithi045.stdout: -6146> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565534fb58e0 v5823 2023-10-03T19:21:09.318 INFO:teuthology.orchestra.run.smithi045.stdout: -6145> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5823 cv=5377/5377 ap=91+90 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=223 | child=1 dirty=1 authpin=1 0x565534f82400] version 5823 2023-10-03T19:21:09.318 INFO:teuthology.orchestra.run.smithi045.stdout: -6144> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=90 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=90 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.318 INFO:teuthology.orchestra.run.smithi045.stdout: -6143> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=90) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5829 pv6007 ap=91 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=91) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=90) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.319 INFO:teuthology.orchestra.run.smithi045.stdout: -6142> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=91) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5829 pv6007 ap=91 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=91) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=89) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.319 INFO:teuthology.orchestra.run.smithi045.stdout: -6141> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000583 [2,head] /dc-dir/dc-file_910 auth v5822 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.465045+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566bb80] 2023-10-03T19:21:09.319 INFO:teuthology.orchestra.run.smithi045.stdout: -6140> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000583 [2,head] /dc-dir/dc-file_910 auth v5822 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.465045+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566bb80] 2023-10-03T19:21:09.319 INFO:teuthology.orchestra.run.smithi045.stdout: -6139> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.319 INFO:teuthology.orchestra.run.smithi045.stdout: -6138> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.319 INFO:teuthology.orchestra.run.smithi045.stdout: -6137> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.319 INFO:teuthology.orchestra.run.smithi045.stdout: -6136> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000583 [2,head] /dc-dir/dc-file_910 auth v5822 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.465045+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566bb80] 2023-10-03T19:21:09.319 INFO:teuthology.orchestra.run.smithi045.stdout: -6135> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000583 [2,head] /dc-dir/dc-file_910 auth v5822 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.465045+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566bb80] 2023-10-03T19:21:09.319 INFO:teuthology.orchestra.run.smithi045.stdout: -6134> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.320 INFO:teuthology.orchestra.run.smithi045.stdout: -6133> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 638.327, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.38e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1279.5] 2023-10-03T19:21:09.320 INFO:teuthology.orchestra.run.smithi045.stdout: -6132> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655351ddb00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5829 pv6007 ap=90 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=90) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=89) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 90 2023-10-03T19:21:09.320 INFO:teuthology.orchestra.run.smithi045.stdout: -6131> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5830 cv=5384/5384 REP dir_auth=0 ap=90+90 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655351ddb00 count now 90/90 2023-10-03T19:21:09.320 INFO:teuthology.orchestra.run.smithi045.stdout: -6130> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655351ddb00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5823 cv=5377/5377 ap=90+90 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=223 | child=1 dirty=1 authpin=1 0x565534f82400] count now 90 2023-10-03T19:21:09.320 INFO:teuthology.orchestra.run.smithi045.stdout: -6129> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655351ddb00 on [dir 0x1 / [2,head] auth pv=6008 v=5830 cv=5384/5384 REP dir_auth=0 ap=89+90 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 89 2023-10-03T19:21:09.320 INFO:teuthology.orchestra.run.smithi045.stdout: -6128> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000583) auth_unpin by 0x5655351ddb00 on [inode 0x10000000583 [2,head] /dc-dir/dc-file_910 auth v5822 s=3 n(v0 rc2023-10-03T19:17:09.465045+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553566bb80] now 0 2023-10-03T19:21:09.320 INFO:teuthology.orchestra.run.smithi045.stdout: -6127> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5823 cv=5377/5377 ap=90+89 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=223 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655351ddb00 count now 90/89 2023-10-03T19:21:09.320 INFO:teuthology.orchestra.run.smithi045.stdout: -6126> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.320 INFO:teuthology.orchestra.run.smithi045.stdout: -6125> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.320 INFO:teuthology.orchestra.run.smithi045.stdout: -6124> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000584 [2,head] /dc-dir/dc-file_911 auth v4566 pv5824 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.476553+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.476553+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553566c100] 2023-10-03T19:21:09.320 INFO:teuthology.orchestra.run.smithi045.stdout: -6123> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5831 2023-10-03T19:21:09.321 INFO:teuthology.orchestra.run.smithi045.stdout: -6122> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5831 pv6007 ap=90 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=90) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=89) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.321 INFO:teuthology.orchestra.run.smithi045.stdout: -6121> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5829 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.321 INFO:teuthology.orchestra.run.smithi045.stdout: -6120> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5830 cv=5384/5384 REP dir_auth=0 ap=89+90 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5830 2023-10-03T19:21:09.321 INFO:teuthology.orchestra.run.smithi045.stdout: -6119> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000584) pop_and_dirty_projected_inode v5824 2023-10-03T19:21:09.321 INFO:teuthology.orchestra.run.smithi045.stdout: -6118> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000584) mark_dirty [inode 0x10000000584 [2,head] /dc-dir/dc-file_911 auth v5824 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.476553+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553566c100] 2023-10-03T19:21:09.321 INFO:teuthology.orchestra.run.smithi045.stdout: -6117> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_911) mark_dirty [dentry #0x1/dc-dir/dc-file_911 [2,head] auth (dversion lock) pv=5824 v=4566 ino=0x10000000584 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535672000] 2023-10-03T19:21:09.321 INFO:teuthology.orchestra.run.smithi045.stdout: -6116> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5823 cv=5377/5377 ap=90+89 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=224 | child=1 dirty=1 authpin=1 0x565534f82400] version 5823 2023-10-03T19:21:09.321 INFO:teuthology.orchestra.run.smithi045.stdout: -6115> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565534fb5c40 v5832 2023-10-03T19:21:09.321 INFO:teuthology.orchestra.run.smithi045.stdout: -6114> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5832 cv=5384/5384 REP dir_auth=0 ap=89+90 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5832 2023-10-03T19:21:09.321 INFO:teuthology.orchestra.run.smithi045.stdout: -6113> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565534fb5b20 v5825 2023-10-03T19:21:09.322 INFO:teuthology.orchestra.run.smithi045.stdout: -6112> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5825 cv=5377/5377 ap=90+89 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=224 | child=1 dirty=1 authpin=1 0x565534f82400] version 5825 2023-10-03T19:21:09.322 INFO:teuthology.orchestra.run.smithi045.stdout: -6111> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=89 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=89 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.322 INFO:teuthology.orchestra.run.smithi045.stdout: -6110> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=89) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5831 pv6007 ap=90 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=90) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=89) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.322 INFO:teuthology.orchestra.run.smithi045.stdout: -6109> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=90) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5831 pv6007 ap=90 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=90) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=88) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.322 INFO:teuthology.orchestra.run.smithi045.stdout: -6108> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000584 [2,head] /dc-dir/dc-file_911 auth v5824 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.476553+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566c100] 2023-10-03T19:21:09.322 INFO:teuthology.orchestra.run.smithi045.stdout: -6107> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000584 [2,head] /dc-dir/dc-file_911 auth v5824 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.476553+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566c100] 2023-10-03T19:21:09.322 INFO:teuthology.orchestra.run.smithi045.stdout: -6106> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.322 INFO:teuthology.orchestra.run.smithi045.stdout: -6105> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.322 INFO:teuthology.orchestra.run.smithi045.stdout: -6104> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.322 INFO:teuthology.orchestra.run.smithi045.stdout: -6103> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000584 [2,head] /dc-dir/dc-file_911 auth v5824 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.476553+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566c100] 2023-10-03T19:21:09.322 INFO:teuthology.orchestra.run.smithi045.stdout: -6102> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000584 [2,head] /dc-dir/dc-file_911 auth v5824 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.476553+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566c100] 2023-10-03T19:21:09.323 INFO:teuthology.orchestra.run.smithi045.stdout: -6101> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.323 INFO:teuthology.orchestra.run.smithi045.stdout: -6100> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 639.327, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.39e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 7.00e-01] *LOAD:1281.5] 2023-10-03T19:21:09.323 INFO:teuthology.orchestra.run.smithi045.stdout: -6099> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536c16000 on [dir 0x1 / [2,head] auth pv=6008 v=5832 cv=5384/5384 REP dir_auth=0 ap=88+90 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 88 2023-10-03T19:21:09.323 INFO:teuthology.orchestra.run.smithi045.stdout: -6098> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536c16000 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5831 pv6007 ap=89 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=89) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=88) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 89 2023-10-03T19:21:09.323 INFO:teuthology.orchestra.run.smithi045.stdout: -6097> 2023-10-03T19:17:19.534+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5832 cv=5384/5384 REP dir_auth=0 ap=88+89 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536c16000 count now 88/89 2023-10-03T19:21:09.323 INFO:teuthology.orchestra.run.smithi045.stdout: -6096> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536c16000 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5825 cv=5377/5377 ap=89+89 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=224 | child=1 dirty=1 authpin=1 0x565534f82400] count now 89 2023-10-03T19:21:09.323 INFO:teuthology.orchestra.run.smithi045.stdout: -6095> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000584) auth_unpin by 0x565536c16000 on [inode 0x10000000584 [2,head] /dc-dir/dc-file_911 auth v5824 s=3 n(v0 rc2023-10-03T19:17:09.476553+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553566c100] now 0 2023-10-03T19:21:09.323 INFO:teuthology.orchestra.run.smithi045.stdout: -6094> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5825 cv=5377/5377 ap=89+88 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=224 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536c16000 count now 89/88 2023-10-03T19:21:09.323 INFO:teuthology.orchestra.run.smithi045.stdout: -6093> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.323 INFO:teuthology.orchestra.run.smithi045.stdout: -6092> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.323 INFO:teuthology.orchestra.run.smithi045.stdout: -6091> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000585 [2,head] /dc-dir/dc-file_912 auth v4570 pv5826 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.489414+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.489414+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553566c680] 2023-10-03T19:21:09.324 INFO:teuthology.orchestra.run.smithi045.stdout: -6090> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5833 2023-10-03T19:21:09.324 INFO:teuthology.orchestra.run.smithi045.stdout: -6089> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5833 pv6007 ap=89 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=89) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=88) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.324 INFO:teuthology.orchestra.run.smithi045.stdout: -6088> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5831 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.324 INFO:teuthology.orchestra.run.smithi045.stdout: -6087> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5832 cv=5384/5384 REP dir_auth=0 ap=88+89 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5832 2023-10-03T19:21:09.324 INFO:teuthology.orchestra.run.smithi045.stdout: -6086> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000585) pop_and_dirty_projected_inode v5826 2023-10-03T19:21:09.324 INFO:teuthology.orchestra.run.smithi045.stdout: -6085> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000585) mark_dirty [inode 0x10000000585 [2,head] /dc-dir/dc-file_912 auth v5826 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.489414+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553566c680] 2023-10-03T19:21:09.324 INFO:teuthology.orchestra.run.smithi045.stdout: -6084> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_912) mark_dirty [dentry #0x1/dc-dir/dc-file_912 [2,head] auth (dversion lock) pv=5826 v=4570 ino=0x10000000585 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535672280] 2023-10-03T19:21:09.324 INFO:teuthology.orchestra.run.smithi045.stdout: -6083> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5825 cv=5377/5377 ap=89+88 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=225 | child=1 dirty=1 authpin=1 0x565534f82400] version 5825 2023-10-03T19:21:09.340 INFO:teuthology.orchestra.run.smithi045.stdout: -6082> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565534fb5e80 v5834 2023-10-03T19:21:09.340 INFO:teuthology.orchestra.run.smithi045.stdout: -6081> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5834 cv=5384/5384 REP dir_auth=0 ap=88+89 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5834 2023-10-03T19:21:09.340 INFO:teuthology.orchestra.run.smithi045.stdout: -6080> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565534fb5d60 v5827 2023-10-03T19:21:09.341 INFO:teuthology.orchestra.run.smithi045.stdout: -6079> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5827 cv=5377/5377 ap=89+88 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=225 | child=1 dirty=1 authpin=1 0x565534f82400] version 5827 2023-10-03T19:21:09.341 INFO:teuthology.orchestra.run.smithi045.stdout: -6078> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=88 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=88 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.341 INFO:teuthology.orchestra.run.smithi045.stdout: -6077> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=88) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5833 pv6007 ap=89 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=89) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=88) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.341 INFO:teuthology.orchestra.run.smithi045.stdout: -6076> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=89) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5833 pv6007 ap=89 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=89) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=87) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.341 INFO:teuthology.orchestra.run.smithi045.stdout: -6075> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000585 [2,head] /dc-dir/dc-file_912 auth v5826 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.489414+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566c680] 2023-10-03T19:21:09.341 INFO:teuthology.orchestra.run.smithi045.stdout: -6074> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000585 [2,head] /dc-dir/dc-file_912 auth v5826 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.489414+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566c680] 2023-10-03T19:21:09.341 INFO:teuthology.orchestra.run.smithi045.stdout: -6073> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.341 INFO:teuthology.orchestra.run.smithi045.stdout: -6072> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.341 INFO:teuthology.orchestra.run.smithi045.stdout: -6071> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.341 INFO:teuthology.orchestra.run.smithi045.stdout: -6070> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000585 [2,head] /dc-dir/dc-file_912 auth v5826 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.489414+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566c680] 2023-10-03T19:21:09.341 INFO:teuthology.orchestra.run.smithi045.stdout: -6069> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000585 [2,head] /dc-dir/dc-file_912 auth v5826 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.489414+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566c680] 2023-10-03T19:21:09.342 INFO:teuthology.orchestra.run.smithi045.stdout: -6068> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.342 INFO:teuthology.orchestra.run.smithi045.stdout: -6067> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 639.972, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.40e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1282.7] 2023-10-03T19:21:09.342 INFO:teuthology.orchestra.run.smithi045.stdout: -6066> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536c16480 on [dir 0x1 / [2,head] auth pv=6008 v=5834 cv=5384/5384 REP dir_auth=0 ap=87+89 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 87 2023-10-03T19:21:09.342 INFO:teuthology.orchestra.run.smithi045.stdout: -6065> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536c16480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5833 pv6007 ap=88 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=88) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=87) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 88 2023-10-03T19:21:09.342 INFO:teuthology.orchestra.run.smithi045.stdout: -6064> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5834 cv=5384/5384 REP dir_auth=0 ap=87+88 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536c16480 count now 87/88 2023-10-03T19:21:09.342 INFO:teuthology.orchestra.run.smithi045.stdout: -6063> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536c16480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5827 cv=5377/5377 ap=88+88 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=225 | child=1 dirty=1 authpin=1 0x565534f82400] count now 88 2023-10-03T19:21:09.342 INFO:teuthology.orchestra.run.smithi045.stdout: -6062> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000585) auth_unpin by 0x565536c16480 on [inode 0x10000000585 [2,head] /dc-dir/dc-file_912 auth v5826 s=3 n(v0 rc2023-10-03T19:17:09.489414+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553566c680] now 0 2023-10-03T19:21:09.342 INFO:teuthology.orchestra.run.smithi045.stdout: -6061> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5827 cv=5377/5377 ap=88+87 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=225 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536c16480 count now 88/87 2023-10-03T19:21:09.342 INFO:teuthology.orchestra.run.smithi045.stdout: -6060> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.342 INFO:teuthology.orchestra.run.smithi045.stdout: -6059> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.342 INFO:teuthology.orchestra.run.smithi045.stdout: -6058> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000586 [2,head] /dc-dir/dc-file_913 auth v4574 pv5828 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.501866+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.501866+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553566cc00] 2023-10-03T19:21:09.343 INFO:teuthology.orchestra.run.smithi045.stdout: -6057> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5835 2023-10-03T19:21:09.343 INFO:teuthology.orchestra.run.smithi045.stdout: -6056> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5835 pv6007 ap=88 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=88) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=87) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.343 INFO:teuthology.orchestra.run.smithi045.stdout: -6055> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5833 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.343 INFO:teuthology.orchestra.run.smithi045.stdout: -6054> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5834 cv=5384/5384 REP dir_auth=0 ap=87+88 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5834 2023-10-03T19:21:09.343 INFO:teuthology.orchestra.run.smithi045.stdout: -6053> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000586) pop_and_dirty_projected_inode v5828 2023-10-03T19:21:09.343 INFO:teuthology.orchestra.run.smithi045.stdout: -6052> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000586) mark_dirty [inode 0x10000000586 [2,head] /dc-dir/dc-file_913 auth v5828 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.501866+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553566cc00] 2023-10-03T19:21:09.343 INFO:teuthology.orchestra.run.smithi045.stdout: -6051> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_913) mark_dirty [dentry #0x1/dc-dir/dc-file_913 [2,head] auth (dversion lock) pv=5828 v=4574 ino=0x10000000586 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535672500] 2023-10-03T19:21:09.343 INFO:teuthology.orchestra.run.smithi045.stdout: -6050> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5827 cv=5377/5377 ap=88+87 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=226 | child=1 dirty=1 authpin=1 0x565534f82400] version 5827 2023-10-03T19:21:09.343 INFO:teuthology.orchestra.run.smithi045.stdout: -6049> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536c18140 v5836 2023-10-03T19:21:09.343 INFO:teuthology.orchestra.run.smithi045.stdout: -6048> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5836 cv=5384/5384 REP dir_auth=0 ap=87+88 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5836 2023-10-03T19:21:09.345 INFO:teuthology.orchestra.run.smithi045.stdout: -6047> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536c18020 v5829 2023-10-03T19:21:09.345 INFO:teuthology.orchestra.run.smithi045.stdout: -6046> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5829 cv=5377/5377 ap=88+87 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=226 | child=1 dirty=1 authpin=1 0x565534f82400] version 5829 2023-10-03T19:21:09.345 INFO:teuthology.orchestra.run.smithi045.stdout: -6045> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=87 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=87 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.345 INFO:teuthology.orchestra.run.smithi045.stdout: -6044> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=87) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5835 pv6007 ap=88 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=88) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=87) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.345 INFO:teuthology.orchestra.run.smithi045.stdout: -6043> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=88) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5835 pv6007 ap=88 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=88) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=86) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.345 INFO:teuthology.orchestra.run.smithi045.stdout: -6042> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000586 [2,head] /dc-dir/dc-file_913 auth v5828 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.501866+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566cc00] 2023-10-03T19:21:09.345 INFO:teuthology.orchestra.run.smithi045.stdout: -6041> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000586 [2,head] /dc-dir/dc-file_913 auth v5828 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.501866+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566cc00] 2023-10-03T19:21:09.345 INFO:teuthology.orchestra.run.smithi045.stdout: -6040> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.346 INFO:teuthology.orchestra.run.smithi045.stdout: -6039> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.346 INFO:teuthology.orchestra.run.smithi045.stdout: -6038> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.346 INFO:teuthology.orchestra.run.smithi045.stdout: -6037> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000586 [2,head] /dc-dir/dc-file_913 auth v5828 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.501866+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566cc00] 2023-10-03T19:21:09.346 INFO:teuthology.orchestra.run.smithi045.stdout: -6036> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000586 [2,head] /dc-dir/dc-file_913 auth v5828 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.501866+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566cc00] 2023-10-03T19:21:09.346 INFO:teuthology.orchestra.run.smithi045.stdout: -6035> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.346 INFO:teuthology.orchestra.run.smithi045.stdout: -6034> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 640.972, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.41e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1284.7] 2023-10-03T19:21:09.346 INFO:teuthology.orchestra.run.smithi045.stdout: -6033> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536c16900 on [dir 0x1 / [2,head] auth pv=6008 v=5836 cv=5384/5384 REP dir_auth=0 ap=86+88 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 86 2023-10-03T19:21:09.346 INFO:teuthology.orchestra.run.smithi045.stdout: -6032> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536c16900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5829 cv=5377/5377 ap=87+87 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=226 | child=1 dirty=1 authpin=1 0x565534f82400] count now 87 2023-10-03T19:21:09.346 INFO:teuthology.orchestra.run.smithi045.stdout: -6031> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536c16900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5835 pv6007 ap=87 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=87) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=86) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 87 2023-10-03T19:21:09.346 INFO:teuthology.orchestra.run.smithi045.stdout: -6030> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5836 cv=5384/5384 REP dir_auth=0 ap=86+87 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536c16900 count now 86/87 2023-10-03T19:21:09.346 INFO:teuthology.orchestra.run.smithi045.stdout: -6029> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000586) auth_unpin by 0x565536c16900 on [inode 0x10000000586 [2,head] /dc-dir/dc-file_913 auth v5828 s=3 n(v0 rc2023-10-03T19:17:09.501866+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553566cc00] now 0 2023-10-03T19:21:09.347 INFO:teuthology.orchestra.run.smithi045.stdout: -6028> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5829 cv=5377/5377 ap=87+86 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=226 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536c16900 count now 87/86 2023-10-03T19:21:09.347 INFO:teuthology.orchestra.run.smithi045.stdout: -6027> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.347 INFO:teuthology.orchestra.run.smithi045.stdout: -6026> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.347 INFO:teuthology.orchestra.run.smithi045.stdout: -6025> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000587 [2,head] /dc-dir/dc-file_914 auth v4746 pv5830 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.594540+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.594540+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553566d180] 2023-10-03T19:21:09.347 INFO:teuthology.orchestra.run.smithi045.stdout: -6024> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5837 2023-10-03T19:21:09.347 INFO:teuthology.orchestra.run.smithi045.stdout: -6023> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5837 pv6007 ap=87 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=87) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=86) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.347 INFO:teuthology.orchestra.run.smithi045.stdout: -6022> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5835 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.347 INFO:teuthology.orchestra.run.smithi045.stdout: -6021> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5836 cv=5384/5384 REP dir_auth=0 ap=86+87 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5836 2023-10-03T19:21:09.347 INFO:teuthology.orchestra.run.smithi045.stdout: -6020> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000587) pop_and_dirty_projected_inode v5830 2023-10-03T19:21:09.347 INFO:teuthology.orchestra.run.smithi045.stdout: -6019> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000587) mark_dirty [inode 0x10000000587 [2,head] /dc-dir/dc-file_914 auth v5830 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.594540+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553566d180] 2023-10-03T19:21:09.348 INFO:teuthology.orchestra.run.smithi045.stdout: -6018> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_914) mark_dirty [dentry #0x1/dc-dir/dc-file_914 [2,head] auth (dversion lock) pv=5830 v=4746 ino=0x10000000587 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535672780] 2023-10-03T19:21:09.348 INFO:teuthology.orchestra.run.smithi045.stdout: -6017> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5829 cv=5377/5377 ap=87+86 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=227 | child=1 dirty=1 authpin=1 0x565534f82400] version 5829 2023-10-03T19:21:09.348 INFO:teuthology.orchestra.run.smithi045.stdout: -6016> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536c18380 v5838 2023-10-03T19:21:09.348 INFO:teuthology.orchestra.run.smithi045.stdout: -6015> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5838 cv=5384/5384 REP dir_auth=0 ap=86+87 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5838 2023-10-03T19:21:09.348 INFO:teuthology.orchestra.run.smithi045.stdout: -6014> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536c18260 v5831 2023-10-03T19:21:09.348 INFO:teuthology.orchestra.run.smithi045.stdout: -6013> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5831 cv=5377/5377 ap=87+86 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=227 | child=1 dirty=1 authpin=1 0x565534f82400] version 5831 2023-10-03T19:21:09.348 INFO:teuthology.orchestra.run.smithi045.stdout: -6012> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=86 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=86 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.412 INFO:teuthology.orchestra.run.smithi045.stdout: -6011> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=86) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5837 pv6007 ap=87 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=87) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=86) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.412 INFO:teuthology.orchestra.run.smithi045.stdout: -6010> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=87) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5837 pv6007 ap=87 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=87) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=85) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.413 INFO:teuthology.orchestra.run.smithi045.stdout: -6009> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000587 [2,head] /dc-dir/dc-file_914 auth v5830 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.594540+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566d180] 2023-10-03T19:21:09.413 INFO:teuthology.orchestra.run.smithi045.stdout: -6008> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000587 [2,head] /dc-dir/dc-file_914 auth v5830 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.594540+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566d180] 2023-10-03T19:21:09.413 INFO:teuthology.orchestra.run.smithi045.stdout: -6007> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.413 INFO:teuthology.orchestra.run.smithi045.stdout: -6006> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.413 INFO:teuthology.orchestra.run.smithi045.stdout: -6005> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.413 INFO:teuthology.orchestra.run.smithi045.stdout: -6004> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000587 [2,head] /dc-dir/dc-file_914 auth v5830 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.594540+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566d180] 2023-10-03T19:21:09.413 INFO:teuthology.orchestra.run.smithi045.stdout: -6003> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000587 [2,head] /dc-dir/dc-file_914 auth v5830 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.594540+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566d180] 2023-10-03T19:21:09.413 INFO:teuthology.orchestra.run.smithi045.stdout: -6002> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.413 INFO:teuthology.orchestra.run.smithi045.stdout: -6001> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 641.972, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.42e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1286.7] 2023-10-03T19:21:09.413 INFO:teuthology.orchestra.run.smithi045.stdout: -6000> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536c16d80 on [dir 0x1 / [2,head] auth pv=6008 v=5838 cv=5384/5384 REP dir_auth=0 ap=85+87 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 85 2023-10-03T19:21:09.414 INFO:teuthology.orchestra.run.smithi045.stdout: -5999> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536c16d80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5837 pv6007 ap=86 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=86) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=85) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 86 2023-10-03T19:21:09.414 INFO:teuthology.orchestra.run.smithi045.stdout: -5998> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5838 cv=5384/5384 REP dir_auth=0 ap=85+86 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536c16d80 count now 85/86 2023-10-03T19:21:09.414 INFO:teuthology.orchestra.run.smithi045.stdout: -5997> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536c16d80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5831 cv=5377/5377 ap=86+86 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=227 | child=1 dirty=1 authpin=1 0x565534f82400] count now 86 2023-10-03T19:21:09.414 INFO:teuthology.orchestra.run.smithi045.stdout: -5996> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000587) auth_unpin by 0x565536c16d80 on [inode 0x10000000587 [2,head] /dc-dir/dc-file_914 auth v5830 s=3 n(v0 rc2023-10-03T19:17:09.594540+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553566d180] now 0 2023-10-03T19:21:09.414 INFO:teuthology.orchestra.run.smithi045.stdout: -5995> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5831 cv=5377/5377 ap=86+85 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=227 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536c16d80 count now 86/85 2023-10-03T19:21:09.414 INFO:teuthology.orchestra.run.smithi045.stdout: -5994> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.414 INFO:teuthology.orchestra.run.smithi045.stdout: -5993> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.414 INFO:teuthology.orchestra.run.smithi045.stdout: -5992> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000588 [2,head] /dc-dir/dc-file_915 auth v4750 pv5832 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.652886+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.652886+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553566d700] 2023-10-03T19:21:09.414 INFO:teuthology.orchestra.run.smithi045.stdout: -5991> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5839 2023-10-03T19:21:09.414 INFO:teuthology.orchestra.run.smithi045.stdout: -5990> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5839 pv6007 ap=86 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=86) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=85) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.415 INFO:teuthology.orchestra.run.smithi045.stdout: -5989> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5837 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.415 INFO:teuthology.orchestra.run.smithi045.stdout: -5988> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5838 cv=5384/5384 REP dir_auth=0 ap=85+86 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5838 2023-10-03T19:21:09.415 INFO:teuthology.orchestra.run.smithi045.stdout: -5987> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000588) pop_and_dirty_projected_inode v5832 2023-10-03T19:21:09.415 INFO:teuthology.orchestra.run.smithi045.stdout: -5986> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000588) mark_dirty [inode 0x10000000588 [2,head] /dc-dir/dc-file_915 auth v5832 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.652886+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553566d700] 2023-10-03T19:21:09.415 INFO:teuthology.orchestra.run.smithi045.stdout: -5985> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_915) mark_dirty [dentry #0x1/dc-dir/dc-file_915 [2,head] auth (dversion lock) pv=5832 v=4750 ino=0x10000000588 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535672a00] 2023-10-03T19:21:09.415 INFO:teuthology.orchestra.run.smithi045.stdout: -5984> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5831 cv=5377/5377 ap=86+85 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=228 | child=1 dirty=1 authpin=1 0x565534f82400] version 5831 2023-10-03T19:21:09.415 INFO:teuthology.orchestra.run.smithi045.stdout: -5983> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536c185c0 v5840 2023-10-03T19:21:09.415 INFO:teuthology.orchestra.run.smithi045.stdout: -5982> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5840 cv=5384/5384 REP dir_auth=0 ap=85+86 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5840 2023-10-03T19:21:09.415 INFO:teuthology.orchestra.run.smithi045.stdout: -5981> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536c184a0 v5833 2023-10-03T19:21:09.415 INFO:teuthology.orchestra.run.smithi045.stdout: -5980> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5833 cv=5377/5377 ap=86+85 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=228 | child=1 dirty=1 authpin=1 0x565534f82400] version 5833 2023-10-03T19:21:09.415 INFO:teuthology.orchestra.run.smithi045.stdout: -5979> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=85 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=85 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.416 INFO:teuthology.orchestra.run.smithi045.stdout: -5978> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=85) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5839 pv6007 ap=86 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=86) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=85) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.416 INFO:teuthology.orchestra.run.smithi045.stdout: -5977> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=86) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5839 pv6007 ap=86 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=86) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=84) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.416 INFO:teuthology.orchestra.run.smithi045.stdout: -5976> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000588 [2,head] /dc-dir/dc-file_915 auth v5832 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.652886+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566d700] 2023-10-03T19:21:09.416 INFO:teuthology.orchestra.run.smithi045.stdout: -5975> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000588 [2,head] /dc-dir/dc-file_915 auth v5832 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.652886+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566d700] 2023-10-03T19:21:09.416 INFO:teuthology.orchestra.run.smithi045.stdout: -5974> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.416 INFO:teuthology.orchestra.run.smithi045.stdout: -5973> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.416 INFO:teuthology.orchestra.run.smithi045.stdout: -5972> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.416 INFO:teuthology.orchestra.run.smithi045.stdout: -5971> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000588 [2,head] /dc-dir/dc-file_915 auth v5832 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.652886+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566d700] 2023-10-03T19:21:09.416 INFO:teuthology.orchestra.run.smithi045.stdout: -5970> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000588 [2,head] /dc-dir/dc-file_915 auth v5832 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.652886+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553566d700] 2023-10-03T19:21:09.416 INFO:teuthology.orchestra.run.smithi045.stdout: -5969> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.416 INFO:teuthology.orchestra.run.smithi045.stdout: -5968> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 642.972, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.43e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1288.7] 2023-10-03T19:21:09.417 INFO:teuthology.orchestra.run.smithi045.stdout: -5967> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536c17200 on [dir 0x1 / [2,head] auth pv=6008 v=5840 cv=5384/5384 REP dir_auth=0 ap=84+86 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 84 2023-10-03T19:21:09.417 INFO:teuthology.orchestra.run.smithi045.stdout: -5966> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536c17200 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5839 pv6007 ap=85 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=85) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=84) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 85 2023-10-03T19:21:09.417 INFO:teuthology.orchestra.run.smithi045.stdout: -5965> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5840 cv=5384/5384 REP dir_auth=0 ap=84+85 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536c17200 count now 84/85 2023-10-03T19:21:09.417 INFO:teuthology.orchestra.run.smithi045.stdout: -5964> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536c17200 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5833 cv=5377/5377 ap=85+85 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=228 | child=1 dirty=1 authpin=1 0x565534f82400] count now 85 2023-10-03T19:21:09.417 INFO:teuthology.orchestra.run.smithi045.stdout: -5963> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000588) auth_unpin by 0x565536c17200 on [inode 0x10000000588 [2,head] /dc-dir/dc-file_915 auth v5832 s=3 n(v0 rc2023-10-03T19:17:09.652886+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553566d700] now 0 2023-10-03T19:21:09.417 INFO:teuthology.orchestra.run.smithi045.stdout: -5962> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5833 cv=5377/5377 ap=85+84 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=228 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536c17200 count now 85/84 2023-10-03T19:21:09.417 INFO:teuthology.orchestra.run.smithi045.stdout: -5961> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.417 INFO:teuthology.orchestra.run.smithi045.stdout: -5960> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.417 INFO:teuthology.orchestra.run.smithi045.stdout: -5959> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000589 [2,head] /dc-dir/dc-file_916 auth v4754 pv5834 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.664708+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.664708+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553568e000] 2023-10-03T19:21:09.417 INFO:teuthology.orchestra.run.smithi045.stdout: -5958> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5841 2023-10-03T19:21:09.418 INFO:teuthology.orchestra.run.smithi045.stdout: -5957> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5841 pv6007 ap=85 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=85) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=84) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.418 INFO:teuthology.orchestra.run.smithi045.stdout: -5956> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5839 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.418 INFO:teuthology.orchestra.run.smithi045.stdout: -5955> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5840 cv=5384/5384 REP dir_auth=0 ap=84+85 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5840 2023-10-03T19:21:09.418 INFO:teuthology.orchestra.run.smithi045.stdout: -5954> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000589) pop_and_dirty_projected_inode v5834 2023-10-03T19:21:09.418 INFO:teuthology.orchestra.run.smithi045.stdout: -5953> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000589) mark_dirty [inode 0x10000000589 [2,head] /dc-dir/dc-file_916 auth v5834 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.664708+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553568e000] 2023-10-03T19:21:09.418 INFO:teuthology.orchestra.run.smithi045.stdout: -5952> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_916) mark_dirty [dentry #0x1/dc-dir/dc-file_916 [2,head] auth (dversion lock) pv=5834 v=4754 ino=0x10000000589 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535672c80] 2023-10-03T19:21:09.418 INFO:teuthology.orchestra.run.smithi045.stdout: -5951> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5833 cv=5377/5377 ap=85+84 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=229 | child=1 dirty=1 authpin=1 0x565534f82400] version 5833 2023-10-03T19:21:09.418 INFO:teuthology.orchestra.run.smithi045.stdout: -5950> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536c18800 v5842 2023-10-03T19:21:09.418 INFO:teuthology.orchestra.run.smithi045.stdout: -5949> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5842 cv=5384/5384 REP dir_auth=0 ap=84+85 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5842 2023-10-03T19:21:09.418 INFO:teuthology.orchestra.run.smithi045.stdout: -5948> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536c186e0 v5835 2023-10-03T19:21:09.418 INFO:teuthology.orchestra.run.smithi045.stdout: -5947> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5835 cv=5377/5377 ap=85+84 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=229 | child=1 dirty=1 authpin=1 0x565534f82400] version 5835 2023-10-03T19:21:09.453 INFO:teuthology.orchestra.run.smithi045.stdout: -5946> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=84 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=84 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.453 INFO:teuthology.orchestra.run.smithi045.stdout: -5945> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=84) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5841 pv6007 ap=85 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=85) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=84) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.453 INFO:teuthology.orchestra.run.smithi045.stdout: -5944> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=85) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5841 pv6007 ap=85 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=85) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=83) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.453 INFO:teuthology.orchestra.run.smithi045.stdout: -5943> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000589 [2,head] /dc-dir/dc-file_916 auth v5834 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.664708+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553568e000] 2023-10-03T19:21:09.453 INFO:teuthology.orchestra.run.smithi045.stdout: -5942> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000589 [2,head] /dc-dir/dc-file_916 auth v5834 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.664708+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553568e000] 2023-10-03T19:21:09.453 INFO:teuthology.orchestra.run.smithi045.stdout: -5941> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.453 INFO:teuthology.orchestra.run.smithi045.stdout: -5940> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.453 INFO:teuthology.orchestra.run.smithi045.stdout: -5939> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.453 INFO:teuthology.orchestra.run.smithi045.stdout: -5938> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000589 [2,head] /dc-dir/dc-file_916 auth v5834 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.664708+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553568e000] 2023-10-03T19:21:09.453 INFO:teuthology.orchestra.run.smithi045.stdout: -5937> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000589 [2,head] /dc-dir/dc-file_916 auth v5834 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.664708+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553568e000] 2023-10-03T19:21:09.453 INFO:teuthology.orchestra.run.smithi045.stdout: -5936> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.454 INFO:teuthology.orchestra.run.smithi045.stdout: -5935> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 643.972, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.44e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1290.7] 2023-10-03T19:21:09.454 INFO:teuthology.orchestra.run.smithi045.stdout: -5934> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536c17680 on [dir 0x1 / [2,head] auth pv=6008 v=5842 cv=5384/5384 REP dir_auth=0 ap=83+85 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 83 2023-10-03T19:21:09.454 INFO:teuthology.orchestra.run.smithi045.stdout: -5933> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536c17680 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5841 pv6007 ap=84 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=84) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=83) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 84 2023-10-03T19:21:09.454 INFO:teuthology.orchestra.run.smithi045.stdout: -5932> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5842 cv=5384/5384 REP dir_auth=0 ap=83+84 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536c17680 count now 83/84 2023-10-03T19:21:09.454 INFO:teuthology.orchestra.run.smithi045.stdout: -5931> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536c17680 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5835 cv=5377/5377 ap=84+84 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=229 | child=1 dirty=1 authpin=1 0x565534f82400] count now 84 2023-10-03T19:21:09.454 INFO:teuthology.orchestra.run.smithi045.stdout: -5930> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000589) auth_unpin by 0x565536c17680 on [inode 0x10000000589 [2,head] /dc-dir/dc-file_916 auth v5834 s=3 n(v0 rc2023-10-03T19:17:09.664708+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553568e000] now 0 2023-10-03T19:21:09.454 INFO:teuthology.orchestra.run.smithi045.stdout: -5929> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5835 cv=5377/5377 ap=84+83 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=229 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536c17680 count now 84/83 2023-10-03T19:21:09.454 INFO:teuthology.orchestra.run.smithi045.stdout: -5928> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.454 INFO:teuthology.orchestra.run.smithi045.stdout: -5927> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.454 INFO:teuthology.orchestra.run.smithi045.stdout: -5926> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000058a [2,head] /dc-dir/dc-file_917 auth v4758 pv5836 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.676421+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.676421+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553568e580] 2023-10-03T19:21:09.455 INFO:teuthology.orchestra.run.smithi045.stdout: -5925> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5843 2023-10-03T19:21:09.455 INFO:teuthology.orchestra.run.smithi045.stdout: -5924> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5843 pv6007 ap=84 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=84) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=83) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.455 INFO:teuthology.orchestra.run.smithi045.stdout: -5923> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5841 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.455 INFO:teuthology.orchestra.run.smithi045.stdout: -5922> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5842 cv=5384/5384 REP dir_auth=0 ap=83+84 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5842 2023-10-03T19:21:09.455 INFO:teuthology.orchestra.run.smithi045.stdout: -5921> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000058a) pop_and_dirty_projected_inode v5836 2023-10-03T19:21:09.455 INFO:teuthology.orchestra.run.smithi045.stdout: -5920> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000058a) mark_dirty [inode 0x1000000058a [2,head] /dc-dir/dc-file_917 auth v5836 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.676421+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553568e580] 2023-10-03T19:21:09.455 INFO:teuthology.orchestra.run.smithi045.stdout: -5919> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_917) mark_dirty [dentry #0x1/dc-dir/dc-file_917 [2,head] auth (dversion lock) pv=5836 v=4758 ino=0x1000000058a state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535672f00] 2023-10-03T19:21:09.455 INFO:teuthology.orchestra.run.smithi045.stdout: -5918> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5835 cv=5377/5377 ap=84+83 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=230 | child=1 dirty=1 authpin=1 0x565534f82400] version 5835 2023-10-03T19:21:09.455 INFO:teuthology.orchestra.run.smithi045.stdout: -5917> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536c18a40 v5844 2023-10-03T19:21:09.455 INFO:teuthology.orchestra.run.smithi045.stdout: -5916> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5844 cv=5384/5384 REP dir_auth=0 ap=83+84 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5844 2023-10-03T19:21:09.455 INFO:teuthology.orchestra.run.smithi045.stdout: -5915> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536c18920 v5837 2023-10-03T19:21:09.456 INFO:teuthology.orchestra.run.smithi045.stdout: -5914> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5837 cv=5377/5377 ap=84+83 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=230 | child=1 dirty=1 authpin=1 0x565534f82400] version 5837 2023-10-03T19:21:09.456 INFO:teuthology.orchestra.run.smithi045.stdout: -5913> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=83 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=83 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.456 INFO:teuthology.orchestra.run.smithi045.stdout: -5912> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=83) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5843 pv6007 ap=84 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=84) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=83) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.456 INFO:teuthology.orchestra.run.smithi045.stdout: -5911> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=84) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5843 pv6007 ap=84 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=84) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=82) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.456 INFO:teuthology.orchestra.run.smithi045.stdout: -5910> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000058a [2,head] /dc-dir/dc-file_917 auth v5836 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.676421+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553568e580] 2023-10-03T19:21:09.456 INFO:teuthology.orchestra.run.smithi045.stdout: -5909> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000058a [2,head] /dc-dir/dc-file_917 auth v5836 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.676421+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553568e580] 2023-10-03T19:21:09.456 INFO:teuthology.orchestra.run.smithi045.stdout: -5908> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.456 INFO:teuthology.orchestra.run.smithi045.stdout: -5907> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.456 INFO:teuthology.orchestra.run.smithi045.stdout: -5906> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.456 INFO:teuthology.orchestra.run.smithi045.stdout: -5905> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000058a [2,head] /dc-dir/dc-file_917 auth v5836 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.676421+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553568e580] 2023-10-03T19:21:09.456 INFO:teuthology.orchestra.run.smithi045.stdout: -5904> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000058a [2,head] /dc-dir/dc-file_917 auth v5836 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.676421+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553568e580] 2023-10-03T19:21:09.457 INFO:teuthology.orchestra.run.smithi045.stdout: -5903> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.457 INFO:teuthology.orchestra.run.smithi045.stdout: -5902> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 644.972, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.45e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1292.7] 2023-10-03T19:21:09.457 INFO:teuthology.orchestra.run.smithi045.stdout: -5901> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536c17b00 on [dir 0x1 / [2,head] auth pv=6008 v=5844 cv=5384/5384 REP dir_auth=0 ap=82+84 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 82 2023-10-03T19:21:09.457 INFO:teuthology.orchestra.run.smithi045.stdout: -5900> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536c17b00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5843 pv6007 ap=83 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=83) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=82) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 83 2023-10-03T19:21:09.457 INFO:teuthology.orchestra.run.smithi045.stdout: -5899> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5844 cv=5384/5384 REP dir_auth=0 ap=82+83 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536c17b00 count now 82/83 2023-10-03T19:21:09.457 INFO:teuthology.orchestra.run.smithi045.stdout: -5898> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536c17b00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5837 cv=5377/5377 ap=83+83 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=230 | child=1 dirty=1 authpin=1 0x565534f82400] count now 83 2023-10-03T19:21:09.457 INFO:teuthology.orchestra.run.smithi045.stdout: -5897> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000058a) auth_unpin by 0x565536c17b00 on [inode 0x1000000058a [2,head] /dc-dir/dc-file_917 auth v5836 s=3 n(v0 rc2023-10-03T19:17:09.676421+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553568e580] now 0 2023-10-03T19:21:09.457 INFO:teuthology.orchestra.run.smithi045.stdout: -5896> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5837 cv=5377/5377 ap=83+82 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=230 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536c17b00 count now 83/82 2023-10-03T19:21:09.457 INFO:teuthology.orchestra.run.smithi045.stdout: -5895> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.457 INFO:teuthology.orchestra.run.smithi045.stdout: -5894> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.457 INFO:teuthology.orchestra.run.smithi045.stdout: -5893> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000058b [2,head] /dc-dir/dc-file_918 auth v4762 pv5838 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.688592+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.688592+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553568eb00] 2023-10-03T19:21:09.457 INFO:teuthology.orchestra.run.smithi045.stdout: -5892> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5845 2023-10-03T19:21:09.458 INFO:teuthology.orchestra.run.smithi045.stdout: -5891> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5845 pv6007 ap=83 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=83) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=82) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.458 INFO:teuthology.orchestra.run.smithi045.stdout: -5890> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5843 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.458 INFO:teuthology.orchestra.run.smithi045.stdout: -5889> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5844 cv=5384/5384 REP dir_auth=0 ap=82+83 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5844 2023-10-03T19:21:09.458 INFO:teuthology.orchestra.run.smithi045.stdout: -5888> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000058b) pop_and_dirty_projected_inode v5838 2023-10-03T19:21:09.458 INFO:teuthology.orchestra.run.smithi045.stdout: -5887> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000058b) mark_dirty [inode 0x1000000058b [2,head] /dc-dir/dc-file_918 auth v5838 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.688592+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553568eb00] 2023-10-03T19:21:09.458 INFO:teuthology.orchestra.run.smithi045.stdout: -5886> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_918) mark_dirty [dentry #0x1/dc-dir/dc-file_918 [2,head] auth (dversion lock) pv=5838 v=4762 ino=0x1000000058b state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535673180] 2023-10-03T19:21:09.458 INFO:teuthology.orchestra.run.smithi045.stdout: -5885> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5837 cv=5377/5377 ap=83+82 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=231 | child=1 dirty=1 authpin=1 0x565534f82400] version 5837 2023-10-03T19:21:09.458 INFO:teuthology.orchestra.run.smithi045.stdout: -5884> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536c18c80 v5846 2023-10-03T19:21:09.458 INFO:teuthology.orchestra.run.smithi045.stdout: -5883> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5846 cv=5384/5384 REP dir_auth=0 ap=82+83 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5846 2023-10-03T19:21:09.458 INFO:teuthology.orchestra.run.smithi045.stdout: -5882> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536c18b60 v5839 2023-10-03T19:21:09.459 INFO:teuthology.orchestra.run.smithi045.stdout: -5881> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5839 cv=5377/5377 ap=83+82 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=231 | child=1 dirty=1 authpin=1 0x565534f82400] version 5839 2023-10-03T19:21:09.489 INFO:teuthology.orchestra.run.smithi045.stdout: -5880> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=82 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=82 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.489 INFO:teuthology.orchestra.run.smithi045.stdout: -5879> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=82) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5845 pv6007 ap=83 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=83) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=82) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.489 INFO:teuthology.orchestra.run.smithi045.stdout: -5878> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=83) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5845 pv6007 ap=83 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=83) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=81) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.489 INFO:teuthology.orchestra.run.smithi045.stdout: -5877> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000058b [2,head] /dc-dir/dc-file_918 auth v5838 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.688592+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553568eb00] 2023-10-03T19:21:09.489 INFO:teuthology.orchestra.run.smithi045.stdout: -5876> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000058b [2,head] /dc-dir/dc-file_918 auth v5838 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.688592+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553568eb00] 2023-10-03T19:21:09.489 INFO:teuthology.orchestra.run.smithi045.stdout: -5875> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.490 INFO:teuthology.orchestra.run.smithi045.stdout: -5874> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.490 INFO:teuthology.orchestra.run.smithi045.stdout: -5873> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.490 INFO:teuthology.orchestra.run.smithi045.stdout: -5872> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000058b [2,head] /dc-dir/dc-file_918 auth v5838 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.688592+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553568eb00] 2023-10-03T19:21:09.490 INFO:teuthology.orchestra.run.smithi045.stdout: -5871> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000058b [2,head] /dc-dir/dc-file_918 auth v5838 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.688592+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553568eb00] 2023-10-03T19:21:09.490 INFO:teuthology.orchestra.run.smithi045.stdout: -5870> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.490 INFO:teuthology.orchestra.run.smithi045.stdout: -5869> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 645.972, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.46e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1294.7] 2023-10-03T19:21:09.490 INFO:teuthology.orchestra.run.smithi045.stdout: -5868> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536c178c0 on [dir 0x1 / [2,head] auth pv=6008 v=5846 cv=5384/5384 REP dir_auth=0 ap=81+83 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 81 2023-10-03T19:21:09.490 INFO:teuthology.orchestra.run.smithi045.stdout: -5867> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536c178c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5845 pv6007 ap=82 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=82) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=81) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 82 2023-10-03T19:21:09.490 INFO:teuthology.orchestra.run.smithi045.stdout: -5866> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5846 cv=5384/5384 REP dir_auth=0 ap=81+82 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536c178c0 count now 81/82 2023-10-03T19:21:09.491 INFO:teuthology.orchestra.run.smithi045.stdout: -5865> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536c178c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5839 cv=5377/5377 ap=82+82 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=231 | child=1 dirty=1 authpin=1 0x565534f82400] count now 82 2023-10-03T19:21:09.491 INFO:teuthology.orchestra.run.smithi045.stdout: -5864> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000058b) auth_unpin by 0x565536c178c0 on [inode 0x1000000058b [2,head] /dc-dir/dc-file_918 auth v5838 s=3 n(v0 rc2023-10-03T19:17:09.688592+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553568eb00] now 0 2023-10-03T19:21:09.491 INFO:teuthology.orchestra.run.smithi045.stdout: -5863> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5839 cv=5377/5377 ap=82+81 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=231 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536c178c0 count now 82/81 2023-10-03T19:21:09.491 INFO:teuthology.orchestra.run.smithi045.stdout: -5862> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.491 INFO:teuthology.orchestra.run.smithi045.stdout: -5861> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.491 INFO:teuthology.orchestra.run.smithi045.stdout: -5860> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000058c [2,head] /dc-dir/dc-file_919 auth v4766 pv5840 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.699798+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.699798+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553568f080] 2023-10-03T19:21:09.491 INFO:teuthology.orchestra.run.smithi045.stdout: -5859> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5847 2023-10-03T19:21:09.491 INFO:teuthology.orchestra.run.smithi045.stdout: -5858> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5847 pv6007 ap=82 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=82) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=81) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.491 INFO:teuthology.orchestra.run.smithi045.stdout: -5857> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5845 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.491 INFO:teuthology.orchestra.run.smithi045.stdout: -5856> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5846 cv=5384/5384 REP dir_auth=0 ap=81+82 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5846 2023-10-03T19:21:09.491 INFO:teuthology.orchestra.run.smithi045.stdout: -5855> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000058c) pop_and_dirty_projected_inode v5840 2023-10-03T19:21:09.492 INFO:teuthology.orchestra.run.smithi045.stdout: -5854> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000058c) mark_dirty [inode 0x1000000058c [2,head] /dc-dir/dc-file_919 auth v5840 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.699798+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553568f080] 2023-10-03T19:21:09.492 INFO:teuthology.orchestra.run.smithi045.stdout: -5853> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_919) mark_dirty [dentry #0x1/dc-dir/dc-file_919 [2,head] auth (dversion lock) pv=5840 v=4766 ino=0x1000000058c state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535673400] 2023-10-03T19:21:09.492 INFO:teuthology.orchestra.run.smithi045.stdout: -5852> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5839 cv=5377/5377 ap=82+81 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=232 | child=1 dirty=1 authpin=1 0x565534f82400] version 5839 2023-10-03T19:21:09.492 INFO:teuthology.orchestra.run.smithi045.stdout: -5851> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536c18ec0 v5848 2023-10-03T19:21:09.492 INFO:teuthology.orchestra.run.smithi045.stdout: -5850> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5848 cv=5384/5384 REP dir_auth=0 ap=81+82 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5848 2023-10-03T19:21:09.492 INFO:teuthology.orchestra.run.smithi045.stdout: -5849> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536c18da0 v5841 2023-10-03T19:21:09.492 INFO:teuthology.orchestra.run.smithi045.stdout: -5848> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5841 cv=5377/5377 ap=82+81 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=232 | child=1 dirty=1 authpin=1 0x565534f82400] version 5841 2023-10-03T19:21:09.492 INFO:teuthology.orchestra.run.smithi045.stdout: -5847> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=81 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=81 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.492 INFO:teuthology.orchestra.run.smithi045.stdout: -5846> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=81) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5847 pv6007 ap=82 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=82) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=81) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.492 INFO:teuthology.orchestra.run.smithi045.stdout: -5845> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=82) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5847 pv6007 ap=82 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=82) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=80) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.492 INFO:teuthology.orchestra.run.smithi045.stdout: -5844> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000058c [2,head] /dc-dir/dc-file_919 auth v5840 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.699798+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553568f080] 2023-10-03T19:21:09.493 INFO:teuthology.orchestra.run.smithi045.stdout: -5843> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000058c [2,head] /dc-dir/dc-file_919 auth v5840 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.699798+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553568f080] 2023-10-03T19:21:09.493 INFO:teuthology.orchestra.run.smithi045.stdout: -5842> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.493 INFO:teuthology.orchestra.run.smithi045.stdout: -5841> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.493 INFO:teuthology.orchestra.run.smithi045.stdout: -5840> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.493 INFO:teuthology.orchestra.run.smithi045.stdout: -5839> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000058c [2,head] /dc-dir/dc-file_919 auth v5840 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.699798+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553568f080] 2023-10-03T19:21:09.493 INFO:teuthology.orchestra.run.smithi045.stdout: -5838> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000058c [2,head] /dc-dir/dc-file_919 auth v5840 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.699798+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553568f080] 2023-10-03T19:21:09.493 INFO:teuthology.orchestra.run.smithi045.stdout: -5837> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.493 INFO:teuthology.orchestra.run.smithi045.stdout: -5836> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 646.972, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.47e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1296.7] 2023-10-03T19:21:09.493 INFO:teuthology.orchestra.run.smithi045.stdout: -5835> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536c16fc0 on [dir 0x1 / [2,head] auth pv=6008 v=5848 cv=5384/5384 REP dir_auth=0 ap=80+82 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 80 2023-10-03T19:21:09.493 INFO:teuthology.orchestra.run.smithi045.stdout: -5834> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536c16fc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5847 pv6007 ap=81 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=81) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=80) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 81 2023-10-03T19:21:09.493 INFO:teuthology.orchestra.run.smithi045.stdout: -5833> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5848 cv=5384/5384 REP dir_auth=0 ap=80+81 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536c16fc0 count now 80/81 2023-10-03T19:21:09.494 INFO:teuthology.orchestra.run.smithi045.stdout: -5832> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536c16fc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5841 cv=5377/5377 ap=81+81 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=232 | child=1 dirty=1 authpin=1 0x565534f82400] count now 81 2023-10-03T19:21:09.494 INFO:teuthology.orchestra.run.smithi045.stdout: -5831> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000058c) auth_unpin by 0x565536c16fc0 on [inode 0x1000000058c [2,head] /dc-dir/dc-file_919 auth v5840 s=3 n(v0 rc2023-10-03T19:17:09.699798+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553568f080] now 0 2023-10-03T19:21:09.494 INFO:teuthology.orchestra.run.smithi045.stdout: -5830> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5841 cv=5377/5377 ap=81+80 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=232 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536c16fc0 count now 81/80 2023-10-03T19:21:09.494 INFO:teuthology.orchestra.run.smithi045.stdout: -5829> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.494 INFO:teuthology.orchestra.run.smithi045.stdout: -5828> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.494 INFO:teuthology.orchestra.run.smithi045.stdout: -5827> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000058d [2,head] /dc-dir/dc-file_920 auth v4770 pv5842 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.711579+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.711579+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553568f600] 2023-10-03T19:21:09.494 INFO:teuthology.orchestra.run.smithi045.stdout: -5826> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5849 2023-10-03T19:21:09.494 INFO:teuthology.orchestra.run.smithi045.stdout: -5825> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5849 pv6007 ap=81 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=81) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=80) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.494 INFO:teuthology.orchestra.run.smithi045.stdout: -5824> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5847 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.494 INFO:teuthology.orchestra.run.smithi045.stdout: -5823> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5848 cv=5384/5384 REP dir_auth=0 ap=80+81 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5848 2023-10-03T19:21:09.494 INFO:teuthology.orchestra.run.smithi045.stdout: -5822> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000058d) pop_and_dirty_projected_inode v5842 2023-10-03T19:21:09.494 INFO:teuthology.orchestra.run.smithi045.stdout: -5821> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000058d) mark_dirty [inode 0x1000000058d [2,head] /dc-dir/dc-file_920 auth v5842 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.711579+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553568f600] 2023-10-03T19:21:09.495 INFO:teuthology.orchestra.run.smithi045.stdout: -5820> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_920) mark_dirty [dentry #0x1/dc-dir/dc-file_920 [2,head] auth (dversion lock) pv=5842 v=4770 ino=0x1000000058d state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535673680] 2023-10-03T19:21:09.495 INFO:teuthology.orchestra.run.smithi045.stdout: -5819> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5841 cv=5377/5377 ap=81+80 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=233 | child=1 dirty=1 authpin=1 0x565534f82400] version 5841 2023-10-03T19:21:09.495 INFO:teuthology.orchestra.run.smithi045.stdout: -5818> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536c19100 v5850 2023-10-03T19:21:09.495 INFO:teuthology.orchestra.run.smithi045.stdout: -5817> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5850 cv=5384/5384 REP dir_auth=0 ap=80+81 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5850 2023-10-03T19:21:09.495 INFO:teuthology.orchestra.run.smithi045.stdout: -5816> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536c18fe0 v5843 2023-10-03T19:21:09.495 INFO:teuthology.orchestra.run.smithi045.stdout: -5815> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5843 cv=5377/5377 ap=81+80 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=233 | child=1 dirty=1 authpin=1 0x565534f82400] version 5843 2023-10-03T19:21:09.560 INFO:teuthology.orchestra.run.smithi045.stdout: -5814> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=80 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=80 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.560 INFO:teuthology.orchestra.run.smithi045.stdout: -5813> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=80) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5849 pv6007 ap=81 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=81) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=80) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.560 INFO:teuthology.orchestra.run.smithi045.stdout: -5812> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=81) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5849 pv6007 ap=81 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=81) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=79) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.560 INFO:teuthology.orchestra.run.smithi045.stdout: -5811> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000058d [2,head] /dc-dir/dc-file_920 auth v5842 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.711579+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553568f600] 2023-10-03T19:21:09.560 INFO:teuthology.orchestra.run.smithi045.stdout: -5810> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000058d [2,head] /dc-dir/dc-file_920 auth v5842 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.711579+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553568f600] 2023-10-03T19:21:09.560 INFO:teuthology.orchestra.run.smithi045.stdout: -5809> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.560 INFO:teuthology.orchestra.run.smithi045.stdout: -5808> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.560 INFO:teuthology.orchestra.run.smithi045.stdout: -5807> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.560 INFO:teuthology.orchestra.run.smithi045.stdout: -5806> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000058d [2,head] /dc-dir/dc-file_920 auth v5842 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.711579+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553568f600] 2023-10-03T19:21:09.561 INFO:teuthology.orchestra.run.smithi045.stdout: -5805> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000058d [2,head] /dc-dir/dc-file_920 auth v5842 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.711579+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553568f600] 2023-10-03T19:21:09.561 INFO:teuthology.orchestra.run.smithi045.stdout: -5804> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.561 INFO:teuthology.orchestra.run.smithi045.stdout: -5803> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 647.972, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.48e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1298.7] 2023-10-03T19:21:09.561 INFO:teuthology.orchestra.run.smithi045.stdout: -5802> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536c166c0 on [dir 0x1 / [2,head] auth pv=6008 v=5850 cv=5384/5384 REP dir_auth=0 ap=79+81 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 79 2023-10-03T19:21:09.561 INFO:teuthology.orchestra.run.smithi045.stdout: -5801> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536c166c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5849 pv6007 ap=80 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=80) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=79) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 80 2023-10-03T19:21:09.561 INFO:teuthology.orchestra.run.smithi045.stdout: -5800> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5850 cv=5384/5384 REP dir_auth=0 ap=79+80 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536c166c0 count now 79/80 2023-10-03T19:21:09.561 INFO:teuthology.orchestra.run.smithi045.stdout: -5799> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536c166c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5843 cv=5377/5377 ap=80+80 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=233 | child=1 dirty=1 authpin=1 0x565534f82400] count now 80 2023-10-03T19:21:09.561 INFO:teuthology.orchestra.run.smithi045.stdout: -5798> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000058d) auth_unpin by 0x565536c166c0 on [inode 0x1000000058d [2,head] /dc-dir/dc-file_920 auth v5842 s=3 n(v0 rc2023-10-03T19:17:09.711579+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553568f600] now 0 2023-10-03T19:21:09.561 INFO:teuthology.orchestra.run.smithi045.stdout: -5797> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5843 cv=5377/5377 ap=80+79 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=233 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536c166c0 count now 80/79 2023-10-03T19:21:09.561 INFO:teuthology.orchestra.run.smithi045.stdout: -5796> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.561 INFO:teuthology.orchestra.run.smithi045.stdout: -5795> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.562 INFO:teuthology.orchestra.run.smithi045.stdout: -5794> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000058e [2,head] /dc-dir/dc-file_921 auth v4774 pv5844 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.723045+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.723045+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553568fb80] 2023-10-03T19:21:09.562 INFO:teuthology.orchestra.run.smithi045.stdout: -5793> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5851 2023-10-03T19:21:09.562 INFO:teuthology.orchestra.run.smithi045.stdout: -5792> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5851 pv6007 ap=80 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=80) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=79) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.562 INFO:teuthology.orchestra.run.smithi045.stdout: -5791> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5849 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.562 INFO:teuthology.orchestra.run.smithi045.stdout: -5790> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5850 cv=5384/5384 REP dir_auth=0 ap=79+80 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5850 2023-10-03T19:21:09.562 INFO:teuthology.orchestra.run.smithi045.stdout: -5789> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000058e) pop_and_dirty_projected_inode v5844 2023-10-03T19:21:09.562 INFO:teuthology.orchestra.run.smithi045.stdout: -5788> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000058e) mark_dirty [inode 0x1000000058e [2,head] /dc-dir/dc-file_921 auth v5844 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.723045+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553568fb80] 2023-10-03T19:21:09.562 INFO:teuthology.orchestra.run.smithi045.stdout: -5787> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_921) mark_dirty [dentry #0x1/dc-dir/dc-file_921 [2,head] auth (dversion lock) pv=5844 v=4774 ino=0x1000000058e state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535673900] 2023-10-03T19:21:09.562 INFO:teuthology.orchestra.run.smithi045.stdout: -5786> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5843 cv=5377/5377 ap=80+79 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=234 | child=1 dirty=1 authpin=1 0x565534f82400] version 5843 2023-10-03T19:21:09.562 INFO:teuthology.orchestra.run.smithi045.stdout: -5785> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536c19340 v5852 2023-10-03T19:21:09.562 INFO:teuthology.orchestra.run.smithi045.stdout: -5784> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5852 cv=5384/5384 REP dir_auth=0 ap=79+80 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5852 2023-10-03T19:21:09.563 INFO:teuthology.orchestra.run.smithi045.stdout: -5783> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536c19220 v5845 2023-10-03T19:21:09.563 INFO:teuthology.orchestra.run.smithi045.stdout: -5782> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5845 cv=5377/5377 ap=80+79 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=234 | child=1 dirty=1 authpin=1 0x565534f82400] version 5845 2023-10-03T19:21:09.563 INFO:teuthology.orchestra.run.smithi045.stdout: -5781> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=79 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=79 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.563 INFO:teuthology.orchestra.run.smithi045.stdout: -5780> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=79) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5851 pv6007 ap=80 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=80) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=79) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.563 INFO:teuthology.orchestra.run.smithi045.stdout: -5779> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=80) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5851 pv6007 ap=80 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=80) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=78) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.563 INFO:teuthology.orchestra.run.smithi045.stdout: -5778> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000058e [2,head] /dc-dir/dc-file_921 auth v5844 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.723045+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553568fb80] 2023-10-03T19:21:09.563 INFO:teuthology.orchestra.run.smithi045.stdout: -5777> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000058e [2,head] /dc-dir/dc-file_921 auth v5844 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.723045+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553568fb80] 2023-10-03T19:21:09.563 INFO:teuthology.orchestra.run.smithi045.stdout: -5776> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.563 INFO:teuthology.orchestra.run.smithi045.stdout: -5775> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.563 INFO:teuthology.orchestra.run.smithi045.stdout: -5774> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.563 INFO:teuthology.orchestra.run.smithi045.stdout: -5773> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000058e [2,head] /dc-dir/dc-file_921 auth v5844 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.723045+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553568fb80] 2023-10-03T19:21:09.564 INFO:teuthology.orchestra.run.smithi045.stdout: -5772> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000058e [2,head] /dc-dir/dc-file_921 auth v5844 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.723045+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553568fb80] 2023-10-03T19:21:09.564 INFO:teuthology.orchestra.run.smithi045.stdout: -5771> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.564 INFO:teuthology.orchestra.run.smithi045.stdout: -5770> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 648.972, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.49e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1300.7] 2023-10-03T19:21:09.564 INFO:teuthology.orchestra.run.smithi045.stdout: -5769> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655351ddd40 on [dir 0x1 / [2,head] auth pv=6008 v=5852 cv=5384/5384 REP dir_auth=0 ap=78+80 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 78 2023-10-03T19:21:09.564 INFO:teuthology.orchestra.run.smithi045.stdout: -5768> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655351ddd40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5851 pv6007 ap=79 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=79) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=78) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 79 2023-10-03T19:21:09.564 INFO:teuthology.orchestra.run.smithi045.stdout: -5767> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5852 cv=5384/5384 REP dir_auth=0 ap=78+79 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655351ddd40 count now 78/79 2023-10-03T19:21:09.564 INFO:teuthology.orchestra.run.smithi045.stdout: -5766> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655351ddd40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5845 cv=5377/5377 ap=79+79 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=234 | child=1 dirty=1 authpin=1 0x565534f82400] count now 79 2023-10-03T19:21:09.564 INFO:teuthology.orchestra.run.smithi045.stdout: -5765> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000058e) auth_unpin by 0x5655351ddd40 on [inode 0x1000000058e [2,head] /dc-dir/dc-file_921 auth v5844 s=3 n(v0 rc2023-10-03T19:17:09.723045+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553568fb80] now 0 2023-10-03T19:21:09.564 INFO:teuthology.orchestra.run.smithi045.stdout: -5764> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5845 cv=5377/5377 ap=79+78 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=234 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655351ddd40 count now 79/78 2023-10-03T19:21:09.564 INFO:teuthology.orchestra.run.smithi045.stdout: -5763> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.564 INFO:teuthology.orchestra.run.smithi045.stdout: -5762> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.565 INFO:teuthology.orchestra.run.smithi045.stdout: -5761> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000058f [2,head] /dc-dir/dc-file_922 auth v4778 pv5846 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.735364+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.735364+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535690100] 2023-10-03T19:21:09.565 INFO:teuthology.orchestra.run.smithi045.stdout: -5760> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5853 2023-10-03T19:21:09.565 INFO:teuthology.orchestra.run.smithi045.stdout: -5759> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5853 pv6007 ap=79 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=79) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=78) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.565 INFO:teuthology.orchestra.run.smithi045.stdout: -5758> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5851 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.565 INFO:teuthology.orchestra.run.smithi045.stdout: -5757> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5852 cv=5384/5384 REP dir_auth=0 ap=78+79 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5852 2023-10-03T19:21:09.565 INFO:teuthology.orchestra.run.smithi045.stdout: -5756> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000058f) pop_and_dirty_projected_inode v5846 2023-10-03T19:21:09.565 INFO:teuthology.orchestra.run.smithi045.stdout: -5755> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000058f) mark_dirty [inode 0x1000000058f [2,head] /dc-dir/dc-file_922 auth v5846 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.735364+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535690100] 2023-10-03T19:21:09.565 INFO:teuthology.orchestra.run.smithi045.stdout: -5754> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_922) mark_dirty [dentry #0x1/dc-dir/dc-file_922 [2,head] auth (dversion lock) pv=5846 v=4778 ino=0x1000000058f state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535673b80] 2023-10-03T19:21:09.565 INFO:teuthology.orchestra.run.smithi045.stdout: -5753> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5845 cv=5377/5377 ap=79+78 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=235 | child=1 dirty=1 authpin=1 0x565534f82400] version 5845 2023-10-03T19:21:09.565 INFO:teuthology.orchestra.run.smithi045.stdout: -5752> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536c19580 v5854 2023-10-03T19:21:09.565 INFO:teuthology.orchestra.run.smithi045.stdout: -5751> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5854 cv=5384/5384 REP dir_auth=0 ap=78+79 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5854 2023-10-03T19:21:09.616 INFO:teuthology.orchestra.run.smithi045.stdout: -5750> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536c19460 v5847 2023-10-03T19:21:09.616 INFO:teuthology.orchestra.run.smithi045.stdout: -5749> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5847 cv=5377/5377 ap=79+78 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=235 | child=1 dirty=1 authpin=1 0x565534f82400] version 5847 2023-10-03T19:21:09.616 INFO:teuthology.orchestra.run.smithi045.stdout: -5748> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=78 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=78 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.616 INFO:teuthology.orchestra.run.smithi045.stdout: -5747> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=78) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5853 pv6007 ap=79 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=79) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=78) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.616 INFO:teuthology.orchestra.run.smithi045.stdout: -5746> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=79) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5853 pv6007 ap=79 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=79) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=77) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.616 INFO:teuthology.orchestra.run.smithi045.stdout: -5745> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000058f [2,head] /dc-dir/dc-file_922 auth v5846 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.735364+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535690100] 2023-10-03T19:21:09.616 INFO:teuthology.orchestra.run.smithi045.stdout: -5744> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000058f [2,head] /dc-dir/dc-file_922 auth v5846 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.735364+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535690100] 2023-10-03T19:21:09.617 INFO:teuthology.orchestra.run.smithi045.stdout: -5743> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.617 INFO:teuthology.orchestra.run.smithi045.stdout: -5742> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.617 INFO:teuthology.orchestra.run.smithi045.stdout: -5741> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.617 INFO:teuthology.orchestra.run.smithi045.stdout: -5740> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000058f [2,head] /dc-dir/dc-file_922 auth v5846 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.735364+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535690100] 2023-10-03T19:21:09.617 INFO:teuthology.orchestra.run.smithi045.stdout: -5739> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000058f [2,head] /dc-dir/dc-file_922 auth v5846 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.735364+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535690100] 2023-10-03T19:21:09.617 INFO:teuthology.orchestra.run.smithi045.stdout: -5738> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.617 INFO:teuthology.orchestra.run.smithi045.stdout: -5737> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 649.972, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.50e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1302.7] 2023-10-03T19:21:09.617 INFO:teuthology.orchestra.run.smithi045.stdout: -5736> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655351dd440 on [dir 0x1 / [2,head] auth pv=6008 v=5854 cv=5384/5384 REP dir_auth=0 ap=77+79 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 77 2023-10-03T19:21:09.617 INFO:teuthology.orchestra.run.smithi045.stdout: -5735> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655351dd440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5853 pv6007 ap=78 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=78) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=77) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 78 2023-10-03T19:21:09.617 INFO:teuthology.orchestra.run.smithi045.stdout: -5734> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5854 cv=5384/5384 REP dir_auth=0 ap=77+78 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655351dd440 count now 77/78 2023-10-03T19:21:09.617 INFO:teuthology.orchestra.run.smithi045.stdout: -5733> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655351dd440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5847 cv=5377/5377 ap=78+78 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=235 | child=1 dirty=1 authpin=1 0x565534f82400] count now 78 2023-10-03T19:21:09.617 INFO:teuthology.orchestra.run.smithi045.stdout: -5732> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000058f) auth_unpin by 0x5655351dd440 on [inode 0x1000000058f [2,head] /dc-dir/dc-file_922 auth v5846 s=3 n(v0 rc2023-10-03T19:17:09.735364+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535690100] now 0 2023-10-03T19:21:09.618 INFO:teuthology.orchestra.run.smithi045.stdout: -5731> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5847 cv=5377/5377 ap=78+77 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=235 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655351dd440 count now 78/77 2023-10-03T19:21:09.618 INFO:teuthology.orchestra.run.smithi045.stdout: -5730> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.618 INFO:teuthology.orchestra.run.smithi045.stdout: -5729> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.618 INFO:teuthology.orchestra.run.smithi045.stdout: -5728> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000590 [2,head] /dc-dir/dc-file_923 auth v4782 pv5848 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.747348+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.747348+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535690680] 2023-10-03T19:21:09.618 INFO:teuthology.orchestra.run.smithi045.stdout: -5727> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5855 2023-10-03T19:21:09.618 INFO:teuthology.orchestra.run.smithi045.stdout: -5726> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5855 pv6007 ap=78 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=78) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=77) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.618 INFO:teuthology.orchestra.run.smithi045.stdout: -5725> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5853 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.618 INFO:teuthology.orchestra.run.smithi045.stdout: -5724> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5854 cv=5384/5384 REP dir_auth=0 ap=77+78 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5854 2023-10-03T19:21:09.618 INFO:teuthology.orchestra.run.smithi045.stdout: -5723> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000590) pop_and_dirty_projected_inode v5848 2023-10-03T19:21:09.619 INFO:teuthology.orchestra.run.smithi045.stdout: -5722> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000590) mark_dirty [inode 0x10000000590 [2,head] /dc-dir/dc-file_923 auth v5848 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.747348+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535690680] 2023-10-03T19:21:09.619 INFO:teuthology.orchestra.run.smithi045.stdout: -5721> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_923) mark_dirty [dentry #0x1/dc-dir/dc-file_923 [2,head] auth (dversion lock) pv=5848 v=4782 ino=0x10000000590 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535694000] 2023-10-03T19:21:09.619 INFO:teuthology.orchestra.run.smithi045.stdout: -5720> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5847 cv=5377/5377 ap=78+77 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=236 | child=1 dirty=1 authpin=1 0x565534f82400] version 5847 2023-10-03T19:21:09.619 INFO:teuthology.orchestra.run.smithi045.stdout: -5719> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536c197c0 v5856 2023-10-03T19:21:09.619 INFO:teuthology.orchestra.run.smithi045.stdout: -5718> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5856 cv=5384/5384 REP dir_auth=0 ap=77+78 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5856 2023-10-03T19:21:09.619 INFO:teuthology.orchestra.run.smithi045.stdout: -5717> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536c196a0 v5849 2023-10-03T19:21:09.619 INFO:teuthology.orchestra.run.smithi045.stdout: -5716> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5849 cv=5377/5377 ap=78+77 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=236 | child=1 dirty=1 authpin=1 0x565534f82400] version 5849 2023-10-03T19:21:09.619 INFO:teuthology.orchestra.run.smithi045.stdout: -5715> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=77 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=77 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.619 INFO:teuthology.orchestra.run.smithi045.stdout: -5714> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=77) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5855 pv6007 ap=78 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=78) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=77) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.619 INFO:teuthology.orchestra.run.smithi045.stdout: -5713> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=78) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5855 pv6007 ap=78 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=78) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=76) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.619 INFO:teuthology.orchestra.run.smithi045.stdout: -5712> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000590 [2,head] /dc-dir/dc-file_923 auth v5848 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.747348+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535690680] 2023-10-03T19:21:09.620 INFO:teuthology.orchestra.run.smithi045.stdout: -5711> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000590 [2,head] /dc-dir/dc-file_923 auth v5848 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.747348+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535690680] 2023-10-03T19:21:09.620 INFO:teuthology.orchestra.run.smithi045.stdout: -5710> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.620 INFO:teuthology.orchestra.run.smithi045.stdout: -5709> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.620 INFO:teuthology.orchestra.run.smithi045.stdout: -5708> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.620 INFO:teuthology.orchestra.run.smithi045.stdout: -5707> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000590 [2,head] /dc-dir/dc-file_923 auth v5848 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.747348+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535690680] 2023-10-03T19:21:09.620 INFO:teuthology.orchestra.run.smithi045.stdout: -5706> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000590 [2,head] /dc-dir/dc-file_923 auth v5848 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.747348+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535690680] 2023-10-03T19:21:09.620 INFO:teuthology.orchestra.run.smithi045.stdout: -5705> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.620 INFO:teuthology.orchestra.run.smithi045.stdout: -5704> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 650.972, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.51e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1304.7] 2023-10-03T19:21:09.620 INFO:teuthology.orchestra.run.smithi045.stdout: -5703> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655351dcb40 on [dir 0x1 / [2,head] auth pv=6008 v=5856 cv=5384/5384 REP dir_auth=0 ap=76+78 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 76 2023-10-03T19:21:09.621 INFO:teuthology.orchestra.run.smithi045.stdout: -5702> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655351dcb40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5855 pv6007 ap=77 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=77) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=76) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 77 2023-10-03T19:21:09.621 INFO:teuthology.orchestra.run.smithi045.stdout: -5701> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5856 cv=5384/5384 REP dir_auth=0 ap=76+77 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655351dcb40 count now 76/77 2023-10-03T19:21:09.621 INFO:teuthology.orchestra.run.smithi045.stdout: -5700> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655351dcb40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5849 cv=5377/5377 ap=77+77 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=236 | child=1 dirty=1 authpin=1 0x565534f82400] count now 77 2023-10-03T19:21:09.621 INFO:teuthology.orchestra.run.smithi045.stdout: -5699> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000590) auth_unpin by 0x5655351dcb40 on [inode 0x10000000590 [2,head] /dc-dir/dc-file_923 auth v5848 s=3 n(v0 rc2023-10-03T19:17:09.747348+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535690680] now 0 2023-10-03T19:21:09.621 INFO:teuthology.orchestra.run.smithi045.stdout: -5698> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5849 cv=5377/5377 ap=77+76 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=236 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655351dcb40 count now 77/76 2023-10-03T19:21:09.621 INFO:teuthology.orchestra.run.smithi045.stdout: -5697> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.621 INFO:teuthology.orchestra.run.smithi045.stdout: -5696> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.621 INFO:teuthology.orchestra.run.smithi045.stdout: -5695> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000591 [2,head] /dc-dir/dc-file_924 auth v4786 pv5850 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.758043+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.758043+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535690c00] 2023-10-03T19:21:09.621 INFO:teuthology.orchestra.run.smithi045.stdout: -5694> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5857 2023-10-03T19:21:09.621 INFO:teuthology.orchestra.run.smithi045.stdout: -5693> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5857 pv6007 ap=77 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=77) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=76) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.621 INFO:teuthology.orchestra.run.smithi045.stdout: -5692> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5855 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.622 INFO:teuthology.orchestra.run.smithi045.stdout: -5691> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5856 cv=5384/5384 REP dir_auth=0 ap=76+77 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5856 2023-10-03T19:21:09.622 INFO:teuthology.orchestra.run.smithi045.stdout: -5690> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000591) pop_and_dirty_projected_inode v5850 2023-10-03T19:21:09.622 INFO:teuthology.orchestra.run.smithi045.stdout: -5689> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000591) mark_dirty [inode 0x10000000591 [2,head] /dc-dir/dc-file_924 auth v5850 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.758043+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535690c00] 2023-10-03T19:21:09.656 INFO:teuthology.orchestra.run.smithi045.stdout: -5688> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_924) mark_dirty [dentry #0x1/dc-dir/dc-file_924 [2,head] auth (dversion lock) pv=5850 v=4786 ino=0x10000000591 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535694280] 2023-10-03T19:21:09.656 INFO:teuthology.orchestra.run.smithi045.stdout: -5687> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5849 cv=5377/5377 ap=77+76 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=237 | child=1 dirty=1 authpin=1 0x565534f82400] version 5849 2023-10-03T19:21:09.657 INFO:teuthology.orchestra.run.smithi045.stdout: -5686> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536c19a00 v5858 2023-10-03T19:21:09.657 INFO:teuthology.orchestra.run.smithi045.stdout: -5685> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5858 cv=5384/5384 REP dir_auth=0 ap=76+77 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5858 2023-10-03T19:21:09.657 INFO:teuthology.orchestra.run.smithi045.stdout: -5684> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536c198e0 v5851 2023-10-03T19:21:09.657 INFO:teuthology.orchestra.run.smithi045.stdout: -5683> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5851 cv=5377/5377 ap=77+76 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=237 | child=1 dirty=1 authpin=1 0x565534f82400] version 5851 2023-10-03T19:21:09.657 INFO:teuthology.orchestra.run.smithi045.stdout: -5682> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=76 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=76 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.657 INFO:teuthology.orchestra.run.smithi045.stdout: -5681> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=76) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5857 pv6007 ap=77 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=77) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=76) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.657 INFO:teuthology.orchestra.run.smithi045.stdout: -5680> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=77) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5857 pv6007 ap=77 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=77) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=75) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.657 INFO:teuthology.orchestra.run.smithi045.stdout: -5679> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000591 [2,head] /dc-dir/dc-file_924 auth v5850 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.758043+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535690c00] 2023-10-03T19:21:09.657 INFO:teuthology.orchestra.run.smithi045.stdout: -5678> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000591 [2,head] /dc-dir/dc-file_924 auth v5850 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.758043+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535690c00] 2023-10-03T19:21:09.657 INFO:teuthology.orchestra.run.smithi045.stdout: -5677> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.658 INFO:teuthology.orchestra.run.smithi045.stdout: -5676> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.658 INFO:teuthology.orchestra.run.smithi045.stdout: -5675> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.658 INFO:teuthology.orchestra.run.smithi045.stdout: -5674> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000591 [2,head] /dc-dir/dc-file_924 auth v5850 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.758043+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535690c00] 2023-10-03T19:21:09.658 INFO:teuthology.orchestra.run.smithi045.stdout: -5673> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000591 [2,head] /dc-dir/dc-file_924 auth v5850 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.758043+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535690c00] 2023-10-03T19:21:09.658 INFO:teuthology.orchestra.run.smithi045.stdout: -5672> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.658 INFO:teuthology.orchestra.run.smithi045.stdout: -5671> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 651.972, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.52e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1306.7] 2023-10-03T19:21:09.658 INFO:teuthology.orchestra.run.smithi045.stdout: -5670> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655351dc240 on [dir 0x1 / [2,head] auth pv=6008 v=5858 cv=5384/5384 REP dir_auth=0 ap=75+77 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 75 2023-10-03T19:21:09.658 INFO:teuthology.orchestra.run.smithi045.stdout: -5669> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655351dc240 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5857 pv6007 ap=76 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=76) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=75) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 76 2023-10-03T19:21:09.658 INFO:teuthology.orchestra.run.smithi045.stdout: -5668> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5858 cv=5384/5384 REP dir_auth=0 ap=75+76 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655351dc240 count now 75/76 2023-10-03T19:21:09.658 INFO:teuthology.orchestra.run.smithi045.stdout: -5667> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655351dc240 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5851 cv=5377/5377 ap=76+76 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=237 | child=1 dirty=1 authpin=1 0x565534f82400] count now 76 2023-10-03T19:21:09.658 INFO:teuthology.orchestra.run.smithi045.stdout: -5666> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000591) auth_unpin by 0x5655351dc240 on [inode 0x10000000591 [2,head] /dc-dir/dc-file_924 auth v5850 s=3 n(v0 rc2023-10-03T19:17:09.758043+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535690c00] now 0 2023-10-03T19:21:09.659 INFO:teuthology.orchestra.run.smithi045.stdout: -5665> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5851 cv=5377/5377 ap=76+75 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=237 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655351dc240 count now 76/75 2023-10-03T19:21:09.659 INFO:teuthology.orchestra.run.smithi045.stdout: -5664> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.659 INFO:teuthology.orchestra.run.smithi045.stdout: -5663> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.659 INFO:teuthology.orchestra.run.smithi045.stdout: -5662> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000592 [2,head] /dc-dir/dc-file_925 auth v4790 pv5852 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.769089+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.769089+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535691180] 2023-10-03T19:21:09.659 INFO:teuthology.orchestra.run.smithi045.stdout: -5661> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5859 2023-10-03T19:21:09.659 INFO:teuthology.orchestra.run.smithi045.stdout: -5660> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5859 pv6007 ap=76 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=76) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=75) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.659 INFO:teuthology.orchestra.run.smithi045.stdout: -5659> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5857 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.659 INFO:teuthology.orchestra.run.smithi045.stdout: -5658> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5858 cv=5384/5384 REP dir_auth=0 ap=75+76 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5858 2023-10-03T19:21:09.659 INFO:teuthology.orchestra.run.smithi045.stdout: -5657> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000592) pop_and_dirty_projected_inode v5852 2023-10-03T19:21:09.659 INFO:teuthology.orchestra.run.smithi045.stdout: -5656> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000592) mark_dirty [inode 0x10000000592 [2,head] /dc-dir/dc-file_925 auth v5852 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.769089+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535691180] 2023-10-03T19:21:09.660 INFO:teuthology.orchestra.run.smithi045.stdout: -5655> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_925) mark_dirty [dentry #0x1/dc-dir/dc-file_925 [2,head] auth (dversion lock) pv=5852 v=4790 ino=0x10000000592 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535694500] 2023-10-03T19:21:09.660 INFO:teuthology.orchestra.run.smithi045.stdout: -5654> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5851 cv=5377/5377 ap=76+75 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=238 | child=1 dirty=1 authpin=1 0x565534f82400] version 5851 2023-10-03T19:21:09.660 INFO:teuthology.orchestra.run.smithi045.stdout: -5653> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536c19c40 v5860 2023-10-03T19:21:09.660 INFO:teuthology.orchestra.run.smithi045.stdout: -5652> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5860 cv=5384/5384 REP dir_auth=0 ap=75+76 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5860 2023-10-03T19:21:09.660 INFO:teuthology.orchestra.run.smithi045.stdout: -5651> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536c19b20 v5853 2023-10-03T19:21:09.660 INFO:teuthology.orchestra.run.smithi045.stdout: -5650> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5853 cv=5377/5377 ap=76+75 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=238 | child=1 dirty=1 authpin=1 0x565534f82400] version 5853 2023-10-03T19:21:09.660 INFO:teuthology.orchestra.run.smithi045.stdout: -5649> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=75 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=75 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.660 INFO:teuthology.orchestra.run.smithi045.stdout: -5648> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=75) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5859 pv6007 ap=76 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=76) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=75) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.660 INFO:teuthology.orchestra.run.smithi045.stdout: -5647> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=76) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5859 pv6007 ap=76 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=76) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=74) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.660 INFO:teuthology.orchestra.run.smithi045.stdout: -5646> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000592 [2,head] /dc-dir/dc-file_925 auth v5852 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.769089+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535691180] 2023-10-03T19:21:09.660 INFO:teuthology.orchestra.run.smithi045.stdout: -5645> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000592 [2,head] /dc-dir/dc-file_925 auth v5852 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.769089+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535691180] 2023-10-03T19:21:09.661 INFO:teuthology.orchestra.run.smithi045.stdout: -5644> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.661 INFO:teuthology.orchestra.run.smithi045.stdout: -5643> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.661 INFO:teuthology.orchestra.run.smithi045.stdout: -5642> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.661 INFO:teuthology.orchestra.run.smithi045.stdout: -5641> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000592 [2,head] /dc-dir/dc-file_925 auth v5852 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.769089+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535691180] 2023-10-03T19:21:09.661 INFO:teuthology.orchestra.run.smithi045.stdout: -5640> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000592 [2,head] /dc-dir/dc-file_925 auth v5852 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.769089+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535691180] 2023-10-03T19:21:09.661 INFO:teuthology.orchestra.run.smithi045.stdout: -5639> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.661 INFO:teuthology.orchestra.run.smithi045.stdout: -5638> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 652.972, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.53e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1308.7] 2023-10-03T19:21:09.661 INFO:teuthology.orchestra.run.smithi045.stdout: -5637> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535ebd440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5859 pv6007 ap=75 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=75) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=74) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 75 2023-10-03T19:21:09.661 INFO:teuthology.orchestra.run.smithi045.stdout: -5636> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5860 cv=5384/5384 REP dir_auth=0 ap=75+75 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535ebd440 count now 75/75 2023-10-03T19:21:09.661 INFO:teuthology.orchestra.run.smithi045.stdout: -5635> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535ebd440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5853 cv=5377/5377 ap=75+75 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=238 | child=1 dirty=1 authpin=1 0x565534f82400] count now 75 2023-10-03T19:21:09.661 INFO:teuthology.orchestra.run.smithi045.stdout: -5634> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535ebd440 on [dir 0x1 / [2,head] auth pv=6008 v=5860 cv=5384/5384 REP dir_auth=0 ap=74+75 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 74 2023-10-03T19:21:09.661 INFO:teuthology.orchestra.run.smithi045.stdout: -5633> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000592) auth_unpin by 0x565535ebd440 on [inode 0x10000000592 [2,head] /dc-dir/dc-file_925 auth v5852 s=3 n(v0 rc2023-10-03T19:17:09.769089+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535691180] now 0 2023-10-03T19:21:09.662 INFO:teuthology.orchestra.run.smithi045.stdout: -5632> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5853 cv=5377/5377 ap=75+74 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=238 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535ebd440 count now 75/74 2023-10-03T19:21:09.662 INFO:teuthology.orchestra.run.smithi045.stdout: -5631> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.662 INFO:teuthology.orchestra.run.smithi045.stdout: -5630> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.662 INFO:teuthology.orchestra.run.smithi045.stdout: -5629> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000593 [2,head] /dc-dir/dc-file_926 auth v4794 pv5854 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.780660+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.780660+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535691700] 2023-10-03T19:21:09.662 INFO:teuthology.orchestra.run.smithi045.stdout: -5628> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5861 2023-10-03T19:21:09.662 INFO:teuthology.orchestra.run.smithi045.stdout: -5627> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5861 pv6007 ap=75 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=75) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=74) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.662 INFO:teuthology.orchestra.run.smithi045.stdout: -5626> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5859 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.662 INFO:teuthology.orchestra.run.smithi045.stdout: -5625> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5860 cv=5384/5384 REP dir_auth=0 ap=74+75 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5860 2023-10-03T19:21:09.662 INFO:teuthology.orchestra.run.smithi045.stdout: -5624> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000593) pop_and_dirty_projected_inode v5854 2023-10-03T19:21:09.662 INFO:teuthology.orchestra.run.smithi045.stdout: -5623> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000593) mark_dirty [inode 0x10000000593 [2,head] /dc-dir/dc-file_926 auth v5854 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.780660+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535691700] 2023-10-03T19:21:09.662 INFO:teuthology.orchestra.run.smithi045.stdout: -5622> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_926) mark_dirty [dentry #0x1/dc-dir/dc-file_926 [2,head] auth (dversion lock) pv=5854 v=4794 ino=0x10000000593 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535694780] 2023-10-03T19:21:09.688 INFO:teuthology.orchestra.run.smithi045.stdout: -5621> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5853 cv=5377/5377 ap=75+74 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=239 | child=1 dirty=1 authpin=1 0x565534f82400] version 5853 2023-10-03T19:21:09.688 INFO:teuthology.orchestra.run.smithi045.stdout: -5620> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536c19e80 v5862 2023-10-03T19:21:09.688 INFO:teuthology.orchestra.run.smithi045.stdout: -5619> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5862 cv=5384/5384 REP dir_auth=0 ap=74+75 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5862 2023-10-03T19:21:09.688 INFO:teuthology.orchestra.run.smithi045.stdout: -5618> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536c19d60 v5855 2023-10-03T19:21:09.688 INFO:teuthology.orchestra.run.smithi045.stdout: -5617> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5855 cv=5377/5377 ap=75+74 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=239 | child=1 dirty=1 authpin=1 0x565534f82400] version 5855 2023-10-03T19:21:09.688 INFO:teuthology.orchestra.run.smithi045.stdout: -5616> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=74 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=74 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.688 INFO:teuthology.orchestra.run.smithi045.stdout: -5615> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=74) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5861 pv6007 ap=75 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=75) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=74) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.688 INFO:teuthology.orchestra.run.smithi045.stdout: -5614> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=75) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5861 pv6007 ap=75 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=75) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=73) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.688 INFO:teuthology.orchestra.run.smithi045.stdout: -5613> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000593 [2,head] /dc-dir/dc-file_926 auth v5854 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.780660+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535691700] 2023-10-03T19:21:09.689 INFO:teuthology.orchestra.run.smithi045.stdout: -5612> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000593 [2,head] /dc-dir/dc-file_926 auth v5854 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.780660+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535691700] 2023-10-03T19:21:09.689 INFO:teuthology.orchestra.run.smithi045.stdout: -5611> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.689 INFO:teuthology.orchestra.run.smithi045.stdout: -5610> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.689 INFO:teuthology.orchestra.run.smithi045.stdout: -5609> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.689 INFO:teuthology.orchestra.run.smithi045.stdout: -5608> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000593 [2,head] /dc-dir/dc-file_926 auth v5854 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.780660+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535691700] 2023-10-03T19:21:09.689 INFO:teuthology.orchestra.run.smithi045.stdout: -5607> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000593 [2,head] /dc-dir/dc-file_926 auth v5854 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.780660+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535691700] 2023-10-03T19:21:09.689 INFO:teuthology.orchestra.run.smithi045.stdout: -5606> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.689 INFO:teuthology.orchestra.run.smithi045.stdout: -5605> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 653.972, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.54e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1310.7] 2023-10-03T19:21:09.689 INFO:teuthology.orchestra.run.smithi045.stdout: -5604> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655363fb8c0 on [dir 0x1 / [2,head] auth pv=6008 v=5862 cv=5384/5384 REP dir_auth=0 ap=73+75 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 73 2023-10-03T19:21:09.689 INFO:teuthology.orchestra.run.smithi045.stdout: -5603> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655363fb8c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5861 pv6007 ap=74 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=74) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=73) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 74 2023-10-03T19:21:09.689 INFO:teuthology.orchestra.run.smithi045.stdout: -5602> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5862 cv=5384/5384 REP dir_auth=0 ap=73+74 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655363fb8c0 count now 73/74 2023-10-03T19:21:09.689 INFO:teuthology.orchestra.run.smithi045.stdout: -5601> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655363fb8c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5855 cv=5377/5377 ap=74+74 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=239 | child=1 dirty=1 authpin=1 0x565534f82400] count now 74 2023-10-03T19:21:09.690 INFO:teuthology.orchestra.run.smithi045.stdout: -5600> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000593) auth_unpin by 0x5655363fb8c0 on [inode 0x10000000593 [2,head] /dc-dir/dc-file_926 auth v5854 s=3 n(v0 rc2023-10-03T19:17:09.780660+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535691700] now 0 2023-10-03T19:21:09.690 INFO:teuthology.orchestra.run.smithi045.stdout: -5599> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5855 cv=5377/5377 ap=74+73 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=239 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655363fb8c0 count now 74/73 2023-10-03T19:21:09.690 INFO:teuthology.orchestra.run.smithi045.stdout: -5598> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.690 INFO:teuthology.orchestra.run.smithi045.stdout: -5597> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.690 INFO:teuthology.orchestra.run.smithi045.stdout: -5596> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000594 [2,head] /dc-dir/dc-file_927 auth v4798 pv5856 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.792087+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.792087+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535696000] 2023-10-03T19:21:09.690 INFO:teuthology.orchestra.run.smithi045.stdout: -5595> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5863 2023-10-03T19:21:09.690 INFO:teuthology.orchestra.run.smithi045.stdout: -5594> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5863 pv6007 ap=74 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=74) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=73) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.690 INFO:teuthology.orchestra.run.smithi045.stdout: -5593> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5861 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.690 INFO:teuthology.orchestra.run.smithi045.stdout: -5592> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5862 cv=5384/5384 REP dir_auth=0 ap=73+74 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5862 2023-10-03T19:21:09.690 INFO:teuthology.orchestra.run.smithi045.stdout: -5591> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000594) pop_and_dirty_projected_inode v5856 2023-10-03T19:21:09.691 INFO:teuthology.orchestra.run.smithi045.stdout: -5590> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000594) mark_dirty [inode 0x10000000594 [2,head] /dc-dir/dc-file_927 auth v5856 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.792087+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535696000] 2023-10-03T19:21:09.691 INFO:teuthology.orchestra.run.smithi045.stdout: -5589> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_927) mark_dirty [dentry #0x1/dc-dir/dc-file_927 [2,head] auth (dversion lock) pv=5856 v=4798 ino=0x10000000594 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535694a00] 2023-10-03T19:21:09.691 INFO:teuthology.orchestra.run.smithi045.stdout: -5588> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5855 cv=5377/5377 ap=74+73 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=240 | child=1 dirty=1 authpin=1 0x565534f82400] version 5855 2023-10-03T19:21:09.691 INFO:teuthology.orchestra.run.smithi045.stdout: -5587> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x5655365f0140 v5864 2023-10-03T19:21:09.691 INFO:teuthology.orchestra.run.smithi045.stdout: -5586> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5864 cv=5384/5384 REP dir_auth=0 ap=73+74 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5864 2023-10-03T19:21:09.691 INFO:teuthology.orchestra.run.smithi045.stdout: -5585> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655365f0020 v5857 2023-10-03T19:21:09.691 INFO:teuthology.orchestra.run.smithi045.stdout: -5584> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5857 cv=5377/5377 ap=74+73 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=240 | child=1 dirty=1 authpin=1 0x565534f82400] version 5857 2023-10-03T19:21:09.693 INFO:teuthology.orchestra.run.smithi045.stdout: -5583> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=73 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=73 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.693 INFO:teuthology.orchestra.run.smithi045.stdout: -5582> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=73) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5863 pv6007 ap=74 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=74) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=73) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.693 INFO:teuthology.orchestra.run.smithi045.stdout: -5581> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=74) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5863 pv6007 ap=74 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=74) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=72) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.693 INFO:teuthology.orchestra.run.smithi045.stdout: -5580> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000594 [2,head] /dc-dir/dc-file_927 auth v5856 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.792087+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535696000] 2023-10-03T19:21:09.693 INFO:teuthology.orchestra.run.smithi045.stdout: -5579> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000594 [2,head] /dc-dir/dc-file_927 auth v5856 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.792087+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535696000] 2023-10-03T19:21:09.693 INFO:teuthology.orchestra.run.smithi045.stdout: -5578> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.693 INFO:teuthology.orchestra.run.smithi045.stdout: -5577> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.693 INFO:teuthology.orchestra.run.smithi045.stdout: -5576> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.693 INFO:teuthology.orchestra.run.smithi045.stdout: -5575> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000594 [2,head] /dc-dir/dc-file_927 auth v5856 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.792087+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535696000] 2023-10-03T19:21:09.694 INFO:teuthology.orchestra.run.smithi045.stdout: -5574> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000594 [2,head] /dc-dir/dc-file_927 auth v5856 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.792087+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535696000] 2023-10-03T19:21:09.694 INFO:teuthology.orchestra.run.smithi045.stdout: -5573> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.694 INFO:teuthology.orchestra.run.smithi045.stdout: -5572> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 654.972, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.55e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1312.7] 2023-10-03T19:21:09.694 INFO:teuthology.orchestra.run.smithi045.stdout: -5571> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535298240 on [dir 0x1 / [2,head] auth pv=6008 v=5864 cv=5384/5384 REP dir_auth=0 ap=72+74 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 72 2023-10-03T19:21:09.694 INFO:teuthology.orchestra.run.smithi045.stdout: -5570> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535298240 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5863 pv6007 ap=73 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=73) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=72) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 73 2023-10-03T19:21:09.694 INFO:teuthology.orchestra.run.smithi045.stdout: -5569> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5864 cv=5384/5384 REP dir_auth=0 ap=72+73 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535298240 count now 72/73 2023-10-03T19:21:09.694 INFO:teuthology.orchestra.run.smithi045.stdout: -5568> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535298240 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5857 cv=5377/5377 ap=73+73 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=240 | child=1 dirty=1 authpin=1 0x565534f82400] count now 73 2023-10-03T19:21:09.694 INFO:teuthology.orchestra.run.smithi045.stdout: -5567> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000594) auth_unpin by 0x565535298240 on [inode 0x10000000594 [2,head] /dc-dir/dc-file_927 auth v5856 s=3 n(v0 rc2023-10-03T19:17:09.792087+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535696000] now 0 2023-10-03T19:21:09.694 INFO:teuthology.orchestra.run.smithi045.stdout: -5566> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5857 cv=5377/5377 ap=73+72 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=240 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535298240 count now 73/72 2023-10-03T19:21:09.695 INFO:teuthology.orchestra.run.smithi045.stdout: -5565> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.695 INFO:teuthology.orchestra.run.smithi045.stdout: -5564> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.695 INFO:teuthology.orchestra.run.smithi045.stdout: -5563> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000595 [2,head] /dc-dir/dc-file_928 auth v4802 pv5858 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.803531+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.803531+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535696580] 2023-10-03T19:21:09.695 INFO:teuthology.orchestra.run.smithi045.stdout: -5562> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5865 2023-10-03T19:21:09.695 INFO:teuthology.orchestra.run.smithi045.stdout: -5561> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5865 pv6007 ap=73 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=73) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=72) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.695 INFO:teuthology.orchestra.run.smithi045.stdout: -5560> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5863 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.744 INFO:teuthology.orchestra.run.smithi045.stdout: -5559> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5864 cv=5384/5384 REP dir_auth=0 ap=72+73 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5864 2023-10-03T19:21:09.744 INFO:teuthology.orchestra.run.smithi045.stdout: -5558> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000595) pop_and_dirty_projected_inode v5858 2023-10-03T19:21:09.744 INFO:teuthology.orchestra.run.smithi045.stdout: -5557> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000595) mark_dirty [inode 0x10000000595 [2,head] /dc-dir/dc-file_928 auth v5858 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.803531+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535696580] 2023-10-03T19:21:09.744 INFO:teuthology.orchestra.run.smithi045.stdout: -5556> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_928) mark_dirty [dentry #0x1/dc-dir/dc-file_928 [2,head] auth (dversion lock) pv=5858 v=4802 ino=0x10000000595 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535694c80] 2023-10-03T19:21:09.744 INFO:teuthology.orchestra.run.smithi045.stdout: -5555> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5857 cv=5377/5377 ap=73+72 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=241 | child=1 dirty=1 authpin=1 0x565534f82400] version 5857 2023-10-03T19:21:09.744 INFO:teuthology.orchestra.run.smithi045.stdout: -5554> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x5655365f0380 v5866 2023-10-03T19:21:09.744 INFO:teuthology.orchestra.run.smithi045.stdout: -5553> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5866 cv=5384/5384 REP dir_auth=0 ap=72+73 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5866 2023-10-03T19:21:09.744 INFO:teuthology.orchestra.run.smithi045.stdout: -5552> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655365f0260 v5859 2023-10-03T19:21:09.745 INFO:teuthology.orchestra.run.smithi045.stdout: -5551> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5859 cv=5377/5377 ap=73+72 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=241 | child=1 dirty=1 authpin=1 0x565534f82400] version 5859 2023-10-03T19:21:09.745 INFO:teuthology.orchestra.run.smithi045.stdout: -5550> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=72 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=72 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.745 INFO:teuthology.orchestra.run.smithi045.stdout: -5549> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=72) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5865 pv6007 ap=73 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=73) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=72) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.745 INFO:teuthology.orchestra.run.smithi045.stdout: -5548> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=73) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5865 pv6007 ap=73 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=73) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=71) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.745 INFO:teuthology.orchestra.run.smithi045.stdout: -5547> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000595 [2,head] /dc-dir/dc-file_928 auth v5858 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.803531+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535696580] 2023-10-03T19:21:09.745 INFO:teuthology.orchestra.run.smithi045.stdout: -5546> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000595 [2,head] /dc-dir/dc-file_928 auth v5858 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.803531+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535696580] 2023-10-03T19:21:09.745 INFO:teuthology.orchestra.run.smithi045.stdout: -5545> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.745 INFO:teuthology.orchestra.run.smithi045.stdout: -5544> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.745 INFO:teuthology.orchestra.run.smithi045.stdout: -5543> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.745 INFO:teuthology.orchestra.run.smithi045.stdout: -5542> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000595 [2,head] /dc-dir/dc-file_928 auth v5858 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.803531+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535696580] 2023-10-03T19:21:09.745 INFO:teuthology.orchestra.run.smithi045.stdout: -5541> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000595 [2,head] /dc-dir/dc-file_928 auth v5858 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.803531+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535696580] 2023-10-03T19:21:09.746 INFO:teuthology.orchestra.run.smithi045.stdout: -5540> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.746 INFO:teuthology.orchestra.run.smithi045.stdout: -5539> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 655.972, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.56e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1314.7] 2023-10-03T19:21:09.746 INFO:teuthology.orchestra.run.smithi045.stdout: -5538> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x56553541ab40 on [dir 0x1 / [2,head] auth pv=6008 v=5866 cv=5384/5384 REP dir_auth=0 ap=71+73 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 71 2023-10-03T19:21:09.746 INFO:teuthology.orchestra.run.smithi045.stdout: -5537> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x56553541ab40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5865 pv6007 ap=72 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=72) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=71) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 72 2023-10-03T19:21:09.746 INFO:teuthology.orchestra.run.smithi045.stdout: -5536> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5866 cv=5384/5384 REP dir_auth=0 ap=71+72 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x56553541ab40 count now 71/72 2023-10-03T19:21:09.746 INFO:teuthology.orchestra.run.smithi045.stdout: -5535> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x56553541ab40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5859 cv=5377/5377 ap=72+72 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=241 | child=1 dirty=1 authpin=1 0x565534f82400] count now 72 2023-10-03T19:21:09.746 INFO:teuthology.orchestra.run.smithi045.stdout: -5534> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000595) auth_unpin by 0x56553541ab40 on [inode 0x10000000595 [2,head] /dc-dir/dc-file_928 auth v5858 s=3 n(v0 rc2023-10-03T19:17:09.803531+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535696580] now 0 2023-10-03T19:21:09.746 INFO:teuthology.orchestra.run.smithi045.stdout: -5533> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5859 cv=5377/5377 ap=72+71 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=241 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x56553541ab40 count now 72/71 2023-10-03T19:21:09.746 INFO:teuthology.orchestra.run.smithi045.stdout: -5532> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.746 INFO:teuthology.orchestra.run.smithi045.stdout: -5531> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.746 INFO:teuthology.orchestra.run.smithi045.stdout: -5530> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000596 [2,head] /dc-dir/dc-file_929 auth v4806 pv5860 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.815149+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.815149+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535696b00] 2023-10-03T19:21:09.747 INFO:teuthology.orchestra.run.smithi045.stdout: -5529> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5867 2023-10-03T19:21:09.747 INFO:teuthology.orchestra.run.smithi045.stdout: -5528> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5867 pv6007 ap=72 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=72) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=71) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.747 INFO:teuthology.orchestra.run.smithi045.stdout: -5527> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5865 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.747 INFO:teuthology.orchestra.run.smithi045.stdout: -5526> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5866 cv=5384/5384 REP dir_auth=0 ap=71+72 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5866 2023-10-03T19:21:09.747 INFO:teuthology.orchestra.run.smithi045.stdout: -5525> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000596) pop_and_dirty_projected_inode v5860 2023-10-03T19:21:09.747 INFO:teuthology.orchestra.run.smithi045.stdout: -5524> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000596) mark_dirty [inode 0x10000000596 [2,head] /dc-dir/dc-file_929 auth v5860 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.815149+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535696b00] 2023-10-03T19:21:09.747 INFO:teuthology.orchestra.run.smithi045.stdout: -5523> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_929) mark_dirty [dentry #0x1/dc-dir/dc-file_929 [2,head] auth (dversion lock) pv=5860 v=4806 ino=0x10000000596 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535694f00] 2023-10-03T19:21:09.747 INFO:teuthology.orchestra.run.smithi045.stdout: -5522> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5859 cv=5377/5377 ap=72+71 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=242 | child=1 dirty=1 authpin=1 0x565534f82400] version 5859 2023-10-03T19:21:09.747 INFO:teuthology.orchestra.run.smithi045.stdout: -5521> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x5655365f05c0 v5868 2023-10-03T19:21:09.747 INFO:teuthology.orchestra.run.smithi045.stdout: -5520> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5868 cv=5384/5384 REP dir_auth=0 ap=71+72 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5868 2023-10-03T19:21:09.748 INFO:teuthology.orchestra.run.smithi045.stdout: -5519> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655365f04a0 v5861 2023-10-03T19:21:09.748 INFO:teuthology.orchestra.run.smithi045.stdout: -5518> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5861 cv=5377/5377 ap=72+71 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=242 | child=1 dirty=1 authpin=1 0x565534f82400] version 5861 2023-10-03T19:21:09.748 INFO:teuthology.orchestra.run.smithi045.stdout: -5517> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=71 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=71 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.748 INFO:teuthology.orchestra.run.smithi045.stdout: -5516> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=71) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5867 pv6007 ap=72 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=72) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=71) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.748 INFO:teuthology.orchestra.run.smithi045.stdout: -5515> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=72) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5867 pv6007 ap=72 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=72) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=70) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.748 INFO:teuthology.orchestra.run.smithi045.stdout: -5514> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000596 [2,head] /dc-dir/dc-file_929 auth v5860 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.815149+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535696b00] 2023-10-03T19:21:09.748 INFO:teuthology.orchestra.run.smithi045.stdout: -5513> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000596 [2,head] /dc-dir/dc-file_929 auth v5860 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.815149+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535696b00] 2023-10-03T19:21:09.748 INFO:teuthology.orchestra.run.smithi045.stdout: -5512> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.748 INFO:teuthology.orchestra.run.smithi045.stdout: -5511> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.748 INFO:teuthology.orchestra.run.smithi045.stdout: -5510> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.748 INFO:teuthology.orchestra.run.smithi045.stdout: -5509> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000596 [2,head] /dc-dir/dc-file_929 auth v5860 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.815149+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535696b00] 2023-10-03T19:21:09.748 INFO:teuthology.orchestra.run.smithi045.stdout: -5508> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000596 [2,head] /dc-dir/dc-file_929 auth v5860 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.815149+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535696b00] 2023-10-03T19:21:09.749 INFO:teuthology.orchestra.run.smithi045.stdout: -5507> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.749 INFO:teuthology.orchestra.run.smithi045.stdout: -5506> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 656.972, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.57e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1316.7] 2023-10-03T19:21:09.749 INFO:teuthology.orchestra.run.smithi045.stdout: -5505> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536387440 on [dir 0x1 / [2,head] auth pv=6008 v=5868 cv=5384/5384 REP dir_auth=0 ap=70+72 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 70 2023-10-03T19:21:09.749 INFO:teuthology.orchestra.run.smithi045.stdout: -5504> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536387440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5867 pv6007 ap=71 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=71) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=70) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 71 2023-10-03T19:21:09.749 INFO:teuthology.orchestra.run.smithi045.stdout: -5503> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5868 cv=5384/5384 REP dir_auth=0 ap=70+71 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536387440 count now 70/71 2023-10-03T19:21:09.749 INFO:teuthology.orchestra.run.smithi045.stdout: -5502> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536387440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5861 cv=5377/5377 ap=71+71 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=242 | child=1 dirty=1 authpin=1 0x565534f82400] count now 71 2023-10-03T19:21:09.749 INFO:teuthology.orchestra.run.smithi045.stdout: -5501> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000596) auth_unpin by 0x565536387440 on [inode 0x10000000596 [2,head] /dc-dir/dc-file_929 auth v5860 s=3 n(v0 rc2023-10-03T19:17:09.815149+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535696b00] now 0 2023-10-03T19:21:09.749 INFO:teuthology.orchestra.run.smithi045.stdout: -5500> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5861 cv=5377/5377 ap=71+70 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=242 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536387440 count now 71/70 2023-10-03T19:21:09.749 INFO:teuthology.orchestra.run.smithi045.stdout: -5499> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.749 INFO:teuthology.orchestra.run.smithi045.stdout: -5498> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.749 INFO:teuthology.orchestra.run.smithi045.stdout: -5497> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000597 [2,head] /dc-dir/dc-file_930 auth v4810 pv5862 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.825948+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.825948+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535697080] 2023-10-03T19:21:09.803 INFO:teuthology.orchestra.run.smithi045.stdout: -5496> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5869 2023-10-03T19:21:09.803 INFO:teuthology.orchestra.run.smithi045.stdout: -5495> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5869 pv6007 ap=71 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=71) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=70) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.803 INFO:teuthology.orchestra.run.smithi045.stdout: -5494> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5867 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.803 INFO:teuthology.orchestra.run.smithi045.stdout: -5493> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5868 cv=5384/5384 REP dir_auth=0 ap=70+71 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5868 2023-10-03T19:21:09.803 INFO:teuthology.orchestra.run.smithi045.stdout: -5492> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000597) pop_and_dirty_projected_inode v5862 2023-10-03T19:21:09.803 INFO:teuthology.orchestra.run.smithi045.stdout: -5491> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000597) mark_dirty [inode 0x10000000597 [2,head] /dc-dir/dc-file_930 auth v5862 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.825948+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535697080] 2023-10-03T19:21:09.803 INFO:teuthology.orchestra.run.smithi045.stdout: -5490> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_930) mark_dirty [dentry #0x1/dc-dir/dc-file_930 [2,head] auth (dversion lock) pv=5862 v=4810 ino=0x10000000597 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535695180] 2023-10-03T19:21:09.803 INFO:teuthology.orchestra.run.smithi045.stdout: -5489> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5861 cv=5377/5377 ap=71+70 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=243 | child=1 dirty=1 authpin=1 0x565534f82400] version 5861 2023-10-03T19:21:09.803 INFO:teuthology.orchestra.run.smithi045.stdout: -5488> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x5655365f0800 v5870 2023-10-03T19:21:09.804 INFO:teuthology.orchestra.run.smithi045.stdout: -5487> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5870 cv=5384/5384 REP dir_auth=0 ap=70+71 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5870 2023-10-03T19:21:09.804 INFO:teuthology.orchestra.run.smithi045.stdout: -5486> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655365f06e0 v5863 2023-10-03T19:21:09.804 INFO:teuthology.orchestra.run.smithi045.stdout: -5485> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5863 cv=5377/5377 ap=71+70 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=243 | child=1 dirty=1 authpin=1 0x565534f82400] version 5863 2023-10-03T19:21:09.804 INFO:teuthology.orchestra.run.smithi045.stdout: -5484> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=70 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=70 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.804 INFO:teuthology.orchestra.run.smithi045.stdout: -5483> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=70) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5869 pv6007 ap=71 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=71) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=70) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.804 INFO:teuthology.orchestra.run.smithi045.stdout: -5482> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=71) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5869 pv6007 ap=71 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=71) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=69) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.804 INFO:teuthology.orchestra.run.smithi045.stdout: -5481> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000597 [2,head] /dc-dir/dc-file_930 auth v5862 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.825948+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535697080] 2023-10-03T19:21:09.804 INFO:teuthology.orchestra.run.smithi045.stdout: -5480> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000597 [2,head] /dc-dir/dc-file_930 auth v5862 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.825948+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535697080] 2023-10-03T19:21:09.804 INFO:teuthology.orchestra.run.smithi045.stdout: -5479> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.804 INFO:teuthology.orchestra.run.smithi045.stdout: -5478> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.805 INFO:teuthology.orchestra.run.smithi045.stdout: -5477> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.805 INFO:teuthology.orchestra.run.smithi045.stdout: -5476> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000597 [2,head] /dc-dir/dc-file_930 auth v5862 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.825948+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535697080] 2023-10-03T19:21:09.805 INFO:teuthology.orchestra.run.smithi045.stdout: -5475> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000597 [2,head] /dc-dir/dc-file_930 auth v5862 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.825948+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535697080] 2023-10-03T19:21:09.805 INFO:teuthology.orchestra.run.smithi045.stdout: -5474> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.805 INFO:teuthology.orchestra.run.smithi045.stdout: -5473> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 657.972, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.58e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1318.7] 2023-10-03T19:21:09.805 INFO:teuthology.orchestra.run.smithi045.stdout: -5472> 2023-10-03T19:17:19.538+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655356b66c0 on [dir 0x1 / [2,head] auth pv=6008 v=5870 cv=5384/5384 REP dir_auth=0 ap=69+71 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 69 2023-10-03T19:21:09.805 INFO:teuthology.orchestra.run.smithi045.stdout: -5471> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655356b66c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5869 pv6007 ap=70 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=70) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=69) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 70 2023-10-03T19:21:09.805 INFO:teuthology.orchestra.run.smithi045.stdout: -5470> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5870 cv=5384/5384 REP dir_auth=0 ap=69+70 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655356b66c0 count now 69/70 2023-10-03T19:21:09.805 INFO:teuthology.orchestra.run.smithi045.stdout: -5469> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655356b66c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5863 cv=5377/5377 ap=70+70 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=243 | child=1 dirty=1 authpin=1 0x565534f82400] count now 70 2023-10-03T19:21:09.805 INFO:teuthology.orchestra.run.smithi045.stdout: -5468> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000597) auth_unpin by 0x5655356b66c0 on [inode 0x10000000597 [2,head] /dc-dir/dc-file_930 auth v5862 s=3 n(v0 rc2023-10-03T19:17:09.825948+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535697080] now 0 2023-10-03T19:21:09.805 INFO:teuthology.orchestra.run.smithi045.stdout: -5467> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5863 cv=5377/5377 ap=70+69 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=243 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655356b66c0 count now 70/69 2023-10-03T19:21:09.805 INFO:teuthology.orchestra.run.smithi045.stdout: -5466> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.806 INFO:teuthology.orchestra.run.smithi045.stdout: -5465> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.806 INFO:teuthology.orchestra.run.smithi045.stdout: -5464> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000598 [2,head] /dc-dir/dc-file_931 auth v4814 pv5864 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.837939+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.837939+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535697600] 2023-10-03T19:21:09.806 INFO:teuthology.orchestra.run.smithi045.stdout: -5463> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5871 2023-10-03T19:21:09.806 INFO:teuthology.orchestra.run.smithi045.stdout: -5462> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5871 pv6007 ap=70 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=70) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=69) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.806 INFO:teuthology.orchestra.run.smithi045.stdout: -5461> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5869 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.806 INFO:teuthology.orchestra.run.smithi045.stdout: -5460> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5870 cv=5384/5384 REP dir_auth=0 ap=69+70 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5870 2023-10-03T19:21:09.806 INFO:teuthology.orchestra.run.smithi045.stdout: -5459> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000598) pop_and_dirty_projected_inode v5864 2023-10-03T19:21:09.806 INFO:teuthology.orchestra.run.smithi045.stdout: -5458> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000598) mark_dirty [inode 0x10000000598 [2,head] /dc-dir/dc-file_931 auth v5864 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.837939+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535697600] 2023-10-03T19:21:09.806 INFO:teuthology.orchestra.run.smithi045.stdout: -5457> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_931) mark_dirty [dentry #0x1/dc-dir/dc-file_931 [2,head] auth (dversion lock) pv=5864 v=4814 ino=0x10000000598 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535695400] 2023-10-03T19:21:09.806 INFO:teuthology.orchestra.run.smithi045.stdout: -5456> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5863 cv=5377/5377 ap=70+69 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=244 | child=1 dirty=1 authpin=1 0x565534f82400] version 5863 2023-10-03T19:21:09.807 INFO:teuthology.orchestra.run.smithi045.stdout: -5455> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x5655365f0a40 v5872 2023-10-03T19:21:09.807 INFO:teuthology.orchestra.run.smithi045.stdout: -5454> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5872 cv=5384/5384 REP dir_auth=0 ap=69+70 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5872 2023-10-03T19:21:09.807 INFO:teuthology.orchestra.run.smithi045.stdout: -5453> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655365f0920 v5865 2023-10-03T19:21:09.807 INFO:teuthology.orchestra.run.smithi045.stdout: -5452> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5865 cv=5377/5377 ap=70+69 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=244 | child=1 dirty=1 authpin=1 0x565534f82400] version 5865 2023-10-03T19:21:09.807 INFO:teuthology.orchestra.run.smithi045.stdout: -5451> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=69 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=69 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.807 INFO:teuthology.orchestra.run.smithi045.stdout: -5450> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=69) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5871 pv6007 ap=70 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=70) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=69) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.807 INFO:teuthology.orchestra.run.smithi045.stdout: -5449> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=70) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5871 pv6007 ap=70 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=70) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=68) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.807 INFO:teuthology.orchestra.run.smithi045.stdout: -5448> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000598 [2,head] /dc-dir/dc-file_931 auth v5864 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.837939+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535697600] 2023-10-03T19:21:09.807 INFO:teuthology.orchestra.run.smithi045.stdout: -5447> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000598 [2,head] /dc-dir/dc-file_931 auth v5864 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.837939+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535697600] 2023-10-03T19:21:09.807 INFO:teuthology.orchestra.run.smithi045.stdout: -5446> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.808 INFO:teuthology.orchestra.run.smithi045.stdout: -5445> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.808 INFO:teuthology.orchestra.run.smithi045.stdout: -5444> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.808 INFO:teuthology.orchestra.run.smithi045.stdout: -5443> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000598 [2,head] /dc-dir/dc-file_931 auth v5864 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.837939+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535697600] 2023-10-03T19:21:09.808 INFO:teuthology.orchestra.run.smithi045.stdout: -5442> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000598 [2,head] /dc-dir/dc-file_931 auth v5864 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.837939+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535697600] 2023-10-03T19:21:09.808 INFO:teuthology.orchestra.run.smithi045.stdout: -5441> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.808 INFO:teuthology.orchestra.run.smithi045.stdout: -5440> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 658.608, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.59e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1320.0] 2023-10-03T19:21:09.808 INFO:teuthology.orchestra.run.smithi045.stdout: -5439> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655356b78c0 on [dir 0x1 / [2,head] auth pv=6008 v=5872 cv=5384/5384 REP dir_auth=0 ap=68+70 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 68 2023-10-03T19:21:09.808 INFO:teuthology.orchestra.run.smithi045.stdout: -5438> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655356b78c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5871 pv6007 ap=69 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=69) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=68) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 69 2023-10-03T19:21:09.808 INFO:teuthology.orchestra.run.smithi045.stdout: -5437> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5872 cv=5384/5384 REP dir_auth=0 ap=68+69 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655356b78c0 count now 68/69 2023-10-03T19:21:09.808 INFO:teuthology.orchestra.run.smithi045.stdout: -5436> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655356b78c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5865 cv=5377/5377 ap=69+69 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=244 | child=1 dirty=1 authpin=1 0x565534f82400] count now 69 2023-10-03T19:21:09.827 INFO:teuthology.orchestra.run.smithi045.stdout: -5435> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000598) auth_unpin by 0x5655356b78c0 on [inode 0x10000000598 [2,head] /dc-dir/dc-file_931 auth v5864 s=3 n(v0 rc2023-10-03T19:17:09.837939+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535697600] now 0 2023-10-03T19:21:09.828 INFO:teuthology.orchestra.run.smithi045.stdout: -5434> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5865 cv=5377/5377 ap=69+68 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=244 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655356b78c0 count now 69/68 2023-10-03T19:21:09.828 INFO:teuthology.orchestra.run.smithi045.stdout: -5433> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.828 INFO:teuthology.orchestra.run.smithi045.stdout: -5432> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.828 INFO:teuthology.orchestra.run.smithi045.stdout: -5431> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x10000000599 [2,head] /dc-dir/dc-file_932 auth v4818 pv5866 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.851092+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.851092+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535697b80] 2023-10-03T19:21:09.828 INFO:teuthology.orchestra.run.smithi045.stdout: -5430> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5873 2023-10-03T19:21:09.828 INFO:teuthology.orchestra.run.smithi045.stdout: -5429> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5873 pv6007 ap=69 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=69) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=68) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.828 INFO:teuthology.orchestra.run.smithi045.stdout: -5428> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5871 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.828 INFO:teuthology.orchestra.run.smithi045.stdout: -5427> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5872 cv=5384/5384 REP dir_auth=0 ap=68+69 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5872 2023-10-03T19:21:09.828 INFO:teuthology.orchestra.run.smithi045.stdout: -5426> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000599) pop_and_dirty_projected_inode v5866 2023-10-03T19:21:09.829 INFO:teuthology.orchestra.run.smithi045.stdout: -5425> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000599) mark_dirty [inode 0x10000000599 [2,head] /dc-dir/dc-file_932 auth v5866 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.851092+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535697b80] 2023-10-03T19:21:09.829 INFO:teuthology.orchestra.run.smithi045.stdout: -5424> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_932) mark_dirty [dentry #0x1/dc-dir/dc-file_932 [2,head] auth (dversion lock) pv=5866 v=4818 ino=0x10000000599 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535695680] 2023-10-03T19:21:09.829 INFO:teuthology.orchestra.run.smithi045.stdout: -5423> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5865 cv=5377/5377 ap=69+68 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=245 | child=1 dirty=1 authpin=1 0x565534f82400] version 5865 2023-10-03T19:21:09.829 INFO:teuthology.orchestra.run.smithi045.stdout: -5422> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x5655365f0c80 v5874 2023-10-03T19:21:09.829 INFO:teuthology.orchestra.run.smithi045.stdout: -5421> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5874 cv=5384/5384 REP dir_auth=0 ap=68+69 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5874 2023-10-03T19:21:09.829 INFO:teuthology.orchestra.run.smithi045.stdout: -5420> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655365f0b60 v5867 2023-10-03T19:21:09.829 INFO:teuthology.orchestra.run.smithi045.stdout: -5419> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5867 cv=5377/5377 ap=69+68 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=245 | child=1 dirty=1 authpin=1 0x565534f82400] version 5867 2023-10-03T19:21:09.829 INFO:teuthology.orchestra.run.smithi045.stdout: -5418> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=68 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=68 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.829 INFO:teuthology.orchestra.run.smithi045.stdout: -5417> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=68) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5873 pv6007 ap=69 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=69) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=68) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.829 INFO:teuthology.orchestra.run.smithi045.stdout: -5416> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=69) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5873 pv6007 ap=69 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=69) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=67) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.829 INFO:teuthology.orchestra.run.smithi045.stdout: -5415> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000599 [2,head] /dc-dir/dc-file_932 auth v5866 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.851092+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535697b80] 2023-10-03T19:21:09.830 INFO:teuthology.orchestra.run.smithi045.stdout: -5414> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000599 [2,head] /dc-dir/dc-file_932 auth v5866 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.851092+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535697b80] 2023-10-03T19:21:09.830 INFO:teuthology.orchestra.run.smithi045.stdout: -5413> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.830 INFO:teuthology.orchestra.run.smithi045.stdout: -5412> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.830 INFO:teuthology.orchestra.run.smithi045.stdout: -5411> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.830 INFO:teuthology.orchestra.run.smithi045.stdout: -5410> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000599 [2,head] /dc-dir/dc-file_932 auth v5866 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.851092+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535697b80] 2023-10-03T19:21:09.830 INFO:teuthology.orchestra.run.smithi045.stdout: -5409> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x10000000599 [2,head] /dc-dir/dc-file_932 auth v5866 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.851092+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535697b80] 2023-10-03T19:21:09.830 INFO:teuthology.orchestra.run.smithi045.stdout: -5408> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.830 INFO:teuthology.orchestra.run.smithi045.stdout: -5407> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 659.608, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.60e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1322.0] 2023-10-03T19:21:09.830 INFO:teuthology.orchestra.run.smithi045.stdout: -5406> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536d9cb40 on [dir 0x1 / [2,head] auth pv=6008 v=5874 cv=5384/5384 REP dir_auth=0 ap=67+69 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 67 2023-10-03T19:21:09.830 INFO:teuthology.orchestra.run.smithi045.stdout: -5405> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536d9cb40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5873 pv6007 ap=68 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=68) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=67) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 68 2023-10-03T19:21:09.831 INFO:teuthology.orchestra.run.smithi045.stdout: -5404> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5874 cv=5384/5384 REP dir_auth=0 ap=67+68 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536d9cb40 count now 67/68 2023-10-03T19:21:09.831 INFO:teuthology.orchestra.run.smithi045.stdout: -5403> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536d9cb40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5867 cv=5377/5377 ap=68+68 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=245 | child=1 dirty=1 authpin=1 0x565534f82400] count now 68 2023-10-03T19:21:09.831 INFO:teuthology.orchestra.run.smithi045.stdout: -5402> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000599) auth_unpin by 0x565536d9cb40 on [inode 0x10000000599 [2,head] /dc-dir/dc-file_932 auth v5866 s=3 n(v0 rc2023-10-03T19:17:09.851092+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535697b80] now 0 2023-10-03T19:21:09.831 INFO:teuthology.orchestra.run.smithi045.stdout: -5401> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5867 cv=5377/5377 ap=68+67 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=245 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536d9cb40 count now 68/67 2023-10-03T19:21:09.831 INFO:teuthology.orchestra.run.smithi045.stdout: -5400> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.831 INFO:teuthology.orchestra.run.smithi045.stdout: -5399> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.831 INFO:teuthology.orchestra.run.smithi045.stdout: -5398> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000059a [2,head] /dc-dir/dc-file_933 auth v4822 pv5868 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.864140+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.864140+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535698100] 2023-10-03T19:21:09.831 INFO:teuthology.orchestra.run.smithi045.stdout: -5397> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5875 2023-10-03T19:21:09.831 INFO:teuthology.orchestra.run.smithi045.stdout: -5396> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5875 pv6007 ap=68 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=68) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=67) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.831 INFO:teuthology.orchestra.run.smithi045.stdout: -5395> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5873 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.831 INFO:teuthology.orchestra.run.smithi045.stdout: -5394> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5874 cv=5384/5384 REP dir_auth=0 ap=67+68 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5874 2023-10-03T19:21:09.832 INFO:teuthology.orchestra.run.smithi045.stdout: -5393> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000059a) pop_and_dirty_projected_inode v5868 2023-10-03T19:21:09.832 INFO:teuthology.orchestra.run.smithi045.stdout: -5392> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000059a) mark_dirty [inode 0x1000000059a [2,head] /dc-dir/dc-file_933 auth v5868 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.864140+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535698100] 2023-10-03T19:21:09.832 INFO:teuthology.orchestra.run.smithi045.stdout: -5391> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_933) mark_dirty [dentry #0x1/dc-dir/dc-file_933 [2,head] auth (dversion lock) pv=5868 v=4822 ino=0x1000000059a state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535695900] 2023-10-03T19:21:09.832 INFO:teuthology.orchestra.run.smithi045.stdout: -5390> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5867 cv=5377/5377 ap=68+67 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=246 | child=1 dirty=1 authpin=1 0x565534f82400] version 5867 2023-10-03T19:21:09.832 INFO:teuthology.orchestra.run.smithi045.stdout: -5389> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x5655365f0ec0 v5876 2023-10-03T19:21:09.832 INFO:teuthology.orchestra.run.smithi045.stdout: -5388> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5876 cv=5384/5384 REP dir_auth=0 ap=67+68 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5876 2023-10-03T19:21:09.832 INFO:teuthology.orchestra.run.smithi045.stdout: -5387> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655365f0da0 v5869 2023-10-03T19:21:09.832 INFO:teuthology.orchestra.run.smithi045.stdout: -5386> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5869 cv=5377/5377 ap=68+67 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=246 | child=1 dirty=1 authpin=1 0x565534f82400] version 5869 2023-10-03T19:21:09.832 INFO:teuthology.orchestra.run.smithi045.stdout: -5385> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=67 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=67 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.832 INFO:teuthology.orchestra.run.smithi045.stdout: -5384> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=67) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5875 pv6007 ap=68 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=68) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=67) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.832 INFO:teuthology.orchestra.run.smithi045.stdout: -5383> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=68) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5875 pv6007 ap=68 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=68) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=66) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.833 INFO:teuthology.orchestra.run.smithi045.stdout: -5382> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000059a [2,head] /dc-dir/dc-file_933 auth v5868 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.864140+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535698100] 2023-10-03T19:21:09.833 INFO:teuthology.orchestra.run.smithi045.stdout: -5381> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000059a [2,head] /dc-dir/dc-file_933 auth v5868 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.864140+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535698100] 2023-10-03T19:21:09.833 INFO:teuthology.orchestra.run.smithi045.stdout: -5380> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.833 INFO:teuthology.orchestra.run.smithi045.stdout: -5379> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.833 INFO:teuthology.orchestra.run.smithi045.stdout: -5378> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.833 INFO:teuthology.orchestra.run.smithi045.stdout: -5377> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000059a [2,head] /dc-dir/dc-file_933 auth v5868 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.864140+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535698100] 2023-10-03T19:21:09.833 INFO:teuthology.orchestra.run.smithi045.stdout: -5376> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000059a [2,head] /dc-dir/dc-file_933 auth v5868 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.864140+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535698100] 2023-10-03T19:21:09.833 INFO:teuthology.orchestra.run.smithi045.stdout: -5375> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.833 INFO:teuthology.orchestra.run.smithi045.stdout: -5374> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 660.608, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.61e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1324.0] 2023-10-03T19:21:09.833 INFO:teuthology.orchestra.run.smithi045.stdout: -5373> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536d9d8c0 on [dir 0x1 / [2,head] auth pv=6008 v=5876 cv=5384/5384 REP dir_auth=0 ap=66+68 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 66 2023-10-03T19:21:09.833 INFO:teuthology.orchestra.run.smithi045.stdout: -5372> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536d9d8c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5875 pv6007 ap=67 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=67) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=66) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 67 2023-10-03T19:21:09.834 INFO:teuthology.orchestra.run.smithi045.stdout: -5371> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5876 cv=5384/5384 REP dir_auth=0 ap=66+67 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536d9d8c0 count now 66/67 2023-10-03T19:21:09.906 INFO:teuthology.orchestra.run.smithi045.stdout: -5370> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536d9d8c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5869 cv=5377/5377 ap=67+67 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=246 | child=1 dirty=1 authpin=1 0x565534f82400] count now 67 2023-10-03T19:21:09.906 INFO:teuthology.orchestra.run.smithi045.stdout: -5369> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000059a) auth_unpin by 0x565536d9d8c0 on [inode 0x1000000059a [2,head] /dc-dir/dc-file_933 auth v5868 s=3 n(v0 rc2023-10-03T19:17:09.864140+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535698100] now 0 2023-10-03T19:21:09.906 INFO:teuthology.orchestra.run.smithi045.stdout: -5368> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5869 cv=5377/5377 ap=67+66 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=246 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536d9d8c0 count now 67/66 2023-10-03T19:21:09.906 INFO:teuthology.orchestra.run.smithi045.stdout: -5367> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.906 INFO:teuthology.orchestra.run.smithi045.stdout: -5366> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.906 INFO:teuthology.orchestra.run.smithi045.stdout: -5365> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000059b [2,head] /dc-dir/dc-file_934 auth v4826 pv5870 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.877166+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.877166+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535698680] 2023-10-03T19:21:09.906 INFO:teuthology.orchestra.run.smithi045.stdout: -5364> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5877 2023-10-03T19:21:09.907 INFO:teuthology.orchestra.run.smithi045.stdout: -5363> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5877 pv6007 ap=67 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=67) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=66) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.907 INFO:teuthology.orchestra.run.smithi045.stdout: -5362> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5875 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.907 INFO:teuthology.orchestra.run.smithi045.stdout: -5361> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5876 cv=5384/5384 REP dir_auth=0 ap=66+67 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5876 2023-10-03T19:21:09.907 INFO:teuthology.orchestra.run.smithi045.stdout: -5360> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000059b) pop_and_dirty_projected_inode v5870 2023-10-03T19:21:09.907 INFO:teuthology.orchestra.run.smithi045.stdout: -5359> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000059b) mark_dirty [inode 0x1000000059b [2,head] /dc-dir/dc-file_934 auth v5870 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.877166+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535698680] 2023-10-03T19:21:09.907 INFO:teuthology.orchestra.run.smithi045.stdout: -5358> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_934) mark_dirty [dentry #0x1/dc-dir/dc-file_934 [2,head] auth (dversion lock) pv=5870 v=4826 ino=0x1000000059b state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535695b80] 2023-10-03T19:21:09.907 INFO:teuthology.orchestra.run.smithi045.stdout: -5357> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5869 cv=5377/5377 ap=67+66 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=247 | child=1 dirty=1 authpin=1 0x565534f82400] version 5869 2023-10-03T19:21:09.907 INFO:teuthology.orchestra.run.smithi045.stdout: -5356> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x5655365f1100 v5878 2023-10-03T19:21:09.907 INFO:teuthology.orchestra.run.smithi045.stdout: -5355> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5878 cv=5384/5384 REP dir_auth=0 ap=66+67 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5878 2023-10-03T19:21:09.907 INFO:teuthology.orchestra.run.smithi045.stdout: -5354> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655365f0fe0 v5871 2023-10-03T19:21:09.907 INFO:teuthology.orchestra.run.smithi045.stdout: -5353> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5871 cv=5377/5377 ap=67+66 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=247 | child=1 dirty=1 authpin=1 0x565534f82400] version 5871 2023-10-03T19:21:09.907 INFO:teuthology.orchestra.run.smithi045.stdout: -5352> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=66 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=66 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.908 INFO:teuthology.orchestra.run.smithi045.stdout: -5351> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=66) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5877 pv6007 ap=67 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=67) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=66) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.908 INFO:teuthology.orchestra.run.smithi045.stdout: -5350> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=67) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5877 pv6007 ap=67 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=67) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=65) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.908 INFO:teuthology.orchestra.run.smithi045.stdout: -5349> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000059b [2,head] /dc-dir/dc-file_934 auth v5870 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.877166+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535698680] 2023-10-03T19:21:09.908 INFO:teuthology.orchestra.run.smithi045.stdout: -5348> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000059b [2,head] /dc-dir/dc-file_934 auth v5870 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.877166+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535698680] 2023-10-03T19:21:09.908 INFO:teuthology.orchestra.run.smithi045.stdout: -5347> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.908 INFO:teuthology.orchestra.run.smithi045.stdout: -5346> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.908 INFO:teuthology.orchestra.run.smithi045.stdout: -5345> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.908 INFO:teuthology.orchestra.run.smithi045.stdout: -5344> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000059b [2,head] /dc-dir/dc-file_934 auth v5870 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.877166+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535698680] 2023-10-03T19:21:09.908 INFO:teuthology.orchestra.run.smithi045.stdout: -5343> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000059b [2,head] /dc-dir/dc-file_934 auth v5870 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.877166+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535698680] 2023-10-03T19:21:09.908 INFO:teuthology.orchestra.run.smithi045.stdout: -5342> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.909 INFO:teuthology.orchestra.run.smithi045.stdout: -5341> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 661.608, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.62e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1326.0] 2023-10-03T19:21:09.909 INFO:teuthology.orchestra.run.smithi045.stdout: -5340> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536428000 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5877 pv6007 ap=66 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=66) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=65) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 66 2023-10-03T19:21:09.909 INFO:teuthology.orchestra.run.smithi045.stdout: -5339> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5878 cv=5384/5384 REP dir_auth=0 ap=66+66 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536428000 count now 66/66 2023-10-03T19:21:09.909 INFO:teuthology.orchestra.run.smithi045.stdout: -5338> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536428000 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5871 cv=5377/5377 ap=66+66 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=247 | child=1 dirty=1 authpin=1 0x565534f82400] count now 66 2023-10-03T19:21:09.909 INFO:teuthology.orchestra.run.smithi045.stdout: -5337> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536428000 on [dir 0x1 / [2,head] auth pv=6008 v=5878 cv=5384/5384 REP dir_auth=0 ap=65+66 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 65 2023-10-03T19:21:09.909 INFO:teuthology.orchestra.run.smithi045.stdout: -5336> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000059b) auth_unpin by 0x565536428000 on [inode 0x1000000059b [2,head] /dc-dir/dc-file_934 auth v5870 s=3 n(v0 rc2023-10-03T19:17:09.877166+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535698680] now 0 2023-10-03T19:21:09.909 INFO:teuthology.orchestra.run.smithi045.stdout: -5335> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5871 cv=5377/5377 ap=66+65 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=247 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536428000 count now 66/65 2023-10-03T19:21:09.909 INFO:teuthology.orchestra.run.smithi045.stdout: -5334> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.909 INFO:teuthology.orchestra.run.smithi045.stdout: -5333> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.910 INFO:teuthology.orchestra.run.smithi045.stdout: -5332> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000059c [2,head] /dc-dir/dc-file_935 auth v4830 pv5872 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.889064+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.889064+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535698c00] 2023-10-03T19:21:09.910 INFO:teuthology.orchestra.run.smithi045.stdout: -5331> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5879 2023-10-03T19:21:09.910 INFO:teuthology.orchestra.run.smithi045.stdout: -5330> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5879 pv6007 ap=66 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=66) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=65) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.910 INFO:teuthology.orchestra.run.smithi045.stdout: -5329> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5877 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.910 INFO:teuthology.orchestra.run.smithi045.stdout: -5328> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5878 cv=5384/5384 REP dir_auth=0 ap=65+66 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5878 2023-10-03T19:21:09.910 INFO:teuthology.orchestra.run.smithi045.stdout: -5327> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000059c) pop_and_dirty_projected_inode v5872 2023-10-03T19:21:09.910 INFO:teuthology.orchestra.run.smithi045.stdout: -5326> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000059c) mark_dirty [inode 0x1000000059c [2,head] /dc-dir/dc-file_935 auth v5872 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.889064+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535698c00] 2023-10-03T19:21:09.910 INFO:teuthology.orchestra.run.smithi045.stdout: -5325> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_935) mark_dirty [dentry #0x1/dc-dir/dc-file_935 [2,head] auth (dversion lock) pv=5872 v=4830 ino=0x1000000059c state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553569c000] 2023-10-03T19:21:09.910 INFO:teuthology.orchestra.run.smithi045.stdout: -5324> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5871 cv=5377/5377 ap=66+65 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=248 | child=1 dirty=1 authpin=1 0x565534f82400] version 5871 2023-10-03T19:21:09.910 INFO:teuthology.orchestra.run.smithi045.stdout: -5323> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x5655365f1340 v5880 2023-10-03T19:21:09.910 INFO:teuthology.orchestra.run.smithi045.stdout: -5322> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5880 cv=5384/5384 REP dir_auth=0 ap=65+66 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5880 2023-10-03T19:21:09.911 INFO:teuthology.orchestra.run.smithi045.stdout: -5321> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655365f1220 v5873 2023-10-03T19:21:09.911 INFO:teuthology.orchestra.run.smithi045.stdout: -5320> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5873 cv=5377/5377 ap=66+65 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=248 | child=1 dirty=1 authpin=1 0x565534f82400] version 5873 2023-10-03T19:21:09.911 INFO:teuthology.orchestra.run.smithi045.stdout: -5319> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=65 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=65 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.911 INFO:teuthology.orchestra.run.smithi045.stdout: -5318> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=65) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5879 pv6007 ap=66 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=66) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=65) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.911 INFO:teuthology.orchestra.run.smithi045.stdout: -5317> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=66) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5879 pv6007 ap=66 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=66) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=64) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.911 INFO:teuthology.orchestra.run.smithi045.stdout: -5316> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000059c [2,head] /dc-dir/dc-file_935 auth v5872 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.889064+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535698c00] 2023-10-03T19:21:09.911 INFO:teuthology.orchestra.run.smithi045.stdout: -5315> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000059c [2,head] /dc-dir/dc-file_935 auth v5872 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.889064+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535698c00] 2023-10-03T19:21:09.911 INFO:teuthology.orchestra.run.smithi045.stdout: -5314> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.911 INFO:teuthology.orchestra.run.smithi045.stdout: -5313> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.911 INFO:teuthology.orchestra.run.smithi045.stdout: -5312> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.911 INFO:teuthology.orchestra.run.smithi045.stdout: -5311> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000059c [2,head] /dc-dir/dc-file_935 auth v5872 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.889064+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535698c00] 2023-10-03T19:21:09.912 INFO:teuthology.orchestra.run.smithi045.stdout: -5310> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000059c [2,head] /dc-dir/dc-file_935 auth v5872 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.889064+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535698c00] 2023-10-03T19:21:09.912 INFO:teuthology.orchestra.run.smithi045.stdout: -5309> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.912 INFO:teuthology.orchestra.run.smithi045.stdout: -5308> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 662.608, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.63e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1328.0] 2023-10-03T19:21:09.949 INFO:teuthology.orchestra.run.smithi045.stdout: -5307> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536428480 on [dir 0x1 / [2,head] auth pv=6008 v=5880 cv=5384/5384 REP dir_auth=0 ap=64+66 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 64 2023-10-03T19:21:09.949 INFO:teuthology.orchestra.run.smithi045.stdout: -5306> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536428480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5879 pv6007 ap=65 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=65) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=64) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 65 2023-10-03T19:21:09.949 INFO:teuthology.orchestra.run.smithi045.stdout: -5305> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5880 cv=5384/5384 REP dir_auth=0 ap=64+65 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536428480 count now 64/65 2023-10-03T19:21:09.949 INFO:teuthology.orchestra.run.smithi045.stdout: -5304> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536428480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5873 cv=5377/5377 ap=65+65 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=248 | child=1 dirty=1 authpin=1 0x565534f82400] count now 65 2023-10-03T19:21:09.949 INFO:teuthology.orchestra.run.smithi045.stdout: -5303> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000059c) auth_unpin by 0x565536428480 on [inode 0x1000000059c [2,head] /dc-dir/dc-file_935 auth v5872 s=3 n(v0 rc2023-10-03T19:17:09.889064+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535698c00] now 0 2023-10-03T19:21:09.949 INFO:teuthology.orchestra.run.smithi045.stdout: -5302> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5873 cv=5377/5377 ap=65+64 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=248 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536428480 count now 65/64 2023-10-03T19:21:09.949 INFO:teuthology.orchestra.run.smithi045.stdout: -5301> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.950 INFO:teuthology.orchestra.run.smithi045.stdout: -5300> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.950 INFO:teuthology.orchestra.run.smithi045.stdout: -5299> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000059d [2,head] /dc-dir/dc-file_936 auth v4834 pv5874 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.900761+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.900761+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535699180] 2023-10-03T19:21:09.950 INFO:teuthology.orchestra.run.smithi045.stdout: -5298> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5881 2023-10-03T19:21:09.950 INFO:teuthology.orchestra.run.smithi045.stdout: -5297> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5881 pv6007 ap=65 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=65) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=64) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.950 INFO:teuthology.orchestra.run.smithi045.stdout: -5296> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5879 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.950 INFO:teuthology.orchestra.run.smithi045.stdout: -5295> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5880 cv=5384/5384 REP dir_auth=0 ap=64+65 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5880 2023-10-03T19:21:09.950 INFO:teuthology.orchestra.run.smithi045.stdout: -5294> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000059d) pop_and_dirty_projected_inode v5874 2023-10-03T19:21:09.950 INFO:teuthology.orchestra.run.smithi045.stdout: -5293> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000059d) mark_dirty [inode 0x1000000059d [2,head] /dc-dir/dc-file_936 auth v5874 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.900761+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535699180] 2023-10-03T19:21:09.950 INFO:teuthology.orchestra.run.smithi045.stdout: -5292> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_936) mark_dirty [dentry #0x1/dc-dir/dc-file_936 [2,head] auth (dversion lock) pv=5874 v=4834 ino=0x1000000059d state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553569c280] 2023-10-03T19:21:09.950 INFO:teuthology.orchestra.run.smithi045.stdout: -5291> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5873 cv=5377/5377 ap=65+64 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=249 | child=1 dirty=1 authpin=1 0x565534f82400] version 5873 2023-10-03T19:21:09.951 INFO:teuthology.orchestra.run.smithi045.stdout: -5290> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x5655365f1580 v5882 2023-10-03T19:21:09.951 INFO:teuthology.orchestra.run.smithi045.stdout: -5289> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5882 cv=5384/5384 REP dir_auth=0 ap=64+65 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5882 2023-10-03T19:21:09.951 INFO:teuthology.orchestra.run.smithi045.stdout: -5288> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655365f1460 v5875 2023-10-03T19:21:09.951 INFO:teuthology.orchestra.run.smithi045.stdout: -5287> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5875 cv=5377/5377 ap=65+64 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=249 | child=1 dirty=1 authpin=1 0x565534f82400] version 5875 2023-10-03T19:21:09.951 INFO:teuthology.orchestra.run.smithi045.stdout: -5286> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=64 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=64 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.951 INFO:teuthology.orchestra.run.smithi045.stdout: -5285> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=64) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5881 pv6007 ap=65 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=65) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=64) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.951 INFO:teuthology.orchestra.run.smithi045.stdout: -5284> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=65) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5881 pv6007 ap=65 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=65) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=63) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.951 INFO:teuthology.orchestra.run.smithi045.stdout: -5283> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000059d [2,head] /dc-dir/dc-file_936 auth v5874 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.900761+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535699180] 2023-10-03T19:21:09.951 INFO:teuthology.orchestra.run.smithi045.stdout: -5282> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000059d [2,head] /dc-dir/dc-file_936 auth v5874 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.900761+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535699180] 2023-10-03T19:21:09.951 INFO:teuthology.orchestra.run.smithi045.stdout: -5281> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.951 INFO:teuthology.orchestra.run.smithi045.stdout: -5280> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.951 INFO:teuthology.orchestra.run.smithi045.stdout: -5279> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.952 INFO:teuthology.orchestra.run.smithi045.stdout: -5278> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000059d [2,head] /dc-dir/dc-file_936 auth v5874 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.900761+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535699180] 2023-10-03T19:21:09.952 INFO:teuthology.orchestra.run.smithi045.stdout: -5277> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000059d [2,head] /dc-dir/dc-file_936 auth v5874 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.900761+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535699180] 2023-10-03T19:21:09.952 INFO:teuthology.orchestra.run.smithi045.stdout: -5276> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.952 INFO:teuthology.orchestra.run.smithi045.stdout: -5275> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 663.608, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.64e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1330.0] 2023-10-03T19:21:09.952 INFO:teuthology.orchestra.run.smithi045.stdout: -5274> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536428900 on [dir 0x1 / [2,head] auth pv=6008 v=5882 cv=5384/5384 REP dir_auth=0 ap=63+65 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 63 2023-10-03T19:21:09.952 INFO:teuthology.orchestra.run.smithi045.stdout: -5273> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536428900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5881 pv6007 ap=64 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=64) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=63) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 64 2023-10-03T19:21:09.952 INFO:teuthology.orchestra.run.smithi045.stdout: -5272> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5882 cv=5384/5384 REP dir_auth=0 ap=63+64 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536428900 count now 63/64 2023-10-03T19:21:09.952 INFO:teuthology.orchestra.run.smithi045.stdout: -5271> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536428900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5875 cv=5377/5377 ap=64+64 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=249 | child=1 dirty=1 authpin=1 0x565534f82400] count now 64 2023-10-03T19:21:09.952 INFO:teuthology.orchestra.run.smithi045.stdout: -5270> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000059d) auth_unpin by 0x565536428900 on [inode 0x1000000059d [2,head] /dc-dir/dc-file_936 auth v5874 s=3 n(v0 rc2023-10-03T19:17:09.900761+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535699180] now 0 2023-10-03T19:21:09.952 INFO:teuthology.orchestra.run.smithi045.stdout: -5269> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5875 cv=5377/5377 ap=64+63 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=249 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536428900 count now 64/63 2023-10-03T19:21:09.952 INFO:teuthology.orchestra.run.smithi045.stdout: -5268> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.953 INFO:teuthology.orchestra.run.smithi045.stdout: -5267> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.953 INFO:teuthology.orchestra.run.smithi045.stdout: -5266> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000059e [2,head] /dc-dir/dc-file_937 auth v4838 pv5876 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.912661+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.912661+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535699700] 2023-10-03T19:21:09.953 INFO:teuthology.orchestra.run.smithi045.stdout: -5265> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5883 2023-10-03T19:21:09.953 INFO:teuthology.orchestra.run.smithi045.stdout: -5264> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5883 pv6007 ap=64 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=64) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=63) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.953 INFO:teuthology.orchestra.run.smithi045.stdout: -5263> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5881 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.953 INFO:teuthology.orchestra.run.smithi045.stdout: -5262> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5882 cv=5384/5384 REP dir_auth=0 ap=63+64 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5882 2023-10-03T19:21:09.953 INFO:teuthology.orchestra.run.smithi045.stdout: -5261> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000059e) pop_and_dirty_projected_inode v5876 2023-10-03T19:21:09.953 INFO:teuthology.orchestra.run.smithi045.stdout: -5260> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000059e) mark_dirty [inode 0x1000000059e [2,head] /dc-dir/dc-file_937 auth v5876 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.912661+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535699700] 2023-10-03T19:21:09.953 INFO:teuthology.orchestra.run.smithi045.stdout: -5259> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_937) mark_dirty [dentry #0x1/dc-dir/dc-file_937 [2,head] auth (dversion lock) pv=5876 v=4838 ino=0x1000000059e state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553569c500] 2023-10-03T19:21:09.953 INFO:teuthology.orchestra.run.smithi045.stdout: -5258> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5875 cv=5377/5377 ap=64+63 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=250 | child=1 dirty=1 authpin=1 0x565534f82400] version 5875 2023-10-03T19:21:09.953 INFO:teuthology.orchestra.run.smithi045.stdout: -5257> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x5655365f17c0 v5884 2023-10-03T19:21:09.953 INFO:teuthology.orchestra.run.smithi045.stdout: -5256> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5884 cv=5384/5384 REP dir_auth=0 ap=63+64 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5884 2023-10-03T19:21:09.954 INFO:teuthology.orchestra.run.smithi045.stdout: -5255> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655365f16a0 v5877 2023-10-03T19:21:09.954 INFO:teuthology.orchestra.run.smithi045.stdout: -5254> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5877 cv=5377/5377 ap=64+63 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=250 | child=1 dirty=1 authpin=1 0x565534f82400] version 5877 2023-10-03T19:21:09.954 INFO:teuthology.orchestra.run.smithi045.stdout: -5253> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=63 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=63 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.954 INFO:teuthology.orchestra.run.smithi045.stdout: -5252> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=63) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5883 pv6007 ap=64 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=64) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=63) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.954 INFO:teuthology.orchestra.run.smithi045.stdout: -5251> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=64) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5883 pv6007 ap=64 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=64) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=62) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.954 INFO:teuthology.orchestra.run.smithi045.stdout: -5250> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000059e [2,head] /dc-dir/dc-file_937 auth v5876 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.912661+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535699700] 2023-10-03T19:21:09.954 INFO:teuthology.orchestra.run.smithi045.stdout: -5249> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000059e [2,head] /dc-dir/dc-file_937 auth v5876 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.912661+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535699700] 2023-10-03T19:21:09.954 INFO:teuthology.orchestra.run.smithi045.stdout: -5248> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.954 INFO:teuthology.orchestra.run.smithi045.stdout: -5247> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.954 INFO:teuthology.orchestra.run.smithi045.stdout: -5246> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.955 INFO:teuthology.orchestra.run.smithi045.stdout: -5245> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000059e [2,head] /dc-dir/dc-file_937 auth v5876 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.912661+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535699700] 2023-10-03T19:21:09.955 INFO:teuthology.orchestra.run.smithi045.stdout: -5244> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000059e [2,head] /dc-dir/dc-file_937 auth v5876 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.912661+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535699700] 2023-10-03T19:21:09.955 INFO:teuthology.orchestra.run.smithi045.stdout: -5243> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.955 INFO:teuthology.orchestra.run.smithi045.stdout: -5242> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 664.608, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.65e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1332.0] 2023-10-03T19:21:09.989 INFO:teuthology.orchestra.run.smithi045.stdout: -5241> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536428d80 on [dir 0x1 / [2,head] auth pv=6008 v=5884 cv=5384/5384 REP dir_auth=0 ap=62+64 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 62 2023-10-03T19:21:09.989 INFO:teuthology.orchestra.run.smithi045.stdout: -5240> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536428d80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5877 cv=5377/5377 ap=63+63 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=250 | child=1 dirty=1 authpin=1 0x565534f82400] count now 63 2023-10-03T19:21:09.989 INFO:teuthology.orchestra.run.smithi045.stdout: -5239> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536428d80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5883 pv6007 ap=63 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=63) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=62) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 63 2023-10-03T19:21:09.990 INFO:teuthology.orchestra.run.smithi045.stdout: -5238> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5884 cv=5384/5384 REP dir_auth=0 ap=62+63 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536428d80 count now 62/63 2023-10-03T19:21:09.990 INFO:teuthology.orchestra.run.smithi045.stdout: -5237> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000059e) auth_unpin by 0x565536428d80 on [inode 0x1000000059e [2,head] /dc-dir/dc-file_937 auth v5876 s=3 n(v0 rc2023-10-03T19:17:09.912661+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535699700] now 0 2023-10-03T19:21:09.990 INFO:teuthology.orchestra.run.smithi045.stdout: -5236> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5877 cv=5377/5377 ap=63+62 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=250 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536428d80 count now 63/62 2023-10-03T19:21:09.990 INFO:teuthology.orchestra.run.smithi045.stdout: -5235> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.990 INFO:teuthology.orchestra.run.smithi045.stdout: -5234> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.990 INFO:teuthology.orchestra.run.smithi045.stdout: -5233> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x1000000059f [2,head] /dc-dir/dc-file_938 auth v4842 pv5878 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.924103+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.924103+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553569e000] 2023-10-03T19:21:09.990 INFO:teuthology.orchestra.run.smithi045.stdout: -5232> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5885 2023-10-03T19:21:09.990 INFO:teuthology.orchestra.run.smithi045.stdout: -5231> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5885 pv6007 ap=63 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=63) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=62) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.990 INFO:teuthology.orchestra.run.smithi045.stdout: -5230> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5883 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.991 INFO:teuthology.orchestra.run.smithi045.stdout: -5229> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5884 cv=5384/5384 REP dir_auth=0 ap=62+63 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5884 2023-10-03T19:21:09.991 INFO:teuthology.orchestra.run.smithi045.stdout: -5228> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x1000000059f) pop_and_dirty_projected_inode v5878 2023-10-03T19:21:09.991 INFO:teuthology.orchestra.run.smithi045.stdout: -5227> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000059f) mark_dirty [inode 0x1000000059f [2,head] /dc-dir/dc-file_938 auth v5878 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.924103+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553569e000] 2023-10-03T19:21:09.991 INFO:teuthology.orchestra.run.smithi045.stdout: -5226> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_938) mark_dirty [dentry #0x1/dc-dir/dc-file_938 [2,head] auth (dversion lock) pv=5878 v=4842 ino=0x1000000059f state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553569c780] 2023-10-03T19:21:09.991 INFO:teuthology.orchestra.run.smithi045.stdout: -5225> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5877 cv=5377/5377 ap=63+62 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=251 | child=1 dirty=1 authpin=1 0x565534f82400] version 5877 2023-10-03T19:21:09.991 INFO:teuthology.orchestra.run.smithi045.stdout: -5224> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x5655365f1a00 v5886 2023-10-03T19:21:09.991 INFO:teuthology.orchestra.run.smithi045.stdout: -5223> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5886 cv=5384/5384 REP dir_auth=0 ap=62+63 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5886 2023-10-03T19:21:09.991 INFO:teuthology.orchestra.run.smithi045.stdout: -5222> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655365f18e0 v5879 2023-10-03T19:21:09.991 INFO:teuthology.orchestra.run.smithi045.stdout: -5221> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5879 cv=5377/5377 ap=63+62 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=251 | child=1 dirty=1 authpin=1 0x565534f82400] version 5879 2023-10-03T19:21:09.991 INFO:teuthology.orchestra.run.smithi045.stdout: -5220> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=62 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=62 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.991 INFO:teuthology.orchestra.run.smithi045.stdout: -5219> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=62) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5885 pv6007 ap=63 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=63) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=62) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.992 INFO:teuthology.orchestra.run.smithi045.stdout: -5218> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=63) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5885 pv6007 ap=63 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=63) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=61) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.992 INFO:teuthology.orchestra.run.smithi045.stdout: -5217> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x1000000059f [2,head] /dc-dir/dc-file_938 auth v5878 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.924103+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553569e000] 2023-10-03T19:21:09.992 INFO:teuthology.orchestra.run.smithi045.stdout: -5216> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x1000000059f [2,head] /dc-dir/dc-file_938 auth v5878 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.924103+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553569e000] 2023-10-03T19:21:09.992 INFO:teuthology.orchestra.run.smithi045.stdout: -5215> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.992 INFO:teuthology.orchestra.run.smithi045.stdout: -5214> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:09.992 INFO:teuthology.orchestra.run.smithi045.stdout: -5213> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:09.992 INFO:teuthology.orchestra.run.smithi045.stdout: -5212> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x1000000059f [2,head] /dc-dir/dc-file_938 auth v5878 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.924103+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553569e000] 2023-10-03T19:21:09.992 INFO:teuthology.orchestra.run.smithi045.stdout: -5211> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x1000000059f [2,head] /dc-dir/dc-file_938 auth v5878 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.924103+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553569e000] 2023-10-03T19:21:09.992 INFO:teuthology.orchestra.run.smithi045.stdout: -5210> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:09.992 INFO:teuthology.orchestra.run.smithi045.stdout: -5209> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 665.608, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.66e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1334.0] 2023-10-03T19:21:09.992 INFO:teuthology.orchestra.run.smithi045.stdout: -5208> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536429200 on [dir 0x1 / [2,head] auth pv=6008 v=5886 cv=5384/5384 REP dir_auth=0 ap=61+63 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 61 2023-10-03T19:21:09.993 INFO:teuthology.orchestra.run.smithi045.stdout: -5207> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536429200 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5885 pv6007 ap=62 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=62) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=61) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 62 2023-10-03T19:21:09.993 INFO:teuthology.orchestra.run.smithi045.stdout: -5206> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5886 cv=5384/5384 REP dir_auth=0 ap=61+62 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536429200 count now 61/62 2023-10-03T19:21:09.993 INFO:teuthology.orchestra.run.smithi045.stdout: -5205> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536429200 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5879 cv=5377/5377 ap=62+62 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=251 | child=1 dirty=1 authpin=1 0x565534f82400] count now 62 2023-10-03T19:21:09.993 INFO:teuthology.orchestra.run.smithi045.stdout: -5204> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000059f) auth_unpin by 0x565536429200 on [inode 0x1000000059f [2,head] /dc-dir/dc-file_938 auth v5878 s=3 n(v0 rc2023-10-03T19:17:09.924103+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553569e000] now 0 2023-10-03T19:21:09.993 INFO:teuthology.orchestra.run.smithi045.stdout: -5203> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5879 cv=5377/5377 ap=62+61 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=251 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536429200 count now 62/61 2023-10-03T19:21:09.993 INFO:teuthology.orchestra.run.smithi045.stdout: -5202> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.993 INFO:teuthology.orchestra.run.smithi045.stdout: -5201> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:09.993 INFO:teuthology.orchestra.run.smithi045.stdout: -5200> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005a0 [2,head] /dc-dir/dc-file_939 auth v4846 pv5880 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.935619+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.935619+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553569e580] 2023-10-03T19:21:09.993 INFO:teuthology.orchestra.run.smithi045.stdout: -5199> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5887 2023-10-03T19:21:09.993 INFO:teuthology.orchestra.run.smithi045.stdout: -5198> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5887 pv6007 ap=62 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=62) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=61) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.994 INFO:teuthology.orchestra.run.smithi045.stdout: -5197> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5885 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:09.994 INFO:teuthology.orchestra.run.smithi045.stdout: -5196> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5886 cv=5384/5384 REP dir_auth=0 ap=61+62 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5886 2023-10-03T19:21:09.994 INFO:teuthology.orchestra.run.smithi045.stdout: -5195> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005a0) pop_and_dirty_projected_inode v5880 2023-10-03T19:21:09.994 INFO:teuthology.orchestra.run.smithi045.stdout: -5194> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005a0) mark_dirty [inode 0x100000005a0 [2,head] /dc-dir/dc-file_939 auth v5880 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.935619+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553569e580] 2023-10-03T19:21:09.994 INFO:teuthology.orchestra.run.smithi045.stdout: -5193> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_939) mark_dirty [dentry #0x1/dc-dir/dc-file_939 [2,head] auth (dversion lock) pv=5880 v=4846 ino=0x100000005a0 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553569ca00] 2023-10-03T19:21:09.994 INFO:teuthology.orchestra.run.smithi045.stdout: -5192> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5879 cv=5377/5377 ap=62+61 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=252 | child=1 dirty=1 authpin=1 0x565534f82400] version 5879 2023-10-03T19:21:09.994 INFO:teuthology.orchestra.run.smithi045.stdout: -5191> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x5655365f1c40 v5888 2023-10-03T19:21:09.994 INFO:teuthology.orchestra.run.smithi045.stdout: -5190> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5888 cv=5384/5384 REP dir_auth=0 ap=61+62 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5888 2023-10-03T19:21:09.994 INFO:teuthology.orchestra.run.smithi045.stdout: -5189> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655365f1b20 v5881 2023-10-03T19:21:09.995 INFO:teuthology.orchestra.run.smithi045.stdout: -5188> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5881 cv=5377/5377 ap=62+61 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=252 | child=1 dirty=1 authpin=1 0x565534f82400] version 5881 2023-10-03T19:21:09.995 INFO:teuthology.orchestra.run.smithi045.stdout: -5187> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=61 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=61 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:09.995 INFO:teuthology.orchestra.run.smithi045.stdout: -5186> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=61) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5887 pv6007 ap=62 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=62) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=61) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.995 INFO:teuthology.orchestra.run.smithi045.stdout: -5185> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=62) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5887 pv6007 ap=62 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=62) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=60) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:09.995 INFO:teuthology.orchestra.run.smithi045.stdout: -5184> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005a0 [2,head] /dc-dir/dc-file_939 auth v5880 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.935619+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553569e580] 2023-10-03T19:21:09.995 INFO:teuthology.orchestra.run.smithi045.stdout: -5183> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005a0 [2,head] /dc-dir/dc-file_939 auth v5880 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.935619+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553569e580] 2023-10-03T19:21:09.995 INFO:teuthology.orchestra.run.smithi045.stdout: -5182> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:09.995 INFO:teuthology.orchestra.run.smithi045.stdout: -5181> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.053 INFO:teuthology.orchestra.run.smithi045.stdout: -5180> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.053 INFO:teuthology.orchestra.run.smithi045.stdout: -5179> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005a0 [2,head] /dc-dir/dc-file_939 auth v5880 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.935619+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553569e580] 2023-10-03T19:21:10.054 INFO:teuthology.orchestra.run.smithi045.stdout: -5178> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005a0 [2,head] /dc-dir/dc-file_939 auth v5880 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.935619+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553569e580] 2023-10-03T19:21:10.054 INFO:teuthology.orchestra.run.smithi045.stdout: -5177> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.054 INFO:teuthology.orchestra.run.smithi045.stdout: -5176> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 666.608, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.67e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1336.0] 2023-10-03T19:21:10.054 INFO:teuthology.orchestra.run.smithi045.stdout: -5175> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536429680 on [dir 0x1 / [2,head] auth pv=6008 v=5888 cv=5384/5384 REP dir_auth=0 ap=60+62 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 60 2023-10-03T19:21:10.054 INFO:teuthology.orchestra.run.smithi045.stdout: -5174> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536429680 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5887 pv6007 ap=61 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=61) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=60) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 61 2023-10-03T19:21:10.054 INFO:teuthology.orchestra.run.smithi045.stdout: -5173> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5888 cv=5384/5384 REP dir_auth=0 ap=60+61 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536429680 count now 60/61 2023-10-03T19:21:10.054 INFO:teuthology.orchestra.run.smithi045.stdout: -5172> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536429680 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5881 cv=5377/5377 ap=61+61 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=252 | child=1 dirty=1 authpin=1 0x565534f82400] count now 61 2023-10-03T19:21:10.054 INFO:teuthology.orchestra.run.smithi045.stdout: -5171> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005a0) auth_unpin by 0x565536429680 on [inode 0x100000005a0 [2,head] /dc-dir/dc-file_939 auth v5880 s=3 n(v0 rc2023-10-03T19:17:09.935619+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553569e580] now 0 2023-10-03T19:21:10.054 INFO:teuthology.orchestra.run.smithi045.stdout: -5170> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5881 cv=5377/5377 ap=61+60 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=252 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536429680 count now 61/60 2023-10-03T19:21:10.054 INFO:teuthology.orchestra.run.smithi045.stdout: -5169> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.055 INFO:teuthology.orchestra.run.smithi045.stdout: -5168> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.055 INFO:teuthology.orchestra.run.smithi045.stdout: -5167> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005a1 [2,head] /dc-dir/dc-file_940 auth v4850 pv5882 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.947215+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.947215+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553569eb00] 2023-10-03T19:21:10.055 INFO:teuthology.orchestra.run.smithi045.stdout: -5166> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5889 2023-10-03T19:21:10.055 INFO:teuthology.orchestra.run.smithi045.stdout: -5165> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5889 pv6007 ap=61 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=61) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=60) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.055 INFO:teuthology.orchestra.run.smithi045.stdout: -5164> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5887 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.055 INFO:teuthology.orchestra.run.smithi045.stdout: -5163> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5888 cv=5384/5384 REP dir_auth=0 ap=60+61 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5888 2023-10-03T19:21:10.055 INFO:teuthology.orchestra.run.smithi045.stdout: -5162> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005a1) pop_and_dirty_projected_inode v5882 2023-10-03T19:21:10.055 INFO:teuthology.orchestra.run.smithi045.stdout: -5161> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005a1) mark_dirty [inode 0x100000005a1 [2,head] /dc-dir/dc-file_940 auth v5882 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.947215+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553569eb00] 2023-10-03T19:21:10.055 INFO:teuthology.orchestra.run.smithi045.stdout: -5160> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_940) mark_dirty [dentry #0x1/dc-dir/dc-file_940 [2,head] auth (dversion lock) pv=5882 v=4850 ino=0x100000005a1 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553569cc80] 2023-10-03T19:21:10.055 INFO:teuthology.orchestra.run.smithi045.stdout: -5159> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5881 cv=5377/5377 ap=61+60 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=253 | child=1 dirty=1 authpin=1 0x565534f82400] version 5881 2023-10-03T19:21:10.055 INFO:teuthology.orchestra.run.smithi045.stdout: -5158> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x5655365f1e80 v5890 2023-10-03T19:21:10.055 INFO:teuthology.orchestra.run.smithi045.stdout: -5157> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5890 cv=5384/5384 REP dir_auth=0 ap=60+61 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5890 2023-10-03T19:21:10.056 INFO:teuthology.orchestra.run.smithi045.stdout: -5156> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655365f1d60 v5883 2023-10-03T19:21:10.056 INFO:teuthology.orchestra.run.smithi045.stdout: -5155> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5883 cv=5377/5377 ap=61+60 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=253 | child=1 dirty=1 authpin=1 0x565534f82400] version 5883 2023-10-03T19:21:10.056 INFO:teuthology.orchestra.run.smithi045.stdout: -5154> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=60 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=60 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.056 INFO:teuthology.orchestra.run.smithi045.stdout: -5153> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=60) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5889 pv6007 ap=61 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=61) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=60) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.056 INFO:teuthology.orchestra.run.smithi045.stdout: -5152> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=61) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5889 pv6007 ap=61 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=61) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=59) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.056 INFO:teuthology.orchestra.run.smithi045.stdout: -5151> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005a1 [2,head] /dc-dir/dc-file_940 auth v5882 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.947215+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553569eb00] 2023-10-03T19:21:10.056 INFO:teuthology.orchestra.run.smithi045.stdout: -5150> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005a1 [2,head] /dc-dir/dc-file_940 auth v5882 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.947215+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553569eb00] 2023-10-03T19:21:10.056 INFO:teuthology.orchestra.run.smithi045.stdout: -5149> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.056 INFO:teuthology.orchestra.run.smithi045.stdout: -5148> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.056 INFO:teuthology.orchestra.run.smithi045.stdout: -5147> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.056 INFO:teuthology.orchestra.run.smithi045.stdout: -5146> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005a1 [2,head] /dc-dir/dc-file_940 auth v5882 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.947215+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553569eb00] 2023-10-03T19:21:10.057 INFO:teuthology.orchestra.run.smithi045.stdout: -5145> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005a1 [2,head] /dc-dir/dc-file_940 auth v5882 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.947215+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553569eb00] 2023-10-03T19:21:10.057 INFO:teuthology.orchestra.run.smithi045.stdout: -5144> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.057 INFO:teuthology.orchestra.run.smithi045.stdout: -5143> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 667.608, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.68e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1338.0] 2023-10-03T19:21:10.057 INFO:teuthology.orchestra.run.smithi045.stdout: -5142> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536429b00 on [dir 0x1 / [2,head] auth pv=6008 v=5890 cv=5384/5384 REP dir_auth=0 ap=59+61 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 59 2023-10-03T19:21:10.057 INFO:teuthology.orchestra.run.smithi045.stdout: -5141> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536429b00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5889 pv6007 ap=60 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=60) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=59) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 60 2023-10-03T19:21:10.057 INFO:teuthology.orchestra.run.smithi045.stdout: -5140> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5890 cv=5384/5384 REP dir_auth=0 ap=59+60 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536429b00 count now 59/60 2023-10-03T19:21:10.057 INFO:teuthology.orchestra.run.smithi045.stdout: -5139> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536429b00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5883 cv=5377/5377 ap=60+60 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=253 | child=1 dirty=1 authpin=1 0x565534f82400] count now 60 2023-10-03T19:21:10.057 INFO:teuthology.orchestra.run.smithi045.stdout: -5138> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005a1) auth_unpin by 0x565536429b00 on [inode 0x100000005a1 [2,head] /dc-dir/dc-file_940 auth v5882 s=3 n(v0 rc2023-10-03T19:17:09.947215+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553569eb00] now 0 2023-10-03T19:21:10.057 INFO:teuthology.orchestra.run.smithi045.stdout: -5137> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5883 cv=5377/5377 ap=60+59 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=253 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536429b00 count now 60/59 2023-10-03T19:21:10.057 INFO:teuthology.orchestra.run.smithi045.stdout: -5136> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.058 INFO:teuthology.orchestra.run.smithi045.stdout: -5135> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.058 INFO:teuthology.orchestra.run.smithi045.stdout: -5134> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005a2 [2,head] /dc-dir/dc-file_941 auth v4854 pv5884 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.960962+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.960962+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553569f080] 2023-10-03T19:21:10.058 INFO:teuthology.orchestra.run.smithi045.stdout: -5133> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5891 2023-10-03T19:21:10.058 INFO:teuthology.orchestra.run.smithi045.stdout: -5132> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5891 pv6007 ap=60 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=60) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=59) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.058 INFO:teuthology.orchestra.run.smithi045.stdout: -5131> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5889 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.058 INFO:teuthology.orchestra.run.smithi045.stdout: -5130> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5890 cv=5384/5384 REP dir_auth=0 ap=59+60 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5890 2023-10-03T19:21:10.058 INFO:teuthology.orchestra.run.smithi045.stdout: -5129> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005a2) pop_and_dirty_projected_inode v5884 2023-10-03T19:21:10.058 INFO:teuthology.orchestra.run.smithi045.stdout: -5128> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005a2) mark_dirty [inode 0x100000005a2 [2,head] /dc-dir/dc-file_941 auth v5884 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.960962+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553569f080] 2023-10-03T19:21:10.058 INFO:teuthology.orchestra.run.smithi045.stdout: -5127> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_941) mark_dirty [dentry #0x1/dc-dir/dc-file_941 [2,head] auth (dversion lock) pv=5884 v=4854 ino=0x100000005a2 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553569cf00] 2023-10-03T19:21:10.058 INFO:teuthology.orchestra.run.smithi045.stdout: -5126> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5883 cv=5377/5377 ap=60+59 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=254 | child=1 dirty=1 authpin=1 0x565534f82400] version 5883 2023-10-03T19:21:10.058 INFO:teuthology.orchestra.run.smithi045.stdout: -5125> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x56553662c140 v5892 2023-10-03T19:21:10.058 INFO:teuthology.orchestra.run.smithi045.stdout: -5124> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5892 cv=5384/5384 REP dir_auth=0 ap=59+60 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5892 2023-10-03T19:21:10.059 INFO:teuthology.orchestra.run.smithi045.stdout: -5123> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x56553662c020 v5885 2023-10-03T19:21:10.059 INFO:teuthology.orchestra.run.smithi045.stdout: -5122> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5885 cv=5377/5377 ap=60+59 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=254 | child=1 dirty=1 authpin=1 0x565534f82400] version 5885 2023-10-03T19:21:10.059 INFO:teuthology.orchestra.run.smithi045.stdout: -5121> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=59 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=59 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.059 INFO:teuthology.orchestra.run.smithi045.stdout: -5120> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=59) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5891 pv6007 ap=60 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=60) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=59) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.059 INFO:teuthology.orchestra.run.smithi045.stdout: -5119> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=60) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5891 pv6007 ap=60 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=60) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=58) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.059 INFO:teuthology.orchestra.run.smithi045.stdout: -5118> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005a2 [2,head] /dc-dir/dc-file_941 auth v5884 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.960962+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553569f080] 2023-10-03T19:21:10.059 INFO:teuthology.orchestra.run.smithi045.stdout: -5117> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005a2 [2,head] /dc-dir/dc-file_941 auth v5884 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.960962+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553569f080] 2023-10-03T19:21:10.060 INFO:teuthology.orchestra.run.smithi045.stdout: -5116> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.060 INFO:teuthology.orchestra.run.smithi045.stdout: -5115> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.060 INFO:teuthology.orchestra.run.smithi045.stdout: -5114> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.060 INFO:teuthology.orchestra.run.smithi045.stdout: -5113> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005a2 [2,head] /dc-dir/dc-file_941 auth v5884 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.960962+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553569f080] 2023-10-03T19:21:10.060 INFO:teuthology.orchestra.run.smithi045.stdout: -5112> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005a2 [2,head] /dc-dir/dc-file_941 auth v5884 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.960962+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553569f080] 2023-10-03T19:21:10.060 INFO:teuthology.orchestra.run.smithi045.stdout: -5111> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.107 INFO:teuthology.orchestra.run.smithi045.stdout: -5110> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 668.608, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.69e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1340.0] 2023-10-03T19:21:10.107 INFO:teuthology.orchestra.run.smithi045.stdout: -5109> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x56553662a000 on [dir 0x1 / [2,head] auth pv=6008 v=5892 cv=5384/5384 REP dir_auth=0 ap=58+60 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 58 2023-10-03T19:21:10.107 INFO:teuthology.orchestra.run.smithi045.stdout: -5108> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x56553662a000 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5891 pv6007 ap=59 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=59) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=58) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 59 2023-10-03T19:21:10.107 INFO:teuthology.orchestra.run.smithi045.stdout: -5107> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5892 cv=5384/5384 REP dir_auth=0 ap=58+59 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x56553662a000 count now 58/59 2023-10-03T19:21:10.107 INFO:teuthology.orchestra.run.smithi045.stdout: -5106> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x56553662a000 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5885 cv=5377/5377 ap=59+59 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=254 | child=1 dirty=1 authpin=1 0x565534f82400] count now 59 2023-10-03T19:21:10.107 INFO:teuthology.orchestra.run.smithi045.stdout: -5105> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005a2) auth_unpin by 0x56553662a000 on [inode 0x100000005a2 [2,head] /dc-dir/dc-file_941 auth v5884 s=3 n(v0 rc2023-10-03T19:17:09.960962+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553569f080] now 0 2023-10-03T19:21:10.108 INFO:teuthology.orchestra.run.smithi045.stdout: -5104> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5885 cv=5377/5377 ap=59+58 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=254 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x56553662a000 count now 59/58 2023-10-03T19:21:10.108 INFO:teuthology.orchestra.run.smithi045.stdout: -5103> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.108 INFO:teuthology.orchestra.run.smithi045.stdout: -5102> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.108 INFO:teuthology.orchestra.run.smithi045.stdout: -5101> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005a3 [2,head] /dc-dir/dc-file_942 auth v4858 pv5886 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.974609+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.974609+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553569f600] 2023-10-03T19:21:10.108 INFO:teuthology.orchestra.run.smithi045.stdout: -5100> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5893 2023-10-03T19:21:10.108 INFO:teuthology.orchestra.run.smithi045.stdout: -5099> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5893 pv6007 ap=59 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=59) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=58) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.108 INFO:teuthology.orchestra.run.smithi045.stdout: -5098> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5891 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.108 INFO:teuthology.orchestra.run.smithi045.stdout: -5097> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5892 cv=5384/5384 REP dir_auth=0 ap=58+59 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5892 2023-10-03T19:21:10.108 INFO:teuthology.orchestra.run.smithi045.stdout: -5096> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005a3) pop_and_dirty_projected_inode v5886 2023-10-03T19:21:10.108 INFO:teuthology.orchestra.run.smithi045.stdout: -5095> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005a3) mark_dirty [inode 0x100000005a3 [2,head] /dc-dir/dc-file_942 auth v5886 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.974609+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553569f600] 2023-10-03T19:21:10.108 INFO:teuthology.orchestra.run.smithi045.stdout: -5094> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_942) mark_dirty [dentry #0x1/dc-dir/dc-file_942 [2,head] auth (dversion lock) pv=5886 v=4858 ino=0x100000005a3 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553569d180] 2023-10-03T19:21:10.109 INFO:teuthology.orchestra.run.smithi045.stdout: -5093> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5885 cv=5377/5377 ap=59+58 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=255 | child=1 dirty=1 authpin=1 0x565534f82400] version 5885 2023-10-03T19:21:10.109 INFO:teuthology.orchestra.run.smithi045.stdout: -5092> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x56553662c380 v5894 2023-10-03T19:21:10.109 INFO:teuthology.orchestra.run.smithi045.stdout: -5091> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5894 cv=5384/5384 REP dir_auth=0 ap=58+59 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5894 2023-10-03T19:21:10.109 INFO:teuthology.orchestra.run.smithi045.stdout: -5090> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x56553662c260 v5887 2023-10-03T19:21:10.109 INFO:teuthology.orchestra.run.smithi045.stdout: -5089> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5887 cv=5377/5377 ap=59+58 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=255 | child=1 dirty=1 authpin=1 0x565534f82400] version 5887 2023-10-03T19:21:10.109 INFO:teuthology.orchestra.run.smithi045.stdout: -5088> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=58 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=58 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.109 INFO:teuthology.orchestra.run.smithi045.stdout: -5087> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=58) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5893 pv6007 ap=59 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=59) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=58) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.109 INFO:teuthology.orchestra.run.smithi045.stdout: -5086> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=59) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5893 pv6007 ap=59 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=59) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=57) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.109 INFO:teuthology.orchestra.run.smithi045.stdout: -5085> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005a3 [2,head] /dc-dir/dc-file_942 auth v5886 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.974609+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553569f600] 2023-10-03T19:21:10.109 INFO:teuthology.orchestra.run.smithi045.stdout: -5084> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005a3 [2,head] /dc-dir/dc-file_942 auth v5886 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.974609+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553569f600] 2023-10-03T19:21:10.110 INFO:teuthology.orchestra.run.smithi045.stdout: -5083> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.110 INFO:teuthology.orchestra.run.smithi045.stdout: -5082> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.110 INFO:teuthology.orchestra.run.smithi045.stdout: -5081> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.110 INFO:teuthology.orchestra.run.smithi045.stdout: -5080> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005a3 [2,head] /dc-dir/dc-file_942 auth v5886 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.974609+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553569f600] 2023-10-03T19:21:10.110 INFO:teuthology.orchestra.run.smithi045.stdout: -5079> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005a3 [2,head] /dc-dir/dc-file_942 auth v5886 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.974609+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553569f600] 2023-10-03T19:21:10.110 INFO:teuthology.orchestra.run.smithi045.stdout: -5078> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.110 INFO:teuthology.orchestra.run.smithi045.stdout: -5077> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 669.608, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.70e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1342.0] 2023-10-03T19:21:10.110 INFO:teuthology.orchestra.run.smithi045.stdout: -5076> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x56553662a480 on [dir 0x1 / [2,head] auth pv=6008 v=5894 cv=5384/5384 REP dir_auth=0 ap=57+59 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 57 2023-10-03T19:21:10.110 INFO:teuthology.orchestra.run.smithi045.stdout: -5075> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x56553662a480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5893 pv6007 ap=58 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=58) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=57) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 58 2023-10-03T19:21:10.110 INFO:teuthology.orchestra.run.smithi045.stdout: -5074> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5894 cv=5384/5384 REP dir_auth=0 ap=57+58 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x56553662a480 count now 57/58 2023-10-03T19:21:10.110 INFO:teuthology.orchestra.run.smithi045.stdout: -5073> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x56553662a480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5887 cv=5377/5377 ap=58+58 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=255 | child=1 dirty=1 authpin=1 0x565534f82400] count now 58 2023-10-03T19:21:10.111 INFO:teuthology.orchestra.run.smithi045.stdout: -5072> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005a3) auth_unpin by 0x56553662a480 on [inode 0x100000005a3 [2,head] /dc-dir/dc-file_942 auth v5886 s=3 n(v0 rc2023-10-03T19:17:09.974609+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553569f600] now 0 2023-10-03T19:21:10.111 INFO:teuthology.orchestra.run.smithi045.stdout: -5071> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5887 cv=5377/5377 ap=58+57 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=255 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x56553662a480 count now 58/57 2023-10-03T19:21:10.111 INFO:teuthology.orchestra.run.smithi045.stdout: -5070> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.111 INFO:teuthology.orchestra.run.smithi045.stdout: -5069> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.111 INFO:teuthology.orchestra.run.smithi045.stdout: -5068> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005a4 [2,head] /dc-dir/dc-file_943 auth v4862 pv5888 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.987593+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.987593+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553569fb80] 2023-10-03T19:21:10.111 INFO:teuthology.orchestra.run.smithi045.stdout: -5067> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5895 2023-10-03T19:21:10.111 INFO:teuthology.orchestra.run.smithi045.stdout: -5066> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5895 pv6007 ap=58 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=58) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=57) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.111 INFO:teuthology.orchestra.run.smithi045.stdout: -5065> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5893 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.111 INFO:teuthology.orchestra.run.smithi045.stdout: -5064> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5894 cv=5384/5384 REP dir_auth=0 ap=57+58 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5894 2023-10-03T19:21:10.111 INFO:teuthology.orchestra.run.smithi045.stdout: -5063> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005a4) pop_and_dirty_projected_inode v5888 2023-10-03T19:21:10.111 INFO:teuthology.orchestra.run.smithi045.stdout: -5062> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005a4) mark_dirty [inode 0x100000005a4 [2,head] /dc-dir/dc-file_943 auth v5888 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.987593+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553569fb80] 2023-10-03T19:21:10.112 INFO:teuthology.orchestra.run.smithi045.stdout: -5061> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_943) mark_dirty [dentry #0x1/dc-dir/dc-file_943 [2,head] auth (dversion lock) pv=5888 v=4862 ino=0x100000005a4 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553569d400] 2023-10-03T19:21:10.112 INFO:teuthology.orchestra.run.smithi045.stdout: -5060> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5887 cv=5377/5377 ap=58+57 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=256 | child=1 dirty=1 authpin=1 0x565534f82400] version 5887 2023-10-03T19:21:10.112 INFO:teuthology.orchestra.run.smithi045.stdout: -5059> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x56553662c5c0 v5896 2023-10-03T19:21:10.112 INFO:teuthology.orchestra.run.smithi045.stdout: -5058> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5896 cv=5384/5384 REP dir_auth=0 ap=57+58 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5896 2023-10-03T19:21:10.112 INFO:teuthology.orchestra.run.smithi045.stdout: -5057> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x56553662c4a0 v5889 2023-10-03T19:21:10.112 INFO:teuthology.orchestra.run.smithi045.stdout: -5056> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5889 cv=5377/5377 ap=58+57 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=256 | child=1 dirty=1 authpin=1 0x565534f82400] version 5889 2023-10-03T19:21:10.112 INFO:teuthology.orchestra.run.smithi045.stdout: -5055> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=57 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=57 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.112 INFO:teuthology.orchestra.run.smithi045.stdout: -5054> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=57) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5895 pv6007 ap=58 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=58) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=57) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.112 INFO:teuthology.orchestra.run.smithi045.stdout: -5053> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=58) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5895 pv6007 ap=58 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=58) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=56) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.112 INFO:teuthology.orchestra.run.smithi045.stdout: -5052> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005a4 [2,head] /dc-dir/dc-file_943 auth v5888 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.987593+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553569fb80] 2023-10-03T19:21:10.113 INFO:teuthology.orchestra.run.smithi045.stdout: -5051> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005a4 [2,head] /dc-dir/dc-file_943 auth v5888 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.987593+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553569fb80] 2023-10-03T19:21:10.113 INFO:teuthology.orchestra.run.smithi045.stdout: -5050> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.113 INFO:teuthology.orchestra.run.smithi045.stdout: -5049> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.113 INFO:teuthology.orchestra.run.smithi045.stdout: -5048> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.113 INFO:teuthology.orchestra.run.smithi045.stdout: -5047> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005a4 [2,head] /dc-dir/dc-file_943 auth v5888 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.987593+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553569fb80] 2023-10-03T19:21:10.155 INFO:teuthology.orchestra.run.smithi045.stdout: -5046> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005a4 [2,head] /dc-dir/dc-file_943 auth v5888 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.987593+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553569fb80] 2023-10-03T19:21:10.155 INFO:teuthology.orchestra.run.smithi045.stdout: -5045> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.155 INFO:teuthology.orchestra.run.smithi045.stdout: -5044> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 670.608, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.71e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1344.0] 2023-10-03T19:21:10.156 INFO:teuthology.orchestra.run.smithi045.stdout: -5043> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x56553662a900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5895 pv6007 ap=57 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=57) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=56) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 57 2023-10-03T19:21:10.156 INFO:teuthology.orchestra.run.smithi045.stdout: -5042> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5896 cv=5384/5384 REP dir_auth=0 ap=57+57 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x56553662a900 count now 57/57 2023-10-03T19:21:10.156 INFO:teuthology.orchestra.run.smithi045.stdout: -5041> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x56553662a900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5889 cv=5377/5377 ap=57+57 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=256 | child=1 dirty=1 authpin=1 0x565534f82400] count now 57 2023-10-03T19:21:10.156 INFO:teuthology.orchestra.run.smithi045.stdout: -5040> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x56553662a900 on [dir 0x1 / [2,head] auth pv=6008 v=5896 cv=5384/5384 REP dir_auth=0 ap=56+57 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 56 2023-10-03T19:21:10.156 INFO:teuthology.orchestra.run.smithi045.stdout: -5039> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005a4) auth_unpin by 0x56553662a900 on [inode 0x100000005a4 [2,head] /dc-dir/dc-file_943 auth v5888 s=3 n(v0 rc2023-10-03T19:17:09.987593+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553569fb80] now 0 2023-10-03T19:21:10.156 INFO:teuthology.orchestra.run.smithi045.stdout: -5038> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5889 cv=5377/5377 ap=57+56 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=256 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x56553662a900 count now 57/56 2023-10-03T19:21:10.156 INFO:teuthology.orchestra.run.smithi045.stdout: -5037> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.156 INFO:teuthology.orchestra.run.smithi045.stdout: -5036> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.156 INFO:teuthology.orchestra.run.smithi045.stdout: -5035> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005a5 [2,head] /dc-dir/dc-file_944 auth v4866 pv5890 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.999158+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:09.999158+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655356a0100] 2023-10-03T19:21:10.156 INFO:teuthology.orchestra.run.smithi045.stdout: -5034> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5897 2023-10-03T19:21:10.156 INFO:teuthology.orchestra.run.smithi045.stdout: -5033> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5897 pv6007 ap=57 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=57) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=56) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.157 INFO:teuthology.orchestra.run.smithi045.stdout: -5032> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5895 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.157 INFO:teuthology.orchestra.run.smithi045.stdout: -5031> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5896 cv=5384/5384 REP dir_auth=0 ap=56+57 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5896 2023-10-03T19:21:10.157 INFO:teuthology.orchestra.run.smithi045.stdout: -5030> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005a5) pop_and_dirty_projected_inode v5890 2023-10-03T19:21:10.157 INFO:teuthology.orchestra.run.smithi045.stdout: -5029> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005a5) mark_dirty [inode 0x100000005a5 [2,head] /dc-dir/dc-file_944 auth v5890 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.999158+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655356a0100] 2023-10-03T19:21:10.157 INFO:teuthology.orchestra.run.smithi045.stdout: -5028> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_944) mark_dirty [dentry #0x1/dc-dir/dc-file_944 [2,head] auth (dversion lock) pv=5890 v=4866 ino=0x100000005a5 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553569d680] 2023-10-03T19:21:10.157 INFO:teuthology.orchestra.run.smithi045.stdout: -5027> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5889 cv=5377/5377 ap=57+56 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=257 | child=1 dirty=1 authpin=1 0x565534f82400] version 5889 2023-10-03T19:21:10.157 INFO:teuthology.orchestra.run.smithi045.stdout: -5026> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x56553662c800 v5898 2023-10-03T19:21:10.157 INFO:teuthology.orchestra.run.smithi045.stdout: -5025> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5898 cv=5384/5384 REP dir_auth=0 ap=56+57 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5898 2023-10-03T19:21:10.157 INFO:teuthology.orchestra.run.smithi045.stdout: -5024> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x56553662c6e0 v5891 2023-10-03T19:21:10.157 INFO:teuthology.orchestra.run.smithi045.stdout: -5023> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5891 cv=5377/5377 ap=57+56 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=257 | child=1 dirty=1 authpin=1 0x565534f82400] version 5891 2023-10-03T19:21:10.157 INFO:teuthology.orchestra.run.smithi045.stdout: -5022> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=56 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=56 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.158 INFO:teuthology.orchestra.run.smithi045.stdout: -5021> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=56) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5897 pv6007 ap=57 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=57) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=56) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.158 INFO:teuthology.orchestra.run.smithi045.stdout: -5020> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=57) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5897 pv6007 ap=57 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=57) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=55) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.158 INFO:teuthology.orchestra.run.smithi045.stdout: -5019> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005a5 [2,head] /dc-dir/dc-file_944 auth v5890 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.999158+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655356a0100] 2023-10-03T19:21:10.158 INFO:teuthology.orchestra.run.smithi045.stdout: -5018> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005a5 [2,head] /dc-dir/dc-file_944 auth v5890 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.999158+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655356a0100] 2023-10-03T19:21:10.158 INFO:teuthology.orchestra.run.smithi045.stdout: -5017> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.158 INFO:teuthology.orchestra.run.smithi045.stdout: -5016> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.158 INFO:teuthology.orchestra.run.smithi045.stdout: -5015> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.158 INFO:teuthology.orchestra.run.smithi045.stdout: -5014> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005a5 [2,head] /dc-dir/dc-file_944 auth v5890 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.999158+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655356a0100] 2023-10-03T19:21:10.158 INFO:teuthology.orchestra.run.smithi045.stdout: -5013> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005a5 [2,head] /dc-dir/dc-file_944 auth v5890 ap=1 s=3 n(v0 rc2023-10-03T19:17:09.999158+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655356a0100] 2023-10-03T19:21:10.158 INFO:teuthology.orchestra.run.smithi045.stdout: -5012> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.159 INFO:teuthology.orchestra.run.smithi045.stdout: -5011> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 671.608, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.72e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1346.0] 2023-10-03T19:21:10.159 INFO:teuthology.orchestra.run.smithi045.stdout: -5010> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x56553662ad80 on [dir 0x1 / [2,head] auth pv=6008 v=5898 cv=5384/5384 REP dir_auth=0 ap=55+57 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 55 2023-10-03T19:21:10.159 INFO:teuthology.orchestra.run.smithi045.stdout: -5009> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x56553662ad80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5897 pv6007 ap=56 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=56) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=55) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 56 2023-10-03T19:21:10.159 INFO:teuthology.orchestra.run.smithi045.stdout: -5008> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5898 cv=5384/5384 REP dir_auth=0 ap=55+56 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x56553662ad80 count now 55/56 2023-10-03T19:21:10.159 INFO:teuthology.orchestra.run.smithi045.stdout: -5007> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x56553662ad80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5891 cv=5377/5377 ap=56+56 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=257 | child=1 dirty=1 authpin=1 0x565534f82400] count now 56 2023-10-03T19:21:10.159 INFO:teuthology.orchestra.run.smithi045.stdout: -5006> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005a5) auth_unpin by 0x56553662ad80 on [inode 0x100000005a5 [2,head] /dc-dir/dc-file_944 auth v5890 s=3 n(v0 rc2023-10-03T19:17:09.999158+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655356a0100] now 0 2023-10-03T19:21:10.159 INFO:teuthology.orchestra.run.smithi045.stdout: -5005> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5891 cv=5377/5377 ap=56+55 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=257 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x56553662ad80 count now 56/55 2023-10-03T19:21:10.159 INFO:teuthology.orchestra.run.smithi045.stdout: -5004> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.159 INFO:teuthology.orchestra.run.smithi045.stdout: -5003> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.159 INFO:teuthology.orchestra.run.smithi045.stdout: -5002> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005a6 [2,head] /dc-dir/dc-file_945 auth v4870 pv5892 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.009972+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.009972+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655356a0680] 2023-10-03T19:21:10.159 INFO:teuthology.orchestra.run.smithi045.stdout: -5001> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5899 2023-10-03T19:21:10.161 INFO:teuthology.orchestra.run.smithi045.stdout: -5000> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5899 pv6007 ap=56 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=56) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=55) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.161 INFO:teuthology.orchestra.run.smithi045.stdout: -4999> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5897 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.161 INFO:teuthology.orchestra.run.smithi045.stdout: -4998> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5898 cv=5384/5384 REP dir_auth=0 ap=55+56 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5898 2023-10-03T19:21:10.161 INFO:teuthology.orchestra.run.smithi045.stdout: -4997> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005a6) pop_and_dirty_projected_inode v5892 2023-10-03T19:21:10.161 INFO:teuthology.orchestra.run.smithi045.stdout: -4996> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005a6) mark_dirty [inode 0x100000005a6 [2,head] /dc-dir/dc-file_945 auth v5892 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.009972+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655356a0680] 2023-10-03T19:21:10.161 INFO:teuthology.orchestra.run.smithi045.stdout: -4995> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_945) mark_dirty [dentry #0x1/dc-dir/dc-file_945 [2,head] auth (dversion lock) pv=5892 v=4870 ino=0x100000005a6 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553569d900] 2023-10-03T19:21:10.161 INFO:teuthology.orchestra.run.smithi045.stdout: -4994> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5891 cv=5377/5377 ap=56+55 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=258 | child=1 dirty=1 authpin=1 0x565534f82400] version 5891 2023-10-03T19:21:10.161 INFO:teuthology.orchestra.run.smithi045.stdout: -4993> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x56553662ca40 v5900 2023-10-03T19:21:10.161 INFO:teuthology.orchestra.run.smithi045.stdout: -4992> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5900 cv=5384/5384 REP dir_auth=0 ap=55+56 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5900 2023-10-03T19:21:10.162 INFO:teuthology.orchestra.run.smithi045.stdout: -4991> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x56553662c920 v5893 2023-10-03T19:21:10.162 INFO:teuthology.orchestra.run.smithi045.stdout: -4990> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5893 cv=5377/5377 ap=56+55 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=258 | child=1 dirty=1 authpin=1 0x565534f82400] version 5893 2023-10-03T19:21:10.162 INFO:teuthology.orchestra.run.smithi045.stdout: -4989> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=55 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=55 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.162 INFO:teuthology.orchestra.run.smithi045.stdout: -4988> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=55) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5899 pv6007 ap=56 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=56) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=55) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.162 INFO:teuthology.orchestra.run.smithi045.stdout: -4987> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=56) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5899 pv6007 ap=56 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=56) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=54) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.162 INFO:teuthology.orchestra.run.smithi045.stdout: -4986> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005a6 [2,head] /dc-dir/dc-file_945 auth v5892 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.009972+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655356a0680] 2023-10-03T19:21:10.162 INFO:teuthology.orchestra.run.smithi045.stdout: -4985> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005a6 [2,head] /dc-dir/dc-file_945 auth v5892 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.009972+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655356a0680] 2023-10-03T19:21:10.162 INFO:teuthology.orchestra.run.smithi045.stdout: -4984> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.188 INFO:teuthology.orchestra.run.smithi045.stdout: -4983> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.188 INFO:teuthology.orchestra.run.smithi045.stdout: -4982> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.188 INFO:teuthology.orchestra.run.smithi045.stdout: -4981> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005a6 [2,head] /dc-dir/dc-file_945 auth v5892 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.009972+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655356a0680] 2023-10-03T19:21:10.188 INFO:teuthology.orchestra.run.smithi045.stdout: -4980> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005a6 [2,head] /dc-dir/dc-file_945 auth v5892 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.009972+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655356a0680] 2023-10-03T19:21:10.188 INFO:teuthology.orchestra.run.smithi045.stdout: -4979> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.188 INFO:teuthology.orchestra.run.smithi045.stdout: -4978> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 672.608, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.73e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1348.0] 2023-10-03T19:21:10.188 INFO:teuthology.orchestra.run.smithi045.stdout: -4977> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x56553662b200 on [dir 0x1 / [2,head] auth pv=6008 v=5900 cv=5384/5384 REP dir_auth=0 ap=54+56 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 54 2023-10-03T19:21:10.188 INFO:teuthology.orchestra.run.smithi045.stdout: -4976> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x56553662b200 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5899 pv6007 ap=55 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=55) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=54) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 55 2023-10-03T19:21:10.188 INFO:teuthology.orchestra.run.smithi045.stdout: -4975> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5900 cv=5384/5384 REP dir_auth=0 ap=54+55 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x56553662b200 count now 54/55 2023-10-03T19:21:10.189 INFO:teuthology.orchestra.run.smithi045.stdout: -4974> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x56553662b200 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5893 cv=5377/5377 ap=55+55 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=258 | child=1 dirty=1 authpin=1 0x565534f82400] count now 55 2023-10-03T19:21:10.189 INFO:teuthology.orchestra.run.smithi045.stdout: -4973> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005a6) auth_unpin by 0x56553662b200 on [inode 0x100000005a6 [2,head] /dc-dir/dc-file_945 auth v5892 s=3 n(v0 rc2023-10-03T19:17:10.009972+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655356a0680] now 0 2023-10-03T19:21:10.189 INFO:teuthology.orchestra.run.smithi045.stdout: -4972> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5893 cv=5377/5377 ap=55+54 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=258 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x56553662b200 count now 55/54 2023-10-03T19:21:10.189 INFO:teuthology.orchestra.run.smithi045.stdout: -4971> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.189 INFO:teuthology.orchestra.run.smithi045.stdout: -4970> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.189 INFO:teuthology.orchestra.run.smithi045.stdout: -4969> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005a7 [2,head] /dc-dir/dc-file_946 auth v4874 pv5894 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.019736+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.019736+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655356a0c00] 2023-10-03T19:21:10.189 INFO:teuthology.orchestra.run.smithi045.stdout: -4968> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5901 2023-10-03T19:21:10.189 INFO:teuthology.orchestra.run.smithi045.stdout: -4967> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5901 pv6007 ap=55 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=55) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=54) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.189 INFO:teuthology.orchestra.run.smithi045.stdout: -4966> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5899 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.189 INFO:teuthology.orchestra.run.smithi045.stdout: -4965> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5900 cv=5384/5384 REP dir_auth=0 ap=54+55 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5900 2023-10-03T19:21:10.190 INFO:teuthology.orchestra.run.smithi045.stdout: -4964> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005a7) pop_and_dirty_projected_inode v5894 2023-10-03T19:21:10.190 INFO:teuthology.orchestra.run.smithi045.stdout: -4963> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005a7) mark_dirty [inode 0x100000005a7 [2,head] /dc-dir/dc-file_946 auth v5894 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.019736+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655356a0c00] 2023-10-03T19:21:10.190 INFO:teuthology.orchestra.run.smithi045.stdout: -4962> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_946) mark_dirty [dentry #0x1/dc-dir/dc-file_946 [2,head] auth (dversion lock) pv=5894 v=4874 ino=0x100000005a7 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553569db80] 2023-10-03T19:21:10.190 INFO:teuthology.orchestra.run.smithi045.stdout: -4961> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5893 cv=5377/5377 ap=55+54 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=259 | child=1 dirty=1 authpin=1 0x565534f82400] version 5893 2023-10-03T19:21:10.190 INFO:teuthology.orchestra.run.smithi045.stdout: -4960> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x56553662cc80 v5902 2023-10-03T19:21:10.190 INFO:teuthology.orchestra.run.smithi045.stdout: -4959> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5902 cv=5384/5384 REP dir_auth=0 ap=54+55 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5902 2023-10-03T19:21:10.190 INFO:teuthology.orchestra.run.smithi045.stdout: -4958> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x56553662cb60 v5895 2023-10-03T19:21:10.190 INFO:teuthology.orchestra.run.smithi045.stdout: -4957> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5895 cv=5377/5377 ap=55+54 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=259 | child=1 dirty=1 authpin=1 0x565534f82400] version 5895 2023-10-03T19:21:10.190 INFO:teuthology.orchestra.run.smithi045.stdout: -4956> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=54 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=54 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.190 INFO:teuthology.orchestra.run.smithi045.stdout: -4955> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=54) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5901 pv6007 ap=55 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=55) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=54) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.191 INFO:teuthology.orchestra.run.smithi045.stdout: -4954> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=55) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5901 pv6007 ap=55 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=55) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=53) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.191 INFO:teuthology.orchestra.run.smithi045.stdout: -4953> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005a7 [2,head] /dc-dir/dc-file_946 auth v5894 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.019736+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655356a0c00] 2023-10-03T19:21:10.191 INFO:teuthology.orchestra.run.smithi045.stdout: -4952> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005a7 [2,head] /dc-dir/dc-file_946 auth v5894 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.019736+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655356a0c00] 2023-10-03T19:21:10.191 INFO:teuthology.orchestra.run.smithi045.stdout: -4951> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.191 INFO:teuthology.orchestra.run.smithi045.stdout: -4950> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.191 INFO:teuthology.orchestra.run.smithi045.stdout: -4949> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.191 INFO:teuthology.orchestra.run.smithi045.stdout: -4948> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005a7 [2,head] /dc-dir/dc-file_946 auth v5894 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.019736+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655356a0c00] 2023-10-03T19:21:10.191 INFO:teuthology.orchestra.run.smithi045.stdout: -4947> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005a7 [2,head] /dc-dir/dc-file_946 auth v5894 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.019736+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655356a0c00] 2023-10-03T19:21:10.191 INFO:teuthology.orchestra.run.smithi045.stdout: -4946> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.191 INFO:teuthology.orchestra.run.smithi045.stdout: -4945> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 673.608, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.74e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1350.0] 2023-10-03T19:21:10.191 INFO:teuthology.orchestra.run.smithi045.stdout: -4944> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x56553662b680 on [dir 0x1 / [2,head] auth pv=6008 v=5902 cv=5384/5384 REP dir_auth=0 ap=53+55 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 53 2023-10-03T19:21:10.191 INFO:teuthology.orchestra.run.smithi045.stdout: -4943> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x56553662b680 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5895 cv=5377/5377 ap=54+54 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=259 | child=1 dirty=1 authpin=1 0x565534f82400] count now 54 2023-10-03T19:21:10.192 INFO:teuthology.orchestra.run.smithi045.stdout: -4942> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x56553662b680 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5901 pv6007 ap=54 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=54) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=53) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 54 2023-10-03T19:21:10.192 INFO:teuthology.orchestra.run.smithi045.stdout: -4941> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5902 cv=5384/5384 REP dir_auth=0 ap=53+54 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x56553662b680 count now 53/54 2023-10-03T19:21:10.192 INFO:teuthology.orchestra.run.smithi045.stdout: -4940> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005a7) auth_unpin by 0x56553662b680 on [inode 0x100000005a7 [2,head] /dc-dir/dc-file_946 auth v5894 s=3 n(v0 rc2023-10-03T19:17:10.019736+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655356a0c00] now 0 2023-10-03T19:21:10.192 INFO:teuthology.orchestra.run.smithi045.stdout: -4939> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5895 cv=5377/5377 ap=54+53 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=259 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x56553662b680 count now 54/53 2023-10-03T19:21:10.192 INFO:teuthology.orchestra.run.smithi045.stdout: -4938> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.192 INFO:teuthology.orchestra.run.smithi045.stdout: -4937> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.192 INFO:teuthology.orchestra.run.smithi045.stdout: -4936> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005a8 [2,head] /dc-dir/dc-file_947 auth v4878 pv5896 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.030010+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.030010+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655356a1180] 2023-10-03T19:21:10.192 INFO:teuthology.orchestra.run.smithi045.stdout: -4935> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5903 2023-10-03T19:21:10.192 INFO:teuthology.orchestra.run.smithi045.stdout: -4934> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5903 pv6007 ap=54 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=54) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=53) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.192 INFO:teuthology.orchestra.run.smithi045.stdout: -4933> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5901 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.192 INFO:teuthology.orchestra.run.smithi045.stdout: -4932> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5902 cv=5384/5384 REP dir_auth=0 ap=53+54 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5902 2023-10-03T19:21:10.193 INFO:teuthology.orchestra.run.smithi045.stdout: -4931> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005a8) pop_and_dirty_projected_inode v5896 2023-10-03T19:21:10.193 INFO:teuthology.orchestra.run.smithi045.stdout: -4930> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005a8) mark_dirty [inode 0x100000005a8 [2,head] /dc-dir/dc-file_947 auth v5896 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.030010+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655356a1180] 2023-10-03T19:21:10.193 INFO:teuthology.orchestra.run.smithi045.stdout: -4929> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_947) mark_dirty [dentry #0x1/dc-dir/dc-file_947 [2,head] auth (dversion lock) pv=5896 v=4878 ino=0x100000005a8 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535682000] 2023-10-03T19:21:10.193 INFO:teuthology.orchestra.run.smithi045.stdout: -4928> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5895 cv=5377/5377 ap=54+53 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=260 | child=1 dirty=1 authpin=1 0x565534f82400] version 5895 2023-10-03T19:21:10.245 INFO:teuthology.orchestra.run.smithi045.stdout: -4927> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x56553662cec0 v5904 2023-10-03T19:21:10.246 INFO:teuthology.orchestra.run.smithi045.stdout: -4926> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5904 cv=5384/5384 REP dir_auth=0 ap=53+54 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5904 2023-10-03T19:21:10.246 INFO:teuthology.orchestra.run.smithi045.stdout: -4925> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x56553662cda0 v5897 2023-10-03T19:21:10.246 INFO:teuthology.orchestra.run.smithi045.stdout: -4924> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5897 cv=5377/5377 ap=54+53 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=260 | child=1 dirty=1 authpin=1 0x565534f82400] version 5897 2023-10-03T19:21:10.246 INFO:teuthology.orchestra.run.smithi045.stdout: -4923> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=53 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=53 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.246 INFO:teuthology.orchestra.run.smithi045.stdout: -4922> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=53) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5903 pv6007 ap=54 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=54) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=53) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.246 INFO:teuthology.orchestra.run.smithi045.stdout: -4921> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=54) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5903 pv6007 ap=54 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=54) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=52) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.246 INFO:teuthology.orchestra.run.smithi045.stdout: -4920> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005a8 [2,head] /dc-dir/dc-file_947 auth v5896 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.030010+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655356a1180] 2023-10-03T19:21:10.246 INFO:teuthology.orchestra.run.smithi045.stdout: -4919> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005a8 [2,head] /dc-dir/dc-file_947 auth v5896 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.030010+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655356a1180] 2023-10-03T19:21:10.246 INFO:teuthology.orchestra.run.smithi045.stdout: -4918> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.246 INFO:teuthology.orchestra.run.smithi045.stdout: -4917> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.247 INFO:teuthology.orchestra.run.smithi045.stdout: -4916> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.247 INFO:teuthology.orchestra.run.smithi045.stdout: -4915> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005a8 [2,head] /dc-dir/dc-file_947 auth v5896 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.030010+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655356a1180] 2023-10-03T19:21:10.247 INFO:teuthology.orchestra.run.smithi045.stdout: -4914> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005a8 [2,head] /dc-dir/dc-file_947 auth v5896 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.030010+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655356a1180] 2023-10-03T19:21:10.247 INFO:teuthology.orchestra.run.smithi045.stdout: -4913> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.247 INFO:teuthology.orchestra.run.smithi045.stdout: -4912> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 674.608, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.75e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1352.0] 2023-10-03T19:21:10.247 INFO:teuthology.orchestra.run.smithi045.stdout: -4911> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x56553662bb00 on [dir 0x1 / [2,head] auth pv=6008 v=5904 cv=5384/5384 REP dir_auth=0 ap=52+54 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 52 2023-10-03T19:21:10.247 INFO:teuthology.orchestra.run.smithi045.stdout: -4910> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x56553662bb00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5903 pv6007 ap=53 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=53) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=52) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 53 2023-10-03T19:21:10.247 INFO:teuthology.orchestra.run.smithi045.stdout: -4909> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5904 cv=5384/5384 REP dir_auth=0 ap=52+53 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x56553662bb00 count now 52/53 2023-10-03T19:21:10.247 INFO:teuthology.orchestra.run.smithi045.stdout: -4908> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x56553662bb00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5897 cv=5377/5377 ap=53+53 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=260 | child=1 dirty=1 authpin=1 0x565534f82400] count now 53 2023-10-03T19:21:10.247 INFO:teuthology.orchestra.run.smithi045.stdout: -4907> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005a8) auth_unpin by 0x56553662bb00 on [inode 0x100000005a8 [2,head] /dc-dir/dc-file_947 auth v5896 s=3 n(v0 rc2023-10-03T19:17:10.030010+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655356a1180] now 0 2023-10-03T19:21:10.247 INFO:teuthology.orchestra.run.smithi045.stdout: -4906> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5897 cv=5377/5377 ap=53+52 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=260 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x56553662bb00 count now 53/52 2023-10-03T19:21:10.248 INFO:teuthology.orchestra.run.smithi045.stdout: -4905> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.248 INFO:teuthology.orchestra.run.smithi045.stdout: -4904> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.248 INFO:teuthology.orchestra.run.smithi045.stdout: -4903> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005a9 [2,head] /dc-dir/dc-file_948 auth v4882 pv5898 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.040282+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.040282+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655356a1700] 2023-10-03T19:21:10.248 INFO:teuthology.orchestra.run.smithi045.stdout: -4902> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5905 2023-10-03T19:21:10.248 INFO:teuthology.orchestra.run.smithi045.stdout: -4901> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5905 pv6007 ap=53 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=53) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=52) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.248 INFO:teuthology.orchestra.run.smithi045.stdout: -4900> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5903 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.248 INFO:teuthology.orchestra.run.smithi045.stdout: -4899> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5904 cv=5384/5384 REP dir_auth=0 ap=52+53 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5904 2023-10-03T19:21:10.248 INFO:teuthology.orchestra.run.smithi045.stdout: -4898> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005a9) pop_and_dirty_projected_inode v5898 2023-10-03T19:21:10.248 INFO:teuthology.orchestra.run.smithi045.stdout: -4897> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005a9) mark_dirty [inode 0x100000005a9 [2,head] /dc-dir/dc-file_948 auth v5898 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.040282+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x5655356a1700] 2023-10-03T19:21:10.248 INFO:teuthology.orchestra.run.smithi045.stdout: -4896> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_948) mark_dirty [dentry #0x1/dc-dir/dc-file_948 [2,head] auth (dversion lock) pv=5898 v=4882 ino=0x100000005a9 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535682280] 2023-10-03T19:21:10.249 INFO:teuthology.orchestra.run.smithi045.stdout: -4895> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5897 cv=5377/5377 ap=53+52 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=261 | child=1 dirty=1 authpin=1 0x565534f82400] version 5897 2023-10-03T19:21:10.249 INFO:teuthology.orchestra.run.smithi045.stdout: -4894> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x56553662d100 v5906 2023-10-03T19:21:10.249 INFO:teuthology.orchestra.run.smithi045.stdout: -4893> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5906 cv=5384/5384 REP dir_auth=0 ap=52+53 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5906 2023-10-03T19:21:10.249 INFO:teuthology.orchestra.run.smithi045.stdout: -4892> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x56553662cfe0 v5899 2023-10-03T19:21:10.249 INFO:teuthology.orchestra.run.smithi045.stdout: -4891> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5899 cv=5377/5377 ap=53+52 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=261 | child=1 dirty=1 authpin=1 0x565534f82400] version 5899 2023-10-03T19:21:10.249 INFO:teuthology.orchestra.run.smithi045.stdout: -4890> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=52 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=52 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.249 INFO:teuthology.orchestra.run.smithi045.stdout: -4889> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=52) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5905 pv6007 ap=53 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=53) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=52) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.249 INFO:teuthology.orchestra.run.smithi045.stdout: -4888> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=53) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5905 pv6007 ap=53 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=53) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=51) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.249 INFO:teuthology.orchestra.run.smithi045.stdout: -4887> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005a9 [2,head] /dc-dir/dc-file_948 auth v5898 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.040282+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655356a1700] 2023-10-03T19:21:10.249 INFO:teuthology.orchestra.run.smithi045.stdout: -4886> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005a9 [2,head] /dc-dir/dc-file_948 auth v5898 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.040282+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655356a1700] 2023-10-03T19:21:10.249 INFO:teuthology.orchestra.run.smithi045.stdout: -4885> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.250 INFO:teuthology.orchestra.run.smithi045.stdout: -4884> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.250 INFO:teuthology.orchestra.run.smithi045.stdout: -4883> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.250 INFO:teuthology.orchestra.run.smithi045.stdout: -4882> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005a9 [2,head] /dc-dir/dc-file_948 auth v5898 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.040282+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655356a1700] 2023-10-03T19:21:10.250 INFO:teuthology.orchestra.run.smithi045.stdout: -4881> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005a9 [2,head] /dc-dir/dc-file_948 auth v5898 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.040282+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x5655356a1700] 2023-10-03T19:21:10.250 INFO:teuthology.orchestra.run.smithi045.stdout: -4880> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.250 INFO:teuthology.orchestra.run.smithi045.stdout: -4879> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 675.608, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.76e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1354.0] 2023-10-03T19:21:10.250 INFO:teuthology.orchestra.run.smithi045.stdout: -4878> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535b96000 on [dir 0x1 / [2,head] auth pv=6008 v=5906 cv=5384/5384 REP dir_auth=0 ap=51+53 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 51 2023-10-03T19:21:10.250 INFO:teuthology.orchestra.run.smithi045.stdout: -4877> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535b96000 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5905 pv6007 ap=52 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=52) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=51) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 52 2023-10-03T19:21:10.250 INFO:teuthology.orchestra.run.smithi045.stdout: -4876> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5906 cv=5384/5384 REP dir_auth=0 ap=51+52 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535b96000 count now 51/52 2023-10-03T19:21:10.250 INFO:teuthology.orchestra.run.smithi045.stdout: -4875> 2023-10-03T19:17:19.542+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535b96000 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5899 cv=5377/5377 ap=52+52 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=261 | child=1 dirty=1 authpin=1 0x565534f82400] count now 52 2023-10-03T19:21:10.251 INFO:teuthology.orchestra.run.smithi045.stdout: -4874> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005a9) auth_unpin by 0x565535b96000 on [inode 0x100000005a9 [2,head] /dc-dir/dc-file_948 auth v5898 s=3 n(v0 rc2023-10-03T19:17:10.040282+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655356a1700] now 0 2023-10-03T19:21:10.251 INFO:teuthology.orchestra.run.smithi045.stdout: -4873> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5899 cv=5377/5377 ap=52+51 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=261 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535b96000 count now 52/51 2023-10-03T19:21:10.251 INFO:teuthology.orchestra.run.smithi045.stdout: -4872> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.307 INFO:teuthology.orchestra.run.smithi045.stdout: -4871> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.307 INFO:teuthology.orchestra.run.smithi045.stdout: -4870> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005aa [2,head] /dc-dir/dc-file_949 auth v4886 pv5900 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.051286+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.051286+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535080000] 2023-10-03T19:21:10.307 INFO:teuthology.orchestra.run.smithi045.stdout: -4869> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5907 2023-10-03T19:21:10.307 INFO:teuthology.orchestra.run.smithi045.stdout: -4868> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5907 pv6007 ap=52 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=52) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=51) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.307 INFO:teuthology.orchestra.run.smithi045.stdout: -4867> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5905 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.308 INFO:teuthology.orchestra.run.smithi045.stdout: -4866> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5906 cv=5384/5384 REP dir_auth=0 ap=51+52 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5906 2023-10-03T19:21:10.308 INFO:teuthology.orchestra.run.smithi045.stdout: -4865> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005aa) pop_and_dirty_projected_inode v5900 2023-10-03T19:21:10.308 INFO:teuthology.orchestra.run.smithi045.stdout: -4864> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005aa) mark_dirty [inode 0x100000005aa [2,head] /dc-dir/dc-file_949 auth v5900 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.051286+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535080000] 2023-10-03T19:21:10.308 INFO:teuthology.orchestra.run.smithi045.stdout: -4863> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_949) mark_dirty [dentry #0x1/dc-dir/dc-file_949 [2,head] auth (dversion lock) pv=5900 v=4886 ino=0x100000005aa state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535682500] 2023-10-03T19:21:10.308 INFO:teuthology.orchestra.run.smithi045.stdout: -4862> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5899 cv=5377/5377 ap=52+51 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=262 | child=1 dirty=1 authpin=1 0x565534f82400] version 5899 2023-10-03T19:21:10.308 INFO:teuthology.orchestra.run.smithi045.stdout: -4861> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x56553662d340 v5908 2023-10-03T19:21:10.308 INFO:teuthology.orchestra.run.smithi045.stdout: -4860> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5908 cv=5384/5384 REP dir_auth=0 ap=51+52 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5908 2023-10-03T19:21:10.308 INFO:teuthology.orchestra.run.smithi045.stdout: -4859> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x56553662d220 v5901 2023-10-03T19:21:10.308 INFO:teuthology.orchestra.run.smithi045.stdout: -4858> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5901 cv=5377/5377 ap=52+51 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=262 | child=1 dirty=1 authpin=1 0x565534f82400] version 5901 2023-10-03T19:21:10.308 INFO:teuthology.orchestra.run.smithi045.stdout: -4857> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=51 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=51 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.308 INFO:teuthology.orchestra.run.smithi045.stdout: -4856> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=51) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5907 pv6007 ap=52 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=52) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=51) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.309 INFO:teuthology.orchestra.run.smithi045.stdout: -4855> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=52) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5907 pv6007 ap=52 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=52) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=50) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.309 INFO:teuthology.orchestra.run.smithi045.stdout: -4854> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005aa [2,head] /dc-dir/dc-file_949 auth v5900 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.051286+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535080000] 2023-10-03T19:21:10.309 INFO:teuthology.orchestra.run.smithi045.stdout: -4853> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005aa [2,head] /dc-dir/dc-file_949 auth v5900 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.051286+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535080000] 2023-10-03T19:21:10.309 INFO:teuthology.orchestra.run.smithi045.stdout: -4852> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.309 INFO:teuthology.orchestra.run.smithi045.stdout: -4851> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.309 INFO:teuthology.orchestra.run.smithi045.stdout: -4850> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.309 INFO:teuthology.orchestra.run.smithi045.stdout: -4849> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005aa [2,head] /dc-dir/dc-file_949 auth v5900 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.051286+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535080000] 2023-10-03T19:21:10.309 INFO:teuthology.orchestra.run.smithi045.stdout: -4848> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005aa [2,head] /dc-dir/dc-file_949 auth v5900 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.051286+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535080000] 2023-10-03T19:21:10.309 INFO:teuthology.orchestra.run.smithi045.stdout: -4847> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.309 INFO:teuthology.orchestra.run.smithi045.stdout: -4846> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 676.233, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.76e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1355.3] 2023-10-03T19:21:10.309 INFO:teuthology.orchestra.run.smithi045.stdout: -4845> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535b96480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5907 pv6007 ap=51 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=51) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=50) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 51 2023-10-03T19:21:10.310 INFO:teuthology.orchestra.run.smithi045.stdout: -4844> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5908 cv=5384/5384 REP dir_auth=0 ap=51+51 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535b96480 count now 51/51 2023-10-03T19:21:10.310 INFO:teuthology.orchestra.run.smithi045.stdout: -4843> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535b96480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5901 cv=5377/5377 ap=51+51 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=262 | child=1 dirty=1 authpin=1 0x565534f82400] count now 51 2023-10-03T19:21:10.310 INFO:teuthology.orchestra.run.smithi045.stdout: -4842> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535b96480 on [dir 0x1 / [2,head] auth pv=6008 v=5908 cv=5384/5384 REP dir_auth=0 ap=50+51 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 50 2023-10-03T19:21:10.310 INFO:teuthology.orchestra.run.smithi045.stdout: -4841> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005aa) auth_unpin by 0x565535b96480 on [inode 0x100000005aa [2,head] /dc-dir/dc-file_949 auth v5900 s=3 n(v0 rc2023-10-03T19:17:10.051286+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535080000] now 0 2023-10-03T19:21:10.310 INFO:teuthology.orchestra.run.smithi045.stdout: -4840> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5901 cv=5377/5377 ap=51+50 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=262 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535b96480 count now 51/50 2023-10-03T19:21:10.310 INFO:teuthology.orchestra.run.smithi045.stdout: -4839> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.310 INFO:teuthology.orchestra.run.smithi045.stdout: -4838> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.310 INFO:teuthology.orchestra.run.smithi045.stdout: -4837> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005ab [2,head] /dc-dir/dc-file_950 auth v4890 pv5902 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.062438+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.062438+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535080580] 2023-10-03T19:21:10.310 INFO:teuthology.orchestra.run.smithi045.stdout: -4836> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5909 2023-10-03T19:21:10.310 INFO:teuthology.orchestra.run.smithi045.stdout: -4835> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5909 pv6007 ap=51 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=51) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=50) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.311 INFO:teuthology.orchestra.run.smithi045.stdout: -4834> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5907 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.311 INFO:teuthology.orchestra.run.smithi045.stdout: -4833> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5908 cv=5384/5384 REP dir_auth=0 ap=50+51 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5908 2023-10-03T19:21:10.311 INFO:teuthology.orchestra.run.smithi045.stdout: -4832> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005ab) pop_and_dirty_projected_inode v5902 2023-10-03T19:21:10.311 INFO:teuthology.orchestra.run.smithi045.stdout: -4831> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005ab) mark_dirty [inode 0x100000005ab [2,head] /dc-dir/dc-file_950 auth v5902 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.062438+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535080580] 2023-10-03T19:21:10.311 INFO:teuthology.orchestra.run.smithi045.stdout: -4830> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_950) mark_dirty [dentry #0x1/dc-dir/dc-file_950 [2,head] auth (dversion lock) pv=5902 v=4890 ino=0x100000005ab state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535682780] 2023-10-03T19:21:10.311 INFO:teuthology.orchestra.run.smithi045.stdout: -4829> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5901 cv=5377/5377 ap=51+50 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=263 | child=1 dirty=1 authpin=1 0x565534f82400] version 5901 2023-10-03T19:21:10.311 INFO:teuthology.orchestra.run.smithi045.stdout: -4828> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x56553662d580 v5910 2023-10-03T19:21:10.311 INFO:teuthology.orchestra.run.smithi045.stdout: -4827> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5910 cv=5384/5384 REP dir_auth=0 ap=50+51 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5910 2023-10-03T19:21:10.311 INFO:teuthology.orchestra.run.smithi045.stdout: -4826> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x56553662d460 v5903 2023-10-03T19:21:10.311 INFO:teuthology.orchestra.run.smithi045.stdout: -4825> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5903 cv=5377/5377 ap=51+50 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=263 | child=1 dirty=1 authpin=1 0x565534f82400] version 5903 2023-10-03T19:21:10.311 INFO:teuthology.orchestra.run.smithi045.stdout: -4824> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=50 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=50 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.337 INFO:teuthology.orchestra.run.smithi045.stdout: -4823> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=50) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5909 pv6007 ap=51 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=51) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=50) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.337 INFO:teuthology.orchestra.run.smithi045.stdout: -4822> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=51) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5909 pv6007 ap=51 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=51) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=49) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.337 INFO:teuthology.orchestra.run.smithi045.stdout: -4821> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005ab [2,head] /dc-dir/dc-file_950 auth v5902 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.062438+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535080580] 2023-10-03T19:21:10.337 INFO:teuthology.orchestra.run.smithi045.stdout: -4820> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005ab [2,head] /dc-dir/dc-file_950 auth v5902 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.062438+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535080580] 2023-10-03T19:21:10.337 INFO:teuthology.orchestra.run.smithi045.stdout: -4819> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.337 INFO:teuthology.orchestra.run.smithi045.stdout: -4818> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.337 INFO:teuthology.orchestra.run.smithi045.stdout: -4817> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.337 INFO:teuthology.orchestra.run.smithi045.stdout: -4816> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005ab [2,head] /dc-dir/dc-file_950 auth v5902 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.062438+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535080580] 2023-10-03T19:21:10.338 INFO:teuthology.orchestra.run.smithi045.stdout: -4815> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005ab [2,head] /dc-dir/dc-file_950 auth v5902 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.062438+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535080580] 2023-10-03T19:21:10.338 INFO:teuthology.orchestra.run.smithi045.stdout: -4814> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.338 INFO:teuthology.orchestra.run.smithi045.stdout: -4813> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 677.233, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.77e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1357.3] 2023-10-03T19:21:10.338 INFO:teuthology.orchestra.run.smithi045.stdout: -4812> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535b96900 on [dir 0x1 / [2,head] auth pv=6008 v=5910 cv=5384/5384 REP dir_auth=0 ap=49+51 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 49 2023-10-03T19:21:10.338 INFO:teuthology.orchestra.run.smithi045.stdout: -4811> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535b96900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5909 pv6007 ap=50 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=50) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=49) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 50 2023-10-03T19:21:10.338 INFO:teuthology.orchestra.run.smithi045.stdout: -4810> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5910 cv=5384/5384 REP dir_auth=0 ap=49+50 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535b96900 count now 49/50 2023-10-03T19:21:10.338 INFO:teuthology.orchestra.run.smithi045.stdout: -4809> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535b96900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5903 cv=5377/5377 ap=50+50 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=263 | child=1 dirty=1 authpin=1 0x565534f82400] count now 50 2023-10-03T19:21:10.338 INFO:teuthology.orchestra.run.smithi045.stdout: -4808> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005ab) auth_unpin by 0x565535b96900 on [inode 0x100000005ab [2,head] /dc-dir/dc-file_950 auth v5902 s=3 n(v0 rc2023-10-03T19:17:10.062438+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535080580] now 0 2023-10-03T19:21:10.338 INFO:teuthology.orchestra.run.smithi045.stdout: -4807> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5903 cv=5377/5377 ap=50+49 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=263 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535b96900 count now 50/49 2023-10-03T19:21:10.338 INFO:teuthology.orchestra.run.smithi045.stdout: -4806> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.338 INFO:teuthology.orchestra.run.smithi045.stdout: -4805> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.339 INFO:teuthology.orchestra.run.smithi045.stdout: -4804> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005ac [2,head] /dc-dir/dc-file_951 auth v4894 pv5904 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.074337+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.074337+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535080b00] 2023-10-03T19:21:10.339 INFO:teuthology.orchestra.run.smithi045.stdout: -4803> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5911 2023-10-03T19:21:10.339 INFO:teuthology.orchestra.run.smithi045.stdout: -4802> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5911 pv6007 ap=50 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=50) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=49) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.339 INFO:teuthology.orchestra.run.smithi045.stdout: -4801> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5909 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.339 INFO:teuthology.orchestra.run.smithi045.stdout: -4800> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5910 cv=5384/5384 REP dir_auth=0 ap=49+50 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5910 2023-10-03T19:21:10.339 INFO:teuthology.orchestra.run.smithi045.stdout: -4799> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005ac) pop_and_dirty_projected_inode v5904 2023-10-03T19:21:10.339 INFO:teuthology.orchestra.run.smithi045.stdout: -4798> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005ac) mark_dirty [inode 0x100000005ac [2,head] /dc-dir/dc-file_951 auth v5904 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.074337+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535080b00] 2023-10-03T19:21:10.339 INFO:teuthology.orchestra.run.smithi045.stdout: -4797> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_951) mark_dirty [dentry #0x1/dc-dir/dc-file_951 [2,head] auth (dversion lock) pv=5904 v=4894 ino=0x100000005ac state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535682a00] 2023-10-03T19:21:10.339 INFO:teuthology.orchestra.run.smithi045.stdout: -4796> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5903 cv=5377/5377 ap=50+49 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=264 | child=1 dirty=1 authpin=1 0x565534f82400] version 5903 2023-10-03T19:21:10.339 INFO:teuthology.orchestra.run.smithi045.stdout: -4795> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x56553662d7c0 v5912 2023-10-03T19:21:10.340 INFO:teuthology.orchestra.run.smithi045.stdout: -4794> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5912 cv=5384/5384 REP dir_auth=0 ap=49+50 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5912 2023-10-03T19:21:10.340 INFO:teuthology.orchestra.run.smithi045.stdout: -4793> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x56553662d6a0 v5905 2023-10-03T19:21:10.340 INFO:teuthology.orchestra.run.smithi045.stdout: -4792> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5905 cv=5377/5377 ap=50+49 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=264 | child=1 dirty=1 authpin=1 0x565534f82400] version 5905 2023-10-03T19:21:10.340 INFO:teuthology.orchestra.run.smithi045.stdout: -4791> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=49 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=49 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.340 INFO:teuthology.orchestra.run.smithi045.stdout: -4790> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=49) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5911 pv6007 ap=50 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=50) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=49) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.340 INFO:teuthology.orchestra.run.smithi045.stdout: -4789> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=50) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5911 pv6007 ap=50 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=50) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=48) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.340 INFO:teuthology.orchestra.run.smithi045.stdout: -4788> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005ac [2,head] /dc-dir/dc-file_951 auth v5904 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.074337+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535080b00] 2023-10-03T19:21:10.340 INFO:teuthology.orchestra.run.smithi045.stdout: -4787> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005ac [2,head] /dc-dir/dc-file_951 auth v5904 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.074337+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535080b00] 2023-10-03T19:21:10.340 INFO:teuthology.orchestra.run.smithi045.stdout: -4786> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.340 INFO:teuthology.orchestra.run.smithi045.stdout: -4785> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.340 INFO:teuthology.orchestra.run.smithi045.stdout: -4784> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.341 INFO:teuthology.orchestra.run.smithi045.stdout: -4783> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005ac [2,head] /dc-dir/dc-file_951 auth v5904 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.074337+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535080b00] 2023-10-03T19:21:10.341 INFO:teuthology.orchestra.run.smithi045.stdout: -4782> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005ac [2,head] /dc-dir/dc-file_951 auth v5904 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.074337+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535080b00] 2023-10-03T19:21:10.341 INFO:teuthology.orchestra.run.smithi045.stdout: -4781> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.341 INFO:teuthology.orchestra.run.smithi045.stdout: -4780> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 678.233, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.78e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1359.3] 2023-10-03T19:21:10.341 INFO:teuthology.orchestra.run.smithi045.stdout: -4779> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535b96d80 on [dir 0x1 / [2,head] auth pv=6008 v=5912 cv=5384/5384 REP dir_auth=0 ap=48+50 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 48 2023-10-03T19:21:10.341 INFO:teuthology.orchestra.run.smithi045.stdout: -4778> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535b96d80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5911 pv6007 ap=49 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=49) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=48) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 49 2023-10-03T19:21:10.341 INFO:teuthology.orchestra.run.smithi045.stdout: -4777> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5912 cv=5384/5384 REP dir_auth=0 ap=48+49 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535b96d80 count now 48/49 2023-10-03T19:21:10.341 INFO:teuthology.orchestra.run.smithi045.stdout: -4776> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535b96d80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5905 cv=5377/5377 ap=49+49 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=264 | child=1 dirty=1 authpin=1 0x565534f82400] count now 49 2023-10-03T19:21:10.341 INFO:teuthology.orchestra.run.smithi045.stdout: -4775> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005ac) auth_unpin by 0x565535b96d80 on [inode 0x100000005ac [2,head] /dc-dir/dc-file_951 auth v5904 s=3 n(v0 rc2023-10-03T19:17:10.074337+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535080b00] now 0 2023-10-03T19:21:10.341 INFO:teuthology.orchestra.run.smithi045.stdout: -4774> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5905 cv=5377/5377 ap=49+48 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=264 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535b96d80 count now 49/48 2023-10-03T19:21:10.341 INFO:teuthology.orchestra.run.smithi045.stdout: -4773> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.342 INFO:teuthology.orchestra.run.smithi045.stdout: -4772> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.342 INFO:teuthology.orchestra.run.smithi045.stdout: -4771> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005ad [2,head] /dc-dir/dc-file_952 auth v4898 pv5906 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.085619+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.085619+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535081080] 2023-10-03T19:21:10.342 INFO:teuthology.orchestra.run.smithi045.stdout: -4770> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5913 2023-10-03T19:21:10.342 INFO:teuthology.orchestra.run.smithi045.stdout: -4769> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5913 pv6007 ap=49 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=49) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=48) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.342 INFO:teuthology.orchestra.run.smithi045.stdout: -4768> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5911 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.342 INFO:teuthology.orchestra.run.smithi045.stdout: -4767> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5912 cv=5384/5384 REP dir_auth=0 ap=48+49 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5912 2023-10-03T19:21:10.415 INFO:teuthology.orchestra.run.smithi045.stdout: -4766> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005ad) pop_and_dirty_projected_inode v5906 2023-10-03T19:21:10.416 INFO:teuthology.orchestra.run.smithi045.stdout: -4765> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005ad) mark_dirty [inode 0x100000005ad [2,head] /dc-dir/dc-file_952 auth v5906 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.085619+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535081080] 2023-10-03T19:21:10.416 INFO:teuthology.orchestra.run.smithi045.stdout: -4764> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_952) mark_dirty [dentry #0x1/dc-dir/dc-file_952 [2,head] auth (dversion lock) pv=5906 v=4898 ino=0x100000005ad state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535682c80] 2023-10-03T19:21:10.416 INFO:teuthology.orchestra.run.smithi045.stdout: -4763> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5905 cv=5377/5377 ap=49+48 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=265 | child=1 dirty=1 authpin=1 0x565534f82400] version 5905 2023-10-03T19:21:10.416 INFO:teuthology.orchestra.run.smithi045.stdout: -4762> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x56553662da00 v5914 2023-10-03T19:21:10.416 INFO:teuthology.orchestra.run.smithi045.stdout: -4761> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5914 cv=5384/5384 REP dir_auth=0 ap=48+49 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5914 2023-10-03T19:21:10.416 INFO:teuthology.orchestra.run.smithi045.stdout: -4760> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x56553662d8e0 v5907 2023-10-03T19:21:10.416 INFO:teuthology.orchestra.run.smithi045.stdout: -4759> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5907 cv=5377/5377 ap=49+48 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=265 | child=1 dirty=1 authpin=1 0x565534f82400] version 5907 2023-10-03T19:21:10.416 INFO:teuthology.orchestra.run.smithi045.stdout: -4758> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=48 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=48 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.416 INFO:teuthology.orchestra.run.smithi045.stdout: -4757> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=48) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5913 pv6007 ap=49 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=49) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=48) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.416 INFO:teuthology.orchestra.run.smithi045.stdout: -4756> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=49) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5913 pv6007 ap=49 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=49) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=47) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.417 INFO:teuthology.orchestra.run.smithi045.stdout: -4755> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005ad [2,head] /dc-dir/dc-file_952 auth v5906 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.085619+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535081080] 2023-10-03T19:21:10.417 INFO:teuthology.orchestra.run.smithi045.stdout: -4754> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005ad [2,head] /dc-dir/dc-file_952 auth v5906 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.085619+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535081080] 2023-10-03T19:21:10.417 INFO:teuthology.orchestra.run.smithi045.stdout: -4753> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.417 INFO:teuthology.orchestra.run.smithi045.stdout: -4752> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.417 INFO:teuthology.orchestra.run.smithi045.stdout: -4751> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.417 INFO:teuthology.orchestra.run.smithi045.stdout: -4750> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005ad [2,head] /dc-dir/dc-file_952 auth v5906 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.085619+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535081080] 2023-10-03T19:21:10.417 INFO:teuthology.orchestra.run.smithi045.stdout: -4749> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005ad [2,head] /dc-dir/dc-file_952 auth v5906 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.085619+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535081080] 2023-10-03T19:21:10.417 INFO:teuthology.orchestra.run.smithi045.stdout: -4748> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.417 INFO:teuthology.orchestra.run.smithi045.stdout: -4747> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 679.233, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.79e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1361.3] 2023-10-03T19:21:10.417 INFO:teuthology.orchestra.run.smithi045.stdout: -4746> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535b97200 on [dir 0x1 / [2,head] auth pv=6008 v=5914 cv=5384/5384 REP dir_auth=0 ap=47+49 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 47 2023-10-03T19:21:10.417 INFO:teuthology.orchestra.run.smithi045.stdout: -4745> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535b97200 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5907 cv=5377/5377 ap=48+48 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=265 | child=1 dirty=1 authpin=1 0x565534f82400] count now 48 2023-10-03T19:21:10.418 INFO:teuthology.orchestra.run.smithi045.stdout: -4744> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535b97200 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5913 pv6007 ap=48 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=48) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=47) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 48 2023-10-03T19:21:10.418 INFO:teuthology.orchestra.run.smithi045.stdout: -4743> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5914 cv=5384/5384 REP dir_auth=0 ap=47+48 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535b97200 count now 47/48 2023-10-03T19:21:10.418 INFO:teuthology.orchestra.run.smithi045.stdout: -4742> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005ad) auth_unpin by 0x565535b97200 on [inode 0x100000005ad [2,head] /dc-dir/dc-file_952 auth v5906 s=3 n(v0 rc2023-10-03T19:17:10.085619+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535081080] now 0 2023-10-03T19:21:10.418 INFO:teuthology.orchestra.run.smithi045.stdout: -4741> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5907 cv=5377/5377 ap=48+47 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=265 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535b97200 count now 48/47 2023-10-03T19:21:10.418 INFO:teuthology.orchestra.run.smithi045.stdout: -4740> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.418 INFO:teuthology.orchestra.run.smithi045.stdout: -4739> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.418 INFO:teuthology.orchestra.run.smithi045.stdout: -4738> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005ae [2,head] /dc-dir/dc-file_953 auth v4902 pv5908 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.097449+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.097449+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535081600] 2023-10-03T19:21:10.418 INFO:teuthology.orchestra.run.smithi045.stdout: -4737> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5915 2023-10-03T19:21:10.418 INFO:teuthology.orchestra.run.smithi045.stdout: -4736> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5915 pv6007 ap=48 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=48) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=47) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.419 INFO:teuthology.orchestra.run.smithi045.stdout: -4735> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5913 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.419 INFO:teuthology.orchestra.run.smithi045.stdout: -4734> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5914 cv=5384/5384 REP dir_auth=0 ap=47+48 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5914 2023-10-03T19:21:10.419 INFO:teuthology.orchestra.run.smithi045.stdout: -4733> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005ae) pop_and_dirty_projected_inode v5908 2023-10-03T19:21:10.419 INFO:teuthology.orchestra.run.smithi045.stdout: -4732> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005ae) mark_dirty [inode 0x100000005ae [2,head] /dc-dir/dc-file_953 auth v5908 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.097449+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535081600] 2023-10-03T19:21:10.419 INFO:teuthology.orchestra.run.smithi045.stdout: -4731> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_953) mark_dirty [dentry #0x1/dc-dir/dc-file_953 [2,head] auth (dversion lock) pv=5908 v=4902 ino=0x100000005ae state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535682f00] 2023-10-03T19:21:10.419 INFO:teuthology.orchestra.run.smithi045.stdout: -4730> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5907 cv=5377/5377 ap=48+47 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=266 | child=1 dirty=1 authpin=1 0x565534f82400] version 5907 2023-10-03T19:21:10.419 INFO:teuthology.orchestra.run.smithi045.stdout: -4729> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x56553662dc40 v5916 2023-10-03T19:21:10.419 INFO:teuthology.orchestra.run.smithi045.stdout: -4728> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5916 cv=5384/5384 REP dir_auth=0 ap=47+48 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5916 2023-10-03T19:21:10.419 INFO:teuthology.orchestra.run.smithi045.stdout: -4727> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x56553662db20 v5909 2023-10-03T19:21:10.419 INFO:teuthology.orchestra.run.smithi045.stdout: -4726> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5909 cv=5377/5377 ap=48+47 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=266 | child=1 dirty=1 authpin=1 0x565534f82400] version 5909 2023-10-03T19:21:10.419 INFO:teuthology.orchestra.run.smithi045.stdout: -4725> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=47 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=47 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.420 INFO:teuthology.orchestra.run.smithi045.stdout: -4724> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=47) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5915 pv6007 ap=48 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=48) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=47) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.420 INFO:teuthology.orchestra.run.smithi045.stdout: -4723> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=48) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5915 pv6007 ap=48 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=48) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=46) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.420 INFO:teuthology.orchestra.run.smithi045.stdout: -4722> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005ae [2,head] /dc-dir/dc-file_953 auth v5908 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.097449+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535081600] 2023-10-03T19:21:10.420 INFO:teuthology.orchestra.run.smithi045.stdout: -4721> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005ae [2,head] /dc-dir/dc-file_953 auth v5908 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.097449+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535081600] 2023-10-03T19:21:10.420 INFO:teuthology.orchestra.run.smithi045.stdout: -4720> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.420 INFO:teuthology.orchestra.run.smithi045.stdout: -4719> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.420 INFO:teuthology.orchestra.run.smithi045.stdout: -4718> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.420 INFO:teuthology.orchestra.run.smithi045.stdout: -4717> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005ae [2,head] /dc-dir/dc-file_953 auth v5908 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.097449+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535081600] 2023-10-03T19:21:10.420 INFO:teuthology.orchestra.run.smithi045.stdout: -4716> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005ae [2,head] /dc-dir/dc-file_953 auth v5908 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.097449+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535081600] 2023-10-03T19:21:10.420 INFO:teuthology.orchestra.run.smithi045.stdout: -4715> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.452 INFO:teuthology.orchestra.run.smithi045.stdout: -4714> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 680.233, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.80e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1363.3] 2023-10-03T19:21:10.452 INFO:teuthology.orchestra.run.smithi045.stdout: -4713> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535b97680 on [dir 0x1 / [2,head] auth pv=6008 v=5916 cv=5384/5384 REP dir_auth=0 ap=46+48 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 46 2023-10-03T19:21:10.452 INFO:teuthology.orchestra.run.smithi045.stdout: -4712> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535b97680 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5915 pv6007 ap=47 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=47) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=46) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 47 2023-10-03T19:21:10.452 INFO:teuthology.orchestra.run.smithi045.stdout: -4711> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5916 cv=5384/5384 REP dir_auth=0 ap=46+47 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535b97680 count now 46/47 2023-10-03T19:21:10.452 INFO:teuthology.orchestra.run.smithi045.stdout: -4710> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535b97680 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5909 cv=5377/5377 ap=47+47 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=266 | child=1 dirty=1 authpin=1 0x565534f82400] count now 47 2023-10-03T19:21:10.452 INFO:teuthology.orchestra.run.smithi045.stdout: -4709> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005ae) auth_unpin by 0x565535b97680 on [inode 0x100000005ae [2,head] /dc-dir/dc-file_953 auth v5908 s=3 n(v0 rc2023-10-03T19:17:10.097449+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535081600] now 0 2023-10-03T19:21:10.452 INFO:teuthology.orchestra.run.smithi045.stdout: -4708> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5909 cv=5377/5377 ap=47+46 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=266 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535b97680 count now 47/46 2023-10-03T19:21:10.452 INFO:teuthology.orchestra.run.smithi045.stdout: -4707> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.452 INFO:teuthology.orchestra.run.smithi045.stdout: -4706> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.453 INFO:teuthology.orchestra.run.smithi045.stdout: -4705> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005af [2,head] /dc-dir/dc-file_954 auth v4906 pv5910 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.108208+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.108208+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535081b80] 2023-10-03T19:21:10.453 INFO:teuthology.orchestra.run.smithi045.stdout: -4704> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5917 2023-10-03T19:21:10.453 INFO:teuthology.orchestra.run.smithi045.stdout: -4703> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5917 pv6007 ap=47 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=47) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=46) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.453 INFO:teuthology.orchestra.run.smithi045.stdout: -4702> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5915 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.453 INFO:teuthology.orchestra.run.smithi045.stdout: -4701> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5916 cv=5384/5384 REP dir_auth=0 ap=46+47 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5916 2023-10-03T19:21:10.453 INFO:teuthology.orchestra.run.smithi045.stdout: -4700> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005af) pop_and_dirty_projected_inode v5910 2023-10-03T19:21:10.453 INFO:teuthology.orchestra.run.smithi045.stdout: -4699> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005af) mark_dirty [inode 0x100000005af [2,head] /dc-dir/dc-file_954 auth v5910 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.108208+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535081b80] 2023-10-03T19:21:10.453 INFO:teuthology.orchestra.run.smithi045.stdout: -4698> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_954) mark_dirty [dentry #0x1/dc-dir/dc-file_954 [2,head] auth (dversion lock) pv=5910 v=4906 ino=0x100000005af state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535683180] 2023-10-03T19:21:10.453 INFO:teuthology.orchestra.run.smithi045.stdout: -4697> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5909 cv=5377/5377 ap=47+46 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=267 | child=1 dirty=1 authpin=1 0x565534f82400] version 5909 2023-10-03T19:21:10.453 INFO:teuthology.orchestra.run.smithi045.stdout: -4696> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x56553662de80 v5918 2023-10-03T19:21:10.453 INFO:teuthology.orchestra.run.smithi045.stdout: -4695> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5918 cv=5384/5384 REP dir_auth=0 ap=46+47 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5918 2023-10-03T19:21:10.454 INFO:teuthology.orchestra.run.smithi045.stdout: -4694> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x56553662dd60 v5911 2023-10-03T19:21:10.454 INFO:teuthology.orchestra.run.smithi045.stdout: -4693> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5911 cv=5377/5377 ap=47+46 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=267 | child=1 dirty=1 authpin=1 0x565534f82400] version 5911 2023-10-03T19:21:10.454 INFO:teuthology.orchestra.run.smithi045.stdout: -4692> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=46 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=46 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.454 INFO:teuthology.orchestra.run.smithi045.stdout: -4691> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=46) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5917 pv6007 ap=47 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=47) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=46) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.454 INFO:teuthology.orchestra.run.smithi045.stdout: -4690> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=47) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5917 pv6007 ap=47 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=47) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=45) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.454 INFO:teuthology.orchestra.run.smithi045.stdout: -4689> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005af [2,head] /dc-dir/dc-file_954 auth v5910 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.108208+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535081b80] 2023-10-03T19:21:10.454 INFO:teuthology.orchestra.run.smithi045.stdout: -4688> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005af [2,head] /dc-dir/dc-file_954 auth v5910 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.108208+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535081b80] 2023-10-03T19:21:10.454 INFO:teuthology.orchestra.run.smithi045.stdout: -4687> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.454 INFO:teuthology.orchestra.run.smithi045.stdout: -4686> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.454 INFO:teuthology.orchestra.run.smithi045.stdout: -4685> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.455 INFO:teuthology.orchestra.run.smithi045.stdout: -4684> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005af [2,head] /dc-dir/dc-file_954 auth v5910 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.108208+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535081b80] 2023-10-03T19:21:10.455 INFO:teuthology.orchestra.run.smithi045.stdout: -4683> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005af [2,head] /dc-dir/dc-file_954 auth v5910 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.108208+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535081b80] 2023-10-03T19:21:10.455 INFO:teuthology.orchestra.run.smithi045.stdout: -4682> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.455 INFO:teuthology.orchestra.run.smithi045.stdout: -4681> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 681.233, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.81e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1365.3] 2023-10-03T19:21:10.455 INFO:teuthology.orchestra.run.smithi045.stdout: -4680> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535b97b00 on [dir 0x1 / [2,head] auth pv=6008 v=5918 cv=5384/5384 REP dir_auth=0 ap=45+47 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 45 2023-10-03T19:21:10.455 INFO:teuthology.orchestra.run.smithi045.stdout: -4679> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535b97b00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5917 pv6007 ap=46 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=46) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=45) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 46 2023-10-03T19:21:10.455 INFO:teuthology.orchestra.run.smithi045.stdout: -4678> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5918 cv=5384/5384 REP dir_auth=0 ap=45+46 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535b97b00 count now 45/46 2023-10-03T19:21:10.455 INFO:teuthology.orchestra.run.smithi045.stdout: -4677> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535b97b00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5911 cv=5377/5377 ap=46+46 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=267 | child=1 dirty=1 authpin=1 0x565534f82400] count now 46 2023-10-03T19:21:10.455 INFO:teuthology.orchestra.run.smithi045.stdout: -4676> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005af) auth_unpin by 0x565535b97b00 on [inode 0x100000005af [2,head] /dc-dir/dc-file_954 auth v5910 s=3 n(v0 rc2023-10-03T19:17:10.108208+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535081b80] now 0 2023-10-03T19:21:10.455 INFO:teuthology.orchestra.run.smithi045.stdout: -4675> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5911 cv=5377/5377 ap=46+45 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=267 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535b97b00 count now 46/45 2023-10-03T19:21:10.455 INFO:teuthology.orchestra.run.smithi045.stdout: -4674> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.456 INFO:teuthology.orchestra.run.smithi045.stdout: -4673> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.456 INFO:teuthology.orchestra.run.smithi045.stdout: -4672> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005b0 [2,head] /dc-dir/dc-file_955 auth v4910 pv5912 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.119263+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.119263+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535082100] 2023-10-03T19:21:10.456 INFO:teuthology.orchestra.run.smithi045.stdout: -4671> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5919 2023-10-03T19:21:10.456 INFO:teuthology.orchestra.run.smithi045.stdout: -4670> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5919 pv6007 ap=46 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=46) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=45) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.456 INFO:teuthology.orchestra.run.smithi045.stdout: -4669> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5917 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.456 INFO:teuthology.orchestra.run.smithi045.stdout: -4668> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5918 cv=5384/5384 REP dir_auth=0 ap=45+46 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5918 2023-10-03T19:21:10.456 INFO:teuthology.orchestra.run.smithi045.stdout: -4667> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005b0) pop_and_dirty_projected_inode v5912 2023-10-03T19:21:10.456 INFO:teuthology.orchestra.run.smithi045.stdout: -4666> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005b0) mark_dirty [inode 0x100000005b0 [2,head] /dc-dir/dc-file_955 auth v5912 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.119263+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535082100] 2023-10-03T19:21:10.456 INFO:teuthology.orchestra.run.smithi045.stdout: -4665> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_955) mark_dirty [dentry #0x1/dc-dir/dc-file_955 [2,head] auth (dversion lock) pv=5912 v=4910 ino=0x100000005b0 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535683400] 2023-10-03T19:21:10.456 INFO:teuthology.orchestra.run.smithi045.stdout: -4664> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5911 cv=5377/5377 ap=46+45 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=268 | child=1 dirty=1 authpin=1 0x565534f82400] version 5911 2023-10-03T19:21:10.457 INFO:teuthology.orchestra.run.smithi045.stdout: -4663> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536710140 v5920 2023-10-03T19:21:10.457 INFO:teuthology.orchestra.run.smithi045.stdout: -4662> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5920 cv=5384/5384 REP dir_auth=0 ap=45+46 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5920 2023-10-03T19:21:10.457 INFO:teuthology.orchestra.run.smithi045.stdout: -4661> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536710020 v5913 2023-10-03T19:21:10.457 INFO:teuthology.orchestra.run.smithi045.stdout: -4660> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5913 cv=5377/5377 ap=46+45 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=268 | child=1 dirty=1 authpin=1 0x565534f82400] version 5913 2023-10-03T19:21:10.457 INFO:teuthology.orchestra.run.smithi045.stdout: -4659> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=45 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=45 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.457 INFO:teuthology.orchestra.run.smithi045.stdout: -4658> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=45) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5919 pv6007 ap=46 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=46) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=45) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.500 INFO:teuthology.orchestra.run.smithi045.stdout: -4657> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=46) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5919 pv6007 ap=46 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=46) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=44) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.500 INFO:teuthology.orchestra.run.smithi045.stdout: -4656> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005b0 [2,head] /dc-dir/dc-file_955 auth v5912 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.119263+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535082100] 2023-10-03T19:21:10.500 INFO:teuthology.orchestra.run.smithi045.stdout: -4655> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005b0 [2,head] /dc-dir/dc-file_955 auth v5912 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.119263+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535082100] 2023-10-03T19:21:10.500 INFO:teuthology.orchestra.run.smithi045.stdout: -4654> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.500 INFO:teuthology.orchestra.run.smithi045.stdout: -4653> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.501 INFO:teuthology.orchestra.run.smithi045.stdout: -4652> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.501 INFO:teuthology.orchestra.run.smithi045.stdout: -4651> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005b0 [2,head] /dc-dir/dc-file_955 auth v5912 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.119263+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535082100] 2023-10-03T19:21:10.501 INFO:teuthology.orchestra.run.smithi045.stdout: -4650> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005b0 [2,head] /dc-dir/dc-file_955 auth v5912 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.119263+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535082100] 2023-10-03T19:21:10.501 INFO:teuthology.orchestra.run.smithi045.stdout: -4649> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.501 INFO:teuthology.orchestra.run.smithi045.stdout: -4648> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 682.233, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.82e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1367.3] 2023-10-03T19:21:10.501 INFO:teuthology.orchestra.run.smithi045.stdout: -4647> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535b96240 on [dir 0x1 / [2,head] auth pv=6008 v=5920 cv=5384/5384 REP dir_auth=0 ap=44+46 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 44 2023-10-03T19:21:10.501 INFO:teuthology.orchestra.run.smithi045.stdout: -4646> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535b96240 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5919 pv6007 ap=45 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=45) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=44) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 45 2023-10-03T19:21:10.501 INFO:teuthology.orchestra.run.smithi045.stdout: -4645> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5920 cv=5384/5384 REP dir_auth=0 ap=44+45 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535b96240 count now 44/45 2023-10-03T19:21:10.501 INFO:teuthology.orchestra.run.smithi045.stdout: -4644> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535b96240 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5913 cv=5377/5377 ap=45+45 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=268 | child=1 dirty=1 authpin=1 0x565534f82400] count now 45 2023-10-03T19:21:10.501 INFO:teuthology.orchestra.run.smithi045.stdout: -4643> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005b0) auth_unpin by 0x565535b96240 on [inode 0x100000005b0 [2,head] /dc-dir/dc-file_955 auth v5912 s=3 n(v0 rc2023-10-03T19:17:10.119263+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535082100] now 0 2023-10-03T19:21:10.502 INFO:teuthology.orchestra.run.smithi045.stdout: -4642> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5913 cv=5377/5377 ap=45+44 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=268 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535b96240 count now 45/44 2023-10-03T19:21:10.502 INFO:teuthology.orchestra.run.smithi045.stdout: -4641> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.502 INFO:teuthology.orchestra.run.smithi045.stdout: -4640> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.502 INFO:teuthology.orchestra.run.smithi045.stdout: -4639> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005b1 [2,head] /dc-dir/dc-file_956 auth v4914 pv5914 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.129972+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.129972+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535082680] 2023-10-03T19:21:10.502 INFO:teuthology.orchestra.run.smithi045.stdout: -4638> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5921 2023-10-03T19:21:10.502 INFO:teuthology.orchestra.run.smithi045.stdout: -4637> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5921 pv6007 ap=45 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=45) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=44) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.502 INFO:teuthology.orchestra.run.smithi045.stdout: -4636> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5919 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.502 INFO:teuthology.orchestra.run.smithi045.stdout: -4635> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5920 cv=5384/5384 REP dir_auth=0 ap=44+45 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5920 2023-10-03T19:21:10.502 INFO:teuthology.orchestra.run.smithi045.stdout: -4634> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005b1) pop_and_dirty_projected_inode v5914 2023-10-03T19:21:10.502 INFO:teuthology.orchestra.run.smithi045.stdout: -4633> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005b1) mark_dirty [inode 0x100000005b1 [2,head] /dc-dir/dc-file_956 auth v5914 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.129972+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535082680] 2023-10-03T19:21:10.502 INFO:teuthology.orchestra.run.smithi045.stdout: -4632> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_956) mark_dirty [dentry #0x1/dc-dir/dc-file_956 [2,head] auth (dversion lock) pv=5914 v=4914 ino=0x100000005b1 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535683680] 2023-10-03T19:21:10.503 INFO:teuthology.orchestra.run.smithi045.stdout: -4631> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5913 cv=5377/5377 ap=45+44 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=269 | child=1 dirty=1 authpin=1 0x565534f82400] version 5913 2023-10-03T19:21:10.503 INFO:teuthology.orchestra.run.smithi045.stdout: -4630> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536710380 v5922 2023-10-03T19:21:10.503 INFO:teuthology.orchestra.run.smithi045.stdout: -4629> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5922 cv=5384/5384 REP dir_auth=0 ap=44+45 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5922 2023-10-03T19:21:10.503 INFO:teuthology.orchestra.run.smithi045.stdout: -4628> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536710260 v5915 2023-10-03T19:21:10.503 INFO:teuthology.orchestra.run.smithi045.stdout: -4627> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5915 cv=5377/5377 ap=45+44 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=269 | child=1 dirty=1 authpin=1 0x565534f82400] version 5915 2023-10-03T19:21:10.503 INFO:teuthology.orchestra.run.smithi045.stdout: -4626> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=44 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=44 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.503 INFO:teuthology.orchestra.run.smithi045.stdout: -4625> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=44) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5921 pv6007 ap=45 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=45) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=44) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.503 INFO:teuthology.orchestra.run.smithi045.stdout: -4624> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=45) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5921 pv6007 ap=45 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=45) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=43) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.503 INFO:teuthology.orchestra.run.smithi045.stdout: -4623> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005b1 [2,head] /dc-dir/dc-file_956 auth v5914 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.129972+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535082680] 2023-10-03T19:21:10.503 INFO:teuthology.orchestra.run.smithi045.stdout: -4622> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005b1 [2,head] /dc-dir/dc-file_956 auth v5914 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.129972+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535082680] 2023-10-03T19:21:10.504 INFO:teuthology.orchestra.run.smithi045.stdout: -4621> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.504 INFO:teuthology.orchestra.run.smithi045.stdout: -4620> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.504 INFO:teuthology.orchestra.run.smithi045.stdout: -4619> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.504 INFO:teuthology.orchestra.run.smithi045.stdout: -4618> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005b1 [2,head] /dc-dir/dc-file_956 auth v5914 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.129972+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535082680] 2023-10-03T19:21:10.504 INFO:teuthology.orchestra.run.smithi045.stdout: -4617> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005b1 [2,head] /dc-dir/dc-file_956 auth v5914 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.129972+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535082680] 2023-10-03T19:21:10.504 INFO:teuthology.orchestra.run.smithi045.stdout: -4616> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.504 INFO:teuthology.orchestra.run.smithi045.stdout: -4615> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 683.233, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.83e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1369.3] 2023-10-03T19:21:10.504 INFO:teuthology.orchestra.run.smithi045.stdout: -4614> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x56553662b8c0 on [dir 0x1 / [2,head] auth pv=6008 v=5922 cv=5384/5384 REP dir_auth=0 ap=43+45 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 43 2023-10-03T19:21:10.504 INFO:teuthology.orchestra.run.smithi045.stdout: -4613> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x56553662b8c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5921 pv6007 ap=44 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=44) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=43) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 44 2023-10-03T19:21:10.504 INFO:teuthology.orchestra.run.smithi045.stdout: -4612> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5922 cv=5384/5384 REP dir_auth=0 ap=43+44 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x56553662b8c0 count now 43/44 2023-10-03T19:21:10.504 INFO:teuthology.orchestra.run.smithi045.stdout: -4611> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x56553662b8c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5915 cv=5377/5377 ap=44+44 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=269 | child=1 dirty=1 authpin=1 0x565534f82400] count now 44 2023-10-03T19:21:10.505 INFO:teuthology.orchestra.run.smithi045.stdout: -4610> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005b1) auth_unpin by 0x56553662b8c0 on [inode 0x100000005b1 [2,head] /dc-dir/dc-file_956 auth v5914 s=3 n(v0 rc2023-10-03T19:17:10.129972+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535082680] now 0 2023-10-03T19:21:10.505 INFO:teuthology.orchestra.run.smithi045.stdout: -4609> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5915 cv=5377/5377 ap=44+43 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=269 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x56553662b8c0 count now 44/43 2023-10-03T19:21:10.505 INFO:teuthology.orchestra.run.smithi045.stdout: -4608> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.505 INFO:teuthology.orchestra.run.smithi045.stdout: -4607> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.505 INFO:teuthology.orchestra.run.smithi045.stdout: -4606> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005b2 [2,head] /dc-dir/dc-file_957 auth v4918 pv5916 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.140345+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.140345+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535082c00] 2023-10-03T19:21:10.505 INFO:teuthology.orchestra.run.smithi045.stdout: -4605> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5923 2023-10-03T19:21:10.505 INFO:teuthology.orchestra.run.smithi045.stdout: -4604> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5923 pv6007 ap=44 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=44) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=43) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.563 INFO:teuthology.orchestra.run.smithi045.stdout: -4603> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5921 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.563 INFO:teuthology.orchestra.run.smithi045.stdout: -4602> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5922 cv=5384/5384 REP dir_auth=0 ap=43+44 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5922 2023-10-03T19:21:10.563 INFO:teuthology.orchestra.run.smithi045.stdout: -4601> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005b2) pop_and_dirty_projected_inode v5916 2023-10-03T19:21:10.563 INFO:teuthology.orchestra.run.smithi045.stdout: -4600> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005b2) mark_dirty [inode 0x100000005b2 [2,head] /dc-dir/dc-file_957 auth v5916 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.140345+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535082c00] 2023-10-03T19:21:10.563 INFO:teuthology.orchestra.run.smithi045.stdout: -4599> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_957) mark_dirty [dentry #0x1/dc-dir/dc-file_957 [2,head] auth (dversion lock) pv=5916 v=4918 ino=0x100000005b2 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535683900] 2023-10-03T19:21:10.581 INFO:teuthology.orchestra.run.smithi045.stdout: -4598> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5915 cv=5377/5377 ap=44+43 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=270 | child=1 dirty=1 authpin=1 0x565534f82400] version 5915 2023-10-03T19:21:10.589 INFO:teuthology.orchestra.run.smithi045.stdout: -4597> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x5655367105c0 v5924 2023-10-03T19:21:10.589 INFO:teuthology.orchestra.run.smithi045.stdout: -4596> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5924 cv=5384/5384 REP dir_auth=0 ap=43+44 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5924 2023-10-03T19:21:10.589 INFO:teuthology.orchestra.run.smithi045.stdout: -4595> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655367104a0 v5917 2023-10-03T19:21:10.589 INFO:teuthology.orchestra.run.smithi045.stdout: -4594> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5917 cv=5377/5377 ap=44+43 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=270 | child=1 dirty=1 authpin=1 0x565534f82400] version 5917 2023-10-03T19:21:10.589 INFO:teuthology.orchestra.run.smithi045.stdout: -4593> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=43 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=43 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.590 INFO:teuthology.orchestra.run.smithi045.stdout: -4592> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=43) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5923 pv6007 ap=44 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=44) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=43) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.590 INFO:teuthology.orchestra.run.smithi045.stdout: -4591> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=44) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5923 pv6007 ap=44 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=44) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=42) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.590 INFO:teuthology.orchestra.run.smithi045.stdout: -4590> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005b2 [2,head] /dc-dir/dc-file_957 auth v5916 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.140345+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535082c00] 2023-10-03T19:21:10.590 INFO:teuthology.orchestra.run.smithi045.stdout: -4589> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005b2 [2,head] /dc-dir/dc-file_957 auth v5916 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.140345+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535082c00] 2023-10-03T19:21:10.590 INFO:teuthology.orchestra.run.smithi045.stdout: -4588> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.590 INFO:teuthology.orchestra.run.smithi045.stdout: -4587> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.590 INFO:teuthology.orchestra.run.smithi045.stdout: -4586> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.590 INFO:teuthology.orchestra.run.smithi045.stdout: -4585> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005b2 [2,head] /dc-dir/dc-file_957 auth v5916 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.140345+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535082c00] 2023-10-03T19:21:10.590 INFO:teuthology.orchestra.run.smithi045.stdout: -4584> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005b2 [2,head] /dc-dir/dc-file_957 auth v5916 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.140345+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535082c00] 2023-10-03T19:21:10.590 INFO:teuthology.orchestra.run.smithi045.stdout: -4583> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.591 INFO:teuthology.orchestra.run.smithi045.stdout: -4582> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 684.233, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.84e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1371.3] 2023-10-03T19:21:10.591 INFO:teuthology.orchestra.run.smithi045.stdout: -4581> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x56553662afc0 on [dir 0x1 / [2,head] auth pv=6008 v=5924 cv=5384/5384 REP dir_auth=0 ap=42+44 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 42 2023-10-03T19:21:10.591 INFO:teuthology.orchestra.run.smithi045.stdout: -4580> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x56553662afc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5923 pv6007 ap=43 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=43) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=42) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 43 2023-10-03T19:21:10.591 INFO:teuthology.orchestra.run.smithi045.stdout: -4579> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5924 cv=5384/5384 REP dir_auth=0 ap=42+43 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x56553662afc0 count now 42/43 2023-10-03T19:21:10.591 INFO:teuthology.orchestra.run.smithi045.stdout: -4578> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x56553662afc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5917 cv=5377/5377 ap=43+43 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=270 | child=1 dirty=1 authpin=1 0x565534f82400] count now 43 2023-10-03T19:21:10.591 INFO:teuthology.orchestra.run.smithi045.stdout: -4577> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005b2) auth_unpin by 0x56553662afc0 on [inode 0x100000005b2 [2,head] /dc-dir/dc-file_957 auth v5916 s=3 n(v0 rc2023-10-03T19:17:10.140345+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535082c00] now 0 2023-10-03T19:21:10.591 INFO:teuthology.orchestra.run.smithi045.stdout: -4576> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5917 cv=5377/5377 ap=43+42 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=270 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x56553662afc0 count now 43/42 2023-10-03T19:21:10.591 INFO:teuthology.orchestra.run.smithi045.stdout: -4575> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.591 INFO:teuthology.orchestra.run.smithi045.stdout: -4574> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.592 INFO:teuthology.orchestra.run.smithi045.stdout: -4573> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005b3 [2,head] /dc-dir/dc-file_958 auth v4922 pv5918 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.150505+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.150505+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535083180] 2023-10-03T19:21:10.592 INFO:teuthology.orchestra.run.smithi045.stdout: -4572> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5925 2023-10-03T19:21:10.592 INFO:teuthology.orchestra.run.smithi045.stdout: -4571> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5925 pv6007 ap=43 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=43) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=42) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.592 INFO:teuthology.orchestra.run.smithi045.stdout: -4570> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5923 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.592 INFO:teuthology.orchestra.run.smithi045.stdout: -4569> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5924 cv=5384/5384 REP dir_auth=0 ap=42+43 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5924 2023-10-03T19:21:10.592 INFO:teuthology.orchestra.run.smithi045.stdout: -4568> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005b3) pop_and_dirty_projected_inode v5918 2023-10-03T19:21:10.592 INFO:teuthology.orchestra.run.smithi045.stdout: -4567> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005b3) mark_dirty [inode 0x100000005b3 [2,head] /dc-dir/dc-file_958 auth v5918 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.150505+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535083180] 2023-10-03T19:21:10.592 INFO:teuthology.orchestra.run.smithi045.stdout: -4566> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_958) mark_dirty [dentry #0x1/dc-dir/dc-file_958 [2,head] auth (dversion lock) pv=5918 v=4922 ino=0x100000005b3 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535683b80] 2023-10-03T19:21:10.592 INFO:teuthology.orchestra.run.smithi045.stdout: -4565> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5917 cv=5377/5377 ap=43+42 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=271 | child=1 dirty=1 authpin=1 0x565534f82400] version 5917 2023-10-03T19:21:10.592 INFO:teuthology.orchestra.run.smithi045.stdout: -4564> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536710800 v5926 2023-10-03T19:21:10.592 INFO:teuthology.orchestra.run.smithi045.stdout: -4563> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5926 cv=5384/5384 REP dir_auth=0 ap=42+43 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5926 2023-10-03T19:21:10.593 INFO:teuthology.orchestra.run.smithi045.stdout: -4562> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655367106e0 v5919 2023-10-03T19:21:10.593 INFO:teuthology.orchestra.run.smithi045.stdout: -4561> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5919 cv=5377/5377 ap=43+42 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=271 | child=1 dirty=1 authpin=1 0x565534f82400] version 5919 2023-10-03T19:21:10.593 INFO:teuthology.orchestra.run.smithi045.stdout: -4560> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=42 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=42 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.593 INFO:teuthology.orchestra.run.smithi045.stdout: -4559> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=42) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5925 pv6007 ap=43 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=43) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=42) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.593 INFO:teuthology.orchestra.run.smithi045.stdout: -4558> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=43) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5925 pv6007 ap=43 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=43) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=41) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.593 INFO:teuthology.orchestra.run.smithi045.stdout: -4557> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005b3 [2,head] /dc-dir/dc-file_958 auth v5918 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.150505+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535083180] 2023-10-03T19:21:10.593 INFO:teuthology.orchestra.run.smithi045.stdout: -4556> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005b3 [2,head] /dc-dir/dc-file_958 auth v5918 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.150505+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535083180] 2023-10-03T19:21:10.593 INFO:teuthology.orchestra.run.smithi045.stdout: -4555> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.593 INFO:teuthology.orchestra.run.smithi045.stdout: -4554> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.593 INFO:teuthology.orchestra.run.smithi045.stdout: -4553> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.594 INFO:teuthology.orchestra.run.smithi045.stdout: -4552> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005b3 [2,head] /dc-dir/dc-file_958 auth v5918 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.150505+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535083180] 2023-10-03T19:21:10.594 INFO:teuthology.orchestra.run.smithi045.stdout: -4551> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005b3 [2,head] /dc-dir/dc-file_958 auth v5918 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.150505+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535083180] 2023-10-03T19:21:10.594 INFO:teuthology.orchestra.run.smithi045.stdout: -4550> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.594 INFO:teuthology.orchestra.run.smithi045.stdout: -4549> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 685.233, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.85e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1373.3] 2023-10-03T19:21:10.594 INFO:teuthology.orchestra.run.smithi045.stdout: -4548> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x56553662a6c0 on [dir 0x1 / [2,head] auth pv=6008 v=5926 cv=5384/5384 REP dir_auth=0 ap=41+43 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 41 2023-10-03T19:21:10.594 INFO:teuthology.orchestra.run.smithi045.stdout: -4547> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x56553662a6c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5925 pv6007 ap=42 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=42) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=41) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 42 2023-10-03T19:21:10.594 INFO:teuthology.orchestra.run.smithi045.stdout: -4546> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5926 cv=5384/5384 REP dir_auth=0 ap=41+42 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x56553662a6c0 count now 41/42 2023-10-03T19:21:10.594 INFO:teuthology.orchestra.run.smithi045.stdout: -4545> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x56553662a6c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5919 cv=5377/5377 ap=42+42 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=271 | child=1 dirty=1 authpin=1 0x565534f82400] count now 42 2023-10-03T19:21:10.594 INFO:teuthology.orchestra.run.smithi045.stdout: -4544> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005b3) auth_unpin by 0x56553662a6c0 on [inode 0x100000005b3 [2,head] /dc-dir/dc-file_958 auth v5918 s=3 n(v0 rc2023-10-03T19:17:10.150505+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535083180] now 0 2023-10-03T19:21:10.595 INFO:teuthology.orchestra.run.smithi045.stdout: -4543> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5919 cv=5377/5377 ap=42+41 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=271 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x56553662a6c0 count now 42/41 2023-10-03T19:21:10.595 INFO:teuthology.orchestra.run.smithi045.stdout: -4542> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.595 INFO:teuthology.orchestra.run.smithi045.stdout: -4541> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.595 INFO:teuthology.orchestra.run.smithi045.stdout: -4540> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005b4 [2,head] /dc-dir/dc-file_959 auth v4926 pv5920 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.163529+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.163529+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535083700] 2023-10-03T19:21:10.595 INFO:teuthology.orchestra.run.smithi045.stdout: -4539> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5927 2023-10-03T19:21:10.595 INFO:teuthology.orchestra.run.smithi045.stdout: -4538> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5927 pv6007 ap=42 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=42) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=41) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.595 INFO:teuthology.orchestra.run.smithi045.stdout: -4537> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5925 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.595 INFO:teuthology.orchestra.run.smithi045.stdout: -4536> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5926 cv=5384/5384 REP dir_auth=0 ap=41+42 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5926 2023-10-03T19:21:10.595 INFO:teuthology.orchestra.run.smithi045.stdout: -4535> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005b4) pop_and_dirty_projected_inode v5920 2023-10-03T19:21:10.916 INFO:teuthology.orchestra.run.smithi045.stdout: -4534> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005b4) mark_dirty [inode 0x100000005b4 [2,head] /dc-dir/dc-file_959 auth v5920 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.163529+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535083700] 2023-10-03T19:21:10.916 INFO:teuthology.orchestra.run.smithi045.stdout: -4533> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_959) mark_dirty [dentry #0x1/dc-dir/dc-file_959 [2,head] auth (dversion lock) pv=5920 v=4926 ino=0x100000005b4 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535050000] 2023-10-03T19:21:10.916 INFO:teuthology.orchestra.run.smithi045.stdout: -4532> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5919 cv=5377/5377 ap=42+41 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=272 | child=1 dirty=1 authpin=1 0x565534f82400] version 5919 2023-10-03T19:21:10.916 INFO:teuthology.orchestra.run.smithi045.stdout: -4531> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536710a40 v5928 2023-10-03T19:21:10.917 INFO:teuthology.orchestra.run.smithi045.stdout: -4530> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5928 cv=5384/5384 REP dir_auth=0 ap=41+42 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5928 2023-10-03T19:21:10.917 INFO:teuthology.orchestra.run.smithi045.stdout: -4529> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536710920 v5921 2023-10-03T19:21:10.917 INFO:teuthology.orchestra.run.smithi045.stdout: -4528> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5921 cv=5377/5377 ap=42+41 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=272 | child=1 dirty=1 authpin=1 0x565534f82400] version 5921 2023-10-03T19:21:10.917 INFO:teuthology.orchestra.run.smithi045.stdout: -4527> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=41 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=41 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.917 INFO:teuthology.orchestra.run.smithi045.stdout: -4526> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=41) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5927 pv6007 ap=42 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=42) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=41) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.917 INFO:teuthology.orchestra.run.smithi045.stdout: -4525> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=42) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5927 pv6007 ap=42 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=42) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=40) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.917 INFO:teuthology.orchestra.run.smithi045.stdout: -4524> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005b4 [2,head] /dc-dir/dc-file_959 auth v5920 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.163529+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535083700] 2023-10-03T19:21:10.918 INFO:teuthology.orchestra.run.smithi045.stdout: -4523> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005b4 [2,head] /dc-dir/dc-file_959 auth v5920 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.163529+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535083700] 2023-10-03T19:21:10.918 INFO:teuthology.orchestra.run.smithi045.stdout: -4522> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.918 INFO:teuthology.orchestra.run.smithi045.stdout: -4521> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.918 INFO:teuthology.orchestra.run.smithi045.stdout: -4520> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.918 INFO:teuthology.orchestra.run.smithi045.stdout: -4519> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005b4 [2,head] /dc-dir/dc-file_959 auth v5920 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.163529+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535083700] 2023-10-03T19:21:10.918 INFO:teuthology.orchestra.run.smithi045.stdout: -4518> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005b4 [2,head] /dc-dir/dc-file_959 auth v5920 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.163529+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535083700] 2023-10-03T19:21:10.918 INFO:teuthology.orchestra.run.smithi045.stdout: -4517> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.918 INFO:teuthology.orchestra.run.smithi045.stdout: -4516> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 686.233, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.86e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1375.3] 2023-10-03T19:21:10.918 INFO:teuthology.orchestra.run.smithi045.stdout: -4515> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536429d40 on [dir 0x1 / [2,head] auth pv=6008 v=5928 cv=5384/5384 REP dir_auth=0 ap=40+42 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 40 2023-10-03T19:21:10.918 INFO:teuthology.orchestra.run.smithi045.stdout: -4514> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536429d40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5927 pv6007 ap=41 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=41) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=40) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 41 2023-10-03T19:21:10.919 INFO:teuthology.orchestra.run.smithi045.stdout: -4513> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5928 cv=5384/5384 REP dir_auth=0 ap=40+41 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536429d40 count now 40/41 2023-10-03T19:21:10.919 INFO:teuthology.orchestra.run.smithi045.stdout: -4512> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536429d40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5921 cv=5377/5377 ap=41+41 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=272 | child=1 dirty=1 authpin=1 0x565534f82400] count now 41 2023-10-03T19:21:10.919 INFO:teuthology.orchestra.run.smithi045.stdout: -4511> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005b4) auth_unpin by 0x565536429d40 on [inode 0x100000005b4 [2,head] /dc-dir/dc-file_959 auth v5920 s=3 n(v0 rc2023-10-03T19:17:10.163529+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535083700] now 0 2023-10-03T19:21:10.919 INFO:teuthology.orchestra.run.smithi045.stdout: -4510> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5921 cv=5377/5377 ap=41+40 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=272 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536429d40 count now 41/40 2023-10-03T19:21:10.919 INFO:teuthology.orchestra.run.smithi045.stdout: -4509> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.919 INFO:teuthology.orchestra.run.smithi045.stdout: -4508> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.919 INFO:teuthology.orchestra.run.smithi045.stdout: -4507> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005b5 [2,head] /dc-dir/dc-file_960 auth v4930 pv5922 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.176390+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.176390+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535052000] 2023-10-03T19:21:10.920 INFO:teuthology.orchestra.run.smithi045.stdout: -4506> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5929 2023-10-03T19:21:10.920 INFO:teuthology.orchestra.run.smithi045.stdout: -4505> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5929 pv6007 ap=41 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=41) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=40) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.920 INFO:teuthology.orchestra.run.smithi045.stdout: -4504> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5927 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.920 INFO:teuthology.orchestra.run.smithi045.stdout: -4503> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5928 cv=5384/5384 REP dir_auth=0 ap=40+41 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5928 2023-10-03T19:21:10.920 INFO:teuthology.orchestra.run.smithi045.stdout: -4502> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005b5) pop_and_dirty_projected_inode v5922 2023-10-03T19:21:10.920 INFO:teuthology.orchestra.run.smithi045.stdout: -4501> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005b5) mark_dirty [inode 0x100000005b5 [2,head] /dc-dir/dc-file_960 auth v5922 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.176390+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535052000] 2023-10-03T19:21:10.920 INFO:teuthology.orchestra.run.smithi045.stdout: -4500> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_960) mark_dirty [dentry #0x1/dc-dir/dc-file_960 [2,head] auth (dversion lock) pv=5922 v=4930 ino=0x100000005b5 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535050280] 2023-10-03T19:21:10.920 INFO:teuthology.orchestra.run.smithi045.stdout: -4499> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5921 cv=5377/5377 ap=41+40 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=273 | child=1 dirty=1 authpin=1 0x565534f82400] version 5921 2023-10-03T19:21:10.920 INFO:teuthology.orchestra.run.smithi045.stdout: -4498> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536710c80 v5930 2023-10-03T19:21:10.920 INFO:teuthology.orchestra.run.smithi045.stdout: -4497> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5930 cv=5384/5384 REP dir_auth=0 ap=40+41 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5930 2023-10-03T19:21:10.921 INFO:teuthology.orchestra.run.smithi045.stdout: -4496> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536710b60 v5923 2023-10-03T19:21:10.921 INFO:teuthology.orchestra.run.smithi045.stdout: -4495> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5923 cv=5377/5377 ap=41+40 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=273 | child=1 dirty=1 authpin=1 0x565534f82400] version 5923 2023-10-03T19:21:10.921 INFO:teuthology.orchestra.run.smithi045.stdout: -4494> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=40 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=40 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.921 INFO:teuthology.orchestra.run.smithi045.stdout: -4493> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=40) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5929 pv6007 ap=41 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=41) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=40) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.921 INFO:teuthology.orchestra.run.smithi045.stdout: -4492> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=41) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5929 pv6007 ap=41 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=41) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=39) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.921 INFO:teuthology.orchestra.run.smithi045.stdout: -4491> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005b5 [2,head] /dc-dir/dc-file_960 auth v5922 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.176390+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535052000] 2023-10-03T19:21:10.921 INFO:teuthology.orchestra.run.smithi045.stdout: -4490> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005b5 [2,head] /dc-dir/dc-file_960 auth v5922 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.176390+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535052000] 2023-10-03T19:21:10.921 INFO:teuthology.orchestra.run.smithi045.stdout: -4489> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.921 INFO:teuthology.orchestra.run.smithi045.stdout: -4488> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.921 INFO:teuthology.orchestra.run.smithi045.stdout: -4487> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.922 INFO:teuthology.orchestra.run.smithi045.stdout: -4486> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005b5 [2,head] /dc-dir/dc-file_960 auth v5922 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.176390+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535052000] 2023-10-03T19:21:10.922 INFO:teuthology.orchestra.run.smithi045.stdout: -4485> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005b5 [2,head] /dc-dir/dc-file_960 auth v5922 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.176390+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535052000] 2023-10-03T19:21:10.922 INFO:teuthology.orchestra.run.smithi045.stdout: -4484> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.922 INFO:teuthology.orchestra.run.smithi045.stdout: -4483> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 687.233, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.87e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1377.3] 2023-10-03T19:21:10.922 INFO:teuthology.orchestra.run.smithi045.stdout: -4482> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536429440 on [dir 0x1 / [2,head] auth pv=6008 v=5930 cv=5384/5384 REP dir_auth=0 ap=39+41 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 39 2023-10-03T19:21:10.922 INFO:teuthology.orchestra.run.smithi045.stdout: -4481> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536429440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5929 pv6007 ap=40 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=40) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=39) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 40 2023-10-03T19:21:10.922 INFO:teuthology.orchestra.run.smithi045.stdout: -4480> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5930 cv=5384/5384 REP dir_auth=0 ap=39+40 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536429440 count now 39/40 2023-10-03T19:21:10.922 INFO:teuthology.orchestra.run.smithi045.stdout: -4479> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536429440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5923 cv=5377/5377 ap=40+40 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=273 | child=1 dirty=1 authpin=1 0x565534f82400] count now 40 2023-10-03T19:21:10.923 INFO:teuthology.orchestra.run.smithi045.stdout: -4478> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005b5) auth_unpin by 0x565536429440 on [inode 0x100000005b5 [2,head] /dc-dir/dc-file_960 auth v5922 s=3 n(v0 rc2023-10-03T19:17:10.176390+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535052000] now 0 2023-10-03T19:21:10.923 INFO:teuthology.orchestra.run.smithi045.stdout: -4477> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5923 cv=5377/5377 ap=40+39 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=273 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536429440 count now 40/39 2023-10-03T19:21:10.923 INFO:teuthology.orchestra.run.smithi045.stdout: -4476> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.923 INFO:teuthology.orchestra.run.smithi045.stdout: -4475> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.923 INFO:teuthology.orchestra.run.smithi045.stdout: -4474> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005b6 [2,head] /dc-dir/dc-file_961 auth v4934 pv5924 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.189372+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.189372+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535052580] 2023-10-03T19:21:10.923 INFO:teuthology.orchestra.run.smithi045.stdout: -4473> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5931 2023-10-03T19:21:10.923 INFO:teuthology.orchestra.run.smithi045.stdout: -4472> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5931 pv6007 ap=40 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=40) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=39) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.923 INFO:teuthology.orchestra.run.smithi045.stdout: -4471> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5929 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.923 INFO:teuthology.orchestra.run.smithi045.stdout: -4470> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5930 cv=5384/5384 REP dir_auth=0 ap=39+40 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5930 2023-10-03T19:21:10.923 INFO:teuthology.orchestra.run.smithi045.stdout: -4469> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005b6) pop_and_dirty_projected_inode v5924 2023-10-03T19:21:10.923 INFO:teuthology.orchestra.run.smithi045.stdout: -4468> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005b6) mark_dirty [inode 0x100000005b6 [2,head] /dc-dir/dc-file_961 auth v5924 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.189372+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535052580] 2023-10-03T19:21:10.924 INFO:teuthology.orchestra.run.smithi045.stdout: -4467> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_961) mark_dirty [dentry #0x1/dc-dir/dc-file_961 [2,head] auth (dversion lock) pv=5924 v=4934 ino=0x100000005b6 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535050500] 2023-10-03T19:21:10.924 INFO:teuthology.orchestra.run.smithi045.stdout: -4466> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5923 cv=5377/5377 ap=40+39 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=274 | child=1 dirty=1 authpin=1 0x565534f82400] version 5923 2023-10-03T19:21:10.924 INFO:teuthology.orchestra.run.smithi045.stdout: -4465> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536710ec0 v5932 2023-10-03T19:21:10.924 INFO:teuthology.orchestra.run.smithi045.stdout: -4464> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5932 cv=5384/5384 REP dir_auth=0 ap=39+40 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5932 2023-10-03T19:21:10.924 INFO:teuthology.orchestra.run.smithi045.stdout: -4463> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536710da0 v5925 2023-10-03T19:21:10.924 INFO:teuthology.orchestra.run.smithi045.stdout: -4462> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5925 cv=5377/5377 ap=40+39 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=274 | child=1 dirty=1 authpin=1 0x565534f82400] version 5925 2023-10-03T19:21:10.924 INFO:teuthology.orchestra.run.smithi045.stdout: -4461> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=39 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=39 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.924 INFO:teuthology.orchestra.run.smithi045.stdout: -4460> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=39) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5931 pv6007 ap=40 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=40) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=39) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.925 INFO:teuthology.orchestra.run.smithi045.stdout: -4459> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=40) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5931 pv6007 ap=40 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=40) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=38) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.925 INFO:teuthology.orchestra.run.smithi045.stdout: -4458> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005b6 [2,head] /dc-dir/dc-file_961 auth v5924 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.189372+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535052580] 2023-10-03T19:21:10.925 INFO:teuthology.orchestra.run.smithi045.stdout: -4457> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005b6 [2,head] /dc-dir/dc-file_961 auth v5924 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.189372+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535052580] 2023-10-03T19:21:10.925 INFO:teuthology.orchestra.run.smithi045.stdout: -4456> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.925 INFO:teuthology.orchestra.run.smithi045.stdout: -4455> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.925 INFO:teuthology.orchestra.run.smithi045.stdout: -4454> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.925 INFO:teuthology.orchestra.run.smithi045.stdout: -4453> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005b6 [2,head] /dc-dir/dc-file_961 auth v5924 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.189372+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535052580] 2023-10-03T19:21:10.925 INFO:teuthology.orchestra.run.smithi045.stdout: -4452> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005b6 [2,head] /dc-dir/dc-file_961 auth v5924 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.189372+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535052580] 2023-10-03T19:21:10.925 INFO:teuthology.orchestra.run.smithi045.stdout: -4451> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.925 INFO:teuthology.orchestra.run.smithi045.stdout: -4450> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 688.233, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.88e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1379.3] 2023-10-03T19:21:10.926 INFO:teuthology.orchestra.run.smithi045.stdout: -4449> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536428b40 on [dir 0x1 / [2,head] auth pv=6008 v=5932 cv=5384/5384 REP dir_auth=0 ap=38+40 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 38 2023-10-03T19:21:10.926 INFO:teuthology.orchestra.run.smithi045.stdout: -4448> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536428b40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5931 pv6007 ap=39 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=39) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=38) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 39 2023-10-03T19:21:10.926 INFO:teuthology.orchestra.run.smithi045.stdout: -4447> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5932 cv=5384/5384 REP dir_auth=0 ap=38+39 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536428b40 count now 38/39 2023-10-03T19:21:10.926 INFO:teuthology.orchestra.run.smithi045.stdout: -4446> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536428b40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5925 cv=5377/5377 ap=39+39 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=274 | child=1 dirty=1 authpin=1 0x565534f82400] count now 39 2023-10-03T19:21:10.926 INFO:teuthology.orchestra.run.smithi045.stdout: -4445> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005b6) auth_unpin by 0x565536428b40 on [inode 0x100000005b6 [2,head] /dc-dir/dc-file_961 auth v5924 s=3 n(v0 rc2023-10-03T19:17:10.189372+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535052580] now 0 2023-10-03T19:21:10.926 INFO:teuthology.orchestra.run.smithi045.stdout: -4444> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5925 cv=5377/5377 ap=39+38 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=274 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536428b40 count now 39/38 2023-10-03T19:21:10.926 INFO:teuthology.orchestra.run.smithi045.stdout: -4443> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.926 INFO:teuthology.orchestra.run.smithi045.stdout: -4442> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.926 INFO:teuthology.orchestra.run.smithi045.stdout: -4441> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005b7 [2,head] /dc-dir/dc-file_962 auth v4938 pv5926 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.202571+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.202571+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535052b00] 2023-10-03T19:21:10.927 INFO:teuthology.orchestra.run.smithi045.stdout: -4440> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5933 2023-10-03T19:21:10.927 INFO:teuthology.orchestra.run.smithi045.stdout: -4439> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5933 pv6007 ap=39 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=39) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=38) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.927 INFO:teuthology.orchestra.run.smithi045.stdout: -4438> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5931 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.927 INFO:teuthology.orchestra.run.smithi045.stdout: -4437> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5932 cv=5384/5384 REP dir_auth=0 ap=38+39 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5932 2023-10-03T19:21:10.927 INFO:teuthology.orchestra.run.smithi045.stdout: -4436> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005b7) pop_and_dirty_projected_inode v5926 2023-10-03T19:21:10.927 INFO:teuthology.orchestra.run.smithi045.stdout: -4435> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005b7) mark_dirty [inode 0x100000005b7 [2,head] /dc-dir/dc-file_962 auth v5926 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.202571+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535052b00] 2023-10-03T19:21:10.927 INFO:teuthology.orchestra.run.smithi045.stdout: -4434> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_962) mark_dirty [dentry #0x1/dc-dir/dc-file_962 [2,head] auth (dversion lock) pv=5926 v=4938 ino=0x100000005b7 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535050780] 2023-10-03T19:21:10.927 INFO:teuthology.orchestra.run.smithi045.stdout: -4433> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5925 cv=5377/5377 ap=39+38 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=275 | child=1 dirty=1 authpin=1 0x565534f82400] version 5925 2023-10-03T19:21:10.927 INFO:teuthology.orchestra.run.smithi045.stdout: -4432> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536711100 v5934 2023-10-03T19:21:10.928 INFO:teuthology.orchestra.run.smithi045.stdout: -4431> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5934 cv=5384/5384 REP dir_auth=0 ap=38+39 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5934 2023-10-03T19:21:10.928 INFO:teuthology.orchestra.run.smithi045.stdout: -4430> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536710fe0 v5927 2023-10-03T19:21:10.928 INFO:teuthology.orchestra.run.smithi045.stdout: -4429> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5927 cv=5377/5377 ap=39+38 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=275 | child=1 dirty=1 authpin=1 0x565534f82400] version 5927 2023-10-03T19:21:10.928 INFO:teuthology.orchestra.run.smithi045.stdout: -4428> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=38 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=38 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.928 INFO:teuthology.orchestra.run.smithi045.stdout: -4427> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=38) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5933 pv6007 ap=39 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=39) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=38) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.928 INFO:teuthology.orchestra.run.smithi045.stdout: -4426> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=39) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5933 pv6007 ap=39 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=39) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=37) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.928 INFO:teuthology.orchestra.run.smithi045.stdout: -4425> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005b7 [2,head] /dc-dir/dc-file_962 auth v5926 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.202571+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535052b00] 2023-10-03T19:21:10.928 INFO:teuthology.orchestra.run.smithi045.stdout: -4424> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005b7 [2,head] /dc-dir/dc-file_962 auth v5926 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.202571+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535052b00] 2023-10-03T19:21:10.928 INFO:teuthology.orchestra.run.smithi045.stdout: -4423> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.928 INFO:teuthology.orchestra.run.smithi045.stdout: -4422> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.929 INFO:teuthology.orchestra.run.smithi045.stdout: -4421> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.929 INFO:teuthology.orchestra.run.smithi045.stdout: -4420> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005b7 [2,head] /dc-dir/dc-file_962 auth v5926 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.202571+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535052b00] 2023-10-03T19:21:10.929 INFO:teuthology.orchestra.run.smithi045.stdout: -4419> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005b7 [2,head] /dc-dir/dc-file_962 auth v5926 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.202571+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535052b00] 2023-10-03T19:21:10.929 INFO:teuthology.orchestra.run.smithi045.stdout: -4418> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.929 INFO:teuthology.orchestra.run.smithi045.stdout: -4417> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 689.233, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.89e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1381.3] 2023-10-03T19:21:10.929 INFO:teuthology.orchestra.run.smithi045.stdout: -4416> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536428240 on [dir 0x1 / [2,head] auth pv=6008 v=5934 cv=5384/5384 REP dir_auth=0 ap=37+39 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 37 2023-10-03T19:21:10.929 INFO:teuthology.orchestra.run.smithi045.stdout: -4415> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536428240 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5933 pv6007 ap=38 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=38) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=37) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 38 2023-10-03T19:21:10.929 INFO:teuthology.orchestra.run.smithi045.stdout: -4414> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5934 cv=5384/5384 REP dir_auth=0 ap=37+38 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536428240 count now 37/38 2023-10-03T19:21:10.929 INFO:teuthology.orchestra.run.smithi045.stdout: -4413> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536428240 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5927 cv=5377/5377 ap=38+38 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=275 | child=1 dirty=1 authpin=1 0x565534f82400] count now 38 2023-10-03T19:21:10.930 INFO:teuthology.orchestra.run.smithi045.stdout: -4412> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005b7) auth_unpin by 0x565536428240 on [inode 0x100000005b7 [2,head] /dc-dir/dc-file_962 auth v5926 s=3 n(v0 rc2023-10-03T19:17:10.202571+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535052b00] now 0 2023-10-03T19:21:10.930 INFO:teuthology.orchestra.run.smithi045.stdout: -4411> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5927 cv=5377/5377 ap=38+37 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=275 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536428240 count now 38/37 2023-10-03T19:21:10.930 INFO:teuthology.orchestra.run.smithi045.stdout: -4410> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.930 INFO:teuthology.orchestra.run.smithi045.stdout: -4409> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.930 INFO:teuthology.orchestra.run.smithi045.stdout: -4408> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005b8 [2,head] /dc-dir/dc-file_963 auth v4942 pv5928 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.215446+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.215446+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535053080] 2023-10-03T19:21:10.930 INFO:teuthology.orchestra.run.smithi045.stdout: -4407> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5935 2023-10-03T19:21:10.930 INFO:teuthology.orchestra.run.smithi045.stdout: -4406> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5935 pv6007 ap=38 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=38) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=37) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.930 INFO:teuthology.orchestra.run.smithi045.stdout: -4405> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5933 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.930 INFO:teuthology.orchestra.run.smithi045.stdout: -4404> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5934 cv=5384/5384 REP dir_auth=0 ap=37+38 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5934 2023-10-03T19:21:10.930 INFO:teuthology.orchestra.run.smithi045.stdout: -4403> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005b8) pop_and_dirty_projected_inode v5928 2023-10-03T19:21:10.931 INFO:teuthology.orchestra.run.smithi045.stdout: -4402> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005b8) mark_dirty [inode 0x100000005b8 [2,head] /dc-dir/dc-file_963 auth v5928 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.215446+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535053080] 2023-10-03T19:21:10.931 INFO:teuthology.orchestra.run.smithi045.stdout: -4401> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_963) mark_dirty [dentry #0x1/dc-dir/dc-file_963 [2,head] auth (dversion lock) pv=5928 v=4942 ino=0x100000005b8 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535050a00] 2023-10-03T19:21:10.931 INFO:teuthology.orchestra.run.smithi045.stdout: -4400> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5927 cv=5377/5377 ap=38+37 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=276 | child=1 dirty=1 authpin=1 0x565534f82400] version 5927 2023-10-03T19:21:10.931 INFO:teuthology.orchestra.run.smithi045.stdout: -4399> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536711340 v5936 2023-10-03T19:21:10.931 INFO:teuthology.orchestra.run.smithi045.stdout: -4398> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5936 cv=5384/5384 REP dir_auth=0 ap=37+38 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5936 2023-10-03T19:21:10.931 INFO:teuthology.orchestra.run.smithi045.stdout: -4397> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536711220 v5929 2023-10-03T19:21:10.931 INFO:teuthology.orchestra.run.smithi045.stdout: -4396> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5929 cv=5377/5377 ap=38+37 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=276 | child=1 dirty=1 authpin=1 0x565534f82400] version 5929 2023-10-03T19:21:10.931 INFO:teuthology.orchestra.run.smithi045.stdout: -4395> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=37 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=37 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.931 INFO:teuthology.orchestra.run.smithi045.stdout: -4394> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=37) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5935 pv6007 ap=38 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=38) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=37) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.932 INFO:teuthology.orchestra.run.smithi045.stdout: -4393> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=38) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5935 pv6007 ap=38 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=38) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=36) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.932 INFO:teuthology.orchestra.run.smithi045.stdout: -4392> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005b8 [2,head] /dc-dir/dc-file_963 auth v5928 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.215446+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535053080] 2023-10-03T19:21:10.932 INFO:teuthology.orchestra.run.smithi045.stdout: -4391> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005b8 [2,head] /dc-dir/dc-file_963 auth v5928 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.215446+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535053080] 2023-10-03T19:21:10.932 INFO:teuthology.orchestra.run.smithi045.stdout: -4390> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.932 INFO:teuthology.orchestra.run.smithi045.stdout: -4389> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.932 INFO:teuthology.orchestra.run.smithi045.stdout: -4388> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.932 INFO:teuthology.orchestra.run.smithi045.stdout: -4387> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005b8 [2,head] /dc-dir/dc-file_963 auth v5928 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.215446+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535053080] 2023-10-03T19:21:10.932 INFO:teuthology.orchestra.run.smithi045.stdout: -4386> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005b8 [2,head] /dc-dir/dc-file_963 auth v5928 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.215446+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535053080] 2023-10-03T19:21:10.932 INFO:teuthology.orchestra.run.smithi045.stdout: -4385> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.932 INFO:teuthology.orchestra.run.smithi045.stdout: -4384> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 690.233, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.90e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1383.3] 2023-10-03T19:21:10.933 INFO:teuthology.orchestra.run.smithi045.stdout: -4383> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536d9dd40 on [dir 0x1 / [2,head] auth pv=6008 v=5936 cv=5384/5384 REP dir_auth=0 ap=36+38 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 36 2023-10-03T19:21:10.933 INFO:teuthology.orchestra.run.smithi045.stdout: -4382> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536d9dd40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5935 pv6007 ap=37 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=37) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=36) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 37 2023-10-03T19:21:10.933 INFO:teuthology.orchestra.run.smithi045.stdout: -4381> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5936 cv=5384/5384 REP dir_auth=0 ap=36+37 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536d9dd40 count now 36/37 2023-10-03T19:21:10.933 INFO:teuthology.orchestra.run.smithi045.stdout: -4380> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536d9dd40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5929 cv=5377/5377 ap=37+37 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=276 | child=1 dirty=1 authpin=1 0x565534f82400] count now 37 2023-10-03T19:21:10.933 INFO:teuthology.orchestra.run.smithi045.stdout: -4379> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005b8) auth_unpin by 0x565536d9dd40 on [inode 0x100000005b8 [2,head] /dc-dir/dc-file_963 auth v5928 s=3 n(v0 rc2023-10-03T19:17:10.215446+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535053080] now 0 2023-10-03T19:21:10.933 INFO:teuthology.orchestra.run.smithi045.stdout: -4378> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5929 cv=5377/5377 ap=37+36 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=276 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536d9dd40 count now 37/36 2023-10-03T19:21:10.933 INFO:teuthology.orchestra.run.smithi045.stdout: -4377> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.933 INFO:teuthology.orchestra.run.smithi045.stdout: -4376> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.933 INFO:teuthology.orchestra.run.smithi045.stdout: -4375> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005b9 [2,head] /dc-dir/dc-file_964 auth v4946 pv5930 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.228435+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.228435+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535053600] 2023-10-03T19:21:10.933 INFO:teuthology.orchestra.run.smithi045.stdout: -4374> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5937 2023-10-03T19:21:10.934 INFO:teuthology.orchestra.run.smithi045.stdout: -4373> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5937 pv6007 ap=37 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=37) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=36) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.934 INFO:teuthology.orchestra.run.smithi045.stdout: -4372> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5935 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.934 INFO:teuthology.orchestra.run.smithi045.stdout: -4371> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5936 cv=5384/5384 REP dir_auth=0 ap=36+37 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5936 2023-10-03T19:21:10.934 INFO:teuthology.orchestra.run.smithi045.stdout: -4370> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005b9) pop_and_dirty_projected_inode v5930 2023-10-03T19:21:10.934 INFO:teuthology.orchestra.run.smithi045.stdout: -4369> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005b9) mark_dirty [inode 0x100000005b9 [2,head] /dc-dir/dc-file_964 auth v5930 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.228435+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535053600] 2023-10-03T19:21:10.934 INFO:teuthology.orchestra.run.smithi045.stdout: -4368> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_964) mark_dirty [dentry #0x1/dc-dir/dc-file_964 [2,head] auth (dversion lock) pv=5930 v=4946 ino=0x100000005b9 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535050c80] 2023-10-03T19:21:10.934 INFO:teuthology.orchestra.run.smithi045.stdout: -4367> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5929 cv=5377/5377 ap=37+36 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=277 | child=1 dirty=1 authpin=1 0x565534f82400] version 5929 2023-10-03T19:21:10.934 INFO:teuthology.orchestra.run.smithi045.stdout: -4366> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536711580 v5938 2023-10-03T19:21:10.935 INFO:teuthology.orchestra.run.smithi045.stdout: -4365> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5938 cv=5384/5384 REP dir_auth=0 ap=36+37 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5938 2023-10-03T19:21:10.935 INFO:teuthology.orchestra.run.smithi045.stdout: -4364> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536711460 v5931 2023-10-03T19:21:10.935 INFO:teuthology.orchestra.run.smithi045.stdout: -4363> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5931 cv=5377/5377 ap=37+36 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=277 | child=1 dirty=1 authpin=1 0x565534f82400] version 5931 2023-10-03T19:21:10.935 INFO:teuthology.orchestra.run.smithi045.stdout: -4362> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=36 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=36 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.935 INFO:teuthology.orchestra.run.smithi045.stdout: -4361> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=36) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5937 pv6007 ap=37 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=37) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=36) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.935 INFO:teuthology.orchestra.run.smithi045.stdout: -4360> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=37) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5937 pv6007 ap=37 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=37) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=35) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.935 INFO:teuthology.orchestra.run.smithi045.stdout: -4359> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005b9 [2,head] /dc-dir/dc-file_964 auth v5930 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.228435+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535053600] 2023-10-03T19:21:10.935 INFO:teuthology.orchestra.run.smithi045.stdout: -4358> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005b9 [2,head] /dc-dir/dc-file_964 auth v5930 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.228435+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535053600] 2023-10-03T19:21:10.935 INFO:teuthology.orchestra.run.smithi045.stdout: -4357> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.935 INFO:teuthology.orchestra.run.smithi045.stdout: -4356> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.936 INFO:teuthology.orchestra.run.smithi045.stdout: -4355> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.936 INFO:teuthology.orchestra.run.smithi045.stdout: -4354> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005b9 [2,head] /dc-dir/dc-file_964 auth v5930 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.228435+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535053600] 2023-10-03T19:21:10.936 INFO:teuthology.orchestra.run.smithi045.stdout: -4353> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005b9 [2,head] /dc-dir/dc-file_964 auth v5930 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.228435+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535053600] 2023-10-03T19:21:10.936 INFO:teuthology.orchestra.run.smithi045.stdout: -4352> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.936 INFO:teuthology.orchestra.run.smithi045.stdout: -4351> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 691.233, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.91e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1385.3] 2023-10-03T19:21:10.936 INFO:teuthology.orchestra.run.smithi045.stdout: -4350> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655356b6fc0 on [dir 0x1 / [2,head] auth pv=6008 v=5938 cv=5384/5384 REP dir_auth=0 ap=35+37 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 35 2023-10-03T19:21:10.936 INFO:teuthology.orchestra.run.smithi045.stdout: -4349> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655356b6fc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5937 pv6007 ap=36 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=36) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=35) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 36 2023-10-03T19:21:10.936 INFO:teuthology.orchestra.run.smithi045.stdout: -4348> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5938 cv=5384/5384 REP dir_auth=0 ap=35+36 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655356b6fc0 count now 35/36 2023-10-03T19:21:10.937 INFO:teuthology.orchestra.run.smithi045.stdout: -4347> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655356b6fc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5931 cv=5377/5377 ap=36+36 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=277 | child=1 dirty=1 authpin=1 0x565534f82400] count now 36 2023-10-03T19:21:10.937 INFO:teuthology.orchestra.run.smithi045.stdout: -4346> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005b9) auth_unpin by 0x5655356b6fc0 on [inode 0x100000005b9 [2,head] /dc-dir/dc-file_964 auth v5930 s=3 n(v0 rc2023-10-03T19:17:10.228435+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535053600] now 0 2023-10-03T19:21:10.937 INFO:teuthology.orchestra.run.smithi045.stdout: -4345> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5931 cv=5377/5377 ap=36+35 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=277 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655356b6fc0 count now 36/35 2023-10-03T19:21:10.937 INFO:teuthology.orchestra.run.smithi045.stdout: -4344> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.937 INFO:teuthology.orchestra.run.smithi045.stdout: -4343> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.937 INFO:teuthology.orchestra.run.smithi045.stdout: -4342> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005ba [2,head] /dc-dir/dc-file_965 auth v4950 pv5932 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.240209+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.240209+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535053b80] 2023-10-03T19:21:10.937 INFO:teuthology.orchestra.run.smithi045.stdout: -4341> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5939 2023-10-03T19:21:10.937 INFO:teuthology.orchestra.run.smithi045.stdout: -4340> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5939 pv6007 ap=36 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=36) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=35) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.937 INFO:teuthology.orchestra.run.smithi045.stdout: -4339> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5937 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.937 INFO:teuthology.orchestra.run.smithi045.stdout: -4338> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5938 cv=5384/5384 REP dir_auth=0 ap=35+36 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5938 2023-10-03T19:21:10.937 INFO:teuthology.orchestra.run.smithi045.stdout: -4337> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005ba) pop_and_dirty_projected_inode v5932 2023-10-03T19:21:10.938 INFO:teuthology.orchestra.run.smithi045.stdout: -4336> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005ba) mark_dirty [inode 0x100000005ba [2,head] /dc-dir/dc-file_965 auth v5932 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.240209+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535053b80] 2023-10-03T19:21:10.938 INFO:teuthology.orchestra.run.smithi045.stdout: -4335> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_965) mark_dirty [dentry #0x1/dc-dir/dc-file_965 [2,head] auth (dversion lock) pv=5932 v=4950 ino=0x100000005ba state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535050f00] 2023-10-03T19:21:10.938 INFO:teuthology.orchestra.run.smithi045.stdout: -4334> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5931 cv=5377/5377 ap=36+35 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=278 | child=1 dirty=1 authpin=1 0x565534f82400] version 5931 2023-10-03T19:21:10.938 INFO:teuthology.orchestra.run.smithi045.stdout: -4333> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x5655367117c0 v5940 2023-10-03T19:21:10.938 INFO:teuthology.orchestra.run.smithi045.stdout: -4332> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5940 cv=5384/5384 REP dir_auth=0 ap=35+36 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5940 2023-10-03T19:21:10.938 INFO:teuthology.orchestra.run.smithi045.stdout: -4331> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655367116a0 v5933 2023-10-03T19:21:10.938 INFO:teuthology.orchestra.run.smithi045.stdout: -4330> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5933 cv=5377/5377 ap=36+35 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=278 | child=1 dirty=1 authpin=1 0x565534f82400] version 5933 2023-10-03T19:21:10.938 INFO:teuthology.orchestra.run.smithi045.stdout: -4329> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=35 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=35 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.938 INFO:teuthology.orchestra.run.smithi045.stdout: -4328> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=35) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5939 pv6007 ap=36 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=36) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=35) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.939 INFO:teuthology.orchestra.run.smithi045.stdout: -4327> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=36) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5939 pv6007 ap=36 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=36) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=34) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.939 INFO:teuthology.orchestra.run.smithi045.stdout: -4326> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005ba [2,head] /dc-dir/dc-file_965 auth v5932 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.240209+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535053b80] 2023-10-03T19:21:10.939 INFO:teuthology.orchestra.run.smithi045.stdout: -4325> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005ba [2,head] /dc-dir/dc-file_965 auth v5932 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.240209+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535053b80] 2023-10-03T19:21:10.939 INFO:teuthology.orchestra.run.smithi045.stdout: -4324> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.939 INFO:teuthology.orchestra.run.smithi045.stdout: -4323> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.939 INFO:teuthology.orchestra.run.smithi045.stdout: -4322> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.939 INFO:teuthology.orchestra.run.smithi045.stdout: -4321> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005ba [2,head] /dc-dir/dc-file_965 auth v5932 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.240209+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535053b80] 2023-10-03T19:21:10.939 INFO:teuthology.orchestra.run.smithi045.stdout: -4320> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005ba [2,head] /dc-dir/dc-file_965 auth v5932 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.240209+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535053b80] 2023-10-03T19:21:10.939 INFO:teuthology.orchestra.run.smithi045.stdout: -4319> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.939 INFO:teuthology.orchestra.run.smithi045.stdout: -4318> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 692.233, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.92e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1387.3] 2023-10-03T19:21:10.940 INFO:teuthology.orchestra.run.smithi045.stdout: -4317> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x56553575d440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5939 pv6007 ap=35 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=35) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=34) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 35 2023-10-03T19:21:10.940 INFO:teuthology.orchestra.run.smithi045.stdout: -4316> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5940 cv=5384/5384 REP dir_auth=0 ap=35+35 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x56553575d440 count now 35/35 2023-10-03T19:21:10.940 INFO:teuthology.orchestra.run.smithi045.stdout: -4315> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x56553575d440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5933 cv=5377/5377 ap=35+35 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=278 | child=1 dirty=1 authpin=1 0x565534f82400] count now 35 2023-10-03T19:21:10.940 INFO:teuthology.orchestra.run.smithi045.stdout: -4314> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x56553575d440 on [dir 0x1 / [2,head] auth pv=6008 v=5940 cv=5384/5384 REP dir_auth=0 ap=34+35 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 34 2023-10-03T19:21:10.940 INFO:teuthology.orchestra.run.smithi045.stdout: -4313> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005ba) auth_unpin by 0x56553575d440 on [inode 0x100000005ba [2,head] /dc-dir/dc-file_965 auth v5932 s=3 n(v0 rc2023-10-03T19:17:10.240209+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535053b80] now 0 2023-10-03T19:21:10.940 INFO:teuthology.orchestra.run.smithi045.stdout: -4312> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5933 cv=5377/5377 ap=35+34 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=278 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x56553575d440 count now 35/34 2023-10-03T19:21:10.940 INFO:teuthology.orchestra.run.smithi045.stdout: -4311> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.940 INFO:teuthology.orchestra.run.smithi045.stdout: -4310> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.940 INFO:teuthology.orchestra.run.smithi045.stdout: -4309> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005bb [2,head] /dc-dir/dc-file_966 auth v4954 pv5934 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.251796+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.251796+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535054100] 2023-10-03T19:21:10.940 INFO:teuthology.orchestra.run.smithi045.stdout: -4308> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5941 2023-10-03T19:21:10.941 INFO:teuthology.orchestra.run.smithi045.stdout: -4307> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5941 pv6007 ap=35 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=35) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=34) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.941 INFO:teuthology.orchestra.run.smithi045.stdout: -4306> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5939 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.941 INFO:teuthology.orchestra.run.smithi045.stdout: -4305> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5940 cv=5384/5384 REP dir_auth=0 ap=34+35 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5940 2023-10-03T19:21:10.941 INFO:teuthology.orchestra.run.smithi045.stdout: -4304> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005bb) pop_and_dirty_projected_inode v5934 2023-10-03T19:21:10.941 INFO:teuthology.orchestra.run.smithi045.stdout: -4303> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005bb) mark_dirty [inode 0x100000005bb [2,head] /dc-dir/dc-file_966 auth v5934 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.251796+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535054100] 2023-10-03T19:21:10.941 INFO:teuthology.orchestra.run.smithi045.stdout: -4302> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_966) mark_dirty [dentry #0x1/dc-dir/dc-file_966 [2,head] auth (dversion lock) pv=5934 v=4954 ino=0x100000005bb state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535051180] 2023-10-03T19:21:10.941 INFO:teuthology.orchestra.run.smithi045.stdout: -4301> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5933 cv=5377/5377 ap=35+34 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=279 | child=1 dirty=1 authpin=1 0x565534f82400] version 5933 2023-10-03T19:21:10.941 INFO:teuthology.orchestra.run.smithi045.stdout: -4300> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536711a00 v5942 2023-10-03T19:21:10.941 INFO:teuthology.orchestra.run.smithi045.stdout: -4299> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5942 cv=5384/5384 REP dir_auth=0 ap=34+35 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5942 2023-10-03T19:21:10.942 INFO:teuthology.orchestra.run.smithi045.stdout: -4298> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655367118e0 v5935 2023-10-03T19:21:10.942 INFO:teuthology.orchestra.run.smithi045.stdout: -4297> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5935 cv=5377/5377 ap=35+34 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=279 | child=1 dirty=1 authpin=1 0x565534f82400] version 5935 2023-10-03T19:21:10.942 INFO:teuthology.orchestra.run.smithi045.stdout: -4296> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=34 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=34 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.942 INFO:teuthology.orchestra.run.smithi045.stdout: -4295> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=34) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5941 pv6007 ap=35 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=35) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=34) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.942 INFO:teuthology.orchestra.run.smithi045.stdout: -4294> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=35) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5941 pv6007 ap=35 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=35) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=33) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.942 INFO:teuthology.orchestra.run.smithi045.stdout: -4293> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005bb [2,head] /dc-dir/dc-file_966 auth v5934 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.251796+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535054100] 2023-10-03T19:21:10.942 INFO:teuthology.orchestra.run.smithi045.stdout: -4292> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005bb [2,head] /dc-dir/dc-file_966 auth v5934 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.251796+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535054100] 2023-10-03T19:21:10.942 INFO:teuthology.orchestra.run.smithi045.stdout: -4291> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.942 INFO:teuthology.orchestra.run.smithi045.stdout: -4290> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.942 INFO:teuthology.orchestra.run.smithi045.stdout: -4289> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.943 INFO:teuthology.orchestra.run.smithi045.stdout: -4288> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005bb [2,head] /dc-dir/dc-file_966 auth v5934 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.251796+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535054100] 2023-10-03T19:21:10.943 INFO:teuthology.orchestra.run.smithi045.stdout: -4287> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005bb [2,head] /dc-dir/dc-file_966 auth v5934 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.251796+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535054100] 2023-10-03T19:21:10.943 INFO:teuthology.orchestra.run.smithi045.stdout: -4286> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.943 INFO:teuthology.orchestra.run.smithi045.stdout: -4285> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 693.233, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.93e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.99e-01] *LOAD:1389.3] 2023-10-03T19:21:10.943 INFO:teuthology.orchestra.run.smithi045.stdout: -4284> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655363fa6c0 on [dir 0x1 / [2,head] auth pv=6008 v=5942 cv=5384/5384 REP dir_auth=0 ap=33+35 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 33 2023-10-03T19:21:10.943 INFO:teuthology.orchestra.run.smithi045.stdout: -4283> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655363fa6c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5941 pv6007 ap=34 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=34) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=33) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 34 2023-10-03T19:21:10.943 INFO:teuthology.orchestra.run.smithi045.stdout: -4282> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5942 cv=5384/5384 REP dir_auth=0 ap=33+34 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655363fa6c0 count now 33/34 2023-10-03T19:21:10.943 INFO:teuthology.orchestra.run.smithi045.stdout: -4281> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655363fa6c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5935 cv=5377/5377 ap=34+34 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=279 | child=1 dirty=1 authpin=1 0x565534f82400] count now 34 2023-10-03T19:21:10.943 INFO:teuthology.orchestra.run.smithi045.stdout: -4280> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005bb) auth_unpin by 0x5655363fa6c0 on [inode 0x100000005bb [2,head] /dc-dir/dc-file_966 auth v5934 s=3 n(v0 rc2023-10-03T19:17:10.251796+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535054100] now 0 2023-10-03T19:21:10.944 INFO:teuthology.orchestra.run.smithi045.stdout: -4279> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5935 cv=5377/5377 ap=34+33 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=279 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655363fa6c0 count now 34/33 2023-10-03T19:21:10.944 INFO:teuthology.orchestra.run.smithi045.stdout: -4278> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.944 INFO:teuthology.orchestra.run.smithi045.stdout: -4277> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.944 INFO:teuthology.orchestra.run.smithi045.stdout: -4276> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005bc [2,head] /dc-dir/dc-file_967 auth v4958 pv5936 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.263808+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.263808+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535054680] 2023-10-03T19:21:10.944 INFO:teuthology.orchestra.run.smithi045.stdout: -4275> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5943 2023-10-03T19:21:10.944 INFO:teuthology.orchestra.run.smithi045.stdout: -4274> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5943 pv6007 ap=34 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=34) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=33) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.944 INFO:teuthology.orchestra.run.smithi045.stdout: -4273> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5941 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.944 INFO:teuthology.orchestra.run.smithi045.stdout: -4272> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5942 cv=5384/5384 REP dir_auth=0 ap=33+34 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5942 2023-10-03T19:21:10.944 INFO:teuthology.orchestra.run.smithi045.stdout: -4271> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005bc) pop_and_dirty_projected_inode v5936 2023-10-03T19:21:10.944 INFO:teuthology.orchestra.run.smithi045.stdout: -4270> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005bc) mark_dirty [inode 0x100000005bc [2,head] /dc-dir/dc-file_967 auth v5936 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.263808+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535054680] 2023-10-03T19:21:10.944 INFO:teuthology.orchestra.run.smithi045.stdout: -4269> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_967) mark_dirty [dentry #0x1/dc-dir/dc-file_967 [2,head] auth (dversion lock) pv=5936 v=4958 ino=0x100000005bc state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535051400] 2023-10-03T19:21:10.945 INFO:teuthology.orchestra.run.smithi045.stdout: -4268> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5935 cv=5377/5377 ap=34+33 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=280 | child=1 dirty=1 authpin=1 0x565534f82400] version 5935 2023-10-03T19:21:10.945 INFO:teuthology.orchestra.run.smithi045.stdout: -4267> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536711c40 v5944 2023-10-03T19:21:10.945 INFO:teuthology.orchestra.run.smithi045.stdout: -4266> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5944 cv=5384/5384 REP dir_auth=0 ap=33+34 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5944 2023-10-03T19:21:10.945 INFO:teuthology.orchestra.run.smithi045.stdout: -4265> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536711b20 v5937 2023-10-03T19:21:10.945 INFO:teuthology.orchestra.run.smithi045.stdout: -4264> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5937 cv=5377/5377 ap=34+33 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=280 | child=1 dirty=1 authpin=1 0x565534f82400] version 5937 2023-10-03T19:21:10.945 INFO:teuthology.orchestra.run.smithi045.stdout: -4263> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=33 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=33 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.945 INFO:teuthology.orchestra.run.smithi045.stdout: -4262> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=33) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5943 pv6007 ap=34 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=34) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=33) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.945 INFO:teuthology.orchestra.run.smithi045.stdout: -4261> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=34) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5943 pv6007 ap=34 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=34) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=32) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.945 INFO:teuthology.orchestra.run.smithi045.stdout: -4260> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005bc [2,head] /dc-dir/dc-file_967 auth v5936 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.263808+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535054680] 2023-10-03T19:21:10.946 INFO:teuthology.orchestra.run.smithi045.stdout: -4259> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005bc [2,head] /dc-dir/dc-file_967 auth v5936 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.263808+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535054680] 2023-10-03T19:21:10.946 INFO:teuthology.orchestra.run.smithi045.stdout: -4258> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.946 INFO:teuthology.orchestra.run.smithi045.stdout: -4257> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.946 INFO:teuthology.orchestra.run.smithi045.stdout: -4256> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.946 INFO:teuthology.orchestra.run.smithi045.stdout: -4255> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005bc [2,head] /dc-dir/dc-file_967 auth v5936 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.263808+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535054680] 2023-10-03T19:21:10.946 INFO:teuthology.orchestra.run.smithi045.stdout: -4254> 2023-10-03T19:17:19.546+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005bc [2,head] /dc-dir/dc-file_967 auth v5936 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.263808+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535054680] 2023-10-03T19:21:10.946 INFO:teuthology.orchestra.run.smithi045.stdout: -4253> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.946 INFO:teuthology.orchestra.run.smithi045.stdout: -4252> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 693.849, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.94e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1390.5] 2023-10-03T19:21:10.946 INFO:teuthology.orchestra.run.smithi045.stdout: -4251> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535ebcb40 on [dir 0x1 / [2,head] auth pv=6008 v=5944 cv=5384/5384 REP dir_auth=0 ap=32+34 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 32 2023-10-03T19:21:10.946 INFO:teuthology.orchestra.run.smithi045.stdout: -4250> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535ebcb40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5943 pv6007 ap=33 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=33) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=32) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 33 2023-10-03T19:21:10.947 INFO:teuthology.orchestra.run.smithi045.stdout: -4249> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5944 cv=5384/5384 REP dir_auth=0 ap=32+33 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535ebcb40 count now 32/33 2023-10-03T19:21:10.947 INFO:teuthology.orchestra.run.smithi045.stdout: -4248> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535ebcb40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5937 cv=5377/5377 ap=33+33 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=280 | child=1 dirty=1 authpin=1 0x565534f82400] count now 33 2023-10-03T19:21:10.947 INFO:teuthology.orchestra.run.smithi045.stdout: -4247> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005bc) auth_unpin by 0x565535ebcb40 on [inode 0x100000005bc [2,head] /dc-dir/dc-file_967 auth v5936 s=3 n(v0 rc2023-10-03T19:17:10.263808+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535054680] now 0 2023-10-03T19:21:10.947 INFO:teuthology.orchestra.run.smithi045.stdout: -4246> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5937 cv=5377/5377 ap=33+32 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=280 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535ebcb40 count now 33/32 2023-10-03T19:21:10.947 INFO:teuthology.orchestra.run.smithi045.stdout: -4245> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.947 INFO:teuthology.orchestra.run.smithi045.stdout: -4244> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.947 INFO:teuthology.orchestra.run.smithi045.stdout: -4243> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005bd [2,head] /dc-dir/dc-file_968 auth v4962 pv5938 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.275776+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.275776+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535054c00] 2023-10-03T19:21:10.947 INFO:teuthology.orchestra.run.smithi045.stdout: -4242> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5945 2023-10-03T19:21:10.947 INFO:teuthology.orchestra.run.smithi045.stdout: -4241> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5945 pv6007 ap=33 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=33) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=32) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.947 INFO:teuthology.orchestra.run.smithi045.stdout: -4240> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5943 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.948 INFO:teuthology.orchestra.run.smithi045.stdout: -4239> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5944 cv=5384/5384 REP dir_auth=0 ap=32+33 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5944 2023-10-03T19:21:10.948 INFO:teuthology.orchestra.run.smithi045.stdout: -4238> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005bd) pop_and_dirty_projected_inode v5938 2023-10-03T19:21:10.948 INFO:teuthology.orchestra.run.smithi045.stdout: -4237> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005bd) mark_dirty [inode 0x100000005bd [2,head] /dc-dir/dc-file_968 auth v5938 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.275776+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535054c00] 2023-10-03T19:21:10.948 INFO:teuthology.orchestra.run.smithi045.stdout: -4236> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_968) mark_dirty [dentry #0x1/dc-dir/dc-file_968 [2,head] auth (dversion lock) pv=5938 v=4962 ino=0x100000005bd state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535051680] 2023-10-03T19:21:10.948 INFO:teuthology.orchestra.run.smithi045.stdout: -4235> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5937 cv=5377/5377 ap=33+32 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=281 | child=1 dirty=1 authpin=1 0x565534f82400] version 5937 2023-10-03T19:21:10.948 INFO:teuthology.orchestra.run.smithi045.stdout: -4234> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536711e80 v5946 2023-10-03T19:21:10.948 INFO:teuthology.orchestra.run.smithi045.stdout: -4233> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5946 cv=5384/5384 REP dir_auth=0 ap=32+33 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5946 2023-10-03T19:21:10.948 INFO:teuthology.orchestra.run.smithi045.stdout: -4232> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536711d60 v5939 2023-10-03T19:21:10.948 INFO:teuthology.orchestra.run.smithi045.stdout: -4231> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5939 cv=5377/5377 ap=33+32 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=281 | child=1 dirty=1 authpin=1 0x565534f82400] version 5939 2023-10-03T19:21:10.949 INFO:teuthology.orchestra.run.smithi045.stdout: -4230> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=32 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=32 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.949 INFO:teuthology.orchestra.run.smithi045.stdout: -4229> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=32) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5945 pv6007 ap=33 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=33) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=32) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.949 INFO:teuthology.orchestra.run.smithi045.stdout: -4228> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=33) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5945 pv6007 ap=33 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=33) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=31) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.949 INFO:teuthology.orchestra.run.smithi045.stdout: -4227> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005bd [2,head] /dc-dir/dc-file_968 auth v5938 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.275776+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535054c00] 2023-10-03T19:21:10.949 INFO:teuthology.orchestra.run.smithi045.stdout: -4226> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005bd [2,head] /dc-dir/dc-file_968 auth v5938 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.275776+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535054c00] 2023-10-03T19:21:10.949 INFO:teuthology.orchestra.run.smithi045.stdout: -4225> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.949 INFO:teuthology.orchestra.run.smithi045.stdout: -4224> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.949 INFO:teuthology.orchestra.run.smithi045.stdout: -4223> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.949 INFO:teuthology.orchestra.run.smithi045.stdout: -4222> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005bd [2,head] /dc-dir/dc-file_968 auth v5938 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.275776+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535054c00] 2023-10-03T19:21:10.949 INFO:teuthology.orchestra.run.smithi045.stdout: -4221> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005bd [2,head] /dc-dir/dc-file_968 auth v5938 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.275776+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535054c00] 2023-10-03T19:21:10.949 INFO:teuthology.orchestra.run.smithi045.stdout: -4220> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.950 INFO:teuthology.orchestra.run.smithi045.stdout: -4219> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 694.849, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.95e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1392.5] 2023-10-03T19:21:10.950 INFO:teuthology.orchestra.run.smithi045.stdout: -4218> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655351dcfc0 on [dir 0x1 / [2,head] auth pv=6008 v=5946 cv=5384/5384 REP dir_auth=0 ap=31+33 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 31 2023-10-03T19:21:10.950 INFO:teuthology.orchestra.run.smithi045.stdout: -4217> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655351dcfc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5939 cv=5377/5377 ap=32+32 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=281 | child=1 dirty=1 authpin=1 0x565534f82400] count now 32 2023-10-03T19:21:10.950 INFO:teuthology.orchestra.run.smithi045.stdout: -4216> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655351dcfc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5945 pv6007 ap=32 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=32) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=31) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 32 2023-10-03T19:21:10.950 INFO:teuthology.orchestra.run.smithi045.stdout: -4215> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5946 cv=5384/5384 REP dir_auth=0 ap=31+32 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655351dcfc0 count now 31/32 2023-10-03T19:21:10.950 INFO:teuthology.orchestra.run.smithi045.stdout: -4214> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005bd) auth_unpin by 0x5655351dcfc0 on [inode 0x100000005bd [2,head] /dc-dir/dc-file_968 auth v5938 s=3 n(v0 rc2023-10-03T19:17:10.275776+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535054c00] now 0 2023-10-03T19:21:10.950 INFO:teuthology.orchestra.run.smithi045.stdout: -4213> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5939 cv=5377/5377 ap=32+31 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=281 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655351dcfc0 count now 32/31 2023-10-03T19:21:10.950 INFO:teuthology.orchestra.run.smithi045.stdout: -4212> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.951 INFO:teuthology.orchestra.run.smithi045.stdout: -4211> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.951 INFO:teuthology.orchestra.run.smithi045.stdout: -4210> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005be [2,head] /dc-dir/dc-file_969 auth v4966 pv5940 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.287859+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.287859+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535055180] 2023-10-03T19:21:10.951 INFO:teuthology.orchestra.run.smithi045.stdout: -4209> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5947 2023-10-03T19:21:10.951 INFO:teuthology.orchestra.run.smithi045.stdout: -4208> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5947 pv6007 ap=32 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=32) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=31) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.951 INFO:teuthology.orchestra.run.smithi045.stdout: -4207> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5945 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.951 INFO:teuthology.orchestra.run.smithi045.stdout: -4206> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5946 cv=5384/5384 REP dir_auth=0 ap=31+32 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5946 2023-10-03T19:21:10.951 INFO:teuthology.orchestra.run.smithi045.stdout: -4205> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005be) pop_and_dirty_projected_inode v5940 2023-10-03T19:21:10.951 INFO:teuthology.orchestra.run.smithi045.stdout: -4204> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005be) mark_dirty [inode 0x100000005be [2,head] /dc-dir/dc-file_969 auth v5940 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.287859+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535055180] 2023-10-03T19:21:10.951 INFO:teuthology.orchestra.run.smithi045.stdout: -4203> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_969) mark_dirty [dentry #0x1/dc-dir/dc-file_969 [2,head] auth (dversion lock) pv=5940 v=4966 ino=0x100000005be state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535051900] 2023-10-03T19:21:10.951 INFO:teuthology.orchestra.run.smithi045.stdout: -4202> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5939 cv=5377/5377 ap=32+31 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=282 | child=1 dirty=1 authpin=1 0x565534f82400] version 5939 2023-10-03T19:21:10.951 INFO:teuthology.orchestra.run.smithi045.stdout: -4201> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536348140 v5948 2023-10-03T19:21:10.952 INFO:teuthology.orchestra.run.smithi045.stdout: -4200> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5948 cv=5384/5384 REP dir_auth=0 ap=31+32 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5948 2023-10-03T19:21:10.952 INFO:teuthology.orchestra.run.smithi045.stdout: -4199> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536348020 v5941 2023-10-03T19:21:10.952 INFO:teuthology.orchestra.run.smithi045.stdout: -4198> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5941 cv=5377/5377 ap=32+31 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=282 | child=1 dirty=1 authpin=1 0x565534f82400] version 5941 2023-10-03T19:21:10.952 INFO:teuthology.orchestra.run.smithi045.stdout: -4197> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=31 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=31 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.952 INFO:teuthology.orchestra.run.smithi045.stdout: -4196> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=31) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5947 pv6007 ap=32 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=32) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=31) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.952 INFO:teuthology.orchestra.run.smithi045.stdout: -4195> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=32) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5947 pv6007 ap=32 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=32) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=30) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.952 INFO:teuthology.orchestra.run.smithi045.stdout: -4194> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005be [2,head] /dc-dir/dc-file_969 auth v5940 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.287859+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535055180] 2023-10-03T19:21:10.952 INFO:teuthology.orchestra.run.smithi045.stdout: -4193> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005be [2,head] /dc-dir/dc-file_969 auth v5940 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.287859+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535055180] 2023-10-03T19:21:10.952 INFO:teuthology.orchestra.run.smithi045.stdout: -4192> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.953 INFO:teuthology.orchestra.run.smithi045.stdout: -4191> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.953 INFO:teuthology.orchestra.run.smithi045.stdout: -4190> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.953 INFO:teuthology.orchestra.run.smithi045.stdout: -4189> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005be [2,head] /dc-dir/dc-file_969 auth v5940 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.287859+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535055180] 2023-10-03T19:21:10.953 INFO:teuthology.orchestra.run.smithi045.stdout: -4188> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005be [2,head] /dc-dir/dc-file_969 auth v5940 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.287859+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535055180] 2023-10-03T19:21:10.953 INFO:teuthology.orchestra.run.smithi045.stdout: -4187> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.953 INFO:teuthology.orchestra.run.smithi045.stdout: -4186> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 695.849, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.96e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1394.5] 2023-10-03T19:21:10.953 INFO:teuthology.orchestra.run.smithi045.stdout: -4185> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536c16240 on [dir 0x1 / [2,head] auth pv=6008 v=5948 cv=5384/5384 REP dir_auth=0 ap=30+32 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 30 2023-10-03T19:21:10.953 INFO:teuthology.orchestra.run.smithi045.stdout: -4184> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536c16240 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5947 pv6007 ap=31 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=31) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=30) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 31 2023-10-03T19:21:10.953 INFO:teuthology.orchestra.run.smithi045.stdout: -4183> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5948 cv=5384/5384 REP dir_auth=0 ap=30+31 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536c16240 count now 30/31 2023-10-03T19:21:10.953 INFO:teuthology.orchestra.run.smithi045.stdout: -4182> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536c16240 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5941 cv=5377/5377 ap=31+31 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=282 | child=1 dirty=1 authpin=1 0x565534f82400] count now 31 2023-10-03T19:21:10.953 INFO:teuthology.orchestra.run.smithi045.stdout: -4181> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005be) auth_unpin by 0x565536c16240 on [inode 0x100000005be [2,head] /dc-dir/dc-file_969 auth v5940 s=3 n(v0 rc2023-10-03T19:17:10.287859+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535055180] now 0 2023-10-03T19:21:10.954 INFO:teuthology.orchestra.run.smithi045.stdout: -4180> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5941 cv=5377/5377 ap=31+30 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=282 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536c16240 count now 31/30 2023-10-03T19:21:10.954 INFO:teuthology.orchestra.run.smithi045.stdout: -4179> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.954 INFO:teuthology.orchestra.run.smithi045.stdout: -4178> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.954 INFO:teuthology.orchestra.run.smithi045.stdout: -4177> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005bf [2,head] /dc-dir/dc-file_970 auth v4970 pv5942 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.299245+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.299245+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535055700] 2023-10-03T19:21:10.954 INFO:teuthology.orchestra.run.smithi045.stdout: -4176> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5949 2023-10-03T19:21:10.954 INFO:teuthology.orchestra.run.smithi045.stdout: -4175> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5949 pv6007 ap=31 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=31) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=30) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.954 INFO:teuthology.orchestra.run.smithi045.stdout: -4174> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5947 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.968 INFO:teuthology.orchestra.run.smithi045.stdout: -4173> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5948 cv=5384/5384 REP dir_auth=0 ap=30+31 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5948 2023-10-03T19:21:10.968 INFO:teuthology.orchestra.run.smithi045.stdout: -4172> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005bf) pop_and_dirty_projected_inode v5942 2023-10-03T19:21:10.968 INFO:teuthology.orchestra.run.smithi045.stdout: -4171> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005bf) mark_dirty [inode 0x100000005bf [2,head] /dc-dir/dc-file_970 auth v5942 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.299245+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535055700] 2023-10-03T19:21:10.968 INFO:teuthology.orchestra.run.smithi045.stdout: -4170> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_970) mark_dirty [dentry #0x1/dc-dir/dc-file_970 [2,head] auth (dversion lock) pv=5942 v=4970 ino=0x100000005bf state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535051b80] 2023-10-03T19:21:10.968 INFO:teuthology.orchestra.run.smithi045.stdout: -4169> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5941 cv=5377/5377 ap=31+30 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=283 | child=1 dirty=1 authpin=1 0x565534f82400] version 5941 2023-10-03T19:21:10.968 INFO:teuthology.orchestra.run.smithi045.stdout: -4168> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536348380 v5950 2023-10-03T19:21:10.968 INFO:teuthology.orchestra.run.smithi045.stdout: -4167> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5950 cv=5384/5384 REP dir_auth=0 ap=30+31 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5950 2023-10-03T19:21:10.968 INFO:teuthology.orchestra.run.smithi045.stdout: -4166> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536348260 v5943 2023-10-03T19:21:10.969 INFO:teuthology.orchestra.run.smithi045.stdout: -4165> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5943 cv=5377/5377 ap=31+30 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=283 | child=1 dirty=1 authpin=1 0x565534f82400] version 5943 2023-10-03T19:21:10.969 INFO:teuthology.orchestra.run.smithi045.stdout: -4164> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=30 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=30 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.969 INFO:teuthology.orchestra.run.smithi045.stdout: -4163> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=30) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5949 pv6007 ap=31 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=31) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=30) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.969 INFO:teuthology.orchestra.run.smithi045.stdout: -4162> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=31) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5949 pv6007 ap=31 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=31) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=29) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.969 INFO:teuthology.orchestra.run.smithi045.stdout: -4161> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005bf [2,head] /dc-dir/dc-file_970 auth v5942 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.299245+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535055700] 2023-10-03T19:21:10.969 INFO:teuthology.orchestra.run.smithi045.stdout: -4160> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005bf [2,head] /dc-dir/dc-file_970 auth v5942 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.299245+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535055700] 2023-10-03T19:21:10.969 INFO:teuthology.orchestra.run.smithi045.stdout: -4159> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.969 INFO:teuthology.orchestra.run.smithi045.stdout: -4158> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.969 INFO:teuthology.orchestra.run.smithi045.stdout: -4157> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.969 INFO:teuthology.orchestra.run.smithi045.stdout: -4156> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005bf [2,head] /dc-dir/dc-file_970 auth v5942 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.299245+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535055700] 2023-10-03T19:21:10.970 INFO:teuthology.orchestra.run.smithi045.stdout: -4155> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005bf [2,head] /dc-dir/dc-file_970 auth v5942 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.299245+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535055700] 2023-10-03T19:21:10.970 INFO:teuthology.orchestra.run.smithi045.stdout: -4154> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.970 INFO:teuthology.orchestra.run.smithi045.stdout: -4153> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 696.849, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.97e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1396.5] 2023-10-03T19:21:10.970 INFO:teuthology.orchestra.run.smithi045.stdout: -4152> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536c17440 on [dir 0x1 / [2,head] auth pv=6008 v=5950 cv=5384/5384 REP dir_auth=0 ap=29+31 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 29 2023-10-03T19:21:10.970 INFO:teuthology.orchestra.run.smithi045.stdout: -4151> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536c17440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5949 pv6007 ap=30 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=30) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=29) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 30 2023-10-03T19:21:10.970 INFO:teuthology.orchestra.run.smithi045.stdout: -4150> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5950 cv=5384/5384 REP dir_auth=0 ap=29+30 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536c17440 count now 29/30 2023-10-03T19:21:10.970 INFO:teuthology.orchestra.run.smithi045.stdout: -4149> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536c17440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5943 cv=5377/5377 ap=30+30 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=283 | child=1 dirty=1 authpin=1 0x565534f82400] count now 30 2023-10-03T19:21:10.970 INFO:teuthology.orchestra.run.smithi045.stdout: -4148> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005bf) auth_unpin by 0x565536c17440 on [inode 0x100000005bf [2,head] /dc-dir/dc-file_970 auth v5942 s=3 n(v0 rc2023-10-03T19:17:10.299245+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535055700] now 0 2023-10-03T19:21:10.970 INFO:teuthology.orchestra.run.smithi045.stdout: -4147> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5943 cv=5377/5377 ap=30+29 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=283 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536c17440 count now 30/29 2023-10-03T19:21:10.971 INFO:teuthology.orchestra.run.smithi045.stdout: -4146> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.971 INFO:teuthology.orchestra.run.smithi045.stdout: -4145> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:10.971 INFO:teuthology.orchestra.run.smithi045.stdout: -4144> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005c0 [2,head] /dc-dir/dc-file_971 auth v4974 pv5944 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.311523+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.311523+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535722000] 2023-10-03T19:21:10.971 INFO:teuthology.orchestra.run.smithi045.stdout: -4143> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5951 2023-10-03T19:21:10.971 INFO:teuthology.orchestra.run.smithi045.stdout: -4142> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5951 pv6007 ap=30 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=30) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=29) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.971 INFO:teuthology.orchestra.run.smithi045.stdout: -4141> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5949 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:10.971 INFO:teuthology.orchestra.run.smithi045.stdout: -4140> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5950 cv=5384/5384 REP dir_auth=0 ap=29+30 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5950 2023-10-03T19:21:10.971 INFO:teuthology.orchestra.run.smithi045.stdout: -4139> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005c0) pop_and_dirty_projected_inode v5944 2023-10-03T19:21:10.971 INFO:teuthology.orchestra.run.smithi045.stdout: -4138> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005c0) mark_dirty [inode 0x100000005c0 [2,head] /dc-dir/dc-file_971 auth v5944 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.311523+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535722000] 2023-10-03T19:21:10.971 INFO:teuthology.orchestra.run.smithi045.stdout: -4137> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_971) mark_dirty [dentry #0x1/dc-dir/dc-file_971 [2,head] auth (dversion lock) pv=5944 v=4974 ino=0x100000005c0 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553505a000] 2023-10-03T19:21:10.972 INFO:teuthology.orchestra.run.smithi045.stdout: -4136> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5943 cv=5377/5377 ap=30+29 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=284 | child=1 dirty=1 authpin=1 0x565534f82400] version 5943 2023-10-03T19:21:10.972 INFO:teuthology.orchestra.run.smithi045.stdout: -4135> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x5655363485c0 v5952 2023-10-03T19:21:10.972 INFO:teuthology.orchestra.run.smithi045.stdout: -4134> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5952 cv=5384/5384 REP dir_auth=0 ap=29+30 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5952 2023-10-03T19:21:10.972 INFO:teuthology.orchestra.run.smithi045.stdout: -4133> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655363484a0 v5945 2023-10-03T19:21:10.972 INFO:teuthology.orchestra.run.smithi045.stdout: -4132> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5945 cv=5377/5377 ap=30+29 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=284 | child=1 dirty=1 authpin=1 0x565534f82400] version 5945 2023-10-03T19:21:10.972 INFO:teuthology.orchestra.run.smithi045.stdout: -4131> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=29 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=29 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:10.972 INFO:teuthology.orchestra.run.smithi045.stdout: -4130> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=29) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5951 pv6007 ap=30 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=30) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=29) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.972 INFO:teuthology.orchestra.run.smithi045.stdout: -4129> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=30) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5951 pv6007 ap=30 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=30) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=28) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:10.972 INFO:teuthology.orchestra.run.smithi045.stdout: -4128> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005c0 [2,head] /dc-dir/dc-file_971 auth v5944 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.311523+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535722000] 2023-10-03T19:21:10.972 INFO:teuthology.orchestra.run.smithi045.stdout: -4127> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005c0 [2,head] /dc-dir/dc-file_971 auth v5944 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.311523+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535722000] 2023-10-03T19:21:10.973 INFO:teuthology.orchestra.run.smithi045.stdout: -4126> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:10.973 INFO:teuthology.orchestra.run.smithi045.stdout: -4125> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:10.973 INFO:teuthology.orchestra.run.smithi045.stdout: -4124> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:10.973 INFO:teuthology.orchestra.run.smithi045.stdout: -4123> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005c0 [2,head] /dc-dir/dc-file_971 auth v5944 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.311523+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535722000] 2023-10-03T19:21:10.973 INFO:teuthology.orchestra.run.smithi045.stdout: -4122> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005c0 [2,head] /dc-dir/dc-file_971 auth v5944 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.311523+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535722000] 2023-10-03T19:21:10.973 INFO:teuthology.orchestra.run.smithi045.stdout: -4121> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:10.973 INFO:teuthology.orchestra.run.smithi045.stdout: -4120> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 697.849, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.98e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1398.5] 2023-10-03T19:21:10.973 INFO:teuthology.orchestra.run.smithi045.stdout: -4119> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536350000 on [dir 0x1 / [2,head] auth pv=6008 v=5952 cv=5384/5384 REP dir_auth=0 ap=28+30 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 28 2023-10-03T19:21:10.973 INFO:teuthology.orchestra.run.smithi045.stdout: -4118> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536350000 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5951 pv6007 ap=29 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=29) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=28) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 29 2023-10-03T19:21:10.974 INFO:teuthology.orchestra.run.smithi045.stdout: -4117> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5952 cv=5384/5384 REP dir_auth=0 ap=28+29 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536350000 count now 28/29 2023-10-03T19:21:10.974 INFO:teuthology.orchestra.run.smithi045.stdout: -4116> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536350000 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5945 cv=5377/5377 ap=29+29 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=284 | child=1 dirty=1 authpin=1 0x565534f82400] count now 29 2023-10-03T19:21:10.974 INFO:teuthology.orchestra.run.smithi045.stdout: -4115> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005c0) auth_unpin by 0x565536350000 on [inode 0x100000005c0 [2,head] /dc-dir/dc-file_971 auth v5944 s=3 n(v0 rc2023-10-03T19:17:10.311523+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535722000] now 0 2023-10-03T19:21:11.021 INFO:teuthology.orchestra.run.smithi045.stdout: -4114> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5945 cv=5377/5377 ap=29+28 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=284 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536350000 count now 29/28 2023-10-03T19:21:11.021 INFO:teuthology.orchestra.run.smithi045.stdout: -4113> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.021 INFO:teuthology.orchestra.run.smithi045.stdout: -4112> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.022 INFO:teuthology.orchestra.run.smithi045.stdout: -4111> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005c1 [2,head] /dc-dir/dc-file_972 auth v4978 pv5946 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.324469+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.324469+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535722580] 2023-10-03T19:21:11.022 INFO:teuthology.orchestra.run.smithi045.stdout: -4110> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5953 2023-10-03T19:21:11.022 INFO:teuthology.orchestra.run.smithi045.stdout: -4109> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5953 pv6007 ap=29 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=29) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=28) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.022 INFO:teuthology.orchestra.run.smithi045.stdout: -4108> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5951 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:11.022 INFO:teuthology.orchestra.run.smithi045.stdout: -4107> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5952 cv=5384/5384 REP dir_auth=0 ap=28+29 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5952 2023-10-03T19:21:11.022 INFO:teuthology.orchestra.run.smithi045.stdout: -4106> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005c1) pop_and_dirty_projected_inode v5946 2023-10-03T19:21:11.022 INFO:teuthology.orchestra.run.smithi045.stdout: -4105> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005c1) mark_dirty [inode 0x100000005c1 [2,head] /dc-dir/dc-file_972 auth v5946 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.324469+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535722580] 2023-10-03T19:21:11.022 INFO:teuthology.orchestra.run.smithi045.stdout: -4104> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_972) mark_dirty [dentry #0x1/dc-dir/dc-file_972 [2,head] auth (dversion lock) pv=5946 v=4978 ino=0x100000005c1 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553505a280] 2023-10-03T19:21:11.022 INFO:teuthology.orchestra.run.smithi045.stdout: -4103> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5945 cv=5377/5377 ap=29+28 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=285 | child=1 dirty=1 authpin=1 0x565534f82400] version 5945 2023-10-03T19:21:11.022 INFO:teuthology.orchestra.run.smithi045.stdout: -4102> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536348800 v5954 2023-10-03T19:21:11.023 INFO:teuthology.orchestra.run.smithi045.stdout: -4101> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5954 cv=5384/5384 REP dir_auth=0 ap=28+29 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5954 2023-10-03T19:21:11.023 INFO:teuthology.orchestra.run.smithi045.stdout: -4100> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655363486e0 v5947 2023-10-03T19:21:11.023 INFO:teuthology.orchestra.run.smithi045.stdout: -4099> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5947 cv=5377/5377 ap=29+28 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=285 | child=1 dirty=1 authpin=1 0x565534f82400] version 5947 2023-10-03T19:21:11.023 INFO:teuthology.orchestra.run.smithi045.stdout: -4098> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=28 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=28 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:11.023 INFO:teuthology.orchestra.run.smithi045.stdout: -4097> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=28) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5953 pv6007 ap=29 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=29) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=28) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.023 INFO:teuthology.orchestra.run.smithi045.stdout: -4096> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=29) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5953 pv6007 ap=29 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=29) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=27) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.023 INFO:teuthology.orchestra.run.smithi045.stdout: -4095> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005c1 [2,head] /dc-dir/dc-file_972 auth v5946 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.324469+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535722580] 2023-10-03T19:21:11.023 INFO:teuthology.orchestra.run.smithi045.stdout: -4094> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005c1 [2,head] /dc-dir/dc-file_972 auth v5946 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.324469+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535722580] 2023-10-03T19:21:11.024 INFO:teuthology.orchestra.run.smithi045.stdout: -4093> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:11.024 INFO:teuthology.orchestra.run.smithi045.stdout: -4092> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:11.024 INFO:teuthology.orchestra.run.smithi045.stdout: -4091> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:11.024 INFO:teuthology.orchestra.run.smithi045.stdout: -4090> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005c1 [2,head] /dc-dir/dc-file_972 auth v5946 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.324469+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535722580] 2023-10-03T19:21:11.024 INFO:teuthology.orchestra.run.smithi045.stdout: -4089> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005c1 [2,head] /dc-dir/dc-file_972 auth v5946 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.324469+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535722580] 2023-10-03T19:21:11.024 INFO:teuthology.orchestra.run.smithi045.stdout: -4088> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:11.024 INFO:teuthology.orchestra.run.smithi045.stdout: -4087> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 698.849, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 6.99e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1400.5] 2023-10-03T19:21:11.024 INFO:teuthology.orchestra.run.smithi045.stdout: -4086> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536350480 on [dir 0x1 / [2,head] auth pv=6008 v=5954 cv=5384/5384 REP dir_auth=0 ap=27+29 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 27 2023-10-03T19:21:11.024 INFO:teuthology.orchestra.run.smithi045.stdout: -4085> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536350480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5947 cv=5377/5377 ap=28+28 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=285 | child=1 dirty=1 authpin=1 0x565534f82400] count now 28 2023-10-03T19:21:11.024 INFO:teuthology.orchestra.run.smithi045.stdout: -4084> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536350480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5953 pv6007 ap=28 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=28) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=27) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 28 2023-10-03T19:21:11.025 INFO:teuthology.orchestra.run.smithi045.stdout: -4083> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5954 cv=5384/5384 REP dir_auth=0 ap=27+28 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536350480 count now 27/28 2023-10-03T19:21:11.025 INFO:teuthology.orchestra.run.smithi045.stdout: -4082> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005c1) auth_unpin by 0x565536350480 on [inode 0x100000005c1 [2,head] /dc-dir/dc-file_972 auth v5946 s=3 n(v0 rc2023-10-03T19:17:10.324469+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535722580] now 0 2023-10-03T19:21:11.025 INFO:teuthology.orchestra.run.smithi045.stdout: -4081> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5947 cv=5377/5377 ap=28+27 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=285 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536350480 count now 28/27 2023-10-03T19:21:11.025 INFO:teuthology.orchestra.run.smithi045.stdout: -4080> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.025 INFO:teuthology.orchestra.run.smithi045.stdout: -4079> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.025 INFO:teuthology.orchestra.run.smithi045.stdout: -4078> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005c2 [2,head] /dc-dir/dc-file_973 auth v4982 pv5948 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.335727+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.335727+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535722b00] 2023-10-03T19:21:11.025 INFO:teuthology.orchestra.run.smithi045.stdout: -4077> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5955 2023-10-03T19:21:11.025 INFO:teuthology.orchestra.run.smithi045.stdout: -4076> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5955 pv6007 ap=28 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=28) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=27) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.025 INFO:teuthology.orchestra.run.smithi045.stdout: -4075> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5953 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:11.026 INFO:teuthology.orchestra.run.smithi045.stdout: -4074> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5954 cv=5384/5384 REP dir_auth=0 ap=27+28 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5954 2023-10-03T19:21:11.026 INFO:teuthology.orchestra.run.smithi045.stdout: -4073> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005c2) pop_and_dirty_projected_inode v5948 2023-10-03T19:21:11.026 INFO:teuthology.orchestra.run.smithi045.stdout: -4072> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005c2) mark_dirty [inode 0x100000005c2 [2,head] /dc-dir/dc-file_973 auth v5948 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.335727+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535722b00] 2023-10-03T19:21:11.026 INFO:teuthology.orchestra.run.smithi045.stdout: -4071> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_973) mark_dirty [dentry #0x1/dc-dir/dc-file_973 [2,head] auth (dversion lock) pv=5948 v=4982 ino=0x100000005c2 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553505a500] 2023-10-03T19:21:11.026 INFO:teuthology.orchestra.run.smithi045.stdout: -4070> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5947 cv=5377/5377 ap=28+27 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=286 | child=1 dirty=1 authpin=1 0x565534f82400] version 5947 2023-10-03T19:21:11.026 INFO:teuthology.orchestra.run.smithi045.stdout: -4069> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536348a40 v5956 2023-10-03T19:21:11.026 INFO:teuthology.orchestra.run.smithi045.stdout: -4068> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5956 cv=5384/5384 REP dir_auth=0 ap=27+28 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5956 2023-10-03T19:21:11.026 INFO:teuthology.orchestra.run.smithi045.stdout: -4067> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536348920 v5949 2023-10-03T19:21:11.026 INFO:teuthology.orchestra.run.smithi045.stdout: -4066> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5949 cv=5377/5377 ap=28+27 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=286 | child=1 dirty=1 authpin=1 0x565534f82400] version 5949 2023-10-03T19:21:11.026 INFO:teuthology.orchestra.run.smithi045.stdout: -4065> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=27 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=27 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:11.027 INFO:teuthology.orchestra.run.smithi045.stdout: -4064> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=27) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5955 pv6007 ap=28 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=28) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=27) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.027 INFO:teuthology.orchestra.run.smithi045.stdout: -4063> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=28) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5955 pv6007 ap=28 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=28) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=26) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.027 INFO:teuthology.orchestra.run.smithi045.stdout: -4062> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005c2 [2,head] /dc-dir/dc-file_973 auth v5948 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.335727+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535722b00] 2023-10-03T19:21:11.027 INFO:teuthology.orchestra.run.smithi045.stdout: -4061> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005c2 [2,head] /dc-dir/dc-file_973 auth v5948 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.335727+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535722b00] 2023-10-03T19:21:11.027 INFO:teuthology.orchestra.run.smithi045.stdout: -4060> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:11.027 INFO:teuthology.orchestra.run.smithi045.stdout: -4059> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:11.027 INFO:teuthology.orchestra.run.smithi045.stdout: -4058> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:11.027 INFO:teuthology.orchestra.run.smithi045.stdout: -4057> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005c2 [2,head] /dc-dir/dc-file_973 auth v5948 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.335727+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535722b00] 2023-10-03T19:21:11.027 INFO:teuthology.orchestra.run.smithi045.stdout: -4056> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005c2 [2,head] /dc-dir/dc-file_973 auth v5948 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.335727+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535722b00] 2023-10-03T19:21:11.108 INFO:teuthology.orchestra.run.smithi045.stdout: -4055> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:11.108 INFO:teuthology.orchestra.run.smithi045.stdout: -4054> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 699.849, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 7.00e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1402.5] 2023-10-03T19:21:11.108 INFO:teuthology.orchestra.run.smithi045.stdout: -4053> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536350900 on [dir 0x1 / [2,head] auth pv=6008 v=5956 cv=5384/5384 REP dir_auth=0 ap=26+28 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 26 2023-10-03T19:21:11.108 INFO:teuthology.orchestra.run.smithi045.stdout: -4052> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536350900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5955 pv6007 ap=27 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=27) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=26) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 27 2023-10-03T19:21:11.108 INFO:teuthology.orchestra.run.smithi045.stdout: -4051> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5956 cv=5384/5384 REP dir_auth=0 ap=26+27 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536350900 count now 26/27 2023-10-03T19:21:11.108 INFO:teuthology.orchestra.run.smithi045.stdout: -4050> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536350900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5949 cv=5377/5377 ap=27+27 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=286 | child=1 dirty=1 authpin=1 0x565534f82400] count now 27 2023-10-03T19:21:11.108 INFO:teuthology.orchestra.run.smithi045.stdout: -4049> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005c2) auth_unpin by 0x565536350900 on [inode 0x100000005c2 [2,head] /dc-dir/dc-file_973 auth v5948 s=3 n(v0 rc2023-10-03T19:17:10.335727+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535722b00] now 0 2023-10-03T19:21:11.109 INFO:teuthology.orchestra.run.smithi045.stdout: -4048> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5949 cv=5377/5377 ap=27+26 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=286 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536350900 count now 27/26 2023-10-03T19:21:11.109 INFO:teuthology.orchestra.run.smithi045.stdout: -4047> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.109 INFO:teuthology.orchestra.run.smithi045.stdout: -4046> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.109 INFO:teuthology.orchestra.run.smithi045.stdout: -4045> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005c3 [2,head] /dc-dir/dc-file_974 auth v4986 pv5950 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.348569+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.348569+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535723080] 2023-10-03T19:21:11.109 INFO:teuthology.orchestra.run.smithi045.stdout: -4044> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5957 2023-10-03T19:21:11.109 INFO:teuthology.orchestra.run.smithi045.stdout: -4043> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5957 pv6007 ap=27 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=27) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=26) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.109 INFO:teuthology.orchestra.run.smithi045.stdout: -4042> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5955 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:11.109 INFO:teuthology.orchestra.run.smithi045.stdout: -4041> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5956 cv=5384/5384 REP dir_auth=0 ap=26+27 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5956 2023-10-03T19:21:11.109 INFO:teuthology.orchestra.run.smithi045.stdout: -4040> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005c3) pop_and_dirty_projected_inode v5950 2023-10-03T19:21:11.109 INFO:teuthology.orchestra.run.smithi045.stdout: -4039> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005c3) mark_dirty [inode 0x100000005c3 [2,head] /dc-dir/dc-file_974 auth v5950 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.348569+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535723080] 2023-10-03T19:21:11.110 INFO:teuthology.orchestra.run.smithi045.stdout: -4038> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_974) mark_dirty [dentry #0x1/dc-dir/dc-file_974 [2,head] auth (dversion lock) pv=5950 v=4986 ino=0x100000005c3 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553505a780] 2023-10-03T19:21:11.110 INFO:teuthology.orchestra.run.smithi045.stdout: -4037> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5949 cv=5377/5377 ap=27+26 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=287 | child=1 dirty=1 authpin=1 0x565534f82400] version 5949 2023-10-03T19:21:11.110 INFO:teuthology.orchestra.run.smithi045.stdout: -4036> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536348c80 v5958 2023-10-03T19:21:11.110 INFO:teuthology.orchestra.run.smithi045.stdout: -4035> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5958 cv=5384/5384 REP dir_auth=0 ap=26+27 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5958 2023-10-03T19:21:11.110 INFO:teuthology.orchestra.run.smithi045.stdout: -4034> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536348b60 v5951 2023-10-03T19:21:11.110 INFO:teuthology.orchestra.run.smithi045.stdout: -4033> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5951 cv=5377/5377 ap=27+26 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=287 | child=1 dirty=1 authpin=1 0x565534f82400] version 5951 2023-10-03T19:21:11.110 INFO:teuthology.orchestra.run.smithi045.stdout: -4032> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=26 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=26 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:11.110 INFO:teuthology.orchestra.run.smithi045.stdout: -4031> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=26) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5957 pv6007 ap=27 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=27) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=26) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.110 INFO:teuthology.orchestra.run.smithi045.stdout: -4030> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=27) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5957 pv6007 ap=27 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=27) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=25) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.111 INFO:teuthology.orchestra.run.smithi045.stdout: -4029> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005c3 [2,head] /dc-dir/dc-file_974 auth v5950 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.348569+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535723080] 2023-10-03T19:21:11.111 INFO:teuthology.orchestra.run.smithi045.stdout: -4028> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005c3 [2,head] /dc-dir/dc-file_974 auth v5950 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.348569+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535723080] 2023-10-03T19:21:11.111 INFO:teuthology.orchestra.run.smithi045.stdout: -4027> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:11.111 INFO:teuthology.orchestra.run.smithi045.stdout: -4026> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:11.111 INFO:teuthology.orchestra.run.smithi045.stdout: -4025> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:11.111 INFO:teuthology.orchestra.run.smithi045.stdout: -4024> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005c3 [2,head] /dc-dir/dc-file_974 auth v5950 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.348569+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535723080] 2023-10-03T19:21:11.111 INFO:teuthology.orchestra.run.smithi045.stdout: -4023> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005c3 [2,head] /dc-dir/dc-file_974 auth v5950 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.348569+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535723080] 2023-10-03T19:21:11.111 INFO:teuthology.orchestra.run.smithi045.stdout: -4022> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:11.111 INFO:teuthology.orchestra.run.smithi045.stdout: -4021> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 700.849, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 7.01e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1404.5] 2023-10-03T19:21:11.111 INFO:teuthology.orchestra.run.smithi045.stdout: -4020> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536350d80 on [dir 0x1 / [2,head] auth pv=6008 v=5958 cv=5384/5384 REP dir_auth=0 ap=25+27 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 25 2023-10-03T19:21:11.111 INFO:teuthology.orchestra.run.smithi045.stdout: -4019> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536350d80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5957 pv6007 ap=26 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=26) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=25) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 26 2023-10-03T19:21:11.112 INFO:teuthology.orchestra.run.smithi045.stdout: -4018> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5958 cv=5384/5384 REP dir_auth=0 ap=25+26 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536350d80 count now 25/26 2023-10-03T19:21:11.112 INFO:teuthology.orchestra.run.smithi045.stdout: -4017> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536350d80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5951 cv=5377/5377 ap=26+26 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=287 | child=1 dirty=1 authpin=1 0x565534f82400] count now 26 2023-10-03T19:21:11.112 INFO:teuthology.orchestra.run.smithi045.stdout: -4016> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005c3) auth_unpin by 0x565536350d80 on [inode 0x100000005c3 [2,head] /dc-dir/dc-file_974 auth v5950 s=3 n(v0 rc2023-10-03T19:17:10.348569+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535723080] now 0 2023-10-03T19:21:11.112 INFO:teuthology.orchestra.run.smithi045.stdout: -4015> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5951 cv=5377/5377 ap=26+25 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=287 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536350d80 count now 26/25 2023-10-03T19:21:11.112 INFO:teuthology.orchestra.run.smithi045.stdout: -4014> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.112 INFO:teuthology.orchestra.run.smithi045.stdout: -4013> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.112 INFO:teuthology.orchestra.run.smithi045.stdout: -4012> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005c4 [2,head] /dc-dir/dc-file_975 auth v4990 pv5952 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.361029+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.361029+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535723600] 2023-10-03T19:21:11.112 INFO:teuthology.orchestra.run.smithi045.stdout: -4011> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5959 2023-10-03T19:21:11.112 INFO:teuthology.orchestra.run.smithi045.stdout: -4010> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5959 pv6007 ap=26 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=26) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=25) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.112 INFO:teuthology.orchestra.run.smithi045.stdout: -4009> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5957 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:11.113 INFO:teuthology.orchestra.run.smithi045.stdout: -4008> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5958 cv=5384/5384 REP dir_auth=0 ap=25+26 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5958 2023-10-03T19:21:11.113 INFO:teuthology.orchestra.run.smithi045.stdout: -4007> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005c4) pop_and_dirty_projected_inode v5952 2023-10-03T19:21:11.113 INFO:teuthology.orchestra.run.smithi045.stdout: -4006> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005c4) mark_dirty [inode 0x100000005c4 [2,head] /dc-dir/dc-file_975 auth v5952 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.361029+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535723600] 2023-10-03T19:21:11.113 INFO:teuthology.orchestra.run.smithi045.stdout: -4005> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_975) mark_dirty [dentry #0x1/dc-dir/dc-file_975 [2,head] auth (dversion lock) pv=5952 v=4990 ino=0x100000005c4 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553505aa00] 2023-10-03T19:21:11.113 INFO:teuthology.orchestra.run.smithi045.stdout: -4004> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5951 cv=5377/5377 ap=26+25 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=288 | child=1 dirty=1 authpin=1 0x565534f82400] version 5951 2023-10-03T19:21:11.113 INFO:teuthology.orchestra.run.smithi045.stdout: -4003> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536348ec0 v5960 2023-10-03T19:21:11.113 INFO:teuthology.orchestra.run.smithi045.stdout: -4002> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5960 cv=5384/5384 REP dir_auth=0 ap=25+26 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5960 2023-10-03T19:21:11.113 INFO:teuthology.orchestra.run.smithi045.stdout: -4001> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536348da0 v5953 2023-10-03T19:21:11.113 INFO:teuthology.orchestra.run.smithi045.stdout: -4000> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5953 cv=5377/5377 ap=26+25 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=288 | child=1 dirty=1 authpin=1 0x565534f82400] version 5953 2023-10-03T19:21:11.113 INFO:teuthology.orchestra.run.smithi045.stdout: -3999> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=25 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=25 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:11.114 INFO:teuthology.orchestra.run.smithi045.stdout: -3998> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=25) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5959 pv6007 ap=26 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=26) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=25) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.167 INFO:teuthology.orchestra.run.smithi045.stdout: -3997> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=26) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5959 pv6007 ap=26 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=26) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=24) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.168 INFO:teuthology.orchestra.run.smithi045.stdout: -3996> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005c4 [2,head] /dc-dir/dc-file_975 auth v5952 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.361029+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535723600] 2023-10-03T19:21:11.168 INFO:teuthology.orchestra.run.smithi045.stdout: -3995> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005c4 [2,head] /dc-dir/dc-file_975 auth v5952 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.361029+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535723600] 2023-10-03T19:21:11.168 INFO:teuthology.orchestra.run.smithi045.stdout: -3994> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:11.168 INFO:teuthology.orchestra.run.smithi045.stdout: -3993> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:11.168 INFO:teuthology.orchestra.run.smithi045.stdout: -3992> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:11.168 INFO:teuthology.orchestra.run.smithi045.stdout: -3991> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005c4 [2,head] /dc-dir/dc-file_975 auth v5952 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.361029+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535723600] 2023-10-03T19:21:11.168 INFO:teuthology.orchestra.run.smithi045.stdout: -3990> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005c4 [2,head] /dc-dir/dc-file_975 auth v5952 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.361029+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535723600] 2023-10-03T19:21:11.168 INFO:teuthology.orchestra.run.smithi045.stdout: -3989> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:11.168 INFO:teuthology.orchestra.run.smithi045.stdout: -3988> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 701.849, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 7.02e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1406.5] 2023-10-03T19:21:11.168 INFO:teuthology.orchestra.run.smithi045.stdout: -3987> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536351200 on [dir 0x1 / [2,head] auth pv=6008 v=5960 cv=5384/5384 REP dir_auth=0 ap=24+26 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 24 2023-10-03T19:21:11.169 INFO:teuthology.orchestra.run.smithi045.stdout: -3986> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536351200 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5959 pv6007 ap=25 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=25) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=24) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 25 2023-10-03T19:21:11.169 INFO:teuthology.orchestra.run.smithi045.stdout: -3985> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5960 cv=5384/5384 REP dir_auth=0 ap=24+25 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536351200 count now 24/25 2023-10-03T19:21:11.169 INFO:teuthology.orchestra.run.smithi045.stdout: -3984> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536351200 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5953 cv=5377/5377 ap=25+25 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=288 | child=1 dirty=1 authpin=1 0x565534f82400] count now 25 2023-10-03T19:21:11.169 INFO:teuthology.orchestra.run.smithi045.stdout: -3983> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005c4) auth_unpin by 0x565536351200 on [inode 0x100000005c4 [2,head] /dc-dir/dc-file_975 auth v5952 s=3 n(v0 rc2023-10-03T19:17:10.361029+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535723600] now 0 2023-10-03T19:21:11.169 INFO:teuthology.orchestra.run.smithi045.stdout: -3982> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5953 cv=5377/5377 ap=25+24 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=288 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536351200 count now 25/24 2023-10-03T19:21:11.169 INFO:teuthology.orchestra.run.smithi045.stdout: -3981> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.169 INFO:teuthology.orchestra.run.smithi045.stdout: -3980> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.169 INFO:teuthology.orchestra.run.smithi045.stdout: -3979> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005c5 [2,head] /dc-dir/dc-file_976 auth v4994 pv5954 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.374102+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.374102+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535723b80] 2023-10-03T19:21:11.169 INFO:teuthology.orchestra.run.smithi045.stdout: -3978> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5961 2023-10-03T19:21:11.169 INFO:teuthology.orchestra.run.smithi045.stdout: -3977> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5961 pv6007 ap=25 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=25) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=24) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.169 INFO:teuthology.orchestra.run.smithi045.stdout: -3976> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5959 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:11.170 INFO:teuthology.orchestra.run.smithi045.stdout: -3975> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5960 cv=5384/5384 REP dir_auth=0 ap=24+25 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5960 2023-10-03T19:21:11.170 INFO:teuthology.orchestra.run.smithi045.stdout: -3974> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005c5) pop_and_dirty_projected_inode v5954 2023-10-03T19:21:11.170 INFO:teuthology.orchestra.run.smithi045.stdout: -3973> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005c5) mark_dirty [inode 0x100000005c5 [2,head] /dc-dir/dc-file_976 auth v5954 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.374102+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535723b80] 2023-10-03T19:21:11.170 INFO:teuthology.orchestra.run.smithi045.stdout: -3972> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_976) mark_dirty [dentry #0x1/dc-dir/dc-file_976 [2,head] auth (dversion lock) pv=5954 v=4994 ino=0x100000005c5 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553505ac80] 2023-10-03T19:21:11.170 INFO:teuthology.orchestra.run.smithi045.stdout: -3971> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5953 cv=5377/5377 ap=25+24 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=289 | child=1 dirty=1 authpin=1 0x565534f82400] version 5953 2023-10-03T19:21:11.170 INFO:teuthology.orchestra.run.smithi045.stdout: -3970> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536349100 v5962 2023-10-03T19:21:11.170 INFO:teuthology.orchestra.run.smithi045.stdout: -3969> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5962 cv=5384/5384 REP dir_auth=0 ap=24+25 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5962 2023-10-03T19:21:11.170 INFO:teuthology.orchestra.run.smithi045.stdout: -3968> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536348fe0 v5955 2023-10-03T19:21:11.170 INFO:teuthology.orchestra.run.smithi045.stdout: -3967> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5955 cv=5377/5377 ap=25+24 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=289 | child=1 dirty=1 authpin=1 0x565534f82400] version 5955 2023-10-03T19:21:11.170 INFO:teuthology.orchestra.run.smithi045.stdout: -3966> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=24 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=24 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:11.171 INFO:teuthology.orchestra.run.smithi045.stdout: -3965> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=24) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5961 pv6007 ap=25 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=25) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=24) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.171 INFO:teuthology.orchestra.run.smithi045.stdout: -3964> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=25) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5961 pv6007 ap=25 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=25) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=23) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.171 INFO:teuthology.orchestra.run.smithi045.stdout: -3963> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005c5 [2,head] /dc-dir/dc-file_976 auth v5954 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.374102+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535723b80] 2023-10-03T19:21:11.171 INFO:teuthology.orchestra.run.smithi045.stdout: -3962> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005c5 [2,head] /dc-dir/dc-file_976 auth v5954 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.374102+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535723b80] 2023-10-03T19:21:11.171 INFO:teuthology.orchestra.run.smithi045.stdout: -3961> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:11.171 INFO:teuthology.orchestra.run.smithi045.stdout: -3960> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:11.171 INFO:teuthology.orchestra.run.smithi045.stdout: -3959> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:11.171 INFO:teuthology.orchestra.run.smithi045.stdout: -3958> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005c5 [2,head] /dc-dir/dc-file_976 auth v5954 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.374102+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535723b80] 2023-10-03T19:21:11.171 INFO:teuthology.orchestra.run.smithi045.stdout: -3957> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005c5 [2,head] /dc-dir/dc-file_976 auth v5954 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.374102+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535723b80] 2023-10-03T19:21:11.171 INFO:teuthology.orchestra.run.smithi045.stdout: -3956> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:11.171 INFO:teuthology.orchestra.run.smithi045.stdout: -3955> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 702.849, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 7.03e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1408.5] 2023-10-03T19:21:11.172 INFO:teuthology.orchestra.run.smithi045.stdout: -3954> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536351680 on [dir 0x1 / [2,head] auth pv=6008 v=5962 cv=5384/5384 REP dir_auth=0 ap=23+25 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 23 2023-10-03T19:21:11.172 INFO:teuthology.orchestra.run.smithi045.stdout: -3953> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536351680 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5961 pv6007 ap=24 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=24) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=23) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 24 2023-10-03T19:21:11.172 INFO:teuthology.orchestra.run.smithi045.stdout: -3952> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5962 cv=5384/5384 REP dir_auth=0 ap=23+24 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536351680 count now 23/24 2023-10-03T19:21:11.172 INFO:teuthology.orchestra.run.smithi045.stdout: -3951> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536351680 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5955 cv=5377/5377 ap=24+24 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=289 | child=1 dirty=1 authpin=1 0x565534f82400] count now 24 2023-10-03T19:21:11.172 INFO:teuthology.orchestra.run.smithi045.stdout: -3950> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005c5) auth_unpin by 0x565536351680 on [inode 0x100000005c5 [2,head] /dc-dir/dc-file_976 auth v5954 s=3 n(v0 rc2023-10-03T19:17:10.374102+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535723b80] now 0 2023-10-03T19:21:11.172 INFO:teuthology.orchestra.run.smithi045.stdout: -3949> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5955 cv=5377/5377 ap=24+23 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=289 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536351680 count now 24/23 2023-10-03T19:21:11.172 INFO:teuthology.orchestra.run.smithi045.stdout: -3948> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.172 INFO:teuthology.orchestra.run.smithi045.stdout: -3947> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.172 INFO:teuthology.orchestra.run.smithi045.stdout: -3946> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005c6 [2,head] /dc-dir/dc-file_977 auth v4998 pv5956 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.386016+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.386016+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535724100] 2023-10-03T19:21:11.172 INFO:teuthology.orchestra.run.smithi045.stdout: -3945> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5963 2023-10-03T19:21:11.172 INFO:teuthology.orchestra.run.smithi045.stdout: -3944> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5963 pv6007 ap=24 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=24) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=23) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.172 INFO:teuthology.orchestra.run.smithi045.stdout: -3943> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5961 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:11.173 INFO:teuthology.orchestra.run.smithi045.stdout: -3942> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5962 cv=5384/5384 REP dir_auth=0 ap=23+24 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5962 2023-10-03T19:21:11.173 INFO:teuthology.orchestra.run.smithi045.stdout: -3941> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005c6) pop_and_dirty_projected_inode v5956 2023-10-03T19:21:11.251 INFO:teuthology.orchestra.run.smithi045.stdout: -3940> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005c6) mark_dirty [inode 0x100000005c6 [2,head] /dc-dir/dc-file_977 auth v5956 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.386016+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535724100] 2023-10-03T19:21:11.251 INFO:teuthology.orchestra.run.smithi045.stdout: -3939> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_977) mark_dirty [dentry #0x1/dc-dir/dc-file_977 [2,head] auth (dversion lock) pv=5956 v=4998 ino=0x100000005c6 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553505af00] 2023-10-03T19:21:11.251 INFO:teuthology.orchestra.run.smithi045.stdout: -3938> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5955 cv=5377/5377 ap=24+23 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=290 | child=1 dirty=1 authpin=1 0x565534f82400] version 5955 2023-10-03T19:21:11.251 INFO:teuthology.orchestra.run.smithi045.stdout: -3937> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536349340 v5964 2023-10-03T19:21:11.252 INFO:teuthology.orchestra.run.smithi045.stdout: -3936> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5964 cv=5384/5384 REP dir_auth=0 ap=23+24 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5964 2023-10-03T19:21:11.252 INFO:teuthology.orchestra.run.smithi045.stdout: -3935> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536349220 v5957 2023-10-03T19:21:11.252 INFO:teuthology.orchestra.run.smithi045.stdout: -3934> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5957 cv=5377/5377 ap=24+23 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=290 | child=1 dirty=1 authpin=1 0x565534f82400] version 5957 2023-10-03T19:21:11.252 INFO:teuthology.orchestra.run.smithi045.stdout: -3933> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=23 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=23 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:11.252 INFO:teuthology.orchestra.run.smithi045.stdout: -3932> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=23) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5963 pv6007 ap=24 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=24) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=23) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.252 INFO:teuthology.orchestra.run.smithi045.stdout: -3931> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=24) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5963 pv6007 ap=24 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=24) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=22) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.252 INFO:teuthology.orchestra.run.smithi045.stdout: -3930> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005c6 [2,head] /dc-dir/dc-file_977 auth v5956 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.386016+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535724100] 2023-10-03T19:21:11.252 INFO:teuthology.orchestra.run.smithi045.stdout: -3929> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005c6 [2,head] /dc-dir/dc-file_977 auth v5956 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.386016+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535724100] 2023-10-03T19:21:11.252 INFO:teuthology.orchestra.run.smithi045.stdout: -3928> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:11.252 INFO:teuthology.orchestra.run.smithi045.stdout: -3927> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:11.252 INFO:teuthology.orchestra.run.smithi045.stdout: -3926> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:11.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3925> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005c6 [2,head] /dc-dir/dc-file_977 auth v5956 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.386016+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535724100] 2023-10-03T19:21:11.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3924> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005c6 [2,head] /dc-dir/dc-file_977 auth v5956 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.386016+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535724100] 2023-10-03T19:21:11.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3923> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:11.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3922> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 703.849, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 7.04e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1410.5] 2023-10-03T19:21:11.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3921> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536351b00 on [dir 0x1 / [2,head] auth pv=6008 v=5964 cv=5384/5384 REP dir_auth=0 ap=22+24 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 22 2023-10-03T19:21:11.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3920> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536351b00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5963 pv6007 ap=23 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=23) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=22) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 23 2023-10-03T19:21:11.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3919> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5964 cv=5384/5384 REP dir_auth=0 ap=22+23 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536351b00 count now 22/23 2023-10-03T19:21:11.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3918> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536351b00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5957 cv=5377/5377 ap=23+23 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=290 | child=1 dirty=1 authpin=1 0x565534f82400] count now 23 2023-10-03T19:21:11.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3917> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005c6) auth_unpin by 0x565536351b00 on [inode 0x100000005c6 [2,head] /dc-dir/dc-file_977 auth v5956 s=3 n(v0 rc2023-10-03T19:17:10.386016+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535724100] now 0 2023-10-03T19:21:11.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3916> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5957 cv=5377/5377 ap=23+22 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=290 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536351b00 count now 23/22 2023-10-03T19:21:11.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3915> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3914> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3913> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005c7 [2,head] /dc-dir/dc-file_978 auth v5002 pv5958 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.397595+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.397595+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535724680] 2023-10-03T19:21:11.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3912> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5965 2023-10-03T19:21:11.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3911> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5965 pv6007 ap=23 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=23) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=22) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3910> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5963 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:11.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3909> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5964 cv=5384/5384 REP dir_auth=0 ap=22+23 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5964 2023-10-03T19:21:11.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3908> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005c7) pop_and_dirty_projected_inode v5958 2023-10-03T19:21:11.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3907> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005c7) mark_dirty [inode 0x100000005c7 [2,head] /dc-dir/dc-file_978 auth v5958 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.397595+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535724680] 2023-10-03T19:21:11.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3906> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_978) mark_dirty [dentry #0x1/dc-dir/dc-file_978 [2,head] auth (dversion lock) pv=5958 v=5002 ino=0x100000005c7 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553505b180] 2023-10-03T19:21:11.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3905> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5957 cv=5377/5377 ap=23+22 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=291 | child=1 dirty=1 authpin=1 0x565534f82400] version 5957 2023-10-03T19:21:11.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3904> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536349580 v5966 2023-10-03T19:21:11.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3903> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5966 cv=5384/5384 REP dir_auth=0 ap=22+23 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5966 2023-10-03T19:21:11.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3902> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536349460 v5959 2023-10-03T19:21:11.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3901> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5959 cv=5377/5377 ap=23+22 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=291 | child=1 dirty=1 authpin=1 0x565534f82400] version 5959 2023-10-03T19:21:11.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3900> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=22 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=22 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:11.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3899> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=22) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5965 pv6007 ap=23 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=23) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=22) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3898> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=23) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5965 pv6007 ap=23 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=23) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=21) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3897> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005c7 [2,head] /dc-dir/dc-file_978 auth v5958 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.397595+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535724680] 2023-10-03T19:21:11.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3896> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005c7 [2,head] /dc-dir/dc-file_978 auth v5958 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.397595+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535724680] 2023-10-03T19:21:11.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3895> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:11.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3894> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:11.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3893> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:11.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3892> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005c7 [2,head] /dc-dir/dc-file_978 auth v5958 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.397595+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535724680] 2023-10-03T19:21:11.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3891> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005c7 [2,head] /dc-dir/dc-file_978 auth v5958 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.397595+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535724680] 2023-10-03T19:21:11.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3890> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:11.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3889> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 704.849, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 7.05e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1412.5] 2023-10-03T19:21:11.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3888> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536936000 on [dir 0x1 / [2,head] auth pv=6008 v=5966 cv=5384/5384 REP dir_auth=0 ap=21+23 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 21 2023-10-03T19:21:11.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3887> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536936000 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5965 pv6007 ap=22 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=22) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=21) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 22 2023-10-03T19:21:11.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3886> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5966 cv=5384/5384 REP dir_auth=0 ap=21+22 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536936000 count now 21/22 2023-10-03T19:21:11.257 INFO:teuthology.orchestra.run.smithi045.stdout: -3885> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536936000 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5959 cv=5377/5377 ap=22+22 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=291 | child=1 dirty=1 authpin=1 0x565534f82400] count now 22 2023-10-03T19:21:11.305 INFO:teuthology.orchestra.run.smithi045.stdout: -3884> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005c7) auth_unpin by 0x565536936000 on [inode 0x100000005c7 [2,head] /dc-dir/dc-file_978 auth v5958 s=3 n(v0 rc2023-10-03T19:17:10.397595+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535724680] now 0 2023-10-03T19:21:11.305 INFO:teuthology.orchestra.run.smithi045.stdout: -3883> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5959 cv=5377/5377 ap=22+21 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=291 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536936000 count now 22/21 2023-10-03T19:21:11.305 INFO:teuthology.orchestra.run.smithi045.stdout: -3882> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.305 INFO:teuthology.orchestra.run.smithi045.stdout: -3881> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.305 INFO:teuthology.orchestra.run.smithi045.stdout: -3880> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005c8 [2,head] /dc-dir/dc-file_979 auth v5006 pv5960 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.409584+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.409584+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535724c00] 2023-10-03T19:21:11.305 INFO:teuthology.orchestra.run.smithi045.stdout: -3879> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5967 2023-10-03T19:21:11.305 INFO:teuthology.orchestra.run.smithi045.stdout: -3878> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5967 pv6007 ap=22 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=22) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=21) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.305 INFO:teuthology.orchestra.run.smithi045.stdout: -3877> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5965 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:11.305 INFO:teuthology.orchestra.run.smithi045.stdout: -3876> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5966 cv=5384/5384 REP dir_auth=0 ap=21+22 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5966 2023-10-03T19:21:11.305 INFO:teuthology.orchestra.run.smithi045.stdout: -3875> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005c8) pop_and_dirty_projected_inode v5960 2023-10-03T19:21:11.306 INFO:teuthology.orchestra.run.smithi045.stdout: -3874> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005c8) mark_dirty [inode 0x100000005c8 [2,head] /dc-dir/dc-file_979 auth v5960 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.409584+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535724c00] 2023-10-03T19:21:11.306 INFO:teuthology.orchestra.run.smithi045.stdout: -3873> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_979) mark_dirty [dentry #0x1/dc-dir/dc-file_979 [2,head] auth (dversion lock) pv=5960 v=5006 ino=0x100000005c8 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553505b400] 2023-10-03T19:21:11.306 INFO:teuthology.orchestra.run.smithi045.stdout: -3872> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5959 cv=5377/5377 ap=22+21 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=292 | child=1 dirty=1 authpin=1 0x565534f82400] version 5959 2023-10-03T19:21:11.306 INFO:teuthology.orchestra.run.smithi045.stdout: -3871> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x5655363497c0 v5968 2023-10-03T19:21:11.306 INFO:teuthology.orchestra.run.smithi045.stdout: -3870> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5968 cv=5384/5384 REP dir_auth=0 ap=21+22 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5968 2023-10-03T19:21:11.306 INFO:teuthology.orchestra.run.smithi045.stdout: -3869> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655363496a0 v5961 2023-10-03T19:21:11.306 INFO:teuthology.orchestra.run.smithi045.stdout: -3868> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5961 cv=5377/5377 ap=22+21 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=292 | child=1 dirty=1 authpin=1 0x565534f82400] version 5961 2023-10-03T19:21:11.306 INFO:teuthology.orchestra.run.smithi045.stdout: -3867> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=21 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=21 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:11.306 INFO:teuthology.orchestra.run.smithi045.stdout: -3866> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=21) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5967 pv6007 ap=22 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=22) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=21) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.307 INFO:teuthology.orchestra.run.smithi045.stdout: -3865> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=22) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5967 pv6007 ap=22 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=22) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=20) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.307 INFO:teuthology.orchestra.run.smithi045.stdout: -3864> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005c8 [2,head] /dc-dir/dc-file_979 auth v5960 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.409584+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535724c00] 2023-10-03T19:21:11.307 INFO:teuthology.orchestra.run.smithi045.stdout: -3863> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005c8 [2,head] /dc-dir/dc-file_979 auth v5960 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.409584+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535724c00] 2023-10-03T19:21:11.307 INFO:teuthology.orchestra.run.smithi045.stdout: -3862> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:11.307 INFO:teuthology.orchestra.run.smithi045.stdout: -3861> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:11.307 INFO:teuthology.orchestra.run.smithi045.stdout: -3860> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:11.307 INFO:teuthology.orchestra.run.smithi045.stdout: -3859> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005c8 [2,head] /dc-dir/dc-file_979 auth v5960 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.409584+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535724c00] 2023-10-03T19:21:11.307 INFO:teuthology.orchestra.run.smithi045.stdout: -3858> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005c8 [2,head] /dc-dir/dc-file_979 auth v5960 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.409584+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535724c00] 2023-10-03T19:21:11.307 INFO:teuthology.orchestra.run.smithi045.stdout: -3857> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:11.307 INFO:teuthology.orchestra.run.smithi045.stdout: -3856> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 705.849, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 7.06e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1414.5] 2023-10-03T19:21:11.307 INFO:teuthology.orchestra.run.smithi045.stdout: -3855> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536936480 on [dir 0x1 / [2,head] auth pv=6008 v=5968 cv=5384/5384 REP dir_auth=0 ap=20+22 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 20 2023-10-03T19:21:11.307 INFO:teuthology.orchestra.run.smithi045.stdout: -3854> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536936480 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5967 pv6007 ap=21 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=21) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=20) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 21 2023-10-03T19:21:11.308 INFO:teuthology.orchestra.run.smithi045.stdout: -3853> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5968 cv=5384/5384 REP dir_auth=0 ap=20+21 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536936480 count now 20/21 2023-10-03T19:21:11.308 INFO:teuthology.orchestra.run.smithi045.stdout: -3852> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536936480 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5961 cv=5377/5377 ap=21+21 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=292 | child=1 dirty=1 authpin=1 0x565534f82400] count now 21 2023-10-03T19:21:11.308 INFO:teuthology.orchestra.run.smithi045.stdout: -3851> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005c8) auth_unpin by 0x565536936480 on [inode 0x100000005c8 [2,head] /dc-dir/dc-file_979 auth v5960 s=3 n(v0 rc2023-10-03T19:17:10.409584+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535724c00] now 0 2023-10-03T19:21:11.308 INFO:teuthology.orchestra.run.smithi045.stdout: -3850> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5961 cv=5377/5377 ap=21+20 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=292 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536936480 count now 21/20 2023-10-03T19:21:11.308 INFO:teuthology.orchestra.run.smithi045.stdout: -3849> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.308 INFO:teuthology.orchestra.run.smithi045.stdout: -3848> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.308 INFO:teuthology.orchestra.run.smithi045.stdout: -3847> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005c9 [2,head] /dc-dir/dc-file_980 auth v5010 pv5962 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.421406+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.421406+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535725180] 2023-10-03T19:21:11.308 INFO:teuthology.orchestra.run.smithi045.stdout: -3846> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5969 2023-10-03T19:21:11.308 INFO:teuthology.orchestra.run.smithi045.stdout: -3845> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5969 pv6007 ap=21 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=21) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=20) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.309 INFO:teuthology.orchestra.run.smithi045.stdout: -3844> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5967 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:11.309 INFO:teuthology.orchestra.run.smithi045.stdout: -3843> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5968 cv=5384/5384 REP dir_auth=0 ap=20+21 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5968 2023-10-03T19:21:11.309 INFO:teuthology.orchestra.run.smithi045.stdout: -3842> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005c9) pop_and_dirty_projected_inode v5962 2023-10-03T19:21:11.309 INFO:teuthology.orchestra.run.smithi045.stdout: -3841> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005c9) mark_dirty [inode 0x100000005c9 [2,head] /dc-dir/dc-file_980 auth v5962 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.421406+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535725180] 2023-10-03T19:21:11.309 INFO:teuthology.orchestra.run.smithi045.stdout: -3840> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_980) mark_dirty [dentry #0x1/dc-dir/dc-file_980 [2,head] auth (dversion lock) pv=5962 v=5010 ino=0x100000005c9 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553505b680] 2023-10-03T19:21:11.309 INFO:teuthology.orchestra.run.smithi045.stdout: -3839> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5961 cv=5377/5377 ap=21+20 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=293 | child=1 dirty=1 authpin=1 0x565534f82400] version 5961 2023-10-03T19:21:11.309 INFO:teuthology.orchestra.run.smithi045.stdout: -3838> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536349a00 v5970 2023-10-03T19:21:11.309 INFO:teuthology.orchestra.run.smithi045.stdout: -3837> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5970 cv=5384/5384 REP dir_auth=0 ap=20+21 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5970 2023-10-03T19:21:11.309 INFO:teuthology.orchestra.run.smithi045.stdout: -3836> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655363498e0 v5963 2023-10-03T19:21:11.309 INFO:teuthology.orchestra.run.smithi045.stdout: -3835> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5963 cv=5377/5377 ap=21+20 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=293 | child=1 dirty=1 authpin=1 0x565534f82400] version 5963 2023-10-03T19:21:11.309 INFO:teuthology.orchestra.run.smithi045.stdout: -3834> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=20 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=20 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:11.310 INFO:teuthology.orchestra.run.smithi045.stdout: -3833> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=20) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5969 pv6007 ap=21 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=21) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=20) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.310 INFO:teuthology.orchestra.run.smithi045.stdout: -3832> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=21) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5969 pv6007 ap=21 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=21) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=19) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.310 INFO:teuthology.orchestra.run.smithi045.stdout: -3831> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005c9 [2,head] /dc-dir/dc-file_980 auth v5962 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.421406+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535725180] 2023-10-03T19:21:11.310 INFO:teuthology.orchestra.run.smithi045.stdout: -3830> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005c9 [2,head] /dc-dir/dc-file_980 auth v5962 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.421406+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535725180] 2023-10-03T19:21:11.310 INFO:teuthology.orchestra.run.smithi045.stdout: -3829> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:11.360 INFO:teuthology.orchestra.run.smithi045.stdout: -3828> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:11.360 INFO:teuthology.orchestra.run.smithi045.stdout: -3827> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:11.360 INFO:teuthology.orchestra.run.smithi045.stdout: -3826> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005c9 [2,head] /dc-dir/dc-file_980 auth v5962 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.421406+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535725180] 2023-10-03T19:21:11.360 INFO:teuthology.orchestra.run.smithi045.stdout: -3825> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005c9 [2,head] /dc-dir/dc-file_980 auth v5962 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.421406+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535725180] 2023-10-03T19:21:11.360 INFO:teuthology.orchestra.run.smithi045.stdout: -3824> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:11.360 INFO:teuthology.orchestra.run.smithi045.stdout: -3823> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 706.849, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 7.07e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1416.5] 2023-10-03T19:21:11.360 INFO:teuthology.orchestra.run.smithi045.stdout: -3822> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536936900 on [dir 0x1 / [2,head] auth pv=6008 v=5970 cv=5384/5384 REP dir_auth=0 ap=19+21 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 19 2023-10-03T19:21:11.360 INFO:teuthology.orchestra.run.smithi045.stdout: -3821> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536936900 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5969 pv6007 ap=20 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=20) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=19) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 20 2023-10-03T19:21:11.360 INFO:teuthology.orchestra.run.smithi045.stdout: -3820> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5970 cv=5384/5384 REP dir_auth=0 ap=19+20 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536936900 count now 19/20 2023-10-03T19:21:11.360 INFO:teuthology.orchestra.run.smithi045.stdout: -3819> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536936900 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5963 cv=5377/5377 ap=20+20 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=293 | child=1 dirty=1 authpin=1 0x565534f82400] count now 20 2023-10-03T19:21:11.361 INFO:teuthology.orchestra.run.smithi045.stdout: -3818> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005c9) auth_unpin by 0x565536936900 on [inode 0x100000005c9 [2,head] /dc-dir/dc-file_980 auth v5962 s=3 n(v0 rc2023-10-03T19:17:10.421406+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535725180] now 0 2023-10-03T19:21:11.361 INFO:teuthology.orchestra.run.smithi045.stdout: -3817> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5963 cv=5377/5377 ap=20+19 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=293 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536936900 count now 20/19 2023-10-03T19:21:11.361 INFO:teuthology.orchestra.run.smithi045.stdout: -3816> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.361 INFO:teuthology.orchestra.run.smithi045.stdout: -3815> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.361 INFO:teuthology.orchestra.run.smithi045.stdout: -3814> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005ca [2,head] /dc-dir/dc-file_981 auth v5014 pv5964 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.433039+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.433039+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535725700] 2023-10-03T19:21:11.361 INFO:teuthology.orchestra.run.smithi045.stdout: -3813> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5971 2023-10-03T19:21:11.361 INFO:teuthology.orchestra.run.smithi045.stdout: -3812> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5971 pv6007 ap=20 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=20) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=19) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.361 INFO:teuthology.orchestra.run.smithi045.stdout: -3811> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5969 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:11.361 INFO:teuthology.orchestra.run.smithi045.stdout: -3810> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5970 cv=5384/5384 REP dir_auth=0 ap=19+20 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5970 2023-10-03T19:21:11.361 INFO:teuthology.orchestra.run.smithi045.stdout: -3809> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005ca) pop_and_dirty_projected_inode v5964 2023-10-03T19:21:11.361 INFO:teuthology.orchestra.run.smithi045.stdout: -3808> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005ca) mark_dirty [inode 0x100000005ca [2,head] /dc-dir/dc-file_981 auth v5964 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.433039+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535725700] 2023-10-03T19:21:11.362 INFO:teuthology.orchestra.run.smithi045.stdout: -3807> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_981) mark_dirty [dentry #0x1/dc-dir/dc-file_981 [2,head] auth (dversion lock) pv=5964 v=5014 ino=0x100000005ca state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553505b900] 2023-10-03T19:21:11.362 INFO:teuthology.orchestra.run.smithi045.stdout: -3806> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5963 cv=5377/5377 ap=20+19 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=294 | child=1 dirty=1 authpin=1 0x565534f82400] version 5963 2023-10-03T19:21:11.362 INFO:teuthology.orchestra.run.smithi045.stdout: -3805> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536349c40 v5972 2023-10-03T19:21:11.362 INFO:teuthology.orchestra.run.smithi045.stdout: -3804> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5972 cv=5384/5384 REP dir_auth=0 ap=19+20 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5972 2023-10-03T19:21:11.362 INFO:teuthology.orchestra.run.smithi045.stdout: -3803> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536349b20 v5965 2023-10-03T19:21:11.362 INFO:teuthology.orchestra.run.smithi045.stdout: -3802> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5965 cv=5377/5377 ap=20+19 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=294 | child=1 dirty=1 authpin=1 0x565534f82400] version 5965 2023-10-03T19:21:11.362 INFO:teuthology.orchestra.run.smithi045.stdout: -3801> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=19 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=19 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:11.362 INFO:teuthology.orchestra.run.smithi045.stdout: -3800> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=19) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5971 pv6007 ap=20 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=20) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=19) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.362 INFO:teuthology.orchestra.run.smithi045.stdout: -3799> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=20) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5971 pv6007 ap=20 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=20) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=18) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.363 INFO:teuthology.orchestra.run.smithi045.stdout: -3798> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005ca [2,head] /dc-dir/dc-file_981 auth v5964 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.433039+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535725700] 2023-10-03T19:21:11.363 INFO:teuthology.orchestra.run.smithi045.stdout: -3797> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005ca [2,head] /dc-dir/dc-file_981 auth v5964 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.433039+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535725700] 2023-10-03T19:21:11.363 INFO:teuthology.orchestra.run.smithi045.stdout: -3796> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:11.363 INFO:teuthology.orchestra.run.smithi045.stdout: -3795> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:11.363 INFO:teuthology.orchestra.run.smithi045.stdout: -3794> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:11.363 INFO:teuthology.orchestra.run.smithi045.stdout: -3793> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005ca [2,head] /dc-dir/dc-file_981 auth v5964 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.433039+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535725700] 2023-10-03T19:21:11.363 INFO:teuthology.orchestra.run.smithi045.stdout: -3792> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005ca [2,head] /dc-dir/dc-file_981 auth v5964 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.433039+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535725700] 2023-10-03T19:21:11.363 INFO:teuthology.orchestra.run.smithi045.stdout: -3791> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:11.363 INFO:teuthology.orchestra.run.smithi045.stdout: -3790> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 707.849, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 7.08e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1418.5] 2023-10-03T19:21:11.363 INFO:teuthology.orchestra.run.smithi045.stdout: -3789> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536936d80 on [dir 0x1 / [2,head] auth pv=6008 v=5972 cv=5384/5384 REP dir_auth=0 ap=18+20 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 18 2023-10-03T19:21:11.363 INFO:teuthology.orchestra.run.smithi045.stdout: -3788> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536936d80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5971 pv6007 ap=19 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=19) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=18) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 19 2023-10-03T19:21:11.364 INFO:teuthology.orchestra.run.smithi045.stdout: -3787> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5972 cv=5384/5384 REP dir_auth=0 ap=18+19 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536936d80 count now 18/19 2023-10-03T19:21:11.364 INFO:teuthology.orchestra.run.smithi045.stdout: -3786> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536936d80 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5965 cv=5377/5377 ap=19+19 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=294 | child=1 dirty=1 authpin=1 0x565534f82400] count now 19 2023-10-03T19:21:11.364 INFO:teuthology.orchestra.run.smithi045.stdout: -3785> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005ca) auth_unpin by 0x565536936d80 on [inode 0x100000005ca [2,head] /dc-dir/dc-file_981 auth v5964 s=3 n(v0 rc2023-10-03T19:17:10.433039+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535725700] now 0 2023-10-03T19:21:11.364 INFO:teuthology.orchestra.run.smithi045.stdout: -3784> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5965 cv=5377/5377 ap=19+18 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=294 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536936d80 count now 19/18 2023-10-03T19:21:11.364 INFO:teuthology.orchestra.run.smithi045.stdout: -3783> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.364 INFO:teuthology.orchestra.run.smithi045.stdout: -3782> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.364 INFO:teuthology.orchestra.run.smithi045.stdout: -3781> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005cb [2,head] /dc-dir/dc-file_982 auth v5018 pv5966 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.444968+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.444968+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535728000] 2023-10-03T19:21:11.364 INFO:teuthology.orchestra.run.smithi045.stdout: -3780> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5973 2023-10-03T19:21:11.364 INFO:teuthology.orchestra.run.smithi045.stdout: -3779> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5973 pv6007 ap=19 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=19) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=18) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.364 INFO:teuthology.orchestra.run.smithi045.stdout: -3778> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5971 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:11.365 INFO:teuthology.orchestra.run.smithi045.stdout: -3777> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5972 cv=5384/5384 REP dir_auth=0 ap=18+19 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5972 2023-10-03T19:21:11.365 INFO:teuthology.orchestra.run.smithi045.stdout: -3776> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005cb) pop_and_dirty_projected_inode v5966 2023-10-03T19:21:11.365 INFO:teuthology.orchestra.run.smithi045.stdout: -3775> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005cb) mark_dirty [inode 0x100000005cb [2,head] /dc-dir/dc-file_982 auth v5966 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.444968+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535728000] 2023-10-03T19:21:11.365 INFO:teuthology.orchestra.run.smithi045.stdout: -3774> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_982) mark_dirty [dentry #0x1/dc-dir/dc-file_982 [2,head] auth (dversion lock) pv=5966 v=5018 ino=0x100000005cb state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553505bb80] 2023-10-03T19:21:11.365 INFO:teuthology.orchestra.run.smithi045.stdout: -3773> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5965 cv=5377/5377 ap=19+18 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=295 | child=1 dirty=1 authpin=1 0x565534f82400] version 5965 2023-10-03T19:21:11.365 INFO:teuthology.orchestra.run.smithi045.stdout: -3772> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536349e80 v5974 2023-10-03T19:21:11.365 INFO:teuthology.orchestra.run.smithi045.stdout: -3771> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5974 cv=5384/5384 REP dir_auth=0 ap=18+19 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5974 2023-10-03T19:21:11.365 INFO:teuthology.orchestra.run.smithi045.stdout: -3770> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536349d60 v5967 2023-10-03T19:21:11.425 INFO:teuthology.orchestra.run.smithi045.stdout: -3769> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5967 cv=5377/5377 ap=19+18 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=295 | child=1 dirty=1 authpin=1 0x565534f82400] version 5967 2023-10-03T19:21:11.425 INFO:teuthology.orchestra.run.smithi045.stdout: -3768> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=18 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=18 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:11.425 INFO:teuthology.orchestra.run.smithi045.stdout: -3767> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=18) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5973 pv6007 ap=19 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=19) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=18) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.425 INFO:teuthology.orchestra.run.smithi045.stdout: -3766> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=19) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5973 pv6007 ap=19 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=19) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=17) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.425 INFO:teuthology.orchestra.run.smithi045.stdout: -3765> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005cb [2,head] /dc-dir/dc-file_982 auth v5966 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.444968+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535728000] 2023-10-03T19:21:11.425 INFO:teuthology.orchestra.run.smithi045.stdout: -3764> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005cb [2,head] /dc-dir/dc-file_982 auth v5966 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.444968+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535728000] 2023-10-03T19:21:11.425 INFO:teuthology.orchestra.run.smithi045.stdout: -3763> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:11.426 INFO:teuthology.orchestra.run.smithi045.stdout: -3762> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:11.426 INFO:teuthology.orchestra.run.smithi045.stdout: -3761> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:11.426 INFO:teuthology.orchestra.run.smithi045.stdout: -3760> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005cb [2,head] /dc-dir/dc-file_982 auth v5966 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.444968+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535728000] 2023-10-03T19:21:11.426 INFO:teuthology.orchestra.run.smithi045.stdout: -3759> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005cb [2,head] /dc-dir/dc-file_982 auth v5966 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.444968+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535728000] 2023-10-03T19:21:11.426 INFO:teuthology.orchestra.run.smithi045.stdout: -3758> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:11.426 INFO:teuthology.orchestra.run.smithi045.stdout: -3757> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 708.849, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 7.09e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1420.5] 2023-10-03T19:21:11.426 INFO:teuthology.orchestra.run.smithi045.stdout: -3756> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536937200 on [dir 0x1 / [2,head] auth pv=6008 v=5974 cv=5384/5384 REP dir_auth=0 ap=17+19 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 17 2023-10-03T19:21:11.426 INFO:teuthology.orchestra.run.smithi045.stdout: -3755> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536937200 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5973 pv6007 ap=18 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=18) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=17) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 18 2023-10-03T19:21:11.426 INFO:teuthology.orchestra.run.smithi045.stdout: -3754> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5974 cv=5384/5384 REP dir_auth=0 ap=17+18 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536937200 count now 17/18 2023-10-03T19:21:11.427 INFO:teuthology.orchestra.run.smithi045.stdout: -3753> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536937200 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5967 cv=5377/5377 ap=18+18 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=295 | child=1 dirty=1 authpin=1 0x565534f82400] count now 18 2023-10-03T19:21:11.427 INFO:teuthology.orchestra.run.smithi045.stdout: -3752> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005cb) auth_unpin by 0x565536937200 on [inode 0x100000005cb [2,head] /dc-dir/dc-file_982 auth v5966 s=3 n(v0 rc2023-10-03T19:17:10.444968+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535728000] now 0 2023-10-03T19:21:11.427 INFO:teuthology.orchestra.run.smithi045.stdout: -3751> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5967 cv=5377/5377 ap=18+17 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=295 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536937200 count now 18/17 2023-10-03T19:21:11.427 INFO:teuthology.orchestra.run.smithi045.stdout: -3750> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.427 INFO:teuthology.orchestra.run.smithi045.stdout: -3749> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.427 INFO:teuthology.orchestra.run.smithi045.stdout: -3748> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005cc [2,head] /dc-dir/dc-file_983 auth v5022 pv5968 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.456156+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.456156+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535728580] 2023-10-03T19:21:11.427 INFO:teuthology.orchestra.run.smithi045.stdout: -3747> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5975 2023-10-03T19:21:11.427 INFO:teuthology.orchestra.run.smithi045.stdout: -3746> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5975 pv6007 ap=18 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=18) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=17) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.427 INFO:teuthology.orchestra.run.smithi045.stdout: -3745> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5973 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:11.427 INFO:teuthology.orchestra.run.smithi045.stdout: -3744> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5974 cv=5384/5384 REP dir_auth=0 ap=17+18 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5974 2023-10-03T19:21:11.427 INFO:teuthology.orchestra.run.smithi045.stdout: -3743> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005cc) pop_and_dirty_projected_inode v5968 2023-10-03T19:21:11.428 INFO:teuthology.orchestra.run.smithi045.stdout: -3742> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005cc) mark_dirty [inode 0x100000005cc [2,head] /dc-dir/dc-file_983 auth v5968 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.456156+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535728580] 2023-10-03T19:21:11.428 INFO:teuthology.orchestra.run.smithi045.stdout: -3741> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_983) mark_dirty [dentry #0x1/dc-dir/dc-file_983 [2,head] auth (dversion lock) pv=5968 v=5022 ino=0x100000005cc state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553572c000] 2023-10-03T19:21:11.428 INFO:teuthology.orchestra.run.smithi045.stdout: -3740> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5967 cv=5377/5377 ap=18+17 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=296 | child=1 dirty=1 authpin=1 0x565534f82400] version 5967 2023-10-03T19:21:11.428 INFO:teuthology.orchestra.run.smithi045.stdout: -3739> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536290140 v5976 2023-10-03T19:21:11.428 INFO:teuthology.orchestra.run.smithi045.stdout: -3738> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5976 cv=5384/5384 REP dir_auth=0 ap=17+18 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5976 2023-10-03T19:21:11.428 INFO:teuthology.orchestra.run.smithi045.stdout: -3737> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536290020 v5969 2023-10-03T19:21:11.428 INFO:teuthology.orchestra.run.smithi045.stdout: -3736> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5969 cv=5377/5377 ap=18+17 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=296 | child=1 dirty=1 authpin=1 0x565534f82400] version 5969 2023-10-03T19:21:11.428 INFO:teuthology.orchestra.run.smithi045.stdout: -3735> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=17 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=17 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:11.428 INFO:teuthology.orchestra.run.smithi045.stdout: -3734> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=17) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5975 pv6007 ap=18 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=18) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=17) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.428 INFO:teuthology.orchestra.run.smithi045.stdout: -3733> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=18) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5975 pv6007 ap=18 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=18) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=16) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.429 INFO:teuthology.orchestra.run.smithi045.stdout: -3732> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005cc [2,head] /dc-dir/dc-file_983 auth v5968 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.456156+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535728580] 2023-10-03T19:21:11.429 INFO:teuthology.orchestra.run.smithi045.stdout: -3731> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005cc [2,head] /dc-dir/dc-file_983 auth v5968 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.456156+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535728580] 2023-10-03T19:21:11.429 INFO:teuthology.orchestra.run.smithi045.stdout: -3730> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:11.429 INFO:teuthology.orchestra.run.smithi045.stdout: -3729> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:11.429 INFO:teuthology.orchestra.run.smithi045.stdout: -3728> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:11.429 INFO:teuthology.orchestra.run.smithi045.stdout: -3727> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005cc [2,head] /dc-dir/dc-file_983 auth v5968 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.456156+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535728580] 2023-10-03T19:21:11.429 INFO:teuthology.orchestra.run.smithi045.stdout: -3726> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005cc [2,head] /dc-dir/dc-file_983 auth v5968 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.456156+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535728580] 2023-10-03T19:21:11.429 INFO:teuthology.orchestra.run.smithi045.stdout: -3725> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:11.429 INFO:teuthology.orchestra.run.smithi045.stdout: -3724> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 709.849, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 7.10e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1422.5] 2023-10-03T19:21:11.429 INFO:teuthology.orchestra.run.smithi045.stdout: -3723> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536937680 on [dir 0x1 / [2,head] auth pv=6008 v=5976 cv=5384/5384 REP dir_auth=0 ap=16+18 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 16 2023-10-03T19:21:11.429 INFO:teuthology.orchestra.run.smithi045.stdout: -3722> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536937680 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5975 pv6007 ap=17 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=17) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=16) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 17 2023-10-03T19:21:11.430 INFO:teuthology.orchestra.run.smithi045.stdout: -3721> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5976 cv=5384/5384 REP dir_auth=0 ap=16+17 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536937680 count now 16/17 2023-10-03T19:21:11.430 INFO:teuthology.orchestra.run.smithi045.stdout: -3720> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536937680 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5969 cv=5377/5377 ap=17+17 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=296 | child=1 dirty=1 authpin=1 0x565534f82400] count now 17 2023-10-03T19:21:11.430 INFO:teuthology.orchestra.run.smithi045.stdout: -3719> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005cc) auth_unpin by 0x565536937680 on [inode 0x100000005cc [2,head] /dc-dir/dc-file_983 auth v5968 s=3 n(v0 rc2023-10-03T19:17:10.456156+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535728580] now 0 2023-10-03T19:21:11.430 INFO:teuthology.orchestra.run.smithi045.stdout: -3718> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5969 cv=5377/5377 ap=17+16 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=296 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536937680 count now 17/16 2023-10-03T19:21:11.430 INFO:teuthology.orchestra.run.smithi045.stdout: -3717> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.430 INFO:teuthology.orchestra.run.smithi045.stdout: -3716> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.430 INFO:teuthology.orchestra.run.smithi045.stdout: -3715> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005cd [2,head] /dc-dir/dc-file_984 auth v5026 pv5970 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.467616+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.467616+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535728b00] 2023-10-03T19:21:11.430 INFO:teuthology.orchestra.run.smithi045.stdout: -3714> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5977 2023-10-03T19:21:11.754 INFO:teuthology.orchestra.run.smithi045.stdout: -3713> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5977 pv6007 ap=17 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=17) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=16) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.755 INFO:teuthology.orchestra.run.smithi045.stdout: -3712> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5975 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:11.755 INFO:teuthology.orchestra.run.smithi045.stdout: -3711> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5976 cv=5384/5384 REP dir_auth=0 ap=16+17 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5976 2023-10-03T19:21:11.755 INFO:teuthology.orchestra.run.smithi045.stdout: -3710> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005cd) pop_and_dirty_projected_inode v5970 2023-10-03T19:21:11.755 INFO:teuthology.orchestra.run.smithi045.stdout: -3709> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005cd) mark_dirty [inode 0x100000005cd [2,head] /dc-dir/dc-file_984 auth v5970 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.467616+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535728b00] 2023-10-03T19:21:11.755 INFO:teuthology.orchestra.run.smithi045.stdout: -3708> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_984) mark_dirty [dentry #0x1/dc-dir/dc-file_984 [2,head] auth (dversion lock) pv=5970 v=5026 ino=0x100000005cd state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553572c280] 2023-10-03T19:21:11.755 INFO:teuthology.orchestra.run.smithi045.stdout: -3707> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5969 cv=5377/5377 ap=17+16 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=297 | child=1 dirty=1 authpin=1 0x565534f82400] version 5969 2023-10-03T19:21:11.755 INFO:teuthology.orchestra.run.smithi045.stdout: -3706> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536290380 v5978 2023-10-03T19:21:11.755 INFO:teuthology.orchestra.run.smithi045.stdout: -3705> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5978 cv=5384/5384 REP dir_auth=0 ap=16+17 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5978 2023-10-03T19:21:11.755 INFO:teuthology.orchestra.run.smithi045.stdout: -3704> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536290260 v5971 2023-10-03T19:21:11.756 INFO:teuthology.orchestra.run.smithi045.stdout: -3703> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5971 cv=5377/5377 ap=17+16 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=297 | child=1 dirty=1 authpin=1 0x565534f82400] version 5971 2023-10-03T19:21:11.756 INFO:teuthology.orchestra.run.smithi045.stdout: -3702> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=16 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=16 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:11.756 INFO:teuthology.orchestra.run.smithi045.stdout: -3701> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=16) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5977 pv6007 ap=17 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=17) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=16) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.756 INFO:teuthology.orchestra.run.smithi045.stdout: -3700> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=17) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5977 pv6007 ap=17 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=17) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=15) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.756 INFO:teuthology.orchestra.run.smithi045.stdout: -3699> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005cd [2,head] /dc-dir/dc-file_984 auth v5970 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.467616+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535728b00] 2023-10-03T19:21:11.756 INFO:teuthology.orchestra.run.smithi045.stdout: -3698> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005cd [2,head] /dc-dir/dc-file_984 auth v5970 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.467616+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535728b00] 2023-10-03T19:21:11.756 INFO:teuthology.orchestra.run.smithi045.stdout: -3697> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:11.756 INFO:teuthology.orchestra.run.smithi045.stdout: -3696> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:11.756 INFO:teuthology.orchestra.run.smithi045.stdout: -3695> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:11.756 INFO:teuthology.orchestra.run.smithi045.stdout: -3694> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005cd [2,head] /dc-dir/dc-file_984 auth v5970 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.467616+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535728b00] 2023-10-03T19:21:11.757 INFO:teuthology.orchestra.run.smithi045.stdout: -3693> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005cd [2,head] /dc-dir/dc-file_984 auth v5970 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.467616+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535728b00] 2023-10-03T19:21:11.757 INFO:teuthology.orchestra.run.smithi045.stdout: -3692> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:11.757 INFO:teuthology.orchestra.run.smithi045.stdout: -3691> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 710.849, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 7.11e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1424.5] 2023-10-03T19:21:11.757 INFO:teuthology.orchestra.run.smithi045.stdout: -3690> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536937b00 on [dir 0x1 / [2,head] auth pv=6008 v=5978 cv=5384/5384 REP dir_auth=0 ap=15+17 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 15 2023-10-03T19:21:11.757 INFO:teuthology.orchestra.run.smithi045.stdout: -3689> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536937b00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5977 pv6007 ap=16 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=16) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=15) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 16 2023-10-03T19:21:11.757 INFO:teuthology.orchestra.run.smithi045.stdout: -3688> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5978 cv=5384/5384 REP dir_auth=0 ap=15+16 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536937b00 count now 15/16 2023-10-03T19:21:11.757 INFO:teuthology.orchestra.run.smithi045.stdout: -3687> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536937b00 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5971 cv=5377/5377 ap=16+16 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=297 | child=1 dirty=1 authpin=1 0x565534f82400] count now 16 2023-10-03T19:21:11.758 INFO:teuthology.orchestra.run.smithi045.stdout: -3686> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005cd) auth_unpin by 0x565536937b00 on [inode 0x100000005cd [2,head] /dc-dir/dc-file_984 auth v5970 s=3 n(v0 rc2023-10-03T19:17:10.467616+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535728b00] now 0 2023-10-03T19:21:11.758 INFO:teuthology.orchestra.run.smithi045.stdout: -3685> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5971 cv=5377/5377 ap=16+15 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=297 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536937b00 count now 16/15 2023-10-03T19:21:11.758 INFO:teuthology.orchestra.run.smithi045.stdout: -3684> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.758 INFO:teuthology.orchestra.run.smithi045.stdout: -3683> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.758 INFO:teuthology.orchestra.run.smithi045.stdout: -3682> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005ce [2,head] /dc-dir/dc-file_985 auth v5030 pv5972 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.479893+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.479893+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535729080] 2023-10-03T19:21:11.758 INFO:teuthology.orchestra.run.smithi045.stdout: -3681> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5979 2023-10-03T19:21:11.758 INFO:teuthology.orchestra.run.smithi045.stdout: -3680> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5979 pv6007 ap=16 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=16) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=15) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.758 INFO:teuthology.orchestra.run.smithi045.stdout: -3679> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5977 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:11.758 INFO:teuthology.orchestra.run.smithi045.stdout: -3678> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5978 cv=5384/5384 REP dir_auth=0 ap=15+16 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5978 2023-10-03T19:21:11.759 INFO:teuthology.orchestra.run.smithi045.stdout: -3677> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005ce) pop_and_dirty_projected_inode v5972 2023-10-03T19:21:11.759 INFO:teuthology.orchestra.run.smithi045.stdout: -3676> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005ce) mark_dirty [inode 0x100000005ce [2,head] /dc-dir/dc-file_985 auth v5972 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.479893+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535729080] 2023-10-03T19:21:11.759 INFO:teuthology.orchestra.run.smithi045.stdout: -3675> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_985) mark_dirty [dentry #0x1/dc-dir/dc-file_985 [2,head] auth (dversion lock) pv=5972 v=5030 ino=0x100000005ce state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553572c500] 2023-10-03T19:21:11.759 INFO:teuthology.orchestra.run.smithi045.stdout: -3674> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5971 cv=5377/5377 ap=16+15 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=298 | child=1 dirty=1 authpin=1 0x565534f82400] version 5971 2023-10-03T19:21:11.759 INFO:teuthology.orchestra.run.smithi045.stdout: -3673> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x5655362905c0 v5980 2023-10-03T19:21:11.759 INFO:teuthology.orchestra.run.smithi045.stdout: -3672> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5980 cv=5384/5384 REP dir_auth=0 ap=15+16 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5980 2023-10-03T19:21:11.759 INFO:teuthology.orchestra.run.smithi045.stdout: -3671> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655362904a0 v5973 2023-10-03T19:21:11.759 INFO:teuthology.orchestra.run.smithi045.stdout: -3670> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5973 cv=5377/5377 ap=16+15 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=298 | child=1 dirty=1 authpin=1 0x565534f82400] version 5973 2023-10-03T19:21:11.759 INFO:teuthology.orchestra.run.smithi045.stdout: -3669> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=15 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=15 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:11.760 INFO:teuthology.orchestra.run.smithi045.stdout: -3668> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=15) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5979 pv6007 ap=16 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=16) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=15) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.760 INFO:teuthology.orchestra.run.smithi045.stdout: -3667> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=16) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5979 pv6007 ap=16 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=16) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=14) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.760 INFO:teuthology.orchestra.run.smithi045.stdout: -3666> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005ce [2,head] /dc-dir/dc-file_985 auth v5972 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.479893+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535729080] 2023-10-03T19:21:11.760 INFO:teuthology.orchestra.run.smithi045.stdout: -3665> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005ce [2,head] /dc-dir/dc-file_985 auth v5972 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.479893+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535729080] 2023-10-03T19:21:11.760 INFO:teuthology.orchestra.run.smithi045.stdout: -3664> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:11.760 INFO:teuthology.orchestra.run.smithi045.stdout: -3663> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:11.760 INFO:teuthology.orchestra.run.smithi045.stdout: -3662> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:11.760 INFO:teuthology.orchestra.run.smithi045.stdout: -3661> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005ce [2,head] /dc-dir/dc-file_985 auth v5972 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.479893+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535729080] 2023-10-03T19:21:11.760 INFO:teuthology.orchestra.run.smithi045.stdout: -3660> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005ce [2,head] /dc-dir/dc-file_985 auth v5972 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.479893+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535729080] 2023-10-03T19:21:11.761 INFO:teuthology.orchestra.run.smithi045.stdout: -3659> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:11.835 INFO:teuthology.orchestra.run.smithi045.stdout: -3658> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 711.849, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 7.12e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1426.5] 2023-10-03T19:21:11.835 INFO:teuthology.orchestra.run.smithi045.stdout: -3657> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536936b40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5979 pv6007 ap=15 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=15) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=14) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 15 2023-10-03T19:21:11.836 INFO:teuthology.orchestra.run.smithi045.stdout: -3656> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5980 cv=5384/5384 REP dir_auth=0 ap=15+15 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536936b40 count now 15/15 2023-10-03T19:21:11.836 INFO:teuthology.orchestra.run.smithi045.stdout: -3655> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536936b40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5973 cv=5377/5377 ap=15+15 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=298 | child=1 dirty=1 authpin=1 0x565534f82400] count now 15 2023-10-03T19:21:11.836 INFO:teuthology.orchestra.run.smithi045.stdout: -3654> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536936b40 on [dir 0x1 / [2,head] auth pv=6008 v=5980 cv=5384/5384 REP dir_auth=0 ap=14+15 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 14 2023-10-03T19:21:11.836 INFO:teuthology.orchestra.run.smithi045.stdout: -3653> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005ce) auth_unpin by 0x565536936b40 on [inode 0x100000005ce [2,head] /dc-dir/dc-file_985 auth v5972 s=3 n(v0 rc2023-10-03T19:17:10.479893+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535729080] now 0 2023-10-03T19:21:11.836 INFO:teuthology.orchestra.run.smithi045.stdout: -3652> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5973 cv=5377/5377 ap=15+14 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=298 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536936b40 count now 15/14 2023-10-03T19:21:11.836 INFO:teuthology.orchestra.run.smithi045.stdout: -3651> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.836 INFO:teuthology.orchestra.run.smithi045.stdout: -3650> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.836 INFO:teuthology.orchestra.run.smithi045.stdout: -3649> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005cf [2,head] /dc-dir/dc-file_986 auth v5034 pv5974 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.492206+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.492206+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535729600] 2023-10-03T19:21:11.836 INFO:teuthology.orchestra.run.smithi045.stdout: -3648> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5981 2023-10-03T19:21:11.837 INFO:teuthology.orchestra.run.smithi045.stdout: -3647> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5981 pv6007 ap=15 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=15) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=14) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.837 INFO:teuthology.orchestra.run.smithi045.stdout: -3646> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5979 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:11.837 INFO:teuthology.orchestra.run.smithi045.stdout: -3645> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5980 cv=5384/5384 REP dir_auth=0 ap=14+15 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5980 2023-10-03T19:21:11.837 INFO:teuthology.orchestra.run.smithi045.stdout: -3644> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005cf) pop_and_dirty_projected_inode v5974 2023-10-03T19:21:11.837 INFO:teuthology.orchestra.run.smithi045.stdout: -3643> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005cf) mark_dirty [inode 0x100000005cf [2,head] /dc-dir/dc-file_986 auth v5974 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.492206+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535729600] 2023-10-03T19:21:11.837 INFO:teuthology.orchestra.run.smithi045.stdout: -3642> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_986) mark_dirty [dentry #0x1/dc-dir/dc-file_986 [2,head] auth (dversion lock) pv=5974 v=5034 ino=0x100000005cf state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553572c780] 2023-10-03T19:21:11.837 INFO:teuthology.orchestra.run.smithi045.stdout: -3641> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5973 cv=5377/5377 ap=15+14 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=299 | child=1 dirty=1 authpin=1 0x565534f82400] version 5973 2023-10-03T19:21:11.837 INFO:teuthology.orchestra.run.smithi045.stdout: -3640> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536290800 v5982 2023-10-03T19:21:11.837 INFO:teuthology.orchestra.run.smithi045.stdout: -3639> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5982 cv=5384/5384 REP dir_auth=0 ap=14+15 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5982 2023-10-03T19:21:11.837 INFO:teuthology.orchestra.run.smithi045.stdout: -3638> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655362906e0 v5975 2023-10-03T19:21:11.838 INFO:teuthology.orchestra.run.smithi045.stdout: -3637> 2023-10-03T19:17:19.550+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5975 cv=5377/5377 ap=15+14 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=299 | child=1 dirty=1 authpin=1 0x565534f82400] version 5975 2023-10-03T19:21:11.838 INFO:teuthology.orchestra.run.smithi045.stdout: -3636> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=14 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=14 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:11.838 INFO:teuthology.orchestra.run.smithi045.stdout: -3635> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=14) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5981 pv6007 ap=15 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=15) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=14) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.838 INFO:teuthology.orchestra.run.smithi045.stdout: -3634> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=15) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5981 pv6007 ap=15 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=15) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=13) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.838 INFO:teuthology.orchestra.run.smithi045.stdout: -3633> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005cf [2,head] /dc-dir/dc-file_986 auth v5974 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.492206+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535729600] 2023-10-03T19:21:11.838 INFO:teuthology.orchestra.run.smithi045.stdout: -3632> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005cf [2,head] /dc-dir/dc-file_986 auth v5974 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.492206+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535729600] 2023-10-03T19:21:11.838 INFO:teuthology.orchestra.run.smithi045.stdout: -3631> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:11.838 INFO:teuthology.orchestra.run.smithi045.stdout: -3630> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:11.838 INFO:teuthology.orchestra.run.smithi045.stdout: -3629> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:11.838 INFO:teuthology.orchestra.run.smithi045.stdout: -3628> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005cf [2,head] /dc-dir/dc-file_986 auth v5974 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.492206+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535729600] 2023-10-03T19:21:11.839 INFO:teuthology.orchestra.run.smithi045.stdout: -3627> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005cf [2,head] /dc-dir/dc-file_986 auth v5974 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.492206+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535729600] 2023-10-03T19:21:11.839 INFO:teuthology.orchestra.run.smithi045.stdout: -3626> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:11.839 INFO:teuthology.orchestra.run.smithi045.stdout: -3625> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 712.454, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 7.12e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1427.7] 2023-10-03T19:21:11.839 INFO:teuthology.orchestra.run.smithi045.stdout: -3624> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536936240 on [dir 0x1 / [2,head] auth pv=6008 v=5982 cv=5384/5384 REP dir_auth=0 ap=13+15 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 13 2023-10-03T19:21:11.839 INFO:teuthology.orchestra.run.smithi045.stdout: -3623> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536936240 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5981 pv6007 ap=14 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=14) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=13) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 14 2023-10-03T19:21:11.839 INFO:teuthology.orchestra.run.smithi045.stdout: -3622> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5982 cv=5384/5384 REP dir_auth=0 ap=13+14 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536936240 count now 13/14 2023-10-03T19:21:11.839 INFO:teuthology.orchestra.run.smithi045.stdout: -3621> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536936240 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5975 cv=5377/5377 ap=14+14 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=299 | child=1 dirty=1 authpin=1 0x565534f82400] count now 14 2023-10-03T19:21:11.839 INFO:teuthology.orchestra.run.smithi045.stdout: -3620> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005cf) auth_unpin by 0x565536936240 on [inode 0x100000005cf [2,head] /dc-dir/dc-file_986 auth v5974 s=3 n(v0 rc2023-10-03T19:17:10.492206+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535729600] now 0 2023-10-03T19:21:11.839 INFO:teuthology.orchestra.run.smithi045.stdout: -3619> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5975 cv=5377/5377 ap=14+13 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=299 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536936240 count now 14/13 2023-10-03T19:21:11.840 INFO:teuthology.orchestra.run.smithi045.stdout: -3618> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.840 INFO:teuthology.orchestra.run.smithi045.stdout: -3617> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.840 INFO:teuthology.orchestra.run.smithi045.stdout: -3616> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005d0 [2,head] /dc-dir/dc-file_987 auth v5038 pv5976 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.505312+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.505312+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535729b80] 2023-10-03T19:21:11.840 INFO:teuthology.orchestra.run.smithi045.stdout: -3615> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5983 2023-10-03T19:21:11.840 INFO:teuthology.orchestra.run.smithi045.stdout: -3614> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5983 pv6007 ap=14 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=14) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=13) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.840 INFO:teuthology.orchestra.run.smithi045.stdout: -3613> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5981 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:11.840 INFO:teuthology.orchestra.run.smithi045.stdout: -3612> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5982 cv=5384/5384 REP dir_auth=0 ap=13+14 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5982 2023-10-03T19:21:11.840 INFO:teuthology.orchestra.run.smithi045.stdout: -3611> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005d0) pop_and_dirty_projected_inode v5976 2023-10-03T19:21:11.840 INFO:teuthology.orchestra.run.smithi045.stdout: -3610> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005d0) mark_dirty [inode 0x100000005d0 [2,head] /dc-dir/dc-file_987 auth v5976 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.505312+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535729b80] 2023-10-03T19:21:11.865 INFO:teuthology.orchestra.run.smithi045.stdout: -3609> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_987) mark_dirty [dentry #0x1/dc-dir/dc-file_987 [2,head] auth (dversion lock) pv=5976 v=5038 ino=0x100000005d0 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553572ca00] 2023-10-03T19:21:11.865 INFO:teuthology.orchestra.run.smithi045.stdout: -3608> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5975 cv=5377/5377 ap=14+13 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=300 | child=1 dirty=1 authpin=1 0x565534f82400] version 5975 2023-10-03T19:21:11.865 INFO:teuthology.orchestra.run.smithi045.stdout: -3607> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536290a40 v5984 2023-10-03T19:21:11.865 INFO:teuthology.orchestra.run.smithi045.stdout: -3606> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5984 cv=5384/5384 REP dir_auth=0 ap=13+14 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5984 2023-10-03T19:21:11.865 INFO:teuthology.orchestra.run.smithi045.stdout: -3605> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536290920 v5977 2023-10-03T19:21:11.866 INFO:teuthology.orchestra.run.smithi045.stdout: -3604> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5977 cv=5377/5377 ap=14+13 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=300 | child=1 dirty=1 authpin=1 0x565534f82400] version 5977 2023-10-03T19:21:11.866 INFO:teuthology.orchestra.run.smithi045.stdout: -3603> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=13 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=13 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:11.866 INFO:teuthology.orchestra.run.smithi045.stdout: -3602> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=13) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5983 pv6007 ap=14 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=14) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=13) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.866 INFO:teuthology.orchestra.run.smithi045.stdout: -3601> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=14) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5983 pv6007 ap=14 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=14) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=12) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.866 INFO:teuthology.orchestra.run.smithi045.stdout: -3600> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005d0 [2,head] /dc-dir/dc-file_987 auth v5976 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.505312+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535729b80] 2023-10-03T19:21:11.866 INFO:teuthology.orchestra.run.smithi045.stdout: -3599> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005d0 [2,head] /dc-dir/dc-file_987 auth v5976 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.505312+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535729b80] 2023-10-03T19:21:11.866 INFO:teuthology.orchestra.run.smithi045.stdout: -3598> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:11.866 INFO:teuthology.orchestra.run.smithi045.stdout: -3597> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:11.866 INFO:teuthology.orchestra.run.smithi045.stdout: -3596> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:11.867 INFO:teuthology.orchestra.run.smithi045.stdout: -3595> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005d0 [2,head] /dc-dir/dc-file_987 auth v5976 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.505312+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535729b80] 2023-10-03T19:21:11.867 INFO:teuthology.orchestra.run.smithi045.stdout: -3594> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005d0 [2,head] /dc-dir/dc-file_987 auth v5976 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.505312+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535729b80] 2023-10-03T19:21:11.867 INFO:teuthology.orchestra.run.smithi045.stdout: -3593> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:11.867 INFO:teuthology.orchestra.run.smithi045.stdout: -3592> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 713.454, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 7.13e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1429.7] 2023-10-03T19:21:11.867 INFO:teuthology.orchestra.run.smithi045.stdout: -3591> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655363518c0 on [dir 0x1 / [2,head] auth pv=6008 v=5984 cv=5384/5384 REP dir_auth=0 ap=12+14 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 12 2023-10-03T19:21:11.867 INFO:teuthology.orchestra.run.smithi045.stdout: -3590> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655363518c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5983 pv6007 ap=13 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=13) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=12) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 13 2023-10-03T19:21:11.867 INFO:teuthology.orchestra.run.smithi045.stdout: -3589> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5984 cv=5384/5384 REP dir_auth=0 ap=12+13 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655363518c0 count now 12/13 2023-10-03T19:21:11.867 INFO:teuthology.orchestra.run.smithi045.stdout: -3588> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655363518c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5977 cv=5377/5377 ap=13+13 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=300 | child=1 dirty=1 authpin=1 0x565534f82400] count now 13 2023-10-03T19:21:11.867 INFO:teuthology.orchestra.run.smithi045.stdout: -3587> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005d0) auth_unpin by 0x5655363518c0 on [inode 0x100000005d0 [2,head] /dc-dir/dc-file_987 auth v5976 s=3 n(v0 rc2023-10-03T19:17:10.505312+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535729b80] now 0 2023-10-03T19:21:11.867 INFO:teuthology.orchestra.run.smithi045.stdout: -3586> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5977 cv=5377/5377 ap=13+12 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=300 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655363518c0 count now 13/12 2023-10-03T19:21:11.867 INFO:teuthology.orchestra.run.smithi045.stdout: -3585> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.868 INFO:teuthology.orchestra.run.smithi045.stdout: -3584> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.868 INFO:teuthology.orchestra.run.smithi045.stdout: -3583> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005d1 [2,head] /dc-dir/dc-file_988 auth v5190 pv5978 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.585086+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.585086+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553572a100] 2023-10-03T19:21:11.868 INFO:teuthology.orchestra.run.smithi045.stdout: -3582> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5985 2023-10-03T19:21:11.868 INFO:teuthology.orchestra.run.smithi045.stdout: -3581> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5985 pv6007 ap=13 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=13) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=12) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.868 INFO:teuthology.orchestra.run.smithi045.stdout: -3580> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5983 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:11.868 INFO:teuthology.orchestra.run.smithi045.stdout: -3579> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5984 cv=5384/5384 REP dir_auth=0 ap=12+13 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5984 2023-10-03T19:21:11.868 INFO:teuthology.orchestra.run.smithi045.stdout: -3578> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005d1) pop_and_dirty_projected_inode v5978 2023-10-03T19:21:11.868 INFO:teuthology.orchestra.run.smithi045.stdout: -3577> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005d1) mark_dirty [inode 0x100000005d1 [2,head] /dc-dir/dc-file_988 auth v5978 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.585086+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553572a100] 2023-10-03T19:21:11.868 INFO:teuthology.orchestra.run.smithi045.stdout: -3576> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_988) mark_dirty [dentry #0x1/dc-dir/dc-file_988 [2,head] auth (dversion lock) pv=5978 v=5190 ino=0x100000005d1 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553572cc80] 2023-10-03T19:21:11.869 INFO:teuthology.orchestra.run.smithi045.stdout: -3575> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5977 cv=5377/5377 ap=13+12 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=301 | child=1 dirty=1 authpin=1 0x565534f82400] version 5977 2023-10-03T19:21:11.869 INFO:teuthology.orchestra.run.smithi045.stdout: -3574> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536290c80 v5986 2023-10-03T19:21:11.869 INFO:teuthology.orchestra.run.smithi045.stdout: -3573> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5986 cv=5384/5384 REP dir_auth=0 ap=12+13 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5986 2023-10-03T19:21:11.869 INFO:teuthology.orchestra.run.smithi045.stdout: -3572> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536290b60 v5979 2023-10-03T19:21:11.869 INFO:teuthology.orchestra.run.smithi045.stdout: -3571> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5979 cv=5377/5377 ap=13+12 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=301 | child=1 dirty=1 authpin=1 0x565534f82400] version 5979 2023-10-03T19:21:11.869 INFO:teuthology.orchestra.run.smithi045.stdout: -3570> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=12 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=12 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:11.869 INFO:teuthology.orchestra.run.smithi045.stdout: -3569> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=12) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5985 pv6007 ap=13 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=13) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=12) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.869 INFO:teuthology.orchestra.run.smithi045.stdout: -3568> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=13) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5985 pv6007 ap=13 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=13) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=11) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.869 INFO:teuthology.orchestra.run.smithi045.stdout: -3567> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005d1 [2,head] /dc-dir/dc-file_988 auth v5978 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.585086+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553572a100] 2023-10-03T19:21:11.869 INFO:teuthology.orchestra.run.smithi045.stdout: -3566> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005d1 [2,head] /dc-dir/dc-file_988 auth v5978 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.585086+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553572a100] 2023-10-03T19:21:11.869 INFO:teuthology.orchestra.run.smithi045.stdout: -3565> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:11.870 INFO:teuthology.orchestra.run.smithi045.stdout: -3564> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:11.870 INFO:teuthology.orchestra.run.smithi045.stdout: -3563> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:11.870 INFO:teuthology.orchestra.run.smithi045.stdout: -3562> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005d1 [2,head] /dc-dir/dc-file_988 auth v5978 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.585086+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553572a100] 2023-10-03T19:21:11.870 INFO:teuthology.orchestra.run.smithi045.stdout: -3561> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005d1 [2,head] /dc-dir/dc-file_988 auth v5978 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.585086+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553572a100] 2023-10-03T19:21:11.870 INFO:teuthology.orchestra.run.smithi045.stdout: -3560> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:11.870 INFO:teuthology.orchestra.run.smithi045.stdout: -3559> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 714.454, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 7.14e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1431.7] 2023-10-03T19:21:11.870 INFO:teuthology.orchestra.run.smithi045.stdout: -3558> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536350fc0 on [dir 0x1 / [2,head] auth pv=6008 v=5986 cv=5384/5384 REP dir_auth=0 ap=11+13 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 11 2023-10-03T19:21:11.870 INFO:teuthology.orchestra.run.smithi045.stdout: -3557> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536350fc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5979 cv=5377/5377 ap=12+12 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=301 | child=1 dirty=1 authpin=1 0x565534f82400] count now 12 2023-10-03T19:21:11.870 INFO:teuthology.orchestra.run.smithi045.stdout: -3556> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536350fc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5985 pv6007 ap=12 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=12) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=11) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 12 2023-10-03T19:21:11.871 INFO:teuthology.orchestra.run.smithi045.stdout: -3555> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5986 cv=5384/5384 REP dir_auth=0 ap=11+12 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536350fc0 count now 11/12 2023-10-03T19:21:11.871 INFO:teuthology.orchestra.run.smithi045.stdout: -3554> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005d1) auth_unpin by 0x565536350fc0 on [inode 0x100000005d1 [2,head] /dc-dir/dc-file_988 auth v5978 s=3 n(v0 rc2023-10-03T19:17:10.585086+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553572a100] now 0 2023-10-03T19:21:11.871 INFO:teuthology.orchestra.run.smithi045.stdout: -3553> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5979 cv=5377/5377 ap=12+11 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=301 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536350fc0 count now 12/11 2023-10-03T19:21:11.871 INFO:teuthology.orchestra.run.smithi045.stdout: -3552> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.871 INFO:teuthology.orchestra.run.smithi045.stdout: -3551> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.871 INFO:teuthology.orchestra.run.smithi045.stdout: -3550> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005d2 [2,head] /dc-dir/dc-file_989 auth v5194 pv5980 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.624116+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.624116+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553572a680] 2023-10-03T19:21:11.871 INFO:teuthology.orchestra.run.smithi045.stdout: -3549> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5987 2023-10-03T19:21:11.871 INFO:teuthology.orchestra.run.smithi045.stdout: -3548> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5987 pv6007 ap=12 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=12) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=11) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.871 INFO:teuthology.orchestra.run.smithi045.stdout: -3547> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5985 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:11.871 INFO:teuthology.orchestra.run.smithi045.stdout: -3546> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5986 cv=5384/5384 REP dir_auth=0 ap=11+12 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5986 2023-10-03T19:21:11.871 INFO:teuthology.orchestra.run.smithi045.stdout: -3545> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005d2) pop_and_dirty_projected_inode v5980 2023-10-03T19:21:11.872 INFO:teuthology.orchestra.run.smithi045.stdout: -3544> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005d2) mark_dirty [inode 0x100000005d2 [2,head] /dc-dir/dc-file_989 auth v5980 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.624116+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553572a680] 2023-10-03T19:21:11.872 INFO:teuthology.orchestra.run.smithi045.stdout: -3543> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_989) mark_dirty [dentry #0x1/dc-dir/dc-file_989 [2,head] auth (dversion lock) pv=5980 v=5194 ino=0x100000005d2 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553572cf00] 2023-10-03T19:21:11.872 INFO:teuthology.orchestra.run.smithi045.stdout: -3542> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5979 cv=5377/5377 ap=12+11 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=302 | child=1 dirty=1 authpin=1 0x565534f82400] version 5979 2023-10-03T19:21:11.872 INFO:teuthology.orchestra.run.smithi045.stdout: -3541> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536290ec0 v5988 2023-10-03T19:21:11.872 INFO:teuthology.orchestra.run.smithi045.stdout: -3540> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5988 cv=5384/5384 REP dir_auth=0 ap=11+12 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5988 2023-10-03T19:21:11.872 INFO:teuthology.orchestra.run.smithi045.stdout: -3539> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536290da0 v5981 2023-10-03T19:21:11.872 INFO:teuthology.orchestra.run.smithi045.stdout: -3538> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5981 cv=5377/5377 ap=12+11 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=302 | child=1 dirty=1 authpin=1 0x565534f82400] version 5981 2023-10-03T19:21:11.872 INFO:teuthology.orchestra.run.smithi045.stdout: -3537> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=11 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=11 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:11.872 INFO:teuthology.orchestra.run.smithi045.stdout: -3536> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=11) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5987 pv6007 ap=12 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=12) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=11) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.872 INFO:teuthology.orchestra.run.smithi045.stdout: -3535> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=12) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5987 pv6007 ap=12 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=12) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=10) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.873 INFO:teuthology.orchestra.run.smithi045.stdout: -3534> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005d2 [2,head] /dc-dir/dc-file_989 auth v5980 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.624116+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553572a680] 2023-10-03T19:21:11.873 INFO:teuthology.orchestra.run.smithi045.stdout: -3533> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005d2 [2,head] /dc-dir/dc-file_989 auth v5980 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.624116+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553572a680] 2023-10-03T19:21:11.873 INFO:teuthology.orchestra.run.smithi045.stdout: -3532> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:11.873 INFO:teuthology.orchestra.run.smithi045.stdout: -3531> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:11.873 INFO:teuthology.orchestra.run.smithi045.stdout: -3530> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:11.873 INFO:teuthology.orchestra.run.smithi045.stdout: -3529> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005d2 [2,head] /dc-dir/dc-file_989 auth v5980 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.624116+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553572a680] 2023-10-03T19:21:11.873 INFO:teuthology.orchestra.run.smithi045.stdout: -3528> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005d2 [2,head] /dc-dir/dc-file_989 auth v5980 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.624116+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553572a680] 2023-10-03T19:21:11.873 INFO:teuthology.orchestra.run.smithi045.stdout: -3527> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:11.873 INFO:teuthology.orchestra.run.smithi045.stdout: -3526> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 715.454, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 7.15e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1433.7] 2023-10-03T19:21:11.873 INFO:teuthology.orchestra.run.smithi045.stdout: -3525> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655363506c0 on [dir 0x1 / [2,head] auth pv=6008 v=5988 cv=5384/5384 REP dir_auth=0 ap=10+12 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 10 2023-10-03T19:21:11.873 INFO:teuthology.orchestra.run.smithi045.stdout: -3524> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655363506c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5987 pv6007 ap=11 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=11) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=10) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 11 2023-10-03T19:21:11.874 INFO:teuthology.orchestra.run.smithi045.stdout: -3523> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5988 cv=5384/5384 REP dir_auth=0 ap=10+11 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655363506c0 count now 10/11 2023-10-03T19:21:11.874 INFO:teuthology.orchestra.run.smithi045.stdout: -3522> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655363506c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5981 cv=5377/5377 ap=11+11 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=302 | child=1 dirty=1 authpin=1 0x565534f82400] count now 11 2023-10-03T19:21:11.874 INFO:teuthology.orchestra.run.smithi045.stdout: -3521> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005d2) auth_unpin by 0x5655363506c0 on [inode 0x100000005d2 [2,head] /dc-dir/dc-file_989 auth v5980 s=3 n(v0 rc2023-10-03T19:17:10.624116+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553572a680] now 0 2023-10-03T19:21:11.874 INFO:teuthology.orchestra.run.smithi045.stdout: -3520> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5981 cv=5377/5377 ap=11+10 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=302 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655363506c0 count now 11/10 2023-10-03T19:21:11.874 INFO:teuthology.orchestra.run.smithi045.stdout: -3519> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.874 INFO:teuthology.orchestra.run.smithi045.stdout: -3518> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.874 INFO:teuthology.orchestra.run.smithi045.stdout: -3517> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005d3 [2,head] /dc-dir/dc-file_990 auth v5198 pv5982 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.636325+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.636325+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553572ac00] 2023-10-03T19:21:11.874 INFO:teuthology.orchestra.run.smithi045.stdout: -3516> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5989 2023-10-03T19:21:11.874 INFO:teuthology.orchestra.run.smithi045.stdout: -3515> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5989 pv6007 ap=11 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=11) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=10) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.874 INFO:teuthology.orchestra.run.smithi045.stdout: -3514> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5987 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:11.874 INFO:teuthology.orchestra.run.smithi045.stdout: -3513> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5988 cv=5384/5384 REP dir_auth=0 ap=10+11 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5988 2023-10-03T19:21:11.875 INFO:teuthology.orchestra.run.smithi045.stdout: -3512> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005d3) pop_and_dirty_projected_inode v5982 2023-10-03T19:21:11.875 INFO:teuthology.orchestra.run.smithi045.stdout: -3511> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005d3) mark_dirty [inode 0x100000005d3 [2,head] /dc-dir/dc-file_990 auth v5982 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.636325+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553572ac00] 2023-10-03T19:21:11.875 INFO:teuthology.orchestra.run.smithi045.stdout: -3510> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_990) mark_dirty [dentry #0x1/dc-dir/dc-file_990 [2,head] auth (dversion lock) pv=5982 v=5198 ino=0x100000005d3 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553572d180] 2023-10-03T19:21:11.875 INFO:teuthology.orchestra.run.smithi045.stdout: -3509> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5981 cv=5377/5377 ap=11+10 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=303 | child=1 dirty=1 authpin=1 0x565534f82400] version 5981 2023-10-03T19:21:11.875 INFO:teuthology.orchestra.run.smithi045.stdout: -3508> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536291100 v5990 2023-10-03T19:21:11.875 INFO:teuthology.orchestra.run.smithi045.stdout: -3507> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5990 cv=5384/5384 REP dir_auth=0 ap=10+11 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5990 2023-10-03T19:21:11.875 INFO:teuthology.orchestra.run.smithi045.stdout: -3506> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536290fe0 v5983 2023-10-03T19:21:11.875 INFO:teuthology.orchestra.run.smithi045.stdout: -3505> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5983 cv=5377/5377 ap=11+10 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=303 | child=1 dirty=1 authpin=1 0x565534f82400] version 5983 2023-10-03T19:21:11.875 INFO:teuthology.orchestra.run.smithi045.stdout: -3504> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=10 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=10 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:11.876 INFO:teuthology.orchestra.run.smithi045.stdout: -3503> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=10) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5989 pv6007 ap=11 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=11) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=10) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.876 INFO:teuthology.orchestra.run.smithi045.stdout: -3502> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=11) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5989 pv6007 ap=11 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=11) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=9) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.876 INFO:teuthology.orchestra.run.smithi045.stdout: -3501> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005d3 [2,head] /dc-dir/dc-file_990 auth v5982 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.636325+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553572ac00] 2023-10-03T19:21:11.876 INFO:teuthology.orchestra.run.smithi045.stdout: -3500> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005d3 [2,head] /dc-dir/dc-file_990 auth v5982 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.636325+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553572ac00] 2023-10-03T19:21:11.876 INFO:teuthology.orchestra.run.smithi045.stdout: -3499> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:11.876 INFO:teuthology.orchestra.run.smithi045.stdout: -3498> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:11.876 INFO:teuthology.orchestra.run.smithi045.stdout: -3497> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:11.876 INFO:teuthology.orchestra.run.smithi045.stdout: -3496> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005d3 [2,head] /dc-dir/dc-file_990 auth v5982 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.636325+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553572ac00] 2023-10-03T19:21:11.876 INFO:teuthology.orchestra.run.smithi045.stdout: -3495> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005d3 [2,head] /dc-dir/dc-file_990 auth v5982 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.636325+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553572ac00] 2023-10-03T19:21:11.876 INFO:teuthology.orchestra.run.smithi045.stdout: -3494> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:11.876 INFO:teuthology.orchestra.run.smithi045.stdout: -3493> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 716.454, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 7.16e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1435.7] 2023-10-03T19:21:11.876 INFO:teuthology.orchestra.run.smithi045.stdout: -3492> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536c17d40 on [dir 0x1 / [2,head] auth pv=6008 v=5990 cv=5384/5384 REP dir_auth=0 ap=9+11 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 9 2023-10-03T19:21:11.877 INFO:teuthology.orchestra.run.smithi045.stdout: -3491> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536c17d40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5989 pv6007 ap=10 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=10) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=9) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 10 2023-10-03T19:21:11.877 INFO:teuthology.orchestra.run.smithi045.stdout: -3490> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5990 cv=5384/5384 REP dir_auth=0 ap=9+10 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536c17d40 count now 9/10 2023-10-03T19:21:11.877 INFO:teuthology.orchestra.run.smithi045.stdout: -3489> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536c17d40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5983 cv=5377/5377 ap=10+10 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=303 | child=1 dirty=1 authpin=1 0x565534f82400] count now 10 2023-10-03T19:21:11.877 INFO:teuthology.orchestra.run.smithi045.stdout: -3488> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005d3) auth_unpin by 0x565536c17d40 on [inode 0x100000005d3 [2,head] /dc-dir/dc-file_990 auth v5982 s=3 n(v0 rc2023-10-03T19:17:10.636325+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553572ac00] now 0 2023-10-03T19:21:11.877 INFO:teuthology.orchestra.run.smithi045.stdout: -3487> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5983 cv=5377/5377 ap=10+9 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=303 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536c17d40 count now 10/9 2023-10-03T19:21:11.877 INFO:teuthology.orchestra.run.smithi045.stdout: -3486> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.877 INFO:teuthology.orchestra.run.smithi045.stdout: -3485> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.877 INFO:teuthology.orchestra.run.smithi045.stdout: -3484> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005d4 [2,head] /dc-dir/dc-file_991 auth v5202 pv5984 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.648066+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.648066+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553572b180] 2023-10-03T19:21:11.877 INFO:teuthology.orchestra.run.smithi045.stdout: -3483> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5991 2023-10-03T19:21:11.878 INFO:teuthology.orchestra.run.smithi045.stdout: -3482> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5991 pv6007 ap=10 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=10) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=9) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.878 INFO:teuthology.orchestra.run.smithi045.stdout: -3481> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5989 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:11.878 INFO:teuthology.orchestra.run.smithi045.stdout: -3480> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5990 cv=5384/5384 REP dir_auth=0 ap=9+10 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5990 2023-10-03T19:21:11.878 INFO:teuthology.orchestra.run.smithi045.stdout: -3479> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005d4) pop_and_dirty_projected_inode v5984 2023-10-03T19:21:11.878 INFO:teuthology.orchestra.run.smithi045.stdout: -3478> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005d4) mark_dirty [inode 0x100000005d4 [2,head] /dc-dir/dc-file_991 auth v5984 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.648066+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553572b180] 2023-10-03T19:21:11.878 INFO:teuthology.orchestra.run.smithi045.stdout: -3477> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_991) mark_dirty [dentry #0x1/dc-dir/dc-file_991 [2,head] auth (dversion lock) pv=5984 v=5202 ino=0x100000005d4 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553572d400] 2023-10-03T19:21:11.878 INFO:teuthology.orchestra.run.smithi045.stdout: -3476> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5983 cv=5377/5377 ap=10+9 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=304 | child=1 dirty=1 authpin=1 0x565534f82400] version 5983 2023-10-03T19:21:11.878 INFO:teuthology.orchestra.run.smithi045.stdout: -3475> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536291340 v5992 2023-10-03T19:21:11.878 INFO:teuthology.orchestra.run.smithi045.stdout: -3474> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5992 cv=5384/5384 REP dir_auth=0 ap=9+10 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5992 2023-10-03T19:21:11.878 INFO:teuthology.orchestra.run.smithi045.stdout: -3473> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536291220 v5985 2023-10-03T19:21:11.879 INFO:teuthology.orchestra.run.smithi045.stdout: -3472> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5985 cv=5377/5377 ap=10+9 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=304 | child=1 dirty=1 authpin=1 0x565534f82400] version 5985 2023-10-03T19:21:11.879 INFO:teuthology.orchestra.run.smithi045.stdout: -3471> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=9 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=9 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:11.879 INFO:teuthology.orchestra.run.smithi045.stdout: -3470> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=9) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5991 pv6007 ap=10 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=10) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=9) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.879 INFO:teuthology.orchestra.run.smithi045.stdout: -3469> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=10) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5991 pv6007 ap=10 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=10) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=8) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.879 INFO:teuthology.orchestra.run.smithi045.stdout: -3468> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005d4 [2,head] /dc-dir/dc-file_991 auth v5984 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.648066+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553572b180] 2023-10-03T19:21:11.879 INFO:teuthology.orchestra.run.smithi045.stdout: -3467> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005d4 [2,head] /dc-dir/dc-file_991 auth v5984 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.648066+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553572b180] 2023-10-03T19:21:11.879 INFO:teuthology.orchestra.run.smithi045.stdout: -3466> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:11.879 INFO:teuthology.orchestra.run.smithi045.stdout: -3465> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:11.879 INFO:teuthology.orchestra.run.smithi045.stdout: -3464> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:11.879 INFO:teuthology.orchestra.run.smithi045.stdout: -3463> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005d4 [2,head] /dc-dir/dc-file_991 auth v5984 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.648066+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553572b180] 2023-10-03T19:21:11.880 INFO:teuthology.orchestra.run.smithi045.stdout: -3462> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005d4 [2,head] /dc-dir/dc-file_991 auth v5984 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.648066+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553572b180] 2023-10-03T19:21:11.880 INFO:teuthology.orchestra.run.smithi045.stdout: -3461> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:11.880 INFO:teuthology.orchestra.run.smithi045.stdout: -3460> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 717.454, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 7.17e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1437.7] 2023-10-03T19:21:11.880 INFO:teuthology.orchestra.run.smithi045.stdout: -3459> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x5655351dd8c0 on [dir 0x1 / [2,head] auth pv=6008 v=5992 cv=5384/5384 REP dir_auth=0 ap=8+10 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 8 2023-10-03T19:21:11.880 INFO:teuthology.orchestra.run.smithi045.stdout: -3458> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x5655351dd8c0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5991 pv6007 ap=9 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=9) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=8) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 9 2023-10-03T19:21:11.880 INFO:teuthology.orchestra.run.smithi045.stdout: -3457> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5992 cv=5384/5384 REP dir_auth=0 ap=8+9 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x5655351dd8c0 count now 8/9 2023-10-03T19:21:11.880 INFO:teuthology.orchestra.run.smithi045.stdout: -3456> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x5655351dd8c0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5985 cv=5377/5377 ap=9+9 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=304 | child=1 dirty=1 authpin=1 0x565534f82400] count now 9 2023-10-03T19:21:11.880 INFO:teuthology.orchestra.run.smithi045.stdout: -3455> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005d4) auth_unpin by 0x5655351dd8c0 on [inode 0x100000005d4 [2,head] /dc-dir/dc-file_991 auth v5984 s=3 n(v0 rc2023-10-03T19:17:10.648066+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553572b180] now 0 2023-10-03T19:21:11.880 INFO:teuthology.orchestra.run.smithi045.stdout: -3454> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5985 cv=5377/5377 ap=9+8 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=304 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x5655351dd8c0 count now 9/8 2023-10-03T19:21:11.880 INFO:teuthology.orchestra.run.smithi045.stdout: -3453> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.880 INFO:teuthology.orchestra.run.smithi045.stdout: -3452> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.881 INFO:teuthology.orchestra.run.smithi045.stdout: -3451> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005d5 [2,head] /dc-dir/dc-file_992 auth v5206 pv5986 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.659229+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.659229+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553572b700] 2023-10-03T19:21:11.881 INFO:teuthology.orchestra.run.smithi045.stdout: -3450> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5993 2023-10-03T19:21:11.881 INFO:teuthology.orchestra.run.smithi045.stdout: -3449> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5993 pv6007 ap=9 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=9) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=8) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.881 INFO:teuthology.orchestra.run.smithi045.stdout: -3448> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5991 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:11.881 INFO:teuthology.orchestra.run.smithi045.stdout: -3447> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5992 cv=5384/5384 REP dir_auth=0 ap=8+9 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5992 2023-10-03T19:21:11.881 INFO:teuthology.orchestra.run.smithi045.stdout: -3446> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005d5) pop_and_dirty_projected_inode v5986 2023-10-03T19:21:11.881 INFO:teuthology.orchestra.run.smithi045.stdout: -3445> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005d5) mark_dirty [inode 0x100000005d5 [2,head] /dc-dir/dc-file_992 auth v5986 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.659229+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553572b700] 2023-10-03T19:21:11.881 INFO:teuthology.orchestra.run.smithi045.stdout: -3444> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_992) mark_dirty [dentry #0x1/dc-dir/dc-file_992 [2,head] auth (dversion lock) pv=5986 v=5206 ino=0x100000005d5 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553572d680] 2023-10-03T19:21:11.881 INFO:teuthology.orchestra.run.smithi045.stdout: -3443> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5985 cv=5377/5377 ap=9+8 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=305 | child=1 dirty=1 authpin=1 0x565534f82400] version 5985 2023-10-03T19:21:11.881 INFO:teuthology.orchestra.run.smithi045.stdout: -3442> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536291580 v5994 2023-10-03T19:21:11.882 INFO:teuthology.orchestra.run.smithi045.stdout: -3441> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5994 cv=5384/5384 REP dir_auth=0 ap=8+9 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5994 2023-10-03T19:21:11.882 INFO:teuthology.orchestra.run.smithi045.stdout: -3440> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536291460 v5987 2023-10-03T19:21:11.882 INFO:teuthology.orchestra.run.smithi045.stdout: -3439> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5987 cv=5377/5377 ap=9+8 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=305 | child=1 dirty=1 authpin=1 0x565534f82400] version 5987 2023-10-03T19:21:11.882 INFO:teuthology.orchestra.run.smithi045.stdout: -3438> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=8 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=8 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:11.882 INFO:teuthology.orchestra.run.smithi045.stdout: -3437> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=8) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5993 pv6007 ap=9 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=9) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=8) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.882 INFO:teuthology.orchestra.run.smithi045.stdout: -3436> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=9) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5993 pv6007 ap=9 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=9) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=7) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.882 INFO:teuthology.orchestra.run.smithi045.stdout: -3435> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005d5 [2,head] /dc-dir/dc-file_992 auth v5986 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.659229+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553572b700] 2023-10-03T19:21:11.882 INFO:teuthology.orchestra.run.smithi045.stdout: -3434> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005d5 [2,head] /dc-dir/dc-file_992 auth v5986 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.659229+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553572b700] 2023-10-03T19:21:11.882 INFO:teuthology.orchestra.run.smithi045.stdout: -3433> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:11.882 INFO:teuthology.orchestra.run.smithi045.stdout: -3432> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:11.882 INFO:teuthology.orchestra.run.smithi045.stdout: -3431> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:11.882 INFO:teuthology.orchestra.run.smithi045.stdout: -3430> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005d5 [2,head] /dc-dir/dc-file_992 auth v5986 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.659229+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553572b700] 2023-10-03T19:21:11.883 INFO:teuthology.orchestra.run.smithi045.stdout: -3429> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005d5 [2,head] /dc-dir/dc-file_992 auth v5986 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.659229+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553572b700] 2023-10-03T19:21:11.883 INFO:teuthology.orchestra.run.smithi045.stdout: -3428> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:11.883 INFO:teuthology.orchestra.run.smithi045.stdout: -3427> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 718.454, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 7.18e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1439.7] 2023-10-03T19:21:11.883 INFO:teuthology.orchestra.run.smithi045.stdout: -3426> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535ebdd40 on [dir 0x1 / [2,head] auth pv=6008 v=5994 cv=5384/5384 REP dir_auth=0 ap=7+9 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 7 2023-10-03T19:21:11.883 INFO:teuthology.orchestra.run.smithi045.stdout: -3425> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535ebdd40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5993 pv6007 ap=8 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=8) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=7) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 8 2023-10-03T19:21:11.883 INFO:teuthology.orchestra.run.smithi045.stdout: -3424> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5994 cv=5384/5384 REP dir_auth=0 ap=7+8 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535ebdd40 count now 7/8 2023-10-03T19:21:11.883 INFO:teuthology.orchestra.run.smithi045.stdout: -3423> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535ebdd40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5987 cv=5377/5377 ap=8+8 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=305 | child=1 dirty=1 authpin=1 0x565534f82400] count now 8 2023-10-03T19:21:11.883 INFO:teuthology.orchestra.run.smithi045.stdout: -3422> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005d5) auth_unpin by 0x565535ebdd40 on [inode 0x100000005d5 [2,head] /dc-dir/dc-file_992 auth v5986 s=3 n(v0 rc2023-10-03T19:17:10.659229+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553572b700] now 0 2023-10-03T19:21:11.883 INFO:teuthology.orchestra.run.smithi045.stdout: -3421> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5987 cv=5377/5377 ap=8+7 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=305 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535ebdd40 count now 8/7 2023-10-03T19:21:11.884 INFO:teuthology.orchestra.run.smithi045.stdout: -3420> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.884 INFO:teuthology.orchestra.run.smithi045.stdout: -3419> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.929 INFO:teuthology.orchestra.run.smithi045.stdout: -3418> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005d6 [2,head] /dc-dir/dc-file_993 auth v5210 pv5988 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.670994+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.670994+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553573e000] 2023-10-03T19:21:11.929 INFO:teuthology.orchestra.run.smithi045.stdout: -3417> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5995 2023-10-03T19:21:11.929 INFO:teuthology.orchestra.run.smithi045.stdout: -3416> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5995 pv6007 ap=8 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=8) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=7) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.929 INFO:teuthology.orchestra.run.smithi045.stdout: -3415> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5993 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:11.930 INFO:teuthology.orchestra.run.smithi045.stdout: -3414> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5994 cv=5384/5384 REP dir_auth=0 ap=7+8 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5994 2023-10-03T19:21:11.930 INFO:teuthology.orchestra.run.smithi045.stdout: -3413> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005d6) pop_and_dirty_projected_inode v5988 2023-10-03T19:21:11.930 INFO:teuthology.orchestra.run.smithi045.stdout: -3412> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005d6) mark_dirty [inode 0x100000005d6 [2,head] /dc-dir/dc-file_993 auth v5988 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.670994+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553573e000] 2023-10-03T19:21:11.930 INFO:teuthology.orchestra.run.smithi045.stdout: -3411> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_993) mark_dirty [dentry #0x1/dc-dir/dc-file_993 [2,head] auth (dversion lock) pv=5988 v=5210 ino=0x100000005d6 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553572d900] 2023-10-03T19:21:11.930 INFO:teuthology.orchestra.run.smithi045.stdout: -3410> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5987 cv=5377/5377 ap=8+7 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=306 | child=1 dirty=1 authpin=1 0x565534f82400] version 5987 2023-10-03T19:21:11.930 INFO:teuthology.orchestra.run.smithi045.stdout: -3409> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x5655362917c0 v5996 2023-10-03T19:21:11.930 INFO:teuthology.orchestra.run.smithi045.stdout: -3408> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5996 cv=5384/5384 REP dir_auth=0 ap=7+8 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5996 2023-10-03T19:21:11.930 INFO:teuthology.orchestra.run.smithi045.stdout: -3407> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655362916a0 v5989 2023-10-03T19:21:11.930 INFO:teuthology.orchestra.run.smithi045.stdout: -3406> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5989 cv=5377/5377 ap=8+7 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=306 | child=1 dirty=1 authpin=1 0x565534f82400] version 5989 2023-10-03T19:21:11.930 INFO:teuthology.orchestra.run.smithi045.stdout: -3405> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=7 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=7 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:11.930 INFO:teuthology.orchestra.run.smithi045.stdout: -3404> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=7) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5995 pv6007 ap=8 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=8) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=7) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.931 INFO:teuthology.orchestra.run.smithi045.stdout: -3403> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=8) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5995 pv6007 ap=8 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=8) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=6) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.931 INFO:teuthology.orchestra.run.smithi045.stdout: -3402> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005d6 [2,head] /dc-dir/dc-file_993 auth v5988 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.670994+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553573e000] 2023-10-03T19:21:11.931 INFO:teuthology.orchestra.run.smithi045.stdout: -3401> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005d6 [2,head] /dc-dir/dc-file_993 auth v5988 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.670994+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553573e000] 2023-10-03T19:21:11.931 INFO:teuthology.orchestra.run.smithi045.stdout: -3400> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:11.931 INFO:teuthology.orchestra.run.smithi045.stdout: -3399> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:11.931 INFO:teuthology.orchestra.run.smithi045.stdout: -3398> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:11.931 INFO:teuthology.orchestra.run.smithi045.stdout: -3397> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005d6 [2,head] /dc-dir/dc-file_993 auth v5988 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.670994+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553573e000] 2023-10-03T19:21:11.931 INFO:teuthology.orchestra.run.smithi045.stdout: -3396> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005d6 [2,head] /dc-dir/dc-file_993 auth v5988 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.670994+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553573e000] 2023-10-03T19:21:11.931 INFO:teuthology.orchestra.run.smithi045.stdout: -3395> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:11.931 INFO:teuthology.orchestra.run.smithi045.stdout: -3394> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 719.454, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 7.19e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1441.7] 2023-10-03T19:21:11.932 INFO:teuthology.orchestra.run.smithi045.stdout: -3393> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536386240 on [dir 0x1 / [2,head] auth pv=6008 v=5996 cv=5384/5384 REP dir_auth=0 ap=6+8 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 6 2023-10-03T19:21:11.932 INFO:teuthology.orchestra.run.smithi045.stdout: -3392> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536386240 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5995 pv6007 ap=7 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=7) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=6) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 7 2023-10-03T19:21:11.932 INFO:teuthology.orchestra.run.smithi045.stdout: -3391> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5996 cv=5384/5384 REP dir_auth=0 ap=6+7 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536386240 count now 6/7 2023-10-03T19:21:11.932 INFO:teuthology.orchestra.run.smithi045.stdout: -3390> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536386240 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5989 cv=5377/5377 ap=7+7 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=306 | child=1 dirty=1 authpin=1 0x565534f82400] count now 7 2023-10-03T19:21:11.932 INFO:teuthology.orchestra.run.smithi045.stdout: -3389> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005d6) auth_unpin by 0x565536386240 on [inode 0x100000005d6 [2,head] /dc-dir/dc-file_993 auth v5988 s=3 n(v0 rc2023-10-03T19:17:10.670994+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553573e000] now 0 2023-10-03T19:21:11.932 INFO:teuthology.orchestra.run.smithi045.stdout: -3388> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5989 cv=5377/5377 ap=7+6 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=306 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536386240 count now 7/6 2023-10-03T19:21:11.932 INFO:teuthology.orchestra.run.smithi045.stdout: -3387> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.932 INFO:teuthology.orchestra.run.smithi045.stdout: -3386> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:11.932 INFO:teuthology.orchestra.run.smithi045.stdout: -3385> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005d7 [2,head] /dc-dir/dc-file_994 auth v5214 pv5990 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.683030+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.683030+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553573e580] 2023-10-03T19:21:11.932 INFO:teuthology.orchestra.run.smithi045.stdout: -3384> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5997 2023-10-03T19:21:11.932 INFO:teuthology.orchestra.run.smithi045.stdout: -3383> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5997 pv6007 ap=7 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=7) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=6) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.932 INFO:teuthology.orchestra.run.smithi045.stdout: -3382> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5995 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:11.933 INFO:teuthology.orchestra.run.smithi045.stdout: -3381> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5996 cv=5384/5384 REP dir_auth=0 ap=6+7 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5996 2023-10-03T19:21:11.933 INFO:teuthology.orchestra.run.smithi045.stdout: -3380> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005d7) pop_and_dirty_projected_inode v5990 2023-10-03T19:21:11.933 INFO:teuthology.orchestra.run.smithi045.stdout: -3379> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005d7) mark_dirty [inode 0x100000005d7 [2,head] /dc-dir/dc-file_994 auth v5990 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.683030+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553573e580] 2023-10-03T19:21:11.933 INFO:teuthology.orchestra.run.smithi045.stdout: -3378> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_994) mark_dirty [dentry #0x1/dc-dir/dc-file_994 [2,head] auth (dversion lock) pv=5990 v=5214 ino=0x100000005d7 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x56553572db80] 2023-10-03T19:21:11.933 INFO:teuthology.orchestra.run.smithi045.stdout: -3377> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5989 cv=5377/5377 ap=7+6 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=307 | child=1 dirty=1 authpin=1 0x565534f82400] version 5989 2023-10-03T19:21:11.933 INFO:teuthology.orchestra.run.smithi045.stdout: -3376> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536291a00 v5998 2023-10-03T19:21:11.933 INFO:teuthology.orchestra.run.smithi045.stdout: -3375> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5998 cv=5384/5384 REP dir_auth=0 ap=6+7 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5998 2023-10-03T19:21:11.933 INFO:teuthology.orchestra.run.smithi045.stdout: -3374> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655362918e0 v5991 2023-10-03T19:21:11.933 INFO:teuthology.orchestra.run.smithi045.stdout: -3373> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5991 cv=5377/5377 ap=7+6 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=307 | child=1 dirty=1 authpin=1 0x565534f82400] version 5991 2023-10-03T19:21:11.933 INFO:teuthology.orchestra.run.smithi045.stdout: -3372> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=6 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=6 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:11.934 INFO:teuthology.orchestra.run.smithi045.stdout: -3371> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=6) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5997 pv6007 ap=7 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=7) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=6) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.934 INFO:teuthology.orchestra.run.smithi045.stdout: -3370> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=7) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5997 pv6007 ap=7 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=7) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=5) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:11.934 INFO:teuthology.orchestra.run.smithi045.stdout: -3369> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005d7 [2,head] /dc-dir/dc-file_994 auth v5990 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.683030+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553573e580] 2023-10-03T19:21:11.934 INFO:teuthology.orchestra.run.smithi045.stdout: -3368> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005d7 [2,head] /dc-dir/dc-file_994 auth v5990 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.683030+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553573e580] 2023-10-03T19:21:11.934 INFO:teuthology.orchestra.run.smithi045.stdout: -3367> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:11.934 INFO:teuthology.orchestra.run.smithi045.stdout: -3366> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:11.934 INFO:teuthology.orchestra.run.smithi045.stdout: -3365> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:11.934 INFO:teuthology.orchestra.run.smithi045.stdout: -3364> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005d7 [2,head] /dc-dir/dc-file_994 auth v5990 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.683030+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553573e580] 2023-10-03T19:21:11.934 INFO:teuthology.orchestra.run.smithi045.stdout: -3363> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005d7 [2,head] /dc-dir/dc-file_994 auth v5990 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.683030+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553573e580] 2023-10-03T19:21:11.934 INFO:teuthology.orchestra.run.smithi045.stdout: -3362> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:11.934 INFO:teuthology.orchestra.run.smithi045.stdout: -3361> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 720.454, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 7.20e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1443.7] 2023-10-03T19:21:11.934 INFO:teuthology.orchestra.run.smithi045.stdout: -3360> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536d9d440 on [dir 0x1 / [2,head] auth pv=6008 v=5998 cv=5384/5384 REP dir_auth=0 ap=5+7 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 5 2023-10-03T19:21:11.935 INFO:teuthology.orchestra.run.smithi045.stdout: -3359> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536d9d440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5997 pv6007 ap=6 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=6) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=5) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 6 2023-10-03T19:21:12.020 INFO:teuthology.orchestra.run.smithi045.stdout: -3358> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=5998 cv=5384/5384 REP dir_auth=0 ap=5+6 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536d9d440 count now 5/6 2023-10-03T19:21:12.020 INFO:teuthology.orchestra.run.smithi045.stdout: -3357> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536d9d440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5991 cv=5377/5377 ap=6+6 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=307 | child=1 dirty=1 authpin=1 0x565534f82400] count now 6 2023-10-03T19:21:12.021 INFO:teuthology.orchestra.run.smithi045.stdout: -3356> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005d7) auth_unpin by 0x565536d9d440 on [inode 0x100000005d7 [2,head] /dc-dir/dc-file_994 auth v5990 s=3 n(v0 rc2023-10-03T19:17:10.683030+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553573e580] now 0 2023-10-03T19:21:12.021 INFO:teuthology.orchestra.run.smithi045.stdout: -3355> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5991 cv=5377/5377 ap=6+5 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=307 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536d9d440 count now 6/5 2023-10-03T19:21:12.021 INFO:teuthology.orchestra.run.smithi045.stdout: -3354> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:12.021 INFO:teuthology.orchestra.run.smithi045.stdout: -3353> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:12.021 INFO:teuthology.orchestra.run.smithi045.stdout: -3352> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005d8 [2,head] /dc-dir/dc-file_995 auth v5218 pv5992 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.694512+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.694512+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553573eb00] 2023-10-03T19:21:12.021 INFO:teuthology.orchestra.run.smithi045.stdout: -3351> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v5999 2023-10-03T19:21:12.022 INFO:teuthology.orchestra.run.smithi045.stdout: -3350> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v5999 pv6007 ap=6 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=6) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=5) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:12.022 INFO:teuthology.orchestra.run.smithi045.stdout: -3349> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5997 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:12.022 INFO:teuthology.orchestra.run.smithi045.stdout: -3348> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=5998 cv=5384/5384 REP dir_auth=0 ap=5+6 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 5998 2023-10-03T19:21:12.022 INFO:teuthology.orchestra.run.smithi045.stdout: -3347> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005d8) pop_and_dirty_projected_inode v5992 2023-10-03T19:21:12.022 INFO:teuthology.orchestra.run.smithi045.stdout: -3346> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005d8) mark_dirty [inode 0x100000005d8 [2,head] /dc-dir/dc-file_995 auth v5992 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.694512+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553573eb00] 2023-10-03T19:21:12.022 INFO:teuthology.orchestra.run.smithi045.stdout: -3345> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_995) mark_dirty [dentry #0x1/dc-dir/dc-file_995 [2,head] auth (dversion lock) pv=5992 v=5218 ino=0x100000005d8 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535742000] 2023-10-03T19:21:12.022 INFO:teuthology.orchestra.run.smithi045.stdout: -3344> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5991 cv=5377/5377 ap=6+5 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=308 | child=1 dirty=1 authpin=1 0x565534f82400] version 5991 2023-10-03T19:21:12.022 INFO:teuthology.orchestra.run.smithi045.stdout: -3343> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536291c40 v6000 2023-10-03T19:21:12.022 INFO:teuthology.orchestra.run.smithi045.stdout: -3342> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=6000 cv=5384/5384 REP dir_auth=0 ap=5+6 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 6000 2023-10-03T19:21:12.022 INFO:teuthology.orchestra.run.smithi045.stdout: -3341> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536291b20 v5993 2023-10-03T19:21:12.022 INFO:teuthology.orchestra.run.smithi045.stdout: -3340> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5993 cv=5377/5377 ap=6+5 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=308 | child=1 dirty=1 authpin=1 0x565534f82400] version 5993 2023-10-03T19:21:12.023 INFO:teuthology.orchestra.run.smithi045.stdout: -3339> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=5 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=5 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:12.023 INFO:teuthology.orchestra.run.smithi045.stdout: -3338> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=5) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5999 pv6007 ap=6 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=6) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=5) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:12.023 INFO:teuthology.orchestra.run.smithi045.stdout: -3337> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=6) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5999 pv6007 ap=6 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=6) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=4) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:12.023 INFO:teuthology.orchestra.run.smithi045.stdout: -3336> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005d8 [2,head] /dc-dir/dc-file_995 auth v5992 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.694512+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553573eb00] 2023-10-03T19:21:12.023 INFO:teuthology.orchestra.run.smithi045.stdout: -3335> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005d8 [2,head] /dc-dir/dc-file_995 auth v5992 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.694512+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553573eb00] 2023-10-03T19:21:12.023 INFO:teuthology.orchestra.run.smithi045.stdout: -3334> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:12.023 INFO:teuthology.orchestra.run.smithi045.stdout: -3333> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:12.023 INFO:teuthology.orchestra.run.smithi045.stdout: -3332> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:12.023 INFO:teuthology.orchestra.run.smithi045.stdout: -3331> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005d8 [2,head] /dc-dir/dc-file_995 auth v5992 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.694512+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553573eb00] 2023-10-03T19:21:12.023 INFO:teuthology.orchestra.run.smithi045.stdout: -3330> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005d8 [2,head] /dc-dir/dc-file_995 auth v5992 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.694512+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553573eb00] 2023-10-03T19:21:12.024 INFO:teuthology.orchestra.run.smithi045.stdout: -3329> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:12.024 INFO:teuthology.orchestra.run.smithi045.stdout: -3328> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 721.454, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 7.21e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1445.7] 2023-10-03T19:21:12.024 INFO:teuthology.orchestra.run.smithi045.stdout: -3327> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565536428fc0 on [dir 0x1 / [2,head] auth pv=6008 v=6000 cv=5384/5384 REP dir_auth=0 ap=4+6 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 4 2023-10-03T19:21:12.024 INFO:teuthology.orchestra.run.smithi045.stdout: -3326> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565536428fc0 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v5999 pv6007 ap=5 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=5) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=4) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 5 2023-10-03T19:21:12.024 INFO:teuthology.orchestra.run.smithi045.stdout: -3325> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=6000 cv=5384/5384 REP dir_auth=0 ap=4+5 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565536428fc0 count now 4/5 2023-10-03T19:21:12.024 INFO:teuthology.orchestra.run.smithi045.stdout: -3324> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565536428fc0 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5993 cv=5377/5377 ap=5+5 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=308 | child=1 dirty=1 authpin=1 0x565534f82400] count now 5 2023-10-03T19:21:12.024 INFO:teuthology.orchestra.run.smithi045.stdout: -3323> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005d8) auth_unpin by 0x565536428fc0 on [inode 0x100000005d8 [2,head] /dc-dir/dc-file_995 auth v5992 s=3 n(v0 rc2023-10-03T19:17:10.694512+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553573eb00] now 0 2023-10-03T19:21:12.024 INFO:teuthology.orchestra.run.smithi045.stdout: -3322> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5993 cv=5377/5377 ap=5+4 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=308 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565536428fc0 count now 5/4 2023-10-03T19:21:12.024 INFO:teuthology.orchestra.run.smithi045.stdout: -3321> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:12.024 INFO:teuthology.orchestra.run.smithi045.stdout: -3320> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:12.024 INFO:teuthology.orchestra.run.smithi045.stdout: -3319> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005d9 [2,head] /dc-dir/dc-file_996 auth v5222 pv5994 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.705645+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.705645+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553573f080] 2023-10-03T19:21:12.025 INFO:teuthology.orchestra.run.smithi045.stdout: -3318> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v6001 2023-10-03T19:21:12.025 INFO:teuthology.orchestra.run.smithi045.stdout: -3317> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v6001 pv6007 ap=5 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=5) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=4) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:12.025 INFO:teuthology.orchestra.run.smithi045.stdout: -3316> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=5999 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:12.025 INFO:teuthology.orchestra.run.smithi045.stdout: -3315> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=6000 cv=5384/5384 REP dir_auth=0 ap=4+5 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 6000 2023-10-03T19:21:12.025 INFO:teuthology.orchestra.run.smithi045.stdout: -3314> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005d9) pop_and_dirty_projected_inode v5994 2023-10-03T19:21:12.025 INFO:teuthology.orchestra.run.smithi045.stdout: -3313> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005d9) mark_dirty [inode 0x100000005d9 [2,head] /dc-dir/dc-file_996 auth v5994 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.705645+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553573f080] 2023-10-03T19:21:12.025 INFO:teuthology.orchestra.run.smithi045.stdout: -3312> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_996) mark_dirty [dentry #0x1/dc-dir/dc-file_996 [2,head] auth (dversion lock) pv=5994 v=5222 ino=0x100000005d9 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535742280] 2023-10-03T19:21:12.025 INFO:teuthology.orchestra.run.smithi045.stdout: -3311> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5993 cv=5377/5377 ap=5+4 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=309 | child=1 dirty=1 authpin=1 0x565534f82400] version 5993 2023-10-03T19:21:12.025 INFO:teuthology.orchestra.run.smithi045.stdout: -3310> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x565536291e80 v6002 2023-10-03T19:21:12.025 INFO:teuthology.orchestra.run.smithi045.stdout: -3309> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=6002 cv=5384/5384 REP dir_auth=0 ap=4+5 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 6002 2023-10-03T19:21:12.025 INFO:teuthology.orchestra.run.smithi045.stdout: -3308> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x565536291d60 v5995 2023-10-03T19:21:12.026 INFO:teuthology.orchestra.run.smithi045.stdout: -3307> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5995 cv=5377/5377 ap=5+4 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=309 | child=1 dirty=1 authpin=1 0x565534f82400] version 5995 2023-10-03T19:21:12.135 INFO:teuthology.orchestra.run.smithi045.stdout: -3306> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=4 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=4 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:12.136 INFO:teuthology.orchestra.run.smithi045.stdout: -3305> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=4) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6001 pv6007 ap=5 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=5) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=4) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:12.136 INFO:teuthology.orchestra.run.smithi045.stdout: -3304> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=5) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6001 pv6007 ap=5 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=5) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=3) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:12.136 INFO:teuthology.orchestra.run.smithi045.stdout: -3303> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005d9 [2,head] /dc-dir/dc-file_996 auth v5994 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.705645+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553573f080] 2023-10-03T19:21:12.136 INFO:teuthology.orchestra.run.smithi045.stdout: -3302> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005d9 [2,head] /dc-dir/dc-file_996 auth v5994 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.705645+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553573f080] 2023-10-03T19:21:12.136 INFO:teuthology.orchestra.run.smithi045.stdout: -3301> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:12.136 INFO:teuthology.orchestra.run.smithi045.stdout: -3300> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:12.136 INFO:teuthology.orchestra.run.smithi045.stdout: -3299> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:12.136 INFO:teuthology.orchestra.run.smithi045.stdout: -3298> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005d9 [2,head] /dc-dir/dc-file_996 auth v5994 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.705645+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553573f080] 2023-10-03T19:21:12.136 INFO:teuthology.orchestra.run.smithi045.stdout: -3297> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005d9 [2,head] /dc-dir/dc-file_996 auth v5994 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.705645+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553573f080] 2023-10-03T19:21:12.136 INFO:teuthology.orchestra.run.smithi045.stdout: -3296> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:12.136 INFO:teuthology.orchestra.run.smithi045.stdout: -3295> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 722.454, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 7.22e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1447.7] 2023-10-03T19:21:12.137 INFO:teuthology.orchestra.run.smithi045.stdout: -3294> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x56553662a240 on [dir 0x1 / [2,head] auth pv=6008 v=6002 cv=5384/5384 REP dir_auth=0 ap=3+5 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 3 2023-10-03T19:21:12.137 INFO:teuthology.orchestra.run.smithi045.stdout: -3293> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x56553662a240 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6001 pv6007 ap=4 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=4) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=3) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 4 2023-10-03T19:21:12.137 INFO:teuthology.orchestra.run.smithi045.stdout: -3292> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=6002 cv=5384/5384 REP dir_auth=0 ap=3+4 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x56553662a240 count now 3/4 2023-10-03T19:21:12.137 INFO:teuthology.orchestra.run.smithi045.stdout: -3291> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x56553662a240 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5995 cv=5377/5377 ap=4+4 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=309 | child=1 dirty=1 authpin=1 0x565534f82400] count now 4 2023-10-03T19:21:12.137 INFO:teuthology.orchestra.run.smithi045.stdout: -3290> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005d9) auth_unpin by 0x56553662a240 on [inode 0x100000005d9 [2,head] /dc-dir/dc-file_996 auth v5994 s=3 n(v0 rc2023-10-03T19:17:10.705645+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553573f080] now 0 2023-10-03T19:21:12.137 INFO:teuthology.orchestra.run.smithi045.stdout: -3289> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5995 cv=5377/5377 ap=4+3 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=309 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x56553662a240 count now 4/3 2023-10-03T19:21:12.137 INFO:teuthology.orchestra.run.smithi045.stdout: -3288> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:12.137 INFO:teuthology.orchestra.run.smithi045.stdout: -3287> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:12.137 INFO:teuthology.orchestra.run.smithi045.stdout: -3286> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005da [2,head] /dc-dir/dc-file_997 auth v5226 pv5996 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.717049+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.717049+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553573f600] 2023-10-03T19:21:12.137 INFO:teuthology.orchestra.run.smithi045.stdout: -3285> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v6003 2023-10-03T19:21:12.138 INFO:teuthology.orchestra.run.smithi045.stdout: -3284> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v6003 pv6007 ap=4 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=4) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=3) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:12.138 INFO:teuthology.orchestra.run.smithi045.stdout: -3283> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=6001 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:12.138 INFO:teuthology.orchestra.run.smithi045.stdout: -3282> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=6002 cv=5384/5384 REP dir_auth=0 ap=3+4 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 6002 2023-10-03T19:21:12.138 INFO:teuthology.orchestra.run.smithi045.stdout: -3281> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005da) pop_and_dirty_projected_inode v5996 2023-10-03T19:21:12.138 INFO:teuthology.orchestra.run.smithi045.stdout: -3280> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005da) mark_dirty [inode 0x100000005da [2,head] /dc-dir/dc-file_997 auth v5996 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.717049+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553573f600] 2023-10-03T19:21:12.138 INFO:teuthology.orchestra.run.smithi045.stdout: -3279> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_997) mark_dirty [dentry #0x1/dc-dir/dc-file_997 [2,head] auth (dversion lock) pv=5996 v=5226 ino=0x100000005da state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535742500] 2023-10-03T19:21:12.138 INFO:teuthology.orchestra.run.smithi045.stdout: -3278> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5995 cv=5377/5377 ap=4+3 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=310 | child=1 dirty=1 authpin=1 0x565534f82400] version 5995 2023-10-03T19:21:12.138 INFO:teuthology.orchestra.run.smithi045.stdout: -3277> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x5655365ca140 v6004 2023-10-03T19:21:12.138 INFO:teuthology.orchestra.run.smithi045.stdout: -3276> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=6004 cv=5384/5384 REP dir_auth=0 ap=3+4 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 6004 2023-10-03T19:21:12.139 INFO:teuthology.orchestra.run.smithi045.stdout: -3275> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655365ca020 v5997 2023-10-03T19:21:12.139 INFO:teuthology.orchestra.run.smithi045.stdout: -3274> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5997 cv=5377/5377 ap=4+3 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=310 | child=1 dirty=1 authpin=1 0x565534f82400] version 5997 2023-10-03T19:21:12.139 INFO:teuthology.orchestra.run.smithi045.stdout: -3273> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=3 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=3 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:12.139 INFO:teuthology.orchestra.run.smithi045.stdout: -3272> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=3) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6003 pv6007 ap=4 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=4) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=3) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:12.139 INFO:teuthology.orchestra.run.smithi045.stdout: -3271> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=4) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6003 pv6007 ap=4 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=4) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=2) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:12.139 INFO:teuthology.orchestra.run.smithi045.stdout: -3270> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005da [2,head] /dc-dir/dc-file_997 auth v5996 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.717049+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553573f600] 2023-10-03T19:21:12.139 INFO:teuthology.orchestra.run.smithi045.stdout: -3269> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005da [2,head] /dc-dir/dc-file_997 auth v5996 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.717049+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553573f600] 2023-10-03T19:21:12.139 INFO:teuthology.orchestra.run.smithi045.stdout: -3268> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:12.139 INFO:teuthology.orchestra.run.smithi045.stdout: -3267> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:12.139 INFO:teuthology.orchestra.run.smithi045.stdout: -3266> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:12.139 INFO:teuthology.orchestra.run.smithi045.stdout: -3265> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005da [2,head] /dc-dir/dc-file_997 auth v5996 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.717049+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553573f600] 2023-10-03T19:21:12.140 INFO:teuthology.orchestra.run.smithi045.stdout: -3264> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005da [2,head] /dc-dir/dc-file_997 auth v5996 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.717049+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553573f600] 2023-10-03T19:21:12.140 INFO:teuthology.orchestra.run.smithi045.stdout: -3263> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:12.140 INFO:teuthology.orchestra.run.smithi045.stdout: -3262> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 723.454, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 7.23e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1449.7] 2023-10-03T19:21:12.140 INFO:teuthology.orchestra.run.smithi045.stdout: -3261> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x56553662b440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6003 pv6007 ap=3 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=3) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=2) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 3 2023-10-03T19:21:12.140 INFO:teuthology.orchestra.run.smithi045.stdout: -3260> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=6004 cv=5384/5384 REP dir_auth=0 ap=3+3 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x56553662b440 count now 3/3 2023-10-03T19:21:12.140 INFO:teuthology.orchestra.run.smithi045.stdout: -3259> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x56553662b440 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5997 cv=5377/5377 ap=3+3 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=310 | child=1 dirty=1 authpin=1 0x565534f82400] count now 3 2023-10-03T19:21:12.140 INFO:teuthology.orchestra.run.smithi045.stdout: -3258> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x56553662b440 on [dir 0x1 / [2,head] auth pv=6008 v=6004 cv=5384/5384 REP dir_auth=0 ap=2+3 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 2 2023-10-03T19:21:12.140 INFO:teuthology.orchestra.run.smithi045.stdout: -3257> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005da) auth_unpin by 0x56553662b440 on [inode 0x100000005da [2,head] /dc-dir/dc-file_997 auth v5996 s=3 n(v0 rc2023-10-03T19:17:10.717049+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553573f600] now 0 2023-10-03T19:21:12.140 INFO:teuthology.orchestra.run.smithi045.stdout: -3256> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5997 cv=5377/5377 ap=3+2 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=310 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x56553662b440 count now 3/2 2023-10-03T19:21:12.140 INFO:teuthology.orchestra.run.smithi045.stdout: -3255> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:12.141 INFO:teuthology.orchestra.run.smithi045.stdout: -3254> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:12.141 INFO:teuthology.orchestra.run.smithi045.stdout: -3253> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005db [2,head] /dc-dir/dc-file_998 auth v5230 pv5998 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.727981+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.727981+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553573fb80] 2023-10-03T19:21:12.141 INFO:teuthology.orchestra.run.smithi045.stdout: -3252> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v6005 2023-10-03T19:21:12.141 INFO:teuthology.orchestra.run.smithi045.stdout: -3251> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 pv6007 ap=3 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=3) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=2) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:12.201 INFO:teuthology.orchestra.run.smithi045.stdout: -3250> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=6003 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:12.201 INFO:teuthology.orchestra.run.smithi045.stdout: -3249> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=6004 cv=5384/5384 REP dir_auth=0 ap=2+3 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 6004 2023-10-03T19:21:12.201 INFO:teuthology.orchestra.run.smithi045.stdout: -3248> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005db) pop_and_dirty_projected_inode v5998 2023-10-03T19:21:12.201 INFO:teuthology.orchestra.run.smithi045.stdout: -3247> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005db) mark_dirty [inode 0x100000005db [2,head] /dc-dir/dc-file_998 auth v5998 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.727981+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x56553573fb80] 2023-10-03T19:21:12.201 INFO:teuthology.orchestra.run.smithi045.stdout: -3246> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_998) mark_dirty [dentry #0x1/dc-dir/dc-file_998 [2,head] auth (dversion lock) pv=5998 v=5230 ino=0x100000005db state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535742780] 2023-10-03T19:21:12.201 INFO:teuthology.orchestra.run.smithi045.stdout: -3245> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5997 cv=5377/5377 ap=3+2 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=311 | child=1 dirty=1 authpin=1 0x565534f82400] version 5997 2023-10-03T19:21:12.201 INFO:teuthology.orchestra.run.smithi045.stdout: -3244> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x5655365ca380 v6006 2023-10-03T19:21:12.202 INFO:teuthology.orchestra.run.smithi045.stdout: -3243> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=6006 cv=5384/5384 REP dir_auth=0 ap=2+3 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 6006 2023-10-03T19:21:12.202 INFO:teuthology.orchestra.run.smithi045.stdout: -3242> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655365ca260 v5999 2023-10-03T19:21:12.202 INFO:teuthology.orchestra.run.smithi045.stdout: -3241> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5999 cv=5377/5377 ap=3+2 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=311 | child=1 dirty=1 authpin=1 0x565534f82400] version 5999 2023-10-03T19:21:12.202 INFO:teuthology.orchestra.run.smithi045.stdout: -3240> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=2 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=2 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:12.202 INFO:teuthology.orchestra.run.smithi045.stdout: -3239> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=2) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 pv6007 ap=3 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=3) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=2) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:12.202 INFO:teuthology.orchestra.run.smithi045.stdout: -3238> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=3) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 pv6007 ap=3 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=3) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=1) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:12.202 INFO:teuthology.orchestra.run.smithi045.stdout: -3237> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005db [2,head] /dc-dir/dc-file_998 auth v5998 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.727981+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553573fb80] 2023-10-03T19:21:12.202 INFO:teuthology.orchestra.run.smithi045.stdout: -3236> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005db [2,head] /dc-dir/dc-file_998 auth v5998 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.727981+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553573fb80] 2023-10-03T19:21:12.202 INFO:teuthology.orchestra.run.smithi045.stdout: -3235> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:12.203 INFO:teuthology.orchestra.run.smithi045.stdout: -3234> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:12.203 INFO:teuthology.orchestra.run.smithi045.stdout: -3233> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:12.203 INFO:teuthology.orchestra.run.smithi045.stdout: -3232> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005db [2,head] /dc-dir/dc-file_998 auth v5998 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.727981+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553573fb80] 2023-10-03T19:21:12.203 INFO:teuthology.orchestra.run.smithi045.stdout: -3231> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005db [2,head] /dc-dir/dc-file_998 auth v5998 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.727981+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x56553573fb80] 2023-10-03T19:21:12.203 INFO:teuthology.orchestra.run.smithi045.stdout: -3230> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:12.203 INFO:teuthology.orchestra.run.smithi045.stdout: -3229> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 724.454, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 7.24e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1451.7] 2023-10-03T19:21:12.203 INFO:teuthology.orchestra.run.smithi045.stdout: -3228> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535b97d40 on [dir 0x1 / [2,head] auth pv=6008 v=6006 cv=5384/5384 REP dir_auth=0 ap=1+3 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] count now 1 2023-10-03T19:21:12.203 INFO:teuthology.orchestra.run.smithi045.stdout: -3227> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535b97d40 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 pv6007 ap=2 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=2) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=1) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 2 2023-10-03T19:21:12.203 INFO:teuthology.orchestra.run.smithi045.stdout: -3226> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth pv=6008 v=6006 cv=5384/5384 REP dir_auth=0 ap=1+2 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] by 0x565535b97d40 count now 1/2 2023-10-03T19:21:12.203 INFO:teuthology.orchestra.run.smithi045.stdout: -3225> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535b97d40 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5999 cv=5377/5377 ap=2+2 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=311 | child=1 dirty=1 authpin=1 0x565534f82400] count now 2 2023-10-03T19:21:12.203 INFO:teuthology.orchestra.run.smithi045.stdout: -3224> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005db) auth_unpin by 0x565535b97d40 on [inode 0x100000005db [2,head] /dc-dir/dc-file_998 auth v5998 s=3 n(v0 rc2023-10-03T19:17:10.727981+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553573fb80] now 0 2023-10-03T19:21:12.204 INFO:teuthology.orchestra.run.smithi045.stdout: -3223> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5999 cv=5377/5377 ap=2+1 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=311 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535b97d40 count now 2/1 2023-10-03T19:21:12.204 INFO:teuthology.orchestra.run.smithi045.stdout: -3222> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:12.204 INFO:teuthology.orchestra.run.smithi045.stdout: -3221> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 MDSContext::complete: 26C_Locker_FileUpdate_finish 2023-10-03T19:21:12.204 INFO:teuthology.orchestra.run.smithi045.stdout: -3220> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.locker file_update_finish on [inode 0x100000005dc [2,head] /dc-dir/dc-file_999 auth v5234 pv6000 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.740067+0000 b3 1=1+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) cr={6102=0-4194304@1} caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535740100] 2023-10-03T19:21:12.204 INFO:teuthology.orchestra.run.smithi045.stdout: -3219> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v6007 2023-10-03T19:21:12.204 INFO:teuthology.orchestra.run.smithi045.stdout: -3218> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /dc-dir/ auth v6007 ap=2 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=2) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=1) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:12.204 INFO:teuthology.orchestra.run.smithi045.stdout: -3217> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.den(0x1 dc-dir) mark_dirty [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) pv=6007 v=6005 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:12.204 INFO:teuthology.orchestra.run.smithi045.stdout: -3216> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=6008 v=6006 cv=5384/5384 REP dir_auth=0 ap=1+2 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1)->f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1)->n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 6006 2023-10-03T19:21:12.204 INFO:teuthology.orchestra.run.smithi045.stdout: -3215> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.ino(0x100000005dc) pop_and_dirty_projected_inode v6000 2023-10-03T19:21:12.205 INFO:teuthology.orchestra.run.smithi045.stdout: -3214> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005dc) mark_dirty [inode 0x100000005dc [2,head] /dc-dir/dc-file_999 auth v6000 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.740067+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=0 authpin=1 0x565535740100] 2023-10-03T19:21:12.205 INFO:teuthology.orchestra.run.smithi045.stdout: -3213> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.den(0x10000000000 dc-file_999) mark_dirty [dentry #0x1/dc-dir/dc-file_999 [2,head] auth (dversion lock) pv=6000 v=5234 ino=0x100000005dc state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 0x565535742a00] 2023-10-03T19:21:12.205 INFO:teuthology.orchestra.run.smithi045.stdout: -3212> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth pv=6001 v=5999 cv=5377/5377 ap=2+1 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0)->f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0)->n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=312 | child=1 dirty=1 authpin=1 0x565534f82400] version 5999 2023-10-03T19:21:12.205 INFO:teuthology.orchestra.run.smithi045.stdout: -3211> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x5655365ca5c0 v6008 2023-10-03T19:21:12.205 INFO:teuthology.orchestra.run.smithi045.stdout: -3210> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth v=6008 cv=5384/5384 REP dir_auth=0 ap=1+2 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x565534040d00] version 6008 2023-10-03T19:21:12.205 INFO:teuthology.orchestra.run.smithi045.stdout: -3209> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x5655365ca4a0 v6001 2023-10-03T19:21:12.205 INFO:teuthology.orchestra.run.smithi045.stdout: -3208> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=5377/5377 ap=2+1 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=312 | child=1 dirty=1 authpin=1 0x565534f82400] version 6001 2023-10-03T19:21:12.205 INFO:teuthology.orchestra.run.smithi045.stdout: -3207> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=1 dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock w=1 dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:12.205 INFO:teuthology.orchestra.run.smithi045.stdout: -3206> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.locker scatter_eval (inest lock dirty) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=2 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:12.205 INFO:teuthology.orchestra.run.smithi045.stdout: -3205> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker local_wrlock_finish on (iversion lock w=1) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6007 ap=2 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=2) (ipolicy sync r=1) (ifile excl w=1) (iversion lock w=1) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=6 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:12.206 INFO:teuthology.orchestra.run.smithi045.stdout: -3204> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (inest lock w=2) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6007 ap=2 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=2) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=5 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:12.206 INFO:teuthology.orchestra.run.smithi045.stdout: -3203> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x100000005dc [2,head] /dc-dir/dc-file_999 auth v6000 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.740067+0000 b3 1=1+0) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=1 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535740100] 2023-10-03T19:21:12.206 INFO:teuthology.orchestra.run.smithi045.stdout: -3202> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x100000005dc [2,head] /dc-dir/dc-file_999 auth v6000 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.740067+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535740100] 2023-10-03T19:21:12.206 INFO:teuthology.orchestra.run.smithi045.stdout: -3201> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:12.206 INFO:teuthology.orchestra.run.smithi045.stdout: -3200> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued=sc other_issued= xlocker_issued= 2023-10-03T19:21:12.206 INFO:teuthology.orchestra.run.smithi045.stdout: -3199> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:12.206 INFO:teuthology.orchestra.run.smithi045.stdout: -3198> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x100000005dc [2,head] /dc-dir/dc-file_999 auth v6000 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.740067+0000 b3 1=1+0) (ifile excl) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535740100] 2023-10-03T19:21:12.206 INFO:teuthology.orchestra.run.smithi045.stdout: -3197> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 7 mds.0.locker get_allowed_caps loner client.6102 allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl, others allowed=pAsLsXsFscrl on [inode 0x100000005dc [2,head] /dc-dir/dc-file_999 auth v6000 ap=1 s=3 n(v0 rc2023-10-03T19:17:10.740067+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=1 0x565535740100] 2023-10-03T19:21:12.206 INFO:teuthology.orchestra.run.smithi045.stdout: -3196> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.locker client.6102 pending pAsLsXsFsc allowed pAsLsXsFscrl wanted - 2023-10-03T19:21:12.206 INFO:teuthology.orchestra.run.smithi045.stdout: -3195> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 20 mds.0.bal hit_dir 1 pop is 725.454, frag * size 1000 [pop IRD:[C 0.00e+00] IWR:[C 7.25e+02] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.98e-01] *LOAD:1453.7] 2023-10-03T19:21:12.206 INFO:teuthology.orchestra.run.smithi045.stdout: -3194> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x1) auth_unpin by 0x565535b97440 on [dir 0x1 / [2,head] auth v=6008 cv=5384/5384 REP dir_auth=0 ap=0+2 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=0 0x565534040d00] count now 0 2023-10-03T19:21:12.207 INFO:teuthology.orchestra.run.smithi045.stdout: -3193> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x565535b97440 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6007 ap=1 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=5 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] now 1 2023-10-03T19:21:12.304 INFO:teuthology.orchestra.run.smithi045.stdout: -3192> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth v=6008 cv=5384/5384 REP dir_auth=0 ap=0+1 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=0 0x565534040d00] by 0x565535b97440 count now 0/1 2023-10-03T19:21:12.304 INFO:teuthology.orchestra.run.smithi045.stdout: -3191> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x565535b97440 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=5377/5377 ap=1+1 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=312 | child=1 dirty=1 authpin=1 0x565534f82400] count now 1 2023-10-03T19:21:12.305 INFO:teuthology.orchestra.run.smithi045.stdout: -3190> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005dc) auth_unpin by 0x565535b97440 on [inode 0x100000005dc [2,head] /dc-dir/dc-file_999 auth v6000 s=3 n(v0 rc2023-10-03T19:17:10.740067+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=1 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535740100] now 0 2023-10-03T19:21:12.305 INFO:teuthology.orchestra.run.smithi045.stdout: -3189> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=5377/5377 ap=1+0 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=312 | child=1 dirty=1 authpin=1 0x565534f82400] by 0x565535b97440 count now 1/0 2023-10-03T19:21:12.305 INFO:teuthology.orchestra.run.smithi045.stdout: -3188> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 20C_MDS_session_finish 2023-10-03T19:21:12.305 INFO:teuthology.orchestra.run.smithi045.stdout: -3187> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 MDSContext::complete: 20C_MDS_session_finish 2023-10-03T19:21:12.305 INFO:teuthology.orchestra.run.smithi045.stdout: -3186> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.server _session_logged client.6102 172.21.15.146:0/2314684411 state_seq 3 close 1005 inos_to_free [0x100000005dd~0x1f7] inotablev 5 inos_to_purge [0x10000000002~0x1f4] 2023-10-03T19:21:12.305 INFO:teuthology.orchestra.run.smithi045.stdout: -3185> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 10 mds.0.cache purge_inodes purging inos [0x10000000002~0x1f4] logseg 2699 2023-10-03T19:21:12.306 INFO:teuthology.orchestra.run.smithi045.stdout: -3184> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2068 10.12 10:4bec3886:::10000000002.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350a7500 con 0x565534ffe800 2023-10-03T19:21:12.306 INFO:teuthology.orchestra.run.smithi045.stdout: -3183> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2069 10.32 10:4def72d4:::10000000003.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535546a80 con 0x565534ef4c00 2023-10-03T19:21:12.306 INFO:teuthology.orchestra.run.smithi045.stdout: -3182> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2070 10.5 10:a367a3e8:::10000000004.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553515ce00 con 0x5655354ba000 2023-10-03T19:21:12.306 INFO:teuthology.orchestra.run.smithi045.stdout: -3181> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2071 10.9 10:9258b67d:::10000000005.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535649500 con 0x565534151000 2023-10-03T19:21:12.307 INFO:teuthology.orchestra.run.smithi045.stdout: -3180> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2072 10.25 10:a5feb6f3:::10000000006.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553560d880 con 0x565534ef4800 2023-10-03T19:21:12.307 INFO:teuthology.orchestra.run.smithi045.stdout: -3179> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2073 10.1d 10:bbf5850a:::10000000007.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655354a6700 con 0x565534ef4800 2023-10-03T19:21:12.307 INFO:teuthology.orchestra.run.smithi045.stdout: -3178> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2074 10.13 10:cabe77c1:::10000000008.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350a7180 con 0x565534ef4400 2023-10-03T19:21:12.307 INFO:teuthology.orchestra.run.smithi045.stdout: -3177> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2075 10.34 10:2eb4da2b:::10000000009.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534e2e700 con 0x565534151000 2023-10-03T19:21:12.307 INFO:teuthology.orchestra.run.smithi045.stdout: -3176> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2076 10.22 10:45d72e17:::1000000000a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553528aa80 con 0x565534151000 2023-10-03T19:21:12.307 INFO:teuthology.orchestra.run.smithi045.stdout: -3175> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2077 10.29 10:9752f43f:::1000000000b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553528dc00 con 0x565534ef5400 2023-10-03T19:21:12.308 INFO:teuthology.orchestra.run.smithi045.stdout: -3174> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2078 10.22 10:46cca9ab:::1000000000c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553548e000 con 0x565534151000 2023-10-03T19:21:12.308 INFO:teuthology.orchestra.run.smithi045.stdout: -3173> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2079 10.17 10:e9ecae36:::1000000000d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350ac000 con 0x565534ef4800 2023-10-03T19:21:12.308 INFO:teuthology.orchestra.run.smithi045.stdout: -3172> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2080 10.37 10:eefe613f:::1000000000e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534fcca80 con 0x565534ef4c00 2023-10-03T19:21:12.308 INFO:teuthology.orchestra.run.smithi045.stdout: -3171> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2081 10.12 10:49e35fbc:::1000000000f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535269500 con 0x565534ffe800 2023-10-03T19:21:12.308 INFO:teuthology.orchestra.run.smithi045.stdout: -3170> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2082 10.3b 10:dde6a3df:::10000000010.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350ad500 con 0x565534ffe800 2023-10-03T19:21:12.309 INFO:teuthology.orchestra.run.smithi045.stdout: -3169> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2083 10.15 10:ab5910e2:::10000000011.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553515d880 con 0x565534ef5400 2023-10-03T19:21:12.309 INFO:teuthology.orchestra.run.smithi045.stdout: -3168> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2084 10.d 10:b185e6e8:::10000000012.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535012a80 con 0x565534ffe800 2023-10-03T19:21:12.309 INFO:teuthology.orchestra.run.smithi045.stdout: -3167> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2085 10.22 10:44834937:::10000000013.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534fcdc00 con 0x565534151000 2023-10-03T19:21:12.309 INFO:teuthology.orchestra.run.smithi045.stdout: -3166> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2086 10.10 10:0b7da9c3:::10000000014.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535247c00 con 0x565534ef5400 2023-10-03T19:21:12.310 INFO:teuthology.orchestra.run.smithi045.stdout: -3165> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2087 10.36 10:6dc1a442:::10000000015.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553518b180 con 0x565534ef4c00 2023-10-03T19:21:12.310 INFO:teuthology.orchestra.run.smithi045.stdout: -3164> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2088 10.38 10:1e20cbdb:::10000000016.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350b8380 con 0x565534151000 2023-10-03T19:21:12.310 INFO:teuthology.orchestra.run.smithi045.stdout: -3163> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2089 10.1e 10:78cea7f0:::10000000017.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553518b880 con 0x565534ef5000 2023-10-03T19:21:12.310 INFO:teuthology.orchestra.run.smithi045.stdout: -3162> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2090 10.1a 10:5b3b19a5:::10000000018.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350ff180 con 0x565534ffe800 2023-10-03T19:21:12.310 INFO:teuthology.orchestra.run.smithi045.stdout: -3161> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2091 10.21 10:86d8200e:::10000000019.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535112700 con 0x565534ef5400 2023-10-03T19:21:12.310 INFO:teuthology.orchestra.run.smithi045.stdout: -3160> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2092 10.20 10:072a8150:::1000000001a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655354a6000 con 0x565534ef5000 2023-10-03T19:21:12.310 INFO:teuthology.orchestra.run.smithi045.stdout: -3159> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2093 10.8 10:12420902:::1000000001b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350e7c00 con 0x565534ef5000 2023-10-03T19:21:12.310 INFO:teuthology.orchestra.run.smithi045.stdout: -3158> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2094 10.16 10:6a54d456:::1000000001c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655364d9880 con 0x565534ffe800 2023-10-03T19:21:12.310 INFO:teuthology.orchestra.run.smithi045.stdout: -3157> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2095 10.33 10:cf746ac5:::1000000001d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655364ac700 con 0x565534151000 2023-10-03T19:21:12.310 INFO:teuthology.orchestra.run.smithi045.stdout: -3156> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2096 10.32 10:4f7da3cc:::1000000001e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553647e000 con 0x565534ef4c00 2023-10-03T19:21:12.311 INFO:teuthology.orchestra.run.smithi045.stdout: -3155> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2097 10.3a 10:5f13809d:::1000000001f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363cf880 con 0x565534ef5000 2023-10-03T19:21:12.311 INFO:teuthology.orchestra.run.smithi045.stdout: -3154> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2098 10.22 10:4503a7ea:::10000000020.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553630e000 con 0x565534151000 2023-10-03T19:21:12.311 INFO:teuthology.orchestra.run.smithi045.stdout: -3153> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2099 10.b 10:d3d0d483:::10000000021.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534fa1880 con 0x565534ffe800 2023-10-03T19:21:12.355 INFO:teuthology.orchestra.run.smithi045.stdout: -3152> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2100 10.b 10:d2626379:::10000000022.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553560d180 con 0x565534ffe800 2023-10-03T19:21:12.355 INFO:teuthology.orchestra.run.smithi045.stdout: -3151> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2101 10.17 10:eb6757d1:::10000000023.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535546000 con 0x565534ef4800 2023-10-03T19:21:12.355 INFO:teuthology.orchestra.run.smithi045.stdout: -3150> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2102 10.2f 10:f6ddf183:::10000000024.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350a6700 con 0x565534ef4400 2023-10-03T19:21:12.355 INFO:teuthology.orchestra.run.smithi045.stdout: -3149> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2103 10.14 10:2a40c2ef:::10000000025.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534143880 con 0x565534ef4400 2023-10-03T19:21:12.356 INFO:teuthology.orchestra.run.smithi045.stdout: -3148> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2104 10.3d 10:be1922a8:::10000000026.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655365fd500 con 0x565534ef4c00 2023-10-03T19:21:12.356 INFO:teuthology.orchestra.run.smithi045.stdout: -3147> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2105 10.d 10:b0d15537:::10000000027.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536500e00 con 0x565534ffe800 2023-10-03T19:21:12.356 INFO:teuthology.orchestra.run.smithi045.stdout: -3146> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2106 10.1d 10:ba3960b0:::10000000028.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655364ac380 con 0x565534ef4800 2023-10-03T19:21:12.356 INFO:teuthology.orchestra.run.smithi045.stdout: -3145> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2107 10.18 10:19311010:::10000000029.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553559e380 con 0x5655354ba000 2023-10-03T19:21:12.356 INFO:teuthology.orchestra.run.smithi045.stdout: -3144> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2108 10.3c 10:3d4c06c4:::1000000002a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535272a80 con 0x565534ef4800 2023-10-03T19:21:12.356 INFO:teuthology.orchestra.run.smithi045.stdout: -3143> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2109 10.26 10:645408ac:::1000000002b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536337500 con 0x565534151000 2023-10-03T19:21:12.356 INFO:teuthology.orchestra.run.smithi045.stdout: -3142> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2110 10.25 10:a622384a:::1000000002c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535503880 con 0x565534ef4800 2023-10-03T19:21:12.356 INFO:teuthology.orchestra.run.smithi045.stdout: -3141> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2111 10.26 10:660982fc:::1000000002d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535119180 con 0x565534151000 2023-10-03T19:21:12.357 INFO:teuthology.orchestra.run.smithi045.stdout: -3140> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2112 10.12 10:49ffa098:::1000000002e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350b8000 con 0x565534ffe800 2023-10-03T19:21:12.357 INFO:teuthology.orchestra.run.smithi045.stdout: -3139> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2113 10.23 10:c550f404:::1000000002f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350b9500 con 0x565534ef4c00 2023-10-03T19:21:12.357 INFO:teuthology.orchestra.run.smithi045.stdout: -3138> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2114 10.3 10:c1adcc3d:::10000000030.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534e2ea80 con 0x5655354ba000 2023-10-03T19:21:12.357 INFO:teuthology.orchestra.run.smithi045.stdout: -3137> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2115 10.1b 10:d88bb762:::10000000031.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350ba000 con 0x565534ef5400 2023-10-03T19:21:12.357 INFO:teuthology.orchestra.run.smithi045.stdout: -3136> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2116 10.31 10:8ea80fc8:::10000000032.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535502700 con 0x565534ef4c00 2023-10-03T19:21:12.357 INFO:teuthology.orchestra.run.smithi045.stdout: -3135> 2023-10-03T19:17:19.554+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2117 10.3e 10:7e2d0da6:::10000000033.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350adc00 con 0x565534ef4400 2023-10-03T19:21:12.357 INFO:teuthology.orchestra.run.smithi045.stdout: -3134> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2118 10.1 10:81df0dbf:::10000000034.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535413180 con 0x565534ef4800 2023-10-03T19:21:12.358 INFO:teuthology.orchestra.run.smithi045.stdout: -3133> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2119 10.38 10:1e1620c8:::10000000035.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535546700 con 0x565534151000 2023-10-03T19:21:12.358 INFO:teuthology.orchestra.run.smithi045.stdout: -3132> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2120 10.2b 10:d747f723:::10000000036.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535017c00 con 0x565534151000 2023-10-03T19:21:12.358 INFO:teuthology.orchestra.run.smithi045.stdout: -3131> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2121 10.6 10:60a13eb4:::10000000037.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655355ca700 con 0x565534151000 2023-10-03T19:21:12.358 INFO:teuthology.orchestra.run.smithi045.stdout: -3130> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2122 10.26 10:65f9ba37:::10000000038.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363ce700 con 0x565534151000 2023-10-03T19:21:12.358 INFO:teuthology.orchestra.run.smithi045.stdout: -3129> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2123 10.22 10:44135715:::10000000039.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553630e380 con 0x565534151000 2023-10-03T19:21:12.358 INFO:teuthology.orchestra.run.smithi045.stdout: -3128> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2124 10.f 10:f1a9c549:::1000000003a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535112e00 con 0x565534ffe800 2023-10-03T19:21:12.359 INFO:teuthology.orchestra.run.smithi045.stdout: -3127> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2125 10.3c 10:3c3d7520:::1000000003b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535269c00 con 0x565534ef4800 2023-10-03T19:21:12.359 INFO:teuthology.orchestra.run.smithi045.stdout: -3126> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2126 10.8 10:12420646:::1000000003c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536651500 con 0x565534ef5000 2023-10-03T19:21:12.359 INFO:teuthology.orchestra.run.smithi045.stdout: -3125> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2127 10.6 10:614fee2a:::1000000003d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536651c00 con 0x565534151000 2023-10-03T19:21:12.359 INFO:teuthology.orchestra.run.smithi045.stdout: -3124> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2128 10.2c 10:3665eb52:::1000000003e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553667ca80 con 0x565534ef5400 2023-10-03T19:21:12.359 INFO:teuthology.orchestra.run.smithi045.stdout: -3123> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2129 10.32 10:4ecb6bb7:::1000000003f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553667ce00 con 0x565534ef4c00 2023-10-03T19:21:12.359 INFO:teuthology.orchestra.run.smithi045.stdout: -3122> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2130 10.23 10:c6a0a389:::10000000040.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536450a80 con 0x565534ef4c00 2023-10-03T19:21:12.359 INFO:teuthology.orchestra.run.smithi045.stdout: -3121> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2131 10.2b 10:d4b9b687:::10000000041.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536427c00 con 0x565534151000 2023-10-03T19:21:12.359 INFO:teuthology.orchestra.run.smithi045.stdout: -3120> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2132 10.6 10:61404748:::10000000042.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350ace00 con 0x565534151000 2023-10-03T19:21:12.359 INFO:teuthology.orchestra.run.smithi045.stdout: -3119> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2133 10.16 10:6a415a36:::10000000043.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363cfc00 con 0x565534ffe800 2023-10-03T19:21:12.359 INFO:teuthology.orchestra.run.smithi045.stdout: -3118> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2134 10.1a 10:5bd35317:::10000000044.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655364d9500 con 0x565534ffe800 2023-10-03T19:21:12.359 INFO:teuthology.orchestra.run.smithi045.stdout: -3117> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2135 10.36 10:6f6f8b6e:::10000000045.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553548f500 con 0x565534ef4c00 2023-10-03T19:21:12.360 INFO:teuthology.orchestra.run.smithi045.stdout: -3116> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2136 10.26 10:678705fb:::10000000046.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363fc380 con 0x565534151000 2023-10-03T19:21:12.360 INFO:teuthology.orchestra.run.smithi045.stdout: -3115> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2137 10.8 10:1044c7a4:::10000000047.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553560c380 con 0x565534ef5000 2023-10-03T19:21:12.360 INFO:teuthology.orchestra.run.smithi045.stdout: -3114> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2138 10.12 10:4899516f:::10000000048.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536451c00 con 0x565534ffe800 2023-10-03T19:21:12.360 INFO:teuthology.orchestra.run.smithi045.stdout: -3113> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2139 10.7 10:e2d50132:::10000000049.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553630f500 con 0x565534ffe800 2023-10-03T19:21:12.360 INFO:teuthology.orchestra.run.smithi045.stdout: -3112> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2140 10.2f 10:f7911ae7:::1000000004a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553560dc00 con 0x565534ef4400 2023-10-03T19:21:12.360 INFO:teuthology.orchestra.run.smithi045.stdout: -3111> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2141 10.31 10:8e5cc622:::1000000004b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363a3880 con 0x565534ef4c00 2023-10-03T19:21:12.360 INFO:teuthology.orchestra.run.smithi045.stdout: -3110> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2142 10.21 10:844eae9e:::1000000004c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536450e00 con 0x565534ef5400 2023-10-03T19:21:12.360 INFO:teuthology.orchestra.run.smithi045.stdout: -3109> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2143 10.36 10:6c82bb73:::1000000004d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363cf180 con 0x565534ef4c00 2023-10-03T19:21:12.360 INFO:teuthology.orchestra.run.smithi045.stdout: -3108> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2144 10.29 10:954bc910:::1000000004e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553630ea80 con 0x565534ef5400 2023-10-03T19:21:12.360 INFO:teuthology.orchestra.run.smithi045.stdout: -3107> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2145 10.21 10:8660ae9f:::1000000004f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535502a80 con 0x565534ef5400 2023-10-03T19:21:12.361 INFO:teuthology.orchestra.run.smithi045.stdout: -3106> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2146 10.16 10:69de5632:::10000000050.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655355fca80 con 0x565534ffe800 2023-10-03T19:21:12.361 INFO:teuthology.orchestra.run.smithi045.stdout: -3105> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2147 10.19 10:9ae7aaf4:::10000000051.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535113500 con 0x565534ef4400 2023-10-03T19:21:12.361 INFO:teuthology.orchestra.run.smithi045.stdout: -3104> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2148 10.b 10:d30f9a54:::10000000052.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535503500 con 0x565534ffe800 2023-10-03T19:21:12.361 INFO:teuthology.orchestra.run.smithi045.stdout: -3103> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2149 10.16 10:6a23747e:::10000000053.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535412380 con 0x565534ffe800 2023-10-03T19:21:12.458 INFO:teuthology.orchestra.run.smithi045.stdout: -3102> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2150 10.0 10:03de5254:::10000000054.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553559f500 con 0x565534ffe800 2023-10-03T19:21:12.458 INFO:teuthology.orchestra.run.smithi045.stdout: -3101> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2151 10.32 10:4d757255:::10000000055.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534e2e000 con 0x565534ef4c00 2023-10-03T19:21:12.459 INFO:teuthology.orchestra.run.smithi045.stdout: -3100> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2152 10.28 10:166e0f51:::10000000056.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553518ae00 con 0x565534ef4c00 2023-10-03T19:21:12.459 INFO:teuthology.orchestra.run.smithi045.stdout: -3099> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2153 10.2e 10:74dc0bdf:::10000000057.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535515500 con 0x565534ef4800 2023-10-03T19:21:12.459 INFO:teuthology.orchestra.run.smithi045.stdout: -3098> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2154 10.14 10:2b0a3bc5:::10000000058.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655354a7880 con 0x565534ef4400 2023-10-03T19:21:12.459 INFO:teuthology.orchestra.run.smithi045.stdout: -3097> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2155 10.31 10:8ff022d2:::10000000059.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553528bc00 con 0x565534ef4c00 2023-10-03T19:21:12.459 INFO:teuthology.orchestra.run.smithi045.stdout: -3096> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2156 10.18 10:1ae6cdf3:::1000000005a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553515c700 con 0x5655354ba000 2023-10-03T19:21:12.459 INFO:teuthology.orchestra.run.smithi045.stdout: -3095> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2157 10.39 10:9fc48627:::1000000005b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535625880 con 0x5655354ba000 2023-10-03T19:21:12.460 INFO:teuthology.orchestra.run.smithi045.stdout: -3094> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2158 10.30 10:0cbf7f79:::1000000005c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535158380 con 0x5655354ba000 2023-10-03T19:21:12.460 INFO:teuthology.orchestra.run.smithi045.stdout: -3093> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2159 10.2d 10:b5236558:::1000000005d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535624700 con 0x565534ffe800 2023-10-03T19:21:12.460 INFO:teuthology.orchestra.run.smithi045.stdout: -3092> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2160 10.21 10:870ac4b3:::1000000005e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535273500 con 0x565534ef5400 2023-10-03T19:21:12.460 INFO:teuthology.orchestra.run.smithi045.stdout: -3091> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2161 10.2c 10:34658595:::1000000005f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534fcc700 con 0x565534ef5400 2023-10-03T19:21:12.460 INFO:teuthology.orchestra.run.smithi045.stdout: -3090> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2162 10.3 10:c001b242:::10000000060.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535558000 con 0x5655354ba000 2023-10-03T19:21:12.460 INFO:teuthology.orchestra.run.smithi045.stdout: -3089> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2163 10.0 10:0181e5f0:::10000000061.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553559f180 con 0x565534ffe800 2023-10-03T19:21:12.460 INFO:teuthology.orchestra.run.smithi045.stdout: -3088> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2164 10.30 10:0d373645:::10000000062.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535547c00 con 0x5655354ba000 2023-10-03T19:21:12.460 INFO:teuthology.orchestra.run.smithi045.stdout: -3087> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2165 10.26 10:66f1e28f:::10000000063.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350fe380 con 0x565534151000 2023-10-03T19:21:12.460 INFO:teuthology.orchestra.run.smithi045.stdout: -3086> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2166 10.20 10:0699973a:::10000000064.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535013500 con 0x565534ef5000 2023-10-03T19:21:12.461 INFO:teuthology.orchestra.run.smithi045.stdout: -3085> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2167 10.f 10:f2d196a0:::10000000065.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535514e00 con 0x565534ffe800 2023-10-03T19:21:12.461 INFO:teuthology.orchestra.run.smithi045.stdout: -3084> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2168 10.38 10:1cab634c:::10000000066.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534fa0380 con 0x565534151000 2023-10-03T19:21:12.461 INFO:teuthology.orchestra.run.smithi045.stdout: -3083> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2169 10.37 10:ef5f0c51:::10000000067.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553528ca80 con 0x565534ef4c00 2023-10-03T19:21:12.461 INFO:teuthology.orchestra.run.smithi045.stdout: -3082> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2170 10.1c 10:3b87fee9:::10000000068.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535648a80 con 0x565534ffe800 2023-10-03T19:21:12.461 INFO:teuthology.orchestra.run.smithi045.stdout: -3081> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2171 10.3 10:c2cd23b6:::10000000069.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553560d500 con 0x5655354ba000 2023-10-03T19:21:12.462 INFO:teuthology.orchestra.run.smithi045.stdout: -3080> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2172 10.c 10:31e782ee:::1000000006a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655354a6e00 con 0x565534ef5400 2023-10-03T19:21:12.462 INFO:teuthology.orchestra.run.smithi045.stdout: -3079> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2173 10.1d 10:bbf235fa:::1000000006b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350bb880 con 0x565534ef4800 2023-10-03T19:21:12.462 INFO:teuthology.orchestra.run.smithi045.stdout: -3078> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2174 10.2b 10:d50f8d72:::1000000006c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350a6e00 con 0x565534151000 2023-10-03T19:21:12.462 INFO:teuthology.orchestra.run.smithi045.stdout: -3077> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2175 10.37 10:eeccecf9:::1000000006d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655355fd500 con 0x565534ef4c00 2023-10-03T19:21:12.462 INFO:teuthology.orchestra.run.smithi045.stdout: -3076> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2176 10.11 10:88725faf:::1000000006e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535413880 con 0x565534151000 2023-10-03T19:21:12.462 INFO:teuthology.orchestra.run.smithi045.stdout: -3075> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2177 10.21 10:862b00fc:::1000000006f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350b8700 con 0x565534ef5400 2023-10-03T19:21:12.462 INFO:teuthology.orchestra.run.smithi045.stdout: -3074> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2178 10.1d 10:b941cebe:::10000000070.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535547180 con 0x565534ef4800 2023-10-03T19:21:12.463 INFO:teuthology.orchestra.run.smithi045.stdout: -3073> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2179 10.10 10:0b002978:::10000000071.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534e2f880 con 0x565534ef5400 2023-10-03T19:21:12.463 INFO:teuthology.orchestra.run.smithi045.stdout: -3072> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2180 10.2e 10:74d940fa:::10000000072.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535624a80 con 0x565534ef4800 2023-10-03T19:21:12.463 INFO:teuthology.orchestra.run.smithi045.stdout: -3071> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2181 10.e 10:730aba89:::10000000073.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535159c00 con 0x565534ef4800 2023-10-03T19:21:12.463 INFO:teuthology.orchestra.run.smithi045.stdout: -3070> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2182 10.22 10:46f2014a:::10000000074.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535158700 con 0x565534151000 2023-10-03T19:21:12.463 INFO:teuthology.orchestra.run.smithi045.stdout: -3069> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2183 10.4 10:2045e544:::10000000075.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534143180 con 0x565534ef5000 2023-10-03T19:21:12.463 INFO:teuthology.orchestra.run.smithi045.stdout: -3068> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2184 10.13 10:ca508270:::10000000076.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534e2fc00 con 0x565534ef4400 2023-10-03T19:21:12.463 INFO:teuthology.orchestra.run.smithi045.stdout: -3067> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2185 10.1d 10:bab01cd9:::10000000077.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534fa1180 con 0x565534ef4800 2023-10-03T19:21:12.463 INFO:teuthology.orchestra.run.smithi045.stdout: -3066> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2186 10.38 10:1da7f472:::10000000078.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655355fc380 con 0x565534151000 2023-10-03T19:21:12.463 INFO:teuthology.orchestra.run.smithi045.stdout: -3065> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2187 10.19 10:99ec5763:::10000000079.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553515ca80 con 0x565534ef4400 2023-10-03T19:21:12.463 INFO:teuthology.orchestra.run.smithi045.stdout: -3064> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2188 10.2 10:4211db15:::1000000007a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535016380 con 0x565534ef4400 2023-10-03T19:21:12.508 INFO:teuthology.orchestra.run.smithi045.stdout: -3063> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2189 10.a 10:51fb4558:::1000000007b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535119500 con 0x565534ffe800 2023-10-03T19:21:12.508 INFO:teuthology.orchestra.run.smithi045.stdout: -3062> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2190 10.1d 10:bb142d16:::1000000007c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553515d500 con 0x565534ef4800 2023-10-03T19:21:12.508 INFO:teuthology.orchestra.run.smithi045.stdout: -3061> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2191 10.1e 10:7ab9e14a:::1000000007d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535016e00 con 0x565534ef5000 2023-10-03T19:21:12.508 INFO:teuthology.orchestra.run.smithi045.stdout: -3060> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2192 10.3d 10:bf02216c:::1000000007e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350ad180 con 0x565534ef4c00 2023-10-03T19:21:12.508 INFO:teuthology.orchestra.run.smithi045.stdout: -3059> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2193 10.30 10:0ffe11ed:::1000000007f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553528ae00 con 0x5655354ba000 2023-10-03T19:21:12.508 INFO:teuthology.orchestra.run.smithi045.stdout: -3058> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2194 10.30 10:0f444cf3:::10000000080.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534142000 con 0x5655354ba000 2023-10-03T19:21:12.508 INFO:teuthology.orchestra.run.smithi045.stdout: -3057> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2195 10.3 10:c27cb132:::10000000081.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350aca80 con 0x5655354ba000 2023-10-03T19:21:12.509 INFO:teuthology.orchestra.run.smithi045.stdout: -3056> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2196 10.39 10:9eab5bef:::10000000082.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350b8e00 con 0x5655354ba000 2023-10-03T19:21:12.509 INFO:teuthology.orchestra.run.smithi045.stdout: -3055> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2197 10.26 10:67d353d7:::10000000083.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350ffc00 con 0x565534151000 2023-10-03T19:21:12.509 INFO:teuthology.orchestra.run.smithi045.stdout: -3054> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2198 10.4 10:21b748bd:::10000000084.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350fe000 con 0x565534ef5000 2023-10-03T19:21:12.509 INFO:teuthology.orchestra.run.smithi045.stdout: -3053> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2199 10.10 10:0a074d4e:::10000000085.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535413500 con 0x565534ef5400 2023-10-03T19:21:12.509 INFO:teuthology.orchestra.run.smithi045.stdout: -3052> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2200 10.2e 10:74218cdb:::10000000086.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535246e00 con 0x565534ef4800 2023-10-03T19:21:12.509 INFO:teuthology.orchestra.run.smithi045.stdout: -3051> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2201 10.8 10:10a36097:::10000000087.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535269180 con 0x565534ef5000 2023-10-03T19:21:12.509 INFO:teuthology.orchestra.run.smithi045.stdout: -3050> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2202 10.2f 10:f7140720:::10000000088.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535272380 con 0x565534ef4400 2023-10-03T19:21:12.510 INFO:teuthology.orchestra.run.smithi045.stdout: -3049> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2203 10.34 10:2e115d36:::10000000089.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535118700 con 0x565534151000 2023-10-03T19:21:12.510 INFO:teuthology.orchestra.run.smithi045.stdout: -3048> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2204 10.35 10:ae88c9e9:::1000000008a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350a7880 con 0x565534ef4800 2023-10-03T19:21:12.510 INFO:teuthology.orchestra.run.smithi045.stdout: -3047> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2205 10.8 10:13275b8b:::1000000008b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350a6380 con 0x565534ef5000 2023-10-03T19:21:12.510 INFO:teuthology.orchestra.run.smithi045.stdout: -3046> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2206 10.3c 10:3c2e7968:::1000000008c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534fa1500 con 0x565534ef4800 2023-10-03T19:21:12.510 INFO:teuthology.orchestra.run.smithi045.stdout: -3045> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2207 10.26 10:67acbfb4:::1000000008d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534e2e380 con 0x565534151000 2023-10-03T19:21:12.510 INFO:teuthology.orchestra.run.smithi045.stdout: -3044> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2208 10.36 10:6cf8d55a:::1000000008e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535503180 con 0x565534ef4c00 2023-10-03T19:21:12.511 INFO:teuthology.orchestra.run.smithi045.stdout: -3043> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2209 10.2d 10:b6d5679c:::1000000008f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535720380 con 0x565534ffe800 2023-10-03T19:21:12.511 INFO:teuthology.orchestra.run.smithi045.stdout: -3042> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2210 10.23 10:c454cd7f:::10000000090.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535247500 con 0x565534ef4c00 2023-10-03T19:21:12.511 INFO:teuthology.orchestra.run.smithi045.stdout: -3041> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2211 10.14 10:2b22960d:::10000000091.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535119880 con 0x565534ef4400 2023-10-03T19:21:12.511 INFO:teuthology.orchestra.run.smithi045.stdout: -3040> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2212 10.c 10:317b49a4:::10000000092.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535547500 con 0x565534ef5400 2023-10-03T19:21:12.511 INFO:teuthology.orchestra.run.smithi045.stdout: -3039> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2213 10.c 10:30dd2ab9:::10000000093.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535246700 con 0x565534ef5400 2023-10-03T19:21:12.511 INFO:teuthology.orchestra.run.smithi045.stdout: -3038> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2214 10.13 10:c844618d:::10000000094.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535502000 con 0x565534ef4400 2023-10-03T19:21:12.511 INFO:teuthology.orchestra.run.smithi045.stdout: -3037> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2215 10.12 10:4aa41a21:::10000000095.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535721880 con 0x565534ffe800 2023-10-03T19:21:12.512 INFO:teuthology.orchestra.run.smithi045.stdout: -3036> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2216 10.33 10:cee3daff:::10000000096.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553559fc00 con 0x565534151000 2023-10-03T19:21:12.512 INFO:teuthology.orchestra.run.smithi045.stdout: -3035> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2217 10.3f 10:fc8be962:::10000000097.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535412700 con 0x565534ef4400 2023-10-03T19:21:12.512 INFO:teuthology.orchestra.run.smithi045.stdout: -3034> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2218 10.2e 10:77d1cb76:::10000000098.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535118a80 con 0x565534ef4800 2023-10-03T19:21:12.512 INFO:teuthology.orchestra.run.smithi045.stdout: -3033> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2219 10.32 10:4e69e568:::10000000099.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535268e00 con 0x565534ef4c00 2023-10-03T19:21:12.512 INFO:teuthology.orchestra.run.smithi045.stdout: -3032> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2220 10.0 10:03c4ee74:::1000000009a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535012000 con 0x565534ffe800 2023-10-03T19:21:12.512 INFO:teuthology.orchestra.run.smithi045.stdout: -3031> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2221 10.37 10:eccff461:::1000000009b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535503c00 con 0x565534ef4c00 2023-10-03T19:21:12.512 INFO:teuthology.orchestra.run.smithi045.stdout: -3030> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2222 10.36 10:6c8b6cb2:::1000000009c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534142a80 con 0x565534ef4c00 2023-10-03T19:21:12.512 INFO:teuthology.orchestra.run.smithi045.stdout: -3029> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2223 10.36 10:6f6a1eb0:::1000000009d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535158e00 con 0x565534ef4c00 2023-10-03T19:21:12.512 INFO:teuthology.orchestra.run.smithi045.stdout: -3028> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2224 10.e 10:70913c6f:::1000000009e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535515880 con 0x565534ef4800 2023-10-03T19:21:12.512 INFO:teuthology.orchestra.run.smithi045.stdout: -3027> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2225 10.33 10:cf652552:::1000000009f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655355ca380 con 0x565534151000 2023-10-03T19:21:12.512 INFO:teuthology.orchestra.run.smithi045.stdout: -3026> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2226 10.2b 10:d4ac5e36:::100000000a0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350e6700 con 0x565534151000 2023-10-03T19:21:12.512 INFO:teuthology.orchestra.run.smithi045.stdout: -3025> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2227 10.4 10:23d81b1d:::100000000a1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535246380 con 0x565534ef5000 2023-10-03T19:21:12.513 INFO:teuthology.orchestra.run.smithi045.stdout: -3024> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2228 10.2a 10:5644b0dd:::100000000a2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553630fc00 con 0x565534ef5400 2023-10-03T19:21:12.513 INFO:teuthology.orchestra.run.smithi045.stdout: -3023> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2229 10.14 10:2800edac:::100000000a3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536336000 con 0x565534ef4400 2023-10-03T19:21:12.513 INFO:teuthology.orchestra.run.smithi045.stdout: -3022> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2230 10.c 10:33682534:::100000000a4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536336380 con 0x565534ef5400 2023-10-03T19:21:12.615 INFO:teuthology.orchestra.run.smithi045.stdout: -3021> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2231 10.1c 10:3948beee:::100000000a5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536337c00 con 0x565534ffe800 2023-10-03T19:21:12.615 INFO:teuthology.orchestra.run.smithi045.stdout: -3020> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2232 10.1 10:82c5dbfa:::100000000a6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535113880 con 0x565534ef4800 2023-10-03T19:21:12.615 INFO:teuthology.orchestra.run.smithi045.stdout: -3019> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2233 10.2d 10:b683ac1f:::100000000a7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655354a7180 con 0x565534ffe800 2023-10-03T19:21:12.615 INFO:teuthology.orchestra.run.smithi045.stdout: -3018> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2234 10.33 10:cf66c3a3:::100000000a8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363a2000 con 0x565534151000 2023-10-03T19:21:12.615 INFO:teuthology.orchestra.run.smithi045.stdout: -3017> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2235 10.12 10:496373b3:::100000000a9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363a2a80 con 0x565534ffe800 2023-10-03T19:21:12.616 INFO:teuthology.orchestra.run.smithi045.stdout: -3016> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2236 10.3b 10:dfd961c9:::100000000aa.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363ce000 con 0x565534ffe800 2023-10-03T19:21:12.616 INFO:teuthology.orchestra.run.smithi045.stdout: -3015> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2237 10.28 10:16ce2f56:::100000000ab.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363cea80 con 0x565534ef4c00 2023-10-03T19:21:12.616 INFO:teuthology.orchestra.run.smithi045.stdout: -3014> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2238 10.26 10:65e71c10:::100000000ac.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363cf500 con 0x565534151000 2023-10-03T19:21:12.616 INFO:teuthology.orchestra.run.smithi045.stdout: -3013> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2239 10.3c 10:3ca8796c:::100000000ad.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363fc000 con 0x565534ef4800 2023-10-03T19:21:12.616 INFO:teuthology.orchestra.run.smithi045.stdout: -3012> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2240 10.2b 10:d77b40aa:::100000000ae.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363fc700 con 0x565534151000 2023-10-03T19:21:12.616 INFO:teuthology.orchestra.run.smithi045.stdout: -3011> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2241 10.8 10:12260154:::100000000af.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363fca80 con 0x565534ef5000 2023-10-03T19:21:12.617 INFO:teuthology.orchestra.run.smithi045.stdout: -3010> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2242 10.19 10:99a6d8b2:::100000000b0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363fd880 con 0x565534ef4400 2023-10-03T19:21:12.617 INFO:teuthology.orchestra.run.smithi045.stdout: -3009> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2243 10.25 10:a4b351a2:::100000000b1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536427880 con 0x565534ef4800 2023-10-03T19:21:12.617 INFO:teuthology.orchestra.run.smithi045.stdout: -3008> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2244 10.20 10:05e903ec:::100000000b2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536450700 con 0x565534ef5000 2023-10-03T19:21:12.617 INFO:teuthology.orchestra.run.smithi045.stdout: -3007> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2245 10.1d 10:bbfd17d2:::100000000b3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655364ad880 con 0x565534ef4800 2023-10-03T19:21:12.617 INFO:teuthology.orchestra.run.smithi045.stdout: -3006> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2246 10.3f 10:fc47e501:::100000000b4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655364d9c00 con 0x565534ef4400 2023-10-03T19:21:12.617 INFO:teuthology.orchestra.run.smithi045.stdout: -3005> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2247 10.29 10:959d3147:::100000000b5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536501180 con 0x565534ef5400 2023-10-03T19:21:12.617 INFO:teuthology.orchestra.run.smithi045.stdout: -3004> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2248 10.21 10:869f8614:::100000000b6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553652f880 con 0x565534ef5400 2023-10-03T19:21:12.618 INFO:teuthology.orchestra.run.smithi045.stdout: -3003> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2249 10.13 10:c826941c:::100000000b7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553655b880 con 0x565534ef4400 2023-10-03T19:21:12.618 INFO:teuthology.orchestra.run.smithi045.stdout: -3002> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2250 10.23 10:c7a7e7ed:::100000000b8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350ac380 con 0x565534ef4c00 2023-10-03T19:21:12.618 INFO:teuthology.orchestra.run.smithi045.stdout: -3001> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2251 10.2a 10:576d20de:::100000000b9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536337180 con 0x565534ef5400 2023-10-03T19:21:12.618 INFO:teuthology.orchestra.run.smithi045.stdout: -3000> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2252 10.28 10:14bef4b2:::100000000ba.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553630f180 con 0x565534ef4c00 2023-10-03T19:21:12.618 INFO:teuthology.orchestra.run.smithi045.stdout: -2999> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2253 10.4 10:21fe71c4:::100000000bb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553528b500 con 0x565534ef5000 2023-10-03T19:21:12.618 INFO:teuthology.orchestra.run.smithi045.stdout: -2998> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2254 10.1d 10:ba036218:::100000000bc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363a3500 con 0x565534ef4800 2023-10-03T19:21:12.619 INFO:teuthology.orchestra.run.smithi045.stdout: -2997> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2255 10.2 10:43b4b389:::100000000bd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363fdc00 con 0x565534ef4400 2023-10-03T19:21:12.619 INFO:teuthology.orchestra.run.smithi045.stdout: -2996> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2256 10.18 10:196d4b2b:::100000000be.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536426a80 con 0x5655354ba000 2023-10-03T19:21:12.619 INFO:teuthology.orchestra.run.smithi045.stdout: -2995> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2257 10.2f 10:f46eb3ed:::100000000bf.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536450380 con 0x565534ef4400 2023-10-03T19:21:12.619 INFO:teuthology.orchestra.run.smithi045.stdout: -2994> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2258 10.2 10:42142be5:::100000000c0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553647e380 con 0x565534ef4400 2023-10-03T19:21:12.619 INFO:teuthology.orchestra.run.smithi045.stdout: -2993> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2259 10.18 10:18cb83ce:::100000000c1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655364ac000 con 0x5655354ba000 2023-10-03T19:21:12.619 INFO:teuthology.orchestra.run.smithi045.stdout: -2992> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2260 10.36 10:6c9ae960:::100000000c2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655364ace00 con 0x565534ef4c00 2023-10-03T19:21:12.620 INFO:teuthology.orchestra.run.smithi045.stdout: -2991> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2261 10.1f 10:f8d20c92:::100000000c3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655364ad180 con 0x565534ef4c00 2023-10-03T19:21:12.620 INFO:teuthology.orchestra.run.smithi045.stdout: -2990> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2262 10.1c 10:3990871b:::100000000c4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655364d8000 con 0x565534ffe800 2023-10-03T19:21:12.620 INFO:teuthology.orchestra.run.smithi045.stdout: -2989> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2263 10.16 10:680c46c7:::100000000c5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553652ee00 con 0x565534ffe800 2023-10-03T19:21:12.620 INFO:teuthology.orchestra.run.smithi045.stdout: -2988> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2264 10.17 10:eb7dd551:::100000000c6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536587500 con 0x565534ef4800 2023-10-03T19:21:12.620 INFO:teuthology.orchestra.run.smithi045.stdout: -2987> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2265 10.36 10:6e30e37c:::100000000c7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536426000 con 0x565534ef4c00 2023-10-03T19:21:12.663 INFO:teuthology.orchestra.run.smithi045.stdout: -2986> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2266 10.f 10:f28dc9ad:::100000000c8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536426380 con 0x565534ffe800 2023-10-03T19:21:12.663 INFO:teuthology.orchestra.run.smithi045.stdout: -2985> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2267 10.11 10:8a614455:::100000000c9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534fcce00 con 0x565534151000 2023-10-03T19:21:12.663 INFO:teuthology.orchestra.run.smithi045.stdout: -2984> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2268 10.2 10:418539fe:::100000000ca.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536500000 con 0x565534ef4400 2023-10-03T19:21:12.664 INFO:teuthology.orchestra.run.smithi045.stdout: -2983> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2269 10.3a 10:5e2665ab:::100000000cb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535268700 con 0x565534ef5000 2023-10-03T19:21:12.664 INFO:teuthology.orchestra.run.smithi045.stdout: -2982> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2270 10.3e 10:7db06380:::100000000cc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535720a80 con 0x565534ef4400 2023-10-03T19:21:12.664 INFO:teuthology.orchestra.run.smithi045.stdout: -2981> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2271 10.33 10:cc35cb30:::100000000cd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535502e00 con 0x565534151000 2023-10-03T19:21:12.664 INFO:teuthology.orchestra.run.smithi045.stdout: -2980> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2272 10.11 10:89a13bde:::100000000ce.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534fcc000 con 0x565534151000 2023-10-03T19:21:12.664 INFO:teuthology.orchestra.run.smithi045.stdout: -2979> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2273 10.19 10:9baaf7f1:::100000000cf.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535514700 con 0x565534ef4400 2023-10-03T19:21:12.665 INFO:teuthology.orchestra.run.smithi045.stdout: -2978> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2274 10.1b 10:d9cb565c:::100000000d0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553528c000 con 0x565534ef5400 2023-10-03T19:21:12.665 INFO:teuthology.orchestra.run.smithi045.stdout: -2977> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2275 10.5 10:a391cf2b:::100000000d1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350b9180 con 0x5655354ba000 2023-10-03T19:21:12.665 INFO:teuthology.orchestra.run.smithi045.stdout: -2976> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2276 10.38 10:1e907e28:::100000000d2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535273180 con 0x565534151000 2023-10-03T19:21:12.665 INFO:teuthology.orchestra.run.smithi045.stdout: -2975> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2277 10.17 10:e88d3223:::100000000d3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363a3180 con 0x565534ef4800 2023-10-03T19:21:12.665 INFO:teuthology.orchestra.run.smithi045.stdout: -2974> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2278 10.b 10:d02f84b5:::100000000d4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553652fc00 con 0x565534ffe800 2023-10-03T19:21:12.666 INFO:teuthology.orchestra.run.smithi045.stdout: -2973> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2279 10.29 10:963c36ab:::100000000d5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536336e00 con 0x565534ef5400 2023-10-03T19:21:12.666 INFO:teuthology.orchestra.run.smithi045.stdout: -2972> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2280 10.1c 10:38569cab:::100000000d6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536651180 con 0x565534ffe800 2023-10-03T19:21:12.666 INFO:teuthology.orchestra.run.smithi045.stdout: -2971> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2281 10.18 10:1bd5bb9e:::100000000d7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534e2ee00 con 0x5655354ba000 2023-10-03T19:21:12.666 INFO:teuthology.orchestra.run.smithi045.stdout: -2970> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2282 10.1e 10:7b9ba906:::100000000d8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553548ee00 con 0x565534ef5000 2023-10-03T19:21:12.666 INFO:teuthology.orchestra.run.smithi045.stdout: -2969> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2283 10.10 10:09e2658b:::100000000d9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553655aa80 con 0x565534ef5400 2023-10-03T19:21:12.666 INFO:teuthology.orchestra.run.smithi045.stdout: -2968> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2284 10.21 10:84e04a5a:::100000000da.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534fa0000 con 0x565534ef5400 2023-10-03T19:21:12.666 INFO:teuthology.orchestra.run.smithi045.stdout: -2967> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2285 10.15 10:aa9378d8:::100000000db.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553559e000 con 0x565534ef5400 2023-10-03T19:21:12.666 INFO:teuthology.orchestra.run.smithi045.stdout: -2966> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2286 10.13 10:c84cd983:::100000000dc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535559500 con 0x565534ef4400 2023-10-03T19:21:12.667 INFO:teuthology.orchestra.run.smithi045.stdout: -2965> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2287 10.26 10:65f6e386:::100000000dd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536624700 con 0x565534151000 2023-10-03T19:21:12.667 INFO:teuthology.orchestra.run.smithi045.stdout: -2964> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2288 10.f 10:f1207765:::100000000de.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535558700 con 0x565534ffe800 2023-10-03T19:21:12.667 INFO:teuthology.orchestra.run.smithi045.stdout: -2963> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2289 10.2f 10:f71b5472:::100000000df.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534142e00 con 0x565534ef4400 2023-10-03T19:21:12.667 INFO:teuthology.orchestra.run.smithi045.stdout: -2962> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2290 10.3 10:c239e8b3:::100000000e0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535648700 con 0x5655354ba000 2023-10-03T19:21:12.769 INFO:teuthology.orchestra.run.smithi045.stdout: -2961> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2291 10.17 10:eba7c799:::100000000e1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534143c00 con 0x565534ef4800 2023-10-03T19:21:12.769 INFO:teuthology.orchestra.run.smithi045.stdout: -2960> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2292 10.12 10:4a996524:::100000000e2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350a6a80 con 0x565534ffe800 2023-10-03T19:21:12.769 INFO:teuthology.orchestra.run.smithi045.stdout: -2959> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2293 10.1f 10:f93d8c0a:::100000000e3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536500a80 con 0x565534ef4c00 2023-10-03T19:21:12.770 INFO:teuthology.orchestra.run.smithi045.stdout: -2958> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2294 10.39 10:9c66f7cb:::100000000e4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655366a9180 con 0x5655354ba000 2023-10-03T19:21:12.770 INFO:teuthology.orchestra.run.smithi045.stdout: -2957> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2295 10.1d 10:bba66d05:::100000000e5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655355fd180 con 0x565534ef4800 2023-10-03T19:21:12.770 INFO:teuthology.orchestra.run.smithi045.stdout: -2956> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2296 10.39 10:9de3e889:::100000000e6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535016700 con 0x5655354ba000 2023-10-03T19:21:12.770 INFO:teuthology.orchestra.run.smithi045.stdout: -2955> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2297 10.36 10:6c62f82b:::100000000e7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536451880 con 0x565534ef4c00 2023-10-03T19:21:12.770 INFO:teuthology.orchestra.run.smithi045.stdout: -2954> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2298 10.1b 10:dba0574f:::100000000e8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534fa0700 con 0x565534ef5400 2023-10-03T19:21:12.770 INFO:teuthology.orchestra.run.smithi045.stdout: -2953> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2299 10.4 10:235bfa30:::100000000e9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553667d500 con 0x565534ef5000 2023-10-03T19:21:12.771 INFO:teuthology.orchestra.run.smithi045.stdout: -2952> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2300 10.2a 10:54beb349:::100000000ea.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535159880 con 0x565534ef5400 2023-10-03T19:21:12.771 INFO:teuthology.orchestra.run.smithi045.stdout: -2951> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2301 10.5 10:a3215264:::100000000eb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553559ea80 con 0x5655354ba000 2023-10-03T19:21:12.771 INFO:teuthology.orchestra.run.smithi045.stdout: -2950> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2302 10.4 10:20ceeb1e:::100000000ec.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535625c00 con 0x565534ef5000 2023-10-03T19:21:12.771 INFO:teuthology.orchestra.run.smithi045.stdout: -2949> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2303 10.1d 10:b9cee72b:::100000000ed.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536451180 con 0x565534ef4800 2023-10-03T19:21:12.771 INFO:teuthology.orchestra.run.smithi045.stdout: -2948> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2304 10.30 10:0c88ada4:::100000000ee.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536501880 con 0x5655354ba000 2023-10-03T19:21:12.771 INFO:teuthology.orchestra.run.smithi045.stdout: -2947> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2305 10.13 10:c8202536:::100000000ef.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655364d9880 con 0x565534ef4400 2023-10-03T19:21:12.771 INFO:teuthology.orchestra.run.smithi045.stdout: -2946> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2306 10.37 10:ef416527:::100000000f0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350ff180 con 0x565534ef4c00 2023-10-03T19:21:12.772 INFO:teuthology.orchestra.run.smithi045.stdout: -2945> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2307 10.3f 10:fea3f43b:::100000000f1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535247c00 con 0x565534ef4400 2023-10-03T19:21:12.772 INFO:teuthology.orchestra.run.smithi045.stdout: -2944> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2308 10.33 10:cff7f4bd:::100000000f2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535012a80 con 0x565534151000 2023-10-03T19:21:12.772 INFO:teuthology.orchestra.run.smithi045.stdout: -2943> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2309 10.d 10:b0cc5b52:::100000000f3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553515d880 con 0x565534ffe800 2023-10-03T19:21:12.772 INFO:teuthology.orchestra.run.smithi045.stdout: -2942> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2310 10.13 10:c97f6a48:::100000000f4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350ad500 con 0x565534ef4400 2023-10-03T19:21:12.772 INFO:teuthology.orchestra.run.smithi045.stdout: -2941> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2311 10.2b 10:d6a65225:::100000000f5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535269500 con 0x565534151000 2023-10-03T19:21:12.772 INFO:teuthology.orchestra.run.smithi045.stdout: -2940> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2312 10.b 10:d1f1a6ab:::100000000f6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350ac000 con 0x565534ffe800 2023-10-03T19:21:12.772 INFO:teuthology.orchestra.run.smithi045.stdout: -2939> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2313 10.12 10:482fe7bc:::100000000f7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553528dc00 con 0x565534ffe800 2023-10-03T19:21:12.773 INFO:teuthology.orchestra.run.smithi045.stdout: -2938> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2314 10.1f 10:fa69016c:::100000000f8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350a7180 con 0x565534ef4c00 2023-10-03T19:21:12.773 INFO:teuthology.orchestra.run.smithi045.stdout: -2937> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2315 10.f 10:f264201d:::100000000f9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655354a6700 con 0x565534ffe800 2023-10-03T19:21:12.773 INFO:teuthology.orchestra.run.smithi045.stdout: -2936> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2316 10.2e 10:752cd5de:::100000000fa.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553560d880 con 0x565534ef4800 2023-10-03T19:21:12.773 INFO:teuthology.orchestra.run.smithi045.stdout: -2935> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2317 10.0 10:00b77ae3:::100000000fb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350a7500 con 0x565534ffe800 2023-10-03T19:21:12.773 INFO:teuthology.orchestra.run.smithi045.stdout: -2934> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2318 10.36 10:6dd545dc:::100000000fc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553528c380 con 0x565534ef4c00 2023-10-03T19:21:12.773 INFO:teuthology.orchestra.run.smithi045.stdout: -2933> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2319 10.2d 10:b6610622:::100000000fd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553667c700 con 0x565534ffe800 2023-10-03T19:21:12.773 INFO:teuthology.orchestra.run.smithi045.stdout: -2932> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2320 10.3d 10:be8dfa60:::100000000fe.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536501c00 con 0x565534ef4c00 2023-10-03T19:21:12.774 INFO:teuthology.orchestra.run.smithi045.stdout: -2931> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2321 10.13 10:ca01a157:::100000000ff.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553518bc00 con 0x565534ef4400 2023-10-03T19:21:12.774 INFO:teuthology.orchestra.run.smithi045.stdout: -2930> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2322 10.16 10:69f8b284:::10000000100.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350a7c00 con 0x565534ffe800 2023-10-03T19:21:12.774 INFO:teuthology.orchestra.run.smithi045.stdout: -2929> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2323 10.3e 10:7d5083c7:::10000000101.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534fa0a80 con 0x565534ef4400 2023-10-03T19:21:12.774 INFO:teuthology.orchestra.run.smithi045.stdout: -2928> 2023-10-03T19:17:19.558+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2324 10.13 10:ca2b2f16:::10000000102.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350e7880 con 0x565534ef4400 2023-10-03T19:21:12.774 INFO:teuthology.orchestra.run.smithi045.stdout: -2927> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2325 10.31 10:8c3ca124:::10000000103.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655366a8e00 con 0x565534ef4c00 2023-10-03T19:21:12.774 INFO:teuthology.orchestra.run.smithi045.stdout: -2926> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2326 10.36 10:6f4aafed:::10000000104.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534142700 con 0x565534ef4c00 2023-10-03T19:21:12.774 INFO:teuthology.orchestra.run.smithi045.stdout: -2925> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2327 10.10 10:088ef71a:::10000000105.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535012380 con 0x565534ef5400 2023-10-03T19:21:12.775 INFO:teuthology.orchestra.run.smithi045.stdout: -2924> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2328 10.14 10:285116e2:::10000000106.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553560ce00 con 0x565534ef4400 2023-10-03T19:21:12.775 INFO:teuthology.orchestra.run.smithi045.stdout: -2923> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2329 10.3f 10:fe10ede2:::10000000107.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534029c00 con 0x565534ef4400 2023-10-03T19:21:12.817 INFO:teuthology.orchestra.run.smithi045.stdout: -2922> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2330 10.30 10:0fd9593b:::10000000108.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553652f500 con 0x5655354ba000 2023-10-03T19:21:12.817 INFO:teuthology.orchestra.run.smithi045.stdout: -2921> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2331 10.37 10:ee98d4aa:::10000000109.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535269880 con 0x565534ef4c00 2023-10-03T19:21:12.818 INFO:teuthology.orchestra.run.smithi045.stdout: -2920> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2332 10.14 10:2b0c3f61:::1000000010a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534fcd180 con 0x565534ef4400 2023-10-03T19:21:12.818 INFO:teuthology.orchestra.run.smithi045.stdout: -2919> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2333 10.3f 10:fe23482d:::1000000010b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655354a7c00 con 0x565534ef4400 2023-10-03T19:21:12.818 INFO:teuthology.orchestra.run.smithi045.stdout: -2918> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2334 10.d 10:b247ee27:::1000000010c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535546380 con 0x565534ffe800 2023-10-03T19:21:12.818 INFO:teuthology.orchestra.run.smithi045.stdout: -2917> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2335 10.26 10:67d72c52:::1000000010d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534e2f500 con 0x565534151000 2023-10-03T19:21:12.818 INFO:teuthology.orchestra.run.smithi045.stdout: -2916> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2336 10.2a 10:542953c1:::1000000010e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536427500 con 0x565534ef5400 2023-10-03T19:21:12.818 INFO:teuthology.orchestra.run.smithi045.stdout: -2915> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2337 10.30 10:0c13cd34:::1000000010f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536651180 con 0x5655354ba000 2023-10-03T19:21:12.818 INFO:teuthology.orchestra.run.smithi045.stdout: -2914> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2338 10.26 10:64ce44bf:::10000000110.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553652fc00 con 0x565534151000 2023-10-03T19:21:12.819 INFO:teuthology.orchestra.run.smithi045.stdout: -2913> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2339 10.22 10:46c9ad04:::10000000111.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536426380 con 0x565534151000 2023-10-03T19:21:12.819 INFO:teuthology.orchestra.run.smithi045.stdout: -2912> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2340 10.0 10:006fa129:::10000000112.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553652ee00 con 0x565534ffe800 2023-10-03T19:21:12.819 INFO:teuthology.orchestra.run.smithi045.stdout: -2911> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2341 10.1f 10:fa9b3804:::10000000113.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655364d8000 con 0x565534ef4c00 2023-10-03T19:21:12.819 INFO:teuthology.orchestra.run.smithi045.stdout: -2910> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2342 10.0 10:005b64bc:::10000000114.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363ce000 con 0x565534ffe800 2023-10-03T19:21:12.819 INFO:teuthology.orchestra.run.smithi045.stdout: -2909> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2343 10.2a 10:575ae04b:::10000000115.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363a2a80 con 0x565534ef5400 2023-10-03T19:21:12.819 INFO:teuthology.orchestra.run.smithi045.stdout: -2908> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2344 10.17 10:ea138f4d:::10000000116.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655354a7180 con 0x565534ef4800 2023-10-03T19:21:12.819 INFO:teuthology.orchestra.run.smithi045.stdout: -2907> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2345 10.23 10:c507b3c5:::10000000117.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536337c00 con 0x565534ef4c00 2023-10-03T19:21:12.819 INFO:teuthology.orchestra.run.smithi045.stdout: -2906> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2346 10.25 10:a6db094f:::10000000118.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535012000 con 0x565534ef4800 2023-10-03T19:21:12.819 INFO:teuthology.orchestra.run.smithi045.stdout: -2905> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2347 10.3 10:c1b999d7:::10000000119.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535721880 con 0x5655354ba000 2023-10-03T19:21:12.819 INFO:teuthology.orchestra.run.smithi045.stdout: -2904> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2348 10.2a 10:565108ac:::1000000011a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535720380 con 0x565534ef5400 2023-10-03T19:21:12.820 INFO:teuthology.orchestra.run.smithi045.stdout: -2903> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2349 10.36 10:6e600286:::1000000011b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535119500 con 0x565534ef4c00 2023-10-03T19:21:12.820 INFO:teuthology.orchestra.run.smithi045.stdout: -2902> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2350 10.b 10:d200bef4:::1000000011c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535648a80 con 0x565534ffe800 2023-10-03T19:21:12.820 INFO:teuthology.orchestra.run.smithi045.stdout: -2901> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2351 10.3a 10:5d261264:::1000000011d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535514e00 con 0x565534ef5000 2023-10-03T19:21:12.820 INFO:teuthology.orchestra.run.smithi045.stdout: -2900> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2352 10.10 10:08a5cadf:::1000000011e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553559f180 con 0x565534ef5400 2023-10-03T19:21:12.820 INFO:teuthology.orchestra.run.smithi045.stdout: -2899> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2353 10.2b 10:d6a4c2d3:::1000000011f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535624700 con 0x565534151000 2023-10-03T19:21:12.820 INFO:teuthology.orchestra.run.smithi045.stdout: -2898> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2354 10.15 10:a96960f2:::10000000120.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553559f500 con 0x565534ef5400 2023-10-03T19:21:12.820 INFO:teuthology.orchestra.run.smithi045.stdout: -2897> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2355 10.2d 10:b4f06a36:::10000000121.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535412380 con 0x565534ffe800 2023-10-03T19:21:12.820 INFO:teuthology.orchestra.run.smithi045.stdout: -2896> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2356 10.1e 10:7b093fa4:::10000000122.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535503500 con 0x565534ef5000 2023-10-03T19:21:12.820 INFO:teuthology.orchestra.run.smithi045.stdout: -2895> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2357 10.36 10:6f395059:::10000000123.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655355fca80 con 0x565534ef4c00 2023-10-03T19:21:12.820 INFO:teuthology.orchestra.run.smithi045.stdout: -2894> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2358 10.27 10:e5c20fbc:::10000000124.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553630f500 con 0x565534151000 2023-10-03T19:21:12.821 INFO:teuthology.orchestra.run.smithi045.stdout: -2893> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2359 10.14 10:2b82a036:::10000000125.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536451c00 con 0x565534ef4400 2023-10-03T19:21:12.821 INFO:teuthology.orchestra.run.smithi045.stdout: -2892> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2360 10.34 10:2f934c4e:::10000000126.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655364d9500 con 0x565534151000 2023-10-03T19:21:12.821 INFO:teuthology.orchestra.run.smithi045.stdout: -2891> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2361 10.0 10:03f08cc0:::10000000127.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363cfc00 con 0x565534ffe800 2023-10-03T19:21:12.821 INFO:teuthology.orchestra.run.smithi045.stdout: -2890> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2362 10.2 10:4319aaa2:::10000000128.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535112e00 con 0x565534ef4400 2023-10-03T19:21:12.821 INFO:teuthology.orchestra.run.smithi045.stdout: -2889> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2363 10.1 10:802a5bbd:::10000000129.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350b8000 con 0x565534ef4800 2023-10-03T19:21:12.821 INFO:teuthology.orchestra.run.smithi045.stdout: -2888> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2364 10.38 10:1c1bce02:::1000000012a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553518bc00 con 0x565534151000 2023-10-03T19:21:12.821 INFO:teuthology.orchestra.run.smithi045.stdout: -2887> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2365 10.9 10:930ba3bb:::1000000012b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350ad500 con 0x565534151000 2023-10-03T19:21:12.821 INFO:teuthology.orchestra.run.smithi045.stdout: -2886> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2366 10.2d 10:b4fb9bd9:::1000000012c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535247c00 con 0x565534ffe800 2023-10-03T19:21:12.821 INFO:teuthology.orchestra.run.smithi045.stdout: -2885> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2367 10.37 10:ee6a6ac0:::1000000012d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655364d9880 con 0x565534ef4c00 2023-10-03T19:21:12.821 INFO:teuthology.orchestra.run.smithi045.stdout: -2884> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2368 10.2 10:439e92fb:::1000000012e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534142e00 con 0x565534ef4400 2023-10-03T19:21:12.821 INFO:teuthology.orchestra.run.smithi045.stdout: -2883> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2369 10.4 10:23f83e86:::1000000012f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536451180 con 0x565534ef5000 2023-10-03T19:21:12.822 INFO:teuthology.orchestra.run.smithi045.stdout: -2882> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2370 10.15 10:abaacf15:::10000000130.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655355fd180 con 0x565534ef5400 2023-10-03T19:21:12.822 INFO:teuthology.orchestra.run.smithi045.stdout: -2881> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2371 10.35 10:af7e9f79:::10000000131.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534143c00 con 0x565534ef4800 2023-10-03T19:21:12.822 INFO:teuthology.orchestra.run.smithi045.stdout: -2880> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2372 10.28 10:14babc15:::10000000132.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363a3180 con 0x565534ef4c00 2023-10-03T19:21:12.822 INFO:teuthology.orchestra.run.smithi045.stdout: -2879> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2373 10.3d 10:beed21fb:::10000000133.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536587500 con 0x565534ef4c00 2023-10-03T19:21:12.822 INFO:teuthology.orchestra.run.smithi045.stdout: -2878> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2374 10.2 10:40fdd18a:::10000000134.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363a3500 con 0x565534ef4400 2023-10-03T19:21:12.822 INFO:teuthology.orchestra.run.smithi045.stdout: -2877> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2375 10.3f 10:fedcb8c2:::10000000135.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655364ad880 con 0x565534ef4400 2023-10-03T19:21:12.822 INFO:teuthology.orchestra.run.smithi045.stdout: -2876> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2376 10.18 10:1b569a42:::10000000136.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536427880 con 0x5655354ba000 2023-10-03T19:21:12.822 INFO:teuthology.orchestra.run.smithi045.stdout: -2875> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2377 10.17 10:e994506f:::10000000137.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363fc000 con 0x565534ef4800 2023-10-03T19:21:12.822 INFO:teuthology.orchestra.run.smithi045.stdout: -2874> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2378 10.6 10:629cc6bc:::10000000138.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535113880 con 0x565534151000 2023-10-03T19:21:12.823 INFO:teuthology.orchestra.run.smithi045.stdout: -2873> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2379 10.8 10:1176dc39:::10000000139.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535515880 con 0x565534ef5000 2023-10-03T19:21:12.823 INFO:teuthology.orchestra.run.smithi045.stdout: -2872> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2380 10.1a 10:5997e84c:::1000000013a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535118a80 con 0x565534ffe800 2023-10-03T19:21:12.823 INFO:teuthology.orchestra.run.smithi045.stdout: -2871> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2381 10.1c 10:3800373d:::1000000013b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534fa1500 con 0x565534ffe800 2023-10-03T19:21:12.823 INFO:teuthology.orchestra.run.smithi045.stdout: -2870> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2382 10.36 10:6c5ddb65:::1000000013c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350a7880 con 0x565534ef4c00 2023-10-03T19:21:12.823 INFO:teuthology.orchestra.run.smithi045.stdout: -2869> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2383 10.33 10:ce600bd1:::1000000013d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535246e00 con 0x565534151000 2023-10-03T19:21:12.823 INFO:teuthology.orchestra.run.smithi045.stdout: -2868> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2384 10.35 10:ae56dbe9:::1000000013e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553515d500 con 0x565534ef4800 2023-10-03T19:21:12.915 INFO:teuthology.orchestra.run.smithi045.stdout: -2867> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2385 10.2b 10:d47db6ab:::1000000013f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534fa1180 con 0x565534151000 2023-10-03T19:21:12.915 INFO:teuthology.orchestra.run.smithi045.stdout: -2866> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2386 10.3b 10:dd7df288:::10000000140.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535159c00 con 0x565534ffe800 2023-10-03T19:21:12.915 INFO:teuthology.orchestra.run.smithi045.stdout: -2865> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2387 10.d 10:b296df2e:::10000000141.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535624a80 con 0x565534ffe800 2023-10-03T19:21:12.915 INFO:teuthology.orchestra.run.smithi045.stdout: -2864> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2388 10.1b 10:d9deb994:::10000000142.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535547180 con 0x565534ef5400 2023-10-03T19:21:12.915 INFO:teuthology.orchestra.run.smithi045.stdout: -2863> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2389 10.2e 10:77f9b43c:::10000000143.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350bb880 con 0x565534ef4800 2023-10-03T19:21:12.916 INFO:teuthology.orchestra.run.smithi045.stdout: -2862> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2390 10.19 10:9ae704d2:::10000000144.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535515500 con 0x565534ef4400 2023-10-03T19:21:12.916 INFO:teuthology.orchestra.run.smithi045.stdout: -2861> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2391 10.1a 10:587da770:::10000000145.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535269c00 con 0x565534ffe800 2023-10-03T19:21:12.916 INFO:teuthology.orchestra.run.smithi045.stdout: -2860> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2392 10.3f 10:fd6fa633:::10000000146.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535413180 con 0x565534ef4400 2023-10-03T19:21:12.916 INFO:teuthology.orchestra.run.smithi045.stdout: -2859> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2393 10.2c 10:35111aed:::10000000147.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535720380 con 0x565534ef5400 2023-10-03T19:21:12.916 INFO:teuthology.orchestra.run.smithi045.stdout: -2858> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2394 10.32 10:4eeada49:::10000000148.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363a2a80 con 0x565534ef4c00 2023-10-03T19:21:12.917 INFO:teuthology.orchestra.run.smithi045.stdout: -2857> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2395 10.11 10:8abfc0dc:::10000000149.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536427500 con 0x565534151000 2023-10-03T19:21:12.917 INFO:teuthology.orchestra.run.smithi045.stdout: -2856> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2396 10.17 10:e821ba07:::1000000014a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535012380 con 0x565534ef4800 2023-10-03T19:21:12.917 INFO:teuthology.orchestra.run.smithi045.stdout: -2855> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2397 10.3f 10:fc6ed777:::1000000014b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535159880 con 0x565534ef4400 2023-10-03T19:21:12.917 INFO:teuthology.orchestra.run.smithi045.stdout: -2854> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2398 10.b 10:d35c25ee:::1000000014c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534fa0700 con 0x565534ffe800 2023-10-03T19:21:12.918 INFO:teuthology.orchestra.run.smithi045.stdout: -2853> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2399 10.c 10:31051922:::1000000014d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553559e000 con 0x565534ef5400 2023-10-03T19:21:12.918 INFO:teuthology.orchestra.run.smithi045.stdout: -2852> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2400 10.15 10:abf4da12:::1000000014e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534fa0000 con 0x565534ef5400 2023-10-03T19:21:12.918 INFO:teuthology.orchestra.run.smithi045.stdout: -2851> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2401 10.2 10:42d137c4:::1000000014f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553655aa80 con 0x565534ef4400 2023-10-03T19:21:12.918 INFO:teuthology.orchestra.run.smithi045.stdout: -2850> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2402 10.34 10:2dfce41c:::10000000150.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536336e00 con 0x565534151000 2023-10-03T19:21:12.918 INFO:teuthology.orchestra.run.smithi045.stdout: -2849> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2403 10.31 10:8d77f5fc:::10000000151.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553528c000 con 0x565534ef4c00 2023-10-03T19:21:12.918 INFO:teuthology.orchestra.run.smithi045.stdout: -2848> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2404 10.2a 10:553c495b:::10000000152.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536337180 con 0x565534ef5400 2023-10-03T19:21:12.919 INFO:teuthology.orchestra.run.smithi045.stdout: -2847> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2405 10.a 10:512fb173:::10000000153.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553652f880 con 0x565534ffe800 2023-10-03T19:21:12.919 INFO:teuthology.orchestra.run.smithi045.stdout: -2846> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2406 10.20 10:0654da44:::10000000154.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536501180 con 0x565534ef5000 2023-10-03T19:21:12.919 INFO:teuthology.orchestra.run.smithi045.stdout: -2845> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2407 10.31 10:8c35c3f8:::10000000155.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536336380 con 0x565534ef4c00 2023-10-03T19:21:12.919 INFO:teuthology.orchestra.run.smithi045.stdout: -2844> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2408 10.29 10:96298894:::10000000156.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553630fc00 con 0x565534ef5400 2023-10-03T19:21:12.919 INFO:teuthology.orchestra.run.smithi045.stdout: -2843> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2409 10.3c 10:3e33a224:::10000000157.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535246700 con 0x565534ef4800 2023-10-03T19:21:12.920 INFO:teuthology.orchestra.run.smithi045.stdout: -2842> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2410 10.11 10:885408d1:::10000000158.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535547500 con 0x565534151000 2023-10-03T19:21:12.920 INFO:teuthology.orchestra.run.smithi045.stdout: -2841> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2411 10.35 10:ac4ca6af:::10000000159.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535413500 con 0x565534ef4800 2023-10-03T19:21:12.920 INFO:teuthology.orchestra.run.smithi045.stdout: -2840> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2412 10.4 10:23cbca8f:::1000000015a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534e2f880 con 0x565534ef5000 2023-10-03T19:21:12.920 INFO:teuthology.orchestra.run.smithi045.stdout: -2839> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2413 10.27 10:e6859628:::1000000015b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350b8700 con 0x565534151000 2023-10-03T19:21:12.920 INFO:teuthology.orchestra.run.smithi045.stdout: -2838> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2414 10.f 10:f04171b6:::1000000015c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655354a6e00 con 0x565534ffe800 2023-10-03T19:21:12.920 INFO:teuthology.orchestra.run.smithi045.stdout: -2837> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2415 10.29 10:94a271f5:::1000000015d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534fcc700 con 0x565534ef5400 2023-10-03T19:21:12.920 INFO:teuthology.orchestra.run.smithi045.stdout: -2836> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2416 10.8 10:12dd7266:::1000000015e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535273500 con 0x565534ef5000 2023-10-03T19:21:12.920 INFO:teuthology.orchestra.run.smithi045.stdout: -2835> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2417 10.f 10:f03d37e6:::1000000015f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535502a80 con 0x565534ffe800 2023-10-03T19:21:12.920 INFO:teuthology.orchestra.run.smithi045.stdout: -2834> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2418 10.e 10:71a8024a:::10000000160.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553630ea80 con 0x565534ef4800 2023-10-03T19:21:12.921 INFO:teuthology.orchestra.run.smithi045.stdout: -2833> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2419 10.3 10:c3d50dc8:::10000000161.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536450e00 con 0x5655354ba000 2023-10-03T19:21:12.952 INFO:teuthology.orchestra.run.smithi045.stdout: -2832> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2420 10.1a 10:581fb947:::10000000162.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553667ca80 con 0x565534ffe800 2023-10-03T19:21:12.952 INFO:teuthology.orchestra.run.smithi045.stdout: -2831> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2421 10.3d 10:bea1de3b:::10000000163.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350ba000 con 0x565534ef4c00 2023-10-03T19:21:12.952 INFO:teuthology.orchestra.run.smithi045.stdout: -2830> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2422 10.26 10:679dc93b:::10000000164.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553652ee00 con 0x565534151000 2023-10-03T19:21:12.952 INFO:teuthology.orchestra.run.smithi045.stdout: -2829> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2423 10.2f 10:f477b060:::10000000165.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535546380 con 0x565534ef4400 2023-10-03T19:21:12.952 INFO:teuthology.orchestra.run.smithi045.stdout: -2828> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2424 10.2f 10:f427aff4:::10000000166.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350a7c00 con 0x565534ef4400 2023-10-03T19:21:12.952 INFO:teuthology.orchestra.run.smithi045.stdout: -2827> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2425 10.7 10:e1d10967:::10000000167.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553667c700 con 0x565534ffe800 2023-10-03T19:21:12.952 INFO:teuthology.orchestra.run.smithi045.stdout: -2826> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2426 10.28 10:157cd199:::10000000168.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350a7500 con 0x565534ef4c00 2023-10-03T19:21:12.953 INFO:teuthology.orchestra.run.smithi045.stdout: -2825> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2427 10.e 10:72fb549a:::10000000169.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655354a6700 con 0x565534ef4800 2023-10-03T19:21:12.953 INFO:teuthology.orchestra.run.smithi045.stdout: -2824> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2428 10.31 10:8c4d6431:::1000000016a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553528dc00 con 0x565534ef4c00 2023-10-03T19:21:12.953 INFO:teuthology.orchestra.run.smithi045.stdout: -2823> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2429 10.24 10:24468cab:::1000000016b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350ac000 con 0x565534ef4400 2023-10-03T19:21:12.953 INFO:teuthology.orchestra.run.smithi045.stdout: -2822> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2430 10.2b 10:d4621505:::1000000016c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553515d880 con 0x565534151000 2023-10-03T19:21:12.953 INFO:teuthology.orchestra.run.smithi045.stdout: -2821> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2431 10.3a 10:5e75abad:::1000000016d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350a6a80 con 0x565534ef5000 2023-10-03T19:21:12.953 INFO:teuthology.orchestra.run.smithi045.stdout: -2820> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2432 10.24 10:25a116fe:::1000000016e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535558700 con 0x565534ef4400 2023-10-03T19:21:12.953 INFO:teuthology.orchestra.run.smithi045.stdout: -2819> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2433 10.29 10:9754688f:::1000000016f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535559500 con 0x565534ef5400 2023-10-03T19:21:12.953 INFO:teuthology.orchestra.run.smithi045.stdout: -2818> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2434 10.21 10:865846d8:::10000000170.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535514700 con 0x565534ef5400 2023-10-03T19:21:12.953 INFO:teuthology.orchestra.run.smithi045.stdout: -2817> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2435 10.26 10:67de5783:::10000000171.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535720a80 con 0x565534151000 2023-10-03T19:21:12.953 INFO:teuthology.orchestra.run.smithi045.stdout: -2816> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2436 10.3a 10:5fae8ea4:::10000000172.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536500000 con 0x565534ef5000 2023-10-03T19:21:12.953 INFO:teuthology.orchestra.run.smithi045.stdout: -2815> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2437 10.2f 10:f750f038:::10000000173.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553647e380 con 0x565534ef4400 2023-10-03T19:21:12.954 INFO:teuthology.orchestra.run.smithi045.stdout: -2814> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2438 10.17 10:ea0d4bd4:::10000000174.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536450380 con 0x565534ef4800 2023-10-03T19:21:12.954 INFO:teuthology.orchestra.run.smithi045.stdout: -2813> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2439 10.2c 10:35de0157:::10000000175.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363fdc00 con 0x565534ef5400 2023-10-03T19:21:12.954 INFO:teuthology.orchestra.run.smithi045.stdout: -2812> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2440 10.21 10:87d44640:::10000000176.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553655b880 con 0x565534ef5400 2023-10-03T19:21:12.954 INFO:teuthology.orchestra.run.smithi045.stdout: -2811> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2441 10.21 10:85136d15:::10000000177.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655364d9c00 con 0x565534ef5400 2023-10-03T19:21:12.954 INFO:teuthology.orchestra.run.smithi045.stdout: -2810> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2442 10.1b 10:d83df968:::10000000178.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363fd880 con 0x565534ef5400 2023-10-03T19:21:12.954 INFO:teuthology.orchestra.run.smithi045.stdout: -2809> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2443 10.23 10:c468a694:::10000000179.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536336000 con 0x565534ef4c00 2023-10-03T19:21:12.954 INFO:teuthology.orchestra.run.smithi045.stdout: -2808> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2444 10.1c 10:392ce431:::1000000017a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535412700 con 0x565534ffe800 2023-10-03T19:21:12.954 INFO:teuthology.orchestra.run.smithi045.stdout: -2807> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2445 10.23 10:c750a2e5:::1000000017b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535502000 con 0x565534ef4c00 2023-10-03T19:21:12.955 INFO:teuthology.orchestra.run.smithi045.stdout: -2806> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2446 10.39 10:9d2c3550:::1000000017c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535119880 con 0x5655354ba000 2023-10-03T19:21:12.955 INFO:teuthology.orchestra.run.smithi045.stdout: -2805> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2447 10.38 10:1e3b0900:::1000000017d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535272380 con 0x565534151000 2023-10-03T19:21:12.955 INFO:teuthology.orchestra.run.smithi045.stdout: -2804> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2448 10.15 10:aa02e122:::1000000017e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535016380 con 0x565534ef5400 2023-10-03T19:21:12.955 INFO:teuthology.orchestra.run.smithi045.stdout: -2803> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2449 10.18 10:1b505fc9:::1000000017f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553515ca80 con 0x5655354ba000 2023-10-03T19:21:12.955 INFO:teuthology.orchestra.run.smithi045.stdout: -2802> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2450 10.6 10:63fec8d1:::10000000180.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534e2fc00 con 0x565534151000 2023-10-03T19:21:12.955 INFO:teuthology.orchestra.run.smithi045.stdout: -2801> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2451 10.35 10:ae109857:::10000000181.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655354a7880 con 0x565534ef4800 2023-10-03T19:21:12.955 INFO:teuthology.orchestra.run.smithi045.stdout: -2800> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2452 10.3c 10:3caa846b:::10000000182.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535113500 con 0x565534ef4800 2023-10-03T19:21:12.955 INFO:teuthology.orchestra.run.smithi045.stdout: -2799> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2453 10.6 10:60954073:::10000000183.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553560dc00 con 0x565534151000 2023-10-03T19:21:12.955 INFO:teuthology.orchestra.run.smithi045.stdout: -2798> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2454 10.37 10:ee74be79:::10000000184.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350adc00 con 0x565534ef4c00 2023-10-03T19:21:12.955 INFO:teuthology.orchestra.run.smithi045.stdout: -2797> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2455 10.2b 10:d44b7594:::10000000185.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534143880 con 0x565534151000 2023-10-03T19:21:12.955 INFO:teuthology.orchestra.run.smithi045.stdout: -2796> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2456 10.1b 10:dac0322e:::10000000186.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350a6700 con 0x565534ef5400 2023-10-03T19:21:12.956 INFO:teuthology.orchestra.run.smithi045.stdout: -2795> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2457 10.2c 10:361d040c:::10000000187.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535503880 con 0x565534ef5400 2023-10-03T19:21:12.956 INFO:teuthology.orchestra.run.smithi045.stdout: -2794> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2458 10.2c 10:34fb46e8:::10000000188.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535272a80 con 0x565534ef5400 2023-10-03T19:21:12.956 INFO:teuthology.orchestra.run.smithi045.stdout: -2793> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2459 10.18 10:1be1b9ec:::10000000189.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655364ac380 con 0x5655354ba000 2023-10-03T19:21:12.956 INFO:teuthology.orchestra.run.smithi045.stdout: -2792> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2460 10.25 10:a628609b:::1000000018a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535546000 con 0x565534ef4800 2023-10-03T19:21:12.956 INFO:teuthology.orchestra.run.smithi045.stdout: -2791> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2461 10.20 10:054a2542:::1000000018b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535112700 con 0x565534ef5000 2023-10-03T19:21:12.956 INFO:teuthology.orchestra.run.smithi045.stdout: -2790> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2462 10.20 10:0528cc08:::1000000018c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536500e00 con 0x565534ef5000 2023-10-03T19:21:12.957 INFO:teuthology.orchestra.run.smithi045.stdout: -2789> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2463 10.25 10:a72aac57:::1000000018d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553560d180 con 0x565534ef4800 2023-10-03T19:21:12.957 INFO:teuthology.orchestra.run.smithi045.stdout: -2788> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2464 10.13 10:ca4de75d:::1000000018e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534fa1880 con 0x565534ef4400 2023-10-03T19:21:12.957 INFO:teuthology.orchestra.run.smithi045.stdout: -2787> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2465 10.21 10:873de92c:::1000000018f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553630f880 con 0x565534ef5400 2023-10-03T19:21:12.957 INFO:teuthology.orchestra.run.smithi045.stdout: -2786> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2466 10.5 10:a17921c8:::10000000190.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536336700 con 0x5655354ba000 2023-10-03T19:21:12.957 INFO:teuthology.orchestra.run.smithi045.stdout: -2785> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2467 10.19 10:98be24f8:::10000000191.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363a2380 con 0x565534ef4400 2023-10-03T19:21:12.957 INFO:teuthology.orchestra.run.smithi045.stdout: -2784> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2468 10.0 10:01a8c5ca:::10000000192.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363a2700 con 0x565534ffe800 2023-10-03T19:21:12.957 INFO:teuthology.orchestra.run.smithi045.stdout: -2783> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2469 10.1d 10:b9c448ca:::10000000193.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363ce380 con 0x565534ef4800 2023-10-03T19:21:12.957 INFO:teuthology.orchestra.run.smithi045.stdout: -2782> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2470 10.26 10:6669d7af:::10000000194.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536426e00 con 0x565534151000 2023-10-03T19:21:12.957 INFO:teuthology.orchestra.run.smithi045.stdout: -2781> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2471 10.1b 10:d8c655bc:::10000000195.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536450000 con 0x565534ef5400 2023-10-03T19:21:12.957 INFO:teuthology.orchestra.run.smithi045.stdout: -2780> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2472 10.1e 10:7894fe2e:::10000000196.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536451500 con 0x565534ef5000 2023-10-03T19:21:12.958 INFO:teuthology.orchestra.run.smithi045.stdout: -2779> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2473 10.12 10:4aa09692:::10000000197.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553647f180 con 0x565534ffe800 2023-10-03T19:21:12.958 INFO:teuthology.orchestra.run.smithi045.stdout: -2778> 2023-10-03T19:17:19.562+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] >> 172.21.15.146:0/2314684411 conn(0x565534151400 msgr2=0x565534ff9180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 37 2023-10-03T19:21:12.958 INFO:teuthology.orchestra.run.smithi045.stdout: -2777> 2023-10-03T19:17:19.562+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] >> 172.21.15.146:0/2314684411 conn(0x565534151400 msgr2=0x565534ff9180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T19:21:12.958 INFO:teuthology.orchestra.run.smithi045.stdout: -2776> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2474 10.30 10:0cac0e23:::10000000198.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655364ad500 con 0x5655354ba000 2023-10-03T19:21:12.958 INFO:teuthology.orchestra.run.smithi045.stdout: -2775> 2023-10-03T19:17:19.562+0000 7f0ab8971640 1 --2- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] >> 172.21.15.146:0/2314684411 conn(0x565534151400 0x565534ff9180 crc :-1 s=READY pgs=4 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T19:21:12.958 INFO:teuthology.orchestra.run.smithi045.stdout: -2774> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2475 10.33 10:cf2b08c7:::10000000199.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655364d8700 con 0x565534151000 2023-10-03T19:21:12.958 INFO:teuthology.orchestra.run.smithi045.stdout: -2773> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2476 10.20 10:068c0723:::1000000019a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553652e700 con 0x565534ef5000 2023-10-03T19:21:12.958 INFO:teuthology.orchestra.run.smithi045.stdout: -2772> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2477 10.13 10:cad07b43:::1000000019b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553655ae00 con 0x565534ef4400 2023-10-03T19:21:12.958 INFO:teuthology.orchestra.run.smithi045.stdout: -2771> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2478 10.7 10:e16233b5:::1000000019c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553655b180 con 0x565534ffe800 2023-10-03T19:21:12.959 INFO:teuthology.orchestra.run.smithi045.stdout: -2770> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2479 10.1d 10:ba9aa119:::1000000019d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553655b500 con 0x565534ef4800 2023-10-03T19:21:12.959 INFO:teuthology.orchestra.run.smithi045.stdout: -2769> 2023-10-03T19:17:19.562+0000 7f0ab8971640 1 --2- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] >> 172.21.15.146:0/2314684411 conn(0x565534151400 0x565534ff9180 unknown :-1 s=READY pgs=4 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault with nothing to send, going to standby 2023-10-03T19:21:12.959 INFO:teuthology.orchestra.run.smithi045.stdout: -2768> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2480 10.20 10:04059238:::1000000019e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553655bc00 con 0x565534ef5000 2023-10-03T19:21:12.959 INFO:teuthology.orchestra.run.smithi045.stdout: -2767> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2481 10.28 10:15089297:::1000000019f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536586380 con 0x565534ef4c00 2023-10-03T19:21:12.959 INFO:teuthology.orchestra.run.smithi045.stdout: -2766> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2482 10.3d 10:beda2349:::100000001a0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536587180 con 0x565534ef4c00 2023-10-03T19:21:12.959 INFO:teuthology.orchestra.run.smithi045.stdout: -2765> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2483 10.1d 10:b947b1d0:::100000001a1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363fd180 con 0x565534ef4800 2023-10-03T19:21:12.959 INFO:teuthology.orchestra.run.smithi045.stdout: -2764> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2484 10.c 10:3156bbd1:::100000001a2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553647f880 con 0x565534ef5400 2023-10-03T19:21:12.959 INFO:teuthology.orchestra.run.smithi045.stdout: -2763> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2485 10.37 10:eefe3312:::100000001a3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655365fdc00 con 0x565534ef4c00 2023-10-03T19:21:12.959 INFO:teuthology.orchestra.run.smithi045.stdout: -2762> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2486 10.37 10:ec159c95:::100000001a4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536624e00 con 0x565534ef4c00 2023-10-03T19:21:12.959 INFO:teuthology.orchestra.run.smithi045.stdout: -2761> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2487 10.2b 10:d55466b4:::100000001a5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536625880 con 0x565534151000 2023-10-03T19:21:12.960 INFO:teuthology.orchestra.run.smithi045.stdout: -2760> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2488 10.2e 10:775b9fb2:::100000001a6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536650380 con 0x565534ef4800 2023-10-03T19:21:12.960 INFO:teuthology.orchestra.run.smithi045.stdout: -2759> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2489 10.29 10:95eb4c87:::100000001a7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536650e00 con 0x565534ef5400 2023-10-03T19:21:12.960 INFO:teuthology.orchestra.run.smithi045.stdout: -2758> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2490 10.35 10:af372925:::100000001a8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655366a8000 con 0x565534ef4800 2023-10-03T19:21:12.960 INFO:teuthology.orchestra.run.smithi045.stdout: -2757> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2491 10.2c 10:3416e1ca:::100000001a9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655366a8380 con 0x565534ef5400 2023-10-03T19:21:12.960 INFO:teuthology.orchestra.run.smithi045.stdout: -2756> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2492 10.13 10:caba0c50:::100000001aa.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536587c00 con 0x565534ef4400 2023-10-03T19:21:13.020 INFO:teuthology.orchestra.run.smithi045.stdout: -2755> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2493 10.2e 10:76865fdc:::100000001ab.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553647e700 con 0x565534ef4800 2023-10-03T19:21:13.021 INFO:teuthology.orchestra.run.smithi045.stdout: -2754> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2494 10.7 10:e255d6cd:::100000001ac.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655365fd180 con 0x565534ffe800 2023-10-03T19:21:13.021 INFO:teuthology.orchestra.run.smithi045.stdout: -2753> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2495 10.13 10:c8b8e906:::100000001ad.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535118380 con 0x565534ef4400 2023-10-03T19:21:13.021 INFO:teuthology.orchestra.run.smithi045.stdout: -2752> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2496 10.f 10:f18f2ceb:::100000001ae.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536624000 con 0x565534ffe800 2023-10-03T19:21:13.021 INFO:teuthology.orchestra.run.smithi045.stdout: -2751> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2497 10.2a 10:540014ba:::100000001af.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553667d880 con 0x565534ef5400 2023-10-03T19:21:13.022 INFO:teuthology.orchestra.run.smithi045.stdout: -2750> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2498 10.32 10:4d7ffadd:::100000001b0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655366a8700 con 0x565534ef4c00 2023-10-03T19:21:13.022 INFO:teuthology.orchestra.run.smithi045.stdout: -2749> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2499 10.1d 10:bafada3d:::100000001b1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655366a9500 con 0x565534ef4800 2023-10-03T19:21:13.022 INFO:teuthology.orchestra.run.smithi045.stdout: -2748> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2500 10.2e 10:76ff63fc:::100000001b2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536587880 con 0x565534ef4800 2023-10-03T19:21:13.022 INFO:teuthology.orchestra.run.smithi045.stdout: -2747> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2501 10.2a 10:54062570:::100000001b3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553655a700 con 0x565534ef5400 2023-10-03T19:21:13.022 INFO:teuthology.orchestra.run.smithi045.stdout: -2746> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2502 10.7 10:e28d3c2b:::100000001b4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553652e000 con 0x565534ffe800 2023-10-03T19:21:13.022 INFO:teuthology.orchestra.run.smithi045.stdout: -2745> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2503 10.38 10:1c92f375:::100000001b5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536501500 con 0x565534151000 2023-10-03T19:21:13.022 INFO:teuthology.orchestra.run.smithi045.stdout: -2744> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2504 10.34 10:2d6f3468:::100000001b6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655364d8380 con 0x565534151000 2023-10-03T19:21:13.022 INFO:teuthology.orchestra.run.smithi045.stdout: -2743> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2505 10.19 10:99a7d964:::100000001b7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553647f500 con 0x565534ef4400 2023-10-03T19:21:13.022 INFO:teuthology.orchestra.run.smithi045.stdout: -2742> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2506 10.d 10:b3fa8219:::100000001b8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535119c00 con 0x565534ffe800 2023-10-03T19:21:13.023 INFO:teuthology.orchestra.run.smithi045.stdout: -2741> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2507 10.2d 10:b7eb2f66:::100000001b9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535112000 con 0x565534ffe800 2023-10-03T19:21:13.023 INFO:teuthology.orchestra.run.smithi045.stdout: -2740> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2508 10.36 10:6d15073c:::100000001ba.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350a6000 con 0x565534ef4c00 2023-10-03T19:21:13.023 INFO:teuthology.orchestra.run.smithi045.stdout: -2739> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2509 10.4 10:2118e87e:::100000001bb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350ba700 con 0x565534ef5000 2023-10-03T19:21:13.023 INFO:teuthology.orchestra.run.smithi045.stdout: -2738> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2510 10.19 10:9b54a4b5:::100000001bc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350b9c00 con 0x565534ef4400 2023-10-03T19:21:13.023 INFO:teuthology.orchestra.run.smithi045.stdout: -2737> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2511 10.16 10:69256f6e:::100000001bd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535246000 con 0x565534ffe800 2023-10-03T19:21:13.023 INFO:teuthology.orchestra.run.smithi045.stdout: -2736> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2512 10.20 10:05a7fbbe:::100000001be.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535118e00 con 0x565534ef5000 2023-10-03T19:21:13.023 INFO:teuthology.orchestra.run.smithi045.stdout: -2735> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2513 10.19 10:9ab6d71b:::100000001bf.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350e7500 con 0x565534ef4400 2023-10-03T19:21:13.023 INFO:teuthology.orchestra.run.smithi045.stdout: -2734> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2514 10.19 10:98a8a8b3:::100000001c0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350e6000 con 0x565534ef4400 2023-10-03T19:21:13.023 INFO:teuthology.orchestra.run.smithi045.stdout: -2733> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2515 10.1 10:823476fa:::100000001c1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536500700 con 0x565534ef4800 2023-10-03T19:21:13.023 INFO:teuthology.orchestra.run.smithi045.stdout: -2732> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2516 10.32 10:4c576489:::100000001c2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536625c00 con 0x565534ef4c00 2023-10-03T19:21:13.023 INFO:teuthology.orchestra.run.smithi045.stdout: -2731> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2517 10.1f 10:fa06f62f:::100000001c3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536426700 con 0x565534ef4c00 2023-10-03T19:21:13.024 INFO:teuthology.orchestra.run.smithi045.stdout: -2730> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2518 10.12 10:483471a4:::100000001c4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553655a000 con 0x565534ffe800 2023-10-03T19:21:13.024 INFO:teuthology.orchestra.run.smithi045.stdout: -2729> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2519 10.22 10:47177243:::100000001c5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536427180 con 0x565534151000 2023-10-03T19:21:13.024 INFO:teuthology.orchestra.run.smithi045.stdout: -2728> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2520 10.1f 10:f9e205e8:::100000001c6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363cee00 con 0x565534ef4c00 2023-10-03T19:21:13.024 INFO:teuthology.orchestra.run.smithi045.stdout: -2727> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2521 10.5 10:a07eb451:::100000001c7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553518a700 con 0x5655354ba000 2023-10-03T19:21:13.024 INFO:teuthology.orchestra.run.smithi045.stdout: -2726> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2522 10.1c 10:3b17a408:::100000001c8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535720000 con 0x565534ffe800 2023-10-03T19:21:13.024 INFO:teuthology.orchestra.run.smithi045.stdout: -2725> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2523 10.8 10:12d75f6c:::100000001c9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536651880 con 0x565534ef5000 2023-10-03T19:21:13.024 INFO:teuthology.orchestra.run.smithi045.stdout: -2724> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2524 10.16 10:6b5900d3:::100000001ca.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655365fce00 con 0x565534ffe800 2023-10-03T19:21:13.024 INFO:teuthology.orchestra.run.smithi045.stdout: -2723> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2525 10.3d 10:bce74be0:::100000001cb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553515c380 con 0x565534ef4c00 2023-10-03T19:21:13.024 INFO:teuthology.orchestra.run.smithi045.stdout: -2722> 2023-10-03T19:17:19.562+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2526 10.26 10:65df6efc:::100000001cc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350bb180 con 0x565534151000 2023-10-03T19:21:13.025 INFO:teuthology.orchestra.run.smithi045.stdout: -2721> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2527 10.21 10:86fbb64b:::100000001cd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553528d500 con 0x565534ef5400 2023-10-03T19:21:13.025 INFO:teuthology.orchestra.run.smithi045.stdout: -2720> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2528 10.14 10:29519214:::100000001ce.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553630e700 con 0x565534ef4400 2023-10-03T19:21:13.025 INFO:teuthology.orchestra.run.smithi045.stdout: -2719> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2529 10.e 10:71d3c486:::100000001cf.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553548e380 con 0x565534ef4800 2023-10-03T19:21:13.025 INFO:teuthology.orchestra.run.smithi045.stdout: -2718> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2530 10.1 10:81350243:::100000001d0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553548e000 con 0x565534ef4800 2023-10-03T19:21:13.025 INFO:teuthology.orchestra.run.smithi045.stdout: -2717> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2531 10.a 10:51da9383:::100000001d1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553548f880 con 0x565534ffe800 2023-10-03T19:21:13.025 INFO:teuthology.orchestra.run.smithi045.stdout: -2716> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2532 10.16 10:69d31978:::100000001d2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534fa1180 con 0x565534ffe800 2023-10-03T19:21:13.025 INFO:teuthology.orchestra.run.smithi045.stdout: -2715> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2533 10.3e 10:7c32b2c0:::100000001d3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534fa0380 con 0x565534ef4400 2023-10-03T19:21:13.025 INFO:teuthology.orchestra.run.smithi045.stdout: -2714> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2534 10.34 10:2d665059:::100000001d4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534fa1c00 con 0x565534151000 2023-10-03T19:21:13.026 INFO:teuthology.orchestra.run.smithi045.stdout: -2713> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2535 10.33 10:cfb1de4c:::100000001d5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535118700 con 0x565534151000 2023-10-03T19:21:13.026 INFO:teuthology.orchestra.run.smithi045.stdout: -2712> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2536 10.16 10:6b2189d7:::100000001d6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535119180 con 0x565534ffe800 2023-10-03T19:21:13.026 INFO:teuthology.orchestra.run.smithi045.stdout: -2711> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2537 10.1a 10:5b825d11:::100000001d7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553630f500 con 0x565534ffe800 2023-10-03T19:21:13.026 INFO:teuthology.orchestra.run.smithi045.stdout: -2710> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2538 10.1d 10:b82de5f4:::100000001d8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553630e380 con 0x565534ef4800 2023-10-03T19:21:13.026 INFO:teuthology.orchestra.run.smithi045.stdout: -2709> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2539 10.6 10:61ce4130:::100000001d9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553630ee00 con 0x565534151000 2023-10-03T19:21:13.027 INFO:teuthology.orchestra.run.smithi045.stdout: -2708> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.27:2540 10.37 10:ec238bc7:::100000001da.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553630e000 con 0x565534ef4c00 2023-10-03T19:21:13.027 INFO:teuthology.orchestra.run.smithi045.stdout: -2707> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2541 10.24 10:24ebe6ca:::100000001db.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534e2f500 con 0x565534ef4400 2023-10-03T19:21:13.108 INFO:teuthology.orchestra.run.smithi045.stdout: -2706> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2542 10.38 10:1fa836f3:::100000001dc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534e2e380 con 0x565534151000 2023-10-03T19:21:13.108 INFO:teuthology.orchestra.run.smithi045.stdout: -2705> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2543 10.3b 10:dd6afadf:::100000001dd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534e2e700 con 0x565534ffe800 2023-10-03T19:21:13.108 INFO:teuthology.orchestra.run.smithi045.stdout: -2704> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2544 10.2e 10:77eaaa70:::100000001de.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535113880 con 0x565534ef4800 2023-10-03T19:21:13.108 INFO:teuthology.orchestra.run.smithi045.stdout: -2703> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2545 10.34 10:2de2f068:::100000001df.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535113c00 con 0x565534151000 2023-10-03T19:21:13.108 INFO:teuthology.orchestra.run.smithi045.stdout: -2702> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2546 10.11 10:8b210d5a:::100000001e0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536500380 con 0x565534151000 2023-10-03T19:21:13.109 INFO:teuthology.orchestra.run.smithi045.stdout: -2701> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2547 10.2c 10:3650da82:::100000001e1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350fe380 con 0x565534ef5400 2023-10-03T19:21:13.109 INFO:teuthology.orchestra.run.smithi045.stdout: -2700> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2548 10.3c 10:3d7caa99:::100000001e2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350ffc00 con 0x565534ef4800 2023-10-03T19:21:13.109 INFO:teuthology.orchestra.run.smithi045.stdout: -2699> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2549 10.1b 10:da67b4c4:::100000001e3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350a6e00 con 0x565534ef5400 2023-10-03T19:21:13.109 INFO:teuthology.orchestra.run.smithi045.stdout: -2698> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2550 10.13 10:c88cf2e1:::100000001e4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363cf500 con 0x565534ef4400 2023-10-03T19:21:13.109 INFO:teuthology.orchestra.run.smithi045.stdout: -2697> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2551 10.1a 10:5bf55946:::100000001e5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363ce700 con 0x565534ffe800 2023-10-03T19:21:13.110 INFO:teuthology.orchestra.run.smithi045.stdout: -2696> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2552 10.14 10:2bd99ea3:::100000001e6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655363cf880 con 0x565534ef4400 2023-10-03T19:21:13.110 INFO:teuthology.orchestra.run.smithi045.stdout: -2695> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2553 10.24 10:25319c2b:::100000001e7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350e6700 con 0x565534ef4400 2023-10-03T19:21:13.110 INFO:teuthology.orchestra.run.smithi045.stdout: -2694> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2554 10.1c 10:3915d86a:::100000001e8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350e7c00 con 0x565534ffe800 2023-10-03T19:21:13.110 INFO:teuthology.orchestra.run.smithi045.stdout: -2693> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.27:2555 10.30 10:0def042e:::100000001e9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350ad500 con 0x5655354ba000 2023-10-03T19:21:13.111 INFO:teuthology.orchestra.run.smithi045.stdout: -2692> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2556 10.1c 10:3811fe79:::100000001ea.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350ace00 con 0x565534ffe800 2023-10-03T19:21:13.111 INFO:teuthology.orchestra.run.smithi045.stdout: -2691> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2557 10.f 10:f3be9911:::100000001eb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536426380 con 0x565534ffe800 2023-10-03T19:21:13.111 INFO:teuthology.orchestra.run.smithi045.stdout: -2690> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2558 10.a 10:52e82f0e:::100000001ec.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536427500 con 0x565534ffe800 2023-10-03T19:21:13.111 INFO:teuthology.orchestra.run.smithi045.stdout: -2689> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2559 10.14 10:2af56820:::100000001ed.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565536427c00 con 0x565534ef4400 2023-10-03T19:21:13.111 INFO:teuthology.orchestra.run.smithi045.stdout: -2688> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.27:2560 10.3a 10:5c391605:::100000001ee.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535502e00 con 0x565534ef5000 2023-10-03T19:21:13.111 INFO:teuthology.orchestra.run.smithi045.stdout: -2687> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2561 10.a 10:519c0e80:::100000001ef.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655366a9880 con 0x565534ffe800 2023-10-03T19:21:13.111 INFO:teuthology.orchestra.run.smithi045.stdout: -2686> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2562 10.13 10:ca7e1ea4:::100000001f0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655366a9c00 con 0x565534ef4400 2023-10-03T19:21:13.111 INFO:teuthology.orchestra.run.smithi045.stdout: -2685> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2563 10.33 10:ce8ed050:::100000001f1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655366a8a80 con 0x565534151000 2023-10-03T19:21:13.112 INFO:teuthology.orchestra.run.smithi045.stdout: -2684> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2564 10.b 10:d079bd36:::100000001f2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553560c380 con 0x565534ffe800 2023-10-03T19:21:13.112 INFO:teuthology.orchestra.run.smithi045.stdout: -2683> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.27:2565 10.3c 10:3d203daf:::100000001f3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x56553560ca80 con 0x565534ef4800 2023-10-03T19:21:13.112 INFO:teuthology.orchestra.run.smithi045.stdout: -2682> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.27:2566 10.14 10:2959de71:::100000001f4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535624700 con 0x565534ef4400 2023-10-03T19:21:13.112 INFO:teuthology.orchestra.run.smithi045.stdout: -2681> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.27:2567 10.d 10:b0d9c9f6:::100000001f5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565535624000 con 0x565534ffe800 2023-10-03T19:21:13.112 INFO:teuthology.orchestra.run.smithi045.stdout: -2680> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.inotable: apply_release_ids [0x100000005dd~0x1f7] to [0x100000005dd~0xfffffffa23]/[0x100000007d4~0xfffffff82c] 2023-10-03T19:21:13.112 INFO:teuthology.orchestra.run.smithi045.stdout: -2679> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.sessionmap mark_dirty s=0x565534f9e300 name=client.6102 v=1004 2023-10-03T19:21:13.113 INFO:teuthology.orchestra.run.smithi045.stdout: -2678> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsx on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6007 ap=1 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) caps={6102=pAsLsXsFsx/-@1002},l=6102 | request=0 lock=5 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:13.113 INFO:teuthology.orchestra.run.smithi045.stdout: -2677> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000000) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.113 INFO:teuthology.orchestra.run.smithi045.stdout: -2676> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.openfiles remove_dirfrag [dir 0x1 / [2,head] auth v=6008 cv=5384/5384 REP dir_auth=0 ap=0+1 state=1610874881|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=0 0x565534040d00] 2023-10-03T19:21:13.113 INFO:teuthology.orchestra.run.smithi045.stdout: -2675> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.locker eval 3648 [inode 0x10000000000 [...2,head] /dc-dir/ auth v6007 ap=1 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=5 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:13.113 INFO:teuthology.orchestra.run.smithi045.stdout: -2674> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl w=1) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6007 ap=1 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=5 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:13.113 INFO:teuthology.orchestra.run.smithi045.stdout: -2673> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.locker is excl 2023-10-03T19:21:13.113 INFO:teuthology.orchestra.run.smithi045.stdout: -2672> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 7 mds.0.locker file_eval loner_issued= other_issued= xlocker_issued= 2023-10-03T19:21:13.113 INFO:teuthology.orchestra.run.smithi045.stdout: -2671> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.locker should lose it 2023-10-03T19:21:13.113 INFO:teuthology.orchestra.run.smithi045.stdout: -2670> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.locker waiting for wrlock to drain 2023-10-03T19:21:13.114 INFO:teuthology.orchestra.run.smithi045.stdout: -2669> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.locker simple_eval (iauth sync r=1) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6007 ap=1 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=5 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:13.114 INFO:teuthology.orchestra.run.smithi045.stdout: -2668> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.locker simple_eval (ilink sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6007 ap=1 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=5 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:13.114 INFO:teuthology.orchestra.run.smithi045.stdout: -2667> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.locker simple_eval (ixattr sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6007 ap=1 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=5 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:13.114 INFO:teuthology.orchestra.run.smithi045.stdout: -2666> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.locker eval done 2023-10-03T19:21:13.114 INFO:teuthology.orchestra.run.smithi045.stdout: -2665> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFs on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (isnap sync r=1) (inest lock dirty) (ipolicy sync r=1) (iversion lock) caps={6102=pAsLsXsFs/-@7} | dirtyscattered=1 request=0 lock=2 dirfrag=1 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:13.114 INFO:teuthology.orchestra.run.smithi045.stdout: -2664> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.114 INFO:teuthology.orchestra.run.smithi045.stdout: -2663> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000001 [2,head] /dc-dir/dc-file_0 auth v1840 s=1 n(v0 rc2023-10-03T19:16:58.410780+0000 b1 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565534ff8100] 2023-10-03T19:21:13.114 INFO:teuthology.orchestra.run.smithi045.stdout: -2662> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000001) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.114 INFO:teuthology.orchestra.run.smithi045.stdout: -2661> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000001f6 [2,head] /dc-dir/dc-file_1 auth v1842 s=1 n(v0 rc2023-10-03T19:16:58.419533+0000 b1 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565534ff7600] 2023-10-03T19:21:13.174 INFO:teuthology.orchestra.run.smithi045.stdout: -2660> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000001f6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.174 INFO:teuthology.orchestra.run.smithi045.stdout: -2659> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000001f7 [2,head] /dc-dir/dc-file_2 auth v1844 s=1 n(v0 rc2023-10-03T19:16:58.429164+0000 b1 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565534ff9700] 2023-10-03T19:21:13.174 INFO:teuthology.orchestra.run.smithi045.stdout: -2658> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000001f7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.174 INFO:teuthology.orchestra.run.smithi045.stdout: -2657> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000001f8 [2,head] /dc-dir/dc-file_3 auth v1846 s=1 n(v0 rc2023-10-03T19:16:58.437618+0000 b1 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565534e26000] 2023-10-03T19:21:13.175 INFO:teuthology.orchestra.run.smithi045.stdout: -2656> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000001f8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.175 INFO:teuthology.orchestra.run.smithi045.stdout: -2655> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000001f9 [2,head] /dc-dir/dc-file_4 auth v1848 s=1 n(v0 rc2023-10-03T19:16:58.447049+0000 b1 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565534e26580] 2023-10-03T19:21:13.175 INFO:teuthology.orchestra.run.smithi045.stdout: -2654> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000001f9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.175 INFO:teuthology.orchestra.run.smithi045.stdout: -2653> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000001fa [2,head] /dc-dir/dc-file_5 auth v1850 s=1 n(v0 rc2023-10-03T19:16:58.455696+0000 b1 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565534e26b00] 2023-10-03T19:21:13.175 INFO:teuthology.orchestra.run.smithi045.stdout: -2652> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000001fa) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.176 INFO:teuthology.orchestra.run.smithi045.stdout: -2651> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000001fb [2,head] /dc-dir/dc-file_6 auth v1852 s=1 n(v0 rc2023-10-03T19:16:58.465475+0000 b1 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565534e27080] 2023-10-03T19:21:13.176 INFO:teuthology.orchestra.run.smithi045.stdout: -2650> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000001fb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.176 INFO:teuthology.orchestra.run.smithi045.stdout: -2649> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000001fc [2,head] /dc-dir/dc-file_7 auth v2188 s=1 n(v0 rc2023-10-03T19:16:58.474528+0000 b1 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565534e27600] 2023-10-03T19:21:13.176 INFO:teuthology.orchestra.run.smithi045.stdout: -2648> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000001fc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.176 INFO:teuthology.orchestra.run.smithi045.stdout: -2647> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000001fd [2,head] /dc-dir/dc-file_8 auth v2190 s=1 n(v0 rc2023-10-03T19:16:58.483765+0000 b1 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565534e27b80] 2023-10-03T19:21:13.176 INFO:teuthology.orchestra.run.smithi045.stdout: -2646> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000001fd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.176 INFO:teuthology.orchestra.run.smithi045.stdout: -2645> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000001fe [2,head] /dc-dir/dc-file_9 auth v2192 s=1 n(v0 rc2023-10-03T19:16:58.493454+0000 b1 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565534e28100] 2023-10-03T19:21:13.176 INFO:teuthology.orchestra.run.smithi045.stdout: -2644> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000001fe) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.176 INFO:teuthology.orchestra.run.smithi045.stdout: -2643> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000001ff [2,head] /dc-dir/dc-file_10 auth v2194 s=2 n(v0 rc2023-10-03T19:16:58.502521+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565534e28680] 2023-10-03T19:21:13.176 INFO:teuthology.orchestra.run.smithi045.stdout: -2642> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000001ff) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.177 INFO:teuthology.orchestra.run.smithi045.stdout: -2641> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000200 [2,head] /dc-dir/dc-file_11 auth v2196 s=2 n(v0 rc2023-10-03T19:16:58.511580+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565534e28c00] 2023-10-03T19:21:13.177 INFO:teuthology.orchestra.run.smithi045.stdout: -2640> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000200) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.177 INFO:teuthology.orchestra.run.smithi045.stdout: -2639> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000201 [2,head] /dc-dir/dc-file_12 auth v2198 s=2 n(v0 rc2023-10-03T19:16:58.522692+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565534e29180] 2023-10-03T19:21:13.177 INFO:teuthology.orchestra.run.smithi045.stdout: -2638> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000201) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.177 INFO:teuthology.orchestra.run.smithi045.stdout: -2637> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000202 [2,head] /dc-dir/dc-file_13 auth v2200 s=2 n(v0 rc2023-10-03T19:16:58.533578+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565534e29700] 2023-10-03T19:21:13.178 INFO:teuthology.orchestra.run.smithi045.stdout: -2636> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000202) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.178 INFO:teuthology.orchestra.run.smithi045.stdout: -2635> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000203 [2,head] /dc-dir/dc-file_14 auth v2202 s=2 n(v0 rc2023-10-03T19:16:58.544151+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350a2000] 2023-10-03T19:21:13.178 INFO:teuthology.orchestra.run.smithi045.stdout: -2634> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000203) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.178 INFO:teuthology.orchestra.run.smithi045.stdout: -2633> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000204 [2,head] /dc-dir/dc-file_15 auth v2204 s=2 n(v0 rc2023-10-03T19:16:58.555075+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350a2580] 2023-10-03T19:21:13.178 INFO:teuthology.orchestra.run.smithi045.stdout: -2632> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000204) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.178 INFO:teuthology.orchestra.run.smithi045.stdout: -2631> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000205 [2,head] /dc-dir/dc-file_16 auth v2206 s=2 n(v0 rc2023-10-03T19:16:58.564545+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350a2b00] 2023-10-03T19:21:13.178 INFO:teuthology.orchestra.run.smithi045.stdout: -2630> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000205) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.178 INFO:teuthology.orchestra.run.smithi045.stdout: -2629> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000206 [2,head] /dc-dir/dc-file_17 auth v2208 s=2 n(v0 rc2023-10-03T19:16:58.573616+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350a3080] 2023-10-03T19:21:13.178 INFO:teuthology.orchestra.run.smithi045.stdout: -2628> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000206) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.179 INFO:teuthology.orchestra.run.smithi045.stdout: -2627> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000207 [2,head] /dc-dir/dc-file_18 auth v2210 s=2 n(v0 rc2023-10-03T19:16:58.582800+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350a3600] 2023-10-03T19:21:13.179 INFO:teuthology.orchestra.run.smithi045.stdout: -2626> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000207) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.179 INFO:teuthology.orchestra.run.smithi045.stdout: -2625> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000208 [2,head] /dc-dir/dc-file_19 auth v2212 s=2 n(v0 rc2023-10-03T19:16:58.592557+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350a3b80] 2023-10-03T19:21:13.179 INFO:teuthology.orchestra.run.smithi045.stdout: -2624> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000208) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.179 INFO:teuthology.orchestra.run.smithi045.stdout: -2623> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000209 [2,head] /dc-dir/dc-file_20 auth v2214 s=2 n(v0 rc2023-10-03T19:16:58.602480+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350a4100] 2023-10-03T19:21:13.179 INFO:teuthology.orchestra.run.smithi045.stdout: -2622> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000209) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.179 INFO:teuthology.orchestra.run.smithi045.stdout: -2621> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000020a [2,head] /dc-dir/dc-file_21 auth v2216 s=2 n(v0 rc2023-10-03T19:16:58.611572+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350a4680] 2023-10-03T19:21:13.179 INFO:teuthology.orchestra.run.smithi045.stdout: -2620> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000020a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.179 INFO:teuthology.orchestra.run.smithi045.stdout: -2619> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000020b [2,head] /dc-dir/dc-file_22 auth v2218 s=2 n(v0 rc2023-10-03T19:16:58.620317+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350a4c00] 2023-10-03T19:21:13.179 INFO:teuthology.orchestra.run.smithi045.stdout: -2618> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000020b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.179 INFO:teuthology.orchestra.run.smithi045.stdout: -2617> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000020c [2,head] /dc-dir/dc-file_23 auth v2220 s=2 n(v0 rc2023-10-03T19:16:58.631217+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350a5180] 2023-10-03T19:21:13.180 INFO:teuthology.orchestra.run.smithi045.stdout: -2616> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000020c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.180 INFO:teuthology.orchestra.run.smithi045.stdout: -2615> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000020d [2,head] /dc-dir/dc-file_24 auth v2222 s=2 n(v0 rc2023-10-03T19:16:58.642305+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350a5700] 2023-10-03T19:21:13.180 INFO:teuthology.orchestra.run.smithi045.stdout: -2614> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000020d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.180 INFO:teuthology.orchestra.run.smithi045.stdout: -2613> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000020e [2,head] /dc-dir/dc-file_25 auth v2224 s=2 n(v0 rc2023-10-03T19:16:58.652471+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350b2000] 2023-10-03T19:21:13.180 INFO:teuthology.orchestra.run.smithi045.stdout: -2612> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000020e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.180 INFO:teuthology.orchestra.run.smithi045.stdout: -2611> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000020f [2,head] /dc-dir/dc-file_26 auth v2226 s=2 n(v0 rc2023-10-03T19:16:58.662768+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350b2580] 2023-10-03T19:21:13.180 INFO:teuthology.orchestra.run.smithi045.stdout: -2610> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000020f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.180 INFO:teuthology.orchestra.run.smithi045.stdout: -2609> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000210 [2,head] /dc-dir/dc-file_27 auth v2228 s=2 n(v0 rc2023-10-03T19:16:58.672603+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350b2b00] 2023-10-03T19:21:13.180 INFO:teuthology.orchestra.run.smithi045.stdout: -2608> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000210) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.181 INFO:teuthology.orchestra.run.smithi045.stdout: -2607> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000211 [2,head] /dc-dir/dc-file_28 auth v2230 s=2 n(v0 rc2023-10-03T19:16:58.681400+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350b3080] 2023-10-03T19:21:13.264 INFO:teuthology.orchestra.run.smithi045.stdout: -2606> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000211) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.264 INFO:teuthology.orchestra.run.smithi045.stdout: -2605> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000212 [2,head] /dc-dir/dc-file_29 auth v2232 s=2 n(v0 rc2023-10-03T19:16:58.689755+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350b3600] 2023-10-03T19:21:13.264 INFO:teuthology.orchestra.run.smithi045.stdout: -2604> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000212) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.265 INFO:teuthology.orchestra.run.smithi045.stdout: -2603> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000213 [2,head] /dc-dir/dc-file_30 auth v2234 s=2 n(v0 rc2023-10-03T19:16:58.699327+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350b3b80] 2023-10-03T19:21:13.265 INFO:teuthology.orchestra.run.smithi045.stdout: -2602> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000213) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.265 INFO:teuthology.orchestra.run.smithi045.stdout: -2601> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000214 [2,head] /dc-dir/dc-file_31 auth v2236 s=2 n(v0 rc2023-10-03T19:16:58.708905+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350b4100] 2023-10-03T19:21:13.265 INFO:teuthology.orchestra.run.smithi045.stdout: -2600> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000214) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.266 INFO:teuthology.orchestra.run.smithi045.stdout: -2599> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000215 [2,head] /dc-dir/dc-file_32 auth v2238 s=2 n(v0 rc2023-10-03T19:16:58.717618+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350b4680] 2023-10-03T19:21:13.266 INFO:teuthology.orchestra.run.smithi045.stdout: -2598> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000215) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.266 INFO:teuthology.orchestra.run.smithi045.stdout: -2597> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000216 [2,head] /dc-dir/dc-file_33 auth v2240 s=2 n(v0 rc2023-10-03T19:16:58.726933+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350b4c00] 2023-10-03T19:21:13.266 INFO:teuthology.orchestra.run.smithi045.stdout: -2596> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000216) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.266 INFO:teuthology.orchestra.run.smithi045.stdout: -2595> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000217 [2,head] /dc-dir/dc-file_34 auth v2242 s=2 n(v0 rc2023-10-03T19:16:58.736404+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350b5180] 2023-10-03T19:21:13.266 INFO:teuthology.orchestra.run.smithi045.stdout: -2594> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000217) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.266 INFO:teuthology.orchestra.run.smithi045.stdout: -2593> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000218 [2,head] /dc-dir/dc-file_35 auth v2244 s=2 n(v0 rc2023-10-03T19:16:58.745846+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350b5700] 2023-10-03T19:21:13.266 INFO:teuthology.orchestra.run.smithi045.stdout: -2592> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000218) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.267 INFO:teuthology.orchestra.run.smithi045.stdout: -2591> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000219 [2,head] /dc-dir/dc-file_36 auth v2246 s=2 n(v0 rc2023-10-03T19:16:58.755525+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350c2000] 2023-10-03T19:21:13.267 INFO:teuthology.orchestra.run.smithi045.stdout: -2590> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000219) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.267 INFO:teuthology.orchestra.run.smithi045.stdout: -2589> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000021a [2,head] /dc-dir/dc-file_37 auth v2248 s=2 n(v0 rc2023-10-03T19:16:58.764571+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350c2580] 2023-10-03T19:21:13.267 INFO:teuthology.orchestra.run.smithi045.stdout: -2588> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000021a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.267 INFO:teuthology.orchestra.run.smithi045.stdout: -2587> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000021b [2,head] /dc-dir/dc-file_38 auth v2250 s=2 n(v0 rc2023-10-03T19:16:58.773436+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350c2b00] 2023-10-03T19:21:13.267 INFO:teuthology.orchestra.run.smithi045.stdout: -2586> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000021b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.268 INFO:teuthology.orchestra.run.smithi045.stdout: -2585> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000021c [2,head] /dc-dir/dc-file_39 auth v2252 s=2 n(v0 rc2023-10-03T19:16:58.782193+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350c3080] 2023-10-03T19:21:13.268 INFO:teuthology.orchestra.run.smithi045.stdout: -2584> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000021c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.268 INFO:teuthology.orchestra.run.smithi045.stdout: -2583> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000021d [2,head] /dc-dir/dc-file_40 auth v2254 s=2 n(v0 rc2023-10-03T19:16:58.791208+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350c3600] 2023-10-03T19:21:13.268 INFO:teuthology.orchestra.run.smithi045.stdout: -2582> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000021d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.268 INFO:teuthology.orchestra.run.smithi045.stdout: -2581> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000021e [2,head] /dc-dir/dc-file_41 auth v2256 s=2 n(v0 rc2023-10-03T19:16:58.799853+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350c3b80] 2023-10-03T19:21:13.268 INFO:teuthology.orchestra.run.smithi045.stdout: -2580> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000021e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.268 INFO:teuthology.orchestra.run.smithi045.stdout: -2579> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000021f [2,head] /dc-dir/dc-file_42 auth v2258 s=2 n(v0 rc2023-10-03T19:16:58.808512+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350c4100] 2023-10-03T19:21:13.268 INFO:teuthology.orchestra.run.smithi045.stdout: -2578> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000021f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.269 INFO:teuthology.orchestra.run.smithi045.stdout: -2577> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000220 [2,head] /dc-dir/dc-file_43 auth v2260 s=2 n(v0 rc2023-10-03T19:16:58.816870+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350c4680] 2023-10-03T19:21:13.269 INFO:teuthology.orchestra.run.smithi045.stdout: -2576> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000220) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.269 INFO:teuthology.orchestra.run.smithi045.stdout: -2575> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000221 [2,head] /dc-dir/dc-file_44 auth v2262 s=2 n(v0 rc2023-10-03T19:16:58.825635+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350c4c00] 2023-10-03T19:21:13.269 INFO:teuthology.orchestra.run.smithi045.stdout: -2574> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000221) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.269 INFO:teuthology.orchestra.run.smithi045.stdout: -2573> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000222 [2,head] /dc-dir/dc-file_45 auth v2264 s=2 n(v0 rc2023-10-03T19:16:58.834339+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350c5180] 2023-10-03T19:21:13.269 INFO:teuthology.orchestra.run.smithi045.stdout: -2572> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000222) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.269 INFO:teuthology.orchestra.run.smithi045.stdout: -2571> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000223 [2,head] /dc-dir/dc-file_46 auth v2266 s=2 n(v0 rc2023-10-03T19:16:58.842798+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350c5700] 2023-10-03T19:21:13.269 INFO:teuthology.orchestra.run.smithi045.stdout: -2570> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000223) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.269 INFO:teuthology.orchestra.run.smithi045.stdout: -2569> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000224 [2,head] /dc-dir/dc-file_47 auth v2268 s=2 n(v0 rc2023-10-03T19:16:58.851832+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350d0000] 2023-10-03T19:21:13.269 INFO:teuthology.orchestra.run.smithi045.stdout: -2568> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000224) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.270 INFO:teuthology.orchestra.run.smithi045.stdout: -2567> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000225 [2,head] /dc-dir/dc-file_48 auth v2270 s=2 n(v0 rc2023-10-03T19:16:58.860908+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350d0580] 2023-10-03T19:21:13.270 INFO:teuthology.orchestra.run.smithi045.stdout: -2566> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000225) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.270 INFO:teuthology.orchestra.run.smithi045.stdout: -2565> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000226 [2,head] /dc-dir/dc-file_49 auth v2272 s=2 n(v0 rc2023-10-03T19:16:58.869508+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350d0b00] 2023-10-03T19:21:13.270 INFO:teuthology.orchestra.run.smithi045.stdout: -2564> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000226) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.270 INFO:teuthology.orchestra.run.smithi045.stdout: -2563> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000227 [2,head] /dc-dir/dc-file_50 auth v2274 s=2 n(v0 rc2023-10-03T19:16:58.878180+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350d1080] 2023-10-03T19:21:13.270 INFO:teuthology.orchestra.run.smithi045.stdout: -2562> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000227) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.270 INFO:teuthology.orchestra.run.smithi045.stdout: -2561> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000228 [2,head] /dc-dir/dc-file_51 auth v2276 s=2 n(v0 rc2023-10-03T19:16:58.886971+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350d1600] 2023-10-03T19:21:13.270 INFO:teuthology.orchestra.run.smithi045.stdout: -2560> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000228) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.270 INFO:teuthology.orchestra.run.smithi045.stdout: -2559> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000229 [2,head] /dc-dir/dc-file_52 auth v2278 s=2 n(v0 rc2023-10-03T19:16:58.895849+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350d1b80] 2023-10-03T19:21:13.270 INFO:teuthology.orchestra.run.smithi045.stdout: -2558> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000229) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.270 INFO:teuthology.orchestra.run.smithi045.stdout: -2557> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000022a [2,head] /dc-dir/dc-file_53 auth v2280 s=2 n(v0 rc2023-10-03T19:16:58.904839+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350d2100] 2023-10-03T19:21:13.271 INFO:teuthology.orchestra.run.smithi045.stdout: -2556> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000022a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.271 INFO:teuthology.orchestra.run.smithi045.stdout: -2555> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000022b [2,head] /dc-dir/dc-file_54 auth v2282 s=2 n(v0 rc2023-10-03T19:16:58.913214+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350d2680] 2023-10-03T19:21:13.271 INFO:teuthology.orchestra.run.smithi045.stdout: -2554> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000022b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.271 INFO:teuthology.orchestra.run.smithi045.stdout: -2553> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000022c [2,head] /dc-dir/dc-file_55 auth v2284 s=2 n(v0 rc2023-10-03T19:16:58.922791+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350d2c00] 2023-10-03T19:21:13.271 INFO:teuthology.orchestra.run.smithi045.stdout: -2552> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000022c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.271 INFO:teuthology.orchestra.run.smithi045.stdout: -2551> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000022d [2,head] /dc-dir/dc-file_56 auth v2286 s=2 n(v0 rc2023-10-03T19:16:58.931526+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350d3180] 2023-10-03T19:21:13.271 INFO:teuthology.orchestra.run.smithi045.stdout: -2550> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000022d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.271 INFO:teuthology.orchestra.run.smithi045.stdout: -2549> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000022e [2,head] /dc-dir/dc-file_57 auth v2288 s=2 n(v0 rc2023-10-03T19:16:58.940243+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350d3700] 2023-10-03T19:21:13.330 INFO:teuthology.orchestra.run.smithi045.stdout: -2548> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000022e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.330 INFO:teuthology.orchestra.run.smithi045.stdout: -2547> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000022f [2,head] /dc-dir/dc-file_58 auth v2290 s=2 n(v0 rc2023-10-03T19:16:58.948957+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350e0000] 2023-10-03T19:21:13.330 INFO:teuthology.orchestra.run.smithi045.stdout: -2546> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000022f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.330 INFO:teuthology.orchestra.run.smithi045.stdout: -2545> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000230 [2,head] /dc-dir/dc-file_59 auth v2292 s=2 n(v0 rc2023-10-03T19:16:58.957732+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350e0580] 2023-10-03T19:21:13.331 INFO:teuthology.orchestra.run.smithi045.stdout: -2544> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000230) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.331 INFO:teuthology.orchestra.run.smithi045.stdout: -2543> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000231 [2,head] /dc-dir/dc-file_60 auth v2294 s=2 n(v0 rc2023-10-03T19:16:58.966089+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350e0b00] 2023-10-03T19:21:13.331 INFO:teuthology.orchestra.run.smithi045.stdout: -2542> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000231) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.331 INFO:teuthology.orchestra.run.smithi045.stdout: -2541> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000232 [2,head] /dc-dir/dc-file_61 auth v2296 s=2 n(v0 rc2023-10-03T19:16:58.975668+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350e1080] 2023-10-03T19:21:13.332 INFO:teuthology.orchestra.run.smithi045.stdout: -2540> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000232) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.332 INFO:teuthology.orchestra.run.smithi045.stdout: -2539> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000233 [2,head] /dc-dir/dc-file_62 auth v2298 s=2 n(v0 rc2023-10-03T19:16:58.985581+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350e1600] 2023-10-03T19:21:13.332 INFO:teuthology.orchestra.run.smithi045.stdout: -2538> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000233) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.332 INFO:teuthology.orchestra.run.smithi045.stdout: -2537> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000234 [2,head] /dc-dir/dc-file_63 auth v2300 s=2 n(v0 rc2023-10-03T19:16:58.995083+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350e1b80] 2023-10-03T19:21:13.332 INFO:teuthology.orchestra.run.smithi045.stdout: -2536> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000234) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.332 INFO:teuthology.orchestra.run.smithi045.stdout: -2535> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000235 [2,head] /dc-dir/dc-file_64 auth v2302 s=2 n(v0 rc2023-10-03T19:16:59.005870+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350e2100] 2023-10-03T19:21:13.332 INFO:teuthology.orchestra.run.smithi045.stdout: -2534> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000235) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.332 INFO:teuthology.orchestra.run.smithi045.stdout: -2533> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000236 [2,head] /dc-dir/dc-file_65 auth v2304 s=2 n(v0 rc2023-10-03T19:16:59.016275+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350e2680] 2023-10-03T19:21:13.332 INFO:teuthology.orchestra.run.smithi045.stdout: -2532> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000236) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.332 INFO:teuthology.orchestra.run.smithi045.stdout: -2531> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000237 [2,head] /dc-dir/dc-file_66 auth v2306 s=2 n(v0 rc2023-10-03T19:16:59.027277+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350e2c00] 2023-10-03T19:21:13.333 INFO:teuthology.orchestra.run.smithi045.stdout: -2530> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000237) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.333 INFO:teuthology.orchestra.run.smithi045.stdout: -2529> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000238 [2,head] /dc-dir/dc-file_67 auth v2308 s=2 n(v0 rc2023-10-03T19:16:59.039158+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350e3180] 2023-10-03T19:21:13.333 INFO:teuthology.orchestra.run.smithi045.stdout: -2528> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000238) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.333 INFO:teuthology.orchestra.run.smithi045.stdout: -2527> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000239 [2,head] /dc-dir/dc-file_68 auth v2310 s=2 n(v0 rc2023-10-03T19:16:59.050790+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350e3700] 2023-10-03T19:21:13.333 INFO:teuthology.orchestra.run.smithi045.stdout: -2526> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000239) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.334 INFO:teuthology.orchestra.run.smithi045.stdout: -2525> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000023a [2,head] /dc-dir/dc-file_69 auth v2312 s=2 n(v0 rc2023-10-03T19:16:59.061666+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350ec000] 2023-10-03T19:21:13.334 INFO:teuthology.orchestra.run.smithi045.stdout: -2524> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000023a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.334 INFO:teuthology.orchestra.run.smithi045.stdout: -2523> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000023b [2,head] /dc-dir/dc-file_70 auth v2314 s=2 n(v0 rc2023-10-03T19:16:59.073247+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350ec580] 2023-10-03T19:21:13.334 INFO:teuthology.orchestra.run.smithi045.stdout: -2522> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000023b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.334 INFO:teuthology.orchestra.run.smithi045.stdout: -2521> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000023c [2,head] /dc-dir/dc-file_71 auth v2316 s=2 n(v0 rc2023-10-03T19:16:59.084502+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350ecb00] 2023-10-03T19:21:13.334 INFO:teuthology.orchestra.run.smithi045.stdout: -2520> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000023c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.334 INFO:teuthology.orchestra.run.smithi045.stdout: -2519> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000023d [2,head] /dc-dir/dc-file_72 auth v2318 s=2 n(v0 rc2023-10-03T19:16:59.095457+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350ed080] 2023-10-03T19:21:13.335 INFO:teuthology.orchestra.run.smithi045.stdout: -2518> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000023d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.335 INFO:teuthology.orchestra.run.smithi045.stdout: -2517> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000023e [2,head] /dc-dir/dc-file_73 auth v2320 s=2 n(v0 rc2023-10-03T19:16:59.105667+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350ed600] 2023-10-03T19:21:13.335 INFO:teuthology.orchestra.run.smithi045.stdout: -2516> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000023e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.335 INFO:teuthology.orchestra.run.smithi045.stdout: -2515> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000023f [2,head] /dc-dir/dc-file_74 auth v2322 s=2 n(v0 rc2023-10-03T19:16:59.115836+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350edb80] 2023-10-03T19:21:13.335 INFO:teuthology.orchestra.run.smithi045.stdout: -2514> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000023f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.335 INFO:teuthology.orchestra.run.smithi045.stdout: -2513> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000240 [2,head] /dc-dir/dc-file_75 auth v2324 s=2 n(v0 rc2023-10-03T19:16:59.125960+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350ee100] 2023-10-03T19:21:13.335 INFO:teuthology.orchestra.run.smithi045.stdout: -2512> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000240) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.335 INFO:teuthology.orchestra.run.smithi045.stdout: -2511> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000241 [2,head] /dc-dir/dc-file_76 auth v2326 s=2 n(v0 rc2023-10-03T19:16:59.135669+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350ee680] 2023-10-03T19:21:13.335 INFO:teuthology.orchestra.run.smithi045.stdout: -2510> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000241) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.335 INFO:teuthology.orchestra.run.smithi045.stdout: -2509> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000242 [2,head] /dc-dir/dc-file_77 auth v2328 s=2 n(v0 rc2023-10-03T19:16:59.145786+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350eec00] 2023-10-03T19:21:13.335 INFO:teuthology.orchestra.run.smithi045.stdout: -2508> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000242) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.336 INFO:teuthology.orchestra.run.smithi045.stdout: -2507> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000243 [2,head] /dc-dir/dc-file_78 auth v2330 s=2 n(v0 rc2023-10-03T19:16:59.155883+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350ef180] 2023-10-03T19:21:13.336 INFO:teuthology.orchestra.run.smithi045.stdout: -2506> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000243) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.336 INFO:teuthology.orchestra.run.smithi045.stdout: -2505> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000244 [2,head] /dc-dir/dc-file_79 auth v2332 s=2 n(v0 rc2023-10-03T19:16:59.165878+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655350ef700] 2023-10-03T19:21:13.336 INFO:teuthology.orchestra.run.smithi045.stdout: -2504> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000244) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.336 INFO:teuthology.orchestra.run.smithi045.stdout: -2503> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000245 [2,head] /dc-dir/dc-file_80 auth v2334 s=2 n(v0 rc2023-10-03T19:16:59.176829+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535100000] 2023-10-03T19:21:13.336 INFO:teuthology.orchestra.run.smithi045.stdout: -2502> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000245) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.336 INFO:teuthology.orchestra.run.smithi045.stdout: -2501> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000246 [2,head] /dc-dir/dc-file_81 auth v2336 s=2 n(v0 rc2023-10-03T19:16:59.187065+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535100580] 2023-10-03T19:21:13.336 INFO:teuthology.orchestra.run.smithi045.stdout: -2500> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000246) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.336 INFO:teuthology.orchestra.run.smithi045.stdout: -2499> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000247 [2,head] /dc-dir/dc-file_82 auth v2338 s=2 n(v0 rc2023-10-03T19:16:59.199274+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535100b00] 2023-10-03T19:21:13.336 INFO:teuthology.orchestra.run.smithi045.stdout: -2498> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000247) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.337 INFO:teuthology.orchestra.run.smithi045.stdout: -2497> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000248 [2,head] /dc-dir/dc-file_83 auth v2340 s=2 n(v0 rc2023-10-03T19:16:59.209917+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535101080] 2023-10-03T19:21:13.337 INFO:teuthology.orchestra.run.smithi045.stdout: -2496> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000248) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.337 INFO:teuthology.orchestra.run.smithi045.stdout: -2495> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000249 [2,head] /dc-dir/dc-file_84 auth v2342 s=2 n(v0 rc2023-10-03T19:16:59.221539+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535101600] 2023-10-03T19:21:13.337 INFO:teuthology.orchestra.run.smithi045.stdout: -2494> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000249) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.337 INFO:teuthology.orchestra.run.smithi045.stdout: -2493> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000024a [2,head] /dc-dir/dc-file_85 auth v2344 s=2 n(v0 rc2023-10-03T19:16:59.233646+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535101b80] 2023-10-03T19:21:13.338 INFO:teuthology.orchestra.run.smithi045.stdout: -2492> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000024a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.338 INFO:teuthology.orchestra.run.smithi045.stdout: -2491> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000024b [2,head] /dc-dir/dc-file_86 auth v2346 s=2 n(v0 rc2023-10-03T19:16:59.245790+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535102100] 2023-10-03T19:21:13.338 INFO:teuthology.orchestra.run.smithi045.stdout: -2490> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000024b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.338 INFO:teuthology.orchestra.run.smithi045.stdout: -2489> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000024c [2,head] /dc-dir/dc-file_87 auth v2348 s=2 n(v0 rc2023-10-03T19:16:59.258340+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535102680] 2023-10-03T19:21:13.338 INFO:teuthology.orchestra.run.smithi045.stdout: -2488> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000024c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.338 INFO:teuthology.orchestra.run.smithi045.stdout: -2487> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000024d [2,head] /dc-dir/dc-file_88 auth v2350 s=2 n(v0 rc2023-10-03T19:16:59.269990+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535102c00] 2023-10-03T19:21:13.338 INFO:teuthology.orchestra.run.smithi045.stdout: -2486> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000024d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.338 INFO:teuthology.orchestra.run.smithi045.stdout: -2485> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000024e [2,head] /dc-dir/dc-file_89 auth v2352 s=2 n(v0 rc2023-10-03T19:16:59.281677+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535103180] 2023-10-03T19:21:13.338 INFO:teuthology.orchestra.run.smithi045.stdout: -2484> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000024e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.339 INFO:teuthology.orchestra.run.smithi045.stdout: -2483> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000024f [2,head] /dc-dir/dc-file_90 auth v2354 s=2 n(v0 rc2023-10-03T19:16:59.292691+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535103700] 2023-10-03T19:21:13.339 INFO:teuthology.orchestra.run.smithi045.stdout: -2482> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000024f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.339 INFO:teuthology.orchestra.run.smithi045.stdout: -2481> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000250 [2,head] /dc-dir/dc-file_91 auth v2356 s=2 n(v0 rc2023-10-03T19:16:59.303098+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553511c000] 2023-10-03T19:21:13.425 INFO:teuthology.orchestra.run.smithi045.stdout: -2480> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000250) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.426 INFO:teuthology.orchestra.run.smithi045.stdout: -2479> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000251 [2,head] /dc-dir/dc-file_92 auth v2358 s=2 n(v0 rc2023-10-03T19:16:59.314615+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553511c580] 2023-10-03T19:21:13.426 INFO:teuthology.orchestra.run.smithi045.stdout: -2478> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000251) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.426 INFO:teuthology.orchestra.run.smithi045.stdout: -2477> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000252 [2,head] /dc-dir/dc-file_93 auth v2360 s=2 n(v0 rc2023-10-03T19:16:59.325049+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553511cb00] 2023-10-03T19:21:13.426 INFO:teuthology.orchestra.run.smithi045.stdout: -2476> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000252) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.426 INFO:teuthology.orchestra.run.smithi045.stdout: -2475> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000253 [2,head] /dc-dir/dc-file_94 auth v2362 s=2 n(v0 rc2023-10-03T19:16:59.336082+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553511d080] 2023-10-03T19:21:13.426 INFO:teuthology.orchestra.run.smithi045.stdout: -2474> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000253) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.427 INFO:teuthology.orchestra.run.smithi045.stdout: -2473> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000254 [2,head] /dc-dir/dc-file_95 auth v2364 s=2 n(v0 rc2023-10-03T19:16:59.347497+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553511d600] 2023-10-03T19:21:13.427 INFO:teuthology.orchestra.run.smithi045.stdout: -2472> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000254) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.427 INFO:teuthology.orchestra.run.smithi045.stdout: -2471> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000255 [2,head] /dc-dir/dc-file_96 auth v2366 s=2 n(v0 rc2023-10-03T19:16:59.359508+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553511db80] 2023-10-03T19:21:13.427 INFO:teuthology.orchestra.run.smithi045.stdout: -2470> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000255) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2469> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000256 [2,head] /dc-dir/dc-file_97 auth v2368 s=2 n(v0 rc2023-10-03T19:16:59.370143+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553511e100] 2023-10-03T19:21:13.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2468> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000256) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2467> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000257 [2,head] /dc-dir/dc-file_98 auth v2370 s=2 n(v0 rc2023-10-03T19:16:59.381905+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553511e680] 2023-10-03T19:21:13.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2466> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000257) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2465> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000258 [2,head] /dc-dir/dc-file_99 auth v2372 s=2 n(v0 rc2023-10-03T19:16:59.394326+0000 b2 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553511ec00] 2023-10-03T19:21:13.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2464> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000258) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2463> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000259 [2,head] /dc-dir/dc-file_100 auth v2374 s=3 n(v0 rc2023-10-03T19:16:59.405927+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553511f180] 2023-10-03T19:21:13.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2462> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000259) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2461> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000025a [2,head] /dc-dir/dc-file_101 auth v2376 s=3 n(v0 rc2023-10-03T19:16:59.417880+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553511f700] 2023-10-03T19:21:13.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2460> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000025a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.429 INFO:teuthology.orchestra.run.smithi045.stdout: -2459> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000025b [2,head] /dc-dir/dc-file_102 auth v2378 s=3 n(v0 rc2023-10-03T19:16:59.428414+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553512c000] 2023-10-03T19:21:13.429 INFO:teuthology.orchestra.run.smithi045.stdout: -2458> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000025b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.429 INFO:teuthology.orchestra.run.smithi045.stdout: -2457> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000025c [2,head] /dc-dir/dc-file_103 auth v2380 s=3 n(v0 rc2023-10-03T19:16:59.439104+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553512c580] 2023-10-03T19:21:13.429 INFO:teuthology.orchestra.run.smithi045.stdout: -2456> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000025c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.429 INFO:teuthology.orchestra.run.smithi045.stdout: -2455> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000025d [2,head] /dc-dir/dc-file_104 auth v2382 s=3 n(v0 rc2023-10-03T19:16:59.450194+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553512cb00] 2023-10-03T19:21:13.429 INFO:teuthology.orchestra.run.smithi045.stdout: -2454> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000025d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2453> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000025e [2,head] /dc-dir/dc-file_105 auth v2384 s=3 n(v0 rc2023-10-03T19:16:59.460609+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553512d080] 2023-10-03T19:21:13.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2452> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000025e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2451> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000025f [2,head] /dc-dir/dc-file_106 auth v2682 s=3 n(v0 rc2023-10-03T19:16:59.472501+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553512d600] 2023-10-03T19:21:13.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2450> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000025f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2449> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000260 [2,head] /dc-dir/dc-file_107 auth v2684 s=3 n(v0 rc2023-10-03T19:16:59.482869+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553512db80] 2023-10-03T19:21:13.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2448> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000260) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2447> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000261 [2,head] /dc-dir/dc-file_108 auth v2686 s=3 n(v0 rc2023-10-03T19:16:59.493068+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553512e100] 2023-10-03T19:21:13.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2446> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000261) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2445> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000262 [2,head] /dc-dir/dc-file_109 auth v2688 s=3 n(v0 rc2023-10-03T19:16:59.503343+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553512e680] 2023-10-03T19:21:13.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2444> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000262) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.431 INFO:teuthology.orchestra.run.smithi045.stdout: -2443> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000263 [2,head] /dc-dir/dc-file_110 auth v2690 s=3 n(v0 rc2023-10-03T19:16:59.513634+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553512ec00] 2023-10-03T19:21:13.431 INFO:teuthology.orchestra.run.smithi045.stdout: -2442> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000263) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.431 INFO:teuthology.orchestra.run.smithi045.stdout: -2441> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000264 [2,head] /dc-dir/dc-file_111 auth v2692 s=3 n(v0 rc2023-10-03T19:16:59.523915+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553512f180] 2023-10-03T19:21:13.431 INFO:teuthology.orchestra.run.smithi045.stdout: -2440> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000264) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.431 INFO:teuthology.orchestra.run.smithi045.stdout: -2439> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000265 [2,head] /dc-dir/dc-file_112 auth v2694 s=3 n(v0 rc2023-10-03T19:16:59.534165+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553512f700] 2023-10-03T19:21:13.431 INFO:teuthology.orchestra.run.smithi045.stdout: -2438> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000265) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.431 INFO:teuthology.orchestra.run.smithi045.stdout: -2437> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000266 [2,head] /dc-dir/dc-file_113 auth v2696 s=3 n(v0 rc2023-10-03T19:16:59.544791+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535162000] 2023-10-03T19:21:13.431 INFO:teuthology.orchestra.run.smithi045.stdout: -2436> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000266) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.431 INFO:teuthology.orchestra.run.smithi045.stdout: -2435> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000267 [2,head] /dc-dir/dc-file_114 auth v2698 s=3 n(v0 rc2023-10-03T19:16:59.554969+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535162580] 2023-10-03T19:21:13.431 INFO:teuthology.orchestra.run.smithi045.stdout: -2434> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000267) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.432 INFO:teuthology.orchestra.run.smithi045.stdout: -2433> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000268 [2,head] /dc-dir/dc-file_115 auth v2700 s=3 n(v0 rc2023-10-03T19:16:59.565474+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535162b00] 2023-10-03T19:21:13.432 INFO:teuthology.orchestra.run.smithi045.stdout: -2432> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000268) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.432 INFO:teuthology.orchestra.run.smithi045.stdout: -2431> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000269 [2,head] /dc-dir/dc-file_116 auth v2702 s=3 n(v0 rc2023-10-03T19:16:59.576251+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535163080] 2023-10-03T19:21:13.432 INFO:teuthology.orchestra.run.smithi045.stdout: -2430> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000269) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.432 INFO:teuthology.orchestra.run.smithi045.stdout: -2429> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000026a [2,head] /dc-dir/dc-file_117 auth v2704 s=3 n(v0 rc2023-10-03T19:16:59.587062+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535163600] 2023-10-03T19:21:13.432 INFO:teuthology.orchestra.run.smithi045.stdout: -2428> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000026a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.432 INFO:teuthology.orchestra.run.smithi045.stdout: -2427> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000026b [2,head] /dc-dir/dc-file_118 auth v2706 s=3 n(v0 rc2023-10-03T19:16:59.597549+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535163b80] 2023-10-03T19:21:13.432 INFO:teuthology.orchestra.run.smithi045.stdout: -2426> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000026b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.432 INFO:teuthology.orchestra.run.smithi045.stdout: -2425> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000026c [2,head] /dc-dir/dc-file_119 auth v2708 s=3 n(v0 rc2023-10-03T19:16:59.608082+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535164100] 2023-10-03T19:21:13.432 INFO:teuthology.orchestra.run.smithi045.stdout: -2424> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000026c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.432 INFO:teuthology.orchestra.run.smithi045.stdout: -2423> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000026d [2,head] /dc-dir/dc-file_120 auth v2710 s=3 n(v0 rc2023-10-03T19:16:59.618380+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535164680] 2023-10-03T19:21:13.433 INFO:teuthology.orchestra.run.smithi045.stdout: -2422> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000026d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.433 INFO:teuthology.orchestra.run.smithi045.stdout: -2421> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000026e [2,head] /dc-dir/dc-file_121 auth v2712 s=3 n(v0 rc2023-10-03T19:16:59.629159+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535164c00] 2023-10-03T19:21:13.433 INFO:teuthology.orchestra.run.smithi045.stdout: -2420> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000026e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.433 INFO:teuthology.orchestra.run.smithi045.stdout: -2419> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000026f [2,head] /dc-dir/dc-file_122 auth v2714 s=3 n(v0 rc2023-10-03T19:16:59.639890+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535165180] 2023-10-03T19:21:13.433 INFO:teuthology.orchestra.run.smithi045.stdout: -2418> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000026f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.433 INFO:teuthology.orchestra.run.smithi045.stdout: -2417> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000270 [2,head] /dc-dir/dc-file_123 auth v2716 s=3 n(v0 rc2023-10-03T19:16:59.650168+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535165700] 2023-10-03T19:21:13.433 INFO:teuthology.orchestra.run.smithi045.stdout: -2416> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000270) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.433 INFO:teuthology.orchestra.run.smithi045.stdout: -2415> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000271 [2,head] /dc-dir/dc-file_124 auth v2718 s=3 n(v0 rc2023-10-03T19:16:59.661244+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553516e000] 2023-10-03T19:21:13.433 INFO:teuthology.orchestra.run.smithi045.stdout: -2414> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000271) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.433 INFO:teuthology.orchestra.run.smithi045.stdout: -2413> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000272 [2,head] /dc-dir/dc-file_125 auth v2720 s=3 n(v0 rc2023-10-03T19:16:59.671785+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553516e580] 2023-10-03T19:21:13.433 INFO:teuthology.orchestra.run.smithi045.stdout: -2412> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000272) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.434 INFO:teuthology.orchestra.run.smithi045.stdout: -2411> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000273 [2,head] /dc-dir/dc-file_126 auth v2722 s=3 n(v0 rc2023-10-03T19:16:59.682386+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553516eb00] 2023-10-03T19:21:13.434 INFO:teuthology.orchestra.run.smithi045.stdout: -2410> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000273) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.434 INFO:teuthology.orchestra.run.smithi045.stdout: -2409> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000274 [2,head] /dc-dir/dc-file_127 auth v2724 s=3 n(v0 rc2023-10-03T19:16:59.692744+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553516f080] 2023-10-03T19:21:13.434 INFO:teuthology.orchestra.run.smithi045.stdout: -2408> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000274) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.434 INFO:teuthology.orchestra.run.smithi045.stdout: -2407> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000275 [2,head] /dc-dir/dc-file_128 auth v2726 s=3 n(v0 rc2023-10-03T19:16:59.703127+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553516f600] 2023-10-03T19:21:13.434 INFO:teuthology.orchestra.run.smithi045.stdout: -2406> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000275) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.434 INFO:teuthology.orchestra.run.smithi045.stdout: -2405> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000276 [2,head] /dc-dir/dc-file_129 auth v2728 s=3 n(v0 rc2023-10-03T19:16:59.713416+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553516fb80] 2023-10-03T19:21:13.467 INFO:teuthology.orchestra.run.smithi045.stdout: -2404> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000276) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.468 INFO:teuthology.orchestra.run.smithi045.stdout: -2403> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000277 [2,head] /dc-dir/dc-file_130 auth v2730 s=3 n(v0 rc2023-10-03T19:16:59.724328+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535170100] 2023-10-03T19:21:13.468 INFO:teuthology.orchestra.run.smithi045.stdout: -2402> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000277) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.468 INFO:teuthology.orchestra.run.smithi045.stdout: -2401> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000278 [2,head] /dc-dir/dc-file_131 auth v2732 s=3 n(v0 rc2023-10-03T19:16:59.737208+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535170680] 2023-10-03T19:21:13.468 INFO:teuthology.orchestra.run.smithi045.stdout: -2400> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000278) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.468 INFO:teuthology.orchestra.run.smithi045.stdout: -2399> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000279 [2,head] /dc-dir/dc-file_132 auth v2734 s=3 n(v0 rc2023-10-03T19:16:59.749804+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535170c00] 2023-10-03T19:21:13.469 INFO:teuthology.orchestra.run.smithi045.stdout: -2398> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000279) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.469 INFO:teuthology.orchestra.run.smithi045.stdout: -2397> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000027a [2,head] /dc-dir/dc-file_133 auth v2736 s=3 n(v0 rc2023-10-03T19:16:59.762178+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535171180] 2023-10-03T19:21:13.469 INFO:teuthology.orchestra.run.smithi045.stdout: -2396> 2023-10-03T19:17:19.566+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000027a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.469 INFO:teuthology.orchestra.run.smithi045.stdout: -2395> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000027b [2,head] /dc-dir/dc-file_134 auth v2738 s=3 n(v0 rc2023-10-03T19:16:59.774845+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535171700] 2023-10-03T19:21:13.469 INFO:teuthology.orchestra.run.smithi045.stdout: -2394> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000027b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.469 INFO:teuthology.orchestra.run.smithi045.stdout: -2393> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000027c [2,head] /dc-dir/dc-file_135 auth v2740 s=3 n(v0 rc2023-10-03T19:16:59.787509+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553517c000] 2023-10-03T19:21:13.469 INFO:teuthology.orchestra.run.smithi045.stdout: -2392> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000027c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.470 INFO:teuthology.orchestra.run.smithi045.stdout: -2391> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000027d [2,head] /dc-dir/dc-file_136 auth v2742 s=3 n(v0 rc2023-10-03T19:16:59.800291+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553517c580] 2023-10-03T19:21:13.470 INFO:teuthology.orchestra.run.smithi045.stdout: -2390> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000027d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.470 INFO:teuthology.orchestra.run.smithi045.stdout: -2389> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000027e [2,head] /dc-dir/dc-file_137 auth v2744 s=3 n(v0 rc2023-10-03T19:16:59.811966+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553517cb00] 2023-10-03T19:21:13.470 INFO:teuthology.orchestra.run.smithi045.stdout: -2388> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000027e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.470 INFO:teuthology.orchestra.run.smithi045.stdout: -2387> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000027f [2,head] /dc-dir/dc-file_138 auth v2746 s=3 n(v0 rc2023-10-03T19:16:59.823794+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553517d080] 2023-10-03T19:21:13.470 INFO:teuthology.orchestra.run.smithi045.stdout: -2386> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000027f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.470 INFO:teuthology.orchestra.run.smithi045.stdout: -2385> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000280 [2,head] /dc-dir/dc-file_139 auth v2748 s=3 n(v0 rc2023-10-03T19:16:59.833980+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553517d600] 2023-10-03T19:21:13.471 INFO:teuthology.orchestra.run.smithi045.stdout: -2384> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000280) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.471 INFO:teuthology.orchestra.run.smithi045.stdout: -2383> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000281 [2,head] /dc-dir/dc-file_140 auth v2750 s=3 n(v0 rc2023-10-03T19:16:59.844920+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553517db80] 2023-10-03T19:21:13.471 INFO:teuthology.orchestra.run.smithi045.stdout: -2382> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000281) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.471 INFO:teuthology.orchestra.run.smithi045.stdout: -2381> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000282 [2,head] /dc-dir/dc-file_141 auth v2752 s=3 n(v0 rc2023-10-03T19:16:59.855725+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553517e100] 2023-10-03T19:21:13.471 INFO:teuthology.orchestra.run.smithi045.stdout: -2380> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000282) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.471 INFO:teuthology.orchestra.run.smithi045.stdout: -2379> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000283 [2,head] /dc-dir/dc-file_142 auth v2754 s=3 n(v0 rc2023-10-03T19:16:59.865988+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553517e680] 2023-10-03T19:21:13.472 INFO:teuthology.orchestra.run.smithi045.stdout: -2378> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000283) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.472 INFO:teuthology.orchestra.run.smithi045.stdout: -2377> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000284 [2,head] /dc-dir/dc-file_143 auth v2756 s=3 n(v0 rc2023-10-03T19:16:59.876148+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553517ec00] 2023-10-03T19:21:13.472 INFO:teuthology.orchestra.run.smithi045.stdout: -2376> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000284) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.472 INFO:teuthology.orchestra.run.smithi045.stdout: -2375> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000285 [2,head] /dc-dir/dc-file_144 auth v2758 s=3 n(v0 rc2023-10-03T19:16:59.887558+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553517f180] 2023-10-03T19:21:13.472 INFO:teuthology.orchestra.run.smithi045.stdout: -2374> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000285) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.472 INFO:teuthology.orchestra.run.smithi045.stdout: -2373> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000286 [2,head] /dc-dir/dc-file_145 auth v2760 s=3 n(v0 rc2023-10-03T19:16:59.897877+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553517f700] 2023-10-03T19:21:13.472 INFO:teuthology.orchestra.run.smithi045.stdout: -2372> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000286) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.473 INFO:teuthology.orchestra.run.smithi045.stdout: -2371> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000287 [2,head] /dc-dir/dc-file_146 auth v2762 s=3 n(v0 rc2023-10-03T19:16:59.908634+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535186000] 2023-10-03T19:21:13.473 INFO:teuthology.orchestra.run.smithi045.stdout: -2370> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000287) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.473 INFO:teuthology.orchestra.run.smithi045.stdout: -2369> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000288 [2,head] /dc-dir/dc-file_147 auth v2764 s=3 n(v0 rc2023-10-03T19:16:59.920396+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535186580] 2023-10-03T19:21:13.473 INFO:teuthology.orchestra.run.smithi045.stdout: -2368> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000288) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.473 INFO:teuthology.orchestra.run.smithi045.stdout: -2367> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000289 [2,head] /dc-dir/dc-file_148 auth v2766 s=3 n(v0 rc2023-10-03T19:16:59.933471+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535186b00] 2023-10-03T19:21:13.473 INFO:teuthology.orchestra.run.smithi045.stdout: -2366> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000289) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.473 INFO:teuthology.orchestra.run.smithi045.stdout: -2365> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000028a [2,head] /dc-dir/dc-file_149 auth v2768 s=3 n(v0 rc2023-10-03T19:16:59.945141+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535187080] 2023-10-03T19:21:13.473 INFO:teuthology.orchestra.run.smithi045.stdout: -2364> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000028a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.474 INFO:teuthology.orchestra.run.smithi045.stdout: -2363> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000028b [2,head] /dc-dir/dc-file_150 auth v2770 s=3 n(v0 rc2023-10-03T19:16:59.956090+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535187600] 2023-10-03T19:21:13.474 INFO:teuthology.orchestra.run.smithi045.stdout: -2362> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000028b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.474 INFO:teuthology.orchestra.run.smithi045.stdout: -2361> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000028c [2,head] /dc-dir/dc-file_151 auth v2772 s=3 n(v0 rc2023-10-03T19:16:59.967675+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535187b80] 2023-10-03T19:21:13.474 INFO:teuthology.orchestra.run.smithi045.stdout: -2360> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000028c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.474 INFO:teuthology.orchestra.run.smithi045.stdout: -2359> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000028d [2,head] /dc-dir/dc-file_152 auth v2774 s=3 n(v0 rc2023-10-03T19:16:59.979434+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535188100] 2023-10-03T19:21:13.475 INFO:teuthology.orchestra.run.smithi045.stdout: -2358> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000028d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.475 INFO:teuthology.orchestra.run.smithi045.stdout: -2357> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000028e [2,head] /dc-dir/dc-file_153 auth v2776 s=3 n(v0 rc2023-10-03T19:16:59.992109+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535188680] 2023-10-03T19:21:13.475 INFO:teuthology.orchestra.run.smithi045.stdout: -2356> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000028e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.475 INFO:teuthology.orchestra.run.smithi045.stdout: -2355> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000028f [2,head] /dc-dir/dc-file_154 auth v2778 s=3 n(v0 rc2023-10-03T19:17:00.004697+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535188c00] 2023-10-03T19:21:13.475 INFO:teuthology.orchestra.run.smithi045.stdout: -2354> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000028f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.476 INFO:teuthology.orchestra.run.smithi045.stdout: -2353> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000290 [2,head] /dc-dir/dc-file_155 auth v2780 s=3 n(v0 rc2023-10-03T19:17:00.016060+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535189180] 2023-10-03T19:21:13.476 INFO:teuthology.orchestra.run.smithi045.stdout: -2352> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000290) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.476 INFO:teuthology.orchestra.run.smithi045.stdout: -2351> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000291 [2,head] /dc-dir/dc-file_156 auth v2782 s=3 n(v0 rc2023-10-03T19:17:00.027673+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535189700] 2023-10-03T19:21:13.476 INFO:teuthology.orchestra.run.smithi045.stdout: -2350> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000291) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.476 INFO:teuthology.orchestra.run.smithi045.stdout: -2349> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000292 [2,head] /dc-dir/dc-file_157 auth v2784 s=3 n(v0 rc2023-10-03T19:17:00.041128+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553523c000] 2023-10-03T19:21:13.476 INFO:teuthology.orchestra.run.smithi045.stdout: -2348> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000292) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.477 INFO:teuthology.orchestra.run.smithi045.stdout: -2347> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000293 [2,head] /dc-dir/dc-file_158 auth v2786 s=3 n(v0 rc2023-10-03T19:17:00.052591+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553523c580] 2023-10-03T19:21:13.477 INFO:teuthology.orchestra.run.smithi045.stdout: -2346> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000293) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.477 INFO:teuthology.orchestra.run.smithi045.stdout: -2345> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000294 [2,head] /dc-dir/dc-file_159 auth v2788 s=3 n(v0 rc2023-10-03T19:17:00.063222+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553523cb00] 2023-10-03T19:21:13.477 INFO:teuthology.orchestra.run.smithi045.stdout: -2344> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000294) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.477 INFO:teuthology.orchestra.run.smithi045.stdout: -2343> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000295 [2,head] /dc-dir/dc-file_160 auth v2790 s=3 n(v0 rc2023-10-03T19:17:00.074302+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553523d080] 2023-10-03T19:21:13.478 INFO:teuthology.orchestra.run.smithi045.stdout: -2342> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000295) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.478 INFO:teuthology.orchestra.run.smithi045.stdout: -2341> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000296 [2,head] /dc-dir/dc-file_161 auth v2792 s=3 n(v0 rc2023-10-03T19:17:00.085153+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553523d600] 2023-10-03T19:21:13.478 INFO:teuthology.orchestra.run.smithi045.stdout: -2340> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000296) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.478 INFO:teuthology.orchestra.run.smithi045.stdout: -2339> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000297 [2,head] /dc-dir/dc-file_162 auth v2794 s=3 n(v0 rc2023-10-03T19:17:00.095958+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553523db80] 2023-10-03T19:21:13.478 INFO:teuthology.orchestra.run.smithi045.stdout: -2338> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000297) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.479 INFO:teuthology.orchestra.run.smithi045.stdout: -2337> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000298 [2,head] /dc-dir/dc-file_163 auth v2796 s=3 n(v0 rc2023-10-03T19:17:00.106742+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553523e100] 2023-10-03T19:21:13.556 INFO:teuthology.orchestra.run.smithi045.stdout: -2336> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000298) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.557 INFO:teuthology.orchestra.run.smithi045.stdout: -2335> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000299 [2,head] /dc-dir/dc-file_164 auth v2798 s=3 n(v0 rc2023-10-03T19:17:00.117072+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553523e680] 2023-10-03T19:21:13.557 INFO:teuthology.orchestra.run.smithi045.stdout: -2334> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000299) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.557 INFO:teuthology.orchestra.run.smithi045.stdout: -2333> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000029a [2,head] /dc-dir/dc-file_165 auth v2800 s=3 n(v0 rc2023-10-03T19:17:00.128884+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553523ec00] 2023-10-03T19:21:13.557 INFO:teuthology.orchestra.run.smithi045.stdout: -2332> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000029a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.558 INFO:teuthology.orchestra.run.smithi045.stdout: -2331> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000029b [2,head] /dc-dir/dc-file_166 auth v2802 s=3 n(v0 rc2023-10-03T19:17:00.139459+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553523f180] 2023-10-03T19:21:13.558 INFO:teuthology.orchestra.run.smithi045.stdout: -2330> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000029b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.558 INFO:teuthology.orchestra.run.smithi045.stdout: -2329> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000029c [2,head] /dc-dir/dc-file_167 auth v2804 s=3 n(v0 rc2023-10-03T19:17:00.150202+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553523f700] 2023-10-03T19:21:13.558 INFO:teuthology.orchestra.run.smithi045.stdout: -2328> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000029c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.559 INFO:teuthology.orchestra.run.smithi045.stdout: -2327> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000029d [2,head] /dc-dir/dc-file_168 auth v2806 s=3 n(v0 rc2023-10-03T19:17:00.161021+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553524e000] 2023-10-03T19:21:13.559 INFO:teuthology.orchestra.run.smithi045.stdout: -2326> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000029d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.559 INFO:teuthology.orchestra.run.smithi045.stdout: -2325> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000029e [2,head] /dc-dir/dc-file_169 auth v2808 s=3 n(v0 rc2023-10-03T19:17:00.171890+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553524e580] 2023-10-03T19:21:13.559 INFO:teuthology.orchestra.run.smithi045.stdout: -2324> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000029e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.559 INFO:teuthology.orchestra.run.smithi045.stdout: -2323> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000029f [2,head] /dc-dir/dc-file_170 auth v2810 s=3 n(v0 rc2023-10-03T19:17:00.182696+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553524eb00] 2023-10-03T19:21:13.559 INFO:teuthology.orchestra.run.smithi045.stdout: -2322> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000029f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.560 INFO:teuthology.orchestra.run.smithi045.stdout: -2321> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002a0 [2,head] /dc-dir/dc-file_171 auth v2812 s=3 n(v0 rc2023-10-03T19:17:00.194420+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553524f080] 2023-10-03T19:21:13.560 INFO:teuthology.orchestra.run.smithi045.stdout: -2320> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002a0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.560 INFO:teuthology.orchestra.run.smithi045.stdout: -2319> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002a1 [2,head] /dc-dir/dc-file_172 auth v2814 s=3 n(v0 rc2023-10-03T19:17:00.205504+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553524f600] 2023-10-03T19:21:13.560 INFO:teuthology.orchestra.run.smithi045.stdout: -2318> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002a1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.560 INFO:teuthology.orchestra.run.smithi045.stdout: -2317> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002a2 [2,head] /dc-dir/dc-file_173 auth v2816 s=3 n(v0 rc2023-10-03T19:17:00.218099+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553524fb80] 2023-10-03T19:21:13.560 INFO:teuthology.orchestra.run.smithi045.stdout: -2316> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002a2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.560 INFO:teuthology.orchestra.run.smithi045.stdout: -2315> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002a3 [2,head] /dc-dir/dc-file_174 auth v2818 s=3 n(v0 rc2023-10-03T19:17:00.231137+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535250100] 2023-10-03T19:21:13.560 INFO:teuthology.orchestra.run.smithi045.stdout: -2314> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002a3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.561 INFO:teuthology.orchestra.run.smithi045.stdout: -2313> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002a4 [2,head] /dc-dir/dc-file_175 auth v2820 s=3 n(v0 rc2023-10-03T19:17:00.242869+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535250680] 2023-10-03T19:21:13.561 INFO:teuthology.orchestra.run.smithi045.stdout: -2312> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002a4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.561 INFO:teuthology.orchestra.run.smithi045.stdout: -2311> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002a5 [2,head] /dc-dir/dc-file_176 auth v2822 s=3 n(v0 rc2023-10-03T19:17:00.254271+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535250c00] 2023-10-03T19:21:13.561 INFO:teuthology.orchestra.run.smithi045.stdout: -2310> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002a5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.561 INFO:teuthology.orchestra.run.smithi045.stdout: -2309> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002a6 [2,head] /dc-dir/dc-file_177 auth v2824 s=3 n(v0 rc2023-10-03T19:17:00.265874+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535251180] 2023-10-03T19:21:13.561 INFO:teuthology.orchestra.run.smithi045.stdout: -2308> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002a6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.561 INFO:teuthology.orchestra.run.smithi045.stdout: -2307> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002a7 [2,head] /dc-dir/dc-file_178 auth v2826 s=3 n(v0 rc2023-10-03T19:17:00.276916+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535251700] 2023-10-03T19:21:13.561 INFO:teuthology.orchestra.run.smithi045.stdout: -2306> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002a7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.561 INFO:teuthology.orchestra.run.smithi045.stdout: -2305> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002a8 [2,head] /dc-dir/dc-file_179 auth v2828 s=3 n(v0 rc2023-10-03T19:17:00.288076+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535258000] 2023-10-03T19:21:13.561 INFO:teuthology.orchestra.run.smithi045.stdout: -2304> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002a8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.562 INFO:teuthology.orchestra.run.smithi045.stdout: -2303> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002a9 [2,head] /dc-dir/dc-file_180 auth v2830 s=3 n(v0 rc2023-10-03T19:17:00.299504+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535258580] 2023-10-03T19:21:13.562 INFO:teuthology.orchestra.run.smithi045.stdout: -2302> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002a9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.562 INFO:teuthology.orchestra.run.smithi045.stdout: -2301> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002aa [2,head] /dc-dir/dc-file_181 auth v2832 s=3 n(v0 rc2023-10-03T19:17:00.310354+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535258b00] 2023-10-03T19:21:13.562 INFO:teuthology.orchestra.run.smithi045.stdout: -2300> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002aa) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.562 INFO:teuthology.orchestra.run.smithi045.stdout: -2299> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ab [2,head] /dc-dir/dc-file_182 auth v2834 s=3 n(v0 rc2023-10-03T19:17:00.322481+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535259080] 2023-10-03T19:21:13.562 INFO:teuthology.orchestra.run.smithi045.stdout: -2298> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002ab) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.562 INFO:teuthology.orchestra.run.smithi045.stdout: -2297> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ac [2,head] /dc-dir/dc-file_183 auth v2836 s=3 n(v0 rc2023-10-03T19:17:00.334110+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535259600] 2023-10-03T19:21:13.563 INFO:teuthology.orchestra.run.smithi045.stdout: -2296> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002ac) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.563 INFO:teuthology.orchestra.run.smithi045.stdout: -2295> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ad [2,head] /dc-dir/dc-file_184 auth v2838 s=3 n(v0 rc2023-10-03T19:17:00.347961+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535259b80] 2023-10-03T19:21:13.563 INFO:teuthology.orchestra.run.smithi045.stdout: -2294> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002ad) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.563 INFO:teuthology.orchestra.run.smithi045.stdout: -2293> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ae [2,head] /dc-dir/dc-file_185 auth v2840 s=3 n(v0 rc2023-10-03T19:17:00.360099+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553525a100] 2023-10-03T19:21:13.563 INFO:teuthology.orchestra.run.smithi045.stdout: -2292> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002ae) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.563 INFO:teuthology.orchestra.run.smithi045.stdout: -2291> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002af [2,head] /dc-dir/dc-file_186 auth v2842 s=3 n(v0 rc2023-10-03T19:17:00.371401+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553525a680] 2023-10-03T19:21:13.564 INFO:teuthology.orchestra.run.smithi045.stdout: -2290> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002af) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.564 INFO:teuthology.orchestra.run.smithi045.stdout: -2289> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002b0 [2,head] /dc-dir/dc-file_187 auth v2844 s=3 n(v0 rc2023-10-03T19:17:00.382604+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553525ac00] 2023-10-03T19:21:13.564 INFO:teuthology.orchestra.run.smithi045.stdout: -2288> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002b0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.564 INFO:teuthology.orchestra.run.smithi045.stdout: -2287> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002b1 [2,head] /dc-dir/dc-file_188 auth v2846 s=3 n(v0 rc2023-10-03T19:17:00.394529+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553525b180] 2023-10-03T19:21:13.564 INFO:teuthology.orchestra.run.smithi045.stdout: -2286> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002b1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.564 INFO:teuthology.orchestra.run.smithi045.stdout: -2285> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002b2 [2,head] /dc-dir/dc-file_189 auth v2848 s=3 n(v0 rc2023-10-03T19:17:00.406376+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553525b700] 2023-10-03T19:21:13.564 INFO:teuthology.orchestra.run.smithi045.stdout: -2284> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002b2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.564 INFO:teuthology.orchestra.run.smithi045.stdout: -2283> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002b3 [2,head] /dc-dir/dc-file_190 auth v2850 s=3 n(v0 rc2023-10-03T19:17:00.417628+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535182000] 2023-10-03T19:21:13.564 INFO:teuthology.orchestra.run.smithi045.stdout: -2282> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002b3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.564 INFO:teuthology.orchestra.run.smithi045.stdout: -2281> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002b4 [2,head] /dc-dir/dc-file_191 auth v2852 s=3 n(v0 rc2023-10-03T19:17:00.429209+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535182580] 2023-10-03T19:21:13.565 INFO:teuthology.orchestra.run.smithi045.stdout: -2280> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002b4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.565 INFO:teuthology.orchestra.run.smithi045.stdout: -2279> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002b5 [2,head] /dc-dir/dc-file_192 auth v2854 s=3 n(v0 rc2023-10-03T19:17:00.440047+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535182b00] 2023-10-03T19:21:13.623 INFO:teuthology.orchestra.run.smithi045.stdout: -2278> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002b5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.623 INFO:teuthology.orchestra.run.smithi045.stdout: -2277> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002b6 [2,head] /dc-dir/dc-file_193 auth v2856 s=3 n(v0 rc2023-10-03T19:17:00.450922+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535183080] 2023-10-03T19:21:13.623 INFO:teuthology.orchestra.run.smithi045.stdout: -2276> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002b6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.624 INFO:teuthology.orchestra.run.smithi045.stdout: -2275> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002b7 [2,head] /dc-dir/dc-file_194 auth v2858 s=3 n(v0 rc2023-10-03T19:17:00.462301+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535183600] 2023-10-03T19:21:13.624 INFO:teuthology.orchestra.run.smithi045.stdout: -2274> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002b7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.624 INFO:teuthology.orchestra.run.smithi045.stdout: -2273> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002b8 [2,head] /dc-dir/dc-file_195 auth v3146 s=3 n(v0 rc2023-10-03T19:17:00.475024+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535183b80] 2023-10-03T19:21:13.624 INFO:teuthology.orchestra.run.smithi045.stdout: -2272> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002b8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.624 INFO:teuthology.orchestra.run.smithi045.stdout: -2271> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002b9 [2,head] /dc-dir/dc-file_196 auth v3148 s=3 n(v0 rc2023-10-03T19:17:00.486219+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535184100] 2023-10-03T19:21:13.624 INFO:teuthology.orchestra.run.smithi045.stdout: -2270> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002b9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.624 INFO:teuthology.orchestra.run.smithi045.stdout: -2269> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ba [2,head] /dc-dir/dc-file_197 auth v3150 s=3 n(v0 rc2023-10-03T19:17:00.497275+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535184680] 2023-10-03T19:21:13.624 INFO:teuthology.orchestra.run.smithi045.stdout: -2268> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002ba) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.624 INFO:teuthology.orchestra.run.smithi045.stdout: -2267> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002bb [2,head] /dc-dir/dc-file_198 auth v3152 s=3 n(v0 rc2023-10-03T19:17:00.508191+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535184c00] 2023-10-03T19:21:13.624 INFO:teuthology.orchestra.run.smithi045.stdout: -2266> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002bb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.624 INFO:teuthology.orchestra.run.smithi045.stdout: -2265> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002bc [2,head] /dc-dir/dc-file_199 auth v3154 s=3 n(v0 rc2023-10-03T19:17:00.519204+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535185180] 2023-10-03T19:21:13.625 INFO:teuthology.orchestra.run.smithi045.stdout: -2264> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002bc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.625 INFO:teuthology.orchestra.run.smithi045.stdout: -2263> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002bd [2,head] /dc-dir/dc-file_200 auth v3156 s=3 n(v0 rc2023-10-03T19:17:00.530375+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535185700] 2023-10-03T19:21:13.625 INFO:teuthology.orchestra.run.smithi045.stdout: -2262> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002bd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.625 INFO:teuthology.orchestra.run.smithi045.stdout: -2261> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002be [2,head] /dc-dir/dc-file_201 auth v3158 s=3 n(v0 rc2023-10-03T19:17:00.541175+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535274000] 2023-10-03T19:21:13.625 INFO:teuthology.orchestra.run.smithi045.stdout: -2260> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002be) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.625 INFO:teuthology.orchestra.run.smithi045.stdout: -2259> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002bf [2,head] /dc-dir/dc-file_202 auth v3160 s=3 n(v0 rc2023-10-03T19:17:00.551718+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535274580] 2023-10-03T19:21:13.625 INFO:teuthology.orchestra.run.smithi045.stdout: -2258> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002bf) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.625 INFO:teuthology.orchestra.run.smithi045.stdout: -2257> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002c0 [2,head] /dc-dir/dc-file_203 auth v3162 s=3 n(v0 rc2023-10-03T19:17:00.562216+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535274b00] 2023-10-03T19:21:13.625 INFO:teuthology.orchestra.run.smithi045.stdout: -2256> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002c0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.625 INFO:teuthology.orchestra.run.smithi045.stdout: -2255> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002c1 [2,head] /dc-dir/dc-file_204 auth v3164 s=3 n(v0 rc2023-10-03T19:17:00.573146+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535275080] 2023-10-03T19:21:13.625 INFO:teuthology.orchestra.run.smithi045.stdout: -2254> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002c1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.626 INFO:teuthology.orchestra.run.smithi045.stdout: -2253> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002c2 [2,head] /dc-dir/dc-file_205 auth v3166 s=3 n(v0 rc2023-10-03T19:17:00.583901+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535275600] 2023-10-03T19:21:13.626 INFO:teuthology.orchestra.run.smithi045.stdout: -2252> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002c2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.626 INFO:teuthology.orchestra.run.smithi045.stdout: -2251> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002c3 [2,head] /dc-dir/dc-file_206 auth v3168 s=3 n(v0 rc2023-10-03T19:17:00.595218+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535275b80] 2023-10-03T19:21:13.626 INFO:teuthology.orchestra.run.smithi045.stdout: -2250> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002c3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.626 INFO:teuthology.orchestra.run.smithi045.stdout: -2249> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002c4 [2,head] /dc-dir/dc-file_207 auth v3170 s=3 n(v0 rc2023-10-03T19:17:00.606234+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535276100] 2023-10-03T19:21:13.626 INFO:teuthology.orchestra.run.smithi045.stdout: -2248> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002c4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.626 INFO:teuthology.orchestra.run.smithi045.stdout: -2247> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002c5 [2,head] /dc-dir/dc-file_208 auth v3172 s=3 n(v0 rc2023-10-03T19:17:00.617639+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535276680] 2023-10-03T19:21:13.626 INFO:teuthology.orchestra.run.smithi045.stdout: -2246> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002c5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.626 INFO:teuthology.orchestra.run.smithi045.stdout: -2245> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002c6 [2,head] /dc-dir/dc-file_209 auth v3174 s=3 n(v0 rc2023-10-03T19:17:00.628803+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535276c00] 2023-10-03T19:21:13.626 INFO:teuthology.orchestra.run.smithi045.stdout: -2244> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002c6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.627 INFO:teuthology.orchestra.run.smithi045.stdout: -2243> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002c7 [2,head] /dc-dir/dc-file_210 auth v3176 s=3 n(v0 rc2023-10-03T19:17:00.639720+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535277180] 2023-10-03T19:21:13.627 INFO:teuthology.orchestra.run.smithi045.stdout: -2242> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002c7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.627 INFO:teuthology.orchestra.run.smithi045.stdout: -2241> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002c8 [2,head] /dc-dir/dc-file_211 auth v3178 s=3 n(v0 rc2023-10-03T19:17:00.652251+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535277700] 2023-10-03T19:21:13.627 INFO:teuthology.orchestra.run.smithi045.stdout: -2240> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002c8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.627 INFO:teuthology.orchestra.run.smithi045.stdout: -2239> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002c9 [2,head] /dc-dir/dc-file_212 auth v3180 s=3 n(v0 rc2023-10-03T19:17:00.664936+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553527c000] 2023-10-03T19:21:13.627 INFO:teuthology.orchestra.run.smithi045.stdout: -2238> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002c9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.627 INFO:teuthology.orchestra.run.smithi045.stdout: -2237> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ca [2,head] /dc-dir/dc-file_213 auth v3182 s=3 n(v0 rc2023-10-03T19:17:00.677949+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553527c580] 2023-10-03T19:21:13.629 INFO:teuthology.orchestra.run.smithi045.stdout: -2236> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002ca) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.629 INFO:teuthology.orchestra.run.smithi045.stdout: -2235> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002cb [2,head] /dc-dir/dc-file_214 auth v3184 s=3 n(v0 rc2023-10-03T19:17:00.689573+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553527cb00] 2023-10-03T19:21:13.629 INFO:teuthology.orchestra.run.smithi045.stdout: -2234> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002cb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.630 INFO:teuthology.orchestra.run.smithi045.stdout: -2233> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002cc [2,head] /dc-dir/dc-file_215 auth v3186 s=3 n(v0 rc2023-10-03T19:17:00.700676+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553527d080] 2023-10-03T19:21:13.630 INFO:teuthology.orchestra.run.smithi045.stdout: -2232> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002cc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.630 INFO:teuthology.orchestra.run.smithi045.stdout: -2231> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002cd [2,head] /dc-dir/dc-file_216 auth v3188 s=3 n(v0 rc2023-10-03T19:17:00.711667+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553527d600] 2023-10-03T19:21:13.630 INFO:teuthology.orchestra.run.smithi045.stdout: -2230> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002cd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.630 INFO:teuthology.orchestra.run.smithi045.stdout: -2229> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ce [2,head] /dc-dir/dc-file_217 auth v3190 s=3 n(v0 rc2023-10-03T19:17:00.723985+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553527db80] 2023-10-03T19:21:13.630 INFO:teuthology.orchestra.run.smithi045.stdout: -2228> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002ce) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.631 INFO:teuthology.orchestra.run.smithi045.stdout: -2227> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002cf [2,head] /dc-dir/dc-file_218 auth v3192 s=3 n(v0 rc2023-10-03T19:17:00.737518+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553527e100] 2023-10-03T19:21:13.631 INFO:teuthology.orchestra.run.smithi045.stdout: -2226> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002cf) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.631 INFO:teuthology.orchestra.run.smithi045.stdout: -2225> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002d0 [2,head] /dc-dir/dc-file_219 auth v3194 s=3 n(v0 rc2023-10-03T19:17:00.750702+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553527e680] 2023-10-03T19:21:13.631 INFO:teuthology.orchestra.run.smithi045.stdout: -2224> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002d0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.631 INFO:teuthology.orchestra.run.smithi045.stdout: -2223> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002d1 [2,head] /dc-dir/dc-file_220 auth v3196 s=3 n(v0 rc2023-10-03T19:17:00.764074+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553527ec00] 2023-10-03T19:21:13.631 INFO:teuthology.orchestra.run.smithi045.stdout: -2222> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002d1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.632 INFO:teuthology.orchestra.run.smithi045.stdout: -2221> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002d2 [2,head] /dc-dir/dc-file_221 auth v3198 s=3 n(v0 rc2023-10-03T19:17:00.776250+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553527f180] 2023-10-03T19:21:13.632 INFO:teuthology.orchestra.run.smithi045.stdout: -2220> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002d2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.632 INFO:teuthology.orchestra.run.smithi045.stdout: -2219> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002d3 [2,head] /dc-dir/dc-file_222 auth v3200 s=3 n(v0 rc2023-10-03T19:17:00.790320+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553527f700] 2023-10-03T19:21:13.632 INFO:teuthology.orchestra.run.smithi045.stdout: -2218> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002d3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.632 INFO:teuthology.orchestra.run.smithi045.stdout: -2217> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002d4 [2,head] /dc-dir/dc-file_223 auth v3202 s=3 n(v0 rc2023-10-03T19:17:00.800646+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553528e000] 2023-10-03T19:21:13.632 INFO:teuthology.orchestra.run.smithi045.stdout: -2216> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002d4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.633 INFO:teuthology.orchestra.run.smithi045.stdout: -2215> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002d5 [2,head] /dc-dir/dc-file_224 auth v3204 s=3 n(v0 rc2023-10-03T19:17:00.811933+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553528e580] 2023-10-03T19:21:13.710 INFO:teuthology.orchestra.run.smithi045.stdout: -2214> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002d5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.711 INFO:teuthology.orchestra.run.smithi045.stdout: -2213> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002d6 [2,head] /dc-dir/dc-file_225 auth v3206 s=3 n(v0 rc2023-10-03T19:17:00.822662+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553528eb00] 2023-10-03T19:21:13.711 INFO:teuthology.orchestra.run.smithi045.stdout: -2212> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002d6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.711 INFO:teuthology.orchestra.run.smithi045.stdout: -2211> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002d7 [2,head] /dc-dir/dc-file_226 auth v3208 s=3 n(v0 rc2023-10-03T19:17:00.834335+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553528f080] 2023-10-03T19:21:13.711 INFO:teuthology.orchestra.run.smithi045.stdout: -2210> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002d7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.712 INFO:teuthology.orchestra.run.smithi045.stdout: -2209> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002d8 [2,head] /dc-dir/dc-file_227 auth v3210 s=3 n(v0 rc2023-10-03T19:17:00.846547+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553528f600] 2023-10-03T19:21:13.712 INFO:teuthology.orchestra.run.smithi045.stdout: -2208> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002d8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.712 INFO:teuthology.orchestra.run.smithi045.stdout: -2207> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002d9 [2,head] /dc-dir/dc-file_228 auth v3212 s=3 n(v0 rc2023-10-03T19:17:00.859235+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553528fb80] 2023-10-03T19:21:13.712 INFO:teuthology.orchestra.run.smithi045.stdout: -2206> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002d9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.712 INFO:teuthology.orchestra.run.smithi045.stdout: -2205> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002da [2,head] /dc-dir/dc-file_229 auth v3214 s=3 n(v0 rc2023-10-03T19:17:00.871894+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535290100] 2023-10-03T19:21:13.713 INFO:teuthology.orchestra.run.smithi045.stdout: -2204> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002da) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.713 INFO:teuthology.orchestra.run.smithi045.stdout: -2203> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002db [2,head] /dc-dir/dc-file_230 auth v3216 s=3 n(v0 rc2023-10-03T19:17:00.883282+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535290680] 2023-10-03T19:21:13.713 INFO:teuthology.orchestra.run.smithi045.stdout: -2202> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002db) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.713 INFO:teuthology.orchestra.run.smithi045.stdout: -2201> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002dc [2,head] /dc-dir/dc-file_231 auth v3218 s=3 n(v0 rc2023-10-03T19:17:00.894944+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535290c00] 2023-10-03T19:21:13.713 INFO:teuthology.orchestra.run.smithi045.stdout: -2200> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002dc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.713 INFO:teuthology.orchestra.run.smithi045.stdout: -2199> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002dd [2,head] /dc-dir/dc-file_232 auth v3220 s=3 n(v0 rc2023-10-03T19:17:00.907327+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535291180] 2023-10-03T19:21:13.713 INFO:teuthology.orchestra.run.smithi045.stdout: -2198> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002dd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.713 INFO:teuthology.orchestra.run.smithi045.stdout: -2197> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002de [2,head] /dc-dir/dc-file_233 auth v3222 s=3 n(v0 rc2023-10-03T19:17:00.918620+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535291700] 2023-10-03T19:21:13.713 INFO:teuthology.orchestra.run.smithi045.stdout: -2196> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002de) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.714 INFO:teuthology.orchestra.run.smithi045.stdout: -2195> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002df [2,head] /dc-dir/dc-file_234 auth v3224 s=3 n(v0 rc2023-10-03T19:17:00.930290+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553529e000] 2023-10-03T19:21:13.714 INFO:teuthology.orchestra.run.smithi045.stdout: -2194> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002df) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.714 INFO:teuthology.orchestra.run.smithi045.stdout: -2193> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002e0 [2,head] /dc-dir/dc-file_235 auth v3226 s=3 n(v0 rc2023-10-03T19:17:00.942323+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553529e580] 2023-10-03T19:21:13.714 INFO:teuthology.orchestra.run.smithi045.stdout: -2192> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002e0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.714 INFO:teuthology.orchestra.run.smithi045.stdout: -2191> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002e1 [2,head] /dc-dir/dc-file_236 auth v3228 s=3 n(v0 rc2023-10-03T19:17:00.953250+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553529eb00] 2023-10-03T19:21:13.715 INFO:teuthology.orchestra.run.smithi045.stdout: -2190> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002e1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.715 INFO:teuthology.orchestra.run.smithi045.stdout: -2189> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002e2 [2,head] /dc-dir/dc-file_237 auth v3230 s=3 n(v0 rc2023-10-03T19:17:00.964361+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553529f080] 2023-10-03T19:21:13.715 INFO:teuthology.orchestra.run.smithi045.stdout: -2188> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002e2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.715 INFO:teuthology.orchestra.run.smithi045.stdout: -2187> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002e3 [2,head] /dc-dir/dc-file_238 auth v3232 s=3 n(v0 rc2023-10-03T19:17:00.975868+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553529f600] 2023-10-03T19:21:13.715 INFO:teuthology.orchestra.run.smithi045.stdout: -2186> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002e3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.716 INFO:teuthology.orchestra.run.smithi045.stdout: -2185> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002e4 [2,head] /dc-dir/dc-file_239 auth v3234 s=3 n(v0 rc2023-10-03T19:17:00.987158+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553529fb80] 2023-10-03T19:21:13.716 INFO:teuthology.orchestra.run.smithi045.stdout: -2184> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002e4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.716 INFO:teuthology.orchestra.run.smithi045.stdout: -2183> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002e5 [2,head] /dc-dir/dc-file_240 auth v3236 s=3 n(v0 rc2023-10-03T19:17:00.998217+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352a0100] 2023-10-03T19:21:13.716 INFO:teuthology.orchestra.run.smithi045.stdout: -2182> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002e5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.716 INFO:teuthology.orchestra.run.smithi045.stdout: -2181> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002e6 [2,head] /dc-dir/dc-file_241 auth v3238 s=3 n(v0 rc2023-10-03T19:17:01.009599+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352a0680] 2023-10-03T19:21:13.716 INFO:teuthology.orchestra.run.smithi045.stdout: -2180> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002e6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.716 INFO:teuthology.orchestra.run.smithi045.stdout: -2179> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002e7 [2,head] /dc-dir/dc-file_242 auth v3240 s=3 n(v0 rc2023-10-03T19:17:01.020904+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352a0c00] 2023-10-03T19:21:13.716 INFO:teuthology.orchestra.run.smithi045.stdout: -2178> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002e7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.716 INFO:teuthology.orchestra.run.smithi045.stdout: -2177> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002e8 [2,head] /dc-dir/dc-file_243 auth v3242 s=3 n(v0 rc2023-10-03T19:17:01.032156+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352a1180] 2023-10-03T19:21:13.716 INFO:teuthology.orchestra.run.smithi045.stdout: -2176> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002e8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.717 INFO:teuthology.orchestra.run.smithi045.stdout: -2175> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002e9 [2,head] /dc-dir/dc-file_244 auth v3244 s=3 n(v0 rc2023-10-03T19:17:01.044591+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352a1700] 2023-10-03T19:21:13.717 INFO:teuthology.orchestra.run.smithi045.stdout: -2174> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002e9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.717 INFO:teuthology.orchestra.run.smithi045.stdout: -2173> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ea [2,head] /dc-dir/dc-file_245 auth v3246 s=3 n(v0 rc2023-10-03T19:17:01.056640+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352ae000] 2023-10-03T19:21:13.717 INFO:teuthology.orchestra.run.smithi045.stdout: -2172> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002ea) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.718 INFO:teuthology.orchestra.run.smithi045.stdout: -2171> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002eb [2,head] /dc-dir/dc-file_246 auth v3248 s=3 n(v0 rc2023-10-03T19:17:01.068155+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352ae580] 2023-10-03T19:21:13.718 INFO:teuthology.orchestra.run.smithi045.stdout: -2170> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002eb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.718 INFO:teuthology.orchestra.run.smithi045.stdout: -2169> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ec [2,head] /dc-dir/dc-file_247 auth v3250 s=3 n(v0 rc2023-10-03T19:17:01.079464+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352aeb00] 2023-10-03T19:21:13.718 INFO:teuthology.orchestra.run.smithi045.stdout: -2168> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002ec) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.718 INFO:teuthology.orchestra.run.smithi045.stdout: -2167> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ed [2,head] /dc-dir/dc-file_248 auth v3252 s=3 n(v0 rc2023-10-03T19:17:01.091215+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352af080] 2023-10-03T19:21:13.719 INFO:teuthology.orchestra.run.smithi045.stdout: -2166> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002ed) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.719 INFO:teuthology.orchestra.run.smithi045.stdout: -2165> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ee [2,head] /dc-dir/dc-file_249 auth v3254 s=3 n(v0 rc2023-10-03T19:17:01.102232+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352af600] 2023-10-03T19:21:13.719 INFO:teuthology.orchestra.run.smithi045.stdout: -2164> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002ee) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.719 INFO:teuthology.orchestra.run.smithi045.stdout: -2163> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ef [2,head] /dc-dir/dc-file_250 auth v3256 s=3 n(v0 rc2023-10-03T19:17:01.113228+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352afb80] 2023-10-03T19:21:13.719 INFO:teuthology.orchestra.run.smithi045.stdout: -2162> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002ef) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.720 INFO:teuthology.orchestra.run.smithi045.stdout: -2161> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002f0 [2,head] /dc-dir/dc-file_251 auth v3258 s=3 n(v0 rc2023-10-03T19:17:01.123939+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352b0100] 2023-10-03T19:21:13.720 INFO:teuthology.orchestra.run.smithi045.stdout: -2160> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002f0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.720 INFO:teuthology.orchestra.run.smithi045.stdout: -2159> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002f1 [2,head] /dc-dir/dc-file_252 auth v3260 s=3 n(v0 rc2023-10-03T19:17:01.134672+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352b0680] 2023-10-03T19:21:13.720 INFO:teuthology.orchestra.run.smithi045.stdout: -2158> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002f1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.720 INFO:teuthology.orchestra.run.smithi045.stdout: -2157> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002f2 [2,head] /dc-dir/dc-file_253 auth v3262 s=3 n(v0 rc2023-10-03T19:17:01.146652+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352b0c00] 2023-10-03T19:21:13.721 INFO:teuthology.orchestra.run.smithi045.stdout: -2156> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002f2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.721 INFO:teuthology.orchestra.run.smithi045.stdout: -2155> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002f3 [2,head] /dc-dir/dc-file_254 auth v3264 s=3 n(v0 rc2023-10-03T19:17:01.158434+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352b1180] 2023-10-03T19:21:13.721 INFO:teuthology.orchestra.run.smithi045.stdout: -2154> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002f3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.764 INFO:teuthology.orchestra.run.smithi045.stdout: -2153> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002f4 [2,head] /dc-dir/dc-file_255 auth v3266 s=3 n(v0 rc2023-10-03T19:17:01.169195+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352b1700] 2023-10-03T19:21:13.765 INFO:teuthology.orchestra.run.smithi045.stdout: -2152> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002f4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.765 INFO:teuthology.orchestra.run.smithi045.stdout: -2151> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002f5 [2,head] /dc-dir/dc-file_256 auth v3268 s=3 n(v0 rc2023-10-03T19:17:01.181544+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352be000] 2023-10-03T19:21:13.765 INFO:teuthology.orchestra.run.smithi045.stdout: -2150> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002f5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.765 INFO:teuthology.orchestra.run.smithi045.stdout: -2149> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002f6 [2,head] /dc-dir/dc-file_257 auth v3270 s=3 n(v0 rc2023-10-03T19:17:01.192860+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352be580] 2023-10-03T19:21:13.765 INFO:teuthology.orchestra.run.smithi045.stdout: -2148> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002f6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.766 INFO:teuthology.orchestra.run.smithi045.stdout: -2147> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002f7 [2,head] /dc-dir/dc-file_258 auth v3272 s=3 n(v0 rc2023-10-03T19:17:01.203563+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352beb00] 2023-10-03T19:21:13.766 INFO:teuthology.orchestra.run.smithi045.stdout: -2146> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002f7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.766 INFO:teuthology.orchestra.run.smithi045.stdout: -2145> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002f8 [2,head] /dc-dir/dc-file_259 auth v3274 s=3 n(v0 rc2023-10-03T19:17:01.214188+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352bf080] 2023-10-03T19:21:13.766 INFO:teuthology.orchestra.run.smithi045.stdout: -2144> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002f8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.767 INFO:teuthology.orchestra.run.smithi045.stdout: -2143> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002f9 [2,head] /dc-dir/dc-file_260 auth v3276 s=3 n(v0 rc2023-10-03T19:17:01.225036+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352bf600] 2023-10-03T19:21:13.767 INFO:teuthology.orchestra.run.smithi045.stdout: -2142> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002f9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.767 INFO:teuthology.orchestra.run.smithi045.stdout: -2141> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002fa [2,head] /dc-dir/dc-file_261 auth v3278 s=3 n(v0 rc2023-10-03T19:17:01.235947+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352bfb80] 2023-10-03T19:21:13.767 INFO:teuthology.orchestra.run.smithi045.stdout: -2140> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002fa) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.767 INFO:teuthology.orchestra.run.smithi045.stdout: -2139> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002fb [2,head] /dc-dir/dc-file_262 auth v3280 s=3 n(v0 rc2023-10-03T19:17:01.247239+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352c0100] 2023-10-03T19:21:13.768 INFO:teuthology.orchestra.run.smithi045.stdout: -2138> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002fb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.768 INFO:teuthology.orchestra.run.smithi045.stdout: -2137> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002fc [2,head] /dc-dir/dc-file_263 auth v3282 s=3 n(v0 rc2023-10-03T19:17:01.258021+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352c0680] 2023-10-03T19:21:13.768 INFO:teuthology.orchestra.run.smithi045.stdout: -2136> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002fc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.768 INFO:teuthology.orchestra.run.smithi045.stdout: -2135> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002fd [2,head] /dc-dir/dc-file_264 auth v3284 s=3 n(v0 rc2023-10-03T19:17:01.268603+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352c0c00] 2023-10-03T19:21:13.768 INFO:teuthology.orchestra.run.smithi045.stdout: -2134> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002fd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.768 INFO:teuthology.orchestra.run.smithi045.stdout: -2133> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002fe [2,head] /dc-dir/dc-file_265 auth v3286 s=3 n(v0 rc2023-10-03T19:17:01.279993+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352c1180] 2023-10-03T19:21:13.769 INFO:teuthology.orchestra.run.smithi045.stdout: -2132> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002fe) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.769 INFO:teuthology.orchestra.run.smithi045.stdout: -2131> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ff [2,head] /dc-dir/dc-file_266 auth v3288 s=3 n(v0 rc2023-10-03T19:17:01.290539+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352c1700] 2023-10-03T19:21:13.769 INFO:teuthology.orchestra.run.smithi045.stdout: -2130> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000002ff) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.769 INFO:teuthology.orchestra.run.smithi045.stdout: -2129> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000300 [2,head] /dc-dir/dc-file_267 auth v3290 s=3 n(v0 rc2023-10-03T19:17:01.300868+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352ce000] 2023-10-03T19:21:13.769 INFO:teuthology.orchestra.run.smithi045.stdout: -2128> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000300) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.770 INFO:teuthology.orchestra.run.smithi045.stdout: -2127> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000301 [2,head] /dc-dir/dc-file_268 auth v3292 s=3 n(v0 rc2023-10-03T19:17:01.314123+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352ce580] 2023-10-03T19:21:13.770 INFO:teuthology.orchestra.run.smithi045.stdout: -2126> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000301) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.770 INFO:teuthology.orchestra.run.smithi045.stdout: -2125> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000302 [2,head] /dc-dir/dc-file_269 auth v3294 s=3 n(v0 rc2023-10-03T19:17:01.325393+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352ceb00] 2023-10-03T19:21:13.770 INFO:teuthology.orchestra.run.smithi045.stdout: -2124> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000302) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.770 INFO:teuthology.orchestra.run.smithi045.stdout: -2123> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000303 [2,head] /dc-dir/dc-file_270 auth v3296 s=3 n(v0 rc2023-10-03T19:17:01.336164+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352cf080] 2023-10-03T19:21:13.771 INFO:teuthology.orchestra.run.smithi045.stdout: -2122> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000303) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.771 INFO:teuthology.orchestra.run.smithi045.stdout: -2121> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000304 [2,head] /dc-dir/dc-file_271 auth v3298 s=3 n(v0 rc2023-10-03T19:17:01.347443+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352cf600] 2023-10-03T19:21:13.771 INFO:teuthology.orchestra.run.smithi045.stdout: -2120> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000304) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.771 INFO:teuthology.orchestra.run.smithi045.stdout: -2119> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000305 [2,head] /dc-dir/dc-file_272 auth v3300 s=3 n(v0 rc2023-10-03T19:17:01.358469+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352cfb80] 2023-10-03T19:21:13.771 INFO:teuthology.orchestra.run.smithi045.stdout: -2118> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000305) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.772 INFO:teuthology.orchestra.run.smithi045.stdout: -2117> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000306 [2,head] /dc-dir/dc-file_273 auth v3302 s=3 n(v0 rc2023-10-03T19:17:01.369031+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352d0100] 2023-10-03T19:21:13.772 INFO:teuthology.orchestra.run.smithi045.stdout: -2116> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000306) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.772 INFO:teuthology.orchestra.run.smithi045.stdout: -2115> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000307 [2,head] /dc-dir/dc-file_274 auth v3304 s=3 n(v0 rc2023-10-03T19:17:01.379842+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352d0680] 2023-10-03T19:21:13.773 INFO:teuthology.orchestra.run.smithi045.stdout: -2114> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000307) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.773 INFO:teuthology.orchestra.run.smithi045.stdout: -2113> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000308 [2,head] /dc-dir/dc-file_275 auth v3306 s=3 n(v0 rc2023-10-03T19:17:01.392163+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352d0c00] 2023-10-03T19:21:13.773 INFO:teuthology.orchestra.run.smithi045.stdout: -2112> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000308) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.773 INFO:teuthology.orchestra.run.smithi045.stdout: -2111> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000309 [2,head] /dc-dir/dc-file_276 auth v3308 s=3 n(v0 rc2023-10-03T19:17:01.404338+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352d1180] 2023-10-03T19:21:13.773 INFO:teuthology.orchestra.run.smithi045.stdout: -2110> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000309) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.857 INFO:teuthology.orchestra.run.smithi045.stdout: -2109> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000030a [2,head] /dc-dir/dc-file_277 auth v3310 s=3 n(v0 rc2023-10-03T19:17:01.416333+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352d1700] 2023-10-03T19:21:13.857 INFO:teuthology.orchestra.run.smithi045.stdout: -2108> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000030a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.857 INFO:teuthology.orchestra.run.smithi045.stdout: -2107> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000030b [2,head] /dc-dir/dc-file_278 auth v3312 s=3 n(v0 rc2023-10-03T19:17:01.428600+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352b2000] 2023-10-03T19:21:13.858 INFO:teuthology.orchestra.run.smithi045.stdout: -2106> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000030b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.858 INFO:teuthology.orchestra.run.smithi045.stdout: -2105> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000030c [2,head] /dc-dir/dc-file_279 auth v3314 s=3 n(v0 rc2023-10-03T19:17:01.440838+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352b2580] 2023-10-03T19:21:13.858 INFO:teuthology.orchestra.run.smithi045.stdout: -2104> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000030c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.858 INFO:teuthology.orchestra.run.smithi045.stdout: -2103> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000030d [2,head] /dc-dir/dc-file_280 auth v3316 s=3 n(v0 rc2023-10-03T19:17:01.451702+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352b2b00] 2023-10-03T19:21:13.858 INFO:teuthology.orchestra.run.smithi045.stdout: -2102> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000030d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.859 INFO:teuthology.orchestra.run.smithi045.stdout: -2101> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000030e [2,head] /dc-dir/dc-file_281 auth v3318 s=3 n(v0 rc2023-10-03T19:17:01.461792+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352b3080] 2023-10-03T19:21:13.859 INFO:teuthology.orchestra.run.smithi045.stdout: -2100> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000030e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.859 INFO:teuthology.orchestra.run.smithi045.stdout: -2099> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000030f [2,head] /dc-dir/dc-file_282 auth v3320 s=3 n(v0 rc2023-10-03T19:17:01.473379+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352b3600] 2023-10-03T19:21:13.859 INFO:teuthology.orchestra.run.smithi045.stdout: -2098> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000030f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.859 INFO:teuthology.orchestra.run.smithi045.stdout: -2097> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000310 [2,head] /dc-dir/dc-file_283 auth v3628 s=3 n(v0 rc2023-10-03T19:17:01.483384+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352b3b80] 2023-10-03T19:21:13.860 INFO:teuthology.orchestra.run.smithi045.stdout: -2096> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000310) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.860 INFO:teuthology.orchestra.run.smithi045.stdout: -2095> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000311 [2,head] /dc-dir/dc-file_284 auth v3630 s=3 n(v0 rc2023-10-03T19:17:01.493704+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352b4100] 2023-10-03T19:21:13.860 INFO:teuthology.orchestra.run.smithi045.stdout: -2094> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000311) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.860 INFO:teuthology.orchestra.run.smithi045.stdout: -2093> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000312 [2,head] /dc-dir/dc-file_285 auth v3632 s=3 n(v0 rc2023-10-03T19:17:01.504985+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352b4680] 2023-10-03T19:21:13.860 INFO:teuthology.orchestra.run.smithi045.stdout: -2092> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000312) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.861 INFO:teuthology.orchestra.run.smithi045.stdout: -2091> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000313 [2,head] /dc-dir/dc-file_286 auth v3634 s=3 n(v0 rc2023-10-03T19:17:01.515941+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352b4c00] 2023-10-03T19:21:13.861 INFO:teuthology.orchestra.run.smithi045.stdout: -2090> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000313) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.861 INFO:teuthology.orchestra.run.smithi045.stdout: -2089> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000314 [2,head] /dc-dir/dc-file_287 auth v3636 s=3 n(v0 rc2023-10-03T19:17:01.526806+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352b5180] 2023-10-03T19:21:13.861 INFO:teuthology.orchestra.run.smithi045.stdout: -2088> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000314) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.861 INFO:teuthology.orchestra.run.smithi045.stdout: -2087> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000315 [2,head] /dc-dir/dc-file_288 auth v3638 s=3 n(v0 rc2023-10-03T19:17:01.538187+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352b5700] 2023-10-03T19:21:13.862 INFO:teuthology.orchestra.run.smithi045.stdout: -2086> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000315) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.862 INFO:teuthology.orchestra.run.smithi045.stdout: -2085> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000316 [2,head] /dc-dir/dc-file_289 auth v3640 s=3 n(v0 rc2023-10-03T19:17:01.548724+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352e2000] 2023-10-03T19:21:13.862 INFO:teuthology.orchestra.run.smithi045.stdout: -2084> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000316) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.862 INFO:teuthology.orchestra.run.smithi045.stdout: -2083> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000317 [2,head] /dc-dir/dc-file_290 auth v3642 s=3 n(v0 rc2023-10-03T19:17:01.559007+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352e2580] 2023-10-03T19:21:13.863 INFO:teuthology.orchestra.run.smithi045.stdout: -2082> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000317) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.863 INFO:teuthology.orchestra.run.smithi045.stdout: -2081> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000318 [2,head] /dc-dir/dc-file_291 auth v3644 s=3 n(v0 rc2023-10-03T19:17:01.569539+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352e2b00] 2023-10-03T19:21:13.863 INFO:teuthology.orchestra.run.smithi045.stdout: -2080> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000318) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.863 INFO:teuthology.orchestra.run.smithi045.stdout: -2079> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000319 [2,head] /dc-dir/dc-file_292 auth v3646 s=3 n(v0 rc2023-10-03T19:17:01.580822+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352e3080] 2023-10-03T19:21:13.863 INFO:teuthology.orchestra.run.smithi045.stdout: -2078> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000319) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.863 INFO:teuthology.orchestra.run.smithi045.stdout: -2077> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000031a [2,head] /dc-dir/dc-file_293 auth v3648 s=3 n(v0 rc2023-10-03T19:17:01.592099+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352e3600] 2023-10-03T19:21:13.863 INFO:teuthology.orchestra.run.smithi045.stdout: -2076> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000031a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.863 INFO:teuthology.orchestra.run.smithi045.stdout: -2075> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000031b [2,head] /dc-dir/dc-file_294 auth v3650 s=3 n(v0 rc2023-10-03T19:17:01.602513+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352e3b80] 2023-10-03T19:21:13.863 INFO:teuthology.orchestra.run.smithi045.stdout: -2074> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000031b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.864 INFO:teuthology.orchestra.run.smithi045.stdout: -2073> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000031c [2,head] /dc-dir/dc-file_295 auth v3652 s=3 n(v0 rc2023-10-03T19:17:01.612969+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352e4100] 2023-10-03T19:21:13.864 INFO:teuthology.orchestra.run.smithi045.stdout: -2072> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000031c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.864 INFO:teuthology.orchestra.run.smithi045.stdout: -2071> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000031d [2,head] /dc-dir/dc-file_296 auth v3654 s=3 n(v0 rc2023-10-03T19:17:01.623557+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352e4680] 2023-10-03T19:21:13.864 INFO:teuthology.orchestra.run.smithi045.stdout: -2070> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000031d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.864 INFO:teuthology.orchestra.run.smithi045.stdout: -2069> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000031e [2,head] /dc-dir/dc-file_297 auth v3656 s=3 n(v0 rc2023-10-03T19:17:01.635161+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352e4c00] 2023-10-03T19:21:13.864 INFO:teuthology.orchestra.run.smithi045.stdout: -2068> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000031e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.865 INFO:teuthology.orchestra.run.smithi045.stdout: -2067> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000031f [2,head] /dc-dir/dc-file_298 auth v3658 s=3 n(v0 rc2023-10-03T19:17:01.647972+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352e5180] 2023-10-03T19:21:13.865 INFO:teuthology.orchestra.run.smithi045.stdout: -2066> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000031f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.865 INFO:teuthology.orchestra.run.smithi045.stdout: -2065> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000320 [2,head] /dc-dir/dc-file_299 auth v3660 s=3 n(v0 rc2023-10-03T19:17:01.661090+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352e5700] 2023-10-03T19:21:13.865 INFO:teuthology.orchestra.run.smithi045.stdout: -2064> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000320) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.865 INFO:teuthology.orchestra.run.smithi045.stdout: -2063> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000321 [2,head] /dc-dir/dc-file_300 auth v3662 s=3 n(v0 rc2023-10-03T19:17:01.673853+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352f2000] 2023-10-03T19:21:13.866 INFO:teuthology.orchestra.run.smithi045.stdout: -2062> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000321) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.866 INFO:teuthology.orchestra.run.smithi045.stdout: -2061> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000322 [2,head] /dc-dir/dc-file_301 auth v3664 s=3 n(v0 rc2023-10-03T19:17:01.686634+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352f2580] 2023-10-03T19:21:13.921 INFO:teuthology.orchestra.run.smithi045.stdout: -2060> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000322) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.921 INFO:teuthology.orchestra.run.smithi045.stdout: -2059> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000323 [2,head] /dc-dir/dc-file_302 auth v3666 s=3 n(v0 rc2023-10-03T19:17:01.698917+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352f2b00] 2023-10-03T19:21:13.921 INFO:teuthology.orchestra.run.smithi045.stdout: -2058> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000323) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.921 INFO:teuthology.orchestra.run.smithi045.stdout: -2057> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000324 [2,head] /dc-dir/dc-file_303 auth v3668 s=3 n(v0 rc2023-10-03T19:17:01.712214+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352f3080] 2023-10-03T19:21:13.921 INFO:teuthology.orchestra.run.smithi045.stdout: -2056> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000324) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.922 INFO:teuthology.orchestra.run.smithi045.stdout: -2055> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000325 [2,head] /dc-dir/dc-file_304 auth v3670 s=3 n(v0 rc2023-10-03T19:17:01.723527+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352f3600] 2023-10-03T19:21:13.922 INFO:teuthology.orchestra.run.smithi045.stdout: -2054> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000325) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.922 INFO:teuthology.orchestra.run.smithi045.stdout: -2053> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000326 [2,head] /dc-dir/dc-file_305 auth v3672 s=3 n(v0 rc2023-10-03T19:17:01.734667+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352f3b80] 2023-10-03T19:21:13.922 INFO:teuthology.orchestra.run.smithi045.stdout: -2052> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000326) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.922 INFO:teuthology.orchestra.run.smithi045.stdout: -2051> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000327 [2,head] /dc-dir/dc-file_306 auth v3674 s=3 n(v0 rc2023-10-03T19:17:01.745951+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352f4100] 2023-10-03T19:21:13.922 INFO:teuthology.orchestra.run.smithi045.stdout: -2050> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000327) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.922 INFO:teuthology.orchestra.run.smithi045.stdout: -2049> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000328 [2,head] /dc-dir/dc-file_307 auth v3676 s=3 n(v0 rc2023-10-03T19:17:01.758549+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352f4680] 2023-10-03T19:21:13.922 INFO:teuthology.orchestra.run.smithi045.stdout: -2048> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000328) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.922 INFO:teuthology.orchestra.run.smithi045.stdout: -2047> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000329 [2,head] /dc-dir/dc-file_308 auth v3678 s=3 n(v0 rc2023-10-03T19:17:01.770363+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352f4c00] 2023-10-03T19:21:13.923 INFO:teuthology.orchestra.run.smithi045.stdout: -2046> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000329) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.923 INFO:teuthology.orchestra.run.smithi045.stdout: -2045> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000032a [2,head] /dc-dir/dc-file_309 auth v3680 s=3 n(v0 rc2023-10-03T19:17:01.780518+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352f5180] 2023-10-03T19:21:13.923 INFO:teuthology.orchestra.run.smithi045.stdout: -2044> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000032a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.923 INFO:teuthology.orchestra.run.smithi045.stdout: -2043> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000032b [2,head] /dc-dir/dc-file_310 auth v3682 s=3 n(v0 rc2023-10-03T19:17:01.792631+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655352f5700] 2023-10-03T19:21:13.923 INFO:teuthology.orchestra.run.smithi045.stdout: -2042> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000032b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.923 INFO:teuthology.orchestra.run.smithi045.stdout: -2041> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000032c [2,head] /dc-dir/dc-file_311 auth v3684 s=3 n(v0 rc2023-10-03T19:17:01.803569+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535302000] 2023-10-03T19:21:13.923 INFO:teuthology.orchestra.run.smithi045.stdout: -2040> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000032c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.923 INFO:teuthology.orchestra.run.smithi045.stdout: -2039> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000032d [2,head] /dc-dir/dc-file_312 auth v3686 s=3 n(v0 rc2023-10-03T19:17:01.814959+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535302580] 2023-10-03T19:21:13.923 INFO:teuthology.orchestra.run.smithi045.stdout: -2038> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000032d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.923 INFO:teuthology.orchestra.run.smithi045.stdout: -2037> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000032e [2,head] /dc-dir/dc-file_313 auth v3688 s=3 n(v0 rc2023-10-03T19:17:01.826424+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535302b00] 2023-10-03T19:21:13.923 INFO:teuthology.orchestra.run.smithi045.stdout: -2036> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000032e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.924 INFO:teuthology.orchestra.run.smithi045.stdout: -2035> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000032f [2,head] /dc-dir/dc-file_314 auth v3690 s=3 n(v0 rc2023-10-03T19:17:01.836918+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535303080] 2023-10-03T19:21:13.924 INFO:teuthology.orchestra.run.smithi045.stdout: -2034> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000032f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.924 INFO:teuthology.orchestra.run.smithi045.stdout: -2033> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000330 [2,head] /dc-dir/dc-file_315 auth v3692 s=3 n(v0 rc2023-10-03T19:17:01.848681+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535303600] 2023-10-03T19:21:13.924 INFO:teuthology.orchestra.run.smithi045.stdout: -2032> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000330) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.924 INFO:teuthology.orchestra.run.smithi045.stdout: -2031> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000331 [2,head] /dc-dir/dc-file_316 auth v3694 s=3 n(v0 rc2023-10-03T19:17:01.858584+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535303b80] 2023-10-03T19:21:13.924 INFO:teuthology.orchestra.run.smithi045.stdout: -2030> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000331) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.924 INFO:teuthology.orchestra.run.smithi045.stdout: -2029> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000332 [2,head] /dc-dir/dc-file_317 auth v3696 s=3 n(v0 rc2023-10-03T19:17:01.870588+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535304100] 2023-10-03T19:21:13.924 INFO:teuthology.orchestra.run.smithi045.stdout: -2028> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000332) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.924 INFO:teuthology.orchestra.run.smithi045.stdout: -2027> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000333 [2,head] /dc-dir/dc-file_318 auth v3698 s=3 n(v0 rc2023-10-03T19:17:01.882102+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535304680] 2023-10-03T19:21:13.924 INFO:teuthology.orchestra.run.smithi045.stdout: -2026> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000333) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.925 INFO:teuthology.orchestra.run.smithi045.stdout: -2025> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000334 [2,head] /dc-dir/dc-file_319 auth v3700 s=3 n(v0 rc2023-10-03T19:17:01.895494+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535304c00] 2023-10-03T19:21:13.925 INFO:teuthology.orchestra.run.smithi045.stdout: -2024> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000334) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.925 INFO:teuthology.orchestra.run.smithi045.stdout: -2023> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000335 [2,head] /dc-dir/dc-file_320 auth v3702 s=3 n(v0 rc2023-10-03T19:17:01.907595+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535305180] 2023-10-03T19:21:13.925 INFO:teuthology.orchestra.run.smithi045.stdout: -2022> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000335) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.925 INFO:teuthology.orchestra.run.smithi045.stdout: -2021> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000336 [2,head] /dc-dir/dc-file_321 auth v3704 s=3 n(v0 rc2023-10-03T19:17:01.919459+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535305700] 2023-10-03T19:21:13.925 INFO:teuthology.orchestra.run.smithi045.stdout: -2020> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000336) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.925 INFO:teuthology.orchestra.run.smithi045.stdout: -2019> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000337 [2,head] /dc-dir/dc-file_322 auth v3706 s=3 n(v0 rc2023-10-03T19:17:01.931580+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553530c000] 2023-10-03T19:21:13.926 INFO:teuthology.orchestra.run.smithi045.stdout: -2018> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000337) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.926 INFO:teuthology.orchestra.run.smithi045.stdout: -2017> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000338 [2,head] /dc-dir/dc-file_323 auth v3708 s=3 n(v0 rc2023-10-03T19:17:01.943185+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553530c580] 2023-10-03T19:21:13.926 INFO:teuthology.orchestra.run.smithi045.stdout: -2016> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000338) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.926 INFO:teuthology.orchestra.run.smithi045.stdout: -2015> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000339 [2,head] /dc-dir/dc-file_324 auth v3710 s=3 n(v0 rc2023-10-03T19:17:01.955078+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553530cb00] 2023-10-03T19:21:13.926 INFO:teuthology.orchestra.run.smithi045.stdout: -2014> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000339) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.927 INFO:teuthology.orchestra.run.smithi045.stdout: -2013> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000033a [2,head] /dc-dir/dc-file_325 auth v3712 s=3 n(v0 rc2023-10-03T19:17:01.966542+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553530d080] 2023-10-03T19:21:13.927 INFO:teuthology.orchestra.run.smithi045.stdout: -2012> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000033a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.927 INFO:teuthology.orchestra.run.smithi045.stdout: -2011> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000033b [2,head] /dc-dir/dc-file_326 auth v3714 s=3 n(v0 rc2023-10-03T19:17:01.977855+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553530d600] 2023-10-03T19:21:13.927 INFO:teuthology.orchestra.run.smithi045.stdout: -2010> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000033b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.927 INFO:teuthology.orchestra.run.smithi045.stdout: -2009> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000033c [2,head] /dc-dir/dc-file_327 auth v3716 s=3 n(v0 rc2023-10-03T19:17:01.990522+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553530db80] 2023-10-03T19:21:13.927 INFO:teuthology.orchestra.run.smithi045.stdout: -2008> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000033c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.928 INFO:teuthology.orchestra.run.smithi045.stdout: -2007> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000033d [2,head] /dc-dir/dc-file_328 auth v3718 s=3 n(v0 rc2023-10-03T19:17:02.001539+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553530e100] 2023-10-03T19:21:13.928 INFO:teuthology.orchestra.run.smithi045.stdout: -2006> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000033d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.928 INFO:teuthology.orchestra.run.smithi045.stdout: -2005> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000033e [2,head] /dc-dir/dc-file_329 auth v3720 s=3 n(v0 rc2023-10-03T19:17:02.013107+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553530e680] 2023-10-03T19:21:13.928 INFO:teuthology.orchestra.run.smithi045.stdout: -2004> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000033e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.928 INFO:teuthology.orchestra.run.smithi045.stdout: -2003> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000033f [2,head] /dc-dir/dc-file_330 auth v3722 s=3 n(v0 rc2023-10-03T19:17:02.024447+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553530ec00] 2023-10-03T19:21:13.998 INFO:teuthology.orchestra.run.smithi045.stdout: -2002> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000033f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.998 INFO:teuthology.orchestra.run.smithi045.stdout: -2001> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000340 [2,head] /dc-dir/dc-file_331 auth v3724 s=3 n(v0 rc2023-10-03T19:17:02.036072+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553530f180] 2023-10-03T19:21:13.998 INFO:teuthology.orchestra.run.smithi045.stdout: -2000> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000340) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.998 INFO:teuthology.orchestra.run.smithi045.stdout: -1999> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000341 [2,head] /dc-dir/dc-file_332 auth v3726 s=3 n(v0 rc2023-10-03T19:17:02.049159+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553530f700] 2023-10-03T19:21:13.998 INFO:teuthology.orchestra.run.smithi045.stdout: -1998> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000341) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.998 INFO:teuthology.orchestra.run.smithi045.stdout: -1997> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000342 [2,head] /dc-dir/dc-file_333 auth v3728 s=3 n(v0 rc2023-10-03T19:17:02.061564+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535316000] 2023-10-03T19:21:13.999 INFO:teuthology.orchestra.run.smithi045.stdout: -1996> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000342) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.999 INFO:teuthology.orchestra.run.smithi045.stdout: -1995> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000343 [2,head] /dc-dir/dc-file_334 auth v3730 s=3 n(v0 rc2023-10-03T19:17:02.072787+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535316580] 2023-10-03T19:21:13.999 INFO:teuthology.orchestra.run.smithi045.stdout: -1994> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000343) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.999 INFO:teuthology.orchestra.run.smithi045.stdout: -1993> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000344 [2,head] /dc-dir/dc-file_335 auth v3732 s=3 n(v0 rc2023-10-03T19:17:02.084085+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535316b00] 2023-10-03T19:21:13.999 INFO:teuthology.orchestra.run.smithi045.stdout: -1992> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000344) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.999 INFO:teuthology.orchestra.run.smithi045.stdout: -1991> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000345 [2,head] /dc-dir/dc-file_336 auth v3734 s=3 n(v0 rc2023-10-03T19:17:02.095551+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535317080] 2023-10-03T19:21:13.999 INFO:teuthology.orchestra.run.smithi045.stdout: -1990> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000345) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.999 INFO:teuthology.orchestra.run.smithi045.stdout: -1989> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000346 [2,head] /dc-dir/dc-file_337 auth v3736 s=3 n(v0 rc2023-10-03T19:17:02.107034+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535317600] 2023-10-03T19:21:13.999 INFO:teuthology.orchestra.run.smithi045.stdout: -1988> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000346) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:13.999 INFO:teuthology.orchestra.run.smithi045.stdout: -1987> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000347 [2,head] /dc-dir/dc-file_338 auth v3738 s=3 n(v0 rc2023-10-03T19:17:02.118515+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535317b80] 2023-10-03T19:21:13.999 INFO:teuthology.orchestra.run.smithi045.stdout: -1986> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000347) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.000 INFO:teuthology.orchestra.run.smithi045.stdout: -1985> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000348 [2,head] /dc-dir/dc-file_339 auth v3740 s=3 n(v0 rc2023-10-03T19:17:02.129673+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535318100] 2023-10-03T19:21:14.000 INFO:teuthology.orchestra.run.smithi045.stdout: -1984> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000348) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.000 INFO:teuthology.orchestra.run.smithi045.stdout: -1983> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000349 [2,head] /dc-dir/dc-file_340 auth v3742 s=3 n(v0 rc2023-10-03T19:17:02.140667+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535318680] 2023-10-03T19:21:14.000 INFO:teuthology.orchestra.run.smithi045.stdout: -1982> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000349) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.000 INFO:teuthology.orchestra.run.smithi045.stdout: -1981> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000034a [2,head] /dc-dir/dc-file_341 auth v3744 s=3 n(v0 rc2023-10-03T19:17:02.151567+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535318c00] 2023-10-03T19:21:14.000 INFO:teuthology.orchestra.run.smithi045.stdout: -1980> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000034a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.000 INFO:teuthology.orchestra.run.smithi045.stdout: -1979> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000034b [2,head] /dc-dir/dc-file_342 auth v3746 s=3 n(v0 rc2023-10-03T19:17:02.162777+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535319180] 2023-10-03T19:21:14.000 INFO:teuthology.orchestra.run.smithi045.stdout: -1978> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000034b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.000 INFO:teuthology.orchestra.run.smithi045.stdout: -1977> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000034c [2,head] /dc-dir/dc-file_343 auth v3748 s=3 n(v0 rc2023-10-03T19:17:02.173888+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535319700] 2023-10-03T19:21:14.000 INFO:teuthology.orchestra.run.smithi045.stdout: -1976> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000034c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.001 INFO:teuthology.orchestra.run.smithi045.stdout: -1975> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000034d [2,head] /dc-dir/dc-file_344 auth v3750 s=3 n(v0 rc2023-10-03T19:17:02.184673+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535324000] 2023-10-03T19:21:14.001 INFO:teuthology.orchestra.run.smithi045.stdout: -1974> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000034d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.001 INFO:teuthology.orchestra.run.smithi045.stdout: -1973> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000034e [2,head] /dc-dir/dc-file_345 auth v3752 s=3 n(v0 rc2023-10-03T19:17:02.196002+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535324580] 2023-10-03T19:21:14.001 INFO:teuthology.orchestra.run.smithi045.stdout: -1972> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000034e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.001 INFO:teuthology.orchestra.run.smithi045.stdout: -1971> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000034f [2,head] /dc-dir/dc-file_346 auth v3754 s=3 n(v0 rc2023-10-03T19:17:02.207213+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535324b00] 2023-10-03T19:21:14.001 INFO:teuthology.orchestra.run.smithi045.stdout: -1970> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000034f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.001 INFO:teuthology.orchestra.run.smithi045.stdout: -1969> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000350 [2,head] /dc-dir/dc-file_347 auth v3756 s=3 n(v0 rc2023-10-03T19:17:02.218678+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535325080] 2023-10-03T19:21:14.001 INFO:teuthology.orchestra.run.smithi045.stdout: -1968> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000350) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.001 INFO:teuthology.orchestra.run.smithi045.stdout: -1967> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000351 [2,head] /dc-dir/dc-file_348 auth v3758 s=3 n(v0 rc2023-10-03T19:17:02.229761+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535325600] 2023-10-03T19:21:14.001 INFO:teuthology.orchestra.run.smithi045.stdout: -1966> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000351) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.002 INFO:teuthology.orchestra.run.smithi045.stdout: -1965> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000352 [2,head] /dc-dir/dc-file_349 auth v3760 s=3 n(v0 rc2023-10-03T19:17:02.240978+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535325b80] 2023-10-03T19:21:14.002 INFO:teuthology.orchestra.run.smithi045.stdout: -1964> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000352) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.002 INFO:teuthology.orchestra.run.smithi045.stdout: -1963> 2023-10-03T19:17:19.570+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000353 [2,head] /dc-dir/dc-file_350 auth v3762 s=3 n(v0 rc2023-10-03T19:17:02.252183+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535326100] 2023-10-03T19:21:14.002 INFO:teuthology.orchestra.run.smithi045.stdout: -1962> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000353) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.002 INFO:teuthology.orchestra.run.smithi045.stdout: -1961> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000354 [2,head] /dc-dir/dc-file_351 auth v3764 s=3 n(v0 rc2023-10-03T19:17:02.264048+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535326680] 2023-10-03T19:21:14.002 INFO:teuthology.orchestra.run.smithi045.stdout: -1960> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000354) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.003 INFO:teuthology.orchestra.run.smithi045.stdout: -1959> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000355 [2,head] /dc-dir/dc-file_352 auth v3766 s=3 n(v0 rc2023-10-03T19:17:02.275810+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535326c00] 2023-10-03T19:21:14.003 INFO:teuthology.orchestra.run.smithi045.stdout: -1958> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000355) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.003 INFO:teuthology.orchestra.run.smithi045.stdout: -1957> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000356 [2,head] /dc-dir/dc-file_353 auth v3768 s=3 n(v0 rc2023-10-03T19:17:02.286701+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535327180] 2023-10-03T19:21:14.003 INFO:teuthology.orchestra.run.smithi045.stdout: -1956> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000356) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.003 INFO:teuthology.orchestra.run.smithi045.stdout: -1955> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000357 [2,head] /dc-dir/dc-file_354 auth v3770 s=3 n(v0 rc2023-10-03T19:17:02.297591+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535327700] 2023-10-03T19:21:14.003 INFO:teuthology.orchestra.run.smithi045.stdout: -1954> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000357) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.004 INFO:teuthology.orchestra.run.smithi045.stdout: -1953> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000358 [2,head] /dc-dir/dc-file_355 auth v3772 s=3 n(v0 rc2023-10-03T19:17:02.309886+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535332000] 2023-10-03T19:21:14.004 INFO:teuthology.orchestra.run.smithi045.stdout: -1952> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000358) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.004 INFO:teuthology.orchestra.run.smithi045.stdout: -1951> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000359 [2,head] /dc-dir/dc-file_356 auth v3774 s=3 n(v0 rc2023-10-03T19:17:02.321610+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535332580] 2023-10-03T19:21:14.004 INFO:teuthology.orchestra.run.smithi045.stdout: -1950> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000359) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.004 INFO:teuthology.orchestra.run.smithi045.stdout: -1949> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000035a [2,head] /dc-dir/dc-file_357 auth v3776 s=3 n(v0 rc2023-10-03T19:17:02.332985+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535332b00] 2023-10-03T19:21:14.005 INFO:teuthology.orchestra.run.smithi045.stdout: -1948> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000035a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.005 INFO:teuthology.orchestra.run.smithi045.stdout: -1947> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000035b [2,head] /dc-dir/dc-file_358 auth v3778 s=3 n(v0 rc2023-10-03T19:17:02.345031+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535333080] 2023-10-03T19:21:14.058 INFO:teuthology.orchestra.run.smithi045.stdout: -1946> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000035b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.058 INFO:teuthology.orchestra.run.smithi045.stdout: -1945> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000035c [2,head] /dc-dir/dc-file_359 auth v3780 s=3 n(v0 rc2023-10-03T19:17:02.356550+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535333600] 2023-10-03T19:21:14.059 INFO:teuthology.orchestra.run.smithi045.stdout: -1944> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000035c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.059 INFO:teuthology.orchestra.run.smithi045.stdout: -1943> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000035d [2,head] /dc-dir/dc-file_360 auth v3782 s=3 n(v0 rc2023-10-03T19:17:02.368651+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535333b80] 2023-10-03T19:21:14.059 INFO:teuthology.orchestra.run.smithi045.stdout: -1942> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000035d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.059 INFO:teuthology.orchestra.run.smithi045.stdout: -1941> 2023-10-03T19:17:19.574+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 298 ==== osd_op_reply(2086 10000000014.00000000 [delete] v63'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:14.059 INFO:teuthology.orchestra.run.smithi045.stdout: -1940> 2023-10-03T19:17:19.574+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 974 ==== osd_op_reply(2103 10000000025.00000000 [delete] v63'29 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:14.060 INFO:teuthology.orchestra.run.smithi045.stdout: -1939> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000035e [2,head] /dc-dir/dc-file_361 auth v3784 s=3 n(v0 rc2023-10-03T19:17:02.380280+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535334100] 2023-10-03T19:21:14.060 INFO:teuthology.orchestra.run.smithi045.stdout: -1938> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000035e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.060 INFO:teuthology.orchestra.run.smithi045.stdout: -1937> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000035f [2,head] /dc-dir/dc-file_362 auth v3786 s=3 n(v0 rc2023-10-03T19:17:02.391612+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535334680] 2023-10-03T19:21:14.060 INFO:teuthology.orchestra.run.smithi045.stdout: -1936> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000035f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.060 INFO:teuthology.orchestra.run.smithi045.stdout: -1935> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000360 [2,head] /dc-dir/dc-file_363 auth v3788 s=3 n(v0 rc2023-10-03T19:17:02.404387+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535334c00] 2023-10-03T19:21:14.060 INFO:teuthology.orchestra.run.smithi045.stdout: -1934> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000360) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.061 INFO:teuthology.orchestra.run.smithi045.stdout: -1933> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000361 [2,head] /dc-dir/dc-file_364 auth v3790 s=3 n(v0 rc2023-10-03T19:17:02.416032+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535335180] 2023-10-03T19:21:14.061 INFO:teuthology.orchestra.run.smithi045.stdout: -1932> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000361) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.061 INFO:teuthology.orchestra.run.smithi045.stdout: -1931> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000362 [2,head] /dc-dir/dc-file_365 auth v3792 s=3 n(v0 rc2023-10-03T19:17:02.428232+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535335700] 2023-10-03T19:21:14.061 INFO:teuthology.orchestra.run.smithi045.stdout: -1930> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000362) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.061 INFO:teuthology.orchestra.run.smithi045.stdout: -1929> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000363 [2,head] /dc-dir/dc-file_366 auth v3794 s=3 n(v0 rc2023-10-03T19:17:02.439709+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535342000] 2023-10-03T19:21:14.061 INFO:teuthology.orchestra.run.smithi045.stdout: -1928> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000363) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.062 INFO:teuthology.orchestra.run.smithi045.stdout: -1927> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000364 [2,head] /dc-dir/dc-file_367 auth v3796 s=3 n(v0 rc2023-10-03T19:17:02.451413+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535342580] 2023-10-03T19:21:14.062 INFO:teuthology.orchestra.run.smithi045.stdout: -1926> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000364) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.062 INFO:teuthology.orchestra.run.smithi045.stdout: -1925> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000365 [2,head] /dc-dir/dc-file_368 auth v3798 s=3 n(v0 rc2023-10-03T19:17:02.462908+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535342b00] 2023-10-03T19:21:14.062 INFO:teuthology.orchestra.run.smithi045.stdout: -1924> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000365) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.062 INFO:teuthology.orchestra.run.smithi045.stdout: -1923> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000366 [2,head] /dc-dir/dc-file_369 auth v3800 s=3 n(v0 rc2023-10-03T19:17:02.474184+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535343080] 2023-10-03T19:21:14.062 INFO:teuthology.orchestra.run.smithi045.stdout: -1922> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000366) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.063 INFO:teuthology.orchestra.run.smithi045.stdout: -1921> 2023-10-03T19:17:19.574+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000367 [2,head] /dc-dir/dc-file_370 auth v3802 s=3 n(v0 rc2023-10-03T19:17:02.484965+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535343600] 2023-10-03T19:21:14.063 INFO:teuthology.orchestra.run.smithi045.stdout: -1920> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000367) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.063 INFO:teuthology.orchestra.run.smithi045.stdout: -1919> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000368 [2,head] /dc-dir/dc-file_371 auth v4094 s=3 n(v0 rc2023-10-03T19:17:02.496377+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535343b80] 2023-10-03T19:21:14.063 INFO:teuthology.orchestra.run.smithi045.stdout: -1918> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000368) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.063 INFO:teuthology.orchestra.run.smithi045.stdout: -1917> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000369 [2,head] /dc-dir/dc-file_372 auth v4096 s=3 n(v0 rc2023-10-03T19:17:02.507602+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535344100] 2023-10-03T19:21:14.063 INFO:teuthology.orchestra.run.smithi045.stdout: -1916> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000369) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.063 INFO:teuthology.orchestra.run.smithi045.stdout: -1915> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000036a [2,head] /dc-dir/dc-file_373 auth v4098 s=3 n(v0 rc2023-10-03T19:17:02.518535+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535344680] 2023-10-03T19:21:14.064 INFO:teuthology.orchestra.run.smithi045.stdout: -1914> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000036a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.064 INFO:teuthology.orchestra.run.smithi045.stdout: -1913> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000036b [2,head] /dc-dir/dc-file_374 auth v4100 s=3 n(v0 rc2023-10-03T19:17:02.527912+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535344c00] 2023-10-03T19:21:14.064 INFO:teuthology.orchestra.run.smithi045.stdout: -1912> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000036b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.064 INFO:teuthology.orchestra.run.smithi045.stdout: -1911> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000036c [2,head] /dc-dir/dc-file_375 auth v4102 s=3 n(v0 rc2023-10-03T19:17:02.536724+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535345180] 2023-10-03T19:21:14.064 INFO:teuthology.orchestra.run.smithi045.stdout: -1910> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000036c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.064 INFO:teuthology.orchestra.run.smithi045.stdout: -1909> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000036d [2,head] /dc-dir/dc-file_376 auth v4104 s=3 n(v0 rc2023-10-03T19:17:02.545249+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535345700] 2023-10-03T19:21:14.065 INFO:teuthology.orchestra.run.smithi045.stdout: -1908> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000036d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.065 INFO:teuthology.orchestra.run.smithi045.stdout: -1907> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000036e [2,head] /dc-dir/dc-file_377 auth v4106 s=3 n(v0 rc2023-10-03T19:17:02.553356+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553534c000] 2023-10-03T19:21:14.065 INFO:teuthology.orchestra.run.smithi045.stdout: -1906> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000036e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.065 INFO:teuthology.orchestra.run.smithi045.stdout: -1905> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000036f [2,head] /dc-dir/dc-file_378 auth v4108 s=3 n(v0 rc2023-10-03T19:17:02.562258+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553534c580] 2023-10-03T19:21:14.065 INFO:teuthology.orchestra.run.smithi045.stdout: -1904> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000036f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.065 INFO:teuthology.orchestra.run.smithi045.stdout: -1903> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000370 [2,head] /dc-dir/dc-file_379 auth v4110 s=3 n(v0 rc2023-10-03T19:17:02.570983+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553534cb00] 2023-10-03T19:21:14.066 INFO:teuthology.orchestra.run.smithi045.stdout: -1902> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000370) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.066 INFO:teuthology.orchestra.run.smithi045.stdout: -1901> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000371 [2,head] /dc-dir/dc-file_380 auth v4112 s=3 n(v0 rc2023-10-03T19:17:02.580012+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553534d080] 2023-10-03T19:21:14.066 INFO:teuthology.orchestra.run.smithi045.stdout: -1900> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000371) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.066 INFO:teuthology.orchestra.run.smithi045.stdout: -1899> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000372 [2,head] /dc-dir/dc-file_381 auth v4114 s=3 n(v0 rc2023-10-03T19:17:02.588227+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553534d600] 2023-10-03T19:21:14.066 INFO:teuthology.orchestra.run.smithi045.stdout: -1898> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000372) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.066 INFO:teuthology.orchestra.run.smithi045.stdout: -1897> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000373 [2,head] /dc-dir/dc-file_382 auth v4116 s=3 n(v0 rc2023-10-03T19:17:02.597089+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553534db80] 2023-10-03T19:21:14.115 INFO:teuthology.orchestra.run.smithi045.stdout: -1896> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000373) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.116 INFO:teuthology.orchestra.run.smithi045.stdout: -1895> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000374 [2,head] /dc-dir/dc-file_383 auth v4118 s=3 n(v0 rc2023-10-03T19:17:02.607217+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553534e100] 2023-10-03T19:21:14.116 INFO:teuthology.orchestra.run.smithi045.stdout: -1894> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000374) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.116 INFO:teuthology.orchestra.run.smithi045.stdout: -1893> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000375 [2,head] /dc-dir/dc-file_384 auth v4120 s=3 n(v0 rc2023-10-03T19:17:02.616372+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553534e680] 2023-10-03T19:21:14.116 INFO:teuthology.orchestra.run.smithi045.stdout: -1892> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000375) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.116 INFO:teuthology.orchestra.run.smithi045.stdout: -1891> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000376 [2,head] /dc-dir/dc-file_385 auth v4122 s=3 n(v0 rc2023-10-03T19:17:02.625573+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553534ec00] 2023-10-03T19:21:14.117 INFO:teuthology.orchestra.run.smithi045.stdout: -1890> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000376) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.117 INFO:teuthology.orchestra.run.smithi045.stdout: -1889> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000377 [2,head] /dc-dir/dc-file_386 auth v4124 s=3 n(v0 rc2023-10-03T19:17:02.635095+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553534f180] 2023-10-03T19:21:14.117 INFO:teuthology.orchestra.run.smithi045.stdout: -1888> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000377) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.117 INFO:teuthology.orchestra.run.smithi045.stdout: -1887> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000378 [2,head] /dc-dir/dc-file_387 auth v4126 s=3 n(v0 rc2023-10-03T19:17:02.644312+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553534f700] 2023-10-03T19:21:14.117 INFO:teuthology.orchestra.run.smithi045.stdout: -1886> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000378) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.118 INFO:teuthology.orchestra.run.smithi045.stdout: -1885> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000379 [2,head] /dc-dir/dc-file_388 auth v4128 s=3 n(v0 rc2023-10-03T19:17:02.653421+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535358000] 2023-10-03T19:21:14.118 INFO:teuthology.orchestra.run.smithi045.stdout: -1884> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000379) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.118 INFO:teuthology.orchestra.run.smithi045.stdout: -1883> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000037a [2,head] /dc-dir/dc-file_389 auth v4130 s=3 n(v0 rc2023-10-03T19:17:02.665231+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535358580] 2023-10-03T19:21:14.118 INFO:teuthology.orchestra.run.smithi045.stdout: -1882> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000037a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.118 INFO:teuthology.orchestra.run.smithi045.stdout: -1881> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000037b [2,head] /dc-dir/dc-file_390 auth v4132 s=3 n(v0 rc2023-10-03T19:17:02.674799+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535358b00] 2023-10-03T19:21:14.118 INFO:teuthology.orchestra.run.smithi045.stdout: -1880> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000037b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.119 INFO:teuthology.orchestra.run.smithi045.stdout: -1879> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000037c [2,head] /dc-dir/dc-file_391 auth v4134 s=3 n(v0 rc2023-10-03T19:17:02.685162+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535359080] 2023-10-03T19:21:14.119 INFO:teuthology.orchestra.run.smithi045.stdout: -1878> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000037c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.119 INFO:teuthology.orchestra.run.smithi045.stdout: -1877> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000037d [2,head] /dc-dir/dc-file_392 auth v4136 s=3 n(v0 rc2023-10-03T19:17:02.694998+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535359600] 2023-10-03T19:21:14.119 INFO:teuthology.orchestra.run.smithi045.stdout: -1876> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000037d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.119 INFO:teuthology.orchestra.run.smithi045.stdout: -1875> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000037e [2,head] /dc-dir/dc-file_393 auth v4138 s=3 n(v0 rc2023-10-03T19:17:02.705074+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535359b80] 2023-10-03T19:21:14.120 INFO:teuthology.orchestra.run.smithi045.stdout: -1874> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000037e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.120 INFO:teuthology.orchestra.run.smithi045.stdout: -1873> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000037f [2,head] /dc-dir/dc-file_394 auth v4140 s=3 n(v0 rc2023-10-03T19:17:02.714794+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553535a100] 2023-10-03T19:21:14.120 INFO:teuthology.orchestra.run.smithi045.stdout: -1872> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000037f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.120 INFO:teuthology.orchestra.run.smithi045.stdout: -1871> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000380 [2,head] /dc-dir/dc-file_395 auth v4142 s=3 n(v0 rc2023-10-03T19:17:02.726348+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553535a680] 2023-10-03T19:21:14.121 INFO:teuthology.orchestra.run.smithi045.stdout: -1870> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000380) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.121 INFO:teuthology.orchestra.run.smithi045.stdout: -1869> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000381 [2,head] /dc-dir/dc-file_396 auth v4144 s=3 n(v0 rc2023-10-03T19:17:02.737269+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553535ac00] 2023-10-03T19:21:14.121 INFO:teuthology.orchestra.run.smithi045.stdout: -1868> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000381) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.121 INFO:teuthology.orchestra.run.smithi045.stdout: -1867> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000382 [2,head] /dc-dir/dc-file_397 auth v4146 s=3 n(v0 rc2023-10-03T19:17:02.748251+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553535b180] 2023-10-03T19:21:14.121 INFO:teuthology.orchestra.run.smithi045.stdout: -1866> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000382) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.121 INFO:teuthology.orchestra.run.smithi045.stdout: -1865> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000383 [2,head] /dc-dir/dc-file_398 auth v4148 s=3 n(v0 rc2023-10-03T19:17:02.759389+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553535b700] 2023-10-03T19:21:14.122 INFO:teuthology.orchestra.run.smithi045.stdout: -1864> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000383) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.122 INFO:teuthology.orchestra.run.smithi045.stdout: -1863> 2023-10-03T19:17:19.578+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 81 ==== osd_op_reply(2107 10000000029.00000000 [delete] v63'45 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:14.122 INFO:teuthology.orchestra.run.smithi045.stdout: -1862> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000384 [2,head] /dc-dir/dc-file_399 auth v4150 s=3 n(v0 rc2023-10-03T19:17:02.770385+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535360000] 2023-10-03T19:21:14.122 INFO:teuthology.orchestra.run.smithi045.stdout: -1861> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000384) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.122 INFO:teuthology.orchestra.run.smithi045.stdout: -1860> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000385 [2,head] /dc-dir/dc-file_400 auth v4152 s=3 n(v0 rc2023-10-03T19:17:02.781755+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535360580] 2023-10-03T19:21:14.122 INFO:teuthology.orchestra.run.smithi045.stdout: -1859> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000385) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.122 INFO:teuthology.orchestra.run.smithi045.stdout: -1858> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000386 [2,head] /dc-dir/dc-file_401 auth v4154 s=3 n(v0 rc2023-10-03T19:17:02.792682+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535360b00] 2023-10-03T19:21:14.123 INFO:teuthology.orchestra.run.smithi045.stdout: -1857> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000386) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.123 INFO:teuthology.orchestra.run.smithi045.stdout: -1856> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000387 [2,head] /dc-dir/dc-file_402 auth v4156 s=3 n(v0 rc2023-10-03T19:17:02.803602+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535361080] 2023-10-03T19:21:14.123 INFO:teuthology.orchestra.run.smithi045.stdout: -1855> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000387) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.123 INFO:teuthology.orchestra.run.smithi045.stdout: -1854> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000388 [2,head] /dc-dir/dc-file_403 auth v4158 s=3 n(v0 rc2023-10-03T19:17:02.814191+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535361600] 2023-10-03T19:21:14.198 INFO:teuthology.orchestra.run.smithi045.stdout: -1853> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000388) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.198 INFO:teuthology.orchestra.run.smithi045.stdout: -1852> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000389 [2,head] /dc-dir/dc-file_404 auth v4160 s=3 n(v0 rc2023-10-03T19:17:02.825083+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535361b80] 2023-10-03T19:21:14.198 INFO:teuthology.orchestra.run.smithi045.stdout: -1851> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000389) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.198 INFO:teuthology.orchestra.run.smithi045.stdout: -1850> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000038a [2,head] /dc-dir/dc-file_405 auth v4162 s=3 n(v0 rc2023-10-03T19:17:02.835987+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535362100] 2023-10-03T19:21:14.199 INFO:teuthology.orchestra.run.smithi045.stdout: -1849> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000038a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.199 INFO:teuthology.orchestra.run.smithi045.stdout: -1848> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000038b [2,head] /dc-dir/dc-file_406 auth v4164 s=3 n(v0 rc2023-10-03T19:17:02.846431+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535362680] 2023-10-03T19:21:14.199 INFO:teuthology.orchestra.run.smithi045.stdout: -1847> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000038b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.199 INFO:teuthology.orchestra.run.smithi045.stdout: -1846> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000038c [2,head] /dc-dir/dc-file_407 auth v4166 s=3 n(v0 rc2023-10-03T19:17:02.857461+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535362c00] 2023-10-03T19:21:14.199 INFO:teuthology.orchestra.run.smithi045.stdout: -1845> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000038c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.200 INFO:teuthology.orchestra.run.smithi045.stdout: -1844> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000038d [2,head] /dc-dir/dc-file_408 auth v4168 s=3 n(v0 rc2023-10-03T19:17:02.870386+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535363180] 2023-10-03T19:21:14.200 INFO:teuthology.orchestra.run.smithi045.stdout: -1843> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000038d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.200 INFO:teuthology.orchestra.run.smithi045.stdout: -1842> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000038e [2,head] /dc-dir/dc-file_409 auth v4170 s=3 n(v0 rc2023-10-03T19:17:02.883203+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535363700] 2023-10-03T19:21:14.200 INFO:teuthology.orchestra.run.smithi045.stdout: -1841> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000038e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.200 INFO:teuthology.orchestra.run.smithi045.stdout: -1840> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000038f [2,head] /dc-dir/dc-file_410 auth v4172 s=3 n(v0 rc2023-10-03T19:17:02.895401+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553536e000] 2023-10-03T19:21:14.201 INFO:teuthology.orchestra.run.smithi045.stdout: -1839> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000038f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.201 INFO:teuthology.orchestra.run.smithi045.stdout: -1838> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000390 [2,head] /dc-dir/dc-file_411 auth v4174 s=3 n(v0 rc2023-10-03T19:17:02.906151+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553536e580] 2023-10-03T19:21:14.201 INFO:teuthology.orchestra.run.smithi045.stdout: -1837> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000390) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.201 INFO:teuthology.orchestra.run.smithi045.stdout: -1836> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000391 [2,head] /dc-dir/dc-file_412 auth v4176 s=3 n(v0 rc2023-10-03T19:17:02.917731+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553536eb00] 2023-10-03T19:21:14.201 INFO:teuthology.orchestra.run.smithi045.stdout: -1835> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000391) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.201 INFO:teuthology.orchestra.run.smithi045.stdout: -1834> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000392 [2,head] /dc-dir/dc-file_413 auth v4178 s=3 n(v0 rc2023-10-03T19:17:02.928345+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553536f080] 2023-10-03T19:21:14.201 INFO:teuthology.orchestra.run.smithi045.stdout: -1833> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000392) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.202 INFO:teuthology.orchestra.run.smithi045.stdout: -1832> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000393 [2,head] /dc-dir/dc-file_414 auth v4180 s=3 n(v0 rc2023-10-03T19:17:02.939191+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553536f600] 2023-10-03T19:21:14.202 INFO:teuthology.orchestra.run.smithi045.stdout: -1831> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000393) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.202 INFO:teuthology.orchestra.run.smithi045.stdout: -1830> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000394 [2,head] /dc-dir/dc-file_415 auth v4182 s=3 n(v0 rc2023-10-03T19:17:02.950519+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553536fb80] 2023-10-03T19:21:14.202 INFO:teuthology.orchestra.run.smithi045.stdout: -1829> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000394) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.202 INFO:teuthology.orchestra.run.smithi045.stdout: -1828> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000395 [2,head] /dc-dir/dc-file_416 auth v4184 s=3 n(v0 rc2023-10-03T19:17:02.961339+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535370100] 2023-10-03T19:21:14.202 INFO:teuthology.orchestra.run.smithi045.stdout: -1827> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000395) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.202 INFO:teuthology.orchestra.run.smithi045.stdout: -1826> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000396 [2,head] /dc-dir/dc-file_417 auth v4186 s=3 n(v0 rc2023-10-03T19:17:02.972286+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535370680] 2023-10-03T19:21:14.203 INFO:teuthology.orchestra.run.smithi045.stdout: -1825> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000396) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.203 INFO:teuthology.orchestra.run.smithi045.stdout: -1824> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000397 [2,head] /dc-dir/dc-file_418 auth v4188 s=3 n(v0 rc2023-10-03T19:17:02.982867+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535370c00] 2023-10-03T19:21:14.203 INFO:teuthology.orchestra.run.smithi045.stdout: -1823> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000397) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.203 INFO:teuthology.orchestra.run.smithi045.stdout: -1822> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000398 [2,head] /dc-dir/dc-file_419 auth v4190 s=3 n(v0 rc2023-10-03T19:17:02.993867+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535371180] 2023-10-03T19:21:14.203 INFO:teuthology.orchestra.run.smithi045.stdout: -1821> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000398) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.203 INFO:teuthology.orchestra.run.smithi045.stdout: -1820> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000399 [2,head] /dc-dir/dc-file_420 auth v4192 s=3 n(v0 rc2023-10-03T19:17:03.004526+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535371700] 2023-10-03T19:21:14.203 INFO:teuthology.orchestra.run.smithi045.stdout: -1819> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000399) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.203 INFO:teuthology.orchestra.run.smithi045.stdout: -1818> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000039a [2,head] /dc-dir/dc-file_421 auth v4194 s=3 n(v0 rc2023-10-03T19:17:03.015272+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553537c000] 2023-10-03T19:21:14.204 INFO:teuthology.orchestra.run.smithi045.stdout: -1817> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000039a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.204 INFO:teuthology.orchestra.run.smithi045.stdout: -1816> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000039b [2,head] /dc-dir/dc-file_422 auth v4196 s=3 n(v0 rc2023-10-03T19:17:03.026175+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553537c580] 2023-10-03T19:21:14.204 INFO:teuthology.orchestra.run.smithi045.stdout: -1815> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000039b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.204 INFO:teuthology.orchestra.run.smithi045.stdout: -1814> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000039c [2,head] /dc-dir/dc-file_423 auth v4198 s=3 n(v0 rc2023-10-03T19:17:03.036385+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553537cb00] 2023-10-03T19:21:14.204 INFO:teuthology.orchestra.run.smithi045.stdout: -1813> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000039c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.204 INFO:teuthology.orchestra.run.smithi045.stdout: -1812> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000039d [2,head] /dc-dir/dc-file_424 auth v4200 s=3 n(v0 rc2023-10-03T19:17:03.047398+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553537d080] 2023-10-03T19:21:14.204 INFO:teuthology.orchestra.run.smithi045.stdout: -1811> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000039d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.205 INFO:teuthology.orchestra.run.smithi045.stdout: -1810> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000039e [2,head] /dc-dir/dc-file_425 auth v4202 s=3 n(v0 rc2023-10-03T19:17:03.058174+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553537d600] 2023-10-03T19:21:14.205 INFO:teuthology.orchestra.run.smithi045.stdout: -1809> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000039e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.205 INFO:teuthology.orchestra.run.smithi045.stdout: -1808> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000039f [2,head] /dc-dir/dc-file_426 auth v4204 s=3 n(v0 rc2023-10-03T19:17:03.068817+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553537db80] 2023-10-03T19:21:14.205 INFO:teuthology.orchestra.run.smithi045.stdout: -1807> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000039f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.205 INFO:teuthology.orchestra.run.smithi045.stdout: -1806> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003a0 [2,head] /dc-dir/dc-file_427 auth v4206 s=3 n(v0 rc2023-10-03T19:17:03.079813+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553537e100] 2023-10-03T19:21:14.205 INFO:teuthology.orchestra.run.smithi045.stdout: -1805> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003a0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.205 INFO:teuthology.orchestra.run.smithi045.stdout: -1804> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003a1 [2,head] /dc-dir/dc-file_428 auth v4208 s=3 n(v0 rc2023-10-03T19:17:03.090593+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553537e680] 2023-10-03T19:21:14.205 INFO:teuthology.orchestra.run.smithi045.stdout: -1803> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003a1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.205 INFO:teuthology.orchestra.run.smithi045.stdout: -1802> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003a2 [2,head] /dc-dir/dc-file_429 auth v4210 s=3 n(v0 rc2023-10-03T19:17:03.101269+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553537ec00] 2023-10-03T19:21:14.205 INFO:teuthology.orchestra.run.smithi045.stdout: -1801> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003a2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.205 INFO:teuthology.orchestra.run.smithi045.stdout: -1800> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003a3 [2,head] /dc-dir/dc-file_430 auth v4212 s=3 n(v0 rc2023-10-03T19:17:03.112579+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553537f180] 2023-10-03T19:21:14.206 INFO:teuthology.orchestra.run.smithi045.stdout: -1799> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003a3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.206 INFO:teuthology.orchestra.run.smithi045.stdout: -1798> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003a4 [2,head] /dc-dir/dc-file_431 auth v4214 s=3 n(v0 rc2023-10-03T19:17:03.125349+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553537f700] 2023-10-03T19:21:14.206 INFO:teuthology.orchestra.run.smithi045.stdout: -1797> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003a4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.206 INFO:teuthology.orchestra.run.smithi045.stdout: -1796> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003a5 [2,head] /dc-dir/dc-file_432 auth v4216 s=3 n(v0 rc2023-10-03T19:17:03.138326+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535386000] 2023-10-03T19:21:14.206 INFO:teuthology.orchestra.run.smithi045.stdout: -1795> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003a5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.206 INFO:teuthology.orchestra.run.smithi045.stdout: -1794> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003a6 [2,head] /dc-dir/dc-file_433 auth v4218 s=3 n(v0 rc2023-10-03T19:17:03.151185+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535386580] 2023-10-03T19:21:14.206 INFO:teuthology.orchestra.run.smithi045.stdout: -1793> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003a6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.206 INFO:teuthology.orchestra.run.smithi045.stdout: -1792> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003a7 [2,head] /dc-dir/dc-file_434 auth v4220 s=3 n(v0 rc2023-10-03T19:17:03.164043+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535386b00] 2023-10-03T19:21:14.254 INFO:teuthology.orchestra.run.smithi045.stdout: -1791> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003a7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.254 INFO:teuthology.orchestra.run.smithi045.stdout: -1790> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003a8 [2,head] /dc-dir/dc-file_435 auth v4222 s=3 n(v0 rc2023-10-03T19:17:03.175794+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535387080] 2023-10-03T19:21:14.255 INFO:teuthology.orchestra.run.smithi045.stdout: -1789> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003a8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.255 INFO:teuthology.orchestra.run.smithi045.stdout: -1788> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003a9 [2,head] /dc-dir/dc-file_436 auth v4224 s=3 n(v0 rc2023-10-03T19:17:03.187067+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535387600] 2023-10-03T19:21:14.255 INFO:teuthology.orchestra.run.smithi045.stdout: -1787> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003a9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.255 INFO:teuthology.orchestra.run.smithi045.stdout: -1786> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003aa [2,head] /dc-dir/dc-file_437 auth v4226 s=3 n(v0 rc2023-10-03T19:17:03.199115+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535387b80] 2023-10-03T19:21:14.255 INFO:teuthology.orchestra.run.smithi045.stdout: -1785> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003aa) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.255 INFO:teuthology.orchestra.run.smithi045.stdout: -1784> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ab [2,head] /dc-dir/dc-file_438 auth v4228 s=3 n(v0 rc2023-10-03T19:17:03.210128+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535388100] 2023-10-03T19:21:14.256 INFO:teuthology.orchestra.run.smithi045.stdout: -1783> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003ab) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.256 INFO:teuthology.orchestra.run.smithi045.stdout: -1782> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ac [2,head] /dc-dir/dc-file_439 auth v4230 s=3 n(v0 rc2023-10-03T19:17:03.222260+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535388680] 2023-10-03T19:21:14.256 INFO:teuthology.orchestra.run.smithi045.stdout: -1781> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003ac) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.256 INFO:teuthology.orchestra.run.smithi045.stdout: -1780> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ad [2,head] /dc-dir/dc-file_440 auth v4232 s=3 n(v0 rc2023-10-03T19:17:03.233265+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535388c00] 2023-10-03T19:21:14.256 INFO:teuthology.orchestra.run.smithi045.stdout: -1779> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003ad) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.257 INFO:teuthology.orchestra.run.smithi045.stdout: -1778> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ae [2,head] /dc-dir/dc-file_441 auth v4234 s=3 n(v0 rc2023-10-03T19:17:03.245627+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535389180] 2023-10-03T19:21:14.257 INFO:teuthology.orchestra.run.smithi045.stdout: -1777> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003ae) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.257 INFO:teuthology.orchestra.run.smithi045.stdout: -1776> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003af [2,head] /dc-dir/dc-file_442 auth v4236 s=3 n(v0 rc2023-10-03T19:17:03.258116+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535389700] 2023-10-03T19:21:14.257 INFO:teuthology.orchestra.run.smithi045.stdout: -1775> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003af) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.257 INFO:teuthology.orchestra.run.smithi045.stdout: -1774> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003b0 [2,head] /dc-dir/dc-file_443 auth v4238 s=3 n(v0 rc2023-10-03T19:17:03.270366+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535394000] 2023-10-03T19:21:14.257 INFO:teuthology.orchestra.run.smithi045.stdout: -1773> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003b0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.257 INFO:teuthology.orchestra.run.smithi045.stdout: -1772> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003b1 [2,head] /dc-dir/dc-file_444 auth v4240 s=3 n(v0 rc2023-10-03T19:17:03.282795+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535394580] 2023-10-03T19:21:14.257 INFO:teuthology.orchestra.run.smithi045.stdout: -1771> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003b1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.257 INFO:teuthology.orchestra.run.smithi045.stdout: -1770> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003b2 [2,head] /dc-dir/dc-file_445 auth v4242 s=3 n(v0 rc2023-10-03T19:17:03.294896+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535394b00] 2023-10-03T19:21:14.258 INFO:teuthology.orchestra.run.smithi045.stdout: -1769> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003b2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.258 INFO:teuthology.orchestra.run.smithi045.stdout: -1768> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003b3 [2,head] /dc-dir/dc-file_446 auth v4244 s=3 n(v0 rc2023-10-03T19:17:03.306801+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535395080] 2023-10-03T19:21:14.258 INFO:teuthology.orchestra.run.smithi045.stdout: -1767> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003b3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.258 INFO:teuthology.orchestra.run.smithi045.stdout: -1766> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003b4 [2,head] /dc-dir/dc-file_447 auth v4246 s=3 n(v0 rc2023-10-03T19:17:03.318224+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535395600] 2023-10-03T19:21:14.258 INFO:teuthology.orchestra.run.smithi045.stdout: -1765> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003b4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.259 INFO:teuthology.orchestra.run.smithi045.stdout: -1764> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003b5 [2,head] /dc-dir/dc-file_448 auth v4248 s=3 n(v0 rc2023-10-03T19:17:03.329939+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535395b80] 2023-10-03T19:21:14.259 INFO:teuthology.orchestra.run.smithi045.stdout: -1763> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003b5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.259 INFO:teuthology.orchestra.run.smithi045.stdout: -1762> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003b6 [2,head] /dc-dir/dc-file_449 auth v4250 s=3 n(v0 rc2023-10-03T19:17:03.342490+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535396100] 2023-10-03T19:21:14.259 INFO:teuthology.orchestra.run.smithi045.stdout: -1761> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003b6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.259 INFO:teuthology.orchestra.run.smithi045.stdout: -1760> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003b7 [2,head] /dc-dir/dc-file_450 auth v4252 s=3 n(v0 rc2023-10-03T19:17:03.356679+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535396680] 2023-10-03T19:21:14.260 INFO:teuthology.orchestra.run.smithi045.stdout: -1759> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003b7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.260 INFO:teuthology.orchestra.run.smithi045.stdout: -1758> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003b8 [2,head] /dc-dir/dc-file_451 auth v4254 s=3 n(v0 rc2023-10-03T19:17:03.369662+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535396c00] 2023-10-03T19:21:14.260 INFO:teuthology.orchestra.run.smithi045.stdout: -1757> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003b8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.260 INFO:teuthology.orchestra.run.smithi045.stdout: -1756> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003b9 [2,head] /dc-dir/dc-file_452 auth v4256 s=3 n(v0 rc2023-10-03T19:17:03.382533+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535397180] 2023-10-03T19:21:14.260 INFO:teuthology.orchestra.run.smithi045.stdout: -1755> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003b9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.260 INFO:teuthology.orchestra.run.smithi045.stdout: -1754> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ba [2,head] /dc-dir/dc-file_453 auth v4258 s=3 n(v0 rc2023-10-03T19:17:03.395509+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535397700] 2023-10-03T19:21:14.261 INFO:teuthology.orchestra.run.smithi045.stdout: -1753> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003ba) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.261 INFO:teuthology.orchestra.run.smithi045.stdout: -1752> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003bb [2,head] /dc-dir/dc-file_454 auth v4260 s=3 n(v0 rc2023-10-03T19:17:03.408950+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553539e000] 2023-10-03T19:21:14.261 INFO:teuthology.orchestra.run.smithi045.stdout: -1751> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003bb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.261 INFO:teuthology.orchestra.run.smithi045.stdout: -1750> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003bc [2,head] /dc-dir/dc-file_455 auth v4262 s=3 n(v0 rc2023-10-03T19:17:03.422409+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553539e580] 2023-10-03T19:21:14.261 INFO:teuthology.orchestra.run.smithi045.stdout: -1749> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003bc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.262 INFO:teuthology.orchestra.run.smithi045.stdout: -1748> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003bd [2,head] /dc-dir/dc-file_456 auth v4264 s=3 n(v0 rc2023-10-03T19:17:03.435690+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553539eb00] 2023-10-03T19:21:14.262 INFO:teuthology.orchestra.run.smithi045.stdout: -1747> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003bd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.262 INFO:teuthology.orchestra.run.smithi045.stdout: -1746> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003be [2,head] /dc-dir/dc-file_457 auth v4266 s=3 n(v0 rc2023-10-03T19:17:03.448899+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553539f080] 2023-10-03T19:21:14.262 INFO:teuthology.orchestra.run.smithi045.stdout: -1745> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003be) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.347 INFO:teuthology.orchestra.run.smithi045.stdout: -1744> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003bf [2,head] /dc-dir/dc-file_458 auth v4268 s=3 n(v0 rc2023-10-03T19:17:03.462359+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553539f600] 2023-10-03T19:21:14.347 INFO:teuthology.orchestra.run.smithi045.stdout: -1743> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003bf) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.347 INFO:teuthology.orchestra.run.smithi045.stdout: -1742> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003c0 [2,head] /dc-dir/dc-file_459 auth v4576 s=3 n(v0 rc2023-10-03T19:17:03.475490+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553539fb80] 2023-10-03T19:21:14.347 INFO:teuthology.orchestra.run.smithi045.stdout: -1741> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003c0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.347 INFO:teuthology.orchestra.run.smithi045.stdout: -1740> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003c1 [2,head] /dc-dir/dc-file_460 auth v4578 s=3 n(v0 rc2023-10-03T19:17:03.502999+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353a0100] 2023-10-03T19:21:14.348 INFO:teuthology.orchestra.run.smithi045.stdout: -1739> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003c1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.348 INFO:teuthology.orchestra.run.smithi045.stdout: -1738> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003c2 [2,head] /dc-dir/dc-file_461 auth v4580 s=3 n(v0 rc2023-10-03T19:17:03.516331+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353a0680] 2023-10-03T19:21:14.348 INFO:teuthology.orchestra.run.smithi045.stdout: -1737> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003c2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.348 INFO:teuthology.orchestra.run.smithi045.stdout: -1736> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003c3 [2,head] /dc-dir/dc-file_462 auth v4582 s=3 n(v0 rc2023-10-03T19:17:03.527973+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353a0c00] 2023-10-03T19:21:14.348 INFO:teuthology.orchestra.run.smithi045.stdout: -1735> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003c3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.349 INFO:teuthology.orchestra.run.smithi045.stdout: -1734> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003c4 [2,head] /dc-dir/dc-file_463 auth v4584 s=3 n(v0 rc2023-10-03T19:17:03.538499+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353a1180] 2023-10-03T19:21:14.349 INFO:teuthology.orchestra.run.smithi045.stdout: -1733> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003c4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.349 INFO:teuthology.orchestra.run.smithi045.stdout: -1732> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003c5 [2,head] /dc-dir/dc-file_464 auth v4586 s=3 n(v0 rc2023-10-03T19:17:03.550170+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353a1700] 2023-10-03T19:21:14.349 INFO:teuthology.orchestra.run.smithi045.stdout: -1731> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003c5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.349 INFO:teuthology.orchestra.run.smithi045.stdout: -1730> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003c6 [2,head] /dc-dir/dc-file_465 auth v4588 s=3 n(v0 rc2023-10-03T19:17:03.561617+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353ac000] 2023-10-03T19:21:14.349 INFO:teuthology.orchestra.run.smithi045.stdout: -1729> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003c6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.349 INFO:teuthology.orchestra.run.smithi045.stdout: -1728> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003c7 [2,head] /dc-dir/dc-file_466 auth v4590 s=3 n(v0 rc2023-10-03T19:17:03.573466+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353ac580] 2023-10-03T19:21:14.350 INFO:teuthology.orchestra.run.smithi045.stdout: -1727> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003c7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.350 INFO:teuthology.orchestra.run.smithi045.stdout: -1726> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003c8 [2,head] /dc-dir/dc-file_467 auth v4592 s=3 n(v0 rc2023-10-03T19:17:03.585048+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353acb00] 2023-10-03T19:21:14.350 INFO:teuthology.orchestra.run.smithi045.stdout: -1725> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003c8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.350 INFO:teuthology.orchestra.run.smithi045.stdout: -1724> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003c9 [2,head] /dc-dir/dc-file_468 auth v4594 s=3 n(v0 rc2023-10-03T19:17:03.597266+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353ad080] 2023-10-03T19:21:14.350 INFO:teuthology.orchestra.run.smithi045.stdout: -1723> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003c9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.350 INFO:teuthology.orchestra.run.smithi045.stdout: -1722> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ca [2,head] /dc-dir/dc-file_469 auth v4596 s=3 n(v0 rc2023-10-03T19:17:03.608073+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353ad600] 2023-10-03T19:21:14.351 INFO:teuthology.orchestra.run.smithi045.stdout: -1721> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003ca) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.351 INFO:teuthology.orchestra.run.smithi045.stdout: -1720> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003cb [2,head] /dc-dir/dc-file_470 auth v4598 s=3 n(v0 rc2023-10-03T19:17:03.619131+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353adb80] 2023-10-03T19:21:14.351 INFO:teuthology.orchestra.run.smithi045.stdout: -1719> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003cb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.351 INFO:teuthology.orchestra.run.smithi045.stdout: -1718> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003cc [2,head] /dc-dir/dc-file_471 auth v4600 s=3 n(v0 rc2023-10-03T19:17:03.629939+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353ae100] 2023-10-03T19:21:14.351 INFO:teuthology.orchestra.run.smithi045.stdout: -1717> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003cc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.352 INFO:teuthology.orchestra.run.smithi045.stdout: -1716> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003cd [2,head] /dc-dir/dc-file_472 auth v4602 s=3 n(v0 rc2023-10-03T19:17:03.640977+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353ae680] 2023-10-03T19:21:14.352 INFO:teuthology.orchestra.run.smithi045.stdout: -1715> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003cd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.352 INFO:teuthology.orchestra.run.smithi045.stdout: -1714> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ce [2,head] /dc-dir/dc-file_473 auth v4604 s=3 n(v0 rc2023-10-03T19:17:03.652015+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353aec00] 2023-10-03T19:21:14.352 INFO:teuthology.orchestra.run.smithi045.stdout: -1713> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003ce) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.352 INFO:teuthology.orchestra.run.smithi045.stdout: -1712> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003cf [2,head] /dc-dir/dc-file_474 auth v4606 s=3 n(v0 rc2023-10-03T19:17:03.662753+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353af180] 2023-10-03T19:21:14.353 INFO:teuthology.orchestra.run.smithi045.stdout: -1711> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003cf) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.353 INFO:teuthology.orchestra.run.smithi045.stdout: -1710> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003d0 [2,head] /dc-dir/dc-file_475 auth v4608 s=3 n(v0 rc2023-10-03T19:17:03.673903+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353af700] 2023-10-03T19:21:14.353 INFO:teuthology.orchestra.run.smithi045.stdout: -1709> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003d0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.353 INFO:teuthology.orchestra.run.smithi045.stdout: -1708> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003d1 [2,head] /dc-dir/dc-file_476 auth v4610 s=3 n(v0 rc2023-10-03T19:17:03.685342+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353b6000] 2023-10-03T19:21:14.353 INFO:teuthology.orchestra.run.smithi045.stdout: -1707> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003d1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.354 INFO:teuthology.orchestra.run.smithi045.stdout: -1706> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003d2 [2,head] /dc-dir/dc-file_477 auth v4612 s=3 n(v0 rc2023-10-03T19:17:03.697405+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353b6580] 2023-10-03T19:21:14.398 INFO:teuthology.orchestra.run.smithi045.stdout: -1705> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003d2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.398 INFO:teuthology.orchestra.run.smithi045.stdout: -1704> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003d3 [2,head] /dc-dir/dc-file_478 auth v4614 s=3 n(v0 rc2023-10-03T19:17:03.709164+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353b6b00] 2023-10-03T19:21:14.398 INFO:teuthology.orchestra.run.smithi045.stdout: -1703> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003d3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.398 INFO:teuthology.orchestra.run.smithi045.stdout: -1702> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003d4 [2,head] /dc-dir/dc-file_479 auth v4616 s=3 n(v0 rc2023-10-03T19:17:03.721192+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353b7080] 2023-10-03T19:21:14.398 INFO:teuthology.orchestra.run.smithi045.stdout: -1701> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003d4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.399 INFO:teuthology.orchestra.run.smithi045.stdout: -1700> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003d5 [2,head] /dc-dir/dc-file_480 auth v4618 s=3 n(v0 rc2023-10-03T19:17:03.732748+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353b7600] 2023-10-03T19:21:14.399 INFO:teuthology.orchestra.run.smithi045.stdout: -1699> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003d5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.399 INFO:teuthology.orchestra.run.smithi045.stdout: -1698> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003d6 [2,head] /dc-dir/dc-file_481 auth v4620 s=3 n(v0 rc2023-10-03T19:17:03.744877+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353b7b80] 2023-10-03T19:21:14.399 INFO:teuthology.orchestra.run.smithi045.stdout: -1697> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003d6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.399 INFO:teuthology.orchestra.run.smithi045.stdout: -1696> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003d7 [2,head] /dc-dir/dc-file_482 auth v4622 s=3 n(v0 rc2023-10-03T19:17:03.755878+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353b8100] 2023-10-03T19:21:14.400 INFO:teuthology.orchestra.run.smithi045.stdout: -1695> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003d7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.400 INFO:teuthology.orchestra.run.smithi045.stdout: -1694> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003d8 [2,head] /dc-dir/dc-file_483 auth v4624 s=3 n(v0 rc2023-10-03T19:17:03.766774+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353b8680] 2023-10-03T19:21:14.400 INFO:teuthology.orchestra.run.smithi045.stdout: -1693> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003d8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.400 INFO:teuthology.orchestra.run.smithi045.stdout: -1692> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003d9 [2,head] /dc-dir/dc-file_484 auth v4626 s=3 n(v0 rc2023-10-03T19:17:03.777494+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353b8c00] 2023-10-03T19:21:14.400 INFO:teuthology.orchestra.run.smithi045.stdout: -1691> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003d9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.400 INFO:teuthology.orchestra.run.smithi045.stdout: -1690> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003da [2,head] /dc-dir/dc-file_485 auth v4628 s=3 n(v0 rc2023-10-03T19:17:03.788510+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353b9180] 2023-10-03T19:21:14.401 INFO:teuthology.orchestra.run.smithi045.stdout: -1689> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003da) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.401 INFO:teuthology.orchestra.run.smithi045.stdout: -1688> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003db [2,head] /dc-dir/dc-file_486 auth v4630 s=3 n(v0 rc2023-10-03T19:17:03.799469+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353b9700] 2023-10-03T19:21:14.401 INFO:teuthology.orchestra.run.smithi045.stdout: -1687> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003db) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.401 INFO:teuthology.orchestra.run.smithi045.stdout: -1686> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003dc [2,head] /dc-dir/dc-file_487 auth v4632 s=3 n(v0 rc2023-10-03T19:17:03.810808+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353be000] 2023-10-03T19:21:14.401 INFO:teuthology.orchestra.run.smithi045.stdout: -1685> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003dc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.402 INFO:teuthology.orchestra.run.smithi045.stdout: -1684> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003dd [2,head] /dc-dir/dc-file_488 auth v4634 s=3 n(v0 rc2023-10-03T19:17:03.821914+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353be580] 2023-10-03T19:21:14.402 INFO:teuthology.orchestra.run.smithi045.stdout: -1683> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003dd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.402 INFO:teuthology.orchestra.run.smithi045.stdout: -1682> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003de [2,head] /dc-dir/dc-file_489 auth v4636 s=3 n(v0 rc2023-10-03T19:17:03.833354+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353beb00] 2023-10-03T19:21:14.402 INFO:teuthology.orchestra.run.smithi045.stdout: -1681> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003de) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.402 INFO:teuthology.orchestra.run.smithi045.stdout: -1680> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003df [2,head] /dc-dir/dc-file_490 auth v4638 s=3 n(v0 rc2023-10-03T19:17:03.844681+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353bf080] 2023-10-03T19:21:14.403 INFO:teuthology.orchestra.run.smithi045.stdout: -1679> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003df) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.403 INFO:teuthology.orchestra.run.smithi045.stdout: -1678> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003e0 [2,head] /dc-dir/dc-file_491 auth v4640 s=3 n(v0 rc2023-10-03T19:17:03.855358+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353bf600] 2023-10-03T19:21:14.403 INFO:teuthology.orchestra.run.smithi045.stdout: -1677> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003e0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.403 INFO:teuthology.orchestra.run.smithi045.stdout: -1676> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003e1 [2,head] /dc-dir/dc-file_492 auth v4642 s=3 n(v0 rc2023-10-03T19:17:03.866761+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353bfb80] 2023-10-03T19:21:14.403 INFO:teuthology.orchestra.run.smithi045.stdout: -1675> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003e1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.403 INFO:teuthology.orchestra.run.smithi045.stdout: -1674> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003e2 [2,head] /dc-dir/dc-file_493 auth v4644 s=3 n(v0 rc2023-10-03T19:17:03.878501+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353c0100] 2023-10-03T19:21:14.403 INFO:teuthology.orchestra.run.smithi045.stdout: -1673> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003e2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.404 INFO:teuthology.orchestra.run.smithi045.stdout: -1672> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003e3 [2,head] /dc-dir/dc-file_494 auth v4646 s=3 n(v0 rc2023-10-03T19:17:03.889601+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353c0680] 2023-10-03T19:21:14.404 INFO:teuthology.orchestra.run.smithi045.stdout: -1671> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003e3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.404 INFO:teuthology.orchestra.run.smithi045.stdout: -1670> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003e4 [2,head] /dc-dir/dc-file_495 auth v4648 s=3 n(v0 rc2023-10-03T19:17:03.901898+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353c0c00] 2023-10-03T19:21:14.404 INFO:teuthology.orchestra.run.smithi045.stdout: -1669> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003e4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.404 INFO:teuthology.orchestra.run.smithi045.stdout: -1668> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003e5 [2,head] /dc-dir/dc-file_496 auth v4650 s=3 n(v0 rc2023-10-03T19:17:03.913332+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353c1180] 2023-10-03T19:21:14.404 INFO:teuthology.orchestra.run.smithi045.stdout: -1667> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003e5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.405 INFO:teuthology.orchestra.run.smithi045.stdout: -1666> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003e6 [2,head] /dc-dir/dc-file_497 auth v4652 s=3 n(v0 rc2023-10-03T19:17:03.925508+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353c1700] 2023-10-03T19:21:14.405 INFO:teuthology.orchestra.run.smithi045.stdout: -1665> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003e6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.405 INFO:teuthology.orchestra.run.smithi045.stdout: -1664> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003e7 [2,head] /dc-dir/dc-file_498 auth v4654 s=3 n(v0 rc2023-10-03T19:17:03.938799+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353d0000] 2023-10-03T19:21:14.405 INFO:teuthology.orchestra.run.smithi045.stdout: -1663> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003e7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.405 INFO:teuthology.orchestra.run.smithi045.stdout: -1662> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003e8 [2,head] /dc-dir/dc-file_499 auth v4656 s=3 n(v0 rc2023-10-03T19:17:03.951275+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353d0580] 2023-10-03T19:21:14.405 INFO:teuthology.orchestra.run.smithi045.stdout: -1661> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003e8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.405 INFO:teuthology.orchestra.run.smithi045.stdout: -1660> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003e9 [2,head] /dc-dir/dc-file_500 auth v4658 s=3 n(v0 rc2023-10-03T19:17:03.963622+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353d0b00] 2023-10-03T19:21:14.406 INFO:teuthology.orchestra.run.smithi045.stdout: -1659> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003e9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.406 INFO:teuthology.orchestra.run.smithi045.stdout: -1658> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ea [2,head] /dc-dir/dc-file_501 auth v4660 s=3 n(v0 rc2023-10-03T19:17:03.975384+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353d1080] 2023-10-03T19:21:14.406 INFO:teuthology.orchestra.run.smithi045.stdout: -1657> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003ea) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.406 INFO:teuthology.orchestra.run.smithi045.stdout: -1656> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003eb [2,head] /dc-dir/dc-file_502 auth v4662 s=3 n(v0 rc2023-10-03T19:17:03.987037+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353d1600] 2023-10-03T19:21:14.406 INFO:teuthology.orchestra.run.smithi045.stdout: -1655> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003eb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.407 INFO:teuthology.orchestra.run.smithi045.stdout: -1654> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ec [2,head] /dc-dir/dc-file_503 auth v4664 s=3 n(v0 rc2023-10-03T19:17:03.999237+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353d1b80] 2023-10-03T19:21:14.407 INFO:teuthology.orchestra.run.smithi045.stdout: -1653> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003ec) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.407 INFO:teuthology.orchestra.run.smithi045.stdout: -1652> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ed [2,head] /dc-dir/dc-file_504 auth v4666 s=3 n(v0 rc2023-10-03T19:17:04.012095+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353d2100] 2023-10-03T19:21:14.407 INFO:teuthology.orchestra.run.smithi045.stdout: -1651> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003ed) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.407 INFO:teuthology.orchestra.run.smithi045.stdout: -1650> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ee [2,head] /dc-dir/dc-file_505 auth v4668 s=3 n(v0 rc2023-10-03T19:17:04.024484+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353d2680] 2023-10-03T19:21:14.407 INFO:teuthology.orchestra.run.smithi045.stdout: -1649> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003ee) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.408 INFO:teuthology.orchestra.run.smithi045.stdout: -1648> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ef [2,head] /dc-dir/dc-file_506 auth v4670 s=3 n(v0 rc2023-10-03T19:17:04.036686+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353d2c00] 2023-10-03T19:21:14.408 INFO:teuthology.orchestra.run.smithi045.stdout: -1647> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003ef) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.408 INFO:teuthology.orchestra.run.smithi045.stdout: -1646> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003f0 [2,head] /dc-dir/dc-file_507 auth v4672 s=3 n(v0 rc2023-10-03T19:17:04.048389+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353d3180] 2023-10-03T19:21:14.408 INFO:teuthology.orchestra.run.smithi045.stdout: -1645> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003f0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.408 INFO:teuthology.orchestra.run.smithi045.stdout: -1644> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003f1 [2,head] /dc-dir/dc-file_508 auth v4674 s=3 n(v0 rc2023-10-03T19:17:04.059780+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353d3700] 2023-10-03T19:21:14.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1643> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003f1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1642> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003f2 [2,head] /dc-dir/dc-file_509 auth v4676 s=3 n(v0 rc2023-10-03T19:17:04.072065+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353de000] 2023-10-03T19:21:14.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1641> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003f2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1640> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003f3 [2,head] /dc-dir/dc-file_510 auth v4678 s=3 n(v0 rc2023-10-03T19:17:04.083660+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353de580] 2023-10-03T19:21:14.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1639> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003f3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1638> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003f4 [2,head] /dc-dir/dc-file_511 auth v4680 s=3 n(v0 rc2023-10-03T19:17:04.095908+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353deb00] 2023-10-03T19:21:14.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1637> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003f4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1636> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003f5 [2,head] /dc-dir/dc-file_512 auth v4682 s=3 n(v0 rc2023-10-03T19:17:04.108218+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353df080] 2023-10-03T19:21:14.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1635> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003f5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1634> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003f6 [2,head] /dc-dir/dc-file_513 auth v4684 s=3 n(v0 rc2023-10-03T19:17:04.119350+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353df600] 2023-10-03T19:21:14.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1633> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003f6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1632> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003f7 [2,head] /dc-dir/dc-file_514 auth v4686 s=3 n(v0 rc2023-10-03T19:17:04.130506+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353dfb80] 2023-10-03T19:21:14.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1631> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003f7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1630> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003f8 [2,head] /dc-dir/dc-file_515 auth v4688 s=3 n(v0 rc2023-10-03T19:17:04.141711+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353e0100] 2023-10-03T19:21:14.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1629> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003f8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1628> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003f9 [2,head] /dc-dir/dc-file_516 auth v4690 s=3 n(v0 rc2023-10-03T19:17:04.152673+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353e0680] 2023-10-03T19:21:14.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1627> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003f9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1626> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003fa [2,head] /dc-dir/dc-file_517 auth v4692 s=3 n(v0 rc2023-10-03T19:17:04.163917+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353e0c00] 2023-10-03T19:21:14.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1625> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003fa) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1624> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003fb [2,head] /dc-dir/dc-file_518 auth v4694 s=3 n(v0 rc2023-10-03T19:17:04.175608+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353e1180] 2023-10-03T19:21:14.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1623> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003fb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1622> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003fc [2,head] /dc-dir/dc-file_519 auth v4696 s=3 n(v0 rc2023-10-03T19:17:04.186587+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353e1700] 2023-10-03T19:21:14.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1621> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003fc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1620> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003fd [2,head] /dc-dir/dc-file_520 auth v4698 s=3 n(v0 rc2023-10-03T19:17:04.197829+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353e4000] 2023-10-03T19:21:14.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1619> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003fd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1618> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003fe [2,head] /dc-dir/dc-file_521 auth v4700 s=3 n(v0 rc2023-10-03T19:17:04.208820+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353e4580] 2023-10-03T19:21:14.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1617> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003fe) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1616> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ff [2,head] /dc-dir/dc-file_522 auth v4702 s=3 n(v0 rc2023-10-03T19:17:04.220917+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353e4b00] 2023-10-03T19:21:14.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1615> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000003ff) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1614> 2023-10-03T19:17:19.578+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000400 [2,head] /dc-dir/dc-file_523 auth v4704 s=3 n(v0 rc2023-10-03T19:17:04.234107+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353e5080] 2023-10-03T19:21:14.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1613> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000400) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1612> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000401 [2,head] /dc-dir/dc-file_524 auth v4706 s=3 n(v0 rc2023-10-03T19:17:04.247861+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353e5600] 2023-10-03T19:21:14.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1611> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000401) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1610> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000402 [2,head] /dc-dir/dc-file_525 auth v4708 s=3 n(v0 rc2023-10-03T19:17:04.258986+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353e5b80] 2023-10-03T19:21:14.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1609> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000402) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1608> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000403 [2,head] /dc-dir/dc-file_526 auth v4710 s=3 n(v0 rc2023-10-03T19:17:04.269731+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353e6100] 2023-10-03T19:21:14.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1607> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000403) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1606> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000404 [2,head] /dc-dir/dc-file_527 auth v4712 s=3 n(v0 rc2023-10-03T19:17:04.283271+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353e6680] 2023-10-03T19:21:14.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1605> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000404) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1604> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000405 [2,head] /dc-dir/dc-file_528 auth v4714 s=3 n(v0 rc2023-10-03T19:17:04.296663+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353e6c00] 2023-10-03T19:21:14.496 INFO:teuthology.orchestra.run.smithi045.stdout: -1603> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000405) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.496 INFO:teuthology.orchestra.run.smithi045.stdout: -1602> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000406 [2,head] /dc-dir/dc-file_529 auth v4716 s=3 n(v0 rc2023-10-03T19:17:04.309485+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353e7180] 2023-10-03T19:21:14.496 INFO:teuthology.orchestra.run.smithi045.stdout: -1601> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000406) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.496 INFO:teuthology.orchestra.run.smithi045.stdout: -1600> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000407 [2,head] /dc-dir/dc-file_530 auth v4718 s=3 n(v0 rc2023-10-03T19:17:04.322737+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353e7700] 2023-10-03T19:21:14.496 INFO:teuthology.orchestra.run.smithi045.stdout: -1599> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000407) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.496 INFO:teuthology.orchestra.run.smithi045.stdout: -1598> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000408 [2,head] /dc-dir/dc-file_531 auth v4720 s=3 n(v0 rc2023-10-03T19:17:04.335676+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353f2000] 2023-10-03T19:21:14.496 INFO:teuthology.orchestra.run.smithi045.stdout: -1597> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000408) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.496 INFO:teuthology.orchestra.run.smithi045.stdout: -1596> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000409 [2,head] /dc-dir/dc-file_532 auth v4722 s=3 n(v0 rc2023-10-03T19:17:04.348321+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353f2580] 2023-10-03T19:21:14.496 INFO:teuthology.orchestra.run.smithi045.stdout: -1595> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000409) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.496 INFO:teuthology.orchestra.run.smithi045.stdout: -1594> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000040a [2,head] /dc-dir/dc-file_533 auth v4724 s=3 n(v0 rc2023-10-03T19:17:04.361411+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353f2b00] 2023-10-03T19:21:14.497 INFO:teuthology.orchestra.run.smithi045.stdout: -1593> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000040a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.497 INFO:teuthology.orchestra.run.smithi045.stdout: -1592> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000040b [2,head] /dc-dir/dc-file_534 auth v4726 s=3 n(v0 rc2023-10-03T19:17:04.373531+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353f3080] 2023-10-03T19:21:14.497 INFO:teuthology.orchestra.run.smithi045.stdout: -1591> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000040b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.497 INFO:teuthology.orchestra.run.smithi045.stdout: -1590> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000040c [2,head] /dc-dir/dc-file_535 auth v4728 s=3 n(v0 rc2023-10-03T19:17:04.385661+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353f3600] 2023-10-03T19:21:14.497 INFO:teuthology.orchestra.run.smithi045.stdout: -1589> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000040c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.497 INFO:teuthology.orchestra.run.smithi045.stdout: -1588> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000040d [2,head] /dc-dir/dc-file_536 auth v4730 s=3 n(v0 rc2023-10-03T19:17:04.398585+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353f3b80] 2023-10-03T19:21:14.497 INFO:teuthology.orchestra.run.smithi045.stdout: -1587> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000040d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.497 INFO:teuthology.orchestra.run.smithi045.stdout: -1586> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000040e [2,head] /dc-dir/dc-file_537 auth v4732 s=3 n(v0 rc2023-10-03T19:17:04.412181+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353f4100] 2023-10-03T19:21:14.497 INFO:teuthology.orchestra.run.smithi045.stdout: -1585> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000040e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.497 INFO:teuthology.orchestra.run.smithi045.stdout: -1584> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000040f [2,head] /dc-dir/dc-file_538 auth v4734 s=3 n(v0 rc2023-10-03T19:17:04.424903+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353f4680] 2023-10-03T19:21:14.497 INFO:teuthology.orchestra.run.smithi045.stdout: -1583> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000040f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.497 INFO:teuthology.orchestra.run.smithi045.stdout: -1582> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000410 [2,head] /dc-dir/dc-file_539 auth v4736 s=3 n(v0 rc2023-10-03T19:17:04.436069+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353f4c00] 2023-10-03T19:21:14.498 INFO:teuthology.orchestra.run.smithi045.stdout: -1581> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000410) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.498 INFO:teuthology.orchestra.run.smithi045.stdout: -1580> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000411 [2,head] /dc-dir/dc-file_540 auth v4738 s=3 n(v0 rc2023-10-03T19:17:04.448032+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353f5180] 2023-10-03T19:21:14.498 INFO:teuthology.orchestra.run.smithi045.stdout: -1579> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000411) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.498 INFO:teuthology.orchestra.run.smithi045.stdout: -1578> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000412 [2,head] /dc-dir/dc-file_541 auth v4740 s=3 n(v0 rc2023-10-03T19:17:04.460447+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655353f5700] 2023-10-03T19:21:14.498 INFO:teuthology.orchestra.run.smithi045.stdout: -1577> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000412) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.498 INFO:teuthology.orchestra.run.smithi045.stdout: -1576> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000413 [2,head] /dc-dir/dc-file_542 auth v4742 s=3 n(v0 rc2023-10-03T19:17:04.472099+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535402000] 2023-10-03T19:21:14.498 INFO:teuthology.orchestra.run.smithi045.stdout: -1575> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000413) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.558 INFO:teuthology.orchestra.run.smithi045.stdout: -1574> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000414 [2,head] /dc-dir/dc-file_543 auth v5040 s=3 n(v0 rc2023-10-03T19:17:04.565667+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535402580] 2023-10-03T19:21:14.559 INFO:teuthology.orchestra.run.smithi045.stdout: -1573> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000414) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.559 INFO:teuthology.orchestra.run.smithi045.stdout: -1572> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000415 [2,head] /dc-dir/dc-file_544 auth v5042 s=3 n(v0 rc2023-10-03T19:17:04.615118+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535402b00] 2023-10-03T19:21:14.559 INFO:teuthology.orchestra.run.smithi045.stdout: -1571> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000415) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.559 INFO:teuthology.orchestra.run.smithi045.stdout: -1570> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000416 [2,head] /dc-dir/dc-file_545 auth v5044 s=3 n(v0 rc2023-10-03T19:17:04.627658+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535403080] 2023-10-03T19:21:14.560 INFO:teuthology.orchestra.run.smithi045.stdout: -1569> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000416) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.560 INFO:teuthology.orchestra.run.smithi045.stdout: -1568> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000417 [2,head] /dc-dir/dc-file_546 auth v5046 s=3 n(v0 rc2023-10-03T19:17:04.639274+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535403600] 2023-10-03T19:21:14.560 INFO:teuthology.orchestra.run.smithi045.stdout: -1567> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000417) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.560 INFO:teuthology.orchestra.run.smithi045.stdout: -1566> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000418 [2,head] /dc-dir/dc-file_547 auth v5048 s=3 n(v0 rc2023-10-03T19:17:04.650331+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535403b80] 2023-10-03T19:21:14.560 INFO:teuthology.orchestra.run.smithi045.stdout: -1565> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000418) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.560 INFO:teuthology.orchestra.run.smithi045.stdout: -1564> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000419 [2,head] /dc-dir/dc-file_548 auth v5050 s=3 n(v0 rc2023-10-03T19:17:04.661079+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535404100] 2023-10-03T19:21:14.561 INFO:teuthology.orchestra.run.smithi045.stdout: -1563> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000419) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.561 INFO:teuthology.orchestra.run.smithi045.stdout: -1562> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000041a [2,head] /dc-dir/dc-file_549 auth v5052 s=3 n(v0 rc2023-10-03T19:17:04.672909+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535404680] 2023-10-03T19:21:14.561 INFO:teuthology.orchestra.run.smithi045.stdout: -1561> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000041a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.561 INFO:teuthology.orchestra.run.smithi045.stdout: -1560> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000041b [2,head] /dc-dir/dc-file_550 auth v5054 s=3 n(v0 rc2023-10-03T19:17:04.683939+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535404c00] 2023-10-03T19:21:14.561 INFO:teuthology.orchestra.run.smithi045.stdout: -1559> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000041b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.561 INFO:teuthology.orchestra.run.smithi045.stdout: -1558> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000041c [2,head] /dc-dir/dc-file_551 auth v5056 s=3 n(v0 rc2023-10-03T19:17:04.695865+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535405180] 2023-10-03T19:21:14.561 INFO:teuthology.orchestra.run.smithi045.stdout: -1557> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000041c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.561 INFO:teuthology.orchestra.run.smithi045.stdout: -1556> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000041d [2,head] /dc-dir/dc-file_552 auth v5058 s=3 n(v0 rc2023-10-03T19:17:04.707314+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535405700] 2023-10-03T19:21:14.561 INFO:teuthology.orchestra.run.smithi045.stdout: -1555> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000041d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.561 INFO:teuthology.orchestra.run.smithi045.stdout: -1554> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000041e [2,head] /dc-dir/dc-file_553 auth v5060 s=3 n(v0 rc2023-10-03T19:17:04.718654+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535480000] 2023-10-03T19:21:14.562 INFO:teuthology.orchestra.run.smithi045.stdout: -1553> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000041e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.562 INFO:teuthology.orchestra.run.smithi045.stdout: -1552> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000041f [2,head] /dc-dir/dc-file_554 auth v5062 s=3 n(v0 rc2023-10-03T19:17:04.729864+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535480580] 2023-10-03T19:21:14.562 INFO:teuthology.orchestra.run.smithi045.stdout: -1551> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000041f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.562 INFO:teuthology.orchestra.run.smithi045.stdout: -1550> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000420 [2,head] /dc-dir/dc-file_555 auth v5064 s=3 n(v0 rc2023-10-03T19:17:04.741553+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535480b00] 2023-10-03T19:21:14.562 INFO:teuthology.orchestra.run.smithi045.stdout: -1549> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000420) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.562 INFO:teuthology.orchestra.run.smithi045.stdout: -1548> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000421 [2,head] /dc-dir/dc-file_556 auth v5066 s=3 n(v0 rc2023-10-03T19:17:04.753115+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535481080] 2023-10-03T19:21:14.562 INFO:teuthology.orchestra.run.smithi045.stdout: -1547> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000421) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.562 INFO:teuthology.orchestra.run.smithi045.stdout: -1546> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000422 [2,head] /dc-dir/dc-file_557 auth v5068 s=3 n(v0 rc2023-10-03T19:17:04.764667+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535481600] 2023-10-03T19:21:14.562 INFO:teuthology.orchestra.run.smithi045.stdout: -1545> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000422) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.563 INFO:teuthology.orchestra.run.smithi045.stdout: -1544> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000423 [2,head] /dc-dir/dc-file_558 auth v5070 s=3 n(v0 rc2023-10-03T19:17:04.775514+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535481b80] 2023-10-03T19:21:14.563 INFO:teuthology.orchestra.run.smithi045.stdout: -1543> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000423) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.563 INFO:teuthology.orchestra.run.smithi045.stdout: -1542> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000424 [2,head] /dc-dir/dc-file_559 auth v5072 s=3 n(v0 rc2023-10-03T19:17:04.786912+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535482100] 2023-10-03T19:21:14.563 INFO:teuthology.orchestra.run.smithi045.stdout: -1541> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000424) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.563 INFO:teuthology.orchestra.run.smithi045.stdout: -1540> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000425 [2,head] /dc-dir/dc-file_560 auth v5074 s=3 n(v0 rc2023-10-03T19:17:04.798957+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535482680] 2023-10-03T19:21:14.563 INFO:teuthology.orchestra.run.smithi045.stdout: -1539> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000425) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.563 INFO:teuthology.orchestra.run.smithi045.stdout: -1538> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000426 [2,head] /dc-dir/dc-file_561 auth v5076 s=3 n(v0 rc2023-10-03T19:17:04.809630+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535482c00] 2023-10-03T19:21:14.563 INFO:teuthology.orchestra.run.smithi045.stdout: -1537> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000426) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.563 INFO:teuthology.orchestra.run.smithi045.stdout: -1536> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000427 [2,head] /dc-dir/dc-file_562 auth v5078 s=3 n(v0 rc2023-10-03T19:17:04.820961+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535483180] 2023-10-03T19:21:14.564 INFO:teuthology.orchestra.run.smithi045.stdout: -1535> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000427) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.564 INFO:teuthology.orchestra.run.smithi045.stdout: -1534> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000428 [2,head] /dc-dir/dc-file_563 auth v5080 s=3 n(v0 rc2023-10-03T19:17:04.832019+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535483700] 2023-10-03T19:21:14.564 INFO:teuthology.orchestra.run.smithi045.stdout: -1533> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000428) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.564 INFO:teuthology.orchestra.run.smithi045.stdout: -1532> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000429 [2,head] /dc-dir/dc-file_564 auth v5082 s=3 n(v0 rc2023-10-03T19:17:04.844765+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535488000] 2023-10-03T19:21:14.564 INFO:teuthology.orchestra.run.smithi045.stdout: -1531> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000429) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.564 INFO:teuthology.orchestra.run.smithi045.stdout: -1530> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000042a [2,head] /dc-dir/dc-file_565 auth v5084 s=3 n(v0 rc2023-10-03T19:17:04.856085+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535488580] 2023-10-03T19:21:14.564 INFO:teuthology.orchestra.run.smithi045.stdout: -1529> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000042a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.564 INFO:teuthology.orchestra.run.smithi045.stdout: -1528> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000042b [2,head] /dc-dir/dc-file_566 auth v5086 s=3 n(v0 rc2023-10-03T19:17:04.868788+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535488b00] 2023-10-03T19:21:14.564 INFO:teuthology.orchestra.run.smithi045.stdout: -1527> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000042b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.565 INFO:teuthology.orchestra.run.smithi045.stdout: -1526> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000042c [2,head] /dc-dir/dc-file_567 auth v5088 s=3 n(v0 rc2023-10-03T19:17:04.880525+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535489080] 2023-10-03T19:21:14.565 INFO:teuthology.orchestra.run.smithi045.stdout: -1525> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000042c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.565 INFO:teuthology.orchestra.run.smithi045.stdout: -1524> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000042d [2,head] /dc-dir/dc-file_568 auth v5090 s=3 n(v0 rc2023-10-03T19:17:04.891842+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535489600] 2023-10-03T19:21:14.565 INFO:teuthology.orchestra.run.smithi045.stdout: -1523> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000042d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.565 INFO:teuthology.orchestra.run.smithi045.stdout: -1522> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000042e [2,head] /dc-dir/dc-file_569 auth v5092 s=3 n(v0 rc2023-10-03T19:17:04.903853+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535489b80] 2023-10-03T19:21:14.565 INFO:teuthology.orchestra.run.smithi045.stdout: -1521> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000042e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.565 INFO:teuthology.orchestra.run.smithi045.stdout: -1520> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000042f [2,head] /dc-dir/dc-file_570 auth v5094 s=3 n(v0 rc2023-10-03T19:17:04.915359+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553548a100] 2023-10-03T19:21:14.565 INFO:teuthology.orchestra.run.smithi045.stdout: -1519> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000042f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.565 INFO:teuthology.orchestra.run.smithi045.stdout: -1518> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000430 [2,head] /dc-dir/dc-file_571 auth v5096 s=3 n(v0 rc2023-10-03T19:17:04.927034+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553548a680] 2023-10-03T19:21:14.565 INFO:teuthology.orchestra.run.smithi045.stdout: -1517> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000430) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.566 INFO:teuthology.orchestra.run.smithi045.stdout: -1516> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000431 [2,head] /dc-dir/dc-file_572 auth v5098 s=3 n(v0 rc2023-10-03T19:17:04.940629+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553548ac00] 2023-10-03T19:21:14.566 INFO:teuthology.orchestra.run.smithi045.stdout: -1515> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000431) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.566 INFO:teuthology.orchestra.run.smithi045.stdout: -1514> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000432 [2,head] /dc-dir/dc-file_573 auth v5100 s=3 n(v0 rc2023-10-03T19:17:04.954196+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553548b180] 2023-10-03T19:21:14.566 INFO:teuthology.orchestra.run.smithi045.stdout: -1513> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000432) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.566 INFO:teuthology.orchestra.run.smithi045.stdout: -1512> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000433 [2,head] /dc-dir/dc-file_574 auth v5102 s=3 n(v0 rc2023-10-03T19:17:04.968173+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553548b700] 2023-10-03T19:21:14.566 INFO:teuthology.orchestra.run.smithi045.stdout: -1511> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000433) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.566 INFO:teuthology.orchestra.run.smithi045.stdout: -1510> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000434 [2,head] /dc-dir/dc-file_575 auth v5104 s=3 n(v0 rc2023-10-03T19:17:04.981138+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354de000] 2023-10-03T19:21:14.566 INFO:teuthology.orchestra.run.smithi045.stdout: -1509> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000434) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.566 INFO:teuthology.orchestra.run.smithi045.stdout: -1508> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000435 [2,head] /dc-dir/dc-file_576 auth v5106 s=3 n(v0 rc2023-10-03T19:17:04.993907+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354de580] 2023-10-03T19:21:14.566 INFO:teuthology.orchestra.run.smithi045.stdout: -1507> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000435) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.566 INFO:teuthology.orchestra.run.smithi045.stdout: -1506> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000436 [2,head] /dc-dir/dc-file_577 auth v5108 s=3 n(v0 rc2023-10-03T19:17:05.005911+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354deb00] 2023-10-03T19:21:14.566 INFO:teuthology.orchestra.run.smithi045.stdout: -1505> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000436) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.567 INFO:teuthology.orchestra.run.smithi045.stdout: -1504> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000437 [2,head] /dc-dir/dc-file_578 auth v5110 s=3 n(v0 rc2023-10-03T19:17:05.017433+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354df080] 2023-10-03T19:21:14.567 INFO:teuthology.orchestra.run.smithi045.stdout: -1503> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000437) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.650 INFO:teuthology.orchestra.run.smithi045.stdout: -1502> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000438 [2,head] /dc-dir/dc-file_579 auth v5112 s=3 n(v0 rc2023-10-03T19:17:05.029599+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354df600] 2023-10-03T19:21:14.650 INFO:teuthology.orchestra.run.smithi045.stdout: -1501> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000438) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.650 INFO:teuthology.orchestra.run.smithi045.stdout: -1500> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000439 [2,head] /dc-dir/dc-file_580 auth v5114 s=3 n(v0 rc2023-10-03T19:17:05.040703+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354dfb80] 2023-10-03T19:21:14.650 INFO:teuthology.orchestra.run.smithi045.stdout: -1499> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000439) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.650 INFO:teuthology.orchestra.run.smithi045.stdout: -1498> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000043a [2,head] /dc-dir/dc-file_581 auth v5116 s=3 n(v0 rc2023-10-03T19:17:05.051321+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354e0100] 2023-10-03T19:21:14.650 INFO:teuthology.orchestra.run.smithi045.stdout: -1497> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000043a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.650 INFO:teuthology.orchestra.run.smithi045.stdout: -1496> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000043b [2,head] /dc-dir/dc-file_582 auth v5118 s=3 n(v0 rc2023-10-03T19:17:05.063250+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354e0680] 2023-10-03T19:21:14.650 INFO:teuthology.orchestra.run.smithi045.stdout: -1495> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000043b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.650 INFO:teuthology.orchestra.run.smithi045.stdout: -1494> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000043c [2,head] /dc-dir/dc-file_583 auth v5120 s=3 n(v0 rc2023-10-03T19:17:05.074802+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354e0c00] 2023-10-03T19:21:14.651 INFO:teuthology.orchestra.run.smithi045.stdout: -1493> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000043c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.651 INFO:teuthology.orchestra.run.smithi045.stdout: -1492> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000043d [2,head] /dc-dir/dc-file_584 auth v5122 s=3 n(v0 rc2023-10-03T19:17:05.087920+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354e1180] 2023-10-03T19:21:14.651 INFO:teuthology.orchestra.run.smithi045.stdout: -1491> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000043d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.651 INFO:teuthology.orchestra.run.smithi045.stdout: -1490> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000043e [2,head] /dc-dir/dc-file_585 auth v5124 s=3 n(v0 rc2023-10-03T19:17:05.101022+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354e1700] 2023-10-03T19:21:14.651 INFO:teuthology.orchestra.run.smithi045.stdout: -1489> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000043e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.651 INFO:teuthology.orchestra.run.smithi045.stdout: -1488> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000043f [2,head] /dc-dir/dc-file_586 auth v5126 s=3 n(v0 rc2023-10-03T19:17:05.114331+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565534d44000] 2023-10-03T19:21:14.651 INFO:teuthology.orchestra.run.smithi045.stdout: -1487> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000043f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.651 INFO:teuthology.orchestra.run.smithi045.stdout: -1486> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000440 [2,head] /dc-dir/dc-file_587 auth v5128 s=3 n(v0 rc2023-10-03T19:17:05.128052+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565534d44580] 2023-10-03T19:21:14.651 INFO:teuthology.orchestra.run.smithi045.stdout: -1485> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000440) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.651 INFO:teuthology.orchestra.run.smithi045.stdout: -1484> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000441 [2,head] /dc-dir/dc-file_588 auth v5130 s=3 n(v0 rc2023-10-03T19:17:05.140980+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565534d44b00] 2023-10-03T19:21:14.652 INFO:teuthology.orchestra.run.smithi045.stdout: -1483> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000441) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.652 INFO:teuthology.orchestra.run.smithi045.stdout: -1482> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000442 [2,head] /dc-dir/dc-file_589 auth v5132 s=3 n(v0 rc2023-10-03T19:17:05.152667+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565534d45080] 2023-10-03T19:21:14.652 INFO:teuthology.orchestra.run.smithi045.stdout: -1481> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000442) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.652 INFO:teuthology.orchestra.run.smithi045.stdout: -1480> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000443 [2,head] /dc-dir/dc-file_590 auth v5134 s=3 n(v0 rc2023-10-03T19:17:05.163823+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565534d45600] 2023-10-03T19:21:14.652 INFO:teuthology.orchestra.run.smithi045.stdout: -1479> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000443) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.652 INFO:teuthology.orchestra.run.smithi045.stdout: -1478> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000444 [2,head] /dc-dir/dc-file_591 auth v5136 s=3 n(v0 rc2023-10-03T19:17:05.175228+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565534d45b80] 2023-10-03T19:21:14.652 INFO:teuthology.orchestra.run.smithi045.stdout: -1477> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000444) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.652 INFO:teuthology.orchestra.run.smithi045.stdout: -1476> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000445 [2,head] /dc-dir/dc-file_592 auth v5138 s=3 n(v0 rc2023-10-03T19:17:05.186563+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565534d46100] 2023-10-03T19:21:14.652 INFO:teuthology.orchestra.run.smithi045.stdout: -1475> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000445) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.652 INFO:teuthology.orchestra.run.smithi045.stdout: -1474> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000446 [2,head] /dc-dir/dc-file_593 auth v5140 s=3 n(v0 rc2023-10-03T19:17:05.198226+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565534d46680] 2023-10-03T19:21:14.652 INFO:teuthology.orchestra.run.smithi045.stdout: -1473> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000446) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.653 INFO:teuthology.orchestra.run.smithi045.stdout: -1472> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000447 [2,head] /dc-dir/dc-file_594 auth v5142 s=3 n(v0 rc2023-10-03T19:17:05.209989+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565534d46c00] 2023-10-03T19:21:14.653 INFO:teuthology.orchestra.run.smithi045.stdout: -1471> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000447) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.653 INFO:teuthology.orchestra.run.smithi045.stdout: -1470> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000448 [2,head] /dc-dir/dc-file_595 auth v5144 s=3 n(v0 rc2023-10-03T19:17:05.221340+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565534d47180] 2023-10-03T19:21:14.653 INFO:teuthology.orchestra.run.smithi045.stdout: -1469> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000448) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.653 INFO:teuthology.orchestra.run.smithi045.stdout: -1468> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000449 [2,head] /dc-dir/dc-file_596 auth v5146 s=3 n(v0 rc2023-10-03T19:17:05.232576+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565534d47700] 2023-10-03T19:21:14.653 INFO:teuthology.orchestra.run.smithi045.stdout: -1467> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000449) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.653 INFO:teuthology.orchestra.run.smithi045.stdout: -1466> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000044a [2,head] /dc-dir/dc-file_597 auth v5148 s=3 n(v0 rc2023-10-03T19:17:05.243819+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354a0000] 2023-10-03T19:21:14.653 INFO:teuthology.orchestra.run.smithi045.stdout: -1465> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000044a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.653 INFO:teuthology.orchestra.run.smithi045.stdout: -1464> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000044b [2,head] /dc-dir/dc-file_598 auth v5150 s=3 n(v0 rc2023-10-03T19:17:05.254520+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354a0580] 2023-10-03T19:21:14.653 INFO:teuthology.orchestra.run.smithi045.stdout: -1463> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000044b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.654 INFO:teuthology.orchestra.run.smithi045.stdout: -1462> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000044c [2,head] /dc-dir/dc-file_599 auth v5152 s=3 n(v0 rc2023-10-03T19:17:05.267971+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354a0b00] 2023-10-03T19:21:14.654 INFO:teuthology.orchestra.run.smithi045.stdout: -1461> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000044c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.654 INFO:teuthology.orchestra.run.smithi045.stdout: -1460> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000044d [2,head] /dc-dir/dc-file_600 auth v5154 s=3 n(v0 rc2023-10-03T19:17:05.280908+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354a1080] 2023-10-03T19:21:14.654 INFO:teuthology.orchestra.run.smithi045.stdout: -1459> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000044d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.654 INFO:teuthology.orchestra.run.smithi045.stdout: -1458> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000044e [2,head] /dc-dir/dc-file_601 auth v5156 s=3 n(v0 rc2023-10-03T19:17:05.294672+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354a1600] 2023-10-03T19:21:14.654 INFO:teuthology.orchestra.run.smithi045.stdout: -1457> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000044e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.654 INFO:teuthology.orchestra.run.smithi045.stdout: -1456> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000044f [2,head] /dc-dir/dc-file_602 auth v5158 s=3 n(v0 rc2023-10-03T19:17:05.306907+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354a1b80] 2023-10-03T19:21:14.654 INFO:teuthology.orchestra.run.smithi045.stdout: -1455> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000044f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.654 INFO:teuthology.orchestra.run.smithi045.stdout: -1454> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000450 [2,head] /dc-dir/dc-file_603 auth v5160 s=3 n(v0 rc2023-10-03T19:17:05.319881+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354a2100] 2023-10-03T19:21:14.654 INFO:teuthology.orchestra.run.smithi045.stdout: -1453> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000450) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.654 INFO:teuthology.orchestra.run.smithi045.stdout: -1452> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000451 [2,head] /dc-dir/dc-file_604 auth v5162 s=3 n(v0 rc2023-10-03T19:17:05.332077+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354a2680] 2023-10-03T19:21:14.655 INFO:teuthology.orchestra.run.smithi045.stdout: -1451> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000451) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.655 INFO:teuthology.orchestra.run.smithi045.stdout: -1450> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000452 [2,head] /dc-dir/dc-file_605 auth v5164 s=3 n(v0 rc2023-10-03T19:17:05.343774+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354a2c00] 2023-10-03T19:21:14.655 INFO:teuthology.orchestra.run.smithi045.stdout: -1449> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000452) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.655 INFO:teuthology.orchestra.run.smithi045.stdout: -1448> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000453 [2,head] /dc-dir/dc-file_606 auth v5166 s=3 n(v0 rc2023-10-03T19:17:05.354546+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354a3180] 2023-10-03T19:21:14.655 INFO:teuthology.orchestra.run.smithi045.stdout: -1447> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000453) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.655 INFO:teuthology.orchestra.run.smithi045.stdout: -1446> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000454 [2,head] /dc-dir/dc-file_607 auth v5168 s=3 n(v0 rc2023-10-03T19:17:05.367496+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354a3700] 2023-10-03T19:21:14.655 INFO:teuthology.orchestra.run.smithi045.stdout: -1445> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000454) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.655 INFO:teuthology.orchestra.run.smithi045.stdout: -1444> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000455 [2,head] /dc-dir/dc-file_608 auth v5170 s=3 n(v0 rc2023-10-03T19:17:05.380288+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354aa000] 2023-10-03T19:21:14.655 INFO:teuthology.orchestra.run.smithi045.stdout: -1443> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000455) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.655 INFO:teuthology.orchestra.run.smithi045.stdout: -1442> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000456 [2,head] /dc-dir/dc-file_609 auth v5172 s=3 n(v0 rc2023-10-03T19:17:05.391429+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354aa580] 2023-10-03T19:21:14.655 INFO:teuthology.orchestra.run.smithi045.stdout: -1441> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000456) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.656 INFO:teuthology.orchestra.run.smithi045.stdout: -1440> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000457 [2,head] /dc-dir/dc-file_610 auth v5174 s=3 n(v0 rc2023-10-03T19:17:05.403916+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354aab00] 2023-10-03T19:21:14.656 INFO:teuthology.orchestra.run.smithi045.stdout: -1439> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000457) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.656 INFO:teuthology.orchestra.run.smithi045.stdout: -1438> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000458 [2,head] /dc-dir/dc-file_611 auth v5176 s=3 n(v0 rc2023-10-03T19:17:05.416368+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354ab080] 2023-10-03T19:21:14.656 INFO:teuthology.orchestra.run.smithi045.stdout: -1437> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000458) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.656 INFO:teuthology.orchestra.run.smithi045.stdout: -1436> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000459 [2,head] /dc-dir/dc-file_612 auth v5178 s=3 n(v0 rc2023-10-03T19:17:05.428202+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354ab600] 2023-10-03T19:21:14.656 INFO:teuthology.orchestra.run.smithi045.stdout: -1435> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000459) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.656 INFO:teuthology.orchestra.run.smithi045.stdout: -1434> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000045a [2,head] /dc-dir/dc-file_613 auth v5180 s=3 n(v0 rc2023-10-03T19:17:05.440127+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354abb80] 2023-10-03T19:21:14.656 INFO:teuthology.orchestra.run.smithi045.stdout: -1433> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000045a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.656 INFO:teuthology.orchestra.run.smithi045.stdout: -1432> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000045b [2,head] /dc-dir/dc-file_614 auth v5182 s=3 n(v0 rc2023-10-03T19:17:05.451790+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354ac100] 2023-10-03T19:21:14.656 INFO:teuthology.orchestra.run.smithi045.stdout: -1431> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000045b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.657 INFO:teuthology.orchestra.run.smithi045.stdout: -1430> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000045c [2,head] /dc-dir/dc-file_615 auth v5184 s=3 n(v0 rc2023-10-03T19:17:05.462924+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354ac680] 2023-10-03T19:21:14.657 INFO:teuthology.orchestra.run.smithi045.stdout: -1429> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000045c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.657 INFO:teuthology.orchestra.run.smithi045.stdout: -1428> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000045d [2,head] /dc-dir/dc-file_616 auth v5186 s=3 n(v0 rc2023-10-03T19:17:05.473986+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354acc00] 2023-10-03T19:21:14.657 INFO:teuthology.orchestra.run.smithi045.stdout: -1427> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000045d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.657 INFO:teuthology.orchestra.run.smithi045.stdout: -1426> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000045e [2,head] /dc-dir/dc-file_617 auth v5236 s=3 n(v0 rc2023-10-03T19:17:05.588698+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354ad180] 2023-10-03T19:21:14.695 INFO:teuthology.orchestra.run.smithi045.stdout: -1425> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000045e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.696 INFO:teuthology.orchestra.run.smithi045.stdout: -1424> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000045f [2,head] /dc-dir/dc-file_618 auth v5238 s=3 n(v0 rc2023-10-03T19:17:05.636023+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354ad700] 2023-10-03T19:21:14.696 INFO:teuthology.orchestra.run.smithi045.stdout: -1423> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000045f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.696 INFO:teuthology.orchestra.run.smithi045.stdout: -1422> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000460 [2,head] /dc-dir/dc-file_619 auth v5240 s=3 n(v0 rc2023-10-03T19:17:05.648084+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553556a000] 2023-10-03T19:21:14.696 INFO:teuthology.orchestra.run.smithi045.stdout: -1421> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000460) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.696 INFO:teuthology.orchestra.run.smithi045.stdout: -1420> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000461 [2,head] /dc-dir/dc-file_620 auth v5242 s=3 n(v0 rc2023-10-03T19:17:05.659942+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553556a580] 2023-10-03T19:21:14.696 INFO:teuthology.orchestra.run.smithi045.stdout: -1419> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000461) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.696 INFO:teuthology.orchestra.run.smithi045.stdout: -1418> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000462 [2,head] /dc-dir/dc-file_621 auth v5244 s=3 n(v0 rc2023-10-03T19:17:05.671672+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553556ab00] 2023-10-03T19:21:14.696 INFO:teuthology.orchestra.run.smithi045.stdout: -1417> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000462) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.696 INFO:teuthology.orchestra.run.smithi045.stdout: -1416> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000463 [2,head] /dc-dir/dc-file_622 auth v5246 s=3 n(v0 rc2023-10-03T19:17:05.684190+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553556b080] 2023-10-03T19:21:14.696 INFO:teuthology.orchestra.run.smithi045.stdout: -1415> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000463) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.697 INFO:teuthology.orchestra.run.smithi045.stdout: -1414> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000464 [2,head] /dc-dir/dc-file_623 auth v5248 s=3 n(v0 rc2023-10-03T19:17:05.695611+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553556b600] 2023-10-03T19:21:14.697 INFO:teuthology.orchestra.run.smithi045.stdout: -1413> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000464) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.697 INFO:teuthology.orchestra.run.smithi045.stdout: -1412> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000465 [2,head] /dc-dir/dc-file_624 auth v5250 s=3 n(v0 rc2023-10-03T19:17:05.708936+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553556bb80] 2023-10-03T19:21:14.697 INFO:teuthology.orchestra.run.smithi045.stdout: -1411> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000465) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.697 INFO:teuthology.orchestra.run.smithi045.stdout: -1410> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000466 [2,head] /dc-dir/dc-file_625 auth v5252 s=3 n(v0 rc2023-10-03T19:17:05.721516+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553556c100] 2023-10-03T19:21:14.697 INFO:teuthology.orchestra.run.smithi045.stdout: -1409> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000466) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.697 INFO:teuthology.orchestra.run.smithi045.stdout: -1408> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000467 [2,head] /dc-dir/dc-file_626 auth v5254 s=3 n(v0 rc2023-10-03T19:17:05.735297+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553556c680] 2023-10-03T19:21:14.697 INFO:teuthology.orchestra.run.smithi045.stdout: -1407> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000467) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.698 INFO:teuthology.orchestra.run.smithi045.stdout: -1406> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000468 [2,head] /dc-dir/dc-file_627 auth v5256 s=3 n(v0 rc2023-10-03T19:17:05.748617+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553556cc00] 2023-10-03T19:21:14.698 INFO:teuthology.orchestra.run.smithi045.stdout: -1405> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000468) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.698 INFO:teuthology.orchestra.run.smithi045.stdout: -1404> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000469 [2,head] /dc-dir/dc-file_628 auth v5258 s=3 n(v0 rc2023-10-03T19:17:05.761377+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553556d180] 2023-10-03T19:21:14.698 INFO:teuthology.orchestra.run.smithi045.stdout: -1403> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000469) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.698 INFO:teuthology.orchestra.run.smithi045.stdout: -1402> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000046a [2,head] /dc-dir/dc-file_629 auth v5260 s=3 n(v0 rc2023-10-03T19:17:05.774510+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553556d700] 2023-10-03T19:21:14.698 INFO:teuthology.orchestra.run.smithi045.stdout: -1401> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000046a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.698 INFO:teuthology.orchestra.run.smithi045.stdout: -1400> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000046b [2,head] /dc-dir/dc-file_630 auth v5262 s=3 n(v0 rc2023-10-03T19:17:05.786465+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553555e000] 2023-10-03T19:21:14.698 INFO:teuthology.orchestra.run.smithi045.stdout: -1399> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000046b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.698 INFO:teuthology.orchestra.run.smithi045.stdout: -1398> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000046c [2,head] /dc-dir/dc-file_631 auth v5264 s=3 n(v0 rc2023-10-03T19:17:05.798101+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553555e580] 2023-10-03T19:21:14.698 INFO:teuthology.orchestra.run.smithi045.stdout: -1397> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000046c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.699 INFO:teuthology.orchestra.run.smithi045.stdout: -1396> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000046d [2,head] /dc-dir/dc-file_632 auth v5266 s=3 n(v0 rc2023-10-03T19:17:05.809615+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553555eb00] 2023-10-03T19:21:14.699 INFO:teuthology.orchestra.run.smithi045.stdout: -1395> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000046d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.699 INFO:teuthology.orchestra.run.smithi045.stdout: -1394> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000046e [2,head] /dc-dir/dc-file_633 auth v5268 s=3 n(v0 rc2023-10-03T19:17:05.821309+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553555f080] 2023-10-03T19:21:14.699 INFO:teuthology.orchestra.run.smithi045.stdout: -1393> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000046e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.699 INFO:teuthology.orchestra.run.smithi045.stdout: -1392> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000046f [2,head] /dc-dir/dc-file_634 auth v5270 s=3 n(v0 rc2023-10-03T19:17:05.833417+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553555f600] 2023-10-03T19:21:14.699 INFO:teuthology.orchestra.run.smithi045.stdout: -1391> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000046f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.699 INFO:teuthology.orchestra.run.smithi045.stdout: -1390> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000470 [2,head] /dc-dir/dc-file_635 auth v5272 s=3 n(v0 rc2023-10-03T19:17:05.845051+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553555fb80] 2023-10-03T19:21:14.699 INFO:teuthology.orchestra.run.smithi045.stdout: -1389> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000470) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.699 INFO:teuthology.orchestra.run.smithi045.stdout: -1388> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000471 [2,head] /dc-dir/dc-file_636 auth v5274 s=3 n(v0 rc2023-10-03T19:17:05.856758+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535560100] 2023-10-03T19:21:14.699 INFO:teuthology.orchestra.run.smithi045.stdout: -1387> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000471) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.699 INFO:teuthology.orchestra.run.smithi045.stdout: -1386> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000472 [2,head] /dc-dir/dc-file_637 auth v5276 s=3 n(v0 rc2023-10-03T19:17:05.868263+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535560680] 2023-10-03T19:21:14.700 INFO:teuthology.orchestra.run.smithi045.stdout: -1385> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000472) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.700 INFO:teuthology.orchestra.run.smithi045.stdout: -1384> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000473 [2,head] /dc-dir/dc-file_638 auth v5278 s=3 n(v0 rc2023-10-03T19:17:05.880085+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535560c00] 2023-10-03T19:21:14.700 INFO:teuthology.orchestra.run.smithi045.stdout: -1383> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000473) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.700 INFO:teuthology.orchestra.run.smithi045.stdout: -1382> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000474 [2,head] /dc-dir/dc-file_639 auth v5280 s=3 n(v0 rc2023-10-03T19:17:05.892063+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535561180] 2023-10-03T19:21:14.700 INFO:teuthology.orchestra.run.smithi045.stdout: -1381> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000474) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.700 INFO:teuthology.orchestra.run.smithi045.stdout: -1380> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000475 [2,head] /dc-dir/dc-file_640 auth v5282 s=3 n(v0 rc2023-10-03T19:17:05.903263+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535561700] 2023-10-03T19:21:14.700 INFO:teuthology.orchestra.run.smithi045.stdout: -1379> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000475) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.700 INFO:teuthology.orchestra.run.smithi045.stdout: -1378> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000476 [2,head] /dc-dir/dc-file_641 auth v5284 s=3 n(v0 rc2023-10-03T19:17:05.914222+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553554a000] 2023-10-03T19:21:14.700 INFO:teuthology.orchestra.run.smithi045.stdout: -1377> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000476) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.700 INFO:teuthology.orchestra.run.smithi045.stdout: -1376> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000477 [2,head] /dc-dir/dc-file_642 auth v5286 s=3 n(v0 rc2023-10-03T19:17:05.926595+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553554a580] 2023-10-03T19:21:14.700 INFO:teuthology.orchestra.run.smithi045.stdout: -1375> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000477) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.701 INFO:teuthology.orchestra.run.smithi045.stdout: -1374> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000478 [2,head] /dc-dir/dc-file_643 auth v5288 s=3 n(v0 rc2023-10-03T19:17:05.939917+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553554ab00] 2023-10-03T19:21:14.701 INFO:teuthology.orchestra.run.smithi045.stdout: -1373> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000478) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.701 INFO:teuthology.orchestra.run.smithi045.stdout: -1372> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000479 [2,head] /dc-dir/dc-file_644 auth v5290 s=3 n(v0 rc2023-10-03T19:17:05.953047+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553554b080] 2023-10-03T19:21:14.701 INFO:teuthology.orchestra.run.smithi045.stdout: -1371> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000479) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.701 INFO:teuthology.orchestra.run.smithi045.stdout: -1370> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000047a [2,head] /dc-dir/dc-file_645 auth v5292 s=3 n(v0 rc2023-10-03T19:17:05.964599+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553554b600] 2023-10-03T19:21:14.701 INFO:teuthology.orchestra.run.smithi045.stdout: -1369> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000047a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.701 INFO:teuthology.orchestra.run.smithi045.stdout: -1368> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000047b [2,head] /dc-dir/dc-file_646 auth v5294 s=3 n(v0 rc2023-10-03T19:17:05.976886+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553554bb80] 2023-10-03T19:21:14.701 INFO:teuthology.orchestra.run.smithi045.stdout: -1367> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000047b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.701 INFO:teuthology.orchestra.run.smithi045.stdout: -1366> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000047c [2,head] /dc-dir/dc-file_647 auth v5296 s=3 n(v0 rc2023-10-03T19:17:05.989752+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553554c100] 2023-10-03T19:21:14.701 INFO:teuthology.orchestra.run.smithi045.stdout: -1365> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000047c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.701 INFO:teuthology.orchestra.run.smithi045.stdout: -1364> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000047d [2,head] /dc-dir/dc-file_648 auth v5298 s=3 n(v0 rc2023-10-03T19:17:06.001620+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553554c680] 2023-10-03T19:21:14.702 INFO:teuthology.orchestra.run.smithi045.stdout: -1363> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000047d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.702 INFO:teuthology.orchestra.run.smithi045.stdout: -1362> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000047e [2,head] /dc-dir/dc-file_649 auth v5300 s=3 n(v0 rc2023-10-03T19:17:06.013285+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553554cc00] 2023-10-03T19:21:14.702 INFO:teuthology.orchestra.run.smithi045.stdout: -1361> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000047e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.702 INFO:teuthology.orchestra.run.smithi045.stdout: -1360> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000047f [2,head] /dc-dir/dc-file_650 auth v5302 s=3 n(v0 rc2023-10-03T19:17:06.025615+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553554d180] 2023-10-03T19:21:14.702 INFO:teuthology.orchestra.run.smithi045.stdout: -1359> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000047f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.702 INFO:teuthology.orchestra.run.smithi045.stdout: -1358> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000480 [2,head] /dc-dir/dc-file_651 auth v5304 s=3 n(v0 rc2023-10-03T19:17:06.037480+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x56553554d700] 2023-10-03T19:21:14.702 INFO:teuthology.orchestra.run.smithi045.stdout: -1357> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000480) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.702 INFO:teuthology.orchestra.run.smithi045.stdout: -1356> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000481 [2,head] /dc-dir/dc-file_652 auth v5306 s=3 n(v0 rc2023-10-03T19:17:06.049557+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535554000] 2023-10-03T19:21:14.702 INFO:teuthology.orchestra.run.smithi045.stdout: -1355> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000481) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.702 INFO:teuthology.orchestra.run.smithi045.stdout: -1354> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000482 [2,head] /dc-dir/dc-file_653 auth v5308 s=3 n(v0 rc2023-10-03T19:17:06.061169+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535554580] 2023-10-03T19:21:14.703 INFO:teuthology.orchestra.run.smithi045.stdout: -1353> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000482) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.752 INFO:teuthology.orchestra.run.smithi045.stdout: -1352> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000483 [2,head] /dc-dir/dc-file_654 auth v5310 s=3 n(v0 rc2023-10-03T19:17:06.073089+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535554b00] 2023-10-03T19:21:14.752 INFO:teuthology.orchestra.run.smithi045.stdout: -1351> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000483) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.752 INFO:teuthology.orchestra.run.smithi045.stdout: -1350> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000484 [2,head] /dc-dir/dc-file_655 auth v5312 s=3 n(v0 rc2023-10-03T19:17:06.084934+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535555080] 2023-10-03T19:21:14.752 INFO:teuthology.orchestra.run.smithi045.stdout: -1349> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000484) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.752 INFO:teuthology.orchestra.run.smithi045.stdout: -1348> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000485 [2,head] /dc-dir/dc-file_656 auth v5314 s=3 n(v0 rc2023-10-03T19:17:06.095904+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535555600] 2023-10-03T19:21:14.752 INFO:teuthology.orchestra.run.smithi045.stdout: -1347> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000485) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.753 INFO:teuthology.orchestra.run.smithi045.stdout: -1346> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000486 [2,head] /dc-dir/dc-file_657 auth v5316 s=3 n(v0 rc2023-10-03T19:17:06.108137+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535555b80] 2023-10-03T19:21:14.753 INFO:teuthology.orchestra.run.smithi045.stdout: -1345> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000486) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.753 INFO:teuthology.orchestra.run.smithi045.stdout: -1344> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000487 [2,head] /dc-dir/dc-file_658 auth v5318 s=3 n(v0 rc2023-10-03T19:17:06.119770+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535556100] 2023-10-03T19:21:14.753 INFO:teuthology.orchestra.run.smithi045.stdout: -1343> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000487) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.753 INFO:teuthology.orchestra.run.smithi045.stdout: -1342> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000488 [2,head] /dc-dir/dc-file_659 auth v5320 s=3 n(v0 rc2023-10-03T19:17:06.131276+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535556680] 2023-10-03T19:21:14.753 INFO:teuthology.orchestra.run.smithi045.stdout: -1341> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000488) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.753 INFO:teuthology.orchestra.run.smithi045.stdout: -1340> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000489 [2,head] /dc-dir/dc-file_660 auth v5322 s=3 n(v0 rc2023-10-03T19:17:06.144739+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535556c00] 2023-10-03T19:21:14.754 INFO:teuthology.orchestra.run.smithi045.stdout: -1339> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000489) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.754 INFO:teuthology.orchestra.run.smithi045.stdout: -1338> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000048a [2,head] /dc-dir/dc-file_661 auth v5324 s=3 n(v0 rc2023-10-03T19:17:06.158439+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535557180] 2023-10-03T19:21:14.754 INFO:teuthology.orchestra.run.smithi045.stdout: -1337> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000048a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.754 INFO:teuthology.orchestra.run.smithi045.stdout: -1336> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000048b [2,head] /dc-dir/dc-file_662 auth v5326 s=3 n(v0 rc2023-10-03T19:17:06.172259+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535557700] 2023-10-03T19:21:14.754 INFO:teuthology.orchestra.run.smithi045.stdout: -1335> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000048b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.754 INFO:teuthology.orchestra.run.smithi045.stdout: -1334> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000048c [2,head] /dc-dir/dc-file_663 auth v5328 s=3 n(v0 rc2023-10-03T19:17:06.183624+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354fa000] 2023-10-03T19:21:14.754 INFO:teuthology.orchestra.run.smithi045.stdout: -1333> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000048c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.754 INFO:teuthology.orchestra.run.smithi045.stdout: -1332> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000048d [2,head] /dc-dir/dc-file_664 auth v5330 s=3 n(v0 rc2023-10-03T19:17:06.195074+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354fa580] 2023-10-03T19:21:14.755 INFO:teuthology.orchestra.run.smithi045.stdout: -1331> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000048d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.755 INFO:teuthology.orchestra.run.smithi045.stdout: -1330> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000048e [2,head] /dc-dir/dc-file_665 auth v5332 s=3 n(v0 rc2023-10-03T19:17:06.206901+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354fab00] 2023-10-03T19:21:14.755 INFO:teuthology.orchestra.run.smithi045.stdout: -1329> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000048e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.755 INFO:teuthology.orchestra.run.smithi045.stdout: -1328> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000048f [2,head] /dc-dir/dc-file_666 auth v5334 s=3 n(v0 rc2023-10-03T19:17:06.218407+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354fb080] 2023-10-03T19:21:14.755 INFO:teuthology.orchestra.run.smithi045.stdout: -1327> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000048f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.756 INFO:teuthology.orchestra.run.smithi045.stdout: -1326> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000490 [2,head] /dc-dir/dc-file_667 auth v5336 s=3 n(v0 rc2023-10-03T19:17:06.230840+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354fb600] 2023-10-03T19:21:14.756 INFO:teuthology.orchestra.run.smithi045.stdout: -1325> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000490) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.756 INFO:teuthology.orchestra.run.smithi045.stdout: -1324> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000491 [2,head] /dc-dir/dc-file_668 auth v5338 s=3 n(v0 rc2023-10-03T19:17:06.244024+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354fbb80] 2023-10-03T19:21:14.756 INFO:teuthology.orchestra.run.smithi045.stdout: -1323> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000491) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.756 INFO:teuthology.orchestra.run.smithi045.stdout: -1322> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000492 [2,head] /dc-dir/dc-file_669 auth v5340 s=3 n(v0 rc2023-10-03T19:17:06.256498+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354fc100] 2023-10-03T19:21:14.756 INFO:teuthology.orchestra.run.smithi045.stdout: -1321> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000492) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.756 INFO:teuthology.orchestra.run.smithi045.stdout: -1320> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000493 [2,head] /dc-dir/dc-file_670 auth v5342 s=3 n(v0 rc2023-10-03T19:17:06.269037+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354fc680] 2023-10-03T19:21:14.756 INFO:teuthology.orchestra.run.smithi045.stdout: -1319> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000493) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.756 INFO:teuthology.orchestra.run.smithi045.stdout: -1318> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000494 [2,head] /dc-dir/dc-file_671 auth v5344 s=3 n(v0 rc2023-10-03T19:17:06.281582+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354fcc00] 2023-10-03T19:21:14.756 INFO:teuthology.orchestra.run.smithi045.stdout: -1317> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000494) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.757 INFO:teuthology.orchestra.run.smithi045.stdout: -1316> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000495 [2,head] /dc-dir/dc-file_672 auth v5346 s=3 n(v0 rc2023-10-03T19:17:06.294410+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354fd180] 2023-10-03T19:21:14.757 INFO:teuthology.orchestra.run.smithi045.stdout: -1315> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000495) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.757 INFO:teuthology.orchestra.run.smithi045.stdout: -1314> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000496 [2,head] /dc-dir/dc-file_673 auth v5348 s=3 n(v0 rc2023-10-03T19:17:06.307504+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x5655354fd700] 2023-10-03T19:21:14.757 INFO:teuthology.orchestra.run.smithi045.stdout: -1313> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000496) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.757 INFO:teuthology.orchestra.run.smithi045.stdout: -1312> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000497 [2,head] /dc-dir/dc-file_674 auth v5350 s=3 n(v0 rc2023-10-03T19:17:06.320056+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535504000] 2023-10-03T19:21:14.757 INFO:teuthology.orchestra.run.smithi045.stdout: -1311> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000497) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.757 INFO:teuthology.orchestra.run.smithi045.stdout: -1310> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000498 [2,head] /dc-dir/dc-file_675 auth v5352 s=3 n(v0 rc2023-10-03T19:17:06.332041+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535504580] 2023-10-03T19:21:14.758 INFO:teuthology.orchestra.run.smithi045.stdout: -1309> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000498) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.758 INFO:teuthology.orchestra.run.smithi045.stdout: -1308> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000499 [2,head] /dc-dir/dc-file_676 auth v5354 s=3 n(v0 rc2023-10-03T19:17:06.344472+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535504b00] 2023-10-03T19:21:14.758 INFO:teuthology.orchestra.run.smithi045.stdout: -1307> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000499) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.758 INFO:teuthology.orchestra.run.smithi045.stdout: -1306> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000049a [2,head] /dc-dir/dc-file_677 auth v5356 s=3 n(v0 rc2023-10-03T19:17:06.356375+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535505080] 2023-10-03T19:21:14.758 INFO:teuthology.orchestra.run.smithi045.stdout: -1305> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000049a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.759 INFO:teuthology.orchestra.run.smithi045.stdout: -1304> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000049b [2,head] /dc-dir/dc-file_678 auth v5358 s=3 n(v0 rc2023-10-03T19:17:06.368439+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535505600] 2023-10-03T19:21:14.759 INFO:teuthology.orchestra.run.smithi045.stdout: -1303> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000049b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.759 INFO:teuthology.orchestra.run.smithi045.stdout: -1302> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000049c [2,head] /dc-dir/dc-file_679 auth v5360 s=3 n(v0 rc2023-10-03T19:17:06.380986+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535505b80] 2023-10-03T19:21:14.759 INFO:teuthology.orchestra.run.smithi045.stdout: -1301> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000049c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.759 INFO:teuthology.orchestra.run.smithi045.stdout: -1300> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000049d [2,head] /dc-dir/dc-file_680 auth v5362 s=3 n(v0 rc2023-10-03T19:17:06.393128+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535506100] 2023-10-03T19:21:14.760 INFO:teuthology.orchestra.run.smithi045.stdout: -1299> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000049d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.848 INFO:teuthology.orchestra.run.smithi045.stdout: -1298> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000049e [2,head] /dc-dir/dc-file_681 auth v5364 s=3 n(v0 rc2023-10-03T19:17:06.405813+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535506680] 2023-10-03T19:21:14.848 INFO:teuthology.orchestra.run.smithi045.stdout: -1297> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000049e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.849 INFO:teuthology.orchestra.run.smithi045.stdout: -1296> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000049f [2,head] /dc-dir/dc-file_682 auth v5366 s=3 n(v0 rc2023-10-03T19:17:06.419321+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535506c00] 2023-10-03T19:21:14.849 INFO:teuthology.orchestra.run.smithi045.stdout: -1295> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000049f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.849 INFO:teuthology.orchestra.run.smithi045.stdout: -1294> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004a0 [2,head] /dc-dir/dc-file_683 auth v5368 s=3 n(v0 rc2023-10-03T19:17:06.431518+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535507180] 2023-10-03T19:21:14.849 INFO:teuthology.orchestra.run.smithi045.stdout: -1293> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004a0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.850 INFO:teuthology.orchestra.run.smithi045.stdout: -1292> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004a1 [2,head] /dc-dir/dc-file_684 auth v5370 s=3 n(v0 rc2023-10-03T19:17:06.443676+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535507700] 2023-10-03T19:21:14.850 INFO:teuthology.orchestra.run.smithi045.stdout: -1291> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004a1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.850 INFO:teuthology.orchestra.run.smithi045.stdout: -1290> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004a2 [2,head] /dc-dir/dc-file_685 auth v5372 s=3 n(v0 rc2023-10-03T19:17:06.455460+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535510000] 2023-10-03T19:21:14.850 INFO:teuthology.orchestra.run.smithi045.stdout: -1289> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004a2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.850 INFO:teuthology.orchestra.run.smithi045.stdout: -1288> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004a3 [2,head] /dc-dir/dc-file_686 auth v5374 s=3 n(v0 rc2023-10-03T19:17:06.466561+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535510580] 2023-10-03T19:21:14.850 INFO:teuthology.orchestra.run.smithi045.stdout: -1287> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004a3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.850 INFO:teuthology.orchestra.run.smithi045.stdout: -1286> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004a4 [2,head] /dc-dir/dc-file_687 auth v5376 s=3 n(v0 rc2023-10-03T19:17:06.477991+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x565535510b00] 2023-10-03T19:21:14.850 INFO:teuthology.orchestra.run.smithi045.stdout: -1285> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004a4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.850 INFO:teuthology.orchestra.run.smithi045.stdout: -1284> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004a5 [2,head] /dc-dir/dc-file_688 auth v5378 s=3 n(v0 rc2023-10-03T19:17:06.494649+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535511080] 2023-10-03T19:21:14.851 INFO:teuthology.orchestra.run.smithi045.stdout: -1283> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004a5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.855 INFO:teuthology.orchestra.run.smithi045.stdout: -1282> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004a6 [2,head] /dc-dir/dc-file_689 auth v5380 s=3 n(v0 rc2023-10-03T19:17:06.607971+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535511600] 2023-10-03T19:21:14.856 INFO:teuthology.orchestra.run.smithi045.stdout: -1281> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004a6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.856 INFO:teuthology.orchestra.run.smithi045.stdout: -1280> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004a7 [2,head] /dc-dir/dc-file_690 auth v5382 s=3 n(v0 rc2023-10-03T19:17:06.619450+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535511b80] 2023-10-03T19:21:14.856 INFO:teuthology.orchestra.run.smithi045.stdout: -1279> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004a7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.856 INFO:teuthology.orchestra.run.smithi045.stdout: -1278> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004a8 [2,head] /dc-dir/dc-file_691 auth v5384 s=3 n(v0 rc2023-10-03T19:17:06.631467+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535512100] 2023-10-03T19:21:14.856 INFO:teuthology.orchestra.run.smithi045.stdout: -1277> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004a8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.857 INFO:teuthology.orchestra.run.smithi045.stdout: -1276> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004a9 [2,head] /dc-dir/dc-file_692 auth v5386 s=3 n(v0 rc2023-10-03T19:17:06.642913+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535512680] 2023-10-03T19:21:14.857 INFO:teuthology.orchestra.run.smithi045.stdout: -1275> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004a9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.857 INFO:teuthology.orchestra.run.smithi045.stdout: -1274> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004aa [2,head] /dc-dir/dc-file_693 auth v5388 s=3 n(v0 rc2023-10-03T19:17:06.655025+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535512c00] 2023-10-03T19:21:14.857 INFO:teuthology.orchestra.run.smithi045.stdout: -1273> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004aa) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.858 INFO:teuthology.orchestra.run.smithi045.stdout: -1272> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ab [2,head] /dc-dir/dc-file_694 auth v5390 s=3 n(v0 rc2023-10-03T19:17:06.666298+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535513180] 2023-10-03T19:21:14.858 INFO:teuthology.orchestra.run.smithi045.stdout: -1271> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004ab) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.858 INFO:teuthology.orchestra.run.smithi045.stdout: -1270> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ac [2,head] /dc-dir/dc-file_695 auth v5392 s=3 n(v0 rc2023-10-03T19:17:06.679895+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535513700] 2023-10-03T19:21:14.858 INFO:teuthology.orchestra.run.smithi045.stdout: -1269> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004ac) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.858 INFO:teuthology.orchestra.run.smithi045.stdout: -1268> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ad [2,head] /dc-dir/dc-file_696 auth v5394 s=3 n(v0 rc2023-10-03T19:17:06.692128+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553552c000] 2023-10-03T19:21:14.858 INFO:teuthology.orchestra.run.smithi045.stdout: -1267> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004ad) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.859 INFO:teuthology.orchestra.run.smithi045.stdout: -1266> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ae [2,head] /dc-dir/dc-file_697 auth v5396 s=3 n(v0 rc2023-10-03T19:17:06.705256+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553552c580] 2023-10-03T19:21:14.859 INFO:teuthology.orchestra.run.smithi045.stdout: -1265> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004ae) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.859 INFO:teuthology.orchestra.run.smithi045.stdout: -1264> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004af [2,head] /dc-dir/dc-file_698 auth v5398 s=3 n(v0 rc2023-10-03T19:17:06.719122+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553552cb00] 2023-10-03T19:21:14.859 INFO:teuthology.orchestra.run.smithi045.stdout: -1263> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004af) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.859 INFO:teuthology.orchestra.run.smithi045.stdout: -1262> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004b0 [2,head] /dc-dir/dc-file_699 auth v5400 s=3 n(v0 rc2023-10-03T19:17:06.732056+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553552d080] 2023-10-03T19:21:14.859 INFO:teuthology.orchestra.run.smithi045.stdout: -1261> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004b0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.859 INFO:teuthology.orchestra.run.smithi045.stdout: -1260> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004b1 [2,head] /dc-dir/dc-file_700 auth v5402 s=3 n(v0 rc2023-10-03T19:17:06.743924+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553552d600] 2023-10-03T19:21:14.860 INFO:teuthology.orchestra.run.smithi045.stdout: -1259> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004b1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.860 INFO:teuthology.orchestra.run.smithi045.stdout: -1258> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004b2 [2,head] /dc-dir/dc-file_701 auth v5404 s=3 n(v0 rc2023-10-03T19:17:06.755770+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553552db80] 2023-10-03T19:21:14.860 INFO:teuthology.orchestra.run.smithi045.stdout: -1257> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004b2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.860 INFO:teuthology.orchestra.run.smithi045.stdout: -1256> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004b3 [2,head] /dc-dir/dc-file_702 auth v5406 s=3 n(v0 rc2023-10-03T19:17:06.767270+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553552e100] 2023-10-03T19:21:14.860 INFO:teuthology.orchestra.run.smithi045.stdout: -1255> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004b3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.860 INFO:teuthology.orchestra.run.smithi045.stdout: -1254> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004b4 [2,head] /dc-dir/dc-file_703 auth v5408 s=3 n(v0 rc2023-10-03T19:17:06.778997+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553552e680] 2023-10-03T19:21:14.860 INFO:teuthology.orchestra.run.smithi045.stdout: -1253> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004b4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.860 INFO:teuthology.orchestra.run.smithi045.stdout: -1252> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004b5 [2,head] /dc-dir/dc-file_704 auth v5410 s=3 n(v0 rc2023-10-03T19:17:06.790669+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553552ec00] 2023-10-03T19:21:14.861 INFO:teuthology.orchestra.run.smithi045.stdout: -1251> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004b5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.861 INFO:teuthology.orchestra.run.smithi045.stdout: -1250> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004b6 [2,head] /dc-dir/dc-file_705 auth v5412 s=3 n(v0 rc2023-10-03T19:17:06.802577+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553552f180] 2023-10-03T19:21:14.861 INFO:teuthology.orchestra.run.smithi045.stdout: -1249> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004b6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.861 INFO:teuthology.orchestra.run.smithi045.stdout: -1248> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004b7 [2,head] /dc-dir/dc-file_706 auth v5414 s=3 n(v0 rc2023-10-03T19:17:06.814410+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553552f700] 2023-10-03T19:21:14.861 INFO:teuthology.orchestra.run.smithi045.stdout: -1247> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004b7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.861 INFO:teuthology.orchestra.run.smithi045.stdout: -1246> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004b8 [2,head] /dc-dir/dc-file_707 auth v5416 s=3 n(v0 rc2023-10-03T19:17:06.825821+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553558a000] 2023-10-03T19:21:14.861 INFO:teuthology.orchestra.run.smithi045.stdout: -1245> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004b8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.862 INFO:teuthology.orchestra.run.smithi045.stdout: -1244> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004b9 [2,head] /dc-dir/dc-file_708 auth v5418 s=3 n(v0 rc2023-10-03T19:17:06.837158+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553558a580] 2023-10-03T19:21:14.862 INFO:teuthology.orchestra.run.smithi045.stdout: -1243> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004b9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.907 INFO:teuthology.orchestra.run.smithi045.stdout: -1242> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ba [2,head] /dc-dir/dc-file_709 auth v5420 s=3 n(v0 rc2023-10-03T19:17:06.848383+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553558ab00] 2023-10-03T19:21:14.907 INFO:teuthology.orchestra.run.smithi045.stdout: -1241> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004ba) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.908 INFO:teuthology.orchestra.run.smithi045.stdout: -1240> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004bb [2,head] /dc-dir/dc-file_710 auth v5422 s=3 n(v0 rc2023-10-03T19:17:06.861455+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553558b080] 2023-10-03T19:21:14.908 INFO:teuthology.orchestra.run.smithi045.stdout: -1239> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004bb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.908 INFO:teuthology.orchestra.run.smithi045.stdout: -1238> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004bc [2,head] /dc-dir/dc-file_711 auth v5424 s=3 n(v0 rc2023-10-03T19:17:06.872303+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553558b600] 2023-10-03T19:21:14.908 INFO:teuthology.orchestra.run.smithi045.stdout: -1237> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004bc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.908 INFO:teuthology.orchestra.run.smithi045.stdout: -1236> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004bd [2,head] /dc-dir/dc-file_712 auth v5426 s=3 n(v0 rc2023-10-03T19:17:06.883783+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553558bb80] 2023-10-03T19:21:14.909 INFO:teuthology.orchestra.run.smithi045.stdout: -1235> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004bd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.909 INFO:teuthology.orchestra.run.smithi045.stdout: -1234> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004be [2,head] /dc-dir/dc-file_713 auth v5428 s=3 n(v0 rc2023-10-03T19:17:06.894966+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553558c100] 2023-10-03T19:21:14.909 INFO:teuthology.orchestra.run.smithi045.stdout: -1233> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004be) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.909 INFO:teuthology.orchestra.run.smithi045.stdout: -1232> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004bf [2,head] /dc-dir/dc-file_714 auth v5430 s=3 n(v0 rc2023-10-03T19:17:06.906213+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553558c680] 2023-10-03T19:21:14.909 INFO:teuthology.orchestra.run.smithi045.stdout: -1231> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004bf) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.909 INFO:teuthology.orchestra.run.smithi045.stdout: -1230> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004c0 [2,head] /dc-dir/dc-file_715 auth v5432 s=3 n(v0 rc2023-10-03T19:17:06.917924+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553558cc00] 2023-10-03T19:21:14.910 INFO:teuthology.orchestra.run.smithi045.stdout: -1229> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004c0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.910 INFO:teuthology.orchestra.run.smithi045.stdout: -1228> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004c1 [2,head] /dc-dir/dc-file_716 auth v5434 s=3 n(v0 rc2023-10-03T19:17:06.929521+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553558d180] 2023-10-03T19:21:14.910 INFO:teuthology.orchestra.run.smithi045.stdout: -1227> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004c1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.910 INFO:teuthology.orchestra.run.smithi045.stdout: -1226> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004c2 [2,head] /dc-dir/dc-file_717 auth v5436 s=3 n(v0 rc2023-10-03T19:17:06.940786+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553558d700] 2023-10-03T19:21:14.910 INFO:teuthology.orchestra.run.smithi045.stdout: -1225> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004c2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.910 INFO:teuthology.orchestra.run.smithi045.stdout: -1224> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004c3 [2,head] /dc-dir/dc-file_718 auth v5438 s=3 n(v0 rc2023-10-03T19:17:06.952246+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553558e000] 2023-10-03T19:21:14.910 INFO:teuthology.orchestra.run.smithi045.stdout: -1223> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004c3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.910 INFO:teuthology.orchestra.run.smithi045.stdout: -1222> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004c4 [2,head] /dc-dir/dc-file_719 auth v5440 s=3 n(v0 rc2023-10-03T19:17:06.963452+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553558e580] 2023-10-03T19:21:14.911 INFO:teuthology.orchestra.run.smithi045.stdout: -1221> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004c4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.911 INFO:teuthology.orchestra.run.smithi045.stdout: -1220> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004c5 [2,head] /dc-dir/dc-file_720 auth v5442 s=3 n(v0 rc2023-10-03T19:17:06.975146+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553558eb00] 2023-10-03T19:21:14.911 INFO:teuthology.orchestra.run.smithi045.stdout: -1219> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004c5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.911 INFO:teuthology.orchestra.run.smithi045.stdout: -1218> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004c6 [2,head] /dc-dir/dc-file_721 auth v5444 s=3 n(v0 rc2023-10-03T19:17:06.986523+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553558f080] 2023-10-03T19:21:14.911 INFO:teuthology.orchestra.run.smithi045.stdout: -1217> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004c6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.912 INFO:teuthology.orchestra.run.smithi045.stdout: -1216> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004c7 [2,head] /dc-dir/dc-file_722 auth v5446 s=3 n(v0 rc2023-10-03T19:17:06.998501+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553558f600] 2023-10-03T19:21:14.912 INFO:teuthology.orchestra.run.smithi045.stdout: -1215> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004c7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.912 INFO:teuthology.orchestra.run.smithi045.stdout: -1214> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004c8 [2,head] /dc-dir/dc-file_723 auth v5448 s=3 n(v0 rc2023-10-03T19:17:07.010298+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553558fb80] 2023-10-03T19:21:14.912 INFO:teuthology.orchestra.run.smithi045.stdout: -1213> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004c8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.912 INFO:teuthology.orchestra.run.smithi045.stdout: -1212> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004c9 [2,head] /dc-dir/dc-file_724 auth v5450 s=3 n(v0 rc2023-10-03T19:17:07.021776+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535590100] 2023-10-03T19:21:14.912 INFO:teuthology.orchestra.run.smithi045.stdout: -1211> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004c9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.912 INFO:teuthology.orchestra.run.smithi045.stdout: -1210> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ca [2,head] /dc-dir/dc-file_725 auth v5452 s=3 n(v0 rc2023-10-03T19:17:07.033456+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535590680] 2023-10-03T19:21:14.912 INFO:teuthology.orchestra.run.smithi045.stdout: -1209> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004ca) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.912 INFO:teuthology.orchestra.run.smithi045.stdout: -1208> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004cb [2,head] /dc-dir/dc-file_726 auth v5454 s=3 n(v0 rc2023-10-03T19:17:07.044907+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535590c00] 2023-10-03T19:21:14.912 INFO:teuthology.orchestra.run.smithi045.stdout: -1207> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004cb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.912 INFO:teuthology.orchestra.run.smithi045.stdout: -1206> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004cc [2,head] /dc-dir/dc-file_727 auth v5456 s=3 n(v0 rc2023-10-03T19:17:07.056271+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535591180] 2023-10-03T19:21:14.913 INFO:teuthology.orchestra.run.smithi045.stdout: -1205> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004cc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.913 INFO:teuthology.orchestra.run.smithi045.stdout: -1204> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004cd [2,head] /dc-dir/dc-file_728 auth v5458 s=3 n(v0 rc2023-10-03T19:17:07.067378+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535591700] 2023-10-03T19:21:14.913 INFO:teuthology.orchestra.run.smithi045.stdout: -1203> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004cd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.913 INFO:teuthology.orchestra.run.smithi045.stdout: -1202> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ce [2,head] /dc-dir/dc-file_729 auth v5460 s=3 n(v0 rc2023-10-03T19:17:07.078726+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535598000] 2023-10-03T19:21:14.913 INFO:teuthology.orchestra.run.smithi045.stdout: -1201> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004ce) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.913 INFO:teuthology.orchestra.run.smithi045.stdout: -1200> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004cf [2,head] /dc-dir/dc-file_730 auth v5462 s=3 n(v0 rc2023-10-03T19:17:07.089686+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535598580] 2023-10-03T19:21:14.913 INFO:teuthology.orchestra.run.smithi045.stdout: -1199> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004cf) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.913 INFO:teuthology.orchestra.run.smithi045.stdout: -1198> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004d0 [2,head] /dc-dir/dc-file_731 auth v5464 s=3 n(v0 rc2023-10-03T19:17:07.100778+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535598b00] 2023-10-03T19:21:14.913 INFO:teuthology.orchestra.run.smithi045.stdout: -1197> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004d0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.913 INFO:teuthology.orchestra.run.smithi045.stdout: -1196> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004d1 [2,head] /dc-dir/dc-file_732 auth v5466 s=3 n(v0 rc2023-10-03T19:17:07.112327+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535599080] 2023-10-03T19:21:14.913 INFO:teuthology.orchestra.run.smithi045.stdout: -1195> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004d1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.914 INFO:teuthology.orchestra.run.smithi045.stdout: -1194> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004d2 [2,head] /dc-dir/dc-file_733 auth v5468 s=3 n(v0 rc2023-10-03T19:17:07.124923+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535599600] 2023-10-03T19:21:14.914 INFO:teuthology.orchestra.run.smithi045.stdout: -1193> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004d2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:14.914 INFO:teuthology.orchestra.run.smithi045.stdout: -1192> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004d3 [2,head] /dc-dir/dc-file_734 auth v5470 s=3 n(v0 rc2023-10-03T19:17:07.137100+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535599b80] 2023-10-03T19:21:14.914 INFO:teuthology.orchestra.run.smithi045.stdout: -1191> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004d3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.003 INFO:teuthology.orchestra.run.smithi045.stdout: -1190> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004d4 [2,head] /dc-dir/dc-file_735 auth v5472 s=3 n(v0 rc2023-10-03T19:17:07.148084+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553559a100] 2023-10-03T19:21:15.003 INFO:teuthology.orchestra.run.smithi045.stdout: -1189> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004d4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.003 INFO:teuthology.orchestra.run.smithi045.stdout: -1188> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004d5 [2,head] /dc-dir/dc-file_736 auth v5474 s=3 n(v0 rc2023-10-03T19:17:07.159786+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553559a680] 2023-10-03T19:21:15.003 INFO:teuthology.orchestra.run.smithi045.stdout: -1187> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004d5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.003 INFO:teuthology.orchestra.run.smithi045.stdout: -1186> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004d6 [2,head] /dc-dir/dc-file_737 auth v5476 s=3 n(v0 rc2023-10-03T19:17:07.171785+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553559ac00] 2023-10-03T19:21:15.004 INFO:teuthology.orchestra.run.smithi045.stdout: -1185> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004d6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.004 INFO:teuthology.orchestra.run.smithi045.stdout: -1184> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004d7 [2,head] /dc-dir/dc-file_738 auth v5478 s=3 n(v0 rc2023-10-03T19:17:07.183976+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553559b180] 2023-10-03T19:21:15.004 INFO:teuthology.orchestra.run.smithi045.stdout: -1183> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004d7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.004 INFO:teuthology.orchestra.run.smithi045.stdout: -1182> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004d8 [2,head] /dc-dir/dc-file_739 auth v5480 s=3 n(v0 rc2023-10-03T19:17:07.196200+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553559b700] 2023-10-03T19:21:15.004 INFO:teuthology.orchestra.run.smithi045.stdout: -1181> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004d8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.005 INFO:teuthology.orchestra.run.smithi045.stdout: -1180> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004d9 [2,head] /dc-dir/dc-file_740 auth v5482 s=3 n(v0 rc2023-10-03T19:17:07.207817+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355a0000] 2023-10-03T19:21:15.005 INFO:teuthology.orchestra.run.smithi045.stdout: -1179> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004d9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.005 INFO:teuthology.orchestra.run.smithi045.stdout: -1178> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004da [2,head] /dc-dir/dc-file_741 auth v5484 s=3 n(v0 rc2023-10-03T19:17:07.220227+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355a0580] 2023-10-03T19:21:15.005 INFO:teuthology.orchestra.run.smithi045.stdout: -1177> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004da) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.005 INFO:teuthology.orchestra.run.smithi045.stdout: -1176> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004db [2,head] /dc-dir/dc-file_742 auth v5486 s=3 n(v0 rc2023-10-03T19:17:07.231789+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355a0b00] 2023-10-03T19:21:15.005 INFO:teuthology.orchestra.run.smithi045.stdout: -1175> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004db) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.006 INFO:teuthology.orchestra.run.smithi045.stdout: -1174> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004dc [2,head] /dc-dir/dc-file_743 auth v5488 s=3 n(v0 rc2023-10-03T19:17:07.243296+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355a1080] 2023-10-03T19:21:15.006 INFO:teuthology.orchestra.run.smithi045.stdout: -1173> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004dc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.006 INFO:teuthology.orchestra.run.smithi045.stdout: -1172> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004dd [2,head] /dc-dir/dc-file_744 auth v5490 s=3 n(v0 rc2023-10-03T19:17:07.255369+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355a1600] 2023-10-03T19:21:15.006 INFO:teuthology.orchestra.run.smithi045.stdout: -1171> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004dd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.006 INFO:teuthology.orchestra.run.smithi045.stdout: -1170> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004de [2,head] /dc-dir/dc-file_745 auth v5492 s=3 n(v0 rc2023-10-03T19:17:07.268100+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355a1b80] 2023-10-03T19:21:15.006 INFO:teuthology.orchestra.run.smithi045.stdout: -1169> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004de) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.006 INFO:teuthology.orchestra.run.smithi045.stdout: -1168> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004df [2,head] /dc-dir/dc-file_746 auth v5494 s=3 n(v0 rc2023-10-03T19:17:07.280107+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355a2100] 2023-10-03T19:21:15.006 INFO:teuthology.orchestra.run.smithi045.stdout: -1167> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004df) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.007 INFO:teuthology.orchestra.run.smithi045.stdout: -1166> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004e0 [2,head] /dc-dir/dc-file_747 auth v5496 s=3 n(v0 rc2023-10-03T19:17:07.291779+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355a2680] 2023-10-03T19:21:15.007 INFO:teuthology.orchestra.run.smithi045.stdout: -1165> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004e0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.007 INFO:teuthology.orchestra.run.smithi045.stdout: -1164> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004e1 [2,head] /dc-dir/dc-file_748 auth v5498 s=3 n(v0 rc2023-10-03T19:17:07.303868+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355a2c00] 2023-10-03T19:21:15.007 INFO:teuthology.orchestra.run.smithi045.stdout: -1163> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004e1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.007 INFO:teuthology.orchestra.run.smithi045.stdout: -1162> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004e2 [2,head] /dc-dir/dc-file_749 auth v5500 s=3 n(v0 rc2023-10-03T19:17:07.315846+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355a3180] 2023-10-03T19:21:15.007 INFO:teuthology.orchestra.run.smithi045.stdout: -1161> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004e2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.007 INFO:teuthology.orchestra.run.smithi045.stdout: -1160> 2023-10-03T19:17:19.582+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 82 ==== osd_op_reply(2070 10000000004.00000000 [delete] v63'33 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:15.008 INFO:teuthology.orchestra.run.smithi045.stdout: -1159> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004e3 [2,head] /dc-dir/dc-file_750 auth v5502 s=3 n(v0 rc2023-10-03T19:17:07.328356+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355a3700] 2023-10-03T19:21:15.008 INFO:teuthology.orchestra.run.smithi045.stdout: -1158> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004e3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.008 INFO:teuthology.orchestra.run.smithi045.stdout: -1157> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004e4 [2,head] /dc-dir/dc-file_751 auth v5504 s=3 n(v0 rc2023-10-03T19:17:07.340385+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355aa000] 2023-10-03T19:21:15.008 INFO:teuthology.orchestra.run.smithi045.stdout: -1156> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004e4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.008 INFO:teuthology.orchestra.run.smithi045.stdout: -1155> 2023-10-03T19:17:19.582+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004e5 [2,head] /dc-dir/dc-file_752 auth v5506 s=3 n(v0 rc2023-10-03T19:17:07.351829+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355aa580] 2023-10-03T19:21:15.008 INFO:teuthology.orchestra.run.smithi045.stdout: -1154> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004e5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.008 INFO:teuthology.orchestra.run.smithi045.stdout: -1153> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004e6 [2,head] /dc-dir/dc-file_753 auth v5508 s=3 n(v0 rc2023-10-03T19:17:07.363202+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355aab00] 2023-10-03T19:21:15.009 INFO:teuthology.orchestra.run.smithi045.stdout: -1152> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004e6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.009 INFO:teuthology.orchestra.run.smithi045.stdout: -1151> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004e7 [2,head] /dc-dir/dc-file_754 auth v5510 s=3 n(v0 rc2023-10-03T19:17:07.375563+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355ab080] 2023-10-03T19:21:15.009 INFO:teuthology.orchestra.run.smithi045.stdout: -1150> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004e7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.009 INFO:teuthology.orchestra.run.smithi045.stdout: -1149> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004e8 [2,head] /dc-dir/dc-file_755 auth v5512 s=3 n(v0 rc2023-10-03T19:17:07.387063+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355ab600] 2023-10-03T19:21:15.009 INFO:teuthology.orchestra.run.smithi045.stdout: -1148> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004e8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.009 INFO:teuthology.orchestra.run.smithi045.stdout: -1147> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004e9 [2,head] /dc-dir/dc-file_756 auth v5514 s=3 n(v0 rc2023-10-03T19:17:07.398916+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355abb80] 2023-10-03T19:21:15.009 INFO:teuthology.orchestra.run.smithi045.stdout: -1146> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004e9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.009 INFO:teuthology.orchestra.run.smithi045.stdout: -1145> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ea [2,head] /dc-dir/dc-file_757 auth v5516 s=3 n(v0 rc2023-10-03T19:17:07.410684+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355ac100] 2023-10-03T19:21:15.009 INFO:teuthology.orchestra.run.smithi045.stdout: -1144> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004ea) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.009 INFO:teuthology.orchestra.run.smithi045.stdout: -1143> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004eb [2,head] /dc-dir/dc-file_758 auth v5518 s=3 n(v0 rc2023-10-03T19:17:07.422537+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355ac680] 2023-10-03T19:21:15.010 INFO:teuthology.orchestra.run.smithi045.stdout: -1142> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004eb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.010 INFO:teuthology.orchestra.run.smithi045.stdout: -1141> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ec [2,head] /dc-dir/dc-file_759 auth v5520 s=3 n(v0 rc2023-10-03T19:17:07.434519+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355acc00] 2023-10-03T19:21:15.010 INFO:teuthology.orchestra.run.smithi045.stdout: -1140> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004ec) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.010 INFO:teuthology.orchestra.run.smithi045.stdout: -1139> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ed [2,head] /dc-dir/dc-file_760 auth v5522 s=3 n(v0 rc2023-10-03T19:17:07.445770+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355ad180] 2023-10-03T19:21:15.010 INFO:teuthology.orchestra.run.smithi045.stdout: -1138> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004ed) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.010 INFO:teuthology.orchestra.run.smithi045.stdout: -1137> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ee [2,head] /dc-dir/dc-file_761 auth v5524 s=3 n(v0 rc2023-10-03T19:17:07.457878+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355ad700] 2023-10-03T19:21:15.010 INFO:teuthology.orchestra.run.smithi045.stdout: -1136> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004ee) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.010 INFO:teuthology.orchestra.run.smithi045.stdout: -1135> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ef [2,head] /dc-dir/dc-file_762 auth v5526 s=3 n(v0 rc2023-10-03T19:17:07.469579+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355b6000] 2023-10-03T19:21:15.010 INFO:teuthology.orchestra.run.smithi045.stdout: -1134> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004ef) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.010 INFO:teuthology.orchestra.run.smithi045.stdout: -1133> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004f0 [2,head] /dc-dir/dc-file_763 auth v5528 s=3 n(v0 rc2023-10-03T19:17:07.480920+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355b6580] 2023-10-03T19:21:15.011 INFO:teuthology.orchestra.run.smithi045.stdout: -1132> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004f0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.011 INFO:teuthology.orchestra.run.smithi045.stdout: -1131> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004f1 [2,head] /dc-dir/dc-file_764 auth v5530 s=3 n(v0 rc2023-10-03T19:17:07.492161+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355b6b00] 2023-10-03T19:21:15.011 INFO:teuthology.orchestra.run.smithi045.stdout: -1130> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004f1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.011 INFO:teuthology.orchestra.run.smithi045.stdout: -1129> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004f2 [2,head] /dc-dir/dc-file_765 auth v5532 s=3 n(v0 rc2023-10-03T19:17:07.598273+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355b7080] 2023-10-03T19:21:15.049 INFO:teuthology.orchestra.run.smithi045.stdout: -1128> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004f2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.049 INFO:teuthology.orchestra.run.smithi045.stdout: -1127> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004f3 [2,head] /dc-dir/dc-file_766 auth v5534 s=3 n(v0 rc2023-10-03T19:17:07.645155+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355b7600] 2023-10-03T19:21:15.050 INFO:teuthology.orchestra.run.smithi045.stdout: -1126> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004f3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.050 INFO:teuthology.orchestra.run.smithi045.stdout: -1125> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004f4 [2,head] /dc-dir/dc-file_767 auth v5536 s=3 n(v0 rc2023-10-03T19:17:07.657443+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355b7b80] 2023-10-03T19:21:15.050 INFO:teuthology.orchestra.run.smithi045.stdout: -1124> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004f4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.050 INFO:teuthology.orchestra.run.smithi045.stdout: -1123> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004f5 [2,head] /dc-dir/dc-file_768 auth v5538 s=3 n(v0 rc2023-10-03T19:17:07.670464+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355b8100] 2023-10-03T19:21:15.050 INFO:teuthology.orchestra.run.smithi045.stdout: -1122> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004f5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.050 INFO:teuthology.orchestra.run.smithi045.stdout: -1121> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004f6 [2,head] /dc-dir/dc-file_769 auth v5540 s=3 n(v0 rc2023-10-03T19:17:07.682542+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355b8680] 2023-10-03T19:21:15.050 INFO:teuthology.orchestra.run.smithi045.stdout: -1120> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004f6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.050 INFO:teuthology.orchestra.run.smithi045.stdout: -1119> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004f7 [2,head] /dc-dir/dc-file_770 auth v5542 s=3 n(v0 rc2023-10-03T19:17:07.694417+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355b8c00] 2023-10-03T19:21:15.050 INFO:teuthology.orchestra.run.smithi045.stdout: -1118> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004f7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.050 INFO:teuthology.orchestra.run.smithi045.stdout: -1117> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004f8 [2,head] /dc-dir/dc-file_771 auth v5544 s=3 n(v0 rc2023-10-03T19:17:07.706236+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355b9180] 2023-10-03T19:21:15.051 INFO:teuthology.orchestra.run.smithi045.stdout: -1116> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004f8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.051 INFO:teuthology.orchestra.run.smithi045.stdout: -1115> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004f9 [2,head] /dc-dir/dc-file_772 auth v5546 s=3 n(v0 rc2023-10-03T19:17:07.717415+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355b9700] 2023-10-03T19:21:15.051 INFO:teuthology.orchestra.run.smithi045.stdout: -1114> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004f9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.051 INFO:teuthology.orchestra.run.smithi045.stdout: -1113> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004fa [2,head] /dc-dir/dc-file_773 auth v5548 s=3 n(v0 rc2023-10-03T19:17:07.729239+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355e4000] 2023-10-03T19:21:15.051 INFO:teuthology.orchestra.run.smithi045.stdout: -1112> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004fa) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.051 INFO:teuthology.orchestra.run.smithi045.stdout: -1111> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004fb [2,head] /dc-dir/dc-file_774 auth v5550 s=3 n(v0 rc2023-10-03T19:17:07.740646+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355e4580] 2023-10-03T19:21:15.051 INFO:teuthology.orchestra.run.smithi045.stdout: -1110> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004fb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.051 INFO:teuthology.orchestra.run.smithi045.stdout: -1109> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004fc [2,head] /dc-dir/dc-file_775 auth v5552 s=3 n(v0 rc2023-10-03T19:17:07.751993+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355e4b00] 2023-10-03T19:21:15.051 INFO:teuthology.orchestra.run.smithi045.stdout: -1108> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004fc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.051 INFO:teuthology.orchestra.run.smithi045.stdout: -1107> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004fd [2,head] /dc-dir/dc-file_776 auth v5554 s=3 n(v0 rc2023-10-03T19:17:07.763548+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355e5080] 2023-10-03T19:21:15.052 INFO:teuthology.orchestra.run.smithi045.stdout: -1106> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004fd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.052 INFO:teuthology.orchestra.run.smithi045.stdout: -1105> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004fe [2,head] /dc-dir/dc-file_777 auth v5556 s=3 n(v0 rc2023-10-03T19:17:07.776765+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355e5600] 2023-10-03T19:21:15.052 INFO:teuthology.orchestra.run.smithi045.stdout: -1104> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004fe) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.052 INFO:teuthology.orchestra.run.smithi045.stdout: -1103> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ff [2,head] /dc-dir/dc-file_778 auth v5558 s=3 n(v0 rc2023-10-03T19:17:07.789492+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355e5b80] 2023-10-03T19:21:15.052 INFO:teuthology.orchestra.run.smithi045.stdout: -1102> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000004ff) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.052 INFO:teuthology.orchestra.run.smithi045.stdout: -1101> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000500 [2,head] /dc-dir/dc-file_779 auth v5560 s=3 n(v0 rc2023-10-03T19:17:07.801381+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355e6100] 2023-10-03T19:21:15.052 INFO:teuthology.orchestra.run.smithi045.stdout: -1100> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000500) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.052 INFO:teuthology.orchestra.run.smithi045.stdout: -1099> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000501 [2,head] /dc-dir/dc-file_780 auth v5562 s=3 n(v0 rc2023-10-03T19:17:07.813584+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355e6680] 2023-10-03T19:21:15.052 INFO:teuthology.orchestra.run.smithi045.stdout: -1098> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000501) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.052 INFO:teuthology.orchestra.run.smithi045.stdout: -1097> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000502 [2,head] /dc-dir/dc-file_781 auth v5564 s=3 n(v0 rc2023-10-03T19:17:07.825570+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355e6c00] 2023-10-03T19:21:15.052 INFO:teuthology.orchestra.run.smithi045.stdout: -1096> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000502) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.052 INFO:teuthology.orchestra.run.smithi045.stdout: -1095> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000503 [2,head] /dc-dir/dc-file_782 auth v5566 s=3 n(v0 rc2023-10-03T19:17:07.837164+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355e7180] 2023-10-03T19:21:15.053 INFO:teuthology.orchestra.run.smithi045.stdout: -1094> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000503) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.053 INFO:teuthology.orchestra.run.smithi045.stdout: -1093> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000504 [2,head] /dc-dir/dc-file_783 auth v5568 s=3 n(v0 rc2023-10-03T19:17:07.848940+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355e7700] 2023-10-03T19:21:15.053 INFO:teuthology.orchestra.run.smithi045.stdout: -1092> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000504) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.053 INFO:teuthology.orchestra.run.smithi045.stdout: -1091> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000505 [2,head] /dc-dir/dc-file_784 auth v5570 s=3 n(v0 rc2023-10-03T19:17:07.861717+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355f2000] 2023-10-03T19:21:15.053 INFO:teuthology.orchestra.run.smithi045.stdout: -1090> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000505) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.053 INFO:teuthology.orchestra.run.smithi045.stdout: -1089> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000506 [2,head] /dc-dir/dc-file_785 auth v5572 s=3 n(v0 rc2023-10-03T19:17:07.874039+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355f2580] 2023-10-03T19:21:15.053 INFO:teuthology.orchestra.run.smithi045.stdout: -1088> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000506) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.053 INFO:teuthology.orchestra.run.smithi045.stdout: -1087> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000507 [2,head] /dc-dir/dc-file_786 auth v5574 s=3 n(v0 rc2023-10-03T19:17:07.885522+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355f2b00] 2023-10-03T19:21:15.053 INFO:teuthology.orchestra.run.smithi045.stdout: -1086> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000507) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.053 INFO:teuthology.orchestra.run.smithi045.stdout: -1085> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000508 [2,head] /dc-dir/dc-file_787 auth v5576 s=3 n(v0 rc2023-10-03T19:17:07.897902+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355f3080] 2023-10-03T19:21:15.053 INFO:teuthology.orchestra.run.smithi045.stdout: -1084> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000508) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.054 INFO:teuthology.orchestra.run.smithi045.stdout: -1083> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000509 [2,head] /dc-dir/dc-file_788 auth v5578 s=3 n(v0 rc2023-10-03T19:17:07.909430+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355f3600] 2023-10-03T19:21:15.054 INFO:teuthology.orchestra.run.smithi045.stdout: -1082> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000509) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.054 INFO:teuthology.orchestra.run.smithi045.stdout: -1081> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000050a [2,head] /dc-dir/dc-file_789 auth v5580 s=3 n(v0 rc2023-10-03T19:17:07.920872+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355f3b80] 2023-10-03T19:21:15.054 INFO:teuthology.orchestra.run.smithi045.stdout: -1080> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000050a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.054 INFO:teuthology.orchestra.run.smithi045.stdout: -1079> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000050b [2,head] /dc-dir/dc-file_790 auth v5582 s=3 n(v0 rc2023-10-03T19:17:07.933167+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355f4100] 2023-10-03T19:21:15.059 INFO:teuthology.orchestra.run.smithi045.stdout: -1078> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000050b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.059 INFO:teuthology.orchestra.run.smithi045.stdout: -1077> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000050c [2,head] /dc-dir/dc-file_791 auth v5584 s=3 n(v0 rc2023-10-03T19:17:07.944476+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355f4680] 2023-10-03T19:21:15.059 INFO:teuthology.orchestra.run.smithi045.stdout: -1076> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000050c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.059 INFO:teuthology.orchestra.run.smithi045.stdout: -1075> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000050d [2,head] /dc-dir/dc-file_792 auth v5586 s=3 n(v0 rc2023-10-03T19:17:07.956798+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355f4c00] 2023-10-03T19:21:15.059 INFO:teuthology.orchestra.run.smithi045.stdout: -1074> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000050d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.059 INFO:teuthology.orchestra.run.smithi045.stdout: -1073> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000050e [2,head] /dc-dir/dc-file_793 auth v5588 s=3 n(v0 rc2023-10-03T19:17:07.968684+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355f5180] 2023-10-03T19:21:15.059 INFO:teuthology.orchestra.run.smithi045.stdout: -1072> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000050e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.060 INFO:teuthology.orchestra.run.smithi045.stdout: -1071> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000050f [2,head] /dc-dir/dc-file_794 auth v5590 s=3 n(v0 rc2023-10-03T19:17:07.980394+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355f5700] 2023-10-03T19:21:15.060 INFO:teuthology.orchestra.run.smithi045.stdout: -1070> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000050f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.060 INFO:teuthology.orchestra.run.smithi045.stdout: -1069> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000510 [2,head] /dc-dir/dc-file_795 auth v5592 s=3 n(v0 rc2023-10-03T19:17:07.992563+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355f8000] 2023-10-03T19:21:15.060 INFO:teuthology.orchestra.run.smithi045.stdout: -1068> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000510) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.137 INFO:teuthology.orchestra.run.smithi045.stdout: -1067> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000511 [2,head] /dc-dir/dc-file_796 auth v5594 s=3 n(v0 rc2023-10-03T19:17:08.005519+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355f8580] 2023-10-03T19:21:15.137 INFO:teuthology.orchestra.run.smithi045.stdout: -1066> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000511) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.137 INFO:teuthology.orchestra.run.smithi045.stdout: -1065> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000512 [2,head] /dc-dir/dc-file_797 auth v5596 s=3 n(v0 rc2023-10-03T19:17:08.019036+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355f8b00] 2023-10-03T19:21:15.137 INFO:teuthology.orchestra.run.smithi045.stdout: -1064> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000512) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.137 INFO:teuthology.orchestra.run.smithi045.stdout: -1063> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000513 [2,head] /dc-dir/dc-file_798 auth v5598 s=3 n(v0 rc2023-10-03T19:17:08.030555+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355f9080] 2023-10-03T19:21:15.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1062> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000513) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1061> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000514 [2,head] /dc-dir/dc-file_799 auth v5600 s=3 n(v0 rc2023-10-03T19:17:08.042012+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355f9600] 2023-10-03T19:21:15.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1060> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000514) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1059> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000515 [2,head] /dc-dir/dc-file_800 auth v5602 s=3 n(v0 rc2023-10-03T19:17:08.053240+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355f9b80] 2023-10-03T19:21:15.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1058> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000515) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1057> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000516 [2,head] /dc-dir/dc-file_801 auth v5604 s=3 n(v0 rc2023-10-03T19:17:08.064696+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355fa100] 2023-10-03T19:21:15.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1056> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000516) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1055> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000517 [2,head] /dc-dir/dc-file_802 auth v5606 s=3 n(v0 rc2023-10-03T19:17:08.076101+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355fa680] 2023-10-03T19:21:15.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1054> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000517) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.139 INFO:teuthology.orchestra.run.smithi045.stdout: -1053> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000518 [2,head] /dc-dir/dc-file_803 auth v5608 s=3 n(v0 rc2023-10-03T19:17:08.089527+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355fac00] 2023-10-03T19:21:15.139 INFO:teuthology.orchestra.run.smithi045.stdout: -1052> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000518) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.139 INFO:teuthology.orchestra.run.smithi045.stdout: -1051> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000519 [2,head] /dc-dir/dc-file_804 auth v5610 s=3 n(v0 rc2023-10-03T19:17:08.101210+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355fb180] 2023-10-03T19:21:15.139 INFO:teuthology.orchestra.run.smithi045.stdout: -1050> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000519) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.139 INFO:teuthology.orchestra.run.smithi045.stdout: -1049> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000051a [2,head] /dc-dir/dc-file_805 auth v5612 s=3 n(v0 rc2023-10-03T19:17:08.112672+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655355fb700] 2023-10-03T19:21:15.139 INFO:teuthology.orchestra.run.smithi045.stdout: -1048> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000051a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.139 INFO:teuthology.orchestra.run.smithi045.stdout: -1047> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000051b [2,head] /dc-dir/dc-file_806 auth v5614 s=3 n(v0 rc2023-10-03T19:17:08.124181+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535608000] 2023-10-03T19:21:15.139 INFO:teuthology.orchestra.run.smithi045.stdout: -1046> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000051b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.139 INFO:teuthology.orchestra.run.smithi045.stdout: -1045> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000051c [2,head] /dc-dir/dc-file_807 auth v5616 s=3 n(v0 rc2023-10-03T19:17:08.135495+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535608580] 2023-10-03T19:21:15.139 INFO:teuthology.orchestra.run.smithi045.stdout: -1044> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000051c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.139 INFO:teuthology.orchestra.run.smithi045.stdout: -1043> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000051d [2,head] /dc-dir/dc-file_808 auth v5618 s=3 n(v0 rc2023-10-03T19:17:08.146973+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535608b00] 2023-10-03T19:21:15.139 INFO:teuthology.orchestra.run.smithi045.stdout: -1042> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000051d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.140 INFO:teuthology.orchestra.run.smithi045.stdout: -1041> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000051e [2,head] /dc-dir/dc-file_809 auth v5620 s=3 n(v0 rc2023-10-03T19:17:08.158332+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535609080] 2023-10-03T19:21:15.140 INFO:teuthology.orchestra.run.smithi045.stdout: -1040> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000051e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.140 INFO:teuthology.orchestra.run.smithi045.stdout: -1039> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000051f [2,head] /dc-dir/dc-file_810 auth v5622 s=3 n(v0 rc2023-10-03T19:17:08.170002+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535609600] 2023-10-03T19:21:15.140 INFO:teuthology.orchestra.run.smithi045.stdout: -1038> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000051f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.140 INFO:teuthology.orchestra.run.smithi045.stdout: -1037> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000520 [2,head] /dc-dir/dc-file_811 auth v5624 s=3 n(v0 rc2023-10-03T19:17:08.181641+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535609b80] 2023-10-03T19:21:15.140 INFO:teuthology.orchestra.run.smithi045.stdout: -1036> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000520) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.141 INFO:teuthology.orchestra.run.smithi045.stdout: -1035> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000521 [2,head] /dc-dir/dc-file_812 auth v5626 s=3 n(v0 rc2023-10-03T19:17:08.193974+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553560a100] 2023-10-03T19:21:15.141 INFO:teuthology.orchestra.run.smithi045.stdout: -1034> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000521) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.141 INFO:teuthology.orchestra.run.smithi045.stdout: -1033> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000522 [2,head] /dc-dir/dc-file_813 auth v5628 s=3 n(v0 rc2023-10-03T19:17:08.205686+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553560a680] 2023-10-03T19:21:15.141 INFO:teuthology.orchestra.run.smithi045.stdout: -1032> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000522) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.141 INFO:teuthology.orchestra.run.smithi045.stdout: -1031> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000523 [2,head] /dc-dir/dc-file_814 auth v5630 s=3 n(v0 rc2023-10-03T19:17:08.217390+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553560ac00] 2023-10-03T19:21:15.142 INFO:teuthology.orchestra.run.smithi045.stdout: -1030> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000523) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.142 INFO:teuthology.orchestra.run.smithi045.stdout: -1029> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000524 [2,head] /dc-dir/dc-file_815 auth v5632 s=3 n(v0 rc2023-10-03T19:17:08.228899+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553560b180] 2023-10-03T19:21:15.142 INFO:teuthology.orchestra.run.smithi045.stdout: -1028> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000524) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.142 INFO:teuthology.orchestra.run.smithi045.stdout: -1027> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000525 [2,head] /dc-dir/dc-file_816 auth v5634 s=3 n(v0 rc2023-10-03T19:17:08.240739+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553560b700] 2023-10-03T19:21:15.143 INFO:teuthology.orchestra.run.smithi045.stdout: -1026> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000525) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.143 INFO:teuthology.orchestra.run.smithi045.stdout: -1025> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000526 [2,head] /dc-dir/dc-file_817 auth v5636 s=3 n(v0 rc2023-10-03T19:17:08.252019+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535614000] 2023-10-03T19:21:15.143 INFO:teuthology.orchestra.run.smithi045.stdout: -1024> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000526) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.143 INFO:teuthology.orchestra.run.smithi045.stdout: -1023> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000527 [2,head] /dc-dir/dc-file_818 auth v5638 s=3 n(v0 rc2023-10-03T19:17:08.264369+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535614580] 2023-10-03T19:21:15.143 INFO:teuthology.orchestra.run.smithi045.stdout: -1022> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000527) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.143 INFO:teuthology.orchestra.run.smithi045.stdout: -1021> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000528 [2,head] /dc-dir/dc-file_819 auth v5640 s=3 n(v0 rc2023-10-03T19:17:08.277918+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535614b00] 2023-10-03T19:21:15.144 INFO:teuthology.orchestra.run.smithi045.stdout: -1020> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000528) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.144 INFO:teuthology.orchestra.run.smithi045.stdout: -1019> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000529 [2,head] /dc-dir/dc-file_820 auth v5642 s=3 n(v0 rc2023-10-03T19:17:08.289621+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535615080] 2023-10-03T19:21:15.144 INFO:teuthology.orchestra.run.smithi045.stdout: -1018> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000529) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.204 INFO:teuthology.orchestra.run.smithi045.stdout: -1017> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000052a [2,head] /dc-dir/dc-file_821 auth v5644 s=3 n(v0 rc2023-10-03T19:17:08.301419+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535615600] 2023-10-03T19:21:15.204 INFO:teuthology.orchestra.run.smithi045.stdout: -1016> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000052a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.204 INFO:teuthology.orchestra.run.smithi045.stdout: -1015> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000052b [2,head] /dc-dir/dc-file_822 auth v5646 s=3 n(v0 rc2023-10-03T19:17:08.315886+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535615b80] 2023-10-03T19:21:15.204 INFO:teuthology.orchestra.run.smithi045.stdout: -1014> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000052b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.204 INFO:teuthology.orchestra.run.smithi045.stdout: -1013> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000052c [2,head] /dc-dir/dc-file_823 auth v5648 s=3 n(v0 rc2023-10-03T19:17:08.330033+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535616100] 2023-10-03T19:21:15.205 INFO:teuthology.orchestra.run.smithi045.stdout: -1012> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000052c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.205 INFO:teuthology.orchestra.run.smithi045.stdout: -1011> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000052d [2,head] /dc-dir/dc-file_824 auth v5650 s=3 n(v0 rc2023-10-03T19:17:08.343965+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535616680] 2023-10-03T19:21:15.205 INFO:teuthology.orchestra.run.smithi045.stdout: -1010> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000052d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.205 INFO:teuthology.orchestra.run.smithi045.stdout: -1009> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000052e [2,head] /dc-dir/dc-file_825 auth v5652 s=3 n(v0 rc2023-10-03T19:17:08.357648+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535616c00] 2023-10-03T19:21:15.205 INFO:teuthology.orchestra.run.smithi045.stdout: -1008> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000052e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.206 INFO:teuthology.orchestra.run.smithi045.stdout: -1007> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000052f [2,head] /dc-dir/dc-file_826 auth v5654 s=3 n(v0 rc2023-10-03T19:17:08.369735+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535617180] 2023-10-03T19:21:15.206 INFO:teuthology.orchestra.run.smithi045.stdout: -1006> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000052f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.206 INFO:teuthology.orchestra.run.smithi045.stdout: -1005> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000530 [2,head] /dc-dir/dc-file_827 auth v5656 s=3 n(v0 rc2023-10-03T19:17:08.381633+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535617700] 2023-10-03T19:21:15.206 INFO:teuthology.orchestra.run.smithi045.stdout: -1004> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000530) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.206 INFO:teuthology.orchestra.run.smithi045.stdout: -1003> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000531 [2,head] /dc-dir/dc-file_828 auth v5658 s=3 n(v0 rc2023-10-03T19:17:08.393814+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535620000] 2023-10-03T19:21:15.207 INFO:teuthology.orchestra.run.smithi045.stdout: -1002> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000531) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.207 INFO:teuthology.orchestra.run.smithi045.stdout: -1001> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000532 [2,head] /dc-dir/dc-file_829 auth v5660 s=3 n(v0 rc2023-10-03T19:17:08.405135+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535620580] 2023-10-03T19:21:15.207 INFO:teuthology.orchestra.run.smithi045.stdout: -1000> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000532) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.207 INFO:teuthology.orchestra.run.smithi045.stdout: -999> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000533 [2,head] /dc-dir/dc-file_830 auth v5662 s=3 n(v0 rc2023-10-03T19:17:08.416650+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535620b00] 2023-10-03T19:21:15.207 INFO:teuthology.orchestra.run.smithi045.stdout: -998> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000533) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.208 INFO:teuthology.orchestra.run.smithi045.stdout: -997> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000534 [2,head] /dc-dir/dc-file_831 auth v5664 s=3 n(v0 rc2023-10-03T19:17:08.429086+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535621080] 2023-10-03T19:21:15.208 INFO:teuthology.orchestra.run.smithi045.stdout: -996> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000534) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.208 INFO:teuthology.orchestra.run.smithi045.stdout: -995> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000535 [2,head] /dc-dir/dc-file_832 auth v5666 s=3 n(v0 rc2023-10-03T19:17:08.440688+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535621600] 2023-10-03T19:21:15.208 INFO:teuthology.orchestra.run.smithi045.stdout: -994> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000535) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.208 INFO:teuthology.orchestra.run.smithi045.stdout: -993> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000536 [2,head] /dc-dir/dc-file_833 auth v5668 s=3 n(v0 rc2023-10-03T19:17:08.452631+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535621b80] 2023-10-03T19:21:15.209 INFO:teuthology.orchestra.run.smithi045.stdout: -992> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000536) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.209 INFO:teuthology.orchestra.run.smithi045.stdout: -991> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000537 [2,head] /dc-dir/dc-file_834 auth v5670 s=3 n(v0 rc2023-10-03T19:17:08.463917+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535622100] 2023-10-03T19:21:15.209 INFO:teuthology.orchestra.run.smithi045.stdout: -990> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000537) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.209 INFO:teuthology.orchestra.run.smithi045.stdout: -989> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000538 [2,head] /dc-dir/dc-file_835 auth v5672 s=3 n(v0 rc2023-10-03T19:17:08.475760+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535622680] 2023-10-03T19:21:15.209 INFO:teuthology.orchestra.run.smithi045.stdout: -988> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000538) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.210 INFO:teuthology.orchestra.run.smithi045.stdout: -987> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000539 [2,head] /dc-dir/dc-file_836 auth v5674 s=3 n(v0 rc2023-10-03T19:17:08.488193+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535622c00] 2023-10-03T19:21:15.210 INFO:teuthology.orchestra.run.smithi045.stdout: -986> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000539) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.210 INFO:teuthology.orchestra.run.smithi045.stdout: -985> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000053a [2,head] /dc-dir/dc-file_837 auth v5676 s=3 n(v0 rc2023-10-03T19:17:08.505621+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535623180] 2023-10-03T19:21:15.210 INFO:teuthology.orchestra.run.smithi045.stdout: -984> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000053a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.210 INFO:teuthology.orchestra.run.smithi045.stdout: -983> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000053b [2,head] /dc-dir/dc-file_838 auth v5678 s=3 n(v0 rc2023-10-03T19:17:08.616373+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535623700] 2023-10-03T19:21:15.211 INFO:teuthology.orchestra.run.smithi045.stdout: -982> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000053b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.211 INFO:teuthology.orchestra.run.smithi045.stdout: -981> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000053c [2,head] /dc-dir/dc-file_839 auth v5680 s=3 n(v0 rc2023-10-03T19:17:08.627898+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535634000] 2023-10-03T19:21:15.211 INFO:teuthology.orchestra.run.smithi045.stdout: -980> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000053c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.211 INFO:teuthology.orchestra.run.smithi045.stdout: -979> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000053d [2,head] /dc-dir/dc-file_840 auth v5682 s=3 n(v0 rc2023-10-03T19:17:08.639602+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535634580] 2023-10-03T19:21:15.211 INFO:teuthology.orchestra.run.smithi045.stdout: -978> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000053d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.211 INFO:teuthology.orchestra.run.smithi045.stdout: -977> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000053e [2,head] /dc-dir/dc-file_841 auth v5684 s=3 n(v0 rc2023-10-03T19:17:08.651219+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535634b00] 2023-10-03T19:21:15.212 INFO:teuthology.orchestra.run.smithi045.stdout: -976> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000053e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.212 INFO:teuthology.orchestra.run.smithi045.stdout: -975> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000053f [2,head] /dc-dir/dc-file_842 auth v5686 s=3 n(v0 rc2023-10-03T19:17:08.662881+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535635080] 2023-10-03T19:21:15.212 INFO:teuthology.orchestra.run.smithi045.stdout: -974> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000053f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.212 INFO:teuthology.orchestra.run.smithi045.stdout: -973> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000540 [2,head] /dc-dir/dc-file_843 auth v5688 s=3 n(v0 rc2023-10-03T19:17:08.674152+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535635600] 2023-10-03T19:21:15.291 INFO:teuthology.orchestra.run.smithi045.stdout: -972> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000540) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.291 INFO:teuthology.orchestra.run.smithi045.stdout: -971> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000541 [2,head] /dc-dir/dc-file_844 auth v5690 s=3 n(v0 rc2023-10-03T19:17:08.685162+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535635b80] 2023-10-03T19:21:15.292 INFO:teuthology.orchestra.run.smithi045.stdout: -970> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000541) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.292 INFO:teuthology.orchestra.run.smithi045.stdout: -969> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000542 [2,head] /dc-dir/dc-file_845 auth v5692 s=3 n(v0 rc2023-10-03T19:17:08.696423+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535636100] 2023-10-03T19:21:15.292 INFO:teuthology.orchestra.run.smithi045.stdout: -968> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000542) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.292 INFO:teuthology.orchestra.run.smithi045.stdout: -967> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000543 [2,head] /dc-dir/dc-file_846 auth v5694 s=3 n(v0 rc2023-10-03T19:17:08.707685+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535636680] 2023-10-03T19:21:15.292 INFO:teuthology.orchestra.run.smithi045.stdout: -966> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000543) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.292 INFO:teuthology.orchestra.run.smithi045.stdout: -965> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000544 [2,head] /dc-dir/dc-file_847 auth v5696 s=3 n(v0 rc2023-10-03T19:17:08.718908+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535636c00] 2023-10-03T19:21:15.292 INFO:teuthology.orchestra.run.smithi045.stdout: -964> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000544) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.292 INFO:teuthology.orchestra.run.smithi045.stdout: -963> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000545 [2,head] /dc-dir/dc-file_848 auth v5698 s=3 n(v0 rc2023-10-03T19:17:08.730080+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535637180] 2023-10-03T19:21:15.292 INFO:teuthology.orchestra.run.smithi045.stdout: -962> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000545) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.292 INFO:teuthology.orchestra.run.smithi045.stdout: -961> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000546 [2,head] /dc-dir/dc-file_849 auth v5700 s=3 n(v0 rc2023-10-03T19:17:08.741248+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535637700] 2023-10-03T19:21:15.292 INFO:teuthology.orchestra.run.smithi045.stdout: -960> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000546) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.293 INFO:teuthology.orchestra.run.smithi045.stdout: -959> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000547 [2,head] /dc-dir/dc-file_850 auth v5702 s=3 n(v0 rc2023-10-03T19:17:08.752238+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535640000] 2023-10-03T19:21:15.293 INFO:teuthology.orchestra.run.smithi045.stdout: -958> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000547) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.293 INFO:teuthology.orchestra.run.smithi045.stdout: -957> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000548 [2,head] /dc-dir/dc-file_851 auth v5704 s=3 n(v0 rc2023-10-03T19:17:08.763647+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535640580] 2023-10-03T19:21:15.293 INFO:teuthology.orchestra.run.smithi045.stdout: -956> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000548) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.293 INFO:teuthology.orchestra.run.smithi045.stdout: -955> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000549 [2,head] /dc-dir/dc-file_852 auth v5706 s=3 n(v0 rc2023-10-03T19:17:08.774833+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535640b00] 2023-10-03T19:21:15.293 INFO:teuthology.orchestra.run.smithi045.stdout: -954> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000549) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.293 INFO:teuthology.orchestra.run.smithi045.stdout: -953> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000054a [2,head] /dc-dir/dc-file_853 auth v5708 s=3 n(v0 rc2023-10-03T19:17:08.786143+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535641080] 2023-10-03T19:21:15.293 INFO:teuthology.orchestra.run.smithi045.stdout: -952> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000054a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.293 INFO:teuthology.orchestra.run.smithi045.stdout: -951> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000054b [2,head] /dc-dir/dc-file_854 auth v5710 s=3 n(v0 rc2023-10-03T19:17:08.797045+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535641600] 2023-10-03T19:21:15.293 INFO:teuthology.orchestra.run.smithi045.stdout: -950> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000054b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.293 INFO:teuthology.orchestra.run.smithi045.stdout: -949> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000054c [2,head] /dc-dir/dc-file_855 auth v5712 s=3 n(v0 rc2023-10-03T19:17:08.808959+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535641b80] 2023-10-03T19:21:15.293 INFO:teuthology.orchestra.run.smithi045.stdout: -948> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000054c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.294 INFO:teuthology.orchestra.run.smithi045.stdout: -947> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000054d [2,head] /dc-dir/dc-file_856 auth v5714 s=3 n(v0 rc2023-10-03T19:17:08.819962+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535642100] 2023-10-03T19:21:15.294 INFO:teuthology.orchestra.run.smithi045.stdout: -946> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000054d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.294 INFO:teuthology.orchestra.run.smithi045.stdout: -945> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000054e [2,head] /dc-dir/dc-file_857 auth v5716 s=3 n(v0 rc2023-10-03T19:17:08.831916+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535642680] 2023-10-03T19:21:15.294 INFO:teuthology.orchestra.run.smithi045.stdout: -944> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000054e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.294 INFO:teuthology.orchestra.run.smithi045.stdout: -943> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000054f [2,head] /dc-dir/dc-file_858 auth v5718 s=3 n(v0 rc2023-10-03T19:17:08.843552+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535642c00] 2023-10-03T19:21:15.294 INFO:teuthology.orchestra.run.smithi045.stdout: -942> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000054f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.294 INFO:teuthology.orchestra.run.smithi045.stdout: -941> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000550 [2,head] /dc-dir/dc-file_859 auth v5720 s=3 n(v0 rc2023-10-03T19:17:08.854764+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535643180] 2023-10-03T19:21:15.294 INFO:teuthology.orchestra.run.smithi045.stdout: -940> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000550) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.294 INFO:teuthology.orchestra.run.smithi045.stdout: -939> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000551 [2,head] /dc-dir/dc-file_860 auth v5722 s=3 n(v0 rc2023-10-03T19:17:08.865600+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535643700] 2023-10-03T19:21:15.294 INFO:teuthology.orchestra.run.smithi045.stdout: -938> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000551) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.294 INFO:teuthology.orchestra.run.smithi045.stdout: -937> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000552 [2,head] /dc-dir/dc-file_861 auth v5724 s=3 n(v0 rc2023-10-03T19:17:08.876693+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553564a000] 2023-10-03T19:21:15.295 INFO:teuthology.orchestra.run.smithi045.stdout: -936> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000552) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.295 INFO:teuthology.orchestra.run.smithi045.stdout: -935> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000553 [2,head] /dc-dir/dc-file_862 auth v5726 s=3 n(v0 rc2023-10-03T19:17:08.887862+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553564a580] 2023-10-03T19:21:15.295 INFO:teuthology.orchestra.run.smithi045.stdout: -934> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000553) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.295 INFO:teuthology.orchestra.run.smithi045.stdout: -933> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000554 [2,head] /dc-dir/dc-file_863 auth v5728 s=3 n(v0 rc2023-10-03T19:17:08.899009+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553564ab00] 2023-10-03T19:21:15.295 INFO:teuthology.orchestra.run.smithi045.stdout: -932> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000554) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.295 INFO:teuthology.orchestra.run.smithi045.stdout: -931> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000555 [2,head] /dc-dir/dc-file_864 auth v5730 s=3 n(v0 rc2023-10-03T19:17:08.910108+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553564b080] 2023-10-03T19:21:15.295 INFO:teuthology.orchestra.run.smithi045.stdout: -930> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000555) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.295 INFO:teuthology.orchestra.run.smithi045.stdout: -929> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000556 [2,head] /dc-dir/dc-file_865 auth v5732 s=3 n(v0 rc2023-10-03T19:17:08.922309+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553564b600] 2023-10-03T19:21:15.295 INFO:teuthology.orchestra.run.smithi045.stdout: -928> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000556) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.295 INFO:teuthology.orchestra.run.smithi045.stdout: -927> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000557 [2,head] /dc-dir/dc-file_866 auth v5734 s=3 n(v0 rc2023-10-03T19:17:08.935040+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553564bb80] 2023-10-03T19:21:15.295 INFO:teuthology.orchestra.run.smithi045.stdout: -926> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000557) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.296 INFO:teuthology.orchestra.run.smithi045.stdout: -925> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000558 [2,head] /dc-dir/dc-file_867 auth v5736 s=3 n(v0 rc2023-10-03T19:17:08.946919+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553564c100] 2023-10-03T19:21:15.296 INFO:teuthology.orchestra.run.smithi045.stdout: -924> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000558) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.296 INFO:teuthology.orchestra.run.smithi045.stdout: -923> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000559 [2,head] /dc-dir/dc-file_868 auth v5738 s=3 n(v0 rc2023-10-03T19:17:08.959408+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553564c680] 2023-10-03T19:21:15.296 INFO:teuthology.orchestra.run.smithi045.stdout: -922> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000559) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.347 INFO:teuthology.orchestra.run.smithi045.stdout: -921> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000055a [2,head] /dc-dir/dc-file_869 auth v5740 s=3 n(v0 rc2023-10-03T19:17:08.970555+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553564cc00] 2023-10-03T19:21:15.347 INFO:teuthology.orchestra.run.smithi045.stdout: -920> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000055a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.347 INFO:teuthology.orchestra.run.smithi045.stdout: -919> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000055b [2,head] /dc-dir/dc-file_870 auth v5742 s=3 n(v0 rc2023-10-03T19:17:08.981914+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553564d180] 2023-10-03T19:21:15.348 INFO:teuthology.orchestra.run.smithi045.stdout: -918> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000055b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.348 INFO:teuthology.orchestra.run.smithi045.stdout: -917> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000055c [2,head] /dc-dir/dc-file_871 auth v5744 s=3 n(v0 rc2023-10-03T19:17:08.994043+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553564d700] 2023-10-03T19:21:15.348 INFO:teuthology.orchestra.run.smithi045.stdout: -916> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000055c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.348 INFO:teuthology.orchestra.run.smithi045.stdout: -915> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000055d [2,head] /dc-dir/dc-file_872 auth v5746 s=3 n(v0 rc2023-10-03T19:17:09.005615+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535654000] 2023-10-03T19:21:15.348 INFO:teuthology.orchestra.run.smithi045.stdout: -914> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000055d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.348 INFO:teuthology.orchestra.run.smithi045.stdout: -913> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000055e [2,head] /dc-dir/dc-file_873 auth v5748 s=3 n(v0 rc2023-10-03T19:17:09.019465+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535654580] 2023-10-03T19:21:15.348 INFO:teuthology.orchestra.run.smithi045.stdout: -912> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000055e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.348 INFO:teuthology.orchestra.run.smithi045.stdout: -911> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000055f [2,head] /dc-dir/dc-file_874 auth v5750 s=3 n(v0 rc2023-10-03T19:17:09.031035+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535654b00] 2023-10-03T19:21:15.348 INFO:teuthology.orchestra.run.smithi045.stdout: -910> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000055f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.348 INFO:teuthology.orchestra.run.smithi045.stdout: -909> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000560 [2,head] /dc-dir/dc-file_875 auth v5752 s=3 n(v0 rc2023-10-03T19:17:09.043153+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535655080] 2023-10-03T19:21:15.349 INFO:teuthology.orchestra.run.smithi045.stdout: -908> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000560) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.349 INFO:teuthology.orchestra.run.smithi045.stdout: -907> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000561 [2,head] /dc-dir/dc-file_876 auth v5754 s=3 n(v0 rc2023-10-03T19:17:09.054235+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535655600] 2023-10-03T19:21:15.349 INFO:teuthology.orchestra.run.smithi045.stdout: -906> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000561) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.349 INFO:teuthology.orchestra.run.smithi045.stdout: -905> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000562 [2,head] /dc-dir/dc-file_877 auth v5756 s=3 n(v0 rc2023-10-03T19:17:09.065109+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535655b80] 2023-10-03T19:21:15.349 INFO:teuthology.orchestra.run.smithi045.stdout: -904> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000562) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.349 INFO:teuthology.orchestra.run.smithi045.stdout: -903> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000563 [2,head] /dc-dir/dc-file_878 auth v5758 s=3 n(v0 rc2023-10-03T19:17:09.077570+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535656100] 2023-10-03T19:21:15.349 INFO:teuthology.orchestra.run.smithi045.stdout: -902> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000563) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.349 INFO:teuthology.orchestra.run.smithi045.stdout: -901> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000564 [2,head] /dc-dir/dc-file_879 auth v5760 s=3 n(v0 rc2023-10-03T19:17:09.090152+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535656680] 2023-10-03T19:21:15.349 INFO:teuthology.orchestra.run.smithi045.stdout: -900> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000564) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.349 INFO:teuthology.orchestra.run.smithi045.stdout: -899> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000565 [2,head] /dc-dir/dc-file_880 auth v5762 s=3 n(v0 rc2023-10-03T19:17:09.103529+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535656c00] 2023-10-03T19:21:15.349 INFO:teuthology.orchestra.run.smithi045.stdout: -898> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000565) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.349 INFO:teuthology.orchestra.run.smithi045.stdout: -897> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000566 [2,head] /dc-dir/dc-file_881 auth v5764 s=3 n(v0 rc2023-10-03T19:17:09.116353+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535657180] 2023-10-03T19:21:15.350 INFO:teuthology.orchestra.run.smithi045.stdout: -896> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000566) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.350 INFO:teuthology.orchestra.run.smithi045.stdout: -895> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000567 [2,head] /dc-dir/dc-file_882 auth v5766 s=3 n(v0 rc2023-10-03T19:17:09.128256+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535657700] 2023-10-03T19:21:15.350 INFO:teuthology.orchestra.run.smithi045.stdout: -894> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000567) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.350 INFO:teuthology.orchestra.run.smithi045.stdout: -893> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000568 [2,head] /dc-dir/dc-file_883 auth v5768 s=3 n(v0 rc2023-10-03T19:17:09.139955+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553565a000] 2023-10-03T19:21:15.350 INFO:teuthology.orchestra.run.smithi045.stdout: -892> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000568) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.350 INFO:teuthology.orchestra.run.smithi045.stdout: -891> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000569 [2,head] /dc-dir/dc-file_884 auth v5770 s=3 n(v0 rc2023-10-03T19:17:09.151288+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553565a580] 2023-10-03T19:21:15.350 INFO:teuthology.orchestra.run.smithi045.stdout: -890> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000569) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.350 INFO:teuthology.orchestra.run.smithi045.stdout: -889> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000056a [2,head] /dc-dir/dc-file_885 auth v5772 s=3 n(v0 rc2023-10-03T19:17:09.163626+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553565ab00] 2023-10-03T19:21:15.350 INFO:teuthology.orchestra.run.smithi045.stdout: -888> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000056a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.350 INFO:teuthology.orchestra.run.smithi045.stdout: -887> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000056b [2,head] /dc-dir/dc-file_886 auth v5774 s=3 n(v0 rc2023-10-03T19:17:09.176499+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553565b080] 2023-10-03T19:21:15.351 INFO:teuthology.orchestra.run.smithi045.stdout: -886> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000056b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.351 INFO:teuthology.orchestra.run.smithi045.stdout: -885> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000056c [2,head] /dc-dir/dc-file_887 auth v5776 s=3 n(v0 rc2023-10-03T19:17:09.188601+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553565b600] 2023-10-03T19:21:15.351 INFO:teuthology.orchestra.run.smithi045.stdout: -884> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000056c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.351 INFO:teuthology.orchestra.run.smithi045.stdout: -883> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000056d [2,head] /dc-dir/dc-file_888 auth v5778 s=3 n(v0 rc2023-10-03T19:17:09.200771+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553565bb80] 2023-10-03T19:21:15.351 INFO:teuthology.orchestra.run.smithi045.stdout: -882> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000056d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.351 INFO:teuthology.orchestra.run.smithi045.stdout: -881> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000056e [2,head] /dc-dir/dc-file_889 auth v5780 s=3 n(v0 rc2023-10-03T19:17:09.213369+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553565c100] 2023-10-03T19:21:15.351 INFO:teuthology.orchestra.run.smithi045.stdout: -880> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000056e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.351 INFO:teuthology.orchestra.run.smithi045.stdout: -879> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000056f [2,head] /dc-dir/dc-file_890 auth v5782 s=3 n(v0 rc2023-10-03T19:17:09.225167+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553565c680] 2023-10-03T19:21:15.351 INFO:teuthology.orchestra.run.smithi045.stdout: -878> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000056f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.351 INFO:teuthology.orchestra.run.smithi045.stdout: -877> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000570 [2,head] /dc-dir/dc-file_891 auth v5784 s=3 n(v0 rc2023-10-03T19:17:09.236008+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553565cc00] 2023-10-03T19:21:15.351 INFO:teuthology.orchestra.run.smithi045.stdout: -876> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000570) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.351 INFO:teuthology.orchestra.run.smithi045.stdout: -875> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000571 [2,head] /dc-dir/dc-file_892 auth v5786 s=3 n(v0 rc2023-10-03T19:17:09.247321+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553565d180] 2023-10-03T19:21:15.352 INFO:teuthology.orchestra.run.smithi045.stdout: -874> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000571) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.352 INFO:teuthology.orchestra.run.smithi045.stdout: -873> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000572 [2,head] /dc-dir/dc-file_893 auth v5788 s=3 n(v0 rc2023-10-03T19:17:09.258402+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553565d700] 2023-10-03T19:21:15.352 INFO:teuthology.orchestra.run.smithi045.stdout: -872> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000572) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.352 INFO:teuthology.orchestra.run.smithi045.stdout: -871> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000573 [2,head] /dc-dir/dc-file_894 auth v5790 s=3 n(v0 rc2023-10-03T19:17:09.270588+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535664000] 2023-10-03T19:21:15.352 INFO:teuthology.orchestra.run.smithi045.stdout: -870> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000573) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.440 INFO:teuthology.orchestra.run.smithi045.stdout: -869> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000574 [2,head] /dc-dir/dc-file_895 auth v5792 s=3 n(v0 rc2023-10-03T19:17:09.284343+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535664580] 2023-10-03T19:21:15.440 INFO:teuthology.orchestra.run.smithi045.stdout: -868> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000574) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.440 INFO:teuthology.orchestra.run.smithi045.stdout: -867> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000575 [2,head] /dc-dir/dc-file_896 auth v5794 s=3 n(v0 rc2023-10-03T19:17:09.296188+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535664b00] 2023-10-03T19:21:15.440 INFO:teuthology.orchestra.run.smithi045.stdout: -866> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000575) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.440 INFO:teuthology.orchestra.run.smithi045.stdout: -865> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000576 [2,head] /dc-dir/dc-file_897 auth v5796 s=3 n(v0 rc2023-10-03T19:17:09.307467+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535665080] 2023-10-03T19:21:15.441 INFO:teuthology.orchestra.run.smithi045.stdout: -864> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000576) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.441 INFO:teuthology.orchestra.run.smithi045.stdout: -863> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000577 [2,head] /dc-dir/dc-file_898 auth v5798 s=3 n(v0 rc2023-10-03T19:17:09.319393+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535665600] 2023-10-03T19:21:15.441 INFO:teuthology.orchestra.run.smithi045.stdout: -862> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000577) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.441 INFO:teuthology.orchestra.run.smithi045.stdout: -861> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000578 [2,head] /dc-dir/dc-file_899 auth v5800 s=3 n(v0 rc2023-10-03T19:17:09.331832+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535665b80] 2023-10-03T19:21:15.441 INFO:teuthology.orchestra.run.smithi045.stdout: -860> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000578) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.441 INFO:teuthology.orchestra.run.smithi045.stdout: -859> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000579 [2,head] /dc-dir/dc-file_900 auth v5802 s=3 n(v0 rc2023-10-03T19:17:09.344427+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535666100] 2023-10-03T19:21:15.441 INFO:teuthology.orchestra.run.smithi045.stdout: -858> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000579) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.441 INFO:teuthology.orchestra.run.smithi045.stdout: -857> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000057a [2,head] /dc-dir/dc-file_901 auth v5804 s=3 n(v0 rc2023-10-03T19:17:09.356902+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535666680] 2023-10-03T19:21:15.441 INFO:teuthology.orchestra.run.smithi045.stdout: -856> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000057a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.442 INFO:teuthology.orchestra.run.smithi045.stdout: -855> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000057b [2,head] /dc-dir/dc-file_902 auth v5806 s=3 n(v0 rc2023-10-03T19:17:09.369480+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535666c00] 2023-10-03T19:21:15.442 INFO:teuthology.orchestra.run.smithi045.stdout: -854> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000057b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.442 INFO:teuthology.orchestra.run.smithi045.stdout: -853> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000057c [2,head] /dc-dir/dc-file_903 auth v5808 s=3 n(v0 rc2023-10-03T19:17:09.381441+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535667180] 2023-10-03T19:21:15.442 INFO:teuthology.orchestra.run.smithi045.stdout: -852> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000057c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.442 INFO:teuthology.orchestra.run.smithi045.stdout: -851> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000057d [2,head] /dc-dir/dc-file_904 auth v5810 s=3 n(v0 rc2023-10-03T19:17:09.393246+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535667700] 2023-10-03T19:21:15.442 INFO:teuthology.orchestra.run.smithi045.stdout: -850> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000057d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.442 INFO:teuthology.orchestra.run.smithi045.stdout: -849> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000057e [2,head] /dc-dir/dc-file_905 auth v5812 s=3 n(v0 rc2023-10-03T19:17:09.405334+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553566a000] 2023-10-03T19:21:15.442 INFO:teuthology.orchestra.run.smithi045.stdout: -848> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000057e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.442 INFO:teuthology.orchestra.run.smithi045.stdout: -847> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000057f [2,head] /dc-dir/dc-file_906 auth v5814 s=3 n(v0 rc2023-10-03T19:17:09.417046+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553566a580] 2023-10-03T19:21:15.442 INFO:teuthology.orchestra.run.smithi045.stdout: -846> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000057f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.443 INFO:teuthology.orchestra.run.smithi045.stdout: -845> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000580 [2,head] /dc-dir/dc-file_907 auth v5816 s=3 n(v0 rc2023-10-03T19:17:09.429573+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553566ab00] 2023-10-03T19:21:15.443 INFO:teuthology.orchestra.run.smithi045.stdout: -844> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000580) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.443 INFO:teuthology.orchestra.run.smithi045.stdout: -843> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000581 [2,head] /dc-dir/dc-file_908 auth v5818 s=3 n(v0 rc2023-10-03T19:17:09.441394+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553566b080] 2023-10-03T19:21:15.443 INFO:teuthology.orchestra.run.smithi045.stdout: -842> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000581) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.443 INFO:teuthology.orchestra.run.smithi045.stdout: -841> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000582 [2,head] /dc-dir/dc-file_909 auth v5820 s=3 n(v0 rc2023-10-03T19:17:09.453515+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553566b600] 2023-10-03T19:21:15.443 INFO:teuthology.orchestra.run.smithi045.stdout: -840> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000582) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.443 INFO:teuthology.orchestra.run.smithi045.stdout: -839> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000583 [2,head] /dc-dir/dc-file_910 auth v5822 s=3 n(v0 rc2023-10-03T19:17:09.465045+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553566bb80] 2023-10-03T19:21:15.443 INFO:teuthology.orchestra.run.smithi045.stdout: -838> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000583) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.443 INFO:teuthology.orchestra.run.smithi045.stdout: -837> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000584 [2,head] /dc-dir/dc-file_911 auth v5824 s=3 n(v0 rc2023-10-03T19:17:09.476553+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553566c100] 2023-10-03T19:21:15.443 INFO:teuthology.orchestra.run.smithi045.stdout: -836> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000584) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.444 INFO:teuthology.orchestra.run.smithi045.stdout: -835> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000585 [2,head] /dc-dir/dc-file_912 auth v5826 s=3 n(v0 rc2023-10-03T19:17:09.489414+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553566c680] 2023-10-03T19:21:15.444 INFO:teuthology.orchestra.run.smithi045.stdout: -834> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000585) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.444 INFO:teuthology.orchestra.run.smithi045.stdout: -833> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000586 [2,head] /dc-dir/dc-file_913 auth v5828 s=3 n(v0 rc2023-10-03T19:17:09.501866+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553566cc00] 2023-10-03T19:21:15.444 INFO:teuthology.orchestra.run.smithi045.stdout: -832> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000586) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.444 INFO:teuthology.orchestra.run.smithi045.stdout: -831> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000587 [2,head] /dc-dir/dc-file_914 auth v5830 s=3 n(v0 rc2023-10-03T19:17:09.594540+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553566d180] 2023-10-03T19:21:15.444 INFO:teuthology.orchestra.run.smithi045.stdout: -830> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000587) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.444 INFO:teuthology.orchestra.run.smithi045.stdout: -829> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000588 [2,head] /dc-dir/dc-file_915 auth v5832 s=3 n(v0 rc2023-10-03T19:17:09.652886+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553566d700] 2023-10-03T19:21:15.444 INFO:teuthology.orchestra.run.smithi045.stdout: -828> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000588) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.444 INFO:teuthology.orchestra.run.smithi045.stdout: -827> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000589 [2,head] /dc-dir/dc-file_916 auth v5834 s=3 n(v0 rc2023-10-03T19:17:09.664708+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553568e000] 2023-10-03T19:21:15.444 INFO:teuthology.orchestra.run.smithi045.stdout: -826> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000589) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.444 INFO:teuthology.orchestra.run.smithi045.stdout: -825> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000058a [2,head] /dc-dir/dc-file_917 auth v5836 s=3 n(v0 rc2023-10-03T19:17:09.676421+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553568e580] 2023-10-03T19:21:15.445 INFO:teuthology.orchestra.run.smithi045.stdout: -824> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000058a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.445 INFO:teuthology.orchestra.run.smithi045.stdout: -823> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000058b [2,head] /dc-dir/dc-file_918 auth v5838 s=3 n(v0 rc2023-10-03T19:17:09.688592+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553568eb00] 2023-10-03T19:21:15.445 INFO:teuthology.orchestra.run.smithi045.stdout: -822> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000058b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.501 INFO:teuthology.orchestra.run.smithi045.stdout: -821> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000058c [2,head] /dc-dir/dc-file_919 auth v5840 s=3 n(v0 rc2023-10-03T19:17:09.699798+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553568f080] 2023-10-03T19:21:15.501 INFO:teuthology.orchestra.run.smithi045.stdout: -820> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000058c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.501 INFO:teuthology.orchestra.run.smithi045.stdout: -819> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000058d [2,head] /dc-dir/dc-file_920 auth v5842 s=3 n(v0 rc2023-10-03T19:17:09.711579+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553568f600] 2023-10-03T19:21:15.502 INFO:teuthology.orchestra.run.smithi045.stdout: -818> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000058d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.502 INFO:teuthology.orchestra.run.smithi045.stdout: -817> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000058e [2,head] /dc-dir/dc-file_921 auth v5844 s=3 n(v0 rc2023-10-03T19:17:09.723045+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553568fb80] 2023-10-03T19:21:15.502 INFO:teuthology.orchestra.run.smithi045.stdout: -816> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000058e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.502 INFO:teuthology.orchestra.run.smithi045.stdout: -815> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000058f [2,head] /dc-dir/dc-file_922 auth v5846 s=3 n(v0 rc2023-10-03T19:17:09.735364+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535690100] 2023-10-03T19:21:15.502 INFO:teuthology.orchestra.run.smithi045.stdout: -814> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000058f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.502 INFO:teuthology.orchestra.run.smithi045.stdout: -813> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000590 [2,head] /dc-dir/dc-file_923 auth v5848 s=3 n(v0 rc2023-10-03T19:17:09.747348+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535690680] 2023-10-03T19:21:15.502 INFO:teuthology.orchestra.run.smithi045.stdout: -812> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000590) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.502 INFO:teuthology.orchestra.run.smithi045.stdout: -811> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000591 [2,head] /dc-dir/dc-file_924 auth v5850 s=3 n(v0 rc2023-10-03T19:17:09.758043+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535690c00] 2023-10-03T19:21:15.502 INFO:teuthology.orchestra.run.smithi045.stdout: -810> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000591) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.502 INFO:teuthology.orchestra.run.smithi045.stdout: -809> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000592 [2,head] /dc-dir/dc-file_925 auth v5852 s=3 n(v0 rc2023-10-03T19:17:09.769089+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535691180] 2023-10-03T19:21:15.503 INFO:teuthology.orchestra.run.smithi045.stdout: -808> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000592) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.503 INFO:teuthology.orchestra.run.smithi045.stdout: -807> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000593 [2,head] /dc-dir/dc-file_926 auth v5854 s=3 n(v0 rc2023-10-03T19:17:09.780660+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535691700] 2023-10-03T19:21:15.503 INFO:teuthology.orchestra.run.smithi045.stdout: -806> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000593) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.503 INFO:teuthology.orchestra.run.smithi045.stdout: -805> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000594 [2,head] /dc-dir/dc-file_927 auth v5856 s=3 n(v0 rc2023-10-03T19:17:09.792087+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535696000] 2023-10-03T19:21:15.503 INFO:teuthology.orchestra.run.smithi045.stdout: -804> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000594) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.503 INFO:teuthology.orchestra.run.smithi045.stdout: -803> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000595 [2,head] /dc-dir/dc-file_928 auth v5858 s=3 n(v0 rc2023-10-03T19:17:09.803531+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535696580] 2023-10-03T19:21:15.503 INFO:teuthology.orchestra.run.smithi045.stdout: -802> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000595) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.503 INFO:teuthology.orchestra.run.smithi045.stdout: -801> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000596 [2,head] /dc-dir/dc-file_929 auth v5860 s=3 n(v0 rc2023-10-03T19:17:09.815149+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535696b00] 2023-10-03T19:21:15.503 INFO:teuthology.orchestra.run.smithi045.stdout: -800> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000596) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.503 INFO:teuthology.orchestra.run.smithi045.stdout: -799> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000597 [2,head] /dc-dir/dc-file_930 auth v5862 s=3 n(v0 rc2023-10-03T19:17:09.825948+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535697080] 2023-10-03T19:21:15.503 INFO:teuthology.orchestra.run.smithi045.stdout: -798> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000597) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.504 INFO:teuthology.orchestra.run.smithi045.stdout: -797> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000598 [2,head] /dc-dir/dc-file_931 auth v5864 s=3 n(v0 rc2023-10-03T19:17:09.837939+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535697600] 2023-10-03T19:21:15.504 INFO:teuthology.orchestra.run.smithi045.stdout: -796> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000598) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.504 INFO:teuthology.orchestra.run.smithi045.stdout: -795> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000599 [2,head] /dc-dir/dc-file_932 auth v5866 s=3 n(v0 rc2023-10-03T19:17:09.851092+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535697b80] 2023-10-03T19:21:15.504 INFO:teuthology.orchestra.run.smithi045.stdout: -794> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x10000000599) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.504 INFO:teuthology.orchestra.run.smithi045.stdout: -793> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000059a [2,head] /dc-dir/dc-file_933 auth v5868 s=3 n(v0 rc2023-10-03T19:17:09.864140+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535698100] 2023-10-03T19:21:15.504 INFO:teuthology.orchestra.run.smithi045.stdout: -792> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000059a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.504 INFO:teuthology.orchestra.run.smithi045.stdout: -791> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000059b [2,head] /dc-dir/dc-file_934 auth v5870 s=3 n(v0 rc2023-10-03T19:17:09.877166+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535698680] 2023-10-03T19:21:15.504 INFO:teuthology.orchestra.run.smithi045.stdout: -790> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000059b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.504 INFO:teuthology.orchestra.run.smithi045.stdout: -789> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000059c [2,head] /dc-dir/dc-file_935 auth v5872 s=3 n(v0 rc2023-10-03T19:17:09.889064+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535698c00] 2023-10-03T19:21:15.504 INFO:teuthology.orchestra.run.smithi045.stdout: -788> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000059c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.504 INFO:teuthology.orchestra.run.smithi045.stdout: -787> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000059d [2,head] /dc-dir/dc-file_936 auth v5874 s=3 n(v0 rc2023-10-03T19:17:09.900761+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535699180] 2023-10-03T19:21:15.505 INFO:teuthology.orchestra.run.smithi045.stdout: -786> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000059d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.505 INFO:teuthology.orchestra.run.smithi045.stdout: -785> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000059e [2,head] /dc-dir/dc-file_937 auth v5876 s=3 n(v0 rc2023-10-03T19:17:09.912661+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535699700] 2023-10-03T19:21:15.505 INFO:teuthology.orchestra.run.smithi045.stdout: -784> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000059e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.505 INFO:teuthology.orchestra.run.smithi045.stdout: -783> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000059f [2,head] /dc-dir/dc-file_938 auth v5878 s=3 n(v0 rc2023-10-03T19:17:09.924103+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553569e000] 2023-10-03T19:21:15.505 INFO:teuthology.orchestra.run.smithi045.stdout: -782> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x1000000059f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.505 INFO:teuthology.orchestra.run.smithi045.stdout: -781> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a0 [2,head] /dc-dir/dc-file_939 auth v5880 s=3 n(v0 rc2023-10-03T19:17:09.935619+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553569e580] 2023-10-03T19:21:15.505 INFO:teuthology.orchestra.run.smithi045.stdout: -780> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005a0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.505 INFO:teuthology.orchestra.run.smithi045.stdout: -779> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a1 [2,head] /dc-dir/dc-file_940 auth v5882 s=3 n(v0 rc2023-10-03T19:17:09.947215+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553569eb00] 2023-10-03T19:21:15.505 INFO:teuthology.orchestra.run.smithi045.stdout: -778> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005a1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.505 INFO:teuthology.orchestra.run.smithi045.stdout: -777> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a2 [2,head] /dc-dir/dc-file_941 auth v5884 s=3 n(v0 rc2023-10-03T19:17:09.960962+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553569f080] 2023-10-03T19:21:15.506 INFO:teuthology.orchestra.run.smithi045.stdout: -776> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005a2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.506 INFO:teuthology.orchestra.run.smithi045.stdout: -775> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a3 [2,head] /dc-dir/dc-file_942 auth v5886 s=3 n(v0 rc2023-10-03T19:17:09.974609+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553569f600] 2023-10-03T19:21:15.506 INFO:teuthology.orchestra.run.smithi045.stdout: -774> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005a3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.506 INFO:teuthology.orchestra.run.smithi045.stdout: -773> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a4 [2,head] /dc-dir/dc-file_943 auth v5888 s=3 n(v0 rc2023-10-03T19:17:09.987593+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553569fb80] 2023-10-03T19:21:15.535 INFO:teuthology.orchestra.run.smithi045.stdout: -772> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005a4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.535 INFO:teuthology.orchestra.run.smithi045.stdout: -771> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a5 [2,head] /dc-dir/dc-file_944 auth v5890 s=3 n(v0 rc2023-10-03T19:17:09.999158+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655356a0100] 2023-10-03T19:21:15.535 INFO:teuthology.orchestra.run.smithi045.stdout: -770> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005a5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.535 INFO:teuthology.orchestra.run.smithi045.stdout: -769> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a6 [2,head] /dc-dir/dc-file_945 auth v5892 s=3 n(v0 rc2023-10-03T19:17:10.009972+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655356a0680] 2023-10-03T19:21:15.536 INFO:teuthology.orchestra.run.smithi045.stdout: -768> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005a6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.536 INFO:teuthology.orchestra.run.smithi045.stdout: -767> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a7 [2,head] /dc-dir/dc-file_946 auth v5894 s=3 n(v0 rc2023-10-03T19:17:10.019736+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655356a0c00] 2023-10-03T19:21:15.536 INFO:teuthology.orchestra.run.smithi045.stdout: -766> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005a7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.536 INFO:teuthology.orchestra.run.smithi045.stdout: -765> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a8 [2,head] /dc-dir/dc-file_947 auth v5896 s=3 n(v0 rc2023-10-03T19:17:10.030010+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655356a1180] 2023-10-03T19:21:15.536 INFO:teuthology.orchestra.run.smithi045.stdout: -764> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005a8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.536 INFO:teuthology.orchestra.run.smithi045.stdout: -763> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a9 [2,head] /dc-dir/dc-file_948 auth v5898 s=3 n(v0 rc2023-10-03T19:17:10.040282+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x5655356a1700] 2023-10-03T19:21:15.536 INFO:teuthology.orchestra.run.smithi045.stdout: -762> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005a9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.536 INFO:teuthology.orchestra.run.smithi045.stdout: -761> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005aa [2,head] /dc-dir/dc-file_949 auth v5900 s=3 n(v0 rc2023-10-03T19:17:10.051286+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535080000] 2023-10-03T19:21:15.536 INFO:teuthology.orchestra.run.smithi045.stdout: -760> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005aa) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.536 INFO:teuthology.orchestra.run.smithi045.stdout: -759> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005ab [2,head] /dc-dir/dc-file_950 auth v5902 s=3 n(v0 rc2023-10-03T19:17:10.062438+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535080580] 2023-10-03T19:21:15.536 INFO:teuthology.orchestra.run.smithi045.stdout: -758> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005ab) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.537 INFO:teuthology.orchestra.run.smithi045.stdout: -757> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005ac [2,head] /dc-dir/dc-file_951 auth v5904 s=3 n(v0 rc2023-10-03T19:17:10.074337+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535080b00] 2023-10-03T19:21:15.537 INFO:teuthology.orchestra.run.smithi045.stdout: -756> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005ac) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.537 INFO:teuthology.orchestra.run.smithi045.stdout: -755> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005ad [2,head] /dc-dir/dc-file_952 auth v5906 s=3 n(v0 rc2023-10-03T19:17:10.085619+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535081080] 2023-10-03T19:21:15.537 INFO:teuthology.orchestra.run.smithi045.stdout: -754> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005ad) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.537 INFO:teuthology.orchestra.run.smithi045.stdout: -753> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005ae [2,head] /dc-dir/dc-file_953 auth v5908 s=3 n(v0 rc2023-10-03T19:17:10.097449+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535081600] 2023-10-03T19:21:15.537 INFO:teuthology.orchestra.run.smithi045.stdout: -752> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005ae) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.537 INFO:teuthology.orchestra.run.smithi045.stdout: -751> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005af [2,head] /dc-dir/dc-file_954 auth v5910 s=3 n(v0 rc2023-10-03T19:17:10.108208+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535081b80] 2023-10-03T19:21:15.537 INFO:teuthology.orchestra.run.smithi045.stdout: -750> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005af) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.537 INFO:teuthology.orchestra.run.smithi045.stdout: -749> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b0 [2,head] /dc-dir/dc-file_955 auth v5912 s=3 n(v0 rc2023-10-03T19:17:10.119263+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535082100] 2023-10-03T19:21:15.537 INFO:teuthology.orchestra.run.smithi045.stdout: -748> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005b0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.538 INFO:teuthology.orchestra.run.smithi045.stdout: -747> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b1 [2,head] /dc-dir/dc-file_956 auth v5914 s=3 n(v0 rc2023-10-03T19:17:10.129972+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535082680] 2023-10-03T19:21:15.538 INFO:teuthology.orchestra.run.smithi045.stdout: -746> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005b1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.538 INFO:teuthology.orchestra.run.smithi045.stdout: -745> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b2 [2,head] /dc-dir/dc-file_957 auth v5916 s=3 n(v0 rc2023-10-03T19:17:10.140345+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535082c00] 2023-10-03T19:21:15.538 INFO:teuthology.orchestra.run.smithi045.stdout: -744> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005b2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.538 INFO:teuthology.orchestra.run.smithi045.stdout: -743> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b3 [2,head] /dc-dir/dc-file_958 auth v5918 s=3 n(v0 rc2023-10-03T19:17:10.150505+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535083180] 2023-10-03T19:21:15.538 INFO:teuthology.orchestra.run.smithi045.stdout: -742> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005b3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.538 INFO:teuthology.orchestra.run.smithi045.stdout: -741> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b4 [2,head] /dc-dir/dc-file_959 auth v5920 s=3 n(v0 rc2023-10-03T19:17:10.163529+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535083700] 2023-10-03T19:21:15.538 INFO:teuthology.orchestra.run.smithi045.stdout: -740> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005b4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.538 INFO:teuthology.orchestra.run.smithi045.stdout: -739> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b5 [2,head] /dc-dir/dc-file_960 auth v5922 s=3 n(v0 rc2023-10-03T19:17:10.176390+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535052000] 2023-10-03T19:21:15.538 INFO:teuthology.orchestra.run.smithi045.stdout: -738> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005b5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.538 INFO:teuthology.orchestra.run.smithi045.stdout: -737> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b6 [2,head] /dc-dir/dc-file_961 auth v5924 s=3 n(v0 rc2023-10-03T19:17:10.189372+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535052580] 2023-10-03T19:21:15.539 INFO:teuthology.orchestra.run.smithi045.stdout: -736> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005b6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.539 INFO:teuthology.orchestra.run.smithi045.stdout: -735> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b7 [2,head] /dc-dir/dc-file_962 auth v5926 s=3 n(v0 rc2023-10-03T19:17:10.202571+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535052b00] 2023-10-03T19:21:15.539 INFO:teuthology.orchestra.run.smithi045.stdout: -734> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005b7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.539 INFO:teuthology.orchestra.run.smithi045.stdout: -733> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b8 [2,head] /dc-dir/dc-file_963 auth v5928 s=3 n(v0 rc2023-10-03T19:17:10.215446+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535053080] 2023-10-03T19:21:15.539 INFO:teuthology.orchestra.run.smithi045.stdout: -732> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005b8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.539 INFO:teuthology.orchestra.run.smithi045.stdout: -731> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b9 [2,head] /dc-dir/dc-file_964 auth v5930 s=3 n(v0 rc2023-10-03T19:17:10.228435+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535053600] 2023-10-03T19:21:15.539 INFO:teuthology.orchestra.run.smithi045.stdout: -730> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005b9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.539 INFO:teuthology.orchestra.run.smithi045.stdout: -729> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005ba [2,head] /dc-dir/dc-file_965 auth v5932 s=3 n(v0 rc2023-10-03T19:17:10.240209+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535053b80] 2023-10-03T19:21:15.539 INFO:teuthology.orchestra.run.smithi045.stdout: -728> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005ba) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.539 INFO:teuthology.orchestra.run.smithi045.stdout: -727> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005bb [2,head] /dc-dir/dc-file_966 auth v5934 s=3 n(v0 rc2023-10-03T19:17:10.251796+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535054100] 2023-10-03T19:21:15.540 INFO:teuthology.orchestra.run.smithi045.stdout: -726> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005bb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.540 INFO:teuthology.orchestra.run.smithi045.stdout: -725> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005bc [2,head] /dc-dir/dc-file_967 auth v5936 s=3 n(v0 rc2023-10-03T19:17:10.263808+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535054680] 2023-10-03T19:21:15.540 INFO:teuthology.orchestra.run.smithi045.stdout: -724> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005bc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.540 INFO:teuthology.orchestra.run.smithi045.stdout: -723> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005bd [2,head] /dc-dir/dc-file_968 auth v5938 s=3 n(v0 rc2023-10-03T19:17:10.275776+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535054c00] 2023-10-03T19:21:15.540 INFO:teuthology.orchestra.run.smithi045.stdout: -722> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005bd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.540 INFO:teuthology.orchestra.run.smithi045.stdout: -721> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005be [2,head] /dc-dir/dc-file_969 auth v5940 s=3 n(v0 rc2023-10-03T19:17:10.287859+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535055180] 2023-10-03T19:21:15.540 INFO:teuthology.orchestra.run.smithi045.stdout: -720> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005be) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.540 INFO:teuthology.orchestra.run.smithi045.stdout: -719> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005bf [2,head] /dc-dir/dc-file_970 auth v5942 s=3 n(v0 rc2023-10-03T19:17:10.299245+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535055700] 2023-10-03T19:21:15.540 INFO:teuthology.orchestra.run.smithi045.stdout: -718> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005bf) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.540 INFO:teuthology.orchestra.run.smithi045.stdout: -717> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c0 [2,head] /dc-dir/dc-file_971 auth v5944 s=3 n(v0 rc2023-10-03T19:17:10.311523+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535722000] 2023-10-03T19:21:15.540 INFO:teuthology.orchestra.run.smithi045.stdout: -716> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005c0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.541 INFO:teuthology.orchestra.run.smithi045.stdout: -715> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c1 [2,head] /dc-dir/dc-file_972 auth v5946 s=3 n(v0 rc2023-10-03T19:17:10.324469+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535722580] 2023-10-03T19:21:15.541 INFO:teuthology.orchestra.run.smithi045.stdout: -714> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005c1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.628 INFO:teuthology.orchestra.run.smithi045.stdout: -713> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c2 [2,head] /dc-dir/dc-file_973 auth v5948 s=3 n(v0 rc2023-10-03T19:17:10.335727+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535722b00] 2023-10-03T19:21:15.628 INFO:teuthology.orchestra.run.smithi045.stdout: -712> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005c2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.628 INFO:teuthology.orchestra.run.smithi045.stdout: -711> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c3 [2,head] /dc-dir/dc-file_974 auth v5950 s=3 n(v0 rc2023-10-03T19:17:10.348569+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535723080] 2023-10-03T19:21:15.628 INFO:teuthology.orchestra.run.smithi045.stdout: -710> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005c3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.628 INFO:teuthology.orchestra.run.smithi045.stdout: -709> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c4 [2,head] /dc-dir/dc-file_975 auth v5952 s=3 n(v0 rc2023-10-03T19:17:10.361029+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535723600] 2023-10-03T19:21:15.628 INFO:teuthology.orchestra.run.smithi045.stdout: -708> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005c4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.628 INFO:teuthology.orchestra.run.smithi045.stdout: -707> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c5 [2,head] /dc-dir/dc-file_976 auth v5954 s=3 n(v0 rc2023-10-03T19:17:10.374102+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535723b80] 2023-10-03T19:21:15.629 INFO:teuthology.orchestra.run.smithi045.stdout: -706> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005c5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.629 INFO:teuthology.orchestra.run.smithi045.stdout: -705> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c6 [2,head] /dc-dir/dc-file_977 auth v5956 s=3 n(v0 rc2023-10-03T19:17:10.386016+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535724100] 2023-10-03T19:21:15.629 INFO:teuthology.orchestra.run.smithi045.stdout: -704> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005c6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.629 INFO:teuthology.orchestra.run.smithi045.stdout: -703> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c7 [2,head] /dc-dir/dc-file_978 auth v5958 s=3 n(v0 rc2023-10-03T19:17:10.397595+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535724680] 2023-10-03T19:21:15.629 INFO:teuthology.orchestra.run.smithi045.stdout: -702> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005c7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.629 INFO:teuthology.orchestra.run.smithi045.stdout: -701> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c8 [2,head] /dc-dir/dc-file_979 auth v5960 s=3 n(v0 rc2023-10-03T19:17:10.409584+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535724c00] 2023-10-03T19:21:15.629 INFO:teuthology.orchestra.run.smithi045.stdout: -700> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005c8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.629 INFO:teuthology.orchestra.run.smithi045.stdout: -699> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c9 [2,head] /dc-dir/dc-file_980 auth v5962 s=3 n(v0 rc2023-10-03T19:17:10.421406+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535725180] 2023-10-03T19:21:15.630 INFO:teuthology.orchestra.run.smithi045.stdout: -698> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005c9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.630 INFO:teuthology.orchestra.run.smithi045.stdout: -697> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005ca [2,head] /dc-dir/dc-file_981 auth v5964 s=3 n(v0 rc2023-10-03T19:17:10.433039+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535725700] 2023-10-03T19:21:15.630 INFO:teuthology.orchestra.run.smithi045.stdout: -696> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005ca) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.630 INFO:teuthology.orchestra.run.smithi045.stdout: -695> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005cb [2,head] /dc-dir/dc-file_982 auth v5966 s=3 n(v0 rc2023-10-03T19:17:10.444968+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535728000] 2023-10-03T19:21:15.630 INFO:teuthology.orchestra.run.smithi045.stdout: -694> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005cb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.630 INFO:teuthology.orchestra.run.smithi045.stdout: -693> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005cc [2,head] /dc-dir/dc-file_983 auth v5968 s=3 n(v0 rc2023-10-03T19:17:10.456156+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535728580] 2023-10-03T19:21:15.630 INFO:teuthology.orchestra.run.smithi045.stdout: -692> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005cc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.630 INFO:teuthology.orchestra.run.smithi045.stdout: -691> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005cd [2,head] /dc-dir/dc-file_984 auth v5970 s=3 n(v0 rc2023-10-03T19:17:10.467616+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535728b00] 2023-10-03T19:21:15.630 INFO:teuthology.orchestra.run.smithi045.stdout: -690> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005cd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.630 INFO:teuthology.orchestra.run.smithi045.stdout: -689> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005ce [2,head] /dc-dir/dc-file_985 auth v5972 s=3 n(v0 rc2023-10-03T19:17:10.479893+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535729080] 2023-10-03T19:21:15.631 INFO:teuthology.orchestra.run.smithi045.stdout: -688> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005ce) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.631 INFO:teuthology.orchestra.run.smithi045.stdout: -687> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005cf [2,head] /dc-dir/dc-file_986 auth v5974 s=3 n(v0 rc2023-10-03T19:17:10.492206+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535729600] 2023-10-03T19:21:15.631 INFO:teuthology.orchestra.run.smithi045.stdout: -686> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005cf) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.631 INFO:teuthology.orchestra.run.smithi045.stdout: -685> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d0 [2,head] /dc-dir/dc-file_987 auth v5976 s=3 n(v0 rc2023-10-03T19:17:10.505312+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535729b80] 2023-10-03T19:21:15.631 INFO:teuthology.orchestra.run.smithi045.stdout: -684> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005d0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.631 INFO:teuthology.orchestra.run.smithi045.stdout: -683> 2023-10-03T19:17:19.586+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d1 [2,head] /dc-dir/dc-file_988 auth v5978 s=3 n(v0 rc2023-10-03T19:17:10.585086+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553572a100] 2023-10-03T19:21:15.631 INFO:teuthology.orchestra.run.smithi045.stdout: -682> 2023-10-03T19:17:19.590+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005d1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.631 INFO:teuthology.orchestra.run.smithi045.stdout: -681> 2023-10-03T19:17:19.590+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d2 [2,head] /dc-dir/dc-file_989 auth v5980 s=3 n(v0 rc2023-10-03T19:17:10.624116+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553572a680] 2023-10-03T19:21:15.631 INFO:teuthology.orchestra.run.smithi045.stdout: -680> 2023-10-03T19:17:19.590+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005d2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.631 INFO:teuthology.orchestra.run.smithi045.stdout: -679> 2023-10-03T19:17:19.590+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d3 [2,head] /dc-dir/dc-file_990 auth v5982 s=3 n(v0 rc2023-10-03T19:17:10.636325+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553572ac00] 2023-10-03T19:21:15.631 INFO:teuthology.orchestra.run.smithi045.stdout: -678> 2023-10-03T19:17:19.590+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005d3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.632 INFO:teuthology.orchestra.run.smithi045.stdout: -677> 2023-10-03T19:17:19.590+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d4 [2,head] /dc-dir/dc-file_991 auth v5984 s=3 n(v0 rc2023-10-03T19:17:10.648066+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553572b180] 2023-10-03T19:21:15.632 INFO:teuthology.orchestra.run.smithi045.stdout: -676> 2023-10-03T19:17:19.590+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005d4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.632 INFO:teuthology.orchestra.run.smithi045.stdout: -675> 2023-10-03T19:17:19.590+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d5 [2,head] /dc-dir/dc-file_992 auth v5986 s=3 n(v0 rc2023-10-03T19:17:10.659229+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553572b700] 2023-10-03T19:21:15.632 INFO:teuthology.orchestra.run.smithi045.stdout: -674> 2023-10-03T19:17:19.590+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005d5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.632 INFO:teuthology.orchestra.run.smithi045.stdout: -673> 2023-10-03T19:17:19.590+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d6 [2,head] /dc-dir/dc-file_993 auth v5988 s=3 n(v0 rc2023-10-03T19:17:10.670994+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553573e000] 2023-10-03T19:21:15.632 INFO:teuthology.orchestra.run.smithi045.stdout: -672> 2023-10-03T19:17:19.590+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005d6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.632 INFO:teuthology.orchestra.run.smithi045.stdout: -671> 2023-10-03T19:17:19.590+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d7 [2,head] /dc-dir/dc-file_994 auth v5990 s=3 n(v0 rc2023-10-03T19:17:10.683030+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553573e580] 2023-10-03T19:21:15.632 INFO:teuthology.orchestra.run.smithi045.stdout: -670> 2023-10-03T19:17:19.590+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005d7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.632 INFO:teuthology.orchestra.run.smithi045.stdout: -669> 2023-10-03T19:17:19.590+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d8 [2,head] /dc-dir/dc-file_995 auth v5992 s=3 n(v0 rc2023-10-03T19:17:10.694512+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553573eb00] 2023-10-03T19:21:15.632 INFO:teuthology.orchestra.run.smithi045.stdout: -668> 2023-10-03T19:17:19.590+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005d8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.633 INFO:teuthology.orchestra.run.smithi045.stdout: -667> 2023-10-03T19:17:19.590+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d9 [2,head] /dc-dir/dc-file_996 auth v5994 s=3 n(v0 rc2023-10-03T19:17:10.705645+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553573f080] 2023-10-03T19:21:15.633 INFO:teuthology.orchestra.run.smithi045.stdout: -666> 2023-10-03T19:17:19.590+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005d9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.633 INFO:teuthology.orchestra.run.smithi045.stdout: -665> 2023-10-03T19:17:19.590+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005da [2,head] /dc-dir/dc-file_997 auth v5996 s=3 n(v0 rc2023-10-03T19:17:10.717049+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553573f600] 2023-10-03T19:21:15.688 INFO:teuthology.orchestra.run.smithi045.stdout: -664> 2023-10-03T19:17:19.590+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005da) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.688 INFO:teuthology.orchestra.run.smithi045.stdout: -663> 2023-10-03T19:17:19.590+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005db [2,head] /dc-dir/dc-file_998 auth v5998 s=3 n(v0 rc2023-10-03T19:17:10.727981+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x56553573fb80] 2023-10-03T19:21:15.688 INFO:teuthology.orchestra.run.smithi045.stdout: -662> 2023-10-03T19:17:19.590+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005db) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.688 INFO:teuthology.orchestra.run.smithi045.stdout: -661> 2023-10-03T19:17:19.590+0000 7f0aaf15e640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005dc [2,head] /dc-dir/dc-file_999 auth v6000 s=3 n(v0 rc2023-10-03T19:17:10.740067+0000 b3 1=1+0) (iversion lock) caps={6102=pAsLsXsFsc/-@2},l=6102(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=1 authpin=0 0x565535740100] 2023-10-03T19:21:15.689 INFO:teuthology.orchestra.run.smithi045.stdout: -660> 2023-10-03T19:17:19.590+0000 7f0aaf15e640 10 mds.0.cache.ino(0x100000005dc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:16:46.301438+0000 change_attr 0 0x565534d4b8c0) 2023-10-03T19:21:15.689 INFO:teuthology.orchestra.run.smithi045.stdout: -659> 2023-10-03T19:17:19.590+0000 7f0aaf15e640 10 mds.0.openfiles remove_dirfrag [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=5377/5377 ap=1+0 state=1610874881|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=312 | child=1 dirty=1 authpin=1 0x565534f82400] 2023-10-03T19:21:15.689 INFO:teuthology.orchestra.run.smithi045.stdout: -658> 2023-10-03T19:17:19.590+0000 7f0aaf15e640 20 mds.0.server killing client lease of [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) v=6007 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x565534f60000] 2023-10-03T19:21:15.689 INFO:teuthology.orchestra.run.smithi045.stdout: -657> 2023-10-03T19:17:19.590+0000 7f0aaf15e640 20 mds.0.cache.den(0x1 dc-dir) remove_client_lease client.6102 on (dn sync l) 2023-10-03T19:21:15.689 INFO:teuthology.orchestra.run.smithi045.stdout: -656> 2023-10-03T19:17:19.590+0000 7f0aaf15e640 10 mds.0.27 send_message_client client.6102 172.21.15.146:0/2314684411 client_session(close) v5 2023-10-03T19:21:15.689 INFO:teuthology.orchestra.run.smithi045.stdout: -655> 2023-10-03T19:17:19.590+0000 7f0aaf15e640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> 172.21.15.146:0/2314684411 -- client_session(close) v5 -- 0x5655352528c0 con 0x565534151400 2023-10-03T19:21:15.689 INFO:teuthology.orchestra.run.smithi045.stdout: -654> 2023-10-03T19:17:19.590+0000 7f0aaf15e640 10 remove_session: mds.metrics: session=0x565534f9e300, client=client.6102 172.21.15.146:0/2314684411 2023-10-03T19:21:15.689 INFO:teuthology.orchestra.run.smithi045.stdout: -653> 2023-10-03T19:17:19.590+0000 7f0aaf15e640 10 mds.0.sessionmap remove_session s=0x565534f9e300 name=client.6102 2023-10-03T19:21:15.689 INFO:teuthology.orchestra.run.smithi045.stdout: -652> 2023-10-03T19:17:19.590+0000 7f0ab0961640 7 mds.0.27 mds has 1 queued contexts 2023-10-03T19:21:15.689 INFO:teuthology.orchestra.run.smithi045.stdout: -651> 2023-10-03T19:17:19.590+0000 7f0ab0961640 10 mds.0.27 finish 0x5655366aef40 2023-10-03T19:21:15.689 INFO:teuthology.orchestra.run.smithi045.stdout: -650> 2023-10-03T19:17:19.590+0000 7f0ab0961640 10 MDSContext::complete: 15C_MDL_DropCache 2023-10-03T19:21:15.690 INFO:teuthology.orchestra.run.smithi045.stdout: -649> 2023-10-03T19:17:19.590+0000 7f0ab0961640 7 mds.0.locker rdlock_finish on (isnap sync) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (inest lock dirty) (ipolicy sync r=1) (iversion lock) | dirtyscattered=1 request=0 lock=1 dirfrag=1 caps=0 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:15.690 INFO:teuthology.orchestra.run.smithi045.stdout: -648> 2023-10-03T19:17:19.590+0000 7f0ab0961640 10 mds.0.locker simple_eval (isnap sync) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (inest lock dirty) (ipolicy sync r=1) (iversion lock) | dirtyscattered=1 request=0 lock=1 dirfrag=1 caps=0 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:15.690 INFO:teuthology.orchestra.run.smithi045.stdout: -647> 2023-10-03T19:17:19.590+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 177 ==== osd_op_reply(2071 10000000005.00000000 [delete] v63'27 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:15.690 INFO:teuthology.orchestra.run.smithi045.stdout: -646> 2023-10-03T19:17:19.590+0000 7f0ab0961640 7 mds.0.locker rdlock_finish on (ipolicy sync) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (inest lock dirty) (iversion lock) | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=0 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:15.690 INFO:teuthology.orchestra.run.smithi045.stdout: -645> 2023-10-03T19:17:19.590+0000 7f0ab0961640 10 mds.0.locker simple_eval (ipolicy sync) on [inode 0x1 [...2,head] / auth v20 snaprealm=0x565534d4b8c0 f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:16:46.301438+0000 1=0+1) (inest lock dirty) (iversion lock) | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=0 dirtyparent=0 dirty=1 authpin=0 0x565534060680] 2023-10-03T19:21:15.690 INFO:teuthology.orchestra.run.smithi045.stdout: -644> 2023-10-03T19:17:19.590+0000 7f0ab0961640 7 mds.0.locker rdlock_finish on (iauth sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6007 ap=1 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=4 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:15.690 INFO:teuthology.orchestra.run.smithi045.stdout: -643> 2023-10-03T19:17:19.590+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 178 ==== osd_op_reply(2109 1000000002b.00000000 [delete] v63'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:15.690 INFO:teuthology.orchestra.run.smithi045.stdout: -642> 2023-10-03T19:17:19.590+0000 7f0ab0961640 10 mds.0.locker simple_eval (iauth sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6007 ap=1 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=4 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:15.690 INFO:teuthology.orchestra.run.smithi045.stdout: -641> 2023-10-03T19:17:19.590+0000 7f0ab0961640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6007 ap=1 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=4 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:15.690 INFO:teuthology.orchestra.run.smithi045.stdout: -640> 2023-10-03T19:17:19.590+0000 7f0ab0961640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6007 ap=1 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl) (iversion lock) | request=0 lock=3 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:15.691 INFO:teuthology.orchestra.run.smithi045.stdout: -639> 2023-10-03T19:17:19.590+0000 7f0ab0961640 20 mds.0.locker is excl 2023-10-03T19:21:15.691 INFO:teuthology.orchestra.run.smithi045.stdout: -638> 2023-10-03T19:17:19.590+0000 7f0ab0961640 7 mds.0.locker file_eval loner_issued= other_issued= xlocker_issued= 2023-10-03T19:21:15.691 INFO:teuthology.orchestra.run.smithi045.stdout: -637> 2023-10-03T19:17:19.590+0000 7f0ab0961640 20 mds.0.locker should lose it 2023-10-03T19:21:15.691 INFO:teuthology.orchestra.run.smithi045.stdout: -636> 2023-10-03T19:17:19.590+0000 7f0ab0961640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6007 ap=1 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl) (iversion lock) | request=0 lock=3 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:15.691 INFO:teuthology.orchestra.run.smithi045.stdout: -635> 2023-10-03T19:17:19.590+0000 7f0ab0961640 7 mds.0.locker rdlock_finish on (isnap sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6007 ap=1 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (inest lock w=1) (ipolicy sync r=1) (iversion lock) | request=0 lock=2 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:15.691 INFO:teuthology.orchestra.run.smithi045.stdout: -634> 2023-10-03T19:17:19.590+0000 7f0ab0961640 10 mds.0.locker simple_eval (isnap sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6007 ap=1 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (inest lock w=1) (ipolicy sync r=1) (iversion lock) | request=0 lock=2 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:15.691 INFO:teuthology.orchestra.run.smithi045.stdout: -633> 2023-10-03T19:17:19.590+0000 7f0ab0961640 7 mds.0.locker wrlock_finish on (inest lock w=1) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6007 ap=1 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (inest lock w=1) (ipolicy sync r=1) (iversion lock) | request=0 lock=2 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:15.691 INFO:teuthology.orchestra.run.smithi045.stdout: -632> 2023-10-03T19:17:19.590+0000 7f0ab0961640 10 mds.0.locker scatter_eval (inest lock) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6007 ap=1 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (inest lock) (ipolicy sync r=1) (iversion lock) | request=0 lock=1 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:15.691 INFO:teuthology.orchestra.run.smithi045.stdout: -631> 2023-10-03T19:17:19.590+0000 7f0ab0961640 7 mds.0.locker rdlock_finish on (ipolicy sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6007 ap=1 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (inest lock) (iversion lock) | request=0 lock=0 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:15.691 INFO:teuthology.orchestra.run.smithi045.stdout: -630> 2023-10-03T19:17:19.590+0000 7f0ab0961640 10 mds.0.locker simple_eval (ipolicy sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6007 ap=1 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (inest lock) (iversion lock) | request=0 lock=0 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=1 0x565534ff7b80] 2023-10-03T19:21:15.691 INFO:teuthology.orchestra.run.smithi045.stdout: -629> 2023-10-03T19:17:19.590+0000 7f0ab0961640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x56553505d080 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6007 f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) (inest lock) (iversion lock) | request=0 lock=0 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=1 waiter=0 authpin=0 0x565534ff7b80] now 0 2023-10-03T19:21:15.692 INFO:teuthology.orchestra.run.smithi045.stdout: -628> 2023-10-03T19:17:19.590+0000 7f0ab0961640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth v=6008 cv=5384/5384 REP dir_auth=0 state=1610612737|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=0 0x565534040d00] by 0x56553505d080 count now 0/0 2023-10-03T19:21:15.692 INFO:teuthology.orchestra.run.smithi045.stdout: -627> 2023-10-03T19:17:19.590+0000 7f0ab0961640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x56553505d080 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=5377/5377 state=1610612737|complete f(v0 m2023-10-03T19:17:10.736697+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:10.740067+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 dirty=312 | child=1 dirty=1 authpin=0 0x565534f82400] count now 0 2023-10-03T19:21:15.692 INFO:teuthology.orchestra.run.smithi045.stdout: -626> 2023-10-03T19:17:19.590+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 975 ==== osd_op_reply(2154 10000000058.00000000 [delete] v63'30 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:15.692 INFO:teuthology.orchestra.run.smithi045.stdout: -625> 2023-10-03T19:17:19.590+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 976 ==== osd_op_reply(2211 10000000091.00000000 [delete] v63'31 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:15.692 INFO:teuthology.orchestra.run.smithi045.stdout: -624> 2023-10-03T19:17:19.590+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 977 ==== osd_op_reply(2229 100000000a3.00000000 [delete] v63'32 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:15.692 INFO:teuthology.orchestra.run.smithi045.stdout: -623> 2023-10-03T19:17:19.590+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 978 ==== osd_op_reply(2328 10000000106.00000000 [delete] v63'33 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:15.692 INFO:teuthology.orchestra.run.smithi045.stdout: -622> 2023-10-03T19:17:19.590+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 979 ==== osd_op_reply(2117 10000000033.00000000 [delete] v63'21 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:15.692 INFO:teuthology.orchestra.run.smithi045.stdout: -621> 2023-10-03T19:17:19.590+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 980 ==== osd_op_reply(2270 100000000cc.00000000 [delete] v63'22 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:15.780 INFO:teuthology.orchestra.run.smithi045.stdout: -620> 2023-10-03T19:17:19.590+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 981 ==== osd_op_reply(2323 10000000101.00000000 [delete] v63'23 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:15.780 INFO:teuthology.orchestra.run.smithi045.stdout: -619> 2023-10-03T19:17:19.590+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 982 ==== osd_op_reply(2533 100000001d3.00000000 [delete] v63'24 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:15.780 INFO:teuthology.orchestra.run.smithi045.stdout: -618> 2023-10-03T19:17:19.590+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 179 ==== osd_op_reply(2076 1000000000a.00000000 [delete] v63'41 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:15.780 INFO:teuthology.orchestra.run.smithi045.stdout: -617> 2023-10-03T19:17:19.594+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 123 ==== osd_op_reply(2079 1000000000d.00000000 [delete] v63'37 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:15.780 INFO:teuthology.orchestra.run.smithi045.stdout: -616> 2023-10-03T19:17:19.594+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 124 ==== osd_op_reply(2153 10000000057.00000000 [delete] v63'43 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:15.780 INFO:teuthology.orchestra.run.smithi045.stdout: -615> 2023-10-03T19:17:19.594+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 125 ==== osd_op_reply(2101 10000000023.00000000 [delete] v63'38 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:15.780 INFO:teuthology.orchestra.run.smithi045.stdout: -614> 2023-10-03T19:17:19.594+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 126 ==== osd_op_reply(2180 10000000072.00000000 [delete] v63'44 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:15.780 INFO:teuthology.orchestra.run.smithi045.stdout: -613> 2023-10-03T19:17:19.594+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 983 ==== osd_op_reply(2102 10000000024.00000000 [delete] v63'37 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:15.780 INFO:teuthology.orchestra.run.smithi045.stdout: -612> 2023-10-03T19:17:19.598+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 149 ==== osd_op_reply(2069 10000000003.00000000 [delete] v63'39 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:15.780 INFO:teuthology.orchestra.run.smithi045.stdout: -611> 2023-10-03T19:17:19.598+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 299 ==== osd_op_reply(2091 10000000019.00000000 [delete] v63'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:15.780 INFO:teuthology.orchestra.run.smithi045.stdout: -610> 2023-10-03T19:17:19.598+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 300 ==== osd_op_reply(2077 1000000000b.00000000 [delete] v63'47 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:15.781 INFO:teuthology.orchestra.run.smithi045.stdout: -609> 2023-10-03T19:17:19.598+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 150 ==== osd_op_reply(2096 1000000001e.00000000 [delete] v63'40 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:15.781 INFO:teuthology.orchestra.run.smithi045.stdout: -608> 2023-10-03T19:17:19.598+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 151 ==== osd_op_reply(2104 10000000026.00000000 [delete] v63'39 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:15.781 INFO:teuthology.orchestra.run.smithi045.stdout: -607> 2023-10-03T19:17:19.598+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 127 ==== osd_op_reply(2108 1000000002a.00000000 [delete] v63'19 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:15.781 INFO:teuthology.orchestra.run.smithi045.stdout: -606> 2023-10-03T19:17:19.602+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 152 ==== osd_op_reply(2129 1000000003f.00000000 [delete] v63'41 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:15.781 INFO:teuthology.orchestra.run.smithi045.stdout: -605> 2023-10-03T19:17:19.602+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 83 ==== osd_op_reply(2156 1000000005a.00000000 [delete] v63'46 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:15.781 INFO:teuthology.orchestra.run.smithi045.stdout: -604> 2023-10-03T19:17:19.602+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 80 ==== osd_op_reply(2089 10000000017.00000000 [delete] v63'21 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:15.781 INFO:teuthology.orchestra.run.smithi045.stdout: -603> 2023-10-03T19:17:19.602+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 301 ==== osd_op_reply(2142 1000000004c.00000000 [delete] v63'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:15.781 INFO:teuthology.orchestra.run.smithi045.stdout: -602> 2023-10-03T19:17:19.602+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 81 ==== osd_op_reply(2092 1000000001a.00000000 [delete] v63'45 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:15.781 INFO:teuthology.orchestra.run.smithi045.stdout: -601> 2023-10-03T19:17:19.602+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 82 ==== osd_op_reply(2093 1000000001b.00000000 [delete] v63'23 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:15.781 INFO:teuthology.orchestra.run.smithi045.stdout: -600> 2023-10-03T19:17:19.602+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 83 ==== osd_op_reply(2126 1000000003c.00000000 [delete] v63'24 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:15.781 INFO:teuthology.orchestra.run.smithi045.stdout: -599> 2023-10-03T19:17:19.602+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 84 ==== osd_op_reply(2137 10000000047.00000000 [delete] v63'25 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:15.781 INFO:teuthology.orchestra.run.smithi045.stdout: -598> 2023-10-03T19:17:19.602+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 984 ==== osd_op_reply(2332 1000000010a.00000000 [delete] v63'34 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:15.782 INFO:teuthology.orchestra.run.smithi045.stdout: -597> 2023-10-03T19:17:19.602+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 84 ==== osd_op_reply(2256 100000000be.00000000 [delete] v63'47 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:15.782 INFO:teuthology.orchestra.run.smithi045.stdout: -596> 2023-10-03T19:17:19.602+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 985 ==== osd_op_reply(2359 10000000125.00000000 [delete] v63'35 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:15.782 INFO:teuthology.orchestra.run.smithi045.stdout: -595> 2023-10-03T19:17:19.602+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 85 ==== osd_op_reply(2259 100000000c1.00000000 [delete] v63'48 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:15.782 INFO:teuthology.orchestra.run.smithi045.stdout: -594> 2023-10-03T19:17:19.602+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 85 ==== osd_op_reply(2166 10000000064.00000000 [delete] v63'46 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:15.782 INFO:teuthology.orchestra.run.smithi045.stdout: -593> 2023-10-03T19:17:19.602+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 193 ==== osd_op_reply(2068 10000000002.00000000 [delete] v63'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.782 INFO:teuthology.orchestra.run.smithi045.stdout: -592> 2023-10-03T19:17:19.602+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 194 ==== osd_op_reply(2081 1000000000f.00000000 [delete] v63'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.782 INFO:teuthology.orchestra.run.smithi045.stdout: -591> 2023-10-03T19:17:19.602+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 195 ==== osd_op_reply(2090 10000000018.00000000 [delete] v63'33 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.782 INFO:teuthology.orchestra.run.smithi045.stdout: -590> 2023-10-03T19:17:19.602+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 196 ==== osd_op_reply(2094 1000000001c.00000000 [delete] v63'39 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.782 INFO:teuthology.orchestra.run.smithi045.stdout: -589> 2023-10-03T19:17:19.602+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 197 ==== osd_op_reply(2133 10000000043.00000000 [delete] v63'40 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.782 INFO:teuthology.orchestra.run.smithi045.stdout: -588> 2023-10-03T19:17:19.602+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 198 ==== osd_op_reply(2146 10000000050.00000000 [delete] v63'41 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.783 INFO:teuthology.orchestra.run.smithi045.stdout: -587> 2023-10-03T19:17:19.602+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 199 ==== osd_op_reply(2159 1000000005d.00000000 [delete] v63'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.783 INFO:teuthology.orchestra.run.smithi045.stdout: -586> 2023-10-03T19:17:19.602+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 200 ==== osd_op_reply(2134 10000000044.00000000 [delete] v63'34 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.783 INFO:teuthology.orchestra.run.smithi045.stdout: -585> 2023-10-03T19:17:19.602+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 201 ==== osd_op_reply(2189 1000000007b.00000000 [delete] v63'27 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.783 INFO:teuthology.orchestra.run.smithi045.stdout: -584> 2023-10-03T19:17:19.602+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 202 ==== osd_op_reply(2150 10000000054.00000000 [delete] v63'37 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.783 INFO:teuthology.orchestra.run.smithi045.stdout: -583> 2023-10-03T19:17:19.602+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 203 ==== osd_op_reply(2163 10000000061.00000000 [delete] v63'38 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.783 INFO:teuthology.orchestra.run.smithi045.stdout: -582> 2023-10-03T19:17:19.602+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 204 ==== osd_op_reply(2170 10000000068.00000000 [delete] v63'23 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.783 INFO:teuthology.orchestra.run.smithi045.stdout: -581> 2023-10-03T19:17:19.602+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 205 ==== osd_op_reply(2380 1000000013a.00000000 [delete] v63'35 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.783 INFO:teuthology.orchestra.run.smithi045.stdout: -580> 2023-10-03T19:17:19.602+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 206 ==== osd_op_reply(2099 10000000021.00000000 [delete] v63'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.783 INFO:teuthology.orchestra.run.smithi045.stdout: -579> 2023-10-03T19:17:19.602+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 207 ==== osd_op_reply(2100 10000000022.00000000 [delete] v63'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.783 INFO:teuthology.orchestra.run.smithi045.stdout: -578> 2023-10-03T19:17:19.602+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 208 ==== osd_op_reply(2149 10000000053.00000000 [delete] v63'42 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.783 INFO:teuthology.orchestra.run.smithi045.stdout: -577> 2023-10-03T19:17:19.602+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 209 ==== osd_op_reply(2112 1000000002e.00000000 [delete] v63'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.783 INFO:teuthology.orchestra.run.smithi045.stdout: -576> 2023-10-03T19:17:19.602+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 210 ==== osd_op_reply(2138 10000000048.00000000 [delete] v63'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.784 INFO:teuthology.orchestra.run.smithi045.stdout: -575> 2023-10-03T19:17:19.602+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 211 ==== osd_op_reply(2215 10000000095.00000000 [delete] v63'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.784 INFO:teuthology.orchestra.run.smithi045.stdout: -574> 2023-10-03T19:17:19.602+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 212 ==== osd_op_reply(2220 1000000009a.00000000 [delete] v63'39 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.784 INFO:teuthology.orchestra.run.smithi045.stdout: -573> 2023-10-03T19:17:19.602+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 213 ==== osd_op_reply(2148 10000000052.00000000 [delete] v63'33 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.829 INFO:teuthology.orchestra.run.smithi045.stdout: -572> 2023-10-03T19:17:19.606+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 86 ==== osd_op_reply(2281 100000000d7.00000000 [delete] v63'49 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:15.829 INFO:teuthology.orchestra.run.smithi045.stdout: -571> 2023-10-03T19:17:19.606+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 87 ==== osd_op_reply(2158 1000000005c.00000000 [delete] v63'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:15.830 INFO:teuthology.orchestra.run.smithi045.stdout: -570> 2023-10-03T19:17:19.606+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 88 ==== osd_op_reply(2164 10000000062.00000000 [delete] v63'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:15.830 INFO:teuthology.orchestra.run.smithi045.stdout: -569> 2023-10-03T19:17:19.606+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 89 ==== osd_op_reply(2193 1000000007f.00000000 [delete] v63'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:15.830 INFO:teuthology.orchestra.run.smithi045.stdout: -568> 2023-10-03T19:17:19.606+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 90 ==== osd_op_reply(2194 10000000080.00000000 [delete] v63'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:15.830 INFO:teuthology.orchestra.run.smithi045.stdout: -567> 2023-10-03T19:17:19.610+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 86 ==== osd_op_reply(2191 1000000007d.00000000 [delete] v63'22 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:15.830 INFO:teuthology.orchestra.run.smithi045.stdout: -566> 2023-10-03T19:17:19.610+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 87 ==== osd_op_reply(2282 100000000d8.00000000 [delete] v63'23 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:15.830 INFO:teuthology.orchestra.run.smithi045.stdout: -565> 2023-10-03T19:17:19.610+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 88 ==== osd_op_reply(2201 10000000087.00000000 [delete] v63'26 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:15.830 INFO:teuthology.orchestra.run.smithi045.stdout: -564> 2023-10-03T19:17:19.610+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 89 ==== osd_op_reply(2356 10000000122.00000000 [delete] v63'24 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:15.830 INFO:teuthology.orchestra.run.smithi045.stdout: -563> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 986 ==== osd_op_reply(2528 100000001ce.00000000 [delete] v63'36 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:15.830 INFO:teuthology.orchestra.run.smithi045.stdout: -562> 2023-10-03T19:17:19.610+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 90 ==== osd_op_reply(2244 100000000b2.00000000 [delete] v63'47 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:15.830 INFO:teuthology.orchestra.run.smithi045.stdout: -561> 2023-10-03T19:17:19.610+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 91 ==== osd_op_reply(2472 10000000196.00000000 [delete] v63'25 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:15.830 INFO:teuthology.orchestra.run.smithi045.stdout: -560> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 987 ==== osd_op_reply(2552 100000001e6.00000000 [delete] v63'37 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:15.830 INFO:teuthology.orchestra.run.smithi045.stdout: -559> 2023-10-03T19:17:19.610+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 92 ==== osd_op_reply(2205 1000000008b.00000000 [delete] v63'27 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:15.831 INFO:teuthology.orchestra.run.smithi045.stdout: -558> 2023-10-03T19:17:19.610+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 91 ==== osd_op_reply(2275 100000000d1.00000000 [delete] v63'34 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:15.831 INFO:teuthology.orchestra.run.smithi045.stdout: -557> 2023-10-03T19:17:19.610+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 180 ==== osd_op_reply(2365 1000000012b.00000000 [delete] v63'28 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:15.831 INFO:teuthology.orchestra.run.smithi045.stdout: -556> 2023-10-03T19:17:19.610+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 92 ==== osd_op_reply(2301 100000000eb.00000000 [delete] v63'35 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:15.831 INFO:teuthology.orchestra.run.smithi045.stdout: -555> 2023-10-03T19:17:19.610+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 93 ==== osd_op_reply(2466 10000000190.00000000 [delete] v63'36 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:15.831 INFO:teuthology.orchestra.run.smithi045.stdout: -554> 2023-10-03T19:17:19.610+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 94 ==== osd_op_reply(2521 100000001c7.00000000 [delete] v63'37 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:15.831 INFO:teuthology.orchestra.run.smithi045.stdout: -553> 2023-10-03T19:17:19.610+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 93 ==== osd_op_reply(2241 100000000af.00000000 [delete] v63'28 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:15.831 INFO:teuthology.orchestra.run.smithi045.stdout: -552> 2023-10-03T19:17:19.610+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 181 ==== osd_op_reply(2111 1000000002d.00000000 [delete] v63'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:15.831 INFO:teuthology.orchestra.run.smithi045.stdout: -551> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 988 ==== osd_op_reply(2559 100000001ed.00000000 [delete] v63'38 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:15.831 INFO:teuthology.orchestra.run.smithi045.stdout: -550> 2023-10-03T19:17:19.610+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 94 ==== osd_op_reply(2406 10000000154.00000000 [delete] v63'48 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:15.831 INFO:teuthology.orchestra.run.smithi045.stdout: -549> 2023-10-03T19:17:19.610+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 182 ==== osd_op_reply(2122 10000000038.00000000 [delete] v63'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:15.831 INFO:teuthology.orchestra.run.smithi045.stdout: -548> 2023-10-03T19:17:19.610+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 95 ==== osd_op_reply(2379 10000000139.00000000 [delete] v63'29 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:15.832 INFO:teuthology.orchestra.run.smithi045.stdout: -547> 2023-10-03T19:17:19.610+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 96 ==== osd_op_reply(2461 1000000018b.00000000 [delete] v63'49 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:15.832 INFO:teuthology.orchestra.run.smithi045.stdout: -546> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 302 ==== osd_op_reply(2145 1000000004f.00000000 [delete] v63'33 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:15.832 INFO:teuthology.orchestra.run.smithi045.stdout: -545> 2023-10-03T19:17:19.610+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 97 ==== osd_op_reply(2416 1000000015e.00000000 [delete] v63'30 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:15.832 INFO:teuthology.orchestra.run.smithi045.stdout: -544> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 128 ==== osd_op_reply(2125 1000000003b.00000000 [delete] v63'20 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:15.832 INFO:teuthology.orchestra.run.smithi045.stdout: -543> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 129 ==== osd_op_reply(2206 1000000008c.00000000 [delete] v63'21 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:15.832 INFO:teuthology.orchestra.run.smithi045.stdout: -542> 2023-10-03T19:17:19.610+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 183 ==== osd_op_reply(2358 10000000124.00000000 [delete] v63'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:15.832 INFO:teuthology.orchestra.run.smithi045.stdout: -541> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 130 ==== osd_op_reply(2239 100000000ad.00000000 [delete] v63'22 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:15.914 INFO:teuthology.orchestra.run.smithi045.stdout: -540> 2023-10-03T19:17:19.610+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 184 ==== osd_op_reply(2136 10000000046.00000000 [delete] v63'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:15.914 INFO:teuthology.orchestra.run.smithi045.stdout: -539> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 131 ==== osd_op_reply(2409 10000000157.00000000 [delete] v63'23 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:15.914 INFO:teuthology.orchestra.run.smithi045.stdout: -538> 2023-10-03T19:17:19.610+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 185 ==== osd_op_reply(2413 1000000015b.00000000 [delete] v63'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:15.914 INFO:teuthology.orchestra.run.smithi045.stdout: -537> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 303 ==== osd_op_reply(2160 1000000005e.00000000 [delete] v63'34 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:15.915 INFO:teuthology.orchestra.run.smithi045.stdout: -536> 2023-10-03T19:17:19.610+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 98 ==== osd_op_reply(2462 1000000018c.00000000 [delete] v63'50 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:15.915 INFO:teuthology.orchestra.run.smithi045.stdout: -535> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 304 ==== osd_op_reply(2177 1000000006f.00000000 [delete] v63'35 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:15.915 INFO:teuthology.orchestra.run.smithi045.stdout: -534> 2023-10-03T19:17:19.610+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 95 ==== osd_op_reply(2114 10000000030.00000000 [delete] v63'27 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:15.915 INFO:teuthology.orchestra.run.smithi045.stdout: -533> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 305 ==== osd_op_reply(2248 100000000b6.00000000 [delete] v63'36 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:15.915 INFO:teuthology.orchestra.run.smithi045.stdout: -532> 2023-10-03T19:17:19.610+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 96 ==== osd_op_reply(2162 10000000060.00000000 [delete] v63'28 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:15.915 INFO:teuthology.orchestra.run.smithi045.stdout: -531> 2023-10-03T19:17:19.610+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 97 ==== osd_op_reply(2171 10000000069.00000000 [delete] v63'29 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:15.915 INFO:teuthology.orchestra.run.smithi045.stdout: -530> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 989 ==== osd_op_reply(2566 100000001f4.00000000 [delete] v63'39 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:15.915 INFO:teuthology.orchestra.run.smithi045.stdout: -529> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 132 ==== osd_op_reply(2072 10000000006.00000000 [delete] v63'25 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:15.915 INFO:teuthology.orchestra.run.smithi045.stdout: -528> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 133 ==== osd_op_reply(2110 1000000002c.00000000 [delete] v63'26 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:15.915 INFO:teuthology.orchestra.run.smithi045.stdout: -527> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 134 ==== osd_op_reply(2243 100000000b1.00000000 [delete] v63'27 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:15.915 INFO:teuthology.orchestra.run.smithi045.stdout: -526> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 135 ==== osd_op_reply(2264 100000000c6.00000000 [delete] v63'39 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:15.916 INFO:teuthology.orchestra.run.smithi045.stdout: -525> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 136 ==== osd_op_reply(2277 100000000d3.00000000 [delete] v63'40 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:15.916 INFO:teuthology.orchestra.run.smithi045.stdout: -524> 2023-10-03T19:17:19.610+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 99 ==== osd_op_reply(2476 1000000019a.00000000 [delete] v63'51 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:15.916 INFO:teuthology.orchestra.run.smithi045.stdout: -523> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 990 ==== osd_op_reply(2147 10000000051.00000000 [delete] v63'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:15.916 INFO:teuthology.orchestra.run.smithi045.stdout: -522> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 991 ==== osd_op_reply(2188 1000000007a.00000000 [delete] v63'19 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:15.916 INFO:teuthology.orchestra.run.smithi045.stdout: -521> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 214 ==== osd_op_reply(2209 1000000008f.00000000 [delete] v63'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.916 INFO:teuthology.orchestra.run.smithi045.stdout: -520> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 215 ==== osd_op_reply(2233 100000000a7.00000000 [delete] v63'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.916 INFO:teuthology.orchestra.run.smithi045.stdout: -519> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 216 ==== osd_op_reply(2082 10000000010.00000000 [delete] v63'37 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.916 INFO:teuthology.orchestra.run.smithi045.stdout: -518> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 217 ==== osd_op_reply(2235 100000000a9.00000000 [delete] v63'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.916 INFO:teuthology.orchestra.run.smithi045.stdout: -517> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 218 ==== osd_op_reply(2292 100000000e2.00000000 [delete] v63'41 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.916 INFO:teuthology.orchestra.run.smithi045.stdout: -516> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 219 ==== osd_op_reply(2313 100000000f7.00000000 [delete] v63'42 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.916 INFO:teuthology.orchestra.run.smithi045.stdout: -515> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 220 ==== osd_op_reply(2124 1000000003a.00000000 [delete] v63'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.917 INFO:teuthology.orchestra.run.smithi045.stdout: -514> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 221 ==== osd_op_reply(2139 10000000049.00000000 [delete] v63'36 uv35 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.917 INFO:teuthology.orchestra.run.smithi045.stdout: -513> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 222 ==== osd_op_reply(2319 100000000fd.00000000 [delete] v63'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.917 INFO:teuthology.orchestra.run.smithi045.stdout: -512> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 223 ==== osd_op_reply(2355 10000000121.00000000 [delete] v63'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.917 INFO:teuthology.orchestra.run.smithi045.stdout: -511> 2023-10-03T19:17:19.610+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 98 ==== osd_op_reply(2376 10000000136.00000000 [delete] v63'50 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:15.917 INFO:teuthology.orchestra.run.smithi045.stdout: -510> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 224 ==== osd_op_reply(2366 1000000012c.00000000 [delete] v63'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.917 INFO:teuthology.orchestra.run.smithi045.stdout: -509> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 225 ==== osd_op_reply(2167 10000000065.00000000 [delete] v63'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.917 INFO:teuthology.orchestra.run.smithi045.stdout: -508> 2023-10-03T19:17:19.610+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 99 ==== osd_op_reply(2449 1000000017f.00000000 [delete] v63'51 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:15.917 INFO:teuthology.orchestra.run.smithi045.stdout: -507> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 226 ==== osd_op_reply(2266 100000000c8.00000000 [delete] v63'33 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.917 INFO:teuthology.orchestra.run.smithi045.stdout: -506> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 227 ==== osd_op_reply(2288 100000000de.00000000 [delete] v63'34 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.917 INFO:teuthology.orchestra.run.smithi045.stdout: -505> 2023-10-03T19:17:19.610+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 100 ==== osd_op_reply(2459 10000000189.00000000 [delete] v63'52 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:15.917 INFO:teuthology.orchestra.run.smithi045.stdout: -504> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 306 ==== osd_op_reply(2284 100000000da.00000000 [delete] v63'37 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:15.918 INFO:teuthology.orchestra.run.smithi045.stdout: -503> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 307 ==== osd_op_reply(2434 10000000170.00000000 [delete] v63'38 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:15.918 INFO:teuthology.orchestra.run.smithi045.stdout: -502> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 308 ==== osd_op_reply(2440 10000000176.00000000 [delete] v63'39 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:15.918 INFO:teuthology.orchestra.run.smithi045.stdout: -501> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 309 ==== osd_op_reply(2441 10000000177.00000000 [delete] v63'40 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:15.918 INFO:teuthology.orchestra.run.smithi045.stdout: -500> 2023-10-03T19:17:19.610+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 100 ==== osd_op_reply(2480 1000000019e.00000000 [delete] v63'52 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:15.918 INFO:teuthology.orchestra.run.smithi045.stdout: -499> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 992 ==== osd_op_reply(2187 10000000079.00000000 [delete] v63'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:15.918 INFO:teuthology.orchestra.run.smithi045.stdout: -498> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 993 ==== osd_op_reply(2242 100000000b0.00000000 [delete] v63'33 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:15.918 INFO:teuthology.orchestra.run.smithi045.stdout: -497> 2023-10-03T19:17:19.610+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 101 ==== osd_op_reply(2512 100000001be.00000000 [delete] v63'53 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:15.918 INFO:teuthology.orchestra.run.smithi045.stdout: -496> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 994 ==== osd_op_reply(2255 100000000bd.00000000 [delete] v63'20 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:15.918 INFO:teuthology.orchestra.run.smithi045.stdout: -495> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 995 ==== osd_op_reply(2140 1000000004a.00000000 [delete] v63'38 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:15.981 INFO:teuthology.orchestra.run.smithi045.stdout: -494> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 996 ==== osd_op_reply(2258 100000000c0.00000000 [delete] v63'21 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:15.981 INFO:teuthology.orchestra.run.smithi045.stdout: -493> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 997 ==== osd_op_reply(2268 100000000ca.00000000 [delete] v63'22 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:15.981 INFO:teuthology.orchestra.run.smithi045.stdout: -492> 2023-10-03T19:17:19.610+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 310 ==== osd_op_reply(2465 1000000018f.00000000 [delete] v63'41 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:15.981 INFO:teuthology.orchestra.run.smithi045.stdout: -491> 2023-10-03T19:17:19.610+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 102 ==== osd_op_reply(2523 100000001c9.00000000 [delete] v63'31 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:15.981 INFO:teuthology.orchestra.run.smithi045.stdout: -490> 2023-10-03T19:17:19.614+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 998 ==== osd_op_reply(2362 10000000128.00000000 [delete] v63'23 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:15.981 INFO:teuthology.orchestra.run.smithi045.stdout: -489> 2023-10-03T19:17:19.614+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 999 ==== osd_op_reply(2368 1000000012e.00000000 [delete] v63'24 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:15.981 INFO:teuthology.orchestra.run.smithi045.stdout: -488> 2023-10-03T19:17:19.614+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 311 ==== osd_op_reply(2527 100000001cd.00000000 [delete] v63'42 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:15.981 INFO:teuthology.orchestra.run.smithi045.stdout: -487> 2023-10-03T19:17:19.614+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 186 ==== osd_op_reply(2165 10000000063.00000000 [delete] v63'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:15.982 INFO:teuthology.orchestra.run.smithi045.stdout: -486> 2023-10-03T19:17:19.614+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 187 ==== osd_op_reply(2197 10000000083.00000000 [delete] v63'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:15.982 INFO:teuthology.orchestra.run.smithi045.stdout: -485> 2023-10-03T19:17:19.614+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 228 ==== osd_op_reply(2278 100000000d4.00000000 [delete] v63'34 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.982 INFO:teuthology.orchestra.run.smithi045.stdout: -484> 2023-10-03T19:17:19.614+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 229 ==== osd_op_reply(2315 100000000f9.00000000 [delete] v63'35 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.982 INFO:teuthology.orchestra.run.smithi045.stdout: -483> 2023-10-03T19:17:19.614+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 230 ==== osd_op_reply(2312 100000000f6.00000000 [delete] v63'35 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.982 INFO:teuthology.orchestra.run.smithi045.stdout: -482> 2023-10-03T19:17:19.614+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 231 ==== osd_op_reply(2317 100000000fb.00000000 [delete] v63'40 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.982 INFO:teuthology.orchestra.run.smithi045.stdout: -481> 2023-10-03T19:17:19.614+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 232 ==== osd_op_reply(2350 1000000011c.00000000 [delete] v63'36 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.982 INFO:teuthology.orchestra.run.smithi045.stdout: -480> 2023-10-03T19:17:19.614+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 233 ==== osd_op_reply(2340 10000000112.00000000 [delete] v63'41 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.982 INFO:teuthology.orchestra.run.smithi045.stdout: -479> 2023-10-03T19:17:19.614+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 234 ==== osd_op_reply(2342 10000000114.00000000 [delete] v63'42 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.982 INFO:teuthology.orchestra.run.smithi045.stdout: -478> 2023-10-03T19:17:19.614+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 235 ==== osd_op_reply(2361 10000000127.00000000 [delete] v63'43 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.982 INFO:teuthology.orchestra.run.smithi045.stdout: -477> 2023-10-03T19:17:19.614+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 137 ==== osd_op_reply(2204 1000000008a.00000000 [delete] v63'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:15.983 INFO:teuthology.orchestra.run.smithi045.stdout: -476> 2023-10-03T19:17:19.614+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 153 ==== osd_op_reply(2116 10000000032.00000000 [delete] v63'39 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:15.983 INFO:teuthology.orchestra.run.smithi045.stdout: -475> 2023-10-03T19:17:19.614+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 138 ==== osd_op_reply(2200 10000000086.00000000 [delete] v63'45 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:15.983 INFO:teuthology.orchestra.run.smithi045.stdout: -474> 2023-10-03T19:17:19.614+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 139 ==== osd_op_reply(2218 10000000098.00000000 [delete] v63'46 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:15.983 INFO:teuthology.orchestra.run.smithi045.stdout: -473> 2023-10-03T19:17:19.614+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 140 ==== osd_op_reply(2316 100000000fa.00000000 [delete] v63'47 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:15.983 INFO:teuthology.orchestra.run.smithi045.stdout: -472> 2023-10-03T19:17:19.614+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 141 ==== osd_op_reply(2389 10000000143.00000000 [delete] v63'48 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:15.983 INFO:teuthology.orchestra.run.smithi045.stdout: -471> 2023-10-03T19:17:19.614+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 142 ==== osd_op_reply(2488 100000001a6.00000000 [delete] v63'49 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:15.983 INFO:teuthology.orchestra.run.smithi045.stdout: -470> 2023-10-03T19:17:19.614+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 143 ==== osd_op_reply(2291 100000000e1.00000000 [delete] v63'41 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:15.983 INFO:teuthology.orchestra.run.smithi045.stdout: -469> 2023-10-03T19:17:19.618+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 144 ==== osd_op_reply(2344 10000000116.00000000 [delete] v63'42 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:15.983 INFO:teuthology.orchestra.run.smithi045.stdout: -468> 2023-10-03T19:17:19.618+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 145 ==== osd_op_reply(2377 10000000137.00000000 [delete] v63'43 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:15.983 INFO:teuthology.orchestra.run.smithi045.stdout: -467> 2023-10-03T19:17:19.618+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 146 ==== osd_op_reply(2396 1000000014a.00000000 [delete] v63'44 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:15.983 INFO:teuthology.orchestra.run.smithi045.stdout: -466> 2023-10-03T19:17:19.618+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 147 ==== osd_op_reply(2438 10000000174.00000000 [delete] v63'45 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:15.984 INFO:teuthology.orchestra.run.smithi045.stdout: -465> 2023-10-03T19:17:19.618+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1000 ==== osd_op_reply(2217 10000000097.00000000 [delete] v63'23 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:15.984 INFO:teuthology.orchestra.run.smithi045.stdout: -464> 2023-10-03T19:17:19.618+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1001 ==== osd_op_reply(2246 100000000b4.00000000 [delete] v63'24 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:15.984 INFO:teuthology.orchestra.run.smithi045.stdout: -463> 2023-10-03T19:17:19.618+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 312 ==== osd_op_reply(2083 10000000011.00000000 [delete] v63'27 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:15.984 INFO:teuthology.orchestra.run.smithi045.stdout: -462> 2023-10-03T19:17:19.618+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 188 ==== osd_op_reply(2095 1000000001d.00000000 [delete] v63'43 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:15.984 INFO:teuthology.orchestra.run.smithi045.stdout: -461> 2023-10-03T19:17:19.618+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 148 ==== osd_op_reply(2493 100000001ab.00000000 [delete] v63'50 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:15.984 INFO:teuthology.orchestra.run.smithi045.stdout: -460> 2023-10-03T19:17:19.618+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 101 ==== osd_op_reply(2304 100000000ee.00000000 [delete] v63'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:15.984 INFO:teuthology.orchestra.run.smithi045.stdout: -459> 2023-10-03T19:17:19.618+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 103 ==== osd_op_reply(2183 10000000075.00000000 [delete] v63'23 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:15.984 INFO:teuthology.orchestra.run.smithi045.stdout: -458> 2023-10-03T19:17:19.618+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 102 ==== osd_op_reply(2330 10000000108.00000000 [delete] v63'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:15.984 INFO:teuthology.orchestra.run.smithi045.stdout: -457> 2023-10-03T19:17:19.618+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 236 ==== osd_op_reply(2391 10000000145.00000000 [delete] v63'36 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.984 INFO:teuthology.orchestra.run.smithi045.stdout: -456> 2023-10-03T19:17:19.618+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 237 ==== osd_op_reply(2405 10000000153.00000000 [delete] v63'28 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.984 INFO:teuthology.orchestra.run.smithi045.stdout: -455> 2023-10-03T19:17:19.618+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 238 ==== osd_op_reply(2084 10000000012.00000000 [delete] v63'33 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.985 INFO:teuthology.orchestra.run.smithi045.stdout: -454> 2023-10-03T19:17:19.618+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 239 ==== osd_op_reply(2105 10000000027.00000000 [delete] v63'34 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.985 INFO:teuthology.orchestra.run.smithi045.stdout: -453> 2023-10-03T19:17:19.618+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 240 ==== osd_op_reply(2231 100000000a5.00000000 [delete] v63'24 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.985 INFO:teuthology.orchestra.run.smithi045.stdout: -452> 2023-10-03T19:17:19.618+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 241 ==== osd_op_reply(2262 100000000c4.00000000 [delete] v63'25 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:15.985 INFO:teuthology.orchestra.run.smithi045.stdout: -451> 2023-10-03T19:17:19.618+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 103 ==== osd_op_reply(2337 1000000010f.00000000 [delete] v63'41 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:16.064 INFO:teuthology.orchestra.run.smithi045.stdout: -450> 2023-10-03T19:17:19.618+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 242 ==== osd_op_reply(2280 100000000d6.00000000 [delete] v63'26 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.064 INFO:teuthology.orchestra.run.smithi045.stdout: -449> 2023-10-03T19:17:19.618+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 243 ==== osd_op_reply(2381 1000000013b.00000000 [delete] v63'27 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.065 INFO:teuthology.orchestra.run.smithi045.stdout: -448> 2023-10-03T19:17:19.618+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 104 ==== osd_op_reply(2474 10000000198.00000000 [delete] v63'42 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:16.065 INFO:teuthology.orchestra.run.smithi045.stdout: -447> 2023-10-03T19:17:19.618+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 105 ==== osd_op_reply(2555 100000001e9.00000000 [delete] v63'43 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:16.065 INFO:teuthology.orchestra.run.smithi045.stdout: -446> 2023-10-03T19:17:19.618+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 104 ==== osd_op_reply(2198 10000000084.00000000 [delete] v63'24 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:16.065 INFO:teuthology.orchestra.run.smithi045.stdout: -445> 2023-10-03T19:17:19.618+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 149 ==== osd_op_reply(2346 10000000118.00000000 [delete] v63'28 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.065 INFO:teuthology.orchestra.run.smithi045.stdout: -444> 2023-10-03T19:17:19.618+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 150 ==== osd_op_reply(2371 10000000131.00000000 [delete] v63'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.065 INFO:teuthology.orchestra.run.smithi045.stdout: -443> 2023-10-03T19:17:19.618+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 151 ==== osd_op_reply(2384 1000000013e.00000000 [delete] v63'33 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.065 INFO:teuthology.orchestra.run.smithi045.stdout: -442> 2023-10-03T19:17:19.618+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 152 ==== osd_op_reply(2500 100000001b2.00000000 [delete] v63'51 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.065 INFO:teuthology.orchestra.run.smithi045.stdout: -441> 2023-10-03T19:17:19.618+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 153 ==== osd_op_reply(2411 10000000159.00000000 [delete] v63'34 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.065 INFO:teuthology.orchestra.run.smithi045.stdout: -440> 2023-10-03T19:17:19.618+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 154 ==== osd_op_reply(2544 100000001de.00000000 [delete] v63'52 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.065 INFO:teuthology.orchestra.run.smithi045.stdout: -439> 2023-10-03T19:17:19.622+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 155 ==== osd_op_reply(2451 10000000181.00000000 [delete] v63'35 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.065 INFO:teuthology.orchestra.run.smithi045.stdout: -438> 2023-10-03T19:17:19.622+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 154 ==== osd_op_reply(2113 1000000002f.00000000 [delete] v63'29 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.066 INFO:teuthology.orchestra.run.smithi045.stdout: -437> 2023-10-03T19:17:19.622+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 155 ==== osd_op_reply(2080 1000000000e.00000000 [delete] v63'37 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.066 INFO:teuthology.orchestra.run.smithi045.stdout: -436> 2023-10-03T19:17:19.622+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 189 ==== osd_op_reply(2207 1000000008d.00000000 [delete] v63'41 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.066 INFO:teuthology.orchestra.run.smithi045.stdout: -435> 2023-10-03T19:17:19.622+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1002 ==== osd_op_reply(2273 100000000cf.00000000 [delete] v63'34 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.066 INFO:teuthology.orchestra.run.smithi045.stdout: -434> 2023-10-03T19:17:19.622+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 190 ==== osd_op_reply(2238 100000000ac.00000000 [delete] v63'42 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.066 INFO:teuthology.orchestra.run.smithi045.stdout: -433> 2023-10-03T19:17:19.622+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1003 ==== osd_op_reply(2390 10000000144.00000000 [delete] v63'35 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.066 INFO:teuthology.orchestra.run.smithi045.stdout: -432> 2023-10-03T19:17:19.622+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 191 ==== osd_op_reply(2287 100000000dd.00000000 [delete] v63'43 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.066 INFO:teuthology.orchestra.run.smithi045.stdout: -431> 2023-10-03T19:17:19.622+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1004 ==== osd_op_reply(2467 10000000191.00000000 [delete] v63'36 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.066 INFO:teuthology.orchestra.run.smithi045.stdout: -430> 2023-10-03T19:17:19.622+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1005 ==== osd_op_reply(2202 10000000088.00000000 [delete] v63'39 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.066 INFO:teuthology.orchestra.run.smithi045.stdout: -429> 2023-10-03T19:17:19.622+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 192 ==== osd_op_reply(2335 1000000010d.00000000 [delete] v63'44 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.066 INFO:teuthology.orchestra.run.smithi045.stdout: -428> 2023-10-03T19:17:19.622+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1006 ==== osd_op_reply(2257 100000000bf.00000000 [delete] v63'40 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.067 INFO:teuthology.orchestra.run.smithi045.stdout: -427> 2023-10-03T19:17:19.622+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1007 ==== osd_op_reply(2374 10000000134.00000000 [delete] v63'25 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.067 INFO:teuthology.orchestra.run.smithi045.stdout: -426> 2023-10-03T19:17:19.622+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1008 ==== osd_op_reply(2505 100000001b7.00000000 [delete] v63'37 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.067 INFO:teuthology.orchestra.run.smithi045.stdout: -425> 2023-10-03T19:17:19.622+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 193 ==== osd_op_reply(2338 10000000110.00000000 [delete] v63'45 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.067 INFO:teuthology.orchestra.run.smithi045.stdout: -424> 2023-10-03T19:17:19.622+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1009 ==== osd_op_reply(2289 100000000df.00000000 [delete] v63'41 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.067 INFO:teuthology.orchestra.run.smithi045.stdout: -423> 2023-10-03T19:17:19.622+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 194 ==== osd_op_reply(2120 10000000036.00000000 [delete] v63'45 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.067 INFO:teuthology.orchestra.run.smithi045.stdout: -422> 2023-10-03T19:17:19.622+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1010 ==== osd_op_reply(2401 1000000014f.00000000 [delete] v63'26 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.067 INFO:teuthology.orchestra.run.smithi045.stdout: -421> 2023-10-03T19:17:19.622+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1011 ==== osd_op_reply(2510 100000001bc.00000000 [delete] v63'38 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.067 INFO:teuthology.orchestra.run.smithi045.stdout: -420> 2023-10-03T19:17:19.622+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1012 ==== osd_op_reply(2423 10000000165.00000000 [delete] v63'42 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.067 INFO:teuthology.orchestra.run.smithi045.stdout: -419> 2023-10-03T19:17:19.622+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 195 ==== osd_op_reply(2422 10000000164.00000000 [delete] v63'46 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.067 INFO:teuthology.orchestra.run.smithi045.stdout: -418> 2023-10-03T19:17:19.622+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 196 ==== osd_op_reply(2435 10000000171.00000000 [delete] v63'47 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.067 INFO:teuthology.orchestra.run.smithi045.stdout: -417> 2023-10-03T19:17:19.622+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 106 ==== osd_op_reply(2195 10000000081.00000000 [delete] v63'30 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:16.068 INFO:teuthology.orchestra.run.smithi045.stdout: -416> 2023-10-03T19:17:19.622+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 107 ==== osd_op_reply(2290 100000000e0.00000000 [delete] v63'31 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:16.068 INFO:teuthology.orchestra.run.smithi045.stdout: -415> 2023-10-03T19:17:19.622+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 105 ==== osd_op_reply(2227 100000000a1.00000000 [delete] v63'25 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:16.068 INFO:teuthology.orchestra.run.smithi045.stdout: -414> 2023-10-03T19:17:19.622+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 106 ==== osd_op_reply(2253 100000000bb.00000000 [delete] v63'26 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:16.068 INFO:teuthology.orchestra.run.smithi045.stdout: -413> 2023-10-03T19:17:19.622+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 107 ==== osd_op_reply(2299 100000000e9.00000000 [delete] v63'27 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:16.068 INFO:teuthology.orchestra.run.smithi045.stdout: -412> 2023-10-03T19:17:19.622+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 108 ==== osd_op_reply(2302 100000000ec.00000000 [delete] v63'28 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:16.068 INFO:teuthology.orchestra.run.smithi045.stdout: -411> 2023-10-03T19:17:19.622+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 197 ==== osd_op_reply(2470 10000000194.00000000 [delete] v63'48 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.068 INFO:teuthology.orchestra.run.smithi045.stdout: -410> 2023-10-03T19:17:19.622+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 198 ==== osd_op_reply(2526 100000001cc.00000000 [delete] v63'49 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.068 INFO:teuthology.orchestra.run.smithi045.stdout: -409> 2023-10-03T19:17:19.622+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 109 ==== osd_op_reply(2369 1000000012f.00000000 [delete] v63'29 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:16.068 INFO:teuthology.orchestra.run.smithi045.stdout: -408> 2023-10-03T19:17:19.622+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 110 ==== osd_op_reply(2412 1000000015a.00000000 [delete] v63'30 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:16.068 INFO:teuthology.orchestra.run.smithi045.stdout: -407> 2023-10-03T19:17:19.622+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 108 ==== osd_op_reply(2347 10000000119.00000000 [delete] v63'32 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:16.068 INFO:teuthology.orchestra.run.smithi045.stdout: -406> 2023-10-03T19:17:19.622+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1013 ==== osd_op_reply(2513 100000001bf.00000000 [delete] v63'39 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.069 INFO:teuthology.orchestra.run.smithi045.stdout: -405> 2023-10-03T19:17:19.622+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 111 ==== osd_op_reply(2509 100000001bb.00000000 [delete] v63'31 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:16.069 INFO:teuthology.orchestra.run.smithi045.stdout: -404> 2023-10-03T19:17:19.622+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1014 ==== osd_op_reply(2424 10000000166.00000000 [delete] v63'43 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.069 INFO:teuthology.orchestra.run.smithi045.stdout: -403> 2023-10-03T19:17:19.622+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1015 ==== osd_op_reply(2514 100000001c0.00000000 [delete] v63'40 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.069 INFO:teuthology.orchestra.run.smithi045.stdout: -402> 2023-10-03T19:17:19.622+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1016 ==== osd_op_reply(2437 10000000173.00000000 [delete] v63'44 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.069 INFO:teuthology.orchestra.run.smithi045.stdout: -401> 2023-10-03T19:17:19.622+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 313 ==== osd_op_reply(2172 1000000006a.00000000 [delete] v63'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.069 INFO:teuthology.orchestra.run.smithi045.stdout: -400> 2023-10-03T19:17:19.622+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 314 ==== osd_op_reply(2212 10000000092.00000000 [delete] v63'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.069 INFO:teuthology.orchestra.run.smithi045.stdout: -399> 2023-10-03T19:17:19.622+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 315 ==== osd_op_reply(2213 10000000093.00000000 [delete] v63'33 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.069 INFO:teuthology.orchestra.run.smithi045.stdout: -398> 2023-10-03T19:17:19.622+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 316 ==== osd_op_reply(2115 10000000031.00000000 [delete] v63'29 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.123 INFO:teuthology.orchestra.run.smithi045.stdout: -397> 2023-10-03T19:17:19.622+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 317 ==== osd_op_reply(2230 100000000a4.00000000 [delete] v63'34 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.123 INFO:teuthology.orchestra.run.smithi045.stdout: -396> 2023-10-03T19:17:19.622+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 156 ==== osd_op_reply(2460 1000000018a.00000000 [delete] v63'29 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.124 INFO:teuthology.orchestra.run.smithi045.stdout: -395> 2023-10-03T19:17:19.622+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 157 ==== osd_op_reply(2452 10000000182.00000000 [delete] v63'24 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.124 INFO:teuthology.orchestra.run.smithi045.stdout: -394> 2023-10-03T19:17:19.622+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 158 ==== osd_op_reply(2548 100000001e2.00000000 [delete] v63'25 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.124 INFO:teuthology.orchestra.run.smithi045.stdout: -393> 2023-10-03T19:17:19.622+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 159 ==== osd_op_reply(2565 100000001f3.00000000 [delete] v63'26 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.124 INFO:teuthology.orchestra.run.smithi045.stdout: -392> 2023-10-03T19:17:19.622+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 244 ==== osd_op_reply(2263 100000000c5.00000000 [delete] v63'43 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.124 INFO:teuthology.orchestra.run.smithi045.stdout: -391> 2023-10-03T19:17:19.622+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 245 ==== osd_op_reply(2322 10000000100.00000000 [delete] v63'44 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.124 INFO:teuthology.orchestra.run.smithi045.stdout: -390> 2023-10-03T19:17:19.622+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 199 ==== osd_op_reply(2121 10000000037.00000000 [delete] v63'45 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.124 INFO:teuthology.orchestra.run.smithi045.stdout: -389> 2023-10-03T19:17:19.622+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 200 ==== osd_op_reply(2176 1000000006e.00000000 [delete] v63'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.124 INFO:teuthology.orchestra.run.smithi045.stdout: -388> 2023-10-03T19:17:19.622+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 109 ==== osd_op_reply(2419 10000000161.00000000 [delete] v63'33 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:16.125 INFO:teuthology.orchestra.run.smithi045.stdout: -387> 2023-10-03T19:17:19.622+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 201 ==== osd_op_reply(2127 1000000003d.00000000 [delete] v63'46 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.125 INFO:teuthology.orchestra.run.smithi045.stdout: -386> 2023-10-03T19:17:19.622+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 202 ==== osd_op_reply(2267 100000000c9.00000000 [delete] v63'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.125 INFO:teuthology.orchestra.run.smithi045.stdout: -385> 2023-10-03T19:17:19.622+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 203 ==== osd_op_reply(2132 10000000042.00000000 [delete] v63'47 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.125 INFO:teuthology.orchestra.run.smithi045.stdout: -384> 2023-10-03T19:17:19.622+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 204 ==== osd_op_reply(2272 100000000ce.00000000 [delete] v63'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.125 INFO:teuthology.orchestra.run.smithi045.stdout: -383> 2023-10-03T19:17:19.626+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 205 ==== osd_op_reply(2395 10000000149.00000000 [delete] v63'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.125 INFO:teuthology.orchestra.run.smithi045.stdout: -382> 2023-10-03T19:17:19.626+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 206 ==== osd_op_reply(2378 10000000138.00000000 [delete] v63'48 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.126 INFO:teuthology.orchestra.run.smithi045.stdout: -381> 2023-10-03T19:17:19.626+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 160 ==== osd_op_reply(2463 1000000018d.00000000 [delete] v63'30 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.126 INFO:teuthology.orchestra.run.smithi045.stdout: -380> 2023-10-03T19:17:19.626+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 161 ==== osd_op_reply(2490 100000001a8.00000000 [delete] v63'36 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.126 INFO:teuthology.orchestra.run.smithi045.stdout: -379> 2023-10-03T19:17:19.626+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 318 ==== osd_op_reply(2399 1000000014d.00000000 [delete] v63'35 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.126 INFO:teuthology.orchestra.run.smithi045.stdout: -378> 2023-10-03T19:17:19.626+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 319 ==== osd_op_reply(2484 100000001a2.00000000 [delete] v63'36 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.126 INFO:teuthology.orchestra.run.smithi045.stdout: -377> 2023-10-03T19:17:19.626+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 156 ==== osd_op_reply(2087 10000000015.00000000 [delete] v63'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.126 INFO:teuthology.orchestra.run.smithi045.stdout: -376> 2023-10-03T19:17:19.626+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 246 ==== osd_op_reply(2309 100000000f3.00000000 [delete] v63'35 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.126 INFO:teuthology.orchestra.run.smithi045.stdout: -375> 2023-10-03T19:17:19.626+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 247 ==== osd_op_reply(2334 1000000010c.00000000 [delete] v63'36 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.126 INFO:teuthology.orchestra.run.smithi045.stdout: -374> 2023-10-03T19:17:19.626+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 248 ==== osd_op_reply(2387 10000000141.00000000 [delete] v63'37 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.127 INFO:teuthology.orchestra.run.smithi045.stdout: -373> 2023-10-03T19:17:19.626+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 207 ==== osd_op_reply(2410 10000000158.00000000 [delete] v63'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.127 INFO:teuthology.orchestra.run.smithi045.stdout: -372> 2023-10-03T19:17:19.626+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 208 ==== osd_op_reply(2450 10000000180.00000000 [delete] v63'49 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.127 INFO:teuthology.orchestra.run.smithi045.stdout: -371> 2023-10-03T19:17:19.626+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 320 ==== osd_op_reply(2274 100000000d0.00000000 [delete] v63'30 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.127 INFO:teuthology.orchestra.run.smithi045.stdout: -370> 2023-10-03T19:17:19.626+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 209 ==== osd_op_reply(2453 10000000183.00000000 [delete] v63'50 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.127 INFO:teuthology.orchestra.run.smithi045.stdout: -369> 2023-10-03T19:17:19.626+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 321 ==== osd_op_reply(2298 100000000e8.00000000 [delete] v63'31 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.127 INFO:teuthology.orchestra.run.smithi045.stdout: -368> 2023-10-03T19:17:19.626+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 322 ==== osd_op_reply(2388 10000000142.00000000 [delete] v63'32 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.127 INFO:teuthology.orchestra.run.smithi045.stdout: -367> 2023-10-03T19:17:19.626+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 210 ==== osd_op_reply(2546 100000001e0.00000000 [delete] v63'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.128 INFO:teuthology.orchestra.run.smithi045.stdout: -366> 2023-10-03T19:17:19.626+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 211 ==== osd_op_reply(2539 100000001d9.00000000 [delete] v63'51 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.225 INFO:teuthology.orchestra.run.smithi045.stdout: -365> 2023-10-03T19:17:19.626+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 323 ==== osd_op_reply(2442 10000000178.00000000 [delete] v63'33 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.225 INFO:teuthology.orchestra.run.smithi045.stdout: -364> 2023-10-03T19:17:19.626+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 324 ==== osd_op_reply(2456 10000000186.00000000 [delete] v63'34 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.225 INFO:teuthology.orchestra.run.smithi045.stdout: -363> 2023-10-03T19:17:19.626+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 325 ==== osd_op_reply(2471 10000000195.00000000 [delete] v63'35 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.225 INFO:teuthology.orchestra.run.smithi045.stdout: -362> 2023-10-03T19:17:19.626+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1017 ==== osd_op_reply(2307 100000000f1.00000000 [delete] v63'25 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.226 INFO:teuthology.orchestra.run.smithi045.stdout: -361> 2023-10-03T19:17:19.626+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 326 ==== osd_op_reply(2285 100000000db.00000000 [delete] v63'28 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.226 INFO:teuthology.orchestra.run.smithi045.stdout: -360> 2023-10-03T19:17:19.626+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1018 ==== osd_op_reply(2329 10000000107.00000000 [delete] v63'26 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.226 INFO:teuthology.orchestra.run.smithi045.stdout: -359> 2023-10-03T19:17:19.626+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1019 ==== osd_op_reply(2333 1000000010b.00000000 [delete] v63'27 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.226 INFO:teuthology.orchestra.run.smithi045.stdout: -358> 2023-10-03T19:17:19.626+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1020 ==== osd_op_reply(2375 10000000135.00000000 [delete] v63'28 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.226 INFO:teuthology.orchestra.run.smithi045.stdout: -357> 2023-10-03T19:17:19.626+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1021 ==== osd_op_reply(2392 10000000146.00000000 [delete] v63'29 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.226 INFO:teuthology.orchestra.run.smithi045.stdout: -356> 2023-10-03T19:17:19.626+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1022 ==== osd_op_reply(2397 1000000014b.00000000 [delete] v63'30 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.226 INFO:teuthology.orchestra.run.smithi045.stdout: -355> 2023-10-03T19:17:19.626+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 212 ==== osd_op_reply(2131 10000000041.00000000 [delete] v63'46 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.226 INFO:teuthology.orchestra.run.smithi045.stdout: -354> 2023-10-03T19:17:19.626+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 327 ==== osd_op_reply(2354 10000000120.00000000 [delete] v63'29 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.226 INFO:teuthology.orchestra.run.smithi045.stdout: -353> 2023-10-03T19:17:19.626+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 213 ==== osd_op_reply(2174 1000000006c.00000000 [delete] v63'47 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.226 INFO:teuthology.orchestra.run.smithi045.stdout: -352> 2023-10-03T19:17:19.626+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 328 ==== osd_op_reply(2370 10000000130.00000000 [delete] v63'30 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.227 INFO:teuthology.orchestra.run.smithi045.stdout: -351> 2023-10-03T19:17:19.626+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 214 ==== osd_op_reply(2226 100000000a0.00000000 [delete] v63'48 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.227 INFO:teuthology.orchestra.run.smithi045.stdout: -350> 2023-10-03T19:17:19.626+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 329 ==== osd_op_reply(2400 1000000014e.00000000 [delete] v63'31 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.227 INFO:teuthology.orchestra.run.smithi045.stdout: -349> 2023-10-03T19:17:19.626+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 215 ==== osd_op_reply(2240 100000000ae.00000000 [delete] v63'49 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.227 INFO:teuthology.orchestra.run.smithi045.stdout: -348> 2023-10-03T19:17:19.626+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 330 ==== osd_op_reply(2448 1000000017e.00000000 [delete] v63'32 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.227 INFO:teuthology.orchestra.run.smithi045.stdout: -347> 2023-10-03T19:17:19.626+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 249 ==== osd_op_reply(2236 100000000aa.00000000 [delete] v63'38 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.227 INFO:teuthology.orchestra.run.smithi045.stdout: -346> 2023-10-03T19:17:19.626+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 216 ==== osd_op_reply(2311 100000000f5.00000000 [delete] v63'50 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.227 INFO:teuthology.orchestra.run.smithi045.stdout: -345> 2023-10-03T19:17:19.630+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 217 ==== osd_op_reply(2353 1000000011f.00000000 [delete] v63'51 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.227 INFO:teuthology.orchestra.run.smithi045.stdout: -344> 2023-10-03T19:17:19.630+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 218 ==== osd_op_reply(2385 1000000013f.00000000 [delete] v63'52 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.227 INFO:teuthology.orchestra.run.smithi045.stdout: -343> 2023-10-03T19:17:19.630+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 219 ==== osd_op_reply(2430 1000000016c.00000000 [delete] v63'53 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.227 INFO:teuthology.orchestra.run.smithi045.stdout: -342> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 331 ==== osd_op_reply(2549 100000001e3.00000000 [delete] v63'36 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.227 INFO:teuthology.orchestra.run.smithi045.stdout: -341> 2023-10-03T19:17:19.630+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 220 ==== osd_op_reply(2455 10000000185.00000000 [delete] v63'54 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.228 INFO:teuthology.orchestra.run.smithi045.stdout: -340> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 250 ==== osd_op_reply(2386 10000000140.00000000 [delete] v63'39 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.228 INFO:teuthology.orchestra.run.smithi045.stdout: -339> 2023-10-03T19:17:19.630+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 221 ==== osd_op_reply(2216 10000000096.00000000 [delete] v63'44 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.228 INFO:teuthology.orchestra.run.smithi045.stdout: -338> 2023-10-03T19:17:19.630+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 222 ==== osd_op_reply(2225 1000000009f.00000000 [delete] v63'45 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.228 INFO:teuthology.orchestra.run.smithi045.stdout: -337> 2023-10-03T19:17:19.630+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 157 ==== osd_op_reply(2192 1000000007e.00000000 [delete] v63'40 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.228 INFO:teuthology.orchestra.run.smithi045.stdout: -336> 2023-10-03T19:17:19.630+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 158 ==== osd_op_reply(2151 10000000055.00000000 [delete] v63'42 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.228 INFO:teuthology.orchestra.run.smithi045.stdout: -335> 2023-10-03T19:17:19.630+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 159 ==== osd_op_reply(2320 100000000fe.00000000 [delete] v63'41 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.228 INFO:teuthology.orchestra.run.smithi045.stdout: -334> 2023-10-03T19:17:19.630+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 160 ==== osd_op_reply(2219 10000000099.00000000 [delete] v63'43 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.228 INFO:teuthology.orchestra.run.smithi045.stdout: -333> 2023-10-03T19:17:19.630+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 161 ==== osd_op_reply(2373 10000000133.00000000 [delete] v63'42 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.228 INFO:teuthology.orchestra.run.smithi045.stdout: -332> 2023-10-03T19:17:19.630+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 162 ==== osd_op_reply(2394 10000000148.00000000 [delete] v63'44 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.228 INFO:teuthology.orchestra.run.smithi045.stdout: -331> 2023-10-03T19:17:19.630+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 163 ==== osd_op_reply(2498 100000001b0.00000000 [delete] v63'45 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.228 INFO:teuthology.orchestra.run.smithi045.stdout: -330> 2023-10-03T19:17:19.630+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 164 ==== osd_op_reply(2130 10000000040.00000000 [delete] v63'30 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.229 INFO:teuthology.orchestra.run.smithi045.stdout: -329> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 251 ==== osd_op_reply(2398 1000000014c.00000000 [delete] v63'37 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.229 INFO:teuthology.orchestra.run.smithi045.stdout: -328> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 252 ==== osd_op_reply(2468 10000000192.00000000 [delete] v63'44 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.229 INFO:teuthology.orchestra.run.smithi045.stdout: -327> 2023-10-03T19:17:19.630+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 165 ==== osd_op_reply(2210 10000000090.00000000 [delete] v63'31 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.229 INFO:teuthology.orchestra.run.smithi045.stdout: -326> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 253 ==== osd_op_reply(2420 10000000162.00000000 [delete] v63'37 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.229 INFO:teuthology.orchestra.run.smithi045.stdout: -325> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 254 ==== osd_op_reply(2414 1000000015c.00000000 [delete] v63'36 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.229 INFO:teuthology.orchestra.run.smithi045.stdout: -324> 2023-10-03T19:17:19.630+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 166 ==== osd_op_reply(2516 100000001c2.00000000 [delete] v63'46 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.229 INFO:teuthology.orchestra.run.smithi045.stdout: -323> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 255 ==== osd_op_reply(2473 10000000197.00000000 [delete] v63'43 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.284 INFO:teuthology.orchestra.run.smithi045.stdout: -322> 2023-10-03T19:17:19.630+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 167 ==== osd_op_reply(2250 100000000b8.00000000 [delete] v63'32 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.284 INFO:teuthology.orchestra.run.smithi045.stdout: -321> 2023-10-03T19:17:19.630+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 168 ==== osd_op_reply(2421 10000000163.00000000 [delete] v63'43 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.284 INFO:teuthology.orchestra.run.smithi045.stdout: -320> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 256 ==== osd_op_reply(2417 1000000015f.00000000 [delete] v63'37 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.284 INFO:teuthology.orchestra.run.smithi045.stdout: -319> 2023-10-03T19:17:19.630+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 169 ==== osd_op_reply(2345 10000000117.00000000 [delete] v63'33 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.284 INFO:teuthology.orchestra.run.smithi045.stdout: -318> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 257 ==== osd_op_reply(2511 100000001bd.00000000 [delete] v63'45 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.284 INFO:teuthology.orchestra.run.smithi045.stdout: -317> 2023-10-03T19:17:19.630+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 170 ==== osd_op_reply(2482 100000001a0.00000000 [delete] v63'44 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.284 INFO:teuthology.orchestra.run.smithi045.stdout: -316> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 258 ==== osd_op_reply(2518 100000001c4.00000000 [delete] v63'44 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.284 INFO:teuthology.orchestra.run.smithi045.stdout: -315> 2023-10-03T19:17:19.630+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 171 ==== osd_op_reply(2152 10000000056.00000000 [delete] v63'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.284 INFO:teuthology.orchestra.run.smithi045.stdout: -314> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 259 ==== osd_op_reply(2425 10000000167.00000000 [delete] v63'37 uv35 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.285 INFO:teuthology.orchestra.run.smithi045.stdout: -313> 2023-10-03T19:17:19.630+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 172 ==== osd_op_reply(2443 10000000179.00000000 [delete] v63'34 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.285 INFO:teuthology.orchestra.run.smithi045.stdout: -312> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 260 ==== osd_op_reply(2478 1000000019c.00000000 [delete] v63'38 uv35 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.285 INFO:teuthology.orchestra.run.smithi045.stdout: -311> 2023-10-03T19:17:19.630+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 173 ==== osd_op_reply(2525 100000001cb.00000000 [delete] v63'45 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.285 INFO:teuthology.orchestra.run.smithi045.stdout: -310> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 261 ==== osd_op_reply(2524 100000001ca.00000000 [delete] v63'46 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.285 INFO:teuthology.orchestra.run.smithi045.stdout: -309> 2023-10-03T19:17:19.630+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 174 ==== osd_op_reply(2169 10000000067.00000000 [delete] v63'38 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.285 INFO:teuthology.orchestra.run.smithi045.stdout: -308> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 262 ==== osd_op_reply(2531 100000001d1.00000000 [delete] v63'29 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.285 INFO:teuthology.orchestra.run.smithi045.stdout: -307> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 263 ==== osd_op_reply(2496 100000001ae.00000000 [delete] v63'38 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.285 INFO:teuthology.orchestra.run.smithi045.stdout: -306> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 264 ==== osd_op_reply(2537 100000001d7.00000000 [delete] v63'38 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.285 INFO:teuthology.orchestra.run.smithi045.stdout: -305> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 265 ==== osd_op_reply(2532 100000001d2.00000000 [delete] v63'47 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.285 INFO:teuthology.orchestra.run.smithi045.stdout: -304> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 266 ==== osd_op_reply(2494 100000001ac.00000000 [delete] v63'39 uv35 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.285 INFO:teuthology.orchestra.run.smithi045.stdout: -303> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 267 ==== osd_op_reply(2551 100000001e5.00000000 [delete] v63'39 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.286 INFO:teuthology.orchestra.run.smithi045.stdout: -302> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 268 ==== osd_op_reply(2536 100000001d6.00000000 [delete] v63'48 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.286 INFO:teuthology.orchestra.run.smithi045.stdout: -301> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 269 ==== osd_op_reply(2502 100000001b4.00000000 [delete] v63'40 uv35 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.286 INFO:teuthology.orchestra.run.smithi045.stdout: -300> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 270 ==== osd_op_reply(2558 100000001ec.00000000 [delete] v63'30 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.286 INFO:teuthology.orchestra.run.smithi045.stdout: -299> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 271 ==== osd_op_reply(2543 100000001dd.00000000 [delete] v63'40 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.286 INFO:teuthology.orchestra.run.smithi045.stdout: -298> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 272 ==== osd_op_reply(2561 100000001ef.00000000 [delete] v63'31 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.286 INFO:teuthology.orchestra.run.smithi045.stdout: -297> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 273 ==== osd_op_reply(2444 1000000017a.00000000 [delete] v63'28 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.286 INFO:teuthology.orchestra.run.smithi045.stdout: -296> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 274 ==== osd_op_reply(2506 100000001b8.00000000 [delete] v63'38 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.286 INFO:teuthology.orchestra.run.smithi045.stdout: -295> 2023-10-03T19:17:19.630+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 223 ==== osd_op_reply(2234 100000000a8.00000000 [delete] v63'46 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.286 INFO:teuthology.orchestra.run.smithi045.stdout: -294> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 275 ==== osd_op_reply(2564 100000001f2.00000000 [delete] v63'38 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.286 INFO:teuthology.orchestra.run.smithi045.stdout: -293> 2023-10-03T19:17:19.630+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 224 ==== osd_op_reply(2271 100000000cd.00000000 [delete] v63'47 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.286 INFO:teuthology.orchestra.run.smithi045.stdout: -292> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 276 ==== osd_op_reply(2522 100000001c8.00000000 [delete] v63'29 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.287 INFO:teuthology.orchestra.run.smithi045.stdout: -291> 2023-10-03T19:17:19.630+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 225 ==== osd_op_reply(2308 100000000f2.00000000 [delete] v63'48 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.287 INFO:teuthology.orchestra.run.smithi045.stdout: -290> 2023-10-03T19:17:19.630+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 226 ==== osd_op_reply(2487 100000001a5.00000000 [delete] v63'55 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.287 INFO:teuthology.orchestra.run.smithi045.stdout: -289> 2023-10-03T19:17:19.630+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 227 ==== osd_op_reply(2383 1000000013d.00000000 [delete] v63'49 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.287 INFO:teuthology.orchestra.run.smithi045.stdout: -288> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1023 ==== osd_op_reply(2429 1000000016b.00000000 [delete] v63'25 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.287 INFO:teuthology.orchestra.run.smithi045.stdout: -287> 2023-10-03T19:17:19.630+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 228 ==== osd_op_reply(2475 10000000199.00000000 [delete] v63'50 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.287 INFO:teuthology.orchestra.run.smithi045.stdout: -286> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1024 ==== osd_op_reply(2074 10000000008.00000000 [delete] v63'43 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.287 INFO:teuthology.orchestra.run.smithi045.stdout: -285> 2023-10-03T19:17:19.630+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 175 ==== osd_op_reply(2175 1000000006d.00000000 [delete] v63'39 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.287 INFO:teuthology.orchestra.run.smithi045.stdout: -284> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1025 ==== osd_op_reply(2432 1000000016e.00000000 [delete] v63'26 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.287 INFO:teuthology.orchestra.run.smithi045.stdout: -283> 2023-10-03T19:17:19.630+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 176 ==== osd_op_reply(2261 100000000c3.00000000 [delete] v63'37 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.287 INFO:teuthology.orchestra.run.smithi045.stdout: -282> 2023-10-03T19:17:19.630+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 177 ==== osd_op_reply(2221 1000000009b.00000000 [delete] v63'40 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.287 INFO:teuthology.orchestra.run.smithi045.stdout: -281> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 332 ==== osd_op_reply(2228 100000000a2.00000000 [delete] v63'33 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.288 INFO:teuthology.orchestra.run.smithi045.stdout: -280> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 333 ==== osd_op_reply(2179 10000000071.00000000 [delete] v63'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.288 INFO:teuthology.orchestra.run.smithi045.stdout: -279> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 334 ==== osd_op_reply(2251 100000000b9.00000000 [delete] v63'34 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.288 INFO:teuthology.orchestra.run.smithi045.stdout: -278> 2023-10-03T19:17:19.630+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 178 ==== osd_op_reply(2141 1000000004b.00000000 [delete] v63'40 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.288 INFO:teuthology.orchestra.run.smithi045.stdout: -277> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 335 ==== osd_op_reply(2300 100000000ea.00000000 [delete] v63'35 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.288 INFO:teuthology.orchestra.run.smithi045.stdout: -276> 2023-10-03T19:17:19.630+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 179 ==== osd_op_reply(2155 10000000059.00000000 [delete] v63'41 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.288 INFO:teuthology.orchestra.run.smithi045.stdout: -275> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 162 ==== osd_op_reply(2181 10000000073.00000000 [delete] v63'23 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.288 INFO:teuthology.orchestra.run.smithi045.stdout: -274> 2023-10-03T19:17:19.630+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 180 ==== osd_op_reply(2325 10000000103.00000000 [delete] v63'42 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.288 INFO:teuthology.orchestra.run.smithi045.stdout: -273> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 163 ==== osd_op_reply(2224 1000000009e.00000000 [delete] v63'24 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.288 INFO:teuthology.orchestra.run.smithi045.stdout: -272> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 164 ==== osd_op_reply(2418 10000000160.00000000 [delete] v63'25 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.288 INFO:teuthology.orchestra.run.smithi045.stdout: -271> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 165 ==== osd_op_reply(2427 10000000169.00000000 [delete] v63'26 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.288 INFO:teuthology.orchestra.run.smithi045.stdout: -270> 2023-10-03T19:17:19.630+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 229 ==== osd_op_reply(2078 1000000000c.00000000 [delete] v63'42 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.288 INFO:teuthology.orchestra.run.smithi045.stdout: -269> 2023-10-03T19:17:19.630+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 230 ==== osd_op_reply(2535 100000001d5.00000000 [delete] v63'51 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.289 INFO:teuthology.orchestra.run.smithi045.stdout: -268> 2023-10-03T19:17:19.630+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 231 ==== osd_op_reply(2085 10000000013.00000000 [delete] v63'43 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.289 INFO:teuthology.orchestra.run.smithi045.stdout: -267> 2023-10-03T19:17:19.630+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 232 ==== osd_op_reply(2098 10000000020.00000000 [delete] v63'44 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.289 INFO:teuthology.orchestra.run.smithi045.stdout: -266> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 166 ==== osd_op_reply(2118 10000000034.00000000 [delete] v63'17 uv16 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.289 INFO:teuthology.orchestra.run.smithi045.stdout: -265> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 167 ==== osd_op_reply(2073 10000000007.00000000 [delete] v63'37 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.289 INFO:teuthology.orchestra.run.smithi045.stdout: -264> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 168 ==== osd_op_reply(2529 100000001cf.00000000 [delete] v63'27 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.389 INFO:teuthology.orchestra.run.smithi045.stdout: -263> 2023-10-03T19:17:19.630+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 181 ==== osd_op_reply(2135 10000000045.00000000 [delete] v63'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.390 INFO:teuthology.orchestra.run.smithi045.stdout: -262> 2023-10-03T19:17:19.630+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 169 ==== osd_op_reply(2232 100000000a6.00000000 [delete] v63'18 uv16 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.390 INFO:teuthology.orchestra.run.smithi045.stdout: -261> 2023-10-03T19:17:19.630+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 182 ==== osd_op_reply(2143 1000000004d.00000000 [delete] v63'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.390 INFO:teuthology.orchestra.run.smithi045.stdout: -260> 2023-10-03T19:17:19.630+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 233 ==== osd_op_reply(2123 10000000039.00000000 [delete] v63'45 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.390 INFO:teuthology.orchestra.run.smithi045.stdout: -259> 2023-10-03T19:17:19.630+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 183 ==== osd_op_reply(2208 1000000008e.00000000 [delete] v63'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.390 INFO:teuthology.orchestra.run.smithi045.stdout: -258> 2023-10-03T19:17:19.630+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 234 ==== osd_op_reply(2563 100000001f1.00000000 [delete] v63'52 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.390 INFO:teuthology.orchestra.run.smithi045.stdout: -257> 2023-10-03T19:17:19.634+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 112 ==== osd_op_reply(2097 1000000001f.00000000 [delete] v63'33 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:16.390 INFO:teuthology.orchestra.run.smithi045.stdout: -256> 2023-10-03T19:17:19.634+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 113 ==== osd_op_reply(2269 100000000cb.00000000 [delete] v63'34 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:16.390 INFO:teuthology.orchestra.run.smithi045.stdout: -255> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 184 ==== osd_op_reply(2222 1000000009c.00000000 [delete] v63'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.390 INFO:teuthology.orchestra.run.smithi045.stdout: -254> 2023-10-03T19:17:19.634+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 114 ==== osd_op_reply(2351 1000000011d.00000000 [delete] v63'35 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:16.391 INFO:teuthology.orchestra.run.smithi045.stdout: -253> 2023-10-03T19:17:19.634+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 115 ==== osd_op_reply(2431 1000000016d.00000000 [delete] v63'36 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:16.391 INFO:teuthology.orchestra.run.smithi045.stdout: -252> 2023-10-03T19:17:19.634+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 116 ==== osd_op_reply(2436 10000000172.00000000 [delete] v63'37 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:16.391 INFO:teuthology.orchestra.run.smithi045.stdout: -251> 2023-10-03T19:17:19.634+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 235 ==== osd_op_reply(2182 10000000074.00000000 [delete] v63'46 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.391 INFO:teuthology.orchestra.run.smithi045.stdout: -250> 2023-10-03T19:17:19.634+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.0 v2:172.21.15.45:6800/1057586985 117 ==== osd_op_reply(2560 100000001ee.00000000 [delete] v63'38 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534ef5000 2023-10-03T19:21:16.391 INFO:teuthology.orchestra.run.smithi045.stdout: -249> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 110 ==== osd_op_reply(2157 1000000005b.00000000 [delete] v63'25 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:16.391 INFO:teuthology.orchestra.run.smithi045.stdout: -248> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 111 ==== osd_op_reply(2196 10000000082.00000000 [delete] v63'26 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:16.391 INFO:teuthology.orchestra.run.smithi045.stdout: -247> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 112 ==== osd_op_reply(2294 100000000e4.00000000 [delete] v63'27 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:16.391 INFO:teuthology.orchestra.run.smithi045.stdout: -246> 2023-10-03T19:17:19.634+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 236 ==== osd_op_reply(2088 10000000016.00000000 [delete] v63'19 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.391 INFO:teuthology.orchestra.run.smithi045.stdout: -245> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 113 ==== osd_op_reply(2296 100000000e6.00000000 [delete] v63'28 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:16.391 INFO:teuthology.orchestra.run.smithi045.stdout: -244> 2023-10-03T19:17:19.634+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 237 ==== osd_op_reply(2075 10000000009.00000000 [delete] v63'23 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.391 INFO:teuthology.orchestra.run.smithi045.stdout: -243> 2023-10-03T19:17:19.634+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 238 ==== osd_op_reply(2203 10000000089.00000000 [delete] v63'24 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.391 INFO:teuthology.orchestra.run.smithi045.stdout: -242> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.2 v2:172.21.15.45:6817/964866005 114 ==== osd_op_reply(2446 1000000017c.00000000 [delete] v63'29 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x5655354ba000 2023-10-03T19:21:16.392 INFO:teuthology.orchestra.run.smithi045.stdout: -241> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 170 ==== osd_op_reply(2106 10000000028.00000000 [delete] v63'38 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.392 INFO:teuthology.orchestra.run.smithi045.stdout: -240> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 171 ==== osd_op_reply(2363 10000000129.00000000 [delete] v63'19 uv16 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.392 INFO:teuthology.orchestra.run.smithi045.stdout: -239> 2023-10-03T19:17:19.634+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 239 ==== osd_op_reply(2360 10000000126.00000000 [delete] v63'25 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.392 INFO:teuthology.orchestra.run.smithi045.stdout: -238> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 172 ==== osd_op_reply(2173 1000000006b.00000000 [delete] v63'39 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.392 INFO:teuthology.orchestra.run.smithi045.stdout: -237> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 173 ==== osd_op_reply(2515 100000001c1.00000000 [delete] v63'20 uv16 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.392 INFO:teuthology.orchestra.run.smithi045.stdout: -236> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 174 ==== osd_op_reply(2178 10000000070.00000000 [delete] v63'40 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.392 INFO:teuthology.orchestra.run.smithi045.stdout: -235> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 175 ==== osd_op_reply(2530 100000001d0.00000000 [delete] v63'21 uv16 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.392 INFO:teuthology.orchestra.run.smithi045.stdout: -234> 2023-10-03T19:17:19.634+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 240 ==== osd_op_reply(2402 10000000150.00000000 [delete] v63'26 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.392 INFO:teuthology.orchestra.run.smithi045.stdout: -233> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 176 ==== osd_op_reply(2185 10000000077.00000000 [delete] v63'41 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.392 INFO:teuthology.orchestra.run.smithi045.stdout: -232> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 177 ==== osd_op_reply(2190 1000000007c.00000000 [delete] v63'42 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.393 INFO:teuthology.orchestra.run.smithi045.stdout: -231> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 178 ==== osd_op_reply(2245 100000000b3.00000000 [delete] v63'43 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.393 INFO:teuthology.orchestra.run.smithi045.stdout: -230> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 336 ==== osd_op_reply(2336 1000000010e.00000000 [delete] v63'36 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.393 INFO:teuthology.orchestra.run.smithi045.stdout: -229> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 337 ==== osd_op_reply(2144 1000000004e.00000000 [delete] v63'48 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.393 INFO:teuthology.orchestra.run.smithi045.stdout: -228> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 338 ==== osd_op_reply(2343 10000000115.00000000 [delete] v63'37 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.393 INFO:teuthology.orchestra.run.smithi045.stdout: -227> 2023-10-03T19:17:19.634+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 241 ==== osd_op_reply(2504 100000001b6.00000000 [delete] v63'27 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.393 INFO:teuthology.orchestra.run.smithi045.stdout: -226> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 339 ==== osd_op_reply(2128 1000000003e.00000000 [delete] v63'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.393 INFO:teuthology.orchestra.run.smithi045.stdout: -225> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 340 ==== osd_op_reply(2199 10000000085.00000000 [delete] v63'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.393 INFO:teuthology.orchestra.run.smithi045.stdout: -224> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 341 ==== osd_op_reply(2161 1000000005f.00000000 [delete] v63'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.393 INFO:teuthology.orchestra.run.smithi045.stdout: -223> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 342 ==== osd_op_reply(2283 100000000d9.00000000 [delete] v63'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.393 INFO:teuthology.orchestra.run.smithi045.stdout: -222> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 343 ==== osd_op_reply(2327 10000000105.00000000 [delete] v63'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.393 INFO:teuthology.orchestra.run.smithi045.stdout: -221> 2023-10-03T19:17:19.634+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 242 ==== osd_op_reply(2534 100000001d4.00000000 [delete] v63'28 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.394 INFO:teuthology.orchestra.run.smithi045.stdout: -220> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 344 ==== osd_op_reply(2393 10000000147.00000000 [delete] v63'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.394 INFO:teuthology.orchestra.run.smithi045.stdout: -219> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 345 ==== osd_op_reply(2348 1000000011a.00000000 [delete] v63'38 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.394 INFO:teuthology.orchestra.run.smithi045.stdout: -218> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 346 ==== osd_op_reply(2439 10000000175.00000000 [delete] v63'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.394 INFO:teuthology.orchestra.run.smithi045.stdout: -217> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 347 ==== osd_op_reply(2352 1000000011e.00000000 [delete] v63'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.394 INFO:teuthology.orchestra.run.smithi045.stdout: -216> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 348 ==== osd_op_reply(2457 10000000187.00000000 [delete] v63'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.394 INFO:teuthology.orchestra.run.smithi045.stdout: -215> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 349 ==== osd_op_reply(2458 10000000188.00000000 [delete] v63'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.394 INFO:teuthology.orchestra.run.smithi045.stdout: -214> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 350 ==== osd_op_reply(2247 100000000b5.00000000 [delete] v63'49 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.394 INFO:teuthology.orchestra.run.smithi045.stdout: -213> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 351 ==== osd_op_reply(2491 100000001a9.00000000 [delete] v63'41 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.394 INFO:teuthology.orchestra.run.smithi045.stdout: -212> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 352 ==== osd_op_reply(2547 100000001e1.00000000 [delete] v63'42 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.394 INFO:teuthology.orchestra.run.smithi045.stdout: -211> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 277 ==== osd_op_reply(2554 100000001e8.00000000 [delete] v63'30 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.395 INFO:teuthology.orchestra.run.smithi045.stdout: -210> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 278 ==== osd_op_reply(2507 100000001b9.00000000 [delete] v63'41 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.395 INFO:teuthology.orchestra.run.smithi045.stdout: -209> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 279 ==== osd_op_reply(2556 100000001ea.00000000 [delete] v63'31 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.395 INFO:teuthology.orchestra.run.smithi045.stdout: -208> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 280 ==== osd_op_reply(2567 100000001f5.00000000 [delete] v63'39 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.395 INFO:teuthology.orchestra.run.smithi045.stdout: -207> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.6 v2:172.21.15.79:6819/1486010128 281 ==== osd_op_reply(2557 100000001eb.00000000 [delete] v63'39 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ffe800 2023-10-03T19:21:16.395 INFO:teuthology.orchestra.run.smithi045.stdout: -206> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1026 ==== osd_op_reply(2541 100000001db.00000000 [delete] v63'27 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.395 INFO:teuthology.orchestra.run.smithi045.stdout: -205> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1027 ==== osd_op_reply(2553 100000001e7.00000000 [delete] v63'28 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.439 INFO:teuthology.orchestra.run.smithi045.stdout: -204> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 179 ==== osd_op_reply(2254 100000000bc.00000000 [delete] v63'44 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.439 INFO:teuthology.orchestra.run.smithi045.stdout: -203> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 180 ==== osd_op_reply(2295 100000000e5.00000000 [delete] v63'45 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.439 INFO:teuthology.orchestra.run.smithi045.stdout: -202> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 181 ==== osd_op_reply(2303 100000000ed.00000000 [delete] v63'46 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.439 INFO:teuthology.orchestra.run.smithi045.stdout: -201> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 182 ==== osd_op_reply(2469 10000000193.00000000 [delete] v63'47 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.439 INFO:teuthology.orchestra.run.smithi045.stdout: -200> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 183 ==== osd_op_reply(2479 1000000019d.00000000 [delete] v63'48 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.440 INFO:teuthology.orchestra.run.smithi045.stdout: -199> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 184 ==== osd_op_reply(2483 100000001a1.00000000 [delete] v63'49 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.440 INFO:teuthology.orchestra.run.smithi045.stdout: -198> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 185 ==== osd_op_reply(2499 100000001b1.00000000 [delete] v63'50 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.440 INFO:teuthology.orchestra.run.smithi045.stdout: -197> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.4 v2:172.21.15.79:6810/2234162464 186 ==== osd_op_reply(2538 100000001d8.00000000 [delete] v63'51 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4800 2023-10-03T19:21:16.440 INFO:teuthology.orchestra.run.smithi045.stdout: -196> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 185 ==== osd_op_reply(2306 100000000f0.00000000 [delete] v63'41 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.440 INFO:teuthology.orchestra.run.smithi045.stdout: -195> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 186 ==== osd_op_reply(2223 1000000009d.00000000 [delete] v63'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.440 INFO:teuthology.orchestra.run.smithi045.stdout: -194> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 187 ==== osd_op_reply(2237 100000000ab.00000000 [delete] v63'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.440 INFO:teuthology.orchestra.run.smithi045.stdout: -193> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 188 ==== osd_op_reply(2403 10000000151.00000000 [delete] v63'43 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.440 INFO:teuthology.orchestra.run.smithi045.stdout: -192> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 189 ==== osd_op_reply(2252 100000000ba.00000000 [delete] v63'33 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.440 INFO:teuthology.orchestra.run.smithi045.stdout: -191> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 190 ==== osd_op_reply(2293 100000000e3.00000000 [delete] v63'38 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.440 INFO:teuthology.orchestra.run.smithi045.stdout: -190> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 191 ==== osd_op_reply(2372 10000000132.00000000 [delete] v63'34 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.440 INFO:teuthology.orchestra.run.smithi045.stdout: -189> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1028 ==== osd_op_reply(2184 10000000076.00000000 [delete] v63'44 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.441 INFO:teuthology.orchestra.run.smithi045.stdout: -188> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 192 ==== osd_op_reply(2331 10000000109.00000000 [delete] v63'42 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.441 INFO:teuthology.orchestra.run.smithi045.stdout: -187> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 193 ==== osd_op_reply(2426 10000000168.00000000 [delete] v63'35 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.441 INFO:teuthology.orchestra.run.smithi045.stdout: -186> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 194 ==== osd_op_reply(2407 10000000155.00000000 [delete] v63'44 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.441 INFO:teuthology.orchestra.run.smithi045.stdout: -185> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1029 ==== osd_op_reply(2214 10000000094.00000000 [delete] v63'45 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.441 INFO:teuthology.orchestra.run.smithi045.stdout: -184> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 195 ==== osd_op_reply(2314 100000000f8.00000000 [delete] v63'39 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.441 INFO:teuthology.orchestra.run.smithi045.stdout: -183> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 196 ==== osd_op_reply(2260 100000000c2.00000000 [delete] v63'41 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.441 INFO:teuthology.orchestra.run.smithi045.stdout: -182> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 197 ==== osd_op_reply(2481 1000000019f.00000000 [delete] v63'36 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.441 INFO:teuthology.orchestra.run.smithi045.stdout: -181> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 198 ==== osd_op_reply(2265 100000000c7.00000000 [delete] v63'42 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.441 INFO:teuthology.orchestra.run.smithi045.stdout: -180> 2023-10-03T19:17:19.634+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 243 ==== osd_op_reply(2119 10000000035.00000000 [delete] v63'20 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.441 INFO:teuthology.orchestra.run.smithi045.stdout: -179> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 199 ==== osd_op_reply(2297 100000000e7.00000000 [delete] v63'43 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.442 INFO:teuthology.orchestra.run.smithi045.stdout: -178> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1030 ==== osd_op_reply(2249 100000000b7.00000000 [delete] v63'46 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.442 INFO:teuthology.orchestra.run.smithi045.stdout: -177> 2023-10-03T19:17:19.634+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 244 ==== osd_op_reply(2168 10000000066.00000000 [delete] v63'21 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.442 INFO:teuthology.orchestra.run.smithi045.stdout: -176> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 200 ==== osd_op_reply(2341 10000000113.00000000 [delete] v63'40 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.442 INFO:teuthology.orchestra.run.smithi045.stdout: -175> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 201 ==== osd_op_reply(2428 1000000016a.00000000 [delete] v63'45 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.442 INFO:teuthology.orchestra.run.smithi045.stdout: -174> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 202 ==== osd_op_reply(2445 1000000017b.00000000 [delete] v63'35 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.442 INFO:teuthology.orchestra.run.smithi045.stdout: -173> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 203 ==== osd_op_reply(2367 1000000012d.00000000 [delete] v63'43 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.442 INFO:teuthology.orchestra.run.smithi045.stdout: -172> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1031 ==== osd_op_reply(2286 100000000dc.00000000 [delete] v63'47 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.442 INFO:teuthology.orchestra.run.smithi045.stdout: -171> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 204 ==== osd_op_reply(2318 100000000fc.00000000 [delete] v63'44 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.442 INFO:teuthology.orchestra.run.smithi045.stdout: -170> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 205 ==== osd_op_reply(2454 10000000184.00000000 [delete] v63'44 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.442 INFO:teuthology.orchestra.run.smithi045.stdout: -169> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 206 ==== osd_op_reply(2326 10000000104.00000000 [delete] v63'45 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.442 INFO:teuthology.orchestra.run.smithi045.stdout: -168> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1032 ==== osd_op_reply(2305 100000000ef.00000000 [delete] v63'48 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.443 INFO:teuthology.orchestra.run.smithi045.stdout: -167> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 207 ==== osd_op_reply(2485 100000001a3.00000000 [delete] v63'45 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.443 INFO:teuthology.orchestra.run.smithi045.stdout: -166> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1033 ==== osd_op_reply(2310 100000000f4.00000000 [delete] v63'49 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.443 INFO:teuthology.orchestra.run.smithi045.stdout: -165> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 208 ==== osd_op_reply(2349 1000000011b.00000000 [delete] v63'46 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.443 INFO:teuthology.orchestra.run.smithi045.stdout: -164> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1034 ==== osd_op_reply(2321 100000000ff.00000000 [delete] v63'50 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.443 INFO:teuthology.orchestra.run.smithi045.stdout: -163> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 209 ==== osd_op_reply(2517 100000001c3.00000000 [delete] v63'41 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.443 INFO:teuthology.orchestra.run.smithi045.stdout: -162> 2023-10-03T19:17:19.634+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 245 ==== osd_op_reply(2545 100000001df.00000000 [delete] v63'29 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.443 INFO:teuthology.orchestra.run.smithi045.stdout: -161> 2023-10-03T19:17:19.634+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 246 ==== osd_op_reply(2186 10000000078.00000000 [delete] v63'22 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.443 INFO:teuthology.orchestra.run.smithi045.stdout: -160> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 210 ==== osd_op_reply(2486 100000001a4.00000000 [delete] v63'46 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.443 INFO:teuthology.orchestra.run.smithi045.stdout: -159> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 211 ==== osd_op_reply(2357 10000000123.00000000 [delete] v63'47 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.443 INFO:teuthology.orchestra.run.smithi045.stdout: -158> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 353 ==== osd_op_reply(2404 10000000152.00000000 [delete] v63'39 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.443 INFO:teuthology.orchestra.run.smithi045.stdout: -157> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 354 ==== osd_op_reply(2279 100000000d5.00000000 [delete] v63'50 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.444 INFO:teuthology.orchestra.run.smithi045.stdout: -156> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 212 ==== osd_op_reply(2540 100000001da.00000000 [delete] v63'47 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.444 INFO:teuthology.orchestra.run.smithi045.stdout: -155> 2023-10-03T19:17:19.634+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 247 ==== osd_op_reply(2276 100000000d2.00000000 [delete] v63'23 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.444 INFO:teuthology.orchestra.run.smithi045.stdout: -154> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 213 ==== osd_op_reply(2382 1000000013c.00000000 [delete] v63'48 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.444 INFO:teuthology.orchestra.run.smithi045.stdout: -153> 2023-10-03T19:17:19.634+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 248 ==== osd_op_reply(2339 10000000111.00000000 [delete] v63'47 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.444 INFO:teuthology.orchestra.run.smithi045.stdout: -152> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 214 ==== osd_op_reply(2520 100000001c6.00000000 [delete] v63'42 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.444 INFO:teuthology.orchestra.run.smithi045.stdout: -151> 2023-10-03T19:17:19.634+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 249 ==== osd_op_reply(2364 1000000012a.00000000 [delete] v63'24 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.444 INFO:teuthology.orchestra.run.smithi045.stdout: -150> 2023-10-03T19:17:19.634+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.7 v2:172.21.15.79:6818/3323397754 215 ==== osd_op_reply(2508 100000001ba.00000000 [delete] v63'49 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56553575d680 con 0x565534ef4c00 2023-10-03T19:21:16.444 INFO:teuthology.orchestra.run.smithi045.stdout: -149> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 355 ==== osd_op_reply(2497 100000001af.00000000 [delete] v63'40 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.444 INFO:teuthology.orchestra.run.smithi045.stdout: -148> 2023-10-03T19:17:19.634+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 250 ==== osd_op_reply(2519 100000001c5.00000000 [delete] v63'48 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.444 INFO:teuthology.orchestra.run.smithi045.stdout: -147> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 356 ==== osd_op_reply(2408 10000000156.00000000 [delete] v63'51 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.444 INFO:teuthology.orchestra.run.smithi045.stdout: -146> 2023-10-03T19:17:19.634+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 251 ==== osd_op_reply(2447 1000000017d.00000000 [delete] v63'25 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.445 INFO:teuthology.orchestra.run.smithi045.stdout: -145> 2023-10-03T19:17:19.634+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 252 ==== osd_op_reply(2503 100000001b5.00000000 [delete] v63'26 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.445 INFO:teuthology.orchestra.run.smithi045.stdout: -144> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 357 ==== osd_op_reply(2501 100000001b3.00000000 [delete] v63'41 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.445 INFO:teuthology.orchestra.run.smithi045.stdout: -143> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 358 ==== osd_op_reply(2415 1000000015d.00000000 [delete] v63'52 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.445 INFO:teuthology.orchestra.run.smithi045.stdout: -142> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 359 ==== osd_op_reply(2433 1000000016f.00000000 [delete] v63'53 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.518 INFO:teuthology.orchestra.run.smithi045.stdout: -141> 2023-10-03T19:17:19.634+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 253 ==== osd_op_reply(2542 100000001dc.00000000 [delete] v63'27 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.518 INFO:teuthology.orchestra.run.smithi045.stdout: -140> 2023-10-03T19:17:19.634+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 360 ==== osd_op_reply(2489 100000001a7.00000000 [delete] v63'54 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.518 INFO:teuthology.orchestra.run.smithi045.stdout: -139> 2023-10-03T19:17:19.638+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1035 ==== osd_op_reply(2324 10000000102.00000000 [delete] v63'51 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.518 INFO:teuthology.orchestra.run.smithi045.stdout: -138> 2023-10-03T19:17:19.638+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1036 ==== osd_op_reply(2464 1000000018e.00000000 [delete] v63'52 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.518 INFO:teuthology.orchestra.run.smithi045.stdout: -137> 2023-10-03T19:17:19.638+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1037 ==== osd_op_reply(2477 1000000019b.00000000 [delete] v63'53 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.518 INFO:teuthology.orchestra.run.smithi045.stdout: -136> 2023-10-03T19:17:19.638+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1038 ==== osd_op_reply(2492 100000001aa.00000000 [delete] v63'54 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.518 INFO:teuthology.orchestra.run.smithi045.stdout: -135> 2023-10-03T19:17:19.638+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1039 ==== osd_op_reply(2495 100000001ad.00000000 [delete] v63'55 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.518 INFO:teuthology.orchestra.run.smithi045.stdout: -134> 2023-10-03T19:17:19.638+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1040 ==== osd_op_reply(2550 100000001e4.00000000 [delete] v63'56 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.518 INFO:teuthology.orchestra.run.smithi045.stdout: -133> 2023-10-03T19:17:19.638+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.1 v2:172.21.15.45:6808/1433143371 1041 ==== osd_op_reply(2562 100000001f0.00000000 [delete] v63'57 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef4400 2023-10-03T19:21:16.518 INFO:teuthology.orchestra.run.smithi045.stdout: -132> 2023-10-03T19:17:19.638+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 19MDSIOContextWrapper 2023-10-03T19:21:16.519 INFO:teuthology.orchestra.run.smithi045.stdout: -131> 2023-10-03T19:17:19.638+0000 7f0aaf15e640 10 MDSContext::complete: 19MDSIOContextWrapper 2023-10-03T19:21:16.519 INFO:teuthology.orchestra.run.smithi045.stdout: -130> 2023-10-03T19:17:19.638+0000 7f0aaf15e640 10 mds.0.inotable: project_release_ids [0x10000000002~0x1f4] to [0x100000005dd~0xfffffffa23]/[0x100000005dd~0xfffffffa23] 2023-10-03T19:21:16.519 INFO:teuthology.orchestra.run.smithi045.stdout: -129> 2023-10-03T19:17:19.638+0000 7f0aae95d640 5 mds.0.log _submit_thread 10056538~56 : Eurged 500 inos, inotable v6 2023-10-03T19:21:16.519 INFO:teuthology.orchestra.run.smithi045.stdout: -128> 2023-10-03T19:17:19.638+0000 7f0aae95d640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.27:2568 9.1b 9:ddb4e4d7:::200.00000002:head [write 1667930~76 [fadvise_dontneed] in=76b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x5655350fea80 con 0x565534ef5400 2023-10-03T19:21:16.519 INFO:teuthology.orchestra.run.smithi045.stdout: -127> 2023-10-03T19:17:19.638+0000 7f0ab796f640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.3 v2:172.21.15.45:6816/4227059688 361 ==== osd_op_reply(2568 200.00000002 [write 1667930~76 [fadvise_dontneed]] v63'167 uv167 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x565534fd6b40 con 0x565534ef5400 2023-10-03T19:21:16.519 INFO:teuthology.orchestra.run.smithi045.stdout: -126> 2023-10-03T19:17:19.638+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 28C_MDS_purge_completed_finish 2023-10-03T19:21:16.519 INFO:teuthology.orchestra.run.smithi045.stdout: -125> 2023-10-03T19:17:19.638+0000 7f0aaf15e640 10 MDSContext::complete: 28C_MDS_purge_completed_finish 2023-10-03T19:21:16.519 INFO:teuthology.orchestra.run.smithi045.stdout: -124> 2023-10-03T19:17:19.638+0000 7f0aaf15e640 10 mds.0.inotable: apply_release_ids [0x10000000002~0x1f4] to [0x10000000002~0x1f4,0x100000005dd~0xfffffffa23]/[0x100000005dd~0xfffffffa23] 2023-10-03T19:21:16.519 INFO:teuthology.orchestra.run.smithi045.stdout: -123> 2023-10-03T19:17:19.954+0000 7f0ab3967640 10 mds.0.log trim 1 / 128 segments, 315 / -1 events, 0 (0) expiring, 0 (0) expired 2023-10-03T19:21:16.519 INFO:teuthology.orchestra.run.smithi045.stdout: -122> 2023-10-03T19:17:19.954+0000 7f0ab3967640 10 mds.0.openfiles commit log_seq 2699 committing_log_seq:2699 2023-10-03T19:21:16.519 INFO:teuthology.orchestra.run.smithi045.stdout: -121> 2023-10-03T19:17:19.954+0000 7f0ab3967640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.27:2569 9.6 9:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b,omap-rm-keys in=4704b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63) v8 -- 0x565534fa1c00 con 0x565534151000 2023-10-03T19:21:16.520 INFO:teuthology.orchestra.run.smithi045.stdout: -120> 2023-10-03T19:17:19.954+0000 7f0ab3967640 10 mds.0.log _trim_expired_segments waiting for 2699/9459904 to expire 2023-10-03T19:21:16.520 INFO:teuthology.orchestra.run.smithi045.stdout: -119> 2023-10-03T19:17:19.954+0000 7f0ab3967640 10 mds.0.server find_idle_sessions. last cleared laggy state 1086.34s ago 2023-10-03T19:21:16.520 INFO:teuthology.orchestra.run.smithi045.stdout: -118> 2023-10-03T19:17:19.954+0000 7f0ab3967640 10 mds.0.locker scatter_tick 2023-10-03T19:21:16.520 INFO:teuthology.orchestra.run.smithi045.stdout: -117> 2023-10-03T19:17:19.954+0000 7f0ab3967640 20 mds.0.locker caps_tick 0 revoking caps 2023-10-03T19:21:16.520 INFO:teuthology.orchestra.run.smithi045.stdout: -116> 2023-10-03T19:17:19.954+0000 7f0ab3967640 20 mds.0.bal handle_export_pins export_pin_queue size=0 2023-10-03T19:21:16.520 INFO:teuthology.orchestra.run.smithi045.stdout: -115> 2023-10-03T19:17:19.954+0000 7f0ab3967640 15 mds.0.bal tick tick last_sample now 1086.343799s 2023-10-03T19:21:16.520 INFO:teuthology.orchestra.run.smithi045.stdout: -114> 2023-10-03T19:17:19.954+0000 7f0ab3967640 15 mds.0.cache show_subtrees 2023-10-03T19:21:16.520 INFO:teuthology.orchestra.run.smithi045.stdout: -113> 2023-10-03T19:17:19.954+0000 7f0ab3967640 10 mds.0.cache |__ 0 auth [dir 0x1 / [2,head] auth v=6008 cv=5384/5384 REP dir_auth=0 state=1610612737|complete f(v0 m2023-10-03T19:16:58.394250+0000 1=0+1) n(v3 rc2023-10-03T19:17:10.740067+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=0 0x565534040d00] 2023-10-03T19:21:16.520 INFO:teuthology.orchestra.run.smithi045.stdout: -112> 2023-10-03T19:17:19.954+0000 7f0ab3967640 10 mds.0.cache |__ 0 auth [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:16:46.302559+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x565534041180] 2023-10-03T19:21:16.520 INFO:teuthology.orchestra.run.smithi045.stdout: -111> 2023-10-03T19:17:19.954+0000 7f0ab3967640 10 mds.0.cache find_stale_fragment_freeze 2023-10-03T19:21:16.521 INFO:teuthology.orchestra.run.smithi045.stdout: -110> 2023-10-03T19:17:19.954+0000 7f0ab3967640 10 mds.0.snap check_osd_map - version unchanged 2023-10-03T19:21:16.521 INFO:teuthology.orchestra.run.smithi045.stdout: -109> 2023-10-03T19:17:19.954+0000 7f0ab3967640 20 mds.0.27 updating export targets, currently 0 ranks are targets 2023-10-03T19:21:16.521 INFO:teuthology.orchestra.run.smithi045.stdout: -108> 2023-10-03T19:17:19.954+0000 7f0ab4168640 10 monclient: tick 2023-10-03T19:21:16.521 INFO:teuthology.orchestra.run.smithi045.stdout: -107> 2023-10-03T19:17:19.954+0000 7f0ab4168640 10 monclient: _check_auth_tickets 2023-10-03T19:21:16.521 INFO:teuthology.orchestra.run.smithi045.stdout: -106> 2023-10-03T19:17:19.954+0000 7f0ab4168640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:16:49.956112+0000) 2023-10-03T19:21:16.521 INFO:teuthology.orchestra.run.smithi045.stdout: -105> 2023-10-03T19:17:19.962+0000 7f0ab8170640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== osd.5 v2:172.21.15.79:6802/2879380539 254 ==== osd_op_reply(2569 mds0_openfiles.0 [omap-set-header,omap-rm-keys] v63'7 uv7 ondisk = 0) v8 ==== 202+0+0 (crc 0 0 0) 0x5655352e9d40 con 0x565534151000 2023-10-03T19:21:16.521 INFO:teuthology.orchestra.run.smithi045.stdout: -104> 2023-10-03T19:17:19.962+0000 7f0aaf15e640 10 MDSIOContextBase::complete: 13C_IO_OFT_Save 2023-10-03T19:21:16.521 INFO:teuthology.orchestra.run.smithi045.stdout: -103> 2023-10-03T19:17:19.962+0000 7f0aaf15e640 10 MDSContext::complete: 13C_IO_OFT_Save 2023-10-03T19:21:16.521 INFO:teuthology.orchestra.run.smithi045.stdout: -102> 2023-10-03T19:17:19.962+0000 7f0aaf15e640 10 mds.0.openfiles _commit_finish log_seq 2699 committed_log_seq 2699 committing_log_seq 2699 2023-10-03T19:21:16.521 INFO:teuthology.orchestra.run.smithi045.stdout: -101> 2023-10-03T19:17:19.962+0000 7f0aaf15e640 10 MDSContext::complete: 15C_OFT_Committed 2023-10-03T19:21:16.521 INFO:teuthology.orchestra.run.smithi045.stdout: -100> 2023-10-03T19:17:19.962+0000 7f0aaf15e640 10 mds.0.log _trim_expired_segments waiting for 2699/9459904 to expire 2023-10-03T19:21:16.522 INFO:teuthology.orchestra.run.smithi045.stdout: -99> 2023-10-03T19:17:20.302+0000 7f0ab3967640 20 mds.0.27 get_task_status 2023-10-03T19:21:16.522 INFO:teuthology.orchestra.run.smithi045.stdout: -98> 2023-10-03T19:17:20.302+0000 7f0ab3967640 20 mds.0.27 schedule_update_timer_task 2023-10-03T19:21:16.522 INFO:teuthology.orchestra.run.smithi045.stdout: -97> 2023-10-03T19:17:20.330+0000 7f0ab1162640 2 mds.0.cache Memory usage: total 304916, rss 76896, heap 207144, baseline 190760, 0 / 1014 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:16.522 INFO:teuthology.orchestra.run.smithi045.stdout: -96> 2023-10-03T19:17:20.330+0000 7f0ab1162640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999990761s ago 2023-10-03T19:21:16.522 INFO:teuthology.orchestra.run.smithi045.stdout: -95> 2023-10-03T19:17:20.330+0000 7f0ab1162640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:16.522 INFO:teuthology.orchestra.run.smithi045.stdout: -94> 2023-10-03T19:17:20.330+0000 7f0ab1162640 7 mds.0.cache trim bytes_used=2MB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:16.522 INFO:teuthology.orchestra.run.smithi045.stdout: -93> 2023-10-03T19:17:20.330+0000 7f0ab1162640 7 mds.0.cache trim_lru trimming 0 items from LRU size=1011 mid=481 pintail=323 pinned=323 2023-10-03T19:21:16.522 INFO:teuthology.orchestra.run.smithi045.stdout: -92> 2023-10-03T19:17:20.330+0000 7f0ab1162640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:16.522 INFO:teuthology.orchestra.run.smithi045.stdout: -91> 2023-10-03T19:17:20.330+0000 7f0ab1162640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:16.522 INFO:teuthology.orchestra.run.smithi045.stdout: -90> 2023-10-03T19:17:20.330+0000 7f0ab1162640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:16.523 INFO:teuthology.orchestra.run.smithi045.stdout: -89> 2023-10-03T19:17:20.330+0000 7f0ab1162640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:16.523 INFO:teuthology.orchestra.run.smithi045.stdout: -88> 2023-10-03T19:17:20.918+0000 7f0ab2965640 10 mds.pinger is_rank_lagging: rank=0 2023-10-03T19:21:16.523 INFO:teuthology.orchestra.run.smithi045.stdout: -87> 2023-10-03T19:17:20.918+0000 7f0ab2965640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgrreport(unknown.a +0-0 packed 1558) v9 -- 0x565535720e00 con 0x565534ef4000 2023-10-03T19:21:16.523 INFO:teuthology.orchestra.run.smithi045.stdout: -86> 2023-10-03T19:17:20.954+0000 7f0ab4168640 10 monclient: tick 2023-10-03T19:21:16.523 INFO:teuthology.orchestra.run.smithi045.stdout: -85> 2023-10-03T19:17:20.954+0000 7f0ab4168640 10 monclient: _check_auth_tickets 2023-10-03T19:21:16.523 INFO:teuthology.orchestra.run.smithi045.stdout: -84> 2023-10-03T19:17:20.954+0000 7f0ab4168640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:16:50.956232+0000) 2023-10-03T19:21:16.523 INFO:teuthology.orchestra.run.smithi045.stdout: -83> 2023-10-03T19:17:21.302+0000 7f0aae15c640 20 update_rank0: mds.metrics 2023-10-03T19:21:16.523 INFO:teuthology.orchestra.run.smithi045.stdout: -82> 2023-10-03T19:17:21.302+0000 7f0aae15c640 20 update_rank0: mds.metrics: sending metric updates for 1 clients to rank 0 (address: [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585]) with sequence number 6, last updated sequence number 15 2023-10-03T19:21:16.523 INFO:teuthology.orchestra.run.smithi045.stdout: -81> 2023-10-03T19:17:21.302+0000 7f0aae15c640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] send_to--> mds [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] -- mds_metrics from rank=0 carrying 1 metric updates v1 -- ?+0 0x565534e1b800 2023-10-03T19:21:16.523 INFO:teuthology.orchestra.run.smithi045.stdout: -80> 2023-10-03T19:17:21.302+0000 7f0aae15c640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] -- mds_metrics from rank=0 carrying 1 metric updates v1 -- 0x565534e1b800 con 0x565533fd3c00 2023-10-03T19:21:16.523 INFO:teuthology.orchestra.run.smithi045.stdout: -79> 2023-10-03T19:17:21.302+0000 7f0ab4969640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== mds.0 v2:172.21.15.45:6832/2572156585 0 ==== mds_metrics from rank=0 carrying 1 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x565534e1b800 con 0x565533fd3c00 2023-10-03T19:21:16.524 INFO:teuthology.orchestra.run.smithi045.stdout: -78> 2023-10-03T19:17:21.302+0000 7f0ab4969640 20 mds.metric.aggregator handle_mds_metrics: applying 1 updates for rank=0 with sequence number 6 2023-10-03T19:21:16.524 INFO:teuthology.orchestra.run.smithi045.stdout: -77> 2023-10-03T19:17:21.302+0000 7f0ab4969640 10 mds.pinger pong_received: rank=0, sequence=6 2023-10-03T19:21:16.524 INFO:teuthology.orchestra.run.smithi045.stdout: -76> 2023-10-03T19:17:21.302+0000 7f0ab4969640 20 mds.metric.aggregator remove_metrics_for_rank: client=client.6102 172.21.15.146:0/2314684411, rank=0 2023-10-03T19:21:16.524 INFO:teuthology.orchestra.run.smithi045.stdout: -75> 2023-10-03T19:17:21.302+0000 7f0ab4969640 20 mds.metric.aggregator remove_metrics_for_rank: rank=0 has 0 connected client(s) 2023-10-03T19:21:16.524 INFO:teuthology.orchestra.run.smithi045.stdout: -74> 2023-10-03T19:17:21.330+0000 7f0ab1162640 2 mds.0.cache Memory usage: total 304916, rss 76896, heap 207144, baseline 190760, 0 / 1014 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:16.524 INFO:teuthology.orchestra.run.smithi045.stdout: -73> 2023-10-03T19:17:21.330+0000 7f0ab1162640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999990761s ago 2023-10-03T19:21:16.524 INFO:teuthology.orchestra.run.smithi045.stdout: -72> 2023-10-03T19:17:21.330+0000 7f0ab1162640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:16.524 INFO:teuthology.orchestra.run.smithi045.stdout: -71> 2023-10-03T19:17:21.330+0000 7f0ab1162640 7 mds.0.cache trim bytes_used=2MB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:16.524 INFO:teuthology.orchestra.run.smithi045.stdout: -70> 2023-10-03T19:17:21.330+0000 7f0ab1162640 7 mds.0.cache trim_lru trimming 0 items from LRU size=1011 mid=481 pintail=323 pinned=323 2023-10-03T19:21:16.524 INFO:teuthology.orchestra.run.smithi045.stdout: -69> 2023-10-03T19:17:21.330+0000 7f0ab1162640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:16.524 INFO:teuthology.orchestra.run.smithi045.stdout: -68> 2023-10-03T19:17:21.330+0000 7f0ab1162640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:16.578 INFO:teuthology.orchestra.run.smithi045.stdout: -67> 2023-10-03T19:17:21.330+0000 7f0ab1162640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:16.578 INFO:teuthology.orchestra.run.smithi045.stdout: -66> 2023-10-03T19:17:21.330+0000 7f0ab1162640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:16.578 INFO:teuthology.orchestra.run.smithi045.stdout: -65> 2023-10-03T19:17:21.954+0000 7f0ab4168640 10 monclient: tick 2023-10-03T19:21:16.578 INFO:teuthology.orchestra.run.smithi045.stdout: -64> 2023-10-03T19:17:21.954+0000 7f0ab4168640 10 monclient: _check_auth_tickets 2023-10-03T19:21:16.578 INFO:teuthology.orchestra.run.smithi045.stdout: -63> 2023-10-03T19:17:21.954+0000 7f0ab4168640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:16:51.956330+0000) 2023-10-03T19:21:16.578 INFO:teuthology.orchestra.run.smithi045.stdout: -62> 2023-10-03T19:17:22.302+0000 7f0ab3967640 20 mds.0.27 get_task_status 2023-10-03T19:21:16.578 INFO:teuthology.orchestra.run.smithi045.stdout: -61> 2023-10-03T19:17:22.302+0000 7f0ab3967640 20 mds.0.27 schedule_update_timer_task 2023-10-03T19:21:16.579 INFO:teuthology.orchestra.run.smithi045.stdout: -60> 2023-10-03T19:17:22.302+0000 7f0aad95b640 10 mds.metric.aggregator ping_all_active_ranks: pinging 1 active mds(s) 2023-10-03T19:21:16.579 INFO:teuthology.orchestra.run.smithi045.stdout: -59> 2023-10-03T19:17:22.302+0000 7f0aad95b640 20 mds.metric.aggregator ping_all_active_ranks: pinging rank=0 addr=[v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] 2023-10-03T19:21:16.579 INFO:teuthology.orchestra.run.smithi045.stdout: -58> 2023-10-03T19:17:22.302+0000 7f0aad95b640 10 mds.pinger send_ping: rank=0 2023-10-03T19:21:16.579 INFO:teuthology.orchestra.run.smithi045.stdout: -57> 2023-10-03T19:17:22.302+0000 7f0aad95b640 10 mds.pinger send_ping: sending ping with sequence=7 to rank=0 2023-10-03T19:21:16.579 INFO:teuthology.orchestra.run.smithi045.stdout: -56> 2023-10-03T19:17:22.302+0000 7f0aad95b640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] send_to--> mds [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] -- mdsping v1 -- ?+0 0x5655340a4640 2023-10-03T19:21:16.579 INFO:teuthology.orchestra.run.smithi045.stdout: -55> 2023-10-03T19:17:22.302+0000 7f0aad95b640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] -- mdsping v1 -- 0x5655340a4640 con 0x565533fd3c00 2023-10-03T19:21:16.579 INFO:teuthology.orchestra.run.smithi045.stdout: -54> 2023-10-03T19:17:22.302+0000 7f0ab4969640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== mds.0 v2:172.21.15.45:6832/2572156585 0 ==== mdsping v1 ==== 0+0+0 (unknown 0 0 0) 0x5655340a4640 con 0x565533fd3c00 2023-10-03T19:21:16.579 INFO:teuthology.orchestra.run.smithi045.stdout: -53> 2023-10-03T19:17:22.302+0000 7f0ab4969640 20 set_next_seq: mds.metrics: current sequence number 6, setting next sequence number 7 2023-10-03T19:21:16.579 INFO:teuthology.orchestra.run.smithi045.stdout: -52> 2023-10-03T19:17:22.330+0000 7f0ab1162640 2 mds.0.cache Memory usage: total 304916, rss 76896, heap 207144, baseline 190760, 0 / 1014 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:16.579 INFO:teuthology.orchestra.run.smithi045.stdout: -51> 2023-10-03T19:17:22.330+0000 7f0ab1162640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999990761s ago 2023-10-03T19:21:16.579 INFO:teuthology.orchestra.run.smithi045.stdout: -50> 2023-10-03T19:17:22.330+0000 7f0ab1162640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:16.580 INFO:teuthology.orchestra.run.smithi045.stdout: -49> 2023-10-03T19:17:22.330+0000 7f0ab1162640 7 mds.0.cache trim bytes_used=2MB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:16.580 INFO:teuthology.orchestra.run.smithi045.stdout: -48> 2023-10-03T19:17:22.330+0000 7f0ab1162640 7 mds.0.cache trim_lru trimming 0 items from LRU size=1011 mid=481 pintail=323 pinned=323 2023-10-03T19:21:16.580 INFO:teuthology.orchestra.run.smithi045.stdout: -47> 2023-10-03T19:17:22.330+0000 7f0ab1162640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:16.580 INFO:teuthology.orchestra.run.smithi045.stdout: -46> 2023-10-03T19:17:22.330+0000 7f0ab1162640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:16.580 INFO:teuthology.orchestra.run.smithi045.stdout: -45> 2023-10-03T19:17:22.330+0000 7f0ab1162640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:16.580 INFO:teuthology.orchestra.run.smithi045.stdout: -44> 2023-10-03T19:17:22.330+0000 7f0ab1162640 10 mds.0.cache releasing free memory 2023-10-03T19:21:16.580 INFO:teuthology.orchestra.run.smithi045.stdout: -43> 2023-10-03T19:17:22.334+0000 7f0ab1162640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:16.580 INFO:teuthology.orchestra.run.smithi045.stdout: -42> 2023-10-03T19:17:22.378+0000 7f0ab3166640 5 mds.beacon.a Sending beacon up:active seq 12 2023-10-03T19:21:16.580 INFO:teuthology.orchestra.run.smithi045.stdout: -41> 2023-10-03T19:17:22.378+0000 7f0ab3166640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:16.580 INFO:teuthology.orchestra.run.smithi045.stdout: -40> 2023-10-03T19:17:22.378+0000 7f0ab3166640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mdsbeacon(5904/a up:active seq=12 v29) v8 -- 0x5655356a6580 con 0x565533fd3000 2023-10-03T19:21:16.580 INFO:teuthology.orchestra.run.smithi045.stdout: -39> 2023-10-03T19:17:22.378+0000 7f0ab3166640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:16.581 INFO:teuthology.orchestra.run.smithi045.stdout: -38> 2023-10-03T19:17:22.378+0000 7f0ab8971640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== mon.0 v2:172.21.15.45:3300/0 63 ==== mdsbeacon(5904/a up:active seq=12 v29) v8 ==== 130+0+0 (secure 0 0 0) 0x5655356a6580 con 0x565533fd3000 2023-10-03T19:21:16.581 INFO:teuthology.orchestra.run.smithi045.stdout: -37> 2023-10-03T19:17:22.378+0000 7f0ab8971640 5 mds.beacon.a received beacon reply up:active seq 12 rtt 0 2023-10-03T19:21:16.581 INFO:teuthology.orchestra.run.smithi045.stdout: -36> 2023-10-03T19:17:22.378+0000 7f0ab3166640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:16.581 INFO:teuthology.orchestra.run.smithi045.stdout: -35> 2023-10-03T19:17:22.954+0000 7f0ab4168640 10 monclient: tick 2023-10-03T19:21:16.581 INFO:teuthology.orchestra.run.smithi045.stdout: -34> 2023-10-03T19:17:22.954+0000 7f0ab4168640 10 monclient: _check_auth_tickets 2023-10-03T19:21:16.581 INFO:teuthology.orchestra.run.smithi045.stdout: -33> 2023-10-03T19:17:22.954+0000 7f0ab4168640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:16:52.956473+0000) 2023-10-03T19:21:16.581 INFO:teuthology.orchestra.run.smithi045.stdout: -32> 2023-10-03T19:17:23.302+0000 7f0aae15c640 20 update_rank0: mds.metrics 2023-10-03T19:21:16.581 INFO:teuthology.orchestra.run.smithi045.stdout: -31> 2023-10-03T19:17:23.302+0000 7f0aae15c640 20 update_rank0: mds.metrics: sending metric updates for 0 clients to rank 0 (address: [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585]) with sequence number 7, last updated sequence number 16 2023-10-03T19:21:16.581 INFO:teuthology.orchestra.run.smithi045.stdout: -30> 2023-10-03T19:17:23.302+0000 7f0aae15c640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] send_to--> mds [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] -- mds_metrics from rank=0 carrying 0 metric updates v1 -- ?+0 0x565534e1b500 2023-10-03T19:21:16.581 INFO:teuthology.orchestra.run.smithi045.stdout: -29> 2023-10-03T19:17:23.302+0000 7f0aae15c640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] -- mds_metrics from rank=0 carrying 0 metric updates v1 -- 0x565534e1b500 con 0x565533fd3c00 2023-10-03T19:21:16.582 INFO:teuthology.orchestra.run.smithi045.stdout: -28> 2023-10-03T19:17:23.302+0000 7f0ab4969640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== mds.0 v2:172.21.15.45:6832/2572156585 0 ==== mds_metrics from rank=0 carrying 0 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x565534e1b500 con 0x565533fd3c00 2023-10-03T19:21:16.582 INFO:teuthology.orchestra.run.smithi045.stdout: -27> 2023-10-03T19:17:23.302+0000 7f0ab4969640 20 mds.metric.aggregator handle_mds_metrics: applying 0 updates for rank=0 with sequence number 7 2023-10-03T19:21:16.582 INFO:teuthology.orchestra.run.smithi045.stdout: -26> 2023-10-03T19:17:23.302+0000 7f0ab4969640 10 mds.pinger pong_received: rank=0, sequence=7 2023-10-03T19:21:16.582 INFO:teuthology.orchestra.run.smithi045.stdout: -25> 2023-10-03T19:17:23.334+0000 7f0ab1162640 2 mds.0.cache Memory usage: total 304916, rss 58468, heap 207144, baseline 190760, 0 / 1014 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:16.582 INFO:teuthology.orchestra.run.smithi045.stdout: -24> 2023-10-03T19:17:23.334+0000 7f0ab1162640 20 mds.0.cache upkeep thread trimming cache; last trim 1.003990769s ago 2023-10-03T19:21:16.582 INFO:teuthology.orchestra.run.smithi045.stdout: -23> 2023-10-03T19:17:23.334+0000 7f0ab1162640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:16.582 INFO:teuthology.orchestra.run.smithi045.stdout: -22> 2023-10-03T19:17:23.334+0000 7f0ab1162640 7 mds.0.cache trim bytes_used=2MB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:16.582 INFO:teuthology.orchestra.run.smithi045.stdout: -21> 2023-10-03T19:17:23.334+0000 7f0ab1162640 7 mds.0.cache trim_lru trimming 0 items from LRU size=1011 mid=481 pintail=323 pinned=323 2023-10-03T19:21:16.582 INFO:teuthology.orchestra.run.smithi045.stdout: -20> 2023-10-03T19:17:23.334+0000 7f0ab1162640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:16.582 INFO:teuthology.orchestra.run.smithi045.stdout: -19> 2023-10-03T19:17:23.334+0000 7f0ab1162640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:16.582 INFO:teuthology.orchestra.run.smithi045.stdout: -18> 2023-10-03T19:17:23.334+0000 7f0ab1162640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:16.583 INFO:teuthology.orchestra.run.smithi045.stdout: -17> 2023-10-03T19:17:23.334+0000 7f0ab1162640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:16.583 INFO:teuthology.orchestra.run.smithi045.stdout: -16> 2023-10-03T19:17:23.498+0000 7f0ab516a640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== mon.0 v2:172.21.15.45:3300/0 64 ==== osd_map(64..64 src has 1..64) v4 ==== 519+0+0 (secure 0 0 0) 0x5655352eae00 con 0x565533fd3000 2023-10-03T19:21:16.583 INFO:teuthology.orchestra.run.smithi045.stdout: -15> 2023-10-03T19:17:23.498+0000 7f0ab516a640 10 mds.0.snap check_osd_map need_to_purge={} 2023-10-03T19:21:16.583 INFO:teuthology.orchestra.run.smithi045.stdout: -14> 2023-10-03T19:17:23.498+0000 7f0ab516a640 7 mds.0.server operator(): full = 0 epoch = 64 2023-10-03T19:21:16.583 INFO:teuthology.orchestra.run.smithi045.stdout: -13> 2023-10-03T19:17:23.498+0000 7f0ab516a640 10 mds.0.server apply_blocklist: killed 0 2023-10-03T19:21:16.583 INFO:teuthology.orchestra.run.smithi045.stdout: -12> 2023-10-03T19:17:23.498+0000 7f0ab516a640 4 mds.0.27 apply_blocklist: killed 0, blocklisted sessions (2 blocklist entries, 0) 2023-10-03T19:21:16.583 INFO:teuthology.orchestra.run.smithi045.stdout: -11> 2023-10-03T19:17:23.498+0000 7f0ab516a640 10 monclient: _renew_subs 2023-10-03T19:21:16.583 INFO:teuthology.orchestra.run.smithi045.stdout: -10> 2023-10-03T19:17:23.498+0000 7f0ab516a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:16.583 INFO:teuthology.orchestra.run.smithi045.stdout: -9> 2023-10-03T19:17:23.498+0000 7f0ab516a640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=65}) v3 -- 0x565534e6e4e0 con 0x565533fd3000 2023-10-03T19:21:16.583 INFO:teuthology.orchestra.run.smithi045.stdout: -8> 2023-10-03T19:17:23.758+0000 7f0ab516a640 1 -- [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] <== mon.0 v2:172.21.15.45:3300/0 65 ==== mdsmap(e 30) v2 ==== 225+0+0 (secure 0 0 0) 0x565534e6e4e0 con 0x565533fd3000 2023-10-03T19:21:16.583 INFO:teuthology.orchestra.run.smithi045.stdout: -7> 2023-10-03T19:17:23.758+0000 7f0ab516a640 1 mds.a Updating MDS map to version 30 from mon.0 2023-10-03T19:21:16.584 INFO:teuthology.orchestra.run.smithi045.stdout: -6> 2023-10-03T19:17:23.758+0000 7f0ab516a640 10 mds.a my compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-03T19:21:16.584 INFO:teuthology.orchestra.run.smithi045.stdout: -5> 2023-10-03T19:17:23.758+0000 7f0ab516a640 10 mds.a mdsmap compat compat={},rocompat={},incompat={7=mds uses inline data} 2023-10-03T19:21:16.584 INFO:teuthology.orchestra.run.smithi045.stdout: -4> 2023-10-03T19:17:23.758+0000 7f0ab516a640 10 mds.a my gid is 5904 2023-10-03T19:21:16.584 INFO:teuthology.orchestra.run.smithi045.stdout: -3> 2023-10-03T19:17:23.758+0000 7f0ab516a640 10 mds.a map says I am mds.-1.-1 state null 2023-10-03T19:21:16.584 INFO:teuthology.orchestra.run.smithi045.stdout: -2> 2023-10-03T19:17:23.758+0000 7f0ab516a640 10 mds.a msgr says I am [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] 2023-10-03T19:21:16.584 INFO:teuthology.orchestra.run.smithi045.stdout: -1> 2023-10-03T19:17:23.758+0000 7f0ab516a640 1 mds.a Map removed me [mds.a{0:5904} state up:active seq 3 addr [v2:172.21.15.45:6832/2572156585,v1:172.21.15.45:6833/2572156585] compat {c=[1],r=[1],i=[7ff]}] from cluster; respawning! See cluster/monitor logs for details. 2023-10-03T19:21:16.584 INFO:teuthology.orchestra.run.smithi045.stdout: 0> 2023-10-03T19:17:23.758+0000 7f0ab516a640 1 mds.a respawn! 2023-10-03T19:21:16.584 INFO:teuthology.orchestra.run.smithi045.stdout:--- logging levels --- 2023-10-03T19:21:16.584 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 none 2023-10-03T19:21:16.584 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 lockdep 2023-10-03T19:21:16.584 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 context 2023-10-03T19:21:16.584 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 1 crush 2023-10-03T19:21:16.585 INFO:teuthology.orchestra.run.smithi045.stdout: 20/20 mds 2023-10-03T19:21:16.585 INFO:teuthology.orchestra.run.smithi045.stdout: 20/20 mds_balancer 2023-10-03T19:21:16.585 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mds_locker 2023-10-03T19:21:16.585 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mds_log 2023-10-03T19:21:16.585 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mds_log_expire 2023-10-03T19:21:16.585 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mds_migrator 2023-10-03T19:21:16.585 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 buffer 2023-10-03T19:21:16.585 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 timer 2023-10-03T19:21:16.585 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 filer 2023-10-03T19:21:16.585 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 striper 2023-10-03T19:21:16.585 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 objecter 2023-10-03T19:21:16.585 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 rados 2023-10-03T19:21:16.586 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 rbd 2023-10-03T19:21:16.586 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 rbd_mirror 2023-10-03T19:21:16.586 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 rbd_replay 2023-10-03T19:21:16.586 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 rbd_pwl 2023-10-03T19:21:16.586 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 journaler 2023-10-03T19:21:16.586 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 objectcacher 2023-10-03T19:21:16.586 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 immutable_obj_cache 2023-10-03T19:21:16.586 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 client 2023-10-03T19:21:16.586 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 osd 2023-10-03T19:21:16.586 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 optracker 2023-10-03T19:21:16.586 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 objclass 2023-10-03T19:21:16.587 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 3 filestore 2023-10-03T19:21:16.587 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 3 journal 2023-10-03T19:21:16.587 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 1 ms 2023-10-03T19:21:16.587 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mon 2023-10-03T19:21:16.587 INFO:teuthology.orchestra.run.smithi045.stdout: 0/10 monc 2023-10-03T19:21:16.587 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 paxos 2023-10-03T19:21:16.587 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 tp 2023-10-03T19:21:16.587 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 auth 2023-10-03T19:21:16.587 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 crypto 2023-10-03T19:21:16.587 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 1 finisher 2023-10-03T19:21:16.587 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 1 reserver 2023-10-03T19:21:16.587 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 heartbeatmap 2023-10-03T19:21:16.588 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 perfcounter 2023-10-03T19:21:16.588 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw 2023-10-03T19:21:16.588 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw_sync 2023-10-03T19:21:16.588 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw_datacache 2023-10-03T19:21:16.588 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw_access 2023-10-03T19:21:16.588 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw_dbstore 2023-10-03T19:21:16.588 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw_flight 2023-10-03T19:21:16.588 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 javaclient 2023-10-03T19:21:16.623 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 asok 2023-10-03T19:21:16.623 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 1 throttle 2023-10-03T19:21:16.623 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 0 refs 2023-10-03T19:21:16.624 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 compressor 2023-10-03T19:21:16.624 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 bluestore 2023-10-03T19:21:16.624 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 bluefs 2023-10-03T19:21:16.624 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 3 bdev 2023-10-03T19:21:16.624 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 kstore 2023-10-03T19:21:16.624 INFO:teuthology.orchestra.run.smithi045.stdout: 4/ 5 rocksdb 2023-10-03T19:21:16.624 INFO:teuthology.orchestra.run.smithi045.stdout: 4/ 5 leveldb 2023-10-03T19:21:16.624 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 fuse 2023-10-03T19:21:16.624 INFO:teuthology.orchestra.run.smithi045.stdout: 2/ 5 mgr 2023-10-03T19:21:16.624 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mgrc 2023-10-03T19:21:16.624 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 dpdk 2023-10-03T19:21:16.624 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 eventtrace 2023-10-03T19:21:16.625 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 prioritycache 2023-10-03T19:21:16.625 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 test 2023-10-03T19:21:16.625 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 cephfs_mirror 2023-10-03T19:21:16.625 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 cephsqlite 2023-10-03T19:21:16.625 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore 2023-10-03T19:21:16.625 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_onode 2023-10-03T19:21:16.625 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_odata 2023-10-03T19:21:16.625 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_omap 2023-10-03T19:21:16.625 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_tm 2023-10-03T19:21:16.625 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_t 2023-10-03T19:21:16.625 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_cleaner 2023-10-03T19:21:16.626 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_epm 2023-10-03T19:21:16.626 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_lba 2023-10-03T19:21:16.626 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_fixedkv_tree 2023-10-03T19:21:16.626 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_cache 2023-10-03T19:21:16.626 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_journal 2023-10-03T19:21:16.626 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_device 2023-10-03T19:21:16.626 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_backref 2023-10-03T19:21:16.626 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 alienstore 2023-10-03T19:21:16.626 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mclock 2023-10-03T19:21:16.626 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 cyanstore 2023-10-03T19:21:16.626 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 ceph_exporter 2023-10-03T19:21:16.626 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 memstore 2023-10-03T19:21:16.627 INFO:teuthology.orchestra.run.smithi045.stdout: -2/-2 (syslog threshold) 2023-10-03T19:21:16.627 INFO:teuthology.orchestra.run.smithi045.stdout: -1/-1 (stderr threshold) 2023-10-03T19:21:16.627 INFO:teuthology.orchestra.run.smithi045.stdout:--- pthread ID / name mapping for recent threads --- 2023-10-03T19:21:16.627 INFO:teuthology.orchestra.run.smithi045.stdout: 7f0aad95b640 / ms_dispatch 2023-10-03T19:21:16.627 INFO:teuthology.orchestra.run.smithi045.stdout: 7f0aae15c640 / ms_dispatch 2023-10-03T19:21:16.627 INFO:teuthology.orchestra.run.smithi045.stdout: 7f0aae95d640 / md_submit 2023-10-03T19:21:16.627 INFO:teuthology.orchestra.run.smithi045.stdout: 7f0aaf15e640 / MR_Finisher 2023-10-03T19:21:16.627 INFO:teuthology.orchestra.run.smithi045.stdout: 7f0ab0961640 / mds_rank_progr 2023-10-03T19:21:16.627 INFO:teuthology.orchestra.run.smithi045.stdout: 7f0ab1162640 / ms_dispatch 2023-10-03T19:21:16.627 INFO:teuthology.orchestra.run.smithi045.stdout: 7f0ab2965640 / safe_timer 2023-10-03T19:21:16.627 INFO:teuthology.orchestra.run.smithi045.stdout: 7f0ab3166640 / ceph-mds 2023-10-03T19:21:16.627 INFO:teuthology.orchestra.run.smithi045.stdout: 7f0ab3967640 / safe_timer 2023-10-03T19:21:16.628 INFO:teuthology.orchestra.run.smithi045.stdout: 7f0ab4168640 / safe_timer 2023-10-03T19:21:16.628 INFO:teuthology.orchestra.run.smithi045.stdout: 7f0ab4969640 / ms_local 2023-10-03T19:21:16.628 INFO:teuthology.orchestra.run.smithi045.stdout: 7f0ab516a640 / ms_dispatch 2023-10-03T19:21:16.628 INFO:teuthology.orchestra.run.smithi045.stdout: 7f0ab796f640 / msgr-worker-2 2023-10-03T19:21:16.628 INFO:teuthology.orchestra.run.smithi045.stdout: 7f0ab8170640 / msgr-worker-1 2023-10-03T19:21:16.628 INFO:teuthology.orchestra.run.smithi045.stdout: 7f0ab8971640 / msgr-worker-0 2023-10-03T19:21:16.628 INFO:teuthology.orchestra.run.smithi045.stdout: max_recent 10000 2023-10-03T19:21:16.628 INFO:teuthology.orchestra.run.smithi045.stdout: max_new 1000 2023-10-03T19:21:16.628 INFO:teuthology.orchestra.run.smithi045.stdout: log_file /var/log/ceph/ceph-mds.a.log 2023-10-03T19:21:16.628 INFO:teuthology.orchestra.run.smithi045.stdout:--- end dump of recent events --- 2023-10-03T19:21:16.628 INFO:teuthology.orchestra.run.smithi045.stdout:--- begin dump of recent events --- 2023-10-03T19:21:16.629 INFO:teuthology.orchestra.run.smithi045.stdout: -9999> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000040d) mark_clean [inode 0x1000000040d [2,head] /dc-dir/dc-file_536 auth v4718 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.930426+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94436100] 2023-10-03T19:21:16.629 INFO:teuthology.orchestra.run.smithi045.stdout: -9998> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 4718 now clean [dentry #0x1/dc-dir/dc-file_536 [2,head] auth (dversion lock) v=4718 ino=0x1000000040d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94431680] 2023-10-03T19:21:16.629 INFO:teuthology.orchestra.run.smithi045.stdout: -9997> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_536) mark_clean [dentry #0x1/dc-dir/dc-file_536 [2,head] auth (dversion lock) v=4718 ino=0x1000000040d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94431680] 2023-10-03T19:21:16.629 INFO:teuthology.orchestra.run.smithi045.stdout: -9996> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 4720 now clean [inode 0x1000000040e [2,head] /dc-dir/dc-file_537 auth v4720 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.942874+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94436680] 2023-10-03T19:21:16.629 INFO:teuthology.orchestra.run.smithi045.stdout: -9995> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000040e) mark_clean [inode 0x1000000040e [2,head] /dc-dir/dc-file_537 auth v4720 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.942874+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94436680] 2023-10-03T19:21:16.629 INFO:teuthology.orchestra.run.smithi045.stdout: -9994> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 4720 now clean [dentry #0x1/dc-dir/dc-file_537 [2,head] auth (dversion lock) v=4720 ino=0x1000000040e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94431900] 2023-10-03T19:21:16.629 INFO:teuthology.orchestra.run.smithi045.stdout: -9993> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_537) mark_clean [dentry #0x1/dc-dir/dc-file_537 [2,head] auth (dversion lock) v=4720 ino=0x1000000040e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94431900] 2023-10-03T19:21:16.630 INFO:teuthology.orchestra.run.smithi045.stdout: -9992> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 4722 now clean [inode 0x1000000040f [2,head] /dc-dir/dc-file_538 auth v4722 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.954237+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94436c00] 2023-10-03T19:21:16.708 INFO:teuthology.orchestra.run.smithi045.stdout: -9991> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000040f) mark_clean [inode 0x1000000040f [2,head] /dc-dir/dc-file_538 auth v4722 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.954237+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94436c00] 2023-10-03T19:21:16.708 INFO:teuthology.orchestra.run.smithi045.stdout: -9990> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 4722 now clean [dentry #0x1/dc-dir/dc-file_538 [2,head] auth (dversion lock) v=4722 ino=0x1000000040f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94431b80] 2023-10-03T19:21:16.708 INFO:teuthology.orchestra.run.smithi045.stdout: -9989> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_538) mark_clean [dentry #0x1/dc-dir/dc-file_538 [2,head] auth (dversion lock) v=4722 ino=0x1000000040f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94431b80] 2023-10-03T19:21:16.708 INFO:teuthology.orchestra.run.smithi045.stdout: -9988> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 4724 now clean [inode 0x10000000410 [2,head] /dc-dir/dc-file_539 auth v4724 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.965749+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94437180] 2023-10-03T19:21:16.709 INFO:teuthology.orchestra.run.smithi045.stdout: -9987> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000410) mark_clean [inode 0x10000000410 [2,head] /dc-dir/dc-file_539 auth v4724 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.965749+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94437180] 2023-10-03T19:21:16.709 INFO:teuthology.orchestra.run.smithi045.stdout: -9986> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 4724 now clean [dentry #0x1/dc-dir/dc-file_539 [2,head] auth (dversion lock) v=4724 ino=0x10000000410 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9443c000] 2023-10-03T19:21:16.709 INFO:teuthology.orchestra.run.smithi045.stdout: -9985> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_539) mark_clean [dentry #0x1/dc-dir/dc-file_539 [2,head] auth (dversion lock) v=4724 ino=0x10000000410 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9443c000] 2023-10-03T19:21:16.709 INFO:teuthology.orchestra.run.smithi045.stdout: -9984> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 4726 now clean [inode 0x10000000411 [2,head] /dc-dir/dc-file_540 auth v4726 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.977987+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94437700] 2023-10-03T19:21:16.709 INFO:teuthology.orchestra.run.smithi045.stdout: -9983> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000411) mark_clean [inode 0x10000000411 [2,head] /dc-dir/dc-file_540 auth v4726 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.977987+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94437700] 2023-10-03T19:21:16.709 INFO:teuthology.orchestra.run.smithi045.stdout: -9982> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 4726 now clean [dentry #0x1/dc-dir/dc-file_540 [2,head] auth (dversion lock) v=4726 ino=0x10000000411 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9443c280] 2023-10-03T19:21:16.709 INFO:teuthology.orchestra.run.smithi045.stdout: -9981> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_540) mark_clean [dentry #0x1/dc-dir/dc-file_540 [2,head] auth (dversion lock) v=4726 ino=0x10000000411 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9443c280] 2023-10-03T19:21:16.709 INFO:teuthology.orchestra.run.smithi045.stdout: -9980> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 4728 now clean [inode 0x10000000412 [2,head] /dc-dir/dc-file_541 auth v4728 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.989691+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94442000] 2023-10-03T19:21:16.709 INFO:teuthology.orchestra.run.smithi045.stdout: -9979> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000412) mark_clean [inode 0x10000000412 [2,head] /dc-dir/dc-file_541 auth v4728 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.989691+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94442000] 2023-10-03T19:21:16.710 INFO:teuthology.orchestra.run.smithi045.stdout: -9978> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 4728 now clean [dentry #0x1/dc-dir/dc-file_541 [2,head] auth (dversion lock) v=4728 ino=0x10000000412 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9443c500] 2023-10-03T19:21:16.710 INFO:teuthology.orchestra.run.smithi045.stdout: -9977> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_541) mark_clean [dentry #0x1/dc-dir/dc-file_541 [2,head] auth (dversion lock) v=4728 ino=0x10000000412 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9443c500] 2023-10-03T19:21:16.710 INFO:teuthology.orchestra.run.smithi045.stdout: -9976> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 4730 now clean [inode 0x10000000413 [2,head] /dc-dir/dc-file_542 auth v4730 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.001754+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94442580] 2023-10-03T19:21:16.710 INFO:teuthology.orchestra.run.smithi045.stdout: -9975> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000413) mark_clean [inode 0x10000000413 [2,head] /dc-dir/dc-file_542 auth v4730 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.001754+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94442580] 2023-10-03T19:21:16.710 INFO:teuthology.orchestra.run.smithi045.stdout: -9974> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 4730 now clean [dentry #0x1/dc-dir/dc-file_542 [2,head] auth (dversion lock) v=4730 ino=0x10000000413 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9443c780] 2023-10-03T19:21:16.710 INFO:teuthology.orchestra.run.smithi045.stdout: -9973> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_542) mark_clean [dentry #0x1/dc-dir/dc-file_542 [2,head] auth (dversion lock) v=4730 ino=0x10000000413 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9443c780] 2023-10-03T19:21:16.710 INFO:teuthology.orchestra.run.smithi045.stdout: -9972> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 4732 now clean [inode 0x10000000414 [2,head] /dc-dir/dc-file_543 auth v4732 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.013623+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94442b00] 2023-10-03T19:21:16.710 INFO:teuthology.orchestra.run.smithi045.stdout: -9971> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000414) mark_clean [inode 0x10000000414 [2,head] /dc-dir/dc-file_543 auth v4732 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.013623+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94442b00] 2023-10-03T19:21:16.710 INFO:teuthology.orchestra.run.smithi045.stdout: -9970> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 4732 now clean [dentry #0x1/dc-dir/dc-file_543 [2,head] auth (dversion lock) v=4732 ino=0x10000000414 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9443ca00] 2023-10-03T19:21:16.710 INFO:teuthology.orchestra.run.smithi045.stdout: -9969> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_543) mark_clean [dentry #0x1/dc-dir/dc-file_543 [2,head] auth (dversion lock) v=4732 ino=0x10000000414 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9443ca00] 2023-10-03T19:21:16.711 INFO:teuthology.orchestra.run.smithi045.stdout: -9968> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 4734 now clean [inode 0x10000000415 [2,head] /dc-dir/dc-file_544 auth v4734 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.025118+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94443080] 2023-10-03T19:21:16.711 INFO:teuthology.orchestra.run.smithi045.stdout: -9967> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000415) mark_clean [inode 0x10000000415 [2,head] /dc-dir/dc-file_544 auth v4734 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.025118+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94443080] 2023-10-03T19:21:16.711 INFO:teuthology.orchestra.run.smithi045.stdout: -9966> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 4734 now clean [dentry #0x1/dc-dir/dc-file_544 [2,head] auth (dversion lock) v=4734 ino=0x10000000415 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9443cc80] 2023-10-03T19:21:16.711 INFO:teuthology.orchestra.run.smithi045.stdout: -9965> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_544) mark_clean [dentry #0x1/dc-dir/dc-file_544 [2,head] auth (dversion lock) v=4734 ino=0x10000000415 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9443cc80] 2023-10-03T19:21:16.711 INFO:teuthology.orchestra.run.smithi045.stdout: -9964> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 4736 now clean [inode 0x10000000416 [2,head] /dc-dir/dc-file_545 auth v4736 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.036209+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94443600] 2023-10-03T19:21:16.711 INFO:teuthology.orchestra.run.smithi045.stdout: -9963> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000416) mark_clean [inode 0x10000000416 [2,head] /dc-dir/dc-file_545 auth v4736 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.036209+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94443600] 2023-10-03T19:21:16.711 INFO:teuthology.orchestra.run.smithi045.stdout: -9962> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 4736 now clean [dentry #0x1/dc-dir/dc-file_545 [2,head] auth (dversion lock) v=4736 ino=0x10000000416 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9443cf00] 2023-10-03T19:21:16.711 INFO:teuthology.orchestra.run.smithi045.stdout: -9961> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_545) mark_clean [dentry #0x1/dc-dir/dc-file_545 [2,head] auth (dversion lock) v=4736 ino=0x10000000416 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9443cf00] 2023-10-03T19:21:16.711 INFO:teuthology.orchestra.run.smithi045.stdout: -9960> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 4738 now clean [inode 0x10000000417 [2,head] /dc-dir/dc-file_546 auth v4738 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.049212+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94443b80] 2023-10-03T19:21:16.711 INFO:teuthology.orchestra.run.smithi045.stdout: -9959> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000417) mark_clean [inode 0x10000000417 [2,head] /dc-dir/dc-file_546 auth v4738 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.049212+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94443b80] 2023-10-03T19:21:16.711 INFO:teuthology.orchestra.run.smithi045.stdout: -9958> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 4738 now clean [dentry #0x1/dc-dir/dc-file_546 [2,head] auth (dversion lock) v=4738 ino=0x10000000417 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9443d180] 2023-10-03T19:21:16.712 INFO:teuthology.orchestra.run.smithi045.stdout: -9957> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_546) mark_clean [dentry #0x1/dc-dir/dc-file_546 [2,head] auth (dversion lock) v=4738 ino=0x10000000417 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9443d180] 2023-10-03T19:21:16.712 INFO:teuthology.orchestra.run.smithi045.stdout: -9956> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 4740 now clean [inode 0x10000000418 [2,head] /dc-dir/dc-file_547 auth v4740 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.063319+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94444100] 2023-10-03T19:21:16.712 INFO:teuthology.orchestra.run.smithi045.stdout: -9955> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000418) mark_clean [inode 0x10000000418 [2,head] /dc-dir/dc-file_547 auth v4740 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.063319+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94444100] 2023-10-03T19:21:16.712 INFO:teuthology.orchestra.run.smithi045.stdout: -9954> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 4740 now clean [dentry #0x1/dc-dir/dc-file_547 [2,head] auth (dversion lock) v=4740 ino=0x10000000418 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9443d400] 2023-10-03T19:21:16.712 INFO:teuthology.orchestra.run.smithi045.stdout: -9953> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_547) mark_clean [dentry #0x1/dc-dir/dc-file_547 [2,head] auth (dversion lock) v=4740 ino=0x10000000418 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9443d400] 2023-10-03T19:21:16.712 INFO:teuthology.orchestra.run.smithi045.stdout: -9952> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5034 now clean [inode 0x10000000419 [2,head] /dc-dir/dc-file_548 auth v5034 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.082921+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94444680] 2023-10-03T19:21:16.712 INFO:teuthology.orchestra.run.smithi045.stdout: -9951> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000419) mark_clean [inode 0x10000000419 [2,head] /dc-dir/dc-file_548 auth v5034 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.082921+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94444680] 2023-10-03T19:21:16.712 INFO:teuthology.orchestra.run.smithi045.stdout: -9950> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5034 now clean [dentry #0x1/dc-dir/dc-file_548 [2,head] auth (dversion lock) v=5034 ino=0x10000000419 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9443d680] 2023-10-03T19:21:16.712 INFO:teuthology.orchestra.run.smithi045.stdout: -9949> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_548) mark_clean [dentry #0x1/dc-dir/dc-file_548 [2,head] auth (dversion lock) v=5034 ino=0x10000000419 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9443d680] 2023-10-03T19:21:16.712 INFO:teuthology.orchestra.run.smithi045.stdout: -9948> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5036 now clean [inode 0x1000000041a [2,head] /dc-dir/dc-file_549 auth v5036 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.199659+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94444c00] 2023-10-03T19:21:16.712 INFO:teuthology.orchestra.run.smithi045.stdout: -9947> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000041a) mark_clean [inode 0x1000000041a [2,head] /dc-dir/dc-file_549 auth v5036 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.199659+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94444c00] 2023-10-03T19:21:16.713 INFO:teuthology.orchestra.run.smithi045.stdout: -9946> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5036 now clean [dentry #0x1/dc-dir/dc-file_549 [2,head] auth (dversion lock) v=5036 ino=0x1000000041a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9443d900] 2023-10-03T19:21:16.713 INFO:teuthology.orchestra.run.smithi045.stdout: -9945> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_549) mark_clean [dentry #0x1/dc-dir/dc-file_549 [2,head] auth (dversion lock) v=5036 ino=0x1000000041a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9443d900] 2023-10-03T19:21:16.713 INFO:teuthology.orchestra.run.smithi045.stdout: -9944> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5038 now clean [inode 0x1000000041b [2,head] /dc-dir/dc-file_550 auth v5038 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.212148+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94445180] 2023-10-03T19:21:16.713 INFO:teuthology.orchestra.run.smithi045.stdout: -9943> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000041b) mark_clean [inode 0x1000000041b [2,head] /dc-dir/dc-file_550 auth v5038 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.212148+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94445180] 2023-10-03T19:21:16.713 INFO:teuthology.orchestra.run.smithi045.stdout: -9942> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5038 now clean [dentry #0x1/dc-dir/dc-file_550 [2,head] auth (dversion lock) v=5038 ino=0x1000000041b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9443db80] 2023-10-03T19:21:16.776 INFO:teuthology.orchestra.run.smithi045.stdout: -9941> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_550) mark_clean [dentry #0x1/dc-dir/dc-file_550 [2,head] auth (dversion lock) v=5038 ino=0x1000000041b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9443db80] 2023-10-03T19:21:16.776 INFO:teuthology.orchestra.run.smithi045.stdout: -9940> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5040 now clean [inode 0x1000000041c [2,head] /dc-dir/dc-file_551 auth v5040 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.223592+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94445700] 2023-10-03T19:21:16.776 INFO:teuthology.orchestra.run.smithi045.stdout: -9939> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000041c) mark_clean [inode 0x1000000041c [2,head] /dc-dir/dc-file_551 auth v5040 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.223592+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94445700] 2023-10-03T19:21:16.776 INFO:teuthology.orchestra.run.smithi045.stdout: -9938> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5040 now clean [dentry #0x1/dc-dir/dc-file_551 [2,head] auth (dversion lock) v=5040 ino=0x1000000041c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9457a000] 2023-10-03T19:21:16.776 INFO:teuthology.orchestra.run.smithi045.stdout: -9937> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_551) mark_clean [dentry #0x1/dc-dir/dc-file_551 [2,head] auth (dversion lock) v=5040 ino=0x1000000041c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9457a000] 2023-10-03T19:21:16.777 INFO:teuthology.orchestra.run.smithi045.stdout: -9936> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5042 now clean [inode 0x1000000041d [2,head] /dc-dir/dc-file_552 auth v5042 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.235543+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94566000] 2023-10-03T19:21:16.777 INFO:teuthology.orchestra.run.smithi045.stdout: -9935> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000041d) mark_clean [inode 0x1000000041d [2,head] /dc-dir/dc-file_552 auth v5042 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.235543+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94566000] 2023-10-03T19:21:16.777 INFO:teuthology.orchestra.run.smithi045.stdout: -9934> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5042 now clean [dentry #0x1/dc-dir/dc-file_552 [2,head] auth (dversion lock) v=5042 ino=0x1000000041d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9457a280] 2023-10-03T19:21:16.777 INFO:teuthology.orchestra.run.smithi045.stdout: -9933> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_552) mark_clean [dentry #0x1/dc-dir/dc-file_552 [2,head] auth (dversion lock) v=5042 ino=0x1000000041d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9457a280] 2023-10-03T19:21:16.777 INFO:teuthology.orchestra.run.smithi045.stdout: -9932> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5044 now clean [inode 0x1000000041e [2,head] /dc-dir/dc-file_553 auth v5044 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.247730+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94566580] 2023-10-03T19:21:16.777 INFO:teuthology.orchestra.run.smithi045.stdout: -9931> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000041e) mark_clean [inode 0x1000000041e [2,head] /dc-dir/dc-file_553 auth v5044 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.247730+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94566580] 2023-10-03T19:21:16.777 INFO:teuthology.orchestra.run.smithi045.stdout: -9930> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5044 now clean [dentry #0x1/dc-dir/dc-file_553 [2,head] auth (dversion lock) v=5044 ino=0x1000000041e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9457a500] 2023-10-03T19:21:16.777 INFO:teuthology.orchestra.run.smithi045.stdout: -9929> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_553) mark_clean [dentry #0x1/dc-dir/dc-file_553 [2,head] auth (dversion lock) v=5044 ino=0x1000000041e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9457a500] 2023-10-03T19:21:16.777 INFO:teuthology.orchestra.run.smithi045.stdout: -9928> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5046 now clean [inode 0x1000000041f [2,head] /dc-dir/dc-file_554 auth v5046 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.260060+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94566b00] 2023-10-03T19:21:16.777 INFO:teuthology.orchestra.run.smithi045.stdout: -9927> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000041f) mark_clean [inode 0x1000000041f [2,head] /dc-dir/dc-file_554 auth v5046 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.260060+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94566b00] 2023-10-03T19:21:16.777 INFO:teuthology.orchestra.run.smithi045.stdout: -9926> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5046 now clean [dentry #0x1/dc-dir/dc-file_554 [2,head] auth (dversion lock) v=5046 ino=0x1000000041f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9457a780] 2023-10-03T19:21:16.778 INFO:teuthology.orchestra.run.smithi045.stdout: -9925> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_554) mark_clean [dentry #0x1/dc-dir/dc-file_554 [2,head] auth (dversion lock) v=5046 ino=0x1000000041f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9457a780] 2023-10-03T19:21:16.778 INFO:teuthology.orchestra.run.smithi045.stdout: -9924> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5048 now clean [inode 0x10000000420 [2,head] /dc-dir/dc-file_555 auth v5048 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.272421+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94567080] 2023-10-03T19:21:16.778 INFO:teuthology.orchestra.run.smithi045.stdout: -9923> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000420) mark_clean [inode 0x10000000420 [2,head] /dc-dir/dc-file_555 auth v5048 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.272421+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94567080] 2023-10-03T19:21:16.778 INFO:teuthology.orchestra.run.smithi045.stdout: -9922> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5048 now clean [dentry #0x1/dc-dir/dc-file_555 [2,head] auth (dversion lock) v=5048 ino=0x10000000420 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9457aa00] 2023-10-03T19:21:16.778 INFO:teuthology.orchestra.run.smithi045.stdout: -9921> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_555) mark_clean [dentry #0x1/dc-dir/dc-file_555 [2,head] auth (dversion lock) v=5048 ino=0x10000000420 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9457aa00] 2023-10-03T19:21:16.778 INFO:teuthology.orchestra.run.smithi045.stdout: -9920> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5050 now clean [inode 0x10000000421 [2,head] /dc-dir/dc-file_556 auth v5050 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.284423+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94567600] 2023-10-03T19:21:16.778 INFO:teuthology.orchestra.run.smithi045.stdout: -9919> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000421) mark_clean [inode 0x10000000421 [2,head] /dc-dir/dc-file_556 auth v5050 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.284423+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94567600] 2023-10-03T19:21:16.778 INFO:teuthology.orchestra.run.smithi045.stdout: -9918> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5050 now clean [dentry #0x1/dc-dir/dc-file_556 [2,head] auth (dversion lock) v=5050 ino=0x10000000421 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9457ac80] 2023-10-03T19:21:16.778 INFO:teuthology.orchestra.run.smithi045.stdout: -9917> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_556) mark_clean [dentry #0x1/dc-dir/dc-file_556 [2,head] auth (dversion lock) v=5050 ino=0x10000000421 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9457ac80] 2023-10-03T19:21:16.778 INFO:teuthology.orchestra.run.smithi045.stdout: -9916> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5052 now clean [inode 0x10000000422 [2,head] /dc-dir/dc-file_557 auth v5052 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.296033+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94567b80] 2023-10-03T19:21:16.778 INFO:teuthology.orchestra.run.smithi045.stdout: -9915> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000422) mark_clean [inode 0x10000000422 [2,head] /dc-dir/dc-file_557 auth v5052 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.296033+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94567b80] 2023-10-03T19:21:16.779 INFO:teuthology.orchestra.run.smithi045.stdout: -9914> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5052 now clean [dentry #0x1/dc-dir/dc-file_557 [2,head] auth (dversion lock) v=5052 ino=0x10000000422 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9457af00] 2023-10-03T19:21:16.779 INFO:teuthology.orchestra.run.smithi045.stdout: -9913> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_557) mark_clean [dentry #0x1/dc-dir/dc-file_557 [2,head] auth (dversion lock) v=5052 ino=0x10000000422 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9457af00] 2023-10-03T19:21:16.779 INFO:teuthology.orchestra.run.smithi045.stdout: -9912> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5054 now clean [inode 0x10000000423 [2,head] /dc-dir/dc-file_558 auth v5054 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.308107+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94568100] 2023-10-03T19:21:16.779 INFO:teuthology.orchestra.run.smithi045.stdout: -9911> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000423) mark_clean [inode 0x10000000423 [2,head] /dc-dir/dc-file_558 auth v5054 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.308107+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94568100] 2023-10-03T19:21:16.779 INFO:teuthology.orchestra.run.smithi045.stdout: -9910> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5054 now clean [dentry #0x1/dc-dir/dc-file_558 [2,head] auth (dversion lock) v=5054 ino=0x10000000423 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9457b180] 2023-10-03T19:21:16.779 INFO:teuthology.orchestra.run.smithi045.stdout: -9909> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_558) mark_clean [dentry #0x1/dc-dir/dc-file_558 [2,head] auth (dversion lock) v=5054 ino=0x10000000423 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9457b180] 2023-10-03T19:21:16.779 INFO:teuthology.orchestra.run.smithi045.stdout: -9908> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5056 now clean [inode 0x10000000424 [2,head] /dc-dir/dc-file_559 auth v5056 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.320539+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94568680] 2023-10-03T19:21:16.779 INFO:teuthology.orchestra.run.smithi045.stdout: -9907> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000424) mark_clean [inode 0x10000000424 [2,head] /dc-dir/dc-file_559 auth v5056 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.320539+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94568680] 2023-10-03T19:21:16.779 INFO:teuthology.orchestra.run.smithi045.stdout: -9906> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5056 now clean [dentry #0x1/dc-dir/dc-file_559 [2,head] auth (dversion lock) v=5056 ino=0x10000000424 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9457b400] 2023-10-03T19:21:16.779 INFO:teuthology.orchestra.run.smithi045.stdout: -9905> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_559) mark_clean [dentry #0x1/dc-dir/dc-file_559 [2,head] auth (dversion lock) v=5056 ino=0x10000000424 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9457b400] 2023-10-03T19:21:16.779 INFO:teuthology.orchestra.run.smithi045.stdout: -9904> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5058 now clean [inode 0x10000000425 [2,head] /dc-dir/dc-file_560 auth v5058 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.333109+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94568c00] 2023-10-03T19:21:16.780 INFO:teuthology.orchestra.run.smithi045.stdout: -9903> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000425) mark_clean [inode 0x10000000425 [2,head] /dc-dir/dc-file_560 auth v5058 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.333109+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94568c00] 2023-10-03T19:21:16.780 INFO:teuthology.orchestra.run.smithi045.stdout: -9902> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5058 now clean [dentry #0x1/dc-dir/dc-file_560 [2,head] auth (dversion lock) v=5058 ino=0x10000000425 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9457b680] 2023-10-03T19:21:16.780 INFO:teuthology.orchestra.run.smithi045.stdout: -9901> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_560) mark_clean [dentry #0x1/dc-dir/dc-file_560 [2,head] auth (dversion lock) v=5058 ino=0x10000000425 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9457b680] 2023-10-03T19:21:16.780 INFO:teuthology.orchestra.run.smithi045.stdout: -9900> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5060 now clean [inode 0x10000000426 [2,head] /dc-dir/dc-file_561 auth v5060 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.345554+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94569180] 2023-10-03T19:21:16.780 INFO:teuthology.orchestra.run.smithi045.stdout: -9899> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000426) mark_clean [inode 0x10000000426 [2,head] /dc-dir/dc-file_561 auth v5060 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.345554+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94569180] 2023-10-03T19:21:16.780 INFO:teuthology.orchestra.run.smithi045.stdout: -9898> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5060 now clean [dentry #0x1/dc-dir/dc-file_561 [2,head] auth (dversion lock) v=5060 ino=0x10000000426 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9457b900] 2023-10-03T19:21:16.780 INFO:teuthology.orchestra.run.smithi045.stdout: -9897> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_561) mark_clean [dentry #0x1/dc-dir/dc-file_561 [2,head] auth (dversion lock) v=5060 ino=0x10000000426 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9457b900] 2023-10-03T19:21:16.780 INFO:teuthology.orchestra.run.smithi045.stdout: -9896> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5062 now clean [inode 0x10000000427 [2,head] /dc-dir/dc-file_562 auth v5062 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.358383+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94569700] 2023-10-03T19:21:16.780 INFO:teuthology.orchestra.run.smithi045.stdout: -9895> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000427) mark_clean [inode 0x10000000427 [2,head] /dc-dir/dc-file_562 auth v5062 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.358383+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94569700] 2023-10-03T19:21:16.780 INFO:teuthology.orchestra.run.smithi045.stdout: -9894> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5062 now clean [dentry #0x1/dc-dir/dc-file_562 [2,head] auth (dversion lock) v=5062 ino=0x10000000427 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9457bb80] 2023-10-03T19:21:16.780 INFO:teuthology.orchestra.run.smithi045.stdout: -9893> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_562) mark_clean [dentry #0x1/dc-dir/dc-file_562 [2,head] auth (dversion lock) v=5062 ino=0x10000000427 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9457bb80] 2023-10-03T19:21:16.781 INFO:teuthology.orchestra.run.smithi045.stdout: -9892> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5064 now clean [inode 0x10000000428 [2,head] /dc-dir/dc-file_563 auth v5064 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.370578+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94570000] 2023-10-03T19:21:16.781 INFO:teuthology.orchestra.run.smithi045.stdout: -9891> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000428) mark_clean [inode 0x10000000428 [2,head] /dc-dir/dc-file_563 auth v5064 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.370578+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94570000] 2023-10-03T19:21:16.781 INFO:teuthology.orchestra.run.smithi045.stdout: -9890> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5064 now clean [dentry #0x1/dc-dir/dc-file_563 [2,head] auth (dversion lock) v=5064 ino=0x10000000428 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9456e000] 2023-10-03T19:21:16.781 INFO:teuthology.orchestra.run.smithi045.stdout: -9889> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_563) mark_clean [dentry #0x1/dc-dir/dc-file_563 [2,head] auth (dversion lock) v=5064 ino=0x10000000428 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9456e000] 2023-10-03T19:21:16.781 INFO:teuthology.orchestra.run.smithi045.stdout: -9888> 2023-10-03T19:18:09.825+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 967 ==== osd_op_reply(1917 10000000545.00000000 [create,setxattr (99),setxattr (30)] v74'22 uv22 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:16.781 INFO:teuthology.orchestra.run.smithi045.stdout: -9887> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5066 now clean [inode 0x10000000429 [2,head] /dc-dir/dc-file_564 auth v5066 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.383261+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94570580] 2023-10-03T19:21:16.781 INFO:teuthology.orchestra.run.smithi045.stdout: -9886> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000429) mark_clean [inode 0x10000000429 [2,head] /dc-dir/dc-file_564 auth v5066 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.383261+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94570580] 2023-10-03T19:21:16.781 INFO:teuthology.orchestra.run.smithi045.stdout: -9885> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5066 now clean [dentry #0x1/dc-dir/dc-file_564 [2,head] auth (dversion lock) v=5066 ino=0x10000000429 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9456e280] 2023-10-03T19:21:16.864 INFO:teuthology.orchestra.run.smithi045.stdout: -9884> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_564) mark_clean [dentry #0x1/dc-dir/dc-file_564 [2,head] auth (dversion lock) v=5066 ino=0x10000000429 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9456e280] 2023-10-03T19:21:16.864 INFO:teuthology.orchestra.run.smithi045.stdout: -9883> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5068 now clean [inode 0x1000000042a [2,head] /dc-dir/dc-file_565 auth v5068 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.395263+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94570b00] 2023-10-03T19:21:16.864 INFO:teuthology.orchestra.run.smithi045.stdout: -9882> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000042a) mark_clean [inode 0x1000000042a [2,head] /dc-dir/dc-file_565 auth v5068 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.395263+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94570b00] 2023-10-03T19:21:16.864 INFO:teuthology.orchestra.run.smithi045.stdout: -9881> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5068 now clean [dentry #0x1/dc-dir/dc-file_565 [2,head] auth (dversion lock) v=5068 ino=0x1000000042a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9456e500] 2023-10-03T19:21:16.864 INFO:teuthology.orchestra.run.smithi045.stdout: -9880> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_565) mark_clean [dentry #0x1/dc-dir/dc-file_565 [2,head] auth (dversion lock) v=5068 ino=0x1000000042a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9456e500] 2023-10-03T19:21:16.864 INFO:teuthology.orchestra.run.smithi045.stdout: -9879> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5070 now clean [inode 0x1000000042b [2,head] /dc-dir/dc-file_566 auth v5070 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.407085+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94571080] 2023-10-03T19:21:16.864 INFO:teuthology.orchestra.run.smithi045.stdout: -9878> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000042b) mark_clean [inode 0x1000000042b [2,head] /dc-dir/dc-file_566 auth v5070 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.407085+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94571080] 2023-10-03T19:21:16.864 INFO:teuthology.orchestra.run.smithi045.stdout: -9877> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5070 now clean [dentry #0x1/dc-dir/dc-file_566 [2,head] auth (dversion lock) v=5070 ino=0x1000000042b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9456e780] 2023-10-03T19:21:16.864 INFO:teuthology.orchestra.run.smithi045.stdout: -9876> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_566) mark_clean [dentry #0x1/dc-dir/dc-file_566 [2,head] auth (dversion lock) v=5070 ino=0x1000000042b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9456e780] 2023-10-03T19:21:16.864 INFO:teuthology.orchestra.run.smithi045.stdout: -9875> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5072 now clean [inode 0x1000000042c [2,head] /dc-dir/dc-file_567 auth v5072 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.418880+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94571600] 2023-10-03T19:21:16.865 INFO:teuthology.orchestra.run.smithi045.stdout: -9874> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000042c) mark_clean [inode 0x1000000042c [2,head] /dc-dir/dc-file_567 auth v5072 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.418880+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94571600] 2023-10-03T19:21:16.865 INFO:teuthology.orchestra.run.smithi045.stdout: -9873> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5072 now clean [dentry #0x1/dc-dir/dc-file_567 [2,head] auth (dversion lock) v=5072 ino=0x1000000042c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9456ea00] 2023-10-03T19:21:16.865 INFO:teuthology.orchestra.run.smithi045.stdout: -9872> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_567) mark_clean [dentry #0x1/dc-dir/dc-file_567 [2,head] auth (dversion lock) v=5072 ino=0x1000000042c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9456ea00] 2023-10-03T19:21:16.865 INFO:teuthology.orchestra.run.smithi045.stdout: -9871> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5074 now clean [inode 0x1000000042d [2,head] /dc-dir/dc-file_568 auth v5074 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.430973+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94571b80] 2023-10-03T19:21:16.865 INFO:teuthology.orchestra.run.smithi045.stdout: -9870> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000042d) mark_clean [inode 0x1000000042d [2,head] /dc-dir/dc-file_568 auth v5074 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.430973+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94571b80] 2023-10-03T19:21:16.865 INFO:teuthology.orchestra.run.smithi045.stdout: -9869> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5074 now clean [dentry #0x1/dc-dir/dc-file_568 [2,head] auth (dversion lock) v=5074 ino=0x1000000042d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9456ec80] 2023-10-03T19:21:16.865 INFO:teuthology.orchestra.run.smithi045.stdout: -9868> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_568) mark_clean [dentry #0x1/dc-dir/dc-file_568 [2,head] auth (dversion lock) v=5074 ino=0x1000000042d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9456ec80] 2023-10-03T19:21:16.865 INFO:teuthology.orchestra.run.smithi045.stdout: -9867> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5076 now clean [inode 0x1000000042e [2,head] /dc-dir/dc-file_569 auth v5076 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.443410+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94572100] 2023-10-03T19:21:16.865 INFO:teuthology.orchestra.run.smithi045.stdout: -9866> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000042e) mark_clean [inode 0x1000000042e [2,head] /dc-dir/dc-file_569 auth v5076 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.443410+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94572100] 2023-10-03T19:21:16.865 INFO:teuthology.orchestra.run.smithi045.stdout: -9865> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5076 now clean [dentry #0x1/dc-dir/dc-file_569 [2,head] auth (dversion lock) v=5076 ino=0x1000000042e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9456ef00] 2023-10-03T19:21:16.866 INFO:teuthology.orchestra.run.smithi045.stdout: -9864> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_569) mark_clean [dentry #0x1/dc-dir/dc-file_569 [2,head] auth (dversion lock) v=5076 ino=0x1000000042e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9456ef00] 2023-10-03T19:21:16.866 INFO:teuthology.orchestra.run.smithi045.stdout: -9863> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5078 now clean [inode 0x1000000042f [2,head] /dc-dir/dc-file_570 auth v5078 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.455272+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94572680] 2023-10-03T19:21:16.866 INFO:teuthology.orchestra.run.smithi045.stdout: -9862> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000042f) mark_clean [inode 0x1000000042f [2,head] /dc-dir/dc-file_570 auth v5078 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.455272+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94572680] 2023-10-03T19:21:16.866 INFO:teuthology.orchestra.run.smithi045.stdout: -9861> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5078 now clean [dentry #0x1/dc-dir/dc-file_570 [2,head] auth (dversion lock) v=5078 ino=0x1000000042f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9456f180] 2023-10-03T19:21:16.866 INFO:teuthology.orchestra.run.smithi045.stdout: -9860> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_570) mark_clean [dentry #0x1/dc-dir/dc-file_570 [2,head] auth (dversion lock) v=5078 ino=0x1000000042f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9456f180] 2023-10-03T19:21:16.866 INFO:teuthology.orchestra.run.smithi045.stdout: -9859> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5080 now clean [inode 0x10000000430 [2,head] /dc-dir/dc-file_571 auth v5080 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.467900+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94572c00] 2023-10-03T19:21:16.866 INFO:teuthology.orchestra.run.smithi045.stdout: -9858> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000430) mark_clean [inode 0x10000000430 [2,head] /dc-dir/dc-file_571 auth v5080 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.467900+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94572c00] 2023-10-03T19:21:16.866 INFO:teuthology.orchestra.run.smithi045.stdout: -9857> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5080 now clean [dentry #0x1/dc-dir/dc-file_571 [2,head] auth (dversion lock) v=5080 ino=0x10000000430 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9456f400] 2023-10-03T19:21:16.866 INFO:teuthology.orchestra.run.smithi045.stdout: -9856> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_571) mark_clean [dentry #0x1/dc-dir/dc-file_571 [2,head] auth (dversion lock) v=5080 ino=0x10000000430 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9456f400] 2023-10-03T19:21:16.866 INFO:teuthology.orchestra.run.smithi045.stdout: -9855> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5082 now clean [inode 0x10000000431 [2,head] /dc-dir/dc-file_572 auth v5082 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.480014+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94573180] 2023-10-03T19:21:16.866 INFO:teuthology.orchestra.run.smithi045.stdout: -9854> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000431) mark_clean [inode 0x10000000431 [2,head] /dc-dir/dc-file_572 auth v5082 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.480014+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94573180] 2023-10-03T19:21:16.867 INFO:teuthology.orchestra.run.smithi045.stdout: -9853> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5082 now clean [dentry #0x1/dc-dir/dc-file_572 [2,head] auth (dversion lock) v=5082 ino=0x10000000431 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9456f680] 2023-10-03T19:21:16.867 INFO:teuthology.orchestra.run.smithi045.stdout: -9852> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_572) mark_clean [dentry #0x1/dc-dir/dc-file_572 [2,head] auth (dversion lock) v=5082 ino=0x10000000431 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9456f680] 2023-10-03T19:21:16.867 INFO:teuthology.orchestra.run.smithi045.stdout: -9851> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5084 now clean [inode 0x10000000432 [2,head] /dc-dir/dc-file_573 auth v5084 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.491933+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94573700] 2023-10-03T19:21:16.867 INFO:teuthology.orchestra.run.smithi045.stdout: -9850> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000432) mark_clean [inode 0x10000000432 [2,head] /dc-dir/dc-file_573 auth v5084 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.491933+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94573700] 2023-10-03T19:21:16.867 INFO:teuthology.orchestra.run.smithi045.stdout: -9849> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5084 now clean [dentry #0x1/dc-dir/dc-file_573 [2,head] auth (dversion lock) v=5084 ino=0x10000000432 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9456f900] 2023-10-03T19:21:16.867 INFO:teuthology.orchestra.run.smithi045.stdout: -9848> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_573) mark_clean [dentry #0x1/dc-dir/dc-file_573 [2,head] auth (dversion lock) v=5084 ino=0x10000000432 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9456f900] 2023-10-03T19:21:16.867 INFO:teuthology.orchestra.run.smithi045.stdout: -9847> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5086 now clean [inode 0x10000000433 [2,head] /dc-dir/dc-file_574 auth v5086 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.504108+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94598000] 2023-10-03T19:21:16.867 INFO:teuthology.orchestra.run.smithi045.stdout: -9846> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000433) mark_clean [inode 0x10000000433 [2,head] /dc-dir/dc-file_574 auth v5086 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.504108+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94598000] 2023-10-03T19:21:16.867 INFO:teuthology.orchestra.run.smithi045.stdout: -9845> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5086 now clean [dentry #0x1/dc-dir/dc-file_574 [2,head] auth (dversion lock) v=5086 ino=0x10000000433 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9456fb80] 2023-10-03T19:21:16.920 INFO:teuthology.orchestra.run.smithi045.stdout: -9844> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_574) mark_clean [dentry #0x1/dc-dir/dc-file_574 [2,head] auth (dversion lock) v=5086 ino=0x10000000433 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9456fb80] 2023-10-03T19:21:16.920 INFO:teuthology.orchestra.run.smithi045.stdout: -9843> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5088 now clean [inode 0x10000000434 [2,head] /dc-dir/dc-file_575 auth v5088 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.515753+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94598580] 2023-10-03T19:21:16.920 INFO:teuthology.orchestra.run.smithi045.stdout: -9842> 2023-10-03T19:18:09.825+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 85 ==== osd_op_reply(1804 100000004d5.00000000 [create,setxattr (99),setxattr (30)] v74'23 uv23 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:16.920 INFO:teuthology.orchestra.run.smithi045.stdout: -9841> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000434) mark_clean [inode 0x10000000434 [2,head] /dc-dir/dc-file_575 auth v5088 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.515753+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94598580] 2023-10-03T19:21:16.920 INFO:teuthology.orchestra.run.smithi045.stdout: -9840> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5088 now clean [dentry #0x1/dc-dir/dc-file_575 [2,head] auth (dversion lock) v=5088 ino=0x10000000434 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9459c000] 2023-10-03T19:21:16.920 INFO:teuthology.orchestra.run.smithi045.stdout: -9839> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_575) mark_clean [dentry #0x1/dc-dir/dc-file_575 [2,head] auth (dversion lock) v=5088 ino=0x10000000434 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9459c000] 2023-10-03T19:21:16.920 INFO:teuthology.orchestra.run.smithi045.stdout: -9838> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5090 now clean [inode 0x10000000435 [2,head] /dc-dir/dc-file_576 auth v5090 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.527513+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94598b00] 2023-10-03T19:21:16.920 INFO:teuthology.orchestra.run.smithi045.stdout: -9837> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000435) mark_clean [inode 0x10000000435 [2,head] /dc-dir/dc-file_576 auth v5090 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.527513+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94598b00] 2023-10-03T19:21:16.921 INFO:teuthology.orchestra.run.smithi045.stdout: -9836> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5090 now clean [dentry #0x1/dc-dir/dc-file_576 [2,head] auth (dversion lock) v=5090 ino=0x10000000435 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9459c280] 2023-10-03T19:21:16.921 INFO:teuthology.orchestra.run.smithi045.stdout: -9835> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_576) mark_clean [dentry #0x1/dc-dir/dc-file_576 [2,head] auth (dversion lock) v=5090 ino=0x10000000435 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9459c280] 2023-10-03T19:21:16.921 INFO:teuthology.orchestra.run.smithi045.stdout: -9834> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5092 now clean [inode 0x10000000436 [2,head] /dc-dir/dc-file_577 auth v5092 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.539961+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94599080] 2023-10-03T19:21:16.921 INFO:teuthology.orchestra.run.smithi045.stdout: -9833> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000436) mark_clean [inode 0x10000000436 [2,head] /dc-dir/dc-file_577 auth v5092 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.539961+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94599080] 2023-10-03T19:21:16.921 INFO:teuthology.orchestra.run.smithi045.stdout: -9832> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5092 now clean [dentry #0x1/dc-dir/dc-file_577 [2,head] auth (dversion lock) v=5092 ino=0x10000000436 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9459c500] 2023-10-03T19:21:16.921 INFO:teuthology.orchestra.run.smithi045.stdout: -9831> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_577) mark_clean [dentry #0x1/dc-dir/dc-file_577 [2,head] auth (dversion lock) v=5092 ino=0x10000000436 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9459c500] 2023-10-03T19:21:16.921 INFO:teuthology.orchestra.run.smithi045.stdout: -9830> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5094 now clean [inode 0x10000000437 [2,head] /dc-dir/dc-file_578 auth v5094 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.551697+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94599600] 2023-10-03T19:21:16.921 INFO:teuthology.orchestra.run.smithi045.stdout: -9829> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000437) mark_clean [inode 0x10000000437 [2,head] /dc-dir/dc-file_578 auth v5094 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.551697+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94599600] 2023-10-03T19:21:16.921 INFO:teuthology.orchestra.run.smithi045.stdout: -9828> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5094 now clean [dentry #0x1/dc-dir/dc-file_578 [2,head] auth (dversion lock) v=5094 ino=0x10000000437 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9459c780] 2023-10-03T19:21:16.921 INFO:teuthology.orchestra.run.smithi045.stdout: -9827> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_578) mark_clean [dentry #0x1/dc-dir/dc-file_578 [2,head] auth (dversion lock) v=5094 ino=0x10000000437 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9459c780] 2023-10-03T19:21:16.921 INFO:teuthology.orchestra.run.smithi045.stdout: -9826> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5096 now clean [inode 0x10000000438 [2,head] /dc-dir/dc-file_579 auth v5096 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.563962+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94599b80] 2023-10-03T19:21:16.922 INFO:teuthology.orchestra.run.smithi045.stdout: -9825> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000438) mark_clean [inode 0x10000000438 [2,head] /dc-dir/dc-file_579 auth v5096 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.563962+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94599b80] 2023-10-03T19:21:16.922 INFO:teuthology.orchestra.run.smithi045.stdout: -9824> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5096 now clean [dentry #0x1/dc-dir/dc-file_579 [2,head] auth (dversion lock) v=5096 ino=0x10000000438 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9459ca00] 2023-10-03T19:21:16.922 INFO:teuthology.orchestra.run.smithi045.stdout: -9823> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_579) mark_clean [dentry #0x1/dc-dir/dc-file_579 [2,head] auth (dversion lock) v=5096 ino=0x10000000438 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9459ca00] 2023-10-03T19:21:16.922 INFO:teuthology.orchestra.run.smithi045.stdout: -9822> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5098 now clean [inode 0x10000000439 [2,head] /dc-dir/dc-file_580 auth v5098 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.576055+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9459a100] 2023-10-03T19:21:16.922 INFO:teuthology.orchestra.run.smithi045.stdout: -9821> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000439) mark_clean [inode 0x10000000439 [2,head] /dc-dir/dc-file_580 auth v5098 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.576055+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9459a100] 2023-10-03T19:21:16.922 INFO:teuthology.orchestra.run.smithi045.stdout: -9820> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5098 now clean [dentry #0x1/dc-dir/dc-file_580 [2,head] auth (dversion lock) v=5098 ino=0x10000000439 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9459cc80] 2023-10-03T19:21:16.922 INFO:teuthology.orchestra.run.smithi045.stdout: -9819> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_580) mark_clean [dentry #0x1/dc-dir/dc-file_580 [2,head] auth (dversion lock) v=5098 ino=0x10000000439 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9459cc80] 2023-10-03T19:21:16.922 INFO:teuthology.orchestra.run.smithi045.stdout: -9818> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5100 now clean [inode 0x1000000043a [2,head] /dc-dir/dc-file_581 auth v5100 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.588141+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9459a680] 2023-10-03T19:21:16.922 INFO:teuthology.orchestra.run.smithi045.stdout: -9817> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000043a) mark_clean [inode 0x1000000043a [2,head] /dc-dir/dc-file_581 auth v5100 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.588141+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9459a680] 2023-10-03T19:21:16.922 INFO:teuthology.orchestra.run.smithi045.stdout: -9816> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5100 now clean [dentry #0x1/dc-dir/dc-file_581 [2,head] auth (dversion lock) v=5100 ino=0x1000000043a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9459cf00] 2023-10-03T19:21:16.923 INFO:teuthology.orchestra.run.smithi045.stdout: -9815> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_581) mark_clean [dentry #0x1/dc-dir/dc-file_581 [2,head] auth (dversion lock) v=5100 ino=0x1000000043a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9459cf00] 2023-10-03T19:21:16.923 INFO:teuthology.orchestra.run.smithi045.stdout: -9814> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5102 now clean [inode 0x1000000043b [2,head] /dc-dir/dc-file_582 auth v5102 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.600484+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9459ac00] 2023-10-03T19:21:16.923 INFO:teuthology.orchestra.run.smithi045.stdout: -9813> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000043b) mark_clean [inode 0x1000000043b [2,head] /dc-dir/dc-file_582 auth v5102 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.600484+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9459ac00] 2023-10-03T19:21:16.923 INFO:teuthology.orchestra.run.smithi045.stdout: -9812> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5102 now clean [dentry #0x1/dc-dir/dc-file_582 [2,head] auth (dversion lock) v=5102 ino=0x1000000043b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9459d180] 2023-10-03T19:21:16.923 INFO:teuthology.orchestra.run.smithi045.stdout: -9811> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_582) mark_clean [dentry #0x1/dc-dir/dc-file_582 [2,head] auth (dversion lock) v=5102 ino=0x1000000043b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9459d180] 2023-10-03T19:21:16.923 INFO:teuthology.orchestra.run.smithi045.stdout: -9810> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5104 now clean [inode 0x1000000043c [2,head] /dc-dir/dc-file_583 auth v5104 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.612426+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9459b180] 2023-10-03T19:21:16.923 INFO:teuthology.orchestra.run.smithi045.stdout: -9809> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000043c) mark_clean [inode 0x1000000043c [2,head] /dc-dir/dc-file_583 auth v5104 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.612426+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9459b180] 2023-10-03T19:21:16.923 INFO:teuthology.orchestra.run.smithi045.stdout: -9808> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5104 now clean [dentry #0x1/dc-dir/dc-file_583 [2,head] auth (dversion lock) v=5104 ino=0x1000000043c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9459d400] 2023-10-03T19:21:16.923 INFO:teuthology.orchestra.run.smithi045.stdout: -9807> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_583) mark_clean [dentry #0x1/dc-dir/dc-file_583 [2,head] auth (dversion lock) v=5104 ino=0x1000000043c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9459d400] 2023-10-03T19:21:16.923 INFO:teuthology.orchestra.run.smithi045.stdout: -9806> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5106 now clean [inode 0x1000000043d [2,head] /dc-dir/dc-file_584 auth v5106 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.624057+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9459b700] 2023-10-03T19:21:16.923 INFO:teuthology.orchestra.run.smithi045.stdout: -9805> 2023-10-03T19:18:09.825+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 86 ==== osd_op_reply(1824 100000004e9.00000000 [create,setxattr (99),setxattr (30)] v74'24 uv24 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:16.924 INFO:teuthology.orchestra.run.smithi045.stdout: -9804> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000043d) mark_clean [inode 0x1000000043d [2,head] /dc-dir/dc-file_584 auth v5106 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.624057+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9459b700] 2023-10-03T19:21:16.924 INFO:teuthology.orchestra.run.smithi045.stdout: -9803> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5106 now clean [dentry #0x1/dc-dir/dc-file_584 [2,head] auth (dversion lock) v=5106 ino=0x1000000043d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9459d680] 2023-10-03T19:21:16.924 INFO:teuthology.orchestra.run.smithi045.stdout: -9802> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_584) mark_clean [dentry #0x1/dc-dir/dc-file_584 [2,head] auth (dversion lock) v=5106 ino=0x1000000043d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9459d680] 2023-10-03T19:21:16.924 INFO:teuthology.orchestra.run.smithi045.stdout: -9801> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5108 now clean [inode 0x1000000043e [2,head] /dc-dir/dc-file_585 auth v5108 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.636002+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945a0000] 2023-10-03T19:21:16.924 INFO:teuthology.orchestra.run.smithi045.stdout: -9800> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000043e) mark_clean [inode 0x1000000043e [2,head] /dc-dir/dc-file_585 auth v5108 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.636002+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945a0000] 2023-10-03T19:21:16.924 INFO:teuthology.orchestra.run.smithi045.stdout: -9799> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5108 now clean [dentry #0x1/dc-dir/dc-file_585 [2,head] auth (dversion lock) v=5108 ino=0x1000000043e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9459d900] 2023-10-03T19:21:16.924 INFO:teuthology.orchestra.run.smithi045.stdout: -9798> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_585) mark_clean [dentry #0x1/dc-dir/dc-file_585 [2,head] auth (dversion lock) v=5108 ino=0x1000000043e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9459d900] 2023-10-03T19:21:16.924 INFO:teuthology.orchestra.run.smithi045.stdout: -9797> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5110 now clean [inode 0x1000000043f [2,head] /dc-dir/dc-file_586 auth v5110 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.647426+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945a0580] 2023-10-03T19:21:16.924 INFO:teuthology.orchestra.run.smithi045.stdout: -9796> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000043f) mark_clean [inode 0x1000000043f [2,head] /dc-dir/dc-file_586 auth v5110 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.647426+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945a0580] 2023-10-03T19:21:16.924 INFO:teuthology.orchestra.run.smithi045.stdout: -9795> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5110 now clean [dentry #0x1/dc-dir/dc-file_586 [2,head] auth (dversion lock) v=5110 ino=0x1000000043f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9459db80] 2023-10-03T19:21:16.925 INFO:teuthology.orchestra.run.smithi045.stdout: -9794> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_586) mark_clean [dentry #0x1/dc-dir/dc-file_586 [2,head] auth (dversion lock) v=5110 ino=0x1000000043f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9459db80] 2023-10-03T19:21:16.925 INFO:teuthology.orchestra.run.smithi045.stdout: -9793> 2023-10-03T19:18:09.825+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5112 now clean [inode 0x10000000440 [2,head] /dc-dir/dc-file_587 auth v5112 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.660109+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945a0b00] 2023-10-03T19:21:17.014 INFO:teuthology.orchestra.run.smithi045.stdout: -9792> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000440) mark_clean [inode 0x10000000440 [2,head] /dc-dir/dc-file_587 auth v5112 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.660109+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945a0b00] 2023-10-03T19:21:17.014 INFO:teuthology.orchestra.run.smithi045.stdout: -9791> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 968 ==== osd_op_reply(1259 100000002b4.00000000 [create,setxattr (99),setxattr (30)] v74'22 uv22 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:17.014 INFO:teuthology.orchestra.run.smithi045.stdout: -9790> 2023-10-03T19:18:09.829+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 274 ==== osd_op_reply(1525 100000003be.00000000 [create,setxattr (99),setxattr (30)] v74'23 uv23 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.014 INFO:teuthology.orchestra.run.smithi045.stdout: -9789> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 969 ==== osd_op_reply(1792 100000004c9.00000000 [create,setxattr (99),setxattr (30)] v74'15 uv15 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:17.014 INFO:teuthology.orchestra.run.smithi045.stdout: -9788> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5112 now clean [dentry #0x1/dc-dir/dc-file_587 [2,head] auth (dversion lock) v=5112 ino=0x10000000440 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945a4000] 2023-10-03T19:21:17.014 INFO:teuthology.orchestra.run.smithi045.stdout: -9787> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_587) mark_clean [dentry #0x1/dc-dir/dc-file_587 [2,head] auth (dversion lock) v=5112 ino=0x10000000440 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945a4000] 2023-10-03T19:21:17.014 INFO:teuthology.orchestra.run.smithi045.stdout: -9786> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5114 now clean [inode 0x10000000441 [2,head] /dc-dir/dc-file_588 auth v5114 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.673355+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945a1080] 2023-10-03T19:21:17.015 INFO:teuthology.orchestra.run.smithi045.stdout: -9785> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 970 ==== osd_op_reply(1305 100000002e2.00000000 [create,setxattr (99),setxattr (30)] v74'23 uv23 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:17.015 INFO:teuthology.orchestra.run.smithi045.stdout: -9784> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000441) mark_clean [inode 0x10000000441 [2,head] /dc-dir/dc-file_588 auth v5114 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.673355+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945a1080] 2023-10-03T19:21:17.015 INFO:teuthology.orchestra.run.smithi045.stdout: -9783> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5114 now clean [dentry #0x1/dc-dir/dc-file_588 [2,head] auth (dversion lock) v=5114 ino=0x10000000441 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945a4280] 2023-10-03T19:21:17.015 INFO:teuthology.orchestra.run.smithi045.stdout: -9782> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 971 ==== osd_op_reply(1313 100000002ea.00000000 [create,setxattr (99),setxattr (30)] v74'24 uv24 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:17.015 INFO:teuthology.orchestra.run.smithi045.stdout: -9781> 2023-10-03T19:18:09.829+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 275 ==== osd_op_reply(1583 100000003f8.00000000 [create,setxattr (99),setxattr (30)] v74'24 uv24 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.015 INFO:teuthology.orchestra.run.smithi045.stdout: -9780> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 972 ==== osd_op_reply(1894 1000000052f.00000000 [create,setxattr (99),setxattr (30)] v74'16 uv16 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:17.015 INFO:teuthology.orchestra.run.smithi045.stdout: -9779> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_588) mark_clean [dentry #0x1/dc-dir/dc-file_588 [2,head] auth (dversion lock) v=5114 ino=0x10000000441 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945a4280] 2023-10-03T19:21:17.015 INFO:teuthology.orchestra.run.smithi045.stdout: -9778> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5116 now clean [inode 0x10000000442 [2,head] /dc-dir/dc-file_589 auth v5116 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.685917+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945a1600] 2023-10-03T19:21:17.015 INFO:teuthology.orchestra.run.smithi045.stdout: -9777> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000442) mark_clean [inode 0x10000000442 [2,head] /dc-dir/dc-file_589 auth v5116 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.685917+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945a1600] 2023-10-03T19:21:17.015 INFO:teuthology.orchestra.run.smithi045.stdout: -9776> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5116 now clean [dentry #0x1/dc-dir/dc-file_589 [2,head] auth (dversion lock) v=5116 ino=0x10000000442 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945a4500] 2023-10-03T19:21:17.015 INFO:teuthology.orchestra.run.smithi045.stdout: -9775> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_589) mark_clean [dentry #0x1/dc-dir/dc-file_589 [2,head] auth (dversion lock) v=5116 ino=0x10000000442 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945a4500] 2023-10-03T19:21:17.016 INFO:teuthology.orchestra.run.smithi045.stdout: -9774> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 973 ==== osd_op_reply(1329 100000002fa.00000000 [create,setxattr (99),setxattr (30)] v74'25 uv25 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:17.016 INFO:teuthology.orchestra.run.smithi045.stdout: -9773> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5118 now clean [inode 0x10000000443 [2,head] /dc-dir/dc-file_590 auth v5118 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.699540+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945a1b80] 2023-10-03T19:21:17.016 INFO:teuthology.orchestra.run.smithi045.stdout: -9772> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000443) mark_clean [inode 0x10000000443 [2,head] /dc-dir/dc-file_590 auth v5118 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.699540+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945a1b80] 2023-10-03T19:21:17.016 INFO:teuthology.orchestra.run.smithi045.stdout: -9771> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5118 now clean [dentry #0x1/dc-dir/dc-file_590 [2,head] auth (dversion lock) v=5118 ino=0x10000000443 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945a4780] 2023-10-03T19:21:17.016 INFO:teuthology.orchestra.run.smithi045.stdout: -9770> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_590) mark_clean [dentry #0x1/dc-dir/dc-file_590 [2,head] auth (dversion lock) v=5118 ino=0x10000000443 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945a4780] 2023-10-03T19:21:17.016 INFO:teuthology.orchestra.run.smithi045.stdout: -9769> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5120 now clean [inode 0x10000000444 [2,head] /dc-dir/dc-file_591 auth v5120 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.710950+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945a2100] 2023-10-03T19:21:17.016 INFO:teuthology.orchestra.run.smithi045.stdout: -9768> 2023-10-03T19:18:09.829+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 276 ==== osd_op_reply(1610 10000000413.00000000 [create,setxattr (99),setxattr (30)] v74'25 uv25 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.016 INFO:teuthology.orchestra.run.smithi045.stdout: -9767> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000444) mark_clean [inode 0x10000000444 [2,head] /dc-dir/dc-file_591 auth v5120 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.710950+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945a2100] 2023-10-03T19:21:17.016 INFO:teuthology.orchestra.run.smithi045.stdout: -9766> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5120 now clean [dentry #0x1/dc-dir/dc-file_591 [2,head] auth (dversion lock) v=5120 ino=0x10000000444 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945a4a00] 2023-10-03T19:21:17.016 INFO:teuthology.orchestra.run.smithi045.stdout: -9765> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_591) mark_clean [dentry #0x1/dc-dir/dc-file_591 [2,head] auth (dversion lock) v=5120 ino=0x10000000444 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945a4a00] 2023-10-03T19:21:17.016 INFO:teuthology.orchestra.run.smithi045.stdout: -9764> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5122 now clean [inode 0x10000000445 [2,head] /dc-dir/dc-file_592 auth v5122 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.723542+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945a2680] 2023-10-03T19:21:17.017 INFO:teuthology.orchestra.run.smithi045.stdout: -9763> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000445) mark_clean [inode 0x10000000445 [2,head] /dc-dir/dc-file_592 auth v5122 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.723542+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945a2680] 2023-10-03T19:21:17.017 INFO:teuthology.orchestra.run.smithi045.stdout: -9762> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5122 now clean [dentry #0x1/dc-dir/dc-file_592 [2,head] auth (dversion lock) v=5122 ino=0x10000000445 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945a4c80] 2023-10-03T19:21:17.017 INFO:teuthology.orchestra.run.smithi045.stdout: -9761> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_592) mark_clean [dentry #0x1/dc-dir/dc-file_592 [2,head] auth (dversion lock) v=5122 ino=0x10000000445 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945a4c80] 2023-10-03T19:21:17.017 INFO:teuthology.orchestra.run.smithi045.stdout: -9760> 2023-10-03T19:18:09.829+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 277 ==== osd_op_reply(1699 1000000046c.00000000 [create,setxattr (99),setxattr (30)] v74'26 uv26 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.017 INFO:teuthology.orchestra.run.smithi045.stdout: -9759> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5124 now clean [inode 0x10000000446 [2,head] /dc-dir/dc-file_593 auth v5124 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.735550+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945a2c00] 2023-10-03T19:21:17.017 INFO:teuthology.orchestra.run.smithi045.stdout: -9758> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000446) mark_clean [inode 0x10000000446 [2,head] /dc-dir/dc-file_593 auth v5124 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.735550+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945a2c00] 2023-10-03T19:21:17.017 INFO:teuthology.orchestra.run.smithi045.stdout: -9757> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5124 now clean [dentry #0x1/dc-dir/dc-file_593 [2,head] auth (dversion lock) v=5124 ino=0x10000000446 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945a4f00] 2023-10-03T19:21:17.017 INFO:teuthology.orchestra.run.smithi045.stdout: -9756> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_593) mark_clean [dentry #0x1/dc-dir/dc-file_593 [2,head] auth (dversion lock) v=5124 ino=0x10000000446 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945a4f00] 2023-10-03T19:21:17.017 INFO:teuthology.orchestra.run.smithi045.stdout: -9755> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5126 now clean [inode 0x10000000447 [2,head] /dc-dir/dc-file_594 auth v5126 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.746996+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945a3180] 2023-10-03T19:21:17.017 INFO:teuthology.orchestra.run.smithi045.stdout: -9754> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000447) mark_clean [inode 0x10000000447 [2,head] /dc-dir/dc-file_594 auth v5126 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.746996+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945a3180] 2023-10-03T19:21:17.017 INFO:teuthology.orchestra.run.smithi045.stdout: -9753> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5126 now clean [dentry #0x1/dc-dir/dc-file_594 [2,head] auth (dversion lock) v=5126 ino=0x10000000447 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945a5180] 2023-10-03T19:21:17.018 INFO:teuthology.orchestra.run.smithi045.stdout: -9752> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_594) mark_clean [dentry #0x1/dc-dir/dc-file_594 [2,head] auth (dversion lock) v=5126 ino=0x10000000447 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945a5180] 2023-10-03T19:21:17.018 INFO:teuthology.orchestra.run.smithi045.stdout: -9751> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5128 now clean [inode 0x10000000448 [2,head] /dc-dir/dc-file_595 auth v5128 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.758690+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945a3700] 2023-10-03T19:21:17.018 INFO:teuthology.orchestra.run.smithi045.stdout: -9750> 2023-10-03T19:18:09.829+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 278 ==== osd_op_reply(1746 1000000049b.00000000 [create,setxattr (99),setxattr (30)] v74'27 uv27 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.018 INFO:teuthology.orchestra.run.smithi045.stdout: -9749> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000448) mark_clean [inode 0x10000000448 [2,head] /dc-dir/dc-file_595 auth v5128 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.758690+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945a3700] 2023-10-03T19:21:17.018 INFO:teuthology.orchestra.run.smithi045.stdout: -9748> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5128 now clean [dentry #0x1/dc-dir/dc-file_595 [2,head] auth (dversion lock) v=5128 ino=0x10000000448 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945a5400] 2023-10-03T19:21:17.018 INFO:teuthology.orchestra.run.smithi045.stdout: -9747> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_595) mark_clean [dentry #0x1/dc-dir/dc-file_595 [2,head] auth (dversion lock) v=5128 ino=0x10000000448 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945a5400] 2023-10-03T19:21:17.018 INFO:teuthology.orchestra.run.smithi045.stdout: -9746> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5130 now clean [inode 0x10000000449 [2,head] /dc-dir/dc-file_596 auth v5130 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.770413+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945aa000] 2023-10-03T19:21:17.018 INFO:teuthology.orchestra.run.smithi045.stdout: -9745> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000449) mark_clean [inode 0x10000000449 [2,head] /dc-dir/dc-file_596 auth v5130 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.770413+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945aa000] 2023-10-03T19:21:17.018 INFO:teuthology.orchestra.run.smithi045.stdout: -9744> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5130 now clean [dentry #0x1/dc-dir/dc-file_596 [2,head] auth (dversion lock) v=5130 ino=0x10000000449 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945a5680] 2023-10-03T19:21:17.018 INFO:teuthology.orchestra.run.smithi045.stdout: -9743> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_596) mark_clean [dentry #0x1/dc-dir/dc-file_596 [2,head] auth (dversion lock) v=5130 ino=0x10000000449 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945a5680] 2023-10-03T19:21:17.019 INFO:teuthology.orchestra.run.smithi045.stdout: -9742> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5132 now clean [inode 0x1000000044a [2,head] /dc-dir/dc-file_597 auth v5132 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.782255+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945aa580] 2023-10-03T19:21:17.019 INFO:teuthology.orchestra.run.smithi045.stdout: -9741> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000044a) mark_clean [inode 0x1000000044a [2,head] /dc-dir/dc-file_597 auth v5132 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.782255+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945aa580] 2023-10-03T19:21:17.019 INFO:teuthology.orchestra.run.smithi045.stdout: -9740> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5132 now clean [dentry #0x1/dc-dir/dc-file_597 [2,head] auth (dversion lock) v=5132 ino=0x1000000044a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945a5900] 2023-10-03T19:21:17.019 INFO:teuthology.orchestra.run.smithi045.stdout: -9739> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_597) mark_clean [dentry #0x1/dc-dir/dc-file_597 [2,head] auth (dversion lock) v=5132 ino=0x1000000044a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945a5900] 2023-10-03T19:21:17.019 INFO:teuthology.orchestra.run.smithi045.stdout: -9738> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5134 now clean [inode 0x1000000044b [2,head] /dc-dir/dc-file_598 auth v5134 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.796025+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945aab00] 2023-10-03T19:21:17.019 INFO:teuthology.orchestra.run.smithi045.stdout: -9737> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000044b) mark_clean [inode 0x1000000044b [2,head] /dc-dir/dc-file_598 auth v5134 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.796025+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945aab00] 2023-10-03T19:21:17.019 INFO:teuthology.orchestra.run.smithi045.stdout: -9736> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5134 now clean [dentry #0x1/dc-dir/dc-file_598 [2,head] auth (dversion lock) v=5134 ino=0x1000000044b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945a5b80] 2023-10-03T19:21:17.019 INFO:teuthology.orchestra.run.smithi045.stdout: -9735> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_598) mark_clean [dentry #0x1/dc-dir/dc-file_598 [2,head] auth (dversion lock) v=5134 ino=0x1000000044b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945a5b80] 2023-10-03T19:21:17.019 INFO:teuthology.orchestra.run.smithi045.stdout: -9734> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5136 now clean [inode 0x1000000044c [2,head] /dc-dir/dc-file_599 auth v5136 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.809169+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945ab080] 2023-10-03T19:21:17.019 INFO:teuthology.orchestra.run.smithi045.stdout: -9733> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000044c) mark_clean [inode 0x1000000044c [2,head] /dc-dir/dc-file_599 auth v5136 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.809169+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945ab080] 2023-10-03T19:21:17.019 INFO:teuthology.orchestra.run.smithi045.stdout: -9732> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5136 now clean [dentry #0x1/dc-dir/dc-file_599 [2,head] auth (dversion lock) v=5136 ino=0x1000000044c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945b0000] 2023-10-03T19:21:17.020 INFO:teuthology.orchestra.run.smithi045.stdout: -9731> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_599) mark_clean [dentry #0x1/dc-dir/dc-file_599 [2,head] auth (dversion lock) v=5136 ino=0x1000000044c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945b0000] 2023-10-03T19:21:17.020 INFO:teuthology.orchestra.run.smithi045.stdout: -9730> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5138 now clean [inode 0x1000000044d [2,head] /dc-dir/dc-file_600 auth v5138 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.820937+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945ab600] 2023-10-03T19:21:17.020 INFO:teuthology.orchestra.run.smithi045.stdout: -9729> 2023-10-03T19:18:09.829+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 279 ==== osd_op_reply(1749 1000000049e.00000000 [create,setxattr (99),setxattr (30)] v74'28 uv28 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.020 INFO:teuthology.orchestra.run.smithi045.stdout: -9728> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000044d) mark_clean [inode 0x1000000044d [2,head] /dc-dir/dc-file_600 auth v5138 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.820937+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945ab600] 2023-10-03T19:21:17.020 INFO:teuthology.orchestra.run.smithi045.stdout: -9727> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5138 now clean [dentry #0x1/dc-dir/dc-file_600 [2,head] auth (dversion lock) v=5138 ino=0x1000000044d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945b0280] 2023-10-03T19:21:17.020 INFO:teuthology.orchestra.run.smithi045.stdout: -9726> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_600) mark_clean [dentry #0x1/dc-dir/dc-file_600 [2,head] auth (dversion lock) v=5138 ino=0x1000000044d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945b0280] 2023-10-03T19:21:17.020 INFO:teuthology.orchestra.run.smithi045.stdout: -9725> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5140 now clean [inode 0x1000000044e [2,head] /dc-dir/dc-file_601 auth v5140 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.832418+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945abb80] 2023-10-03T19:21:17.020 INFO:teuthology.orchestra.run.smithi045.stdout: -9724> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000044e) mark_clean [inode 0x1000000044e [2,head] /dc-dir/dc-file_601 auth v5140 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.832418+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945abb80] 2023-10-03T19:21:17.020 INFO:teuthology.orchestra.run.smithi045.stdout: -9723> 2023-10-03T19:18:09.829+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 118 ==== osd_op_reply(1905 1.00000000 [stat,omap-set-header,omap-set-vals] v74'6 uv6 ondisk = 0) v8 ==== 238+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:17.020 INFO:teuthology.orchestra.run.smithi045.stdout: -9722> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 974 ==== osd_op_reply(1405 10000000346.00000000 [create,setxattr (99),setxattr (30)] v74'26 uv26 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:17.066 INFO:teuthology.orchestra.run.smithi045.stdout: -9721> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 975 ==== osd_op_reply(1477 1000000038e.00000000 [create,setxattr (99),setxattr (30)] v74'27 uv27 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:17.066 INFO:teuthology.orchestra.run.smithi045.stdout: -9720> 2023-10-03T19:18:09.829+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 280 ==== osd_op_reply(1751 100000004a0.00000000 [create,setxattr (99),setxattr (30)] v74'29 uv29 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.066 INFO:teuthology.orchestra.run.smithi045.stdout: -9719> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5140 now clean [dentry #0x1/dc-dir/dc-file_601 [2,head] auth (dversion lock) v=5140 ino=0x1000000044e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945b0500] 2023-10-03T19:21:17.066 INFO:teuthology.orchestra.run.smithi045.stdout: -9718> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_601) mark_clean [dentry #0x1/dc-dir/dc-file_601 [2,head] auth (dversion lock) v=5140 ino=0x1000000044e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945b0500] 2023-10-03T19:21:17.067 INFO:teuthology.orchestra.run.smithi045.stdout: -9717> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5142 now clean [inode 0x1000000044f [2,head] /dc-dir/dc-file_602 auth v5142 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.843762+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945ac100] 2023-10-03T19:21:17.067 INFO:teuthology.orchestra.run.smithi045.stdout: -9716> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000044f) mark_clean [inode 0x1000000044f [2,head] /dc-dir/dc-file_602 auth v5142 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.843762+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945ac100] 2023-10-03T19:21:17.067 INFO:teuthology.orchestra.run.smithi045.stdout: -9715> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5142 now clean [dentry #0x1/dc-dir/dc-file_602 [2,head] auth (dversion lock) v=5142 ino=0x1000000044f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945b0780] 2023-10-03T19:21:17.067 INFO:teuthology.orchestra.run.smithi045.stdout: -9714> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_602) mark_clean [dentry #0x1/dc-dir/dc-file_602 [2,head] auth (dversion lock) v=5142 ino=0x1000000044f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945b0780] 2023-10-03T19:21:17.067 INFO:teuthology.orchestra.run.smithi045.stdout: -9713> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5144 now clean [inode 0x10000000450 [2,head] /dc-dir/dc-file_603 auth v5144 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.856130+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945ac680] 2023-10-03T19:21:17.067 INFO:teuthology.orchestra.run.smithi045.stdout: -9712> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000450) mark_clean [inode 0x10000000450 [2,head] /dc-dir/dc-file_603 auth v5144 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.856130+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945ac680] 2023-10-03T19:21:17.067 INFO:teuthology.orchestra.run.smithi045.stdout: -9711> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5144 now clean [dentry #0x1/dc-dir/dc-file_603 [2,head] auth (dversion lock) v=5144 ino=0x10000000450 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945b0a00] 2023-10-03T19:21:17.067 INFO:teuthology.orchestra.run.smithi045.stdout: -9710> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_603) mark_clean [dentry #0x1/dc-dir/dc-file_603 [2,head] auth (dversion lock) v=5144 ino=0x10000000450 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945b0a00] 2023-10-03T19:21:17.067 INFO:teuthology.orchestra.run.smithi045.stdout: -9709> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5146 now clean [inode 0x10000000451 [2,head] /dc-dir/dc-file_604 auth v5146 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.868781+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945acc00] 2023-10-03T19:21:17.067 INFO:teuthology.orchestra.run.smithi045.stdout: -9708> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000451) mark_clean [inode 0x10000000451 [2,head] /dc-dir/dc-file_604 auth v5146 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.868781+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945acc00] 2023-10-03T19:21:17.067 INFO:teuthology.orchestra.run.smithi045.stdout: -9707> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5146 now clean [dentry #0x1/dc-dir/dc-file_604 [2,head] auth (dversion lock) v=5146 ino=0x10000000451 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945b0c80] 2023-10-03T19:21:17.068 INFO:teuthology.orchestra.run.smithi045.stdout: -9706> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_604) mark_clean [dentry #0x1/dc-dir/dc-file_604 [2,head] auth (dversion lock) v=5146 ino=0x10000000451 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945b0c80] 2023-10-03T19:21:17.068 INFO:teuthology.orchestra.run.smithi045.stdout: -9705> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5148 now clean [inode 0x10000000452 [2,head] /dc-dir/dc-file_605 auth v5148 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.880171+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945ad180] 2023-10-03T19:21:17.068 INFO:teuthology.orchestra.run.smithi045.stdout: -9704> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000452) mark_clean [inode 0x10000000452 [2,head] /dc-dir/dc-file_605 auth v5148 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.880171+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945ad180] 2023-10-03T19:21:17.068 INFO:teuthology.orchestra.run.smithi045.stdout: -9703> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5148 now clean [dentry #0x1/dc-dir/dc-file_605 [2,head] auth (dversion lock) v=5148 ino=0x10000000452 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945b0f00] 2023-10-03T19:21:17.068 INFO:teuthology.orchestra.run.smithi045.stdout: -9702> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_605) mark_clean [dentry #0x1/dc-dir/dc-file_605 [2,head] auth (dversion lock) v=5148 ino=0x10000000452 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945b0f00] 2023-10-03T19:21:17.068 INFO:teuthology.orchestra.run.smithi045.stdout: -9701> 2023-10-03T19:18:09.829+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 281 ==== osd_op_reply(1863 10000000510.00000000 [create,setxattr (99),setxattr (30)] v74'30 uv30 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.068 INFO:teuthology.orchestra.run.smithi045.stdout: -9700> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5150 now clean [inode 0x10000000453 [2,head] /dc-dir/dc-file_606 auth v5150 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.892822+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945ad700] 2023-10-03T19:21:17.068 INFO:teuthology.orchestra.run.smithi045.stdout: -9699> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000453) mark_clean [inode 0x10000000453 [2,head] /dc-dir/dc-file_606 auth v5150 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.892822+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945ad700] 2023-10-03T19:21:17.068 INFO:teuthology.orchestra.run.smithi045.stdout: -9698> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5150 now clean [dentry #0x1/dc-dir/dc-file_606 [2,head] auth (dversion lock) v=5150 ino=0x10000000453 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945b1180] 2023-10-03T19:21:17.068 INFO:teuthology.orchestra.run.smithi045.stdout: -9697> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_606) mark_clean [dentry #0x1/dc-dir/dc-file_606 [2,head] auth (dversion lock) v=5150 ino=0x10000000453 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945b1180] 2023-10-03T19:21:17.069 INFO:teuthology.orchestra.run.smithi045.stdout: -9696> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5152 now clean [inode 0x10000000454 [2,head] /dc-dir/dc-file_607 auth v5152 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.905669+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945b6000] 2023-10-03T19:21:17.069 INFO:teuthology.orchestra.run.smithi045.stdout: -9695> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000454) mark_clean [inode 0x10000000454 [2,head] /dc-dir/dc-file_607 auth v5152 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.905669+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945b6000] 2023-10-03T19:21:17.069 INFO:teuthology.orchestra.run.smithi045.stdout: -9694> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5152 now clean [dentry #0x1/dc-dir/dc-file_607 [2,head] auth (dversion lock) v=5152 ino=0x10000000454 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945b1400] 2023-10-03T19:21:17.069 INFO:teuthology.orchestra.run.smithi045.stdout: -9693> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_607) mark_clean [dentry #0x1/dc-dir/dc-file_607 [2,head] auth (dversion lock) v=5152 ino=0x10000000454 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945b1400] 2023-10-03T19:21:17.069 INFO:teuthology.orchestra.run.smithi045.stdout: -9692> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5154 now clean [inode 0x10000000455 [2,head] /dc-dir/dc-file_608 auth v5154 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.918244+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945b6580] 2023-10-03T19:21:17.069 INFO:teuthology.orchestra.run.smithi045.stdout: -9691> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000455) mark_clean [inode 0x10000000455 [2,head] /dc-dir/dc-file_608 auth v5154 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.918244+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945b6580] 2023-10-03T19:21:17.069 INFO:teuthology.orchestra.run.smithi045.stdout: -9690> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5154 now clean [dentry #0x1/dc-dir/dc-file_608 [2,head] auth (dversion lock) v=5154 ino=0x10000000455 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945b1680] 2023-10-03T19:21:17.069 INFO:teuthology.orchestra.run.smithi045.stdout: -9689> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_608) mark_clean [dentry #0x1/dc-dir/dc-file_608 [2,head] auth (dversion lock) v=5154 ino=0x10000000455 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945b1680] 2023-10-03T19:21:17.069 INFO:teuthology.orchestra.run.smithi045.stdout: -9688> 2023-10-03T19:18:09.829+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 282 ==== osd_op_reply(1875 1000000051c.00000000 [create,setxattr (99),setxattr (30)] v74'31 uv31 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.069 INFO:teuthology.orchestra.run.smithi045.stdout: -9687> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 976 ==== osd_op_reply(1608 10000000411.00000000 [create,setxattr (99),setxattr (30)] v74'28 uv28 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:17.069 INFO:teuthology.orchestra.run.smithi045.stdout: -9686> 2023-10-03T19:18:09.829+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 84 ==== osd_op_reply(1132 10000000235.00000000 [create,setxattr (98),setxattr (30)] v74'21 uv21 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffc800 2023-10-03T19:21:17.070 INFO:teuthology.orchestra.run.smithi045.stdout: -9685> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 977 ==== osd_op_reply(1652 1000000043d.00000000 [create,setxattr (99),setxattr (30)] v74'29 uv29 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:17.070 INFO:teuthology.orchestra.run.smithi045.stdout: -9684> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 978 ==== osd_op_reply(1710 10000000477.00000000 [create,setxattr (99),setxattr (30)] v74'30 uv30 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:17.070 INFO:teuthology.orchestra.run.smithi045.stdout: -9683> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 979 ==== osd_op_reply(1766 100000004af.00000000 [create,setxattr (99),setxattr (30)] v74'31 uv31 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:17.070 INFO:teuthology.orchestra.run.smithi045.stdout: -9682> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 980 ==== osd_op_reply(1782 100000004bf.00000000 [create,setxattr (99),setxattr (30)] v74'32 uv32 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:17.070 INFO:teuthology.orchestra.run.smithi045.stdout: -9681> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 89 ==== osd_op_reply(1315 100000002ec.00000000 [create,setxattr (99),setxattr (30)] v74'23 uv23 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:17.070 INFO:teuthology.orchestra.run.smithi045.stdout: -9680> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5156 now clean [inode 0x10000000456 [2,head] /dc-dir/dc-file_609 auth v5156 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.930989+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945b6b00] 2023-10-03T19:21:17.070 INFO:teuthology.orchestra.run.smithi045.stdout: -9679> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000456) mark_clean [inode 0x10000000456 [2,head] /dc-dir/dc-file_609 auth v5156 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.930989+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945b6b00] 2023-10-03T19:21:17.070 INFO:teuthology.orchestra.run.smithi045.stdout: -9678> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5156 now clean [dentry #0x1/dc-dir/dc-file_609 [2,head] auth (dversion lock) v=5156 ino=0x10000000456 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945b1900] 2023-10-03T19:21:17.070 INFO:teuthology.orchestra.run.smithi045.stdout: -9677> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_609) mark_clean [dentry #0x1/dc-dir/dc-file_609 [2,head] auth (dversion lock) v=5156 ino=0x10000000456 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945b1900] 2023-10-03T19:21:17.070 INFO:teuthology.orchestra.run.smithi045.stdout: -9676> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 90 ==== osd_op_reply(1421 10000000356.00000000 [create,setxattr (99),setxattr (30)] v74'24 uv24 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:17.071 INFO:teuthology.orchestra.run.smithi045.stdout: -9675> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5158 now clean [inode 0x10000000457 [2,head] /dc-dir/dc-file_610 auth v5158 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.943865+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945b7080] 2023-10-03T19:21:17.071 INFO:teuthology.orchestra.run.smithi045.stdout: -9674> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000457) mark_clean [inode 0x10000000457 [2,head] /dc-dir/dc-file_610 auth v5158 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.943865+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945b7080] 2023-10-03T19:21:17.071 INFO:teuthology.orchestra.run.smithi045.stdout: -9673> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5158 now clean [dentry #0x1/dc-dir/dc-file_610 [2,head] auth (dversion lock) v=5158 ino=0x10000000457 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945b1b80] 2023-10-03T19:21:17.071 INFO:teuthology.orchestra.run.smithi045.stdout: -9672> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_610) mark_clean [dentry #0x1/dc-dir/dc-file_610 [2,head] auth (dversion lock) v=5158 ino=0x10000000457 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945b1b80] 2023-10-03T19:21:17.071 INFO:teuthology.orchestra.run.smithi045.stdout: -9671> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5160 now clean [inode 0x10000000458 [2,head] /dc-dir/dc-file_611 auth v5160 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.955712+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945b7600] 2023-10-03T19:21:17.071 INFO:teuthology.orchestra.run.smithi045.stdout: -9670> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 91 ==== osd_op_reply(1542 100000003cf.00000000 [create,setxattr (99),setxattr (30)] v74'29 uv29 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:17.071 INFO:teuthology.orchestra.run.smithi045.stdout: -9669> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000458) mark_clean [inode 0x10000000458 [2,head] /dc-dir/dc-file_611 auth v5160 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.955712+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945b7600] 2023-10-03T19:21:17.071 INFO:teuthology.orchestra.run.smithi045.stdout: -9668> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5160 now clean [dentry #0x1/dc-dir/dc-file_611 [2,head] auth (dversion lock) v=5160 ino=0x10000000458 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945ba000] 2023-10-03T19:21:17.071 INFO:teuthology.orchestra.run.smithi045.stdout: -9667> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_611) mark_clean [dentry #0x1/dc-dir/dc-file_611 [2,head] auth (dversion lock) v=5160 ino=0x10000000458 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945ba000] 2023-10-03T19:21:17.071 INFO:teuthology.orchestra.run.smithi045.stdout: -9666> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5162 now clean [inode 0x10000000459 [2,head] /dc-dir/dc-file_612 auth v5162 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.968079+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945b7b80] 2023-10-03T19:21:17.072 INFO:teuthology.orchestra.run.smithi045.stdout: -9665> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000459) mark_clean [inode 0x10000000459 [2,head] /dc-dir/dc-file_612 auth v5162 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.968079+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945b7b80] 2023-10-03T19:21:17.072 INFO:teuthology.orchestra.run.smithi045.stdout: -9664> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5162 now clean [dentry #0x1/dc-dir/dc-file_612 [2,head] auth (dversion lock) v=5162 ino=0x10000000459 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945ba280] 2023-10-03T19:21:17.072 INFO:teuthology.orchestra.run.smithi045.stdout: -9663> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_612) mark_clean [dentry #0x1/dc-dir/dc-file_612 [2,head] auth (dversion lock) v=5162 ino=0x10000000459 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945ba280] 2023-10-03T19:21:17.072 INFO:teuthology.orchestra.run.smithi045.stdout: -9662> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 92 ==== osd_op_reply(1462 1000000037f.00000000 [create,setxattr (99),setxattr (30)] v74'25 uv25 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:17.072 INFO:teuthology.orchestra.run.smithi045.stdout: -9661> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5164 now clean [inode 0x1000000045a [2,head] /dc-dir/dc-file_613 auth v5164 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.980028+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945b8100] 2023-10-03T19:21:17.072 INFO:teuthology.orchestra.run.smithi045.stdout: -9660> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000045a) mark_clean [inode 0x1000000045a [2,head] /dc-dir/dc-file_613 auth v5164 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.980028+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945b8100] 2023-10-03T19:21:17.072 INFO:teuthology.orchestra.run.smithi045.stdout: -9659> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5164 now clean [dentry #0x1/dc-dir/dc-file_613 [2,head] auth (dversion lock) v=5164 ino=0x1000000045a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945ba500] 2023-10-03T19:21:17.072 INFO:teuthology.orchestra.run.smithi045.stdout: -9658> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_613) mark_clean [dentry #0x1/dc-dir/dc-file_613 [2,head] auth (dversion lock) v=5164 ino=0x1000000045a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945ba500] 2023-10-03T19:21:17.072 INFO:teuthology.orchestra.run.smithi045.stdout: -9657> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 93 ==== osd_op_reply(1592 10000000401.00000000 [create,setxattr (99),setxattr (30)] v74'24 uv24 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:17.072 INFO:teuthology.orchestra.run.smithi045.stdout: -9656> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5166 now clean [inode 0x1000000045b [2,head] /dc-dir/dc-file_614 auth v5166 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.992071+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945b8680] 2023-10-03T19:21:17.072 INFO:teuthology.orchestra.run.smithi045.stdout: -9655> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000045b) mark_clean [inode 0x1000000045b [2,head] /dc-dir/dc-file_614 auth v5166 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.992071+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945b8680] 2023-10-03T19:21:17.072 INFO:teuthology.orchestra.run.smithi045.stdout: -9654> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5166 now clean [dentry #0x1/dc-dir/dc-file_614 [2,head] auth (dversion lock) v=5166 ino=0x1000000045b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945ba780] 2023-10-03T19:21:17.073 INFO:teuthology.orchestra.run.smithi045.stdout: -9653> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 94 ==== osd_op_reply(1467 10000000384.00000000 [create,setxattr (99),setxattr (30)] v74'26 uv26 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:17.073 INFO:teuthology.orchestra.run.smithi045.stdout: -9652> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_614) mark_clean [dentry #0x1/dc-dir/dc-file_614 [2,head] auth (dversion lock) v=5166 ino=0x1000000045b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945ba780] 2023-10-03T19:21:17.073 INFO:teuthology.orchestra.run.smithi045.stdout: -9651> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5168 now clean [inode 0x1000000045c [2,head] /dc-dir/dc-file_615 auth v5168 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.003975+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945b8c00] 2023-10-03T19:21:17.073 INFO:teuthology.orchestra.run.smithi045.stdout: -9650> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000045c) mark_clean [inode 0x1000000045c [2,head] /dc-dir/dc-file_615 auth v5168 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.003975+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945b8c00] 2023-10-03T19:21:17.163 INFO:teuthology.orchestra.run.smithi045.stdout: -9649> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5168 now clean [dentry #0x1/dc-dir/dc-file_615 [2,head] auth (dversion lock) v=5168 ino=0x1000000045c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945baa00] 2023-10-03T19:21:17.163 INFO:teuthology.orchestra.run.smithi045.stdout: -9648> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_615) mark_clean [dentry #0x1/dc-dir/dc-file_615 [2,head] auth (dversion lock) v=5168 ino=0x1000000045c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945baa00] 2023-10-03T19:21:17.163 INFO:teuthology.orchestra.run.smithi045.stdout: -9647> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5170 now clean [inode 0x1000000045d [2,head] /dc-dir/dc-file_616 auth v5170 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.017170+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945b9180] 2023-10-03T19:21:17.163 INFO:teuthology.orchestra.run.smithi045.stdout: -9646> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000045d) mark_clean [inode 0x1000000045d [2,head] /dc-dir/dc-file_616 auth v5170 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.017170+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945b9180] 2023-10-03T19:21:17.163 INFO:teuthology.orchestra.run.smithi045.stdout: -9645> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 95 ==== osd_op_reply(1669 1000000044e.00000000 [create,setxattr (99),setxattr (30)] v74'27 uv27 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:17.164 INFO:teuthology.orchestra.run.smithi045.stdout: -9644> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5170 now clean [dentry #0x1/dc-dir/dc-file_616 [2,head] auth (dversion lock) v=5170 ino=0x1000000045d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945bac80] 2023-10-03T19:21:17.164 INFO:teuthology.orchestra.run.smithi045.stdout: -9643> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_616) mark_clean [dentry #0x1/dc-dir/dc-file_616 [2,head] auth (dversion lock) v=5170 ino=0x1000000045d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945bac80] 2023-10-03T19:21:17.164 INFO:teuthology.orchestra.run.smithi045.stdout: -9642> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5172 now clean [inode 0x1000000045e [2,head] /dc-dir/dc-file_617 auth v5172 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.029673+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945b9700] 2023-10-03T19:21:17.164 INFO:teuthology.orchestra.run.smithi045.stdout: -9641> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000045e) mark_clean [inode 0x1000000045e [2,head] /dc-dir/dc-file_617 auth v5172 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.029673+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945b9700] 2023-10-03T19:21:17.164 INFO:teuthology.orchestra.run.smithi045.stdout: -9640> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5172 now clean [dentry #0x1/dc-dir/dc-file_617 [2,head] auth (dversion lock) v=5172 ino=0x1000000045e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945baf00] 2023-10-03T19:21:17.164 INFO:teuthology.orchestra.run.smithi045.stdout: -9639> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_617) mark_clean [dentry #0x1/dc-dir/dc-file_617 [2,head] auth (dversion lock) v=5172 ino=0x1000000045e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945baf00] 2023-10-03T19:21:17.164 INFO:teuthology.orchestra.run.smithi045.stdout: -9638> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5174 now clean [inode 0x1000000045f [2,head] /dc-dir/dc-file_618 auth v5174 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.042482+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945c0000] 2023-10-03T19:21:17.164 INFO:teuthology.orchestra.run.smithi045.stdout: -9637> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 981 ==== osd_op_reply(1858 1000000050b.00000000 [create,setxattr (99),setxattr (30)] v74'33 uv33 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:17.164 INFO:teuthology.orchestra.run.smithi045.stdout: -9636> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000045f) mark_clean [inode 0x1000000045f [2,head] /dc-dir/dc-file_618 auth v5174 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.042482+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945c0000] 2023-10-03T19:21:17.164 INFO:teuthology.orchestra.run.smithi045.stdout: -9635> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5174 now clean [dentry #0x1/dc-dir/dc-file_618 [2,head] auth (dversion lock) v=5174 ino=0x1000000045f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945bb180] 2023-10-03T19:21:17.164 INFO:teuthology.orchestra.run.smithi045.stdout: -9634> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_618) mark_clean [dentry #0x1/dc-dir/dc-file_618 [2,head] auth (dversion lock) v=5174 ino=0x1000000045f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945bb180] 2023-10-03T19:21:17.165 INFO:teuthology.orchestra.run.smithi045.stdout: -9633> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5176 now clean [inode 0x10000000460 [2,head] /dc-dir/dc-file_619 auth v5176 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.055107+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945c0580] 2023-10-03T19:21:17.165 INFO:teuthology.orchestra.run.smithi045.stdout: -9632> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000460) mark_clean [inode 0x10000000460 [2,head] /dc-dir/dc-file_619 auth v5176 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.055107+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945c0580] 2023-10-03T19:21:17.165 INFO:teuthology.orchestra.run.smithi045.stdout: -9631> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 982 ==== osd_op_reply(1900 10000000535.00000000 [create,setxattr (99),setxattr (30)] v74'34 uv34 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:17.165 INFO:teuthology.orchestra.run.smithi045.stdout: -9630> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5176 now clean [dentry #0x1/dc-dir/dc-file_619 [2,head] auth (dversion lock) v=5176 ino=0x10000000460 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945bb400] 2023-10-03T19:21:17.165 INFO:teuthology.orchestra.run.smithi045.stdout: -9629> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_619) mark_clean [dentry #0x1/dc-dir/dc-file_619 [2,head] auth (dversion lock) v=5176 ino=0x10000000460 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945bb400] 2023-10-03T19:21:17.165 INFO:teuthology.orchestra.run.smithi045.stdout: -9628> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5178 now clean [inode 0x10000000461 [2,head] /dc-dir/dc-file_620 auth v5178 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.067338+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945c0b00] 2023-10-03T19:21:17.165 INFO:teuthology.orchestra.run.smithi045.stdout: -9627> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000461) mark_clean [inode 0x10000000461 [2,head] /dc-dir/dc-file_620 auth v5178 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.067338+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945c0b00] 2023-10-03T19:21:17.165 INFO:teuthology.orchestra.run.smithi045.stdout: -9626> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5178 now clean [dentry #0x1/dc-dir/dc-file_620 [2,head] auth (dversion lock) v=5178 ino=0x10000000461 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945bb680] 2023-10-03T19:21:17.165 INFO:teuthology.orchestra.run.smithi045.stdout: -9625> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_620) mark_clean [dentry #0x1/dc-dir/dc-file_620 [2,head] auth (dversion lock) v=5178 ino=0x10000000461 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945bb680] 2023-10-03T19:21:17.165 INFO:teuthology.orchestra.run.smithi045.stdout: -9624> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5180 now clean [inode 0x10000000462 [2,head] /dc-dir/dc-file_621 auth v5180 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.079145+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945c1080] 2023-10-03T19:21:17.165 INFO:teuthology.orchestra.run.smithi045.stdout: -9623> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 983 ==== osd_op_reply(1907 1000000053b.00000000 [create,setxattr (99),setxattr (30)] v74'35 uv35 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:17.166 INFO:teuthology.orchestra.run.smithi045.stdout: -9622> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000462) mark_clean [inode 0x10000000462 [2,head] /dc-dir/dc-file_621 auth v5180 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.079145+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945c1080] 2023-10-03T19:21:17.166 INFO:teuthology.orchestra.run.smithi045.stdout: -9621> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5180 now clean [dentry #0x1/dc-dir/dc-file_621 [2,head] auth (dversion lock) v=5180 ino=0x10000000462 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945bb900] 2023-10-03T19:21:17.166 INFO:teuthology.orchestra.run.smithi045.stdout: -9620> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_621) mark_clean [dentry #0x1/dc-dir/dc-file_621 [2,head] auth (dversion lock) v=5180 ino=0x10000000462 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945bb900] 2023-10-03T19:21:17.166 INFO:teuthology.orchestra.run.smithi045.stdout: -9619> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5246 now clean [inode 0x10000000463 [2,head] /dc-dir/dc-file_622 auth v5246 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.169528+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945c1600] 2023-10-03T19:21:17.166 INFO:teuthology.orchestra.run.smithi045.stdout: -9618> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000463) mark_clean [inode 0x10000000463 [2,head] /dc-dir/dc-file_622 auth v5246 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.169528+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945c1600] 2023-10-03T19:21:17.166 INFO:teuthology.orchestra.run.smithi045.stdout: -9617> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5246 now clean [dentry #0x1/dc-dir/dc-file_622 [2,head] auth (dversion lock) v=5246 ino=0x10000000463 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945bbb80] 2023-10-03T19:21:17.166 INFO:teuthology.orchestra.run.smithi045.stdout: -9616> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_622) mark_clean [dentry #0x1/dc-dir/dc-file_622 [2,head] auth (dversion lock) v=5246 ino=0x10000000463 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945bbb80] 2023-10-03T19:21:17.166 INFO:teuthology.orchestra.run.smithi045.stdout: -9615> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 46 ==== osd_op_reply(1970 1000000057a.00000000 [create,setxattr (99),setxattr (30)] v74'29 uv29 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:17.166 INFO:teuthology.orchestra.run.smithi045.stdout: -9614> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5248 now clean [inode 0x10000000464 [2,head] /dc-dir/dc-file_623 auth v5248 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.217556+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945c1b80] 2023-10-03T19:21:17.166 INFO:teuthology.orchestra.run.smithi045.stdout: -9613> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000464) mark_clean [inode 0x10000000464 [2,head] /dc-dir/dc-file_623 auth v5248 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.217556+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945c1b80] 2023-10-03T19:21:17.167 INFO:teuthology.orchestra.run.smithi045.stdout: -9612> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5248 now clean [dentry #0x1/dc-dir/dc-file_623 [2,head] auth (dversion lock) v=5248 ino=0x10000000464 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945d6000] 2023-10-03T19:21:17.167 INFO:teuthology.orchestra.run.smithi045.stdout: -9611> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_623) mark_clean [dentry #0x1/dc-dir/dc-file_623 [2,head] auth (dversion lock) v=5248 ino=0x10000000464 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945d6000] 2023-10-03T19:21:17.167 INFO:teuthology.orchestra.run.smithi045.stdout: -9610> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 47 ==== osd_op_reply(2015 100000005a7.00000000 [create,setxattr (99),setxattr (30)] v74'30 uv30 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:17.167 INFO:teuthology.orchestra.run.smithi045.stdout: -9609> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5250 now clean [inode 0x10000000465 [2,head] /dc-dir/dc-file_624 auth v5250 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.229605+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945c2100] 2023-10-03T19:21:17.167 INFO:teuthology.orchestra.run.smithi045.stdout: -9608> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000465) mark_clean [inode 0x10000000465 [2,head] /dc-dir/dc-file_624 auth v5250 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.229605+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945c2100] 2023-10-03T19:21:17.167 INFO:teuthology.orchestra.run.smithi045.stdout: -9607> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5250 now clean [dentry #0x1/dc-dir/dc-file_624 [2,head] auth (dversion lock) v=5250 ino=0x10000000465 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945d6280] 2023-10-03T19:21:17.167 INFO:teuthology.orchestra.run.smithi045.stdout: -9606> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_624) mark_clean [dentry #0x1/dc-dir/dc-file_624 [2,head] auth (dversion lock) v=5250 ino=0x10000000465 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945d6280] 2023-10-03T19:21:17.167 INFO:teuthology.orchestra.run.smithi045.stdout: -9605> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5252 now clean [inode 0x10000000466 [2,head] /dc-dir/dc-file_625 auth v5252 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.242448+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945c2680] 2023-10-03T19:21:17.167 INFO:teuthology.orchestra.run.smithi045.stdout: -9604> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 48 ==== osd_op_reply(1781 100000004be.00000000 [create,setxattr (99),setxattr (30)] v74'30 uv30 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:17.167 INFO:teuthology.orchestra.run.smithi045.stdout: -9603> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000466) mark_clean [inode 0x10000000466 [2,head] /dc-dir/dc-file_625 auth v5252 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.242448+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945c2680] 2023-10-03T19:21:17.168 INFO:teuthology.orchestra.run.smithi045.stdout: -9602> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5252 now clean [dentry #0x1/dc-dir/dc-file_625 [2,head] auth (dversion lock) v=5252 ino=0x10000000466 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945d6500] 2023-10-03T19:21:17.168 INFO:teuthology.orchestra.run.smithi045.stdout: -9601> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_625) mark_clean [dentry #0x1/dc-dir/dc-file_625 [2,head] auth (dversion lock) v=5252 ino=0x10000000466 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945d6500] 2023-10-03T19:21:17.168 INFO:teuthology.orchestra.run.smithi045.stdout: -9600> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 49 ==== osd_op_reply(1869 10000000516.00000000 [create,setxattr (99),setxattr (30)] v74'31 uv31 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:17.168 INFO:teuthology.orchestra.run.smithi045.stdout: -9599> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5254 now clean [inode 0x10000000467 [2,head] /dc-dir/dc-file_626 auth v5254 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.256032+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945c2c00] 2023-10-03T19:21:17.168 INFO:teuthology.orchestra.run.smithi045.stdout: -9598> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 50 ==== osd_op_reply(1912 10000000540.00000000 [create,setxattr (99),setxattr (30)] v74'32 uv32 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:17.168 INFO:teuthology.orchestra.run.smithi045.stdout: -9597> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000467) mark_clean [inode 0x10000000467 [2,head] /dc-dir/dc-file_626 auth v5254 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.256032+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945c2c00] 2023-10-03T19:21:17.168 INFO:teuthology.orchestra.run.smithi045.stdout: -9596> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5254 now clean [dentry #0x1/dc-dir/dc-file_626 [2,head] auth (dversion lock) v=5254 ino=0x10000000467 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945d6780] 2023-10-03T19:21:17.168 INFO:teuthology.orchestra.run.smithi045.stdout: -9595> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_626) mark_clean [dentry #0x1/dc-dir/dc-file_626 [2,head] auth (dversion lock) v=5254 ino=0x10000000467 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945d6780] 2023-10-03T19:21:17.168 INFO:teuthology.orchestra.run.smithi045.stdout: -9594> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 51 ==== osd_op_reply(1920 10000000548.00000000 [create,setxattr (99),setxattr (30)] v74'33 uv33 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:17.168 INFO:teuthology.orchestra.run.smithi045.stdout: -9593> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5256 now clean [inode 0x10000000468 [2,head] /dc-dir/dc-file_627 auth v5256 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.267975+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945c3180] 2023-10-03T19:21:17.168 INFO:teuthology.orchestra.run.smithi045.stdout: -9592> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000468) mark_clean [inode 0x10000000468 [2,head] /dc-dir/dc-file_627 auth v5256 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.267975+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945c3180] 2023-10-03T19:21:17.169 INFO:teuthology.orchestra.run.smithi045.stdout: -9591> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5256 now clean [dentry #0x1/dc-dir/dc-file_627 [2,head] auth (dversion lock) v=5256 ino=0x10000000468 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945d6a00] 2023-10-03T19:21:17.169 INFO:teuthology.orchestra.run.smithi045.stdout: -9590> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_627) mark_clean [dentry #0x1/dc-dir/dc-file_627 [2,head] auth (dversion lock) v=5256 ino=0x10000000468 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945d6a00] 2023-10-03T19:21:17.169 INFO:teuthology.orchestra.run.smithi045.stdout: -9589> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 96 ==== osd_op_reply(1649 1000000043a.00000000 [create,setxattr (99),setxattr (30)] v74'30 uv30 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:17.169 INFO:teuthology.orchestra.run.smithi045.stdout: -9588> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5258 now clean [inode 0x10000000469 [2,head] /dc-dir/dc-file_628 auth v5258 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.280071+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945c3700] 2023-10-03T19:21:17.169 INFO:teuthology.orchestra.run.smithi045.stdout: -9587> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000469) mark_clean [inode 0x10000000469 [2,head] /dc-dir/dc-file_628 auth v5258 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.280071+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945c3700] 2023-10-03T19:21:17.169 INFO:teuthology.orchestra.run.smithi045.stdout: -9586> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5258 now clean [dentry #0x1/dc-dir/dc-file_628 [2,head] auth (dversion lock) v=5258 ino=0x10000000469 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945d6c80] 2023-10-03T19:21:17.169 INFO:teuthology.orchestra.run.smithi045.stdout: -9585> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_628) mark_clean [dentry #0x1/dc-dir/dc-file_628 [2,head] auth (dversion lock) v=5258 ino=0x10000000469 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945d6c80] 2023-10-03T19:21:17.169 INFO:teuthology.orchestra.run.smithi045.stdout: -9584> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 97 ==== osd_op_reply(1715 1000000047c.00000000 [create,setxattr (99),setxattr (30)] v74'25 uv25 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:17.169 INFO:teuthology.orchestra.run.smithi045.stdout: -9583> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5260 now clean [inode 0x1000000046a [2,head] /dc-dir/dc-file_629 auth v5260 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.292019+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945da000] 2023-10-03T19:21:17.169 INFO:teuthology.orchestra.run.smithi045.stdout: -9582> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000046a) mark_clean [inode 0x1000000046a [2,head] /dc-dir/dc-file_629 auth v5260 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.292019+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945da000] 2023-10-03T19:21:17.193 INFO:teuthology.orchestra.run.smithi045.stdout: -9581> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5260 now clean [dentry #0x1/dc-dir/dc-file_629 [2,head] auth (dversion lock) v=5260 ino=0x1000000046a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945d6f00] 2023-10-03T19:21:17.193 INFO:teuthology.orchestra.run.smithi045.stdout: -9580> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_629) mark_clean [dentry #0x1/dc-dir/dc-file_629 [2,head] auth (dversion lock) v=5260 ino=0x1000000046a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945d6f00] 2023-10-03T19:21:17.193 INFO:teuthology.orchestra.run.smithi045.stdout: -9579> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5262 now clean [inode 0x1000000046b [2,head] /dc-dir/dc-file_630 auth v5262 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.303347+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945da580] 2023-10-03T19:21:17.193 INFO:teuthology.orchestra.run.smithi045.stdout: -9578> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 98 ==== osd_op_reply(1724 10000000485.00000000 [create,setxattr (99),setxattr (30)] v74'26 uv26 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:17.193 INFO:teuthology.orchestra.run.smithi045.stdout: -9577> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000046b) mark_clean [inode 0x1000000046b [2,head] /dc-dir/dc-file_630 auth v5262 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.303347+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945da580] 2023-10-03T19:21:17.193 INFO:teuthology.orchestra.run.smithi045.stdout: -9576> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5262 now clean [dentry #0x1/dc-dir/dc-file_630 [2,head] auth (dversion lock) v=5262 ino=0x1000000046b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945d7180] 2023-10-03T19:21:17.193 INFO:teuthology.orchestra.run.smithi045.stdout: -9575> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_630) mark_clean [dentry #0x1/dc-dir/dc-file_630 [2,head] auth (dversion lock) v=5262 ino=0x1000000046b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945d7180] 2023-10-03T19:21:17.193 INFO:teuthology.orchestra.run.smithi045.stdout: -9574> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5264 now clean [inode 0x1000000046c [2,head] /dc-dir/dc-file_631 auth v5264 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.314946+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945dab00] 2023-10-03T19:21:17.194 INFO:teuthology.orchestra.run.smithi045.stdout: -9573> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000046c) mark_clean [inode 0x1000000046c [2,head] /dc-dir/dc-file_631 auth v5264 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.314946+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945dab00] 2023-10-03T19:21:17.194 INFO:teuthology.orchestra.run.smithi045.stdout: -9572> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5264 now clean [dentry #0x1/dc-dir/dc-file_631 [2,head] auth (dversion lock) v=5264 ino=0x1000000046c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945d7400] 2023-10-03T19:21:17.194 INFO:teuthology.orchestra.run.smithi045.stdout: -9571> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_631) mark_clean [dentry #0x1/dc-dir/dc-file_631 [2,head] auth (dversion lock) v=5264 ino=0x1000000046c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945d7400] 2023-10-03T19:21:17.194 INFO:teuthology.orchestra.run.smithi045.stdout: -9570> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5266 now clean [inode 0x1000000046d [2,head] /dc-dir/dc-file_632 auth v5266 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.327969+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945db080] 2023-10-03T19:21:17.194 INFO:teuthology.orchestra.run.smithi045.stdout: -9569> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 984 ==== osd_op_reply(2019 100000005ab.00000000 [create,setxattr (99),setxattr (30)] v74'36 uv36 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:17.194 INFO:teuthology.orchestra.run.smithi045.stdout: -9568> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000046d) mark_clean [inode 0x1000000046d [2,head] /dc-dir/dc-file_632 auth v5266 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.327969+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945db080] 2023-10-03T19:21:17.194 INFO:teuthology.orchestra.run.smithi045.stdout: -9567> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5266 now clean [dentry #0x1/dc-dir/dc-file_632 [2,head] auth (dversion lock) v=5266 ino=0x1000000046d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945d7680] 2023-10-03T19:21:17.194 INFO:teuthology.orchestra.run.smithi045.stdout: -9566> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_632) mark_clean [dentry #0x1/dc-dir/dc-file_632 [2,head] auth (dversion lock) v=5266 ino=0x1000000046d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945d7680] 2023-10-03T19:21:17.194 INFO:teuthology.orchestra.run.smithi045.stdout: -9565> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5268 now clean [inode 0x1000000046e [2,head] /dc-dir/dc-file_633 auth v5268 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.339950+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945db600] 2023-10-03T19:21:17.194 INFO:teuthology.orchestra.run.smithi045.stdout: -9564> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000046e) mark_clean [inode 0x1000000046e [2,head] /dc-dir/dc-file_633 auth v5268 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.339950+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945db600] 2023-10-03T19:21:17.195 INFO:teuthology.orchestra.run.smithi045.stdout: -9563> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5268 now clean [dentry #0x1/dc-dir/dc-file_633 [2,head] auth (dversion lock) v=5268 ino=0x1000000046e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945d7900] 2023-10-03T19:21:17.195 INFO:teuthology.orchestra.run.smithi045.stdout: -9562> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_633) mark_clean [dentry #0x1/dc-dir/dc-file_633 [2,head] auth (dversion lock) v=5268 ino=0x1000000046e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945d7900] 2023-10-03T19:21:17.195 INFO:teuthology.orchestra.run.smithi045.stdout: -9561> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5270 now clean [inode 0x1000000046f [2,head] /dc-dir/dc-file_634 auth v5270 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.352501+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945dbb80] 2023-10-03T19:21:17.195 INFO:teuthology.orchestra.run.smithi045.stdout: -9560> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000046f) mark_clean [inode 0x1000000046f [2,head] /dc-dir/dc-file_634 auth v5270 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.352501+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945dbb80] 2023-10-03T19:21:17.195 INFO:teuthology.orchestra.run.smithi045.stdout: -9559> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5270 now clean [dentry #0x1/dc-dir/dc-file_634 [2,head] auth (dversion lock) v=5270 ino=0x1000000046f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945d7b80] 2023-10-03T19:21:17.195 INFO:teuthology.orchestra.run.smithi045.stdout: -9558> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_634) mark_clean [dentry #0x1/dc-dir/dc-file_634 [2,head] auth (dversion lock) v=5270 ino=0x1000000046f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945d7b80] 2023-10-03T19:21:17.195 INFO:teuthology.orchestra.run.smithi045.stdout: -9557> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5272 now clean [inode 0x10000000470 [2,head] /dc-dir/dc-file_635 auth v5272 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.364383+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945dc100] 2023-10-03T19:21:17.195 INFO:teuthology.orchestra.run.smithi045.stdout: -9556> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000470) mark_clean [inode 0x10000000470 [2,head] /dc-dir/dc-file_635 auth v5272 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.364383+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945dc100] 2023-10-03T19:21:17.195 INFO:teuthology.orchestra.run.smithi045.stdout: -9555> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5272 now clean [dentry #0x1/dc-dir/dc-file_635 [2,head] auth (dversion lock) v=5272 ino=0x10000000470 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945de000] 2023-10-03T19:21:17.195 INFO:teuthology.orchestra.run.smithi045.stdout: -9554> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_635) mark_clean [dentry #0x1/dc-dir/dc-file_635 [2,head] auth (dversion lock) v=5272 ino=0x10000000470 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945de000] 2023-10-03T19:21:17.195 INFO:teuthology.orchestra.run.smithi045.stdout: -9553> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5274 now clean [inode 0x10000000471 [2,head] /dc-dir/dc-file_636 auth v5274 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.377355+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945dc680] 2023-10-03T19:21:17.196 INFO:teuthology.orchestra.run.smithi045.stdout: -9552> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000471) mark_clean [inode 0x10000000471 [2,head] /dc-dir/dc-file_636 auth v5274 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.377355+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945dc680] 2023-10-03T19:21:17.196 INFO:teuthology.orchestra.run.smithi045.stdout: -9551> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5274 now clean [dentry #0x1/dc-dir/dc-file_636 [2,head] auth (dversion lock) v=5274 ino=0x10000000471 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945de280] 2023-10-03T19:21:17.196 INFO:teuthology.orchestra.run.smithi045.stdout: -9550> 2023-10-03T19:18:09.829+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 85 ==== osd_op_reply(1140 1000000023d.00000000 [create,setxattr (98),setxattr (30)] v74'22 uv22 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffc800 2023-10-03T19:21:17.196 INFO:teuthology.orchestra.run.smithi045.stdout: -9549> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_636) mark_clean [dentry #0x1/dc-dir/dc-file_636 [2,head] auth (dversion lock) v=5274 ino=0x10000000471 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945de280] 2023-10-03T19:21:17.196 INFO:teuthology.orchestra.run.smithi045.stdout: -9548> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5276 now clean [inode 0x10000000472 [2,head] /dc-dir/dc-file_637 auth v5276 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.389836+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945dcc00] 2023-10-03T19:21:17.196 INFO:teuthology.orchestra.run.smithi045.stdout: -9547> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000472) mark_clean [inode 0x10000000472 [2,head] /dc-dir/dc-file_637 auth v5276 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.389836+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945dcc00] 2023-10-03T19:21:17.196 INFO:teuthology.orchestra.run.smithi045.stdout: -9546> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5276 now clean [dentry #0x1/dc-dir/dc-file_637 [2,head] auth (dversion lock) v=5276 ino=0x10000000472 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945de500] 2023-10-03T19:21:17.196 INFO:teuthology.orchestra.run.smithi045.stdout: -9545> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_637) mark_clean [dentry #0x1/dc-dir/dc-file_637 [2,head] auth (dversion lock) v=5276 ino=0x10000000472 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945de500] 2023-10-03T19:21:17.196 INFO:teuthology.orchestra.run.smithi045.stdout: -9544> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5278 now clean [inode 0x10000000473 [2,head] /dc-dir/dc-file_638 auth v5278 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.401904+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945dd180] 2023-10-03T19:21:17.196 INFO:teuthology.orchestra.run.smithi045.stdout: -9543> 2023-10-03T19:18:09.829+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 86 ==== osd_op_reply(1155 1000000024c.00000000 [create,setxattr (98),setxattr (30)] v74'23 uv23 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffc800 2023-10-03T19:21:17.196 INFO:teuthology.orchestra.run.smithi045.stdout: -9542> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000473) mark_clean [inode 0x10000000473 [2,head] /dc-dir/dc-file_638 auth v5278 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.401904+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945dd180] 2023-10-03T19:21:17.197 INFO:teuthology.orchestra.run.smithi045.stdout: -9541> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5278 now clean [dentry #0x1/dc-dir/dc-file_638 [2,head] auth (dversion lock) v=5278 ino=0x10000000473 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945de780] 2023-10-03T19:21:17.197 INFO:teuthology.orchestra.run.smithi045.stdout: -9540> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_638) mark_clean [dentry #0x1/dc-dir/dc-file_638 [2,head] auth (dversion lock) v=5278 ino=0x10000000473 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945de780] 2023-10-03T19:21:17.197 INFO:teuthology.orchestra.run.smithi045.stdout: -9539> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5280 now clean [inode 0x10000000474 [2,head] /dc-dir/dc-file_639 auth v5280 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.414842+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945dd700] 2023-10-03T19:21:17.197 INFO:teuthology.orchestra.run.smithi045.stdout: -9538> 2023-10-03T19:18:09.829+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 87 ==== osd_op_reply(1221 1000000028e.00000000 [create,setxattr (99),setxattr (30)] v74'24 uv24 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffc800 2023-10-03T19:21:17.197 INFO:teuthology.orchestra.run.smithi045.stdout: -9537> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000474) mark_clean [inode 0x10000000474 [2,head] /dc-dir/dc-file_639 auth v5280 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.414842+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945dd700] 2023-10-03T19:21:17.197 INFO:teuthology.orchestra.run.smithi045.stdout: -9536> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5280 now clean [dentry #0x1/dc-dir/dc-file_639 [2,head] auth (dversion lock) v=5280 ino=0x10000000474 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945dea00] 2023-10-03T19:21:17.197 INFO:teuthology.orchestra.run.smithi045.stdout: -9535> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_639) mark_clean [dentry #0x1/dc-dir/dc-file_639 [2,head] auth (dversion lock) v=5280 ino=0x10000000474 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945dea00] 2023-10-03T19:21:17.197 INFO:teuthology.orchestra.run.smithi045.stdout: -9534> 2023-10-03T19:18:09.829+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 88 ==== osd_op_reply(1257 100000002b2.00000000 [create,setxattr (99),setxattr (30)] v74'25 uv25 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffc800 2023-10-03T19:21:17.197 INFO:teuthology.orchestra.run.smithi045.stdout: -9533> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5282 now clean [inode 0x10000000475 [2,head] /dc-dir/dc-file_640 auth v5282 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.426552+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945f2000] 2023-10-03T19:21:17.197 INFO:teuthology.orchestra.run.smithi045.stdout: -9532> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000475) mark_clean [inode 0x10000000475 [2,head] /dc-dir/dc-file_640 auth v5282 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.426552+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945f2000] 2023-10-03T19:21:17.197 INFO:teuthology.orchestra.run.smithi045.stdout: -9531> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5282 now clean [dentry #0x1/dc-dir/dc-file_640 [2,head] auth (dversion lock) v=5282 ino=0x10000000475 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945dec80] 2023-10-03T19:21:17.198 INFO:teuthology.orchestra.run.smithi045.stdout: -9530> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_640) mark_clean [dentry #0x1/dc-dir/dc-file_640 [2,head] auth (dversion lock) v=5282 ino=0x10000000475 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945dec80] 2023-10-03T19:21:17.198 INFO:teuthology.orchestra.run.smithi045.stdout: -9529> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5284 now clean [inode 0x10000000476 [2,head] /dc-dir/dc-file_641 auth v5284 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.438725+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945f2580] 2023-10-03T19:21:17.198 INFO:teuthology.orchestra.run.smithi045.stdout: -9528> 2023-10-03T19:18:09.829+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 283 ==== osd_op_reply(1876 1000000051d.00000000 [create,setxattr (99),setxattr (30)] v74'32 uv32 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.198 INFO:teuthology.orchestra.run.smithi045.stdout: -9527> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000476) mark_clean [inode 0x10000000476 [2,head] /dc-dir/dc-file_641 auth v5284 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.438725+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945f2580] 2023-10-03T19:21:17.198 INFO:teuthology.orchestra.run.smithi045.stdout: -9526> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5284 now clean [dentry #0x1/dc-dir/dc-file_641 [2,head] auth (dversion lock) v=5284 ino=0x10000000476 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945def00] 2023-10-03T19:21:17.198 INFO:teuthology.orchestra.run.smithi045.stdout: -9525> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_641) mark_clean [dentry #0x1/dc-dir/dc-file_641 [2,head] auth (dversion lock) v=5284 ino=0x10000000476 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945def00] 2023-10-03T19:21:17.198 INFO:teuthology.orchestra.run.smithi045.stdout: -9524> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5286 now clean [inode 0x10000000477 [2,head] /dc-dir/dc-file_642 auth v5286 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.451879+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945f2b00] 2023-10-03T19:21:17.198 INFO:teuthology.orchestra.run.smithi045.stdout: -9523> 2023-10-03T19:18:09.829+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 284 ==== osd_op_reply(1882 10000000523.00000000 [create,setxattr (99),setxattr (30)] v74'33 uv33 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.198 INFO:teuthology.orchestra.run.smithi045.stdout: -9522> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000477) mark_clean [inode 0x10000000477 [2,head] /dc-dir/dc-file_642 auth v5286 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.451879+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945f2b00] 2023-10-03T19:21:17.198 INFO:teuthology.orchestra.run.smithi045.stdout: -9521> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5286 now clean [dentry #0x1/dc-dir/dc-file_642 [2,head] auth (dversion lock) v=5286 ino=0x10000000477 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945df180] 2023-10-03T19:21:17.198 INFO:teuthology.orchestra.run.smithi045.stdout: -9520> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_642) mark_clean [dentry #0x1/dc-dir/dc-file_642 [2,head] auth (dversion lock) v=5286 ino=0x10000000477 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945df180] 2023-10-03T19:21:17.199 INFO:teuthology.orchestra.run.smithi045.stdout: -9519> 2023-10-03T19:18:09.829+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 285 ==== osd_op_reply(1931 10000000553.00000000 [create,setxattr (99),setxattr (30)] v74'34 uv34 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.199 INFO:teuthology.orchestra.run.smithi045.stdout: -9518> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5288 now clean [inode 0x10000000478 [2,head] /dc-dir/dc-file_643 auth v5288 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.463798+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945f3080] 2023-10-03T19:21:17.199 INFO:teuthology.orchestra.run.smithi045.stdout: -9517> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000478) mark_clean [inode 0x10000000478 [2,head] /dc-dir/dc-file_643 auth v5288 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.463798+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945f3080] 2023-10-03T19:21:17.199 INFO:teuthology.orchestra.run.smithi045.stdout: -9516> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5288 now clean [dentry #0x1/dc-dir/dc-file_643 [2,head] auth (dversion lock) v=5288 ino=0x10000000478 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945df400] 2023-10-03T19:21:17.199 INFO:teuthology.orchestra.run.smithi045.stdout: -9515> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_643) mark_clean [dentry #0x1/dc-dir/dc-file_643 [2,head] auth (dversion lock) v=5288 ino=0x10000000478 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945df400] 2023-10-03T19:21:17.199 INFO:teuthology.orchestra.run.smithi045.stdout: -9514> 2023-10-03T19:18:09.829+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 286 ==== osd_op_reply(1957 1000000056d.00000000 [create,setxattr (99),setxattr (30)] v74'35 uv35 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.199 INFO:teuthology.orchestra.run.smithi045.stdout: -9513> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5290 now clean [inode 0x10000000479 [2,head] /dc-dir/dc-file_644 auth v5290 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.475546+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945f3600] 2023-10-03T19:21:17.199 INFO:teuthology.orchestra.run.smithi045.stdout: -9512> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000479) mark_clean [inode 0x10000000479 [2,head] /dc-dir/dc-file_644 auth v5290 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.475546+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945f3600] 2023-10-03T19:21:17.199 INFO:teuthology.orchestra.run.smithi045.stdout: -9511> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5290 now clean [dentry #0x1/dc-dir/dc-file_644 [2,head] auth (dversion lock) v=5290 ino=0x10000000479 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945df680] 2023-10-03T19:21:17.199 INFO:teuthology.orchestra.run.smithi045.stdout: -9510> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_644) mark_clean [dentry #0x1/dc-dir/dc-file_644 [2,head] auth (dversion lock) v=5290 ino=0x10000000479 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945df680] 2023-10-03T19:21:17.199 INFO:teuthology.orchestra.run.smithi045.stdout: -9509> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5292 now clean [inode 0x1000000047a [2,head] /dc-dir/dc-file_645 auth v5292 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.488285+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945f3b80] 2023-10-03T19:21:17.199 INFO:teuthology.orchestra.run.smithi045.stdout: -9508> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000047a) mark_clean [inode 0x1000000047a [2,head] /dc-dir/dc-file_645 auth v5292 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.488285+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945f3b80] 2023-10-03T19:21:17.200 INFO:teuthology.orchestra.run.smithi045.stdout: -9507> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5292 now clean [dentry #0x1/dc-dir/dc-file_645 [2,head] auth (dversion lock) v=5292 ino=0x1000000047a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945df900] 2023-10-03T19:21:17.200 INFO:teuthology.orchestra.run.smithi045.stdout: -9506> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_645) mark_clean [dentry #0x1/dc-dir/dc-file_645 [2,head] auth (dversion lock) v=5292 ino=0x1000000047a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945df900] 2023-10-03T19:21:17.200 INFO:teuthology.orchestra.run.smithi045.stdout: -9505> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5294 now clean [inode 0x1000000047b [2,head] /dc-dir/dc-file_646 auth v5294 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.502775+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945f4100] 2023-10-03T19:21:17.241 INFO:teuthology.orchestra.run.smithi045.stdout: -9504> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000047b) mark_clean [inode 0x1000000047b [2,head] /dc-dir/dc-file_646 auth v5294 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.502775+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945f4100] 2023-10-03T19:21:17.241 INFO:teuthology.orchestra.run.smithi045.stdout: -9503> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5294 now clean [dentry #0x1/dc-dir/dc-file_646 [2,head] auth (dversion lock) v=5294 ino=0x1000000047b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945dfb80] 2023-10-03T19:21:17.241 INFO:teuthology.orchestra.run.smithi045.stdout: -9502> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_646) mark_clean [dentry #0x1/dc-dir/dc-file_646 [2,head] auth (dversion lock) v=5294 ino=0x1000000047b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945dfb80] 2023-10-03T19:21:17.241 INFO:teuthology.orchestra.run.smithi045.stdout: -9501> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5296 now clean [inode 0x1000000047c [2,head] /dc-dir/dc-file_647 auth v5296 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.516655+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945f4680] 2023-10-03T19:21:17.241 INFO:teuthology.orchestra.run.smithi045.stdout: -9500> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000047c) mark_clean [inode 0x1000000047c [2,head] /dc-dir/dc-file_647 auth v5296 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.516655+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945f4680] 2023-10-03T19:21:17.242 INFO:teuthology.orchestra.run.smithi045.stdout: -9499> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5296 now clean [dentry #0x1/dc-dir/dc-file_647 [2,head] auth (dversion lock) v=5296 ino=0x1000000047c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945f6000] 2023-10-03T19:21:17.242 INFO:teuthology.orchestra.run.smithi045.stdout: -9498> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_647) mark_clean [dentry #0x1/dc-dir/dc-file_647 [2,head] auth (dversion lock) v=5296 ino=0x1000000047c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945f6000] 2023-10-03T19:21:17.242 INFO:teuthology.orchestra.run.smithi045.stdout: -9497> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5298 now clean [inode 0x1000000047d [2,head] /dc-dir/dc-file_648 auth v5298 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.529133+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945f4c00] 2023-10-03T19:21:17.242 INFO:teuthology.orchestra.run.smithi045.stdout: -9496> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000047d) mark_clean [inode 0x1000000047d [2,head] /dc-dir/dc-file_648 auth v5298 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.529133+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945f4c00] 2023-10-03T19:21:17.242 INFO:teuthology.orchestra.run.smithi045.stdout: -9495> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5298 now clean [dentry #0x1/dc-dir/dc-file_648 [2,head] auth (dversion lock) v=5298 ino=0x1000000047d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945f6280] 2023-10-03T19:21:17.242 INFO:teuthology.orchestra.run.smithi045.stdout: -9494> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_648) mark_clean [dentry #0x1/dc-dir/dc-file_648 [2,head] auth (dversion lock) v=5298 ino=0x1000000047d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945f6280] 2023-10-03T19:21:17.242 INFO:teuthology.orchestra.run.smithi045.stdout: -9493> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5300 now clean [inode 0x1000000047e [2,head] /dc-dir/dc-file_649 auth v5300 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.540393+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945f5180] 2023-10-03T19:21:17.242 INFO:teuthology.orchestra.run.smithi045.stdout: -9492> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000047e) mark_clean [inode 0x1000000047e [2,head] /dc-dir/dc-file_649 auth v5300 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.540393+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945f5180] 2023-10-03T19:21:17.242 INFO:teuthology.orchestra.run.smithi045.stdout: -9491> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5300 now clean [dentry #0x1/dc-dir/dc-file_649 [2,head] auth (dversion lock) v=5300 ino=0x1000000047e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945f6500] 2023-10-03T19:21:17.242 INFO:teuthology.orchestra.run.smithi045.stdout: -9490> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_649) mark_clean [dentry #0x1/dc-dir/dc-file_649 [2,head] auth (dversion lock) v=5300 ino=0x1000000047e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945f6500] 2023-10-03T19:21:17.242 INFO:teuthology.orchestra.run.smithi045.stdout: -9489> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5302 now clean [inode 0x1000000047f [2,head] /dc-dir/dc-file_650 auth v5302 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.552977+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945f5700] 2023-10-03T19:21:17.243 INFO:teuthology.orchestra.run.smithi045.stdout: -9488> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000047f) mark_clean [inode 0x1000000047f [2,head] /dc-dir/dc-file_650 auth v5302 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.552977+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945f5700] 2023-10-03T19:21:17.243 INFO:teuthology.orchestra.run.smithi045.stdout: -9487> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5302 now clean [dentry #0x1/dc-dir/dc-file_650 [2,head] auth (dversion lock) v=5302 ino=0x1000000047f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945f6780] 2023-10-03T19:21:17.243 INFO:teuthology.orchestra.run.smithi045.stdout: -9486> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_650) mark_clean [dentry #0x1/dc-dir/dc-file_650 [2,head] auth (dversion lock) v=5302 ino=0x1000000047f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945f6780] 2023-10-03T19:21:17.243 INFO:teuthology.orchestra.run.smithi045.stdout: -9485> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5304 now clean [inode 0x10000000480 [2,head] /dc-dir/dc-file_651 auth v5304 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.566453+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945fa000] 2023-10-03T19:21:17.243 INFO:teuthology.orchestra.run.smithi045.stdout: -9484> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000480) mark_clean [inode 0x10000000480 [2,head] /dc-dir/dc-file_651 auth v5304 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.566453+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945fa000] 2023-10-03T19:21:17.243 INFO:teuthology.orchestra.run.smithi045.stdout: -9483> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5304 now clean [dentry #0x1/dc-dir/dc-file_651 [2,head] auth (dversion lock) v=5304 ino=0x10000000480 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945f6a00] 2023-10-03T19:21:17.243 INFO:teuthology.orchestra.run.smithi045.stdout: -9482> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 99 ==== osd_op_reply(1432 10000000361.00000000 [create,setxattr (99),setxattr (30)] v74'21 uv21 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:17.243 INFO:teuthology.orchestra.run.smithi045.stdout: -9481> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_651) mark_clean [dentry #0x1/dc-dir/dc-file_651 [2,head] auth (dversion lock) v=5304 ino=0x10000000480 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945f6a00] 2023-10-03T19:21:17.243 INFO:teuthology.orchestra.run.smithi045.stdout: -9480> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5306 now clean [inode 0x10000000481 [2,head] /dc-dir/dc-file_652 auth v5306 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.578885+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945fa580] 2023-10-03T19:21:17.243 INFO:teuthology.orchestra.run.smithi045.stdout: -9479> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000481) mark_clean [inode 0x10000000481 [2,head] /dc-dir/dc-file_652 auth v5306 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.578885+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945fa580] 2023-10-03T19:21:17.243 INFO:teuthology.orchestra.run.smithi045.stdout: -9478> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5306 now clean [dentry #0x1/dc-dir/dc-file_652 [2,head] auth (dversion lock) v=5306 ino=0x10000000481 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945f6c80] 2023-10-03T19:21:17.244 INFO:teuthology.orchestra.run.smithi045.stdout: -9477> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_652) mark_clean [dentry #0x1/dc-dir/dc-file_652 [2,head] auth (dversion lock) v=5306 ino=0x10000000481 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945f6c80] 2023-10-03T19:21:17.244 INFO:teuthology.orchestra.run.smithi045.stdout: -9476> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5308 now clean [inode 0x10000000482 [2,head] /dc-dir/dc-file_653 auth v5308 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.591419+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945fab00] 2023-10-03T19:21:17.244 INFO:teuthology.orchestra.run.smithi045.stdout: -9475> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000482) mark_clean [inode 0x10000000482 [2,head] /dc-dir/dc-file_653 auth v5308 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.591419+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945fab00] 2023-10-03T19:21:17.244 INFO:teuthology.orchestra.run.smithi045.stdout: -9474> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5308 now clean [dentry #0x1/dc-dir/dc-file_653 [2,head] auth (dversion lock) v=5308 ino=0x10000000482 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945f6f00] 2023-10-03T19:21:17.244 INFO:teuthology.orchestra.run.smithi045.stdout: -9473> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_653) mark_clean [dentry #0x1/dc-dir/dc-file_653 [2,head] auth (dversion lock) v=5308 ino=0x10000000482 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945f6f00] 2023-10-03T19:21:17.244 INFO:teuthology.orchestra.run.smithi045.stdout: -9472> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5310 now clean [inode 0x10000000483 [2,head] /dc-dir/dc-file_654 auth v5310 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.604145+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945fb080] 2023-10-03T19:21:17.244 INFO:teuthology.orchestra.run.smithi045.stdout: -9471> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000483) mark_clean [inode 0x10000000483 [2,head] /dc-dir/dc-file_654 auth v5310 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.604145+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945fb080] 2023-10-03T19:21:17.244 INFO:teuthology.orchestra.run.smithi045.stdout: -9470> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5310 now clean [dentry #0x1/dc-dir/dc-file_654 [2,head] auth (dversion lock) v=5310 ino=0x10000000483 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945f7180] 2023-10-03T19:21:17.244 INFO:teuthology.orchestra.run.smithi045.stdout: -9469> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_654) mark_clean [dentry #0x1/dc-dir/dc-file_654 [2,head] auth (dversion lock) v=5310 ino=0x10000000483 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945f7180] 2023-10-03T19:21:17.244 INFO:teuthology.orchestra.run.smithi045.stdout: -9468> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5312 now clean [inode 0x10000000484 [2,head] /dc-dir/dc-file_655 auth v5312 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.617846+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945fb600] 2023-10-03T19:21:17.244 INFO:teuthology.orchestra.run.smithi045.stdout: -9467> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000484) mark_clean [inode 0x10000000484 [2,head] /dc-dir/dc-file_655 auth v5312 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.617846+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945fb600] 2023-10-03T19:21:17.245 INFO:teuthology.orchestra.run.smithi045.stdout: -9466> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5312 now clean [dentry #0x1/dc-dir/dc-file_655 [2,head] auth (dversion lock) v=5312 ino=0x10000000484 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945f7400] 2023-10-03T19:21:17.245 INFO:teuthology.orchestra.run.smithi045.stdout: -9465> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_655) mark_clean [dentry #0x1/dc-dir/dc-file_655 [2,head] auth (dversion lock) v=5312 ino=0x10000000484 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945f7400] 2023-10-03T19:21:17.245 INFO:teuthology.orchestra.run.smithi045.stdout: -9464> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5314 now clean [inode 0x10000000485 [2,head] /dc-dir/dc-file_656 auth v5314 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.630102+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945fbb80] 2023-10-03T19:21:17.245 INFO:teuthology.orchestra.run.smithi045.stdout: -9463> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000485) mark_clean [inode 0x10000000485 [2,head] /dc-dir/dc-file_656 auth v5314 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.630102+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945fbb80] 2023-10-03T19:21:17.245 INFO:teuthology.orchestra.run.smithi045.stdout: -9462> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5314 now clean [dentry #0x1/dc-dir/dc-file_656 [2,head] auth (dversion lock) v=5314 ino=0x10000000485 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945f7680] 2023-10-03T19:21:17.245 INFO:teuthology.orchestra.run.smithi045.stdout: -9461> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_656) mark_clean [dentry #0x1/dc-dir/dc-file_656 [2,head] auth (dversion lock) v=5314 ino=0x10000000485 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945f7680] 2023-10-03T19:21:17.245 INFO:teuthology.orchestra.run.smithi045.stdout: -9460> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5316 now clean [inode 0x10000000486 [2,head] /dc-dir/dc-file_657 auth v5316 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.643412+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945fc100] 2023-10-03T19:21:17.245 INFO:teuthology.orchestra.run.smithi045.stdout: -9459> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000486) mark_clean [inode 0x10000000486 [2,head] /dc-dir/dc-file_657 auth v5316 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.643412+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945fc100] 2023-10-03T19:21:17.245 INFO:teuthology.orchestra.run.smithi045.stdout: -9458> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5316 now clean [dentry #0x1/dc-dir/dc-file_657 [2,head] auth (dversion lock) v=5316 ino=0x10000000486 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945f7900] 2023-10-03T19:21:17.245 INFO:teuthology.orchestra.run.smithi045.stdout: -9457> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_657) mark_clean [dentry #0x1/dc-dir/dc-file_657 [2,head] auth (dversion lock) v=5316 ino=0x10000000486 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945f7900] 2023-10-03T19:21:17.245 INFO:teuthology.orchestra.run.smithi045.stdout: -9456> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5318 now clean [inode 0x10000000487 [2,head] /dc-dir/dc-file_658 auth v5318 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.655883+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945fc680] 2023-10-03T19:21:17.245 INFO:teuthology.orchestra.run.smithi045.stdout: -9455> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000487) mark_clean [inode 0x10000000487 [2,head] /dc-dir/dc-file_658 auth v5318 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.655883+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945fc680] 2023-10-03T19:21:17.246 INFO:teuthology.orchestra.run.smithi045.stdout: -9454> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5318 now clean [dentry #0x1/dc-dir/dc-file_658 [2,head] auth (dversion lock) v=5318 ino=0x10000000487 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945f7b80] 2023-10-03T19:21:17.246 INFO:teuthology.orchestra.run.smithi045.stdout: -9453> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_658) mark_clean [dentry #0x1/dc-dir/dc-file_658 [2,head] auth (dversion lock) v=5318 ino=0x10000000487 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc945f7b80] 2023-10-03T19:21:17.246 INFO:teuthology.orchestra.run.smithi045.stdout: -9452> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5320 now clean [inode 0x10000000488 [2,head] /dc-dir/dc-file_659 auth v5320 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.667674+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945fcc00] 2023-10-03T19:21:17.246 INFO:teuthology.orchestra.run.smithi045.stdout: -9451> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000488) mark_clean [inode 0x10000000488 [2,head] /dc-dir/dc-file_659 auth v5320 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.667674+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945fcc00] 2023-10-03T19:21:17.246 INFO:teuthology.orchestra.run.smithi045.stdout: -9450> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5320 now clean [dentry #0x1/dc-dir/dc-file_659 [2,head] auth (dversion lock) v=5320 ino=0x10000000488 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94602000] 2023-10-03T19:21:17.246 INFO:teuthology.orchestra.run.smithi045.stdout: -9449> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_659) mark_clean [dentry #0x1/dc-dir/dc-file_659 [2,head] auth (dversion lock) v=5320 ino=0x10000000488 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94602000] 2023-10-03T19:21:17.246 INFO:teuthology.orchestra.run.smithi045.stdout: -9448> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5322 now clean [inode 0x10000000489 [2,head] /dc-dir/dc-file_660 auth v5322 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.679313+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945fd180] 2023-10-03T19:21:17.246 INFO:teuthology.orchestra.run.smithi045.stdout: -9447> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000489) mark_clean [inode 0x10000000489 [2,head] /dc-dir/dc-file_660 auth v5322 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.679313+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945fd180] 2023-10-03T19:21:17.246 INFO:teuthology.orchestra.run.smithi045.stdout: -9446> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5322 now clean [dentry #0x1/dc-dir/dc-file_660 [2,head] auth (dversion lock) v=5322 ino=0x10000000489 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94602280] 2023-10-03T19:21:17.246 INFO:teuthology.orchestra.run.smithi045.stdout: -9445> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_660) mark_clean [dentry #0x1/dc-dir/dc-file_660 [2,head] auth (dversion lock) v=5322 ino=0x10000000489 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94602280] 2023-10-03T19:21:17.247 INFO:teuthology.orchestra.run.smithi045.stdout: -9444> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5324 now clean [inode 0x1000000048a [2,head] /dc-dir/dc-file_661 auth v5324 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.691279+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945fd700] 2023-10-03T19:21:17.247 INFO:teuthology.orchestra.run.smithi045.stdout: -9443> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000048a) mark_clean [inode 0x1000000048a [2,head] /dc-dir/dc-file_661 auth v5324 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.691279+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc945fd700] 2023-10-03T19:21:17.247 INFO:teuthology.orchestra.run.smithi045.stdout: -9442> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5324 now clean [dentry #0x1/dc-dir/dc-file_661 [2,head] auth (dversion lock) v=5324 ino=0x1000000048a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94602500] 2023-10-03T19:21:17.247 INFO:teuthology.orchestra.run.smithi045.stdout: -9441> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_661) mark_clean [dentry #0x1/dc-dir/dc-file_661 [2,head] auth (dversion lock) v=5324 ino=0x1000000048a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94602500] 2023-10-03T19:21:17.247 INFO:teuthology.orchestra.run.smithi045.stdout: -9440> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5326 now clean [inode 0x1000000048b [2,head] /dc-dir/dc-file_662 auth v5326 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.704389+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94606000] 2023-10-03T19:21:17.247 INFO:teuthology.orchestra.run.smithi045.stdout: -9439> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000048b) mark_clean [inode 0x1000000048b [2,head] /dc-dir/dc-file_662 auth v5326 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.704389+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94606000] 2023-10-03T19:21:17.247 INFO:teuthology.orchestra.run.smithi045.stdout: -9438> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5326 now clean [dentry #0x1/dc-dir/dc-file_662 [2,head] auth (dversion lock) v=5326 ino=0x1000000048b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94602780] 2023-10-03T19:21:17.247 INFO:teuthology.orchestra.run.smithi045.stdout: -9437> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_662) mark_clean [dentry #0x1/dc-dir/dc-file_662 [2,head] auth (dversion lock) v=5326 ino=0x1000000048b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94602780] 2023-10-03T19:21:17.247 INFO:teuthology.orchestra.run.smithi045.stdout: -9436> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5328 now clean [inode 0x1000000048c [2,head] /dc-dir/dc-file_663 auth v5328 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.717211+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94606580] 2023-10-03T19:21:17.247 INFO:teuthology.orchestra.run.smithi045.stdout: -9435> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000048c) mark_clean [inode 0x1000000048c [2,head] /dc-dir/dc-file_663 auth v5328 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.717211+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94606580] 2023-10-03T19:21:17.247 INFO:teuthology.orchestra.run.smithi045.stdout: -9434> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5328 now clean [dentry #0x1/dc-dir/dc-file_663 [2,head] auth (dversion lock) v=5328 ino=0x1000000048c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94602a00] 2023-10-03T19:21:17.331 INFO:teuthology.orchestra.run.smithi045.stdout: -9433> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_663) mark_clean [dentry #0x1/dc-dir/dc-file_663 [2,head] auth (dversion lock) v=5328 ino=0x1000000048c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94602a00] 2023-10-03T19:21:17.331 INFO:teuthology.orchestra.run.smithi045.stdout: -9432> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5330 now clean [inode 0x1000000048d [2,head] /dc-dir/dc-file_664 auth v5330 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.730376+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94606b00] 2023-10-03T19:21:17.331 INFO:teuthology.orchestra.run.smithi045.stdout: -9431> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000048d) mark_clean [inode 0x1000000048d [2,head] /dc-dir/dc-file_664 auth v5330 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.730376+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94606b00] 2023-10-03T19:21:17.331 INFO:teuthology.orchestra.run.smithi045.stdout: -9430> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5330 now clean [dentry #0x1/dc-dir/dc-file_664 [2,head] auth (dversion lock) v=5330 ino=0x1000000048d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94602c80] 2023-10-03T19:21:17.331 INFO:teuthology.orchestra.run.smithi045.stdout: -9429> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_664) mark_clean [dentry #0x1/dc-dir/dc-file_664 [2,head] auth (dversion lock) v=5330 ino=0x1000000048d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94602c80] 2023-10-03T19:21:17.331 INFO:teuthology.orchestra.run.smithi045.stdout: -9428> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5332 now clean [inode 0x1000000048e [2,head] /dc-dir/dc-file_665 auth v5332 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.742380+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94607080] 2023-10-03T19:21:17.332 INFO:teuthology.orchestra.run.smithi045.stdout: -9427> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000048e) mark_clean [inode 0x1000000048e [2,head] /dc-dir/dc-file_665 auth v5332 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.742380+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94607080] 2023-10-03T19:21:17.332 INFO:teuthology.orchestra.run.smithi045.stdout: -9426> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5332 now clean [dentry #0x1/dc-dir/dc-file_665 [2,head] auth (dversion lock) v=5332 ino=0x1000000048e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94602f00] 2023-10-03T19:21:17.332 INFO:teuthology.orchestra.run.smithi045.stdout: -9425> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_665) mark_clean [dentry #0x1/dc-dir/dc-file_665 [2,head] auth (dversion lock) v=5332 ino=0x1000000048e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94602f00] 2023-10-03T19:21:17.332 INFO:teuthology.orchestra.run.smithi045.stdout: -9424> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5334 now clean [inode 0x1000000048f [2,head] /dc-dir/dc-file_666 auth v5334 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.754773+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94607600] 2023-10-03T19:21:17.332 INFO:teuthology.orchestra.run.smithi045.stdout: -9423> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000048f) mark_clean [inode 0x1000000048f [2,head] /dc-dir/dc-file_666 auth v5334 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.754773+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94607600] 2023-10-03T19:21:17.332 INFO:teuthology.orchestra.run.smithi045.stdout: -9422> 2023-10-03T19:18:09.829+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 119 ==== osd_op_reply(1282 100000002cb.00000000 [create,setxattr (99),setxattr (30)] v74'25 uv25 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:17.332 INFO:teuthology.orchestra.run.smithi045.stdout: -9421> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5334 now clean [dentry #0x1/dc-dir/dc-file_666 [2,head] auth (dversion lock) v=5334 ino=0x1000000048f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94603180] 2023-10-03T19:21:17.332 INFO:teuthology.orchestra.run.smithi045.stdout: -9420> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_666) mark_clean [dentry #0x1/dc-dir/dc-file_666 [2,head] auth (dversion lock) v=5334 ino=0x1000000048f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94603180] 2023-10-03T19:21:17.332 INFO:teuthology.orchestra.run.smithi045.stdout: -9419> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5336 now clean [inode 0x10000000490 [2,head] /dc-dir/dc-file_667 auth v5336 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.767403+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94607b80] 2023-10-03T19:21:17.332 INFO:teuthology.orchestra.run.smithi045.stdout: -9418> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000490) mark_clean [inode 0x10000000490 [2,head] /dc-dir/dc-file_667 auth v5336 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.767403+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94607b80] 2023-10-03T19:21:17.332 INFO:teuthology.orchestra.run.smithi045.stdout: -9417> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5336 now clean [dentry #0x1/dc-dir/dc-file_667 [2,head] auth (dversion lock) v=5336 ino=0x10000000490 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94603400] 2023-10-03T19:21:17.333 INFO:teuthology.orchestra.run.smithi045.stdout: -9416> 2023-10-03T19:18:09.829+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 120 ==== osd_op_reply(1396 1000000033d.00000000 [create,setxattr (99),setxattr (30)] v74'26 uv26 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:17.333 INFO:teuthology.orchestra.run.smithi045.stdout: -9415> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_667) mark_clean [dentry #0x1/dc-dir/dc-file_667 [2,head] auth (dversion lock) v=5336 ino=0x10000000490 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94603400] 2023-10-03T19:21:17.333 INFO:teuthology.orchestra.run.smithi045.stdout: -9414> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5338 now clean [inode 0x10000000491 [2,head] /dc-dir/dc-file_668 auth v5338 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.779255+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94608100] 2023-10-03T19:21:17.333 INFO:teuthology.orchestra.run.smithi045.stdout: -9413> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000491) mark_clean [inode 0x10000000491 [2,head] /dc-dir/dc-file_668 auth v5338 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.779255+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94608100] 2023-10-03T19:21:17.333 INFO:teuthology.orchestra.run.smithi045.stdout: -9412> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5338 now clean [dentry #0x1/dc-dir/dc-file_668 [2,head] auth (dversion lock) v=5338 ino=0x10000000491 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94603680] 2023-10-03T19:21:17.333 INFO:teuthology.orchestra.run.smithi045.stdout: -9411> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_668) mark_clean [dentry #0x1/dc-dir/dc-file_668 [2,head] auth (dversion lock) v=5338 ino=0x10000000491 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94603680] 2023-10-03T19:21:17.333 INFO:teuthology.orchestra.run.smithi045.stdout: -9410> 2023-10-03T19:18:09.829+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 121 ==== osd_op_reply(1450 10000000373.00000000 [create,setxattr (99),setxattr (30)] v74'27 uv27 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:17.333 INFO:teuthology.orchestra.run.smithi045.stdout: -9409> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5340 now clean [inode 0x10000000492 [2,head] /dc-dir/dc-file_669 auth v5340 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.791463+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94608680] 2023-10-03T19:21:17.333 INFO:teuthology.orchestra.run.smithi045.stdout: -9408> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000492) mark_clean [inode 0x10000000492 [2,head] /dc-dir/dc-file_669 auth v5340 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.791463+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94608680] 2023-10-03T19:21:17.333 INFO:teuthology.orchestra.run.smithi045.stdout: -9407> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5340 now clean [dentry #0x1/dc-dir/dc-file_669 [2,head] auth (dversion lock) v=5340 ino=0x10000000492 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94603900] 2023-10-03T19:21:17.333 INFO:teuthology.orchestra.run.smithi045.stdout: -9406> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_669) mark_clean [dentry #0x1/dc-dir/dc-file_669 [2,head] auth (dversion lock) v=5340 ino=0x10000000492 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94603900] 2023-10-03T19:21:17.333 INFO:teuthology.orchestra.run.smithi045.stdout: -9405> 2023-10-03T19:18:09.829+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 122 ==== osd_op_reply(1539 100000003cc.00000000 [create,setxattr (99),setxattr (30)] v74'28 uv28 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:17.334 INFO:teuthology.orchestra.run.smithi045.stdout: -9404> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5342 now clean [inode 0x10000000493 [2,head] /dc-dir/dc-file_670 auth v5342 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.804480+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94608c00] 2023-10-03T19:21:17.334 INFO:teuthology.orchestra.run.smithi045.stdout: -9403> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000493) mark_clean [inode 0x10000000493 [2,head] /dc-dir/dc-file_670 auth v5342 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.804480+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94608c00] 2023-10-03T19:21:17.334 INFO:teuthology.orchestra.run.smithi045.stdout: -9402> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5342 now clean [dentry #0x1/dc-dir/dc-file_670 [2,head] auth (dversion lock) v=5342 ino=0x10000000493 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94603b80] 2023-10-03T19:21:17.334 INFO:teuthology.orchestra.run.smithi045.stdout: -9401> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_670) mark_clean [dentry #0x1/dc-dir/dc-file_670 [2,head] auth (dversion lock) v=5342 ino=0x10000000493 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94603b80] 2023-10-03T19:21:17.334 INFO:teuthology.orchestra.run.smithi045.stdout: -9400> 2023-10-03T19:18:09.829+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 123 ==== osd_op_reply(1557 100000003de.00000000 [create,setxattr (99),setxattr (30)] v74'29 uv29 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:17.334 INFO:teuthology.orchestra.run.smithi045.stdout: -9399> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5344 now clean [inode 0x10000000494 [2,head] /dc-dir/dc-file_671 auth v5344 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.816519+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94609180] 2023-10-03T19:21:17.334 INFO:teuthology.orchestra.run.smithi045.stdout: -9398> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000494) mark_clean [inode 0x10000000494 [2,head] /dc-dir/dc-file_671 auth v5344 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.816519+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94609180] 2023-10-03T19:21:17.334 INFO:teuthology.orchestra.run.smithi045.stdout: -9397> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5344 now clean [dentry #0x1/dc-dir/dc-file_671 [2,head] auth (dversion lock) v=5344 ino=0x10000000494 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94610000] 2023-10-03T19:21:17.334 INFO:teuthology.orchestra.run.smithi045.stdout: -9396> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_671) mark_clean [dentry #0x1/dc-dir/dc-file_671 [2,head] auth (dversion lock) v=5344 ino=0x10000000494 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94610000] 2023-10-03T19:21:17.334 INFO:teuthology.orchestra.run.smithi045.stdout: -9395> 2023-10-03T19:18:09.829+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 124 ==== osd_op_reply(1586 100000003fb.00000000 [create,setxattr (99),setxattr (30)] v74'30 uv30 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:17.334 INFO:teuthology.orchestra.run.smithi045.stdout: -9394> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5346 now clean [inode 0x10000000495 [2,head] /dc-dir/dc-file_672 auth v5346 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.828245+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94609700] 2023-10-03T19:21:17.335 INFO:teuthology.orchestra.run.smithi045.stdout: -9393> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000495) mark_clean [inode 0x10000000495 [2,head] /dc-dir/dc-file_672 auth v5346 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.828245+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94609700] 2023-10-03T19:21:17.335 INFO:teuthology.orchestra.run.smithi045.stdout: -9392> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5346 now clean [dentry #0x1/dc-dir/dc-file_672 [2,head] auth (dversion lock) v=5346 ino=0x10000000495 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94610280] 2023-10-03T19:21:17.335 INFO:teuthology.orchestra.run.smithi045.stdout: -9391> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_672) mark_clean [dentry #0x1/dc-dir/dc-file_672 [2,head] auth (dversion lock) v=5346 ino=0x10000000495 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94610280] 2023-10-03T19:21:17.335 INFO:teuthology.orchestra.run.smithi045.stdout: -9390> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5348 now clean [inode 0x10000000496 [2,head] /dc-dir/dc-file_673 auth v5348 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.840524+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94612000] 2023-10-03T19:21:17.335 INFO:teuthology.orchestra.run.smithi045.stdout: -9389> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000496) mark_clean [inode 0x10000000496 [2,head] /dc-dir/dc-file_673 auth v5348 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.840524+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94612000] 2023-10-03T19:21:17.335 INFO:teuthology.orchestra.run.smithi045.stdout: -9388> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5348 now clean [dentry #0x1/dc-dir/dc-file_673 [2,head] auth (dversion lock) v=5348 ino=0x10000000496 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94610500] 2023-10-03T19:21:17.335 INFO:teuthology.orchestra.run.smithi045.stdout: -9387> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_673) mark_clean [dentry #0x1/dc-dir/dc-file_673 [2,head] auth (dversion lock) v=5348 ino=0x10000000496 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94610500] 2023-10-03T19:21:17.335 INFO:teuthology.orchestra.run.smithi045.stdout: -9386> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5350 now clean [inode 0x10000000497 [2,head] /dc-dir/dc-file_674 auth v5350 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.851795+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94612580] 2023-10-03T19:21:17.335 INFO:teuthology.orchestra.run.smithi045.stdout: -9385> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000497) mark_clean [inode 0x10000000497 [2,head] /dc-dir/dc-file_674 auth v5350 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.851795+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94612580] 2023-10-03T19:21:17.335 INFO:teuthology.orchestra.run.smithi045.stdout: -9384> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5350 now clean [dentry #0x1/dc-dir/dc-file_674 [2,head] auth (dversion lock) v=5350 ino=0x10000000497 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94610780] 2023-10-03T19:21:17.335 INFO:teuthology.orchestra.run.smithi045.stdout: -9383> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_674) mark_clean [dentry #0x1/dc-dir/dc-file_674 [2,head] auth (dversion lock) v=5350 ino=0x10000000497 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94610780] 2023-10-03T19:21:17.336 INFO:teuthology.orchestra.run.smithi045.stdout: -9382> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5352 now clean [inode 0x10000000498 [2,head] /dc-dir/dc-file_675 auth v5352 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.863775+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94612b00] 2023-10-03T19:21:17.336 INFO:teuthology.orchestra.run.smithi045.stdout: -9381> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000498) mark_clean [inode 0x10000000498 [2,head] /dc-dir/dc-file_675 auth v5352 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.863775+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94612b00] 2023-10-03T19:21:17.336 INFO:teuthology.orchestra.run.smithi045.stdout: -9380> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5352 now clean [dentry #0x1/dc-dir/dc-file_675 [2,head] auth (dversion lock) v=5352 ino=0x10000000498 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94610a00] 2023-10-03T19:21:17.336 INFO:teuthology.orchestra.run.smithi045.stdout: -9379> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_675) mark_clean [dentry #0x1/dc-dir/dc-file_675 [2,head] auth (dversion lock) v=5352 ino=0x10000000498 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94610a00] 2023-10-03T19:21:17.336 INFO:teuthology.orchestra.run.smithi045.stdout: -9378> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5354 now clean [inode 0x10000000499 [2,head] /dc-dir/dc-file_676 auth v5354 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.875771+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94613080] 2023-10-03T19:21:17.336 INFO:teuthology.orchestra.run.smithi045.stdout: -9377> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000499) mark_clean [inode 0x10000000499 [2,head] /dc-dir/dc-file_676 auth v5354 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.875771+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94613080] 2023-10-03T19:21:17.336 INFO:teuthology.orchestra.run.smithi045.stdout: -9376> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5354 now clean [dentry #0x1/dc-dir/dc-file_676 [2,head] auth (dversion lock) v=5354 ino=0x10000000499 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94610c80] 2023-10-03T19:21:17.336 INFO:teuthology.orchestra.run.smithi045.stdout: -9375> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_676) mark_clean [dentry #0x1/dc-dir/dc-file_676 [2,head] auth (dversion lock) v=5354 ino=0x10000000499 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94610c80] 2023-10-03T19:21:17.336 INFO:teuthology.orchestra.run.smithi045.stdout: -9374> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5356 now clean [inode 0x1000000049a [2,head] /dc-dir/dc-file_677 auth v5356 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.888241+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94613600] 2023-10-03T19:21:17.336 INFO:teuthology.orchestra.run.smithi045.stdout: -9373> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000049a) mark_clean [inode 0x1000000049a [2,head] /dc-dir/dc-file_677 auth v5356 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.888241+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94613600] 2023-10-03T19:21:17.336 INFO:teuthology.orchestra.run.smithi045.stdout: -9372> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5356 now clean [dentry #0x1/dc-dir/dc-file_677 [2,head] auth (dversion lock) v=5356 ino=0x1000000049a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94610f00] 2023-10-03T19:21:17.337 INFO:teuthology.orchestra.run.smithi045.stdout: -9371> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_677) mark_clean [dentry #0x1/dc-dir/dc-file_677 [2,head] auth (dversion lock) v=5356 ino=0x1000000049a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94610f00] 2023-10-03T19:21:17.337 INFO:teuthology.orchestra.run.smithi045.stdout: -9370> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5358 now clean [inode 0x1000000049b [2,head] /dc-dir/dc-file_678 auth v5358 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.900022+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94613b80] 2023-10-03T19:21:17.337 INFO:teuthology.orchestra.run.smithi045.stdout: -9369> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000049b) mark_clean [inode 0x1000000049b [2,head] /dc-dir/dc-file_678 auth v5358 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.900022+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94613b80] 2023-10-03T19:21:17.381 INFO:teuthology.orchestra.run.smithi045.stdout: -9368> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5358 now clean [dentry #0x1/dc-dir/dc-file_678 [2,head] auth (dversion lock) v=5358 ino=0x1000000049b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94611180] 2023-10-03T19:21:17.381 INFO:teuthology.orchestra.run.smithi045.stdout: -9367> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_678) mark_clean [dentry #0x1/dc-dir/dc-file_678 [2,head] auth (dversion lock) v=5358 ino=0x1000000049b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94611180] 2023-10-03T19:21:17.381 INFO:teuthology.orchestra.run.smithi045.stdout: -9366> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5360 now clean [inode 0x1000000049c [2,head] /dc-dir/dc-file_679 auth v5360 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.911862+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94614100] 2023-10-03T19:21:17.381 INFO:teuthology.orchestra.run.smithi045.stdout: -9365> 2023-10-03T19:18:09.829+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 287 ==== osd_op_reply(2055 100000005cf.00000000 [create,setxattr (99),setxattr (30)] v74'36 uv36 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.381 INFO:teuthology.orchestra.run.smithi045.stdout: -9364> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000049c) mark_clean [inode 0x1000000049c [2,head] /dc-dir/dc-file_679 auth v5360 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.911862+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94614100] 2023-10-03T19:21:17.381 INFO:teuthology.orchestra.run.smithi045.stdout: -9363> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5360 now clean [dentry #0x1/dc-dir/dc-file_679 [2,head] auth (dversion lock) v=5360 ino=0x1000000049c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94611400] 2023-10-03T19:21:17.381 INFO:teuthology.orchestra.run.smithi045.stdout: -9362> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_679) mark_clean [dentry #0x1/dc-dir/dc-file_679 [2,head] auth (dversion lock) v=5360 ino=0x1000000049c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94611400] 2023-10-03T19:21:17.381 INFO:teuthology.orchestra.run.smithi045.stdout: -9361> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5362 now clean [inode 0x1000000049d [2,head] /dc-dir/dc-file_680 auth v5362 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.924086+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94614680] 2023-10-03T19:21:17.381 INFO:teuthology.orchestra.run.smithi045.stdout: -9360> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000049d) mark_clean [inode 0x1000000049d [2,head] /dc-dir/dc-file_680 auth v5362 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.924086+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94614680] 2023-10-03T19:21:17.381 INFO:teuthology.orchestra.run.smithi045.stdout: -9359> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5362 now clean [dentry #0x1/dc-dir/dc-file_680 [2,head] auth (dversion lock) v=5362 ino=0x1000000049d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94611680] 2023-10-03T19:21:17.382 INFO:teuthology.orchestra.run.smithi045.stdout: -9358> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_680) mark_clean [dentry #0x1/dc-dir/dc-file_680 [2,head] auth (dversion lock) v=5362 ino=0x1000000049d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94611680] 2023-10-03T19:21:17.382 INFO:teuthology.orchestra.run.smithi045.stdout: -9357> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5364 now clean [inode 0x1000000049e [2,head] /dc-dir/dc-file_681 auth v5364 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.936013+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94614c00] 2023-10-03T19:21:17.382 INFO:teuthology.orchestra.run.smithi045.stdout: -9356> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000049e) mark_clean [inode 0x1000000049e [2,head] /dc-dir/dc-file_681 auth v5364 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.936013+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94614c00] 2023-10-03T19:21:17.382 INFO:teuthology.orchestra.run.smithi045.stdout: -9355> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5364 now clean [dentry #0x1/dc-dir/dc-file_681 [2,head] auth (dversion lock) v=5364 ino=0x1000000049e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94611900] 2023-10-03T19:21:17.382 INFO:teuthology.orchestra.run.smithi045.stdout: -9354> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_681) mark_clean [dentry #0x1/dc-dir/dc-file_681 [2,head] auth (dversion lock) v=5364 ino=0x1000000049e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94611900] 2023-10-03T19:21:17.382 INFO:teuthology.orchestra.run.smithi045.stdout: -9353> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5366 now clean [inode 0x1000000049f [2,head] /dc-dir/dc-file_682 auth v5366 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.947591+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94615180] 2023-10-03T19:21:17.382 INFO:teuthology.orchestra.run.smithi045.stdout: -9352> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000049f) mark_clean [inode 0x1000000049f [2,head] /dc-dir/dc-file_682 auth v5366 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.947591+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94615180] 2023-10-03T19:21:17.382 INFO:teuthology.orchestra.run.smithi045.stdout: -9351> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5366 now clean [dentry #0x1/dc-dir/dc-file_682 [2,head] auth (dversion lock) v=5366 ino=0x1000000049f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94611b80] 2023-10-03T19:21:17.382 INFO:teuthology.orchestra.run.smithi045.stdout: -9350> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_682) mark_clean [dentry #0x1/dc-dir/dc-file_682 [2,head] auth (dversion lock) v=5366 ino=0x1000000049f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94611b80] 2023-10-03T19:21:17.382 INFO:teuthology.orchestra.run.smithi045.stdout: -9349> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5368 now clean [inode 0x100000004a0 [2,head] /dc-dir/dc-file_683 auth v5368 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.959542+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94615700] 2023-10-03T19:21:17.383 INFO:teuthology.orchestra.run.smithi045.stdout: -9348> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a0) mark_clean [inode 0x100000004a0 [2,head] /dc-dir/dc-file_683 auth v5368 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.959542+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94615700] 2023-10-03T19:21:17.383 INFO:teuthology.orchestra.run.smithi045.stdout: -9347> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5368 now clean [dentry #0x1/dc-dir/dc-file_683 [2,head] auth (dversion lock) v=5368 ino=0x100000004a0 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94618000] 2023-10-03T19:21:17.383 INFO:teuthology.orchestra.run.smithi045.stdout: -9346> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_683) mark_clean [dentry #0x1/dc-dir/dc-file_683 [2,head] auth (dversion lock) v=5368 ino=0x100000004a0 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94618000] 2023-10-03T19:21:17.383 INFO:teuthology.orchestra.run.smithi045.stdout: -9345> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5370 now clean [inode 0x100000004a1 [2,head] /dc-dir/dc-file_684 auth v5370 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.971994+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9461a000] 2023-10-03T19:21:17.383 INFO:teuthology.orchestra.run.smithi045.stdout: -9344> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a1) mark_clean [inode 0x100000004a1 [2,head] /dc-dir/dc-file_684 auth v5370 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.971994+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9461a000] 2023-10-03T19:21:17.383 INFO:teuthology.orchestra.run.smithi045.stdout: -9343> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5370 now clean [dentry #0x1/dc-dir/dc-file_684 [2,head] auth (dversion lock) v=5370 ino=0x100000004a1 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94618280] 2023-10-03T19:21:17.383 INFO:teuthology.orchestra.run.smithi045.stdout: -9342> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_684) mark_clean [dentry #0x1/dc-dir/dc-file_684 [2,head] auth (dversion lock) v=5370 ino=0x100000004a1 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94618280] 2023-10-03T19:21:17.383 INFO:teuthology.orchestra.run.smithi045.stdout: -9341> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5372 now clean [inode 0x100000004a2 [2,head] /dc-dir/dc-file_685 auth v5372 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.984597+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9461a580] 2023-10-03T19:21:17.383 INFO:teuthology.orchestra.run.smithi045.stdout: -9340> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a2) mark_clean [inode 0x100000004a2 [2,head] /dc-dir/dc-file_685 auth v5372 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.984597+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9461a580] 2023-10-03T19:21:17.384 INFO:teuthology.orchestra.run.smithi045.stdout: -9339> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 100 ==== osd_op_reply(1195 10000000274.00000000 [create,setxattr (99),setxattr (30)] v74'20 uv20 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:17.384 INFO:teuthology.orchestra.run.smithi045.stdout: -9338> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5372 now clean [dentry #0x1/dc-dir/dc-file_685 [2,head] auth (dversion lock) v=5372 ino=0x100000004a2 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94618500] 2023-10-03T19:21:17.384 INFO:teuthology.orchestra.run.smithi045.stdout: -9337> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_685) mark_clean [dentry #0x1/dc-dir/dc-file_685 [2,head] auth (dversion lock) v=5372 ino=0x100000004a2 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94618500] 2023-10-03T19:21:17.384 INFO:teuthology.orchestra.run.smithi045.stdout: -9336> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5374 now clean [inode 0x100000004a3 [2,head] /dc-dir/dc-file_686 auth v5374 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.997339+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9461ab00] 2023-10-03T19:21:17.384 INFO:teuthology.orchestra.run.smithi045.stdout: -9335> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a3) mark_clean [inode 0x100000004a3 [2,head] /dc-dir/dc-file_686 auth v5374 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.997339+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9461ab00] 2023-10-03T19:21:17.384 INFO:teuthology.orchestra.run.smithi045.stdout: -9334> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5374 now clean [dentry #0x1/dc-dir/dc-file_686 [2,head] auth (dversion lock) v=5374 ino=0x100000004a3 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94618780] 2023-10-03T19:21:17.384 INFO:teuthology.orchestra.run.smithi045.stdout: -9333> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 101 ==== osd_op_reply(1360 10000000319.00000000 [create,setxattr (99),setxattr (30)] v74'23 uv23 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:17.384 INFO:teuthology.orchestra.run.smithi045.stdout: -9332> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_686) mark_clean [dentry #0x1/dc-dir/dc-file_686 [2,head] auth (dversion lock) v=5374 ino=0x100000004a3 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94618780] 2023-10-03T19:21:17.384 INFO:teuthology.orchestra.run.smithi045.stdout: -9331> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5376 now clean [inode 0x100000004a4 [2,head] /dc-dir/dc-file_687 auth v5376 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.009142+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9461b080] 2023-10-03T19:21:17.384 INFO:teuthology.orchestra.run.smithi045.stdout: -9330> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 102 ==== osd_op_reply(1433 10000000362.00000000 [create,setxattr (99),setxattr (30)] v74'23 uv23 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:17.384 INFO:teuthology.orchestra.run.smithi045.stdout: -9329> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a4) mark_clean [inode 0x100000004a4 [2,head] /dc-dir/dc-file_687 auth v5376 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.009142+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9461b080] 2023-10-03T19:21:17.384 INFO:teuthology.orchestra.run.smithi045.stdout: -9328> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5376 now clean [dentry #0x1/dc-dir/dc-file_687 [2,head] auth (dversion lock) v=5376 ino=0x100000004a4 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94618a00] 2023-10-03T19:21:17.385 INFO:teuthology.orchestra.run.smithi045.stdout: -9327> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_687) mark_clean [dentry #0x1/dc-dir/dc-file_687 [2,head] auth (dversion lock) v=5376 ino=0x100000004a4 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94618a00] 2023-10-03T19:21:17.385 INFO:teuthology.orchestra.run.smithi045.stdout: -9326> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5378 now clean [inode 0x100000004a5 [2,head] /dc-dir/dc-file_688 auth v5378 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.020845+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9461b600] 2023-10-03T19:21:17.385 INFO:teuthology.orchestra.run.smithi045.stdout: -9325> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a5) mark_clean [inode 0x100000004a5 [2,head] /dc-dir/dc-file_688 auth v5378 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.020845+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9461b600] 2023-10-03T19:21:17.385 INFO:teuthology.orchestra.run.smithi045.stdout: -9324> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5378 now clean [dentry #0x1/dc-dir/dc-file_688 [2,head] auth (dversion lock) v=5378 ino=0x100000004a5 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94618c80] 2023-10-03T19:21:17.385 INFO:teuthology.orchestra.run.smithi045.stdout: -9323> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_688) mark_clean [dentry #0x1/dc-dir/dc-file_688 [2,head] auth (dversion lock) v=5378 ino=0x100000004a5 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94618c80] 2023-10-03T19:21:17.385 INFO:teuthology.orchestra.run.smithi045.stdout: -9322> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 52 ==== osd_op_reply(1967 10000000577.00000000 [create,setxattr (99),setxattr (30)] v74'34 uv34 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:17.385 INFO:teuthology.orchestra.run.smithi045.stdout: -9321> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5380 now clean [inode 0x100000004a6 [2,head] /dc-dir/dc-file_689 auth v5380 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.032514+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9461bb80] 2023-10-03T19:21:17.385 INFO:teuthology.orchestra.run.smithi045.stdout: -9320> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a6) mark_clean [inode 0x100000004a6 [2,head] /dc-dir/dc-file_689 auth v5380 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.032514+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9461bb80] 2023-10-03T19:21:17.385 INFO:teuthology.orchestra.run.smithi045.stdout: -9319> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5380 now clean [dentry #0x1/dc-dir/dc-file_689 [2,head] auth (dversion lock) v=5380 ino=0x100000004a6 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94618f00] 2023-10-03T19:21:17.385 INFO:teuthology.orchestra.run.smithi045.stdout: -9318> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_689) mark_clean [dentry #0x1/dc-dir/dc-file_689 [2,head] auth (dversion lock) v=5380 ino=0x100000004a6 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94618f00] 2023-10-03T19:21:17.385 INFO:teuthology.orchestra.run.smithi045.stdout: -9317> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5382 now clean [inode 0x100000004a7 [2,head] /dc-dir/dc-file_690 auth v5382 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.044237+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9461c100] 2023-10-03T19:21:17.386 INFO:teuthology.orchestra.run.smithi045.stdout: -9316> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a7) mark_clean [inode 0x100000004a7 [2,head] /dc-dir/dc-file_690 auth v5382 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.044237+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9461c100] 2023-10-03T19:21:17.386 INFO:teuthology.orchestra.run.smithi045.stdout: -9315> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5382 now clean [dentry #0x1/dc-dir/dc-file_690 [2,head] auth (dversion lock) v=5382 ino=0x100000004a7 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94619180] 2023-10-03T19:21:17.386 INFO:teuthology.orchestra.run.smithi045.stdout: -9314> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_690) mark_clean [dentry #0x1/dc-dir/dc-file_690 [2,head] auth (dversion lock) v=5382 ino=0x100000004a7 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94619180] 2023-10-03T19:21:17.386 INFO:teuthology.orchestra.run.smithi045.stdout: -9313> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5384 now clean [inode 0x100000004a8 [2,head] /dc-dir/dc-file_691 auth v5384 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.056477+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9461c680] 2023-10-03T19:21:17.386 INFO:teuthology.orchestra.run.smithi045.stdout: -9312> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a8) mark_clean [inode 0x100000004a8 [2,head] /dc-dir/dc-file_691 auth v5384 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.056477+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9461c680] 2023-10-03T19:21:17.386 INFO:teuthology.orchestra.run.smithi045.stdout: -9311> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5384 now clean [dentry #0x1/dc-dir/dc-file_691 [2,head] auth (dversion lock) v=5384 ino=0x100000004a8 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94619400] 2023-10-03T19:21:17.386 INFO:teuthology.orchestra.run.smithi045.stdout: -9310> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_691) mark_clean [dentry #0x1/dc-dir/dc-file_691 [2,head] auth (dversion lock) v=5384 ino=0x100000004a8 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94619400] 2023-10-03T19:21:17.386 INFO:teuthology.orchestra.run.smithi045.stdout: -9309> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5386 now clean [inode 0x100000004a9 [2,head] /dc-dir/dc-file_692 auth v5386 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.068400+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9461cc00] 2023-10-03T19:21:17.386 INFO:teuthology.orchestra.run.smithi045.stdout: -9308> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a9) mark_clean [inode 0x100000004a9 [2,head] /dc-dir/dc-file_692 auth v5386 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.068400+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9461cc00] 2023-10-03T19:21:17.386 INFO:teuthology.orchestra.run.smithi045.stdout: -9307> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5386 now clean [dentry #0x1/dc-dir/dc-file_692 [2,head] auth (dversion lock) v=5386 ino=0x100000004a9 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94619680] 2023-10-03T19:21:17.386 INFO:teuthology.orchestra.run.smithi045.stdout: -9306> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_692) mark_clean [dentry #0x1/dc-dir/dc-file_692 [2,head] auth (dversion lock) v=5386 ino=0x100000004a9 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94619680] 2023-10-03T19:21:17.387 INFO:teuthology.orchestra.run.smithi045.stdout: -9305> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5388 now clean [inode 0x100000004aa [2,head] /dc-dir/dc-file_693 auth v5388 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.081109+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9461d180] 2023-10-03T19:21:17.387 INFO:teuthology.orchestra.run.smithi045.stdout: -9304> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004aa) mark_clean [inode 0x100000004aa [2,head] /dc-dir/dc-file_693 auth v5388 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.081109+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9461d180] 2023-10-03T19:21:17.387 INFO:teuthology.orchestra.run.smithi045.stdout: -9303> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5388 now clean [dentry #0x1/dc-dir/dc-file_693 [2,head] auth (dversion lock) v=5388 ino=0x100000004aa state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94619900] 2023-10-03T19:21:17.387 INFO:teuthology.orchestra.run.smithi045.stdout: -9302> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_693) mark_clean [dentry #0x1/dc-dir/dc-file_693 [2,head] auth (dversion lock) v=5388 ino=0x100000004aa state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94619900] 2023-10-03T19:21:17.387 INFO:teuthology.orchestra.run.smithi045.stdout: -9301> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5390 now clean [inode 0x100000004ab [2,head] /dc-dir/dc-file_694 auth v5390 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.163080+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9461d700] 2023-10-03T19:21:17.387 INFO:teuthology.orchestra.run.smithi045.stdout: -9300> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ab) mark_clean [inode 0x100000004ab [2,head] /dc-dir/dc-file_694 auth v5390 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.163080+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9461d700] 2023-10-03T19:21:17.387 INFO:teuthology.orchestra.run.smithi045.stdout: -9299> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 103 ==== osd_op_reply(1326 100000002f7.00000000 [create,setxattr (99),setxattr (30)] v74'21 uv21 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:17.387 INFO:teuthology.orchestra.run.smithi045.stdout: -9298> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5390 now clean [dentry #0x1/dc-dir/dc-file_694 [2,head] auth (dversion lock) v=5390 ino=0x100000004ab state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94619b80] 2023-10-03T19:21:17.387 INFO:teuthology.orchestra.run.smithi045.stdout: -9297> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_694) mark_clean [dentry #0x1/dc-dir/dc-file_694 [2,head] auth (dversion lock) v=5390 ino=0x100000004ab state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94619b80] 2023-10-03T19:21:17.480 INFO:teuthology.orchestra.run.smithi045.stdout: -9296> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5392 now clean [inode 0x100000004ac [2,head] /dc-dir/dc-file_695 auth v5392 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.208121+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94640000] 2023-10-03T19:21:17.480 INFO:teuthology.orchestra.run.smithi045.stdout: -9295> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ac) mark_clean [inode 0x100000004ac [2,head] /dc-dir/dc-file_695 auth v5392 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.208121+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94640000] 2023-10-03T19:21:17.480 INFO:teuthology.orchestra.run.smithi045.stdout: -9294> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5392 now clean [dentry #0x1/dc-dir/dc-file_695 [2,head] auth (dversion lock) v=5392 ino=0x100000004ac state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9463e000] 2023-10-03T19:21:17.481 INFO:teuthology.orchestra.run.smithi045.stdout: -9293> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_695) mark_clean [dentry #0x1/dc-dir/dc-file_695 [2,head] auth (dversion lock) v=5392 ino=0x100000004ac state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9463e000] 2023-10-03T19:21:17.481 INFO:teuthology.orchestra.run.smithi045.stdout: -9292> 2023-10-03T19:18:09.829+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 104 ==== osd_op_reply(1472 10000000389.00000000 [create,setxattr (99),setxattr (30)] v74'24 uv24 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:17.481 INFO:teuthology.orchestra.run.smithi045.stdout: -9291> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5394 now clean [inode 0x100000004ad [2,head] /dc-dir/dc-file_696 auth v5394 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.220249+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94640580] 2023-10-03T19:21:17.481 INFO:teuthology.orchestra.run.smithi045.stdout: -9290> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ad) mark_clean [inode 0x100000004ad [2,head] /dc-dir/dc-file_696 auth v5394 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.220249+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94640580] 2023-10-03T19:21:17.481 INFO:teuthology.orchestra.run.smithi045.stdout: -9289> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5394 now clean [dentry #0x1/dc-dir/dc-file_696 [2,head] auth (dversion lock) v=5394 ino=0x100000004ad state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9463e280] 2023-10-03T19:21:17.481 INFO:teuthology.orchestra.run.smithi045.stdout: -9288> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_696) mark_clean [dentry #0x1/dc-dir/dc-file_696 [2,head] auth (dversion lock) v=5394 ino=0x100000004ad state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9463e280] 2023-10-03T19:21:17.481 INFO:teuthology.orchestra.run.smithi045.stdout: -9287> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5396 now clean [inode 0x100000004ae [2,head] /dc-dir/dc-file_697 auth v5396 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.232131+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94640b00] 2023-10-03T19:21:17.481 INFO:teuthology.orchestra.run.smithi045.stdout: -9286> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ae) mark_clean [inode 0x100000004ae [2,head] /dc-dir/dc-file_697 auth v5396 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.232131+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94640b00] 2023-10-03T19:21:17.481 INFO:teuthology.orchestra.run.smithi045.stdout: -9285> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5396 now clean [dentry #0x1/dc-dir/dc-file_697 [2,head] auth (dversion lock) v=5396 ino=0x100000004ae state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9463e500] 2023-10-03T19:21:17.481 INFO:teuthology.orchestra.run.smithi045.stdout: -9284> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_697) mark_clean [dentry #0x1/dc-dir/dc-file_697 [2,head] auth (dversion lock) v=5396 ino=0x100000004ae state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9463e500] 2023-10-03T19:21:17.481 INFO:teuthology.orchestra.run.smithi045.stdout: -9283> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5398 now clean [inode 0x100000004af [2,head] /dc-dir/dc-file_698 auth v5398 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.243761+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94641080] 2023-10-03T19:21:17.481 INFO:teuthology.orchestra.run.smithi045.stdout: -9282> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004af) mark_clean [inode 0x100000004af [2,head] /dc-dir/dc-file_698 auth v5398 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.243761+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94641080] 2023-10-03T19:21:17.482 INFO:teuthology.orchestra.run.smithi045.stdout: -9281> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5398 now clean [dentry #0x1/dc-dir/dc-file_698 [2,head] auth (dversion lock) v=5398 ino=0x100000004af state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9463e780] 2023-10-03T19:21:17.482 INFO:teuthology.orchestra.run.smithi045.stdout: -9280> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_698) mark_clean [dentry #0x1/dc-dir/dc-file_698 [2,head] auth (dversion lock) v=5398 ino=0x100000004af state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9463e780] 2023-10-03T19:21:17.482 INFO:teuthology.orchestra.run.smithi045.stdout: -9279> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5400 now clean [inode 0x100000004b0 [2,head] /dc-dir/dc-file_699 auth v5400 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.256017+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94641600] 2023-10-03T19:21:17.482 INFO:teuthology.orchestra.run.smithi045.stdout: -9278> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b0) mark_clean [inode 0x100000004b0 [2,head] /dc-dir/dc-file_699 auth v5400 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.256017+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94641600] 2023-10-03T19:21:17.482 INFO:teuthology.orchestra.run.smithi045.stdout: -9277> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5400 now clean [dentry #0x1/dc-dir/dc-file_699 [2,head] auth (dversion lock) v=5400 ino=0x100000004b0 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9463ea00] 2023-10-03T19:21:17.482 INFO:teuthology.orchestra.run.smithi045.stdout: -9276> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_699) mark_clean [dentry #0x1/dc-dir/dc-file_699 [2,head] auth (dversion lock) v=5400 ino=0x100000004b0 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9463ea00] 2023-10-03T19:21:17.482 INFO:teuthology.orchestra.run.smithi045.stdout: -9275> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5402 now clean [inode 0x100000004b1 [2,head] /dc-dir/dc-file_700 auth v5402 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.268455+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94641b80] 2023-10-03T19:21:17.482 INFO:teuthology.orchestra.run.smithi045.stdout: -9274> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b1) mark_clean [inode 0x100000004b1 [2,head] /dc-dir/dc-file_700 auth v5402 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.268455+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94641b80] 2023-10-03T19:21:17.482 INFO:teuthology.orchestra.run.smithi045.stdout: -9273> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5402 now clean [dentry #0x1/dc-dir/dc-file_700 [2,head] auth (dversion lock) v=5402 ino=0x100000004b1 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9463ec80] 2023-10-03T19:21:17.482 INFO:teuthology.orchestra.run.smithi045.stdout: -9272> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_700) mark_clean [dentry #0x1/dc-dir/dc-file_700 [2,head] auth (dversion lock) v=5402 ino=0x100000004b1 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9463ec80] 2023-10-03T19:21:17.483 INFO:teuthology.orchestra.run.smithi045.stdout: -9271> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5404 now clean [inode 0x100000004b2 [2,head] /dc-dir/dc-file_701 auth v5404 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.280625+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94642100] 2023-10-03T19:21:17.483 INFO:teuthology.orchestra.run.smithi045.stdout: -9270> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b2) mark_clean [inode 0x100000004b2 [2,head] /dc-dir/dc-file_701 auth v5404 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.280625+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94642100] 2023-10-03T19:21:17.483 INFO:teuthology.orchestra.run.smithi045.stdout: -9269> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5404 now clean [dentry #0x1/dc-dir/dc-file_701 [2,head] auth (dversion lock) v=5404 ino=0x100000004b2 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9463ef00] 2023-10-03T19:21:17.483 INFO:teuthology.orchestra.run.smithi045.stdout: -9268> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_701) mark_clean [dentry #0x1/dc-dir/dc-file_701 [2,head] auth (dversion lock) v=5404 ino=0x100000004b2 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9463ef00] 2023-10-03T19:21:17.483 INFO:teuthology.orchestra.run.smithi045.stdout: -9267> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5406 now clean [inode 0x100000004b3 [2,head] /dc-dir/dc-file_702 auth v5406 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.292812+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94642680] 2023-10-03T19:21:17.483 INFO:teuthology.orchestra.run.smithi045.stdout: -9266> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b3) mark_clean [inode 0x100000004b3 [2,head] /dc-dir/dc-file_702 auth v5406 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.292812+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94642680] 2023-10-03T19:21:17.483 INFO:teuthology.orchestra.run.smithi045.stdout: -9265> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5406 now clean [dentry #0x1/dc-dir/dc-file_702 [2,head] auth (dversion lock) v=5406 ino=0x100000004b3 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9463f180] 2023-10-03T19:21:17.483 INFO:teuthology.orchestra.run.smithi045.stdout: -9264> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_702) mark_clean [dentry #0x1/dc-dir/dc-file_702 [2,head] auth (dversion lock) v=5406 ino=0x100000004b3 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9463f180] 2023-10-03T19:21:17.483 INFO:teuthology.orchestra.run.smithi045.stdout: -9263> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5408 now clean [inode 0x100000004b4 [2,head] /dc-dir/dc-file_703 auth v5408 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.305228+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94642c00] 2023-10-03T19:21:17.483 INFO:teuthology.orchestra.run.smithi045.stdout: -9262> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b4) mark_clean [inode 0x100000004b4 [2,head] /dc-dir/dc-file_703 auth v5408 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.305228+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94642c00] 2023-10-03T19:21:17.483 INFO:teuthology.orchestra.run.smithi045.stdout: -9261> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5408 now clean [dentry #0x1/dc-dir/dc-file_703 [2,head] auth (dversion lock) v=5408 ino=0x100000004b4 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9463f400] 2023-10-03T19:21:17.484 INFO:teuthology.orchestra.run.smithi045.stdout: -9260> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_703) mark_clean [dentry #0x1/dc-dir/dc-file_703 [2,head] auth (dversion lock) v=5408 ino=0x100000004b4 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9463f400] 2023-10-03T19:21:17.484 INFO:teuthology.orchestra.run.smithi045.stdout: -9259> 2023-10-03T19:18:09.829+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 87 ==== osd_op_reply(1885 10000000526.00000000 [create,setxattr (99),setxattr (30)] v74'25 uv25 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:17.484 INFO:teuthology.orchestra.run.smithi045.stdout: -9258> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5410 now clean [inode 0x100000004b5 [2,head] /dc-dir/dc-file_704 auth v5410 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.317069+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94643180] 2023-10-03T19:21:17.484 INFO:teuthology.orchestra.run.smithi045.stdout: -9257> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b5) mark_clean [inode 0x100000004b5 [2,head] /dc-dir/dc-file_704 auth v5410 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.317069+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94643180] 2023-10-03T19:21:17.484 INFO:teuthology.orchestra.run.smithi045.stdout: -9256> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5410 now clean [dentry #0x1/dc-dir/dc-file_704 [2,head] auth (dversion lock) v=5410 ino=0x100000004b5 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9463f680] 2023-10-03T19:21:17.484 INFO:teuthology.orchestra.run.smithi045.stdout: -9255> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_704) mark_clean [dentry #0x1/dc-dir/dc-file_704 [2,head] auth (dversion lock) v=5410 ino=0x100000004b5 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9463f680] 2023-10-03T19:21:17.484 INFO:teuthology.orchestra.run.smithi045.stdout: -9254> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5412 now clean [inode 0x100000004b6 [2,head] /dc-dir/dc-file_705 auth v5412 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.329554+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94643700] 2023-10-03T19:21:17.484 INFO:teuthology.orchestra.run.smithi045.stdout: -9253> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b6) mark_clean [inode 0x100000004b6 [2,head] /dc-dir/dc-file_705 auth v5412 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.329554+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94643700] 2023-10-03T19:21:17.484 INFO:teuthology.orchestra.run.smithi045.stdout: -9252> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5412 now clean [dentry #0x1/dc-dir/dc-file_705 [2,head] auth (dversion lock) v=5412 ino=0x100000004b6 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9463f900] 2023-10-03T19:21:17.484 INFO:teuthology.orchestra.run.smithi045.stdout: -9251> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_705) mark_clean [dentry #0x1/dc-dir/dc-file_705 [2,head] auth (dversion lock) v=5412 ino=0x100000004b6 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9463f900] 2023-10-03T19:21:17.484 INFO:teuthology.orchestra.run.smithi045.stdout: -9250> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5414 now clean [inode 0x100000004b7 [2,head] /dc-dir/dc-file_706 auth v5414 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.341686+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94648000] 2023-10-03T19:21:17.485 INFO:teuthology.orchestra.run.smithi045.stdout: -9249> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b7) mark_clean [inode 0x100000004b7 [2,head] /dc-dir/dc-file_706 auth v5414 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.341686+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94648000] 2023-10-03T19:21:17.485 INFO:teuthology.orchestra.run.smithi045.stdout: -9248> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5414 now clean [dentry #0x1/dc-dir/dc-file_706 [2,head] auth (dversion lock) v=5414 ino=0x100000004b7 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9463fb80] 2023-10-03T19:21:17.485 INFO:teuthology.orchestra.run.smithi045.stdout: -9247> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_706) mark_clean [dentry #0x1/dc-dir/dc-file_706 [2,head] auth (dversion lock) v=5414 ino=0x100000004b7 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9463fb80] 2023-10-03T19:21:17.485 INFO:teuthology.orchestra.run.smithi045.stdout: -9246> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5416 now clean [inode 0x100000004b8 [2,head] /dc-dir/dc-file_707 auth v5416 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.354348+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94648580] 2023-10-03T19:21:17.485 INFO:teuthology.orchestra.run.smithi045.stdout: -9245> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b8) mark_clean [inode 0x100000004b8 [2,head] /dc-dir/dc-file_707 auth v5416 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.354348+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94648580] 2023-10-03T19:21:17.485 INFO:teuthology.orchestra.run.smithi045.stdout: -9244> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5416 now clean [dentry #0x1/dc-dir/dc-file_707 [2,head] auth (dversion lock) v=5416 ino=0x100000004b8 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9464c000] 2023-10-03T19:21:17.485 INFO:teuthology.orchestra.run.smithi045.stdout: -9243> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_707) mark_clean [dentry #0x1/dc-dir/dc-file_707 [2,head] auth (dversion lock) v=5416 ino=0x100000004b8 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9464c000] 2023-10-03T19:21:17.485 INFO:teuthology.orchestra.run.smithi045.stdout: -9242> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5418 now clean [inode 0x100000004b9 [2,head] /dc-dir/dc-file_708 auth v5418 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.367532+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94648b00] 2023-10-03T19:21:17.485 INFO:teuthology.orchestra.run.smithi045.stdout: -9241> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b9) mark_clean [inode 0x100000004b9 [2,head] /dc-dir/dc-file_708 auth v5418 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.367532+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94648b00] 2023-10-03T19:21:17.485 INFO:teuthology.orchestra.run.smithi045.stdout: -9240> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5418 now clean [dentry #0x1/dc-dir/dc-file_708 [2,head] auth (dversion lock) v=5418 ino=0x100000004b9 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9464c280] 2023-10-03T19:21:17.485 INFO:teuthology.orchestra.run.smithi045.stdout: -9239> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_708) mark_clean [dentry #0x1/dc-dir/dc-file_708 [2,head] auth (dversion lock) v=5418 ino=0x100000004b9 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9464c280] 2023-10-03T19:21:17.486 INFO:teuthology.orchestra.run.smithi045.stdout: -9238> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5420 now clean [inode 0x100000004ba [2,head] /dc-dir/dc-file_709 auth v5420 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.380687+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94649080] 2023-10-03T19:21:17.486 INFO:teuthology.orchestra.run.smithi045.stdout: -9237> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ba) mark_clean [inode 0x100000004ba [2,head] /dc-dir/dc-file_709 auth v5420 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.380687+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94649080] 2023-10-03T19:21:17.486 INFO:teuthology.orchestra.run.smithi045.stdout: -9236> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5420 now clean [dentry #0x1/dc-dir/dc-file_709 [2,head] auth (dversion lock) v=5420 ino=0x100000004ba state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9464c500] 2023-10-03T19:21:17.486 INFO:teuthology.orchestra.run.smithi045.stdout: -9235> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_709) mark_clean [dentry #0x1/dc-dir/dc-file_709 [2,head] auth (dversion lock) v=5420 ino=0x100000004ba state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9464c500] 2023-10-03T19:21:17.486 INFO:teuthology.orchestra.run.smithi045.stdout: -9234> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5422 now clean [inode 0x100000004bb [2,head] /dc-dir/dc-file_710 auth v5422 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.393835+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94649600] 2023-10-03T19:21:17.486 INFO:teuthology.orchestra.run.smithi045.stdout: -9233> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004bb) mark_clean [inode 0x100000004bb [2,head] /dc-dir/dc-file_710 auth v5422 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.393835+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94649600] 2023-10-03T19:21:17.486 INFO:teuthology.orchestra.run.smithi045.stdout: -9232> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5422 now clean [dentry #0x1/dc-dir/dc-file_710 [2,head] auth (dversion lock) v=5422 ino=0x100000004bb state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9464c780] 2023-10-03T19:21:17.530 INFO:teuthology.orchestra.run.smithi045.stdout: -9231> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_710) mark_clean [dentry #0x1/dc-dir/dc-file_710 [2,head] auth (dversion lock) v=5422 ino=0x100000004bb state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9464c780] 2023-10-03T19:21:17.530 INFO:teuthology.orchestra.run.smithi045.stdout: -9230> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5424 now clean [inode 0x100000004bc [2,head] /dc-dir/dc-file_711 auth v5424 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.407554+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94649b80] 2023-10-03T19:21:17.530 INFO:teuthology.orchestra.run.smithi045.stdout: -9229> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004bc) mark_clean [inode 0x100000004bc [2,head] /dc-dir/dc-file_711 auth v5424 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.407554+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94649b80] 2023-10-03T19:21:17.530 INFO:teuthology.orchestra.run.smithi045.stdout: -9228> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5424 now clean [dentry #0x1/dc-dir/dc-file_711 [2,head] auth (dversion lock) v=5424 ino=0x100000004bc state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9464ca00] 2023-10-03T19:21:17.530 INFO:teuthology.orchestra.run.smithi045.stdout: -9227> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_711) mark_clean [dentry #0x1/dc-dir/dc-file_711 [2,head] auth (dversion lock) v=5424 ino=0x100000004bc state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9464ca00] 2023-10-03T19:21:17.530 INFO:teuthology.orchestra.run.smithi045.stdout: -9226> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5426 now clean [inode 0x100000004bd [2,head] /dc-dir/dc-file_712 auth v5426 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.420427+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9464a100] 2023-10-03T19:21:17.530 INFO:teuthology.orchestra.run.smithi045.stdout: -9225> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004bd) mark_clean [inode 0x100000004bd [2,head] /dc-dir/dc-file_712 auth v5426 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.420427+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9464a100] 2023-10-03T19:21:17.530 INFO:teuthology.orchestra.run.smithi045.stdout: -9224> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5426 now clean [dentry #0x1/dc-dir/dc-file_712 [2,head] auth (dversion lock) v=5426 ino=0x100000004bd state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9464cc80] 2023-10-03T19:21:17.531 INFO:teuthology.orchestra.run.smithi045.stdout: -9223> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_712) mark_clean [dentry #0x1/dc-dir/dc-file_712 [2,head] auth (dversion lock) v=5426 ino=0x100000004bd state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9464cc80] 2023-10-03T19:21:17.531 INFO:teuthology.orchestra.run.smithi045.stdout: -9222> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5428 now clean [inode 0x100000004be [2,head] /dc-dir/dc-file_713 auth v5428 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.432059+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9464a680] 2023-10-03T19:21:17.531 INFO:teuthology.orchestra.run.smithi045.stdout: -9221> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004be) mark_clean [inode 0x100000004be [2,head] /dc-dir/dc-file_713 auth v5428 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.432059+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9464a680] 2023-10-03T19:21:17.531 INFO:teuthology.orchestra.run.smithi045.stdout: -9220> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5428 now clean [dentry #0x1/dc-dir/dc-file_713 [2,head] auth (dversion lock) v=5428 ino=0x100000004be state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9464cf00] 2023-10-03T19:21:17.531 INFO:teuthology.orchestra.run.smithi045.stdout: -9219> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_713) mark_clean [dentry #0x1/dc-dir/dc-file_713 [2,head] auth (dversion lock) v=5428 ino=0x100000004be state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9464cf00] 2023-10-03T19:21:17.531 INFO:teuthology.orchestra.run.smithi045.stdout: -9218> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5430 now clean [inode 0x100000004bf [2,head] /dc-dir/dc-file_714 auth v5430 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.443559+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9464ac00] 2023-10-03T19:21:17.531 INFO:teuthology.orchestra.run.smithi045.stdout: -9217> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004bf) mark_clean [inode 0x100000004bf [2,head] /dc-dir/dc-file_714 auth v5430 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.443559+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9464ac00] 2023-10-03T19:21:17.531 INFO:teuthology.orchestra.run.smithi045.stdout: -9216> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5430 now clean [dentry #0x1/dc-dir/dc-file_714 [2,head] auth (dversion lock) v=5430 ino=0x100000004bf state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9464d180] 2023-10-03T19:21:17.531 INFO:teuthology.orchestra.run.smithi045.stdout: -9215> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_714) mark_clean [dentry #0x1/dc-dir/dc-file_714 [2,head] auth (dversion lock) v=5430 ino=0x100000004bf state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9464d180] 2023-10-03T19:21:17.531 INFO:teuthology.orchestra.run.smithi045.stdout: -9214> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5432 now clean [inode 0x100000004c0 [2,head] /dc-dir/dc-file_715 auth v5432 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.455698+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9464b180] 2023-10-03T19:21:17.531 INFO:teuthology.orchestra.run.smithi045.stdout: -9213> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c0) mark_clean [inode 0x100000004c0 [2,head] /dc-dir/dc-file_715 auth v5432 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.455698+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9464b180] 2023-10-03T19:21:17.532 INFO:teuthology.orchestra.run.smithi045.stdout: -9212> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5432 now clean [dentry #0x1/dc-dir/dc-file_715 [2,head] auth (dversion lock) v=5432 ino=0x100000004c0 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9464d400] 2023-10-03T19:21:17.532 INFO:teuthology.orchestra.run.smithi045.stdout: -9211> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_715) mark_clean [dentry #0x1/dc-dir/dc-file_715 [2,head] auth (dversion lock) v=5432 ino=0x100000004c0 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9464d400] 2023-10-03T19:21:17.532 INFO:teuthology.orchestra.run.smithi045.stdout: -9210> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5434 now clean [inode 0x100000004c1 [2,head] /dc-dir/dc-file_716 auth v5434 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.467945+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9464b700] 2023-10-03T19:21:17.532 INFO:teuthology.orchestra.run.smithi045.stdout: -9209> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c1) mark_clean [inode 0x100000004c1 [2,head] /dc-dir/dc-file_716 auth v5434 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.467945+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9464b700] 2023-10-03T19:21:17.532 INFO:teuthology.orchestra.run.smithi045.stdout: -9208> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5434 now clean [dentry #0x1/dc-dir/dc-file_716 [2,head] auth (dversion lock) v=5434 ino=0x100000004c1 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9464d680] 2023-10-03T19:21:17.532 INFO:teuthology.orchestra.run.smithi045.stdout: -9207> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_716) mark_clean [dentry #0x1/dc-dir/dc-file_716 [2,head] auth (dversion lock) v=5434 ino=0x100000004c1 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9464d680] 2023-10-03T19:21:17.532 INFO:teuthology.orchestra.run.smithi045.stdout: -9206> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5436 now clean [inode 0x100000004c2 [2,head] /dc-dir/dc-file_717 auth v5436 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.480071+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94652000] 2023-10-03T19:21:17.532 INFO:teuthology.orchestra.run.smithi045.stdout: -9205> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c2) mark_clean [inode 0x100000004c2 [2,head] /dc-dir/dc-file_717 auth v5436 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.480071+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94652000] 2023-10-03T19:21:17.532 INFO:teuthology.orchestra.run.smithi045.stdout: -9204> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5436 now clean [dentry #0x1/dc-dir/dc-file_717 [2,head] auth (dversion lock) v=5436 ino=0x100000004c2 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9464d900] 2023-10-03T19:21:17.532 INFO:teuthology.orchestra.run.smithi045.stdout: -9203> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_717) mark_clean [dentry #0x1/dc-dir/dc-file_717 [2,head] auth (dversion lock) v=5436 ino=0x100000004c2 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9464d900] 2023-10-03T19:21:17.532 INFO:teuthology.orchestra.run.smithi045.stdout: -9202> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5438 now clean [inode 0x100000004c3 [2,head] /dc-dir/dc-file_718 auth v5438 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.492279+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94652580] 2023-10-03T19:21:17.532 INFO:teuthology.orchestra.run.smithi045.stdout: -9201> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c3) mark_clean [inode 0x100000004c3 [2,head] /dc-dir/dc-file_718 auth v5438 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.492279+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94652580] 2023-10-03T19:21:17.533 INFO:teuthology.orchestra.run.smithi045.stdout: -9200> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5438 now clean [dentry #0x1/dc-dir/dc-file_718 [2,head] auth (dversion lock) v=5438 ino=0x100000004c3 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9464db80] 2023-10-03T19:21:17.533 INFO:teuthology.orchestra.run.smithi045.stdout: -9199> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_718) mark_clean [dentry #0x1/dc-dir/dc-file_718 [2,head] auth (dversion lock) v=5438 ino=0x100000004c3 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9464db80] 2023-10-03T19:21:17.533 INFO:teuthology.orchestra.run.smithi045.stdout: -9198> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5440 now clean [inode 0x100000004c4 [2,head] /dc-dir/dc-file_719 auth v5440 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.504605+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94652b00] 2023-10-03T19:21:17.533 INFO:teuthology.orchestra.run.smithi045.stdout: -9197> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c4) mark_clean [inode 0x100000004c4 [2,head] /dc-dir/dc-file_719 auth v5440 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.504605+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94652b00] 2023-10-03T19:21:17.533 INFO:teuthology.orchestra.run.smithi045.stdout: -9196> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5440 now clean [dentry #0x1/dc-dir/dc-file_719 [2,head] auth (dversion lock) v=5440 ino=0x100000004c4 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9465a000] 2023-10-03T19:21:17.533 INFO:teuthology.orchestra.run.smithi045.stdout: -9195> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_719) mark_clean [dentry #0x1/dc-dir/dc-file_719 [2,head] auth (dversion lock) v=5440 ino=0x100000004c4 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9465a000] 2023-10-03T19:21:17.533 INFO:teuthology.orchestra.run.smithi045.stdout: -9194> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5442 now clean [inode 0x100000004c5 [2,head] /dc-dir/dc-file_720 auth v5442 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.516950+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94653080] 2023-10-03T19:21:17.533 INFO:teuthology.orchestra.run.smithi045.stdout: -9193> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c5) mark_clean [inode 0x100000004c5 [2,head] /dc-dir/dc-file_720 auth v5442 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.516950+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94653080] 2023-10-03T19:21:17.533 INFO:teuthology.orchestra.run.smithi045.stdout: -9192> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5442 now clean [dentry #0x1/dc-dir/dc-file_720 [2,head] auth (dversion lock) v=5442 ino=0x100000004c5 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9465a280] 2023-10-03T19:21:17.533 INFO:teuthology.orchestra.run.smithi045.stdout: -9191> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_720) mark_clean [dentry #0x1/dc-dir/dc-file_720 [2,head] auth (dversion lock) v=5442 ino=0x100000004c5 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9465a280] 2023-10-03T19:21:17.533 INFO:teuthology.orchestra.run.smithi045.stdout: -9190> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5444 now clean [inode 0x100000004c6 [2,head] /dc-dir/dc-file_721 auth v5444 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.528810+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94653600] 2023-10-03T19:21:17.533 INFO:teuthology.orchestra.run.smithi045.stdout: -9189> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c6) mark_clean [inode 0x100000004c6 [2,head] /dc-dir/dc-file_721 auth v5444 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.528810+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94653600] 2023-10-03T19:21:17.534 INFO:teuthology.orchestra.run.smithi045.stdout: -9188> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5444 now clean [dentry #0x1/dc-dir/dc-file_721 [2,head] auth (dversion lock) v=5444 ino=0x100000004c6 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9465a500] 2023-10-03T19:21:17.534 INFO:teuthology.orchestra.run.smithi045.stdout: -9187> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_721) mark_clean [dentry #0x1/dc-dir/dc-file_721 [2,head] auth (dversion lock) v=5444 ino=0x100000004c6 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9465a500] 2023-10-03T19:21:17.534 INFO:teuthology.orchestra.run.smithi045.stdout: -9186> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5446 now clean [inode 0x100000004c7 [2,head] /dc-dir/dc-file_722 auth v5446 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.540938+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94653b80] 2023-10-03T19:21:17.534 INFO:teuthology.orchestra.run.smithi045.stdout: -9185> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c7) mark_clean [inode 0x100000004c7 [2,head] /dc-dir/dc-file_722 auth v5446 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.540938+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94653b80] 2023-10-03T19:21:17.534 INFO:teuthology.orchestra.run.smithi045.stdout: -9184> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5446 now clean [dentry #0x1/dc-dir/dc-file_722 [2,head] auth (dversion lock) v=5446 ino=0x100000004c7 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9465a780] 2023-10-03T19:21:17.534 INFO:teuthology.orchestra.run.smithi045.stdout: -9183> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_722) mark_clean [dentry #0x1/dc-dir/dc-file_722 [2,head] auth (dversion lock) v=5446 ino=0x100000004c7 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9465a780] 2023-10-03T19:21:17.534 INFO:teuthology.orchestra.run.smithi045.stdout: -9182> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5448 now clean [inode 0x100000004c8 [2,head] /dc-dir/dc-file_723 auth v5448 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.552452+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94654100] 2023-10-03T19:21:17.534 INFO:teuthology.orchestra.run.smithi045.stdout: -9181> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c8) mark_clean [inode 0x100000004c8 [2,head] /dc-dir/dc-file_723 auth v5448 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.552452+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94654100] 2023-10-03T19:21:17.599 INFO:teuthology.orchestra.run.smithi045.stdout: -9180> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5448 now clean [dentry #0x1/dc-dir/dc-file_723 [2,head] auth (dversion lock) v=5448 ino=0x100000004c8 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9465aa00] 2023-10-03T19:21:17.599 INFO:teuthology.orchestra.run.smithi045.stdout: -9179> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_723) mark_clean [dentry #0x1/dc-dir/dc-file_723 [2,head] auth (dversion lock) v=5448 ino=0x100000004c8 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9465aa00] 2023-10-03T19:21:17.599 INFO:teuthology.orchestra.run.smithi045.stdout: -9178> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5450 now clean [inode 0x100000004c9 [2,head] /dc-dir/dc-file_724 auth v5450 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.565114+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94654680] 2023-10-03T19:21:17.599 INFO:teuthology.orchestra.run.smithi045.stdout: -9177> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c9) mark_clean [inode 0x100000004c9 [2,head] /dc-dir/dc-file_724 auth v5450 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.565114+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94654680] 2023-10-03T19:21:17.599 INFO:teuthology.orchestra.run.smithi045.stdout: -9176> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5450 now clean [dentry #0x1/dc-dir/dc-file_724 [2,head] auth (dversion lock) v=5450 ino=0x100000004c9 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9465ac80] 2023-10-03T19:21:17.599 INFO:teuthology.orchestra.run.smithi045.stdout: -9175> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_724) mark_clean [dentry #0x1/dc-dir/dc-file_724 [2,head] auth (dversion lock) v=5450 ino=0x100000004c9 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9465ac80] 2023-10-03T19:21:17.599 INFO:teuthology.orchestra.run.smithi045.stdout: -9174> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5452 now clean [inode 0x100000004ca [2,head] /dc-dir/dc-file_725 auth v5452 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.576945+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94654c00] 2023-10-03T19:21:17.599 INFO:teuthology.orchestra.run.smithi045.stdout: -9173> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ca) mark_clean [inode 0x100000004ca [2,head] /dc-dir/dc-file_725 auth v5452 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.576945+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94654c00] 2023-10-03T19:21:17.600 INFO:teuthology.orchestra.run.smithi045.stdout: -9172> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5452 now clean [dentry #0x1/dc-dir/dc-file_725 [2,head] auth (dversion lock) v=5452 ino=0x100000004ca state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9465af00] 2023-10-03T19:21:17.600 INFO:teuthology.orchestra.run.smithi045.stdout: -9171> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_725) mark_clean [dentry #0x1/dc-dir/dc-file_725 [2,head] auth (dversion lock) v=5452 ino=0x100000004ca state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9465af00] 2023-10-03T19:21:17.600 INFO:teuthology.orchestra.run.smithi045.stdout: -9170> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5454 now clean [inode 0x100000004cb [2,head] /dc-dir/dc-file_726 auth v5454 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.589297+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94655180] 2023-10-03T19:21:17.600 INFO:teuthology.orchestra.run.smithi045.stdout: -9169> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004cb) mark_clean [inode 0x100000004cb [2,head] /dc-dir/dc-file_726 auth v5454 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.589297+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94655180] 2023-10-03T19:21:17.600 INFO:teuthology.orchestra.run.smithi045.stdout: -9168> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5454 now clean [dentry #0x1/dc-dir/dc-file_726 [2,head] auth (dversion lock) v=5454 ino=0x100000004cb state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9465b180] 2023-10-03T19:21:17.600 INFO:teuthology.orchestra.run.smithi045.stdout: -9167> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_726) mark_clean [dentry #0x1/dc-dir/dc-file_726 [2,head] auth (dversion lock) v=5454 ino=0x100000004cb state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9465b180] 2023-10-03T19:21:17.600 INFO:teuthology.orchestra.run.smithi045.stdout: -9166> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5456 now clean [inode 0x100000004cc [2,head] /dc-dir/dc-file_727 auth v5456 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.601256+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94655700] 2023-10-03T19:21:17.600 INFO:teuthology.orchestra.run.smithi045.stdout: -9165> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004cc) mark_clean [inode 0x100000004cc [2,head] /dc-dir/dc-file_727 auth v5456 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.601256+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94655700] 2023-10-03T19:21:17.600 INFO:teuthology.orchestra.run.smithi045.stdout: -9164> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5456 now clean [dentry #0x1/dc-dir/dc-file_727 [2,head] auth (dversion lock) v=5456 ino=0x100000004cc state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9465b400] 2023-10-03T19:21:17.600 INFO:teuthology.orchestra.run.smithi045.stdout: -9163> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_727) mark_clean [dentry #0x1/dc-dir/dc-file_727 [2,head] auth (dversion lock) v=5456 ino=0x100000004cc state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9465b400] 2023-10-03T19:21:17.600 INFO:teuthology.orchestra.run.smithi045.stdout: -9162> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5458 now clean [inode 0x100000004cd [2,head] /dc-dir/dc-file_728 auth v5458 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.613299+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9465e000] 2023-10-03T19:21:17.601 INFO:teuthology.orchestra.run.smithi045.stdout: -9161> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004cd) mark_clean [inode 0x100000004cd [2,head] /dc-dir/dc-file_728 auth v5458 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.613299+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9465e000] 2023-10-03T19:21:17.601 INFO:teuthology.orchestra.run.smithi045.stdout: -9160> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5458 now clean [dentry #0x1/dc-dir/dc-file_728 [2,head] auth (dversion lock) v=5458 ino=0x100000004cd state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9465b680] 2023-10-03T19:21:17.601 INFO:teuthology.orchestra.run.smithi045.stdout: -9159> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_728) mark_clean [dentry #0x1/dc-dir/dc-file_728 [2,head] auth (dversion lock) v=5458 ino=0x100000004cd state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9465b680] 2023-10-03T19:21:17.601 INFO:teuthology.orchestra.run.smithi045.stdout: -9158> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5460 now clean [inode 0x100000004ce [2,head] /dc-dir/dc-file_729 auth v5460 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.625847+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9465e580] 2023-10-03T19:21:17.601 INFO:teuthology.orchestra.run.smithi045.stdout: -9157> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ce) mark_clean [inode 0x100000004ce [2,head] /dc-dir/dc-file_729 auth v5460 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.625847+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9465e580] 2023-10-03T19:21:17.601 INFO:teuthology.orchestra.run.smithi045.stdout: -9156> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5460 now clean [dentry #0x1/dc-dir/dc-file_729 [2,head] auth (dversion lock) v=5460 ino=0x100000004ce state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9465b900] 2023-10-03T19:21:17.601 INFO:teuthology.orchestra.run.smithi045.stdout: -9155> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_729) mark_clean [dentry #0x1/dc-dir/dc-file_729 [2,head] auth (dversion lock) v=5460 ino=0x100000004ce state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9465b900] 2023-10-03T19:21:17.601 INFO:teuthology.orchestra.run.smithi045.stdout: -9154> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5462 now clean [inode 0x100000004cf [2,head] /dc-dir/dc-file_730 auth v5462 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.638100+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9465eb00] 2023-10-03T19:21:17.601 INFO:teuthology.orchestra.run.smithi045.stdout: -9153> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004cf) mark_clean [inode 0x100000004cf [2,head] /dc-dir/dc-file_730 auth v5462 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.638100+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9465eb00] 2023-10-03T19:21:17.601 INFO:teuthology.orchestra.run.smithi045.stdout: -9152> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5462 now clean [dentry #0x1/dc-dir/dc-file_730 [2,head] auth (dversion lock) v=5462 ino=0x100000004cf state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9465bb80] 2023-10-03T19:21:17.601 INFO:teuthology.orchestra.run.smithi045.stdout: -9151> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_730) mark_clean [dentry #0x1/dc-dir/dc-file_730 [2,head] auth (dversion lock) v=5462 ino=0x100000004cf state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9465bb80] 2023-10-03T19:21:17.601 INFO:teuthology.orchestra.run.smithi045.stdout: -9150> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5464 now clean [inode 0x100000004d0 [2,head] /dc-dir/dc-file_731 auth v5464 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.651841+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9465f080] 2023-10-03T19:21:17.602 INFO:teuthology.orchestra.run.smithi045.stdout: -9149> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d0) mark_clean [inode 0x100000004d0 [2,head] /dc-dir/dc-file_731 auth v5464 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.651841+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9465f080] 2023-10-03T19:21:17.602 INFO:teuthology.orchestra.run.smithi045.stdout: -9148> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5464 now clean [dentry #0x1/dc-dir/dc-file_731 [2,head] auth (dversion lock) v=5464 ino=0x100000004d0 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94662000] 2023-10-03T19:21:17.602 INFO:teuthology.orchestra.run.smithi045.stdout: -9147> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_731) mark_clean [dentry #0x1/dc-dir/dc-file_731 [2,head] auth (dversion lock) v=5464 ino=0x100000004d0 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94662000] 2023-10-03T19:21:17.602 INFO:teuthology.orchestra.run.smithi045.stdout: -9146> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5466 now clean [inode 0x100000004d1 [2,head] /dc-dir/dc-file_732 auth v5466 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.663894+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9465f600] 2023-10-03T19:21:17.602 INFO:teuthology.orchestra.run.smithi045.stdout: -9145> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d1) mark_clean [inode 0x100000004d1 [2,head] /dc-dir/dc-file_732 auth v5466 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.663894+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9465f600] 2023-10-03T19:21:17.602 INFO:teuthology.orchestra.run.smithi045.stdout: -9144> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5466 now clean [dentry #0x1/dc-dir/dc-file_732 [2,head] auth (dversion lock) v=5466 ino=0x100000004d1 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94662280] 2023-10-03T19:21:17.602 INFO:teuthology.orchestra.run.smithi045.stdout: -9143> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_732) mark_clean [dentry #0x1/dc-dir/dc-file_732 [2,head] auth (dversion lock) v=5466 ino=0x100000004d1 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94662280] 2023-10-03T19:21:17.602 INFO:teuthology.orchestra.run.smithi045.stdout: -9142> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5468 now clean [inode 0x100000004d2 [2,head] /dc-dir/dc-file_733 auth v5468 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.677454+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9465fb80] 2023-10-03T19:21:17.602 INFO:teuthology.orchestra.run.smithi045.stdout: -9141> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d2) mark_clean [inode 0x100000004d2 [2,head] /dc-dir/dc-file_733 auth v5468 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.677454+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9465fb80] 2023-10-03T19:21:17.602 INFO:teuthology.orchestra.run.smithi045.stdout: -9140> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5468 now clean [dentry #0x1/dc-dir/dc-file_733 [2,head] auth (dversion lock) v=5468 ino=0x100000004d2 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94662500] 2023-10-03T19:21:17.603 INFO:teuthology.orchestra.run.smithi045.stdout: -9139> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_733) mark_clean [dentry #0x1/dc-dir/dc-file_733 [2,head] auth (dversion lock) v=5468 ino=0x100000004d2 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94662500] 2023-10-03T19:21:17.603 INFO:teuthology.orchestra.run.smithi045.stdout: -9138> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5470 now clean [inode 0x100000004d3 [2,head] /dc-dir/dc-file_734 auth v5470 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.692125+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94660100] 2023-10-03T19:21:17.603 INFO:teuthology.orchestra.run.smithi045.stdout: -9137> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d3) mark_clean [inode 0x100000004d3 [2,head] /dc-dir/dc-file_734 auth v5470 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.692125+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94660100] 2023-10-03T19:21:17.603 INFO:teuthology.orchestra.run.smithi045.stdout: -9136> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5470 now clean [dentry #0x1/dc-dir/dc-file_734 [2,head] auth (dversion lock) v=5470 ino=0x100000004d3 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94662780] 2023-10-03T19:21:17.603 INFO:teuthology.orchestra.run.smithi045.stdout: -9135> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_734) mark_clean [dentry #0x1/dc-dir/dc-file_734 [2,head] auth (dversion lock) v=5470 ino=0x100000004d3 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94662780] 2023-10-03T19:21:17.603 INFO:teuthology.orchestra.run.smithi045.stdout: -9134> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5472 now clean [inode 0x100000004d4 [2,head] /dc-dir/dc-file_735 auth v5472 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.707587+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94660680] 2023-10-03T19:21:17.603 INFO:teuthology.orchestra.run.smithi045.stdout: -9133> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d4) mark_clean [inode 0x100000004d4 [2,head] /dc-dir/dc-file_735 auth v5472 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.707587+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94660680] 2023-10-03T19:21:17.603 INFO:teuthology.orchestra.run.smithi045.stdout: -9132> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5472 now clean [dentry #0x1/dc-dir/dc-file_735 [2,head] auth (dversion lock) v=5472 ino=0x100000004d4 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94662a00] 2023-10-03T19:21:17.603 INFO:teuthology.orchestra.run.smithi045.stdout: -9131> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_735) mark_clean [dentry #0x1/dc-dir/dc-file_735 [2,head] auth (dversion lock) v=5472 ino=0x100000004d4 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94662a00] 2023-10-03T19:21:17.603 INFO:teuthology.orchestra.run.smithi045.stdout: -9130> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5474 now clean [inode 0x100000004d5 [2,head] /dc-dir/dc-file_736 auth v5474 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.722599+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94660c00] 2023-10-03T19:21:17.603 INFO:teuthology.orchestra.run.smithi045.stdout: -9129> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d5) mark_clean [inode 0x100000004d5 [2,head] /dc-dir/dc-file_736 auth v5474 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.722599+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94660c00] 2023-10-03T19:21:17.603 INFO:teuthology.orchestra.run.smithi045.stdout: -9128> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5474 now clean [dentry #0x1/dc-dir/dc-file_736 [2,head] auth (dversion lock) v=5474 ino=0x100000004d5 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94662c80] 2023-10-03T19:21:17.604 INFO:teuthology.orchestra.run.smithi045.stdout: -9127> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_736) mark_clean [dentry #0x1/dc-dir/dc-file_736 [2,head] auth (dversion lock) v=5474 ino=0x100000004d5 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94662c80] 2023-10-03T19:21:17.604 INFO:teuthology.orchestra.run.smithi045.stdout: -9126> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5476 now clean [inode 0x100000004d6 [2,head] /dc-dir/dc-file_737 auth v5476 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.736554+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94661180] 2023-10-03T19:21:17.604 INFO:teuthology.orchestra.run.smithi045.stdout: -9125> 2023-10-03T19:18:09.829+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d6) mark_clean [inode 0x100000004d6 [2,head] /dc-dir/dc-file_737 auth v5476 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.736554+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94661180] 2023-10-03T19:21:17.604 INFO:teuthology.orchestra.run.smithi045.stdout: -9124> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5476 now clean [dentry #0x1/dc-dir/dc-file_737 [2,head] auth (dversion lock) v=5476 ino=0x100000004d6 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94662f00] 2023-10-03T19:21:17.604 INFO:teuthology.orchestra.run.smithi045.stdout: -9123> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_737) mark_clean [dentry #0x1/dc-dir/dc-file_737 [2,head] auth (dversion lock) v=5476 ino=0x100000004d6 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94662f00] 2023-10-03T19:21:17.604 INFO:teuthology.orchestra.run.smithi045.stdout: -9122> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5478 now clean [inode 0x100000004d7 [2,head] /dc-dir/dc-file_738 auth v5478 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.749180+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94661700] 2023-10-03T19:21:17.604 INFO:teuthology.orchestra.run.smithi045.stdout: -9121> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d7) mark_clean [inode 0x100000004d7 [2,head] /dc-dir/dc-file_738 auth v5478 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.749180+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94661700] 2023-10-03T19:21:17.604 INFO:teuthology.orchestra.run.smithi045.stdout: -9120> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5478 now clean [dentry #0x1/dc-dir/dc-file_738 [2,head] auth (dversion lock) v=5478 ino=0x100000004d7 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94663180] 2023-10-03T19:21:17.604 INFO:teuthology.orchestra.run.smithi045.stdout: -9119> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_738) mark_clean [dentry #0x1/dc-dir/dc-file_738 [2,head] auth (dversion lock) v=5478 ino=0x100000004d7 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94663180] 2023-10-03T19:21:17.604 INFO:teuthology.orchestra.run.smithi045.stdout: -9118> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5480 now clean [inode 0x100000004d8 [2,head] /dc-dir/dc-file_739 auth v5480 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.761549+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94668000] 2023-10-03T19:21:17.604 INFO:teuthology.orchestra.run.smithi045.stdout: -9117> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d8) mark_clean [inode 0x100000004d8 [2,head] /dc-dir/dc-file_739 auth v5480 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.761549+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94668000] 2023-10-03T19:21:17.605 INFO:teuthology.orchestra.run.smithi045.stdout: -9116> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5480 now clean [dentry #0x1/dc-dir/dc-file_739 [2,head] auth (dversion lock) v=5480 ino=0x100000004d8 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94663400] 2023-10-03T19:21:17.605 INFO:teuthology.orchestra.run.smithi045.stdout: -9115> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_739) mark_clean [dentry #0x1/dc-dir/dc-file_739 [2,head] auth (dversion lock) v=5480 ino=0x100000004d8 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94663400] 2023-10-03T19:21:17.605 INFO:teuthology.orchestra.run.smithi045.stdout: -9114> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5482 now clean [inode 0x100000004d9 [2,head] /dc-dir/dc-file_740 auth v5482 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.773481+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94668580] 2023-10-03T19:21:17.605 INFO:teuthology.orchestra.run.smithi045.stdout: -9113> 2023-10-03T19:18:09.833+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 105 ==== osd_op_reply(1521 100000003ba.00000000 [create,setxattr (99),setxattr (30)] v74'22 uv22 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:17.605 INFO:teuthology.orchestra.run.smithi045.stdout: -9112> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d9) mark_clean [inode 0x100000004d9 [2,head] /dc-dir/dc-file_740 auth v5482 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.773481+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94668580] 2023-10-03T19:21:17.605 INFO:teuthology.orchestra.run.smithi045.stdout: -9111> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5482 now clean [dentry #0x1/dc-dir/dc-file_740 [2,head] auth (dversion lock) v=5482 ino=0x100000004d9 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94663680] 2023-10-03T19:21:17.605 INFO:teuthology.orchestra.run.smithi045.stdout: -9110> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_740) mark_clean [dentry #0x1/dc-dir/dc-file_740 [2,head] auth (dversion lock) v=5482 ino=0x100000004d9 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94663680] 2023-10-03T19:21:17.605 INFO:teuthology.orchestra.run.smithi045.stdout: -9109> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5484 now clean [inode 0x100000004da [2,head] /dc-dir/dc-file_741 auth v5484 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.785349+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94668b00] 2023-10-03T19:21:17.605 INFO:teuthology.orchestra.run.smithi045.stdout: -9108> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004da) mark_clean [inode 0x100000004da [2,head] /dc-dir/dc-file_741 auth v5484 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.785349+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94668b00] 2023-10-03T19:21:17.605 INFO:teuthology.orchestra.run.smithi045.stdout: -9107> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5484 now clean [dentry #0x1/dc-dir/dc-file_741 [2,head] auth (dversion lock) v=5484 ino=0x100000004da state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94663900] 2023-10-03T19:21:17.605 INFO:teuthology.orchestra.run.smithi045.stdout: -9106> 2023-10-03T19:18:09.833+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 106 ==== osd_op_reply(1493 1000000039e.00000000 [create,setxattr (99),setxattr (30)] v74'25 uv25 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:17.659 INFO:teuthology.orchestra.run.smithi045.stdout: -9105> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_741) mark_clean [dentry #0x1/dc-dir/dc-file_741 [2,head] auth (dversion lock) v=5484 ino=0x100000004da state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94663900] 2023-10-03T19:21:17.659 INFO:teuthology.orchestra.run.smithi045.stdout: -9104> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5486 now clean [inode 0x100000004db [2,head] /dc-dir/dc-file_742 auth v5486 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.796787+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94669080] 2023-10-03T19:21:17.659 INFO:teuthology.orchestra.run.smithi045.stdout: -9103> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004db) mark_clean [inode 0x100000004db [2,head] /dc-dir/dc-file_742 auth v5486 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.796787+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94669080] 2023-10-03T19:21:17.659 INFO:teuthology.orchestra.run.smithi045.stdout: -9102> 2023-10-03T19:18:09.833+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 107 ==== osd_op_reply(1536 100000003c9.00000000 [create,setxattr (99),setxattr (30)] v74'23 uv23 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:17.659 INFO:teuthology.orchestra.run.smithi045.stdout: -9101> 2023-10-03T19:18:09.833+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 108 ==== osd_op_reply(1601 1000000040a.00000000 [create,setxattr (99),setxattr (30)] v74'24 uv24 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:17.659 INFO:teuthology.orchestra.run.smithi045.stdout: -9100> 2023-10-03T19:18:09.833+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 109 ==== osd_op_reply(1530 100000003c3.00000000 [create,setxattr (99),setxattr (30)] v74'26 uv26 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:17.660 INFO:teuthology.orchestra.run.smithi045.stdout: -9099> 2023-10-03T19:18:09.833+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 110 ==== osd_op_reply(1482 10000000393.00000000 [create,setxattr (99),setxattr (30)] v74'24 uv24 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:17.660 INFO:teuthology.orchestra.run.smithi045.stdout: -9098> 2023-10-03T19:18:09.833+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 111 ==== osd_op_reply(1332 100000002fd.00000000 [create,setxattr (99),setxattr (30)] v74'22 uv22 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:17.660 INFO:teuthology.orchestra.run.smithi045.stdout: -9097> 2023-10-03T19:18:09.833+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 112 ==== osd_op_reply(1434 10000000363.00000000 [create,setxattr (99),setxattr (30)] v74'23 uv23 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:17.660 INFO:teuthology.orchestra.run.smithi045.stdout: -9096> 2023-10-03T19:18:09.833+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 113 ==== osd_op_reply(1509 100000003ae.00000000 [create,setxattr (99),setxattr (30)] v74'24 uv24 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:17.660 INFO:teuthology.orchestra.run.smithi045.stdout: -9095> 2023-10-03T19:18:09.833+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 114 ==== osd_op_reply(1591 10000000400.00000000 [create,setxattr (99),setxattr (30)] v74'25 uv25 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:17.660 INFO:teuthology.orchestra.run.smithi045.stdout: -9094> 2023-10-03T19:18:09.833+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 115 ==== osd_op_reply(1657 10000000442.00000000 [create,setxattr (99),setxattr (30)] v74'26 uv26 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:17.660 INFO:teuthology.orchestra.run.smithi045.stdout: -9093> 2023-10-03T19:18:09.833+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 116 ==== osd_op_reply(1769 100000004b2.00000000 [create,setxattr (99),setxattr (30)] v74'27 uv27 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:17.660 INFO:teuthology.orchestra.run.smithi045.stdout: -9092> 2023-10-03T19:18:09.833+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 117 ==== osd_op_reply(1775 100000004b8.00000000 [create,setxattr (99),setxattr (30)] v74'28 uv28 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:17.660 INFO:teuthology.orchestra.run.smithi045.stdout: -9091> 2023-10-03T19:18:09.833+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 80 ==== osd_op_reply(1084 10000000205.00000000 [create,setxattr (98),setxattr (30)] v74'20 uv20 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:17.660 INFO:teuthology.orchestra.run.smithi045.stdout: -9090> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5486 now clean [dentry #0x1/dc-dir/dc-file_742 [2,head] auth (dversion lock) v=5486 ino=0x100000004db state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94663b80] 2023-10-03T19:21:17.661 INFO:teuthology.orchestra.run.smithi045.stdout: -9089> 2023-10-03T19:18:09.833+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 81 ==== osd_op_reply(1104 10000000219.00000000 [create,setxattr (98),setxattr (30)] v74'21 uv21 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:17.661 INFO:teuthology.orchestra.run.smithi045.stdout: -9088> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_742) mark_clean [dentry #0x1/dc-dir/dc-file_742 [2,head] auth (dversion lock) v=5486 ino=0x100000004db state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94663b80] 2023-10-03T19:21:17.661 INFO:teuthology.orchestra.run.smithi045.stdout: -9087> 2023-10-03T19:18:09.833+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 88 ==== osd_op_reply(1936 10000000558.00000000 [create,setxattr (99),setxattr (30)] v74'26 uv26 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:17.661 INFO:teuthology.orchestra.run.smithi045.stdout: -9086> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5488 now clean [inode 0x100000004dc [2,head] /dc-dir/dc-file_743 auth v5488 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.808389+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94669600] 2023-10-03T19:21:17.661 INFO:teuthology.orchestra.run.smithi045.stdout: -9085> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004dc) mark_clean [inode 0x100000004dc [2,head] /dc-dir/dc-file_743 auth v5488 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.808389+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94669600] 2023-10-03T19:21:17.661 INFO:teuthology.orchestra.run.smithi045.stdout: -9084> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5488 now clean [dentry #0x1/dc-dir/dc-file_743 [2,head] auth (dversion lock) v=5488 ino=0x100000004dc state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94670000] 2023-10-03T19:21:17.661 INFO:teuthology.orchestra.run.smithi045.stdout: -9083> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_743) mark_clean [dentry #0x1/dc-dir/dc-file_743 [2,head] auth (dversion lock) v=5488 ino=0x100000004dc state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94670000] 2023-10-03T19:21:17.661 INFO:teuthology.orchestra.run.smithi045.stdout: -9082> 2023-10-03T19:18:09.833+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 89 ==== osd_op_reply(1952 10000000568.00000000 [create,setxattr (99),setxattr (30)] v74'27 uv27 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:17.661 INFO:teuthology.orchestra.run.smithi045.stdout: -9081> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5490 now clean [inode 0x100000004dd [2,head] /dc-dir/dc-file_744 auth v5490 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.821111+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94669b80] 2023-10-03T19:21:17.661 INFO:teuthology.orchestra.run.smithi045.stdout: -9080> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004dd) mark_clean [inode 0x100000004dd [2,head] /dc-dir/dc-file_744 auth v5490 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.821111+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94669b80] 2023-10-03T19:21:17.661 INFO:teuthology.orchestra.run.smithi045.stdout: -9079> 2023-10-03T19:18:09.833+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 90 ==== osd_op_reply(1979 10000000583.00000000 [create,setxattr (99),setxattr (30)] v74'28 uv28 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:17.661 INFO:teuthology.orchestra.run.smithi045.stdout: -9078> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5490 now clean [dentry #0x1/dc-dir/dc-file_744 [2,head] auth (dversion lock) v=5490 ino=0x100000004dd state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94670280] 2023-10-03T19:21:17.662 INFO:teuthology.orchestra.run.smithi045.stdout: -9077> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_744) mark_clean [dentry #0x1/dc-dir/dc-file_744 [2,head] auth (dversion lock) v=5490 ino=0x100000004dd state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94670280] 2023-10-03T19:21:17.662 INFO:teuthology.orchestra.run.smithi045.stdout: -9076> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5492 now clean [inode 0x100000004de [2,head] /dc-dir/dc-file_745 auth v5492 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.834341+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9466a100] 2023-10-03T19:21:17.662 INFO:teuthology.orchestra.run.smithi045.stdout: -9075> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004de) mark_clean [inode 0x100000004de [2,head] /dc-dir/dc-file_745 auth v5492 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.834341+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9466a100] 2023-10-03T19:21:17.662 INFO:teuthology.orchestra.run.smithi045.stdout: -9074> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5492 now clean [dentry #0x1/dc-dir/dc-file_745 [2,head] auth (dversion lock) v=5492 ino=0x100000004de state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94670500] 2023-10-03T19:21:17.662 INFO:teuthology.orchestra.run.smithi045.stdout: -9073> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_745) mark_clean [dentry #0x1/dc-dir/dc-file_745 [2,head] auth (dversion lock) v=5492 ino=0x100000004de state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94670500] 2023-10-03T19:21:17.662 INFO:teuthology.orchestra.run.smithi045.stdout: -9072> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5494 now clean [inode 0x100000004df [2,head] /dc-dir/dc-file_746 auth v5494 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.846793+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9466a680] 2023-10-03T19:21:17.662 INFO:teuthology.orchestra.run.smithi045.stdout: -9071> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004df) mark_clean [inode 0x100000004df [2,head] /dc-dir/dc-file_746 auth v5494 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.846793+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9466a680] 2023-10-03T19:21:17.662 INFO:teuthology.orchestra.run.smithi045.stdout: -9070> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5494 now clean [dentry #0x1/dc-dir/dc-file_746 [2,head] auth (dversion lock) v=5494 ino=0x100000004df state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94670780] 2023-10-03T19:21:17.662 INFO:teuthology.orchestra.run.smithi045.stdout: -9069> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_746) mark_clean [dentry #0x1/dc-dir/dc-file_746 [2,head] auth (dversion lock) v=5494 ino=0x100000004df state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94670780] 2023-10-03T19:21:17.662 INFO:teuthology.orchestra.run.smithi045.stdout: -9068> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5496 now clean [inode 0x100000004e0 [2,head] /dc-dir/dc-file_747 auth v5496 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.860603+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9466ac00] 2023-10-03T19:21:17.662 INFO:teuthology.orchestra.run.smithi045.stdout: -9067> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e0) mark_clean [inode 0x100000004e0 [2,head] /dc-dir/dc-file_747 auth v5496 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.860603+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9466ac00] 2023-10-03T19:21:17.663 INFO:teuthology.orchestra.run.smithi045.stdout: -9066> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5496 now clean [dentry #0x1/dc-dir/dc-file_747 [2,head] auth (dversion lock) v=5496 ino=0x100000004e0 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94670a00] 2023-10-03T19:21:17.663 INFO:teuthology.orchestra.run.smithi045.stdout: -9065> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_747) mark_clean [dentry #0x1/dc-dir/dc-file_747 [2,head] auth (dversion lock) v=5496 ino=0x100000004e0 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94670a00] 2023-10-03T19:21:17.663 INFO:teuthology.orchestra.run.smithi045.stdout: -9064> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5498 now clean [inode 0x100000004e1 [2,head] /dc-dir/dc-file_748 auth v5498 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.874727+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9466b180] 2023-10-03T19:21:17.663 INFO:teuthology.orchestra.run.smithi045.stdout: -9063> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e1) mark_clean [inode 0x100000004e1 [2,head] /dc-dir/dc-file_748 auth v5498 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.874727+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9466b180] 2023-10-03T19:21:17.663 INFO:teuthology.orchestra.run.smithi045.stdout: -9062> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5498 now clean [dentry #0x1/dc-dir/dc-file_748 [2,head] auth (dversion lock) v=5498 ino=0x100000004e1 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94670c80] 2023-10-03T19:21:17.663 INFO:teuthology.orchestra.run.smithi045.stdout: -9061> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_748) mark_clean [dentry #0x1/dc-dir/dc-file_748 [2,head] auth (dversion lock) v=5498 ino=0x100000004e1 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94670c80] 2023-10-03T19:21:17.663 INFO:teuthology.orchestra.run.smithi045.stdout: -9060> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5500 now clean [inode 0x100000004e2 [2,head] /dc-dir/dc-file_749 auth v5500 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.887595+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9466b700] 2023-10-03T19:21:17.663 INFO:teuthology.orchestra.run.smithi045.stdout: -9059> 2023-10-03T19:18:09.833+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 82 ==== osd_op_reply(1201 1000000027a.00000000 [create,setxattr (99),setxattr (30)] v74'22 uv22 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:17.663 INFO:teuthology.orchestra.run.smithi045.stdout: -9058> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e2) mark_clean [inode 0x100000004e2 [2,head] /dc-dir/dc-file_749 auth v5500 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.887595+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9466b700] 2023-10-03T19:21:17.663 INFO:teuthology.orchestra.run.smithi045.stdout: -9057> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5500 now clean [dentry #0x1/dc-dir/dc-file_749 [2,head] auth (dversion lock) v=5500 ino=0x100000004e2 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94670f00] 2023-10-03T19:21:17.663 INFO:teuthology.orchestra.run.smithi045.stdout: -9056> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_749) mark_clean [dentry #0x1/dc-dir/dc-file_749 [2,head] auth (dversion lock) v=5500 ino=0x100000004e2 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94670f00] 2023-10-03T19:21:17.664 INFO:teuthology.orchestra.run.smithi045.stdout: -9055> 2023-10-03T19:18:09.833+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 83 ==== osd_op_reply(1213 10000000286.00000000 [create,setxattr (99),setxattr (30)] v74'23 uv23 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:17.664 INFO:teuthology.orchestra.run.smithi045.stdout: -9054> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5502 now clean [inode 0x100000004e3 [2,head] /dc-dir/dc-file_750 auth v5502 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.900057+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94672000] 2023-10-03T19:21:17.664 INFO:teuthology.orchestra.run.smithi045.stdout: -9053> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e3) mark_clean [inode 0x100000004e3 [2,head] /dc-dir/dc-file_750 auth v5502 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.900057+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94672000] 2023-10-03T19:21:17.664 INFO:teuthology.orchestra.run.smithi045.stdout: -9052> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5502 now clean [dentry #0x1/dc-dir/dc-file_750 [2,head] auth (dversion lock) v=5502 ino=0x100000004e3 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94671180] 2023-10-03T19:21:17.664 INFO:teuthology.orchestra.run.smithi045.stdout: -9051> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_750) mark_clean [dentry #0x1/dc-dir/dc-file_750 [2,head] auth (dversion lock) v=5502 ino=0x100000004e3 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94671180] 2023-10-03T19:21:17.664 INFO:teuthology.orchestra.run.smithi045.stdout: -9050> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5504 now clean [inode 0x100000004e4 [2,head] /dc-dir/dc-file_751 auth v5504 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.913061+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94672580] 2023-10-03T19:21:17.664 INFO:teuthology.orchestra.run.smithi045.stdout: -9049> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e4) mark_clean [inode 0x100000004e4 [2,head] /dc-dir/dc-file_751 auth v5504 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.913061+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94672580] 2023-10-03T19:21:17.664 INFO:teuthology.orchestra.run.smithi045.stdout: -9048> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5504 now clean [dentry #0x1/dc-dir/dc-file_751 [2,head] auth (dversion lock) v=5504 ino=0x100000004e4 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94671400] 2023-10-03T19:21:17.664 INFO:teuthology.orchestra.run.smithi045.stdout: -9047> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_751) mark_clean [dentry #0x1/dc-dir/dc-file_751 [2,head] auth (dversion lock) v=5504 ino=0x100000004e4 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94671400] 2023-10-03T19:21:17.664 INFO:teuthology.orchestra.run.smithi045.stdout: -9046> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5506 now clean [inode 0x100000004e5 [2,head] /dc-dir/dc-file_752 auth v5506 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.925536+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94672b00] 2023-10-03T19:21:17.664 INFO:teuthology.orchestra.run.smithi045.stdout: -9045> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e5) mark_clean [inode 0x100000004e5 [2,head] /dc-dir/dc-file_752 auth v5506 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.925536+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94672b00] 2023-10-03T19:21:17.664 INFO:teuthology.orchestra.run.smithi045.stdout: -9044> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5506 now clean [dentry #0x1/dc-dir/dc-file_752 [2,head] auth (dversion lock) v=5506 ino=0x100000004e5 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94671680] 2023-10-03T19:21:17.706 INFO:teuthology.orchestra.run.smithi045.stdout: -9043> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_752) mark_clean [dentry #0x1/dc-dir/dc-file_752 [2,head] auth (dversion lock) v=5506 ino=0x100000004e5 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94671680] 2023-10-03T19:21:17.706 INFO:teuthology.orchestra.run.smithi045.stdout: -9042> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5508 now clean [inode 0x100000004e6 [2,head] /dc-dir/dc-file_753 auth v5508 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.937837+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94673080] 2023-10-03T19:21:17.706 INFO:teuthology.orchestra.run.smithi045.stdout: -9041> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e6) mark_clean [inode 0x100000004e6 [2,head] /dc-dir/dc-file_753 auth v5508 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.937837+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94673080] 2023-10-03T19:21:17.706 INFO:teuthology.orchestra.run.smithi045.stdout: -9040> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5508 now clean [dentry #0x1/dc-dir/dc-file_753 [2,head] auth (dversion lock) v=5508 ino=0x100000004e6 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94671900] 2023-10-03T19:21:17.706 INFO:teuthology.orchestra.run.smithi045.stdout: -9039> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_753) mark_clean [dentry #0x1/dc-dir/dc-file_753 [2,head] auth (dversion lock) v=5508 ino=0x100000004e6 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94671900] 2023-10-03T19:21:17.706 INFO:teuthology.orchestra.run.smithi045.stdout: -9038> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5510 now clean [inode 0x100000004e7 [2,head] /dc-dir/dc-file_754 auth v5510 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.950324+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94673600] 2023-10-03T19:21:17.707 INFO:teuthology.orchestra.run.smithi045.stdout: -9037> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e7) mark_clean [inode 0x100000004e7 [2,head] /dc-dir/dc-file_754 auth v5510 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.950324+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94673600] 2023-10-03T19:21:17.707 INFO:teuthology.orchestra.run.smithi045.stdout: -9036> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5510 now clean [dentry #0x1/dc-dir/dc-file_754 [2,head] auth (dversion lock) v=5510 ino=0x100000004e7 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94671b80] 2023-10-03T19:21:17.707 INFO:teuthology.orchestra.run.smithi045.stdout: -9035> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_754) mark_clean [dentry #0x1/dc-dir/dc-file_754 [2,head] auth (dversion lock) v=5510 ino=0x100000004e7 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94671b80] 2023-10-03T19:21:17.707 INFO:teuthology.orchestra.run.smithi045.stdout: -9034> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5512 now clean [inode 0x100000004e8 [2,head] /dc-dir/dc-file_755 auth v5512 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.962865+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94673b80] 2023-10-03T19:21:17.707 INFO:teuthology.orchestra.run.smithi045.stdout: -9033> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e8) mark_clean [inode 0x100000004e8 [2,head] /dc-dir/dc-file_755 auth v5512 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.962865+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94673b80] 2023-10-03T19:21:17.707 INFO:teuthology.orchestra.run.smithi045.stdout: -9032> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5512 now clean [dentry #0x1/dc-dir/dc-file_755 [2,head] auth (dversion lock) v=5512 ino=0x100000004e8 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94678000] 2023-10-03T19:21:17.707 INFO:teuthology.orchestra.run.smithi045.stdout: -9031> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_755) mark_clean [dentry #0x1/dc-dir/dc-file_755 [2,head] auth (dversion lock) v=5512 ino=0x100000004e8 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94678000] 2023-10-03T19:21:17.707 INFO:teuthology.orchestra.run.smithi045.stdout: -9030> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5514 now clean [inode 0x100000004e9 [2,head] /dc-dir/dc-file_756 auth v5514 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.974478+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94674100] 2023-10-03T19:21:17.707 INFO:teuthology.orchestra.run.smithi045.stdout: -9029> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e9) mark_clean [inode 0x100000004e9 [2,head] /dc-dir/dc-file_756 auth v5514 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.974478+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94674100] 2023-10-03T19:21:17.707 INFO:teuthology.orchestra.run.smithi045.stdout: -9028> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5514 now clean [dentry #0x1/dc-dir/dc-file_756 [2,head] auth (dversion lock) v=5514 ino=0x100000004e9 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94678280] 2023-10-03T19:21:17.707 INFO:teuthology.orchestra.run.smithi045.stdout: -9027> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_756) mark_clean [dentry #0x1/dc-dir/dc-file_756 [2,head] auth (dversion lock) v=5514 ino=0x100000004e9 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94678280] 2023-10-03T19:21:17.708 INFO:teuthology.orchestra.run.smithi045.stdout: -9026> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5516 now clean [inode 0x100000004ea [2,head] /dc-dir/dc-file_757 auth v5516 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.985985+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94674680] 2023-10-03T19:21:17.708 INFO:teuthology.orchestra.run.smithi045.stdout: -9025> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ea) mark_clean [inode 0x100000004ea [2,head] /dc-dir/dc-file_757 auth v5516 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.985985+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94674680] 2023-10-03T19:21:17.708 INFO:teuthology.orchestra.run.smithi045.stdout: -9024> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5516 now clean [dentry #0x1/dc-dir/dc-file_757 [2,head] auth (dversion lock) v=5516 ino=0x100000004ea state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94678500] 2023-10-03T19:21:17.708 INFO:teuthology.orchestra.run.smithi045.stdout: -9023> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_757) mark_clean [dentry #0x1/dc-dir/dc-file_757 [2,head] auth (dversion lock) v=5516 ino=0x100000004ea state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94678500] 2023-10-03T19:21:17.708 INFO:teuthology.orchestra.run.smithi045.stdout: -9022> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5518 now clean [inode 0x100000004eb [2,head] /dc-dir/dc-file_758 auth v5518 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.999529+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94674c00] 2023-10-03T19:21:17.708 INFO:teuthology.orchestra.run.smithi045.stdout: -9021> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004eb) mark_clean [inode 0x100000004eb [2,head] /dc-dir/dc-file_758 auth v5518 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.999529+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94674c00] 2023-10-03T19:21:17.708 INFO:teuthology.orchestra.run.smithi045.stdout: -9020> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5518 now clean [dentry #0x1/dc-dir/dc-file_758 [2,head] auth (dversion lock) v=5518 ino=0x100000004eb state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94678780] 2023-10-03T19:21:17.708 INFO:teuthology.orchestra.run.smithi045.stdout: -9019> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_758) mark_clean [dentry #0x1/dc-dir/dc-file_758 [2,head] auth (dversion lock) v=5518 ino=0x100000004eb state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94678780] 2023-10-03T19:21:17.708 INFO:teuthology.orchestra.run.smithi045.stdout: -9018> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5520 now clean [inode 0x100000004ec [2,head] /dc-dir/dc-file_759 auth v5520 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.011926+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94675180] 2023-10-03T19:21:17.708 INFO:teuthology.orchestra.run.smithi045.stdout: -9017> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ec) mark_clean [inode 0x100000004ec [2,head] /dc-dir/dc-file_759 auth v5520 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.011926+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94675180] 2023-10-03T19:21:17.708 INFO:teuthology.orchestra.run.smithi045.stdout: -9016> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5520 now clean [dentry #0x1/dc-dir/dc-file_759 [2,head] auth (dversion lock) v=5520 ino=0x100000004ec state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94678a00] 2023-10-03T19:21:17.709 INFO:teuthology.orchestra.run.smithi045.stdout: -9015> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_759) mark_clean [dentry #0x1/dc-dir/dc-file_759 [2,head] auth (dversion lock) v=5520 ino=0x100000004ec state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94678a00] 2023-10-03T19:21:17.709 INFO:teuthology.orchestra.run.smithi045.stdout: -9014> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5522 now clean [inode 0x100000004ed [2,head] /dc-dir/dc-file_760 auth v5522 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.024656+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94675700] 2023-10-03T19:21:17.709 INFO:teuthology.orchestra.run.smithi045.stdout: -9013> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ed) mark_clean [inode 0x100000004ed [2,head] /dc-dir/dc-file_760 auth v5522 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.024656+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94675700] 2023-10-03T19:21:17.709 INFO:teuthology.orchestra.run.smithi045.stdout: -9012> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5522 now clean [dentry #0x1/dc-dir/dc-file_760 [2,head] auth (dversion lock) v=5522 ino=0x100000004ed state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94678c80] 2023-10-03T19:21:17.709 INFO:teuthology.orchestra.run.smithi045.stdout: -9011> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_760) mark_clean [dentry #0x1/dc-dir/dc-file_760 [2,head] auth (dversion lock) v=5522 ino=0x100000004ed state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94678c80] 2023-10-03T19:21:17.709 INFO:teuthology.orchestra.run.smithi045.stdout: -9010> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5524 now clean [inode 0x100000004ee [2,head] /dc-dir/dc-file_761 auth v5524 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.036181+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946f4000] 2023-10-03T19:21:17.709 INFO:teuthology.orchestra.run.smithi045.stdout: -9009> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ee) mark_clean [inode 0x100000004ee [2,head] /dc-dir/dc-file_761 auth v5524 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.036181+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946f4000] 2023-10-03T19:21:17.709 INFO:teuthology.orchestra.run.smithi045.stdout: -9008> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5524 now clean [dentry #0x1/dc-dir/dc-file_761 [2,head] auth (dversion lock) v=5524 ino=0x100000004ee state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94678f00] 2023-10-03T19:21:17.709 INFO:teuthology.orchestra.run.smithi045.stdout: -9007> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_761) mark_clean [dentry #0x1/dc-dir/dc-file_761 [2,head] auth (dversion lock) v=5524 ino=0x100000004ee state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94678f00] 2023-10-03T19:21:17.709 INFO:teuthology.orchestra.run.smithi045.stdout: -9006> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5526 now clean [inode 0x100000004ef [2,head] /dc-dir/dc-file_762 auth v5526 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.048073+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946f4580] 2023-10-03T19:21:17.709 INFO:teuthology.orchestra.run.smithi045.stdout: -9005> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ef) mark_clean [inode 0x100000004ef [2,head] /dc-dir/dc-file_762 auth v5526 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.048073+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946f4580] 2023-10-03T19:21:17.710 INFO:teuthology.orchestra.run.smithi045.stdout: -9004> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5526 now clean [dentry #0x1/dc-dir/dc-file_762 [2,head] auth (dversion lock) v=5526 ino=0x100000004ef state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94679180] 2023-10-03T19:21:17.710 INFO:teuthology.orchestra.run.smithi045.stdout: -9003> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_762) mark_clean [dentry #0x1/dc-dir/dc-file_762 [2,head] auth (dversion lock) v=5526 ino=0x100000004ef state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94679180] 2023-10-03T19:21:17.710 INFO:teuthology.orchestra.run.smithi045.stdout: -9002> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5528 now clean [inode 0x100000004f0 [2,head] /dc-dir/dc-file_763 auth v5528 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.061223+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946f4b00] 2023-10-03T19:21:17.710 INFO:teuthology.orchestra.run.smithi045.stdout: -9001> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f0) mark_clean [inode 0x100000004f0 [2,head] /dc-dir/dc-file_763 auth v5528 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.061223+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946f4b00] 2023-10-03T19:21:17.710 INFO:teuthology.orchestra.run.smithi045.stdout: -9000> 2023-10-03T19:18:09.833+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 288 ==== osd_op_reply(1409 1000000034a.00000000 [create,setxattr (99),setxattr (30)] v74'25 uv25 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.710 INFO:teuthology.orchestra.run.smithi045.stdout: -8999> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5528 now clean [dentry #0x1/dc-dir/dc-file_763 [2,head] auth (dversion lock) v=5528 ino=0x100000004f0 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94679400] 2023-10-03T19:21:17.710 INFO:teuthology.orchestra.run.smithi045.stdout: -8998> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_763) mark_clean [dentry #0x1/dc-dir/dc-file_763 [2,head] auth (dversion lock) v=5528 ino=0x100000004f0 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94679400] 2023-10-03T19:21:17.710 INFO:teuthology.orchestra.run.smithi045.stdout: -8997> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5530 now clean [inode 0x100000004f1 [2,head] /dc-dir/dc-file_764 auth v5530 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.074204+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946f5080] 2023-10-03T19:21:17.710 INFO:teuthology.orchestra.run.smithi045.stdout: -8996> 2023-10-03T19:18:09.833+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 289 ==== osd_op_reply(1475 1000000038c.00000000 [create,setxattr (99),setxattr (30)] v74'10 uv10 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.710 INFO:teuthology.orchestra.run.smithi045.stdout: -8995> 2023-10-03T19:18:09.833+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 125 ==== osd_op_reply(1693 10000000466.00000000 [create,setxattr (99),setxattr (30)] v74'31 uv31 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:17.711 INFO:teuthology.orchestra.run.smithi045.stdout: -8994> 2023-10-03T19:18:09.833+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 126 ==== osd_op_reply(1731 1000000048c.00000000 [create,setxattr (99),setxattr (30)] v74'32 uv32 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:17.711 INFO:teuthology.orchestra.run.smithi045.stdout: -8993> 2023-10-03T19:18:09.833+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 290 ==== osd_op_reply(1476 1000000038d.00000000 [create,setxattr (99),setxattr (30)] v74'11 uv11 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.711 INFO:teuthology.orchestra.run.smithi045.stdout: -8992> 2023-10-03T19:18:09.833+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 127 ==== osd_op_reply(1756 100000004a5.00000000 [create,setxattr (99),setxattr (30)] v74'33 uv33 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:17.711 INFO:teuthology.orchestra.run.smithi045.stdout: -8991> 2023-10-03T19:18:09.833+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 128 ==== osd_op_reply(1773 100000004b6.00000000 [create,setxattr (99),setxattr (30)] v74'34 uv34 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:17.711 INFO:teuthology.orchestra.run.smithi045.stdout: -8990> 2023-10-03T19:18:09.833+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 129 ==== osd_op_reply(1774 100000004b7.00000000 [create,setxattr (99),setxattr (30)] v74'35 uv35 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:17.711 INFO:teuthology.orchestra.run.smithi045.stdout: -8989> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f1) mark_clean [inode 0x100000004f1 [2,head] /dc-dir/dc-file_764 auth v5530 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.074204+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946f5080] 2023-10-03T19:21:17.711 INFO:teuthology.orchestra.run.smithi045.stdout: -8988> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5530 now clean [dentry #0x1/dc-dir/dc-file_764 [2,head] auth (dversion lock) v=5530 ino=0x100000004f1 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94679680] 2023-10-03T19:21:17.711 INFO:teuthology.orchestra.run.smithi045.stdout: -8987> 2023-10-03T19:18:09.833+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 130 ==== osd_op_reply(1780 100000004bd.00000000 [create,setxattr (99),setxattr (30)] v74'36 uv36 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:17.711 INFO:teuthology.orchestra.run.smithi045.stdout: -8986> 2023-10-03T19:18:09.833+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 131 ==== osd_op_reply(1908 1000000053c.00000000 [create,setxattr (99),setxattr (30)] v74'24 uv24 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:17.711 INFO:teuthology.orchestra.run.smithi045.stdout: -8985> 2023-10-03T19:18:09.833+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 132 ==== osd_op_reply(1812 100000004dd.00000000 [create,setxattr (99),setxattr (30)] v74'37 uv37 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:17.711 INFO:teuthology.orchestra.run.smithi045.stdout: -8984> 2023-10-03T19:18:09.833+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 133 ==== osd_op_reply(1994 10000000592.00000000 [create,setxattr (99),setxattr (30)] v74'25 uv25 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:17.711 INFO:teuthology.orchestra.run.smithi045.stdout: -8983> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_764) mark_clean [dentry #0x1/dc-dir/dc-file_764 [2,head] auth (dversion lock) v=5530 ino=0x100000004f1 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94679680] 2023-10-03T19:21:17.789 INFO:teuthology.orchestra.run.smithi045.stdout: -8982> 2023-10-03T19:18:09.833+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 134 ==== osd_op_reply(1989 1000000058d.00000000 [create,setxattr (99),setxattr (30)] v74'38 uv38 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:17.790 INFO:teuthology.orchestra.run.smithi045.stdout: -8981> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5532 now clean [inode 0x100000004f2 [2,head] /dc-dir/dc-file_765 auth v5532 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.086215+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946f5600] 2023-10-03T19:21:17.790 INFO:teuthology.orchestra.run.smithi045.stdout: -8980> 2023-10-03T19:18:09.833+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 135 ==== osd_op_reply(1993 10000000591.00000000 [create,setxattr (99),setxattr (30)] v74'39 uv39 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:17.790 INFO:teuthology.orchestra.run.smithi045.stdout: -8979> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f2) mark_clean [inode 0x100000004f2 [2,head] /dc-dir/dc-file_765 auth v5532 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.086215+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946f5600] 2023-10-03T19:21:17.790 INFO:teuthology.orchestra.run.smithi045.stdout: -8978> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5532 now clean [dentry #0x1/dc-dir/dc-file_765 [2,head] auth (dversion lock) v=5532 ino=0x100000004f2 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94679900] 2023-10-03T19:21:17.790 INFO:teuthology.orchestra.run.smithi045.stdout: -8977> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_765) mark_clean [dentry #0x1/dc-dir/dc-file_765 [2,head] auth (dversion lock) v=5532 ino=0x100000004f2 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94679900] 2023-10-03T19:21:17.790 INFO:teuthology.orchestra.run.smithi045.stdout: -8976> 2023-10-03T19:18:09.833+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 136 ==== osd_op_reply(1997 10000000595.00000000 [create,setxattr (99),setxattr (30)] v74'40 uv40 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:17.790 INFO:teuthology.orchestra.run.smithi045.stdout: -8975> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5534 now clean [inode 0x100000004f3 [2,head] /dc-dir/dc-file_766 auth v5534 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.175732+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946f5b80] 2023-10-03T19:21:17.790 INFO:teuthology.orchestra.run.smithi045.stdout: -8974> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f3) mark_clean [inode 0x100000004f3 [2,head] /dc-dir/dc-file_766 auth v5534 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.175732+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946f5b80] 2023-10-03T19:21:17.790 INFO:teuthology.orchestra.run.smithi045.stdout: -8973> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5534 now clean [dentry #0x1/dc-dir/dc-file_766 [2,head] auth (dversion lock) v=5534 ino=0x100000004f3 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94679b80] 2023-10-03T19:21:17.790 INFO:teuthology.orchestra.run.smithi045.stdout: -8972> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_766) mark_clean [dentry #0x1/dc-dir/dc-file_766 [2,head] auth (dversion lock) v=5534 ino=0x100000004f3 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94679b80] 2023-10-03T19:21:17.791 INFO:teuthology.orchestra.run.smithi045.stdout: -8971> 2023-10-03T19:18:09.833+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 137 ==== osd_op_reply(2028 100000005b4.00000000 [create,setxattr (99),setxattr (30)] v74'41 uv41 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:17.791 INFO:teuthology.orchestra.run.smithi045.stdout: -8970> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5536 now clean [inode 0x100000004f4 [2,head] /dc-dir/dc-file_767 auth v5536 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.220342+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946f6100] 2023-10-03T19:21:17.791 INFO:teuthology.orchestra.run.smithi045.stdout: -8969> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f4) mark_clean [inode 0x100000004f4 [2,head] /dc-dir/dc-file_767 auth v5536 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.220342+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946f6100] 2023-10-03T19:21:17.791 INFO:teuthology.orchestra.run.smithi045.stdout: -8968> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5536 now clean [dentry #0x1/dc-dir/dc-file_767 [2,head] auth (dversion lock) v=5536 ino=0x100000004f4 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9472e000] 2023-10-03T19:21:17.791 INFO:teuthology.orchestra.run.smithi045.stdout: -8967> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_767) mark_clean [dentry #0x1/dc-dir/dc-file_767 [2,head] auth (dversion lock) v=5536 ino=0x100000004f4 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9472e000] 2023-10-03T19:21:17.791 INFO:teuthology.orchestra.run.smithi045.stdout: -8966> 2023-10-03T19:18:09.833+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 138 ==== osd_op_reply(2066 100000005da.00000000 [create,setxattr (99),setxattr (30)] v74'26 uv26 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:17.791 INFO:teuthology.orchestra.run.smithi045.stdout: -8965> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5538 now clean [inode 0x100000004f5 [2,head] /dc-dir/dc-file_768 auth v5538 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.235262+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946f6680] 2023-10-03T19:21:17.791 INFO:teuthology.orchestra.run.smithi045.stdout: -8964> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f5) mark_clean [inode 0x100000004f5 [2,head] /dc-dir/dc-file_768 auth v5538 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.235262+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946f6680] 2023-10-03T19:21:17.791 INFO:teuthology.orchestra.run.smithi045.stdout: -8963> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5538 now clean [dentry #0x1/dc-dir/dc-file_768 [2,head] auth (dversion lock) v=5538 ino=0x100000004f5 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9472e280] 2023-10-03T19:21:17.791 INFO:teuthology.orchestra.run.smithi045.stdout: -8962> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_768) mark_clean [dentry #0x1/dc-dir/dc-file_768 [2,head] auth (dversion lock) v=5538 ino=0x100000004f5 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9472e280] 2023-10-03T19:21:17.791 INFO:teuthology.orchestra.run.smithi045.stdout: -8961> 2023-10-03T19:18:09.833+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 139 ==== osd_op_reply(2045 100000005c5.00000000 [create,setxattr (99),setxattr (30)] v74'42 uv42 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:17.792 INFO:teuthology.orchestra.run.smithi045.stdout: -8960> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5540 now clean [inode 0x100000004f6 [2,head] /dc-dir/dc-file_769 auth v5540 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.247014+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946f6c00] 2023-10-03T19:21:17.792 INFO:teuthology.orchestra.run.smithi045.stdout: -8959> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f6) mark_clean [inode 0x100000004f6 [2,head] /dc-dir/dc-file_769 auth v5540 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.247014+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946f6c00] 2023-10-03T19:21:17.792 INFO:teuthology.orchestra.run.smithi045.stdout: -8958> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5540 now clean [dentry #0x1/dc-dir/dc-file_769 [2,head] auth (dversion lock) v=5540 ino=0x100000004f6 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9472e500] 2023-10-03T19:21:17.792 INFO:teuthology.orchestra.run.smithi045.stdout: -8957> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_769) mark_clean [dentry #0x1/dc-dir/dc-file_769 [2,head] auth (dversion lock) v=5540 ino=0x100000004f6 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9472e500] 2023-10-03T19:21:17.792 INFO:teuthology.orchestra.run.smithi045.stdout: -8956> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5542 now clean [inode 0x100000004f7 [2,head] /dc-dir/dc-file_770 auth v5542 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.259090+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946f7180] 2023-10-03T19:21:17.792 INFO:teuthology.orchestra.run.smithi045.stdout: -8955> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f7) mark_clean [inode 0x100000004f7 [2,head] /dc-dir/dc-file_770 auth v5542 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.259090+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946f7180] 2023-10-03T19:21:17.792 INFO:teuthology.orchestra.run.smithi045.stdout: -8954> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5542 now clean [dentry #0x1/dc-dir/dc-file_770 [2,head] auth (dversion lock) v=5542 ino=0x100000004f7 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9472e780] 2023-10-03T19:21:17.792 INFO:teuthology.orchestra.run.smithi045.stdout: -8953> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_770) mark_clean [dentry #0x1/dc-dir/dc-file_770 [2,head] auth (dversion lock) v=5542 ino=0x100000004f7 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9472e780] 2023-10-03T19:21:17.792 INFO:teuthology.orchestra.run.smithi045.stdout: -8952> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5544 now clean [inode 0x100000004f8 [2,head] /dc-dir/dc-file_771 auth v5544 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.270969+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946f7700] 2023-10-03T19:21:17.792 INFO:teuthology.orchestra.run.smithi045.stdout: -8951> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f8) mark_clean [inode 0x100000004f8 [2,head] /dc-dir/dc-file_771 auth v5544 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.270969+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946f7700] 2023-10-03T19:21:17.793 INFO:teuthology.orchestra.run.smithi045.stdout: -8950> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5544 now clean [dentry #0x1/dc-dir/dc-file_771 [2,head] auth (dversion lock) v=5544 ino=0x100000004f8 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9472ea00] 2023-10-03T19:21:17.793 INFO:teuthology.orchestra.run.smithi045.stdout: -8949> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_771) mark_clean [dentry #0x1/dc-dir/dc-file_771 [2,head] auth (dversion lock) v=5544 ino=0x100000004f8 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9472ea00] 2023-10-03T19:21:17.793 INFO:teuthology.orchestra.run.smithi045.stdout: -8948> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5546 now clean [inode 0x100000004f9 [2,head] /dc-dir/dc-file_772 auth v5546 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.283288+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94730000] 2023-10-03T19:21:17.793 INFO:teuthology.orchestra.run.smithi045.stdout: -8947> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f9) mark_clean [inode 0x100000004f9 [2,head] /dc-dir/dc-file_772 auth v5546 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.283288+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94730000] 2023-10-03T19:21:17.793 INFO:teuthology.orchestra.run.smithi045.stdout: -8946> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5546 now clean [dentry #0x1/dc-dir/dc-file_772 [2,head] auth (dversion lock) v=5546 ino=0x100000004f9 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9472ec80] 2023-10-03T19:21:17.793 INFO:teuthology.orchestra.run.smithi045.stdout: -8945> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_772) mark_clean [dentry #0x1/dc-dir/dc-file_772 [2,head] auth (dversion lock) v=5546 ino=0x100000004f9 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9472ec80] 2023-10-03T19:21:17.793 INFO:teuthology.orchestra.run.smithi045.stdout: -8944> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5548 now clean [inode 0x100000004fa [2,head] /dc-dir/dc-file_773 auth v5548 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.294975+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94730580] 2023-10-03T19:21:17.793 INFO:teuthology.orchestra.run.smithi045.stdout: -8943> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004fa) mark_clean [inode 0x100000004fa [2,head] /dc-dir/dc-file_773 auth v5548 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.294975+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94730580] 2023-10-03T19:21:17.793 INFO:teuthology.orchestra.run.smithi045.stdout: -8942> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5548 now clean [dentry #0x1/dc-dir/dc-file_773 [2,head] auth (dversion lock) v=5548 ino=0x100000004fa state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9472ef00] 2023-10-03T19:21:17.793 INFO:teuthology.orchestra.run.smithi045.stdout: -8941> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_773) mark_clean [dentry #0x1/dc-dir/dc-file_773 [2,head] auth (dversion lock) v=5548 ino=0x100000004fa state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9472ef00] 2023-10-03T19:21:17.793 INFO:teuthology.orchestra.run.smithi045.stdout: -8940> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5550 now clean [inode 0x100000004fb [2,head] /dc-dir/dc-file_774 auth v5550 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.306882+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94730b00] 2023-10-03T19:21:17.794 INFO:teuthology.orchestra.run.smithi045.stdout: -8939> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004fb) mark_clean [inode 0x100000004fb [2,head] /dc-dir/dc-file_774 auth v5550 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.306882+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94730b00] 2023-10-03T19:21:17.794 INFO:teuthology.orchestra.run.smithi045.stdout: -8938> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5550 now clean [dentry #0x1/dc-dir/dc-file_774 [2,head] auth (dversion lock) v=5550 ino=0x100000004fb state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9472f180] 2023-10-03T19:21:17.794 INFO:teuthology.orchestra.run.smithi045.stdout: -8937> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_774) mark_clean [dentry #0x1/dc-dir/dc-file_774 [2,head] auth (dversion lock) v=5550 ino=0x100000004fb state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9472f180] 2023-10-03T19:21:17.794 INFO:teuthology.orchestra.run.smithi045.stdout: -8936> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5552 now clean [inode 0x100000004fc [2,head] /dc-dir/dc-file_775 auth v5552 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.318660+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94731080] 2023-10-03T19:21:17.794 INFO:teuthology.orchestra.run.smithi045.stdout: -8935> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004fc) mark_clean [inode 0x100000004fc [2,head] /dc-dir/dc-file_775 auth v5552 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.318660+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94731080] 2023-10-03T19:21:17.794 INFO:teuthology.orchestra.run.smithi045.stdout: -8934> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5552 now clean [dentry #0x1/dc-dir/dc-file_775 [2,head] auth (dversion lock) v=5552 ino=0x100000004fc state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9472f400] 2023-10-03T19:21:17.794 INFO:teuthology.orchestra.run.smithi045.stdout: -8933> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_775) mark_clean [dentry #0x1/dc-dir/dc-file_775 [2,head] auth (dversion lock) v=5552 ino=0x100000004fc state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9472f400] 2023-10-03T19:21:17.794 INFO:teuthology.orchestra.run.smithi045.stdout: -8932> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5554 now clean [inode 0x100000004fd [2,head] /dc-dir/dc-file_776 auth v5554 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.330712+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94731600] 2023-10-03T19:21:17.794 INFO:teuthology.orchestra.run.smithi045.stdout: -8931> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004fd) mark_clean [inode 0x100000004fd [2,head] /dc-dir/dc-file_776 auth v5554 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.330712+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94731600] 2023-10-03T19:21:17.794 INFO:teuthology.orchestra.run.smithi045.stdout: -8930> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5554 now clean [dentry #0x1/dc-dir/dc-file_776 [2,head] auth (dversion lock) v=5554 ino=0x100000004fd state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9472f680] 2023-10-03T19:21:17.794 INFO:teuthology.orchestra.run.smithi045.stdout: -8929> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_776) mark_clean [dentry #0x1/dc-dir/dc-file_776 [2,head] auth (dversion lock) v=5554 ino=0x100000004fd state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9472f680] 2023-10-03T19:21:17.795 INFO:teuthology.orchestra.run.smithi045.stdout: -8928> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5556 now clean [inode 0x100000004fe [2,head] /dc-dir/dc-file_777 auth v5556 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.342052+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94731b80] 2023-10-03T19:21:17.795 INFO:teuthology.orchestra.run.smithi045.stdout: -8927> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004fe) mark_clean [inode 0x100000004fe [2,head] /dc-dir/dc-file_777 auth v5556 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.342052+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94731b80] 2023-10-03T19:21:17.795 INFO:teuthology.orchestra.run.smithi045.stdout: -8926> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5556 now clean [dentry #0x1/dc-dir/dc-file_777 [2,head] auth (dversion lock) v=5556 ino=0x100000004fe state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9472f900] 2023-10-03T19:21:17.795 INFO:teuthology.orchestra.run.smithi045.stdout: -8925> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_777) mark_clean [dentry #0x1/dc-dir/dc-file_777 [2,head] auth (dversion lock) v=5556 ino=0x100000004fe state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9472f900] 2023-10-03T19:21:17.795 INFO:teuthology.orchestra.run.smithi045.stdout: -8924> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5558 now clean [inode 0x100000004ff [2,head] /dc-dir/dc-file_778 auth v5558 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.354089+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94732100] 2023-10-03T19:21:17.795 INFO:teuthology.orchestra.run.smithi045.stdout: -8923> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ff) mark_clean [inode 0x100000004ff [2,head] /dc-dir/dc-file_778 auth v5558 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.354089+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94732100] 2023-10-03T19:21:17.795 INFO:teuthology.orchestra.run.smithi045.stdout: -8922> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5558 now clean [dentry #0x1/dc-dir/dc-file_778 [2,head] auth (dversion lock) v=5558 ino=0x100000004ff state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9472fb80] 2023-10-03T19:21:17.795 INFO:teuthology.orchestra.run.smithi045.stdout: -8921> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_778) mark_clean [dentry #0x1/dc-dir/dc-file_778 [2,head] auth (dversion lock) v=5558 ino=0x100000004ff state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9472fb80] 2023-10-03T19:21:17.795 INFO:teuthology.orchestra.run.smithi045.stdout: -8920> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5560 now clean [inode 0x10000000500 [2,head] /dc-dir/dc-file_779 auth v5560 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.366699+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94732680] 2023-10-03T19:21:17.795 INFO:teuthology.orchestra.run.smithi045.stdout: -8919> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000500) mark_clean [inode 0x10000000500 [2,head] /dc-dir/dc-file_779 auth v5560 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.366699+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94732680] 2023-10-03T19:21:17.841 INFO:teuthology.orchestra.run.smithi045.stdout: -8918> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5560 now clean [dentry #0x1/dc-dir/dc-file_779 [2,head] auth (dversion lock) v=5560 ino=0x10000000500 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94738000] 2023-10-03T19:21:17.841 INFO:teuthology.orchestra.run.smithi045.stdout: -8917> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_779) mark_clean [dentry #0x1/dc-dir/dc-file_779 [2,head] auth (dversion lock) v=5560 ino=0x10000000500 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94738000] 2023-10-03T19:21:17.841 INFO:teuthology.orchestra.run.smithi045.stdout: -8916> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5562 now clean [inode 0x10000000501 [2,head] /dc-dir/dc-file_780 auth v5562 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.378959+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94732c00] 2023-10-03T19:21:17.841 INFO:teuthology.orchestra.run.smithi045.stdout: -8915> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000501) mark_clean [inode 0x10000000501 [2,head] /dc-dir/dc-file_780 auth v5562 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.378959+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94732c00] 2023-10-03T19:21:17.841 INFO:teuthology.orchestra.run.smithi045.stdout: -8914> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5562 now clean [dentry #0x1/dc-dir/dc-file_780 [2,head] auth (dversion lock) v=5562 ino=0x10000000501 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94738280] 2023-10-03T19:21:17.841 INFO:teuthology.orchestra.run.smithi045.stdout: -8913> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_780) mark_clean [dentry #0x1/dc-dir/dc-file_780 [2,head] auth (dversion lock) v=5562 ino=0x10000000501 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94738280] 2023-10-03T19:21:17.841 INFO:teuthology.orchestra.run.smithi045.stdout: -8912> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5564 now clean [inode 0x10000000502 [2,head] /dc-dir/dc-file_781 auth v5564 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.391272+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94733180] 2023-10-03T19:21:17.841 INFO:teuthology.orchestra.run.smithi045.stdout: -8911> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000502) mark_clean [inode 0x10000000502 [2,head] /dc-dir/dc-file_781 auth v5564 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.391272+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94733180] 2023-10-03T19:21:17.841 INFO:teuthology.orchestra.run.smithi045.stdout: -8910> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5564 now clean [dentry #0x1/dc-dir/dc-file_781 [2,head] auth (dversion lock) v=5564 ino=0x10000000502 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94738500] 2023-10-03T19:21:17.841 INFO:teuthology.orchestra.run.smithi045.stdout: -8909> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_781) mark_clean [dentry #0x1/dc-dir/dc-file_781 [2,head] auth (dversion lock) v=5564 ino=0x10000000502 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94738500] 2023-10-03T19:21:17.842 INFO:teuthology.orchestra.run.smithi045.stdout: -8908> 2023-10-03T19:18:09.833+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 53 ==== osd_op_reply(1306 100000002e3.00000000 [create,setxattr (99),setxattr (30)] v74'22 uv22 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:17.842 INFO:teuthology.orchestra.run.smithi045.stdout: -8907> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5566 now clean [inode 0x10000000503 [2,head] /dc-dir/dc-file_782 auth v5566 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.403260+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94733700] 2023-10-03T19:21:17.842 INFO:teuthology.orchestra.run.smithi045.stdout: -8906> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000503) mark_clean [inode 0x10000000503 [2,head] /dc-dir/dc-file_782 auth v5566 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.403260+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94733700] 2023-10-03T19:21:17.842 INFO:teuthology.orchestra.run.smithi045.stdout: -8905> 2023-10-03T19:18:09.833+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 291 ==== osd_op_reply(1611 10000000414.00000000 [create,setxattr (99),setxattr (30)] v74'12 uv12 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.842 INFO:teuthology.orchestra.run.smithi045.stdout: -8904> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5566 now clean [dentry #0x1/dc-dir/dc-file_782 [2,head] auth (dversion lock) v=5566 ino=0x10000000503 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94738780] 2023-10-03T19:21:17.842 INFO:teuthology.orchestra.run.smithi045.stdout: -8903> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_782) mark_clean [dentry #0x1/dc-dir/dc-file_782 [2,head] auth (dversion lock) v=5566 ino=0x10000000503 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94738780] 2023-10-03T19:21:17.842 INFO:teuthology.orchestra.run.smithi045.stdout: -8902> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5568 now clean [inode 0x10000000504 [2,head] /dc-dir/dc-file_783 auth v5568 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.416797+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9473c000] 2023-10-03T19:21:17.842 INFO:teuthology.orchestra.run.smithi045.stdout: -8901> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000504) mark_clean [inode 0x10000000504 [2,head] /dc-dir/dc-file_783 auth v5568 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.416797+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9473c000] 2023-10-03T19:21:17.842 INFO:teuthology.orchestra.run.smithi045.stdout: -8900> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5568 now clean [dentry #0x1/dc-dir/dc-file_783 [2,head] auth (dversion lock) v=5568 ino=0x10000000504 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94738a00] 2023-10-03T19:21:17.842 INFO:teuthology.orchestra.run.smithi045.stdout: -8899> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_783) mark_clean [dentry #0x1/dc-dir/dc-file_783 [2,head] auth (dversion lock) v=5568 ino=0x10000000504 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94738a00] 2023-10-03T19:21:17.842 INFO:teuthology.orchestra.run.smithi045.stdout: -8898> 2023-10-03T19:18:09.833+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 292 ==== osd_op_reply(1415 10000000350.00000000 [create,setxattr (99),setxattr (30)] v74'26 uv26 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.843 INFO:teuthology.orchestra.run.smithi045.stdout: -8897> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5570 now clean [inode 0x10000000505 [2,head] /dc-dir/dc-file_784 auth v5570 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.428983+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9473c580] 2023-10-03T19:21:17.843 INFO:teuthology.orchestra.run.smithi045.stdout: -8896> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000505) mark_clean [inode 0x10000000505 [2,head] /dc-dir/dc-file_784 auth v5570 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.428983+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9473c580] 2023-10-03T19:21:17.843 INFO:teuthology.orchestra.run.smithi045.stdout: -8895> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5570 now clean [dentry #0x1/dc-dir/dc-file_784 [2,head] auth (dversion lock) v=5570 ino=0x10000000505 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94738c80] 2023-10-03T19:21:17.843 INFO:teuthology.orchestra.run.smithi045.stdout: -8894> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_784) mark_clean [dentry #0x1/dc-dir/dc-file_784 [2,head] auth (dversion lock) v=5570 ino=0x10000000505 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94738c80] 2023-10-03T19:21:17.843 INFO:teuthology.orchestra.run.smithi045.stdout: -8893> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5572 now clean [inode 0x10000000506 [2,head] /dc-dir/dc-file_785 auth v5572 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.442397+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9473cb00] 2023-10-03T19:21:17.843 INFO:teuthology.orchestra.run.smithi045.stdout: -8892> 2023-10-03T19:18:09.833+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 293 ==== osd_op_reply(1524 100000003bd.00000000 [create,setxattr (99),setxattr (30)] v74'27 uv27 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.843 INFO:teuthology.orchestra.run.smithi045.stdout: -8891> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000506) mark_clean [inode 0x10000000506 [2,head] /dc-dir/dc-file_785 auth v5572 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.442397+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9473cb00] 2023-10-03T19:21:17.843 INFO:teuthology.orchestra.run.smithi045.stdout: -8890> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5572 now clean [dentry #0x1/dc-dir/dc-file_785 [2,head] auth (dversion lock) v=5572 ino=0x10000000506 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94738f00] 2023-10-03T19:21:17.843 INFO:teuthology.orchestra.run.smithi045.stdout: -8889> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_785) mark_clean [dentry #0x1/dc-dir/dc-file_785 [2,head] auth (dversion lock) v=5572 ino=0x10000000506 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94738f00] 2023-10-03T19:21:17.843 INFO:teuthology.orchestra.run.smithi045.stdout: -8888> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5574 now clean [inode 0x10000000507 [2,head] /dc-dir/dc-file_786 auth v5574 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.454795+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9473d080] 2023-10-03T19:21:17.843 INFO:teuthology.orchestra.run.smithi045.stdout: -8887> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000507) mark_clean [inode 0x10000000507 [2,head] /dc-dir/dc-file_786 auth v5574 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.454795+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9473d080] 2023-10-03T19:21:17.844 INFO:teuthology.orchestra.run.smithi045.stdout: -8886> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5574 now clean [dentry #0x1/dc-dir/dc-file_786 [2,head] auth (dversion lock) v=5574 ino=0x10000000507 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94739180] 2023-10-03T19:21:17.844 INFO:teuthology.orchestra.run.smithi045.stdout: -8885> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_786) mark_clean [dentry #0x1/dc-dir/dc-file_786 [2,head] auth (dversion lock) v=5574 ino=0x10000000507 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94739180] 2023-10-03T19:21:17.844 INFO:teuthology.orchestra.run.smithi045.stdout: -8884> 2023-10-03T19:18:09.833+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 294 ==== osd_op_reply(1720 10000000481.00000000 [create,setxattr (99),setxattr (30)] v74'13 uv13 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.844 INFO:teuthology.orchestra.run.smithi045.stdout: -8883> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5576 now clean [inode 0x10000000508 [2,head] /dc-dir/dc-file_787 auth v5576 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.468067+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9473d600] 2023-10-03T19:21:17.844 INFO:teuthology.orchestra.run.smithi045.stdout: -8882> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000508) mark_clean [inode 0x10000000508 [2,head] /dc-dir/dc-file_787 auth v5576 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.468067+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9473d600] 2023-10-03T19:21:17.844 INFO:teuthology.orchestra.run.smithi045.stdout: -8881> 2023-10-03T19:18:09.833+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 295 ==== osd_op_reply(1626 10000000423.00000000 [create,setxattr (99),setxattr (30)] v74'28 uv28 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.844 INFO:teuthology.orchestra.run.smithi045.stdout: -8880> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5576 now clean [dentry #0x1/dc-dir/dc-file_787 [2,head] auth (dversion lock) v=5576 ino=0x10000000508 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94739400] 2023-10-03T19:21:17.844 INFO:teuthology.orchestra.run.smithi045.stdout: -8879> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_787) mark_clean [dentry #0x1/dc-dir/dc-file_787 [2,head] auth (dversion lock) v=5576 ino=0x10000000508 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94739400] 2023-10-03T19:21:17.844 INFO:teuthology.orchestra.run.smithi045.stdout: -8878> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5578 now clean [inode 0x10000000509 [2,head] /dc-dir/dc-file_788 auth v5578 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.480149+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9473db80] 2023-10-03T19:21:17.844 INFO:teuthology.orchestra.run.smithi045.stdout: -8877> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000509) mark_clean [inode 0x10000000509 [2,head] /dc-dir/dc-file_788 auth v5578 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.480149+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9473db80] 2023-10-03T19:21:17.844 INFO:teuthology.orchestra.run.smithi045.stdout: -8876> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5578 now clean [dentry #0x1/dc-dir/dc-file_788 [2,head] auth (dversion lock) v=5578 ino=0x10000000509 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94739680] 2023-10-03T19:21:17.845 INFO:teuthology.orchestra.run.smithi045.stdout: -8875> 2023-10-03T19:18:09.833+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 296 ==== osd_op_reply(1772 100000004b5.00000000 [create,setxattr (99),setxattr (30)] v74'14 uv14 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.845 INFO:teuthology.orchestra.run.smithi045.stdout: -8874> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_788) mark_clean [dentry #0x1/dc-dir/dc-file_788 [2,head] auth (dversion lock) v=5578 ino=0x10000000509 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94739680] 2023-10-03T19:21:17.845 INFO:teuthology.orchestra.run.smithi045.stdout: -8873> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5580 now clean [inode 0x1000000050a [2,head] /dc-dir/dc-file_789 auth v5580 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.492989+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9473e100] 2023-10-03T19:21:17.845 INFO:teuthology.orchestra.run.smithi045.stdout: -8872> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000050a) mark_clean [inode 0x1000000050a [2,head] /dc-dir/dc-file_789 auth v5580 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.492989+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9473e100] 2023-10-03T19:21:17.845 INFO:teuthology.orchestra.run.smithi045.stdout: -8871> 2023-10-03T19:18:09.833+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 140 ==== osd_op_reply(1484 10000000395.00000000 [create,setxattr (99),setxattr (30)] v74'25 uv25 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:17.845 INFO:teuthology.orchestra.run.smithi045.stdout: -8870> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5580 now clean [dentry #0x1/dc-dir/dc-file_789 [2,head] auth (dversion lock) v=5580 ino=0x1000000050a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94739900] 2023-10-03T19:21:17.845 INFO:teuthology.orchestra.run.smithi045.stdout: -8869> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_789) mark_clean [dentry #0x1/dc-dir/dc-file_789 [2,head] auth (dversion lock) v=5580 ino=0x1000000050a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94739900] 2023-10-03T19:21:17.845 INFO:teuthology.orchestra.run.smithi045.stdout: -8868> 2023-10-03T19:18:09.833+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 297 ==== osd_op_reply(1739 10000000494.00000000 [create,setxattr (99),setxattr (30)] v74'29 uv29 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.845 INFO:teuthology.orchestra.run.smithi045.stdout: -8867> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5582 now clean [inode 0x1000000050b [2,head] /dc-dir/dc-file_790 auth v5582 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.505499+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9473e680] 2023-10-03T19:21:17.845 INFO:teuthology.orchestra.run.smithi045.stdout: -8866> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000050b) mark_clean [inode 0x1000000050b [2,head] /dc-dir/dc-file_790 auth v5582 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.505499+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9473e680] 2023-10-03T19:21:17.845 INFO:teuthology.orchestra.run.smithi045.stdout: -8865> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5582 now clean [dentry #0x1/dc-dir/dc-file_790 [2,head] auth (dversion lock) v=5582 ino=0x1000000050b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94739b80] 2023-10-03T19:21:17.846 INFO:teuthology.orchestra.run.smithi045.stdout: -8864> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_790) mark_clean [dentry #0x1/dc-dir/dc-file_790 [2,head] auth (dversion lock) v=5582 ino=0x1000000050b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94739b80] 2023-10-03T19:21:17.846 INFO:teuthology.orchestra.run.smithi045.stdout: -8863> 2023-10-03T19:18:09.833+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 298 ==== osd_op_reply(1854 10000000507.00000000 [create,setxattr (99),setxattr (30)] v74'15 uv15 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.846 INFO:teuthology.orchestra.run.smithi045.stdout: -8862> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5584 now clean [inode 0x1000000050c [2,head] /dc-dir/dc-file_791 auth v5584 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.518506+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9473ec00] 2023-10-03T19:21:17.846 INFO:teuthology.orchestra.run.smithi045.stdout: -8861> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000050c) mark_clean [inode 0x1000000050c [2,head] /dc-dir/dc-file_791 auth v5584 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.518506+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9473ec00] 2023-10-03T19:21:17.846 INFO:teuthology.orchestra.run.smithi045.stdout: -8860> 2023-10-03T19:18:09.833+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 141 ==== osd_op_reply(1529 100000003c2.00000000 [create,setxattr (99),setxattr (30)] v74'26 uv26 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:17.846 INFO:teuthology.orchestra.run.smithi045.stdout: -8859> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5584 now clean [dentry #0x1/dc-dir/dc-file_791 [2,head] auth (dversion lock) v=5584 ino=0x1000000050c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94740000] 2023-10-03T19:21:17.846 INFO:teuthology.orchestra.run.smithi045.stdout: -8858> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_791) mark_clean [dentry #0x1/dc-dir/dc-file_791 [2,head] auth (dversion lock) v=5584 ino=0x1000000050c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94740000] 2023-10-03T19:21:17.846 INFO:teuthology.orchestra.run.smithi045.stdout: -8857> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5586 now clean [inode 0x1000000050d [2,head] /dc-dir/dc-file_792 auth v5586 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.531969+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9473f180] 2023-10-03T19:21:17.846 INFO:teuthology.orchestra.run.smithi045.stdout: -8856> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000050d) mark_clean [inode 0x1000000050d [2,head] /dc-dir/dc-file_792 auth v5586 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.531969+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9473f180] 2023-10-03T19:21:17.846 INFO:teuthology.orchestra.run.smithi045.stdout: -8855> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5586 now clean [dentry #0x1/dc-dir/dc-file_792 [2,head] auth (dversion lock) v=5586 ino=0x1000000050d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94740280] 2023-10-03T19:21:17.942 INFO:teuthology.orchestra.run.smithi045.stdout: -8854> 2023-10-03T19:18:09.833+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 299 ==== osd_op_reply(1918 10000000546.00000000 [create,setxattr (99),setxattr (30)] v74'16 uv16 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.943 INFO:teuthology.orchestra.run.smithi045.stdout: -8853> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_792) mark_clean [dentry #0x1/dc-dir/dc-file_792 [2,head] auth (dversion lock) v=5586 ino=0x1000000050d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94740280] 2023-10-03T19:21:17.943 INFO:teuthology.orchestra.run.smithi045.stdout: -8852> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5588 now clean [inode 0x1000000050e [2,head] /dc-dir/dc-file_793 auth v5588 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.544595+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9473f700] 2023-10-03T19:21:17.943 INFO:teuthology.orchestra.run.smithi045.stdout: -8851> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000050e) mark_clean [inode 0x1000000050e [2,head] /dc-dir/dc-file_793 auth v5588 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.544595+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9473f700] 2023-10-03T19:21:17.943 INFO:teuthology.orchestra.run.smithi045.stdout: -8850> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5588 now clean [dentry #0x1/dc-dir/dc-file_793 [2,head] auth (dversion lock) v=5588 ino=0x1000000050e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94740500] 2023-10-03T19:21:17.943 INFO:teuthology.orchestra.run.smithi045.stdout: -8849> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_793) mark_clean [dentry #0x1/dc-dir/dc-file_793 [2,head] auth (dversion lock) v=5588 ino=0x1000000050e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94740500] 2023-10-03T19:21:17.943 INFO:teuthology.orchestra.run.smithi045.stdout: -8848> 2023-10-03T19:18:09.833+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 300 ==== osd_op_reply(1887 10000000528.00000000 [create,setxattr (99),setxattr (30)] v74'30 uv30 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.943 INFO:teuthology.orchestra.run.smithi045.stdout: -8847> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5590 now clean [inode 0x1000000050f [2,head] /dc-dir/dc-file_794 auth v5590 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.558012+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94742000] 2023-10-03T19:21:17.943 INFO:teuthology.orchestra.run.smithi045.stdout: -8846> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000050f) mark_clean [inode 0x1000000050f [2,head] /dc-dir/dc-file_794 auth v5590 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.558012+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94742000] 2023-10-03T19:21:17.943 INFO:teuthology.orchestra.run.smithi045.stdout: -8845> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5590 now clean [dentry #0x1/dc-dir/dc-file_794 [2,head] auth (dversion lock) v=5590 ino=0x1000000050f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94740780] 2023-10-03T19:21:17.943 INFO:teuthology.orchestra.run.smithi045.stdout: -8844> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_794) mark_clean [dentry #0x1/dc-dir/dc-file_794 [2,head] auth (dversion lock) v=5590 ino=0x1000000050f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94740780] 2023-10-03T19:21:17.944 INFO:teuthology.orchestra.run.smithi045.stdout: -8843> 2023-10-03T19:18:09.833+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 301 ==== osd_op_reply(1933 10000000555.00000000 [create,setxattr (99),setxattr (30)] v74'17 uv17 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.944 INFO:teuthology.orchestra.run.smithi045.stdout: -8842> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5592 now clean [inode 0x10000000510 [2,head] /dc-dir/dc-file_795 auth v5592 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.570089+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94742580] 2023-10-03T19:21:17.944 INFO:teuthology.orchestra.run.smithi045.stdout: -8841> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000510) mark_clean [inode 0x10000000510 [2,head] /dc-dir/dc-file_795 auth v5592 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.570089+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94742580] 2023-10-03T19:21:17.944 INFO:teuthology.orchestra.run.smithi045.stdout: -8840> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5592 now clean [dentry #0x1/dc-dir/dc-file_795 [2,head] auth (dversion lock) v=5592 ino=0x10000000510 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94740a00] 2023-10-03T19:21:17.944 INFO:teuthology.orchestra.run.smithi045.stdout: -8839> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_795) mark_clean [dentry #0x1/dc-dir/dc-file_795 [2,head] auth (dversion lock) v=5592 ino=0x10000000510 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94740a00] 2023-10-03T19:21:17.944 INFO:teuthology.orchestra.run.smithi045.stdout: -8838> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5594 now clean [inode 0x10000000511 [2,head] /dc-dir/dc-file_796 auth v5594 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.581774+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94742b00] 2023-10-03T19:21:17.944 INFO:teuthology.orchestra.run.smithi045.stdout: -8837> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000511) mark_clean [inode 0x10000000511 [2,head] /dc-dir/dc-file_796 auth v5594 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.581774+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94742b00] 2023-10-03T19:21:17.944 INFO:teuthology.orchestra.run.smithi045.stdout: -8836> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5594 now clean [dentry #0x1/dc-dir/dc-file_796 [2,head] auth (dversion lock) v=5594 ino=0x10000000511 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94740c80] 2023-10-03T19:21:17.944 INFO:teuthology.orchestra.run.smithi045.stdout: -8835> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_796) mark_clean [dentry #0x1/dc-dir/dc-file_796 [2,head] auth (dversion lock) v=5594 ino=0x10000000511 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94740c80] 2023-10-03T19:21:17.944 INFO:teuthology.orchestra.run.smithi045.stdout: -8834> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5596 now clean [inode 0x10000000512 [2,head] /dc-dir/dc-file_797 auth v5596 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.594246+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94743080] 2023-10-03T19:21:17.944 INFO:teuthology.orchestra.run.smithi045.stdout: -8833> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000512) mark_clean [inode 0x10000000512 [2,head] /dc-dir/dc-file_797 auth v5596 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.594246+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94743080] 2023-10-03T19:21:17.945 INFO:teuthology.orchestra.run.smithi045.stdout: -8832> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5596 now clean [dentry #0x1/dc-dir/dc-file_797 [2,head] auth (dversion lock) v=5596 ino=0x10000000512 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94740f00] 2023-10-03T19:21:17.945 INFO:teuthology.orchestra.run.smithi045.stdout: -8831> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_797) mark_clean [dentry #0x1/dc-dir/dc-file_797 [2,head] auth (dversion lock) v=5596 ino=0x10000000512 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94740f00] 2023-10-03T19:21:17.945 INFO:teuthology.orchestra.run.smithi045.stdout: -8830> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5598 now clean [inode 0x10000000513 [2,head] /dc-dir/dc-file_798 auth v5598 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.608115+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94743600] 2023-10-03T19:21:17.945 INFO:teuthology.orchestra.run.smithi045.stdout: -8829> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000513) mark_clean [inode 0x10000000513 [2,head] /dc-dir/dc-file_798 auth v5598 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.608115+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94743600] 2023-10-03T19:21:17.945 INFO:teuthology.orchestra.run.smithi045.stdout: -8828> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5598 now clean [dentry #0x1/dc-dir/dc-file_798 [2,head] auth (dversion lock) v=5598 ino=0x10000000513 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94741180] 2023-10-03T19:21:17.945 INFO:teuthology.orchestra.run.smithi045.stdout: -8827> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_798) mark_clean [dentry #0x1/dc-dir/dc-file_798 [2,head] auth (dversion lock) v=5598 ino=0x10000000513 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94741180] 2023-10-03T19:21:17.945 INFO:teuthology.orchestra.run.smithi045.stdout: -8826> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5600 now clean [inode 0x10000000514 [2,head] /dc-dir/dc-file_799 auth v5600 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.621261+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94743b80] 2023-10-03T19:21:17.945 INFO:teuthology.orchestra.run.smithi045.stdout: -8825> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000514) mark_clean [inode 0x10000000514 [2,head] /dc-dir/dc-file_799 auth v5600 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.621261+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94743b80] 2023-10-03T19:21:17.945 INFO:teuthology.orchestra.run.smithi045.stdout: -8824> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5600 now clean [dentry #0x1/dc-dir/dc-file_799 [2,head] auth (dversion lock) v=5600 ino=0x10000000514 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94741400] 2023-10-03T19:21:17.945 INFO:teuthology.orchestra.run.smithi045.stdout: -8823> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_799) mark_clean [dentry #0x1/dc-dir/dc-file_799 [2,head] auth (dversion lock) v=5600 ino=0x10000000514 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94741400] 2023-10-03T19:21:17.945 INFO:teuthology.orchestra.run.smithi045.stdout: -8822> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5602 now clean [inode 0x10000000515 [2,head] /dc-dir/dc-file_800 auth v5602 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.633573+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94744100] 2023-10-03T19:21:17.946 INFO:teuthology.orchestra.run.smithi045.stdout: -8821> 2023-10-03T19:18:09.833+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 302 ==== osd_op_reply(1996 10000000594.00000000 [create,setxattr (99),setxattr (30)] v74'18 uv18 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.946 INFO:teuthology.orchestra.run.smithi045.stdout: -8820> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000515) mark_clean [inode 0x10000000515 [2,head] /dc-dir/dc-file_800 auth v5602 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.633573+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94744100] 2023-10-03T19:21:17.946 INFO:teuthology.orchestra.run.smithi045.stdout: -8819> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5602 now clean [dentry #0x1/dc-dir/dc-file_800 [2,head] auth (dversion lock) v=5602 ino=0x10000000515 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94741680] 2023-10-03T19:21:17.946 INFO:teuthology.orchestra.run.smithi045.stdout: -8818> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_800) mark_clean [dentry #0x1/dc-dir/dc-file_800 [2,head] auth (dversion lock) v=5602 ino=0x10000000515 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94741680] 2023-10-03T19:21:17.946 INFO:teuthology.orchestra.run.smithi045.stdout: -8817> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5604 now clean [inode 0x10000000516 [2,head] /dc-dir/dc-file_801 auth v5604 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.646896+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94744680] 2023-10-03T19:21:17.946 INFO:teuthology.orchestra.run.smithi045.stdout: -8816> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000516) mark_clean [inode 0x10000000516 [2,head] /dc-dir/dc-file_801 auth v5604 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.646896+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94744680] 2023-10-03T19:21:17.946 INFO:teuthology.orchestra.run.smithi045.stdout: -8815> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5604 now clean [dentry #0x1/dc-dir/dc-file_801 [2,head] auth (dversion lock) v=5604 ino=0x10000000516 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94741900] 2023-10-03T19:21:17.946 INFO:teuthology.orchestra.run.smithi045.stdout: -8814> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_801) mark_clean [dentry #0x1/dc-dir/dc-file_801 [2,head] auth (dversion lock) v=5604 ino=0x10000000516 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94741900] 2023-10-03T19:21:17.946 INFO:teuthology.orchestra.run.smithi045.stdout: -8813> 2023-10-03T19:18:09.833+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 303 ==== osd_op_reply(1909 1000000053d.00000000 [create,setxattr (99),setxattr (30)] v74'31 uv31 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.946 INFO:teuthology.orchestra.run.smithi045.stdout: -8812> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5606 now clean [inode 0x10000000517 [2,head] /dc-dir/dc-file_802 auth v5606 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.660293+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94744c00] 2023-10-03T19:21:17.947 INFO:teuthology.orchestra.run.smithi045.stdout: -8811> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000517) mark_clean [inode 0x10000000517 [2,head] /dc-dir/dc-file_802 auth v5606 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.660293+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94744c00] 2023-10-03T19:21:17.947 INFO:teuthology.orchestra.run.smithi045.stdout: -8810> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5606 now clean [dentry #0x1/dc-dir/dc-file_802 [2,head] auth (dversion lock) v=5606 ino=0x10000000517 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94741b80] 2023-10-03T19:21:17.947 INFO:teuthology.orchestra.run.smithi045.stdout: -8809> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_802) mark_clean [dentry #0x1/dc-dir/dc-file_802 [2,head] auth (dversion lock) v=5606 ino=0x10000000517 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94741b80] 2023-10-03T19:21:17.947 INFO:teuthology.orchestra.run.smithi045.stdout: -8808> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5608 now clean [inode 0x10000000518 [2,head] /dc-dir/dc-file_803 auth v5608 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.673102+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94745180] 2023-10-03T19:21:17.947 INFO:teuthology.orchestra.run.smithi045.stdout: -8807> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000518) mark_clean [inode 0x10000000518 [2,head] /dc-dir/dc-file_803 auth v5608 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.673102+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94745180] 2023-10-03T19:21:17.947 INFO:teuthology.orchestra.run.smithi045.stdout: -8806> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5608 now clean [dentry #0x1/dc-dir/dc-file_803 [2,head] auth (dversion lock) v=5608 ino=0x10000000518 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9468a000] 2023-10-03T19:21:17.947 INFO:teuthology.orchestra.run.smithi045.stdout: -8805> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_803) mark_clean [dentry #0x1/dc-dir/dc-file_803 [2,head] auth (dversion lock) v=5608 ino=0x10000000518 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9468a000] 2023-10-03T19:21:17.947 INFO:teuthology.orchestra.run.smithi045.stdout: -8804> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5610 now clean [inode 0x10000000519 [2,head] /dc-dir/dc-file_804 auth v5610 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.685420+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94745700] 2023-10-03T19:21:17.947 INFO:teuthology.orchestra.run.smithi045.stdout: -8803> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000519) mark_clean [inode 0x10000000519 [2,head] /dc-dir/dc-file_804 auth v5610 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.685420+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94745700] 2023-10-03T19:21:17.947 INFO:teuthology.orchestra.run.smithi045.stdout: -8802> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5610 now clean [dentry #0x1/dc-dir/dc-file_804 [2,head] auth (dversion lock) v=5610 ino=0x10000000519 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9468a280] 2023-10-03T19:21:17.989 INFO:teuthology.orchestra.run.smithi045.stdout: -8801> 2023-10-03T19:18:09.833+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 304 ==== osd_op_reply(1981 10000000585.00000000 [create,setxattr (99),setxattr (30)] v74'32 uv32 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffd400 2023-10-03T19:21:17.990 INFO:teuthology.orchestra.run.smithi045.stdout: -8800> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_804) mark_clean [dentry #0x1/dc-dir/dc-file_804 [2,head] auth (dversion lock) v=5610 ino=0x10000000519 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9468a280] 2023-10-03T19:21:17.990 INFO:teuthology.orchestra.run.smithi045.stdout: -8799> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5612 now clean [inode 0x1000000051a [2,head] /dc-dir/dc-file_805 auth v5612 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.698950+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9468c000] 2023-10-03T19:21:17.990 INFO:teuthology.orchestra.run.smithi045.stdout: -8798> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000051a) mark_clean [inode 0x1000000051a [2,head] /dc-dir/dc-file_805 auth v5612 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.698950+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9468c000] 2023-10-03T19:21:17.990 INFO:teuthology.orchestra.run.smithi045.stdout: -8797> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5612 now clean [dentry #0x1/dc-dir/dc-file_805 [2,head] auth (dversion lock) v=5612 ino=0x1000000051a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9468a500] 2023-10-03T19:21:17.990 INFO:teuthology.orchestra.run.smithi045.stdout: -8796> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_805) mark_clean [dentry #0x1/dc-dir/dc-file_805 [2,head] auth (dversion lock) v=5612 ino=0x1000000051a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9468a500] 2023-10-03T19:21:17.990 INFO:teuthology.orchestra.run.smithi045.stdout: -8795> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5614 now clean [inode 0x1000000051b [2,head] /dc-dir/dc-file_806 auth v5614 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.711083+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9468c580] 2023-10-03T19:21:17.990 INFO:teuthology.orchestra.run.smithi045.stdout: -8794> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000051b) mark_clean [inode 0x1000000051b [2,head] /dc-dir/dc-file_806 auth v5614 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.711083+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9468c580] 2023-10-03T19:21:17.990 INFO:teuthology.orchestra.run.smithi045.stdout: -8793> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5614 now clean [dentry #0x1/dc-dir/dc-file_806 [2,head] auth (dversion lock) v=5614 ino=0x1000000051b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9468a780] 2023-10-03T19:21:17.990 INFO:teuthology.orchestra.run.smithi045.stdout: -8792> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_806) mark_clean [dentry #0x1/dc-dir/dc-file_806 [2,head] auth (dversion lock) v=5614 ino=0x1000000051b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9468a780] 2023-10-03T19:21:17.990 INFO:teuthology.orchestra.run.smithi045.stdout: -8791> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5616 now clean [inode 0x1000000051c [2,head] /dc-dir/dc-file_807 auth v5616 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.723345+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9468cb00] 2023-10-03T19:21:17.991 INFO:teuthology.orchestra.run.smithi045.stdout: -8790> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000051c) mark_clean [inode 0x1000000051c [2,head] /dc-dir/dc-file_807 auth v5616 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.723345+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9468cb00] 2023-10-03T19:21:17.991 INFO:teuthology.orchestra.run.smithi045.stdout: -8789> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5616 now clean [dentry #0x1/dc-dir/dc-file_807 [2,head] auth (dversion lock) v=5616 ino=0x1000000051c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9468aa00] 2023-10-03T19:21:17.991 INFO:teuthology.orchestra.run.smithi045.stdout: -8788> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_807) mark_clean [dentry #0x1/dc-dir/dc-file_807 [2,head] auth (dversion lock) v=5616 ino=0x1000000051c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9468aa00] 2023-10-03T19:21:17.991 INFO:teuthology.orchestra.run.smithi045.stdout: -8787> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5618 now clean [inode 0x1000000051d [2,head] /dc-dir/dc-file_808 auth v5618 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.735428+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9468d080] 2023-10-03T19:21:17.991 INFO:teuthology.orchestra.run.smithi045.stdout: -8786> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000051d) mark_clean [inode 0x1000000051d [2,head] /dc-dir/dc-file_808 auth v5618 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.735428+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9468d080] 2023-10-03T19:21:17.991 INFO:teuthology.orchestra.run.smithi045.stdout: -8785> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5618 now clean [dentry #0x1/dc-dir/dc-file_808 [2,head] auth (dversion lock) v=5618 ino=0x1000000051d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9468ac80] 2023-10-03T19:21:17.991 INFO:teuthology.orchestra.run.smithi045.stdout: -8784> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_808) mark_clean [dentry #0x1/dc-dir/dc-file_808 [2,head] auth (dversion lock) v=5618 ino=0x1000000051d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9468ac80] 2023-10-03T19:21:17.991 INFO:teuthology.orchestra.run.smithi045.stdout: -8783> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5620 now clean [inode 0x1000000051e [2,head] /dc-dir/dc-file_809 auth v5620 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.747323+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9468d600] 2023-10-03T19:21:17.991 INFO:teuthology.orchestra.run.smithi045.stdout: -8782> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000051e) mark_clean [inode 0x1000000051e [2,head] /dc-dir/dc-file_809 auth v5620 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.747323+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9468d600] 2023-10-03T19:21:17.991 INFO:teuthology.orchestra.run.smithi045.stdout: -8781> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5620 now clean [dentry #0x1/dc-dir/dc-file_809 [2,head] auth (dversion lock) v=5620 ino=0x1000000051e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9468af00] 2023-10-03T19:21:17.991 INFO:teuthology.orchestra.run.smithi045.stdout: -8780> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_809) mark_clean [dentry #0x1/dc-dir/dc-file_809 [2,head] auth (dversion lock) v=5620 ino=0x1000000051e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9468af00] 2023-10-03T19:21:17.992 INFO:teuthology.orchestra.run.smithi045.stdout: -8779> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5622 now clean [inode 0x1000000051f [2,head] /dc-dir/dc-file_810 auth v5622 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.759618+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9468db80] 2023-10-03T19:21:17.992 INFO:teuthology.orchestra.run.smithi045.stdout: -8778> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000051f) mark_clean [inode 0x1000000051f [2,head] /dc-dir/dc-file_810 auth v5622 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.759618+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9468db80] 2023-10-03T19:21:17.992 INFO:teuthology.orchestra.run.smithi045.stdout: -8777> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5622 now clean [dentry #0x1/dc-dir/dc-file_810 [2,head] auth (dversion lock) v=5622 ino=0x1000000051f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9468b180] 2023-10-03T19:21:17.992 INFO:teuthology.orchestra.run.smithi045.stdout: -8776> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_810) mark_clean [dentry #0x1/dc-dir/dc-file_810 [2,head] auth (dversion lock) v=5622 ino=0x1000000051f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9468b180] 2023-10-03T19:21:17.993 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:21:18.125 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2023-10-03T19:21:18.261 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:21:18.270 INFO:teuthology.orchestra.run.smithi045.stdout: -8775> 2023-10-03T19:18:09.833+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 142 ==== osd_op_reply(1589 100000003fe.00000000 [create,setxattr (99),setxattr (30)] v74'27 uv27 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:18.304 INFO:teuthology.orchestra.run.smithi045.stdout: -8774> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5624 now clean [inode 0x10000000520 [2,head] /dc-dir/dc-file_811 auth v5624 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.771972+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9468e100] 2023-10-03T19:21:18.304 INFO:teuthology.orchestra.run.smithi045.stdout: -8773> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000520) mark_clean [inode 0x10000000520 [2,head] /dc-dir/dc-file_811 auth v5624 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.771972+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9468e100] 2023-10-03T19:21:18.304 INFO:teuthology.orchestra.run.smithi045.stdout: -8772> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5624 now clean [dentry #0x1/dc-dir/dc-file_811 [2,head] auth (dversion lock) v=5624 ino=0x10000000520 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9468b400] 2023-10-03T19:21:18.304 INFO:teuthology.orchestra.run.smithi045.stdout: -8771> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_811) mark_clean [dentry #0x1/dc-dir/dc-file_811 [2,head] auth (dversion lock) v=5624 ino=0x10000000520 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9468b400] 2023-10-03T19:21:18.305 INFO:teuthology.orchestra.run.smithi045.stdout: -8770> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5626 now clean [inode 0x10000000521 [2,head] /dc-dir/dc-file_812 auth v5626 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.784179+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9468e680] 2023-10-03T19:21:18.305 INFO:teuthology.orchestra.run.smithi045.stdout: -8769> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000521) mark_clean [inode 0x10000000521 [2,head] /dc-dir/dc-file_812 auth v5626 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.784179+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9468e680] 2023-10-03T19:21:18.305 INFO:teuthology.orchestra.run.smithi045.stdout: -8768> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5626 now clean [dentry #0x1/dc-dir/dc-file_812 [2,head] auth (dversion lock) v=5626 ino=0x10000000521 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9468b680] 2023-10-03T19:21:18.305 INFO:teuthology.orchestra.run.smithi045.stdout: -8767> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_812) mark_clean [dentry #0x1/dc-dir/dc-file_812 [2,head] auth (dversion lock) v=5626 ino=0x10000000521 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9468b680] 2023-10-03T19:21:18.305 INFO:teuthology.orchestra.run.smithi045.stdout: -8766> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5628 now clean [inode 0x10000000522 [2,head] /dc-dir/dc-file_813 auth v5628 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.797114+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9468ec00] 2023-10-03T19:21:18.305 INFO:teuthology.orchestra.run.smithi045.stdout: -8765> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000522) mark_clean [inode 0x10000000522 [2,head] /dc-dir/dc-file_813 auth v5628 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.797114+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9468ec00] 2023-10-03T19:21:18.305 INFO:teuthology.orchestra.run.smithi045.stdout: -8764> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5628 now clean [dentry #0x1/dc-dir/dc-file_813 [2,head] auth (dversion lock) v=5628 ino=0x10000000522 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9468b900] 2023-10-03T19:21:18.305 INFO:teuthology.orchestra.run.smithi045.stdout: -8763> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_813) mark_clean [dentry #0x1/dc-dir/dc-file_813 [2,head] auth (dversion lock) v=5628 ino=0x10000000522 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9468b900] 2023-10-03T19:21:18.305 INFO:teuthology.orchestra.run.smithi045.stdout: -8762> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5630 now clean [inode 0x10000000523 [2,head] /dc-dir/dc-file_814 auth v5630 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.809388+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9468f180] 2023-10-03T19:21:18.305 INFO:teuthology.orchestra.run.smithi045.stdout: -8761> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000523) mark_clean [inode 0x10000000523 [2,head] /dc-dir/dc-file_814 auth v5630 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.809388+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9468f180] 2023-10-03T19:21:18.306 INFO:teuthology.orchestra.run.smithi045.stdout: -8760> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5630 now clean [dentry #0x1/dc-dir/dc-file_814 [2,head] auth (dversion lock) v=5630 ino=0x10000000523 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9468bb80] 2023-10-03T19:21:18.306 INFO:teuthology.orchestra.run.smithi045.stdout: -8759> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_814) mark_clean [dentry #0x1/dc-dir/dc-file_814 [2,head] auth (dversion lock) v=5630 ino=0x10000000523 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9468bb80] 2023-10-03T19:21:18.306 INFO:teuthology.orchestra.run.smithi045.stdout: -8758> 2023-10-03T19:18:09.833+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 143 ==== osd_op_reply(1612 10000000415.00000000 [create,setxattr (99),setxattr (30)] v74'28 uv28 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:18.306 INFO:teuthology.orchestra.run.smithi045.stdout: -8757> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5632 now clean [inode 0x10000000524 [2,head] /dc-dir/dc-file_815 auth v5632 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.822112+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9468f700] 2023-10-03T19:21:18.306 INFO:teuthology.orchestra.run.smithi045.stdout: -8756> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000524) mark_clean [inode 0x10000000524 [2,head] /dc-dir/dc-file_815 auth v5632 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.822112+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9468f700] 2023-10-03T19:21:18.306 INFO:teuthology.orchestra.run.smithi045.stdout: -8755> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5632 now clean [dentry #0x1/dc-dir/dc-file_815 [2,head] auth (dversion lock) v=5632 ino=0x10000000524 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94690000] 2023-10-03T19:21:18.306 INFO:teuthology.orchestra.run.smithi045.stdout: -8754> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_815) mark_clean [dentry #0x1/dc-dir/dc-file_815 [2,head] auth (dversion lock) v=5632 ino=0x10000000524 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94690000] 2023-10-03T19:21:18.306 INFO:teuthology.orchestra.run.smithi045.stdout: -8753> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5634 now clean [inode 0x10000000525 [2,head] /dc-dir/dc-file_816 auth v5634 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.834647+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94692000] 2023-10-03T19:21:18.306 INFO:teuthology.orchestra.run.smithi045.stdout: -8752> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000525) mark_clean [inode 0x10000000525 [2,head] /dc-dir/dc-file_816 auth v5634 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.834647+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94692000] 2023-10-03T19:21:18.307 INFO:teuthology.orchestra.run.smithi045.stdout: -8751> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5634 now clean [dentry #0x1/dc-dir/dc-file_816 [2,head] auth (dversion lock) v=5634 ino=0x10000000525 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94690280] 2023-10-03T19:21:18.307 INFO:teuthology.orchestra.run.smithi045.stdout: -8750> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_816) mark_clean [dentry #0x1/dc-dir/dc-file_816 [2,head] auth (dversion lock) v=5634 ino=0x10000000525 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94690280] 2023-10-03T19:21:18.307 INFO:teuthology.orchestra.run.smithi045.stdout: -8749> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5636 now clean [inode 0x10000000526 [2,head] /dc-dir/dc-file_817 auth v5636 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.847698+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94692580] 2023-10-03T19:21:18.307 INFO:teuthology.orchestra.run.smithi045.stdout: -8748> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000526) mark_clean [inode 0x10000000526 [2,head] /dc-dir/dc-file_817 auth v5636 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.847698+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94692580] 2023-10-03T19:21:18.307 INFO:teuthology.orchestra.run.smithi045.stdout: -8747> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5636 now clean [dentry #0x1/dc-dir/dc-file_817 [2,head] auth (dversion lock) v=5636 ino=0x10000000526 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94690500] 2023-10-03T19:21:18.307 INFO:teuthology.orchestra.run.smithi045.stdout: -8746> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_817) mark_clean [dentry #0x1/dc-dir/dc-file_817 [2,head] auth (dversion lock) v=5636 ino=0x10000000526 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94690500] 2023-10-03T19:21:18.307 INFO:teuthology.orchestra.run.smithi045.stdout: -8745> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5638 now clean [inode 0x10000000527 [2,head] /dc-dir/dc-file_818 auth v5638 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.859836+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94692b00] 2023-10-03T19:21:18.307 INFO:teuthology.orchestra.run.smithi045.stdout: -8744> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000527) mark_clean [inode 0x10000000527 [2,head] /dc-dir/dc-file_818 auth v5638 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.859836+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94692b00] 2023-10-03T19:21:18.307 INFO:teuthology.orchestra.run.smithi045.stdout: -8743> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5638 now clean [dentry #0x1/dc-dir/dc-file_818 [2,head] auth (dversion lock) v=5638 ino=0x10000000527 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94690780] 2023-10-03T19:21:18.307 INFO:teuthology.orchestra.run.smithi045.stdout: -8742> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_818) mark_clean [dentry #0x1/dc-dir/dc-file_818 [2,head] auth (dversion lock) v=5638 ino=0x10000000527 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94690780] 2023-10-03T19:21:18.307 INFO:teuthology.orchestra.run.smithi045.stdout: -8741> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5640 now clean [inode 0x10000000528 [2,head] /dc-dir/dc-file_819 auth v5640 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.871619+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94693080] 2023-10-03T19:21:18.308 INFO:teuthology.orchestra.run.smithi045.stdout: -8740> 2023-10-03T19:18:09.833+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 144 ==== osd_op_reply(1663 10000000448.00000000 [create,setxattr (99),setxattr (30)] v74'29 uv29 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:18.308 INFO:teuthology.orchestra.run.smithi045.stdout: -8739> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000528) mark_clean [inode 0x10000000528 [2,head] /dc-dir/dc-file_819 auth v5640 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.871619+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94693080] 2023-10-03T19:21:18.308 INFO:teuthology.orchestra.run.smithi045.stdout: -8738> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5640 now clean [dentry #0x1/dc-dir/dc-file_819 [2,head] auth (dversion lock) v=5640 ino=0x10000000528 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94690a00] 2023-10-03T19:21:18.308 INFO:teuthology.orchestra.run.smithi045.stdout: -8737> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_819) mark_clean [dentry #0x1/dc-dir/dc-file_819 [2,head] auth (dversion lock) v=5640 ino=0x10000000528 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94690a00] 2023-10-03T19:21:18.308 INFO:teuthology.orchestra.run.smithi045.stdout: -8736> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5642 now clean [inode 0x10000000529 [2,head] /dc-dir/dc-file_820 auth v5642 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.884127+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94693600] 2023-10-03T19:21:18.308 INFO:teuthology.orchestra.run.smithi045.stdout: -8735> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000529) mark_clean [inode 0x10000000529 [2,head] /dc-dir/dc-file_820 auth v5642 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.884127+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94693600] 2023-10-03T19:21:18.308 INFO:teuthology.orchestra.run.smithi045.stdout: -8734> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5642 now clean [dentry #0x1/dc-dir/dc-file_820 [2,head] auth (dversion lock) v=5642 ino=0x10000000529 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94690c80] 2023-10-03T19:21:18.308 INFO:teuthology.orchestra.run.smithi045.stdout: -8733> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_820) mark_clean [dentry #0x1/dc-dir/dc-file_820 [2,head] auth (dversion lock) v=5642 ino=0x10000000529 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94690c80] 2023-10-03T19:21:18.308 INFO:teuthology.orchestra.run.smithi045.stdout: -8732> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5644 now clean [inode 0x1000000052a [2,head] /dc-dir/dc-file_821 auth v5644 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.897318+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94693b80] 2023-10-03T19:21:18.308 INFO:teuthology.orchestra.run.smithi045.stdout: -8731> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000052a) mark_clean [inode 0x1000000052a [2,head] /dc-dir/dc-file_821 auth v5644 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.897318+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94693b80] 2023-10-03T19:21:18.308 INFO:teuthology.orchestra.run.smithi045.stdout: -8730> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5644 now clean [dentry #0x1/dc-dir/dc-file_821 [2,head] auth (dversion lock) v=5644 ino=0x1000000052a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94690f00] 2023-10-03T19:21:18.308 INFO:teuthology.orchestra.run.smithi045.stdout: -8729> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_821) mark_clean [dentry #0x1/dc-dir/dc-file_821 [2,head] auth (dversion lock) v=5644 ino=0x1000000052a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94690f00] 2023-10-03T19:21:18.309 INFO:teuthology.orchestra.run.smithi045.stdout: -8728> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5646 now clean [inode 0x1000000052b [2,head] /dc-dir/dc-file_822 auth v5646 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.909595+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94694100] 2023-10-03T19:21:18.309 INFO:teuthology.orchestra.run.smithi045.stdout: -8727> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000052b) mark_clean [inode 0x1000000052b [2,head] /dc-dir/dc-file_822 auth v5646 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.909595+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94694100] 2023-10-03T19:21:18.309 INFO:teuthology.orchestra.run.smithi045.stdout: -8726> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5646 now clean [dentry #0x1/dc-dir/dc-file_822 [2,head] auth (dversion lock) v=5646 ino=0x1000000052b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94691180] 2023-10-03T19:21:18.309 INFO:teuthology.orchestra.run.smithi045.stdout: -8725> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_822) mark_clean [dentry #0x1/dc-dir/dc-file_822 [2,head] auth (dversion lock) v=5646 ino=0x1000000052b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94691180] 2023-10-03T19:21:18.309 INFO:teuthology.orchestra.run.smithi045.stdout: -8724> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5648 now clean [inode 0x1000000052c [2,head] /dc-dir/dc-file_823 auth v5648 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.923564+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94694680] 2023-10-03T19:21:18.309 INFO:teuthology.orchestra.run.smithi045.stdout: -8723> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000052c) mark_clean [inode 0x1000000052c [2,head] /dc-dir/dc-file_823 auth v5648 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.923564+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94694680] 2023-10-03T19:21:18.309 INFO:teuthology.orchestra.run.smithi045.stdout: -8722> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5648 now clean [dentry #0x1/dc-dir/dc-file_823 [2,head] auth (dversion lock) v=5648 ino=0x1000000052c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94691400] 2023-10-03T19:21:18.309 INFO:teuthology.orchestra.run.smithi045.stdout: -8721> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_823) mark_clean [dentry #0x1/dc-dir/dc-file_823 [2,head] auth (dversion lock) v=5648 ino=0x1000000052c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94691400] 2023-10-03T19:21:18.309 INFO:teuthology.orchestra.run.smithi045.stdout: -8720> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5650 now clean [inode 0x1000000052d [2,head] /dc-dir/dc-file_824 auth v5650 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.936393+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94694c00] 2023-10-03T19:21:18.310 INFO:teuthology.orchestra.run.smithi045.stdout: -8719> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000052d) mark_clean [inode 0x1000000052d [2,head] /dc-dir/dc-file_824 auth v5650 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.936393+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94694c00] 2023-10-03T19:21:18.310 INFO:teuthology.orchestra.run.smithi045.stdout: -8718> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5650 now clean [dentry #0x1/dc-dir/dc-file_824 [2,head] auth (dversion lock) v=5650 ino=0x1000000052d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94691680] 2023-10-03T19:21:18.310 INFO:teuthology.orchestra.run.smithi045.stdout: -8717> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_824) mark_clean [dentry #0x1/dc-dir/dc-file_824 [2,head] auth (dversion lock) v=5650 ino=0x1000000052d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94691680] 2023-10-03T19:21:18.310 INFO:teuthology.orchestra.run.smithi045.stdout: -8716> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5652 now clean [inode 0x1000000052e [2,head] /dc-dir/dc-file_825 auth v5652 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.949585+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94695180] 2023-10-03T19:21:18.310 INFO:teuthology.orchestra.run.smithi045.stdout: -8715> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000052e) mark_clean [inode 0x1000000052e [2,head] /dc-dir/dc-file_825 auth v5652 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.949585+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94695180] 2023-10-03T19:21:18.310 INFO:teuthology.orchestra.run.smithi045.stdout: -8714> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5652 now clean [dentry #0x1/dc-dir/dc-file_825 [2,head] auth (dversion lock) v=5652 ino=0x1000000052e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94691900] 2023-10-03T19:21:18.310 INFO:teuthology.orchestra.run.smithi045.stdout: -8713> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_825) mark_clean [dentry #0x1/dc-dir/dc-file_825 [2,head] auth (dversion lock) v=5652 ino=0x1000000052e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94691900] 2023-10-03T19:21:18.310 INFO:teuthology.orchestra.run.smithi045.stdout: -8712> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5654 now clean [inode 0x1000000052f [2,head] /dc-dir/dc-file_826 auth v5654 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.962272+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94695700] 2023-10-03T19:21:18.310 INFO:teuthology.orchestra.run.smithi045.stdout: -8711> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000052f) mark_clean [inode 0x1000000052f [2,head] /dc-dir/dc-file_826 auth v5654 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.962272+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94695700] 2023-10-03T19:21:18.310 INFO:teuthology.orchestra.run.smithi045.stdout: -8710> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5654 now clean [dentry #0x1/dc-dir/dc-file_826 [2,head] auth (dversion lock) v=5654 ino=0x1000000052f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94691b80] 2023-10-03T19:21:18.310 INFO:teuthology.orchestra.run.smithi045.stdout: -8709> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_826) mark_clean [dentry #0x1/dc-dir/dc-file_826 [2,head] auth (dversion lock) v=5654 ino=0x1000000052f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94691b80] 2023-10-03T19:21:18.311 INFO:teuthology.orchestra.run.smithi045.stdout: -8708> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5656 now clean [inode 0x10000000530 [2,head] /dc-dir/dc-file_827 auth v5656 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.975092+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9469c000] 2023-10-03T19:21:18.334 INFO:teuthology.orchestra.run.smithi045.stdout: -8707> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000530) mark_clean [inode 0x10000000530 [2,head] /dc-dir/dc-file_827 auth v5656 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.975092+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9469c000] 2023-10-03T19:21:18.334 INFO:teuthology.orchestra.run.smithi045.stdout: -8706> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5656 now clean [dentry #0x1/dc-dir/dc-file_827 [2,head] auth (dversion lock) v=5656 ino=0x10000000530 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9469a000] 2023-10-03T19:21:18.334 INFO:teuthology.orchestra.run.smithi045.stdout: -8705> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_827) mark_clean [dentry #0x1/dc-dir/dc-file_827 [2,head] auth (dversion lock) v=5656 ino=0x10000000530 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9469a000] 2023-10-03T19:21:18.335 INFO:teuthology.orchestra.run.smithi045.stdout: -8704> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5658 now clean [inode 0x10000000531 [2,head] /dc-dir/dc-file_828 auth v5658 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.988309+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9469c580] 2023-10-03T19:21:18.335 INFO:teuthology.orchestra.run.smithi045.stdout: -8703> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000531) mark_clean [inode 0x10000000531 [2,head] /dc-dir/dc-file_828 auth v5658 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.988309+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9469c580] 2023-10-03T19:21:18.335 INFO:teuthology.orchestra.run.smithi045.stdout: -8702> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5658 now clean [dentry #0x1/dc-dir/dc-file_828 [2,head] auth (dversion lock) v=5658 ino=0x10000000531 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9469a280] 2023-10-03T19:21:18.335 INFO:teuthology.orchestra.run.smithi045.stdout: -8701> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_828) mark_clean [dentry #0x1/dc-dir/dc-file_828 [2,head] auth (dversion lock) v=5658 ino=0x10000000531 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9469a280] 2023-10-03T19:21:18.335 INFO:teuthology.orchestra.run.smithi045.stdout: -8700> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5660 now clean [inode 0x10000000532 [2,head] /dc-dir/dc-file_829 auth v5660 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.000219+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9469cb00] 2023-10-03T19:21:18.335 INFO:teuthology.orchestra.run.smithi045.stdout: -8699> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000532) mark_clean [inode 0x10000000532 [2,head] /dc-dir/dc-file_829 auth v5660 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.000219+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9469cb00] 2023-10-03T19:21:18.335 INFO:teuthology.orchestra.run.smithi045.stdout: -8698> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5660 now clean [dentry #0x1/dc-dir/dc-file_829 [2,head] auth (dversion lock) v=5660 ino=0x10000000532 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9469a500] 2023-10-03T19:21:18.336 INFO:teuthology.orchestra.run.smithi045.stdout: -8697> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_829) mark_clean [dentry #0x1/dc-dir/dc-file_829 [2,head] auth (dversion lock) v=5660 ino=0x10000000532 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9469a500] 2023-10-03T19:21:18.336 INFO:teuthology.orchestra.run.smithi045.stdout: -8696> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5662 now clean [inode 0x10000000533 [2,head] /dc-dir/dc-file_830 auth v5662 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.013296+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9469d080] 2023-10-03T19:21:18.336 INFO:teuthology.orchestra.run.smithi045.stdout: -8695> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000533) mark_clean [inode 0x10000000533 [2,head] /dc-dir/dc-file_830 auth v5662 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.013296+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9469d080] 2023-10-03T19:21:18.336 INFO:teuthology.orchestra.run.smithi045.stdout: -8694> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5662 now clean [dentry #0x1/dc-dir/dc-file_830 [2,head] auth (dversion lock) v=5662 ino=0x10000000533 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9469a780] 2023-10-03T19:21:18.336 INFO:teuthology.orchestra.run.smithi045.stdout: -8693> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_830) mark_clean [dentry #0x1/dc-dir/dc-file_830 [2,head] auth (dversion lock) v=5662 ino=0x10000000533 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9469a780] 2023-10-03T19:21:18.336 INFO:teuthology.orchestra.run.smithi045.stdout: -8692> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5664 now clean [inode 0x10000000534 [2,head] /dc-dir/dc-file_831 auth v5664 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.027269+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9469d600] 2023-10-03T19:21:18.336 INFO:teuthology.orchestra.run.smithi045.stdout: -8691> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000534) mark_clean [inode 0x10000000534 [2,head] /dc-dir/dc-file_831 auth v5664 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.027269+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9469d600] 2023-10-03T19:21:18.336 INFO:teuthology.orchestra.run.smithi045.stdout: -8690> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5664 now clean [dentry #0x1/dc-dir/dc-file_831 [2,head] auth (dversion lock) v=5664 ino=0x10000000534 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9469aa00] 2023-10-03T19:21:18.336 INFO:teuthology.orchestra.run.smithi045.stdout: -8689> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_831) mark_clean [dentry #0x1/dc-dir/dc-file_831 [2,head] auth (dversion lock) v=5664 ino=0x10000000534 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9469aa00] 2023-10-03T19:21:18.336 INFO:teuthology.orchestra.run.smithi045.stdout: -8688> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5666 now clean [inode 0x10000000535 [2,head] /dc-dir/dc-file_832 auth v5666 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.040839+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9469db80] 2023-10-03T19:21:18.336 INFO:teuthology.orchestra.run.smithi045.stdout: -8687> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000535) mark_clean [inode 0x10000000535 [2,head] /dc-dir/dc-file_832 auth v5666 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.040839+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9469db80] 2023-10-03T19:21:18.337 INFO:teuthology.orchestra.run.smithi045.stdout: -8686> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5666 now clean [dentry #0x1/dc-dir/dc-file_832 [2,head] auth (dversion lock) v=5666 ino=0x10000000535 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9469ac80] 2023-10-03T19:21:18.337 INFO:teuthology.orchestra.run.smithi045.stdout: -8685> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_832) mark_clean [dentry #0x1/dc-dir/dc-file_832 [2,head] auth (dversion lock) v=5666 ino=0x10000000535 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9469ac80] 2023-10-03T19:21:18.337 INFO:teuthology.orchestra.run.smithi045.stdout: -8684> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5668 now clean [inode 0x10000000536 [2,head] /dc-dir/dc-file_833 auth v5668 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.054604+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9469e100] 2023-10-03T19:21:18.337 INFO:teuthology.orchestra.run.smithi045.stdout: -8683> 2023-10-03T19:18:09.833+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 145 ==== osd_op_reply(1834 100000004f3.00000000 [create,setxattr (99),setxattr (30)] v74'30 uv30 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:18.337 INFO:teuthology.orchestra.run.smithi045.stdout: -8682> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000536) mark_clean [inode 0x10000000536 [2,head] /dc-dir/dc-file_833 auth v5668 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.054604+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9469e100] 2023-10-03T19:21:18.337 INFO:teuthology.orchestra.run.smithi045.stdout: -8681> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5668 now clean [dentry #0x1/dc-dir/dc-file_833 [2,head] auth (dversion lock) v=5668 ino=0x10000000536 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9469af00] 2023-10-03T19:21:18.337 INFO:teuthology.orchestra.run.smithi045.stdout: -8680> 2023-10-03T19:18:09.833+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 146 ==== osd_op_reply(1836 100000004f5.00000000 [create,setxattr (99),setxattr (30)] v74'31 uv31 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:18.337 INFO:teuthology.orchestra.run.smithi045.stdout: -8679> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_833) mark_clean [dentry #0x1/dc-dir/dc-file_833 [2,head] auth (dversion lock) v=5668 ino=0x10000000536 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9469af00] 2023-10-03T19:21:18.337 INFO:teuthology.orchestra.run.smithi045.stdout: -8678> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5670 now clean [inode 0x10000000537 [2,head] /dc-dir/dc-file_834 auth v5670 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.067841+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9469e680] 2023-10-03T19:21:18.337 INFO:teuthology.orchestra.run.smithi045.stdout: -8677> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000537) mark_clean [inode 0x10000000537 [2,head] /dc-dir/dc-file_834 auth v5670 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.067841+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9469e680] 2023-10-03T19:21:18.338 INFO:teuthology.orchestra.run.smithi045.stdout: -8676> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5670 now clean [dentry #0x1/dc-dir/dc-file_834 [2,head] auth (dversion lock) v=5670 ino=0x10000000537 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9469b180] 2023-10-03T19:21:18.338 INFO:teuthology.orchestra.run.smithi045.stdout: -8675> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_834) mark_clean [dentry #0x1/dc-dir/dc-file_834 [2,head] auth (dversion lock) v=5670 ino=0x10000000537 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9469b180] 2023-10-03T19:21:18.338 INFO:teuthology.orchestra.run.smithi045.stdout: -8674> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5672 now clean [inode 0x10000000538 [2,head] /dc-dir/dc-file_835 auth v5672 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.079693+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9469ec00] 2023-10-03T19:21:18.338 INFO:teuthology.orchestra.run.smithi045.stdout: -8673> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000538) mark_clean [inode 0x10000000538 [2,head] /dc-dir/dc-file_835 auth v5672 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.079693+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9469ec00] 2023-10-03T19:21:18.338 INFO:teuthology.orchestra.run.smithi045.stdout: -8672> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5672 now clean [dentry #0x1/dc-dir/dc-file_835 [2,head] auth (dversion lock) v=5672 ino=0x10000000538 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9469b400] 2023-10-03T19:21:18.338 INFO:teuthology.orchestra.run.smithi045.stdout: -8671> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_835) mark_clean [dentry #0x1/dc-dir/dc-file_835 [2,head] auth (dversion lock) v=5672 ino=0x10000000538 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9469b400] 2023-10-03T19:21:18.338 INFO:teuthology.orchestra.run.smithi045.stdout: -8670> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5674 now clean [inode 0x10000000539 [2,head] /dc-dir/dc-file_836 auth v5674 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.092371+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9469f180] 2023-10-03T19:21:18.338 INFO:teuthology.orchestra.run.smithi045.stdout: -8669> 2023-10-03T19:18:09.833+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 147 ==== osd_op_reply(1904 10000000539.00000000 [create,setxattr (99),setxattr (30)] v74'32 uv32 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:18.338 INFO:teuthology.orchestra.run.smithi045.stdout: -8668> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000539) mark_clean [inode 0x10000000539 [2,head] /dc-dir/dc-file_836 auth v5674 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.092371+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9469f180] 2023-10-03T19:21:18.338 INFO:teuthology.orchestra.run.smithi045.stdout: -8667> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5674 now clean [dentry #0x1/dc-dir/dc-file_836 [2,head] auth (dversion lock) v=5674 ino=0x10000000539 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9469b680] 2023-10-03T19:21:18.339 INFO:teuthology.orchestra.run.smithi045.stdout: -8666> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_836) mark_clean [dentry #0x1/dc-dir/dc-file_836 [2,head] auth (dversion lock) v=5674 ino=0x10000000539 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9469b680] 2023-10-03T19:21:18.339 INFO:teuthology.orchestra.run.smithi045.stdout: -8665> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5676 now clean [inode 0x1000000053a [2,head] /dc-dir/dc-file_837 auth v5676 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.178132+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9469f700] 2023-10-03T19:21:18.339 INFO:teuthology.orchestra.run.smithi045.stdout: -8664> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000053a) mark_clean [inode 0x1000000053a [2,head] /dc-dir/dc-file_837 auth v5676 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.178132+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9469f700] 2023-10-03T19:21:18.339 INFO:teuthology.orchestra.run.smithi045.stdout: -8663> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5676 now clean [dentry #0x1/dc-dir/dc-file_837 [2,head] auth (dversion lock) v=5676 ino=0x1000000053a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9469b900] 2023-10-03T19:21:18.339 INFO:teuthology.orchestra.run.smithi045.stdout: -8662> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_837) mark_clean [dentry #0x1/dc-dir/dc-file_837 [2,head] auth (dversion lock) v=5676 ino=0x1000000053a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9469b900] 2023-10-03T19:21:18.339 INFO:teuthology.orchestra.run.smithi045.stdout: -8661> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5678 now clean [inode 0x1000000053b [2,head] /dc-dir/dc-file_838 auth v5678 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.220090+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946ae000] 2023-10-03T19:21:18.339 INFO:teuthology.orchestra.run.smithi045.stdout: -8660> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000053b) mark_clean [inode 0x1000000053b [2,head] /dc-dir/dc-file_838 auth v5678 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.220090+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946ae000] 2023-10-03T19:21:18.339 INFO:teuthology.orchestra.run.smithi045.stdout: -8659> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5678 now clean [dentry #0x1/dc-dir/dc-file_838 [2,head] auth (dversion lock) v=5678 ino=0x1000000053b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9469bb80] 2023-10-03T19:21:18.339 INFO:teuthology.orchestra.run.smithi045.stdout: -8658> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_838) mark_clean [dentry #0x1/dc-dir/dc-file_838 [2,head] auth (dversion lock) v=5678 ino=0x1000000053b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9469bb80] 2023-10-03T19:21:18.339 INFO:teuthology.orchestra.run.smithi045.stdout: -8657> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5680 now clean [inode 0x1000000053c [2,head] /dc-dir/dc-file_839 auth v5680 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.233672+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946ae580] 2023-10-03T19:21:18.339 INFO:teuthology.orchestra.run.smithi045.stdout: -8656> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000053c) mark_clean [inode 0x1000000053c [2,head] /dc-dir/dc-file_839 auth v5680 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.233672+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946ae580] 2023-10-03T19:21:18.340 INFO:teuthology.orchestra.run.smithi045.stdout: -8655> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5680 now clean [dentry #0x1/dc-dir/dc-file_839 [2,head] auth (dversion lock) v=5680 ino=0x1000000053c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946b4000] 2023-10-03T19:21:18.340 INFO:teuthology.orchestra.run.smithi045.stdout: -8654> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_839) mark_clean [dentry #0x1/dc-dir/dc-file_839 [2,head] auth (dversion lock) v=5680 ino=0x1000000053c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946b4000] 2023-10-03T19:21:18.340 INFO:teuthology.orchestra.run.smithi045.stdout: -8653> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5682 now clean [inode 0x1000000053d [2,head] /dc-dir/dc-file_840 auth v5682 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.245482+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946aeb00] 2023-10-03T19:21:18.340 INFO:teuthology.orchestra.run.smithi045.stdout: -8652> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000053d) mark_clean [inode 0x1000000053d [2,head] /dc-dir/dc-file_840 auth v5682 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.245482+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946aeb00] 2023-10-03T19:21:18.340 INFO:teuthology.orchestra.run.smithi045.stdout: -8651> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5682 now clean [dentry #0x1/dc-dir/dc-file_840 [2,head] auth (dversion lock) v=5682 ino=0x1000000053d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946b4280] 2023-10-03T19:21:18.340 INFO:teuthology.orchestra.run.smithi045.stdout: -8650> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_840) mark_clean [dentry #0x1/dc-dir/dc-file_840 [2,head] auth (dversion lock) v=5682 ino=0x1000000053d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946b4280] 2023-10-03T19:21:18.340 INFO:teuthology.orchestra.run.smithi045.stdout: -8649> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5684 now clean [inode 0x1000000053e [2,head] /dc-dir/dc-file_841 auth v5684 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.256120+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946af080] 2023-10-03T19:21:18.340 INFO:teuthology.orchestra.run.smithi045.stdout: -8648> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000053e) mark_clean [inode 0x1000000053e [2,head] /dc-dir/dc-file_841 auth v5684 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.256120+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946af080] 2023-10-03T19:21:18.410 INFO:teuthology.orchestra.run.smithi045.stdout: -8647> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5684 now clean [dentry #0x1/dc-dir/dc-file_841 [2,head] auth (dversion lock) v=5684 ino=0x1000000053e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946b4500] 2023-10-03T19:21:18.410 INFO:teuthology.orchestra.run.smithi045.stdout: -8646> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_841) mark_clean [dentry #0x1/dc-dir/dc-file_841 [2,head] auth (dversion lock) v=5684 ino=0x1000000053e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946b4500] 2023-10-03T19:21:18.411 INFO:teuthology.orchestra.run.smithi045.stdout: -8645> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5686 now clean [inode 0x1000000053f [2,head] /dc-dir/dc-file_842 auth v5686 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.267334+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946af600] 2023-10-03T19:21:18.411 INFO:teuthology.orchestra.run.smithi045.stdout: -8644> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000053f) mark_clean [inode 0x1000000053f [2,head] /dc-dir/dc-file_842 auth v5686 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.267334+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946af600] 2023-10-03T19:21:18.411 INFO:teuthology.orchestra.run.smithi045.stdout: -8643> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5686 now clean [dentry #0x1/dc-dir/dc-file_842 [2,head] auth (dversion lock) v=5686 ino=0x1000000053f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946b4780] 2023-10-03T19:21:18.411 INFO:teuthology.orchestra.run.smithi045.stdout: -8642> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_842) mark_clean [dentry #0x1/dc-dir/dc-file_842 [2,head] auth (dversion lock) v=5686 ino=0x1000000053f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946b4780] 2023-10-03T19:21:18.411 INFO:teuthology.orchestra.run.smithi045.stdout: -8641> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5688 now clean [inode 0x10000000540 [2,head] /dc-dir/dc-file_843 auth v5688 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.278182+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946afb80] 2023-10-03T19:21:18.412 INFO:teuthology.orchestra.run.smithi045.stdout: -8640> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000540) mark_clean [inode 0x10000000540 [2,head] /dc-dir/dc-file_843 auth v5688 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.278182+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946afb80] 2023-10-03T19:21:18.412 INFO:teuthology.orchestra.run.smithi045.stdout: -8639> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5688 now clean [dentry #0x1/dc-dir/dc-file_843 [2,head] auth (dversion lock) v=5688 ino=0x10000000540 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946b4a00] 2023-10-03T19:21:18.412 INFO:teuthology.orchestra.run.smithi045.stdout: -8638> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_843) mark_clean [dentry #0x1/dc-dir/dc-file_843 [2,head] auth (dversion lock) v=5688 ino=0x10000000540 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946b4a00] 2023-10-03T19:21:18.412 INFO:teuthology.orchestra.run.smithi045.stdout: -8637> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5690 now clean [inode 0x10000000541 [2,head] /dc-dir/dc-file_844 auth v5690 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.290367+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946b0100] 2023-10-03T19:21:18.412 INFO:teuthology.orchestra.run.smithi045.stdout: -8636> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000541) mark_clean [inode 0x10000000541 [2,head] /dc-dir/dc-file_844 auth v5690 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.290367+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946b0100] 2023-10-03T19:21:18.413 INFO:teuthology.orchestra.run.smithi045.stdout: -8635> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5690 now clean [dentry #0x1/dc-dir/dc-file_844 [2,head] auth (dversion lock) v=5690 ino=0x10000000541 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946b4c80] 2023-10-03T19:21:18.413 INFO:teuthology.orchestra.run.smithi045.stdout: -8634> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_844) mark_clean [dentry #0x1/dc-dir/dc-file_844 [2,head] auth (dversion lock) v=5690 ino=0x10000000541 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946b4c80] 2023-10-03T19:21:18.413 INFO:teuthology.orchestra.run.smithi045.stdout: -8633> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5692 now clean [inode 0x10000000542 [2,head] /dc-dir/dc-file_845 auth v5692 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.301930+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946b0680] 2023-10-03T19:21:18.413 INFO:teuthology.orchestra.run.smithi045.stdout: -8632> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000542) mark_clean [inode 0x10000000542 [2,head] /dc-dir/dc-file_845 auth v5692 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.301930+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946b0680] 2023-10-03T19:21:18.413 INFO:teuthology.orchestra.run.smithi045.stdout: -8631> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5692 now clean [dentry #0x1/dc-dir/dc-file_845 [2,head] auth (dversion lock) v=5692 ino=0x10000000542 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946b4f00] 2023-10-03T19:21:18.414 INFO:teuthology.orchestra.run.smithi045.stdout: -8630> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_845) mark_clean [dentry #0x1/dc-dir/dc-file_845 [2,head] auth (dversion lock) v=5692 ino=0x10000000542 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946b4f00] 2023-10-03T19:21:18.414 INFO:teuthology.orchestra.run.smithi045.stdout: -8629> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5694 now clean [inode 0x10000000543 [2,head] /dc-dir/dc-file_846 auth v5694 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.313806+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946b0c00] 2023-10-03T19:21:18.414 INFO:teuthology.orchestra.run.smithi045.stdout: -8628> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000543) mark_clean [inode 0x10000000543 [2,head] /dc-dir/dc-file_846 auth v5694 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.313806+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946b0c00] 2023-10-03T19:21:18.414 INFO:teuthology.orchestra.run.smithi045.stdout: -8627> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5694 now clean [dentry #0x1/dc-dir/dc-file_846 [2,head] auth (dversion lock) v=5694 ino=0x10000000543 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946b5180] 2023-10-03T19:21:18.414 INFO:teuthology.orchestra.run.smithi045.stdout: -8626> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_846) mark_clean [dentry #0x1/dc-dir/dc-file_846 [2,head] auth (dversion lock) v=5694 ino=0x10000000543 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946b5180] 2023-10-03T19:21:18.415 INFO:teuthology.orchestra.run.smithi045.stdout: -8625> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5696 now clean [inode 0x10000000544 [2,head] /dc-dir/dc-file_847 auth v5696 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.325401+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946b1180] 2023-10-03T19:21:18.415 INFO:teuthology.orchestra.run.smithi045.stdout: -8624> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000544) mark_clean [inode 0x10000000544 [2,head] /dc-dir/dc-file_847 auth v5696 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.325401+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946b1180] 2023-10-03T19:21:18.415 INFO:teuthology.orchestra.run.smithi045.stdout: -8623> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5696 now clean [dentry #0x1/dc-dir/dc-file_847 [2,head] auth (dversion lock) v=5696 ino=0x10000000544 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946b5400] 2023-10-03T19:21:18.415 INFO:teuthology.orchestra.run.smithi045.stdout: -8622> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_847) mark_clean [dentry #0x1/dc-dir/dc-file_847 [2,head] auth (dversion lock) v=5696 ino=0x10000000544 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946b5400] 2023-10-03T19:21:18.415 INFO:teuthology.orchestra.run.smithi045.stdout: -8621> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5698 now clean [inode 0x10000000545 [2,head] /dc-dir/dc-file_848 auth v5698 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.337271+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946b1700] 2023-10-03T19:21:18.415 INFO:teuthology.orchestra.run.smithi045.stdout: -8620> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000545) mark_clean [inode 0x10000000545 [2,head] /dc-dir/dc-file_848 auth v5698 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.337271+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946b1700] 2023-10-03T19:21:18.415 INFO:teuthology.orchestra.run.smithi045.stdout: -8619> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5698 now clean [dentry #0x1/dc-dir/dc-file_848 [2,head] auth (dversion lock) v=5698 ino=0x10000000545 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946b5680] 2023-10-03T19:21:18.415 INFO:teuthology.orchestra.run.smithi045.stdout: -8618> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_848) mark_clean [dentry #0x1/dc-dir/dc-file_848 [2,head] auth (dversion lock) v=5698 ino=0x10000000545 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946b5680] 2023-10-03T19:21:18.415 INFO:teuthology.orchestra.run.smithi045.stdout: -8617> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5700 now clean [inode 0x10000000546 [2,head] /dc-dir/dc-file_849 auth v5700 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.348661+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946b8000] 2023-10-03T19:21:18.416 INFO:teuthology.orchestra.run.smithi045.stdout: -8616> 2023-10-03T19:18:09.833+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 118 ==== osd_op_reply(1372 10000000325.00000000 [create,setxattr (99),setxattr (30)] v74'17 uv17 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:18.416 INFO:teuthology.orchestra.run.smithi045.stdout: -8615> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000546) mark_clean [inode 0x10000000546 [2,head] /dc-dir/dc-file_849 auth v5700 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.348661+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946b8000] 2023-10-03T19:21:18.416 INFO:teuthology.orchestra.run.smithi045.stdout: -8614> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5700 now clean [dentry #0x1/dc-dir/dc-file_849 [2,head] auth (dversion lock) v=5700 ino=0x10000000546 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946b5900] 2023-10-03T19:21:18.416 INFO:teuthology.orchestra.run.smithi045.stdout: -8613> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_849) mark_clean [dentry #0x1/dc-dir/dc-file_849 [2,head] auth (dversion lock) v=5700 ino=0x10000000546 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946b5900] 2023-10-03T19:21:18.416 INFO:teuthology.orchestra.run.smithi045.stdout: -8612> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5702 now clean [inode 0x10000000547 [2,head] /dc-dir/dc-file_850 auth v5702 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.360083+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946b8580] 2023-10-03T19:21:18.416 INFO:teuthology.orchestra.run.smithi045.stdout: -8611> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000547) mark_clean [inode 0x10000000547 [2,head] /dc-dir/dc-file_850 auth v5702 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.360083+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946b8580] 2023-10-03T19:21:18.416 INFO:teuthology.orchestra.run.smithi045.stdout: -8610> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5702 now clean [dentry #0x1/dc-dir/dc-file_850 [2,head] auth (dversion lock) v=5702 ino=0x10000000547 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946b5b80] 2023-10-03T19:21:18.416 INFO:teuthology.orchestra.run.smithi045.stdout: -8609> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_850) mark_clean [dentry #0x1/dc-dir/dc-file_850 [2,head] auth (dversion lock) v=5702 ino=0x10000000547 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946b5b80] 2023-10-03T19:21:18.416 INFO:teuthology.orchestra.run.smithi045.stdout: -8608> 2023-10-03T19:18:09.833+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 119 ==== osd_op_reply(1499 100000003a4.00000000 [create,setxattr (99),setxattr (30)] v74'18 uv18 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:18.416 INFO:teuthology.orchestra.run.smithi045.stdout: -8607> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5704 now clean [inode 0x10000000548 [2,head] /dc-dir/dc-file_851 auth v5704 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.371799+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946b8b00] 2023-10-03T19:21:18.416 INFO:teuthology.orchestra.run.smithi045.stdout: -8606> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000548) mark_clean [inode 0x10000000548 [2,head] /dc-dir/dc-file_851 auth v5704 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.371799+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946b8b00] 2023-10-03T19:21:18.417 INFO:teuthology.orchestra.run.smithi045.stdout: -8605> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5704 now clean [dentry #0x1/dc-dir/dc-file_851 [2,head] auth (dversion lock) v=5704 ino=0x10000000548 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946bc000] 2023-10-03T19:21:18.417 INFO:teuthology.orchestra.run.smithi045.stdout: -8604> 2023-10-03T19:18:09.833+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 120 ==== osd_op_reply(1506 100000003ab.00000000 [create,setxattr (99),setxattr (30)] v74'19 uv19 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:18.417 INFO:teuthology.orchestra.run.smithi045.stdout: -8603> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_851) mark_clean [dentry #0x1/dc-dir/dc-file_851 [2,head] auth (dversion lock) v=5704 ino=0x10000000548 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946bc000] 2023-10-03T19:21:18.457 INFO:teuthology.orchestra.run.smithi045.stdout: -8602> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5706 now clean [inode 0x10000000549 [2,head] /dc-dir/dc-file_852 auth v5706 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.383562+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946b9080] 2023-10-03T19:21:18.457 INFO:teuthology.orchestra.run.smithi045.stdout: -8601> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000549) mark_clean [inode 0x10000000549 [2,head] /dc-dir/dc-file_852 auth v5706 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.383562+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946b9080] 2023-10-03T19:21:18.458 INFO:teuthology.orchestra.run.smithi045.stdout: -8600> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5706 now clean [dentry #0x1/dc-dir/dc-file_852 [2,head] auth (dversion lock) v=5706 ino=0x10000000549 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946bc280] 2023-10-03T19:21:18.458 INFO:teuthology.orchestra.run.smithi045.stdout: -8599> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_852) mark_clean [dentry #0x1/dc-dir/dc-file_852 [2,head] auth (dversion lock) v=5706 ino=0x10000000549 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946bc280] 2023-10-03T19:21:18.458 INFO:teuthology.orchestra.run.smithi045.stdout: -8598> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5708 now clean [inode 0x1000000054a [2,head] /dc-dir/dc-file_853 auth v5708 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.395661+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946b9600] 2023-10-03T19:21:18.458 INFO:teuthology.orchestra.run.smithi045.stdout: -8597> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000054a) mark_clean [inode 0x1000000054a [2,head] /dc-dir/dc-file_853 auth v5708 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.395661+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946b9600] 2023-10-03T19:21:18.458 INFO:teuthology.orchestra.run.smithi045.stdout: -8596> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5708 now clean [dentry #0x1/dc-dir/dc-file_853 [2,head] auth (dversion lock) v=5708 ino=0x1000000054a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946bc500] 2023-10-03T19:21:18.458 INFO:teuthology.orchestra.run.smithi045.stdout: -8595> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_853) mark_clean [dentry #0x1/dc-dir/dc-file_853 [2,head] auth (dversion lock) v=5708 ino=0x1000000054a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946bc500] 2023-10-03T19:21:18.458 INFO:teuthology.orchestra.run.smithi045.stdout: -8594> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5710 now clean [inode 0x1000000054b [2,head] /dc-dir/dc-file_854 auth v5710 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.407078+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946b9b80] 2023-10-03T19:21:18.459 INFO:teuthology.orchestra.run.smithi045.stdout: -8593> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000054b) mark_clean [inode 0x1000000054b [2,head] /dc-dir/dc-file_854 auth v5710 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.407078+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946b9b80] 2023-10-03T19:21:18.459 INFO:teuthology.orchestra.run.smithi045.stdout: -8592> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5710 now clean [dentry #0x1/dc-dir/dc-file_854 [2,head] auth (dversion lock) v=5710 ino=0x1000000054b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946bc780] 2023-10-03T19:21:18.459 INFO:teuthology.orchestra.run.smithi045.stdout: -8591> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_854) mark_clean [dentry #0x1/dc-dir/dc-file_854 [2,head] auth (dversion lock) v=5710 ino=0x1000000054b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946bc780] 2023-10-03T19:21:18.459 INFO:teuthology.orchestra.run.smithi045.stdout: -8590> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5712 now clean [inode 0x1000000054c [2,head] /dc-dir/dc-file_855 auth v5712 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.419140+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946ba100] 2023-10-03T19:21:18.459 INFO:teuthology.orchestra.run.smithi045.stdout: -8589> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000054c) mark_clean [inode 0x1000000054c [2,head] /dc-dir/dc-file_855 auth v5712 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.419140+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946ba100] 2023-10-03T19:21:18.459 INFO:teuthology.orchestra.run.smithi045.stdout: -8588> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5712 now clean [dentry #0x1/dc-dir/dc-file_855 [2,head] auth (dversion lock) v=5712 ino=0x1000000054c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946bca00] 2023-10-03T19:21:18.459 INFO:teuthology.orchestra.run.smithi045.stdout: -8587> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_855) mark_clean [dentry #0x1/dc-dir/dc-file_855 [2,head] auth (dversion lock) v=5712 ino=0x1000000054c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946bca00] 2023-10-03T19:21:18.459 INFO:teuthology.orchestra.run.smithi045.stdout: -8586> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5714 now clean [inode 0x1000000054d [2,head] /dc-dir/dc-file_856 auth v5714 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.432283+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946ba680] 2023-10-03T19:21:18.459 INFO:teuthology.orchestra.run.smithi045.stdout: -8585> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000054d) mark_clean [inode 0x1000000054d [2,head] /dc-dir/dc-file_856 auth v5714 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.432283+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946ba680] 2023-10-03T19:21:18.459 INFO:teuthology.orchestra.run.smithi045.stdout: -8584> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5714 now clean [dentry #0x1/dc-dir/dc-file_856 [2,head] auth (dversion lock) v=5714 ino=0x1000000054d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946bcc80] 2023-10-03T19:21:18.459 INFO:teuthology.orchestra.run.smithi045.stdout: -8583> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_856) mark_clean [dentry #0x1/dc-dir/dc-file_856 [2,head] auth (dversion lock) v=5714 ino=0x1000000054d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946bcc80] 2023-10-03T19:21:18.460 INFO:teuthology.orchestra.run.smithi045.stdout: -8582> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5716 now clean [inode 0x1000000054e [2,head] /dc-dir/dc-file_857 auth v5716 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.445869+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946bac00] 2023-10-03T19:21:18.460 INFO:teuthology.orchestra.run.smithi045.stdout: -8581> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000054e) mark_clean [inode 0x1000000054e [2,head] /dc-dir/dc-file_857 auth v5716 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.445869+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946bac00] 2023-10-03T19:21:18.460 INFO:teuthology.orchestra.run.smithi045.stdout: -8580> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5716 now clean [dentry #0x1/dc-dir/dc-file_857 [2,head] auth (dversion lock) v=5716 ino=0x1000000054e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946bcf00] 2023-10-03T19:21:18.460 INFO:teuthology.orchestra.run.smithi045.stdout: -8579> 2023-10-03T19:18:09.833+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_857) mark_clean [dentry #0x1/dc-dir/dc-file_857 [2,head] auth (dversion lock) v=5716 ino=0x1000000054e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946bcf00] 2023-10-03T19:21:18.460 INFO:teuthology.orchestra.run.smithi045.stdout: -8578> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5718 now clean [inode 0x1000000054f [2,head] /dc-dir/dc-file_858 auth v5718 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.459222+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946bb180] 2023-10-03T19:21:18.460 INFO:teuthology.orchestra.run.smithi045.stdout: -8577> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000054f) mark_clean [inode 0x1000000054f [2,head] /dc-dir/dc-file_858 auth v5718 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.459222+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946bb180] 2023-10-03T19:21:18.460 INFO:teuthology.orchestra.run.smithi045.stdout: -8576> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5718 now clean [dentry #0x1/dc-dir/dc-file_858 [2,head] auth (dversion lock) v=5718 ino=0x1000000054f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946bd180] 2023-10-03T19:21:18.460 INFO:teuthology.orchestra.run.smithi045.stdout: -8575> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_858) mark_clean [dentry #0x1/dc-dir/dc-file_858 [2,head] auth (dversion lock) v=5718 ino=0x1000000054f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946bd180] 2023-10-03T19:21:18.461 INFO:teuthology.orchestra.run.smithi045.stdout: -8574> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5720 now clean [inode 0x10000000550 [2,head] /dc-dir/dc-file_859 auth v5720 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.471423+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946bb700] 2023-10-03T19:21:18.461 INFO:teuthology.orchestra.run.smithi045.stdout: -8573> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000550) mark_clean [inode 0x10000000550 [2,head] /dc-dir/dc-file_859 auth v5720 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.471423+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946bb700] 2023-10-03T19:21:18.461 INFO:teuthology.orchestra.run.smithi045.stdout: -8572> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5720 now clean [dentry #0x1/dc-dir/dc-file_859 [2,head] auth (dversion lock) v=5720 ino=0x10000000550 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946bd400] 2023-10-03T19:21:18.461 INFO:teuthology.orchestra.run.smithi045.stdout: -8571> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_859) mark_clean [dentry #0x1/dc-dir/dc-file_859 [2,head] auth (dversion lock) v=5720 ino=0x10000000550 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946bd400] 2023-10-03T19:21:18.461 INFO:teuthology.orchestra.run.smithi045.stdout: -8570> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5722 now clean [inode 0x10000000551 [2,head] /dc-dir/dc-file_860 auth v5722 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.484402+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946c2000] 2023-10-03T19:21:18.461 INFO:teuthology.orchestra.run.smithi045.stdout: -8569> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000551) mark_clean [inode 0x10000000551 [2,head] /dc-dir/dc-file_860 auth v5722 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.484402+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946c2000] 2023-10-03T19:21:18.461 INFO:teuthology.orchestra.run.smithi045.stdout: -8568> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5722 now clean [dentry #0x1/dc-dir/dc-file_860 [2,head] auth (dversion lock) v=5722 ino=0x10000000551 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946bd680] 2023-10-03T19:21:18.461 INFO:teuthology.orchestra.run.smithi045.stdout: -8567> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_860) mark_clean [dentry #0x1/dc-dir/dc-file_860 [2,head] auth (dversion lock) v=5722 ino=0x10000000551 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946bd680] 2023-10-03T19:21:18.461 INFO:teuthology.orchestra.run.smithi045.stdout: -8566> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5724 now clean [inode 0x10000000552 [2,head] /dc-dir/dc-file_861 auth v5724 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.495928+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946c2580] 2023-10-03T19:21:18.461 INFO:teuthology.orchestra.run.smithi045.stdout: -8565> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000552) mark_clean [inode 0x10000000552 [2,head] /dc-dir/dc-file_861 auth v5724 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.495928+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946c2580] 2023-10-03T19:21:18.461 INFO:teuthology.orchestra.run.smithi045.stdout: -8564> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5724 now clean [dentry #0x1/dc-dir/dc-file_861 [2,head] auth (dversion lock) v=5724 ino=0x10000000552 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946bd900] 2023-10-03T19:21:18.461 INFO:teuthology.orchestra.run.smithi045.stdout: -8563> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_861) mark_clean [dentry #0x1/dc-dir/dc-file_861 [2,head] auth (dversion lock) v=5724 ino=0x10000000552 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946bd900] 2023-10-03T19:21:18.462 INFO:teuthology.orchestra.run.smithi045.stdout: -8562> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5726 now clean [inode 0x10000000553 [2,head] /dc-dir/dc-file_862 auth v5726 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.508230+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946c2b00] 2023-10-03T19:21:18.462 INFO:teuthology.orchestra.run.smithi045.stdout: -8561> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000553) mark_clean [inode 0x10000000553 [2,head] /dc-dir/dc-file_862 auth v5726 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.508230+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946c2b00] 2023-10-03T19:21:18.462 INFO:teuthology.orchestra.run.smithi045.stdout: -8560> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5726 now clean [dentry #0x1/dc-dir/dc-file_862 [2,head] auth (dversion lock) v=5726 ino=0x10000000553 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946bdb80] 2023-10-03T19:21:18.462 INFO:teuthology.orchestra.run.smithi045.stdout: -8559> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_862) mark_clean [dentry #0x1/dc-dir/dc-file_862 [2,head] auth (dversion lock) v=5726 ino=0x10000000553 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946bdb80] 2023-10-03T19:21:18.462 INFO:teuthology.orchestra.run.smithi045.stdout: -8558> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5728 now clean [inode 0x10000000554 [2,head] /dc-dir/dc-file_863 auth v5728 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.520493+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946c3080] 2023-10-03T19:21:18.462 INFO:teuthology.orchestra.run.smithi045.stdout: -8557> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000554) mark_clean [inode 0x10000000554 [2,head] /dc-dir/dc-file_863 auth v5728 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.520493+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946c3080] 2023-10-03T19:21:18.462 INFO:teuthology.orchestra.run.smithi045.stdout: -8556> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5728 now clean [dentry #0x1/dc-dir/dc-file_863 [2,head] auth (dversion lock) v=5728 ino=0x10000000554 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946c6000] 2023-10-03T19:21:18.462 INFO:teuthology.orchestra.run.smithi045.stdout: -8555> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_863) mark_clean [dentry #0x1/dc-dir/dc-file_863 [2,head] auth (dversion lock) v=5728 ino=0x10000000554 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946c6000] 2023-10-03T19:21:18.462 INFO:teuthology.orchestra.run.smithi045.stdout: -8554> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5730 now clean [inode 0x10000000555 [2,head] /dc-dir/dc-file_864 auth v5730 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.532364+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946c3600] 2023-10-03T19:21:18.462 INFO:teuthology.orchestra.run.smithi045.stdout: -8553> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000555) mark_clean [inode 0x10000000555 [2,head] /dc-dir/dc-file_864 auth v5730 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.532364+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946c3600] 2023-10-03T19:21:18.462 INFO:teuthology.orchestra.run.smithi045.stdout: -8552> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5730 now clean [dentry #0x1/dc-dir/dc-file_864 [2,head] auth (dversion lock) v=5730 ino=0x10000000555 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946c6280] 2023-10-03T19:21:18.463 INFO:teuthology.orchestra.run.smithi045.stdout: -8551> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_864) mark_clean [dentry #0x1/dc-dir/dc-file_864 [2,head] auth (dversion lock) v=5730 ino=0x10000000555 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946c6280] 2023-10-03T19:21:18.463 INFO:teuthology.orchestra.run.smithi045.stdout: -8550> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5732 now clean [inode 0x10000000556 [2,head] /dc-dir/dc-file_865 auth v5732 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.543731+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946c3b80] 2023-10-03T19:21:18.463 INFO:teuthology.orchestra.run.smithi045.stdout: -8549> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000556) mark_clean [inode 0x10000000556 [2,head] /dc-dir/dc-file_865 auth v5732 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.543731+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946c3b80] 2023-10-03T19:21:18.463 INFO:teuthology.orchestra.run.smithi045.stdout: -8548> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5732 now clean [dentry #0x1/dc-dir/dc-file_865 [2,head] auth (dversion lock) v=5732 ino=0x10000000556 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946c6500] 2023-10-03T19:21:18.463 INFO:teuthology.orchestra.run.smithi045.stdout: -8547> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_865) mark_clean [dentry #0x1/dc-dir/dc-file_865 [2,head] auth (dversion lock) v=5732 ino=0x10000000556 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946c6500] 2023-10-03T19:21:18.463 INFO:teuthology.orchestra.run.smithi045.stdout: -8546> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5734 now clean [inode 0x10000000557 [2,head] /dc-dir/dc-file_866 auth v5734 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.557015+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946c4100] 2023-10-03T19:21:18.463 INFO:teuthology.orchestra.run.smithi045.stdout: -8545> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000557) mark_clean [inode 0x10000000557 [2,head] /dc-dir/dc-file_866 auth v5734 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.557015+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946c4100] 2023-10-03T19:21:18.463 INFO:teuthology.orchestra.run.smithi045.stdout: -8544> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5734 now clean [dentry #0x1/dc-dir/dc-file_866 [2,head] auth (dversion lock) v=5734 ino=0x10000000557 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946c6780] 2023-10-03T19:21:18.463 INFO:teuthology.orchestra.run.smithi045.stdout: -8543> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_866) mark_clean [dentry #0x1/dc-dir/dc-file_866 [2,head] auth (dversion lock) v=5734 ino=0x10000000557 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946c6780] 2023-10-03T19:21:18.463 INFO:teuthology.orchestra.run.smithi045.stdout: -8542> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5736 now clean [inode 0x10000000558 [2,head] /dc-dir/dc-file_867 auth v5736 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.570701+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946c4680] 2023-10-03T19:21:18.464 INFO:teuthology.orchestra.run.smithi045.stdout: -8541> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000558) mark_clean [inode 0x10000000558 [2,head] /dc-dir/dc-file_867 auth v5736 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.570701+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946c4680] 2023-10-03T19:21:18.464 INFO:teuthology.orchestra.run.smithi045.stdout: -8540> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5736 now clean [dentry #0x1/dc-dir/dc-file_867 [2,head] auth (dversion lock) v=5736 ino=0x10000000558 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946c6a00] 2023-10-03T19:21:18.464 INFO:teuthology.orchestra.run.smithi045.stdout: -8539> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_867) mark_clean [dentry #0x1/dc-dir/dc-file_867 [2,head] auth (dversion lock) v=5736 ino=0x10000000558 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946c6a00] 2023-10-03T19:21:18.464 INFO:teuthology.orchestra.run.smithi045.stdout: -8538> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5738 now clean [inode 0x10000000559 [2,head] /dc-dir/dc-file_868 auth v5738 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.583174+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946c4c00] 2023-10-03T19:21:18.464 INFO:teuthology.orchestra.run.smithi045.stdout: -8537> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000559) mark_clean [inode 0x10000000559 [2,head] /dc-dir/dc-file_868 auth v5738 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.583174+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946c4c00] 2023-10-03T19:21:18.464 INFO:teuthology.orchestra.run.smithi045.stdout: -8536> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5738 now clean [dentry #0x1/dc-dir/dc-file_868 [2,head] auth (dversion lock) v=5738 ino=0x10000000559 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946c6c80] 2023-10-03T19:21:18.464 INFO:teuthology.orchestra.run.smithi045.stdout: -8535> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_868) mark_clean [dentry #0x1/dc-dir/dc-file_868 [2,head] auth (dversion lock) v=5738 ino=0x10000000559 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946c6c80] 2023-10-03T19:21:18.464 INFO:teuthology.orchestra.run.smithi045.stdout: -8534> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5740 now clean [inode 0x1000000055a [2,head] /dc-dir/dc-file_869 auth v5740 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.595618+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946c5180] 2023-10-03T19:21:18.464 INFO:teuthology.orchestra.run.smithi045.stdout: -8533> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000055a) mark_clean [inode 0x1000000055a [2,head] /dc-dir/dc-file_869 auth v5740 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.595618+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946c5180] 2023-10-03T19:21:18.464 INFO:teuthology.orchestra.run.smithi045.stdout: -8532> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5740 now clean [dentry #0x1/dc-dir/dc-file_869 [2,head] auth (dversion lock) v=5740 ino=0x1000000055a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946c6f00] 2023-10-03T19:21:18.464 INFO:teuthology.orchestra.run.smithi045.stdout: -8531> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_869) mark_clean [dentry #0x1/dc-dir/dc-file_869 [2,head] auth (dversion lock) v=5740 ino=0x1000000055a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946c6f00] 2023-10-03T19:21:18.464 INFO:teuthology.orchestra.run.smithi045.stdout: -8530> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5742 now clean [inode 0x1000000055b [2,head] /dc-dir/dc-file_870 auth v5742 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.607302+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946c5700] 2023-10-03T19:21:18.465 INFO:teuthology.orchestra.run.smithi045.stdout: -8529> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000055b) mark_clean [inode 0x1000000055b [2,head] /dc-dir/dc-file_870 auth v5742 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.607302+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946c5700] 2023-10-03T19:21:18.465 INFO:teuthology.orchestra.run.smithi045.stdout: -8528> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5742 now clean [dentry #0x1/dc-dir/dc-file_870 [2,head] auth (dversion lock) v=5742 ino=0x1000000055b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946c7180] 2023-10-03T19:21:18.465 INFO:teuthology.orchestra.run.smithi045.stdout: -8527> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_870) mark_clean [dentry #0x1/dc-dir/dc-file_870 [2,head] auth (dversion lock) v=5742 ino=0x1000000055b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946c7180] 2023-10-03T19:21:18.465 INFO:teuthology.orchestra.run.smithi045.stdout: -8526> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5744 now clean [inode 0x1000000055c [2,head] /dc-dir/dc-file_871 auth v5744 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.619119+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946ca000] 2023-10-03T19:21:18.465 INFO:teuthology.orchestra.run.smithi045.stdout: -8525> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000055c) mark_clean [inode 0x1000000055c [2,head] /dc-dir/dc-file_871 auth v5744 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.619119+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946ca000] 2023-10-03T19:21:18.465 INFO:teuthology.orchestra.run.smithi045.stdout: -8524> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5744 now clean [dentry #0x1/dc-dir/dc-file_871 [2,head] auth (dversion lock) v=5744 ino=0x1000000055c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946c7400] 2023-10-03T19:21:18.465 INFO:teuthology.orchestra.run.smithi045.stdout: -8523> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_871) mark_clean [dentry #0x1/dc-dir/dc-file_871 [2,head] auth (dversion lock) v=5744 ino=0x1000000055c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946c7400] 2023-10-03T19:21:18.465 INFO:teuthology.orchestra.run.smithi045.stdout: -8522> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5746 now clean [inode 0x1000000055d [2,head] /dc-dir/dc-file_872 auth v5746 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.630962+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946ca580] 2023-10-03T19:21:18.465 INFO:teuthology.orchestra.run.smithi045.stdout: -8521> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000055d) mark_clean [inode 0x1000000055d [2,head] /dc-dir/dc-file_872 auth v5746 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.630962+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946ca580] 2023-10-03T19:21:18.490 INFO:teuthology.orchestra.run.smithi045.stdout: -8520> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5746 now clean [dentry #0x1/dc-dir/dc-file_872 [2,head] auth (dversion lock) v=5746 ino=0x1000000055d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946c7680] 2023-10-03T19:21:18.490 INFO:teuthology.orchestra.run.smithi045.stdout: -8519> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_872) mark_clean [dentry #0x1/dc-dir/dc-file_872 [2,head] auth (dversion lock) v=5746 ino=0x1000000055d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946c7680] 2023-10-03T19:21:18.490 INFO:teuthology.orchestra.run.smithi045.stdout: -8518> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5748 now clean [inode 0x1000000055e [2,head] /dc-dir/dc-file_873 auth v5748 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.643881+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946cab00] 2023-10-03T19:21:18.490 INFO:teuthology.orchestra.run.smithi045.stdout: -8517> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000055e) mark_clean [inode 0x1000000055e [2,head] /dc-dir/dc-file_873 auth v5748 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.643881+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946cab00] 2023-10-03T19:21:18.491 INFO:teuthology.orchestra.run.smithi045.stdout: -8516> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5748 now clean [dentry #0x1/dc-dir/dc-file_873 [2,head] auth (dversion lock) v=5748 ino=0x1000000055e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946c7900] 2023-10-03T19:21:18.491 INFO:teuthology.orchestra.run.smithi045.stdout: -8515> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_873) mark_clean [dentry #0x1/dc-dir/dc-file_873 [2,head] auth (dversion lock) v=5748 ino=0x1000000055e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946c7900] 2023-10-03T19:21:18.491 INFO:teuthology.orchestra.run.smithi045.stdout: -8514> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5750 now clean [inode 0x1000000055f [2,head] /dc-dir/dc-file_874 auth v5750 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.655754+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946cb080] 2023-10-03T19:21:18.491 INFO:teuthology.orchestra.run.smithi045.stdout: -8513> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000055f) mark_clean [inode 0x1000000055f [2,head] /dc-dir/dc-file_874 auth v5750 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.655754+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946cb080] 2023-10-03T19:21:18.491 INFO:teuthology.orchestra.run.smithi045.stdout: -8512> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5750 now clean [dentry #0x1/dc-dir/dc-file_874 [2,head] auth (dversion lock) v=5750 ino=0x1000000055f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946c7b80] 2023-10-03T19:21:18.491 INFO:teuthology.orchestra.run.smithi045.stdout: -8511> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_874) mark_clean [dentry #0x1/dc-dir/dc-file_874 [2,head] auth (dversion lock) v=5750 ino=0x1000000055f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946c7b80] 2023-10-03T19:21:18.491 INFO:teuthology.orchestra.run.smithi045.stdout: -8510> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5752 now clean [inode 0x10000000560 [2,head] /dc-dir/dc-file_875 auth v5752 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.667368+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946cb600] 2023-10-03T19:21:18.491 INFO:teuthology.orchestra.run.smithi045.stdout: -8509> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000560) mark_clean [inode 0x10000000560 [2,head] /dc-dir/dc-file_875 auth v5752 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.667368+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946cb600] 2023-10-03T19:21:18.491 INFO:teuthology.orchestra.run.smithi045.stdout: -8508> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5752 now clean [dentry #0x1/dc-dir/dc-file_875 [2,head] auth (dversion lock) v=5752 ino=0x10000000560 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946ce000] 2023-10-03T19:21:18.492 INFO:teuthology.orchestra.run.smithi045.stdout: -8507> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_875) mark_clean [dentry #0x1/dc-dir/dc-file_875 [2,head] auth (dversion lock) v=5752 ino=0x10000000560 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946ce000] 2023-10-03T19:21:18.492 INFO:teuthology.orchestra.run.smithi045.stdout: -8506> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5754 now clean [inode 0x10000000561 [2,head] /dc-dir/dc-file_876 auth v5754 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.679877+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946cbb80] 2023-10-03T19:21:18.492 INFO:teuthology.orchestra.run.smithi045.stdout: -8505> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000561) mark_clean [inode 0x10000000561 [2,head] /dc-dir/dc-file_876 auth v5754 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.679877+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946cbb80] 2023-10-03T19:21:18.492 INFO:teuthology.orchestra.run.smithi045.stdout: -8504> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5754 now clean [dentry #0x1/dc-dir/dc-file_876 [2,head] auth (dversion lock) v=5754 ino=0x10000000561 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946ce280] 2023-10-03T19:21:18.492 INFO:teuthology.orchestra.run.smithi045.stdout: -8503> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_876) mark_clean [dentry #0x1/dc-dir/dc-file_876 [2,head] auth (dversion lock) v=5754 ino=0x10000000561 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946ce280] 2023-10-03T19:21:18.492 INFO:teuthology.orchestra.run.smithi045.stdout: -8502> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5756 now clean [inode 0x10000000562 [2,head] /dc-dir/dc-file_877 auth v5756 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.692441+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946cc100] 2023-10-03T19:21:18.492 INFO:teuthology.orchestra.run.smithi045.stdout: -8501> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000562) mark_clean [inode 0x10000000562 [2,head] /dc-dir/dc-file_877 auth v5756 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.692441+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946cc100] 2023-10-03T19:21:18.492 INFO:teuthology.orchestra.run.smithi045.stdout: -8500> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5756 now clean [dentry #0x1/dc-dir/dc-file_877 [2,head] auth (dversion lock) v=5756 ino=0x10000000562 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946ce500] 2023-10-03T19:21:18.492 INFO:teuthology.orchestra.run.smithi045.stdout: -8499> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_877) mark_clean [dentry #0x1/dc-dir/dc-file_877 [2,head] auth (dversion lock) v=5756 ino=0x10000000562 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946ce500] 2023-10-03T19:21:18.492 INFO:teuthology.orchestra.run.smithi045.stdout: -8498> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5758 now clean [inode 0x10000000563 [2,head] /dc-dir/dc-file_878 auth v5758 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.706166+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946cc680] 2023-10-03T19:21:18.493 INFO:teuthology.orchestra.run.smithi045.stdout: -8497> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000563) mark_clean [inode 0x10000000563 [2,head] /dc-dir/dc-file_878 auth v5758 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.706166+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946cc680] 2023-10-03T19:21:18.493 INFO:teuthology.orchestra.run.smithi045.stdout: -8496> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5758 now clean [dentry #0x1/dc-dir/dc-file_878 [2,head] auth (dversion lock) v=5758 ino=0x10000000563 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946ce780] 2023-10-03T19:21:18.493 INFO:teuthology.orchestra.run.smithi045.stdout: -8495> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_878) mark_clean [dentry #0x1/dc-dir/dc-file_878 [2,head] auth (dversion lock) v=5758 ino=0x10000000563 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946ce780] 2023-10-03T19:21:18.493 INFO:teuthology.orchestra.run.smithi045.stdout: -8494> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5760 now clean [inode 0x10000000564 [2,head] /dc-dir/dc-file_879 auth v5760 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.717695+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946ccc00] 2023-10-03T19:21:18.493 INFO:teuthology.orchestra.run.smithi045.stdout: -8493> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000564) mark_clean [inode 0x10000000564 [2,head] /dc-dir/dc-file_879 auth v5760 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.717695+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946ccc00] 2023-10-03T19:21:18.493 INFO:teuthology.orchestra.run.smithi045.stdout: -8492> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5760 now clean [dentry #0x1/dc-dir/dc-file_879 [2,head] auth (dversion lock) v=5760 ino=0x10000000564 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946cea00] 2023-10-03T19:21:18.493 INFO:teuthology.orchestra.run.smithi045.stdout: -8491> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_879) mark_clean [dentry #0x1/dc-dir/dc-file_879 [2,head] auth (dversion lock) v=5760 ino=0x10000000564 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946cea00] 2023-10-03T19:21:18.493 INFO:teuthology.orchestra.run.smithi045.stdout: -8490> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5762 now clean [inode 0x10000000565 [2,head] /dc-dir/dc-file_880 auth v5762 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.729649+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946cd180] 2023-10-03T19:21:18.493 INFO:teuthology.orchestra.run.smithi045.stdout: -8489> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000565) mark_clean [inode 0x10000000565 [2,head] /dc-dir/dc-file_880 auth v5762 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.729649+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946cd180] 2023-10-03T19:21:18.493 INFO:teuthology.orchestra.run.smithi045.stdout: -8488> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5762 now clean [dentry #0x1/dc-dir/dc-file_880 [2,head] auth (dversion lock) v=5762 ino=0x10000000565 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946cec80] 2023-10-03T19:21:18.493 INFO:teuthology.orchestra.run.smithi045.stdout: -8487> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_880) mark_clean [dentry #0x1/dc-dir/dc-file_880 [2,head] auth (dversion lock) v=5762 ino=0x10000000565 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946cec80] 2023-10-03T19:21:18.493 INFO:teuthology.orchestra.run.smithi045.stdout: -8486> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5764 now clean [inode 0x10000000566 [2,head] /dc-dir/dc-file_881 auth v5764 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.742340+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946cd700] 2023-10-03T19:21:18.494 INFO:teuthology.orchestra.run.smithi045.stdout: -8485> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000566) mark_clean [inode 0x10000000566 [2,head] /dc-dir/dc-file_881 auth v5764 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.742340+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946cd700] 2023-10-03T19:21:18.494 INFO:teuthology.orchestra.run.smithi045.stdout: -8484> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5764 now clean [dentry #0x1/dc-dir/dc-file_881 [2,head] auth (dversion lock) v=5764 ino=0x10000000566 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946cef00] 2023-10-03T19:21:18.494 INFO:teuthology.orchestra.run.smithi045.stdout: -8483> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_881) mark_clean [dentry #0x1/dc-dir/dc-file_881 [2,head] auth (dversion lock) v=5764 ino=0x10000000566 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946cef00] 2023-10-03T19:21:18.494 INFO:teuthology.orchestra.run.smithi045.stdout: -8482> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5766 now clean [inode 0x10000000567 [2,head] /dc-dir/dc-file_882 auth v5766 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.754571+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946d2000] 2023-10-03T19:21:18.494 INFO:teuthology.orchestra.run.smithi045.stdout: -8481> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000567) mark_clean [inode 0x10000000567 [2,head] /dc-dir/dc-file_882 auth v5766 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.754571+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946d2000] 2023-10-03T19:21:18.494 INFO:teuthology.orchestra.run.smithi045.stdout: -8480> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5766 now clean [dentry #0x1/dc-dir/dc-file_882 [2,head] auth (dversion lock) v=5766 ino=0x10000000567 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946cf180] 2023-10-03T19:21:18.494 INFO:teuthology.orchestra.run.smithi045.stdout: -8479> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 121 ==== osd_op_reply(1514 100000003b3.00000000 [create,setxattr (99),setxattr (30)] v74'17 uv17 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:18.494 INFO:teuthology.orchestra.run.smithi045.stdout: -8478> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_882) mark_clean [dentry #0x1/dc-dir/dc-file_882 [2,head] auth (dversion lock) v=5766 ino=0x10000000567 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946cf180] 2023-10-03T19:21:18.494 INFO:teuthology.orchestra.run.smithi045.stdout: -8477> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5768 now clean [inode 0x10000000568 [2,head] /dc-dir/dc-file_883 auth v5768 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.766560+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946d2580] 2023-10-03T19:21:18.494 INFO:teuthology.orchestra.run.smithi045.stdout: -8476> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000568) mark_clean [inode 0x10000000568 [2,head] /dc-dir/dc-file_883 auth v5768 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.766560+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946d2580] 2023-10-03T19:21:18.495 INFO:teuthology.orchestra.run.smithi045.stdout: -8475> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5768 now clean [dentry #0x1/dc-dir/dc-file_883 [2,head] auth (dversion lock) v=5768 ino=0x10000000568 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946cf400] 2023-10-03T19:21:18.495 INFO:teuthology.orchestra.run.smithi045.stdout: -8474> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_883) mark_clean [dentry #0x1/dc-dir/dc-file_883 [2,head] auth (dversion lock) v=5768 ino=0x10000000568 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946cf400] 2023-10-03T19:21:18.495 INFO:teuthology.orchestra.run.smithi045.stdout: -8473> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5770 now clean [inode 0x10000000569 [2,head] /dc-dir/dc-file_884 auth v5770 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.778595+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946d2b00] 2023-10-03T19:21:18.495 INFO:teuthology.orchestra.run.smithi045.stdout: -8472> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000569) mark_clean [inode 0x10000000569 [2,head] /dc-dir/dc-file_884 auth v5770 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.778595+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946d2b00] 2023-10-03T19:21:18.495 INFO:teuthology.orchestra.run.smithi045.stdout: -8471> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5770 now clean [dentry #0x1/dc-dir/dc-file_884 [2,head] auth (dversion lock) v=5770 ino=0x10000000569 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946cf680] 2023-10-03T19:21:18.495 INFO:teuthology.orchestra.run.smithi045.stdout: -8470> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_884) mark_clean [dentry #0x1/dc-dir/dc-file_884 [2,head] auth (dversion lock) v=5770 ino=0x10000000569 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946cf680] 2023-10-03T19:21:18.495 INFO:teuthology.orchestra.run.smithi045.stdout: -8469> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5772 now clean [inode 0x1000000056a [2,head] /dc-dir/dc-file_885 auth v5772 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.790907+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946d3080] 2023-10-03T19:21:18.495 INFO:teuthology.orchestra.run.smithi045.stdout: -8468> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000056a) mark_clean [inode 0x1000000056a [2,head] /dc-dir/dc-file_885 auth v5772 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.790907+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946d3080] 2023-10-03T19:21:18.495 INFO:teuthology.orchestra.run.smithi045.stdout: -8467> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5772 now clean [dentry #0x1/dc-dir/dc-file_885 [2,head] auth (dversion lock) v=5772 ino=0x1000000056a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946cf900] 2023-10-03T19:21:18.495 INFO:teuthology.orchestra.run.smithi045.stdout: -8466> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_885) mark_clean [dentry #0x1/dc-dir/dc-file_885 [2,head] auth (dversion lock) v=5772 ino=0x1000000056a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946cf900] 2023-10-03T19:21:18.495 INFO:teuthology.orchestra.run.smithi045.stdout: -8465> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5774 now clean [inode 0x1000000056b [2,head] /dc-dir/dc-file_886 auth v5774 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.803145+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946d3600] 2023-10-03T19:21:18.496 INFO:teuthology.orchestra.run.smithi045.stdout: -8464> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 54 ==== osd_op_reply(1352 10000000311.00000000 [create,setxattr (99),setxattr (30)] v74'20 uv20 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:18.496 INFO:teuthology.orchestra.run.smithi045.stdout: -8463> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000056b) mark_clean [inode 0x1000000056b [2,head] /dc-dir/dc-file_886 auth v5774 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.803145+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946d3600] 2023-10-03T19:21:18.496 INFO:teuthology.orchestra.run.smithi045.stdout: -8462> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5774 now clean [dentry #0x1/dc-dir/dc-file_886 [2,head] auth (dversion lock) v=5774 ino=0x1000000056b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946cfb80] 2023-10-03T19:21:18.496 INFO:teuthology.orchestra.run.smithi045.stdout: -8461> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 55 ==== osd_op_reply(1363 1000000031c.00000000 [create,setxattr (99),setxattr (30)] v74'21 uv21 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:18.496 INFO:teuthology.orchestra.run.smithi045.stdout: -8460> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_886) mark_clean [dentry #0x1/dc-dir/dc-file_886 [2,head] auth (dversion lock) v=5774 ino=0x1000000056b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946cfb80] 2023-10-03T19:21:18.496 INFO:teuthology.orchestra.run.smithi045.stdout: -8459> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5776 now clean [inode 0x1000000056c [2,head] /dc-dir/dc-file_887 auth v5776 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.816007+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946d3b80] 2023-10-03T19:21:18.496 INFO:teuthology.orchestra.run.smithi045.stdout: -8458> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 122 ==== osd_op_reply(1556 100000003dd.00000000 [create,setxattr (99),setxattr (30)] v74'20 uv20 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:18.496 INFO:teuthology.orchestra.run.smithi045.stdout: -8457> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 123 ==== osd_op_reply(1607 10000000410.00000000 [create,setxattr (99),setxattr (30)] v74'18 uv18 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:18.496 INFO:teuthology.orchestra.run.smithi045.stdout: -8456> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 56 ==== osd_op_reply(1390 10000000337.00000000 [create,setxattr (99),setxattr (30)] v74'19 uv19 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:18.496 INFO:teuthology.orchestra.run.smithi045.stdout: -8455> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000056c) mark_clean [inode 0x1000000056c [2,head] /dc-dir/dc-file_887 auth v5776 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.816007+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946d3b80] 2023-10-03T19:21:18.496 INFO:teuthology.orchestra.run.smithi045.stdout: -8454> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5776 now clean [dentry #0x1/dc-dir/dc-file_887 [2,head] auth (dversion lock) v=5776 ino=0x1000000056c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946da000] 2023-10-03T19:21:18.496 INFO:teuthology.orchestra.run.smithi045.stdout: -8453> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_887) mark_clean [dentry #0x1/dc-dir/dc-file_887 [2,head] auth (dversion lock) v=5776 ino=0x1000000056c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946da000] 2023-10-03T19:21:18.497 INFO:teuthology.orchestra.run.smithi045.stdout: -8452> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5778 now clean [inode 0x1000000056d [2,head] /dc-dir/dc-file_888 auth v5778 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.829564+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946d4100] 2023-10-03T19:21:18.497 INFO:teuthology.orchestra.run.smithi045.stdout: -8451> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000056d) mark_clean [inode 0x1000000056d [2,head] /dc-dir/dc-file_888 auth v5778 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.829564+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946d4100] 2023-10-03T19:21:18.497 INFO:teuthology.orchestra.run.smithi045.stdout: -8450> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 124 ==== osd_op_reply(1560 100000003e1.00000000 [create,setxattr (99),setxattr (30)] v74'21 uv21 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:18.497 INFO:teuthology.orchestra.run.smithi045.stdout: -8449> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5778 now clean [dentry #0x1/dc-dir/dc-file_888 [2,head] auth (dversion lock) v=5778 ino=0x1000000056d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946da280] 2023-10-03T19:21:18.497 INFO:teuthology.orchestra.run.smithi045.stdout: -8448> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_888) mark_clean [dentry #0x1/dc-dir/dc-file_888 [2,head] auth (dversion lock) v=5778 ino=0x1000000056d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946da280] 2023-10-03T19:21:18.497 INFO:teuthology.orchestra.run.smithi045.stdout: -8447> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5780 now clean [inode 0x1000000056e [2,head] /dc-dir/dc-file_889 auth v5780 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.841538+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946d4680] 2023-10-03T19:21:18.497 INFO:teuthology.orchestra.run.smithi045.stdout: -8446> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000056e) mark_clean [inode 0x1000000056e [2,head] /dc-dir/dc-file_889 auth v5780 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.841538+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946d4680] 2023-10-03T19:21:18.571 INFO:teuthology.orchestra.run.smithi045.stdout: -8445> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5780 now clean [dentry #0x1/dc-dir/dc-file_889 [2,head] auth (dversion lock) v=5780 ino=0x1000000056e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946da500] 2023-10-03T19:21:18.571 INFO:teuthology.orchestra.run.smithi045.stdout: -8444> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_889) mark_clean [dentry #0x1/dc-dir/dc-file_889 [2,head] auth (dversion lock) v=5780 ino=0x1000000056e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946da500] 2023-10-03T19:21:18.571 INFO:teuthology.orchestra.run.smithi045.stdout: -8443> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5782 now clean [inode 0x1000000056f [2,head] /dc-dir/dc-file_890 auth v5782 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.854602+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946d4c00] 2023-10-03T19:21:18.571 INFO:teuthology.orchestra.run.smithi045.stdout: -8442> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 57 ==== osd_op_reply(1370 10000000323.00000000 [create,setxattr (99),setxattr (30)] v74'22 uv22 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:18.572 INFO:teuthology.orchestra.run.smithi045.stdout: -8441> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000056f) mark_clean [inode 0x1000000056f [2,head] /dc-dir/dc-file_890 auth v5782 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.854602+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946d4c00] 2023-10-03T19:21:18.572 INFO:teuthology.orchestra.run.smithi045.stdout: -8440> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5782 now clean [dentry #0x1/dc-dir/dc-file_890 [2,head] auth (dversion lock) v=5782 ino=0x1000000056f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946da780] 2023-10-03T19:21:18.572 INFO:teuthology.orchestra.run.smithi045.stdout: -8439> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_890) mark_clean [dentry #0x1/dc-dir/dc-file_890 [2,head] auth (dversion lock) v=5782 ino=0x1000000056f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946da780] 2023-10-03T19:21:18.572 INFO:teuthology.orchestra.run.smithi045.stdout: -8438> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5784 now clean [inode 0x10000000570 [2,head] /dc-dir/dc-file_891 auth v5784 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.869295+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946d5180] 2023-10-03T19:21:18.572 INFO:teuthology.orchestra.run.smithi045.stdout: -8437> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000570) mark_clean [inode 0x10000000570 [2,head] /dc-dir/dc-file_891 auth v5784 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.869295+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946d5180] 2023-10-03T19:21:18.572 INFO:teuthology.orchestra.run.smithi045.stdout: -8436> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5784 now clean [dentry #0x1/dc-dir/dc-file_891 [2,head] auth (dversion lock) v=5784 ino=0x10000000570 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946daa00] 2023-10-03T19:21:18.572 INFO:teuthology.orchestra.run.smithi045.stdout: -8435> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_891) mark_clean [dentry #0x1/dc-dir/dc-file_891 [2,head] auth (dversion lock) v=5784 ino=0x10000000570 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946daa00] 2023-10-03T19:21:18.572 INFO:teuthology.orchestra.run.smithi045.stdout: -8434> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5786 now clean [inode 0x10000000571 [2,head] /dc-dir/dc-file_892 auth v5786 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.883169+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946d5700] 2023-10-03T19:21:18.573 INFO:teuthology.orchestra.run.smithi045.stdout: -8433> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000571) mark_clean [inode 0x10000000571 [2,head] /dc-dir/dc-file_892 auth v5786 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.883169+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946d5700] 2023-10-03T19:21:18.573 INFO:teuthology.orchestra.run.smithi045.stdout: -8432> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5786 now clean [dentry #0x1/dc-dir/dc-file_892 [2,head] auth (dversion lock) v=5786 ino=0x10000000571 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946dac80] 2023-10-03T19:21:18.573 INFO:teuthology.orchestra.run.smithi045.stdout: -8431> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_892) mark_clean [dentry #0x1/dc-dir/dc-file_892 [2,head] auth (dversion lock) v=5786 ino=0x10000000571 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946dac80] 2023-10-03T19:21:18.573 INFO:teuthology.orchestra.run.smithi045.stdout: -8430> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5788 now clean [inode 0x10000000572 [2,head] /dc-dir/dc-file_893 auth v5788 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.897890+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946dc000] 2023-10-03T19:21:18.573 INFO:teuthology.orchestra.run.smithi045.stdout: -8429> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000572) mark_clean [inode 0x10000000572 [2,head] /dc-dir/dc-file_893 auth v5788 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.897890+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946dc000] 2023-10-03T19:21:18.573 INFO:teuthology.orchestra.run.smithi045.stdout: -8428> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5788 now clean [dentry #0x1/dc-dir/dc-file_893 [2,head] auth (dversion lock) v=5788 ino=0x10000000572 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946daf00] 2023-10-03T19:21:18.573 INFO:teuthology.orchestra.run.smithi045.stdout: -8427> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_893) mark_clean [dentry #0x1/dc-dir/dc-file_893 [2,head] auth (dversion lock) v=5788 ino=0x10000000572 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946daf00] 2023-10-03T19:21:18.574 INFO:teuthology.orchestra.run.smithi045.stdout: -8426> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5790 now clean [inode 0x10000000573 [2,head] /dc-dir/dc-file_894 auth v5790 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.910829+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946dc580] 2023-10-03T19:21:18.574 INFO:teuthology.orchestra.run.smithi045.stdout: -8425> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000573) mark_clean [inode 0x10000000573 [2,head] /dc-dir/dc-file_894 auth v5790 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.910829+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946dc580] 2023-10-03T19:21:18.574 INFO:teuthology.orchestra.run.smithi045.stdout: -8424> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5790 now clean [dentry #0x1/dc-dir/dc-file_894 [2,head] auth (dversion lock) v=5790 ino=0x10000000573 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946db180] 2023-10-03T19:21:18.574 INFO:teuthology.orchestra.run.smithi045.stdout: -8423> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_894) mark_clean [dentry #0x1/dc-dir/dc-file_894 [2,head] auth (dversion lock) v=5790 ino=0x10000000573 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946db180] 2023-10-03T19:21:18.574 INFO:teuthology.orchestra.run.smithi045.stdout: -8422> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5792 now clean [inode 0x10000000574 [2,head] /dc-dir/dc-file_895 auth v5792 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.923001+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946dcb00] 2023-10-03T19:21:18.574 INFO:teuthology.orchestra.run.smithi045.stdout: -8421> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000574) mark_clean [inode 0x10000000574 [2,head] /dc-dir/dc-file_895 auth v5792 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.923001+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946dcb00] 2023-10-03T19:21:18.575 INFO:teuthology.orchestra.run.smithi045.stdout: -8420> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5792 now clean [dentry #0x1/dc-dir/dc-file_895 [2,head] auth (dversion lock) v=5792 ino=0x10000000574 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946db400] 2023-10-03T19:21:18.575 INFO:teuthology.orchestra.run.smithi045.stdout: -8419> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_895) mark_clean [dentry #0x1/dc-dir/dc-file_895 [2,head] auth (dversion lock) v=5792 ino=0x10000000574 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946db400] 2023-10-03T19:21:18.575 INFO:teuthology.orchestra.run.smithi045.stdout: -8418> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5794 now clean [inode 0x10000000575 [2,head] /dc-dir/dc-file_896 auth v5794 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.934564+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946dd080] 2023-10-03T19:21:18.575 INFO:teuthology.orchestra.run.smithi045.stdout: -8417> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000575) mark_clean [inode 0x10000000575 [2,head] /dc-dir/dc-file_896 auth v5794 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.934564+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946dd080] 2023-10-03T19:21:18.575 INFO:teuthology.orchestra.run.smithi045.stdout: -8416> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5794 now clean [dentry #0x1/dc-dir/dc-file_896 [2,head] auth (dversion lock) v=5794 ino=0x10000000575 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946db680] 2023-10-03T19:21:18.575 INFO:teuthology.orchestra.run.smithi045.stdout: -8415> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_896) mark_clean [dentry #0x1/dc-dir/dc-file_896 [2,head] auth (dversion lock) v=5794 ino=0x10000000575 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946db680] 2023-10-03T19:21:18.575 INFO:teuthology.orchestra.run.smithi045.stdout: -8414> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 125 ==== osd_op_reply(1644 10000000435.00000000 [create,setxattr (99),setxattr (30)] v74'19 uv19 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:18.576 INFO:teuthology.orchestra.run.smithi045.stdout: -8413> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5796 now clean [inode 0x10000000576 [2,head] /dc-dir/dc-file_897 auth v5796 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.947371+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946dd600] 2023-10-03T19:21:18.576 INFO:teuthology.orchestra.run.smithi045.stdout: -8412> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000576) mark_clean [inode 0x10000000576 [2,head] /dc-dir/dc-file_897 auth v5796 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.947371+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946dd600] 2023-10-03T19:21:18.576 INFO:teuthology.orchestra.run.smithi045.stdout: -8411> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5796 now clean [dentry #0x1/dc-dir/dc-file_897 [2,head] auth (dversion lock) v=5796 ino=0x10000000576 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946db900] 2023-10-03T19:21:18.576 INFO:teuthology.orchestra.run.smithi045.stdout: -8410> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_897) mark_clean [dentry #0x1/dc-dir/dc-file_897 [2,head] auth (dversion lock) v=5796 ino=0x10000000576 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946db900] 2023-10-03T19:21:18.576 INFO:teuthology.orchestra.run.smithi045.stdout: -8409> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5798 now clean [inode 0x10000000577 [2,head] /dc-dir/dc-file_898 auth v5798 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.958959+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946ddb80] 2023-10-03T19:21:18.576 INFO:teuthology.orchestra.run.smithi045.stdout: -8408> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000577) mark_clean [inode 0x10000000577 [2,head] /dc-dir/dc-file_898 auth v5798 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.958959+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946ddb80] 2023-10-03T19:21:18.576 INFO:teuthology.orchestra.run.smithi045.stdout: -8407> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5798 now clean [dentry #0x1/dc-dir/dc-file_898 [2,head] auth (dversion lock) v=5798 ino=0x10000000577 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946dbb80] 2023-10-03T19:21:18.576 INFO:teuthology.orchestra.run.smithi045.stdout: -8406> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_898) mark_clean [dentry #0x1/dc-dir/dc-file_898 [2,head] auth (dversion lock) v=5798 ino=0x10000000577 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946dbb80] 2023-10-03T19:21:18.577 INFO:teuthology.orchestra.run.smithi045.stdout: -8405> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5800 now clean [inode 0x10000000578 [2,head] /dc-dir/dc-file_899 auth v5800 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.970758+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946de100] 2023-10-03T19:21:18.577 INFO:teuthology.orchestra.run.smithi045.stdout: -8404> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000578) mark_clean [inode 0x10000000578 [2,head] /dc-dir/dc-file_899 auth v5800 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.970758+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946de100] 2023-10-03T19:21:18.577 INFO:teuthology.orchestra.run.smithi045.stdout: -8403> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5800 now clean [dentry #0x1/dc-dir/dc-file_899 [2,head] auth (dversion lock) v=5800 ino=0x10000000578 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946e2000] 2023-10-03T19:21:18.577 INFO:teuthology.orchestra.run.smithi045.stdout: -8402> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_899) mark_clean [dentry #0x1/dc-dir/dc-file_899 [2,head] auth (dversion lock) v=5800 ino=0x10000000578 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946e2000] 2023-10-03T19:21:18.577 INFO:teuthology.orchestra.run.smithi045.stdout: -8401> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5802 now clean [inode 0x10000000579 [2,head] /dc-dir/dc-file_900 auth v5802 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.982312+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946de680] 2023-10-03T19:21:18.577 INFO:teuthology.orchestra.run.smithi045.stdout: -8400> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000579) mark_clean [inode 0x10000000579 [2,head] /dc-dir/dc-file_900 auth v5802 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.982312+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946de680] 2023-10-03T19:21:18.578 INFO:teuthology.orchestra.run.smithi045.stdout: -8399> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5802 now clean [dentry #0x1/dc-dir/dc-file_900 [2,head] auth (dversion lock) v=5802 ino=0x10000000579 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946e2280] 2023-10-03T19:21:18.578 INFO:teuthology.orchestra.run.smithi045.stdout: -8398> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_900) mark_clean [dentry #0x1/dc-dir/dc-file_900 [2,head] auth (dversion lock) v=5802 ino=0x10000000579 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946e2280] 2023-10-03T19:21:18.578 INFO:teuthology.orchestra.run.smithi045.stdout: -8397> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5804 now clean [inode 0x1000000057a [2,head] /dc-dir/dc-file_901 auth v5804 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.994266+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946dec00] 2023-10-03T19:21:18.578 INFO:teuthology.orchestra.run.smithi045.stdout: -8396> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000057a) mark_clean [inode 0x1000000057a [2,head] /dc-dir/dc-file_901 auth v5804 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.994266+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946dec00] 2023-10-03T19:21:18.578 INFO:teuthology.orchestra.run.smithi045.stdout: -8395> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5804 now clean [dentry #0x1/dc-dir/dc-file_901 [2,head] auth (dversion lock) v=5804 ino=0x1000000057a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946e2500] 2023-10-03T19:21:18.578 INFO:teuthology.orchestra.run.smithi045.stdout: -8394> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_901) mark_clean [dentry #0x1/dc-dir/dc-file_901 [2,head] auth (dversion lock) v=5804 ino=0x1000000057a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946e2500] 2023-10-03T19:21:18.578 INFO:teuthology.orchestra.run.smithi045.stdout: -8393> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5806 now clean [inode 0x1000000057b [2,head] /dc-dir/dc-file_902 auth v5806 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.005725+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946df180] 2023-10-03T19:21:18.578 INFO:teuthology.orchestra.run.smithi045.stdout: -8392> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000057b) mark_clean [inode 0x1000000057b [2,head] /dc-dir/dc-file_902 auth v5806 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.005725+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946df180] 2023-10-03T19:21:18.578 INFO:teuthology.orchestra.run.smithi045.stdout: -8391> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5806 now clean [dentry #0x1/dc-dir/dc-file_902 [2,head] auth (dversion lock) v=5806 ino=0x1000000057b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946e2780] 2023-10-03T19:21:18.578 INFO:teuthology.orchestra.run.smithi045.stdout: -8390> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_902) mark_clean [dentry #0x1/dc-dir/dc-file_902 [2,head] auth (dversion lock) v=5806 ino=0x1000000057b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946e2780] 2023-10-03T19:21:18.644 INFO:teuthology.orchestra.run.smithi045.stdout: -8389> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5808 now clean [inode 0x1000000057c [2,head] /dc-dir/dc-file_903 auth v5808 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.017638+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946df700] 2023-10-03T19:21:18.644 INFO:teuthology.orchestra.run.smithi045.stdout: -8388> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000057c) mark_clean [inode 0x1000000057c [2,head] /dc-dir/dc-file_903 auth v5808 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.017638+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946df700] 2023-10-03T19:21:18.644 INFO:teuthology.orchestra.run.smithi045.stdout: -8387> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5808 now clean [dentry #0x1/dc-dir/dc-file_903 [2,head] auth (dversion lock) v=5808 ino=0x1000000057c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946e2a00] 2023-10-03T19:21:18.644 INFO:teuthology.orchestra.run.smithi045.stdout: -8386> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_903) mark_clean [dentry #0x1/dc-dir/dc-file_903 [2,head] auth (dversion lock) v=5808 ino=0x1000000057c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946e2a00] 2023-10-03T19:21:18.644 INFO:teuthology.orchestra.run.smithi045.stdout: -8385> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5810 now clean [inode 0x1000000057d [2,head] /dc-dir/dc-file_904 auth v5810 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.029441+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946e4000] 2023-10-03T19:21:18.645 INFO:teuthology.orchestra.run.smithi045.stdout: -8384> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000057d) mark_clean [inode 0x1000000057d [2,head] /dc-dir/dc-file_904 auth v5810 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.029441+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946e4000] 2023-10-03T19:21:18.645 INFO:teuthology.orchestra.run.smithi045.stdout: -8383> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5810 now clean [dentry #0x1/dc-dir/dc-file_904 [2,head] auth (dversion lock) v=5810 ino=0x1000000057d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946e2c80] 2023-10-03T19:21:18.645 INFO:teuthology.orchestra.run.smithi045.stdout: -8382> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_904) mark_clean [dentry #0x1/dc-dir/dc-file_904 [2,head] auth (dversion lock) v=5810 ino=0x1000000057d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946e2c80] 2023-10-03T19:21:18.645 INFO:teuthology.orchestra.run.smithi045.stdout: -8381> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5812 now clean [inode 0x1000000057e [2,head] /dc-dir/dc-file_905 auth v5812 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.041526+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946e4580] 2023-10-03T19:21:18.645 INFO:teuthology.orchestra.run.smithi045.stdout: -8380> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 84 ==== osd_op_reply(1074 100000001fb.00000000 [create,setxattr (97),setxattr (30)] v74'22 uv22 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:18.645 INFO:teuthology.orchestra.run.smithi045.stdout: -8379> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000057e) mark_clean [inode 0x1000000057e [2,head] /dc-dir/dc-file_905 auth v5812 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.041526+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946e4580] 2023-10-03T19:21:18.645 INFO:teuthology.orchestra.run.smithi045.stdout: -8378> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5812 now clean [dentry #0x1/dc-dir/dc-file_905 [2,head] auth (dversion lock) v=5812 ino=0x1000000057e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946e2f00] 2023-10-03T19:21:18.646 INFO:teuthology.orchestra.run.smithi045.stdout: -8377> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_905) mark_clean [dentry #0x1/dc-dir/dc-file_905 [2,head] auth (dversion lock) v=5812 ino=0x1000000057e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946e2f00] 2023-10-03T19:21:18.646 INFO:teuthology.orchestra.run.smithi045.stdout: -8376> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5814 now clean [inode 0x1000000057f [2,head] /dc-dir/dc-file_906 auth v5814 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.053715+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946e4b00] 2023-10-03T19:21:18.646 INFO:teuthology.orchestra.run.smithi045.stdout: -8375> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000057f) mark_clean [inode 0x1000000057f [2,head] /dc-dir/dc-file_906 auth v5814 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.053715+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946e4b00] 2023-10-03T19:21:18.646 INFO:teuthology.orchestra.run.smithi045.stdout: -8374> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5814 now clean [dentry #0x1/dc-dir/dc-file_906 [2,head] auth (dversion lock) v=5814 ino=0x1000000057f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946e3180] 2023-10-03T19:21:18.646 INFO:teuthology.orchestra.run.smithi045.stdout: -8373> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_906) mark_clean [dentry #0x1/dc-dir/dc-file_906 [2,head] auth (dversion lock) v=5814 ino=0x1000000057f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946e3180] 2023-10-03T19:21:18.647 INFO:teuthology.orchestra.run.smithi045.stdout: -8372> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5816 now clean [inode 0x10000000580 [2,head] /dc-dir/dc-file_907 auth v5816 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.065995+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946e5080] 2023-10-03T19:21:18.647 INFO:teuthology.orchestra.run.smithi045.stdout: -8371> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000580) mark_clean [inode 0x10000000580 [2,head] /dc-dir/dc-file_907 auth v5816 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.065995+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946e5080] 2023-10-03T19:21:18.647 INFO:teuthology.orchestra.run.smithi045.stdout: -8370> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5816 now clean [dentry #0x1/dc-dir/dc-file_907 [2,head] auth (dversion lock) v=5816 ino=0x10000000580 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946e3400] 2023-10-03T19:21:18.647 INFO:teuthology.orchestra.run.smithi045.stdout: -8369> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_907) mark_clean [dentry #0x1/dc-dir/dc-file_907 [2,head] auth (dversion lock) v=5816 ino=0x10000000580 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946e3400] 2023-10-03T19:21:18.647 INFO:teuthology.orchestra.run.smithi045.stdout: -8368> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5818 now clean [inode 0x10000000581 [2,head] /dc-dir/dc-file_908 auth v5818 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.078197+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946e5600] 2023-10-03T19:21:18.647 INFO:teuthology.orchestra.run.smithi045.stdout: -8367> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000581) mark_clean [inode 0x10000000581 [2,head] /dc-dir/dc-file_908 auth v5818 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.078197+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946e5600] 2023-10-03T19:21:18.647 INFO:teuthology.orchestra.run.smithi045.stdout: -8366> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5818 now clean [dentry #0x1/dc-dir/dc-file_908 [2,head] auth (dversion lock) v=5818 ino=0x10000000581 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946e3680] 2023-10-03T19:21:18.647 INFO:teuthology.orchestra.run.smithi045.stdout: -8365> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_908) mark_clean [dentry #0x1/dc-dir/dc-file_908 [2,head] auth (dversion lock) v=5818 ino=0x10000000581 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946e3680] 2023-10-03T19:21:18.648 INFO:teuthology.orchestra.run.smithi045.stdout: -8364> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5820 now clean [inode 0x10000000582 [2,head] /dc-dir/dc-file_909 auth v5820 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.089539+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946e5b80] 2023-10-03T19:21:18.648 INFO:teuthology.orchestra.run.smithi045.stdout: -8363> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000582) mark_clean [inode 0x10000000582 [2,head] /dc-dir/dc-file_909 auth v5820 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.089539+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946e5b80] 2023-10-03T19:21:18.648 INFO:teuthology.orchestra.run.smithi045.stdout: -8362> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5820 now clean [dentry #0x1/dc-dir/dc-file_909 [2,head] auth (dversion lock) v=5820 ino=0x10000000582 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946e3900] 2023-10-03T19:21:18.648 INFO:teuthology.orchestra.run.smithi045.stdout: -8361> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_909) mark_clean [dentry #0x1/dc-dir/dc-file_909 [2,head] auth (dversion lock) v=5820 ino=0x10000000582 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946e3900] 2023-10-03T19:21:18.648 INFO:teuthology.orchestra.run.smithi045.stdout: -8360> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5822 now clean [inode 0x10000000583 [2,head] /dc-dir/dc-file_910 auth v5822 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.101860+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946e6100] 2023-10-03T19:21:18.648 INFO:teuthology.orchestra.run.smithi045.stdout: -8359> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000583) mark_clean [inode 0x10000000583 [2,head] /dc-dir/dc-file_910 auth v5822 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.101860+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946e6100] 2023-10-03T19:21:18.649 INFO:teuthology.orchestra.run.smithi045.stdout: -8358> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5822 now clean [dentry #0x1/dc-dir/dc-file_910 [2,head] auth (dversion lock) v=5822 ino=0x10000000583 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946e3b80] 2023-10-03T19:21:18.649 INFO:teuthology.orchestra.run.smithi045.stdout: -8357> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_910) mark_clean [dentry #0x1/dc-dir/dc-file_910 [2,head] auth (dversion lock) v=5822 ino=0x10000000583 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc946e3b80] 2023-10-03T19:21:18.649 INFO:teuthology.orchestra.run.smithi045.stdout: -8356> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5824 now clean [inode 0x10000000584 [2,head] /dc-dir/dc-file_911 auth v5824 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.191043+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946e6680] 2023-10-03T19:21:18.649 INFO:teuthology.orchestra.run.smithi045.stdout: -8355> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000584) mark_clean [inode 0x10000000584 [2,head] /dc-dir/dc-file_911 auth v5824 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.191043+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946e6680] 2023-10-03T19:21:18.649 INFO:teuthology.orchestra.run.smithi045.stdout: -8354> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5824 now clean [dentry #0x1/dc-dir/dc-file_911 [2,head] auth (dversion lock) v=5824 ino=0x10000000584 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94754000] 2023-10-03T19:21:18.649 INFO:teuthology.orchestra.run.smithi045.stdout: -8353> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_911) mark_clean [dentry #0x1/dc-dir/dc-file_911 [2,head] auth (dversion lock) v=5824 ino=0x10000000584 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94754000] 2023-10-03T19:21:18.649 INFO:teuthology.orchestra.run.smithi045.stdout: -8352> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5826 now clean [inode 0x10000000585 [2,head] /dc-dir/dc-file_912 auth v5826 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.248771+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946e6c00] 2023-10-03T19:21:18.649 INFO:teuthology.orchestra.run.smithi045.stdout: -8351> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000585) mark_clean [inode 0x10000000585 [2,head] /dc-dir/dc-file_912 auth v5826 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.248771+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946e6c00] 2023-10-03T19:21:18.649 INFO:teuthology.orchestra.run.smithi045.stdout: -8350> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5826 now clean [dentry #0x1/dc-dir/dc-file_912 [2,head] auth (dversion lock) v=5826 ino=0x10000000585 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94754280] 2023-10-03T19:21:18.649 INFO:teuthology.orchestra.run.smithi045.stdout: -8349> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_912) mark_clean [dentry #0x1/dc-dir/dc-file_912 [2,head] auth (dversion lock) v=5826 ino=0x10000000585 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94754280] 2023-10-03T19:21:18.650 INFO:teuthology.orchestra.run.smithi045.stdout: -8348> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5828 now clean [inode 0x10000000586 [2,head] /dc-dir/dc-file_913 auth v5828 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.261813+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946e7180] 2023-10-03T19:21:18.650 INFO:teuthology.orchestra.run.smithi045.stdout: -8347> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000586) mark_clean [inode 0x10000000586 [2,head] /dc-dir/dc-file_913 auth v5828 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.261813+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946e7180] 2023-10-03T19:21:18.650 INFO:teuthology.orchestra.run.smithi045.stdout: -8346> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5828 now clean [dentry #0x1/dc-dir/dc-file_913 [2,head] auth (dversion lock) v=5828 ino=0x10000000586 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94754500] 2023-10-03T19:21:18.650 INFO:teuthology.orchestra.run.smithi045.stdout: -8345> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_913) mark_clean [dentry #0x1/dc-dir/dc-file_913 [2,head] auth (dversion lock) v=5828 ino=0x10000000586 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94754500] 2023-10-03T19:21:18.650 INFO:teuthology.orchestra.run.smithi045.stdout: -8344> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5830 now clean [inode 0x10000000587 [2,head] /dc-dir/dc-file_914 auth v5830 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.274199+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946e7700] 2023-10-03T19:21:18.650 INFO:teuthology.orchestra.run.smithi045.stdout: -8343> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000587) mark_clean [inode 0x10000000587 [2,head] /dc-dir/dc-file_914 auth v5830 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.274199+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc946e7700] 2023-10-03T19:21:18.650 INFO:teuthology.orchestra.run.smithi045.stdout: -8342> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5830 now clean [dentry #0x1/dc-dir/dc-file_914 [2,head] auth (dversion lock) v=5830 ino=0x10000000587 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94754780] 2023-10-03T19:21:18.650 INFO:teuthology.orchestra.run.smithi045.stdout: -8341> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_914) mark_clean [dentry #0x1/dc-dir/dc-file_914 [2,head] auth (dversion lock) v=5830 ino=0x10000000587 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94754780] 2023-10-03T19:21:18.650 INFO:teuthology.orchestra.run.smithi045.stdout: -8340> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5832 now clean [inode 0x10000000588 [2,head] /dc-dir/dc-file_915 auth v5832 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.285737+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9475c000] 2023-10-03T19:21:18.650 INFO:teuthology.orchestra.run.smithi045.stdout: -8339> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000588) mark_clean [inode 0x10000000588 [2,head] /dc-dir/dc-file_915 auth v5832 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.285737+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9475c000] 2023-10-03T19:21:18.651 INFO:teuthology.orchestra.run.smithi045.stdout: -8338> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5832 now clean [dentry #0x1/dc-dir/dc-file_915 [2,head] auth (dversion lock) v=5832 ino=0x10000000588 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94754a00] 2023-10-03T19:21:18.651 INFO:teuthology.orchestra.run.smithi045.stdout: -8337> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_915) mark_clean [dentry #0x1/dc-dir/dc-file_915 [2,head] auth (dversion lock) v=5832 ino=0x10000000588 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94754a00] 2023-10-03T19:21:18.651 INFO:teuthology.orchestra.run.smithi045.stdout: -8336> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5834 now clean [inode 0x10000000589 [2,head] /dc-dir/dc-file_916 auth v5834 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.298068+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9475c580] 2023-10-03T19:21:18.651 INFO:teuthology.orchestra.run.smithi045.stdout: -8335> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000589) mark_clean [inode 0x10000000589 [2,head] /dc-dir/dc-file_916 auth v5834 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.298068+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9475c580] 2023-10-03T19:21:18.651 INFO:teuthology.orchestra.run.smithi045.stdout: -8334> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5834 now clean [dentry #0x1/dc-dir/dc-file_916 [2,head] auth (dversion lock) v=5834 ino=0x10000000589 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94754c80] 2023-10-03T19:21:18.651 INFO:teuthology.orchestra.run.smithi045.stdout: -8333> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_916) mark_clean [dentry #0x1/dc-dir/dc-file_916 [2,head] auth (dversion lock) v=5834 ino=0x10000000589 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94754c80] 2023-10-03T19:21:18.651 INFO:teuthology.orchestra.run.smithi045.stdout: -8332> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5836 now clean [inode 0x1000000058a [2,head] /dc-dir/dc-file_917 auth v5836 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.309902+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9475cb00] 2023-10-03T19:21:18.651 INFO:teuthology.orchestra.run.smithi045.stdout: -8331> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000058a) mark_clean [inode 0x1000000058a [2,head] /dc-dir/dc-file_917 auth v5836 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.309902+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9475cb00] 2023-10-03T19:21:18.651 INFO:teuthology.orchestra.run.smithi045.stdout: -8330> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5836 now clean [dentry #0x1/dc-dir/dc-file_917 [2,head] auth (dversion lock) v=5836 ino=0x1000000058a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94754f00] 2023-10-03T19:21:18.651 INFO:teuthology.orchestra.run.smithi045.stdout: -8329> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_917) mark_clean [dentry #0x1/dc-dir/dc-file_917 [2,head] auth (dversion lock) v=5836 ino=0x1000000058a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94754f00] 2023-10-03T19:21:18.651 INFO:teuthology.orchestra.run.smithi045.stdout: -8328> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5838 now clean [inode 0x1000000058b [2,head] /dc-dir/dc-file_918 auth v5838 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.322449+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9475d080] 2023-10-03T19:21:18.652 INFO:teuthology.orchestra.run.smithi045.stdout: -8327> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000058b) mark_clean [inode 0x1000000058b [2,head] /dc-dir/dc-file_918 auth v5838 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.322449+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9475d080] 2023-10-03T19:21:18.738 INFO:teuthology.orchestra.run.smithi045.stdout: -8326> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5838 now clean [dentry #0x1/dc-dir/dc-file_918 [2,head] auth (dversion lock) v=5838 ino=0x1000000058b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94755180] 2023-10-03T19:21:18.738 INFO:teuthology.orchestra.run.smithi045.stdout: -8325> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_918) mark_clean [dentry #0x1/dc-dir/dc-file_918 [2,head] auth (dversion lock) v=5838 ino=0x1000000058b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94755180] 2023-10-03T19:21:18.738 INFO:teuthology.orchestra.run.smithi045.stdout: -8324> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5840 now clean [inode 0x1000000058c [2,head] /dc-dir/dc-file_919 auth v5840 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.334165+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9475d600] 2023-10-03T19:21:18.738 INFO:teuthology.orchestra.run.smithi045.stdout: -8323> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000058c) mark_clean [inode 0x1000000058c [2,head] /dc-dir/dc-file_919 auth v5840 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.334165+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9475d600] 2023-10-03T19:21:18.739 INFO:teuthology.orchestra.run.smithi045.stdout: -8322> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5840 now clean [dentry #0x1/dc-dir/dc-file_919 [2,head] auth (dversion lock) v=5840 ino=0x1000000058c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94755400] 2023-10-03T19:21:18.739 INFO:teuthology.orchestra.run.smithi045.stdout: -8321> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_919) mark_clean [dentry #0x1/dc-dir/dc-file_919 [2,head] auth (dversion lock) v=5840 ino=0x1000000058c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94755400] 2023-10-03T19:21:18.739 INFO:teuthology.orchestra.run.smithi045.stdout: -8320> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5842 now clean [inode 0x1000000058d [2,head] /dc-dir/dc-file_920 auth v5842 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.345546+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9475db80] 2023-10-03T19:21:18.739 INFO:teuthology.orchestra.run.smithi045.stdout: -8319> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000058d) mark_clean [inode 0x1000000058d [2,head] /dc-dir/dc-file_920 auth v5842 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.345546+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9475db80] 2023-10-03T19:21:18.739 INFO:teuthology.orchestra.run.smithi045.stdout: -8318> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5842 now clean [dentry #0x1/dc-dir/dc-file_920 [2,head] auth (dversion lock) v=5842 ino=0x1000000058d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94755680] 2023-10-03T19:21:18.739 INFO:teuthology.orchestra.run.smithi045.stdout: -8317> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_920) mark_clean [dentry #0x1/dc-dir/dc-file_920 [2,head] auth (dversion lock) v=5842 ino=0x1000000058d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94755680] 2023-10-03T19:21:18.739 INFO:teuthology.orchestra.run.smithi045.stdout: -8316> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5844 now clean [inode 0x1000000058e [2,head] /dc-dir/dc-file_921 auth v5844 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.357110+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9475e100] 2023-10-03T19:21:18.740 INFO:teuthology.orchestra.run.smithi045.stdout: -8315> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000058e) mark_clean [inode 0x1000000058e [2,head] /dc-dir/dc-file_921 auth v5844 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.357110+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9475e100] 2023-10-03T19:21:18.740 INFO:teuthology.orchestra.run.smithi045.stdout: -8314> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5844 now clean [dentry #0x1/dc-dir/dc-file_921 [2,head] auth (dversion lock) v=5844 ino=0x1000000058e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94755900] 2023-10-03T19:21:18.740 INFO:teuthology.orchestra.run.smithi045.stdout: -8313> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_921) mark_clean [dentry #0x1/dc-dir/dc-file_921 [2,head] auth (dversion lock) v=5844 ino=0x1000000058e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94755900] 2023-10-03T19:21:18.740 INFO:teuthology.orchestra.run.smithi045.stdout: -8312> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5846 now clean [inode 0x1000000058f [2,head] /dc-dir/dc-file_922 auth v5846 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.368611+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9475e680] 2023-10-03T19:21:18.740 INFO:teuthology.orchestra.run.smithi045.stdout: -8311> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000058f) mark_clean [inode 0x1000000058f [2,head] /dc-dir/dc-file_922 auth v5846 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.368611+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9475e680] 2023-10-03T19:21:18.740 INFO:teuthology.orchestra.run.smithi045.stdout: -8310> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5846 now clean [dentry #0x1/dc-dir/dc-file_922 [2,head] auth (dversion lock) v=5846 ino=0x1000000058f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94755b80] 2023-10-03T19:21:18.740 INFO:teuthology.orchestra.run.smithi045.stdout: -8309> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_922) mark_clean [dentry #0x1/dc-dir/dc-file_922 [2,head] auth (dversion lock) v=5846 ino=0x1000000058f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94755b80] 2023-10-03T19:21:18.740 INFO:teuthology.orchestra.run.smithi045.stdout: -8308> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5848 now clean [inode 0x10000000590 [2,head] /dc-dir/dc-file_923 auth v5848 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.379945+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9475ec00] 2023-10-03T19:21:18.741 INFO:teuthology.orchestra.run.smithi045.stdout: -8307> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000590) mark_clean [inode 0x10000000590 [2,head] /dc-dir/dc-file_923 auth v5848 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.379945+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9475ec00] 2023-10-03T19:21:18.741 INFO:teuthology.orchestra.run.smithi045.stdout: -8306> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5848 now clean [dentry #0x1/dc-dir/dc-file_923 [2,head] auth (dversion lock) v=5848 ino=0x10000000590 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94760000] 2023-10-03T19:21:18.741 INFO:teuthology.orchestra.run.smithi045.stdout: -8305> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_923) mark_clean [dentry #0x1/dc-dir/dc-file_923 [2,head] auth (dversion lock) v=5848 ino=0x10000000590 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94760000] 2023-10-03T19:21:18.741 INFO:teuthology.orchestra.run.smithi045.stdout: -8304> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5850 now clean [inode 0x10000000591 [2,head] /dc-dir/dc-file_924 auth v5850 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.391684+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9475f180] 2023-10-03T19:21:18.741 INFO:teuthology.orchestra.run.smithi045.stdout: -8303> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000591) mark_clean [inode 0x10000000591 [2,head] /dc-dir/dc-file_924 auth v5850 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.391684+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9475f180] 2023-10-03T19:21:18.741 INFO:teuthology.orchestra.run.smithi045.stdout: -8302> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5850 now clean [dentry #0x1/dc-dir/dc-file_924 [2,head] auth (dversion lock) v=5850 ino=0x10000000591 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94760280] 2023-10-03T19:21:18.741 INFO:teuthology.orchestra.run.smithi045.stdout: -8301> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_924) mark_clean [dentry #0x1/dc-dir/dc-file_924 [2,head] auth (dversion lock) v=5850 ino=0x10000000591 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94760280] 2023-10-03T19:21:18.742 INFO:teuthology.orchestra.run.smithi045.stdout: -8300> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5852 now clean [inode 0x10000000592 [2,head] /dc-dir/dc-file_925 auth v5852 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.404041+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9475f700] 2023-10-03T19:21:18.742 INFO:teuthology.orchestra.run.smithi045.stdout: -8299> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000592) mark_clean [inode 0x10000000592 [2,head] /dc-dir/dc-file_925 auth v5852 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.404041+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9475f700] 2023-10-03T19:21:18.742 INFO:teuthology.orchestra.run.smithi045.stdout: -8298> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5852 now clean [dentry #0x1/dc-dir/dc-file_925 [2,head] auth (dversion lock) v=5852 ino=0x10000000592 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94760500] 2023-10-03T19:21:18.742 INFO:teuthology.orchestra.run.smithi045.stdout: -8297> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_925) mark_clean [dentry #0x1/dc-dir/dc-file_925 [2,head] auth (dversion lock) v=5852 ino=0x10000000592 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94760500] 2023-10-03T19:21:18.742 INFO:teuthology.orchestra.run.smithi045.stdout: -8296> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5854 now clean [inode 0x10000000593 [2,head] /dc-dir/dc-file_926 auth v5854 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.415576+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94762000] 2023-10-03T19:21:18.742 INFO:teuthology.orchestra.run.smithi045.stdout: -8295> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000593) mark_clean [inode 0x10000000593 [2,head] /dc-dir/dc-file_926 auth v5854 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.415576+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94762000] 2023-10-03T19:21:18.742 INFO:teuthology.orchestra.run.smithi045.stdout: -8294> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5854 now clean [dentry #0x1/dc-dir/dc-file_926 [2,head] auth (dversion lock) v=5854 ino=0x10000000593 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94760780] 2023-10-03T19:21:18.743 INFO:teuthology.orchestra.run.smithi045.stdout: -8293> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_926) mark_clean [dentry #0x1/dc-dir/dc-file_926 [2,head] auth (dversion lock) v=5854 ino=0x10000000593 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94760780] 2023-10-03T19:21:18.743 INFO:teuthology.orchestra.run.smithi045.stdout: -8292> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5856 now clean [inode 0x10000000594 [2,head] /dc-dir/dc-file_927 auth v5856 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.427592+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94762580] 2023-10-03T19:21:18.743 INFO:teuthology.orchestra.run.smithi045.stdout: -8291> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000594) mark_clean [inode 0x10000000594 [2,head] /dc-dir/dc-file_927 auth v5856 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.427592+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94762580] 2023-10-03T19:21:18.743 INFO:teuthology.orchestra.run.smithi045.stdout: -8290> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5856 now clean [dentry #0x1/dc-dir/dc-file_927 [2,head] auth (dversion lock) v=5856 ino=0x10000000594 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94760a00] 2023-10-03T19:21:18.743 INFO:teuthology.orchestra.run.smithi045.stdout: -8289> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_927) mark_clean [dentry #0x1/dc-dir/dc-file_927 [2,head] auth (dversion lock) v=5856 ino=0x10000000594 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94760a00] 2023-10-03T19:21:18.743 INFO:teuthology.orchestra.run.smithi045.stdout: -8288> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5858 now clean [inode 0x10000000595 [2,head] /dc-dir/dc-file_928 auth v5858 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.439118+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94762b00] 2023-10-03T19:21:18.743 INFO:teuthology.orchestra.run.smithi045.stdout: -8287> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 85 ==== osd_op_reply(1097 10000000212.00000000 [create,setxattr (98),setxattr (30)] v74'23 uv23 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:18.743 INFO:teuthology.orchestra.run.smithi045.stdout: -8286> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000595) mark_clean [inode 0x10000000595 [2,head] /dc-dir/dc-file_928 auth v5858 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.439118+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94762b00] 2023-10-03T19:21:18.743 INFO:teuthology.orchestra.run.smithi045.stdout: -8285> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5858 now clean [dentry #0x1/dc-dir/dc-file_928 [2,head] auth (dversion lock) v=5858 ino=0x10000000595 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94760c80] 2023-10-03T19:21:18.744 INFO:teuthology.orchestra.run.smithi045.stdout: -8284> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_928) mark_clean [dentry #0x1/dc-dir/dc-file_928 [2,head] auth (dversion lock) v=5858 ino=0x10000000595 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94760c80] 2023-10-03T19:21:18.744 INFO:teuthology.orchestra.run.smithi045.stdout: -8283> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 86 ==== osd_op_reply(1136 10000000239.00000000 [create,setxattr (98),setxattr (30)] v74'24 uv24 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:18.744 INFO:teuthology.orchestra.run.smithi045.stdout: -8282> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5860 now clean [inode 0x10000000596 [2,head] /dc-dir/dc-file_929 auth v5860 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.450943+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94763080] 2023-10-03T19:21:18.744 INFO:teuthology.orchestra.run.smithi045.stdout: -8281> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000596) mark_clean [inode 0x10000000596 [2,head] /dc-dir/dc-file_929 auth v5860 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.450943+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94763080] 2023-10-03T19:21:18.744 INFO:teuthology.orchestra.run.smithi045.stdout: -8280> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5860 now clean [dentry #0x1/dc-dir/dc-file_929 [2,head] auth (dversion lock) v=5860 ino=0x10000000596 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94760f00] 2023-10-03T19:21:18.744 INFO:teuthology.orchestra.run.smithi045.stdout: -8279> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 87 ==== osd_op_reply(1139 1000000023c.00000000 [create,setxattr (98),setxattr (30)] v74'25 uv25 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:18.744 INFO:teuthology.orchestra.run.smithi045.stdout: -8278> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_929) mark_clean [dentry #0x1/dc-dir/dc-file_929 [2,head] auth (dversion lock) v=5860 ino=0x10000000596 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94760f00] 2023-10-03T19:21:18.744 INFO:teuthology.orchestra.run.smithi045.stdout: -8277> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5862 now clean [inode 0x10000000597 [2,head] /dc-dir/dc-file_930 auth v5862 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.462223+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94763600] 2023-10-03T19:21:18.744 INFO:teuthology.orchestra.run.smithi045.stdout: -8276> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000597) mark_clean [inode 0x10000000597 [2,head] /dc-dir/dc-file_930 auth v5862 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.462223+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94763600] 2023-10-03T19:21:18.745 INFO:teuthology.orchestra.run.smithi045.stdout: -8275> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 88 ==== osd_op_reply(1144 10000000241.00000000 [create,setxattr (98),setxattr (30)] v74'26 uv26 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:18.745 INFO:teuthology.orchestra.run.smithi045.stdout: -8274> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5862 now clean [dentry #0x1/dc-dir/dc-file_930 [2,head] auth (dversion lock) v=5862 ino=0x10000000597 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94761180] 2023-10-03T19:21:18.745 INFO:teuthology.orchestra.run.smithi045.stdout: -8273> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_930) mark_clean [dentry #0x1/dc-dir/dc-file_930 [2,head] auth (dversion lock) v=5862 ino=0x10000000597 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94761180] 2023-10-03T19:21:18.745 INFO:teuthology.orchestra.run.smithi045.stdout: -8272> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5864 now clean [inode 0x10000000598 [2,head] /dc-dir/dc-file_931 auth v5864 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.474241+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94763b80] 2023-10-03T19:21:18.745 INFO:teuthology.orchestra.run.smithi045.stdout: -8271> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 89 ==== osd_op_reply(1169 1000000025a.00000000 [create,setxattr (99),setxattr (30)] v74'27 uv27 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:18.745 INFO:teuthology.orchestra.run.smithi045.stdout: -8270> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000598) mark_clean [inode 0x10000000598 [2,head] /dc-dir/dc-file_931 auth v5864 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.474241+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94763b80] 2023-10-03T19:21:18.745 INFO:teuthology.orchestra.run.smithi045.stdout: -8269> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5864 now clean [dentry #0x1/dc-dir/dc-file_931 [2,head] auth (dversion lock) v=5864 ino=0x10000000598 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94761400] 2023-10-03T19:21:18.745 INFO:teuthology.orchestra.run.smithi045.stdout: -8268> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_931) mark_clean [dentry #0x1/dc-dir/dc-file_931 [2,head] auth (dversion lock) v=5864 ino=0x10000000598 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94761400] 2023-10-03T19:21:18.745 INFO:teuthology.orchestra.run.smithi045.stdout: -8267> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5866 now clean [inode 0x10000000599 [2,head] /dc-dir/dc-file_932 auth v5866 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.485632+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94764100] 2023-10-03T19:21:18.745 INFO:teuthology.orchestra.run.smithi045.stdout: -8266> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000599) mark_clean [inode 0x10000000599 [2,head] /dc-dir/dc-file_932 auth v5866 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.485632+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94764100] 2023-10-03T19:21:18.745 INFO:teuthology.orchestra.run.smithi045.stdout: -8265> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5866 now clean [dentry #0x1/dc-dir/dc-file_932 [2,head] auth (dversion lock) v=5866 ino=0x10000000599 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94761680] 2023-10-03T19:21:18.746 INFO:teuthology.orchestra.run.smithi045.stdout: -8264> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_932) mark_clean [dentry #0x1/dc-dir/dc-file_932 [2,head] auth (dversion lock) v=5866 ino=0x10000000599 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94761680] 2023-10-03T19:21:18.746 INFO:teuthology.orchestra.run.smithi045.stdout: -8263> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5868 now clean [inode 0x1000000059a [2,head] /dc-dir/dc-file_933 auth v5868 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.496719+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94764680] 2023-10-03T19:21:18.786 INFO:teuthology.orchestra.run.smithi045.stdout: -8262> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000059a) mark_clean [inode 0x1000000059a [2,head] /dc-dir/dc-file_933 auth v5868 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.496719+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94764680] 2023-10-03T19:21:18.786 INFO:teuthology.orchestra.run.smithi045.stdout: -8261> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5868 now clean [dentry #0x1/dc-dir/dc-file_933 [2,head] auth (dversion lock) v=5868 ino=0x1000000059a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94761900] 2023-10-03T19:21:18.786 INFO:teuthology.orchestra.run.smithi045.stdout: -8260> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_933) mark_clean [dentry #0x1/dc-dir/dc-file_933 [2,head] auth (dversion lock) v=5868 ino=0x1000000059a state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94761900] 2023-10-03T19:21:18.786 INFO:teuthology.orchestra.run.smithi045.stdout: -8259> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5870 now clean [inode 0x1000000059b [2,head] /dc-dir/dc-file_934 auth v5870 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.508220+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94764c00] 2023-10-03T19:21:18.786 INFO:teuthology.orchestra.run.smithi045.stdout: -8258> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000059b) mark_clean [inode 0x1000000059b [2,head] /dc-dir/dc-file_934 auth v5870 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.508220+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94764c00] 2023-10-03T19:21:18.787 INFO:teuthology.orchestra.run.smithi045.stdout: -8257> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5870 now clean [dentry #0x1/dc-dir/dc-file_934 [2,head] auth (dversion lock) v=5870 ino=0x1000000059b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94761b80] 2023-10-03T19:21:18.787 INFO:teuthology.orchestra.run.smithi045.stdout: -8256> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_934) mark_clean [dentry #0x1/dc-dir/dc-file_934 [2,head] auth (dversion lock) v=5870 ino=0x1000000059b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94761b80] 2023-10-03T19:21:18.787 INFO:teuthology.orchestra.run.smithi045.stdout: -8255> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5872 now clean [inode 0x1000000059c [2,head] /dc-dir/dc-file_935 auth v5872 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.520205+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94765180] 2023-10-03T19:21:18.787 INFO:teuthology.orchestra.run.smithi045.stdout: -8254> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000059c) mark_clean [inode 0x1000000059c [2,head] /dc-dir/dc-file_935 auth v5872 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.520205+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94765180] 2023-10-03T19:21:18.787 INFO:teuthology.orchestra.run.smithi045.stdout: -8253> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5872 now clean [dentry #0x1/dc-dir/dc-file_935 [2,head] auth (dversion lock) v=5872 ino=0x1000000059c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9476a000] 2023-10-03T19:21:18.787 INFO:teuthology.orchestra.run.smithi045.stdout: -8252> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_935) mark_clean [dentry #0x1/dc-dir/dc-file_935 [2,head] auth (dversion lock) v=5872 ino=0x1000000059c state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9476a000] 2023-10-03T19:21:18.788 INFO:teuthology.orchestra.run.smithi045.stdout: -8251> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5874 now clean [inode 0x1000000059d [2,head] /dc-dir/dc-file_936 auth v5874 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.532245+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94765700] 2023-10-03T19:21:18.788 INFO:teuthology.orchestra.run.smithi045.stdout: -8250> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000059d) mark_clean [inode 0x1000000059d [2,head] /dc-dir/dc-file_936 auth v5874 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.532245+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94765700] 2023-10-03T19:21:18.788 INFO:teuthology.orchestra.run.smithi045.stdout: -8249> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5874 now clean [dentry #0x1/dc-dir/dc-file_936 [2,head] auth (dversion lock) v=5874 ino=0x1000000059d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9476a280] 2023-10-03T19:21:18.788 INFO:teuthology.orchestra.run.smithi045.stdout: -8248> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_936) mark_clean [dentry #0x1/dc-dir/dc-file_936 [2,head] auth (dversion lock) v=5874 ino=0x1000000059d state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9476a280] 2023-10-03T19:21:18.788 INFO:teuthology.orchestra.run.smithi045.stdout: -8247> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5876 now clean [inode 0x1000000059e [2,head] /dc-dir/dc-file_937 auth v5876 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.544005+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9476c000] 2023-10-03T19:21:18.788 INFO:teuthology.orchestra.run.smithi045.stdout: -8246> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000059e) mark_clean [inode 0x1000000059e [2,head] /dc-dir/dc-file_937 auth v5876 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.544005+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9476c000] 2023-10-03T19:21:18.788 INFO:teuthology.orchestra.run.smithi045.stdout: -8245> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 58 ==== osd_op_reply(1397 1000000033e.00000000 [create,setxattr (99),setxattr (30)] v74'23 uv23 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:18.788 INFO:teuthology.orchestra.run.smithi045.stdout: -8244> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5876 now clean [dentry #0x1/dc-dir/dc-file_937 [2,head] auth (dversion lock) v=5876 ino=0x1000000059e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9476a500] 2023-10-03T19:21:18.788 INFO:teuthology.orchestra.run.smithi045.stdout: -8243> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_937) mark_clean [dentry #0x1/dc-dir/dc-file_937 [2,head] auth (dversion lock) v=5876 ino=0x1000000059e state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9476a500] 2023-10-03T19:21:18.788 INFO:teuthology.orchestra.run.smithi045.stdout: -8242> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5878 now clean [inode 0x1000000059f [2,head] /dc-dir/dc-file_938 auth v5878 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.555799+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9476c580] 2023-10-03T19:21:18.789 INFO:teuthology.orchestra.run.smithi045.stdout: -8241> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000059f) mark_clean [inode 0x1000000059f [2,head] /dc-dir/dc-file_938 auth v5878 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.555799+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9476c580] 2023-10-03T19:21:18.789 INFO:teuthology.orchestra.run.smithi045.stdout: -8240> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5878 now clean [dentry #0x1/dc-dir/dc-file_938 [2,head] auth (dversion lock) v=5878 ino=0x1000000059f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9476a780] 2023-10-03T19:21:18.789 INFO:teuthology.orchestra.run.smithi045.stdout: -8239> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_938) mark_clean [dentry #0x1/dc-dir/dc-file_938 [2,head] auth (dversion lock) v=5878 ino=0x1000000059f state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9476a780] 2023-10-03T19:21:18.789 INFO:teuthology.orchestra.run.smithi045.stdout: -8238> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5880 now clean [inode 0x100000005a0 [2,head] /dc-dir/dc-file_939 auth v5880 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.567107+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9476cb00] 2023-10-03T19:21:18.789 INFO:teuthology.orchestra.run.smithi045.stdout: -8237> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a0) mark_clean [inode 0x100000005a0 [2,head] /dc-dir/dc-file_939 auth v5880 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.567107+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9476cb00] 2023-10-03T19:21:18.789 INFO:teuthology.orchestra.run.smithi045.stdout: -8236> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5880 now clean [dentry #0x1/dc-dir/dc-file_939 [2,head] auth (dversion lock) v=5880 ino=0x100000005a0 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9476aa00] 2023-10-03T19:21:18.789 INFO:teuthology.orchestra.run.smithi045.stdout: -8235> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_939) mark_clean [dentry #0x1/dc-dir/dc-file_939 [2,head] auth (dversion lock) v=5880 ino=0x100000005a0 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9476aa00] 2023-10-03T19:21:18.790 INFO:teuthology.orchestra.run.smithi045.stdout: -8234> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5882 now clean [inode 0x100000005a1 [2,head] /dc-dir/dc-file_940 auth v5882 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.578640+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9476d080] 2023-10-03T19:21:18.790 INFO:teuthology.orchestra.run.smithi045.stdout: -8233> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a1) mark_clean [inode 0x100000005a1 [2,head] /dc-dir/dc-file_940 auth v5882 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.578640+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9476d080] 2023-10-03T19:21:18.790 INFO:teuthology.orchestra.run.smithi045.stdout: -8232> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5882 now clean [dentry #0x1/dc-dir/dc-file_940 [2,head] auth (dversion lock) v=5882 ino=0x100000005a1 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9476ac80] 2023-10-03T19:21:18.790 INFO:teuthology.orchestra.run.smithi045.stdout: -8231> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_940) mark_clean [dentry #0x1/dc-dir/dc-file_940 [2,head] auth (dversion lock) v=5882 ino=0x100000005a1 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9476ac80] 2023-10-03T19:21:18.790 INFO:teuthology.orchestra.run.smithi045.stdout: -8230> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5884 now clean [inode 0x100000005a2 [2,head] /dc-dir/dc-file_941 auth v5884 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.589765+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9476d600] 2023-10-03T19:21:18.790 INFO:teuthology.orchestra.run.smithi045.stdout: -8229> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a2) mark_clean [inode 0x100000005a2 [2,head] /dc-dir/dc-file_941 auth v5884 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.589765+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9476d600] 2023-10-03T19:21:18.790 INFO:teuthology.orchestra.run.smithi045.stdout: -8228> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5884 now clean [dentry #0x1/dc-dir/dc-file_941 [2,head] auth (dversion lock) v=5884 ino=0x100000005a2 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9476af00] 2023-10-03T19:21:18.791 INFO:teuthology.orchestra.run.smithi045.stdout: -8227> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 59 ==== osd_op_reply(1403 10000000344.00000000 [create,setxattr (99),setxattr (30)] v74'23 uv23 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:18.791 INFO:teuthology.orchestra.run.smithi045.stdout: -8226> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_941) mark_clean [dentry #0x1/dc-dir/dc-file_941 [2,head] auth (dversion lock) v=5884 ino=0x100000005a2 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9476af00] 2023-10-03T19:21:18.791 INFO:teuthology.orchestra.run.smithi045.stdout: -8225> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5886 now clean [inode 0x100000005a3 [2,head] /dc-dir/dc-file_942 auth v5886 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.602121+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9476db80] 2023-10-03T19:21:18.791 INFO:teuthology.orchestra.run.smithi045.stdout: -8224> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a3) mark_clean [inode 0x100000005a3 [2,head] /dc-dir/dc-file_942 auth v5886 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.602121+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9476db80] 2023-10-03T19:21:18.791 INFO:teuthology.orchestra.run.smithi045.stdout: -8223> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5886 now clean [dentry #0x1/dc-dir/dc-file_942 [2,head] auth (dversion lock) v=5886 ino=0x100000005a3 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9476b180] 2023-10-03T19:21:18.791 INFO:teuthology.orchestra.run.smithi045.stdout: -8222> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_942) mark_clean [dentry #0x1/dc-dir/dc-file_942 [2,head] auth (dversion lock) v=5886 ino=0x100000005a3 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9476b180] 2023-10-03T19:21:18.791 INFO:teuthology.orchestra.run.smithi045.stdout: -8221> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5888 now clean [inode 0x100000005a4 [2,head] /dc-dir/dc-file_943 auth v5888 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.614834+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9476e100] 2023-10-03T19:21:18.792 INFO:teuthology.orchestra.run.smithi045.stdout: -8220> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a4) mark_clean [inode 0x100000005a4 [2,head] /dc-dir/dc-file_943 auth v5888 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.614834+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9476e100] 2023-10-03T19:21:18.792 INFO:teuthology.orchestra.run.smithi045.stdout: -8219> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5888 now clean [dentry #0x1/dc-dir/dc-file_943 [2,head] auth (dversion lock) v=5888 ino=0x100000005a4 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9476b400] 2023-10-03T19:21:18.792 INFO:teuthology.orchestra.run.smithi045.stdout: -8218> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_943) mark_clean [dentry #0x1/dc-dir/dc-file_943 [2,head] auth (dversion lock) v=5888 ino=0x100000005a4 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9476b400] 2023-10-03T19:21:18.792 INFO:teuthology.orchestra.run.smithi045.stdout: -8217> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5890 now clean [inode 0x100000005a5 [2,head] /dc-dir/dc-file_944 auth v5890 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.626490+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9476e680] 2023-10-03T19:21:18.792 INFO:teuthology.orchestra.run.smithi045.stdout: -8216> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a5) mark_clean [inode 0x100000005a5 [2,head] /dc-dir/dc-file_944 auth v5890 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.626490+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9476e680] 2023-10-03T19:21:18.792 INFO:teuthology.orchestra.run.smithi045.stdout: -8215> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5890 now clean [dentry #0x1/dc-dir/dc-file_944 [2,head] auth (dversion lock) v=5890 ino=0x100000005a5 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9476b680] 2023-10-03T19:21:18.792 INFO:teuthology.orchestra.run.smithi045.stdout: -8214> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_944) mark_clean [dentry #0x1/dc-dir/dc-file_944 [2,head] auth (dversion lock) v=5890 ino=0x100000005a5 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9476b680] 2023-10-03T19:21:18.793 INFO:teuthology.orchestra.run.smithi045.stdout: -8213> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5892 now clean [inode 0x100000005a6 [2,head] /dc-dir/dc-file_945 auth v5892 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.637656+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9476ec00] 2023-10-03T19:21:18.793 INFO:teuthology.orchestra.run.smithi045.stdout: -8212> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a6) mark_clean [inode 0x100000005a6 [2,head] /dc-dir/dc-file_945 auth v5892 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.637656+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9476ec00] 2023-10-03T19:21:18.793 INFO:teuthology.orchestra.run.smithi045.stdout: -8211> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5892 now clean [dentry #0x1/dc-dir/dc-file_945 [2,head] auth (dversion lock) v=5892 ino=0x100000005a6 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9476b900] 2023-10-03T19:21:18.793 INFO:teuthology.orchestra.run.smithi045.stdout: -8210> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_945) mark_clean [dentry #0x1/dc-dir/dc-file_945 [2,head] auth (dversion lock) v=5892 ino=0x100000005a6 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9476b900] 2023-10-03T19:21:18.793 INFO:teuthology.orchestra.run.smithi045.stdout: -8209> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5894 now clean [inode 0x100000005a7 [2,head] /dc-dir/dc-file_946 auth v5894 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.648791+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9476f180] 2023-10-03T19:21:18.793 INFO:teuthology.orchestra.run.smithi045.stdout: -8208> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a7) mark_clean [inode 0x100000005a7 [2,head] /dc-dir/dc-file_946 auth v5894 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.648791+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9476f180] 2023-10-03T19:21:18.793 INFO:teuthology.orchestra.run.smithi045.stdout: -8207> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 60 ==== osd_op_reply(1436 10000000365.00000000 [create,setxattr (99),setxattr (30)] v74'24 uv24 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:18.794 INFO:teuthology.orchestra.run.smithi045.stdout: -8206> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5894 now clean [dentry #0x1/dc-dir/dc-file_946 [2,head] auth (dversion lock) v=5894 ino=0x100000005a7 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9476bb80] 2023-10-03T19:21:18.820 INFO:teuthology.orchestra.run.smithi045.stdout: -8205> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_946) mark_clean [dentry #0x1/dc-dir/dc-file_946 [2,head] auth (dversion lock) v=5894 ino=0x100000005a7 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9476bb80] 2023-10-03T19:21:18.820 INFO:teuthology.orchestra.run.smithi045.stdout: -8204> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5896 now clean [inode 0x100000005a8 [2,head] /dc-dir/dc-file_947 auth v5896 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.661701+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9476f700] 2023-10-03T19:21:18.820 INFO:teuthology.orchestra.run.smithi045.stdout: -8203> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a8) mark_clean [inode 0x100000005a8 [2,head] /dc-dir/dc-file_947 auth v5896 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.661701+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9476f700] 2023-10-03T19:21:18.821 INFO:teuthology.orchestra.run.smithi045.stdout: -8202> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5896 now clean [dentry #0x1/dc-dir/dc-file_947 [2,head] auth (dversion lock) v=5896 ino=0x100000005a8 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94772000] 2023-10-03T19:21:18.821 INFO:teuthology.orchestra.run.smithi045.stdout: -8201> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_947) mark_clean [dentry #0x1/dc-dir/dc-file_947 [2,head] auth (dversion lock) v=5896 ino=0x100000005a8 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94772000] 2023-10-03T19:21:18.821 INFO:teuthology.orchestra.run.smithi045.stdout: -8200> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5898 now clean [inode 0x100000005a9 [2,head] /dc-dir/dc-file_948 auth v5898 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.674973+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94774000] 2023-10-03T19:21:18.821 INFO:teuthology.orchestra.run.smithi045.stdout: -8199> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a9) mark_clean [inode 0x100000005a9 [2,head] /dc-dir/dc-file_948 auth v5898 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.674973+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94774000] 2023-10-03T19:21:18.821 INFO:teuthology.orchestra.run.smithi045.stdout: -8198> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 61 ==== osd_op_reply(1456 10000000379.00000000 [create,setxattr (99),setxattr (30)] v74'24 uv24 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:18.821 INFO:teuthology.orchestra.run.smithi045.stdout: -8197> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5898 now clean [dentry #0x1/dc-dir/dc-file_948 [2,head] auth (dversion lock) v=5898 ino=0x100000005a9 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94772280] 2023-10-03T19:21:18.821 INFO:teuthology.orchestra.run.smithi045.stdout: -8196> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_948) mark_clean [dentry #0x1/dc-dir/dc-file_948 [2,head] auth (dversion lock) v=5898 ino=0x100000005a9 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94772280] 2023-10-03T19:21:18.822 INFO:teuthology.orchestra.run.smithi045.stdout: -8195> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5900 now clean [inode 0x100000005aa [2,head] /dc-dir/dc-file_949 auth v5900 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.688324+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94774580] 2023-10-03T19:21:18.822 INFO:teuthology.orchestra.run.smithi045.stdout: -8194> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 62 ==== osd_op_reply(1470 10000000387.00000000 [create,setxattr (99),setxattr (30)] v74'25 uv25 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:18.822 INFO:teuthology.orchestra.run.smithi045.stdout: -8193> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005aa) mark_clean [inode 0x100000005aa [2,head] /dc-dir/dc-file_949 auth v5900 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.688324+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94774580] 2023-10-03T19:21:18.822 INFO:teuthology.orchestra.run.smithi045.stdout: -8192> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5900 now clean [dentry #0x1/dc-dir/dc-file_949 [2,head] auth (dversion lock) v=5900 ino=0x100000005aa state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94772500] 2023-10-03T19:21:18.822 INFO:teuthology.orchestra.run.smithi045.stdout: -8191> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_949) mark_clean [dentry #0x1/dc-dir/dc-file_949 [2,head] auth (dversion lock) v=5900 ino=0x100000005aa state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94772500] 2023-10-03T19:21:18.822 INFO:teuthology.orchestra.run.smithi045.stdout: -8190> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5902 now clean [inode 0x100000005ab [2,head] /dc-dir/dc-file_950 auth v5902 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.700334+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94774b00] 2023-10-03T19:21:18.823 INFO:teuthology.orchestra.run.smithi045.stdout: -8189> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ab) mark_clean [inode 0x100000005ab [2,head] /dc-dir/dc-file_950 auth v5902 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.700334+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94774b00] 2023-10-03T19:21:18.823 INFO:teuthology.orchestra.run.smithi045.stdout: -8188> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5902 now clean [dentry #0x1/dc-dir/dc-file_950 [2,head] auth (dversion lock) v=5902 ino=0x100000005ab state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94772780] 2023-10-03T19:21:18.823 INFO:teuthology.orchestra.run.smithi045.stdout: -8187> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_950) mark_clean [dentry #0x1/dc-dir/dc-file_950 [2,head] auth (dversion lock) v=5902 ino=0x100000005ab state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94772780] 2023-10-03T19:21:18.823 INFO:teuthology.orchestra.run.smithi045.stdout: -8186> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5904 now clean [inode 0x100000005ac [2,head] /dc-dir/dc-file_951 auth v5904 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.712601+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94775080] 2023-10-03T19:21:18.823 INFO:teuthology.orchestra.run.smithi045.stdout: -8185> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ac) mark_clean [inode 0x100000005ac [2,head] /dc-dir/dc-file_951 auth v5904 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.712601+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94775080] 2023-10-03T19:21:18.823 INFO:teuthology.orchestra.run.smithi045.stdout: -8184> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5904 now clean [dentry #0x1/dc-dir/dc-file_951 [2,head] auth (dversion lock) v=5904 ino=0x100000005ac state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94772a00] 2023-10-03T19:21:18.823 INFO:teuthology.orchestra.run.smithi045.stdout: -8183> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_951) mark_clean [dentry #0x1/dc-dir/dc-file_951 [2,head] auth (dversion lock) v=5904 ino=0x100000005ac state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94772a00] 2023-10-03T19:21:18.824 INFO:teuthology.orchestra.run.smithi045.stdout: -8182> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5906 now clean [inode 0x100000005ad [2,head] /dc-dir/dc-file_952 auth v5906 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.724052+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94775600] 2023-10-03T19:21:18.824 INFO:teuthology.orchestra.run.smithi045.stdout: -8181> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ad) mark_clean [inode 0x100000005ad [2,head] /dc-dir/dc-file_952 auth v5906 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.724052+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94775600] 2023-10-03T19:21:18.824 INFO:teuthology.orchestra.run.smithi045.stdout: -8180> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5906 now clean [dentry #0x1/dc-dir/dc-file_952 [2,head] auth (dversion lock) v=5906 ino=0x100000005ad state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94772c80] 2023-10-03T19:21:18.824 INFO:teuthology.orchestra.run.smithi045.stdout: -8179> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_952) mark_clean [dentry #0x1/dc-dir/dc-file_952 [2,head] auth (dversion lock) v=5906 ino=0x100000005ad state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94772c80] 2023-10-03T19:21:18.824 INFO:teuthology.orchestra.run.smithi045.stdout: -8178> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5908 now clean [inode 0x100000005ae [2,head] /dc-dir/dc-file_953 auth v5908 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.735359+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94775b80] 2023-10-03T19:21:18.825 INFO:teuthology.orchestra.run.smithi045.stdout: -8177> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ae) mark_clean [inode 0x100000005ae [2,head] /dc-dir/dc-file_953 auth v5908 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.735359+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94775b80] 2023-10-03T19:21:18.825 INFO:teuthology.orchestra.run.smithi045.stdout: -8176> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 63 ==== osd_op_reply(1466 10000000383.00000000 [create,setxattr (99),setxattr (30)] v74'25 uv25 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:18.825 INFO:teuthology.orchestra.run.smithi045.stdout: -8175> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5908 now clean [dentry #0x1/dc-dir/dc-file_953 [2,head] auth (dversion lock) v=5908 ino=0x100000005ae state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94772f00] 2023-10-03T19:21:18.825 INFO:teuthology.orchestra.run.smithi045.stdout: -8174> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_953) mark_clean [dentry #0x1/dc-dir/dc-file_953 [2,head] auth (dversion lock) v=5908 ino=0x100000005ae state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94772f00] 2023-10-03T19:21:18.825 INFO:teuthology.orchestra.run.smithi045.stdout: -8173> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5910 now clean [inode 0x100000005af [2,head] /dc-dir/dc-file_954 auth v5910 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.746488+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94776100] 2023-10-03T19:21:18.825 INFO:teuthology.orchestra.run.smithi045.stdout: -8172> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005af) mark_clean [inode 0x100000005af [2,head] /dc-dir/dc-file_954 auth v5910 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.746488+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94776100] 2023-10-03T19:21:18.825 INFO:teuthology.orchestra.run.smithi045.stdout: -8171> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5910 now clean [dentry #0x1/dc-dir/dc-file_954 [2,head] auth (dversion lock) v=5910 ino=0x100000005af state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94773180] 2023-10-03T19:21:18.825 INFO:teuthology.orchestra.run.smithi045.stdout: -8170> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_954) mark_clean [dentry #0x1/dc-dir/dc-file_954 [2,head] auth (dversion lock) v=5910 ino=0x100000005af state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94773180] 2023-10-03T19:21:18.825 INFO:teuthology.orchestra.run.smithi045.stdout: -8169> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5912 now clean [inode 0x100000005b0 [2,head] /dc-dir/dc-file_955 auth v5912 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.758015+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94776680] 2023-10-03T19:21:18.826 INFO:teuthology.orchestra.run.smithi045.stdout: -8168> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b0) mark_clean [inode 0x100000005b0 [2,head] /dc-dir/dc-file_955 auth v5912 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.758015+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94776680] 2023-10-03T19:21:18.826 INFO:teuthology.orchestra.run.smithi045.stdout: -8167> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5912 now clean [dentry #0x1/dc-dir/dc-file_955 [2,head] auth (dversion lock) v=5912 ino=0x100000005b0 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94773400] 2023-10-03T19:21:18.826 INFO:teuthology.orchestra.run.smithi045.stdout: -8166> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_955) mark_clean [dentry #0x1/dc-dir/dc-file_955 [2,head] auth (dversion lock) v=5912 ino=0x100000005b0 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94773400] 2023-10-03T19:21:18.826 INFO:teuthology.orchestra.run.smithi045.stdout: -8165> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5914 now clean [inode 0x100000005b1 [2,head] /dc-dir/dc-file_956 auth v5914 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.769545+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94776c00] 2023-10-03T19:21:18.826 INFO:teuthology.orchestra.run.smithi045.stdout: -8164> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b1) mark_clean [inode 0x100000005b1 [2,head] /dc-dir/dc-file_956 auth v5914 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.769545+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94776c00] 2023-10-03T19:21:18.826 INFO:teuthology.orchestra.run.smithi045.stdout: -8163> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5914 now clean [dentry #0x1/dc-dir/dc-file_956 [2,head] auth (dversion lock) v=5914 ino=0x100000005b1 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94773680] 2023-10-03T19:21:18.826 INFO:teuthology.orchestra.run.smithi045.stdout: -8162> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_956) mark_clean [dentry #0x1/dc-dir/dc-file_956 [2,head] auth (dversion lock) v=5914 ino=0x100000005b1 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94773680] 2023-10-03T19:21:18.827 INFO:teuthology.orchestra.run.smithi045.stdout: -8161> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5916 now clean [inode 0x100000005b2 [2,head] /dc-dir/dc-file_957 auth v5916 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.782633+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94777180] 2023-10-03T19:21:18.827 INFO:teuthology.orchestra.run.smithi045.stdout: -8160> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b2) mark_clean [inode 0x100000005b2 [2,head] /dc-dir/dc-file_957 auth v5916 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.782633+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94777180] 2023-10-03T19:21:18.827 INFO:teuthology.orchestra.run.smithi045.stdout: -8159> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5916 now clean [dentry #0x1/dc-dir/dc-file_957 [2,head] auth (dversion lock) v=5916 ino=0x100000005b2 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94773900] 2023-10-03T19:21:18.827 INFO:teuthology.orchestra.run.smithi045.stdout: -8158> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_957) mark_clean [dentry #0x1/dc-dir/dc-file_957 [2,head] auth (dversion lock) v=5916 ino=0x100000005b2 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94773900] 2023-10-03T19:21:18.827 INFO:teuthology.orchestra.run.smithi045.stdout: -8157> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5918 now clean [inode 0x100000005b3 [2,head] /dc-dir/dc-file_958 auth v5918 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.793609+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94777700] 2023-10-03T19:21:18.827 INFO:teuthology.orchestra.run.smithi045.stdout: -8156> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b3) mark_clean [inode 0x100000005b3 [2,head] /dc-dir/dc-file_958 auth v5918 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.793609+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94777700] 2023-10-03T19:21:18.900 INFO:teuthology.orchestra.run.smithi045.stdout: -8155> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5918 now clean [dentry #0x1/dc-dir/dc-file_958 [2,head] auth (dversion lock) v=5918 ino=0x100000005b3 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94773b80] 2023-10-03T19:21:18.900 INFO:teuthology.orchestra.run.smithi045.stdout: -8154> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_958) mark_clean [dentry #0x1/dc-dir/dc-file_958 [2,head] auth (dversion lock) v=5918 ino=0x100000005b3 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94773b80] 2023-10-03T19:21:18.900 INFO:teuthology.orchestra.run.smithi045.stdout: -8153> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5920 now clean [inode 0x100000005b4 [2,head] /dc-dir/dc-file_959 auth v5920 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.804932+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9477c000] 2023-10-03T19:21:18.901 INFO:teuthology.orchestra.run.smithi045.stdout: -8152> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b4) mark_clean [inode 0x100000005b4 [2,head] /dc-dir/dc-file_959 auth v5920 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.804932+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9477c000] 2023-10-03T19:21:18.901 INFO:teuthology.orchestra.run.smithi045.stdout: -8151> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5920 now clean [dentry #0x1/dc-dir/dc-file_959 [2,head] auth (dversion lock) v=5920 ino=0x100000005b4 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9477a000] 2023-10-03T19:21:18.901 INFO:teuthology.orchestra.run.smithi045.stdout: -8150> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_959) mark_clean [dentry #0x1/dc-dir/dc-file_959 [2,head] auth (dversion lock) v=5920 ino=0x100000005b4 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9477a000] 2023-10-03T19:21:18.901 INFO:teuthology.orchestra.run.smithi045.stdout: -8149> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 64 ==== osd_op_reply(1481 10000000392.00000000 [create,setxattr (99),setxattr (30)] v74'20 uv20 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:18.901 INFO:teuthology.orchestra.run.smithi045.stdout: -8148> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5922 now clean [inode 0x100000005b5 [2,head] /dc-dir/dc-file_960 auth v5922 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.818051+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9477c580] 2023-10-03T19:21:18.901 INFO:teuthology.orchestra.run.smithi045.stdout: -8147> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 65 ==== osd_op_reply(1488 10000000399.00000000 [create,setxattr (99),setxattr (30)] v74'26 uv26 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:18.901 INFO:teuthology.orchestra.run.smithi045.stdout: -8146> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 66 ==== osd_op_reply(1511 100000003b0.00000000 [create,setxattr (99),setxattr (30)] v74'27 uv27 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:18.901 INFO:teuthology.orchestra.run.smithi045.stdout: -8145> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b5) mark_clean [inode 0x100000005b5 [2,head] /dc-dir/dc-file_960 auth v5922 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.818051+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9477c580] 2023-10-03T19:21:18.901 INFO:teuthology.orchestra.run.smithi045.stdout: -8144> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5922 now clean [dentry #0x1/dc-dir/dc-file_960 [2,head] auth (dversion lock) v=5922 ino=0x100000005b5 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9477a280] 2023-10-03T19:21:18.902 INFO:teuthology.orchestra.run.smithi045.stdout: -8143> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_960) mark_clean [dentry #0x1/dc-dir/dc-file_960 [2,head] auth (dversion lock) v=5922 ino=0x100000005b5 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9477a280] 2023-10-03T19:21:18.902 INFO:teuthology.orchestra.run.smithi045.stdout: -8142> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 67 ==== osd_op_reply(1522 100000003bb.00000000 [create,setxattr (99),setxattr (30)] v74'28 uv28 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:18.902 INFO:teuthology.orchestra.run.smithi045.stdout: -8141> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5924 now clean [inode 0x100000005b6 [2,head] /dc-dir/dc-file_961 auth v5924 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.830287+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9477cb00] 2023-10-03T19:21:18.902 INFO:teuthology.orchestra.run.smithi045.stdout: -8140> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b6) mark_clean [inode 0x100000005b6 [2,head] /dc-dir/dc-file_961 auth v5924 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.830287+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9477cb00] 2023-10-03T19:21:18.902 INFO:teuthology.orchestra.run.smithi045.stdout: -8139> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5924 now clean [dentry #0x1/dc-dir/dc-file_961 [2,head] auth (dversion lock) v=5924 ino=0x100000005b6 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9477a500] 2023-10-03T19:21:18.902 INFO:teuthology.orchestra.run.smithi045.stdout: -8138> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_961) mark_clean [dentry #0x1/dc-dir/dc-file_961 [2,head] auth (dversion lock) v=5924 ino=0x100000005b6 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9477a500] 2023-10-03T19:21:18.902 INFO:teuthology.orchestra.run.smithi045.stdout: -8137> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5926 now clean [inode 0x100000005b7 [2,head] /dc-dir/dc-file_962 auth v5926 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.841780+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9477d080] 2023-10-03T19:21:18.902 INFO:teuthology.orchestra.run.smithi045.stdout: -8136> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b7) mark_clean [inode 0x100000005b7 [2,head] /dc-dir/dc-file_962 auth v5926 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.841780+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9477d080] 2023-10-03T19:21:18.902 INFO:teuthology.orchestra.run.smithi045.stdout: -8135> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5926 now clean [dentry #0x1/dc-dir/dc-file_962 [2,head] auth (dversion lock) v=5926 ino=0x100000005b7 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9477a780] 2023-10-03T19:21:18.902 INFO:teuthology.orchestra.run.smithi045.stdout: -8134> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_962) mark_clean [dentry #0x1/dc-dir/dc-file_962 [2,head] auth (dversion lock) v=5926 ino=0x100000005b7 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9477a780] 2023-10-03T19:21:18.902 INFO:teuthology.orchestra.run.smithi045.stdout: -8133> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5928 now clean [inode 0x100000005b8 [2,head] /dc-dir/dc-file_963 auth v5928 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.853705+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9477d600] 2023-10-03T19:21:18.903 INFO:teuthology.orchestra.run.smithi045.stdout: -8132> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b8) mark_clean [inode 0x100000005b8 [2,head] /dc-dir/dc-file_963 auth v5928 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.853705+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9477d600] 2023-10-03T19:21:18.903 INFO:teuthology.orchestra.run.smithi045.stdout: -8131> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5928 now clean [dentry #0x1/dc-dir/dc-file_963 [2,head] auth (dversion lock) v=5928 ino=0x100000005b8 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9477aa00] 2023-10-03T19:21:18.903 INFO:teuthology.orchestra.run.smithi045.stdout: -8130> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_963) mark_clean [dentry #0x1/dc-dir/dc-file_963 [2,head] auth (dversion lock) v=5928 ino=0x100000005b8 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9477aa00] 2023-10-03T19:21:18.903 INFO:teuthology.orchestra.run.smithi045.stdout: -8129> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5930 now clean [inode 0x100000005b9 [2,head] /dc-dir/dc-file_964 auth v5930 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.867216+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9477db80] 2023-10-03T19:21:18.903 INFO:teuthology.orchestra.run.smithi045.stdout: -8128> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 68 ==== osd_op_reply(1534 100000003c7.00000000 [create,setxattr (99),setxattr (30)] v74'29 uv29 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:18.903 INFO:teuthology.orchestra.run.smithi045.stdout: -8127> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b9) mark_clean [inode 0x100000005b9 [2,head] /dc-dir/dc-file_964 auth v5930 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.867216+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9477db80] 2023-10-03T19:21:18.903 INFO:teuthology.orchestra.run.smithi045.stdout: -8126> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5930 now clean [dentry #0x1/dc-dir/dc-file_964 [2,head] auth (dversion lock) v=5930 ino=0x100000005b9 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9477ac80] 2023-10-03T19:21:18.903 INFO:teuthology.orchestra.run.smithi045.stdout: -8125> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_964) mark_clean [dentry #0x1/dc-dir/dc-file_964 [2,head] auth (dversion lock) v=5930 ino=0x100000005b9 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9477ac80] 2023-10-03T19:21:18.903 INFO:teuthology.orchestra.run.smithi045.stdout: -8124> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5932 now clean [inode 0x100000005ba [2,head] /dc-dir/dc-file_965 auth v5932 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.878724+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9477e100] 2023-10-03T19:21:18.903 INFO:teuthology.orchestra.run.smithi045.stdout: -8123> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ba) mark_clean [inode 0x100000005ba [2,head] /dc-dir/dc-file_965 auth v5932 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.878724+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9477e100] 2023-10-03T19:21:18.903 INFO:teuthology.orchestra.run.smithi045.stdout: -8122> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5932 now clean [dentry #0x1/dc-dir/dc-file_965 [2,head] auth (dversion lock) v=5932 ino=0x100000005ba state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9477af00] 2023-10-03T19:21:18.904 INFO:teuthology.orchestra.run.smithi045.stdout: -8121> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 69 ==== osd_op_reply(1594 10000000403.00000000 [create,setxattr (99),setxattr (30)] v74'21 uv21 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:18.904 INFO:teuthology.orchestra.run.smithi045.stdout: -8120> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_965) mark_clean [dentry #0x1/dc-dir/dc-file_965 [2,head] auth (dversion lock) v=5932 ino=0x100000005ba state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9477af00] 2023-10-03T19:21:18.904 INFO:teuthology.orchestra.run.smithi045.stdout: -8119> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5934 now clean [inode 0x100000005bb [2,head] /dc-dir/dc-file_966 auth v5934 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.890092+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9477e680] 2023-10-03T19:21:18.904 INFO:teuthology.orchestra.run.smithi045.stdout: -8118> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005bb) mark_clean [inode 0x100000005bb [2,head] /dc-dir/dc-file_966 auth v5934 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.890092+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9477e680] 2023-10-03T19:21:18.904 INFO:teuthology.orchestra.run.smithi045.stdout: -8117> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5934 now clean [dentry #0x1/dc-dir/dc-file_966 [2,head] auth (dversion lock) v=5934 ino=0x100000005bb state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9477b180] 2023-10-03T19:21:18.904 INFO:teuthology.orchestra.run.smithi045.stdout: -8116> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_966) mark_clean [dentry #0x1/dc-dir/dc-file_966 [2,head] auth (dversion lock) v=5934 ino=0x100000005bb state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9477b180] 2023-10-03T19:21:18.904 INFO:teuthology.orchestra.run.smithi045.stdout: -8115> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5936 now clean [inode 0x100000005bc [2,head] /dc-dir/dc-file_967 auth v5936 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.901617+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9477ec00] 2023-10-03T19:21:18.904 INFO:teuthology.orchestra.run.smithi045.stdout: -8114> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005bc) mark_clean [inode 0x100000005bc [2,head] /dc-dir/dc-file_967 auth v5936 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.901617+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9477ec00] 2023-10-03T19:21:18.904 INFO:teuthology.orchestra.run.smithi045.stdout: -8113> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5936 now clean [dentry #0x1/dc-dir/dc-file_967 [2,head] auth (dversion lock) v=5936 ino=0x100000005bc state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9477b400] 2023-10-03T19:21:18.904 INFO:teuthology.orchestra.run.smithi045.stdout: -8112> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_967) mark_clean [dentry #0x1/dc-dir/dc-file_967 [2,head] auth (dversion lock) v=5936 ino=0x100000005bc state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9477b400] 2023-10-03T19:21:18.904 INFO:teuthology.orchestra.run.smithi045.stdout: -8111> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5938 now clean [inode 0x100000005bd [2,head] /dc-dir/dc-file_968 auth v5938 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.912931+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9477f180] 2023-10-03T19:21:18.905 INFO:teuthology.orchestra.run.smithi045.stdout: -8110> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005bd) mark_clean [inode 0x100000005bd [2,head] /dc-dir/dc-file_968 auth v5938 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.912931+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9477f180] 2023-10-03T19:21:18.905 INFO:teuthology.orchestra.run.smithi045.stdout: -8109> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5938 now clean [dentry #0x1/dc-dir/dc-file_968 [2,head] auth (dversion lock) v=5938 ino=0x100000005bd state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9477b680] 2023-10-03T19:21:18.905 INFO:teuthology.orchestra.run.smithi045.stdout: -8108> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 70 ==== osd_op_reply(1547 100000003d4.00000000 [create,setxattr (99),setxattr (30)] v74'30 uv30 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:18.905 INFO:teuthology.orchestra.run.smithi045.stdout: -8107> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_968) mark_clean [dentry #0x1/dc-dir/dc-file_968 [2,head] auth (dversion lock) v=5938 ino=0x100000005bd state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9477b680] 2023-10-03T19:21:18.905 INFO:teuthology.orchestra.run.smithi045.stdout: -8106> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5940 now clean [inode 0x100000005be [2,head] /dc-dir/dc-file_969 auth v5940 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.926504+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9477f700] 2023-10-03T19:21:18.905 INFO:teuthology.orchestra.run.smithi045.stdout: -8105> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 71 ==== osd_op_reply(1606 1000000040f.00000000 [create,setxattr (99),setxattr (30)] v74'22 uv22 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:18.905 INFO:teuthology.orchestra.run.smithi045.stdout: -8104> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005be) mark_clean [inode 0x100000005be [2,head] /dc-dir/dc-file_969 auth v5940 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.926504+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9477f700] 2023-10-03T19:21:18.905 INFO:teuthology.orchestra.run.smithi045.stdout: -8103> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5940 now clean [dentry #0x1/dc-dir/dc-file_969 [2,head] auth (dversion lock) v=5940 ino=0x100000005be state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9477b900] 2023-10-03T19:21:18.905 INFO:teuthology.orchestra.run.smithi045.stdout: -8102> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_969) mark_clean [dentry #0x1/dc-dir/dc-file_969 [2,head] auth (dversion lock) v=5940 ino=0x100000005be state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9477b900] 2023-10-03T19:21:18.905 INFO:teuthology.orchestra.run.smithi045.stdout: -8101> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5942 now clean [inode 0x100000005bf [2,head] /dc-dir/dc-file_970 auth v5942 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.939798+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94782000] 2023-10-03T19:21:18.905 INFO:teuthology.orchestra.run.smithi045.stdout: -8100> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005bf) mark_clean [inode 0x100000005bf [2,head] /dc-dir/dc-file_970 auth v5942 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.939798+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94782000] 2023-10-03T19:21:18.906 INFO:teuthology.orchestra.run.smithi045.stdout: -8099> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5942 now clean [dentry #0x1/dc-dir/dc-file_970 [2,head] auth (dversion lock) v=5942 ino=0x100000005bf state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9477bb80] 2023-10-03T19:21:18.906 INFO:teuthology.orchestra.run.smithi045.stdout: -8098> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_970) mark_clean [dentry #0x1/dc-dir/dc-file_970 [2,head] auth (dversion lock) v=5942 ino=0x100000005bf state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc9477bb80] 2023-10-03T19:21:18.906 INFO:teuthology.orchestra.run.smithi045.stdout: -8097> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 72 ==== osd_op_reply(1636 1000000042d.00000000 [create,setxattr (99),setxattr (30)] v74'23 uv23 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:18.906 INFO:teuthology.orchestra.run.smithi045.stdout: -8096> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5944 now clean [inode 0x100000005c0 [2,head] /dc-dir/dc-file_971 auth v5944 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.953098+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94782580] 2023-10-03T19:21:18.906 INFO:teuthology.orchestra.run.smithi045.stdout: -8095> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c0) mark_clean [inode 0x100000005c0 [2,head] /dc-dir/dc-file_971 auth v5944 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.953098+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94782580] 2023-10-03T19:21:18.906 INFO:teuthology.orchestra.run.smithi045.stdout: -8094> 2023-10-03T19:18:09.837+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 73 ==== osd_op_reply(1665 1000000044a.00000000 [create,setxattr (99),setxattr (30)] v74'26 uv26 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:18.906 INFO:teuthology.orchestra.run.smithi045.stdout: -8093> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5944 now clean [dentry #0x1/dc-dir/dc-file_971 [2,head] auth (dversion lock) v=5944 ino=0x100000005c0 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94788000] 2023-10-03T19:21:18.906 INFO:teuthology.orchestra.run.smithi045.stdout: -8092> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_971) mark_clean [dentry #0x1/dc-dir/dc-file_971 [2,head] auth (dversion lock) v=5944 ino=0x100000005c0 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94788000] 2023-10-03T19:21:18.906 INFO:teuthology.orchestra.run.smithi045.stdout: -8091> 2023-10-03T19:18:09.837+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5946 now clean [inode 0x100000005c1 [2,head] /dc-dir/dc-file_972 auth v5946 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.965102+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94782b00] 2023-10-03T19:21:18.906 INFO:teuthology.orchestra.run.smithi045.stdout: -8090> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c1) mark_clean [inode 0x100000005c1 [2,head] /dc-dir/dc-file_972 auth v5946 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.965102+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94782b00] 2023-10-03T19:21:18.906 INFO:teuthology.orchestra.run.smithi045.stdout: -8089> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5946 now clean [dentry #0x1/dc-dir/dc-file_972 [2,head] auth (dversion lock) v=5946 ino=0x100000005c1 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94788280] 2023-10-03T19:21:18.951 INFO:teuthology.orchestra.run.smithi045.stdout: -8088> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_972) mark_clean [dentry #0x1/dc-dir/dc-file_972 [2,head] auth (dversion lock) v=5946 ino=0x100000005c1 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94788280] 2023-10-03T19:21:18.951 INFO:teuthology.orchestra.run.smithi045.stdout: -8087> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5948 now clean [inode 0x100000005c2 [2,head] /dc-dir/dc-file_973 auth v5948 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.977951+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94783080] 2023-10-03T19:21:18.951 INFO:teuthology.orchestra.run.smithi045.stdout: -8086> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c2) mark_clean [inode 0x100000005c2 [2,head] /dc-dir/dc-file_973 auth v5948 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.977951+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94783080] 2023-10-03T19:21:18.951 INFO:teuthology.orchestra.run.smithi045.stdout: -8085> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5948 now clean [dentry #0x1/dc-dir/dc-file_973 [2,head] auth (dversion lock) v=5948 ino=0x100000005c2 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94788500] 2023-10-03T19:21:18.951 INFO:teuthology.orchestra.run.smithi045.stdout: -8084> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_973) mark_clean [dentry #0x1/dc-dir/dc-file_973 [2,head] auth (dversion lock) v=5948 ino=0x100000005c2 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94788500] 2023-10-03T19:21:18.951 INFO:teuthology.orchestra.run.smithi045.stdout: -8083> 2023-10-03T19:18:09.841+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 74 ==== osd_op_reply(1671 10000000450.00000000 [create,setxattr (99),setxattr (30)] v74'24 uv24 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:18.952 INFO:teuthology.orchestra.run.smithi045.stdout: -8082> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5950 now clean [inode 0x100000005c3 [2,head] /dc-dir/dc-file_974 auth v5950 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.989973+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94783600] 2023-10-03T19:21:18.952 INFO:teuthology.orchestra.run.smithi045.stdout: -8081> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c3) mark_clean [inode 0x100000005c3 [2,head] /dc-dir/dc-file_974 auth v5950 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.989973+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94783600] 2023-10-03T19:21:18.952 INFO:teuthology.orchestra.run.smithi045.stdout: -8080> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5950 now clean [dentry #0x1/dc-dir/dc-file_974 [2,head] auth (dversion lock) v=5950 ino=0x100000005c3 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94788780] 2023-10-03T19:21:18.952 INFO:teuthology.orchestra.run.smithi045.stdout: -8079> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_974) mark_clean [dentry #0x1/dc-dir/dc-file_974 [2,head] auth (dversion lock) v=5950 ino=0x100000005c3 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94788780] 2023-10-03T19:21:18.952 INFO:teuthology.orchestra.run.smithi045.stdout: -8078> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5952 now clean [inode 0x100000005c4 [2,head] /dc-dir/dc-file_975 auth v5952 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.002424+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94783b80] 2023-10-03T19:21:18.952 INFO:teuthology.orchestra.run.smithi045.stdout: -8077> 2023-10-03T19:18:09.841+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 75 ==== osd_op_reply(1668 1000000044d.00000000 [create,setxattr (99),setxattr (30)] v74'27 uv27 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:18.952 INFO:teuthology.orchestra.run.smithi045.stdout: -8076> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c4) mark_clean [inode 0x100000005c4 [2,head] /dc-dir/dc-file_975 auth v5952 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.002424+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94783b80] 2023-10-03T19:21:18.952 INFO:teuthology.orchestra.run.smithi045.stdout: -8075> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5952 now clean [dentry #0x1/dc-dir/dc-file_975 [2,head] auth (dversion lock) v=5952 ino=0x100000005c4 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94788a00] 2023-10-03T19:21:18.952 INFO:teuthology.orchestra.run.smithi045.stdout: -8074> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_975) mark_clean [dentry #0x1/dc-dir/dc-file_975 [2,head] auth (dversion lock) v=5952 ino=0x100000005c4 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94788a00] 2023-10-03T19:21:18.952 INFO:teuthology.orchestra.run.smithi045.stdout: -8073> 2023-10-03T19:18:09.841+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 76 ==== osd_op_reply(1674 10000000453.00000000 [create,setxattr (99),setxattr (30)] v74'25 uv25 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:18.953 INFO:teuthology.orchestra.run.smithi045.stdout: -8072> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5954 now clean [inode 0x100000005c5 [2,head] /dc-dir/dc-file_976 auth v5954 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.014785+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94784100] 2023-10-03T19:21:18.953 INFO:teuthology.orchestra.run.smithi045.stdout: -8071> 2023-10-03T19:18:09.841+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 77 ==== osd_op_reply(1681 1000000045a.00000000 [create,setxattr (99),setxattr (30)] v74'26 uv26 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:18.953 INFO:teuthology.orchestra.run.smithi045.stdout: -8070> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c5) mark_clean [inode 0x100000005c5 [2,head] /dc-dir/dc-file_976 auth v5954 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.014785+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94784100] 2023-10-03T19:21:18.953 INFO:teuthology.orchestra.run.smithi045.stdout: -8069> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5954 now clean [dentry #0x1/dc-dir/dc-file_976 [2,head] auth (dversion lock) v=5954 ino=0x100000005c5 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94788c80] 2023-10-03T19:21:18.953 INFO:teuthology.orchestra.run.smithi045.stdout: -8068> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_976) mark_clean [dentry #0x1/dc-dir/dc-file_976 [2,head] auth (dversion lock) v=5954 ino=0x100000005c5 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94788c80] 2023-10-03T19:21:18.953 INFO:teuthology.orchestra.run.smithi045.stdout: -8067> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5956 now clean [inode 0x100000005c6 [2,head] /dc-dir/dc-file_977 auth v5956 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.028977+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94784680] 2023-10-03T19:21:18.953 INFO:teuthology.orchestra.run.smithi045.stdout: -8066> 2023-10-03T19:18:09.841+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 78 ==== osd_op_reply(1680 10000000459.00000000 [create,setxattr (99),setxattr (30)] v74'31 uv31 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:18.953 INFO:teuthology.orchestra.run.smithi045.stdout: -8065> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c6) mark_clean [inode 0x100000005c6 [2,head] /dc-dir/dc-file_977 auth v5956 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.028977+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94784680] 2023-10-03T19:21:18.953 INFO:teuthology.orchestra.run.smithi045.stdout: -8064> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5956 now clean [dentry #0x1/dc-dir/dc-file_977 [2,head] auth (dversion lock) v=5956 ino=0x100000005c6 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94788f00] 2023-10-03T19:21:18.953 INFO:teuthology.orchestra.run.smithi045.stdout: -8063> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_977) mark_clean [dentry #0x1/dc-dir/dc-file_977 [2,head] auth (dversion lock) v=5956 ino=0x100000005c6 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94788f00] 2023-10-03T19:21:18.953 INFO:teuthology.orchestra.run.smithi045.stdout: -8062> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5958 now clean [inode 0x100000005c7 [2,head] /dc-dir/dc-file_978 auth v5958 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.042650+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94784c00] 2023-10-03T19:21:18.954 INFO:teuthology.orchestra.run.smithi045.stdout: -8061> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c7) mark_clean [inode 0x100000005c7 [2,head] /dc-dir/dc-file_978 auth v5958 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.042650+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94784c00] 2023-10-03T19:21:18.954 INFO:teuthology.orchestra.run.smithi045.stdout: -8060> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5958 now clean [dentry #0x1/dc-dir/dc-file_978 [2,head] auth (dversion lock) v=5958 ino=0x100000005c7 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94789180] 2023-10-03T19:21:18.954 INFO:teuthology.orchestra.run.smithi045.stdout: -8059> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_978) mark_clean [dentry #0x1/dc-dir/dc-file_978 [2,head] auth (dversion lock) v=5958 ino=0x100000005c7 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94789180] 2023-10-03T19:21:18.954 INFO:teuthology.orchestra.run.smithi045.stdout: -8058> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5960 now clean [inode 0x100000005c8 [2,head] /dc-dir/dc-file_979 auth v5960 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.054557+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94785180] 2023-10-03T19:21:18.954 INFO:teuthology.orchestra.run.smithi045.stdout: -8057> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c8) mark_clean [inode 0x100000005c8 [2,head] /dc-dir/dc-file_979 auth v5960 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.054557+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94785180] 2023-10-03T19:21:18.954 INFO:teuthology.orchestra.run.smithi045.stdout: -8056> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5960 now clean [dentry #0x1/dc-dir/dc-file_979 [2,head] auth (dversion lock) v=5960 ino=0x100000005c8 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94789400] 2023-10-03T19:21:18.954 INFO:teuthology.orchestra.run.smithi045.stdout: -8055> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_979) mark_clean [dentry #0x1/dc-dir/dc-file_979 [2,head] auth (dversion lock) v=5960 ino=0x100000005c8 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94789400] 2023-10-03T19:21:18.954 INFO:teuthology.orchestra.run.smithi045.stdout: -8054> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5962 now clean [inode 0x100000005c9 [2,head] /dc-dir/dc-file_980 auth v5962 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.067690+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94785700] 2023-10-03T19:21:18.955 INFO:teuthology.orchestra.run.smithi045.stdout: -8053> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c9) mark_clean [inode 0x100000005c9 [2,head] /dc-dir/dc-file_980 auth v5962 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.067690+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc94785700] 2023-10-03T19:21:18.955 INFO:teuthology.orchestra.run.smithi045.stdout: -8052> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5962 now clean [dentry #0x1/dc-dir/dc-file_980 [2,head] auth (dversion lock) v=5962 ino=0x100000005c9 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94789680] 2023-10-03T19:21:18.955 INFO:teuthology.orchestra.run.smithi045.stdout: -8051> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_980) mark_clean [dentry #0x1/dc-dir/dc-file_980 [2,head] auth (dversion lock) v=5962 ino=0x100000005c9 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94789680] 2023-10-03T19:21:18.955 INFO:teuthology.orchestra.run.smithi045.stdout: -8050> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5964 now clean [inode 0x100000005ca [2,head] /dc-dir/dc-file_981 auth v5964 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.079990+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9478a000] 2023-10-03T19:21:18.955 INFO:teuthology.orchestra.run.smithi045.stdout: -8049> 2023-10-03T19:18:09.841+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 79 ==== osd_op_reply(1758 100000004a7.00000000 [create,setxattr (99),setxattr (30)] v74'28 uv28 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:18.955 INFO:teuthology.orchestra.run.smithi045.stdout: -8048> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ca) mark_clean [inode 0x100000005ca [2,head] /dc-dir/dc-file_981 auth v5964 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.079990+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9478a000] 2023-10-03T19:21:18.955 INFO:teuthology.orchestra.run.smithi045.stdout: -8047> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5964 now clean [dentry #0x1/dc-dir/dc-file_981 [2,head] auth (dversion lock) v=5964 ino=0x100000005ca state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94789900] 2023-10-03T19:21:18.955 INFO:teuthology.orchestra.run.smithi045.stdout: -8046> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_981) mark_clean [dentry #0x1/dc-dir/dc-file_981 [2,head] auth (dversion lock) v=5964 ino=0x100000005ca state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94789900] 2023-10-03T19:21:18.955 INFO:teuthology.orchestra.run.smithi045.stdout: -8045> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5966 now clean [inode 0x100000005cb [2,head] /dc-dir/dc-file_982 auth v5966 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.092395+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9478a580] 2023-10-03T19:21:18.955 INFO:teuthology.orchestra.run.smithi045.stdout: -8044> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005cb) mark_clean [inode 0x100000005cb [2,head] /dc-dir/dc-file_982 auth v5966 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.092395+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9478a580] 2023-10-03T19:21:18.955 INFO:teuthology.orchestra.run.smithi045.stdout: -8043> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5966 now clean [dentry #0x1/dc-dir/dc-file_982 [2,head] auth (dversion lock) v=5966 ino=0x100000005cb state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94789b80] 2023-10-03T19:21:18.956 INFO:teuthology.orchestra.run.smithi045.stdout: -8042> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_982) mark_clean [dentry #0x1/dc-dir/dc-file_982 [2,head] auth (dversion lock) v=5966 ino=0x100000005cb state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94789b80] 2023-10-03T19:21:18.956 INFO:teuthology.orchestra.run.smithi045.stdout: -8041> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5968 now clean [inode 0x100000005cc [2,head] /dc-dir/dc-file_983 auth v5968 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.105240+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9478ab00] 2023-10-03T19:21:18.956 INFO:teuthology.orchestra.run.smithi045.stdout: -8040> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005cc) mark_clean [inode 0x100000005cc [2,head] /dc-dir/dc-file_983 auth v5968 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.105240+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9478ab00] 2023-10-03T19:21:18.956 INFO:teuthology.orchestra.run.smithi045.stdout: -8039> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5968 now clean [dentry #0x1/dc-dir/dc-file_983 [2,head] auth (dversion lock) v=5968 ino=0x100000005cc state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94790000] 2023-10-03T19:21:18.956 INFO:teuthology.orchestra.run.smithi045.stdout: -8038> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_983) mark_clean [dentry #0x1/dc-dir/dc-file_983 [2,head] auth (dversion lock) v=5968 ino=0x100000005cc state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94790000] 2023-10-03T19:21:18.956 INFO:teuthology.orchestra.run.smithi045.stdout: -8037> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5970 now clean [inode 0x100000005cd [2,head] /dc-dir/dc-file_984 auth v5970 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.195020+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9478b080] 2023-10-03T19:21:18.956 INFO:teuthology.orchestra.run.smithi045.stdout: -8036> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005cd) mark_clean [inode 0x100000005cd [2,head] /dc-dir/dc-file_984 auth v5970 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.195020+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9478b080] 2023-10-03T19:21:19.049 INFO:teuthology.orchestra.run.smithi045.stdout: -8035> 2023-10-03T19:18:09.841+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 80 ==== osd_op_reply(1770 100000004b3.00000000 [create,setxattr (99),setxattr (30)] v74'32 uv32 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:19.049 INFO:teuthology.orchestra.run.smithi045.stdout: -8034> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5970 now clean [dentry #0x1/dc-dir/dc-file_984 [2,head] auth (dversion lock) v=5970 ino=0x100000005cd state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94790280] 2023-10-03T19:21:19.049 INFO:teuthology.orchestra.run.smithi045.stdout: -8033> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_984) mark_clean [dentry #0x1/dc-dir/dc-file_984 [2,head] auth (dversion lock) v=5970 ino=0x100000005cd state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94790280] 2023-10-03T19:21:19.049 INFO:teuthology.orchestra.run.smithi045.stdout: -8032> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5972 now clean [inode 0x100000005ce [2,head] /dc-dir/dc-file_985 auth v5972 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.236571+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9478b600] 2023-10-03T19:21:19.049 INFO:teuthology.orchestra.run.smithi045.stdout: -8031> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ce) mark_clean [inode 0x100000005ce [2,head] /dc-dir/dc-file_985 auth v5972 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.236571+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9478b600] 2023-10-03T19:21:19.049 INFO:teuthology.orchestra.run.smithi045.stdout: -8030> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5972 now clean [dentry #0x1/dc-dir/dc-file_985 [2,head] auth (dversion lock) v=5972 ino=0x100000005ce state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94790500] 2023-10-03T19:21:19.049 INFO:teuthology.orchestra.run.smithi045.stdout: -8029> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_985) mark_clean [dentry #0x1/dc-dir/dc-file_985 [2,head] auth (dversion lock) v=5972 ino=0x100000005ce state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94790500] 2023-10-03T19:21:19.049 INFO:teuthology.orchestra.run.smithi045.stdout: -8028> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5974 now clean [inode 0x100000005cf [2,head] /dc-dir/dc-file_986 auth v5974 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.248205+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9478bb80] 2023-10-03T19:21:19.050 INFO:teuthology.orchestra.run.smithi045.stdout: -8027> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005cf) mark_clean [inode 0x100000005cf [2,head] /dc-dir/dc-file_986 auth v5974 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.248205+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9478bb80] 2023-10-03T19:21:19.050 INFO:teuthology.orchestra.run.smithi045.stdout: -8026> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5974 now clean [dentry #0x1/dc-dir/dc-file_986 [2,head] auth (dversion lock) v=5974 ino=0x100000005cf state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94790780] 2023-10-03T19:21:19.050 INFO:teuthology.orchestra.run.smithi045.stdout: -8025> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_986) mark_clean [dentry #0x1/dc-dir/dc-file_986 [2,head] auth (dversion lock) v=5974 ino=0x100000005cf state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94790780] 2023-10-03T19:21:19.050 INFO:teuthology.orchestra.run.smithi045.stdout: -8024> 2023-10-03T19:18:09.841+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 81 ==== osd_op_reply(1803 100000004d4.00000000 [create,setxattr (99),setxattr (30)] v74'33 uv33 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:19.050 INFO:teuthology.orchestra.run.smithi045.stdout: -8023> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5976 now clean [inode 0x100000005d0 [2,head] /dc-dir/dc-file_987 auth v5976 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.260102+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9478c100] 2023-10-03T19:21:19.050 INFO:teuthology.orchestra.run.smithi045.stdout: -8022> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d0) mark_clean [inode 0x100000005d0 [2,head] /dc-dir/dc-file_987 auth v5976 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.260102+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9478c100] 2023-10-03T19:21:19.050 INFO:teuthology.orchestra.run.smithi045.stdout: -8021> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5976 now clean [dentry #0x1/dc-dir/dc-file_987 [2,head] auth (dversion lock) v=5976 ino=0x100000005d0 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94790a00] 2023-10-03T19:21:19.050 INFO:teuthology.orchestra.run.smithi045.stdout: -8020> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_987) mark_clean [dentry #0x1/dc-dir/dc-file_987 [2,head] auth (dversion lock) v=5976 ino=0x100000005d0 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94790a00] 2023-10-03T19:21:19.050 INFO:teuthology.orchestra.run.smithi045.stdout: -8019> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5978 now clean [inode 0x100000005d1 [2,head] /dc-dir/dc-file_988 auth v5978 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.272627+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9478c680] 2023-10-03T19:21:19.051 INFO:teuthology.orchestra.run.smithi045.stdout: -8018> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d1) mark_clean [inode 0x100000005d1 [2,head] /dc-dir/dc-file_988 auth v5978 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.272627+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9478c680] 2023-10-03T19:21:19.051 INFO:teuthology.orchestra.run.smithi045.stdout: -8017> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5978 now clean [dentry #0x1/dc-dir/dc-file_988 [2,head] auth (dversion lock) v=5978 ino=0x100000005d1 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94790c80] 2023-10-03T19:21:19.051 INFO:teuthology.orchestra.run.smithi045.stdout: -8016> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_988) mark_clean [dentry #0x1/dc-dir/dc-file_988 [2,head] auth (dversion lock) v=5978 ino=0x100000005d1 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94790c80] 2023-10-03T19:21:19.051 INFO:teuthology.orchestra.run.smithi045.stdout: -8015> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5980 now clean [inode 0x100000005d2 [2,head] /dc-dir/dc-file_989 auth v5980 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.286023+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9478cc00] 2023-10-03T19:21:19.051 INFO:teuthology.orchestra.run.smithi045.stdout: -8014> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d2) mark_clean [inode 0x100000005d2 [2,head] /dc-dir/dc-file_989 auth v5980 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.286023+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9478cc00] 2023-10-03T19:21:19.051 INFO:teuthology.orchestra.run.smithi045.stdout: -8013> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5980 now clean [dentry #0x1/dc-dir/dc-file_989 [2,head] auth (dversion lock) v=5980 ino=0x100000005d2 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94790f00] 2023-10-03T19:21:19.051 INFO:teuthology.orchestra.run.smithi045.stdout: -8012> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_989) mark_clean [dentry #0x1/dc-dir/dc-file_989 [2,head] auth (dversion lock) v=5980 ino=0x100000005d2 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94790f00] 2023-10-03T19:21:19.051 INFO:teuthology.orchestra.run.smithi045.stdout: -8011> 2023-10-03T19:18:09.841+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 82 ==== osd_op_reply(1833 100000004f2.00000000 [create,setxattr (99),setxattr (30)] v74'34 uv34 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:19.051 INFO:teuthology.orchestra.run.smithi045.stdout: -8010> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5982 now clean [inode 0x100000005d3 [2,head] /dc-dir/dc-file_990 auth v5982 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.299168+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9478d180] 2023-10-03T19:21:19.051 INFO:teuthology.orchestra.run.smithi045.stdout: -8009> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d3) mark_clean [inode 0x100000005d3 [2,head] /dc-dir/dc-file_990 auth v5982 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.299168+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9478d180] 2023-10-03T19:21:19.052 INFO:teuthology.orchestra.run.smithi045.stdout: -8008> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5982 now clean [dentry #0x1/dc-dir/dc-file_990 [2,head] auth (dversion lock) v=5982 ino=0x100000005d3 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94791180] 2023-10-03T19:21:19.052 INFO:teuthology.orchestra.run.smithi045.stdout: -8007> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_990) mark_clean [dentry #0x1/dc-dir/dc-file_990 [2,head] auth (dversion lock) v=5982 ino=0x100000005d3 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94791180] 2023-10-03T19:21:19.052 INFO:teuthology.orchestra.run.smithi045.stdout: -8006> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5984 now clean [inode 0x100000005d4 [2,head] /dc-dir/dc-file_991 auth v5984 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.312049+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9478d700] 2023-10-03T19:21:19.052 INFO:teuthology.orchestra.run.smithi045.stdout: -8005> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d4) mark_clean [inode 0x100000005d4 [2,head] /dc-dir/dc-file_991 auth v5984 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.312049+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc9478d700] 2023-10-03T19:21:19.052 INFO:teuthology.orchestra.run.smithi045.stdout: -8004> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5984 now clean [dentry #0x1/dc-dir/dc-file_991 [2,head] auth (dversion lock) v=5984 ino=0x100000005d4 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94791400] 2023-10-03T19:21:19.052 INFO:teuthology.orchestra.run.smithi045.stdout: -8003> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_991) mark_clean [dentry #0x1/dc-dir/dc-file_991 [2,head] auth (dversion lock) v=5984 ino=0x100000005d4 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94791400] 2023-10-03T19:21:19.052 INFO:teuthology.orchestra.run.smithi045.stdout: -8002> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5986 now clean [inode 0x100000005d5 [2,head] /dc-dir/dc-file_992 auth v5986 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.323818+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc947a0000] 2023-10-03T19:21:19.052 INFO:teuthology.orchestra.run.smithi045.stdout: -8001> 2023-10-03T19:18:09.841+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 83 ==== osd_op_reply(1840 100000004f9.00000000 [create,setxattr (99),setxattr (30)] v74'29 uv29 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:19.052 INFO:teuthology.orchestra.run.smithi045.stdout: -8000> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d5) mark_clean [inode 0x100000005d5 [2,head] /dc-dir/dc-file_992 auth v5986 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.323818+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc947a0000] 2023-10-03T19:21:19.052 INFO:teuthology.orchestra.run.smithi045.stdout: -7999> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5986 now clean [dentry #0x1/dc-dir/dc-file_992 [2,head] auth (dversion lock) v=5986 ino=0x100000005d5 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94791680] 2023-10-03T19:21:19.053 INFO:teuthology.orchestra.run.smithi045.stdout: -7998> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_992) mark_clean [dentry #0x1/dc-dir/dc-file_992 [2,head] auth (dversion lock) v=5986 ino=0x100000005d5 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94791680] 2023-10-03T19:21:19.053 INFO:teuthology.orchestra.run.smithi045.stdout: -7997> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5988 now clean [inode 0x100000005d6 [2,head] /dc-dir/dc-file_993 auth v5988 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.335278+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc947a0580] 2023-10-03T19:21:19.053 INFO:teuthology.orchestra.run.smithi045.stdout: -7996> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d6) mark_clean [inode 0x100000005d6 [2,head] /dc-dir/dc-file_993 auth v5988 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.335278+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc947a0580] 2023-10-03T19:21:19.053 INFO:teuthology.orchestra.run.smithi045.stdout: -7995> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5988 now clean [dentry #0x1/dc-dir/dc-file_993 [2,head] auth (dversion lock) v=5988 ino=0x100000005d6 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94791900] 2023-10-03T19:21:19.053 INFO:teuthology.orchestra.run.smithi045.stdout: -7994> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_993) mark_clean [dentry #0x1/dc-dir/dc-file_993 [2,head] auth (dversion lock) v=5988 ino=0x100000005d6 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94791900] 2023-10-03T19:21:19.084 INFO:teuthology.orchestra.run.smithi045.stdout: -7993> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5990 now clean [inode 0x100000005d7 [2,head] /dc-dir/dc-file_994 auth v5990 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.347277+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc947a0b00] 2023-10-03T19:21:19.084 INFO:teuthology.orchestra.run.smithi045.stdout: -7992> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d7) mark_clean [inode 0x100000005d7 [2,head] /dc-dir/dc-file_994 auth v5990 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.347277+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc947a0b00] 2023-10-03T19:21:19.084 INFO:teuthology.orchestra.run.smithi045.stdout: -7991> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5990 now clean [dentry #0x1/dc-dir/dc-file_994 [2,head] auth (dversion lock) v=5990 ino=0x100000005d7 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94791b80] 2023-10-03T19:21:19.084 INFO:teuthology.orchestra.run.smithi045.stdout: -7990> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_994) mark_clean [dentry #0x1/dc-dir/dc-file_994 [2,head] auth (dversion lock) v=5990 ino=0x100000005d7 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc94791b80] 2023-10-03T19:21:19.084 INFO:teuthology.orchestra.run.smithi045.stdout: -7989> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5992 now clean [inode 0x100000005d8 [2,head] /dc-dir/dc-file_995 auth v5992 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.358556+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc947a1080] 2023-10-03T19:21:19.084 INFO:teuthology.orchestra.run.smithi045.stdout: -7988> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d8) mark_clean [inode 0x100000005d8 [2,head] /dc-dir/dc-file_995 auth v5992 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.358556+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc947a1080] 2023-10-03T19:21:19.084 INFO:teuthology.orchestra.run.smithi045.stdout: -7987> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5992 now clean [dentry #0x1/dc-dir/dc-file_995 [2,head] auth (dversion lock) v=5992 ino=0x100000005d8 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc947a4000] 2023-10-03T19:21:19.084 INFO:teuthology.orchestra.run.smithi045.stdout: -7986> 2023-10-03T19:18:09.841+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 84 ==== osd_op_reply(1851 10000000504.00000000 [create,setxattr (99),setxattr (30)] v74'35 uv35 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:19.085 INFO:teuthology.orchestra.run.smithi045.stdout: -7985> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_995) mark_clean [dentry #0x1/dc-dir/dc-file_995 [2,head] auth (dversion lock) v=5992 ino=0x100000005d8 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc947a4000] 2023-10-03T19:21:19.085 INFO:teuthology.orchestra.run.smithi045.stdout: -7984> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5994 now clean [inode 0x100000005d9 [2,head] /dc-dir/dc-file_996 auth v5994 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.369933+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc947a1600] 2023-10-03T19:21:19.085 INFO:teuthology.orchestra.run.smithi045.stdout: -7983> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d9) mark_clean [inode 0x100000005d9 [2,head] /dc-dir/dc-file_996 auth v5994 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.369933+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc947a1600] 2023-10-03T19:21:19.085 INFO:teuthology.orchestra.run.smithi045.stdout: -7982> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5994 now clean [dentry #0x1/dc-dir/dc-file_996 [2,head] auth (dversion lock) v=5994 ino=0x100000005d9 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc947a4280] 2023-10-03T19:21:19.085 INFO:teuthology.orchestra.run.smithi045.stdout: -7981> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_996) mark_clean [dentry #0x1/dc-dir/dc-file_996 [2,head] auth (dversion lock) v=5994 ino=0x100000005d9 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc947a4280] 2023-10-03T19:21:19.085 INFO:teuthology.orchestra.run.smithi045.stdout: -7980> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5996 now clean [inode 0x100000005da [2,head] /dc-dir/dc-file_997 auth v5996 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.381346+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc947a1b80] 2023-10-03T19:21:19.085 INFO:teuthology.orchestra.run.smithi045.stdout: -7979> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005da) mark_clean [inode 0x100000005da [2,head] /dc-dir/dc-file_997 auth v5996 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.381346+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc947a1b80] 2023-10-03T19:21:19.085 INFO:teuthology.orchestra.run.smithi045.stdout: -7978> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5996 now clean [dentry #0x1/dc-dir/dc-file_997 [2,head] auth (dversion lock) v=5996 ino=0x100000005da state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc947a4500] 2023-10-03T19:21:19.085 INFO:teuthology.orchestra.run.smithi045.stdout: -7977> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_997) mark_clean [dentry #0x1/dc-dir/dc-file_997 [2,head] auth (dversion lock) v=5996 ino=0x100000005da state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc947a4500] 2023-10-03T19:21:19.086 INFO:teuthology.orchestra.run.smithi045.stdout: -7976> 2023-10-03T19:18:09.841+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 85 ==== osd_op_reply(1853 10000000506.00000000 [create,setxattr (99),setxattr (30)] v74'30 uv30 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:19.086 INFO:teuthology.orchestra.run.smithi045.stdout: -7975> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 5998 now clean [inode 0x100000005db [2,head] /dc-dir/dc-file_998 auth v5998 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.392936+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc947a2100] 2023-10-03T19:21:19.086 INFO:teuthology.orchestra.run.smithi045.stdout: -7974> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005db) mark_clean [inode 0x100000005db [2,head] /dc-dir/dc-file_998 auth v5998 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.392936+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc947a2100] 2023-10-03T19:21:19.086 INFO:teuthology.orchestra.run.smithi045.stdout: -7973> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 5998 now clean [dentry #0x1/dc-dir/dc-file_998 [2,head] auth (dversion lock) v=5998 ino=0x100000005db state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc947a4780] 2023-10-03T19:21:19.086 INFO:teuthology.orchestra.run.smithi045.stdout: -7972> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_998) mark_clean [dentry #0x1/dc-dir/dc-file_998 [2,head] auth (dversion lock) v=5998 ino=0x100000005db state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc947a4780] 2023-10-03T19:21:19.086 INFO:teuthology.orchestra.run.smithi045.stdout: -7971> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= inode 6000 now clean [inode 0x100000005dc [2,head] /dc-dir/dc-file_999 auth v6000 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.405153+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc947a2680] 2023-10-03T19:21:19.086 INFO:teuthology.orchestra.run.smithi045.stdout: -7970> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005dc) mark_clean [inode 0x100000005dc [2,head] /dc-dir/dc-file_999 auth v6000 ap=1 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.405153+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55cc947a2680] 2023-10-03T19:21:19.086 INFO:teuthology.orchestra.run.smithi045.stdout: -7969> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) dir 6001 >= dn 6000 now clean [dentry #0x1/dc-dir/dc-file_999 [2,head] auth (dversion lock) v=6000 ino=0x100000005dc state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc947a4a00] 2023-10-03T19:21:19.086 INFO:teuthology.orchestra.run.smithi045.stdout: -7968> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.den(0x10000000000 dc-file_999) mark_clean [dentry #0x1/dc-dir/dc-file_999 [2,head] auth (dversion lock) v=6000 ino=0x100000005dc state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 0x55cc947a4a00] 2023-10-03T19:21:19.086 INFO:teuthology.orchestra.run.smithi045.stdout: -7967> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55cc94052400 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+1000 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] count now 1 2023-10-03T19:21:19.087 INFO:teuthology.orchestra.run.smithi045.stdout: -7966> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 MDSIOContextBase::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:19.087 INFO:teuthology.orchestra.run.smithi045.stdout: -7965> 2023-10-03T19:18:09.841+0000 7f5aaf71d640 7 mds.0.33 mds has 4 queued contexts 2023-10-03T19:21:19.087 INFO:teuthology.orchestra.run.smithi045.stdout: -7964> 2023-10-03T19:18:09.841+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 86 ==== osd_op_reply(1861 1000000050e.00000000 [create,setxattr (99),setxattr (30)] v74'31 uv31 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:19.087 INFO:teuthology.orchestra.run.smithi045.stdout: -7963> 2023-10-03T19:18:09.841+0000 7f5aaf71d640 10 mds.0.33 finish 0x55cc93e95540 2023-10-03T19:21:19.087 INFO:teuthology.orchestra.run.smithi045.stdout: -7962> 2023-10-03T19:18:09.841+0000 7f5aaf71d640 10 mds.0.33 finish 0x55cc93e95710 2023-10-03T19:21:19.087 INFO:teuthology.orchestra.run.smithi045.stdout: -7961> 2023-10-03T19:18:09.841+0000 7f5aaf71d640 10 mds.0.33 finish 0x55cc93e95900 2023-10-03T19:21:19.087 INFO:teuthology.orchestra.run.smithi045.stdout: -7960> 2023-10-03T19:18:09.841+0000 7f5aaf71d640 10 mds.0.33 finish 0x55cc93e958c0 2023-10-03T19:21:19.087 INFO:teuthology.orchestra.run.smithi045.stdout: -7959> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 MDSContext::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:19.087 INFO:teuthology.orchestra.run.smithi045.stdout: -7958> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.dir(0x1) _committed v 6007 on [dir 0x1 / [2,head] auth v=6007 cv=6007/1 REP dir_auth=0 ap=1+2 state=1610874913|complete|committing f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55cc9312ed00] 2023-10-03T19:21:19.087 INFO:teuthology.orchestra.run.smithi045.stdout: -7957> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.dir(0x1) mark_clean [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=1+2 state=1610874881|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x55cc9312ed00] version 6007 2023-10-03T19:21:19.087 INFO:teuthology.orchestra.run.smithi045.stdout: -7956> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x1) dir 6007 >= inode 6005 now clean [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=2 DIRTYPARENT f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) caps={5929=pAsLsXsFsx/-@1002},l=5929 | request=0 lock=5 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x55cc940bfb80] 2023-10-03T19:21:19.088 INFO:teuthology.orchestra.run.smithi045.stdout: -7955> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000000) mark_clean [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=2 DIRTYPARENT f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) caps={5929=pAsLsXsFsx/-@1002},l=5929 | request=0 lock=5 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x55cc940bfb80] 2023-10-03T19:21:19.088 INFO:teuthology.orchestra.run.smithi045.stdout: -7954> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 15 mds.0.cache.dir(0x1) dir 6007 >= dn 6005 now clean [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) v=6005 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55cc9413c000] 2023-10-03T19:21:19.088 INFO:teuthology.orchestra.run.smithi045.stdout: -7953> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.den(0x1 dc-dir) mark_clean [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) v=6005 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x55cc9413c000] 2023-10-03T19:21:19.524 INFO:teuthology.orchestra.run.smithi045.stdout: -7952> 2023-10-03T19:18:09.841+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 87 ==== osd_op_reply(1867 10000000514.00000000 [create,setxattr (99),setxattr (30)] v74'36 uv36 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:19.524 INFO:teuthology.orchestra.run.smithi045.stdout: -7951> 2023-10-03T19:18:09.841+0000 7f5aadf1a640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55cc9312ed00 on [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+2 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] count now 0 2023-10-03T19:21:19.525 INFO:teuthology.orchestra.run.smithi045.stdout: -7950> 2023-10-03T19:18:09.841+0000 7f5aaf71d640 7 mds.0.33 mds has 1 queued contexts 2023-10-03T19:21:19.525 INFO:teuthology.orchestra.run.smithi045.stdout: -7949> 2023-10-03T19:18:09.841+0000 7f5aaf71d640 10 mds.0.33 finish 0x55cc93e954a0 2023-10-03T19:21:19.525 INFO:teuthology.orchestra.run.smithi045.stdout: -7948> 2023-10-03T19:18:09.841+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 88 ==== osd_op_reply(1913 10000000541.00000000 [create,setxattr (99),setxattr (30)] v74'32 uv32 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:19.525 INFO:teuthology.orchestra.run.smithi045.stdout: -7947> 2023-10-03T19:18:09.841+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 89 ==== osd_op_reply(1924 1000000054c.00000000 [create,setxattr (99),setxattr (30)] v74'27 uv27 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:19.526 INFO:teuthology.orchestra.run.smithi045.stdout: -7946> 2023-10-03T19:18:09.841+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 90 ==== osd_op_reply(1927 1000000054f.00000000 [create,setxattr (99),setxattr (30)] v74'37 uv37 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:19.526 INFO:teuthology.orchestra.run.smithi045.stdout: -7945> 2023-10-03T19:18:09.841+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 91 ==== osd_op_reply(1930 10000000552.00000000 [create,setxattr (99),setxattr (30)] v74'28 uv28 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:19.526 INFO:teuthology.orchestra.run.smithi045.stdout: -7944> 2023-10-03T19:18:09.841+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 92 ==== osd_op_reply(1949 10000000565.00000000 [create,setxattr (99),setxattr (30)] v74'33 uv33 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:19.526 INFO:teuthology.orchestra.run.smithi045.stdout: -7943> 2023-10-03T19:18:09.841+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 93 ==== osd_op_reply(1951 10000000567.00000000 [create,setxattr (99),setxattr (30)] v74'38 uv38 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:19.526 INFO:teuthology.orchestra.run.smithi045.stdout: -7942> 2023-10-03T19:18:09.841+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 94 ==== osd_op_reply(1969 10000000579.00000000 [create,setxattr (99),setxattr (30)] v74'29 uv29 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:19.527 INFO:teuthology.orchestra.run.smithi045.stdout: -7941> 2023-10-03T19:18:09.841+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 95 ==== osd_op_reply(2031 100000005b7.00000000 [create,setxattr (99),setxattr (30)] v74'30 uv30 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:19.527 INFO:teuthology.orchestra.run.smithi045.stdout: -7940> 2023-10-03T19:18:09.841+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 96 ==== osd_op_reply(2039 100000005bf.00000000 [create,setxattr (99),setxattr (30)] v74'31 uv31 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:19.527 INFO:teuthology.orchestra.run.smithi045.stdout: -7939> 2023-10-03T19:18:09.841+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 97 ==== osd_op_reply(2040 100000005c0.00000000 [create,setxattr (99),setxattr (30)] v74'32 uv32 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:19.527 INFO:teuthology.orchestra.run.smithi045.stdout: -7938> 2023-10-03T19:18:09.841+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 98 ==== osd_op_reply(2052 100000005cc.00000000 [create,setxattr (99),setxattr (30)] v74'34 uv34 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:19.527 INFO:teuthology.orchestra.run.smithi045.stdout: -7937> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 126 ==== osd_op_reply(1366 1000000031f.00000000 [create,setxattr (99),setxattr (30)] v74'24 uv24 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.527 INFO:teuthology.orchestra.run.smithi045.stdout: -7936> 2023-10-03T19:18:09.845+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 89 ==== osd_op_reply(1304 100000002e1.00000000 [create,setxattr (99),setxattr (30)] v74'26 uv26 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffc800 2023-10-03T19:21:19.527 INFO:teuthology.orchestra.run.smithi045.stdout: -7935> 2023-10-03T19:18:09.845+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 90 ==== osd_op_reply(1336 10000000301.00000000 [create,setxattr (99),setxattr (30)] v74'27 uv27 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffc800 2023-10-03T19:21:19.527 INFO:teuthology.orchestra.run.smithi045.stdout: -7934> 2023-10-03T19:18:09.845+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 91 ==== osd_op_reply(1935 10000000557.00000000 [create,setxattr (99),setxattr (30)] v74'22 uv22 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:19.528 INFO:teuthology.orchestra.run.smithi045.stdout: -7933> 2023-10-03T19:18:09.845+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 91 ==== osd_op_reply(1398 1000000033f.00000000 [create,setxattr (99),setxattr (30)] v74'28 uv28 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffc800 2023-10-03T19:21:19.528 INFO:teuthology.orchestra.run.smithi045.stdout: -7932> 2023-10-03T19:18:09.845+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 92 ==== osd_op_reply(1401 10000000342.00000000 [create,setxattr (99),setxattr (30)] v74'29 uv29 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffc800 2023-10-03T19:21:19.528 INFO:teuthology.orchestra.run.smithi045.stdout: -7931> 2023-10-03T19:18:09.845+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 93 ==== osd_op_reply(1424 10000000359.00000000 [create,setxattr (99),setxattr (30)] v74'30 uv30 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffc800 2023-10-03T19:21:19.528 INFO:teuthology.orchestra.run.smithi045.stdout: -7930> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 127 ==== osd_op_reply(1430 1000000035f.00000000 [create,setxattr (99),setxattr (30)] v74'25 uv25 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.528 INFO:teuthology.orchestra.run.smithi045.stdout: -7929> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 128 ==== osd_op_reply(1660 10000000445.00000000 [create,setxattr (99),setxattr (30)] v74'31 uv31 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.528 INFO:teuthology.orchestra.run.smithi045.stdout: -7928> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 129 ==== osd_op_reply(1444 1000000036d.00000000 [create,setxattr (99),setxattr (30)] v74'15 uv15 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.528 INFO:teuthology.orchestra.run.smithi045.stdout: -7927> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 130 ==== osd_op_reply(1732 1000000048d.00000000 [create,setxattr (99),setxattr (30)] v74'32 uv32 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.528 INFO:teuthology.orchestra.run.smithi045.stdout: -7926> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 131 ==== osd_op_reply(1670 1000000044f.00000000 [create,setxattr (99),setxattr (30)] v74'25 uv25 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.528 INFO:teuthology.orchestra.run.smithi045.stdout: -7925> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 132 ==== osd_op_reply(1729 1000000048a.00000000 [create,setxattr (99),setxattr (30)] v74'26 uv26 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.528 INFO:teuthology.orchestra.run.smithi045.stdout: -7924> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 133 ==== osd_op_reply(1750 1000000049f.00000000 [create,setxattr (99),setxattr (30)] v74'33 uv33 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.529 INFO:teuthology.orchestra.run.smithi045.stdout: -7923> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 134 ==== osd_op_reply(1679 10000000458.00000000 [create,setxattr (99),setxattr (30)] v74'28 uv28 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.565 INFO:teuthology.orchestra.run.smithi045.stdout: -7922> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 135 ==== osd_op_reply(1805 100000004d6.00000000 [create,setxattr (99),setxattr (30)] v74'27 uv27 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.565 INFO:teuthology.orchestra.run.smithi045.stdout: -7921> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 136 ==== osd_op_reply(1817 100000004e2.00000000 [create,setxattr (99),setxattr (30)] v74'17 uv17 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.565 INFO:teuthology.orchestra.run.smithi045.stdout: -7920> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 137 ==== osd_op_reply(1745 1000000049a.00000000 [create,setxattr (99),setxattr (30)] v74'27 uv27 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.565 INFO:teuthology.orchestra.run.smithi045.stdout: -7919> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 138 ==== osd_op_reply(1810 100000004db.00000000 [create,setxattr (99),setxattr (30)] v74'34 uv34 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.565 INFO:teuthology.orchestra.run.smithi045.stdout: -7918> 2023-10-03T19:18:09.845+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 94 ==== osd_op_reply(1596 10000000405.00000000 [create,setxattr (99),setxattr (30)] v74'31 uv31 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffc800 2023-10-03T19:21:19.566 INFO:teuthology.orchestra.run.smithi045.stdout: -7917> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 139 ==== osd_op_reply(1822 100000004e7.00000000 [create,setxattr (99),setxattr (30)] v74'28 uv28 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.566 INFO:teuthology.orchestra.run.smithi045.stdout: -7916> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 140 ==== osd_op_reply(2000 10000000598.00000000 [create,setxattr (99),setxattr (30)] v74'18 uv18 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.566 INFO:teuthology.orchestra.run.smithi045.stdout: -7915> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 141 ==== osd_op_reply(1823 100000004e8.00000000 [create,setxattr (99),setxattr (30)] v74'35 uv35 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.566 INFO:teuthology.orchestra.run.smithi045.stdout: -7914> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 142 ==== osd_op_reply(1818 100000004e3.00000000 [create,setxattr (99),setxattr (30)] v74'29 uv29 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.566 INFO:teuthology.orchestra.run.smithi045.stdout: -7913> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 90 ==== osd_op_reply(1204 1000000027d.00000000 [create,setxattr (99),setxattr (30)] v74'28 uv28 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.566 INFO:teuthology.orchestra.run.smithi045.stdout: -7912> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 91 ==== osd_op_reply(1391 10000000338.00000000 [create,setxattr (99),setxattr (30)] v74'27 uv27 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.567 INFO:teuthology.orchestra.run.smithi045.stdout: -7911> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 92 ==== osd_op_reply(1469 10000000386.00000000 [create,setxattr (99),setxattr (30)] v74'28 uv28 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.567 INFO:teuthology.orchestra.run.smithi045.stdout: -7910> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 93 ==== osd_op_reply(1230 10000000297.00000000 [create,setxattr (99),setxattr (30)] v74'29 uv29 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.567 INFO:teuthology.orchestra.run.smithi045.stdout: -7909> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 94 ==== osd_op_reply(1489 1000000039a.00000000 [create,setxattr (99),setxattr (30)] v74'29 uv29 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.567 INFO:teuthology.orchestra.run.smithi045.stdout: -7908> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 95 ==== osd_op_reply(1301 100000002de.00000000 [create,setxattr (99),setxattr (30)] v74'30 uv30 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.567 INFO:teuthology.orchestra.run.smithi045.stdout: -7907> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 96 ==== osd_op_reply(1501 100000003a6.00000000 [create,setxattr (99),setxattr (30)] v74'30 uv30 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.567 INFO:teuthology.orchestra.run.smithi045.stdout: -7906> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 97 ==== osd_op_reply(1381 1000000032e.00000000 [create,setxattr (99),setxattr (30)] v74'31 uv31 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.567 INFO:teuthology.orchestra.run.smithi045.stdout: -7905> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 98 ==== osd_op_reply(1316 100000002ed.00000000 [create,setxattr (99),setxattr (30)] v74'24 uv24 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.568 INFO:teuthology.orchestra.run.smithi045.stdout: -7904> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 99 ==== osd_op_reply(1533 100000003c6.00000000 [create,setxattr (99),setxattr (30)] v74'31 uv31 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.568 INFO:teuthology.orchestra.run.smithi045.stdout: -7903> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 100 ==== osd_op_reply(1449 10000000372.00000000 [create,setxattr (99),setxattr (30)] v74'25 uv25 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.568 INFO:teuthology.orchestra.run.smithi045.stdout: -7902> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 101 ==== osd_op_reply(1544 100000003d1.00000000 [create,setxattr (99),setxattr (30)] v74'32 uv32 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.568 INFO:teuthology.orchestra.run.smithi045.stdout: -7901> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 102 ==== osd_op_reply(1550 100000003d7.00000000 [create,setxattr (99),setxattr (30)] v74'33 uv33 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.568 INFO:teuthology.orchestra.run.smithi045.stdout: -7900> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 103 ==== osd_op_reply(1452 10000000375.00000000 [create,setxattr (99),setxattr (30)] v74'26 uv26 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.569 INFO:teuthology.orchestra.run.smithi045.stdout: -7899> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 104 ==== osd_op_reply(1573 100000003ee.00000000 [create,setxattr (99),setxattr (30)] v74'34 uv34 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.569 INFO:teuthology.orchestra.run.smithi045.stdout: -7898> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 105 ==== osd_op_reply(1597 10000000406.00000000 [create,setxattr (99),setxattr (30)] v74'35 uv35 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.569 INFO:teuthology.orchestra.run.smithi045.stdout: -7897> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 106 ==== osd_op_reply(1628 10000000425.00000000 [create,setxattr (99),setxattr (30)] v74'36 uv36 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.569 INFO:teuthology.orchestra.run.smithi045.stdout: -7896> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 107 ==== osd_op_reply(1645 10000000436.00000000 [create,setxattr (99),setxattr (30)] v74'37 uv37 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.569 INFO:teuthology.orchestra.run.smithi045.stdout: -7895> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 108 ==== osd_op_reply(1661 10000000446.00000000 [create,setxattr (99),setxattr (30)] v74'38 uv38 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.569 INFO:teuthology.orchestra.run.smithi045.stdout: -7894> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 109 ==== osd_op_reply(1741 10000000496.00000000 [create,setxattr (99),setxattr (30)] v74'39 uv39 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.569 INFO:teuthology.orchestra.run.smithi045.stdout: -7893> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 110 ==== osd_op_reply(1786 100000004c3.00000000 [create,setxattr (99),setxattr (30)] v74'40 uv40 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.668 INFO:teuthology.orchestra.run.smithi045.stdout: -7892> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 111 ==== osd_op_reply(1855 10000000508.00000000 [create,setxattr (99),setxattr (30)] v74'41 uv41 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.668 INFO:teuthology.orchestra.run.smithi045.stdout: -7891> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 112 ==== osd_op_reply(1888 10000000529.00000000 [create,setxattr (99),setxattr (30)] v74'42 uv42 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.668 INFO:teuthology.orchestra.run.smithi045.stdout: -7890> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 113 ==== osd_op_reply(2022 100000005ae.00000000 [create,setxattr (99),setxattr (30)] v74'43 uv43 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.668 INFO:teuthology.orchestra.run.smithi045.stdout: -7889> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 114 ==== osd_op_reply(2056 100000005d0.00000000 [create,setxattr (99),setxattr (30)] v74'44 uv44 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.668 INFO:teuthology.orchestra.run.smithi045.stdout: -7888> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 143 ==== osd_op_reply(1784 100000004c1.00000000 [create,setxattr (99),setxattr (30)] v74'29 uv29 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.668 INFO:teuthology.orchestra.run.smithi045.stdout: -7887> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 144 ==== osd_op_reply(1435 10000000364.00000000 [create,setxattr (99),setxattr (30)] v74'26 uv26 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.668 INFO:teuthology.orchestra.run.smithi045.stdout: -7886> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 145 ==== osd_op_reply(1883 10000000524.00000000 [create,setxattr (99),setxattr (30)] v74'29 uv29 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.668 INFO:teuthology.orchestra.run.smithi045.stdout: -7885> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 146 ==== osd_op_reply(2002 1000000059a.00000000 [create,setxattr (99),setxattr (30)] v74'19 uv19 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.669 INFO:teuthology.orchestra.run.smithi045.stdout: -7884> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 147 ==== osd_op_reply(1832 100000004f1.00000000 [create,setxattr (99),setxattr (30)] v74'30 uv30 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.669 INFO:teuthology.orchestra.run.smithi045.stdout: -7883> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 148 ==== osd_op_reply(1463 10000000380.00000000 [create,setxattr (99),setxattr (30)] v74'27 uv27 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.669 INFO:teuthology.orchestra.run.smithi045.stdout: -7882> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 149 ==== osd_op_reply(2005 1000000059d.00000000 [create,setxattr (99),setxattr (30)] v74'20 uv20 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.669 INFO:teuthology.orchestra.run.smithi045.stdout: -7881> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 150 ==== osd_op_reply(1870 10000000517.00000000 [create,setxattr (99),setxattr (30)] v74'30 uv30 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.669 INFO:teuthology.orchestra.run.smithi045.stdout: -7880> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 151 ==== osd_op_reply(1587 100000003fc.00000000 [create,setxattr (99),setxattr (30)] v74'16 uv16 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.669 INFO:teuthology.orchestra.run.smithi045.stdout: -7879> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 152 ==== osd_op_reply(1971 1000000057b.00000000 [create,setxattr (99),setxattr (30)] v74'30 uv30 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.669 INFO:teuthology.orchestra.run.smithi045.stdout: -7878> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 153 ==== osd_op_reply(1835 100000004f4.00000000 [create,setxattr (99),setxattr (30)] v74'20 uv20 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.669 INFO:teuthology.orchestra.run.smithi045.stdout: -7877> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 154 ==== osd_op_reply(1662 10000000447.00000000 [create,setxattr (99),setxattr (30)] v74'17 uv17 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.669 INFO:teuthology.orchestra.run.smithi045.stdout: -7876> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 155 ==== osd_op_reply(1937 10000000559.00000000 [create,setxattr (99),setxattr (30)] v74'31 uv31 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.669 INFO:teuthology.orchestra.run.smithi045.stdout: -7875> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 156 ==== osd_op_reply(2049 100000005c9.00000000 [create,setxattr (99),setxattr (30)] v74'21 uv21 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.670 INFO:teuthology.orchestra.run.smithi045.stdout: -7874> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 157 ==== osd_op_reply(1973 1000000057d.00000000 [create,setxattr (99),setxattr (30)] v74'32 uv32 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.670 INFO:teuthology.orchestra.run.smithi045.stdout: -7873> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 158 ==== osd_op_reply(1733 1000000048e.00000000 [create,setxattr (99),setxattr (30)] v74'28 uv28 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.670 INFO:teuthology.orchestra.run.smithi045.stdout: -7872> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 159 ==== osd_op_reply(2001 10000000599.00000000 [create,setxattr (99),setxattr (30)] v74'33 uv33 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.670 INFO:teuthology.orchestra.run.smithi045.stdout: -7871> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 160 ==== osd_op_reply(2054 100000005ce.00000000 [create,setxattr (99),setxattr (30)] v74'22 uv22 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.670 INFO:teuthology.orchestra.run.smithi045.stdout: -7870> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 161 ==== osd_op_reply(1716 1000000047d.00000000 [create,setxattr (99),setxattr (30)] v74'18 uv18 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.670 INFO:teuthology.orchestra.run.smithi045.stdout: -7869> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 162 ==== osd_op_reply(2051 100000005cb.00000000 [create,setxattr (99),setxattr (30)] v74'34 uv34 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.670 INFO:teuthology.orchestra.run.smithi045.stdout: -7868> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 163 ==== osd_op_reply(1747 1000000049c.00000000 [create,setxattr (99),setxattr (30)] v74'19 uv19 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.670 INFO:teuthology.orchestra.run.smithi045.stdout: -7867> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 164 ==== osd_op_reply(1890 1000000052b.00000000 [create,setxattr (99),setxattr (30)] v74'36 uv36 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.670 INFO:teuthology.orchestra.run.smithi045.stdout: -7866> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 165 ==== osd_op_reply(1755 100000004a4.00000000 [create,setxattr (99),setxattr (30)] v74'20 uv20 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.671 INFO:teuthology.orchestra.run.smithi045.stdout: -7865> 2023-10-03T19:18:09.845+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 95 ==== osd_op_reply(1614 10000000417.00000000 [create,setxattr (99),setxattr (30)] v74'32 uv32 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffc800 2023-10-03T19:21:19.671 INFO:teuthology.orchestra.run.smithi045.stdout: -7864> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 166 ==== osd_op_reply(1950 10000000566.00000000 [create,setxattr (99),setxattr (30)] v74'37 uv37 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.671 INFO:teuthology.orchestra.run.smithi045.stdout: -7863> 2023-10-03T19:18:09.845+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 96 ==== osd_op_reply(1664 10000000449.00000000 [create,setxattr (99),setxattr (30)] v74'33 uv33 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffc800 2023-10-03T19:21:19.671 INFO:teuthology.orchestra.run.smithi045.stdout: -7862> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 167 ==== osd_op_reply(1897 10000000532.00000000 [create,setxattr (99),setxattr (30)] v74'29 uv29 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.671 INFO:teuthology.orchestra.run.smithi045.stdout: -7861> 2023-10-03T19:18:09.845+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 97 ==== osd_op_reply(1737 10000000492.00000000 [create,setxattr (99),setxattr (30)] v74'34 uv34 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffc800 2023-10-03T19:21:19.671 INFO:teuthology.orchestra.run.smithi045.stdout: -7860> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 168 ==== osd_op_reply(2041 100000005c1.00000000 [create,setxattr (99),setxattr (30)] v74'28 uv28 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.671 INFO:teuthology.orchestra.run.smithi045.stdout: -7859> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 169 ==== osd_op_reply(1968 10000000578.00000000 [create,setxattr (99),setxattr (30)] v74'38 uv38 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.671 INFO:teuthology.orchestra.run.smithi045.stdout: -7858> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 170 ==== osd_op_reply(1947 10000000563.00000000 [create,setxattr (99),setxattr (30)] v74'21 uv21 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.671 INFO:teuthology.orchestra.run.smithi045.stdout: -7857> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 171 ==== osd_op_reply(2060 100000005d4.00000000 [create,setxattr (99),setxattr (30)] v74'29 uv29 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.671 INFO:teuthology.orchestra.run.smithi045.stdout: -7856> 2023-10-03T19:18:09.845+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 172 ==== osd_op_reply(1995 10000000593.00000000 [create,setxattr (99),setxattr (30)] v74'30 uv30 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.671 INFO:teuthology.orchestra.run.smithi045.stdout: -7855> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 173 ==== osd_op_reply(2067 100000005db.00000000 [create,setxattr (99),setxattr (30)] v74'30 uv30 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.672 INFO:teuthology.orchestra.run.smithi045.stdout: -7854> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 174 ==== osd_op_reply(2009 100000005a1.00000000 [create,setxattr (99),setxattr (30)] v74'22 uv22 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.672 INFO:teuthology.orchestra.run.smithi045.stdout: -7853> 2023-10-03T19:18:09.849+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 98 ==== osd_op_reply(1743 10000000498.00000000 [create,setxattr (99),setxattr (30)] v74'35 uv35 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffc800 2023-10-03T19:21:19.672 INFO:teuthology.orchestra.run.smithi045.stdout: -7852> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 175 ==== osd_op_reply(1676 10000000455.00000000 [create,setxattr (99),setxattr (30)] v74'20 uv20 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.672 INFO:teuthology.orchestra.run.smithi045.stdout: -7851> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 176 ==== osd_op_reply(1700 1000000046d.00000000 [create,setxattr (99),setxattr (30)] v74'22 uv22 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.672 INFO:teuthology.orchestra.run.smithi045.stdout: -7850> 2023-10-03T19:18:09.849+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 99 ==== osd_op_reply(1847 10000000500.00000000 [create,setxattr (99),setxattr (30)] v74'36 uv36 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffc800 2023-10-03T19:21:19.672 INFO:teuthology.orchestra.run.smithi045.stdout: -7849> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 115 ==== osd_op_reply(1519 100000003b8.00000000 [create,setxattr (99),setxattr (30)] v74'32 uv32 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.672 INFO:teuthology.orchestra.run.smithi045.stdout: -7848> 2023-10-03T19:18:09.849+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 100 ==== osd_op_reply(1881 10000000522.00000000 [create,setxattr (99),setxattr (30)] v74'37 uv37 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffc800 2023-10-03T19:21:19.672 INFO:teuthology.orchestra.run.smithi045.stdout: -7847> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 116 ==== osd_op_reply(1561 100000003e2.00000000 [create,setxattr (99),setxattr (30)] v74'33 uv33 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.672 INFO:teuthology.orchestra.run.smithi045.stdout: -7846> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 117 ==== osd_op_reply(1640 10000000431.00000000 [create,setxattr (99),setxattr (30)] v74'27 uv27 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.672 INFO:teuthology.orchestra.run.smithi045.stdout: -7845> 2023-10-03T19:18:09.849+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 101 ==== osd_op_reply(1896 10000000531.00000000 [create,setxattr (99),setxattr (30)] v74'38 uv38 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffc800 2023-10-03T19:21:19.673 INFO:teuthology.orchestra.run.smithi045.stdout: -7844> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 177 ==== osd_op_reply(1704 10000000471.00000000 [create,setxattr (99),setxattr (30)] v74'23 uv23 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.673 INFO:teuthology.orchestra.run.smithi045.stdout: -7843> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 178 ==== osd_op_reply(1740 10000000495.00000000 [create,setxattr (99),setxattr (30)] v74'24 uv24 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.673 INFO:teuthology.orchestra.run.smithi045.stdout: -7842> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 179 ==== osd_op_reply(1765 100000004ae.00000000 [create,setxattr (99),setxattr (30)] v74'25 uv25 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.673 INFO:teuthology.orchestra.run.smithi045.stdout: -7841> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 180 ==== osd_op_reply(1615 10000000418.00000000 [create,setxattr (99),setxattr (30)] v74'27 uv27 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.673 INFO:teuthology.orchestra.run.smithi045.stdout: -7840> 2023-10-03T19:18:09.849+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 102 ==== osd_op_reply(1901 10000000536.00000000 [create,setxattr (99),setxattr (30)] v74'39 uv39 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffc800 2023-10-03T19:21:19.673 INFO:teuthology.orchestra.run.smithi045.stdout: -7839> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 181 ==== osd_op_reply(1675 10000000454.00000000 [create,setxattr (99),setxattr (30)] v74'25 uv25 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.673 INFO:teuthology.orchestra.run.smithi045.stdout: -7838> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 182 ==== osd_op_reply(1678 10000000457.00000000 [create,setxattr (99),setxattr (30)] v74'26 uv26 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.673 INFO:teuthology.orchestra.run.smithi045.stdout: -7837> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 MDSIOContextBase::complete: 20BatchStoredBacktrace 2023-10-03T19:21:19.673 INFO:teuthology.orchestra.run.smithi045.stdout: -7836> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 MDSContext::complete: 20BatchStoredBacktrace 2023-10-03T19:21:19.673 INFO:teuthology.orchestra.run.smithi045.stdout: -7835> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000532) _stored_backtrace v 4084 2023-10-03T19:21:19.673 INFO:teuthology.orchestra.run.smithi045.stdout: -7834> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 183 ==== osd_op_reply(1727 10000000488.00000000 [create,setxattr (99),setxattr (30)] v74'27 uv27 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.682 INFO:teuthology.orchestra.run.smithi045.stdout: -7833> 2023-10-03T19:18:09.849+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 103 ==== osd_op_reply(1929 10000000551.00000000 [create,setxattr (99),setxattr (30)] v74'40 uv40 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc947dc480 con 0x55cc93ffc800 2023-10-03T19:21:19.682 INFO:teuthology.orchestra.run.smithi045.stdout: -7832> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 184 ==== osd_op_reply(1797 100000004ce.00000000 [create,setxattr (99),setxattr (30)] v74'28 uv28 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.682 INFO:teuthology.orchestra.run.smithi045.stdout: -7831> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000532) auth_unpin by 0x55cc9469cb00 on [inode 0x10000000532 [2,head] /dc-dir/dc-file_829 auth v5660 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.000219+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9469cb00] now 0 2023-10-03T19:21:19.683 INFO:teuthology.orchestra.run.smithi045.stdout: -7830> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 118 ==== osd_op_reply(1567 100000003e8.00000000 [create,setxattr (99),setxattr (30)] v74'34 uv34 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.683 INFO:teuthology.orchestra.run.smithi045.stdout: -7829> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+999 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9469cb00 count now 1/999 2023-10-03T19:21:19.683 INFO:teuthology.orchestra.run.smithi045.stdout: -7828> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000532) clear_dirty_parent 2023-10-03T19:21:19.683 INFO:teuthology.orchestra.run.smithi045.stdout: -7827> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000533) _stored_backtrace v 4088 2023-10-03T19:21:19.683 INFO:teuthology.orchestra.run.smithi045.stdout: -7826> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000533) auth_unpin by 0x55cc9469d080 on [inode 0x10000000533 [2,head] /dc-dir/dc-file_830 auth v5662 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.013296+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9469d080] now 0 2023-10-03T19:21:19.683 INFO:teuthology.orchestra.run.smithi045.stdout: -7825> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 119 ==== osd_op_reply(1705 10000000472.00000000 [create,setxattr (99),setxattr (30)] v74'28 uv28 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.683 INFO:teuthology.orchestra.run.smithi045.stdout: -7824> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+998 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9469d080 count now 1/998 2023-10-03T19:21:19.683 INFO:teuthology.orchestra.run.smithi045.stdout: -7823> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000533) clear_dirty_parent 2023-10-03T19:21:19.683 INFO:teuthology.orchestra.run.smithi045.stdout: -7822> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000534) _stored_backtrace v 4092 2023-10-03T19:21:19.684 INFO:teuthology.orchestra.run.smithi045.stdout: -7821> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000534) auth_unpin by 0x55cc9469d600 on [inode 0x10000000534 [2,head] /dc-dir/dc-file_831 auth v5664 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.027269+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9469d600] now 0 2023-10-03T19:21:19.684 INFO:teuthology.orchestra.run.smithi045.stdout: -7820> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 120 ==== osd_op_reply(1759 100000004a8.00000000 [create,setxattr (99),setxattr (30)] v74'29 uv29 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.684 INFO:teuthology.orchestra.run.smithi045.stdout: -7819> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+997 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9469d600 count now 1/997 2023-10-03T19:21:19.684 INFO:teuthology.orchestra.run.smithi045.stdout: -7818> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000534) clear_dirty_parent 2023-10-03T19:21:19.684 INFO:teuthology.orchestra.run.smithi045.stdout: -7817> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000535) _stored_backtrace v 4096 2023-10-03T19:21:19.684 INFO:teuthology.orchestra.run.smithi045.stdout: -7816> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 121 ==== osd_op_reply(1590 100000003ff.00000000 [create,setxattr (99),setxattr (30)] v74'35 uv35 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.684 INFO:teuthology.orchestra.run.smithi045.stdout: -7815> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000535) auth_unpin by 0x55cc9469db80 on [inode 0x10000000535 [2,head] /dc-dir/dc-file_832 auth v5666 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.040839+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9469db80] now 0 2023-10-03T19:21:19.684 INFO:teuthology.orchestra.run.smithi045.stdout: -7814> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+996 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9469db80 count now 1/996 2023-10-03T19:21:19.684 INFO:teuthology.orchestra.run.smithi045.stdout: -7813> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000535) clear_dirty_parent 2023-10-03T19:21:19.684 INFO:teuthology.orchestra.run.smithi045.stdout: -7812> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000536) _stored_backtrace v 4100 2023-10-03T19:21:19.684 INFO:teuthology.orchestra.run.smithi045.stdout: -7811> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000536) auth_unpin by 0x55cc9469e100 on [inode 0x10000000536 [2,head] /dc-dir/dc-file_833 auth v5668 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.054604+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9469e100] now 0 2023-10-03T19:21:19.684 INFO:teuthology.orchestra.run.smithi045.stdout: -7810> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+995 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9469e100 count now 1/995 2023-10-03T19:21:19.685 INFO:teuthology.orchestra.run.smithi045.stdout: -7809> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000536) clear_dirty_parent 2023-10-03T19:21:19.685 INFO:teuthology.orchestra.run.smithi045.stdout: -7808> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000537) _stored_backtrace v 4104 2023-10-03T19:21:19.685 INFO:teuthology.orchestra.run.smithi045.stdout: -7807> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000537) auth_unpin by 0x55cc9469e680 on [inode 0x10000000537 [2,head] /dc-dir/dc-file_834 auth v5670 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.067841+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9469e680] now 0 2023-10-03T19:21:19.685 INFO:teuthology.orchestra.run.smithi045.stdout: -7806> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 122 ==== osd_op_reply(1785 100000004c2.00000000 [create,setxattr (99),setxattr (30)] v74'30 uv30 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.685 INFO:teuthology.orchestra.run.smithi045.stdout: -7805> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+994 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9469e680 count now 1/994 2023-10-03T19:21:19.685 INFO:teuthology.orchestra.run.smithi045.stdout: -7804> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000537) clear_dirty_parent 2023-10-03T19:21:19.686 INFO:teuthology.orchestra.run.smithi045.stdout: -7803> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000538) _stored_backtrace v 4108 2023-10-03T19:21:19.686 INFO:teuthology.orchestra.run.smithi045.stdout: -7802> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000538) auth_unpin by 0x55cc9469ec00 on [inode 0x10000000538 [2,head] /dc-dir/dc-file_835 auth v5672 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.079693+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9469ec00] now 0 2023-10-03T19:21:19.686 INFO:teuthology.orchestra.run.smithi045.stdout: -7801> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 123 ==== osd_op_reply(1621 1000000041e.00000000 [create,setxattr (99),setxattr (30)] v74'36 uv36 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.686 INFO:teuthology.orchestra.run.smithi045.stdout: -7800> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+993 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9469ec00 count now 1/993 2023-10-03T19:21:19.686 INFO:teuthology.orchestra.run.smithi045.stdout: -7799> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000538) clear_dirty_parent 2023-10-03T19:21:19.686 INFO:teuthology.orchestra.run.smithi045.stdout: -7798> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000539) _stored_backtrace v 4112 2023-10-03T19:21:19.687 INFO:teuthology.orchestra.run.smithi045.stdout: -7797> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000539) auth_unpin by 0x55cc9469f180 on [inode 0x10000000539 [2,head] /dc-dir/dc-file_836 auth v5674 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.092371+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9469f180] now 0 2023-10-03T19:21:19.687 INFO:teuthology.orchestra.run.smithi045.stdout: -7796> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+992 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9469f180 count now 1/992 2023-10-03T19:21:19.687 INFO:teuthology.orchestra.run.smithi045.stdout: -7795> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000539) clear_dirty_parent 2023-10-03T19:21:19.687 INFO:teuthology.orchestra.run.smithi045.stdout: -7794> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 MDSContext::complete: 21C_MaybeExpiredSegment 2023-10-03T19:21:19.687 INFO:teuthology.orchestra.run.smithi045.stdout: -7793> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.log _maybe_expired segment 2049/8200194, 100 events 2023-10-03T19:21:19.688 INFO:teuthology.orchestra.run.smithi045.stdout: -7792> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 6 mds.0.journal LogSegment(2049/8200194).try_to_expire 2023-10-03T19:21:19.688 INFO:teuthology.orchestra.run.smithi045.stdout: -7791> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 4 mds.0.sessionmap save_if_dirty: writing 0 2023-10-03T19:21:19.688 INFO:teuthology.orchestra.run.smithi045.stdout: -7790> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.journal try_to_expire waiting for purge of [] 2023-10-03T19:21:19.688 INFO:teuthology.orchestra.run.smithi045.stdout: -7789> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 6 mds.0.journal LogSegment(2049/8200194).try_to_expire success 2023-10-03T19:21:19.688 INFO:teuthology.orchestra.run.smithi045.stdout: -7788> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.log try_expire expired segment 2049/8200194 2023-10-03T19:21:19.688 INFO:teuthology.orchestra.run.smithi045.stdout: -7787> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 5 mds.0.log _expired segment 2049/8200194, 100 events 2023-10-03T19:21:19.689 INFO:teuthology.orchestra.run.smithi045.stdout: -7786> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 MDSIOContextBase::complete: 20BatchStoredBacktrace 2023-10-03T19:21:19.689 INFO:teuthology.orchestra.run.smithi045.stdout: -7785> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 MDSContext::complete: 20BatchStoredBacktrace 2023-10-03T19:21:19.689 INFO:teuthology.orchestra.run.smithi045.stdout: -7784> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1) _stored_backtrace v 2 2023-10-03T19:21:19.689 INFO:teuthology.orchestra.run.smithi045.stdout: -7783> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 124 ==== osd_op_reply(1787 100000004c4.00000000 [create,setxattr (99),setxattr (30)] v74'31 uv31 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.689 INFO:teuthology.orchestra.run.smithi045.stdout: -7782> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1) auth_unpin by 0x55cc9314e680 on [inode 0x1 [...2,head] / auth v24 snaprealm=0x55cc932298c0 DIRTYPARENT f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:17:35.501989+0000 1=0+1) (isnap sync r=1) (inest lock) (ipolicy sync r=1) (iversion lock) caps={5929=pAsLsXsFs/-@7} | dirtyscattered=0 request=0 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9314e680] now 0 2023-10-03T19:21:19.690 INFO:teuthology.orchestra.run.smithi045.stdout: -7781> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1) clear_dirty_parent 2023-10-03T19:21:19.690 INFO:teuthology.orchestra.run.smithi045.stdout: -7780> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000000) _stored_backtrace v 2 2023-10-03T19:21:19.690 INFO:teuthology.orchestra.run.smithi045.stdout: -7779> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55cc940bfb80 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 DIRTYPARENT f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) caps={5929=pAsLsXsFsx/-@1002},l=5929 | request=0 lock=5 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=1 dirty=0 waiter=0 authpin=1 0x55cc940bfb80] now 1 2023-10-03T19:21:19.690 INFO:teuthology.orchestra.run.smithi045.stdout: -7778> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] by 0x55cc940bfb80 count now 0/1 2023-10-03T19:21:19.690 INFO:teuthology.orchestra.run.smithi045.stdout: -7777> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000000) clear_dirty_parent 2023-10-03T19:21:19.690 INFO:teuthology.orchestra.run.smithi045.stdout: -7776> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000001) _stored_backtrace v 2 2023-10-03T19:21:19.690 INFO:teuthology.orchestra.run.smithi045.stdout: -7775> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000001) auth_unpin by 0x55cc940c0100 on [inode 0x10000000001 [2,head] /dc-dir/dc-file_0 auth v1870 DIRTYPARENT s=1 n(v0 rc2023-10-03T19:17:45.865632+0000 b1 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc940c0100] now 0 2023-10-03T19:21:19.691 INFO:teuthology.orchestra.run.smithi045.stdout: -7774> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 185 ==== osd_op_reply(1799 100000004d0.00000000 [create,setxattr (99),setxattr (30)] v74'29 uv29 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.691 INFO:teuthology.orchestra.run.smithi045.stdout: -7773> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+991 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc940c0100 count now 1/991 2023-10-03T19:21:19.691 INFO:teuthology.orchestra.run.smithi045.stdout: -7772> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000001) clear_dirty_parent 2023-10-03T19:21:19.691 INFO:teuthology.orchestra.run.smithi045.stdout: -7771> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000001f6) _stored_backtrace v 6 2023-10-03T19:21:19.721 INFO:teuthology.orchestra.run.smithi045.stdout: -7770> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000001f6) auth_unpin by 0x55cc940c1700 on [inode 0x100000001f6 [2,head] /dc-dir/dc-file_1 auth v1872 DIRTYPARENT s=1 n(v0 rc2023-10-03T19:17:45.875690+0000 b1 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc940c1700] now 0 2023-10-03T19:21:19.721 INFO:teuthology.orchestra.run.smithi045.stdout: -7769> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 186 ==== osd_op_reply(1809 100000004da.00000000 [create,setxattr (99),setxattr (30)] v74'30 uv30 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.721 INFO:teuthology.orchestra.run.smithi045.stdout: -7768> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+990 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc940c1700 count now 1/990 2023-10-03T19:21:19.722 INFO:teuthology.orchestra.run.smithi045.stdout: -7767> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000001f6) clear_dirty_parent 2023-10-03T19:21:19.722 INFO:teuthology.orchestra.run.smithi045.stdout: -7766> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000001f7) _stored_backtrace v 10 2023-10-03T19:21:19.722 INFO:teuthology.orchestra.run.smithi045.stdout: -7765> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000001f7) auth_unpin by 0x55cc94154000 on [inode 0x100000001f7 [2,head] /dc-dir/dc-file_2 auth v1874 DIRTYPARENT s=1 n(v0 rc2023-10-03T19:17:45.885379+0000 b1 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc94154000] now 0 2023-10-03T19:21:19.722 INFO:teuthology.orchestra.run.smithi045.stdout: -7764> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 187 ==== osd_op_reply(1839 100000004f8.00000000 [create,setxattr (99),setxattr (30)] v74'31 uv31 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.722 INFO:teuthology.orchestra.run.smithi045.stdout: -7763> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+989 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94154000 count now 1/989 2023-10-03T19:21:19.722 INFO:teuthology.orchestra.run.smithi045.stdout: -7762> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000001f7) clear_dirty_parent 2023-10-03T19:21:19.722 INFO:teuthology.orchestra.run.smithi045.stdout: -7761> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000001f8) _stored_backtrace v 14 2023-10-03T19:21:19.722 INFO:teuthology.orchestra.run.smithi045.stdout: -7760> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 188 ==== osd_op_reply(1850 10000000503.00000000 [create,setxattr (99),setxattr (30)] v74'32 uv32 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.722 INFO:teuthology.orchestra.run.smithi045.stdout: -7759> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000001f8) auth_unpin by 0x55cc94154580 on [inode 0x100000001f8 [2,head] /dc-dir/dc-file_3 auth v1876 DIRTYPARENT s=1 n(v0 rc2023-10-03T19:17:45.895404+0000 b1 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc94154580] now 0 2023-10-03T19:21:19.722 INFO:teuthology.orchestra.run.smithi045.stdout: -7758> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+988 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94154580 count now 1/988 2023-10-03T19:21:19.723 INFO:teuthology.orchestra.run.smithi045.stdout: -7757> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000001f8) clear_dirty_parent 2023-10-03T19:21:19.723 INFO:teuthology.orchestra.run.smithi045.stdout: -7756> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000001f9) _stored_backtrace v 18 2023-10-03T19:21:19.723 INFO:teuthology.orchestra.run.smithi045.stdout: -7755> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 189 ==== osd_op_reply(1865 10000000512.00000000 [create,setxattr (99),setxattr (30)] v74'33 uv33 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.723 INFO:teuthology.orchestra.run.smithi045.stdout: -7754> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000001f9) auth_unpin by 0x55cc94154b00 on [inode 0x100000001f9 [2,head] /dc-dir/dc-file_4 auth v1878 DIRTYPARENT s=1 n(v0 rc2023-10-03T19:17:45.905596+0000 b1 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc94154b00] now 0 2023-10-03T19:21:19.723 INFO:teuthology.orchestra.run.smithi045.stdout: -7753> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+987 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94154b00 count now 1/987 2023-10-03T19:21:19.723 INFO:teuthology.orchestra.run.smithi045.stdout: -7752> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000001f9) clear_dirty_parent 2023-10-03T19:21:19.723 INFO:teuthology.orchestra.run.smithi045.stdout: -7751> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000001fa) _stored_backtrace v 22 2023-10-03T19:21:19.723 INFO:teuthology.orchestra.run.smithi045.stdout: -7750> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000001fa) auth_unpin by 0x55cc94155080 on [inode 0x100000001fa [2,head] /dc-dir/dc-file_5 auth v1880 DIRTYPARENT s=1 n(v0 rc2023-10-03T19:17:45.915708+0000 b1 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc94155080] now 0 2023-10-03T19:21:19.723 INFO:teuthology.orchestra.run.smithi045.stdout: -7749> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+986 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94155080 count now 1/986 2023-10-03T19:21:19.723 INFO:teuthology.orchestra.run.smithi045.stdout: -7748> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000001fa) clear_dirty_parent 2023-10-03T19:21:19.724 INFO:teuthology.orchestra.run.smithi045.stdout: -7747> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000001fb) _stored_backtrace v 26 2023-10-03T19:21:19.724 INFO:teuthology.orchestra.run.smithi045.stdout: -7746> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000001fb) auth_unpin by 0x55cc94155600 on [inode 0x100000001fb [2,head] /dc-dir/dc-file_6 auth v1882 DIRTYPARENT s=1 n(v0 rc2023-10-03T19:17:45.925736+0000 b1 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc94155600] now 0 2023-10-03T19:21:19.724 INFO:teuthology.orchestra.run.smithi045.stdout: -7745> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+985 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94155600 count now 1/985 2023-10-03T19:21:19.724 INFO:teuthology.orchestra.run.smithi045.stdout: -7744> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000001fb) clear_dirty_parent 2023-10-03T19:21:19.724 INFO:teuthology.orchestra.run.smithi045.stdout: -7743> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000001fc) _stored_backtrace v 30 2023-10-03T19:21:19.724 INFO:teuthology.orchestra.run.smithi045.stdout: -7742> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000001fc) auth_unpin by 0x55cc94155b80 on [inode 0x100000001fc [2,head] /dc-dir/dc-file_7 auth v1884 DIRTYPARENT s=1 n(v0 rc2023-10-03T19:17:45.935161+0000 b1 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc94155b80] now 0 2023-10-03T19:21:19.724 INFO:teuthology.orchestra.run.smithi045.stdout: -7741> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+984 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94155b80 count now 1/984 2023-10-03T19:21:19.724 INFO:teuthology.orchestra.run.smithi045.stdout: -7740> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000001fc) clear_dirty_parent 2023-10-03T19:21:19.724 INFO:teuthology.orchestra.run.smithi045.stdout: -7739> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000001fd) _stored_backtrace v 34 2023-10-03T19:21:19.724 INFO:teuthology.orchestra.run.smithi045.stdout: -7738> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000001fd) auth_unpin by 0x55cc94156100 on [inode 0x100000001fd [2,head] /dc-dir/dc-file_8 auth v1886 DIRTYPARENT s=1 n(v0 rc2023-10-03T19:17:45.945163+0000 b1 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc94156100] now 0 2023-10-03T19:21:19.724 INFO:teuthology.orchestra.run.smithi045.stdout: -7737> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+983 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94156100 count now 1/983 2023-10-03T19:21:19.724 INFO:teuthology.orchestra.run.smithi045.stdout: -7736> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000001fd) clear_dirty_parent 2023-10-03T19:21:19.725 INFO:teuthology.orchestra.run.smithi045.stdout: -7735> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000001fe) _stored_backtrace v 38 2023-10-03T19:21:19.725 INFO:teuthology.orchestra.run.smithi045.stdout: -7734> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000001fe) auth_unpin by 0x55cc94156680 on [inode 0x100000001fe [2,head] /dc-dir/dc-file_9 auth v1888 DIRTYPARENT s=1 n(v0 rc2023-10-03T19:17:45.955713+0000 b1 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc94156680] now 0 2023-10-03T19:21:19.725 INFO:teuthology.orchestra.run.smithi045.stdout: -7733> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+982 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94156680 count now 1/982 2023-10-03T19:21:19.725 INFO:teuthology.orchestra.run.smithi045.stdout: -7732> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000001fe) clear_dirty_parent 2023-10-03T19:21:19.725 INFO:teuthology.orchestra.run.smithi045.stdout: -7731> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000001ff) _stored_backtrace v 42 2023-10-03T19:21:19.725 INFO:teuthology.orchestra.run.smithi045.stdout: -7730> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000001ff) auth_unpin by 0x55cc94156c00 on [inode 0x100000001ff [2,head] /dc-dir/dc-file_10 auth v1890 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:45.967218+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc94156c00] now 0 2023-10-03T19:21:19.725 INFO:teuthology.orchestra.run.smithi045.stdout: -7729> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+981 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94156c00 count now 1/981 2023-10-03T19:21:19.725 INFO:teuthology.orchestra.run.smithi045.stdout: -7728> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000001ff) clear_dirty_parent 2023-10-03T19:21:19.725 INFO:teuthology.orchestra.run.smithi045.stdout: -7727> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000200) _stored_backtrace v 46 2023-10-03T19:21:19.725 INFO:teuthology.orchestra.run.smithi045.stdout: -7726> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000200) auth_unpin by 0x55cc94157180 on [inode 0x10000000200 [2,head] /dc-dir/dc-file_11 auth v1892 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:45.978307+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc94157180] now 0 2023-10-03T19:21:19.725 INFO:teuthology.orchestra.run.smithi045.stdout: -7725> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+980 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94157180 count now 1/980 2023-10-03T19:21:19.725 INFO:teuthology.orchestra.run.smithi045.stdout: -7724> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000200) clear_dirty_parent 2023-10-03T19:21:19.726 INFO:teuthology.orchestra.run.smithi045.stdout: -7723> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000201) _stored_backtrace v 50 2023-10-03T19:21:19.726 INFO:teuthology.orchestra.run.smithi045.stdout: -7722> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000201) auth_unpin by 0x55cc94157700 on [inode 0x10000000201 [2,head] /dc-dir/dc-file_12 auth v1894 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:45.988809+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc94157700] now 0 2023-10-03T19:21:19.726 INFO:teuthology.orchestra.run.smithi045.stdout: -7721> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+979 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94157700 count now 1/979 2023-10-03T19:21:19.726 INFO:teuthology.orchestra.run.smithi045.stdout: -7720> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000201) clear_dirty_parent 2023-10-03T19:21:19.726 INFO:teuthology.orchestra.run.smithi045.stdout: -7719> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000202) _stored_backtrace v 54 2023-10-03T19:21:19.726 INFO:teuthology.orchestra.run.smithi045.stdout: -7718> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000202) auth_unpin by 0x55cc9418a000 on [inode 0x10000000202 [2,head] /dc-dir/dc-file_13 auth v1896 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:45.998891+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc9418a000] now 0 2023-10-03T19:21:19.726 INFO:teuthology.orchestra.run.smithi045.stdout: -7717> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+978 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9418a000 count now 1/978 2023-10-03T19:21:19.726 INFO:teuthology.orchestra.run.smithi045.stdout: -7716> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000202) clear_dirty_parent 2023-10-03T19:21:19.726 INFO:teuthology.orchestra.run.smithi045.stdout: -7715> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000203) _stored_backtrace v 58 2023-10-03T19:21:19.726 INFO:teuthology.orchestra.run.smithi045.stdout: -7714> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000203) auth_unpin by 0x55cc9418a580 on [inode 0x10000000203 [2,head] /dc-dir/dc-file_14 auth v1898 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.008578+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc9418a580] now 0 2023-10-03T19:21:19.727 INFO:teuthology.orchestra.run.smithi045.stdout: -7713> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+977 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9418a580 count now 1/977 2023-10-03T19:21:19.727 INFO:teuthology.orchestra.run.smithi045.stdout: -7712> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000203) clear_dirty_parent 2023-10-03T19:21:19.727 INFO:teuthology.orchestra.run.smithi045.stdout: -7711> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000204) _stored_backtrace v 62 2023-10-03T19:21:19.727 INFO:teuthology.orchestra.run.smithi045.stdout: -7710> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000204) auth_unpin by 0x55cc9418ab00 on [inode 0x10000000204 [2,head] /dc-dir/dc-file_15 auth v1900 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.019694+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc9418ab00] now 0 2023-10-03T19:21:19.727 INFO:teuthology.orchestra.run.smithi045.stdout: -7709> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+976 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9418ab00 count now 1/976 2023-10-03T19:21:19.727 INFO:teuthology.orchestra.run.smithi045.stdout: -7708> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000204) clear_dirty_parent 2023-10-03T19:21:19.727 INFO:teuthology.orchestra.run.smithi045.stdout: -7707> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000205) _stored_backtrace v 66 2023-10-03T19:21:19.727 INFO:teuthology.orchestra.run.smithi045.stdout: -7706> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000205) auth_unpin by 0x55cc9418b080 on [inode 0x10000000205 [2,head] /dc-dir/dc-file_16 auth v1902 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.031830+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc9418b080] now 0 2023-10-03T19:21:19.727 INFO:teuthology.orchestra.run.smithi045.stdout: -7705> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+975 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9418b080 count now 1/975 2023-10-03T19:21:19.727 INFO:teuthology.orchestra.run.smithi045.stdout: -7704> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000205) clear_dirty_parent 2023-10-03T19:21:19.727 INFO:teuthology.orchestra.run.smithi045.stdout: -7703> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000206) _stored_backtrace v 70 2023-10-03T19:21:19.728 INFO:teuthology.orchestra.run.smithi045.stdout: -7702> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000206) auth_unpin by 0x55cc9418b600 on [inode 0x10000000206 [2,head] /dc-dir/dc-file_17 auth v1904 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.041293+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc9418b600] now 0 2023-10-03T19:21:19.728 INFO:teuthology.orchestra.run.smithi045.stdout: -7701> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+974 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9418b600 count now 1/974 2023-10-03T19:21:19.728 INFO:teuthology.orchestra.run.smithi045.stdout: -7700> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000206) clear_dirty_parent 2023-10-03T19:21:19.728 INFO:teuthology.orchestra.run.smithi045.stdout: -7699> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000207) _stored_backtrace v 74 2023-10-03T19:21:19.728 INFO:teuthology.orchestra.run.smithi045.stdout: -7698> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000207) auth_unpin by 0x55cc9418bb80 on [inode 0x10000000207 [2,head] /dc-dir/dc-file_18 auth v1906 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.052501+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc9418bb80] now 0 2023-10-03T19:21:19.728 INFO:teuthology.orchestra.run.smithi045.stdout: -7697> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+973 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9418bb80 count now 1/973 2023-10-03T19:21:19.728 INFO:teuthology.orchestra.run.smithi045.stdout: -7696> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000207) clear_dirty_parent 2023-10-03T19:21:19.728 INFO:teuthology.orchestra.run.smithi045.stdout: -7695> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000208) _stored_backtrace v 78 2023-10-03T19:21:19.728 INFO:teuthology.orchestra.run.smithi045.stdout: -7694> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000208) auth_unpin by 0x55cc9418c100 on [inode 0x10000000208 [2,head] /dc-dir/dc-file_19 auth v1908 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.062936+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc9418c100] now 0 2023-10-03T19:21:19.728 INFO:teuthology.orchestra.run.smithi045.stdout: -7693> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+972 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9418c100 count now 1/972 2023-10-03T19:21:19.728 INFO:teuthology.orchestra.run.smithi045.stdout: -7692> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000208) clear_dirty_parent 2023-10-03T19:21:19.728 INFO:teuthology.orchestra.run.smithi045.stdout: -7691> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000209) _stored_backtrace v 82 2023-10-03T19:21:19.729 INFO:teuthology.orchestra.run.smithi045.stdout: -7690> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000209) auth_unpin by 0x55cc9418c680 on [inode 0x10000000209 [2,head] /dc-dir/dc-file_20 auth v2236 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.073109+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc9418c680] now 0 2023-10-03T19:21:19.729 INFO:teuthology.orchestra.run.smithi045.stdout: -7689> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+971 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9418c680 count now 1/971 2023-10-03T19:21:19.729 INFO:teuthology.orchestra.run.smithi045.stdout: -7688> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000209) clear_dirty_parent 2023-10-03T19:21:19.729 INFO:teuthology.orchestra.run.smithi045.stdout: -7687> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000020a) _stored_backtrace v 86 2023-10-03T19:21:19.729 INFO:teuthology.orchestra.run.smithi045.stdout: -7686> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000020a) auth_unpin by 0x55cc9418cc00 on [inode 0x1000000020a [2,head] /dc-dir/dc-file_21 auth v2238 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.083619+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc9418cc00] now 0 2023-10-03T19:21:19.729 INFO:teuthology.orchestra.run.smithi045.stdout: -7685> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+970 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9418cc00 count now 1/970 2023-10-03T19:21:19.729 INFO:teuthology.orchestra.run.smithi045.stdout: -7684> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000020a) clear_dirty_parent 2023-10-03T19:21:19.821 INFO:teuthology.orchestra.run.smithi045.stdout: -7683> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000020b) _stored_backtrace v 90 2023-10-03T19:21:19.821 INFO:teuthology.orchestra.run.smithi045.stdout: -7682> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000020b) auth_unpin by 0x55cc9418d180 on [inode 0x1000000020b [2,head] /dc-dir/dc-file_22 auth v2240 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.093951+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc9418d180] now 0 2023-10-03T19:21:19.821 INFO:teuthology.orchestra.run.smithi045.stdout: -7681> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+969 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9418d180 count now 1/969 2023-10-03T19:21:19.821 INFO:teuthology.orchestra.run.smithi045.stdout: -7680> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000020b) clear_dirty_parent 2023-10-03T19:21:19.821 INFO:teuthology.orchestra.run.smithi045.stdout: -7679> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000020c) _stored_backtrace v 94 2023-10-03T19:21:19.821 INFO:teuthology.orchestra.run.smithi045.stdout: -7678> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000020c) auth_unpin by 0x55cc9418d700 on [inode 0x1000000020c [2,head] /dc-dir/dc-file_23 auth v2242 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.105362+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc9418d700] now 0 2023-10-03T19:21:19.821 INFO:teuthology.orchestra.run.smithi045.stdout: -7677> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+968 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9418d700 count now 1/968 2023-10-03T19:21:19.822 INFO:teuthology.orchestra.run.smithi045.stdout: -7676> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000020c) clear_dirty_parent 2023-10-03T19:21:19.822 INFO:teuthology.orchestra.run.smithi045.stdout: -7675> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000020d) _stored_backtrace v 98 2023-10-03T19:21:19.822 INFO:teuthology.orchestra.run.smithi045.stdout: -7674> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000020d) auth_unpin by 0x55cc94198000 on [inode 0x1000000020d [2,head] /dc-dir/dc-file_24 auth v2244 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.115307+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc94198000] now 0 2023-10-03T19:21:19.822 INFO:teuthology.orchestra.run.smithi045.stdout: -7673> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+967 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94198000 count now 1/967 2023-10-03T19:21:19.822 INFO:teuthology.orchestra.run.smithi045.stdout: -7672> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000020d) clear_dirty_parent 2023-10-03T19:21:19.822 INFO:teuthology.orchestra.run.smithi045.stdout: -7671> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000020e) _stored_backtrace v 102 2023-10-03T19:21:19.822 INFO:teuthology.orchestra.run.smithi045.stdout: -7670> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000020e) auth_unpin by 0x55cc94198580 on [inode 0x1000000020e [2,head] /dc-dir/dc-file_25 auth v2246 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.125341+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc94198580] now 0 2023-10-03T19:21:19.822 INFO:teuthology.orchestra.run.smithi045.stdout: -7669> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+966 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94198580 count now 1/966 2023-10-03T19:21:19.823 INFO:teuthology.orchestra.run.smithi045.stdout: -7668> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000020e) clear_dirty_parent 2023-10-03T19:21:19.823 INFO:teuthology.orchestra.run.smithi045.stdout: -7667> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000020f) _stored_backtrace v 106 2023-10-03T19:21:19.823 INFO:teuthology.orchestra.run.smithi045.stdout: -7666> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000020f) auth_unpin by 0x55cc94198b00 on [inode 0x1000000020f [2,head] /dc-dir/dc-file_26 auth v2248 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.135554+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc94198b00] now 0 2023-10-03T19:21:19.823 INFO:teuthology.orchestra.run.smithi045.stdout: -7665> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+965 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94198b00 count now 1/965 2023-10-03T19:21:19.823 INFO:teuthology.orchestra.run.smithi045.stdout: -7664> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000020f) clear_dirty_parent 2023-10-03T19:21:19.823 INFO:teuthology.orchestra.run.smithi045.stdout: -7663> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000210) _stored_backtrace v 110 2023-10-03T19:21:19.823 INFO:teuthology.orchestra.run.smithi045.stdout: -7662> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000210) auth_unpin by 0x55cc94199080 on [inode 0x10000000210 [2,head] /dc-dir/dc-file_27 auth v2250 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.146117+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc94199080] now 0 2023-10-03T19:21:19.823 INFO:teuthology.orchestra.run.smithi045.stdout: -7661> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+964 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94199080 count now 1/964 2023-10-03T19:21:19.823 INFO:teuthology.orchestra.run.smithi045.stdout: -7660> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000210) clear_dirty_parent 2023-10-03T19:21:19.823 INFO:teuthology.orchestra.run.smithi045.stdout: -7659> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000211) _stored_backtrace v 114 2023-10-03T19:21:19.824 INFO:teuthology.orchestra.run.smithi045.stdout: -7658> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000211) auth_unpin by 0x55cc94199600 on [inode 0x10000000211 [2,head] /dc-dir/dc-file_28 auth v2252 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.156301+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc94199600] now 0 2023-10-03T19:21:19.824 INFO:teuthology.orchestra.run.smithi045.stdout: -7657> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+963 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94199600 count now 1/963 2023-10-03T19:21:19.824 INFO:teuthology.orchestra.run.smithi045.stdout: -7656> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000211) clear_dirty_parent 2023-10-03T19:21:19.824 INFO:teuthology.orchestra.run.smithi045.stdout: -7655> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000212) _stored_backtrace v 118 2023-10-03T19:21:19.824 INFO:teuthology.orchestra.run.smithi045.stdout: -7654> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000212) auth_unpin by 0x55cc94199b80 on [inode 0x10000000212 [2,head] /dc-dir/dc-file_29 auth v2254 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.166044+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc94199b80] now 0 2023-10-03T19:21:19.824 INFO:teuthology.orchestra.run.smithi045.stdout: -7653> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+962 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94199b80 count now 1/962 2023-10-03T19:21:19.824 INFO:teuthology.orchestra.run.smithi045.stdout: -7652> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000212) clear_dirty_parent 2023-10-03T19:21:19.824 INFO:teuthology.orchestra.run.smithi045.stdout: -7651> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000213) _stored_backtrace v 122 2023-10-03T19:21:19.824 INFO:teuthology.orchestra.run.smithi045.stdout: -7650> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000213) auth_unpin by 0x55cc9419a100 on [inode 0x10000000213 [2,head] /dc-dir/dc-file_30 auth v2256 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.176189+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc9419a100] now 0 2023-10-03T19:21:19.824 INFO:teuthology.orchestra.run.smithi045.stdout: -7649> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+961 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9419a100 count now 1/961 2023-10-03T19:21:19.825 INFO:teuthology.orchestra.run.smithi045.stdout: -7648> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000213) clear_dirty_parent 2023-10-03T19:21:19.825 INFO:teuthology.orchestra.run.smithi045.stdout: -7647> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000214) _stored_backtrace v 126 2023-10-03T19:21:19.825 INFO:teuthology.orchestra.run.smithi045.stdout: -7646> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000214) auth_unpin by 0x55cc9419a680 on [inode 0x10000000214 [2,head] /dc-dir/dc-file_31 auth v2258 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.187400+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc9419a680] now 0 2023-10-03T19:21:19.825 INFO:teuthology.orchestra.run.smithi045.stdout: -7645> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+960 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9419a680 count now 1/960 2023-10-03T19:21:19.825 INFO:teuthology.orchestra.run.smithi045.stdout: -7644> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000214) clear_dirty_parent 2023-10-03T19:21:19.825 INFO:teuthology.orchestra.run.smithi045.stdout: -7643> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000215) _stored_backtrace v 130 2023-10-03T19:21:19.825 INFO:teuthology.orchestra.run.smithi045.stdout: -7642> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000215) auth_unpin by 0x55cc9419ac00 on [inode 0x10000000215 [2,head] /dc-dir/dc-file_32 auth v2260 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.199264+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc9419ac00] now 0 2023-10-03T19:21:19.825 INFO:teuthology.orchestra.run.smithi045.stdout: -7641> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+959 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9419ac00 count now 1/959 2023-10-03T19:21:19.825 INFO:teuthology.orchestra.run.smithi045.stdout: -7640> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000215) clear_dirty_parent 2023-10-03T19:21:19.825 INFO:teuthology.orchestra.run.smithi045.stdout: -7639> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000216) _stored_backtrace v 134 2023-10-03T19:21:19.825 INFO:teuthology.orchestra.run.smithi045.stdout: -7638> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000216) auth_unpin by 0x55cc9419b180 on [inode 0x10000000216 [2,head] /dc-dir/dc-file_33 auth v2262 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.210759+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc9419b180] now 0 2023-10-03T19:21:19.825 INFO:teuthology.orchestra.run.smithi045.stdout: -7637> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+958 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9419b180 count now 1/958 2023-10-03T19:21:19.826 INFO:teuthology.orchestra.run.smithi045.stdout: -7636> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000216) clear_dirty_parent 2023-10-03T19:21:19.826 INFO:teuthology.orchestra.run.smithi045.stdout: -7635> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000217) _stored_backtrace v 138 2023-10-03T19:21:19.826 INFO:teuthology.orchestra.run.smithi045.stdout: -7634> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000217) auth_unpin by 0x55cc9419b700 on [inode 0x10000000217 [2,head] /dc-dir/dc-file_34 auth v2264 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.222505+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc9419b700] now 0 2023-10-03T19:21:19.826 INFO:teuthology.orchestra.run.smithi045.stdout: -7633> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+957 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9419b700 count now 1/957 2023-10-03T19:21:19.826 INFO:teuthology.orchestra.run.smithi045.stdout: -7632> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000217) clear_dirty_parent 2023-10-03T19:21:19.826 INFO:teuthology.orchestra.run.smithi045.stdout: -7631> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000218) _stored_backtrace v 142 2023-10-03T19:21:19.826 INFO:teuthology.orchestra.run.smithi045.stdout: -7630> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 190 ==== osd_op_reply(1877 1000000051e.00000000 [create,setxattr (99),setxattr (30)] v74'34 uv34 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.826 INFO:teuthology.orchestra.run.smithi045.stdout: -7629> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000218) auth_unpin by 0x55cc941aa000 on [inode 0x10000000218 [2,head] /dc-dir/dc-file_35 auth v2266 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.232329+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941aa000] now 0 2023-10-03T19:21:19.826 INFO:teuthology.orchestra.run.smithi045.stdout: -7628> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+956 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941aa000 count now 1/956 2023-10-03T19:21:19.826 INFO:teuthology.orchestra.run.smithi045.stdout: -7627> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000218) clear_dirty_parent 2023-10-03T19:21:19.826 INFO:teuthology.orchestra.run.smithi045.stdout: -7626> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000219) _stored_backtrace v 146 2023-10-03T19:21:19.827 INFO:teuthology.orchestra.run.smithi045.stdout: -7625> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000219) auth_unpin by 0x55cc941aa580 on [inode 0x10000000219 [2,head] /dc-dir/dc-file_36 auth v2268 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.243662+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941aa580] now 0 2023-10-03T19:21:19.827 INFO:teuthology.orchestra.run.smithi045.stdout: -7624> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 191 ==== osd_op_reply(1934 10000000556.00000000 [create,setxattr (99),setxattr (30)] v74'28 uv28 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.827 INFO:teuthology.orchestra.run.smithi045.stdout: -7623> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+955 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941aa580 count now 1/955 2023-10-03T19:21:19.827 INFO:teuthology.orchestra.run.smithi045.stdout: -7622> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000219) clear_dirty_parent 2023-10-03T19:21:19.827 INFO:teuthology.orchestra.run.smithi045.stdout: -7621> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000021a) _stored_backtrace v 150 2023-10-03T19:21:19.827 INFO:teuthology.orchestra.run.smithi045.stdout: -7620> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000021a) auth_unpin by 0x55cc941aab00 on [inode 0x1000000021a [2,head] /dc-dir/dc-file_37 auth v2270 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.254441+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941aab00] now 0 2023-10-03T19:21:19.827 INFO:teuthology.orchestra.run.smithi045.stdout: -7619> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 192 ==== osd_op_reply(1985 10000000589.00000000 [create,setxattr (99),setxattr (30)] v74'29 uv29 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.827 INFO:teuthology.orchestra.run.smithi045.stdout: -7618> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+954 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941aab00 count now 1/954 2023-10-03T19:21:19.827 INFO:teuthology.orchestra.run.smithi045.stdout: -7617> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000021a) clear_dirty_parent 2023-10-03T19:21:19.827 INFO:teuthology.orchestra.run.smithi045.stdout: -7616> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000021b) _stored_backtrace v 154 2023-10-03T19:21:19.828 INFO:teuthology.orchestra.run.smithi045.stdout: -7615> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000021b) auth_unpin by 0x55cc941ab080 on [inode 0x1000000021b [2,head] /dc-dir/dc-file_38 auth v2272 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.264028+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941ab080] now 0 2023-10-03T19:21:19.828 INFO:teuthology.orchestra.run.smithi045.stdout: -7614> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 193 ==== osd_op_reply(2007 1000000059f.00000000 [create,setxattr (99),setxattr (30)] v74'35 uv35 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.828 INFO:teuthology.orchestra.run.smithi045.stdout: -7613> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+953 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941ab080 count now 1/953 2023-10-03T19:21:19.828 INFO:teuthology.orchestra.run.smithi045.stdout: -7612> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000021b) clear_dirty_parent 2023-10-03T19:21:19.828 INFO:teuthology.orchestra.run.smithi045.stdout: -7611> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000021c) _stored_backtrace v 158 2023-10-03T19:21:19.828 INFO:teuthology.orchestra.run.smithi045.stdout: -7610> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000021c) auth_unpin by 0x55cc941ab600 on [inode 0x1000000021c [2,head] /dc-dir/dc-file_39 auth v2274 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.273748+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941ab600] now 0 2023-10-03T19:21:19.828 INFO:teuthology.orchestra.run.smithi045.stdout: -7609> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+952 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941ab600 count now 1/952 2023-10-03T19:21:19.828 INFO:teuthology.orchestra.run.smithi045.stdout: -7608> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 194 ==== osd_op_reply(2065 100000005d9.00000000 [create,setxattr (99),setxattr (30)] v74'30 uv30 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.828 INFO:teuthology.orchestra.run.smithi045.stdout: -7607> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000021c) clear_dirty_parent 2023-10-03T19:21:19.828 INFO:teuthology.orchestra.run.smithi045.stdout: -7606> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000021d) _stored_backtrace v 162 2023-10-03T19:21:19.828 INFO:teuthology.orchestra.run.smithi045.stdout: -7605> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000021d) auth_unpin by 0x55cc941abb80 on [inode 0x1000000021d [2,head] /dc-dir/dc-file_40 auth v2276 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.284151+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941abb80] now 0 2023-10-03T19:21:19.836 INFO:teuthology.orchestra.run.smithi045.stdout: -7604> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+951 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941abb80 count now 1/951 2023-10-03T19:21:19.836 INFO:teuthology.orchestra.run.smithi045.stdout: -7603> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000021d) clear_dirty_parent 2023-10-03T19:21:19.836 INFO:teuthology.orchestra.run.smithi045.stdout: -7602> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000021e) _stored_backtrace v 166 2023-10-03T19:21:19.836 INFO:teuthology.orchestra.run.smithi045.stdout: -7601> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000021e) auth_unpin by 0x55cc941ac100 on [inode 0x1000000021e [2,head] /dc-dir/dc-file_41 auth v2278 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.294460+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941ac100] now 0 2023-10-03T19:21:19.837 INFO:teuthology.orchestra.run.smithi045.stdout: -7600> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 195 ==== osd_op_reply(2026 100000005b2.00000000 [create,setxattr (99),setxattr (30)] v74'36 uv36 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.837 INFO:teuthology.orchestra.run.smithi045.stdout: -7599> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+950 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941ac100 count now 1/950 2023-10-03T19:21:19.837 INFO:teuthology.orchestra.run.smithi045.stdout: -7598> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000021e) clear_dirty_parent 2023-10-03T19:21:19.837 INFO:teuthology.orchestra.run.smithi045.stdout: -7597> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000021f) _stored_backtrace v 170 2023-10-03T19:21:19.837 INFO:teuthology.orchestra.run.smithi045.stdout: -7596> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000021f) auth_unpin by 0x55cc941ac680 on [inode 0x1000000021f [2,head] /dc-dir/dc-file_42 auth v2280 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.304529+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941ac680] now 0 2023-10-03T19:21:19.837 INFO:teuthology.orchestra.run.smithi045.stdout: -7595> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+949 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941ac680 count now 1/949 2023-10-03T19:21:19.837 INFO:teuthology.orchestra.run.smithi045.stdout: -7594> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000021f) clear_dirty_parent 2023-10-03T19:21:19.837 INFO:teuthology.orchestra.run.smithi045.stdout: -7593> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000220) _stored_backtrace v 174 2023-10-03T19:21:19.837 INFO:teuthology.orchestra.run.smithi045.stdout: -7592> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000220) auth_unpin by 0x55cc941acc00 on [inode 0x10000000220 [2,head] /dc-dir/dc-file_43 auth v2282 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.315093+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941acc00] now 0 2023-10-03T19:21:19.837 INFO:teuthology.orchestra.run.smithi045.stdout: -7591> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+948 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941acc00 count now 1/948 2023-10-03T19:21:19.837 INFO:teuthology.orchestra.run.smithi045.stdout: -7590> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000220) clear_dirty_parent 2023-10-03T19:21:19.838 INFO:teuthology.orchestra.run.smithi045.stdout: -7589> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000221) _stored_backtrace v 178 2023-10-03T19:21:19.838 INFO:teuthology.orchestra.run.smithi045.stdout: -7588> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000221) auth_unpin by 0x55cc941ad180 on [inode 0x10000000221 [2,head] /dc-dir/dc-file_44 auth v2284 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.325183+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941ad180] now 0 2023-10-03T19:21:19.838 INFO:teuthology.orchestra.run.smithi045.stdout: -7587> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+947 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941ad180 count now 1/947 2023-10-03T19:21:19.838 INFO:teuthology.orchestra.run.smithi045.stdout: -7586> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000221) clear_dirty_parent 2023-10-03T19:21:19.838 INFO:teuthology.orchestra.run.smithi045.stdout: -7585> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000222) _stored_backtrace v 182 2023-10-03T19:21:19.838 INFO:teuthology.orchestra.run.smithi045.stdout: -7584> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000222) auth_unpin by 0x55cc941ad700 on [inode 0x10000000222 [2,head] /dc-dir/dc-file_45 auth v2286 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.335520+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941ad700] now 0 2023-10-03T19:21:19.838 INFO:teuthology.orchestra.run.smithi045.stdout: -7583> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+946 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941ad700 count now 1/946 2023-10-03T19:21:19.838 INFO:teuthology.orchestra.run.smithi045.stdout: -7582> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000222) clear_dirty_parent 2023-10-03T19:21:19.838 INFO:teuthology.orchestra.run.smithi045.stdout: -7581> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000223) _stored_backtrace v 186 2023-10-03T19:21:19.838 INFO:teuthology.orchestra.run.smithi045.stdout: -7580> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000223) auth_unpin by 0x55cc941b4000 on [inode 0x10000000223 [2,head] /dc-dir/dc-file_46 auth v2288 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.345986+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941b4000] now 0 2023-10-03T19:21:19.839 INFO:teuthology.orchestra.run.smithi045.stdout: -7579> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 125 ==== osd_op_reply(1633 1000000042a.00000000 [create,setxattr (99),setxattr (30)] v74'37 uv37 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.839 INFO:teuthology.orchestra.run.smithi045.stdout: -7578> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+945 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941b4000 count now 1/945 2023-10-03T19:21:19.839 INFO:teuthology.orchestra.run.smithi045.stdout: -7577> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000223) clear_dirty_parent 2023-10-03T19:21:19.839 INFO:teuthology.orchestra.run.smithi045.stdout: -7576> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000224) _stored_backtrace v 190 2023-10-03T19:21:19.839 INFO:teuthology.orchestra.run.smithi045.stdout: -7575> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000224) auth_unpin by 0x55cc941b4580 on [inode 0x10000000224 [2,head] /dc-dir/dc-file_47 auth v2290 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.356255+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941b4580] now 0 2023-10-03T19:21:19.839 INFO:teuthology.orchestra.run.smithi045.stdout: -7574> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+944 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941b4580 count now 1/944 2023-10-03T19:21:19.839 INFO:teuthology.orchestra.run.smithi045.stdout: -7573> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000224) clear_dirty_parent 2023-10-03T19:21:19.839 INFO:teuthology.orchestra.run.smithi045.stdout: -7572> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000225) _stored_backtrace v 194 2023-10-03T19:21:19.839 INFO:teuthology.orchestra.run.smithi045.stdout: -7571> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000225) auth_unpin by 0x55cc941b4b00 on [inode 0x10000000225 [2,head] /dc-dir/dc-file_48 auth v2292 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.367240+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941b4b00] now 0 2023-10-03T19:21:19.839 INFO:teuthology.orchestra.run.smithi045.stdout: -7570> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+943 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941b4b00 count now 1/943 2023-10-03T19:21:19.839 INFO:teuthology.orchestra.run.smithi045.stdout: -7569> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 126 ==== osd_op_reply(1838 100000004f7.00000000 [create,setxattr (99),setxattr (30)] v74'32 uv32 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.840 INFO:teuthology.orchestra.run.smithi045.stdout: -7568> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000225) clear_dirty_parent 2023-10-03T19:21:19.840 INFO:teuthology.orchestra.run.smithi045.stdout: -7567> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000226) _stored_backtrace v 198 2023-10-03T19:21:19.840 INFO:teuthology.orchestra.run.smithi045.stdout: -7566> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000226) auth_unpin by 0x55cc941b5080 on [inode 0x10000000226 [2,head] /dc-dir/dc-file_49 auth v2294 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.378535+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941b5080] now 0 2023-10-03T19:21:19.840 INFO:teuthology.orchestra.run.smithi045.stdout: -7565> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+942 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941b5080 count now 1/942 2023-10-03T19:21:19.840 INFO:teuthology.orchestra.run.smithi045.stdout: -7564> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000226) clear_dirty_parent 2023-10-03T19:21:19.840 INFO:teuthology.orchestra.run.smithi045.stdout: -7563> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000227) _stored_backtrace v 202 2023-10-03T19:21:19.840 INFO:teuthology.orchestra.run.smithi045.stdout: -7562> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000227) auth_unpin by 0x55cc941b5600 on [inode 0x10000000227 [2,head] /dc-dir/dc-file_50 auth v2296 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.388911+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941b5600] now 0 2023-10-03T19:21:19.840 INFO:teuthology.orchestra.run.smithi045.stdout: -7561> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 127 ==== osd_op_reply(1667 1000000044c.00000000 [create,setxattr (99),setxattr (30)] v74'38 uv38 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.840 INFO:teuthology.orchestra.run.smithi045.stdout: -7560> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+941 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941b5600 count now 1/941 2023-10-03T19:21:19.840 INFO:teuthology.orchestra.run.smithi045.stdout: -7559> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000227) clear_dirty_parent 2023-10-03T19:21:19.840 INFO:teuthology.orchestra.run.smithi045.stdout: -7558> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000228) _stored_backtrace v 206 2023-10-03T19:21:19.840 INFO:teuthology.orchestra.run.smithi045.stdout: -7557> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000228) auth_unpin by 0x55cc941b5b80 on [inode 0x10000000228 [2,head] /dc-dir/dc-file_51 auth v2298 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.398965+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941b5b80] now 0 2023-10-03T19:21:19.841 INFO:teuthology.orchestra.run.smithi045.stdout: -7556> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+940 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941b5b80 count now 1/940 2023-10-03T19:21:19.841 INFO:teuthology.orchestra.run.smithi045.stdout: -7555> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000228) clear_dirty_parent 2023-10-03T19:21:19.841 INFO:teuthology.orchestra.run.smithi045.stdout: -7554> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000229) _stored_backtrace v 210 2023-10-03T19:21:19.841 INFO:teuthology.orchestra.run.smithi045.stdout: -7553> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000229) auth_unpin by 0x55cc941b6100 on [inode 0x10000000229 [2,head] /dc-dir/dc-file_52 auth v2300 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.410476+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941b6100] now 0 2023-10-03T19:21:19.841 INFO:teuthology.orchestra.run.smithi045.stdout: -7552> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+939 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941b6100 count now 1/939 2023-10-03T19:21:19.841 INFO:teuthology.orchestra.run.smithi045.stdout: -7551> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000229) clear_dirty_parent 2023-10-03T19:21:19.841 INFO:teuthology.orchestra.run.smithi045.stdout: -7550> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000022a) _stored_backtrace v 214 2023-10-03T19:21:19.841 INFO:teuthology.orchestra.run.smithi045.stdout: -7549> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 128 ==== osd_op_reply(1878 1000000051f.00000000 [create,setxattr (99),setxattr (30)] v74'33 uv33 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.841 INFO:teuthology.orchestra.run.smithi045.stdout: -7548> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000022a) auth_unpin by 0x55cc941b6680 on [inode 0x1000000022a [2,head] /dc-dir/dc-file_53 auth v2302 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.420220+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941b6680] now 0 2023-10-03T19:21:19.841 INFO:teuthology.orchestra.run.smithi045.stdout: -7547> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+938 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941b6680 count now 1/938 2023-10-03T19:21:19.841 INFO:teuthology.orchestra.run.smithi045.stdout: -7546> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000022a) clear_dirty_parent 2023-10-03T19:21:19.842 INFO:teuthology.orchestra.run.smithi045.stdout: -7545> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000022b) _stored_backtrace v 218 2023-10-03T19:21:19.842 INFO:teuthology.orchestra.run.smithi045.stdout: -7544> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000022b) auth_unpin by 0x55cc941b6c00 on [inode 0x1000000022b [2,head] /dc-dir/dc-file_54 auth v2304 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.429989+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941b6c00] now 0 2023-10-03T19:21:19.842 INFO:teuthology.orchestra.run.smithi045.stdout: -7543> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+937 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941b6c00 count now 1/937 2023-10-03T19:21:19.842 INFO:teuthology.orchestra.run.smithi045.stdout: -7542> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000022b) clear_dirty_parent 2023-10-03T19:21:19.842 INFO:teuthology.orchestra.run.smithi045.stdout: -7541> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000022c) _stored_backtrace v 222 2023-10-03T19:21:19.842 INFO:teuthology.orchestra.run.smithi045.stdout: -7540> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 129 ==== osd_op_reply(1707 10000000474.00000000 [create,setxattr (99),setxattr (30)] v74'39 uv39 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.842 INFO:teuthology.orchestra.run.smithi045.stdout: -7539> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000022c) auth_unpin by 0x55cc941b7180 on [inode 0x1000000022c [2,head] /dc-dir/dc-file_55 auth v2306 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.439706+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941b7180] now 0 2023-10-03T19:21:19.842 INFO:teuthology.orchestra.run.smithi045.stdout: -7538> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+936 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941b7180 count now 1/936 2023-10-03T19:21:19.842 INFO:teuthology.orchestra.run.smithi045.stdout: -7537> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000022c) clear_dirty_parent 2023-10-03T19:21:19.842 INFO:teuthology.orchestra.run.smithi045.stdout: -7536> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000022d) _stored_backtrace v 226 2023-10-03T19:21:19.843 INFO:teuthology.orchestra.run.smithi045.stdout: -7535> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000022d) auth_unpin by 0x55cc941b7700 on [inode 0x1000000022d [2,head] /dc-dir/dc-file_56 auth v2308 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.450791+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941b7700] now 0 2023-10-03T19:21:19.843 INFO:teuthology.orchestra.run.smithi045.stdout: -7534> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+935 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941b7700 count now 1/935 2023-10-03T19:21:19.843 INFO:teuthology.orchestra.run.smithi045.stdout: -7533> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000022d) clear_dirty_parent 2023-10-03T19:21:19.843 INFO:teuthology.orchestra.run.smithi045.stdout: -7532> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 130 ==== osd_op_reply(1964 10000000574.00000000 [create,setxattr (99),setxattr (30)] v74'34 uv34 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.843 INFO:teuthology.orchestra.run.smithi045.stdout: -7531> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000022e) _stored_backtrace v 230 2023-10-03T19:21:19.843 INFO:teuthology.orchestra.run.smithi045.stdout: -7530> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000022e) auth_unpin by 0x55cc941d6000 on [inode 0x1000000022e [2,head] /dc-dir/dc-file_57 auth v2310 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.462021+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941d6000] now 0 2023-10-03T19:21:19.843 INFO:teuthology.orchestra.run.smithi045.stdout: -7529> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+934 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941d6000 count now 1/934 2023-10-03T19:21:19.843 INFO:teuthology.orchestra.run.smithi045.stdout: -7528> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000022e) clear_dirty_parent 2023-10-03T19:21:19.843 INFO:teuthology.orchestra.run.smithi045.stdout: -7527> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000022f) _stored_backtrace v 234 2023-10-03T19:21:19.843 INFO:teuthology.orchestra.run.smithi045.stdout: -7526> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000022f) auth_unpin by 0x55cc941d6580 on [inode 0x1000000022f [2,head] /dc-dir/dc-file_58 auth v2312 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.471692+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941d6580] now 0 2023-10-03T19:21:19.843 INFO:teuthology.orchestra.run.smithi045.stdout: -7525> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+933 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941d6580 count now 1/933 2023-10-03T19:21:19.844 INFO:teuthology.orchestra.run.smithi045.stdout: -7524> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 131 ==== osd_op_reply(2013 100000005a5.00000000 [create,setxattr (99),setxattr (30)] v74'40 uv40 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.844 INFO:teuthology.orchestra.run.smithi045.stdout: -7523> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000022f) clear_dirty_parent 2023-10-03T19:21:19.844 INFO:teuthology.orchestra.run.smithi045.stdout: -7522> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000230) _stored_backtrace v 238 2023-10-03T19:21:19.844 INFO:teuthology.orchestra.run.smithi045.stdout: -7521> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000230) auth_unpin by 0x55cc941d6b00 on [inode 0x10000000230 [2,head] /dc-dir/dc-file_59 auth v2314 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.481346+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941d6b00] now 0 2023-10-03T19:21:19.844 INFO:teuthology.orchestra.run.smithi045.stdout: -7520> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+932 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941d6b00 count now 1/932 2023-10-03T19:21:19.877 INFO:teuthology.orchestra.run.smithi045.stdout: -7519> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000230) clear_dirty_parent 2023-10-03T19:21:19.877 INFO:teuthology.orchestra.run.smithi045.stdout: -7518> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000231) _stored_backtrace v 242 2023-10-03T19:21:19.877 INFO:teuthology.orchestra.run.smithi045.stdout: -7517> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000231) auth_unpin by 0x55cc941d7080 on [inode 0x10000000231 [2,head] /dc-dir/dc-file_60 auth v2316 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.491650+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941d7080] now 0 2023-10-03T19:21:19.877 INFO:teuthology.orchestra.run.smithi045.stdout: -7516> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+931 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941d7080 count now 1/931 2023-10-03T19:21:19.877 INFO:teuthology.orchestra.run.smithi045.stdout: -7515> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000231) clear_dirty_parent 2023-10-03T19:21:19.877 INFO:teuthology.orchestra.run.smithi045.stdout: -7514> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000232) _stored_backtrace v 246 2023-10-03T19:21:19.877 INFO:teuthology.orchestra.run.smithi045.stdout: -7513> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 132 ==== osd_op_reply(1991 1000000058f.00000000 [create,setxattr (99),setxattr (30)] v74'35 uv35 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.877 INFO:teuthology.orchestra.run.smithi045.stdout: -7512> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000232) auth_unpin by 0x55cc941d7600 on [inode 0x10000000232 [2,head] /dc-dir/dc-file_61 auth v2318 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.501815+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941d7600] now 0 2023-10-03T19:21:19.877 INFO:teuthology.orchestra.run.smithi045.stdout: -7511> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+930 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941d7600 count now 1/930 2023-10-03T19:21:19.877 INFO:teuthology.orchestra.run.smithi045.stdout: -7510> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000232) clear_dirty_parent 2023-10-03T19:21:19.878 INFO:teuthology.orchestra.run.smithi045.stdout: -7509> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000233) _stored_backtrace v 250 2023-10-03T19:21:19.878 INFO:teuthology.orchestra.run.smithi045.stdout: -7508> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000233) auth_unpin by 0x55cc941d7b80 on [inode 0x10000000233 [2,head] /dc-dir/dc-file_62 auth v2320 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.513190+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941d7b80] now 0 2023-10-03T19:21:19.878 INFO:teuthology.orchestra.run.smithi045.stdout: -7507> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+929 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941d7b80 count now 1/929 2023-10-03T19:21:19.878 INFO:teuthology.orchestra.run.smithi045.stdout: -7506> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000233) clear_dirty_parent 2023-10-03T19:21:19.878 INFO:teuthology.orchestra.run.smithi045.stdout: -7505> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000234) _stored_backtrace v 254 2023-10-03T19:21:19.878 INFO:teuthology.orchestra.run.smithi045.stdout: -7504> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 133 ==== osd_op_reply(2027 100000005b3.00000000 [create,setxattr (99),setxattr (30)] v74'41 uv41 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.878 INFO:teuthology.orchestra.run.smithi045.stdout: -7503> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000234) auth_unpin by 0x55cc941d8100 on [inode 0x10000000234 [2,head] /dc-dir/dc-file_63 auth v2322 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.523862+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941d8100] now 0 2023-10-03T19:21:19.878 INFO:teuthology.orchestra.run.smithi045.stdout: -7502> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+928 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941d8100 count now 1/928 2023-10-03T19:21:19.878 INFO:teuthology.orchestra.run.smithi045.stdout: -7501> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000234) clear_dirty_parent 2023-10-03T19:21:19.878 INFO:teuthology.orchestra.run.smithi045.stdout: -7500> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000235) _stored_backtrace v 258 2023-10-03T19:21:19.878 INFO:teuthology.orchestra.run.smithi045.stdout: -7499> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000235) auth_unpin by 0x55cc941d8680 on [inode 0x10000000235 [2,head] /dc-dir/dc-file_64 auth v2324 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.535182+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941d8680] now 0 2023-10-03T19:21:19.879 INFO:teuthology.orchestra.run.smithi045.stdout: -7498> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 134 ==== osd_op_reply(1999 10000000597.00000000 [create,setxattr (99),setxattr (30)] v74'36 uv36 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.879 INFO:teuthology.orchestra.run.smithi045.stdout: -7497> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+927 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941d8680 count now 1/927 2023-10-03T19:21:19.879 INFO:teuthology.orchestra.run.smithi045.stdout: -7496> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000235) clear_dirty_parent 2023-10-03T19:21:19.879 INFO:teuthology.orchestra.run.smithi045.stdout: -7495> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000236) _stored_backtrace v 262 2023-10-03T19:21:19.879 INFO:teuthology.orchestra.run.smithi045.stdout: -7494> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000236) auth_unpin by 0x55cc941d8c00 on [inode 0x10000000236 [2,head] /dc-dir/dc-file_65 auth v2326 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.546897+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941d8c00] now 0 2023-10-03T19:21:19.879 INFO:teuthology.orchestra.run.smithi045.stdout: -7493> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+926 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941d8c00 count now 1/926 2023-10-03T19:21:19.879 INFO:teuthology.orchestra.run.smithi045.stdout: -7492> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000236) clear_dirty_parent 2023-10-03T19:21:19.879 INFO:teuthology.orchestra.run.smithi045.stdout: -7491> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000237) _stored_backtrace v 266 2023-10-03T19:21:19.879 INFO:teuthology.orchestra.run.smithi045.stdout: -7490> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000237) auth_unpin by 0x55cc941d9180 on [inode 0x10000000237 [2,head] /dc-dir/dc-file_66 auth v2328 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.558452+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941d9180] now 0 2023-10-03T19:21:19.879 INFO:teuthology.orchestra.run.smithi045.stdout: -7489> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+925 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941d9180 count now 1/925 2023-10-03T19:21:19.879 INFO:teuthology.orchestra.run.smithi045.stdout: -7488> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 135 ==== osd_op_reply(2003 1000000059b.00000000 [create,setxattr (99),setxattr (30)] v74'37 uv37 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.880 INFO:teuthology.orchestra.run.smithi045.stdout: -7487> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000237) clear_dirty_parent 2023-10-03T19:21:19.880 INFO:teuthology.orchestra.run.smithi045.stdout: -7486> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000238) _stored_backtrace v 270 2023-10-03T19:21:19.880 INFO:teuthology.orchestra.run.smithi045.stdout: -7485> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000238) auth_unpin by 0x55cc941d9700 on [inode 0x10000000238 [2,head] /dc-dir/dc-file_67 auth v2330 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.568935+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941d9700] now 0 2023-10-03T19:21:19.880 INFO:teuthology.orchestra.run.smithi045.stdout: -7484> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+924 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941d9700 count now 1/924 2023-10-03T19:21:19.880 INFO:teuthology.orchestra.run.smithi045.stdout: -7483> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000238) clear_dirty_parent 2023-10-03T19:21:19.880 INFO:teuthology.orchestra.run.smithi045.stdout: -7482> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000239) _stored_backtrace v 274 2023-10-03T19:21:19.880 INFO:teuthology.orchestra.run.smithi045.stdout: -7481> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000239) auth_unpin by 0x55cc941e2000 on [inode 0x10000000239 [2,head] /dc-dir/dc-file_68 auth v2332 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.580351+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941e2000] now 0 2023-10-03T19:21:19.880 INFO:teuthology.orchestra.run.smithi045.stdout: -7480> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+923 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941e2000 count now 1/923 2023-10-03T19:21:19.880 INFO:teuthology.orchestra.run.smithi045.stdout: -7479> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000239) clear_dirty_parent 2023-10-03T19:21:19.880 INFO:teuthology.orchestra.run.smithi045.stdout: -7478> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000023a) _stored_backtrace v 278 2023-10-03T19:21:19.880 INFO:teuthology.orchestra.run.smithi045.stdout: -7477> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000023a) auth_unpin by 0x55cc941e2580 on [inode 0x1000000023a [2,head] /dc-dir/dc-file_69 auth v2334 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.591614+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941e2580] now 0 2023-10-03T19:21:19.881 INFO:teuthology.orchestra.run.smithi045.stdout: -7476> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+922 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941e2580 count now 1/922 2023-10-03T19:21:19.881 INFO:teuthology.orchestra.run.smithi045.stdout: -7475> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000023a) clear_dirty_parent 2023-10-03T19:21:19.881 INFO:teuthology.orchestra.run.smithi045.stdout: -7474> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000023b) _stored_backtrace v 282 2023-10-03T19:21:19.881 INFO:teuthology.orchestra.run.smithi045.stdout: -7473> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000023b) auth_unpin by 0x55cc941e2b00 on [inode 0x1000000023b [2,head] /dc-dir/dc-file_70 auth v2336 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.602117+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941e2b00] now 0 2023-10-03T19:21:19.881 INFO:teuthology.orchestra.run.smithi045.stdout: -7472> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+921 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941e2b00 count now 1/921 2023-10-03T19:21:19.881 INFO:teuthology.orchestra.run.smithi045.stdout: -7471> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000023b) clear_dirty_parent 2023-10-03T19:21:19.881 INFO:teuthology.orchestra.run.smithi045.stdout: -7470> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000023c) _stored_backtrace v 286 2023-10-03T19:21:19.881 INFO:teuthology.orchestra.run.smithi045.stdout: -7469> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000023c) auth_unpin by 0x55cc941e3080 on [inode 0x1000000023c [2,head] /dc-dir/dc-file_71 auth v2338 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.612432+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941e3080] now 0 2023-10-03T19:21:19.881 INFO:teuthology.orchestra.run.smithi045.stdout: -7468> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 136 ==== osd_op_reply(2062 100000005d6.00000000 [create,setxattr (99),setxattr (30)] v74'42 uv42 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.881 INFO:teuthology.orchestra.run.smithi045.stdout: -7467> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+920 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941e3080 count now 1/920 2023-10-03T19:21:19.881 INFO:teuthology.orchestra.run.smithi045.stdout: -7466> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000023c) clear_dirty_parent 2023-10-03T19:21:19.882 INFO:teuthology.orchestra.run.smithi045.stdout: -7465> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000023d) _stored_backtrace v 290 2023-10-03T19:21:19.882 INFO:teuthology.orchestra.run.smithi045.stdout: -7464> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000023d) auth_unpin by 0x55cc941e3600 on [inode 0x1000000023d [2,head] /dc-dir/dc-file_72 auth v2340 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.623058+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941e3600] now 0 2023-10-03T19:21:19.882 INFO:teuthology.orchestra.run.smithi045.stdout: -7463> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+919 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941e3600 count now 1/919 2023-10-03T19:21:19.882 INFO:teuthology.orchestra.run.smithi045.stdout: -7462> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000023d) clear_dirty_parent 2023-10-03T19:21:19.882 INFO:teuthology.orchestra.run.smithi045.stdout: -7461> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000023e) _stored_backtrace v 294 2023-10-03T19:21:19.882 INFO:teuthology.orchestra.run.smithi045.stdout: -7460> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 137 ==== osd_op_reply(2036 100000005bc.00000000 [create,setxattr (99),setxattr (30)] v74'38 uv38 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:19.882 INFO:teuthology.orchestra.run.smithi045.stdout: -7459> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000023e) auth_unpin by 0x55cc941e3b80 on [inode 0x1000000023e [2,head] /dc-dir/dc-file_73 auth v2342 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.633217+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941e3b80] now 0 2023-10-03T19:21:19.882 INFO:teuthology.orchestra.run.smithi045.stdout: -7458> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+918 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941e3b80 count now 1/918 2023-10-03T19:21:19.882 INFO:teuthology.orchestra.run.smithi045.stdout: -7457> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000023e) clear_dirty_parent 2023-10-03T19:21:19.896 INFO:teuthology.orchestra.run.smithi045.stdout: -7456> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000023f) _stored_backtrace v 298 2023-10-03T19:21:19.896 INFO:teuthology.orchestra.run.smithi045.stdout: -7455> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000023f) auth_unpin by 0x55cc941e4100 on [inode 0x1000000023f [2,head] /dc-dir/dc-file_74 auth v2344 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.643478+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941e4100] now 0 2023-10-03T19:21:19.897 INFO:teuthology.orchestra.run.smithi045.stdout: -7454> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+917 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941e4100 count now 1/917 2023-10-03T19:21:19.897 INFO:teuthology.orchestra.run.smithi045.stdout: -7453> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000023f) clear_dirty_parent 2023-10-03T19:21:19.897 INFO:teuthology.orchestra.run.smithi045.stdout: -7452> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000240) _stored_backtrace v 302 2023-10-03T19:21:19.897 INFO:teuthology.orchestra.run.smithi045.stdout: -7451> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000240) auth_unpin by 0x55cc941e4680 on [inode 0x10000000240 [2,head] /dc-dir/dc-file_75 auth v2346 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.653998+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941e4680] now 0 2023-10-03T19:21:19.897 INFO:teuthology.orchestra.run.smithi045.stdout: -7450> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+916 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941e4680 count now 1/916 2023-10-03T19:21:19.897 INFO:teuthology.orchestra.run.smithi045.stdout: -7449> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000240) clear_dirty_parent 2023-10-03T19:21:19.897 INFO:teuthology.orchestra.run.smithi045.stdout: -7448> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000241) _stored_backtrace v 306 2023-10-03T19:21:19.897 INFO:teuthology.orchestra.run.smithi045.stdout: -7447> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000241) auth_unpin by 0x55cc941e4c00 on [inode 0x10000000241 [2,head] /dc-dir/dc-file_76 auth v2348 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.663411+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941e4c00] now 0 2023-10-03T19:21:19.897 INFO:teuthology.orchestra.run.smithi045.stdout: -7446> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+915 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941e4c00 count now 1/915 2023-10-03T19:21:19.897 INFO:teuthology.orchestra.run.smithi045.stdout: -7445> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000241) clear_dirty_parent 2023-10-03T19:21:19.897 INFO:teuthology.orchestra.run.smithi045.stdout: -7444> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000242) _stored_backtrace v 310 2023-10-03T19:21:19.898 INFO:teuthology.orchestra.run.smithi045.stdout: -7443> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000242) auth_unpin by 0x55cc941e5180 on [inode 0x10000000242 [2,head] /dc-dir/dc-file_77 auth v2350 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.673440+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941e5180] now 0 2023-10-03T19:21:19.898 INFO:teuthology.orchestra.run.smithi045.stdout: -7442> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+914 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941e5180 count now 1/914 2023-10-03T19:21:19.898 INFO:teuthology.orchestra.run.smithi045.stdout: -7441> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000242) clear_dirty_parent 2023-10-03T19:21:19.898 INFO:teuthology.orchestra.run.smithi045.stdout: -7440> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000243) _stored_backtrace v 314 2023-10-03T19:21:19.898 INFO:teuthology.orchestra.run.smithi045.stdout: -7439> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000243) auth_unpin by 0x55cc941e5700 on [inode 0x10000000243 [2,head] /dc-dir/dc-file_78 auth v2352 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.683580+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941e5700] now 0 2023-10-03T19:21:19.898 INFO:teuthology.orchestra.run.smithi045.stdout: -7438> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+913 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941e5700 count now 1/913 2023-10-03T19:21:19.898 INFO:teuthology.orchestra.run.smithi045.stdout: -7437> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000243) clear_dirty_parent 2023-10-03T19:21:19.898 INFO:teuthology.orchestra.run.smithi045.stdout: -7436> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000244) _stored_backtrace v 318 2023-10-03T19:21:19.898 INFO:teuthology.orchestra.run.smithi045.stdout: -7435> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000244) auth_unpin by 0x55cc941ee000 on [inode 0x10000000244 [2,head] /dc-dir/dc-file_79 auth v2354 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.693622+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941ee000] now 0 2023-10-03T19:21:19.898 INFO:teuthology.orchestra.run.smithi045.stdout: -7434> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+912 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941ee000 count now 1/912 2023-10-03T19:21:19.898 INFO:teuthology.orchestra.run.smithi045.stdout: -7433> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000244) clear_dirty_parent 2023-10-03T19:21:19.899 INFO:teuthology.orchestra.run.smithi045.stdout: -7432> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000245) _stored_backtrace v 322 2023-10-03T19:21:19.899 INFO:teuthology.orchestra.run.smithi045.stdout: -7431> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000245) auth_unpin by 0x55cc941ee580 on [inode 0x10000000245 [2,head] /dc-dir/dc-file_80 auth v2356 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.704334+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941ee580] now 0 2023-10-03T19:21:19.899 INFO:teuthology.orchestra.run.smithi045.stdout: -7430> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+911 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941ee580 count now 1/911 2023-10-03T19:21:19.899 INFO:teuthology.orchestra.run.smithi045.stdout: -7429> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000245) clear_dirty_parent 2023-10-03T19:21:19.899 INFO:teuthology.orchestra.run.smithi045.stdout: -7428> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000246) _stored_backtrace v 326 2023-10-03T19:21:19.899 INFO:teuthology.orchestra.run.smithi045.stdout: -7427> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000246) auth_unpin by 0x55cc941eeb00 on [inode 0x10000000246 [2,head] /dc-dir/dc-file_81 auth v2358 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.713935+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941eeb00] now 0 2023-10-03T19:21:19.899 INFO:teuthology.orchestra.run.smithi045.stdout: -7426> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+910 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941eeb00 count now 1/910 2023-10-03T19:21:19.899 INFO:teuthology.orchestra.run.smithi045.stdout: -7425> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000246) clear_dirty_parent 2023-10-03T19:21:19.900 INFO:teuthology.orchestra.run.smithi045.stdout: -7424> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000247) _stored_backtrace v 330 2023-10-03T19:21:19.900 INFO:teuthology.orchestra.run.smithi045.stdout: -7423> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000247) auth_unpin by 0x55cc941ef080 on [inode 0x10000000247 [2,head] /dc-dir/dc-file_82 auth v2360 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.724011+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941ef080] now 0 2023-10-03T19:21:19.900 INFO:teuthology.orchestra.run.smithi045.stdout: -7422> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+909 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941ef080 count now 1/909 2023-10-03T19:21:19.900 INFO:teuthology.orchestra.run.smithi045.stdout: -7421> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000247) clear_dirty_parent 2023-10-03T19:21:19.900 INFO:teuthology.orchestra.run.smithi045.stdout: -7420> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000248) _stored_backtrace v 334 2023-10-03T19:21:19.900 INFO:teuthology.orchestra.run.smithi045.stdout: -7419> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000248) auth_unpin by 0x55cc941ef600 on [inode 0x10000000248 [2,head] /dc-dir/dc-file_83 auth v2362 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.735243+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941ef600] now 0 2023-10-03T19:21:19.900 INFO:teuthology.orchestra.run.smithi045.stdout: -7418> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+908 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941ef600 count now 1/908 2023-10-03T19:21:19.900 INFO:teuthology.orchestra.run.smithi045.stdout: -7417> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000248) clear_dirty_parent 2023-10-03T19:21:19.900 INFO:teuthology.orchestra.run.smithi045.stdout: -7416> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000249) _stored_backtrace v 338 2023-10-03T19:21:19.901 INFO:teuthology.orchestra.run.smithi045.stdout: -7415> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000249) auth_unpin by 0x55cc941efb80 on [inode 0x10000000249 [2,head] /dc-dir/dc-file_84 auth v2364 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.745120+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941efb80] now 0 2023-10-03T19:21:19.901 INFO:teuthology.orchestra.run.smithi045.stdout: -7414> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+907 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941efb80 count now 1/907 2023-10-03T19:21:19.901 INFO:teuthology.orchestra.run.smithi045.stdout: -7413> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000249) clear_dirty_parent 2023-10-03T19:21:19.901 INFO:teuthology.orchestra.run.smithi045.stdout: -7412> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000024a) _stored_backtrace v 342 2023-10-03T19:21:19.901 INFO:teuthology.orchestra.run.smithi045.stdout: -7411> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000024a) auth_unpin by 0x55cc941f0100 on [inode 0x1000000024a [2,head] /dc-dir/dc-file_85 auth v2366 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.754912+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941f0100] now 0 2023-10-03T19:21:19.901 INFO:teuthology.orchestra.run.smithi045.stdout: -7410> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+906 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941f0100 count now 1/906 2023-10-03T19:21:19.901 INFO:teuthology.orchestra.run.smithi045.stdout: -7409> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000024a) clear_dirty_parent 2023-10-03T19:21:19.901 INFO:teuthology.orchestra.run.smithi045.stdout: -7408> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000024b) _stored_backtrace v 346 2023-10-03T19:21:19.901 INFO:teuthology.orchestra.run.smithi045.stdout: -7407> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000024b) auth_unpin by 0x55cc941f0680 on [inode 0x1000000024b [2,head] /dc-dir/dc-file_86 auth v2368 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.765075+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941f0680] now 0 2023-10-03T19:21:19.901 INFO:teuthology.orchestra.run.smithi045.stdout: -7406> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+905 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941f0680 count now 1/905 2023-10-03T19:21:19.901 INFO:teuthology.orchestra.run.smithi045.stdout: -7405> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000024b) clear_dirty_parent 2023-10-03T19:21:19.902 INFO:teuthology.orchestra.run.smithi045.stdout: -7404> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000024c) _stored_backtrace v 350 2023-10-03T19:21:19.902 INFO:teuthology.orchestra.run.smithi045.stdout: -7403> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000024c) auth_unpin by 0x55cc941f0c00 on [inode 0x1000000024c [2,head] /dc-dir/dc-file_87 auth v2370 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.775229+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941f0c00] now 0 2023-10-03T19:21:19.902 INFO:teuthology.orchestra.run.smithi045.stdout: -7402> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+904 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941f0c00 count now 1/904 2023-10-03T19:21:19.902 INFO:teuthology.orchestra.run.smithi045.stdout: -7401> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000024c) clear_dirty_parent 2023-10-03T19:21:19.902 INFO:teuthology.orchestra.run.smithi045.stdout: -7400> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000024d) _stored_backtrace v 354 2023-10-03T19:21:19.902 INFO:teuthology.orchestra.run.smithi045.stdout: -7399> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000024d) auth_unpin by 0x55cc941f1180 on [inode 0x1000000024d [2,head] /dc-dir/dc-file_88 auth v2372 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.785465+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941f1180] now 0 2023-10-03T19:21:19.902 INFO:teuthology.orchestra.run.smithi045.stdout: -7398> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+903 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941f1180 count now 1/903 2023-10-03T19:21:19.902 INFO:teuthology.orchestra.run.smithi045.stdout: -7397> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000024d) clear_dirty_parent 2023-10-03T19:21:19.902 INFO:teuthology.orchestra.run.smithi045.stdout: -7396> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000024e) _stored_backtrace v 358 2023-10-03T19:21:19.902 INFO:teuthology.orchestra.run.smithi045.stdout: -7395> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000024e) auth_unpin by 0x55cc941f1700 on [inode 0x1000000024e [2,head] /dc-dir/dc-file_89 auth v2374 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.795432+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941f1700] now 0 2023-10-03T19:21:19.902 INFO:teuthology.orchestra.run.smithi045.stdout: -7394> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+902 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941f1700 count now 1/902 2023-10-03T19:21:19.903 INFO:teuthology.orchestra.run.smithi045.stdout: -7393> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000024e) clear_dirty_parent 2023-10-03T19:21:19.903 INFO:teuthology.orchestra.run.smithi045.stdout: -7392> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000024f) _stored_backtrace v 362 2023-10-03T19:21:19.903 INFO:teuthology.orchestra.run.smithi045.stdout: -7391> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000024f) auth_unpin by 0x55cc941fc000 on [inode 0x1000000024f [2,head] /dc-dir/dc-file_90 auth v2376 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.805384+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941fc000] now 0 2023-10-03T19:21:19.903 INFO:teuthology.orchestra.run.smithi045.stdout: -7390> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+901 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941fc000 count now 1/901 2023-10-03T19:21:19.903 INFO:teuthology.orchestra.run.smithi045.stdout: -7389> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000024f) clear_dirty_parent 2023-10-03T19:21:19.903 INFO:teuthology.orchestra.run.smithi045.stdout: -7388> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000250) _stored_backtrace v 366 2023-10-03T19:21:19.903 INFO:teuthology.orchestra.run.smithi045.stdout: -7387> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000250) auth_unpin by 0x55cc941fc580 on [inode 0x10000000250 [2,head] /dc-dir/dc-file_91 auth v2378 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.814955+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941fc580] now 0 2023-10-03T19:21:19.903 INFO:teuthology.orchestra.run.smithi045.stdout: -7386> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+900 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941fc580 count now 1/900 2023-10-03T19:21:19.903 INFO:teuthology.orchestra.run.smithi045.stdout: -7385> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000250) clear_dirty_parent 2023-10-03T19:21:19.903 INFO:teuthology.orchestra.run.smithi045.stdout: -7384> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000251) _stored_backtrace v 370 2023-10-03T19:21:19.904 INFO:teuthology.orchestra.run.smithi045.stdout: -7383> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000251) auth_unpin by 0x55cc941fcb00 on [inode 0x10000000251 [2,head] /dc-dir/dc-file_92 auth v2380 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.824804+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941fcb00] now 0 2023-10-03T19:21:19.904 INFO:teuthology.orchestra.run.smithi045.stdout: -7382> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+899 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941fcb00 count now 1/899 2023-10-03T19:21:19.904 INFO:teuthology.orchestra.run.smithi045.stdout: -7381> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000251) clear_dirty_parent 2023-10-03T19:21:19.904 INFO:teuthology.orchestra.run.smithi045.stdout: -7380> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000252) _stored_backtrace v 374 2023-10-03T19:21:19.904 INFO:teuthology.orchestra.run.smithi045.stdout: -7379> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000252) auth_unpin by 0x55cc941fd080 on [inode 0x10000000252 [2,head] /dc-dir/dc-file_93 auth v2382 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.835136+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941fd080] now 0 2023-10-03T19:21:19.904 INFO:teuthology.orchestra.run.smithi045.stdout: -7378> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+898 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941fd080 count now 1/898 2023-10-03T19:21:19.904 INFO:teuthology.orchestra.run.smithi045.stdout: -7377> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000252) clear_dirty_parent 2023-10-03T19:21:19.904 INFO:teuthology.orchestra.run.smithi045.stdout: -7376> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000253) _stored_backtrace v 378 2023-10-03T19:21:19.904 INFO:teuthology.orchestra.run.smithi045.stdout: -7375> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000253) auth_unpin by 0x55cc941fd600 on [inode 0x10000000253 [2,head] /dc-dir/dc-file_94 auth v2384 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.845569+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941fd600] now 0 2023-10-03T19:21:19.993 INFO:teuthology.orchestra.run.smithi045.stdout: -7374> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+897 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941fd600 count now 1/897 2023-10-03T19:21:19.993 INFO:teuthology.orchestra.run.smithi045.stdout: -7373> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000253) clear_dirty_parent 2023-10-03T19:21:19.993 INFO:teuthology.orchestra.run.smithi045.stdout: -7372> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 196 ==== osd_op_reply(1807 100000004d8.00000000 [create,setxattr (99),setxattr (30)] v74'21 uv21 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.993 INFO:teuthology.orchestra.run.smithi045.stdout: -7371> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000254) _stored_backtrace v 382 2023-10-03T19:21:19.993 INFO:teuthology.orchestra.run.smithi045.stdout: -7370> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000254) auth_unpin by 0x55cc941fdb80 on [inode 0x10000000254 [2,head] /dc-dir/dc-file_95 auth v2386 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.856217+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941fdb80] now 0 2023-10-03T19:21:19.994 INFO:teuthology.orchestra.run.smithi045.stdout: -7369> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+896 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941fdb80 count now 1/896 2023-10-03T19:21:19.994 INFO:teuthology.orchestra.run.smithi045.stdout: -7368> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000254) clear_dirty_parent 2023-10-03T19:21:19.994 INFO:teuthology.orchestra.run.smithi045.stdout: -7367> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000255) _stored_backtrace v 386 2023-10-03T19:21:19.994 INFO:teuthology.orchestra.run.smithi045.stdout: -7366> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000255) auth_unpin by 0x55cc941fe100 on [inode 0x10000000255 [2,head] /dc-dir/dc-file_96 auth v2388 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.867300+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941fe100] now 0 2023-10-03T19:21:19.994 INFO:teuthology.orchestra.run.smithi045.stdout: -7365> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+895 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941fe100 count now 1/895 2023-10-03T19:21:19.994 INFO:teuthology.orchestra.run.smithi045.stdout: -7364> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000255) clear_dirty_parent 2023-10-03T19:21:19.994 INFO:teuthology.orchestra.run.smithi045.stdout: -7363> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000256) _stored_backtrace v 390 2023-10-03T19:21:19.994 INFO:teuthology.orchestra.run.smithi045.stdout: -7362> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000256) auth_unpin by 0x55cc941fe680 on [inode 0x10000000256 [2,head] /dc-dir/dc-file_97 auth v2390 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.878151+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941fe680] now 0 2023-10-03T19:21:19.994 INFO:teuthology.orchestra.run.smithi045.stdout: -7361> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+894 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941fe680 count now 1/894 2023-10-03T19:21:19.994 INFO:teuthology.orchestra.run.smithi045.stdout: -7360> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000256) clear_dirty_parent 2023-10-03T19:21:19.995 INFO:teuthology.orchestra.run.smithi045.stdout: -7359> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000257) _stored_backtrace v 394 2023-10-03T19:21:19.995 INFO:teuthology.orchestra.run.smithi045.stdout: -7358> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000257) auth_unpin by 0x55cc941fec00 on [inode 0x10000000257 [2,head] /dc-dir/dc-file_98 auth v2392 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.888942+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941fec00] now 0 2023-10-03T19:21:19.995 INFO:teuthology.orchestra.run.smithi045.stdout: -7357> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+893 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941fec00 count now 1/893 2023-10-03T19:21:19.995 INFO:teuthology.orchestra.run.smithi045.stdout: -7356> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000257) clear_dirty_parent 2023-10-03T19:21:19.995 INFO:teuthology.orchestra.run.smithi045.stdout: -7355> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000258) _stored_backtrace v 398 2023-10-03T19:21:19.995 INFO:teuthology.orchestra.run.smithi045.stdout: -7354> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000258) auth_unpin by 0x55cc941ff180 on [inode 0x10000000258 [2,head] /dc-dir/dc-file_99 auth v2394 DIRTYPARENT s=2 n(v0 rc2023-10-03T19:17:46.898841+0000 b2 1=1+0) (iversion lock) | ptrwaiter=0 request=0 lock=0 caps=0 dirtyparent=1 dirty=0 authpin=0 0x55cc941ff180] now 0 2023-10-03T19:21:19.995 INFO:teuthology.orchestra.run.smithi045.stdout: -7353> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+892 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941ff180 count now 1/892 2023-10-03T19:21:19.995 INFO:teuthology.orchestra.run.smithi045.stdout: -7352> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000258) clear_dirty_parent 2023-10-03T19:21:19.995 INFO:teuthology.orchestra.run.smithi045.stdout: -7351> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000259) _stored_backtrace v 402 2023-10-03T19:21:19.995 INFO:teuthology.orchestra.run.smithi045.stdout: -7350> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000259) auth_unpin by 0x55cc941ff700 on [inode 0x10000000259 [2,head] /dc-dir/dc-file_100 auth v2396 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:46.909091+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc941ff700] now 0 2023-10-03T19:21:19.996 INFO:teuthology.orchestra.run.smithi045.stdout: -7349> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+891 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc941ff700 count now 1/891 2023-10-03T19:21:19.996 INFO:teuthology.orchestra.run.smithi045.stdout: -7348> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000259) clear_dirty_parent 2023-10-03T19:21:19.996 INFO:teuthology.orchestra.run.smithi045.stdout: -7347> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000025a) _stored_backtrace v 406 2023-10-03T19:21:19.996 INFO:teuthology.orchestra.run.smithi045.stdout: -7346> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000025a) auth_unpin by 0x55cc94208000 on [inode 0x1000000025a [2,head] /dc-dir/dc-file_101 auth v2398 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:46.918865+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94208000] now 0 2023-10-03T19:21:19.996 INFO:teuthology.orchestra.run.smithi045.stdout: -7345> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+890 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94208000 count now 1/890 2023-10-03T19:21:19.996 INFO:teuthology.orchestra.run.smithi045.stdout: -7344> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000025a) clear_dirty_parent 2023-10-03T19:21:19.996 INFO:teuthology.orchestra.run.smithi045.stdout: -7343> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000025b) _stored_backtrace v 410 2023-10-03T19:21:19.996 INFO:teuthology.orchestra.run.smithi045.stdout: -7342> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000025b) auth_unpin by 0x55cc94208580 on [inode 0x1000000025b [2,head] /dc-dir/dc-file_102 auth v2400 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:46.929096+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94208580] now 0 2023-10-03T19:21:19.996 INFO:teuthology.orchestra.run.smithi045.stdout: -7341> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+889 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94208580 count now 1/889 2023-10-03T19:21:19.996 INFO:teuthology.orchestra.run.smithi045.stdout: -7340> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000025b) clear_dirty_parent 2023-10-03T19:21:19.996 INFO:teuthology.orchestra.run.smithi045.stdout: -7339> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000025c) _stored_backtrace v 414 2023-10-03T19:21:19.997 INFO:teuthology.orchestra.run.smithi045.stdout: -7338> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000025c) auth_unpin by 0x55cc94208b00 on [inode 0x1000000025c [2,head] /dc-dir/dc-file_103 auth v2402 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:46.940656+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94208b00] now 0 2023-10-03T19:21:19.997 INFO:teuthology.orchestra.run.smithi045.stdout: -7337> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+888 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94208b00 count now 1/888 2023-10-03T19:21:19.997 INFO:teuthology.orchestra.run.smithi045.stdout: -7336> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000025c) clear_dirty_parent 2023-10-03T19:21:19.997 INFO:teuthology.orchestra.run.smithi045.stdout: -7335> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000025d) _stored_backtrace v 418 2023-10-03T19:21:19.997 INFO:teuthology.orchestra.run.smithi045.stdout: -7334> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000025d) auth_unpin by 0x55cc94209080 on [inode 0x1000000025d [2,head] /dc-dir/dc-file_104 auth v2404 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:46.951033+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94209080] now 0 2023-10-03T19:21:19.997 INFO:teuthology.orchestra.run.smithi045.stdout: -7333> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+887 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94209080 count now 1/887 2023-10-03T19:21:19.997 INFO:teuthology.orchestra.run.smithi045.stdout: -7332> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000025d) clear_dirty_parent 2023-10-03T19:21:19.997 INFO:teuthology.orchestra.run.smithi045.stdout: -7331> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000025e) _stored_backtrace v 422 2023-10-03T19:21:19.997 INFO:teuthology.orchestra.run.smithi045.stdout: -7330> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000025e) auth_unpin by 0x55cc94209600 on [inode 0x1000000025e [2,head] /dc-dir/dc-file_105 auth v2406 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:46.960273+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94209600] now 0 2023-10-03T19:21:19.997 INFO:teuthology.orchestra.run.smithi045.stdout: -7329> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+886 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94209600 count now 1/886 2023-10-03T19:21:19.997 INFO:teuthology.orchestra.run.smithi045.stdout: -7328> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000025e) clear_dirty_parent 2023-10-03T19:21:19.998 INFO:teuthology.orchestra.run.smithi045.stdout: -7327> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000025f) _stored_backtrace v 426 2023-10-03T19:21:19.998 INFO:teuthology.orchestra.run.smithi045.stdout: -7326> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000025f) auth_unpin by 0x55cc94209b80 on [inode 0x1000000025f [2,head] /dc-dir/dc-file_106 auth v2408 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:46.970097+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94209b80] now 0 2023-10-03T19:21:19.998 INFO:teuthology.orchestra.run.smithi045.stdout: -7325> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+885 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94209b80 count now 1/885 2023-10-03T19:21:19.998 INFO:teuthology.orchestra.run.smithi045.stdout: -7324> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000025f) clear_dirty_parent 2023-10-03T19:21:19.998 INFO:teuthology.orchestra.run.smithi045.stdout: -7323> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000260) _stored_backtrace v 430 2023-10-03T19:21:19.998 INFO:teuthology.orchestra.run.smithi045.stdout: -7322> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000260) auth_unpin by 0x55cc9420a100 on [inode 0x10000000260 [2,head] /dc-dir/dc-file_107 auth v2410 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:46.979733+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9420a100] now 0 2023-10-03T19:21:19.998 INFO:teuthology.orchestra.run.smithi045.stdout: -7321> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 197 ==== osd_op_reply(1814 100000004df.00000000 [create,setxattr (99),setxattr (30)] v74'22 uv22 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:19.998 INFO:teuthology.orchestra.run.smithi045.stdout: -7320> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+884 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9420a100 count now 1/884 2023-10-03T19:21:19.998 INFO:teuthology.orchestra.run.smithi045.stdout: -7319> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000260) clear_dirty_parent 2023-10-03T19:21:19.998 INFO:teuthology.orchestra.run.smithi045.stdout: -7318> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000261) _stored_backtrace v 434 2023-10-03T19:21:19.999 INFO:teuthology.orchestra.run.smithi045.stdout: -7317> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000261) auth_unpin by 0x55cc9420a680 on [inode 0x10000000261 [2,head] /dc-dir/dc-file_108 auth v2412 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:46.989407+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9420a680] now 0 2023-10-03T19:21:19.999 INFO:teuthology.orchestra.run.smithi045.stdout: -7316> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+883 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9420a680 count now 1/883 2023-10-03T19:21:19.999 INFO:teuthology.orchestra.run.smithi045.stdout: -7315> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000261) clear_dirty_parent 2023-10-03T19:21:19.999 INFO:teuthology.orchestra.run.smithi045.stdout: -7314> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000262) _stored_backtrace v 438 2023-10-03T19:21:19.999 INFO:teuthology.orchestra.run.smithi045.stdout: -7313> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000262) auth_unpin by 0x55cc9420ac00 on [inode 0x10000000262 [2,head] /dc-dir/dc-file_109 auth v2414 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.000065+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9420ac00] now 0 2023-10-03T19:21:19.999 INFO:teuthology.orchestra.run.smithi045.stdout: -7312> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+882 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9420ac00 count now 1/882 2023-10-03T19:21:19.999 INFO:teuthology.orchestra.run.smithi045.stdout: -7311> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000262) clear_dirty_parent 2023-10-03T19:21:19.999 INFO:teuthology.orchestra.run.smithi045.stdout: -7310> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000263) _stored_backtrace v 442 2023-10-03T19:21:19.999 INFO:teuthology.orchestra.run.smithi045.stdout: -7309> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000263) auth_unpin by 0x55cc9420b180 on [inode 0x10000000263 [2,head] /dc-dir/dc-file_110 auth v2416 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.011751+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9420b180] now 0 2023-10-03T19:21:19.999 INFO:teuthology.orchestra.run.smithi045.stdout: -7308> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+881 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9420b180 count now 1/881 2023-10-03T19:21:19.999 INFO:teuthology.orchestra.run.smithi045.stdout: -7307> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000263) clear_dirty_parent 2023-10-03T19:21:20.000 INFO:teuthology.orchestra.run.smithi045.stdout: -7306> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000264) _stored_backtrace v 446 2023-10-03T19:21:20.000 INFO:teuthology.orchestra.run.smithi045.stdout: -7305> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000264) auth_unpin by 0x55cc9420b700 on [inode 0x10000000264 [2,head] /dc-dir/dc-file_111 auth v2418 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.022000+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9420b700] now 0 2023-10-03T19:21:20.000 INFO:teuthology.orchestra.run.smithi045.stdout: -7304> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+880 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9420b700 count now 1/880 2023-10-03T19:21:20.000 INFO:teuthology.orchestra.run.smithi045.stdout: -7303> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000264) clear_dirty_parent 2023-10-03T19:21:20.000 INFO:teuthology.orchestra.run.smithi045.stdout: -7302> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000265) _stored_backtrace v 450 2023-10-03T19:21:20.000 INFO:teuthology.orchestra.run.smithi045.stdout: -7301> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000265) auth_unpin by 0x55cc9421c000 on [inode 0x10000000265 [2,head] /dc-dir/dc-file_112 auth v2420 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.033060+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9421c000] now 0 2023-10-03T19:21:20.000 INFO:teuthology.orchestra.run.smithi045.stdout: -7300> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+879 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9421c000 count now 1/879 2023-10-03T19:21:20.000 INFO:teuthology.orchestra.run.smithi045.stdout: -7299> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000265) clear_dirty_parent 2023-10-03T19:21:20.000 INFO:teuthology.orchestra.run.smithi045.stdout: -7298> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000266) _stored_backtrace v 454 2023-10-03T19:21:20.000 INFO:teuthology.orchestra.run.smithi045.stdout: -7297> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000266) auth_unpin by 0x55cc9421c580 on [inode 0x10000000266 [2,head] /dc-dir/dc-file_113 auth v2422 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.043483+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9421c580] now 0 2023-10-03T19:21:20.000 INFO:teuthology.orchestra.run.smithi045.stdout: -7296> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+878 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9421c580 count now 1/878 2023-10-03T19:21:20.001 INFO:teuthology.orchestra.run.smithi045.stdout: -7295> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000266) clear_dirty_parent 2023-10-03T19:21:20.001 INFO:teuthology.orchestra.run.smithi045.stdout: -7294> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000267) _stored_backtrace v 458 2023-10-03T19:21:20.001 INFO:teuthology.orchestra.run.smithi045.stdout: -7293> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000267) auth_unpin by 0x55cc9421cb00 on [inode 0x10000000267 [2,head] /dc-dir/dc-file_114 auth v2424 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.053806+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9421cb00] now 0 2023-10-03T19:21:20.001 INFO:teuthology.orchestra.run.smithi045.stdout: -7292> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+877 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9421cb00 count now 1/877 2023-10-03T19:21:20.001 INFO:teuthology.orchestra.run.smithi045.stdout: -7291> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000267) clear_dirty_parent 2023-10-03T19:21:20.032 INFO:teuthology.orchestra.run.smithi045.stdout: -7290> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000268) _stored_backtrace v 462 2023-10-03T19:21:20.032 INFO:teuthology.orchestra.run.smithi045.stdout: -7289> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000268) auth_unpin by 0x55cc9421d080 on [inode 0x10000000268 [2,head] /dc-dir/dc-file_115 auth v2426 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.065075+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9421d080] now 0 2023-10-03T19:21:20.032 INFO:teuthology.orchestra.run.smithi045.stdout: -7288> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+876 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9421d080 count now 1/876 2023-10-03T19:21:20.033 INFO:teuthology.orchestra.run.smithi045.stdout: -7287> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000268) clear_dirty_parent 2023-10-03T19:21:20.033 INFO:teuthology.orchestra.run.smithi045.stdout: -7286> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000269) _stored_backtrace v 466 2023-10-03T19:21:20.033 INFO:teuthology.orchestra.run.smithi045.stdout: -7285> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000269) auth_unpin by 0x55cc9421d600 on [inode 0x10000000269 [2,head] /dc-dir/dc-file_116 auth v2722 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.075950+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9421d600] now 0 2023-10-03T19:21:20.033 INFO:teuthology.orchestra.run.smithi045.stdout: -7284> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+875 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9421d600 count now 1/875 2023-10-03T19:21:20.033 INFO:teuthology.orchestra.run.smithi045.stdout: -7283> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000269) clear_dirty_parent 2023-10-03T19:21:20.033 INFO:teuthology.orchestra.run.smithi045.stdout: -7282> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000026a) _stored_backtrace v 470 2023-10-03T19:21:20.033 INFO:teuthology.orchestra.run.smithi045.stdout: -7281> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000026a) auth_unpin by 0x55cc9421db80 on [inode 0x1000000026a [2,head] /dc-dir/dc-file_117 auth v2724 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.087101+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9421db80] now 0 2023-10-03T19:21:20.033 INFO:teuthology.orchestra.run.smithi045.stdout: -7280> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+874 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9421db80 count now 1/874 2023-10-03T19:21:20.033 INFO:teuthology.orchestra.run.smithi045.stdout: -7279> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000026a) clear_dirty_parent 2023-10-03T19:21:20.033 INFO:teuthology.orchestra.run.smithi045.stdout: -7278> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000026b) _stored_backtrace v 474 2023-10-03T19:21:20.033 INFO:teuthology.orchestra.run.smithi045.stdout: -7277> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000026b) auth_unpin by 0x55cc9421e100 on [inode 0x1000000026b [2,head] /dc-dir/dc-file_118 auth v2726 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.098042+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9421e100] now 0 2023-10-03T19:21:20.034 INFO:teuthology.orchestra.run.smithi045.stdout: -7276> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+873 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9421e100 count now 1/873 2023-10-03T19:21:20.034 INFO:teuthology.orchestra.run.smithi045.stdout: -7275> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000026b) clear_dirty_parent 2023-10-03T19:21:20.034 INFO:teuthology.orchestra.run.smithi045.stdout: -7274> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000026c) _stored_backtrace v 478 2023-10-03T19:21:20.034 INFO:teuthology.orchestra.run.smithi045.stdout: -7273> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000026c) auth_unpin by 0x55cc9421e680 on [inode 0x1000000026c [2,head] /dc-dir/dc-file_119 auth v2728 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.109953+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9421e680] now 0 2023-10-03T19:21:20.034 INFO:teuthology.orchestra.run.smithi045.stdout: -7272> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+872 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9421e680 count now 1/872 2023-10-03T19:21:20.034 INFO:teuthology.orchestra.run.smithi045.stdout: -7271> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000026c) clear_dirty_parent 2023-10-03T19:21:20.034 INFO:teuthology.orchestra.run.smithi045.stdout: -7270> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000026d) _stored_backtrace v 482 2023-10-03T19:21:20.034 INFO:teuthology.orchestra.run.smithi045.stdout: -7269> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000026d) auth_unpin by 0x55cc9421ec00 on [inode 0x1000000026d [2,head] /dc-dir/dc-file_120 auth v2730 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.122169+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9421ec00] now 0 2023-10-03T19:21:20.034 INFO:teuthology.orchestra.run.smithi045.stdout: -7268> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 198 ==== osd_op_reply(1928 10000000550.00000000 [create,setxattr (99),setxattr (30)] v74'26 uv26 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:20.034 INFO:teuthology.orchestra.run.smithi045.stdout: -7267> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+871 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9421ec00 count now 1/871 2023-10-03T19:21:20.034 INFO:teuthology.orchestra.run.smithi045.stdout: -7266> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000026d) clear_dirty_parent 2023-10-03T19:21:20.035 INFO:teuthology.orchestra.run.smithi045.stdout: -7265> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000026e) _stored_backtrace v 486 2023-10-03T19:21:20.035 INFO:teuthology.orchestra.run.smithi045.stdout: -7264> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000026e) auth_unpin by 0x55cc9421f180 on [inode 0x1000000026e [2,head] /dc-dir/dc-file_121 auth v2732 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.132894+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9421f180] now 0 2023-10-03T19:21:20.035 INFO:teuthology.orchestra.run.smithi045.stdout: -7263> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+870 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9421f180 count now 1/870 2023-10-03T19:21:20.035 INFO:teuthology.orchestra.run.smithi045.stdout: -7262> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000026e) clear_dirty_parent 2023-10-03T19:21:20.035 INFO:teuthology.orchestra.run.smithi045.stdout: -7261> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000026f) _stored_backtrace v 490 2023-10-03T19:21:20.035 INFO:teuthology.orchestra.run.smithi045.stdout: -7260> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000026f) auth_unpin by 0x55cc9421f700 on [inode 0x1000000026f [2,head] /dc-dir/dc-file_122 auth v2734 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.144015+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9421f700] now 0 2023-10-03T19:21:20.035 INFO:teuthology.orchestra.run.smithi045.stdout: -7259> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+869 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9421f700 count now 1/869 2023-10-03T19:21:20.035 INFO:teuthology.orchestra.run.smithi045.stdout: -7258> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000026f) clear_dirty_parent 2023-10-03T19:21:20.036 INFO:teuthology.orchestra.run.smithi045.stdout: -7257> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000270) _stored_backtrace v 494 2023-10-03T19:21:20.036 INFO:teuthology.orchestra.run.smithi045.stdout: -7256> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000270) auth_unpin by 0x55cc94224000 on [inode 0x10000000270 [2,head] /dc-dir/dc-file_123 auth v2736 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.154682+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94224000] now 0 2023-10-03T19:21:20.036 INFO:teuthology.orchestra.run.smithi045.stdout: -7255> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+868 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94224000 count now 1/868 2023-10-03T19:21:20.036 INFO:teuthology.orchestra.run.smithi045.stdout: -7254> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000270) clear_dirty_parent 2023-10-03T19:21:20.036 INFO:teuthology.orchestra.run.smithi045.stdout: -7253> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000271) _stored_backtrace v 498 2023-10-03T19:21:20.036 INFO:teuthology.orchestra.run.smithi045.stdout: -7252> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000271) auth_unpin by 0x55cc94224580 on [inode 0x10000000271 [2,head] /dc-dir/dc-file_124 auth v2738 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.165430+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94224580] now 0 2023-10-03T19:21:20.036 INFO:teuthology.orchestra.run.smithi045.stdout: -7251> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+867 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94224580 count now 1/867 2023-10-03T19:21:20.036 INFO:teuthology.orchestra.run.smithi045.stdout: -7250> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000271) clear_dirty_parent 2023-10-03T19:21:20.036 INFO:teuthology.orchestra.run.smithi045.stdout: -7249> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000272) _stored_backtrace v 502 2023-10-03T19:21:20.036 INFO:teuthology.orchestra.run.smithi045.stdout: -7248> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000272) auth_unpin by 0x55cc94224b00 on [inode 0x10000000272 [2,head] /dc-dir/dc-file_125 auth v2740 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.175246+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94224b00] now 0 2023-10-03T19:21:20.036 INFO:teuthology.orchestra.run.smithi045.stdout: -7247> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+866 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94224b00 count now 1/866 2023-10-03T19:21:20.037 INFO:teuthology.orchestra.run.smithi045.stdout: -7246> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000272) clear_dirty_parent 2023-10-03T19:21:20.037 INFO:teuthology.orchestra.run.smithi045.stdout: -7245> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000273) _stored_backtrace v 506 2023-10-03T19:21:20.037 INFO:teuthology.orchestra.run.smithi045.stdout: -7244> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000273) auth_unpin by 0x55cc94225080 on [inode 0x10000000273 [2,head] /dc-dir/dc-file_126 auth v2742 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.184955+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94225080] now 0 2023-10-03T19:21:20.037 INFO:teuthology.orchestra.run.smithi045.stdout: -7243> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+865 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94225080 count now 1/865 2023-10-03T19:21:20.037 INFO:teuthology.orchestra.run.smithi045.stdout: -7242> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000273) clear_dirty_parent 2023-10-03T19:21:20.037 INFO:teuthology.orchestra.run.smithi045.stdout: -7241> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000274) _stored_backtrace v 510 2023-10-03T19:21:20.037 INFO:teuthology.orchestra.run.smithi045.stdout: -7240> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000274) auth_unpin by 0x55cc94225600 on [inode 0x10000000274 [2,head] /dc-dir/dc-file_127 auth v2744 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.194909+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94225600] now 0 2023-10-03T19:21:20.037 INFO:teuthology.orchestra.run.smithi045.stdout: -7239> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+864 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94225600 count now 1/864 2023-10-03T19:21:20.037 INFO:teuthology.orchestra.run.smithi045.stdout: -7238> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000274) clear_dirty_parent 2023-10-03T19:21:20.037 INFO:teuthology.orchestra.run.smithi045.stdout: -7237> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000275) _stored_backtrace v 514 2023-10-03T19:21:20.037 INFO:teuthology.orchestra.run.smithi045.stdout: -7236> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000275) auth_unpin by 0x55cc94225b80 on [inode 0x10000000275 [2,head] /dc-dir/dc-file_128 auth v2746 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.205381+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94225b80] now 0 2023-10-03T19:21:20.038 INFO:teuthology.orchestra.run.smithi045.stdout: -7235> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+863 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94225b80 count now 1/863 2023-10-03T19:21:20.038 INFO:teuthology.orchestra.run.smithi045.stdout: -7234> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000275) clear_dirty_parent 2023-10-03T19:21:20.038 INFO:teuthology.orchestra.run.smithi045.stdout: -7233> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000276) _stored_backtrace v 518 2023-10-03T19:21:20.038 INFO:teuthology.orchestra.run.smithi045.stdout: -7232> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000276) auth_unpin by 0x55cc94226100 on [inode 0x10000000276 [2,head] /dc-dir/dc-file_129 auth v2748 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.215408+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94226100] now 0 2023-10-03T19:21:20.038 INFO:teuthology.orchestra.run.smithi045.stdout: -7231> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+862 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94226100 count now 1/862 2023-10-03T19:21:20.038 INFO:teuthology.orchestra.run.smithi045.stdout: -7230> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000276) clear_dirty_parent 2023-10-03T19:21:20.038 INFO:teuthology.orchestra.run.smithi045.stdout: -7229> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000277) _stored_backtrace v 522 2023-10-03T19:21:20.038 INFO:teuthology.orchestra.run.smithi045.stdout: -7228> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000277) auth_unpin by 0x55cc94226680 on [inode 0x10000000277 [2,head] /dc-dir/dc-file_130 auth v2750 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.225119+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94226680] now 0 2023-10-03T19:21:20.038 INFO:teuthology.orchestra.run.smithi045.stdout: -7227> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+861 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94226680 count now 1/861 2023-10-03T19:21:20.039 INFO:teuthology.orchestra.run.smithi045.stdout: -7226> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000277) clear_dirty_parent 2023-10-03T19:21:20.039 INFO:teuthology.orchestra.run.smithi045.stdout: -7225> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000278) _stored_backtrace v 526 2023-10-03T19:21:20.039 INFO:teuthology.orchestra.run.smithi045.stdout: -7224> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000278) auth_unpin by 0x55cc94226c00 on [inode 0x10000000278 [2,head] /dc-dir/dc-file_131 auth v2752 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.235241+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94226c00] now 0 2023-10-03T19:21:20.039 INFO:teuthology.orchestra.run.smithi045.stdout: -7223> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+860 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94226c00 count now 1/860 2023-10-03T19:21:20.039 INFO:teuthology.orchestra.run.smithi045.stdout: -7222> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000278) clear_dirty_parent 2023-10-03T19:21:20.039 INFO:teuthology.orchestra.run.smithi045.stdout: -7221> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000279) _stored_backtrace v 530 2023-10-03T19:21:20.039 INFO:teuthology.orchestra.run.smithi045.stdout: -7220> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000279) auth_unpin by 0x55cc94227180 on [inode 0x10000000279 [2,head] /dc-dir/dc-file_132 auth v2754 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.246072+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94227180] now 0 2023-10-03T19:21:20.039 INFO:teuthology.orchestra.run.smithi045.stdout: -7219> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+859 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94227180 count now 1/859 2023-10-03T19:21:20.039 INFO:teuthology.orchestra.run.smithi045.stdout: -7218> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000279) clear_dirty_parent 2023-10-03T19:21:20.039 INFO:teuthology.orchestra.run.smithi045.stdout: -7217> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000027a) _stored_backtrace v 534 2023-10-03T19:21:20.039 INFO:teuthology.orchestra.run.smithi045.stdout: -7216> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000027a) auth_unpin by 0x55cc94227700 on [inode 0x1000000027a [2,head] /dc-dir/dc-file_133 auth v2756 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.256610+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94227700] now 0 2023-10-03T19:21:20.040 INFO:teuthology.orchestra.run.smithi045.stdout: -7215> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+858 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94227700 count now 1/858 2023-10-03T19:21:20.040 INFO:teuthology.orchestra.run.smithi045.stdout: -7214> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000027a) clear_dirty_parent 2023-10-03T19:21:20.040 INFO:teuthology.orchestra.run.smithi045.stdout: -7213> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000027b) _stored_backtrace v 538 2023-10-03T19:21:20.040 INFO:teuthology.orchestra.run.smithi045.stdout: -7212> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000027b) auth_unpin by 0x55cc94234000 on [inode 0x1000000027b [2,head] /dc-dir/dc-file_134 auth v2758 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.267964+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94234000] now 0 2023-10-03T19:21:20.040 INFO:teuthology.orchestra.run.smithi045.stdout: -7211> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 199 ==== osd_op_reply(1845 100000004fe.00000000 [create,setxattr (99),setxattr (30)] v74'23 uv23 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:20.040 INFO:teuthology.orchestra.run.smithi045.stdout: -7210> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+857 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94234000 count now 1/857 2023-10-03T19:21:20.040 INFO:teuthology.orchestra.run.smithi045.stdout: -7209> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000027b) clear_dirty_parent 2023-10-03T19:21:20.040 INFO:teuthology.orchestra.run.smithi045.stdout: -7208> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000027c) _stored_backtrace v 542 2023-10-03T19:21:20.040 INFO:teuthology.orchestra.run.smithi045.stdout: -7207> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000027c) auth_unpin by 0x55cc94234580 on [inode 0x1000000027c [2,head] /dc-dir/dc-file_135 auth v2760 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.278905+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94234580] now 0 2023-10-03T19:21:20.040 INFO:teuthology.orchestra.run.smithi045.stdout: -7206> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+856 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94234580 count now 1/856 2023-10-03T19:21:20.041 INFO:teuthology.orchestra.run.smithi045.stdout: -7205> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000027c) clear_dirty_parent 2023-10-03T19:21:20.041 INFO:teuthology.orchestra.run.smithi045.stdout: -7204> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000027d) _stored_backtrace v 546 2023-10-03T19:21:20.041 INFO:teuthology.orchestra.run.smithi045.stdout: -7203> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000027d) auth_unpin by 0x55cc94234b00 on [inode 0x1000000027d [2,head] /dc-dir/dc-file_136 auth v2762 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.288908+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94234b00] now 0 2023-10-03T19:21:20.041 INFO:teuthology.orchestra.run.smithi045.stdout: -7202> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+855 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94234b00 count now 1/855 2023-10-03T19:21:20.041 INFO:teuthology.orchestra.run.smithi045.stdout: -7201> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000027d) clear_dirty_parent 2023-10-03T19:21:20.041 INFO:teuthology.orchestra.run.smithi045.stdout: -7200> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000027e) _stored_backtrace v 550 2023-10-03T19:21:20.041 INFO:teuthology.orchestra.run.smithi045.stdout: -7199> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000027e) auth_unpin by 0x55cc94235080 on [inode 0x1000000027e [2,head] /dc-dir/dc-file_137 auth v2764 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.299429+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94235080] now 0 2023-10-03T19:21:20.050 INFO:teuthology.orchestra.run.smithi045.stdout: -7198> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+854 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94235080 count now 1/854 2023-10-03T19:21:20.051 INFO:teuthology.orchestra.run.smithi045.stdout: -7197> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000027e) clear_dirty_parent 2023-10-03T19:21:20.051 INFO:teuthology.orchestra.run.smithi045.stdout: -7196> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000027f) _stored_backtrace v 554 2023-10-03T19:21:20.051 INFO:teuthology.orchestra.run.smithi045.stdout: -7195> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000027f) auth_unpin by 0x55cc94235600 on [inode 0x1000000027f [2,head] /dc-dir/dc-file_138 auth v2766 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.309340+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94235600] now 0 2023-10-03T19:21:20.051 INFO:teuthology.orchestra.run.smithi045.stdout: -7194> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+853 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94235600 count now 1/853 2023-10-03T19:21:20.051 INFO:teuthology.orchestra.run.smithi045.stdout: -7193> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000027f) clear_dirty_parent 2023-10-03T19:21:20.051 INFO:teuthology.orchestra.run.smithi045.stdout: -7192> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000280) _stored_backtrace v 558 2023-10-03T19:21:20.051 INFO:teuthology.orchestra.run.smithi045.stdout: -7191> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000280) auth_unpin by 0x55cc94235b80 on [inode 0x10000000280 [2,head] /dc-dir/dc-file_139 auth v2768 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.319997+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94235b80] now 0 2023-10-03T19:21:20.051 INFO:teuthology.orchestra.run.smithi045.stdout: -7190> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+852 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94235b80 count now 1/852 2023-10-03T19:21:20.051 INFO:teuthology.orchestra.run.smithi045.stdout: -7189> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000280) clear_dirty_parent 2023-10-03T19:21:20.051 INFO:teuthology.orchestra.run.smithi045.stdout: -7188> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000281) _stored_backtrace v 562 2023-10-03T19:21:20.051 INFO:teuthology.orchestra.run.smithi045.stdout: -7187> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000281) auth_unpin by 0x55cc94236100 on [inode 0x10000000281 [2,head] /dc-dir/dc-file_140 auth v2770 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.329816+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94236100] now 0 2023-10-03T19:21:20.052 INFO:teuthology.orchestra.run.smithi045.stdout: -7186> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+851 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94236100 count now 1/851 2023-10-03T19:21:20.052 INFO:teuthology.orchestra.run.smithi045.stdout: -7185> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000281) clear_dirty_parent 2023-10-03T19:21:20.052 INFO:teuthology.orchestra.run.smithi045.stdout: -7184> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000282) _stored_backtrace v 566 2023-10-03T19:21:20.052 INFO:teuthology.orchestra.run.smithi045.stdout: -7183> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000282) auth_unpin by 0x55cc94236680 on [inode 0x10000000282 [2,head] /dc-dir/dc-file_141 auth v2772 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.340390+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94236680] now 0 2023-10-03T19:21:20.052 INFO:teuthology.orchestra.run.smithi045.stdout: -7182> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+850 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94236680 count now 1/850 2023-10-03T19:21:20.052 INFO:teuthology.orchestra.run.smithi045.stdout: -7181> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000282) clear_dirty_parent 2023-10-03T19:21:20.052 INFO:teuthology.orchestra.run.smithi045.stdout: -7180> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000283) _stored_backtrace v 570 2023-10-03T19:21:20.052 INFO:teuthology.orchestra.run.smithi045.stdout: -7179> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000283) auth_unpin by 0x55cc94236c00 on [inode 0x10000000283 [2,head] /dc-dir/dc-file_142 auth v2774 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.350738+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94236c00] now 0 2023-10-03T19:21:20.052 INFO:teuthology.orchestra.run.smithi045.stdout: -7178> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+849 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94236c00 count now 1/849 2023-10-03T19:21:20.052 INFO:teuthology.orchestra.run.smithi045.stdout: -7177> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000283) clear_dirty_parent 2023-10-03T19:21:20.052 INFO:teuthology.orchestra.run.smithi045.stdout: -7176> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000284) _stored_backtrace v 574 2023-10-03T19:21:20.053 INFO:teuthology.orchestra.run.smithi045.stdout: -7175> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000284) auth_unpin by 0x55cc94237180 on [inode 0x10000000284 [2,head] /dc-dir/dc-file_143 auth v2776 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.361667+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94237180] now 0 2023-10-03T19:21:20.053 INFO:teuthology.orchestra.run.smithi045.stdout: -7174> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+848 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94237180 count now 1/848 2023-10-03T19:21:20.053 INFO:teuthology.orchestra.run.smithi045.stdout: -7173> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000284) clear_dirty_parent 2023-10-03T19:21:20.053 INFO:teuthology.orchestra.run.smithi045.stdout: -7172> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000285) _stored_backtrace v 578 2023-10-03T19:21:20.053 INFO:teuthology.orchestra.run.smithi045.stdout: -7171> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000285) auth_unpin by 0x55cc94237700 on [inode 0x10000000285 [2,head] /dc-dir/dc-file_144 auth v2778 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.372235+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94237700] now 0 2023-10-03T19:21:20.053 INFO:teuthology.orchestra.run.smithi045.stdout: -7170> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+847 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94237700 count now 1/847 2023-10-03T19:21:20.053 INFO:teuthology.orchestra.run.smithi045.stdout: -7169> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000285) clear_dirty_parent 2023-10-03T19:21:20.053 INFO:teuthology.orchestra.run.smithi045.stdout: -7168> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000286) _stored_backtrace v 582 2023-10-03T19:21:20.053 INFO:teuthology.orchestra.run.smithi045.stdout: -7167> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000286) auth_unpin by 0x55cc9423e000 on [inode 0x10000000286 [2,head] /dc-dir/dc-file_145 auth v2780 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.383314+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9423e000] now 0 2023-10-03T19:21:20.054 INFO:teuthology.orchestra.run.smithi045.stdout: -7166> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+846 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9423e000 count now 1/846 2023-10-03T19:21:20.054 INFO:teuthology.orchestra.run.smithi045.stdout: -7165> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000286) clear_dirty_parent 2023-10-03T19:21:20.054 INFO:teuthology.orchestra.run.smithi045.stdout: -7164> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000287) _stored_backtrace v 586 2023-10-03T19:21:20.054 INFO:teuthology.orchestra.run.smithi045.stdout: -7163> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000287) auth_unpin by 0x55cc9423e580 on [inode 0x10000000287 [2,head] /dc-dir/dc-file_146 auth v2782 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.393799+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9423e580] now 0 2023-10-03T19:21:20.054 INFO:teuthology.orchestra.run.smithi045.stdout: -7162> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 200 ==== osd_op_reply(1945 10000000561.00000000 [create,setxattr (99),setxattr (30)] v74'27 uv27 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:20.054 INFO:teuthology.orchestra.run.smithi045.stdout: -7161> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+845 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9423e580 count now 1/845 2023-10-03T19:21:20.054 INFO:teuthology.orchestra.run.smithi045.stdout: -7160> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000287) clear_dirty_parent 2023-10-03T19:21:20.054 INFO:teuthology.orchestra.run.smithi045.stdout: -7159> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000288) _stored_backtrace v 590 2023-10-03T19:21:20.054 INFO:teuthology.orchestra.run.smithi045.stdout: -7158> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000288) auth_unpin by 0x55cc9423eb00 on [inode 0x10000000288 [2,head] /dc-dir/dc-file_147 auth v2784 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.404364+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9423eb00] now 0 2023-10-03T19:21:20.054 INFO:teuthology.orchestra.run.smithi045.stdout: -7157> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+844 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9423eb00 count now 1/844 2023-10-03T19:21:20.055 INFO:teuthology.orchestra.run.smithi045.stdout: -7156> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000288) clear_dirty_parent 2023-10-03T19:21:20.055 INFO:teuthology.orchestra.run.smithi045.stdout: -7155> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000289) _stored_backtrace v 594 2023-10-03T19:21:20.055 INFO:teuthology.orchestra.run.smithi045.stdout: -7154> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000289) auth_unpin by 0x55cc9423f080 on [inode 0x10000000289 [2,head] /dc-dir/dc-file_148 auth v2786 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.414571+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9423f080] now 0 2023-10-03T19:21:20.055 INFO:teuthology.orchestra.run.smithi045.stdout: -7153> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+843 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9423f080 count now 1/843 2023-10-03T19:21:20.055 INFO:teuthology.orchestra.run.smithi045.stdout: -7152> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000289) clear_dirty_parent 2023-10-03T19:21:20.055 INFO:teuthology.orchestra.run.smithi045.stdout: -7151> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000028a) _stored_backtrace v 598 2023-10-03T19:21:20.055 INFO:teuthology.orchestra.run.smithi045.stdout: -7150> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000028a) auth_unpin by 0x55cc9423f600 on [inode 0x1000000028a [2,head] /dc-dir/dc-file_149 auth v2788 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.425794+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9423f600] now 0 2023-10-03T19:21:20.055 INFO:teuthology.orchestra.run.smithi045.stdout: -7149> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+842 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9423f600 count now 1/842 2023-10-03T19:21:20.055 INFO:teuthology.orchestra.run.smithi045.stdout: -7148> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000028a) clear_dirty_parent 2023-10-03T19:21:20.055 INFO:teuthology.orchestra.run.smithi045.stdout: -7147> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000028b) _stored_backtrace v 602 2023-10-03T19:21:20.055 INFO:teuthology.orchestra.run.smithi045.stdout: -7146> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000028b) auth_unpin by 0x55cc9423fb80 on [inode 0x1000000028b [2,head] /dc-dir/dc-file_150 auth v2790 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.436089+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9423fb80] now 0 2023-10-03T19:21:20.055 INFO:teuthology.orchestra.run.smithi045.stdout: -7145> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+841 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9423fb80 count now 1/841 2023-10-03T19:21:20.056 INFO:teuthology.orchestra.run.smithi045.stdout: -7144> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000028b) clear_dirty_parent 2023-10-03T19:21:20.056 INFO:teuthology.orchestra.run.smithi045.stdout: -7143> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000028c) _stored_backtrace v 606 2023-10-03T19:21:20.056 INFO:teuthology.orchestra.run.smithi045.stdout: -7142> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000028c) auth_unpin by 0x55cc94240100 on [inode 0x1000000028c [2,head] /dc-dir/dc-file_151 auth v2792 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.445800+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94240100] now 0 2023-10-03T19:21:20.056 INFO:teuthology.orchestra.run.smithi045.stdout: -7141> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+840 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94240100 count now 1/840 2023-10-03T19:21:20.056 INFO:teuthology.orchestra.run.smithi045.stdout: -7140> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000028c) clear_dirty_parent 2023-10-03T19:21:20.056 INFO:teuthology.orchestra.run.smithi045.stdout: -7139> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000028d) _stored_backtrace v 610 2023-10-03T19:21:20.056 INFO:teuthology.orchestra.run.smithi045.stdout: -7138> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000028d) auth_unpin by 0x55cc94240680 on [inode 0x1000000028d [2,head] /dc-dir/dc-file_152 auth v2794 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.455835+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94240680] now 0 2023-10-03T19:21:20.056 INFO:teuthology.orchestra.run.smithi045.stdout: -7137> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+839 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94240680 count now 1/839 2023-10-03T19:21:20.056 INFO:teuthology.orchestra.run.smithi045.stdout: -7136> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000028d) clear_dirty_parent 2023-10-03T19:21:20.056 INFO:teuthology.orchestra.run.smithi045.stdout: -7135> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000028e) _stored_backtrace v 614 2023-10-03T19:21:20.056 INFO:teuthology.orchestra.run.smithi045.stdout: -7134> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000028e) auth_unpin by 0x55cc94240c00 on [inode 0x1000000028e [2,head] /dc-dir/dc-file_153 auth v2796 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.466375+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94240c00] now 0 2023-10-03T19:21:20.057 INFO:teuthology.orchestra.run.smithi045.stdout: -7133> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+838 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94240c00 count now 1/838 2023-10-03T19:21:20.057 INFO:teuthology.orchestra.run.smithi045.stdout: -7132> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000028e) clear_dirty_parent 2023-10-03T19:21:20.057 INFO:teuthology.orchestra.run.smithi045.stdout: -7131> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000028f) _stored_backtrace v 618 2023-10-03T19:21:20.057 INFO:teuthology.orchestra.run.smithi045.stdout: -7130> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000028f) auth_unpin by 0x55cc94241180 on [inode 0x1000000028f [2,head] /dc-dir/dc-file_154 auth v2798 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.476599+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94241180] now 0 2023-10-03T19:21:20.057 INFO:teuthology.orchestra.run.smithi045.stdout: -7129> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+837 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94241180 count now 1/837 2023-10-03T19:21:20.057 INFO:teuthology.orchestra.run.smithi045.stdout: -7128> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000028f) clear_dirty_parent 2023-10-03T19:21:20.057 INFO:teuthology.orchestra.run.smithi045.stdout: -7127> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000290) _stored_backtrace v 622 2023-10-03T19:21:20.057 INFO:teuthology.orchestra.run.smithi045.stdout: -7126> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000290) auth_unpin by 0x55cc94241700 on [inode 0x10000000290 [2,head] /dc-dir/dc-file_155 auth v2800 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.487267+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94241700] now 0 2023-10-03T19:21:20.057 INFO:teuthology.orchestra.run.smithi045.stdout: -7125> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+836 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94241700 count now 1/836 2023-10-03T19:21:20.057 INFO:teuthology.orchestra.run.smithi045.stdout: -7124> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000290) clear_dirty_parent 2023-10-03T19:21:20.058 INFO:teuthology.orchestra.run.smithi045.stdout: -7123> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000291) _stored_backtrace v 626 2023-10-03T19:21:20.058 INFO:teuthology.orchestra.run.smithi045.stdout: -7122> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000291) auth_unpin by 0x55cc94252000 on [inode 0x10000000291 [2,head] /dc-dir/dc-file_156 auth v2802 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.497436+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94252000] now 0 2023-10-03T19:21:20.058 INFO:teuthology.orchestra.run.smithi045.stdout: -7121> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+835 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94252000 count now 1/835 2023-10-03T19:21:20.058 INFO:teuthology.orchestra.run.smithi045.stdout: -7120> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000291) clear_dirty_parent 2023-10-03T19:21:20.058 INFO:teuthology.orchestra.run.smithi045.stdout: -7119> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000292) _stored_backtrace v 630 2023-10-03T19:21:20.058 INFO:teuthology.orchestra.run.smithi045.stdout: -7118> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000292) auth_unpin by 0x55cc94252580 on [inode 0x10000000292 [2,head] /dc-dir/dc-file_157 auth v2804 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.508139+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94252580] now 0 2023-10-03T19:21:20.058 INFO:teuthology.orchestra.run.smithi045.stdout: -7117> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+834 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94252580 count now 1/834 2023-10-03T19:21:20.058 INFO:teuthology.orchestra.run.smithi045.stdout: -7116> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000292) clear_dirty_parent 2023-10-03T19:21:20.058 INFO:teuthology.orchestra.run.smithi045.stdout: -7115> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000293) _stored_backtrace v 634 2023-10-03T19:21:20.058 INFO:teuthology.orchestra.run.smithi045.stdout: -7114> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000293) auth_unpin by 0x55cc94252b00 on [inode 0x10000000293 [2,head] /dc-dir/dc-file_158 auth v2806 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.520667+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94252b00] now 0 2023-10-03T19:21:20.058 INFO:teuthology.orchestra.run.smithi045.stdout: -7113> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 201 ==== osd_op_reply(1956 1000000056c.00000000 [create,setxattr (99),setxattr (30)] v74'24 uv24 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:20.059 INFO:teuthology.orchestra.run.smithi045.stdout: -7112> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+833 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94252b00 count now 1/833 2023-10-03T19:21:20.059 INFO:teuthology.orchestra.run.smithi045.stdout: -7111> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000293) clear_dirty_parent 2023-10-03T19:21:20.059 INFO:teuthology.orchestra.run.smithi045.stdout: -7110> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000294) _stored_backtrace v 638 2023-10-03T19:21:20.059 INFO:teuthology.orchestra.run.smithi045.stdout: -7109> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000294) auth_unpin by 0x55cc94253080 on [inode 0x10000000294 [2,head] /dc-dir/dc-file_159 auth v2808 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.532586+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94253080] now 0 2023-10-03T19:21:20.142 INFO:teuthology.orchestra.run.smithi045.stdout: -7108> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+832 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94253080 count now 1/832 2023-10-03T19:21:20.142 INFO:teuthology.orchestra.run.smithi045.stdout: -7107> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000294) clear_dirty_parent 2023-10-03T19:21:20.142 INFO:teuthology.orchestra.run.smithi045.stdout: -7106> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000295) _stored_backtrace v 642 2023-10-03T19:21:20.142 INFO:teuthology.orchestra.run.smithi045.stdout: -7105> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000295) auth_unpin by 0x55cc94253600 on [inode 0x10000000295 [2,head] /dc-dir/dc-file_160 auth v2810 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.544628+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94253600] now 0 2023-10-03T19:21:20.143 INFO:teuthology.orchestra.run.smithi045.stdout: -7104> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+831 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94253600 count now 1/831 2023-10-03T19:21:20.143 INFO:teuthology.orchestra.run.smithi045.stdout: -7103> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000295) clear_dirty_parent 2023-10-03T19:21:20.143 INFO:teuthology.orchestra.run.smithi045.stdout: -7102> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000296) _stored_backtrace v 646 2023-10-03T19:21:20.143 INFO:teuthology.orchestra.run.smithi045.stdout: -7101> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000296) auth_unpin by 0x55cc94253b80 on [inode 0x10000000296 [2,head] /dc-dir/dc-file_161 auth v2812 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.556330+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94253b80] now 0 2023-10-03T19:21:20.143 INFO:teuthology.orchestra.run.smithi045.stdout: -7100> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+830 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94253b80 count now 1/830 2023-10-03T19:21:20.143 INFO:teuthology.orchestra.run.smithi045.stdout: -7099> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000296) clear_dirty_parent 2023-10-03T19:21:20.143 INFO:teuthology.orchestra.run.smithi045.stdout: -7098> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000297) _stored_backtrace v 650 2023-10-03T19:21:20.143 INFO:teuthology.orchestra.run.smithi045.stdout: -7097> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000297) auth_unpin by 0x55cc94254100 on [inode 0x10000000297 [2,head] /dc-dir/dc-file_162 auth v2814 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.567051+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94254100] now 0 2023-10-03T19:21:20.143 INFO:teuthology.orchestra.run.smithi045.stdout: -7096> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+829 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94254100 count now 1/829 2023-10-03T19:21:20.143 INFO:teuthology.orchestra.run.smithi045.stdout: -7095> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000297) clear_dirty_parent 2023-10-03T19:21:20.144 INFO:teuthology.orchestra.run.smithi045.stdout: -7094> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000298) _stored_backtrace v 654 2023-10-03T19:21:20.144 INFO:teuthology.orchestra.run.smithi045.stdout: -7093> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000298) auth_unpin by 0x55cc94254680 on [inode 0x10000000298 [2,head] /dc-dir/dc-file_163 auth v2816 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.578431+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94254680] now 0 2023-10-03T19:21:20.144 INFO:teuthology.orchestra.run.smithi045.stdout: -7092> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+828 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94254680 count now 1/828 2023-10-03T19:21:20.144 INFO:teuthology.orchestra.run.smithi045.stdout: -7091> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000298) clear_dirty_parent 2023-10-03T19:21:20.144 INFO:teuthology.orchestra.run.smithi045.stdout: -7090> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000299) _stored_backtrace v 658 2023-10-03T19:21:20.144 INFO:teuthology.orchestra.run.smithi045.stdout: -7089> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000299) auth_unpin by 0x55cc94254c00 on [inode 0x10000000299 [2,head] /dc-dir/dc-file_164 auth v2818 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.590039+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94254c00] now 0 2023-10-03T19:21:20.144 INFO:teuthology.orchestra.run.smithi045.stdout: -7088> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+827 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94254c00 count now 1/827 2023-10-03T19:21:20.144 INFO:teuthology.orchestra.run.smithi045.stdout: -7087> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000299) clear_dirty_parent 2023-10-03T19:21:20.144 INFO:teuthology.orchestra.run.smithi045.stdout: -7086> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000029a) _stored_backtrace v 662 2023-10-03T19:21:20.144 INFO:teuthology.orchestra.run.smithi045.stdout: -7085> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000029a) auth_unpin by 0x55cc94255180 on [inode 0x1000000029a [2,head] /dc-dir/dc-file_165 auth v2820 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.600733+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94255180] now 0 2023-10-03T19:21:20.144 INFO:teuthology.orchestra.run.smithi045.stdout: -7084> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+826 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94255180 count now 1/826 2023-10-03T19:21:20.145 INFO:teuthology.orchestra.run.smithi045.stdout: -7083> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000029a) clear_dirty_parent 2023-10-03T19:21:20.145 INFO:teuthology.orchestra.run.smithi045.stdout: -7082> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000029b) _stored_backtrace v 666 2023-10-03T19:21:20.145 INFO:teuthology.orchestra.run.smithi045.stdout: -7081> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000029b) auth_unpin by 0x55cc94255700 on [inode 0x1000000029b [2,head] /dc-dir/dc-file_166 auth v2822 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.611020+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94255700] now 0 2023-10-03T19:21:20.145 INFO:teuthology.orchestra.run.smithi045.stdout: -7080> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+825 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94255700 count now 1/825 2023-10-03T19:21:20.145 INFO:teuthology.orchestra.run.smithi045.stdout: -7079> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000029b) clear_dirty_parent 2023-10-03T19:21:20.145 INFO:teuthology.orchestra.run.smithi045.stdout: -7078> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000029c) _stored_backtrace v 670 2023-10-03T19:21:20.145 INFO:teuthology.orchestra.run.smithi045.stdout: -7077> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000029c) auth_unpin by 0x55cc93f12000 on [inode 0x1000000029c [2,head] /dc-dir/dc-file_167 auth v2824 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.621331+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc93f12000] now 0 2023-10-03T19:21:20.145 INFO:teuthology.orchestra.run.smithi045.stdout: -7076> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+824 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc93f12000 count now 1/824 2023-10-03T19:21:20.145 INFO:teuthology.orchestra.run.smithi045.stdout: -7075> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000029c) clear_dirty_parent 2023-10-03T19:21:20.145 INFO:teuthology.orchestra.run.smithi045.stdout: -7074> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000029d) _stored_backtrace v 674 2023-10-03T19:21:20.145 INFO:teuthology.orchestra.run.smithi045.stdout: -7073> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000029d) auth_unpin by 0x55cc93f12580 on [inode 0x1000000029d [2,head] /dc-dir/dc-file_168 auth v2826 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.631305+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc93f12580] now 0 2023-10-03T19:21:20.146 INFO:teuthology.orchestra.run.smithi045.stdout: -7072> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+823 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc93f12580 count now 1/823 2023-10-03T19:21:20.146 INFO:teuthology.orchestra.run.smithi045.stdout: -7071> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000029d) clear_dirty_parent 2023-10-03T19:21:20.146 INFO:teuthology.orchestra.run.smithi045.stdout: -7070> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000029e) _stored_backtrace v 678 2023-10-03T19:21:20.146 INFO:teuthology.orchestra.run.smithi045.stdout: -7069> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000029e) auth_unpin by 0x55cc93f12b00 on [inode 0x1000000029e [2,head] /dc-dir/dc-file_169 auth v2828 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.641617+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc93f12b00] now 0 2023-10-03T19:21:20.146 INFO:teuthology.orchestra.run.smithi045.stdout: -7068> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+822 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc93f12b00 count now 1/822 2023-10-03T19:21:20.146 INFO:teuthology.orchestra.run.smithi045.stdout: -7067> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000029e) clear_dirty_parent 2023-10-03T19:21:20.146 INFO:teuthology.orchestra.run.smithi045.stdout: -7066> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 202 ==== osd_op_reply(1982 10000000586.00000000 [create,setxattr (99),setxattr (30)] v74'25 uv25 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:20.146 INFO:teuthology.orchestra.run.smithi045.stdout: -7065> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000029f) _stored_backtrace v 682 2023-10-03T19:21:20.146 INFO:teuthology.orchestra.run.smithi045.stdout: -7064> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000029f) auth_unpin by 0x55cc93f13080 on [inode 0x1000000029f [2,head] /dc-dir/dc-file_170 auth v2830 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.651881+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc93f13080] now 0 2023-10-03T19:21:20.146 INFO:teuthology.orchestra.run.smithi045.stdout: -7063> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+821 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc93f13080 count now 1/821 2023-10-03T19:21:20.147 INFO:teuthology.orchestra.run.smithi045.stdout: -7062> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000029f) clear_dirty_parent 2023-10-03T19:21:20.147 INFO:teuthology.orchestra.run.smithi045.stdout: -7061> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a0) _stored_backtrace v 686 2023-10-03T19:21:20.147 INFO:teuthology.orchestra.run.smithi045.stdout: -7060> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a0) auth_unpin by 0x55cc93f13600 on [inode 0x100000002a0 [2,head] /dc-dir/dc-file_171 auth v2832 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.662464+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc93f13600] now 0 2023-10-03T19:21:20.147 INFO:teuthology.orchestra.run.smithi045.stdout: -7059> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+820 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc93f13600 count now 1/820 2023-10-03T19:21:20.147 INFO:teuthology.orchestra.run.smithi045.stdout: -7058> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a0) clear_dirty_parent 2023-10-03T19:21:20.147 INFO:teuthology.orchestra.run.smithi045.stdout: -7057> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a1) _stored_backtrace v 690 2023-10-03T19:21:20.147 INFO:teuthology.orchestra.run.smithi045.stdout: -7056> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a1) auth_unpin by 0x55cc93f13b80 on [inode 0x100000002a1 [2,head] /dc-dir/dc-file_172 auth v2834 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.672669+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc93f13b80] now 0 2023-10-03T19:21:20.147 INFO:teuthology.orchestra.run.smithi045.stdout: -7055> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+819 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc93f13b80 count now 1/819 2023-10-03T19:21:20.147 INFO:teuthology.orchestra.run.smithi045.stdout: -7054> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a1) clear_dirty_parent 2023-10-03T19:21:20.147 INFO:teuthology.orchestra.run.smithi045.stdout: -7053> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a2) _stored_backtrace v 694 2023-10-03T19:21:20.147 INFO:teuthology.orchestra.run.smithi045.stdout: -7052> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a2) auth_unpin by 0x55cc93f14100 on [inode 0x100000002a2 [2,head] /dc-dir/dc-file_173 auth v2836 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.683892+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc93f14100] now 0 2023-10-03T19:21:20.148 INFO:teuthology.orchestra.run.smithi045.stdout: -7051> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+818 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc93f14100 count now 1/818 2023-10-03T19:21:20.148 INFO:teuthology.orchestra.run.smithi045.stdout: -7050> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a2) clear_dirty_parent 2023-10-03T19:21:20.148 INFO:teuthology.orchestra.run.smithi045.stdout: -7049> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a3) _stored_backtrace v 698 2023-10-03T19:21:20.148 INFO:teuthology.orchestra.run.smithi045.stdout: -7048> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a3) auth_unpin by 0x55cc93f14680 on [inode 0x100000002a3 [2,head] /dc-dir/dc-file_174 auth v2838 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.694182+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc93f14680] now 0 2023-10-03T19:21:20.148 INFO:teuthology.orchestra.run.smithi045.stdout: -7047> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+817 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc93f14680 count now 1/817 2023-10-03T19:21:20.148 INFO:teuthology.orchestra.run.smithi045.stdout: -7046> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a3) clear_dirty_parent 2023-10-03T19:21:20.148 INFO:teuthology.orchestra.run.smithi045.stdout: -7045> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a4) _stored_backtrace v 702 2023-10-03T19:21:20.148 INFO:teuthology.orchestra.run.smithi045.stdout: -7044> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a4) auth_unpin by 0x55cc93f14c00 on [inode 0x100000002a4 [2,head] /dc-dir/dc-file_175 auth v2840 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.704726+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc93f14c00] now 0 2023-10-03T19:21:20.148 INFO:teuthology.orchestra.run.smithi045.stdout: -7043> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+816 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc93f14c00 count now 1/816 2023-10-03T19:21:20.148 INFO:teuthology.orchestra.run.smithi045.stdout: -7042> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a4) clear_dirty_parent 2023-10-03T19:21:20.148 INFO:teuthology.orchestra.run.smithi045.stdout: -7041> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a5) _stored_backtrace v 706 2023-10-03T19:21:20.149 INFO:teuthology.orchestra.run.smithi045.stdout: -7040> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a5) auth_unpin by 0x55cc93f15180 on [inode 0x100000002a5 [2,head] /dc-dir/dc-file_176 auth v2842 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.715702+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc93f15180] now 0 2023-10-03T19:21:20.149 INFO:teuthology.orchestra.run.smithi045.stdout: -7039> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+815 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc93f15180 count now 1/815 2023-10-03T19:21:20.149 INFO:teuthology.orchestra.run.smithi045.stdout: -7038> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a5) clear_dirty_parent 2023-10-03T19:21:20.149 INFO:teuthology.orchestra.run.smithi045.stdout: -7037> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a6) _stored_backtrace v 710 2023-10-03T19:21:20.149 INFO:teuthology.orchestra.run.smithi045.stdout: -7036> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a6) auth_unpin by 0x55cc93f15700 on [inode 0x100000002a6 [2,head] /dc-dir/dc-file_177 auth v2844 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.725885+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc93f15700] now 0 2023-10-03T19:21:20.149 INFO:teuthology.orchestra.run.smithi045.stdout: -7035> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+814 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc93f15700 count now 1/814 2023-10-03T19:21:20.149 INFO:teuthology.orchestra.run.smithi045.stdout: -7034> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a6) clear_dirty_parent 2023-10-03T19:21:20.149 INFO:teuthology.orchestra.run.smithi045.stdout: -7033> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a7) _stored_backtrace v 714 2023-10-03T19:21:20.149 INFO:teuthology.orchestra.run.smithi045.stdout: -7032> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a7) auth_unpin by 0x55cc93f18000 on [inode 0x100000002a7 [2,head] /dc-dir/dc-file_178 auth v2846 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.737142+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc93f18000] now 0 2023-10-03T19:21:20.178 INFO:teuthology.orchestra.run.smithi045.stdout: -7031> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+813 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc93f18000 count now 1/813 2023-10-03T19:21:20.179 INFO:teuthology.orchestra.run.smithi045.stdout: -7030> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a7) clear_dirty_parent 2023-10-03T19:21:20.179 INFO:teuthology.orchestra.run.smithi045.stdout: -7029> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a8) _stored_backtrace v 718 2023-10-03T19:21:20.179 INFO:teuthology.orchestra.run.smithi045.stdout: -7028> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a8) auth_unpin by 0x55cc93f18580 on [inode 0x100000002a8 [2,head] /dc-dir/dc-file_179 auth v2848 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.747461+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc93f18580] now 0 2023-10-03T19:21:20.179 INFO:teuthology.orchestra.run.smithi045.stdout: -7027> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+812 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc93f18580 count now 1/812 2023-10-03T19:21:20.179 INFO:teuthology.orchestra.run.smithi045.stdout: -7026> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a8) clear_dirty_parent 2023-10-03T19:21:20.179 INFO:teuthology.orchestra.run.smithi045.stdout: -7025> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a9) _stored_backtrace v 722 2023-10-03T19:21:20.179 INFO:teuthology.orchestra.run.smithi045.stdout: -7024> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a9) auth_unpin by 0x55cc93f18b00 on [inode 0x100000002a9 [2,head] /dc-dir/dc-file_180 auth v2850 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.758474+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc93f18b00] now 0 2023-10-03T19:21:20.179 INFO:teuthology.orchestra.run.smithi045.stdout: -7023> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+811 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc93f18b00 count now 1/811 2023-10-03T19:21:20.179 INFO:teuthology.orchestra.run.smithi045.stdout: -7022> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a9) clear_dirty_parent 2023-10-03T19:21:20.179 INFO:teuthology.orchestra.run.smithi045.stdout: -7021> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002aa) _stored_backtrace v 726 2023-10-03T19:21:20.179 INFO:teuthology.orchestra.run.smithi045.stdout: -7020> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 203 ==== osd_op_reply(2020 100000005ac.00000000 [create,setxattr (99),setxattr (30)] v74'26 uv26 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:20.180 INFO:teuthology.orchestra.run.smithi045.stdout: -7019> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002aa) auth_unpin by 0x55cc93f19080 on [inode 0x100000002aa [2,head] /dc-dir/dc-file_181 auth v2852 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.769014+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc93f19080] now 0 2023-10-03T19:21:20.180 INFO:teuthology.orchestra.run.smithi045.stdout: -7018> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+810 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc93f19080 count now 1/810 2023-10-03T19:21:20.180 INFO:teuthology.orchestra.run.smithi045.stdout: -7017> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002aa) clear_dirty_parent 2023-10-03T19:21:20.180 INFO:teuthology.orchestra.run.smithi045.stdout: -7016> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ab) _stored_backtrace v 730 2023-10-03T19:21:20.180 INFO:teuthology.orchestra.run.smithi045.stdout: -7015> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ab) auth_unpin by 0x55cc93f19600 on [inode 0x100000002ab [2,head] /dc-dir/dc-file_182 auth v2854 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.779544+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc93f19600] now 0 2023-10-03T19:21:20.180 INFO:teuthology.orchestra.run.smithi045.stdout: -7014> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+809 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc93f19600 count now 1/809 2023-10-03T19:21:20.180 INFO:teuthology.orchestra.run.smithi045.stdout: -7013> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ab) clear_dirty_parent 2023-10-03T19:21:20.180 INFO:teuthology.orchestra.run.smithi045.stdout: -7012> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ac) _stored_backtrace v 734 2023-10-03T19:21:20.180 INFO:teuthology.orchestra.run.smithi045.stdout: -7011> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ac) auth_unpin by 0x55cc93f19b80 on [inode 0x100000002ac [2,head] /dc-dir/dc-file_183 auth v2856 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.789932+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc93f19b80] now 0 2023-10-03T19:21:20.180 INFO:teuthology.orchestra.run.smithi045.stdout: -7010> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+808 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc93f19b80 count now 1/808 2023-10-03T19:21:20.181 INFO:teuthology.orchestra.run.smithi045.stdout: -7009> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ac) clear_dirty_parent 2023-10-03T19:21:20.181 INFO:teuthology.orchestra.run.smithi045.stdout: -7008> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ad) _stored_backtrace v 738 2023-10-03T19:21:20.181 INFO:teuthology.orchestra.run.smithi045.stdout: -7007> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ad) auth_unpin by 0x55cc93f1a100 on [inode 0x100000002ad [2,head] /dc-dir/dc-file_184 auth v2858 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.800015+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc93f1a100] now 0 2023-10-03T19:21:20.181 INFO:teuthology.orchestra.run.smithi045.stdout: -7006> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+807 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc93f1a100 count now 1/807 2023-10-03T19:21:20.181 INFO:teuthology.orchestra.run.smithi045.stdout: -7005> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ad) clear_dirty_parent 2023-10-03T19:21:20.181 INFO:teuthology.orchestra.run.smithi045.stdout: -7004> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ae) _stored_backtrace v 742 2023-10-03T19:21:20.181 INFO:teuthology.orchestra.run.smithi045.stdout: -7003> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ae) auth_unpin by 0x55cc93f1a680 on [inode 0x100000002ae [2,head] /dc-dir/dc-file_185 auth v2860 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.810520+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc93f1a680] now 0 2023-10-03T19:21:20.181 INFO:teuthology.orchestra.run.smithi045.stdout: -7002> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+806 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc93f1a680 count now 1/806 2023-10-03T19:21:20.181 INFO:teuthology.orchestra.run.smithi045.stdout: -7001> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ae) clear_dirty_parent 2023-10-03T19:21:20.181 INFO:teuthology.orchestra.run.smithi045.stdout: -7000> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002af) _stored_backtrace v 746 2023-10-03T19:21:20.182 INFO:teuthology.orchestra.run.smithi045.stdout: -6999> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002af) auth_unpin by 0x55cc93f1ac00 on [inode 0x100000002af [2,head] /dc-dir/dc-file_186 auth v2862 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.822006+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc93f1ac00] now 0 2023-10-03T19:21:20.182 INFO:teuthology.orchestra.run.smithi045.stdout: -6998> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+805 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc93f1ac00 count now 1/805 2023-10-03T19:21:20.182 INFO:teuthology.orchestra.run.smithi045.stdout: -6997> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002af) clear_dirty_parent 2023-10-03T19:21:20.182 INFO:teuthology.orchestra.run.smithi045.stdout: -6996> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b0) _stored_backtrace v 750 2023-10-03T19:21:20.182 INFO:teuthology.orchestra.run.smithi045.stdout: -6995> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b0) auth_unpin by 0x55cc93f1b180 on [inode 0x100000002b0 [2,head] /dc-dir/dc-file_187 auth v2864 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.835044+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc93f1b180] now 0 2023-10-03T19:21:20.182 INFO:teuthology.orchestra.run.smithi045.stdout: -6994> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+804 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc93f1b180 count now 1/804 2023-10-03T19:21:20.182 INFO:teuthology.orchestra.run.smithi045.stdout: -6993> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b0) clear_dirty_parent 2023-10-03T19:21:20.182 INFO:teuthology.orchestra.run.smithi045.stdout: -6992> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b1) _stored_backtrace v 754 2023-10-03T19:21:20.182 INFO:teuthology.orchestra.run.smithi045.stdout: -6991> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b1) auth_unpin by 0x55cc93f1b700 on [inode 0x100000002b1 [2,head] /dc-dir/dc-file_188 auth v2866 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.847052+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc93f1b700] now 0 2023-10-03T19:21:20.182 INFO:teuthology.orchestra.run.smithi045.stdout: -6990> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+803 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc93f1b700 count now 1/803 2023-10-03T19:21:20.182 INFO:teuthology.orchestra.run.smithi045.stdout: -6989> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b1) clear_dirty_parent 2023-10-03T19:21:20.182 INFO:teuthology.orchestra.run.smithi045.stdout: -6988> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b2) _stored_backtrace v 758 2023-10-03T19:21:20.183 INFO:teuthology.orchestra.run.smithi045.stdout: -6987> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b2) auth_unpin by 0x55cc94264000 on [inode 0x100000002b2 [2,head] /dc-dir/dc-file_189 auth v2868 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.859187+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94264000] now 0 2023-10-03T19:21:20.183 INFO:teuthology.orchestra.run.smithi045.stdout: -6986> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+802 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94264000 count now 1/802 2023-10-03T19:21:20.183 INFO:teuthology.orchestra.run.smithi045.stdout: -6985> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b2) clear_dirty_parent 2023-10-03T19:21:20.183 INFO:teuthology.orchestra.run.smithi045.stdout: -6984> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b3) _stored_backtrace v 762 2023-10-03T19:21:20.183 INFO:teuthology.orchestra.run.smithi045.stdout: -6983> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b3) auth_unpin by 0x55cc94264580 on [inode 0x100000002b3 [2,head] /dc-dir/dc-file_190 auth v2870 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.870571+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94264580] now 0 2023-10-03T19:21:20.183 INFO:teuthology.orchestra.run.smithi045.stdout: -6982> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+801 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94264580 count now 1/801 2023-10-03T19:21:20.183 INFO:teuthology.orchestra.run.smithi045.stdout: -6981> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b3) clear_dirty_parent 2023-10-03T19:21:20.183 INFO:teuthology.orchestra.run.smithi045.stdout: -6980> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b4) _stored_backtrace v 766 2023-10-03T19:21:20.183 INFO:teuthology.orchestra.run.smithi045.stdout: -6979> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b4) auth_unpin by 0x55cc94264b00 on [inode 0x100000002b4 [2,head] /dc-dir/dc-file_191 auth v2872 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.881018+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94264b00] now 0 2023-10-03T19:21:20.183 INFO:teuthology.orchestra.run.smithi045.stdout: -6978> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+800 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94264b00 count now 1/800 2023-10-03T19:21:20.183 INFO:teuthology.orchestra.run.smithi045.stdout: -6977> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b4) clear_dirty_parent 2023-10-03T19:21:20.184 INFO:teuthology.orchestra.run.smithi045.stdout: -6976> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b5) _stored_backtrace v 770 2023-10-03T19:21:20.184 INFO:teuthology.orchestra.run.smithi045.stdout: -6975> 2023-10-03T19:18:09.849+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 204 ==== osd_op_reply(2038 100000005be.00000000 [create,setxattr (99),setxattr (30)] v74'28 uv28 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:20.184 INFO:teuthology.orchestra.run.smithi045.stdout: -6974> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b5) auth_unpin by 0x55cc94265080 on [inode 0x100000002b5 [2,head] /dc-dir/dc-file_192 auth v2874 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.891416+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94265080] now 0 2023-10-03T19:21:20.184 INFO:teuthology.orchestra.run.smithi045.stdout: -6973> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+799 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94265080 count now 1/799 2023-10-03T19:21:20.184 INFO:teuthology.orchestra.run.smithi045.stdout: -6972> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b5) clear_dirty_parent 2023-10-03T19:21:20.184 INFO:teuthology.orchestra.run.smithi045.stdout: -6971> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b6) _stored_backtrace v 774 2023-10-03T19:21:20.184 INFO:teuthology.orchestra.run.smithi045.stdout: -6970> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b6) auth_unpin by 0x55cc94265600 on [inode 0x100000002b6 [2,head] /dc-dir/dc-file_193 auth v2876 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.901644+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94265600] now 0 2023-10-03T19:21:20.184 INFO:teuthology.orchestra.run.smithi045.stdout: -6969> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+798 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94265600 count now 1/798 2023-10-03T19:21:20.184 INFO:teuthology.orchestra.run.smithi045.stdout: -6968> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b6) clear_dirty_parent 2023-10-03T19:21:20.190 INFO:teuthology.orchestra.run.smithi045.stdout: -6967> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b7) _stored_backtrace v 778 2023-10-03T19:21:20.190 INFO:teuthology.orchestra.run.smithi045.stdout: -6966> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b7) auth_unpin by 0x55cc94265b80 on [inode 0x100000002b7 [2,head] /dc-dir/dc-file_194 auth v2878 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.911813+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94265b80] now 0 2023-10-03T19:21:20.191 INFO:teuthology.orchestra.run.smithi045.stdout: -6965> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+797 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94265b80 count now 1/797 2023-10-03T19:21:20.191 INFO:teuthology.orchestra.run.smithi045.stdout: -6964> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b7) clear_dirty_parent 2023-10-03T19:21:20.191 INFO:teuthology.orchestra.run.smithi045.stdout: -6963> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b8) _stored_backtrace v 782 2023-10-03T19:21:20.191 INFO:teuthology.orchestra.run.smithi045.stdout: -6962> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b8) auth_unpin by 0x55cc94266100 on [inode 0x100000002b8 [2,head] /dc-dir/dc-file_195 auth v2880 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.922417+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94266100] now 0 2023-10-03T19:21:20.191 INFO:teuthology.orchestra.run.smithi045.stdout: -6961> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+796 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94266100 count now 1/796 2023-10-03T19:21:20.191 INFO:teuthology.orchestra.run.smithi045.stdout: -6960> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b8) clear_dirty_parent 2023-10-03T19:21:20.191 INFO:teuthology.orchestra.run.smithi045.stdout: -6959> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b9) _stored_backtrace v 786 2023-10-03T19:21:20.191 INFO:teuthology.orchestra.run.smithi045.stdout: -6958> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b9) auth_unpin by 0x55cc94266680 on [inode 0x100000002b9 [2,head] /dc-dir/dc-file_196 auth v2882 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.934142+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94266680] now 0 2023-10-03T19:21:20.191 INFO:teuthology.orchestra.run.smithi045.stdout: -6957> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+795 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94266680 count now 1/795 2023-10-03T19:21:20.191 INFO:teuthology.orchestra.run.smithi045.stdout: -6956> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b9) clear_dirty_parent 2023-10-03T19:21:20.191 INFO:teuthology.orchestra.run.smithi045.stdout: -6955> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ba) _stored_backtrace v 790 2023-10-03T19:21:20.191 INFO:teuthology.orchestra.run.smithi045.stdout: -6954> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ba) auth_unpin by 0x55cc94266c00 on [inode 0x100000002ba [2,head] /dc-dir/dc-file_197 auth v2884 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.944845+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94266c00] now 0 2023-10-03T19:21:20.192 INFO:teuthology.orchestra.run.smithi045.stdout: -6953> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+794 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94266c00 count now 1/794 2023-10-03T19:21:20.192 INFO:teuthology.orchestra.run.smithi045.stdout: -6952> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ba) clear_dirty_parent 2023-10-03T19:21:20.192 INFO:teuthology.orchestra.run.smithi045.stdout: -6951> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002bb) _stored_backtrace v 794 2023-10-03T19:21:20.192 INFO:teuthology.orchestra.run.smithi045.stdout: -6950> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002bb) auth_unpin by 0x55cc94267180 on [inode 0x100000002bb [2,head] /dc-dir/dc-file_198 auth v2886 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.955134+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94267180] now 0 2023-10-03T19:21:20.192 INFO:teuthology.orchestra.run.smithi045.stdout: -6949> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+793 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94267180 count now 1/793 2023-10-03T19:21:20.192 INFO:teuthology.orchestra.run.smithi045.stdout: -6948> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002bb) clear_dirty_parent 2023-10-03T19:21:20.192 INFO:teuthology.orchestra.run.smithi045.stdout: -6947> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002bc) _stored_backtrace v 798 2023-10-03T19:21:20.192 INFO:teuthology.orchestra.run.smithi045.stdout: -6946> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002bc) auth_unpin by 0x55cc94267700 on [inode 0x100000002bc [2,head] /dc-dir/dc-file_199 auth v2888 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.965290+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94267700] now 0 2023-10-03T19:21:20.192 INFO:teuthology.orchestra.run.smithi045.stdout: -6945> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+792 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94267700 count now 1/792 2023-10-03T19:21:20.192 INFO:teuthology.orchestra.run.smithi045.stdout: -6944> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002bc) clear_dirty_parent 2023-10-03T19:21:20.192 INFO:teuthology.orchestra.run.smithi045.stdout: -6943> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002bd) _stored_backtrace v 802 2023-10-03T19:21:20.193 INFO:teuthology.orchestra.run.smithi045.stdout: -6942> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002bd) auth_unpin by 0x55cc94270000 on [inode 0x100000002bd [2,head] /dc-dir/dc-file_200 auth v2890 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.975368+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94270000] now 0 2023-10-03T19:21:20.193 INFO:teuthology.orchestra.run.smithi045.stdout: -6941> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+791 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94270000 count now 1/791 2023-10-03T19:21:20.193 INFO:teuthology.orchestra.run.smithi045.stdout: -6940> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002bd) clear_dirty_parent 2023-10-03T19:21:20.193 INFO:teuthology.orchestra.run.smithi045.stdout: -6939> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002be) _stored_backtrace v 806 2023-10-03T19:21:20.193 INFO:teuthology.orchestra.run.smithi045.stdout: -6938> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002be) auth_unpin by 0x55cc94270580 on [inode 0x100000002be [2,head] /dc-dir/dc-file_201 auth v2892 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.985894+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94270580] now 0 2023-10-03T19:21:20.193 INFO:teuthology.orchestra.run.smithi045.stdout: -6937> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+790 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94270580 count now 1/790 2023-10-03T19:21:20.193 INFO:teuthology.orchestra.run.smithi045.stdout: -6936> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002be) clear_dirty_parent 2023-10-03T19:21:20.193 INFO:teuthology.orchestra.run.smithi045.stdout: -6935> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002bf) _stored_backtrace v 810 2023-10-03T19:21:20.193 INFO:teuthology.orchestra.run.smithi045.stdout: -6934> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002bf) auth_unpin by 0x55cc94270b00 on [inode 0x100000002bf [2,head] /dc-dir/dc-file_202 auth v2894 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:47.996258+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94270b00] now 0 2023-10-03T19:21:20.193 INFO:teuthology.orchestra.run.smithi045.stdout: -6933> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+789 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94270b00 count now 1/789 2023-10-03T19:21:20.194 INFO:teuthology.orchestra.run.smithi045.stdout: -6932> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002bf) clear_dirty_parent 2023-10-03T19:21:20.194 INFO:teuthology.orchestra.run.smithi045.stdout: -6931> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c0) _stored_backtrace v 814 2023-10-03T19:21:20.194 INFO:teuthology.orchestra.run.smithi045.stdout: -6930> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c0) auth_unpin by 0x55cc94271080 on [inode 0x100000002c0 [2,head] /dc-dir/dc-file_203 auth v2896 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.006456+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94271080] now 0 2023-10-03T19:21:20.194 INFO:teuthology.orchestra.run.smithi045.stdout: -6929> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+788 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94271080 count now 1/788 2023-10-03T19:21:20.194 INFO:teuthology.orchestra.run.smithi045.stdout: -6928> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c0) clear_dirty_parent 2023-10-03T19:21:20.194 INFO:teuthology.orchestra.run.smithi045.stdout: -6927> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c1) _stored_backtrace v 818 2023-10-03T19:21:20.194 INFO:teuthology.orchestra.run.smithi045.stdout: -6926> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c1) auth_unpin by 0x55cc94271600 on [inode 0x100000002c1 [2,head] /dc-dir/dc-file_204 auth v2898 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.016571+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94271600] now 0 2023-10-03T19:21:20.194 INFO:teuthology.orchestra.run.smithi045.stdout: -6925> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+787 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94271600 count now 1/787 2023-10-03T19:21:20.194 INFO:teuthology.orchestra.run.smithi045.stdout: -6924> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c1) clear_dirty_parent 2023-10-03T19:21:20.194 INFO:teuthology.orchestra.run.smithi045.stdout: -6923> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c2) _stored_backtrace v 822 2023-10-03T19:21:20.194 INFO:teuthology.orchestra.run.smithi045.stdout: -6922> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c2) auth_unpin by 0x55cc94271b80 on [inode 0x100000002c2 [2,head] /dc-dir/dc-file_205 auth v2900 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.026443+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94271b80] now 0 2023-10-03T19:21:20.195 INFO:teuthology.orchestra.run.smithi045.stdout: -6921> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+786 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94271b80 count now 1/786 2023-10-03T19:21:20.195 INFO:teuthology.orchestra.run.smithi045.stdout: -6920> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c2) clear_dirty_parent 2023-10-03T19:21:20.195 INFO:teuthology.orchestra.run.smithi045.stdout: -6919> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c3) _stored_backtrace v 826 2023-10-03T19:21:20.195 INFO:teuthology.orchestra.run.smithi045.stdout: -6918> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c3) auth_unpin by 0x55cc94272100 on [inode 0x100000002c3 [2,head] /dc-dir/dc-file_206 auth v2902 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.037477+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94272100] now 0 2023-10-03T19:21:20.195 INFO:teuthology.orchestra.run.smithi045.stdout: -6917> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+785 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94272100 count now 1/785 2023-10-03T19:21:20.195 INFO:teuthology.orchestra.run.smithi045.stdout: -6916> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c3) clear_dirty_parent 2023-10-03T19:21:20.195 INFO:teuthology.orchestra.run.smithi045.stdout: -6915> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c4) _stored_backtrace v 830 2023-10-03T19:21:20.195 INFO:teuthology.orchestra.run.smithi045.stdout: -6914> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c4) auth_unpin by 0x55cc94272680 on [inode 0x100000002c4 [2,head] /dc-dir/dc-file_207 auth v2904 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.048505+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94272680] now 0 2023-10-03T19:21:20.195 INFO:teuthology.orchestra.run.smithi045.stdout: -6913> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+784 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94272680 count now 1/784 2023-10-03T19:21:20.195 INFO:teuthology.orchestra.run.smithi045.stdout: -6912> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c4) clear_dirty_parent 2023-10-03T19:21:20.195 INFO:teuthology.orchestra.run.smithi045.stdout: -6911> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c5) _stored_backtrace v 834 2023-10-03T19:21:20.196 INFO:teuthology.orchestra.run.smithi045.stdout: -6910> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c5) auth_unpin by 0x55cc94272c00 on [inode 0x100000002c5 [2,head] /dc-dir/dc-file_208 auth v2906 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.060232+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94272c00] now 0 2023-10-03T19:21:20.196 INFO:teuthology.orchestra.run.smithi045.stdout: -6909> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+783 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94272c00 count now 1/783 2023-10-03T19:21:20.196 INFO:teuthology.orchestra.run.smithi045.stdout: -6908> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c5) clear_dirty_parent 2023-10-03T19:21:20.196 INFO:teuthology.orchestra.run.smithi045.stdout: -6907> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c6) _stored_backtrace v 838 2023-10-03T19:21:20.196 INFO:teuthology.orchestra.run.smithi045.stdout: -6906> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c6) auth_unpin by 0x55cc94273180 on [inode 0x100000002c6 [2,head] /dc-dir/dc-file_209 auth v2908 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.072099+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94273180] now 0 2023-10-03T19:21:20.196 INFO:teuthology.orchestra.run.smithi045.stdout: -6905> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+782 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94273180 count now 1/782 2023-10-03T19:21:20.196 INFO:teuthology.orchestra.run.smithi045.stdout: -6904> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c6) clear_dirty_parent 2023-10-03T19:21:20.196 INFO:teuthology.orchestra.run.smithi045.stdout: -6903> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c7) _stored_backtrace v 842 2023-10-03T19:21:20.196 INFO:teuthology.orchestra.run.smithi045.stdout: -6902> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c7) auth_unpin by 0x55cc94273700 on [inode 0x100000002c7 [2,head] /dc-dir/dc-file_210 auth v3198 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.082815+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94273700] now 0 2023-10-03T19:21:20.196 INFO:teuthology.orchestra.run.smithi045.stdout: -6901> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+781 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94273700 count now 1/781 2023-10-03T19:21:20.197 INFO:teuthology.orchestra.run.smithi045.stdout: -6900> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c7) clear_dirty_parent 2023-10-03T19:21:20.197 INFO:teuthology.orchestra.run.smithi045.stdout: -6899> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c8) _stored_backtrace v 846 2023-10-03T19:21:20.197 INFO:teuthology.orchestra.run.smithi045.stdout: -6898> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c8) auth_unpin by 0x55cc94280000 on [inode 0x100000002c8 [2,head] /dc-dir/dc-file_211 auth v3200 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.093685+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94280000] now 0 2023-10-03T19:21:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: -6897> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+780 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94280000 count now 1/780 2023-10-03T19:21:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: -6896> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c8) clear_dirty_parent 2023-10-03T19:21:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: -6895> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c9) _stored_backtrace v 850 2023-10-03T19:21:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: -6894> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c9) auth_unpin by 0x55cc94280580 on [inode 0x100000002c9 [2,head] /dc-dir/dc-file_212 auth v3202 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.104827+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94280580] now 0 2023-10-03T19:21:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: -6893> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+779 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94280580 count now 1/779 2023-10-03T19:21:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: -6892> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c9) clear_dirty_parent 2023-10-03T19:21:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: -6891> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ca) _stored_backtrace v 854 2023-10-03T19:21:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: -6890> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ca) auth_unpin by 0x55cc94280b00 on [inode 0x100000002ca [2,head] /dc-dir/dc-file_213 auth v3204 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.116082+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94280b00] now 0 2023-10-03T19:21:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: -6889> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+778 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94280b00 count now 1/778 2023-10-03T19:21:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: -6888> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ca) clear_dirty_parent 2023-10-03T19:21:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: -6887> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002cb) _stored_backtrace v 858 2023-10-03T19:21:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: -6886> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002cb) auth_unpin by 0x55cc94281080 on [inode 0x100000002cb [2,head] /dc-dir/dc-file_214 auth v3206 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.127237+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94281080] now 0 2023-10-03T19:21:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: -6885> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+777 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94281080 count now 1/777 2023-10-03T19:21:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: -6884> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002cb) clear_dirty_parent 2023-10-03T19:21:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: -6883> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002cc) _stored_backtrace v 862 2023-10-03T19:21:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: -6882> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002cc) auth_unpin by 0x55cc94281600 on [inode 0x100000002cc [2,head] /dc-dir/dc-file_215 auth v3208 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.138200+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94281600] now 0 2023-10-03T19:21:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: -6881> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+776 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94281600 count now 1/776 2023-10-03T19:21:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: -6880> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002cc) clear_dirty_parent 2023-10-03T19:21:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: -6879> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002cd) _stored_backtrace v 866 2023-10-03T19:21:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: -6878> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002cd) auth_unpin by 0x55cc94281b80 on [inode 0x100000002cd [2,head] /dc-dir/dc-file_216 auth v3210 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.149125+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94281b80] now 0 2023-10-03T19:21:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: -6877> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+775 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94281b80 count now 1/775 2023-10-03T19:21:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: -6876> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002cd) clear_dirty_parent 2023-10-03T19:21:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: -6875> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ce) _stored_backtrace v 870 2023-10-03T19:21:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: -6874> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ce) auth_unpin by 0x55cc94282100 on [inode 0x100000002ce [2,head] /dc-dir/dc-file_217 auth v3212 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.161265+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94282100] now 0 2023-10-03T19:21:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: -6873> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+774 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94282100 count now 1/774 2023-10-03T19:21:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: -6872> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ce) clear_dirty_parent 2023-10-03T19:21:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: -6871> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002cf) _stored_backtrace v 874 2023-10-03T19:21:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: -6870> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002cf) auth_unpin by 0x55cc94282680 on [inode 0x100000002cf [2,head] /dc-dir/dc-file_218 auth v3214 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.173659+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94282680] now 0 2023-10-03T19:21:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: -6869> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+773 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94282680 count now 1/773 2023-10-03T19:21:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: -6868> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002cf) clear_dirty_parent 2023-10-03T19:21:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: -6867> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d0) _stored_backtrace v 878 2023-10-03T19:21:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: -6866> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d0) auth_unpin by 0x55cc94282c00 on [inode 0x100000002d0 [2,head] /dc-dir/dc-file_219 auth v3216 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.185152+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94282c00] now 0 2023-10-03T19:21:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: -6865> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+772 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94282c00 count now 1/772 2023-10-03T19:21:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: -6864> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d0) clear_dirty_parent 2023-10-03T19:21:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: -6863> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d1) _stored_backtrace v 882 2023-10-03T19:21:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: -6862> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d1) auth_unpin by 0x55cc94283180 on [inode 0x100000002d1 [2,head] /dc-dir/dc-file_220 auth v3218 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.196217+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94283180] now 0 2023-10-03T19:21:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: -6861> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+771 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94283180 count now 1/771 2023-10-03T19:21:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: -6860> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d1) clear_dirty_parent 2023-10-03T19:21:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: -6859> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d2) _stored_backtrace v 886 2023-10-03T19:21:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: -6858> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d2) auth_unpin by 0x55cc94283700 on [inode 0x100000002d2 [2,head] /dc-dir/dc-file_221 auth v3220 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.206667+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94283700] now 0 2023-10-03T19:21:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: -6857> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+770 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94283700 count now 1/770 2023-10-03T19:21:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: -6856> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d2) clear_dirty_parent 2023-10-03T19:21:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: -6855> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d3) _stored_backtrace v 890 2023-10-03T19:21:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: -6854> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d3) auth_unpin by 0x55cc9428e000 on [inode 0x100000002d3 [2,head] /dc-dir/dc-file_222 auth v3222 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.217761+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9428e000] now 0 2023-10-03T19:21:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: -6853> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+769 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9428e000 count now 1/769 2023-10-03T19:21:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: -6852> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d3) clear_dirty_parent 2023-10-03T19:21:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: -6851> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d4) _stored_backtrace v 894 2023-10-03T19:21:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: -6850> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d4) auth_unpin by 0x55cc9428e580 on [inode 0x100000002d4 [2,head] /dc-dir/dc-file_223 auth v3224 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.228542+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9428e580] now 0 2023-10-03T19:21:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: -6849> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+768 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9428e580 count now 1/768 2023-10-03T19:21:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: -6848> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d4) clear_dirty_parent 2023-10-03T19:21:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: -6847> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d5) _stored_backtrace v 898 2023-10-03T19:21:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: -6846> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d5) auth_unpin by 0x55cc9428eb00 on [inode 0x100000002d5 [2,head] /dc-dir/dc-file_224 auth v3226 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.239446+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9428eb00] now 0 2023-10-03T19:21:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: -6845> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+767 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9428eb00 count now 1/767 2023-10-03T19:21:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: -6844> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d5) clear_dirty_parent 2023-10-03T19:21:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: -6843> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d6) _stored_backtrace v 902 2023-10-03T19:21:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: -6842> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d6) auth_unpin by 0x55cc9428f080 on [inode 0x100000002d6 [2,head] /dc-dir/dc-file_225 auth v3228 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.249894+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9428f080] now 0 2023-10-03T19:21:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: -6841> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+766 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9428f080 count now 1/766 2023-10-03T19:21:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: -6840> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d6) clear_dirty_parent 2023-10-03T19:21:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: -6839> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d7) _stored_backtrace v 906 2023-10-03T19:21:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: -6838> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d7) auth_unpin by 0x55cc9428f600 on [inode 0x100000002d7 [2,head] /dc-dir/dc-file_226 auth v3230 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.260604+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9428f600] now 0 2023-10-03T19:21:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: -6837> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+765 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9428f600 count now 1/765 2023-10-03T19:21:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: -6836> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d7) clear_dirty_parent 2023-10-03T19:21:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: -6835> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d8) _stored_backtrace v 910 2023-10-03T19:21:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: -6834> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d8) auth_unpin by 0x55cc9428fb80 on [inode 0x100000002d8 [2,head] /dc-dir/dc-file_227 auth v3232 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.271413+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9428fb80] now 0 2023-10-03T19:21:20.228 INFO:teuthology.orchestra.run.smithi045.stdout: -6833> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+764 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9428fb80 count now 1/764 2023-10-03T19:21:20.228 INFO:teuthology.orchestra.run.smithi045.stdout: -6832> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d8) clear_dirty_parent 2023-10-03T19:21:20.228 INFO:teuthology.orchestra.run.smithi045.stdout: -6831> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d9) _stored_backtrace v 914 2023-10-03T19:21:20.228 INFO:teuthology.orchestra.run.smithi045.stdout: -6830> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d9) auth_unpin by 0x55cc94290100 on [inode 0x100000002d9 [2,head] /dc-dir/dc-file_228 auth v3234 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.282286+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94290100] now 0 2023-10-03T19:21:20.228 INFO:teuthology.orchestra.run.smithi045.stdout: -6829> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+763 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94290100 count now 1/763 2023-10-03T19:21:20.228 INFO:teuthology.orchestra.run.smithi045.stdout: -6828> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d9) clear_dirty_parent 2023-10-03T19:21:20.228 INFO:teuthology.orchestra.run.smithi045.stdout: -6827> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002da) _stored_backtrace v 918 2023-10-03T19:21:20.228 INFO:teuthology.orchestra.run.smithi045.stdout: -6826> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002da) auth_unpin by 0x55cc94290680 on [inode 0x100000002da [2,head] /dc-dir/dc-file_229 auth v3236 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.292591+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94290680] now 0 2023-10-03T19:21:20.228 INFO:teuthology.orchestra.run.smithi045.stdout: -6825> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+762 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94290680 count now 1/762 2023-10-03T19:21:20.228 INFO:teuthology.orchestra.run.smithi045.stdout: -6824> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002da) clear_dirty_parent 2023-10-03T19:21:20.228 INFO:teuthology.orchestra.run.smithi045.stdout: -6823> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002db) _stored_backtrace v 922 2023-10-03T19:21:20.228 INFO:teuthology.orchestra.run.smithi045.stdout: -6822> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002db) auth_unpin by 0x55cc94290c00 on [inode 0x100000002db [2,head] /dc-dir/dc-file_230 auth v3238 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.304318+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94290c00] now 0 2023-10-03T19:21:20.229 INFO:teuthology.orchestra.run.smithi045.stdout: -6821> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+761 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94290c00 count now 1/761 2023-10-03T19:21:20.229 INFO:teuthology.orchestra.run.smithi045.stdout: -6820> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002db) clear_dirty_parent 2023-10-03T19:21:20.304 INFO:teuthology.orchestra.run.smithi045.stdout: -6819> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002dc) _stored_backtrace v 926 2023-10-03T19:21:20.304 INFO:teuthology.orchestra.run.smithi045.stdout: -6818> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002dc) auth_unpin by 0x55cc94291180 on [inode 0x100000002dc [2,head] /dc-dir/dc-file_231 auth v3240 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.315582+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94291180] now 0 2023-10-03T19:21:20.304 INFO:teuthology.orchestra.run.smithi045.stdout: -6817> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+760 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94291180 count now 1/760 2023-10-03T19:21:20.304 INFO:teuthology.orchestra.run.smithi045.stdout: -6816> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002dc) clear_dirty_parent 2023-10-03T19:21:20.304 INFO:teuthology.orchestra.run.smithi045.stdout: -6815> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002dd) _stored_backtrace v 930 2023-10-03T19:21:20.304 INFO:teuthology.orchestra.run.smithi045.stdout: -6814> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002dd) auth_unpin by 0x55cc94291700 on [inode 0x100000002dd [2,head] /dc-dir/dc-file_232 auth v3242 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.326281+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94291700] now 0 2023-10-03T19:21:20.304 INFO:teuthology.orchestra.run.smithi045.stdout: -6813> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+759 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94291700 count now 1/759 2023-10-03T19:21:20.304 INFO:teuthology.orchestra.run.smithi045.stdout: -6812> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002dd) clear_dirty_parent 2023-10-03T19:21:20.305 INFO:teuthology.orchestra.run.smithi045.stdout: -6811> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002de) _stored_backtrace v 934 2023-10-03T19:21:20.305 INFO:teuthology.orchestra.run.smithi045.stdout: -6810> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002de) auth_unpin by 0x55cc9429e000 on [inode 0x100000002de [2,head] /dc-dir/dc-file_233 auth v3244 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.336393+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9429e000] now 0 2023-10-03T19:21:20.305 INFO:teuthology.orchestra.run.smithi045.stdout: -6809> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+758 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9429e000 count now 1/758 2023-10-03T19:21:20.305 INFO:teuthology.orchestra.run.smithi045.stdout: -6808> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002de) clear_dirty_parent 2023-10-03T19:21:20.305 INFO:teuthology.orchestra.run.smithi045.stdout: -6807> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002df) _stored_backtrace v 938 2023-10-03T19:21:20.305 INFO:teuthology.orchestra.run.smithi045.stdout: -6806> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002df) auth_unpin by 0x55cc9429e580 on [inode 0x100000002df [2,head] /dc-dir/dc-file_234 auth v3246 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.348306+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9429e580] now 0 2023-10-03T19:21:20.305 INFO:teuthology.orchestra.run.smithi045.stdout: -6805> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+757 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9429e580 count now 1/757 2023-10-03T19:21:20.305 INFO:teuthology.orchestra.run.smithi045.stdout: -6804> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002df) clear_dirty_parent 2023-10-03T19:21:20.305 INFO:teuthology.orchestra.run.smithi045.stdout: -6803> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e0) _stored_backtrace v 942 2023-10-03T19:21:20.305 INFO:teuthology.orchestra.run.smithi045.stdout: -6802> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e0) auth_unpin by 0x55cc9429eb00 on [inode 0x100000002e0 [2,head] /dc-dir/dc-file_235 auth v3248 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.358719+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9429eb00] now 0 2023-10-03T19:21:20.306 INFO:teuthology.orchestra.run.smithi045.stdout: -6801> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+756 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9429eb00 count now 1/756 2023-10-03T19:21:20.306 INFO:teuthology.orchestra.run.smithi045.stdout: -6800> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e0) clear_dirty_parent 2023-10-03T19:21:20.306 INFO:teuthology.orchestra.run.smithi045.stdout: -6799> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e1) _stored_backtrace v 946 2023-10-03T19:21:20.306 INFO:teuthology.orchestra.run.smithi045.stdout: -6798> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e1) auth_unpin by 0x55cc9429f080 on [inode 0x100000002e1 [2,head] /dc-dir/dc-file_236 auth v3250 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.368880+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9429f080] now 0 2023-10-03T19:21:20.306 INFO:teuthology.orchestra.run.smithi045.stdout: -6797> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+755 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9429f080 count now 1/755 2023-10-03T19:21:20.306 INFO:teuthology.orchestra.run.smithi045.stdout: -6796> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e1) clear_dirty_parent 2023-10-03T19:21:20.306 INFO:teuthology.orchestra.run.smithi045.stdout: -6795> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e2) _stored_backtrace v 950 2023-10-03T19:21:20.306 INFO:teuthology.orchestra.run.smithi045.stdout: -6794> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e2) auth_unpin by 0x55cc9429f600 on [inode 0x100000002e2 [2,head] /dc-dir/dc-file_237 auth v3252 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.379761+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9429f600] now 0 2023-10-03T19:21:20.306 INFO:teuthology.orchestra.run.smithi045.stdout: -6793> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+754 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9429f600 count now 1/754 2023-10-03T19:21:20.306 INFO:teuthology.orchestra.run.smithi045.stdout: -6792> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e2) clear_dirty_parent 2023-10-03T19:21:20.306 INFO:teuthology.orchestra.run.smithi045.stdout: -6791> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e3) _stored_backtrace v 954 2023-10-03T19:21:20.307 INFO:teuthology.orchestra.run.smithi045.stdout: -6790> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e3) auth_unpin by 0x55cc9429fb80 on [inode 0x100000002e3 [2,head] /dc-dir/dc-file_238 auth v3254 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.391448+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9429fb80] now 0 2023-10-03T19:21:20.307 INFO:teuthology.orchestra.run.smithi045.stdout: -6789> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+753 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9429fb80 count now 1/753 2023-10-03T19:21:20.307 INFO:teuthology.orchestra.run.smithi045.stdout: -6788> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e3) clear_dirty_parent 2023-10-03T19:21:20.307 INFO:teuthology.orchestra.run.smithi045.stdout: -6787> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e4) _stored_backtrace v 958 2023-10-03T19:21:20.307 INFO:teuthology.orchestra.run.smithi045.stdout: -6786> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e4) auth_unpin by 0x55cc942a0100 on [inode 0x100000002e4 [2,head] /dc-dir/dc-file_239 auth v3256 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.404358+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942a0100] now 0 2023-10-03T19:21:20.307 INFO:teuthology.orchestra.run.smithi045.stdout: -6785> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+752 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942a0100 count now 1/752 2023-10-03T19:21:20.307 INFO:teuthology.orchestra.run.smithi045.stdout: -6784> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e4) clear_dirty_parent 2023-10-03T19:21:20.307 INFO:teuthology.orchestra.run.smithi045.stdout: -6783> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e5) _stored_backtrace v 962 2023-10-03T19:21:20.307 INFO:teuthology.orchestra.run.smithi045.stdout: -6782> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e5) auth_unpin by 0x55cc942a0680 on [inode 0x100000002e5 [2,head] /dc-dir/dc-file_240 auth v3258 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.415941+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942a0680] now 0 2023-10-03T19:21:20.307 INFO:teuthology.orchestra.run.smithi045.stdout: -6781> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+751 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942a0680 count now 1/751 2023-10-03T19:21:20.307 INFO:teuthology.orchestra.run.smithi045.stdout: -6780> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e5) clear_dirty_parent 2023-10-03T19:21:20.308 INFO:teuthology.orchestra.run.smithi045.stdout: -6779> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e6) _stored_backtrace v 966 2023-10-03T19:21:20.308 INFO:teuthology.orchestra.run.smithi045.stdout: -6778> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e6) auth_unpin by 0x55cc942a0c00 on [inode 0x100000002e6 [2,head] /dc-dir/dc-file_241 auth v3260 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.427028+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942a0c00] now 0 2023-10-03T19:21:20.308 INFO:teuthology.orchestra.run.smithi045.stdout: -6777> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+750 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942a0c00 count now 1/750 2023-10-03T19:21:20.308 INFO:teuthology.orchestra.run.smithi045.stdout: -6776> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e6) clear_dirty_parent 2023-10-03T19:21:20.308 INFO:teuthology.orchestra.run.smithi045.stdout: -6775> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e7) _stored_backtrace v 970 2023-10-03T19:21:20.308 INFO:teuthology.orchestra.run.smithi045.stdout: -6774> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e7) auth_unpin by 0x55cc942a1180 on [inode 0x100000002e7 [2,head] /dc-dir/dc-file_242 auth v3262 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.440532+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942a1180] now 0 2023-10-03T19:21:20.308 INFO:teuthology.orchestra.run.smithi045.stdout: -6773> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+749 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942a1180 count now 1/749 2023-10-03T19:21:20.308 INFO:teuthology.orchestra.run.smithi045.stdout: -6772> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e7) clear_dirty_parent 2023-10-03T19:21:20.308 INFO:teuthology.orchestra.run.smithi045.stdout: -6771> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e8) _stored_backtrace v 974 2023-10-03T19:21:20.308 INFO:teuthology.orchestra.run.smithi045.stdout: -6770> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e8) auth_unpin by 0x55cc942a1700 on [inode 0x100000002e8 [2,head] /dc-dir/dc-file_243 auth v3264 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.453618+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942a1700] now 0 2023-10-03T19:21:20.309 INFO:teuthology.orchestra.run.smithi045.stdout: -6769> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+748 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942a1700 count now 1/748 2023-10-03T19:21:20.309 INFO:teuthology.orchestra.run.smithi045.stdout: -6768> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e8) clear_dirty_parent 2023-10-03T19:21:20.309 INFO:teuthology.orchestra.run.smithi045.stdout: -6767> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e9) _stored_backtrace v 978 2023-10-03T19:21:20.309 INFO:teuthology.orchestra.run.smithi045.stdout: -6766> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e9) auth_unpin by 0x55cc942b2000 on [inode 0x100000002e9 [2,head] /dc-dir/dc-file_244 auth v3266 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.464466+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942b2000] now 0 2023-10-03T19:21:20.309 INFO:teuthology.orchestra.run.smithi045.stdout: -6765> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+747 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942b2000 count now 1/747 2023-10-03T19:21:20.309 INFO:teuthology.orchestra.run.smithi045.stdout: -6764> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e9) clear_dirty_parent 2023-10-03T19:21:20.309 INFO:teuthology.orchestra.run.smithi045.stdout: -6763> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ea) _stored_backtrace v 982 2023-10-03T19:21:20.309 INFO:teuthology.orchestra.run.smithi045.stdout: -6762> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ea) auth_unpin by 0x55cc942b2580 on [inode 0x100000002ea [2,head] /dc-dir/dc-file_245 auth v3268 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.475794+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942b2580] now 0 2023-10-03T19:21:20.309 INFO:teuthology.orchestra.run.smithi045.stdout: -6761> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+746 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942b2580 count now 1/746 2023-10-03T19:21:20.309 INFO:teuthology.orchestra.run.smithi045.stdout: -6760> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ea) clear_dirty_parent 2023-10-03T19:21:20.309 INFO:teuthology.orchestra.run.smithi045.stdout: -6759> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002eb) _stored_backtrace v 986 2023-10-03T19:21:20.310 INFO:teuthology.orchestra.run.smithi045.stdout: -6758> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002eb) auth_unpin by 0x55cc942b2b00 on [inode 0x100000002eb [2,head] /dc-dir/dc-file_246 auth v3270 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.486630+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942b2b00] now 0 2023-10-03T19:21:20.310 INFO:teuthology.orchestra.run.smithi045.stdout: -6757> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+745 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942b2b00 count now 1/745 2023-10-03T19:21:20.310 INFO:teuthology.orchestra.run.smithi045.stdout: -6756> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002eb) clear_dirty_parent 2023-10-03T19:21:20.310 INFO:teuthology.orchestra.run.smithi045.stdout: -6755> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ec) _stored_backtrace v 990 2023-10-03T19:21:20.310 INFO:teuthology.orchestra.run.smithi045.stdout: -6754> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ec) auth_unpin by 0x55cc942b3080 on [inode 0x100000002ec [2,head] /dc-dir/dc-file_247 auth v3272 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.497646+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942b3080] now 0 2023-10-03T19:21:20.310 INFO:teuthology.orchestra.run.smithi045.stdout: -6753> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+744 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942b3080 count now 1/744 2023-10-03T19:21:20.310 INFO:teuthology.orchestra.run.smithi045.stdout: -6752> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ec) clear_dirty_parent 2023-10-03T19:21:20.310 INFO:teuthology.orchestra.run.smithi045.stdout: -6751> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ed) _stored_backtrace v 994 2023-10-03T19:21:20.339 INFO:teuthology.orchestra.run.smithi045.stdout: -6750> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ed) auth_unpin by 0x55cc942b3600 on [inode 0x100000002ed [2,head] /dc-dir/dc-file_248 auth v3274 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.510566+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942b3600] now 0 2023-10-03T19:21:20.339 INFO:teuthology.orchestra.run.smithi045.stdout: -6749> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+743 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942b3600 count now 1/743 2023-10-03T19:21:20.340 INFO:teuthology.orchestra.run.smithi045.stdout: -6748> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ed) clear_dirty_parent 2023-10-03T19:21:20.340 INFO:teuthology.orchestra.run.smithi045.stdout: -6747> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ee) _stored_backtrace v 998 2023-10-03T19:21:20.340 INFO:teuthology.orchestra.run.smithi045.stdout: -6746> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ee) auth_unpin by 0x55cc942b3b80 on [inode 0x100000002ee [2,head] /dc-dir/dc-file_249 auth v3276 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.524056+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942b3b80] now 0 2023-10-03T19:21:20.340 INFO:teuthology.orchestra.run.smithi045.stdout: -6745> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+742 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942b3b80 count now 1/742 2023-10-03T19:21:20.340 INFO:teuthology.orchestra.run.smithi045.stdout: -6744> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ee) clear_dirty_parent 2023-10-03T19:21:20.340 INFO:teuthology.orchestra.run.smithi045.stdout: -6743> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ef) _stored_backtrace v 1002 2023-10-03T19:21:20.340 INFO:teuthology.orchestra.run.smithi045.stdout: -6742> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ef) auth_unpin by 0x55cc942b4100 on [inode 0x100000002ef [2,head] /dc-dir/dc-file_250 auth v3278 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.537155+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942b4100] now 0 2023-10-03T19:21:20.340 INFO:teuthology.orchestra.run.smithi045.stdout: -6741> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+741 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942b4100 count now 1/741 2023-10-03T19:21:20.340 INFO:teuthology.orchestra.run.smithi045.stdout: -6740> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ef) clear_dirty_parent 2023-10-03T19:21:20.340 INFO:teuthology.orchestra.run.smithi045.stdout: -6739> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f0) _stored_backtrace v 1006 2023-10-03T19:21:20.341 INFO:teuthology.orchestra.run.smithi045.stdout: -6738> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f0) auth_unpin by 0x55cc942b4680 on [inode 0x100000002f0 [2,head] /dc-dir/dc-file_251 auth v3280 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.550095+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942b4680] now 0 2023-10-03T19:21:20.341 INFO:teuthology.orchestra.run.smithi045.stdout: -6737> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+740 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942b4680 count now 1/740 2023-10-03T19:21:20.341 INFO:teuthology.orchestra.run.smithi045.stdout: -6736> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f0) clear_dirty_parent 2023-10-03T19:21:20.341 INFO:teuthology.orchestra.run.smithi045.stdout: -6735> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f1) _stored_backtrace v 1010 2023-10-03T19:21:20.341 INFO:teuthology.orchestra.run.smithi045.stdout: -6734> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f1) auth_unpin by 0x55cc942b4c00 on [inode 0x100000002f1 [2,head] /dc-dir/dc-file_252 auth v3282 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.561807+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942b4c00] now 0 2023-10-03T19:21:20.341 INFO:teuthology.orchestra.run.smithi045.stdout: -6733> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+739 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942b4c00 count now 1/739 2023-10-03T19:21:20.341 INFO:teuthology.orchestra.run.smithi045.stdout: -6732> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f1) clear_dirty_parent 2023-10-03T19:21:20.341 INFO:teuthology.orchestra.run.smithi045.stdout: -6731> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f2) _stored_backtrace v 1014 2023-10-03T19:21:20.341 INFO:teuthology.orchestra.run.smithi045.stdout: -6730> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f2) auth_unpin by 0x55cc942b5180 on [inode 0x100000002f2 [2,head] /dc-dir/dc-file_253 auth v3284 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.572345+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942b5180] now 0 2023-10-03T19:21:20.341 INFO:teuthology.orchestra.run.smithi045.stdout: -6729> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+738 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942b5180 count now 1/738 2023-10-03T19:21:20.341 INFO:teuthology.orchestra.run.smithi045.stdout: -6728> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f2) clear_dirty_parent 2023-10-03T19:21:20.342 INFO:teuthology.orchestra.run.smithi045.stdout: -6727> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f3) _stored_backtrace v 1018 2023-10-03T19:21:20.342 INFO:teuthology.orchestra.run.smithi045.stdout: -6726> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f3) auth_unpin by 0x55cc942b5700 on [inode 0x100000002f3 [2,head] /dc-dir/dc-file_254 auth v3286 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.583838+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942b5700] now 0 2023-10-03T19:21:20.342 INFO:teuthology.orchestra.run.smithi045.stdout: -6725> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+737 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942b5700 count now 1/737 2023-10-03T19:21:20.342 INFO:teuthology.orchestra.run.smithi045.stdout: -6724> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f3) clear_dirty_parent 2023-10-03T19:21:20.342 INFO:teuthology.orchestra.run.smithi045.stdout: -6723> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f4) _stored_backtrace v 1022 2023-10-03T19:21:20.342 INFO:teuthology.orchestra.run.smithi045.stdout: -6722> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f4) auth_unpin by 0x55cc942c0000 on [inode 0x100000002f4 [2,head] /dc-dir/dc-file_255 auth v3288 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.595413+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942c0000] now 0 2023-10-03T19:21:20.342 INFO:teuthology.orchestra.run.smithi045.stdout: -6721> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+736 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942c0000 count now 1/736 2023-10-03T19:21:20.342 INFO:teuthology.orchestra.run.smithi045.stdout: -6720> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f4) clear_dirty_parent 2023-10-03T19:21:20.342 INFO:teuthology.orchestra.run.smithi045.stdout: -6719> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f5) _stored_backtrace v 1026 2023-10-03T19:21:20.342 INFO:teuthology.orchestra.run.smithi045.stdout: -6718> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f5) auth_unpin by 0x55cc942c0580 on [inode 0x100000002f5 [2,head] /dc-dir/dc-file_256 auth v3290 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.607634+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942c0580] now 0 2023-10-03T19:21:20.342 INFO:teuthology.orchestra.run.smithi045.stdout: -6717> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+735 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942c0580 count now 1/735 2023-10-03T19:21:20.343 INFO:teuthology.orchestra.run.smithi045.stdout: -6716> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f5) clear_dirty_parent 2023-10-03T19:21:20.343 INFO:teuthology.orchestra.run.smithi045.stdout: -6715> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f6) _stored_backtrace v 1030 2023-10-03T19:21:20.343 INFO:teuthology.orchestra.run.smithi045.stdout: -6714> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f6) auth_unpin by 0x55cc942c0b00 on [inode 0x100000002f6 [2,head] /dc-dir/dc-file_257 auth v3292 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.618304+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942c0b00] now 0 2023-10-03T19:21:20.343 INFO:teuthology.orchestra.run.smithi045.stdout: -6713> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+734 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942c0b00 count now 1/734 2023-10-03T19:21:20.343 INFO:teuthology.orchestra.run.smithi045.stdout: -6712> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f6) clear_dirty_parent 2023-10-03T19:21:20.343 INFO:teuthology.orchestra.run.smithi045.stdout: -6711> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f7) _stored_backtrace v 1034 2023-10-03T19:21:20.343 INFO:teuthology.orchestra.run.smithi045.stdout: -6710> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f7) auth_unpin by 0x55cc942c1080 on [inode 0x100000002f7 [2,head] /dc-dir/dc-file_258 auth v3294 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.629470+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942c1080] now 0 2023-10-03T19:21:20.343 INFO:teuthology.orchestra.run.smithi045.stdout: -6709> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+733 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942c1080 count now 1/733 2023-10-03T19:21:20.343 INFO:teuthology.orchestra.run.smithi045.stdout: -6708> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f7) clear_dirty_parent 2023-10-03T19:21:20.343 INFO:teuthology.orchestra.run.smithi045.stdout: -6707> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f8) _stored_backtrace v 1038 2023-10-03T19:21:20.343 INFO:teuthology.orchestra.run.smithi045.stdout: -6706> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f8) auth_unpin by 0x55cc942c1600 on [inode 0x100000002f8 [2,head] /dc-dir/dc-file_259 auth v3296 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.640249+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942c1600] now 0 2023-10-03T19:21:20.344 INFO:teuthology.orchestra.run.smithi045.stdout: -6705> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+732 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942c1600 count now 1/732 2023-10-03T19:21:20.344 INFO:teuthology.orchestra.run.smithi045.stdout: -6704> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f8) clear_dirty_parent 2023-10-03T19:21:20.344 INFO:teuthology.orchestra.run.smithi045.stdout: -6703> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f9) _stored_backtrace v 1042 2023-10-03T19:21:20.344 INFO:teuthology.orchestra.run.smithi045.stdout: -6702> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f9) auth_unpin by 0x55cc942c1b80 on [inode 0x100000002f9 [2,head] /dc-dir/dc-file_260 auth v3298 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.651357+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942c1b80] now 0 2023-10-03T19:21:20.344 INFO:teuthology.orchestra.run.smithi045.stdout: -6701> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+731 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942c1b80 count now 1/731 2023-10-03T19:21:20.344 INFO:teuthology.orchestra.run.smithi045.stdout: -6700> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f9) clear_dirty_parent 2023-10-03T19:21:20.344 INFO:teuthology.orchestra.run.smithi045.stdout: -6699> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002fa) _stored_backtrace v 1046 2023-10-03T19:21:20.344 INFO:teuthology.orchestra.run.smithi045.stdout: -6698> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002fa) auth_unpin by 0x55cc942c2100 on [inode 0x100000002fa [2,head] /dc-dir/dc-file_261 auth v3300 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.662672+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942c2100] now 0 2023-10-03T19:21:20.344 INFO:teuthology.orchestra.run.smithi045.stdout: -6697> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+730 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942c2100 count now 1/730 2023-10-03T19:21:20.344 INFO:teuthology.orchestra.run.smithi045.stdout: -6696> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002fa) clear_dirty_parent 2023-10-03T19:21:20.344 INFO:teuthology.orchestra.run.smithi045.stdout: -6695> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002fb) _stored_backtrace v 1050 2023-10-03T19:21:20.345 INFO:teuthology.orchestra.run.smithi045.stdout: -6694> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002fb) auth_unpin by 0x55cc942c2680 on [inode 0x100000002fb [2,head] /dc-dir/dc-file_262 auth v3302 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.674070+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942c2680] now 0 2023-10-03T19:21:20.345 INFO:teuthology.orchestra.run.smithi045.stdout: -6693> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+729 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942c2680 count now 1/729 2023-10-03T19:21:20.345 INFO:teuthology.orchestra.run.smithi045.stdout: -6692> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002fb) clear_dirty_parent 2023-10-03T19:21:20.345 INFO:teuthology.orchestra.run.smithi045.stdout: -6691> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002fc) _stored_backtrace v 1054 2023-10-03T19:21:20.345 INFO:teuthology.orchestra.run.smithi045.stdout: -6690> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002fc) auth_unpin by 0x55cc942c2c00 on [inode 0x100000002fc [2,head] /dc-dir/dc-file_263 auth v3304 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.685826+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942c2c00] now 0 2023-10-03T19:21:20.345 INFO:teuthology.orchestra.run.smithi045.stdout: -6689> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+728 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942c2c00 count now 1/728 2023-10-03T19:21:20.345 INFO:teuthology.orchestra.run.smithi045.stdout: -6688> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002fc) clear_dirty_parent 2023-10-03T19:21:20.345 INFO:teuthology.orchestra.run.smithi045.stdout: -6687> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002fd) _stored_backtrace v 1058 2023-10-03T19:21:20.345 INFO:teuthology.orchestra.run.smithi045.stdout: -6686> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002fd) auth_unpin by 0x55cc942c3180 on [inode 0x100000002fd [2,head] /dc-dir/dc-file_264 auth v3306 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.697314+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942c3180] now 0 2023-10-03T19:21:20.345 INFO:teuthology.orchestra.run.smithi045.stdout: -6685> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+727 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942c3180 count now 1/727 2023-10-03T19:21:20.345 INFO:teuthology.orchestra.run.smithi045.stdout: -6684> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002fd) clear_dirty_parent 2023-10-03T19:21:20.345 INFO:teuthology.orchestra.run.smithi045.stdout: -6683> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002fe) _stored_backtrace v 1062 2023-10-03T19:21:20.346 INFO:teuthology.orchestra.run.smithi045.stdout: -6682> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002fe) auth_unpin by 0x55cc942c3700 on [inode 0x100000002fe [2,head] /dc-dir/dc-file_265 auth v3308 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.709017+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942c3700] now 0 2023-10-03T19:21:20.361 INFO:teuthology.orchestra.run.smithi045.stdout: -6681> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+726 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942c3700 count now 1/726 2023-10-03T19:21:20.362 INFO:teuthology.orchestra.run.smithi045.stdout: -6680> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002fe) clear_dirty_parent 2023-10-03T19:21:20.362 INFO:teuthology.orchestra.run.smithi045.stdout: -6679> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ff) _stored_backtrace v 1066 2023-10-03T19:21:20.362 INFO:teuthology.orchestra.run.smithi045.stdout: -6678> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ff) auth_unpin by 0x55cc942cc000 on [inode 0x100000002ff [2,head] /dc-dir/dc-file_266 auth v3310 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.719919+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942cc000] now 0 2023-10-03T19:21:20.362 INFO:teuthology.orchestra.run.smithi045.stdout: -6677> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+725 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942cc000 count now 1/725 2023-10-03T19:21:20.362 INFO:teuthology.orchestra.run.smithi045.stdout: -6676> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ff) clear_dirty_parent 2023-10-03T19:21:20.362 INFO:teuthology.orchestra.run.smithi045.stdout: -6675> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000300) _stored_backtrace v 1070 2023-10-03T19:21:20.362 INFO:teuthology.orchestra.run.smithi045.stdout: -6674> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000300) auth_unpin by 0x55cc942cc580 on [inode 0x10000000300 [2,head] /dc-dir/dc-file_267 auth v3312 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.731277+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942cc580] now 0 2023-10-03T19:21:20.362 INFO:teuthology.orchestra.run.smithi045.stdout: -6673> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+724 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942cc580 count now 1/724 2023-10-03T19:21:20.362 INFO:teuthology.orchestra.run.smithi045.stdout: -6672> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000300) clear_dirty_parent 2023-10-03T19:21:20.362 INFO:teuthology.orchestra.run.smithi045.stdout: -6671> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000301) _stored_backtrace v 1074 2023-10-03T19:21:20.362 INFO:teuthology.orchestra.run.smithi045.stdout: -6670> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000301) auth_unpin by 0x55cc942ccb00 on [inode 0x10000000301 [2,head] /dc-dir/dc-file_268 auth v3314 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.742375+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942ccb00] now 0 2023-10-03T19:21:20.363 INFO:teuthology.orchestra.run.smithi045.stdout: -6669> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+723 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942ccb00 count now 1/723 2023-10-03T19:21:20.363 INFO:teuthology.orchestra.run.smithi045.stdout: -6668> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000301) clear_dirty_parent 2023-10-03T19:21:20.363 INFO:teuthology.orchestra.run.smithi045.stdout: -6667> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000302) _stored_backtrace v 1078 2023-10-03T19:21:20.363 INFO:teuthology.orchestra.run.smithi045.stdout: -6666> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000302) auth_unpin by 0x55cc942cd080 on [inode 0x10000000302 [2,head] /dc-dir/dc-file_269 auth v3316 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.753863+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942cd080] now 0 2023-10-03T19:21:20.363 INFO:teuthology.orchestra.run.smithi045.stdout: -6665> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+722 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942cd080 count now 1/722 2023-10-03T19:21:20.363 INFO:teuthology.orchestra.run.smithi045.stdout: -6664> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000302) clear_dirty_parent 2023-10-03T19:21:20.363 INFO:teuthology.orchestra.run.smithi045.stdout: -6663> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000303) _stored_backtrace v 1082 2023-10-03T19:21:20.363 INFO:teuthology.orchestra.run.smithi045.stdout: -6662> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000303) auth_unpin by 0x55cc942cd600 on [inode 0x10000000303 [2,head] /dc-dir/dc-file_270 auth v3318 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.764274+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942cd600] now 0 2023-10-03T19:21:20.363 INFO:teuthology.orchestra.run.smithi045.stdout: -6661> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+721 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942cd600 count now 1/721 2023-10-03T19:21:20.363 INFO:teuthology.orchestra.run.smithi045.stdout: -6660> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000303) clear_dirty_parent 2023-10-03T19:21:20.363 INFO:teuthology.orchestra.run.smithi045.stdout: -6659> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000304) _stored_backtrace v 1086 2023-10-03T19:21:20.363 INFO:teuthology.orchestra.run.smithi045.stdout: -6658> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000304) auth_unpin by 0x55cc942cdb80 on [inode 0x10000000304 [2,head] /dc-dir/dc-file_271 auth v3320 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.775045+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942cdb80] now 0 2023-10-03T19:21:20.364 INFO:teuthology.orchestra.run.smithi045.stdout: -6657> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+720 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942cdb80 count now 1/720 2023-10-03T19:21:20.364 INFO:teuthology.orchestra.run.smithi045.stdout: -6656> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000304) clear_dirty_parent 2023-10-03T19:21:20.364 INFO:teuthology.orchestra.run.smithi045.stdout: -6655> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000305) _stored_backtrace v 1090 2023-10-03T19:21:20.364 INFO:teuthology.orchestra.run.smithi045.stdout: -6654> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000305) auth_unpin by 0x55cc942ce100 on [inode 0x10000000305 [2,head] /dc-dir/dc-file_272 auth v3322 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.786300+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942ce100] now 0 2023-10-03T19:21:20.364 INFO:teuthology.orchestra.run.smithi045.stdout: -6653> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+719 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942ce100 count now 1/719 2023-10-03T19:21:20.364 INFO:teuthology.orchestra.run.smithi045.stdout: -6652> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000305) clear_dirty_parent 2023-10-03T19:21:20.364 INFO:teuthology.orchestra.run.smithi045.stdout: -6651> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000306) _stored_backtrace v 1094 2023-10-03T19:21:20.364 INFO:teuthology.orchestra.run.smithi045.stdout: -6650> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000306) auth_unpin by 0x55cc942ce680 on [inode 0x10000000306 [2,head] /dc-dir/dc-file_273 auth v3324 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.797451+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942ce680] now 0 2023-10-03T19:21:20.364 INFO:teuthology.orchestra.run.smithi045.stdout: -6649> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+718 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942ce680 count now 1/718 2023-10-03T19:21:20.364 INFO:teuthology.orchestra.run.smithi045.stdout: -6648> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000306) clear_dirty_parent 2023-10-03T19:21:20.365 INFO:teuthology.orchestra.run.smithi045.stdout: -6647> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000307) _stored_backtrace v 1098 2023-10-03T19:21:20.365 INFO:teuthology.orchestra.run.smithi045.stdout: -6646> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000307) auth_unpin by 0x55cc942cec00 on [inode 0x10000000307 [2,head] /dc-dir/dc-file_274 auth v3326 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.809694+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942cec00] now 0 2023-10-03T19:21:20.365 INFO:teuthology.orchestra.run.smithi045.stdout: -6645> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+717 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942cec00 count now 1/717 2023-10-03T19:21:20.365 INFO:teuthology.orchestra.run.smithi045.stdout: -6644> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000307) clear_dirty_parent 2023-10-03T19:21:20.365 INFO:teuthology.orchestra.run.smithi045.stdout: -6643> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000308) _stored_backtrace v 1102 2023-10-03T19:21:20.365 INFO:teuthology.orchestra.run.smithi045.stdout: -6642> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000308) auth_unpin by 0x55cc942cf180 on [inode 0x10000000308 [2,head] /dc-dir/dc-file_275 auth v3328 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.821057+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942cf180] now 0 2023-10-03T19:21:20.365 INFO:teuthology.orchestra.run.smithi045.stdout: -6641> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+716 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942cf180 count now 1/716 2023-10-03T19:21:20.365 INFO:teuthology.orchestra.run.smithi045.stdout: -6640> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000308) clear_dirty_parent 2023-10-03T19:21:20.365 INFO:teuthology.orchestra.run.smithi045.stdout: -6639> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000309) _stored_backtrace v 1106 2023-10-03T19:21:20.365 INFO:teuthology.orchestra.run.smithi045.stdout: -6638> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000309) auth_unpin by 0x55cc942cf700 on [inode 0x10000000309 [2,head] /dc-dir/dc-file_276 auth v3330 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.833120+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942cf700] now 0 2023-10-03T19:21:20.365 INFO:teuthology.orchestra.run.smithi045.stdout: -6637> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+715 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942cf700 count now 1/715 2023-10-03T19:21:20.365 INFO:teuthology.orchestra.run.smithi045.stdout: -6636> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000309) clear_dirty_parent 2023-10-03T19:21:20.366 INFO:teuthology.orchestra.run.smithi045.stdout: -6635> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000030a) _stored_backtrace v 1110 2023-10-03T19:21:20.366 INFO:teuthology.orchestra.run.smithi045.stdout: -6634> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000030a) auth_unpin by 0x55cc942d4000 on [inode 0x1000000030a [2,head] /dc-dir/dc-file_277 auth v3332 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.844133+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942d4000] now 0 2023-10-03T19:21:20.366 INFO:teuthology.orchestra.run.smithi045.stdout: -6633> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+714 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942d4000 count now 1/714 2023-10-03T19:21:20.366 INFO:teuthology.orchestra.run.smithi045.stdout: -6632> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000030a) clear_dirty_parent 2023-10-03T19:21:20.366 INFO:teuthology.orchestra.run.smithi045.stdout: -6631> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000030b) _stored_backtrace v 1114 2023-10-03T19:21:20.366 INFO:teuthology.orchestra.run.smithi045.stdout: -6630> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000030b) auth_unpin by 0x55cc942d4580 on [inode 0x1000000030b [2,head] /dc-dir/dc-file_278 auth v3334 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.854601+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942d4580] now 0 2023-10-03T19:21:20.366 INFO:teuthology.orchestra.run.smithi045.stdout: -6629> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+713 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942d4580 count now 1/713 2023-10-03T19:21:20.366 INFO:teuthology.orchestra.run.smithi045.stdout: -6628> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000030b) clear_dirty_parent 2023-10-03T19:21:20.366 INFO:teuthology.orchestra.run.smithi045.stdout: -6627> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000030c) _stored_backtrace v 1118 2023-10-03T19:21:20.366 INFO:teuthology.orchestra.run.smithi045.stdout: -6626> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000030c) auth_unpin by 0x55cc942d4b00 on [inode 0x1000000030c [2,head] /dc-dir/dc-file_279 auth v3336 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.867100+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942d4b00] now 0 2023-10-03T19:21:20.366 INFO:teuthology.orchestra.run.smithi045.stdout: -6625> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+712 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942d4b00 count now 1/712 2023-10-03T19:21:20.367 INFO:teuthology.orchestra.run.smithi045.stdout: -6624> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000030c) clear_dirty_parent 2023-10-03T19:21:20.367 INFO:teuthology.orchestra.run.smithi045.stdout: -6623> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000030d) _stored_backtrace v 1122 2023-10-03T19:21:20.367 INFO:teuthology.orchestra.run.smithi045.stdout: -6622> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000030d) auth_unpin by 0x55cc942d5080 on [inode 0x1000000030d [2,head] /dc-dir/dc-file_280 auth v3338 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.878300+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942d5080] now 0 2023-10-03T19:21:20.367 INFO:teuthology.orchestra.run.smithi045.stdout: -6621> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+711 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942d5080 count now 1/711 2023-10-03T19:21:20.367 INFO:teuthology.orchestra.run.smithi045.stdout: -6620> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000030d) clear_dirty_parent 2023-10-03T19:21:20.367 INFO:teuthology.orchestra.run.smithi045.stdout: -6619> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000030e) _stored_backtrace v 1126 2023-10-03T19:21:20.367 INFO:teuthology.orchestra.run.smithi045.stdout: -6618> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000030e) auth_unpin by 0x55cc942d5600 on [inode 0x1000000030e [2,head] /dc-dir/dc-file_281 auth v3340 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.891478+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942d5600] now 0 2023-10-03T19:21:20.367 INFO:teuthology.orchestra.run.smithi045.stdout: -6617> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+710 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942d5600 count now 1/710 2023-10-03T19:21:20.367 INFO:teuthology.orchestra.run.smithi045.stdout: -6616> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000030e) clear_dirty_parent 2023-10-03T19:21:20.367 INFO:teuthology.orchestra.run.smithi045.stdout: -6615> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000030f) _stored_backtrace v 1130 2023-10-03T19:21:20.368 INFO:teuthology.orchestra.run.smithi045.stdout: -6614> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000030f) auth_unpin by 0x55cc942d5b80 on [inode 0x1000000030f [2,head] /dc-dir/dc-file_282 auth v3342 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.902571+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942d5b80] now 0 2023-10-03T19:21:20.368 INFO:teuthology.orchestra.run.smithi045.stdout: -6613> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+709 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942d5b80 count now 1/709 2023-10-03T19:21:20.368 INFO:teuthology.orchestra.run.smithi045.stdout: -6612> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000030f) clear_dirty_parent 2023-10-03T19:21:20.368 INFO:teuthology.orchestra.run.smithi045.stdout: -6611> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000310) _stored_backtrace v 1134 2023-10-03T19:21:20.368 INFO:teuthology.orchestra.run.smithi045.stdout: -6610> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000310) auth_unpin by 0x55cc942d6100 on [inode 0x10000000310 [2,head] /dc-dir/dc-file_283 auth v3344 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.913136+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942d6100] now 0 2023-10-03T19:21:20.368 INFO:teuthology.orchestra.run.smithi045.stdout: -6609> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+708 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942d6100 count now 1/708 2023-10-03T19:21:20.368 INFO:teuthology.orchestra.run.smithi045.stdout: -6608> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000310) clear_dirty_parent 2023-10-03T19:21:20.368 INFO:teuthology.orchestra.run.smithi045.stdout: -6607> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000311) _stored_backtrace v 1138 2023-10-03T19:21:20.368 INFO:teuthology.orchestra.run.smithi045.stdout: -6606> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000311) auth_unpin by 0x55cc942d6680 on [inode 0x10000000311 [2,head] /dc-dir/dc-file_284 auth v3346 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.923551+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942d6680] now 0 2023-10-03T19:21:20.368 INFO:teuthology.orchestra.run.smithi045.stdout: -6605> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+707 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942d6680 count now 1/707 2023-10-03T19:21:20.369 INFO:teuthology.orchestra.run.smithi045.stdout: -6604> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000311) clear_dirty_parent 2023-10-03T19:21:20.369 INFO:teuthology.orchestra.run.smithi045.stdout: -6603> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000312) _stored_backtrace v 1142 2023-10-03T19:21:20.461 INFO:teuthology.orchestra.run.smithi045.stdout: -6602> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000312) auth_unpin by 0x55cc942d6c00 on [inode 0x10000000312 [2,head] /dc-dir/dc-file_285 auth v3348 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.934226+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942d6c00] now 0 2023-10-03T19:21:20.461 INFO:teuthology.orchestra.run.smithi045.stdout: -6601> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+706 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942d6c00 count now 1/706 2023-10-03T19:21:20.461 INFO:teuthology.orchestra.run.smithi045.stdout: -6600> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000312) clear_dirty_parent 2023-10-03T19:21:20.461 INFO:teuthology.orchestra.run.smithi045.stdout: -6599> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000313) _stored_backtrace v 1146 2023-10-03T19:21:20.461 INFO:teuthology.orchestra.run.smithi045.stdout: -6598> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000313) auth_unpin by 0x55cc942d7180 on [inode 0x10000000313 [2,head] /dc-dir/dc-file_286 auth v3350 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.944851+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942d7180] now 0 2023-10-03T19:21:20.462 INFO:teuthology.orchestra.run.smithi045.stdout: -6597> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+705 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942d7180 count now 1/705 2023-10-03T19:21:20.462 INFO:teuthology.orchestra.run.smithi045.stdout: -6596> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000313) clear_dirty_parent 2023-10-03T19:21:20.462 INFO:teuthology.orchestra.run.smithi045.stdout: -6595> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000314) _stored_backtrace v 1150 2023-10-03T19:21:20.462 INFO:teuthology.orchestra.run.smithi045.stdout: -6594> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000314) auth_unpin by 0x55cc942d7700 on [inode 0x10000000314 [2,head] /dc-dir/dc-file_287 auth v3352 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.955690+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942d7700] now 0 2023-10-03T19:21:20.462 INFO:teuthology.orchestra.run.smithi045.stdout: -6593> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+704 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942d7700 count now 1/704 2023-10-03T19:21:20.462 INFO:teuthology.orchestra.run.smithi045.stdout: -6592> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000314) clear_dirty_parent 2023-10-03T19:21:20.463 INFO:teuthology.orchestra.run.smithi045.stdout: -6591> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000315) _stored_backtrace v 1154 2023-10-03T19:21:20.463 INFO:teuthology.orchestra.run.smithi045.stdout: -6590> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000315) auth_unpin by 0x55cc942e4000 on [inode 0x10000000315 [2,head] /dc-dir/dc-file_288 auth v3354 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.969143+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942e4000] now 0 2023-10-03T19:21:20.463 INFO:teuthology.orchestra.run.smithi045.stdout: -6589> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+703 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942e4000 count now 1/703 2023-10-03T19:21:20.463 INFO:teuthology.orchestra.run.smithi045.stdout: -6588> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000315) clear_dirty_parent 2023-10-03T19:21:20.463 INFO:teuthology.orchestra.run.smithi045.stdout: -6587> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000316) _stored_backtrace v 1158 2023-10-03T19:21:20.463 INFO:teuthology.orchestra.run.smithi045.stdout: -6586> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000316) auth_unpin by 0x55cc942e4580 on [inode 0x10000000316 [2,head] /dc-dir/dc-file_289 auth v3356 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.980864+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942e4580] now 0 2023-10-03T19:21:20.464 INFO:teuthology.orchestra.run.smithi045.stdout: -6585> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+702 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942e4580 count now 1/702 2023-10-03T19:21:20.464 INFO:teuthology.orchestra.run.smithi045.stdout: -6584> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000316) clear_dirty_parent 2023-10-03T19:21:20.464 INFO:teuthology.orchestra.run.smithi045.stdout: -6583> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000317) _stored_backtrace v 1162 2023-10-03T19:21:20.464 INFO:teuthology.orchestra.run.smithi045.stdout: -6582> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000317) auth_unpin by 0x55cc942e4b00 on [inode 0x10000000317 [2,head] /dc-dir/dc-file_290 auth v3358 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:48.993729+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942e4b00] now 0 2023-10-03T19:21:20.464 INFO:teuthology.orchestra.run.smithi045.stdout: -6581> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+701 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942e4b00 count now 1/701 2023-10-03T19:21:20.464 INFO:teuthology.orchestra.run.smithi045.stdout: -6580> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000317) clear_dirty_parent 2023-10-03T19:21:20.464 INFO:teuthology.orchestra.run.smithi045.stdout: -6579> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000318) _stored_backtrace v 1166 2023-10-03T19:21:20.464 INFO:teuthology.orchestra.run.smithi045.stdout: -6578> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000318) auth_unpin by 0x55cc942e5080 on [inode 0x10000000318 [2,head] /dc-dir/dc-file_291 auth v3360 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.004322+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942e5080] now 0 2023-10-03T19:21:20.464 INFO:teuthology.orchestra.run.smithi045.stdout: -6577> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+700 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942e5080 count now 1/700 2023-10-03T19:21:20.465 INFO:teuthology.orchestra.run.smithi045.stdout: -6576> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000318) clear_dirty_parent 2023-10-03T19:21:20.465 INFO:teuthology.orchestra.run.smithi045.stdout: -6575> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000319) _stored_backtrace v 1170 2023-10-03T19:21:20.465 INFO:teuthology.orchestra.run.smithi045.stdout: -6574> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000319) auth_unpin by 0x55cc942e5600 on [inode 0x10000000319 [2,head] /dc-dir/dc-file_292 auth v3362 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.016027+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942e5600] now 0 2023-10-03T19:21:20.465 INFO:teuthology.orchestra.run.smithi045.stdout: -6573> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+699 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942e5600 count now 1/699 2023-10-03T19:21:20.465 INFO:teuthology.orchestra.run.smithi045.stdout: -6572> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000319) clear_dirty_parent 2023-10-03T19:21:20.465 INFO:teuthology.orchestra.run.smithi045.stdout: -6571> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000031a) _stored_backtrace v 1174 2023-10-03T19:21:20.465 INFO:teuthology.orchestra.run.smithi045.stdout: -6570> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000031a) auth_unpin by 0x55cc942e5b80 on [inode 0x1000000031a [2,head] /dc-dir/dc-file_293 auth v3364 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.027493+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942e5b80] now 0 2023-10-03T19:21:20.465 INFO:teuthology.orchestra.run.smithi045.stdout: -6569> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+698 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942e5b80 count now 1/698 2023-10-03T19:21:20.465 INFO:teuthology.orchestra.run.smithi045.stdout: -6568> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000031a) clear_dirty_parent 2023-10-03T19:21:20.465 INFO:teuthology.orchestra.run.smithi045.stdout: -6567> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000031b) _stored_backtrace v 1178 2023-10-03T19:21:20.465 INFO:teuthology.orchestra.run.smithi045.stdout: -6566> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000031b) auth_unpin by 0x55cc942e6100 on [inode 0x1000000031b [2,head] /dc-dir/dc-file_294 auth v3366 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.039625+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942e6100] now 0 2023-10-03T19:21:20.465 INFO:teuthology.orchestra.run.smithi045.stdout: -6565> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+697 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942e6100 count now 1/697 2023-10-03T19:21:20.466 INFO:teuthology.orchestra.run.smithi045.stdout: -6564> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000031b) clear_dirty_parent 2023-10-03T19:21:20.466 INFO:teuthology.orchestra.run.smithi045.stdout: -6563> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000031c) _stored_backtrace v 1182 2023-10-03T19:21:20.466 INFO:teuthology.orchestra.run.smithi045.stdout: -6562> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000031c) auth_unpin by 0x55cc942e6680 on [inode 0x1000000031c [2,head] /dc-dir/dc-file_295 auth v3368 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.051486+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942e6680] now 0 2023-10-03T19:21:20.466 INFO:teuthology.orchestra.run.smithi045.stdout: -6561> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+696 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942e6680 count now 1/696 2023-10-03T19:21:20.466 INFO:teuthology.orchestra.run.smithi045.stdout: -6560> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000031c) clear_dirty_parent 2023-10-03T19:21:20.466 INFO:teuthology.orchestra.run.smithi045.stdout: -6559> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000031d) _stored_backtrace v 1186 2023-10-03T19:21:20.466 INFO:teuthology.orchestra.run.smithi045.stdout: -6558> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000031d) auth_unpin by 0x55cc942e6c00 on [inode 0x1000000031d [2,head] /dc-dir/dc-file_296 auth v3370 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.062125+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942e6c00] now 0 2023-10-03T19:21:20.466 INFO:teuthology.orchestra.run.smithi045.stdout: -6557> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+695 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942e6c00 count now 1/695 2023-10-03T19:21:20.466 INFO:teuthology.orchestra.run.smithi045.stdout: -6556> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000031d) clear_dirty_parent 2023-10-03T19:21:20.466 INFO:teuthology.orchestra.run.smithi045.stdout: -6555> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000031e) _stored_backtrace v 1190 2023-10-03T19:21:20.467 INFO:teuthology.orchestra.run.smithi045.stdout: -6554> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000031e) auth_unpin by 0x55cc942e7180 on [inode 0x1000000031e [2,head] /dc-dir/dc-file_297 auth v3372 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.073561+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942e7180] now 0 2023-10-03T19:21:20.467 INFO:teuthology.orchestra.run.smithi045.stdout: -6553> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+694 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942e7180 count now 1/694 2023-10-03T19:21:20.467 INFO:teuthology.orchestra.run.smithi045.stdout: -6552> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000031e) clear_dirty_parent 2023-10-03T19:21:20.467 INFO:teuthology.orchestra.run.smithi045.stdout: -6551> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000031f) _stored_backtrace v 1194 2023-10-03T19:21:20.467 INFO:teuthology.orchestra.run.smithi045.stdout: -6550> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000031f) auth_unpin by 0x55cc942e7700 on [inode 0x1000000031f [2,head] /dc-dir/dc-file_298 auth v3662 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.085668+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942e7700] now 0 2023-10-03T19:21:20.467 INFO:teuthology.orchestra.run.smithi045.stdout: -6549> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+693 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942e7700 count now 1/693 2023-10-03T19:21:20.467 INFO:teuthology.orchestra.run.smithi045.stdout: -6548> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000031f) clear_dirty_parent 2023-10-03T19:21:20.467 INFO:teuthology.orchestra.run.smithi045.stdout: -6547> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000320) _stored_backtrace v 1198 2023-10-03T19:21:20.467 INFO:teuthology.orchestra.run.smithi045.stdout: -6546> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000320) auth_unpin by 0x55cc942f0000 on [inode 0x10000000320 [2,head] /dc-dir/dc-file_299 auth v3664 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.096166+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942f0000] now 0 2023-10-03T19:21:20.467 INFO:teuthology.orchestra.run.smithi045.stdout: -6545> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+692 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942f0000 count now 1/692 2023-10-03T19:21:20.468 INFO:teuthology.orchestra.run.smithi045.stdout: -6544> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000320) clear_dirty_parent 2023-10-03T19:21:20.468 INFO:teuthology.orchestra.run.smithi045.stdout: -6543> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000321) _stored_backtrace v 1202 2023-10-03T19:21:20.468 INFO:teuthology.orchestra.run.smithi045.stdout: -6542> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000321) auth_unpin by 0x55cc942f0580 on [inode 0x10000000321 [2,head] /dc-dir/dc-file_300 auth v3666 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.107871+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942f0580] now 0 2023-10-03T19:21:20.468 INFO:teuthology.orchestra.run.smithi045.stdout: -6541> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+691 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942f0580 count now 1/691 2023-10-03T19:21:20.478 INFO:teuthology.orchestra.run.smithi045.stdout: -6540> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000321) clear_dirty_parent 2023-10-03T19:21:20.478 INFO:teuthology.orchestra.run.smithi045.stdout: -6539> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000322) _stored_backtrace v 1206 2023-10-03T19:21:20.478 INFO:teuthology.orchestra.run.smithi045.stdout: -6538> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000322) auth_unpin by 0x55cc942f0b00 on [inode 0x10000000322 [2,head] /dc-dir/dc-file_301 auth v3668 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.119888+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942f0b00] now 0 2023-10-03T19:21:20.478 INFO:teuthology.orchestra.run.smithi045.stdout: -6537> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+690 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942f0b00 count now 1/690 2023-10-03T19:21:20.478 INFO:teuthology.orchestra.run.smithi045.stdout: -6536> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000322) clear_dirty_parent 2023-10-03T19:21:20.478 INFO:teuthology.orchestra.run.smithi045.stdout: -6535> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000323) _stored_backtrace v 1210 2023-10-03T19:21:20.478 INFO:teuthology.orchestra.run.smithi045.stdout: -6534> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000323) auth_unpin by 0x55cc942f1080 on [inode 0x10000000323 [2,head] /dc-dir/dc-file_302 auth v3670 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.130859+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942f1080] now 0 2023-10-03T19:21:20.478 INFO:teuthology.orchestra.run.smithi045.stdout: -6533> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+689 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942f1080 count now 1/689 2023-10-03T19:21:20.478 INFO:teuthology.orchestra.run.smithi045.stdout: -6532> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000323) clear_dirty_parent 2023-10-03T19:21:20.479 INFO:teuthology.orchestra.run.smithi045.stdout: -6531> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000324) _stored_backtrace v 1214 2023-10-03T19:21:20.479 INFO:teuthology.orchestra.run.smithi045.stdout: -6530> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000324) auth_unpin by 0x55cc942f1600 on [inode 0x10000000324 [2,head] /dc-dir/dc-file_303 auth v3672 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.142314+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942f1600] now 0 2023-10-03T19:21:20.479 INFO:teuthology.orchestra.run.smithi045.stdout: -6529> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+688 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942f1600 count now 1/688 2023-10-03T19:21:20.479 INFO:teuthology.orchestra.run.smithi045.stdout: -6528> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000324) clear_dirty_parent 2023-10-03T19:21:20.479 INFO:teuthology.orchestra.run.smithi045.stdout: -6527> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000325) _stored_backtrace v 1218 2023-10-03T19:21:20.479 INFO:teuthology.orchestra.run.smithi045.stdout: -6526> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000325) auth_unpin by 0x55cc942f1b80 on [inode 0x10000000325 [2,head] /dc-dir/dc-file_304 auth v3674 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.153691+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942f1b80] now 0 2023-10-03T19:21:20.479 INFO:teuthology.orchestra.run.smithi045.stdout: -6525> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+687 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942f1b80 count now 1/687 2023-10-03T19:21:20.479 INFO:teuthology.orchestra.run.smithi045.stdout: -6524> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000325) clear_dirty_parent 2023-10-03T19:21:20.479 INFO:teuthology.orchestra.run.smithi045.stdout: -6523> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000326) _stored_backtrace v 1222 2023-10-03T19:21:20.479 INFO:teuthology.orchestra.run.smithi045.stdout: -6522> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000326) auth_unpin by 0x55cc942f2100 on [inode 0x10000000326 [2,head] /dc-dir/dc-file_305 auth v3676 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.164611+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942f2100] now 0 2023-10-03T19:21:20.480 INFO:teuthology.orchestra.run.smithi045.stdout: -6521> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+686 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942f2100 count now 1/686 2023-10-03T19:21:20.480 INFO:teuthology.orchestra.run.smithi045.stdout: -6520> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000326) clear_dirty_parent 2023-10-03T19:21:20.480 INFO:teuthology.orchestra.run.smithi045.stdout: -6519> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000327) _stored_backtrace v 1226 2023-10-03T19:21:20.480 INFO:teuthology.orchestra.run.smithi045.stdout: -6518> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000327) auth_unpin by 0x55cc942f2680 on [inode 0x10000000327 [2,head] /dc-dir/dc-file_306 auth v3678 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.175465+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942f2680] now 0 2023-10-03T19:21:20.480 INFO:teuthology.orchestra.run.smithi045.stdout: -6517> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+685 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942f2680 count now 1/685 2023-10-03T19:21:20.480 INFO:teuthology.orchestra.run.smithi045.stdout: -6516> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000327) clear_dirty_parent 2023-10-03T19:21:20.480 INFO:teuthology.orchestra.run.smithi045.stdout: -6515> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000328) _stored_backtrace v 1230 2023-10-03T19:21:20.480 INFO:teuthology.orchestra.run.smithi045.stdout: -6514> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000328) auth_unpin by 0x55cc942f2c00 on [inode 0x10000000328 [2,head] /dc-dir/dc-file_307 auth v3680 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.186170+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942f2c00] now 0 2023-10-03T19:21:20.480 INFO:teuthology.orchestra.run.smithi045.stdout: -6513> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+684 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942f2c00 count now 1/684 2023-10-03T19:21:20.480 INFO:teuthology.orchestra.run.smithi045.stdout: -6512> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000328) clear_dirty_parent 2023-10-03T19:21:20.480 INFO:teuthology.orchestra.run.smithi045.stdout: -6511> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000329) _stored_backtrace v 1234 2023-10-03T19:21:20.480 INFO:teuthology.orchestra.run.smithi045.stdout: -6510> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000329) auth_unpin by 0x55cc942f3180 on [inode 0x10000000329 [2,head] /dc-dir/dc-file_308 auth v3682 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.197024+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942f3180] now 0 2023-10-03T19:21:20.481 INFO:teuthology.orchestra.run.smithi045.stdout: -6509> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+683 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942f3180 count now 1/683 2023-10-03T19:21:20.481 INFO:teuthology.orchestra.run.smithi045.stdout: -6508> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000329) clear_dirty_parent 2023-10-03T19:21:20.481 INFO:teuthology.orchestra.run.smithi045.stdout: -6507> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000032a) _stored_backtrace v 1238 2023-10-03T19:21:20.481 INFO:teuthology.orchestra.run.smithi045.stdout: -6506> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000032a) auth_unpin by 0x55cc942f3700 on [inode 0x1000000032a [2,head] /dc-dir/dc-file_309 auth v3684 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.207265+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942f3700] now 0 2023-10-03T19:21:20.481 INFO:teuthology.orchestra.run.smithi045.stdout: -6505> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+682 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942f3700 count now 1/682 2023-10-03T19:21:20.481 INFO:teuthology.orchestra.run.smithi045.stdout: -6504> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000032a) clear_dirty_parent 2023-10-03T19:21:20.481 INFO:teuthology.orchestra.run.smithi045.stdout: -6503> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000032b) _stored_backtrace v 1242 2023-10-03T19:21:20.481 INFO:teuthology.orchestra.run.smithi045.stdout: -6502> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000032b) auth_unpin by 0x55cc942fa000 on [inode 0x1000000032b [2,head] /dc-dir/dc-file_310 auth v3686 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.217610+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942fa000] now 0 2023-10-03T19:21:20.481 INFO:teuthology.orchestra.run.smithi045.stdout: -6501> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+681 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942fa000 count now 1/681 2023-10-03T19:21:20.481 INFO:teuthology.orchestra.run.smithi045.stdout: -6500> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000032b) clear_dirty_parent 2023-10-03T19:21:20.481 INFO:teuthology.orchestra.run.smithi045.stdout: -6499> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000032c) _stored_backtrace v 1246 2023-10-03T19:21:20.481 INFO:teuthology.orchestra.run.smithi045.stdout: -6498> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000032c) auth_unpin by 0x55cc942fa580 on [inode 0x1000000032c [2,head] /dc-dir/dc-file_311 auth v3688 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.228463+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942fa580] now 0 2023-10-03T19:21:20.482 INFO:teuthology.orchestra.run.smithi045.stdout: -6497> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+680 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942fa580 count now 1/680 2023-10-03T19:21:20.482 INFO:teuthology.orchestra.run.smithi045.stdout: -6496> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000032c) clear_dirty_parent 2023-10-03T19:21:20.482 INFO:teuthology.orchestra.run.smithi045.stdout: -6495> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000032d) _stored_backtrace v 1250 2023-10-03T19:21:20.482 INFO:teuthology.orchestra.run.smithi045.stdout: -6494> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000032d) auth_unpin by 0x55cc942fab00 on [inode 0x1000000032d [2,head] /dc-dir/dc-file_312 auth v3690 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.239272+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942fab00] now 0 2023-10-03T19:21:20.482 INFO:teuthology.orchestra.run.smithi045.stdout: -6493> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+679 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942fab00 count now 1/679 2023-10-03T19:21:20.482 INFO:teuthology.orchestra.run.smithi045.stdout: -6492> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000032d) clear_dirty_parent 2023-10-03T19:21:20.482 INFO:teuthology.orchestra.run.smithi045.stdout: -6491> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000032e) _stored_backtrace v 1254 2023-10-03T19:21:20.482 INFO:teuthology.orchestra.run.smithi045.stdout: -6490> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000032e) auth_unpin by 0x55cc942fb080 on [inode 0x1000000032e [2,head] /dc-dir/dc-file_313 auth v3692 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.251104+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942fb080] now 0 2023-10-03T19:21:20.482 INFO:teuthology.orchestra.run.smithi045.stdout: -6489> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+678 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942fb080 count now 1/678 2023-10-03T19:21:20.482 INFO:teuthology.orchestra.run.smithi045.stdout: -6488> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000032e) clear_dirty_parent 2023-10-03T19:21:20.483 INFO:teuthology.orchestra.run.smithi045.stdout: -6487> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000032f) _stored_backtrace v 1258 2023-10-03T19:21:20.483 INFO:teuthology.orchestra.run.smithi045.stdout: -6486> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000032f) auth_unpin by 0x55cc942fb600 on [inode 0x1000000032f [2,head] /dc-dir/dc-file_314 auth v3694 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.262031+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942fb600] now 0 2023-10-03T19:21:20.483 INFO:teuthology.orchestra.run.smithi045.stdout: -6485> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+677 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942fb600 count now 1/677 2023-10-03T19:21:20.483 INFO:teuthology.orchestra.run.smithi045.stdout: -6484> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000032f) clear_dirty_parent 2023-10-03T19:21:20.483 INFO:teuthology.orchestra.run.smithi045.stdout: -6483> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000330) _stored_backtrace v 1262 2023-10-03T19:21:20.483 INFO:teuthology.orchestra.run.smithi045.stdout: -6482> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000330) auth_unpin by 0x55cc942fbb80 on [inode 0x10000000330 [2,head] /dc-dir/dc-file_315 auth v3696 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.273139+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942fbb80] now 0 2023-10-03T19:21:20.483 INFO:teuthology.orchestra.run.smithi045.stdout: -6481> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+676 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942fbb80 count now 1/676 2023-10-03T19:21:20.483 INFO:teuthology.orchestra.run.smithi045.stdout: -6480> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000330) clear_dirty_parent 2023-10-03T19:21:20.483 INFO:teuthology.orchestra.run.smithi045.stdout: -6479> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000331) _stored_backtrace v 1266 2023-10-03T19:21:20.483 INFO:teuthology.orchestra.run.smithi045.stdout: -6478> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000331) auth_unpin by 0x55cc942fc100 on [inode 0x10000000331 [2,head] /dc-dir/dc-file_316 auth v3698 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.283781+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942fc100] now 0 2023-10-03T19:21:20.483 INFO:teuthology.orchestra.run.smithi045.stdout: -6477> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+675 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942fc100 count now 1/675 2023-10-03T19:21:20.483 INFO:teuthology.orchestra.run.smithi045.stdout: -6476> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000331) clear_dirty_parent 2023-10-03T19:21:20.484 INFO:teuthology.orchestra.run.smithi045.stdout: -6475> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000332) _stored_backtrace v 1270 2023-10-03T19:21:20.484 INFO:teuthology.orchestra.run.smithi045.stdout: -6474> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000332) auth_unpin by 0x55cc942fc680 on [inode 0x10000000332 [2,head] /dc-dir/dc-file_317 auth v3700 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.294177+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942fc680] now 0 2023-10-03T19:21:20.484 INFO:teuthology.orchestra.run.smithi045.stdout: -6473> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+674 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942fc680 count now 1/674 2023-10-03T19:21:20.484 INFO:teuthology.orchestra.run.smithi045.stdout: -6472> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000332) clear_dirty_parent 2023-10-03T19:21:20.484 INFO:teuthology.orchestra.run.smithi045.stdout: -6471> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000333) _stored_backtrace v 1274 2023-10-03T19:21:20.484 INFO:teuthology.orchestra.run.smithi045.stdout: -6470> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000333) auth_unpin by 0x55cc942fcc00 on [inode 0x10000000333 [2,head] /dc-dir/dc-file_318 auth v3702 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.304770+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942fcc00] now 0 2023-10-03T19:21:20.484 INFO:teuthology.orchestra.run.smithi045.stdout: -6469> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+673 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942fcc00 count now 1/673 2023-10-03T19:21:20.512 INFO:teuthology.orchestra.run.smithi045.stdout: -6468> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000333) clear_dirty_parent 2023-10-03T19:21:20.512 INFO:teuthology.orchestra.run.smithi045.stdout: -6467> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000334) _stored_backtrace v 1278 2023-10-03T19:21:20.512 INFO:teuthology.orchestra.run.smithi045.stdout: -6466> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000334) auth_unpin by 0x55cc942fd180 on [inode 0x10000000334 [2,head] /dc-dir/dc-file_319 auth v3704 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.315622+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942fd180] now 0 2023-10-03T19:21:20.512 INFO:teuthology.orchestra.run.smithi045.stdout: -6465> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+672 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942fd180 count now 1/672 2023-10-03T19:21:20.512 INFO:teuthology.orchestra.run.smithi045.stdout: -6464> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000334) clear_dirty_parent 2023-10-03T19:21:20.512 INFO:teuthology.orchestra.run.smithi045.stdout: -6463> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000335) _stored_backtrace v 1282 2023-10-03T19:21:20.512 INFO:teuthology.orchestra.run.smithi045.stdout: -6462> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000335) auth_unpin by 0x55cc942fd700 on [inode 0x10000000335 [2,head] /dc-dir/dc-file_320 auth v3706 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.326794+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc942fd700] now 0 2023-10-03T19:21:20.512 INFO:teuthology.orchestra.run.smithi045.stdout: -6461> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+671 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc942fd700 count now 1/671 2023-10-03T19:21:20.512 INFO:teuthology.orchestra.run.smithi045.stdout: -6460> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000335) clear_dirty_parent 2023-10-03T19:21:20.512 INFO:teuthology.orchestra.run.smithi045.stdout: -6459> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000336) _stored_backtrace v 1286 2023-10-03T19:21:20.512 INFO:teuthology.orchestra.run.smithi045.stdout: -6458> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000336) auth_unpin by 0x55cc94304000 on [inode 0x10000000336 [2,head] /dc-dir/dc-file_321 auth v3708 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.337581+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94304000] now 0 2023-10-03T19:21:20.513 INFO:teuthology.orchestra.run.smithi045.stdout: -6457> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+670 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94304000 count now 1/670 2023-10-03T19:21:20.513 INFO:teuthology.orchestra.run.smithi045.stdout: -6456> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000336) clear_dirty_parent 2023-10-03T19:21:20.513 INFO:teuthology.orchestra.run.smithi045.stdout: -6455> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000337) _stored_backtrace v 1290 2023-10-03T19:21:20.513 INFO:teuthology.orchestra.run.smithi045.stdout: -6454> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000337) auth_unpin by 0x55cc94304580 on [inode 0x10000000337 [2,head] /dc-dir/dc-file_322 auth v3710 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.349906+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94304580] now 0 2023-10-03T19:21:20.513 INFO:teuthology.orchestra.run.smithi045.stdout: -6453> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+669 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94304580 count now 1/669 2023-10-03T19:21:20.513 INFO:teuthology.orchestra.run.smithi045.stdout: -6452> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000337) clear_dirty_parent 2023-10-03T19:21:20.513 INFO:teuthology.orchestra.run.smithi045.stdout: -6451> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000338) _stored_backtrace v 1294 2023-10-03T19:21:20.513 INFO:teuthology.orchestra.run.smithi045.stdout: -6450> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000338) auth_unpin by 0x55cc94304b00 on [inode 0x10000000338 [2,head] /dc-dir/dc-file_323 auth v3712 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.361909+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94304b00] now 0 2023-10-03T19:21:20.513 INFO:teuthology.orchestra.run.smithi045.stdout: -6449> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+668 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94304b00 count now 1/668 2023-10-03T19:21:20.513 INFO:teuthology.orchestra.run.smithi045.stdout: -6448> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000338) clear_dirty_parent 2023-10-03T19:21:20.514 INFO:teuthology.orchestra.run.smithi045.stdout: -6447> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000339) _stored_backtrace v 1298 2023-10-03T19:21:20.514 INFO:teuthology.orchestra.run.smithi045.stdout: -6446> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000339) auth_unpin by 0x55cc94305080 on [inode 0x10000000339 [2,head] /dc-dir/dc-file_324 auth v3714 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.373397+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94305080] now 0 2023-10-03T19:21:20.514 INFO:teuthology.orchestra.run.smithi045.stdout: -6445> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+667 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94305080 count now 1/667 2023-10-03T19:21:20.514 INFO:teuthology.orchestra.run.smithi045.stdout: -6444> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000339) clear_dirty_parent 2023-10-03T19:21:20.514 INFO:teuthology.orchestra.run.smithi045.stdout: -6443> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000033a) _stored_backtrace v 1302 2023-10-03T19:21:20.514 INFO:teuthology.orchestra.run.smithi045.stdout: -6442> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000033a) auth_unpin by 0x55cc94305600 on [inode 0x1000000033a [2,head] /dc-dir/dc-file_325 auth v3716 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.385353+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94305600] now 0 2023-10-03T19:21:20.514 INFO:teuthology.orchestra.run.smithi045.stdout: -6441> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+666 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94305600 count now 1/666 2023-10-03T19:21:20.514 INFO:teuthology.orchestra.run.smithi045.stdout: -6440> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000033a) clear_dirty_parent 2023-10-03T19:21:20.514 INFO:teuthology.orchestra.run.smithi045.stdout: -6439> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000033b) _stored_backtrace v 1306 2023-10-03T19:21:20.514 INFO:teuthology.orchestra.run.smithi045.stdout: -6438> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000033b) auth_unpin by 0x55cc94305b80 on [inode 0x1000000033b [2,head] /dc-dir/dc-file_326 auth v3718 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.396265+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94305b80] now 0 2023-10-03T19:21:20.514 INFO:teuthology.orchestra.run.smithi045.stdout: -6437> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+665 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94305b80 count now 1/665 2023-10-03T19:21:20.514 INFO:teuthology.orchestra.run.smithi045.stdout: -6436> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000033b) clear_dirty_parent 2023-10-03T19:21:20.515 INFO:teuthology.orchestra.run.smithi045.stdout: -6435> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000033c) _stored_backtrace v 1310 2023-10-03T19:21:20.515 INFO:teuthology.orchestra.run.smithi045.stdout: -6434> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000033c) auth_unpin by 0x55cc94306100 on [inode 0x1000000033c [2,head] /dc-dir/dc-file_327 auth v3720 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.407478+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94306100] now 0 2023-10-03T19:21:20.515 INFO:teuthology.orchestra.run.smithi045.stdout: -6433> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+664 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94306100 count now 1/664 2023-10-03T19:21:20.515 INFO:teuthology.orchestra.run.smithi045.stdout: -6432> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000033c) clear_dirty_parent 2023-10-03T19:21:20.515 INFO:teuthology.orchestra.run.smithi045.stdout: -6431> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000033d) _stored_backtrace v 1314 2023-10-03T19:21:20.515 INFO:teuthology.orchestra.run.smithi045.stdout: -6430> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000033d) auth_unpin by 0x55cc94306680 on [inode 0x1000000033d [2,head] /dc-dir/dc-file_328 auth v3722 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.418590+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94306680] now 0 2023-10-03T19:21:20.515 INFO:teuthology.orchestra.run.smithi045.stdout: -6429> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+663 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94306680 count now 1/663 2023-10-03T19:21:20.515 INFO:teuthology.orchestra.run.smithi045.stdout: -6428> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000033d) clear_dirty_parent 2023-10-03T19:21:20.515 INFO:teuthology.orchestra.run.smithi045.stdout: -6427> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000033e) _stored_backtrace v 1318 2023-10-03T19:21:20.515 INFO:teuthology.orchestra.run.smithi045.stdout: -6426> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000033e) auth_unpin by 0x55cc94306c00 on [inode 0x1000000033e [2,head] /dc-dir/dc-file_329 auth v3724 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.431640+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94306c00] now 0 2023-10-03T19:21:20.515 INFO:teuthology.orchestra.run.smithi045.stdout: -6425> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+662 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94306c00 count now 1/662 2023-10-03T19:21:20.516 INFO:teuthology.orchestra.run.smithi045.stdout: -6424> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000033e) clear_dirty_parent 2023-10-03T19:21:20.516 INFO:teuthology.orchestra.run.smithi045.stdout: -6423> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000033f) _stored_backtrace v 1322 2023-10-03T19:21:20.516 INFO:teuthology.orchestra.run.smithi045.stdout: -6422> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000033f) auth_unpin by 0x55cc94307180 on [inode 0x1000000033f [2,head] /dc-dir/dc-file_330 auth v3726 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.444665+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94307180] now 0 2023-10-03T19:21:20.516 INFO:teuthology.orchestra.run.smithi045.stdout: -6421> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+661 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94307180 count now 1/661 2023-10-03T19:21:20.516 INFO:teuthology.orchestra.run.smithi045.stdout: -6420> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000033f) clear_dirty_parent 2023-10-03T19:21:20.516 INFO:teuthology.orchestra.run.smithi045.stdout: -6419> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000340) _stored_backtrace v 1326 2023-10-03T19:21:20.516 INFO:teuthology.orchestra.run.smithi045.stdout: -6418> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000340) auth_unpin by 0x55cc94307700 on [inode 0x10000000340 [2,head] /dc-dir/dc-file_331 auth v3728 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.457548+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94307700] now 0 2023-10-03T19:21:20.516 INFO:teuthology.orchestra.run.smithi045.stdout: -6417> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+660 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94307700 count now 1/660 2023-10-03T19:21:20.516 INFO:teuthology.orchestra.run.smithi045.stdout: -6416> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000340) clear_dirty_parent 2023-10-03T19:21:20.517 INFO:teuthology.orchestra.run.smithi045.stdout: -6415> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000341) _stored_backtrace v 1330 2023-10-03T19:21:20.517 INFO:teuthology.orchestra.run.smithi045.stdout: -6414> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000341) auth_unpin by 0x55cc94316000 on [inode 0x10000000341 [2,head] /dc-dir/dc-file_332 auth v3730 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.469879+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94316000] now 0 2023-10-03T19:21:20.517 INFO:teuthology.orchestra.run.smithi045.stdout: -6413> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+659 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94316000 count now 1/659 2023-10-03T19:21:20.517 INFO:teuthology.orchestra.run.smithi045.stdout: -6412> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000341) clear_dirty_parent 2023-10-03T19:21:20.517 INFO:teuthology.orchestra.run.smithi045.stdout: -6411> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000342) _stored_backtrace v 1334 2023-10-03T19:21:20.517 INFO:teuthology.orchestra.run.smithi045.stdout: -6410> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000342) auth_unpin by 0x55cc94316580 on [inode 0x10000000342 [2,head] /dc-dir/dc-file_333 auth v3732 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.481733+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94316580] now 0 2023-10-03T19:21:20.517 INFO:teuthology.orchestra.run.smithi045.stdout: -6409> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+658 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94316580 count now 1/658 2023-10-03T19:21:20.517 INFO:teuthology.orchestra.run.smithi045.stdout: -6408> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000342) clear_dirty_parent 2023-10-03T19:21:20.517 INFO:teuthology.orchestra.run.smithi045.stdout: -6407> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000343) _stored_backtrace v 1338 2023-10-03T19:21:20.517 INFO:teuthology.orchestra.run.smithi045.stdout: -6406> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000343) auth_unpin by 0x55cc94316b00 on [inode 0x10000000343 [2,head] /dc-dir/dc-file_334 auth v3734 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.493123+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94316b00] now 0 2023-10-03T19:21:20.518 INFO:teuthology.orchestra.run.smithi045.stdout: -6405> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+657 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94316b00 count now 1/657 2023-10-03T19:21:20.518 INFO:teuthology.orchestra.run.smithi045.stdout: -6404> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000343) clear_dirty_parent 2023-10-03T19:21:20.518 INFO:teuthology.orchestra.run.smithi045.stdout: -6403> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000344) _stored_backtrace v 1342 2023-10-03T19:21:20.518 INFO:teuthology.orchestra.run.smithi045.stdout: -6402> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000344) auth_unpin by 0x55cc94317080 on [inode 0x10000000344 [2,head] /dc-dir/dc-file_335 auth v3736 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.505611+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94317080] now 0 2023-10-03T19:21:20.518 INFO:teuthology.orchestra.run.smithi045.stdout: -6401> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+656 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94317080 count now 1/656 2023-10-03T19:21:20.518 INFO:teuthology.orchestra.run.smithi045.stdout: -6400> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000344) clear_dirty_parent 2023-10-03T19:21:20.518 INFO:teuthology.orchestra.run.smithi045.stdout: -6399> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000345) _stored_backtrace v 1346 2023-10-03T19:21:20.518 INFO:teuthology.orchestra.run.smithi045.stdout: -6398> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000345) auth_unpin by 0x55cc94317600 on [inode 0x10000000345 [2,head] /dc-dir/dc-file_336 auth v3738 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.518914+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94317600] now 0 2023-10-03T19:21:20.518 INFO:teuthology.orchestra.run.smithi045.stdout: -6397> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+655 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94317600 count now 1/655 2023-10-03T19:21:20.518 INFO:teuthology.orchestra.run.smithi045.stdout: -6396> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000345) clear_dirty_parent 2023-10-03T19:21:20.518 INFO:teuthology.orchestra.run.smithi045.stdout: -6395> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000346) _stored_backtrace v 1350 2023-10-03T19:21:20.519 INFO:teuthology.orchestra.run.smithi045.stdout: -6394> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000346) auth_unpin by 0x55cc94317b80 on [inode 0x10000000346 [2,head] /dc-dir/dc-file_337 auth v3740 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.531491+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94317b80] now 0 2023-10-03T19:21:20.535 INFO:teuthology.orchestra.run.smithi045.stdout: -6393> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+654 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94317b80 count now 1/654 2023-10-03T19:21:20.535 INFO:teuthology.orchestra.run.smithi045.stdout: -6392> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000346) clear_dirty_parent 2023-10-03T19:21:20.535 INFO:teuthology.orchestra.run.smithi045.stdout: -6391> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000347) _stored_backtrace v 1354 2023-10-03T19:21:20.535 INFO:teuthology.orchestra.run.smithi045.stdout: -6390> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000347) auth_unpin by 0x55cc94318100 on [inode 0x10000000347 [2,head] /dc-dir/dc-file_338 auth v3742 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.544311+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94318100] now 0 2023-10-03T19:21:20.535 INFO:teuthology.orchestra.run.smithi045.stdout: -6389> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+653 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94318100 count now 1/653 2023-10-03T19:21:20.536 INFO:teuthology.orchestra.run.smithi045.stdout: -6388> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000347) clear_dirty_parent 2023-10-03T19:21:20.536 INFO:teuthology.orchestra.run.smithi045.stdout: -6387> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000348) _stored_backtrace v 1358 2023-10-03T19:21:20.536 INFO:teuthology.orchestra.run.smithi045.stdout: -6386> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000348) auth_unpin by 0x55cc94318680 on [inode 0x10000000348 [2,head] /dc-dir/dc-file_339 auth v3744 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.556145+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94318680] now 0 2023-10-03T19:21:20.536 INFO:teuthology.orchestra.run.smithi045.stdout: -6385> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+652 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94318680 count now 1/652 2023-10-03T19:21:20.536 INFO:teuthology.orchestra.run.smithi045.stdout: -6384> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000348) clear_dirty_parent 2023-10-03T19:21:20.536 INFO:teuthology.orchestra.run.smithi045.stdout: -6383> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000349) _stored_backtrace v 1362 2023-10-03T19:21:20.536 INFO:teuthology.orchestra.run.smithi045.stdout: -6382> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000349) auth_unpin by 0x55cc94318c00 on [inode 0x10000000349 [2,head] /dc-dir/dc-file_340 auth v3746 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.568068+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94318c00] now 0 2023-10-03T19:21:20.536 INFO:teuthology.orchestra.run.smithi045.stdout: -6381> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+651 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94318c00 count now 1/651 2023-10-03T19:21:20.536 INFO:teuthology.orchestra.run.smithi045.stdout: -6380> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000349) clear_dirty_parent 2023-10-03T19:21:20.536 INFO:teuthology.orchestra.run.smithi045.stdout: -6379> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000034a) _stored_backtrace v 1366 2023-10-03T19:21:20.536 INFO:teuthology.orchestra.run.smithi045.stdout: -6378> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000034a) auth_unpin by 0x55cc94319180 on [inode 0x1000000034a [2,head] /dc-dir/dc-file_341 auth v3748 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.579151+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94319180] now 0 2023-10-03T19:21:20.536 INFO:teuthology.orchestra.run.smithi045.stdout: -6377> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+650 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94319180 count now 1/650 2023-10-03T19:21:20.537 INFO:teuthology.orchestra.run.smithi045.stdout: -6376> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000034a) clear_dirty_parent 2023-10-03T19:21:20.537 INFO:teuthology.orchestra.run.smithi045.stdout: -6375> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000034b) _stored_backtrace v 1370 2023-10-03T19:21:20.537 INFO:teuthology.orchestra.run.smithi045.stdout: -6374> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000034b) auth_unpin by 0x55cc94319700 on [inode 0x1000000034b [2,head] /dc-dir/dc-file_342 auth v3750 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.591950+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94319700] now 0 2023-10-03T19:21:20.537 INFO:teuthology.orchestra.run.smithi045.stdout: -6373> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+649 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94319700 count now 1/649 2023-10-03T19:21:20.537 INFO:teuthology.orchestra.run.smithi045.stdout: -6372> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000034b) clear_dirty_parent 2023-10-03T19:21:20.537 INFO:teuthology.orchestra.run.smithi045.stdout: -6371> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000034c) _stored_backtrace v 1374 2023-10-03T19:21:20.537 INFO:teuthology.orchestra.run.smithi045.stdout: -6370> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000034c) auth_unpin by 0x55cc9432c000 on [inode 0x1000000034c [2,head] /dc-dir/dc-file_343 auth v3752 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.603414+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9432c000] now 0 2023-10-03T19:21:20.537 INFO:teuthology.orchestra.run.smithi045.stdout: -6369> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+648 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9432c000 count now 1/648 2023-10-03T19:21:20.537 INFO:teuthology.orchestra.run.smithi045.stdout: -6368> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000034c) clear_dirty_parent 2023-10-03T19:21:20.537 INFO:teuthology.orchestra.run.smithi045.stdout: -6367> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000034d) _stored_backtrace v 1378 2023-10-03T19:21:20.537 INFO:teuthology.orchestra.run.smithi045.stdout: -6366> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000034d) auth_unpin by 0x55cc9432c580 on [inode 0x1000000034d [2,head] /dc-dir/dc-file_344 auth v3754 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.614825+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9432c580] now 0 2023-10-03T19:21:20.538 INFO:teuthology.orchestra.run.smithi045.stdout: -6365> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+647 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9432c580 count now 1/647 2023-10-03T19:21:20.538 INFO:teuthology.orchestra.run.smithi045.stdout: -6364> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000034d) clear_dirty_parent 2023-10-03T19:21:20.538 INFO:teuthology.orchestra.run.smithi045.stdout: -6363> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000034e) _stored_backtrace v 1382 2023-10-03T19:21:20.538 INFO:teuthology.orchestra.run.smithi045.stdout: -6362> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000034e) auth_unpin by 0x55cc9432cb00 on [inode 0x1000000034e [2,head] /dc-dir/dc-file_345 auth v3756 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.626709+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9432cb00] now 0 2023-10-03T19:21:20.538 INFO:teuthology.orchestra.run.smithi045.stdout: -6361> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+646 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9432cb00 count now 1/646 2023-10-03T19:21:20.538 INFO:teuthology.orchestra.run.smithi045.stdout: -6360> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000034e) clear_dirty_parent 2023-10-03T19:21:20.538 INFO:teuthology.orchestra.run.smithi045.stdout: -6359> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000034f) _stored_backtrace v 1386 2023-10-03T19:21:20.538 INFO:teuthology.orchestra.run.smithi045.stdout: -6358> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000034f) auth_unpin by 0x55cc9432d080 on [inode 0x1000000034f [2,head] /dc-dir/dc-file_346 auth v3758 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.638020+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9432d080] now 0 2023-10-03T19:21:20.538 INFO:teuthology.orchestra.run.smithi045.stdout: -6357> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+645 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9432d080 count now 1/645 2023-10-03T19:21:20.538 INFO:teuthology.orchestra.run.smithi045.stdout: -6356> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000034f) clear_dirty_parent 2023-10-03T19:21:20.539 INFO:teuthology.orchestra.run.smithi045.stdout: -6355> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000350) _stored_backtrace v 1390 2023-10-03T19:21:20.539 INFO:teuthology.orchestra.run.smithi045.stdout: -6354> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000350) auth_unpin by 0x55cc9432d600 on [inode 0x10000000350 [2,head] /dc-dir/dc-file_347 auth v3760 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.649381+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9432d600] now 0 2023-10-03T19:21:20.539 INFO:teuthology.orchestra.run.smithi045.stdout: -6353> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+644 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9432d600 count now 1/644 2023-10-03T19:21:20.539 INFO:teuthology.orchestra.run.smithi045.stdout: -6352> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000350) clear_dirty_parent 2023-10-03T19:21:20.539 INFO:teuthology.orchestra.run.smithi045.stdout: -6351> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000351) _stored_backtrace v 1394 2023-10-03T19:21:20.539 INFO:teuthology.orchestra.run.smithi045.stdout: -6350> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000351) auth_unpin by 0x55cc9432db80 on [inode 0x10000000351 [2,head] /dc-dir/dc-file_348 auth v3762 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.662447+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9432db80] now 0 2023-10-03T19:21:20.539 INFO:teuthology.orchestra.run.smithi045.stdout: -6349> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+643 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9432db80 count now 1/643 2023-10-03T19:21:20.539 INFO:teuthology.orchestra.run.smithi045.stdout: -6348> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000351) clear_dirty_parent 2023-10-03T19:21:20.539 INFO:teuthology.orchestra.run.smithi045.stdout: -6347> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000352) _stored_backtrace v 1398 2023-10-03T19:21:20.539 INFO:teuthology.orchestra.run.smithi045.stdout: -6346> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000352) auth_unpin by 0x55cc9432e100 on [inode 0x10000000352 [2,head] /dc-dir/dc-file_349 auth v3764 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.675224+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9432e100] now 0 2023-10-03T19:21:20.539 INFO:teuthology.orchestra.run.smithi045.stdout: -6345> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+642 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9432e100 count now 1/642 2023-10-03T19:21:20.540 INFO:teuthology.orchestra.run.smithi045.stdout: -6344> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000352) clear_dirty_parent 2023-10-03T19:21:20.540 INFO:teuthology.orchestra.run.smithi045.stdout: -6343> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000353) _stored_backtrace v 1402 2023-10-03T19:21:20.540 INFO:teuthology.orchestra.run.smithi045.stdout: -6342> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000353) auth_unpin by 0x55cc9432e680 on [inode 0x10000000353 [2,head] /dc-dir/dc-file_350 auth v3766 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.688208+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9432e680] now 0 2023-10-03T19:21:20.540 INFO:teuthology.orchestra.run.smithi045.stdout: -6341> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+641 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9432e680 count now 1/641 2023-10-03T19:21:20.540 INFO:teuthology.orchestra.run.smithi045.stdout: -6340> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000353) clear_dirty_parent 2023-10-03T19:21:20.540 INFO:teuthology.orchestra.run.smithi045.stdout: -6339> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000354) _stored_backtrace v 1406 2023-10-03T19:21:20.540 INFO:teuthology.orchestra.run.smithi045.stdout: -6338> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000354) auth_unpin by 0x55cc9432ec00 on [inode 0x10000000354 [2,head] /dc-dir/dc-file_351 auth v3768 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.701286+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9432ec00] now 0 2023-10-03T19:21:20.540 INFO:teuthology.orchestra.run.smithi045.stdout: -6337> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+640 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9432ec00 count now 1/640 2023-10-03T19:21:20.540 INFO:teuthology.orchestra.run.smithi045.stdout: -6336> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000354) clear_dirty_parent 2023-10-03T19:21:20.540 INFO:teuthology.orchestra.run.smithi045.stdout: -6335> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000355) _stored_backtrace v 1410 2023-10-03T19:21:20.540 INFO:teuthology.orchestra.run.smithi045.stdout: -6334> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000355) auth_unpin by 0x55cc9432f180 on [inode 0x10000000355 [2,head] /dc-dir/dc-file_352 auth v3770 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.713087+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9432f180] now 0 2023-10-03T19:21:20.540 INFO:teuthology.orchestra.run.smithi045.stdout: -6333> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+639 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9432f180 count now 1/639 2023-10-03T19:21:20.540 INFO:teuthology.orchestra.run.smithi045.stdout: -6332> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000355) clear_dirty_parent 2023-10-03T19:21:20.541 INFO:teuthology.orchestra.run.smithi045.stdout: -6331> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000356) _stored_backtrace v 1414 2023-10-03T19:21:20.541 INFO:teuthology.orchestra.run.smithi045.stdout: -6330> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000356) auth_unpin by 0x55cc9432f700 on [inode 0x10000000356 [2,head] /dc-dir/dc-file_353 auth v3772 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.724111+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9432f700] now 0 2023-10-03T19:21:20.541 INFO:teuthology.orchestra.run.smithi045.stdout: -6329> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+638 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9432f700 count now 1/638 2023-10-03T19:21:20.541 INFO:teuthology.orchestra.run.smithi045.stdout: -6328> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000356) clear_dirty_parent 2023-10-03T19:21:20.541 INFO:teuthology.orchestra.run.smithi045.stdout: -6327> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000357) _stored_backtrace v 1418 2023-10-03T19:21:20.541 INFO:teuthology.orchestra.run.smithi045.stdout: -6326> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000357) auth_unpin by 0x55cc94336000 on [inode 0x10000000357 [2,head] /dc-dir/dc-file_354 auth v3774 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.735970+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94336000] now 0 2023-10-03T19:21:20.541 INFO:teuthology.orchestra.run.smithi045.stdout: -6325> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+637 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94336000 count now 1/637 2023-10-03T19:21:20.541 INFO:teuthology.orchestra.run.smithi045.stdout: -6324> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000357) clear_dirty_parent 2023-10-03T19:21:20.541 INFO:teuthology.orchestra.run.smithi045.stdout: -6323> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000358) _stored_backtrace v 1422 2023-10-03T19:21:20.541 INFO:teuthology.orchestra.run.smithi045.stdout: -6322> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000358) auth_unpin by 0x55cc94336580 on [inode 0x10000000358 [2,head] /dc-dir/dc-file_355 auth v3776 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.747835+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94336580] now 0 2023-10-03T19:21:20.542 INFO:teuthology.orchestra.run.smithi045.stdout: -6321> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+636 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94336580 count now 1/636 2023-10-03T19:21:20.633 INFO:teuthology.orchestra.run.smithi045.stdout: -6320> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000358) clear_dirty_parent 2023-10-03T19:21:20.633 INFO:teuthology.orchestra.run.smithi045.stdout: -6319> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000359) _stored_backtrace v 1426 2023-10-03T19:21:20.633 INFO:teuthology.orchestra.run.smithi045.stdout: -6318> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000359) auth_unpin by 0x55cc94336b00 on [inode 0x10000000359 [2,head] /dc-dir/dc-file_356 auth v3778 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.759287+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94336b00] now 0 2023-10-03T19:21:20.633 INFO:teuthology.orchestra.run.smithi045.stdout: -6317> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+635 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94336b00 count now 1/635 2023-10-03T19:21:20.634 INFO:teuthology.orchestra.run.smithi045.stdout: -6316> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000359) clear_dirty_parent 2023-10-03T19:21:20.634 INFO:teuthology.orchestra.run.smithi045.stdout: -6315> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000035a) _stored_backtrace v 1430 2023-10-03T19:21:20.634 INFO:teuthology.orchestra.run.smithi045.stdout: -6314> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000035a) auth_unpin by 0x55cc94337080 on [inode 0x1000000035a [2,head] /dc-dir/dc-file_357 auth v3780 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.770498+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94337080] now 0 2023-10-03T19:21:20.634 INFO:teuthology.orchestra.run.smithi045.stdout: -6313> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+634 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94337080 count now 1/634 2023-10-03T19:21:20.634 INFO:teuthology.orchestra.run.smithi045.stdout: -6312> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000035a) clear_dirty_parent 2023-10-03T19:21:20.634 INFO:teuthology.orchestra.run.smithi045.stdout: -6311> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000035b) _stored_backtrace v 1434 2023-10-03T19:21:20.634 INFO:teuthology.orchestra.run.smithi045.stdout: -6310> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000035b) auth_unpin by 0x55cc94337600 on [inode 0x1000000035b [2,head] /dc-dir/dc-file_358 auth v3782 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.781307+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94337600] now 0 2023-10-03T19:21:20.634 INFO:teuthology.orchestra.run.smithi045.stdout: -6309> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+633 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94337600 count now 1/633 2023-10-03T19:21:20.634 INFO:teuthology.orchestra.run.smithi045.stdout: -6308> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000035b) clear_dirty_parent 2023-10-03T19:21:20.634 INFO:teuthology.orchestra.run.smithi045.stdout: -6307> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000035c) _stored_backtrace v 1438 2023-10-03T19:21:20.634 INFO:teuthology.orchestra.run.smithi045.stdout: -6306> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000035c) auth_unpin by 0x55cc94337b80 on [inode 0x1000000035c [2,head] /dc-dir/dc-file_359 auth v3784 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.793159+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94337b80] now 0 2023-10-03T19:21:20.635 INFO:teuthology.orchestra.run.smithi045.stdout: -6305> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+632 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94337b80 count now 1/632 2023-10-03T19:21:20.635 INFO:teuthology.orchestra.run.smithi045.stdout: -6304> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000035c) clear_dirty_parent 2023-10-03T19:21:20.635 INFO:teuthology.orchestra.run.smithi045.stdout: -6303> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000035d) _stored_backtrace v 1442 2023-10-03T19:21:20.635 INFO:teuthology.orchestra.run.smithi045.stdout: -6302> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000035d) auth_unpin by 0x55cc94338100 on [inode 0x1000000035d [2,head] /dc-dir/dc-file_360 auth v3786 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.805069+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94338100] now 0 2023-10-03T19:21:20.635 INFO:teuthology.orchestra.run.smithi045.stdout: -6301> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+631 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94338100 count now 1/631 2023-10-03T19:21:20.635 INFO:teuthology.orchestra.run.smithi045.stdout: -6300> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000035d) clear_dirty_parent 2023-10-03T19:21:20.635 INFO:teuthology.orchestra.run.smithi045.stdout: -6299> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000035e) _stored_backtrace v 1446 2023-10-03T19:21:20.635 INFO:teuthology.orchestra.run.smithi045.stdout: -6298> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000035e) auth_unpin by 0x55cc94338680 on [inode 0x1000000035e [2,head] /dc-dir/dc-file_361 auth v3788 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.817384+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94338680] now 0 2023-10-03T19:21:20.635 INFO:teuthology.orchestra.run.smithi045.stdout: -6297> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+630 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94338680 count now 1/630 2023-10-03T19:21:20.635 INFO:teuthology.orchestra.run.smithi045.stdout: -6296> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000035e) clear_dirty_parent 2023-10-03T19:21:20.636 INFO:teuthology.orchestra.run.smithi045.stdout: -6295> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000035f) _stored_backtrace v 1450 2023-10-03T19:21:20.636 INFO:teuthology.orchestra.run.smithi045.stdout: -6294> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000035f) auth_unpin by 0x55cc94338c00 on [inode 0x1000000035f [2,head] /dc-dir/dc-file_362 auth v3790 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.829255+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94338c00] now 0 2023-10-03T19:21:20.636 INFO:teuthology.orchestra.run.smithi045.stdout: -6293> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+629 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94338c00 count now 1/629 2023-10-03T19:21:20.636 INFO:teuthology.orchestra.run.smithi045.stdout: -6292> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000035f) clear_dirty_parent 2023-10-03T19:21:20.636 INFO:teuthology.orchestra.run.smithi045.stdout: -6291> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000360) _stored_backtrace v 1454 2023-10-03T19:21:20.636 INFO:teuthology.orchestra.run.smithi045.stdout: -6290> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000360) auth_unpin by 0x55cc94339180 on [inode 0x10000000360 [2,head] /dc-dir/dc-file_363 auth v3792 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.840860+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94339180] now 0 2023-10-03T19:21:20.636 INFO:teuthology.orchestra.run.smithi045.stdout: -6289> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+628 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94339180 count now 1/628 2023-10-03T19:21:20.636 INFO:teuthology.orchestra.run.smithi045.stdout: -6288> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000360) clear_dirty_parent 2023-10-03T19:21:20.636 INFO:teuthology.orchestra.run.smithi045.stdout: -6287> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000361) _stored_backtrace v 1458 2023-10-03T19:21:20.636 INFO:teuthology.orchestra.run.smithi045.stdout: -6286> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000361) auth_unpin by 0x55cc94339700 on [inode 0x10000000361 [2,head] /dc-dir/dc-file_364 auth v3794 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.852759+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94339700] now 0 2023-10-03T19:21:20.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6285> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+627 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94339700 count now 1/627 2023-10-03T19:21:20.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6284> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000361) clear_dirty_parent 2023-10-03T19:21:20.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6283> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000362) _stored_backtrace v 1462 2023-10-03T19:21:20.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6282> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000362) auth_unpin by 0x55cc9433e000 on [inode 0x10000000362 [2,head] /dc-dir/dc-file_365 auth v3796 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.864612+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9433e000] now 0 2023-10-03T19:21:20.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6281> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+626 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9433e000 count now 1/626 2023-10-03T19:21:20.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6280> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000362) clear_dirty_parent 2023-10-03T19:21:20.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6279> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000363) _stored_backtrace v 1466 2023-10-03T19:21:20.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6278> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000363) auth_unpin by 0x55cc9433e580 on [inode 0x10000000363 [2,head] /dc-dir/dc-file_366 auth v3798 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.875708+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9433e580] now 0 2023-10-03T19:21:20.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6277> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+625 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9433e580 count now 1/625 2023-10-03T19:21:20.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6276> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000363) clear_dirty_parent 2023-10-03T19:21:20.637 INFO:teuthology.orchestra.run.smithi045.stdout: -6275> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000364) _stored_backtrace v 1470 2023-10-03T19:21:20.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6274> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000364) auth_unpin by 0x55cc9433eb00 on [inode 0x10000000364 [2,head] /dc-dir/dc-file_367 auth v3800 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.888555+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9433eb00] now 0 2023-10-03T19:21:20.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6273> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+624 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9433eb00 count now 1/624 2023-10-03T19:21:20.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6272> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000364) clear_dirty_parent 2023-10-03T19:21:20.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6271> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000365) _stored_backtrace v 1474 2023-10-03T19:21:20.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6270> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000365) auth_unpin by 0x55cc9433f080 on [inode 0x10000000365 [2,head] /dc-dir/dc-file_368 auth v3802 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.901651+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9433f080] now 0 2023-10-03T19:21:20.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6269> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+623 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9433f080 count now 1/623 2023-10-03T19:21:20.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6268> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000365) clear_dirty_parent 2023-10-03T19:21:20.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6267> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000366) _stored_backtrace v 1478 2023-10-03T19:21:20.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6266> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000366) auth_unpin by 0x55cc9433f600 on [inode 0x10000000366 [2,head] /dc-dir/dc-file_369 auth v3804 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.913868+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9433f600] now 0 2023-10-03T19:21:20.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6265> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+622 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9433f600 count now 1/622 2023-10-03T19:21:20.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6264> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000366) clear_dirty_parent 2023-10-03T19:21:20.638 INFO:teuthology.orchestra.run.smithi045.stdout: -6263> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000367) _stored_backtrace v 1482 2023-10-03T19:21:20.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6262> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000367) auth_unpin by 0x55cc9433fb80 on [inode 0x10000000367 [2,head] /dc-dir/dc-file_370 auth v3806 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.925429+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9433fb80] now 0 2023-10-03T19:21:20.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6261> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+621 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9433fb80 count now 1/621 2023-10-03T19:21:20.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6260> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000367) clear_dirty_parent 2023-10-03T19:21:20.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6259> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000368) _stored_backtrace v 1486 2023-10-03T19:21:20.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6258> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000368) auth_unpin by 0x55cc94340100 on [inode 0x10000000368 [2,head] /dc-dir/dc-file_371 auth v3808 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.936977+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94340100] now 0 2023-10-03T19:21:20.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6257> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+620 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94340100 count now 1/620 2023-10-03T19:21:20.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6256> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000368) clear_dirty_parent 2023-10-03T19:21:20.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6255> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000369) _stored_backtrace v 1490 2023-10-03T19:21:20.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6254> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000369) auth_unpin by 0x55cc94340680 on [inode 0x10000000369 [2,head] /dc-dir/dc-file_372 auth v3810 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.947835+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94340680] now 0 2023-10-03T19:21:20.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6253> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+619 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94340680 count now 1/619 2023-10-03T19:21:20.639 INFO:teuthology.orchestra.run.smithi045.stdout: -6252> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000369) clear_dirty_parent 2023-10-03T19:21:20.640 INFO:teuthology.orchestra.run.smithi045.stdout: -6251> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000036a) _stored_backtrace v 1494 2023-10-03T19:21:20.640 INFO:teuthology.orchestra.run.smithi045.stdout: -6250> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000036a) auth_unpin by 0x55cc94340c00 on [inode 0x1000000036a [2,head] /dc-dir/dc-file_373 auth v3812 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.959051+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94340c00] now 0 2023-10-03T19:21:20.640 INFO:teuthology.orchestra.run.smithi045.stdout: -6249> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+618 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94340c00 count now 1/618 2023-10-03T19:21:20.640 INFO:teuthology.orchestra.run.smithi045.stdout: -6248> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000036a) clear_dirty_parent 2023-10-03T19:21:20.640 INFO:teuthology.orchestra.run.smithi045.stdout: -6247> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000036b) _stored_backtrace v 1498 2023-10-03T19:21:20.640 INFO:teuthology.orchestra.run.smithi045.stdout: -6246> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000036b) auth_unpin by 0x55cc94341180 on [inode 0x1000000036b [2,head] /dc-dir/dc-file_374 auth v3814 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.969833+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94341180] now 0 2023-10-03T19:21:20.640 INFO:teuthology.orchestra.run.smithi045.stdout: -6245> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+617 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94341180 count now 1/617 2023-10-03T19:21:20.640 INFO:teuthology.orchestra.run.smithi045.stdout: -6244> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000036b) clear_dirty_parent 2023-10-03T19:21:20.640 INFO:teuthology.orchestra.run.smithi045.stdout: -6243> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000036c) _stored_backtrace v 1502 2023-10-03T19:21:20.640 INFO:teuthology.orchestra.run.smithi045.stdout: -6242> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000036c) auth_unpin by 0x55cc94341700 on [inode 0x1000000036c [2,head] /dc-dir/dc-file_375 auth v3816 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.981314+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94341700] now 0 2023-10-03T19:21:20.640 INFO:teuthology.orchestra.run.smithi045.stdout: -6241> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+616 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94341700 count now 1/616 2023-10-03T19:21:20.668 INFO:teuthology.orchestra.run.smithi045.stdout: -6240> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000036c) clear_dirty_parent 2023-10-03T19:21:20.668 INFO:teuthology.orchestra.run.smithi045.stdout: -6239> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000036d) _stored_backtrace v 1506 2023-10-03T19:21:20.668 INFO:teuthology.orchestra.run.smithi045.stdout: -6238> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000036d) auth_unpin by 0x55cc94348000 on [inode 0x1000000036d [2,head] /dc-dir/dc-file_376 auth v3818 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:49.992888+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94348000] now 0 2023-10-03T19:21:20.669 INFO:teuthology.orchestra.run.smithi045.stdout: -6237> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+615 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94348000 count now 1/615 2023-10-03T19:21:20.669 INFO:teuthology.orchestra.run.smithi045.stdout: -6236> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000036d) clear_dirty_parent 2023-10-03T19:21:20.669 INFO:teuthology.orchestra.run.smithi045.stdout: -6235> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000036e) _stored_backtrace v 1510 2023-10-03T19:21:20.669 INFO:teuthology.orchestra.run.smithi045.stdout: -6234> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000036e) auth_unpin by 0x55cc94348580 on [inode 0x1000000036e [2,head] /dc-dir/dc-file_377 auth v3820 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.005981+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94348580] now 0 2023-10-03T19:21:20.669 INFO:teuthology.orchestra.run.smithi045.stdout: -6233> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+614 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94348580 count now 1/614 2023-10-03T19:21:20.669 INFO:teuthology.orchestra.run.smithi045.stdout: -6232> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000036e) clear_dirty_parent 2023-10-03T19:21:20.669 INFO:teuthology.orchestra.run.smithi045.stdout: -6231> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000036f) _stored_backtrace v 1514 2023-10-03T19:21:20.669 INFO:teuthology.orchestra.run.smithi045.stdout: -6230> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000036f) auth_unpin by 0x55cc94348b00 on [inode 0x1000000036f [2,head] /dc-dir/dc-file_378 auth v3822 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.020352+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94348b00] now 0 2023-10-03T19:21:20.669 INFO:teuthology.orchestra.run.smithi045.stdout: -6229> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+613 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94348b00 count now 1/613 2023-10-03T19:21:20.669 INFO:teuthology.orchestra.run.smithi045.stdout: -6228> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000036f) clear_dirty_parent 2023-10-03T19:21:20.670 INFO:teuthology.orchestra.run.smithi045.stdout: -6227> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000370) _stored_backtrace v 1518 2023-10-03T19:21:20.670 INFO:teuthology.orchestra.run.smithi045.stdout: -6226> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000370) auth_unpin by 0x55cc94349080 on [inode 0x10000000370 [2,head] /dc-dir/dc-file_379 auth v3824 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.032829+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94349080] now 0 2023-10-03T19:21:20.670 INFO:teuthology.orchestra.run.smithi045.stdout: -6225> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+612 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94349080 count now 1/612 2023-10-03T19:21:20.670 INFO:teuthology.orchestra.run.smithi045.stdout: -6224> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000370) clear_dirty_parent 2023-10-03T19:21:20.670 INFO:teuthology.orchestra.run.smithi045.stdout: -6223> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000371) _stored_backtrace v 1522 2023-10-03T19:21:20.670 INFO:teuthology.orchestra.run.smithi045.stdout: -6222> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000371) auth_unpin by 0x55cc94349600 on [inode 0x10000000371 [2,head] /dc-dir/dc-file_380 auth v3826 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.045450+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94349600] now 0 2023-10-03T19:21:20.670 INFO:teuthology.orchestra.run.smithi045.stdout: -6221> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+611 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94349600 count now 1/611 2023-10-03T19:21:20.670 INFO:teuthology.orchestra.run.smithi045.stdout: -6220> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000371) clear_dirty_parent 2023-10-03T19:21:20.670 INFO:teuthology.orchestra.run.smithi045.stdout: -6219> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000372) _stored_backtrace v 1526 2023-10-03T19:21:20.670 INFO:teuthology.orchestra.run.smithi045.stdout: -6218> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000372) auth_unpin by 0x55cc94349b80 on [inode 0x10000000372 [2,head] /dc-dir/dc-file_381 auth v3828 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.057047+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94349b80] now 0 2023-10-03T19:21:20.670 INFO:teuthology.orchestra.run.smithi045.stdout: -6217> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+610 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94349b80 count now 1/610 2023-10-03T19:21:20.670 INFO:teuthology.orchestra.run.smithi045.stdout: -6216> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000372) clear_dirty_parent 2023-10-03T19:21:20.671 INFO:teuthology.orchestra.run.smithi045.stdout: -6215> 2023-10-03T19:18:09.849+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000373) _stored_backtrace v 1530 2023-10-03T19:21:20.671 INFO:teuthology.orchestra.run.smithi045.stdout: -6214> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000373) auth_unpin by 0x55cc9434a100 on [inode 0x10000000373 [2,head] /dc-dir/dc-file_382 auth v3830 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.070572+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9434a100] now 0 2023-10-03T19:21:20.671 INFO:teuthology.orchestra.run.smithi045.stdout: -6213> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+609 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9434a100 count now 1/609 2023-10-03T19:21:20.671 INFO:teuthology.orchestra.run.smithi045.stdout: -6212> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000373) clear_dirty_parent 2023-10-03T19:21:20.671 INFO:teuthology.orchestra.run.smithi045.stdout: -6211> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000374) _stored_backtrace v 1534 2023-10-03T19:21:20.671 INFO:teuthology.orchestra.run.smithi045.stdout: -6210> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000374) auth_unpin by 0x55cc9434a680 on [inode 0x10000000374 [2,head] /dc-dir/dc-file_383 auth v4116 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.084491+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9434a680] now 0 2023-10-03T19:21:20.671 INFO:teuthology.orchestra.run.smithi045.stdout: -6209> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+608 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9434a680 count now 1/608 2023-10-03T19:21:20.671 INFO:teuthology.orchestra.run.smithi045.stdout: -6208> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000374) clear_dirty_parent 2023-10-03T19:21:20.671 INFO:teuthology.orchestra.run.smithi045.stdout: -6207> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000375) _stored_backtrace v 1538 2023-10-03T19:21:20.671 INFO:teuthology.orchestra.run.smithi045.stdout: -6206> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000375) auth_unpin by 0x55cc9434ac00 on [inode 0x10000000375 [2,head] /dc-dir/dc-file_384 auth v4118 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.097533+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9434ac00] now 0 2023-10-03T19:21:20.671 INFO:teuthology.orchestra.run.smithi045.stdout: -6205> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+607 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9434ac00 count now 1/607 2023-10-03T19:21:20.672 INFO:teuthology.orchestra.run.smithi045.stdout: -6204> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000375) clear_dirty_parent 2023-10-03T19:21:20.672 INFO:teuthology.orchestra.run.smithi045.stdout: -6203> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000376) _stored_backtrace v 1542 2023-10-03T19:21:20.672 INFO:teuthology.orchestra.run.smithi045.stdout: -6202> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000376) auth_unpin by 0x55cc9434b180 on [inode 0x10000000376 [2,head] /dc-dir/dc-file_385 auth v4120 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.109049+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9434b180] now 0 2023-10-03T19:21:20.672 INFO:teuthology.orchestra.run.smithi045.stdout: -6201> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+606 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9434b180 count now 1/606 2023-10-03T19:21:20.672 INFO:teuthology.orchestra.run.smithi045.stdout: -6200> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000376) clear_dirty_parent 2023-10-03T19:21:20.672 INFO:teuthology.orchestra.run.smithi045.stdout: -6199> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000377) _stored_backtrace v 1546 2023-10-03T19:21:20.672 INFO:teuthology.orchestra.run.smithi045.stdout: -6198> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000377) auth_unpin by 0x55cc9434b700 on [inode 0x10000000377 [2,head] /dc-dir/dc-file_386 auth v4122 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.119538+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9434b700] now 0 2023-10-03T19:21:20.672 INFO:teuthology.orchestra.run.smithi045.stdout: -6197> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+605 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9434b700 count now 1/605 2023-10-03T19:21:20.672 INFO:teuthology.orchestra.run.smithi045.stdout: -6196> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000377) clear_dirty_parent 2023-10-03T19:21:20.672 INFO:teuthology.orchestra.run.smithi045.stdout: -6195> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000378) _stored_backtrace v 1550 2023-10-03T19:21:20.672 INFO:teuthology.orchestra.run.smithi045.stdout: -6194> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000378) auth_unpin by 0x55cc94414000 on [inode 0x10000000378 [2,head] /dc-dir/dc-file_387 auth v4124 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.132193+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94414000] now 0 2023-10-03T19:21:20.673 INFO:teuthology.orchestra.run.smithi045.stdout: -6193> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+604 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94414000 count now 1/604 2023-10-03T19:21:20.673 INFO:teuthology.orchestra.run.smithi045.stdout: -6192> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000378) clear_dirty_parent 2023-10-03T19:21:20.673 INFO:teuthology.orchestra.run.smithi045.stdout: -6191> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000379) _stored_backtrace v 1554 2023-10-03T19:21:20.673 INFO:teuthology.orchestra.run.smithi045.stdout: -6190> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000379) auth_unpin by 0x55cc94414580 on [inode 0x10000000379 [2,head] /dc-dir/dc-file_388 auth v4126 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.143213+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94414580] now 0 2023-10-03T19:21:20.673 INFO:teuthology.orchestra.run.smithi045.stdout: -6189> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+603 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94414580 count now 1/603 2023-10-03T19:21:20.673 INFO:teuthology.orchestra.run.smithi045.stdout: -6188> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000379) clear_dirty_parent 2023-10-03T19:21:20.673 INFO:teuthology.orchestra.run.smithi045.stdout: -6187> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000037a) _stored_backtrace v 1558 2023-10-03T19:21:20.673 INFO:teuthology.orchestra.run.smithi045.stdout: -6186> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000037a) auth_unpin by 0x55cc94414b00 on [inode 0x1000000037a [2,head] /dc-dir/dc-file_389 auth v4128 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.154309+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94414b00] now 0 2023-10-03T19:21:20.673 INFO:teuthology.orchestra.run.smithi045.stdout: -6185> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+602 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94414b00 count now 1/602 2023-10-03T19:21:20.673 INFO:teuthology.orchestra.run.smithi045.stdout: -6184> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000037a) clear_dirty_parent 2023-10-03T19:21:20.673 INFO:teuthology.orchestra.run.smithi045.stdout: -6183> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000037b) _stored_backtrace v 1562 2023-10-03T19:21:20.674 INFO:teuthology.orchestra.run.smithi045.stdout: -6182> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000037b) auth_unpin by 0x55cc94415080 on [inode 0x1000000037b [2,head] /dc-dir/dc-file_390 auth v4130 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.164507+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94415080] now 0 2023-10-03T19:21:20.674 INFO:teuthology.orchestra.run.smithi045.stdout: -6181> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+601 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94415080 count now 1/601 2023-10-03T19:21:20.674 INFO:teuthology.orchestra.run.smithi045.stdout: -6180> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000037b) clear_dirty_parent 2023-10-03T19:21:20.674 INFO:teuthology.orchestra.run.smithi045.stdout: -6179> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000037c) _stored_backtrace v 1566 2023-10-03T19:21:20.674 INFO:teuthology.orchestra.run.smithi045.stdout: -6178> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000037c) auth_unpin by 0x55cc94415600 on [inode 0x1000000037c [2,head] /dc-dir/dc-file_391 auth v4132 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.174698+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94415600] now 0 2023-10-03T19:21:20.674 INFO:teuthology.orchestra.run.smithi045.stdout: -6177> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+600 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94415600 count now 1/600 2023-10-03T19:21:20.674 INFO:teuthology.orchestra.run.smithi045.stdout: -6176> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000037c) clear_dirty_parent 2023-10-03T19:21:20.674 INFO:teuthology.orchestra.run.smithi045.stdout: -6175> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000037d) _stored_backtrace v 1570 2023-10-03T19:21:20.674 INFO:teuthology.orchestra.run.smithi045.stdout: -6174> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000037d) auth_unpin by 0x55cc94415b80 on [inode 0x1000000037d [2,head] /dc-dir/dc-file_392 auth v4134 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.185425+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94415b80] now 0 2023-10-03T19:21:20.674 INFO:teuthology.orchestra.run.smithi045.stdout: -6173> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+599 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94415b80 count now 1/599 2023-10-03T19:21:20.674 INFO:teuthology.orchestra.run.smithi045.stdout: -6172> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000037d) clear_dirty_parent 2023-10-03T19:21:20.674 INFO:teuthology.orchestra.run.smithi045.stdout: -6171> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000037e) _stored_backtrace v 1574 2023-10-03T19:21:20.675 INFO:teuthology.orchestra.run.smithi045.stdout: -6170> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000037e) auth_unpin by 0x55cc94416100 on [inode 0x1000000037e [2,head] /dc-dir/dc-file_393 auth v4136 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.197125+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94416100] now 0 2023-10-03T19:21:20.675 INFO:teuthology.orchestra.run.smithi045.stdout: -6169> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+598 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94416100 count now 1/598 2023-10-03T19:21:20.675 INFO:teuthology.orchestra.run.smithi045.stdout: -6168> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000037e) clear_dirty_parent 2023-10-03T19:21:20.675 INFO:teuthology.orchestra.run.smithi045.stdout: -6167> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000037f) _stored_backtrace v 1578 2023-10-03T19:21:20.675 INFO:teuthology.orchestra.run.smithi045.stdout: -6166> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000037f) auth_unpin by 0x55cc94416680 on [inode 0x1000000037f [2,head] /dc-dir/dc-file_394 auth v4138 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.208655+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94416680] now 0 2023-10-03T19:21:20.675 INFO:teuthology.orchestra.run.smithi045.stdout: -6165> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+597 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94416680 count now 1/597 2023-10-03T19:21:20.675 INFO:teuthology.orchestra.run.smithi045.stdout: -6164> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000037f) clear_dirty_parent 2023-10-03T19:21:20.675 INFO:teuthology.orchestra.run.smithi045.stdout: -6163> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000380) _stored_backtrace v 1582 2023-10-03T19:21:20.675 INFO:teuthology.orchestra.run.smithi045.stdout: -6162> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000380) auth_unpin by 0x55cc94416c00 on [inode 0x10000000380 [2,head] /dc-dir/dc-file_395 auth v4140 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.220262+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94416c00] now 0 2023-10-03T19:21:20.675 INFO:teuthology.orchestra.run.smithi045.stdout: -6161> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+596 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94416c00 count now 1/596 2023-10-03T19:21:20.675 INFO:teuthology.orchestra.run.smithi045.stdout: -6160> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000380) clear_dirty_parent 2023-10-03T19:21:20.676 INFO:teuthology.orchestra.run.smithi045.stdout: -6159> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000381) _stored_backtrace v 1586 2023-10-03T19:21:20.676 INFO:teuthology.orchestra.run.smithi045.stdout: -6158> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000381) auth_unpin by 0x55cc94417180 on [inode 0x10000000381 [2,head] /dc-dir/dc-file_396 auth v4142 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.231848+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94417180] now 0 2023-10-03T19:21:20.676 INFO:teuthology.orchestra.run.smithi045.stdout: -6157> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+595 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94417180 count now 1/595 2023-10-03T19:21:20.676 INFO:teuthology.orchestra.run.smithi045.stdout: -6156> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000381) clear_dirty_parent 2023-10-03T19:21:20.676 INFO:teuthology.orchestra.run.smithi045.stdout: -6155> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000382) _stored_backtrace v 1590 2023-10-03T19:21:20.693 INFO:teuthology.orchestra.run.smithi045.stdout: -6154> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000382) auth_unpin by 0x55cc94417700 on [inode 0x10000000382 [2,head] /dc-dir/dc-file_397 auth v4144 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.244536+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94417700] now 0 2023-10-03T19:21:20.693 INFO:teuthology.orchestra.run.smithi045.stdout: -6153> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+594 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94417700 count now 1/594 2023-10-03T19:21:20.693 INFO:teuthology.orchestra.run.smithi045.stdout: -6152> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000382) clear_dirty_parent 2023-10-03T19:21:20.694 INFO:teuthology.orchestra.run.smithi045.stdout: -6151> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000383) _stored_backtrace v 1594 2023-10-03T19:21:20.694 INFO:teuthology.orchestra.run.smithi045.stdout: -6150> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000383) auth_unpin by 0x55cc944b4000 on [inode 0x10000000383 [2,head] /dc-dir/dc-file_398 auth v4146 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.256353+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc944b4000] now 0 2023-10-03T19:21:20.694 INFO:teuthology.orchestra.run.smithi045.stdout: -6149> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+593 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc944b4000 count now 1/593 2023-10-03T19:21:20.694 INFO:teuthology.orchestra.run.smithi045.stdout: -6148> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000383) clear_dirty_parent 2023-10-03T19:21:20.694 INFO:teuthology.orchestra.run.smithi045.stdout: -6147> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000384) _stored_backtrace v 1598 2023-10-03T19:21:20.694 INFO:teuthology.orchestra.run.smithi045.stdout: -6146> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000384) auth_unpin by 0x55cc944b4580 on [inode 0x10000000384 [2,head] /dc-dir/dc-file_399 auth v4148 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.268840+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc944b4580] now 0 2023-10-03T19:21:20.694 INFO:teuthology.orchestra.run.smithi045.stdout: -6145> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+592 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc944b4580 count now 1/592 2023-10-03T19:21:20.694 INFO:teuthology.orchestra.run.smithi045.stdout: -6144> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000384) clear_dirty_parent 2023-10-03T19:21:20.694 INFO:teuthology.orchestra.run.smithi045.stdout: -6143> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000385) _stored_backtrace v 1602 2023-10-03T19:21:20.694 INFO:teuthology.orchestra.run.smithi045.stdout: -6142> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000385) auth_unpin by 0x55cc944b4b00 on [inode 0x10000000385 [2,head] /dc-dir/dc-file_400 auth v4150 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.279843+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc944b4b00] now 0 2023-10-03T19:21:20.695 INFO:teuthology.orchestra.run.smithi045.stdout: -6141> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+591 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc944b4b00 count now 1/591 2023-10-03T19:21:20.695 INFO:teuthology.orchestra.run.smithi045.stdout: -6140> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000385) clear_dirty_parent 2023-10-03T19:21:20.695 INFO:teuthology.orchestra.run.smithi045.stdout: -6139> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000386) _stored_backtrace v 1606 2023-10-03T19:21:20.695 INFO:teuthology.orchestra.run.smithi045.stdout: -6138> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000386) auth_unpin by 0x55cc944b5080 on [inode 0x10000000386 [2,head] /dc-dir/dc-file_401 auth v4152 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.291516+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc944b5080] now 0 2023-10-03T19:21:20.695 INFO:teuthology.orchestra.run.smithi045.stdout: -6137> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+590 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc944b5080 count now 1/590 2023-10-03T19:21:20.695 INFO:teuthology.orchestra.run.smithi045.stdout: -6136> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000386) clear_dirty_parent 2023-10-03T19:21:20.695 INFO:teuthology.orchestra.run.smithi045.stdout: -6135> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000387) _stored_backtrace v 1610 2023-10-03T19:21:20.695 INFO:teuthology.orchestra.run.smithi045.stdout: -6134> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000387) auth_unpin by 0x55cc944b5600 on [inode 0x10000000387 [2,head] /dc-dir/dc-file_402 auth v4154 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.302685+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc944b5600] now 0 2023-10-03T19:21:20.695 INFO:teuthology.orchestra.run.smithi045.stdout: -6133> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+589 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc944b5600 count now 1/589 2023-10-03T19:21:20.695 INFO:teuthology.orchestra.run.smithi045.stdout: -6132> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000387) clear_dirty_parent 2023-10-03T19:21:20.696 INFO:teuthology.orchestra.run.smithi045.stdout: -6131> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000388) _stored_backtrace v 1614 2023-10-03T19:21:20.696 INFO:teuthology.orchestra.run.smithi045.stdout: -6130> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000388) auth_unpin by 0x55cc944b5b80 on [inode 0x10000000388 [2,head] /dc-dir/dc-file_403 auth v4156 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.315079+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc944b5b80] now 0 2023-10-03T19:21:20.696 INFO:teuthology.orchestra.run.smithi045.stdout: -6129> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+588 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc944b5b80 count now 1/588 2023-10-03T19:21:20.696 INFO:teuthology.orchestra.run.smithi045.stdout: -6128> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000388) clear_dirty_parent 2023-10-03T19:21:20.696 INFO:teuthology.orchestra.run.smithi045.stdout: -6127> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000389) _stored_backtrace v 1618 2023-10-03T19:21:20.696 INFO:teuthology.orchestra.run.smithi045.stdout: -6126> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000389) auth_unpin by 0x55cc944b6100 on [inode 0x10000000389 [2,head] /dc-dir/dc-file_404 auth v4158 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.325953+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc944b6100] now 0 2023-10-03T19:21:20.696 INFO:teuthology.orchestra.run.smithi045.stdout: -6125> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+587 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc944b6100 count now 1/587 2023-10-03T19:21:20.696 INFO:teuthology.orchestra.run.smithi045.stdout: -6124> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000389) clear_dirty_parent 2023-10-03T19:21:20.696 INFO:teuthology.orchestra.run.smithi045.stdout: -6123> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000038a) _stored_backtrace v 1622 2023-10-03T19:21:20.696 INFO:teuthology.orchestra.run.smithi045.stdout: -6122> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000038a) auth_unpin by 0x55cc944b6680 on [inode 0x1000000038a [2,head] /dc-dir/dc-file_405 auth v4160 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.337192+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc944b6680] now 0 2023-10-03T19:21:20.696 INFO:teuthology.orchestra.run.smithi045.stdout: -6121> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+586 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc944b6680 count now 1/586 2023-10-03T19:21:20.696 INFO:teuthology.orchestra.run.smithi045.stdout: -6120> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000038a) clear_dirty_parent 2023-10-03T19:21:20.697 INFO:teuthology.orchestra.run.smithi045.stdout: -6119> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000038b) _stored_backtrace v 1626 2023-10-03T19:21:20.697 INFO:teuthology.orchestra.run.smithi045.stdout: -6118> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000038b) auth_unpin by 0x55cc944b6c00 on [inode 0x1000000038b [2,head] /dc-dir/dc-file_406 auth v4162 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.347926+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc944b6c00] now 0 2023-10-03T19:21:20.697 INFO:teuthology.orchestra.run.smithi045.stdout: -6117> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+585 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc944b6c00 count now 1/585 2023-10-03T19:21:20.697 INFO:teuthology.orchestra.run.smithi045.stdout: -6116> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000038b) clear_dirty_parent 2023-10-03T19:21:20.697 INFO:teuthology.orchestra.run.smithi045.stdout: -6115> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000038c) _stored_backtrace v 1630 2023-10-03T19:21:20.697 INFO:teuthology.orchestra.run.smithi045.stdout: -6114> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000038c) auth_unpin by 0x55cc944b7180 on [inode 0x1000000038c [2,head] /dc-dir/dc-file_407 auth v4164 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.358968+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc944b7180] now 0 2023-10-03T19:21:20.697 INFO:teuthology.orchestra.run.smithi045.stdout: -6113> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+584 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc944b7180 count now 1/584 2023-10-03T19:21:20.697 INFO:teuthology.orchestra.run.smithi045.stdout: -6112> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000038c) clear_dirty_parent 2023-10-03T19:21:20.697 INFO:teuthology.orchestra.run.smithi045.stdout: -6111> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000038d) _stored_backtrace v 1634 2023-10-03T19:21:20.697 INFO:teuthology.orchestra.run.smithi045.stdout: -6110> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000038d) auth_unpin by 0x55cc944b7700 on [inode 0x1000000038d [2,head] /dc-dir/dc-file_408 auth v4166 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.370254+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc944b7700] now 0 2023-10-03T19:21:20.697 INFO:teuthology.orchestra.run.smithi045.stdout: -6109> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+583 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc944b7700 count now 1/583 2023-10-03T19:21:20.698 INFO:teuthology.orchestra.run.smithi045.stdout: -6108> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000038d) clear_dirty_parent 2023-10-03T19:21:20.698 INFO:teuthology.orchestra.run.smithi045.stdout: -6107> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000038e) _stored_backtrace v 1638 2023-10-03T19:21:20.698 INFO:teuthology.orchestra.run.smithi045.stdout: -6106> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000038e) auth_unpin by 0x55cc94476000 on [inode 0x1000000038e [2,head] /dc-dir/dc-file_409 auth v4168 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.381627+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94476000] now 0 2023-10-03T19:21:20.698 INFO:teuthology.orchestra.run.smithi045.stdout: -6105> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+582 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94476000 count now 1/582 2023-10-03T19:21:20.698 INFO:teuthology.orchestra.run.smithi045.stdout: -6104> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000038e) clear_dirty_parent 2023-10-03T19:21:20.698 INFO:teuthology.orchestra.run.smithi045.stdout: -6103> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000038f) _stored_backtrace v 1642 2023-10-03T19:21:20.698 INFO:teuthology.orchestra.run.smithi045.stdout: -6102> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000038f) auth_unpin by 0x55cc94476580 on [inode 0x1000000038f [2,head] /dc-dir/dc-file_410 auth v4170 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.392935+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94476580] now 0 2023-10-03T19:21:20.698 INFO:teuthology.orchestra.run.smithi045.stdout: -6101> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+581 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94476580 count now 1/581 2023-10-03T19:21:20.698 INFO:teuthology.orchestra.run.smithi045.stdout: -6100> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000038f) clear_dirty_parent 2023-10-03T19:21:20.698 INFO:teuthology.orchestra.run.smithi045.stdout: -6099> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000390) _stored_backtrace v 1646 2023-10-03T19:21:20.699 INFO:teuthology.orchestra.run.smithi045.stdout: -6098> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000390) auth_unpin by 0x55cc94476b00 on [inode 0x10000000390 [2,head] /dc-dir/dc-file_411 auth v4172 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.405076+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94476b00] now 0 2023-10-03T19:21:20.699 INFO:teuthology.orchestra.run.smithi045.stdout: -6097> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+580 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94476b00 count now 1/580 2023-10-03T19:21:20.699 INFO:teuthology.orchestra.run.smithi045.stdout: -6096> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000390) clear_dirty_parent 2023-10-03T19:21:20.699 INFO:teuthology.orchestra.run.smithi045.stdout: -6095> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000391) _stored_backtrace v 1650 2023-10-03T19:21:20.699 INFO:teuthology.orchestra.run.smithi045.stdout: -6094> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000391) auth_unpin by 0x55cc94477080 on [inode 0x10000000391 [2,head] /dc-dir/dc-file_412 auth v4174 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.417588+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94477080] now 0 2023-10-03T19:21:20.699 INFO:teuthology.orchestra.run.smithi045.stdout: -6093> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+579 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94477080 count now 1/579 2023-10-03T19:21:20.699 INFO:teuthology.orchestra.run.smithi045.stdout: -6092> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000391) clear_dirty_parent 2023-10-03T19:21:20.699 INFO:teuthology.orchestra.run.smithi045.stdout: -6091> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000392) _stored_backtrace v 1654 2023-10-03T19:21:20.699 INFO:teuthology.orchestra.run.smithi045.stdout: -6090> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000392) auth_unpin by 0x55cc94477600 on [inode 0x10000000392 [2,head] /dc-dir/dc-file_413 auth v4176 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.428206+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94477600] now 0 2023-10-03T19:21:20.699 INFO:teuthology.orchestra.run.smithi045.stdout: -6089> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+578 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94477600 count now 1/578 2023-10-03T19:21:20.699 INFO:teuthology.orchestra.run.smithi045.stdout: -6088> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000392) clear_dirty_parent 2023-10-03T19:21:20.699 INFO:teuthology.orchestra.run.smithi045.stdout: -6087> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000393) _stored_backtrace v 1658 2023-10-03T19:21:20.700 INFO:teuthology.orchestra.run.smithi045.stdout: -6086> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000393) auth_unpin by 0x55cc94477b80 on [inode 0x10000000393 [2,head] /dc-dir/dc-file_414 auth v4178 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.439546+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94477b80] now 0 2023-10-03T19:21:20.700 INFO:teuthology.orchestra.run.smithi045.stdout: -6085> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+577 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94477b80 count now 1/577 2023-10-03T19:21:20.700 INFO:teuthology.orchestra.run.smithi045.stdout: -6084> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000393) clear_dirty_parent 2023-10-03T19:21:20.700 INFO:teuthology.orchestra.run.smithi045.stdout: -6083> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000394) _stored_backtrace v 1662 2023-10-03T19:21:20.700 INFO:teuthology.orchestra.run.smithi045.stdout: -6082> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000394) auth_unpin by 0x55cc94478100 on [inode 0x10000000394 [2,head] /dc-dir/dc-file_415 auth v4180 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.450710+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94478100] now 0 2023-10-03T19:21:20.700 INFO:teuthology.orchestra.run.smithi045.stdout: -6081> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+576 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94478100 count now 1/576 2023-10-03T19:21:20.787 INFO:teuthology.orchestra.run.smithi045.stdout: -6080> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000394) clear_dirty_parent 2023-10-03T19:21:20.787 INFO:teuthology.orchestra.run.smithi045.stdout: -6079> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000395) _stored_backtrace v 1666 2023-10-03T19:21:20.787 INFO:teuthology.orchestra.run.smithi045.stdout: -6078> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000395) auth_unpin by 0x55cc94478680 on [inode 0x10000000395 [2,head] /dc-dir/dc-file_416 auth v4182 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.461282+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94478680] now 0 2023-10-03T19:21:20.788 INFO:teuthology.orchestra.run.smithi045.stdout: -6077> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+575 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94478680 count now 1/575 2023-10-03T19:21:20.788 INFO:teuthology.orchestra.run.smithi045.stdout: -6076> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000395) clear_dirty_parent 2023-10-03T19:21:20.788 INFO:teuthology.orchestra.run.smithi045.stdout: -6075> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000396) _stored_backtrace v 1670 2023-10-03T19:21:20.788 INFO:teuthology.orchestra.run.smithi045.stdout: -6074> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000396) auth_unpin by 0x55cc94478c00 on [inode 0x10000000396 [2,head] /dc-dir/dc-file_417 auth v4184 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.473124+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94478c00] now 0 2023-10-03T19:21:20.788 INFO:teuthology.orchestra.run.smithi045.stdout: -6073> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+574 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94478c00 count now 1/574 2023-10-03T19:21:20.788 INFO:teuthology.orchestra.run.smithi045.stdout: -6072> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000396) clear_dirty_parent 2023-10-03T19:21:20.788 INFO:teuthology.orchestra.run.smithi045.stdout: -6071> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000397) _stored_backtrace v 1674 2023-10-03T19:21:20.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6070> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000397) auth_unpin by 0x55cc94479180 on [inode 0x10000000397 [2,head] /dc-dir/dc-file_418 auth v4186 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.485670+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94479180] now 0 2023-10-03T19:21:20.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6069> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+573 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94479180 count now 1/573 2023-10-03T19:21:20.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6068> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000397) clear_dirty_parent 2023-10-03T19:21:20.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6067> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000398) _stored_backtrace v 1678 2023-10-03T19:21:20.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6066> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000398) auth_unpin by 0x55cc94479700 on [inode 0x10000000398 [2,head] /dc-dir/dc-file_419 auth v4188 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.498900+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94479700] now 0 2023-10-03T19:21:20.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6065> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+572 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94479700 count now 1/572 2023-10-03T19:21:20.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6064> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000398) clear_dirty_parent 2023-10-03T19:21:20.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6063> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000399) _stored_backtrace v 1682 2023-10-03T19:21:20.789 INFO:teuthology.orchestra.run.smithi045.stdout: -6062> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000399) auth_unpin by 0x55cc9447c000 on [inode 0x10000000399 [2,head] /dc-dir/dc-file_420 auth v4190 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.512168+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9447c000] now 0 2023-10-03T19:21:20.790 INFO:teuthology.orchestra.run.smithi045.stdout: -6061> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+571 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9447c000 count now 1/571 2023-10-03T19:21:20.790 INFO:teuthology.orchestra.run.smithi045.stdout: -6060> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000399) clear_dirty_parent 2023-10-03T19:21:20.790 INFO:teuthology.orchestra.run.smithi045.stdout: -6059> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000039a) _stored_backtrace v 1686 2023-10-03T19:21:20.790 INFO:teuthology.orchestra.run.smithi045.stdout: -6058> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000039a) auth_unpin by 0x55cc9447c580 on [inode 0x1000000039a [2,head] /dc-dir/dc-file_421 auth v4192 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.524116+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9447c580] now 0 2023-10-03T19:21:20.790 INFO:teuthology.orchestra.run.smithi045.stdout: -6057> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+570 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9447c580 count now 1/570 2023-10-03T19:21:20.790 INFO:teuthology.orchestra.run.smithi045.stdout: -6056> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000039a) clear_dirty_parent 2023-10-03T19:21:20.790 INFO:teuthology.orchestra.run.smithi045.stdout: -6055> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000039b) _stored_backtrace v 1690 2023-10-03T19:21:20.790 INFO:teuthology.orchestra.run.smithi045.stdout: -6054> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000039b) auth_unpin by 0x55cc9447cb00 on [inode 0x1000000039b [2,head] /dc-dir/dc-file_422 auth v4194 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.537286+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9447cb00] now 0 2023-10-03T19:21:20.790 INFO:teuthology.orchestra.run.smithi045.stdout: -6053> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+569 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9447cb00 count now 1/569 2023-10-03T19:21:20.790 INFO:teuthology.orchestra.run.smithi045.stdout: -6052> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000039b) clear_dirty_parent 2023-10-03T19:21:20.791 INFO:teuthology.orchestra.run.smithi045.stdout: -6051> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000039c) _stored_backtrace v 1694 2023-10-03T19:21:20.791 INFO:teuthology.orchestra.run.smithi045.stdout: -6050> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000039c) auth_unpin by 0x55cc9447d080 on [inode 0x1000000039c [2,head] /dc-dir/dc-file_423 auth v4196 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.548189+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9447d080] now 0 2023-10-03T19:21:20.791 INFO:teuthology.orchestra.run.smithi045.stdout: -6049> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+568 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9447d080 count now 1/568 2023-10-03T19:21:20.791 INFO:teuthology.orchestra.run.smithi045.stdout: -6048> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000039c) clear_dirty_parent 2023-10-03T19:21:20.791 INFO:teuthology.orchestra.run.smithi045.stdout: -6047> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000039d) _stored_backtrace v 1698 2023-10-03T19:21:20.791 INFO:teuthology.orchestra.run.smithi045.stdout: -6046> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000039d) auth_unpin by 0x55cc9447d600 on [inode 0x1000000039d [2,head] /dc-dir/dc-file_424 auth v4198 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.558985+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9447d600] now 0 2023-10-03T19:21:20.791 INFO:teuthology.orchestra.run.smithi045.stdout: -6045> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+567 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9447d600 count now 1/567 2023-10-03T19:21:20.791 INFO:teuthology.orchestra.run.smithi045.stdout: -6044> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000039d) clear_dirty_parent 2023-10-03T19:21:20.791 INFO:teuthology.orchestra.run.smithi045.stdout: -6043> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000039e) _stored_backtrace v 1702 2023-10-03T19:21:20.791 INFO:teuthology.orchestra.run.smithi045.stdout: -6042> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000039e) auth_unpin by 0x55cc9447db80 on [inode 0x1000000039e [2,head] /dc-dir/dc-file_425 auth v4200 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.570914+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9447db80] now 0 2023-10-03T19:21:20.791 INFO:teuthology.orchestra.run.smithi045.stdout: -6041> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+566 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9447db80 count now 1/566 2023-10-03T19:21:20.791 INFO:teuthology.orchestra.run.smithi045.stdout: -6040> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000039e) clear_dirty_parent 2023-10-03T19:21:20.792 INFO:teuthology.orchestra.run.smithi045.stdout: -6039> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000039f) _stored_backtrace v 1706 2023-10-03T19:21:20.792 INFO:teuthology.orchestra.run.smithi045.stdout: -6038> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000039f) auth_unpin by 0x55cc9447e100 on [inode 0x1000000039f [2,head] /dc-dir/dc-file_426 auth v4202 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.583223+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9447e100] now 0 2023-10-03T19:21:20.792 INFO:teuthology.orchestra.run.smithi045.stdout: -6037> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+565 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9447e100 count now 1/565 2023-10-03T19:21:20.792 INFO:teuthology.orchestra.run.smithi045.stdout: -6036> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000039f) clear_dirty_parent 2023-10-03T19:21:20.792 INFO:teuthology.orchestra.run.smithi045.stdout: -6035> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a0) _stored_backtrace v 1710 2023-10-03T19:21:20.792 INFO:teuthology.orchestra.run.smithi045.stdout: -6034> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a0) auth_unpin by 0x55cc9447e680 on [inode 0x100000003a0 [2,head] /dc-dir/dc-file_427 auth v4204 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.595686+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9447e680] now 0 2023-10-03T19:21:20.792 INFO:teuthology.orchestra.run.smithi045.stdout: -6033> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+564 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9447e680 count now 1/564 2023-10-03T19:21:20.792 INFO:teuthology.orchestra.run.smithi045.stdout: -6032> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a0) clear_dirty_parent 2023-10-03T19:21:20.792 INFO:teuthology.orchestra.run.smithi045.stdout: -6031> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a1) _stored_backtrace v 1714 2023-10-03T19:21:20.792 INFO:teuthology.orchestra.run.smithi045.stdout: -6030> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a1) auth_unpin by 0x55cc9447ec00 on [inode 0x100000003a1 [2,head] /dc-dir/dc-file_428 auth v4206 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.608255+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9447ec00] now 0 2023-10-03T19:21:20.793 INFO:teuthology.orchestra.run.smithi045.stdout: -6029> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+563 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9447ec00 count now 1/563 2023-10-03T19:21:20.793 INFO:teuthology.orchestra.run.smithi045.stdout: -6028> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a1) clear_dirty_parent 2023-10-03T19:21:20.793 INFO:teuthology.orchestra.run.smithi045.stdout: -6027> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a2) _stored_backtrace v 1718 2023-10-03T19:21:20.793 INFO:teuthology.orchestra.run.smithi045.stdout: -6026> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a2) auth_unpin by 0x55cc9447f180 on [inode 0x100000003a2 [2,head] /dc-dir/dc-file_429 auth v4208 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.620323+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9447f180] now 0 2023-10-03T19:21:20.793 INFO:teuthology.orchestra.run.smithi045.stdout: -6025> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+562 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9447f180 count now 1/562 2023-10-03T19:21:20.793 INFO:teuthology.orchestra.run.smithi045.stdout: -6024> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a2) clear_dirty_parent 2023-10-03T19:21:20.793 INFO:teuthology.orchestra.run.smithi045.stdout: -6023> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a3) _stored_backtrace v 1722 2023-10-03T19:21:20.793 INFO:teuthology.orchestra.run.smithi045.stdout: -6022> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a3) auth_unpin by 0x55cc9447f700 on [inode 0x100000003a3 [2,head] /dc-dir/dc-file_430 auth v4210 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.633099+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9447f700] now 0 2023-10-03T19:21:20.793 INFO:teuthology.orchestra.run.smithi045.stdout: -6021> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+561 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9447f700 count now 1/561 2023-10-03T19:21:20.793 INFO:teuthology.orchestra.run.smithi045.stdout: -6020> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a3) clear_dirty_parent 2023-10-03T19:21:20.793 INFO:teuthology.orchestra.run.smithi045.stdout: -6019> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a4) _stored_backtrace v 1726 2023-10-03T19:21:20.793 INFO:teuthology.orchestra.run.smithi045.stdout: -6018> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a4) auth_unpin by 0x55cc94486000 on [inode 0x100000003a4 [2,head] /dc-dir/dc-file_431 auth v4212 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.646180+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94486000] now 0 2023-10-03T19:21:20.794 INFO:teuthology.orchestra.run.smithi045.stdout: -6017> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+560 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94486000 count now 1/560 2023-10-03T19:21:20.794 INFO:teuthology.orchestra.run.smithi045.stdout: -6016> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a4) clear_dirty_parent 2023-10-03T19:21:20.794 INFO:teuthology.orchestra.run.smithi045.stdout: -6015> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a5) _stored_backtrace v 1730 2023-10-03T19:21:20.794 INFO:teuthology.orchestra.run.smithi045.stdout: -6014> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a5) auth_unpin by 0x55cc94486580 on [inode 0x100000003a5 [2,head] /dc-dir/dc-file_432 auth v4214 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.658793+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94486580] now 0 2023-10-03T19:21:20.794 INFO:teuthology.orchestra.run.smithi045.stdout: -6013> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+559 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94486580 count now 1/559 2023-10-03T19:21:20.794 INFO:teuthology.orchestra.run.smithi045.stdout: -6012> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a5) clear_dirty_parent 2023-10-03T19:21:20.794 INFO:teuthology.orchestra.run.smithi045.stdout: -6011> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a6) _stored_backtrace v 1734 2023-10-03T19:21:20.794 INFO:teuthology.orchestra.run.smithi045.stdout: -6010> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a6) auth_unpin by 0x55cc94486b00 on [inode 0x100000003a6 [2,head] /dc-dir/dc-file_433 auth v4216 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.669847+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94486b00] now 0 2023-10-03T19:21:20.794 INFO:teuthology.orchestra.run.smithi045.stdout: -6009> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+558 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94486b00 count now 1/558 2023-10-03T19:21:20.804 INFO:teuthology.orchestra.run.smithi045.stdout: -6008> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a6) clear_dirty_parent 2023-10-03T19:21:20.804 INFO:teuthology.orchestra.run.smithi045.stdout: -6007> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a7) _stored_backtrace v 1738 2023-10-03T19:21:20.804 INFO:teuthology.orchestra.run.smithi045.stdout: -6006> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a7) auth_unpin by 0x55cc94487080 on [inode 0x100000003a7 [2,head] /dc-dir/dc-file_434 auth v4218 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.681332+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94487080] now 0 2023-10-03T19:21:20.804 INFO:teuthology.orchestra.run.smithi045.stdout: -6005> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+557 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94487080 count now 1/557 2023-10-03T19:21:20.805 INFO:teuthology.orchestra.run.smithi045.stdout: -6004> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a7) clear_dirty_parent 2023-10-03T19:21:20.805 INFO:teuthology.orchestra.run.smithi045.stdout: -6003> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a8) _stored_backtrace v 1742 2023-10-03T19:21:20.805 INFO:teuthology.orchestra.run.smithi045.stdout: -6002> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a8) auth_unpin by 0x55cc94487600 on [inode 0x100000003a8 [2,head] /dc-dir/dc-file_435 auth v4220 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.693249+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94487600] now 0 2023-10-03T19:21:20.805 INFO:teuthology.orchestra.run.smithi045.stdout: -6001> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+556 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94487600 count now 1/556 2023-10-03T19:21:20.805 INFO:teuthology.orchestra.run.smithi045.stdout: -6000> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a8) clear_dirty_parent 2023-10-03T19:21:20.805 INFO:teuthology.orchestra.run.smithi045.stdout: -5999> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a9) _stored_backtrace v 1746 2023-10-03T19:21:20.806 INFO:teuthology.orchestra.run.smithi045.stdout: -5998> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a9) auth_unpin by 0x55cc94487b80 on [inode 0x100000003a9 [2,head] /dc-dir/dc-file_436 auth v4222 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.704242+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94487b80] now 0 2023-10-03T19:21:20.806 INFO:teuthology.orchestra.run.smithi045.stdout: -5997> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+555 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94487b80 count now 1/555 2023-10-03T19:21:20.806 INFO:teuthology.orchestra.run.smithi045.stdout: -5996> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a9) clear_dirty_parent 2023-10-03T19:21:20.806 INFO:teuthology.orchestra.run.smithi045.stdout: -5995> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003aa) _stored_backtrace v 1750 2023-10-03T19:21:20.806 INFO:teuthology.orchestra.run.smithi045.stdout: -5994> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003aa) auth_unpin by 0x55cc94488100 on [inode 0x100000003aa [2,head] /dc-dir/dc-file_437 auth v4224 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.715366+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94488100] now 0 2023-10-03T19:21:20.806 INFO:teuthology.orchestra.run.smithi045.stdout: -5993> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+554 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94488100 count now 1/554 2023-10-03T19:21:20.807 INFO:teuthology.orchestra.run.smithi045.stdout: -5992> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003aa) clear_dirty_parent 2023-10-03T19:21:20.807 INFO:teuthology.orchestra.run.smithi045.stdout: -5991> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ab) _stored_backtrace v 1754 2023-10-03T19:21:20.807 INFO:teuthology.orchestra.run.smithi045.stdout: -5990> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ab) auth_unpin by 0x55cc94488680 on [inode 0x100000003ab [2,head] /dc-dir/dc-file_438 auth v4226 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.727081+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94488680] now 0 2023-10-03T19:21:20.807 INFO:teuthology.orchestra.run.smithi045.stdout: -5989> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+553 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94488680 count now 1/553 2023-10-03T19:21:20.807 INFO:teuthology.orchestra.run.smithi045.stdout: -5988> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ab) clear_dirty_parent 2023-10-03T19:21:20.807 INFO:teuthology.orchestra.run.smithi045.stdout: -5987> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ac) _stored_backtrace v 1758 2023-10-03T19:21:20.808 INFO:teuthology.orchestra.run.smithi045.stdout: -5986> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ac) auth_unpin by 0x55cc94488c00 on [inode 0x100000003ac [2,head] /dc-dir/dc-file_439 auth v4228 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.739493+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94488c00] now 0 2023-10-03T19:21:20.808 INFO:teuthology.orchestra.run.smithi045.stdout: -5985> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+552 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94488c00 count now 1/552 2023-10-03T19:21:20.808 INFO:teuthology.orchestra.run.smithi045.stdout: -5984> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ac) clear_dirty_parent 2023-10-03T19:21:20.808 INFO:teuthology.orchestra.run.smithi045.stdout: -5983> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ad) _stored_backtrace v 1762 2023-10-03T19:21:20.808 INFO:teuthology.orchestra.run.smithi045.stdout: -5982> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ad) auth_unpin by 0x55cc94489180 on [inode 0x100000003ad [2,head] /dc-dir/dc-file_440 auth v4230 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.750986+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94489180] now 0 2023-10-03T19:21:20.808 INFO:teuthology.orchestra.run.smithi045.stdout: -5981> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+551 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94489180 count now 1/551 2023-10-03T19:21:20.809 INFO:teuthology.orchestra.run.smithi045.stdout: -5980> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ad) clear_dirty_parent 2023-10-03T19:21:20.809 INFO:teuthology.orchestra.run.smithi045.stdout: -5979> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ae) _stored_backtrace v 1766 2023-10-03T19:21:20.809 INFO:teuthology.orchestra.run.smithi045.stdout: -5978> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ae) auth_unpin by 0x55cc94489700 on [inode 0x100000003ae [2,head] /dc-dir/dc-file_441 auth v4232 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.762180+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94489700] now 0 2023-10-03T19:21:20.809 INFO:teuthology.orchestra.run.smithi045.stdout: -5977> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+550 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94489700 count now 1/550 2023-10-03T19:21:20.809 INFO:teuthology.orchestra.run.smithi045.stdout: -5976> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ae) clear_dirty_parent 2023-10-03T19:21:20.810 INFO:teuthology.orchestra.run.smithi045.stdout: -5975> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003af) _stored_backtrace v 1770 2023-10-03T19:21:20.810 INFO:teuthology.orchestra.run.smithi045.stdout: -5974> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003af) auth_unpin by 0x55cc94490000 on [inode 0x100000003af [2,head] /dc-dir/dc-file_442 auth v4234 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.773067+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94490000] now 0 2023-10-03T19:21:20.810 INFO:teuthology.orchestra.run.smithi045.stdout: -5973> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+549 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94490000 count now 1/549 2023-10-03T19:21:20.810 INFO:teuthology.orchestra.run.smithi045.stdout: -5972> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003af) clear_dirty_parent 2023-10-03T19:21:20.810 INFO:teuthology.orchestra.run.smithi045.stdout: -5971> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b0) _stored_backtrace v 1774 2023-10-03T19:21:20.811 INFO:teuthology.orchestra.run.smithi045.stdout: -5970> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b0) auth_unpin by 0x55cc94490580 on [inode 0x100000003b0 [2,head] /dc-dir/dc-file_443 auth v4236 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.784407+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94490580] now 0 2023-10-03T19:21:20.811 INFO:teuthology.orchestra.run.smithi045.stdout: -5969> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+548 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94490580 count now 1/548 2023-10-03T19:21:20.811 INFO:teuthology.orchestra.run.smithi045.stdout: -5968> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b0) clear_dirty_parent 2023-10-03T19:21:20.811 INFO:teuthology.orchestra.run.smithi045.stdout: -5967> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b1) _stored_backtrace v 1778 2023-10-03T19:21:20.811 INFO:teuthology.orchestra.run.smithi045.stdout: -5966> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b1) auth_unpin by 0x55cc94490b00 on [inode 0x100000003b1 [2,head] /dc-dir/dc-file_444 auth v4238 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.796046+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94490b00] now 0 2023-10-03T19:21:20.811 INFO:teuthology.orchestra.run.smithi045.stdout: -5965> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+547 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94490b00 count now 1/547 2023-10-03T19:21:20.812 INFO:teuthology.orchestra.run.smithi045.stdout: -5964> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b1) clear_dirty_parent 2023-10-03T19:21:20.812 INFO:teuthology.orchestra.run.smithi045.stdout: -5963> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b2) _stored_backtrace v 1782 2023-10-03T19:21:20.812 INFO:teuthology.orchestra.run.smithi045.stdout: -5962> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b2) auth_unpin by 0x55cc94491080 on [inode 0x100000003b2 [2,head] /dc-dir/dc-file_445 auth v4240 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.809560+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94491080] now 0 2023-10-03T19:21:20.812 INFO:teuthology.orchestra.run.smithi045.stdout: -5961> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+546 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94491080 count now 1/546 2023-10-03T19:21:20.812 INFO:teuthology.orchestra.run.smithi045.stdout: -5960> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b2) clear_dirty_parent 2023-10-03T19:21:20.813 INFO:teuthology.orchestra.run.smithi045.stdout: -5959> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b3) _stored_backtrace v 1786 2023-10-03T19:21:20.813 INFO:teuthology.orchestra.run.smithi045.stdout: -5958> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b3) auth_unpin by 0x55cc94491600 on [inode 0x100000003b3 [2,head] /dc-dir/dc-file_446 auth v4242 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.823546+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94491600] now 0 2023-10-03T19:21:20.813 INFO:teuthology.orchestra.run.smithi045.stdout: -5957> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+545 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94491600 count now 1/545 2023-10-03T19:21:20.813 INFO:teuthology.orchestra.run.smithi045.stdout: -5956> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b3) clear_dirty_parent 2023-10-03T19:21:20.813 INFO:teuthology.orchestra.run.smithi045.stdout: -5955> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b4) _stored_backtrace v 1790 2023-10-03T19:21:20.813 INFO:teuthology.orchestra.run.smithi045.stdout: -5954> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b4) auth_unpin by 0x55cc94491b80 on [inode 0x100000003b4 [2,head] /dc-dir/dc-file_447 auth v4244 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.835141+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94491b80] now 0 2023-10-03T19:21:20.814 INFO:teuthology.orchestra.run.smithi045.stdout: -5953> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+544 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94491b80 count now 1/544 2023-10-03T19:21:20.814 INFO:teuthology.orchestra.run.smithi045.stdout: -5952> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b4) clear_dirty_parent 2023-10-03T19:21:20.814 INFO:teuthology.orchestra.run.smithi045.stdout: -5951> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b5) _stored_backtrace v 1794 2023-10-03T19:21:20.814 INFO:teuthology.orchestra.run.smithi045.stdout: -5950> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b5) auth_unpin by 0x55cc94492100 on [inode 0x100000003b5 [2,head] /dc-dir/dc-file_448 auth v4246 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.845904+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94492100] now 0 2023-10-03T19:21:20.814 INFO:teuthology.orchestra.run.smithi045.stdout: -5949> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+543 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94492100 count now 1/543 2023-10-03T19:21:20.815 INFO:teuthology.orchestra.run.smithi045.stdout: -5948> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b5) clear_dirty_parent 2023-10-03T19:21:20.815 INFO:teuthology.orchestra.run.smithi045.stdout: -5947> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b6) _stored_backtrace v 1798 2023-10-03T19:21:20.815 INFO:teuthology.orchestra.run.smithi045.stdout: -5946> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b6) auth_unpin by 0x55cc94492680 on [inode 0x100000003b6 [2,head] /dc-dir/dc-file_449 auth v4248 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.857400+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94492680] now 0 2023-10-03T19:21:20.815 INFO:teuthology.orchestra.run.smithi045.stdout: -5945> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+542 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94492680 count now 1/542 2023-10-03T19:21:20.815 INFO:teuthology.orchestra.run.smithi045.stdout: -5944> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b6) clear_dirty_parent 2023-10-03T19:21:20.815 INFO:teuthology.orchestra.run.smithi045.stdout: -5943> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b7) _stored_backtrace v 1802 2023-10-03T19:21:20.834 INFO:teuthology.orchestra.run.smithi045.stdout: -5942> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b7) auth_unpin by 0x55cc94492c00 on [inode 0x100000003b7 [2,head] /dc-dir/dc-file_450 auth v4250 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.868439+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94492c00] now 0 2023-10-03T19:21:20.834 INFO:teuthology.orchestra.run.smithi045.stdout: -5941> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+541 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94492c00 count now 1/541 2023-10-03T19:21:20.835 INFO:teuthology.orchestra.run.smithi045.stdout: -5940> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b7) clear_dirty_parent 2023-10-03T19:21:20.835 INFO:teuthology.orchestra.run.smithi045.stdout: -5939> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b8) _stored_backtrace v 1806 2023-10-03T19:21:20.835 INFO:teuthology.orchestra.run.smithi045.stdout: -5938> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b8) auth_unpin by 0x55cc94493180 on [inode 0x100000003b8 [2,head] /dc-dir/dc-file_451 auth v4252 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.879888+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94493180] now 0 2023-10-03T19:21:20.835 INFO:teuthology.orchestra.run.smithi045.stdout: -5937> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+540 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94493180 count now 1/540 2023-10-03T19:21:20.835 INFO:teuthology.orchestra.run.smithi045.stdout: -5936> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b8) clear_dirty_parent 2023-10-03T19:21:20.836 INFO:teuthology.orchestra.run.smithi045.stdout: -5935> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b9) _stored_backtrace v 1810 2023-10-03T19:21:20.836 INFO:teuthology.orchestra.run.smithi045.stdout: -5934> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b9) auth_unpin by 0x55cc94493700 on [inode 0x100000003b9 [2,head] /dc-dir/dc-file_452 auth v4254 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.890838+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94493700] now 0 2023-10-03T19:21:20.836 INFO:teuthology.orchestra.run.smithi045.stdout: -5933> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+539 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94493700 count now 1/539 2023-10-03T19:21:20.836 INFO:teuthology.orchestra.run.smithi045.stdout: -5932> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b9) clear_dirty_parent 2023-10-03T19:21:20.836 INFO:teuthology.orchestra.run.smithi045.stdout: -5931> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ba) _stored_backtrace v 1814 2023-10-03T19:21:20.836 INFO:teuthology.orchestra.run.smithi045.stdout: -5930> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ba) auth_unpin by 0x55cc944a0000 on [inode 0x100000003ba [2,head] /dc-dir/dc-file_453 auth v4256 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.902544+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc944a0000] now 0 2023-10-03T19:21:20.837 INFO:teuthology.orchestra.run.smithi045.stdout: -5929> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+538 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc944a0000 count now 1/538 2023-10-03T19:21:20.837 INFO:teuthology.orchestra.run.smithi045.stdout: -5928> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ba) clear_dirty_parent 2023-10-03T19:21:20.837 INFO:teuthology.orchestra.run.smithi045.stdout: -5927> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003bb) _stored_backtrace v 1818 2023-10-03T19:21:20.837 INFO:teuthology.orchestra.run.smithi045.stdout: -5926> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003bb) auth_unpin by 0x55cc944a0580 on [inode 0x100000003bb [2,head] /dc-dir/dc-file_454 auth v4258 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.914444+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc944a0580] now 0 2023-10-03T19:21:20.837 INFO:teuthology.orchestra.run.smithi045.stdout: -5925> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+537 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc944a0580 count now 1/537 2023-10-03T19:21:20.838 INFO:teuthology.orchestra.run.smithi045.stdout: -5924> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003bb) clear_dirty_parent 2023-10-03T19:21:20.838 INFO:teuthology.orchestra.run.smithi045.stdout: -5923> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003bc) _stored_backtrace v 1822 2023-10-03T19:21:20.838 INFO:teuthology.orchestra.run.smithi045.stdout: -5922> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003bc) auth_unpin by 0x55cc944a0b00 on [inode 0x100000003bc [2,head] /dc-dir/dc-file_455 auth v4260 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.927910+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc944a0b00] now 0 2023-10-03T19:21:20.838 INFO:teuthology.orchestra.run.smithi045.stdout: -5921> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+536 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc944a0b00 count now 1/536 2023-10-03T19:21:20.838 INFO:teuthology.orchestra.run.smithi045.stdout: -5920> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003bc) clear_dirty_parent 2023-10-03T19:21:20.838 INFO:teuthology.orchestra.run.smithi045.stdout: -5919> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003bd) _stored_backtrace v 1826 2023-10-03T19:21:20.839 INFO:teuthology.orchestra.run.smithi045.stdout: -5918> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003bd) auth_unpin by 0x55cc944a1080 on [inode 0x100000003bd [2,head] /dc-dir/dc-file_456 auth v4262 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.942305+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc944a1080] now 0 2023-10-03T19:21:20.839 INFO:teuthology.orchestra.run.smithi045.stdout: -5917> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+535 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc944a1080 count now 1/535 2023-10-03T19:21:20.839 INFO:teuthology.orchestra.run.smithi045.stdout: -5916> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003bd) clear_dirty_parent 2023-10-03T19:21:20.839 INFO:teuthology.orchestra.run.smithi045.stdout: -5915> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003be) _stored_backtrace v 1830 2023-10-03T19:21:20.839 INFO:teuthology.orchestra.run.smithi045.stdout: -5914> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003be) auth_unpin by 0x55cc944a1600 on [inode 0x100000003be [2,head] /dc-dir/dc-file_457 auth v4264 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.956013+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc944a1600] now 0 2023-10-03T19:21:20.840 INFO:teuthology.orchestra.run.smithi045.stdout: -5913> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+534 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc944a1600 count now 1/534 2023-10-03T19:21:20.840 INFO:teuthology.orchestra.run.smithi045.stdout: -5912> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003be) clear_dirty_parent 2023-10-03T19:21:20.840 INFO:teuthology.orchestra.run.smithi045.stdout: -5911> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003bf) _stored_backtrace v 1834 2023-10-03T19:21:20.840 INFO:teuthology.orchestra.run.smithi045.stdout: -5910> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003bf) auth_unpin by 0x55cc944a1b80 on [inode 0x100000003bf [2,head] /dc-dir/dc-file_458 auth v4266 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.968515+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc944a1b80] now 0 2023-10-03T19:21:20.840 INFO:teuthology.orchestra.run.smithi045.stdout: -5909> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+533 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc944a1b80 count now 1/533 2023-10-03T19:21:20.841 INFO:teuthology.orchestra.run.smithi045.stdout: -5908> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003bf) clear_dirty_parent 2023-10-03T19:21:20.841 INFO:teuthology.orchestra.run.smithi045.stdout: -5907> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c0) _stored_backtrace v 1838 2023-10-03T19:21:20.841 INFO:teuthology.orchestra.run.smithi045.stdout: -5906> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c0) auth_unpin by 0x55cc944a2100 on [inode 0x100000003c0 [2,head] /dc-dir/dc-file_459 auth v4268 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.981305+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc944a2100] now 0 2023-10-03T19:21:20.841 INFO:teuthology.orchestra.run.smithi045.stdout: -5905> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+532 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc944a2100 count now 1/532 2023-10-03T19:21:20.841 INFO:teuthology.orchestra.run.smithi045.stdout: -5904> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c0) clear_dirty_parent 2023-10-03T19:21:20.842 INFO:teuthology.orchestra.run.smithi045.stdout: -5903> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c1) _stored_backtrace v 1842 2023-10-03T19:21:20.842 INFO:teuthology.orchestra.run.smithi045.stdout: -5902> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c1) auth_unpin by 0x55cc944a2680 on [inode 0x100000003c1 [2,head] /dc-dir/dc-file_460 auth v4270 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:50.995582+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc944a2680] now 0 2023-10-03T19:21:20.842 INFO:teuthology.orchestra.run.smithi045.stdout: -5901> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+531 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc944a2680 count now 1/531 2023-10-03T19:21:20.842 INFO:teuthology.orchestra.run.smithi045.stdout: -5900> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c1) clear_dirty_parent 2023-10-03T19:21:20.842 INFO:teuthology.orchestra.run.smithi045.stdout: -5899> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c2) _stored_backtrace v 1846 2023-10-03T19:21:20.843 INFO:teuthology.orchestra.run.smithi045.stdout: -5898> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c2) auth_unpin by 0x55cc944a2c00 on [inode 0x100000003c2 [2,head] /dc-dir/dc-file_461 auth v4272 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.010184+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc944a2c00] now 0 2023-10-03T19:21:20.843 INFO:teuthology.orchestra.run.smithi045.stdout: -5897> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+530 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc944a2c00 count now 1/530 2023-10-03T19:21:20.843 INFO:teuthology.orchestra.run.smithi045.stdout: -5896> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c2) clear_dirty_parent 2023-10-03T19:21:20.843 INFO:teuthology.orchestra.run.smithi045.stdout: -5895> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c3) _stored_backtrace v 1850 2023-10-03T19:21:20.843 INFO:teuthology.orchestra.run.smithi045.stdout: -5894> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c3) auth_unpin by 0x55cc944a3180 on [inode 0x100000003c3 [2,head] /dc-dir/dc-file_462 auth v4274 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.022754+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc944a3180] now 0 2023-10-03T19:21:20.844 INFO:teuthology.orchestra.run.smithi045.stdout: -5893> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+529 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc944a3180 count now 1/529 2023-10-03T19:21:20.844 INFO:teuthology.orchestra.run.smithi045.stdout: -5892> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c3) clear_dirty_parent 2023-10-03T19:21:20.844 INFO:teuthology.orchestra.run.smithi045.stdout: -5891> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c4) _stored_backtrace v 1854 2023-10-03T19:21:20.844 INFO:teuthology.orchestra.run.smithi045.stdout: -5890> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c4) auth_unpin by 0x55cc944a3700 on [inode 0x100000003c4 [2,head] /dc-dir/dc-file_463 auth v4276 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.035068+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc944a3700] now 0 2023-10-03T19:21:20.844 INFO:teuthology.orchestra.run.smithi045.stdout: -5889> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+528 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc944a3700 count now 1/528 2023-10-03T19:21:20.845 INFO:teuthology.orchestra.run.smithi045.stdout: -5888> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c4) clear_dirty_parent 2023-10-03T19:21:20.845 INFO:teuthology.orchestra.run.smithi045.stdout: -5887> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c5) _stored_backtrace v 1858 2023-10-03T19:21:20.845 INFO:teuthology.orchestra.run.smithi045.stdout: -5886> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c5) auth_unpin by 0x55cc94518000 on [inode 0x100000003c5 [2,head] /dc-dir/dc-file_464 auth v4278 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.046162+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94518000] now 0 2023-10-03T19:21:20.845 INFO:teuthology.orchestra.run.smithi045.stdout: -5885> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+527 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94518000 count now 1/527 2023-10-03T19:21:20.845 INFO:teuthology.orchestra.run.smithi045.stdout: -5884> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c5) clear_dirty_parent 2023-10-03T19:21:20.845 INFO:teuthology.orchestra.run.smithi045.stdout: -5883> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c6) _stored_backtrace v 1862 2023-10-03T19:21:20.846 INFO:teuthology.orchestra.run.smithi045.stdout: -5882> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c6) auth_unpin by 0x55cc94518580 on [inode 0x100000003c6 [2,head] /dc-dir/dc-file_465 auth v4280 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.058229+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94518580] now 0 2023-10-03T19:21:20.846 INFO:teuthology.orchestra.run.smithi045.stdout: -5881> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+526 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94518580 count now 1/526 2023-10-03T19:21:20.846 INFO:teuthology.orchestra.run.smithi045.stdout: -5880> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c6) clear_dirty_parent 2023-10-03T19:21:20.846 INFO:teuthology.orchestra.run.smithi045.stdout: -5879> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c7) _stored_backtrace v 1866 2023-10-03T19:21:20.846 INFO:teuthology.orchestra.run.smithi045.stdout: -5878> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c7) auth_unpin by 0x55cc94518b00 on [inode 0x100000003c7 [2,head] /dc-dir/dc-file_466 auth v4282 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.070894+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94518b00] now 0 2023-10-03T19:21:20.847 INFO:teuthology.orchestra.run.smithi045.stdout: -5877> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+525 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94518b00 count now 1/525 2023-10-03T19:21:20.847 INFO:teuthology.orchestra.run.smithi045.stdout: -5876> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c7) clear_dirty_parent 2023-10-03T19:21:20.847 INFO:teuthology.orchestra.run.smithi045.stdout: -5875> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c8) _stored_backtrace v 1910 2023-10-03T19:21:20.847 INFO:teuthology.orchestra.run.smithi045.stdout: -5874> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c8) auth_unpin by 0x55cc94519080 on [inode 0x100000003c8 [2,head] /dc-dir/dc-file_467 auth v4580 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.097499+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94519080] now 0 2023-10-03T19:21:20.847 INFO:teuthology.orchestra.run.smithi045.stdout: -5873> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+524 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94519080 count now 1/524 2023-10-03T19:21:20.848 INFO:teuthology.orchestra.run.smithi045.stdout: -5872> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c8) clear_dirty_parent 2023-10-03T19:21:20.848 INFO:teuthology.orchestra.run.smithi045.stdout: -5871> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c9) _stored_backtrace v 1914 2023-10-03T19:21:20.848 INFO:teuthology.orchestra.run.smithi045.stdout: -5870> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c9) auth_unpin by 0x55cc94519600 on [inode 0x100000003c9 [2,head] /dc-dir/dc-file_468 auth v4582 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.125239+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94519600] now 0 2023-10-03T19:21:20.848 INFO:teuthology.orchestra.run.smithi045.stdout: -5869> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+523 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94519600 count now 1/523 2023-10-03T19:21:20.864 INFO:teuthology.orchestra.run.smithi045.stdout: -5868> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c9) clear_dirty_parent 2023-10-03T19:21:20.864 INFO:teuthology.orchestra.run.smithi045.stdout: -5867> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ca) _stored_backtrace v 1918 2023-10-03T19:21:20.864 INFO:teuthology.orchestra.run.smithi045.stdout: -5866> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ca) auth_unpin by 0x55cc94519b80 on [inode 0x100000003ca [2,head] /dc-dir/dc-file_469 auth v4584 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.137330+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94519b80] now 0 2023-10-03T19:21:20.865 INFO:teuthology.orchestra.run.smithi045.stdout: -5865> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+522 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94519b80 count now 1/522 2023-10-03T19:21:20.865 INFO:teuthology.orchestra.run.smithi045.stdout: -5864> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ca) clear_dirty_parent 2023-10-03T19:21:20.865 INFO:teuthology.orchestra.run.smithi045.stdout: -5863> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003cb) _stored_backtrace v 1922 2023-10-03T19:21:20.865 INFO:teuthology.orchestra.run.smithi045.stdout: -5862> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003cb) auth_unpin by 0x55cc9451a100 on [inode 0x100000003cb [2,head] /dc-dir/dc-file_470 auth v4586 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.149442+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9451a100] now 0 2023-10-03T19:21:20.865 INFO:teuthology.orchestra.run.smithi045.stdout: -5861> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+521 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9451a100 count now 1/521 2023-10-03T19:21:20.865 INFO:teuthology.orchestra.run.smithi045.stdout: -5860> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003cb) clear_dirty_parent 2023-10-03T19:21:20.866 INFO:teuthology.orchestra.run.smithi045.stdout: -5859> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003cc) _stored_backtrace v 1926 2023-10-03T19:21:20.866 INFO:teuthology.orchestra.run.smithi045.stdout: -5858> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003cc) auth_unpin by 0x55cc9451a680 on [inode 0x100000003cc [2,head] /dc-dir/dc-file_471 auth v4588 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.161033+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9451a680] now 0 2023-10-03T19:21:20.866 INFO:teuthology.orchestra.run.smithi045.stdout: -5857> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+520 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9451a680 count now 1/520 2023-10-03T19:21:20.866 INFO:teuthology.orchestra.run.smithi045.stdout: -5856> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003cc) clear_dirty_parent 2023-10-03T19:21:20.866 INFO:teuthology.orchestra.run.smithi045.stdout: -5855> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003cd) _stored_backtrace v 1930 2023-10-03T19:21:20.867 INFO:teuthology.orchestra.run.smithi045.stdout: -5854> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003cd) auth_unpin by 0x55cc9451ac00 on [inode 0x100000003cd [2,head] /dc-dir/dc-file_472 auth v4590 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.172173+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9451ac00] now 0 2023-10-03T19:21:20.867 INFO:teuthology.orchestra.run.smithi045.stdout: -5853> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+519 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9451ac00 count now 1/519 2023-10-03T19:21:20.867 INFO:teuthology.orchestra.run.smithi045.stdout: -5852> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003cd) clear_dirty_parent 2023-10-03T19:21:20.867 INFO:teuthology.orchestra.run.smithi045.stdout: -5851> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ce) _stored_backtrace v 1934 2023-10-03T19:21:20.867 INFO:teuthology.orchestra.run.smithi045.stdout: -5850> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ce) auth_unpin by 0x55cc9451b180 on [inode 0x100000003ce [2,head] /dc-dir/dc-file_473 auth v4592 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.183407+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9451b180] now 0 2023-10-03T19:21:20.867 INFO:teuthology.orchestra.run.smithi045.stdout: -5849> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+518 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9451b180 count now 1/518 2023-10-03T19:21:20.868 INFO:teuthology.orchestra.run.smithi045.stdout: -5848> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ce) clear_dirty_parent 2023-10-03T19:21:20.868 INFO:teuthology.orchestra.run.smithi045.stdout: -5847> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003cf) _stored_backtrace v 1938 2023-10-03T19:21:20.868 INFO:teuthology.orchestra.run.smithi045.stdout: -5846> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003cf) auth_unpin by 0x55cc9451b700 on [inode 0x100000003cf [2,head] /dc-dir/dc-file_474 auth v4594 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.195046+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9451b700] now 0 2023-10-03T19:21:20.868 INFO:teuthology.orchestra.run.smithi045.stdout: -5845> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+517 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9451b700 count now 1/517 2023-10-03T19:21:20.868 INFO:teuthology.orchestra.run.smithi045.stdout: -5844> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003cf) clear_dirty_parent 2023-10-03T19:21:20.869 INFO:teuthology.orchestra.run.smithi045.stdout: -5843> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d0) _stored_backtrace v 1942 2023-10-03T19:21:20.869 INFO:teuthology.orchestra.run.smithi045.stdout: -5842> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d0) auth_unpin by 0x55cc9452c000 on [inode 0x100000003d0 [2,head] /dc-dir/dc-file_475 auth v4596 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.206128+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9452c000] now 0 2023-10-03T19:21:20.869 INFO:teuthology.orchestra.run.smithi045.stdout: -5841> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+516 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9452c000 count now 1/516 2023-10-03T19:21:20.869 INFO:teuthology.orchestra.run.smithi045.stdout: -5840> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d0) clear_dirty_parent 2023-10-03T19:21:20.870 INFO:teuthology.orchestra.run.smithi045.stdout: -5839> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d1) _stored_backtrace v 1946 2023-10-03T19:21:20.870 INFO:teuthology.orchestra.run.smithi045.stdout: -5838> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d1) auth_unpin by 0x55cc9452c580 on [inode 0x100000003d1 [2,head] /dc-dir/dc-file_476 auth v4598 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.217560+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9452c580] now 0 2023-10-03T19:21:20.870 INFO:teuthology.orchestra.run.smithi045.stdout: -5837> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+515 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9452c580 count now 1/515 2023-10-03T19:21:20.870 INFO:teuthology.orchestra.run.smithi045.stdout: -5836> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d1) clear_dirty_parent 2023-10-03T19:21:20.870 INFO:teuthology.orchestra.run.smithi045.stdout: -5835> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d2) _stored_backtrace v 1950 2023-10-03T19:21:20.870 INFO:teuthology.orchestra.run.smithi045.stdout: -5834> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d2) auth_unpin by 0x55cc9452cb00 on [inode 0x100000003d2 [2,head] /dc-dir/dc-file_477 auth v4600 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.229269+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9452cb00] now 0 2023-10-03T19:21:20.871 INFO:teuthology.orchestra.run.smithi045.stdout: -5833> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+514 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9452cb00 count now 1/514 2023-10-03T19:21:20.871 INFO:teuthology.orchestra.run.smithi045.stdout: -5832> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d2) clear_dirty_parent 2023-10-03T19:21:20.871 INFO:teuthology.orchestra.run.smithi045.stdout: -5831> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d3) _stored_backtrace v 1954 2023-10-03T19:21:20.871 INFO:teuthology.orchestra.run.smithi045.stdout: -5830> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d3) auth_unpin by 0x55cc9452d080 on [inode 0x100000003d3 [2,head] /dc-dir/dc-file_478 auth v4602 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.240251+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9452d080] now 0 2023-10-03T19:21:20.871 INFO:teuthology.orchestra.run.smithi045.stdout: -5829> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+513 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9452d080 count now 1/513 2023-10-03T19:21:20.872 INFO:teuthology.orchestra.run.smithi045.stdout: -5828> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d3) clear_dirty_parent 2023-10-03T19:21:20.872 INFO:teuthology.orchestra.run.smithi045.stdout: -5827> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d4) _stored_backtrace v 1958 2023-10-03T19:21:20.872 INFO:teuthology.orchestra.run.smithi045.stdout: -5826> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d4) auth_unpin by 0x55cc9452d600 on [inode 0x100000003d4 [2,head] /dc-dir/dc-file_479 auth v4604 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.252644+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9452d600] now 0 2023-10-03T19:21:20.872 INFO:teuthology.orchestra.run.smithi045.stdout: -5825> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+512 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9452d600 count now 1/512 2023-10-03T19:21:20.872 INFO:teuthology.orchestra.run.smithi045.stdout: -5824> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d4) clear_dirty_parent 2023-10-03T19:21:20.872 INFO:teuthology.orchestra.run.smithi045.stdout: -5823> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d5) _stored_backtrace v 1962 2023-10-03T19:21:20.873 INFO:teuthology.orchestra.run.smithi045.stdout: -5822> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d5) auth_unpin by 0x55cc9452db80 on [inode 0x100000003d5 [2,head] /dc-dir/dc-file_480 auth v4606 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.263746+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9452db80] now 0 2023-10-03T19:21:20.873 INFO:teuthology.orchestra.run.smithi045.stdout: -5821> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+511 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9452db80 count now 1/511 2023-10-03T19:21:20.873 INFO:teuthology.orchestra.run.smithi045.stdout: -5820> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d5) clear_dirty_parent 2023-10-03T19:21:20.873 INFO:teuthology.orchestra.run.smithi045.stdout: -5819> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d6) _stored_backtrace v 1966 2023-10-03T19:21:20.873 INFO:teuthology.orchestra.run.smithi045.stdout: -5818> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d6) auth_unpin by 0x55cc9452e100 on [inode 0x100000003d6 [2,head] /dc-dir/dc-file_481 auth v4608 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.275004+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9452e100] now 0 2023-10-03T19:21:20.873 INFO:teuthology.orchestra.run.smithi045.stdout: -5817> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+510 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9452e100 count now 1/510 2023-10-03T19:21:20.874 INFO:teuthology.orchestra.run.smithi045.stdout: -5816> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d6) clear_dirty_parent 2023-10-03T19:21:20.874 INFO:teuthology.orchestra.run.smithi045.stdout: -5815> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d7) _stored_backtrace v 1970 2023-10-03T19:21:20.874 INFO:teuthology.orchestra.run.smithi045.stdout: -5814> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d7) auth_unpin by 0x55cc9452e680 on [inode 0x100000003d7 [2,head] /dc-dir/dc-file_482 auth v4610 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.286265+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9452e680] now 0 2023-10-03T19:21:20.874 INFO:teuthology.orchestra.run.smithi045.stdout: -5813> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+509 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9452e680 count now 1/509 2023-10-03T19:21:20.874 INFO:teuthology.orchestra.run.smithi045.stdout: -5812> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d7) clear_dirty_parent 2023-10-03T19:21:20.874 INFO:teuthology.orchestra.run.smithi045.stdout: -5811> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d8) _stored_backtrace v 1974 2023-10-03T19:21:20.875 INFO:teuthology.orchestra.run.smithi045.stdout: -5810> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d8) auth_unpin by 0x55cc9452ec00 on [inode 0x100000003d8 [2,head] /dc-dir/dc-file_483 auth v4612 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.297735+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9452ec00] now 0 2023-10-03T19:21:20.875 INFO:teuthology.orchestra.run.smithi045.stdout: -5809> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+508 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9452ec00 count now 1/508 2023-10-03T19:21:20.875 INFO:teuthology.orchestra.run.smithi045.stdout: -5808> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d8) clear_dirty_parent 2023-10-03T19:21:20.875 INFO:teuthology.orchestra.run.smithi045.stdout: -5807> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d9) _stored_backtrace v 1978 2023-10-03T19:21:20.876 INFO:teuthology.orchestra.run.smithi045.stdout: -5806> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d9) auth_unpin by 0x55cc9452f180 on [inode 0x100000003d9 [2,head] /dc-dir/dc-file_484 auth v4614 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.310120+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9452f180] now 0 2023-10-03T19:21:20.876 INFO:teuthology.orchestra.run.smithi045.stdout: -5805> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+507 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9452f180 count now 1/507 2023-10-03T19:21:20.876 INFO:teuthology.orchestra.run.smithi045.stdout: -5804> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d9) clear_dirty_parent 2023-10-03T19:21:20.876 INFO:teuthology.orchestra.run.smithi045.stdout: -5803> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003da) _stored_backtrace v 1982 2023-10-03T19:21:20.876 INFO:teuthology.orchestra.run.smithi045.stdout: -5802> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003da) auth_unpin by 0x55cc9452f700 on [inode 0x100000003da [2,head] /dc-dir/dc-file_485 auth v4616 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.322012+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9452f700] now 0 2023-10-03T19:21:20.876 INFO:teuthology.orchestra.run.smithi045.stdout: -5801> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+506 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9452f700 count now 1/506 2023-10-03T19:21:21.254 INFO:teuthology.orchestra.run.smithi045.stdout: -5800> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003da) clear_dirty_parent 2023-10-03T19:21:21.254 INFO:teuthology.orchestra.run.smithi045.stdout: -5799> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003db) _stored_backtrace v 1986 2023-10-03T19:21:21.254 INFO:teuthology.orchestra.run.smithi045.stdout: -5798> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003db) auth_unpin by 0x55cc94534000 on [inode 0x100000003db [2,head] /dc-dir/dc-file_486 auth v4618 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.333569+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94534000] now 0 2023-10-03T19:21:21.254 INFO:teuthology.orchestra.run.smithi045.stdout: -5797> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+505 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94534000 count now 1/505 2023-10-03T19:21:21.254 INFO:teuthology.orchestra.run.smithi045.stdout: -5796> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003db) clear_dirty_parent 2023-10-03T19:21:21.254 INFO:teuthology.orchestra.run.smithi045.stdout: -5795> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003dc) _stored_backtrace v 1990 2023-10-03T19:21:21.254 INFO:teuthology.orchestra.run.smithi045.stdout: -5794> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003dc) auth_unpin by 0x55cc94534580 on [inode 0x100000003dc [2,head] /dc-dir/dc-file_487 auth v4620 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.345727+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94534580] now 0 2023-10-03T19:21:21.254 INFO:teuthology.orchestra.run.smithi045.stdout: -5793> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+504 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94534580 count now 1/504 2023-10-03T19:21:21.255 INFO:teuthology.orchestra.run.smithi045.stdout: -5792> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003dc) clear_dirty_parent 2023-10-03T19:21:21.255 INFO:teuthology.orchestra.run.smithi045.stdout: -5791> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003dd) _stored_backtrace v 1994 2023-10-03T19:21:21.255 INFO:teuthology.orchestra.run.smithi045.stdout: -5790> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003dd) auth_unpin by 0x55cc94534b00 on [inode 0x100000003dd [2,head] /dc-dir/dc-file_488 auth v4622 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.358874+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94534b00] now 0 2023-10-03T19:21:21.255 INFO:teuthology.orchestra.run.smithi045.stdout: -5789> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+503 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94534b00 count now 1/503 2023-10-03T19:21:21.255 INFO:teuthology.orchestra.run.smithi045.stdout: -5788> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003dd) clear_dirty_parent 2023-10-03T19:21:21.255 INFO:teuthology.orchestra.run.smithi045.stdout: -5787> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003de) _stored_backtrace v 1998 2023-10-03T19:21:21.255 INFO:teuthology.orchestra.run.smithi045.stdout: -5786> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003de) auth_unpin by 0x55cc94535080 on [inode 0x100000003de [2,head] /dc-dir/dc-file_489 auth v4624 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.371180+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94535080] now 0 2023-10-03T19:21:21.255 INFO:teuthology.orchestra.run.smithi045.stdout: -5785> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+502 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94535080 count now 1/502 2023-10-03T19:21:21.255 INFO:teuthology.orchestra.run.smithi045.stdout: -5784> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003de) clear_dirty_parent 2023-10-03T19:21:21.256 INFO:teuthology.orchestra.run.smithi045.stdout: -5783> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003df) _stored_backtrace v 2002 2023-10-03T19:21:21.256 INFO:teuthology.orchestra.run.smithi045.stdout: -5782> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003df) auth_unpin by 0x55cc94535600 on [inode 0x100000003df [2,head] /dc-dir/dc-file_490 auth v4626 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.383436+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94535600] now 0 2023-10-03T19:21:21.256 INFO:teuthology.orchestra.run.smithi045.stdout: -5781> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+501 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94535600 count now 1/501 2023-10-03T19:21:21.256 INFO:teuthology.orchestra.run.smithi045.stdout: -5780> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003df) clear_dirty_parent 2023-10-03T19:21:21.256 INFO:teuthology.orchestra.run.smithi045.stdout: -5779> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e0) _stored_backtrace v 2006 2023-10-03T19:21:21.256 INFO:teuthology.orchestra.run.smithi045.stdout: -5778> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e0) auth_unpin by 0x55cc94535b80 on [inode 0x100000003e0 [2,head] /dc-dir/dc-file_491 auth v4628 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.394939+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94535b80] now 0 2023-10-03T19:21:21.256 INFO:teuthology.orchestra.run.smithi045.stdout: -5777> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+500 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94535b80 count now 1/500 2023-10-03T19:21:21.256 INFO:teuthology.orchestra.run.smithi045.stdout: -5776> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e0) clear_dirty_parent 2023-10-03T19:21:21.256 INFO:teuthology.orchestra.run.smithi045.stdout: -5775> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e1) _stored_backtrace v 2010 2023-10-03T19:21:21.257 INFO:teuthology.orchestra.run.smithi045.stdout: -5774> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e1) auth_unpin by 0x55cc94536100 on [inode 0x100000003e1 [2,head] /dc-dir/dc-file_492 auth v4630 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.406451+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94536100] now 0 2023-10-03T19:21:21.257 INFO:teuthology.orchestra.run.smithi045.stdout: -5773> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+499 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94536100 count now 1/499 2023-10-03T19:21:21.257 INFO:teuthology.orchestra.run.smithi045.stdout: -5772> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e1) clear_dirty_parent 2023-10-03T19:21:21.257 INFO:teuthology.orchestra.run.smithi045.stdout: -5771> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e2) _stored_backtrace v 2014 2023-10-03T19:21:21.257 INFO:teuthology.orchestra.run.smithi045.stdout: -5770> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e2) auth_unpin by 0x55cc94536680 on [inode 0x100000003e2 [2,head] /dc-dir/dc-file_493 auth v4632 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.418435+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94536680] now 0 2023-10-03T19:21:21.257 INFO:teuthology.orchestra.run.smithi045.stdout: -5769> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+498 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94536680 count now 1/498 2023-10-03T19:21:21.257 INFO:teuthology.orchestra.run.smithi045.stdout: -5768> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e2) clear_dirty_parent 2023-10-03T19:21:21.257 INFO:teuthology.orchestra.run.smithi045.stdout: -5767> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e3) _stored_backtrace v 2018 2023-10-03T19:21:21.257 INFO:teuthology.orchestra.run.smithi045.stdout: -5766> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e3) auth_unpin by 0x55cc94536c00 on [inode 0x100000003e3 [2,head] /dc-dir/dc-file_494 auth v4634 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.430389+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94536c00] now 0 2023-10-03T19:21:21.258 INFO:teuthology.orchestra.run.smithi045.stdout: -5765> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+497 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94536c00 count now 1/497 2023-10-03T19:21:21.258 INFO:teuthology.orchestra.run.smithi045.stdout: -5764> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e3) clear_dirty_parent 2023-10-03T19:21:21.258 INFO:teuthology.orchestra.run.smithi045.stdout: -5763> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e4) _stored_backtrace v 2022 2023-10-03T19:21:21.258 INFO:teuthology.orchestra.run.smithi045.stdout: -5762> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e4) auth_unpin by 0x55cc94537180 on [inode 0x100000003e4 [2,head] /dc-dir/dc-file_495 auth v4636 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.441665+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94537180] now 0 2023-10-03T19:21:21.258 INFO:teuthology.orchestra.run.smithi045.stdout: -5761> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+496 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94537180 count now 1/496 2023-10-03T19:21:21.258 INFO:teuthology.orchestra.run.smithi045.stdout: -5760> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e4) clear_dirty_parent 2023-10-03T19:21:21.258 INFO:teuthology.orchestra.run.smithi045.stdout: -5759> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e5) _stored_backtrace v 2026 2023-10-03T19:21:21.258 INFO:teuthology.orchestra.run.smithi045.stdout: -5758> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e5) auth_unpin by 0x55cc94537700 on [inode 0x100000003e5 [2,head] /dc-dir/dc-file_496 auth v4638 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.454042+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94537700] now 0 2023-10-03T19:21:21.258 INFO:teuthology.orchestra.run.smithi045.stdout: -5757> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+495 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94537700 count now 1/495 2023-10-03T19:21:21.258 INFO:teuthology.orchestra.run.smithi045.stdout: -5756> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e5) clear_dirty_parent 2023-10-03T19:21:21.258 INFO:teuthology.orchestra.run.smithi045.stdout: -5755> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e6) _stored_backtrace v 2030 2023-10-03T19:21:21.259 INFO:teuthology.orchestra.run.smithi045.stdout: -5754> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e6) auth_unpin by 0x55cc94540000 on [inode 0x100000003e6 [2,head] /dc-dir/dc-file_497 auth v4640 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.465393+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94540000] now 0 2023-10-03T19:21:21.259 INFO:teuthology.orchestra.run.smithi045.stdout: -5753> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+494 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94540000 count now 1/494 2023-10-03T19:21:21.259 INFO:teuthology.orchestra.run.smithi045.stdout: -5752> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e6) clear_dirty_parent 2023-10-03T19:21:21.259 INFO:teuthology.orchestra.run.smithi045.stdout: -5751> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e7) _stored_backtrace v 2034 2023-10-03T19:21:21.259 INFO:teuthology.orchestra.run.smithi045.stdout: -5750> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e7) auth_unpin by 0x55cc94540580 on [inode 0x100000003e7 [2,head] /dc-dir/dc-file_498 auth v4642 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.478352+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94540580] now 0 2023-10-03T19:21:21.259 INFO:teuthology.orchestra.run.smithi045.stdout: -5749> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+493 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94540580 count now 1/493 2023-10-03T19:21:21.259 INFO:teuthology.orchestra.run.smithi045.stdout: -5748> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e7) clear_dirty_parent 2023-10-03T19:21:21.259 INFO:teuthology.orchestra.run.smithi045.stdout: -5747> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e8) _stored_backtrace v 2038 2023-10-03T19:21:21.259 INFO:teuthology.orchestra.run.smithi045.stdout: -5746> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e8) auth_unpin by 0x55cc94540b00 on [inode 0x100000003e8 [2,head] /dc-dir/dc-file_499 auth v4644 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.489364+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94540b00] now 0 2023-10-03T19:21:21.259 INFO:teuthology.orchestra.run.smithi045.stdout: -5745> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+492 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94540b00 count now 1/492 2023-10-03T19:21:21.260 INFO:teuthology.orchestra.run.smithi045.stdout: -5744> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e8) clear_dirty_parent 2023-10-03T19:21:21.260 INFO:teuthology.orchestra.run.smithi045.stdout: -5743> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 MDSContext::complete: 21C_MaybeExpiredSegment 2023-10-03T19:21:21.260 INFO:teuthology.orchestra.run.smithi045.stdout: -5742> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.log _maybe_expired segment 1/4194304, 1024 events 2023-10-03T19:21:21.260 INFO:teuthology.orchestra.run.smithi045.stdout: -5741> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 6 mds.0.journal LogSegment(1/4194304).try_to_expire 2023-10-03T19:21:21.260 INFO:teuthology.orchestra.run.smithi045.stdout: -5740> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 4 mds.0.sessionmap save_if_dirty: writing 0 2023-10-03T19:21:21.260 INFO:teuthology.orchestra.run.smithi045.stdout: -5739> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.journal try_to_expire waiting for purge of [] 2023-10-03T19:21:21.260 INFO:teuthology.orchestra.run.smithi045.stdout: -5738> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 6 mds.0.journal LogSegment(1/4194304).try_to_expire success 2023-10-03T19:21:21.260 INFO:teuthology.orchestra.run.smithi045.stdout: -5737> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.log try_expire expired segment 1/4194304 2023-10-03T19:21:21.260 INFO:teuthology.orchestra.run.smithi045.stdout: -5736> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 5 mds.0.log _expired segment 1/4194304, 1024 events 2023-10-03T19:21:21.260 INFO:teuthology.orchestra.run.smithi045.stdout: -5735> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 MDSIOContextBase::complete: 20BatchStoredBacktrace 2023-10-03T19:21:21.260 INFO:teuthology.orchestra.run.smithi045.stdout: -5734> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 MDSContext::complete: 20BatchStoredBacktrace 2023-10-03T19:21:21.260 INFO:teuthology.orchestra.run.smithi045.stdout: -5733> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e9) _stored_backtrace v 2042 2023-10-03T19:21:21.261 INFO:teuthology.orchestra.run.smithi045.stdout: -5732> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e9) auth_unpin by 0x55cc94541080 on [inode 0x100000003e9 [2,head] /dc-dir/dc-file_500 auth v4646 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.501101+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94541080] now 0 2023-10-03T19:21:21.261 INFO:teuthology.orchestra.run.smithi045.stdout: -5731> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+491 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94541080 count now 1/491 2023-10-03T19:21:21.261 INFO:teuthology.orchestra.run.smithi045.stdout: -5730> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e9) clear_dirty_parent 2023-10-03T19:21:21.261 INFO:teuthology.orchestra.run.smithi045.stdout: -5729> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ea) _stored_backtrace v 2046 2023-10-03T19:21:21.261 INFO:teuthology.orchestra.run.smithi045.stdout: -5728> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ea) auth_unpin by 0x55cc94541600 on [inode 0x100000003ea [2,head] /dc-dir/dc-file_501 auth v4648 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.512514+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94541600] now 0 2023-10-03T19:21:21.261 INFO:teuthology.orchestra.run.smithi045.stdout: -5727> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+490 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94541600 count now 1/490 2023-10-03T19:21:21.261 INFO:teuthology.orchestra.run.smithi045.stdout: -5726> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ea) clear_dirty_parent 2023-10-03T19:21:21.261 INFO:teuthology.orchestra.run.smithi045.stdout: -5725> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003eb) _stored_backtrace v 2050 2023-10-03T19:21:21.261 INFO:teuthology.orchestra.run.smithi045.stdout: -5724> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003eb) auth_unpin by 0x55cc94541b80 on [inode 0x100000003eb [2,head] /dc-dir/dc-file_502 auth v4650 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.525153+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94541b80] now 0 2023-10-03T19:21:21.261 INFO:teuthology.orchestra.run.smithi045.stdout: -5723> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+489 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94541b80 count now 1/489 2023-10-03T19:21:21.261 INFO:teuthology.orchestra.run.smithi045.stdout: -5722> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003eb) clear_dirty_parent 2023-10-03T19:21:21.261 INFO:teuthology.orchestra.run.smithi045.stdout: -5721> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ec) _stored_backtrace v 2054 2023-10-03T19:21:21.262 INFO:teuthology.orchestra.run.smithi045.stdout: -5720> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ec) auth_unpin by 0x55cc94542100 on [inode 0x100000003ec [2,head] /dc-dir/dc-file_503 auth v4652 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.538261+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94542100] now 0 2023-10-03T19:21:21.262 INFO:teuthology.orchestra.run.smithi045.stdout: -5719> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+488 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94542100 count now 1/488 2023-10-03T19:21:21.262 INFO:teuthology.orchestra.run.smithi045.stdout: -5718> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ec) clear_dirty_parent 2023-10-03T19:21:21.262 INFO:teuthology.orchestra.run.smithi045.stdout: -5717> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ed) _stored_backtrace v 2058 2023-10-03T19:21:21.262 INFO:teuthology.orchestra.run.smithi045.stdout: -5716> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ed) auth_unpin by 0x55cc94542680 on [inode 0x100000003ed [2,head] /dc-dir/dc-file_504 auth v4654 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.550523+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94542680] now 0 2023-10-03T19:21:21.262 INFO:teuthology.orchestra.run.smithi045.stdout: -5715> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+487 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94542680 count now 1/487 2023-10-03T19:21:21.262 INFO:teuthology.orchestra.run.smithi045.stdout: -5714> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ed) clear_dirty_parent 2023-10-03T19:21:21.262 INFO:teuthology.orchestra.run.smithi045.stdout: -5713> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ee) _stored_backtrace v 2062 2023-10-03T19:21:21.262 INFO:teuthology.orchestra.run.smithi045.stdout: -5712> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ee) auth_unpin by 0x55cc94542c00 on [inode 0x100000003ee [2,head] /dc-dir/dc-file_505 auth v4656 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.562879+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94542c00] now 0 2023-10-03T19:21:21.262 INFO:teuthology.orchestra.run.smithi045.stdout: -5711> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+486 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94542c00 count now 1/486 2023-10-03T19:21:21.262 INFO:teuthology.orchestra.run.smithi045.stdout: -5710> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ee) clear_dirty_parent 2023-10-03T19:21:21.262 INFO:teuthology.orchestra.run.smithi045.stdout: -5709> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ef) _stored_backtrace v 2066 2023-10-03T19:21:21.263 INFO:teuthology.orchestra.run.smithi045.stdout: -5708> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ef) auth_unpin by 0x55cc94543180 on [inode 0x100000003ef [2,head] /dc-dir/dc-file_506 auth v4658 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.575414+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94543180] now 0 2023-10-03T19:21:21.263 INFO:teuthology.orchestra.run.smithi045.stdout: -5707> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+485 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94543180 count now 1/485 2023-10-03T19:21:21.263 INFO:teuthology.orchestra.run.smithi045.stdout: -5706> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ef) clear_dirty_parent 2023-10-03T19:21:21.263 INFO:teuthology.orchestra.run.smithi045.stdout: -5705> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f0) _stored_backtrace v 2070 2023-10-03T19:21:21.263 INFO:teuthology.orchestra.run.smithi045.stdout: -5704> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f0) auth_unpin by 0x55cc94543700 on [inode 0x100000003f0 [2,head] /dc-dir/dc-file_507 auth v4660 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.587113+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94543700] now 0 2023-10-03T19:21:21.263 INFO:teuthology.orchestra.run.smithi045.stdout: -5703> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+484 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94543700 count now 1/484 2023-10-03T19:21:21.263 INFO:teuthology.orchestra.run.smithi045.stdout: -5702> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f0) clear_dirty_parent 2023-10-03T19:21:21.263 INFO:teuthology.orchestra.run.smithi045.stdout: -5701> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f1) _stored_backtrace v 2074 2023-10-03T19:21:21.263 INFO:teuthology.orchestra.run.smithi045.stdout: -5700> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f1) auth_unpin by 0x55cc94548000 on [inode 0x100000003f1 [2,head] /dc-dir/dc-file_508 auth v4662 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.598530+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94548000] now 0 2023-10-03T19:21:21.263 INFO:teuthology.orchestra.run.smithi045.stdout: -5699> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+483 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94548000 count now 1/483 2023-10-03T19:21:21.264 INFO:teuthology.orchestra.run.smithi045.stdout: -5698> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f1) clear_dirty_parent 2023-10-03T19:21:21.264 INFO:teuthology.orchestra.run.smithi045.stdout: -5697> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f2) _stored_backtrace v 2078 2023-10-03T19:21:21.264 INFO:teuthology.orchestra.run.smithi045.stdout: -5696> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f2) auth_unpin by 0x55cc94548580 on [inode 0x100000003f2 [2,head] /dc-dir/dc-file_509 auth v4664 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.609729+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94548580] now 0 2023-10-03T19:21:21.264 INFO:teuthology.orchestra.run.smithi045.stdout: -5695> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+482 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94548580 count now 1/482 2023-10-03T19:21:21.264 INFO:teuthology.orchestra.run.smithi045.stdout: -5694> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f2) clear_dirty_parent 2023-10-03T19:21:21.264 INFO:teuthology.orchestra.run.smithi045.stdout: -5693> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f3) _stored_backtrace v 2082 2023-10-03T19:21:21.264 INFO:teuthology.orchestra.run.smithi045.stdout: -5692> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f3) auth_unpin by 0x55cc94548b00 on [inode 0x100000003f3 [2,head] /dc-dir/dc-file_510 auth v4666 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.621272+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94548b00] now 0 2023-10-03T19:21:21.264 INFO:teuthology.orchestra.run.smithi045.stdout: -5691> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+481 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94548b00 count now 1/481 2023-10-03T19:21:21.264 INFO:teuthology.orchestra.run.smithi045.stdout: -5690> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f3) clear_dirty_parent 2023-10-03T19:21:21.264 INFO:teuthology.orchestra.run.smithi045.stdout: -5689> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f4) _stored_backtrace v 2086 2023-10-03T19:21:21.264 INFO:teuthology.orchestra.run.smithi045.stdout: -5688> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f4) auth_unpin by 0x55cc94549080 on [inode 0x100000003f4 [2,head] /dc-dir/dc-file_511 auth v4668 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.632408+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94549080] now 0 2023-10-03T19:21:21.264 INFO:teuthology.orchestra.run.smithi045.stdout: -5687> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+480 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94549080 count now 1/480 2023-10-03T19:21:21.265 INFO:teuthology.orchestra.run.smithi045.stdout: -5686> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f4) clear_dirty_parent 2023-10-03T19:21:21.265 INFO:teuthology.orchestra.run.smithi045.stdout: -5685> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f5) _stored_backtrace v 2090 2023-10-03T19:21:21.265 INFO:teuthology.orchestra.run.smithi045.stdout: -5684> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f5) auth_unpin by 0x55cc94549600 on [inode 0x100000003f5 [2,head] /dc-dir/dc-file_512 auth v4670 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.643622+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94549600] now 0 2023-10-03T19:21:21.265 INFO:teuthology.orchestra.run.smithi045.stdout: -5683> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+479 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94549600 count now 1/479 2023-10-03T19:21:21.265 INFO:teuthology.orchestra.run.smithi045.stdout: -5682> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f5) clear_dirty_parent 2023-10-03T19:21:21.265 INFO:teuthology.orchestra.run.smithi045.stdout: -5681> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f6) _stored_backtrace v 2094 2023-10-03T19:21:21.265 INFO:teuthology.orchestra.run.smithi045.stdout: -5680> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f6) auth_unpin by 0x55cc94549b80 on [inode 0x100000003f6 [2,head] /dc-dir/dc-file_513 auth v4672 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.655034+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94549b80] now 0 2023-10-03T19:21:21.265 INFO:teuthology.orchestra.run.smithi045.stdout: -5679> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+478 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94549b80 count now 1/478 2023-10-03T19:21:21.265 INFO:teuthology.orchestra.run.smithi045.stdout: -5678> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f6) clear_dirty_parent 2023-10-03T19:21:21.265 INFO:teuthology.orchestra.run.smithi045.stdout: -5677> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f7) _stored_backtrace v 2098 2023-10-03T19:21:21.265 INFO:teuthology.orchestra.run.smithi045.stdout: -5676> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f7) auth_unpin by 0x55cc9454a100 on [inode 0x100000003f7 [2,head] /dc-dir/dc-file_514 auth v4674 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.666002+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9454a100] now 0 2023-10-03T19:21:21.266 INFO:teuthology.orchestra.run.smithi045.stdout: -5675> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+477 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9454a100 count now 1/477 2023-10-03T19:21:21.266 INFO:teuthology.orchestra.run.smithi045.stdout: -5674> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f7) clear_dirty_parent 2023-10-03T19:21:21.266 INFO:teuthology.orchestra.run.smithi045.stdout: -5673> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f8) _stored_backtrace v 2102 2023-10-03T19:21:21.266 INFO:teuthology.orchestra.run.smithi045.stdout: -5672> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f8) auth_unpin by 0x55cc9454a680 on [inode 0x100000003f8 [2,head] /dc-dir/dc-file_515 auth v4676 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.677216+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9454a680] now 0 2023-10-03T19:21:21.266 INFO:teuthology.orchestra.run.smithi045.stdout: -5671> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+476 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9454a680 count now 1/476 2023-10-03T19:21:21.266 INFO:teuthology.orchestra.run.smithi045.stdout: -5670> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f8) clear_dirty_parent 2023-10-03T19:21:21.266 INFO:teuthology.orchestra.run.smithi045.stdout: -5669> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f9) _stored_backtrace v 2106 2023-10-03T19:21:21.266 INFO:teuthology.orchestra.run.smithi045.stdout: -5668> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f9) auth_unpin by 0x55cc9454ac00 on [inode 0x100000003f9 [2,head] /dc-dir/dc-file_516 auth v4678 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.689199+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9454ac00] now 0 2023-10-03T19:21:21.266 INFO:teuthology.orchestra.run.smithi045.stdout: -5667> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+475 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9454ac00 count now 1/475 2023-10-03T19:21:21.266 INFO:teuthology.orchestra.run.smithi045.stdout: -5666> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f9) clear_dirty_parent 2023-10-03T19:21:21.266 INFO:teuthology.orchestra.run.smithi045.stdout: -5665> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003fa) _stored_backtrace v 2110 2023-10-03T19:21:21.267 INFO:teuthology.orchestra.run.smithi045.stdout: -5664> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003fa) auth_unpin by 0x55cc9454b180 on [inode 0x100000003fa [2,head] /dc-dir/dc-file_517 auth v4680 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.700822+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9454b180] now 0 2023-10-03T19:21:21.267 INFO:teuthology.orchestra.run.smithi045.stdout: -5663> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+474 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9454b180 count now 1/474 2023-10-03T19:21:21.267 INFO:teuthology.orchestra.run.smithi045.stdout: -5662> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003fa) clear_dirty_parent 2023-10-03T19:21:21.267 INFO:teuthology.orchestra.run.smithi045.stdout: -5661> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003fb) _stored_backtrace v 2114 2023-10-03T19:21:21.267 INFO:teuthology.orchestra.run.smithi045.stdout: -5660> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003fb) auth_unpin by 0x55cc9454b700 on [inode 0x100000003fb [2,head] /dc-dir/dc-file_518 auth v4682 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.712247+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9454b700] now 0 2023-10-03T19:21:21.267 INFO:teuthology.orchestra.run.smithi045.stdout: -5659> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+473 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9454b700 count now 1/473 2023-10-03T19:21:21.267 INFO:teuthology.orchestra.run.smithi045.stdout: -5658> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003fb) clear_dirty_parent 2023-10-03T19:21:21.267 INFO:teuthology.orchestra.run.smithi045.stdout: -5657> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003fc) _stored_backtrace v 2118 2023-10-03T19:21:21.267 INFO:teuthology.orchestra.run.smithi045.stdout: -5656> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003fc) auth_unpin by 0x55cc9442a000 on [inode 0x100000003fc [2,head] /dc-dir/dc-file_519 auth v4684 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.724358+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9442a000] now 0 2023-10-03T19:21:21.267 INFO:teuthology.orchestra.run.smithi045.stdout: -5655> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+472 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9442a000 count now 1/472 2023-10-03T19:21:21.267 INFO:teuthology.orchestra.run.smithi045.stdout: -5654> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003fc) clear_dirty_parent 2023-10-03T19:21:21.268 INFO:teuthology.orchestra.run.smithi045.stdout: -5653> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003fd) _stored_backtrace v 2122 2023-10-03T19:21:21.268 INFO:teuthology.orchestra.run.smithi045.stdout: -5652> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003fd) auth_unpin by 0x55cc9442a580 on [inode 0x100000003fd [2,head] /dc-dir/dc-file_520 auth v4686 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.735902+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9442a580] now 0 2023-10-03T19:21:21.268 INFO:teuthology.orchestra.run.smithi045.stdout: -5651> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+471 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9442a580 count now 1/471 2023-10-03T19:21:21.268 INFO:teuthology.orchestra.run.smithi045.stdout: -5650> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003fd) clear_dirty_parent 2023-10-03T19:21:21.268 INFO:teuthology.orchestra.run.smithi045.stdout: -5649> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003fe) _stored_backtrace v 2126 2023-10-03T19:21:21.268 INFO:teuthology.orchestra.run.smithi045.stdout: -5648> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003fe) auth_unpin by 0x55cc9442ab00 on [inode 0x100000003fe [2,head] /dc-dir/dc-file_521 auth v4688 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.747848+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9442ab00] now 0 2023-10-03T19:21:21.268 INFO:teuthology.orchestra.run.smithi045.stdout: -5647> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+470 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9442ab00 count now 1/470 2023-10-03T19:21:21.268 INFO:teuthology.orchestra.run.smithi045.stdout: -5646> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003fe) clear_dirty_parent 2023-10-03T19:21:21.268 INFO:teuthology.orchestra.run.smithi045.stdout: -5645> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ff) _stored_backtrace v 2130 2023-10-03T19:21:21.268 INFO:teuthology.orchestra.run.smithi045.stdout: -5644> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ff) auth_unpin by 0x55cc9442b080 on [inode 0x100000003ff [2,head] /dc-dir/dc-file_522 auth v4690 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.760561+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9442b080] now 0 2023-10-03T19:21:21.268 INFO:teuthology.orchestra.run.smithi045.stdout: -5643> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+469 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9442b080 count now 1/469 2023-10-03T19:21:21.268 INFO:teuthology.orchestra.run.smithi045.stdout: -5642> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ff) clear_dirty_parent 2023-10-03T19:21:21.269 INFO:teuthology.orchestra.run.smithi045.stdout: -5641> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000400) _stored_backtrace v 2134 2023-10-03T19:21:21.269 INFO:teuthology.orchestra.run.smithi045.stdout: -5640> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000400) auth_unpin by 0x55cc9442b600 on [inode 0x10000000400 [2,head] /dc-dir/dc-file_523 auth v4692 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.772077+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9442b600] now 0 2023-10-03T19:21:21.269 INFO:teuthology.orchestra.run.smithi045.stdout: -5639> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+468 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9442b600 count now 1/468 2023-10-03T19:21:21.269 INFO:teuthology.orchestra.run.smithi045.stdout: -5638> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000400) clear_dirty_parent 2023-10-03T19:21:21.269 INFO:teuthology.orchestra.run.smithi045.stdout: -5637> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000401) _stored_backtrace v 2138 2023-10-03T19:21:21.269 INFO:teuthology.orchestra.run.smithi045.stdout: -5636> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000401) auth_unpin by 0x55cc9442bb80 on [inode 0x10000000401 [2,head] /dc-dir/dc-file_524 auth v4694 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.783775+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9442bb80] now 0 2023-10-03T19:21:21.269 INFO:teuthology.orchestra.run.smithi045.stdout: -5635> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+467 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9442bb80 count now 1/467 2023-10-03T19:21:21.269 INFO:teuthology.orchestra.run.smithi045.stdout: -5634> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000401) clear_dirty_parent 2023-10-03T19:21:21.269 INFO:teuthology.orchestra.run.smithi045.stdout: -5633> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000402) _stored_backtrace v 2142 2023-10-03T19:21:21.269 INFO:teuthology.orchestra.run.smithi045.stdout: -5632> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000402) auth_unpin by 0x55cc9442c100 on [inode 0x10000000402 [2,head] /dc-dir/dc-file_525 auth v4696 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.795514+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9442c100] now 0 2023-10-03T19:21:21.269 INFO:teuthology.orchestra.run.smithi045.stdout: -5631> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+466 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9442c100 count now 1/466 2023-10-03T19:21:21.269 INFO:teuthology.orchestra.run.smithi045.stdout: -5630> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000402) clear_dirty_parent 2023-10-03T19:21:21.270 INFO:teuthology.orchestra.run.smithi045.stdout: -5629> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000403) _stored_backtrace v 2146 2023-10-03T19:21:21.270 INFO:teuthology.orchestra.run.smithi045.stdout: -5628> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000403) auth_unpin by 0x55cc9442c680 on [inode 0x10000000403 [2,head] /dc-dir/dc-file_526 auth v4698 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.807295+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9442c680] now 0 2023-10-03T19:21:21.270 INFO:teuthology.orchestra.run.smithi045.stdout: -5627> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+465 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9442c680 count now 1/465 2023-10-03T19:21:21.270 INFO:teuthology.orchestra.run.smithi045.stdout: -5626> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000403) clear_dirty_parent 2023-10-03T19:21:21.270 INFO:teuthology.orchestra.run.smithi045.stdout: -5625> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000404) _stored_backtrace v 2150 2023-10-03T19:21:21.270 INFO:teuthology.orchestra.run.smithi045.stdout: -5624> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000404) auth_unpin by 0x55cc9442cc00 on [inode 0x10000000404 [2,head] /dc-dir/dc-file_527 auth v4700 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.818652+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9442cc00] now 0 2023-10-03T19:21:21.270 INFO:teuthology.orchestra.run.smithi045.stdout: -5623> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+464 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9442cc00 count now 1/464 2023-10-03T19:21:21.270 INFO:teuthology.orchestra.run.smithi045.stdout: -5622> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000404) clear_dirty_parent 2023-10-03T19:21:21.270 INFO:teuthology.orchestra.run.smithi045.stdout: -5621> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000405) _stored_backtrace v 2154 2023-10-03T19:21:21.270 INFO:teuthology.orchestra.run.smithi045.stdout: -5620> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000405) auth_unpin by 0x55cc9442d180 on [inode 0x10000000405 [2,head] /dc-dir/dc-file_528 auth v4702 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.831255+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9442d180] now 0 2023-10-03T19:21:21.271 INFO:teuthology.orchestra.run.smithi045.stdout: -5619> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+463 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9442d180 count now 1/463 2023-10-03T19:21:21.271 INFO:teuthology.orchestra.run.smithi045.stdout: -5618> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000405) clear_dirty_parent 2023-10-03T19:21:21.271 INFO:teuthology.orchestra.run.smithi045.stdout: -5617> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000406) _stored_backtrace v 2158 2023-10-03T19:21:21.271 INFO:teuthology.orchestra.run.smithi045.stdout: -5616> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000406) auth_unpin by 0x55cc9442d700 on [inode 0x10000000406 [2,head] /dc-dir/dc-file_529 auth v4704 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.843268+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9442d700] now 0 2023-10-03T19:21:21.271 INFO:teuthology.orchestra.run.smithi045.stdout: -5615> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+462 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9442d700 count now 1/462 2023-10-03T19:21:21.271 INFO:teuthology.orchestra.run.smithi045.stdout: -5614> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000406) clear_dirty_parent 2023-10-03T19:21:21.271 INFO:teuthology.orchestra.run.smithi045.stdout: -5613> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000407) _stored_backtrace v 2162 2023-10-03T19:21:21.271 INFO:teuthology.orchestra.run.smithi045.stdout: -5612> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000407) auth_unpin by 0x55cc94434000 on [inode 0x10000000407 [2,head] /dc-dir/dc-file_530 auth v4706 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.855884+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94434000] now 0 2023-10-03T19:21:21.271 INFO:teuthology.orchestra.run.smithi045.stdout: -5611> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+461 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94434000 count now 1/461 2023-10-03T19:21:21.271 INFO:teuthology.orchestra.run.smithi045.stdout: -5610> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000407) clear_dirty_parent 2023-10-03T19:21:21.272 INFO:teuthology.orchestra.run.smithi045.stdout: -5609> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000408) _stored_backtrace v 2166 2023-10-03T19:21:21.272 INFO:teuthology.orchestra.run.smithi045.stdout: -5608> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000408) auth_unpin by 0x55cc94434580 on [inode 0x10000000408 [2,head] /dc-dir/dc-file_531 auth v4708 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.868223+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94434580] now 0 2023-10-03T19:21:21.272 INFO:teuthology.orchestra.run.smithi045.stdout: -5607> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+460 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94434580 count now 1/460 2023-10-03T19:21:21.272 INFO:teuthology.orchestra.run.smithi045.stdout: -5606> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000408) clear_dirty_parent 2023-10-03T19:21:21.272 INFO:teuthology.orchestra.run.smithi045.stdout: -5605> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000409) _stored_backtrace v 2170 2023-10-03T19:21:21.272 INFO:teuthology.orchestra.run.smithi045.stdout: -5604> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000409) auth_unpin by 0x55cc94434b00 on [inode 0x10000000409 [2,head] /dc-dir/dc-file_532 auth v4710 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.880066+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94434b00] now 0 2023-10-03T19:21:21.272 INFO:teuthology.orchestra.run.smithi045.stdout: -5603> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+459 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94434b00 count now 1/459 2023-10-03T19:21:21.272 INFO:teuthology.orchestra.run.smithi045.stdout: -5602> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000409) clear_dirty_parent 2023-10-03T19:21:21.272 INFO:teuthology.orchestra.run.smithi045.stdout: -5601> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000040a) _stored_backtrace v 2174 2023-10-03T19:21:21.272 INFO:teuthology.orchestra.run.smithi045.stdout: -5600> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000040a) auth_unpin by 0x55cc94435080 on [inode 0x1000000040a [2,head] /dc-dir/dc-file_533 auth v4712 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.892469+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94435080] now 0 2023-10-03T19:21:21.272 INFO:teuthology.orchestra.run.smithi045.stdout: -5599> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+458 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94435080 count now 1/458 2023-10-03T19:21:21.272 INFO:teuthology.orchestra.run.smithi045.stdout: -5598> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000040a) clear_dirty_parent 2023-10-03T19:21:21.273 INFO:teuthology.orchestra.run.smithi045.stdout: -5597> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000040b) _stored_backtrace v 2178 2023-10-03T19:21:21.273 INFO:teuthology.orchestra.run.smithi045.stdout: -5596> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000040b) auth_unpin by 0x55cc94435600 on [inode 0x1000000040b [2,head] /dc-dir/dc-file_534 auth v4714 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.904167+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94435600] now 0 2023-10-03T19:21:21.273 INFO:teuthology.orchestra.run.smithi045.stdout: -5595> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+457 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94435600 count now 1/457 2023-10-03T19:21:21.273 INFO:teuthology.orchestra.run.smithi045.stdout: -5594> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000040b) clear_dirty_parent 2023-10-03T19:21:21.273 INFO:teuthology.orchestra.run.smithi045.stdout: -5593> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000040c) _stored_backtrace v 2182 2023-10-03T19:21:21.273 INFO:teuthology.orchestra.run.smithi045.stdout: -5592> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000040c) auth_unpin by 0x55cc94435b80 on [inode 0x1000000040c [2,head] /dc-dir/dc-file_535 auth v4716 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.917994+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94435b80] now 0 2023-10-03T19:21:21.273 INFO:teuthology.orchestra.run.smithi045.stdout: -5591> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+456 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94435b80 count now 1/456 2023-10-03T19:21:21.273 INFO:teuthology.orchestra.run.smithi045.stdout: -5590> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000040c) clear_dirty_parent 2023-10-03T19:21:21.273 INFO:teuthology.orchestra.run.smithi045.stdout: -5589> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000040d) _stored_backtrace v 2186 2023-10-03T19:21:21.273 INFO:teuthology.orchestra.run.smithi045.stdout: -5588> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000040d) auth_unpin by 0x55cc94436100 on [inode 0x1000000040d [2,head] /dc-dir/dc-file_536 auth v4718 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.930426+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94436100] now 0 2023-10-03T19:21:21.273 INFO:teuthology.orchestra.run.smithi045.stdout: -5587> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+455 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94436100 count now 1/455 2023-10-03T19:21:21.274 INFO:teuthology.orchestra.run.smithi045.stdout: -5586> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000040d) clear_dirty_parent 2023-10-03T19:21:21.274 INFO:teuthology.orchestra.run.smithi045.stdout: -5585> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000040e) _stored_backtrace v 2190 2023-10-03T19:21:21.274 INFO:teuthology.orchestra.run.smithi045.stdout: -5584> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000040e) auth_unpin by 0x55cc94436680 on [inode 0x1000000040e [2,head] /dc-dir/dc-file_537 auth v4720 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.942874+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94436680] now 0 2023-10-03T19:21:21.274 INFO:teuthology.orchestra.run.smithi045.stdout: -5583> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+454 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94436680 count now 1/454 2023-10-03T19:21:21.274 INFO:teuthology.orchestra.run.smithi045.stdout: -5582> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000040e) clear_dirty_parent 2023-10-03T19:21:21.274 INFO:teuthology.orchestra.run.smithi045.stdout: -5581> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000040f) _stored_backtrace v 2194 2023-10-03T19:21:21.274 INFO:teuthology.orchestra.run.smithi045.stdout: -5580> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000040f) auth_unpin by 0x55cc94436c00 on [inode 0x1000000040f [2,head] /dc-dir/dc-file_538 auth v4722 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.954237+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94436c00] now 0 2023-10-03T19:21:21.274 INFO:teuthology.orchestra.run.smithi045.stdout: -5579> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+453 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94436c00 count now 1/453 2023-10-03T19:21:21.275 INFO:teuthology.orchestra.run.smithi045.stdout: -5578> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000040f) clear_dirty_parent 2023-10-03T19:21:21.275 INFO:teuthology.orchestra.run.smithi045.stdout: -5577> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000410) _stored_backtrace v 2198 2023-10-03T19:21:21.275 INFO:teuthology.orchestra.run.smithi045.stdout: -5576> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000410) auth_unpin by 0x55cc94437180 on [inode 0x10000000410 [2,head] /dc-dir/dc-file_539 auth v4724 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.965749+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94437180] now 0 2023-10-03T19:21:21.275 INFO:teuthology.orchestra.run.smithi045.stdout: -5575> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+452 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94437180 count now 1/452 2023-10-03T19:21:21.275 INFO:teuthology.orchestra.run.smithi045.stdout: -5574> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000410) clear_dirty_parent 2023-10-03T19:21:21.275 INFO:teuthology.orchestra.run.smithi045.stdout: -5573> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000411) _stored_backtrace v 2202 2023-10-03T19:21:21.275 INFO:teuthology.orchestra.run.smithi045.stdout: -5572> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000411) auth_unpin by 0x55cc94437700 on [inode 0x10000000411 [2,head] /dc-dir/dc-file_540 auth v4726 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.977987+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94437700] now 0 2023-10-03T19:21:21.275 INFO:teuthology.orchestra.run.smithi045.stdout: -5571> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+451 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94437700 count now 1/451 2023-10-03T19:21:21.275 INFO:teuthology.orchestra.run.smithi045.stdout: -5570> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000411) clear_dirty_parent 2023-10-03T19:21:21.275 INFO:teuthology.orchestra.run.smithi045.stdout: -5569> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000412) _stored_backtrace v 2206 2023-10-03T19:21:21.275 INFO:teuthology.orchestra.run.smithi045.stdout: -5568> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000412) auth_unpin by 0x55cc94442000 on [inode 0x10000000412 [2,head] /dc-dir/dc-file_541 auth v4728 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:51.989691+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94442000] now 0 2023-10-03T19:21:21.276 INFO:teuthology.orchestra.run.smithi045.stdout: -5567> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+450 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94442000 count now 1/450 2023-10-03T19:21:21.276 INFO:teuthology.orchestra.run.smithi045.stdout: -5566> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000412) clear_dirty_parent 2023-10-03T19:21:21.276 INFO:teuthology.orchestra.run.smithi045.stdout: -5565> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000413) _stored_backtrace v 2210 2023-10-03T19:21:21.276 INFO:teuthology.orchestra.run.smithi045.stdout: -5564> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000413) auth_unpin by 0x55cc94442580 on [inode 0x10000000413 [2,head] /dc-dir/dc-file_542 auth v4730 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.001754+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94442580] now 0 2023-10-03T19:21:21.276 INFO:teuthology.orchestra.run.smithi045.stdout: -5563> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+449 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94442580 count now 1/449 2023-10-03T19:21:21.276 INFO:teuthology.orchestra.run.smithi045.stdout: -5562> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000413) clear_dirty_parent 2023-10-03T19:21:21.276 INFO:teuthology.orchestra.run.smithi045.stdout: -5561> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000414) _stored_backtrace v 2214 2023-10-03T19:21:21.276 INFO:teuthology.orchestra.run.smithi045.stdout: -5560> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000414) auth_unpin by 0x55cc94442b00 on [inode 0x10000000414 [2,head] /dc-dir/dc-file_543 auth v4732 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.013623+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94442b00] now 0 2023-10-03T19:21:21.276 INFO:teuthology.orchestra.run.smithi045.stdout: -5559> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+448 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94442b00 count now 1/448 2023-10-03T19:21:21.276 INFO:teuthology.orchestra.run.smithi045.stdout: -5558> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000414) clear_dirty_parent 2023-10-03T19:21:21.277 INFO:teuthology.orchestra.run.smithi045.stdout: -5557> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000415) _stored_backtrace v 2218 2023-10-03T19:21:21.277 INFO:teuthology.orchestra.run.smithi045.stdout: -5556> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000415) auth_unpin by 0x55cc94443080 on [inode 0x10000000415 [2,head] /dc-dir/dc-file_544 auth v4734 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.025118+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94443080] now 0 2023-10-03T19:21:21.277 INFO:teuthology.orchestra.run.smithi045.stdout: -5555> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+447 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94443080 count now 1/447 2023-10-03T19:21:21.277 INFO:teuthology.orchestra.run.smithi045.stdout: -5554> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000415) clear_dirty_parent 2023-10-03T19:21:21.277 INFO:teuthology.orchestra.run.smithi045.stdout: -5553> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000416) _stored_backtrace v 2222 2023-10-03T19:21:21.277 INFO:teuthology.orchestra.run.smithi045.stdout: -5552> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000416) auth_unpin by 0x55cc94443600 on [inode 0x10000000416 [2,head] /dc-dir/dc-file_545 auth v4736 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.036209+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94443600] now 0 2023-10-03T19:21:21.277 INFO:teuthology.orchestra.run.smithi045.stdout: -5551> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+446 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94443600 count now 1/446 2023-10-03T19:21:21.277 INFO:teuthology.orchestra.run.smithi045.stdout: -5550> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000416) clear_dirty_parent 2023-10-03T19:21:21.277 INFO:teuthology.orchestra.run.smithi045.stdout: -5549> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000417) _stored_backtrace v 2226 2023-10-03T19:21:21.277 INFO:teuthology.orchestra.run.smithi045.stdout: -5548> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000417) auth_unpin by 0x55cc94443b80 on [inode 0x10000000417 [2,head] /dc-dir/dc-file_546 auth v4738 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.049212+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94443b80] now 0 2023-10-03T19:21:21.277 INFO:teuthology.orchestra.run.smithi045.stdout: -5547> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+445 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94443b80 count now 1/445 2023-10-03T19:21:21.278 INFO:teuthology.orchestra.run.smithi045.stdout: -5546> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000417) clear_dirty_parent 2023-10-03T19:21:21.278 INFO:teuthology.orchestra.run.smithi045.stdout: -5545> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000418) _stored_backtrace v 2230 2023-10-03T19:21:21.278 INFO:teuthology.orchestra.run.smithi045.stdout: -5544> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000418) auth_unpin by 0x55cc94444100 on [inode 0x10000000418 [2,head] /dc-dir/dc-file_547 auth v4740 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.063319+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94444100] now 0 2023-10-03T19:21:21.278 INFO:teuthology.orchestra.run.smithi045.stdout: -5543> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+444 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94444100 count now 1/444 2023-10-03T19:21:21.278 INFO:teuthology.orchestra.run.smithi045.stdout: -5542> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000418) clear_dirty_parent 2023-10-03T19:21:21.278 INFO:teuthology.orchestra.run.smithi045.stdout: -5541> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000419) _stored_backtrace v 2234 2023-10-03T19:21:21.278 INFO:teuthology.orchestra.run.smithi045.stdout: -5540> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000419) auth_unpin by 0x55cc94444680 on [inode 0x10000000419 [2,head] /dc-dir/dc-file_548 auth v5034 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.082921+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94444680] now 0 2023-10-03T19:21:21.278 INFO:teuthology.orchestra.run.smithi045.stdout: -5539> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+443 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94444680 count now 1/443 2023-10-03T19:21:21.278 INFO:teuthology.orchestra.run.smithi045.stdout: -5538> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000419) clear_dirty_parent 2023-10-03T19:21:21.278 INFO:teuthology.orchestra.run.smithi045.stdout: -5537> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000041a) _stored_backtrace v 2430 2023-10-03T19:21:21.278 INFO:teuthology.orchestra.run.smithi045.stdout: -5536> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000041a) auth_unpin by 0x55cc94444c00 on [inode 0x1000000041a [2,head] /dc-dir/dc-file_549 auth v5036 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.199659+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94444c00] now 0 2023-10-03T19:21:21.279 INFO:teuthology.orchestra.run.smithi045.stdout: -5535> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+442 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94444c00 count now 1/442 2023-10-03T19:21:21.279 INFO:teuthology.orchestra.run.smithi045.stdout: -5534> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000041a) clear_dirty_parent 2023-10-03T19:21:21.279 INFO:teuthology.orchestra.run.smithi045.stdout: -5533> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000041b) _stored_backtrace v 2434 2023-10-03T19:21:21.279 INFO:teuthology.orchestra.run.smithi045.stdout: -5532> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000041b) auth_unpin by 0x55cc94445180 on [inode 0x1000000041b [2,head] /dc-dir/dc-file_550 auth v5038 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.212148+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94445180] now 0 2023-10-03T19:21:21.279 INFO:teuthology.orchestra.run.smithi045.stdout: -5531> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+441 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94445180 count now 1/441 2023-10-03T19:21:21.279 INFO:teuthology.orchestra.run.smithi045.stdout: -5530> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000041b) clear_dirty_parent 2023-10-03T19:21:21.279 INFO:teuthology.orchestra.run.smithi045.stdout: -5529> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000041c) _stored_backtrace v 2438 2023-10-03T19:21:21.279 INFO:teuthology.orchestra.run.smithi045.stdout: -5528> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000041c) auth_unpin by 0x55cc94445700 on [inode 0x1000000041c [2,head] /dc-dir/dc-file_551 auth v5040 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.223592+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94445700] now 0 2023-10-03T19:21:21.279 INFO:teuthology.orchestra.run.smithi045.stdout: -5527> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+440 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94445700 count now 1/440 2023-10-03T19:21:21.279 INFO:teuthology.orchestra.run.smithi045.stdout: -5526> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000041c) clear_dirty_parent 2023-10-03T19:21:21.279 INFO:teuthology.orchestra.run.smithi045.stdout: -5525> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000041d) _stored_backtrace v 2442 2023-10-03T19:21:21.279 INFO:teuthology.orchestra.run.smithi045.stdout: -5524> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000041d) auth_unpin by 0x55cc94566000 on [inode 0x1000000041d [2,head] /dc-dir/dc-file_552 auth v5042 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.235543+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94566000] now 0 2023-10-03T19:21:21.280 INFO:teuthology.orchestra.run.smithi045.stdout: -5523> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+439 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94566000 count now 1/439 2023-10-03T19:21:21.280 INFO:teuthology.orchestra.run.smithi045.stdout: -5522> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000041d) clear_dirty_parent 2023-10-03T19:21:21.280 INFO:teuthology.orchestra.run.smithi045.stdout: -5521> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000041e) _stored_backtrace v 2446 2023-10-03T19:21:21.280 INFO:teuthology.orchestra.run.smithi045.stdout: -5520> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000041e) auth_unpin by 0x55cc94566580 on [inode 0x1000000041e [2,head] /dc-dir/dc-file_553 auth v5044 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.247730+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94566580] now 0 2023-10-03T19:21:21.280 INFO:teuthology.orchestra.run.smithi045.stdout: -5519> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+438 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94566580 count now 1/438 2023-10-03T19:21:21.280 INFO:teuthology.orchestra.run.smithi045.stdout: -5518> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000041e) clear_dirty_parent 2023-10-03T19:21:21.280 INFO:teuthology.orchestra.run.smithi045.stdout: -5517> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000041f) _stored_backtrace v 2450 2023-10-03T19:21:21.280 INFO:teuthology.orchestra.run.smithi045.stdout: -5516> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000041f) auth_unpin by 0x55cc94566b00 on [inode 0x1000000041f [2,head] /dc-dir/dc-file_554 auth v5046 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.260060+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94566b00] now 0 2023-10-03T19:21:21.280 INFO:teuthology.orchestra.run.smithi045.stdout: -5515> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+437 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94566b00 count now 1/437 2023-10-03T19:21:21.280 INFO:teuthology.orchestra.run.smithi045.stdout: -5514> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000041f) clear_dirty_parent 2023-10-03T19:21:21.280 INFO:teuthology.orchestra.run.smithi045.stdout: -5513> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000420) _stored_backtrace v 2454 2023-10-03T19:21:21.281 INFO:teuthology.orchestra.run.smithi045.stdout: -5512> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000420) auth_unpin by 0x55cc94567080 on [inode 0x10000000420 [2,head] /dc-dir/dc-file_555 auth v5048 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.272421+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94567080] now 0 2023-10-03T19:21:21.281 INFO:teuthology.orchestra.run.smithi045.stdout: -5511> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+436 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94567080 count now 1/436 2023-10-03T19:21:21.281 INFO:teuthology.orchestra.run.smithi045.stdout: -5510> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000420) clear_dirty_parent 2023-10-03T19:21:21.281 INFO:teuthology.orchestra.run.smithi045.stdout: -5509> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000421) _stored_backtrace v 2458 2023-10-03T19:21:21.281 INFO:teuthology.orchestra.run.smithi045.stdout: -5508> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000421) auth_unpin by 0x55cc94567600 on [inode 0x10000000421 [2,head] /dc-dir/dc-file_556 auth v5050 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.284423+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94567600] now 0 2023-10-03T19:21:21.281 INFO:teuthology.orchestra.run.smithi045.stdout: -5507> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+435 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94567600 count now 1/435 2023-10-03T19:21:21.281 INFO:teuthology.orchestra.run.smithi045.stdout: -5506> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000421) clear_dirty_parent 2023-10-03T19:21:21.281 INFO:teuthology.orchestra.run.smithi045.stdout: -5505> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000422) _stored_backtrace v 2462 2023-10-03T19:21:21.281 INFO:teuthology.orchestra.run.smithi045.stdout: -5504> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000422) auth_unpin by 0x55cc94567b80 on [inode 0x10000000422 [2,head] /dc-dir/dc-file_557 auth v5052 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.296033+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94567b80] now 0 2023-10-03T19:21:21.281 INFO:teuthology.orchestra.run.smithi045.stdout: -5503> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+434 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94567b80 count now 1/434 2023-10-03T19:21:21.281 INFO:teuthology.orchestra.run.smithi045.stdout: -5502> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000422) clear_dirty_parent 2023-10-03T19:21:21.281 INFO:teuthology.orchestra.run.smithi045.stdout: -5501> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000423) _stored_backtrace v 2466 2023-10-03T19:21:21.282 INFO:teuthology.orchestra.run.smithi045.stdout: -5500> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000423) auth_unpin by 0x55cc94568100 on [inode 0x10000000423 [2,head] /dc-dir/dc-file_558 auth v5054 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.308107+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94568100] now 0 2023-10-03T19:21:21.282 INFO:teuthology.orchestra.run.smithi045.stdout: -5499> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+433 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94568100 count now 1/433 2023-10-03T19:21:21.282 INFO:teuthology.orchestra.run.smithi045.stdout: -5498> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000423) clear_dirty_parent 2023-10-03T19:21:21.282 INFO:teuthology.orchestra.run.smithi045.stdout: -5497> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000424) _stored_backtrace v 2470 2023-10-03T19:21:21.282 INFO:teuthology.orchestra.run.smithi045.stdout: -5496> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000424) auth_unpin by 0x55cc94568680 on [inode 0x10000000424 [2,head] /dc-dir/dc-file_559 auth v5056 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.320539+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94568680] now 0 2023-10-03T19:21:21.282 INFO:teuthology.orchestra.run.smithi045.stdout: -5495> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+432 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94568680 count now 1/432 2023-10-03T19:21:21.282 INFO:teuthology.orchestra.run.smithi045.stdout: -5494> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000424) clear_dirty_parent 2023-10-03T19:21:21.282 INFO:teuthology.orchestra.run.smithi045.stdout: -5493> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000425) _stored_backtrace v 2474 2023-10-03T19:21:21.282 INFO:teuthology.orchestra.run.smithi045.stdout: -5492> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000425) auth_unpin by 0x55cc94568c00 on [inode 0x10000000425 [2,head] /dc-dir/dc-file_560 auth v5058 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.333109+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94568c00] now 0 2023-10-03T19:21:21.282 INFO:teuthology.orchestra.run.smithi045.stdout: -5491> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+431 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94568c00 count now 1/431 2023-10-03T19:21:21.282 INFO:teuthology.orchestra.run.smithi045.stdout: -5490> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000425) clear_dirty_parent 2023-10-03T19:21:21.283 INFO:teuthology.orchestra.run.smithi045.stdout: -5489> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000426) _stored_backtrace v 2478 2023-10-03T19:21:21.283 INFO:teuthology.orchestra.run.smithi045.stdout: -5488> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000426) auth_unpin by 0x55cc94569180 on [inode 0x10000000426 [2,head] /dc-dir/dc-file_561 auth v5060 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.345554+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94569180] now 0 2023-10-03T19:21:21.283 INFO:teuthology.orchestra.run.smithi045.stdout: -5487> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+430 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94569180 count now 1/430 2023-10-03T19:21:21.283 INFO:teuthology.orchestra.run.smithi045.stdout: -5486> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000426) clear_dirty_parent 2023-10-03T19:21:21.283 INFO:teuthology.orchestra.run.smithi045.stdout: -5485> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000427) _stored_backtrace v 2482 2023-10-03T19:21:21.283 INFO:teuthology.orchestra.run.smithi045.stdout: -5484> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000427) auth_unpin by 0x55cc94569700 on [inode 0x10000000427 [2,head] /dc-dir/dc-file_562 auth v5062 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.358383+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94569700] now 0 2023-10-03T19:21:21.283 INFO:teuthology.orchestra.run.smithi045.stdout: -5483> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+429 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94569700 count now 1/429 2023-10-03T19:21:21.283 INFO:teuthology.orchestra.run.smithi045.stdout: -5482> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000427) clear_dirty_parent 2023-10-03T19:21:21.283 INFO:teuthology.orchestra.run.smithi045.stdout: -5481> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000428) _stored_backtrace v 2486 2023-10-03T19:21:21.283 INFO:teuthology.orchestra.run.smithi045.stdout: -5480> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000428) auth_unpin by 0x55cc94570000 on [inode 0x10000000428 [2,head] /dc-dir/dc-file_563 auth v5064 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.370578+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94570000] now 0 2023-10-03T19:21:21.283 INFO:teuthology.orchestra.run.smithi045.stdout: -5479> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+428 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94570000 count now 1/428 2023-10-03T19:21:21.284 INFO:teuthology.orchestra.run.smithi045.stdout: -5478> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000428) clear_dirty_parent 2023-10-03T19:21:21.284 INFO:teuthology.orchestra.run.smithi045.stdout: -5477> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000429) _stored_backtrace v 2490 2023-10-03T19:21:21.284 INFO:teuthology.orchestra.run.smithi045.stdout: -5476> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000429) auth_unpin by 0x55cc94570580 on [inode 0x10000000429 [2,head] /dc-dir/dc-file_564 auth v5066 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.383261+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94570580] now 0 2023-10-03T19:21:21.284 INFO:teuthology.orchestra.run.smithi045.stdout: -5475> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+427 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94570580 count now 1/427 2023-10-03T19:21:21.284 INFO:teuthology.orchestra.run.smithi045.stdout: -5474> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000429) clear_dirty_parent 2023-10-03T19:21:21.284 INFO:teuthology.orchestra.run.smithi045.stdout: -5473> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000042a) _stored_backtrace v 2494 2023-10-03T19:21:21.284 INFO:teuthology.orchestra.run.smithi045.stdout: -5472> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000042a) auth_unpin by 0x55cc94570b00 on [inode 0x1000000042a [2,head] /dc-dir/dc-file_565 auth v5068 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.395263+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94570b00] now 0 2023-10-03T19:21:21.284 INFO:teuthology.orchestra.run.smithi045.stdout: -5471> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+426 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94570b00 count now 1/426 2023-10-03T19:21:21.284 INFO:teuthology.orchestra.run.smithi045.stdout: -5470> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000042a) clear_dirty_parent 2023-10-03T19:21:21.284 INFO:teuthology.orchestra.run.smithi045.stdout: -5469> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000042b) _stored_backtrace v 2498 2023-10-03T19:21:21.284 INFO:teuthology.orchestra.run.smithi045.stdout: -5468> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000042b) auth_unpin by 0x55cc94571080 on [inode 0x1000000042b [2,head] /dc-dir/dc-file_566 auth v5070 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.407085+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94571080] now 0 2023-10-03T19:21:21.284 INFO:teuthology.orchestra.run.smithi045.stdout: -5467> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+425 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94571080 count now 1/425 2023-10-03T19:21:21.285 INFO:teuthology.orchestra.run.smithi045.stdout: -5466> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000042b) clear_dirty_parent 2023-10-03T19:21:21.285 INFO:teuthology.orchestra.run.smithi045.stdout: -5465> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000042c) _stored_backtrace v 2502 2023-10-03T19:21:21.285 INFO:teuthology.orchestra.run.smithi045.stdout: -5464> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000042c) auth_unpin by 0x55cc94571600 on [inode 0x1000000042c [2,head] /dc-dir/dc-file_567 auth v5072 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.418880+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94571600] now 0 2023-10-03T19:21:21.285 INFO:teuthology.orchestra.run.smithi045.stdout: -5463> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+424 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94571600 count now 1/424 2023-10-03T19:21:21.285 INFO:teuthology.orchestra.run.smithi045.stdout: -5462> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000042c) clear_dirty_parent 2023-10-03T19:21:21.285 INFO:teuthology.orchestra.run.smithi045.stdout: -5461> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000042d) _stored_backtrace v 2506 2023-10-03T19:21:21.285 INFO:teuthology.orchestra.run.smithi045.stdout: -5460> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000042d) auth_unpin by 0x55cc94571b80 on [inode 0x1000000042d [2,head] /dc-dir/dc-file_568 auth v5074 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.430973+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94571b80] now 0 2023-10-03T19:21:21.285 INFO:teuthology.orchestra.run.smithi045.stdout: -5459> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+423 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94571b80 count now 1/423 2023-10-03T19:21:21.285 INFO:teuthology.orchestra.run.smithi045.stdout: -5458> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000042d) clear_dirty_parent 2023-10-03T19:21:21.285 INFO:teuthology.orchestra.run.smithi045.stdout: -5457> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000042e) _stored_backtrace v 2510 2023-10-03T19:21:21.285 INFO:teuthology.orchestra.run.smithi045.stdout: -5456> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000042e) auth_unpin by 0x55cc94572100 on [inode 0x1000000042e [2,head] /dc-dir/dc-file_569 auth v5076 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.443410+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94572100] now 0 2023-10-03T19:21:21.286 INFO:teuthology.orchestra.run.smithi045.stdout: -5455> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+422 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94572100 count now 1/422 2023-10-03T19:21:21.286 INFO:teuthology.orchestra.run.smithi045.stdout: -5454> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000042e) clear_dirty_parent 2023-10-03T19:21:21.286 INFO:teuthology.orchestra.run.smithi045.stdout: -5453> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000042f) _stored_backtrace v 2514 2023-10-03T19:21:21.286 INFO:teuthology.orchestra.run.smithi045.stdout: -5452> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000042f) auth_unpin by 0x55cc94572680 on [inode 0x1000000042f [2,head] /dc-dir/dc-file_570 auth v5078 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.455272+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94572680] now 0 2023-10-03T19:21:21.286 INFO:teuthology.orchestra.run.smithi045.stdout: -5451> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+421 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94572680 count now 1/421 2023-10-03T19:21:21.286 INFO:teuthology.orchestra.run.smithi045.stdout: -5450> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000042f) clear_dirty_parent 2023-10-03T19:21:21.286 INFO:teuthology.orchestra.run.smithi045.stdout: -5449> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000430) _stored_backtrace v 2518 2023-10-03T19:21:21.286 INFO:teuthology.orchestra.run.smithi045.stdout: -5448> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000430) auth_unpin by 0x55cc94572c00 on [inode 0x10000000430 [2,head] /dc-dir/dc-file_571 auth v5080 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.467900+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94572c00] now 0 2023-10-03T19:21:21.286 INFO:teuthology.orchestra.run.smithi045.stdout: -5447> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+420 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94572c00 count now 1/420 2023-10-03T19:21:21.286 INFO:teuthology.orchestra.run.smithi045.stdout: -5446> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000430) clear_dirty_parent 2023-10-03T19:21:21.287 INFO:teuthology.orchestra.run.smithi045.stdout: -5445> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000431) _stored_backtrace v 2522 2023-10-03T19:21:21.287 INFO:teuthology.orchestra.run.smithi045.stdout: -5444> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000431) auth_unpin by 0x55cc94573180 on [inode 0x10000000431 [2,head] /dc-dir/dc-file_572 auth v5082 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.480014+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94573180] now 0 2023-10-03T19:21:21.287 INFO:teuthology.orchestra.run.smithi045.stdout: -5443> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+419 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94573180 count now 1/419 2023-10-03T19:21:21.287 INFO:teuthology.orchestra.run.smithi045.stdout: -5442> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000431) clear_dirty_parent 2023-10-03T19:21:21.287 INFO:teuthology.orchestra.run.smithi045.stdout: -5441> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000432) _stored_backtrace v 2526 2023-10-03T19:21:21.287 INFO:teuthology.orchestra.run.smithi045.stdout: -5440> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000432) auth_unpin by 0x55cc94573700 on [inode 0x10000000432 [2,head] /dc-dir/dc-file_573 auth v5084 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.491933+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94573700] now 0 2023-10-03T19:21:21.287 INFO:teuthology.orchestra.run.smithi045.stdout: -5439> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+418 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94573700 count now 1/418 2023-10-03T19:21:21.287 INFO:teuthology.orchestra.run.smithi045.stdout: -5438> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000432) clear_dirty_parent 2023-10-03T19:21:21.287 INFO:teuthology.orchestra.run.smithi045.stdout: -5437> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000433) _stored_backtrace v 2530 2023-10-03T19:21:21.287 INFO:teuthology.orchestra.run.smithi045.stdout: -5436> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000433) auth_unpin by 0x55cc94598000 on [inode 0x10000000433 [2,head] /dc-dir/dc-file_574 auth v5086 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.504108+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94598000] now 0 2023-10-03T19:21:21.287 INFO:teuthology.orchestra.run.smithi045.stdout: -5435> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+417 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94598000 count now 1/417 2023-10-03T19:21:21.287 INFO:teuthology.orchestra.run.smithi045.stdout: -5434> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000433) clear_dirty_parent 2023-10-03T19:21:21.288 INFO:teuthology.orchestra.run.smithi045.stdout: -5433> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000434) _stored_backtrace v 2534 2023-10-03T19:21:21.288 INFO:teuthology.orchestra.run.smithi045.stdout: -5432> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000434) auth_unpin by 0x55cc94598580 on [inode 0x10000000434 [2,head] /dc-dir/dc-file_575 auth v5088 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.515753+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94598580] now 0 2023-10-03T19:21:21.288 INFO:teuthology.orchestra.run.smithi045.stdout: -5431> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+416 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94598580 count now 1/416 2023-10-03T19:21:21.288 INFO:teuthology.orchestra.run.smithi045.stdout: -5430> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000434) clear_dirty_parent 2023-10-03T19:21:21.288 INFO:teuthology.orchestra.run.smithi045.stdout: -5429> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000435) _stored_backtrace v 2538 2023-10-03T19:21:21.288 INFO:teuthology.orchestra.run.smithi045.stdout: -5428> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000435) auth_unpin by 0x55cc94598b00 on [inode 0x10000000435 [2,head] /dc-dir/dc-file_576 auth v5090 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.527513+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94598b00] now 0 2023-10-03T19:21:21.288 INFO:teuthology.orchestra.run.smithi045.stdout: -5427> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+415 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94598b00 count now 1/415 2023-10-03T19:21:21.288 INFO:teuthology.orchestra.run.smithi045.stdout: -5426> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000435) clear_dirty_parent 2023-10-03T19:21:21.288 INFO:teuthology.orchestra.run.smithi045.stdout: -5425> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000436) _stored_backtrace v 2542 2023-10-03T19:21:21.288 INFO:teuthology.orchestra.run.smithi045.stdout: -5424> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000436) auth_unpin by 0x55cc94599080 on [inode 0x10000000436 [2,head] /dc-dir/dc-file_577 auth v5092 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.539961+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94599080] now 0 2023-10-03T19:21:21.288 INFO:teuthology.orchestra.run.smithi045.stdout: -5423> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+414 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94599080 count now 1/414 2023-10-03T19:21:21.288 INFO:teuthology.orchestra.run.smithi045.stdout: -5422> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000436) clear_dirty_parent 2023-10-03T19:21:21.288 INFO:teuthology.orchestra.run.smithi045.stdout: -5421> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000437) _stored_backtrace v 2546 2023-10-03T19:21:21.289 INFO:teuthology.orchestra.run.smithi045.stdout: -5420> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000437) auth_unpin by 0x55cc94599600 on [inode 0x10000000437 [2,head] /dc-dir/dc-file_578 auth v5094 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.551697+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94599600] now 0 2023-10-03T19:21:21.289 INFO:teuthology.orchestra.run.smithi045.stdout: -5419> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+413 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94599600 count now 1/413 2023-10-03T19:21:21.289 INFO:teuthology.orchestra.run.smithi045.stdout: -5418> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000437) clear_dirty_parent 2023-10-03T19:21:21.289 INFO:teuthology.orchestra.run.smithi045.stdout: -5417> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000438) _stored_backtrace v 2550 2023-10-03T19:21:21.289 INFO:teuthology.orchestra.run.smithi045.stdout: -5416> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000438) auth_unpin by 0x55cc94599b80 on [inode 0x10000000438 [2,head] /dc-dir/dc-file_579 auth v5096 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.563962+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94599b80] now 0 2023-10-03T19:21:21.289 INFO:teuthology.orchestra.run.smithi045.stdout: -5415> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+412 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94599b80 count now 1/412 2023-10-03T19:21:21.289 INFO:teuthology.orchestra.run.smithi045.stdout: -5414> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000438) clear_dirty_parent 2023-10-03T19:21:21.289 INFO:teuthology.orchestra.run.smithi045.stdout: -5413> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000439) _stored_backtrace v 2554 2023-10-03T19:21:21.289 INFO:teuthology.orchestra.run.smithi045.stdout: -5412> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000439) auth_unpin by 0x55cc9459a100 on [inode 0x10000000439 [2,head] /dc-dir/dc-file_580 auth v5098 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.576055+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9459a100] now 0 2023-10-03T19:21:21.289 INFO:teuthology.orchestra.run.smithi045.stdout: -5411> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+411 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9459a100 count now 1/411 2023-10-03T19:21:21.289 INFO:teuthology.orchestra.run.smithi045.stdout: -5410> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000439) clear_dirty_parent 2023-10-03T19:21:21.290 INFO:teuthology.orchestra.run.smithi045.stdout: -5409> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000043a) _stored_backtrace v 2558 2023-10-03T19:21:21.290 INFO:teuthology.orchestra.run.smithi045.stdout: -5408> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000043a) auth_unpin by 0x55cc9459a680 on [inode 0x1000000043a [2,head] /dc-dir/dc-file_581 auth v5100 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.588141+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9459a680] now 0 2023-10-03T19:21:21.290 INFO:teuthology.orchestra.run.smithi045.stdout: -5407> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+410 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9459a680 count now 1/410 2023-10-03T19:21:21.290 INFO:teuthology.orchestra.run.smithi045.stdout: -5406> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000043a) clear_dirty_parent 2023-10-03T19:21:21.290 INFO:teuthology.orchestra.run.smithi045.stdout: -5405> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000043b) _stored_backtrace v 2562 2023-10-03T19:21:21.290 INFO:teuthology.orchestra.run.smithi045.stdout: -5404> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000043b) auth_unpin by 0x55cc9459ac00 on [inode 0x1000000043b [2,head] /dc-dir/dc-file_582 auth v5102 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.600484+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9459ac00] now 0 2023-10-03T19:21:21.290 INFO:teuthology.orchestra.run.smithi045.stdout: -5403> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+409 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9459ac00 count now 1/409 2023-10-03T19:21:21.290 INFO:teuthology.orchestra.run.smithi045.stdout: -5402> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000043b) clear_dirty_parent 2023-10-03T19:21:21.290 INFO:teuthology.orchestra.run.smithi045.stdout: -5401> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000043c) _stored_backtrace v 2566 2023-10-03T19:21:21.290 INFO:teuthology.orchestra.run.smithi045.stdout: -5400> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000043c) auth_unpin by 0x55cc9459b180 on [inode 0x1000000043c [2,head] /dc-dir/dc-file_583 auth v5104 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.612426+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9459b180] now 0 2023-10-03T19:21:21.290 INFO:teuthology.orchestra.run.smithi045.stdout: -5399> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+408 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9459b180 count now 1/408 2023-10-03T19:21:21.291 INFO:teuthology.orchestra.run.smithi045.stdout: -5398> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000043c) clear_dirty_parent 2023-10-03T19:21:21.291 INFO:teuthology.orchestra.run.smithi045.stdout: -5397> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000043d) _stored_backtrace v 2570 2023-10-03T19:21:21.291 INFO:teuthology.orchestra.run.smithi045.stdout: -5396> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000043d) auth_unpin by 0x55cc9459b700 on [inode 0x1000000043d [2,head] /dc-dir/dc-file_584 auth v5106 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.624057+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9459b700] now 0 2023-10-03T19:21:21.291 INFO:teuthology.orchestra.run.smithi045.stdout: -5395> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+407 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9459b700 count now 1/407 2023-10-03T19:21:21.291 INFO:teuthology.orchestra.run.smithi045.stdout: -5394> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000043d) clear_dirty_parent 2023-10-03T19:21:21.291 INFO:teuthology.orchestra.run.smithi045.stdout: -5393> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000043e) _stored_backtrace v 2574 2023-10-03T19:21:21.291 INFO:teuthology.orchestra.run.smithi045.stdout: -5392> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000043e) auth_unpin by 0x55cc945a0000 on [inode 0x1000000043e [2,head] /dc-dir/dc-file_585 auth v5108 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.636002+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945a0000] now 0 2023-10-03T19:21:21.291 INFO:teuthology.orchestra.run.smithi045.stdout: -5391> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+406 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945a0000 count now 1/406 2023-10-03T19:21:21.291 INFO:teuthology.orchestra.run.smithi045.stdout: -5390> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000043e) clear_dirty_parent 2023-10-03T19:21:21.291 INFO:teuthology.orchestra.run.smithi045.stdout: -5389> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000043f) _stored_backtrace v 2578 2023-10-03T19:21:21.292 INFO:teuthology.orchestra.run.smithi045.stdout: -5388> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000043f) auth_unpin by 0x55cc945a0580 on [inode 0x1000000043f [2,head] /dc-dir/dc-file_586 auth v5110 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.647426+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945a0580] now 0 2023-10-03T19:21:21.292 INFO:teuthology.orchestra.run.smithi045.stdout: -5387> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+405 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945a0580 count now 1/405 2023-10-03T19:21:21.292 INFO:teuthology.orchestra.run.smithi045.stdout: -5386> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000043f) clear_dirty_parent 2023-10-03T19:21:21.292 INFO:teuthology.orchestra.run.smithi045.stdout: -5385> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000440) _stored_backtrace v 2582 2023-10-03T19:21:21.292 INFO:teuthology.orchestra.run.smithi045.stdout: -5384> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000440) auth_unpin by 0x55cc945a0b00 on [inode 0x10000000440 [2,head] /dc-dir/dc-file_587 auth v5112 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.660109+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945a0b00] now 0 2023-10-03T19:21:21.292 INFO:teuthology.orchestra.run.smithi045.stdout: -5383> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+404 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945a0b00 count now 1/404 2023-10-03T19:21:21.292 INFO:teuthology.orchestra.run.smithi045.stdout: -5382> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000440) clear_dirty_parent 2023-10-03T19:21:21.292 INFO:teuthology.orchestra.run.smithi045.stdout: -5381> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000441) _stored_backtrace v 2586 2023-10-03T19:21:21.292 INFO:teuthology.orchestra.run.smithi045.stdout: -5380> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000441) auth_unpin by 0x55cc945a1080 on [inode 0x10000000441 [2,head] /dc-dir/dc-file_588 auth v5114 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.673355+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945a1080] now 0 2023-10-03T19:21:21.292 INFO:teuthology.orchestra.run.smithi045.stdout: -5379> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+403 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945a1080 count now 1/403 2023-10-03T19:21:21.292 INFO:teuthology.orchestra.run.smithi045.stdout: -5378> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000441) clear_dirty_parent 2023-10-03T19:21:21.293 INFO:teuthology.orchestra.run.smithi045.stdout: -5377> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000442) _stored_backtrace v 2590 2023-10-03T19:21:21.293 INFO:teuthology.orchestra.run.smithi045.stdout: -5376> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000442) auth_unpin by 0x55cc945a1600 on [inode 0x10000000442 [2,head] /dc-dir/dc-file_589 auth v5116 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.685917+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945a1600] now 0 2023-10-03T19:21:21.293 INFO:teuthology.orchestra.run.smithi045.stdout: -5375> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+402 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945a1600 count now 1/402 2023-10-03T19:21:21.293 INFO:teuthology.orchestra.run.smithi045.stdout: -5374> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000442) clear_dirty_parent 2023-10-03T19:21:21.293 INFO:teuthology.orchestra.run.smithi045.stdout: -5373> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000443) _stored_backtrace v 2594 2023-10-03T19:21:21.293 INFO:teuthology.orchestra.run.smithi045.stdout: -5372> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000443) auth_unpin by 0x55cc945a1b80 on [inode 0x10000000443 [2,head] /dc-dir/dc-file_590 auth v5118 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.699540+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945a1b80] now 0 2023-10-03T19:21:21.293 INFO:teuthology.orchestra.run.smithi045.stdout: -5371> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+401 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945a1b80 count now 1/401 2023-10-03T19:21:21.293 INFO:teuthology.orchestra.run.smithi045.stdout: -5370> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000443) clear_dirty_parent 2023-10-03T19:21:21.293 INFO:teuthology.orchestra.run.smithi045.stdout: -5369> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000444) _stored_backtrace v 2598 2023-10-03T19:21:21.293 INFO:teuthology.orchestra.run.smithi045.stdout: -5368> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000444) auth_unpin by 0x55cc945a2100 on [inode 0x10000000444 [2,head] /dc-dir/dc-file_591 auth v5120 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.710950+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945a2100] now 0 2023-10-03T19:21:21.293 INFO:teuthology.orchestra.run.smithi045.stdout: -5367> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+400 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945a2100 count now 1/400 2023-10-03T19:21:21.293 INFO:teuthology.orchestra.run.smithi045.stdout: -5366> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000444) clear_dirty_parent 2023-10-03T19:21:21.294 INFO:teuthology.orchestra.run.smithi045.stdout: -5365> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000445) _stored_backtrace v 2602 2023-10-03T19:21:21.294 INFO:teuthology.orchestra.run.smithi045.stdout: -5364> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000445) auth_unpin by 0x55cc945a2680 on [inode 0x10000000445 [2,head] /dc-dir/dc-file_592 auth v5122 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.723542+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945a2680] now 0 2023-10-03T19:21:21.294 INFO:teuthology.orchestra.run.smithi045.stdout: -5363> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+399 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945a2680 count now 1/399 2023-10-03T19:21:21.294 INFO:teuthology.orchestra.run.smithi045.stdout: -5362> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000445) clear_dirty_parent 2023-10-03T19:21:21.294 INFO:teuthology.orchestra.run.smithi045.stdout: -5361> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000446) _stored_backtrace v 2606 2023-10-03T19:21:21.294 INFO:teuthology.orchestra.run.smithi045.stdout: -5360> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000446) auth_unpin by 0x55cc945a2c00 on [inode 0x10000000446 [2,head] /dc-dir/dc-file_593 auth v5124 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.735550+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945a2c00] now 0 2023-10-03T19:21:21.294 INFO:teuthology.orchestra.run.smithi045.stdout: -5359> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+398 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945a2c00 count now 1/398 2023-10-03T19:21:21.294 INFO:teuthology.orchestra.run.smithi045.stdout: -5358> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000446) clear_dirty_parent 2023-10-03T19:21:21.294 INFO:teuthology.orchestra.run.smithi045.stdout: -5357> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000447) _stored_backtrace v 2610 2023-10-03T19:21:21.294 INFO:teuthology.orchestra.run.smithi045.stdout: -5356> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000447) auth_unpin by 0x55cc945a3180 on [inode 0x10000000447 [2,head] /dc-dir/dc-file_594 auth v5126 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.746996+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945a3180] now 0 2023-10-03T19:21:21.295 INFO:teuthology.orchestra.run.smithi045.stdout: -5355> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+397 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945a3180 count now 1/397 2023-10-03T19:21:21.295 INFO:teuthology.orchestra.run.smithi045.stdout: -5354> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000447) clear_dirty_parent 2023-10-03T19:21:21.295 INFO:teuthology.orchestra.run.smithi045.stdout: -5353> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000448) _stored_backtrace v 2614 2023-10-03T19:21:21.295 INFO:teuthology.orchestra.run.smithi045.stdout: -5352> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000448) auth_unpin by 0x55cc945a3700 on [inode 0x10000000448 [2,head] /dc-dir/dc-file_595 auth v5128 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.758690+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945a3700] now 0 2023-10-03T19:21:21.295 INFO:teuthology.orchestra.run.smithi045.stdout: -5351> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+396 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945a3700 count now 1/396 2023-10-03T19:21:21.295 INFO:teuthology.orchestra.run.smithi045.stdout: -5350> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000448) clear_dirty_parent 2023-10-03T19:21:21.295 INFO:teuthology.orchestra.run.smithi045.stdout: -5349> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000449) _stored_backtrace v 2618 2023-10-03T19:21:21.295 INFO:teuthology.orchestra.run.smithi045.stdout: -5348> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000449) auth_unpin by 0x55cc945aa000 on [inode 0x10000000449 [2,head] /dc-dir/dc-file_596 auth v5130 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.770413+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945aa000] now 0 2023-10-03T19:21:21.295 INFO:teuthology.orchestra.run.smithi045.stdout: -5347> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+395 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945aa000 count now 1/395 2023-10-03T19:21:21.295 INFO:teuthology.orchestra.run.smithi045.stdout: -5346> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000449) clear_dirty_parent 2023-10-03T19:21:21.295 INFO:teuthology.orchestra.run.smithi045.stdout: -5345> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000044a) _stored_backtrace v 2622 2023-10-03T19:21:21.296 INFO:teuthology.orchestra.run.smithi045.stdout: -5344> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000044a) auth_unpin by 0x55cc945aa580 on [inode 0x1000000044a [2,head] /dc-dir/dc-file_597 auth v5132 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.782255+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945aa580] now 0 2023-10-03T19:21:21.296 INFO:teuthology.orchestra.run.smithi045.stdout: -5343> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+394 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945aa580 count now 1/394 2023-10-03T19:21:21.296 INFO:teuthology.orchestra.run.smithi045.stdout: -5342> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000044a) clear_dirty_parent 2023-10-03T19:21:21.296 INFO:teuthology.orchestra.run.smithi045.stdout: -5341> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000044b) _stored_backtrace v 2626 2023-10-03T19:21:21.296 INFO:teuthology.orchestra.run.smithi045.stdout: -5340> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000044b) auth_unpin by 0x55cc945aab00 on [inode 0x1000000044b [2,head] /dc-dir/dc-file_598 auth v5134 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.796025+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945aab00] now 0 2023-10-03T19:21:21.296 INFO:teuthology.orchestra.run.smithi045.stdout: -5339> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+393 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945aab00 count now 1/393 2023-10-03T19:21:21.296 INFO:teuthology.orchestra.run.smithi045.stdout: -5338> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000044b) clear_dirty_parent 2023-10-03T19:21:21.296 INFO:teuthology.orchestra.run.smithi045.stdout: -5337> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000044c) _stored_backtrace v 2630 2023-10-03T19:21:21.296 INFO:teuthology.orchestra.run.smithi045.stdout: -5336> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000044c) auth_unpin by 0x55cc945ab080 on [inode 0x1000000044c [2,head] /dc-dir/dc-file_599 auth v5136 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.809169+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945ab080] now 0 2023-10-03T19:21:21.296 INFO:teuthology.orchestra.run.smithi045.stdout: -5335> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+392 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945ab080 count now 1/392 2023-10-03T19:21:21.297 INFO:teuthology.orchestra.run.smithi045.stdout: -5334> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000044c) clear_dirty_parent 2023-10-03T19:21:21.297 INFO:teuthology.orchestra.run.smithi045.stdout: -5333> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000044d) _stored_backtrace v 2634 2023-10-03T19:21:21.297 INFO:teuthology.orchestra.run.smithi045.stdout: -5332> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000044d) auth_unpin by 0x55cc945ab600 on [inode 0x1000000044d [2,head] /dc-dir/dc-file_600 auth v5138 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.820937+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945ab600] now 0 2023-10-03T19:21:21.297 INFO:teuthology.orchestra.run.smithi045.stdout: -5331> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+391 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945ab600 count now 1/391 2023-10-03T19:21:21.297 INFO:teuthology.orchestra.run.smithi045.stdout: -5330> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000044d) clear_dirty_parent 2023-10-03T19:21:21.297 INFO:teuthology.orchestra.run.smithi045.stdout: -5329> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000044e) _stored_backtrace v 2638 2023-10-03T19:21:21.297 INFO:teuthology.orchestra.run.smithi045.stdout: -5328> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000044e) auth_unpin by 0x55cc945abb80 on [inode 0x1000000044e [2,head] /dc-dir/dc-file_601 auth v5140 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.832418+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945abb80] now 0 2023-10-03T19:21:21.297 INFO:teuthology.orchestra.run.smithi045.stdout: -5327> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+390 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945abb80 count now 1/390 2023-10-03T19:21:21.297 INFO:teuthology.orchestra.run.smithi045.stdout: -5326> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000044e) clear_dirty_parent 2023-10-03T19:21:21.297 INFO:teuthology.orchestra.run.smithi045.stdout: -5325> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000044f) _stored_backtrace v 2642 2023-10-03T19:21:21.298 INFO:teuthology.orchestra.run.smithi045.stdout: -5324> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000044f) auth_unpin by 0x55cc945ac100 on [inode 0x1000000044f [2,head] /dc-dir/dc-file_602 auth v5142 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.843762+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945ac100] now 0 2023-10-03T19:21:21.298 INFO:teuthology.orchestra.run.smithi045.stdout: -5323> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+389 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945ac100 count now 1/389 2023-10-03T19:21:21.298 INFO:teuthology.orchestra.run.smithi045.stdout: -5322> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000044f) clear_dirty_parent 2023-10-03T19:21:21.298 INFO:teuthology.orchestra.run.smithi045.stdout: -5321> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000450) _stored_backtrace v 2646 2023-10-03T19:21:21.298 INFO:teuthology.orchestra.run.smithi045.stdout: -5320> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000450) auth_unpin by 0x55cc945ac680 on [inode 0x10000000450 [2,head] /dc-dir/dc-file_603 auth v5144 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.856130+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945ac680] now 0 2023-10-03T19:21:21.298 INFO:teuthology.orchestra.run.smithi045.stdout: -5319> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+388 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945ac680 count now 1/388 2023-10-03T19:21:21.298 INFO:teuthology.orchestra.run.smithi045.stdout: -5318> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000450) clear_dirty_parent 2023-10-03T19:21:21.298 INFO:teuthology.orchestra.run.smithi045.stdout: -5317> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000451) _stored_backtrace v 2650 2023-10-03T19:21:21.298 INFO:teuthology.orchestra.run.smithi045.stdout: -5316> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000451) auth_unpin by 0x55cc945acc00 on [inode 0x10000000451 [2,head] /dc-dir/dc-file_604 auth v5146 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.868781+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945acc00] now 0 2023-10-03T19:21:21.298 INFO:teuthology.orchestra.run.smithi045.stdout: -5315> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+387 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945acc00 count now 1/387 2023-10-03T19:21:21.299 INFO:teuthology.orchestra.run.smithi045.stdout: -5314> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000451) clear_dirty_parent 2023-10-03T19:21:21.299 INFO:teuthology.orchestra.run.smithi045.stdout: -5313> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000452) _stored_backtrace v 2654 2023-10-03T19:21:21.299 INFO:teuthology.orchestra.run.smithi045.stdout: -5312> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000452) auth_unpin by 0x55cc945ad180 on [inode 0x10000000452 [2,head] /dc-dir/dc-file_605 auth v5148 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.880171+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945ad180] now 0 2023-10-03T19:21:21.299 INFO:teuthology.orchestra.run.smithi045.stdout: -5311> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+386 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945ad180 count now 1/386 2023-10-03T19:21:21.299 INFO:teuthology.orchestra.run.smithi045.stdout: -5310> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000452) clear_dirty_parent 2023-10-03T19:21:21.299 INFO:teuthology.orchestra.run.smithi045.stdout: -5309> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000453) _stored_backtrace v 2658 2023-10-03T19:21:21.299 INFO:teuthology.orchestra.run.smithi045.stdout: -5308> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000453) auth_unpin by 0x55cc945ad700 on [inode 0x10000000453 [2,head] /dc-dir/dc-file_606 auth v5150 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.892822+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945ad700] now 0 2023-10-03T19:21:21.299 INFO:teuthology.orchestra.run.smithi045.stdout: -5307> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+385 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945ad700 count now 1/385 2023-10-03T19:21:21.299 INFO:teuthology.orchestra.run.smithi045.stdout: -5306> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000453) clear_dirty_parent 2023-10-03T19:21:21.299 INFO:teuthology.orchestra.run.smithi045.stdout: -5305> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000454) _stored_backtrace v 2662 2023-10-03T19:21:21.299 INFO:teuthology.orchestra.run.smithi045.stdout: -5304> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000454) auth_unpin by 0x55cc945b6000 on [inode 0x10000000454 [2,head] /dc-dir/dc-file_607 auth v5152 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.905669+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945b6000] now 0 2023-10-03T19:21:21.300 INFO:teuthology.orchestra.run.smithi045.stdout: -5303> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+384 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945b6000 count now 1/384 2023-10-03T19:21:21.300 INFO:teuthology.orchestra.run.smithi045.stdout: -5302> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000454) clear_dirty_parent 2023-10-03T19:21:21.300 INFO:teuthology.orchestra.run.smithi045.stdout: -5301> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000455) _stored_backtrace v 2666 2023-10-03T19:21:21.300 INFO:teuthology.orchestra.run.smithi045.stdout: -5300> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000455) auth_unpin by 0x55cc945b6580 on [inode 0x10000000455 [2,head] /dc-dir/dc-file_608 auth v5154 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.918244+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945b6580] now 0 2023-10-03T19:21:21.300 INFO:teuthology.orchestra.run.smithi045.stdout: -5299> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+383 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945b6580 count now 1/383 2023-10-03T19:21:21.300 INFO:teuthology.orchestra.run.smithi045.stdout: -5298> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000455) clear_dirty_parent 2023-10-03T19:21:21.300 INFO:teuthology.orchestra.run.smithi045.stdout: -5297> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000456) _stored_backtrace v 2670 2023-10-03T19:21:21.300 INFO:teuthology.orchestra.run.smithi045.stdout: -5296> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000456) auth_unpin by 0x55cc945b6b00 on [inode 0x10000000456 [2,head] /dc-dir/dc-file_609 auth v5156 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.930989+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945b6b00] now 0 2023-10-03T19:21:21.300 INFO:teuthology.orchestra.run.smithi045.stdout: -5295> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+382 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945b6b00 count now 1/382 2023-10-03T19:21:21.300 INFO:teuthology.orchestra.run.smithi045.stdout: -5294> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000456) clear_dirty_parent 2023-10-03T19:21:21.300 INFO:teuthology.orchestra.run.smithi045.stdout: -5293> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000457) _stored_backtrace v 2674 2023-10-03T19:21:21.300 INFO:teuthology.orchestra.run.smithi045.stdout: -5292> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000457) auth_unpin by 0x55cc945b7080 on [inode 0x10000000457 [2,head] /dc-dir/dc-file_610 auth v5158 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.943865+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945b7080] now 0 2023-10-03T19:21:21.301 INFO:teuthology.orchestra.run.smithi045.stdout: -5291> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+381 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945b7080 count now 1/381 2023-10-03T19:21:21.301 INFO:teuthology.orchestra.run.smithi045.stdout: -5290> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000457) clear_dirty_parent 2023-10-03T19:21:21.301 INFO:teuthology.orchestra.run.smithi045.stdout: -5289> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000458) _stored_backtrace v 2678 2023-10-03T19:21:21.301 INFO:teuthology.orchestra.run.smithi045.stdout: -5288> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000458) auth_unpin by 0x55cc945b7600 on [inode 0x10000000458 [2,head] /dc-dir/dc-file_611 auth v5160 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.955712+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945b7600] now 0 2023-10-03T19:21:21.301 INFO:teuthology.orchestra.run.smithi045.stdout: -5287> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+380 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945b7600 count now 1/380 2023-10-03T19:21:21.301 INFO:teuthology.orchestra.run.smithi045.stdout: -5286> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000458) clear_dirty_parent 2023-10-03T19:21:21.301 INFO:teuthology.orchestra.run.smithi045.stdout: -5285> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000459) _stored_backtrace v 2682 2023-10-03T19:21:21.301 INFO:teuthology.orchestra.run.smithi045.stdout: -5284> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000459) auth_unpin by 0x55cc945b7b80 on [inode 0x10000000459 [2,head] /dc-dir/dc-file_612 auth v5162 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.968079+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945b7b80] now 0 2023-10-03T19:21:21.301 INFO:teuthology.orchestra.run.smithi045.stdout: -5283> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+379 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945b7b80 count now 1/379 2023-10-03T19:21:21.301 INFO:teuthology.orchestra.run.smithi045.stdout: -5282> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000459) clear_dirty_parent 2023-10-03T19:21:21.302 INFO:teuthology.orchestra.run.smithi045.stdout: -5281> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000045a) _stored_backtrace v 2686 2023-10-03T19:21:21.302 INFO:teuthology.orchestra.run.smithi045.stdout: -5280> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000045a) auth_unpin by 0x55cc945b8100 on [inode 0x1000000045a [2,head] /dc-dir/dc-file_613 auth v5164 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.980028+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945b8100] now 0 2023-10-03T19:21:21.302 INFO:teuthology.orchestra.run.smithi045.stdout: -5279> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+378 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945b8100 count now 1/378 2023-10-03T19:21:21.302 INFO:teuthology.orchestra.run.smithi045.stdout: -5278> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000045a) clear_dirty_parent 2023-10-03T19:21:21.302 INFO:teuthology.orchestra.run.smithi045.stdout: -5277> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000045b) _stored_backtrace v 2690 2023-10-03T19:21:21.302 INFO:teuthology.orchestra.run.smithi045.stdout: -5276> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000045b) auth_unpin by 0x55cc945b8680 on [inode 0x1000000045b [2,head] /dc-dir/dc-file_614 auth v5166 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:52.992071+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945b8680] now 0 2023-10-03T19:21:21.302 INFO:teuthology.orchestra.run.smithi045.stdout: -5275> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+377 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945b8680 count now 1/377 2023-10-03T19:21:21.302 INFO:teuthology.orchestra.run.smithi045.stdout: -5274> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000045b) clear_dirty_parent 2023-10-03T19:21:21.302 INFO:teuthology.orchestra.run.smithi045.stdout: -5273> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000045c) _stored_backtrace v 2694 2023-10-03T19:21:21.302 INFO:teuthology.orchestra.run.smithi045.stdout: -5272> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000045c) auth_unpin by 0x55cc945b8c00 on [inode 0x1000000045c [2,head] /dc-dir/dc-file_615 auth v5168 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.003975+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945b8c00] now 0 2023-10-03T19:21:21.302 INFO:teuthology.orchestra.run.smithi045.stdout: -5271> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+376 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945b8c00 count now 1/376 2023-10-03T19:21:21.302 INFO:teuthology.orchestra.run.smithi045.stdout: -5270> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000045c) clear_dirty_parent 2023-10-03T19:21:21.303 INFO:teuthology.orchestra.run.smithi045.stdout: -5269> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000045d) _stored_backtrace v 2698 2023-10-03T19:21:21.303 INFO:teuthology.orchestra.run.smithi045.stdout: -5268> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000045d) auth_unpin by 0x55cc945b9180 on [inode 0x1000000045d [2,head] /dc-dir/dc-file_616 auth v5170 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.017170+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945b9180] now 0 2023-10-03T19:21:21.303 INFO:teuthology.orchestra.run.smithi045.stdout: -5267> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+375 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945b9180 count now 1/375 2023-10-03T19:21:21.303 INFO:teuthology.orchestra.run.smithi045.stdout: -5266> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000045d) clear_dirty_parent 2023-10-03T19:21:21.303 INFO:teuthology.orchestra.run.smithi045.stdout: -5265> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000045e) _stored_backtrace v 2702 2023-10-03T19:21:21.303 INFO:teuthology.orchestra.run.smithi045.stdout: -5264> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000045e) auth_unpin by 0x55cc945b9700 on [inode 0x1000000045e [2,head] /dc-dir/dc-file_617 auth v5172 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.029673+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945b9700] now 0 2023-10-03T19:21:21.303 INFO:teuthology.orchestra.run.smithi045.stdout: -5263> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+374 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945b9700 count now 1/374 2023-10-03T19:21:21.303 INFO:teuthology.orchestra.run.smithi045.stdout: -5262> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000045e) clear_dirty_parent 2023-10-03T19:21:21.303 INFO:teuthology.orchestra.run.smithi045.stdout: -5261> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000045f) _stored_backtrace v 2706 2023-10-03T19:21:21.303 INFO:teuthology.orchestra.run.smithi045.stdout: -5260> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000045f) auth_unpin by 0x55cc945c0000 on [inode 0x1000000045f [2,head] /dc-dir/dc-file_618 auth v5174 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.042482+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945c0000] now 0 2023-10-03T19:21:21.303 INFO:teuthology.orchestra.run.smithi045.stdout: -5259> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+373 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945c0000 count now 1/373 2023-10-03T19:21:21.304 INFO:teuthology.orchestra.run.smithi045.stdout: -5258> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000045f) clear_dirty_parent 2023-10-03T19:21:21.304 INFO:teuthology.orchestra.run.smithi045.stdout: -5257> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000460) _stored_backtrace v 2710 2023-10-03T19:21:21.304 INFO:teuthology.orchestra.run.smithi045.stdout: -5256> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000460) auth_unpin by 0x55cc945c0580 on [inode 0x10000000460 [2,head] /dc-dir/dc-file_619 auth v5176 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.055107+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945c0580] now 0 2023-10-03T19:21:21.304 INFO:teuthology.orchestra.run.smithi045.stdout: -5255> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+372 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945c0580 count now 1/372 2023-10-03T19:21:21.304 INFO:teuthology.orchestra.run.smithi045.stdout: -5254> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000460) clear_dirty_parent 2023-10-03T19:21:21.304 INFO:teuthology.orchestra.run.smithi045.stdout: -5253> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000461) _stored_backtrace v 2714 2023-10-03T19:21:21.304 INFO:teuthology.orchestra.run.smithi045.stdout: -5252> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000461) auth_unpin by 0x55cc945c0b00 on [inode 0x10000000461 [2,head] /dc-dir/dc-file_620 auth v5178 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.067338+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945c0b00] now 0 2023-10-03T19:21:21.304 INFO:teuthology.orchestra.run.smithi045.stdout: -5251> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+371 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945c0b00 count now 1/371 2023-10-03T19:21:21.304 INFO:teuthology.orchestra.run.smithi045.stdout: -5250> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000461) clear_dirty_parent 2023-10-03T19:21:21.304 INFO:teuthology.orchestra.run.smithi045.stdout: -5249> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000462) _stored_backtrace v 2718 2023-10-03T19:21:21.305 INFO:teuthology.orchestra.run.smithi045.stdout: -5248> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000462) auth_unpin by 0x55cc945c1080 on [inode 0x10000000462 [2,head] /dc-dir/dc-file_621 auth v5180 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.079145+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945c1080] now 0 2023-10-03T19:21:21.305 INFO:teuthology.orchestra.run.smithi045.stdout: -5247> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+370 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945c1080 count now 1/370 2023-10-03T19:21:21.305 INFO:teuthology.orchestra.run.smithi045.stdout: -5246> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000462) clear_dirty_parent 2023-10-03T19:21:21.305 INFO:teuthology.orchestra.run.smithi045.stdout: -5245> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000463) _stored_backtrace v 2910 2023-10-03T19:21:21.305 INFO:teuthology.orchestra.run.smithi045.stdout: -5244> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000463) auth_unpin by 0x55cc945c1600 on [inode 0x10000000463 [2,head] /dc-dir/dc-file_622 auth v5246 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.169528+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945c1600] now 0 2023-10-03T19:21:21.305 INFO:teuthology.orchestra.run.smithi045.stdout: -5243> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+369 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945c1600 count now 1/369 2023-10-03T19:21:21.305 INFO:teuthology.orchestra.run.smithi045.stdout: -5242> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000463) clear_dirty_parent 2023-10-03T19:21:21.305 INFO:teuthology.orchestra.run.smithi045.stdout: -5241> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000464) _stored_backtrace v 2914 2023-10-03T19:21:21.305 INFO:teuthology.orchestra.run.smithi045.stdout: -5240> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000464) auth_unpin by 0x55cc945c1b80 on [inode 0x10000000464 [2,head] /dc-dir/dc-file_623 auth v5248 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.217556+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945c1b80] now 0 2023-10-03T19:21:21.305 INFO:teuthology.orchestra.run.smithi045.stdout: -5239> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+368 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945c1b80 count now 1/368 2023-10-03T19:21:21.305 INFO:teuthology.orchestra.run.smithi045.stdout: -5238> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000464) clear_dirty_parent 2023-10-03T19:21:21.306 INFO:teuthology.orchestra.run.smithi045.stdout: -5237> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000465) _stored_backtrace v 2918 2023-10-03T19:21:21.306 INFO:teuthology.orchestra.run.smithi045.stdout: -5236> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000465) auth_unpin by 0x55cc945c2100 on [inode 0x10000000465 [2,head] /dc-dir/dc-file_624 auth v5250 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.229605+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945c2100] now 0 2023-10-03T19:21:21.306 INFO:teuthology.orchestra.run.smithi045.stdout: -5235> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+367 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945c2100 count now 1/367 2023-10-03T19:21:21.306 INFO:teuthology.orchestra.run.smithi045.stdout: -5234> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000465) clear_dirty_parent 2023-10-03T19:21:21.306 INFO:teuthology.orchestra.run.smithi045.stdout: -5233> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000466) _stored_backtrace v 2922 2023-10-03T19:21:21.306 INFO:teuthology.orchestra.run.smithi045.stdout: -5232> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000466) auth_unpin by 0x55cc945c2680 on [inode 0x10000000466 [2,head] /dc-dir/dc-file_625 auth v5252 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.242448+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945c2680] now 0 2023-10-03T19:21:21.306 INFO:teuthology.orchestra.run.smithi045.stdout: -5231> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+366 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945c2680 count now 1/366 2023-10-03T19:21:21.306 INFO:teuthology.orchestra.run.smithi045.stdout: -5230> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000466) clear_dirty_parent 2023-10-03T19:21:21.306 INFO:teuthology.orchestra.run.smithi045.stdout: -5229> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000467) _stored_backtrace v 2926 2023-10-03T19:21:21.306 INFO:teuthology.orchestra.run.smithi045.stdout: -5228> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000467) auth_unpin by 0x55cc945c2c00 on [inode 0x10000000467 [2,head] /dc-dir/dc-file_626 auth v5254 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.256032+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945c2c00] now 0 2023-10-03T19:21:21.306 INFO:teuthology.orchestra.run.smithi045.stdout: -5227> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+365 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945c2c00 count now 1/365 2023-10-03T19:21:21.307 INFO:teuthology.orchestra.run.smithi045.stdout: -5226> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000467) clear_dirty_parent 2023-10-03T19:21:21.307 INFO:teuthology.orchestra.run.smithi045.stdout: -5225> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000468) _stored_backtrace v 2930 2023-10-03T19:21:21.307 INFO:teuthology.orchestra.run.smithi045.stdout: -5224> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000468) auth_unpin by 0x55cc945c3180 on [inode 0x10000000468 [2,head] /dc-dir/dc-file_627 auth v5256 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.267975+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945c3180] now 0 2023-10-03T19:21:21.307 INFO:teuthology.orchestra.run.smithi045.stdout: -5223> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+364 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945c3180 count now 1/364 2023-10-03T19:21:21.307 INFO:teuthology.orchestra.run.smithi045.stdout: -5222> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000468) clear_dirty_parent 2023-10-03T19:21:21.307 INFO:teuthology.orchestra.run.smithi045.stdout: -5221> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000469) _stored_backtrace v 2934 2023-10-03T19:21:21.307 INFO:teuthology.orchestra.run.smithi045.stdout: -5220> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000469) auth_unpin by 0x55cc945c3700 on [inode 0x10000000469 [2,head] /dc-dir/dc-file_628 auth v5258 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.280071+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945c3700] now 0 2023-10-03T19:21:21.307 INFO:teuthology.orchestra.run.smithi045.stdout: -5219> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+363 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945c3700 count now 1/363 2023-10-03T19:21:21.307 INFO:teuthology.orchestra.run.smithi045.stdout: -5218> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000469) clear_dirty_parent 2023-10-03T19:21:21.307 INFO:teuthology.orchestra.run.smithi045.stdout: -5217> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000046a) _stored_backtrace v 2938 2023-10-03T19:21:21.307 INFO:teuthology.orchestra.run.smithi045.stdout: -5216> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000046a) auth_unpin by 0x55cc945da000 on [inode 0x1000000046a [2,head] /dc-dir/dc-file_629 auth v5260 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.292019+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945da000] now 0 2023-10-03T19:21:21.308 INFO:teuthology.orchestra.run.smithi045.stdout: -5215> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+362 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945da000 count now 1/362 2023-10-03T19:21:21.308 INFO:teuthology.orchestra.run.smithi045.stdout: -5214> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000046a) clear_dirty_parent 2023-10-03T19:21:21.308 INFO:teuthology.orchestra.run.smithi045.stdout: -5213> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000046b) _stored_backtrace v 2942 2023-10-03T19:21:21.308 INFO:teuthology.orchestra.run.smithi045.stdout: -5212> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000046b) auth_unpin by 0x55cc945da580 on [inode 0x1000000046b [2,head] /dc-dir/dc-file_630 auth v5262 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.303347+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945da580] now 0 2023-10-03T19:21:21.308 INFO:teuthology.orchestra.run.smithi045.stdout: -5211> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+361 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945da580 count now 1/361 2023-10-03T19:21:21.308 INFO:teuthology.orchestra.run.smithi045.stdout: -5210> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000046b) clear_dirty_parent 2023-10-03T19:21:21.308 INFO:teuthology.orchestra.run.smithi045.stdout: -5209> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000046c) _stored_backtrace v 2946 2023-10-03T19:21:21.308 INFO:teuthology.orchestra.run.smithi045.stdout: -5208> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000046c) auth_unpin by 0x55cc945dab00 on [inode 0x1000000046c [2,head] /dc-dir/dc-file_631 auth v5264 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.314946+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945dab00] now 0 2023-10-03T19:21:21.308 INFO:teuthology.orchestra.run.smithi045.stdout: -5207> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+360 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945dab00 count now 1/360 2023-10-03T19:21:21.308 INFO:teuthology.orchestra.run.smithi045.stdout: -5206> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000046c) clear_dirty_parent 2023-10-03T19:21:21.308 INFO:teuthology.orchestra.run.smithi045.stdout: -5205> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000046d) _stored_backtrace v 2950 2023-10-03T19:21:21.308 INFO:teuthology.orchestra.run.smithi045.stdout: -5204> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000046d) auth_unpin by 0x55cc945db080 on [inode 0x1000000046d [2,head] /dc-dir/dc-file_632 auth v5266 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.327969+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945db080] now 0 2023-10-03T19:21:21.309 INFO:teuthology.orchestra.run.smithi045.stdout: -5203> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+359 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945db080 count now 1/359 2023-10-03T19:21:21.309 INFO:teuthology.orchestra.run.smithi045.stdout: -5202> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000046d) clear_dirty_parent 2023-10-03T19:21:21.309 INFO:teuthology.orchestra.run.smithi045.stdout: -5201> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000046e) _stored_backtrace v 2954 2023-10-03T19:21:21.309 INFO:teuthology.orchestra.run.smithi045.stdout: -5200> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000046e) auth_unpin by 0x55cc945db600 on [inode 0x1000000046e [2,head] /dc-dir/dc-file_633 auth v5268 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.339950+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945db600] now 0 2023-10-03T19:21:21.309 INFO:teuthology.orchestra.run.smithi045.stdout: -5199> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+358 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945db600 count now 1/358 2023-10-03T19:21:21.309 INFO:teuthology.orchestra.run.smithi045.stdout: -5198> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000046e) clear_dirty_parent 2023-10-03T19:21:21.309 INFO:teuthology.orchestra.run.smithi045.stdout: -5197> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000046f) _stored_backtrace v 2958 2023-10-03T19:21:21.309 INFO:teuthology.orchestra.run.smithi045.stdout: -5196> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000046f) auth_unpin by 0x55cc945dbb80 on [inode 0x1000000046f [2,head] /dc-dir/dc-file_634 auth v5270 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.352501+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945dbb80] now 0 2023-10-03T19:21:21.309 INFO:teuthology.orchestra.run.smithi045.stdout: -5195> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+357 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945dbb80 count now 1/357 2023-10-03T19:21:21.309 INFO:teuthology.orchestra.run.smithi045.stdout: -5194> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000046f) clear_dirty_parent 2023-10-03T19:21:21.309 INFO:teuthology.orchestra.run.smithi045.stdout: -5193> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000470) _stored_backtrace v 2962 2023-10-03T19:21:21.309 INFO:teuthology.orchestra.run.smithi045.stdout: -5192> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000470) auth_unpin by 0x55cc945dc100 on [inode 0x10000000470 [2,head] /dc-dir/dc-file_635 auth v5272 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.364383+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945dc100] now 0 2023-10-03T19:21:21.310 INFO:teuthology.orchestra.run.smithi045.stdout: -5191> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+356 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945dc100 count now 1/356 2023-10-03T19:21:21.310 INFO:teuthology.orchestra.run.smithi045.stdout: -5190> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000470) clear_dirty_parent 2023-10-03T19:21:21.310 INFO:teuthology.orchestra.run.smithi045.stdout: -5189> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000471) _stored_backtrace v 2966 2023-10-03T19:21:21.310 INFO:teuthology.orchestra.run.smithi045.stdout: -5188> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000471) auth_unpin by 0x55cc945dc680 on [inode 0x10000000471 [2,head] /dc-dir/dc-file_636 auth v5274 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.377355+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945dc680] now 0 2023-10-03T19:21:21.310 INFO:teuthology.orchestra.run.smithi045.stdout: -5187> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+355 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945dc680 count now 1/355 2023-10-03T19:21:21.310 INFO:teuthology.orchestra.run.smithi045.stdout: -5186> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000471) clear_dirty_parent 2023-10-03T19:21:21.310 INFO:teuthology.orchestra.run.smithi045.stdout: -5185> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000472) _stored_backtrace v 2970 2023-10-03T19:21:21.310 INFO:teuthology.orchestra.run.smithi045.stdout: -5184> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000472) auth_unpin by 0x55cc945dcc00 on [inode 0x10000000472 [2,head] /dc-dir/dc-file_637 auth v5276 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.389836+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945dcc00] now 0 2023-10-03T19:21:21.310 INFO:teuthology.orchestra.run.smithi045.stdout: -5183> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+354 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945dcc00 count now 1/354 2023-10-03T19:21:21.310 INFO:teuthology.orchestra.run.smithi045.stdout: -5182> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000472) clear_dirty_parent 2023-10-03T19:21:21.311 INFO:teuthology.orchestra.run.smithi045.stdout: -5181> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000473) _stored_backtrace v 2974 2023-10-03T19:21:21.311 INFO:teuthology.orchestra.run.smithi045.stdout: -5180> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000473) auth_unpin by 0x55cc945dd180 on [inode 0x10000000473 [2,head] /dc-dir/dc-file_638 auth v5278 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.401904+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945dd180] now 0 2023-10-03T19:21:21.311 INFO:teuthology.orchestra.run.smithi045.stdout: -5179> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+353 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945dd180 count now 1/353 2023-10-03T19:21:21.311 INFO:teuthology.orchestra.run.smithi045.stdout: -5178> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000473) clear_dirty_parent 2023-10-03T19:21:21.311 INFO:teuthology.orchestra.run.smithi045.stdout: -5177> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000474) _stored_backtrace v 2978 2023-10-03T19:21:21.311 INFO:teuthology.orchestra.run.smithi045.stdout: -5176> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000474) auth_unpin by 0x55cc945dd700 on [inode 0x10000000474 [2,head] /dc-dir/dc-file_639 auth v5280 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.414842+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945dd700] now 0 2023-10-03T19:21:21.311 INFO:teuthology.orchestra.run.smithi045.stdout: -5175> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+352 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945dd700 count now 1/352 2023-10-03T19:21:21.311 INFO:teuthology.orchestra.run.smithi045.stdout: -5174> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000474) clear_dirty_parent 2023-10-03T19:21:21.311 INFO:teuthology.orchestra.run.smithi045.stdout: -5173> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000475) _stored_backtrace v 2982 2023-10-03T19:21:21.311 INFO:teuthology.orchestra.run.smithi045.stdout: -5172> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000475) auth_unpin by 0x55cc945f2000 on [inode 0x10000000475 [2,head] /dc-dir/dc-file_640 auth v5282 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.426552+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945f2000] now 0 2023-10-03T19:21:21.311 INFO:teuthology.orchestra.run.smithi045.stdout: -5171> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+351 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945f2000 count now 1/351 2023-10-03T19:21:21.312 INFO:teuthology.orchestra.run.smithi045.stdout: -5170> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000475) clear_dirty_parent 2023-10-03T19:21:21.312 INFO:teuthology.orchestra.run.smithi045.stdout: -5169> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000476) _stored_backtrace v 2986 2023-10-03T19:21:21.312 INFO:teuthology.orchestra.run.smithi045.stdout: -5168> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000476) auth_unpin by 0x55cc945f2580 on [inode 0x10000000476 [2,head] /dc-dir/dc-file_641 auth v5284 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.438725+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945f2580] now 0 2023-10-03T19:21:21.312 INFO:teuthology.orchestra.run.smithi045.stdout: -5167> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+350 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945f2580 count now 1/350 2023-10-03T19:21:21.312 INFO:teuthology.orchestra.run.smithi045.stdout: -5166> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000476) clear_dirty_parent 2023-10-03T19:21:21.312 INFO:teuthology.orchestra.run.smithi045.stdout: -5165> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000477) _stored_backtrace v 2990 2023-10-03T19:21:21.312 INFO:teuthology.orchestra.run.smithi045.stdout: -5164> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000477) auth_unpin by 0x55cc945f2b00 on [inode 0x10000000477 [2,head] /dc-dir/dc-file_642 auth v5286 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.451879+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945f2b00] now 0 2023-10-03T19:21:21.312 INFO:teuthology.orchestra.run.smithi045.stdout: -5163> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+349 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945f2b00 count now 1/349 2023-10-03T19:21:21.312 INFO:teuthology.orchestra.run.smithi045.stdout: -5162> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000477) clear_dirty_parent 2023-10-03T19:21:21.312 INFO:teuthology.orchestra.run.smithi045.stdout: -5161> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000478) _stored_backtrace v 2994 2023-10-03T19:21:21.313 INFO:teuthology.orchestra.run.smithi045.stdout: -5160> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000478) auth_unpin by 0x55cc945f3080 on [inode 0x10000000478 [2,head] /dc-dir/dc-file_643 auth v5288 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.463798+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945f3080] now 0 2023-10-03T19:21:21.313 INFO:teuthology.orchestra.run.smithi045.stdout: -5159> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+348 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945f3080 count now 1/348 2023-10-03T19:21:21.313 INFO:teuthology.orchestra.run.smithi045.stdout: -5158> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000478) clear_dirty_parent 2023-10-03T19:21:21.313 INFO:teuthology.orchestra.run.smithi045.stdout: -5157> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000479) _stored_backtrace v 2998 2023-10-03T19:21:21.313 INFO:teuthology.orchestra.run.smithi045.stdout: -5156> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000479) auth_unpin by 0x55cc945f3600 on [inode 0x10000000479 [2,head] /dc-dir/dc-file_644 auth v5290 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.475546+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945f3600] now 0 2023-10-03T19:21:21.313 INFO:teuthology.orchestra.run.smithi045.stdout: -5155> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+347 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945f3600 count now 1/347 2023-10-03T19:21:21.313 INFO:teuthology.orchestra.run.smithi045.stdout: -5154> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000479) clear_dirty_parent 2023-10-03T19:21:21.313 INFO:teuthology.orchestra.run.smithi045.stdout: -5153> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000047a) _stored_backtrace v 3002 2023-10-03T19:21:21.313 INFO:teuthology.orchestra.run.smithi045.stdout: -5152> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000047a) auth_unpin by 0x55cc945f3b80 on [inode 0x1000000047a [2,head] /dc-dir/dc-file_645 auth v5292 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.488285+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945f3b80] now 0 2023-10-03T19:21:21.313 INFO:teuthology.orchestra.run.smithi045.stdout: -5151> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+346 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945f3b80 count now 1/346 2023-10-03T19:21:21.313 INFO:teuthology.orchestra.run.smithi045.stdout: -5150> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000047a) clear_dirty_parent 2023-10-03T19:21:21.314 INFO:teuthology.orchestra.run.smithi045.stdout: -5149> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000047b) _stored_backtrace v 3006 2023-10-03T19:21:21.314 INFO:teuthology.orchestra.run.smithi045.stdout: -5148> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000047b) auth_unpin by 0x55cc945f4100 on [inode 0x1000000047b [2,head] /dc-dir/dc-file_646 auth v5294 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.502775+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945f4100] now 0 2023-10-03T19:21:21.314 INFO:teuthology.orchestra.run.smithi045.stdout: -5147> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+345 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945f4100 count now 1/345 2023-10-03T19:21:21.314 INFO:teuthology.orchestra.run.smithi045.stdout: -5146> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000047b) clear_dirty_parent 2023-10-03T19:21:21.314 INFO:teuthology.orchestra.run.smithi045.stdout: -5145> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000047c) _stored_backtrace v 3010 2023-10-03T19:21:21.314 INFO:teuthology.orchestra.run.smithi045.stdout: -5144> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000047c) auth_unpin by 0x55cc945f4680 on [inode 0x1000000047c [2,head] /dc-dir/dc-file_647 auth v5296 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.516655+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945f4680] now 0 2023-10-03T19:21:21.314 INFO:teuthology.orchestra.run.smithi045.stdout: -5143> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+344 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945f4680 count now 1/344 2023-10-03T19:21:21.314 INFO:teuthology.orchestra.run.smithi045.stdout: -5142> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000047c) clear_dirty_parent 2023-10-03T19:21:21.314 INFO:teuthology.orchestra.run.smithi045.stdout: -5141> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000047d) _stored_backtrace v 3014 2023-10-03T19:21:21.314 INFO:teuthology.orchestra.run.smithi045.stdout: -5140> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000047d) auth_unpin by 0x55cc945f4c00 on [inode 0x1000000047d [2,head] /dc-dir/dc-file_648 auth v5298 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.529133+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945f4c00] now 0 2023-10-03T19:21:21.314 INFO:teuthology.orchestra.run.smithi045.stdout: -5139> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+343 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945f4c00 count now 1/343 2023-10-03T19:21:21.315 INFO:teuthology.orchestra.run.smithi045.stdout: -5138> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000047d) clear_dirty_parent 2023-10-03T19:21:21.315 INFO:teuthology.orchestra.run.smithi045.stdout: -5137> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000047e) _stored_backtrace v 3018 2023-10-03T19:21:21.315 INFO:teuthology.orchestra.run.smithi045.stdout: -5136> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000047e) auth_unpin by 0x55cc945f5180 on [inode 0x1000000047e [2,head] /dc-dir/dc-file_649 auth v5300 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.540393+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945f5180] now 0 2023-10-03T19:21:21.315 INFO:teuthology.orchestra.run.smithi045.stdout: -5135> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+342 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945f5180 count now 1/342 2023-10-03T19:21:21.315 INFO:teuthology.orchestra.run.smithi045.stdout: -5134> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000047e) clear_dirty_parent 2023-10-03T19:21:21.315 INFO:teuthology.orchestra.run.smithi045.stdout: -5133> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000047f) _stored_backtrace v 3022 2023-10-03T19:21:21.315 INFO:teuthology.orchestra.run.smithi045.stdout: -5132> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000047f) auth_unpin by 0x55cc945f5700 on [inode 0x1000000047f [2,head] /dc-dir/dc-file_650 auth v5302 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.552977+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945f5700] now 0 2023-10-03T19:21:21.315 INFO:teuthology.orchestra.run.smithi045.stdout: -5131> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+341 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945f5700 count now 1/341 2023-10-03T19:21:21.315 INFO:teuthology.orchestra.run.smithi045.stdout: -5130> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000047f) clear_dirty_parent 2023-10-03T19:21:21.315 INFO:teuthology.orchestra.run.smithi045.stdout: -5129> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000480) _stored_backtrace v 3026 2023-10-03T19:21:21.315 INFO:teuthology.orchestra.run.smithi045.stdout: -5128> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000480) auth_unpin by 0x55cc945fa000 on [inode 0x10000000480 [2,head] /dc-dir/dc-file_651 auth v5304 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.566453+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945fa000] now 0 2023-10-03T19:21:21.315 INFO:teuthology.orchestra.run.smithi045.stdout: -5127> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+340 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945fa000 count now 1/340 2023-10-03T19:21:21.316 INFO:teuthology.orchestra.run.smithi045.stdout: -5126> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000480) clear_dirty_parent 2023-10-03T19:21:21.316 INFO:teuthology.orchestra.run.smithi045.stdout: -5125> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000481) _stored_backtrace v 3030 2023-10-03T19:21:21.316 INFO:teuthology.orchestra.run.smithi045.stdout: -5124> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000481) auth_unpin by 0x55cc945fa580 on [inode 0x10000000481 [2,head] /dc-dir/dc-file_652 auth v5306 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.578885+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945fa580] now 0 2023-10-03T19:21:21.316 INFO:teuthology.orchestra.run.smithi045.stdout: -5123> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+339 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945fa580 count now 1/339 2023-10-03T19:21:21.316 INFO:teuthology.orchestra.run.smithi045.stdout: -5122> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000481) clear_dirty_parent 2023-10-03T19:21:21.316 INFO:teuthology.orchestra.run.smithi045.stdout: -5121> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000482) _stored_backtrace v 3034 2023-10-03T19:21:21.316 INFO:teuthology.orchestra.run.smithi045.stdout: -5120> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000482) auth_unpin by 0x55cc945fab00 on [inode 0x10000000482 [2,head] /dc-dir/dc-file_653 auth v5308 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.591419+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945fab00] now 0 2023-10-03T19:21:21.316 INFO:teuthology.orchestra.run.smithi045.stdout: -5119> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+338 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945fab00 count now 1/338 2023-10-03T19:21:21.316 INFO:teuthology.orchestra.run.smithi045.stdout: -5118> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000482) clear_dirty_parent 2023-10-03T19:21:21.316 INFO:teuthology.orchestra.run.smithi045.stdout: -5117> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000483) _stored_backtrace v 3038 2023-10-03T19:21:21.316 INFO:teuthology.orchestra.run.smithi045.stdout: -5116> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000483) auth_unpin by 0x55cc945fb080 on [inode 0x10000000483 [2,head] /dc-dir/dc-file_654 auth v5310 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.604145+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945fb080] now 0 2023-10-03T19:21:21.316 INFO:teuthology.orchestra.run.smithi045.stdout: -5115> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+337 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945fb080 count now 1/337 2023-10-03T19:21:21.317 INFO:teuthology.orchestra.run.smithi045.stdout: -5114> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000483) clear_dirty_parent 2023-10-03T19:21:21.317 INFO:teuthology.orchestra.run.smithi045.stdout: -5113> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000484) _stored_backtrace v 3042 2023-10-03T19:21:21.317 INFO:teuthology.orchestra.run.smithi045.stdout: -5112> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000484) auth_unpin by 0x55cc945fb600 on [inode 0x10000000484 [2,head] /dc-dir/dc-file_655 auth v5312 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.617846+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945fb600] now 0 2023-10-03T19:21:21.317 INFO:teuthology.orchestra.run.smithi045.stdout: -5111> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+336 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945fb600 count now 1/336 2023-10-03T19:21:21.317 INFO:teuthology.orchestra.run.smithi045.stdout: -5110> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000484) clear_dirty_parent 2023-10-03T19:21:21.317 INFO:teuthology.orchestra.run.smithi045.stdout: -5109> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000485) _stored_backtrace v 3046 2023-10-03T19:21:21.317 INFO:teuthology.orchestra.run.smithi045.stdout: -5108> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000485) auth_unpin by 0x55cc945fbb80 on [inode 0x10000000485 [2,head] /dc-dir/dc-file_656 auth v5314 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.630102+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945fbb80] now 0 2023-10-03T19:21:21.317 INFO:teuthology.orchestra.run.smithi045.stdout: -5107> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+335 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945fbb80 count now 1/335 2023-10-03T19:21:21.317 INFO:teuthology.orchestra.run.smithi045.stdout: -5106> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000485) clear_dirty_parent 2023-10-03T19:21:21.317 INFO:teuthology.orchestra.run.smithi045.stdout: -5105> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000486) _stored_backtrace v 3050 2023-10-03T19:21:21.317 INFO:teuthology.orchestra.run.smithi045.stdout: -5104> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000486) auth_unpin by 0x55cc945fc100 on [inode 0x10000000486 [2,head] /dc-dir/dc-file_657 auth v5316 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.643412+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945fc100] now 0 2023-10-03T19:21:21.317 INFO:teuthology.orchestra.run.smithi045.stdout: -5103> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+334 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945fc100 count now 1/334 2023-10-03T19:21:21.318 INFO:teuthology.orchestra.run.smithi045.stdout: -5102> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000486) clear_dirty_parent 2023-10-03T19:21:21.318 INFO:teuthology.orchestra.run.smithi045.stdout: -5101> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000487) _stored_backtrace v 3054 2023-10-03T19:21:21.318 INFO:teuthology.orchestra.run.smithi045.stdout: -5100> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000487) auth_unpin by 0x55cc945fc680 on [inode 0x10000000487 [2,head] /dc-dir/dc-file_658 auth v5318 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.655883+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945fc680] now 0 2023-10-03T19:21:21.318 INFO:teuthology.orchestra.run.smithi045.stdout: -5099> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+333 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945fc680 count now 1/333 2023-10-03T19:21:21.318 INFO:teuthology.orchestra.run.smithi045.stdout: -5098> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000487) clear_dirty_parent 2023-10-03T19:21:21.318 INFO:teuthology.orchestra.run.smithi045.stdout: -5097> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000488) _stored_backtrace v 3058 2023-10-03T19:21:21.318 INFO:teuthology.orchestra.run.smithi045.stdout: -5096> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000488) auth_unpin by 0x55cc945fcc00 on [inode 0x10000000488 [2,head] /dc-dir/dc-file_659 auth v5320 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.667674+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945fcc00] now 0 2023-10-03T19:21:21.318 INFO:teuthology.orchestra.run.smithi045.stdout: -5095> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+332 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945fcc00 count now 1/332 2023-10-03T19:21:21.318 INFO:teuthology.orchestra.run.smithi045.stdout: -5094> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000488) clear_dirty_parent 2023-10-03T19:21:21.318 INFO:teuthology.orchestra.run.smithi045.stdout: -5093> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000489) _stored_backtrace v 3062 2023-10-03T19:21:21.318 INFO:teuthology.orchestra.run.smithi045.stdout: -5092> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000489) auth_unpin by 0x55cc945fd180 on [inode 0x10000000489 [2,head] /dc-dir/dc-file_660 auth v5322 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.679313+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945fd180] now 0 2023-10-03T19:21:21.319 INFO:teuthology.orchestra.run.smithi045.stdout: -5091> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+331 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945fd180 count now 1/331 2023-10-03T19:21:21.319 INFO:teuthology.orchestra.run.smithi045.stdout: -5090> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000489) clear_dirty_parent 2023-10-03T19:21:21.319 INFO:teuthology.orchestra.run.smithi045.stdout: -5089> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000048a) _stored_backtrace v 3066 2023-10-03T19:21:21.319 INFO:teuthology.orchestra.run.smithi045.stdout: -5088> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000048a) auth_unpin by 0x55cc945fd700 on [inode 0x1000000048a [2,head] /dc-dir/dc-file_661 auth v5324 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.691279+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc945fd700] now 0 2023-10-03T19:21:21.319 INFO:teuthology.orchestra.run.smithi045.stdout: -5087> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+330 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc945fd700 count now 1/330 2023-10-03T19:21:21.319 INFO:teuthology.orchestra.run.smithi045.stdout: -5086> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000048a) clear_dirty_parent 2023-10-03T19:21:21.319 INFO:teuthology.orchestra.run.smithi045.stdout: -5085> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000048b) _stored_backtrace v 3070 2023-10-03T19:21:21.319 INFO:teuthology.orchestra.run.smithi045.stdout: -5084> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000048b) auth_unpin by 0x55cc94606000 on [inode 0x1000000048b [2,head] /dc-dir/dc-file_662 auth v5326 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.704389+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94606000] now 0 2023-10-03T19:21:21.319 INFO:teuthology.orchestra.run.smithi045.stdout: -5083> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+329 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94606000 count now 1/329 2023-10-03T19:21:21.319 INFO:teuthology.orchestra.run.smithi045.stdout: -5082> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000048b) clear_dirty_parent 2023-10-03T19:21:21.319 INFO:teuthology.orchestra.run.smithi045.stdout: -5081> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000048c) _stored_backtrace v 3074 2023-10-03T19:21:21.320 INFO:teuthology.orchestra.run.smithi045.stdout: -5080> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000048c) auth_unpin by 0x55cc94606580 on [inode 0x1000000048c [2,head] /dc-dir/dc-file_663 auth v5328 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.717211+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94606580] now 0 2023-10-03T19:21:21.320 INFO:teuthology.orchestra.run.smithi045.stdout: -5079> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+328 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94606580 count now 1/328 2023-10-03T19:21:21.320 INFO:teuthology.orchestra.run.smithi045.stdout: -5078> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000048c) clear_dirty_parent 2023-10-03T19:21:21.320 INFO:teuthology.orchestra.run.smithi045.stdout: -5077> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000048d) _stored_backtrace v 3078 2023-10-03T19:21:21.320 INFO:teuthology.orchestra.run.smithi045.stdout: -5076> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000048d) auth_unpin by 0x55cc94606b00 on [inode 0x1000000048d [2,head] /dc-dir/dc-file_664 auth v5330 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.730376+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94606b00] now 0 2023-10-03T19:21:21.320 INFO:teuthology.orchestra.run.smithi045.stdout: -5075> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+327 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94606b00 count now 1/327 2023-10-03T19:21:21.320 INFO:teuthology.orchestra.run.smithi045.stdout: -5074> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000048d) clear_dirty_parent 2023-10-03T19:21:21.320 INFO:teuthology.orchestra.run.smithi045.stdout: -5073> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000048e) _stored_backtrace v 3082 2023-10-03T19:21:21.320 INFO:teuthology.orchestra.run.smithi045.stdout: -5072> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000048e) auth_unpin by 0x55cc94607080 on [inode 0x1000000048e [2,head] /dc-dir/dc-file_665 auth v5332 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.742380+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94607080] now 0 2023-10-03T19:21:21.320 INFO:teuthology.orchestra.run.smithi045.stdout: -5071> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+326 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94607080 count now 1/326 2023-10-03T19:21:21.320 INFO:teuthology.orchestra.run.smithi045.stdout: -5070> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000048e) clear_dirty_parent 2023-10-03T19:21:21.320 INFO:teuthology.orchestra.run.smithi045.stdout: -5069> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000048f) _stored_backtrace v 3086 2023-10-03T19:21:21.321 INFO:teuthology.orchestra.run.smithi045.stdout: -5068> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000048f) auth_unpin by 0x55cc94607600 on [inode 0x1000000048f [2,head] /dc-dir/dc-file_666 auth v5334 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.754773+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94607600] now 0 2023-10-03T19:21:21.321 INFO:teuthology.orchestra.run.smithi045.stdout: -5067> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+325 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94607600 count now 1/325 2023-10-03T19:21:21.321 INFO:teuthology.orchestra.run.smithi045.stdout: -5066> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000048f) clear_dirty_parent 2023-10-03T19:21:21.321 INFO:teuthology.orchestra.run.smithi045.stdout: -5065> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000490) _stored_backtrace v 3090 2023-10-03T19:21:21.321 INFO:teuthology.orchestra.run.smithi045.stdout: -5064> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000490) auth_unpin by 0x55cc94607b80 on [inode 0x10000000490 [2,head] /dc-dir/dc-file_667 auth v5336 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.767403+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94607b80] now 0 2023-10-03T19:21:21.321 INFO:teuthology.orchestra.run.smithi045.stdout: -5063> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+324 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94607b80 count now 1/324 2023-10-03T19:21:21.321 INFO:teuthology.orchestra.run.smithi045.stdout: -5062> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000490) clear_dirty_parent 2023-10-03T19:21:21.321 INFO:teuthology.orchestra.run.smithi045.stdout: -5061> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000491) _stored_backtrace v 3094 2023-10-03T19:21:21.321 INFO:teuthology.orchestra.run.smithi045.stdout: -5060> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000491) auth_unpin by 0x55cc94608100 on [inode 0x10000000491 [2,head] /dc-dir/dc-file_668 auth v5338 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.779255+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94608100] now 0 2023-10-03T19:21:21.321 INFO:teuthology.orchestra.run.smithi045.stdout: -5059> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+323 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94608100 count now 1/323 2023-10-03T19:21:21.322 INFO:teuthology.orchestra.run.smithi045.stdout: -5058> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000491) clear_dirty_parent 2023-10-03T19:21:21.322 INFO:teuthology.orchestra.run.smithi045.stdout: -5057> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000492) _stored_backtrace v 3098 2023-10-03T19:21:21.322 INFO:teuthology.orchestra.run.smithi045.stdout: -5056> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000492) auth_unpin by 0x55cc94608680 on [inode 0x10000000492 [2,head] /dc-dir/dc-file_669 auth v5340 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.791463+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94608680] now 0 2023-10-03T19:21:21.322 INFO:teuthology.orchestra.run.smithi045.stdout: -5055> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+322 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94608680 count now 1/322 2023-10-03T19:21:21.322 INFO:teuthology.orchestra.run.smithi045.stdout: -5054> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000492) clear_dirty_parent 2023-10-03T19:21:21.322 INFO:teuthology.orchestra.run.smithi045.stdout: -5053> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000493) _stored_backtrace v 3102 2023-10-03T19:21:21.322 INFO:teuthology.orchestra.run.smithi045.stdout: -5052> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000493) auth_unpin by 0x55cc94608c00 on [inode 0x10000000493 [2,head] /dc-dir/dc-file_670 auth v5342 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.804480+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94608c00] now 0 2023-10-03T19:21:21.322 INFO:teuthology.orchestra.run.smithi045.stdout: -5051> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+321 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94608c00 count now 1/321 2023-10-03T19:21:21.322 INFO:teuthology.orchestra.run.smithi045.stdout: -5050> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000493) clear_dirty_parent 2023-10-03T19:21:21.322 INFO:teuthology.orchestra.run.smithi045.stdout: -5049> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000494) _stored_backtrace v 3106 2023-10-03T19:21:21.322 INFO:teuthology.orchestra.run.smithi045.stdout: -5048> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000494) auth_unpin by 0x55cc94609180 on [inode 0x10000000494 [2,head] /dc-dir/dc-file_671 auth v5344 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.816519+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94609180] now 0 2023-10-03T19:21:21.323 INFO:teuthology.orchestra.run.smithi045.stdout: -5047> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+320 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94609180 count now 1/320 2023-10-03T19:21:21.323 INFO:teuthology.orchestra.run.smithi045.stdout: -5046> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000494) clear_dirty_parent 2023-10-03T19:21:21.323 INFO:teuthology.orchestra.run.smithi045.stdout: -5045> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000495) _stored_backtrace v 3110 2023-10-03T19:21:21.323 INFO:teuthology.orchestra.run.smithi045.stdout: -5044> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000495) auth_unpin by 0x55cc94609700 on [inode 0x10000000495 [2,head] /dc-dir/dc-file_672 auth v5346 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.828245+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94609700] now 0 2023-10-03T19:21:21.323 INFO:teuthology.orchestra.run.smithi045.stdout: -5043> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+319 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94609700 count now 1/319 2023-10-03T19:21:21.323 INFO:teuthology.orchestra.run.smithi045.stdout: -5042> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000495) clear_dirty_parent 2023-10-03T19:21:21.323 INFO:teuthology.orchestra.run.smithi045.stdout: -5041> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000496) _stored_backtrace v 3114 2023-10-03T19:21:21.323 INFO:teuthology.orchestra.run.smithi045.stdout: -5040> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000496) auth_unpin by 0x55cc94612000 on [inode 0x10000000496 [2,head] /dc-dir/dc-file_673 auth v5348 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.840524+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94612000] now 0 2023-10-03T19:21:21.323 INFO:teuthology.orchestra.run.smithi045.stdout: -5039> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+318 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94612000 count now 1/318 2023-10-03T19:21:21.323 INFO:teuthology.orchestra.run.smithi045.stdout: -5038> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000496) clear_dirty_parent 2023-10-03T19:21:21.323 INFO:teuthology.orchestra.run.smithi045.stdout: -5037> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000497) _stored_backtrace v 3118 2023-10-03T19:21:21.324 INFO:teuthology.orchestra.run.smithi045.stdout: -5036> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000497) auth_unpin by 0x55cc94612580 on [inode 0x10000000497 [2,head] /dc-dir/dc-file_674 auth v5350 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.851795+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94612580] now 0 2023-10-03T19:21:21.324 INFO:teuthology.orchestra.run.smithi045.stdout: -5035> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+317 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94612580 count now 1/317 2023-10-03T19:21:21.324 INFO:teuthology.orchestra.run.smithi045.stdout: -5034> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000497) clear_dirty_parent 2023-10-03T19:21:21.324 INFO:teuthology.orchestra.run.smithi045.stdout: -5033> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000498) _stored_backtrace v 3122 2023-10-03T19:21:21.324 INFO:teuthology.orchestra.run.smithi045.stdout: -5032> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000498) auth_unpin by 0x55cc94612b00 on [inode 0x10000000498 [2,head] /dc-dir/dc-file_675 auth v5352 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.863775+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94612b00] now 0 2023-10-03T19:21:21.324 INFO:teuthology.orchestra.run.smithi045.stdout: -5031> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+316 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94612b00 count now 1/316 2023-10-03T19:21:21.324 INFO:teuthology.orchestra.run.smithi045.stdout: -5030> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000498) clear_dirty_parent 2023-10-03T19:21:21.324 INFO:teuthology.orchestra.run.smithi045.stdout: -5029> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000499) _stored_backtrace v 3126 2023-10-03T19:21:21.324 INFO:teuthology.orchestra.run.smithi045.stdout: -5028> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000499) auth_unpin by 0x55cc94613080 on [inode 0x10000000499 [2,head] /dc-dir/dc-file_676 auth v5354 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.875771+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94613080] now 0 2023-10-03T19:21:21.324 INFO:teuthology.orchestra.run.smithi045.stdout: -5027> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+315 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94613080 count now 1/315 2023-10-03T19:21:21.325 INFO:teuthology.orchestra.run.smithi045.stdout: -5026> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000499) clear_dirty_parent 2023-10-03T19:21:21.325 INFO:teuthology.orchestra.run.smithi045.stdout: -5025> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000049a) _stored_backtrace v 3130 2023-10-03T19:21:21.325 INFO:teuthology.orchestra.run.smithi045.stdout: -5024> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000049a) auth_unpin by 0x55cc94613600 on [inode 0x1000000049a [2,head] /dc-dir/dc-file_677 auth v5356 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.888241+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94613600] now 0 2023-10-03T19:21:21.325 INFO:teuthology.orchestra.run.smithi045.stdout: -5023> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+314 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94613600 count now 1/314 2023-10-03T19:21:21.325 INFO:teuthology.orchestra.run.smithi045.stdout: -5022> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000049a) clear_dirty_parent 2023-10-03T19:21:21.325 INFO:teuthology.orchestra.run.smithi045.stdout: -5021> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000049b) _stored_backtrace v 3134 2023-10-03T19:21:21.325 INFO:teuthology.orchestra.run.smithi045.stdout: -5020> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000049b) auth_unpin by 0x55cc94613b80 on [inode 0x1000000049b [2,head] /dc-dir/dc-file_678 auth v5358 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.900022+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94613b80] now 0 2023-10-03T19:21:21.325 INFO:teuthology.orchestra.run.smithi045.stdout: -5019> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+313 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94613b80 count now 1/313 2023-10-03T19:21:21.325 INFO:teuthology.orchestra.run.smithi045.stdout: -5018> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000049b) clear_dirty_parent 2023-10-03T19:21:21.325 INFO:teuthology.orchestra.run.smithi045.stdout: -5017> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000049c) _stored_backtrace v 3138 2023-10-03T19:21:21.325 INFO:teuthology.orchestra.run.smithi045.stdout: -5016> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000049c) auth_unpin by 0x55cc94614100 on [inode 0x1000000049c [2,head] /dc-dir/dc-file_679 auth v5360 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.911862+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94614100] now 0 2023-10-03T19:21:21.325 INFO:teuthology.orchestra.run.smithi045.stdout: -5015> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+312 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94614100 count now 1/312 2023-10-03T19:21:21.326 INFO:teuthology.orchestra.run.smithi045.stdout: -5014> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000049c) clear_dirty_parent 2023-10-03T19:21:21.326 INFO:teuthology.orchestra.run.smithi045.stdout: -5013> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000049d) _stored_backtrace v 3142 2023-10-03T19:21:21.326 INFO:teuthology.orchestra.run.smithi045.stdout: -5012> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000049d) auth_unpin by 0x55cc94614680 on [inode 0x1000000049d [2,head] /dc-dir/dc-file_680 auth v5362 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.924086+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94614680] now 0 2023-10-03T19:21:21.326 INFO:teuthology.orchestra.run.smithi045.stdout: -5011> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+311 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94614680 count now 1/311 2023-10-03T19:21:21.326 INFO:teuthology.orchestra.run.smithi045.stdout: -5010> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000049d) clear_dirty_parent 2023-10-03T19:21:21.326 INFO:teuthology.orchestra.run.smithi045.stdout: -5009> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000049e) _stored_backtrace v 3146 2023-10-03T19:21:21.326 INFO:teuthology.orchestra.run.smithi045.stdout: -5008> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000049e) auth_unpin by 0x55cc94614c00 on [inode 0x1000000049e [2,head] /dc-dir/dc-file_681 auth v5364 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.936013+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94614c00] now 0 2023-10-03T19:21:21.326 INFO:teuthology.orchestra.run.smithi045.stdout: -5007> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+310 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94614c00 count now 1/310 2023-10-03T19:21:21.326 INFO:teuthology.orchestra.run.smithi045.stdout: -5006> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000049e) clear_dirty_parent 2023-10-03T19:21:21.326 INFO:teuthology.orchestra.run.smithi045.stdout: -5005> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000049f) _stored_backtrace v 3150 2023-10-03T19:21:21.326 INFO:teuthology.orchestra.run.smithi045.stdout: -5004> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000049f) auth_unpin by 0x55cc94615180 on [inode 0x1000000049f [2,head] /dc-dir/dc-file_682 auth v5366 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.947591+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94615180] now 0 2023-10-03T19:21:21.327 INFO:teuthology.orchestra.run.smithi045.stdout: -5003> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+309 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94615180 count now 1/309 2023-10-03T19:21:21.327 INFO:teuthology.orchestra.run.smithi045.stdout: -5002> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000049f) clear_dirty_parent 2023-10-03T19:21:21.327 INFO:teuthology.orchestra.run.smithi045.stdout: -5001> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a0) _stored_backtrace v 3154 2023-10-03T19:21:21.327 INFO:teuthology.orchestra.run.smithi045.stdout: -5000> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a0) auth_unpin by 0x55cc94615700 on [inode 0x100000004a0 [2,head] /dc-dir/dc-file_683 auth v5368 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.959542+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94615700] now 0 2023-10-03T19:21:21.327 INFO:teuthology.orchestra.run.smithi045.stdout: -4999> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+308 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94615700 count now 1/308 2023-10-03T19:21:21.327 INFO:teuthology.orchestra.run.smithi045.stdout: -4998> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a0) clear_dirty_parent 2023-10-03T19:21:21.327 INFO:teuthology.orchestra.run.smithi045.stdout: -4997> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a1) _stored_backtrace v 3158 2023-10-03T19:21:21.327 INFO:teuthology.orchestra.run.smithi045.stdout: -4996> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a1) auth_unpin by 0x55cc9461a000 on [inode 0x100000004a1 [2,head] /dc-dir/dc-file_684 auth v5370 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.971994+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9461a000] now 0 2023-10-03T19:21:21.327 INFO:teuthology.orchestra.run.smithi045.stdout: -4995> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+307 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9461a000 count now 1/307 2023-10-03T19:21:21.327 INFO:teuthology.orchestra.run.smithi045.stdout: -4994> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a1) clear_dirty_parent 2023-10-03T19:21:21.327 INFO:teuthology.orchestra.run.smithi045.stdout: -4993> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a2) _stored_backtrace v 3162 2023-10-03T19:21:21.328 INFO:teuthology.orchestra.run.smithi045.stdout: -4992> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a2) auth_unpin by 0x55cc9461a580 on [inode 0x100000004a2 [2,head] /dc-dir/dc-file_685 auth v5372 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.984597+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9461a580] now 0 2023-10-03T19:21:21.328 INFO:teuthology.orchestra.run.smithi045.stdout: -4991> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+306 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9461a580 count now 1/306 2023-10-03T19:21:21.328 INFO:teuthology.orchestra.run.smithi045.stdout: -4990> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a2) clear_dirty_parent 2023-10-03T19:21:21.328 INFO:teuthology.orchestra.run.smithi045.stdout: -4989> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a3) _stored_backtrace v 3166 2023-10-03T19:21:21.328 INFO:teuthology.orchestra.run.smithi045.stdout: -4988> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a3) auth_unpin by 0x55cc9461ab00 on [inode 0x100000004a3 [2,head] /dc-dir/dc-file_686 auth v5374 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:53.997339+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9461ab00] now 0 2023-10-03T19:21:21.328 INFO:teuthology.orchestra.run.smithi045.stdout: -4987> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+305 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9461ab00 count now 1/305 2023-10-03T19:21:21.328 INFO:teuthology.orchestra.run.smithi045.stdout: -4986> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a3) clear_dirty_parent 2023-10-03T19:21:21.328 INFO:teuthology.orchestra.run.smithi045.stdout: -4985> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a4) _stored_backtrace v 3170 2023-10-03T19:21:21.328 INFO:teuthology.orchestra.run.smithi045.stdout: -4984> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a4) auth_unpin by 0x55cc9461b080 on [inode 0x100000004a4 [2,head] /dc-dir/dc-file_687 auth v5376 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.009142+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9461b080] now 0 2023-10-03T19:21:21.328 INFO:teuthology.orchestra.run.smithi045.stdout: -4983> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+304 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9461b080 count now 1/304 2023-10-03T19:21:21.329 INFO:teuthology.orchestra.run.smithi045.stdout: -4982> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a4) clear_dirty_parent 2023-10-03T19:21:21.329 INFO:teuthology.orchestra.run.smithi045.stdout: -4981> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a5) _stored_backtrace v 3174 2023-10-03T19:21:21.329 INFO:teuthology.orchestra.run.smithi045.stdout: -4980> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a5) auth_unpin by 0x55cc9461b600 on [inode 0x100000004a5 [2,head] /dc-dir/dc-file_688 auth v5378 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.020845+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9461b600] now 0 2023-10-03T19:21:21.329 INFO:teuthology.orchestra.run.smithi045.stdout: -4979> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+303 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9461b600 count now 1/303 2023-10-03T19:21:21.329 INFO:teuthology.orchestra.run.smithi045.stdout: -4978> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a5) clear_dirty_parent 2023-10-03T19:21:21.329 INFO:teuthology.orchestra.run.smithi045.stdout: -4977> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a6) _stored_backtrace v 3178 2023-10-03T19:21:21.329 INFO:teuthology.orchestra.run.smithi045.stdout: -4976> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a6) auth_unpin by 0x55cc9461bb80 on [inode 0x100000004a6 [2,head] /dc-dir/dc-file_689 auth v5380 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.032514+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9461bb80] now 0 2023-10-03T19:21:21.329 INFO:teuthology.orchestra.run.smithi045.stdout: -4975> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+302 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9461bb80 count now 1/302 2023-10-03T19:21:21.329 INFO:teuthology.orchestra.run.smithi045.stdout: -4974> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a6) clear_dirty_parent 2023-10-03T19:21:21.329 INFO:teuthology.orchestra.run.smithi045.stdout: -4973> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a7) _stored_backtrace v 3182 2023-10-03T19:21:21.329 INFO:teuthology.orchestra.run.smithi045.stdout: -4972> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a7) auth_unpin by 0x55cc9461c100 on [inode 0x100000004a7 [2,head] /dc-dir/dc-file_690 auth v5382 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.044237+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9461c100] now 0 2023-10-03T19:21:21.330 INFO:teuthology.orchestra.run.smithi045.stdout: -4971> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+301 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9461c100 count now 1/301 2023-10-03T19:21:21.330 INFO:teuthology.orchestra.run.smithi045.stdout: -4970> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a7) clear_dirty_parent 2023-10-03T19:21:21.330 INFO:teuthology.orchestra.run.smithi045.stdout: -4969> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a8) _stored_backtrace v 3186 2023-10-03T19:21:21.330 INFO:teuthology.orchestra.run.smithi045.stdout: -4968> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a8) auth_unpin by 0x55cc9461c680 on [inode 0x100000004a8 [2,head] /dc-dir/dc-file_691 auth v5384 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.056477+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9461c680] now 0 2023-10-03T19:21:21.330 INFO:teuthology.orchestra.run.smithi045.stdout: -4967> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+300 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9461c680 count now 1/300 2023-10-03T19:21:21.330 INFO:teuthology.orchestra.run.smithi045.stdout: -4966> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a8) clear_dirty_parent 2023-10-03T19:21:21.330 INFO:teuthology.orchestra.run.smithi045.stdout: -4965> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a9) _stored_backtrace v 3190 2023-10-03T19:21:21.330 INFO:teuthology.orchestra.run.smithi045.stdout: -4964> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a9) auth_unpin by 0x55cc9461cc00 on [inode 0x100000004a9 [2,head] /dc-dir/dc-file_692 auth v5386 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.068400+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9461cc00] now 0 2023-10-03T19:21:21.330 INFO:teuthology.orchestra.run.smithi045.stdout: -4963> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+299 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9461cc00 count now 1/299 2023-10-03T19:21:21.330 INFO:teuthology.orchestra.run.smithi045.stdout: -4962> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a9) clear_dirty_parent 2023-10-03T19:21:21.331 INFO:teuthology.orchestra.run.smithi045.stdout: -4961> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004aa) _stored_backtrace v 3194 2023-10-03T19:21:21.331 INFO:teuthology.orchestra.run.smithi045.stdout: -4960> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004aa) auth_unpin by 0x55cc9461d180 on [inode 0x100000004aa [2,head] /dc-dir/dc-file_693 auth v5388 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.081109+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9461d180] now 0 2023-10-03T19:21:21.331 INFO:teuthology.orchestra.run.smithi045.stdout: -4959> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+298 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9461d180 count now 1/298 2023-10-03T19:21:21.331 INFO:teuthology.orchestra.run.smithi045.stdout: -4958> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004aa) clear_dirty_parent 2023-10-03T19:21:21.331 INFO:teuthology.orchestra.run.smithi045.stdout: -4957> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ab) _stored_backtrace v 3374 2023-10-03T19:21:21.331 INFO:teuthology.orchestra.run.smithi045.stdout: -4956> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ab) auth_unpin by 0x55cc9461d700 on [inode 0x100000004ab [2,head] /dc-dir/dc-file_694 auth v5390 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.163080+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9461d700] now 0 2023-10-03T19:21:21.331 INFO:teuthology.orchestra.run.smithi045.stdout: -4955> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+297 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9461d700 count now 1/297 2023-10-03T19:21:21.331 INFO:teuthology.orchestra.run.smithi045.stdout: -4954> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ab) clear_dirty_parent 2023-10-03T19:21:21.331 INFO:teuthology.orchestra.run.smithi045.stdout: -4953> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ac) _stored_backtrace v 3378 2023-10-03T19:21:21.331 INFO:teuthology.orchestra.run.smithi045.stdout: -4952> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ac) auth_unpin by 0x55cc94640000 on [inode 0x100000004ac [2,head] /dc-dir/dc-file_695 auth v5392 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.208121+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94640000] now 0 2023-10-03T19:21:21.331 INFO:teuthology.orchestra.run.smithi045.stdout: -4951> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+296 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94640000 count now 1/296 2023-10-03T19:21:21.331 INFO:teuthology.orchestra.run.smithi045.stdout: -4950> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ac) clear_dirty_parent 2023-10-03T19:21:21.332 INFO:teuthology.orchestra.run.smithi045.stdout: -4949> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ad) _stored_backtrace v 3382 2023-10-03T19:21:21.332 INFO:teuthology.orchestra.run.smithi045.stdout: -4948> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ad) auth_unpin by 0x55cc94640580 on [inode 0x100000004ad [2,head] /dc-dir/dc-file_696 auth v5394 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.220249+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94640580] now 0 2023-10-03T19:21:21.332 INFO:teuthology.orchestra.run.smithi045.stdout: -4947> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+295 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94640580 count now 1/295 2023-10-03T19:21:21.332 INFO:teuthology.orchestra.run.smithi045.stdout: -4946> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ad) clear_dirty_parent 2023-10-03T19:21:21.332 INFO:teuthology.orchestra.run.smithi045.stdout: -4945> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ae) _stored_backtrace v 3386 2023-10-03T19:21:21.332 INFO:teuthology.orchestra.run.smithi045.stdout: -4944> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ae) auth_unpin by 0x55cc94640b00 on [inode 0x100000004ae [2,head] /dc-dir/dc-file_697 auth v5396 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.232131+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94640b00] now 0 2023-10-03T19:21:21.332 INFO:teuthology.orchestra.run.smithi045.stdout: -4943> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+294 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94640b00 count now 1/294 2023-10-03T19:21:21.332 INFO:teuthology.orchestra.run.smithi045.stdout: -4942> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ae) clear_dirty_parent 2023-10-03T19:21:21.332 INFO:teuthology.orchestra.run.smithi045.stdout: -4941> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004af) _stored_backtrace v 3390 2023-10-03T19:21:21.332 INFO:teuthology.orchestra.run.smithi045.stdout: -4940> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004af) auth_unpin by 0x55cc94641080 on [inode 0x100000004af [2,head] /dc-dir/dc-file_698 auth v5398 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.243761+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94641080] now 0 2023-10-03T19:21:21.332 INFO:teuthology.orchestra.run.smithi045.stdout: -4939> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+293 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94641080 count now 1/293 2023-10-03T19:21:21.333 INFO:teuthology.orchestra.run.smithi045.stdout: -4938> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004af) clear_dirty_parent 2023-10-03T19:21:21.333 INFO:teuthology.orchestra.run.smithi045.stdout: -4937> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b0) _stored_backtrace v 3394 2023-10-03T19:21:21.333 INFO:teuthology.orchestra.run.smithi045.stdout: -4936> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b0) auth_unpin by 0x55cc94641600 on [inode 0x100000004b0 [2,head] /dc-dir/dc-file_699 auth v5400 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.256017+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94641600] now 0 2023-10-03T19:21:21.333 INFO:teuthology.orchestra.run.smithi045.stdout: -4935> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+292 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94641600 count now 1/292 2023-10-03T19:21:21.333 INFO:teuthology.orchestra.run.smithi045.stdout: -4934> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b0) clear_dirty_parent 2023-10-03T19:21:21.333 INFO:teuthology.orchestra.run.smithi045.stdout: -4933> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b1) _stored_backtrace v 3398 2023-10-03T19:21:21.333 INFO:teuthology.orchestra.run.smithi045.stdout: -4932> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b1) auth_unpin by 0x55cc94641b80 on [inode 0x100000004b1 [2,head] /dc-dir/dc-file_700 auth v5402 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.268455+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94641b80] now 0 2023-10-03T19:21:21.333 INFO:teuthology.orchestra.run.smithi045.stdout: -4931> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+291 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94641b80 count now 1/291 2023-10-03T19:21:21.333 INFO:teuthology.orchestra.run.smithi045.stdout: -4930> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b1) clear_dirty_parent 2023-10-03T19:21:21.333 INFO:teuthology.orchestra.run.smithi045.stdout: -4929> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b2) _stored_backtrace v 3402 2023-10-03T19:21:21.333 INFO:teuthology.orchestra.run.smithi045.stdout: -4928> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b2) auth_unpin by 0x55cc94642100 on [inode 0x100000004b2 [2,head] /dc-dir/dc-file_701 auth v5404 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.280625+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94642100] now 0 2023-10-03T19:21:21.334 INFO:teuthology.orchestra.run.smithi045.stdout: -4927> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+290 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94642100 count now 1/290 2023-10-03T19:21:21.334 INFO:teuthology.orchestra.run.smithi045.stdout: -4926> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b2) clear_dirty_parent 2023-10-03T19:21:21.334 INFO:teuthology.orchestra.run.smithi045.stdout: -4925> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b3) _stored_backtrace v 3406 2023-10-03T19:21:21.334 INFO:teuthology.orchestra.run.smithi045.stdout: -4924> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b3) auth_unpin by 0x55cc94642680 on [inode 0x100000004b3 [2,head] /dc-dir/dc-file_702 auth v5406 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.292812+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94642680] now 0 2023-10-03T19:21:21.334 INFO:teuthology.orchestra.run.smithi045.stdout: -4923> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+289 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94642680 count now 1/289 2023-10-03T19:21:21.334 INFO:teuthology.orchestra.run.smithi045.stdout: -4922> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b3) clear_dirty_parent 2023-10-03T19:21:21.334 INFO:teuthology.orchestra.run.smithi045.stdout: -4921> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b4) _stored_backtrace v 3410 2023-10-03T19:21:21.334 INFO:teuthology.orchestra.run.smithi045.stdout: -4920> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b4) auth_unpin by 0x55cc94642c00 on [inode 0x100000004b4 [2,head] /dc-dir/dc-file_703 auth v5408 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.305228+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94642c00] now 0 2023-10-03T19:21:21.334 INFO:teuthology.orchestra.run.smithi045.stdout: -4919> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+288 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94642c00 count now 1/288 2023-10-03T19:21:21.334 INFO:teuthology.orchestra.run.smithi045.stdout: -4918> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b4) clear_dirty_parent 2023-10-03T19:21:21.334 INFO:teuthology.orchestra.run.smithi045.stdout: -4917> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b5) _stored_backtrace v 3414 2023-10-03T19:21:21.334 INFO:teuthology.orchestra.run.smithi045.stdout: -4916> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b5) auth_unpin by 0x55cc94643180 on [inode 0x100000004b5 [2,head] /dc-dir/dc-file_704 auth v5410 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.317069+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94643180] now 0 2023-10-03T19:21:21.335 INFO:teuthology.orchestra.run.smithi045.stdout: -4915> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+287 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94643180 count now 1/287 2023-10-03T19:21:21.335 INFO:teuthology.orchestra.run.smithi045.stdout: -4914> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b5) clear_dirty_parent 2023-10-03T19:21:21.335 INFO:teuthology.orchestra.run.smithi045.stdout: -4913> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b6) _stored_backtrace v 3418 2023-10-03T19:21:21.335 INFO:teuthology.orchestra.run.smithi045.stdout: -4912> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b6) auth_unpin by 0x55cc94643700 on [inode 0x100000004b6 [2,head] /dc-dir/dc-file_705 auth v5412 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.329554+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94643700] now 0 2023-10-03T19:21:21.335 INFO:teuthology.orchestra.run.smithi045.stdout: -4911> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+286 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94643700 count now 1/286 2023-10-03T19:21:21.335 INFO:teuthology.orchestra.run.smithi045.stdout: -4910> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b6) clear_dirty_parent 2023-10-03T19:21:21.335 INFO:teuthology.orchestra.run.smithi045.stdout: -4909> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b7) _stored_backtrace v 3422 2023-10-03T19:21:21.335 INFO:teuthology.orchestra.run.smithi045.stdout: -4908> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b7) auth_unpin by 0x55cc94648000 on [inode 0x100000004b7 [2,head] /dc-dir/dc-file_706 auth v5414 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.341686+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94648000] now 0 2023-10-03T19:21:21.335 INFO:teuthology.orchestra.run.smithi045.stdout: -4907> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+285 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94648000 count now 1/285 2023-10-03T19:21:21.335 INFO:teuthology.orchestra.run.smithi045.stdout: -4906> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b7) clear_dirty_parent 2023-10-03T19:21:21.335 INFO:teuthology.orchestra.run.smithi045.stdout: -4905> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b8) _stored_backtrace v 3426 2023-10-03T19:21:21.336 INFO:teuthology.orchestra.run.smithi045.stdout: -4904> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b8) auth_unpin by 0x55cc94648580 on [inode 0x100000004b8 [2,head] /dc-dir/dc-file_707 auth v5416 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.354348+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94648580] now 0 2023-10-03T19:21:21.336 INFO:teuthology.orchestra.run.smithi045.stdout: -4903> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+284 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94648580 count now 1/284 2023-10-03T19:21:21.336 INFO:teuthology.orchestra.run.smithi045.stdout: -4902> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b8) clear_dirty_parent 2023-10-03T19:21:21.336 INFO:teuthology.orchestra.run.smithi045.stdout: -4901> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b9) _stored_backtrace v 3430 2023-10-03T19:21:21.336 INFO:teuthology.orchestra.run.smithi045.stdout: -4900> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b9) auth_unpin by 0x55cc94648b00 on [inode 0x100000004b9 [2,head] /dc-dir/dc-file_708 auth v5418 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.367532+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94648b00] now 0 2023-10-03T19:21:21.336 INFO:teuthology.orchestra.run.smithi045.stdout: -4899> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+283 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94648b00 count now 1/283 2023-10-03T19:21:21.336 INFO:teuthology.orchestra.run.smithi045.stdout: -4898> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b9) clear_dirty_parent 2023-10-03T19:21:21.336 INFO:teuthology.orchestra.run.smithi045.stdout: -4897> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ba) _stored_backtrace v 3434 2023-10-03T19:21:21.336 INFO:teuthology.orchestra.run.smithi045.stdout: -4896> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ba) auth_unpin by 0x55cc94649080 on [inode 0x100000004ba [2,head] /dc-dir/dc-file_709 auth v5420 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.380687+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94649080] now 0 2023-10-03T19:21:21.336 INFO:teuthology.orchestra.run.smithi045.stdout: -4895> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+282 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94649080 count now 1/282 2023-10-03T19:21:21.336 INFO:teuthology.orchestra.run.smithi045.stdout: -4894> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ba) clear_dirty_parent 2023-10-03T19:21:21.337 INFO:teuthology.orchestra.run.smithi045.stdout: -4893> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004bb) _stored_backtrace v 3438 2023-10-03T19:21:21.337 INFO:teuthology.orchestra.run.smithi045.stdout: -4892> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004bb) auth_unpin by 0x55cc94649600 on [inode 0x100000004bb [2,head] /dc-dir/dc-file_710 auth v5422 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.393835+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94649600] now 0 2023-10-03T19:21:21.337 INFO:teuthology.orchestra.run.smithi045.stdout: -4891> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+281 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94649600 count now 1/281 2023-10-03T19:21:21.337 INFO:teuthology.orchestra.run.smithi045.stdout: -4890> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004bb) clear_dirty_parent 2023-10-03T19:21:21.337 INFO:teuthology.orchestra.run.smithi045.stdout: -4889> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004bc) _stored_backtrace v 3442 2023-10-03T19:21:21.337 INFO:teuthology.orchestra.run.smithi045.stdout: -4888> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004bc) auth_unpin by 0x55cc94649b80 on [inode 0x100000004bc [2,head] /dc-dir/dc-file_711 auth v5424 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.407554+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94649b80] now 0 2023-10-03T19:21:21.337 INFO:teuthology.orchestra.run.smithi045.stdout: -4887> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+280 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94649b80 count now 1/280 2023-10-03T19:21:21.337 INFO:teuthology.orchestra.run.smithi045.stdout: -4886> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004bc) clear_dirty_parent 2023-10-03T19:21:21.337 INFO:teuthology.orchestra.run.smithi045.stdout: -4885> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004bd) _stored_backtrace v 3446 2023-10-03T19:21:21.337 INFO:teuthology.orchestra.run.smithi045.stdout: -4884> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004bd) auth_unpin by 0x55cc9464a100 on [inode 0x100000004bd [2,head] /dc-dir/dc-file_712 auth v5426 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.420427+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9464a100] now 0 2023-10-03T19:21:21.337 INFO:teuthology.orchestra.run.smithi045.stdout: -4883> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+279 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9464a100 count now 1/279 2023-10-03T19:21:21.338 INFO:teuthology.orchestra.run.smithi045.stdout: -4882> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004bd) clear_dirty_parent 2023-10-03T19:21:21.338 INFO:teuthology.orchestra.run.smithi045.stdout: -4881> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004be) _stored_backtrace v 3450 2023-10-03T19:21:21.338 INFO:teuthology.orchestra.run.smithi045.stdout: -4880> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004be) auth_unpin by 0x55cc9464a680 on [inode 0x100000004be [2,head] /dc-dir/dc-file_713 auth v5428 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.432059+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9464a680] now 0 2023-10-03T19:21:21.338 INFO:teuthology.orchestra.run.smithi045.stdout: -4879> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+278 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9464a680 count now 1/278 2023-10-03T19:21:21.338 INFO:teuthology.orchestra.run.smithi045.stdout: -4878> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004be) clear_dirty_parent 2023-10-03T19:21:21.338 INFO:teuthology.orchestra.run.smithi045.stdout: -4877> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004bf) _stored_backtrace v 3454 2023-10-03T19:21:21.338 INFO:teuthology.orchestra.run.smithi045.stdout: -4876> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004bf) auth_unpin by 0x55cc9464ac00 on [inode 0x100000004bf [2,head] /dc-dir/dc-file_714 auth v5430 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.443559+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9464ac00] now 0 2023-10-03T19:21:21.338 INFO:teuthology.orchestra.run.smithi045.stdout: -4875> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+277 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9464ac00 count now 1/277 2023-10-03T19:21:21.338 INFO:teuthology.orchestra.run.smithi045.stdout: -4874> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004bf) clear_dirty_parent 2023-10-03T19:21:21.338 INFO:teuthology.orchestra.run.smithi045.stdout: -4873> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c0) _stored_backtrace v 3458 2023-10-03T19:21:21.338 INFO:teuthology.orchestra.run.smithi045.stdout: -4872> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c0) auth_unpin by 0x55cc9464b180 on [inode 0x100000004c0 [2,head] /dc-dir/dc-file_715 auth v5432 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.455698+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9464b180] now 0 2023-10-03T19:21:21.338 INFO:teuthology.orchestra.run.smithi045.stdout: -4871> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+276 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9464b180 count now 1/276 2023-10-03T19:21:21.339 INFO:teuthology.orchestra.run.smithi045.stdout: -4870> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c0) clear_dirty_parent 2023-10-03T19:21:21.339 INFO:teuthology.orchestra.run.smithi045.stdout: -4869> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c1) _stored_backtrace v 3462 2023-10-03T19:21:21.339 INFO:teuthology.orchestra.run.smithi045.stdout: -4868> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c1) auth_unpin by 0x55cc9464b700 on [inode 0x100000004c1 [2,head] /dc-dir/dc-file_716 auth v5434 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.467945+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9464b700] now 0 2023-10-03T19:21:21.339 INFO:teuthology.orchestra.run.smithi045.stdout: -4867> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+275 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9464b700 count now 1/275 2023-10-03T19:21:21.339 INFO:teuthology.orchestra.run.smithi045.stdout: -4866> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c1) clear_dirty_parent 2023-10-03T19:21:21.339 INFO:teuthology.orchestra.run.smithi045.stdout: -4865> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c2) _stored_backtrace v 3466 2023-10-03T19:21:21.339 INFO:teuthology.orchestra.run.smithi045.stdout: -4864> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c2) auth_unpin by 0x55cc94652000 on [inode 0x100000004c2 [2,head] /dc-dir/dc-file_717 auth v5436 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.480071+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94652000] now 0 2023-10-03T19:21:21.339 INFO:teuthology.orchestra.run.smithi045.stdout: -4863> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+274 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94652000 count now 1/274 2023-10-03T19:21:21.339 INFO:teuthology.orchestra.run.smithi045.stdout: -4862> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c2) clear_dirty_parent 2023-10-03T19:21:21.340 INFO:teuthology.orchestra.run.smithi045.stdout: -4861> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c3) _stored_backtrace v 3470 2023-10-03T19:21:21.340 INFO:teuthology.orchestra.run.smithi045.stdout: -4860> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c3) auth_unpin by 0x55cc94652580 on [inode 0x100000004c3 [2,head] /dc-dir/dc-file_718 auth v5438 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.492279+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94652580] now 0 2023-10-03T19:21:21.340 INFO:teuthology.orchestra.run.smithi045.stdout: -4859> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+273 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94652580 count now 1/273 2023-10-03T19:21:21.340 INFO:teuthology.orchestra.run.smithi045.stdout: -4858> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c3) clear_dirty_parent 2023-10-03T19:21:21.340 INFO:teuthology.orchestra.run.smithi045.stdout: -4857> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c4) _stored_backtrace v 3474 2023-10-03T19:21:21.340 INFO:teuthology.orchestra.run.smithi045.stdout: -4856> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c4) auth_unpin by 0x55cc94652b00 on [inode 0x100000004c4 [2,head] /dc-dir/dc-file_719 auth v5440 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.504605+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94652b00] now 0 2023-10-03T19:21:21.340 INFO:teuthology.orchestra.run.smithi045.stdout: -4855> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+272 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94652b00 count now 1/272 2023-10-03T19:21:21.340 INFO:teuthology.orchestra.run.smithi045.stdout: -4854> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c4) clear_dirty_parent 2023-10-03T19:21:21.340 INFO:teuthology.orchestra.run.smithi045.stdout: -4853> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c5) _stored_backtrace v 3478 2023-10-03T19:21:21.340 INFO:teuthology.orchestra.run.smithi045.stdout: -4852> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c5) auth_unpin by 0x55cc94653080 on [inode 0x100000004c5 [2,head] /dc-dir/dc-file_720 auth v5442 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.516950+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94653080] now 0 2023-10-03T19:21:21.340 INFO:teuthology.orchestra.run.smithi045.stdout: -4851> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+271 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94653080 count now 1/271 2023-10-03T19:21:21.340 INFO:teuthology.orchestra.run.smithi045.stdout: -4850> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c5) clear_dirty_parent 2023-10-03T19:21:21.341 INFO:teuthology.orchestra.run.smithi045.stdout: -4849> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c6) _stored_backtrace v 3482 2023-10-03T19:21:21.341 INFO:teuthology.orchestra.run.smithi045.stdout: -4848> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c6) auth_unpin by 0x55cc94653600 on [inode 0x100000004c6 [2,head] /dc-dir/dc-file_721 auth v5444 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.528810+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94653600] now 0 2023-10-03T19:21:21.341 INFO:teuthology.orchestra.run.smithi045.stdout: -4847> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+270 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94653600 count now 1/270 2023-10-03T19:21:21.341 INFO:teuthology.orchestra.run.smithi045.stdout: -4846> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c6) clear_dirty_parent 2023-10-03T19:21:21.341 INFO:teuthology.orchestra.run.smithi045.stdout: -4845> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c7) _stored_backtrace v 3486 2023-10-03T19:21:21.341 INFO:teuthology.orchestra.run.smithi045.stdout: -4844> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c7) auth_unpin by 0x55cc94653b80 on [inode 0x100000004c7 [2,head] /dc-dir/dc-file_722 auth v5446 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.540938+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94653b80] now 0 2023-10-03T19:21:21.341 INFO:teuthology.orchestra.run.smithi045.stdout: -4843> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+269 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94653b80 count now 1/269 2023-10-03T19:21:21.341 INFO:teuthology.orchestra.run.smithi045.stdout: -4842> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c7) clear_dirty_parent 2023-10-03T19:21:21.341 INFO:teuthology.orchestra.run.smithi045.stdout: -4841> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c8) _stored_backtrace v 3490 2023-10-03T19:21:21.341 INFO:teuthology.orchestra.run.smithi045.stdout: -4840> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c8) auth_unpin by 0x55cc94654100 on [inode 0x100000004c8 [2,head] /dc-dir/dc-file_723 auth v5448 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.552452+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94654100] now 0 2023-10-03T19:21:21.341 INFO:teuthology.orchestra.run.smithi045.stdout: -4839> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+268 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94654100 count now 1/268 2023-10-03T19:21:21.341 INFO:teuthology.orchestra.run.smithi045.stdout: -4838> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c8) clear_dirty_parent 2023-10-03T19:21:21.342 INFO:teuthology.orchestra.run.smithi045.stdout: -4837> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c9) _stored_backtrace v 3494 2023-10-03T19:21:21.342 INFO:teuthology.orchestra.run.smithi045.stdout: -4836> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c9) auth_unpin by 0x55cc94654680 on [inode 0x100000004c9 [2,head] /dc-dir/dc-file_724 auth v5450 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.565114+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94654680] now 0 2023-10-03T19:21:21.342 INFO:teuthology.orchestra.run.smithi045.stdout: -4835> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+267 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94654680 count now 1/267 2023-10-03T19:21:21.342 INFO:teuthology.orchestra.run.smithi045.stdout: -4834> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c9) clear_dirty_parent 2023-10-03T19:21:21.342 INFO:teuthology.orchestra.run.smithi045.stdout: -4833> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ca) _stored_backtrace v 3498 2023-10-03T19:21:21.342 INFO:teuthology.orchestra.run.smithi045.stdout: -4832> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ca) auth_unpin by 0x55cc94654c00 on [inode 0x100000004ca [2,head] /dc-dir/dc-file_725 auth v5452 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.576945+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94654c00] now 0 2023-10-03T19:21:21.342 INFO:teuthology.orchestra.run.smithi045.stdout: -4831> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+266 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94654c00 count now 1/266 2023-10-03T19:21:21.342 INFO:teuthology.orchestra.run.smithi045.stdout: -4830> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ca) clear_dirty_parent 2023-10-03T19:21:21.342 INFO:teuthology.orchestra.run.smithi045.stdout: -4829> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004cb) _stored_backtrace v 3502 2023-10-03T19:21:21.342 INFO:teuthology.orchestra.run.smithi045.stdout: -4828> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004cb) auth_unpin by 0x55cc94655180 on [inode 0x100000004cb [2,head] /dc-dir/dc-file_726 auth v5454 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.589297+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94655180] now 0 2023-10-03T19:21:21.343 INFO:teuthology.orchestra.run.smithi045.stdout: -4827> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+265 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94655180 count now 1/265 2023-10-03T19:21:21.343 INFO:teuthology.orchestra.run.smithi045.stdout: -4826> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004cb) clear_dirty_parent 2023-10-03T19:21:21.343 INFO:teuthology.orchestra.run.smithi045.stdout: -4825> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004cc) _stored_backtrace v 3506 2023-10-03T19:21:21.343 INFO:teuthology.orchestra.run.smithi045.stdout: -4824> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004cc) auth_unpin by 0x55cc94655700 on [inode 0x100000004cc [2,head] /dc-dir/dc-file_727 auth v5456 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.601256+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94655700] now 0 2023-10-03T19:21:21.343 INFO:teuthology.orchestra.run.smithi045.stdout: -4823> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+264 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94655700 count now 1/264 2023-10-03T19:21:21.343 INFO:teuthology.orchestra.run.smithi045.stdout: -4822> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004cc) clear_dirty_parent 2023-10-03T19:21:21.343 INFO:teuthology.orchestra.run.smithi045.stdout: -4821> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004cd) _stored_backtrace v 3510 2023-10-03T19:21:21.343 INFO:teuthology.orchestra.run.smithi045.stdout: -4820> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004cd) auth_unpin by 0x55cc9465e000 on [inode 0x100000004cd [2,head] /dc-dir/dc-file_728 auth v5458 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.613299+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9465e000] now 0 2023-10-03T19:21:21.343 INFO:teuthology.orchestra.run.smithi045.stdout: -4819> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+263 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9465e000 count now 1/263 2023-10-03T19:21:21.343 INFO:teuthology.orchestra.run.smithi045.stdout: -4818> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004cd) clear_dirty_parent 2023-10-03T19:21:21.343 INFO:teuthology.orchestra.run.smithi045.stdout: -4817> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ce) _stored_backtrace v 3514 2023-10-03T19:21:21.343 INFO:teuthology.orchestra.run.smithi045.stdout: -4816> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ce) auth_unpin by 0x55cc9465e580 on [inode 0x100000004ce [2,head] /dc-dir/dc-file_729 auth v5460 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.625847+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9465e580] now 0 2023-10-03T19:21:21.344 INFO:teuthology.orchestra.run.smithi045.stdout: -4815> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+262 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9465e580 count now 1/262 2023-10-03T19:21:21.344 INFO:teuthology.orchestra.run.smithi045.stdout: -4814> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ce) clear_dirty_parent 2023-10-03T19:21:21.344 INFO:teuthology.orchestra.run.smithi045.stdout: -4813> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004cf) _stored_backtrace v 3518 2023-10-03T19:21:21.344 INFO:teuthology.orchestra.run.smithi045.stdout: -4812> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004cf) auth_unpin by 0x55cc9465eb00 on [inode 0x100000004cf [2,head] /dc-dir/dc-file_730 auth v5462 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.638100+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9465eb00] now 0 2023-10-03T19:21:21.344 INFO:teuthology.orchestra.run.smithi045.stdout: -4811> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+261 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9465eb00 count now 1/261 2023-10-03T19:21:21.344 INFO:teuthology.orchestra.run.smithi045.stdout: -4810> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004cf) clear_dirty_parent 2023-10-03T19:21:21.344 INFO:teuthology.orchestra.run.smithi045.stdout: -4809> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d0) _stored_backtrace v 3522 2023-10-03T19:21:21.344 INFO:teuthology.orchestra.run.smithi045.stdout: -4808> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d0) auth_unpin by 0x55cc9465f080 on [inode 0x100000004d0 [2,head] /dc-dir/dc-file_731 auth v5464 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.651841+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9465f080] now 0 2023-10-03T19:21:21.344 INFO:teuthology.orchestra.run.smithi045.stdout: -4807> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+260 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9465f080 count now 1/260 2023-10-03T19:21:21.344 INFO:teuthology.orchestra.run.smithi045.stdout: -4806> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d0) clear_dirty_parent 2023-10-03T19:21:21.344 INFO:teuthology.orchestra.run.smithi045.stdout: -4805> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d1) _stored_backtrace v 3526 2023-10-03T19:21:21.345 INFO:teuthology.orchestra.run.smithi045.stdout: -4804> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d1) auth_unpin by 0x55cc9465f600 on [inode 0x100000004d1 [2,head] /dc-dir/dc-file_732 auth v5466 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.663894+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9465f600] now 0 2023-10-03T19:21:21.345 INFO:teuthology.orchestra.run.smithi045.stdout: -4803> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+259 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9465f600 count now 1/259 2023-10-03T19:21:21.345 INFO:teuthology.orchestra.run.smithi045.stdout: -4802> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d1) clear_dirty_parent 2023-10-03T19:21:21.345 INFO:teuthology.orchestra.run.smithi045.stdout: -4801> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d2) _stored_backtrace v 3530 2023-10-03T19:21:21.345 INFO:teuthology.orchestra.run.smithi045.stdout: -4800> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d2) auth_unpin by 0x55cc9465fb80 on [inode 0x100000004d2 [2,head] /dc-dir/dc-file_733 auth v5468 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.677454+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9465fb80] now 0 2023-10-03T19:21:21.345 INFO:teuthology.orchestra.run.smithi045.stdout: -4799> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+258 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9465fb80 count now 1/258 2023-10-03T19:21:21.345 INFO:teuthology.orchestra.run.smithi045.stdout: -4798> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d2) clear_dirty_parent 2023-10-03T19:21:21.345 INFO:teuthology.orchestra.run.smithi045.stdout: -4797> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d3) _stored_backtrace v 3534 2023-10-03T19:21:21.345 INFO:teuthology.orchestra.run.smithi045.stdout: -4796> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d3) auth_unpin by 0x55cc94660100 on [inode 0x100000004d3 [2,head] /dc-dir/dc-file_734 auth v5470 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.692125+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94660100] now 0 2023-10-03T19:21:21.345 INFO:teuthology.orchestra.run.smithi045.stdout: -4795> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+257 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94660100 count now 1/257 2023-10-03T19:21:21.345 INFO:teuthology.orchestra.run.smithi045.stdout: -4794> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d3) clear_dirty_parent 2023-10-03T19:21:21.346 INFO:teuthology.orchestra.run.smithi045.stdout: -4793> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d4) _stored_backtrace v 3538 2023-10-03T19:21:21.346 INFO:teuthology.orchestra.run.smithi045.stdout: -4792> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d4) auth_unpin by 0x55cc94660680 on [inode 0x100000004d4 [2,head] /dc-dir/dc-file_735 auth v5472 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.707587+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94660680] now 0 2023-10-03T19:21:21.346 INFO:teuthology.orchestra.run.smithi045.stdout: -4791> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+256 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94660680 count now 1/256 2023-10-03T19:21:21.346 INFO:teuthology.orchestra.run.smithi045.stdout: -4790> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d4) clear_dirty_parent 2023-10-03T19:21:21.346 INFO:teuthology.orchestra.run.smithi045.stdout: -4789> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d5) _stored_backtrace v 3542 2023-10-03T19:21:21.346 INFO:teuthology.orchestra.run.smithi045.stdout: -4788> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d5) auth_unpin by 0x55cc94660c00 on [inode 0x100000004d5 [2,head] /dc-dir/dc-file_736 auth v5474 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.722599+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94660c00] now 0 2023-10-03T19:21:21.346 INFO:teuthology.orchestra.run.smithi045.stdout: -4787> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+255 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94660c00 count now 1/255 2023-10-03T19:21:21.346 INFO:teuthology.orchestra.run.smithi045.stdout: -4786> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d5) clear_dirty_parent 2023-10-03T19:21:21.346 INFO:teuthology.orchestra.run.smithi045.stdout: -4785> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d6) _stored_backtrace v 3546 2023-10-03T19:21:21.346 INFO:teuthology.orchestra.run.smithi045.stdout: -4784> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d6) auth_unpin by 0x55cc94661180 on [inode 0x100000004d6 [2,head] /dc-dir/dc-file_737 auth v5476 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.736554+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94661180] now 0 2023-10-03T19:21:21.346 INFO:teuthology.orchestra.run.smithi045.stdout: -4783> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+254 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94661180 count now 1/254 2023-10-03T19:21:21.347 INFO:teuthology.orchestra.run.smithi045.stdout: -4782> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d6) clear_dirty_parent 2023-10-03T19:21:21.347 INFO:teuthology.orchestra.run.smithi045.stdout: -4781> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d7) _stored_backtrace v 3550 2023-10-03T19:21:21.347 INFO:teuthology.orchestra.run.smithi045.stdout: -4780> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d7) auth_unpin by 0x55cc94661700 on [inode 0x100000004d7 [2,head] /dc-dir/dc-file_738 auth v5478 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.749180+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94661700] now 0 2023-10-03T19:21:21.347 INFO:teuthology.orchestra.run.smithi045.stdout: -4779> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+253 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94661700 count now 1/253 2023-10-03T19:21:21.347 INFO:teuthology.orchestra.run.smithi045.stdout: -4778> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d7) clear_dirty_parent 2023-10-03T19:21:21.347 INFO:teuthology.orchestra.run.smithi045.stdout: -4777> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d8) _stored_backtrace v 3554 2023-10-03T19:21:21.347 INFO:teuthology.orchestra.run.smithi045.stdout: -4776> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d8) auth_unpin by 0x55cc94668000 on [inode 0x100000004d8 [2,head] /dc-dir/dc-file_739 auth v5480 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.761549+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94668000] now 0 2023-10-03T19:21:21.347 INFO:teuthology.orchestra.run.smithi045.stdout: -4775> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+252 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94668000 count now 1/252 2023-10-03T19:21:21.347 INFO:teuthology.orchestra.run.smithi045.stdout: -4774> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d8) clear_dirty_parent 2023-10-03T19:21:21.347 INFO:teuthology.orchestra.run.smithi045.stdout: -4773> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d9) _stored_backtrace v 3558 2023-10-03T19:21:21.347 INFO:teuthology.orchestra.run.smithi045.stdout: -4772> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d9) auth_unpin by 0x55cc94668580 on [inode 0x100000004d9 [2,head] /dc-dir/dc-file_740 auth v5482 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.773481+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94668580] now 0 2023-10-03T19:21:21.348 INFO:teuthology.orchestra.run.smithi045.stdout: -4771> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+251 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94668580 count now 1/251 2023-10-03T19:21:21.348 INFO:teuthology.orchestra.run.smithi045.stdout: -4770> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d9) clear_dirty_parent 2023-10-03T19:21:21.348 INFO:teuthology.orchestra.run.smithi045.stdout: -4769> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004da) _stored_backtrace v 3562 2023-10-03T19:21:21.348 INFO:teuthology.orchestra.run.smithi045.stdout: -4768> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004da) auth_unpin by 0x55cc94668b00 on [inode 0x100000004da [2,head] /dc-dir/dc-file_741 auth v5484 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.785349+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94668b00] now 0 2023-10-03T19:21:21.348 INFO:teuthology.orchestra.run.smithi045.stdout: -4767> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+250 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94668b00 count now 1/250 2023-10-03T19:21:21.350 INFO:teuthology.orchestra.run.smithi045.stdout: -4766> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004da) clear_dirty_parent 2023-10-03T19:21:21.350 INFO:teuthology.orchestra.run.smithi045.stdout: -4765> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004db) _stored_backtrace v 3566 2023-10-03T19:21:21.350 INFO:teuthology.orchestra.run.smithi045.stdout: -4764> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004db) auth_unpin by 0x55cc94669080 on [inode 0x100000004db [2,head] /dc-dir/dc-file_742 auth v5486 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.796787+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94669080] now 0 2023-10-03T19:21:21.350 INFO:teuthology.orchestra.run.smithi045.stdout: -4763> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+249 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94669080 count now 1/249 2023-10-03T19:21:21.350 INFO:teuthology.orchestra.run.smithi045.stdout: -4762> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004db) clear_dirty_parent 2023-10-03T19:21:21.350 INFO:teuthology.orchestra.run.smithi045.stdout: -4761> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004dc) _stored_backtrace v 3570 2023-10-03T19:21:21.350 INFO:teuthology.orchestra.run.smithi045.stdout: -4760> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004dc) auth_unpin by 0x55cc94669600 on [inode 0x100000004dc [2,head] /dc-dir/dc-file_743 auth v5488 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.808389+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94669600] now 0 2023-10-03T19:21:21.351 INFO:teuthology.orchestra.run.smithi045.stdout: -4759> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+248 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94669600 count now 1/248 2023-10-03T19:21:21.351 INFO:teuthology.orchestra.run.smithi045.stdout: -4758> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004dc) clear_dirty_parent 2023-10-03T19:21:21.351 INFO:teuthology.orchestra.run.smithi045.stdout: -4757> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004dd) _stored_backtrace v 3574 2023-10-03T19:21:21.351 INFO:teuthology.orchestra.run.smithi045.stdout: -4756> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004dd) auth_unpin by 0x55cc94669b80 on [inode 0x100000004dd [2,head] /dc-dir/dc-file_744 auth v5490 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.821111+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94669b80] now 0 2023-10-03T19:21:21.351 INFO:teuthology.orchestra.run.smithi045.stdout: -4755> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+247 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94669b80 count now 1/247 2023-10-03T19:21:21.351 INFO:teuthology.orchestra.run.smithi045.stdout: -4754> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004dd) clear_dirty_parent 2023-10-03T19:21:21.351 INFO:teuthology.orchestra.run.smithi045.stdout: -4753> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004de) _stored_backtrace v 3578 2023-10-03T19:21:21.351 INFO:teuthology.orchestra.run.smithi045.stdout: -4752> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004de) auth_unpin by 0x55cc9466a100 on [inode 0x100000004de [2,head] /dc-dir/dc-file_745 auth v5492 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.834341+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9466a100] now 0 2023-10-03T19:21:21.351 INFO:teuthology.orchestra.run.smithi045.stdout: -4751> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+246 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9466a100 count now 1/246 2023-10-03T19:21:21.351 INFO:teuthology.orchestra.run.smithi045.stdout: -4750> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004de) clear_dirty_parent 2023-10-03T19:21:21.351 INFO:teuthology.orchestra.run.smithi045.stdout: -4749> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004df) _stored_backtrace v 3582 2023-10-03T19:21:21.352 INFO:teuthology.orchestra.run.smithi045.stdout: -4748> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004df) auth_unpin by 0x55cc9466a680 on [inode 0x100000004df [2,head] /dc-dir/dc-file_746 auth v5494 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.846793+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9466a680] now 0 2023-10-03T19:21:21.352 INFO:teuthology.orchestra.run.smithi045.stdout: -4747> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+245 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9466a680 count now 1/245 2023-10-03T19:21:21.352 INFO:teuthology.orchestra.run.smithi045.stdout: -4746> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004df) clear_dirty_parent 2023-10-03T19:21:21.352 INFO:teuthology.orchestra.run.smithi045.stdout: -4745> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e0) _stored_backtrace v 3586 2023-10-03T19:21:21.352 INFO:teuthology.orchestra.run.smithi045.stdout: -4744> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e0) auth_unpin by 0x55cc9466ac00 on [inode 0x100000004e0 [2,head] /dc-dir/dc-file_747 auth v5496 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.860603+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9466ac00] now 0 2023-10-03T19:21:21.352 INFO:teuthology.orchestra.run.smithi045.stdout: -4743> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+244 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9466ac00 count now 1/244 2023-10-03T19:21:21.352 INFO:teuthology.orchestra.run.smithi045.stdout: -4742> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e0) clear_dirty_parent 2023-10-03T19:21:21.352 INFO:teuthology.orchestra.run.smithi045.stdout: -4741> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e1) _stored_backtrace v 3590 2023-10-03T19:21:21.352 INFO:teuthology.orchestra.run.smithi045.stdout: -4740> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e1) auth_unpin by 0x55cc9466b180 on [inode 0x100000004e1 [2,head] /dc-dir/dc-file_748 auth v5498 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.874727+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9466b180] now 0 2023-10-03T19:21:21.353 INFO:teuthology.orchestra.run.smithi045.stdout: -4739> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+243 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9466b180 count now 1/243 2023-10-03T19:21:21.353 INFO:teuthology.orchestra.run.smithi045.stdout: -4738> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e1) clear_dirty_parent 2023-10-03T19:21:21.353 INFO:teuthology.orchestra.run.smithi045.stdout: -4737> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e2) _stored_backtrace v 3594 2023-10-03T19:21:21.353 INFO:teuthology.orchestra.run.smithi045.stdout: -4736> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e2) auth_unpin by 0x55cc9466b700 on [inode 0x100000004e2 [2,head] /dc-dir/dc-file_749 auth v5500 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.887595+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9466b700] now 0 2023-10-03T19:21:21.353 INFO:teuthology.orchestra.run.smithi045.stdout: -4735> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+242 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9466b700 count now 1/242 2023-10-03T19:21:21.353 INFO:teuthology.orchestra.run.smithi045.stdout: -4734> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e2) clear_dirty_parent 2023-10-03T19:21:21.353 INFO:teuthology.orchestra.run.smithi045.stdout: -4733> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e3) _stored_backtrace v 3598 2023-10-03T19:21:21.353 INFO:teuthology.orchestra.run.smithi045.stdout: -4732> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e3) auth_unpin by 0x55cc94672000 on [inode 0x100000004e3 [2,head] /dc-dir/dc-file_750 auth v5502 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.900057+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94672000] now 0 2023-10-03T19:21:21.353 INFO:teuthology.orchestra.run.smithi045.stdout: -4731> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+241 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94672000 count now 1/241 2023-10-03T19:21:21.353 INFO:teuthology.orchestra.run.smithi045.stdout: -4730> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e3) clear_dirty_parent 2023-10-03T19:21:21.353 INFO:teuthology.orchestra.run.smithi045.stdout: -4729> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e4) _stored_backtrace v 3602 2023-10-03T19:21:21.353 INFO:teuthology.orchestra.run.smithi045.stdout: -4728> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e4) auth_unpin by 0x55cc94672580 on [inode 0x100000004e4 [2,head] /dc-dir/dc-file_751 auth v5504 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.913061+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94672580] now 0 2023-10-03T19:21:21.354 INFO:teuthology.orchestra.run.smithi045.stdout: -4727> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+240 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94672580 count now 1/240 2023-10-03T19:21:21.354 INFO:teuthology.orchestra.run.smithi045.stdout: -4726> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e4) clear_dirty_parent 2023-10-03T19:21:21.354 INFO:teuthology.orchestra.run.smithi045.stdout: -4725> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e5) _stored_backtrace v 3606 2023-10-03T19:21:21.354 INFO:teuthology.orchestra.run.smithi045.stdout: -4724> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e5) auth_unpin by 0x55cc94672b00 on [inode 0x100000004e5 [2,head] /dc-dir/dc-file_752 auth v5506 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.925536+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94672b00] now 0 2023-10-03T19:21:21.354 INFO:teuthology.orchestra.run.smithi045.stdout: -4723> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+239 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94672b00 count now 1/239 2023-10-03T19:21:21.354 INFO:teuthology.orchestra.run.smithi045.stdout: -4722> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e5) clear_dirty_parent 2023-10-03T19:21:21.354 INFO:teuthology.orchestra.run.smithi045.stdout: -4721> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e6) _stored_backtrace v 3610 2023-10-03T19:21:21.354 INFO:teuthology.orchestra.run.smithi045.stdout: -4720> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e6) auth_unpin by 0x55cc94673080 on [inode 0x100000004e6 [2,head] /dc-dir/dc-file_753 auth v5508 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.937837+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94673080] now 0 2023-10-03T19:21:21.354 INFO:teuthology.orchestra.run.smithi045.stdout: -4719> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+238 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94673080 count now 1/238 2023-10-03T19:21:21.354 INFO:teuthology.orchestra.run.smithi045.stdout: -4718> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e6) clear_dirty_parent 2023-10-03T19:21:21.354 INFO:teuthology.orchestra.run.smithi045.stdout: -4717> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e7) _stored_backtrace v 3614 2023-10-03T19:21:21.355 INFO:teuthology.orchestra.run.smithi045.stdout: -4716> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e7) auth_unpin by 0x55cc94673600 on [inode 0x100000004e7 [2,head] /dc-dir/dc-file_754 auth v5510 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.950324+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94673600] now 0 2023-10-03T19:21:21.355 INFO:teuthology.orchestra.run.smithi045.stdout: -4715> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+237 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94673600 count now 1/237 2023-10-03T19:21:21.355 INFO:teuthology.orchestra.run.smithi045.stdout: -4714> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e7) clear_dirty_parent 2023-10-03T19:21:21.355 INFO:teuthology.orchestra.run.smithi045.stdout: -4713> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e8) _stored_backtrace v 3618 2023-10-03T19:21:21.355 INFO:teuthology.orchestra.run.smithi045.stdout: -4712> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e8) auth_unpin by 0x55cc94673b80 on [inode 0x100000004e8 [2,head] /dc-dir/dc-file_755 auth v5512 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.962865+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94673b80] now 0 2023-10-03T19:21:21.355 INFO:teuthology.orchestra.run.smithi045.stdout: -4711> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+236 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94673b80 count now 1/236 2023-10-03T19:21:21.355 INFO:teuthology.orchestra.run.smithi045.stdout: -4710> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e8) clear_dirty_parent 2023-10-03T19:21:21.355 INFO:teuthology.orchestra.run.smithi045.stdout: -4709> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e9) _stored_backtrace v 3622 2023-10-03T19:21:21.355 INFO:teuthology.orchestra.run.smithi045.stdout: -4708> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e9) auth_unpin by 0x55cc94674100 on [inode 0x100000004e9 [2,head] /dc-dir/dc-file_756 auth v5514 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.974478+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94674100] now 0 2023-10-03T19:21:21.355 INFO:teuthology.orchestra.run.smithi045.stdout: -4707> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+235 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94674100 count now 1/235 2023-10-03T19:21:21.356 INFO:teuthology.orchestra.run.smithi045.stdout: -4706> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e9) clear_dirty_parent 2023-10-03T19:21:21.356 INFO:teuthology.orchestra.run.smithi045.stdout: -4705> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ea) _stored_backtrace v 3626 2023-10-03T19:21:21.356 INFO:teuthology.orchestra.run.smithi045.stdout: -4704> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ea) auth_unpin by 0x55cc94674680 on [inode 0x100000004ea [2,head] /dc-dir/dc-file_757 auth v5516 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.985985+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94674680] now 0 2023-10-03T19:21:21.356 INFO:teuthology.orchestra.run.smithi045.stdout: -4703> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+234 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94674680 count now 1/234 2023-10-03T19:21:21.356 INFO:teuthology.orchestra.run.smithi045.stdout: -4702> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ea) clear_dirty_parent 2023-10-03T19:21:21.356 INFO:teuthology.orchestra.run.smithi045.stdout: -4701> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004eb) _stored_backtrace v 3630 2023-10-03T19:21:21.356 INFO:teuthology.orchestra.run.smithi045.stdout: -4700> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004eb) auth_unpin by 0x55cc94674c00 on [inode 0x100000004eb [2,head] /dc-dir/dc-file_758 auth v5518 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:54.999529+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94674c00] now 0 2023-10-03T19:21:21.356 INFO:teuthology.orchestra.run.smithi045.stdout: -4699> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+233 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94674c00 count now 1/233 2023-10-03T19:21:21.356 INFO:teuthology.orchestra.run.smithi045.stdout: -4698> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004eb) clear_dirty_parent 2023-10-03T19:21:21.356 INFO:teuthology.orchestra.run.smithi045.stdout: -4697> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ec) _stored_backtrace v 3634 2023-10-03T19:21:21.356 INFO:teuthology.orchestra.run.smithi045.stdout: -4696> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ec) auth_unpin by 0x55cc94675180 on [inode 0x100000004ec [2,head] /dc-dir/dc-file_759 auth v5520 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.011926+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94675180] now 0 2023-10-03T19:21:21.357 INFO:teuthology.orchestra.run.smithi045.stdout: -4695> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+232 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94675180 count now 1/232 2023-10-03T19:21:21.357 INFO:teuthology.orchestra.run.smithi045.stdout: -4694> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ec) clear_dirty_parent 2023-10-03T19:21:21.357 INFO:teuthology.orchestra.run.smithi045.stdout: -4693> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ed) _stored_backtrace v 3638 2023-10-03T19:21:21.357 INFO:teuthology.orchestra.run.smithi045.stdout: -4692> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ed) auth_unpin by 0x55cc94675700 on [inode 0x100000004ed [2,head] /dc-dir/dc-file_760 auth v5522 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.024656+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94675700] now 0 2023-10-03T19:21:21.357 INFO:teuthology.orchestra.run.smithi045.stdout: -4691> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+231 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94675700 count now 1/231 2023-10-03T19:21:21.357 INFO:teuthology.orchestra.run.smithi045.stdout: -4690> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ed) clear_dirty_parent 2023-10-03T19:21:21.357 INFO:teuthology.orchestra.run.smithi045.stdout: -4689> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ee) _stored_backtrace v 3642 2023-10-03T19:21:21.357 INFO:teuthology.orchestra.run.smithi045.stdout: -4688> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ee) auth_unpin by 0x55cc946f4000 on [inode 0x100000004ee [2,head] /dc-dir/dc-file_761 auth v5524 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.036181+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946f4000] now 0 2023-10-03T19:21:21.357 INFO:teuthology.orchestra.run.smithi045.stdout: -4687> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+230 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946f4000 count now 1/230 2023-10-03T19:21:21.357 INFO:teuthology.orchestra.run.smithi045.stdout: -4686> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ee) clear_dirty_parent 2023-10-03T19:21:21.357 INFO:teuthology.orchestra.run.smithi045.stdout: -4685> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ef) _stored_backtrace v 3646 2023-10-03T19:21:21.357 INFO:teuthology.orchestra.run.smithi045.stdout: -4684> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ef) auth_unpin by 0x55cc946f4580 on [inode 0x100000004ef [2,head] /dc-dir/dc-file_762 auth v5526 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.048073+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946f4580] now 0 2023-10-03T19:21:21.358 INFO:teuthology.orchestra.run.smithi045.stdout: -4683> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+229 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946f4580 count now 1/229 2023-10-03T19:21:21.468 INFO:teuthology.orchestra.run.smithi045.stdout: -4682> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ef) clear_dirty_parent 2023-10-03T19:21:21.468 INFO:teuthology.orchestra.run.smithi045.stdout: -4681> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f0) _stored_backtrace v 3650 2023-10-03T19:21:21.468 INFO:teuthology.orchestra.run.smithi045.stdout: -4680> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f0) auth_unpin by 0x55cc946f4b00 on [inode 0x100000004f0 [2,head] /dc-dir/dc-file_763 auth v5528 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.061223+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946f4b00] now 0 2023-10-03T19:21:21.468 INFO:teuthology.orchestra.run.smithi045.stdout: -4679> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+228 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946f4b00 count now 1/228 2023-10-03T19:21:21.468 INFO:teuthology.orchestra.run.smithi045.stdout: -4678> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f0) clear_dirty_parent 2023-10-03T19:21:21.468 INFO:teuthology.orchestra.run.smithi045.stdout: -4677> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f1) _stored_backtrace v 3654 2023-10-03T19:21:21.469 INFO:teuthology.orchestra.run.smithi045.stdout: -4676> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f1) auth_unpin by 0x55cc946f5080 on [inode 0x100000004f1 [2,head] /dc-dir/dc-file_764 auth v5530 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.074204+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946f5080] now 0 2023-10-03T19:21:21.469 INFO:teuthology.orchestra.run.smithi045.stdout: -4675> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+227 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946f5080 count now 1/227 2023-10-03T19:21:21.469 INFO:teuthology.orchestra.run.smithi045.stdout: -4674> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f1) clear_dirty_parent 2023-10-03T19:21:21.469 INFO:teuthology.orchestra.run.smithi045.stdout: -4673> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f2) _stored_backtrace v 3658 2023-10-03T19:21:21.469 INFO:teuthology.orchestra.run.smithi045.stdout: -4672> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f2) auth_unpin by 0x55cc946f5600 on [inode 0x100000004f2 [2,head] /dc-dir/dc-file_765 auth v5532 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.086215+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946f5600] now 0 2023-10-03T19:21:21.469 INFO:teuthology.orchestra.run.smithi045.stdout: -4671> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+226 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946f5600 count now 1/226 2023-10-03T19:21:21.469 INFO:teuthology.orchestra.run.smithi045.stdout: -4670> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f2) clear_dirty_parent 2023-10-03T19:21:21.469 INFO:teuthology.orchestra.run.smithi045.stdout: -4669> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f3) _stored_backtrace v 3832 2023-10-03T19:21:21.470 INFO:teuthology.orchestra.run.smithi045.stdout: -4668> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f3) auth_unpin by 0x55cc946f5b80 on [inode 0x100000004f3 [2,head] /dc-dir/dc-file_766 auth v5534 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.175732+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946f5b80] now 0 2023-10-03T19:21:21.470 INFO:teuthology.orchestra.run.smithi045.stdout: -4667> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+225 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946f5b80 count now 1/225 2023-10-03T19:21:21.470 INFO:teuthology.orchestra.run.smithi045.stdout: -4666> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f3) clear_dirty_parent 2023-10-03T19:21:21.470 INFO:teuthology.orchestra.run.smithi045.stdout: -4665> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f4) _stored_backtrace v 3836 2023-10-03T19:21:21.470 INFO:teuthology.orchestra.run.smithi045.stdout: -4664> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f4) auth_unpin by 0x55cc946f6100 on [inode 0x100000004f4 [2,head] /dc-dir/dc-file_767 auth v5536 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.220342+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946f6100] now 0 2023-10-03T19:21:21.470 INFO:teuthology.orchestra.run.smithi045.stdout: -4663> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+224 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946f6100 count now 1/224 2023-10-03T19:21:21.471 INFO:teuthology.orchestra.run.smithi045.stdout: -4662> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f4) clear_dirty_parent 2023-10-03T19:21:21.471 INFO:teuthology.orchestra.run.smithi045.stdout: -4661> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f5) _stored_backtrace v 3840 2023-10-03T19:21:21.471 INFO:teuthology.orchestra.run.smithi045.stdout: -4660> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f5) auth_unpin by 0x55cc946f6680 on [inode 0x100000004f5 [2,head] /dc-dir/dc-file_768 auth v5538 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.235262+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946f6680] now 0 2023-10-03T19:21:21.471 INFO:teuthology.orchestra.run.smithi045.stdout: -4659> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+223 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946f6680 count now 1/223 2023-10-03T19:21:21.471 INFO:teuthology.orchestra.run.smithi045.stdout: -4658> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f5) clear_dirty_parent 2023-10-03T19:21:21.471 INFO:teuthology.orchestra.run.smithi045.stdout: -4657> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f6) _stored_backtrace v 3844 2023-10-03T19:21:21.472 INFO:teuthology.orchestra.run.smithi045.stdout: -4656> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f6) auth_unpin by 0x55cc946f6c00 on [inode 0x100000004f6 [2,head] /dc-dir/dc-file_769 auth v5540 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.247014+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946f6c00] now 0 2023-10-03T19:21:21.472 INFO:teuthology.orchestra.run.smithi045.stdout: -4655> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+222 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946f6c00 count now 1/222 2023-10-03T19:21:21.472 INFO:teuthology.orchestra.run.smithi045.stdout: -4654> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f6) clear_dirty_parent 2023-10-03T19:21:21.472 INFO:teuthology.orchestra.run.smithi045.stdout: -4653> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f7) _stored_backtrace v 3848 2023-10-03T19:21:21.472 INFO:teuthology.orchestra.run.smithi045.stdout: -4652> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f7) auth_unpin by 0x55cc946f7180 on [inode 0x100000004f7 [2,head] /dc-dir/dc-file_770 auth v5542 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.259090+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946f7180] now 0 2023-10-03T19:21:21.472 INFO:teuthology.orchestra.run.smithi045.stdout: -4651> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+221 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946f7180 count now 1/221 2023-10-03T19:21:21.473 INFO:teuthology.orchestra.run.smithi045.stdout: -4650> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f7) clear_dirty_parent 2023-10-03T19:21:21.473 INFO:teuthology.orchestra.run.smithi045.stdout: -4649> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f8) _stored_backtrace v 3852 2023-10-03T19:21:21.473 INFO:teuthology.orchestra.run.smithi045.stdout: -4648> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f8) auth_unpin by 0x55cc946f7700 on [inode 0x100000004f8 [2,head] /dc-dir/dc-file_771 auth v5544 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.270969+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946f7700] now 0 2023-10-03T19:21:21.473 INFO:teuthology.orchestra.run.smithi045.stdout: -4647> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+220 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946f7700 count now 1/220 2023-10-03T19:21:21.473 INFO:teuthology.orchestra.run.smithi045.stdout: -4646> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f8) clear_dirty_parent 2023-10-03T19:21:21.473 INFO:teuthology.orchestra.run.smithi045.stdout: -4645> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f9) _stored_backtrace v 3856 2023-10-03T19:21:21.473 INFO:teuthology.orchestra.run.smithi045.stdout: -4644> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f9) auth_unpin by 0x55cc94730000 on [inode 0x100000004f9 [2,head] /dc-dir/dc-file_772 auth v5546 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.283288+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94730000] now 0 2023-10-03T19:21:21.473 INFO:teuthology.orchestra.run.smithi045.stdout: -4643> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+219 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94730000 count now 1/219 2023-10-03T19:21:21.474 INFO:teuthology.orchestra.run.smithi045.stdout: -4642> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f9) clear_dirty_parent 2023-10-03T19:21:21.474 INFO:teuthology.orchestra.run.smithi045.stdout: -4641> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004fa) _stored_backtrace v 3860 2023-10-03T19:21:21.474 INFO:teuthology.orchestra.run.smithi045.stdout: -4640> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004fa) auth_unpin by 0x55cc94730580 on [inode 0x100000004fa [2,head] /dc-dir/dc-file_773 auth v5548 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.294975+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94730580] now 0 2023-10-03T19:21:21.474 INFO:teuthology.orchestra.run.smithi045.stdout: -4639> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+218 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94730580 count now 1/218 2023-10-03T19:21:21.474 INFO:teuthology.orchestra.run.smithi045.stdout: -4638> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004fa) clear_dirty_parent 2023-10-03T19:21:21.474 INFO:teuthology.orchestra.run.smithi045.stdout: -4637> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004fb) _stored_backtrace v 3864 2023-10-03T19:21:21.474 INFO:teuthology.orchestra.run.smithi045.stdout: -4636> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004fb) auth_unpin by 0x55cc94730b00 on [inode 0x100000004fb [2,head] /dc-dir/dc-file_774 auth v5550 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.306882+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94730b00] now 0 2023-10-03T19:21:21.474 INFO:teuthology.orchestra.run.smithi045.stdout: -4635> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+217 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94730b00 count now 1/217 2023-10-03T19:21:21.474 INFO:teuthology.orchestra.run.smithi045.stdout: -4634> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004fb) clear_dirty_parent 2023-10-03T19:21:21.474 INFO:teuthology.orchestra.run.smithi045.stdout: -4633> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004fc) _stored_backtrace v 3868 2023-10-03T19:21:21.474 INFO:teuthology.orchestra.run.smithi045.stdout: -4632> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004fc) auth_unpin by 0x55cc94731080 on [inode 0x100000004fc [2,head] /dc-dir/dc-file_775 auth v5552 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.318660+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94731080] now 0 2023-10-03T19:21:21.475 INFO:teuthology.orchestra.run.smithi045.stdout: -4631> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+216 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94731080 count now 1/216 2023-10-03T19:21:21.475 INFO:teuthology.orchestra.run.smithi045.stdout: -4630> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004fc) clear_dirty_parent 2023-10-03T19:21:21.475 INFO:teuthology.orchestra.run.smithi045.stdout: -4629> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004fd) _stored_backtrace v 3872 2023-10-03T19:21:21.475 INFO:teuthology.orchestra.run.smithi045.stdout: -4628> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004fd) auth_unpin by 0x55cc94731600 on [inode 0x100000004fd [2,head] /dc-dir/dc-file_776 auth v5554 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.330712+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94731600] now 0 2023-10-03T19:21:21.475 INFO:teuthology.orchestra.run.smithi045.stdout: -4627> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+215 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94731600 count now 1/215 2023-10-03T19:21:21.475 INFO:teuthology.orchestra.run.smithi045.stdout: -4626> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004fd) clear_dirty_parent 2023-10-03T19:21:21.475 INFO:teuthology.orchestra.run.smithi045.stdout: -4625> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004fe) _stored_backtrace v 3876 2023-10-03T19:21:21.485 INFO:teuthology.orchestra.run.smithi045.stdout: -4624> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004fe) auth_unpin by 0x55cc94731b80 on [inode 0x100000004fe [2,head] /dc-dir/dc-file_777 auth v5556 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.342052+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94731b80] now 0 2023-10-03T19:21:21.485 INFO:teuthology.orchestra.run.smithi045.stdout: -4623> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+214 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94731b80 count now 1/214 2023-10-03T19:21:21.485 INFO:teuthology.orchestra.run.smithi045.stdout: -4622> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004fe) clear_dirty_parent 2023-10-03T19:21:21.485 INFO:teuthology.orchestra.run.smithi045.stdout: -4621> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ff) _stored_backtrace v 3880 2023-10-03T19:21:21.485 INFO:teuthology.orchestra.run.smithi045.stdout: -4620> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ff) auth_unpin by 0x55cc94732100 on [inode 0x100000004ff [2,head] /dc-dir/dc-file_778 auth v5558 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.354089+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94732100] now 0 2023-10-03T19:21:21.485 INFO:teuthology.orchestra.run.smithi045.stdout: -4619> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+213 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94732100 count now 1/213 2023-10-03T19:21:21.485 INFO:teuthology.orchestra.run.smithi045.stdout: -4618> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ff) clear_dirty_parent 2023-10-03T19:21:21.485 INFO:teuthology.orchestra.run.smithi045.stdout: -4617> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000500) _stored_backtrace v 3884 2023-10-03T19:21:21.486 INFO:teuthology.orchestra.run.smithi045.stdout: -4616> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000500) auth_unpin by 0x55cc94732680 on [inode 0x10000000500 [2,head] /dc-dir/dc-file_779 auth v5560 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.366699+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94732680] now 0 2023-10-03T19:21:21.486 INFO:teuthology.orchestra.run.smithi045.stdout: -4615> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+212 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94732680 count now 1/212 2023-10-03T19:21:21.486 INFO:teuthology.orchestra.run.smithi045.stdout: -4614> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000500) clear_dirty_parent 2023-10-03T19:21:21.486 INFO:teuthology.orchestra.run.smithi045.stdout: -4613> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000501) _stored_backtrace v 3888 2023-10-03T19:21:21.486 INFO:teuthology.orchestra.run.smithi045.stdout: -4612> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000501) auth_unpin by 0x55cc94732c00 on [inode 0x10000000501 [2,head] /dc-dir/dc-file_780 auth v5562 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.378959+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94732c00] now 0 2023-10-03T19:21:21.486 INFO:teuthology.orchestra.run.smithi045.stdout: -4611> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+211 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94732c00 count now 1/211 2023-10-03T19:21:21.486 INFO:teuthology.orchestra.run.smithi045.stdout: -4610> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000501) clear_dirty_parent 2023-10-03T19:21:21.486 INFO:teuthology.orchestra.run.smithi045.stdout: -4609> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000502) _stored_backtrace v 3892 2023-10-03T19:21:21.486 INFO:teuthology.orchestra.run.smithi045.stdout: -4608> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000502) auth_unpin by 0x55cc94733180 on [inode 0x10000000502 [2,head] /dc-dir/dc-file_781 auth v5564 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.391272+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94733180] now 0 2023-10-03T19:21:21.487 INFO:teuthology.orchestra.run.smithi045.stdout: -4607> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+210 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94733180 count now 1/210 2023-10-03T19:21:21.487 INFO:teuthology.orchestra.run.smithi045.stdout: -4606> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000502) clear_dirty_parent 2023-10-03T19:21:21.487 INFO:teuthology.orchestra.run.smithi045.stdout: -4605> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000503) _stored_backtrace v 3896 2023-10-03T19:21:21.487 INFO:teuthology.orchestra.run.smithi045.stdout: -4604> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000503) auth_unpin by 0x55cc94733700 on [inode 0x10000000503 [2,head] /dc-dir/dc-file_782 auth v5566 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.403260+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94733700] now 0 2023-10-03T19:21:21.487 INFO:teuthology.orchestra.run.smithi045.stdout: -4603> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+209 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94733700 count now 1/209 2023-10-03T19:21:21.487 INFO:teuthology.orchestra.run.smithi045.stdout: -4602> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000503) clear_dirty_parent 2023-10-03T19:21:21.487 INFO:teuthology.orchestra.run.smithi045.stdout: -4601> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000504) _stored_backtrace v 3900 2023-10-03T19:21:21.487 INFO:teuthology.orchestra.run.smithi045.stdout: -4600> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000504) auth_unpin by 0x55cc9473c000 on [inode 0x10000000504 [2,head] /dc-dir/dc-file_783 auth v5568 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.416797+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9473c000] now 0 2023-10-03T19:21:21.487 INFO:teuthology.orchestra.run.smithi045.stdout: -4599> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+208 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9473c000 count now 1/208 2023-10-03T19:21:21.487 INFO:teuthology.orchestra.run.smithi045.stdout: -4598> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000504) clear_dirty_parent 2023-10-03T19:21:21.487 INFO:teuthology.orchestra.run.smithi045.stdout: -4597> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000505) _stored_backtrace v 3904 2023-10-03T19:21:21.488 INFO:teuthology.orchestra.run.smithi045.stdout: -4596> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000505) auth_unpin by 0x55cc9473c580 on [inode 0x10000000505 [2,head] /dc-dir/dc-file_784 auth v5570 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.428983+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9473c580] now 0 2023-10-03T19:21:21.488 INFO:teuthology.orchestra.run.smithi045.stdout: -4595> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+207 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9473c580 count now 1/207 2023-10-03T19:21:21.488 INFO:teuthology.orchestra.run.smithi045.stdout: -4594> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000505) clear_dirty_parent 2023-10-03T19:21:21.488 INFO:teuthology.orchestra.run.smithi045.stdout: -4593> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000506) _stored_backtrace v 3908 2023-10-03T19:21:21.488 INFO:teuthology.orchestra.run.smithi045.stdout: -4592> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000506) auth_unpin by 0x55cc9473cb00 on [inode 0x10000000506 [2,head] /dc-dir/dc-file_785 auth v5572 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.442397+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9473cb00] now 0 2023-10-03T19:21:21.488 INFO:teuthology.orchestra.run.smithi045.stdout: -4591> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+206 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9473cb00 count now 1/206 2023-10-03T19:21:21.488 INFO:teuthology.orchestra.run.smithi045.stdout: -4590> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000506) clear_dirty_parent 2023-10-03T19:21:21.488 INFO:teuthology.orchestra.run.smithi045.stdout: -4589> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000507) _stored_backtrace v 3912 2023-10-03T19:21:21.488 INFO:teuthology.orchestra.run.smithi045.stdout: -4588> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000507) auth_unpin by 0x55cc9473d080 on [inode 0x10000000507 [2,head] /dc-dir/dc-file_786 auth v5574 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.454795+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9473d080] now 0 2023-10-03T19:21:21.488 INFO:teuthology.orchestra.run.smithi045.stdout: -4587> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+205 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9473d080 count now 1/205 2023-10-03T19:21:21.488 INFO:teuthology.orchestra.run.smithi045.stdout: -4586> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000507) clear_dirty_parent 2023-10-03T19:21:21.488 INFO:teuthology.orchestra.run.smithi045.stdout: -4585> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000508) _stored_backtrace v 3916 2023-10-03T19:21:21.489 INFO:teuthology.orchestra.run.smithi045.stdout: -4584> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000508) auth_unpin by 0x55cc9473d600 on [inode 0x10000000508 [2,head] /dc-dir/dc-file_787 auth v5576 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.468067+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9473d600] now 0 2023-10-03T19:21:21.489 INFO:teuthology.orchestra.run.smithi045.stdout: -4583> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+204 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9473d600 count now 1/204 2023-10-03T19:21:21.489 INFO:teuthology.orchestra.run.smithi045.stdout: -4582> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000508) clear_dirty_parent 2023-10-03T19:21:21.489 INFO:teuthology.orchestra.run.smithi045.stdout: -4581> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000509) _stored_backtrace v 3920 2023-10-03T19:21:21.489 INFO:teuthology.orchestra.run.smithi045.stdout: -4580> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000509) auth_unpin by 0x55cc9473db80 on [inode 0x10000000509 [2,head] /dc-dir/dc-file_788 auth v5578 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.480149+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9473db80] now 0 2023-10-03T19:21:21.489 INFO:teuthology.orchestra.run.smithi045.stdout: -4579> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+203 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9473db80 count now 1/203 2023-10-03T19:21:21.489 INFO:teuthology.orchestra.run.smithi045.stdout: -4578> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000509) clear_dirty_parent 2023-10-03T19:21:21.489 INFO:teuthology.orchestra.run.smithi045.stdout: -4577> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000050a) _stored_backtrace v 3924 2023-10-03T19:21:21.489 INFO:teuthology.orchestra.run.smithi045.stdout: -4576> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000050a) auth_unpin by 0x55cc9473e100 on [inode 0x1000000050a [2,head] /dc-dir/dc-file_789 auth v5580 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.492989+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9473e100] now 0 2023-10-03T19:21:21.489 INFO:teuthology.orchestra.run.smithi045.stdout: -4575> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+202 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9473e100 count now 1/202 2023-10-03T19:21:21.490 INFO:teuthology.orchestra.run.smithi045.stdout: -4574> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000050a) clear_dirty_parent 2023-10-03T19:21:21.490 INFO:teuthology.orchestra.run.smithi045.stdout: -4573> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000050b) _stored_backtrace v 3928 2023-10-03T19:21:21.490 INFO:teuthology.orchestra.run.smithi045.stdout: -4572> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000050b) auth_unpin by 0x55cc9473e680 on [inode 0x1000000050b [2,head] /dc-dir/dc-file_790 auth v5582 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.505499+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9473e680] now 0 2023-10-03T19:21:21.490 INFO:teuthology.orchestra.run.smithi045.stdout: -4571> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+201 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9473e680 count now 1/201 2023-10-03T19:21:21.490 INFO:teuthology.orchestra.run.smithi045.stdout: -4570> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000050b) clear_dirty_parent 2023-10-03T19:21:21.490 INFO:teuthology.orchestra.run.smithi045.stdout: -4569> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000050c) _stored_backtrace v 3932 2023-10-03T19:21:21.490 INFO:teuthology.orchestra.run.smithi045.stdout: -4568> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000050c) auth_unpin by 0x55cc9473ec00 on [inode 0x1000000050c [2,head] /dc-dir/dc-file_791 auth v5584 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.518506+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9473ec00] now 0 2023-10-03T19:21:21.490 INFO:teuthology.orchestra.run.smithi045.stdout: -4567> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+200 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9473ec00 count now 1/200 2023-10-03T19:21:21.490 INFO:teuthology.orchestra.run.smithi045.stdout: -4566> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000050c) clear_dirty_parent 2023-10-03T19:21:21.512 INFO:teuthology.orchestra.run.smithi045.stdout: -4565> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000050d) _stored_backtrace v 3936 2023-10-03T19:21:21.512 INFO:teuthology.orchestra.run.smithi045.stdout: -4564> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000050d) auth_unpin by 0x55cc9473f180 on [inode 0x1000000050d [2,head] /dc-dir/dc-file_792 auth v5586 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.531969+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9473f180] now 0 2023-10-03T19:21:21.512 INFO:teuthology.orchestra.run.smithi045.stdout: -4563> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+199 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9473f180 count now 1/199 2023-10-03T19:21:21.512 INFO:teuthology.orchestra.run.smithi045.stdout: -4562> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000050d) clear_dirty_parent 2023-10-03T19:21:21.512 INFO:teuthology.orchestra.run.smithi045.stdout: -4561> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000050e) _stored_backtrace v 3940 2023-10-03T19:21:21.512 INFO:teuthology.orchestra.run.smithi045.stdout: -4560> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000050e) auth_unpin by 0x55cc9473f700 on [inode 0x1000000050e [2,head] /dc-dir/dc-file_793 auth v5588 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.544595+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9473f700] now 0 2023-10-03T19:21:21.512 INFO:teuthology.orchestra.run.smithi045.stdout: -4559> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+198 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9473f700 count now 1/198 2023-10-03T19:21:21.513 INFO:teuthology.orchestra.run.smithi045.stdout: -4558> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000050e) clear_dirty_parent 2023-10-03T19:21:21.513 INFO:teuthology.orchestra.run.smithi045.stdout: -4557> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000050f) _stored_backtrace v 3944 2023-10-03T19:21:21.513 INFO:teuthology.orchestra.run.smithi045.stdout: -4556> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000050f) auth_unpin by 0x55cc94742000 on [inode 0x1000000050f [2,head] /dc-dir/dc-file_794 auth v5590 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.558012+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94742000] now 0 2023-10-03T19:21:21.513 INFO:teuthology.orchestra.run.smithi045.stdout: -4555> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+197 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94742000 count now 1/197 2023-10-03T19:21:21.513 INFO:teuthology.orchestra.run.smithi045.stdout: -4554> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000050f) clear_dirty_parent 2023-10-03T19:21:21.513 INFO:teuthology.orchestra.run.smithi045.stdout: -4553> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000510) _stored_backtrace v 3948 2023-10-03T19:21:21.513 INFO:teuthology.orchestra.run.smithi045.stdout: -4552> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000510) auth_unpin by 0x55cc94742580 on [inode 0x10000000510 [2,head] /dc-dir/dc-file_795 auth v5592 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.570089+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94742580] now 0 2023-10-03T19:21:21.513 INFO:teuthology.orchestra.run.smithi045.stdout: -4551> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+196 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94742580 count now 1/196 2023-10-03T19:21:21.513 INFO:teuthology.orchestra.run.smithi045.stdout: -4550> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000510) clear_dirty_parent 2023-10-03T19:21:21.513 INFO:teuthology.orchestra.run.smithi045.stdout: -4549> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000511) _stored_backtrace v 3952 2023-10-03T19:21:21.514 INFO:teuthology.orchestra.run.smithi045.stdout: -4548> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000511) auth_unpin by 0x55cc94742b00 on [inode 0x10000000511 [2,head] /dc-dir/dc-file_796 auth v5594 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.581774+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94742b00] now 0 2023-10-03T19:21:21.514 INFO:teuthology.orchestra.run.smithi045.stdout: -4547> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+195 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94742b00 count now 1/195 2023-10-03T19:21:21.514 INFO:teuthology.orchestra.run.smithi045.stdout: -4546> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000511) clear_dirty_parent 2023-10-03T19:21:21.514 INFO:teuthology.orchestra.run.smithi045.stdout: -4545> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000512) _stored_backtrace v 3956 2023-10-03T19:21:21.514 INFO:teuthology.orchestra.run.smithi045.stdout: -4544> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000512) auth_unpin by 0x55cc94743080 on [inode 0x10000000512 [2,head] /dc-dir/dc-file_797 auth v5596 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.594246+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94743080] now 0 2023-10-03T19:21:21.514 INFO:teuthology.orchestra.run.smithi045.stdout: -4543> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+194 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94743080 count now 1/194 2023-10-03T19:21:21.514 INFO:teuthology.orchestra.run.smithi045.stdout: -4542> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000512) clear_dirty_parent 2023-10-03T19:21:21.514 INFO:teuthology.orchestra.run.smithi045.stdout: -4541> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000513) _stored_backtrace v 3960 2023-10-03T19:21:21.514 INFO:teuthology.orchestra.run.smithi045.stdout: -4540> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000513) auth_unpin by 0x55cc94743600 on [inode 0x10000000513 [2,head] /dc-dir/dc-file_798 auth v5598 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.608115+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94743600] now 0 2023-10-03T19:21:21.514 INFO:teuthology.orchestra.run.smithi045.stdout: -4539> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+193 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94743600 count now 1/193 2023-10-03T19:21:21.515 INFO:teuthology.orchestra.run.smithi045.stdout: -4538> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000513) clear_dirty_parent 2023-10-03T19:21:21.515 INFO:teuthology.orchestra.run.smithi045.stdout: -4537> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000514) _stored_backtrace v 3964 2023-10-03T19:21:21.515 INFO:teuthology.orchestra.run.smithi045.stdout: -4536> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000514) auth_unpin by 0x55cc94743b80 on [inode 0x10000000514 [2,head] /dc-dir/dc-file_799 auth v5600 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.621261+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94743b80] now 0 2023-10-03T19:21:21.515 INFO:teuthology.orchestra.run.smithi045.stdout: -4535> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+192 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94743b80 count now 1/192 2023-10-03T19:21:21.515 INFO:teuthology.orchestra.run.smithi045.stdout: -4534> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000514) clear_dirty_parent 2023-10-03T19:21:21.515 INFO:teuthology.orchestra.run.smithi045.stdout: -4533> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000515) _stored_backtrace v 3968 2023-10-03T19:21:21.515 INFO:teuthology.orchestra.run.smithi045.stdout: -4532> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000515) auth_unpin by 0x55cc94744100 on [inode 0x10000000515 [2,head] /dc-dir/dc-file_800 auth v5602 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.633573+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94744100] now 0 2023-10-03T19:21:21.515 INFO:teuthology.orchestra.run.smithi045.stdout: -4531> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+191 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94744100 count now 1/191 2023-10-03T19:21:21.515 INFO:teuthology.orchestra.run.smithi045.stdout: -4530> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000515) clear_dirty_parent 2023-10-03T19:21:21.515 INFO:teuthology.orchestra.run.smithi045.stdout: -4529> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000516) _stored_backtrace v 3972 2023-10-03T19:21:21.515 INFO:teuthology.orchestra.run.smithi045.stdout: -4528> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000516) auth_unpin by 0x55cc94744680 on [inode 0x10000000516 [2,head] /dc-dir/dc-file_801 auth v5604 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.646896+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94744680] now 0 2023-10-03T19:21:21.516 INFO:teuthology.orchestra.run.smithi045.stdout: -4527> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+190 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94744680 count now 1/190 2023-10-03T19:21:21.516 INFO:teuthology.orchestra.run.smithi045.stdout: -4526> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000516) clear_dirty_parent 2023-10-03T19:21:21.516 INFO:teuthology.orchestra.run.smithi045.stdout: -4525> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000517) _stored_backtrace v 3976 2023-10-03T19:21:21.516 INFO:teuthology.orchestra.run.smithi045.stdout: -4524> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000517) auth_unpin by 0x55cc94744c00 on [inode 0x10000000517 [2,head] /dc-dir/dc-file_802 auth v5606 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.660293+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94744c00] now 0 2023-10-03T19:21:21.516 INFO:teuthology.orchestra.run.smithi045.stdout: -4523> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+189 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94744c00 count now 1/189 2023-10-03T19:21:21.516 INFO:teuthology.orchestra.run.smithi045.stdout: -4522> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000517) clear_dirty_parent 2023-10-03T19:21:21.516 INFO:teuthology.orchestra.run.smithi045.stdout: -4521> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000518) _stored_backtrace v 3980 2023-10-03T19:21:21.516 INFO:teuthology.orchestra.run.smithi045.stdout: -4520> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000518) auth_unpin by 0x55cc94745180 on [inode 0x10000000518 [2,head] /dc-dir/dc-file_803 auth v5608 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.673102+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94745180] now 0 2023-10-03T19:21:21.516 INFO:teuthology.orchestra.run.smithi045.stdout: -4519> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+188 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94745180 count now 1/188 2023-10-03T19:21:21.516 INFO:teuthology.orchestra.run.smithi045.stdout: -4518> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000518) clear_dirty_parent 2023-10-03T19:21:21.516 INFO:teuthology.orchestra.run.smithi045.stdout: -4517> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000519) _stored_backtrace v 3984 2023-10-03T19:21:21.516 INFO:teuthology.orchestra.run.smithi045.stdout: -4516> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000519) auth_unpin by 0x55cc94745700 on [inode 0x10000000519 [2,head] /dc-dir/dc-file_804 auth v5610 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.685420+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94745700] now 0 2023-10-03T19:21:21.517 INFO:teuthology.orchestra.run.smithi045.stdout: -4515> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+187 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94745700 count now 1/187 2023-10-03T19:21:21.517 INFO:teuthology.orchestra.run.smithi045.stdout: -4514> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000519) clear_dirty_parent 2023-10-03T19:21:21.517 INFO:teuthology.orchestra.run.smithi045.stdout: -4513> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000051a) _stored_backtrace v 3988 2023-10-03T19:21:21.517 INFO:teuthology.orchestra.run.smithi045.stdout: -4512> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000051a) auth_unpin by 0x55cc9468c000 on [inode 0x1000000051a [2,head] /dc-dir/dc-file_805 auth v5612 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.698950+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9468c000] now 0 2023-10-03T19:21:21.517 INFO:teuthology.orchestra.run.smithi045.stdout: -4511> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+186 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9468c000 count now 1/186 2023-10-03T19:21:21.517 INFO:teuthology.orchestra.run.smithi045.stdout: -4510> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000051a) clear_dirty_parent 2023-10-03T19:21:21.517 INFO:teuthology.orchestra.run.smithi045.stdout: -4509> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000051b) _stored_backtrace v 3992 2023-10-03T19:21:21.517 INFO:teuthology.orchestra.run.smithi045.stdout: -4508> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000051b) auth_unpin by 0x55cc9468c580 on [inode 0x1000000051b [2,head] /dc-dir/dc-file_806 auth v5614 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.711083+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9468c580] now 0 2023-10-03T19:21:21.517 INFO:teuthology.orchestra.run.smithi045.stdout: -4507> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+185 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9468c580 count now 1/185 2023-10-03T19:21:21.517 INFO:teuthology.orchestra.run.smithi045.stdout: -4506> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000051b) clear_dirty_parent 2023-10-03T19:21:21.517 INFO:teuthology.orchestra.run.smithi045.stdout: -4505> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000051c) _stored_backtrace v 3996 2023-10-03T19:21:21.518 INFO:teuthology.orchestra.run.smithi045.stdout: -4504> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000051c) auth_unpin by 0x55cc9468cb00 on [inode 0x1000000051c [2,head] /dc-dir/dc-file_807 auth v5616 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.723345+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9468cb00] now 0 2023-10-03T19:21:21.518 INFO:teuthology.orchestra.run.smithi045.stdout: -4503> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+184 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9468cb00 count now 1/184 2023-10-03T19:21:21.518 INFO:teuthology.orchestra.run.smithi045.stdout: -4502> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000051c) clear_dirty_parent 2023-10-03T19:21:21.518 INFO:teuthology.orchestra.run.smithi045.stdout: -4501> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000051d) _stored_backtrace v 4000 2023-10-03T19:21:21.518 INFO:teuthology.orchestra.run.smithi045.stdout: -4500> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000051d) auth_unpin by 0x55cc9468d080 on [inode 0x1000000051d [2,head] /dc-dir/dc-file_808 auth v5618 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.735428+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9468d080] now 0 2023-10-03T19:21:21.518 INFO:teuthology.orchestra.run.smithi045.stdout: -4499> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+183 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9468d080 count now 1/183 2023-10-03T19:21:21.518 INFO:teuthology.orchestra.run.smithi045.stdout: -4498> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000051d) clear_dirty_parent 2023-10-03T19:21:21.518 INFO:teuthology.orchestra.run.smithi045.stdout: -4497> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000051e) _stored_backtrace v 4004 2023-10-03T19:21:21.518 INFO:teuthology.orchestra.run.smithi045.stdout: -4496> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000051e) auth_unpin by 0x55cc9468d600 on [inode 0x1000000051e [2,head] /dc-dir/dc-file_809 auth v5620 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.747323+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9468d600] now 0 2023-10-03T19:21:21.518 INFO:teuthology.orchestra.run.smithi045.stdout: -4495> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+182 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9468d600 count now 1/182 2023-10-03T19:21:21.518 INFO:teuthology.orchestra.run.smithi045.stdout: -4494> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000051e) clear_dirty_parent 2023-10-03T19:21:21.519 INFO:teuthology.orchestra.run.smithi045.stdout: -4493> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000051f) _stored_backtrace v 4008 2023-10-03T19:21:21.519 INFO:teuthology.orchestra.run.smithi045.stdout: -4492> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000051f) auth_unpin by 0x55cc9468db80 on [inode 0x1000000051f [2,head] /dc-dir/dc-file_810 auth v5622 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.759618+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9468db80] now 0 2023-10-03T19:21:21.519 INFO:teuthology.orchestra.run.smithi045.stdout: -4491> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+181 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9468db80 count now 1/181 2023-10-03T19:21:21.519 INFO:teuthology.orchestra.run.smithi045.stdout: -4490> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000051f) clear_dirty_parent 2023-10-03T19:21:21.519 INFO:teuthology.orchestra.run.smithi045.stdout: -4489> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000520) _stored_backtrace v 4012 2023-10-03T19:21:21.519 INFO:teuthology.orchestra.run.smithi045.stdout: -4488> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000520) auth_unpin by 0x55cc9468e100 on [inode 0x10000000520 [2,head] /dc-dir/dc-file_811 auth v5624 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.771972+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9468e100] now 0 2023-10-03T19:21:21.519 INFO:teuthology.orchestra.run.smithi045.stdout: -4487> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+180 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9468e100 count now 1/180 2023-10-03T19:21:21.519 INFO:teuthology.orchestra.run.smithi045.stdout: -4486> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000520) clear_dirty_parent 2023-10-03T19:21:21.622 INFO:teuthology.orchestra.run.smithi045.stdout: -4485> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000521) _stored_backtrace v 4016 2023-10-03T19:21:21.622 INFO:teuthology.orchestra.run.smithi045.stdout: -4484> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000521) auth_unpin by 0x55cc9468e680 on [inode 0x10000000521 [2,head] /dc-dir/dc-file_812 auth v5626 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.784179+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9468e680] now 0 2023-10-03T19:21:21.622 INFO:teuthology.orchestra.run.smithi045.stdout: -4483> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+179 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9468e680 count now 1/179 2023-10-03T19:21:21.622 INFO:teuthology.orchestra.run.smithi045.stdout: -4482> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000521) clear_dirty_parent 2023-10-03T19:21:21.622 INFO:teuthology.orchestra.run.smithi045.stdout: -4481> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000522) _stored_backtrace v 4020 2023-10-03T19:21:21.623 INFO:teuthology.orchestra.run.smithi045.stdout: -4480> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000522) auth_unpin by 0x55cc9468ec00 on [inode 0x10000000522 [2,head] /dc-dir/dc-file_813 auth v5628 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.797114+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9468ec00] now 0 2023-10-03T19:21:21.623 INFO:teuthology.orchestra.run.smithi045.stdout: -4479> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+178 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9468ec00 count now 1/178 2023-10-03T19:21:21.623 INFO:teuthology.orchestra.run.smithi045.stdout: -4478> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000522) clear_dirty_parent 2023-10-03T19:21:21.623 INFO:teuthology.orchestra.run.smithi045.stdout: -4477> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000523) _stored_backtrace v 4024 2023-10-03T19:21:21.623 INFO:teuthology.orchestra.run.smithi045.stdout: -4476> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000523) auth_unpin by 0x55cc9468f180 on [inode 0x10000000523 [2,head] /dc-dir/dc-file_814 auth v5630 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.809388+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9468f180] now 0 2023-10-03T19:21:21.623 INFO:teuthology.orchestra.run.smithi045.stdout: -4475> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+177 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9468f180 count now 1/177 2023-10-03T19:21:21.623 INFO:teuthology.orchestra.run.smithi045.stdout: -4474> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000523) clear_dirty_parent 2023-10-03T19:21:21.623 INFO:teuthology.orchestra.run.smithi045.stdout: -4473> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000524) _stored_backtrace v 4028 2023-10-03T19:21:21.623 INFO:teuthology.orchestra.run.smithi045.stdout: -4472> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000524) auth_unpin by 0x55cc9468f700 on [inode 0x10000000524 [2,head] /dc-dir/dc-file_815 auth v5632 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.822112+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9468f700] now 0 2023-10-03T19:21:21.624 INFO:teuthology.orchestra.run.smithi045.stdout: -4471> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+176 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9468f700 count now 1/176 2023-10-03T19:21:21.624 INFO:teuthology.orchestra.run.smithi045.stdout: -4470> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000524) clear_dirty_parent 2023-10-03T19:21:21.624 INFO:teuthology.orchestra.run.smithi045.stdout: -4469> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000525) _stored_backtrace v 4032 2023-10-03T19:21:21.624 INFO:teuthology.orchestra.run.smithi045.stdout: -4468> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000525) auth_unpin by 0x55cc94692000 on [inode 0x10000000525 [2,head] /dc-dir/dc-file_816 auth v5634 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.834647+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94692000] now 0 2023-10-03T19:21:21.624 INFO:teuthology.orchestra.run.smithi045.stdout: -4467> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+175 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94692000 count now 1/175 2023-10-03T19:21:21.624 INFO:teuthology.orchestra.run.smithi045.stdout: -4466> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000525) clear_dirty_parent 2023-10-03T19:21:21.624 INFO:teuthology.orchestra.run.smithi045.stdout: -4465> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000526) _stored_backtrace v 4036 2023-10-03T19:21:21.624 INFO:teuthology.orchestra.run.smithi045.stdout: -4464> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000526) auth_unpin by 0x55cc94692580 on [inode 0x10000000526 [2,head] /dc-dir/dc-file_817 auth v5636 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.847698+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94692580] now 0 2023-10-03T19:21:21.624 INFO:teuthology.orchestra.run.smithi045.stdout: -4463> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+174 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94692580 count now 1/174 2023-10-03T19:21:21.624 INFO:teuthology.orchestra.run.smithi045.stdout: -4462> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000526) clear_dirty_parent 2023-10-03T19:21:21.624 INFO:teuthology.orchestra.run.smithi045.stdout: -4461> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000527) _stored_backtrace v 4040 2023-10-03T19:21:21.625 INFO:teuthology.orchestra.run.smithi045.stdout: -4460> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000527) auth_unpin by 0x55cc94692b00 on [inode 0x10000000527 [2,head] /dc-dir/dc-file_818 auth v5638 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.859836+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94692b00] now 0 2023-10-03T19:21:21.625 INFO:teuthology.orchestra.run.smithi045.stdout: -4459> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+173 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94692b00 count now 1/173 2023-10-03T19:21:21.625 INFO:teuthology.orchestra.run.smithi045.stdout: -4458> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000527) clear_dirty_parent 2023-10-03T19:21:21.625 INFO:teuthology.orchestra.run.smithi045.stdout: -4457> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000528) _stored_backtrace v 4044 2023-10-03T19:21:21.625 INFO:teuthology.orchestra.run.smithi045.stdout: -4456> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000528) auth_unpin by 0x55cc94693080 on [inode 0x10000000528 [2,head] /dc-dir/dc-file_819 auth v5640 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.871619+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94693080] now 0 2023-10-03T19:21:21.625 INFO:teuthology.orchestra.run.smithi045.stdout: -4455> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+172 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94693080 count now 1/172 2023-10-03T19:21:21.625 INFO:teuthology.orchestra.run.smithi045.stdout: -4454> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000528) clear_dirty_parent 2023-10-03T19:21:21.625 INFO:teuthology.orchestra.run.smithi045.stdout: -4453> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000529) _stored_backtrace v 4048 2023-10-03T19:21:21.625 INFO:teuthology.orchestra.run.smithi045.stdout: -4452> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000529) auth_unpin by 0x55cc94693600 on [inode 0x10000000529 [2,head] /dc-dir/dc-file_820 auth v5642 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.884127+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94693600] now 0 2023-10-03T19:21:21.625 INFO:teuthology.orchestra.run.smithi045.stdout: -4451> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+171 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94693600 count now 1/171 2023-10-03T19:21:21.625 INFO:teuthology.orchestra.run.smithi045.stdout: -4450> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000529) clear_dirty_parent 2023-10-03T19:21:21.625 INFO:teuthology.orchestra.run.smithi045.stdout: -4449> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000052a) _stored_backtrace v 4052 2023-10-03T19:21:21.626 INFO:teuthology.orchestra.run.smithi045.stdout: -4448> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000052a) auth_unpin by 0x55cc94693b80 on [inode 0x1000000052a [2,head] /dc-dir/dc-file_821 auth v5644 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.897318+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94693b80] now 0 2023-10-03T19:21:21.626 INFO:teuthology.orchestra.run.smithi045.stdout: -4447> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+170 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94693b80 count now 1/170 2023-10-03T19:21:21.626 INFO:teuthology.orchestra.run.smithi045.stdout: -4446> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000052a) clear_dirty_parent 2023-10-03T19:21:21.626 INFO:teuthology.orchestra.run.smithi045.stdout: -4445> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000052b) _stored_backtrace v 4056 2023-10-03T19:21:21.626 INFO:teuthology.orchestra.run.smithi045.stdout: -4444> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000052b) auth_unpin by 0x55cc94694100 on [inode 0x1000000052b [2,head] /dc-dir/dc-file_822 auth v5646 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.909595+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94694100] now 0 2023-10-03T19:21:21.626 INFO:teuthology.orchestra.run.smithi045.stdout: -4443> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+169 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94694100 count now 1/169 2023-10-03T19:21:21.626 INFO:teuthology.orchestra.run.smithi045.stdout: -4442> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000052b) clear_dirty_parent 2023-10-03T19:21:21.626 INFO:teuthology.orchestra.run.smithi045.stdout: -4441> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000052c) _stored_backtrace v 4060 2023-10-03T19:21:21.626 INFO:teuthology.orchestra.run.smithi045.stdout: -4440> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000052c) auth_unpin by 0x55cc94694680 on [inode 0x1000000052c [2,head] /dc-dir/dc-file_823 auth v5648 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.923564+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94694680] now 0 2023-10-03T19:21:21.627 INFO:teuthology.orchestra.run.smithi045.stdout: -4439> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+168 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94694680 count now 1/168 2023-10-03T19:21:21.627 INFO:teuthology.orchestra.run.smithi045.stdout: -4438> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000052c) clear_dirty_parent 2023-10-03T19:21:21.627 INFO:teuthology.orchestra.run.smithi045.stdout: -4437> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000052d) _stored_backtrace v 4064 2023-10-03T19:21:21.627 INFO:teuthology.orchestra.run.smithi045.stdout: -4436> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000052d) auth_unpin by 0x55cc94694c00 on [inode 0x1000000052d [2,head] /dc-dir/dc-file_824 auth v5650 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.936393+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94694c00] now 0 2023-10-03T19:21:21.627 INFO:teuthology.orchestra.run.smithi045.stdout: -4435> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+167 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94694c00 count now 1/167 2023-10-03T19:21:21.627 INFO:teuthology.orchestra.run.smithi045.stdout: -4434> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000052d) clear_dirty_parent 2023-10-03T19:21:21.627 INFO:teuthology.orchestra.run.smithi045.stdout: -4433> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000052e) _stored_backtrace v 4068 2023-10-03T19:21:21.627 INFO:teuthology.orchestra.run.smithi045.stdout: -4432> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000052e) auth_unpin by 0x55cc94695180 on [inode 0x1000000052e [2,head] /dc-dir/dc-file_825 auth v5652 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.949585+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94695180] now 0 2023-10-03T19:21:21.627 INFO:teuthology.orchestra.run.smithi045.stdout: -4431> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+166 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94695180 count now 1/166 2023-10-03T19:21:21.627 INFO:teuthology.orchestra.run.smithi045.stdout: -4430> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000052e) clear_dirty_parent 2023-10-03T19:21:21.627 INFO:teuthology.orchestra.run.smithi045.stdout: -4429> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000052f) _stored_backtrace v 4072 2023-10-03T19:21:21.627 INFO:teuthology.orchestra.run.smithi045.stdout: -4428> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000052f) auth_unpin by 0x55cc94695700 on [inode 0x1000000052f [2,head] /dc-dir/dc-file_826 auth v5654 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.962272+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94695700] now 0 2023-10-03T19:21:21.628 INFO:teuthology.orchestra.run.smithi045.stdout: -4427> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+165 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94695700 count now 1/165 2023-10-03T19:21:21.628 INFO:teuthology.orchestra.run.smithi045.stdout: -4426> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000052f) clear_dirty_parent 2023-10-03T19:21:21.628 INFO:teuthology.orchestra.run.smithi045.stdout: -4425> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000530) _stored_backtrace v 4076 2023-10-03T19:21:21.628 INFO:teuthology.orchestra.run.smithi045.stdout: -4424> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000530) auth_unpin by 0x55cc9469c000 on [inode 0x10000000530 [2,head] /dc-dir/dc-file_827 auth v5656 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.975092+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9469c000] now 0 2023-10-03T19:21:21.628 INFO:teuthology.orchestra.run.smithi045.stdout: -4423> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+164 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9469c000 count now 1/164 2023-10-03T19:21:21.628 INFO:teuthology.orchestra.run.smithi045.stdout: -4422> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000530) clear_dirty_parent 2023-10-03T19:21:21.628 INFO:teuthology.orchestra.run.smithi045.stdout: -4421> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000531) _stored_backtrace v 4080 2023-10-03T19:21:21.628 INFO:teuthology.orchestra.run.smithi045.stdout: -4420> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000531) auth_unpin by 0x55cc9469c580 on [inode 0x10000000531 [2,head] /dc-dir/dc-file_828 auth v5658 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:55.988309+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9469c580] now 0 2023-10-03T19:21:21.629 INFO:teuthology.orchestra.run.smithi045.stdout: -4419> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+163 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9469c580 count now 1/163 2023-10-03T19:21:21.629 INFO:teuthology.orchestra.run.smithi045.stdout: -4418> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000531) clear_dirty_parent 2023-10-03T19:21:21.629 INFO:teuthology.orchestra.run.smithi045.stdout: -4417> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 MDSContext::complete: 21C_MaybeExpiredSegment 2023-10-03T19:21:21.629 INFO:teuthology.orchestra.run.smithi045.stdout: -4416> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.log _maybe_expired segment 1025/6206796, 1024 events 2023-10-03T19:21:21.629 INFO:teuthology.orchestra.run.smithi045.stdout: -4415> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 6 mds.0.journal LogSegment(1025/6206796).try_to_expire 2023-10-03T19:21:21.629 INFO:teuthology.orchestra.run.smithi045.stdout: -4414> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 4 mds.0.sessionmap save_if_dirty: writing 0 2023-10-03T19:21:21.629 INFO:teuthology.orchestra.run.smithi045.stdout: -4413> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.journal try_to_expire waiting for purge of [] 2023-10-03T19:21:21.639 INFO:teuthology.orchestra.run.smithi045.stdout: -4412> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 6 mds.0.journal LogSegment(1025/6206796).try_to_expire success 2023-10-03T19:21:21.639 INFO:teuthology.orchestra.run.smithi045.stdout: -4411> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.log try_expire expired segment 1025/6206796 2023-10-03T19:21:21.639 INFO:teuthology.orchestra.run.smithi045.stdout: -4410> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 5 mds.0.log _expired segment 1025/6206796, 1024 events 2023-10-03T19:21:21.639 INFO:teuthology.orchestra.run.smithi045.stdout: -4409> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 MDSIOContextBase::complete: 20BatchStoredBacktrace 2023-10-03T19:21:21.640 INFO:teuthology.orchestra.run.smithi045.stdout: -4408> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 MDSContext::complete: 20BatchStoredBacktrace 2023-10-03T19:21:21.640 INFO:teuthology.orchestra.run.smithi045.stdout: -4407> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000053a) _stored_backtrace v 4284 2023-10-03T19:21:21.640 INFO:teuthology.orchestra.run.smithi045.stdout: -4406> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000053a) auth_unpin by 0x55cc9469f700 on [inode 0x1000000053a [2,head] /dc-dir/dc-file_837 auth v5676 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.178132+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9469f700] now 0 2023-10-03T19:21:21.640 INFO:teuthology.orchestra.run.smithi045.stdout: -4405> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+162 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9469f700 count now 1/162 2023-10-03T19:21:21.640 INFO:teuthology.orchestra.run.smithi045.stdout: -4404> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000053a) clear_dirty_parent 2023-10-03T19:21:21.640 INFO:teuthology.orchestra.run.smithi045.stdout: -4403> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000053b) _stored_backtrace v 4288 2023-10-03T19:21:21.641 INFO:teuthology.orchestra.run.smithi045.stdout: -4402> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000053b) auth_unpin by 0x55cc946ae000 on [inode 0x1000000053b [2,head] /dc-dir/dc-file_838 auth v5678 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.220090+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946ae000] now 0 2023-10-03T19:21:21.641 INFO:teuthology.orchestra.run.smithi045.stdout: -4401> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+161 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946ae000 count now 1/161 2023-10-03T19:21:21.641 INFO:teuthology.orchestra.run.smithi045.stdout: -4400> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000053b) clear_dirty_parent 2023-10-03T19:21:21.641 INFO:teuthology.orchestra.run.smithi045.stdout: -4399> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000053c) _stored_backtrace v 4292 2023-10-03T19:21:21.641 INFO:teuthology.orchestra.run.smithi045.stdout: -4398> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000053c) auth_unpin by 0x55cc946ae580 on [inode 0x1000000053c [2,head] /dc-dir/dc-file_839 auth v5680 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.233672+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946ae580] now 0 2023-10-03T19:21:21.642 INFO:teuthology.orchestra.run.smithi045.stdout: -4397> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+160 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946ae580 count now 1/160 2023-10-03T19:21:21.642 INFO:teuthology.orchestra.run.smithi045.stdout: -4396> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000053c) clear_dirty_parent 2023-10-03T19:21:21.642 INFO:teuthology.orchestra.run.smithi045.stdout: -4395> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000053d) _stored_backtrace v 4296 2023-10-03T19:21:21.642 INFO:teuthology.orchestra.run.smithi045.stdout: -4394> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000053d) auth_unpin by 0x55cc946aeb00 on [inode 0x1000000053d [2,head] /dc-dir/dc-file_840 auth v5682 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.245482+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946aeb00] now 0 2023-10-03T19:21:21.642 INFO:teuthology.orchestra.run.smithi045.stdout: -4393> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+159 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946aeb00 count now 1/159 2023-10-03T19:21:21.642 INFO:teuthology.orchestra.run.smithi045.stdout: -4392> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000053d) clear_dirty_parent 2023-10-03T19:21:21.642 INFO:teuthology.orchestra.run.smithi045.stdout: -4391> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000053e) _stored_backtrace v 4300 2023-10-03T19:21:21.643 INFO:teuthology.orchestra.run.smithi045.stdout: -4390> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000053e) auth_unpin by 0x55cc946af080 on [inode 0x1000000053e [2,head] /dc-dir/dc-file_841 auth v5684 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.256120+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946af080] now 0 2023-10-03T19:21:21.643 INFO:teuthology.orchestra.run.smithi045.stdout: -4389> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+158 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946af080 count now 1/158 2023-10-03T19:21:21.643 INFO:teuthology.orchestra.run.smithi045.stdout: -4388> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000053e) clear_dirty_parent 2023-10-03T19:21:21.643 INFO:teuthology.orchestra.run.smithi045.stdout: -4387> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000053f) _stored_backtrace v 4304 2023-10-03T19:21:21.643 INFO:teuthology.orchestra.run.smithi045.stdout: -4386> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000053f) auth_unpin by 0x55cc946af600 on [inode 0x1000000053f [2,head] /dc-dir/dc-file_842 auth v5686 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.267334+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946af600] now 0 2023-10-03T19:21:21.643 INFO:teuthology.orchestra.run.smithi045.stdout: -4385> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+157 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946af600 count now 1/157 2023-10-03T19:21:21.643 INFO:teuthology.orchestra.run.smithi045.stdout: -4384> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000053f) clear_dirty_parent 2023-10-03T19:21:21.644 INFO:teuthology.orchestra.run.smithi045.stdout: -4383> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000540) _stored_backtrace v 4308 2023-10-03T19:21:21.644 INFO:teuthology.orchestra.run.smithi045.stdout: -4382> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000540) auth_unpin by 0x55cc946afb80 on [inode 0x10000000540 [2,head] /dc-dir/dc-file_843 auth v5688 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.278182+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946afb80] now 0 2023-10-03T19:21:21.644 INFO:teuthology.orchestra.run.smithi045.stdout: -4381> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+156 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946afb80 count now 1/156 2023-10-03T19:21:21.644 INFO:teuthology.orchestra.run.smithi045.stdout: -4380> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000540) clear_dirty_parent 2023-10-03T19:21:21.644 INFO:teuthology.orchestra.run.smithi045.stdout: -4379> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000541) _stored_backtrace v 4312 2023-10-03T19:21:21.645 INFO:teuthology.orchestra.run.smithi045.stdout: -4378> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000541) auth_unpin by 0x55cc946b0100 on [inode 0x10000000541 [2,head] /dc-dir/dc-file_844 auth v5690 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.290367+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946b0100] now 0 2023-10-03T19:21:21.645 INFO:teuthology.orchestra.run.smithi045.stdout: -4377> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+155 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946b0100 count now 1/155 2023-10-03T19:21:21.645 INFO:teuthology.orchestra.run.smithi045.stdout: -4376> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000541) clear_dirty_parent 2023-10-03T19:21:21.645 INFO:teuthology.orchestra.run.smithi045.stdout: -4375> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000542) _stored_backtrace v 4316 2023-10-03T19:21:21.645 INFO:teuthology.orchestra.run.smithi045.stdout: -4374> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000542) auth_unpin by 0x55cc946b0680 on [inode 0x10000000542 [2,head] /dc-dir/dc-file_845 auth v5692 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.301930+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946b0680] now 0 2023-10-03T19:21:21.645 INFO:teuthology.orchestra.run.smithi045.stdout: -4373> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+154 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946b0680 count now 1/154 2023-10-03T19:21:21.645 INFO:teuthology.orchestra.run.smithi045.stdout: -4372> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000542) clear_dirty_parent 2023-10-03T19:21:21.646 INFO:teuthology.orchestra.run.smithi045.stdout: -4371> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000543) _stored_backtrace v 4320 2023-10-03T19:21:21.646 INFO:teuthology.orchestra.run.smithi045.stdout: -4370> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000543) auth_unpin by 0x55cc946b0c00 on [inode 0x10000000543 [2,head] /dc-dir/dc-file_846 auth v5694 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.313806+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946b0c00] now 0 2023-10-03T19:21:21.646 INFO:teuthology.orchestra.run.smithi045.stdout: -4369> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+153 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946b0c00 count now 1/153 2023-10-03T19:21:21.646 INFO:teuthology.orchestra.run.smithi045.stdout: -4368> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000543) clear_dirty_parent 2023-10-03T19:21:21.646 INFO:teuthology.orchestra.run.smithi045.stdout: -4367> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000544) _stored_backtrace v 4324 2023-10-03T19:21:21.646 INFO:teuthology.orchestra.run.smithi045.stdout: -4366> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000544) auth_unpin by 0x55cc946b1180 on [inode 0x10000000544 [2,head] /dc-dir/dc-file_847 auth v5696 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.325401+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946b1180] now 0 2023-10-03T19:21:21.646 INFO:teuthology.orchestra.run.smithi045.stdout: -4365> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+152 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946b1180 count now 1/152 2023-10-03T19:21:21.646 INFO:teuthology.orchestra.run.smithi045.stdout: -4364> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000544) clear_dirty_parent 2023-10-03T19:21:21.646 INFO:teuthology.orchestra.run.smithi045.stdout: -4363> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000545) _stored_backtrace v 4328 2023-10-03T19:21:21.646 INFO:teuthology.orchestra.run.smithi045.stdout: -4362> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000545) auth_unpin by 0x55cc946b1700 on [inode 0x10000000545 [2,head] /dc-dir/dc-file_848 auth v5698 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.337271+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946b1700] now 0 2023-10-03T19:21:21.647 INFO:teuthology.orchestra.run.smithi045.stdout: -4361> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+151 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946b1700 count now 1/151 2023-10-03T19:21:21.647 INFO:teuthology.orchestra.run.smithi045.stdout: -4360> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000545) clear_dirty_parent 2023-10-03T19:21:21.647 INFO:teuthology.orchestra.run.smithi045.stdout: -4359> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000546) _stored_backtrace v 4332 2023-10-03T19:21:21.647 INFO:teuthology.orchestra.run.smithi045.stdout: -4358> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000546) auth_unpin by 0x55cc946b8000 on [inode 0x10000000546 [2,head] /dc-dir/dc-file_849 auth v5700 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.348661+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946b8000] now 0 2023-10-03T19:21:21.647 INFO:teuthology.orchestra.run.smithi045.stdout: -4357> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+150 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946b8000 count now 1/150 2023-10-03T19:21:21.647 INFO:teuthology.orchestra.run.smithi045.stdout: -4356> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000546) clear_dirty_parent 2023-10-03T19:21:21.647 INFO:teuthology.orchestra.run.smithi045.stdout: -4355> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000547) _stored_backtrace v 4336 2023-10-03T19:21:21.647 INFO:teuthology.orchestra.run.smithi045.stdout: -4354> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000547) auth_unpin by 0x55cc946b8580 on [inode 0x10000000547 [2,head] /dc-dir/dc-file_850 auth v5702 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.360083+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946b8580] now 0 2023-10-03T19:21:21.647 INFO:teuthology.orchestra.run.smithi045.stdout: -4353> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+149 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946b8580 count now 1/149 2023-10-03T19:21:21.647 INFO:teuthology.orchestra.run.smithi045.stdout: -4352> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000547) clear_dirty_parent 2023-10-03T19:21:21.647 INFO:teuthology.orchestra.run.smithi045.stdout: -4351> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000548) _stored_backtrace v 4340 2023-10-03T19:21:21.648 INFO:teuthology.orchestra.run.smithi045.stdout: -4350> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000548) auth_unpin by 0x55cc946b8b00 on [inode 0x10000000548 [2,head] /dc-dir/dc-file_851 auth v5704 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.371799+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946b8b00] now 0 2023-10-03T19:21:21.648 INFO:teuthology.orchestra.run.smithi045.stdout: -4349> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+148 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946b8b00 count now 1/148 2023-10-03T19:21:21.648 INFO:teuthology.orchestra.run.smithi045.stdout: -4348> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000548) clear_dirty_parent 2023-10-03T19:21:21.648 INFO:teuthology.orchestra.run.smithi045.stdout: -4347> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000549) _stored_backtrace v 4344 2023-10-03T19:21:21.648 INFO:teuthology.orchestra.run.smithi045.stdout: -4346> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000549) auth_unpin by 0x55cc946b9080 on [inode 0x10000000549 [2,head] /dc-dir/dc-file_852 auth v5706 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.383562+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946b9080] now 0 2023-10-03T19:21:21.648 INFO:teuthology.orchestra.run.smithi045.stdout: -4345> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+147 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946b9080 count now 1/147 2023-10-03T19:21:21.648 INFO:teuthology.orchestra.run.smithi045.stdout: -4344> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000549) clear_dirty_parent 2023-10-03T19:21:21.648 INFO:teuthology.orchestra.run.smithi045.stdout: -4343> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000054a) _stored_backtrace v 4348 2023-10-03T19:21:21.648 INFO:teuthology.orchestra.run.smithi045.stdout: -4342> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000054a) auth_unpin by 0x55cc946b9600 on [inode 0x1000000054a [2,head] /dc-dir/dc-file_853 auth v5708 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.395661+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946b9600] now 0 2023-10-03T19:21:21.648 INFO:teuthology.orchestra.run.smithi045.stdout: -4341> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+146 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946b9600 count now 1/146 2023-10-03T19:21:21.648 INFO:teuthology.orchestra.run.smithi045.stdout: -4340> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000054a) clear_dirty_parent 2023-10-03T19:21:21.649 INFO:teuthology.orchestra.run.smithi045.stdout: -4339> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000054b) _stored_backtrace v 4352 2023-10-03T19:21:21.662 INFO:teuthology.orchestra.run.smithi045.stdout: -4338> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000054b) auth_unpin by 0x55cc946b9b80 on [inode 0x1000000054b [2,head] /dc-dir/dc-file_854 auth v5710 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.407078+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946b9b80] now 0 2023-10-03T19:21:21.662 INFO:teuthology.orchestra.run.smithi045.stdout: -4337> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+145 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946b9b80 count now 1/145 2023-10-03T19:21:21.663 INFO:teuthology.orchestra.run.smithi045.stdout: -4336> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000054b) clear_dirty_parent 2023-10-03T19:21:21.663 INFO:teuthology.orchestra.run.smithi045.stdout: -4335> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000054c) _stored_backtrace v 4356 2023-10-03T19:21:21.663 INFO:teuthology.orchestra.run.smithi045.stdout: -4334> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000054c) auth_unpin by 0x55cc946ba100 on [inode 0x1000000054c [2,head] /dc-dir/dc-file_855 auth v5712 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.419140+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946ba100] now 0 2023-10-03T19:21:21.663 INFO:teuthology.orchestra.run.smithi045.stdout: -4333> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+144 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946ba100 count now 1/144 2023-10-03T19:21:21.663 INFO:teuthology.orchestra.run.smithi045.stdout: -4332> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000054c) clear_dirty_parent 2023-10-03T19:21:21.663 INFO:teuthology.orchestra.run.smithi045.stdout: -4331> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000054d) _stored_backtrace v 4360 2023-10-03T19:21:21.663 INFO:teuthology.orchestra.run.smithi045.stdout: -4330> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000054d) auth_unpin by 0x55cc946ba680 on [inode 0x1000000054d [2,head] /dc-dir/dc-file_856 auth v5714 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.432283+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946ba680] now 0 2023-10-03T19:21:21.663 INFO:teuthology.orchestra.run.smithi045.stdout: -4329> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+143 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946ba680 count now 1/143 2023-10-03T19:21:21.663 INFO:teuthology.orchestra.run.smithi045.stdout: -4328> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000054d) clear_dirty_parent 2023-10-03T19:21:21.663 INFO:teuthology.orchestra.run.smithi045.stdout: -4327> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000054e) _stored_backtrace v 4364 2023-10-03T19:21:21.663 INFO:teuthology.orchestra.run.smithi045.stdout: -4326> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000054e) auth_unpin by 0x55cc946bac00 on [inode 0x1000000054e [2,head] /dc-dir/dc-file_857 auth v5716 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.445869+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946bac00] now 0 2023-10-03T19:21:21.664 INFO:teuthology.orchestra.run.smithi045.stdout: -4325> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+142 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946bac00 count now 1/142 2023-10-03T19:21:21.664 INFO:teuthology.orchestra.run.smithi045.stdout: -4324> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000054e) clear_dirty_parent 2023-10-03T19:21:21.664 INFO:teuthology.orchestra.run.smithi045.stdout: -4323> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000054f) _stored_backtrace v 4368 2023-10-03T19:21:21.664 INFO:teuthology.orchestra.run.smithi045.stdout: -4322> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000054f) auth_unpin by 0x55cc946bb180 on [inode 0x1000000054f [2,head] /dc-dir/dc-file_858 auth v5718 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.459222+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946bb180] now 0 2023-10-03T19:21:21.664 INFO:teuthology.orchestra.run.smithi045.stdout: -4321> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+141 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946bb180 count now 1/141 2023-10-03T19:21:21.664 INFO:teuthology.orchestra.run.smithi045.stdout: -4320> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000054f) clear_dirty_parent 2023-10-03T19:21:21.664 INFO:teuthology.orchestra.run.smithi045.stdout: -4319> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000550) _stored_backtrace v 4372 2023-10-03T19:21:21.664 INFO:teuthology.orchestra.run.smithi045.stdout: -4318> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000550) auth_unpin by 0x55cc946bb700 on [inode 0x10000000550 [2,head] /dc-dir/dc-file_859 auth v5720 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.471423+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946bb700] now 0 2023-10-03T19:21:21.664 INFO:teuthology.orchestra.run.smithi045.stdout: -4317> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+140 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946bb700 count now 1/140 2023-10-03T19:21:21.664 INFO:teuthology.orchestra.run.smithi045.stdout: -4316> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000550) clear_dirty_parent 2023-10-03T19:21:21.664 INFO:teuthology.orchestra.run.smithi045.stdout: -4315> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000551) _stored_backtrace v 4376 2023-10-03T19:21:21.665 INFO:teuthology.orchestra.run.smithi045.stdout: -4314> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000551) auth_unpin by 0x55cc946c2000 on [inode 0x10000000551 [2,head] /dc-dir/dc-file_860 auth v5722 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.484402+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946c2000] now 0 2023-10-03T19:21:21.665 INFO:teuthology.orchestra.run.smithi045.stdout: -4313> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+139 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946c2000 count now 1/139 2023-10-03T19:21:21.665 INFO:teuthology.orchestra.run.smithi045.stdout: -4312> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000551) clear_dirty_parent 2023-10-03T19:21:21.665 INFO:teuthology.orchestra.run.smithi045.stdout: -4311> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000552) _stored_backtrace v 4380 2023-10-03T19:21:21.665 INFO:teuthology.orchestra.run.smithi045.stdout: -4310> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000552) auth_unpin by 0x55cc946c2580 on [inode 0x10000000552 [2,head] /dc-dir/dc-file_861 auth v5724 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.495928+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946c2580] now 0 2023-10-03T19:21:21.665 INFO:teuthology.orchestra.run.smithi045.stdout: -4309> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+138 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946c2580 count now 1/138 2023-10-03T19:21:21.665 INFO:teuthology.orchestra.run.smithi045.stdout: -4308> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000552) clear_dirty_parent 2023-10-03T19:21:21.665 INFO:teuthology.orchestra.run.smithi045.stdout: -4307> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000553) _stored_backtrace v 4384 2023-10-03T19:21:21.665 INFO:teuthology.orchestra.run.smithi045.stdout: -4306> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000553) auth_unpin by 0x55cc946c2b00 on [inode 0x10000000553 [2,head] /dc-dir/dc-file_862 auth v5726 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.508230+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946c2b00] now 0 2023-10-03T19:21:21.665 INFO:teuthology.orchestra.run.smithi045.stdout: -4305> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+137 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946c2b00 count now 1/137 2023-10-03T19:21:21.666 INFO:teuthology.orchestra.run.smithi045.stdout: -4304> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000553) clear_dirty_parent 2023-10-03T19:21:21.666 INFO:teuthology.orchestra.run.smithi045.stdout: -4303> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000554) _stored_backtrace v 4388 2023-10-03T19:21:21.666 INFO:teuthology.orchestra.run.smithi045.stdout: -4302> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000554) auth_unpin by 0x55cc946c3080 on [inode 0x10000000554 [2,head] /dc-dir/dc-file_863 auth v5728 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.520493+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946c3080] now 0 2023-10-03T19:21:21.666 INFO:teuthology.orchestra.run.smithi045.stdout: -4301> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+136 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946c3080 count now 1/136 2023-10-03T19:21:21.666 INFO:teuthology.orchestra.run.smithi045.stdout: -4300> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000554) clear_dirty_parent 2023-10-03T19:21:21.666 INFO:teuthology.orchestra.run.smithi045.stdout: -4299> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000555) _stored_backtrace v 4392 2023-10-03T19:21:21.666 INFO:teuthology.orchestra.run.smithi045.stdout: -4298> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000555) auth_unpin by 0x55cc946c3600 on [inode 0x10000000555 [2,head] /dc-dir/dc-file_864 auth v5730 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.532364+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946c3600] now 0 2023-10-03T19:21:21.666 INFO:teuthology.orchestra.run.smithi045.stdout: -4297> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+135 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946c3600 count now 1/135 2023-10-03T19:21:21.666 INFO:teuthology.orchestra.run.smithi045.stdout: -4296> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000555) clear_dirty_parent 2023-10-03T19:21:21.666 INFO:teuthology.orchestra.run.smithi045.stdout: -4295> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000556) _stored_backtrace v 4396 2023-10-03T19:21:21.667 INFO:teuthology.orchestra.run.smithi045.stdout: -4294> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000556) auth_unpin by 0x55cc946c3b80 on [inode 0x10000000556 [2,head] /dc-dir/dc-file_865 auth v5732 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.543731+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946c3b80] now 0 2023-10-03T19:21:21.667 INFO:teuthology.orchestra.run.smithi045.stdout: -4293> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+134 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946c3b80 count now 1/134 2023-10-03T19:21:21.667 INFO:teuthology.orchestra.run.smithi045.stdout: -4292> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000556) clear_dirty_parent 2023-10-03T19:21:21.667 INFO:teuthology.orchestra.run.smithi045.stdout: -4291> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000557) _stored_backtrace v 4400 2023-10-03T19:21:21.667 INFO:teuthology.orchestra.run.smithi045.stdout: -4290> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000557) auth_unpin by 0x55cc946c4100 on [inode 0x10000000557 [2,head] /dc-dir/dc-file_866 auth v5734 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.557015+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946c4100] now 0 2023-10-03T19:21:21.667 INFO:teuthology.orchestra.run.smithi045.stdout: -4289> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+133 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946c4100 count now 1/133 2023-10-03T19:21:21.667 INFO:teuthology.orchestra.run.smithi045.stdout: -4288> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000557) clear_dirty_parent 2023-10-03T19:21:21.667 INFO:teuthology.orchestra.run.smithi045.stdout: -4287> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000558) _stored_backtrace v 4404 2023-10-03T19:21:21.667 INFO:teuthology.orchestra.run.smithi045.stdout: -4286> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000558) auth_unpin by 0x55cc946c4680 on [inode 0x10000000558 [2,head] /dc-dir/dc-file_867 auth v5736 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.570701+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946c4680] now 0 2023-10-03T19:21:21.667 INFO:teuthology.orchestra.run.smithi045.stdout: -4285> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+132 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946c4680 count now 1/132 2023-10-03T19:21:21.667 INFO:teuthology.orchestra.run.smithi045.stdout: -4284> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000558) clear_dirty_parent 2023-10-03T19:21:21.668 INFO:teuthology.orchestra.run.smithi045.stdout: -4283> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000559) _stored_backtrace v 4408 2023-10-03T19:21:21.668 INFO:teuthology.orchestra.run.smithi045.stdout: -4282> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000559) auth_unpin by 0x55cc946c4c00 on [inode 0x10000000559 [2,head] /dc-dir/dc-file_868 auth v5738 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.583174+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946c4c00] now 0 2023-10-03T19:21:21.668 INFO:teuthology.orchestra.run.smithi045.stdout: -4281> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+131 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946c4c00 count now 1/131 2023-10-03T19:21:21.668 INFO:teuthology.orchestra.run.smithi045.stdout: -4280> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000559) clear_dirty_parent 2023-10-03T19:21:21.668 INFO:teuthology.orchestra.run.smithi045.stdout: -4279> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000055a) _stored_backtrace v 4412 2023-10-03T19:21:21.668 INFO:teuthology.orchestra.run.smithi045.stdout: -4278> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000055a) auth_unpin by 0x55cc946c5180 on [inode 0x1000000055a [2,head] /dc-dir/dc-file_869 auth v5740 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.595618+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946c5180] now 0 2023-10-03T19:21:21.668 INFO:teuthology.orchestra.run.smithi045.stdout: -4277> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+130 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946c5180 count now 1/130 2023-10-03T19:21:21.668 INFO:teuthology.orchestra.run.smithi045.stdout: -4276> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000055a) clear_dirty_parent 2023-10-03T19:21:21.668 INFO:teuthology.orchestra.run.smithi045.stdout: -4275> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000055b) _stored_backtrace v 4416 2023-10-03T19:21:21.668 INFO:teuthology.orchestra.run.smithi045.stdout: -4274> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000055b) auth_unpin by 0x55cc946c5700 on [inode 0x1000000055b [2,head] /dc-dir/dc-file_870 auth v5742 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.607302+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946c5700] now 0 2023-10-03T19:21:21.669 INFO:teuthology.orchestra.run.smithi045.stdout: -4273> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+129 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946c5700 count now 1/129 2023-10-03T19:21:21.669 INFO:teuthology.orchestra.run.smithi045.stdout: -4272> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000055b) clear_dirty_parent 2023-10-03T19:21:21.669 INFO:teuthology.orchestra.run.smithi045.stdout: -4271> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000055c) _stored_backtrace v 4420 2023-10-03T19:21:21.669 INFO:teuthology.orchestra.run.smithi045.stdout: -4270> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000055c) auth_unpin by 0x55cc946ca000 on [inode 0x1000000055c [2,head] /dc-dir/dc-file_871 auth v5744 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.619119+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946ca000] now 0 2023-10-03T19:21:21.669 INFO:teuthology.orchestra.run.smithi045.stdout: -4269> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+128 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946ca000 count now 1/128 2023-10-03T19:21:21.669 INFO:teuthology.orchestra.run.smithi045.stdout: -4268> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000055c) clear_dirty_parent 2023-10-03T19:21:21.669 INFO:teuthology.orchestra.run.smithi045.stdout: -4267> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000055d) _stored_backtrace v 4424 2023-10-03T19:21:21.669 INFO:teuthology.orchestra.run.smithi045.stdout: -4266> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000055d) auth_unpin by 0x55cc946ca580 on [inode 0x1000000055d [2,head] /dc-dir/dc-file_872 auth v5746 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.630962+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946ca580] now 0 2023-10-03T19:21:21.669 INFO:teuthology.orchestra.run.smithi045.stdout: -4265> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+127 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946ca580 count now 1/127 2023-10-03T19:21:21.669 INFO:teuthology.orchestra.run.smithi045.stdout: -4264> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000055d) clear_dirty_parent 2023-10-03T19:21:21.669 INFO:teuthology.orchestra.run.smithi045.stdout: -4263> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000055e) _stored_backtrace v 4428 2023-10-03T19:21:21.670 INFO:teuthology.orchestra.run.smithi045.stdout: -4262> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000055e) auth_unpin by 0x55cc946cab00 on [inode 0x1000000055e [2,head] /dc-dir/dc-file_873 auth v5748 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.643881+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946cab00] now 0 2023-10-03T19:21:21.670 INFO:teuthology.orchestra.run.smithi045.stdout: -4261> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+126 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946cab00 count now 1/126 2023-10-03T19:21:21.670 INFO:teuthology.orchestra.run.smithi045.stdout: -4260> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000055e) clear_dirty_parent 2023-10-03T19:21:21.670 INFO:teuthology.orchestra.run.smithi045.stdout: -4259> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000055f) _stored_backtrace v 4432 2023-10-03T19:21:21.670 INFO:teuthology.orchestra.run.smithi045.stdout: -4258> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000055f) auth_unpin by 0x55cc946cb080 on [inode 0x1000000055f [2,head] /dc-dir/dc-file_874 auth v5750 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.655754+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946cb080] now 0 2023-10-03T19:21:21.670 INFO:teuthology.orchestra.run.smithi045.stdout: -4257> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+125 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946cb080 count now 1/125 2023-10-03T19:21:21.670 INFO:teuthology.orchestra.run.smithi045.stdout: -4256> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000055f) clear_dirty_parent 2023-10-03T19:21:21.670 INFO:teuthology.orchestra.run.smithi045.stdout: -4255> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000560) _stored_backtrace v 4436 2023-10-03T19:21:21.670 INFO:teuthology.orchestra.run.smithi045.stdout: -4254> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000560) auth_unpin by 0x55cc946cb600 on [inode 0x10000000560 [2,head] /dc-dir/dc-file_875 auth v5752 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.667368+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946cb600] now 0 2023-10-03T19:21:21.764 INFO:teuthology.orchestra.run.smithi045.stdout: -4253> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+124 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946cb600 count now 1/124 2023-10-03T19:21:21.764 INFO:teuthology.orchestra.run.smithi045.stdout: -4252> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000560) clear_dirty_parent 2023-10-03T19:21:21.764 INFO:teuthology.orchestra.run.smithi045.stdout: -4251> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000561) _stored_backtrace v 4440 2023-10-03T19:21:21.764 INFO:teuthology.orchestra.run.smithi045.stdout: -4250> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000561) auth_unpin by 0x55cc946cbb80 on [inode 0x10000000561 [2,head] /dc-dir/dc-file_876 auth v5754 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.679877+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946cbb80] now 0 2023-10-03T19:21:21.765 INFO:teuthology.orchestra.run.smithi045.stdout: -4249> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+123 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946cbb80 count now 1/123 2023-10-03T19:21:21.765 INFO:teuthology.orchestra.run.smithi045.stdout: -4248> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000561) clear_dirty_parent 2023-10-03T19:21:21.765 INFO:teuthology.orchestra.run.smithi045.stdout: -4247> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000562) _stored_backtrace v 4444 2023-10-03T19:21:21.765 INFO:teuthology.orchestra.run.smithi045.stdout: -4246> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000562) auth_unpin by 0x55cc946cc100 on [inode 0x10000000562 [2,head] /dc-dir/dc-file_877 auth v5756 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.692441+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946cc100] now 0 2023-10-03T19:21:21.765 INFO:teuthology.orchestra.run.smithi045.stdout: -4245> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+122 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946cc100 count now 1/122 2023-10-03T19:21:21.765 INFO:teuthology.orchestra.run.smithi045.stdout: -4244> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000562) clear_dirty_parent 2023-10-03T19:21:21.765 INFO:teuthology.orchestra.run.smithi045.stdout: -4243> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000563) _stored_backtrace v 4448 2023-10-03T19:21:21.765 INFO:teuthology.orchestra.run.smithi045.stdout: -4242> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000563) auth_unpin by 0x55cc946cc680 on [inode 0x10000000563 [2,head] /dc-dir/dc-file_878 auth v5758 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.706166+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946cc680] now 0 2023-10-03T19:21:21.765 INFO:teuthology.orchestra.run.smithi045.stdout: -4241> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+121 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946cc680 count now 1/121 2023-10-03T19:21:21.765 INFO:teuthology.orchestra.run.smithi045.stdout: -4240> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000563) clear_dirty_parent 2023-10-03T19:21:21.766 INFO:teuthology.orchestra.run.smithi045.stdout: -4239> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000564) _stored_backtrace v 4452 2023-10-03T19:21:21.766 INFO:teuthology.orchestra.run.smithi045.stdout: -4238> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000564) auth_unpin by 0x55cc946ccc00 on [inode 0x10000000564 [2,head] /dc-dir/dc-file_879 auth v5760 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.717695+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946ccc00] now 0 2023-10-03T19:21:21.766 INFO:teuthology.orchestra.run.smithi045.stdout: -4237> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+120 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946ccc00 count now 1/120 2023-10-03T19:21:21.766 INFO:teuthology.orchestra.run.smithi045.stdout: -4236> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000564) clear_dirty_parent 2023-10-03T19:21:21.766 INFO:teuthology.orchestra.run.smithi045.stdout: -4235> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000565) _stored_backtrace v 4456 2023-10-03T19:21:21.766 INFO:teuthology.orchestra.run.smithi045.stdout: -4234> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000565) auth_unpin by 0x55cc946cd180 on [inode 0x10000000565 [2,head] /dc-dir/dc-file_880 auth v5762 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.729649+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946cd180] now 0 2023-10-03T19:21:21.766 INFO:teuthology.orchestra.run.smithi045.stdout: -4233> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+119 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946cd180 count now 1/119 2023-10-03T19:21:21.766 INFO:teuthology.orchestra.run.smithi045.stdout: -4232> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000565) clear_dirty_parent 2023-10-03T19:21:21.766 INFO:teuthology.orchestra.run.smithi045.stdout: -4231> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000566) _stored_backtrace v 4460 2023-10-03T19:21:21.766 INFO:teuthology.orchestra.run.smithi045.stdout: -4230> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000566) auth_unpin by 0x55cc946cd700 on [inode 0x10000000566 [2,head] /dc-dir/dc-file_881 auth v5764 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.742340+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946cd700] now 0 2023-10-03T19:21:21.767 INFO:teuthology.orchestra.run.smithi045.stdout: -4229> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+118 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946cd700 count now 1/118 2023-10-03T19:21:21.767 INFO:teuthology.orchestra.run.smithi045.stdout: -4228> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000566) clear_dirty_parent 2023-10-03T19:21:21.767 INFO:teuthology.orchestra.run.smithi045.stdout: -4227> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000567) _stored_backtrace v 4464 2023-10-03T19:21:21.767 INFO:teuthology.orchestra.run.smithi045.stdout: -4226> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000567) auth_unpin by 0x55cc946d2000 on [inode 0x10000000567 [2,head] /dc-dir/dc-file_882 auth v5766 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.754571+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946d2000] now 0 2023-10-03T19:21:21.767 INFO:teuthology.orchestra.run.smithi045.stdout: -4225> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+117 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946d2000 count now 1/117 2023-10-03T19:21:21.767 INFO:teuthology.orchestra.run.smithi045.stdout: -4224> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000567) clear_dirty_parent 2023-10-03T19:21:21.767 INFO:teuthology.orchestra.run.smithi045.stdout: -4223> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000568) _stored_backtrace v 4468 2023-10-03T19:21:21.767 INFO:teuthology.orchestra.run.smithi045.stdout: -4222> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000568) auth_unpin by 0x55cc946d2580 on [inode 0x10000000568 [2,head] /dc-dir/dc-file_883 auth v5768 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.766560+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946d2580] now 0 2023-10-03T19:21:21.767 INFO:teuthology.orchestra.run.smithi045.stdout: -4221> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+116 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946d2580 count now 1/116 2023-10-03T19:21:21.767 INFO:teuthology.orchestra.run.smithi045.stdout: -4220> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000568) clear_dirty_parent 2023-10-03T19:21:21.767 INFO:teuthology.orchestra.run.smithi045.stdout: -4219> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000569) _stored_backtrace v 4472 2023-10-03T19:21:21.767 INFO:teuthology.orchestra.run.smithi045.stdout: -4218> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000569) auth_unpin by 0x55cc946d2b00 on [inode 0x10000000569 [2,head] /dc-dir/dc-file_884 auth v5770 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.778595+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946d2b00] now 0 2023-10-03T19:21:21.768 INFO:teuthology.orchestra.run.smithi045.stdout: -4217> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+115 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946d2b00 count now 1/115 2023-10-03T19:21:21.768 INFO:teuthology.orchestra.run.smithi045.stdout: -4216> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000569) clear_dirty_parent 2023-10-03T19:21:21.768 INFO:teuthology.orchestra.run.smithi045.stdout: -4215> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000056a) _stored_backtrace v 4476 2023-10-03T19:21:21.768 INFO:teuthology.orchestra.run.smithi045.stdout: -4214> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000056a) auth_unpin by 0x55cc946d3080 on [inode 0x1000000056a [2,head] /dc-dir/dc-file_885 auth v5772 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.790907+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946d3080] now 0 2023-10-03T19:21:21.768 INFO:teuthology.orchestra.run.smithi045.stdout: -4213> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+114 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946d3080 count now 1/114 2023-10-03T19:21:21.768 INFO:teuthology.orchestra.run.smithi045.stdout: -4212> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000056a) clear_dirty_parent 2023-10-03T19:21:21.768 INFO:teuthology.orchestra.run.smithi045.stdout: -4211> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000056b) _stored_backtrace v 4480 2023-10-03T19:21:21.768 INFO:teuthology.orchestra.run.smithi045.stdout: -4210> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000056b) auth_unpin by 0x55cc946d3600 on [inode 0x1000000056b [2,head] /dc-dir/dc-file_886 auth v5774 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.803145+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946d3600] now 0 2023-10-03T19:21:21.768 INFO:teuthology.orchestra.run.smithi045.stdout: -4209> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+113 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946d3600 count now 1/113 2023-10-03T19:21:21.768 INFO:teuthology.orchestra.run.smithi045.stdout: -4208> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000056b) clear_dirty_parent 2023-10-03T19:21:21.769 INFO:teuthology.orchestra.run.smithi045.stdout: -4207> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000056c) _stored_backtrace v 4484 2023-10-03T19:21:21.769 INFO:teuthology.orchestra.run.smithi045.stdout: -4206> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000056c) auth_unpin by 0x55cc946d3b80 on [inode 0x1000000056c [2,head] /dc-dir/dc-file_887 auth v5776 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.816007+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946d3b80] now 0 2023-10-03T19:21:21.769 INFO:teuthology.orchestra.run.smithi045.stdout: -4205> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+112 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946d3b80 count now 1/112 2023-10-03T19:21:21.769 INFO:teuthology.orchestra.run.smithi045.stdout: -4204> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000056c) clear_dirty_parent 2023-10-03T19:21:21.769 INFO:teuthology.orchestra.run.smithi045.stdout: -4203> 2023-10-03T19:18:09.853+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000056d) _stored_backtrace v 4488 2023-10-03T19:21:21.769 INFO:teuthology.orchestra.run.smithi045.stdout: -4202> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000056d) auth_unpin by 0x55cc946d4100 on [inode 0x1000000056d [2,head] /dc-dir/dc-file_888 auth v5778 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.829564+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946d4100] now 0 2023-10-03T19:21:21.769 INFO:teuthology.orchestra.run.smithi045.stdout: -4201> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+111 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946d4100 count now 1/111 2023-10-03T19:21:21.769 INFO:teuthology.orchestra.run.smithi045.stdout: -4200> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000056d) clear_dirty_parent 2023-10-03T19:21:21.769 INFO:teuthology.orchestra.run.smithi045.stdout: -4199> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000056e) _stored_backtrace v 4492 2023-10-03T19:21:21.769 INFO:teuthology.orchestra.run.smithi045.stdout: -4198> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000056e) auth_unpin by 0x55cc946d4680 on [inode 0x1000000056e [2,head] /dc-dir/dc-file_889 auth v5780 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.841538+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946d4680] now 0 2023-10-03T19:21:21.769 INFO:teuthology.orchestra.run.smithi045.stdout: -4197> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+110 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946d4680 count now 1/110 2023-10-03T19:21:21.770 INFO:teuthology.orchestra.run.smithi045.stdout: -4196> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000056e) clear_dirty_parent 2023-10-03T19:21:21.770 INFO:teuthology.orchestra.run.smithi045.stdout: -4195> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000056f) _stored_backtrace v 4496 2023-10-03T19:21:21.770 INFO:teuthology.orchestra.run.smithi045.stdout: -4194> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000056f) auth_unpin by 0x55cc946d4c00 on [inode 0x1000000056f [2,head] /dc-dir/dc-file_890 auth v5782 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.854602+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946d4c00] now 0 2023-10-03T19:21:21.770 INFO:teuthology.orchestra.run.smithi045.stdout: -4193> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+109 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946d4c00 count now 1/109 2023-10-03T19:21:21.770 INFO:teuthology.orchestra.run.smithi045.stdout: -4192> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000056f) clear_dirty_parent 2023-10-03T19:21:21.770 INFO:teuthology.orchestra.run.smithi045.stdout: -4191> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000570) _stored_backtrace v 4500 2023-10-03T19:21:21.770 INFO:teuthology.orchestra.run.smithi045.stdout: -4190> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000570) auth_unpin by 0x55cc946d5180 on [inode 0x10000000570 [2,head] /dc-dir/dc-file_891 auth v5784 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.869295+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946d5180] now 0 2023-10-03T19:21:21.770 INFO:teuthology.orchestra.run.smithi045.stdout: -4189> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+108 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946d5180 count now 1/108 2023-10-03T19:21:21.770 INFO:teuthology.orchestra.run.smithi045.stdout: -4188> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000570) clear_dirty_parent 2023-10-03T19:21:21.770 INFO:teuthology.orchestra.run.smithi045.stdout: -4187> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000571) _stored_backtrace v 4504 2023-10-03T19:21:21.770 INFO:teuthology.orchestra.run.smithi045.stdout: -4186> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000571) auth_unpin by 0x55cc946d5700 on [inode 0x10000000571 [2,head] /dc-dir/dc-file_892 auth v5786 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.883169+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946d5700] now 0 2023-10-03T19:21:21.771 INFO:teuthology.orchestra.run.smithi045.stdout: -4185> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+107 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946d5700 count now 1/107 2023-10-03T19:21:21.771 INFO:teuthology.orchestra.run.smithi045.stdout: -4184> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000571) clear_dirty_parent 2023-10-03T19:21:21.771 INFO:teuthology.orchestra.run.smithi045.stdout: -4183> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000572) _stored_backtrace v 4508 2023-10-03T19:21:21.771 INFO:teuthology.orchestra.run.smithi045.stdout: -4182> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000572) auth_unpin by 0x55cc946dc000 on [inode 0x10000000572 [2,head] /dc-dir/dc-file_893 auth v5788 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.897890+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946dc000] now 0 2023-10-03T19:21:21.771 INFO:teuthology.orchestra.run.smithi045.stdout: -4181> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+106 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946dc000 count now 1/106 2023-10-03T19:21:21.771 INFO:teuthology.orchestra.run.smithi045.stdout: -4180> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000572) clear_dirty_parent 2023-10-03T19:21:21.771 INFO:teuthology.orchestra.run.smithi045.stdout: -4179> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000573) _stored_backtrace v 4512 2023-10-03T19:21:21.771 INFO:teuthology.orchestra.run.smithi045.stdout: -4178> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000573) auth_unpin by 0x55cc946dc580 on [inode 0x10000000573 [2,head] /dc-dir/dc-file_894 auth v5790 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.910829+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946dc580] now 0 2023-10-03T19:21:21.789 INFO:teuthology.orchestra.run.smithi045.stdout: -4177> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+105 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946dc580 count now 1/105 2023-10-03T19:21:21.789 INFO:teuthology.orchestra.run.smithi045.stdout: -4176> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000573) clear_dirty_parent 2023-10-03T19:21:21.789 INFO:teuthology.orchestra.run.smithi045.stdout: -4175> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000574) _stored_backtrace v 4516 2023-10-03T19:21:21.789 INFO:teuthology.orchestra.run.smithi045.stdout: -4174> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000574) auth_unpin by 0x55cc946dcb00 on [inode 0x10000000574 [2,head] /dc-dir/dc-file_895 auth v5792 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.923001+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946dcb00] now 0 2023-10-03T19:21:21.789 INFO:teuthology.orchestra.run.smithi045.stdout: -4173> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+104 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946dcb00 count now 1/104 2023-10-03T19:21:21.789 INFO:teuthology.orchestra.run.smithi045.stdout: -4172> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000574) clear_dirty_parent 2023-10-03T19:21:21.789 INFO:teuthology.orchestra.run.smithi045.stdout: -4171> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000575) _stored_backtrace v 4520 2023-10-03T19:21:21.790 INFO:teuthology.orchestra.run.smithi045.stdout: -4170> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000575) auth_unpin by 0x55cc946dd080 on [inode 0x10000000575 [2,head] /dc-dir/dc-file_896 auth v5794 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.934564+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946dd080] now 0 2023-10-03T19:21:21.790 INFO:teuthology.orchestra.run.smithi045.stdout: -4169> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+103 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946dd080 count now 1/103 2023-10-03T19:21:21.790 INFO:teuthology.orchestra.run.smithi045.stdout: -4168> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000575) clear_dirty_parent 2023-10-03T19:21:21.790 INFO:teuthology.orchestra.run.smithi045.stdout: -4167> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000576) _stored_backtrace v 4524 2023-10-03T19:21:21.790 INFO:teuthology.orchestra.run.smithi045.stdout: -4166> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000576) auth_unpin by 0x55cc946dd600 on [inode 0x10000000576 [2,head] /dc-dir/dc-file_897 auth v5796 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.947371+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946dd600] now 0 2023-10-03T19:21:21.790 INFO:teuthology.orchestra.run.smithi045.stdout: -4165> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+102 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946dd600 count now 1/102 2023-10-03T19:21:21.790 INFO:teuthology.orchestra.run.smithi045.stdout: -4164> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000576) clear_dirty_parent 2023-10-03T19:21:21.790 INFO:teuthology.orchestra.run.smithi045.stdout: -4163> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000577) _stored_backtrace v 4528 2023-10-03T19:21:21.790 INFO:teuthology.orchestra.run.smithi045.stdout: -4162> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000577) auth_unpin by 0x55cc946ddb80 on [inode 0x10000000577 [2,head] /dc-dir/dc-file_898 auth v5798 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.958959+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946ddb80] now 0 2023-10-03T19:21:21.790 INFO:teuthology.orchestra.run.smithi045.stdout: -4161> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+101 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946ddb80 count now 1/101 2023-10-03T19:21:21.791 INFO:teuthology.orchestra.run.smithi045.stdout: -4160> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000577) clear_dirty_parent 2023-10-03T19:21:21.791 INFO:teuthology.orchestra.run.smithi045.stdout: -4159> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000578) _stored_backtrace v 4532 2023-10-03T19:21:21.791 INFO:teuthology.orchestra.run.smithi045.stdout: -4158> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000578) auth_unpin by 0x55cc946de100 on [inode 0x10000000578 [2,head] /dc-dir/dc-file_899 auth v5800 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.970758+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946de100] now 0 2023-10-03T19:21:21.791 INFO:teuthology.orchestra.run.smithi045.stdout: -4157> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+100 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946de100 count now 1/100 2023-10-03T19:21:21.791 INFO:teuthology.orchestra.run.smithi045.stdout: -4156> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000578) clear_dirty_parent 2023-10-03T19:21:21.791 INFO:teuthology.orchestra.run.smithi045.stdout: -4155> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000579) _stored_backtrace v 4536 2023-10-03T19:21:21.791 INFO:teuthology.orchestra.run.smithi045.stdout: -4154> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000579) auth_unpin by 0x55cc946de680 on [inode 0x10000000579 [2,head] /dc-dir/dc-file_900 auth v5802 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.982312+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946de680] now 0 2023-10-03T19:21:21.791 INFO:teuthology.orchestra.run.smithi045.stdout: -4153> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+99 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946de680 count now 1/99 2023-10-03T19:21:21.791 INFO:teuthology.orchestra.run.smithi045.stdout: -4152> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000579) clear_dirty_parent 2023-10-03T19:21:21.791 INFO:teuthology.orchestra.run.smithi045.stdout: -4151> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000057a) _stored_backtrace v 4540 2023-10-03T19:21:21.791 INFO:teuthology.orchestra.run.smithi045.stdout: -4150> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000057a) auth_unpin by 0x55cc946dec00 on [inode 0x1000000057a [2,head] /dc-dir/dc-file_901 auth v5804 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:56.994266+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946dec00] now 0 2023-10-03T19:21:21.792 INFO:teuthology.orchestra.run.smithi045.stdout: -4149> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+98 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946dec00 count now 1/98 2023-10-03T19:21:21.792 INFO:teuthology.orchestra.run.smithi045.stdout: -4148> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000057a) clear_dirty_parent 2023-10-03T19:21:21.792 INFO:teuthology.orchestra.run.smithi045.stdout: -4147> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000057b) _stored_backtrace v 4544 2023-10-03T19:21:21.792 INFO:teuthology.orchestra.run.smithi045.stdout: -4146> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000057b) auth_unpin by 0x55cc946df180 on [inode 0x1000000057b [2,head] /dc-dir/dc-file_902 auth v5806 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.005725+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946df180] now 0 2023-10-03T19:21:21.792 INFO:teuthology.orchestra.run.smithi045.stdout: -4145> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+97 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946df180 count now 1/97 2023-10-03T19:21:21.792 INFO:teuthology.orchestra.run.smithi045.stdout: -4144> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000057b) clear_dirty_parent 2023-10-03T19:21:21.792 INFO:teuthology.orchestra.run.smithi045.stdout: -4143> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000057c) _stored_backtrace v 4548 2023-10-03T19:21:21.792 INFO:teuthology.orchestra.run.smithi045.stdout: -4142> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000057c) auth_unpin by 0x55cc946df700 on [inode 0x1000000057c [2,head] /dc-dir/dc-file_903 auth v5808 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.017638+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946df700] now 0 2023-10-03T19:21:21.792 INFO:teuthology.orchestra.run.smithi045.stdout: -4141> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+96 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946df700 count now 1/96 2023-10-03T19:21:21.792 INFO:teuthology.orchestra.run.smithi045.stdout: -4140> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000057c) clear_dirty_parent 2023-10-03T19:21:21.793 INFO:teuthology.orchestra.run.smithi045.stdout: -4139> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000057d) _stored_backtrace v 4552 2023-10-03T19:21:21.793 INFO:teuthology.orchestra.run.smithi045.stdout: -4138> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000057d) auth_unpin by 0x55cc946e4000 on [inode 0x1000000057d [2,head] /dc-dir/dc-file_904 auth v5810 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.029441+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946e4000] now 0 2023-10-03T19:21:21.793 INFO:teuthology.orchestra.run.smithi045.stdout: -4137> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+95 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946e4000 count now 1/95 2023-10-03T19:21:21.793 INFO:teuthology.orchestra.run.smithi045.stdout: -4136> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000057d) clear_dirty_parent 2023-10-03T19:21:21.793 INFO:teuthology.orchestra.run.smithi045.stdout: -4135> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000057e) _stored_backtrace v 4556 2023-10-03T19:21:21.793 INFO:teuthology.orchestra.run.smithi045.stdout: -4134> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000057e) auth_unpin by 0x55cc946e4580 on [inode 0x1000000057e [2,head] /dc-dir/dc-file_905 auth v5812 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.041526+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946e4580] now 0 2023-10-03T19:21:21.793 INFO:teuthology.orchestra.run.smithi045.stdout: -4133> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+94 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946e4580 count now 1/94 2023-10-03T19:21:21.793 INFO:teuthology.orchestra.run.smithi045.stdout: -4132> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000057e) clear_dirty_parent 2023-10-03T19:21:21.793 INFO:teuthology.orchestra.run.smithi045.stdout: -4131> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000057f) _stored_backtrace v 4560 2023-10-03T19:21:21.793 INFO:teuthology.orchestra.run.smithi045.stdout: -4130> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000057f) auth_unpin by 0x55cc946e4b00 on [inode 0x1000000057f [2,head] /dc-dir/dc-file_906 auth v5814 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.053715+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946e4b00] now 0 2023-10-03T19:21:21.794 INFO:teuthology.orchestra.run.smithi045.stdout: -4129> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+93 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946e4b00 count now 1/93 2023-10-03T19:21:21.794 INFO:teuthology.orchestra.run.smithi045.stdout: -4128> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000057f) clear_dirty_parent 2023-10-03T19:21:21.794 INFO:teuthology.orchestra.run.smithi045.stdout: -4127> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000580) _stored_backtrace v 4564 2023-10-03T19:21:21.794 INFO:teuthology.orchestra.run.smithi045.stdout: -4126> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000580) auth_unpin by 0x55cc946e5080 on [inode 0x10000000580 [2,head] /dc-dir/dc-file_907 auth v5816 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.065995+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946e5080] now 0 2023-10-03T19:21:21.794 INFO:teuthology.orchestra.run.smithi045.stdout: -4125> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+92 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946e5080 count now 1/92 2023-10-03T19:21:21.794 INFO:teuthology.orchestra.run.smithi045.stdout: -4124> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000580) clear_dirty_parent 2023-10-03T19:21:21.794 INFO:teuthology.orchestra.run.smithi045.stdout: -4123> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000581) _stored_backtrace v 4568 2023-10-03T19:21:21.794 INFO:teuthology.orchestra.run.smithi045.stdout: -4122> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000581) auth_unpin by 0x55cc946e5600 on [inode 0x10000000581 [2,head] /dc-dir/dc-file_908 auth v5818 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.078197+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946e5600] now 0 2023-10-03T19:21:21.794 INFO:teuthology.orchestra.run.smithi045.stdout: -4121> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+91 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946e5600 count now 1/91 2023-10-03T19:21:21.794 INFO:teuthology.orchestra.run.smithi045.stdout: -4120> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000581) clear_dirty_parent 2023-10-03T19:21:21.794 INFO:teuthology.orchestra.run.smithi045.stdout: -4119> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000582) _stored_backtrace v 4572 2023-10-03T19:21:21.795 INFO:teuthology.orchestra.run.smithi045.stdout: -4118> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000582) auth_unpin by 0x55cc946e5b80 on [inode 0x10000000582 [2,head] /dc-dir/dc-file_909 auth v5820 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.089539+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946e5b80] now 0 2023-10-03T19:21:21.795 INFO:teuthology.orchestra.run.smithi045.stdout: -4117> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+90 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946e5b80 count now 1/90 2023-10-03T19:21:21.795 INFO:teuthology.orchestra.run.smithi045.stdout: -4116> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000582) clear_dirty_parent 2023-10-03T19:21:21.795 INFO:teuthology.orchestra.run.smithi045.stdout: -4115> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000583) _stored_backtrace v 4576 2023-10-03T19:21:21.795 INFO:teuthology.orchestra.run.smithi045.stdout: -4114> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000583) auth_unpin by 0x55cc946e6100 on [inode 0x10000000583 [2,head] /dc-dir/dc-file_910 auth v5822 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.101860+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946e6100] now 0 2023-10-03T19:21:21.795 INFO:teuthology.orchestra.run.smithi045.stdout: -4113> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+89 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946e6100 count now 1/89 2023-10-03T19:21:21.795 INFO:teuthology.orchestra.run.smithi045.stdout: -4112> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000583) clear_dirty_parent 2023-10-03T19:21:21.795 INFO:teuthology.orchestra.run.smithi045.stdout: -4111> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000584) _stored_backtrace v 4742 2023-10-03T19:21:21.795 INFO:teuthology.orchestra.run.smithi045.stdout: -4110> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000584) auth_unpin by 0x55cc946e6680 on [inode 0x10000000584 [2,head] /dc-dir/dc-file_911 auth v5824 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.191043+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946e6680] now 0 2023-10-03T19:21:21.795 INFO:teuthology.orchestra.run.smithi045.stdout: -4109> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+88 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946e6680 count now 1/88 2023-10-03T19:21:21.796 INFO:teuthology.orchestra.run.smithi045.stdout: -4108> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000584) clear_dirty_parent 2023-10-03T19:21:21.796 INFO:teuthology.orchestra.run.smithi045.stdout: -4107> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000585) _stored_backtrace v 4746 2023-10-03T19:21:21.796 INFO:teuthology.orchestra.run.smithi045.stdout: -4106> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000585) auth_unpin by 0x55cc946e6c00 on [inode 0x10000000585 [2,head] /dc-dir/dc-file_912 auth v5826 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.248771+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946e6c00] now 0 2023-10-03T19:21:21.796 INFO:teuthology.orchestra.run.smithi045.stdout: -4105> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+87 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946e6c00 count now 1/87 2023-10-03T19:21:21.796 INFO:teuthology.orchestra.run.smithi045.stdout: -4104> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000585) clear_dirty_parent 2023-10-03T19:21:21.796 INFO:teuthology.orchestra.run.smithi045.stdout: -4103> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000586) _stored_backtrace v 4750 2023-10-03T19:21:21.796 INFO:teuthology.orchestra.run.smithi045.stdout: -4102> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000586) auth_unpin by 0x55cc946e7180 on [inode 0x10000000586 [2,head] /dc-dir/dc-file_913 auth v5828 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.261813+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946e7180] now 0 2023-10-03T19:21:21.796 INFO:teuthology.orchestra.run.smithi045.stdout: -4101> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+86 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946e7180 count now 1/86 2023-10-03T19:21:21.796 INFO:teuthology.orchestra.run.smithi045.stdout: -4100> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000586) clear_dirty_parent 2023-10-03T19:21:21.796 INFO:teuthology.orchestra.run.smithi045.stdout: -4099> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000587) _stored_backtrace v 4754 2023-10-03T19:21:21.796 INFO:teuthology.orchestra.run.smithi045.stdout: -4098> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000587) auth_unpin by 0x55cc946e7700 on [inode 0x10000000587 [2,head] /dc-dir/dc-file_914 auth v5830 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.274199+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc946e7700] now 0 2023-10-03T19:21:21.797 INFO:teuthology.orchestra.run.smithi045.stdout: -4097> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+85 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc946e7700 count now 1/85 2023-10-03T19:21:21.797 INFO:teuthology.orchestra.run.smithi045.stdout: -4096> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000587) clear_dirty_parent 2023-10-03T19:21:21.797 INFO:teuthology.orchestra.run.smithi045.stdout: -4095> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000588) _stored_backtrace v 4758 2023-10-03T19:21:21.797 INFO:teuthology.orchestra.run.smithi045.stdout: -4094> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000588) auth_unpin by 0x55cc9475c000 on [inode 0x10000000588 [2,head] /dc-dir/dc-file_915 auth v5832 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.285737+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9475c000] now 0 2023-10-03T19:21:21.797 INFO:teuthology.orchestra.run.smithi045.stdout: -4093> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+84 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9475c000 count now 1/84 2023-10-03T19:21:21.797 INFO:teuthology.orchestra.run.smithi045.stdout: -4092> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000588) clear_dirty_parent 2023-10-03T19:21:21.797 INFO:teuthology.orchestra.run.smithi045.stdout: -4091> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000589) _stored_backtrace v 4762 2023-10-03T19:21:21.797 INFO:teuthology.orchestra.run.smithi045.stdout: -4090> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000589) auth_unpin by 0x55cc9475c580 on [inode 0x10000000589 [2,head] /dc-dir/dc-file_916 auth v5834 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.298068+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9475c580] now 0 2023-10-03T19:21:21.812 INFO:teuthology.orchestra.run.smithi045.stdout: -4089> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+83 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9475c580 count now 1/83 2023-10-03T19:21:21.812 INFO:teuthology.orchestra.run.smithi045.stdout: -4088> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000589) clear_dirty_parent 2023-10-03T19:21:21.813 INFO:teuthology.orchestra.run.smithi045.stdout: -4087> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000058a) _stored_backtrace v 4766 2023-10-03T19:21:21.813 INFO:teuthology.orchestra.run.smithi045.stdout: -4086> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000058a) auth_unpin by 0x55cc9475cb00 on [inode 0x1000000058a [2,head] /dc-dir/dc-file_917 auth v5836 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.309902+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9475cb00] now 0 2023-10-03T19:21:21.813 INFO:teuthology.orchestra.run.smithi045.stdout: -4085> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+82 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9475cb00 count now 1/82 2023-10-03T19:21:21.813 INFO:teuthology.orchestra.run.smithi045.stdout: -4084> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000058a) clear_dirty_parent 2023-10-03T19:21:21.813 INFO:teuthology.orchestra.run.smithi045.stdout: -4083> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000058b) _stored_backtrace v 4770 2023-10-03T19:21:21.813 INFO:teuthology.orchestra.run.smithi045.stdout: -4082> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000058b) auth_unpin by 0x55cc9475d080 on [inode 0x1000000058b [2,head] /dc-dir/dc-file_918 auth v5838 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.322449+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9475d080] now 0 2023-10-03T19:21:21.813 INFO:teuthology.orchestra.run.smithi045.stdout: -4081> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+81 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9475d080 count now 1/81 2023-10-03T19:21:21.813 INFO:teuthology.orchestra.run.smithi045.stdout: -4080> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000058b) clear_dirty_parent 2023-10-03T19:21:21.813 INFO:teuthology.orchestra.run.smithi045.stdout: -4079> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000058c) _stored_backtrace v 4774 2023-10-03T19:21:21.813 INFO:teuthology.orchestra.run.smithi045.stdout: -4078> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000058c) auth_unpin by 0x55cc9475d600 on [inode 0x1000000058c [2,head] /dc-dir/dc-file_919 auth v5840 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.334165+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9475d600] now 0 2023-10-03T19:21:21.813 INFO:teuthology.orchestra.run.smithi045.stdout: -4077> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+80 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9475d600 count now 1/80 2023-10-03T19:21:21.814 INFO:teuthology.orchestra.run.smithi045.stdout: -4076> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000058c) clear_dirty_parent 2023-10-03T19:21:21.814 INFO:teuthology.orchestra.run.smithi045.stdout: -4075> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000058d) _stored_backtrace v 4778 2023-10-03T19:21:21.814 INFO:teuthology.orchestra.run.smithi045.stdout: -4074> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000058d) auth_unpin by 0x55cc9475db80 on [inode 0x1000000058d [2,head] /dc-dir/dc-file_920 auth v5842 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.345546+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9475db80] now 0 2023-10-03T19:21:21.814 INFO:teuthology.orchestra.run.smithi045.stdout: -4073> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+79 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9475db80 count now 1/79 2023-10-03T19:21:21.814 INFO:teuthology.orchestra.run.smithi045.stdout: -4072> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000058d) clear_dirty_parent 2023-10-03T19:21:21.814 INFO:teuthology.orchestra.run.smithi045.stdout: -4071> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000058e) _stored_backtrace v 4782 2023-10-03T19:21:21.814 INFO:teuthology.orchestra.run.smithi045.stdout: -4070> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000058e) auth_unpin by 0x55cc9475e100 on [inode 0x1000000058e [2,head] /dc-dir/dc-file_921 auth v5844 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.357110+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9475e100] now 0 2023-10-03T19:21:21.814 INFO:teuthology.orchestra.run.smithi045.stdout: -4069> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+78 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9475e100 count now 1/78 2023-10-03T19:21:21.814 INFO:teuthology.orchestra.run.smithi045.stdout: -4068> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000058e) clear_dirty_parent 2023-10-03T19:21:21.814 INFO:teuthology.orchestra.run.smithi045.stdout: -4067> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000058f) _stored_backtrace v 4786 2023-10-03T19:21:21.814 INFO:teuthology.orchestra.run.smithi045.stdout: -4066> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000058f) auth_unpin by 0x55cc9475e680 on [inode 0x1000000058f [2,head] /dc-dir/dc-file_922 auth v5846 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.368611+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9475e680] now 0 2023-10-03T19:21:21.815 INFO:teuthology.orchestra.run.smithi045.stdout: -4065> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+77 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9475e680 count now 1/77 2023-10-03T19:21:21.815 INFO:teuthology.orchestra.run.smithi045.stdout: -4064> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000058f) clear_dirty_parent 2023-10-03T19:21:21.815 INFO:teuthology.orchestra.run.smithi045.stdout: -4063> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000590) _stored_backtrace v 4790 2023-10-03T19:21:21.815 INFO:teuthology.orchestra.run.smithi045.stdout: -4062> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000590) auth_unpin by 0x55cc9475ec00 on [inode 0x10000000590 [2,head] /dc-dir/dc-file_923 auth v5848 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.379945+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9475ec00] now 0 2023-10-03T19:21:21.815 INFO:teuthology.orchestra.run.smithi045.stdout: -4061> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+76 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9475ec00 count now 1/76 2023-10-03T19:21:21.815 INFO:teuthology.orchestra.run.smithi045.stdout: -4060> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000590) clear_dirty_parent 2023-10-03T19:21:21.815 INFO:teuthology.orchestra.run.smithi045.stdout: -4059> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000591) _stored_backtrace v 4794 2023-10-03T19:21:21.815 INFO:teuthology.orchestra.run.smithi045.stdout: -4058> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000591) auth_unpin by 0x55cc9475f180 on [inode 0x10000000591 [2,head] /dc-dir/dc-file_924 auth v5850 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.391684+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9475f180] now 0 2023-10-03T19:21:21.815 INFO:teuthology.orchestra.run.smithi045.stdout: -4057> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+75 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9475f180 count now 1/75 2023-10-03T19:21:21.815 INFO:teuthology.orchestra.run.smithi045.stdout: -4056> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000591) clear_dirty_parent 2023-10-03T19:21:21.816 INFO:teuthology.orchestra.run.smithi045.stdout: -4055> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000592) _stored_backtrace v 4798 2023-10-03T19:21:21.816 INFO:teuthology.orchestra.run.smithi045.stdout: -4054> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000592) auth_unpin by 0x55cc9475f700 on [inode 0x10000000592 [2,head] /dc-dir/dc-file_925 auth v5852 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.404041+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9475f700] now 0 2023-10-03T19:21:21.816 INFO:teuthology.orchestra.run.smithi045.stdout: -4053> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+74 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9475f700 count now 1/74 2023-10-03T19:21:21.816 INFO:teuthology.orchestra.run.smithi045.stdout: -4052> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000592) clear_dirty_parent 2023-10-03T19:21:21.816 INFO:teuthology.orchestra.run.smithi045.stdout: -4051> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000593) _stored_backtrace v 4802 2023-10-03T19:21:21.816 INFO:teuthology.orchestra.run.smithi045.stdout: -4050> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000593) auth_unpin by 0x55cc94762000 on [inode 0x10000000593 [2,head] /dc-dir/dc-file_926 auth v5854 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.415576+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94762000] now 0 2023-10-03T19:21:21.816 INFO:teuthology.orchestra.run.smithi045.stdout: -4049> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+73 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94762000 count now 1/73 2023-10-03T19:21:21.816 INFO:teuthology.orchestra.run.smithi045.stdout: -4048> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000593) clear_dirty_parent 2023-10-03T19:21:21.816 INFO:teuthology.orchestra.run.smithi045.stdout: -4047> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000594) _stored_backtrace v 4806 2023-10-03T19:21:21.816 INFO:teuthology.orchestra.run.smithi045.stdout: -4046> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000594) auth_unpin by 0x55cc94762580 on [inode 0x10000000594 [2,head] /dc-dir/dc-file_927 auth v5856 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.427592+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94762580] now 0 2023-10-03T19:21:21.816 INFO:teuthology.orchestra.run.smithi045.stdout: -4045> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+72 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94762580 count now 1/72 2023-10-03T19:21:21.816 INFO:teuthology.orchestra.run.smithi045.stdout: -4044> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000594) clear_dirty_parent 2023-10-03T19:21:21.817 INFO:teuthology.orchestra.run.smithi045.stdout: -4043> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000595) _stored_backtrace v 4810 2023-10-03T19:21:21.817 INFO:teuthology.orchestra.run.smithi045.stdout: -4042> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000595) auth_unpin by 0x55cc94762b00 on [inode 0x10000000595 [2,head] /dc-dir/dc-file_928 auth v5858 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.439118+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94762b00] now 0 2023-10-03T19:21:21.817 INFO:teuthology.orchestra.run.smithi045.stdout: -4041> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+71 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94762b00 count now 1/71 2023-10-03T19:21:21.817 INFO:teuthology.orchestra.run.smithi045.stdout: -4040> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000595) clear_dirty_parent 2023-10-03T19:21:21.817 INFO:teuthology.orchestra.run.smithi045.stdout: -4039> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000596) _stored_backtrace v 4814 2023-10-03T19:21:21.817 INFO:teuthology.orchestra.run.smithi045.stdout: -4038> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000596) auth_unpin by 0x55cc94763080 on [inode 0x10000000596 [2,head] /dc-dir/dc-file_929 auth v5860 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.450943+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94763080] now 0 2023-10-03T19:21:21.817 INFO:teuthology.orchestra.run.smithi045.stdout: -4037> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+70 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94763080 count now 1/70 2023-10-03T19:21:21.817 INFO:teuthology.orchestra.run.smithi045.stdout: -4036> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000596) clear_dirty_parent 2023-10-03T19:21:21.817 INFO:teuthology.orchestra.run.smithi045.stdout: -4035> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000597) _stored_backtrace v 4818 2023-10-03T19:21:21.817 INFO:teuthology.orchestra.run.smithi045.stdout: -4034> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000597) auth_unpin by 0x55cc94763600 on [inode 0x10000000597 [2,head] /dc-dir/dc-file_930 auth v5862 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.462223+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94763600] now 0 2023-10-03T19:21:21.817 INFO:teuthology.orchestra.run.smithi045.stdout: -4033> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+69 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94763600 count now 1/69 2023-10-03T19:21:21.818 INFO:teuthology.orchestra.run.smithi045.stdout: -4032> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000597) clear_dirty_parent 2023-10-03T19:21:21.818 INFO:teuthology.orchestra.run.smithi045.stdout: -4031> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000598) _stored_backtrace v 4822 2023-10-03T19:21:21.818 INFO:teuthology.orchestra.run.smithi045.stdout: -4030> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000598) auth_unpin by 0x55cc94763b80 on [inode 0x10000000598 [2,head] /dc-dir/dc-file_931 auth v5864 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.474241+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94763b80] now 0 2023-10-03T19:21:21.818 INFO:teuthology.orchestra.run.smithi045.stdout: -4029> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+68 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94763b80 count now 1/68 2023-10-03T19:21:21.818 INFO:teuthology.orchestra.run.smithi045.stdout: -4028> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000598) clear_dirty_parent 2023-10-03T19:21:21.818 INFO:teuthology.orchestra.run.smithi045.stdout: -4027> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000599) _stored_backtrace v 4826 2023-10-03T19:21:21.818 INFO:teuthology.orchestra.run.smithi045.stdout: -4026> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000599) auth_unpin by 0x55cc94764100 on [inode 0x10000000599 [2,head] /dc-dir/dc-file_932 auth v5866 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.485632+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94764100] now 0 2023-10-03T19:21:21.818 INFO:teuthology.orchestra.run.smithi045.stdout: -4025> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+67 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94764100 count now 1/67 2023-10-03T19:21:21.818 INFO:teuthology.orchestra.run.smithi045.stdout: -4024> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000599) clear_dirty_parent 2023-10-03T19:21:21.818 INFO:teuthology.orchestra.run.smithi045.stdout: -4023> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000059a) _stored_backtrace v 4830 2023-10-03T19:21:21.818 INFO:teuthology.orchestra.run.smithi045.stdout: -4022> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000059a) auth_unpin by 0x55cc94764680 on [inode 0x1000000059a [2,head] /dc-dir/dc-file_933 auth v5868 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.496719+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94764680] now 0 2023-10-03T19:21:21.819 INFO:teuthology.orchestra.run.smithi045.stdout: -4021> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+66 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94764680 count now 1/66 2023-10-03T19:21:21.819 INFO:teuthology.orchestra.run.smithi045.stdout: -4020> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000059a) clear_dirty_parent 2023-10-03T19:21:21.819 INFO:teuthology.orchestra.run.smithi045.stdout: -4019> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000059b) _stored_backtrace v 4834 2023-10-03T19:21:21.819 INFO:teuthology.orchestra.run.smithi045.stdout: -4018> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000059b) auth_unpin by 0x55cc94764c00 on [inode 0x1000000059b [2,head] /dc-dir/dc-file_934 auth v5870 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.508220+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94764c00] now 0 2023-10-03T19:21:21.819 INFO:teuthology.orchestra.run.smithi045.stdout: -4017> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+65 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94764c00 count now 1/65 2023-10-03T19:21:21.819 INFO:teuthology.orchestra.run.smithi045.stdout: -4016> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000059b) clear_dirty_parent 2023-10-03T19:21:21.819 INFO:teuthology.orchestra.run.smithi045.stdout: -4015> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000059c) _stored_backtrace v 4838 2023-10-03T19:21:21.819 INFO:teuthology.orchestra.run.smithi045.stdout: -4014> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000059c) auth_unpin by 0x55cc94765180 on [inode 0x1000000059c [2,head] /dc-dir/dc-file_935 auth v5872 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.520205+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94765180] now 0 2023-10-03T19:21:21.819 INFO:teuthology.orchestra.run.smithi045.stdout: -4013> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+64 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94765180 count now 1/64 2023-10-03T19:21:21.819 INFO:teuthology.orchestra.run.smithi045.stdout: -4012> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000059c) clear_dirty_parent 2023-10-03T19:21:21.819 INFO:teuthology.orchestra.run.smithi045.stdout: -4011> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000059d) _stored_backtrace v 4842 2023-10-03T19:21:21.820 INFO:teuthology.orchestra.run.smithi045.stdout: -4010> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000059d) auth_unpin by 0x55cc94765700 on [inode 0x1000000059d [2,head] /dc-dir/dc-file_936 auth v5874 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.532245+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94765700] now 0 2023-10-03T19:21:21.820 INFO:teuthology.orchestra.run.smithi045.stdout: -4009> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+63 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94765700 count now 1/63 2023-10-03T19:21:21.820 INFO:teuthology.orchestra.run.smithi045.stdout: -4008> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000059d) clear_dirty_parent 2023-10-03T19:21:21.820 INFO:teuthology.orchestra.run.smithi045.stdout: -4007> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000059e) _stored_backtrace v 4846 2023-10-03T19:21:21.820 INFO:teuthology.orchestra.run.smithi045.stdout: -4006> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000059e) auth_unpin by 0x55cc9476c000 on [inode 0x1000000059e [2,head] /dc-dir/dc-file_937 auth v5876 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.544005+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9476c000] now 0 2023-10-03T19:21:21.820 INFO:teuthology.orchestra.run.smithi045.stdout: -4005> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+62 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9476c000 count now 1/62 2023-10-03T19:21:21.919 INFO:teuthology.orchestra.run.smithi045.stdout: -4004> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000059e) clear_dirty_parent 2023-10-03T19:21:21.920 INFO:teuthology.orchestra.run.smithi045.stdout: -4003> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000059f) _stored_backtrace v 4850 2023-10-03T19:21:21.920 INFO:teuthology.orchestra.run.smithi045.stdout: -4002> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000059f) auth_unpin by 0x55cc9476c580 on [inode 0x1000000059f [2,head] /dc-dir/dc-file_938 auth v5878 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.555799+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9476c580] now 0 2023-10-03T19:21:21.920 INFO:teuthology.orchestra.run.smithi045.stdout: -4001> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+61 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9476c580 count now 1/61 2023-10-03T19:21:21.920 INFO:teuthology.orchestra.run.smithi045.stdout: -4000> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000059f) clear_dirty_parent 2023-10-03T19:21:21.920 INFO:teuthology.orchestra.run.smithi045.stdout: -3999> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a0) _stored_backtrace v 4854 2023-10-03T19:21:21.920 INFO:teuthology.orchestra.run.smithi045.stdout: -3998> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a0) auth_unpin by 0x55cc9476cb00 on [inode 0x100000005a0 [2,head] /dc-dir/dc-file_939 auth v5880 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.567107+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9476cb00] now 0 2023-10-03T19:21:21.920 INFO:teuthology.orchestra.run.smithi045.stdout: -3997> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+60 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9476cb00 count now 1/60 2023-10-03T19:21:21.920 INFO:teuthology.orchestra.run.smithi045.stdout: -3996> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a0) clear_dirty_parent 2023-10-03T19:21:21.920 INFO:teuthology.orchestra.run.smithi045.stdout: -3995> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a1) _stored_backtrace v 4858 2023-10-03T19:21:21.921 INFO:teuthology.orchestra.run.smithi045.stdout: -3994> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a1) auth_unpin by 0x55cc9476d080 on [inode 0x100000005a1 [2,head] /dc-dir/dc-file_940 auth v5882 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.578640+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9476d080] now 0 2023-10-03T19:21:21.921 INFO:teuthology.orchestra.run.smithi045.stdout: -3993> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+59 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9476d080 count now 1/59 2023-10-03T19:21:21.921 INFO:teuthology.orchestra.run.smithi045.stdout: -3992> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a1) clear_dirty_parent 2023-10-03T19:21:21.921 INFO:teuthology.orchestra.run.smithi045.stdout: -3991> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a2) _stored_backtrace v 4862 2023-10-03T19:21:21.921 INFO:teuthology.orchestra.run.smithi045.stdout: -3990> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a2) auth_unpin by 0x55cc9476d600 on [inode 0x100000005a2 [2,head] /dc-dir/dc-file_941 auth v5884 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.589765+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9476d600] now 0 2023-10-03T19:21:21.921 INFO:teuthology.orchestra.run.smithi045.stdout: -3989> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+58 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9476d600 count now 1/58 2023-10-03T19:21:21.921 INFO:teuthology.orchestra.run.smithi045.stdout: -3988> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a2) clear_dirty_parent 2023-10-03T19:21:21.922 INFO:teuthology.orchestra.run.smithi045.stdout: -3987> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a3) _stored_backtrace v 4866 2023-10-03T19:21:21.922 INFO:teuthology.orchestra.run.smithi045.stdout: -3986> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a3) auth_unpin by 0x55cc9476db80 on [inode 0x100000005a3 [2,head] /dc-dir/dc-file_942 auth v5886 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.602121+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9476db80] now 0 2023-10-03T19:21:21.922 INFO:teuthology.orchestra.run.smithi045.stdout: -3985> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+57 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9476db80 count now 1/57 2023-10-03T19:21:21.922 INFO:teuthology.orchestra.run.smithi045.stdout: -3984> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a3) clear_dirty_parent 2023-10-03T19:21:21.922 INFO:teuthology.orchestra.run.smithi045.stdout: -3983> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a4) _stored_backtrace v 4870 2023-10-03T19:21:21.922 INFO:teuthology.orchestra.run.smithi045.stdout: -3982> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a4) auth_unpin by 0x55cc9476e100 on [inode 0x100000005a4 [2,head] /dc-dir/dc-file_943 auth v5888 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.614834+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9476e100] now 0 2023-10-03T19:21:21.922 INFO:teuthology.orchestra.run.smithi045.stdout: -3981> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+56 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9476e100 count now 1/56 2023-10-03T19:21:21.922 INFO:teuthology.orchestra.run.smithi045.stdout: -3980> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a4) clear_dirty_parent 2023-10-03T19:21:21.923 INFO:teuthology.orchestra.run.smithi045.stdout: -3979> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a5) _stored_backtrace v 4874 2023-10-03T19:21:21.923 INFO:teuthology.orchestra.run.smithi045.stdout: -3978> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a5) auth_unpin by 0x55cc9476e680 on [inode 0x100000005a5 [2,head] /dc-dir/dc-file_944 auth v5890 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.626490+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9476e680] now 0 2023-10-03T19:21:21.923 INFO:teuthology.orchestra.run.smithi045.stdout: -3977> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+55 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9476e680 count now 1/55 2023-10-03T19:21:21.923 INFO:teuthology.orchestra.run.smithi045.stdout: -3976> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a5) clear_dirty_parent 2023-10-03T19:21:21.923 INFO:teuthology.orchestra.run.smithi045.stdout: -3975> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a6) _stored_backtrace v 4878 2023-10-03T19:21:21.923 INFO:teuthology.orchestra.run.smithi045.stdout: -3974> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a6) auth_unpin by 0x55cc9476ec00 on [inode 0x100000005a6 [2,head] /dc-dir/dc-file_945 auth v5892 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.637656+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9476ec00] now 0 2023-10-03T19:21:21.923 INFO:teuthology.orchestra.run.smithi045.stdout: -3973> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+54 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9476ec00 count now 1/54 2023-10-03T19:21:21.923 INFO:teuthology.orchestra.run.smithi045.stdout: -3972> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a6) clear_dirty_parent 2023-10-03T19:21:21.923 INFO:teuthology.orchestra.run.smithi045.stdout: -3971> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a7) _stored_backtrace v 4882 2023-10-03T19:21:21.923 INFO:teuthology.orchestra.run.smithi045.stdout: -3970> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a7) auth_unpin by 0x55cc9476f180 on [inode 0x100000005a7 [2,head] /dc-dir/dc-file_946 auth v5894 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.648791+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9476f180] now 0 2023-10-03T19:21:21.924 INFO:teuthology.orchestra.run.smithi045.stdout: -3969> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+53 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9476f180 count now 1/53 2023-10-03T19:21:21.924 INFO:teuthology.orchestra.run.smithi045.stdout: -3968> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a7) clear_dirty_parent 2023-10-03T19:21:21.924 INFO:teuthology.orchestra.run.smithi045.stdout: -3967> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a8) _stored_backtrace v 4886 2023-10-03T19:21:21.924 INFO:teuthology.orchestra.run.smithi045.stdout: -3966> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a8) auth_unpin by 0x55cc9476f700 on [inode 0x100000005a8 [2,head] /dc-dir/dc-file_947 auth v5896 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.661701+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9476f700] now 0 2023-10-03T19:21:21.924 INFO:teuthology.orchestra.run.smithi045.stdout: -3965> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+52 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9476f700 count now 1/52 2023-10-03T19:21:21.924 INFO:teuthology.orchestra.run.smithi045.stdout: -3964> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a8) clear_dirty_parent 2023-10-03T19:21:21.924 INFO:teuthology.orchestra.run.smithi045.stdout: -3963> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a9) _stored_backtrace v 4890 2023-10-03T19:21:21.924 INFO:teuthology.orchestra.run.smithi045.stdout: -3962> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a9) auth_unpin by 0x55cc94774000 on [inode 0x100000005a9 [2,head] /dc-dir/dc-file_948 auth v5898 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.674973+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94774000] now 0 2023-10-03T19:21:21.925 INFO:teuthology.orchestra.run.smithi045.stdout: -3961> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+51 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94774000 count now 1/51 2023-10-03T19:21:21.925 INFO:teuthology.orchestra.run.smithi045.stdout: -3960> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a9) clear_dirty_parent 2023-10-03T19:21:21.925 INFO:teuthology.orchestra.run.smithi045.stdout: -3959> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005aa) _stored_backtrace v 4894 2023-10-03T19:21:21.925 INFO:teuthology.orchestra.run.smithi045.stdout: -3958> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005aa) auth_unpin by 0x55cc94774580 on [inode 0x100000005aa [2,head] /dc-dir/dc-file_949 auth v5900 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.688324+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94774580] now 0 2023-10-03T19:21:21.925 INFO:teuthology.orchestra.run.smithi045.stdout: -3957> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+50 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94774580 count now 1/50 2023-10-03T19:21:21.925 INFO:teuthology.orchestra.run.smithi045.stdout: -3956> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005aa) clear_dirty_parent 2023-10-03T19:21:21.925 INFO:teuthology.orchestra.run.smithi045.stdout: -3955> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ab) _stored_backtrace v 4898 2023-10-03T19:21:21.926 INFO:teuthology.orchestra.run.smithi045.stdout: -3954> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ab) auth_unpin by 0x55cc94774b00 on [inode 0x100000005ab [2,head] /dc-dir/dc-file_950 auth v5902 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.700334+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94774b00] now 0 2023-10-03T19:21:21.926 INFO:teuthology.orchestra.run.smithi045.stdout: -3953> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+49 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94774b00 count now 1/49 2023-10-03T19:21:21.926 INFO:teuthology.orchestra.run.smithi045.stdout: -3952> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ab) clear_dirty_parent 2023-10-03T19:21:21.926 INFO:teuthology.orchestra.run.smithi045.stdout: -3951> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ac) _stored_backtrace v 4902 2023-10-03T19:21:21.926 INFO:teuthology.orchestra.run.smithi045.stdout: -3950> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ac) auth_unpin by 0x55cc94775080 on [inode 0x100000005ac [2,head] /dc-dir/dc-file_951 auth v5904 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.712601+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94775080] now 0 2023-10-03T19:21:21.926 INFO:teuthology.orchestra.run.smithi045.stdout: -3949> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+48 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94775080 count now 1/48 2023-10-03T19:21:21.926 INFO:teuthology.orchestra.run.smithi045.stdout: -3948> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ac) clear_dirty_parent 2023-10-03T19:21:21.926 INFO:teuthology.orchestra.run.smithi045.stdout: -3947> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ad) _stored_backtrace v 4906 2023-10-03T19:21:21.927 INFO:teuthology.orchestra.run.smithi045.stdout: -3946> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ad) auth_unpin by 0x55cc94775600 on [inode 0x100000005ad [2,head] /dc-dir/dc-file_952 auth v5906 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.724052+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94775600] now 0 2023-10-03T19:21:21.927 INFO:teuthology.orchestra.run.smithi045.stdout: -3945> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+47 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94775600 count now 1/47 2023-10-03T19:21:21.927 INFO:teuthology.orchestra.run.smithi045.stdout: -3944> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ad) clear_dirty_parent 2023-10-03T19:21:21.927 INFO:teuthology.orchestra.run.smithi045.stdout: -3943> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ae) _stored_backtrace v 4910 2023-10-03T19:21:21.927 INFO:teuthology.orchestra.run.smithi045.stdout: -3942> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ae) auth_unpin by 0x55cc94775b80 on [inode 0x100000005ae [2,head] /dc-dir/dc-file_953 auth v5908 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.735359+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94775b80] now 0 2023-10-03T19:21:21.927 INFO:teuthology.orchestra.run.smithi045.stdout: -3941> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+46 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94775b80 count now 1/46 2023-10-03T19:21:21.927 INFO:teuthology.orchestra.run.smithi045.stdout: -3940> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ae) clear_dirty_parent 2023-10-03T19:21:21.927 INFO:teuthology.orchestra.run.smithi045.stdout: -3939> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005af) _stored_backtrace v 4914 2023-10-03T19:21:21.928 INFO:teuthology.orchestra.run.smithi045.stdout: -3938> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005af) auth_unpin by 0x55cc94776100 on [inode 0x100000005af [2,head] /dc-dir/dc-file_954 auth v5910 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.746488+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94776100] now 0 2023-10-03T19:21:21.928 INFO:teuthology.orchestra.run.smithi045.stdout: -3937> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+45 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94776100 count now 1/45 2023-10-03T19:21:21.928 INFO:teuthology.orchestra.run.smithi045.stdout: -3936> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005af) clear_dirty_parent 2023-10-03T19:21:21.928 INFO:teuthology.orchestra.run.smithi045.stdout: -3935> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b0) _stored_backtrace v 4918 2023-10-03T19:21:21.928 INFO:teuthology.orchestra.run.smithi045.stdout: -3934> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b0) auth_unpin by 0x55cc94776680 on [inode 0x100000005b0 [2,head] /dc-dir/dc-file_955 auth v5912 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.758015+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94776680] now 0 2023-10-03T19:21:21.928 INFO:teuthology.orchestra.run.smithi045.stdout: -3933> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+44 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94776680 count now 1/44 2023-10-03T19:21:21.928 INFO:teuthology.orchestra.run.smithi045.stdout: -3932> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b0) clear_dirty_parent 2023-10-03T19:21:21.928 INFO:teuthology.orchestra.run.smithi045.stdout: -3931> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b1) _stored_backtrace v 4922 2023-10-03T19:21:21.928 INFO:teuthology.orchestra.run.smithi045.stdout: -3930> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b1) auth_unpin by 0x55cc94776c00 on [inode 0x100000005b1 [2,head] /dc-dir/dc-file_956 auth v5914 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.769545+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94776c00] now 0 2023-10-03T19:21:21.928 INFO:teuthology.orchestra.run.smithi045.stdout: -3929> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+43 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94776c00 count now 1/43 2023-10-03T19:21:21.928 INFO:teuthology.orchestra.run.smithi045.stdout: -3928> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b1) clear_dirty_parent 2023-10-03T19:21:21.929 INFO:teuthology.orchestra.run.smithi045.stdout: -3927> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b2) _stored_backtrace v 4926 2023-10-03T19:21:21.933 INFO:teuthology.orchestra.run.smithi045.stdout: -3926> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b2) auth_unpin by 0x55cc94777180 on [inode 0x100000005b2 [2,head] /dc-dir/dc-file_957 auth v5916 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.782633+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94777180] now 0 2023-10-03T19:21:21.933 INFO:teuthology.orchestra.run.smithi045.stdout: -3925> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+42 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94777180 count now 1/42 2023-10-03T19:21:21.933 INFO:teuthology.orchestra.run.smithi045.stdout: -3924> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b2) clear_dirty_parent 2023-10-03T19:21:21.933 INFO:teuthology.orchestra.run.smithi045.stdout: -3923> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b3) _stored_backtrace v 4930 2023-10-03T19:21:21.933 INFO:teuthology.orchestra.run.smithi045.stdout: -3922> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b3) auth_unpin by 0x55cc94777700 on [inode 0x100000005b3 [2,head] /dc-dir/dc-file_958 auth v5918 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.793609+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94777700] now 0 2023-10-03T19:21:21.933 INFO:teuthology.orchestra.run.smithi045.stdout: -3921> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+41 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94777700 count now 1/41 2023-10-03T19:21:21.933 INFO:teuthology.orchestra.run.smithi045.stdout: -3920> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b3) clear_dirty_parent 2023-10-03T19:21:21.933 INFO:teuthology.orchestra.run.smithi045.stdout: -3919> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b4) _stored_backtrace v 4934 2023-10-03T19:21:21.933 INFO:teuthology.orchestra.run.smithi045.stdout: -3918> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b4) auth_unpin by 0x55cc9477c000 on [inode 0x100000005b4 [2,head] /dc-dir/dc-file_959 auth v5920 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.804932+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9477c000] now 0 2023-10-03T19:21:21.933 INFO:teuthology.orchestra.run.smithi045.stdout: -3917> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+40 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9477c000 count now 1/40 2023-10-03T19:21:21.933 INFO:teuthology.orchestra.run.smithi045.stdout: -3916> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b4) clear_dirty_parent 2023-10-03T19:21:21.934 INFO:teuthology.orchestra.run.smithi045.stdout: -3915> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b5) _stored_backtrace v 4938 2023-10-03T19:21:21.934 INFO:teuthology.orchestra.run.smithi045.stdout: -3914> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b5) auth_unpin by 0x55cc9477c580 on [inode 0x100000005b5 [2,head] /dc-dir/dc-file_960 auth v5922 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.818051+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9477c580] now 0 2023-10-03T19:21:21.934 INFO:teuthology.orchestra.run.smithi045.stdout: -3913> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+39 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9477c580 count now 1/39 2023-10-03T19:21:21.934 INFO:teuthology.orchestra.run.smithi045.stdout: -3912> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b5) clear_dirty_parent 2023-10-03T19:21:21.934 INFO:teuthology.orchestra.run.smithi045.stdout: -3911> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b6) _stored_backtrace v 4942 2023-10-03T19:21:21.934 INFO:teuthology.orchestra.run.smithi045.stdout: -3910> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b6) auth_unpin by 0x55cc9477cb00 on [inode 0x100000005b6 [2,head] /dc-dir/dc-file_961 auth v5924 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.830287+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9477cb00] now 0 2023-10-03T19:21:21.934 INFO:teuthology.orchestra.run.smithi045.stdout: -3909> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+38 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9477cb00 count now 1/38 2023-10-03T19:21:21.934 INFO:teuthology.orchestra.run.smithi045.stdout: -3908> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b6) clear_dirty_parent 2023-10-03T19:21:21.934 INFO:teuthology.orchestra.run.smithi045.stdout: -3907> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b7) _stored_backtrace v 4946 2023-10-03T19:21:21.934 INFO:teuthology.orchestra.run.smithi045.stdout: -3906> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b7) auth_unpin by 0x55cc9477d080 on [inode 0x100000005b7 [2,head] /dc-dir/dc-file_962 auth v5926 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.841780+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9477d080] now 0 2023-10-03T19:21:21.934 INFO:teuthology.orchestra.run.smithi045.stdout: -3905> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+37 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9477d080 count now 1/37 2023-10-03T19:21:21.934 INFO:teuthology.orchestra.run.smithi045.stdout: -3904> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b7) clear_dirty_parent 2023-10-03T19:21:21.935 INFO:teuthology.orchestra.run.smithi045.stdout: -3903> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b8) _stored_backtrace v 4950 2023-10-03T19:21:21.935 INFO:teuthology.orchestra.run.smithi045.stdout: -3902> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b8) auth_unpin by 0x55cc9477d600 on [inode 0x100000005b8 [2,head] /dc-dir/dc-file_963 auth v5928 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.853705+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9477d600] now 0 2023-10-03T19:21:21.935 INFO:teuthology.orchestra.run.smithi045.stdout: -3901> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+36 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9477d600 count now 1/36 2023-10-03T19:21:21.935 INFO:teuthology.orchestra.run.smithi045.stdout: -3900> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b8) clear_dirty_parent 2023-10-03T19:21:21.935 INFO:teuthology.orchestra.run.smithi045.stdout: -3899> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b9) _stored_backtrace v 4954 2023-10-03T19:21:21.935 INFO:teuthology.orchestra.run.smithi045.stdout: -3898> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b9) auth_unpin by 0x55cc9477db80 on [inode 0x100000005b9 [2,head] /dc-dir/dc-file_964 auth v5930 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.867216+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9477db80] now 0 2023-10-03T19:21:21.935 INFO:teuthology.orchestra.run.smithi045.stdout: -3897> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+35 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9477db80 count now 1/35 2023-10-03T19:21:21.935 INFO:teuthology.orchestra.run.smithi045.stdout: -3896> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b9) clear_dirty_parent 2023-10-03T19:21:21.935 INFO:teuthology.orchestra.run.smithi045.stdout: -3895> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ba) _stored_backtrace v 4958 2023-10-03T19:21:21.935 INFO:teuthology.orchestra.run.smithi045.stdout: -3894> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ba) auth_unpin by 0x55cc9477e100 on [inode 0x100000005ba [2,head] /dc-dir/dc-file_965 auth v5932 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.878724+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9477e100] now 0 2023-10-03T19:21:21.936 INFO:teuthology.orchestra.run.smithi045.stdout: -3893> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+34 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9477e100 count now 1/34 2023-10-03T19:21:21.936 INFO:teuthology.orchestra.run.smithi045.stdout: -3892> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ba) clear_dirty_parent 2023-10-03T19:21:21.936 INFO:teuthology.orchestra.run.smithi045.stdout: -3891> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005bb) _stored_backtrace v 4962 2023-10-03T19:21:21.936 INFO:teuthology.orchestra.run.smithi045.stdout: -3890> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005bb) auth_unpin by 0x55cc9477e680 on [inode 0x100000005bb [2,head] /dc-dir/dc-file_966 auth v5934 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.890092+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9477e680] now 0 2023-10-03T19:21:21.936 INFO:teuthology.orchestra.run.smithi045.stdout: -3889> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+33 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9477e680 count now 1/33 2023-10-03T19:21:21.936 INFO:teuthology.orchestra.run.smithi045.stdout: -3888> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005bb) clear_dirty_parent 2023-10-03T19:21:21.936 INFO:teuthology.orchestra.run.smithi045.stdout: -3887> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005bc) _stored_backtrace v 4966 2023-10-03T19:21:21.936 INFO:teuthology.orchestra.run.smithi045.stdout: -3886> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005bc) auth_unpin by 0x55cc9477ec00 on [inode 0x100000005bc [2,head] /dc-dir/dc-file_967 auth v5936 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.901617+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9477ec00] now 0 2023-10-03T19:21:21.936 INFO:teuthology.orchestra.run.smithi045.stdout: -3885> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+32 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9477ec00 count now 1/32 2023-10-03T19:21:21.937 INFO:teuthology.orchestra.run.smithi045.stdout: -3884> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005bc) clear_dirty_parent 2023-10-03T19:21:21.937 INFO:teuthology.orchestra.run.smithi045.stdout: -3883> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005bd) _stored_backtrace v 4970 2023-10-03T19:21:21.937 INFO:teuthology.orchestra.run.smithi045.stdout: -3882> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005bd) auth_unpin by 0x55cc9477f180 on [inode 0x100000005bd [2,head] /dc-dir/dc-file_968 auth v5938 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.912931+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9477f180] now 0 2023-10-03T19:21:21.937 INFO:teuthology.orchestra.run.smithi045.stdout: -3881> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+31 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9477f180 count now 1/31 2023-10-03T19:21:21.937 INFO:teuthology.orchestra.run.smithi045.stdout: -3880> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005bd) clear_dirty_parent 2023-10-03T19:21:21.937 INFO:teuthology.orchestra.run.smithi045.stdout: -3879> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005be) _stored_backtrace v 4974 2023-10-03T19:21:21.937 INFO:teuthology.orchestra.run.smithi045.stdout: -3878> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005be) auth_unpin by 0x55cc9477f700 on [inode 0x100000005be [2,head] /dc-dir/dc-file_969 auth v5940 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.926504+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9477f700] now 0 2023-10-03T19:21:21.937 INFO:teuthology.orchestra.run.smithi045.stdout: -3877> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+30 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9477f700 count now 1/30 2023-10-03T19:21:21.937 INFO:teuthology.orchestra.run.smithi045.stdout: -3876> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005be) clear_dirty_parent 2023-10-03T19:21:21.937 INFO:teuthology.orchestra.run.smithi045.stdout: -3875> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005bf) _stored_backtrace v 4978 2023-10-03T19:21:21.937 INFO:teuthology.orchestra.run.smithi045.stdout: -3874> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005bf) auth_unpin by 0x55cc94782000 on [inode 0x100000005bf [2,head] /dc-dir/dc-file_970 auth v5942 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.939798+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94782000] now 0 2023-10-03T19:21:21.938 INFO:teuthology.orchestra.run.smithi045.stdout: -3873> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+29 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94782000 count now 1/29 2023-10-03T19:21:21.938 INFO:teuthology.orchestra.run.smithi045.stdout: -3872> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005bf) clear_dirty_parent 2023-10-03T19:21:21.938 INFO:teuthology.orchestra.run.smithi045.stdout: -3871> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c0) _stored_backtrace v 4982 2023-10-03T19:21:21.938 INFO:teuthology.orchestra.run.smithi045.stdout: -3870> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c0) auth_unpin by 0x55cc94782580 on [inode 0x100000005c0 [2,head] /dc-dir/dc-file_971 auth v5944 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.953098+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94782580] now 0 2023-10-03T19:21:21.938 INFO:teuthology.orchestra.run.smithi045.stdout: -3869> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+28 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94782580 count now 1/28 2023-10-03T19:21:21.938 INFO:teuthology.orchestra.run.smithi045.stdout: -3868> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c0) clear_dirty_parent 2023-10-03T19:21:21.938 INFO:teuthology.orchestra.run.smithi045.stdout: -3867> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c1) _stored_backtrace v 4986 2023-10-03T19:21:21.938 INFO:teuthology.orchestra.run.smithi045.stdout: -3866> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c1) auth_unpin by 0x55cc94782b00 on [inode 0x100000005c1 [2,head] /dc-dir/dc-file_972 auth v5946 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.965102+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94782b00] now 0 2023-10-03T19:21:21.938 INFO:teuthology.orchestra.run.smithi045.stdout: -3865> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+27 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94782b00 count now 1/27 2023-10-03T19:21:21.938 INFO:teuthology.orchestra.run.smithi045.stdout: -3864> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c1) clear_dirty_parent 2023-10-03T19:21:21.938 INFO:teuthology.orchestra.run.smithi045.stdout: -3863> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c2) _stored_backtrace v 4990 2023-10-03T19:21:21.939 INFO:teuthology.orchestra.run.smithi045.stdout: -3862> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c2) auth_unpin by 0x55cc94783080 on [inode 0x100000005c2 [2,head] /dc-dir/dc-file_973 auth v5948 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.977951+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94783080] now 0 2023-10-03T19:21:21.939 INFO:teuthology.orchestra.run.smithi045.stdout: -3861> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+26 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94783080 count now 1/26 2023-10-03T19:21:21.939 INFO:teuthology.orchestra.run.smithi045.stdout: -3860> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c2) clear_dirty_parent 2023-10-03T19:21:21.939 INFO:teuthology.orchestra.run.smithi045.stdout: -3859> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c3) _stored_backtrace v 4994 2023-10-03T19:21:21.939 INFO:teuthology.orchestra.run.smithi045.stdout: -3858> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c3) auth_unpin by 0x55cc94783600 on [inode 0x100000005c3 [2,head] /dc-dir/dc-file_974 auth v5950 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:57.989973+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94783600] now 0 2023-10-03T19:21:21.939 INFO:teuthology.orchestra.run.smithi045.stdout: -3857> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+25 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94783600 count now 1/25 2023-10-03T19:21:21.939 INFO:teuthology.orchestra.run.smithi045.stdout: -3856> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c3) clear_dirty_parent 2023-10-03T19:21:21.939 INFO:teuthology.orchestra.run.smithi045.stdout: -3855> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c4) _stored_backtrace v 4998 2023-10-03T19:21:21.939 INFO:teuthology.orchestra.run.smithi045.stdout: -3854> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c4) auth_unpin by 0x55cc94783b80 on [inode 0x100000005c4 [2,head] /dc-dir/dc-file_975 auth v5952 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.002424+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94783b80] now 0 2023-10-03T19:21:21.939 INFO:teuthology.orchestra.run.smithi045.stdout: -3853> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+24 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94783b80 count now 1/24 2023-10-03T19:21:21.940 INFO:teuthology.orchestra.run.smithi045.stdout: -3852> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c4) clear_dirty_parent 2023-10-03T19:21:21.940 INFO:teuthology.orchestra.run.smithi045.stdout: -3851> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c5) _stored_backtrace v 5002 2023-10-03T19:21:21.940 INFO:teuthology.orchestra.run.smithi045.stdout: -3850> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c5) auth_unpin by 0x55cc94784100 on [inode 0x100000005c5 [2,head] /dc-dir/dc-file_976 auth v5954 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.014785+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94784100] now 0 2023-10-03T19:21:21.940 INFO:teuthology.orchestra.run.smithi045.stdout: -3849> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+23 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94784100 count now 1/23 2023-10-03T19:21:21.940 INFO:teuthology.orchestra.run.smithi045.stdout: -3848> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c5) clear_dirty_parent 2023-10-03T19:21:21.940 INFO:teuthology.orchestra.run.smithi045.stdout: -3847> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c6) _stored_backtrace v 5006 2023-10-03T19:21:21.940 INFO:teuthology.orchestra.run.smithi045.stdout: -3846> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c6) auth_unpin by 0x55cc94784680 on [inode 0x100000005c6 [2,head] /dc-dir/dc-file_977 auth v5956 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.028977+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94784680] now 0 2023-10-03T19:21:21.940 INFO:teuthology.orchestra.run.smithi045.stdout: -3845> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+22 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94784680 count now 1/22 2023-10-03T19:21:21.965 INFO:teuthology.orchestra.run.smithi045.stdout: -3844> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c6) clear_dirty_parent 2023-10-03T19:21:21.965 INFO:teuthology.orchestra.run.smithi045.stdout: -3843> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c7) _stored_backtrace v 5010 2023-10-03T19:21:21.966 INFO:teuthology.orchestra.run.smithi045.stdout: -3842> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c7) auth_unpin by 0x55cc94784c00 on [inode 0x100000005c7 [2,head] /dc-dir/dc-file_978 auth v5958 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.042650+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94784c00] now 0 2023-10-03T19:21:21.966 INFO:teuthology.orchestra.run.smithi045.stdout: -3841> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+21 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94784c00 count now 1/21 2023-10-03T19:21:21.966 INFO:teuthology.orchestra.run.smithi045.stdout: -3840> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c7) clear_dirty_parent 2023-10-03T19:21:21.966 INFO:teuthology.orchestra.run.smithi045.stdout: -3839> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c8) _stored_backtrace v 5014 2023-10-03T19:21:21.966 INFO:teuthology.orchestra.run.smithi045.stdout: -3838> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c8) auth_unpin by 0x55cc94785180 on [inode 0x100000005c8 [2,head] /dc-dir/dc-file_979 auth v5960 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.054557+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94785180] now 0 2023-10-03T19:21:21.966 INFO:teuthology.orchestra.run.smithi045.stdout: -3837> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+20 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94785180 count now 1/20 2023-10-03T19:21:21.966 INFO:teuthology.orchestra.run.smithi045.stdout: -3836> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c8) clear_dirty_parent 2023-10-03T19:21:21.966 INFO:teuthology.orchestra.run.smithi045.stdout: -3835> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c9) _stored_backtrace v 5018 2023-10-03T19:21:21.966 INFO:teuthology.orchestra.run.smithi045.stdout: -3834> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c9) auth_unpin by 0x55cc94785700 on [inode 0x100000005c9 [2,head] /dc-dir/dc-file_980 auth v5962 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.067690+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc94785700] now 0 2023-10-03T19:21:21.966 INFO:teuthology.orchestra.run.smithi045.stdout: -3833> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+19 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc94785700 count now 1/19 2023-10-03T19:21:21.967 INFO:teuthology.orchestra.run.smithi045.stdout: -3832> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c9) clear_dirty_parent 2023-10-03T19:21:21.967 INFO:teuthology.orchestra.run.smithi045.stdout: -3831> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ca) _stored_backtrace v 5022 2023-10-03T19:21:21.967 INFO:teuthology.orchestra.run.smithi045.stdout: -3830> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ca) auth_unpin by 0x55cc9478a000 on [inode 0x100000005ca [2,head] /dc-dir/dc-file_981 auth v5964 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.079990+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9478a000] now 0 2023-10-03T19:21:21.967 INFO:teuthology.orchestra.run.smithi045.stdout: -3829> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+18 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9478a000 count now 1/18 2023-10-03T19:21:21.967 INFO:teuthology.orchestra.run.smithi045.stdout: -3828> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ca) clear_dirty_parent 2023-10-03T19:21:21.967 INFO:teuthology.orchestra.run.smithi045.stdout: -3827> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005cb) _stored_backtrace v 5026 2023-10-03T19:21:21.967 INFO:teuthology.orchestra.run.smithi045.stdout: -3826> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005cb) auth_unpin by 0x55cc9478a580 on [inode 0x100000005cb [2,head] /dc-dir/dc-file_982 auth v5966 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.092395+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9478a580] now 0 2023-10-03T19:21:21.967 INFO:teuthology.orchestra.run.smithi045.stdout: -3825> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+17 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9478a580 count now 1/17 2023-10-03T19:21:21.967 INFO:teuthology.orchestra.run.smithi045.stdout: -3824> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005cb) clear_dirty_parent 2023-10-03T19:21:21.967 INFO:teuthology.orchestra.run.smithi045.stdout: -3823> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005cc) _stored_backtrace v 5030 2023-10-03T19:21:21.968 INFO:teuthology.orchestra.run.smithi045.stdout: -3822> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005cc) auth_unpin by 0x55cc9478ab00 on [inode 0x100000005cc [2,head] /dc-dir/dc-file_983 auth v5968 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.105240+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9478ab00] now 0 2023-10-03T19:21:21.968 INFO:teuthology.orchestra.run.smithi045.stdout: -3821> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+16 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9478ab00 count now 1/16 2023-10-03T19:21:21.968 INFO:teuthology.orchestra.run.smithi045.stdout: -3820> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005cc) clear_dirty_parent 2023-10-03T19:21:21.968 INFO:teuthology.orchestra.run.smithi045.stdout: -3819> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005cd) _stored_backtrace v 5182 2023-10-03T19:21:21.968 INFO:teuthology.orchestra.run.smithi045.stdout: -3818> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005cd) auth_unpin by 0x55cc9478b080 on [inode 0x100000005cd [2,head] /dc-dir/dc-file_984 auth v5970 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.195020+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9478b080] now 0 2023-10-03T19:21:21.968 INFO:teuthology.orchestra.run.smithi045.stdout: -3817> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+15 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9478b080 count now 1/15 2023-10-03T19:21:21.968 INFO:teuthology.orchestra.run.smithi045.stdout: -3816> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005cd) clear_dirty_parent 2023-10-03T19:21:21.968 INFO:teuthology.orchestra.run.smithi045.stdout: -3815> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ce) _stored_backtrace v 5186 2023-10-03T19:21:21.968 INFO:teuthology.orchestra.run.smithi045.stdout: -3814> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ce) auth_unpin by 0x55cc9478b600 on [inode 0x100000005ce [2,head] /dc-dir/dc-file_985 auth v5972 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.236571+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9478b600] now 0 2023-10-03T19:21:21.968 INFO:teuthology.orchestra.run.smithi045.stdout: -3813> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+14 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9478b600 count now 1/14 2023-10-03T19:21:21.968 INFO:teuthology.orchestra.run.smithi045.stdout: -3812> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ce) clear_dirty_parent 2023-10-03T19:21:21.969 INFO:teuthology.orchestra.run.smithi045.stdout: -3811> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005cf) _stored_backtrace v 5190 2023-10-03T19:21:21.969 INFO:teuthology.orchestra.run.smithi045.stdout: -3810> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005cf) auth_unpin by 0x55cc9478bb80 on [inode 0x100000005cf [2,head] /dc-dir/dc-file_986 auth v5974 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.248205+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9478bb80] now 0 2023-10-03T19:21:21.969 INFO:teuthology.orchestra.run.smithi045.stdout: -3809> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+13 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9478bb80 count now 1/13 2023-10-03T19:21:21.969 INFO:teuthology.orchestra.run.smithi045.stdout: -3808> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005cf) clear_dirty_parent 2023-10-03T19:21:21.969 INFO:teuthology.orchestra.run.smithi045.stdout: -3807> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d0) _stored_backtrace v 5194 2023-10-03T19:21:21.969 INFO:teuthology.orchestra.run.smithi045.stdout: -3806> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d0) auth_unpin by 0x55cc9478c100 on [inode 0x100000005d0 [2,head] /dc-dir/dc-file_987 auth v5976 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.260102+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9478c100] now 0 2023-10-03T19:21:21.969 INFO:teuthology.orchestra.run.smithi045.stdout: -3805> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+12 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9478c100 count now 1/12 2023-10-03T19:21:21.969 INFO:teuthology.orchestra.run.smithi045.stdout: -3804> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d0) clear_dirty_parent 2023-10-03T19:21:21.969 INFO:teuthology.orchestra.run.smithi045.stdout: -3803> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d1) _stored_backtrace v 5198 2023-10-03T19:21:21.969 INFO:teuthology.orchestra.run.smithi045.stdout: -3802> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d1) auth_unpin by 0x55cc9478c680 on [inode 0x100000005d1 [2,head] /dc-dir/dc-file_988 auth v5978 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.272627+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9478c680] now 0 2023-10-03T19:21:21.969 INFO:teuthology.orchestra.run.smithi045.stdout: -3801> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+11 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9478c680 count now 1/11 2023-10-03T19:21:21.970 INFO:teuthology.orchestra.run.smithi045.stdout: -3800> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d1) clear_dirty_parent 2023-10-03T19:21:21.970 INFO:teuthology.orchestra.run.smithi045.stdout: -3799> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d2) _stored_backtrace v 5202 2023-10-03T19:21:21.970 INFO:teuthology.orchestra.run.smithi045.stdout: -3798> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d2) auth_unpin by 0x55cc9478cc00 on [inode 0x100000005d2 [2,head] /dc-dir/dc-file_989 auth v5980 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.286023+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9478cc00] now 0 2023-10-03T19:21:21.970 INFO:teuthology.orchestra.run.smithi045.stdout: -3797> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+10 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9478cc00 count now 1/10 2023-10-03T19:21:21.970 INFO:teuthology.orchestra.run.smithi045.stdout: -3796> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d2) clear_dirty_parent 2023-10-03T19:21:21.970 INFO:teuthology.orchestra.run.smithi045.stdout: -3795> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d3) _stored_backtrace v 5206 2023-10-03T19:21:21.970 INFO:teuthology.orchestra.run.smithi045.stdout: -3794> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d3) auth_unpin by 0x55cc9478d180 on [inode 0x100000005d3 [2,head] /dc-dir/dc-file_990 auth v5982 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.299168+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9478d180] now 0 2023-10-03T19:21:21.970 INFO:teuthology.orchestra.run.smithi045.stdout: -3793> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+9 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9478d180 count now 1/9 2023-10-03T19:21:21.970 INFO:teuthology.orchestra.run.smithi045.stdout: -3792> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d3) clear_dirty_parent 2023-10-03T19:21:21.970 INFO:teuthology.orchestra.run.smithi045.stdout: -3791> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d4) _stored_backtrace v 5210 2023-10-03T19:21:21.971 INFO:teuthology.orchestra.run.smithi045.stdout: -3790> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d4) auth_unpin by 0x55cc9478d700 on [inode 0x100000005d4 [2,head] /dc-dir/dc-file_991 auth v5984 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.312049+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc9478d700] now 0 2023-10-03T19:21:21.971 INFO:teuthology.orchestra.run.smithi045.stdout: -3789> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+8 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc9478d700 count now 1/8 2023-10-03T19:21:21.971 INFO:teuthology.orchestra.run.smithi045.stdout: -3788> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d4) clear_dirty_parent 2023-10-03T19:21:21.971 INFO:teuthology.orchestra.run.smithi045.stdout: -3787> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d5) _stored_backtrace v 5214 2023-10-03T19:21:21.971 INFO:teuthology.orchestra.run.smithi045.stdout: -3786> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d5) auth_unpin by 0x55cc947a0000 on [inode 0x100000005d5 [2,head] /dc-dir/dc-file_992 auth v5986 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.323818+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc947a0000] now 0 2023-10-03T19:21:21.971 INFO:teuthology.orchestra.run.smithi045.stdout: -3785> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+7 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc947a0000 count now 1/7 2023-10-03T19:21:21.971 INFO:teuthology.orchestra.run.smithi045.stdout: -3784> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d5) clear_dirty_parent 2023-10-03T19:21:21.971 INFO:teuthology.orchestra.run.smithi045.stdout: -3783> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d6) _stored_backtrace v 5218 2023-10-03T19:21:21.971 INFO:teuthology.orchestra.run.smithi045.stdout: -3782> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d6) auth_unpin by 0x55cc947a0580 on [inode 0x100000005d6 [2,head] /dc-dir/dc-file_993 auth v5988 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.335278+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc947a0580] now 0 2023-10-03T19:21:21.971 INFO:teuthology.orchestra.run.smithi045.stdout: -3781> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+6 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc947a0580 count now 1/6 2023-10-03T19:21:21.971 INFO:teuthology.orchestra.run.smithi045.stdout: -3780> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d6) clear_dirty_parent 2023-10-03T19:21:21.972 INFO:teuthology.orchestra.run.smithi045.stdout: -3779> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d7) _stored_backtrace v 5222 2023-10-03T19:21:21.972 INFO:teuthology.orchestra.run.smithi045.stdout: -3778> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d7) auth_unpin by 0x55cc947a0b00 on [inode 0x100000005d7 [2,head] /dc-dir/dc-file_994 auth v5990 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.347277+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc947a0b00] now 0 2023-10-03T19:21:21.972 INFO:teuthology.orchestra.run.smithi045.stdout: -3777> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+5 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc947a0b00 count now 1/5 2023-10-03T19:21:21.972 INFO:teuthology.orchestra.run.smithi045.stdout: -3776> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d7) clear_dirty_parent 2023-10-03T19:21:21.972 INFO:teuthology.orchestra.run.smithi045.stdout: -3775> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d8) _stored_backtrace v 5226 2023-10-03T19:21:21.972 INFO:teuthology.orchestra.run.smithi045.stdout: -3774> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d8) auth_unpin by 0x55cc947a1080 on [inode 0x100000005d8 [2,head] /dc-dir/dc-file_995 auth v5992 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.358556+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc947a1080] now 0 2023-10-03T19:21:21.972 INFO:teuthology.orchestra.run.smithi045.stdout: -3773> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+4 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc947a1080 count now 1/4 2023-10-03T19:21:21.972 INFO:teuthology.orchestra.run.smithi045.stdout: -3772> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d8) clear_dirty_parent 2023-10-03T19:21:21.972 INFO:teuthology.orchestra.run.smithi045.stdout: -3771> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d9) _stored_backtrace v 5230 2023-10-03T19:21:22.026 INFO:teuthology.orchestra.run.smithi045.stdout: -3770> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d9) auth_unpin by 0x55cc947a1600 on [inode 0x100000005d9 [2,head] /dc-dir/dc-file_996 auth v5994 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.369933+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc947a1600] now 0 2023-10-03T19:21:22.026 INFO:teuthology.orchestra.run.smithi045.stdout: -3769> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+3 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc947a1600 count now 1/3 2023-10-03T19:21:22.026 INFO:teuthology.orchestra.run.smithi045.stdout: -3768> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d9) clear_dirty_parent 2023-10-03T19:21:22.026 INFO:teuthology.orchestra.run.smithi045.stdout: -3767> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005da) _stored_backtrace v 5234 2023-10-03T19:21:22.026 INFO:teuthology.orchestra.run.smithi045.stdout: -3766> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005da) auth_unpin by 0x55cc947a1b80 on [inode 0x100000005da [2,head] /dc-dir/dc-file_997 auth v5996 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.381346+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc947a1b80] now 0 2023-10-03T19:21:22.026 INFO:teuthology.orchestra.run.smithi045.stdout: -3765> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+2 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc947a1b80 count now 1/2 2023-10-03T19:21:22.026 INFO:teuthology.orchestra.run.smithi045.stdout: -3764> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005da) clear_dirty_parent 2023-10-03T19:21:22.026 INFO:teuthology.orchestra.run.smithi045.stdout: -3763> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005db) _stored_backtrace v 5238 2023-10-03T19:21:22.026 INFO:teuthology.orchestra.run.smithi045.stdout: -3762> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005db) auth_unpin by 0x55cc947a2100 on [inode 0x100000005db [2,head] /dc-dir/dc-file_998 auth v5998 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.392936+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc947a2100] now 0 2023-10-03T19:21:22.026 INFO:teuthology.orchestra.run.smithi045.stdout: -3761> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+1 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc947a2100 count now 1/1 2023-10-03T19:21:22.027 INFO:teuthology.orchestra.run.smithi045.stdout: -3760> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005db) clear_dirty_parent 2023-10-03T19:21:22.027 INFO:teuthology.orchestra.run.smithi045.stdout: -3759> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005dc) _stored_backtrace v 5242 2023-10-03T19:21:22.027 INFO:teuthology.orchestra.run.smithi045.stdout: -3758> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005dc) auth_unpin by 0x55cc947a2680 on [inode 0x100000005dc [2,head] /dc-dir/dc-file_999 auth v6000 DIRTYPARENT s=3 n(v0 rc2023-10-03T19:17:58.405153+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=0 0x55cc947a2680] now 0 2023-10-03T19:21:22.027 INFO:teuthology.orchestra.run.smithi045.stdout: -3757> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+0 state=1074003969|complete f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=1000+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] by 0x55cc947a2680 count now 1/0 2023-10-03T19:21:22.027 INFO:teuthology.orchestra.run.smithi045.stdout: -3756> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005dc) clear_dirty_parent 2023-10-03T19:21:22.027 INFO:teuthology.orchestra.run.smithi045.stdout: -3755> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 MDSContext::complete: 21C_MaybeExpiredSegment 2023-10-03T19:21:22.027 INFO:teuthology.orchestra.run.smithi045.stdout: -3754> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.log _maybe_expired segment 2149/8390847, 862 events 2023-10-03T19:21:22.027 INFO:teuthology.orchestra.run.smithi045.stdout: -3753> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 6 mds.0.journal LogSegment(2149/8390847).try_to_expire 2023-10-03T19:21:22.027 INFO:teuthology.orchestra.run.smithi045.stdout: -3752> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 4 mds.0.sessionmap save_if_dirty: writing 0 2023-10-03T19:21:22.027 INFO:teuthology.orchestra.run.smithi045.stdout: -3751> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.journal try_to_expire waiting for purge of [] 2023-10-03T19:21:22.027 INFO:teuthology.orchestra.run.smithi045.stdout: -3750> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 6 mds.0.journal LogSegment(2149/8390847).try_to_expire success 2023-10-03T19:21:22.028 INFO:teuthology.orchestra.run.smithi045.stdout: -3749> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.log try_expire expired segment 2149/8390847 2023-10-03T19:21:22.028 INFO:teuthology.orchestra.run.smithi045.stdout: -3748> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 5 mds.0.log _expired segment 2149/8390847, 862 events 2023-10-03T19:21:22.028 INFO:teuthology.orchestra.run.smithi045.stdout: -3747> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 MDSContext::complete: 25MDSInternalContextWrapper 2023-10-03T19:21:22.028 INFO:teuthology.orchestra.run.smithi045.stdout: -3746> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 20 mds.0.33 handle_expire_segments: r=0 2023-10-03T19:21:22.028 INFO:teuthology.orchestra.run.smithi045.stdout: -3745> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 20 mds.0.33 trim_segments 2023-10-03T19:21:22.028 INFO:teuthology.orchestra.run.smithi045.stdout: -3744> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 5 mds.0.33 trim_expired_segments: expiry complete, expire_pos/trim_pos is now 400000/400000 2023-10-03T19:21:22.028 INFO:teuthology.orchestra.run.smithi045.stdout: -3743> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.log _trim_expired_segments trimming expired 1/0x400000 2023-10-03T19:21:22.028 INFO:teuthology.orchestra.run.smithi045.stdout: -3742> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.log _trim_expired_segments trimming expired 1025/0x5eb54c 2023-10-03T19:21:22.028 INFO:teuthology.orchestra.run.smithi045.stdout: -3741> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.log _trim_expired_segments trimming expired 2049/0x7d2002 2023-10-03T19:21:22.028 INFO:teuthology.orchestra.run.smithi045.stdout: -3740> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.log _trim_expired_segments trimming expired 2149/0x8008bf 2023-10-03T19:21:22.029 INFO:teuthology.orchestra.run.smithi045.stdout: -3739> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 10 mds.0.log _trim_expired_segments waiting for 3011/10057300 to expire 2023-10-03T19:21:22.029 INFO:teuthology.orchestra.run.smithi045.stdout: -3738> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2069 11.14 11:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed] in=90b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9460e700 con 0x55cc93ffc400 2023-10-03T19:21:22.029 INFO:teuthology.orchestra.run.smithi045.stdout: -3737> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 5 mds.0.33 trim_expired_segments: trim complete, expire_pos/trim_pos is now 997654/400000 2023-10-03T19:21:22.029 INFO:teuthology.orchestra.run.smithi045.stdout: -3736> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 20 mds.0.33 write_journal_head 2023-10-03T19:21:22.029 INFO:teuthology.orchestra.run.smithi045.stdout: -3735> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2070 11.14 11:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed] in=90b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b25c00 con 0x55cc93ffc400 2023-10-03T19:21:22.029 INFO:teuthology.orchestra.run.smithi045.stdout: -3734> 2023-10-03T19:18:09.857+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 985 ==== osd_op_reply(2069 200.00000000 [writefull 0~90 [fadvise_dontneed]] v74'853 uv853 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:22.029 INFO:teuthology.orchestra.run.smithi045.stdout: -3733> 2023-10-03T19:18:09.857+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2071 11.14 11:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b4e380 con 0x55cc93ffc400 2023-10-03T19:21:22.029 INFO:teuthology.orchestra.run.smithi045.stdout: -3732> 2023-10-03T19:18:09.861+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 986 ==== osd_op_reply(2070 200.00000000 [writefull 0~90 [fadvise_dontneed]] v74'854 uv854 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:22.029 INFO:teuthology.orchestra.run.smithi045.stdout: -3731> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 5 mds.0.33 handle_write_head: write_head complete, all done! 2023-10-03T19:21:22.029 INFO:teuthology.orchestra.run.smithi045.stdout: -3730> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 10 MDSContext::complete: 15C_Flush_Journal 2023-10-03T19:21:22.029 INFO:teuthology.orchestra.run.smithi045.stdout: -3729> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 20 mds.0.33 finish: r=0 2023-10-03T19:21:22.030 INFO:teuthology.orchestra.run.smithi045.stdout: -3728> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 20 mds.0.33 handle_flush_journal: r=0 2023-10-03T19:21:22.030 INFO:teuthology.orchestra.run.smithi045.stdout: -3727> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 20 mds.0.33 trim_cache 2023-10-03T19:21:22.030 INFO:teuthology.orchestra.run.smithi045.stdout: -3726> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 7 mds.0.cache trim bytes_used=3MB limit=4GB reservation=0.05% count=18446744073709551615 2023-10-03T19:21:22.030 INFO:teuthology.orchestra.run.smithi045.stdout: -3725> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 7 mds.0.cache trim_lru trimming 18446744073709551615 items from LRU size=1011 mid=70 pintail=911 pinned=911 2023-10-03T19:21:22.030 INFO:teuthology.orchestra.run.smithi045.stdout: -3724> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_99 [2,head] auth (dversion lock) v=2394 ino=0x10000000258 state=1073741824 0x55cc94206a00] 2023-10-03T19:21:22.030 INFO:teuthology.orchestra.run.smithi045.stdout: -3723> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.030 INFO:teuthology.orchestra.run.smithi045.stdout: -3722> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000258 [2,head] /dc-dir/dc-file_99 auth v2394 s=2 n(v0 rc2023-10-03T19:17:46.898841+0000 b2 1=1+0) (iversion lock) 0x55cc941ff180] 2023-10-03T19:21:22.030 INFO:teuthology.orchestra.run.smithi045.stdout: -3721> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_99 [2,head] auth (dversion lock) v=2394 ino=0x10000000258 state=1073741824 0x55cc94206a00] [inode 0x10000000258 [2,head] /dc-dir/dc-file_99 auth v2394 s=2 n(v0 rc2023-10-03T19:17:46.898841+0000 b2 1=1+0) (iversion lock) 0x55cc941ff180] 2023-10-03T19:21:22.030 INFO:teuthology.orchestra.run.smithi045.stdout: -3720> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000258 [2,head] #10000000258 auth v2394 s=2 n(v0 rc2023-10-03T19:17:46.898841+0000 b2 1=1+0) (iversion lock) 0x55cc941ff180] 2023-10-03T19:21:22.031 INFO:teuthology.orchestra.run.smithi045.stdout: -3719> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_99 [2,head] auth NULL (dversion lock) v=2394 ino=(nil) state=1073741824 0x55cc94206a00] 2023-10-03T19:21:22.031 INFO:teuthology.orchestra.run.smithi045.stdout: -3718> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_98 [2,head] auth (dversion lock) v=2392 ino=0x10000000257 state=1073741824 0x55cc94206780] 2023-10-03T19:21:22.031 INFO:teuthology.orchestra.run.smithi045.stdout: -3717> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.031 INFO:teuthology.orchestra.run.smithi045.stdout: -3716> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000257 [2,head] /dc-dir/dc-file_98 auth v2392 s=2 n(v0 rc2023-10-03T19:17:46.888942+0000 b2 1=1+0) (iversion lock) 0x55cc941fec00] 2023-10-03T19:21:22.031 INFO:teuthology.orchestra.run.smithi045.stdout: -3715> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_98 [2,head] auth (dversion lock) v=2392 ino=0x10000000257 state=1073741824 0x55cc94206780] [inode 0x10000000257 [2,head] /dc-dir/dc-file_98 auth v2392 s=2 n(v0 rc2023-10-03T19:17:46.888942+0000 b2 1=1+0) (iversion lock) 0x55cc941fec00] 2023-10-03T19:21:22.031 INFO:teuthology.orchestra.run.smithi045.stdout: -3714> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000257 [2,head] #10000000257 auth v2392 s=2 n(v0 rc2023-10-03T19:17:46.888942+0000 b2 1=1+0) (iversion lock) 0x55cc941fec00] 2023-10-03T19:21:22.031 INFO:teuthology.orchestra.run.smithi045.stdout: -3713> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_98 [2,head] auth NULL (dversion lock) v=2392 ino=(nil) state=1073741824 0x55cc94206780] 2023-10-03T19:21:22.031 INFO:teuthology.orchestra.run.smithi045.stdout: -3712> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_97 [2,head] auth (dversion lock) v=2390 ino=0x10000000256 state=1073741824 0x55cc94206500] 2023-10-03T19:21:22.031 INFO:teuthology.orchestra.run.smithi045.stdout: -3711> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.031 INFO:teuthology.orchestra.run.smithi045.stdout: -3710> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000256 [2,head] /dc-dir/dc-file_97 auth v2390 s=2 n(v0 rc2023-10-03T19:17:46.878151+0000 b2 1=1+0) (iversion lock) 0x55cc941fe680] 2023-10-03T19:21:22.031 INFO:teuthology.orchestra.run.smithi045.stdout: -3709> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_97 [2,head] auth (dversion lock) v=2390 ino=0x10000000256 state=1073741824 0x55cc94206500] [inode 0x10000000256 [2,head] /dc-dir/dc-file_97 auth v2390 s=2 n(v0 rc2023-10-03T19:17:46.878151+0000 b2 1=1+0) (iversion lock) 0x55cc941fe680] 2023-10-03T19:21:22.032 INFO:teuthology.orchestra.run.smithi045.stdout: -3708> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000256 [2,head] #10000000256 auth v2390 s=2 n(v0 rc2023-10-03T19:17:46.878151+0000 b2 1=1+0) (iversion lock) 0x55cc941fe680] 2023-10-03T19:21:22.032 INFO:teuthology.orchestra.run.smithi045.stdout: -3707> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_97 [2,head] auth NULL (dversion lock) v=2390 ino=(nil) state=1073741824 0x55cc94206500] 2023-10-03T19:21:22.032 INFO:teuthology.orchestra.run.smithi045.stdout: -3706> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_96 [2,head] auth (dversion lock) v=2388 ino=0x10000000255 state=1073741824 0x55cc94206280] 2023-10-03T19:21:22.032 INFO:teuthology.orchestra.run.smithi045.stdout: -3705> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.032 INFO:teuthology.orchestra.run.smithi045.stdout: -3704> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000255 [2,head] /dc-dir/dc-file_96 auth v2388 s=2 n(v0 rc2023-10-03T19:17:46.867300+0000 b2 1=1+0) (iversion lock) 0x55cc941fe100] 2023-10-03T19:21:22.032 INFO:teuthology.orchestra.run.smithi045.stdout: -3703> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_96 [2,head] auth (dversion lock) v=2388 ino=0x10000000255 state=1073741824 0x55cc94206280] [inode 0x10000000255 [2,head] /dc-dir/dc-file_96 auth v2388 s=2 n(v0 rc2023-10-03T19:17:46.867300+0000 b2 1=1+0) (iversion lock) 0x55cc941fe100] 2023-10-03T19:21:22.032 INFO:teuthology.orchestra.run.smithi045.stdout: -3702> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000255 [2,head] #10000000255 auth v2388 s=2 n(v0 rc2023-10-03T19:17:46.867300+0000 b2 1=1+0) (iversion lock) 0x55cc941fe100] 2023-10-03T19:21:22.032 INFO:teuthology.orchestra.run.smithi045.stdout: -3701> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_96 [2,head] auth NULL (dversion lock) v=2388 ino=(nil) state=1073741824 0x55cc94206280] 2023-10-03T19:21:22.032 INFO:teuthology.orchestra.run.smithi045.stdout: -3700> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_95 [2,head] auth (dversion lock) v=2386 ino=0x10000000254 state=1073741824 0x55cc94206000] 2023-10-03T19:21:22.032 INFO:teuthology.orchestra.run.smithi045.stdout: -3699> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.033 INFO:teuthology.orchestra.run.smithi045.stdout: -3698> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000254 [2,head] /dc-dir/dc-file_95 auth v2386 s=2 n(v0 rc2023-10-03T19:17:46.856217+0000 b2 1=1+0) (iversion lock) 0x55cc941fdb80] 2023-10-03T19:21:22.033 INFO:teuthology.orchestra.run.smithi045.stdout: -3697> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_95 [2,head] auth (dversion lock) v=2386 ino=0x10000000254 state=1073741824 0x55cc94206000] [inode 0x10000000254 [2,head] /dc-dir/dc-file_95 auth v2386 s=2 n(v0 rc2023-10-03T19:17:46.856217+0000 b2 1=1+0) (iversion lock) 0x55cc941fdb80] 2023-10-03T19:21:22.033 INFO:teuthology.orchestra.run.smithi045.stdout: -3696> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000254 [2,head] #10000000254 auth v2386 s=2 n(v0 rc2023-10-03T19:17:46.856217+0000 b2 1=1+0) (iversion lock) 0x55cc941fdb80] 2023-10-03T19:21:22.033 INFO:teuthology.orchestra.run.smithi045.stdout: -3695> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_95 [2,head] auth NULL (dversion lock) v=2386 ino=(nil) state=1073741824 0x55cc94206000] 2023-10-03T19:21:22.033 INFO:teuthology.orchestra.run.smithi045.stdout: -3694> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_94 [2,head] auth (dversion lock) v=2384 ino=0x10000000253 state=1073741824 0x55cc941f7b80] 2023-10-03T19:21:22.033 INFO:teuthology.orchestra.run.smithi045.stdout: -3693> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.033 INFO:teuthology.orchestra.run.smithi045.stdout: -3692> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000253 [2,head] /dc-dir/dc-file_94 auth v2384 s=2 n(v0 rc2023-10-03T19:17:46.845569+0000 b2 1=1+0) (iversion lock) 0x55cc941fd600] 2023-10-03T19:21:22.033 INFO:teuthology.orchestra.run.smithi045.stdout: -3691> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_94 [2,head] auth (dversion lock) v=2384 ino=0x10000000253 state=1073741824 0x55cc941f7b80] [inode 0x10000000253 [2,head] /dc-dir/dc-file_94 auth v2384 s=2 n(v0 rc2023-10-03T19:17:46.845569+0000 b2 1=1+0) (iversion lock) 0x55cc941fd600] 2023-10-03T19:21:22.033 INFO:teuthology.orchestra.run.smithi045.stdout: -3690> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000253 [2,head] #10000000253 auth v2384 s=2 n(v0 rc2023-10-03T19:17:46.845569+0000 b2 1=1+0) (iversion lock) 0x55cc941fd600] 2023-10-03T19:21:22.033 INFO:teuthology.orchestra.run.smithi045.stdout: -3689> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_94 [2,head] auth NULL (dversion lock) v=2384 ino=(nil) state=1073741824 0x55cc941f7b80] 2023-10-03T19:21:22.034 INFO:teuthology.orchestra.run.smithi045.stdout: -3688> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_93 [2,head] auth (dversion lock) v=2382 ino=0x10000000252 state=1073741824 0x55cc941f7900] 2023-10-03T19:21:22.034 INFO:teuthology.orchestra.run.smithi045.stdout: -3687> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.088 INFO:teuthology.orchestra.run.smithi045.stdout: -3686> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000252 [2,head] /dc-dir/dc-file_93 auth v2382 s=2 n(v0 rc2023-10-03T19:17:46.835136+0000 b2 1=1+0) (iversion lock) 0x55cc941fd080] 2023-10-03T19:21:22.088 INFO:teuthology.orchestra.run.smithi045.stdout: -3685> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_93 [2,head] auth (dversion lock) v=2382 ino=0x10000000252 state=1073741824 0x55cc941f7900] [inode 0x10000000252 [2,head] /dc-dir/dc-file_93 auth v2382 s=2 n(v0 rc2023-10-03T19:17:46.835136+0000 b2 1=1+0) (iversion lock) 0x55cc941fd080] 2023-10-03T19:21:22.088 INFO:teuthology.orchestra.run.smithi045.stdout: -3684> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000252 [2,head] #10000000252 auth v2382 s=2 n(v0 rc2023-10-03T19:17:46.835136+0000 b2 1=1+0) (iversion lock) 0x55cc941fd080] 2023-10-03T19:21:22.088 INFO:teuthology.orchestra.run.smithi045.stdout: -3683> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_93 [2,head] auth NULL (dversion lock) v=2382 ino=(nil) state=1073741824 0x55cc941f7900] 2023-10-03T19:21:22.088 INFO:teuthology.orchestra.run.smithi045.stdout: -3682> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_92 [2,head] auth (dversion lock) v=2380 ino=0x10000000251 state=1073741824 0x55cc941f7680] 2023-10-03T19:21:22.089 INFO:teuthology.orchestra.run.smithi045.stdout: -3681> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.089 INFO:teuthology.orchestra.run.smithi045.stdout: -3680> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000251 [2,head] /dc-dir/dc-file_92 auth v2380 s=2 n(v0 rc2023-10-03T19:17:46.824804+0000 b2 1=1+0) (iversion lock) 0x55cc941fcb00] 2023-10-03T19:21:22.089 INFO:teuthology.orchestra.run.smithi045.stdout: -3679> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_92 [2,head] auth (dversion lock) v=2380 ino=0x10000000251 state=1073741824 0x55cc941f7680] [inode 0x10000000251 [2,head] /dc-dir/dc-file_92 auth v2380 s=2 n(v0 rc2023-10-03T19:17:46.824804+0000 b2 1=1+0) (iversion lock) 0x55cc941fcb00] 2023-10-03T19:21:22.089 INFO:teuthology.orchestra.run.smithi045.stdout: -3678> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000251 [2,head] #10000000251 auth v2380 s=2 n(v0 rc2023-10-03T19:17:46.824804+0000 b2 1=1+0) (iversion lock) 0x55cc941fcb00] 2023-10-03T19:21:22.089 INFO:teuthology.orchestra.run.smithi045.stdout: -3677> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_92 [2,head] auth NULL (dversion lock) v=2380 ino=(nil) state=1073741824 0x55cc941f7680] 2023-10-03T19:21:22.089 INFO:teuthology.orchestra.run.smithi045.stdout: -3676> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_91 [2,head] auth (dversion lock) v=2378 ino=0x10000000250 state=1073741824 0x55cc941f7400] 2023-10-03T19:21:22.089 INFO:teuthology.orchestra.run.smithi045.stdout: -3675> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.089 INFO:teuthology.orchestra.run.smithi045.stdout: -3674> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000250 [2,head] /dc-dir/dc-file_91 auth v2378 s=2 n(v0 rc2023-10-03T19:17:46.814955+0000 b2 1=1+0) (iversion lock) 0x55cc941fc580] 2023-10-03T19:21:22.089 INFO:teuthology.orchestra.run.smithi045.stdout: -3673> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_91 [2,head] auth (dversion lock) v=2378 ino=0x10000000250 state=1073741824 0x55cc941f7400] [inode 0x10000000250 [2,head] /dc-dir/dc-file_91 auth v2378 s=2 n(v0 rc2023-10-03T19:17:46.814955+0000 b2 1=1+0) (iversion lock) 0x55cc941fc580] 2023-10-03T19:21:22.089 INFO:teuthology.orchestra.run.smithi045.stdout: -3672> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000250 [2,head] #10000000250 auth v2378 s=2 n(v0 rc2023-10-03T19:17:46.814955+0000 b2 1=1+0) (iversion lock) 0x55cc941fc580] 2023-10-03T19:21:22.089 INFO:teuthology.orchestra.run.smithi045.stdout: -3671> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_91 [2,head] auth NULL (dversion lock) v=2378 ino=(nil) state=1073741824 0x55cc941f7400] 2023-10-03T19:21:22.090 INFO:teuthology.orchestra.run.smithi045.stdout: -3670> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_90 [2,head] auth (dversion lock) v=2376 ino=0x1000000024f state=1073741824 0x55cc941f7180] 2023-10-03T19:21:22.090 INFO:teuthology.orchestra.run.smithi045.stdout: -3669> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.090 INFO:teuthology.orchestra.run.smithi045.stdout: -3668> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x1000000024f [2,head] /dc-dir/dc-file_90 auth v2376 s=2 n(v0 rc2023-10-03T19:17:46.805384+0000 b2 1=1+0) (iversion lock) 0x55cc941fc000] 2023-10-03T19:21:22.090 INFO:teuthology.orchestra.run.smithi045.stdout: -3667> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_90 [2,head] auth (dversion lock) v=2376 ino=0x1000000024f state=1073741824 0x55cc941f7180] [inode 0x1000000024f [2,head] /dc-dir/dc-file_90 auth v2376 s=2 n(v0 rc2023-10-03T19:17:46.805384+0000 b2 1=1+0) (iversion lock) 0x55cc941fc000] 2023-10-03T19:21:22.090 INFO:teuthology.orchestra.run.smithi045.stdout: -3666> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x1000000024f [2,head] #1000000024f auth v2376 s=2 n(v0 rc2023-10-03T19:17:46.805384+0000 b2 1=1+0) (iversion lock) 0x55cc941fc000] 2023-10-03T19:21:22.090 INFO:teuthology.orchestra.run.smithi045.stdout: -3665> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_90 [2,head] auth NULL (dversion lock) v=2376 ino=(nil) state=1073741824 0x55cc941f7180] 2023-10-03T19:21:22.090 INFO:teuthology.orchestra.run.smithi045.stdout: -3664> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_89 [2,head] auth (dversion lock) v=2374 ino=0x1000000024e state=1073741824 0x55cc941f6f00] 2023-10-03T19:21:22.090 INFO:teuthology.orchestra.run.smithi045.stdout: -3663> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.090 INFO:teuthology.orchestra.run.smithi045.stdout: -3662> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x1000000024e [2,head] /dc-dir/dc-file_89 auth v2374 s=2 n(v0 rc2023-10-03T19:17:46.795432+0000 b2 1=1+0) (iversion lock) 0x55cc941f1700] 2023-10-03T19:21:22.090 INFO:teuthology.orchestra.run.smithi045.stdout: -3661> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_89 [2,head] auth (dversion lock) v=2374 ino=0x1000000024e state=1073741824 0x55cc941f6f00] [inode 0x1000000024e [2,head] /dc-dir/dc-file_89 auth v2374 s=2 n(v0 rc2023-10-03T19:17:46.795432+0000 b2 1=1+0) (iversion lock) 0x55cc941f1700] 2023-10-03T19:21:22.091 INFO:teuthology.orchestra.run.smithi045.stdout: -3660> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x1000000024e [2,head] #1000000024e auth v2374 s=2 n(v0 rc2023-10-03T19:17:46.795432+0000 b2 1=1+0) (iversion lock) 0x55cc941f1700] 2023-10-03T19:21:22.091 INFO:teuthology.orchestra.run.smithi045.stdout: -3659> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_89 [2,head] auth NULL (dversion lock) v=2374 ino=(nil) state=1073741824 0x55cc941f6f00] 2023-10-03T19:21:22.091 INFO:teuthology.orchestra.run.smithi045.stdout: -3658> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_88 [2,head] auth (dversion lock) v=2372 ino=0x1000000024d state=1073741824 0x55cc941f6c80] 2023-10-03T19:21:22.091 INFO:teuthology.orchestra.run.smithi045.stdout: -3657> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.091 INFO:teuthology.orchestra.run.smithi045.stdout: -3656> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x1000000024d [2,head] /dc-dir/dc-file_88 auth v2372 s=2 n(v0 rc2023-10-03T19:17:46.785465+0000 b2 1=1+0) (iversion lock) 0x55cc941f1180] 2023-10-03T19:21:22.091 INFO:teuthology.orchestra.run.smithi045.stdout: -3655> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_88 [2,head] auth (dversion lock) v=2372 ino=0x1000000024d state=1073741824 0x55cc941f6c80] [inode 0x1000000024d [2,head] /dc-dir/dc-file_88 auth v2372 s=2 n(v0 rc2023-10-03T19:17:46.785465+0000 b2 1=1+0) (iversion lock) 0x55cc941f1180] 2023-10-03T19:21:22.091 INFO:teuthology.orchestra.run.smithi045.stdout: -3654> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x1000000024d [2,head] #1000000024d auth v2372 s=2 n(v0 rc2023-10-03T19:17:46.785465+0000 b2 1=1+0) (iversion lock) 0x55cc941f1180] 2023-10-03T19:21:22.091 INFO:teuthology.orchestra.run.smithi045.stdout: -3653> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_88 [2,head] auth NULL (dversion lock) v=2372 ino=(nil) state=1073741824 0x55cc941f6c80] 2023-10-03T19:21:22.091 INFO:teuthology.orchestra.run.smithi045.stdout: -3652> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_87 [2,head] auth (dversion lock) v=2370 ino=0x1000000024c state=1073741824 0x55cc941f6a00] 2023-10-03T19:21:22.091 INFO:teuthology.orchestra.run.smithi045.stdout: -3651> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.092 INFO:teuthology.orchestra.run.smithi045.stdout: -3650> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x1000000024c [2,head] /dc-dir/dc-file_87 auth v2370 s=2 n(v0 rc2023-10-03T19:17:46.775229+0000 b2 1=1+0) (iversion lock) 0x55cc941f0c00] 2023-10-03T19:21:22.092 INFO:teuthology.orchestra.run.smithi045.stdout: -3649> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_87 [2,head] auth (dversion lock) v=2370 ino=0x1000000024c state=1073741824 0x55cc941f6a00] [inode 0x1000000024c [2,head] /dc-dir/dc-file_87 auth v2370 s=2 n(v0 rc2023-10-03T19:17:46.775229+0000 b2 1=1+0) (iversion lock) 0x55cc941f0c00] 2023-10-03T19:21:22.092 INFO:teuthology.orchestra.run.smithi045.stdout: -3648> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x1000000024c [2,head] #1000000024c auth v2370 s=2 n(v0 rc2023-10-03T19:17:46.775229+0000 b2 1=1+0) (iversion lock) 0x55cc941f0c00] 2023-10-03T19:21:22.092 INFO:teuthology.orchestra.run.smithi045.stdout: -3647> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_87 [2,head] auth NULL (dversion lock) v=2370 ino=(nil) state=1073741824 0x55cc941f6a00] 2023-10-03T19:21:22.092 INFO:teuthology.orchestra.run.smithi045.stdout: -3646> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_86 [2,head] auth (dversion lock) v=2368 ino=0x1000000024b state=1073741824 0x55cc941f6780] 2023-10-03T19:21:22.092 INFO:teuthology.orchestra.run.smithi045.stdout: -3645> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.092 INFO:teuthology.orchestra.run.smithi045.stdout: -3644> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x1000000024b [2,head] /dc-dir/dc-file_86 auth v2368 s=2 n(v0 rc2023-10-03T19:17:46.765075+0000 b2 1=1+0) (iversion lock) 0x55cc941f0680] 2023-10-03T19:21:22.092 INFO:teuthology.orchestra.run.smithi045.stdout: -3643> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_86 [2,head] auth (dversion lock) v=2368 ino=0x1000000024b state=1073741824 0x55cc941f6780] [inode 0x1000000024b [2,head] /dc-dir/dc-file_86 auth v2368 s=2 n(v0 rc2023-10-03T19:17:46.765075+0000 b2 1=1+0) (iversion lock) 0x55cc941f0680] 2023-10-03T19:21:22.092 INFO:teuthology.orchestra.run.smithi045.stdout: -3642> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x1000000024b [2,head] #1000000024b auth v2368 s=2 n(v0 rc2023-10-03T19:17:46.765075+0000 b2 1=1+0) (iversion lock) 0x55cc941f0680] 2023-10-03T19:21:22.092 INFO:teuthology.orchestra.run.smithi045.stdout: -3641> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_86 [2,head] auth NULL (dversion lock) v=2368 ino=(nil) state=1073741824 0x55cc941f6780] 2023-10-03T19:21:22.092 INFO:teuthology.orchestra.run.smithi045.stdout: -3640> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_85 [2,head] auth (dversion lock) v=2366 ino=0x1000000024a state=1073741824 0x55cc941f6500] 2023-10-03T19:21:22.092 INFO:teuthology.orchestra.run.smithi045.stdout: -3639> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.093 INFO:teuthology.orchestra.run.smithi045.stdout: -3638> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x1000000024a [2,head] /dc-dir/dc-file_85 auth v2366 s=2 n(v0 rc2023-10-03T19:17:46.754912+0000 b2 1=1+0) (iversion lock) 0x55cc941f0100] 2023-10-03T19:21:22.093 INFO:teuthology.orchestra.run.smithi045.stdout: -3637> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_85 [2,head] auth (dversion lock) v=2366 ino=0x1000000024a state=1073741824 0x55cc941f6500] [inode 0x1000000024a [2,head] /dc-dir/dc-file_85 auth v2366 s=2 n(v0 rc2023-10-03T19:17:46.754912+0000 b2 1=1+0) (iversion lock) 0x55cc941f0100] 2023-10-03T19:21:22.093 INFO:teuthology.orchestra.run.smithi045.stdout: -3636> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x1000000024a [2,head] #1000000024a auth v2366 s=2 n(v0 rc2023-10-03T19:17:46.754912+0000 b2 1=1+0) (iversion lock) 0x55cc941f0100] 2023-10-03T19:21:22.093 INFO:teuthology.orchestra.run.smithi045.stdout: -3635> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_85 [2,head] auth NULL (dversion lock) v=2366 ino=(nil) state=1073741824 0x55cc941f6500] 2023-10-03T19:21:22.093 INFO:teuthology.orchestra.run.smithi045.stdout: -3634> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_84 [2,head] auth (dversion lock) v=2364 ino=0x10000000249 state=1073741824 0x55cc941f6280] 2023-10-03T19:21:22.093 INFO:teuthology.orchestra.run.smithi045.stdout: -3633> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.093 INFO:teuthology.orchestra.run.smithi045.stdout: -3632> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000249 [2,head] /dc-dir/dc-file_84 auth v2364 s=2 n(v0 rc2023-10-03T19:17:46.745120+0000 b2 1=1+0) (iversion lock) 0x55cc941efb80] 2023-10-03T19:21:22.093 INFO:teuthology.orchestra.run.smithi045.stdout: -3631> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_84 [2,head] auth (dversion lock) v=2364 ino=0x10000000249 state=1073741824 0x55cc941f6280] [inode 0x10000000249 [2,head] /dc-dir/dc-file_84 auth v2364 s=2 n(v0 rc2023-10-03T19:17:46.745120+0000 b2 1=1+0) (iversion lock) 0x55cc941efb80] 2023-10-03T19:21:22.093 INFO:teuthology.orchestra.run.smithi045.stdout: -3630> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000249 [2,head] #10000000249 auth v2364 s=2 n(v0 rc2023-10-03T19:17:46.745120+0000 b2 1=1+0) (iversion lock) 0x55cc941efb80] 2023-10-03T19:21:22.093 INFO:teuthology.orchestra.run.smithi045.stdout: -3629> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_84 [2,head] auth NULL (dversion lock) v=2364 ino=(nil) state=1073741824 0x55cc941f6280] 2023-10-03T19:21:22.093 INFO:teuthology.orchestra.run.smithi045.stdout: -3628> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_83 [2,head] auth (dversion lock) v=2362 ino=0x10000000248 state=1073741824 0x55cc941f6000] 2023-10-03T19:21:22.094 INFO:teuthology.orchestra.run.smithi045.stdout: -3627> 2023-10-03T19:18:09.861+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 987 ==== osd_op_reply(2071 200.00000001 [delete] v74'855 uv855 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:22.094 INFO:teuthology.orchestra.run.smithi045.stdout: -3626> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.094 INFO:teuthology.orchestra.run.smithi045.stdout: -3625> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000248 [2,head] /dc-dir/dc-file_83 auth v2362 s=2 n(v0 rc2023-10-03T19:17:46.735243+0000 b2 1=1+0) (iversion lock) 0x55cc941ef600] 2023-10-03T19:21:22.094 INFO:teuthology.orchestra.run.smithi045.stdout: -3624> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_83 [2,head] auth (dversion lock) v=2362 ino=0x10000000248 state=1073741824 0x55cc941f6000] [inode 0x10000000248 [2,head] /dc-dir/dc-file_83 auth v2362 s=2 n(v0 rc2023-10-03T19:17:46.735243+0000 b2 1=1+0) (iversion lock) 0x55cc941ef600] 2023-10-03T19:21:22.112 INFO:teuthology.orchestra.run.smithi045.stdout: -3623> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000248 [2,head] #10000000248 auth v2362 s=2 n(v0 rc2023-10-03T19:17:46.735243+0000 b2 1=1+0) (iversion lock) 0x55cc941ef600] 2023-10-03T19:21:22.112 INFO:teuthology.orchestra.run.smithi045.stdout: -3622> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_83 [2,head] auth NULL (dversion lock) v=2362 ino=(nil) state=1073741824 0x55cc941f6000] 2023-10-03T19:21:22.112 INFO:teuthology.orchestra.run.smithi045.stdout: -3621> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_82 [2,head] auth (dversion lock) v=2360 ino=0x10000000247 state=1073741824 0x55cc94163b80] 2023-10-03T19:21:22.112 INFO:teuthology.orchestra.run.smithi045.stdout: -3620> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.112 INFO:teuthology.orchestra.run.smithi045.stdout: -3619> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000247 [2,head] /dc-dir/dc-file_82 auth v2360 s=2 n(v0 rc2023-10-03T19:17:46.724011+0000 b2 1=1+0) (iversion lock) 0x55cc941ef080] 2023-10-03T19:21:22.112 INFO:teuthology.orchestra.run.smithi045.stdout: -3618> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_82 [2,head] auth (dversion lock) v=2360 ino=0x10000000247 state=1073741824 0x55cc94163b80] [inode 0x10000000247 [2,head] /dc-dir/dc-file_82 auth v2360 s=2 n(v0 rc2023-10-03T19:17:46.724011+0000 b2 1=1+0) (iversion lock) 0x55cc941ef080] 2023-10-03T19:21:22.112 INFO:teuthology.orchestra.run.smithi045.stdout: -3617> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000247 [2,head] #10000000247 auth v2360 s=2 n(v0 rc2023-10-03T19:17:46.724011+0000 b2 1=1+0) (iversion lock) 0x55cc941ef080] 2023-10-03T19:21:22.112 INFO:teuthology.orchestra.run.smithi045.stdout: -3616> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_82 [2,head] auth NULL (dversion lock) v=2360 ino=(nil) state=1073741824 0x55cc94163b80] 2023-10-03T19:21:22.112 INFO:teuthology.orchestra.run.smithi045.stdout: -3615> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_81 [2,head] auth (dversion lock) v=2358 ino=0x10000000246 state=1073741824 0x55cc94163900] 2023-10-03T19:21:22.112 INFO:teuthology.orchestra.run.smithi045.stdout: -3614> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.112 INFO:teuthology.orchestra.run.smithi045.stdout: -3613> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000246 [2,head] /dc-dir/dc-file_81 auth v2358 s=2 n(v0 rc2023-10-03T19:17:46.713935+0000 b2 1=1+0) (iversion lock) 0x55cc941eeb00] 2023-10-03T19:21:22.113 INFO:teuthology.orchestra.run.smithi045.stdout: -3612> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_81 [2,head] auth (dversion lock) v=2358 ino=0x10000000246 state=1073741824 0x55cc94163900] [inode 0x10000000246 [2,head] /dc-dir/dc-file_81 auth v2358 s=2 n(v0 rc2023-10-03T19:17:46.713935+0000 b2 1=1+0) (iversion lock) 0x55cc941eeb00] 2023-10-03T19:21:22.113 INFO:teuthology.orchestra.run.smithi045.stdout: -3611> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000246 [2,head] #10000000246 auth v2358 s=2 n(v0 rc2023-10-03T19:17:46.713935+0000 b2 1=1+0) (iversion lock) 0x55cc941eeb00] 2023-10-03T19:21:22.113 INFO:teuthology.orchestra.run.smithi045.stdout: -3610> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_81 [2,head] auth NULL (dversion lock) v=2358 ino=(nil) state=1073741824 0x55cc94163900] 2023-10-03T19:21:22.113 INFO:teuthology.orchestra.run.smithi045.stdout: -3609> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_80 [2,head] auth (dversion lock) v=2356 ino=0x10000000245 state=1073741824 0x55cc94163680] 2023-10-03T19:21:22.113 INFO:teuthology.orchestra.run.smithi045.stdout: -3608> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.113 INFO:teuthology.orchestra.run.smithi045.stdout: -3607> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000245 [2,head] /dc-dir/dc-file_80 auth v2356 s=2 n(v0 rc2023-10-03T19:17:46.704334+0000 b2 1=1+0) (iversion lock) 0x55cc941ee580] 2023-10-03T19:21:22.113 INFO:teuthology.orchestra.run.smithi045.stdout: -3606> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_80 [2,head] auth (dversion lock) v=2356 ino=0x10000000245 state=1073741824 0x55cc94163680] [inode 0x10000000245 [2,head] /dc-dir/dc-file_80 auth v2356 s=2 n(v0 rc2023-10-03T19:17:46.704334+0000 b2 1=1+0) (iversion lock) 0x55cc941ee580] 2023-10-03T19:21:22.113 INFO:teuthology.orchestra.run.smithi045.stdout: -3605> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000245 [2,head] #10000000245 auth v2356 s=2 n(v0 rc2023-10-03T19:17:46.704334+0000 b2 1=1+0) (iversion lock) 0x55cc941ee580] 2023-10-03T19:21:22.113 INFO:teuthology.orchestra.run.smithi045.stdout: -3604> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_80 [2,head] auth NULL (dversion lock) v=2356 ino=(nil) state=1073741824 0x55cc94163680] 2023-10-03T19:21:22.113 INFO:teuthology.orchestra.run.smithi045.stdout: -3603> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_79 [2,head] auth (dversion lock) v=2354 ino=0x10000000244 state=1073741824 0x55cc94163400] 2023-10-03T19:21:22.113 INFO:teuthology.orchestra.run.smithi045.stdout: -3602> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.114 INFO:teuthology.orchestra.run.smithi045.stdout: -3601> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000244 [2,head] /dc-dir/dc-file_79 auth v2354 s=2 n(v0 rc2023-10-03T19:17:46.693622+0000 b2 1=1+0) (iversion lock) 0x55cc941ee000] 2023-10-03T19:21:22.114 INFO:teuthology.orchestra.run.smithi045.stdout: -3600> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_79 [2,head] auth (dversion lock) v=2354 ino=0x10000000244 state=1073741824 0x55cc94163400] [inode 0x10000000244 [2,head] /dc-dir/dc-file_79 auth v2354 s=2 n(v0 rc2023-10-03T19:17:46.693622+0000 b2 1=1+0) (iversion lock) 0x55cc941ee000] 2023-10-03T19:21:22.114 INFO:teuthology.orchestra.run.smithi045.stdout: -3599> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000244 [2,head] #10000000244 auth v2354 s=2 n(v0 rc2023-10-03T19:17:46.693622+0000 b2 1=1+0) (iversion lock) 0x55cc941ee000] 2023-10-03T19:21:22.114 INFO:teuthology.orchestra.run.smithi045.stdout: -3598> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_79 [2,head] auth NULL (dversion lock) v=2354 ino=(nil) state=1073741824 0x55cc94163400] 2023-10-03T19:21:22.114 INFO:teuthology.orchestra.run.smithi045.stdout: -3597> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_78 [2,head] auth (dversion lock) v=2352 ino=0x10000000243 state=1073741824 0x55cc94163180] 2023-10-03T19:21:22.114 INFO:teuthology.orchestra.run.smithi045.stdout: -3596> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.114 INFO:teuthology.orchestra.run.smithi045.stdout: -3595> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000243 [2,head] /dc-dir/dc-file_78 auth v2352 s=2 n(v0 rc2023-10-03T19:17:46.683580+0000 b2 1=1+0) (iversion lock) 0x55cc941e5700] 2023-10-03T19:21:22.114 INFO:teuthology.orchestra.run.smithi045.stdout: -3594> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_78 [2,head] auth (dversion lock) v=2352 ino=0x10000000243 state=1073741824 0x55cc94163180] [inode 0x10000000243 [2,head] /dc-dir/dc-file_78 auth v2352 s=2 n(v0 rc2023-10-03T19:17:46.683580+0000 b2 1=1+0) (iversion lock) 0x55cc941e5700] 2023-10-03T19:21:22.114 INFO:teuthology.orchestra.run.smithi045.stdout: -3593> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000243 [2,head] #10000000243 auth v2352 s=2 n(v0 rc2023-10-03T19:17:46.683580+0000 b2 1=1+0) (iversion lock) 0x55cc941e5700] 2023-10-03T19:21:22.114 INFO:teuthology.orchestra.run.smithi045.stdout: -3592> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_78 [2,head] auth NULL (dversion lock) v=2352 ino=(nil) state=1073741824 0x55cc94163180] 2023-10-03T19:21:22.114 INFO:teuthology.orchestra.run.smithi045.stdout: -3591> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_77 [2,head] auth (dversion lock) v=2350 ino=0x10000000242 state=1073741824 0x55cc94162f00] 2023-10-03T19:21:22.115 INFO:teuthology.orchestra.run.smithi045.stdout: -3590> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.115 INFO:teuthology.orchestra.run.smithi045.stdout: -3589> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000242 [2,head] /dc-dir/dc-file_77 auth v2350 s=2 n(v0 rc2023-10-03T19:17:46.673440+0000 b2 1=1+0) (iversion lock) 0x55cc941e5180] 2023-10-03T19:21:22.115 INFO:teuthology.orchestra.run.smithi045.stdout: -3588> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_77 [2,head] auth (dversion lock) v=2350 ino=0x10000000242 state=1073741824 0x55cc94162f00] [inode 0x10000000242 [2,head] /dc-dir/dc-file_77 auth v2350 s=2 n(v0 rc2023-10-03T19:17:46.673440+0000 b2 1=1+0) (iversion lock) 0x55cc941e5180] 2023-10-03T19:21:22.115 INFO:teuthology.orchestra.run.smithi045.stdout: -3587> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000242 [2,head] #10000000242 auth v2350 s=2 n(v0 rc2023-10-03T19:17:46.673440+0000 b2 1=1+0) (iversion lock) 0x55cc941e5180] 2023-10-03T19:21:22.115 INFO:teuthology.orchestra.run.smithi045.stdout: -3586> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_77 [2,head] auth NULL (dversion lock) v=2350 ino=(nil) state=1073741824 0x55cc94162f00] 2023-10-03T19:21:22.115 INFO:teuthology.orchestra.run.smithi045.stdout: -3585> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_76 [2,head] auth (dversion lock) v=2348 ino=0x10000000241 state=1073741824 0x55cc94162c80] 2023-10-03T19:21:22.115 INFO:teuthology.orchestra.run.smithi045.stdout: -3584> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.115 INFO:teuthology.orchestra.run.smithi045.stdout: -3583> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000241 [2,head] /dc-dir/dc-file_76 auth v2348 s=2 n(v0 rc2023-10-03T19:17:46.663411+0000 b2 1=1+0) (iversion lock) 0x55cc941e4c00] 2023-10-03T19:21:22.115 INFO:teuthology.orchestra.run.smithi045.stdout: -3582> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_76 [2,head] auth (dversion lock) v=2348 ino=0x10000000241 state=1073741824 0x55cc94162c80] [inode 0x10000000241 [2,head] /dc-dir/dc-file_76 auth v2348 s=2 n(v0 rc2023-10-03T19:17:46.663411+0000 b2 1=1+0) (iversion lock) 0x55cc941e4c00] 2023-10-03T19:21:22.115 INFO:teuthology.orchestra.run.smithi045.stdout: -3581> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000241 [2,head] #10000000241 auth v2348 s=2 n(v0 rc2023-10-03T19:17:46.663411+0000 b2 1=1+0) (iversion lock) 0x55cc941e4c00] 2023-10-03T19:21:22.115 INFO:teuthology.orchestra.run.smithi045.stdout: -3580> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_76 [2,head] auth NULL (dversion lock) v=2348 ino=(nil) state=1073741824 0x55cc94162c80] 2023-10-03T19:21:22.115 INFO:teuthology.orchestra.run.smithi045.stdout: -3579> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_75 [2,head] auth (dversion lock) v=2346 ino=0x10000000240 state=1073741824 0x55cc94162a00] 2023-10-03T19:21:22.116 INFO:teuthology.orchestra.run.smithi045.stdout: -3578> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.116 INFO:teuthology.orchestra.run.smithi045.stdout: -3577> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000240 [2,head] /dc-dir/dc-file_75 auth v2346 s=2 n(v0 rc2023-10-03T19:17:46.653998+0000 b2 1=1+0) (iversion lock) 0x55cc941e4680] 2023-10-03T19:21:22.116 INFO:teuthology.orchestra.run.smithi045.stdout: -3576> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_75 [2,head] auth (dversion lock) v=2346 ino=0x10000000240 state=1073741824 0x55cc94162a00] [inode 0x10000000240 [2,head] /dc-dir/dc-file_75 auth v2346 s=2 n(v0 rc2023-10-03T19:17:46.653998+0000 b2 1=1+0) (iversion lock) 0x55cc941e4680] 2023-10-03T19:21:22.116 INFO:teuthology.orchestra.run.smithi045.stdout: -3575> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000240 [2,head] #10000000240 auth v2346 s=2 n(v0 rc2023-10-03T19:17:46.653998+0000 b2 1=1+0) (iversion lock) 0x55cc941e4680] 2023-10-03T19:21:22.116 INFO:teuthology.orchestra.run.smithi045.stdout: -3574> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_75 [2,head] auth NULL (dversion lock) v=2346 ino=(nil) state=1073741824 0x55cc94162a00] 2023-10-03T19:21:22.116 INFO:teuthology.orchestra.run.smithi045.stdout: -3573> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_74 [2,head] auth (dversion lock) v=2344 ino=0x1000000023f state=1073741824 0x55cc94162780] 2023-10-03T19:21:22.116 INFO:teuthology.orchestra.run.smithi045.stdout: -3572> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.116 INFO:teuthology.orchestra.run.smithi045.stdout: -3571> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x1000000023f [2,head] /dc-dir/dc-file_74 auth v2344 s=2 n(v0 rc2023-10-03T19:17:46.643478+0000 b2 1=1+0) (iversion lock) 0x55cc941e4100] 2023-10-03T19:21:22.116 INFO:teuthology.orchestra.run.smithi045.stdout: -3570> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_74 [2,head] auth (dversion lock) v=2344 ino=0x1000000023f state=1073741824 0x55cc94162780] [inode 0x1000000023f [2,head] /dc-dir/dc-file_74 auth v2344 s=2 n(v0 rc2023-10-03T19:17:46.643478+0000 b2 1=1+0) (iversion lock) 0x55cc941e4100] 2023-10-03T19:21:22.116 INFO:teuthology.orchestra.run.smithi045.stdout: -3569> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x1000000023f [2,head] #1000000023f auth v2344 s=2 n(v0 rc2023-10-03T19:17:46.643478+0000 b2 1=1+0) (iversion lock) 0x55cc941e4100] 2023-10-03T19:21:22.116 INFO:teuthology.orchestra.run.smithi045.stdout: -3568> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_74 [2,head] auth NULL (dversion lock) v=2344 ino=(nil) state=1073741824 0x55cc94162780] 2023-10-03T19:21:22.116 INFO:teuthology.orchestra.run.smithi045.stdout: -3567> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_73 [2,head] auth (dversion lock) v=2342 ino=0x1000000023e state=1073741824 0x55cc94162500] 2023-10-03T19:21:22.117 INFO:teuthology.orchestra.run.smithi045.stdout: -3566> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.117 INFO:teuthology.orchestra.run.smithi045.stdout: -3565> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x1000000023e [2,head] /dc-dir/dc-file_73 auth v2342 s=2 n(v0 rc2023-10-03T19:17:46.633217+0000 b2 1=1+0) (iversion lock) 0x55cc941e3b80] 2023-10-03T19:21:22.117 INFO:teuthology.orchestra.run.smithi045.stdout: -3564> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_73 [2,head] auth (dversion lock) v=2342 ino=0x1000000023e state=1073741824 0x55cc94162500] [inode 0x1000000023e [2,head] /dc-dir/dc-file_73 auth v2342 s=2 n(v0 rc2023-10-03T19:17:46.633217+0000 b2 1=1+0) (iversion lock) 0x55cc941e3b80] 2023-10-03T19:21:22.117 INFO:teuthology.orchestra.run.smithi045.stdout: -3563> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x1000000023e [2,head] #1000000023e auth v2342 s=2 n(v0 rc2023-10-03T19:17:46.633217+0000 b2 1=1+0) (iversion lock) 0x55cc941e3b80] 2023-10-03T19:21:22.117 INFO:teuthology.orchestra.run.smithi045.stdout: -3562> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_73 [2,head] auth NULL (dversion lock) v=2342 ino=(nil) state=1073741824 0x55cc94162500] 2023-10-03T19:21:22.117 INFO:teuthology.orchestra.run.smithi045.stdout: -3561> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_72 [2,head] auth (dversion lock) v=2340 ino=0x1000000023d state=1073741824 0x55cc94162280] 2023-10-03T19:21:22.117 INFO:teuthology.orchestra.run.smithi045.stdout: -3560> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.117 INFO:teuthology.orchestra.run.smithi045.stdout: -3559> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x1000000023d [2,head] /dc-dir/dc-file_72 auth v2340 s=2 n(v0 rc2023-10-03T19:17:46.623058+0000 b2 1=1+0) (iversion lock) 0x55cc941e3600] 2023-10-03T19:21:22.117 INFO:teuthology.orchestra.run.smithi045.stdout: -3558> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_72 [2,head] auth (dversion lock) v=2340 ino=0x1000000023d state=1073741824 0x55cc94162280] [inode 0x1000000023d [2,head] /dc-dir/dc-file_72 auth v2340 s=2 n(v0 rc2023-10-03T19:17:46.623058+0000 b2 1=1+0) (iversion lock) 0x55cc941e3600] 2023-10-03T19:21:22.117 INFO:teuthology.orchestra.run.smithi045.stdout: -3557> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x1000000023d [2,head] #1000000023d auth v2340 s=2 n(v0 rc2023-10-03T19:17:46.623058+0000 b2 1=1+0) (iversion lock) 0x55cc941e3600] 2023-10-03T19:21:22.117 INFO:teuthology.orchestra.run.smithi045.stdout: -3556> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_72 [2,head] auth NULL (dversion lock) v=2340 ino=(nil) state=1073741824 0x55cc94162280] 2023-10-03T19:21:22.118 INFO:teuthology.orchestra.run.smithi045.stdout: -3555> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_71 [2,head] auth (dversion lock) v=2338 ino=0x1000000023c state=1073741824 0x55cc94162000] 2023-10-03T19:21:22.118 INFO:teuthology.orchestra.run.smithi045.stdout: -3554> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.118 INFO:teuthology.orchestra.run.smithi045.stdout: -3553> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x1000000023c [2,head] /dc-dir/dc-file_71 auth v2338 s=2 n(v0 rc2023-10-03T19:17:46.612432+0000 b2 1=1+0) (iversion lock) 0x55cc941e3080] 2023-10-03T19:21:22.118 INFO:teuthology.orchestra.run.smithi045.stdout: -3552> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_71 [2,head] auth (dversion lock) v=2338 ino=0x1000000023c state=1073741824 0x55cc94162000] [inode 0x1000000023c [2,head] /dc-dir/dc-file_71 auth v2338 s=2 n(v0 rc2023-10-03T19:17:46.612432+0000 b2 1=1+0) (iversion lock) 0x55cc941e3080] 2023-10-03T19:21:22.118 INFO:teuthology.orchestra.run.smithi045.stdout: -3551> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x1000000023c [2,head] #1000000023c auth v2338 s=2 n(v0 rc2023-10-03T19:17:46.612432+0000 b2 1=1+0) (iversion lock) 0x55cc941e3080] 2023-10-03T19:21:22.118 INFO:teuthology.orchestra.run.smithi045.stdout: -3550> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_71 [2,head] auth NULL (dversion lock) v=2338 ino=(nil) state=1073741824 0x55cc94162000] 2023-10-03T19:21:22.118 INFO:teuthology.orchestra.run.smithi045.stdout: -3549> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_70 [2,head] auth (dversion lock) v=2336 ino=0x1000000023b state=1073741824 0x55cc941dfb80] 2023-10-03T19:21:22.118 INFO:teuthology.orchestra.run.smithi045.stdout: -3548> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.118 INFO:teuthology.orchestra.run.smithi045.stdout: -3547> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x1000000023b [2,head] /dc-dir/dc-file_70 auth v2336 s=2 n(v0 rc2023-10-03T19:17:46.602117+0000 b2 1=1+0) (iversion lock) 0x55cc941e2b00] 2023-10-03T19:21:22.135 INFO:teuthology.orchestra.run.smithi045.stdout: -3546> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_70 [2,head] auth (dversion lock) v=2336 ino=0x1000000023b state=1073741824 0x55cc941dfb80] [inode 0x1000000023b [2,head] /dc-dir/dc-file_70 auth v2336 s=2 n(v0 rc2023-10-03T19:17:46.602117+0000 b2 1=1+0) (iversion lock) 0x55cc941e2b00] 2023-10-03T19:21:22.135 INFO:teuthology.orchestra.run.smithi045.stdout: -3545> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x1000000023b [2,head] #1000000023b auth v2336 s=2 n(v0 rc2023-10-03T19:17:46.602117+0000 b2 1=1+0) (iversion lock) 0x55cc941e2b00] 2023-10-03T19:21:22.135 INFO:teuthology.orchestra.run.smithi045.stdout: -3544> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_70 [2,head] auth NULL (dversion lock) v=2336 ino=(nil) state=1073741824 0x55cc941dfb80] 2023-10-03T19:21:22.135 INFO:teuthology.orchestra.run.smithi045.stdout: -3543> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_69 [2,head] auth (dversion lock) v=2334 ino=0x1000000023a state=1073741824 0x55cc941df900] 2023-10-03T19:21:22.135 INFO:teuthology.orchestra.run.smithi045.stdout: -3542> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.135 INFO:teuthology.orchestra.run.smithi045.stdout: -3541> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x1000000023a [2,head] /dc-dir/dc-file_69 auth v2334 s=2 n(v0 rc2023-10-03T19:17:46.591614+0000 b2 1=1+0) (iversion lock) 0x55cc941e2580] 2023-10-03T19:21:22.136 INFO:teuthology.orchestra.run.smithi045.stdout: -3540> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_69 [2,head] auth (dversion lock) v=2334 ino=0x1000000023a state=1073741824 0x55cc941df900] [inode 0x1000000023a [2,head] /dc-dir/dc-file_69 auth v2334 s=2 n(v0 rc2023-10-03T19:17:46.591614+0000 b2 1=1+0) (iversion lock) 0x55cc941e2580] 2023-10-03T19:21:22.136 INFO:teuthology.orchestra.run.smithi045.stdout: -3539> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x1000000023a [2,head] #1000000023a auth v2334 s=2 n(v0 rc2023-10-03T19:17:46.591614+0000 b2 1=1+0) (iversion lock) 0x55cc941e2580] 2023-10-03T19:21:22.136 INFO:teuthology.orchestra.run.smithi045.stdout: -3538> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_69 [2,head] auth NULL (dversion lock) v=2334 ino=(nil) state=1073741824 0x55cc941df900] 2023-10-03T19:21:22.136 INFO:teuthology.orchestra.run.smithi045.stdout: -3537> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_68 [2,head] auth (dversion lock) v=2332 ino=0x10000000239 state=1073741824 0x55cc941df680] 2023-10-03T19:21:22.136 INFO:teuthology.orchestra.run.smithi045.stdout: -3536> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.136 INFO:teuthology.orchestra.run.smithi045.stdout: -3535> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000239 [2,head] /dc-dir/dc-file_68 auth v2332 s=2 n(v0 rc2023-10-03T19:17:46.580351+0000 b2 1=1+0) (iversion lock) 0x55cc941e2000] 2023-10-03T19:21:22.136 INFO:teuthology.orchestra.run.smithi045.stdout: -3534> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_68 [2,head] auth (dversion lock) v=2332 ino=0x10000000239 state=1073741824 0x55cc941df680] [inode 0x10000000239 [2,head] /dc-dir/dc-file_68 auth v2332 s=2 n(v0 rc2023-10-03T19:17:46.580351+0000 b2 1=1+0) (iversion lock) 0x55cc941e2000] 2023-10-03T19:21:22.136 INFO:teuthology.orchestra.run.smithi045.stdout: -3533> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000239 [2,head] #10000000239 auth v2332 s=2 n(v0 rc2023-10-03T19:17:46.580351+0000 b2 1=1+0) (iversion lock) 0x55cc941e2000] 2023-10-03T19:21:22.136 INFO:teuthology.orchestra.run.smithi045.stdout: -3532> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_68 [2,head] auth NULL (dversion lock) v=2332 ino=(nil) state=1073741824 0x55cc941df680] 2023-10-03T19:21:22.136 INFO:teuthology.orchestra.run.smithi045.stdout: -3531> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_67 [2,head] auth (dversion lock) v=2330 ino=0x10000000238 state=1073741824 0x55cc941df400] 2023-10-03T19:21:22.136 INFO:teuthology.orchestra.run.smithi045.stdout: -3530> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.137 INFO:teuthology.orchestra.run.smithi045.stdout: -3529> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000238 [2,head] /dc-dir/dc-file_67 auth v2330 s=2 n(v0 rc2023-10-03T19:17:46.568935+0000 b2 1=1+0) (iversion lock) 0x55cc941d9700] 2023-10-03T19:21:22.137 INFO:teuthology.orchestra.run.smithi045.stdout: -3528> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_67 [2,head] auth (dversion lock) v=2330 ino=0x10000000238 state=1073741824 0x55cc941df400] [inode 0x10000000238 [2,head] /dc-dir/dc-file_67 auth v2330 s=2 n(v0 rc2023-10-03T19:17:46.568935+0000 b2 1=1+0) (iversion lock) 0x55cc941d9700] 2023-10-03T19:21:22.137 INFO:teuthology.orchestra.run.smithi045.stdout: -3527> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000238 [2,head] #10000000238 auth v2330 s=2 n(v0 rc2023-10-03T19:17:46.568935+0000 b2 1=1+0) (iversion lock) 0x55cc941d9700] 2023-10-03T19:21:22.137 INFO:teuthology.orchestra.run.smithi045.stdout: -3526> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_67 [2,head] auth NULL (dversion lock) v=2330 ino=(nil) state=1073741824 0x55cc941df400] 2023-10-03T19:21:22.137 INFO:teuthology.orchestra.run.smithi045.stdout: -3525> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_66 [2,head] auth (dversion lock) v=2328 ino=0x10000000237 state=1073741824 0x55cc941df180] 2023-10-03T19:21:22.137 INFO:teuthology.orchestra.run.smithi045.stdout: -3524> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.137 INFO:teuthology.orchestra.run.smithi045.stdout: -3523> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000237 [2,head] /dc-dir/dc-file_66 auth v2328 s=2 n(v0 rc2023-10-03T19:17:46.558452+0000 b2 1=1+0) (iversion lock) 0x55cc941d9180] 2023-10-03T19:21:22.137 INFO:teuthology.orchestra.run.smithi045.stdout: -3522> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_66 [2,head] auth (dversion lock) v=2328 ino=0x10000000237 state=1073741824 0x55cc941df180] [inode 0x10000000237 [2,head] /dc-dir/dc-file_66 auth v2328 s=2 n(v0 rc2023-10-03T19:17:46.558452+0000 b2 1=1+0) (iversion lock) 0x55cc941d9180] 2023-10-03T19:21:22.137 INFO:teuthology.orchestra.run.smithi045.stdout: -3521> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000237 [2,head] #10000000237 auth v2328 s=2 n(v0 rc2023-10-03T19:17:46.558452+0000 b2 1=1+0) (iversion lock) 0x55cc941d9180] 2023-10-03T19:21:22.137 INFO:teuthology.orchestra.run.smithi045.stdout: -3520> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_66 [2,head] auth NULL (dversion lock) v=2328 ino=(nil) state=1073741824 0x55cc941df180] 2023-10-03T19:21:22.138 INFO:teuthology.orchestra.run.smithi045.stdout: -3519> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_65 [2,head] auth (dversion lock) v=2326 ino=0x10000000236 state=1073741824 0x55cc941def00] 2023-10-03T19:21:22.138 INFO:teuthology.orchestra.run.smithi045.stdout: -3518> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.138 INFO:teuthology.orchestra.run.smithi045.stdout: -3517> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000236 [2,head] /dc-dir/dc-file_65 auth v2326 s=2 n(v0 rc2023-10-03T19:17:46.546897+0000 b2 1=1+0) (iversion lock) 0x55cc941d8c00] 2023-10-03T19:21:22.138 INFO:teuthology.orchestra.run.smithi045.stdout: -3516> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_65 [2,head] auth (dversion lock) v=2326 ino=0x10000000236 state=1073741824 0x55cc941def00] [inode 0x10000000236 [2,head] /dc-dir/dc-file_65 auth v2326 s=2 n(v0 rc2023-10-03T19:17:46.546897+0000 b2 1=1+0) (iversion lock) 0x55cc941d8c00] 2023-10-03T19:21:22.138 INFO:teuthology.orchestra.run.smithi045.stdout: -3515> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000236 [2,head] #10000000236 auth v2326 s=2 n(v0 rc2023-10-03T19:17:46.546897+0000 b2 1=1+0) (iversion lock) 0x55cc941d8c00] 2023-10-03T19:21:22.138 INFO:teuthology.orchestra.run.smithi045.stdout: -3514> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_65 [2,head] auth NULL (dversion lock) v=2326 ino=(nil) state=1073741824 0x55cc941def00] 2023-10-03T19:21:22.138 INFO:teuthology.orchestra.run.smithi045.stdout: -3513> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_64 [2,head] auth (dversion lock) v=2324 ino=0x10000000235 state=1073741824 0x55cc941dec80] 2023-10-03T19:21:22.138 INFO:teuthology.orchestra.run.smithi045.stdout: -3512> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.138 INFO:teuthology.orchestra.run.smithi045.stdout: -3511> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000235 [2,head] /dc-dir/dc-file_64 auth v2324 s=2 n(v0 rc2023-10-03T19:17:46.535182+0000 b2 1=1+0) (iversion lock) 0x55cc941d8680] 2023-10-03T19:21:22.139 INFO:teuthology.orchestra.run.smithi045.stdout: -3510> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_64 [2,head] auth (dversion lock) v=2324 ino=0x10000000235 state=1073741824 0x55cc941dec80] [inode 0x10000000235 [2,head] /dc-dir/dc-file_64 auth v2324 s=2 n(v0 rc2023-10-03T19:17:46.535182+0000 b2 1=1+0) (iversion lock) 0x55cc941d8680] 2023-10-03T19:21:22.139 INFO:teuthology.orchestra.run.smithi045.stdout: -3509> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000235 [2,head] #10000000235 auth v2324 s=2 n(v0 rc2023-10-03T19:17:46.535182+0000 b2 1=1+0) (iversion lock) 0x55cc941d8680] 2023-10-03T19:21:22.139 INFO:teuthology.orchestra.run.smithi045.stdout: -3508> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_64 [2,head] auth NULL (dversion lock) v=2324 ino=(nil) state=1073741824 0x55cc941dec80] 2023-10-03T19:21:22.139 INFO:teuthology.orchestra.run.smithi045.stdout: -3507> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_63 [2,head] auth (dversion lock) v=2322 ino=0x10000000234 state=1073741824 0x55cc941dea00] 2023-10-03T19:21:22.139 INFO:teuthology.orchestra.run.smithi045.stdout: -3506> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.139 INFO:teuthology.orchestra.run.smithi045.stdout: -3505> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000234 [2,head] /dc-dir/dc-file_63 auth v2322 s=2 n(v0 rc2023-10-03T19:17:46.523862+0000 b2 1=1+0) (iversion lock) 0x55cc941d8100] 2023-10-03T19:21:22.139 INFO:teuthology.orchestra.run.smithi045.stdout: -3504> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_63 [2,head] auth (dversion lock) v=2322 ino=0x10000000234 state=1073741824 0x55cc941dea00] [inode 0x10000000234 [2,head] /dc-dir/dc-file_63 auth v2322 s=2 n(v0 rc2023-10-03T19:17:46.523862+0000 b2 1=1+0) (iversion lock) 0x55cc941d8100] 2023-10-03T19:21:22.139 INFO:teuthology.orchestra.run.smithi045.stdout: -3503> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000234 [2,head] #10000000234 auth v2322 s=2 n(v0 rc2023-10-03T19:17:46.523862+0000 b2 1=1+0) (iversion lock) 0x55cc941d8100] 2023-10-03T19:21:22.139 INFO:teuthology.orchestra.run.smithi045.stdout: -3502> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_63 [2,head] auth NULL (dversion lock) v=2322 ino=(nil) state=1073741824 0x55cc941dea00] 2023-10-03T19:21:22.139 INFO:teuthology.orchestra.run.smithi045.stdout: -3501> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_62 [2,head] auth (dversion lock) v=2320 ino=0x10000000233 state=1073741824 0x55cc941de780] 2023-10-03T19:21:22.139 INFO:teuthology.orchestra.run.smithi045.stdout: -3500> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.140 INFO:teuthology.orchestra.run.smithi045.stdout: -3499> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000233 [2,head] /dc-dir/dc-file_62 auth v2320 s=2 n(v0 rc2023-10-03T19:17:46.513190+0000 b2 1=1+0) (iversion lock) 0x55cc941d7b80] 2023-10-03T19:21:22.140 INFO:teuthology.orchestra.run.smithi045.stdout: -3498> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_62 [2,head] auth (dversion lock) v=2320 ino=0x10000000233 state=1073741824 0x55cc941de780] [inode 0x10000000233 [2,head] /dc-dir/dc-file_62 auth v2320 s=2 n(v0 rc2023-10-03T19:17:46.513190+0000 b2 1=1+0) (iversion lock) 0x55cc941d7b80] 2023-10-03T19:21:22.140 INFO:teuthology.orchestra.run.smithi045.stdout: -3497> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000233 [2,head] #10000000233 auth v2320 s=2 n(v0 rc2023-10-03T19:17:46.513190+0000 b2 1=1+0) (iversion lock) 0x55cc941d7b80] 2023-10-03T19:21:22.140 INFO:teuthology.orchestra.run.smithi045.stdout: -3496> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_62 [2,head] auth NULL (dversion lock) v=2320 ino=(nil) state=1073741824 0x55cc941de780] 2023-10-03T19:21:22.140 INFO:teuthology.orchestra.run.smithi045.stdout: -3495> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_61 [2,head] auth (dversion lock) v=2318 ino=0x10000000232 state=1073741824 0x55cc941de500] 2023-10-03T19:21:22.140 INFO:teuthology.orchestra.run.smithi045.stdout: -3494> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.140 INFO:teuthology.orchestra.run.smithi045.stdout: -3493> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000232 [2,head] /dc-dir/dc-file_61 auth v2318 s=2 n(v0 rc2023-10-03T19:17:46.501815+0000 b2 1=1+0) (iversion lock) 0x55cc941d7600] 2023-10-03T19:21:22.140 INFO:teuthology.orchestra.run.smithi045.stdout: -3492> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_61 [2,head] auth (dversion lock) v=2318 ino=0x10000000232 state=1073741824 0x55cc941de500] [inode 0x10000000232 [2,head] /dc-dir/dc-file_61 auth v2318 s=2 n(v0 rc2023-10-03T19:17:46.501815+0000 b2 1=1+0) (iversion lock) 0x55cc941d7600] 2023-10-03T19:21:22.140 INFO:teuthology.orchestra.run.smithi045.stdout: -3491> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000232 [2,head] #10000000232 auth v2318 s=2 n(v0 rc2023-10-03T19:17:46.501815+0000 b2 1=1+0) (iversion lock) 0x55cc941d7600] 2023-10-03T19:21:22.140 INFO:teuthology.orchestra.run.smithi045.stdout: -3490> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_61 [2,head] auth NULL (dversion lock) v=2318 ino=(nil) state=1073741824 0x55cc941de500] 2023-10-03T19:21:22.140 INFO:teuthology.orchestra.run.smithi045.stdout: -3489> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_60 [2,head] auth (dversion lock) v=2316 ino=0x10000000231 state=1073741824 0x55cc941de280] 2023-10-03T19:21:22.141 INFO:teuthology.orchestra.run.smithi045.stdout: -3488> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.141 INFO:teuthology.orchestra.run.smithi045.stdout: -3487> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000231 [2,head] /dc-dir/dc-file_60 auth v2316 s=2 n(v0 rc2023-10-03T19:17:46.491650+0000 b2 1=1+0) (iversion lock) 0x55cc941d7080] 2023-10-03T19:21:22.141 INFO:teuthology.orchestra.run.smithi045.stdout: -3486> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_60 [2,head] auth (dversion lock) v=2316 ino=0x10000000231 state=1073741824 0x55cc941de280] [inode 0x10000000231 [2,head] /dc-dir/dc-file_60 auth v2316 s=2 n(v0 rc2023-10-03T19:17:46.491650+0000 b2 1=1+0) (iversion lock) 0x55cc941d7080] 2023-10-03T19:21:22.141 INFO:teuthology.orchestra.run.smithi045.stdout: -3485> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000231 [2,head] #10000000231 auth v2316 s=2 n(v0 rc2023-10-03T19:17:46.491650+0000 b2 1=1+0) (iversion lock) 0x55cc941d7080] 2023-10-03T19:21:22.141 INFO:teuthology.orchestra.run.smithi045.stdout: -3484> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_60 [2,head] auth NULL (dversion lock) v=2316 ino=(nil) state=1073741824 0x55cc941de280] 2023-10-03T19:21:22.141 INFO:teuthology.orchestra.run.smithi045.stdout: -3483> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_59 [2,head] auth (dversion lock) v=2314 ino=0x10000000230 state=1073741824 0x55cc941de000] 2023-10-03T19:21:22.141 INFO:teuthology.orchestra.run.smithi045.stdout: -3482> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.141 INFO:teuthology.orchestra.run.smithi045.stdout: -3481> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000230 [2,head] /dc-dir/dc-file_59 auth v2314 s=2 n(v0 rc2023-10-03T19:17:46.481346+0000 b2 1=1+0) (iversion lock) 0x55cc941d6b00] 2023-10-03T19:21:22.141 INFO:teuthology.orchestra.run.smithi045.stdout: -3480> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_59 [2,head] auth (dversion lock) v=2314 ino=0x10000000230 state=1073741824 0x55cc941de000] [inode 0x10000000230 [2,head] /dc-dir/dc-file_59 auth v2314 s=2 n(v0 rc2023-10-03T19:17:46.481346+0000 b2 1=1+0) (iversion lock) 0x55cc941d6b00] 2023-10-03T19:21:22.142 INFO:teuthology.orchestra.run.smithi045.stdout: -3479> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000230 [2,head] #10000000230 auth v2314 s=2 n(v0 rc2023-10-03T19:17:46.481346+0000 b2 1=1+0) (iversion lock) 0x55cc941d6b00] 2023-10-03T19:21:22.142 INFO:teuthology.orchestra.run.smithi045.stdout: -3478> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_59 [2,head] auth NULL (dversion lock) v=2314 ino=(nil) state=1073741824 0x55cc941de000] 2023-10-03T19:21:22.142 INFO:teuthology.orchestra.run.smithi045.stdout: -3477> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_58 [2,head] auth (dversion lock) v=2312 ino=0x1000000022f state=1073741824 0x55cc941bbb80] 2023-10-03T19:21:22.142 INFO:teuthology.orchestra.run.smithi045.stdout: -3476> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.244 INFO:teuthology.orchestra.run.smithi045.stdout: -3475> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x1000000022f [2,head] /dc-dir/dc-file_58 auth v2312 s=2 n(v0 rc2023-10-03T19:17:46.471692+0000 b2 1=1+0) (iversion lock) 0x55cc941d6580] 2023-10-03T19:21:22.244 INFO:teuthology.orchestra.run.smithi045.stdout: -3474> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_58 [2,head] auth (dversion lock) v=2312 ino=0x1000000022f state=1073741824 0x55cc941bbb80] [inode 0x1000000022f [2,head] /dc-dir/dc-file_58 auth v2312 s=2 n(v0 rc2023-10-03T19:17:46.471692+0000 b2 1=1+0) (iversion lock) 0x55cc941d6580] 2023-10-03T19:21:22.244 INFO:teuthology.orchestra.run.smithi045.stdout: -3473> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x1000000022f [2,head] #1000000022f auth v2312 s=2 n(v0 rc2023-10-03T19:17:46.471692+0000 b2 1=1+0) (iversion lock) 0x55cc941d6580] 2023-10-03T19:21:22.244 INFO:teuthology.orchestra.run.smithi045.stdout: -3472> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_58 [2,head] auth NULL (dversion lock) v=2312 ino=(nil) state=1073741824 0x55cc941bbb80] 2023-10-03T19:21:22.244 INFO:teuthology.orchestra.run.smithi045.stdout: -3471> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_57 [2,head] auth (dversion lock) v=2310 ino=0x1000000022e state=1073741824 0x55cc941bb900] 2023-10-03T19:21:22.244 INFO:teuthology.orchestra.run.smithi045.stdout: -3470> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.244 INFO:teuthology.orchestra.run.smithi045.stdout: -3469> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x1000000022e [2,head] /dc-dir/dc-file_57 auth v2310 s=2 n(v0 rc2023-10-03T19:17:46.462021+0000 b2 1=1+0) (iversion lock) 0x55cc941d6000] 2023-10-03T19:21:22.244 INFO:teuthology.orchestra.run.smithi045.stdout: -3468> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_57 [2,head] auth (dversion lock) v=2310 ino=0x1000000022e state=1073741824 0x55cc941bb900] [inode 0x1000000022e [2,head] /dc-dir/dc-file_57 auth v2310 s=2 n(v0 rc2023-10-03T19:17:46.462021+0000 b2 1=1+0) (iversion lock) 0x55cc941d6000] 2023-10-03T19:21:22.244 INFO:teuthology.orchestra.run.smithi045.stdout: -3467> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x1000000022e [2,head] #1000000022e auth v2310 s=2 n(v0 rc2023-10-03T19:17:46.462021+0000 b2 1=1+0) (iversion lock) 0x55cc941d6000] 2023-10-03T19:21:22.245 INFO:teuthology.orchestra.run.smithi045.stdout: -3466> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_57 [2,head] auth NULL (dversion lock) v=2310 ino=(nil) state=1073741824 0x55cc941bb900] 2023-10-03T19:21:22.245 INFO:teuthology.orchestra.run.smithi045.stdout: -3465> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_56 [2,head] auth (dversion lock) v=2308 ino=0x1000000022d state=1073741824 0x55cc941bb680] 2023-10-03T19:21:22.245 INFO:teuthology.orchestra.run.smithi045.stdout: -3464> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.245 INFO:teuthology.orchestra.run.smithi045.stdout: -3463> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x1000000022d [2,head] /dc-dir/dc-file_56 auth v2308 s=2 n(v0 rc2023-10-03T19:17:46.450791+0000 b2 1=1+0) (iversion lock) 0x55cc941b7700] 2023-10-03T19:21:22.245 INFO:teuthology.orchestra.run.smithi045.stdout: -3462> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_56 [2,head] auth (dversion lock) v=2308 ino=0x1000000022d state=1073741824 0x55cc941bb680] [inode 0x1000000022d [2,head] /dc-dir/dc-file_56 auth v2308 s=2 n(v0 rc2023-10-03T19:17:46.450791+0000 b2 1=1+0) (iversion lock) 0x55cc941b7700] 2023-10-03T19:21:22.245 INFO:teuthology.orchestra.run.smithi045.stdout: -3461> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x1000000022d [2,head] #1000000022d auth v2308 s=2 n(v0 rc2023-10-03T19:17:46.450791+0000 b2 1=1+0) (iversion lock) 0x55cc941b7700] 2023-10-03T19:21:22.245 INFO:teuthology.orchestra.run.smithi045.stdout: -3460> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_56 [2,head] auth NULL (dversion lock) v=2308 ino=(nil) state=1073741824 0x55cc941bb680] 2023-10-03T19:21:22.245 INFO:teuthology.orchestra.run.smithi045.stdout: -3459> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_55 [2,head] auth (dversion lock) v=2306 ino=0x1000000022c state=1073741824 0x55cc941bb400] 2023-10-03T19:21:22.245 INFO:teuthology.orchestra.run.smithi045.stdout: -3458> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.245 INFO:teuthology.orchestra.run.smithi045.stdout: -3457> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x1000000022c [2,head] /dc-dir/dc-file_55 auth v2306 s=2 n(v0 rc2023-10-03T19:17:46.439706+0000 b2 1=1+0) (iversion lock) 0x55cc941b7180] 2023-10-03T19:21:22.245 INFO:teuthology.orchestra.run.smithi045.stdout: -3456> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_55 [2,head] auth (dversion lock) v=2306 ino=0x1000000022c state=1073741824 0x55cc941bb400] [inode 0x1000000022c [2,head] /dc-dir/dc-file_55 auth v2306 s=2 n(v0 rc2023-10-03T19:17:46.439706+0000 b2 1=1+0) (iversion lock) 0x55cc941b7180] 2023-10-03T19:21:22.245 INFO:teuthology.orchestra.run.smithi045.stdout: -3455> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x1000000022c [2,head] #1000000022c auth v2306 s=2 n(v0 rc2023-10-03T19:17:46.439706+0000 b2 1=1+0) (iversion lock) 0x55cc941b7180] 2023-10-03T19:21:22.246 INFO:teuthology.orchestra.run.smithi045.stdout: -3454> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_55 [2,head] auth NULL (dversion lock) v=2306 ino=(nil) state=1073741824 0x55cc941bb400] 2023-10-03T19:21:22.246 INFO:teuthology.orchestra.run.smithi045.stdout: -3453> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_54 [2,head] auth (dversion lock) v=2304 ino=0x1000000022b state=1073741824 0x55cc941bb180] 2023-10-03T19:21:22.246 INFO:teuthology.orchestra.run.smithi045.stdout: -3452> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.246 INFO:teuthology.orchestra.run.smithi045.stdout: -3451> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x1000000022b [2,head] /dc-dir/dc-file_54 auth v2304 s=2 n(v0 rc2023-10-03T19:17:46.429989+0000 b2 1=1+0) (iversion lock) 0x55cc941b6c00] 2023-10-03T19:21:22.246 INFO:teuthology.orchestra.run.smithi045.stdout: -3450> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_54 [2,head] auth (dversion lock) v=2304 ino=0x1000000022b state=1073741824 0x55cc941bb180] [inode 0x1000000022b [2,head] /dc-dir/dc-file_54 auth v2304 s=2 n(v0 rc2023-10-03T19:17:46.429989+0000 b2 1=1+0) (iversion lock) 0x55cc941b6c00] 2023-10-03T19:21:22.246 INFO:teuthology.orchestra.run.smithi045.stdout: -3449> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x1000000022b [2,head] #1000000022b auth v2304 s=2 n(v0 rc2023-10-03T19:17:46.429989+0000 b2 1=1+0) (iversion lock) 0x55cc941b6c00] 2023-10-03T19:21:22.246 INFO:teuthology.orchestra.run.smithi045.stdout: -3448> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_54 [2,head] auth NULL (dversion lock) v=2304 ino=(nil) state=1073741824 0x55cc941bb180] 2023-10-03T19:21:22.246 INFO:teuthology.orchestra.run.smithi045.stdout: -3447> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_53 [2,head] auth (dversion lock) v=2302 ino=0x1000000022a state=1073741824 0x55cc941baf00] 2023-10-03T19:21:22.246 INFO:teuthology.orchestra.run.smithi045.stdout: -3446> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.246 INFO:teuthology.orchestra.run.smithi045.stdout: -3445> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x1000000022a [2,head] /dc-dir/dc-file_53 auth v2302 s=2 n(v0 rc2023-10-03T19:17:46.420220+0000 b2 1=1+0) (iversion lock) 0x55cc941b6680] 2023-10-03T19:21:22.247 INFO:teuthology.orchestra.run.smithi045.stdout: -3444> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_53 [2,head] auth (dversion lock) v=2302 ino=0x1000000022a state=1073741824 0x55cc941baf00] [inode 0x1000000022a [2,head] /dc-dir/dc-file_53 auth v2302 s=2 n(v0 rc2023-10-03T19:17:46.420220+0000 b2 1=1+0) (iversion lock) 0x55cc941b6680] 2023-10-03T19:21:22.247 INFO:teuthology.orchestra.run.smithi045.stdout: -3443> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x1000000022a [2,head] #1000000022a auth v2302 s=2 n(v0 rc2023-10-03T19:17:46.420220+0000 b2 1=1+0) (iversion lock) 0x55cc941b6680] 2023-10-03T19:21:22.247 INFO:teuthology.orchestra.run.smithi045.stdout: -3442> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_53 [2,head] auth NULL (dversion lock) v=2302 ino=(nil) state=1073741824 0x55cc941baf00] 2023-10-03T19:21:22.247 INFO:teuthology.orchestra.run.smithi045.stdout: -3441> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_52 [2,head] auth (dversion lock) v=2300 ino=0x10000000229 state=1073741824 0x55cc941bac80] 2023-10-03T19:21:22.247 INFO:teuthology.orchestra.run.smithi045.stdout: -3440> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.247 INFO:teuthology.orchestra.run.smithi045.stdout: -3439> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000229 [2,head] /dc-dir/dc-file_52 auth v2300 s=2 n(v0 rc2023-10-03T19:17:46.410476+0000 b2 1=1+0) (iversion lock) 0x55cc941b6100] 2023-10-03T19:21:22.247 INFO:teuthology.orchestra.run.smithi045.stdout: -3438> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_52 [2,head] auth (dversion lock) v=2300 ino=0x10000000229 state=1073741824 0x55cc941bac80] [inode 0x10000000229 [2,head] /dc-dir/dc-file_52 auth v2300 s=2 n(v0 rc2023-10-03T19:17:46.410476+0000 b2 1=1+0) (iversion lock) 0x55cc941b6100] 2023-10-03T19:21:22.247 INFO:teuthology.orchestra.run.smithi045.stdout: -3437> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000229 [2,head] #10000000229 auth v2300 s=2 n(v0 rc2023-10-03T19:17:46.410476+0000 b2 1=1+0) (iversion lock) 0x55cc941b6100] 2023-10-03T19:21:22.247 INFO:teuthology.orchestra.run.smithi045.stdout: -3436> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_52 [2,head] auth NULL (dversion lock) v=2300 ino=(nil) state=1073741824 0x55cc941bac80] 2023-10-03T19:21:22.247 INFO:teuthology.orchestra.run.smithi045.stdout: -3435> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_51 [2,head] auth (dversion lock) v=2298 ino=0x10000000228 state=1073741824 0x55cc941baa00] 2023-10-03T19:21:22.247 INFO:teuthology.orchestra.run.smithi045.stdout: -3434> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.248 INFO:teuthology.orchestra.run.smithi045.stdout: -3433> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000228 [2,head] /dc-dir/dc-file_51 auth v2298 s=2 n(v0 rc2023-10-03T19:17:46.398965+0000 b2 1=1+0) (iversion lock) 0x55cc941b5b80] 2023-10-03T19:21:22.248 INFO:teuthology.orchestra.run.smithi045.stdout: -3432> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_51 [2,head] auth (dversion lock) v=2298 ino=0x10000000228 state=1073741824 0x55cc941baa00] [inode 0x10000000228 [2,head] /dc-dir/dc-file_51 auth v2298 s=2 n(v0 rc2023-10-03T19:17:46.398965+0000 b2 1=1+0) (iversion lock) 0x55cc941b5b80] 2023-10-03T19:21:22.248 INFO:teuthology.orchestra.run.smithi045.stdout: -3431> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000228 [2,head] #10000000228 auth v2298 s=2 n(v0 rc2023-10-03T19:17:46.398965+0000 b2 1=1+0) (iversion lock) 0x55cc941b5b80] 2023-10-03T19:21:22.248 INFO:teuthology.orchestra.run.smithi045.stdout: -3430> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_51 [2,head] auth NULL (dversion lock) v=2298 ino=(nil) state=1073741824 0x55cc941baa00] 2023-10-03T19:21:22.248 INFO:teuthology.orchestra.run.smithi045.stdout: -3429> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_50 [2,head] auth (dversion lock) v=2296 ino=0x10000000227 state=1073741824 0x55cc941ba780] 2023-10-03T19:21:22.248 INFO:teuthology.orchestra.run.smithi045.stdout: -3428> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.248 INFO:teuthology.orchestra.run.smithi045.stdout: -3427> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000227 [2,head] /dc-dir/dc-file_50 auth v2296 s=2 n(v0 rc2023-10-03T19:17:46.388911+0000 b2 1=1+0) (iversion lock) 0x55cc941b5600] 2023-10-03T19:21:22.248 INFO:teuthology.orchestra.run.smithi045.stdout: -3426> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_50 [2,head] auth (dversion lock) v=2296 ino=0x10000000227 state=1073741824 0x55cc941ba780] [inode 0x10000000227 [2,head] /dc-dir/dc-file_50 auth v2296 s=2 n(v0 rc2023-10-03T19:17:46.388911+0000 b2 1=1+0) (iversion lock) 0x55cc941b5600] 2023-10-03T19:21:22.248 INFO:teuthology.orchestra.run.smithi045.stdout: -3425> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000227 [2,head] #10000000227 auth v2296 s=2 n(v0 rc2023-10-03T19:17:46.388911+0000 b2 1=1+0) (iversion lock) 0x55cc941b5600] 2023-10-03T19:21:22.248 INFO:teuthology.orchestra.run.smithi045.stdout: -3424> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_50 [2,head] auth NULL (dversion lock) v=2296 ino=(nil) state=1073741824 0x55cc941ba780] 2023-10-03T19:21:22.248 INFO:teuthology.orchestra.run.smithi045.stdout: -3423> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_49 [2,head] auth (dversion lock) v=2294 ino=0x10000000226 state=1073741824 0x55cc941ba500] 2023-10-03T19:21:22.249 INFO:teuthology.orchestra.run.smithi045.stdout: -3422> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.249 INFO:teuthology.orchestra.run.smithi045.stdout: -3421> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000226 [2,head] /dc-dir/dc-file_49 auth v2294 s=2 n(v0 rc2023-10-03T19:17:46.378535+0000 b2 1=1+0) (iversion lock) 0x55cc941b5080] 2023-10-03T19:21:22.249 INFO:teuthology.orchestra.run.smithi045.stdout: -3420> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_49 [2,head] auth (dversion lock) v=2294 ino=0x10000000226 state=1073741824 0x55cc941ba500] [inode 0x10000000226 [2,head] /dc-dir/dc-file_49 auth v2294 s=2 n(v0 rc2023-10-03T19:17:46.378535+0000 b2 1=1+0) (iversion lock) 0x55cc941b5080] 2023-10-03T19:21:22.249 INFO:teuthology.orchestra.run.smithi045.stdout: -3419> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000226 [2,head] #10000000226 auth v2294 s=2 n(v0 rc2023-10-03T19:17:46.378535+0000 b2 1=1+0) (iversion lock) 0x55cc941b5080] 2023-10-03T19:21:22.249 INFO:teuthology.orchestra.run.smithi045.stdout: -3418> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_49 [2,head] auth NULL (dversion lock) v=2294 ino=(nil) state=1073741824 0x55cc941ba500] 2023-10-03T19:21:22.249 INFO:teuthology.orchestra.run.smithi045.stdout: -3417> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_48 [2,head] auth (dversion lock) v=2292 ino=0x10000000225 state=1073741824 0x55cc941ba280] 2023-10-03T19:21:22.249 INFO:teuthology.orchestra.run.smithi045.stdout: -3416> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.249 INFO:teuthology.orchestra.run.smithi045.stdout: -3415> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000225 [2,head] /dc-dir/dc-file_48 auth v2292 s=2 n(v0 rc2023-10-03T19:17:46.367240+0000 b2 1=1+0) (iversion lock) 0x55cc941b4b00] 2023-10-03T19:21:22.249 INFO:teuthology.orchestra.run.smithi045.stdout: -3414> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_48 [2,head] auth (dversion lock) v=2292 ino=0x10000000225 state=1073741824 0x55cc941ba280] [inode 0x10000000225 [2,head] /dc-dir/dc-file_48 auth v2292 s=2 n(v0 rc2023-10-03T19:17:46.367240+0000 b2 1=1+0) (iversion lock) 0x55cc941b4b00] 2023-10-03T19:21:22.249 INFO:teuthology.orchestra.run.smithi045.stdout: -3413> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000225 [2,head] #10000000225 auth v2292 s=2 n(v0 rc2023-10-03T19:17:46.367240+0000 b2 1=1+0) (iversion lock) 0x55cc941b4b00] 2023-10-03T19:21:22.249 INFO:teuthology.orchestra.run.smithi045.stdout: -3412> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_48 [2,head] auth NULL (dversion lock) v=2292 ino=(nil) state=1073741824 0x55cc941ba280] 2023-10-03T19:21:22.249 INFO:teuthology.orchestra.run.smithi045.stdout: -3411> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_47 [2,head] auth (dversion lock) v=2290 ino=0x10000000224 state=1073741824 0x55cc941ba000] 2023-10-03T19:21:22.250 INFO:teuthology.orchestra.run.smithi045.stdout: -3410> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.250 INFO:teuthology.orchestra.run.smithi045.stdout: -3409> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000224 [2,head] /dc-dir/dc-file_47 auth v2290 s=2 n(v0 rc2023-10-03T19:17:46.356255+0000 b2 1=1+0) (iversion lock) 0x55cc941b4580] 2023-10-03T19:21:22.250 INFO:teuthology.orchestra.run.smithi045.stdout: -3408> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_47 [2,head] auth (dversion lock) v=2290 ino=0x10000000224 state=1073741824 0x55cc941ba000] [inode 0x10000000224 [2,head] /dc-dir/dc-file_47 auth v2290 s=2 n(v0 rc2023-10-03T19:17:46.356255+0000 b2 1=1+0) (iversion lock) 0x55cc941b4580] 2023-10-03T19:21:22.250 INFO:teuthology.orchestra.run.smithi045.stdout: -3407> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000224 [2,head] #10000000224 auth v2290 s=2 n(v0 rc2023-10-03T19:17:46.356255+0000 b2 1=1+0) (iversion lock) 0x55cc941b4580] 2023-10-03T19:21:22.250 INFO:teuthology.orchestra.run.smithi045.stdout: -3406> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_47 [2,head] auth NULL (dversion lock) v=2290 ino=(nil) state=1073741824 0x55cc941ba000] 2023-10-03T19:21:22.250 INFO:teuthology.orchestra.run.smithi045.stdout: -3405> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_46 [2,head] auth (dversion lock) v=2288 ino=0x10000000223 state=1073741824 0x55cc9414db80] 2023-10-03T19:21:22.250 INFO:teuthology.orchestra.run.smithi045.stdout: -3404> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.260 INFO:teuthology.orchestra.run.smithi045.stdout: -3403> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000223 [2,head] /dc-dir/dc-file_46 auth v2288 s=2 n(v0 rc2023-10-03T19:17:46.345986+0000 b2 1=1+0) (iversion lock) 0x55cc941b4000] 2023-10-03T19:21:22.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3402> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_46 [2,head] auth (dversion lock) v=2288 ino=0x10000000223 state=1073741824 0x55cc9414db80] [inode 0x10000000223 [2,head] /dc-dir/dc-file_46 auth v2288 s=2 n(v0 rc2023-10-03T19:17:46.345986+0000 b2 1=1+0) (iversion lock) 0x55cc941b4000] 2023-10-03T19:21:22.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3401> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000223 [2,head] #10000000223 auth v2288 s=2 n(v0 rc2023-10-03T19:17:46.345986+0000 b2 1=1+0) (iversion lock) 0x55cc941b4000] 2023-10-03T19:21:22.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3400> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_46 [2,head] auth NULL (dversion lock) v=2288 ino=(nil) state=1073741824 0x55cc9414db80] 2023-10-03T19:21:22.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3399> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_45 [2,head] auth (dversion lock) v=2286 ino=0x10000000222 state=1073741824 0x55cc9414d900] 2023-10-03T19:21:22.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3398> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3397> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000222 [2,head] /dc-dir/dc-file_45 auth v2286 s=2 n(v0 rc2023-10-03T19:17:46.335520+0000 b2 1=1+0) (iversion lock) 0x55cc941ad700] 2023-10-03T19:21:22.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3396> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_45 [2,head] auth (dversion lock) v=2286 ino=0x10000000222 state=1073741824 0x55cc9414d900] [inode 0x10000000222 [2,head] /dc-dir/dc-file_45 auth v2286 s=2 n(v0 rc2023-10-03T19:17:46.335520+0000 b2 1=1+0) (iversion lock) 0x55cc941ad700] 2023-10-03T19:21:22.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3395> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000222 [2,head] #10000000222 auth v2286 s=2 n(v0 rc2023-10-03T19:17:46.335520+0000 b2 1=1+0) (iversion lock) 0x55cc941ad700] 2023-10-03T19:21:22.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3394> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_45 [2,head] auth NULL (dversion lock) v=2286 ino=(nil) state=1073741824 0x55cc9414d900] 2023-10-03T19:21:22.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3393> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_44 [2,head] auth (dversion lock) v=2284 ino=0x10000000221 state=1073741824 0x55cc9414d680] 2023-10-03T19:21:22.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3392> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3391> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000221 [2,head] /dc-dir/dc-file_44 auth v2284 s=2 n(v0 rc2023-10-03T19:17:46.325183+0000 b2 1=1+0) (iversion lock) 0x55cc941ad180] 2023-10-03T19:21:22.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3390> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_44 [2,head] auth (dversion lock) v=2284 ino=0x10000000221 state=1073741824 0x55cc9414d680] [inode 0x10000000221 [2,head] /dc-dir/dc-file_44 auth v2284 s=2 n(v0 rc2023-10-03T19:17:46.325183+0000 b2 1=1+0) (iversion lock) 0x55cc941ad180] 2023-10-03T19:21:22.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3389> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000221 [2,head] #10000000221 auth v2284 s=2 n(v0 rc2023-10-03T19:17:46.325183+0000 b2 1=1+0) (iversion lock) 0x55cc941ad180] 2023-10-03T19:21:22.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3388> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_44 [2,head] auth NULL (dversion lock) v=2284 ino=(nil) state=1073741824 0x55cc9414d680] 2023-10-03T19:21:22.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3387> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_43 [2,head] auth (dversion lock) v=2282 ino=0x10000000220 state=1073741824 0x55cc9414d400] 2023-10-03T19:21:22.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3386> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3385> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000220 [2,head] /dc-dir/dc-file_43 auth v2282 s=2 n(v0 rc2023-10-03T19:17:46.315093+0000 b2 1=1+0) (iversion lock) 0x55cc941acc00] 2023-10-03T19:21:22.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3384> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_43 [2,head] auth (dversion lock) v=2282 ino=0x10000000220 state=1073741824 0x55cc9414d400] [inode 0x10000000220 [2,head] /dc-dir/dc-file_43 auth v2282 s=2 n(v0 rc2023-10-03T19:17:46.315093+0000 b2 1=1+0) (iversion lock) 0x55cc941acc00] 2023-10-03T19:21:22.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3383> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000220 [2,head] #10000000220 auth v2282 s=2 n(v0 rc2023-10-03T19:17:46.315093+0000 b2 1=1+0) (iversion lock) 0x55cc941acc00] 2023-10-03T19:21:22.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3382> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_43 [2,head] auth NULL (dversion lock) v=2282 ino=(nil) state=1073741824 0x55cc9414d400] 2023-10-03T19:21:22.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3381> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_42 [2,head] auth (dversion lock) v=2280 ino=0x1000000021f state=1073741824 0x55cc9414d180] 2023-10-03T19:21:22.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3380> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3379> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x1000000021f [2,head] /dc-dir/dc-file_42 auth v2280 s=2 n(v0 rc2023-10-03T19:17:46.304529+0000 b2 1=1+0) (iversion lock) 0x55cc941ac680] 2023-10-03T19:21:22.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3378> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_42 [2,head] auth (dversion lock) v=2280 ino=0x1000000021f state=1073741824 0x55cc9414d180] [inode 0x1000000021f [2,head] /dc-dir/dc-file_42 auth v2280 s=2 n(v0 rc2023-10-03T19:17:46.304529+0000 b2 1=1+0) (iversion lock) 0x55cc941ac680] 2023-10-03T19:21:22.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3377> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x1000000021f [2,head] #1000000021f auth v2280 s=2 n(v0 rc2023-10-03T19:17:46.304529+0000 b2 1=1+0) (iversion lock) 0x55cc941ac680] 2023-10-03T19:21:22.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3376> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_42 [2,head] auth NULL (dversion lock) v=2280 ino=(nil) state=1073741824 0x55cc9414d180] 2023-10-03T19:21:22.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3375> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_41 [2,head] auth (dversion lock) v=2278 ino=0x1000000021e state=1073741824 0x55cc9414cf00] 2023-10-03T19:21:22.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3374> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3373> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x1000000021e [2,head] /dc-dir/dc-file_41 auth v2278 s=2 n(v0 rc2023-10-03T19:17:46.294460+0000 b2 1=1+0) (iversion lock) 0x55cc941ac100] 2023-10-03T19:21:22.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3372> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_41 [2,head] auth (dversion lock) v=2278 ino=0x1000000021e state=1073741824 0x55cc9414cf00] [inode 0x1000000021e [2,head] /dc-dir/dc-file_41 auth v2278 s=2 n(v0 rc2023-10-03T19:17:46.294460+0000 b2 1=1+0) (iversion lock) 0x55cc941ac100] 2023-10-03T19:21:22.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3371> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x1000000021e [2,head] #1000000021e auth v2278 s=2 n(v0 rc2023-10-03T19:17:46.294460+0000 b2 1=1+0) (iversion lock) 0x55cc941ac100] 2023-10-03T19:21:22.264 INFO:teuthology.orchestra.run.smithi045.stdout: -3370> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_41 [2,head] auth NULL (dversion lock) v=2278 ino=(nil) state=1073741824 0x55cc9414cf00] 2023-10-03T19:21:22.264 INFO:teuthology.orchestra.run.smithi045.stdout: -3369> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_40 [2,head] auth (dversion lock) v=2276 ino=0x1000000021d state=1073741824 0x55cc9414cc80] 2023-10-03T19:21:22.264 INFO:teuthology.orchestra.run.smithi045.stdout: -3368> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.264 INFO:teuthology.orchestra.run.smithi045.stdout: -3367> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x1000000021d [2,head] /dc-dir/dc-file_40 auth v2276 s=2 n(v0 rc2023-10-03T19:17:46.284151+0000 b2 1=1+0) (iversion lock) 0x55cc941abb80] 2023-10-03T19:21:22.264 INFO:teuthology.orchestra.run.smithi045.stdout: -3366> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_40 [2,head] auth (dversion lock) v=2276 ino=0x1000000021d state=1073741824 0x55cc9414cc80] [inode 0x1000000021d [2,head] /dc-dir/dc-file_40 auth v2276 s=2 n(v0 rc2023-10-03T19:17:46.284151+0000 b2 1=1+0) (iversion lock) 0x55cc941abb80] 2023-10-03T19:21:22.264 INFO:teuthology.orchestra.run.smithi045.stdout: -3365> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x1000000021d [2,head] #1000000021d auth v2276 s=2 n(v0 rc2023-10-03T19:17:46.284151+0000 b2 1=1+0) (iversion lock) 0x55cc941abb80] 2023-10-03T19:21:22.264 INFO:teuthology.orchestra.run.smithi045.stdout: -3364> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_40 [2,head] auth NULL (dversion lock) v=2276 ino=(nil) state=1073741824 0x55cc9414cc80] 2023-10-03T19:21:22.264 INFO:teuthology.orchestra.run.smithi045.stdout: -3363> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_39 [2,head] auth (dversion lock) v=2274 ino=0x1000000021c state=1073741824 0x55cc9414ca00] 2023-10-03T19:21:22.265 INFO:teuthology.orchestra.run.smithi045.stdout: -3362> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.265 INFO:teuthology.orchestra.run.smithi045.stdout: -3361> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x1000000021c [2,head] /dc-dir/dc-file_39 auth v2274 s=2 n(v0 rc2023-10-03T19:17:46.273748+0000 b2 1=1+0) (iversion lock) 0x55cc941ab600] 2023-10-03T19:21:22.265 INFO:teuthology.orchestra.run.smithi045.stdout: -3360> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_39 [2,head] auth (dversion lock) v=2274 ino=0x1000000021c state=1073741824 0x55cc9414ca00] [inode 0x1000000021c [2,head] /dc-dir/dc-file_39 auth v2274 s=2 n(v0 rc2023-10-03T19:17:46.273748+0000 b2 1=1+0) (iversion lock) 0x55cc941ab600] 2023-10-03T19:21:22.265 INFO:teuthology.orchestra.run.smithi045.stdout: -3359> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x1000000021c [2,head] #1000000021c auth v2274 s=2 n(v0 rc2023-10-03T19:17:46.273748+0000 b2 1=1+0) (iversion lock) 0x55cc941ab600] 2023-10-03T19:21:22.265 INFO:teuthology.orchestra.run.smithi045.stdout: -3358> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_39 [2,head] auth NULL (dversion lock) v=2274 ino=(nil) state=1073741824 0x55cc9414ca00] 2023-10-03T19:21:22.265 INFO:teuthology.orchestra.run.smithi045.stdout: -3357> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_38 [2,head] auth (dversion lock) v=2272 ino=0x1000000021b state=1073741824 0x55cc9414c780] 2023-10-03T19:21:22.265 INFO:teuthology.orchestra.run.smithi045.stdout: -3356> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.265 INFO:teuthology.orchestra.run.smithi045.stdout: -3355> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x1000000021b [2,head] /dc-dir/dc-file_38 auth v2272 s=2 n(v0 rc2023-10-03T19:17:46.264028+0000 b2 1=1+0) (iversion lock) 0x55cc941ab080] 2023-10-03T19:21:22.265 INFO:teuthology.orchestra.run.smithi045.stdout: -3354> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_38 [2,head] auth (dversion lock) v=2272 ino=0x1000000021b state=1073741824 0x55cc9414c780] [inode 0x1000000021b [2,head] /dc-dir/dc-file_38 auth v2272 s=2 n(v0 rc2023-10-03T19:17:46.264028+0000 b2 1=1+0) (iversion lock) 0x55cc941ab080] 2023-10-03T19:21:22.266 INFO:teuthology.orchestra.run.smithi045.stdout: -3353> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x1000000021b [2,head] #1000000021b auth v2272 s=2 n(v0 rc2023-10-03T19:17:46.264028+0000 b2 1=1+0) (iversion lock) 0x55cc941ab080] 2023-10-03T19:21:22.266 INFO:teuthology.orchestra.run.smithi045.stdout: -3352> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_38 [2,head] auth NULL (dversion lock) v=2272 ino=(nil) state=1073741824 0x55cc9414c780] 2023-10-03T19:21:22.266 INFO:teuthology.orchestra.run.smithi045.stdout: -3351> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_37 [2,head] auth (dversion lock) v=2270 ino=0x1000000021a state=1073741824 0x55cc9414c500] 2023-10-03T19:21:22.266 INFO:teuthology.orchestra.run.smithi045.stdout: -3350> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.266 INFO:teuthology.orchestra.run.smithi045.stdout: -3349> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x1000000021a [2,head] /dc-dir/dc-file_37 auth v2270 s=2 n(v0 rc2023-10-03T19:17:46.254441+0000 b2 1=1+0) (iversion lock) 0x55cc941aab00] 2023-10-03T19:21:22.266 INFO:teuthology.orchestra.run.smithi045.stdout: -3348> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_37 [2,head] auth (dversion lock) v=2270 ino=0x1000000021a state=1073741824 0x55cc9414c500] [inode 0x1000000021a [2,head] /dc-dir/dc-file_37 auth v2270 s=2 n(v0 rc2023-10-03T19:17:46.254441+0000 b2 1=1+0) (iversion lock) 0x55cc941aab00] 2023-10-03T19:21:22.266 INFO:teuthology.orchestra.run.smithi045.stdout: -3347> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x1000000021a [2,head] #1000000021a auth v2270 s=2 n(v0 rc2023-10-03T19:17:46.254441+0000 b2 1=1+0) (iversion lock) 0x55cc941aab00] 2023-10-03T19:21:22.266 INFO:teuthology.orchestra.run.smithi045.stdout: -3346> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_37 [2,head] auth NULL (dversion lock) v=2270 ino=(nil) state=1073741824 0x55cc9414c500] 2023-10-03T19:21:22.266 INFO:teuthology.orchestra.run.smithi045.stdout: -3345> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_36 [2,head] auth (dversion lock) v=2268 ino=0x10000000219 state=1073741824 0x55cc9414c280] 2023-10-03T19:21:22.266 INFO:teuthology.orchestra.run.smithi045.stdout: -3344> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.266 INFO:teuthology.orchestra.run.smithi045.stdout: -3343> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000219 [2,head] /dc-dir/dc-file_36 auth v2268 s=2 n(v0 rc2023-10-03T19:17:46.243662+0000 b2 1=1+0) (iversion lock) 0x55cc941aa580] 2023-10-03T19:21:22.266 INFO:teuthology.orchestra.run.smithi045.stdout: -3342> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_36 [2,head] auth (dversion lock) v=2268 ino=0x10000000219 state=1073741824 0x55cc9414c280] [inode 0x10000000219 [2,head] /dc-dir/dc-file_36 auth v2268 s=2 n(v0 rc2023-10-03T19:17:46.243662+0000 b2 1=1+0) (iversion lock) 0x55cc941aa580] 2023-10-03T19:21:22.267 INFO:teuthology.orchestra.run.smithi045.stdout: -3341> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000219 [2,head] #10000000219 auth v2268 s=2 n(v0 rc2023-10-03T19:17:46.243662+0000 b2 1=1+0) (iversion lock) 0x55cc941aa580] 2023-10-03T19:21:22.267 INFO:teuthology.orchestra.run.smithi045.stdout: -3340> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_36 [2,head] auth NULL (dversion lock) v=2268 ino=(nil) state=1073741824 0x55cc9414c280] 2023-10-03T19:21:22.267 INFO:teuthology.orchestra.run.smithi045.stdout: -3339> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_35 [2,head] auth (dversion lock) v=2266 ino=0x10000000218 state=1073741824 0x55cc9414c000] 2023-10-03T19:21:22.267 INFO:teuthology.orchestra.run.smithi045.stdout: -3338> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.267 INFO:teuthology.orchestra.run.smithi045.stdout: -3337> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000218 [2,head] /dc-dir/dc-file_35 auth v2266 s=2 n(v0 rc2023-10-03T19:17:46.232329+0000 b2 1=1+0) (iversion lock) 0x55cc941aa000] 2023-10-03T19:21:22.267 INFO:teuthology.orchestra.run.smithi045.stdout: -3336> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_35 [2,head] auth (dversion lock) v=2266 ino=0x10000000218 state=1073741824 0x55cc9414c000] [inode 0x10000000218 [2,head] /dc-dir/dc-file_35 auth v2266 s=2 n(v0 rc2023-10-03T19:17:46.232329+0000 b2 1=1+0) (iversion lock) 0x55cc941aa000] 2023-10-03T19:21:22.267 INFO:teuthology.orchestra.run.smithi045.stdout: -3335> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000218 [2,head] #10000000218 auth v2266 s=2 n(v0 rc2023-10-03T19:17:46.232329+0000 b2 1=1+0) (iversion lock) 0x55cc941aa000] 2023-10-03T19:21:22.267 INFO:teuthology.orchestra.run.smithi045.stdout: -3334> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_35 [2,head] auth NULL (dversion lock) v=2266 ino=(nil) state=1073741824 0x55cc9414c000] 2023-10-03T19:21:22.267 INFO:teuthology.orchestra.run.smithi045.stdout: -3333> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_34 [2,head] auth (dversion lock) v=2264 ino=0x10000000217 state=1073741824 0x55cc94197b80] 2023-10-03T19:21:22.267 INFO:teuthology.orchestra.run.smithi045.stdout: -3332> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.268 INFO:teuthology.orchestra.run.smithi045.stdout: -3331> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000217 [2,head] /dc-dir/dc-file_34 auth v2264 s=2 n(v0 rc2023-10-03T19:17:46.222505+0000 b2 1=1+0) (iversion lock) 0x55cc9419b700] 2023-10-03T19:21:22.268 INFO:teuthology.orchestra.run.smithi045.stdout: -3330> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_34 [2,head] auth (dversion lock) v=2264 ino=0x10000000217 state=1073741824 0x55cc94197b80] [inode 0x10000000217 [2,head] /dc-dir/dc-file_34 auth v2264 s=2 n(v0 rc2023-10-03T19:17:46.222505+0000 b2 1=1+0) (iversion lock) 0x55cc9419b700] 2023-10-03T19:21:22.268 INFO:teuthology.orchestra.run.smithi045.stdout: -3329> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000217 [2,head] #10000000217 auth v2264 s=2 n(v0 rc2023-10-03T19:17:46.222505+0000 b2 1=1+0) (iversion lock) 0x55cc9419b700] 2023-10-03T19:21:22.268 INFO:teuthology.orchestra.run.smithi045.stdout: -3328> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_34 [2,head] auth NULL (dversion lock) v=2264 ino=(nil) state=1073741824 0x55cc94197b80] 2023-10-03T19:21:22.268 INFO:teuthology.orchestra.run.smithi045.stdout: -3327> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_33 [2,head] auth (dversion lock) v=2262 ino=0x10000000216 state=1073741824 0x55cc94197900] 2023-10-03T19:21:22.268 INFO:teuthology.orchestra.run.smithi045.stdout: -3326> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.268 INFO:teuthology.orchestra.run.smithi045.stdout: -3325> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000216 [2,head] /dc-dir/dc-file_33 auth v2262 s=2 n(v0 rc2023-10-03T19:17:46.210759+0000 b2 1=1+0) (iversion lock) 0x55cc9419b180] 2023-10-03T19:21:22.268 INFO:teuthology.orchestra.run.smithi045.stdout: -3324> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_33 [2,head] auth (dversion lock) v=2262 ino=0x10000000216 state=1073741824 0x55cc94197900] [inode 0x10000000216 [2,head] /dc-dir/dc-file_33 auth v2262 s=2 n(v0 rc2023-10-03T19:17:46.210759+0000 b2 1=1+0) (iversion lock) 0x55cc9419b180] 2023-10-03T19:21:22.268 INFO:teuthology.orchestra.run.smithi045.stdout: -3323> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000216 [2,head] #10000000216 auth v2262 s=2 n(v0 rc2023-10-03T19:17:46.210759+0000 b2 1=1+0) (iversion lock) 0x55cc9419b180] 2023-10-03T19:21:22.269 INFO:teuthology.orchestra.run.smithi045.stdout: -3322> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_33 [2,head] auth NULL (dversion lock) v=2262 ino=(nil) state=1073741824 0x55cc94197900] 2023-10-03T19:21:22.269 INFO:teuthology.orchestra.run.smithi045.stdout: -3321> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_32 [2,head] auth (dversion lock) v=2260 ino=0x10000000215 state=1073741824 0x55cc94197680] 2023-10-03T19:21:22.269 INFO:teuthology.orchestra.run.smithi045.stdout: -3320> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.269 INFO:teuthology.orchestra.run.smithi045.stdout: -3319> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000215 [2,head] /dc-dir/dc-file_32 auth v2260 s=2 n(v0 rc2023-10-03T19:17:46.199264+0000 b2 1=1+0) (iversion lock) 0x55cc9419ac00] 2023-10-03T19:21:22.269 INFO:teuthology.orchestra.run.smithi045.stdout: -3318> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_32 [2,head] auth (dversion lock) v=2260 ino=0x10000000215 state=1073741824 0x55cc94197680] [inode 0x10000000215 [2,head] /dc-dir/dc-file_32 auth v2260 s=2 n(v0 rc2023-10-03T19:17:46.199264+0000 b2 1=1+0) (iversion lock) 0x55cc9419ac00] 2023-10-03T19:21:22.269 INFO:teuthology.orchestra.run.smithi045.stdout: -3317> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000215 [2,head] #10000000215 auth v2260 s=2 n(v0 rc2023-10-03T19:17:46.199264+0000 b2 1=1+0) (iversion lock) 0x55cc9419ac00] 2023-10-03T19:21:22.269 INFO:teuthology.orchestra.run.smithi045.stdout: -3316> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_32 [2,head] auth NULL (dversion lock) v=2260 ino=(nil) state=1073741824 0x55cc94197680] 2023-10-03T19:21:22.269 INFO:teuthology.orchestra.run.smithi045.stdout: -3315> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_31 [2,head] auth (dversion lock) v=2258 ino=0x10000000214 state=1073741824 0x55cc94197400] 2023-10-03T19:21:22.269 INFO:teuthology.orchestra.run.smithi045.stdout: -3314> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.269 INFO:teuthology.orchestra.run.smithi045.stdout: -3313> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000214 [2,head] /dc-dir/dc-file_31 auth v2258 s=2 n(v0 rc2023-10-03T19:17:46.187400+0000 b2 1=1+0) (iversion lock) 0x55cc9419a680] 2023-10-03T19:21:22.269 INFO:teuthology.orchestra.run.smithi045.stdout: -3312> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_31 [2,head] auth (dversion lock) v=2258 ino=0x10000000214 state=1073741824 0x55cc94197400] [inode 0x10000000214 [2,head] /dc-dir/dc-file_31 auth v2258 s=2 n(v0 rc2023-10-03T19:17:46.187400+0000 b2 1=1+0) (iversion lock) 0x55cc9419a680] 2023-10-03T19:21:22.284 INFO:teuthology.orchestra.run.smithi045.stdout: -3311> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000214 [2,head] #10000000214 auth v2258 s=2 n(v0 rc2023-10-03T19:17:46.187400+0000 b2 1=1+0) (iversion lock) 0x55cc9419a680] 2023-10-03T19:21:22.284 INFO:teuthology.orchestra.run.smithi045.stdout: -3310> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_31 [2,head] auth NULL (dversion lock) v=2258 ino=(nil) state=1073741824 0x55cc94197400] 2023-10-03T19:21:22.284 INFO:teuthology.orchestra.run.smithi045.stdout: -3309> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_30 [2,head] auth (dversion lock) v=2256 ino=0x10000000213 state=1073741824 0x55cc94197180] 2023-10-03T19:21:22.284 INFO:teuthology.orchestra.run.smithi045.stdout: -3308> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.284 INFO:teuthology.orchestra.run.smithi045.stdout: -3307> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000213 [2,head] /dc-dir/dc-file_30 auth v2256 s=2 n(v0 rc2023-10-03T19:17:46.176189+0000 b2 1=1+0) (iversion lock) 0x55cc9419a100] 2023-10-03T19:21:22.284 INFO:teuthology.orchestra.run.smithi045.stdout: -3306> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_30 [2,head] auth (dversion lock) v=2256 ino=0x10000000213 state=1073741824 0x55cc94197180] [inode 0x10000000213 [2,head] /dc-dir/dc-file_30 auth v2256 s=2 n(v0 rc2023-10-03T19:17:46.176189+0000 b2 1=1+0) (iversion lock) 0x55cc9419a100] 2023-10-03T19:21:22.284 INFO:teuthology.orchestra.run.smithi045.stdout: -3305> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000213 [2,head] #10000000213 auth v2256 s=2 n(v0 rc2023-10-03T19:17:46.176189+0000 b2 1=1+0) (iversion lock) 0x55cc9419a100] 2023-10-03T19:21:22.284 INFO:teuthology.orchestra.run.smithi045.stdout: -3304> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_30 [2,head] auth NULL (dversion lock) v=2256 ino=(nil) state=1073741824 0x55cc94197180] 2023-10-03T19:21:22.285 INFO:teuthology.orchestra.run.smithi045.stdout: -3303> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_29 [2,head] auth (dversion lock) v=2254 ino=0x10000000212 state=1073741824 0x55cc94196f00] 2023-10-03T19:21:22.285 INFO:teuthology.orchestra.run.smithi045.stdout: -3302> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.285 INFO:teuthology.orchestra.run.smithi045.stdout: -3301> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000212 [2,head] /dc-dir/dc-file_29 auth v2254 s=2 n(v0 rc2023-10-03T19:17:46.166044+0000 b2 1=1+0) (iversion lock) 0x55cc94199b80] 2023-10-03T19:21:22.285 INFO:teuthology.orchestra.run.smithi045.stdout: -3300> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_29 [2,head] auth (dversion lock) v=2254 ino=0x10000000212 state=1073741824 0x55cc94196f00] [inode 0x10000000212 [2,head] /dc-dir/dc-file_29 auth v2254 s=2 n(v0 rc2023-10-03T19:17:46.166044+0000 b2 1=1+0) (iversion lock) 0x55cc94199b80] 2023-10-03T19:21:22.285 INFO:teuthology.orchestra.run.smithi045.stdout: -3299> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000212 [2,head] #10000000212 auth v2254 s=2 n(v0 rc2023-10-03T19:17:46.166044+0000 b2 1=1+0) (iversion lock) 0x55cc94199b80] 2023-10-03T19:21:22.285 INFO:teuthology.orchestra.run.smithi045.stdout: -3298> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_29 [2,head] auth NULL (dversion lock) v=2254 ino=(nil) state=1073741824 0x55cc94196f00] 2023-10-03T19:21:22.285 INFO:teuthology.orchestra.run.smithi045.stdout: -3297> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_28 [2,head] auth (dversion lock) v=2252 ino=0x10000000211 state=1073741824 0x55cc94196c80] 2023-10-03T19:21:22.285 INFO:teuthology.orchestra.run.smithi045.stdout: -3296> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.285 INFO:teuthology.orchestra.run.smithi045.stdout: -3295> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000211 [2,head] /dc-dir/dc-file_28 auth v2252 s=2 n(v0 rc2023-10-03T19:17:46.156301+0000 b2 1=1+0) (iversion lock) 0x55cc94199600] 2023-10-03T19:21:22.285 INFO:teuthology.orchestra.run.smithi045.stdout: -3294> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_28 [2,head] auth (dversion lock) v=2252 ino=0x10000000211 state=1073741824 0x55cc94196c80] [inode 0x10000000211 [2,head] /dc-dir/dc-file_28 auth v2252 s=2 n(v0 rc2023-10-03T19:17:46.156301+0000 b2 1=1+0) (iversion lock) 0x55cc94199600] 2023-10-03T19:21:22.285 INFO:teuthology.orchestra.run.smithi045.stdout: -3293> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000211 [2,head] #10000000211 auth v2252 s=2 n(v0 rc2023-10-03T19:17:46.156301+0000 b2 1=1+0) (iversion lock) 0x55cc94199600] 2023-10-03T19:21:22.286 INFO:teuthology.orchestra.run.smithi045.stdout: -3292> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_28 [2,head] auth NULL (dversion lock) v=2252 ino=(nil) state=1073741824 0x55cc94196c80] 2023-10-03T19:21:22.286 INFO:teuthology.orchestra.run.smithi045.stdout: -3291> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_27 [2,head] auth (dversion lock) v=2250 ino=0x10000000210 state=1073741824 0x55cc94196a00] 2023-10-03T19:21:22.286 INFO:teuthology.orchestra.run.smithi045.stdout: -3290> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.286 INFO:teuthology.orchestra.run.smithi045.stdout: -3289> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000210 [2,head] /dc-dir/dc-file_27 auth v2250 s=2 n(v0 rc2023-10-03T19:17:46.146117+0000 b2 1=1+0) (iversion lock) 0x55cc94199080] 2023-10-03T19:21:22.286 INFO:teuthology.orchestra.run.smithi045.stdout: -3288> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_27 [2,head] auth (dversion lock) v=2250 ino=0x10000000210 state=1073741824 0x55cc94196a00] [inode 0x10000000210 [2,head] /dc-dir/dc-file_27 auth v2250 s=2 n(v0 rc2023-10-03T19:17:46.146117+0000 b2 1=1+0) (iversion lock) 0x55cc94199080] 2023-10-03T19:21:22.286 INFO:teuthology.orchestra.run.smithi045.stdout: -3287> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000210 [2,head] #10000000210 auth v2250 s=2 n(v0 rc2023-10-03T19:17:46.146117+0000 b2 1=1+0) (iversion lock) 0x55cc94199080] 2023-10-03T19:21:22.286 INFO:teuthology.orchestra.run.smithi045.stdout: -3286> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_27 [2,head] auth NULL (dversion lock) v=2250 ino=(nil) state=1073741824 0x55cc94196a00] 2023-10-03T19:21:22.286 INFO:teuthology.orchestra.run.smithi045.stdout: -3285> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_26 [2,head] auth (dversion lock) v=2248 ino=0x1000000020f state=1073741824 0x55cc94196780] 2023-10-03T19:21:22.286 INFO:teuthology.orchestra.run.smithi045.stdout: -3284> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.286 INFO:teuthology.orchestra.run.smithi045.stdout: -3283> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x1000000020f [2,head] /dc-dir/dc-file_26 auth v2248 s=2 n(v0 rc2023-10-03T19:17:46.135554+0000 b2 1=1+0) (iversion lock) 0x55cc94198b00] 2023-10-03T19:21:22.286 INFO:teuthology.orchestra.run.smithi045.stdout: -3282> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_26 [2,head] auth (dversion lock) v=2248 ino=0x1000000020f state=1073741824 0x55cc94196780] [inode 0x1000000020f [2,head] /dc-dir/dc-file_26 auth v2248 s=2 n(v0 rc2023-10-03T19:17:46.135554+0000 b2 1=1+0) (iversion lock) 0x55cc94198b00] 2023-10-03T19:21:22.286 INFO:teuthology.orchestra.run.smithi045.stdout: -3281> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x1000000020f [2,head] #1000000020f auth v2248 s=2 n(v0 rc2023-10-03T19:17:46.135554+0000 b2 1=1+0) (iversion lock) 0x55cc94198b00] 2023-10-03T19:21:22.287 INFO:teuthology.orchestra.run.smithi045.stdout: -3280> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_26 [2,head] auth NULL (dversion lock) v=2248 ino=(nil) state=1073741824 0x55cc94196780] 2023-10-03T19:21:22.287 INFO:teuthology.orchestra.run.smithi045.stdout: -3279> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_25 [2,head] auth (dversion lock) v=2246 ino=0x1000000020e state=1073741824 0x55cc94196500] 2023-10-03T19:21:22.287 INFO:teuthology.orchestra.run.smithi045.stdout: -3278> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.287 INFO:teuthology.orchestra.run.smithi045.stdout: -3277> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x1000000020e [2,head] /dc-dir/dc-file_25 auth v2246 s=2 n(v0 rc2023-10-03T19:17:46.125341+0000 b2 1=1+0) (iversion lock) 0x55cc94198580] 2023-10-03T19:21:22.287 INFO:teuthology.orchestra.run.smithi045.stdout: -3276> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_25 [2,head] auth (dversion lock) v=2246 ino=0x1000000020e state=1073741824 0x55cc94196500] [inode 0x1000000020e [2,head] /dc-dir/dc-file_25 auth v2246 s=2 n(v0 rc2023-10-03T19:17:46.125341+0000 b2 1=1+0) (iversion lock) 0x55cc94198580] 2023-10-03T19:21:22.287 INFO:teuthology.orchestra.run.smithi045.stdout: -3275> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x1000000020e [2,head] #1000000020e auth v2246 s=2 n(v0 rc2023-10-03T19:17:46.125341+0000 b2 1=1+0) (iversion lock) 0x55cc94198580] 2023-10-03T19:21:22.287 INFO:teuthology.orchestra.run.smithi045.stdout: -3274> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_25 [2,head] auth NULL (dversion lock) v=2246 ino=(nil) state=1073741824 0x55cc94196500] 2023-10-03T19:21:22.287 INFO:teuthology.orchestra.run.smithi045.stdout: -3273> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_24 [2,head] auth (dversion lock) v=2244 ino=0x1000000020d state=1073741824 0x55cc94196280] 2023-10-03T19:21:22.287 INFO:teuthology.orchestra.run.smithi045.stdout: -3272> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.287 INFO:teuthology.orchestra.run.smithi045.stdout: -3271> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x1000000020d [2,head] /dc-dir/dc-file_24 auth v2244 s=2 n(v0 rc2023-10-03T19:17:46.115307+0000 b2 1=1+0) (iversion lock) 0x55cc94198000] 2023-10-03T19:21:22.287 INFO:teuthology.orchestra.run.smithi045.stdout: -3270> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_24 [2,head] auth (dversion lock) v=2244 ino=0x1000000020d state=1073741824 0x55cc94196280] [inode 0x1000000020d [2,head] /dc-dir/dc-file_24 auth v2244 s=2 n(v0 rc2023-10-03T19:17:46.115307+0000 b2 1=1+0) (iversion lock) 0x55cc94198000] 2023-10-03T19:21:22.288 INFO:teuthology.orchestra.run.smithi045.stdout: -3269> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x1000000020d [2,head] #1000000020d auth v2244 s=2 n(v0 rc2023-10-03T19:17:46.115307+0000 b2 1=1+0) (iversion lock) 0x55cc94198000] 2023-10-03T19:21:22.288 INFO:teuthology.orchestra.run.smithi045.stdout: -3268> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_24 [2,head] auth NULL (dversion lock) v=2244 ino=(nil) state=1073741824 0x55cc94196280] 2023-10-03T19:21:22.288 INFO:teuthology.orchestra.run.smithi045.stdout: -3267> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_23 [2,head] auth (dversion lock) v=2242 ino=0x1000000020c state=1073741824 0x55cc94196000] 2023-10-03T19:21:22.288 INFO:teuthology.orchestra.run.smithi045.stdout: -3266> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.288 INFO:teuthology.orchestra.run.smithi045.stdout: -3265> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x1000000020c [2,head] /dc-dir/dc-file_23 auth v2242 s=2 n(v0 rc2023-10-03T19:17:46.105362+0000 b2 1=1+0) (iversion lock) 0x55cc9418d700] 2023-10-03T19:21:22.288 INFO:teuthology.orchestra.run.smithi045.stdout: -3264> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_23 [2,head] auth (dversion lock) v=2242 ino=0x1000000020c state=1073741824 0x55cc94196000] [inode 0x1000000020c [2,head] /dc-dir/dc-file_23 auth v2242 s=2 n(v0 rc2023-10-03T19:17:46.105362+0000 b2 1=1+0) (iversion lock) 0x55cc9418d700] 2023-10-03T19:21:22.288 INFO:teuthology.orchestra.run.smithi045.stdout: -3263> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x1000000020c [2,head] #1000000020c auth v2242 s=2 n(v0 rc2023-10-03T19:17:46.105362+0000 b2 1=1+0) (iversion lock) 0x55cc9418d700] 2023-10-03T19:21:22.288 INFO:teuthology.orchestra.run.smithi045.stdout: -3262> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_23 [2,head] auth NULL (dversion lock) v=2242 ino=(nil) state=1073741824 0x55cc94196000] 2023-10-03T19:21:22.288 INFO:teuthology.orchestra.run.smithi045.stdout: -3261> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_22 [2,head] auth (dversion lock) v=2240 ino=0x1000000020b state=1073741824 0x55cc94185b80] 2023-10-03T19:21:22.288 INFO:teuthology.orchestra.run.smithi045.stdout: -3260> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.289 INFO:teuthology.orchestra.run.smithi045.stdout: -3259> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x1000000020b [2,head] /dc-dir/dc-file_22 auth v2240 s=2 n(v0 rc2023-10-03T19:17:46.093951+0000 b2 1=1+0) (iversion lock) 0x55cc9418d180] 2023-10-03T19:21:22.289 INFO:teuthology.orchestra.run.smithi045.stdout: -3258> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_22 [2,head] auth (dversion lock) v=2240 ino=0x1000000020b state=1073741824 0x55cc94185b80] [inode 0x1000000020b [2,head] /dc-dir/dc-file_22 auth v2240 s=2 n(v0 rc2023-10-03T19:17:46.093951+0000 b2 1=1+0) (iversion lock) 0x55cc9418d180] 2023-10-03T19:21:22.289 INFO:teuthology.orchestra.run.smithi045.stdout: -3257> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x1000000020b [2,head] #1000000020b auth v2240 s=2 n(v0 rc2023-10-03T19:17:46.093951+0000 b2 1=1+0) (iversion lock) 0x55cc9418d180] 2023-10-03T19:21:22.289 INFO:teuthology.orchestra.run.smithi045.stdout: -3256> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_22 [2,head] auth NULL (dversion lock) v=2240 ino=(nil) state=1073741824 0x55cc94185b80] 2023-10-03T19:21:22.289 INFO:teuthology.orchestra.run.smithi045.stdout: -3255> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_21 [2,head] auth (dversion lock) v=2238 ino=0x1000000020a state=1073741824 0x55cc94185900] 2023-10-03T19:21:22.289 INFO:teuthology.orchestra.run.smithi045.stdout: -3254> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.289 INFO:teuthology.orchestra.run.smithi045.stdout: -3253> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x1000000020a [2,head] /dc-dir/dc-file_21 auth v2238 s=2 n(v0 rc2023-10-03T19:17:46.083619+0000 b2 1=1+0) (iversion lock) 0x55cc9418cc00] 2023-10-03T19:21:22.289 INFO:teuthology.orchestra.run.smithi045.stdout: -3252> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_21 [2,head] auth (dversion lock) v=2238 ino=0x1000000020a state=1073741824 0x55cc94185900] [inode 0x1000000020a [2,head] /dc-dir/dc-file_21 auth v2238 s=2 n(v0 rc2023-10-03T19:17:46.083619+0000 b2 1=1+0) (iversion lock) 0x55cc9418cc00] 2023-10-03T19:21:22.289 INFO:teuthology.orchestra.run.smithi045.stdout: -3251> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x1000000020a [2,head] #1000000020a auth v2238 s=2 n(v0 rc2023-10-03T19:17:46.083619+0000 b2 1=1+0) (iversion lock) 0x55cc9418cc00] 2023-10-03T19:21:22.289 INFO:teuthology.orchestra.run.smithi045.stdout: -3250> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_21 [2,head] auth NULL (dversion lock) v=2238 ino=(nil) state=1073741824 0x55cc94185900] 2023-10-03T19:21:22.290 INFO:teuthology.orchestra.run.smithi045.stdout: -3249> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_20 [2,head] auth (dversion lock) v=2236 ino=0x10000000209 state=1073741824 0x55cc94185680] 2023-10-03T19:21:22.290 INFO:teuthology.orchestra.run.smithi045.stdout: -3248> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.290 INFO:teuthology.orchestra.run.smithi045.stdout: -3247> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000209 [2,head] /dc-dir/dc-file_20 auth v2236 s=2 n(v0 rc2023-10-03T19:17:46.073109+0000 b2 1=1+0) (iversion lock) 0x55cc9418c680] 2023-10-03T19:21:22.290 INFO:teuthology.orchestra.run.smithi045.stdout: -3246> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_20 [2,head] auth (dversion lock) v=2236 ino=0x10000000209 state=1073741824 0x55cc94185680] [inode 0x10000000209 [2,head] /dc-dir/dc-file_20 auth v2236 s=2 n(v0 rc2023-10-03T19:17:46.073109+0000 b2 1=1+0) (iversion lock) 0x55cc9418c680] 2023-10-03T19:21:22.290 INFO:teuthology.orchestra.run.smithi045.stdout: -3245> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000209 [2,head] #10000000209 auth v2236 s=2 n(v0 rc2023-10-03T19:17:46.073109+0000 b2 1=1+0) (iversion lock) 0x55cc9418c680] 2023-10-03T19:21:22.290 INFO:teuthology.orchestra.run.smithi045.stdout: -3244> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_20 [2,head] auth NULL (dversion lock) v=2236 ino=(nil) state=1073741824 0x55cc94185680] 2023-10-03T19:21:22.290 INFO:teuthology.orchestra.run.smithi045.stdout: -3243> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_19 [2,head] auth (dversion lock) v=1908 ino=0x10000000208 state=1073741824 0x55cc94185400] 2023-10-03T19:21:22.290 INFO:teuthology.orchestra.run.smithi045.stdout: -3242> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.290 INFO:teuthology.orchestra.run.smithi045.stdout: -3241> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000208 [2,head] /dc-dir/dc-file_19 auth v1908 s=2 n(v0 rc2023-10-03T19:17:46.062936+0000 b2 1=1+0) (iversion lock) 0x55cc9418c100] 2023-10-03T19:21:22.291 INFO:teuthology.orchestra.run.smithi045.stdout: -3240> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_19 [2,head] auth (dversion lock) v=1908 ino=0x10000000208 state=1073741824 0x55cc94185400] [inode 0x10000000208 [2,head] /dc-dir/dc-file_19 auth v1908 s=2 n(v0 rc2023-10-03T19:17:46.062936+0000 b2 1=1+0) (iversion lock) 0x55cc9418c100] 2023-10-03T19:21:22.291 INFO:teuthology.orchestra.run.smithi045.stdout: -3239> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000208 [2,head] #10000000208 auth v1908 s=2 n(v0 rc2023-10-03T19:17:46.062936+0000 b2 1=1+0) (iversion lock) 0x55cc9418c100] 2023-10-03T19:21:22.291 INFO:teuthology.orchestra.run.smithi045.stdout: -3238> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_19 [2,head] auth NULL (dversion lock) v=1908 ino=(nil) state=1073741824 0x55cc94185400] 2023-10-03T19:21:22.291 INFO:teuthology.orchestra.run.smithi045.stdout: -3237> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_18 [2,head] auth (dversion lock) v=1906 ino=0x10000000207 state=1073741824 0x55cc94185180] 2023-10-03T19:21:22.291 INFO:teuthology.orchestra.run.smithi045.stdout: -3236> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.291 INFO:teuthology.orchestra.run.smithi045.stdout: -3235> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000207 [2,head] /dc-dir/dc-file_18 auth v1906 s=2 n(v0 rc2023-10-03T19:17:46.052501+0000 b2 1=1+0) (iversion lock) 0x55cc9418bb80] 2023-10-03T19:21:22.291 INFO:teuthology.orchestra.run.smithi045.stdout: -3234> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_18 [2,head] auth (dversion lock) v=1906 ino=0x10000000207 state=1073741824 0x55cc94185180] [inode 0x10000000207 [2,head] /dc-dir/dc-file_18 auth v1906 s=2 n(v0 rc2023-10-03T19:17:46.052501+0000 b2 1=1+0) (iversion lock) 0x55cc9418bb80] 2023-10-03T19:21:22.291 INFO:teuthology.orchestra.run.smithi045.stdout: -3233> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000207 [2,head] #10000000207 auth v1906 s=2 n(v0 rc2023-10-03T19:17:46.052501+0000 b2 1=1+0) (iversion lock) 0x55cc9418bb80] 2023-10-03T19:21:22.291 INFO:teuthology.orchestra.run.smithi045.stdout: -3232> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_18 [2,head] auth NULL (dversion lock) v=1906 ino=(nil) state=1073741824 0x55cc94185180] 2023-10-03T19:21:22.291 INFO:teuthology.orchestra.run.smithi045.stdout: -3231> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_17 [2,head] auth (dversion lock) v=1904 ino=0x10000000206 state=1073741824 0x55cc94184f00] 2023-10-03T19:21:22.292 INFO:teuthology.orchestra.run.smithi045.stdout: -3230> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.292 INFO:teuthology.orchestra.run.smithi045.stdout: -3229> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000206 [2,head] /dc-dir/dc-file_17 auth v1904 s=2 n(v0 rc2023-10-03T19:17:46.041293+0000 b2 1=1+0) (iversion lock) 0x55cc9418b600] 2023-10-03T19:21:22.292 INFO:teuthology.orchestra.run.smithi045.stdout: -3228> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_17 [2,head] auth (dversion lock) v=1904 ino=0x10000000206 state=1073741824 0x55cc94184f00] [inode 0x10000000206 [2,head] /dc-dir/dc-file_17 auth v1904 s=2 n(v0 rc2023-10-03T19:17:46.041293+0000 b2 1=1+0) (iversion lock) 0x55cc9418b600] 2023-10-03T19:21:22.292 INFO:teuthology.orchestra.run.smithi045.stdout: -3227> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000206 [2,head] #10000000206 auth v1904 s=2 n(v0 rc2023-10-03T19:17:46.041293+0000 b2 1=1+0) (iversion lock) 0x55cc9418b600] 2023-10-03T19:21:22.292 INFO:teuthology.orchestra.run.smithi045.stdout: -3226> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_17 [2,head] auth NULL (dversion lock) v=1904 ino=(nil) state=1073741824 0x55cc94184f00] 2023-10-03T19:21:22.292 INFO:teuthology.orchestra.run.smithi045.stdout: -3225> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_16 [2,head] auth (dversion lock) v=1902 ino=0x10000000205 state=1073741824 0x55cc94184c80] 2023-10-03T19:21:22.292 INFO:teuthology.orchestra.run.smithi045.stdout: -3224> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.292 INFO:teuthology.orchestra.run.smithi045.stdout: -3223> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000205 [2,head] /dc-dir/dc-file_16 auth v1902 s=2 n(v0 rc2023-10-03T19:17:46.031830+0000 b2 1=1+0) (iversion lock) 0x55cc9418b080] 2023-10-03T19:21:22.292 INFO:teuthology.orchestra.run.smithi045.stdout: -3222> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_16 [2,head] auth (dversion lock) v=1902 ino=0x10000000205 state=1073741824 0x55cc94184c80] [inode 0x10000000205 [2,head] /dc-dir/dc-file_16 auth v1902 s=2 n(v0 rc2023-10-03T19:17:46.031830+0000 b2 1=1+0) (iversion lock) 0x55cc9418b080] 2023-10-03T19:21:22.292 INFO:teuthology.orchestra.run.smithi045.stdout: -3221> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000205 [2,head] #10000000205 auth v1902 s=2 n(v0 rc2023-10-03T19:17:46.031830+0000 b2 1=1+0) (iversion lock) 0x55cc9418b080] 2023-10-03T19:21:22.292 INFO:teuthology.orchestra.run.smithi045.stdout: -3220> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_16 [2,head] auth NULL (dversion lock) v=1902 ino=(nil) state=1073741824 0x55cc94184c80] 2023-10-03T19:21:22.293 INFO:teuthology.orchestra.run.smithi045.stdout: -3219> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_15 [2,head] auth (dversion lock) v=1900 ino=0x10000000204 state=1073741824 0x55cc94184a00] 2023-10-03T19:21:22.293 INFO:teuthology.orchestra.run.smithi045.stdout: -3218> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.293 INFO:teuthology.orchestra.run.smithi045.stdout: -3217> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000204 [2,head] /dc-dir/dc-file_15 auth v1900 s=2 n(v0 rc2023-10-03T19:17:46.019694+0000 b2 1=1+0) (iversion lock) 0x55cc9418ab00] 2023-10-03T19:21:22.293 INFO:teuthology.orchestra.run.smithi045.stdout: -3216> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_15 [2,head] auth (dversion lock) v=1900 ino=0x10000000204 state=1073741824 0x55cc94184a00] [inode 0x10000000204 [2,head] /dc-dir/dc-file_15 auth v1900 s=2 n(v0 rc2023-10-03T19:17:46.019694+0000 b2 1=1+0) (iversion lock) 0x55cc9418ab00] 2023-10-03T19:21:22.293 INFO:teuthology.orchestra.run.smithi045.stdout: -3215> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000204 [2,head] #10000000204 auth v1900 s=2 n(v0 rc2023-10-03T19:17:46.019694+0000 b2 1=1+0) (iversion lock) 0x55cc9418ab00] 2023-10-03T19:21:22.400 INFO:teuthology.orchestra.run.smithi045.stdout: -3214> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_15 [2,head] auth NULL (dversion lock) v=1900 ino=(nil) state=1073741824 0x55cc94184a00] 2023-10-03T19:21:22.400 INFO:teuthology.orchestra.run.smithi045.stdout: -3213> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_14 [2,head] auth (dversion lock) v=1898 ino=0x10000000203 state=1073741824 0x55cc94184780] 2023-10-03T19:21:22.401 INFO:teuthology.orchestra.run.smithi045.stdout: -3212> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.401 INFO:teuthology.orchestra.run.smithi045.stdout: -3211> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000203 [2,head] /dc-dir/dc-file_14 auth v1898 s=2 n(v0 rc2023-10-03T19:17:46.008578+0000 b2 1=1+0) (iversion lock) 0x55cc9418a580] 2023-10-03T19:21:22.401 INFO:teuthology.orchestra.run.smithi045.stdout: -3210> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_14 [2,head] auth (dversion lock) v=1898 ino=0x10000000203 state=1073741824 0x55cc94184780] [inode 0x10000000203 [2,head] /dc-dir/dc-file_14 auth v1898 s=2 n(v0 rc2023-10-03T19:17:46.008578+0000 b2 1=1+0) (iversion lock) 0x55cc9418a580] 2023-10-03T19:21:22.401 INFO:teuthology.orchestra.run.smithi045.stdout: -3209> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000203 [2,head] #10000000203 auth v1898 s=2 n(v0 rc2023-10-03T19:17:46.008578+0000 b2 1=1+0) (iversion lock) 0x55cc9418a580] 2023-10-03T19:21:22.401 INFO:teuthology.orchestra.run.smithi045.stdout: -3208> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_14 [2,head] auth NULL (dversion lock) v=1898 ino=(nil) state=1073741824 0x55cc94184780] 2023-10-03T19:21:22.401 INFO:teuthology.orchestra.run.smithi045.stdout: -3207> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_13 [2,head] auth (dversion lock) v=1896 ino=0x10000000202 state=1073741824 0x55cc94184500] 2023-10-03T19:21:22.401 INFO:teuthology.orchestra.run.smithi045.stdout: -3206> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.401 INFO:teuthology.orchestra.run.smithi045.stdout: -3205> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000202 [2,head] /dc-dir/dc-file_13 auth v1896 s=2 n(v0 rc2023-10-03T19:17:45.998891+0000 b2 1=1+0) (iversion lock) 0x55cc9418a000] 2023-10-03T19:21:22.402 INFO:teuthology.orchestra.run.smithi045.stdout: -3204> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_13 [2,head] auth (dversion lock) v=1896 ino=0x10000000202 state=1073741824 0x55cc94184500] [inode 0x10000000202 [2,head] /dc-dir/dc-file_13 auth v1896 s=2 n(v0 rc2023-10-03T19:17:45.998891+0000 b2 1=1+0) (iversion lock) 0x55cc9418a000] 2023-10-03T19:21:22.402 INFO:teuthology.orchestra.run.smithi045.stdout: -3203> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000202 [2,head] #10000000202 auth v1896 s=2 n(v0 rc2023-10-03T19:17:45.998891+0000 b2 1=1+0) (iversion lock) 0x55cc9418a000] 2023-10-03T19:21:22.402 INFO:teuthology.orchestra.run.smithi045.stdout: -3202> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_13 [2,head] auth NULL (dversion lock) v=1896 ino=(nil) state=1073741824 0x55cc94184500] 2023-10-03T19:21:22.402 INFO:teuthology.orchestra.run.smithi045.stdout: -3201> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_12 [2,head] auth (dversion lock) v=1894 ino=0x10000000201 state=1073741824 0x55cc94184280] 2023-10-03T19:21:22.402 INFO:teuthology.orchestra.run.smithi045.stdout: -3200> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.402 INFO:teuthology.orchestra.run.smithi045.stdout: -3199> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000201 [2,head] /dc-dir/dc-file_12 auth v1894 s=2 n(v0 rc2023-10-03T19:17:45.988809+0000 b2 1=1+0) (iversion lock) 0x55cc94157700] 2023-10-03T19:21:22.402 INFO:teuthology.orchestra.run.smithi045.stdout: -3198> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_12 [2,head] auth (dversion lock) v=1894 ino=0x10000000201 state=1073741824 0x55cc94184280] [inode 0x10000000201 [2,head] /dc-dir/dc-file_12 auth v1894 s=2 n(v0 rc2023-10-03T19:17:45.988809+0000 b2 1=1+0) (iversion lock) 0x55cc94157700] 2023-10-03T19:21:22.402 INFO:teuthology.orchestra.run.smithi045.stdout: -3197> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000201 [2,head] #10000000201 auth v1894 s=2 n(v0 rc2023-10-03T19:17:45.988809+0000 b2 1=1+0) (iversion lock) 0x55cc94157700] 2023-10-03T19:21:22.402 INFO:teuthology.orchestra.run.smithi045.stdout: -3196> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_12 [2,head] auth NULL (dversion lock) v=1894 ino=(nil) state=1073741824 0x55cc94184280] 2023-10-03T19:21:22.402 INFO:teuthology.orchestra.run.smithi045.stdout: -3195> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_11 [2,head] auth (dversion lock) v=1892 ino=0x10000000200 state=1073741824 0x55cc94184000] 2023-10-03T19:21:22.403 INFO:teuthology.orchestra.run.smithi045.stdout: -3194> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.403 INFO:teuthology.orchestra.run.smithi045.stdout: -3193> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000200 [2,head] /dc-dir/dc-file_11 auth v1892 s=2 n(v0 rc2023-10-03T19:17:45.978307+0000 b2 1=1+0) (iversion lock) 0x55cc94157180] 2023-10-03T19:21:22.403 INFO:teuthology.orchestra.run.smithi045.stdout: -3192> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_11 [2,head] auth (dversion lock) v=1892 ino=0x10000000200 state=1073741824 0x55cc94184000] [inode 0x10000000200 [2,head] /dc-dir/dc-file_11 auth v1892 s=2 n(v0 rc2023-10-03T19:17:45.978307+0000 b2 1=1+0) (iversion lock) 0x55cc94157180] 2023-10-03T19:21:22.403 INFO:teuthology.orchestra.run.smithi045.stdout: -3191> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000200 [2,head] #10000000200 auth v1892 s=2 n(v0 rc2023-10-03T19:17:45.978307+0000 b2 1=1+0) (iversion lock) 0x55cc94157180] 2023-10-03T19:21:22.403 INFO:teuthology.orchestra.run.smithi045.stdout: -3190> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_11 [2,head] auth NULL (dversion lock) v=1892 ino=(nil) state=1073741824 0x55cc94184000] 2023-10-03T19:21:22.403 INFO:teuthology.orchestra.run.smithi045.stdout: -3189> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_10 [2,head] auth (dversion lock) v=1890 ino=0x100000001ff state=1073741824 0x55cc9413db80] 2023-10-03T19:21:22.403 INFO:teuthology.orchestra.run.smithi045.stdout: -3188> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.403 INFO:teuthology.orchestra.run.smithi045.stdout: -3187> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x100000001ff [2,head] /dc-dir/dc-file_10 auth v1890 s=2 n(v0 rc2023-10-03T19:17:45.967218+0000 b2 1=1+0) (iversion lock) 0x55cc94156c00] 2023-10-03T19:21:22.403 INFO:teuthology.orchestra.run.smithi045.stdout: -3186> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_10 [2,head] auth (dversion lock) v=1890 ino=0x100000001ff state=1073741824 0x55cc9413db80] [inode 0x100000001ff [2,head] /dc-dir/dc-file_10 auth v1890 s=2 n(v0 rc2023-10-03T19:17:45.967218+0000 b2 1=1+0) (iversion lock) 0x55cc94156c00] 2023-10-03T19:21:22.403 INFO:teuthology.orchestra.run.smithi045.stdout: -3185> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x100000001ff [2,head] #100000001ff auth v1890 s=2 n(v0 rc2023-10-03T19:17:45.967218+0000 b2 1=1+0) (iversion lock) 0x55cc94156c00] 2023-10-03T19:21:22.403 INFO:teuthology.orchestra.run.smithi045.stdout: -3184> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_10 [2,head] auth NULL (dversion lock) v=1890 ino=(nil) state=1073741824 0x55cc9413db80] 2023-10-03T19:21:22.403 INFO:teuthology.orchestra.run.smithi045.stdout: -3183> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_9 [2,head] auth (dversion lock) v=1888 ino=0x100000001fe state=1073741824 0x55cc9413d900] 2023-10-03T19:21:22.404 INFO:teuthology.orchestra.run.smithi045.stdout: -3182> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.404 INFO:teuthology.orchestra.run.smithi045.stdout: -3181> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x100000001fe [2,head] /dc-dir/dc-file_9 auth v1888 s=1 n(v0 rc2023-10-03T19:17:45.955713+0000 b1 1=1+0) (iversion lock) 0x55cc94156680] 2023-10-03T19:21:22.404 INFO:teuthology.orchestra.run.smithi045.stdout: -3180> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_9 [2,head] auth (dversion lock) v=1888 ino=0x100000001fe state=1073741824 0x55cc9413d900] [inode 0x100000001fe [2,head] /dc-dir/dc-file_9 auth v1888 s=1 n(v0 rc2023-10-03T19:17:45.955713+0000 b1 1=1+0) (iversion lock) 0x55cc94156680] 2023-10-03T19:21:22.404 INFO:teuthology.orchestra.run.smithi045.stdout: -3179> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x100000001fe [2,head] #100000001fe auth v1888 s=1 n(v0 rc2023-10-03T19:17:45.955713+0000 b1 1=1+0) (iversion lock) 0x55cc94156680] 2023-10-03T19:21:22.404 INFO:teuthology.orchestra.run.smithi045.stdout: -3178> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_9 [2,head] auth NULL (dversion lock) v=1888 ino=(nil) state=1073741824 0x55cc9413d900] 2023-10-03T19:21:22.404 INFO:teuthology.orchestra.run.smithi045.stdout: -3177> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_8 [2,head] auth (dversion lock) v=1886 ino=0x100000001fd state=1073741824 0x55cc9413d680] 2023-10-03T19:21:22.404 INFO:teuthology.orchestra.run.smithi045.stdout: -3176> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.404 INFO:teuthology.orchestra.run.smithi045.stdout: -3175> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x100000001fd [2,head] /dc-dir/dc-file_8 auth v1886 s=1 n(v0 rc2023-10-03T19:17:45.945163+0000 b1 1=1+0) (iversion lock) 0x55cc94156100] 2023-10-03T19:21:22.404 INFO:teuthology.orchestra.run.smithi045.stdout: -3174> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_8 [2,head] auth (dversion lock) v=1886 ino=0x100000001fd state=1073741824 0x55cc9413d680] [inode 0x100000001fd [2,head] /dc-dir/dc-file_8 auth v1886 s=1 n(v0 rc2023-10-03T19:17:45.945163+0000 b1 1=1+0) (iversion lock) 0x55cc94156100] 2023-10-03T19:21:22.404 INFO:teuthology.orchestra.run.smithi045.stdout: -3173> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x100000001fd [2,head] #100000001fd auth v1886 s=1 n(v0 rc2023-10-03T19:17:45.945163+0000 b1 1=1+0) (iversion lock) 0x55cc94156100] 2023-10-03T19:21:22.404 INFO:teuthology.orchestra.run.smithi045.stdout: -3172> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_8 [2,head] auth NULL (dversion lock) v=1886 ino=(nil) state=1073741824 0x55cc9413d680] 2023-10-03T19:21:22.405 INFO:teuthology.orchestra.run.smithi045.stdout: -3171> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_7 [2,head] auth (dversion lock) v=1884 ino=0x100000001fc state=1073741824 0x55cc9413d400] 2023-10-03T19:21:22.405 INFO:teuthology.orchestra.run.smithi045.stdout: -3170> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.405 INFO:teuthology.orchestra.run.smithi045.stdout: -3169> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x100000001fc [2,head] /dc-dir/dc-file_7 auth v1884 s=1 n(v0 rc2023-10-03T19:17:45.935161+0000 b1 1=1+0) (iversion lock) 0x55cc94155b80] 2023-10-03T19:21:22.405 INFO:teuthology.orchestra.run.smithi045.stdout: -3168> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_7 [2,head] auth (dversion lock) v=1884 ino=0x100000001fc state=1073741824 0x55cc9413d400] [inode 0x100000001fc [2,head] /dc-dir/dc-file_7 auth v1884 s=1 n(v0 rc2023-10-03T19:17:45.935161+0000 b1 1=1+0) (iversion lock) 0x55cc94155b80] 2023-10-03T19:21:22.405 INFO:teuthology.orchestra.run.smithi045.stdout: -3167> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x100000001fc [2,head] #100000001fc auth v1884 s=1 n(v0 rc2023-10-03T19:17:45.935161+0000 b1 1=1+0) (iversion lock) 0x55cc94155b80] 2023-10-03T19:21:22.405 INFO:teuthology.orchestra.run.smithi045.stdout: -3166> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_7 [2,head] auth NULL (dversion lock) v=1884 ino=(nil) state=1073741824 0x55cc9413d400] 2023-10-03T19:21:22.405 INFO:teuthology.orchestra.run.smithi045.stdout: -3165> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_6 [2,head] auth (dversion lock) v=1882 ino=0x100000001fb state=1073741824 0x55cc9413d180] 2023-10-03T19:21:22.405 INFO:teuthology.orchestra.run.smithi045.stdout: -3164> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.405 INFO:teuthology.orchestra.run.smithi045.stdout: -3163> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x100000001fb [2,head] /dc-dir/dc-file_6 auth v1882 s=1 n(v0 rc2023-10-03T19:17:45.925736+0000 b1 1=1+0) (iversion lock) 0x55cc94155600] 2023-10-03T19:21:22.405 INFO:teuthology.orchestra.run.smithi045.stdout: -3162> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_6 [2,head] auth (dversion lock) v=1882 ino=0x100000001fb state=1073741824 0x55cc9413d180] [inode 0x100000001fb [2,head] /dc-dir/dc-file_6 auth v1882 s=1 n(v0 rc2023-10-03T19:17:45.925736+0000 b1 1=1+0) (iversion lock) 0x55cc94155600] 2023-10-03T19:21:22.405 INFO:teuthology.orchestra.run.smithi045.stdout: -3161> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x100000001fb [2,head] #100000001fb auth v1882 s=1 n(v0 rc2023-10-03T19:17:45.925736+0000 b1 1=1+0) (iversion lock) 0x55cc94155600] 2023-10-03T19:21:22.405 INFO:teuthology.orchestra.run.smithi045.stdout: -3160> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_6 [2,head] auth NULL (dversion lock) v=1882 ino=(nil) state=1073741824 0x55cc9413d180] 2023-10-03T19:21:22.406 INFO:teuthology.orchestra.run.smithi045.stdout: -3159> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_5 [2,head] auth (dversion lock) v=1880 ino=0x100000001fa state=1073741824 0x55cc9413cf00] 2023-10-03T19:21:22.406 INFO:teuthology.orchestra.run.smithi045.stdout: -3158> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.406 INFO:teuthology.orchestra.run.smithi045.stdout: -3157> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x100000001fa [2,head] /dc-dir/dc-file_5 auth v1880 s=1 n(v0 rc2023-10-03T19:17:45.915708+0000 b1 1=1+0) (iversion lock) 0x55cc94155080] 2023-10-03T19:21:22.406 INFO:teuthology.orchestra.run.smithi045.stdout: -3156> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_5 [2,head] auth (dversion lock) v=1880 ino=0x100000001fa state=1073741824 0x55cc9413cf00] [inode 0x100000001fa [2,head] /dc-dir/dc-file_5 auth v1880 s=1 n(v0 rc2023-10-03T19:17:45.915708+0000 b1 1=1+0) (iversion lock) 0x55cc94155080] 2023-10-03T19:21:22.406 INFO:teuthology.orchestra.run.smithi045.stdout: -3155> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x100000001fa [2,head] #100000001fa auth v1880 s=1 n(v0 rc2023-10-03T19:17:45.915708+0000 b1 1=1+0) (iversion lock) 0x55cc94155080] 2023-10-03T19:21:22.406 INFO:teuthology.orchestra.run.smithi045.stdout: -3154> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_5 [2,head] auth NULL (dversion lock) v=1880 ino=(nil) state=1073741824 0x55cc9413cf00] 2023-10-03T19:21:22.406 INFO:teuthology.orchestra.run.smithi045.stdout: -3153> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_4 [2,head] auth (dversion lock) v=1878 ino=0x100000001f9 state=1073741824 0x55cc9413cc80] 2023-10-03T19:21:22.406 INFO:teuthology.orchestra.run.smithi045.stdout: -3152> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.406 INFO:teuthology.orchestra.run.smithi045.stdout: -3151> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x100000001f9 [2,head] /dc-dir/dc-file_4 auth v1878 s=1 n(v0 rc2023-10-03T19:17:45.905596+0000 b1 1=1+0) (iversion lock) 0x55cc94154b00] 2023-10-03T19:21:22.406 INFO:teuthology.orchestra.run.smithi045.stdout: -3150> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_4 [2,head] auth (dversion lock) v=1878 ino=0x100000001f9 state=1073741824 0x55cc9413cc80] [inode 0x100000001f9 [2,head] /dc-dir/dc-file_4 auth v1878 s=1 n(v0 rc2023-10-03T19:17:45.905596+0000 b1 1=1+0) (iversion lock) 0x55cc94154b00] 2023-10-03T19:21:22.407 INFO:teuthology.orchestra.run.smithi045.stdout: -3149> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x100000001f9 [2,head] #100000001f9 auth v1878 s=1 n(v0 rc2023-10-03T19:17:45.905596+0000 b1 1=1+0) (iversion lock) 0x55cc94154b00] 2023-10-03T19:21:22.407 INFO:teuthology.orchestra.run.smithi045.stdout: -3148> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_4 [2,head] auth NULL (dversion lock) v=1878 ino=(nil) state=1073741824 0x55cc9413cc80] 2023-10-03T19:21:22.407 INFO:teuthology.orchestra.run.smithi045.stdout: -3147> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_3 [2,head] auth (dversion lock) v=1876 ino=0x100000001f8 state=1073741824 0x55cc9413ca00] 2023-10-03T19:21:22.407 INFO:teuthology.orchestra.run.smithi045.stdout: -3146> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.407 INFO:teuthology.orchestra.run.smithi045.stdout: -3145> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x100000001f8 [2,head] /dc-dir/dc-file_3 auth v1876 s=1 n(v0 rc2023-10-03T19:17:45.895404+0000 b1 1=1+0) (iversion lock) 0x55cc94154580] 2023-10-03T19:21:22.407 INFO:teuthology.orchestra.run.smithi045.stdout: -3144> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_3 [2,head] auth (dversion lock) v=1876 ino=0x100000001f8 state=1073741824 0x55cc9413ca00] [inode 0x100000001f8 [2,head] /dc-dir/dc-file_3 auth v1876 s=1 n(v0 rc2023-10-03T19:17:45.895404+0000 b1 1=1+0) (iversion lock) 0x55cc94154580] 2023-10-03T19:21:22.407 INFO:teuthology.orchestra.run.smithi045.stdout: -3143> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x100000001f8 [2,head] #100000001f8 auth v1876 s=1 n(v0 rc2023-10-03T19:17:45.895404+0000 b1 1=1+0) (iversion lock) 0x55cc94154580] 2023-10-03T19:21:22.407 INFO:teuthology.orchestra.run.smithi045.stdout: -3142> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_3 [2,head] auth NULL (dversion lock) v=1876 ino=(nil) state=1073741824 0x55cc9413ca00] 2023-10-03T19:21:22.407 INFO:teuthology.orchestra.run.smithi045.stdout: -3141> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_2 [2,head] auth (dversion lock) v=1874 ino=0x100000001f7 state=1073741824 0x55cc9413c780] 2023-10-03T19:21:22.407 INFO:teuthology.orchestra.run.smithi045.stdout: -3140> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.407 INFO:teuthology.orchestra.run.smithi045.stdout: -3139> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x100000001f7 [2,head] /dc-dir/dc-file_2 auth v1874 s=1 n(v0 rc2023-10-03T19:17:45.885379+0000 b1 1=1+0) (iversion lock) 0x55cc94154000] 2023-10-03T19:21:22.407 INFO:teuthology.orchestra.run.smithi045.stdout: -3138> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_2 [2,head] auth (dversion lock) v=1874 ino=0x100000001f7 state=1073741824 0x55cc9413c780] [inode 0x100000001f7 [2,head] /dc-dir/dc-file_2 auth v1874 s=1 n(v0 rc2023-10-03T19:17:45.885379+0000 b1 1=1+0) (iversion lock) 0x55cc94154000] 2023-10-03T19:21:22.408 INFO:teuthology.orchestra.run.smithi045.stdout: -3137> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x100000001f7 [2,head] #100000001f7 auth v1874 s=1 n(v0 rc2023-10-03T19:17:45.885379+0000 b1 1=1+0) (iversion lock) 0x55cc94154000] 2023-10-03T19:21:22.408 INFO:teuthology.orchestra.run.smithi045.stdout: -3136> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_2 [2,head] auth NULL (dversion lock) v=1874 ino=(nil) state=1073741824 0x55cc9413c780] 2023-10-03T19:21:22.408 INFO:teuthology.orchestra.run.smithi045.stdout: -3135> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_1 [2,head] auth (dversion lock) v=1872 ino=0x100000001f6 state=1073741824 0x55cc9413c500] 2023-10-03T19:21:22.408 INFO:teuthology.orchestra.run.smithi045.stdout: -3134> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.408 INFO:teuthology.orchestra.run.smithi045.stdout: -3133> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x100000001f6 [2,head] /dc-dir/dc-file_1 auth v1872 s=1 n(v0 rc2023-10-03T19:17:45.875690+0000 b1 1=1+0) (iversion lock) 0x55cc940c1700] 2023-10-03T19:21:22.408 INFO:teuthology.orchestra.run.smithi045.stdout: -3132> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_1 [2,head] auth (dversion lock) v=1872 ino=0x100000001f6 state=1073741824 0x55cc9413c500] [inode 0x100000001f6 [2,head] /dc-dir/dc-file_1 auth v1872 s=1 n(v0 rc2023-10-03T19:17:45.875690+0000 b1 1=1+0) (iversion lock) 0x55cc940c1700] 2023-10-03T19:21:22.408 INFO:teuthology.orchestra.run.smithi045.stdout: -3131> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x100000001f6 [2,head] #100000001f6 auth v1872 s=1 n(v0 rc2023-10-03T19:17:45.875690+0000 b1 1=1+0) (iversion lock) 0x55cc940c1700] 2023-10-03T19:21:22.408 INFO:teuthology.orchestra.run.smithi045.stdout: -3130> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_1 [2,head] auth NULL (dversion lock) v=1872 ino=(nil) state=1073741824 0x55cc9413c500] 2023-10-03T19:21:22.408 INFO:teuthology.orchestra.run.smithi045.stdout: -3129> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache trim_dentry [dentry #0x1/dc-dir/dc-file_0 [2,head] auth (dversion lock) v=1870 ino=0x10000000001 state=1073741824 0x55cc9413c280] 2023-10-03T19:21:22.408 INFO:teuthology.orchestra.run.smithi045.stdout: -3128> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache in container [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.408 INFO:teuthology.orchestra.run.smithi045.stdout: -3127> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 15 mds.0.cache trim_inode [inode 0x10000000001 [2,head] /dc-dir/dc-file_0 auth v1870 s=1 n(v0 rc2023-10-03T19:17:45.865632+0000 b1 1=1+0) (iversion lock) 0x55cc940c0100] 2023-10-03T19:21:22.408 INFO:teuthology.orchestra.run.smithi045.stdout: -3126> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) unlink_inode [dentry #0x1/dc-dir/dc-file_0 [2,head] auth (dversion lock) v=1870 ino=0x10000000001 state=1073741824 0x55cc9413c280] [inode 0x10000000001 [2,head] /dc-dir/dc-file_0 auth v1870 s=1 n(v0 rc2023-10-03T19:17:45.865632+0000 b1 1=1+0) (iversion lock) 0x55cc940c0100] 2023-10-03T19:21:22.409 INFO:teuthology.orchestra.run.smithi045.stdout: -3125> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 14 mds.0.cache remove_inode [inode 0x10000000001 [2,head] #10000000001 auth v1870 s=1 n(v0 rc2023-10-03T19:17:45.865632+0000 b1 1=1+0) (iversion lock) 0x55cc940c0100] 2023-10-03T19:21:22.409 INFO:teuthology.orchestra.run.smithi045.stdout: -3124> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 12 mds.0.cache.dir(0x10000000000) remove_dentry [dentry #0x1/dc-dir/dc-file_0 [2,head] auth NULL (dversion lock) v=1870 ino=(nil) state=1073741824 0x55cc9413c280] 2023-10-03T19:21:22.409 INFO:teuthology.orchestra.run.smithi045.stdout: -3123> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 7 mds.0.cache trim_lru trimmed 100 items 2023-10-03T19:21:22.409 INFO:teuthology.orchestra.run.smithi045.stdout: -3122> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 10 mds.0.33 do_trim trimmed 100 caps 2023-10-03T19:21:22.409 INFO:teuthology.orchestra.run.smithi045.stdout: -3121> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 20 mds.0.33 cache_status 2023-10-03T19:21:22.409 INFO:teuthology.orchestra.run.smithi045.stdout: -3120> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 10 MDSContext::complete: 12C_Drop_Cache 2023-10-03T19:21:22.409 INFO:teuthology.orchestra.run.smithi045.stdout: -3119> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 20 mds.0.33 finish: r=0 2023-10-03T19:21:22.409 INFO:teuthology.orchestra.run.smithi045.stdout: -3118> 2023-10-03T19:18:09.861+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> 172.21.15.45:0/3512836594 -- command_reply(tid 0: 0 ) v1 -- 0x55cc95dc34a0 con 0x55cc930c1000 2023-10-03T19:21:22.409 INFO:teuthology.orchestra.run.smithi045.stdout: -3117> 2023-10-03T19:18:09.865+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] >> 172.21.15.45:0/3512836594 conn(0x55cc930c1000 msgr2=0x55cc9314d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 39 2023-10-03T19:21:22.409 INFO:teuthology.orchestra.run.smithi045.stdout: -3116> 2023-10-03T19:18:09.865+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] >> 172.21.15.45:0/3512836594 conn(0x55cc930c1000 msgr2=0x55cc9314d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-03T19:21:22.409 INFO:teuthology.orchestra.run.smithi045.stdout: -3115> 2023-10-03T19:18:09.865+0000 7f5ab672b640 1 --2- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] >> 172.21.15.45:0/3512836594 conn(0x55cc930c1000 0x55cc9314d080 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T19:21:22.410 INFO:teuthology.orchestra.run.smithi045.stdout: -3114> 2023-10-03T19:18:09.865+0000 7f5ab672b640 1 --2- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] >> 172.21.15.45:0/3512836594 conn(0x55cc930c1000 0x55cc9314d080 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:22.410 INFO:teuthology.orchestra.run.smithi045.stdout: -3113> 2023-10-03T19:18:09.865+0000 7f5ab3f26640 5 mds.a ms_handle_reset on 172.21.15.45:0/3512836594 2023-10-03T19:21:22.410 INFO:teuthology.orchestra.run.smithi045.stdout: -3112> 2023-10-03T19:18:09.865+0000 7f5ab3f26640 3 mds.a ms_handle_reset closing connection for session client.6534 172.21.15.45:0/3512836594 2023-10-03T19:21:22.410 INFO:teuthology.orchestra.run.smithi045.stdout: -3111> 2023-10-03T19:18:09.865+0000 7f5ab3f26640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] >> 172.21.15.45:0/3512836594 conn(0x55cc930c1000 msgr2=0x55cc9314d080 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-10-03T19:21:22.410 INFO:teuthology.orchestra.run.smithi045.stdout: -3110> 2023-10-03T19:18:09.865+0000 7f5ab3f26640 1 --2- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] >> 172.21.15.45:0/3512836594 conn(0x55cc930c1000 0x55cc9314d080 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:22.410 INFO:teuthology.orchestra.run.smithi045.stdout: -3109> 2023-10-03T19:18:10.001+0000 7f5ab2723640 10 mds.0.log trim 1 / 128 segments, 1 / -1 events, 0 (0) expiring, 0 (0) expired 2023-10-03T19:21:22.410 INFO:teuthology.orchestra.run.smithi045.stdout: -3108> 2023-10-03T19:18:10.001+0000 7f5ab2723640 10 mds.0.log _trim_expired_segments waiting for 3011/10057300 to expire 2023-10-03T19:21:22.410 INFO:teuthology.orchestra.run.smithi045.stdout: -3107> 2023-10-03T19:18:10.001+0000 7f5ab2723640 10 mds.0.server find_idle_sessions. last cleared laggy state 1136.39s ago 2023-10-03T19:21:22.410 INFO:teuthology.orchestra.run.smithi045.stdout: -3106> 2023-10-03T19:18:10.001+0000 7f5ab2723640 20 mds.0.server laggiest active session is client.5929 172.21.15.146:0/3047788495 and renewed caps recently (3.82395s ago) 2023-10-03T19:21:22.411 INFO:teuthology.orchestra.run.smithi045.stdout: -3105> 2023-10-03T19:18:10.001+0000 7f5ab2723640 10 mds.0.locker scatter_tick 2023-10-03T19:21:22.411 INFO:teuthology.orchestra.run.smithi045.stdout: -3104> 2023-10-03T19:18:10.001+0000 7f5ab2723640 20 mds.0.locker caps_tick 0 revoking caps 2023-10-03T19:21:22.411 INFO:teuthology.orchestra.run.smithi045.stdout: -3103> 2023-10-03T19:18:10.001+0000 7f5ab2723640 20 mds.0.bal handle_export_pins export_pin_queue size=0 2023-10-03T19:21:22.411 INFO:teuthology.orchestra.run.smithi045.stdout: -3102> 2023-10-03T19:18:10.001+0000 7f5ab2723640 15 mds.0.bal tick tick last_sample now 1136.391217s 2023-10-03T19:21:22.411 INFO:teuthology.orchestra.run.smithi045.stdout: -3101> 2023-10-03T19:18:10.001+0000 7f5ab2723640 15 mds.0.cache show_subtrees 2023-10-03T19:21:22.411 INFO:teuthology.orchestra.run.smithi045.stdout: -3100> 2023-10-03T19:18:10.001+0000 7f5ab2723640 10 mds.0.cache |__ 0 auth [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:22.411 INFO:teuthology.orchestra.run.smithi045.stdout: -3099> 2023-10-03T19:18:10.001+0000 7f5ab2723640 10 mds.0.cache |__ 0 auth [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:17:35.503088+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312f180] 2023-10-03T19:21:22.411 INFO:teuthology.orchestra.run.smithi045.stdout: -3098> 2023-10-03T19:18:10.001+0000 7f5ab2723640 10 mds.0.cache find_stale_fragment_freeze 2023-10-03T19:21:22.411 INFO:teuthology.orchestra.run.smithi045.stdout: -3097> 2023-10-03T19:18:10.001+0000 7f5ab2723640 10 mds.0.snap check_osd_map - version unchanged 2023-10-03T19:21:22.411 INFO:teuthology.orchestra.run.smithi045.stdout: -3096> 2023-10-03T19:18:10.001+0000 7f5ab2723640 20 mds.0.33 updating export targets, currently 0 ranks are targets 2023-10-03T19:21:22.411 INFO:teuthology.orchestra.run.smithi045.stdout: -3095> 2023-10-03T19:18:10.001+0000 7f5ab2f24640 10 monclient: tick 2023-10-03T19:21:22.411 INFO:teuthology.orchestra.run.smithi045.stdout: -3094> 2023-10-03T19:18:10.001+0000 7f5ab2f24640 10 monclient: _check_auth_tickets 2023-10-03T19:21:22.412 INFO:teuthology.orchestra.run.smithi045.stdout: -3093> 2023-10-03T19:18:10.001+0000 7f5ab2f24640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:17:40.006353+0000) 2023-10-03T19:21:22.412 INFO:teuthology.orchestra.run.smithi045.stdout: -3092> 2023-10-03T19:18:10.181+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== client.5929 172.21.15.146:0/3047788495 4054 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.125620, avg_latency: 0.000125, sq_sum: 38480022362598, count=1000][client_metric_type: METADATA_LATENCY latency: 2.708530, avg_latency: 0.002689, sq_sum: 31556747939477496, count=1007][client_metric_type: CAP_INFO cap_hits: 10014 cap_misses: 6 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 1001 dlease_misses: 0 num_dentries: 881][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 902][client_metric_type: PINNED_ICAPS pinned_icaps: 902 total_inodes: 902][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 902][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 1000 total_size: 2890] v1 ==== 328+0+0 (crc 0 0 0) 0x55cc95d8cf20 con 0x55cc9410e800 2023-10-03T19:21:22.412 INFO:teuthology.orchestra.run.smithi045.stdout: -3091> 2023-10-03T19:18:10.181+0000 7f5ab6f2c640 20 mds.0.33 get_session have 0x55cc9406b400 client.5929 172.21.15.146:0/3047788495 state open 2023-10-03T19:21:22.412 INFO:teuthology.orchestra.run.smithi045.stdout: -3090> 2023-10-03T19:18:10.181+0000 7f5ab6f2c640 20 handle_client_metrics: mds.metrics: session=0x55cc9406b400 2023-10-03T19:21:22.412 INFO:teuthology.orchestra.run.smithi045.stdout: -3089> 2023-10-03T19:18:10.181+0000 7f5ab6f2c640 20 handle_payload: mds.metrics: type=READ_LATENCY, session=0x55cc9406b400, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:22.412 INFO:teuthology.orchestra.run.smithi045.stdout: -3088> 2023-10-03T19:18:10.181+0000 7f5ab6f2c640 20 handle_payload: mds.metrics: type=WRITE_LATENCY, session=0x55cc9406b400, latency=0.125620, avg=0.000125, sq_sum=38480022362598, count=1000 2023-10-03T19:21:22.412 INFO:teuthology.orchestra.run.smithi045.stdout: -3087> 2023-10-03T19:18:10.181+0000 7f5ab6f2c640 20 handle_payload: mds.metrics: type=METADATA_LATENCY, session=0x55cc9406b400, latency=2.708530, avg=0.002689, sq_sum=31556747939477496, count=1007 2023-10-03T19:21:22.412 INFO:teuthology.orchestra.run.smithi045.stdout: -3086> 2023-10-03T19:18:10.181+0000 7f5ab6f2c640 20 handle_payload: mds.metrics: type=CAP_INFO, session=0x55cc9406b400, hits=10014, misses=6 2023-10-03T19:21:22.412 INFO:teuthology.orchestra.run.smithi045.stdout: -3085> 2023-10-03T19:18:10.181+0000 7f5ab6f2c640 20 handle_payload: mds.metrics: type=DENTRY_LEASE, session=0x55cc9406b400, hits=1001, misses=0 2023-10-03T19:21:22.412 INFO:teuthology.orchestra.run.smithi045.stdout: -3084> 2023-10-03T19:18:10.181+0000 7f5ab6f2c640 20 handle_payload: mds.metrics: type=OPENED_FILES, session=0x55cc9406b400, opened_files=0, total_inodes=902 2023-10-03T19:21:22.412 INFO:teuthology.orchestra.run.smithi045.stdout: -3083> 2023-10-03T19:18:10.181+0000 7f5ab6f2c640 20 handle_payload: mds.metrics: type=PINNED_ICAPS, session=0x55cc9406b400, pinned_icaps=902, total_inodes=902 2023-10-03T19:21:22.412 INFO:teuthology.orchestra.run.smithi045.stdout: -3082> 2023-10-03T19:18:10.181+0000 7f5ab6f2c640 20 handle_payload: mds.metrics: type=OPENED_INODES, session=0x55cc9406b400, opened_inodes=0, total_inodes=902 2023-10-03T19:21:22.413 INFO:teuthology.orchestra.run.smithi045.stdout: -3081> 2023-10-03T19:18:10.181+0000 7f5ab6f2c640 20 handle_payload: mds.metrics: type=READ_IO_SIZES, session=0x55cc9406b400, total_ops=0, total_size=0 2023-10-03T19:21:22.413 INFO:teuthology.orchestra.run.smithi045.stdout: -3080> 2023-10-03T19:18:10.181+0000 7f5ab6f2c640 20 handle_payload: mds.metrics: type=WRITE_IO_SIZES, session=0x55cc9406b400, total_ops=1000, total_size=2890 2023-10-03T19:21:22.413 INFO:teuthology.orchestra.run.smithi045.stdout: -3079> 2023-10-03T19:18:10.533+0000 7f5aaff1e640 2 mds.0.cache Memory usage: total 303888, rss 76264, heap 207144, baseline 190760, 902 / 914 inodes have caps, 902 caps, 0.986871 caps per inode 2023-10-03T19:21:22.413 INFO:teuthology.orchestra.run.smithi045.stdout: -3078> 2023-10-03T19:18:10.533+0000 7f5aaff1e640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999988139s ago 2023-10-03T19:21:22.413 INFO:teuthology.orchestra.run.smithi045.stdout: -3077> 2023-10-03T19:18:10.533+0000 7f5aaff1e640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:22.413 INFO:teuthology.orchestra.run.smithi045.stdout: -3076> 2023-10-03T19:18:10.533+0000 7f5aaff1e640 10 mds.0.cache trim_client_leases pool 2 trimmed 0 leases, 1 left 2023-10-03T19:21:22.413 INFO:teuthology.orchestra.run.smithi045.stdout: -3075> 2023-10-03T19:18:10.533+0000 7f5aaff1e640 7 mds.0.cache trim bytes_used=2MB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:22.413 INFO:teuthology.orchestra.run.smithi045.stdout: -3074> 2023-10-03T19:18:10.533+0000 7f5aaff1e640 7 mds.0.cache trim_lru trimming 0 items from LRU size=911 mid=0 pintail=911 pinned=911 2023-10-03T19:21:22.413 INFO:teuthology.orchestra.run.smithi045.stdout: -3073> 2023-10-03T19:18:10.533+0000 7f5aaff1e640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:22.413 INFO:teuthology.orchestra.run.smithi045.stdout: -3072> 2023-10-03T19:18:10.533+0000 7f5aaff1e640 7 mds.0.server recall_client_state: min=100 max=1048576 total=902 flags=0xa 2023-10-03T19:21:22.413 INFO:teuthology.orchestra.run.smithi045.stdout: -3071> 2023-10-03T19:18:10.533+0000 7f5aaff1e640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:22.413 INFO:teuthology.orchestra.run.smithi045.stdout: -3070> 2023-10-03T19:18:10.533+0000 7f5aaff1e640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:22.414 INFO:teuthology.orchestra.run.smithi045.stdout: -3069> 2023-10-03T19:18:10.641+0000 7f5aac717640 10 mds.metric.aggregator ping_all_active_ranks: pinging 1 active mds(s) 2023-10-03T19:21:22.414 INFO:teuthology.orchestra.run.smithi045.stdout: -3068> 2023-10-03T19:18:10.641+0000 7f5aac717640 20 mds.metric.aggregator ping_all_active_ranks: pinging rank=0 addr=[v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] 2023-10-03T19:21:22.414 INFO:teuthology.orchestra.run.smithi045.stdout: -3067> 2023-10-03T19:18:10.641+0000 7f5aac717640 10 mds.pinger send_ping: rank=0 2023-10-03T19:21:22.414 INFO:teuthology.orchestra.run.smithi045.stdout: -3066> 2023-10-03T19:18:10.641+0000 7f5aac717640 10 mds.pinger send_ping: sending ping with sequence=7 to rank=0 2023-10-03T19:21:22.414 INFO:teuthology.orchestra.run.smithi045.stdout: -3065> 2023-10-03T19:18:10.641+0000 7f5aac717640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] send_to--> mds [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] -- mdsping v1 -- ?+0 0x55cc93192a00 2023-10-03T19:21:22.414 INFO:teuthology.orchestra.run.smithi045.stdout: -3064> 2023-10-03T19:18:10.641+0000 7f5aac717640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] -- mdsping v1 -- 0x55cc93192a00 con 0x55cc930c1c00 2023-10-03T19:21:22.414 INFO:teuthology.orchestra.run.smithi045.stdout: -3063> 2023-10-03T19:18:10.641+0000 7f5ab3725640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== mds.0 v2:172.21.15.45:6833/2939002026 0 ==== mdsping v1 ==== 0+0+0 (unknown 0 0 0) 0x55cc93192a00 con 0x55cc930c1c00 2023-10-03T19:21:22.414 INFO:teuthology.orchestra.run.smithi045.stdout: -3062> 2023-10-03T19:18:10.645+0000 7f5ab3725640 20 set_next_seq: mds.metrics: current sequence number 6, setting next sequence number 7 2023-10-03T19:21:22.414 INFO:teuthology.orchestra.run.smithi045.stdout: -3061> 2023-10-03T19:18:10.905+0000 7f5ab1721640 10 mds.pinger is_rank_lagging: rank=0 2023-10-03T19:21:22.414 INFO:teuthology.orchestra.run.smithi045.stdout: -3060> 2023-10-03T19:18:10.905+0000 7f5ab1721640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgrreport(unknown.a +0-0 packed 1558) v9 -- 0x55cc947d8380 con 0x55cc93e55800 2023-10-03T19:21:22.414 INFO:teuthology.orchestra.run.smithi045.stdout: -3059> 2023-10-03T19:18:11.001+0000 7f5ab2f24640 10 monclient: tick 2023-10-03T19:21:22.415 INFO:teuthology.orchestra.run.smithi045.stdout: -3058> 2023-10-03T19:18:11.001+0000 7f5ab2f24640 10 monclient: _check_auth_tickets 2023-10-03T19:21:22.415 INFO:teuthology.orchestra.run.smithi045.stdout: -3057> 2023-10-03T19:18:11.001+0000 7f5ab2f24640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:17:41.006442+0000) 2023-10-03T19:21:22.415 INFO:teuthology.orchestra.run.smithi045.stdout: -3056> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== client.5929 172.21.15.146:0/3047788495 4055 ==== client_cap_release(20) v2 ==== 488+0+0 (crc 0 0 0) 0x55cc95d8cf20 con 0x55cc9410e800 2023-10-03T19:21:22.415 INFO:teuthology.orchestra.run.smithi045.stdout: -3055> 2023-10-03T19:18:11.181+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== client.5929 172.21.15.146:0/3047788495 4056 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.125620, avg_latency: 0.000125, sq_sum: 38480022362598, count=1000][client_metric_type: METADATA_LATENCY latency: 2.708530, avg_latency: 0.002689, sq_sum: 31556747939477496, count=1007][client_metric_type: CAP_INFO cap_hits: 10014 cap_misses: 6 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 1001 dlease_misses: 0 num_dentries: 881][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 882][client_metric_type: PINNED_ICAPS pinned_icaps: 882 total_inodes: 882][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 882][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 1000 total_size: 2890] v1 ==== 328+0+0 (crc 0 0 0) 0x55cc956982c0 con 0x55cc9410e800 2023-10-03T19:21:22.415 INFO:teuthology.orchestra.run.smithi045.stdout: -3054> 2023-10-03T19:18:11.181+0000 7f5ab6f2c640 20 mds.0.33 get_session have 0x55cc9406b400 client.5929 172.21.15.146:0/3047788495 state open 2023-10-03T19:21:22.415 INFO:teuthology.orchestra.run.smithi045.stdout: -3053> 2023-10-03T19:18:11.181+0000 7f5ab6f2c640 20 handle_client_metrics: mds.metrics: session=0x55cc9406b400 2023-10-03T19:21:22.415 INFO:teuthology.orchestra.run.smithi045.stdout: -3052> 2023-10-03T19:18:11.181+0000 7f5ab6f2c640 20 handle_payload: mds.metrics: type=READ_LATENCY, session=0x55cc9406b400, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:22.415 INFO:teuthology.orchestra.run.smithi045.stdout: -3051> 2023-10-03T19:18:11.181+0000 7f5ab6f2c640 20 handle_payload: mds.metrics: type=WRITE_LATENCY, session=0x55cc9406b400, latency=0.125620, avg=0.000125, sq_sum=38480022362598, count=1000 2023-10-03T19:21:22.415 INFO:teuthology.orchestra.run.smithi045.stdout: -3050> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 10 mds.0.locker handle_client_cap_release client_cap_release(20) v2 2023-10-03T19:21:22.415 INFO:teuthology.orchestra.run.smithi045.stdout: -3049> 2023-10-03T19:18:11.181+0000 7f5ab6f2c640 20 handle_payload: mds.metrics: type=METADATA_LATENCY, session=0x55cc9406b400, latency=2.708530, avg=0.002689, sq_sum=31556747939477496, count=1007 2023-10-03T19:21:22.415 INFO:teuthology.orchestra.run.smithi045.stdout: -3048> 2023-10-03T19:18:11.181+0000 7f5ab6f2c640 20 handle_payload: mds.metrics: type=CAP_INFO, session=0x55cc9406b400, hits=10014, misses=6 2023-10-03T19:21:22.415 INFO:teuthology.orchestra.run.smithi045.stdout: -3047> 2023-10-03T19:18:11.181+0000 7f5ab6f2c640 20 handle_payload: mds.metrics: type=DENTRY_LEASE, session=0x55cc9406b400, hits=1001, misses=0 2023-10-03T19:21:22.416 INFO:teuthology.orchestra.run.smithi045.stdout: -3046> 2023-10-03T19:18:11.181+0000 7f5ab6f2c640 20 handle_payload: mds.metrics: type=OPENED_FILES, session=0x55cc9406b400, opened_files=0, total_inodes=882 2023-10-03T19:21:22.416 INFO:teuthology.orchestra.run.smithi045.stdout: -3045> 2023-10-03T19:18:11.181+0000 7f5ab6f2c640 20 handle_payload: mds.metrics: type=PINNED_ICAPS, session=0x55cc9406b400, pinned_icaps=882, total_inodes=882 2023-10-03T19:21:22.416 INFO:teuthology.orchestra.run.smithi045.stdout: -3044> 2023-10-03T19:18:11.181+0000 7f5ab6f2c640 20 handle_payload: mds.metrics: type=OPENED_INODES, session=0x55cc9406b400, opened_inodes=0, total_inodes=882 2023-10-03T19:21:22.416 INFO:teuthology.orchestra.run.smithi045.stdout: -3043> 2023-10-03T19:18:11.181+0000 7f5ab6f2c640 20 handle_payload: mds.metrics: type=READ_IO_SIZES, session=0x55cc9406b400, total_ops=0, total_size=0 2023-10-03T19:21:22.416 INFO:teuthology.orchestra.run.smithi045.stdout: -3042> 2023-10-03T19:18:11.181+0000 7f5ab6f2c640 20 handle_payload: mds.metrics: type=WRITE_IO_SIZES, session=0x55cc9406b400, total_ops=1000, total_size=2890 2023-10-03T19:21:22.416 INFO:teuthology.orchestra.run.smithi045.stdout: -3041> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 20 mds.0.33 get_session have 0x55cc9406b400 client.5929 172.21.15.146:0/3047788495 state open 2023-10-03T19:21:22.416 INFO:teuthology.orchestra.run.smithi045.stdout: -3040> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 7 mds.0.locker _do_cap_release for client.5929 on [inode 0x10000000259 [2,head] /dc-dir/dc-file_100 auth v2396 s=3 n(v0 rc2023-10-03T19:17:46.909091+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc941ff700] 2023-10-03T19:21:22.416 INFO:teuthology.orchestra.run.smithi045.stdout: -3039> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 10 mds.0.cache.ino(0x10000000259) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:22.416 INFO:teuthology.orchestra.run.smithi045.stdout: -3038> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 7 mds.0.locker _do_cap_release for client.5929 on [inode 0x1000000025a [2,head] /dc-dir/dc-file_101 auth v2398 s=3 n(v0 rc2023-10-03T19:17:46.918865+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94208000] 2023-10-03T19:21:22.416 INFO:teuthology.orchestra.run.smithi045.stdout: -3037> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 10 mds.0.cache.ino(0x1000000025a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:22.416 INFO:teuthology.orchestra.run.smithi045.stdout: -3036> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 7 mds.0.locker _do_cap_release for client.5929 on [inode 0x1000000025b [2,head] /dc-dir/dc-file_102 auth v2400 s=3 n(v0 rc2023-10-03T19:17:46.929096+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94208580] 2023-10-03T19:21:22.416 INFO:teuthology.orchestra.run.smithi045.stdout: -3035> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 10 mds.0.cache.ino(0x1000000025b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:22.417 INFO:teuthology.orchestra.run.smithi045.stdout: -3034> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 7 mds.0.locker _do_cap_release for client.5929 on [inode 0x1000000025c [2,head] /dc-dir/dc-file_103 auth v2402 s=3 n(v0 rc2023-10-03T19:17:46.940656+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94208b00] 2023-10-03T19:21:22.417 INFO:teuthology.orchestra.run.smithi045.stdout: -3033> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 10 mds.0.cache.ino(0x1000000025c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:22.417 INFO:teuthology.orchestra.run.smithi045.stdout: -3032> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 7 mds.0.locker _do_cap_release for client.5929 on [inode 0x1000000025d [2,head] /dc-dir/dc-file_104 auth v2404 s=3 n(v0 rc2023-10-03T19:17:46.951033+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94209080] 2023-10-03T19:21:22.417 INFO:teuthology.orchestra.run.smithi045.stdout: -3031> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 10 mds.0.cache.ino(0x1000000025d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:22.417 INFO:teuthology.orchestra.run.smithi045.stdout: -3030> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 7 mds.0.locker _do_cap_release for client.5929 on [inode 0x1000000025e [2,head] /dc-dir/dc-file_105 auth v2406 s=3 n(v0 rc2023-10-03T19:17:46.960273+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94209600] 2023-10-03T19:21:22.417 INFO:teuthology.orchestra.run.smithi045.stdout: -3029> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 10 mds.0.cache.ino(0x1000000025e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:22.417 INFO:teuthology.orchestra.run.smithi045.stdout: -3028> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 7 mds.0.locker _do_cap_release for client.5929 on [inode 0x1000000025f [2,head] /dc-dir/dc-file_106 auth v2408 s=3 n(v0 rc2023-10-03T19:17:46.970097+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94209b80] 2023-10-03T19:21:22.417 INFO:teuthology.orchestra.run.smithi045.stdout: -3027> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 10 mds.0.cache.ino(0x1000000025f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:22.417 INFO:teuthology.orchestra.run.smithi045.stdout: -3026> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 7 mds.0.locker _do_cap_release for client.5929 on [inode 0x10000000260 [2,head] /dc-dir/dc-file_107 auth v2410 s=3 n(v0 rc2023-10-03T19:17:46.979733+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9420a100] 2023-10-03T19:21:22.417 INFO:teuthology.orchestra.run.smithi045.stdout: -3025> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 10 mds.0.cache.ino(0x10000000260) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:22.418 INFO:teuthology.orchestra.run.smithi045.stdout: -3024> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 7 mds.0.locker _do_cap_release for client.5929 on [inode 0x10000000261 [2,head] /dc-dir/dc-file_108 auth v2412 s=3 n(v0 rc2023-10-03T19:17:46.989407+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9420a680] 2023-10-03T19:21:22.418 INFO:teuthology.orchestra.run.smithi045.stdout: -3023> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 10 mds.0.cache.ino(0x10000000261) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:22.450 INFO:teuthology.orchestra.run.smithi045.stdout: -3022> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 7 mds.0.locker _do_cap_release for client.5929 on [inode 0x10000000262 [2,head] /dc-dir/dc-file_109 auth v2414 s=3 n(v0 rc2023-10-03T19:17:47.000065+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9420ac00] 2023-10-03T19:21:22.450 INFO:teuthology.orchestra.run.smithi045.stdout: -3021> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 10 mds.0.cache.ino(0x10000000262) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:22.450 INFO:teuthology.orchestra.run.smithi045.stdout: -3020> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 7 mds.0.locker _do_cap_release for client.5929 on [inode 0x10000000263 [2,head] /dc-dir/dc-file_110 auth v2416 s=3 n(v0 rc2023-10-03T19:17:47.011751+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9420b180] 2023-10-03T19:21:22.450 INFO:teuthology.orchestra.run.smithi045.stdout: -3019> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 10 mds.0.cache.ino(0x10000000263) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:22.450 INFO:teuthology.orchestra.run.smithi045.stdout: -3018> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 7 mds.0.locker _do_cap_release for client.5929 on [inode 0x10000000264 [2,head] /dc-dir/dc-file_111 auth v2418 s=3 n(v0 rc2023-10-03T19:17:47.022000+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9420b700] 2023-10-03T19:21:22.450 INFO:teuthology.orchestra.run.smithi045.stdout: -3017> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 10 mds.0.cache.ino(0x10000000264) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:22.450 INFO:teuthology.orchestra.run.smithi045.stdout: -3016> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 7 mds.0.locker _do_cap_release for client.5929 on [inode 0x10000000265 [2,head] /dc-dir/dc-file_112 auth v2420 s=3 n(v0 rc2023-10-03T19:17:47.033060+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9421c000] 2023-10-03T19:21:22.451 INFO:teuthology.orchestra.run.smithi045.stdout: -3015> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 10 mds.0.cache.ino(0x10000000265) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:22.451 INFO:teuthology.orchestra.run.smithi045.stdout: -3014> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 7 mds.0.locker _do_cap_release for client.5929 on [inode 0x10000000266 [2,head] /dc-dir/dc-file_113 auth v2422 s=3 n(v0 rc2023-10-03T19:17:47.043483+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9421c580] 2023-10-03T19:21:22.451 INFO:teuthology.orchestra.run.smithi045.stdout: -3013> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 10 mds.0.cache.ino(0x10000000266) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:22.451 INFO:teuthology.orchestra.run.smithi045.stdout: -3012> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 7 mds.0.locker _do_cap_release for client.5929 on [inode 0x10000000267 [2,head] /dc-dir/dc-file_114 auth v2424 s=3 n(v0 rc2023-10-03T19:17:47.053806+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9421cb00] 2023-10-03T19:21:22.451 INFO:teuthology.orchestra.run.smithi045.stdout: -3011> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 10 mds.0.cache.ino(0x10000000267) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:22.451 INFO:teuthology.orchestra.run.smithi045.stdout: -3010> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 7 mds.0.locker _do_cap_release for client.5929 on [inode 0x10000000268 [2,head] /dc-dir/dc-file_115 auth v2426 s=3 n(v0 rc2023-10-03T19:17:47.065075+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9421d080] 2023-10-03T19:21:22.451 INFO:teuthology.orchestra.run.smithi045.stdout: -3009> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 10 mds.0.cache.ino(0x10000000268) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:22.451 INFO:teuthology.orchestra.run.smithi045.stdout: -3008> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 7 mds.0.locker _do_cap_release for client.5929 on [inode 0x10000000269 [2,head] /dc-dir/dc-file_116 auth v2722 s=3 n(v0 rc2023-10-03T19:17:47.075950+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9421d600] 2023-10-03T19:21:22.451 INFO:teuthology.orchestra.run.smithi045.stdout: -3007> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 10 mds.0.cache.ino(0x10000000269) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:22.451 INFO:teuthology.orchestra.run.smithi045.stdout: -3006> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 7 mds.0.locker _do_cap_release for client.5929 on [inode 0x1000000026a [2,head] /dc-dir/dc-file_117 auth v2724 s=3 n(v0 rc2023-10-03T19:17:47.087101+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9421db80] 2023-10-03T19:21:22.451 INFO:teuthology.orchestra.run.smithi045.stdout: -3005> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 10 mds.0.cache.ino(0x1000000026a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:22.452 INFO:teuthology.orchestra.run.smithi045.stdout: -3004> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 7 mds.0.locker _do_cap_release for client.5929 on [inode 0x1000000026b [2,head] /dc-dir/dc-file_118 auth v2726 s=3 n(v0 rc2023-10-03T19:17:47.098042+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9421e100] 2023-10-03T19:21:22.452 INFO:teuthology.orchestra.run.smithi045.stdout: -3003> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 10 mds.0.cache.ino(0x1000000026b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:22.452 INFO:teuthology.orchestra.run.smithi045.stdout: -3002> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 7 mds.0.locker _do_cap_release for client.5929 on [inode 0x1000000026c [2,head] /dc-dir/dc-file_119 auth v2728 s=3 n(v0 rc2023-10-03T19:17:47.109953+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9421e680] 2023-10-03T19:21:22.452 INFO:teuthology.orchestra.run.smithi045.stdout: -3001> 2023-10-03T19:18:11.181+0000 7f5ab3f26640 10 mds.0.cache.ino(0x1000000026c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:22.452 INFO:teuthology.orchestra.run.smithi045.stdout: -3000> 2023-10-03T19:18:11.501+0000 7f5ab2723640 20 mds.0.33 get_task_status 2023-10-03T19:21:22.452 INFO:teuthology.orchestra.run.smithi045.stdout: -2999> 2023-10-03T19:18:11.501+0000 7f5ab2723640 20 mds.0.33 schedule_update_timer_task 2023-10-03T19:21:22.452 INFO:teuthology.orchestra.run.smithi045.stdout: -2998> 2023-10-03T19:18:11.533+0000 7f5aaff1e640 2 mds.0.cache Memory usage: total 303888, rss 76264, heap 207144, baseline 190760, 882 / 914 inodes have caps, 882 caps, 0.964989 caps per inode 2023-10-03T19:21:22.452 INFO:teuthology.orchestra.run.smithi045.stdout: -2997> 2023-10-03T19:18:11.533+0000 7f5aaff1e640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999988139s ago 2023-10-03T19:21:22.452 INFO:teuthology.orchestra.run.smithi045.stdout: -2996> 2023-10-03T19:18:11.533+0000 7f5aaff1e640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:22.452 INFO:teuthology.orchestra.run.smithi045.stdout: -2995> 2023-10-03T19:18:11.533+0000 7f5aaff1e640 10 mds.0.cache trim_client_leases pool 2 trimmed 0 leases, 1 left 2023-10-03T19:21:22.453 INFO:teuthology.orchestra.run.smithi045.stdout: -2994> 2023-10-03T19:18:11.533+0000 7f5aaff1e640 7 mds.0.cache trim bytes_used=2MB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:22.453 INFO:teuthology.orchestra.run.smithi045.stdout: -2993> 2023-10-03T19:18:11.533+0000 7f5aaff1e640 7 mds.0.cache trim_lru trimming 0 items from LRU size=911 mid=14 pintail=891 pinned=891 2023-10-03T19:21:22.453 INFO:teuthology.orchestra.run.smithi045.stdout: -2992> 2023-10-03T19:18:11.533+0000 7f5aaff1e640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:22.453 INFO:teuthology.orchestra.run.smithi045.stdout: -2991> 2023-10-03T19:18:11.533+0000 7f5aaff1e640 7 mds.0.server recall_client_state: min=100 max=1048576 total=882 flags=0xa 2023-10-03T19:21:22.453 INFO:teuthology.orchestra.run.smithi045.stdout: -2990> 2023-10-03T19:18:11.533+0000 7f5aaff1e640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:22.453 INFO:teuthology.orchestra.run.smithi045.stdout: -2989> 2023-10-03T19:18:11.533+0000 7f5aaff1e640 10 mds.0.cache releasing free memory 2023-10-03T19:21:22.453 INFO:teuthology.orchestra.run.smithi045.stdout: -2988> 2023-10-03T19:18:11.537+0000 7f5aaff1e640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:22.453 INFO:teuthology.orchestra.run.smithi045.stdout: -2987> 2023-10-03T19:18:11.573+0000 7f5ab1f22640 5 mds.beacon.a Sending beacon up:active seq 12 2023-10-03T19:21:22.453 INFO:teuthology.orchestra.run.smithi045.stdout: -2986> 2023-10-03T19:18:11.573+0000 7f5ab1f22640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:22.453 INFO:teuthology.orchestra.run.smithi045.stdout: -2985> 2023-10-03T19:18:11.573+0000 7f5ab1f22640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mdsbeacon(6342/a up:active seq=12 v36) v8 -- 0x55cc941e0b00 con 0x55cc930c1400 2023-10-03T19:21:22.453 INFO:teuthology.orchestra.run.smithi045.stdout: -2984> 2023-10-03T19:18:11.573+0000 7f5ab1f22640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:22.453 INFO:teuthology.orchestra.run.smithi045.stdout: -2983> 2023-10-03T19:18:11.573+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== mon.0 v2:172.21.15.45:3300/0 62 ==== mdsbeacon(6342/a up:active seq=12 v36) v8 ==== 130+0+0 (secure 0 0 0) 0x55cc941e0b00 con 0x55cc930c1400 2023-10-03T19:21:22.454 INFO:teuthology.orchestra.run.smithi045.stdout: -2982> 2023-10-03T19:18:11.573+0000 7f5ab672b640 5 mds.beacon.a received beacon reply up:active seq 12 rtt 0 2023-10-03T19:21:22.454 INFO:teuthology.orchestra.run.smithi045.stdout: -2981> 2023-10-03T19:18:11.573+0000 7f5ab1f22640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:22.454 INFO:teuthology.orchestra.run.smithi045.stdout: -2980> 2023-10-03T19:18:11.645+0000 7f5aacf18640 20 update_rank0: mds.metrics 2023-10-03T19:21:22.454 INFO:teuthology.orchestra.run.smithi045.stdout: -2979> 2023-10-03T19:18:11.645+0000 7f5aacf18640 20 update_rank0: mds.metrics: sending metric updates for 1 clients to rank 0 (address: [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026]) with sequence number 7, last updated sequence number 16 2023-10-03T19:21:22.454 INFO:teuthology.orchestra.run.smithi045.stdout: -2978> 2023-10-03T19:18:11.645+0000 7f5aacf18640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] send_to--> mds [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] -- mds_metrics from rank=0 carrying 1 metric updates v1 -- ?+0 0x55cc94600600 2023-10-03T19:21:22.454 INFO:teuthology.orchestra.run.smithi045.stdout: -2977> 2023-10-03T19:18:11.645+0000 7f5aacf18640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] -- mds_metrics from rank=0 carrying 1 metric updates v1 -- 0x55cc94600600 con 0x55cc930c1c00 2023-10-03T19:21:22.454 INFO:teuthology.orchestra.run.smithi045.stdout: -2976> 2023-10-03T19:18:11.645+0000 7f5ab3725640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== mds.0 v2:172.21.15.45:6833/2939002026 0 ==== mds_metrics from rank=0 carrying 1 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x55cc94600600 con 0x55cc930c1c00 2023-10-03T19:21:22.454 INFO:teuthology.orchestra.run.smithi045.stdout: -2975> 2023-10-03T19:18:11.645+0000 7f5ab3725640 20 mds.metric.aggregator handle_mds_metrics: applying 1 updates for rank=0 with sequence number 7 2023-10-03T19:21:22.454 INFO:teuthology.orchestra.run.smithi045.stdout: -2974> 2023-10-03T19:18:11.645+0000 7f5ab3725640 10 mds.pinger pong_received: rank=0, sequence=7 2023-10-03T19:21:22.454 INFO:teuthology.orchestra.run.smithi045.stdout: -2973> 2023-10-03T19:18:11.645+0000 7f5ab3725640 20 mds.metric.aggregator refresh_metrics_for_rank: client=client.5929 172.21.15.146:0/3047788495, rank=0, metrics=[update_type=0, metrics={cap_hit_metric={hits=10014, misses=6}, read_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, write_latency={latency=0.125620, avg_latency=0.000125, sq_sum=38480022362598, count=1000}, metadata_latency={latency=2.708530, avg_latency=0.002689, sq_sum=31556747939477496, count=1007}, dentry_lease={hits=1001, misses=0}, opened_files_metric={opened_files=0, total_inodes=882}, pinned_icaps_metric={pinned_icaps=882, total_inodes=882}, opened_inodes_metric={opened_inodes=0, total_inodes=882}, read_io_sizes_metric={total_ops=0, total_size=0}, write_io_sizes_metric={total_ops=1000, total_size=2890}}] 2023-10-03T19:21:22.454 INFO:teuthology.orchestra.run.smithi045.stdout: -2972> 2023-10-03T19:18:12.005+0000 7f5ab2f24640 10 monclient: tick 2023-10-03T19:21:22.454 INFO:teuthology.orchestra.run.smithi045.stdout: -2971> 2023-10-03T19:18:12.005+0000 7f5ab2f24640 10 monclient: _check_auth_tickets 2023-10-03T19:21:22.455 INFO:teuthology.orchestra.run.smithi045.stdout: -2970> 2023-10-03T19:18:12.005+0000 7f5ab2f24640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:17:42.006550+0000) 2023-10-03T19:21:22.455 INFO:teuthology.orchestra.run.smithi045.stdout: -2969> 2023-10-03T19:18:12.077+0000 7f5ab3f26640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== client.5929 172.21.15.146:0/3047788495 4057 ==== client_session(request_close seq 2001) v1 ==== 28+0+0 (crc 0 0 0) 0x55cc93101c00 con 0x55cc9410e800 2023-10-03T19:21:22.455 INFO:teuthology.orchestra.run.smithi045.stdout: -2968> 2023-10-03T19:18:12.077+0000 7f5ab3f26640 20 mds.0.33 get_session have 0x55cc9406b400 client.5929 172.21.15.146:0/3047788495 state open 2023-10-03T19:21:22.455 INFO:teuthology.orchestra.run.smithi045.stdout: -2967> 2023-10-03T19:18:12.077+0000 7f5ab3f26640 3 mds.0.server handle_client_session client_session(request_close seq 2001) v1 from client.5929 2023-10-03T19:21:22.455 INFO:teuthology.orchestra.run.smithi045.stdout: -2966> 2023-10-03T19:18:12.077+0000 7f5ab3f26640 10 mds.0.server journal_close_session : client.5929 172.21.15.146:0/3047788495 pending_prealloc_inos [] free_prealloc_inos [0x100000005dd~0x1f7] delegated_inos [0x10000000002~0x1f4] 2023-10-03T19:21:22.455 INFO:teuthology.orchestra.run.smithi045.stdout: -2965> 2023-10-03T19:18:12.077+0000 7f5ab3f26640 20 mds.0.sessionmap mark_projected s=0x55cc9406b400 name=client.5929 pv=1004 -> 1005 2023-10-03T19:21:22.455 INFO:teuthology.orchestra.run.smithi045.stdout: -2964> 2023-10-03T19:18:12.077+0000 7f5ab3f26640 10 mds.0.inotable: project_release_ids [0x100000005dd~0x1f7] to [0x100000007d4~0xfffffff82c]/[0x100000007d4~0xfffffff82c] 2023-10-03T19:21:22.455 INFO:teuthology.orchestra.run.smithi045.stdout: -2963> 2023-10-03T19:18:12.077+0000 7f5aad719640 5 mds.0.log _submit_thread 10058192~153 : ESession client.5929 172.21.15.146:0/3047788495 close cmapv 1005 (503 to free, v5, 500 to purge) 2023-10-03T19:21:22.455 INFO:teuthology.orchestra.run.smithi045.stdout: -2962> 2023-10-03T19:18:12.077+0000 7f5aad719640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2072 11.1b 11:ddb4e4d7:::200.00000002:head [write 1669584~173 [fadvise_dontneed] in=173b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc947d9500 con 0x55cc93ffd400 2023-10-03T19:21:22.455 INFO:teuthology.orchestra.run.smithi045.stdout: -2961> 2023-10-03T19:18:12.081+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 305 ==== osd_op_reply(2072 200.00000002 [write 1669584~173 [fadvise_dontneed]] v74'173 uv173 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:22.455 INFO:teuthology.orchestra.run.smithi045.stdout: -2960> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 10 MDSIOContextBase::complete: 20C_MDS_session_finish 2023-10-03T19:21:22.455 INFO:teuthology.orchestra.run.smithi045.stdout: -2959> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 10 MDSContext::complete: 20C_MDS_session_finish 2023-10-03T19:21:22.456 INFO:teuthology.orchestra.run.smithi045.stdout: -2958> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 10 mds.0.server _session_logged client.5929 172.21.15.146:0/3047788495 state_seq 3 close 1005 inos_to_free [0x100000005dd~0x1f7] inotablev 5 inos_to_purge [0x10000000002~0x1f4] 2023-10-03T19:21:22.456 INFO:teuthology.orchestra.run.smithi045.stdout: -2957> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 10 mds.0.cache purge_inodes purging inos [0x10000000002~0x1f4] logseg 3011 2023-10-03T19:21:22.456 INFO:teuthology.orchestra.run.smithi045.stdout: -2956> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2073 12.12 12:4bec3886:::10000000002.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc940cf880 con 0x55cc93ffdc00 2023-10-03T19:21:22.456 INFO:teuthology.orchestra.run.smithi045.stdout: -2955> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2074 12.32 12:4def72d4:::10000000003.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b4f880 con 0x55cc93ffdc00 2023-10-03T19:21:22.456 INFO:teuthology.orchestra.run.smithi045.stdout: -2954> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2075 12.5 12:a367a3e8:::10000000004.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941d3880 con 0x55cc93ffc400 2023-10-03T19:21:22.456 INFO:teuthology.orchestra.run.smithi045.stdout: -2953> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2076 12.9 12:9258b67d:::10000000005.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941d3500 con 0x55cc93ffcc00 2023-10-03T19:21:22.456 INFO:teuthology.orchestra.run.smithi045.stdout: -2952> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2077 12.25 12:a5feb6f3:::10000000006.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc947c6a80 con 0x55cc93ffc800 2023-10-03T19:21:22.456 INFO:teuthology.orchestra.run.smithi045.stdout: -2951> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2078 12.1d 12:bbf5850a:::10000000007.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc947c7500 con 0x55cc93ffd000 2023-10-03T19:21:22.456 INFO:teuthology.orchestra.run.smithi045.stdout: -2950> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2079 12.13 12:cabe77c1:::10000000008.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9419dc00 con 0x55cc9410e000 2023-10-03T19:21:22.456 INFO:teuthology.orchestra.run.smithi045.stdout: -2949> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2080 12.34 12:2eb4da2b:::10000000009.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9419d180 con 0x55cc93ffd800 2023-10-03T19:21:22.456 INFO:teuthology.orchestra.run.smithi045.stdout: -2948> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2081 12.22 12:45d72e17:::1000000000a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9419c000 con 0x55cc93ffc800 2023-10-03T19:21:22.457 INFO:teuthology.orchestra.run.smithi045.stdout: -2947> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2082 12.29 12:9752f43f:::1000000000b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94261c00 con 0x55cc93ffd400 2023-10-03T19:21:22.457 INFO:teuthology.orchestra.run.smithi045.stdout: -2946> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2083 12.22 12:46cca9ab:::1000000000c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941a6380 con 0x55cc93ffc800 2023-10-03T19:21:22.457 INFO:teuthology.orchestra.run.smithi045.stdout: -2945> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2084 12.17 12:e9ecae36:::1000000000d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc946d8a80 con 0x55cc93ffc400 2023-10-03T19:21:22.457 INFO:teuthology.orchestra.run.smithi045.stdout: -2944> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2085 12.37 12:eefe613f:::1000000000e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b7d500 con 0x55cc93ffd400 2023-10-03T19:21:22.457 INFO:teuthology.orchestra.run.smithi045.stdout: -2943> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2086 12.12 12:49e35fbc:::1000000000f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94734e00 con 0x55cc93ffdc00 2023-10-03T19:21:22.457 INFO:teuthology.orchestra.run.smithi045.stdout: -2942> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2087 12.3b 12:dde6a3df:::10000000010.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94735c00 con 0x55cc93ffcc00 2023-10-03T19:21:22.457 INFO:teuthology.orchestra.run.smithi045.stdout: -2941> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2088 12.15 12:ab5910e2:::10000000011.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc945d8000 con 0x55cc93ffc400 2023-10-03T19:21:22.457 INFO:teuthology.orchestra.run.smithi045.stdout: -2940> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2089 12.d 12:b185e6e8:::10000000012.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94452000 con 0x55cc93ffc800 2023-10-03T19:21:22.457 INFO:teuthology.orchestra.run.smithi045.stdout: -2939> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2090 12.22 12:44834937:::10000000013.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9415ae00 con 0x55cc93ffc800 2023-10-03T19:21:22.457 INFO:teuthology.orchestra.run.smithi045.stdout: -2938> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2091 12.10 12:0b7da9c3:::10000000014.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94676380 con 0x55cc93ffd000 2023-10-03T19:21:22.457 INFO:teuthology.orchestra.run.smithi045.stdout: -2937> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2092 12.36 12:6dc1a442:::10000000015.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc93f1fc00 con 0x55cc93ffd800 2023-10-03T19:21:22.457 INFO:teuthology.orchestra.run.smithi045.stdout: -2936> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2093 12.38 12:1e20cbdb:::10000000016.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941b9880 con 0x55cc93ffcc00 2023-10-03T19:21:22.458 INFO:teuthology.orchestra.run.smithi045.stdout: -2935> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2094 12.1e 12:78cea7f0:::10000000017.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc940cea80 con 0x55cc93ffd400 2023-10-03T19:21:22.458 INFO:teuthology.orchestra.run.smithi045.stdout: -2934> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2095 12.1a 12:5b3b19a5:::10000000018.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94686000 con 0x55cc93ffd400 2023-10-03T19:21:22.458 INFO:teuthology.orchestra.run.smithi045.stdout: -2933> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2096 12.21 12:86d8200e:::10000000019.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc942ad880 con 0x55cc9410e000 2023-10-03T19:21:22.458 INFO:teuthology.orchestra.run.smithi045.stdout: -2932> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2097 12.20 12:072a8150:::1000000001a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b7d180 con 0x55cc93ffc800 2023-10-03T19:21:22.458 INFO:teuthology.orchestra.run.smithi045.stdout: -2931> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2098 12.8 12:12420902:::1000000001b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b7c700 con 0x55cc93ffdc00 2023-10-03T19:21:22.458 INFO:teuthology.orchestra.run.smithi045.stdout: -2930> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2099 12.16 12:6a54d456:::1000000001c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b4f500 con 0x55cc93ffc400 2023-10-03T19:21:22.458 INFO:teuthology.orchestra.run.smithi045.stdout: -2929> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2100 12.33 12:cf746ac5:::1000000001d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b25880 con 0x55cc93ffcc00 2023-10-03T19:21:22.458 INFO:teuthology.orchestra.run.smithi045.stdout: -2928> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2101 12.32 12:4f7da3cc:::1000000001e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b25500 con 0x55cc93ffdc00 2023-10-03T19:21:22.458 INFO:teuthology.orchestra.run.smithi045.stdout: -2927> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2102 12.3a 12:5f13809d:::1000000001f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9414bc00 con 0x55cc93ffdc00 2023-10-03T19:21:22.458 INFO:teuthology.orchestra.run.smithi045.stdout: -2926> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2103 12.22 12:4503a7ea:::10000000020.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9465c700 con 0x55cc93ffc800 2023-10-03T19:21:22.459 INFO:teuthology.orchestra.run.smithi045.stdout: -2925> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2104 12.b 12:d3d0d483:::10000000021.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9460e000 con 0x55cc93ffdc00 2023-10-03T19:21:22.459 INFO:teuthology.orchestra.run.smithi045.stdout: -2924> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2105 12.b 12:d2626379:::10000000022.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9460f880 con 0x55cc93ffdc00 2023-10-03T19:21:22.459 INFO:teuthology.orchestra.run.smithi045.stdout: -2923> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2106 12.17 12:eb6757d1:::10000000023.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941a6000 con 0x55cc93ffc400 2023-10-03T19:21:22.459 INFO:teuthology.orchestra.run.smithi045.stdout: -2922> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2107 12.2f 12:f6ddf183:::10000000024.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9420d880 con 0x55cc93ffcc00 2023-10-03T19:21:22.459 INFO:teuthology.orchestra.run.smithi045.stdout: -2921> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2108 12.14 12:2a40c2ef:::10000000025.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9465ca80 con 0x55cc93ffd800 2023-10-03T19:21:22.459 INFO:teuthology.orchestra.run.smithi045.stdout: -2920> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2109 12.3d 12:be1922a8:::10000000026.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9413ee00 con 0x55cc9410e000 2023-10-03T19:21:22.459 INFO:teuthology.orchestra.run.smithi045.stdout: -2919> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2110 12.d 12:b0d15537:::10000000027.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9415bc00 con 0x55cc93ffc800 2023-10-03T19:21:22.459 INFO:teuthology.orchestra.run.smithi045.stdout: -2918> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2111 12.1d 12:ba3960b0:::10000000028.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941b8000 con 0x55cc93ffd000 2023-10-03T19:21:22.459 INFO:teuthology.orchestra.run.smithi045.stdout: -2917> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2112 12.18 12:19311010:::10000000029.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94242a80 con 0x55cc9410e000 2023-10-03T19:21:22.459 INFO:teuthology.orchestra.run.smithi045.stdout: -2916> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2113 12.3c 12:3d4c06c4:::1000000002a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9413e000 con 0x55cc93ffd800 2023-10-03T19:21:22.459 INFO:teuthology.orchestra.run.smithi045.stdout: -2915> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2114 12.26 12:645408ac:::1000000002b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc945d8700 con 0x55cc93ffd800 2023-10-03T19:21:23.530 INFO:teuthology.orchestra.run.smithi045.stdout: -2914> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2115 12.25 12:a622384a:::1000000002c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9478f880 con 0x55cc93ffc800 2023-10-03T19:21:23.530 INFO:teuthology.orchestra.run.smithi045.stdout: -2913> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2116 12.26 12:660982fc:::1000000002d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9459f500 con 0x55cc93ffd800 2023-10-03T19:21:23.531 INFO:teuthology.orchestra.run.smithi045.stdout: -2912> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2117 12.12 12:49ffa098:::1000000002e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9460fc00 con 0x55cc93ffdc00 2023-10-03T19:21:23.531 INFO:teuthology.orchestra.run.smithi045.stdout: -2911> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2118 12.23 12:c550f404:::1000000002f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc940cee00 con 0x55cc93ffd000 2023-10-03T19:21:23.531 INFO:teuthology.orchestra.run.smithi045.stdout: -2910> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2119 12.3 12:c1adcc3d:::10000000030.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941b3180 con 0x55cc93ffd000 2023-10-03T19:21:23.531 INFO:teuthology.orchestra.run.smithi045.stdout: -2909> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2120 12.1b 12:d88bb762:::10000000031.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9415a000 con 0x55cc93ffd400 2023-10-03T19:21:23.531 INFO:teuthology.orchestra.run.smithi045.stdout: -2908> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2121 12.31 12:8ea80fc8:::10000000032.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941eae00 con 0x55cc93ffd000 2023-10-03T19:21:23.532 INFO:teuthology.orchestra.run.smithi045.stdout: -2907> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2122 12.3e 12:7e2d0da6:::10000000033.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9415aa80 con 0x55cc93ffd000 2023-10-03T19:21:23.532 INFO:teuthology.orchestra.run.smithi045.stdout: -2906> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2123 12.1 12:81df0dbf:::10000000034.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9414b880 con 0x55cc93ffc400 2023-10-03T19:21:23.532 INFO:teuthology.orchestra.run.smithi045.stdout: -2905> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2124 12.38 12:1e1620c8:::10000000035.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94243880 con 0x55cc93ffcc00 2023-10-03T19:21:23.532 INFO:teuthology.orchestra.run.smithi045.stdout: -2904> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2125 12.2b 12:d747f723:::10000000036.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9413fc00 con 0x55cc93ffd400 2023-10-03T19:21:23.532 INFO:teuthology.orchestra.run.smithi045.stdout: -2903> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2126 12.6 12:60a13eb4:::10000000037.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9460f180 con 0x55cc9410e000 2023-10-03T19:21:23.533 INFO:teuthology.orchestra.run.smithi045.stdout: -2902> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2127 12.26 12:65f9ba37:::10000000038.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9419c380 con 0x55cc93ffd800 2023-10-03T19:21:23.533 INFO:teuthology.orchestra.run.smithi045.stdout: -2901> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2128 12.22 12:44135715:::10000000039.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94452380 con 0x55cc93ffc800 2023-10-03T19:21:23.533 INFO:teuthology.orchestra.run.smithi045.stdout: -2900> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2129 12.f 12:f1a9c549:::1000000003a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc942ad880 con 0x55cc93ffc400 2023-10-03T19:21:23.533 INFO:teuthology.orchestra.run.smithi045.stdout: -2899> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2130 12.3c 12:3c3d7520:::1000000003b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94676380 con 0x55cc93ffd800 2023-10-03T19:21:23.533 INFO:teuthology.orchestra.run.smithi045.stdout: -2898> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2131 12.8 12:12420646:::1000000003c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc945d8000 con 0x55cc93ffdc00 2023-10-03T19:21:23.534 INFO:teuthology.orchestra.run.smithi045.stdout: -2897> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2132 12.6 12:614fee2a:::1000000003d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94734e00 con 0x55cc9410e000 2023-10-03T19:21:23.534 INFO:teuthology.orchestra.run.smithi045.stdout: -2896> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2133 12.2c 12:3665eb52:::1000000003e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9419dc00 con 0x55cc93ffcc00 2023-10-03T19:21:23.534 INFO:teuthology.orchestra.run.smithi045.stdout: -2895> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2134 12.32 12:4ecb6bb7:::1000000003f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc947c7500 con 0x55cc93ffdc00 2023-10-03T19:21:23.534 INFO:teuthology.orchestra.run.smithi045.stdout: -2894> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2135 12.23 12:c6a0a389:::10000000040.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc946d8a80 con 0x55cc93ffd000 2023-10-03T19:21:23.534 INFO:teuthology.orchestra.run.smithi045.stdout: -2893> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2136 12.2b 12:d4b9b687:::10000000041.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941d3880 con 0x55cc93ffd400 2023-10-03T19:21:23.535 INFO:teuthology.orchestra.run.smithi045.stdout: -2892> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2137 12.6 12:61404748:::10000000042.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b4f880 con 0x55cc9410e000 2023-10-03T19:21:23.535 INFO:teuthology.orchestra.run.smithi045.stdout: -2891> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2138 12.16 12:6a415a36:::10000000043.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc940cf880 con 0x55cc93ffc400 2023-10-03T19:21:23.535 INFO:teuthology.orchestra.run.smithi045.stdout: -2890> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2139 12.1a 12:5bd35317:::10000000044.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b4e380 con 0x55cc93ffd400 2023-10-03T19:21:23.535 INFO:teuthology.orchestra.run.smithi045.stdout: -2889> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2140 12.36 12:6f6f8b6e:::10000000045.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b25c00 con 0x55cc93ffd800 2023-10-03T19:21:23.535 INFO:teuthology.orchestra.run.smithi045.stdout: -2888> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2141 12.26 12:678705fb:::10000000046.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9460e700 con 0x55cc93ffd800 2023-10-03T19:21:23.536 INFO:teuthology.orchestra.run.smithi045.stdout: -2887> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2142 12.8 12:1044c7a4:::10000000047.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95baa000 con 0x55cc93ffdc00 2023-10-03T19:21:23.536 INFO:teuthology.orchestra.run.smithi045.stdout: -2886> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2143 12.12 12:4899516f:::10000000048.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95baae00 con 0x55cc93ffdc00 2023-10-03T19:21:23.536 INFO:teuthology.orchestra.run.smithi045.stdout: -2885> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2144 12.7 12:e2d50132:::10000000049.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95c28e00 con 0x55cc9410e000 2023-10-03T19:21:23.536 INFO:teuthology.orchestra.run.smithi045.stdout: -2884> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2145 12.2f 12:f7911ae7:::1000000004a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9421a000 con 0x55cc93ffcc00 2023-10-03T19:21:23.536 INFO:teuthology.orchestra.run.smithi045.stdout: -2883> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2146 12.31 12:8e5cc622:::1000000004b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b7ce00 con 0x55cc93ffd000 2023-10-03T19:21:23.537 INFO:teuthology.orchestra.run.smithi045.stdout: -2882> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2147 12.21 12:844eae9e:::1000000004c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9420dc00 con 0x55cc9410e000 2023-10-03T19:21:23.537 INFO:teuthology.orchestra.run.smithi045.stdout: -2881> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2148 12.36 12:6c82bb73:::1000000004d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9420c000 con 0x55cc93ffd800 2023-10-03T19:21:23.537 INFO:teuthology.orchestra.run.smithi045.stdout: -2880> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2149 12.29 12:954bc910:::1000000004e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b4fc00 con 0x55cc93ffd400 2023-10-03T19:21:23.537 INFO:teuthology.orchestra.run.smithi045.stdout: -2879> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2150 12.21 12:8660ae9f:::1000000004f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95bfe380 con 0x55cc9410e000 2023-10-03T19:21:23.537 INFO:teuthology.orchestra.run.smithi045.stdout: -2878> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2151 12.16 12:69de5632:::10000000050.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b24700 con 0x55cc93ffc400 2023-10-03T19:21:23.538 INFO:teuthology.orchestra.run.smithi045.stdout: -2877> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2152 12.19 12:9ae7aaf4:::10000000051.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b24000 con 0x55cc93ffd000 2023-10-03T19:21:23.538 INFO:teuthology.orchestra.run.smithi045.stdout: -2876> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2153 12.b 12:d30f9a54:::10000000052.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b4f180 con 0x55cc93ffdc00 2023-10-03T19:21:23.538 INFO:teuthology.orchestra.run.smithi045.stdout: -2875> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2154 12.16 12:6a23747e:::10000000053.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94243500 con 0x55cc93ffc400 2023-10-03T19:21:23.538 INFO:teuthology.orchestra.run.smithi045.stdout: -2874> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2155 12.0 12:03de5254:::10000000054.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9421bc00 con 0x55cc93ffd400 2023-10-03T19:21:23.538 INFO:teuthology.orchestra.run.smithi045.stdout: -2873> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2156 12.32 12:4d757255:::10000000055.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94203c00 con 0x55cc93ffdc00 2023-10-03T19:21:23.539 INFO:teuthology.orchestra.run.smithi045.stdout: -2872> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2157 12.28 12:166e0f51:::10000000056.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95bd4000 con 0x55cc93ffd000 2023-10-03T19:21:23.539 INFO:teuthology.orchestra.run.smithi045.stdout: -2871> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2158 12.2e 12:74dc0bdf:::10000000057.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94203500 con 0x55cc9410e000 2023-10-03T19:21:23.539 INFO:teuthology.orchestra.run.smithi045.stdout: -2870> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2159 12.14 12:2b0a3bc5:::10000000058.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b7ca80 con 0x55cc93ffd800 2023-10-03T19:21:23.539 INFO:teuthology.orchestra.run.smithi045.stdout: -2869> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2160 12.31 12:8ff022d2:::10000000059.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc93f1f880 con 0x55cc93ffd000 2023-10-03T19:21:23.539 INFO:teuthology.orchestra.run.smithi045.stdout: -2868> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2161 12.18 12:1ae6cdf3:::1000000005a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc93117180 con 0x55cc9410e000 2023-10-03T19:21:23.540 INFO:teuthology.orchestra.run.smithi045.stdout: -2867> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2162 12.39 12:9fc48627:::1000000005b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc93f1e000 con 0x55cc93ffc400 2023-10-03T19:21:23.540 INFO:teuthology.orchestra.run.smithi045.stdout: -2866> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2163 12.30 12:0cbf7f79:::1000000005c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b4e000 con 0x55cc93ffc800 2023-10-03T19:21:23.540 INFO:teuthology.orchestra.run.smithi045.stdout: -2865> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2164 12.2d 12:b5236558:::1000000005d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9415a380 con 0x55cc93ffdc00 2023-10-03T19:21:23.540 INFO:teuthology.orchestra.run.smithi045.stdout: -2864> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2165 12.21 12:870ac4b3:::1000000005e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94734a80 con 0x55cc9410e000 2023-10-03T19:21:23.540 INFO:teuthology.orchestra.run.smithi045.stdout: -2863> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2166 12.2c 12:34658595:::1000000005f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9419d880 con 0x55cc93ffcc00 2023-10-03T19:21:23.540 INFO:teuthology.orchestra.run.smithi045.stdout: -2862> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2167 12.3 12:c001b242:::10000000060.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9419c700 con 0x55cc93ffd000 2023-10-03T19:21:23.541 INFO:teuthology.orchestra.run.smithi045.stdout: -2861> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2168 12.0 12:0181e5f0:::10000000061.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94260a80 con 0x55cc93ffd400 2023-10-03T19:21:23.541 INFO:teuthology.orchestra.run.smithi045.stdout: -2860> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2169 12.30 12:0d373645:::10000000062.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9465d880 con 0x55cc93ffc800 2023-10-03T19:21:23.541 INFO:teuthology.orchestra.run.smithi045.stdout: -2859> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2170 12.26 12:66f1e28f:::10000000063.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94202000 con 0x55cc93ffd800 2023-10-03T19:21:23.541 INFO:teuthology.orchestra.run.smithi045.stdout: -2858> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2171 12.20 12:0699973a:::10000000064.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9413ea80 con 0x55cc93ffc800 2023-10-03T19:21:23.542 INFO:teuthology.orchestra.run.smithi045.stdout: -2857> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2172 12.f 12:f2d196a0:::10000000065.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9415b180 con 0x55cc93ffc400 2023-10-03T19:21:23.542 INFO:teuthology.orchestra.run.smithi045.stdout: -2856> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2173 12.38 12:1cab634c:::10000000066.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94735880 con 0x55cc93ffcc00 2023-10-03T19:21:23.542 INFO:teuthology.orchestra.run.smithi045.stdout: -2855> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2174 12.37 12:ef5f0c51:::10000000067.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc946b2000 con 0x55cc93ffd400 2023-10-03T19:21:23.542 INFO:teuthology.orchestra.run.smithi045.stdout: -2854> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2175 12.1c 12:3b87fee9:::10000000068.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b24a80 con 0x55cc93ffd000 2023-10-03T19:21:23.542 INFO:teuthology.orchestra.run.smithi045.stdout: -2853> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2176 12.3 12:c2cd23b6:::10000000069.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95c29c00 con 0x55cc93ffd000 2023-10-03T19:21:23.543 INFO:teuthology.orchestra.run.smithi045.stdout: -2852> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2177 12.c 12:31e782ee:::1000000006a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95c29500 con 0x55cc93ffd000 2023-10-03T19:21:23.543 INFO:teuthology.orchestra.run.smithi045.stdout: -2851> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2178 12.1d 12:bbf235fa:::1000000006b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95c28380 con 0x55cc93ffd000 2023-10-03T19:21:23.543 INFO:teuthology.orchestra.run.smithi045.stdout: -2850> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2179 12.2b 12:d50f8d72:::1000000006c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95c28000 con 0x55cc93ffd400 2023-10-03T19:21:23.543 INFO:teuthology.orchestra.run.smithi045.stdout: -2849> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2180 12.37 12:eeccecf9:::1000000006d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95bff880 con 0x55cc93ffd400 2023-10-03T19:21:23.543 INFO:teuthology.orchestra.run.smithi045.stdout: -2848> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2181 12.11 12:88725faf:::1000000006e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95bff180 con 0x55cc93ffd800 2023-10-03T19:21:23.544 INFO:teuthology.orchestra.run.smithi045.stdout: -2847> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2182 12.21 12:862b00fc:::1000000006f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95bd5180 con 0x55cc9410e000 2023-10-03T19:21:23.544 INFO:teuthology.orchestra.run.smithi045.stdout: -2846> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2183 12.1d 12:b941cebe:::10000000070.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95bd4a80 con 0x55cc93ffd000 2023-10-03T19:21:23.544 INFO:teuthology.orchestra.run.smithi045.stdout: -2845> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2184 12.10 12:0b002978:::10000000071.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b7dc00 con 0x55cc93ffd000 2023-10-03T19:21:23.544 INFO:teuthology.orchestra.run.smithi045.stdout: -2844> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2185 12.2e 12:74d940fa:::10000000072.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b7c380 con 0x55cc9410e000 2023-10-03T19:21:23.544 INFO:teuthology.orchestra.run.smithi045.stdout: -2843> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2186 12.e 12:730aba89:::10000000073.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b4ee00 con 0x55cc93ffd000 2023-10-03T19:21:23.544 INFO:teuthology.orchestra.run.smithi045.stdout: -2842> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2187 12.22 12:46f2014a:::10000000074.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b4e700 con 0x55cc93ffc800 2023-10-03T19:21:23.545 INFO:teuthology.orchestra.run.smithi045.stdout: -2841> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2188 12.4 12:2045e544:::10000000075.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95bd4e00 con 0x55cc93ffc400 2023-10-03T19:21:23.545 INFO:teuthology.orchestra.run.smithi045.stdout: -2840> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2189 12.13 12:ca508270:::10000000076.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95bd4380 con 0x55cc9410e000 2023-10-03T19:21:23.545 INFO:teuthology.orchestra.run.smithi045.stdout: -2839> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2190 12.1d 12:bab01cd9:::10000000077.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95baaa80 con 0x55cc93ffd000 2023-10-03T19:21:23.545 INFO:teuthology.orchestra.run.smithi045.stdout: -2838> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2191 12.38 12:1da7f472:::10000000078.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95baa700 con 0x55cc93ffcc00 2023-10-03T19:21:23.545 INFO:teuthology.orchestra.run.smithi045.stdout: -2837> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2192 12.19 12:99ec5763:::10000000079.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95baa380 con 0x55cc93ffd000 2023-10-03T19:21:23.545 INFO:teuthology.orchestra.run.smithi045.stdout: -2836> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2193 12.2 12:4211db15:::1000000007a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95bab180 con 0x55cc93ffd400 2023-10-03T19:21:23.546 INFO:teuthology.orchestra.run.smithi045.stdout: -2835> 2023-10-03T19:18:12.081+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2194 12.a 12:51fb4558:::1000000007b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b24e00 con 0x55cc93ffcc00 2023-10-03T19:21:23.546 INFO:teuthology.orchestra.run.smithi045.stdout: -2834> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2195 12.1d 12:bb142d16:::1000000007c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b7c000 con 0x55cc93ffd000 2023-10-03T19:21:23.546 INFO:teuthology.orchestra.run.smithi045.stdout: -2833> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2196 12.1e 12:7ab9e14a:::1000000007d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95bfe000 con 0x55cc93ffd400 2023-10-03T19:21:23.546 INFO:teuthology.orchestra.run.smithi045.stdout: -2832> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2197 12.3d 12:bf02216c:::1000000007e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b4ea80 con 0x55cc9410e000 2023-10-03T19:21:23.546 INFO:teuthology.orchestra.run.smithi045.stdout: -2831> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2198 12.30 12:0ffe11ed:::1000000007f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94734000 con 0x55cc93ffc800 2023-10-03T19:21:23.546 INFO:teuthology.orchestra.run.smithi045.stdout: -2830> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2199 12.30 12:0f444cf3:::10000000080.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95babc00 con 0x55cc93ffc800 2023-10-03T19:21:23.547 INFO:teuthology.orchestra.run.smithi045.stdout: -2829> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2200 12.3 12:c27cb132:::10000000081.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95bfea80 con 0x55cc93ffd000 2023-10-03T19:21:23.547 INFO:teuthology.orchestra.run.smithi045.stdout: -2828> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2201 12.39 12:9eab5bef:::10000000082.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94677880 con 0x55cc93ffc400 2023-10-03T19:21:23.547 INFO:teuthology.orchestra.run.smithi045.stdout: -2827> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2202 12.26 12:67d353d7:::10000000083.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9414b180 con 0x55cc93ffd800 2023-10-03T19:21:23.547 INFO:teuthology.orchestra.run.smithi045.stdout: -2826> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2203 12.4 12:21b748bd:::10000000084.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9460f500 con 0x55cc93ffc400 2023-10-03T19:21:23.547 INFO:teuthology.orchestra.run.smithi045.stdout: -2825> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2204 12.10 12:0a074d4e:::10000000085.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95c29880 con 0x55cc93ffd000 2023-10-03T19:21:23.547 INFO:teuthology.orchestra.run.smithi045.stdout: -2824> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2205 12.2e 12:74218cdb:::10000000086.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94187500 con 0x55cc9410e000 2023-10-03T19:21:23.548 INFO:teuthology.orchestra.run.smithi045.stdout: -2823> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2206 12.8 12:10a36097:::10000000087.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9420c700 con 0x55cc93ffdc00 2023-10-03T19:21:23.548 INFO:teuthology.orchestra.run.smithi045.stdout: -2822> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2207 12.2f 12:f7140720:::10000000088.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94192e00 con 0x55cc93ffcc00 2023-10-03T19:21:23.548 INFO:teuthology.orchestra.run.smithi045.stdout: -2821> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2208 12.34 12:2e115d36:::10000000089.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc947c6000 con 0x55cc93ffd800 2023-10-03T19:21:23.548 INFO:teuthology.orchestra.run.smithi045.stdout: -2820> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2209 12.35 12:ae88c9e9:::1000000008a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94203180 con 0x55cc93ffd000 2023-10-03T19:21:23.548 INFO:teuthology.orchestra.run.smithi045.stdout: -2819> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2210 12.8 12:13275b8b:::1000000008b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94624000 con 0x55cc93ffdc00 2023-10-03T19:21:23.549 INFO:teuthology.orchestra.run.smithi045.stdout: -2818> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2211 12.3c 12:3c2e7968:::1000000008c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b7d880 con 0x55cc93ffd800 2023-10-03T19:21:23.549 INFO:teuthology.orchestra.run.smithi045.stdout: -2817> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2212 12.26 12:67acbfb4:::1000000008d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95bab880 con 0x55cc93ffd800 2023-10-03T19:21:23.549 INFO:teuthology.orchestra.run.smithi045.stdout: -2816> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2213 12.36 12:6cf8d55a:::1000000008e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95bd5c00 con 0x55cc93ffd800 2023-10-03T19:21:23.549 INFO:teuthology.orchestra.run.smithi045.stdout: -2815> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2214 12.2d 12:b6d5679c:::1000000008f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95bffc00 con 0x55cc93ffdc00 2023-10-03T19:21:23.549 INFO:teuthology.orchestra.run.smithi045.stdout: -2814> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2215 12.23 12:c454cd7f:::10000000090.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc947d9180 con 0x55cc93ffd000 2023-10-03T19:21:23.549 INFO:teuthology.orchestra.run.smithi045.stdout: -2813> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2216 12.14 12:2b22960d:::10000000091.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94186700 con 0x55cc93ffd800 2023-10-03T19:21:23.550 INFO:teuthology.orchestra.run.smithi045.stdout: -2812> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2217 12.c 12:317b49a4:::10000000092.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9460ea80 con 0x55cc93ffd000 2023-10-03T19:21:23.550 INFO:teuthology.orchestra.run.smithi045.stdout: -2811> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2218 12.c 12:30dd2ab9:::10000000093.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94258e00 con 0x55cc93ffd000 2023-10-03T19:21:23.550 INFO:teuthology.orchestra.run.smithi045.stdout: -2810> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2219 12.13 12:c844618d:::10000000094.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc942ace00 con 0x55cc9410e000 2023-10-03T19:21:23.550 INFO:teuthology.orchestra.run.smithi045.stdout: -2809> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2220 12.12 12:4aa41a21:::10000000095.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9420d180 con 0x55cc93ffdc00 2023-10-03T19:21:23.550 INFO:teuthology.orchestra.run.smithi045.stdout: -2808> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2221 12.33 12:cee3daff:::10000000096.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc947c7880 con 0x55cc93ffcc00 2023-10-03T19:21:23.551 INFO:teuthology.orchestra.run.smithi045.stdout: -2807> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2222 12.3f 12:fc8be962:::10000000097.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941ea700 con 0x55cc93ffc800 2023-10-03T19:21:23.551 INFO:teuthology.orchestra.run.smithi045.stdout: -2806> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2223 12.2e 12:77d1cb76:::10000000098.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94734700 con 0x55cc9410e000 2023-10-03T19:21:23.551 INFO:teuthology.orchestra.run.smithi045.stdout: -2805> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2224 12.32 12:4e69e568:::10000000099.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94771c00 con 0x55cc93ffdc00 2023-10-03T19:21:23.551 INFO:teuthology.orchestra.run.smithi045.stdout: -2804> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2225 12.0 12:03c4ee74:::1000000009a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95c28700 con 0x55cc93ffd400 2023-10-03T19:21:23.551 INFO:teuthology.orchestra.run.smithi045.stdout: -2803> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2226 12.37 12:eccff461:::1000000009b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95c28a80 con 0x55cc93ffd400 2023-10-03T19:21:23.552 INFO:teuthology.orchestra.run.smithi045.stdout: -2802> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2227 12.36 12:6c8b6cb2:::1000000009c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95c29180 con 0x55cc93ffd800 2023-10-03T19:21:23.552 INFO:teuthology.orchestra.run.smithi045.stdout: -2801> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2228 12.36 12:6f6a1eb0:::1000000009d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95bfe700 con 0x55cc93ffd800 2023-10-03T19:21:23.552 INFO:teuthology.orchestra.run.smithi045.stdout: -2800> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2229 12.e 12:70913c6f:::1000000009e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95bfee00 con 0x55cc93ffd000 2023-10-03T19:21:23.552 INFO:teuthology.orchestra.run.smithi045.stdout: -2799> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2230 12.33 12:cf652552:::1000000009f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95bff500 con 0x55cc93ffcc00 2023-10-03T19:21:23.552 INFO:teuthology.orchestra.run.smithi045.stdout: -2798> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2231 12.2b 12:d4ac5e36:::100000000a0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95bd5500 con 0x55cc93ffd400 2023-10-03T19:21:23.552 INFO:teuthology.orchestra.run.smithi045.stdout: -2797> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2232 12.4 12:23d81b1d:::100000000a1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95bd4700 con 0x55cc93ffc400 2023-10-03T19:21:23.552 INFO:teuthology.orchestra.run.smithi045.stdout: -2796> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2233 12.2a 12:5644b0dd:::100000000a2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95bab500 con 0x55cc93ffcc00 2023-10-03T19:21:23.553 INFO:teuthology.orchestra.run.smithi045.stdout: -2795> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2234 12.14 12:2800edac:::100000000a3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9478e380 con 0x55cc93ffd800 2023-10-03T19:21:23.553 INFO:teuthology.orchestra.run.smithi045.stdout: -2794> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2235 12.c 12:33682534:::100000000a4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc942b7180 con 0x55cc93ffd000 2023-10-03T19:21:23.553 INFO:teuthology.orchestra.run.smithi045.stdout: -2793> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2236 12.1c 12:3948beee:::100000000a5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941b8a80 con 0x55cc93ffd000 2023-10-03T19:21:23.553 INFO:teuthology.orchestra.run.smithi045.stdout: -2792> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2237 12.1 12:82c5dbfa:::100000000a6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94186000 con 0x55cc93ffc400 2023-10-03T19:21:23.553 INFO:teuthology.orchestra.run.smithi045.stdout: -2791> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2238 12.2d 12:b683ac1f:::100000000a7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94203880 con 0x55cc93ffdc00 2023-10-03T19:21:23.553 INFO:teuthology.orchestra.run.smithi045.stdout: -2790> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2239 12.33 12:cf66c3a3:::100000000a8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9413f500 con 0x55cc93ffcc00 2023-10-03T19:21:23.554 INFO:teuthology.orchestra.run.smithi045.stdout: -2789> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2240 12.12 12:496373b3:::100000000a9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9413f880 con 0x55cc93ffdc00 2023-10-03T19:21:23.554 INFO:teuthology.orchestra.run.smithi045.stdout: -2788> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2241 12.3b 12:dfd961c9:::100000000aa.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9419d500 con 0x55cc93ffcc00 2023-10-03T19:21:23.554 INFO:teuthology.orchestra.run.smithi045.stdout: -2787> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2242 12.28 12:16ce2f56:::100000000ab.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc946d9500 con 0x55cc93ffd000 2023-10-03T19:21:23.554 INFO:teuthology.orchestra.run.smithi045.stdout: -2786> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2243 12.26 12:65e71c10:::100000000ac.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc946d9180 con 0x55cc93ffd800 2023-10-03T19:21:23.554 INFO:teuthology.orchestra.run.smithi045.stdout: -2785> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2244 12.3c 12:3ca8796c:::100000000ad.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc946d8700 con 0x55cc93ffd800 2023-10-03T19:21:23.554 INFO:teuthology.orchestra.run.smithi045.stdout: -2784> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2245 12.2b 12:d77b40aa:::100000000ae.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94243180 con 0x55cc93ffd400 2023-10-03T19:21:23.555 INFO:teuthology.orchestra.run.smithi045.stdout: -2783> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2246 12.8 12:12260154:::100000000af.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94243c00 con 0x55cc93ffdc00 2023-10-03T19:21:23.555 INFO:teuthology.orchestra.run.smithi045.stdout: -2782> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2247 12.19 12:99a6d8b2:::100000000b0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9459f180 con 0x55cc93ffd000 2023-10-03T19:21:23.555 INFO:teuthology.orchestra.run.smithi045.stdout: -2781> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2248 12.25 12:a4b351a2:::100000000b1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941a7500 con 0x55cc93ffc800 2023-10-03T19:21:23.555 INFO:teuthology.orchestra.run.smithi045.stdout: -2780> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2249 12.20 12:05e903ec:::100000000b2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc946b2e00 con 0x55cc93ffc800 2023-10-03T19:21:23.555 INFO:teuthology.orchestra.run.smithi045.stdout: -2779> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2250 12.1d 12:bbfd17d2:::100000000b3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94625c00 con 0x55cc93ffd000 2023-10-03T19:21:23.555 INFO:teuthology.orchestra.run.smithi045.stdout: -2778> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2251 12.3f 12:fc47e501:::100000000b4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94192000 con 0x55cc93ffc800 2023-10-03T19:21:23.555 INFO:teuthology.orchestra.run.smithi045.stdout: -2777> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2252 12.29 12:959d3147:::100000000b5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc942ac000 con 0x55cc93ffd400 2023-10-03T19:21:23.556 INFO:teuthology.orchestra.run.smithi045.stdout: -2776> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2253 12.21 12:869f8614:::100000000b6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9488c000 con 0x55cc9410e000 2023-10-03T19:21:23.556 INFO:teuthology.orchestra.run.smithi045.stdout: -2775> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2254 12.13 12:c826941c:::100000000b7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9488c380 con 0x55cc9410e000 2023-10-03T19:21:23.556 INFO:teuthology.orchestra.run.smithi045.stdout: -2774> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2255 12.23 12:c7a7e7ed:::100000000b8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9488c700 con 0x55cc93ffd000 2023-10-03T19:21:23.556 INFO:teuthology.orchestra.run.smithi045.stdout: -2773> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2256 12.2a 12:576d20de:::100000000b9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9488ca80 con 0x55cc93ffcc00 2023-10-03T19:21:23.556 INFO:teuthology.orchestra.run.smithi045.stdout: -2772> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2257 12.28 12:14bef4b2:::100000000ba.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9488ce00 con 0x55cc93ffd000 2023-10-03T19:21:23.556 INFO:teuthology.orchestra.run.smithi045.stdout: -2771> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2258 12.4 12:21fe71c4:::100000000bb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9488d180 con 0x55cc93ffc400 2023-10-03T19:21:23.557 INFO:teuthology.orchestra.run.smithi045.stdout: -2770> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2259 12.1d 12:ba036218:::100000000bc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9488d500 con 0x55cc93ffd000 2023-10-03T19:21:23.557 INFO:teuthology.orchestra.run.smithi045.stdout: -2769> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2260 12.2 12:43b4b389:::100000000bd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9488d880 con 0x55cc93ffd400 2023-10-03T19:21:23.557 INFO:teuthology.orchestra.run.smithi045.stdout: -2768> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2261 12.18 12:196d4b2b:::100000000be.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9488dc00 con 0x55cc9410e000 2023-10-03T19:21:23.557 INFO:teuthology.orchestra.run.smithi045.stdout: -2767> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2262 12.2f 12:f46eb3ed:::100000000bf.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9414c000 con 0x55cc93ffcc00 2023-10-03T19:21:23.557 INFO:teuthology.orchestra.run.smithi045.stdout: -2766> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2263 12.2 12:42142be5:::100000000c0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9414c380 con 0x55cc93ffd400 2023-10-03T19:21:23.557 INFO:teuthology.orchestra.run.smithi045.stdout: -2765> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2264 12.18 12:18cb83ce:::100000000c1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9414c700 con 0x55cc9410e000 2023-10-03T19:21:23.557 INFO:teuthology.orchestra.run.smithi045.stdout: -2764> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2265 12.36 12:6c9ae960:::100000000c2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9414ca80 con 0x55cc93ffd800 2023-10-03T19:21:23.558 INFO:teuthology.orchestra.run.smithi045.stdout: -2763> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2266 12.1f 12:f8d20c92:::100000000c3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9414ce00 con 0x55cc93ffc400 2023-10-03T19:21:23.558 INFO:teuthology.orchestra.run.smithi045.stdout: -2762> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2267 12.1c 12:3990871b:::100000000c4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9414d180 con 0x55cc93ffd000 2023-10-03T19:21:23.558 INFO:teuthology.orchestra.run.smithi045.stdout: -2761> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2268 12.16 12:680c46c7:::100000000c5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9414d500 con 0x55cc93ffc400 2023-10-03T19:21:23.558 INFO:teuthology.orchestra.run.smithi045.stdout: -2760> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2269 12.17 12:eb7dd551:::100000000c6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9414d880 con 0x55cc93ffc400 2023-10-03T19:21:23.558 INFO:teuthology.orchestra.run.smithi045.stdout: -2759> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2270 12.36 12:6e30e37c:::100000000c7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9414dc00 con 0x55cc93ffd800 2023-10-03T19:21:23.558 INFO:teuthology.orchestra.run.smithi045.stdout: -2758> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2271 12.f 12:f28dc9ad:::100000000c8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941ba000 con 0x55cc93ffc400 2023-10-03T19:21:23.558 INFO:teuthology.orchestra.run.smithi045.stdout: -2757> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2272 12.11 12:8a614455:::100000000c9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941ba380 con 0x55cc93ffd800 2023-10-03T19:21:23.558 INFO:teuthology.orchestra.run.smithi045.stdout: -2756> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2273 12.2 12:418539fe:::100000000ca.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941ba700 con 0x55cc93ffd400 2023-10-03T19:21:23.558 INFO:teuthology.orchestra.run.smithi045.stdout: -2755> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2274 12.3a 12:5e2665ab:::100000000cb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941baa80 con 0x55cc93ffdc00 2023-10-03T19:21:23.558 INFO:teuthology.orchestra.run.smithi045.stdout: -2754> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2275 12.3e 12:7db06380:::100000000cc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941bae00 con 0x55cc93ffd000 2023-10-03T19:21:23.559 INFO:teuthology.orchestra.run.smithi045.stdout: -2753> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2276 12.33 12:cc35cb30:::100000000cd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941bb180 con 0x55cc93ffcc00 2023-10-03T19:21:23.559 INFO:teuthology.orchestra.run.smithi045.stdout: -2752> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2277 12.11 12:89a13bde:::100000000ce.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941bb500 con 0x55cc93ffd800 2023-10-03T19:21:23.559 INFO:teuthology.orchestra.run.smithi045.stdout: -2751> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2278 12.19 12:9baaf7f1:::100000000cf.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941bb880 con 0x55cc93ffd000 2023-10-03T19:21:23.559 INFO:teuthology.orchestra.run.smithi045.stdout: -2750> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2279 12.1b 12:d9cb565c:::100000000d0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941bbc00 con 0x55cc93ffd400 2023-10-03T19:21:23.559 INFO:teuthology.orchestra.run.smithi045.stdout: -2749> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2280 12.5 12:a391cf2b:::100000000d1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941de000 con 0x55cc93ffc400 2023-10-03T19:21:23.559 INFO:teuthology.orchestra.run.smithi045.stdout: -2748> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2281 12.38 12:1e907e28:::100000000d2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941de380 con 0x55cc93ffcc00 2023-10-03T19:21:23.559 INFO:teuthology.orchestra.run.smithi045.stdout: -2747> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2282 12.17 12:e88d3223:::100000000d3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941de700 con 0x55cc93ffc400 2023-10-03T19:21:23.559 INFO:teuthology.orchestra.run.smithi045.stdout: -2746> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2283 12.b 12:d02f84b5:::100000000d4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941dea80 con 0x55cc93ffdc00 2023-10-03T19:21:23.559 INFO:teuthology.orchestra.run.smithi045.stdout: -2745> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2284 12.29 12:963c36ab:::100000000d5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941dee00 con 0x55cc93ffd400 2023-10-03T19:21:24.029 INFO:teuthology.orchestra.run.smithi045.stdout: -2744> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2285 12.1c 12:38569cab:::100000000d6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941df180 con 0x55cc93ffd000 2023-10-03T19:21:24.029 INFO:teuthology.orchestra.run.smithi045.stdout: -2743> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2286 12.18 12:1bd5bb9e:::100000000d7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941df500 con 0x55cc9410e000 2023-10-03T19:21:24.030 INFO:teuthology.orchestra.run.smithi045.stdout: -2742> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2287 12.1e 12:7b9ba906:::100000000d8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941df880 con 0x55cc93ffd400 2023-10-03T19:21:24.030 INFO:teuthology.orchestra.run.smithi045.stdout: -2741> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2288 12.10 12:09e2658b:::100000000d9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941dfc00 con 0x55cc93ffd000 2023-10-03T19:21:24.030 INFO:teuthology.orchestra.run.smithi045.stdout: -2740> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2289 12.21 12:84e04a5a:::100000000da.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94162000 con 0x55cc9410e000 2023-10-03T19:21:24.030 INFO:teuthology.orchestra.run.smithi045.stdout: -2739> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2290 12.15 12:aa9378d8:::100000000db.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94162380 con 0x55cc93ffc400 2023-10-03T19:21:24.030 INFO:teuthology.orchestra.run.smithi045.stdout: -2738> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2291 12.13 12:c84cd983:::100000000dc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94162700 con 0x55cc9410e000 2023-10-03T19:21:24.030 INFO:teuthology.orchestra.run.smithi045.stdout: -2737> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2292 12.26 12:65f6e386:::100000000dd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94162a80 con 0x55cc93ffd800 2023-10-03T19:21:24.031 INFO:teuthology.orchestra.run.smithi045.stdout: -2736> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2293 12.f 12:f1207765:::100000000de.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94162e00 con 0x55cc93ffc400 2023-10-03T19:21:24.031 INFO:teuthology.orchestra.run.smithi045.stdout: -2735> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2294 12.2f 12:f71b5472:::100000000df.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94163180 con 0x55cc93ffcc00 2023-10-03T19:21:24.031 INFO:teuthology.orchestra.run.smithi045.stdout: -2734> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2295 12.3 12:c239e8b3:::100000000e0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94163500 con 0x55cc93ffd000 2023-10-03T19:21:24.031 INFO:teuthology.orchestra.run.smithi045.stdout: -2733> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2296 12.17 12:eba7c799:::100000000e1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94163880 con 0x55cc93ffc400 2023-10-03T19:21:24.031 INFO:teuthology.orchestra.run.smithi045.stdout: -2732> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2297 12.12 12:4a996524:::100000000e2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94163c00 con 0x55cc93ffdc00 2023-10-03T19:21:24.032 INFO:teuthology.orchestra.run.smithi045.stdout: -2731> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2298 12.1f 12:f93d8c0a:::100000000e3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95baa700 con 0x55cc93ffc400 2023-10-03T19:21:24.032 INFO:teuthology.orchestra.run.smithi045.stdout: -2730> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2299 12.39 12:9c66f7cb:::100000000e4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94735c00 con 0x55cc93ffc400 2023-10-03T19:21:24.032 INFO:teuthology.orchestra.run.smithi045.stdout: -2729> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2300 12.1d 12:bba66d05:::100000000e5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94735880 con 0x55cc93ffd000 2023-10-03T19:21:24.032 INFO:teuthology.orchestra.run.smithi045.stdout: -2728> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2301 12.39 12:9de3e889:::100000000e6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9419d180 con 0x55cc93ffc400 2023-10-03T19:21:24.032 INFO:teuthology.orchestra.run.smithi045.stdout: -2727> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2302 12.36 12:6c62f82b:::100000000e7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9419dc00 con 0x55cc93ffd800 2023-10-03T19:21:24.032 INFO:teuthology.orchestra.run.smithi045.stdout: -2726> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2303 12.1b 12:dba0574f:::100000000e8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9419d880 con 0x55cc93ffd400 2023-10-03T19:21:24.033 INFO:teuthology.orchestra.run.smithi045.stdout: -2725> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2304 12.4 12:235bfa30:::100000000e9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9421a000 con 0x55cc93ffc400 2023-10-03T19:21:24.033 INFO:teuthology.orchestra.run.smithi045.stdout: -2724> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2305 12.2a 12:54beb349:::100000000ea.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94243880 con 0x55cc93ffcc00 2023-10-03T19:21:24.033 INFO:teuthology.orchestra.run.smithi045.stdout: -2723> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2306 12.5 12:a3215264:::100000000eb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9420d880 con 0x55cc93ffc400 2023-10-03T19:21:24.033 INFO:teuthology.orchestra.run.smithi045.stdout: -2722> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2307 12.4 12:20ceeb1e:::100000000ec.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b24380 con 0x55cc93ffc400 2023-10-03T19:21:24.033 INFO:teuthology.orchestra.run.smithi045.stdout: -2721> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2308 12.1d 12:b9cee72b:::100000000ed.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b25180 con 0x55cc93ffd000 2023-10-03T19:21:24.034 INFO:teuthology.orchestra.run.smithi045.stdout: -2720> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2309 12.30 12:0c88ada4:::100000000ee.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b25880 con 0x55cc93ffc800 2023-10-03T19:21:24.034 INFO:teuthology.orchestra.run.smithi045.stdout: -2719> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2310 12.13 12:c8202536:::100000000ef.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941b9880 con 0x55cc9410e000 2023-10-03T19:21:24.034 INFO:teuthology.orchestra.run.smithi045.stdout: -2718> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2311 12.37 12:ef416527:::100000000f0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc93f1e380 con 0x55cc93ffd400 2023-10-03T19:21:24.034 INFO:teuthology.orchestra.run.smithi045.stdout: -2717> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2312 12.3f 12:fea3f43b:::100000000f1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc93f1fc00 con 0x55cc93ffc800 2023-10-03T19:21:24.034 INFO:teuthology.orchestra.run.smithi045.stdout: -2716> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2313 12.33 12:cff7f4bd:::100000000f2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941d3500 con 0x55cc93ffcc00 2023-10-03T19:21:24.034 INFO:teuthology.orchestra.run.smithi045.stdout: -2715> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2314 12.d 12:b0cc5b52:::100000000f3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95bd5880 con 0x55cc93ffc800 2023-10-03T19:21:24.035 INFO:teuthology.orchestra.run.smithi045.stdout: -2714> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2315 12.13 12:c97f6a48:::100000000f4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9413e700 con 0x55cc9410e000 2023-10-03T19:21:24.035 INFO:teuthology.orchestra.run.smithi045.stdout: -2713> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2316 12.2b 12:d6a65225:::100000000f5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9414a380 con 0x55cc93ffd400 2023-10-03T19:21:24.035 INFO:teuthology.orchestra.run.smithi045.stdout: -2712> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2317 12.b 12:d1f1a6ab:::100000000f6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9414a700 con 0x55cc93ffdc00 2023-10-03T19:21:24.035 INFO:teuthology.orchestra.run.smithi045.stdout: -2711> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2318 12.12 12:482fe7bc:::100000000f7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc946d8380 con 0x55cc93ffdc00 2023-10-03T19:21:24.035 INFO:teuthology.orchestra.run.smithi045.stdout: -2710> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2319 12.1f 12:fa69016c:::100000000f8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc946d8e00 con 0x55cc93ffc400 2023-10-03T19:21:24.035 INFO:teuthology.orchestra.run.smithi045.stdout: -2709> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2320 12.f 12:f264201d:::100000000f9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94202000 con 0x55cc93ffc400 2023-10-03T19:21:24.036 INFO:teuthology.orchestra.run.smithi045.stdout: -2708> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2321 12.2e 12:752cd5de:::100000000fa.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b7ca80 con 0x55cc9410e000 2023-10-03T19:21:24.036 INFO:teuthology.orchestra.run.smithi045.stdout: -2707> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2322 12.0 12:00b77ae3:::100000000fb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9420c000 con 0x55cc93ffd400 2023-10-03T19:21:24.036 INFO:teuthology.orchestra.run.smithi045.stdout: -2706> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2323 12.36 12:6dd545dc:::100000000fc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9460e700 con 0x55cc93ffd800 2023-10-03T19:21:24.036 INFO:teuthology.orchestra.run.smithi045.stdout: -2705> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2324 12.2d 12:b6610622:::100000000fd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b24e00 con 0x55cc93ffdc00 2023-10-03T19:21:24.036 INFO:teuthology.orchestra.run.smithi045.stdout: -2704> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2325 12.3d 12:be8dfa60:::100000000fe.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b25c00 con 0x55cc9410e000 2023-10-03T19:21:24.036 INFO:teuthology.orchestra.run.smithi045.stdout: -2703> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2326 12.13 12:ca01a157:::100000000ff.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94676380 con 0x55cc9410e000 2023-10-03T19:21:24.037 INFO:teuthology.orchestra.run.smithi045.stdout: -2702> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2327 12.16 12:69f8b284:::10000000100.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9419d500 con 0x55cc93ffc400 2023-10-03T19:21:24.037 INFO:teuthology.orchestra.run.smithi045.stdout: -2701> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2328 12.3e 12:7d5083c7:::10000000101.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9419c380 con 0x55cc93ffd000 2023-10-03T19:21:24.037 INFO:teuthology.orchestra.run.smithi045.stdout: -2700> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2329 12.13 12:ca2b2f16:::10000000102.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9459f500 con 0x55cc9410e000 2023-10-03T19:21:24.037 INFO:teuthology.orchestra.run.smithi045.stdout: -2699> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2330 12.31 12:8c3ca124:::10000000103.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc945d8700 con 0x55cc93ffd000 2023-10-03T19:21:24.037 INFO:teuthology.orchestra.run.smithi045.stdout: -2698> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2331 12.36 12:6f4aafed:::10000000104.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9413f500 con 0x55cc93ffd800 2023-10-03T19:21:24.037 INFO:teuthology.orchestra.run.smithi045.stdout: -2697> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2332 12.10 12:088ef71a:::10000000105.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9413e000 con 0x55cc93ffd000 2023-10-03T19:21:24.038 INFO:teuthology.orchestra.run.smithi045.stdout: -2696> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2333 12.14 12:285116e2:::10000000106.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9465ca80 con 0x55cc93ffd800 2023-10-03T19:21:24.038 INFO:teuthology.orchestra.run.smithi045.stdout: -2695> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2334 12.3f 12:fe10ede2:::10000000107.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94163180 con 0x55cc93ffc800 2023-10-03T19:21:24.038 INFO:teuthology.orchestra.run.smithi045.stdout: -2694> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2335 12.30 12:0fd9593b:::10000000108.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941de380 con 0x55cc93ffc800 2023-10-03T19:21:24.038 INFO:teuthology.orchestra.run.smithi045.stdout: -2693> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2336 12.37 12:ee98d4aa:::10000000109.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941bb180 con 0x55cc93ffd400 2023-10-03T19:21:24.038 INFO:teuthology.orchestra.run.smithi045.stdout: -2692> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2337 12.14 12:2b0c3f61:::1000000010a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9414c000 con 0x55cc93ffd800 2023-10-03T19:21:24.038 INFO:teuthology.orchestra.run.smithi045.stdout: -2691> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2338 12.3f 12:fe23482d:::1000000010b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9488ca80 con 0x55cc93ffc800 2023-10-03T19:21:24.039 INFO:teuthology.orchestra.run.smithi045.stdout: -2690> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2339 12.d 12:b247ee27:::1000000010c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95bab500 con 0x55cc93ffc800 2023-10-03T19:21:24.039 INFO:teuthology.orchestra.run.smithi045.stdout: -2689> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2340 12.26 12:67d72c52:::1000000010d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95bff500 con 0x55cc93ffd800 2023-10-03T19:21:24.039 INFO:teuthology.orchestra.run.smithi045.stdout: -2688> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2341 12.2a 12:542953c1:::1000000010e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc947c7880 con 0x55cc93ffcc00 2023-10-03T19:21:24.039 INFO:teuthology.orchestra.run.smithi045.stdout: -2687> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2342 12.30 12:0c13cd34:::1000000010f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94192e00 con 0x55cc93ffc800 2023-10-03T19:21:24.039 INFO:teuthology.orchestra.run.smithi045.stdout: -2686> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2343 12.26 12:64ce44bf:::10000000110.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9460e380 con 0x55cc93ffd800 2023-10-03T19:21:24.039 INFO:teuthology.orchestra.run.smithi045.stdout: -2685> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2344 12.22 12:46c9ad04:::10000000111.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9459ea80 con 0x55cc93ffc800 2023-10-03T19:21:24.040 INFO:teuthology.orchestra.run.smithi045.stdout: -2684> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2345 12.0 12:006fa129:::10000000112.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94187180 con 0x55cc93ffd400 2023-10-03T19:21:24.040 INFO:teuthology.orchestra.run.smithi045.stdout: -2683> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2346 12.1f 12:fa9b3804:::10000000113.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc940cf180 con 0x55cc93ffc400 2023-10-03T19:21:24.040 INFO:teuthology.orchestra.run.smithi045.stdout: -2682> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2347 12.0 12:005b64bc:::10000000114.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9421b180 con 0x55cc93ffd400 2023-10-03T19:21:24.040 INFO:teuthology.orchestra.run.smithi045.stdout: -2681> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2348 12.2a 12:575ae04b:::10000000115.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc946b2a80 con 0x55cc93ffcc00 2023-10-03T19:21:24.040 INFO:teuthology.orchestra.run.smithi045.stdout: -2680> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2349 12.17 12:ea138f4d:::10000000116.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc947c6380 con 0x55cc93ffc400 2023-10-03T19:21:24.041 INFO:teuthology.orchestra.run.smithi045.stdout: -2679> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2350 12.23 12:c507b3c5:::10000000117.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94686a80 con 0x55cc93ffd000 2023-10-03T19:21:24.041 INFO:teuthology.orchestra.run.smithi045.stdout: -2678> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2351 12.25 12:a6db094f:::10000000118.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94624a80 con 0x55cc93ffc800 2023-10-03T19:21:24.041 INFO:teuthology.orchestra.run.smithi045.stdout: -2677> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2352 12.3 12:c1b999d7:::10000000119.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94677500 con 0x55cc93ffd000 2023-10-03T19:21:24.041 INFO:teuthology.orchestra.run.smithi045.stdout: -2676> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2353 12.2a 12:565108ac:::1000000011a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94770e00 con 0x55cc93ffcc00 2023-10-03T19:21:24.041 INFO:teuthology.orchestra.run.smithi045.stdout: -2675> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2354 12.36 12:6e600286:::1000000011b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9465ce00 con 0x55cc93ffd800 2023-10-03T19:21:24.042 INFO:teuthology.orchestra.run.smithi045.stdout: -2674> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2355 12.b 12:d200bef4:::1000000011c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941a6a80 con 0x55cc93ffdc00 2023-10-03T19:21:24.042 INFO:teuthology.orchestra.run.smithi045.stdout: -2673> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2356 12.3a 12:5d261264:::1000000011d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941a6e00 con 0x55cc93ffdc00 2023-10-03T19:21:24.042 INFO:teuthology.orchestra.run.smithi045.stdout: -2672> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2357 12.10 12:08a5cadf:::1000000011e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94770700 con 0x55cc93ffd000 2023-10-03T19:21:24.042 INFO:teuthology.orchestra.run.smithi045.stdout: -2671> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2358 12.2b 12:d6a4c2d3:::1000000011f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941eb880 con 0x55cc93ffd400 2023-10-03T19:21:24.042 INFO:teuthology.orchestra.run.smithi045.stdout: -2670> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2359 12.15 12:a96960f2:::10000000120.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9459e000 con 0x55cc93ffc400 2023-10-03T19:21:24.042 INFO:teuthology.orchestra.run.smithi045.stdout: -2669> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2360 12.2d 12:b4f06a36:::10000000121.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94771880 con 0x55cc93ffdc00 2023-10-03T19:21:24.043 INFO:teuthology.orchestra.run.smithi045.stdout: -2668> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2361 12.1e 12:7b093fa4:::10000000122.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941b2a80 con 0x55cc93ffd400 2023-10-03T19:21:24.043 INFO:teuthology.orchestra.run.smithi045.stdout: -2667> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2362 12.36 12:6f395059:::10000000123.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc942b7500 con 0x55cc93ffd800 2023-10-03T19:21:24.043 INFO:teuthology.orchestra.run.smithi045.stdout: -2666> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2363 12.27 12:e5c20fbc:::10000000124.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9478ee00 con 0x55cc93ffd000 2023-10-03T19:21:24.043 INFO:teuthology.orchestra.run.smithi045.stdout: -2665> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2364 12.14 12:2b82a036:::10000000125.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941b8e00 con 0x55cc93ffd800 2023-10-03T19:21:24.043 INFO:teuthology.orchestra.run.smithi045.stdout: -2664> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2365 12.34 12:2f934c4e:::10000000126.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94187880 con 0x55cc93ffd800 2023-10-03T19:21:24.044 INFO:teuthology.orchestra.run.smithi045.stdout: -2663> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2366 12.0 12:03f08cc0:::10000000127.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94735180 con 0x55cc93ffd400 2023-10-03T19:21:24.044 INFO:teuthology.orchestra.run.smithi045.stdout: -2662> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2367 12.2 12:4319aaa2:::10000000128.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9478e000 con 0x55cc93ffd400 2023-10-03T19:21:24.044 INFO:teuthology.orchestra.run.smithi045.stdout: -2661> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2368 12.1 12:802a5bbd:::10000000129.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94687500 con 0x55cc93ffc400 2023-10-03T19:21:24.044 INFO:teuthology.orchestra.run.smithi045.stdout: -2660> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2369 12.38 12:1c1bce02:::1000000012a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94771500 con 0x55cc93ffcc00 2023-10-03T19:21:24.044 INFO:teuthology.orchestra.run.smithi045.stdout: -2659> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2370 12.9 12:930ba3bb:::1000000012b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94677180 con 0x55cc93ffcc00 2023-10-03T19:21:24.044 INFO:teuthology.orchestra.run.smithi045.stdout: -2658> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2371 12.2d 12:b4fb9bd9:::1000000012c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc946d9c00 con 0x55cc93ffdc00 2023-10-03T19:21:24.045 INFO:teuthology.orchestra.run.smithi045.stdout: -2657> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2372 12.37 12:ee6a6ac0:::1000000012d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941eb500 con 0x55cc93ffd400 2023-10-03T19:21:24.045 INFO:teuthology.orchestra.run.smithi045.stdout: -2656> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2373 12.2 12:439e92fb:::1000000012e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9478f500 con 0x55cc93ffd400 2023-10-03T19:21:24.045 INFO:teuthology.orchestra.run.smithi045.stdout: -2655> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2374 12.4 12:23f83e86:::1000000012f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9414aa80 con 0x55cc93ffc400 2023-10-03T19:21:24.045 INFO:teuthology.orchestra.run.smithi045.stdout: -2654> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2375 12.15 12:abaacf15:::10000000130.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b4e380 con 0x55cc93ffc400 2023-10-03T19:21:24.045 INFO:teuthology.orchestra.run.smithi045.stdout: -2653> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2376 12.35 12:af7e9f79:::10000000131.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941d3880 con 0x55cc93ffd000 2023-10-03T19:21:24.045 INFO:teuthology.orchestra.run.smithi045.stdout: -2652> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2377 12.28 12:14babc15:::10000000132.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9413fc00 con 0x55cc93ffd000 2023-10-03T19:21:24.046 INFO:teuthology.orchestra.run.smithi045.stdout: -2651> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2378 12.3d 12:beed21fb:::10000000133.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9415a000 con 0x55cc9410e000 2023-10-03T19:21:24.046 INFO:teuthology.orchestra.run.smithi045.stdout: -2650> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2379 12.2 12:40fdd18a:::10000000134.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9478f880 con 0x55cc93ffd400 2023-10-03T19:21:24.046 INFO:teuthology.orchestra.run.smithi045.stdout: -2649> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2380 12.3f 12:fedcb8c2:::10000000135.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9415bc00 con 0x55cc93ffc800 2023-10-03T19:21:24.046 INFO:teuthology.orchestra.run.smithi045.stdout: -2648> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2381 12.18 12:1b569a42:::10000000136.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9465c700 con 0x55cc9410e000 2023-10-03T19:21:24.046 INFO:teuthology.orchestra.run.smithi045.stdout: -2647> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2382 12.17 12:e994506f:::10000000137.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94686000 con 0x55cc93ffc400 2023-10-03T19:21:24.046 INFO:teuthology.orchestra.run.smithi045.stdout: -2646> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2383 12.6 12:629cc6bc:::10000000138.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc940cea80 con 0x55cc9410e000 2023-10-03T19:21:24.047 INFO:teuthology.orchestra.run.smithi045.stdout: -2645> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2384 12.8 12:1176dc39:::10000000139.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b7d180 con 0x55cc93ffdc00 2023-10-03T19:21:24.047 INFO:teuthology.orchestra.run.smithi045.stdout: -2644> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2385 12.1a 12:5997e84c:::1000000013a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9415ae00 con 0x55cc93ffd400 2023-10-03T19:21:24.047 INFO:teuthology.orchestra.run.smithi045.stdout: -2643> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2386 12.1c 12:3800373d:::1000000013b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94452000 con 0x55cc93ffd000 2023-10-03T19:21:24.047 INFO:teuthology.orchestra.run.smithi045.stdout: -2642> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2387 12.36 12:6c5ddb65:::1000000013c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b7d500 con 0x55cc93ffd800 2023-10-03T19:21:24.047 INFO:teuthology.orchestra.run.smithi045.stdout: -2641> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2388 12.33 12:ce600bd1:::1000000013d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94261c00 con 0x55cc93ffcc00 2023-10-03T19:21:24.048 INFO:teuthology.orchestra.run.smithi045.stdout: -2640> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2389 12.35 12:ae56dbe9:::1000000013e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941a6380 con 0x55cc93ffd000 2023-10-03T19:21:24.048 INFO:teuthology.orchestra.run.smithi045.stdout: -2639> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2390 12.2b 12:d47db6ab:::1000000013f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9419c000 con 0x55cc93ffd400 2023-10-03T19:21:24.048 INFO:teuthology.orchestra.run.smithi045.stdout: -2638> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2391 12.3b 12:dd7df288:::10000000140.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc947c6a80 con 0x55cc93ffcc00 2023-10-03T19:21:24.048 INFO:teuthology.orchestra.run.smithi045.stdout: -2637> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2392 12.d 12:b296df2e:::10000000141.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc947d9500 con 0x55cc93ffc800 2023-10-03T19:21:24.048 INFO:teuthology.orchestra.run.smithi045.stdout: -2636> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2393 12.1b 12:d9deb994:::10000000142.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc947d8380 con 0x55cc93ffd400 2023-10-03T19:21:24.048 INFO:teuthology.orchestra.run.smithi045.stdout: -2635> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2394 12.2e 12:77f9b43c:::10000000143.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9478f180 con 0x55cc9410e000 2023-10-03T19:21:24.049 INFO:teuthology.orchestra.run.smithi045.stdout: -2634> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2395 12.19 12:9ae704d2:::10000000144.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941a7180 con 0x55cc93ffd000 2023-10-03T19:21:24.049 INFO:teuthology.orchestra.run.smithi045.stdout: -2633> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2396 12.1a 12:587da770:::10000000145.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941a7880 con 0x55cc93ffd400 2023-10-03T19:21:24.049 INFO:teuthology.orchestra.run.smithi045.stdout: -2632> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2397 12.3f 12:fd6fa633:::10000000146.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94452700 con 0x55cc93ffc800 2023-10-03T19:21:24.049 INFO:teuthology.orchestra.run.smithi045.stdout: -2631> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2398 12.2c 12:35111aed:::10000000147.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9465c000 con 0x55cc93ffcc00 2023-10-03T19:21:24.049 INFO:teuthology.orchestra.run.smithi045.stdout: -2630> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2399 12.32 12:4eeada49:::10000000148.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94193880 con 0x55cc93ffdc00 2023-10-03T19:21:24.049 INFO:teuthology.orchestra.run.smithi045.stdout: -2629> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2400 12.11 12:8abfc0dc:::10000000149.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94187c00 con 0x55cc93ffd800 2023-10-03T19:21:24.050 INFO:teuthology.orchestra.run.smithi045.stdout: -2628> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2401 12.17 12:e821ba07:::1000000014a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94453880 con 0x55cc93ffc400 2023-10-03T19:21:24.050 INFO:teuthology.orchestra.run.smithi045.stdout: -2627> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2402 12.3f 12:fc6ed777:::1000000014b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9420c380 con 0x55cc93ffc800 2023-10-03T19:21:24.050 INFO:teuthology.orchestra.run.smithi045.stdout: -2626> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2403 12.b 12:d35c25ee:::1000000014c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94453500 con 0x55cc93ffdc00 2023-10-03T19:21:24.050 INFO:teuthology.orchestra.run.smithi045.stdout: -2625> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2404 12.c 12:31051922:::1000000014d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9421a380 con 0x55cc93ffd000 2023-10-03T19:21:24.050 INFO:teuthology.orchestra.run.smithi045.stdout: -2624> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2405 12.15 12:abf4da12:::1000000014e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94676e00 con 0x55cc93ffc400 2023-10-03T19:21:24.050 INFO:teuthology.orchestra.run.smithi045.stdout: -2623> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2406 12.2 12:42d137c4:::1000000014f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941ea380 con 0x55cc93ffd400 2023-10-03T19:21:24.051 INFO:teuthology.orchestra.run.smithi045.stdout: -2622> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2407 12.34 12:2dfce41c:::10000000150.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc942b6a80 con 0x55cc93ffd800 2023-10-03T19:21:24.051 INFO:teuthology.orchestra.run.smithi045.stdout: -2621> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2408 12.31 12:8d77f5fc:::10000000151.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc942b6700 con 0x55cc93ffd000 2023-10-03T19:21:24.051 INFO:teuthology.orchestra.run.smithi045.stdout: -2620> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2409 12.2a 12:553c495b:::10000000152.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94452a80 con 0x55cc93ffcc00 2023-10-03T19:21:24.051 INFO:teuthology.orchestra.run.smithi045.stdout: -2619> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2410 12.a 12:512fb173:::10000000153.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94770a80 con 0x55cc93ffcc00 2023-10-03T19:21:24.051 INFO:teuthology.orchestra.run.smithi045.stdout: -2618> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2411 12.20 12:0654da44:::10000000154.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941d2700 con 0x55cc93ffc800 2023-10-03T19:21:24.051 INFO:teuthology.orchestra.run.smithi045.stdout: -2617> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2412 12.31 12:8c35c3f8:::10000000155.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9465dc00 con 0x55cc93ffd000 2023-10-03T19:21:24.052 INFO:teuthology.orchestra.run.smithi045.stdout: -2616> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2413 12.29 12:96298894:::10000000156.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9421b500 con 0x55cc93ffd400 2023-10-03T19:21:24.052 INFO:teuthology.orchestra.run.smithi045.stdout: -2615> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2414 12.3c 12:3e33a224:::10000000157.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9419ce00 con 0x55cc93ffd800 2023-10-03T19:21:24.052 INFO:teuthology.orchestra.run.smithi045.stdout: -2614> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2415 12.11 12:885408d1:::10000000158.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941b2e00 con 0x55cc93ffd800 2023-10-03T19:21:24.052 INFO:teuthology.orchestra.run.smithi045.stdout: -2613> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2416 12.35 12:ac4ca6af:::10000000159.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941f6000 con 0x55cc93ffd000 2023-10-03T19:21:24.052 INFO:teuthology.orchestra.run.smithi045.stdout: -2612> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2417 12.4 12:23cbca8f:::1000000015a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941f6380 con 0x55cc93ffc400 2023-10-03T19:21:24.052 INFO:teuthology.orchestra.run.smithi045.stdout: -2611> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2418 12.27 12:e6859628:::1000000015b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941f6700 con 0x55cc93ffd000 2023-10-03T19:21:24.053 INFO:teuthology.orchestra.run.smithi045.stdout: -2610> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2419 12.f 12:f04171b6:::1000000015c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941f6a80 con 0x55cc93ffc400 2023-10-03T19:21:24.053 INFO:teuthology.orchestra.run.smithi045.stdout: -2609> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2420 12.29 12:94a271f5:::1000000015d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941f6e00 con 0x55cc93ffd400 2023-10-03T19:21:24.053 INFO:teuthology.orchestra.run.smithi045.stdout: -2608> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2421 12.8 12:12dd7266:::1000000015e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941f7180 con 0x55cc93ffdc00 2023-10-03T19:21:24.053 INFO:teuthology.orchestra.run.smithi045.stdout: -2607> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2422 12.f 12:f03d37e6:::1000000015f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941f7500 con 0x55cc93ffc400 2023-10-03T19:21:24.053 INFO:teuthology.orchestra.run.smithi045.stdout: -2606> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2423 12.e 12:71a8024a:::10000000160.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941f7880 con 0x55cc93ffd000 2023-10-03T19:21:24.053 INFO:teuthology.orchestra.run.smithi045.stdout: -2605> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2424 12.3 12:c3d50dc8:::10000000161.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941f7c00 con 0x55cc93ffd000 2023-10-03T19:21:24.053 INFO:teuthology.orchestra.run.smithi045.stdout: -2604> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2425 12.1a 12:581fb947:::10000000162.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94c42000 con 0x55cc93ffd400 2023-10-03T19:21:24.054 INFO:teuthology.orchestra.run.smithi045.stdout: -2603> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2426 12.3d 12:bea1de3b:::10000000163.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94c42380 con 0x55cc9410e000 2023-10-03T19:21:24.054 INFO:teuthology.orchestra.run.smithi045.stdout: -2602> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2427 12.26 12:679dc93b:::10000000164.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94c42700 con 0x55cc93ffd800 2023-10-03T19:21:24.054 INFO:teuthology.orchestra.run.smithi045.stdout: -2601> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2428 12.2f 12:f477b060:::10000000165.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94c42a80 con 0x55cc93ffcc00 2023-10-03T19:21:24.054 INFO:teuthology.orchestra.run.smithi045.stdout: -2600> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2429 12.2f 12:f427aff4:::10000000166.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94c42e00 con 0x55cc93ffcc00 2023-10-03T19:21:24.054 INFO:teuthology.orchestra.run.smithi045.stdout: -2599> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2430 12.7 12:e1d10967:::10000000167.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94c43180 con 0x55cc9410e000 2023-10-03T19:21:24.055 INFO:teuthology.orchestra.run.smithi045.stdout: -2598> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2431 12.28 12:157cd199:::10000000168.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94c43500 con 0x55cc93ffd000 2023-10-03T19:21:24.055 INFO:teuthology.orchestra.run.smithi045.stdout: -2597> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2432 12.e 12:72fb549a:::10000000169.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94c43880 con 0x55cc93ffd000 2023-10-03T19:21:24.189 INFO:teuthology.orchestra.run.smithi045.stdout: -2596> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2433 12.31 12:8c4d6431:::1000000016a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94c43c00 con 0x55cc93ffd000 2023-10-03T19:21:24.189 INFO:teuthology.orchestra.run.smithi045.stdout: -2595> 2023-10-03T19:18:12.085+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2434 12.24 12:24468cab:::1000000016b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9418a000 con 0x55cc93ffcc00 2023-10-03T19:21:24.189 INFO:teuthology.orchestra.run.smithi045.stdout: -2594> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2435 12.2b 12:d4621505:::1000000016c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9418a380 con 0x55cc93ffd400 2023-10-03T19:21:24.189 INFO:teuthology.orchestra.run.smithi045.stdout: -2593> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2436 12.3a 12:5e75abad:::1000000016d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9418a700 con 0x55cc93ffdc00 2023-10-03T19:21:24.189 INFO:teuthology.orchestra.run.smithi045.stdout: -2592> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2437 12.24 12:25a116fe:::1000000016e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9418aa80 con 0x55cc93ffcc00 2023-10-03T19:21:24.189 INFO:teuthology.orchestra.run.smithi045.stdout: -2591> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2438 12.29 12:9754688f:::1000000016f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9418ae00 con 0x55cc93ffd400 2023-10-03T19:21:24.189 INFO:teuthology.orchestra.run.smithi045.stdout: -2590> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2439 12.21 12:865846d8:::10000000170.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9418b180 con 0x55cc9410e000 2023-10-03T19:21:24.189 INFO:teuthology.orchestra.run.smithi045.stdout: -2589> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2440 12.26 12:67de5783:::10000000171.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9418b500 con 0x55cc93ffd800 2023-10-03T19:21:24.189 INFO:teuthology.orchestra.run.smithi045.stdout: -2588> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2441 12.3a 12:5fae8ea4:::10000000172.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9418b880 con 0x55cc93ffdc00 2023-10-03T19:21:24.189 INFO:teuthology.orchestra.run.smithi045.stdout: -2587> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2442 12.2f 12:f750f038:::10000000173.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9418bc00 con 0x55cc93ffcc00 2023-10-03T19:21:24.190 INFO:teuthology.orchestra.run.smithi045.stdout: -2586> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2443 12.17 12:ea0d4bd4:::10000000174.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b24e00 con 0x55cc93ffc400 2023-10-03T19:21:24.190 INFO:teuthology.orchestra.run.smithi045.stdout: -2585> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2444 12.2c 12:35de0157:::10000000175.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc946d8380 con 0x55cc93ffcc00 2023-10-03T19:21:24.190 INFO:teuthology.orchestra.run.smithi045.stdout: -2584> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2445 12.21 12:87d44640:::10000000176.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9414a700 con 0x55cc9410e000 2023-10-03T19:21:24.190 INFO:teuthology.orchestra.run.smithi045.stdout: -2583> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2446 12.21 12:85136d15:::10000000177.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94163c00 con 0x55cc9410e000 2023-10-03T19:21:24.190 INFO:teuthology.orchestra.run.smithi045.stdout: -2582> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2447 12.1b 12:d83df968:::10000000178.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941dea80 con 0x55cc93ffd400 2023-10-03T19:21:24.190 INFO:teuthology.orchestra.run.smithi045.stdout: -2581> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2448 12.23 12:c468a694:::10000000179.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941baa80 con 0x55cc93ffd000 2023-10-03T19:21:24.190 INFO:teuthology.orchestra.run.smithi045.stdout: -2580> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2449 12.1c 12:392ce431:::1000000017a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94243c00 con 0x55cc93ffd000 2023-10-03T19:21:24.190 INFO:teuthology.orchestra.run.smithi045.stdout: -2579> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2450 12.23 12:c750a2e5:::1000000017b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9413f880 con 0x55cc93ffd000 2023-10-03T19:21:24.190 INFO:teuthology.orchestra.run.smithi045.stdout: -2578> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2451 12.39 12:9d2c3550:::1000000017c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94203880 con 0x55cc93ffc400 2023-10-03T19:21:24.190 INFO:teuthology.orchestra.run.smithi045.stdout: -2577> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2452 12.38 12:1e3b0900:::1000000017d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94771c00 con 0x55cc93ffcc00 2023-10-03T19:21:24.193 INFO:teuthology.orchestra.run.smithi045.stdout: -2576> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2453 12.15 12:aa02e122:::1000000017e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9420d180 con 0x55cc93ffc400 2023-10-03T19:21:24.194 INFO:teuthology.orchestra.run.smithi045.stdout: -2575> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2454 12.18 12:1b505fc9:::1000000017f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95bffc00 con 0x55cc9410e000 2023-10-03T19:21:24.194 INFO:teuthology.orchestra.run.smithi045.stdout: -2574> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2455 12.6 12:63fec8d1:::10000000180.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94624000 con 0x55cc9410e000 2023-10-03T19:21:24.194 INFO:teuthology.orchestra.run.smithi045.stdout: -2573> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2456 12.35 12:ae109857:::10000000181.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9420c700 con 0x55cc93ffd000 2023-10-03T19:21:24.194 INFO:teuthology.orchestra.run.smithi045.stdout: -2572> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2457 12.3c 12:3caa846b:::10000000182.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9415a380 con 0x55cc93ffd800 2023-10-03T19:21:24.194 INFO:teuthology.orchestra.run.smithi045.stdout: -2571> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2458 12.6 12:60954073:::10000000183.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94203c00 con 0x55cc9410e000 2023-10-03T19:21:24.194 INFO:teuthology.orchestra.run.smithi045.stdout: -2570> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2459 12.37 12:ee74be79:::10000000184.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b4f180 con 0x55cc93ffd400 2023-10-03T19:21:24.194 INFO:teuthology.orchestra.run.smithi045.stdout: -2569> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2460 12.2b 12:d44b7594:::10000000185.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95baae00 con 0x55cc93ffd400 2023-10-03T19:21:24.194 INFO:teuthology.orchestra.run.smithi045.stdout: -2568> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2461 12.1b 12:dac0322e:::10000000186.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95baa000 con 0x55cc93ffd400 2023-10-03T19:21:24.194 INFO:teuthology.orchestra.run.smithi045.stdout: -2567> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2462 12.2c 12:361d040c:::10000000187.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc947c7500 con 0x55cc93ffcc00 2023-10-03T19:21:24.194 INFO:teuthology.orchestra.run.smithi045.stdout: -2566> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2463 12.2c 12:34fb46e8:::10000000188.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc945d8000 con 0x55cc93ffcc00 2023-10-03T19:21:24.194 INFO:teuthology.orchestra.run.smithi045.stdout: -2565> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2464 12.18 12:1be1b9ec:::10000000189.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9460fc00 con 0x55cc9410e000 2023-10-03T19:21:24.195 INFO:teuthology.orchestra.run.smithi045.stdout: -2564> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2465 12.25 12:a628609b:::1000000018a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94242a80 con 0x55cc93ffc800 2023-10-03T19:21:24.195 INFO:teuthology.orchestra.run.smithi045.stdout: -2563> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2466 12.20 12:054a2542:::1000000018b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941b8000 con 0x55cc93ffc800 2023-10-03T19:21:24.195 INFO:teuthology.orchestra.run.smithi045.stdout: -2562> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2467 12.20 12:0528cc08:::1000000018c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9413ee00 con 0x55cc93ffc800 2023-10-03T19:21:24.195 INFO:teuthology.orchestra.run.smithi045.stdout: -2561> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2468 12.25 12:a72aac57:::1000000018d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941a6000 con 0x55cc93ffc800 2023-10-03T19:21:24.195 INFO:teuthology.orchestra.run.smithi045.stdout: -2560> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2469 12.13 12:ca4de75d:::1000000018e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b4f500 con 0x55cc9410e000 2023-10-03T19:21:24.195 INFO:teuthology.orchestra.run.smithi045.stdout: -2559> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2470 12.21 12:873de92c:::1000000018f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9460f880 con 0x55cc9410e000 2023-10-03T19:21:24.195 INFO:teuthology.orchestra.run.smithi045.stdout: -2558> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2471 12.5 12:a17921c8:::10000000190.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9460e000 con 0x55cc93ffc400 2023-10-03T19:21:24.195 INFO:teuthology.orchestra.run.smithi045.stdout: -2557> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2472 12.19 12:98be24f8:::10000000191.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9414bc00 con 0x55cc93ffd000 2023-10-03T19:21:24.195 INFO:teuthology.orchestra.run.smithi045.stdout: -2556> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2473 12.0 12:01a8c5ca:::10000000192.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b25500 con 0x55cc93ffd400 2023-10-03T19:21:24.195 INFO:teuthology.orchestra.run.smithi045.stdout: -2555> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2474 12.1d 12:b9c448ca:::10000000193.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b7c700 con 0x55cc93ffd000 2023-10-03T19:21:24.195 INFO:teuthology.orchestra.run.smithi045.stdout: -2554> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2475 12.26 12:6669d7af:::10000000194.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc946d9180 con 0x55cc93ffd800 2023-10-03T19:21:24.196 INFO:teuthology.orchestra.run.smithi045.stdout: -2553> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2476 12.1b 12:d8c655bc:::10000000195.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9478e380 con 0x55cc93ffd400 2023-10-03T19:21:24.196 INFO:teuthology.orchestra.run.smithi045.stdout: -2552> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2477 12.1e 12:7894fe2e:::10000000196.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95bff500 con 0x55cc93ffd400 2023-10-03T19:21:24.196 INFO:teuthology.orchestra.run.smithi045.stdout: -2551> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2478 12.12 12:4aa09692:::10000000197.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95bff180 con 0x55cc93ffdc00 2023-10-03T19:21:24.196 INFO:teuthology.orchestra.run.smithi045.stdout: -2550> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2479 12.30 12:0cac0e23:::10000000198.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95bfe700 con 0x55cc93ffc800 2023-10-03T19:21:24.196 INFO:teuthology.orchestra.run.smithi045.stdout: -2549> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2480 12.33 12:cf2b08c7:::10000000199.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95c29180 con 0x55cc93ffcc00 2023-10-03T19:21:24.196 INFO:teuthology.orchestra.run.smithi045.stdout: -2548> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2481 12.20 12:068c0723:::1000000019a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94187880 con 0x55cc93ffc800 2023-10-03T19:21:24.196 INFO:teuthology.orchestra.run.smithi045.stdout: -2547> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2482 12.13 12:cad07b43:::1000000019b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94187c00 con 0x55cc9410e000 2023-10-03T19:21:24.196 INFO:teuthology.orchestra.run.smithi045.stdout: -2546> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2483 12.7 12:e16233b5:::1000000019c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94186700 con 0x55cc9410e000 2023-10-03T19:21:24.196 INFO:teuthology.orchestra.run.smithi045.stdout: -2545> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2484 12.1d 12:ba9aa119:::1000000019d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95bd5c00 con 0x55cc93ffd000 2023-10-03T19:21:24.196 INFO:teuthology.orchestra.run.smithi045.stdout: -2544> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2485 12.20 12:04059238:::1000000019e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95bab880 con 0x55cc93ffc800 2023-10-03T19:21:24.196 INFO:teuthology.orchestra.run.smithi045.stdout: -2543> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2486 12.28 12:15089297:::1000000019f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b7d500 con 0x55cc93ffd000 2023-10-03T19:21:24.197 INFO:teuthology.orchestra.run.smithi045.stdout: -2542> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2487 12.3d 12:beda2349:::100000001a0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b7d880 con 0x55cc9410e000 2023-10-03T19:21:24.197 INFO:teuthology.orchestra.run.smithi045.stdout: -2541> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2488 12.1d 12:b947b1d0:::100000001a1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc947c7880 con 0x55cc93ffd000 2023-10-03T19:21:24.197 INFO:teuthology.orchestra.run.smithi045.stdout: -2540> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2489 12.c 12:3156bbd1:::100000001a2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc947c6a80 con 0x55cc93ffd000 2023-10-03T19:21:24.197 INFO:teuthology.orchestra.run.smithi045.stdout: -2539> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2490 12.37 12:eefe3312:::100000001a3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc947c6000 con 0x55cc93ffd400 2023-10-03T19:21:24.197 INFO:teuthology.orchestra.run.smithi045.stdout: -2538> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2491 12.37 12:ec159c95:::100000001a4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9414b180 con 0x55cc93ffd400 2023-10-03T19:21:24.197 INFO:teuthology.orchestra.run.smithi045.stdout: -2537> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2492 12.2b 12:d55466b4:::100000001a5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9418a000 con 0x55cc93ffd400 2023-10-03T19:21:24.197 INFO:teuthology.orchestra.run.smithi045.stdout: -2536> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2493 12.2e 12:775b9fb2:::100000001a6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94c42700 con 0x55cc9410e000 2023-10-03T19:21:24.197 INFO:teuthology.orchestra.run.smithi045.stdout: -2535> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2494 12.29 12:95eb4c87:::100000001a7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94c42a80 con 0x55cc93ffd400 2023-10-03T19:21:24.197 INFO:teuthology.orchestra.run.smithi045.stdout: -2534> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2495 12.35 12:af372925:::100000001a8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94c42e00 con 0x55cc93ffd000 2023-10-03T19:21:24.197 INFO:teuthology.orchestra.run.smithi045.stdout: -2533> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2496 12.2c 12:3416e1ca:::100000001a9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94770e00 con 0x55cc93ffcc00 2023-10-03T19:21:24.197 INFO:teuthology.orchestra.run.smithi045.stdout: -2532> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2497 12.13 12:caba0c50:::100000001aa.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94771500 con 0x55cc9410e000 2023-10-03T19:21:24.198 INFO:teuthology.orchestra.run.smithi045.stdout: -2531> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2498 12.2e 12:76865fdc:::100000001ab.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94770a80 con 0x55cc9410e000 2023-10-03T19:21:24.198 INFO:teuthology.orchestra.run.smithi045.stdout: -2530> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2499 12.7 12:e255d6cd:::100000001ac.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94452a80 con 0x55cc9410e000 2023-10-03T19:21:24.198 INFO:teuthology.orchestra.run.smithi045.stdout: -2529> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2500 12.13 12:c8b8e906:::100000001ad.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94261c00 con 0x55cc9410e000 2023-10-03T19:21:24.198 INFO:teuthology.orchestra.run.smithi045.stdout: -2528> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2501 12.f 12:f18f2ceb:::100000001ae.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94677180 con 0x55cc93ffc400 2023-10-03T19:21:24.198 INFO:teuthology.orchestra.run.smithi045.stdout: -2527> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2502 12.2a 12:540014ba:::100000001af.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc946b2a80 con 0x55cc93ffcc00 2023-10-03T19:21:24.198 INFO:teuthology.orchestra.run.smithi045.stdout: -2526> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2503 12.32 12:4d7ffadd:::100000001b0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941b2e00 con 0x55cc93ffdc00 2023-10-03T19:21:24.198 INFO:teuthology.orchestra.run.smithi045.stdout: -2525> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2504 12.1d 12:bafada3d:::100000001b1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc942b7500 con 0x55cc93ffd000 2023-10-03T19:21:24.198 INFO:teuthology.orchestra.run.smithi045.stdout: -2524> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2505 12.2e 12:76ff63fc:::100000001b2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc942b6a80 con 0x55cc9410e000 2023-10-03T19:21:24.198 INFO:teuthology.orchestra.run.smithi045.stdout: -2523> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2506 12.2a 12:54062570:::100000001b3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941b8e00 con 0x55cc93ffcc00 2023-10-03T19:21:24.198 INFO:teuthology.orchestra.run.smithi045.stdout: -2522> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2507 12.7 12:e28d3c2b:::100000001b4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9414ca80 con 0x55cc9410e000 2023-10-03T19:21:24.198 INFO:teuthology.orchestra.run.smithi045.stdout: -2521> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2508 12.38 12:1c92f375:::100000001b5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9414dc00 con 0x55cc93ffcc00 2023-10-03T19:21:24.199 INFO:teuthology.orchestra.run.smithi045.stdout: -2520> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2509 12.34 12:2d6f3468:::100000001b6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9414c000 con 0x55cc93ffd800 2023-10-03T19:21:24.344 INFO:teuthology.orchestra.run.smithi045.stdout: -2519> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2510 12.19 12:99a7d964:::100000001b7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9465ce00 con 0x55cc93ffd000 2023-10-03T19:21:24.345 INFO:teuthology.orchestra.run.smithi045.stdout: -2518> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2511 12.d 12:b3fa8219:::100000001b8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9465c000 con 0x55cc93ffc800 2023-10-03T19:21:24.345 INFO:teuthology.orchestra.run.smithi045.stdout: -2517> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2512 12.2d 12:b7eb2f66:::100000001b9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9465ca80 con 0x55cc93ffdc00 2023-10-03T19:21:24.345 INFO:teuthology.orchestra.run.smithi045.stdout: -2516> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2513 12.36 12:6d15073c:::100000001ba.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9413f500 con 0x55cc93ffd800 2023-10-03T19:21:24.345 INFO:teuthology.orchestra.run.smithi045.stdout: -2515> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2514 12.4 12:2118e87e:::100000001bb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9460e380 con 0x55cc93ffc400 2023-10-03T19:21:24.346 INFO:teuthology.orchestra.run.smithi045.stdout: -2514> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2515 12.19 12:9b54a4b5:::100000001bc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9460e700 con 0x55cc93ffd000 2023-10-03T19:21:24.346 INFO:teuthology.orchestra.run.smithi045.stdout: -2513> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2516 12.16 12:69256f6e:::100000001bd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941d3500 con 0x55cc93ffc400 2023-10-03T19:21:24.346 INFO:teuthology.orchestra.run.smithi045.stdout: -2512> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2517 12.20 12:05a7fbbe:::100000001be.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94243880 con 0x55cc93ffc800 2023-10-03T19:21:24.346 INFO:teuthology.orchestra.run.smithi045.stdout: -2511> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2518 12.19 12:9ab6d71b:::100000001bf.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9419ce00 con 0x55cc93ffd000 2023-10-03T19:21:24.346 INFO:teuthology.orchestra.run.smithi045.stdout: -2510> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2519 12.19 12:98a8a8b3:::100000001c0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9419dc00 con 0x55cc93ffd000 2023-10-03T19:21:24.346 INFO:teuthology.orchestra.run.smithi045.stdout: -2509> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2520 12.1 12:823476fa:::100000001c1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94162a80 con 0x55cc93ffc400 2023-10-03T19:21:24.346 INFO:teuthology.orchestra.run.smithi045.stdout: -2508> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2521 12.32 12:4c576489:::100000001c2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941ba380 con 0x55cc93ffdc00 2023-10-03T19:21:24.346 INFO:teuthology.orchestra.run.smithi045.stdout: -2507> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2522 12.1f 12:fa06f62f:::100000001c3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941bb500 con 0x55cc93ffc400 2023-10-03T19:21:24.346 INFO:teuthology.orchestra.run.smithi045.stdout: -2506> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2523 12.12 12:483471a4:::100000001c4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc946d8700 con 0x55cc93ffdc00 2023-10-03T19:21:24.346 INFO:teuthology.orchestra.run.smithi045.stdout: -2505> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2524 12.22 12:47177243:::100000001c5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9418c000 con 0x55cc93ffc800 2023-10-03T19:21:24.346 INFO:teuthology.orchestra.run.smithi045.stdout: -2504> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2525 12.1f 12:f9e205e8:::100000001c6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9418c380 con 0x55cc93ffc400 2023-10-03T19:21:24.347 INFO:teuthology.orchestra.run.smithi045.stdout: -2503> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2526 12.5 12:a07eb451:::100000001c7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9418c700 con 0x55cc93ffc400 2023-10-03T19:21:24.347 INFO:teuthology.orchestra.run.smithi045.stdout: -2502> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2527 12.1c 12:3b17a408:::100000001c8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9418ca80 con 0x55cc93ffd000 2023-10-03T19:21:24.347 INFO:teuthology.orchestra.run.smithi045.stdout: -2501> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2528 12.8 12:12d75f6c:::100000001c9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9418ce00 con 0x55cc93ffdc00 2023-10-03T19:21:24.347 INFO:teuthology.orchestra.run.smithi045.stdout: -2500> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2529 12.16 12:6b5900d3:::100000001ca.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9418d180 con 0x55cc93ffc400 2023-10-03T19:21:24.347 INFO:teuthology.orchestra.run.smithi045.stdout: -2499> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2530 12.3d 12:bce74be0:::100000001cb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9418d500 con 0x55cc9410e000 2023-10-03T19:21:24.347 INFO:teuthology.orchestra.run.smithi045.stdout: -2498> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2531 12.26 12:65df6efc:::100000001cc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9418d880 con 0x55cc93ffd800 2023-10-03T19:21:24.347 INFO:teuthology.orchestra.run.smithi045.stdout: -2497> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2532 12.21 12:86fbb64b:::100000001cd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9418dc00 con 0x55cc9410e000 2023-10-03T19:21:24.347 INFO:teuthology.orchestra.run.smithi045.stdout: -2496> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2533 12.14 12:29519214:::100000001ce.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941aa000 con 0x55cc93ffd800 2023-10-03T19:21:24.347 INFO:teuthology.orchestra.run.smithi045.stdout: -2495> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2534 12.e 12:71d3c486:::100000001cf.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941aa380 con 0x55cc93ffd000 2023-10-03T19:21:24.347 INFO:teuthology.orchestra.run.smithi045.stdout: -2494> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2535 12.1 12:81350243:::100000001d0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941aa700 con 0x55cc93ffc400 2023-10-03T19:21:24.347 INFO:teuthology.orchestra.run.smithi045.stdout: -2493> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2536 12.a 12:51da9383:::100000001d1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941aaa80 con 0x55cc93ffcc00 2023-10-03T19:21:24.348 INFO:teuthology.orchestra.run.smithi045.stdout: -2492> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2537 12.16 12:69d31978:::100000001d2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941aae00 con 0x55cc93ffc400 2023-10-03T19:21:24.348 INFO:teuthology.orchestra.run.smithi045.stdout: -2491> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2538 12.3e 12:7c32b2c0:::100000001d3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941ab180 con 0x55cc93ffd000 2023-10-03T19:21:24.348 INFO:teuthology.orchestra.run.smithi045.stdout: -2490> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2539 12.34 12:2d665059:::100000001d4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941ab500 con 0x55cc93ffd800 2023-10-03T19:21:24.348 INFO:teuthology.orchestra.run.smithi045.stdout: -2489> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2540 12.33 12:cfb1de4c:::100000001d5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941ab880 con 0x55cc93ffcc00 2023-10-03T19:21:24.348 INFO:teuthology.orchestra.run.smithi045.stdout: -2488> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2541 12.16 12:6b2189d7:::100000001d6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941abc00 con 0x55cc93ffc400 2023-10-03T19:21:24.348 INFO:teuthology.orchestra.run.smithi045.stdout: -2487> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2542 12.1a 12:5b825d11:::100000001d7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941a7180 con 0x55cc93ffd400 2023-10-03T19:21:24.348 INFO:teuthology.orchestra.run.smithi045.stdout: -2486> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2543 12.1d 12:b82de5f4:::100000001d8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941a6380 con 0x55cc93ffd000 2023-10-03T19:21:24.348 INFO:teuthology.orchestra.run.smithi045.stdout: -2485> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2544 12.6 12:61ce4130:::100000001d9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94452000 con 0x55cc9410e000 2023-10-03T19:21:24.348 INFO:teuthology.orchestra.run.smithi045.stdout: -2484> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2545 12.37 12:ec238bc7:::100000001da.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9413fc00 con 0x55cc93ffd400 2023-10-03T19:21:24.348 INFO:teuthology.orchestra.run.smithi045.stdout: -2483> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2546 12.24 12:24ebe6ca:::100000001db.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941d3880 con 0x55cc93ffcc00 2023-10-03T19:21:24.348 INFO:teuthology.orchestra.run.smithi045.stdout: -2482> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2547 12.38 12:1fa836f3:::100000001dc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9478ee00 con 0x55cc93ffcc00 2023-10-03T19:21:24.349 INFO:teuthology.orchestra.run.smithi045.stdout: -2481> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2548 12.3b 12:dd6afadf:::100000001dd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94770700 con 0x55cc93ffcc00 2023-10-03T19:21:24.349 INFO:teuthology.orchestra.run.smithi045.stdout: -2480> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2549 12.2e 12:77eaaa70:::100000001de.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94677500 con 0x55cc9410e000 2023-10-03T19:21:24.349 INFO:teuthology.orchestra.run.smithi045.stdout: -2479> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2550 12.34 12:2de2f068:::100000001df.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94686a80 con 0x55cc93ffd800 2023-10-03T19:21:24.349 INFO:teuthology.orchestra.run.smithi045.stdout: -2478> 2023-10-03T19:18:12.089+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2551 12.11 12:8b210d5a:::100000001e0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9413e000 con 0x55cc93ffd800 2023-10-03T19:21:24.349 INFO:teuthology.orchestra.run.smithi045.stdout: -2477> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2552 12.2c 12:3650da82:::100000001e1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc945d8700 con 0x55cc93ffcc00 2023-10-03T19:21:24.349 INFO:teuthology.orchestra.run.smithi045.stdout: -2476> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2553 12.3c 12:3d7caa99:::100000001e2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9419c380 con 0x55cc93ffd800 2023-10-03T19:21:24.349 INFO:teuthology.orchestra.run.smithi045.stdout: -2475> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2554 12.1b 12:da67b4c4:::100000001e3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95b25180 con 0x55cc93ffd400 2023-10-03T19:21:24.349 INFO:teuthology.orchestra.run.smithi045.stdout: -2474> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2555 12.13 12:c88cf2e1:::100000001e4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94735880 con 0x55cc9410e000 2023-10-03T19:21:24.349 INFO:teuthology.orchestra.run.smithi045.stdout: -2473> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2556 12.1a 12:5bf55946:::100000001e5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94163500 con 0x55cc93ffd400 2023-10-03T19:21:24.349 INFO:teuthology.orchestra.run.smithi045.stdout: -2472> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2557 12.14 12:2bd99ea3:::100000001e6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941dfc00 con 0x55cc93ffd800 2023-10-03T19:21:24.349 INFO:teuthology.orchestra.run.smithi045.stdout: -2471> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2558 12.24 12:25319c2b:::100000001e7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941df180 con 0x55cc93ffcc00 2023-10-03T19:21:24.350 INFO:teuthology.orchestra.run.smithi045.stdout: -2470> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2559 12.1c 12:3915d86a:::100000001e8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941bb880 con 0x55cc93ffd000 2023-10-03T19:21:24.350 INFO:teuthology.orchestra.run.smithi045.stdout: -2469> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2560 12.30 12:0def042e:::100000001e9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941bae00 con 0x55cc93ffc800 2023-10-03T19:21:24.350 INFO:teuthology.orchestra.run.smithi045.stdout: -2468> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2561 12.1c 12:3811fe79:::100000001ea.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9414d180 con 0x55cc93ffd000 2023-10-03T19:21:24.350 INFO:teuthology.orchestra.run.smithi045.stdout: -2467> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.33:2562 12.f 12:f3be9911:::100000001eb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9488d500 con 0x55cc93ffc400 2023-10-03T19:21:24.350 INFO:teuthology.orchestra.run.smithi045.stdout: -2466> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2563 12.a 12:52e82f0e:::100000001ec.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9488ce00 con 0x55cc93ffcc00 2023-10-03T19:21:24.350 INFO:teuthology.orchestra.run.smithi045.stdout: -2465> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2564 12.14 12:2af56820:::100000001ed.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9488c700 con 0x55cc93ffd800 2023-10-03T19:21:24.350 INFO:teuthology.orchestra.run.smithi045.stdout: -2464> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2565 12.3a 12:5c391605:::100000001ee.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94625c00 con 0x55cc93ffdc00 2023-10-03T19:21:24.350 INFO:teuthology.orchestra.run.smithi045.stdout: -2463> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2566 12.a 12:519c0e80:::100000001ef.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9459f180 con 0x55cc93ffcc00 2023-10-03T19:21:24.350 INFO:teuthology.orchestra.run.smithi045.stdout: -2462> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.33:2567 12.13 12:ca7e1ea4:::100000001f0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc946d9500 con 0x55cc9410e000 2023-10-03T19:21:24.350 INFO:teuthology.orchestra.run.smithi045.stdout: -2461> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.33:2568 12.33 12:ce8ed050:::100000001f1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc941b8a80 con 0x55cc93ffcc00 2023-10-03T19:21:24.350 INFO:teuthology.orchestra.run.smithi045.stdout: -2460> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.33:2569 12.b 12:d079bd36:::100000001f2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc942b7180 con 0x55cc93ffdc00 2023-10-03T19:21:24.351 INFO:teuthology.orchestra.run.smithi045.stdout: -2459> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2570 12.3c 12:3d203daf:::100000001f3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc95bfee00 con 0x55cc93ffd800 2023-10-03T19:21:24.351 INFO:teuthology.orchestra.run.smithi045.stdout: -2458> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.33:2571 12.14 12:2959de71:::100000001f4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc94258e00 con 0x55cc93ffd800 2023-10-03T19:21:24.351 INFO:teuthology.orchestra.run.smithi045.stdout: -2457> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.33:2572 12.d 12:b0d9c9f6:::100000001f5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc9460ea80 con 0x55cc93ffc800 2023-10-03T19:21:24.351 INFO:teuthology.orchestra.run.smithi045.stdout: -2456> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.inotable: apply_release_ids [0x100000005dd~0x1f7] to [0x100000005dd~0xfffffffa23]/[0x100000007d4~0xfffffff82c] 2023-10-03T19:21:24.351 INFO:teuthology.orchestra.run.smithi045.stdout: -2455> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.sessionmap mark_dirty s=0x55cc9406b400 name=client.5929 v=1004 2023-10-03T19:21:24.351 INFO:teuthology.orchestra.run.smithi045.stdout: -2454> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsx on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) caps={5929=pAsLsXsFsx/-@1002},l=5929 | request=0 lock=5 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cc940bfb80] 2023-10-03T19:21:24.351 INFO:teuthology.orchestra.run.smithi045.stdout: -2453> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000000) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.351 INFO:teuthology.orchestra.run.smithi045.stdout: -2452> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.openfiles remove_dirfrag [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 ap=0+1 state=1074003969|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:24.351 INFO:teuthology.orchestra.run.smithi045.stdout: -2451> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.locker eval 3648 [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=5 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cc940bfb80] 2023-10-03T19:21:24.352 INFO:teuthology.orchestra.run.smithi045.stdout: -2450> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl w=1) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=5 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cc940bfb80] 2023-10-03T19:21:24.352 INFO:teuthology.orchestra.run.smithi045.stdout: -2449> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.locker is excl 2023-10-03T19:21:24.352 INFO:teuthology.orchestra.run.smithi045.stdout: -2448> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 7 mds.0.locker file_eval loner_issued= other_issued= xlocker_issued= 2023-10-03T19:21:24.352 INFO:teuthology.orchestra.run.smithi045.stdout: -2447> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.locker should lose it 2023-10-03T19:21:24.352 INFO:teuthology.orchestra.run.smithi045.stdout: -2446> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.locker waiting for wrlock to drain 2023-10-03T19:21:24.352 INFO:teuthology.orchestra.run.smithi045.stdout: -2445> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.locker simple_eval (iauth sync r=1) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=5 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cc940bfb80] 2023-10-03T19:21:24.352 INFO:teuthology.orchestra.run.smithi045.stdout: -2444> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.locker simple_eval (ilink sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=5 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cc940bfb80] 2023-10-03T19:21:24.352 INFO:teuthology.orchestra.run.smithi045.stdout: -2443> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.locker simple_eval (ixattr sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=5 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cc940bfb80] 2023-10-03T19:21:24.352 INFO:teuthology.orchestra.run.smithi045.stdout: -2442> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.locker eval done 2023-10-03T19:21:24.352 INFO:teuthology.orchestra.run.smithi045.stdout: -2441> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFs on [inode 0x1 [...2,head] / auth v24 snaprealm=0x55cc932298c0 f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:17:35.501989+0000 1=0+1) (isnap sync r=1) (inest lock) (ipolicy sync r=1) (iversion lock) caps={5929=pAsLsXsFs/-@7} | dirtyscattered=0 request=0 lock=2 dirfrag=1 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9314e680] 2023-10-03T19:21:24.352 INFO:teuthology.orchestra.run.smithi045.stdout: -2440> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.352 INFO:teuthology.orchestra.run.smithi045.stdout: -2439> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000026d [2,head] /dc-dir/dc-file_120 auth v2730 s=3 n(v0 rc2023-10-03T19:17:47.122169+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9421ec00] 2023-10-03T19:21:24.353 INFO:teuthology.orchestra.run.smithi045.stdout: -2438> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000026d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.353 INFO:teuthology.orchestra.run.smithi045.stdout: -2437> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000026e [2,head] /dc-dir/dc-file_121 auth v2732 s=3 n(v0 rc2023-10-03T19:17:47.132894+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9421f180] 2023-10-03T19:21:24.353 INFO:teuthology.orchestra.run.smithi045.stdout: -2436> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000026e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.353 INFO:teuthology.orchestra.run.smithi045.stdout: -2435> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000026f [2,head] /dc-dir/dc-file_122 auth v2734 s=3 n(v0 rc2023-10-03T19:17:47.144015+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9421f700] 2023-10-03T19:21:24.353 INFO:teuthology.orchestra.run.smithi045.stdout: -2434> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000026f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.353 INFO:teuthology.orchestra.run.smithi045.stdout: -2433> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000270 [2,head] /dc-dir/dc-file_123 auth v2736 s=3 n(v0 rc2023-10-03T19:17:47.154682+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94224000] 2023-10-03T19:21:24.353 INFO:teuthology.orchestra.run.smithi045.stdout: -2432> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000270) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.353 INFO:teuthology.orchestra.run.smithi045.stdout: -2431> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000271 [2,head] /dc-dir/dc-file_124 auth v2738 s=3 n(v0 rc2023-10-03T19:17:47.165430+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94224580] 2023-10-03T19:21:24.353 INFO:teuthology.orchestra.run.smithi045.stdout: -2430> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000271) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.353 INFO:teuthology.orchestra.run.smithi045.stdout: -2429> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000272 [2,head] /dc-dir/dc-file_125 auth v2740 s=3 n(v0 rc2023-10-03T19:17:47.175246+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94224b00] 2023-10-03T19:21:24.353 INFO:teuthology.orchestra.run.smithi045.stdout: -2428> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000272) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.354 INFO:teuthology.orchestra.run.smithi045.stdout: -2427> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000273 [2,head] /dc-dir/dc-file_126 auth v2742 s=3 n(v0 rc2023-10-03T19:17:47.184955+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94225080] 2023-10-03T19:21:24.354 INFO:teuthology.orchestra.run.smithi045.stdout: -2426> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000273) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.354 INFO:teuthology.orchestra.run.smithi045.stdout: -2425> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000274 [2,head] /dc-dir/dc-file_127 auth v2744 s=3 n(v0 rc2023-10-03T19:17:47.194909+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94225600] 2023-10-03T19:21:24.354 INFO:teuthology.orchestra.run.smithi045.stdout: -2424> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000274) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.354 INFO:teuthology.orchestra.run.smithi045.stdout: -2423> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000275 [2,head] /dc-dir/dc-file_128 auth v2746 s=3 n(v0 rc2023-10-03T19:17:47.205381+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94225b80] 2023-10-03T19:21:24.354 INFO:teuthology.orchestra.run.smithi045.stdout: -2422> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000275) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.354 INFO:teuthology.orchestra.run.smithi045.stdout: -2421> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000276 [2,head] /dc-dir/dc-file_129 auth v2748 s=3 n(v0 rc2023-10-03T19:17:47.215408+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94226100] 2023-10-03T19:21:24.354 INFO:teuthology.orchestra.run.smithi045.stdout: -2420> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000276) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.354 INFO:teuthology.orchestra.run.smithi045.stdout: -2419> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000277 [2,head] /dc-dir/dc-file_130 auth v2750 s=3 n(v0 rc2023-10-03T19:17:47.225119+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94226680] 2023-10-03T19:21:24.354 INFO:teuthology.orchestra.run.smithi045.stdout: -2418> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000277) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.354 INFO:teuthology.orchestra.run.smithi045.stdout: -2417> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000278 [2,head] /dc-dir/dc-file_131 auth v2752 s=3 n(v0 rc2023-10-03T19:17:47.235241+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94226c00] 2023-10-03T19:21:24.355 INFO:teuthology.orchestra.run.smithi045.stdout: -2416> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000278) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.355 INFO:teuthology.orchestra.run.smithi045.stdout: -2415> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000279 [2,head] /dc-dir/dc-file_132 auth v2754 s=3 n(v0 rc2023-10-03T19:17:47.246072+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94227180] 2023-10-03T19:21:24.355 INFO:teuthology.orchestra.run.smithi045.stdout: -2414> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000279) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.355 INFO:teuthology.orchestra.run.smithi045.stdout: -2413> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000027a [2,head] /dc-dir/dc-file_133 auth v2756 s=3 n(v0 rc2023-10-03T19:17:47.256610+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94227700] 2023-10-03T19:21:24.355 INFO:teuthology.orchestra.run.smithi045.stdout: -2412> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000027a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.355 INFO:teuthology.orchestra.run.smithi045.stdout: -2411> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000027b [2,head] /dc-dir/dc-file_134 auth v2758 s=3 n(v0 rc2023-10-03T19:17:47.267964+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94234000] 2023-10-03T19:21:24.355 INFO:teuthology.orchestra.run.smithi045.stdout: -2410> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000027b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.355 INFO:teuthology.orchestra.run.smithi045.stdout: -2409> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000027c [2,head] /dc-dir/dc-file_135 auth v2760 s=3 n(v0 rc2023-10-03T19:17:47.278905+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94234580] 2023-10-03T19:21:24.355 INFO:teuthology.orchestra.run.smithi045.stdout: -2408> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000027c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.355 INFO:teuthology.orchestra.run.smithi045.stdout: -2407> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000027d [2,head] /dc-dir/dc-file_136 auth v2762 s=3 n(v0 rc2023-10-03T19:17:47.288908+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94234b00] 2023-10-03T19:21:24.355 INFO:teuthology.orchestra.run.smithi045.stdout: -2406> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000027d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.355 INFO:teuthology.orchestra.run.smithi045.stdout: -2405> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000027e [2,head] /dc-dir/dc-file_137 auth v2764 s=3 n(v0 rc2023-10-03T19:17:47.299429+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94235080] 2023-10-03T19:21:24.356 INFO:teuthology.orchestra.run.smithi045.stdout: -2404> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000027e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.356 INFO:teuthology.orchestra.run.smithi045.stdout: -2403> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000027f [2,head] /dc-dir/dc-file_138 auth v2766 s=3 n(v0 rc2023-10-03T19:17:47.309340+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94235600] 2023-10-03T19:21:24.356 INFO:teuthology.orchestra.run.smithi045.stdout: -2402> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000027f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.356 INFO:teuthology.orchestra.run.smithi045.stdout: -2401> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000280 [2,head] /dc-dir/dc-file_139 auth v2768 s=3 n(v0 rc2023-10-03T19:17:47.319997+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94235b80] 2023-10-03T19:21:24.356 INFO:teuthology.orchestra.run.smithi045.stdout: -2400> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000280) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.356 INFO:teuthology.orchestra.run.smithi045.stdout: -2399> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000281 [2,head] /dc-dir/dc-file_140 auth v2770 s=3 n(v0 rc2023-10-03T19:17:47.329816+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94236100] 2023-10-03T19:21:24.356 INFO:teuthology.orchestra.run.smithi045.stdout: -2398> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000281) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.356 INFO:teuthology.orchestra.run.smithi045.stdout: -2397> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000282 [2,head] /dc-dir/dc-file_141 auth v2772 s=3 n(v0 rc2023-10-03T19:17:47.340390+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94236680] 2023-10-03T19:21:24.356 INFO:teuthology.orchestra.run.smithi045.stdout: -2396> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000282) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.356 INFO:teuthology.orchestra.run.smithi045.stdout: -2395> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000283 [2,head] /dc-dir/dc-file_142 auth v2774 s=3 n(v0 rc2023-10-03T19:17:47.350738+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94236c00] 2023-10-03T19:21:24.356 INFO:teuthology.orchestra.run.smithi045.stdout: -2394> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000283) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.356 INFO:teuthology.orchestra.run.smithi045.stdout: -2393> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000284 [2,head] /dc-dir/dc-file_143 auth v2776 s=3 n(v0 rc2023-10-03T19:17:47.361667+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94237180] 2023-10-03T19:21:24.357 INFO:teuthology.orchestra.run.smithi045.stdout: -2392> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000284) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.357 INFO:teuthology.orchestra.run.smithi045.stdout: -2391> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000285 [2,head] /dc-dir/dc-file_144 auth v2778 s=3 n(v0 rc2023-10-03T19:17:47.372235+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94237700] 2023-10-03T19:21:24.357 INFO:teuthology.orchestra.run.smithi045.stdout: -2390> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000285) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.357 INFO:teuthology.orchestra.run.smithi045.stdout: -2389> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000286 [2,head] /dc-dir/dc-file_145 auth v2780 s=3 n(v0 rc2023-10-03T19:17:47.383314+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9423e000] 2023-10-03T19:21:24.357 INFO:teuthology.orchestra.run.smithi045.stdout: -2388> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000286) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.357 INFO:teuthology.orchestra.run.smithi045.stdout: -2387> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000287 [2,head] /dc-dir/dc-file_146 auth v2782 s=3 n(v0 rc2023-10-03T19:17:47.393799+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9423e580] 2023-10-03T19:21:24.357 INFO:teuthology.orchestra.run.smithi045.stdout: -2386> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000287) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.357 INFO:teuthology.orchestra.run.smithi045.stdout: -2385> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000288 [2,head] /dc-dir/dc-file_147 auth v2784 s=3 n(v0 rc2023-10-03T19:17:47.404364+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9423eb00] 2023-10-03T19:21:24.357 INFO:teuthology.orchestra.run.smithi045.stdout: -2384> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000288) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.357 INFO:teuthology.orchestra.run.smithi045.stdout: -2383> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000289 [2,head] /dc-dir/dc-file_148 auth v2786 s=3 n(v0 rc2023-10-03T19:17:47.414571+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9423f080] 2023-10-03T19:21:24.357 INFO:teuthology.orchestra.run.smithi045.stdout: -2382> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000289) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.358 INFO:teuthology.orchestra.run.smithi045.stdout: -2381> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000028a [2,head] /dc-dir/dc-file_149 auth v2788 s=3 n(v0 rc2023-10-03T19:17:47.425794+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9423f600] 2023-10-03T19:21:24.358 INFO:teuthology.orchestra.run.smithi045.stdout: -2380> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000028a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.358 INFO:teuthology.orchestra.run.smithi045.stdout: -2379> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000028b [2,head] /dc-dir/dc-file_150 auth v2790 s=3 n(v0 rc2023-10-03T19:17:47.436089+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9423fb80] 2023-10-03T19:21:24.358 INFO:teuthology.orchestra.run.smithi045.stdout: -2378> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000028b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.358 INFO:teuthology.orchestra.run.smithi045.stdout: -2377> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000028c [2,head] /dc-dir/dc-file_151 auth v2792 s=3 n(v0 rc2023-10-03T19:17:47.445800+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94240100] 2023-10-03T19:21:24.358 INFO:teuthology.orchestra.run.smithi045.stdout: -2376> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000028c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.358 INFO:teuthology.orchestra.run.smithi045.stdout: -2375> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000028d [2,head] /dc-dir/dc-file_152 auth v2794 s=3 n(v0 rc2023-10-03T19:17:47.455835+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94240680] 2023-10-03T19:21:24.358 INFO:teuthology.orchestra.run.smithi045.stdout: -2374> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000028d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.358 INFO:teuthology.orchestra.run.smithi045.stdout: -2373> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000028e [2,head] /dc-dir/dc-file_153 auth v2796 s=3 n(v0 rc2023-10-03T19:17:47.466375+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94240c00] 2023-10-03T19:21:24.358 INFO:teuthology.orchestra.run.smithi045.stdout: -2372> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000028e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.358 INFO:teuthology.orchestra.run.smithi045.stdout: -2371> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000028f [2,head] /dc-dir/dc-file_154 auth v2798 s=3 n(v0 rc2023-10-03T19:17:47.476599+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94241180] 2023-10-03T19:21:24.359 INFO:teuthology.orchestra.run.smithi045.stdout: -2370> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000028f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.359 INFO:teuthology.orchestra.run.smithi045.stdout: -2369> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000290 [2,head] /dc-dir/dc-file_155 auth v2800 s=3 n(v0 rc2023-10-03T19:17:47.487267+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94241700] 2023-10-03T19:21:24.359 INFO:teuthology.orchestra.run.smithi045.stdout: -2368> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000290) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.359 INFO:teuthology.orchestra.run.smithi045.stdout: -2367> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000291 [2,head] /dc-dir/dc-file_156 auth v2802 s=3 n(v0 rc2023-10-03T19:17:47.497436+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94252000] 2023-10-03T19:21:24.359 INFO:teuthology.orchestra.run.smithi045.stdout: -2366> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000291) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.359 INFO:teuthology.orchestra.run.smithi045.stdout: -2365> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000292 [2,head] /dc-dir/dc-file_157 auth v2804 s=3 n(v0 rc2023-10-03T19:17:47.508139+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94252580] 2023-10-03T19:21:24.359 INFO:teuthology.orchestra.run.smithi045.stdout: -2364> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000292) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.359 INFO:teuthology.orchestra.run.smithi045.stdout: -2363> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000293 [2,head] /dc-dir/dc-file_158 auth v2806 s=3 n(v0 rc2023-10-03T19:17:47.520667+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94252b00] 2023-10-03T19:21:24.359 INFO:teuthology.orchestra.run.smithi045.stdout: -2362> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000293) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.359 INFO:teuthology.orchestra.run.smithi045.stdout: -2361> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000294 [2,head] /dc-dir/dc-file_159 auth v2808 s=3 n(v0 rc2023-10-03T19:17:47.532586+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94253080] 2023-10-03T19:21:24.359 INFO:teuthology.orchestra.run.smithi045.stdout: -2360> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000294) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.360 INFO:teuthology.orchestra.run.smithi045.stdout: -2359> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000295 [2,head] /dc-dir/dc-file_160 auth v2810 s=3 n(v0 rc2023-10-03T19:17:47.544628+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94253600] 2023-10-03T19:21:24.360 INFO:teuthology.orchestra.run.smithi045.stdout: -2358> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000295) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.360 INFO:teuthology.orchestra.run.smithi045.stdout: -2357> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000296 [2,head] /dc-dir/dc-file_161 auth v2812 s=3 n(v0 rc2023-10-03T19:17:47.556330+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94253b80] 2023-10-03T19:21:24.360 INFO:teuthology.orchestra.run.smithi045.stdout: -2356> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000296) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.360 INFO:teuthology.orchestra.run.smithi045.stdout: -2355> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000297 [2,head] /dc-dir/dc-file_162 auth v2814 s=3 n(v0 rc2023-10-03T19:17:47.567051+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94254100] 2023-10-03T19:21:24.499 INFO:teuthology.orchestra.run.smithi045.stdout: -2354> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000297) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.499 INFO:teuthology.orchestra.run.smithi045.stdout: -2353> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000298 [2,head] /dc-dir/dc-file_163 auth v2816 s=3 n(v0 rc2023-10-03T19:17:47.578431+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94254680] 2023-10-03T19:21:24.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2352> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000298) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2351> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000299 [2,head] /dc-dir/dc-file_164 auth v2818 s=3 n(v0 rc2023-10-03T19:17:47.590039+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94254c00] 2023-10-03T19:21:24.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2350> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000299) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2349> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000029a [2,head] /dc-dir/dc-file_165 auth v2820 s=3 n(v0 rc2023-10-03T19:17:47.600733+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94255180] 2023-10-03T19:21:24.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2348> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000029a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2347> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000029b [2,head] /dc-dir/dc-file_166 auth v2822 s=3 n(v0 rc2023-10-03T19:17:47.611020+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94255700] 2023-10-03T19:21:24.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2346> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000029b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2345> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000029c [2,head] /dc-dir/dc-file_167 auth v2824 s=3 n(v0 rc2023-10-03T19:17:47.621331+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc93f12000] 2023-10-03T19:21:24.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2344> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000029c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.500 INFO:teuthology.orchestra.run.smithi045.stdout: -2343> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000029d [2,head] /dc-dir/dc-file_168 auth v2826 s=3 n(v0 rc2023-10-03T19:17:47.631305+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc93f12580] 2023-10-03T19:21:24.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2342> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000029d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2341> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000029e [2,head] /dc-dir/dc-file_169 auth v2828 s=3 n(v0 rc2023-10-03T19:17:47.641617+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc93f12b00] 2023-10-03T19:21:24.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2340> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000029e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2339> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000029f [2,head] /dc-dir/dc-file_170 auth v2830 s=3 n(v0 rc2023-10-03T19:17:47.651881+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc93f13080] 2023-10-03T19:21:24.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2338> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000029f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2337> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002a0 [2,head] /dc-dir/dc-file_171 auth v2832 s=3 n(v0 rc2023-10-03T19:17:47.662464+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc93f13600] 2023-10-03T19:21:24.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2336> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2335> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002a1 [2,head] /dc-dir/dc-file_172 auth v2834 s=3 n(v0 rc2023-10-03T19:17:47.672669+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc93f13b80] 2023-10-03T19:21:24.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2334> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2333> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002a2 [2,head] /dc-dir/dc-file_173 auth v2836 s=3 n(v0 rc2023-10-03T19:17:47.683892+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc93f14100] 2023-10-03T19:21:24.501 INFO:teuthology.orchestra.run.smithi045.stdout: -2332> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.502 INFO:teuthology.orchestra.run.smithi045.stdout: -2331> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002a3 [2,head] /dc-dir/dc-file_174 auth v2838 s=3 n(v0 rc2023-10-03T19:17:47.694182+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc93f14680] 2023-10-03T19:21:24.502 INFO:teuthology.orchestra.run.smithi045.stdout: -2330> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.502 INFO:teuthology.orchestra.run.smithi045.stdout: -2329> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002a4 [2,head] /dc-dir/dc-file_175 auth v2840 s=3 n(v0 rc2023-10-03T19:17:47.704726+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc93f14c00] 2023-10-03T19:21:24.502 INFO:teuthology.orchestra.run.smithi045.stdout: -2328> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.502 INFO:teuthology.orchestra.run.smithi045.stdout: -2327> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002a5 [2,head] /dc-dir/dc-file_176 auth v2842 s=3 n(v0 rc2023-10-03T19:17:47.715702+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc93f15180] 2023-10-03T19:21:24.502 INFO:teuthology.orchestra.run.smithi045.stdout: -2326> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.502 INFO:teuthology.orchestra.run.smithi045.stdout: -2325> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002a6 [2,head] /dc-dir/dc-file_177 auth v2844 s=3 n(v0 rc2023-10-03T19:17:47.725885+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc93f15700] 2023-10-03T19:21:24.502 INFO:teuthology.orchestra.run.smithi045.stdout: -2324> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.502 INFO:teuthology.orchestra.run.smithi045.stdout: -2323> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002a7 [2,head] /dc-dir/dc-file_178 auth v2846 s=3 n(v0 rc2023-10-03T19:17:47.737142+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc93f18000] 2023-10-03T19:21:24.502 INFO:teuthology.orchestra.run.smithi045.stdout: -2322> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.502 INFO:teuthology.orchestra.run.smithi045.stdout: -2321> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002a8 [2,head] /dc-dir/dc-file_179 auth v2848 s=3 n(v0 rc2023-10-03T19:17:47.747461+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc93f18580] 2023-10-03T19:21:24.503 INFO:teuthology.orchestra.run.smithi045.stdout: -2320> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.503 INFO:teuthology.orchestra.run.smithi045.stdout: -2319> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002a9 [2,head] /dc-dir/dc-file_180 auth v2850 s=3 n(v0 rc2023-10-03T19:17:47.758474+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc93f18b00] 2023-10-03T19:21:24.503 INFO:teuthology.orchestra.run.smithi045.stdout: -2318> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002a9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.503 INFO:teuthology.orchestra.run.smithi045.stdout: -2317> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002aa [2,head] /dc-dir/dc-file_181 auth v2852 s=3 n(v0 rc2023-10-03T19:17:47.769014+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc93f19080] 2023-10-03T19:21:24.503 INFO:teuthology.orchestra.run.smithi045.stdout: -2316> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002aa) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.503 INFO:teuthology.orchestra.run.smithi045.stdout: -2315> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ab [2,head] /dc-dir/dc-file_182 auth v2854 s=3 n(v0 rc2023-10-03T19:17:47.779544+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc93f19600] 2023-10-03T19:21:24.503 INFO:teuthology.orchestra.run.smithi045.stdout: -2314> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ab) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.503 INFO:teuthology.orchestra.run.smithi045.stdout: -2313> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ac [2,head] /dc-dir/dc-file_183 auth v2856 s=3 n(v0 rc2023-10-03T19:17:47.789932+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc93f19b80] 2023-10-03T19:21:24.503 INFO:teuthology.orchestra.run.smithi045.stdout: -2312> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ac) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.503 INFO:teuthology.orchestra.run.smithi045.stdout: -2311> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ad [2,head] /dc-dir/dc-file_184 auth v2858 s=3 n(v0 rc2023-10-03T19:17:47.800015+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc93f1a100] 2023-10-03T19:21:24.503 INFO:teuthology.orchestra.run.smithi045.stdout: -2310> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ad) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.504 INFO:teuthology.orchestra.run.smithi045.stdout: -2309> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ae [2,head] /dc-dir/dc-file_185 auth v2860 s=3 n(v0 rc2023-10-03T19:17:47.810520+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc93f1a680] 2023-10-03T19:21:24.504 INFO:teuthology.orchestra.run.smithi045.stdout: -2308> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ae) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.504 INFO:teuthology.orchestra.run.smithi045.stdout: -2307> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002af [2,head] /dc-dir/dc-file_186 auth v2862 s=3 n(v0 rc2023-10-03T19:17:47.822006+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc93f1ac00] 2023-10-03T19:21:24.504 INFO:teuthology.orchestra.run.smithi045.stdout: -2306> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002af) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.504 INFO:teuthology.orchestra.run.smithi045.stdout: -2305> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002b0 [2,head] /dc-dir/dc-file_187 auth v2864 s=3 n(v0 rc2023-10-03T19:17:47.835044+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc93f1b180] 2023-10-03T19:21:24.504 INFO:teuthology.orchestra.run.smithi045.stdout: -2304> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.504 INFO:teuthology.orchestra.run.smithi045.stdout: -2303> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002b1 [2,head] /dc-dir/dc-file_188 auth v2866 s=3 n(v0 rc2023-10-03T19:17:47.847052+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc93f1b700] 2023-10-03T19:21:24.504 INFO:teuthology.orchestra.run.smithi045.stdout: -2302> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.504 INFO:teuthology.orchestra.run.smithi045.stdout: -2301> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002b2 [2,head] /dc-dir/dc-file_189 auth v2868 s=3 n(v0 rc2023-10-03T19:17:47.859187+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94264000] 2023-10-03T19:21:24.504 INFO:teuthology.orchestra.run.smithi045.stdout: -2300> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.504 INFO:teuthology.orchestra.run.smithi045.stdout: -2299> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002b3 [2,head] /dc-dir/dc-file_190 auth v2870 s=3 n(v0 rc2023-10-03T19:17:47.870571+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94264580] 2023-10-03T19:21:24.505 INFO:teuthology.orchestra.run.smithi045.stdout: -2298> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.505 INFO:teuthology.orchestra.run.smithi045.stdout: -2297> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002b4 [2,head] /dc-dir/dc-file_191 auth v2872 s=3 n(v0 rc2023-10-03T19:17:47.881018+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94264b00] 2023-10-03T19:21:24.505 INFO:teuthology.orchestra.run.smithi045.stdout: -2296> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.505 INFO:teuthology.orchestra.run.smithi045.stdout: -2295> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002b5 [2,head] /dc-dir/dc-file_192 auth v2874 s=3 n(v0 rc2023-10-03T19:17:47.891416+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94265080] 2023-10-03T19:21:24.505 INFO:teuthology.orchestra.run.smithi045.stdout: -2294> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.505 INFO:teuthology.orchestra.run.smithi045.stdout: -2293> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002b6 [2,head] /dc-dir/dc-file_193 auth v2876 s=3 n(v0 rc2023-10-03T19:17:47.901644+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94265600] 2023-10-03T19:21:24.505 INFO:teuthology.orchestra.run.smithi045.stdout: -2292> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.505 INFO:teuthology.orchestra.run.smithi045.stdout: -2291> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002b7 [2,head] /dc-dir/dc-file_194 auth v2878 s=3 n(v0 rc2023-10-03T19:17:47.911813+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94265b80] 2023-10-03T19:21:24.505 INFO:teuthology.orchestra.run.smithi045.stdout: -2290> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.505 INFO:teuthology.orchestra.run.smithi045.stdout: -2289> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002b8 [2,head] /dc-dir/dc-file_195 auth v2880 s=3 n(v0 rc2023-10-03T19:17:47.922417+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94266100] 2023-10-03T19:21:24.505 INFO:teuthology.orchestra.run.smithi045.stdout: -2288> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.506 INFO:teuthology.orchestra.run.smithi045.stdout: -2287> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002b9 [2,head] /dc-dir/dc-file_196 auth v2882 s=3 n(v0 rc2023-10-03T19:17:47.934142+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94266680] 2023-10-03T19:21:24.506 INFO:teuthology.orchestra.run.smithi045.stdout: -2286> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002b9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.506 INFO:teuthology.orchestra.run.smithi045.stdout: -2285> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ba [2,head] /dc-dir/dc-file_197 auth v2884 s=3 n(v0 rc2023-10-03T19:17:47.944845+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94266c00] 2023-10-03T19:21:24.506 INFO:teuthology.orchestra.run.smithi045.stdout: -2284> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ba) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.506 INFO:teuthology.orchestra.run.smithi045.stdout: -2283> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002bb [2,head] /dc-dir/dc-file_198 auth v2886 s=3 n(v0 rc2023-10-03T19:17:47.955134+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94267180] 2023-10-03T19:21:24.506 INFO:teuthology.orchestra.run.smithi045.stdout: -2282> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002bb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.506 INFO:teuthology.orchestra.run.smithi045.stdout: -2281> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002bc [2,head] /dc-dir/dc-file_199 auth v2888 s=3 n(v0 rc2023-10-03T19:17:47.965290+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94267700] 2023-10-03T19:21:24.506 INFO:teuthology.orchestra.run.smithi045.stdout: -2280> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002bc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.506 INFO:teuthology.orchestra.run.smithi045.stdout: -2279> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002bd [2,head] /dc-dir/dc-file_200 auth v2890 s=3 n(v0 rc2023-10-03T19:17:47.975368+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94270000] 2023-10-03T19:21:24.506 INFO:teuthology.orchestra.run.smithi045.stdout: -2278> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002bd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.506 INFO:teuthology.orchestra.run.smithi045.stdout: -2277> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002be [2,head] /dc-dir/dc-file_201 auth v2892 s=3 n(v0 rc2023-10-03T19:17:47.985894+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94270580] 2023-10-03T19:21:24.507 INFO:teuthology.orchestra.run.smithi045.stdout: -2276> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002be) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.507 INFO:teuthology.orchestra.run.smithi045.stdout: -2275> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002bf [2,head] /dc-dir/dc-file_202 auth v2894 s=3 n(v0 rc2023-10-03T19:17:47.996258+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94270b00] 2023-10-03T19:21:24.507 INFO:teuthology.orchestra.run.smithi045.stdout: -2274> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002bf) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.507 INFO:teuthology.orchestra.run.smithi045.stdout: -2273> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002c0 [2,head] /dc-dir/dc-file_203 auth v2896 s=3 n(v0 rc2023-10-03T19:17:48.006456+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94271080] 2023-10-03T19:21:24.507 INFO:teuthology.orchestra.run.smithi045.stdout: -2272> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.507 INFO:teuthology.orchestra.run.smithi045.stdout: -2271> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002c1 [2,head] /dc-dir/dc-file_204 auth v2898 s=3 n(v0 rc2023-10-03T19:17:48.016571+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94271600] 2023-10-03T19:21:24.507 INFO:teuthology.orchestra.run.smithi045.stdout: -2270> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.507 INFO:teuthology.orchestra.run.smithi045.stdout: -2269> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002c2 [2,head] /dc-dir/dc-file_205 auth v2900 s=3 n(v0 rc2023-10-03T19:17:48.026443+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94271b80] 2023-10-03T19:21:24.507 INFO:teuthology.orchestra.run.smithi045.stdout: -2268> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.507 INFO:teuthology.orchestra.run.smithi045.stdout: -2267> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002c3 [2,head] /dc-dir/dc-file_206 auth v2902 s=3 n(v0 rc2023-10-03T19:17:48.037477+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94272100] 2023-10-03T19:21:24.507 INFO:teuthology.orchestra.run.smithi045.stdout: -2266> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.508 INFO:teuthology.orchestra.run.smithi045.stdout: -2265> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002c4 [2,head] /dc-dir/dc-file_207 auth v2904 s=3 n(v0 rc2023-10-03T19:17:48.048505+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94272680] 2023-10-03T19:21:24.508 INFO:teuthology.orchestra.run.smithi045.stdout: -2264> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.508 INFO:teuthology.orchestra.run.smithi045.stdout: -2263> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002c5 [2,head] /dc-dir/dc-file_208 auth v2906 s=3 n(v0 rc2023-10-03T19:17:48.060232+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94272c00] 2023-10-03T19:21:24.508 INFO:teuthology.orchestra.run.smithi045.stdout: -2262> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.508 INFO:teuthology.orchestra.run.smithi045.stdout: -2261> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002c6 [2,head] /dc-dir/dc-file_209 auth v2908 s=3 n(v0 rc2023-10-03T19:17:48.072099+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94273180] 2023-10-03T19:21:24.508 INFO:teuthology.orchestra.run.smithi045.stdout: -2260> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.508 INFO:teuthology.orchestra.run.smithi045.stdout: -2259> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002c7 [2,head] /dc-dir/dc-file_210 auth v3198 s=3 n(v0 rc2023-10-03T19:17:48.082815+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94273700] 2023-10-03T19:21:24.508 INFO:teuthology.orchestra.run.smithi045.stdout: -2258> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.508 INFO:teuthology.orchestra.run.smithi045.stdout: -2257> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002c8 [2,head] /dc-dir/dc-file_211 auth v3200 s=3 n(v0 rc2023-10-03T19:17:48.093685+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94280000] 2023-10-03T19:21:24.508 INFO:teuthology.orchestra.run.smithi045.stdout: -2256> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.508 INFO:teuthology.orchestra.run.smithi045.stdout: -2255> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002c9 [2,head] /dc-dir/dc-file_212 auth v3202 s=3 n(v0 rc2023-10-03T19:17:48.104827+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94280580] 2023-10-03T19:21:24.509 INFO:teuthology.orchestra.run.smithi045.stdout: -2254> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002c9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.509 INFO:teuthology.orchestra.run.smithi045.stdout: -2253> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ca [2,head] /dc-dir/dc-file_213 auth v3204 s=3 n(v0 rc2023-10-03T19:17:48.116082+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94280b00] 2023-10-03T19:21:24.509 INFO:teuthology.orchestra.run.smithi045.stdout: -2252> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ca) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.509 INFO:teuthology.orchestra.run.smithi045.stdout: -2251> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002cb [2,head] /dc-dir/dc-file_214 auth v3206 s=3 n(v0 rc2023-10-03T19:17:48.127237+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94281080] 2023-10-03T19:21:24.509 INFO:teuthology.orchestra.run.smithi045.stdout: -2250> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002cb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.509 INFO:teuthology.orchestra.run.smithi045.stdout: -2249> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002cc [2,head] /dc-dir/dc-file_215 auth v3208 s=3 n(v0 rc2023-10-03T19:17:48.138200+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94281600] 2023-10-03T19:21:24.509 INFO:teuthology.orchestra.run.smithi045.stdout: -2248> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002cc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.509 INFO:teuthology.orchestra.run.smithi045.stdout: -2247> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002cd [2,head] /dc-dir/dc-file_216 auth v3210 s=3 n(v0 rc2023-10-03T19:17:48.149125+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94281b80] 2023-10-03T19:21:24.509 INFO:teuthology.orchestra.run.smithi045.stdout: -2246> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002cd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.509 INFO:teuthology.orchestra.run.smithi045.stdout: -2245> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ce [2,head] /dc-dir/dc-file_217 auth v3212 s=3 n(v0 rc2023-10-03T19:17:48.161265+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94282100] 2023-10-03T19:21:24.509 INFO:teuthology.orchestra.run.smithi045.stdout: -2244> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ce) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.510 INFO:teuthology.orchestra.run.smithi045.stdout: -2243> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002cf [2,head] /dc-dir/dc-file_218 auth v3214 s=3 n(v0 rc2023-10-03T19:17:48.173659+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94282680] 2023-10-03T19:21:24.510 INFO:teuthology.orchestra.run.smithi045.stdout: -2242> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002cf) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.510 INFO:teuthology.orchestra.run.smithi045.stdout: -2241> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002d0 [2,head] /dc-dir/dc-file_219 auth v3216 s=3 n(v0 rc2023-10-03T19:17:48.185152+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94282c00] 2023-10-03T19:21:24.510 INFO:teuthology.orchestra.run.smithi045.stdout: -2240> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.510 INFO:teuthology.orchestra.run.smithi045.stdout: -2239> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002d1 [2,head] /dc-dir/dc-file_220 auth v3218 s=3 n(v0 rc2023-10-03T19:17:48.196217+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94283180] 2023-10-03T19:21:24.510 INFO:teuthology.orchestra.run.smithi045.stdout: -2238> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.510 INFO:teuthology.orchestra.run.smithi045.stdout: -2237> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002d2 [2,head] /dc-dir/dc-file_221 auth v3220 s=3 n(v0 rc2023-10-03T19:17:48.206667+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94283700] 2023-10-03T19:21:24.510 INFO:teuthology.orchestra.run.smithi045.stdout: -2236> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.510 INFO:teuthology.orchestra.run.smithi045.stdout: -2235> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002d3 [2,head] /dc-dir/dc-file_222 auth v3222 s=3 n(v0 rc2023-10-03T19:17:48.217761+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9428e000] 2023-10-03T19:21:24.510 INFO:teuthology.orchestra.run.smithi045.stdout: -2234> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.511 INFO:teuthology.orchestra.run.smithi045.stdout: -2233> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002d4 [2,head] /dc-dir/dc-file_223 auth v3224 s=3 n(v0 rc2023-10-03T19:17:48.228542+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9428e580] 2023-10-03T19:21:24.511 INFO:teuthology.orchestra.run.smithi045.stdout: -2232> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.511 INFO:teuthology.orchestra.run.smithi045.stdout: -2231> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002d5 [2,head] /dc-dir/dc-file_224 auth v3226 s=3 n(v0 rc2023-10-03T19:17:48.239446+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9428eb00] 2023-10-03T19:21:24.511 INFO:teuthology.orchestra.run.smithi045.stdout: -2230> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.511 INFO:teuthology.orchestra.run.smithi045.stdout: -2229> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002d6 [2,head] /dc-dir/dc-file_225 auth v3228 s=3 n(v0 rc2023-10-03T19:17:48.249894+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9428f080] 2023-10-03T19:21:24.511 INFO:teuthology.orchestra.run.smithi045.stdout: -2228> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.511 INFO:teuthology.orchestra.run.smithi045.stdout: -2227> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002d7 [2,head] /dc-dir/dc-file_226 auth v3230 s=3 n(v0 rc2023-10-03T19:17:48.260604+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9428f600] 2023-10-03T19:21:24.511 INFO:teuthology.orchestra.run.smithi045.stdout: -2226> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.511 INFO:teuthology.orchestra.run.smithi045.stdout: -2225> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002d8 [2,head] /dc-dir/dc-file_227 auth v3232 s=3 n(v0 rc2023-10-03T19:17:48.271413+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9428fb80] 2023-10-03T19:21:24.511 INFO:teuthology.orchestra.run.smithi045.stdout: -2224> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.511 INFO:teuthology.orchestra.run.smithi045.stdout: -2223> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002d9 [2,head] /dc-dir/dc-file_228 auth v3234 s=3 n(v0 rc2023-10-03T19:17:48.282286+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94290100] 2023-10-03T19:21:24.511 INFO:teuthology.orchestra.run.smithi045.stdout: -2222> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002d9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.512 INFO:teuthology.orchestra.run.smithi045.stdout: -2221> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002da [2,head] /dc-dir/dc-file_229 auth v3236 s=3 n(v0 rc2023-10-03T19:17:48.292591+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94290680] 2023-10-03T19:21:24.512 INFO:teuthology.orchestra.run.smithi045.stdout: -2220> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002da) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.512 INFO:teuthology.orchestra.run.smithi045.stdout: -2219> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002db [2,head] /dc-dir/dc-file_230 auth v3238 s=3 n(v0 rc2023-10-03T19:17:48.304318+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94290c00] 2023-10-03T19:21:24.512 INFO:teuthology.orchestra.run.smithi045.stdout: -2218> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002db) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.512 INFO:teuthology.orchestra.run.smithi045.stdout: -2217> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002dc [2,head] /dc-dir/dc-file_231 auth v3240 s=3 n(v0 rc2023-10-03T19:17:48.315582+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94291180] 2023-10-03T19:21:24.512 INFO:teuthology.orchestra.run.smithi045.stdout: -2216> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002dc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.512 INFO:teuthology.orchestra.run.smithi045.stdout: -2215> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002dd [2,head] /dc-dir/dc-file_232 auth v3242 s=3 n(v0 rc2023-10-03T19:17:48.326281+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94291700] 2023-10-03T19:21:24.512 INFO:teuthology.orchestra.run.smithi045.stdout: -2214> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002dd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.512 INFO:teuthology.orchestra.run.smithi045.stdout: -2213> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002de [2,head] /dc-dir/dc-file_233 auth v3244 s=3 n(v0 rc2023-10-03T19:17:48.336393+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9429e000] 2023-10-03T19:21:24.512 INFO:teuthology.orchestra.run.smithi045.stdout: -2212> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002de) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.512 INFO:teuthology.orchestra.run.smithi045.stdout: -2211> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002df [2,head] /dc-dir/dc-file_234 auth v3246 s=3 n(v0 rc2023-10-03T19:17:48.348306+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9429e580] 2023-10-03T19:21:24.513 INFO:teuthology.orchestra.run.smithi045.stdout: -2210> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002df) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.513 INFO:teuthology.orchestra.run.smithi045.stdout: -2209> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002e0 [2,head] /dc-dir/dc-file_235 auth v3248 s=3 n(v0 rc2023-10-03T19:17:48.358719+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9429eb00] 2023-10-03T19:21:24.513 INFO:teuthology.orchestra.run.smithi045.stdout: -2208> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.513 INFO:teuthology.orchestra.run.smithi045.stdout: -2207> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002e1 [2,head] /dc-dir/dc-file_236 auth v3250 s=3 n(v0 rc2023-10-03T19:17:48.368880+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9429f080] 2023-10-03T19:21:24.513 INFO:teuthology.orchestra.run.smithi045.stdout: -2206> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.513 INFO:teuthology.orchestra.run.smithi045.stdout: -2205> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002e2 [2,head] /dc-dir/dc-file_237 auth v3252 s=3 n(v0 rc2023-10-03T19:17:48.379761+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9429f600] 2023-10-03T19:21:24.513 INFO:teuthology.orchestra.run.smithi045.stdout: -2204> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.513 INFO:teuthology.orchestra.run.smithi045.stdout: -2203> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002e3 [2,head] /dc-dir/dc-file_238 auth v3254 s=3 n(v0 rc2023-10-03T19:17:48.391448+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9429fb80] 2023-10-03T19:21:24.513 INFO:teuthology.orchestra.run.smithi045.stdout: -2202> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.513 INFO:teuthology.orchestra.run.smithi045.stdout: -2201> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002e4 [2,head] /dc-dir/dc-file_239 auth v3256 s=3 n(v0 rc2023-10-03T19:17:48.404358+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942a0100] 2023-10-03T19:21:24.513 INFO:teuthology.orchestra.run.smithi045.stdout: -2200> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.514 INFO:teuthology.orchestra.run.smithi045.stdout: -2199> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002e5 [2,head] /dc-dir/dc-file_240 auth v3258 s=3 n(v0 rc2023-10-03T19:17:48.415941+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942a0680] 2023-10-03T19:21:24.514 INFO:teuthology.orchestra.run.smithi045.stdout: -2198> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.514 INFO:teuthology.orchestra.run.smithi045.stdout: -2197> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002e6 [2,head] /dc-dir/dc-file_241 auth v3260 s=3 n(v0 rc2023-10-03T19:17:48.427028+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942a0c00] 2023-10-03T19:21:24.514 INFO:teuthology.orchestra.run.smithi045.stdout: -2196> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.514 INFO:teuthology.orchestra.run.smithi045.stdout: -2195> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002e7 [2,head] /dc-dir/dc-file_242 auth v3262 s=3 n(v0 rc2023-10-03T19:17:48.440532+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942a1180] 2023-10-03T19:21:24.514 INFO:teuthology.orchestra.run.smithi045.stdout: -2194> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.514 INFO:teuthology.orchestra.run.smithi045.stdout: -2193> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002e8 [2,head] /dc-dir/dc-file_243 auth v3264 s=3 n(v0 rc2023-10-03T19:17:48.453618+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942a1700] 2023-10-03T19:21:24.514 INFO:teuthology.orchestra.run.smithi045.stdout: -2192> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.514 INFO:teuthology.orchestra.run.smithi045.stdout: -2191> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002e9 [2,head] /dc-dir/dc-file_244 auth v3266 s=3 n(v0 rc2023-10-03T19:17:48.464466+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942b2000] 2023-10-03T19:21:24.514 INFO:teuthology.orchestra.run.smithi045.stdout: -2190> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002e9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.515 INFO:teuthology.orchestra.run.smithi045.stdout: -2189> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ea [2,head] /dc-dir/dc-file_245 auth v3268 s=3 n(v0 rc2023-10-03T19:17:48.475794+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942b2580] 2023-10-03T19:21:24.515 INFO:teuthology.orchestra.run.smithi045.stdout: -2188> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ea) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.515 INFO:teuthology.orchestra.run.smithi045.stdout: -2187> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002eb [2,head] /dc-dir/dc-file_246 auth v3270 s=3 n(v0 rc2023-10-03T19:17:48.486630+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942b2b00] 2023-10-03T19:21:24.515 INFO:teuthology.orchestra.run.smithi045.stdout: -2186> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002eb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.515 INFO:teuthology.orchestra.run.smithi045.stdout: -2185> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ec [2,head] /dc-dir/dc-file_247 auth v3272 s=3 n(v0 rc2023-10-03T19:17:48.497646+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942b3080] 2023-10-03T19:21:24.515 INFO:teuthology.orchestra.run.smithi045.stdout: -2184> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ec) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.515 INFO:teuthology.orchestra.run.smithi045.stdout: -2183> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ed [2,head] /dc-dir/dc-file_248 auth v3274 s=3 n(v0 rc2023-10-03T19:17:48.510566+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942b3600] 2023-10-03T19:21:24.515 INFO:teuthology.orchestra.run.smithi045.stdout: -2182> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ed) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.515 INFO:teuthology.orchestra.run.smithi045.stdout: -2181> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ee [2,head] /dc-dir/dc-file_249 auth v3276 s=3 n(v0 rc2023-10-03T19:17:48.524056+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942b3b80] 2023-10-03T19:21:24.515 INFO:teuthology.orchestra.run.smithi045.stdout: -2180> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ee) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.515 INFO:teuthology.orchestra.run.smithi045.stdout: -2179> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ef [2,head] /dc-dir/dc-file_250 auth v3278 s=3 n(v0 rc2023-10-03T19:17:48.537155+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942b4100] 2023-10-03T19:21:24.516 INFO:teuthology.orchestra.run.smithi045.stdout: -2178> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ef) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.516 INFO:teuthology.orchestra.run.smithi045.stdout: -2177> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002f0 [2,head] /dc-dir/dc-file_251 auth v3280 s=3 n(v0 rc2023-10-03T19:17:48.550095+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942b4680] 2023-10-03T19:21:24.516 INFO:teuthology.orchestra.run.smithi045.stdout: -2176> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.516 INFO:teuthology.orchestra.run.smithi045.stdout: -2175> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002f1 [2,head] /dc-dir/dc-file_252 auth v3282 s=3 n(v0 rc2023-10-03T19:17:48.561807+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942b4c00] 2023-10-03T19:21:24.516 INFO:teuthology.orchestra.run.smithi045.stdout: -2174> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.516 INFO:teuthology.orchestra.run.smithi045.stdout: -2173> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002f2 [2,head] /dc-dir/dc-file_253 auth v3284 s=3 n(v0 rc2023-10-03T19:17:48.572345+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942b5180] 2023-10-03T19:21:24.516 INFO:teuthology.orchestra.run.smithi045.stdout: -2172> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.516 INFO:teuthology.orchestra.run.smithi045.stdout: -2171> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002f3 [2,head] /dc-dir/dc-file_254 auth v3286 s=3 n(v0 rc2023-10-03T19:17:48.583838+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942b5700] 2023-10-03T19:21:24.516 INFO:teuthology.orchestra.run.smithi045.stdout: -2170> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.516 INFO:teuthology.orchestra.run.smithi045.stdout: -2169> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002f4 [2,head] /dc-dir/dc-file_255 auth v3288 s=3 n(v0 rc2023-10-03T19:17:48.595413+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942c0000] 2023-10-03T19:21:24.516 INFO:teuthology.orchestra.run.smithi045.stdout: -2168> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.517 INFO:teuthology.orchestra.run.smithi045.stdout: -2167> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002f5 [2,head] /dc-dir/dc-file_256 auth v3290 s=3 n(v0 rc2023-10-03T19:17:48.607634+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942c0580] 2023-10-03T19:21:24.517 INFO:teuthology.orchestra.run.smithi045.stdout: -2166> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.517 INFO:teuthology.orchestra.run.smithi045.stdout: -2165> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002f6 [2,head] /dc-dir/dc-file_257 auth v3292 s=3 n(v0 rc2023-10-03T19:17:48.618304+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942c0b00] 2023-10-03T19:21:24.517 INFO:teuthology.orchestra.run.smithi045.stdout: -2164> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.517 INFO:teuthology.orchestra.run.smithi045.stdout: -2163> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002f7 [2,head] /dc-dir/dc-file_258 auth v3294 s=3 n(v0 rc2023-10-03T19:17:48.629470+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942c1080] 2023-10-03T19:21:24.517 INFO:teuthology.orchestra.run.smithi045.stdout: -2162> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.517 INFO:teuthology.orchestra.run.smithi045.stdout: -2161> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002f8 [2,head] /dc-dir/dc-file_259 auth v3296 s=3 n(v0 rc2023-10-03T19:17:48.640249+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942c1600] 2023-10-03T19:21:24.517 INFO:teuthology.orchestra.run.smithi045.stdout: -2160> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.517 INFO:teuthology.orchestra.run.smithi045.stdout: -2159> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002f9 [2,head] /dc-dir/dc-file_260 auth v3298 s=3 n(v0 rc2023-10-03T19:17:48.651357+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942c1b80] 2023-10-03T19:21:24.517 INFO:teuthology.orchestra.run.smithi045.stdout: -2158> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002f9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.517 INFO:teuthology.orchestra.run.smithi045.stdout: -2157> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002fa [2,head] /dc-dir/dc-file_261 auth v3300 s=3 n(v0 rc2023-10-03T19:17:48.662672+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942c2100] 2023-10-03T19:21:24.518 INFO:teuthology.orchestra.run.smithi045.stdout: -2156> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002fa) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.518 INFO:teuthology.orchestra.run.smithi045.stdout: -2155> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002fb [2,head] /dc-dir/dc-file_262 auth v3302 s=3 n(v0 rc2023-10-03T19:17:48.674070+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942c2680] 2023-10-03T19:21:24.518 INFO:teuthology.orchestra.run.smithi045.stdout: -2154> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002fb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.518 INFO:teuthology.orchestra.run.smithi045.stdout: -2153> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002fc [2,head] /dc-dir/dc-file_263 auth v3304 s=3 n(v0 rc2023-10-03T19:17:48.685826+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942c2c00] 2023-10-03T19:21:24.518 INFO:teuthology.orchestra.run.smithi045.stdout: -2152> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002fc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.518 INFO:teuthology.orchestra.run.smithi045.stdout: -2151> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002fd [2,head] /dc-dir/dc-file_264 auth v3306 s=3 n(v0 rc2023-10-03T19:17:48.697314+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942c3180] 2023-10-03T19:21:24.518 INFO:teuthology.orchestra.run.smithi045.stdout: -2150> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002fd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.518 INFO:teuthology.orchestra.run.smithi045.stdout: -2149> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002fe [2,head] /dc-dir/dc-file_265 auth v3308 s=3 n(v0 rc2023-10-03T19:17:48.709017+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942c3700] 2023-10-03T19:21:24.518 INFO:teuthology.orchestra.run.smithi045.stdout: -2148> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002fe) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.518 INFO:teuthology.orchestra.run.smithi045.stdout: -2147> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000002ff [2,head] /dc-dir/dc-file_266 auth v3310 s=3 n(v0 rc2023-10-03T19:17:48.719919+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942cc000] 2023-10-03T19:21:24.518 INFO:teuthology.orchestra.run.smithi045.stdout: -2146> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000002ff) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.519 INFO:teuthology.orchestra.run.smithi045.stdout: -2145> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000300 [2,head] /dc-dir/dc-file_267 auth v3312 s=3 n(v0 rc2023-10-03T19:17:48.731277+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942cc580] 2023-10-03T19:21:24.519 INFO:teuthology.orchestra.run.smithi045.stdout: -2144> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000300) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.519 INFO:teuthology.orchestra.run.smithi045.stdout: -2143> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000301 [2,head] /dc-dir/dc-file_268 auth v3314 s=3 n(v0 rc2023-10-03T19:17:48.742375+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942ccb00] 2023-10-03T19:21:24.519 INFO:teuthology.orchestra.run.smithi045.stdout: -2142> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000301) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.519 INFO:teuthology.orchestra.run.smithi045.stdout: -2141> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000302 [2,head] /dc-dir/dc-file_269 auth v3316 s=3 n(v0 rc2023-10-03T19:17:48.753863+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942cd080] 2023-10-03T19:21:24.519 INFO:teuthology.orchestra.run.smithi045.stdout: -2140> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000302) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.519 INFO:teuthology.orchestra.run.smithi045.stdout: -2139> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000303 [2,head] /dc-dir/dc-file_270 auth v3318 s=3 n(v0 rc2023-10-03T19:17:48.764274+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942cd600] 2023-10-03T19:21:24.519 INFO:teuthology.orchestra.run.smithi045.stdout: -2138> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000303) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.519 INFO:teuthology.orchestra.run.smithi045.stdout: -2137> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000304 [2,head] /dc-dir/dc-file_271 auth v3320 s=3 n(v0 rc2023-10-03T19:17:48.775045+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942cdb80] 2023-10-03T19:21:24.519 INFO:teuthology.orchestra.run.smithi045.stdout: -2136> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000304) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.519 INFO:teuthology.orchestra.run.smithi045.stdout: -2135> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000305 [2,head] /dc-dir/dc-file_272 auth v3322 s=3 n(v0 rc2023-10-03T19:17:48.786300+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942ce100] 2023-10-03T19:21:24.520 INFO:teuthology.orchestra.run.smithi045.stdout: -2134> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000305) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.520 INFO:teuthology.orchestra.run.smithi045.stdout: -2133> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000306 [2,head] /dc-dir/dc-file_273 auth v3324 s=3 n(v0 rc2023-10-03T19:17:48.797451+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942ce680] 2023-10-03T19:21:24.520 INFO:teuthology.orchestra.run.smithi045.stdout: -2132> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000306) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.520 INFO:teuthology.orchestra.run.smithi045.stdout: -2131> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000307 [2,head] /dc-dir/dc-file_274 auth v3326 s=3 n(v0 rc2023-10-03T19:17:48.809694+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942cec00] 2023-10-03T19:21:24.520 INFO:teuthology.orchestra.run.smithi045.stdout: -2130> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000307) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.520 INFO:teuthology.orchestra.run.smithi045.stdout: -2129> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000308 [2,head] /dc-dir/dc-file_275 auth v3328 s=3 n(v0 rc2023-10-03T19:17:48.821057+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942cf180] 2023-10-03T19:21:24.520 INFO:teuthology.orchestra.run.smithi045.stdout: -2128> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000308) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.520 INFO:teuthology.orchestra.run.smithi045.stdout: -2127> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000309 [2,head] /dc-dir/dc-file_276 auth v3330 s=3 n(v0 rc2023-10-03T19:17:48.833120+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942cf700] 2023-10-03T19:21:24.653 INFO:teuthology.orchestra.run.smithi045.stdout: -2126> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000309) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.654 INFO:teuthology.orchestra.run.smithi045.stdout: -2125> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000030a [2,head] /dc-dir/dc-file_277 auth v3332 s=3 n(v0 rc2023-10-03T19:17:48.844133+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942d4000] 2023-10-03T19:21:24.654 INFO:teuthology.orchestra.run.smithi045.stdout: -2124> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000030a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.654 INFO:teuthology.orchestra.run.smithi045.stdout: -2123> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000030b [2,head] /dc-dir/dc-file_278 auth v3334 s=3 n(v0 rc2023-10-03T19:17:48.854601+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942d4580] 2023-10-03T19:21:24.654 INFO:teuthology.orchestra.run.smithi045.stdout: -2122> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000030b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.654 INFO:teuthology.orchestra.run.smithi045.stdout: -2121> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000030c [2,head] /dc-dir/dc-file_279 auth v3336 s=3 n(v0 rc2023-10-03T19:17:48.867100+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942d4b00] 2023-10-03T19:21:24.654 INFO:teuthology.orchestra.run.smithi045.stdout: -2120> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000030c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.654 INFO:teuthology.orchestra.run.smithi045.stdout: -2119> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000030d [2,head] /dc-dir/dc-file_280 auth v3338 s=3 n(v0 rc2023-10-03T19:17:48.878300+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942d5080] 2023-10-03T19:21:24.654 INFO:teuthology.orchestra.run.smithi045.stdout: -2118> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000030d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.654 INFO:teuthology.orchestra.run.smithi045.stdout: -2117> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000030e [2,head] /dc-dir/dc-file_281 auth v3340 s=3 n(v0 rc2023-10-03T19:17:48.891478+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942d5600] 2023-10-03T19:21:24.654 INFO:teuthology.orchestra.run.smithi045.stdout: -2116> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000030e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.655 INFO:teuthology.orchestra.run.smithi045.stdout: -2115> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000030f [2,head] /dc-dir/dc-file_282 auth v3342 s=3 n(v0 rc2023-10-03T19:17:48.902571+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942d5b80] 2023-10-03T19:21:24.655 INFO:teuthology.orchestra.run.smithi045.stdout: -2114> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000030f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.655 INFO:teuthology.orchestra.run.smithi045.stdout: -2113> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000310 [2,head] /dc-dir/dc-file_283 auth v3344 s=3 n(v0 rc2023-10-03T19:17:48.913136+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942d6100] 2023-10-03T19:21:24.655 INFO:teuthology.orchestra.run.smithi045.stdout: -2112> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000310) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.655 INFO:teuthology.orchestra.run.smithi045.stdout: -2111> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000311 [2,head] /dc-dir/dc-file_284 auth v3346 s=3 n(v0 rc2023-10-03T19:17:48.923551+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942d6680] 2023-10-03T19:21:24.655 INFO:teuthology.orchestra.run.smithi045.stdout: -2110> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000311) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.655 INFO:teuthology.orchestra.run.smithi045.stdout: -2109> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000312 [2,head] /dc-dir/dc-file_285 auth v3348 s=3 n(v0 rc2023-10-03T19:17:48.934226+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942d6c00] 2023-10-03T19:21:24.655 INFO:teuthology.orchestra.run.smithi045.stdout: -2108> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000312) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.655 INFO:teuthology.orchestra.run.smithi045.stdout: -2107> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000313 [2,head] /dc-dir/dc-file_286 auth v3350 s=3 n(v0 rc2023-10-03T19:17:48.944851+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942d7180] 2023-10-03T19:21:24.655 INFO:teuthology.orchestra.run.smithi045.stdout: -2106> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000313) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.655 INFO:teuthology.orchestra.run.smithi045.stdout: -2105> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000314 [2,head] /dc-dir/dc-file_287 auth v3352 s=3 n(v0 rc2023-10-03T19:17:48.955690+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942d7700] 2023-10-03T19:21:24.655 INFO:teuthology.orchestra.run.smithi045.stdout: -2104> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000314) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.656 INFO:teuthology.orchestra.run.smithi045.stdout: -2103> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000315 [2,head] /dc-dir/dc-file_288 auth v3354 s=3 n(v0 rc2023-10-03T19:17:48.969143+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942e4000] 2023-10-03T19:21:24.656 INFO:teuthology.orchestra.run.smithi045.stdout: -2102> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000315) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.656 INFO:teuthology.orchestra.run.smithi045.stdout: -2101> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000316 [2,head] /dc-dir/dc-file_289 auth v3356 s=3 n(v0 rc2023-10-03T19:17:48.980864+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942e4580] 2023-10-03T19:21:24.656 INFO:teuthology.orchestra.run.smithi045.stdout: -2100> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000316) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.656 INFO:teuthology.orchestra.run.smithi045.stdout: -2099> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000317 [2,head] /dc-dir/dc-file_290 auth v3358 s=3 n(v0 rc2023-10-03T19:17:48.993729+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942e4b00] 2023-10-03T19:21:24.656 INFO:teuthology.orchestra.run.smithi045.stdout: -2098> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000317) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.656 INFO:teuthology.orchestra.run.smithi045.stdout: -2097> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000318 [2,head] /dc-dir/dc-file_291 auth v3360 s=3 n(v0 rc2023-10-03T19:17:49.004322+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942e5080] 2023-10-03T19:21:24.656 INFO:teuthology.orchestra.run.smithi045.stdout: -2096> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000318) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.656 INFO:teuthology.orchestra.run.smithi045.stdout: -2095> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000319 [2,head] /dc-dir/dc-file_292 auth v3362 s=3 n(v0 rc2023-10-03T19:17:49.016027+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942e5600] 2023-10-03T19:21:24.656 INFO:teuthology.orchestra.run.smithi045.stdout: -2094> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000319) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.656 INFO:teuthology.orchestra.run.smithi045.stdout: -2093> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000031a [2,head] /dc-dir/dc-file_293 auth v3364 s=3 n(v0 rc2023-10-03T19:17:49.027493+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942e5b80] 2023-10-03T19:21:24.657 INFO:teuthology.orchestra.run.smithi045.stdout: -2092> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000031a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.657 INFO:teuthology.orchestra.run.smithi045.stdout: -2091> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000031b [2,head] /dc-dir/dc-file_294 auth v3366 s=3 n(v0 rc2023-10-03T19:17:49.039625+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942e6100] 2023-10-03T19:21:24.657 INFO:teuthology.orchestra.run.smithi045.stdout: -2090> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000031b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.657 INFO:teuthology.orchestra.run.smithi045.stdout: -2089> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000031c [2,head] /dc-dir/dc-file_295 auth v3368 s=3 n(v0 rc2023-10-03T19:17:49.051486+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942e6680] 2023-10-03T19:21:24.657 INFO:teuthology.orchestra.run.smithi045.stdout: -2088> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000031c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.657 INFO:teuthology.orchestra.run.smithi045.stdout: -2087> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000031d [2,head] /dc-dir/dc-file_296 auth v3370 s=3 n(v0 rc2023-10-03T19:17:49.062125+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942e6c00] 2023-10-03T19:21:24.657 INFO:teuthology.orchestra.run.smithi045.stdout: -2086> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000031d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.657 INFO:teuthology.orchestra.run.smithi045.stdout: -2085> 2023-10-03T19:18:12.093+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000031e [2,head] /dc-dir/dc-file_297 auth v3372 s=3 n(v0 rc2023-10-03T19:17:49.073561+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942e7180] 2023-10-03T19:21:24.657 INFO:teuthology.orchestra.run.smithi045.stdout: -2084> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000031e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.657 INFO:teuthology.orchestra.run.smithi045.stdout: -2083> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000031f [2,head] /dc-dir/dc-file_298 auth v3662 s=3 n(v0 rc2023-10-03T19:17:49.085668+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942e7700] 2023-10-03T19:21:24.657 INFO:teuthology.orchestra.run.smithi045.stdout: -2082> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000031f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.657 INFO:teuthology.orchestra.run.smithi045.stdout: -2081> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000320 [2,head] /dc-dir/dc-file_299 auth v3664 s=3 n(v0 rc2023-10-03T19:17:49.096166+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942f0000] 2023-10-03T19:21:24.657 INFO:teuthology.orchestra.run.smithi045.stdout: -2080> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000320) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.658 INFO:teuthology.orchestra.run.smithi045.stdout: -2079> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000321 [2,head] /dc-dir/dc-file_300 auth v3666 s=3 n(v0 rc2023-10-03T19:17:49.107871+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942f0580] 2023-10-03T19:21:24.658 INFO:teuthology.orchestra.run.smithi045.stdout: -2078> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000321) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.658 INFO:teuthology.orchestra.run.smithi045.stdout: -2077> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000322 [2,head] /dc-dir/dc-file_301 auth v3668 s=3 n(v0 rc2023-10-03T19:17:49.119888+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942f0b00] 2023-10-03T19:21:24.658 INFO:teuthology.orchestra.run.smithi045.stdout: -2076> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000322) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.658 INFO:teuthology.orchestra.run.smithi045.stdout: -2075> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000323 [2,head] /dc-dir/dc-file_302 auth v3670 s=3 n(v0 rc2023-10-03T19:17:49.130859+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942f1080] 2023-10-03T19:21:24.658 INFO:teuthology.orchestra.run.smithi045.stdout: -2074> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000323) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.658 INFO:teuthology.orchestra.run.smithi045.stdout: -2073> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000324 [2,head] /dc-dir/dc-file_303 auth v3672 s=3 n(v0 rc2023-10-03T19:17:49.142314+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942f1600] 2023-10-03T19:21:24.658 INFO:teuthology.orchestra.run.smithi045.stdout: -2072> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000324) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.658 INFO:teuthology.orchestra.run.smithi045.stdout: -2071> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000325 [2,head] /dc-dir/dc-file_304 auth v3674 s=3 n(v0 rc2023-10-03T19:17:49.153691+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942f1b80] 2023-10-03T19:21:24.658 INFO:teuthology.orchestra.run.smithi045.stdout: -2070> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000325) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.658 INFO:teuthology.orchestra.run.smithi045.stdout: -2069> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000326 [2,head] /dc-dir/dc-file_305 auth v3676 s=3 n(v0 rc2023-10-03T19:17:49.164611+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942f2100] 2023-10-03T19:21:24.659 INFO:teuthology.orchestra.run.smithi045.stdout: -2068> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000326) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.659 INFO:teuthology.orchestra.run.smithi045.stdout: -2067> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000327 [2,head] /dc-dir/dc-file_306 auth v3678 s=3 n(v0 rc2023-10-03T19:17:49.175465+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942f2680] 2023-10-03T19:21:24.659 INFO:teuthology.orchestra.run.smithi045.stdout: -2066> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000327) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.659 INFO:teuthology.orchestra.run.smithi045.stdout: -2065> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000328 [2,head] /dc-dir/dc-file_307 auth v3680 s=3 n(v0 rc2023-10-03T19:17:49.186170+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942f2c00] 2023-10-03T19:21:24.659 INFO:teuthology.orchestra.run.smithi045.stdout: -2064> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000328) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.659 INFO:teuthology.orchestra.run.smithi045.stdout: -2063> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000329 [2,head] /dc-dir/dc-file_308 auth v3682 s=3 n(v0 rc2023-10-03T19:17:49.197024+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942f3180] 2023-10-03T19:21:24.659 INFO:teuthology.orchestra.run.smithi045.stdout: -2062> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000329) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.659 INFO:teuthology.orchestra.run.smithi045.stdout: -2061> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000032a [2,head] /dc-dir/dc-file_309 auth v3684 s=3 n(v0 rc2023-10-03T19:17:49.207265+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942f3700] 2023-10-03T19:21:24.659 INFO:teuthology.orchestra.run.smithi045.stdout: -2060> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000032a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.659 INFO:teuthology.orchestra.run.smithi045.stdout: -2059> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000032b [2,head] /dc-dir/dc-file_310 auth v3686 s=3 n(v0 rc2023-10-03T19:17:49.217610+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942fa000] 2023-10-03T19:21:24.662 INFO:teuthology.orchestra.run.smithi045.stdout: -2058> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000032b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.663 INFO:teuthology.orchestra.run.smithi045.stdout: -2057> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000032c [2,head] /dc-dir/dc-file_311 auth v3688 s=3 n(v0 rc2023-10-03T19:17:49.228463+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942fa580] 2023-10-03T19:21:24.663 INFO:teuthology.orchestra.run.smithi045.stdout: -2056> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000032c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.663 INFO:teuthology.orchestra.run.smithi045.stdout: -2055> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000032d [2,head] /dc-dir/dc-file_312 auth v3690 s=3 n(v0 rc2023-10-03T19:17:49.239272+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942fab00] 2023-10-03T19:21:24.663 INFO:teuthology.orchestra.run.smithi045.stdout: -2054> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000032d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.663 INFO:teuthology.orchestra.run.smithi045.stdout: -2053> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000032e [2,head] /dc-dir/dc-file_313 auth v3692 s=3 n(v0 rc2023-10-03T19:17:49.251104+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942fb080] 2023-10-03T19:21:24.663 INFO:teuthology.orchestra.run.smithi045.stdout: -2052> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000032e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.663 INFO:teuthology.orchestra.run.smithi045.stdout: -2051> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000032f [2,head] /dc-dir/dc-file_314 auth v3694 s=3 n(v0 rc2023-10-03T19:17:49.262031+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942fb600] 2023-10-03T19:21:24.663 INFO:teuthology.orchestra.run.smithi045.stdout: -2050> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000032f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.663 INFO:teuthology.orchestra.run.smithi045.stdout: -2049> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000330 [2,head] /dc-dir/dc-file_315 auth v3696 s=3 n(v0 rc2023-10-03T19:17:49.273139+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942fbb80] 2023-10-03T19:21:24.663 INFO:teuthology.orchestra.run.smithi045.stdout: -2048> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000330) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.663 INFO:teuthology.orchestra.run.smithi045.stdout: -2047> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000331 [2,head] /dc-dir/dc-file_316 auth v3698 s=3 n(v0 rc2023-10-03T19:17:49.283781+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942fc100] 2023-10-03T19:21:24.664 INFO:teuthology.orchestra.run.smithi045.stdout: -2046> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000331) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.664 INFO:teuthology.orchestra.run.smithi045.stdout: -2045> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000332 [2,head] /dc-dir/dc-file_317 auth v3700 s=3 n(v0 rc2023-10-03T19:17:49.294177+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942fc680] 2023-10-03T19:21:24.664 INFO:teuthology.orchestra.run.smithi045.stdout: -2044> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000332) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.664 INFO:teuthology.orchestra.run.smithi045.stdout: -2043> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000333 [2,head] /dc-dir/dc-file_318 auth v3702 s=3 n(v0 rc2023-10-03T19:17:49.304770+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942fcc00] 2023-10-03T19:21:24.664 INFO:teuthology.orchestra.run.smithi045.stdout: -2042> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000333) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.664 INFO:teuthology.orchestra.run.smithi045.stdout: -2041> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000334 [2,head] /dc-dir/dc-file_319 auth v3704 s=3 n(v0 rc2023-10-03T19:17:49.315622+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942fd180] 2023-10-03T19:21:24.664 INFO:teuthology.orchestra.run.smithi045.stdout: -2040> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000334) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.664 INFO:teuthology.orchestra.run.smithi045.stdout: -2039> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000335 [2,head] /dc-dir/dc-file_320 auth v3706 s=3 n(v0 rc2023-10-03T19:17:49.326794+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc942fd700] 2023-10-03T19:21:24.664 INFO:teuthology.orchestra.run.smithi045.stdout: -2038> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000335) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.664 INFO:teuthology.orchestra.run.smithi045.stdout: -2037> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000336 [2,head] /dc-dir/dc-file_321 auth v3708 s=3 n(v0 rc2023-10-03T19:17:49.337581+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94304000] 2023-10-03T19:21:24.664 INFO:teuthology.orchestra.run.smithi045.stdout: -2036> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000336) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.665 INFO:teuthology.orchestra.run.smithi045.stdout: -2035> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000337 [2,head] /dc-dir/dc-file_322 auth v3710 s=3 n(v0 rc2023-10-03T19:17:49.349906+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94304580] 2023-10-03T19:21:24.665 INFO:teuthology.orchestra.run.smithi045.stdout: -2034> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000337) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.665 INFO:teuthology.orchestra.run.smithi045.stdout: -2033> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000338 [2,head] /dc-dir/dc-file_323 auth v3712 s=3 n(v0 rc2023-10-03T19:17:49.361909+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94304b00] 2023-10-03T19:21:24.665 INFO:teuthology.orchestra.run.smithi045.stdout: -2032> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000338) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.665 INFO:teuthology.orchestra.run.smithi045.stdout: -2031> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000339 [2,head] /dc-dir/dc-file_324 auth v3714 s=3 n(v0 rc2023-10-03T19:17:49.373397+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94305080] 2023-10-03T19:21:24.665 INFO:teuthology.orchestra.run.smithi045.stdout: -2030> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000339) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.665 INFO:teuthology.orchestra.run.smithi045.stdout: -2029> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000033a [2,head] /dc-dir/dc-file_325 auth v3716 s=3 n(v0 rc2023-10-03T19:17:49.385353+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94305600] 2023-10-03T19:21:24.665 INFO:teuthology.orchestra.run.smithi045.stdout: -2028> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000033a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.665 INFO:teuthology.orchestra.run.smithi045.stdout: -2027> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000033b [2,head] /dc-dir/dc-file_326 auth v3718 s=3 n(v0 rc2023-10-03T19:17:49.396265+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94305b80] 2023-10-03T19:21:24.665 INFO:teuthology.orchestra.run.smithi045.stdout: -2026> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000033b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.665 INFO:teuthology.orchestra.run.smithi045.stdout: -2025> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000033c [2,head] /dc-dir/dc-file_327 auth v3720 s=3 n(v0 rc2023-10-03T19:17:49.407478+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94306100] 2023-10-03T19:21:24.665 INFO:teuthology.orchestra.run.smithi045.stdout: -2024> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000033c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.666 INFO:teuthology.orchestra.run.smithi045.stdout: -2023> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000033d [2,head] /dc-dir/dc-file_328 auth v3722 s=3 n(v0 rc2023-10-03T19:17:49.418590+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94306680] 2023-10-03T19:21:24.666 INFO:teuthology.orchestra.run.smithi045.stdout: -2022> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000033d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.666 INFO:teuthology.orchestra.run.smithi045.stdout: -2021> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000033e [2,head] /dc-dir/dc-file_329 auth v3724 s=3 n(v0 rc2023-10-03T19:17:49.431640+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94306c00] 2023-10-03T19:21:24.666 INFO:teuthology.orchestra.run.smithi045.stdout: -2020> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000033e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.666 INFO:teuthology.orchestra.run.smithi045.stdout: -2019> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000033f [2,head] /dc-dir/dc-file_330 auth v3726 s=3 n(v0 rc2023-10-03T19:17:49.444665+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94307180] 2023-10-03T19:21:24.666 INFO:teuthology.orchestra.run.smithi045.stdout: -2018> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000033f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.666 INFO:teuthology.orchestra.run.smithi045.stdout: -2017> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000340 [2,head] /dc-dir/dc-file_331 auth v3728 s=3 n(v0 rc2023-10-03T19:17:49.457548+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94307700] 2023-10-03T19:21:24.666 INFO:teuthology.orchestra.run.smithi045.stdout: -2016> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000340) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.666 INFO:teuthology.orchestra.run.smithi045.stdout: -2015> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000341 [2,head] /dc-dir/dc-file_332 auth v3730 s=3 n(v0 rc2023-10-03T19:17:49.469879+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94316000] 2023-10-03T19:21:24.666 INFO:teuthology.orchestra.run.smithi045.stdout: -2014> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000341) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.666 INFO:teuthology.orchestra.run.smithi045.stdout: -2013> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000342 [2,head] /dc-dir/dc-file_333 auth v3732 s=3 n(v0 rc2023-10-03T19:17:49.481733+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94316580] 2023-10-03T19:21:24.667 INFO:teuthology.orchestra.run.smithi045.stdout: -2012> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000342) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.667 INFO:teuthology.orchestra.run.smithi045.stdout: -2011> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000343 [2,head] /dc-dir/dc-file_334 auth v3734 s=3 n(v0 rc2023-10-03T19:17:49.493123+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94316b00] 2023-10-03T19:21:24.667 INFO:teuthology.orchestra.run.smithi045.stdout: -2010> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000343) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.667 INFO:teuthology.orchestra.run.smithi045.stdout: -2009> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000344 [2,head] /dc-dir/dc-file_335 auth v3736 s=3 n(v0 rc2023-10-03T19:17:49.505611+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94317080] 2023-10-03T19:21:24.667 INFO:teuthology.orchestra.run.smithi045.stdout: -2008> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000344) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.667 INFO:teuthology.orchestra.run.smithi045.stdout: -2007> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000345 [2,head] /dc-dir/dc-file_336 auth v3738 s=3 n(v0 rc2023-10-03T19:17:49.518914+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94317600] 2023-10-03T19:21:24.667 INFO:teuthology.orchestra.run.smithi045.stdout: -2006> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000345) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.667 INFO:teuthology.orchestra.run.smithi045.stdout: -2005> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000346 [2,head] /dc-dir/dc-file_337 auth v3740 s=3 n(v0 rc2023-10-03T19:17:49.531491+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94317b80] 2023-10-03T19:21:24.667 INFO:teuthology.orchestra.run.smithi045.stdout: -2004> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000346) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.667 INFO:teuthology.orchestra.run.smithi045.stdout: -2003> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000347 [2,head] /dc-dir/dc-file_338 auth v3742 s=3 n(v0 rc2023-10-03T19:17:49.544311+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94318100] 2023-10-03T19:21:24.667 INFO:teuthology.orchestra.run.smithi045.stdout: -2002> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000347) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.668 INFO:teuthology.orchestra.run.smithi045.stdout: -2001> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000348 [2,head] /dc-dir/dc-file_339 auth v3744 s=3 n(v0 rc2023-10-03T19:17:49.556145+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94318680] 2023-10-03T19:21:24.668 INFO:teuthology.orchestra.run.smithi045.stdout: -2000> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000348) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.668 INFO:teuthology.orchestra.run.smithi045.stdout: -1999> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000349 [2,head] /dc-dir/dc-file_340 auth v3746 s=3 n(v0 rc2023-10-03T19:17:49.568068+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94318c00] 2023-10-03T19:21:24.668 INFO:teuthology.orchestra.run.smithi045.stdout: -1998> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000349) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.668 INFO:teuthology.orchestra.run.smithi045.stdout: -1997> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000034a [2,head] /dc-dir/dc-file_341 auth v3748 s=3 n(v0 rc2023-10-03T19:17:49.579151+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94319180] 2023-10-03T19:21:24.668 INFO:teuthology.orchestra.run.smithi045.stdout: -1996> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000034a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.668 INFO:teuthology.orchestra.run.smithi045.stdout: -1995> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000034b [2,head] /dc-dir/dc-file_342 auth v3750 s=3 n(v0 rc2023-10-03T19:17:49.591950+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94319700] 2023-10-03T19:21:24.668 INFO:teuthology.orchestra.run.smithi045.stdout: -1994> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000034b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.668 INFO:teuthology.orchestra.run.smithi045.stdout: -1993> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000034c [2,head] /dc-dir/dc-file_343 auth v3752 s=3 n(v0 rc2023-10-03T19:17:49.603414+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9432c000] 2023-10-03T19:21:24.668 INFO:teuthology.orchestra.run.smithi045.stdout: -1992> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000034c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.668 INFO:teuthology.orchestra.run.smithi045.stdout: -1991> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000034d [2,head] /dc-dir/dc-file_344 auth v3754 s=3 n(v0 rc2023-10-03T19:17:49.614825+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9432c580] 2023-10-03T19:21:24.668 INFO:teuthology.orchestra.run.smithi045.stdout: -1990> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000034d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.669 INFO:teuthology.orchestra.run.smithi045.stdout: -1989> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000034e [2,head] /dc-dir/dc-file_345 auth v3756 s=3 n(v0 rc2023-10-03T19:17:49.626709+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9432cb00] 2023-10-03T19:21:24.669 INFO:teuthology.orchestra.run.smithi045.stdout: -1988> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000034e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.669 INFO:teuthology.orchestra.run.smithi045.stdout: -1987> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000034f [2,head] /dc-dir/dc-file_346 auth v3758 s=3 n(v0 rc2023-10-03T19:17:49.638020+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9432d080] 2023-10-03T19:21:24.669 INFO:teuthology.orchestra.run.smithi045.stdout: -1986> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000034f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.669 INFO:teuthology.orchestra.run.smithi045.stdout: -1985> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000350 [2,head] /dc-dir/dc-file_347 auth v3760 s=3 n(v0 rc2023-10-03T19:17:49.649381+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9432d600] 2023-10-03T19:21:24.669 INFO:teuthology.orchestra.run.smithi045.stdout: -1984> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000350) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.669 INFO:teuthology.orchestra.run.smithi045.stdout: -1983> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000351 [2,head] /dc-dir/dc-file_348 auth v3762 s=3 n(v0 rc2023-10-03T19:17:49.662447+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9432db80] 2023-10-03T19:21:24.669 INFO:teuthology.orchestra.run.smithi045.stdout: -1982> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000351) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.669 INFO:teuthology.orchestra.run.smithi045.stdout: -1981> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000352 [2,head] /dc-dir/dc-file_349 auth v3764 s=3 n(v0 rc2023-10-03T19:17:49.675224+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9432e100] 2023-10-03T19:21:24.669 INFO:teuthology.orchestra.run.smithi045.stdout: -1980> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000352) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.669 INFO:teuthology.orchestra.run.smithi045.stdout: -1979> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000353 [2,head] /dc-dir/dc-file_350 auth v3766 s=3 n(v0 rc2023-10-03T19:17:49.688208+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9432e680] 2023-10-03T19:21:24.669 INFO:teuthology.orchestra.run.smithi045.stdout: -1978> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000353) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.670 INFO:teuthology.orchestra.run.smithi045.stdout: -1977> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000354 [2,head] /dc-dir/dc-file_351 auth v3768 s=3 n(v0 rc2023-10-03T19:17:49.701286+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9432ec00] 2023-10-03T19:21:24.670 INFO:teuthology.orchestra.run.smithi045.stdout: -1976> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000354) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.670 INFO:teuthology.orchestra.run.smithi045.stdout: -1975> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000355 [2,head] /dc-dir/dc-file_352 auth v3770 s=3 n(v0 rc2023-10-03T19:17:49.713087+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9432f180] 2023-10-03T19:21:24.670 INFO:teuthology.orchestra.run.smithi045.stdout: -1974> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000355) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.670 INFO:teuthology.orchestra.run.smithi045.stdout: -1973> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000356 [2,head] /dc-dir/dc-file_353 auth v3772 s=3 n(v0 rc2023-10-03T19:17:49.724111+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9432f700] 2023-10-03T19:21:24.670 INFO:teuthology.orchestra.run.smithi045.stdout: -1972> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000356) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.670 INFO:teuthology.orchestra.run.smithi045.stdout: -1971> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000357 [2,head] /dc-dir/dc-file_354 auth v3774 s=3 n(v0 rc2023-10-03T19:17:49.735970+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94336000] 2023-10-03T19:21:24.670 INFO:teuthology.orchestra.run.smithi045.stdout: -1970> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000357) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.670 INFO:teuthology.orchestra.run.smithi045.stdout: -1969> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000358 [2,head] /dc-dir/dc-file_355 auth v3776 s=3 n(v0 rc2023-10-03T19:17:49.747835+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94336580] 2023-10-03T19:21:24.670 INFO:teuthology.orchestra.run.smithi045.stdout: -1968> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000358) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.670 INFO:teuthology.orchestra.run.smithi045.stdout: -1967> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000359 [2,head] /dc-dir/dc-file_356 auth v3778 s=3 n(v0 rc2023-10-03T19:17:49.759287+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94336b00] 2023-10-03T19:21:24.671 INFO:teuthology.orchestra.run.smithi045.stdout: -1966> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000359) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.671 INFO:teuthology.orchestra.run.smithi045.stdout: -1965> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000035a [2,head] /dc-dir/dc-file_357 auth v3780 s=3 n(v0 rc2023-10-03T19:17:49.770498+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94337080] 2023-10-03T19:21:24.671 INFO:teuthology.orchestra.run.smithi045.stdout: -1964> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000035a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.671 INFO:teuthology.orchestra.run.smithi045.stdout: -1963> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000035b [2,head] /dc-dir/dc-file_358 auth v3782 s=3 n(v0 rc2023-10-03T19:17:49.781307+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94337600] 2023-10-03T19:21:24.671 INFO:teuthology.orchestra.run.smithi045.stdout: -1962> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000035b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.671 INFO:teuthology.orchestra.run.smithi045.stdout: -1961> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000035c [2,head] /dc-dir/dc-file_359 auth v3784 s=3 n(v0 rc2023-10-03T19:17:49.793159+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94337b80] 2023-10-03T19:21:24.671 INFO:teuthology.orchestra.run.smithi045.stdout: -1960> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000035c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.671 INFO:teuthology.orchestra.run.smithi045.stdout: -1959> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000035d [2,head] /dc-dir/dc-file_360 auth v3786 s=3 n(v0 rc2023-10-03T19:17:49.805069+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94338100] 2023-10-03T19:21:24.671 INFO:teuthology.orchestra.run.smithi045.stdout: -1958> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000035d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.671 INFO:teuthology.orchestra.run.smithi045.stdout: -1957> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000035e [2,head] /dc-dir/dc-file_361 auth v3788 s=3 n(v0 rc2023-10-03T19:17:49.817384+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94338680] 2023-10-03T19:21:24.671 INFO:teuthology.orchestra.run.smithi045.stdout: -1956> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000035e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.671 INFO:teuthology.orchestra.run.smithi045.stdout: -1955> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000035f [2,head] /dc-dir/dc-file_362 auth v3790 s=3 n(v0 rc2023-10-03T19:17:49.829255+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94338c00] 2023-10-03T19:21:24.672 INFO:teuthology.orchestra.run.smithi045.stdout: -1954> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000035f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.672 INFO:teuthology.orchestra.run.smithi045.stdout: -1953> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000360 [2,head] /dc-dir/dc-file_363 auth v3792 s=3 n(v0 rc2023-10-03T19:17:49.840860+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94339180] 2023-10-03T19:21:24.672 INFO:teuthology.orchestra.run.smithi045.stdout: -1952> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000360) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.672 INFO:teuthology.orchestra.run.smithi045.stdout: -1951> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000361 [2,head] /dc-dir/dc-file_364 auth v3794 s=3 n(v0 rc2023-10-03T19:17:49.852759+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94339700] 2023-10-03T19:21:24.672 INFO:teuthology.orchestra.run.smithi045.stdout: -1950> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000361) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.672 INFO:teuthology.orchestra.run.smithi045.stdout: -1949> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000362 [2,head] /dc-dir/dc-file_365 auth v3796 s=3 n(v0 rc2023-10-03T19:17:49.864612+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9433e000] 2023-10-03T19:21:24.672 INFO:teuthology.orchestra.run.smithi045.stdout: -1948> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000362) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.672 INFO:teuthology.orchestra.run.smithi045.stdout: -1947> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000363 [2,head] /dc-dir/dc-file_366 auth v3798 s=3 n(v0 rc2023-10-03T19:17:49.875708+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9433e580] 2023-10-03T19:21:24.672 INFO:teuthology.orchestra.run.smithi045.stdout: -1946> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000363) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.672 INFO:teuthology.orchestra.run.smithi045.stdout: -1945> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000364 [2,head] /dc-dir/dc-file_367 auth v3800 s=3 n(v0 rc2023-10-03T19:17:49.888555+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9433eb00] 2023-10-03T19:21:24.672 INFO:teuthology.orchestra.run.smithi045.stdout: -1944> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000364) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.672 INFO:teuthology.orchestra.run.smithi045.stdout: -1943> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000365 [2,head] /dc-dir/dc-file_368 auth v3802 s=3 n(v0 rc2023-10-03T19:17:49.901651+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9433f080] 2023-10-03T19:21:24.673 INFO:teuthology.orchestra.run.smithi045.stdout: -1942> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000365) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.673 INFO:teuthology.orchestra.run.smithi045.stdout: -1941> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000366 [2,head] /dc-dir/dc-file_369 auth v3804 s=3 n(v0 rc2023-10-03T19:17:49.913868+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9433f600] 2023-10-03T19:21:24.673 INFO:teuthology.orchestra.run.smithi045.stdout: -1940> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000366) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.673 INFO:teuthology.orchestra.run.smithi045.stdout: -1939> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000367 [2,head] /dc-dir/dc-file_370 auth v3806 s=3 n(v0 rc2023-10-03T19:17:49.925429+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9433fb80] 2023-10-03T19:21:24.673 INFO:teuthology.orchestra.run.smithi045.stdout: -1938> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000367) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.673 INFO:teuthology.orchestra.run.smithi045.stdout: -1937> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000368 [2,head] /dc-dir/dc-file_371 auth v3808 s=3 n(v0 rc2023-10-03T19:17:49.936977+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94340100] 2023-10-03T19:21:24.673 INFO:teuthology.orchestra.run.smithi045.stdout: -1936> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000368) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.673 INFO:teuthology.orchestra.run.smithi045.stdout: -1935> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000369 [2,head] /dc-dir/dc-file_372 auth v3810 s=3 n(v0 rc2023-10-03T19:17:49.947835+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94340680] 2023-10-03T19:21:24.673 INFO:teuthology.orchestra.run.smithi045.stdout: -1934> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000369) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.673 INFO:teuthology.orchestra.run.smithi045.stdout: -1933> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000036a [2,head] /dc-dir/dc-file_373 auth v3812 s=3 n(v0 rc2023-10-03T19:17:49.959051+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94340c00] 2023-10-03T19:21:24.673 INFO:teuthology.orchestra.run.smithi045.stdout: -1932> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000036a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.674 INFO:teuthology.orchestra.run.smithi045.stdout: -1931> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000036b [2,head] /dc-dir/dc-file_374 auth v3814 s=3 n(v0 rc2023-10-03T19:17:49.969833+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94341180] 2023-10-03T19:21:24.674 INFO:teuthology.orchestra.run.smithi045.stdout: -1930> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000036b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.674 INFO:teuthology.orchestra.run.smithi045.stdout: -1929> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000036c [2,head] /dc-dir/dc-file_375 auth v3816 s=3 n(v0 rc2023-10-03T19:17:49.981314+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94341700] 2023-10-03T19:21:24.674 INFO:teuthology.orchestra.run.smithi045.stdout: -1928> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000036c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.674 INFO:teuthology.orchestra.run.smithi045.stdout: -1927> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000036d [2,head] /dc-dir/dc-file_376 auth v3818 s=3 n(v0 rc2023-10-03T19:17:49.992888+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94348000] 2023-10-03T19:21:24.674 INFO:teuthology.orchestra.run.smithi045.stdout: -1926> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000036d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.674 INFO:teuthology.orchestra.run.smithi045.stdout: -1925> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000036e [2,head] /dc-dir/dc-file_377 auth v3820 s=3 n(v0 rc2023-10-03T19:17:50.005981+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94348580] 2023-10-03T19:21:24.674 INFO:teuthology.orchestra.run.smithi045.stdout: -1924> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000036e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.674 INFO:teuthology.orchestra.run.smithi045.stdout: -1923> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000036f [2,head] /dc-dir/dc-file_378 auth v3822 s=3 n(v0 rc2023-10-03T19:17:50.020352+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94348b00] 2023-10-03T19:21:24.674 INFO:teuthology.orchestra.run.smithi045.stdout: -1922> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000036f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.674 INFO:teuthology.orchestra.run.smithi045.stdout: -1921> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000370 [2,head] /dc-dir/dc-file_379 auth v3824 s=3 n(v0 rc2023-10-03T19:17:50.032829+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94349080] 2023-10-03T19:21:24.675 INFO:teuthology.orchestra.run.smithi045.stdout: -1920> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000370) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.675 INFO:teuthology.orchestra.run.smithi045.stdout: -1919> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000371 [2,head] /dc-dir/dc-file_380 auth v3826 s=3 n(v0 rc2023-10-03T19:17:50.045450+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94349600] 2023-10-03T19:21:24.675 INFO:teuthology.orchestra.run.smithi045.stdout: -1918> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000371) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.675 INFO:teuthology.orchestra.run.smithi045.stdout: -1917> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000372 [2,head] /dc-dir/dc-file_381 auth v3828 s=3 n(v0 rc2023-10-03T19:17:50.057047+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94349b80] 2023-10-03T19:21:24.675 INFO:teuthology.orchestra.run.smithi045.stdout: -1916> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000372) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.675 INFO:teuthology.orchestra.run.smithi045.stdout: -1915> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000373 [2,head] /dc-dir/dc-file_382 auth v3830 s=3 n(v0 rc2023-10-03T19:17:50.070572+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9434a100] 2023-10-03T19:21:24.675 INFO:teuthology.orchestra.run.smithi045.stdout: -1914> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000373) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.675 INFO:teuthology.orchestra.run.smithi045.stdout: -1913> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000374 [2,head] /dc-dir/dc-file_383 auth v4116 s=3 n(v0 rc2023-10-03T19:17:50.084491+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9434a680] 2023-10-03T19:21:24.675 INFO:teuthology.orchestra.run.smithi045.stdout: -1912> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000374) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.675 INFO:teuthology.orchestra.run.smithi045.stdout: -1911> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000375 [2,head] /dc-dir/dc-file_384 auth v4118 s=3 n(v0 rc2023-10-03T19:17:50.097533+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9434ac00] 2023-10-03T19:21:24.675 INFO:teuthology.orchestra.run.smithi045.stdout: -1910> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000375) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.675 INFO:teuthology.orchestra.run.smithi045.stdout: -1909> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000376 [2,head] /dc-dir/dc-file_385 auth v4120 s=3 n(v0 rc2023-10-03T19:17:50.109049+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9434b180] 2023-10-03T19:21:24.676 INFO:teuthology.orchestra.run.smithi045.stdout: -1908> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000376) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.676 INFO:teuthology.orchestra.run.smithi045.stdout: -1907> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000377 [2,head] /dc-dir/dc-file_386 auth v4122 s=3 n(v0 rc2023-10-03T19:17:50.119538+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9434b700] 2023-10-03T19:21:24.676 INFO:teuthology.orchestra.run.smithi045.stdout: -1906> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000377) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.676 INFO:teuthology.orchestra.run.smithi045.stdout: -1905> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000378 [2,head] /dc-dir/dc-file_387 auth v4124 s=3 n(v0 rc2023-10-03T19:17:50.132193+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94414000] 2023-10-03T19:21:24.676 INFO:teuthology.orchestra.run.smithi045.stdout: -1904> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000378) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.676 INFO:teuthology.orchestra.run.smithi045.stdout: -1903> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000379 [2,head] /dc-dir/dc-file_388 auth v4126 s=3 n(v0 rc2023-10-03T19:17:50.143213+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94414580] 2023-10-03T19:21:24.676 INFO:teuthology.orchestra.run.smithi045.stdout: -1902> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000379) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.676 INFO:teuthology.orchestra.run.smithi045.stdout: -1901> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000037a [2,head] /dc-dir/dc-file_389 auth v4128 s=3 n(v0 rc2023-10-03T19:17:50.154309+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94414b00] 2023-10-03T19:21:24.676 INFO:teuthology.orchestra.run.smithi045.stdout: -1900> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000037a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.676 INFO:teuthology.orchestra.run.smithi045.stdout: -1899> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000037b [2,head] /dc-dir/dc-file_390 auth v4130 s=3 n(v0 rc2023-10-03T19:17:50.164507+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94415080] 2023-10-03T19:21:24.676 INFO:teuthology.orchestra.run.smithi045.stdout: -1898> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000037b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.676 INFO:teuthology.orchestra.run.smithi045.stdout: -1897> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000037c [2,head] /dc-dir/dc-file_391 auth v4132 s=3 n(v0 rc2023-10-03T19:17:50.174698+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94415600] 2023-10-03T19:21:24.677 INFO:teuthology.orchestra.run.smithi045.stdout: -1896> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000037c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.677 INFO:teuthology.orchestra.run.smithi045.stdout: -1895> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000037d [2,head] /dc-dir/dc-file_392 auth v4134 s=3 n(v0 rc2023-10-03T19:17:50.185425+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94415b80] 2023-10-03T19:21:24.677 INFO:teuthology.orchestra.run.smithi045.stdout: -1894> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000037d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.677 INFO:teuthology.orchestra.run.smithi045.stdout: -1893> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000037e [2,head] /dc-dir/dc-file_393 auth v4136 s=3 n(v0 rc2023-10-03T19:17:50.197125+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94416100] 2023-10-03T19:21:24.677 INFO:teuthology.orchestra.run.smithi045.stdout: -1892> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000037e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.677 INFO:teuthology.orchestra.run.smithi045.stdout: -1891> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000037f [2,head] /dc-dir/dc-file_394 auth v4138 s=3 n(v0 rc2023-10-03T19:17:50.208655+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94416680] 2023-10-03T19:21:24.677 INFO:teuthology.orchestra.run.smithi045.stdout: -1890> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000037f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.677 INFO:teuthology.orchestra.run.smithi045.stdout: -1889> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000380 [2,head] /dc-dir/dc-file_395 auth v4140 s=3 n(v0 rc2023-10-03T19:17:50.220262+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94416c00] 2023-10-03T19:21:24.809 INFO:teuthology.orchestra.run.smithi045.stdout: -1888> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000380) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.809 INFO:teuthology.orchestra.run.smithi045.stdout: -1887> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000381 [2,head] /dc-dir/dc-file_396 auth v4142 s=3 n(v0 rc2023-10-03T19:17:50.231848+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94417180] 2023-10-03T19:21:24.809 INFO:teuthology.orchestra.run.smithi045.stdout: -1886> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000381) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.809 INFO:teuthology.orchestra.run.smithi045.stdout: -1885> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000382 [2,head] /dc-dir/dc-file_397 auth v4144 s=3 n(v0 rc2023-10-03T19:17:50.244536+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94417700] 2023-10-03T19:21:24.809 INFO:teuthology.orchestra.run.smithi045.stdout: -1884> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000382) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.809 INFO:teuthology.orchestra.run.smithi045.stdout: -1883> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000383 [2,head] /dc-dir/dc-file_398 auth v4146 s=3 n(v0 rc2023-10-03T19:17:50.256353+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc944b4000] 2023-10-03T19:21:24.810 INFO:teuthology.orchestra.run.smithi045.stdout: -1882> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000383) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.810 INFO:teuthology.orchestra.run.smithi045.stdout: -1881> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000384 [2,head] /dc-dir/dc-file_399 auth v4148 s=3 n(v0 rc2023-10-03T19:17:50.268840+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc944b4580] 2023-10-03T19:21:24.810 INFO:teuthology.orchestra.run.smithi045.stdout: -1880> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000384) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.810 INFO:teuthology.orchestra.run.smithi045.stdout: -1879> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000385 [2,head] /dc-dir/dc-file_400 auth v4150 s=3 n(v0 rc2023-10-03T19:17:50.279843+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc944b4b00] 2023-10-03T19:21:24.810 INFO:teuthology.orchestra.run.smithi045.stdout: -1878> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000385) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.810 INFO:teuthology.orchestra.run.smithi045.stdout: -1877> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000386 [2,head] /dc-dir/dc-file_401 auth v4152 s=3 n(v0 rc2023-10-03T19:17:50.291516+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc944b5080] 2023-10-03T19:21:24.810 INFO:teuthology.orchestra.run.smithi045.stdout: -1876> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000386) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.810 INFO:teuthology.orchestra.run.smithi045.stdout: -1875> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000387 [2,head] /dc-dir/dc-file_402 auth v4154 s=3 n(v0 rc2023-10-03T19:17:50.302685+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc944b5600] 2023-10-03T19:21:24.810 INFO:teuthology.orchestra.run.smithi045.stdout: -1874> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000387) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.810 INFO:teuthology.orchestra.run.smithi045.stdout: -1873> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000388 [2,head] /dc-dir/dc-file_403 auth v4156 s=3 n(v0 rc2023-10-03T19:17:50.315079+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc944b5b80] 2023-10-03T19:21:24.811 INFO:teuthology.orchestra.run.smithi045.stdout: -1872> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000388) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.811 INFO:teuthology.orchestra.run.smithi045.stdout: -1871> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000389 [2,head] /dc-dir/dc-file_404 auth v4158 s=3 n(v0 rc2023-10-03T19:17:50.325953+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc944b6100] 2023-10-03T19:21:24.811 INFO:teuthology.orchestra.run.smithi045.stdout: -1870> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000389) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.811 INFO:teuthology.orchestra.run.smithi045.stdout: -1869> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000038a [2,head] /dc-dir/dc-file_405 auth v4160 s=3 n(v0 rc2023-10-03T19:17:50.337192+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc944b6680] 2023-10-03T19:21:24.811 INFO:teuthology.orchestra.run.smithi045.stdout: -1868> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000038a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.811 INFO:teuthology.orchestra.run.smithi045.stdout: -1867> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000038b [2,head] /dc-dir/dc-file_406 auth v4162 s=3 n(v0 rc2023-10-03T19:17:50.347926+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc944b6c00] 2023-10-03T19:21:24.811 INFO:teuthology.orchestra.run.smithi045.stdout: -1866> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000038b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.811 INFO:teuthology.orchestra.run.smithi045.stdout: -1865> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000038c [2,head] /dc-dir/dc-file_407 auth v4164 s=3 n(v0 rc2023-10-03T19:17:50.358968+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc944b7180] 2023-10-03T19:21:24.812 INFO:teuthology.orchestra.run.smithi045.stdout: -1864> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000038c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.812 INFO:teuthology.orchestra.run.smithi045.stdout: -1863> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000038d [2,head] /dc-dir/dc-file_408 auth v4166 s=3 n(v0 rc2023-10-03T19:17:50.370254+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc944b7700] 2023-10-03T19:21:24.812 INFO:teuthology.orchestra.run.smithi045.stdout: -1862> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000038d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.812 INFO:teuthology.orchestra.run.smithi045.stdout: -1861> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000038e [2,head] /dc-dir/dc-file_409 auth v4168 s=3 n(v0 rc2023-10-03T19:17:50.381627+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94476000] 2023-10-03T19:21:24.812 INFO:teuthology.orchestra.run.smithi045.stdout: -1860> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000038e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.813 INFO:teuthology.orchestra.run.smithi045.stdout: -1859> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000038f [2,head] /dc-dir/dc-file_410 auth v4170 s=3 n(v0 rc2023-10-03T19:17:50.392935+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94476580] 2023-10-03T19:21:24.813 INFO:teuthology.orchestra.run.smithi045.stdout: -1858> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000038f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.813 INFO:teuthology.orchestra.run.smithi045.stdout: -1857> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000390 [2,head] /dc-dir/dc-file_411 auth v4172 s=3 n(v0 rc2023-10-03T19:17:50.405076+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94476b00] 2023-10-03T19:21:24.813 INFO:teuthology.orchestra.run.smithi045.stdout: -1856> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000390) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.813 INFO:teuthology.orchestra.run.smithi045.stdout: -1855> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000391 [2,head] /dc-dir/dc-file_412 auth v4174 s=3 n(v0 rc2023-10-03T19:17:50.417588+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94477080] 2023-10-03T19:21:24.813 INFO:teuthology.orchestra.run.smithi045.stdout: -1854> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000391) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.814 INFO:teuthology.orchestra.run.smithi045.stdout: -1853> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000392 [2,head] /dc-dir/dc-file_413 auth v4176 s=3 n(v0 rc2023-10-03T19:17:50.428206+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94477600] 2023-10-03T19:21:24.814 INFO:teuthology.orchestra.run.smithi045.stdout: -1852> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000392) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.814 INFO:teuthology.orchestra.run.smithi045.stdout: -1851> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000393 [2,head] /dc-dir/dc-file_414 auth v4178 s=3 n(v0 rc2023-10-03T19:17:50.439546+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94477b80] 2023-10-03T19:21:24.814 INFO:teuthology.orchestra.run.smithi045.stdout: -1850> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000393) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.814 INFO:teuthology.orchestra.run.smithi045.stdout: -1849> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000394 [2,head] /dc-dir/dc-file_415 auth v4180 s=3 n(v0 rc2023-10-03T19:17:50.450710+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94478100] 2023-10-03T19:21:24.815 INFO:teuthology.orchestra.run.smithi045.stdout: -1848> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000394) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.815 INFO:teuthology.orchestra.run.smithi045.stdout: -1847> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000395 [2,head] /dc-dir/dc-file_416 auth v4182 s=3 n(v0 rc2023-10-03T19:17:50.461282+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94478680] 2023-10-03T19:21:24.815 INFO:teuthology.orchestra.run.smithi045.stdout: -1846> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000395) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.815 INFO:teuthology.orchestra.run.smithi045.stdout: -1845> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000396 [2,head] /dc-dir/dc-file_417 auth v4184 s=3 n(v0 rc2023-10-03T19:17:50.473124+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94478c00] 2023-10-03T19:21:24.815 INFO:teuthology.orchestra.run.smithi045.stdout: -1844> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000396) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.815 INFO:teuthology.orchestra.run.smithi045.stdout: -1843> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000397 [2,head] /dc-dir/dc-file_418 auth v4186 s=3 n(v0 rc2023-10-03T19:17:50.485670+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94479180] 2023-10-03T19:21:24.816 INFO:teuthology.orchestra.run.smithi045.stdout: -1842> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000397) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.816 INFO:teuthology.orchestra.run.smithi045.stdout: -1841> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000398 [2,head] /dc-dir/dc-file_419 auth v4188 s=3 n(v0 rc2023-10-03T19:17:50.498900+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94479700] 2023-10-03T19:21:24.816 INFO:teuthology.orchestra.run.smithi045.stdout: -1840> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000398) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.816 INFO:teuthology.orchestra.run.smithi045.stdout: -1839> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000399 [2,head] /dc-dir/dc-file_420 auth v4190 s=3 n(v0 rc2023-10-03T19:17:50.512168+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9447c000] 2023-10-03T19:21:24.816 INFO:teuthology.orchestra.run.smithi045.stdout: -1838> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000399) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.816 INFO:teuthology.orchestra.run.smithi045.stdout: -1837> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000039a [2,head] /dc-dir/dc-file_421 auth v4192 s=3 n(v0 rc2023-10-03T19:17:50.524116+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9447c580] 2023-10-03T19:21:24.816 INFO:teuthology.orchestra.run.smithi045.stdout: -1836> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000039a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.817 INFO:teuthology.orchestra.run.smithi045.stdout: -1835> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000039b [2,head] /dc-dir/dc-file_422 auth v4194 s=3 n(v0 rc2023-10-03T19:17:50.537286+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9447cb00] 2023-10-03T19:21:24.817 INFO:teuthology.orchestra.run.smithi045.stdout: -1834> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000039b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.817 INFO:teuthology.orchestra.run.smithi045.stdout: -1833> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000039c [2,head] /dc-dir/dc-file_423 auth v4196 s=3 n(v0 rc2023-10-03T19:17:50.548189+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9447d080] 2023-10-03T19:21:24.817 INFO:teuthology.orchestra.run.smithi045.stdout: -1832> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000039c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.817 INFO:teuthology.orchestra.run.smithi045.stdout: -1831> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000039d [2,head] /dc-dir/dc-file_424 auth v4198 s=3 n(v0 rc2023-10-03T19:17:50.558985+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9447d600] 2023-10-03T19:21:24.817 INFO:teuthology.orchestra.run.smithi045.stdout: -1830> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000039d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.818 INFO:teuthology.orchestra.run.smithi045.stdout: -1829> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000039e [2,head] /dc-dir/dc-file_425 auth v4200 s=3 n(v0 rc2023-10-03T19:17:50.570914+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9447db80] 2023-10-03T19:21:24.818 INFO:teuthology.orchestra.run.smithi045.stdout: -1828> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000039e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.821 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:21:24.836 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-03T19:21:24.836 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:21:24.837 INFO:teuthology.orchestra.run.smithi045.stdout: -1827> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000039f [2,head] /dc-dir/dc-file_426 auth v4202 s=3 n(v0 rc2023-10-03T19:17:50.583223+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9447e100] 2023-10-03T19:21:24.837 INFO:teuthology.orchestra.run.smithi045.stdout: -1826> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000039f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.837 INFO:teuthology.orchestra.run.smithi045.stdout: -1825> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003a0 [2,head] /dc-dir/dc-file_427 auth v4204 s=3 n(v0 rc2023-10-03T19:17:50.595686+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9447e680] 2023-10-03T19:21:24.837 INFO:teuthology.orchestra.run.smithi045.stdout: -1824> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.837 INFO:teuthology.orchestra.run.smithi045.stdout: -1823> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003a1 [2,head] /dc-dir/dc-file_428 auth v4206 s=3 n(v0 rc2023-10-03T19:17:50.608255+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9447ec00] 2023-10-03T19:21:24.837 INFO:teuthology.orchestra.run.smithi045.stdout: -1822> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.837 INFO:teuthology.orchestra.run.smithi045.stdout: -1821> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003a2 [2,head] /dc-dir/dc-file_429 auth v4208 s=3 n(v0 rc2023-10-03T19:17:50.620323+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9447f180] 2023-10-03T19:21:24.837 INFO:teuthology.orchestra.run.smithi045.stdout: -1820> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.838 INFO:teuthology.orchestra.run.smithi045.stdout: -1819> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003a3 [2,head] /dc-dir/dc-file_430 auth v4210 s=3 n(v0 rc2023-10-03T19:17:50.633099+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9447f700] 2023-10-03T19:21:24.838 INFO:teuthology.orchestra.run.smithi045.stdout: -1818> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.838 INFO:teuthology.orchestra.run.smithi045.stdout: -1817> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003a4 [2,head] /dc-dir/dc-file_431 auth v4212 s=3 n(v0 rc2023-10-03T19:17:50.646180+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94486000] 2023-10-03T19:21:24.838 INFO:teuthology.orchestra.run.smithi045.stdout: -1816> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.838 INFO:teuthology.orchestra.run.smithi045.stdout: -1815> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003a5 [2,head] /dc-dir/dc-file_432 auth v4214 s=3 n(v0 rc2023-10-03T19:17:50.658793+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94486580] 2023-10-03T19:21:24.838 INFO:teuthology.orchestra.run.smithi045.stdout: -1814> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.838 INFO:teuthology.orchestra.run.smithi045.stdout: -1813> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003a6 [2,head] /dc-dir/dc-file_433 auth v4216 s=3 n(v0 rc2023-10-03T19:17:50.669847+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94486b00] 2023-10-03T19:21:24.838 INFO:teuthology.orchestra.run.smithi045.stdout: -1812> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.838 INFO:teuthology.orchestra.run.smithi045.stdout: -1811> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003a7 [2,head] /dc-dir/dc-file_434 auth v4218 s=3 n(v0 rc2023-10-03T19:17:50.681332+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94487080] 2023-10-03T19:21:24.838 INFO:teuthology.orchestra.run.smithi045.stdout: -1810> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.838 INFO:teuthology.orchestra.run.smithi045.stdout: -1809> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003a8 [2,head] /dc-dir/dc-file_435 auth v4220 s=3 n(v0 rc2023-10-03T19:17:50.693249+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94487600] 2023-10-03T19:21:24.839 INFO:teuthology.orchestra.run.smithi045.stdout: -1808> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.839 INFO:teuthology.orchestra.run.smithi045.stdout: -1807> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003a9 [2,head] /dc-dir/dc-file_436 auth v4222 s=3 n(v0 rc2023-10-03T19:17:50.704242+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94487b80] 2023-10-03T19:21:24.839 INFO:teuthology.orchestra.run.smithi045.stdout: -1806> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003a9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.839 INFO:teuthology.orchestra.run.smithi045.stdout: -1805> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003aa [2,head] /dc-dir/dc-file_437 auth v4224 s=3 n(v0 rc2023-10-03T19:17:50.715366+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94488100] 2023-10-03T19:21:24.839 INFO:teuthology.orchestra.run.smithi045.stdout: -1804> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003aa) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.839 INFO:teuthology.orchestra.run.smithi045.stdout: -1803> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ab [2,head] /dc-dir/dc-file_438 auth v4226 s=3 n(v0 rc2023-10-03T19:17:50.727081+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94488680] 2023-10-03T19:21:24.839 INFO:teuthology.orchestra.run.smithi045.stdout: -1802> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ab) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.839 INFO:teuthology.orchestra.run.smithi045.stdout: -1801> 2023-10-03T19:18:12.097+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ac [2,head] /dc-dir/dc-file_439 auth v4228 s=3 n(v0 rc2023-10-03T19:17:50.739493+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94488c00] 2023-10-03T19:21:24.839 INFO:teuthology.orchestra.run.smithi045.stdout: -1800> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ac) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.839 INFO:teuthology.orchestra.run.smithi045.stdout: -1799> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ad [2,head] /dc-dir/dc-file_440 auth v4230 s=3 n(v0 rc2023-10-03T19:17:50.750986+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94489180] 2023-10-03T19:21:24.839 INFO:teuthology.orchestra.run.smithi045.stdout: -1798> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ad) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.840 INFO:teuthology.orchestra.run.smithi045.stdout: -1797> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ae [2,head] /dc-dir/dc-file_441 auth v4232 s=3 n(v0 rc2023-10-03T19:17:50.762180+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94489700] 2023-10-03T19:21:24.840 INFO:teuthology.orchestra.run.smithi045.stdout: -1796> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ae) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.840 INFO:teuthology.orchestra.run.smithi045.stdout: -1795> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003af [2,head] /dc-dir/dc-file_442 auth v4234 s=3 n(v0 rc2023-10-03T19:17:50.773067+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94490000] 2023-10-03T19:21:24.840 INFO:teuthology.orchestra.run.smithi045.stdout: -1794> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003af) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.840 INFO:teuthology.orchestra.run.smithi045.stdout: -1793> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003b0 [2,head] /dc-dir/dc-file_443 auth v4236 s=3 n(v0 rc2023-10-03T19:17:50.784407+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94490580] 2023-10-03T19:21:24.840 INFO:teuthology.orchestra.run.smithi045.stdout: -1792> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.840 INFO:teuthology.orchestra.run.smithi045.stdout: -1791> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003b1 [2,head] /dc-dir/dc-file_444 auth v4238 s=3 n(v0 rc2023-10-03T19:17:50.796046+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94490b00] 2023-10-03T19:21:24.972 INFO:teuthology.orchestra.run.smithi045.stdout: -1790> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.972 INFO:teuthology.orchestra.run.smithi045.stdout: -1789> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003b2 [2,head] /dc-dir/dc-file_445 auth v4240 s=3 n(v0 rc2023-10-03T19:17:50.809560+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94491080] 2023-10-03T19:21:24.972 INFO:teuthology.orchestra.run.smithi045.stdout: -1788> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.972 INFO:teuthology.orchestra.run.smithi045.stdout: -1787> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003b3 [2,head] /dc-dir/dc-file_446 auth v4242 s=3 n(v0 rc2023-10-03T19:17:50.823546+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94491600] 2023-10-03T19:21:24.973 INFO:teuthology.orchestra.run.smithi045.stdout: -1786> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.973 INFO:teuthology.orchestra.run.smithi045.stdout: -1785> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003b4 [2,head] /dc-dir/dc-file_447 auth v4244 s=3 n(v0 rc2023-10-03T19:17:50.835141+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94491b80] 2023-10-03T19:21:24.973 INFO:teuthology.orchestra.run.smithi045.stdout: -1784> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.973 INFO:teuthology.orchestra.run.smithi045.stdout: -1783> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003b5 [2,head] /dc-dir/dc-file_448 auth v4246 s=3 n(v0 rc2023-10-03T19:17:50.845904+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94492100] 2023-10-03T19:21:24.973 INFO:teuthology.orchestra.run.smithi045.stdout: -1782> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.973 INFO:teuthology.orchestra.run.smithi045.stdout: -1781> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003b6 [2,head] /dc-dir/dc-file_449 auth v4248 s=3 n(v0 rc2023-10-03T19:17:50.857400+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94492680] 2023-10-03T19:21:24.973 INFO:teuthology.orchestra.run.smithi045.stdout: -1780> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.973 INFO:teuthology.orchestra.run.smithi045.stdout: -1779> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003b7 [2,head] /dc-dir/dc-file_450 auth v4250 s=3 n(v0 rc2023-10-03T19:17:50.868439+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94492c00] 2023-10-03T19:21:24.973 INFO:teuthology.orchestra.run.smithi045.stdout: -1778> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.973 INFO:teuthology.orchestra.run.smithi045.stdout: -1777> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003b8 [2,head] /dc-dir/dc-file_451 auth v4252 s=3 n(v0 rc2023-10-03T19:17:50.879888+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94493180] 2023-10-03T19:21:24.973 INFO:teuthology.orchestra.run.smithi045.stdout: -1776> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.974 INFO:teuthology.orchestra.run.smithi045.stdout: -1775> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003b9 [2,head] /dc-dir/dc-file_452 auth v4254 s=3 n(v0 rc2023-10-03T19:17:50.890838+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94493700] 2023-10-03T19:21:24.974 INFO:teuthology.orchestra.run.smithi045.stdout: -1774> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003b9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.974 INFO:teuthology.orchestra.run.smithi045.stdout: -1773> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ba [2,head] /dc-dir/dc-file_453 auth v4256 s=3 n(v0 rc2023-10-03T19:17:50.902544+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc944a0000] 2023-10-03T19:21:24.974 INFO:teuthology.orchestra.run.smithi045.stdout: -1772> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ba) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.974 INFO:teuthology.orchestra.run.smithi045.stdout: -1771> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003bb [2,head] /dc-dir/dc-file_454 auth v4258 s=3 n(v0 rc2023-10-03T19:17:50.914444+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc944a0580] 2023-10-03T19:21:24.974 INFO:teuthology.orchestra.run.smithi045.stdout: -1770> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003bb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.974 INFO:teuthology.orchestra.run.smithi045.stdout: -1769> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003bc [2,head] /dc-dir/dc-file_455 auth v4260 s=3 n(v0 rc2023-10-03T19:17:50.927910+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc944a0b00] 2023-10-03T19:21:24.974 INFO:teuthology.orchestra.run.smithi045.stdout: -1768> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003bc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.975 INFO:teuthology.orchestra.run.smithi045.stdout: -1767> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003bd [2,head] /dc-dir/dc-file_456 auth v4262 s=3 n(v0 rc2023-10-03T19:17:50.942305+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc944a1080] 2023-10-03T19:21:24.975 INFO:teuthology.orchestra.run.smithi045.stdout: -1766> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003bd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.975 INFO:teuthology.orchestra.run.smithi045.stdout: -1765> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003be [2,head] /dc-dir/dc-file_457 auth v4264 s=3 n(v0 rc2023-10-03T19:17:50.956013+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc944a1600] 2023-10-03T19:21:24.975 INFO:teuthology.orchestra.run.smithi045.stdout: -1764> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003be) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.975 INFO:teuthology.orchestra.run.smithi045.stdout: -1763> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003bf [2,head] /dc-dir/dc-file_458 auth v4266 s=3 n(v0 rc2023-10-03T19:17:50.968515+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc944a1b80] 2023-10-03T19:21:24.975 INFO:teuthology.orchestra.run.smithi045.stdout: -1762> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003bf) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.975 INFO:teuthology.orchestra.run.smithi045.stdout: -1761> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003c0 [2,head] /dc-dir/dc-file_459 auth v4268 s=3 n(v0 rc2023-10-03T19:17:50.981305+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc944a2100] 2023-10-03T19:21:24.975 INFO:teuthology.orchestra.run.smithi045.stdout: -1760> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.975 INFO:teuthology.orchestra.run.smithi045.stdout: -1759> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003c1 [2,head] /dc-dir/dc-file_460 auth v4270 s=3 n(v0 rc2023-10-03T19:17:50.995582+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc944a2680] 2023-10-03T19:21:24.975 INFO:teuthology.orchestra.run.smithi045.stdout: -1758> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.975 INFO:teuthology.orchestra.run.smithi045.stdout: -1757> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003c2 [2,head] /dc-dir/dc-file_461 auth v4272 s=3 n(v0 rc2023-10-03T19:17:51.010184+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc944a2c00] 2023-10-03T19:21:24.976 INFO:teuthology.orchestra.run.smithi045.stdout: -1756> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.976 INFO:teuthology.orchestra.run.smithi045.stdout: -1755> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003c3 [2,head] /dc-dir/dc-file_462 auth v4274 s=3 n(v0 rc2023-10-03T19:17:51.022754+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc944a3180] 2023-10-03T19:21:24.976 INFO:teuthology.orchestra.run.smithi045.stdout: -1754> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.976 INFO:teuthology.orchestra.run.smithi045.stdout: -1753> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003c4 [2,head] /dc-dir/dc-file_463 auth v4276 s=3 n(v0 rc2023-10-03T19:17:51.035068+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc944a3700] 2023-10-03T19:21:24.976 INFO:teuthology.orchestra.run.smithi045.stdout: -1752> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.976 INFO:teuthology.orchestra.run.smithi045.stdout: -1751> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003c5 [2,head] /dc-dir/dc-file_464 auth v4278 s=3 n(v0 rc2023-10-03T19:17:51.046162+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94518000] 2023-10-03T19:21:24.976 INFO:teuthology.orchestra.run.smithi045.stdout: -1750> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.976 INFO:teuthology.orchestra.run.smithi045.stdout: -1749> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003c6 [2,head] /dc-dir/dc-file_465 auth v4280 s=3 n(v0 rc2023-10-03T19:17:51.058229+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94518580] 2023-10-03T19:21:24.976 INFO:teuthology.orchestra.run.smithi045.stdout: -1748> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.976 INFO:teuthology.orchestra.run.smithi045.stdout: -1747> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003c7 [2,head] /dc-dir/dc-file_466 auth v4282 s=3 n(v0 rc2023-10-03T19:17:51.070894+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94518b00] 2023-10-03T19:21:24.977 INFO:teuthology.orchestra.run.smithi045.stdout: -1746> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.977 INFO:teuthology.orchestra.run.smithi045.stdout: -1745> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003c8 [2,head] /dc-dir/dc-file_467 auth v4580 s=3 n(v0 rc2023-10-03T19:17:51.097499+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94519080] 2023-10-03T19:21:24.977 INFO:teuthology.orchestra.run.smithi045.stdout: -1744> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.977 INFO:teuthology.orchestra.run.smithi045.stdout: -1743> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003c9 [2,head] /dc-dir/dc-file_468 auth v4582 s=3 n(v0 rc2023-10-03T19:17:51.125239+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94519600] 2023-10-03T19:21:24.977 INFO:teuthology.orchestra.run.smithi045.stdout: -1742> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003c9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.977 INFO:teuthology.orchestra.run.smithi045.stdout: -1741> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ca [2,head] /dc-dir/dc-file_469 auth v4584 s=3 n(v0 rc2023-10-03T19:17:51.137330+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94519b80] 2023-10-03T19:21:24.977 INFO:teuthology.orchestra.run.smithi045.stdout: -1740> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ca) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.977 INFO:teuthology.orchestra.run.smithi045.stdout: -1739> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003cb [2,head] /dc-dir/dc-file_470 auth v4586 s=3 n(v0 rc2023-10-03T19:17:51.149442+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9451a100] 2023-10-03T19:21:24.977 INFO:teuthology.orchestra.run.smithi045.stdout: -1738> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003cb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.977 INFO:teuthology.orchestra.run.smithi045.stdout: -1737> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003cc [2,head] /dc-dir/dc-file_471 auth v4588 s=3 n(v0 rc2023-10-03T19:17:51.161033+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9451a680] 2023-10-03T19:21:24.977 INFO:teuthology.orchestra.run.smithi045.stdout: -1736> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003cc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.978 INFO:teuthology.orchestra.run.smithi045.stdout: -1735> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003cd [2,head] /dc-dir/dc-file_472 auth v4590 s=3 n(v0 rc2023-10-03T19:17:51.172173+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9451ac00] 2023-10-03T19:21:24.978 INFO:teuthology.orchestra.run.smithi045.stdout: -1734> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003cd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.978 INFO:teuthology.orchestra.run.smithi045.stdout: -1733> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ce [2,head] /dc-dir/dc-file_473 auth v4592 s=3 n(v0 rc2023-10-03T19:17:51.183407+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9451b180] 2023-10-03T19:21:24.978 INFO:teuthology.orchestra.run.smithi045.stdout: -1732> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ce) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.978 INFO:teuthology.orchestra.run.smithi045.stdout: -1731> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003cf [2,head] /dc-dir/dc-file_474 auth v4594 s=3 n(v0 rc2023-10-03T19:17:51.195046+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9451b700] 2023-10-03T19:21:24.978 INFO:teuthology.orchestra.run.smithi045.stdout: -1730> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003cf) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.978 INFO:teuthology.orchestra.run.smithi045.stdout: -1729> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003d0 [2,head] /dc-dir/dc-file_475 auth v4596 s=3 n(v0 rc2023-10-03T19:17:51.206128+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9452c000] 2023-10-03T19:21:24.978 INFO:teuthology.orchestra.run.smithi045.stdout: -1728> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.978 INFO:teuthology.orchestra.run.smithi045.stdout: -1727> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003d1 [2,head] /dc-dir/dc-file_476 auth v4598 s=3 n(v0 rc2023-10-03T19:17:51.217560+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9452c580] 2023-10-03T19:21:24.978 INFO:teuthology.orchestra.run.smithi045.stdout: -1726> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.978 INFO:teuthology.orchestra.run.smithi045.stdout: -1725> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003d2 [2,head] /dc-dir/dc-file_477 auth v4600 s=3 n(v0 rc2023-10-03T19:17:51.229269+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9452cb00] 2023-10-03T19:21:24.979 INFO:teuthology.orchestra.run.smithi045.stdout: -1724> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.979 INFO:teuthology.orchestra.run.smithi045.stdout: -1723> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003d3 [2,head] /dc-dir/dc-file_478 auth v4602 s=3 n(v0 rc2023-10-03T19:17:51.240251+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9452d080] 2023-10-03T19:21:24.979 INFO:teuthology.orchestra.run.smithi045.stdout: -1722> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.979 INFO:teuthology.orchestra.run.smithi045.stdout: -1721> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003d4 [2,head] /dc-dir/dc-file_479 auth v4604 s=3 n(v0 rc2023-10-03T19:17:51.252644+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9452d600] 2023-10-03T19:21:24.979 INFO:teuthology.orchestra.run.smithi045.stdout: -1720> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.979 INFO:teuthology.orchestra.run.smithi045.stdout: -1719> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003d5 [2,head] /dc-dir/dc-file_480 auth v4606 s=3 n(v0 rc2023-10-03T19:17:51.263746+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9452db80] 2023-10-03T19:21:24.979 INFO:teuthology.orchestra.run.smithi045.stdout: -1718> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.979 INFO:teuthology.orchestra.run.smithi045.stdout: -1717> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003d6 [2,head] /dc-dir/dc-file_481 auth v4608 s=3 n(v0 rc2023-10-03T19:17:51.275004+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9452e100] 2023-10-03T19:21:24.979 INFO:teuthology.orchestra.run.smithi045.stdout: -1716> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.979 INFO:teuthology.orchestra.run.smithi045.stdout: -1715> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003d7 [2,head] /dc-dir/dc-file_482 auth v4610 s=3 n(v0 rc2023-10-03T19:17:51.286265+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9452e680] 2023-10-03T19:21:24.980 INFO:teuthology.orchestra.run.smithi045.stdout: -1714> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.980 INFO:teuthology.orchestra.run.smithi045.stdout: -1713> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003d8 [2,head] /dc-dir/dc-file_483 auth v4612 s=3 n(v0 rc2023-10-03T19:17:51.297735+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9452ec00] 2023-10-03T19:21:24.980 INFO:teuthology.orchestra.run.smithi045.stdout: -1712> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.980 INFO:teuthology.orchestra.run.smithi045.stdout: -1711> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003d9 [2,head] /dc-dir/dc-file_484 auth v4614 s=3 n(v0 rc2023-10-03T19:17:51.310120+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9452f180] 2023-10-03T19:21:24.980 INFO:teuthology.orchestra.run.smithi045.stdout: -1710> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003d9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.980 INFO:teuthology.orchestra.run.smithi045.stdout: -1709> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003da [2,head] /dc-dir/dc-file_485 auth v4616 s=3 n(v0 rc2023-10-03T19:17:51.322012+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9452f700] 2023-10-03T19:21:24.980 INFO:teuthology.orchestra.run.smithi045.stdout: -1708> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003da) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.980 INFO:teuthology.orchestra.run.smithi045.stdout: -1707> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003db [2,head] /dc-dir/dc-file_486 auth v4618 s=3 n(v0 rc2023-10-03T19:17:51.333569+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94534000] 2023-10-03T19:21:24.980 INFO:teuthology.orchestra.run.smithi045.stdout: -1706> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003db) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.980 INFO:teuthology.orchestra.run.smithi045.stdout: -1705> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003dc [2,head] /dc-dir/dc-file_487 auth v4620 s=3 n(v0 rc2023-10-03T19:17:51.345727+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94534580] 2023-10-03T19:21:24.980 INFO:teuthology.orchestra.run.smithi045.stdout: -1704> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003dc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.981 INFO:teuthology.orchestra.run.smithi045.stdout: -1703> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003dd [2,head] /dc-dir/dc-file_488 auth v4622 s=3 n(v0 rc2023-10-03T19:17:51.358874+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94534b00] 2023-10-03T19:21:24.981 INFO:teuthology.orchestra.run.smithi045.stdout: -1702> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003dd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.981 INFO:teuthology.orchestra.run.smithi045.stdout: -1701> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003de [2,head] /dc-dir/dc-file_489 auth v4624 s=3 n(v0 rc2023-10-03T19:17:51.371180+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94535080] 2023-10-03T19:21:24.981 INFO:teuthology.orchestra.run.smithi045.stdout: -1700> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003de) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.981 INFO:teuthology.orchestra.run.smithi045.stdout: -1699> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003df [2,head] /dc-dir/dc-file_490 auth v4626 s=3 n(v0 rc2023-10-03T19:17:51.383436+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94535600] 2023-10-03T19:21:24.981 INFO:teuthology.orchestra.run.smithi045.stdout: -1698> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003df) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.981 INFO:teuthology.orchestra.run.smithi045.stdout: -1697> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003e0 [2,head] /dc-dir/dc-file_491 auth v4628 s=3 n(v0 rc2023-10-03T19:17:51.394939+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94535b80] 2023-10-03T19:21:24.981 INFO:teuthology.orchestra.run.smithi045.stdout: -1696> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.981 INFO:teuthology.orchestra.run.smithi045.stdout: -1695> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003e1 [2,head] /dc-dir/dc-file_492 auth v4630 s=3 n(v0 rc2023-10-03T19:17:51.406451+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94536100] 2023-10-03T19:21:24.981 INFO:teuthology.orchestra.run.smithi045.stdout: -1694> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.981 INFO:teuthology.orchestra.run.smithi045.stdout: -1693> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003e2 [2,head] /dc-dir/dc-file_493 auth v4632 s=3 n(v0 rc2023-10-03T19:17:51.418435+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94536680] 2023-10-03T19:21:24.981 INFO:teuthology.orchestra.run.smithi045.stdout: -1692> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.982 INFO:teuthology.orchestra.run.smithi045.stdout: -1691> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003e3 [2,head] /dc-dir/dc-file_494 auth v4634 s=3 n(v0 rc2023-10-03T19:17:51.430389+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94536c00] 2023-10-03T19:21:24.982 INFO:teuthology.orchestra.run.smithi045.stdout: -1690> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.982 INFO:teuthology.orchestra.run.smithi045.stdout: -1689> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003e4 [2,head] /dc-dir/dc-file_495 auth v4636 s=3 n(v0 rc2023-10-03T19:17:51.441665+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94537180] 2023-10-03T19:21:24.982 INFO:teuthology.orchestra.run.smithi045.stdout: -1688> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.982 INFO:teuthology.orchestra.run.smithi045.stdout: -1687> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003e5 [2,head] /dc-dir/dc-file_496 auth v4638 s=3 n(v0 rc2023-10-03T19:17:51.454042+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94537700] 2023-10-03T19:21:24.982 INFO:teuthology.orchestra.run.smithi045.stdout: -1686> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.982 INFO:teuthology.orchestra.run.smithi045.stdout: -1685> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003e6 [2,head] /dc-dir/dc-file_497 auth v4640 s=3 n(v0 rc2023-10-03T19:17:51.465393+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94540000] 2023-10-03T19:21:24.982 INFO:teuthology.orchestra.run.smithi045.stdout: -1684> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.982 INFO:teuthology.orchestra.run.smithi045.stdout: -1683> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003e7 [2,head] /dc-dir/dc-file_498 auth v4642 s=3 n(v0 rc2023-10-03T19:17:51.478352+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94540580] 2023-10-03T19:21:24.983 INFO:teuthology.orchestra.run.smithi045.stdout: -1682> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.983 INFO:teuthology.orchestra.run.smithi045.stdout: -1681> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003e8 [2,head] /dc-dir/dc-file_499 auth v4644 s=3 n(v0 rc2023-10-03T19:17:51.489364+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94540b00] 2023-10-03T19:21:24.983 INFO:teuthology.orchestra.run.smithi045.stdout: -1680> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.983 INFO:teuthology.orchestra.run.smithi045.stdout: -1679> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003e9 [2,head] /dc-dir/dc-file_500 auth v4646 s=3 n(v0 rc2023-10-03T19:17:51.501101+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94541080] 2023-10-03T19:21:24.983 INFO:teuthology.orchestra.run.smithi045.stdout: -1678> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003e9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.983 INFO:teuthology.orchestra.run.smithi045.stdout: -1677> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ea [2,head] /dc-dir/dc-file_501 auth v4648 s=3 n(v0 rc2023-10-03T19:17:51.512514+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94541600] 2023-10-03T19:21:24.983 INFO:teuthology.orchestra.run.smithi045.stdout: -1676> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ea) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.983 INFO:teuthology.orchestra.run.smithi045.stdout: -1675> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003eb [2,head] /dc-dir/dc-file_502 auth v4650 s=3 n(v0 rc2023-10-03T19:17:51.525153+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94541b80] 2023-10-03T19:21:24.983 INFO:teuthology.orchestra.run.smithi045.stdout: -1674> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003eb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.983 INFO:teuthology.orchestra.run.smithi045.stdout: -1673> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ec [2,head] /dc-dir/dc-file_503 auth v4652 s=3 n(v0 rc2023-10-03T19:17:51.538261+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94542100] 2023-10-03T19:21:24.983 INFO:teuthology.orchestra.run.smithi045.stdout: -1672> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ec) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.984 INFO:teuthology.orchestra.run.smithi045.stdout: -1671> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ed [2,head] /dc-dir/dc-file_504 auth v4654 s=3 n(v0 rc2023-10-03T19:17:51.550523+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94542680] 2023-10-03T19:21:24.984 INFO:teuthology.orchestra.run.smithi045.stdout: -1670> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ed) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.984 INFO:teuthology.orchestra.run.smithi045.stdout: -1669> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ee [2,head] /dc-dir/dc-file_505 auth v4656 s=3 n(v0 rc2023-10-03T19:17:51.562879+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94542c00] 2023-10-03T19:21:24.984 INFO:teuthology.orchestra.run.smithi045.stdout: -1668> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ee) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.984 INFO:teuthology.orchestra.run.smithi045.stdout: -1667> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ef [2,head] /dc-dir/dc-file_506 auth v4658 s=3 n(v0 rc2023-10-03T19:17:51.575414+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94543180] 2023-10-03T19:21:24.984 INFO:teuthology.orchestra.run.smithi045.stdout: -1666> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ef) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.984 INFO:teuthology.orchestra.run.smithi045.stdout: -1665> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003f0 [2,head] /dc-dir/dc-file_507 auth v4660 s=3 n(v0 rc2023-10-03T19:17:51.587113+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94543700] 2023-10-03T19:21:24.984 INFO:teuthology.orchestra.run.smithi045.stdout: -1664> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.984 INFO:teuthology.orchestra.run.smithi045.stdout: -1663> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003f1 [2,head] /dc-dir/dc-file_508 auth v4662 s=3 n(v0 rc2023-10-03T19:17:51.598530+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94548000] 2023-10-03T19:21:24.984 INFO:teuthology.orchestra.run.smithi045.stdout: -1662> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.985 INFO:teuthology.orchestra.run.smithi045.stdout: -1661> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003f2 [2,head] /dc-dir/dc-file_509 auth v4664 s=3 n(v0 rc2023-10-03T19:17:51.609729+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94548580] 2023-10-03T19:21:24.985 INFO:teuthology.orchestra.run.smithi045.stdout: -1660> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.985 INFO:teuthology.orchestra.run.smithi045.stdout: -1659> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003f3 [2,head] /dc-dir/dc-file_510 auth v4666 s=3 n(v0 rc2023-10-03T19:17:51.621272+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94548b00] 2023-10-03T19:21:24.985 INFO:teuthology.orchestra.run.smithi045.stdout: -1658> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.985 INFO:teuthology.orchestra.run.smithi045.stdout: -1657> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003f4 [2,head] /dc-dir/dc-file_511 auth v4668 s=3 n(v0 rc2023-10-03T19:17:51.632408+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94549080] 2023-10-03T19:21:24.985 INFO:teuthology.orchestra.run.smithi045.stdout: -1656> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.985 INFO:teuthology.orchestra.run.smithi045.stdout: -1655> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003f5 [2,head] /dc-dir/dc-file_512 auth v4670 s=3 n(v0 rc2023-10-03T19:17:51.643622+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94549600] 2023-10-03T19:21:24.985 INFO:teuthology.orchestra.run.smithi045.stdout: -1654> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.985 INFO:teuthology.orchestra.run.smithi045.stdout: -1653> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003f6 [2,head] /dc-dir/dc-file_513 auth v4672 s=3 n(v0 rc2023-10-03T19:17:51.655034+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94549b80] 2023-10-03T19:21:24.985 INFO:teuthology.orchestra.run.smithi045.stdout: -1652> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.985 INFO:teuthology.orchestra.run.smithi045.stdout: -1651> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003f7 [2,head] /dc-dir/dc-file_514 auth v4674 s=3 n(v0 rc2023-10-03T19:17:51.666002+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9454a100] 2023-10-03T19:21:24.986 INFO:teuthology.orchestra.run.smithi045.stdout: -1650> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.986 INFO:teuthology.orchestra.run.smithi045.stdout: -1649> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003f8 [2,head] /dc-dir/dc-file_515 auth v4676 s=3 n(v0 rc2023-10-03T19:17:51.677216+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9454a680] 2023-10-03T19:21:24.986 INFO:teuthology.orchestra.run.smithi045.stdout: -1648> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.986 INFO:teuthology.orchestra.run.smithi045.stdout: -1647> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003f9 [2,head] /dc-dir/dc-file_516 auth v4678 s=3 n(v0 rc2023-10-03T19:17:51.689199+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9454ac00] 2023-10-03T19:21:24.986 INFO:teuthology.orchestra.run.smithi045.stdout: -1646> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003f9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.986 INFO:teuthology.orchestra.run.smithi045.stdout: -1645> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003fa [2,head] /dc-dir/dc-file_517 auth v4680 s=3 n(v0 rc2023-10-03T19:17:51.700822+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9454b180] 2023-10-03T19:21:24.986 INFO:teuthology.orchestra.run.smithi045.stdout: -1644> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003fa) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.986 INFO:teuthology.orchestra.run.smithi045.stdout: -1643> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003fb [2,head] /dc-dir/dc-file_518 auth v4682 s=3 n(v0 rc2023-10-03T19:17:51.712247+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9454b700] 2023-10-03T19:21:24.986 INFO:teuthology.orchestra.run.smithi045.stdout: -1642> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003fb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.986 INFO:teuthology.orchestra.run.smithi045.stdout: -1641> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003fc [2,head] /dc-dir/dc-file_519 auth v4684 s=3 n(v0 rc2023-10-03T19:17:51.724358+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9442a000] 2023-10-03T19:21:24.986 INFO:teuthology.orchestra.run.smithi045.stdout: -1640> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003fc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.987 INFO:teuthology.orchestra.run.smithi045.stdout: -1639> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003fd [2,head] /dc-dir/dc-file_520 auth v4686 s=3 n(v0 rc2023-10-03T19:17:51.735902+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9442a580] 2023-10-03T19:21:24.987 INFO:teuthology.orchestra.run.smithi045.stdout: -1638> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003fd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.987 INFO:teuthology.orchestra.run.smithi045.stdout: -1637> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003fe [2,head] /dc-dir/dc-file_521 auth v4688 s=3 n(v0 rc2023-10-03T19:17:51.747848+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9442ab00] 2023-10-03T19:21:24.987 INFO:teuthology.orchestra.run.smithi045.stdout: -1636> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003fe) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.987 INFO:teuthology.orchestra.run.smithi045.stdout: -1635> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000003ff [2,head] /dc-dir/dc-file_522 auth v4690 s=3 n(v0 rc2023-10-03T19:17:51.760561+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9442b080] 2023-10-03T19:21:24.987 INFO:teuthology.orchestra.run.smithi045.stdout: -1634> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000003ff) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.987 INFO:teuthology.orchestra.run.smithi045.stdout: -1633> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000400 [2,head] /dc-dir/dc-file_523 auth v4692 s=3 n(v0 rc2023-10-03T19:17:51.772077+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9442b600] 2023-10-03T19:21:24.987 INFO:teuthology.orchestra.run.smithi045.stdout: -1632> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000400) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.987 INFO:teuthology.orchestra.run.smithi045.stdout: -1631> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000401 [2,head] /dc-dir/dc-file_524 auth v4694 s=3 n(v0 rc2023-10-03T19:17:51.783775+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9442bb80] 2023-10-03T19:21:24.987 INFO:teuthology.orchestra.run.smithi045.stdout: -1630> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000401) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.987 INFO:teuthology.orchestra.run.smithi045.stdout: -1629> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000402 [2,head] /dc-dir/dc-file_525 auth v4696 s=3 n(v0 rc2023-10-03T19:17:51.795514+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9442c100] 2023-10-03T19:21:24.988 INFO:teuthology.orchestra.run.smithi045.stdout: -1628> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000402) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.988 INFO:teuthology.orchestra.run.smithi045.stdout: -1627> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000403 [2,head] /dc-dir/dc-file_526 auth v4698 s=3 n(v0 rc2023-10-03T19:17:51.807295+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9442c680] 2023-10-03T19:21:24.988 INFO:teuthology.orchestra.run.smithi045.stdout: -1626> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000403) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.988 INFO:teuthology.orchestra.run.smithi045.stdout: -1625> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000404 [2,head] /dc-dir/dc-file_527 auth v4700 s=3 n(v0 rc2023-10-03T19:17:51.818652+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9442cc00] 2023-10-03T19:21:24.988 INFO:teuthology.orchestra.run.smithi045.stdout: -1624> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000404) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.988 INFO:teuthology.orchestra.run.smithi045.stdout: -1623> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000405 [2,head] /dc-dir/dc-file_528 auth v4702 s=3 n(v0 rc2023-10-03T19:17:51.831255+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9442d180] 2023-10-03T19:21:24.988 INFO:teuthology.orchestra.run.smithi045.stdout: -1622> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000405) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.988 INFO:teuthology.orchestra.run.smithi045.stdout: -1621> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000406 [2,head] /dc-dir/dc-file_529 auth v4704 s=3 n(v0 rc2023-10-03T19:17:51.843268+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9442d700] 2023-10-03T19:21:24.988 INFO:teuthology.orchestra.run.smithi045.stdout: -1620> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000406) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.988 INFO:teuthology.orchestra.run.smithi045.stdout: -1619> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000407 [2,head] /dc-dir/dc-file_530 auth v4706 s=3 n(v0 rc2023-10-03T19:17:51.855884+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94434000] 2023-10-03T19:21:24.988 INFO:teuthology.orchestra.run.smithi045.stdout: -1618> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000407) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.989 INFO:teuthology.orchestra.run.smithi045.stdout: -1617> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000408 [2,head] /dc-dir/dc-file_531 auth v4708 s=3 n(v0 rc2023-10-03T19:17:51.868223+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94434580] 2023-10-03T19:21:24.989 INFO:teuthology.orchestra.run.smithi045.stdout: -1616> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000408) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.989 INFO:teuthology.orchestra.run.smithi045.stdout: -1615> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000409 [2,head] /dc-dir/dc-file_532 auth v4710 s=3 n(v0 rc2023-10-03T19:17:51.880066+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94434b00] 2023-10-03T19:21:24.989 INFO:teuthology.orchestra.run.smithi045.stdout: -1614> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000409) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.989 INFO:teuthology.orchestra.run.smithi045.stdout: -1613> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000040a [2,head] /dc-dir/dc-file_533 auth v4712 s=3 n(v0 rc2023-10-03T19:17:51.892469+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94435080] 2023-10-03T19:21:24.989 INFO:teuthology.orchestra.run.smithi045.stdout: -1612> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000040a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.989 INFO:teuthology.orchestra.run.smithi045.stdout: -1611> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000040b [2,head] /dc-dir/dc-file_534 auth v4714 s=3 n(v0 rc2023-10-03T19:17:51.904167+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94435600] 2023-10-03T19:21:24.989 INFO:teuthology.orchestra.run.smithi045.stdout: -1610> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000040b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.989 INFO:teuthology.orchestra.run.smithi045.stdout: -1609> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000040c [2,head] /dc-dir/dc-file_535 auth v4716 s=3 n(v0 rc2023-10-03T19:17:51.917994+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94435b80] 2023-10-03T19:21:24.989 INFO:teuthology.orchestra.run.smithi045.stdout: -1608> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000040c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.990 INFO:teuthology.orchestra.run.smithi045.stdout: -1607> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000040d [2,head] /dc-dir/dc-file_536 auth v4718 s=3 n(v0 rc2023-10-03T19:17:51.930426+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94436100] 2023-10-03T19:21:24.990 INFO:teuthology.orchestra.run.smithi045.stdout: -1606> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000040d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.990 INFO:teuthology.orchestra.run.smithi045.stdout: -1605> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000040e [2,head] /dc-dir/dc-file_537 auth v4720 s=3 n(v0 rc2023-10-03T19:17:51.942874+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94436680] 2023-10-03T19:21:24.990 INFO:teuthology.orchestra.run.smithi045.stdout: -1604> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000040e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.990 INFO:teuthology.orchestra.run.smithi045.stdout: -1603> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000040f [2,head] /dc-dir/dc-file_538 auth v4722 s=3 n(v0 rc2023-10-03T19:17:51.954237+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94436c00] 2023-10-03T19:21:24.990 INFO:teuthology.orchestra.run.smithi045.stdout: -1602> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000040f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.990 INFO:teuthology.orchestra.run.smithi045.stdout: -1601> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000410 [2,head] /dc-dir/dc-file_539 auth v4724 s=3 n(v0 rc2023-10-03T19:17:51.965749+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94437180] 2023-10-03T19:21:24.990 INFO:teuthology.orchestra.run.smithi045.stdout: -1600> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000410) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.990 INFO:teuthology.orchestra.run.smithi045.stdout: -1599> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000411 [2,head] /dc-dir/dc-file_540 auth v4726 s=3 n(v0 rc2023-10-03T19:17:51.977987+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94437700] 2023-10-03T19:21:24.990 INFO:teuthology.orchestra.run.smithi045.stdout: -1598> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000411) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.991 INFO:teuthology.orchestra.run.smithi045.stdout: -1597> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000412 [2,head] /dc-dir/dc-file_541 auth v4728 s=3 n(v0 rc2023-10-03T19:17:51.989691+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94442000] 2023-10-03T19:21:24.991 INFO:teuthology.orchestra.run.smithi045.stdout: -1596> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000412) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.991 INFO:teuthology.orchestra.run.smithi045.stdout: -1595> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000413 [2,head] /dc-dir/dc-file_542 auth v4730 s=3 n(v0 rc2023-10-03T19:17:52.001754+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94442580] 2023-10-03T19:21:24.991 INFO:teuthology.orchestra.run.smithi045.stdout: -1594> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000413) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.991 INFO:teuthology.orchestra.run.smithi045.stdout: -1593> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000414 [2,head] /dc-dir/dc-file_543 auth v4732 s=3 n(v0 rc2023-10-03T19:17:52.013623+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94442b00] 2023-10-03T19:21:24.991 INFO:teuthology.orchestra.run.smithi045.stdout: -1592> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000414) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.991 INFO:teuthology.orchestra.run.smithi045.stdout: -1591> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000415 [2,head] /dc-dir/dc-file_544 auth v4734 s=3 n(v0 rc2023-10-03T19:17:52.025118+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94443080] 2023-10-03T19:21:24.991 INFO:teuthology.orchestra.run.smithi045.stdout: -1590> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000415) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.991 INFO:teuthology.orchestra.run.smithi045.stdout: -1589> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000416 [2,head] /dc-dir/dc-file_545 auth v4736 s=3 n(v0 rc2023-10-03T19:17:52.036209+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94443600] 2023-10-03T19:21:24.991 INFO:teuthology.orchestra.run.smithi045.stdout: -1588> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000416) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.991 INFO:teuthology.orchestra.run.smithi045.stdout: -1587> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000417 [2,head] /dc-dir/dc-file_546 auth v4738 s=3 n(v0 rc2023-10-03T19:17:52.049212+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94443b80] 2023-10-03T19:21:24.991 INFO:teuthology.orchestra.run.smithi045.stdout: -1586> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000417) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.992 INFO:teuthology.orchestra.run.smithi045.stdout: -1585> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000418 [2,head] /dc-dir/dc-file_547 auth v4740 s=3 n(v0 rc2023-10-03T19:17:52.063319+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94444100] 2023-10-03T19:21:24.992 INFO:teuthology.orchestra.run.smithi045.stdout: -1584> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000418) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.992 INFO:teuthology.orchestra.run.smithi045.stdout: -1583> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000419 [2,head] /dc-dir/dc-file_548 auth v5034 s=3 n(v0 rc2023-10-03T19:17:52.082921+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94444680] 2023-10-03T19:21:24.992 INFO:teuthology.orchestra.run.smithi045.stdout: -1582> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000419) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.992 INFO:teuthology.orchestra.run.smithi045.stdout: -1581> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000041a [2,head] /dc-dir/dc-file_549 auth v5036 s=3 n(v0 rc2023-10-03T19:17:52.199659+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94444c00] 2023-10-03T19:21:24.992 INFO:teuthology.orchestra.run.smithi045.stdout: -1580> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000041a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:24.992 INFO:teuthology.orchestra.run.smithi045.stdout: -1579> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000041b [2,head] /dc-dir/dc-file_550 auth v5038 s=3 n(v0 rc2023-10-03T19:17:52.212148+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94445180] 2023-10-03T19:21:24.992 INFO:teuthology.orchestra.run.smithi045.stdout: -1578> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000041b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.130 INFO:teuthology.orchestra.run.smithi045.stdout: -1577> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000041c [2,head] /dc-dir/dc-file_551 auth v5040 s=3 n(v0 rc2023-10-03T19:17:52.223592+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94445700] 2023-10-03T19:21:25.130 INFO:teuthology.orchestra.run.smithi045.stdout: -1576> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000041c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.130 INFO:teuthology.orchestra.run.smithi045.stdout: -1575> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000041d [2,head] /dc-dir/dc-file_552 auth v5042 s=3 n(v0 rc2023-10-03T19:17:52.235543+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94566000] 2023-10-03T19:21:25.130 INFO:teuthology.orchestra.run.smithi045.stdout: -1574> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000041d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.131 INFO:teuthology.orchestra.run.smithi045.stdout: -1573> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000041e [2,head] /dc-dir/dc-file_553 auth v5044 s=3 n(v0 rc2023-10-03T19:17:52.247730+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94566580] 2023-10-03T19:21:25.131 INFO:teuthology.orchestra.run.smithi045.stdout: -1572> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000041e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.131 INFO:teuthology.orchestra.run.smithi045.stdout: -1571> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000041f [2,head] /dc-dir/dc-file_554 auth v5046 s=3 n(v0 rc2023-10-03T19:17:52.260060+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94566b00] 2023-10-03T19:21:25.131 INFO:teuthology.orchestra.run.smithi045.stdout: -1570> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000041f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.131 INFO:teuthology.orchestra.run.smithi045.stdout: -1569> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000420 [2,head] /dc-dir/dc-file_555 auth v5048 s=3 n(v0 rc2023-10-03T19:17:52.272421+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94567080] 2023-10-03T19:21:25.131 INFO:teuthology.orchestra.run.smithi045.stdout: -1568> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000420) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.131 INFO:teuthology.orchestra.run.smithi045.stdout: -1567> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000421 [2,head] /dc-dir/dc-file_556 auth v5050 s=3 n(v0 rc2023-10-03T19:17:52.284423+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94567600] 2023-10-03T19:21:25.131 INFO:teuthology.orchestra.run.smithi045.stdout: -1566> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000421) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.131 INFO:teuthology.orchestra.run.smithi045.stdout: -1565> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000422 [2,head] /dc-dir/dc-file_557 auth v5052 s=3 n(v0 rc2023-10-03T19:17:52.296033+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94567b80] 2023-10-03T19:21:25.131 INFO:teuthology.orchestra.run.smithi045.stdout: -1564> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000422) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.131 INFO:teuthology.orchestra.run.smithi045.stdout: -1563> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000423 [2,head] /dc-dir/dc-file_558 auth v5054 s=3 n(v0 rc2023-10-03T19:17:52.308107+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94568100] 2023-10-03T19:21:25.132 INFO:teuthology.orchestra.run.smithi045.stdout: -1562> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000423) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.132 INFO:teuthology.orchestra.run.smithi045.stdout: -1561> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000424 [2,head] /dc-dir/dc-file_559 auth v5056 s=3 n(v0 rc2023-10-03T19:17:52.320539+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94568680] 2023-10-03T19:21:25.132 INFO:teuthology.orchestra.run.smithi045.stdout: -1560> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000424) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.132 INFO:teuthology.orchestra.run.smithi045.stdout: -1559> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000425 [2,head] /dc-dir/dc-file_560 auth v5058 s=3 n(v0 rc2023-10-03T19:17:52.333109+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94568c00] 2023-10-03T19:21:25.132 INFO:teuthology.orchestra.run.smithi045.stdout: -1558> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000425) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.132 INFO:teuthology.orchestra.run.smithi045.stdout: -1557> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000426 [2,head] /dc-dir/dc-file_561 auth v5060 s=3 n(v0 rc2023-10-03T19:17:52.345554+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94569180] 2023-10-03T19:21:25.132 INFO:teuthology.orchestra.run.smithi045.stdout: -1556> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000426) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.132 INFO:teuthology.orchestra.run.smithi045.stdout: -1555> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000427 [2,head] /dc-dir/dc-file_562 auth v5062 s=3 n(v0 rc2023-10-03T19:17:52.358383+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94569700] 2023-10-03T19:21:25.133 INFO:teuthology.orchestra.run.smithi045.stdout: -1554> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000427) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.133 INFO:teuthology.orchestra.run.smithi045.stdout: -1553> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000428 [2,head] /dc-dir/dc-file_563 auth v5064 s=3 n(v0 rc2023-10-03T19:17:52.370578+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94570000] 2023-10-03T19:21:25.133 INFO:teuthology.orchestra.run.smithi045.stdout: -1552> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000428) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.133 INFO:teuthology.orchestra.run.smithi045.stdout: -1551> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000429 [2,head] /dc-dir/dc-file_564 auth v5066 s=3 n(v0 rc2023-10-03T19:17:52.383261+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94570580] 2023-10-03T19:21:25.133 INFO:teuthology.orchestra.run.smithi045.stdout: -1550> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000429) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.133 INFO:teuthology.orchestra.run.smithi045.stdout: -1549> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000042a [2,head] /dc-dir/dc-file_565 auth v5068 s=3 n(v0 rc2023-10-03T19:17:52.395263+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94570b00] 2023-10-03T19:21:25.133 INFO:teuthology.orchestra.run.smithi045.stdout: -1548> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000042a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.133 INFO:teuthology.orchestra.run.smithi045.stdout: -1547> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000042b [2,head] /dc-dir/dc-file_566 auth v5070 s=3 n(v0 rc2023-10-03T19:17:52.407085+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94571080] 2023-10-03T19:21:25.133 INFO:teuthology.orchestra.run.smithi045.stdout: -1546> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000042b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.133 INFO:teuthology.orchestra.run.smithi045.stdout: -1545> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000042c [2,head] /dc-dir/dc-file_567 auth v5072 s=3 n(v0 rc2023-10-03T19:17:52.418880+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94571600] 2023-10-03T19:21:25.133 INFO:teuthology.orchestra.run.smithi045.stdout: -1544> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000042c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.134 INFO:teuthology.orchestra.run.smithi045.stdout: -1543> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000042d [2,head] /dc-dir/dc-file_568 auth v5074 s=3 n(v0 rc2023-10-03T19:17:52.430973+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94571b80] 2023-10-03T19:21:25.134 INFO:teuthology.orchestra.run.smithi045.stdout: -1542> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000042d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.134 INFO:teuthology.orchestra.run.smithi045.stdout: -1541> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000042e [2,head] /dc-dir/dc-file_569 auth v5076 s=3 n(v0 rc2023-10-03T19:17:52.443410+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94572100] 2023-10-03T19:21:25.134 INFO:teuthology.orchestra.run.smithi045.stdout: -1540> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000042e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.134 INFO:teuthology.orchestra.run.smithi045.stdout: -1539> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000042f [2,head] /dc-dir/dc-file_570 auth v5078 s=3 n(v0 rc2023-10-03T19:17:52.455272+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94572680] 2023-10-03T19:21:25.134 INFO:teuthology.orchestra.run.smithi045.stdout: -1538> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000042f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.134 INFO:teuthology.orchestra.run.smithi045.stdout: -1537> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000430 [2,head] /dc-dir/dc-file_571 auth v5080 s=3 n(v0 rc2023-10-03T19:17:52.467900+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94572c00] 2023-10-03T19:21:25.134 INFO:teuthology.orchestra.run.smithi045.stdout: -1536> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000430) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.134 INFO:teuthology.orchestra.run.smithi045.stdout: -1535> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000431 [2,head] /dc-dir/dc-file_572 auth v5082 s=3 n(v0 rc2023-10-03T19:17:52.480014+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94573180] 2023-10-03T19:21:25.134 INFO:teuthology.orchestra.run.smithi045.stdout: -1534> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000431) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.134 INFO:teuthology.orchestra.run.smithi045.stdout: -1533> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000432 [2,head] /dc-dir/dc-file_573 auth v5084 s=3 n(v0 rc2023-10-03T19:17:52.491933+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94573700] 2023-10-03T19:21:25.135 INFO:teuthology.orchestra.run.smithi045.stdout: -1532> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000432) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.135 INFO:teuthology.orchestra.run.smithi045.stdout: -1531> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000433 [2,head] /dc-dir/dc-file_574 auth v5086 s=3 n(v0 rc2023-10-03T19:17:52.504108+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94598000] 2023-10-03T19:21:25.135 INFO:teuthology.orchestra.run.smithi045.stdout: -1530> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000433) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.135 INFO:teuthology.orchestra.run.smithi045.stdout: -1529> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000434 [2,head] /dc-dir/dc-file_575 auth v5088 s=3 n(v0 rc2023-10-03T19:17:52.515753+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94598580] 2023-10-03T19:21:25.135 INFO:teuthology.orchestra.run.smithi045.stdout: -1528> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000434) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.135 INFO:teuthology.orchestra.run.smithi045.stdout: -1527> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000435 [2,head] /dc-dir/dc-file_576 auth v5090 s=3 n(v0 rc2023-10-03T19:17:52.527513+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94598b00] 2023-10-03T19:21:25.135 INFO:teuthology.orchestra.run.smithi045.stdout: -1526> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000435) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.135 INFO:teuthology.orchestra.run.smithi045.stdout: -1525> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000436 [2,head] /dc-dir/dc-file_577 auth v5092 s=3 n(v0 rc2023-10-03T19:17:52.539961+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94599080] 2023-10-03T19:21:25.135 INFO:teuthology.orchestra.run.smithi045.stdout: -1524> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000436) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.135 INFO:teuthology.orchestra.run.smithi045.stdout: -1523> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000437 [2,head] /dc-dir/dc-file_578 auth v5094 s=3 n(v0 rc2023-10-03T19:17:52.551697+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94599600] 2023-10-03T19:21:25.136 INFO:teuthology.orchestra.run.smithi045.stdout: -1522> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000437) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.136 INFO:teuthology.orchestra.run.smithi045.stdout: -1521> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000438 [2,head] /dc-dir/dc-file_579 auth v5096 s=3 n(v0 rc2023-10-03T19:17:52.563962+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94599b80] 2023-10-03T19:21:25.136 INFO:teuthology.orchestra.run.smithi045.stdout: -1520> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000438) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.136 INFO:teuthology.orchestra.run.smithi045.stdout: -1519> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000439 [2,head] /dc-dir/dc-file_580 auth v5098 s=3 n(v0 rc2023-10-03T19:17:52.576055+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9459a100] 2023-10-03T19:21:25.136 INFO:teuthology.orchestra.run.smithi045.stdout: -1518> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000439) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.136 INFO:teuthology.orchestra.run.smithi045.stdout: -1517> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000043a [2,head] /dc-dir/dc-file_581 auth v5100 s=3 n(v0 rc2023-10-03T19:17:52.588141+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9459a680] 2023-10-03T19:21:25.136 INFO:teuthology.orchestra.run.smithi045.stdout: -1516> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000043a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.136 INFO:teuthology.orchestra.run.smithi045.stdout: -1515> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000043b [2,head] /dc-dir/dc-file_582 auth v5102 s=3 n(v0 rc2023-10-03T19:17:52.600484+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9459ac00] 2023-10-03T19:21:25.136 INFO:teuthology.orchestra.run.smithi045.stdout: -1514> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000043b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.136 INFO:teuthology.orchestra.run.smithi045.stdout: -1513> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000043c [2,head] /dc-dir/dc-file_583 auth v5104 s=3 n(v0 rc2023-10-03T19:17:52.612426+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9459b180] 2023-10-03T19:21:25.136 INFO:teuthology.orchestra.run.smithi045.stdout: -1512> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000043c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.136 INFO:teuthology.orchestra.run.smithi045.stdout: -1511> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000043d [2,head] /dc-dir/dc-file_584 auth v5106 s=3 n(v0 rc2023-10-03T19:17:52.624057+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9459b700] 2023-10-03T19:21:25.137 INFO:teuthology.orchestra.run.smithi045.stdout: -1510> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000043d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.137 INFO:teuthology.orchestra.run.smithi045.stdout: -1509> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000043e [2,head] /dc-dir/dc-file_585 auth v5108 s=3 n(v0 rc2023-10-03T19:17:52.636002+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945a0000] 2023-10-03T19:21:25.137 INFO:teuthology.orchestra.run.smithi045.stdout: -1508> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000043e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.137 INFO:teuthology.orchestra.run.smithi045.stdout: -1507> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000043f [2,head] /dc-dir/dc-file_586 auth v5110 s=3 n(v0 rc2023-10-03T19:17:52.647426+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945a0580] 2023-10-03T19:21:25.137 INFO:teuthology.orchestra.run.smithi045.stdout: -1506> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000043f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.137 INFO:teuthology.orchestra.run.smithi045.stdout: -1505> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000440 [2,head] /dc-dir/dc-file_587 auth v5112 s=3 n(v0 rc2023-10-03T19:17:52.660109+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945a0b00] 2023-10-03T19:21:25.137 INFO:teuthology.orchestra.run.smithi045.stdout: -1504> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000440) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.137 INFO:teuthology.orchestra.run.smithi045.stdout: -1503> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000441 [2,head] /dc-dir/dc-file_588 auth v5114 s=3 n(v0 rc2023-10-03T19:17:52.673355+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945a1080] 2023-10-03T19:21:25.137 INFO:teuthology.orchestra.run.smithi045.stdout: -1502> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000441) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.137 INFO:teuthology.orchestra.run.smithi045.stdout: -1501> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000442 [2,head] /dc-dir/dc-file_589 auth v5116 s=3 n(v0 rc2023-10-03T19:17:52.685917+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945a1600] 2023-10-03T19:21:25.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1500> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000442) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1499> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000443 [2,head] /dc-dir/dc-file_590 auth v5118 s=3 n(v0 rc2023-10-03T19:17:52.699540+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945a1b80] 2023-10-03T19:21:25.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1498> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000443) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1497> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000444 [2,head] /dc-dir/dc-file_591 auth v5120 s=3 n(v0 rc2023-10-03T19:17:52.710950+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945a2100] 2023-10-03T19:21:25.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1496> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000444) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1495> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000445 [2,head] /dc-dir/dc-file_592 auth v5122 s=3 n(v0 rc2023-10-03T19:17:52.723542+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945a2680] 2023-10-03T19:21:25.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1494> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000445) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1493> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000446 [2,head] /dc-dir/dc-file_593 auth v5124 s=3 n(v0 rc2023-10-03T19:17:52.735550+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945a2c00] 2023-10-03T19:21:25.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1492> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000446) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1491> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000447 [2,head] /dc-dir/dc-file_594 auth v5126 s=3 n(v0 rc2023-10-03T19:17:52.746996+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945a3180] 2023-10-03T19:21:25.138 INFO:teuthology.orchestra.run.smithi045.stdout: -1490> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000447) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.139 INFO:teuthology.orchestra.run.smithi045.stdout: -1489> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000448 [2,head] /dc-dir/dc-file_595 auth v5128 s=3 n(v0 rc2023-10-03T19:17:52.758690+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945a3700] 2023-10-03T19:21:25.139 INFO:teuthology.orchestra.run.smithi045.stdout: -1488> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000448) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.139 INFO:teuthology.orchestra.run.smithi045.stdout: -1487> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000449 [2,head] /dc-dir/dc-file_596 auth v5130 s=3 n(v0 rc2023-10-03T19:17:52.770413+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945aa000] 2023-10-03T19:21:25.139 INFO:teuthology.orchestra.run.smithi045.stdout: -1486> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000449) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.139 INFO:teuthology.orchestra.run.smithi045.stdout: -1485> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000044a [2,head] /dc-dir/dc-file_597 auth v5132 s=3 n(v0 rc2023-10-03T19:17:52.782255+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945aa580] 2023-10-03T19:21:25.140 INFO:teuthology.orchestra.run.smithi045.stdout: -1484> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000044a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.140 INFO:teuthology.orchestra.run.smithi045.stdout: -1483> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000044b [2,head] /dc-dir/dc-file_598 auth v5134 s=3 n(v0 rc2023-10-03T19:17:52.796025+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945aab00] 2023-10-03T19:21:25.140 INFO:teuthology.orchestra.run.smithi045.stdout: -1482> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000044b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.140 INFO:teuthology.orchestra.run.smithi045.stdout: -1481> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000044c [2,head] /dc-dir/dc-file_599 auth v5136 s=3 n(v0 rc2023-10-03T19:17:52.809169+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945ab080] 2023-10-03T19:21:25.140 INFO:teuthology.orchestra.run.smithi045.stdout: -1480> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000044c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.140 INFO:teuthology.orchestra.run.smithi045.stdout: -1479> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000044d [2,head] /dc-dir/dc-file_600 auth v5138 s=3 n(v0 rc2023-10-03T19:17:52.820937+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945ab600] 2023-10-03T19:21:25.140 INFO:teuthology.orchestra.run.smithi045.stdout: -1478> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000044d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.140 INFO:teuthology.orchestra.run.smithi045.stdout: -1477> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000044e [2,head] /dc-dir/dc-file_601 auth v5140 s=3 n(v0 rc2023-10-03T19:17:52.832418+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945abb80] 2023-10-03T19:21:25.140 INFO:teuthology.orchestra.run.smithi045.stdout: -1476> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000044e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.140 INFO:teuthology.orchestra.run.smithi045.stdout: -1475> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000044f [2,head] /dc-dir/dc-file_602 auth v5142 s=3 n(v0 rc2023-10-03T19:17:52.843762+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945ac100] 2023-10-03T19:21:25.140 INFO:teuthology.orchestra.run.smithi045.stdout: -1474> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000044f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.141 INFO:teuthology.orchestra.run.smithi045.stdout: -1473> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000450 [2,head] /dc-dir/dc-file_603 auth v5144 s=3 n(v0 rc2023-10-03T19:17:52.856130+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945ac680] 2023-10-03T19:21:25.141 INFO:teuthology.orchestra.run.smithi045.stdout: -1472> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000450) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.141 INFO:teuthology.orchestra.run.smithi045.stdout: -1471> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000451 [2,head] /dc-dir/dc-file_604 auth v5146 s=3 n(v0 rc2023-10-03T19:17:52.868781+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945acc00] 2023-10-03T19:21:25.141 INFO:teuthology.orchestra.run.smithi045.stdout: -1470> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000451) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.141 INFO:teuthology.orchestra.run.smithi045.stdout: -1469> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000452 [2,head] /dc-dir/dc-file_605 auth v5148 s=3 n(v0 rc2023-10-03T19:17:52.880171+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945ad180] 2023-10-03T19:21:25.141 INFO:teuthology.orchestra.run.smithi045.stdout: -1468> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000452) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.141 INFO:teuthology.orchestra.run.smithi045.stdout: -1467> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000453 [2,head] /dc-dir/dc-file_606 auth v5150 s=3 n(v0 rc2023-10-03T19:17:52.892822+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945ad700] 2023-10-03T19:21:25.141 INFO:teuthology.orchestra.run.smithi045.stdout: -1466> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000453) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.141 INFO:teuthology.orchestra.run.smithi045.stdout: -1465> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000454 [2,head] /dc-dir/dc-file_607 auth v5152 s=3 n(v0 rc2023-10-03T19:17:52.905669+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945b6000] 2023-10-03T19:21:25.141 INFO:teuthology.orchestra.run.smithi045.stdout: -1464> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000454) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.141 INFO:teuthology.orchestra.run.smithi045.stdout: -1463> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000455 [2,head] /dc-dir/dc-file_608 auth v5154 s=3 n(v0 rc2023-10-03T19:17:52.918244+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945b6580] 2023-10-03T19:21:25.142 INFO:teuthology.orchestra.run.smithi045.stdout: -1462> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000455) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.142 INFO:teuthology.orchestra.run.smithi045.stdout: -1461> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000456 [2,head] /dc-dir/dc-file_609 auth v5156 s=3 n(v0 rc2023-10-03T19:17:52.930989+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945b6b00] 2023-10-03T19:21:25.142 INFO:teuthology.orchestra.run.smithi045.stdout: -1460> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000456) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.142 INFO:teuthology.orchestra.run.smithi045.stdout: -1459> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000457 [2,head] /dc-dir/dc-file_610 auth v5158 s=3 n(v0 rc2023-10-03T19:17:52.943865+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945b7080] 2023-10-03T19:21:25.142 INFO:teuthology.orchestra.run.smithi045.stdout: -1458> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000457) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.142 INFO:teuthology.orchestra.run.smithi045.stdout: -1457> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000458 [2,head] /dc-dir/dc-file_611 auth v5160 s=3 n(v0 rc2023-10-03T19:17:52.955712+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945b7600] 2023-10-03T19:21:25.142 INFO:teuthology.orchestra.run.smithi045.stdout: -1456> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000458) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.142 INFO:teuthology.orchestra.run.smithi045.stdout: -1455> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000459 [2,head] /dc-dir/dc-file_612 auth v5162 s=3 n(v0 rc2023-10-03T19:17:52.968079+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945b7b80] 2023-10-03T19:21:25.142 INFO:teuthology.orchestra.run.smithi045.stdout: -1454> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000459) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.142 INFO:teuthology.orchestra.run.smithi045.stdout: -1453> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000045a [2,head] /dc-dir/dc-file_613 auth v5164 s=3 n(v0 rc2023-10-03T19:17:52.980028+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945b8100] 2023-10-03T19:21:25.142 INFO:teuthology.orchestra.run.smithi045.stdout: -1452> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000045a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.142 INFO:teuthology.orchestra.run.smithi045.stdout: -1451> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000045b [2,head] /dc-dir/dc-file_614 auth v5166 s=3 n(v0 rc2023-10-03T19:17:52.992071+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945b8680] 2023-10-03T19:21:25.143 INFO:teuthology.orchestra.run.smithi045.stdout: -1450> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000045b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.143 INFO:teuthology.orchestra.run.smithi045.stdout: -1449> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000045c [2,head] /dc-dir/dc-file_615 auth v5168 s=3 n(v0 rc2023-10-03T19:17:53.003975+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945b8c00] 2023-10-03T19:21:25.143 INFO:teuthology.orchestra.run.smithi045.stdout: -1448> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000045c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.143 INFO:teuthology.orchestra.run.smithi045.stdout: -1447> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000045d [2,head] /dc-dir/dc-file_616 auth v5170 s=3 n(v0 rc2023-10-03T19:17:53.017170+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945b9180] 2023-10-03T19:21:25.143 INFO:teuthology.orchestra.run.smithi045.stdout: -1446> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000045d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.143 INFO:teuthology.orchestra.run.smithi045.stdout: -1445> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000045e [2,head] /dc-dir/dc-file_617 auth v5172 s=3 n(v0 rc2023-10-03T19:17:53.029673+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945b9700] 2023-10-03T19:21:25.143 INFO:teuthology.orchestra.run.smithi045.stdout: -1444> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000045e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.143 INFO:teuthology.orchestra.run.smithi045.stdout: -1443> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000045f [2,head] /dc-dir/dc-file_618 auth v5174 s=3 n(v0 rc2023-10-03T19:17:53.042482+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945c0000] 2023-10-03T19:21:25.143 INFO:teuthology.orchestra.run.smithi045.stdout: -1442> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000045f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.143 INFO:teuthology.orchestra.run.smithi045.stdout: -1441> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000460 [2,head] /dc-dir/dc-file_619 auth v5176 s=3 n(v0 rc2023-10-03T19:17:53.055107+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945c0580] 2023-10-03T19:21:25.144 INFO:teuthology.orchestra.run.smithi045.stdout: -1440> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000460) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.144 INFO:teuthology.orchestra.run.smithi045.stdout: -1439> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000461 [2,head] /dc-dir/dc-file_620 auth v5178 s=3 n(v0 rc2023-10-03T19:17:53.067338+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945c0b00] 2023-10-03T19:21:25.144 INFO:teuthology.orchestra.run.smithi045.stdout: -1438> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000461) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.144 INFO:teuthology.orchestra.run.smithi045.stdout: -1437> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000462 [2,head] /dc-dir/dc-file_621 auth v5180 s=3 n(v0 rc2023-10-03T19:17:53.079145+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945c1080] 2023-10-03T19:21:25.144 INFO:teuthology.orchestra.run.smithi045.stdout: -1436> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000462) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.144 INFO:teuthology.orchestra.run.smithi045.stdout: -1435> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000463 [2,head] /dc-dir/dc-file_622 auth v5246 s=3 n(v0 rc2023-10-03T19:17:53.169528+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945c1600] 2023-10-03T19:21:25.144 INFO:teuthology.orchestra.run.smithi045.stdout: -1434> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000463) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.144 INFO:teuthology.orchestra.run.smithi045.stdout: -1433> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000464 [2,head] /dc-dir/dc-file_623 auth v5248 s=3 n(v0 rc2023-10-03T19:17:53.217556+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945c1b80] 2023-10-03T19:21:25.144 INFO:teuthology.orchestra.run.smithi045.stdout: -1432> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000464) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.144 INFO:teuthology.orchestra.run.smithi045.stdout: -1431> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000465 [2,head] /dc-dir/dc-file_624 auth v5250 s=3 n(v0 rc2023-10-03T19:17:53.229605+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945c2100] 2023-10-03T19:21:25.144 INFO:teuthology.orchestra.run.smithi045.stdout: -1430> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000465) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.145 INFO:teuthology.orchestra.run.smithi045.stdout: -1429> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000466 [2,head] /dc-dir/dc-file_625 auth v5252 s=3 n(v0 rc2023-10-03T19:17:53.242448+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945c2680] 2023-10-03T19:21:25.145 INFO:teuthology.orchestra.run.smithi045.stdout: -1428> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000466) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.145 INFO:teuthology.orchestra.run.smithi045.stdout: -1427> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000467 [2,head] /dc-dir/dc-file_626 auth v5254 s=3 n(v0 rc2023-10-03T19:17:53.256032+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945c2c00] 2023-10-03T19:21:25.145 INFO:teuthology.orchestra.run.smithi045.stdout: -1426> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000467) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.145 INFO:teuthology.orchestra.run.smithi045.stdout: -1425> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000468 [2,head] /dc-dir/dc-file_627 auth v5256 s=3 n(v0 rc2023-10-03T19:17:53.267975+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945c3180] 2023-10-03T19:21:25.145 INFO:teuthology.orchestra.run.smithi045.stdout: -1424> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000468) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.145 INFO:teuthology.orchestra.run.smithi045.stdout: -1423> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000469 [2,head] /dc-dir/dc-file_628 auth v5258 s=3 n(v0 rc2023-10-03T19:17:53.280071+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945c3700] 2023-10-03T19:21:25.145 INFO:teuthology.orchestra.run.smithi045.stdout: -1422> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000469) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.145 INFO:teuthology.orchestra.run.smithi045.stdout: -1421> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000046a [2,head] /dc-dir/dc-file_629 auth v5260 s=3 n(v0 rc2023-10-03T19:17:53.292019+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945da000] 2023-10-03T19:21:25.145 INFO:teuthology.orchestra.run.smithi045.stdout: -1420> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000046a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.145 INFO:teuthology.orchestra.run.smithi045.stdout: -1419> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000046b [2,head] /dc-dir/dc-file_630 auth v5262 s=3 n(v0 rc2023-10-03T19:17:53.303347+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945da580] 2023-10-03T19:21:25.146 INFO:teuthology.orchestra.run.smithi045.stdout: -1418> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000046b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.146 INFO:teuthology.orchestra.run.smithi045.stdout: -1417> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000046c [2,head] /dc-dir/dc-file_631 auth v5264 s=3 n(v0 rc2023-10-03T19:17:53.314946+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945dab00] 2023-10-03T19:21:25.146 INFO:teuthology.orchestra.run.smithi045.stdout: -1416> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000046c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.146 INFO:teuthology.orchestra.run.smithi045.stdout: -1415> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000046d [2,head] /dc-dir/dc-file_632 auth v5266 s=3 n(v0 rc2023-10-03T19:17:53.327969+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945db080] 2023-10-03T19:21:25.146 INFO:teuthology.orchestra.run.smithi045.stdout: -1414> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000046d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.146 INFO:teuthology.orchestra.run.smithi045.stdout: -1413> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000046e [2,head] /dc-dir/dc-file_633 auth v5268 s=3 n(v0 rc2023-10-03T19:17:53.339950+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945db600] 2023-10-03T19:21:25.146 INFO:teuthology.orchestra.run.smithi045.stdout: -1412> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000046e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.146 INFO:teuthology.orchestra.run.smithi045.stdout: -1411> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000046f [2,head] /dc-dir/dc-file_634 auth v5270 s=3 n(v0 rc2023-10-03T19:17:53.352501+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945dbb80] 2023-10-03T19:21:25.146 INFO:teuthology.orchestra.run.smithi045.stdout: -1410> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000046f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.146 INFO:teuthology.orchestra.run.smithi045.stdout: -1409> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000470 [2,head] /dc-dir/dc-file_635 auth v5272 s=3 n(v0 rc2023-10-03T19:17:53.364383+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945dc100] 2023-10-03T19:21:25.158 INFO:teuthology.orchestra.run.smithi045.stdout: -1408> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000470) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.158 INFO:teuthology.orchestra.run.smithi045.stdout: -1407> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000471 [2,head] /dc-dir/dc-file_636 auth v5274 s=3 n(v0 rc2023-10-03T19:17:53.377355+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945dc680] 2023-10-03T19:21:25.158 INFO:teuthology.orchestra.run.smithi045.stdout: -1406> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000471) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.158 INFO:teuthology.orchestra.run.smithi045.stdout: -1405> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000472 [2,head] /dc-dir/dc-file_637 auth v5276 s=3 n(v0 rc2023-10-03T19:17:53.389836+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945dcc00] 2023-10-03T19:21:25.158 INFO:teuthology.orchestra.run.smithi045.stdout: -1404> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000472) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.158 INFO:teuthology.orchestra.run.smithi045.stdout: -1403> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000473 [2,head] /dc-dir/dc-file_638 auth v5278 s=3 n(v0 rc2023-10-03T19:17:53.401904+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945dd180] 2023-10-03T19:21:25.158 INFO:teuthology.orchestra.run.smithi045.stdout: -1402> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000473) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.158 INFO:teuthology.orchestra.run.smithi045.stdout: -1401> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000474 [2,head] /dc-dir/dc-file_639 auth v5280 s=3 n(v0 rc2023-10-03T19:17:53.414842+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945dd700] 2023-10-03T19:21:25.158 INFO:teuthology.orchestra.run.smithi045.stdout: -1400> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000474) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.158 INFO:teuthology.orchestra.run.smithi045.stdout: -1399> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000475 [2,head] /dc-dir/dc-file_640 auth v5282 s=3 n(v0 rc2023-10-03T19:17:53.426552+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945f2000] 2023-10-03T19:21:25.158 INFO:teuthology.orchestra.run.smithi045.stdout: -1398> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000475) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.159 INFO:teuthology.orchestra.run.smithi045.stdout: -1397> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000476 [2,head] /dc-dir/dc-file_641 auth v5284 s=3 n(v0 rc2023-10-03T19:17:53.438725+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945f2580] 2023-10-03T19:21:25.159 INFO:teuthology.orchestra.run.smithi045.stdout: -1396> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000476) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.159 INFO:teuthology.orchestra.run.smithi045.stdout: -1395> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000477 [2,head] /dc-dir/dc-file_642 auth v5286 s=3 n(v0 rc2023-10-03T19:17:53.451879+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945f2b00] 2023-10-03T19:21:25.159 INFO:teuthology.orchestra.run.smithi045.stdout: -1394> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000477) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.159 INFO:teuthology.orchestra.run.smithi045.stdout: -1393> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000478 [2,head] /dc-dir/dc-file_643 auth v5288 s=3 n(v0 rc2023-10-03T19:17:53.463798+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945f3080] 2023-10-03T19:21:25.159 INFO:teuthology.orchestra.run.smithi045.stdout: -1392> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000478) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.159 INFO:teuthology.orchestra.run.smithi045.stdout: -1391> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000479 [2,head] /dc-dir/dc-file_644 auth v5290 s=3 n(v0 rc2023-10-03T19:17:53.475546+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945f3600] 2023-10-03T19:21:25.159 INFO:teuthology.orchestra.run.smithi045.stdout: -1390> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000479) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.159 INFO:teuthology.orchestra.run.smithi045.stdout: -1389> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000047a [2,head] /dc-dir/dc-file_645 auth v5292 s=3 n(v0 rc2023-10-03T19:17:53.488285+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945f3b80] 2023-10-03T19:21:25.159 INFO:teuthology.orchestra.run.smithi045.stdout: -1388> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000047a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.160 INFO:teuthology.orchestra.run.smithi045.stdout: -1387> 2023-10-03T19:18:12.101+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000047b [2,head] /dc-dir/dc-file_646 auth v5294 s=3 n(v0 rc2023-10-03T19:17:53.502775+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945f4100] 2023-10-03T19:21:25.160 INFO:teuthology.orchestra.run.smithi045.stdout: -1386> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000047b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.160 INFO:teuthology.orchestra.run.smithi045.stdout: -1385> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000047c [2,head] /dc-dir/dc-file_647 auth v5296 s=3 n(v0 rc2023-10-03T19:17:53.516655+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945f4680] 2023-10-03T19:21:25.160 INFO:teuthology.orchestra.run.smithi045.stdout: -1384> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000047c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.160 INFO:teuthology.orchestra.run.smithi045.stdout: -1383> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000047d [2,head] /dc-dir/dc-file_648 auth v5298 s=3 n(v0 rc2023-10-03T19:17:53.529133+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945f4c00] 2023-10-03T19:21:25.160 INFO:teuthology.orchestra.run.smithi045.stdout: -1382> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000047d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.160 INFO:teuthology.orchestra.run.smithi045.stdout: -1381> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000047e [2,head] /dc-dir/dc-file_649 auth v5300 s=3 n(v0 rc2023-10-03T19:17:53.540393+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945f5180] 2023-10-03T19:21:25.160 INFO:teuthology.orchestra.run.smithi045.stdout: -1380> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000047e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.160 INFO:teuthology.orchestra.run.smithi045.stdout: -1379> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000047f [2,head] /dc-dir/dc-file_650 auth v5302 s=3 n(v0 rc2023-10-03T19:17:53.552977+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945f5700] 2023-10-03T19:21:25.160 INFO:teuthology.orchestra.run.smithi045.stdout: -1378> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000047f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.160 INFO:teuthology.orchestra.run.smithi045.stdout: -1377> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000480 [2,head] /dc-dir/dc-file_651 auth v5304 s=3 n(v0 rc2023-10-03T19:17:53.566453+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945fa000] 2023-10-03T19:21:25.161 INFO:teuthology.orchestra.run.smithi045.stdout: -1376> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000480) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.161 INFO:teuthology.orchestra.run.smithi045.stdout: -1375> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000481 [2,head] /dc-dir/dc-file_652 auth v5306 s=3 n(v0 rc2023-10-03T19:17:53.578885+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945fa580] 2023-10-03T19:21:25.161 INFO:teuthology.orchestra.run.smithi045.stdout: -1374> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000481) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.161 INFO:teuthology.orchestra.run.smithi045.stdout: -1373> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000482 [2,head] /dc-dir/dc-file_653 auth v5308 s=3 n(v0 rc2023-10-03T19:17:53.591419+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945fab00] 2023-10-03T19:21:25.161 INFO:teuthology.orchestra.run.smithi045.stdout: -1372> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000482) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.161 INFO:teuthology.orchestra.run.smithi045.stdout: -1371> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000483 [2,head] /dc-dir/dc-file_654 auth v5310 s=3 n(v0 rc2023-10-03T19:17:53.604145+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945fb080] 2023-10-03T19:21:25.161 INFO:teuthology.orchestra.run.smithi045.stdout: -1370> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000483) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.161 INFO:teuthology.orchestra.run.smithi045.stdout: -1369> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000484 [2,head] /dc-dir/dc-file_655 auth v5312 s=3 n(v0 rc2023-10-03T19:17:53.617846+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945fb600] 2023-10-03T19:21:25.161 INFO:teuthology.orchestra.run.smithi045.stdout: -1368> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000484) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.161 INFO:teuthology.orchestra.run.smithi045.stdout: -1367> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000485 [2,head] /dc-dir/dc-file_656 auth v5314 s=3 n(v0 rc2023-10-03T19:17:53.630102+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945fbb80] 2023-10-03T19:21:25.161 INFO:teuthology.orchestra.run.smithi045.stdout: -1366> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000485) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.162 INFO:teuthology.orchestra.run.smithi045.stdout: -1365> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000486 [2,head] /dc-dir/dc-file_657 auth v5316 s=3 n(v0 rc2023-10-03T19:17:53.643412+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945fc100] 2023-10-03T19:21:25.162 INFO:teuthology.orchestra.run.smithi045.stdout: -1364> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000486) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.162 INFO:teuthology.orchestra.run.smithi045.stdout: -1363> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000487 [2,head] /dc-dir/dc-file_658 auth v5318 s=3 n(v0 rc2023-10-03T19:17:53.655883+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945fc680] 2023-10-03T19:21:25.162 INFO:teuthology.orchestra.run.smithi045.stdout: -1362> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000487) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.162 INFO:teuthology.orchestra.run.smithi045.stdout: -1361> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000488 [2,head] /dc-dir/dc-file_659 auth v5320 s=3 n(v0 rc2023-10-03T19:17:53.667674+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945fcc00] 2023-10-03T19:21:25.162 INFO:teuthology.orchestra.run.smithi045.stdout: -1360> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000488) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.162 INFO:teuthology.orchestra.run.smithi045.stdout: -1359> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000489 [2,head] /dc-dir/dc-file_660 auth v5322 s=3 n(v0 rc2023-10-03T19:17:53.679313+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945fd180] 2023-10-03T19:21:25.162 INFO:teuthology.orchestra.run.smithi045.stdout: -1358> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000489) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.162 INFO:teuthology.orchestra.run.smithi045.stdout: -1357> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000048a [2,head] /dc-dir/dc-file_661 auth v5324 s=3 n(v0 rc2023-10-03T19:17:53.691279+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc945fd700] 2023-10-03T19:21:25.162 INFO:teuthology.orchestra.run.smithi045.stdout: -1356> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000048a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.163 INFO:teuthology.orchestra.run.smithi045.stdout: -1355> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000048b [2,head] /dc-dir/dc-file_662 auth v5326 s=3 n(v0 rc2023-10-03T19:17:53.704389+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94606000] 2023-10-03T19:21:25.163 INFO:teuthology.orchestra.run.smithi045.stdout: -1354> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000048b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.163 INFO:teuthology.orchestra.run.smithi045.stdout: -1353> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000048c [2,head] /dc-dir/dc-file_663 auth v5328 s=3 n(v0 rc2023-10-03T19:17:53.717211+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94606580] 2023-10-03T19:21:25.163 INFO:teuthology.orchestra.run.smithi045.stdout: -1352> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000048c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.163 INFO:teuthology.orchestra.run.smithi045.stdout: -1351> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000048d [2,head] /dc-dir/dc-file_664 auth v5330 s=3 n(v0 rc2023-10-03T19:17:53.730376+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94606b00] 2023-10-03T19:21:25.163 INFO:teuthology.orchestra.run.smithi045.stdout: -1350> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000048d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.163 INFO:teuthology.orchestra.run.smithi045.stdout: -1349> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000048e [2,head] /dc-dir/dc-file_665 auth v5332 s=3 n(v0 rc2023-10-03T19:17:53.742380+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94607080] 2023-10-03T19:21:25.163 INFO:teuthology.orchestra.run.smithi045.stdout: -1348> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000048e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.163 INFO:teuthology.orchestra.run.smithi045.stdout: -1347> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000048f [2,head] /dc-dir/dc-file_666 auth v5334 s=3 n(v0 rc2023-10-03T19:17:53.754773+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94607600] 2023-10-03T19:21:25.163 INFO:teuthology.orchestra.run.smithi045.stdout: -1346> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000048f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.163 INFO:teuthology.orchestra.run.smithi045.stdout: -1345> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000490 [2,head] /dc-dir/dc-file_667 auth v5336 s=3 n(v0 rc2023-10-03T19:17:53.767403+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94607b80] 2023-10-03T19:21:25.164 INFO:teuthology.orchestra.run.smithi045.stdout: -1344> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000490) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.164 INFO:teuthology.orchestra.run.smithi045.stdout: -1343> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000491 [2,head] /dc-dir/dc-file_668 auth v5338 s=3 n(v0 rc2023-10-03T19:17:53.779255+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94608100] 2023-10-03T19:21:25.164 INFO:teuthology.orchestra.run.smithi045.stdout: -1342> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000491) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.164 INFO:teuthology.orchestra.run.smithi045.stdout: -1341> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000492 [2,head] /dc-dir/dc-file_669 auth v5340 s=3 n(v0 rc2023-10-03T19:17:53.791463+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94608680] 2023-10-03T19:21:25.164 INFO:teuthology.orchestra.run.smithi045.stdout: -1340> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000492) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.164 INFO:teuthology.orchestra.run.smithi045.stdout: -1339> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000493 [2,head] /dc-dir/dc-file_670 auth v5342 s=3 n(v0 rc2023-10-03T19:17:53.804480+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94608c00] 2023-10-03T19:21:25.164 INFO:teuthology.orchestra.run.smithi045.stdout: -1338> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000493) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.164 INFO:teuthology.orchestra.run.smithi045.stdout: -1337> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000494 [2,head] /dc-dir/dc-file_671 auth v5344 s=3 n(v0 rc2023-10-03T19:17:53.816519+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94609180] 2023-10-03T19:21:25.164 INFO:teuthology.orchestra.run.smithi045.stdout: -1336> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000494) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.164 INFO:teuthology.orchestra.run.smithi045.stdout: -1335> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000495 [2,head] /dc-dir/dc-file_672 auth v5346 s=3 n(v0 rc2023-10-03T19:17:53.828245+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94609700] 2023-10-03T19:21:25.165 INFO:teuthology.orchestra.run.smithi045.stdout: -1334> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000495) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.165 INFO:teuthology.orchestra.run.smithi045.stdout: -1333> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000496 [2,head] /dc-dir/dc-file_673 auth v5348 s=3 n(v0 rc2023-10-03T19:17:53.840524+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94612000] 2023-10-03T19:21:25.165 INFO:teuthology.orchestra.run.smithi045.stdout: -1332> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000496) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.165 INFO:teuthology.orchestra.run.smithi045.stdout: -1331> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000497 [2,head] /dc-dir/dc-file_674 auth v5350 s=3 n(v0 rc2023-10-03T19:17:53.851795+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94612580] 2023-10-03T19:21:25.165 INFO:teuthology.orchestra.run.smithi045.stdout: -1330> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000497) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.165 INFO:teuthology.orchestra.run.smithi045.stdout: -1329> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000498 [2,head] /dc-dir/dc-file_675 auth v5352 s=3 n(v0 rc2023-10-03T19:17:53.863775+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94612b00] 2023-10-03T19:21:25.165 INFO:teuthology.orchestra.run.smithi045.stdout: -1328> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000498) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.165 INFO:teuthology.orchestra.run.smithi045.stdout: -1327> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000499 [2,head] /dc-dir/dc-file_676 auth v5354 s=3 n(v0 rc2023-10-03T19:17:53.875771+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94613080] 2023-10-03T19:21:25.165 INFO:teuthology.orchestra.run.smithi045.stdout: -1326> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000499) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.165 INFO:teuthology.orchestra.run.smithi045.stdout: -1325> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000049a [2,head] /dc-dir/dc-file_677 auth v5356 s=3 n(v0 rc2023-10-03T19:17:53.888241+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94613600] 2023-10-03T19:21:25.165 INFO:teuthology.orchestra.run.smithi045.stdout: -1324> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000049a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.166 INFO:teuthology.orchestra.run.smithi045.stdout: -1323> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000049b [2,head] /dc-dir/dc-file_678 auth v5358 s=3 n(v0 rc2023-10-03T19:17:53.900022+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94613b80] 2023-10-03T19:21:25.166 INFO:teuthology.orchestra.run.smithi045.stdout: -1322> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000049b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.166 INFO:teuthology.orchestra.run.smithi045.stdout: -1321> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000049c [2,head] /dc-dir/dc-file_679 auth v5360 s=3 n(v0 rc2023-10-03T19:17:53.911862+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94614100] 2023-10-03T19:21:25.166 INFO:teuthology.orchestra.run.smithi045.stdout: -1320> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000049c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.166 INFO:teuthology.orchestra.run.smithi045.stdout: -1319> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000049d [2,head] /dc-dir/dc-file_680 auth v5362 s=3 n(v0 rc2023-10-03T19:17:53.924086+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94614680] 2023-10-03T19:21:25.166 INFO:teuthology.orchestra.run.smithi045.stdout: -1318> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000049d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.166 INFO:teuthology.orchestra.run.smithi045.stdout: -1317> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000049e [2,head] /dc-dir/dc-file_681 auth v5364 s=3 n(v0 rc2023-10-03T19:17:53.936013+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94614c00] 2023-10-03T19:21:25.166 INFO:teuthology.orchestra.run.smithi045.stdout: -1316> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000049e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.166 INFO:teuthology.orchestra.run.smithi045.stdout: -1315> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000049f [2,head] /dc-dir/dc-file_682 auth v5366 s=3 n(v0 rc2023-10-03T19:17:53.947591+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94615180] 2023-10-03T19:21:25.166 INFO:teuthology.orchestra.run.smithi045.stdout: -1314> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000049f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.292 INFO:teuthology.orchestra.run.smithi045.stdout: -1313> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004a0 [2,head] /dc-dir/dc-file_683 auth v5368 s=3 n(v0 rc2023-10-03T19:17:53.959542+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94615700] 2023-10-03T19:21:25.293 INFO:teuthology.orchestra.run.smithi045.stdout: -1312> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.293 INFO:teuthology.orchestra.run.smithi045.stdout: -1311> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004a1 [2,head] /dc-dir/dc-file_684 auth v5370 s=3 n(v0 rc2023-10-03T19:17:53.971994+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9461a000] 2023-10-03T19:21:25.293 INFO:teuthology.orchestra.run.smithi045.stdout: -1310> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.293 INFO:teuthology.orchestra.run.smithi045.stdout: -1309> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004a2 [2,head] /dc-dir/dc-file_685 auth v5372 s=3 n(v0 rc2023-10-03T19:17:53.984597+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9461a580] 2023-10-03T19:21:25.293 INFO:teuthology.orchestra.run.smithi045.stdout: -1308> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.293 INFO:teuthology.orchestra.run.smithi045.stdout: -1307> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004a3 [2,head] /dc-dir/dc-file_686 auth v5374 s=3 n(v0 rc2023-10-03T19:17:53.997339+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9461ab00] 2023-10-03T19:21:25.293 INFO:teuthology.orchestra.run.smithi045.stdout: -1306> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.293 INFO:teuthology.orchestra.run.smithi045.stdout: -1305> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004a4 [2,head] /dc-dir/dc-file_687 auth v5376 s=3 n(v0 rc2023-10-03T19:17:54.009142+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9461b080] 2023-10-03T19:21:25.294 INFO:teuthology.orchestra.run.smithi045.stdout: -1304> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.294 INFO:teuthology.orchestra.run.smithi045.stdout: -1303> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004a5 [2,head] /dc-dir/dc-file_688 auth v5378 s=3 n(v0 rc2023-10-03T19:17:54.020845+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9461b600] 2023-10-03T19:21:25.294 INFO:teuthology.orchestra.run.smithi045.stdout: -1302> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.294 INFO:teuthology.orchestra.run.smithi045.stdout: -1301> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004a6 [2,head] /dc-dir/dc-file_689 auth v5380 s=3 n(v0 rc2023-10-03T19:17:54.032514+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9461bb80] 2023-10-03T19:21:25.294 INFO:teuthology.orchestra.run.smithi045.stdout: -1300> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.294 INFO:teuthology.orchestra.run.smithi045.stdout: -1299> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004a7 [2,head] /dc-dir/dc-file_690 auth v5382 s=3 n(v0 rc2023-10-03T19:17:54.044237+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9461c100] 2023-10-03T19:21:25.294 INFO:teuthology.orchestra.run.smithi045.stdout: -1298> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.294 INFO:teuthology.orchestra.run.smithi045.stdout: -1297> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004a8 [2,head] /dc-dir/dc-file_691 auth v5384 s=3 n(v0 rc2023-10-03T19:17:54.056477+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9461c680] 2023-10-03T19:21:25.294 INFO:teuthology.orchestra.run.smithi045.stdout: -1296> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.294 INFO:teuthology.orchestra.run.smithi045.stdout: -1295> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004a9 [2,head] /dc-dir/dc-file_692 auth v5386 s=3 n(v0 rc2023-10-03T19:17:54.068400+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9461cc00] 2023-10-03T19:21:25.295 INFO:teuthology.orchestra.run.smithi045.stdout: -1294> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004a9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.295 INFO:teuthology.orchestra.run.smithi045.stdout: -1293> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004aa [2,head] /dc-dir/dc-file_693 auth v5388 s=3 n(v0 rc2023-10-03T19:17:54.081109+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9461d180] 2023-10-03T19:21:25.295 INFO:teuthology.orchestra.run.smithi045.stdout: -1292> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004aa) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.295 INFO:teuthology.orchestra.run.smithi045.stdout: -1291> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ab [2,head] /dc-dir/dc-file_694 auth v5390 s=3 n(v0 rc2023-10-03T19:17:54.163080+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9461d700] 2023-10-03T19:21:25.295 INFO:teuthology.orchestra.run.smithi045.stdout: -1290> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ab) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.295 INFO:teuthology.orchestra.run.smithi045.stdout: -1289> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ac [2,head] /dc-dir/dc-file_695 auth v5392 s=3 n(v0 rc2023-10-03T19:17:54.208121+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94640000] 2023-10-03T19:21:25.295 INFO:teuthology.orchestra.run.smithi045.stdout: -1288> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ac) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.295 INFO:teuthology.orchestra.run.smithi045.stdout: -1287> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ad [2,head] /dc-dir/dc-file_696 auth v5394 s=3 n(v0 rc2023-10-03T19:17:54.220249+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94640580] 2023-10-03T19:21:25.295 INFO:teuthology.orchestra.run.smithi045.stdout: -1286> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ad) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.295 INFO:teuthology.orchestra.run.smithi045.stdout: -1285> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ae [2,head] /dc-dir/dc-file_697 auth v5396 s=3 n(v0 rc2023-10-03T19:17:54.232131+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94640b00] 2023-10-03T19:21:25.295 INFO:teuthology.orchestra.run.smithi045.stdout: -1284> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ae) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.295 INFO:teuthology.orchestra.run.smithi045.stdout: -1283> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004af [2,head] /dc-dir/dc-file_698 auth v5398 s=3 n(v0 rc2023-10-03T19:17:54.243761+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94641080] 2023-10-03T19:21:25.296 INFO:teuthology.orchestra.run.smithi045.stdout: -1282> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004af) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.296 INFO:teuthology.orchestra.run.smithi045.stdout: -1281> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004b0 [2,head] /dc-dir/dc-file_699 auth v5400 s=3 n(v0 rc2023-10-03T19:17:54.256017+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94641600] 2023-10-03T19:21:25.296 INFO:teuthology.orchestra.run.smithi045.stdout: -1280> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.296 INFO:teuthology.orchestra.run.smithi045.stdout: -1279> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004b1 [2,head] /dc-dir/dc-file_700 auth v5402 s=3 n(v0 rc2023-10-03T19:17:54.268455+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94641b80] 2023-10-03T19:21:25.296 INFO:teuthology.orchestra.run.smithi045.stdout: -1278> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.296 INFO:teuthology.orchestra.run.smithi045.stdout: -1277> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004b2 [2,head] /dc-dir/dc-file_701 auth v5404 s=3 n(v0 rc2023-10-03T19:17:54.280625+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94642100] 2023-10-03T19:21:25.296 INFO:teuthology.orchestra.run.smithi045.stdout: -1276> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.296 INFO:teuthology.orchestra.run.smithi045.stdout: -1275> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004b3 [2,head] /dc-dir/dc-file_702 auth v5406 s=3 n(v0 rc2023-10-03T19:17:54.292812+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94642680] 2023-10-03T19:21:25.296 INFO:teuthology.orchestra.run.smithi045.stdout: -1274> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.296 INFO:teuthology.orchestra.run.smithi045.stdout: -1273> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004b4 [2,head] /dc-dir/dc-file_703 auth v5408 s=3 n(v0 rc2023-10-03T19:17:54.305228+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94642c00] 2023-10-03T19:21:25.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1272> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1271> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004b5 [2,head] /dc-dir/dc-file_704 auth v5410 s=3 n(v0 rc2023-10-03T19:17:54.317069+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94643180] 2023-10-03T19:21:25.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1270> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1269> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004b6 [2,head] /dc-dir/dc-file_705 auth v5412 s=3 n(v0 rc2023-10-03T19:17:54.329554+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94643700] 2023-10-03T19:21:25.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1268> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1267> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004b7 [2,head] /dc-dir/dc-file_706 auth v5414 s=3 n(v0 rc2023-10-03T19:17:54.341686+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94648000] 2023-10-03T19:21:25.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1266> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1265> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004b8 [2,head] /dc-dir/dc-file_707 auth v5416 s=3 n(v0 rc2023-10-03T19:17:54.354348+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94648580] 2023-10-03T19:21:25.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1264> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1263> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004b9 [2,head] /dc-dir/dc-file_708 auth v5418 s=3 n(v0 rc2023-10-03T19:17:54.367532+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94648b00] 2023-10-03T19:21:25.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1262> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004b9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1261> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ba [2,head] /dc-dir/dc-file_709 auth v5420 s=3 n(v0 rc2023-10-03T19:17:54.380687+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94649080] 2023-10-03T19:21:25.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1260> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ba) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1259> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004bb [2,head] /dc-dir/dc-file_710 auth v5422 s=3 n(v0 rc2023-10-03T19:17:54.393835+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94649600] 2023-10-03T19:21:25.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1258> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004bb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1257> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004bc [2,head] /dc-dir/dc-file_711 auth v5424 s=3 n(v0 rc2023-10-03T19:17:54.407554+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94649b80] 2023-10-03T19:21:25.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1256> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004bc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1255> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004bd [2,head] /dc-dir/dc-file_712 auth v5426 s=3 n(v0 rc2023-10-03T19:17:54.420427+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9464a100] 2023-10-03T19:21:25.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1254> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004bd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1253> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004be [2,head] /dc-dir/dc-file_713 auth v5428 s=3 n(v0 rc2023-10-03T19:17:54.432059+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9464a680] 2023-10-03T19:21:25.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1252> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004be) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1251> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004bf [2,head] /dc-dir/dc-file_714 auth v5430 s=3 n(v0 rc2023-10-03T19:17:54.443559+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9464ac00] 2023-10-03T19:21:25.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1250> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004bf) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1249> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004c0 [2,head] /dc-dir/dc-file_715 auth v5432 s=3 n(v0 rc2023-10-03T19:17:54.455698+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9464b180] 2023-10-03T19:21:25.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1248> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1247> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004c1 [2,head] /dc-dir/dc-file_716 auth v5434 s=3 n(v0 rc2023-10-03T19:17:54.467945+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9464b700] 2023-10-03T19:21:25.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1246> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1245> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004c2 [2,head] /dc-dir/dc-file_717 auth v5436 s=3 n(v0 rc2023-10-03T19:17:54.480071+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94652000] 2023-10-03T19:21:25.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1244> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1243> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004c3 [2,head] /dc-dir/dc-file_718 auth v5438 s=3 n(v0 rc2023-10-03T19:17:54.492279+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94652580] 2023-10-03T19:21:25.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1242> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1241> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004c4 [2,head] /dc-dir/dc-file_719 auth v5440 s=3 n(v0 rc2023-10-03T19:17:54.504605+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94652b00] 2023-10-03T19:21:25.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1240> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1239> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004c5 [2,head] /dc-dir/dc-file_720 auth v5442 s=3 n(v0 rc2023-10-03T19:17:54.516950+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94653080] 2023-10-03T19:21:25.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1238> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1237> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004c6 [2,head] /dc-dir/dc-file_721 auth v5444 s=3 n(v0 rc2023-10-03T19:17:54.528810+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94653600] 2023-10-03T19:21:25.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1236> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1235> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004c7 [2,head] /dc-dir/dc-file_722 auth v5446 s=3 n(v0 rc2023-10-03T19:17:54.540938+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94653b80] 2023-10-03T19:21:25.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1234> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1233> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004c8 [2,head] /dc-dir/dc-file_723 auth v5448 s=3 n(v0 rc2023-10-03T19:17:54.552452+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94654100] 2023-10-03T19:21:25.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1232> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1231> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004c9 [2,head] /dc-dir/dc-file_724 auth v5450 s=3 n(v0 rc2023-10-03T19:17:54.565114+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94654680] 2023-10-03T19:21:25.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1230> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004c9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1229> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ca [2,head] /dc-dir/dc-file_725 auth v5452 s=3 n(v0 rc2023-10-03T19:17:54.576945+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94654c00] 2023-10-03T19:21:25.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1228> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ca) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1227> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004cb [2,head] /dc-dir/dc-file_726 auth v5454 s=3 n(v0 rc2023-10-03T19:17:54.589297+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94655180] 2023-10-03T19:21:25.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1226> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004cb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1225> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004cc [2,head] /dc-dir/dc-file_727 auth v5456 s=3 n(v0 rc2023-10-03T19:17:54.601256+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94655700] 2023-10-03T19:21:25.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1224> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004cc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1223> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004cd [2,head] /dc-dir/dc-file_728 auth v5458 s=3 n(v0 rc2023-10-03T19:17:54.613299+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9465e000] 2023-10-03T19:21:25.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1222> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004cd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1221> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ce [2,head] /dc-dir/dc-file_729 auth v5460 s=3 n(v0 rc2023-10-03T19:17:54.625847+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9465e580] 2023-10-03T19:21:25.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1220> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ce) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1219> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004cf [2,head] /dc-dir/dc-file_730 auth v5462 s=3 n(v0 rc2023-10-03T19:17:54.638100+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9465eb00] 2023-10-03T19:21:25.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1218> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004cf) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1217> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004d0 [2,head] /dc-dir/dc-file_731 auth v5464 s=3 n(v0 rc2023-10-03T19:17:54.651841+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9465f080] 2023-10-03T19:21:25.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1216> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1215> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004d1 [2,head] /dc-dir/dc-file_732 auth v5466 s=3 n(v0 rc2023-10-03T19:17:54.663894+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9465f600] 2023-10-03T19:21:25.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1214> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1213> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004d2 [2,head] /dc-dir/dc-file_733 auth v5468 s=3 n(v0 rc2023-10-03T19:17:54.677454+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9465fb80] 2023-10-03T19:21:25.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1212> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1211> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004d3 [2,head] /dc-dir/dc-file_734 auth v5470 s=3 n(v0 rc2023-10-03T19:17:54.692125+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94660100] 2023-10-03T19:21:25.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1210> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1209> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004d4 [2,head] /dc-dir/dc-file_735 auth v5472 s=3 n(v0 rc2023-10-03T19:17:54.707587+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94660680] 2023-10-03T19:21:25.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1208> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1207> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004d5 [2,head] /dc-dir/dc-file_736 auth v5474 s=3 n(v0 rc2023-10-03T19:17:54.722599+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94660c00] 2023-10-03T19:21:25.303 INFO:teuthology.orchestra.run.smithi045.stdout: -1206> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.303 INFO:teuthology.orchestra.run.smithi045.stdout: -1205> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004d6 [2,head] /dc-dir/dc-file_737 auth v5476 s=3 n(v0 rc2023-10-03T19:17:54.736554+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94661180] 2023-10-03T19:21:25.303 INFO:teuthology.orchestra.run.smithi045.stdout: -1204> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.303 INFO:teuthology.orchestra.run.smithi045.stdout: -1203> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004d7 [2,head] /dc-dir/dc-file_738 auth v5478 s=3 n(v0 rc2023-10-03T19:17:54.749180+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94661700] 2023-10-03T19:21:25.303 INFO:teuthology.orchestra.run.smithi045.stdout: -1202> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.303 INFO:teuthology.orchestra.run.smithi045.stdout: -1201> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004d8 [2,head] /dc-dir/dc-file_739 auth v5480 s=3 n(v0 rc2023-10-03T19:17:54.761549+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94668000] 2023-10-03T19:21:25.303 INFO:teuthology.orchestra.run.smithi045.stdout: -1200> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.303 INFO:teuthology.orchestra.run.smithi045.stdout: -1199> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004d9 [2,head] /dc-dir/dc-file_740 auth v5482 s=3 n(v0 rc2023-10-03T19:17:54.773481+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94668580] 2023-10-03T19:21:25.314 INFO:teuthology.orchestra.run.smithi045.stdout: -1198> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004d9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.314 INFO:teuthology.orchestra.run.smithi045.stdout: -1197> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004da [2,head] /dc-dir/dc-file_741 auth v5484 s=3 n(v0 rc2023-10-03T19:17:54.785349+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94668b00] 2023-10-03T19:21:25.314 INFO:teuthology.orchestra.run.smithi045.stdout: -1196> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004da) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.314 INFO:teuthology.orchestra.run.smithi045.stdout: -1195> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004db [2,head] /dc-dir/dc-file_742 auth v5486 s=3 n(v0 rc2023-10-03T19:17:54.796787+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94669080] 2023-10-03T19:21:25.315 INFO:teuthology.orchestra.run.smithi045.stdout: -1194> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004db) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.315 INFO:teuthology.orchestra.run.smithi045.stdout: -1193> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004dc [2,head] /dc-dir/dc-file_743 auth v5488 s=3 n(v0 rc2023-10-03T19:17:54.808389+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94669600] 2023-10-03T19:21:25.315 INFO:teuthology.orchestra.run.smithi045.stdout: -1192> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004dc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.315 INFO:teuthology.orchestra.run.smithi045.stdout: -1191> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004dd [2,head] /dc-dir/dc-file_744 auth v5490 s=3 n(v0 rc2023-10-03T19:17:54.821111+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94669b80] 2023-10-03T19:21:25.315 INFO:teuthology.orchestra.run.smithi045.stdout: -1190> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004dd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.315 INFO:teuthology.orchestra.run.smithi045.stdout: -1189> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004de [2,head] /dc-dir/dc-file_745 auth v5492 s=3 n(v0 rc2023-10-03T19:17:54.834341+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9466a100] 2023-10-03T19:21:25.315 INFO:teuthology.orchestra.run.smithi045.stdout: -1188> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004de) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.315 INFO:teuthology.orchestra.run.smithi045.stdout: -1187> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004df [2,head] /dc-dir/dc-file_746 auth v5494 s=3 n(v0 rc2023-10-03T19:17:54.846793+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9466a680] 2023-10-03T19:21:25.315 INFO:teuthology.orchestra.run.smithi045.stdout: -1186> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004df) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.315 INFO:teuthology.orchestra.run.smithi045.stdout: -1185> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004e0 [2,head] /dc-dir/dc-file_747 auth v5496 s=3 n(v0 rc2023-10-03T19:17:54.860603+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9466ac00] 2023-10-03T19:21:25.315 INFO:teuthology.orchestra.run.smithi045.stdout: -1184> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.316 INFO:teuthology.orchestra.run.smithi045.stdout: -1183> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004e1 [2,head] /dc-dir/dc-file_748 auth v5498 s=3 n(v0 rc2023-10-03T19:17:54.874727+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9466b180] 2023-10-03T19:21:25.316 INFO:teuthology.orchestra.run.smithi045.stdout: -1182> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.316 INFO:teuthology.orchestra.run.smithi045.stdout: -1181> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004e2 [2,head] /dc-dir/dc-file_749 auth v5500 s=3 n(v0 rc2023-10-03T19:17:54.887595+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9466b700] 2023-10-03T19:21:25.316 INFO:teuthology.orchestra.run.smithi045.stdout: -1180> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.316 INFO:teuthology.orchestra.run.smithi045.stdout: -1179> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004e3 [2,head] /dc-dir/dc-file_750 auth v5502 s=3 n(v0 rc2023-10-03T19:17:54.900057+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94672000] 2023-10-03T19:21:25.316 INFO:teuthology.orchestra.run.smithi045.stdout: -1178> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.316 INFO:teuthology.orchestra.run.smithi045.stdout: -1177> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004e4 [2,head] /dc-dir/dc-file_751 auth v5504 s=3 n(v0 rc2023-10-03T19:17:54.913061+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94672580] 2023-10-03T19:21:25.316 INFO:teuthology.orchestra.run.smithi045.stdout: -1176> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.316 INFO:teuthology.orchestra.run.smithi045.stdout: -1175> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004e5 [2,head] /dc-dir/dc-file_752 auth v5506 s=3 n(v0 rc2023-10-03T19:17:54.925536+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94672b00] 2023-10-03T19:21:25.316 INFO:teuthology.orchestra.run.smithi045.stdout: -1174> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.316 INFO:teuthology.orchestra.run.smithi045.stdout: -1173> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004e6 [2,head] /dc-dir/dc-file_753 auth v5508 s=3 n(v0 rc2023-10-03T19:17:54.937837+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94673080] 2023-10-03T19:21:25.317 INFO:teuthology.orchestra.run.smithi045.stdout: -1172> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.317 INFO:teuthology.orchestra.run.smithi045.stdout: -1171> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004e7 [2,head] /dc-dir/dc-file_754 auth v5510 s=3 n(v0 rc2023-10-03T19:17:54.950324+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94673600] 2023-10-03T19:21:25.317 INFO:teuthology.orchestra.run.smithi045.stdout: -1170> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.317 INFO:teuthology.orchestra.run.smithi045.stdout: -1169> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004e8 [2,head] /dc-dir/dc-file_755 auth v5512 s=3 n(v0 rc2023-10-03T19:17:54.962865+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94673b80] 2023-10-03T19:21:25.317 INFO:teuthology.orchestra.run.smithi045.stdout: -1168> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.317 INFO:teuthology.orchestra.run.smithi045.stdout: -1167> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004e9 [2,head] /dc-dir/dc-file_756 auth v5514 s=3 n(v0 rc2023-10-03T19:17:54.974478+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94674100] 2023-10-03T19:21:25.317 INFO:teuthology.orchestra.run.smithi045.stdout: -1166> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004e9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.317 INFO:teuthology.orchestra.run.smithi045.stdout: -1165> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ea [2,head] /dc-dir/dc-file_757 auth v5516 s=3 n(v0 rc2023-10-03T19:17:54.985985+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94674680] 2023-10-03T19:21:25.317 INFO:teuthology.orchestra.run.smithi045.stdout: -1164> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ea) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.317 INFO:teuthology.orchestra.run.smithi045.stdout: -1163> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004eb [2,head] /dc-dir/dc-file_758 auth v5518 s=3 n(v0 rc2023-10-03T19:17:54.999529+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94674c00] 2023-10-03T19:21:25.317 INFO:teuthology.orchestra.run.smithi045.stdout: -1162> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004eb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.318 INFO:teuthology.orchestra.run.smithi045.stdout: -1161> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ec [2,head] /dc-dir/dc-file_759 auth v5520 s=3 n(v0 rc2023-10-03T19:17:55.011926+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94675180] 2023-10-03T19:21:25.318 INFO:teuthology.orchestra.run.smithi045.stdout: -1160> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ec) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.318 INFO:teuthology.orchestra.run.smithi045.stdout: -1159> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ed [2,head] /dc-dir/dc-file_760 auth v5522 s=3 n(v0 rc2023-10-03T19:17:55.024656+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94675700] 2023-10-03T19:21:25.318 INFO:teuthology.orchestra.run.smithi045.stdout: -1158> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ed) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.318 INFO:teuthology.orchestra.run.smithi045.stdout: -1157> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ee [2,head] /dc-dir/dc-file_761 auth v5524 s=3 n(v0 rc2023-10-03T19:17:55.036181+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946f4000] 2023-10-03T19:21:25.318 INFO:teuthology.orchestra.run.smithi045.stdout: -1156> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ee) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.318 INFO:teuthology.orchestra.run.smithi045.stdout: -1155> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ef [2,head] /dc-dir/dc-file_762 auth v5526 s=3 n(v0 rc2023-10-03T19:17:55.048073+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946f4580] 2023-10-03T19:21:25.318 INFO:teuthology.orchestra.run.smithi045.stdout: -1154> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ef) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.318 INFO:teuthology.orchestra.run.smithi045.stdout: -1153> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004f0 [2,head] /dc-dir/dc-file_763 auth v5528 s=3 n(v0 rc2023-10-03T19:17:55.061223+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946f4b00] 2023-10-03T19:21:25.318 INFO:teuthology.orchestra.run.smithi045.stdout: -1152> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.318 INFO:teuthology.orchestra.run.smithi045.stdout: -1151> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004f1 [2,head] /dc-dir/dc-file_764 auth v5530 s=3 n(v0 rc2023-10-03T19:17:55.074204+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946f5080] 2023-10-03T19:21:25.319 INFO:teuthology.orchestra.run.smithi045.stdout: -1150> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.319 INFO:teuthology.orchestra.run.smithi045.stdout: -1149> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004f2 [2,head] /dc-dir/dc-file_765 auth v5532 s=3 n(v0 rc2023-10-03T19:17:55.086215+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946f5600] 2023-10-03T19:21:25.319 INFO:teuthology.orchestra.run.smithi045.stdout: -1148> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.319 INFO:teuthology.orchestra.run.smithi045.stdout: -1147> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004f3 [2,head] /dc-dir/dc-file_766 auth v5534 s=3 n(v0 rc2023-10-03T19:17:55.175732+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946f5b80] 2023-10-03T19:21:25.319 INFO:teuthology.orchestra.run.smithi045.stdout: -1146> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.319 INFO:teuthology.orchestra.run.smithi045.stdout: -1145> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004f4 [2,head] /dc-dir/dc-file_767 auth v5536 s=3 n(v0 rc2023-10-03T19:17:55.220342+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946f6100] 2023-10-03T19:21:25.455 INFO:teuthology.orchestra.run.smithi045.stdout: -1144> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.456 INFO:teuthology.orchestra.run.smithi045.stdout: -1143> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004f5 [2,head] /dc-dir/dc-file_768 auth v5538 s=3 n(v0 rc2023-10-03T19:17:55.235262+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946f6680] 2023-10-03T19:21:25.456 INFO:teuthology.orchestra.run.smithi045.stdout: -1142> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.456 INFO:teuthology.orchestra.run.smithi045.stdout: -1141> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004f6 [2,head] /dc-dir/dc-file_769 auth v5540 s=3 n(v0 rc2023-10-03T19:17:55.247014+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946f6c00] 2023-10-03T19:21:25.456 INFO:teuthology.orchestra.run.smithi045.stdout: -1140> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.456 INFO:teuthology.orchestra.run.smithi045.stdout: -1139> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004f7 [2,head] /dc-dir/dc-file_770 auth v5542 s=3 n(v0 rc2023-10-03T19:17:55.259090+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946f7180] 2023-10-03T19:21:25.456 INFO:teuthology.orchestra.run.smithi045.stdout: -1138> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.456 INFO:teuthology.orchestra.run.smithi045.stdout: -1137> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004f8 [2,head] /dc-dir/dc-file_771 auth v5544 s=3 n(v0 rc2023-10-03T19:17:55.270969+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946f7700] 2023-10-03T19:21:25.456 INFO:teuthology.orchestra.run.smithi045.stdout: -1136> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.456 INFO:teuthology.orchestra.run.smithi045.stdout: -1135> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004f9 [2,head] /dc-dir/dc-file_772 auth v5546 s=3 n(v0 rc2023-10-03T19:17:55.283288+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94730000] 2023-10-03T19:21:25.456 INFO:teuthology.orchestra.run.smithi045.stdout: -1134> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004f9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.456 INFO:teuthology.orchestra.run.smithi045.stdout: -1133> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004fa [2,head] /dc-dir/dc-file_773 auth v5548 s=3 n(v0 rc2023-10-03T19:17:55.294975+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94730580] 2023-10-03T19:21:25.457 INFO:teuthology.orchestra.run.smithi045.stdout: -1132> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004fa) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.457 INFO:teuthology.orchestra.run.smithi045.stdout: -1131> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004fb [2,head] /dc-dir/dc-file_774 auth v5550 s=3 n(v0 rc2023-10-03T19:17:55.306882+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94730b00] 2023-10-03T19:21:25.457 INFO:teuthology.orchestra.run.smithi045.stdout: -1130> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004fb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.457 INFO:teuthology.orchestra.run.smithi045.stdout: -1129> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004fc [2,head] /dc-dir/dc-file_775 auth v5552 s=3 n(v0 rc2023-10-03T19:17:55.318660+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94731080] 2023-10-03T19:21:25.457 INFO:teuthology.orchestra.run.smithi045.stdout: -1128> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004fc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.457 INFO:teuthology.orchestra.run.smithi045.stdout: -1127> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004fd [2,head] /dc-dir/dc-file_776 auth v5554 s=3 n(v0 rc2023-10-03T19:17:55.330712+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94731600] 2023-10-03T19:21:25.457 INFO:teuthology.orchestra.run.smithi045.stdout: -1126> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004fd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.457 INFO:teuthology.orchestra.run.smithi045.stdout: -1125> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004fe [2,head] /dc-dir/dc-file_777 auth v5556 s=3 n(v0 rc2023-10-03T19:17:55.342052+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94731b80] 2023-10-03T19:21:25.457 INFO:teuthology.orchestra.run.smithi045.stdout: -1124> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004fe) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.457 INFO:teuthology.orchestra.run.smithi045.stdout: -1123> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000004ff [2,head] /dc-dir/dc-file_778 auth v5558 s=3 n(v0 rc2023-10-03T19:17:55.354089+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94732100] 2023-10-03T19:21:25.457 INFO:teuthology.orchestra.run.smithi045.stdout: -1122> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000004ff) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.458 INFO:teuthology.orchestra.run.smithi045.stdout: -1121> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000500 [2,head] /dc-dir/dc-file_779 auth v5560 s=3 n(v0 rc2023-10-03T19:17:55.366699+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94732680] 2023-10-03T19:21:25.458 INFO:teuthology.orchestra.run.smithi045.stdout: -1120> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000500) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.458 INFO:teuthology.orchestra.run.smithi045.stdout: -1119> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000501 [2,head] /dc-dir/dc-file_780 auth v5562 s=3 n(v0 rc2023-10-03T19:17:55.378959+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94732c00] 2023-10-03T19:21:25.458 INFO:teuthology.orchestra.run.smithi045.stdout: -1118> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000501) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.458 INFO:teuthology.orchestra.run.smithi045.stdout: -1117> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000502 [2,head] /dc-dir/dc-file_781 auth v5564 s=3 n(v0 rc2023-10-03T19:17:55.391272+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94733180] 2023-10-03T19:21:25.458 INFO:teuthology.orchestra.run.smithi045.stdout: -1116> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000502) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.458 INFO:teuthology.orchestra.run.smithi045.stdout: -1115> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000503 [2,head] /dc-dir/dc-file_782 auth v5566 s=3 n(v0 rc2023-10-03T19:17:55.403260+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94733700] 2023-10-03T19:21:25.458 INFO:teuthology.orchestra.run.smithi045.stdout: -1114> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000503) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.458 INFO:teuthology.orchestra.run.smithi045.stdout: -1113> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000504 [2,head] /dc-dir/dc-file_783 auth v5568 s=3 n(v0 rc2023-10-03T19:17:55.416797+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9473c000] 2023-10-03T19:21:25.458 INFO:teuthology.orchestra.run.smithi045.stdout: -1112> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000504) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.459 INFO:teuthology.orchestra.run.smithi045.stdout: -1111> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000505 [2,head] /dc-dir/dc-file_784 auth v5570 s=3 n(v0 rc2023-10-03T19:17:55.428983+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9473c580] 2023-10-03T19:21:25.459 INFO:teuthology.orchestra.run.smithi045.stdout: -1110> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000505) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.459 INFO:teuthology.orchestra.run.smithi045.stdout: -1109> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000506 [2,head] /dc-dir/dc-file_785 auth v5572 s=3 n(v0 rc2023-10-03T19:17:55.442397+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9473cb00] 2023-10-03T19:21:25.459 INFO:teuthology.orchestra.run.smithi045.stdout: -1108> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000506) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.459 INFO:teuthology.orchestra.run.smithi045.stdout: -1107> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000507 [2,head] /dc-dir/dc-file_786 auth v5574 s=3 n(v0 rc2023-10-03T19:17:55.454795+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9473d080] 2023-10-03T19:21:25.459 INFO:teuthology.orchestra.run.smithi045.stdout: -1106> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000507) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.459 INFO:teuthology.orchestra.run.smithi045.stdout: -1105> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000508 [2,head] /dc-dir/dc-file_787 auth v5576 s=3 n(v0 rc2023-10-03T19:17:55.468067+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9473d600] 2023-10-03T19:21:25.459 INFO:teuthology.orchestra.run.smithi045.stdout: -1104> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000508) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.459 INFO:teuthology.orchestra.run.smithi045.stdout: -1103> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000509 [2,head] /dc-dir/dc-file_788 auth v5578 s=3 n(v0 rc2023-10-03T19:17:55.480149+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9473db80] 2023-10-03T19:21:25.459 INFO:teuthology.orchestra.run.smithi045.stdout: -1102> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000509) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.461 INFO:teuthology.orchestra.run.smithi045.stdout: -1101> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000050a [2,head] /dc-dir/dc-file_789 auth v5580 s=3 n(v0 rc2023-10-03T19:17:55.492989+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9473e100] 2023-10-03T19:21:25.461 INFO:teuthology.orchestra.run.smithi045.stdout: -1100> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000050a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.461 INFO:teuthology.orchestra.run.smithi045.stdout: -1099> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000050b [2,head] /dc-dir/dc-file_790 auth v5582 s=3 n(v0 rc2023-10-03T19:17:55.505499+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9473e680] 2023-10-03T19:21:25.461 INFO:teuthology.orchestra.run.smithi045.stdout: -1098> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000050b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.461 INFO:teuthology.orchestra.run.smithi045.stdout: -1097> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000050c [2,head] /dc-dir/dc-file_791 auth v5584 s=3 n(v0 rc2023-10-03T19:17:55.518506+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9473ec00] 2023-10-03T19:21:25.461 INFO:teuthology.orchestra.run.smithi045.stdout: -1096> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000050c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.461 INFO:teuthology.orchestra.run.smithi045.stdout: -1095> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000050d [2,head] /dc-dir/dc-file_792 auth v5586 s=3 n(v0 rc2023-10-03T19:17:55.531969+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9473f180] 2023-10-03T19:21:25.462 INFO:teuthology.orchestra.run.smithi045.stdout: -1094> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000050d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.462 INFO:teuthology.orchestra.run.smithi045.stdout: -1093> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000050e [2,head] /dc-dir/dc-file_793 auth v5588 s=3 n(v0 rc2023-10-03T19:17:55.544595+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9473f700] 2023-10-03T19:21:25.462 INFO:teuthology.orchestra.run.smithi045.stdout: -1092> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000050e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.462 INFO:teuthology.orchestra.run.smithi045.stdout: -1091> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000050f [2,head] /dc-dir/dc-file_794 auth v5590 s=3 n(v0 rc2023-10-03T19:17:55.558012+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94742000] 2023-10-03T19:21:25.462 INFO:teuthology.orchestra.run.smithi045.stdout: -1090> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000050f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.462 INFO:teuthology.orchestra.run.smithi045.stdout: -1089> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000510 [2,head] /dc-dir/dc-file_795 auth v5592 s=3 n(v0 rc2023-10-03T19:17:55.570089+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94742580] 2023-10-03T19:21:25.462 INFO:teuthology.orchestra.run.smithi045.stdout: -1088> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000510) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.462 INFO:teuthology.orchestra.run.smithi045.stdout: -1087> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000511 [2,head] /dc-dir/dc-file_796 auth v5594 s=3 n(v0 rc2023-10-03T19:17:55.581774+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94742b00] 2023-10-03T19:21:25.462 INFO:teuthology.orchestra.run.smithi045.stdout: -1086> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000511) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.462 INFO:teuthology.orchestra.run.smithi045.stdout: -1085> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000512 [2,head] /dc-dir/dc-file_797 auth v5596 s=3 n(v0 rc2023-10-03T19:17:55.594246+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94743080] 2023-10-03T19:21:25.463 INFO:teuthology.orchestra.run.smithi045.stdout: -1084> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000512) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.463 INFO:teuthology.orchestra.run.smithi045.stdout: -1083> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000513 [2,head] /dc-dir/dc-file_798 auth v5598 s=3 n(v0 rc2023-10-03T19:17:55.608115+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94743600] 2023-10-03T19:21:25.463 INFO:teuthology.orchestra.run.smithi045.stdout: -1082> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000513) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.463 INFO:teuthology.orchestra.run.smithi045.stdout: -1081> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000514 [2,head] /dc-dir/dc-file_799 auth v5600 s=3 n(v0 rc2023-10-03T19:17:55.621261+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94743b80] 2023-10-03T19:21:25.463 INFO:teuthology.orchestra.run.smithi045.stdout: -1080> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000514) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.463 INFO:teuthology.orchestra.run.smithi045.stdout: -1079> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000515 [2,head] /dc-dir/dc-file_800 auth v5602 s=3 n(v0 rc2023-10-03T19:17:55.633573+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94744100] 2023-10-03T19:21:25.463 INFO:teuthology.orchestra.run.smithi045.stdout: -1078> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000515) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.463 INFO:teuthology.orchestra.run.smithi045.stdout: -1077> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000516 [2,head] /dc-dir/dc-file_801 auth v5604 s=3 n(v0 rc2023-10-03T19:17:55.646896+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94744680] 2023-10-03T19:21:25.463 INFO:teuthology.orchestra.run.smithi045.stdout: -1076> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000516) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.463 INFO:teuthology.orchestra.run.smithi045.stdout: -1075> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000517 [2,head] /dc-dir/dc-file_802 auth v5606 s=3 n(v0 rc2023-10-03T19:17:55.660293+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94744c00] 2023-10-03T19:21:25.463 INFO:teuthology.orchestra.run.smithi045.stdout: -1074> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000517) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.464 INFO:teuthology.orchestra.run.smithi045.stdout: -1073> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000518 [2,head] /dc-dir/dc-file_803 auth v5608 s=3 n(v0 rc2023-10-03T19:17:55.673102+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94745180] 2023-10-03T19:21:25.464 INFO:teuthology.orchestra.run.smithi045.stdout: -1072> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000518) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.464 INFO:teuthology.orchestra.run.smithi045.stdout: -1071> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000519 [2,head] /dc-dir/dc-file_804 auth v5610 s=3 n(v0 rc2023-10-03T19:17:55.685420+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94745700] 2023-10-03T19:21:25.464 INFO:teuthology.orchestra.run.smithi045.stdout: -1070> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000519) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.464 INFO:teuthology.orchestra.run.smithi045.stdout: -1069> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000051a [2,head] /dc-dir/dc-file_805 auth v5612 s=3 n(v0 rc2023-10-03T19:17:55.698950+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9468c000] 2023-10-03T19:21:25.464 INFO:teuthology.orchestra.run.smithi045.stdout: -1068> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000051a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.464 INFO:teuthology.orchestra.run.smithi045.stdout: -1067> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000051b [2,head] /dc-dir/dc-file_806 auth v5614 s=3 n(v0 rc2023-10-03T19:17:55.711083+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9468c580] 2023-10-03T19:21:25.464 INFO:teuthology.orchestra.run.smithi045.stdout: -1066> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000051b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.464 INFO:teuthology.orchestra.run.smithi045.stdout: -1065> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000051c [2,head] /dc-dir/dc-file_807 auth v5616 s=3 n(v0 rc2023-10-03T19:17:55.723345+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9468cb00] 2023-10-03T19:21:25.464 INFO:teuthology.orchestra.run.smithi045.stdout: -1064> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000051c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.464 INFO:teuthology.orchestra.run.smithi045.stdout: -1063> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000051d [2,head] /dc-dir/dc-file_808 auth v5618 s=3 n(v0 rc2023-10-03T19:17:55.735428+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9468d080] 2023-10-03T19:21:25.465 INFO:teuthology.orchestra.run.smithi045.stdout: -1062> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000051d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.465 INFO:teuthology.orchestra.run.smithi045.stdout: -1061> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000051e [2,head] /dc-dir/dc-file_809 auth v5620 s=3 n(v0 rc2023-10-03T19:17:55.747323+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9468d600] 2023-10-03T19:21:25.465 INFO:teuthology.orchestra.run.smithi045.stdout: -1060> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000051e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.465 INFO:teuthology.orchestra.run.smithi045.stdout: -1059> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000051f [2,head] /dc-dir/dc-file_810 auth v5622 s=3 n(v0 rc2023-10-03T19:17:55.759618+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9468db80] 2023-10-03T19:21:25.465 INFO:teuthology.orchestra.run.smithi045.stdout: -1058> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000051f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.465 INFO:teuthology.orchestra.run.smithi045.stdout: -1057> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000520 [2,head] /dc-dir/dc-file_811 auth v5624 s=3 n(v0 rc2023-10-03T19:17:55.771972+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9468e100] 2023-10-03T19:21:25.465 INFO:teuthology.orchestra.run.smithi045.stdout: -1056> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000520) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.465 INFO:teuthology.orchestra.run.smithi045.stdout: -1055> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000521 [2,head] /dc-dir/dc-file_812 auth v5626 s=3 n(v0 rc2023-10-03T19:17:55.784179+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9468e680] 2023-10-03T19:21:25.465 INFO:teuthology.orchestra.run.smithi045.stdout: -1054> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000521) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.465 INFO:teuthology.orchestra.run.smithi045.stdout: -1053> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000522 [2,head] /dc-dir/dc-file_813 auth v5628 s=3 n(v0 rc2023-10-03T19:17:55.797114+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9468ec00] 2023-10-03T19:21:25.465 INFO:teuthology.orchestra.run.smithi045.stdout: -1052> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000522) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.466 INFO:teuthology.orchestra.run.smithi045.stdout: -1051> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000523 [2,head] /dc-dir/dc-file_814 auth v5630 s=3 n(v0 rc2023-10-03T19:17:55.809388+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9468f180] 2023-10-03T19:21:25.466 INFO:teuthology.orchestra.run.smithi045.stdout: -1050> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000523) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.466 INFO:teuthology.orchestra.run.smithi045.stdout: -1049> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000524 [2,head] /dc-dir/dc-file_815 auth v5632 s=3 n(v0 rc2023-10-03T19:17:55.822112+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9468f700] 2023-10-03T19:21:25.466 INFO:teuthology.orchestra.run.smithi045.stdout: -1048> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000524) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.466 INFO:teuthology.orchestra.run.smithi045.stdout: -1047> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000525 [2,head] /dc-dir/dc-file_816 auth v5634 s=3 n(v0 rc2023-10-03T19:17:55.834647+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94692000] 2023-10-03T19:21:25.466 INFO:teuthology.orchestra.run.smithi045.stdout: -1046> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000525) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.466 INFO:teuthology.orchestra.run.smithi045.stdout: -1045> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000526 [2,head] /dc-dir/dc-file_817 auth v5636 s=3 n(v0 rc2023-10-03T19:17:55.847698+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94692580] 2023-10-03T19:21:25.466 INFO:teuthology.orchestra.run.smithi045.stdout: -1044> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000526) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.466 INFO:teuthology.orchestra.run.smithi045.stdout: -1043> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000527 [2,head] /dc-dir/dc-file_818 auth v5638 s=3 n(v0 rc2023-10-03T19:17:55.859836+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94692b00] 2023-10-03T19:21:25.466 INFO:teuthology.orchestra.run.smithi045.stdout: -1042> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000527) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.466 INFO:teuthology.orchestra.run.smithi045.stdout: -1041> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000528 [2,head] /dc-dir/dc-file_819 auth v5640 s=3 n(v0 rc2023-10-03T19:17:55.871619+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94693080] 2023-10-03T19:21:25.467 INFO:teuthology.orchestra.run.smithi045.stdout: -1040> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000528) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.467 INFO:teuthology.orchestra.run.smithi045.stdout: -1039> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000529 [2,head] /dc-dir/dc-file_820 auth v5642 s=3 n(v0 rc2023-10-03T19:17:55.884127+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94693600] 2023-10-03T19:21:25.467 INFO:teuthology.orchestra.run.smithi045.stdout: -1038> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000529) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.467 INFO:teuthology.orchestra.run.smithi045.stdout: -1037> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000052a [2,head] /dc-dir/dc-file_821 auth v5644 s=3 n(v0 rc2023-10-03T19:17:55.897318+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94693b80] 2023-10-03T19:21:25.467 INFO:teuthology.orchestra.run.smithi045.stdout: -1036> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000052a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.467 INFO:teuthology.orchestra.run.smithi045.stdout: -1035> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000052b [2,head] /dc-dir/dc-file_822 auth v5646 s=3 n(v0 rc2023-10-03T19:17:55.909595+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94694100] 2023-10-03T19:21:25.467 INFO:teuthology.orchestra.run.smithi045.stdout: -1034> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000052b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.467 INFO:teuthology.orchestra.run.smithi045.stdout: -1033> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000052c [2,head] /dc-dir/dc-file_823 auth v5648 s=3 n(v0 rc2023-10-03T19:17:55.923564+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94694680] 2023-10-03T19:21:25.467 INFO:teuthology.orchestra.run.smithi045.stdout: -1032> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000052c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.467 INFO:teuthology.orchestra.run.smithi045.stdout: -1031> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000052d [2,head] /dc-dir/dc-file_824 auth v5650 s=3 n(v0 rc2023-10-03T19:17:55.936393+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94694c00] 2023-10-03T19:21:25.467 INFO:teuthology.orchestra.run.smithi045.stdout: -1030> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000052d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.468 INFO:teuthology.orchestra.run.smithi045.stdout: -1029> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000052e [2,head] /dc-dir/dc-file_825 auth v5652 s=3 n(v0 rc2023-10-03T19:17:55.949585+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94695180] 2023-10-03T19:21:25.468 INFO:teuthology.orchestra.run.smithi045.stdout: -1028> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000052e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.468 INFO:teuthology.orchestra.run.smithi045.stdout: -1027> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000052f [2,head] /dc-dir/dc-file_826 auth v5654 s=3 n(v0 rc2023-10-03T19:17:55.962272+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94695700] 2023-10-03T19:21:25.468 INFO:teuthology.orchestra.run.smithi045.stdout: -1026> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000052f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.468 INFO:teuthology.orchestra.run.smithi045.stdout: -1025> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000530 [2,head] /dc-dir/dc-file_827 auth v5656 s=3 n(v0 rc2023-10-03T19:17:55.975092+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9469c000] 2023-10-03T19:21:25.468 INFO:teuthology.orchestra.run.smithi045.stdout: -1024> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000530) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.468 INFO:teuthology.orchestra.run.smithi045.stdout: -1023> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000531 [2,head] /dc-dir/dc-file_828 auth v5658 s=3 n(v0 rc2023-10-03T19:17:55.988309+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9469c580] 2023-10-03T19:21:25.468 INFO:teuthology.orchestra.run.smithi045.stdout: -1022> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000531) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.468 INFO:teuthology.orchestra.run.smithi045.stdout: -1021> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000532 [2,head] /dc-dir/dc-file_829 auth v5660 s=3 n(v0 rc2023-10-03T19:17:56.000219+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9469cb00] 2023-10-03T19:21:25.468 INFO:teuthology.orchestra.run.smithi045.stdout: -1020> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000532) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.468 INFO:teuthology.orchestra.run.smithi045.stdout: -1019> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000533 [2,head] /dc-dir/dc-file_830 auth v5662 s=3 n(v0 rc2023-10-03T19:17:56.013296+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9469d080] 2023-10-03T19:21:25.469 INFO:teuthology.orchestra.run.smithi045.stdout: -1018> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000533) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.469 INFO:teuthology.orchestra.run.smithi045.stdout: -1017> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000534 [2,head] /dc-dir/dc-file_831 auth v5664 s=3 n(v0 rc2023-10-03T19:17:56.027269+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9469d600] 2023-10-03T19:21:25.469 INFO:teuthology.orchestra.run.smithi045.stdout: -1016> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000534) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.469 INFO:teuthology.orchestra.run.smithi045.stdout: -1015> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000535 [2,head] /dc-dir/dc-file_832 auth v5666 s=3 n(v0 rc2023-10-03T19:17:56.040839+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9469db80] 2023-10-03T19:21:25.469 INFO:teuthology.orchestra.run.smithi045.stdout: -1014> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000535) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.469 INFO:teuthology.orchestra.run.smithi045.stdout: -1013> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000536 [2,head] /dc-dir/dc-file_833 auth v5668 s=3 n(v0 rc2023-10-03T19:17:56.054604+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9469e100] 2023-10-03T19:21:25.469 INFO:teuthology.orchestra.run.smithi045.stdout: -1012> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000536) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.469 INFO:teuthology.orchestra.run.smithi045.stdout: -1011> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000537 [2,head] /dc-dir/dc-file_834 auth v5670 s=3 n(v0 rc2023-10-03T19:17:56.067841+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9469e680] 2023-10-03T19:21:25.469 INFO:teuthology.orchestra.run.smithi045.stdout: -1010> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000537) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.469 INFO:teuthology.orchestra.run.smithi045.stdout: -1009> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000538 [2,head] /dc-dir/dc-file_835 auth v5672 s=3 n(v0 rc2023-10-03T19:17:56.079693+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9469ec00] 2023-10-03T19:21:25.469 INFO:teuthology.orchestra.run.smithi045.stdout: -1008> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000538) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.470 INFO:teuthology.orchestra.run.smithi045.stdout: -1007> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000539 [2,head] /dc-dir/dc-file_836 auth v5674 s=3 n(v0 rc2023-10-03T19:17:56.092371+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9469f180] 2023-10-03T19:21:25.470 INFO:teuthology.orchestra.run.smithi045.stdout: -1006> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000539) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.470 INFO:teuthology.orchestra.run.smithi045.stdout: -1005> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000053a [2,head] /dc-dir/dc-file_837 auth v5676 s=3 n(v0 rc2023-10-03T19:17:56.178132+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9469f700] 2023-10-03T19:21:25.470 INFO:teuthology.orchestra.run.smithi045.stdout: -1004> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000053a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.470 INFO:teuthology.orchestra.run.smithi045.stdout: -1003> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000053b [2,head] /dc-dir/dc-file_838 auth v5678 s=3 n(v0 rc2023-10-03T19:17:56.220090+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946ae000] 2023-10-03T19:21:25.470 INFO:teuthology.orchestra.run.smithi045.stdout: -1002> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000053b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.470 INFO:teuthology.orchestra.run.smithi045.stdout: -1001> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000053c [2,head] /dc-dir/dc-file_839 auth v5680 s=3 n(v0 rc2023-10-03T19:17:56.233672+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946ae580] 2023-10-03T19:21:25.470 INFO:teuthology.orchestra.run.smithi045.stdout: -1000> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000053c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.470 INFO:teuthology.orchestra.run.smithi045.stdout: -999> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000053d [2,head] /dc-dir/dc-file_840 auth v5682 s=3 n(v0 rc2023-10-03T19:17:56.245482+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946aeb00] 2023-10-03T19:21:25.470 INFO:teuthology.orchestra.run.smithi045.stdout: -998> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000053d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.470 INFO:teuthology.orchestra.run.smithi045.stdout: -997> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000053e [2,head] /dc-dir/dc-file_841 auth v5684 s=3 n(v0 rc2023-10-03T19:17:56.256120+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946af080] 2023-10-03T19:21:25.471 INFO:teuthology.orchestra.run.smithi045.stdout: -996> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000053e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.471 INFO:teuthology.orchestra.run.smithi045.stdout: -995> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000053f [2,head] /dc-dir/dc-file_842 auth v5686 s=3 n(v0 rc2023-10-03T19:17:56.267334+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946af600] 2023-10-03T19:21:25.471 INFO:teuthology.orchestra.run.smithi045.stdout: -994> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000053f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.471 INFO:teuthology.orchestra.run.smithi045.stdout: -993> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000540 [2,head] /dc-dir/dc-file_843 auth v5688 s=3 n(v0 rc2023-10-03T19:17:56.278182+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946afb80] 2023-10-03T19:21:25.471 INFO:teuthology.orchestra.run.smithi045.stdout: -992> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000540) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.471 INFO:teuthology.orchestra.run.smithi045.stdout: -991> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000541 [2,head] /dc-dir/dc-file_844 auth v5690 s=3 n(v0 rc2023-10-03T19:17:56.290367+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946b0100] 2023-10-03T19:21:25.471 INFO:teuthology.orchestra.run.smithi045.stdout: -990> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000541) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.471 INFO:teuthology.orchestra.run.smithi045.stdout: -989> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000542 [2,head] /dc-dir/dc-file_845 auth v5692 s=3 n(v0 rc2023-10-03T19:17:56.301930+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946b0680] 2023-10-03T19:21:25.471 INFO:teuthology.orchestra.run.smithi045.stdout: -988> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000542) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.471 INFO:teuthology.orchestra.run.smithi045.stdout: -987> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000543 [2,head] /dc-dir/dc-file_846 auth v5694 s=3 n(v0 rc2023-10-03T19:17:56.313806+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946b0c00] 2023-10-03T19:21:25.471 INFO:teuthology.orchestra.run.smithi045.stdout: -986> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000543) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.471 INFO:teuthology.orchestra.run.smithi045.stdout: -985> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000544 [2,head] /dc-dir/dc-file_847 auth v5696 s=3 n(v0 rc2023-10-03T19:17:56.325401+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946b1180] 2023-10-03T19:21:25.472 INFO:teuthology.orchestra.run.smithi045.stdout: -984> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000544) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.472 INFO:teuthology.orchestra.run.smithi045.stdout: -983> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000545 [2,head] /dc-dir/dc-file_848 auth v5698 s=3 n(v0 rc2023-10-03T19:17:56.337271+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946b1700] 2023-10-03T19:21:25.472 INFO:teuthology.orchestra.run.smithi045.stdout: -982> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000545) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.472 INFO:teuthology.orchestra.run.smithi045.stdout: -981> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000546 [2,head] /dc-dir/dc-file_849 auth v5700 s=3 n(v0 rc2023-10-03T19:17:56.348661+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946b8000] 2023-10-03T19:21:25.472 INFO:teuthology.orchestra.run.smithi045.stdout: -980> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000546) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.472 INFO:teuthology.orchestra.run.smithi045.stdout: -979> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000547 [2,head] /dc-dir/dc-file_850 auth v5702 s=3 n(v0 rc2023-10-03T19:17:56.360083+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946b8580] 2023-10-03T19:21:25.472 INFO:teuthology.orchestra.run.smithi045.stdout: -978> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000547) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.472 INFO:teuthology.orchestra.run.smithi045.stdout: -977> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000548 [2,head] /dc-dir/dc-file_851 auth v5704 s=3 n(v0 rc2023-10-03T19:17:56.371799+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946b8b00] 2023-10-03T19:21:25.472 INFO:teuthology.orchestra.run.smithi045.stdout: -976> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000548) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.472 INFO:teuthology.orchestra.run.smithi045.stdout: -975> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000549 [2,head] /dc-dir/dc-file_852 auth v5706 s=3 n(v0 rc2023-10-03T19:17:56.383562+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946b9080] 2023-10-03T19:21:25.473 INFO:teuthology.orchestra.run.smithi045.stdout: -974> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000549) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.473 INFO:teuthology.orchestra.run.smithi045.stdout: -973> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000054a [2,head] /dc-dir/dc-file_853 auth v5708 s=3 n(v0 rc2023-10-03T19:17:56.395661+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946b9600] 2023-10-03T19:21:25.473 INFO:teuthology.orchestra.run.smithi045.stdout: -972> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000054a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.473 INFO:teuthology.orchestra.run.smithi045.stdout: -971> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000054b [2,head] /dc-dir/dc-file_854 auth v5710 s=3 n(v0 rc2023-10-03T19:17:56.407078+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946b9b80] 2023-10-03T19:21:25.473 INFO:teuthology.orchestra.run.smithi045.stdout: -970> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000054b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.473 INFO:teuthology.orchestra.run.smithi045.stdout: -969> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000054c [2,head] /dc-dir/dc-file_855 auth v5712 s=3 n(v0 rc2023-10-03T19:17:56.419140+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946ba100] 2023-10-03T19:21:25.473 INFO:teuthology.orchestra.run.smithi045.stdout: -968> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000054c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.473 INFO:teuthology.orchestra.run.smithi045.stdout: -967> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000054d [2,head] /dc-dir/dc-file_856 auth v5714 s=3 n(v0 rc2023-10-03T19:17:56.432283+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946ba680] 2023-10-03T19:21:25.473 INFO:teuthology.orchestra.run.smithi045.stdout: -966> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000054d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.473 INFO:teuthology.orchestra.run.smithi045.stdout: -965> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000054e [2,head] /dc-dir/dc-file_857 auth v5716 s=3 n(v0 rc2023-10-03T19:17:56.445869+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946bac00] 2023-10-03T19:21:25.473 INFO:teuthology.orchestra.run.smithi045.stdout: -964> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000054e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.473 INFO:teuthology.orchestra.run.smithi045.stdout: -963> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000054f [2,head] /dc-dir/dc-file_858 auth v5718 s=3 n(v0 rc2023-10-03T19:17:56.459222+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946bb180] 2023-10-03T19:21:25.474 INFO:teuthology.orchestra.run.smithi045.stdout: -962> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000054f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.474 INFO:teuthology.orchestra.run.smithi045.stdout: -961> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000550 [2,head] /dc-dir/dc-file_859 auth v5720 s=3 n(v0 rc2023-10-03T19:17:56.471423+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946bb700] 2023-10-03T19:21:25.474 INFO:teuthology.orchestra.run.smithi045.stdout: -960> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000550) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.474 INFO:teuthology.orchestra.run.smithi045.stdout: -959> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000551 [2,head] /dc-dir/dc-file_860 auth v5722 s=3 n(v0 rc2023-10-03T19:17:56.484402+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946c2000] 2023-10-03T19:21:25.474 INFO:teuthology.orchestra.run.smithi045.stdout: -958> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000551) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.474 INFO:teuthology.orchestra.run.smithi045.stdout: -957> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000552 [2,head] /dc-dir/dc-file_861 auth v5724 s=3 n(v0 rc2023-10-03T19:17:56.495928+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946c2580] 2023-10-03T19:21:25.474 INFO:teuthology.orchestra.run.smithi045.stdout: -956> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000552) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.474 INFO:teuthology.orchestra.run.smithi045.stdout: -955> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000553 [2,head] /dc-dir/dc-file_862 auth v5726 s=3 n(v0 rc2023-10-03T19:17:56.508230+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946c2b00] 2023-10-03T19:21:25.474 INFO:teuthology.orchestra.run.smithi045.stdout: -954> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000553) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.474 INFO:teuthology.orchestra.run.smithi045.stdout: -953> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000554 [2,head] /dc-dir/dc-file_863 auth v5728 s=3 n(v0 rc2023-10-03T19:17:56.520493+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946c3080] 2023-10-03T19:21:25.475 INFO:teuthology.orchestra.run.smithi045.stdout: -952> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000554) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.475 INFO:teuthology.orchestra.run.smithi045.stdout: -951> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000555 [2,head] /dc-dir/dc-file_864 auth v5730 s=3 n(v0 rc2023-10-03T19:17:56.532364+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946c3600] 2023-10-03T19:21:25.475 INFO:teuthology.orchestra.run.smithi045.stdout: -950> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000555) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.475 INFO:teuthology.orchestra.run.smithi045.stdout: -949> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000556 [2,head] /dc-dir/dc-file_865 auth v5732 s=3 n(v0 rc2023-10-03T19:17:56.543731+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946c3b80] 2023-10-03T19:21:25.475 INFO:teuthology.orchestra.run.smithi045.stdout: -948> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000556) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.475 INFO:teuthology.orchestra.run.smithi045.stdout: -947> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000557 [2,head] /dc-dir/dc-file_866 auth v5734 s=3 n(v0 rc2023-10-03T19:17:56.557015+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946c4100] 2023-10-03T19:21:25.475 INFO:teuthology.orchestra.run.smithi045.stdout: -946> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000557) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.614 INFO:teuthology.orchestra.run.smithi045.stdout: -945> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000558 [2,head] /dc-dir/dc-file_867 auth v5736 s=3 n(v0 rc2023-10-03T19:17:56.570701+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946c4680] 2023-10-03T19:21:25.614 INFO:teuthology.orchestra.run.smithi045.stdout: -944> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000558) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.614 INFO:teuthology.orchestra.run.smithi045.stdout: -943> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000559 [2,head] /dc-dir/dc-file_868 auth v5738 s=3 n(v0 rc2023-10-03T19:17:56.583174+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946c4c00] 2023-10-03T19:21:25.614 INFO:teuthology.orchestra.run.smithi045.stdout: -942> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000559) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.614 INFO:teuthology.orchestra.run.smithi045.stdout: -941> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000055a [2,head] /dc-dir/dc-file_869 auth v5740 s=3 n(v0 rc2023-10-03T19:17:56.595618+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946c5180] 2023-10-03T19:21:25.614 INFO:teuthology.orchestra.run.smithi045.stdout: -940> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000055a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.614 INFO:teuthology.orchestra.run.smithi045.stdout: -939> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000055b [2,head] /dc-dir/dc-file_870 auth v5742 s=3 n(v0 rc2023-10-03T19:17:56.607302+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946c5700] 2023-10-03T19:21:25.614 INFO:teuthology.orchestra.run.smithi045.stdout: -938> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000055b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.614 INFO:teuthology.orchestra.run.smithi045.stdout: -937> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000055c [2,head] /dc-dir/dc-file_871 auth v5744 s=3 n(v0 rc2023-10-03T19:17:56.619119+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946ca000] 2023-10-03T19:21:25.614 INFO:teuthology.orchestra.run.smithi045.stdout: -936> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000055c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.615 INFO:teuthology.orchestra.run.smithi045.stdout: -935> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000055d [2,head] /dc-dir/dc-file_872 auth v5746 s=3 n(v0 rc2023-10-03T19:17:56.630962+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946ca580] 2023-10-03T19:21:25.615 INFO:teuthology.orchestra.run.smithi045.stdout: -934> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000055d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.615 INFO:teuthology.orchestra.run.smithi045.stdout: -933> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000055e [2,head] /dc-dir/dc-file_873 auth v5748 s=3 n(v0 rc2023-10-03T19:17:56.643881+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946cab00] 2023-10-03T19:21:25.615 INFO:teuthology.orchestra.run.smithi045.stdout: -932> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000055e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.615 INFO:teuthology.orchestra.run.smithi045.stdout: -931> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000055f [2,head] /dc-dir/dc-file_874 auth v5750 s=3 n(v0 rc2023-10-03T19:17:56.655754+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946cb080] 2023-10-03T19:21:25.615 INFO:teuthology.orchestra.run.smithi045.stdout: -930> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000055f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.615 INFO:teuthology.orchestra.run.smithi045.stdout: -929> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000560 [2,head] /dc-dir/dc-file_875 auth v5752 s=3 n(v0 rc2023-10-03T19:17:56.667368+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946cb600] 2023-10-03T19:21:25.615 INFO:teuthology.orchestra.run.smithi045.stdout: -928> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000560) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.615 INFO:teuthology.orchestra.run.smithi045.stdout: -927> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000561 [2,head] /dc-dir/dc-file_876 auth v5754 s=3 n(v0 rc2023-10-03T19:17:56.679877+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946cbb80] 2023-10-03T19:21:25.616 INFO:teuthology.orchestra.run.smithi045.stdout: -926> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000561) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.616 INFO:teuthology.orchestra.run.smithi045.stdout: -925> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000562 [2,head] /dc-dir/dc-file_877 auth v5756 s=3 n(v0 rc2023-10-03T19:17:56.692441+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946cc100] 2023-10-03T19:21:25.616 INFO:teuthology.orchestra.run.smithi045.stdout: -924> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000562) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.616 INFO:teuthology.orchestra.run.smithi045.stdout: -923> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000563 [2,head] /dc-dir/dc-file_878 auth v5758 s=3 n(v0 rc2023-10-03T19:17:56.706166+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946cc680] 2023-10-03T19:21:25.616 INFO:teuthology.orchestra.run.smithi045.stdout: -922> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000563) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.616 INFO:teuthology.orchestra.run.smithi045.stdout: -921> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000564 [2,head] /dc-dir/dc-file_879 auth v5760 s=3 n(v0 rc2023-10-03T19:17:56.717695+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946ccc00] 2023-10-03T19:21:25.616 INFO:teuthology.orchestra.run.smithi045.stdout: -920> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000564) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.616 INFO:teuthology.orchestra.run.smithi045.stdout: -919> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000565 [2,head] /dc-dir/dc-file_880 auth v5762 s=3 n(v0 rc2023-10-03T19:17:56.729649+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946cd180] 2023-10-03T19:21:25.616 INFO:teuthology.orchestra.run.smithi045.stdout: -918> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000565) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.616 INFO:teuthology.orchestra.run.smithi045.stdout: -917> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000566 [2,head] /dc-dir/dc-file_881 auth v5764 s=3 n(v0 rc2023-10-03T19:17:56.742340+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946cd700] 2023-10-03T19:21:25.616 INFO:teuthology.orchestra.run.smithi045.stdout: -916> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000566) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.617 INFO:teuthology.orchestra.run.smithi045.stdout: -915> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000567 [2,head] /dc-dir/dc-file_882 auth v5766 s=3 n(v0 rc2023-10-03T19:17:56.754571+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946d2000] 2023-10-03T19:21:25.617 INFO:teuthology.orchestra.run.smithi045.stdout: -914> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000567) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.617 INFO:teuthology.orchestra.run.smithi045.stdout: -913> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000568 [2,head] /dc-dir/dc-file_883 auth v5768 s=3 n(v0 rc2023-10-03T19:17:56.766560+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946d2580] 2023-10-03T19:21:25.617 INFO:teuthology.orchestra.run.smithi045.stdout: -912> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000568) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.617 INFO:teuthology.orchestra.run.smithi045.stdout: -911> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000569 [2,head] /dc-dir/dc-file_884 auth v5770 s=3 n(v0 rc2023-10-03T19:17:56.778595+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946d2b00] 2023-10-03T19:21:25.617 INFO:teuthology.orchestra.run.smithi045.stdout: -910> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000569) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.617 INFO:teuthology.orchestra.run.smithi045.stdout: -909> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000056a [2,head] /dc-dir/dc-file_885 auth v5772 s=3 n(v0 rc2023-10-03T19:17:56.790907+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946d3080] 2023-10-03T19:21:25.617 INFO:teuthology.orchestra.run.smithi045.stdout: -908> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000056a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.617 INFO:teuthology.orchestra.run.smithi045.stdout: -907> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000056b [2,head] /dc-dir/dc-file_886 auth v5774 s=3 n(v0 rc2023-10-03T19:17:56.803145+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946d3600] 2023-10-03T19:21:25.618 INFO:teuthology.orchestra.run.smithi045.stdout: -906> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000056b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.618 INFO:teuthology.orchestra.run.smithi045.stdout: -905> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000056c [2,head] /dc-dir/dc-file_887 auth v5776 s=3 n(v0 rc2023-10-03T19:17:56.816007+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946d3b80] 2023-10-03T19:21:25.618 INFO:teuthology.orchestra.run.smithi045.stdout: -904> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000056c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.618 INFO:teuthology.orchestra.run.smithi045.stdout: -903> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000056d [2,head] /dc-dir/dc-file_888 auth v5778 s=3 n(v0 rc2023-10-03T19:17:56.829564+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946d4100] 2023-10-03T19:21:25.618 INFO:teuthology.orchestra.run.smithi045.stdout: -902> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000056d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.618 INFO:teuthology.orchestra.run.smithi045.stdout: -901> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000056e [2,head] /dc-dir/dc-file_889 auth v5780 s=3 n(v0 rc2023-10-03T19:17:56.841538+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946d4680] 2023-10-03T19:21:25.618 INFO:teuthology.orchestra.run.smithi045.stdout: -900> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000056e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.618 INFO:teuthology.orchestra.run.smithi045.stdout: -899> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000056f [2,head] /dc-dir/dc-file_890 auth v5782 s=3 n(v0 rc2023-10-03T19:17:56.854602+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946d4c00] 2023-10-03T19:21:25.618 INFO:teuthology.orchestra.run.smithi045.stdout: -898> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000056f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.618 INFO:teuthology.orchestra.run.smithi045.stdout: -897> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000570 [2,head] /dc-dir/dc-file_891 auth v5784 s=3 n(v0 rc2023-10-03T19:17:56.869295+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946d5180] 2023-10-03T19:21:25.619 INFO:teuthology.orchestra.run.smithi045.stdout: -896> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000570) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.619 INFO:teuthology.orchestra.run.smithi045.stdout: -895> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000571 [2,head] /dc-dir/dc-file_892 auth v5786 s=3 n(v0 rc2023-10-03T19:17:56.883169+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946d5700] 2023-10-03T19:21:25.619 INFO:teuthology.orchestra.run.smithi045.stdout: -894> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000571) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.619 INFO:teuthology.orchestra.run.smithi045.stdout: -893> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000572 [2,head] /dc-dir/dc-file_893 auth v5788 s=3 n(v0 rc2023-10-03T19:17:56.897890+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946dc000] 2023-10-03T19:21:25.619 INFO:teuthology.orchestra.run.smithi045.stdout: -892> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000572) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.619 INFO:teuthology.orchestra.run.smithi045.stdout: -891> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000573 [2,head] /dc-dir/dc-file_894 auth v5790 s=3 n(v0 rc2023-10-03T19:17:56.910829+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946dc580] 2023-10-03T19:21:25.619 INFO:teuthology.orchestra.run.smithi045.stdout: -890> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000573) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.619 INFO:teuthology.orchestra.run.smithi045.stdout: -889> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000574 [2,head] /dc-dir/dc-file_895 auth v5792 s=3 n(v0 rc2023-10-03T19:17:56.923001+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946dcb00] 2023-10-03T19:21:25.619 INFO:teuthology.orchestra.run.smithi045.stdout: -888> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000574) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.619 INFO:teuthology.orchestra.run.smithi045.stdout: -887> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000575 [2,head] /dc-dir/dc-file_896 auth v5794 s=3 n(v0 rc2023-10-03T19:17:56.934564+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946dd080] 2023-10-03T19:21:25.619 INFO:teuthology.orchestra.run.smithi045.stdout: -886> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000575) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.620 INFO:teuthology.orchestra.run.smithi045.stdout: -885> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000576 [2,head] /dc-dir/dc-file_897 auth v5796 s=3 n(v0 rc2023-10-03T19:17:56.947371+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946dd600] 2023-10-03T19:21:25.620 INFO:teuthology.orchestra.run.smithi045.stdout: -884> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000576) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.620 INFO:teuthology.orchestra.run.smithi045.stdout: -883> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000577 [2,head] /dc-dir/dc-file_898 auth v5798 s=3 n(v0 rc2023-10-03T19:17:56.958959+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946ddb80] 2023-10-03T19:21:25.620 INFO:teuthology.orchestra.run.smithi045.stdout: -882> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000577) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.620 INFO:teuthology.orchestra.run.smithi045.stdout: -881> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000578 [2,head] /dc-dir/dc-file_899 auth v5800 s=3 n(v0 rc2023-10-03T19:17:56.970758+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946de100] 2023-10-03T19:21:25.620 INFO:teuthology.orchestra.run.smithi045.stdout: -880> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000578) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.620 INFO:teuthology.orchestra.run.smithi045.stdout: -879> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000579 [2,head] /dc-dir/dc-file_900 auth v5802 s=3 n(v0 rc2023-10-03T19:17:56.982312+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946de680] 2023-10-03T19:21:25.620 INFO:teuthology.orchestra.run.smithi045.stdout: -878> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000579) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.620 INFO:teuthology.orchestra.run.smithi045.stdout: -877> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000057a [2,head] /dc-dir/dc-file_901 auth v5804 s=3 n(v0 rc2023-10-03T19:17:56.994266+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946dec00] 2023-10-03T19:21:25.620 INFO:teuthology.orchestra.run.smithi045.stdout: -876> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000057a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.620 INFO:teuthology.orchestra.run.smithi045.stdout: -875> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000057b [2,head] /dc-dir/dc-file_902 auth v5806 s=3 n(v0 rc2023-10-03T19:17:57.005725+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946df180] 2023-10-03T19:21:25.621 INFO:teuthology.orchestra.run.smithi045.stdout: -874> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000057b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.621 INFO:teuthology.orchestra.run.smithi045.stdout: -873> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000057c [2,head] /dc-dir/dc-file_903 auth v5808 s=3 n(v0 rc2023-10-03T19:17:57.017638+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946df700] 2023-10-03T19:21:25.621 INFO:teuthology.orchestra.run.smithi045.stdout: -872> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000057c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.621 INFO:teuthology.orchestra.run.smithi045.stdout: -871> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000057d [2,head] /dc-dir/dc-file_904 auth v5810 s=3 n(v0 rc2023-10-03T19:17:57.029441+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946e4000] 2023-10-03T19:21:25.621 INFO:teuthology.orchestra.run.smithi045.stdout: -870> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000057d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.621 INFO:teuthology.orchestra.run.smithi045.stdout: -869> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000057e [2,head] /dc-dir/dc-file_905 auth v5812 s=3 n(v0 rc2023-10-03T19:17:57.041526+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946e4580] 2023-10-03T19:21:25.621 INFO:teuthology.orchestra.run.smithi045.stdout: -868> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000057e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.621 INFO:teuthology.orchestra.run.smithi045.stdout: -867> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000057f [2,head] /dc-dir/dc-file_906 auth v5814 s=3 n(v0 rc2023-10-03T19:17:57.053715+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946e4b00] 2023-10-03T19:21:25.621 INFO:teuthology.orchestra.run.smithi045.stdout: -866> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000057f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.621 INFO:teuthology.orchestra.run.smithi045.stdout: -865> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000580 [2,head] /dc-dir/dc-file_907 auth v5816 s=3 n(v0 rc2023-10-03T19:17:57.065995+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946e5080] 2023-10-03T19:21:25.622 INFO:teuthology.orchestra.run.smithi045.stdout: -864> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000580) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.622 INFO:teuthology.orchestra.run.smithi045.stdout: -863> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000581 [2,head] /dc-dir/dc-file_908 auth v5818 s=3 n(v0 rc2023-10-03T19:17:57.078197+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946e5600] 2023-10-03T19:21:25.622 INFO:teuthology.orchestra.run.smithi045.stdout: -862> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000581) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.622 INFO:teuthology.orchestra.run.smithi045.stdout: -861> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000582 [2,head] /dc-dir/dc-file_909 auth v5820 s=3 n(v0 rc2023-10-03T19:17:57.089539+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946e5b80] 2023-10-03T19:21:25.622 INFO:teuthology.orchestra.run.smithi045.stdout: -860> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000582) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.622 INFO:teuthology.orchestra.run.smithi045.stdout: -859> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000583 [2,head] /dc-dir/dc-file_910 auth v5822 s=3 n(v0 rc2023-10-03T19:17:57.101860+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946e6100] 2023-10-03T19:21:25.622 INFO:teuthology.orchestra.run.smithi045.stdout: -858> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000583) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.622 INFO:teuthology.orchestra.run.smithi045.stdout: -857> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000584 [2,head] /dc-dir/dc-file_911 auth v5824 s=3 n(v0 rc2023-10-03T19:17:57.191043+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946e6680] 2023-10-03T19:21:25.622 INFO:teuthology.orchestra.run.smithi045.stdout: -856> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000584) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.622 INFO:teuthology.orchestra.run.smithi045.stdout: -855> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000585 [2,head] /dc-dir/dc-file_912 auth v5826 s=3 n(v0 rc2023-10-03T19:17:57.248771+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946e6c00] 2023-10-03T19:21:25.623 INFO:teuthology.orchestra.run.smithi045.stdout: -854> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000585) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.623 INFO:teuthology.orchestra.run.smithi045.stdout: -853> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000586 [2,head] /dc-dir/dc-file_913 auth v5828 s=3 n(v0 rc2023-10-03T19:17:57.261813+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946e7180] 2023-10-03T19:21:25.623 INFO:teuthology.orchestra.run.smithi045.stdout: -852> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000586) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.623 INFO:teuthology.orchestra.run.smithi045.stdout: -851> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000587 [2,head] /dc-dir/dc-file_914 auth v5830 s=3 n(v0 rc2023-10-03T19:17:57.274199+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc946e7700] 2023-10-03T19:21:25.623 INFO:teuthology.orchestra.run.smithi045.stdout: -850> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000587) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.623 INFO:teuthology.orchestra.run.smithi045.stdout: -849> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000588 [2,head] /dc-dir/dc-file_915 auth v5832 s=3 n(v0 rc2023-10-03T19:17:57.285737+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9475c000] 2023-10-03T19:21:25.623 INFO:teuthology.orchestra.run.smithi045.stdout: -848> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000588) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.623 INFO:teuthology.orchestra.run.smithi045.stdout: -847> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000589 [2,head] /dc-dir/dc-file_916 auth v5834 s=3 n(v0 rc2023-10-03T19:17:57.298068+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9475c580] 2023-10-03T19:21:25.623 INFO:teuthology.orchestra.run.smithi045.stdout: -846> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000589) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.623 INFO:teuthology.orchestra.run.smithi045.stdout: -845> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000058a [2,head] /dc-dir/dc-file_917 auth v5836 s=3 n(v0 rc2023-10-03T19:17:57.309902+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9475cb00] 2023-10-03T19:21:25.623 INFO:teuthology.orchestra.run.smithi045.stdout: -844> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000058a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.624 INFO:teuthology.orchestra.run.smithi045.stdout: -843> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000058b [2,head] /dc-dir/dc-file_918 auth v5838 s=3 n(v0 rc2023-10-03T19:17:57.322449+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9475d080] 2023-10-03T19:21:25.624 INFO:teuthology.orchestra.run.smithi045.stdout: -842> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000058b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.624 INFO:teuthology.orchestra.run.smithi045.stdout: -841> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000058c [2,head] /dc-dir/dc-file_919 auth v5840 s=3 n(v0 rc2023-10-03T19:17:57.334165+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9475d600] 2023-10-03T19:21:25.624 INFO:teuthology.orchestra.run.smithi045.stdout: -840> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000058c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.624 INFO:teuthology.orchestra.run.smithi045.stdout: -839> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000058d [2,head] /dc-dir/dc-file_920 auth v5842 s=3 n(v0 rc2023-10-03T19:17:57.345546+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9475db80] 2023-10-03T19:21:25.624 INFO:teuthology.orchestra.run.smithi045.stdout: -838> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000058d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.624 INFO:teuthology.orchestra.run.smithi045.stdout: -837> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000058e [2,head] /dc-dir/dc-file_921 auth v5844 s=3 n(v0 rc2023-10-03T19:17:57.357110+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9475e100] 2023-10-03T19:21:25.624 INFO:teuthology.orchestra.run.smithi045.stdout: -836> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000058e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.624 INFO:teuthology.orchestra.run.smithi045.stdout: -835> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000058f [2,head] /dc-dir/dc-file_922 auth v5846 s=3 n(v0 rc2023-10-03T19:17:57.368611+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9475e680] 2023-10-03T19:21:25.624 INFO:teuthology.orchestra.run.smithi045.stdout: -834> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000058f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.624 INFO:teuthology.orchestra.run.smithi045.stdout: -833> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000590 [2,head] /dc-dir/dc-file_923 auth v5848 s=3 n(v0 rc2023-10-03T19:17:57.379945+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9475ec00] 2023-10-03T19:21:25.625 INFO:teuthology.orchestra.run.smithi045.stdout: -832> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000590) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.625 INFO:teuthology.orchestra.run.smithi045.stdout: -831> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000591 [2,head] /dc-dir/dc-file_924 auth v5850 s=3 n(v0 rc2023-10-03T19:17:57.391684+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9475f180] 2023-10-03T19:21:25.625 INFO:teuthology.orchestra.run.smithi045.stdout: -830> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000591) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.625 INFO:teuthology.orchestra.run.smithi045.stdout: -829> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000592 [2,head] /dc-dir/dc-file_925 auth v5852 s=3 n(v0 rc2023-10-03T19:17:57.404041+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9475f700] 2023-10-03T19:21:25.625 INFO:teuthology.orchestra.run.smithi045.stdout: -828> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000592) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.625 INFO:teuthology.orchestra.run.smithi045.stdout: -827> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000593 [2,head] /dc-dir/dc-file_926 auth v5854 s=3 n(v0 rc2023-10-03T19:17:57.415576+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94762000] 2023-10-03T19:21:25.625 INFO:teuthology.orchestra.run.smithi045.stdout: -826> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000593) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.625 INFO:teuthology.orchestra.run.smithi045.stdout: -825> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000594 [2,head] /dc-dir/dc-file_927 auth v5856 s=3 n(v0 rc2023-10-03T19:17:57.427592+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94762580] 2023-10-03T19:21:25.625 INFO:teuthology.orchestra.run.smithi045.stdout: -824> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000594) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.625 INFO:teuthology.orchestra.run.smithi045.stdout: -823> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000595 [2,head] /dc-dir/dc-file_928 auth v5858 s=3 n(v0 rc2023-10-03T19:17:57.439118+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94762b00] 2023-10-03T19:21:25.625 INFO:teuthology.orchestra.run.smithi045.stdout: -822> 2023-10-03T19:18:12.105+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000595) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.626 INFO:teuthology.orchestra.run.smithi045.stdout: -821> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000596 [2,head] /dc-dir/dc-file_929 auth v5860 s=3 n(v0 rc2023-10-03T19:17:57.450943+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94763080] 2023-10-03T19:21:25.626 INFO:teuthology.orchestra.run.smithi045.stdout: -820> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000596) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.626 INFO:teuthology.orchestra.run.smithi045.stdout: -819> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000597 [2,head] /dc-dir/dc-file_930 auth v5862 s=3 n(v0 rc2023-10-03T19:17:57.462223+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94763600] 2023-10-03T19:21:25.626 INFO:teuthology.orchestra.run.smithi045.stdout: -818> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000597) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.626 INFO:teuthology.orchestra.run.smithi045.stdout: -817> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000598 [2,head] /dc-dir/dc-file_931 auth v5864 s=3 n(v0 rc2023-10-03T19:17:57.474241+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94763b80] 2023-10-03T19:21:25.626 INFO:teuthology.orchestra.run.smithi045.stdout: -816> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000598) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.626 INFO:teuthology.orchestra.run.smithi045.stdout: -815> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x10000000599 [2,head] /dc-dir/dc-file_932 auth v5866 s=3 n(v0 rc2023-10-03T19:17:57.485632+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94764100] 2023-10-03T19:21:25.626 INFO:teuthology.orchestra.run.smithi045.stdout: -814> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x10000000599) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.626 INFO:teuthology.orchestra.run.smithi045.stdout: -813> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000059a [2,head] /dc-dir/dc-file_933 auth v5868 s=3 n(v0 rc2023-10-03T19:17:57.496719+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94764680] 2023-10-03T19:21:25.627 INFO:teuthology.orchestra.run.smithi045.stdout: -812> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000059a) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.627 INFO:teuthology.orchestra.run.smithi045.stdout: -811> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000059b [2,head] /dc-dir/dc-file_934 auth v5870 s=3 n(v0 rc2023-10-03T19:17:57.508220+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94764c00] 2023-10-03T19:21:25.627 INFO:teuthology.orchestra.run.smithi045.stdout: -810> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000059b) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.627 INFO:teuthology.orchestra.run.smithi045.stdout: -809> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000059c [2,head] /dc-dir/dc-file_935 auth v5872 s=3 n(v0 rc2023-10-03T19:17:57.520205+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94765180] 2023-10-03T19:21:25.627 INFO:teuthology.orchestra.run.smithi045.stdout: -808> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000059c) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.627 INFO:teuthology.orchestra.run.smithi045.stdout: -807> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000059d [2,head] /dc-dir/dc-file_936 auth v5874 s=3 n(v0 rc2023-10-03T19:17:57.532245+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94765700] 2023-10-03T19:21:25.627 INFO:teuthology.orchestra.run.smithi045.stdout: -806> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000059d) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.627 INFO:teuthology.orchestra.run.smithi045.stdout: -805> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000059e [2,head] /dc-dir/dc-file_937 auth v5876 s=3 n(v0 rc2023-10-03T19:17:57.544005+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9476c000] 2023-10-03T19:21:25.627 INFO:teuthology.orchestra.run.smithi045.stdout: -804> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000059e) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.627 INFO:teuthology.orchestra.run.smithi045.stdout: -803> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x1000000059f [2,head] /dc-dir/dc-file_938 auth v5878 s=3 n(v0 rc2023-10-03T19:17:57.555799+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9476c580] 2023-10-03T19:21:25.627 INFO:teuthology.orchestra.run.smithi045.stdout: -802> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x1000000059f) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.628 INFO:teuthology.orchestra.run.smithi045.stdout: -801> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a0 [2,head] /dc-dir/dc-file_939 auth v5880 s=3 n(v0 rc2023-10-03T19:17:57.567107+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9476cb00] 2023-10-03T19:21:25.628 INFO:teuthology.orchestra.run.smithi045.stdout: -800> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.628 INFO:teuthology.orchestra.run.smithi045.stdout: -799> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a1 [2,head] /dc-dir/dc-file_940 auth v5882 s=3 n(v0 rc2023-10-03T19:17:57.578640+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9476d080] 2023-10-03T19:21:25.628 INFO:teuthology.orchestra.run.smithi045.stdout: -798> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.628 INFO:teuthology.orchestra.run.smithi045.stdout: -797> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a2 [2,head] /dc-dir/dc-file_941 auth v5884 s=3 n(v0 rc2023-10-03T19:17:57.589765+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9476d600] 2023-10-03T19:21:25.628 INFO:teuthology.orchestra.run.smithi045.stdout: -796> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.628 INFO:teuthology.orchestra.run.smithi045.stdout: -795> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a3 [2,head] /dc-dir/dc-file_942 auth v5886 s=3 n(v0 rc2023-10-03T19:17:57.602121+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9476db80] 2023-10-03T19:21:25.628 INFO:teuthology.orchestra.run.smithi045.stdout: -794> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.628 INFO:teuthology.orchestra.run.smithi045.stdout: -793> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a4 [2,head] /dc-dir/dc-file_943 auth v5888 s=3 n(v0 rc2023-10-03T19:17:57.614834+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9476e100] 2023-10-03T19:21:25.628 INFO:teuthology.orchestra.run.smithi045.stdout: -792> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.628 INFO:teuthology.orchestra.run.smithi045.stdout: -791> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a5 [2,head] /dc-dir/dc-file_944 auth v5890 s=3 n(v0 rc2023-10-03T19:17:57.626490+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9476e680] 2023-10-03T19:21:25.629 INFO:teuthology.orchestra.run.smithi045.stdout: -790> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.629 INFO:teuthology.orchestra.run.smithi045.stdout: -789> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a6 [2,head] /dc-dir/dc-file_945 auth v5892 s=3 n(v0 rc2023-10-03T19:17:57.637656+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9476ec00] 2023-10-03T19:21:25.629 INFO:teuthology.orchestra.run.smithi045.stdout: -788> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.629 INFO:teuthology.orchestra.run.smithi045.stdout: -787> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a7 [2,head] /dc-dir/dc-file_946 auth v5894 s=3 n(v0 rc2023-10-03T19:17:57.648791+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9476f180] 2023-10-03T19:21:25.629 INFO:teuthology.orchestra.run.smithi045.stdout: -786> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.629 INFO:teuthology.orchestra.run.smithi045.stdout: -785> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a8 [2,head] /dc-dir/dc-file_947 auth v5896 s=3 n(v0 rc2023-10-03T19:17:57.661701+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9476f700] 2023-10-03T19:21:25.629 INFO:teuthology.orchestra.run.smithi045.stdout: -784> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.629 INFO:teuthology.orchestra.run.smithi045.stdout: -783> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005a9 [2,head] /dc-dir/dc-file_948 auth v5898 s=3 n(v0 rc2023-10-03T19:17:57.674973+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94774000] 2023-10-03T19:21:25.629 INFO:teuthology.orchestra.run.smithi045.stdout: -782> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005a9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.629 INFO:teuthology.orchestra.run.smithi045.stdout: -781> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005aa [2,head] /dc-dir/dc-file_949 auth v5900 s=3 n(v0 rc2023-10-03T19:17:57.688324+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94774580] 2023-10-03T19:21:25.629 INFO:teuthology.orchestra.run.smithi045.stdout: -780> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005aa) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.630 INFO:teuthology.orchestra.run.smithi045.stdout: -779> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005ab [2,head] /dc-dir/dc-file_950 auth v5902 s=3 n(v0 rc2023-10-03T19:17:57.700334+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94774b00] 2023-10-03T19:21:25.630 INFO:teuthology.orchestra.run.smithi045.stdout: -778> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ab) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.630 INFO:teuthology.orchestra.run.smithi045.stdout: -777> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005ac [2,head] /dc-dir/dc-file_951 auth v5904 s=3 n(v0 rc2023-10-03T19:17:57.712601+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94775080] 2023-10-03T19:21:25.630 INFO:teuthology.orchestra.run.smithi045.stdout: -776> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ac) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.630 INFO:teuthology.orchestra.run.smithi045.stdout: -775> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005ad [2,head] /dc-dir/dc-file_952 auth v5906 s=3 n(v0 rc2023-10-03T19:17:57.724052+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94775600] 2023-10-03T19:21:25.630 INFO:teuthology.orchestra.run.smithi045.stdout: -774> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ad) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.630 INFO:teuthology.orchestra.run.smithi045.stdout: -773> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005ae [2,head] /dc-dir/dc-file_953 auth v5908 s=3 n(v0 rc2023-10-03T19:17:57.735359+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94775b80] 2023-10-03T19:21:25.630 INFO:teuthology.orchestra.run.smithi045.stdout: -772> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ae) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.630 INFO:teuthology.orchestra.run.smithi045.stdout: -771> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005af [2,head] /dc-dir/dc-file_954 auth v5910 s=3 n(v0 rc2023-10-03T19:17:57.746488+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94776100] 2023-10-03T19:21:25.630 INFO:teuthology.orchestra.run.smithi045.stdout: -770> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005af) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.631 INFO:teuthology.orchestra.run.smithi045.stdout: -769> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b0 [2,head] /dc-dir/dc-file_955 auth v5912 s=3 n(v0 rc2023-10-03T19:17:57.758015+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94776680] 2023-10-03T19:21:25.631 INFO:teuthology.orchestra.run.smithi045.stdout: -768> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.631 INFO:teuthology.orchestra.run.smithi045.stdout: -767> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b1 [2,head] /dc-dir/dc-file_956 auth v5914 s=3 n(v0 rc2023-10-03T19:17:57.769545+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94776c00] 2023-10-03T19:21:25.631 INFO:teuthology.orchestra.run.smithi045.stdout: -766> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.631 INFO:teuthology.orchestra.run.smithi045.stdout: -765> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b2 [2,head] /dc-dir/dc-file_957 auth v5916 s=3 n(v0 rc2023-10-03T19:17:57.782633+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94777180] 2023-10-03T19:21:25.631 INFO:teuthology.orchestra.run.smithi045.stdout: -764> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.631 INFO:teuthology.orchestra.run.smithi045.stdout: -763> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b3 [2,head] /dc-dir/dc-file_958 auth v5918 s=3 n(v0 rc2023-10-03T19:17:57.793609+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94777700] 2023-10-03T19:21:25.631 INFO:teuthology.orchestra.run.smithi045.stdout: -762> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.631 INFO:teuthology.orchestra.run.smithi045.stdout: -761> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b4 [2,head] /dc-dir/dc-file_959 auth v5920 s=3 n(v0 rc2023-10-03T19:17:57.804932+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9477c000] 2023-10-03T19:21:25.631 INFO:teuthology.orchestra.run.smithi045.stdout: -760> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.632 INFO:teuthology.orchestra.run.smithi045.stdout: -759> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b5 [2,head] /dc-dir/dc-file_960 auth v5922 s=3 n(v0 rc2023-10-03T19:17:57.818051+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9477c580] 2023-10-03T19:21:25.632 INFO:teuthology.orchestra.run.smithi045.stdout: -758> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.632 INFO:teuthology.orchestra.run.smithi045.stdout: -757> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b6 [2,head] /dc-dir/dc-file_961 auth v5924 s=3 n(v0 rc2023-10-03T19:17:57.830287+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9477cb00] 2023-10-03T19:21:25.632 INFO:teuthology.orchestra.run.smithi045.stdout: -756> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.632 INFO:teuthology.orchestra.run.smithi045.stdout: -755> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b7 [2,head] /dc-dir/dc-file_962 auth v5926 s=3 n(v0 rc2023-10-03T19:17:57.841780+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9477d080] 2023-10-03T19:21:25.632 INFO:teuthology.orchestra.run.smithi045.stdout: -754> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.632 INFO:teuthology.orchestra.run.smithi045.stdout: -753> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b8 [2,head] /dc-dir/dc-file_963 auth v5928 s=3 n(v0 rc2023-10-03T19:17:57.853705+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9477d600] 2023-10-03T19:21:25.632 INFO:teuthology.orchestra.run.smithi045.stdout: -752> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.632 INFO:teuthology.orchestra.run.smithi045.stdout: -751> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005b9 [2,head] /dc-dir/dc-file_964 auth v5930 s=3 n(v0 rc2023-10-03T19:17:57.867216+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9477db80] 2023-10-03T19:21:25.632 INFO:teuthology.orchestra.run.smithi045.stdout: -750> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005b9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.632 INFO:teuthology.orchestra.run.smithi045.stdout: -749> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005ba [2,head] /dc-dir/dc-file_965 auth v5932 s=3 n(v0 rc2023-10-03T19:17:57.878724+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9477e100] 2023-10-03T19:21:25.633 INFO:teuthology.orchestra.run.smithi045.stdout: -748> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ba) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.633 INFO:teuthology.orchestra.run.smithi045.stdout: -747> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005bb [2,head] /dc-dir/dc-file_966 auth v5934 s=3 n(v0 rc2023-10-03T19:17:57.890092+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9477e680] 2023-10-03T19:21:25.633 INFO:teuthology.orchestra.run.smithi045.stdout: -746> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005bb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.633 INFO:teuthology.orchestra.run.smithi045.stdout: -745> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005bc [2,head] /dc-dir/dc-file_967 auth v5936 s=3 n(v0 rc2023-10-03T19:17:57.901617+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9477ec00] 2023-10-03T19:21:25.633 INFO:teuthology.orchestra.run.smithi045.stdout: -744> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005bc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.633 INFO:teuthology.orchestra.run.smithi045.stdout: -743> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005bd [2,head] /dc-dir/dc-file_968 auth v5938 s=3 n(v0 rc2023-10-03T19:17:57.912931+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9477f180] 2023-10-03T19:21:25.633 INFO:teuthology.orchestra.run.smithi045.stdout: -742> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005bd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.633 INFO:teuthology.orchestra.run.smithi045.stdout: -741> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005be [2,head] /dc-dir/dc-file_969 auth v5940 s=3 n(v0 rc2023-10-03T19:17:57.926504+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9477f700] 2023-10-03T19:21:25.633 INFO:teuthology.orchestra.run.smithi045.stdout: -740> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005be) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.633 INFO:teuthology.orchestra.run.smithi045.stdout: -739> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005bf [2,head] /dc-dir/dc-file_970 auth v5942 s=3 n(v0 rc2023-10-03T19:17:57.939798+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94782000] 2023-10-03T19:21:25.633 INFO:teuthology.orchestra.run.smithi045.stdout: -738> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005bf) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.634 INFO:teuthology.orchestra.run.smithi045.stdout: -737> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c0 [2,head] /dc-dir/dc-file_971 auth v5944 s=3 n(v0 rc2023-10-03T19:17:57.953098+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94782580] 2023-10-03T19:21:25.634 INFO:teuthology.orchestra.run.smithi045.stdout: -736> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.634 INFO:teuthology.orchestra.run.smithi045.stdout: -735> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c1 [2,head] /dc-dir/dc-file_972 auth v5946 s=3 n(v0 rc2023-10-03T19:17:57.965102+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94782b00] 2023-10-03T19:21:25.634 INFO:teuthology.orchestra.run.smithi045.stdout: -734> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.634 INFO:teuthology.orchestra.run.smithi045.stdout: -733> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c2 [2,head] /dc-dir/dc-file_973 auth v5948 s=3 n(v0 rc2023-10-03T19:17:57.977951+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94783080] 2023-10-03T19:21:25.634 INFO:teuthology.orchestra.run.smithi045.stdout: -732> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.634 INFO:teuthology.orchestra.run.smithi045.stdout: -731> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c3 [2,head] /dc-dir/dc-file_974 auth v5950 s=3 n(v0 rc2023-10-03T19:17:57.989973+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94783600] 2023-10-03T19:21:25.634 INFO:teuthology.orchestra.run.smithi045.stdout: -730> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.634 INFO:teuthology.orchestra.run.smithi045.stdout: -729> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c4 [2,head] /dc-dir/dc-file_975 auth v5952 s=3 n(v0 rc2023-10-03T19:17:58.002424+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94783b80] 2023-10-03T19:21:25.634 INFO:teuthology.orchestra.run.smithi045.stdout: -728> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.634 INFO:teuthology.orchestra.run.smithi045.stdout: -727> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c5 [2,head] /dc-dir/dc-file_976 auth v5954 s=3 n(v0 rc2023-10-03T19:17:58.014785+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94784100] 2023-10-03T19:21:25.635 INFO:teuthology.orchestra.run.smithi045.stdout: -726> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.635 INFO:teuthology.orchestra.run.smithi045.stdout: -725> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c6 [2,head] /dc-dir/dc-file_977 auth v5956 s=3 n(v0 rc2023-10-03T19:17:58.028977+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94784680] 2023-10-03T19:21:25.635 INFO:teuthology.orchestra.run.smithi045.stdout: -724> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.635 INFO:teuthology.orchestra.run.smithi045.stdout: -723> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c7 [2,head] /dc-dir/dc-file_978 auth v5958 s=3 n(v0 rc2023-10-03T19:17:58.042650+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94784c00] 2023-10-03T19:21:25.635 INFO:teuthology.orchestra.run.smithi045.stdout: -722> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.635 INFO:teuthology.orchestra.run.smithi045.stdout: -721> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c8 [2,head] /dc-dir/dc-file_979 auth v5960 s=3 n(v0 rc2023-10-03T19:17:58.054557+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94785180] 2023-10-03T19:21:25.635 INFO:teuthology.orchestra.run.smithi045.stdout: -720> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.635 INFO:teuthology.orchestra.run.smithi045.stdout: -719> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005c9 [2,head] /dc-dir/dc-file_980 auth v5962 s=3 n(v0 rc2023-10-03T19:17:58.067690+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc94785700] 2023-10-03T19:21:25.635 INFO:teuthology.orchestra.run.smithi045.stdout: -718> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005c9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.635 INFO:teuthology.orchestra.run.smithi045.stdout: -717> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005ca [2,head] /dc-dir/dc-file_981 auth v5964 s=3 n(v0 rc2023-10-03T19:17:58.079990+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9478a000] 2023-10-03T19:21:25.635 INFO:teuthology.orchestra.run.smithi045.stdout: -716> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ca) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.635 INFO:teuthology.orchestra.run.smithi045.stdout: -715> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005cb [2,head] /dc-dir/dc-file_982 auth v5966 s=3 n(v0 rc2023-10-03T19:17:58.092395+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9478a580] 2023-10-03T19:21:25.636 INFO:teuthology.orchestra.run.smithi045.stdout: -714> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005cb) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.636 INFO:teuthology.orchestra.run.smithi045.stdout: -713> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005cc [2,head] /dc-dir/dc-file_983 auth v5968 s=3 n(v0 rc2023-10-03T19:17:58.105240+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9478ab00] 2023-10-03T19:21:25.636 INFO:teuthology.orchestra.run.smithi045.stdout: -712> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005cc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.636 INFO:teuthology.orchestra.run.smithi045.stdout: -711> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005cd [2,head] /dc-dir/dc-file_984 auth v5970 s=3 n(v0 rc2023-10-03T19:17:58.195020+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9478b080] 2023-10-03T19:21:25.636 INFO:teuthology.orchestra.run.smithi045.stdout: -710> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005cd) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.636 INFO:teuthology.orchestra.run.smithi045.stdout: -709> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005ce [2,head] /dc-dir/dc-file_985 auth v5972 s=3 n(v0 rc2023-10-03T19:17:58.236571+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9478b600] 2023-10-03T19:21:25.636 INFO:teuthology.orchestra.run.smithi045.stdout: -708> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005ce) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.636 INFO:teuthology.orchestra.run.smithi045.stdout: -707> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005cf [2,head] /dc-dir/dc-file_986 auth v5974 s=3 n(v0 rc2023-10-03T19:17:58.248205+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9478bb80] 2023-10-03T19:21:25.636 INFO:teuthology.orchestra.run.smithi045.stdout: -706> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005cf) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.637 INFO:teuthology.orchestra.run.smithi045.stdout: -705> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d0 [2,head] /dc-dir/dc-file_987 auth v5976 s=3 n(v0 rc2023-10-03T19:17:58.260102+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9478c100] 2023-10-03T19:21:25.637 INFO:teuthology.orchestra.run.smithi045.stdout: -704> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d0) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.637 INFO:teuthology.orchestra.run.smithi045.stdout: -703> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d1 [2,head] /dc-dir/dc-file_988 auth v5978 s=3 n(v0 rc2023-10-03T19:17:58.272627+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9478c680] 2023-10-03T19:21:25.637 INFO:teuthology.orchestra.run.smithi045.stdout: -702> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.637 INFO:teuthology.orchestra.run.smithi045.stdout: -701> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d2 [2,head] /dc-dir/dc-file_989 auth v5980 s=3 n(v0 rc2023-10-03T19:17:58.286023+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9478cc00] 2023-10-03T19:21:25.637 INFO:teuthology.orchestra.run.smithi045.stdout: -700> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d2) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.637 INFO:teuthology.orchestra.run.smithi045.stdout: -699> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d3 [2,head] /dc-dir/dc-file_990 auth v5982 s=3 n(v0 rc2023-10-03T19:17:58.299168+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9478d180] 2023-10-03T19:21:25.637 INFO:teuthology.orchestra.run.smithi045.stdout: -698> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d3) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.637 INFO:teuthology.orchestra.run.smithi045.stdout: -697> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d4 [2,head] /dc-dir/dc-file_991 auth v5984 s=3 n(v0 rc2023-10-03T19:17:58.312049+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc9478d700] 2023-10-03T19:21:25.637 INFO:teuthology.orchestra.run.smithi045.stdout: -696> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d4) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.637 INFO:teuthology.orchestra.run.smithi045.stdout: -695> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d5 [2,head] /dc-dir/dc-file_992 auth v5986 s=3 n(v0 rc2023-10-03T19:17:58.323818+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc947a0000] 2023-10-03T19:21:25.637 INFO:teuthology.orchestra.run.smithi045.stdout: -694> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d5) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.638 INFO:teuthology.orchestra.run.smithi045.stdout: -693> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d6 [2,head] /dc-dir/dc-file_993 auth v5988 s=3 n(v0 rc2023-10-03T19:17:58.335278+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc947a0580] 2023-10-03T19:21:25.638 INFO:teuthology.orchestra.run.smithi045.stdout: -692> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d6) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.638 INFO:teuthology.orchestra.run.smithi045.stdout: -691> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d7 [2,head] /dc-dir/dc-file_994 auth v5990 s=3 n(v0 rc2023-10-03T19:17:58.347277+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc947a0b00] 2023-10-03T19:21:25.638 INFO:teuthology.orchestra.run.smithi045.stdout: -690> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d7) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.638 INFO:teuthology.orchestra.run.smithi045.stdout: -689> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d8 [2,head] /dc-dir/dc-file_995 auth v5992 s=3 n(v0 rc2023-10-03T19:17:58.358556+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc947a1080] 2023-10-03T19:21:25.638 INFO:teuthology.orchestra.run.smithi045.stdout: -688> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d8) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.638 INFO:teuthology.orchestra.run.smithi045.stdout: -687> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005d9 [2,head] /dc-dir/dc-file_996 auth v5994 s=3 n(v0 rc2023-10-03T19:17:58.369933+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc947a1600] 2023-10-03T19:21:25.638 INFO:teuthology.orchestra.run.smithi045.stdout: -686> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005d9) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.638 INFO:teuthology.orchestra.run.smithi045.stdout: -685> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005da [2,head] /dc-dir/dc-file_997 auth v5996 s=3 n(v0 rc2023-10-03T19:17:58.381346+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc947a1b80] 2023-10-03T19:21:25.638 INFO:teuthology.orchestra.run.smithi045.stdout: -684> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005da) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.639 INFO:teuthology.orchestra.run.smithi045.stdout: -683> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005db [2,head] /dc-dir/dc-file_998 auth v5998 s=3 n(v0 rc2023-10-03T19:17:58.392936+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc947a2100] 2023-10-03T19:21:25.639 INFO:teuthology.orchestra.run.smithi045.stdout: -682> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005db) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.639 INFO:teuthology.orchestra.run.smithi045.stdout: -681> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing capability pAsLsXsFsc on [inode 0x100000005dc [2,head] /dc-dir/dc-file_999 auth v6000 s=3 n(v0 rc2023-10-03T19:17:58.405153+0000 b3 1=1+0) (iversion lock) caps={5929=pAsLsXsFsc/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=0 0x55cc947a2680] 2023-10-03T19:21:25.639 INFO:teuthology.orchestra.run.smithi045.stdout: -680> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.cache.ino(0x100000005dc) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:17:35.501989+0000 change_attr 0 0x55cc932298c0) 2023-10-03T19:21:25.639 INFO:teuthology.orchestra.run.smithi045.stdout: -679> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.openfiles remove_dirfrag [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 ap=1+0 state=1074003968 f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=900+0,ss=0+0 | child=1 dirty=0 authpin=1 0x55cc94052400] 2023-10-03T19:21:25.639 INFO:teuthology.orchestra.run.smithi045.stdout: -678> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.server killing client lease of [dentry #0x1/dc-dir [2,head] auth (dn sync l) (dversion lock) v=6005 ino=0x10000000000 state=1073741824 | request=0 lock=0 inodepin=1 dirty=0 authpin=0 clientlease=1 0x55cc9413c000] 2023-10-03T19:21:25.639 INFO:teuthology.orchestra.run.smithi045.stdout: -677> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 20 mds.0.cache.den(0x1 dc-dir) remove_client_lease client.5929 on (dn sync l) 2023-10-03T19:21:25.639 INFO:teuthology.orchestra.run.smithi045.stdout: -676> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.33 send_message_client client.5929 172.21.15.146:0/3047788495 client_session(close) v5 2023-10-03T19:21:25.639 INFO:teuthology.orchestra.run.smithi045.stdout: -675> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> 172.21.15.146:0/3047788495 -- client_session(close) v5 -- 0x55cc943461c0 con 0x55cc9410e800 2023-10-03T19:21:25.639 INFO:teuthology.orchestra.run.smithi045.stdout: -674> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 remove_session: mds.metrics: session=0x55cc9406b400, client=client.5929 172.21.15.146:0/3047788495 2023-10-03T19:21:25.639 INFO:teuthology.orchestra.run.smithi045.stdout: -673> 2023-10-03T19:18:12.109+0000 7f5aadf1a640 10 mds.0.sessionmap remove_session s=0x55cc9406b400 name=client.5929 2023-10-03T19:21:25.640 INFO:teuthology.orchestra.run.smithi045.stdout: -672> 2023-10-03T19:18:12.109+0000 7f5aaf71d640 7 mds.0.33 mds has 1 queued contexts 2023-10-03T19:21:25.640 INFO:teuthology.orchestra.run.smithi045.stdout: -671> 2023-10-03T19:18:12.109+0000 7f5aaf71d640 10 mds.0.33 finish 0x55cc944dfb80 2023-10-03T19:21:25.640 INFO:teuthology.orchestra.run.smithi045.stdout: -670> 2023-10-03T19:18:12.109+0000 7f5aaf71d640 10 MDSContext::complete: 15C_MDL_DropCache 2023-10-03T19:21:25.640 INFO:teuthology.orchestra.run.smithi045.stdout: -669> 2023-10-03T19:18:12.109+0000 7f5aaf71d640 7 mds.0.locker rdlock_finish on (isnap sync) on [inode 0x1 [...2,head] / auth v24 snaprealm=0x55cc932298c0 f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:17:35.501989+0000 1=0+1) (inest lock) (ipolicy sync r=1) (iversion lock) | dirtyscattered=0 request=0 lock=1 dirfrag=1 caps=0 dirtyparent=0 dirty=0 authpin=0 0x55cc9314e680] 2023-10-03T19:21:25.640 INFO:teuthology.orchestra.run.smithi045.stdout: -668> 2023-10-03T19:18:12.109+0000 7f5aaf71d640 10 mds.0.locker simple_eval (isnap sync) on [inode 0x1 [...2,head] / auth v24 snaprealm=0x55cc932298c0 f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:17:35.501989+0000 1=0+1) (inest lock) (ipolicy sync r=1) (iversion lock) | dirtyscattered=0 request=0 lock=1 dirfrag=1 caps=0 dirtyparent=0 dirty=0 authpin=0 0x55cc9314e680] 2023-10-03T19:21:25.640 INFO:teuthology.orchestra.run.smithi045.stdout: -667> 2023-10-03T19:18:12.109+0000 7f5aaf71d640 7 mds.0.locker rdlock_finish on (ipolicy sync) on [inode 0x1 [...2,head] / auth v24 snaprealm=0x55cc932298c0 f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:17:35.501989+0000 1=0+1) (inest lock) (iversion lock) | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=0 dirtyparent=0 dirty=0 authpin=0 0x55cc9314e680] 2023-10-03T19:21:25.640 INFO:teuthology.orchestra.run.smithi045.stdout: -666> 2023-10-03T19:18:12.109+0000 7f5aaf71d640 10 mds.0.locker simple_eval (ipolicy sync) on [inode 0x1 [...2,head] / auth v24 snaprealm=0x55cc932298c0 f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1002=1000+2)/n(v0 rc2023-10-03T19:17:35.501989+0000 1=0+1) (inest lock) (iversion lock) | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=0 dirtyparent=0 dirty=0 authpin=0 0x55cc9314e680] 2023-10-03T19:21:25.640 INFO:teuthology.orchestra.run.smithi045.stdout: -665> 2023-10-03T19:18:12.109+0000 7f5aaf71d640 7 mds.0.locker rdlock_finish on (iauth sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=4 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cc940bfb80] 2023-10-03T19:21:25.775 INFO:teuthology.orchestra.run.smithi045.stdout: -664> 2023-10-03T19:18:12.109+0000 7f5aaf71d640 10 mds.0.locker simple_eval (iauth sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=4 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cc940bfb80] 2023-10-03T19:21:25.776 INFO:teuthology.orchestra.run.smithi045.stdout: -663> 2023-10-03T19:18:12.109+0000 7f5aaf71d640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl w=1) (iversion lock) | request=0 lock=4 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cc940bfb80] 2023-10-03T19:21:25.776 INFO:teuthology.orchestra.run.smithi045.stdout: -662> 2023-10-03T19:18:12.109+0000 7f5aaf71d640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl) (iversion lock) | request=0 lock=3 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cc940bfb80] 2023-10-03T19:21:25.776 INFO:teuthology.orchestra.run.smithi045.stdout: -661> 2023-10-03T19:18:12.109+0000 7f5aaf71d640 20 mds.0.locker is excl 2023-10-03T19:21:25.776 INFO:teuthology.orchestra.run.smithi045.stdout: -660> 2023-10-03T19:18:12.109+0000 7f5aaf71d640 7 mds.0.locker file_eval loner_issued= other_issued= xlocker_issued= 2023-10-03T19:21:25.776 INFO:teuthology.orchestra.run.smithi045.stdout: -659> 2023-10-03T19:18:12.109+0000 7f5aaf71d640 20 mds.0.locker should lose it 2023-10-03T19:21:25.776 INFO:teuthology.orchestra.run.smithi045.stdout: -658> 2023-10-03T19:18:12.109+0000 7f5aaf71d640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) (isnap sync r=1) (inest lock w=1) (ipolicy sync r=1) (ifile excl) (iversion lock) | request=0 lock=3 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cc940bfb80] 2023-10-03T19:21:25.776 INFO:teuthology.orchestra.run.smithi045.stdout: -657> 2023-10-03T19:18:12.109+0000 7f5aaf71d640 7 mds.0.locker rdlock_finish on (isnap sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) (inest lock w=1) (ipolicy sync r=1) (iversion lock) | request=0 lock=2 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cc940bfb80] 2023-10-03T19:21:25.776 INFO:teuthology.orchestra.run.smithi045.stdout: -656> 2023-10-03T19:18:12.109+0000 7f5aaf71d640 10 mds.0.locker simple_eval (isnap sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) (inest lock w=1) (ipolicy sync r=1) (iversion lock) | request=0 lock=2 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cc940bfb80] 2023-10-03T19:21:25.776 INFO:teuthology.orchestra.run.smithi045.stdout: -655> 2023-10-03T19:18:12.109+0000 7f5aaf71d640 7 mds.0.locker wrlock_finish on (inest lock w=1) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) (inest lock w=1) (ipolicy sync r=1) (iversion lock) | request=0 lock=2 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cc940bfb80] 2023-10-03T19:21:25.777 INFO:teuthology.orchestra.run.smithi045.stdout: -654> 2023-10-03T19:18:12.109+0000 7f5aaf71d640 10 mds.0.locker scatter_eval (inest lock) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) (inest lock) (ipolicy sync r=1) (iversion lock) | request=0 lock=1 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cc940bfb80] 2023-10-03T19:21:25.777 INFO:teuthology.orchestra.run.smithi045.stdout: -653> 2023-10-03T19:18:12.109+0000 7f5aaf71d640 7 mds.0.locker rdlock_finish on (ipolicy sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) (inest lock) (iversion lock) | request=0 lock=0 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cc940bfb80] 2023-10-03T19:21:25.777 INFO:teuthology.orchestra.run.smithi045.stdout: -652> 2023-10-03T19:18:12.109+0000 7f5aaf71d640 10 mds.0.locker simple_eval (ipolicy sync) on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 ap=1 f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) (inest lock) (iversion lock) | request=0 lock=0 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=1 0x55cc940bfb80] 2023-10-03T19:21:25.777 INFO:teuthology.orchestra.run.smithi045.stdout: -651> 2023-10-03T19:18:12.109+0000 7f5aaf71d640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x55cc94134b00 on [inode 0x10000000000 [...2,head] /dc-dir/ auth v6005 f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) (inest lock) (iversion lock) | request=0 lock=0 dirfrag=1 caps=0 dirtyrstat=0 dirtyparent=0 dirty=0 waiter=0 authpin=0 0x55cc940bfb80] now 0 2023-10-03T19:21:25.777 INFO:teuthology.orchestra.run.smithi045.stdout: -650> 2023-10-03T19:18:12.109+0000 7f5aaf71d640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 state=1073741825|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] by 0x55cc94134b00 count now 0/0 2023-10-03T19:21:25.777 INFO:teuthology.orchestra.run.smithi045.stdout: -649> 2023-10-03T19:18:12.109+0000 7f5aaf71d640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x55cc94134b00 on [dir 0x10000000000 /dc-dir/ [2,head] auth v=6001 cv=6001/6001 state=1073741824 f(v0 m2023-10-03T19:17:58.401892+0000 1000=1000+0) n(v0 rc2023-10-03T19:17:58.405153+0000 b2890 1000=1000+0) hs=900+0,ss=0+0 | child=1 dirty=0 authpin=0 0x55cc94052400] count now 0 2023-10-03T19:21:25.777 INFO:teuthology.orchestra.run.smithi045.stdout: -648> 2023-10-03T19:18:12.113+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] >> 172.21.15.146:0/3047788495 conn(0x55cc9410e800 msgr2=0x55cc940c1180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 38 2023-10-03T19:21:25.778 INFO:teuthology.orchestra.run.smithi045.stdout: -647> 2023-10-03T19:18:12.113+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] >> 172.21.15.146:0/3047788495 conn(0x55cc9410e800 msgr2=0x55cc940c1180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-03T19:21:25.778 INFO:teuthology.orchestra.run.smithi045.stdout: -646> 2023-10-03T19:18:12.113+0000 7f5ab6f2c640 1 --2- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] >> 172.21.15.146:0/3047788495 conn(0x55cc9410e800 0x55cc940c1180 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T19:21:25.778 INFO:teuthology.orchestra.run.smithi045.stdout: -645> 2023-10-03T19:18:12.113+0000 7f5ab6f2c640 1 --2- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] >> 172.21.15.146:0/3047788495 conn(0x55cc9410e800 0x55cc940c1180 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:25.778 INFO:teuthology.orchestra.run.smithi045.stdout: -644> 2023-10-03T19:18:12.113+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 306 ==== osd_op_reply(2082 1000000000b.00000000 [delete] v74'47 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.778 INFO:teuthology.orchestra.run.smithi045.stdout: -643> 2023-10-03T19:18:12.113+0000 7f5ab3f26640 5 mds.a ms_handle_reset on 172.21.15.146:0/3047788495 2023-10-03T19:21:25.778 INFO:teuthology.orchestra.run.smithi045.stdout: -642> 2023-10-03T19:18:12.113+0000 7f5ab3f26640 3 mds.a ms_handle_reset closing connection for session client.5929 172.21.15.146:0/3047788495 2023-10-03T19:21:25.778 INFO:teuthology.orchestra.run.smithi045.stdout: -641> 2023-10-03T19:18:12.113+0000 7f5ab3f26640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] >> 172.21.15.146:0/3047788495 conn(0x55cc9410e800 msgr2=0x55cc940c1180 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-10-03T19:21:25.778 INFO:teuthology.orchestra.run.smithi045.stdout: -640> 2023-10-03T19:18:12.113+0000 7f5ab3f26640 1 --2- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] >> 172.21.15.146:0/3047788495 conn(0x55cc9410e800 0x55cc940c1180 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:25.778 INFO:teuthology.orchestra.run.smithi045.stdout: -639> 2023-10-03T19:18:12.117+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 205 ==== osd_op_reply(2078 10000000007.00000000 [delete] v74'37 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.779 INFO:teuthology.orchestra.run.smithi045.stdout: -638> 2023-10-03T19:18:12.117+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 99 ==== osd_op_reply(2073 10000000002.00000000 [delete] v74'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.779 INFO:teuthology.orchestra.run.smithi045.stdout: -637> 2023-10-03T19:18:12.117+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 100 ==== osd_op_reply(2086 1000000000f.00000000 [delete] v74'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.779 INFO:teuthology.orchestra.run.smithi045.stdout: -636> 2023-10-03T19:18:12.117+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 138 ==== osd_op_reply(2079 10000000008.00000000 [delete] v74'43 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.779 INFO:teuthology.orchestra.run.smithi045.stdout: -635> 2023-10-03T19:18:12.117+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 139 ==== osd_op_reply(2109 10000000026.00000000 [delete] v74'39 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.779 INFO:teuthology.orchestra.run.smithi045.stdout: -634> 2023-10-03T19:18:12.117+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 104 ==== osd_op_reply(2089 10000000012.00000000 [delete] v74'33 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.779 INFO:teuthology.orchestra.run.smithi045.stdout: -633> 2023-10-03T19:18:12.117+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 105 ==== osd_op_reply(2110 10000000027.00000000 [delete] v74'34 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.779 INFO:teuthology.orchestra.run.smithi045.stdout: -632> 2023-10-03T19:18:12.117+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 106 ==== osd_op_reply(2077 10000000006.00000000 [delete] v74'25 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.779 INFO:teuthology.orchestra.run.smithi045.stdout: -631> 2023-10-03T19:18:12.117+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 988 ==== osd_op_reply(2075 10000000004.00000000 [delete] v74'33 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.779 INFO:teuthology.orchestra.run.smithi045.stdout: -630> 2023-10-03T19:18:12.117+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 92 ==== osd_op_reply(2080 10000000009.00000000 [delete] v74'23 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.779 INFO:teuthology.orchestra.run.smithi045.stdout: -629> 2023-10-03T19:18:12.117+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 989 ==== osd_op_reply(2084 1000000000d.00000000 [delete] v74'37 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.780 INFO:teuthology.orchestra.run.smithi045.stdout: -628> 2023-10-03T19:18:12.117+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 990 ==== osd_op_reply(2099 1000000001c.00000000 [delete] v74'39 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.780 INFO:teuthology.orchestra.run.smithi045.stdout: -627> 2023-10-03T19:18:12.121+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 991 ==== osd_op_reply(2106 10000000023.00000000 [delete] v74'38 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.780 INFO:teuthology.orchestra.run.smithi045.stdout: -626> 2023-10-03T19:18:12.121+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 148 ==== osd_op_reply(2133 1000000003e.00000000 [delete] v74'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.780 INFO:teuthology.orchestra.run.smithi045.stdout: -625> 2023-10-03T19:18:12.121+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 101 ==== osd_op_reply(2098 1000000001b.00000000 [delete] v74'23 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.780 INFO:teuthology.orchestra.run.smithi045.stdout: -624> 2023-10-03T19:18:12.121+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 107 ==== osd_op_reply(2081 1000000000a.00000000 [delete] v74'41 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.780 INFO:teuthology.orchestra.run.smithi045.stdout: -623> 2023-10-03T19:18:12.121+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 108 ==== osd_op_reply(2083 1000000000c.00000000 [delete] v74'42 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.780 INFO:teuthology.orchestra.run.smithi045.stdout: -622> 2023-10-03T19:18:12.125+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 102 ==== osd_op_reply(2104 10000000021.00000000 [delete] v74'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.780 INFO:teuthology.orchestra.run.smithi045.stdout: -621> 2023-10-03T19:18:12.125+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 103 ==== osd_op_reply(2105 10000000022.00000000 [delete] v74'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.780 INFO:teuthology.orchestra.run.smithi045.stdout: -620> 2023-10-03T19:18:12.129+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 104 ==== osd_op_reply(2117 1000000002e.00000000 [delete] v74'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.780 INFO:teuthology.orchestra.run.smithi045.stdout: -619> 2023-10-03T19:18:12.129+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 140 ==== osd_op_reply(2144 10000000049.00000000 [delete] v74'36 uv35 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.781 INFO:teuthology.orchestra.run.smithi045.stdout: -618> 2023-10-03T19:18:12.129+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 141 ==== osd_op_reply(2430 10000000167.00000000 [delete] v74'37 uv35 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.781 INFO:teuthology.orchestra.run.smithi045.stdout: -617> 2023-10-03T19:18:12.129+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 142 ==== osd_op_reply(2483 1000000019c.00000000 [delete] v74'38 uv35 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.781 INFO:teuthology.orchestra.run.smithi045.stdout: -616> 2023-10-03T19:18:12.129+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 143 ==== osd_op_reply(2499 100000001ac.00000000 [delete] v74'39 uv35 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.781 INFO:teuthology.orchestra.run.smithi045.stdout: -615> 2023-10-03T19:18:12.129+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 149 ==== osd_op_reply(2194 1000000007b.00000000 [delete] v74'27 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.781 INFO:teuthology.orchestra.run.smithi045.stdout: -614> 2023-10-03T19:18:12.129+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 150 ==== osd_op_reply(2087 10000000010.00000000 [delete] v74'37 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.781 INFO:teuthology.orchestra.run.smithi045.stdout: -613> 2023-10-03T19:18:12.129+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 151 ==== osd_op_reply(2166 1000000005f.00000000 [delete] v74'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.781 INFO:teuthology.orchestra.run.smithi045.stdout: -612> 2023-10-03T19:18:12.129+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 152 ==== osd_op_reply(2093 10000000016.00000000 [delete] v74'19 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.781 INFO:teuthology.orchestra.run.smithi045.stdout: -611> 2023-10-03T19:18:12.129+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 153 ==== osd_op_reply(2241 100000000aa.00000000 [delete] v74'38 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.781 INFO:teuthology.orchestra.run.smithi045.stdout: -610> 2023-10-03T19:18:12.129+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 93 ==== osd_op_reply(2108 10000000025.00000000 [delete] v74'29 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.781 INFO:teuthology.orchestra.run.smithi045.stdout: -609> 2023-10-03T19:18:12.129+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 94 ==== osd_op_reply(2114 1000000002b.00000000 [delete] v74'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.781 INFO:teuthology.orchestra.run.smithi045.stdout: -608> 2023-10-03T19:18:12.133+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 95 ==== osd_op_reply(2116 1000000002d.00000000 [delete] v74'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.782 INFO:teuthology.orchestra.run.smithi045.stdout: -607> 2023-10-03T19:18:12.133+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 96 ==== osd_op_reply(2159 10000000058.00000000 [delete] v74'30 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.782 INFO:teuthology.orchestra.run.smithi045.stdout: -606> 2023-10-03T19:18:12.133+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 97 ==== osd_op_reply(2208 10000000089.00000000 [delete] v74'24 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.782 INFO:teuthology.orchestra.run.smithi045.stdout: -605> 2023-10-03T19:18:12.133+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 98 ==== osd_op_reply(2127 10000000038.00000000 [delete] v74'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.782 INFO:teuthology.orchestra.run.smithi045.stdout: -604> 2023-10-03T19:18:12.133+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 99 ==== osd_op_reply(2216 10000000091.00000000 [delete] v74'31 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.782 INFO:teuthology.orchestra.run.smithi045.stdout: -603> 2023-10-03T19:18:12.133+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 100 ==== osd_op_reply(2141 10000000046.00000000 [delete] v74'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.782 INFO:teuthology.orchestra.run.smithi045.stdout: -602> 2023-10-03T19:18:12.133+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 101 ==== osd_op_reply(2234 100000000a3.00000000 [delete] v74'32 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.782 INFO:teuthology.orchestra.run.smithi045.stdout: -601> 2023-10-03T19:18:12.133+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 102 ==== osd_op_reply(2170 10000000063.00000000 [delete] v74'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.782 INFO:teuthology.orchestra.run.smithi045.stdout: -600> 2023-10-03T19:18:12.133+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 103 ==== osd_op_reply(2333 10000000106.00000000 [delete] v74'33 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.782 INFO:teuthology.orchestra.run.smithi045.stdout: -599> 2023-10-03T19:18:12.133+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 104 ==== osd_op_reply(2337 1000000010a.00000000 [delete] v74'34 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.782 INFO:teuthology.orchestra.run.smithi045.stdout: -598> 2023-10-03T19:18:12.133+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 154 ==== osd_op_reply(2124 10000000035.00000000 [delete] v74'20 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.783 INFO:teuthology.orchestra.run.smithi045.stdout: -597> 2023-10-03T19:18:12.133+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 155 ==== osd_op_reply(2173 10000000066.00000000 [delete] v74'21 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.783 INFO:teuthology.orchestra.run.smithi045.stdout: -596> 2023-10-03T19:18:12.133+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 156 ==== osd_op_reply(2191 10000000078.00000000 [delete] v74'22 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.783 INFO:teuthology.orchestra.run.smithi045.stdout: -595> 2023-10-03T19:18:12.133+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 157 ==== osd_op_reply(2281 100000000d2.00000000 [delete] v74'23 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.783 INFO:teuthology.orchestra.run.smithi045.stdout: -594> 2023-10-03T19:18:12.133+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 158 ==== osd_op_reply(2369 1000000012a.00000000 [delete] v74'24 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.783 INFO:teuthology.orchestra.run.smithi045.stdout: -593> 2023-10-03T19:18:12.133+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 206 ==== osd_op_reply(2111 10000000028.00000000 [delete] v74'38 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.783 INFO:teuthology.orchestra.run.smithi045.stdout: -592> 2023-10-03T19:18:12.133+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 109 ==== osd_op_reply(2090 10000000013.00000000 [delete] v74'43 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.783 INFO:teuthology.orchestra.run.smithi045.stdout: -591> 2023-10-03T19:18:12.133+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 110 ==== osd_op_reply(2103 10000000020.00000000 [delete] v74'44 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.783 INFO:teuthology.orchestra.run.smithi045.stdout: -590> 2023-10-03T19:18:12.133+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 307 ==== osd_op_reply(2149 1000000004e.00000000 [delete] v74'48 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.783 INFO:teuthology.orchestra.run.smithi045.stdout: -589> 2023-10-03T19:18:12.133+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 144 ==== osd_op_reply(2507 100000001b4.00000000 [delete] v74'40 uv35 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.783 INFO:teuthology.orchestra.run.smithi045.stdout: -588> 2023-10-03T19:18:12.133+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 308 ==== osd_op_reply(2252 100000000b5.00000000 [delete] v74'49 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.783 INFO:teuthology.orchestra.run.smithi045.stdout: -587> 2023-10-03T19:18:12.133+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 309 ==== osd_op_reply(2284 100000000d5.00000000 [delete] v74'50 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.784 INFO:teuthology.orchestra.run.smithi045.stdout: -586> 2023-10-03T19:18:12.133+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 159 ==== osd_op_reply(2398 10000000147.00000000 [delete] v74'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.784 INFO:teuthology.orchestra.run.smithi045.stdout: -585> 2023-10-03T19:18:12.133+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 145 ==== osd_op_reply(2112 10000000029.00000000 [delete] v74'45 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.784 INFO:teuthology.orchestra.run.smithi045.stdout: -584> 2023-10-03T19:18:12.137+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 111 ==== osd_op_reply(2314 100000000f3.00000000 [delete] v74'35 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.784 INFO:teuthology.orchestra.run.smithi045.stdout: -583> 2023-10-03T19:18:12.137+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 112 ==== osd_op_reply(2097 1000000001a.00000000 [delete] v74'45 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.784 INFO:teuthology.orchestra.run.smithi045.stdout: -582> 2023-10-03T19:18:12.137+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 113 ==== osd_op_reply(2339 1000000010c.00000000 [delete] v74'36 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.784 INFO:teuthology.orchestra.run.smithi045.stdout: -581> 2023-10-03T19:18:12.137+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 114 ==== osd_op_reply(2392 10000000141.00000000 [delete] v74'37 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.784 INFO:teuthology.orchestra.run.smithi045.stdout: -580> 2023-10-03T19:18:12.137+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 160 ==== osd_op_reply(2444 10000000175.00000000 [delete] v74'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.784 INFO:teuthology.orchestra.run.smithi045.stdout: -579> 2023-10-03T19:18:12.137+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 105 ==== osd_op_reply(2113 1000000002a.00000000 [delete] v74'19 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.784 INFO:teuthology.orchestra.run.smithi045.stdout: -578> 2023-10-03T19:18:12.137+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 115 ==== osd_op_reply(2511 100000001b8.00000000 [delete] v74'38 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.784 INFO:teuthology.orchestra.run.smithi045.stdout: -577> 2023-10-03T19:18:12.137+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 116 ==== osd_op_reply(2572 100000001f5.00000000 [delete] v74'39 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.785 INFO:teuthology.orchestra.run.smithi045.stdout: -576> 2023-10-03T19:18:12.137+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 106 ==== osd_op_reply(2130 1000000003b.00000000 [delete] v74'20 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.785 INFO:teuthology.orchestra.run.smithi045.stdout: -575> 2023-10-03T19:18:12.137+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 107 ==== osd_op_reply(2181 1000000006e.00000000 [delete] v74'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.785 INFO:teuthology.orchestra.run.smithi045.stdout: -574> 2023-10-03T19:18:12.137+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 108 ==== osd_op_reply(2211 1000000008c.00000000 [delete] v74'21 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.785 INFO:teuthology.orchestra.run.smithi045.stdout: -573> 2023-10-03T19:18:12.137+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 109 ==== osd_op_reply(2272 100000000c9.00000000 [delete] v74'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.785 INFO:teuthology.orchestra.run.smithi045.stdout: -572> 2023-10-03T19:18:12.137+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 110 ==== osd_op_reply(2277 100000000ce.00000000 [delete] v74'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.785 INFO:teuthology.orchestra.run.smithi045.stdout: -571> 2023-10-03T19:18:12.137+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 111 ==== osd_op_reply(2244 100000000ad.00000000 [delete] v74'22 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.785 INFO:teuthology.orchestra.run.smithi045.stdout: -570> 2023-10-03T19:18:12.137+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 112 ==== osd_op_reply(2400 10000000149.00000000 [delete] v74'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.785 INFO:teuthology.orchestra.run.smithi045.stdout: -569> 2023-10-03T19:18:12.137+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 992 ==== osd_op_reply(2088 10000000011.00000000 [delete] v74'27 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.785 INFO:teuthology.orchestra.run.smithi045.stdout: -568> 2023-10-03T19:18:12.137+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 146 ==== osd_op_reply(2096 10000000019.00000000 [delete] v74'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.785 INFO:teuthology.orchestra.run.smithi045.stdout: -567> 2023-10-03T19:18:12.137+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 105 ==== osd_op_reply(2074 10000000003.00000000 [delete] v74'39 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.785 INFO:teuthology.orchestra.run.smithi045.stdout: -566> 2023-10-03T19:18:12.137+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 106 ==== osd_op_reply(2101 1000000001e.00000000 [delete] v74'40 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.786 INFO:teuthology.orchestra.run.smithi045.stdout: -565> 2023-10-03T19:18:12.137+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 107 ==== osd_op_reply(2102 1000000001f.00000000 [delete] v74'33 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.786 INFO:teuthology.orchestra.run.smithi045.stdout: -564> 2023-10-03T19:18:12.137+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 113 ==== osd_op_reply(2092 10000000015.00000000 [delete] v74'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.786 INFO:teuthology.orchestra.run.smithi045.stdout: -563> 2023-10-03T19:18:12.137+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 114 ==== osd_op_reply(2140 10000000045.00000000 [delete] v74'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.786 INFO:teuthology.orchestra.run.smithi045.stdout: -562> 2023-10-03T19:18:12.137+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 115 ==== osd_op_reply(2148 1000000004d.00000000 [delete] v74'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.786 INFO:teuthology.orchestra.run.smithi045.stdout: -561> 2023-10-03T19:18:12.137+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 161 ==== osd_op_reply(2076 10000000005.00000000 [delete] v74'27 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.786 INFO:teuthology.orchestra.run.smithi045.stdout: -560> 2023-10-03T19:18:12.137+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 162 ==== osd_op_reply(2107 10000000024.00000000 [delete] v74'37 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.786 INFO:teuthology.orchestra.run.smithi045.stdout: -559> 2023-10-03T19:18:12.137+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 116 ==== osd_op_reply(2213 1000000008e.00000000 [delete] v74'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.786 INFO:teuthology.orchestra.run.smithi045.stdout: -558> 2023-10-03T19:18:12.137+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 117 ==== osd_op_reply(2227 1000000009c.00000000 [delete] v74'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.786 INFO:teuthology.orchestra.run.smithi045.stdout: -557> 2023-10-03T19:18:12.141+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 118 ==== osd_op_reply(2228 1000000009d.00000000 [delete] v74'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.786 INFO:teuthology.orchestra.run.smithi045.stdout: -556> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 147 ==== osd_op_reply(2147 1000000004c.00000000 [delete] v74'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.787 INFO:teuthology.orchestra.run.smithi045.stdout: -555> 2023-10-03T19:18:12.141+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 119 ==== osd_op_reply(2265 100000000c2.00000000 [delete] v74'41 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.787 INFO:teuthology.orchestra.run.smithi045.stdout: -554> 2023-10-03T19:18:12.141+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 120 ==== osd_op_reply(2270 100000000c7.00000000 [delete] v74'42 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.787 INFO:teuthology.orchestra.run.smithi045.stdout: -553> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 148 ==== osd_op_reply(2150 1000000004f.00000000 [delete] v74'33 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.787 INFO:teuthology.orchestra.run.smithi045.stdout: -552> 2023-10-03T19:18:12.141+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 121 ==== osd_op_reply(2302 100000000e7.00000000 [delete] v74'43 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.787 INFO:teuthology.orchestra.run.smithi045.stdout: -551> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 149 ==== osd_op_reply(2165 1000000005e.00000000 [delete] v74'34 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.787 INFO:teuthology.orchestra.run.smithi045.stdout: -550> 2023-10-03T19:18:12.141+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 122 ==== osd_op_reply(2323 100000000fc.00000000 [delete] v74'44 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.787 INFO:teuthology.orchestra.run.smithi045.stdout: -549> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 150 ==== osd_op_reply(2182 1000000006f.00000000 [delete] v74'35 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.787 INFO:teuthology.orchestra.run.smithi045.stdout: -548> 2023-10-03T19:18:12.141+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 123 ==== osd_op_reply(2331 10000000104.00000000 [delete] v74'45 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.787 INFO:teuthology.orchestra.run.smithi045.stdout: -547> 2023-10-03T19:18:12.141+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 124 ==== osd_op_reply(2354 1000000011b.00000000 [delete] v74'46 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.787 INFO:teuthology.orchestra.run.smithi045.stdout: -546> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 151 ==== osd_op_reply(2253 100000000b6.00000000 [delete] v74'36 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.788 INFO:teuthology.orchestra.run.smithi045.stdout: -545> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 152 ==== osd_op_reply(2289 100000000da.00000000 [delete] v74'37 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.788 INFO:teuthology.orchestra.run.smithi045.stdout: -544> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 153 ==== osd_op_reply(2439 10000000170.00000000 [delete] v74'38 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.788 INFO:teuthology.orchestra.run.smithi045.stdout: -543> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 993 ==== osd_op_reply(2123 10000000034.00000000 [delete] v74'17 uv16 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.788 INFO:teuthology.orchestra.run.smithi045.stdout: -542> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 994 ==== osd_op_reply(2162 1000000005b.00000000 [delete] v74'25 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.788 INFO:teuthology.orchestra.run.smithi045.stdout: -541> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 995 ==== osd_op_reply(2188 10000000075.00000000 [delete] v74'23 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.788 INFO:teuthology.orchestra.run.smithi045.stdout: -540> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 996 ==== osd_op_reply(2201 10000000082.00000000 [delete] v74'26 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.788 INFO:teuthology.orchestra.run.smithi045.stdout: -539> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 997 ==== osd_op_reply(2237 100000000a6.00000000 [delete] v74'18 uv16 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.788 INFO:teuthology.orchestra.run.smithi045.stdout: -538> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 998 ==== osd_op_reply(2280 100000000d1.00000000 [delete] v74'34 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.788 INFO:teuthology.orchestra.run.smithi045.stdout: -537> 2023-10-03T19:18:12.141+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 163 ==== osd_op_reply(2370 1000000012b.00000000 [delete] v74'28 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.788 INFO:teuthology.orchestra.run.smithi045.stdout: -536> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 999 ==== osd_op_reply(2290 100000000db.00000000 [delete] v74'28 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.788 INFO:teuthology.orchestra.run.smithi045.stdout: -535> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1000 ==== osd_op_reply(2299 100000000e4.00000000 [delete] v74'27 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.788 INFO:teuthology.orchestra.run.smithi045.stdout: -534> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1001 ==== osd_op_reply(2306 100000000eb.00000000 [delete] v74'35 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.789 INFO:teuthology.orchestra.run.smithi045.stdout: -533> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1002 ==== osd_op_reply(2129 1000000003a.00000000 [delete] v74'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.789 INFO:teuthology.orchestra.run.smithi045.stdout: -532> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1003 ==== osd_op_reply(2301 100000000e6.00000000 [delete] v74'28 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.789 INFO:teuthology.orchestra.run.smithi045.stdout: -531> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1004 ==== osd_op_reply(2359 10000000120.00000000 [delete] v74'29 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.789 INFO:teuthology.orchestra.run.smithi045.stdout: -530> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1005 ==== osd_op_reply(2375 10000000130.00000000 [delete] v74'30 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.789 INFO:teuthology.orchestra.run.smithi045.stdout: -529> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1006 ==== osd_op_reply(2405 1000000014e.00000000 [delete] v74'31 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.789 INFO:teuthology.orchestra.run.smithi045.stdout: -528> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1007 ==== osd_op_reply(2368 10000000129.00000000 [delete] v74'19 uv16 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.789 INFO:teuthology.orchestra.run.smithi045.stdout: -527> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1008 ==== osd_op_reply(2453 1000000017e.00000000 [delete] v74'32 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.789 INFO:teuthology.orchestra.run.smithi045.stdout: -526> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1009 ==== osd_op_reply(2451 1000000017c.00000000 [delete] v74'29 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.789 INFO:teuthology.orchestra.run.smithi045.stdout: -525> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1010 ==== osd_op_reply(2471 10000000190.00000000 [delete] v74'36 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.789 INFO:teuthology.orchestra.run.smithi045.stdout: -524> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1011 ==== osd_op_reply(2520 100000001c1.00000000 [delete] v74'20 uv16 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.790 INFO:teuthology.orchestra.run.smithi045.stdout: -523> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1012 ==== osd_op_reply(2535 100000001d0.00000000 [delete] v74'21 uv16 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.790 INFO:teuthology.orchestra.run.smithi045.stdout: -522> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1013 ==== osd_op_reply(2172 10000000065.00000000 [delete] v74'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.790 INFO:teuthology.orchestra.run.smithi045.stdout: -521> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1014 ==== osd_op_reply(2266 100000000c3.00000000 [delete] v74'37 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.790 INFO:teuthology.orchestra.run.smithi045.stdout: -520> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1015 ==== osd_op_reply(2271 100000000c8.00000000 [delete] v74'33 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.790 INFO:teuthology.orchestra.run.smithi045.stdout: -519> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 207 ==== osd_op_reply(2091 10000000014.00000000 [delete] v74'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.790 INFO:teuthology.orchestra.run.smithi045.stdout: -518> 2023-10-03T19:18:12.141+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 164 ==== osd_op_reply(2145 1000000004a.00000000 [delete] v74'38 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.790 INFO:teuthology.orchestra.run.smithi045.stdout: -517> 2023-10-03T19:18:12.141+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 165 ==== osd_op_reply(2207 10000000088.00000000 [delete] v74'39 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.790 INFO:teuthology.orchestra.run.smithi045.stdout: -516> 2023-10-03T19:18:12.141+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 166 ==== osd_op_reply(2262 100000000bf.00000000 [delete] v74'40 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.790 INFO:teuthology.orchestra.run.smithi045.stdout: -515> 2023-10-03T19:18:12.141+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 167 ==== osd_op_reply(2294 100000000df.00000000 [delete] v74'41 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.790 INFO:teuthology.orchestra.run.smithi045.stdout: -514> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1016 ==== osd_op_reply(2203 10000000084.00000000 [delete] v74'24 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.790 INFO:teuthology.orchestra.run.smithi045.stdout: -513> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1017 ==== osd_op_reply(2232 100000000a1.00000000 [delete] v74'25 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.791 INFO:teuthology.orchestra.run.smithi045.stdout: -512> 2023-10-03T19:18:12.141+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 168 ==== osd_op_reply(2434 1000000016b.00000000 [delete] v74'25 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.791 INFO:teuthology.orchestra.run.smithi045.stdout: -511> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1018 ==== osd_op_reply(2258 100000000bb.00000000 [delete] v74'26 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.791 INFO:teuthology.orchestra.run.smithi045.stdout: -510> 2023-10-03T19:18:12.141+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 169 ==== osd_op_reply(2437 1000000016e.00000000 [delete] v74'26 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.791 INFO:teuthology.orchestra.run.smithi045.stdout: -509> 2023-10-03T19:18:12.141+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 170 ==== osd_op_reply(2100 1000000001d.00000000 [delete] v74'43 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.791 INFO:teuthology.orchestra.run.smithi045.stdout: -508> 2023-10-03T19:18:12.141+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 117 ==== osd_op_reply(2115 1000000002c.00000000 [delete] v74'26 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.791 INFO:teuthology.orchestra.run.smithi045.stdout: -507> 2023-10-03T19:18:12.141+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 118 ==== osd_op_reply(2163 1000000005c.00000000 [delete] v74'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.791 INFO:teuthology.orchestra.run.smithi045.stdout: -506> 2023-10-03T19:18:12.141+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 119 ==== osd_op_reply(2169 10000000062.00000000 [delete] v74'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.791 INFO:teuthology.orchestra.run.smithi045.stdout: -505> 2023-10-03T19:18:12.141+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 171 ==== osd_op_reply(2221 10000000096.00000000 [delete] v74'44 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.791 INFO:teuthology.orchestra.run.smithi045.stdout: -504> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1019 ==== osd_op_reply(2304 100000000e9.00000000 [delete] v74'27 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.791 INFO:teuthology.orchestra.run.smithi045.stdout: -503> 2023-10-03T19:18:12.141+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 172 ==== osd_op_reply(2230 1000000009f.00000000 [delete] v74'45 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.792 INFO:teuthology.orchestra.run.smithi045.stdout: -502> 2023-10-03T19:18:12.141+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 120 ==== osd_op_reply(2248 100000000b1.00000000 [delete] v74'27 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.792 INFO:teuthology.orchestra.run.smithi045.stdout: -501> 2023-10-03T19:18:12.141+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 121 ==== osd_op_reply(2198 1000000007f.00000000 [delete] v74'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.792 INFO:teuthology.orchestra.run.smithi045.stdout: -500> 2023-10-03T19:18:12.141+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 122 ==== osd_op_reply(2199 10000000080.00000000 [delete] v74'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.792 INFO:teuthology.orchestra.run.smithi045.stdout: -499> 2023-10-03T19:18:12.141+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 123 ==== osd_op_reply(2351 10000000118.00000000 [delete] v74'28 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.792 INFO:teuthology.orchestra.run.smithi045.stdout: -498> 2023-10-03T19:18:12.141+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 124 ==== osd_op_reply(2309 100000000ee.00000000 [delete] v74'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.792 INFO:teuthology.orchestra.run.smithi045.stdout: -497> 2023-10-03T19:18:12.141+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 125 ==== osd_op_reply(2364 10000000125.00000000 [delete] v74'35 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.792 INFO:teuthology.orchestra.run.smithi045.stdout: -496> 2023-10-03T19:18:12.141+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 126 ==== osd_op_reply(2533 100000001ce.00000000 [delete] v74'36 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.792 INFO:teuthology.orchestra.run.smithi045.stdout: -495> 2023-10-03T19:18:12.141+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 127 ==== osd_op_reply(2557 100000001e6.00000000 [delete] v74'37 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.792 INFO:teuthology.orchestra.run.smithi045.stdout: -494> 2023-10-03T19:18:12.141+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 128 ==== osd_op_reply(2564 100000001ed.00000000 [delete] v74'38 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.792 INFO:teuthology.orchestra.run.smithi045.stdout: -493> 2023-10-03T19:18:12.141+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 129 ==== osd_op_reply(2571 100000001f4.00000000 [delete] v74'39 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.792 INFO:teuthology.orchestra.run.smithi045.stdout: -492> 2023-10-03T19:18:12.141+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 310 ==== osd_op_reply(2120 10000000031.00000000 [delete] v74'29 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.793 INFO:teuthology.orchestra.run.smithi045.stdout: -491> 2023-10-03T19:18:12.141+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 311 ==== osd_op_reply(2125 10000000036.00000000 [delete] v74'45 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.793 INFO:teuthology.orchestra.run.smithi045.stdout: -490> 2023-10-03T19:18:12.141+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 173 ==== osd_op_reply(2452 1000000017d.00000000 [delete] v74'25 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.793 INFO:teuthology.orchestra.run.smithi045.stdout: -489> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 108 ==== osd_op_reply(2143 10000000048.00000000 [delete] v74'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.793 INFO:teuthology.orchestra.run.smithi045.stdout: -488> 2023-10-03T19:18:12.141+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 312 ==== osd_op_reply(2136 10000000041.00000000 [delete] v74'46 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.793 INFO:teuthology.orchestra.run.smithi045.stdout: -487> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1020 ==== osd_op_reply(2307 100000000ec.00000000 [delete] v74'28 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.793 INFO:teuthology.orchestra.run.smithi045.stdout: -486> 2023-10-03T19:18:12.141+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 313 ==== osd_op_reply(2094 10000000017.00000000 [delete] v74'21 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.793 INFO:teuthology.orchestra.run.smithi045.stdout: -485> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1021 ==== osd_op_reply(2374 1000000012f.00000000 [delete] v74'29 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.793 INFO:teuthology.orchestra.run.smithi045.stdout: -484> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1022 ==== osd_op_reply(2417 1000000015a.00000000 [delete] v74'30 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.793 INFO:teuthology.orchestra.run.smithi045.stdout: -483> 2023-10-03T19:18:12.141+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1023 ==== osd_op_reply(2514 100000001bb.00000000 [delete] v74'31 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.793 INFO:teuthology.orchestra.run.smithi045.stdout: -482> 2023-10-03T19:18:12.145+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 314 ==== osd_op_reply(2179 1000000006c.00000000 [delete] v74'47 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.793 INFO:teuthology.orchestra.run.smithi045.stdout: -481> 2023-10-03T19:18:12.145+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 315 ==== osd_op_reply(2085 1000000000e.00000000 [delete] v74'37 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.794 INFO:teuthology.orchestra.run.smithi045.stdout: -480> 2023-10-03T19:18:12.145+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 316 ==== osd_op_reply(2279 100000000d0.00000000 [delete] v74'30 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.794 INFO:teuthology.orchestra.run.smithi045.stdout: -479> 2023-10-03T19:18:12.145+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 317 ==== osd_op_reply(2174 10000000067.00000000 [delete] v74'38 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.794 INFO:teuthology.orchestra.run.smithi045.stdout: -478> 2023-10-03T19:18:12.145+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 318 ==== osd_op_reply(2231 100000000a0.00000000 [delete] v74'48 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.794 INFO:teuthology.orchestra.run.smithi045.stdout: -477> 2023-10-03T19:18:12.145+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 319 ==== osd_op_reply(2180 1000000006d.00000000 [delete] v74'39 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.794 INFO:teuthology.orchestra.run.smithi045.stdout: -476> 2023-10-03T19:18:12.145+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 320 ==== osd_op_reply(2303 100000000e8.00000000 [delete] v74'31 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.794 INFO:teuthology.orchestra.run.smithi045.stdout: -475> 2023-10-03T19:18:12.145+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 125 ==== osd_op_reply(2335 10000000108.00000000 [delete] v74'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.794 INFO:teuthology.orchestra.run.smithi045.stdout: -474> 2023-10-03T19:18:12.145+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 126 ==== osd_op_reply(2465 1000000018a.00000000 [delete] v74'29 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.794 INFO:teuthology.orchestra.run.smithi045.stdout: -473> 2023-10-03T19:18:12.145+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 127 ==== osd_op_reply(2342 1000000010f.00000000 [delete] v74'41 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.794 INFO:teuthology.orchestra.run.smithi045.stdout: -472> 2023-10-03T19:18:12.145+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 128 ==== osd_op_reply(2468 1000000018d.00000000 [delete] v74'30 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.794 INFO:teuthology.orchestra.run.smithi045.stdout: -471> 2023-10-03T19:18:12.145+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 129 ==== osd_op_reply(2479 10000000198.00000000 [delete] v74'42 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.794 INFO:teuthology.orchestra.run.smithi045.stdout: -470> 2023-10-03T19:18:12.145+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 130 ==== osd_op_reply(2560 100000001e9.00000000 [delete] v74'43 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.795 INFO:teuthology.orchestra.run.smithi045.stdout: -469> 2023-10-03T19:18:12.145+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 109 ==== osd_op_reply(2220 10000000095.00000000 [delete] v74'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.795 INFO:teuthology.orchestra.run.smithi045.stdout: -468> 2023-10-03T19:18:12.145+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 110 ==== osd_op_reply(2240 100000000a9.00000000 [delete] v74'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.795 INFO:teuthology.orchestra.run.smithi045.stdout: -467> 2023-10-03T19:18:12.145+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 111 ==== osd_op_reply(2297 100000000e2.00000000 [delete] v74'41 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.795 INFO:teuthology.orchestra.run.smithi045.stdout: -466> 2023-10-03T19:18:12.145+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 112 ==== osd_op_reply(2131 1000000003c.00000000 [delete] v74'24 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.795 INFO:teuthology.orchestra.run.smithi045.stdout: -465> 2023-10-03T19:18:12.145+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 113 ==== osd_op_reply(2318 100000000f7.00000000 [delete] v74'42 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.795 INFO:teuthology.orchestra.run.smithi045.stdout: -464> 2023-10-03T19:18:12.145+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 114 ==== osd_op_reply(2142 10000000047.00000000 [delete] v74'25 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.795 INFO:teuthology.orchestra.run.smithi045.stdout: -463> 2023-10-03T19:18:12.145+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 115 ==== osd_op_reply(2206 10000000087.00000000 [delete] v74'26 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.795 INFO:teuthology.orchestra.run.smithi045.stdout: -462> 2023-10-03T19:18:12.145+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1024 ==== osd_op_reply(2269 100000000c6.00000000 [delete] v74'39 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.795 INFO:teuthology.orchestra.run.smithi045.stdout: -461> 2023-10-03T19:18:12.145+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1025 ==== osd_op_reply(2282 100000000d3.00000000 [delete] v74'40 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.795 INFO:teuthology.orchestra.run.smithi045.stdout: -460> 2023-10-03T19:18:12.145+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 116 ==== osd_op_reply(2210 1000000008b.00000000 [delete] v74'27 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.796 INFO:teuthology.orchestra.run.smithi045.stdout: -459> 2023-10-03T19:18:12.145+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 117 ==== osd_op_reply(2246 100000000af.00000000 [delete] v74'28 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.796 INFO:teuthology.orchestra.run.smithi045.stdout: -458> 2023-10-03T19:18:12.145+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1026 ==== osd_op_reply(2526 100000001c7.00000000 [delete] v74'37 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.796 INFO:teuthology.orchestra.run.smithi045.stdout: -457> 2023-10-03T19:18:12.145+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 174 ==== osd_op_reply(2239 100000000a8.00000000 [delete] v74'46 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.796 INFO:teuthology.orchestra.run.smithi045.stdout: -456> 2023-10-03T19:18:12.145+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 175 ==== osd_op_reply(2508 100000001b5.00000000 [delete] v74'26 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.796 INFO:teuthology.orchestra.run.smithi045.stdout: -455> 2023-10-03T19:18:12.145+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 176 ==== osd_op_reply(2276 100000000cd.00000000 [delete] v74'47 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.796 INFO:teuthology.orchestra.run.smithi045.stdout: -454> 2023-10-03T19:18:12.145+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 321 ==== osd_op_reply(2245 100000000ae.00000000 [delete] v74'49 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.796 INFO:teuthology.orchestra.run.smithi045.stdout: -453> 2023-10-03T19:18:12.145+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 322 ==== osd_op_reply(2095 10000000018.00000000 [delete] v74'33 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.796 INFO:teuthology.orchestra.run.smithi045.stdout: -452> 2023-10-03T19:18:12.145+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 323 ==== osd_op_reply(2139 10000000044.00000000 [delete] v74'34 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.936 INFO:teuthology.orchestra.run.smithi045.stdout: -451> 2023-10-03T19:18:12.145+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 118 ==== osd_op_reply(2153 10000000052.00000000 [delete] v74'33 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.936 INFO:teuthology.orchestra.run.smithi045.stdout: -450> 2023-10-03T19:18:12.145+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 119 ==== osd_op_reply(2384 10000000139.00000000 [delete] v74'29 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.936 INFO:teuthology.orchestra.run.smithi045.stdout: -449> 2023-10-03T19:18:12.145+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 120 ==== osd_op_reply(2283 100000000d4.00000000 [delete] v74'34 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.936 INFO:teuthology.orchestra.run.smithi045.stdout: -448> 2023-10-03T19:18:12.145+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 121 ==== osd_op_reply(2421 1000000015e.00000000 [delete] v74'30 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.936 INFO:teuthology.orchestra.run.smithi045.stdout: -447> 2023-10-03T19:18:12.145+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 177 ==== osd_op_reply(2313 100000000f2.00000000 [delete] v74'48 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.936 INFO:teuthology.orchestra.run.smithi045.stdout: -446> 2023-10-03T19:18:12.145+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 122 ==== osd_op_reply(2528 100000001c9.00000000 [delete] v74'31 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.937 INFO:teuthology.orchestra.run.smithi045.stdout: -445> 2023-10-03T19:18:12.145+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 178 ==== osd_op_reply(2547 100000001dc.00000000 [delete] v74'27 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.937 INFO:teuthology.orchestra.run.smithi045.stdout: -444> 2023-10-03T19:18:12.145+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 123 ==== osd_op_reply(2317 100000000f6.00000000 [delete] v74'35 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.937 INFO:teuthology.orchestra.run.smithi045.stdout: -443> 2023-10-03T19:18:12.145+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 179 ==== osd_op_reply(2388 1000000013d.00000000 [delete] v74'49 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.937 INFO:teuthology.orchestra.run.smithi045.stdout: -442> 2023-10-03T19:18:12.145+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 180 ==== osd_op_reply(2391 10000000140.00000000 [delete] v74'39 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.937 INFO:teuthology.orchestra.run.smithi045.stdout: -441> 2023-10-03T19:18:12.145+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 181 ==== osd_op_reply(2548 100000001dd.00000000 [delete] v74'40 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.937 INFO:teuthology.orchestra.run.smithi045.stdout: -440> 2023-10-03T19:18:12.145+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 182 ==== osd_op_reply(2462 10000000187.00000000 [delete] v74'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.937 INFO:teuthology.orchestra.run.smithi045.stdout: -439> 2023-10-03T19:18:12.145+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 183 ==== osd_op_reply(2463 10000000188.00000000 [delete] v74'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.937 INFO:teuthology.orchestra.run.smithi045.stdout: -438> 2023-10-03T19:18:12.145+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 184 ==== osd_op_reply(2496 100000001a9.00000000 [delete] v74'41 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.937 INFO:teuthology.orchestra.run.smithi045.stdout: -437> 2023-10-03T19:18:12.145+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 185 ==== osd_op_reply(2552 100000001e1.00000000 [delete] v74'42 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.937 INFO:teuthology.orchestra.run.smithi045.stdout: -436> 2023-10-03T19:18:12.145+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 186 ==== osd_op_reply(2546 100000001db.00000000 [delete] v74'27 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.938 INFO:teuthology.orchestra.run.smithi045.stdout: -435> 2023-10-03T19:18:12.145+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 187 ==== osd_op_reply(2558 100000001e7.00000000 [delete] v74'28 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.938 INFO:teuthology.orchestra.run.smithi045.stdout: -434> 2023-10-03T19:18:12.145+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 188 ==== osd_op_reply(2233 100000000a2.00000000 [delete] v74'33 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.938 INFO:teuthology.orchestra.run.smithi045.stdout: -433> 2023-10-03T19:18:12.149+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 189 ==== osd_op_reply(2256 100000000b9.00000000 [delete] v74'34 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.938 INFO:teuthology.orchestra.run.smithi045.stdout: -432> 2023-10-03T19:18:12.149+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 124 ==== osd_op_reply(2355 1000000011c.00000000 [delete] v74'36 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.938 INFO:teuthology.orchestra.run.smithi045.stdout: -431> 2023-10-03T19:18:12.149+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 190 ==== osd_op_reply(2305 100000000ea.00000000 [delete] v74'35 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.938 INFO:teuthology.orchestra.run.smithi045.stdout: -430> 2023-10-03T19:18:12.149+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 125 ==== osd_op_reply(2403 1000000014c.00000000 [delete] v74'37 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.938 INFO:teuthology.orchestra.run.smithi045.stdout: -429> 2023-10-03T19:18:12.149+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 191 ==== osd_op_reply(2341 1000000010e.00000000 [delete] v74'36 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.938 INFO:teuthology.orchestra.run.smithi045.stdout: -428> 2023-10-03T19:18:12.149+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 192 ==== osd_op_reply(2348 10000000115.00000000 [delete] v74'37 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.938 INFO:teuthology.orchestra.run.smithi045.stdout: -427> 2023-10-03T19:18:12.149+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 193 ==== osd_op_reply(2353 1000000011a.00000000 [delete] v74'38 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.938 INFO:teuthology.orchestra.run.smithi045.stdout: -426> 2023-10-03T19:18:12.149+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 130 ==== osd_op_reply(2202 10000000083.00000000 [delete] v74'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.938 INFO:teuthology.orchestra.run.smithi045.stdout: -425> 2023-10-03T19:18:12.149+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 131 ==== osd_op_reply(2212 1000000008d.00000000 [delete] v74'41 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.939 INFO:teuthology.orchestra.run.smithi045.stdout: -424> 2023-10-03T19:18:12.149+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 132 ==== osd_op_reply(2362 10000000123.00000000 [delete] v74'47 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.939 INFO:teuthology.orchestra.run.smithi045.stdout: -423> 2023-10-03T19:18:12.149+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 133 ==== osd_op_reply(2387 1000000013c.00000000 [delete] v74'48 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.939 INFO:teuthology.orchestra.run.smithi045.stdout: -422> 2023-10-03T19:18:12.149+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 324 ==== osd_op_reply(2155 10000000054.00000000 [delete] v74'37 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.939 INFO:teuthology.orchestra.run.smithi045.stdout: -421> 2023-10-03T19:18:12.149+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1027 ==== osd_op_reply(2293 100000000de.00000000 [delete] v74'34 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.939 INFO:teuthology.orchestra.run.smithi045.stdout: -420> 2023-10-03T19:18:12.149+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 194 ==== osd_op_reply(2409 10000000152.00000000 [delete] v74'39 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.939 INFO:teuthology.orchestra.run.smithi045.stdout: -419> 2023-10-03T19:18:12.149+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 195 ==== osd_op_reply(2502 100000001af.00000000 [delete] v74'40 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.939 INFO:teuthology.orchestra.run.smithi045.stdout: -418> 2023-10-03T19:18:12.149+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 196 ==== osd_op_reply(2506 100000001b3.00000000 [delete] v74'41 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.939 INFO:teuthology.orchestra.run.smithi045.stdout: -417> 2023-10-03T19:18:12.149+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 325 ==== osd_op_reply(2168 10000000061.00000000 [delete] v74'38 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.939 INFO:teuthology.orchestra.run.smithi045.stdout: -416> 2023-10-03T19:18:12.149+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 134 ==== osd_op_reply(2513 100000001ba.00000000 [delete] v74'49 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.939 INFO:teuthology.orchestra.run.smithi045.stdout: -415> 2023-10-03T19:18:12.149+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 326 ==== osd_op_reply(2225 1000000009a.00000000 [delete] v74'39 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.939 INFO:teuthology.orchestra.run.smithi045.stdout: -414> 2023-10-03T19:18:12.149+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 197 ==== osd_op_reply(2428 10000000165.00000000 [delete] v74'42 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.940 INFO:teuthology.orchestra.run.smithi045.stdout: -413> 2023-10-03T19:18:12.149+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 198 ==== osd_op_reply(2429 10000000166.00000000 [delete] v74'43 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.940 INFO:teuthology.orchestra.run.smithi045.stdout: -412> 2023-10-03T19:18:12.149+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 126 ==== osd_op_reply(2569 100000001f2.00000000 [delete] v74'38 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.940 INFO:teuthology.orchestra.run.smithi045.stdout: -411> 2023-10-03T19:18:12.149+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 154 ==== osd_op_reply(2445 10000000176.00000000 [delete] v74'39 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.940 INFO:teuthology.orchestra.run.smithi045.stdout: -410> 2023-10-03T19:18:12.149+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 155 ==== osd_op_reply(2446 10000000177.00000000 [delete] v74'40 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.940 INFO:teuthology.orchestra.run.smithi045.stdout: -409> 2023-10-03T19:18:12.149+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 156 ==== osd_op_reply(2470 1000000018f.00000000 [delete] v74'41 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.940 INFO:teuthology.orchestra.run.smithi045.stdout: -408> 2023-10-03T19:18:12.149+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 157 ==== osd_op_reply(2532 100000001cd.00000000 [delete] v74'42 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.940 INFO:teuthology.orchestra.run.smithi045.stdout: -407> 2023-10-03T19:18:12.149+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 199 ==== osd_op_reply(2442 10000000173.00000000 [delete] v74'44 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.940 INFO:teuthology.orchestra.run.smithi045.stdout: -406> 2023-10-03T19:18:12.149+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1028 ==== osd_op_reply(2296 100000000e1.00000000 [delete] v74'41 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.940 INFO:teuthology.orchestra.run.smithi045.stdout: -405> 2023-10-03T19:18:12.149+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1029 ==== osd_op_reply(2298 100000000e3.00000000 [delete] v74'38 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.940 INFO:teuthology.orchestra.run.smithi045.stdout: -404> 2023-10-03T19:18:12.149+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1030 ==== osd_op_reply(2320 100000000f9.00000000 [delete] v74'35 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.940 INFO:teuthology.orchestra.run.smithi045.stdout: -403> 2023-10-03T19:18:12.149+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1031 ==== osd_op_reply(2419 1000000015c.00000000 [delete] v74'36 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.941 INFO:teuthology.orchestra.run.smithi045.stdout: -402> 2023-10-03T19:18:12.149+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1032 ==== osd_op_reply(2422 1000000015f.00000000 [delete] v74'37 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.941 INFO:teuthology.orchestra.run.smithi045.stdout: -401> 2023-10-03T19:18:12.149+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1033 ==== osd_op_reply(2319 100000000f8.00000000 [delete] v74'39 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.941 INFO:teuthology.orchestra.run.smithi045.stdout: -400> 2023-10-03T19:18:12.149+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1034 ==== osd_op_reply(2346 10000000113.00000000 [delete] v74'40 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.941 INFO:teuthology.orchestra.run.smithi045.stdout: -399> 2023-10-03T19:18:12.149+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 327 ==== osd_op_reply(2322 100000000fb.00000000 [delete] v74'40 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.941 INFO:teuthology.orchestra.run.smithi045.stdout: -398> 2023-10-03T19:18:12.149+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 127 ==== osd_op_reply(2164 1000000005d.00000000 [delete] v74'35 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.941 INFO:teuthology.orchestra.run.smithi045.stdout: -397> 2023-10-03T19:18:12.149+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 328 ==== osd_op_reply(2413 10000000156.00000000 [delete] v74'51 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.941 INFO:teuthology.orchestra.run.smithi045.stdout: -396> 2023-10-03T19:18:12.149+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 128 ==== osd_op_reply(2214 1000000008f.00000000 [delete] v74'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.941 INFO:teuthology.orchestra.run.smithi045.stdout: -395> 2023-10-03T19:18:12.149+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 129 ==== osd_op_reply(2238 100000000a7.00000000 [delete] v74'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.941 INFO:teuthology.orchestra.run.smithi045.stdout: -394> 2023-10-03T19:18:12.149+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 130 ==== osd_op_reply(2324 100000000fd.00000000 [delete] v74'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.941 INFO:teuthology.orchestra.run.smithi045.stdout: -393> 2023-10-03T19:18:12.149+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 135 ==== osd_op_reply(2414 10000000157.00000000 [delete] v74'23 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.941 INFO:teuthology.orchestra.run.smithi045.stdout: -392> 2023-10-03T19:18:12.149+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 131 ==== osd_op_reply(2222 10000000097.00000000 [delete] v74'23 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.942 INFO:teuthology.orchestra.run.smithi045.stdout: -391> 2023-10-03T19:18:12.149+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 132 ==== osd_op_reply(2251 100000000b4.00000000 [delete] v74'24 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.942 INFO:teuthology.orchestra.run.smithi045.stdout: -390> 2023-10-03T19:18:12.149+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1035 ==== osd_op_reply(2138 10000000043.00000000 [delete] v74'40 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.942 INFO:teuthology.orchestra.run.smithi045.stdout: -389> 2023-10-03T19:18:12.149+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 136 ==== osd_op_reply(2415 10000000158.00000000 [delete] v74'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.942 INFO:teuthology.orchestra.run.smithi045.stdout: -388> 2023-10-03T19:18:12.149+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 133 ==== osd_op_reply(2171 10000000064.00000000 [delete] v74'46 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.942 INFO:teuthology.orchestra.run.smithi045.stdout: -387> 2023-10-03T19:18:12.149+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 137 ==== osd_op_reply(2457 10000000182.00000000 [delete] v74'24 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.942 INFO:teuthology.orchestra.run.smithi045.stdout: -386> 2023-10-03T19:18:12.149+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 138 ==== osd_op_reply(2551 100000001e0.00000000 [delete] v74'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.942 INFO:teuthology.orchestra.run.smithi045.stdout: -385> 2023-10-03T19:18:12.149+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 139 ==== osd_op_reply(2553 100000001e2.00000000 [delete] v74'25 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.942 INFO:teuthology.orchestra.run.smithi045.stdout: -384> 2023-10-03T19:18:12.149+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 140 ==== osd_op_reply(2570 100000001f3.00000000 [delete] v74'26 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.942 INFO:teuthology.orchestra.run.smithi045.stdout: -383> 2023-10-03T19:18:12.149+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 134 ==== osd_op_reply(2249 100000000b2.00000000 [delete] v74'47 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.942 INFO:teuthology.orchestra.run.smithi045.stdout: -382> 2023-10-03T19:18:12.149+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 135 ==== osd_op_reply(2312 100000000f1.00000000 [delete] v74'25 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.942 INFO:teuthology.orchestra.run.smithi045.stdout: -381> 2023-10-03T19:18:12.149+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 136 ==== osd_op_reply(2334 10000000107.00000000 [delete] v74'26 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.943 INFO:teuthology.orchestra.run.smithi045.stdout: -380> 2023-10-03T19:18:12.149+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 137 ==== osd_op_reply(2338 1000000010b.00000000 [delete] v74'27 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.943 INFO:teuthology.orchestra.run.smithi045.stdout: -379> 2023-10-03T19:18:12.149+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 329 ==== osd_op_reply(2420 1000000015d.00000000 [delete] v74'52 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.943 INFO:teuthology.orchestra.run.smithi045.stdout: -378> 2023-10-03T19:18:12.149+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 330 ==== osd_op_reply(2345 10000000112.00000000 [delete] v74'41 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.943 INFO:teuthology.orchestra.run.smithi045.stdout: -377> 2023-10-03T19:18:12.149+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 331 ==== osd_op_reply(2347 10000000114.00000000 [delete] v74'42 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.943 INFO:teuthology.orchestra.run.smithi045.stdout: -376> 2023-10-03T19:18:12.149+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 332 ==== osd_op_reply(2438 1000000016f.00000000 [delete] v74'53 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.943 INFO:teuthology.orchestra.run.smithi045.stdout: -375> 2023-10-03T19:18:12.149+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 333 ==== osd_op_reply(2494 100000001a7.00000000 [delete] v74'54 uv46 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.943 INFO:teuthology.orchestra.run.smithi045.stdout: -374> 2023-10-03T19:18:12.149+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 334 ==== osd_op_reply(2316 100000000f5.00000000 [delete] v74'50 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.943 INFO:teuthology.orchestra.run.smithi045.stdout: -373> 2023-10-03T19:18:12.149+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 335 ==== osd_op_reply(2366 10000000127.00000000 [delete] v74'43 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.943 INFO:teuthology.orchestra.run.smithi045.stdout: -372> 2023-10-03T19:18:12.149+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 336 ==== osd_op_reply(2473 10000000192.00000000 [delete] v74'44 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.943 INFO:teuthology.orchestra.run.smithi045.stdout: -371> 2023-10-03T19:18:12.149+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 138 ==== osd_op_reply(2380 10000000135.00000000 [delete] v74'28 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.943 INFO:teuthology.orchestra.run.smithi045.stdout: -370> 2023-10-03T19:18:12.149+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 139 ==== osd_op_reply(2411 10000000154.00000000 [delete] v74'48 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.943 INFO:teuthology.orchestra.run.smithi045.stdout: -369> 2023-10-03T19:18:12.149+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 140 ==== osd_op_reply(2397 10000000146.00000000 [delete] v74'29 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.944 INFO:teuthology.orchestra.run.smithi045.stdout: -368> 2023-10-03T19:18:12.149+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1036 ==== osd_op_reply(2151 10000000050.00000000 [delete] v74'41 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.944 INFO:teuthology.orchestra.run.smithi045.stdout: -367> 2023-10-03T19:18:12.149+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 200 ==== osd_op_reply(2480 10000000199.00000000 [delete] v74'50 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.944 INFO:teuthology.orchestra.run.smithi045.stdout: -366> 2023-10-03T19:18:12.149+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1037 ==== osd_op_reply(2154 10000000053.00000000 [delete] v74'42 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.944 INFO:teuthology.orchestra.run.smithi045.stdout: -365> 2023-10-03T19:18:12.149+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1038 ==== osd_op_reply(2522 100000001c3.00000000 [delete] v74'41 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.944 INFO:teuthology.orchestra.run.smithi045.stdout: -364> 2023-10-03T19:18:12.149+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 201 ==== osd_op_reply(2540 100000001d5.00000000 [delete] v74'51 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.944 INFO:teuthology.orchestra.run.smithi045.stdout: -363> 2023-10-03T19:18:12.149+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 202 ==== osd_op_reply(2568 100000001f1.00000000 [delete] v74'52 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.944 INFO:teuthology.orchestra.run.smithi045.stdout: -362> 2023-10-03T19:18:12.149+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 141 ==== osd_op_reply(2466 1000000018b.00000000 [delete] v74'49 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.944 INFO:teuthology.orchestra.run.smithi045.stdout: -361> 2023-10-03T19:18:12.149+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 141 ==== osd_op_reply(2365 10000000126.00000000 [delete] v74'25 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.944 INFO:teuthology.orchestra.run.smithi045.stdout: -360> 2023-10-03T19:18:12.149+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1039 ==== osd_op_reply(2525 100000001c6.00000000 [delete] v74'42 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.944 INFO:teuthology.orchestra.run.smithi045.stdout: -359> 2023-10-03T19:18:12.149+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1040 ==== osd_op_reply(2268 100000000c5.00000000 [delete] v74'43 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.945 INFO:teuthology.orchestra.run.smithi045.stdout: -358> 2023-10-03T19:18:12.149+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1041 ==== osd_op_reply(2327 10000000100.00000000 [delete] v74'44 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.945 INFO:teuthology.orchestra.run.smithi045.stdout: -357> 2023-10-03T19:18:12.149+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1042 ==== osd_op_reply(2516 100000001bd.00000000 [delete] v74'45 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.945 INFO:teuthology.orchestra.run.smithi045.stdout: -356> 2023-10-03T19:18:12.149+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1043 ==== osd_op_reply(2529 100000001ca.00000000 [delete] v74'46 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.945 INFO:teuthology.orchestra.run.smithi045.stdout: -355> 2023-10-03T19:18:12.149+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1044 ==== osd_op_reply(2537 100000001d2.00000000 [delete] v74'47 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.945 INFO:teuthology.orchestra.run.smithi045.stdout: -354> 2023-10-03T19:18:12.149+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1045 ==== osd_op_reply(2349 10000000116.00000000 [delete] v74'42 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.945 INFO:teuthology.orchestra.run.smithi045.stdout: -353> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1046 ==== osd_op_reply(2541 100000001d6.00000000 [delete] v74'48 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.945 INFO:teuthology.orchestra.run.smithi045.stdout: -352> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1047 ==== osd_op_reply(2382 10000000137.00000000 [delete] v74'43 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.945 INFO:teuthology.orchestra.run.smithi045.stdout: -351> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 131 ==== osd_op_reply(2360 10000000121.00000000 [delete] v74'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.945 INFO:teuthology.orchestra.run.smithi045.stdout: -350> 2023-10-03T19:18:12.153+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 337 ==== osd_op_reply(2226 1000000009b.00000000 [delete] v74'40 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.945 INFO:teuthology.orchestra.run.smithi045.stdout: -349> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 132 ==== osd_op_reply(2371 1000000012c.00000000 [delete] v74'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.945 INFO:teuthology.orchestra.run.smithi045.stdout: -348> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 133 ==== osd_op_reply(2512 100000001b9.00000000 [delete] v74'41 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.945 INFO:teuthology.orchestra.run.smithi045.stdout: -347> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 134 ==== osd_op_reply(2134 1000000003f.00000000 [delete] v74'41 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.946 INFO:teuthology.orchestra.run.smithi045.stdout: -346> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1048 ==== osd_op_reply(2401 1000000014a.00000000 [delete] v74'44 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.946 INFO:teuthology.orchestra.run.smithi045.stdout: -345> 2023-10-03T19:18:12.153+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 142 ==== osd_op_reply(2407 10000000150.00000000 [delete] v74'26 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.946 INFO:teuthology.orchestra.run.smithi045.stdout: -344> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1049 ==== osd_op_reply(2443 10000000174.00000000 [delete] v74'45 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.946 INFO:teuthology.orchestra.run.smithi045.stdout: -343> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 208 ==== osd_op_reply(2157 10000000056.00000000 [delete] v74'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.946 INFO:teuthology.orchestra.run.smithi045.stdout: -342> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 209 ==== osd_op_reply(2184 10000000071.00000000 [delete] v74'36 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.946 INFO:teuthology.orchestra.run.smithi045.stdout: -341> 2023-10-03T19:18:12.153+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 338 ==== osd_op_reply(2311 100000000f0.00000000 [delete] v74'41 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.946 INFO:teuthology.orchestra.run.smithi045.stdout: -340> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 210 ==== osd_op_reply(2204 10000000085.00000000 [delete] v74'37 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.946 INFO:teuthology.orchestra.run.smithi045.stdout: -339> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 211 ==== osd_op_reply(2178 1000000006b.00000000 [delete] v74'39 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.946 INFO:teuthology.orchestra.run.smithi045.stdout: -338> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 212 ==== osd_op_reply(2122 10000000033.00000000 [delete] v74'21 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.946 INFO:teuthology.orchestra.run.smithi045.stdout: -337> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 213 ==== osd_op_reply(2242 100000000ab.00000000 [delete] v74'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.947 INFO:teuthology.orchestra.run.smithi045.stdout: -336> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 214 ==== osd_op_reply(2183 10000000070.00000000 [delete] v74'40 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.947 INFO:teuthology.orchestra.run.smithi045.stdout: -335> 2023-10-03T19:18:12.153+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 143 ==== osd_op_reply(2243 100000000ac.00000000 [delete] v74'42 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.947 INFO:teuthology.orchestra.run.smithi045.stdout: -334> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 215 ==== osd_op_reply(2257 100000000ba.00000000 [delete] v74'33 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.947 INFO:teuthology.orchestra.run.smithi045.stdout: -333> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 216 ==== osd_op_reply(2190 10000000077.00000000 [delete] v74'41 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.947 INFO:teuthology.orchestra.run.smithi045.stdout: -332> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 217 ==== osd_op_reply(2177 1000000006a.00000000 [delete] v74'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.947 INFO:teuthology.orchestra.run.smithi045.stdout: -331> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 218 ==== osd_op_reply(2195 1000000007c.00000000 [delete] v74'42 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.947 INFO:teuthology.orchestra.run.smithi045.stdout: -330> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 219 ==== osd_op_reply(2217 10000000092.00000000 [delete] v74'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.947 INFO:teuthology.orchestra.run.smithi045.stdout: -329> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 220 ==== osd_op_reply(2209 1000000008a.00000000 [delete] v74'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.947 INFO:teuthology.orchestra.run.smithi045.stdout: -328> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 221 ==== osd_op_reply(2218 10000000093.00000000 [delete] v74'33 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.947 INFO:teuthology.orchestra.run.smithi045.stdout: -327> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 222 ==== osd_op_reply(2250 100000000b3.00000000 [delete] v74'43 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.947 INFO:teuthology.orchestra.run.smithi045.stdout: -326> 2023-10-03T19:18:12.153+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 144 ==== osd_op_reply(2292 100000000dd.00000000 [delete] v74'43 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.947 INFO:teuthology.orchestra.run.smithi045.stdout: -325> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 223 ==== osd_op_reply(2235 100000000a4.00000000 [delete] v74'34 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.948 INFO:teuthology.orchestra.run.smithi045.stdout: -324> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 224 ==== osd_op_reply(2259 100000000bc.00000000 [delete] v74'44 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.948 INFO:teuthology.orchestra.run.smithi045.stdout: -323> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 225 ==== osd_op_reply(2175 10000000068.00000000 [delete] v74'23 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.948 INFO:teuthology.orchestra.run.smithi045.stdout: -322> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 226 ==== osd_op_reply(2121 10000000032.00000000 [delete] v74'39 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.948 INFO:teuthology.orchestra.run.smithi045.stdout: -321> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 227 ==== osd_op_reply(2275 100000000cc.00000000 [delete] v74'22 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.948 INFO:teuthology.orchestra.run.smithi045.stdout: -320> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 228 ==== osd_op_reply(2152 10000000051.00000000 [delete] v74'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.948 INFO:teuthology.orchestra.run.smithi045.stdout: -319> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 229 ==== osd_op_reply(2363 10000000124.00000000 [delete] v74'31 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.948 INFO:teuthology.orchestra.run.smithi045.stdout: -318> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 230 ==== osd_op_reply(2146 1000000004b.00000000 [delete] v74'40 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.948 INFO:teuthology.orchestra.run.smithi045.stdout: -317> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 231 ==== osd_op_reply(2186 10000000073.00000000 [delete] v74'23 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.948 INFO:teuthology.orchestra.run.smithi045.stdout: -316> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 232 ==== osd_op_reply(2418 1000000015b.00000000 [delete] v74'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.948 INFO:teuthology.orchestra.run.smithi045.stdout: -315> 2023-10-03T19:18:12.153+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 145 ==== osd_op_reply(2340 1000000010d.00000000 [delete] v74'44 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.949 INFO:teuthology.orchestra.run.smithi045.stdout: -314> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 233 ==== osd_op_reply(2288 100000000d9.00000000 [delete] v74'38 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.949 INFO:teuthology.orchestra.run.smithi045.stdout: -313> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 234 ==== osd_op_reply(2192 10000000079.00000000 [delete] v74'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.949 INFO:teuthology.orchestra.run.smithi045.stdout: -312> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 135 ==== osd_op_reply(2156 10000000055.00000000 [delete] v74'42 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.949 INFO:teuthology.orchestra.run.smithi045.stdout: -311> 2023-10-03T19:18:12.153+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 146 ==== osd_op_reply(2343 10000000110.00000000 [delete] v74'45 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.949 INFO:teuthology.orchestra.run.smithi045.stdout: -310> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 136 ==== osd_op_reply(2478 10000000197.00000000 [delete] v74'43 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.949 INFO:teuthology.orchestra.run.smithi045.stdout: -309> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 137 ==== osd_op_reply(2523 100000001c4.00000000 [delete] v74'44 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:25.949 INFO:teuthology.orchestra.run.smithi045.stdout: -308> 2023-10-03T19:18:12.153+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 339 ==== osd_op_reply(2336 10000000109.00000000 [delete] v74'42 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.949 INFO:teuthology.orchestra.run.smithi045.stdout: -307> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1050 ==== osd_op_reply(2501 100000001ae.00000000 [delete] v74'38 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.949 INFO:teuthology.orchestra.run.smithi045.stdout: -306> 2023-10-03T19:18:12.153+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 340 ==== osd_op_reply(2372 1000000012d.00000000 [delete] v74'43 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.949 INFO:teuthology.orchestra.run.smithi045.stdout: -305> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.6 v2:172.21.15.79:6819/1486010128 1051 ==== osd_op_reply(2562 100000001eb.00000000 [delete] v74'39 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffc400 2023-10-03T19:21:25.949 INFO:teuthology.orchestra.run.smithi045.stdout: -304> 2023-10-03T19:18:12.153+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 341 ==== osd_op_reply(2459 10000000184.00000000 [delete] v74'44 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.949 INFO:teuthology.orchestra.run.smithi045.stdout: -303> 2023-10-03T19:18:12.153+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 342 ==== osd_op_reply(2196 1000000007d.00000000 [delete] v74'22 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.950 INFO:teuthology.orchestra.run.smithi045.stdout: -302> 2023-10-03T19:18:12.153+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 343 ==== osd_op_reply(2490 100000001a3.00000000 [delete] v74'45 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.950 INFO:teuthology.orchestra.run.smithi045.stdout: -301> 2023-10-03T19:18:12.153+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 344 ==== osd_op_reply(2287 100000000d8.00000000 [delete] v74'23 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.950 INFO:teuthology.orchestra.run.smithi045.stdout: -300> 2023-10-03T19:18:12.153+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 345 ==== osd_op_reply(2491 100000001a4.00000000 [delete] v74'46 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.950 INFO:teuthology.orchestra.run.smithi045.stdout: -299> 2023-10-03T19:18:12.153+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 346 ==== osd_op_reply(2545 100000001da.00000000 [delete] v74'47 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.950 INFO:teuthology.orchestra.run.smithi045.stdout: -298> 2023-10-03T19:18:12.153+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 347 ==== osd_op_reply(2361 10000000122.00000000 [delete] v74'24 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.950 INFO:teuthology.orchestra.run.smithi045.stdout: -297> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 235 ==== osd_op_reply(2300 100000000e5.00000000 [delete] v74'45 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.950 INFO:teuthology.orchestra.run.smithi045.stdout: -296> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 236 ==== osd_op_reply(2236 100000000a5.00000000 [delete] v74'24 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.950 INFO:teuthology.orchestra.run.smithi045.stdout: -295> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 237 ==== osd_op_reply(2308 100000000ed.00000000 [delete] v74'46 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.950 INFO:teuthology.orchestra.run.smithi045.stdout: -294> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 238 ==== osd_op_reply(2229 1000000009e.00000000 [delete] v74'24 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.950 INFO:teuthology.orchestra.run.smithi045.stdout: -293> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 239 ==== osd_op_reply(2332 10000000105.00000000 [delete] v74'39 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.950 INFO:teuthology.orchestra.run.smithi045.stdout: -292> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 240 ==== osd_op_reply(2160 10000000059.00000000 [delete] v74'41 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.951 INFO:teuthology.orchestra.run.smithi045.stdout: -291> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 241 ==== osd_op_reply(2267 100000000c4.00000000 [delete] v74'25 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.951 INFO:teuthology.orchestra.run.smithi045.stdout: -290> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 242 ==== osd_op_reply(2377 10000000132.00000000 [delete] v74'34 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.951 INFO:teuthology.orchestra.run.smithi045.stdout: -289> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 243 ==== osd_op_reply(2285 100000000d6.00000000 [delete] v74'26 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.951 INFO:teuthology.orchestra.run.smithi045.stdout: -288> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 244 ==== osd_op_reply(2247 100000000b0.00000000 [delete] v74'33 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.951 INFO:teuthology.orchestra.run.smithi045.stdout: -287> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 245 ==== osd_op_reply(2404 1000000014d.00000000 [delete] v74'35 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.951 INFO:teuthology.orchestra.run.smithi045.stdout: -286> 2023-10-03T19:18:12.153+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 147 ==== osd_op_reply(2509 100000001b6.00000000 [delete] v74'27 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.951 INFO:teuthology.orchestra.run.smithi045.stdout: -285> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 246 ==== osd_op_reply(2330 10000000103.00000000 [delete] v74'42 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.951 INFO:teuthology.orchestra.run.smithi045.stdout: -284> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 247 ==== osd_op_reply(2431 10000000168.00000000 [delete] v74'35 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.951 INFO:teuthology.orchestra.run.smithi045.stdout: -283> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 248 ==== osd_op_reply(2486 1000000019f.00000000 [delete] v74'36 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.951 INFO:teuthology.orchestra.run.smithi045.stdout: -282> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 249 ==== osd_op_reply(2328 10000000101.00000000 [delete] v74'23 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.951 INFO:teuthology.orchestra.run.smithi045.stdout: -281> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 158 ==== osd_op_reply(2197 1000000007e.00000000 [delete] v74'40 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.952 INFO:teuthology.orchestra.run.smithi045.stdout: -280> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 159 ==== osd_op_reply(2126 10000000037.00000000 [delete] v74'45 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.952 INFO:teuthology.orchestra.run.smithi045.stdout: -279> 2023-10-03T19:18:12.153+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 203 ==== osd_op_reply(2410 10000000153.00000000 [delete] v74'28 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.952 INFO:teuthology.orchestra.run.smithi045.stdout: -278> 2023-10-03T19:18:12.153+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 348 ==== osd_op_reply(2193 1000000007a.00000000 [delete] v74'19 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.952 INFO:teuthology.orchestra.run.smithi045.stdout: -277> 2023-10-03T19:18:12.153+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 349 ==== osd_op_reply(2260 100000000bd.00000000 [delete] v74'20 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.952 INFO:teuthology.orchestra.run.smithi045.stdout: -276> 2023-10-03T19:18:12.153+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 350 ==== osd_op_reply(2263 100000000c0.00000000 [delete] v74'21 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.952 INFO:teuthology.orchestra.run.smithi045.stdout: -275> 2023-10-03T19:18:12.153+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 351 ==== osd_op_reply(2273 100000000ca.00000000 [delete] v74'22 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.952 INFO:teuthology.orchestra.run.smithi045.stdout: -274> 2023-10-03T19:18:12.153+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 352 ==== osd_op_reply(2385 1000000013a.00000000 [delete] v74'35 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.952 INFO:teuthology.orchestra.run.smithi045.stdout: -273> 2023-10-03T19:18:12.153+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 353 ==== osd_op_reply(2396 10000000145.00000000 [delete] v74'36 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.952 INFO:teuthology.orchestra.run.smithi045.stdout: -272> 2023-10-03T19:18:12.153+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 354 ==== osd_op_reply(2367 10000000128.00000000 [delete] v74'23 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.952 INFO:teuthology.orchestra.run.smithi045.stdout: -271> 2023-10-03T19:18:12.153+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 355 ==== osd_op_reply(2373 1000000012e.00000000 [delete] v74'24 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.952 INFO:teuthology.orchestra.run.smithi045.stdout: -270> 2023-10-03T19:18:12.153+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 356 ==== osd_op_reply(2379 10000000134.00000000 [delete] v74'25 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.953 INFO:teuthology.orchestra.run.smithi045.stdout: -269> 2023-10-03T19:18:12.153+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 148 ==== osd_op_reply(2427 10000000164.00000000 [delete] v74'46 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.953 INFO:teuthology.orchestra.run.smithi045.stdout: -268> 2023-10-03T19:18:12.153+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 149 ==== osd_op_reply(2440 10000000171.00000000 [delete] v74'47 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.953 INFO:teuthology.orchestra.run.smithi045.stdout: -267> 2023-10-03T19:18:12.153+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 150 ==== osd_op_reply(2475 10000000194.00000000 [delete] v74'48 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.953 INFO:teuthology.orchestra.run.smithi045.stdout: -266> 2023-10-03T19:18:12.153+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 357 ==== osd_op_reply(2406 1000000014f.00000000 [delete] v74'26 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.953 INFO:teuthology.orchestra.run.smithi045.stdout: -265> 2023-10-03T19:18:12.153+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 151 ==== osd_op_reply(2531 100000001cc.00000000 [delete] v74'49 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.953 INFO:teuthology.orchestra.run.smithi045.stdout: -264> 2023-10-03T19:18:12.153+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 358 ==== osd_op_reply(2425 10000000162.00000000 [delete] v74'37 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.953 INFO:teuthology.orchestra.run.smithi045.stdout: -263> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 250 ==== osd_op_reply(2118 1000000002f.00000000 [delete] v74'29 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.953 INFO:teuthology.orchestra.run.smithi045.stdout: -262> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 251 ==== osd_op_reply(2119 10000000030.00000000 [delete] v74'27 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.953 INFO:teuthology.orchestra.run.smithi045.stdout: -261> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 252 ==== osd_op_reply(2135 10000000040.00000000 [delete] v74'30 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.953 INFO:teuthology.orchestra.run.smithi045.stdout: -260> 2023-10-03T19:18:12.153+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 359 ==== osd_op_reply(2542 100000001d7.00000000 [delete] v74'38 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.953 INFO:teuthology.orchestra.run.smithi045.stdout: -259> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 253 ==== osd_op_reply(2167 10000000060.00000000 [delete] v74'28 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.954 INFO:teuthology.orchestra.run.smithi045.stdout: -258> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 254 ==== osd_op_reply(2176 10000000069.00000000 [delete] v74'29 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.954 INFO:teuthology.orchestra.run.smithi045.stdout: -257> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 255 ==== osd_op_reply(2215 10000000090.00000000 [delete] v74'31 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.954 INFO:teuthology.orchestra.run.smithi045.stdout: -256> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 256 ==== osd_op_reply(2255 100000000b8.00000000 [delete] v74'32 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.954 INFO:teuthology.orchestra.run.smithi045.stdout: -255> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 257 ==== osd_op_reply(2200 10000000081.00000000 [delete] v74'30 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.954 INFO:teuthology.orchestra.run.smithi045.stdout: -254> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 160 ==== osd_op_reply(2132 1000000003d.00000000 [delete] v74'46 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.954 INFO:teuthology.orchestra.run.smithi045.stdout: -253> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 161 ==== osd_op_reply(2137 10000000042.00000000 [delete] v74'47 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.954 INFO:teuthology.orchestra.run.smithi045.stdout: -252> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 162 ==== osd_op_reply(2383 10000000138.00000000 [delete] v74'48 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.954 INFO:teuthology.orchestra.run.smithi045.stdout: -251> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 163 ==== osd_op_reply(2455 10000000180.00000000 [delete] v74'49 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.954 INFO:teuthology.orchestra.run.smithi045.stdout: -250> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 164 ==== osd_op_reply(2458 10000000183.00000000 [delete] v74'50 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.954 INFO:teuthology.orchestra.run.smithi045.stdout: -249> 2023-10-03T19:18:12.153+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 152 ==== osd_op_reply(2539 100000001d4.00000000 [delete] v74'28 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.954 INFO:teuthology.orchestra.run.smithi045.stdout: -248> 2023-10-03T19:18:12.153+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 204 ==== osd_op_reply(2536 100000001d1.00000000 [delete] v74'29 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.955 INFO:teuthology.orchestra.run.smithi045.stdout: -247> 2023-10-03T19:18:12.153+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.5 v2:172.21.15.79:6802/2879380539 153 ==== osd_op_reply(2550 100000001df.00000000 [delete] v74'29 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffd800 2023-10-03T19:21:25.955 INFO:teuthology.orchestra.run.smithi045.stdout: -246> 2023-10-03T19:18:12.153+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 205 ==== osd_op_reply(2563 100000001ec.00000000 [delete] v74'30 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.955 INFO:teuthology.orchestra.run.smithi045.stdout: -245> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 258 ==== osd_op_reply(2278 100000000cf.00000000 [delete] v74'34 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.955 INFO:teuthology.orchestra.run.smithi045.stdout: -244> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 259 ==== osd_op_reply(2408 10000000151.00000000 [delete] v74'43 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.955 INFO:teuthology.orchestra.run.smithi045.stdout: -243> 2023-10-03T19:18:12.153+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 260 ==== osd_op_reply(2412 10000000155.00000000 [delete] v74'44 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.955 INFO:teuthology.orchestra.run.smithi045.stdout: -242> 2023-10-03T19:18:12.153+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 142 ==== osd_op_reply(2128 10000000039.00000000 [delete] v74'45 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.955 INFO:teuthology.orchestra.run.smithi045.stdout: -241> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 261 ==== osd_op_reply(2433 1000000016a.00000000 [delete] v74'45 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.955 INFO:teuthology.orchestra.run.smithi045.stdout: -240> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 262 ==== osd_op_reply(2386 1000000013b.00000000 [delete] v74'27 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.955 INFO:teuthology.orchestra.run.smithi045.stdout: -239> 2023-10-03T19:18:12.157+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 143 ==== osd_op_reply(2187 10000000074.00000000 [delete] v74'46 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.955 INFO:teuthology.orchestra.run.smithi045.stdout: -238> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 263 ==== osd_op_reply(2376 10000000131.00000000 [delete] v74'32 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.955 INFO:teuthology.orchestra.run.smithi045.stdout: -237> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 264 ==== osd_op_reply(2489 100000001a2.00000000 [delete] v74'36 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.956 INFO:teuthology.orchestra.run.smithi045.stdout: -236> 2023-10-03T19:18:12.157+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.2 v2:172.21.15.45:6817/964866005 206 ==== osd_op_reply(2566 100000001ef.00000000 [delete] v74'31 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc9409d680 con 0x55cc93ffcc00 2023-10-03T19:21:25.956 INFO:teuthology.orchestra.run.smithi045.stdout: -235> 2023-10-03T19:18:12.157+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 144 ==== osd_op_reply(2344 10000000111.00000000 [delete] v74'47 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.956 INFO:teuthology.orchestra.run.smithi045.stdout: -234> 2023-10-03T19:18:12.157+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 145 ==== osd_op_reply(2467 1000000018c.00000000 [delete] v74'50 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.956 INFO:teuthology.orchestra.run.smithi045.stdout: -233> 2023-10-03T19:18:12.157+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 146 ==== osd_op_reply(2524 100000001c5.00000000 [delete] v74'48 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.956 INFO:teuthology.orchestra.run.smithi045.stdout: -232> 2023-10-03T19:18:12.157+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 147 ==== osd_op_reply(2481 1000000019a.00000000 [delete] v74'51 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.956 INFO:teuthology.orchestra.run.smithi045.stdout: -231> 2023-10-03T19:18:12.157+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 360 ==== osd_op_reply(2477 10000000196.00000000 [delete] v74'25 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.956 INFO:teuthology.orchestra.run.smithi045.stdout: -230> 2023-10-03T19:18:12.157+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 361 ==== osd_op_reply(2556 100000001e5.00000000 [delete] v74'39 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.956 INFO:teuthology.orchestra.run.smithi045.stdout: -229> 2023-10-03T19:18:12.157+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 362 ==== osd_op_reply(2358 1000000011f.00000000 [delete] v74'51 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.956 INFO:teuthology.orchestra.run.smithi045.stdout: -228> 2023-10-03T19:18:12.157+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 363 ==== osd_op_reply(2390 1000000013f.00000000 [delete] v74'52 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.956 INFO:teuthology.orchestra.run.smithi045.stdout: -227> 2023-10-03T19:18:12.157+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 364 ==== osd_op_reply(2393 10000000142.00000000 [delete] v74'32 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.956 INFO:teuthology.orchestra.run.smithi045.stdout: -226> 2023-10-03T19:18:12.157+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 148 ==== osd_op_reply(2402 1000000014b.00000000 [delete] v74'30 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.956 INFO:teuthology.orchestra.run.smithi045.stdout: -225> 2023-10-03T19:18:12.157+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 149 ==== osd_op_reply(2485 1000000019e.00000000 [delete] v74'52 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.957 INFO:teuthology.orchestra.run.smithi045.stdout: -224> 2023-10-03T19:18:12.157+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 365 ==== osd_op_reply(2435 1000000016c.00000000 [delete] v74'53 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.957 INFO:teuthology.orchestra.run.smithi045.stdout: -223> 2023-10-03T19:18:12.157+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 366 ==== osd_op_reply(2447 10000000178.00000000 [delete] v74'33 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.957 INFO:teuthology.orchestra.run.smithi045.stdout: -222> 2023-10-03T19:18:12.157+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.7 v2:172.21.15.79:6818/3323397754 150 ==== osd_op_reply(2517 100000001be.00000000 [delete] v74'53 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffc800 2023-10-03T19:21:25.957 INFO:teuthology.orchestra.run.smithi045.stdout: -221> 2023-10-03T19:18:12.157+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 367 ==== osd_op_reply(2461 10000000186.00000000 [delete] v74'34 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.957 INFO:teuthology.orchestra.run.smithi045.stdout: -220> 2023-10-03T19:18:12.157+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 368 ==== osd_op_reply(2460 10000000185.00000000 [delete] v74'54 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.957 INFO:teuthology.orchestra.run.smithi045.stdout: -219> 2023-10-03T19:18:12.157+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 369 ==== osd_op_reply(2476 10000000195.00000000 [delete] v74'35 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.957 INFO:teuthology.orchestra.run.smithi045.stdout: -218> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 165 ==== osd_op_reply(2189 10000000076.00000000 [delete] v74'44 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.957 INFO:teuthology.orchestra.run.smithi045.stdout: -217> 2023-10-03T19:18:12.157+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 370 ==== osd_op_reply(2492 100000001a5.00000000 [delete] v74'55 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.957 INFO:teuthology.orchestra.run.smithi045.stdout: -216> 2023-10-03T19:18:12.157+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 371 ==== osd_op_reply(2554 100000001e3.00000000 [delete] v74'36 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:25.957 INFO:teuthology.orchestra.run.smithi045.stdout: -215> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 166 ==== osd_op_reply(2325 100000000fe.00000000 [delete] v74'41 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.957 INFO:teuthology.orchestra.run.smithi045.stdout: -214> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 167 ==== osd_op_reply(2219 10000000094.00000000 [delete] v74'45 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.958 INFO:teuthology.orchestra.run.smithi045.stdout: -213> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 168 ==== osd_op_reply(2378 10000000133.00000000 [delete] v74'42 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.958 INFO:teuthology.orchestra.run.smithi045.stdout: -212> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 169 ==== osd_op_reply(2158 10000000057.00000000 [delete] v74'43 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.958 INFO:teuthology.orchestra.run.smithi045.stdout: -211> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 170 ==== osd_op_reply(2185 10000000072.00000000 [delete] v74'44 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.958 INFO:teuthology.orchestra.run.smithi045.stdout: -210> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 171 ==== osd_op_reply(2205 10000000086.00000000 [delete] v74'45 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.958 INFO:teuthology.orchestra.run.smithi045.stdout: -209> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 172 ==== osd_op_reply(2223 10000000098.00000000 [delete] v74'46 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.958 INFO:teuthology.orchestra.run.smithi045.stdout: -208> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 173 ==== osd_op_reply(2321 100000000fa.00000000 [delete] v74'47 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.958 INFO:teuthology.orchestra.run.smithi045.stdout: -207> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 174 ==== osd_op_reply(2254 100000000b7.00000000 [delete] v74'46 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.958 INFO:teuthology.orchestra.run.smithi045.stdout: -206> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 175 ==== osd_op_reply(2394 10000000143.00000000 [delete] v74'48 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:25.958 INFO:teuthology.orchestra.run.smithi045.stdout: -205> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 265 ==== osd_op_reply(2295 100000000e0.00000000 [delete] v74'31 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.958 INFO:teuthology.orchestra.run.smithi045.stdout: -204> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 266 ==== osd_op_reply(2449 1000000017a.00000000 [delete] v74'28 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.958 INFO:teuthology.orchestra.run.smithi045.stdout: -203> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 267 ==== osd_op_reply(2527 100000001c8.00000000 [delete] v74'29 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.959 INFO:teuthology.orchestra.run.smithi045.stdout: -202> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 268 ==== osd_op_reply(2559 100000001e8.00000000 [delete] v74'30 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.959 INFO:teuthology.orchestra.run.smithi045.stdout: -201> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 269 ==== osd_op_reply(2561 100000001ea.00000000 [delete] v74'31 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.959 INFO:teuthology.orchestra.run.smithi045.stdout: -200> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 270 ==== osd_op_reply(2357 1000000011e.00000000 [delete] v74'40 uv34 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.959 INFO:teuthology.orchestra.run.smithi045.stdout: -199> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 271 ==== osd_op_reply(2389 1000000013e.00000000 [delete] v74'33 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.959 INFO:teuthology.orchestra.run.smithi045.stdout: -198> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 272 ==== osd_op_reply(2416 10000000159.00000000 [delete] v74'34 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.959 INFO:teuthology.orchestra.run.smithi045.stdout: -197> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 273 ==== osd_op_reply(2395 10000000144.00000000 [delete] v74'35 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.959 INFO:teuthology.orchestra.run.smithi045.stdout: -196> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 274 ==== osd_op_reply(2456 10000000181.00000000 [delete] v74'35 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.959 INFO:teuthology.orchestra.run.smithi045.stdout: -195> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 275 ==== osd_op_reply(2472 10000000191.00000000 [delete] v74'36 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.959 INFO:teuthology.orchestra.run.smithi045.stdout: -194> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 276 ==== osd_op_reply(2474 10000000193.00000000 [delete] v74'47 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.959 INFO:teuthology.orchestra.run.smithi045.stdout: -193> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 277 ==== osd_op_reply(2510 100000001b7.00000000 [delete] v74'37 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.959 INFO:teuthology.orchestra.run.smithi045.stdout: -192> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 278 ==== osd_op_reply(2484 1000000019d.00000000 [delete] v74'48 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:25.960 INFO:teuthology.orchestra.run.smithi045.stdout: -191> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 279 ==== osd_op_reply(2495 100000001a8.00000000 [delete] v74'36 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:26.087 INFO:teuthology.orchestra.run.smithi045.stdout: -190> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 280 ==== osd_op_reply(2515 100000001bc.00000000 [delete] v74'38 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:26.088 INFO:teuthology.orchestra.run.smithi045.stdout: -189> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 281 ==== osd_op_reply(2488 100000001a1.00000000 [delete] v74'49 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:26.088 INFO:teuthology.orchestra.run.smithi045.stdout: -188> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 282 ==== osd_op_reply(2504 100000001b1.00000000 [delete] v74'50 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:26.088 INFO:teuthology.orchestra.run.smithi045.stdout: -187> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 283 ==== osd_op_reply(2538 100000001d3.00000000 [delete] v74'24 uv20 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:26.088 INFO:teuthology.orchestra.run.smithi045.stdout: -186> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 284 ==== osd_op_reply(2543 100000001d8.00000000 [delete] v74'51 uv36 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:26.088 INFO:teuthology.orchestra.run.smithi045.stdout: -185> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 285 ==== osd_op_reply(2423 10000000160.00000000 [delete] v74'25 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:26.088 INFO:teuthology.orchestra.run.smithi045.stdout: -184> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 286 ==== osd_op_reply(2432 10000000169.00000000 [delete] v74'26 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:26.088 INFO:teuthology.orchestra.run.smithi045.stdout: -183> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 138 ==== osd_op_reply(2224 10000000099.00000000 [delete] v74'43 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:26.088 INFO:teuthology.orchestra.run.smithi045.stdout: -182> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 139 ==== osd_op_reply(2274 100000000cb.00000000 [delete] v74'34 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:26.088 INFO:teuthology.orchestra.run.smithi045.stdout: -181> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 140 ==== osd_op_reply(2356 1000000011d.00000000 [delete] v74'35 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:26.088 INFO:teuthology.orchestra.run.smithi045.stdout: -180> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 141 ==== osd_op_reply(2399 10000000148.00000000 [delete] v74'44 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:26.088 INFO:teuthology.orchestra.run.smithi045.stdout: -179> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 142 ==== osd_op_reply(2436 1000000016d.00000000 [delete] v74'36 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:26.089 INFO:teuthology.orchestra.run.smithi045.stdout: -178> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 176 ==== osd_op_reply(2291 100000000dc.00000000 [delete] v74'47 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:26.089 INFO:teuthology.orchestra.run.smithi045.stdout: -177> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 177 ==== osd_op_reply(2493 100000001a6.00000000 [delete] v74'49 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:26.089 INFO:teuthology.orchestra.run.smithi045.stdout: -176> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 178 ==== osd_op_reply(2161 1000000005a.00000000 [delete] v74'46 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:26.089 INFO:teuthology.orchestra.run.smithi045.stdout: -175> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 179 ==== osd_op_reply(2498 100000001ab.00000000 [delete] v74'50 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:26.089 INFO:teuthology.orchestra.run.smithi045.stdout: -174> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 180 ==== osd_op_reply(2505 100000001b2.00000000 [delete] v74'51 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:26.089 INFO:teuthology.orchestra.run.smithi045.stdout: -173> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 181 ==== osd_op_reply(2549 100000001de.00000000 [delete] v74'52 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:26.089 INFO:teuthology.orchestra.run.smithi045.stdout: -172> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 182 ==== osd_op_reply(2310 100000000ef.00000000 [delete] v74'48 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:26.089 INFO:teuthology.orchestra.run.smithi045.stdout: -171> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 183 ==== osd_op_reply(2261 100000000be.00000000 [delete] v74'47 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:26.089 INFO:teuthology.orchestra.run.smithi045.stdout: -170> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 184 ==== osd_op_reply(2426 10000000163.00000000 [delete] v74'43 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:26.089 INFO:teuthology.orchestra.run.smithi045.stdout: -169> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 185 ==== osd_op_reply(2264 100000000c1.00000000 [delete] v74'48 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:26.090 INFO:teuthology.orchestra.run.smithi045.stdout: -168> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 186 ==== osd_op_reply(2315 100000000f4.00000000 [delete] v74'49 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:26.090 INFO:teuthology.orchestra.run.smithi045.stdout: -167> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 187 ==== osd_op_reply(2544 100000001d9.00000000 [delete] v74'51 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:26.090 INFO:teuthology.orchestra.run.smithi045.stdout: -166> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 188 ==== osd_op_reply(2286 100000000d7.00000000 [delete] v74'49 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:26.090 INFO:teuthology.orchestra.run.smithi045.stdout: -165> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 189 ==== osd_op_reply(2487 100000001a0.00000000 [delete] v74'44 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:26.090 INFO:teuthology.orchestra.run.smithi045.stdout: -164> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 190 ==== osd_op_reply(2381 10000000136.00000000 [delete] v74'50 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:26.090 INFO:teuthology.orchestra.run.smithi045.stdout: -163> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 191 ==== osd_op_reply(2530 100000001cb.00000000 [delete] v74'45 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:26.090 INFO:teuthology.orchestra.run.smithi045.stdout: -162> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 192 ==== osd_op_reply(2326 100000000ff.00000000 [delete] v74'50 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:26.090 INFO:teuthology.orchestra.run.smithi045.stdout: -161> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 193 ==== osd_op_reply(2454 1000000017f.00000000 [delete] v74'51 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:26.090 INFO:teuthology.orchestra.run.smithi045.stdout: -160> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 194 ==== osd_op_reply(2464 10000000189.00000000 [delete] v74'52 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:26.090 INFO:teuthology.orchestra.run.smithi045.stdout: -159> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 287 ==== osd_op_reply(2534 100000001cf.00000000 [delete] v74'27 uv22 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:26.090 INFO:teuthology.orchestra.run.smithi045.stdout: -158> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 143 ==== osd_op_reply(2503 100000001b0.00000000 [delete] v74'45 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:26.091 INFO:teuthology.orchestra.run.smithi045.stdout: -157> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 144 ==== osd_op_reply(2521 100000001c2.00000000 [delete] v74'46 uv38 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:26.091 INFO:teuthology.orchestra.run.smithi045.stdout: -156> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 145 ==== osd_op_reply(2441 10000000172.00000000 [delete] v74'37 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:26.091 INFO:teuthology.orchestra.run.smithi045.stdout: -155> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.3 v2:172.21.15.45:6816/4227059688 146 ==== osd_op_reply(2565 100000001ee.00000000 [delete] v74'38 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffdc00 2023-10-03T19:21:26.091 INFO:teuthology.orchestra.run.smithi045.stdout: -154> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 288 ==== osd_op_reply(2518 100000001bf.00000000 [delete] v74'39 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:26.091 INFO:teuthology.orchestra.run.smithi045.stdout: -153> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 289 ==== osd_op_reply(2519 100000001c0.00000000 [delete] v74'40 uv30 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:26.091 INFO:teuthology.orchestra.run.smithi045.stdout: -152> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 290 ==== osd_op_reply(2350 10000000117.00000000 [delete] v74'33 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:26.091 INFO:teuthology.orchestra.run.smithi045.stdout: -151> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 291 ==== osd_op_reply(2352 10000000119.00000000 [delete] v74'32 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:26.091 INFO:teuthology.orchestra.run.smithi045.stdout: -150> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 195 ==== osd_op_reply(2329 10000000102.00000000 [delete] v74'51 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:26.091 INFO:teuthology.orchestra.run.smithi045.stdout: -149> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 292 ==== osd_op_reply(2448 10000000179.00000000 [delete] v74'34 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:26.091 INFO:teuthology.orchestra.run.smithi045.stdout: -148> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 196 ==== osd_op_reply(2469 1000000018e.00000000 [delete] v74'52 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:26.091 INFO:teuthology.orchestra.run.smithi045.stdout: -147> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 293 ==== osd_op_reply(2450 1000000017b.00000000 [delete] v74'35 uv28 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:26.092 INFO:teuthology.orchestra.run.smithi045.stdout: -146> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 197 ==== osd_op_reply(2482 1000000019b.00000000 [delete] v74'53 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:26.092 INFO:teuthology.orchestra.run.smithi045.stdout: -145> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 294 ==== osd_op_reply(2424 10000000161.00000000 [delete] v74'33 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:26.092 INFO:teuthology.orchestra.run.smithi045.stdout: -144> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 198 ==== osd_op_reply(2497 100000001aa.00000000 [delete] v74'54 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:26.092 INFO:teuthology.orchestra.run.smithi045.stdout: -143> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 199 ==== osd_op_reply(2500 100000001ad.00000000 [delete] v74'55 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:26.092 INFO:teuthology.orchestra.run.smithi045.stdout: -142> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 200 ==== osd_op_reply(2555 100000001e4.00000000 [delete] v74'56 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:26.092 INFO:teuthology.orchestra.run.smithi045.stdout: -141> 2023-10-03T19:18:12.157+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.1 v2:172.21.15.45:6808/1433143371 201 ==== osd_op_reply(2567 100000001f0.00000000 [delete] v74'57 uv42 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc9410e000 2023-10-03T19:21:26.092 INFO:teuthology.orchestra.run.smithi045.stdout: -140> 2023-10-03T19:18:12.157+0000 7f5aadf1a640 10 MDSIOContextBase::complete: 19MDSIOContextWrapper 2023-10-03T19:21:26.092 INFO:teuthology.orchestra.run.smithi045.stdout: -139> 2023-10-03T19:18:12.157+0000 7f5aadf1a640 10 MDSContext::complete: 19MDSIOContextWrapper 2023-10-03T19:21:26.092 INFO:teuthology.orchestra.run.smithi045.stdout: -138> 2023-10-03T19:18:12.157+0000 7f5aadf1a640 10 mds.0.inotable: project_release_ids [0x10000000002~0x1f4] to [0x100000005dd~0xfffffffa23]/[0x100000005dd~0xfffffffa23] 2023-10-03T19:21:26.092 INFO:teuthology.orchestra.run.smithi045.stdout: -137> 2023-10-03T19:18:12.157+0000 7f5aad719640 5 mds.0.log _submit_thread 10058365~56 : Eurged 500 inos, inotable v6 2023-10-03T19:21:26.092 INFO:teuthology.orchestra.run.smithi045.stdout: -136> 2023-10-03T19:18:12.157+0000 7f5aad719640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.33:2573 11.1b 11:ddb4e4d7:::200.00000002:head [write 1669757~76 [fadvise_dontneed] in=76b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc947d9880 con 0x55cc93ffd400 2023-10-03T19:21:26.093 INFO:teuthology.orchestra.run.smithi045.stdout: -135> 2023-10-03T19:18:12.161+0000 7f5ab6f2c640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.4 v2:172.21.15.79:6810/2234162464 372 ==== osd_op_reply(2573 200.00000002 [write 1669757~76 [fadvise_dontneed]] v74'174 uv174 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55cc947dc6c0 con 0x55cc93ffd400 2023-10-03T19:21:26.093 INFO:teuthology.orchestra.run.smithi045.stdout: -134> 2023-10-03T19:18:12.161+0000 7f5aadf1a640 10 MDSIOContextBase::complete: 28C_MDS_purge_completed_finish 2023-10-03T19:21:26.093 INFO:teuthology.orchestra.run.smithi045.stdout: -133> 2023-10-03T19:18:12.161+0000 7f5aadf1a640 10 MDSContext::complete: 28C_MDS_purge_completed_finish 2023-10-03T19:21:26.093 INFO:teuthology.orchestra.run.smithi045.stdout: -132> 2023-10-03T19:18:12.161+0000 7f5aadf1a640 10 mds.0.inotable: apply_release_ids [0x10000000002~0x1f4] to [0x10000000002~0x1f4,0x100000005dd~0xfffffffa23]/[0x100000005dd~0xfffffffa23] 2023-10-03T19:21:26.093 INFO:teuthology.orchestra.run.smithi045.stdout: -131> 2023-10-03T19:18:12.541+0000 7f5aaff1e640 2 mds.0.cache Memory usage: total 303888, rss 57152, heap 207144, baseline 190760, 0 / 914 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:26.093 INFO:teuthology.orchestra.run.smithi045.stdout: -130> 2023-10-03T19:18:12.541+0000 7f5aaff1e640 20 mds.0.cache upkeep thread trimming cache; last trim 1.007988095s ago 2023-10-03T19:21:26.093 INFO:teuthology.orchestra.run.smithi045.stdout: -129> 2023-10-03T19:18:12.541+0000 7f5aaff1e640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:26.093 INFO:teuthology.orchestra.run.smithi045.stdout: -128> 2023-10-03T19:18:12.541+0000 7f5aaff1e640 7 mds.0.cache trim bytes_used=2MB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:26.093 INFO:teuthology.orchestra.run.smithi045.stdout: -127> 2023-10-03T19:18:12.541+0000 7f5aaff1e640 7 mds.0.cache trim_lru trimming 0 items from LRU size=911 mid=630 pintail=11 pinned=11 2023-10-03T19:21:26.093 INFO:teuthology.orchestra.run.smithi045.stdout: -126> 2023-10-03T19:18:12.541+0000 7f5aaff1e640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:26.093 INFO:teuthology.orchestra.run.smithi045.stdout: -125> 2023-10-03T19:18:12.541+0000 7f5aaff1e640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:26.094 INFO:teuthology.orchestra.run.smithi045.stdout: -124> 2023-10-03T19:18:12.541+0000 7f5aaff1e640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:26.094 INFO:teuthology.orchestra.run.smithi045.stdout: -123> 2023-10-03T19:18:12.541+0000 7f5aaff1e640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:26.094 INFO:teuthology.orchestra.run.smithi045.stdout: -122> 2023-10-03T19:18:13.005+0000 7f5ab2f24640 10 monclient: tick 2023-10-03T19:21:26.094 INFO:teuthology.orchestra.run.smithi045.stdout: -121> 2023-10-03T19:18:13.005+0000 7f5ab2f24640 10 monclient: _check_auth_tickets 2023-10-03T19:21:26.094 INFO:teuthology.orchestra.run.smithi045.stdout: -120> 2023-10-03T19:18:13.005+0000 7f5ab2f24640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:17:43.006636+0000) 2023-10-03T19:21:26.094 INFO:teuthology.orchestra.run.smithi045.stdout: -119> 2023-10-03T19:18:13.501+0000 7f5ab2723640 20 mds.0.33 get_task_status 2023-10-03T19:21:26.094 INFO:teuthology.orchestra.run.smithi045.stdout: -118> 2023-10-03T19:18:13.501+0000 7f5ab2723640 20 mds.0.33 schedule_update_timer_task 2023-10-03T19:21:26.094 INFO:teuthology.orchestra.run.smithi045.stdout: -117> 2023-10-03T19:18:13.541+0000 7f5aaff1e640 2 mds.0.cache Memory usage: total 303888, rss 57152, heap 207144, baseline 190760, 0 / 914 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:26.094 INFO:teuthology.orchestra.run.smithi045.stdout: -116> 2023-10-03T19:18:13.541+0000 7f5aaff1e640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999988139s ago 2023-10-03T19:21:26.094 INFO:teuthology.orchestra.run.smithi045.stdout: -115> 2023-10-03T19:18:13.541+0000 7f5aaff1e640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:26.094 INFO:teuthology.orchestra.run.smithi045.stdout: -114> 2023-10-03T19:18:13.541+0000 7f5aaff1e640 7 mds.0.cache trim bytes_used=2MB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:26.094 INFO:teuthology.orchestra.run.smithi045.stdout: -113> 2023-10-03T19:18:13.541+0000 7f5aaff1e640 7 mds.0.cache trim_lru trimming 0 items from LRU size=911 mid=630 pintail=11 pinned=11 2023-10-03T19:21:26.095 INFO:teuthology.orchestra.run.smithi045.stdout: -112> 2023-10-03T19:18:13.541+0000 7f5aaff1e640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:26.095 INFO:teuthology.orchestra.run.smithi045.stdout: -111> 2023-10-03T19:18:13.541+0000 7f5aaff1e640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:26.095 INFO:teuthology.orchestra.run.smithi045.stdout: -110> 2023-10-03T19:18:13.541+0000 7f5aaff1e640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:26.095 INFO:teuthology.orchestra.run.smithi045.stdout: -109> 2023-10-03T19:18:13.541+0000 7f5aaff1e640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:26.095 INFO:teuthology.orchestra.run.smithi045.stdout: -108> 2023-10-03T19:18:13.645+0000 7f5aacf18640 20 update_rank0: mds.metrics 2023-10-03T19:21:26.095 INFO:teuthology.orchestra.run.smithi045.stdout: -107> 2023-10-03T19:18:13.645+0000 7f5aacf18640 20 update_rank0: mds.metrics: sending metric updates for 1 clients to rank 0 (address: [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026]) with sequence number 7, last updated sequence number 17 2023-10-03T19:21:26.095 INFO:teuthology.orchestra.run.smithi045.stdout: -106> 2023-10-03T19:18:13.645+0000 7f5aacf18640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] send_to--> mds [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] -- mds_metrics from rank=0 carrying 1 metric updates v1 -- ?+0 0x55cc93fff980 2023-10-03T19:21:26.095 INFO:teuthology.orchestra.run.smithi045.stdout: -105> 2023-10-03T19:18:13.645+0000 7f5aacf18640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] -- mds_metrics from rank=0 carrying 1 metric updates v1 -- 0x55cc93fff980 con 0x55cc930c1c00 2023-10-03T19:21:26.095 INFO:teuthology.orchestra.run.smithi045.stdout: -104> 2023-10-03T19:18:13.645+0000 7f5ab3725640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== mds.0 v2:172.21.15.45:6833/2939002026 0 ==== mds_metrics from rank=0 carrying 1 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x55cc93fff980 con 0x55cc930c1c00 2023-10-03T19:21:26.095 INFO:teuthology.orchestra.run.smithi045.stdout: -103> 2023-10-03T19:18:13.645+0000 7f5ab3725640 20 mds.metric.aggregator handle_mds_metrics: applying 1 updates for rank=0 with sequence number 7 2023-10-03T19:21:26.095 INFO:teuthology.orchestra.run.smithi045.stdout: -102> 2023-10-03T19:18:13.645+0000 7f5ab3725640 10 mds.pinger pong_received: rank=0, sequence=7 2023-10-03T19:21:26.095 INFO:teuthology.orchestra.run.smithi045.stdout: -101> 2023-10-03T19:18:13.645+0000 7f5ab3725640 20 mds.metric.aggregator remove_metrics_for_rank: client=client.5929 172.21.15.146:0/3047788495, rank=0 2023-10-03T19:21:26.096 INFO:teuthology.orchestra.run.smithi045.stdout: -100> 2023-10-03T19:18:13.645+0000 7f5ab3725640 20 mds.metric.aggregator remove_metrics_for_rank: rank=0 has 0 connected client(s) 2023-10-03T19:21:26.096 INFO:teuthology.orchestra.run.smithi045.stdout: -99> 2023-10-03T19:18:14.005+0000 7f5ab2f24640 10 monclient: tick 2023-10-03T19:21:26.096 INFO:teuthology.orchestra.run.smithi045.stdout: -98> 2023-10-03T19:18:14.005+0000 7f5ab2f24640 10 monclient: _check_auth_tickets 2023-10-03T19:21:26.096 INFO:teuthology.orchestra.run.smithi045.stdout: -97> 2023-10-03T19:18:14.005+0000 7f5ab2f24640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:17:44.006730+0000) 2023-10-03T19:21:26.096 INFO:teuthology.orchestra.run.smithi045.stdout: -96> 2023-10-03T19:18:14.541+0000 7f5aaff1e640 2 mds.0.cache Memory usage: total 303888, rss 57152, heap 207144, baseline 190760, 0 / 914 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:26.096 INFO:teuthology.orchestra.run.smithi045.stdout: -95> 2023-10-03T19:18:14.541+0000 7f5aaff1e640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999988139s ago 2023-10-03T19:21:26.096 INFO:teuthology.orchestra.run.smithi045.stdout: -94> 2023-10-03T19:18:14.541+0000 7f5aaff1e640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:26.096 INFO:teuthology.orchestra.run.smithi045.stdout: -93> 2023-10-03T19:18:14.541+0000 7f5aaff1e640 7 mds.0.cache trim bytes_used=2MB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:26.096 INFO:teuthology.orchestra.run.smithi045.stdout: -92> 2023-10-03T19:18:14.541+0000 7f5aaff1e640 7 mds.0.cache trim_lru trimming 0 items from LRU size=911 mid=630 pintail=11 pinned=11 2023-10-03T19:21:26.096 INFO:teuthology.orchestra.run.smithi045.stdout: -91> 2023-10-03T19:18:14.541+0000 7f5aaff1e640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:26.097 INFO:teuthology.orchestra.run.smithi045.stdout: -90> 2023-10-03T19:18:14.541+0000 7f5aaff1e640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:26.097 INFO:teuthology.orchestra.run.smithi045.stdout: -89> 2023-10-03T19:18:14.541+0000 7f5aaff1e640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:26.097 INFO:teuthology.orchestra.run.smithi045.stdout: -88> 2023-10-03T19:18:14.541+0000 7f5aaff1e640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:26.097 INFO:teuthology.orchestra.run.smithi045.stdout: -87> 2023-10-03T19:18:15.001+0000 7f5ab2723640 10 mds.0.log trim 1 / 128 segments, 3 / -1 events, 0 (0) expiring, 0 (0) expired 2023-10-03T19:21:26.097 INFO:teuthology.orchestra.run.smithi045.stdout: -86> 2023-10-03T19:18:15.001+0000 7f5ab2723640 10 mds.0.openfiles commit log_seq 3011 committing_log_seq:3011 2023-10-03T19:21:26.097 INFO:teuthology.orchestra.run.smithi045.stdout: -85> 2023-10-03T19:18:15.001+0000 7f5ab2723640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.33:2574 11.6 11:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b,omap-rm-keys in=24b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74) v8 -- 0x55cc947c7c00 con 0x55cc93ffd000 2023-10-03T19:21:26.097 INFO:teuthology.orchestra.run.smithi045.stdout: -84> 2023-10-03T19:18:15.001+0000 7f5ab2723640 10 mds.0.log _trim_expired_segments waiting for 3011/10057300 to expire 2023-10-03T19:21:26.097 INFO:teuthology.orchestra.run.smithi045.stdout: -83> 2023-10-03T19:18:15.001+0000 7f5ab2723640 10 mds.0.server find_idle_sessions. last cleared laggy state 1141.39s ago 2023-10-03T19:21:26.097 INFO:teuthology.orchestra.run.smithi045.stdout: -82> 2023-10-03T19:18:15.001+0000 7f5ab2723640 10 mds.0.locker scatter_tick 2023-10-03T19:21:26.097 INFO:teuthology.orchestra.run.smithi045.stdout: -81> 2023-10-03T19:18:15.001+0000 7f5ab2723640 20 mds.0.locker caps_tick 0 revoking caps 2023-10-03T19:21:26.097 INFO:teuthology.orchestra.run.smithi045.stdout: -80> 2023-10-03T19:18:15.001+0000 7f5ab2723640 20 mds.0.bal handle_export_pins export_pin_queue size=0 2023-10-03T19:21:26.097 INFO:teuthology.orchestra.run.smithi045.stdout: -79> 2023-10-03T19:18:15.001+0000 7f5ab2723640 15 mds.0.bal tick tick last_sample now 1141.391158s 2023-10-03T19:21:26.097 INFO:teuthology.orchestra.run.smithi045.stdout: -78> 2023-10-03T19:18:15.001+0000 7f5ab2723640 15 mds.0.cache show_subtrees 2023-10-03T19:21:26.098 INFO:teuthology.orchestra.run.smithi045.stdout: -77> 2023-10-03T19:18:15.001+0000 7f5ab2723640 10 mds.0.cache |__ 0 auth [dir 0x1 / [2,head] auth v=6007 cv=6007/6007 REP dir_auth=0 state=1073741825|complete f(v0 m2023-10-03T19:17:45.846763+0000 1=0+1) n(v3 rc2023-10-03T19:17:58.405153+0000 b2890 1001=1000+1) hs=1+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312ed00] 2023-10-03T19:21:26.098 INFO:teuthology.orchestra.run.smithi045.stdout: -76> 2023-10-03T19:18:15.001+0000 7f5ab2723640 10 mds.0.cache |__ 0 auth [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:17:35.503088+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55cc9312f180] 2023-10-03T19:21:26.098 INFO:teuthology.orchestra.run.smithi045.stdout: -75> 2023-10-03T19:18:15.001+0000 7f5ab2723640 10 mds.0.cache find_stale_fragment_freeze 2023-10-03T19:21:26.098 INFO:teuthology.orchestra.run.smithi045.stdout: -74> 2023-10-03T19:18:15.001+0000 7f5ab2723640 10 mds.0.snap check_osd_map - version unchanged 2023-10-03T19:21:26.098 INFO:teuthology.orchestra.run.smithi045.stdout: -73> 2023-10-03T19:18:15.001+0000 7f5ab2723640 20 mds.0.33 updating export targets, currently 0 ranks are targets 2023-10-03T19:21:26.098 INFO:teuthology.orchestra.run.smithi045.stdout: -72> 2023-10-03T19:18:15.005+0000 7f5ab2f24640 10 monclient: tick 2023-10-03T19:21:26.098 INFO:teuthology.orchestra.run.smithi045.stdout: -71> 2023-10-03T19:18:15.005+0000 7f5ab2f24640 10 monclient: _check_auth_tickets 2023-10-03T19:21:26.098 INFO:teuthology.orchestra.run.smithi045.stdout: -70> 2023-10-03T19:18:15.005+0000 7f5ab2f24640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:17:45.006810+0000) 2023-10-03T19:21:26.098 INFO:teuthology.orchestra.run.smithi045.stdout: -69> 2023-10-03T19:18:15.005+0000 7f5ab772d640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== osd.0 v2:172.21.15.45:6800/1057586985 295 ==== osd_op_reply(2574 mds0_openfiles.0 [omap-set-header,omap-rm-keys] v74'7 uv7 ondisk = 0) v8 ==== 202+0+0 (crc 0 0 0) 0x55cc945b5440 con 0x55cc93ffd000 2023-10-03T19:21:26.098 INFO:teuthology.orchestra.run.smithi045.stdout: -68> 2023-10-03T19:18:15.005+0000 7f5aadf1a640 10 MDSIOContextBase::complete: 13C_IO_OFT_Save 2023-10-03T19:21:26.098 INFO:teuthology.orchestra.run.smithi045.stdout: -67> 2023-10-03T19:18:15.005+0000 7f5aadf1a640 10 MDSContext::complete: 13C_IO_OFT_Save 2023-10-03T19:21:26.099 INFO:teuthology.orchestra.run.smithi045.stdout: -66> 2023-10-03T19:18:15.005+0000 7f5aadf1a640 10 mds.0.openfiles _commit_finish log_seq 3011 committed_log_seq 3011 committing_log_seq 3011 2023-10-03T19:21:26.099 INFO:teuthology.orchestra.run.smithi045.stdout: -65> 2023-10-03T19:18:15.005+0000 7f5aadf1a640 10 MDSContext::complete: 15C_OFT_Committed 2023-10-03T19:21:26.099 INFO:teuthology.orchestra.run.smithi045.stdout: -64> 2023-10-03T19:18:15.005+0000 7f5aadf1a640 10 mds.0.log _trim_expired_segments waiting for 3011/10057300 to expire 2023-10-03T19:21:26.099 INFO:teuthology.orchestra.run.smithi045.stdout: -63> 2023-10-03T19:18:15.501+0000 7f5ab2723640 20 mds.0.33 get_task_status 2023-10-03T19:21:26.099 INFO:teuthology.orchestra.run.smithi045.stdout: -62> 2023-10-03T19:18:15.501+0000 7f5ab2723640 20 mds.0.33 schedule_update_timer_task 2023-10-03T19:21:26.099 INFO:teuthology.orchestra.run.smithi045.stdout: -61> 2023-10-03T19:18:15.541+0000 7f5aaff1e640 2 mds.0.cache Memory usage: total 303888, rss 57152, heap 207144, baseline 190760, 0 / 914 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:26.099 INFO:teuthology.orchestra.run.smithi045.stdout: -60> 2023-10-03T19:18:15.541+0000 7f5aaff1e640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999988198s ago 2023-10-03T19:21:26.099 INFO:teuthology.orchestra.run.smithi045.stdout: -59> 2023-10-03T19:18:15.541+0000 7f5aaff1e640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:26.099 INFO:teuthology.orchestra.run.smithi045.stdout: -58> 2023-10-03T19:18:15.541+0000 7f5aaff1e640 7 mds.0.cache trim bytes_used=2MB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:26.099 INFO:teuthology.orchestra.run.smithi045.stdout: -57> 2023-10-03T19:18:15.541+0000 7f5aaff1e640 7 mds.0.cache trim_lru trimming 0 items from LRU size=911 mid=630 pintail=11 pinned=11 2023-10-03T19:21:26.099 INFO:teuthology.orchestra.run.smithi045.stdout: -56> 2023-10-03T19:18:15.541+0000 7f5aaff1e640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:26.099 INFO:teuthology.orchestra.run.smithi045.stdout: -55> 2023-10-03T19:18:15.541+0000 7f5aaff1e640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:26.099 INFO:teuthology.orchestra.run.smithi045.stdout: -54> 2023-10-03T19:18:15.541+0000 7f5aaff1e640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:26.100 INFO:teuthology.orchestra.run.smithi045.stdout: -53> 2023-10-03T19:18:15.541+0000 7f5aaff1e640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:26.100 INFO:teuthology.orchestra.run.smithi045.stdout: -52> 2023-10-03T19:18:15.573+0000 7f5ab1f22640 5 mds.beacon.a Sending beacon up:active seq 13 2023-10-03T19:21:26.100 INFO:teuthology.orchestra.run.smithi045.stdout: -51> 2023-10-03T19:18:15.573+0000 7f5ab1f22640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.100 INFO:teuthology.orchestra.run.smithi045.stdout: -50> 2023-10-03T19:18:15.573+0000 7f5ab1f22640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mdsbeacon(6342/a up:active seq=13 v36) v8 -- 0x55cc94796840 con 0x55cc930c1400 2023-10-03T19:21:26.100 INFO:teuthology.orchestra.run.smithi045.stdout: -49> 2023-10-03T19:18:15.573+0000 7f5ab1f22640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:26.100 INFO:teuthology.orchestra.run.smithi045.stdout: -48> 2023-10-03T19:18:15.573+0000 7f5ab672b640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== mon.0 v2:172.21.15.45:3300/0 63 ==== mdsbeacon(6342/a up:active seq=13 v36) v8 ==== 130+0+0 (secure 0 0 0) 0x55cc94796840 con 0x55cc930c1400 2023-10-03T19:21:26.100 INFO:teuthology.orchestra.run.smithi045.stdout: -47> 2023-10-03T19:18:15.573+0000 7f5ab672b640 5 mds.beacon.a received beacon reply up:active seq 13 rtt 0 2023-10-03T19:21:26.100 INFO:teuthology.orchestra.run.smithi045.stdout: -46> 2023-10-03T19:18:15.573+0000 7f5ab1f22640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:26.100 INFO:teuthology.orchestra.run.smithi045.stdout: -45> 2023-10-03T19:18:15.641+0000 7f5aac717640 10 mds.metric.aggregator ping_all_active_ranks: pinging 1 active mds(s) 2023-10-03T19:21:26.100 INFO:teuthology.orchestra.run.smithi045.stdout: -44> 2023-10-03T19:18:15.641+0000 7f5aac717640 20 mds.metric.aggregator ping_all_active_ranks: pinging rank=0 addr=[v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] 2023-10-03T19:21:26.100 INFO:teuthology.orchestra.run.smithi045.stdout: -43> 2023-10-03T19:18:15.641+0000 7f5aac717640 10 mds.pinger send_ping: rank=0 2023-10-03T19:21:26.101 INFO:teuthology.orchestra.run.smithi045.stdout: -42> 2023-10-03T19:18:15.641+0000 7f5aac717640 10 mds.pinger send_ping: sending ping with sequence=8 to rank=0 2023-10-03T19:21:26.101 INFO:teuthology.orchestra.run.smithi045.stdout: -41> 2023-10-03T19:18:15.641+0000 7f5aac717640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] send_to--> mds [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] -- mdsping v1 -- ?+0 0x55cc93192500 2023-10-03T19:21:26.101 INFO:teuthology.orchestra.run.smithi045.stdout: -40> 2023-10-03T19:18:15.645+0000 7f5aac717640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] -- mdsping v1 -- 0x55cc93192500 con 0x55cc930c1c00 2023-10-03T19:21:26.101 INFO:teuthology.orchestra.run.smithi045.stdout: -39> 2023-10-03T19:18:15.645+0000 7f5ab3725640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== mds.0 v2:172.21.15.45:6833/2939002026 0 ==== mdsping v1 ==== 0+0+0 (unknown 0 0 0) 0x55cc93192500 con 0x55cc930c1c00 2023-10-03T19:21:26.101 INFO:teuthology.orchestra.run.smithi045.stdout: -38> 2023-10-03T19:18:15.645+0000 7f5ab3725640 20 set_next_seq: mds.metrics: current sequence number 7, setting next sequence number 8 2023-10-03T19:21:26.101 INFO:teuthology.orchestra.run.smithi045.stdout: -37> 2023-10-03T19:18:15.645+0000 7f5aacf18640 20 update_rank0: mds.metrics 2023-10-03T19:21:26.101 INFO:teuthology.orchestra.run.smithi045.stdout: -36> 2023-10-03T19:18:15.645+0000 7f5aacf18640 20 update_rank0: mds.metrics: sending metric updates for 0 clients to rank 0 (address: [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026]) with sequence number 8, last updated sequence number 18 2023-10-03T19:21:26.101 INFO:teuthology.orchestra.run.smithi045.stdout: -35> 2023-10-03T19:18:15.645+0000 7f5aacf18640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] send_to--> mds [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] -- mds_metrics from rank=0 carrying 0 metric updates v1 -- ?+0 0x55cc93fff500 2023-10-03T19:21:26.101 INFO:teuthology.orchestra.run.smithi045.stdout: -34> 2023-10-03T19:18:15.645+0000 7f5aacf18640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] -- mds_metrics from rank=0 carrying 0 metric updates v1 -- 0x55cc93fff500 con 0x55cc930c1c00 2023-10-03T19:21:26.101 INFO:teuthology.orchestra.run.smithi045.stdout: -33> 2023-10-03T19:18:15.645+0000 7f5ab3725640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== mds.0 v2:172.21.15.45:6833/2939002026 0 ==== mds_metrics from rank=0 carrying 0 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x55cc93fff500 con 0x55cc930c1c00 2023-10-03T19:21:26.101 INFO:teuthology.orchestra.run.smithi045.stdout: -32> 2023-10-03T19:18:15.645+0000 7f5ab3725640 20 mds.metric.aggregator handle_mds_metrics: applying 0 updates for rank=0 with sequence number 8 2023-10-03T19:21:26.102 INFO:teuthology.orchestra.run.smithi045.stdout: -31> 2023-10-03T19:18:15.645+0000 7f5ab3725640 10 mds.pinger pong_received: rank=0, sequence=8 2023-10-03T19:21:26.102 INFO:teuthology.orchestra.run.smithi045.stdout: -30> 2023-10-03T19:18:15.905+0000 7f5ab1721640 10 mds.pinger is_rank_lagging: rank=0 2023-10-03T19:21:26.102 INFO:teuthology.orchestra.run.smithi045.stdout: -29> 2023-10-03T19:18:15.905+0000 7f5ab1721640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgrreport(unknown.a +0-0 packed 1558) v9 -- 0x55cc947d8700 con 0x55cc93e55800 2023-10-03T19:21:26.102 INFO:teuthology.orchestra.run.smithi045.stdout: -28> 2023-10-03T19:18:16.005+0000 7f5ab2f24640 10 monclient: tick 2023-10-03T19:21:26.102 INFO:teuthology.orchestra.run.smithi045.stdout: -27> 2023-10-03T19:18:16.005+0000 7f5ab2f24640 10 monclient: _check_auth_tickets 2023-10-03T19:21:26.102 INFO:teuthology.orchestra.run.smithi045.stdout: -26> 2023-10-03T19:18:16.005+0000 7f5ab2f24640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:17:46.006923+0000) 2023-10-03T19:21:26.102 INFO:teuthology.orchestra.run.smithi045.stdout: -25> 2023-10-03T19:18:16.113+0000 7f5ab3f26640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== mon.0 v2:172.21.15.45:3300/0 64 ==== osd_map(75..75 src has 1..75) v4 ==== 374+0+0 (secure 0 0 0) 0x55cc93101c00 con 0x55cc930c1400 2023-10-03T19:21:26.102 INFO:teuthology.orchestra.run.smithi045.stdout: -24> 2023-10-03T19:18:16.113+0000 7f5ab3f26640 10 mds.0.snap check_osd_map need_to_purge={} 2023-10-03T19:21:26.102 INFO:teuthology.orchestra.run.smithi045.stdout: -23> 2023-10-03T19:18:16.113+0000 7f5ab3f26640 7 mds.0.server operator(): full = 0 epoch = 75 2023-10-03T19:21:26.102 INFO:teuthology.orchestra.run.smithi045.stdout: -22> 2023-10-03T19:18:16.113+0000 7f5ab3f26640 10 mds.0.server apply_blocklist: killed 0 2023-10-03T19:21:26.102 INFO:teuthology.orchestra.run.smithi045.stdout: -21> 2023-10-03T19:18:16.113+0000 7f5ab3f26640 4 mds.0.33 apply_blocklist: killed 0, blocklisted sessions (2 blocklist entries, 0) 2023-10-03T19:21:26.102 INFO:teuthology.orchestra.run.smithi045.stdout: -20> 2023-10-03T19:18:16.113+0000 7f5ab3f26640 10 monclient: _renew_subs 2023-10-03T19:21:26.103 INFO:teuthology.orchestra.run.smithi045.stdout: -19> 2023-10-03T19:18:16.113+0000 7f5ab3f26640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.103 INFO:teuthology.orchestra.run.smithi045.stdout: -18> 2023-10-03T19:18:16.113+0000 7f5ab3f26640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=76}) v3 -- 0x55cc93f54340 con 0x55cc930c1400 2023-10-03T19:21:26.103 INFO:teuthology.orchestra.run.smithi045.stdout: -17> 2023-10-03T19:18:16.541+0000 7f5aaff1e640 2 mds.0.cache Memory usage: total 303888, rss 57152, heap 207144, baseline 190760, 0 / 914 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:26.103 INFO:teuthology.orchestra.run.smithi045.stdout: -16> 2023-10-03T19:18:16.541+0000 7f5aaff1e640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999988198s ago 2023-10-03T19:21:26.103 INFO:teuthology.orchestra.run.smithi045.stdout: -15> 2023-10-03T19:18:16.541+0000 7f5aaff1e640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:26.103 INFO:teuthology.orchestra.run.smithi045.stdout: -14> 2023-10-03T19:18:16.541+0000 7f5aaff1e640 7 mds.0.cache trim bytes_used=2MB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:26.103 INFO:teuthology.orchestra.run.smithi045.stdout: -13> 2023-10-03T19:18:16.541+0000 7f5aaff1e640 7 mds.0.cache trim_lru trimming 0 items from LRU size=911 mid=630 pintail=11 pinned=11 2023-10-03T19:21:26.103 INFO:teuthology.orchestra.run.smithi045.stdout: -12> 2023-10-03T19:18:16.541+0000 7f5aaff1e640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:26.103 INFO:teuthology.orchestra.run.smithi045.stdout: -11> 2023-10-03T19:18:16.541+0000 7f5aaff1e640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:26.103 INFO:teuthology.orchestra.run.smithi045.stdout: -10> 2023-10-03T19:18:16.541+0000 7f5aaff1e640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:26.103 INFO:teuthology.orchestra.run.smithi045.stdout: -9> 2023-10-03T19:18:16.541+0000 7f5aaff1e640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:26.103 INFO:teuthology.orchestra.run.smithi045.stdout: -8> 2023-10-03T19:18:16.781+0000 7f5ab3f26640 1 -- [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] <== mon.0 v2:172.21.15.45:3300/0 65 ==== mdsmap(e 37) v2 ==== 225+0+0 (secure 0 0 0) 0x55cc93f54340 con 0x55cc930c1400 2023-10-03T19:21:26.104 INFO:teuthology.orchestra.run.smithi045.stdout: -7> 2023-10-03T19:18:16.781+0000 7f5ab3f26640 1 mds.a Updating MDS map to version 37 from mon.0 2023-10-03T19:21:26.104 INFO:teuthology.orchestra.run.smithi045.stdout: -6> 2023-10-03T19:18:16.781+0000 7f5ab3f26640 10 mds.a my compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-03T19:21:26.104 INFO:teuthology.orchestra.run.smithi045.stdout: -5> 2023-10-03T19:18:16.781+0000 7f5ab3f26640 10 mds.a mdsmap compat compat={},rocompat={},incompat={7=mds uses inline data} 2023-10-03T19:21:26.104 INFO:teuthology.orchestra.run.smithi045.stdout: -4> 2023-10-03T19:18:16.781+0000 7f5ab3f26640 10 mds.a my gid is 6342 2023-10-03T19:21:26.104 INFO:teuthology.orchestra.run.smithi045.stdout: -3> 2023-10-03T19:18:16.781+0000 7f5ab3f26640 10 mds.a map says I am mds.-1.-1 state null 2023-10-03T19:21:26.104 INFO:teuthology.orchestra.run.smithi045.stdout: -2> 2023-10-03T19:18:16.781+0000 7f5ab3f26640 10 mds.a msgr says I am [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] 2023-10-03T19:21:26.104 INFO:teuthology.orchestra.run.smithi045.stdout: -1> 2023-10-03T19:18:16.781+0000 7f5ab3f26640 1 mds.a Map removed me [mds.a{0:6342} state up:active seq 3 addr [v2:172.21.15.45:6833/2939002026,v1:172.21.15.45:6835/2939002026] compat {c=[1],r=[1],i=[7ff]}] from cluster; respawning! See cluster/monitor logs for details. 2023-10-03T19:21:26.104 INFO:teuthology.orchestra.run.smithi045.stdout: 0> 2023-10-03T19:18:16.781+0000 7f5ab3f26640 1 mds.a respawn! 2023-10-03T19:21:26.104 INFO:teuthology.orchestra.run.smithi045.stdout:--- logging levels --- 2023-10-03T19:21:26.104 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 none 2023-10-03T19:21:26.104 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 lockdep 2023-10-03T19:21:26.104 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 context 2023-10-03T19:21:26.105 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 1 crush 2023-10-03T19:21:26.105 INFO:teuthology.orchestra.run.smithi045.stdout: 20/20 mds 2023-10-03T19:21:26.105 INFO:teuthology.orchestra.run.smithi045.stdout: 20/20 mds_balancer 2023-10-03T19:21:26.105 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mds_locker 2023-10-03T19:21:26.105 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mds_log 2023-10-03T19:21:26.105 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mds_log_expire 2023-10-03T19:21:26.105 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mds_migrator 2023-10-03T19:21:26.105 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 buffer 2023-10-03T19:21:26.105 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 timer 2023-10-03T19:21:26.105 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 filer 2023-10-03T19:21:26.105 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 striper 2023-10-03T19:21:26.105 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 objecter 2023-10-03T19:21:26.105 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 rados 2023-10-03T19:21:26.106 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 rbd 2023-10-03T19:21:26.106 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 rbd_mirror 2023-10-03T19:21:26.106 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 rbd_replay 2023-10-03T19:21:26.106 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 rbd_pwl 2023-10-03T19:21:26.106 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 journaler 2023-10-03T19:21:26.106 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 objectcacher 2023-10-03T19:21:26.106 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 immutable_obj_cache 2023-10-03T19:21:26.106 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 client 2023-10-03T19:21:26.106 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 osd 2023-10-03T19:21:26.106 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 optracker 2023-10-03T19:21:26.106 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 objclass 2023-10-03T19:21:26.106 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 3 filestore 2023-10-03T19:21:26.107 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 3 journal 2023-10-03T19:21:26.107 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 1 ms 2023-10-03T19:21:26.107 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mon 2023-10-03T19:21:26.107 INFO:teuthology.orchestra.run.smithi045.stdout: 0/10 monc 2023-10-03T19:21:26.107 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 paxos 2023-10-03T19:21:26.107 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 tp 2023-10-03T19:21:26.107 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 auth 2023-10-03T19:21:26.107 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 crypto 2023-10-03T19:21:26.107 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 1 finisher 2023-10-03T19:21:26.107 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 1 reserver 2023-10-03T19:21:26.107 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 heartbeatmap 2023-10-03T19:21:26.107 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 perfcounter 2023-10-03T19:21:26.108 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw 2023-10-03T19:21:26.108 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw_sync 2023-10-03T19:21:26.108 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw_datacache 2023-10-03T19:21:26.108 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw_access 2023-10-03T19:21:26.108 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw_dbstore 2023-10-03T19:21:26.108 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw_flight 2023-10-03T19:21:26.108 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 javaclient 2023-10-03T19:21:26.108 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 asok 2023-10-03T19:21:26.108 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 1 throttle 2023-10-03T19:21:26.108 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 0 refs 2023-10-03T19:21:26.108 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 compressor 2023-10-03T19:21:26.108 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 bluestore 2023-10-03T19:21:26.109 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 bluefs 2023-10-03T19:21:26.109 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 3 bdev 2023-10-03T19:21:26.109 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 kstore 2023-10-03T19:21:26.109 INFO:teuthology.orchestra.run.smithi045.stdout: 4/ 5 rocksdb 2023-10-03T19:21:26.109 INFO:teuthology.orchestra.run.smithi045.stdout: 4/ 5 leveldb 2023-10-03T19:21:26.109 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 fuse 2023-10-03T19:21:26.109 INFO:teuthology.orchestra.run.smithi045.stdout: 2/ 5 mgr 2023-10-03T19:21:26.109 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mgrc 2023-10-03T19:21:26.109 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 dpdk 2023-10-03T19:21:26.109 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 eventtrace 2023-10-03T19:21:26.109 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 prioritycache 2023-10-03T19:21:26.109 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 test 2023-10-03T19:21:26.109 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 cephfs_mirror 2023-10-03T19:21:26.110 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 cephsqlite 2023-10-03T19:21:26.110 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore 2023-10-03T19:21:26.110 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_onode 2023-10-03T19:21:26.110 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_odata 2023-10-03T19:21:26.110 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_omap 2023-10-03T19:21:26.110 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_tm 2023-10-03T19:21:26.110 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_t 2023-10-03T19:21:26.110 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_cleaner 2023-10-03T19:21:26.110 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_epm 2023-10-03T19:21:26.110 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_lba 2023-10-03T19:21:26.110 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_fixedkv_tree 2023-10-03T19:21:26.111 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_cache 2023-10-03T19:21:26.111 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_journal 2023-10-03T19:21:26.111 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_device 2023-10-03T19:21:26.111 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_backref 2023-10-03T19:21:26.111 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 alienstore 2023-10-03T19:21:26.111 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mclock 2023-10-03T19:21:26.111 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 cyanstore 2023-10-03T19:21:26.111 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 ceph_exporter 2023-10-03T19:21:26.111 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 memstore 2023-10-03T19:21:26.111 INFO:teuthology.orchestra.run.smithi045.stdout: -2/-2 (syslog threshold) 2023-10-03T19:21:26.111 INFO:teuthology.orchestra.run.smithi045.stdout: -1/-1 (stderr threshold) 2023-10-03T19:21:26.243 INFO:teuthology.orchestra.run.smithi045.stdout:--- pthread ID / name mapping for recent threads --- 2023-10-03T19:21:26.243 INFO:teuthology.orchestra.run.smithi045.stdout: 7f5aac717640 / ms_dispatch 2023-10-03T19:21:26.243 INFO:teuthology.orchestra.run.smithi045.stdout: 7f5aacf18640 / ms_dispatch 2023-10-03T19:21:26.243 INFO:teuthology.orchestra.run.smithi045.stdout: 7f5aad719640 / md_submit 2023-10-03T19:21:26.243 INFO:teuthology.orchestra.run.smithi045.stdout: 7f5aadf1a640 / MR_Finisher 2023-10-03T19:21:26.243 INFO:teuthology.orchestra.run.smithi045.stdout: 7f5aaf71d640 / mds_rank_progr 2023-10-03T19:21:26.243 INFO:teuthology.orchestra.run.smithi045.stdout: 7f5aaff1e640 / ms_dispatch 2023-10-03T19:21:26.243 INFO:teuthology.orchestra.run.smithi045.stdout: 7f5ab1721640 / safe_timer 2023-10-03T19:21:26.243 INFO:teuthology.orchestra.run.smithi045.stdout: 7f5ab1f22640 / ceph-mds 2023-10-03T19:21:26.244 INFO:teuthology.orchestra.run.smithi045.stdout: 7f5ab2723640 / safe_timer 2023-10-03T19:21:26.244 INFO:teuthology.orchestra.run.smithi045.stdout: 7f5ab2f24640 / safe_timer 2023-10-03T19:21:26.244 INFO:teuthology.orchestra.run.smithi045.stdout: 7f5ab3725640 / ms_local 2023-10-03T19:21:26.244 INFO:teuthology.orchestra.run.smithi045.stdout: 7f5ab3f26640 / ms_dispatch 2023-10-03T19:21:26.244 INFO:teuthology.orchestra.run.smithi045.stdout: 7f5ab672b640 / msgr-worker-2 2023-10-03T19:21:26.244 INFO:teuthology.orchestra.run.smithi045.stdout: 7f5ab6f2c640 / msgr-worker-1 2023-10-03T19:21:26.244 INFO:teuthology.orchestra.run.smithi045.stdout: 7f5ab772d640 / msgr-worker-0 2023-10-03T19:21:26.244 INFO:teuthology.orchestra.run.smithi045.stdout: max_recent 10000 2023-10-03T19:21:26.244 INFO:teuthology.orchestra.run.smithi045.stdout: max_new 1000 2023-10-03T19:21:26.244 INFO:teuthology.orchestra.run.smithi045.stdout: log_file /var/log/ceph/ceph-mds.a.log 2023-10-03T19:21:26.245 INFO:teuthology.orchestra.run.smithi045.stdout:--- end dump of recent events --- 2023-10-03T19:21:26.245 INFO:teuthology.orchestra.run.smithi045.stdout:--- begin dump of recent events --- 2023-10-03T19:21:26.245 INFO:teuthology.orchestra.run.smithi045.stdout: -3173> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command assert hook 0x556317a8cba0 2023-10-03T19:21:26.245 INFO:teuthology.orchestra.run.smithi045.stdout: -3172> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command abort hook 0x556317a8cba0 2023-10-03T19:21:26.245 INFO:teuthology.orchestra.run.smithi045.stdout: -3171> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command leak_some_memory hook 0x556317a8cba0 2023-10-03T19:21:26.245 INFO:teuthology.orchestra.run.smithi045.stdout: -3170> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command perfcounters_dump hook 0x556317a8cba0 2023-10-03T19:21:26.245 INFO:teuthology.orchestra.run.smithi045.stdout: -3169> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command 1 hook 0x556317a8cba0 2023-10-03T19:21:26.245 INFO:teuthology.orchestra.run.smithi045.stdout: -3168> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command perf dump hook 0x556317a8cba0 2023-10-03T19:21:26.245 INFO:teuthology.orchestra.run.smithi045.stdout: -3167> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command perfcounters_schema hook 0x556317a8cba0 2023-10-03T19:21:26.245 INFO:teuthology.orchestra.run.smithi045.stdout: -3166> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command perf histogram dump hook 0x556317a8cba0 2023-10-03T19:21:26.245 INFO:teuthology.orchestra.run.smithi045.stdout: -3165> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command 2 hook 0x556317a8cba0 2023-10-03T19:21:26.245 INFO:teuthology.orchestra.run.smithi045.stdout: -3164> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command perf schema hook 0x556317a8cba0 2023-10-03T19:21:26.246 INFO:teuthology.orchestra.run.smithi045.stdout: -3163> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command counter dump hook 0x556317a8cba0 2023-10-03T19:21:26.246 INFO:teuthology.orchestra.run.smithi045.stdout: -3162> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command counter schema hook 0x556317a8cba0 2023-10-03T19:21:26.246 INFO:teuthology.orchestra.run.smithi045.stdout: -3161> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command perf histogram schema hook 0x556317a8cba0 2023-10-03T19:21:26.246 INFO:teuthology.orchestra.run.smithi045.stdout: -3160> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command perf reset hook 0x556317a8cba0 2023-10-03T19:21:26.246 INFO:teuthology.orchestra.run.smithi045.stdout: -3159> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command config show hook 0x556317a8cba0 2023-10-03T19:21:26.246 INFO:teuthology.orchestra.run.smithi045.stdout: -3158> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command config help hook 0x556317a8cba0 2023-10-03T19:21:26.246 INFO:teuthology.orchestra.run.smithi045.stdout: -3157> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command config set hook 0x556317a8cba0 2023-10-03T19:21:26.246 INFO:teuthology.orchestra.run.smithi045.stdout: -3156> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command config unset hook 0x556317a8cba0 2023-10-03T19:21:26.246 INFO:teuthology.orchestra.run.smithi045.stdout: -3155> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command config get hook 0x556317a8cba0 2023-10-03T19:21:26.246 INFO:teuthology.orchestra.run.smithi045.stdout: -3154> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command config diff hook 0x556317a8cba0 2023-10-03T19:21:26.246 INFO:teuthology.orchestra.run.smithi045.stdout: -3153> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command config diff get hook 0x556317a8cba0 2023-10-03T19:21:26.247 INFO:teuthology.orchestra.run.smithi045.stdout: -3152> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command injectargs hook 0x556317a8cba0 2023-10-03T19:21:26.247 INFO:teuthology.orchestra.run.smithi045.stdout: -3151> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command log flush hook 0x556317a8cba0 2023-10-03T19:21:26.247 INFO:teuthology.orchestra.run.smithi045.stdout: -3150> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command log dump hook 0x556317a8cba0 2023-10-03T19:21:26.247 INFO:teuthology.orchestra.run.smithi045.stdout: -3149> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command log reopen hook 0x556317a8cba0 2023-10-03T19:21:26.247 INFO:teuthology.orchestra.run.smithi045.stdout: -3148> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command dump_mempools hook 0x556317b7a328 2023-10-03T19:21:26.247 INFO:teuthology.orchestra.run.smithi045.stdout: -3147> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 10 monclient: get_monmap_and_config 2023-10-03T19:21:26.247 INFO:teuthology.orchestra.run.smithi045.stdout: -3146> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 10 monclient: build_initial_monmap 2023-10-03T19:21:26.247 INFO:teuthology.orchestra.run.smithi045.stdout: -3145> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 1 build_initial for_mkfs: 0 2023-10-03T19:21:26.247 INFO:teuthology.orchestra.run.smithi045.stdout: -3144> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 10 monclient: monmap: 2023-10-03T19:21:26.247 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 0 2023-10-03T19:21:26.247 INFO:teuthology.orchestra.run.smithi045.stdout:fsid 58400977-12ba-4c73-bb3e-1589b2492669 2023-10-03T19:21:26.247 INFO:teuthology.orchestra.run.smithi045.stdout:last_changed 2023-10-03T19:19:34.061560+0000 2023-10-03T19:21:26.248 INFO:teuthology.orchestra.run.smithi045.stdout:created 2023-10-03T19:19:34.061560+0000 2023-10-03T19:21:26.248 INFO:teuthology.orchestra.run.smithi045.stdout:min_mon_release 0 (unknown) 2023-10-03T19:21:26.248 INFO:teuthology.orchestra.run.smithi045.stdout:election_strategy: 1 2023-10-03T19:21:26.248 INFO:teuthology.orchestra.run.smithi045.stdout:0: v1:172.21.15.45:6789/0 mon.noname-a-legacy 2023-10-03T19:21:26.248 INFO:teuthology.orchestra.run.smithi045.stdout:1: v1:172.21.15.79:6789/0 mon.noname-b-legacy 2023-10-03T19:21:26.248 INFO:teuthology.orchestra.run.smithi045.stdout:2: [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] mon.noname-c 2023-10-03T19:21:26.248 INFO:teuthology.orchestra.run.smithi045.stdout:3: v2:172.21.15.45:3300/0 mon.noname-a 2023-10-03T19:21:26.248 INFO:teuthology.orchestra.run.smithi045.stdout:4: v2:172.21.15.79:3300/0 mon.noname-b 2023-10-03T19:21:26.248 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:21:26.248 INFO:teuthology.orchestra.run.smithi045.stdout: -3143> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 AuthRegistry(0x556317ad7340) adding auth protocol: cephx 2023-10-03T19:21:26.248 INFO:teuthology.orchestra.run.smithi045.stdout: -3142> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 AuthRegistry(0x556317ad7340) adding auth protocol: cephx 2023-10-03T19:21:26.248 INFO:teuthology.orchestra.run.smithi045.stdout: -3141> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 AuthRegistry(0x556317ad7340) adding auth protocol: cephx 2023-10-03T19:21:26.249 INFO:teuthology.orchestra.run.smithi045.stdout: -3140> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 AuthRegistry(0x556317ad7340) adding con mode: secure 2023-10-03T19:21:26.249 INFO:teuthology.orchestra.run.smithi045.stdout: -3139> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 AuthRegistry(0x556317ad7340) adding con mode: crc 2023-10-03T19:21:26.249 INFO:teuthology.orchestra.run.smithi045.stdout: -3138> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 AuthRegistry(0x556317ad7340) adding con mode: secure 2023-10-03T19:21:26.249 INFO:teuthology.orchestra.run.smithi045.stdout: -3137> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 AuthRegistry(0x556317ad7340) adding con mode: crc 2023-10-03T19:21:26.249 INFO:teuthology.orchestra.run.smithi045.stdout: -3136> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 AuthRegistry(0x556317ad7340) adding con mode: secure 2023-10-03T19:21:26.249 INFO:teuthology.orchestra.run.smithi045.stdout: -3135> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 AuthRegistry(0x556317ad7340) adding con mode: crc 2023-10-03T19:21:26.249 INFO:teuthology.orchestra.run.smithi045.stdout: -3134> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 AuthRegistry(0x556317ad7340) adding con mode: crc 2023-10-03T19:21:26.249 INFO:teuthology.orchestra.run.smithi045.stdout: -3133> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 AuthRegistry(0x556317ad7340) adding con mode: secure 2023-10-03T19:21:26.249 INFO:teuthology.orchestra.run.smithi045.stdout: -3132> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 AuthRegistry(0x556317ad7340) adding con mode: crc 2023-10-03T19:21:26.249 INFO:teuthology.orchestra.run.smithi045.stdout: -3131> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 AuthRegistry(0x556317ad7340) adding con mode: secure 2023-10-03T19:21:26.249 INFO:teuthology.orchestra.run.smithi045.stdout: -3130> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 AuthRegistry(0x556317ad7340) adding con mode: crc 2023-10-03T19:21:26.250 INFO:teuthology.orchestra.run.smithi045.stdout: -3129> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 AuthRegistry(0x556317ad7340) adding con mode: secure 2023-10-03T19:21:26.250 INFO:teuthology.orchestra.run.smithi045.stdout: -3128> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 2 auth: KeyRing::load: loaded key file /var/lib/ceph/mds/ceph-a/keyring 2023-10-03T19:21:26.250 INFO:teuthology.orchestra.run.smithi045.stdout: -3127> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 1 Processor -- start 2023-10-03T19:21:26.250 INFO:teuthology.orchestra.run.smithi045.stdout: -3126> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 1 -- start start 2023-10-03T19:21:26.250 INFO:teuthology.orchestra.run.smithi045.stdout: -3125> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 10 monclient: init 2023-10-03T19:21:26.250 INFO:teuthology.orchestra.run.smithi045.stdout: -3124> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 AuthRegistry(0x7fff8b28c930) adding auth protocol: cephx 2023-10-03T19:21:26.250 INFO:teuthology.orchestra.run.smithi045.stdout: -3123> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 AuthRegistry(0x7fff8b28c930) adding auth protocol: cephx 2023-10-03T19:21:26.250 INFO:teuthology.orchestra.run.smithi045.stdout: -3122> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 AuthRegistry(0x7fff8b28c930) adding auth protocol: cephx 2023-10-03T19:21:26.250 INFO:teuthology.orchestra.run.smithi045.stdout: -3121> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 AuthRegistry(0x7fff8b28c930) adding con mode: secure 2023-10-03T19:21:26.250 INFO:teuthology.orchestra.run.smithi045.stdout: -3120> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 AuthRegistry(0x7fff8b28c930) adding con mode: crc 2023-10-03T19:21:26.250 INFO:teuthology.orchestra.run.smithi045.stdout: -3119> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 AuthRegistry(0x7fff8b28c930) adding con mode: secure 2023-10-03T19:21:26.250 INFO:teuthology.orchestra.run.smithi045.stdout: -3118> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 AuthRegistry(0x7fff8b28c930) adding con mode: crc 2023-10-03T19:21:26.251 INFO:teuthology.orchestra.run.smithi045.stdout: -3117> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 AuthRegistry(0x7fff8b28c930) adding con mode: secure 2023-10-03T19:21:26.252 INFO:teuthology.orchestra.run.smithi045.stdout: -3116> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 AuthRegistry(0x7fff8b28c930) adding con mode: crc 2023-10-03T19:21:26.252 INFO:teuthology.orchestra.run.smithi045.stdout: -3115> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 AuthRegistry(0x7fff8b28c930) adding con mode: crc 2023-10-03T19:21:26.252 INFO:teuthology.orchestra.run.smithi045.stdout: -3114> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 AuthRegistry(0x7fff8b28c930) adding con mode: secure 2023-10-03T19:21:26.252 INFO:teuthology.orchestra.run.smithi045.stdout: -3113> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 AuthRegistry(0x7fff8b28c930) adding con mode: crc 2023-10-03T19:21:26.252 INFO:teuthology.orchestra.run.smithi045.stdout: -3112> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 AuthRegistry(0x7fff8b28c930) adding con mode: secure 2023-10-03T19:21:26.252 INFO:teuthology.orchestra.run.smithi045.stdout: -3111> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 AuthRegistry(0x7fff8b28c930) adding con mode: crc 2023-10-03T19:21:26.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3110> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 AuthRegistry(0x7fff8b28c930) adding con mode: secure 2023-10-03T19:21:26.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3109> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 2 auth: KeyRing::load: loaded key file /var/lib/ceph/mds/ceph-a/keyring 2023-10-03T19:21:26.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3108> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 2 auth: KeyRing::load: loaded key file /var/lib/ceph/mds/ceph-a/keyring 2023-10-03T19:21:26.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3107> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command rotate-key hook 0x7fff8b28ca78 2023-10-03T19:21:26.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3106> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 10 monclient: _reopen_session rank -1 2023-10-03T19:21:26.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3105> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 10 monclient: _add_conns ranks=[1,3,2,4,0] 2023-10-03T19:21:26.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3104> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 10 monclient(hunting): picked mon.noname-b-legacy con 0x556317aaf000 addr v1:172.21.15.79:6789/0 2023-10-03T19:21:26.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3103> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 1 --2- >> v2:172.21.15.45:3300/0 conn(0x556317aaf400 0x556317b3a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:26.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3102> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 10 monclient(hunting): picked mon.noname-a con 0x556317aaf400 addr v2:172.21.15.45:3300/0 2023-10-03T19:21:26.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3101> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x556317aaf800 0x556317b3ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:26.253 INFO:teuthology.orchestra.run.smithi045.stdout: -3100> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 10 monclient(hunting): picked mon.noname-c con 0x556317aaf800 addr [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] 2023-10-03T19:21:26.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3099> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556317b0b800 con 0x556317aaf000 2023-10-03T19:21:26.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3098> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 10 monclient(hunting): start opening mon connection 2023-10-03T19:21:26.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3097> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x556317af5400 con 0x556317aaf400 2023-10-03T19:21:26.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3096> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 10 monclient(hunting): start opening mon connection 2023-10-03T19:21:26.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3095> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x556317af5e00 con 0x556317aaf800 2023-10-03T19:21:26.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3094> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 10 monclient(hunting): _renew_subs 2023-10-03T19:21:26.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3093> 2023-10-03T19:19:34.056+0000 7fd1a9cb5ac0 10 monclient(hunting): authenticate will time out at 1520.451774s 2023-10-03T19:21:26.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3092> 2023-10-03T19:19:34.056+0000 7fd1a7c75640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x556317aaf400 0x556317b3a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:26.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3091> 2023-10-03T19:19:34.056+0000 7fd1a7c75640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x556317aaf400 0x556317b3a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42660/0 (socket says 172.21.15.45:42660) 2023-10-03T19:21:26.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3090> 2023-10-03T19:19:34.056+0000 7fd1a7c75640 1 -- 172.21.15.45:0/2870176299 learned_addr learned my addr 172.21.15.45:0/2870176299 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:26.254 INFO:teuthology.orchestra.run.smithi045.stdout: -3089> 2023-10-03T19:19:34.056+0000 7fd1a7c75640 10 monclient(hunting): get_auth_request con 0x556317aaf400 auth_method 0 2023-10-03T19:21:26.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3088> 2023-10-03T19:19:34.056+0000 7fd1a7c75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-03T19:21:26.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3087> 2023-10-03T19:19:34.056+0000 7fd1a7c75640 10 monclient(hunting): _init_auth method 2 2023-10-03T19:21:26.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3086> 2023-10-03T19:19:34.056+0000 7fd1a7c75640 10 monclient(hunting): _init_auth creating new auth 2023-10-03T19:21:26.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3085> 2023-10-03T19:19:34.056+0000 7fd1a8c77640 1 --2- 172.21.15.45:0/2870176299 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x556317aaf800 0x556317b3ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:26.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3084> 2023-10-03T19:19:34.056+0000 7fd1a7c75640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-03T19:21:26.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3083> 2023-10-03T19:19:34.060+0000 7fd1a7c75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-03T19:21:26.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3082> 2023-10-03T19:19:34.060+0000 7fd1a7c75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-03T19:21:26.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3081> 2023-10-03T19:19:34.060+0000 7fd1a8c77640 10 monclient(hunting): get_auth_request con 0x556317aaf800 auth_method 0 2023-10-03T19:21:26.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3080> 2023-10-03T19:19:34.060+0000 7fd1a8c77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-03T19:21:26.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3079> 2023-10-03T19:19:34.060+0000 7fd1a8c77640 10 monclient(hunting): _init_auth method 2 2023-10-03T19:21:26.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3078> 2023-10-03T19:19:34.060+0000 7fd1a8c77640 10 monclient(hunting): _init_auth creating new auth 2023-10-03T19:21:26.255 INFO:teuthology.orchestra.run.smithi045.stdout: -3077> 2023-10-03T19:19:34.060+0000 7fd1a7c75640 10 monclient(hunting): handle_auth_done global_id 7152 payload 274 2023-10-03T19:21:26.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3076> 2023-10-03T19:19:34.060+0000 7fd1a7c75640 1 -- 172.21.15.45:0/2870176299 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x556317aaf800 msgr2=0x556317b3ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:26.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3075> 2023-10-03T19:19:34.060+0000 7fd1a7c75640 1 --2- 172.21.15.45:0/2870176299 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x556317aaf800 0x556317b3ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:26.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3074> 2023-10-03T19:19:34.060+0000 7fd1a7c75640 1 -- 172.21.15.45:0/2870176299 >> v1:172.21.15.79:6789/0 conn(0x556317aaf000 legacy=0x556318828800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:26.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3073> 2023-10-03T19:19:34.060+0000 7fd1a7c75640 10 monclient: _finish_hunting 0 2023-10-03T19:21:26.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3072> 2023-10-03T19:19:34.060+0000 7fd1a7c75640 1 monclient: found mon.noname-a 2023-10-03T19:21:26.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3071> 2023-10-03T19:19:34.060+0000 7fd1a7c75640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3070> 2023-10-03T19:19:34.060+0000 7fd1a7c75640 1 -- 172.21.15.45:0/2870176299 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556317ae5520 con 0x556317aaf400 2023-10-03T19:21:26.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3069> 2023-10-03T19:19:34.060+0000 7fd1a7c75640 1 --2- 172.21.15.45:0/2870176299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556317aaf400 0x556317b3a580 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x556317b788a0 tx=0x556318830e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c61f348d3cf0cde server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:26.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3068> 2023-10-03T19:19:34.060+0000 7fd1a7474640 1 -- 172.21.15.45:0/2870176299 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556317b13600 con 0x556317aaf400 2023-10-03T19:21:26.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3067> 2023-10-03T19:19:34.060+0000 7fd1a7474640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-03T19:21:26.256 INFO:teuthology.orchestra.run.smithi045.stdout: -3066> 2023-10-03T19:19:34.060+0000 7fd1a7474640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-10-03T19:21:26.257 INFO:teuthology.orchestra.run.smithi045.stdout: -3065> 2023-10-03T19:19:34.060+0000 7fd1a7474640 10 monclient: dump: 2023-10-03T19:21:26.257 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 1 2023-10-03T19:21:26.257 INFO:teuthology.orchestra.run.smithi045.stdout:fsid 58400977-12ba-4c73-bb3e-1589b2492669 2023-10-03T19:21:26.257 INFO:teuthology.orchestra.run.smithi045.stdout:last_changed 2023-10-03T19:11:32.553177+0000 2023-10-03T19:21:26.257 INFO:teuthology.orchestra.run.smithi045.stdout:created 2023-10-03T19:11:32.553177+0000 2023-10-03T19:21:26.257 INFO:teuthology.orchestra.run.smithi045.stdout:min_mon_release 18 (reef) 2023-10-03T19:21:26.257 INFO:teuthology.orchestra.run.smithi045.stdout:election_strategy: 1 2023-10-03T19:21:26.257 INFO:teuthology.orchestra.run.smithi045.stdout:0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2023-10-03T19:21:26.257 INFO:teuthology.orchestra.run.smithi045.stdout:1: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.b 2023-10-03T19:21:26.257 INFO:teuthology.orchestra.run.smithi045.stdout:2: [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] mon.c 2023-10-03T19:21:26.257 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:21:26.257 INFO:teuthology.orchestra.run.smithi045.stdout: -3064> 2023-10-03T19:19:34.060+0000 7fd1a7474640 10 monclient: _finish_auth 0 2023-10-03T19:21:26.257 INFO:teuthology.orchestra.run.smithi045.stdout: -3063> 2023-10-03T19:19:34.060+0000 7fd1a7474640 10 monclient: _check_auth_tickets 2023-10-03T19:21:26.258 INFO:teuthology.orchestra.run.smithi045.stdout: -3062> 2023-10-03T19:19:34.060+0000 7fd1a7474640 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2023-10-03T19:19:04.065074+0000) 2023-10-03T19:21:26.258 INFO:teuthology.orchestra.run.smithi045.stdout: -3061> 2023-10-03T19:19:34.060+0000 7fd1a7474640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.258 INFO:teuthology.orchestra.run.smithi045.stdout: -3060> 2023-10-03T19:19:34.060+0000 7fd1a7474640 1 -- 172.21.15.45:0/2870176299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- auth(proto 2 2 bytes epoch 0) v1 -- 0x556317b0bc80 con 0x556317aaf400 2023-10-03T19:21:26.258 INFO:teuthology.orchestra.run.smithi045.stdout: -3059> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 5 monclient: authenticate success, global_id 7152 2023-10-03T19:21:26.258 INFO:teuthology.orchestra.run.smithi045.stdout: -3058> 2023-10-03T19:19:34.060+0000 7fd1a7474640 1 -- 172.21.15.45:0/2870176299 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556317b0b980 con 0x556317aaf400 2023-10-03T19:21:26.258 INFO:teuthology.orchestra.run.smithi045.stdout: -3057> 2023-10-03T19:19:34.060+0000 7fd1a7474640 10 monclient: handle_config config(0 keys) v1 2023-10-03T19:21:26.258 INFO:teuthology.orchestra.run.smithi045.stdout: -3056> 2023-10-03T19:19:34.060+0000 7fd1a7474640 1 -- 172.21.15.45:0/2870176299 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556317b131e0 con 0x556317aaf400 2023-10-03T19:21:26.258 INFO:teuthology.orchestra.run.smithi045.stdout: -3055> 2023-10-03T19:19:34.060+0000 7fd1a7474640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-03T19:21:26.258 INFO:teuthology.orchestra.run.smithi045.stdout: -3054> 2023-10-03T19:19:34.060+0000 7fd1a7474640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-10-03T19:21:26.258 INFO:teuthology.orchestra.run.smithi045.stdout: -3053> 2023-10-03T19:19:34.060+0000 7fd1a7474640 10 monclient: dump: 2023-10-03T19:21:26.258 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 1 2023-10-03T19:21:26.259 INFO:teuthology.orchestra.run.smithi045.stdout:fsid 58400977-12ba-4c73-bb3e-1589b2492669 2023-10-03T19:21:26.259 INFO:teuthology.orchestra.run.smithi045.stdout:last_changed 2023-10-03T19:11:32.553177+0000 2023-10-03T19:21:26.259 INFO:teuthology.orchestra.run.smithi045.stdout:created 2023-10-03T19:11:32.553177+0000 2023-10-03T19:21:26.259 INFO:teuthology.orchestra.run.smithi045.stdout:min_mon_release 18 (reef) 2023-10-03T19:21:26.259 INFO:teuthology.orchestra.run.smithi045.stdout:election_strategy: 1 2023-10-03T19:21:26.259 INFO:teuthology.orchestra.run.smithi045.stdout:0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2023-10-03T19:21:26.259 INFO:teuthology.orchestra.run.smithi045.stdout:1: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.b 2023-10-03T19:21:26.259 INFO:teuthology.orchestra.run.smithi045.stdout:2: [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] mon.c 2023-10-03T19:21:26.259 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:21:26.259 INFO:teuthology.orchestra.run.smithi045.stdout: -3052> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 10 monclient: get_monmap_and_config success 2023-10-03T19:21:26.259 INFO:teuthology.orchestra.run.smithi045.stdout: -3051> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 4 set_mon_vals no callback set 2023-10-03T19:21:26.260 INFO:teuthology.orchestra.run.smithi045.stdout: -3050> 2023-10-03T19:19:34.060+0000 7fd1a7474640 1 -- 172.21.15.45:0/2870176299 <== mon.0 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556317ae5520 con 0x556317aaf400 2023-10-03T19:21:26.260 INFO:teuthology.orchestra.run.smithi045.stdout: -3049> 2023-10-03T19:19:34.060+0000 7fd1a7474640 10 monclient: _finish_auth 0 2023-10-03T19:21:26.260 INFO:teuthology.orchestra.run.smithi045.stdout: -3048> 2023-10-03T19:19:34.060+0000 7fd1a7474640 10 monclient: _check_auth_tickets 2023-10-03T19:21:26.260 INFO:teuthology.orchestra.run.smithi045.stdout: -3047> 2023-10-03T19:19:34.060+0000 7fd1a7474640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:04.065298+0000) 2023-10-03T19:21:26.260 INFO:teuthology.orchestra.run.smithi045.stdout: -3046> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 10 monclient: shutdown 2023-10-03T19:21:26.260 INFO:teuthology.orchestra.run.smithi045.stdout: -3045> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) unregister_commands rotate-key 2023-10-03T19:21:26.260 INFO:teuthology.orchestra.run.smithi045.stdout: -3044> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 1 -- 172.21.15.45:0/2870176299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556317aaf400 msgr2=0x556317b3a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:26.260 INFO:teuthology.orchestra.run.smithi045.stdout: -3043> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 1 --2- 172.21.15.45:0/2870176299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556317aaf400 0x556317b3a580 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x556317b788a0 tx=0x556318830e40 comp rx=0 tx=0).stop 2023-10-03T19:21:26.260 INFO:teuthology.orchestra.run.smithi045.stdout: -3042> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 1 -- 172.21.15.45:0/2870176299 shutdown_connections 2023-10-03T19:21:26.260 INFO:teuthology.orchestra.run.smithi045.stdout: -3041> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 1 --2- 172.21.15.45:0/2870176299 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x556317aaf800 0x556317b3ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:26.260 INFO:teuthology.orchestra.run.smithi045.stdout: -3040> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 1 --2- 172.21.15.45:0/2870176299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556317aaf400 0x556317b3a580 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:26.260 INFO:teuthology.orchestra.run.smithi045.stdout: -3039> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 1 -- 172.21.15.45:0/2870176299 >> 172.21.15.45:0/2870176299 conn(0x556317aaec00 msgr2=0x556318828000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:26.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3038> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 1 -- 172.21.15.45:0/2870176299 shutdown_connections 2023-10-03T19:21:26.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3037> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 1 -- 172.21.15.45:0/2870176299 wait complete. 2023-10-03T19:21:26.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3036> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 0 ceph version 18.0.0-3908-g05a43c8f (05a43c8fb3988914c879a50970f9054a098e0612) reef (dev), process ceph-mds, pid 52631 2023-10-03T19:21:26.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3035> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 1 main not setting numa affinity 2023-10-03T19:21:26.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3034> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) init /var/run/ceph/ceph-mds.a.asok 2023-10-03T19:21:26.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3033> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) bind_and_listen /var/run/ceph/ceph-mds.a.asok 2023-10-03T19:21:26.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3032> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command 0 hook 0x556317b034b0 2023-10-03T19:21:26.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3031> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command version hook 0x556317b034b0 2023-10-03T19:21:26.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3030> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command git_version hook 0x556317b034b0 2023-10-03T19:21:26.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3029> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command help hook 0x556317a8cb20 2023-10-03T19:21:26.261 INFO:teuthology.orchestra.run.smithi045.stdout: -3028> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command get_command_descriptions hook 0x556317a8cb30 2023-10-03T19:21:26.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3027> 2023-10-03T19:19:34.060+0000 7fd1a7474640 5 asok(0x556317b36000) entry start 2023-10-03T19:21:26.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3026> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 5 AuthRegistry(0x556317ad7340) adding auth protocol: cephx 2023-10-03T19:21:26.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3025> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 5 AuthRegistry(0x556317ad7340) adding auth protocol: cephx 2023-10-03T19:21:26.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3024> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 5 AuthRegistry(0x556317ad7340) adding auth protocol: cephx 2023-10-03T19:21:26.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3023> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 5 AuthRegistry(0x556317ad7340) adding con mode: secure 2023-10-03T19:21:26.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3022> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 5 AuthRegistry(0x556317ad7340) adding con mode: crc 2023-10-03T19:21:26.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3021> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 5 AuthRegistry(0x556317ad7340) adding con mode: secure 2023-10-03T19:21:26.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3020> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 5 AuthRegistry(0x556317ad7340) adding con mode: crc 2023-10-03T19:21:26.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3019> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 5 AuthRegistry(0x556317ad7340) adding con mode: secure 2023-10-03T19:21:26.262 INFO:teuthology.orchestra.run.smithi045.stdout: -3018> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 5 AuthRegistry(0x556317ad7340) adding con mode: crc 2023-10-03T19:21:26.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3017> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 5 AuthRegistry(0x556317ad7340) adding con mode: crc 2023-10-03T19:21:26.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3016> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 5 AuthRegistry(0x556317ad7340) adding con mode: secure 2023-10-03T19:21:26.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3015> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 5 AuthRegistry(0x556317ad7340) adding con mode: crc 2023-10-03T19:21:26.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3014> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 5 AuthRegistry(0x556317ad7340) adding con mode: secure 2023-10-03T19:21:26.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3013> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 5 AuthRegistry(0x556317ad7340) adding con mode: crc 2023-10-03T19:21:26.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3012> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 5 AuthRegistry(0x556317ad7340) adding con mode: secure 2023-10-03T19:21:26.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3011> 2023-10-03T19:19:34.060+0000 7fd1a9cb5ac0 2 auth: KeyRing::load: loaded key file /var/lib/ceph/mds/ceph-a/keyring 2023-10-03T19:21:26.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3010> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 1 -- [v2:0.0.0.0:6834/3401546487,v1:0.0.0.0:6835/3401546487] _finish_bind bind my_addrs is [v2:0.0.0.0:6834/3401546487,v1:0.0.0.0:6835/3401546487] 2023-10-03T19:21:26.263 INFO:teuthology.orchestra.run.smithi045.stdout: -3009> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 monclient: build_initial_monmap 2023-10-03T19:21:26.264 INFO:teuthology.orchestra.run.smithi045.stdout: -3008> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 1 build_initial for_mkfs: 0 2023-10-03T19:21:26.264 INFO:teuthology.orchestra.run.smithi045.stdout: -3007> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 monclient: monmap: 2023-10-03T19:21:26.264 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 0 2023-10-03T19:21:26.264 INFO:teuthology.orchestra.run.smithi045.stdout:fsid 00000000-0000-0000-0000-000000000000 2023-10-03T19:21:26.264 INFO:teuthology.orchestra.run.smithi045.stdout:last_changed 0.000000 2023-10-03T19:21:26.264 INFO:teuthology.orchestra.run.smithi045.stdout:created 0.000000 2023-10-03T19:21:26.264 INFO:teuthology.orchestra.run.smithi045.stdout:min_mon_release 0 (unknown) 2023-10-03T19:21:26.264 INFO:teuthology.orchestra.run.smithi045.stdout:election_strategy: 1 2023-10-03T19:21:26.264 INFO:teuthology.orchestra.run.smithi045.stdout:0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.noname-a 2023-10-03T19:21:26.265 INFO:teuthology.orchestra.run.smithi045.stdout:1: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.noname-b 2023-10-03T19:21:26.265 INFO:teuthology.orchestra.run.smithi045.stdout:2: [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] mon.noname-c 2023-10-03T19:21:26.265 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:21:26.265 INFO:teuthology.orchestra.run.smithi045.stdout: -3006> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 1 -- [v2:0.0.0.0:6834/3401546487,v1:0.0.0.0:6835/3401546487] start start 2023-10-03T19:21:26.265 INFO:teuthology.orchestra.run.smithi045.stdout: -3005> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 mds.a Dumping misc struct sizes: 2023-10-03T19:21:26.265 INFO:teuthology.orchestra.run.smithi045.stdout: -3004> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 mds.a 96 MDSCacheObject 2023-10-03T19:21:26.265 INFO:teuthology.orchestra.run.smithi045.stdout: -3003> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 mds.a 1328 CInode 2023-10-03T19:21:26.265 INFO:teuthology.orchestra.run.smithi045.stdout: -3002> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 mds.a 16 elist<>::item 2023-10-03T19:21:26.265 INFO:teuthology.orchestra.run.smithi045.stdout: -3001> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 mds.a 632 inode 2023-10-03T19:21:26.265 INFO:teuthology.orchestra.run.smithi045.stdout: -3000> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 mds.a 704 old_inode 2023-10-03T19:21:26.265 INFO:teuthology.orchestra.run.smithi045.stdout: -2999> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 mds.a 48 nest_info_t 2023-10-03T19:21:26.265 INFO:teuthology.orchestra.run.smithi045.stdout: -2998> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 mds.a 40 frag_info_t 2023-10-03T19:21:26.266 INFO:teuthology.orchestra.run.smithi045.stdout: -2997> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 mds.a 40 SimpleLock 2023-10-03T19:21:26.266 INFO:teuthology.orchestra.run.smithi045.stdout: -2996> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 mds.a 48 ScatterLock 2023-10-03T19:21:26.266 INFO:teuthology.orchestra.run.smithi045.stdout: -2995> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 mds.a 616 CDentry 2023-10-03T19:21:26.266 INFO:teuthology.orchestra.run.smithi045.stdout: -2994> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 mds.a 16 elist<>::item 2023-10-03T19:21:26.266 INFO:teuthology.orchestra.run.smithi045.stdout: -2993> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 mds.a 40 SimpleLock 2023-10-03T19:21:26.266 INFO:teuthology.orchestra.run.smithi045.stdout: -2992> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 mds.a 1088 CDir 2023-10-03T19:21:26.266 INFO:teuthology.orchestra.run.smithi045.stdout: -2991> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 mds.a 16 elist<>::item 2023-10-03T19:21:26.266 INFO:teuthology.orchestra.run.smithi045.stdout: -2990> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 mds.a 232 fnode_t 2023-10-03T19:21:26.266 INFO:teuthology.orchestra.run.smithi045.stdout: -2989> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 mds.a 48 nest_info_t 2023-10-03T19:21:26.266 INFO:teuthology.orchestra.run.smithi045.stdout: -2988> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 mds.a 40 frag_info_t 2023-10-03T19:21:26.266 INFO:teuthology.orchestra.run.smithi045.stdout: -2987> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 mds.a 320 Capability 2023-10-03T19:21:26.267 INFO:teuthology.orchestra.run.smithi045.stdout: -2986> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 mds.a 32 xlist<>::item 2023-10-03T19:21:26.267 INFO:teuthology.orchestra.run.smithi045.stdout: -2985> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 1 Processor -- start 2023-10-03T19:21:26.267 INFO:teuthology.orchestra.run.smithi045.stdout: -2984> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 monclient: init 2023-10-03T19:21:26.267 INFO:teuthology.orchestra.run.smithi045.stdout: -2983> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 AuthRegistry(0x7fff8b28dcc0) adding auth protocol: cephx 2023-10-03T19:21:26.267 INFO:teuthology.orchestra.run.smithi045.stdout: -2982> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 AuthRegistry(0x7fff8b28dcc0) adding auth protocol: cephx 2023-10-03T19:21:26.267 INFO:teuthology.orchestra.run.smithi045.stdout: -2981> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 AuthRegistry(0x7fff8b28dcc0) adding auth protocol: cephx 2023-10-03T19:21:26.267 INFO:teuthology.orchestra.run.smithi045.stdout: -2980> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 AuthRegistry(0x7fff8b28dcc0) adding con mode: secure 2023-10-03T19:21:26.267 INFO:teuthology.orchestra.run.smithi045.stdout: -2979> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 AuthRegistry(0x7fff8b28dcc0) adding con mode: crc 2023-10-03T19:21:26.267 INFO:teuthology.orchestra.run.smithi045.stdout: -2978> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 AuthRegistry(0x7fff8b28dcc0) adding con mode: secure 2023-10-03T19:21:26.267 INFO:teuthology.orchestra.run.smithi045.stdout: -2977> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 AuthRegistry(0x7fff8b28dcc0) adding con mode: crc 2023-10-03T19:21:26.267 INFO:teuthology.orchestra.run.smithi045.stdout: -2976> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 AuthRegistry(0x7fff8b28dcc0) adding con mode: secure 2023-10-03T19:21:26.268 INFO:teuthology.orchestra.run.smithi045.stdout: -2975> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 AuthRegistry(0x7fff8b28dcc0) adding con mode: crc 2023-10-03T19:21:26.268 INFO:teuthology.orchestra.run.smithi045.stdout: -2974> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 AuthRegistry(0x7fff8b28dcc0) adding con mode: crc 2023-10-03T19:21:26.268 INFO:teuthology.orchestra.run.smithi045.stdout: -2973> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 AuthRegistry(0x7fff8b28dcc0) adding con mode: secure 2023-10-03T19:21:26.268 INFO:teuthology.orchestra.run.smithi045.stdout: -2972> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 AuthRegistry(0x7fff8b28dcc0) adding con mode: crc 2023-10-03T19:21:26.268 INFO:teuthology.orchestra.run.smithi045.stdout: -2971> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 AuthRegistry(0x7fff8b28dcc0) adding con mode: secure 2023-10-03T19:21:26.268 INFO:teuthology.orchestra.run.smithi045.stdout: -2970> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 AuthRegistry(0x7fff8b28dcc0) adding con mode: crc 2023-10-03T19:21:26.268 INFO:teuthology.orchestra.run.smithi045.stdout: -2969> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 AuthRegistry(0x7fff8b28dcc0) adding con mode: secure 2023-10-03T19:21:26.268 INFO:teuthology.orchestra.run.smithi045.stdout: -2968> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 2 auth: KeyRing::load: loaded key file /var/lib/ceph/mds/ceph-a/keyring 2023-10-03T19:21:26.268 INFO:teuthology.orchestra.run.smithi045.stdout: -2967> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 2 auth: KeyRing::load: loaded key file /var/lib/ceph/mds/ceph-a/keyring 2023-10-03T19:21:26.268 INFO:teuthology.orchestra.run.smithi045.stdout: -2966> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command rotate-key hook 0x7fff8b28de08 2023-10-03T19:21:26.268 INFO:teuthology.orchestra.run.smithi045.stdout: -2965> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 monclient: _reopen_session rank -1 2023-10-03T19:21:26.268 INFO:teuthology.orchestra.run.smithi045.stdout: -2964> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 monclient: _add_conns ranks=[0,1,2] 2023-10-03T19:21:26.269 INFO:teuthology.orchestra.run.smithi045.stdout: -2963> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 1 --2- [v2:0.0.0.0:6834/3401546487,v1:0.0.0.0:6835/3401546487] >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556317aaf800 0x556317b3a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:26.269 INFO:teuthology.orchestra.run.smithi045.stdout: -2962> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 monclient(hunting): picked mon.noname-a con 0x556317aaf800 addr [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] 2023-10-03T19:21:26.269 INFO:teuthology.orchestra.run.smithi045.stdout: -2961> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 1 --2- [v2:0.0.0.0:6834/3401546487,v1:0.0.0.0:6835/3401546487] >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556317aaf400 0x556317b3ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:26.269 INFO:teuthology.orchestra.run.smithi045.stdout: -2960> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 monclient(hunting): picked mon.noname-b con 0x556317aaf400 addr [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] 2023-10-03T19:21:26.269 INFO:teuthology.orchestra.run.smithi045.stdout: -2959> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 1 --2- [v2:0.0.0.0:6834/3401546487,v1:0.0.0.0:6835/3401546487] >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x556317aaf000 0x556317b3b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:26.269 INFO:teuthology.orchestra.run.smithi045.stdout: -2958> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 monclient(hunting): picked mon.noname-c con 0x556317aaf000 addr [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] 2023-10-03T19:21:26.269 INFO:teuthology.orchestra.run.smithi045.stdout: -2957> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 monclient(hunting): start opening mon connection 2023-10-03T19:21:26.269 INFO:teuthology.orchestra.run.smithi045.stdout: -2956> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 1 -- [v2:0.0.0.0:6834/3401546487,v1:0.0.0.0:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x556317af5e00 con 0x556317aaf800 2023-10-03T19:21:26.269 INFO:teuthology.orchestra.run.smithi045.stdout: -2955> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 monclient(hunting): start opening mon connection 2023-10-03T19:21:26.269 INFO:teuthology.orchestra.run.smithi045.stdout: -2954> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 1 -- [v2:0.0.0.0:6834/3401546487,v1:0.0.0.0:6835/3401546487] --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x556317af5cc0 con 0x556317aaf400 2023-10-03T19:21:26.269 INFO:teuthology.orchestra.run.smithi045.stdout: -2953> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 monclient(hunting): start opening mon connection 2023-10-03T19:21:26.269 INFO:teuthology.orchestra.run.smithi045.stdout: -2952> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 1 -- [v2:0.0.0.0:6834/3401546487,v1:0.0.0.0:6835/3401546487] --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x556317af4a00 con 0x556317aaf000 2023-10-03T19:21:26.270 INFO:teuthology.orchestra.run.smithi045.stdout: -2951> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 monclient(hunting): _renew_subs 2023-10-03T19:21:26.270 INFO:teuthology.orchestra.run.smithi045.stdout: -2950> 2023-10-03T19:19:34.064+0000 7fd1a8476640 1 --2- [v2:0.0.0.0:6834/3401546487,v1:0.0.0.0:6835/3401546487] >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556317aaf800 0x556317b3a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:26.270 INFO:teuthology.orchestra.run.smithi045.stdout: -2949> 2023-10-03T19:19:34.064+0000 7fd1a8476640 1 --2- [v2:0.0.0.0:6834/3401546487,v1:0.0.0.0:6835/3401546487] >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556317aaf800 0x556317b3a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42672/0 (socket says 172.21.15.45:42672) 2023-10-03T19:21:26.270 INFO:teuthology.orchestra.run.smithi045.stdout: -2948> 2023-10-03T19:19:34.064+0000 7fd1a8476640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] learned_addr learned my addr [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:26.270 INFO:teuthology.orchestra.run.smithi045.stdout: -2947> 2023-10-03T19:19:34.064+0000 7fd1a8476640 10 monclient(hunting): get_auth_request con 0x556317aaf800 auth_method 0 2023-10-03T19:21:26.270 INFO:teuthology.orchestra.run.smithi045.stdout: -2946> 2023-10-03T19:19:34.064+0000 7fd1a8476640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-03T19:21:26.270 INFO:teuthology.orchestra.run.smithi045.stdout: -2945> 2023-10-03T19:19:34.064+0000 7fd1a8476640 10 monclient(hunting): _init_auth method 2 2023-10-03T19:21:26.270 INFO:teuthology.orchestra.run.smithi045.stdout: -2944> 2023-10-03T19:19:34.064+0000 7fd1a8476640 10 monclient(hunting): _init_auth creating new auth 2023-10-03T19:21:26.270 INFO:teuthology.orchestra.run.smithi045.stdout: -2943> 2023-10-03T19:19:34.064+0000 7fd1a8c77640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x556317aaf000 0x556317b3b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:26.270 INFO:teuthology.orchestra.run.smithi045.stdout: -2942> 2023-10-03T19:19:34.064+0000 7fd1a7c75640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556317aaf400 0x556317b3ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:26.270 INFO:teuthology.orchestra.run.smithi045.stdout: -2941> 2023-10-03T19:19:34.064+0000 7fd1a7c75640 10 monclient(hunting): get_auth_request con 0x556317aaf400 auth_method 0 2023-10-03T19:21:26.271 INFO:teuthology.orchestra.run.smithi045.stdout: -2940> 2023-10-03T19:19:34.064+0000 7fd1a7c75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-03T19:21:26.271 INFO:teuthology.orchestra.run.smithi045.stdout: -2939> 2023-10-03T19:19:34.064+0000 7fd1a7c75640 10 monclient(hunting): _init_auth method 2 2023-10-03T19:21:26.271 INFO:teuthology.orchestra.run.smithi045.stdout: -2938> 2023-10-03T19:19:34.064+0000 7fd1a7c75640 10 monclient(hunting): _init_auth creating new auth 2023-10-03T19:21:26.271 INFO:teuthology.orchestra.run.smithi045.stdout: -2937> 2023-10-03T19:19:34.064+0000 7fd1a8c77640 10 monclient(hunting): get_auth_request con 0x556317aaf000 auth_method 0 2023-10-03T19:21:26.271 INFO:teuthology.orchestra.run.smithi045.stdout: -2936> 2023-10-03T19:19:34.064+0000 7fd1a8c77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-03T19:21:26.271 INFO:teuthology.orchestra.run.smithi045.stdout: -2935> 2023-10-03T19:19:34.064+0000 7fd1a8c77640 10 monclient(hunting): _init_auth method 2 2023-10-03T19:21:26.271 INFO:teuthology.orchestra.run.smithi045.stdout: -2934> 2023-10-03T19:19:34.064+0000 7fd1a8c77640 10 monclient(hunting): _init_auth creating new auth 2023-10-03T19:21:26.271 INFO:teuthology.orchestra.run.smithi045.stdout: -2933> 2023-10-03T19:19:34.064+0000 7fd1a8476640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-03T19:21:26.271 INFO:teuthology.orchestra.run.smithi045.stdout: -2932> 2023-10-03T19:19:34.064+0000 7fd1a8476640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-03T19:21:26.271 INFO:teuthology.orchestra.run.smithi045.stdout: -2931> 2023-10-03T19:19:34.064+0000 7fd1a8476640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-03T19:21:26.271 INFO:teuthology.orchestra.run.smithi045.stdout: -2930> 2023-10-03T19:19:34.064+0000 7fd1a7c75640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-03T19:21:26.271 INFO:teuthology.orchestra.run.smithi045.stdout: -2929> 2023-10-03T19:19:34.064+0000 7fd1a7c75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-03T19:21:26.272 INFO:teuthology.orchestra.run.smithi045.stdout: -2928> 2023-10-03T19:19:34.064+0000 7fd1a7c75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-03T19:21:26.272 INFO:teuthology.orchestra.run.smithi045.stdout: -2927> 2023-10-03T19:19:34.064+0000 7fd1a8c77640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-03T19:21:26.272 INFO:teuthology.orchestra.run.smithi045.stdout: -2926> 2023-10-03T19:19:34.064+0000 7fd1a8c77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-03T19:21:26.272 INFO:teuthology.orchestra.run.smithi045.stdout: -2925> 2023-10-03T19:19:34.064+0000 7fd1a8c77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-03T19:21:26.272 INFO:teuthology.orchestra.run.smithi045.stdout: -2924> 2023-10-03T19:19:34.064+0000 7fd1a8476640 10 monclient(hunting): handle_auth_done global_id 7155 payload 1011 2023-10-03T19:21:26.272 INFO:teuthology.orchestra.run.smithi045.stdout: -2923> 2023-10-03T19:19:34.064+0000 7fd1a8476640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x556317aaf000 msgr2=0x556317b3b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:26.272 INFO:teuthology.orchestra.run.smithi045.stdout: -2922> 2023-10-03T19:19:34.064+0000 7fd1a8476640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x556317aaf000 0x556317b3b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:26.272 INFO:teuthology.orchestra.run.smithi045.stdout: -2921> 2023-10-03T19:19:34.064+0000 7fd1a8476640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556317aaf400 msgr2=0x556317b3ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:26.272 INFO:teuthology.orchestra.run.smithi045.stdout: -2920> 2023-10-03T19:19:34.064+0000 7fd1a8476640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556317aaf400 0x556317b3ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:26.272 INFO:teuthology.orchestra.run.smithi045.stdout: -2919> 2023-10-03T19:19:34.064+0000 7fd1a8476640 10 monclient: _finish_hunting 0 2023-10-03T19:21:26.272 INFO:teuthology.orchestra.run.smithi045.stdout: -2918> 2023-10-03T19:19:34.064+0000 7fd1a8476640 1 monclient: found mon.noname-a 2023-10-03T19:21:26.273 INFO:teuthology.orchestra.run.smithi045.stdout: -2917> 2023-10-03T19:19:34.064+0000 7fd1a8476640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.273 INFO:teuthology.orchestra.run.smithi045.stdout: -2916> 2023-10-03T19:19:34.064+0000 7fd1a8476640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556317ae56c0 con 0x556317aaf800 2023-10-03T19:21:26.273 INFO:teuthology.orchestra.run.smithi045.stdout: -2915> 2023-10-03T19:19:34.064+0000 7fd1a7c75640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556317aaf400 0x556317b3ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:21:26.273 INFO:teuthology.orchestra.run.smithi045.stdout: -2914> 2023-10-03T19:19:34.064+0000 7fd1a8476640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556317aaf800 0x556317b3a580 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x556317b14240 tx=0x5563188312c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:26.273 INFO:teuthology.orchestra.run.smithi045.stdout: -2913> 2023-10-03T19:19:34.064+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556317b13600 con 0x556317aaf800 2023-10-03T19:21:26.273 INFO:teuthology.orchestra.run.smithi045.stdout: -2912> 2023-10-03T19:19:34.064+0000 7fd1a5470640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-03T19:21:26.273 INFO:teuthology.orchestra.run.smithi045.stdout: -2911> 2023-10-03T19:19:34.064+0000 7fd1a5470640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-10-03T19:21:26.273 INFO:teuthology.orchestra.run.smithi045.stdout: -2910> 2023-10-03T19:19:34.064+0000 7fd1a5470640 10 monclient: dump: 2023-10-03T19:21:26.273 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 1 2023-10-03T19:21:26.398 INFO:teuthology.orchestra.run.smithi045.stdout:fsid 58400977-12ba-4c73-bb3e-1589b2492669 2023-10-03T19:21:26.399 INFO:teuthology.orchestra.run.smithi045.stdout:last_changed 2023-10-03T19:11:32.553177+0000 2023-10-03T19:21:26.399 INFO:teuthology.orchestra.run.smithi045.stdout:created 2023-10-03T19:11:32.553177+0000 2023-10-03T19:21:26.399 INFO:teuthology.orchestra.run.smithi045.stdout:min_mon_release 18 (reef) 2023-10-03T19:21:26.399 INFO:teuthology.orchestra.run.smithi045.stdout:election_strategy: 1 2023-10-03T19:21:26.399 INFO:teuthology.orchestra.run.smithi045.stdout:0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2023-10-03T19:21:26.399 INFO:teuthology.orchestra.run.smithi045.stdout:1: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.b 2023-10-03T19:21:26.399 INFO:teuthology.orchestra.run.smithi045.stdout:2: [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] mon.c 2023-10-03T19:21:26.399 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:21:26.399 INFO:teuthology.orchestra.run.smithi045.stdout: -2909> 2023-10-03T19:19:34.064+0000 7fd1a5470640 10 monclient: _finish_auth 0 2023-10-03T19:21:26.399 INFO:teuthology.orchestra.run.smithi045.stdout: -2908> 2023-10-03T19:19:34.064+0000 7fd1a5470640 10 monclient: _check_auth_tickets 2023-10-03T19:21:26.399 INFO:teuthology.orchestra.run.smithi045.stdout: -2907> 2023-10-03T19:19:34.064+0000 7fd1a5470640 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2023-10-03T19:19:04.069008+0000) 2023-10-03T19:21:26.400 INFO:teuthology.orchestra.run.smithi045.stdout: -2906> 2023-10-03T19:19:34.064+0000 7fd1a5470640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.400 INFO:teuthology.orchestra.run.smithi045.stdout: -2905> 2023-10-03T19:19:34.064+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- auth(proto 2 2 bytes epoch 0) v1 -- 0x556317b0be00 con 0x556317aaf800 2023-10-03T19:21:26.400 INFO:teuthology.orchestra.run.smithi045.stdout: -2904> 2023-10-03T19:19:34.064+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556317b0b800 con 0x556317aaf800 2023-10-03T19:21:26.400 INFO:teuthology.orchestra.run.smithi045.stdout: -2903> 2023-10-03T19:19:34.064+0000 7fd1a5470640 10 monclient: handle_config config(0 keys) v1 2023-10-03T19:21:26.400 INFO:teuthology.orchestra.run.smithi045.stdout: -2902> 2023-10-03T19:19:34.064+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556317b131e0 con 0x556317aaf800 2023-10-03T19:21:26.400 INFO:teuthology.orchestra.run.smithi045.stdout: -2901> 2023-10-03T19:19:34.064+0000 7fd1a5470640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-03T19:21:26.400 INFO:teuthology.orchestra.run.smithi045.stdout: -2900> 2023-10-03T19:19:34.064+0000 7fd1a5470640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-10-03T19:21:26.400 INFO:teuthology.orchestra.run.smithi045.stdout: -2899> 2023-10-03T19:19:34.064+0000 7fd1a5470640 10 monclient: dump: 2023-10-03T19:21:26.400 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 1 2023-10-03T19:21:26.400 INFO:teuthology.orchestra.run.smithi045.stdout:fsid 58400977-12ba-4c73-bb3e-1589b2492669 2023-10-03T19:21:26.400 INFO:teuthology.orchestra.run.smithi045.stdout:last_changed 2023-10-03T19:11:32.553177+0000 2023-10-03T19:21:26.401 INFO:teuthology.orchestra.run.smithi045.stdout:created 2023-10-03T19:11:32.553177+0000 2023-10-03T19:21:26.401 INFO:teuthology.orchestra.run.smithi045.stdout:min_mon_release 18 (reef) 2023-10-03T19:21:26.401 INFO:teuthology.orchestra.run.smithi045.stdout:election_strategy: 1 2023-10-03T19:21:26.401 INFO:teuthology.orchestra.run.smithi045.stdout:0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2023-10-03T19:21:26.401 INFO:teuthology.orchestra.run.smithi045.stdout:1: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.b 2023-10-03T19:21:26.401 INFO:teuthology.orchestra.run.smithi045.stdout:2: [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] mon.c 2023-10-03T19:21:26.401 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:21:26.401 INFO:teuthology.orchestra.run.smithi045.stdout: -2898> 2023-10-03T19:19:34.064+0000 7fd1a6472640 4 set_mon_vals no callback set 2023-10-03T19:21:26.401 INFO:teuthology.orchestra.run.smithi045.stdout: -2897> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 monclient: authenticate success, global_id 7155 2023-10-03T19:21:26.401 INFO:teuthology.orchestra.run.smithi045.stdout: -2896> 2023-10-03T19:19:34.064+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556317ae56c0 con 0x556317aaf800 2023-10-03T19:21:26.401 INFO:teuthology.orchestra.run.smithi045.stdout: -2895> 2023-10-03T19:19:34.064+0000 7fd1a5470640 10 monclient: _finish_auth 0 2023-10-03T19:21:26.402 INFO:teuthology.orchestra.run.smithi045.stdout: -2894> 2023-10-03T19:19:34.064+0000 7fd1a5470640 10 monclient: _check_auth_tickets 2023-10-03T19:21:26.402 INFO:teuthology.orchestra.run.smithi045.stdout: -2893> 2023-10-03T19:19:34.064+0000 7fd1a5470640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:04.069212+0000) 2023-10-03T19:21:26.402 INFO:teuthology.orchestra.run.smithi045.stdout: -2892> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 monclient: wait_auth_rotating waiting for 30 2023-10-03T19:21:26.402 INFO:teuthology.orchestra.run.smithi045.stdout: -2891> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 monclient: wait_auth_rotating done 2023-10-03T19:21:26.402 INFO:teuthology.orchestra.run.smithi045.stdout: -2890> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 monclient: _renew_subs 2023-10-03T19:21:26.402 INFO:teuthology.orchestra.run.smithi045.stdout: -2889> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.402 INFO:teuthology.orchestra.run.smithi045.stdout: -2888> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mdsmap=0+}) v3 -- 0x556317ae4d00 con 0x556317aaf800 2023-10-03T19:21:26.402 INFO:teuthology.orchestra.run.smithi045.stdout: -2887> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command status hook 0x556318881250 2023-10-03T19:21:26.402 INFO:teuthology.orchestra.run.smithi045.stdout: -2886> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command dump_ops_in_flight hook 0x556318881250 2023-10-03T19:21:26.402 INFO:teuthology.orchestra.run.smithi045.stdout: -2885> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command ops hook 0x556318881250 2023-10-03T19:21:26.402 INFO:teuthology.orchestra.run.smithi045.stdout: -2884> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command dump_blocked_ops hook 0x556318881250 2023-10-03T19:21:26.403 INFO:teuthology.orchestra.run.smithi045.stdout: -2883> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command dump_blocked_ops_count hook 0x556318881250 2023-10-03T19:21:26.403 INFO:teuthology.orchestra.run.smithi045.stdout: -2882> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command dump_historic_ops hook 0x556318881250 2023-10-03T19:21:26.403 INFO:teuthology.orchestra.run.smithi045.stdout: -2881> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command dump_historic_ops_by_duration hook 0x556318881250 2023-10-03T19:21:26.403 INFO:teuthology.orchestra.run.smithi045.stdout: -2880> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command scrub_path hook 0x556318881250 2023-10-03T19:21:26.403 INFO:teuthology.orchestra.run.smithi045.stdout: -2879> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command scrub start hook 0x556318881250 2023-10-03T19:21:26.403 INFO:teuthology.orchestra.run.smithi045.stdout: -2878> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command scrub abort hook 0x556318881250 2023-10-03T19:21:26.403 INFO:teuthology.orchestra.run.smithi045.stdout: -2877> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command scrub pause hook 0x556318881250 2023-10-03T19:21:26.403 INFO:teuthology.orchestra.run.smithi045.stdout: -2876> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command scrub resume hook 0x556318881250 2023-10-03T19:21:26.403 INFO:teuthology.orchestra.run.smithi045.stdout: -2875> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command scrub status hook 0x556318881250 2023-10-03T19:21:26.403 INFO:teuthology.orchestra.run.smithi045.stdout: -2874> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command tag path hook 0x556318881250 2023-10-03T19:21:26.404 INFO:teuthology.orchestra.run.smithi045.stdout: -2873> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command flush_path hook 0x556318881250 2023-10-03T19:21:26.404 INFO:teuthology.orchestra.run.smithi045.stdout: -2872> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command export dir hook 0x556318881250 2023-10-03T19:21:26.404 INFO:teuthology.orchestra.run.smithi045.stdout: -2871> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command dump cache hook 0x556318881250 2023-10-03T19:21:26.404 INFO:teuthology.orchestra.run.smithi045.stdout: -2870> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command cache drop hook 0x556318881250 2023-10-03T19:21:26.404 INFO:teuthology.orchestra.run.smithi045.stdout: -2869> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command cache status hook 0x556318881250 2023-10-03T19:21:26.404 INFO:teuthology.orchestra.run.smithi045.stdout: -2868> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command dump tree hook 0x556318881250 2023-10-03T19:21:26.404 INFO:teuthology.orchestra.run.smithi045.stdout: -2867> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command dump loads hook 0x556318881250 2023-10-03T19:21:26.404 INFO:teuthology.orchestra.run.smithi045.stdout: -2866> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command dump snaps hook 0x556318881250 2023-10-03T19:21:26.404 INFO:teuthology.orchestra.run.smithi045.stdout: -2865> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command session ls hook 0x556318881250 2023-10-03T19:21:26.404 INFO:teuthology.orchestra.run.smithi045.stdout: -2864> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command client ls hook 0x556318881250 2023-10-03T19:21:26.404 INFO:teuthology.orchestra.run.smithi045.stdout: -2863> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command session evict hook 0x556318881250 2023-10-03T19:21:26.404 INFO:teuthology.orchestra.run.smithi045.stdout: -2862> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command client evict hook 0x556318881250 2023-10-03T19:21:26.405 INFO:teuthology.orchestra.run.smithi045.stdout: -2861> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command session kill hook 0x556318881250 2023-10-03T19:21:26.405 INFO:teuthology.orchestra.run.smithi045.stdout: -2860> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command session ls hook 0x556318881250 2023-10-03T19:21:26.405 INFO:teuthology.orchestra.run.smithi045.stdout: -2859> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command session config hook 0x556318881250 2023-10-03T19:21:26.405 INFO:teuthology.orchestra.run.smithi045.stdout: -2858> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command client config hook 0x556318881250 2023-10-03T19:21:26.405 INFO:teuthology.orchestra.run.smithi045.stdout: -2857> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command damage ls hook 0x556318881250 2023-10-03T19:21:26.405 INFO:teuthology.orchestra.run.smithi045.stdout: -2856> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command damage rm hook 0x556318881250 2023-10-03T19:21:26.405 INFO:teuthology.orchestra.run.smithi045.stdout: -2855> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command osdmap barrier hook 0x556318881250 2023-10-03T19:21:26.405 INFO:teuthology.orchestra.run.smithi045.stdout: -2854> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command flush journal hook 0x556318881250 2023-10-03T19:21:26.405 INFO:teuthology.orchestra.run.smithi045.stdout: -2853> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command force_readonly hook 0x556318881250 2023-10-03T19:21:26.405 INFO:teuthology.orchestra.run.smithi045.stdout: -2852> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command get subtrees hook 0x556318881250 2023-10-03T19:21:26.405 INFO:teuthology.orchestra.run.smithi045.stdout: -2851> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command dirfrag split hook 0x556318881250 2023-10-03T19:21:26.406 INFO:teuthology.orchestra.run.smithi045.stdout: -2850> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command dirfrag merge hook 0x556318881250 2023-10-03T19:21:26.406 INFO:teuthology.orchestra.run.smithi045.stdout: -2849> 2023-10-03T19:19:34.064+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 5 ==== mdsmap(e 46) v2 ==== 225+0+0 (secure 0 0 0) 0x556317ae4d00 con 0x556317aaf800 2023-10-03T19:21:26.406 INFO:teuthology.orchestra.run.smithi045.stdout: -2848> 2023-10-03T19:19:34.064+0000 7fd1a5470640 1 mds.a Updating MDS map to version 46 from mon.0 2023-10-03T19:21:26.406 INFO:teuthology.orchestra.run.smithi045.stdout: -2847> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command dirfrag ls hook 0x556318881250 2023-10-03T19:21:26.406 INFO:teuthology.orchestra.run.smithi045.stdout: -2846> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command openfiles ls hook 0x556318881250 2023-10-03T19:21:26.406 INFO:teuthology.orchestra.run.smithi045.stdout: -2845> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command dump inode hook 0x556318881250 2023-10-03T19:21:26.406 INFO:teuthology.orchestra.run.smithi045.stdout: -2844> 2023-10-03T19:19:34.064+0000 7fd1a5470640 10 mds.a my compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-03T19:21:26.406 INFO:teuthology.orchestra.run.smithi045.stdout: -2843> 2023-10-03T19:19:34.064+0000 7fd1a5470640 10 mds.a mdsmap compat compat={},rocompat={},incompat={7=mds uses inline data} 2023-10-03T19:21:26.406 INFO:teuthology.orchestra.run.smithi045.stdout: -2842> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command dump dir hook 0x556318881250 2023-10-03T19:21:26.406 INFO:teuthology.orchestra.run.smithi045.stdout: -2841> 2023-10-03T19:19:34.064+0000 7fd1a5470640 10 mds.a my gid is 7155 2023-10-03T19:21:26.406 INFO:teuthology.orchestra.run.smithi045.stdout: -2840> 2023-10-03T19:19:34.064+0000 7fd1a5470640 10 mds.a map says I am mds.-1.-1 state null 2023-10-03T19:21:26.407 INFO:teuthology.orchestra.run.smithi045.stdout: -2839> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command exit hook 0x556318881250 2023-10-03T19:21:26.407 INFO:teuthology.orchestra.run.smithi045.stdout: -2838> 2023-10-03T19:19:34.064+0000 7fd1a5470640 10 mds.a msgr says I am [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] 2023-10-03T19:21:26.407 INFO:teuthology.orchestra.run.smithi045.stdout: -2837> 2023-10-03T19:19:34.064+0000 7fd1a5470640 10 mds.a handle_mds_map: handling map in rankless mode 2023-10-03T19:21:26.407 INFO:teuthology.orchestra.run.smithi045.stdout: -2836> 2023-10-03T19:19:34.064+0000 7fd1a5470640 10 mds.a not in map yet 2023-10-03T19:21:26.407 INFO:teuthology.orchestra.run.smithi045.stdout: -2835> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command respawn hook 0x556318881250 2023-10-03T19:21:26.411 INFO:teuthology.orchestra.run.smithi045.stdout: -2834> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command heap hook 0x556318881250 2023-10-03T19:21:26.412 INFO:teuthology.orchestra.run.smithi045.stdout: -2833> 2023-10-03T19:19:34.064+0000 7fd1a9cb5ac0 5 asok(0x556317b36000) register_command cpu_profiler hook 0x556318881250 2023-10-03T19:21:26.412 INFO:teuthology.orchestra.run.smithi045.stdout: -2832> 2023-10-03T19:19:34.064+0000 7fd1a346c640 5 mds.beacon.a Sending beacon up:boot seq 1 2023-10-03T19:21:26.412 INFO:teuthology.orchestra.run.smithi045.stdout: -2831> 2023-10-03T19:19:34.084+0000 7fd1a346c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.412 INFO:teuthology.orchestra.run.smithi045.stdout: -2830> 2023-10-03T19:19:34.084+0000 7fd1a346c640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mdsbeacon(7155/a up:boot seq=1 v46) v8 -- 0x556317b7adc0 con 0x556317aaf800 2023-10-03T19:21:26.412 INFO:teuthology.orchestra.run.smithi045.stdout: -2829> 2023-10-03T19:19:34.084+0000 7fd1a346c640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:26.412 INFO:teuthology.orchestra.run.smithi045.stdout: -2828> 2023-10-03T19:19:35.004+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 6 ==== mdsmap(e 47) v2 ==== 746+0+0 (secure 0 0 0) 0x556317ae56c0 con 0x556317aaf800 2023-10-03T19:21:26.412 INFO:teuthology.orchestra.run.smithi045.stdout: -2827> 2023-10-03T19:19:35.004+0000 7fd1a5470640 1 mds.a Updating MDS map to version 47 from mon.0 2023-10-03T19:21:26.412 INFO:teuthology.orchestra.run.smithi045.stdout: -2826> 2023-10-03T19:19:35.004+0000 7fd1a5470640 10 mds.a my compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-03T19:21:26.412 INFO:teuthology.orchestra.run.smithi045.stdout: -2825> 2023-10-03T19:19:35.004+0000 7fd1a5470640 10 mds.a mdsmap compat compat={},rocompat={},incompat={7=mds uses inline data} 2023-10-03T19:21:26.412 INFO:teuthology.orchestra.run.smithi045.stdout: -2824> 2023-10-03T19:19:35.004+0000 7fd1a5470640 10 mds.a my gid is 7155 2023-10-03T19:21:26.412 INFO:teuthology.orchestra.run.smithi045.stdout: -2823> 2023-10-03T19:19:35.004+0000 7fd1a5470640 10 mds.a map says I am mds.-1.0 state up:standby 2023-10-03T19:21:26.413 INFO:teuthology.orchestra.run.smithi045.stdout: -2822> 2023-10-03T19:19:35.004+0000 7fd1a5470640 10 mds.a msgr says I am [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] 2023-10-03T19:21:26.413 INFO:teuthology.orchestra.run.smithi045.stdout: -2821> 2023-10-03T19:19:35.004+0000 7fd1a5470640 10 monclient: _renew_subs 2023-10-03T19:21:26.413 INFO:teuthology.orchestra.run.smithi045.stdout: -2820> 2023-10-03T19:19:35.004+0000 7fd1a5470640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.413 INFO:teuthology.orchestra.run.smithi045.stdout: -2819> 2023-10-03T19:19:35.004+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556317ae4d00 con 0x556317aaf800 2023-10-03T19:21:26.413 INFO:teuthology.orchestra.run.smithi045.stdout: -2818> 2023-10-03T19:19:35.004+0000 7fd1a5470640 10 mds.a handle_mds_map: handling map in rankless mode 2023-10-03T19:21:26.413 INFO:teuthology.orchestra.run.smithi045.stdout: -2817> 2023-10-03T19:19:35.004+0000 7fd1a5470640 1 mds.a Monitors have assigned me to become a standby. 2023-10-03T19:21:26.413 INFO:teuthology.orchestra.run.smithi045.stdout: -2816> 2023-10-03T19:19:35.004+0000 7fd1a5470640 5 mds.beacon.a set_want_state: up:boot -> up:standby 2023-10-03T19:21:26.413 INFO:teuthology.orchestra.run.smithi045.stdout: -2815> 2023-10-03T19:19:35.008+0000 7fd1a8476640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 7 ==== mdsbeacon(7155/a up:boot seq=1 v47) v8 ==== 134+0+0 (secure 0 0 0) 0x556317b7adc0 con 0x556317aaf800 2023-10-03T19:21:26.413 INFO:teuthology.orchestra.run.smithi045.stdout: -2814> 2023-10-03T19:19:35.008+0000 7fd1a8476640 5 mds.beacon.a received beacon reply up:boot seq 1 rtt 0.94399 2023-10-03T19:21:26.413 INFO:teuthology.orchestra.run.smithi045.stdout: -2813> 2023-10-03T19:19:35.008+0000 7fd1a346c640 20 mds.beacon.a sender thread waiting interval 3.05601s 2023-10-03T19:21:26.414 INFO:teuthology.orchestra.run.smithi045.stdout: -2812> 2023-10-03T19:19:35.012+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 8 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x556317b7adc0 con 0x556317aaf800 2023-10-03T19:21:26.414 INFO:teuthology.orchestra.run.smithi045.stdout: -2811> 2023-10-03T19:19:35.012+0000 7fd1a5470640 4 mgrc handle_mgr_map Got map version 5 2023-10-03T19:21:26.414 INFO:teuthology.orchestra.run.smithi045.stdout: -2810> 2023-10-03T19:19:35.012+0000 7fd1a5470640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] 2023-10-03T19:21:26.414 INFO:teuthology.orchestra.run.smithi045.stdout: -2809> 2023-10-03T19:19:35.012+0000 7fd1a5470640 4 mgrc reconnect Starting new session with [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] 2023-10-03T19:21:26.414 INFO:teuthology.orchestra.run.smithi045.stdout: -2808> 2023-10-03T19:19:35.012+0000 7fd1a5470640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x5563189cc000 0x556317b3c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:26.414 INFO:teuthology.orchestra.run.smithi045.stdout: -2807> 2023-10-03T19:19:35.012+0000 7fd1a7c75640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x5563189cc000 0x556317b3c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:26.414 INFO:teuthology.orchestra.run.smithi045.stdout: -2806> 2023-10-03T19:19:35.012+0000 7fd1a7c75640 10 monclient: get_auth_request con 0x5563189cc000 auth_method 0 2023-10-03T19:21:26.414 INFO:teuthology.orchestra.run.smithi045.stdout: -2805> 2023-10-03T19:19:35.016+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgropen(unknown.a) v3 -- 0x556317c16fc0 con 0x5563189cc000 2023-10-03T19:21:26.414 INFO:teuthology.orchestra.run.smithi045.stdout: -2804> 2023-10-03T19:19:35.016+0000 7fd1a7c75640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x5563189cc000 0x556317b3c100 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x556317b788a0 tx=0x556318830f00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:26.414 INFO:teuthology.orchestra.run.smithi045.stdout: -2803> 2023-10-03T19:19:35.016+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgrconfigure(period=5, threshold=5) v4 ==== 27+0+0 (secure 0 0 0) 0x556317aeec40 con 0x5563189cc000 2023-10-03T19:21:26.414 INFO:teuthology.orchestra.run.smithi045.stdout: -2802> 2023-10-03T19:19:35.016+0000 7fd1a5470640 4 mgrc handle_mgr_configure stats_period=5 2023-10-03T19:21:26.415 INFO:teuthology.orchestra.run.smithi045.stdout: -2801> 2023-10-03T19:19:35.016+0000 7fd1a5470640 4 mgrc handle_mgr_configure updated stats threshold: 5 2023-10-03T19:21:26.415 INFO:teuthology.orchestra.run.smithi045.stdout: -2800> 2023-10-03T19:19:35.016+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgrreport(unknown.a +0-0 packed 6 task_status=0) v9 -- 0x556317b05180 con 0x5563189cc000 2023-10-03T19:21:26.415 INFO:teuthology.orchestra.run.smithi045.stdout: -2799> 2023-10-03T19:19:37.064+0000 7fd1a446e640 10 monclient: tick 2023-10-03T19:21:26.415 INFO:teuthology.orchestra.run.smithi045.stdout: -2798> 2023-10-03T19:19:37.064+0000 7fd1a446e640 10 monclient: _check_auth_tickets 2023-10-03T19:21:26.415 INFO:teuthology.orchestra.run.smithi045.stdout: -2797> 2023-10-03T19:19:37.064+0000 7fd1a446e640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:07.068222+0000) 2023-10-03T19:21:26.415 INFO:teuthology.orchestra.run.smithi045.stdout: -2796> 2023-10-03T19:19:38.064+0000 7fd1a446e640 10 monclient: tick 2023-10-03T19:21:26.415 INFO:teuthology.orchestra.run.smithi045.stdout: -2795> 2023-10-03T19:19:38.064+0000 7fd1a446e640 10 monclient: _check_auth_tickets 2023-10-03T19:21:26.415 INFO:teuthology.orchestra.run.smithi045.stdout: -2794> 2023-10-03T19:19:38.064+0000 7fd1a446e640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:08.068359+0000) 2023-10-03T19:21:26.415 INFO:teuthology.orchestra.run.smithi045.stdout: -2793> 2023-10-03T19:19:38.064+0000 7fd1a346c640 5 mds.beacon.a Sending beacon up:standby seq 2 2023-10-03T19:21:26.415 INFO:teuthology.orchestra.run.smithi045.stdout: -2792> 2023-10-03T19:19:38.064+0000 7fd1a346c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.415 INFO:teuthology.orchestra.run.smithi045.stdout: -2791> 2023-10-03T19:19:38.064+0000 7fd1a346c640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mdsbeacon(7155/a up:standby seq=2 v47) v8 -- 0x556317b7ab00 con 0x556317aaf800 2023-10-03T19:21:26.415 INFO:teuthology.orchestra.run.smithi045.stdout: -2790> 2023-10-03T19:19:38.064+0000 7fd1a346c640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:26.416 INFO:teuthology.orchestra.run.smithi045.stdout: -2789> 2023-10-03T19:19:38.064+0000 7fd1a8476640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 9 ==== mdsbeacon(7155/a up:standby seq=2 v47) v8 ==== 130+0+0 (secure 0 0 0) 0x556317b7ab00 con 0x556317aaf800 2023-10-03T19:21:26.416 INFO:teuthology.orchestra.run.smithi045.stdout: -2788> 2023-10-03T19:19:38.064+0000 7fd1a8476640 5 mds.beacon.a received beacon reply up:standby seq 2 rtt 0 2023-10-03T19:21:26.416 INFO:teuthology.orchestra.run.smithi045.stdout: -2787> 2023-10-03T19:19:38.064+0000 7fd1a346c640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:26.416 INFO:teuthology.orchestra.run.smithi045.stdout: -2786> 2023-10-03T19:19:39.064+0000 7fd1a446e640 10 monclient: tick 2023-10-03T19:21:26.416 INFO:teuthology.orchestra.run.smithi045.stdout: -2785> 2023-10-03T19:19:39.064+0000 7fd1a446e640 10 monclient: _check_auth_tickets 2023-10-03T19:21:26.416 INFO:teuthology.orchestra.run.smithi045.stdout: -2784> 2023-10-03T19:19:39.064+0000 7fd1a446e640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:09.068467+0000) 2023-10-03T19:21:26.416 INFO:teuthology.orchestra.run.smithi045.stdout: -2783> 2023-10-03T19:19:39.420+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 10 ==== mdsmap(e 48) v2 ==== 1100+0+0 (secure 0 0 0) 0x55631896b860 con 0x556317aaf800 2023-10-03T19:21:26.416 INFO:teuthology.orchestra.run.smithi045.stdout: -2782> 2023-10-03T19:19:39.420+0000 7fd1a5470640 1 mds.a Updating MDS map to version 48 from mon.0 2023-10-03T19:21:26.416 INFO:teuthology.orchestra.run.smithi045.stdout: -2781> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.a my compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-03T19:21:26.416 INFO:teuthology.orchestra.run.smithi045.stdout: -2780> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.a mdsmap compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-03T19:21:26.416 INFO:teuthology.orchestra.run.smithi045.stdout: -2779> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.a my gid is 7155 2023-10-03T19:21:26.417 INFO:teuthology.orchestra.run.smithi045.stdout: -2778> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.a map says I am mds.0.48 state up:creating 2023-10-03T19:21:26.417 INFO:teuthology.orchestra.run.smithi045.stdout: -2777> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.a msgr says I am [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] 2023-10-03T19:21:26.417 INFO:teuthology.orchestra.run.smithi045.stdout: -2776> 2023-10-03T19:19:39.420+0000 7fd1a5470640 4 mds.0.purge_queue operator(): data pool 16 not found in OSDMap 2023-10-03T19:21:26.417 INFO:teuthology.orchestra.run.smithi045.stdout: -2775> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 mds.0.0 schedule_update_timer_task 2023-10-03T19:21:26.417 INFO:teuthology.orchestra.run.smithi045.stdout: -2774> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.a handle_mds_map: initializing MDS rank 0 2023-10-03T19:21:26.417 INFO:teuthology.orchestra.run.smithi045.stdout: -2773> 2023-10-03T19:19:39.420+0000 7fd1a5470640 5 asok(0x556317b36000) register_command objecter_requests hook 0x5563188812e0 2023-10-03T19:21:26.417 INFO:teuthology.orchestra.run.smithi045.stdout: -2772> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 monclient: _renew_subs 2023-10-03T19:21:26.417 INFO:teuthology.orchestra.run.smithi045.stdout: -2771> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.417 INFO:teuthology.orchestra.run.smithi045.stdout: -2770> 2023-10-03T19:19:39.420+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55631891fa00 con 0x556317aaf800 2023-10-03T19:21:26.417 INFO:teuthology.orchestra.run.smithi045.stdout: -2769> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 log_channel(cluster) update_config to_monitors: true to_syslog: false syslog_facility: prio: info to_graylog: false graylog_host: 127.0.0.1 graylog_port: 12201) 2023-10-03T19:21:26.417 INFO:teuthology.orchestra.run.smithi045.stdout: -2768> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.0 update_log_config log_to_monitors true 2023-10-03T19:21:26.417 INFO:teuthology.orchestra.run.smithi045.stdout: -2767> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.0 create_logger 2023-10-03T19:21:26.418 INFO:teuthology.orchestra.run.smithi045.stdout: -2766> 2023-10-03T19:19:39.420+0000 7fd1a5470640 7 mds.0.server operator(): full = 0 epoch = 0 2023-10-03T19:21:26.418 INFO:teuthology.orchestra.run.smithi045.stdout: -2765> 2023-10-03T19:19:39.420+0000 7fd1a5470640 4 mds.0.purge_queue operator(): data pool 16 not found in OSDMap 2023-10-03T19:21:26.418 INFO:teuthology.orchestra.run.smithi045.stdout: -2764> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.server apply_blocklist: killed 0 2023-10-03T19:21:26.418 INFO:teuthology.orchestra.run.smithi045.stdout: -2763> 2023-10-03T19:19:39.420+0000 7fd1a5470640 4 mds.0.0 apply_blocklist: killed 0, blocklisted sessions (0 blocklist entries, 0) 2023-10-03T19:21:26.418 INFO:teuthology.orchestra.run.smithi045.stdout: -2762> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.a handle_mds_map: handling map as rank 0 2023-10-03T19:21:26.418 INFO:teuthology.orchestra.run.smithi045.stdout: -2761> 2023-10-03T19:19:39.420+0000 7fd1a5470640 1 mds.0.48 handle_mds_map i am now mds.0.48 2023-10-03T19:21:26.418 INFO:teuthology.orchestra.run.smithi045.stdout: -2760> 2023-10-03T19:19:39.420+0000 7fd1a5470640 1 mds.0.48 handle_mds_map state change up:standby --> up:creating 2023-10-03T19:21:26.418 INFO:teuthology.orchestra.run.smithi045.stdout: -2759> 2023-10-03T19:19:39.420+0000 7fd1a5470640 5 mds.beacon.a set_want_state: up:standby -> up:creating 2023-10-03T19:21:26.418 INFO:teuthology.orchestra.run.smithi045.stdout: -2758> 2023-10-03T19:19:39.420+0000 7fd1a5470640 3 mds.0.48 boot_create 2023-10-03T19:21:26.418 INFO:teuthology.orchestra.run.smithi045.stdout: -2757> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.48 boot_create creating fresh journal 2023-10-03T19:21:26.418 INFO:teuthology.orchestra.run.smithi045.stdout: -2756> 2023-10-03T19:19:39.420+0000 7fd1a5470640 5 mds.0.log create empty log 2023-10-03T19:21:26.419 INFO:teuthology.orchestra.run.smithi045.stdout: -2755> 2023-10-03T19:19:39.420+0000 7fd1a5470640 1 mds.0.journaler.mdlog(ro) set_writeable 2023-10-03T19:21:26.419 INFO:teuthology.orchestra.run.smithi045.stdout: -2754> 2023-10-03T19:19:39.420+0000 7fd1a5470640 1 mds.0.journaler.mdlog(rw) created blank journal at inode 0x0x200, format=1 2023-10-03T19:21:26.419 INFO:teuthology.orchestra.run.smithi045.stdout: -2753> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.419 INFO:teuthology.orchestra.run.smithi045.stdout: -2752> 2023-10-03T19:19:39.420+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x556317b13080 con 0x556317aaf800 2023-10-03T19:21:26.419 INFO:teuthology.orchestra.run.smithi045.stdout: -2751> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.419 INFO:teuthology.orchestra.run.smithi045.stdout: -2750> 2023-10-03T19:19:39.420+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=2) v1 -- 0x556317b12f20 con 0x556317aaf800 2023-10-03T19:21:26.419 INFO:teuthology.orchestra.run.smithi045.stdout: -2749> 2023-10-03T19:19:39.420+0000 7fd1a5470640 7 mds.0.log _prepare_new_segment seq 1 2023-10-03T19:21:26.419 INFO:teuthology.orchestra.run.smithi045.stdout: -2748> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache advance_stray to index 1 fragmenting index -1 2023-10-03T19:21:26.419 INFO:teuthology.orchestra.run.smithi045.stdout: -2747> 2023-10-03T19:19:39.420+0000 7fd1a5470640 3 mds.0.48 boot_create creating fresh hierarchy 2023-10-03T19:21:26.419 INFO:teuthology.orchestra.run.smithi045.stdout: -2746> 2023-10-03T19:19:39.420+0000 7fd1a5470640 0 mds.0.cache creating system inode with ino:0x1 2023-10-03T19:21:26.419 INFO:teuthology.orchestra.run.smithi045.stdout: -2745> 2023-10-03T19:19:39.420+0000 7fd19ec63640 10 mds.0.log _submit_thread start 2023-10-03T19:21:26.419 INFO:teuthology.orchestra.run.smithi045.stdout: -2744> 2023-10-03T19:19:39.420+0000 7fd1a5470640 7 mds.0.cache adjust_subtree_auth -1,-2 -> 0,-2 on [dir 0x1 / [2,head] auth v=0 cv=0/0 state=1073741824 f() n() hs=0+0,ss=0+0 0x556317b1d180] 2023-10-03T19:21:26.420 INFO:teuthology.orchestra.run.smithi045.stdout: -2743> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache show_subtrees - no subtrees 2023-10-03T19:21:26.420 INFO:teuthology.orchestra.run.smithi045.stdout: -2742> 2023-10-03T19:19:39.420+0000 7fd1a5470640 7 mds.0.cache current root is [dir 0x1 / [2,head] auth v=0 cv=0/0 state=1073741824 f() n() hs=0+0,ss=0+0 | subtree=1 0x556317b1d180] 2023-10-03T19:21:26.420 INFO:teuthology.orchestra.run.smithi045.stdout: -2741> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x1) setting dir_auth=0,-2 from -1,-2 on [dir 0x1 / [2,head] auth v=0 cv=0/0 state=1073741824 f() n() hs=0+0,ss=0+0 | subtree=1 0x556317b1d180] 2023-10-03T19:21:26.420 INFO:teuthology.orchestra.run.smithi045.stdout: -2740> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x1) new subtree root, adjusting auth_pins 2023-10-03T19:21:26.420 INFO:teuthology.orchestra.run.smithi045.stdout: -2739> 2023-10-03T19:19:39.420+0000 7fd1a5470640 15 mds.0.cache show_subtrees 2023-10-03T19:21:26.420 INFO:teuthology.orchestra.run.smithi045.stdout: -2738> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache |__ 0 auth [dir 0x1 / [2,head] auth v=0 cv=0/0 dir_auth=0 state=1073741824 f() n() hs=0+0,ss=0+0 | subtree=1 0x556317b1d180] 2023-10-03T19:21:26.420 INFO:teuthology.orchestra.run.smithi045.stdout: -2737> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x1) pre_dirty 1 2023-10-03T19:21:26.420 INFO:teuthology.orchestra.run.smithi045.stdout: -2736> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x1) _mark_dirty (was clean) [dir 0x1 / [2,head] auth v=1 cv=0/0 REP dir_auth=0 state=1073741825|complete f() n() hs=0+0,ss=0+0 | subtree=1 0x556317b1d180] version 1 2023-10-03T19:21:26.420 INFO:teuthology.orchestra.run.smithi045.stdout: -2735> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x1) commit want 0 on [dir 0x1 / [2,head] auth v=1 cv=0/0 REP dir_auth=0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | subtree=1 dirty=1 0x556317b1d180] 2023-10-03T19:21:26.420 INFO:teuthology.orchestra.run.smithi045.stdout: -2734> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x1) auth_pin by 0x556317b1d180 on [dir 0x1 / [2,head] auth v=1 cv=0/0 REP dir_auth=0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | subtree=1 dirty=1 authpin=1 0x556317b1d180] count now 1 2023-10-03T19:21:26.420 INFO:teuthology.orchestra.run.smithi045.stdout: -2733> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x1) _commit want 1 on [dir 0x1 / [2,head] auth v=1 cv=0/0 REP dir_auth=0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | subtree=1 dirty=1 authpin=1 0x556317b1d180] 2023-10-03T19:21:26.421 INFO:teuthology.orchestra.run.smithi045.stdout: -2732> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x1) marking committing 2023-10-03T19:21:26.421 INFO:teuthology.orchestra.run.smithi045.stdout: -2731> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 mds.0.bal hit_dir 4 pop is 1, frag * size 0 [pop IRD:[C 0.00e+00] IWR:[C 0.00e+00] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 1.00e+00] *LOAD:4.0] 2023-10-03T19:21:26.421 INFO:teuthology.orchestra.run.smithi045.stdout: -2730> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x1) _omap_commit 2023-10-03T19:21:26.421 INFO:teuthology.orchestra.run.smithi045.stdout: -2729> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.snaprealm(0x1 seq 1 0x556317c178c0) build_snap_set on snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:19:39.424362+0000 change_attr 0 0x556317c178c0) 2023-10-03T19:21:26.421 INFO:teuthology.orchestra.run.smithi045.stdout: -2728> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.snaprealm(0x1 seq 1 0x556317c178c0) build_snap_trace my_snaps [] 2023-10-03T19:21:26.421 INFO:teuthology.orchestra.run.smithi045.stdout: -2727> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.snaprealm(0x1 seq 1 0x556317c178c0) check_cache rebuilt seq 1 cached_seq 1 cached_last_created 0 cached_last_destroyed 0) 2023-10-03T19:21:26.421 INFO:teuthology.orchestra.run.smithi045.stdout: -2726> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) store 1 2023-10-03T19:21:26.421 INFO:teuthology.orchestra.run.smithi045.stdout: -2725> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.snaprealm(0x1 seq 1 0x556317c178c0) get_snaps (seq 1 cached_seq 1) 2023-10-03T19:21:26.421 INFO:teuthology.orchestra.run.smithi045.stdout: -2724> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) purge_stale_snap_data 2023-10-03T19:21:26.421 INFO:teuthology.orchestra.run.smithi045.stdout: -2723> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 mds.0.cache.ino(0x1) encode_snap_blob snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:19:39.424362+0000 change_attr 0 0x556317c178c0) 2023-10-03T19:21:26.421 INFO:teuthology.orchestra.run.smithi045.stdout: -2722> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.421 INFO:teuthology.orchestra.run.smithi045.stdout: -2721> 2023-10-03T19:19:39.420+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=3) v1 -- 0x556317b13600 con 0x556317aaf800 2023-10-03T19:21:26.422 INFO:teuthology.orchestra.run.smithi045.stdout: -2720> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) mark_dirty_parent 2023-10-03T19:21:26.422 INFO:teuthology.orchestra.run.smithi045.stdout: -2719> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) _store_backtrace on [inode 0x1 [...2,head] / auth v1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 0x556317b3c680] 2023-10-03T19:21:26.422 INFO:teuthology.orchestra.run.smithi045.stdout: -2718> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) auth_pin by 0x556317b3c680 on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x556317b3c680] now 1 2023-10-03T19:21:26.422 INFO:teuthology.orchestra.run.smithi045.stdout: -2717> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 mds.0.cache.ino(0x1) _store_backtrace: no dirtypool or no old pools 2023-10-03T19:21:26.422 INFO:teuthology.orchestra.run.smithi045.stdout: -2716> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) _commit_ops 2023-10-03T19:21:26.422 INFO:teuthology.orchestra.run.smithi045.stdout: -2715> 2023-10-03T19:19:39.420+0000 7fd19f464640 10 mds.0.cache.dir(0x1) _omap_commit_ops 2023-10-03T19:21:26.422 INFO:teuthology.orchestra.run.smithi045.stdout: -2714> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.422 INFO:teuthology.orchestra.run.smithi045.stdout: -2713> 2023-10-03T19:19:39.420+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=4) v1 -- 0x556317b12dc0 con 0x556317aaf800 2023-10-03T19:21:26.422 INFO:teuthology.orchestra.run.smithi045.stdout: -2712> 2023-10-03T19:19:39.420+0000 7fd1a5470640 3 mds.0.48 boot_create creating mydir hierarchy 2023-10-03T19:21:26.422 INFO:teuthology.orchestra.run.smithi045.stdout: -2711> 2023-10-03T19:19:39.420+0000 7fd1a5470640 0 mds.0.cache creating system inode with ino:0x100 2023-10-03T19:21:26.422 INFO:teuthology.orchestra.run.smithi045.stdout: -2710> 2023-10-03T19:19:39.420+0000 7fd1a5470640 7 mds.0.cache adjust_subtree_auth -1,-2 -> 0,-2 on [dir 0x100 ~mds0/ [2,head] auth v=0 cv=0/0 state=1073741824 f() n() hs=0+0,ss=0+0 0x556317b1d600] 2023-10-03T19:21:26.423 INFO:teuthology.orchestra.run.smithi045.stdout: -2709> 2023-10-03T19:19:39.420+0000 7fd19f464640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.423 INFO:teuthology.orchestra.run.smithi045.stdout: -2708> 2023-10-03T19:19:39.420+0000 7fd1a5470640 15 mds.0.cache show_subtrees 2023-10-03T19:21:26.423 INFO:teuthology.orchestra.run.smithi045.stdout: -2707> 2023-10-03T19:19:39.420+0000 7fd19f464640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=5) v1 -- 0x556317b12420 con 0x556317aaf800 2023-10-03T19:21:26.423 INFO:teuthology.orchestra.run.smithi045.stdout: -2706> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache |__ 0 auth [dir 0x1 / [2,head] auth v=1 cv=1/0 REP dir_auth=0 ap=1+0 state=1610612769|complete|committing f() n() hs=0+0,ss=0+0 | subtree=1 dirty=1 authpin=1 0x556317b1d180] 2023-10-03T19:21:26.423 INFO:teuthology.orchestra.run.smithi045.stdout: -2705> 2023-10-03T19:19:39.420+0000 7fd1a5470640 7 mds.0.cache current root is [dir 0x100 ~mds0/ [2,head] auth v=0 cv=0/0 state=1073741824 f() n() hs=0+0,ss=0+0 | subtree=1 0x556317b1d600] 2023-10-03T19:21:26.423 INFO:teuthology.orchestra.run.smithi045.stdout: -2704> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x100) setting dir_auth=0,-2 from -1,-2 on [dir 0x100 ~mds0/ [2,head] auth v=0 cv=0/0 state=1073741824 f() n() hs=0+0,ss=0+0 | subtree=1 0x556317b1d600] 2023-10-03T19:21:26.423 INFO:teuthology.orchestra.run.smithi045.stdout: -2703> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x100) new subtree root, adjusting auth_pins 2023-10-03T19:21:26.423 INFO:teuthology.orchestra.run.smithi045.stdout: -2702> 2023-10-03T19:19:39.420+0000 7fd1a5470640 15 mds.0.cache show_subtrees 2023-10-03T19:21:26.423 INFO:teuthology.orchestra.run.smithi045.stdout: -2701> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache |__ 0 auth [dir 0x1 / [2,head] auth v=1 cv=1/0 REP dir_auth=0 ap=1+0 state=1610612769|complete|committing f() n() hs=0+0,ss=0+0 | subtree=1 dirty=1 authpin=1 0x556317b1d180] 2023-10-03T19:21:26.423 INFO:teuthology.orchestra.run.smithi045.stdout: -2700> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache |__ 0 auth [dir 0x100 ~mds0/ [2,head] auth v=0 cv=0/0 dir_auth=0 state=1073741824 f() n() hs=0+0,ss=0+0 | subtree=1 0x556317b1d600] 2023-10-03T19:21:26.423 INFO:teuthology.orchestra.run.smithi045.stdout: -2699> 2023-10-03T19:19:39.420+0000 7fd1a5470640 0 mds.0.cache creating system inode with ino:0x600 2023-10-03T19:21:26.424 INFO:teuthology.orchestra.run.smithi045.stdout: -2698> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 mds.0.cache.dir(0x100) lookup_exact_snap (head, 'stray0') 2023-10-03T19:21:26.424 INFO:teuthology.orchestra.run.smithi045.stdout: -2697> 2023-10-03T19:19:39.420+0000 7fd1a5470640 12 mds.0.cache.dir(0x100) add_primary_dentry [dentry #0x100/stray0 [2,head] auth (dversion lock) v=0 ino=0x600 state=1073741824 0x55631882c500] 2023-10-03T19:21:26.424 INFO:teuthology.orchestra.run.smithi045.stdout: -2696> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x600) pre_dirty 1 2023-10-03T19:21:26.424 INFO:teuthology.orchestra.run.smithi045.stdout: -2695> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x600) _mark_dirty (was clean) [dir 0x600 ~mds0/stray0/ [2,head] auth v=1 cv=0/0 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x556317b1da80] version 1 2023-10-03T19:21:26.424 INFO:teuthology.orchestra.run.smithi045.stdout: -2694> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x600) commit want 0 on [dir 0x600 ~mds0/stray0/ [2,head] auth v=1 cv=0/0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 0x556317b1da80] 2023-10-03T19:21:26.424 INFO:teuthology.orchestra.run.smithi045.stdout: -2693> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x600) auth_pin by 0x556317b1da80 on [dir 0x600 ~mds0/stray0/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556317b1da80] count now 1 2023-10-03T19:21:26.424 INFO:teuthology.orchestra.run.smithi045.stdout: -2692> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x600) _commit want 1 on [dir 0x600 ~mds0/stray0/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556317b1da80] 2023-10-03T19:21:26.424 INFO:teuthology.orchestra.run.smithi045.stdout: -2691> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x600) marking committing 2023-10-03T19:21:26.424 INFO:teuthology.orchestra.run.smithi045.stdout: -2690> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x600) _omap_commit 2023-10-03T19:21:26.424 INFO:teuthology.orchestra.run.smithi045.stdout: -2689> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.snaprealm(0x100 seq 1 0x556317c17b00) build_snap_set on snaprealm(0x100 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 0.000000 change_attr 0 0x556317c17b00) 2023-10-03T19:21:26.424 INFO:teuthology.orchestra.run.smithi045.stdout: -2688> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.snaprealm(0x100 seq 1 0x556317c17b00) build_snap_trace my_snaps [] 2023-10-03T19:21:26.425 INFO:teuthology.orchestra.run.smithi045.stdout: -2687> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.snaprealm(0x100 seq 1 0x556317c17b00) check_cache rebuilt seq 1 cached_seq 1 cached_last_created 0 cached_last_destroyed 0) 2023-10-03T19:21:26.425 INFO:teuthology.orchestra.run.smithi045.stdout: -2686> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x600) mark_dirty_parent 2023-10-03T19:21:26.425 INFO:teuthology.orchestra.run.smithi045.stdout: -2685> 2023-10-03T19:19:39.420+0000 7fd19f464640 10 mds.0.cache.dir(0x600) _omap_commit_ops 2023-10-03T19:21:26.425 INFO:teuthology.orchestra.run.smithi045.stdout: -2684> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x600) _store_backtrace on [inode 0x600 [...2,head] ~mds0/stray0/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.424687+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 0x556317b3d180] 2023-10-03T19:21:26.425 INFO:teuthology.orchestra.run.smithi045.stdout: -2683> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x600) auth_pin by 0x556317b3d180 on [inode 0x600 [...2,head] ~mds0/stray0/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.424687+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x556317b3d180] now 1 2023-10-03T19:21:26.425 INFO:teuthology.orchestra.run.smithi045.stdout: -2682> 2023-10-03T19:19:39.420+0000 7fd1a5470640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins 1 on [dir 0x100 ~mds0/ [2,head] auth v=0 cv=0/0 dir_auth=0 ap=0+1 state=1073741824 f(v0 1=0+1)/f() n(v0 rc2023-10-03T19:19:39.424687+0000 1=0+1)/n() hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 0x556317b1d600] by 0x556317b3d180 count now 0/1 2023-10-03T19:21:26.425 INFO:teuthology.orchestra.run.smithi045.stdout: -2681> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 mds.0.cache.ino(0x600) _store_backtrace: no dirtypool or no old pools 2023-10-03T19:21:26.425 INFO:teuthology.orchestra.run.smithi045.stdout: -2680> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x600) _commit_ops 2023-10-03T19:21:26.425 INFO:teuthology.orchestra.run.smithi045.stdout: -2679> 2023-10-03T19:19:39.420+0000 7fd19f464640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.425 INFO:teuthology.orchestra.run.smithi045.stdout: -2678> 2023-10-03T19:19:39.420+0000 7fd19f464640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=6) v1 -- 0x556317b13080 con 0x556317aaf800 2023-10-03T19:21:26.425 INFO:teuthology.orchestra.run.smithi045.stdout: -2677> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.425 INFO:teuthology.orchestra.run.smithi045.stdout: -2676> 2023-10-03T19:19:39.420+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=7) v1 -- 0x556317b12dc0 con 0x556317aaf800 2023-10-03T19:21:26.426 INFO:teuthology.orchestra.run.smithi045.stdout: -2675> 2023-10-03T19:19:39.420+0000 7fd1a5470640 0 mds.0.cache creating system inode with ino:0x601 2023-10-03T19:21:26.426 INFO:teuthology.orchestra.run.smithi045.stdout: -2674> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 mds.0.cache.dir(0x100) lookup_exact_snap (head, 'stray1') 2023-10-03T19:21:26.426 INFO:teuthology.orchestra.run.smithi045.stdout: -2673> 2023-10-03T19:19:39.420+0000 7fd1a5470640 12 mds.0.cache.dir(0x100) add_primary_dentry [dentry #0x100/stray1 [2,head] auth (dversion lock) v=0 ino=0x601 state=1073741824 0x55631882c780] 2023-10-03T19:21:26.426 INFO:teuthology.orchestra.run.smithi045.stdout: -2672> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x601) pre_dirty 1 2023-10-03T19:21:26.426 INFO:teuthology.orchestra.run.smithi045.stdout: -2671> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x601) _mark_dirty (was clean) [dir 0x601 ~mds0/stray1/ [2,head] auth v=1 cv=0/0 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x556318a50000] version 1 2023-10-03T19:21:26.426 INFO:teuthology.orchestra.run.smithi045.stdout: -2670> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x601) commit want 0 on [dir 0x601 ~mds0/stray1/ [2,head] auth v=1 cv=0/0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 0x556318a50000] 2023-10-03T19:21:26.426 INFO:teuthology.orchestra.run.smithi045.stdout: -2669> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x601) auth_pin by 0x556318a50000 on [dir 0x601 ~mds0/stray1/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a50000] count now 1 2023-10-03T19:21:26.426 INFO:teuthology.orchestra.run.smithi045.stdout: -2668> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x601) _commit want 1 on [dir 0x601 ~mds0/stray1/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a50000] 2023-10-03T19:21:26.426 INFO:teuthology.orchestra.run.smithi045.stdout: -2667> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x601) marking committing 2023-10-03T19:21:26.426 INFO:teuthology.orchestra.run.smithi045.stdout: -2666> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x601) _omap_commit 2023-10-03T19:21:26.426 INFO:teuthology.orchestra.run.smithi045.stdout: -2665> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x601) mark_dirty_parent 2023-10-03T19:21:26.427 INFO:teuthology.orchestra.run.smithi045.stdout: -2664> 2023-10-03T19:19:39.420+0000 7fd19f464640 10 mds.0.cache.dir(0x601) _omap_commit_ops 2023-10-03T19:21:26.427 INFO:teuthology.orchestra.run.smithi045.stdout: -2663> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x601) _store_backtrace on [inode 0x601 [...2,head] ~mds0/stray1/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.424810+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 0x556317b3d700] 2023-10-03T19:21:26.427 INFO:teuthology.orchestra.run.smithi045.stdout: -2662> 2023-10-03T19:19:39.420+0000 7fd19f464640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.427 INFO:teuthology.orchestra.run.smithi045.stdout: -2661> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x601) auth_pin by 0x556317b3d700 on [inode 0x601 [...2,head] ~mds0/stray1/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.424810+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x556317b3d700] now 1 2023-10-03T19:21:26.427 INFO:teuthology.orchestra.run.smithi045.stdout: -2660> 2023-10-03T19:19:39.420+0000 7fd19f464640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=8) v1 -- 0x556317b12f20 con 0x556317aaf800 2023-10-03T19:21:26.427 INFO:teuthology.orchestra.run.smithi045.stdout: -2659> 2023-10-03T19:19:39.420+0000 7fd1a5470640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins 1 on [dir 0x100 ~mds0/ [2,head] auth v=0 cv=0/0 dir_auth=0 ap=0+2 state=1073741824 f(v0 2=0+2)/f() n(v0 rc2023-10-03T19:19:39.424810+0000 2=0+2)/n() hs=2+0,ss=0+0 dirty=2 | child=1 subtree=1 0x556317b1d600] by 0x556317b3d700 count now 0/2 2023-10-03T19:21:26.427 INFO:teuthology.orchestra.run.smithi045.stdout: -2658> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 mds.0.cache.ino(0x601) _store_backtrace: no dirtypool or no old pools 2023-10-03T19:21:26.427 INFO:teuthology.orchestra.run.smithi045.stdout: -2657> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x601) _commit_ops 2023-10-03T19:21:26.427 INFO:teuthology.orchestra.run.smithi045.stdout: -2656> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.427 INFO:teuthology.orchestra.run.smithi045.stdout: -2655> 2023-10-03T19:19:39.420+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=9) v1 -- 0x556317b126e0 con 0x556317aaf800 2023-10-03T19:21:26.427 INFO:teuthology.orchestra.run.smithi045.stdout: -2654> 2023-10-03T19:19:39.420+0000 7fd1a5470640 0 mds.0.cache creating system inode with ino:0x602 2023-10-03T19:21:26.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2653> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 mds.0.cache.dir(0x100) lookup_exact_snap (head, 'stray2') 2023-10-03T19:21:26.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2652> 2023-10-03T19:19:39.420+0000 7fd1a5470640 12 mds.0.cache.dir(0x100) add_primary_dentry [dentry #0x100/stray2 [2,head] auth (dversion lock) v=0 ino=0x602 state=1073741824 0x55631882ca00] 2023-10-03T19:21:26.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2651> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x602) pre_dirty 1 2023-10-03T19:21:26.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2650> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x602) _mark_dirty (was clean) [dir 0x602 ~mds0/stray2/ [2,head] auth v=1 cv=0/0 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x556318a50480] version 1 2023-10-03T19:21:26.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2649> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x602) commit want 0 on [dir 0x602 ~mds0/stray2/ [2,head] auth v=1 cv=0/0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 0x556318a50480] 2023-10-03T19:21:26.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2648> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x602) auth_pin by 0x556318a50480 on [dir 0x602 ~mds0/stray2/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a50480] count now 1 2023-10-03T19:21:26.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2647> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x602) _commit want 1 on [dir 0x602 ~mds0/stray2/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a50480] 2023-10-03T19:21:26.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2646> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x602) marking committing 2023-10-03T19:21:26.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2645> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x602) _omap_commit 2023-10-03T19:21:26.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2644> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x602) mark_dirty_parent 2023-10-03T19:21:26.428 INFO:teuthology.orchestra.run.smithi045.stdout: -2643> 2023-10-03T19:19:39.420+0000 7fd19f464640 10 mds.0.cache.dir(0x602) _omap_commit_ops 2023-10-03T19:21:26.429 INFO:teuthology.orchestra.run.smithi045.stdout: -2642> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x602) _store_backtrace on [inode 0x602 [...2,head] ~mds0/stray2/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.424979+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 0x556318a5c000] 2023-10-03T19:21:26.429 INFO:teuthology.orchestra.run.smithi045.stdout: -2641> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x602) auth_pin by 0x556318a5c000 on [inode 0x602 [...2,head] ~mds0/stray2/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.424979+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x556318a5c000] now 1 2023-10-03T19:21:26.429 INFO:teuthology.orchestra.run.smithi045.stdout: -2640> 2023-10-03T19:19:39.420+0000 7fd19f464640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.429 INFO:teuthology.orchestra.run.smithi045.stdout: -2639> 2023-10-03T19:19:39.420+0000 7fd19f464640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=10) v1 -- 0x556317b12420 con 0x556317aaf800 2023-10-03T19:21:26.429 INFO:teuthology.orchestra.run.smithi045.stdout: -2638> 2023-10-03T19:19:39.420+0000 7fd1a5470640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins 1 on [dir 0x100 ~mds0/ [2,head] auth v=0 cv=0/0 dir_auth=0 ap=0+3 state=1073741824 f(v0 3=0+3)/f() n(v0 rc2023-10-03T19:19:39.424979+0000 3=0+3)/n() hs=3+0,ss=0+0 dirty=3 | child=1 subtree=1 0x556317b1d600] by 0x556318a5c000 count now 0/3 2023-10-03T19:21:26.429 INFO:teuthology.orchestra.run.smithi045.stdout: -2637> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 mds.0.cache.ino(0x602) _store_backtrace: no dirtypool or no old pools 2023-10-03T19:21:26.429 INFO:teuthology.orchestra.run.smithi045.stdout: -2636> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x602) _commit_ops 2023-10-03T19:21:26.429 INFO:teuthology.orchestra.run.smithi045.stdout: -2635> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.429 INFO:teuthology.orchestra.run.smithi045.stdout: -2634> 2023-10-03T19:19:39.420+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=11) v1 -- 0x556317b126e0 con 0x556317aaf800 2023-10-03T19:21:26.429 INFO:teuthology.orchestra.run.smithi045.stdout: -2633> 2023-10-03T19:19:39.420+0000 7fd1a5470640 0 mds.0.cache creating system inode with ino:0x603 2023-10-03T19:21:26.429 INFO:teuthology.orchestra.run.smithi045.stdout: -2632> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 mds.0.cache.dir(0x100) lookup_exact_snap (head, 'stray3') 2023-10-03T19:21:26.429 INFO:teuthology.orchestra.run.smithi045.stdout: -2631> 2023-10-03T19:19:39.420+0000 7fd1a5470640 12 mds.0.cache.dir(0x100) add_primary_dentry [dentry #0x100/stray3 [2,head] auth (dversion lock) v=0 ino=0x603 state=1073741824 0x55631882cc80] 2023-10-03T19:21:26.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2630> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x603) pre_dirty 1 2023-10-03T19:21:26.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2629> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x603) _mark_dirty (was clean) [dir 0x603 ~mds0/stray3/ [2,head] auth v=1 cv=0/0 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x556318a50900] version 1 2023-10-03T19:21:26.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2628> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x603) commit want 0 on [dir 0x603 ~mds0/stray3/ [2,head] auth v=1 cv=0/0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 0x556318a50900] 2023-10-03T19:21:26.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2627> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x603) auth_pin by 0x556318a50900 on [dir 0x603 ~mds0/stray3/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a50900] count now 1 2023-10-03T19:21:26.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2626> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x603) _commit want 1 on [dir 0x603 ~mds0/stray3/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a50900] 2023-10-03T19:21:26.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2625> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x603) marking committing 2023-10-03T19:21:26.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2624> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x603) _omap_commit 2023-10-03T19:21:26.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2623> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x603) mark_dirty_parent 2023-10-03T19:21:26.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2622> 2023-10-03T19:19:39.420+0000 7fd19f464640 10 mds.0.cache.dir(0x603) _omap_commit_ops 2023-10-03T19:21:26.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2621> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x603) _store_backtrace on [inode 0x603 [...2,head] ~mds0/stray3/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.425113+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 0x556318a5c580] 2023-10-03T19:21:26.430 INFO:teuthology.orchestra.run.smithi045.stdout: -2620> 2023-10-03T19:19:39.420+0000 7fd19f464640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.431 INFO:teuthology.orchestra.run.smithi045.stdout: -2619> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x603) auth_pin by 0x556318a5c580 on [inode 0x603 [...2,head] ~mds0/stray3/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.425113+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x556318a5c580] now 1 2023-10-03T19:21:26.431 INFO:teuthology.orchestra.run.smithi045.stdout: -2618> 2023-10-03T19:19:39.420+0000 7fd19f464640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=12) v1 -- 0x556317b13080 con 0x556317aaf800 2023-10-03T19:21:26.431 INFO:teuthology.orchestra.run.smithi045.stdout: -2617> 2023-10-03T19:19:39.420+0000 7fd1a5470640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins 1 on [dir 0x100 ~mds0/ [2,head] auth v=0 cv=0/0 dir_auth=0 ap=0+4 state=1073741824 f(v0 4=0+4)/f() n(v0 rc2023-10-03T19:19:39.425113+0000 4=0+4)/n() hs=4+0,ss=0+0 dirty=4 | child=1 subtree=1 0x556317b1d600] by 0x556318a5c580 count now 0/4 2023-10-03T19:21:26.431 INFO:teuthology.orchestra.run.smithi045.stdout: -2616> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 mds.0.cache.ino(0x603) _store_backtrace: no dirtypool or no old pools 2023-10-03T19:21:26.431 INFO:teuthology.orchestra.run.smithi045.stdout: -2615> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x603) _commit_ops 2023-10-03T19:21:26.431 INFO:teuthology.orchestra.run.smithi045.stdout: -2614> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.431 INFO:teuthology.orchestra.run.smithi045.stdout: -2613> 2023-10-03T19:19:39.420+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=13) v1 -- 0x556317b12c60 con 0x556317aaf800 2023-10-03T19:21:26.431 INFO:teuthology.orchestra.run.smithi045.stdout: -2612> 2023-10-03T19:19:39.420+0000 7fd1a5470640 0 mds.0.cache creating system inode with ino:0x604 2023-10-03T19:21:26.431 INFO:teuthology.orchestra.run.smithi045.stdout: -2611> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 mds.0.cache.dir(0x100) lookup_exact_snap (head, 'stray4') 2023-10-03T19:21:26.431 INFO:teuthology.orchestra.run.smithi045.stdout: -2610> 2023-10-03T19:19:39.420+0000 7fd1a5470640 12 mds.0.cache.dir(0x100) add_primary_dentry [dentry #0x100/stray4 [2,head] auth (dversion lock) v=0 ino=0x604 state=1073741824 0x55631882cf00] 2023-10-03T19:21:26.431 INFO:teuthology.orchestra.run.smithi045.stdout: -2609> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x604) pre_dirty 1 2023-10-03T19:21:26.432 INFO:teuthology.orchestra.run.smithi045.stdout: -2608> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x604) _mark_dirty (was clean) [dir 0x604 ~mds0/stray4/ [2,head] auth v=1 cv=0/0 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x556318a50d80] version 1 2023-10-03T19:21:26.432 INFO:teuthology.orchestra.run.smithi045.stdout: -2607> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x604) commit want 0 on [dir 0x604 ~mds0/stray4/ [2,head] auth v=1 cv=0/0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 0x556318a50d80] 2023-10-03T19:21:26.432 INFO:teuthology.orchestra.run.smithi045.stdout: -2606> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x604) auth_pin by 0x556318a50d80 on [dir 0x604 ~mds0/stray4/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a50d80] count now 1 2023-10-03T19:21:26.432 INFO:teuthology.orchestra.run.smithi045.stdout: -2605> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x604) _commit want 1 on [dir 0x604 ~mds0/stray4/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a50d80] 2023-10-03T19:21:26.432 INFO:teuthology.orchestra.run.smithi045.stdout: -2604> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x604) marking committing 2023-10-03T19:21:26.432 INFO:teuthology.orchestra.run.smithi045.stdout: -2603> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x604) _omap_commit 2023-10-03T19:21:26.432 INFO:teuthology.orchestra.run.smithi045.stdout: -2602> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x604) mark_dirty_parent 2023-10-03T19:21:26.432 INFO:teuthology.orchestra.run.smithi045.stdout: -2601> 2023-10-03T19:19:39.420+0000 7fd19f464640 10 mds.0.cache.dir(0x604) _omap_commit_ops 2023-10-03T19:21:26.432 INFO:teuthology.orchestra.run.smithi045.stdout: -2600> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x604) _store_backtrace on [inode 0x604 [...2,head] ~mds0/stray4/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.425234+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 0x556318a5cb00] 2023-10-03T19:21:26.432 INFO:teuthology.orchestra.run.smithi045.stdout: -2599> 2023-10-03T19:19:39.420+0000 7fd19f464640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.432 INFO:teuthology.orchestra.run.smithi045.stdout: -2598> 2023-10-03T19:19:39.420+0000 7fd19f464640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=14) v1 -- 0x556317b12dc0 con 0x556317aaf800 2023-10-03T19:21:26.432 INFO:teuthology.orchestra.run.smithi045.stdout: -2597> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x604) auth_pin by 0x556318a5cb00 on [inode 0x604 [...2,head] ~mds0/stray4/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.425234+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x556318a5cb00] now 1 2023-10-03T19:21:26.433 INFO:teuthology.orchestra.run.smithi045.stdout: -2596> 2023-10-03T19:19:39.420+0000 7fd1a5470640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins 1 on [dir 0x100 ~mds0/ [2,head] auth v=0 cv=0/0 dir_auth=0 ap=0+5 state=1073741824 f(v0 5=0+5)/f() n(v0 rc2023-10-03T19:19:39.425234+0000 5=0+5)/n() hs=5+0,ss=0+0 dirty=5 | child=1 subtree=1 0x556317b1d600] by 0x556318a5cb00 count now 0/5 2023-10-03T19:21:26.433 INFO:teuthology.orchestra.run.smithi045.stdout: -2595> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 mds.0.cache.ino(0x604) _store_backtrace: no dirtypool or no old pools 2023-10-03T19:21:26.433 INFO:teuthology.orchestra.run.smithi045.stdout: -2594> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x604) _commit_ops 2023-10-03T19:21:26.433 INFO:teuthology.orchestra.run.smithi045.stdout: -2593> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.433 INFO:teuthology.orchestra.run.smithi045.stdout: -2592> 2023-10-03T19:19:39.420+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=15) v1 -- 0x556317b138c0 con 0x556317aaf800 2023-10-03T19:21:26.433 INFO:teuthology.orchestra.run.smithi045.stdout: -2591> 2023-10-03T19:19:39.420+0000 7fd1a5470640 0 mds.0.cache creating system inode with ino:0x605 2023-10-03T19:21:26.433 INFO:teuthology.orchestra.run.smithi045.stdout: -2590> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 mds.0.cache.dir(0x100) lookup_exact_snap (head, 'stray5') 2023-10-03T19:21:26.433 INFO:teuthology.orchestra.run.smithi045.stdout: -2589> 2023-10-03T19:19:39.420+0000 7fd1a5470640 12 mds.0.cache.dir(0x100) add_primary_dentry [dentry #0x100/stray5 [2,head] auth (dversion lock) v=0 ino=0x605 state=1073741824 0x55631882d180] 2023-10-03T19:21:26.433 INFO:teuthology.orchestra.run.smithi045.stdout: -2588> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x605) pre_dirty 1 2023-10-03T19:21:26.433 INFO:teuthology.orchestra.run.smithi045.stdout: -2587> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x605) _mark_dirty (was clean) [dir 0x605 ~mds0/stray5/ [2,head] auth v=1 cv=0/0 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x556318a51200] version 1 2023-10-03T19:21:26.433 INFO:teuthology.orchestra.run.smithi045.stdout: -2586> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x605) commit want 0 on [dir 0x605 ~mds0/stray5/ [2,head] auth v=1 cv=0/0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 0x556318a51200] 2023-10-03T19:21:26.434 INFO:teuthology.orchestra.run.smithi045.stdout: -2585> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x605) auth_pin by 0x556318a51200 on [dir 0x605 ~mds0/stray5/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a51200] count now 1 2023-10-03T19:21:26.434 INFO:teuthology.orchestra.run.smithi045.stdout: -2584> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x605) _commit want 1 on [dir 0x605 ~mds0/stray5/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a51200] 2023-10-03T19:21:26.434 INFO:teuthology.orchestra.run.smithi045.stdout: -2583> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x605) marking committing 2023-10-03T19:21:26.434 INFO:teuthology.orchestra.run.smithi045.stdout: -2582> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x605) _omap_commit 2023-10-03T19:21:26.434 INFO:teuthology.orchestra.run.smithi045.stdout: -2581> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x605) mark_dirty_parent 2023-10-03T19:21:26.434 INFO:teuthology.orchestra.run.smithi045.stdout: -2580> 2023-10-03T19:19:39.420+0000 7fd19f464640 10 mds.0.cache.dir(0x605) _omap_commit_ops 2023-10-03T19:21:26.434 INFO:teuthology.orchestra.run.smithi045.stdout: -2579> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x605) _store_backtrace on [inode 0x605 [...2,head] ~mds0/stray5/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.425362+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 0x556318a5d080] 2023-10-03T19:21:26.434 INFO:teuthology.orchestra.run.smithi045.stdout: -2578> 2023-10-03T19:19:39.420+0000 7fd19f464640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.434 INFO:teuthology.orchestra.run.smithi045.stdout: -2577> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x605) auth_pin by 0x556318a5d080 on [inode 0x605 [...2,head] ~mds0/stray5/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.425362+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x556318a5d080] now 1 2023-10-03T19:21:26.434 INFO:teuthology.orchestra.run.smithi045.stdout: -2576> 2023-10-03T19:19:39.420+0000 7fd19f464640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=16) v1 -- 0x556317b12420 con 0x556317aaf800 2023-10-03T19:21:26.434 INFO:teuthology.orchestra.run.smithi045.stdout: -2575> 2023-10-03T19:19:39.420+0000 7fd1a5470640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins 1 on [dir 0x100 ~mds0/ [2,head] auth v=0 cv=0/0 dir_auth=0 ap=0+6 state=1073741824 f(v0 6=0+6)/f() n(v0 rc2023-10-03T19:19:39.425362+0000 6=0+6)/n() hs=6+0,ss=0+0 dirty=6 | child=1 subtree=1 0x556317b1d600] by 0x556318a5d080 count now 0/6 2023-10-03T19:21:26.434 INFO:teuthology.orchestra.run.smithi045.stdout: -2574> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 mds.0.cache.ino(0x605) _store_backtrace: no dirtypool or no old pools 2023-10-03T19:21:26.435 INFO:teuthology.orchestra.run.smithi045.stdout: -2573> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x605) _commit_ops 2023-10-03T19:21:26.435 INFO:teuthology.orchestra.run.smithi045.stdout: -2572> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.435 INFO:teuthology.orchestra.run.smithi045.stdout: -2571> 2023-10-03T19:19:39.420+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=17) v1 -- 0x556317b13b80 con 0x556317aaf800 2023-10-03T19:21:26.435 INFO:teuthology.orchestra.run.smithi045.stdout: -2570> 2023-10-03T19:19:39.420+0000 7fd1a5470640 0 mds.0.cache creating system inode with ino:0x606 2023-10-03T19:21:26.435 INFO:teuthology.orchestra.run.smithi045.stdout: -2569> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 mds.0.cache.dir(0x100) lookup_exact_snap (head, 'stray6') 2023-10-03T19:21:26.435 INFO:teuthology.orchestra.run.smithi045.stdout: -2568> 2023-10-03T19:19:39.420+0000 7fd1a5470640 12 mds.0.cache.dir(0x100) add_primary_dentry [dentry #0x100/stray6 [2,head] auth (dversion lock) v=0 ino=0x606 state=1073741824 0x55631882d400] 2023-10-03T19:21:26.435 INFO:teuthology.orchestra.run.smithi045.stdout: -2567> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x606) pre_dirty 1 2023-10-03T19:21:26.435 INFO:teuthology.orchestra.run.smithi045.stdout: -2566> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x606) _mark_dirty (was clean) [dir 0x606 ~mds0/stray6/ [2,head] auth v=1 cv=0/0 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x556318a51680] version 1 2023-10-03T19:21:26.435 INFO:teuthology.orchestra.run.smithi045.stdout: -2565> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x606) commit want 0 on [dir 0x606 ~mds0/stray6/ [2,head] auth v=1 cv=0/0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 0x556318a51680] 2023-10-03T19:21:26.435 INFO:teuthology.orchestra.run.smithi045.stdout: -2564> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x606) auth_pin by 0x556318a51680 on [dir 0x606 ~mds0/stray6/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a51680] count now 1 2023-10-03T19:21:26.436 INFO:teuthology.orchestra.run.smithi045.stdout: -2563> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x606) _commit want 1 on [dir 0x606 ~mds0/stray6/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a51680] 2023-10-03T19:21:26.436 INFO:teuthology.orchestra.run.smithi045.stdout: -2562> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x606) marking committing 2023-10-03T19:21:26.436 INFO:teuthology.orchestra.run.smithi045.stdout: -2561> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x606) _omap_commit 2023-10-03T19:21:26.436 INFO:teuthology.orchestra.run.smithi045.stdout: -2560> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x606) mark_dirty_parent 2023-10-03T19:21:26.436 INFO:teuthology.orchestra.run.smithi045.stdout: -2559> 2023-10-03T19:19:39.420+0000 7fd19f464640 10 mds.0.cache.dir(0x606) _omap_commit_ops 2023-10-03T19:21:26.436 INFO:teuthology.orchestra.run.smithi045.stdout: -2558> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x606) _store_backtrace on [inode 0x606 [...2,head] ~mds0/stray6/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.425504+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 0x556318a5d600] 2023-10-03T19:21:26.436 INFO:teuthology.orchestra.run.smithi045.stdout: -2557> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x606) auth_pin by 0x556318a5d600 on [inode 0x606 [...2,head] ~mds0/stray6/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.425504+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x556318a5d600] now 1 2023-10-03T19:21:26.436 INFO:teuthology.orchestra.run.smithi045.stdout: -2556> 2023-10-03T19:19:39.420+0000 7fd19f464640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.436 INFO:teuthology.orchestra.run.smithi045.stdout: -2555> 2023-10-03T19:19:39.420+0000 7fd1a5470640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins 1 on [dir 0x100 ~mds0/ [2,head] auth v=0 cv=0/0 dir_auth=0 ap=0+7 state=1073741824 f(v0 7=0+7)/f() n(v0 rc2023-10-03T19:19:39.425504+0000 7=0+7)/n() hs=7+0,ss=0+0 dirty=7 | child=1 subtree=1 0x556317b1d600] by 0x556318a5d600 count now 0/7 2023-10-03T19:21:26.436 INFO:teuthology.orchestra.run.smithi045.stdout: -2554> 2023-10-03T19:19:39.420+0000 7fd19f464640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=18) v1 -- 0x556317b126e0 con 0x556317aaf800 2023-10-03T19:21:26.436 INFO:teuthology.orchestra.run.smithi045.stdout: -2553> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 mds.0.cache.ino(0x606) _store_backtrace: no dirtypool or no old pools 2023-10-03T19:21:26.436 INFO:teuthology.orchestra.run.smithi045.stdout: -2552> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x606) _commit_ops 2023-10-03T19:21:26.437 INFO:teuthology.orchestra.run.smithi045.stdout: -2551> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.437 INFO:teuthology.orchestra.run.smithi045.stdout: -2550> 2023-10-03T19:19:39.420+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=19) v1 -- 0x556317b13e40 con 0x556317aaf800 2023-10-03T19:21:26.437 INFO:teuthology.orchestra.run.smithi045.stdout: -2549> 2023-10-03T19:19:39.420+0000 7fd1a5470640 0 mds.0.cache creating system inode with ino:0x607 2023-10-03T19:21:26.437 INFO:teuthology.orchestra.run.smithi045.stdout: -2548> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 mds.0.cache.dir(0x100) lookup_exact_snap (head, 'stray7') 2023-10-03T19:21:26.437 INFO:teuthology.orchestra.run.smithi045.stdout: -2547> 2023-10-03T19:19:39.420+0000 7fd1a5470640 12 mds.0.cache.dir(0x100) add_primary_dentry [dentry #0x100/stray7 [2,head] auth (dversion lock) v=0 ino=0x607 state=1073741824 0x55631882d680] 2023-10-03T19:21:26.437 INFO:teuthology.orchestra.run.smithi045.stdout: -2546> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x607) pre_dirty 1 2023-10-03T19:21:26.437 INFO:teuthology.orchestra.run.smithi045.stdout: -2545> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x607) _mark_dirty (was clean) [dir 0x607 ~mds0/stray7/ [2,head] auth v=1 cv=0/0 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x556318a51b00] version 1 2023-10-03T19:21:26.437 INFO:teuthology.orchestra.run.smithi045.stdout: -2544> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x607) commit want 0 on [dir 0x607 ~mds0/stray7/ [2,head] auth v=1 cv=0/0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 0x556318a51b00] 2023-10-03T19:21:26.437 INFO:teuthology.orchestra.run.smithi045.stdout: -2543> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x607) auth_pin by 0x556318a51b00 on [dir 0x607 ~mds0/stray7/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a51b00] count now 1 2023-10-03T19:21:26.437 INFO:teuthology.orchestra.run.smithi045.stdout: -2542> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x607) _commit want 1 on [dir 0x607 ~mds0/stray7/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a51b00] 2023-10-03T19:21:26.437 INFO:teuthology.orchestra.run.smithi045.stdout: -2541> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x607) marking committing 2023-10-03T19:21:26.437 INFO:teuthology.orchestra.run.smithi045.stdout: -2540> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x607) _omap_commit 2023-10-03T19:21:26.438 INFO:teuthology.orchestra.run.smithi045.stdout: -2539> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x607) mark_dirty_parent 2023-10-03T19:21:26.438 INFO:teuthology.orchestra.run.smithi045.stdout: -2538> 2023-10-03T19:19:39.420+0000 7fd19f464640 10 mds.0.cache.dir(0x607) _omap_commit_ops 2023-10-03T19:21:26.438 INFO:teuthology.orchestra.run.smithi045.stdout: -2537> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x607) _store_backtrace on [inode 0x607 [...2,head] ~mds0/stray7/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.425629+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 0x556318a5db80] 2023-10-03T19:21:26.438 INFO:teuthology.orchestra.run.smithi045.stdout: -2536> 2023-10-03T19:19:39.420+0000 7fd19f464640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.438 INFO:teuthology.orchestra.run.smithi045.stdout: -2535> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x607) auth_pin by 0x556318a5db80 on [inode 0x607 [...2,head] ~mds0/stray7/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.425629+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x556318a5db80] now 1 2023-10-03T19:21:26.438 INFO:teuthology.orchestra.run.smithi045.stdout: -2534> 2023-10-03T19:19:39.420+0000 7fd19f464640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=20) v1 -- 0x556317b13080 con 0x556317aaf800 2023-10-03T19:21:26.438 INFO:teuthology.orchestra.run.smithi045.stdout: -2533> 2023-10-03T19:19:39.420+0000 7fd1a5470640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins 1 on [dir 0x100 ~mds0/ [2,head] auth v=0 cv=0/0 dir_auth=0 ap=0+8 state=1073741824 f(v0 8=0+8)/f() n(v0 rc2023-10-03T19:19:39.425629+0000 8=0+8)/n() hs=8+0,ss=0+0 dirty=8 | child=1 subtree=1 0x556317b1d600] by 0x556318a5db80 count now 0/8 2023-10-03T19:21:26.560 INFO:teuthology.orchestra.run.smithi045.stdout: -2532> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 mds.0.cache.ino(0x607) _store_backtrace: no dirtypool or no old pools 2023-10-03T19:21:26.560 INFO:teuthology.orchestra.run.smithi045.stdout: -2531> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x607) _commit_ops 2023-10-03T19:21:26.560 INFO:teuthology.orchestra.run.smithi045.stdout: -2530> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.561 INFO:teuthology.orchestra.run.smithi045.stdout: -2529> 2023-10-03T19:19:39.420+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=21) v1 -- 0x556317b138c0 con 0x556317aaf800 2023-10-03T19:21:26.561 INFO:teuthology.orchestra.run.smithi045.stdout: -2528> 2023-10-03T19:19:39.420+0000 7fd1a5470640 0 mds.0.cache creating system inode with ino:0x608 2023-10-03T19:21:26.561 INFO:teuthology.orchestra.run.smithi045.stdout: -2527> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 mds.0.cache.dir(0x100) lookup_exact_snap (head, 'stray8') 2023-10-03T19:21:26.561 INFO:teuthology.orchestra.run.smithi045.stdout: -2526> 2023-10-03T19:19:39.420+0000 7fd1a5470640 12 mds.0.cache.dir(0x100) add_primary_dentry [dentry #0x100/stray8 [2,head] auth (dversion lock) v=0 ino=0x608 state=1073741824 0x55631882d900] 2023-10-03T19:21:26.561 INFO:teuthology.orchestra.run.smithi045.stdout: -2525> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x608) pre_dirty 1 2023-10-03T19:21:26.561 INFO:teuthology.orchestra.run.smithi045.stdout: -2524> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x608) _mark_dirty (was clean) [dir 0x608 ~mds0/stray8/ [2,head] auth v=1 cv=0/0 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x556318a51f80] version 1 2023-10-03T19:21:26.561 INFO:teuthology.orchestra.run.smithi045.stdout: -2523> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x608) commit want 0 on [dir 0x608 ~mds0/stray8/ [2,head] auth v=1 cv=0/0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 0x556318a51f80] 2023-10-03T19:21:26.561 INFO:teuthology.orchestra.run.smithi045.stdout: -2522> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x608) auth_pin by 0x556318a51f80 on [dir 0x608 ~mds0/stray8/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a51f80] count now 1 2023-10-03T19:21:26.561 INFO:teuthology.orchestra.run.smithi045.stdout: -2521> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x608) _commit want 1 on [dir 0x608 ~mds0/stray8/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a51f80] 2023-10-03T19:21:26.561 INFO:teuthology.orchestra.run.smithi045.stdout: -2520> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x608) marking committing 2023-10-03T19:21:26.561 INFO:teuthology.orchestra.run.smithi045.stdout: -2519> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x608) _omap_commit 2023-10-03T19:21:26.562 INFO:teuthology.orchestra.run.smithi045.stdout: -2518> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x608) mark_dirty_parent 2023-10-03T19:21:26.562 INFO:teuthology.orchestra.run.smithi045.stdout: -2517> 2023-10-03T19:19:39.420+0000 7fd19f464640 10 mds.0.cache.dir(0x608) _omap_commit_ops 2023-10-03T19:21:26.562 INFO:teuthology.orchestra.run.smithi045.stdout: -2516> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x608) _store_backtrace on [inode 0x608 [...2,head] ~mds0/stray8/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.425747+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 0x556318a5e100] 2023-10-03T19:21:26.562 INFO:teuthology.orchestra.run.smithi045.stdout: -2515> 2023-10-03T19:19:39.420+0000 7fd19f464640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.562 INFO:teuthology.orchestra.run.smithi045.stdout: -2514> 2023-10-03T19:19:39.420+0000 7fd19f464640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=22) v1 -- 0x556317b12c60 con 0x556317aaf800 2023-10-03T19:21:26.562 INFO:teuthology.orchestra.run.smithi045.stdout: -2513> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x608) auth_pin by 0x556318a5e100 on [inode 0x608 [...2,head] ~mds0/stray8/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.425747+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x556318a5e100] now 1 2023-10-03T19:21:26.562 INFO:teuthology.orchestra.run.smithi045.stdout: -2512> 2023-10-03T19:19:39.420+0000 7fd1a5470640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins 1 on [dir 0x100 ~mds0/ [2,head] auth v=0 cv=0/0 dir_auth=0 ap=0+9 state=1073741824 f(v0 9=0+9)/f() n(v0 rc2023-10-03T19:19:39.425747+0000 9=0+9)/n() hs=9+0,ss=0+0 dirty=9 | child=1 subtree=1 0x556317b1d600] by 0x556318a5e100 count now 0/9 2023-10-03T19:21:26.562 INFO:teuthology.orchestra.run.smithi045.stdout: -2511> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 mds.0.cache.ino(0x608) _store_backtrace: no dirtypool or no old pools 2023-10-03T19:21:26.562 INFO:teuthology.orchestra.run.smithi045.stdout: -2510> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x608) _commit_ops 2023-10-03T19:21:26.563 INFO:teuthology.orchestra.run.smithi045.stdout: -2509> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.563 INFO:teuthology.orchestra.run.smithi045.stdout: -2508> 2023-10-03T19:19:39.420+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=23) v1 -- 0x556317b13b80 con 0x556317aaf800 2023-10-03T19:21:26.563 INFO:teuthology.orchestra.run.smithi045.stdout: -2507> 2023-10-03T19:19:39.420+0000 7fd1a5470640 0 mds.0.cache creating system inode with ino:0x609 2023-10-03T19:21:26.563 INFO:teuthology.orchestra.run.smithi045.stdout: -2506> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 mds.0.cache.dir(0x100) lookup_exact_snap (head, 'stray9') 2023-10-03T19:21:26.563 INFO:teuthology.orchestra.run.smithi045.stdout: -2505> 2023-10-03T19:19:39.420+0000 7fd1a5470640 12 mds.0.cache.dir(0x100) add_primary_dentry [dentry #0x100/stray9 [2,head] auth (dversion lock) v=0 ino=0x609 state=1073741824 0x55631882db80] 2023-10-03T19:21:26.563 INFO:teuthology.orchestra.run.smithi045.stdout: -2504> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x609) pre_dirty 1 2023-10-03T19:21:26.563 INFO:teuthology.orchestra.run.smithi045.stdout: -2503> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x609) _mark_dirty (was clean) [dir 0x609 ~mds0/stray9/ [2,head] auth v=1 cv=0/0 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x556318a52400] version 1 2023-10-03T19:21:26.563 INFO:teuthology.orchestra.run.smithi045.stdout: -2502> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x609) commit want 0 on [dir 0x609 ~mds0/stray9/ [2,head] auth v=1 cv=0/0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 0x556318a52400] 2023-10-03T19:21:26.563 INFO:teuthology.orchestra.run.smithi045.stdout: -2501> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x609) auth_pin by 0x556318a52400 on [dir 0x609 ~mds0/stray9/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a52400] count now 1 2023-10-03T19:21:26.563 INFO:teuthology.orchestra.run.smithi045.stdout: -2500> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x609) _commit want 1 on [dir 0x609 ~mds0/stray9/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a52400] 2023-10-03T19:21:26.563 INFO:teuthology.orchestra.run.smithi045.stdout: -2499> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x609) marking committing 2023-10-03T19:21:26.563 INFO:teuthology.orchestra.run.smithi045.stdout: -2498> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x609) _omap_commit 2023-10-03T19:21:26.564 INFO:teuthology.orchestra.run.smithi045.stdout: -2497> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x609) mark_dirty_parent 2023-10-03T19:21:26.564 INFO:teuthology.orchestra.run.smithi045.stdout: -2496> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x609) _store_backtrace on [inode 0x609 [...2,head] ~mds0/stray9/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.425877+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 0x556318a5e680] 2023-10-03T19:21:26.564 INFO:teuthology.orchestra.run.smithi045.stdout: -2495> 2023-10-03T19:19:39.420+0000 7fd19f464640 10 mds.0.cache.dir(0x609) _omap_commit_ops 2023-10-03T19:21:26.564 INFO:teuthology.orchestra.run.smithi045.stdout: -2494> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x609) auth_pin by 0x556318a5e680 on [inode 0x609 [...2,head] ~mds0/stray9/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.425877+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x556318a5e680] now 1 2023-10-03T19:21:26.564 INFO:teuthology.orchestra.run.smithi045.stdout: -2493> 2023-10-03T19:19:39.420+0000 7fd1a5470640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins 1 on [dir 0x100 ~mds0/ [2,head] auth v=0 cv=0/0 dir_auth=0 ap=0+10 state=1073741824 f(v0 10=0+10)/f() n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10)/n() hs=10+0,ss=0+0 dirty=10 | child=1 subtree=1 0x556317b1d600] by 0x556318a5e680 count now 0/10 2023-10-03T19:21:26.564 INFO:teuthology.orchestra.run.smithi045.stdout: -2492> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 mds.0.cache.ino(0x609) _store_backtrace: no dirtypool or no old pools 2023-10-03T19:21:26.564 INFO:teuthology.orchestra.run.smithi045.stdout: -2491> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x609) _commit_ops 2023-10-03T19:21:26.564 INFO:teuthology.orchestra.run.smithi045.stdout: -2490> 2023-10-03T19:19:39.420+0000 7fd19f464640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.564 INFO:teuthology.orchestra.run.smithi045.stdout: -2489> 2023-10-03T19:19:39.420+0000 7fd19f464640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=24) v1 -- 0x556318a8c000 con 0x556317aaf800 2023-10-03T19:21:26.564 INFO:teuthology.orchestra.run.smithi045.stdout: -2488> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.564 INFO:teuthology.orchestra.run.smithi045.stdout: -2487> 2023-10-03T19:19:39.420+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=25) v1 -- 0x556317b13e40 con 0x556317aaf800 2023-10-03T19:21:26.564 INFO:teuthology.orchestra.run.smithi045.stdout: -2486> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x100) pre_dirty 1 2023-10-03T19:21:26.565 INFO:teuthology.orchestra.run.smithi045.stdout: -2485> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x100) _mark_dirty (was clean) [dir 0x100 ~mds0/ [2,head] auth v=1 cv=0/0 dir_auth=0 ap=0+10 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10) hs=10+0,ss=0+0 dirty=10 | child=1 subtree=1 0x556317b1d600] version 1 2023-10-03T19:21:26.565 INFO:teuthology.orchestra.run.smithi045.stdout: -2484> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x100) commit want 0 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=0/0 dir_auth=0 ap=0+10 state=1610612737|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10) hs=10+0,ss=0+0 dirty=10 | child=1 subtree=1 dirty=1 0x556317b1d600] 2023-10-03T19:21:26.565 INFO:teuthology.orchestra.run.smithi045.stdout: -2483> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x100) auth_pin by 0x556317b1d600 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=0/0 dir_auth=0 ap=1+10 state=1610612737|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10) hs=10+0,ss=0+0 dirty=10 | child=1 subtree=1 dirty=1 authpin=1 0x556317b1d600] count now 1 2023-10-03T19:21:26.565 INFO:teuthology.orchestra.run.smithi045.stdout: -2482> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x100) _commit want 1 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=0/0 dir_auth=0 ap=1+10 state=1610612737|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10) hs=10+0,ss=0+0 dirty=10 | child=1 subtree=1 dirty=1 authpin=1 0x556317b1d600] 2023-10-03T19:21:26.565 INFO:teuthology.orchestra.run.smithi045.stdout: -2481> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x100) marking committing 2023-10-03T19:21:26.565 INFO:teuthology.orchestra.run.smithi045.stdout: -2480> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 mds.0.bal hit_dir 4 pop is 1, frag * size 10 [pop IRD:[C 0.00e+00] IWR:[C 0.00e+00] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 1.00e+00] *LOAD:4.0] 2023-10-03T19:21:26.565 INFO:teuthology.orchestra.run.smithi045.stdout: -2479> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x100) _omap_commit 2023-10-03T19:21:26.565 INFO:teuthology.orchestra.run.smithi045.stdout: -2478> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x100) set stray0 [dentry #0x100/stray0 [2,head] auth (dversion lock) v=0 ino=0x600 state=1610612736 | inodepin=1 dirty=1 0x55631882c500] 2023-10-03T19:21:26.565 INFO:teuthology.orchestra.run.smithi045.stdout: -2477> 2023-10-03T19:19:39.420+0000 7fd1a5470640 14 mds.0.cache.dir(0x100) dn 'stray0' inode [inode 0x600 [...2,head] ~mds0/stray0/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.424687+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x556317b3d180] 2023-10-03T19:21:26.565 INFO:teuthology.orchestra.run.smithi045.stdout: -2476> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x100) set stray1 [dentry #0x100/stray1 [2,head] auth (dversion lock) v=0 ino=0x601 state=1610612736 | inodepin=1 dirty=1 0x55631882c780] 2023-10-03T19:21:26.565 INFO:teuthology.orchestra.run.smithi045.stdout: -2475> 2023-10-03T19:19:39.420+0000 7fd1a5470640 14 mds.0.cache.dir(0x100) dn 'stray1' inode [inode 0x601 [...2,head] ~mds0/stray1/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.424810+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x556317b3d700] 2023-10-03T19:21:26.566 INFO:teuthology.orchestra.run.smithi045.stdout: -2474> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x100) set stray2 [dentry #0x100/stray2 [2,head] auth (dversion lock) v=0 ino=0x602 state=1610612736 | inodepin=1 dirty=1 0x55631882ca00] 2023-10-03T19:21:26.566 INFO:teuthology.orchestra.run.smithi045.stdout: -2473> 2023-10-03T19:19:39.420+0000 7fd1a5470640 14 mds.0.cache.dir(0x100) dn 'stray2' inode [inode 0x602 [...2,head] ~mds0/stray2/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.424979+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x556318a5c000] 2023-10-03T19:21:26.566 INFO:teuthology.orchestra.run.smithi045.stdout: -2472> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x100) set stray3 [dentry #0x100/stray3 [2,head] auth (dversion lock) v=0 ino=0x603 state=1610612736 | inodepin=1 dirty=1 0x55631882cc80] 2023-10-03T19:21:26.566 INFO:teuthology.orchestra.run.smithi045.stdout: -2471> 2023-10-03T19:19:39.420+0000 7fd1a5470640 14 mds.0.cache.dir(0x100) dn 'stray3' inode [inode 0x603 [...2,head] ~mds0/stray3/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.425113+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x556318a5c580] 2023-10-03T19:21:26.566 INFO:teuthology.orchestra.run.smithi045.stdout: -2470> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x100) set stray4 [dentry #0x100/stray4 [2,head] auth (dversion lock) v=0 ino=0x604 state=1610612736 | inodepin=1 dirty=1 0x55631882cf00] 2023-10-03T19:21:26.566 INFO:teuthology.orchestra.run.smithi045.stdout: -2469> 2023-10-03T19:19:39.420+0000 7fd1a5470640 14 mds.0.cache.dir(0x100) dn 'stray4' inode [inode 0x604 [...2,head] ~mds0/stray4/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.425234+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x556318a5cb00] 2023-10-03T19:21:26.566 INFO:teuthology.orchestra.run.smithi045.stdout: -2468> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x100) set stray5 [dentry #0x100/stray5 [2,head] auth (dversion lock) v=0 ino=0x605 state=1610612736 | inodepin=1 dirty=1 0x55631882d180] 2023-10-03T19:21:26.566 INFO:teuthology.orchestra.run.smithi045.stdout: -2467> 2023-10-03T19:19:39.420+0000 7fd1a5470640 14 mds.0.cache.dir(0x100) dn 'stray5' inode [inode 0x605 [...2,head] ~mds0/stray5/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.425362+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x556318a5d080] 2023-10-03T19:21:26.566 INFO:teuthology.orchestra.run.smithi045.stdout: -2466> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x100) set stray6 [dentry #0x100/stray6 [2,head] auth (dversion lock) v=0 ino=0x606 state=1610612736 | inodepin=1 dirty=1 0x55631882d400] 2023-10-03T19:21:26.566 INFO:teuthology.orchestra.run.smithi045.stdout: -2465> 2023-10-03T19:19:39.420+0000 7fd1a5470640 14 mds.0.cache.dir(0x100) dn 'stray6' inode [inode 0x606 [...2,head] ~mds0/stray6/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.425504+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x556318a5d600] 2023-10-03T19:21:26.566 INFO:teuthology.orchestra.run.smithi045.stdout: -2464> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x100) set stray7 [dentry #0x100/stray7 [2,head] auth (dversion lock) v=0 ino=0x607 state=1610612736 | inodepin=1 dirty=1 0x55631882d680] 2023-10-03T19:21:26.567 INFO:teuthology.orchestra.run.smithi045.stdout: -2463> 2023-10-03T19:19:39.420+0000 7fd1a5470640 14 mds.0.cache.dir(0x100) dn 'stray7' inode [inode 0x607 [...2,head] ~mds0/stray7/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.425629+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x556318a5db80] 2023-10-03T19:21:26.567 INFO:teuthology.orchestra.run.smithi045.stdout: -2462> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x100) set stray8 [dentry #0x100/stray8 [2,head] auth (dversion lock) v=0 ino=0x608 state=1610612736 | inodepin=1 dirty=1 0x55631882d900] 2023-10-03T19:21:26.567 INFO:teuthology.orchestra.run.smithi045.stdout: -2461> 2023-10-03T19:19:39.420+0000 7fd1a5470640 14 mds.0.cache.dir(0x100) dn 'stray8' inode [inode 0x608 [...2,head] ~mds0/stray8/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.425747+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x556318a5e100] 2023-10-03T19:21:26.567 INFO:teuthology.orchestra.run.smithi045.stdout: -2460> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.dir(0x100) set stray9 [dentry #0x100/stray9 [2,head] auth (dversion lock) v=0 ino=0x609 state=1610612736 | inodepin=1 dirty=1 0x55631882db80] 2023-10-03T19:21:26.567 INFO:teuthology.orchestra.run.smithi045.stdout: -2459> 2023-10-03T19:19:39.420+0000 7fd1a5470640 14 mds.0.cache.dir(0x100) dn 'stray9' inode [inode 0x609 [...2,head] ~mds0/stray9/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.425877+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x556318a5e680] 2023-10-03T19:21:26.567 INFO:teuthology.orchestra.run.smithi045.stdout: -2458> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x100) store 1 2023-10-03T19:21:26.567 INFO:teuthology.orchestra.run.smithi045.stdout: -2457> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.snaprealm(0x100 seq 1 0x556317c17b00) get_snaps (seq 1 cached_seq 1) 2023-10-03T19:21:26.567 INFO:teuthology.orchestra.run.smithi045.stdout: -2456> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache.ino(0x100) purge_stale_snap_data 2023-10-03T19:21:26.567 INFO:teuthology.orchestra.run.smithi045.stdout: -2455> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 mds.0.cache.ino(0x100) encode_snap_blob snaprealm(0x100 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 0.000000 change_attr 0 0x556317c17b00) 2023-10-03T19:21:26.567 INFO:teuthology.orchestra.run.smithi045.stdout: -2454> 2023-10-03T19:19:39.420+0000 7fd19f464640 10 mds.0.cache.dir(0x100) _omap_commit_ops 2023-10-03T19:21:26.567 INFO:teuthology.orchestra.run.smithi045.stdout: -2453> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.571 INFO:teuthology.orchestra.run.smithi045.stdout: -2452> 2023-10-03T19:19:39.420+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=26) v1 -- 0x556317b13080 con 0x556317aaf800 2023-10-03T19:21:26.571 INFO:teuthology.orchestra.run.smithi045.stdout: -2451> 2023-10-03T19:19:39.420+0000 7fd1a5470640 3 mds.0.48 boot_create creating global snaprealm 2023-10-03T19:21:26.571 INFO:teuthology.orchestra.run.smithi045.stdout: -2450> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.48 boot_create creating fresh inotable table 2023-10-03T19:21:26.571 INFO:teuthology.orchestra.run.smithi045.stdout: -2449> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.inotable: save v 0 2023-10-03T19:21:26.571 INFO:teuthology.orchestra.run.smithi045.stdout: -2448> 2023-10-03T19:19:39.420+0000 7fd19f464640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.571 INFO:teuthology.orchestra.run.smithi045.stdout: -2447> 2023-10-03T19:19:39.420+0000 7fd19f464640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=27) v1 -- 0x556318a8c160 con 0x556317aaf800 2023-10-03T19:21:26.571 INFO:teuthology.orchestra.run.smithi045.stdout: -2446> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.571 INFO:teuthology.orchestra.run.smithi045.stdout: -2445> 2023-10-03T19:19:39.420+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=28) v1 -- 0x556317b138c0 con 0x556317aaf800 2023-10-03T19:21:26.571 INFO:teuthology.orchestra.run.smithi045.stdout: -2444> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.sessionmap save: needv 0, v 0 2023-10-03T19:21:26.571 INFO:teuthology.orchestra.run.smithi045.stdout: -2443> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 mds.0.sessionmap updating keys: 2023-10-03T19:21:26.571 INFO:teuthology.orchestra.run.smithi045.stdout: -2442> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 mds.0.sessionmap removing keys: 2023-10-03T19:21:26.571 INFO:teuthology.orchestra.run.smithi045.stdout: -2441> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.572 INFO:teuthology.orchestra.run.smithi045.stdout: -2440> 2023-10-03T19:19:39.420+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=29) v1 -- 0x556317b12c60 con 0x556317aaf800 2023-10-03T19:21:26.572 INFO:teuthology.orchestra.run.smithi045.stdout: -2439> 2023-10-03T19:19:39.420+0000 7fd1a5470640 4 mds.0.purge_queue create: creating 2023-10-03T19:21:26.572 INFO:teuthology.orchestra.run.smithi045.stdout: -2438> 2023-10-03T19:19:39.420+0000 7fd1a5470640 1 mds.0.journaler.pq(ro) set_writeable 2023-10-03T19:21:26.572 INFO:teuthology.orchestra.run.smithi045.stdout: -2437> 2023-10-03T19:19:39.420+0000 7fd1a5470640 1 mds.0.journaler.pq(rw) created blank journal at inode 0x0x500, format=1 2023-10-03T19:21:26.572 INFO:teuthology.orchestra.run.smithi045.stdout: -2436> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.572 INFO:teuthology.orchestra.run.smithi045.stdout: -2435> 2023-10-03T19:19:39.420+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=30) v1 -- 0x556318a8c6e0 con 0x556317aaf800 2023-10-03T19:21:26.572 INFO:teuthology.orchestra.run.smithi045.stdout: -2434> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.48 boot_create creating fresh snaptable 2023-10-03T19:21:26.572 INFO:teuthology.orchestra.run.smithi045.stdout: -2433> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.snaptable: save v 1 2023-10-03T19:21:26.572 INFO:teuthology.orchestra.run.smithi045.stdout: -2432> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.572 INFO:teuthology.orchestra.run.smithi045.stdout: -2431> 2023-10-03T19:19:39.420+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=31) v1 -- 0x556318a8c840 con 0x556317aaf800 2023-10-03T19:21:26.572 INFO:teuthology.orchestra.run.smithi045.stdout: -2430> 2023-10-03T19:19:39.420+0000 7fd1a5470640 7 mds.0.log _journal_segment_subtree_map 2023-10-03T19:21:26.572 INFO:teuthology.orchestra.run.smithi045.stdout: -2429> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache create_subtree_map 2 subtrees, 2 fullauth 2023-10-03T19:21:26.573 INFO:teuthology.orchestra.run.smithi045.stdout: -2428> 2023-10-03T19:19:39.420+0000 7fd1a5470640 15 mds.0.cache show_subtrees 2023-10-03T19:21:26.573 INFO:teuthology.orchestra.run.smithi045.stdout: -2427> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache |__ 0 auth [dir 0x1 / [2,head] auth v=1 cv=1/0 REP dir_auth=0 ap=1+0 state=1610612769|complete|committing f() n() hs=0+0,ss=0+0 | subtree=1 dirty=1 authpin=1 0x556317b1d180] 2023-10-03T19:21:26.573 INFO:teuthology.orchestra.run.smithi045.stdout: -2426> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 mds.0.cache |__ 0 auth [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/0 dir_auth=0 ap=1+10 state=1610612769|complete|committing f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10) hs=10+0,ss=0+0 dirty=10 | child=1 subtree=1 dirty=1 authpin=1 0x556317b1d600] 2023-10-03T19:21:26.573 INFO:teuthology.orchestra.run.smithi045.stdout: -2425> 2023-10-03T19:19:39.420+0000 7fd1a5470640 15 mds.0.cache auth subtree [dir 0x1 / [2,head] auth v=1 cv=1/0 REP dir_auth=0 ap=1+0 state=1610612769|complete|committing f() n() hs=0+0,ss=0+0 | subtree=1 dirty=1 authpin=1 0x556317b1d180] 2023-10-03T19:21:26.573 INFO:teuthology.orchestra.run.smithi045.stdout: -2424> 2023-10-03T19:19:39.420+0000 7fd1a5470640 15 mds.0.cache auth subtree [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/0 dir_auth=0 ap=1+10 state=1610612769|complete|committing f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10) hs=10+0,ss=0+0 dirty=10 | child=1 subtree=1 dirty=1 authpin=1 0x556317b1d600] 2023-10-03T19:21:26.573 INFO:teuthology.orchestra.run.smithi045.stdout: -2423> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 mds.0.journal EMetaBlob::add_dir_context final: 2023-10-03T19:21:26.573 INFO:teuthology.orchestra.run.smithi045.stdout: -2422> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 mds.0.journal EMetaBlob::add_dir_context final: 2023-10-03T19:21:26.573 INFO:teuthology.orchestra.run.smithi045.stdout: -2421> 2023-10-03T19:19:39.420+0000 7fd1a5470640 15 mds.0.cache subtrees {0x1=[],0x100=[]} 2023-10-03T19:21:26.573 INFO:teuthology.orchestra.run.smithi045.stdout: -2420> 2023-10-03T19:19:39.420+0000 7fd1a5470640 15 mds.0.cache ambiguous_subtrees 2023-10-03T19:21:26.573 INFO:teuthology.orchestra.run.smithi045.stdout: -2419> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 notify_mdsmap: mds.metrics 2023-10-03T19:21:26.574 INFO:teuthology.orchestra.run.smithi045.stdout: -2418> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 notify_mdsmap: mds.metrics: rank0 is unavailable 2023-10-03T19:21:26.574 INFO:teuthology.orchestra.run.smithi045.stdout: -2417> 2023-10-03T19:19:39.420+0000 7fd1a5470640 10 reset_seq: mds.metrics: last_updated_seq=0 2023-10-03T19:21:26.574 INFO:teuthology.orchestra.run.smithi045.stdout: -2416> 2023-10-03T19:19:39.420+0000 7fd1a5470640 20 set_next_seq: mds.metrics: current sequence number 0, setting next sequence number 0 2023-10-03T19:21:26.574 INFO:teuthology.orchestra.run.smithi045.stdout: -2415> 2023-10-03T19:19:39.420+0000 7fd19ec63640 5 mds.0.log _submit_thread 4194304~872 : ESubtreeMap 2 subtrees , 0 ambiguous [metablob 0x1, 2 dirs] 2023-10-03T19:21:26.574 INFO:teuthology.orchestra.run.smithi045.stdout: -2414> 2023-10-03T19:19:39.424+0000 7fd19ec63640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.574 INFO:teuthology.orchestra.run.smithi045.stdout: -2413> 2023-10-03T19:19:39.424+0000 7fd19ec63640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=32) v1 -- 0x556317b13b80 con 0x556317aaf800 2023-10-03T19:21:26.574 INFO:teuthology.orchestra.run.smithi045.stdout: -2412> 2023-10-03T19:19:39.424+0000 7fd19ec63640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.574 INFO:teuthology.orchestra.run.smithi045.stdout: -2411> 2023-10-03T19:19:39.424+0000 7fd19ec63640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=33) v1 -- 0x556317b13e40 con 0x556317aaf800 2023-10-03T19:21:26.574 INFO:teuthology.orchestra.run.smithi045.stdout: -2410> 2023-10-03T19:19:39.424+0000 7fd19ec63640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.574 INFO:teuthology.orchestra.run.smithi045.stdout: -2409> 2023-10-03T19:19:39.424+0000 7fd19ec63640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=34) v1 -- 0x556317b13080 con 0x556317aaf800 2023-10-03T19:21:26.574 INFO:teuthology.orchestra.run.smithi045.stdout: -2408> 2023-10-03T19:19:39.424+0000 7fd19ec63640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.574 INFO:teuthology.orchestra.run.smithi045.stdout: -2407> 2023-10-03T19:19:39.424+0000 7fd19ec63640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=35) v1 -- 0x556318a8c000 con 0x556317aaf800 2023-10-03T19:21:26.575 INFO:teuthology.orchestra.run.smithi045.stdout: -2406> 2023-10-03T19:19:39.424+0000 7fd19ec63640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.575 INFO:teuthology.orchestra.run.smithi045.stdout: -2405> 2023-10-03T19:19:39.424+0000 7fd19ec63640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=36) v1 -- 0x556317b138c0 con 0x556317aaf800 2023-10-03T19:21:26.575 INFO:teuthology.orchestra.run.smithi045.stdout: -2404> 2023-10-03T19:19:39.424+0000 7fd19ec63640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.575 INFO:teuthology.orchestra.run.smithi045.stdout: -2403> 2023-10-03T19:19:39.424+0000 7fd19ec63640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=37) v1 -- 0x556317b12c60 con 0x556317aaf800 2023-10-03T19:21:26.575 INFO:teuthology.orchestra.run.smithi045.stdout: -2402> 2023-10-03T19:19:39.424+0000 7fd1a1468640 2 mds.0.cache Memory usage: total 256716, rss 35332, heap 190760, baseline 190760, 0 / 13 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:26.575 INFO:teuthology.orchestra.run.smithi045.stdout: -2401> 2023-10-03T19:19:39.424+0000 7fd1a1468640 10 mds.0.cache cache not ready for trimming 2023-10-03T19:21:26.575 INFO:teuthology.orchestra.run.smithi045.stdout: -2400> 2023-10-03T19:19:39.424+0000 7fd1a1468640 10 mds.0.cache releasing free memory 2023-10-03T19:21:26.575 INFO:teuthology.orchestra.run.smithi045.stdout: -2399> 2023-10-03T19:19:39.424+0000 7fd1a1468640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:26.575 INFO:teuthology.orchestra.run.smithi045.stdout: -2398> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 11 ==== osd_map(97..97 src has 1..97) v4 ==== 6062+0+0 (secure 0 0 0) 0x556317aeea80 con 0x556317aaf800 2023-10-03T19:21:26.575 INFO:teuthology.orchestra.run.smithi045.stdout: -2397> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] conn(0x5563189cc400 0x556318a5f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:26.575 INFO:teuthology.orchestra.run.smithi045.stdout: -2396> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.48:1 15.14 15:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556317b05880 con 0x5563189cc400 2023-10-03T19:21:26.576 INFO:teuthology.orchestra.run.smithi045.stdout: -2395> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.48:2 15.f 15:f1f69726:::400.00000000:head [writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556317b05c00 con 0x5563189cc400 2023-10-03T19:21:26.576 INFO:teuthology.orchestra.run.smithi045.stdout: -2394> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.48:3 15.14 15:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318ac8000 con 0x5563189cc400 2023-10-03T19:21:26.576 INFO:teuthology.orchestra.run.smithi045.stdout: -2393> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] conn(0x556317c2d000 0x556318a5f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:26.576 INFO:teuthology.orchestra.run.smithi045.stdout: -2392> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.48:4 15.1f 15:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=36b,setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318ac8380 con 0x556317c2d000 2023-10-03T19:21:26.576 INFO:teuthology.orchestra.run.smithi045.stdout: -2391> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.48:5 15.1f 15:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318ac8700 con 0x556317c2d000 2023-10-03T19:21:26.576 INFO:teuthology.orchestra.run.smithi045.stdout: -2390> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] conn(0x5563189cc800 0x556318ace000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:26.576 INFO:teuthology.orchestra.run.smithi045.stdout: -2389> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.48:6 15.10 15:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318ac8a80 con 0x5563189cc800 2023-10-03T19:21:26.576 INFO:teuthology.orchestra.run.smithi045.stdout: -2388> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.48:7 15.10 15:0d82a743:::600.00000000:head [create,setxattr parent (62) in=68b,setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318ac8e00 con 0x5563189cc800 2023-10-03T19:21:26.576 INFO:teuthology.orchestra.run.smithi045.stdout: -2387> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.48:8 15.10 15:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318ac9180 con 0x5563189cc800 2023-10-03T19:21:26.576 INFO:teuthology.orchestra.run.smithi045.stdout: -2386> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.48:9 15.10 15:09401a81:::601.00000000:head [create,setxattr parent (62) in=68b,setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318ac9500 con 0x5563189cc800 2023-10-03T19:21:26.576 INFO:teuthology.orchestra.run.smithi045.stdout: -2385> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.48:10 15.10 15:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318ac9880 con 0x5563189cc800 2023-10-03T19:21:26.577 INFO:teuthology.orchestra.run.smithi045.stdout: -2384> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.48:11 15.10 15:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=68b,setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318ac9c00 con 0x5563189cc800 2023-10-03T19:21:26.577 INFO:teuthology.orchestra.run.smithi045.stdout: -2383> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.48:12 15.10 15:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318ad2000 con 0x5563189cc800 2023-10-03T19:21:26.577 INFO:teuthology.orchestra.run.smithi045.stdout: -2382> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.48:13 15.10 15:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=68b,setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318ad2380 con 0x5563189cc800 2023-10-03T19:21:26.577 INFO:teuthology.orchestra.run.smithi045.stdout: -2381> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] conn(0x5563189ccc00 0x556318ace580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:26.577 INFO:teuthology.orchestra.run.smithi045.stdout: -2380> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.48:14 15.15 15:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318ad2700 con 0x5563189ccc00 2023-10-03T19:21:26.577 INFO:teuthology.orchestra.run.smithi045.stdout: -2379> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.48:15 15.15 15:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=68b,setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318ad2a80 con 0x5563189ccc00 2023-10-03T19:21:26.577 INFO:teuthology.orchestra.run.smithi045.stdout: -2378> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.48:16 15.1d 15:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318ad2e00 con 0x5563189cc800 2023-10-03T19:21:26.577 INFO:teuthology.orchestra.run.smithi045.stdout: -2377> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.48:17 15.1d 15:b871830b:::605.00000000:head [create,setxattr parent (62) in=68b,setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318ad3180 con 0x5563189cc800 2023-10-03T19:21:26.577 INFO:teuthology.orchestra.run.smithi045.stdout: -2376> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.48:18 15.14 15:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318ad3500 con 0x5563189cc400 2023-10-03T19:21:26.577 INFO:teuthology.orchestra.run.smithi045.stdout: -2375> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.48:19 15.14 15:2f55791f:::606.00000000:head [create,setxattr parent (62) in=68b,setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318ad3880 con 0x5563189cc400 2023-10-03T19:21:26.577 INFO:teuthology.orchestra.run.smithi045.stdout: -2374> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] conn(0x5563189cd000 0x556318aceb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:26.578 INFO:teuthology.orchestra.run.smithi045.stdout: -2373> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.48:20 15.1c 15:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318ad3c00 con 0x5563189cd000 2023-10-03T19:21:26.578 INFO:teuthology.orchestra.run.smithi045.stdout: -2372> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.48:21 15.1c 15:3ed09add:::607.00000000:head [create,setxattr parent (62) in=68b,setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318ad8000 con 0x5563189cd000 2023-10-03T19:21:26.578 INFO:teuthology.orchestra.run.smithi045.stdout: -2371> 2023-10-03T19:19:39.428+0000 7fd1a8c77640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] conn(0x5563189ccc00 0x556318ace580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:26.578 INFO:teuthology.orchestra.run.smithi045.stdout: -2370> 2023-10-03T19:19:39.428+0000 7fd1a8476640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] conn(0x556317c2d000 0x556318a5f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:26.578 INFO:teuthology.orchestra.run.smithi045.stdout: -2369> 2023-10-03T19:19:39.428+0000 7fd1a8476640 10 monclient: get_auth_request con 0x556317c2d000 auth_method 0 2023-10-03T19:21:26.578 INFO:teuthology.orchestra.run.smithi045.stdout: -2368> 2023-10-03T19:19:39.428+0000 7fd1a8476640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] conn(0x5563189cd000 0x556318aceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:26.578 INFO:teuthology.orchestra.run.smithi045.stdout: -2367> 2023-10-03T19:19:39.428+0000 7fd1a8476640 10 monclient: get_auth_request con 0x5563189cd000 auth_method 0 2023-10-03T19:21:26.578 INFO:teuthology.orchestra.run.smithi045.stdout: -2366> 2023-10-03T19:19:39.428+0000 7fd1a8c77640 10 monclient: get_auth_request con 0x5563189ccc00 auth_method 0 2023-10-03T19:21:26.578 INFO:teuthology.orchestra.run.smithi045.stdout: -2365> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] conn(0x5563189cd400 0x556318acf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:26.578 INFO:teuthology.orchestra.run.smithi045.stdout: -2364> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.48:22 15.e 15:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318ad8380 con 0x5563189cd400 2023-10-03T19:21:26.579 INFO:teuthology.orchestra.run.smithi045.stdout: -2363> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.48:23 15.e 15:717a0223:::608.00000000:head [create,setxattr parent (62) in=68b,setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318ad8700 con 0x5563189cd400 2023-10-03T19:21:26.579 INFO:teuthology.orchestra.run.smithi045.stdout: -2362> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.48:24 15.7 15:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318ad8a80 con 0x5563189cd000 2023-10-03T19:21:26.579 INFO:teuthology.orchestra.run.smithi045.stdout: -2361> 2023-10-03T19:19:39.428+0000 7fd1a8476640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] conn(0x556317c2d000 0x556318a5f700 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:26.579 INFO:teuthology.orchestra.run.smithi045.stdout: -2360> 2023-10-03T19:19:39.428+0000 7fd1a7c75640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] conn(0x5563189cd400 0x556318acf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:26.579 INFO:teuthology.orchestra.run.smithi045.stdout: -2359> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.48:25 15.7 15:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=68b,setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318ad8e00 con 0x5563189cd000 2023-10-03T19:21:26.579 INFO:teuthology.orchestra.run.smithi045.stdout: -2358> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.48:26 15.1f 15:fe07bba1:::100.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318ad9180 con 0x556317c2d000 2023-10-03T19:21:26.579 INFO:teuthology.orchestra.run.smithi045.stdout: -2357> 2023-10-03T19:19:39.428+0000 7fd1a7c75640 10 monclient: get_auth_request con 0x5563189cd400 auth_method 0 2023-10-03T19:21:26.579 INFO:teuthology.orchestra.run.smithi045.stdout: -2356> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.48:27 15.13 15:cd5a64a3:::100.00000000:head [omap-set-header in=274b,omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318ad9500 con 0x5563189cd000 2023-10-03T19:21:26.579 INFO:teuthology.orchestra.run.smithi045.stdout: -2355> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.48:28 15.13 15:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318ad9880 con 0x5563189cd000 2023-10-03T19:21:26.579 INFO:teuthology.orchestra.run.smithi045.stdout: -2354> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.48:29 15.b 15:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318ad9c00 con 0x5563189cd400 2023-10-03T19:21:26.579 INFO:teuthology.orchestra.run.smithi045.stdout: -2353> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.48:30 15.15 15:aa448500:::500.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318900000 con 0x5563189ccc00 2023-10-03T19:21:26.580 INFO:teuthology.orchestra.run.smithi045.stdout: -2352> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.48:31 15.d 15:b50e409b:::mds_snaptable:head [writefull 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318900380 con 0x5563189ccc00 2023-10-03T19:21:26.580 INFO:teuthology.orchestra.run.smithi045.stdout: -2351> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.48:32 15.14 15:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318900700 con 0x5563189cc400 2023-10-03T19:21:26.580 INFO:teuthology.orchestra.run.smithi045.stdout: -2350> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.48:33 15.1b 15:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318900a80 con 0x5563189ccc00 2023-10-03T19:21:26.580 INFO:teuthology.orchestra.run.smithi045.stdout: -2349> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.48:34 15.b 15:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318900e00 con 0x5563189cd400 2023-10-03T19:21:26.580 INFO:teuthology.orchestra.run.smithi045.stdout: -2348> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.48:35 15.1f 15:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318901180 con 0x556317c2d000 2023-10-03T19:21:26.580 INFO:teuthology.orchestra.run.smithi045.stdout: -2347> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] conn(0x5563189cd800 0x556318acf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:26.580 INFO:teuthology.orchestra.run.smithi045.stdout: -2346> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.48:36 15.1a 15:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318901500 con 0x5563189cd800 2023-10-03T19:21:26.580 INFO:teuthology.orchestra.run.smithi045.stdout: -2345> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.48:37 15.1e 15:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318901880 con 0x5563189cd400 2023-10-03T19:21:26.580 INFO:teuthology.orchestra.run.smithi045.stdout: -2344> 2023-10-03T19:19:39.428+0000 7fd1a5470640 7 mds.0.server operator(): full = 0 epoch = 97 2023-10-03T19:21:26.580 INFO:teuthology.orchestra.run.smithi045.stdout: -2343> 2023-10-03T19:19:39.428+0000 7fd1a5470640 10 mds.0.server apply_blocklist: killed 0 2023-10-03T19:21:26.580 INFO:teuthology.orchestra.run.smithi045.stdout: -2342> 2023-10-03T19:19:39.428+0000 7fd1a5470640 4 mds.0.48 apply_blocklist: killed 0, blocklisted sessions (0 blocklist entries, 0) 2023-10-03T19:21:26.581 INFO:teuthology.orchestra.run.smithi045.stdout: -2341> 2023-10-03T19:19:39.428+0000 7fd1a5470640 10 monclient: _renew_subs 2023-10-03T19:21:26.581 INFO:teuthology.orchestra.run.smithi045.stdout: -2340> 2023-10-03T19:19:39.428+0000 7fd1a5470640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.581 INFO:teuthology.orchestra.run.smithi045.stdout: -2339> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=98}) v3 -- 0x556318959d40 con 0x556317aaf800 2023-10-03T19:21:26.581 INFO:teuthology.orchestra.run.smithi045.stdout: -2338> 2023-10-03T19:19:39.428+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 12 ==== mon_get_version_reply(handle=1 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556317b12c60 con 0x556317aaf800 2023-10-03T19:21:26.581 INFO:teuthology.orchestra.run.smithi045.stdout: -2337> 2023-10-03T19:19:39.428+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 1 version 97 2023-10-03T19:21:26.581 INFO:teuthology.orchestra.run.smithi045.stdout: -2336> 2023-10-03T19:19:39.428+0000 7fd1a8476640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] conn(0x5563189cd000 0x556318aceb00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:26.581 INFO:teuthology.orchestra.run.smithi045.stdout: -2335> 2023-10-03T19:19:39.428+0000 7fd1a7c75640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] conn(0x5563189cd400 0x556318acf080 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:26.581 INFO:teuthology.orchestra.run.smithi045.stdout: -2334> 2023-10-03T19:19:39.432+0000 7fd1a8c77640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] conn(0x5563189cd800 0x556318acf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:26.581 INFO:teuthology.orchestra.run.smithi045.stdout: -2333> 2023-10-03T19:19:39.432+0000 7fd1a7c75640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] conn(0x5563189cc800 0x556318ace000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:26.581 INFO:teuthology.orchestra.run.smithi045.stdout: -2332> 2023-10-03T19:19:39.432+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 13 ==== mon_get_version_reply(handle=2 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556317b138c0 con 0x556317aaf800 2023-10-03T19:21:26.581 INFO:teuthology.orchestra.run.smithi045.stdout: -2331> 2023-10-03T19:19:39.432+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 2 version 97 2023-10-03T19:21:26.582 INFO:teuthology.orchestra.run.smithi045.stdout: -2330> 2023-10-03T19:19:39.432+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 14 ==== mon_get_version_reply(handle=3 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318a8c000 con 0x556317aaf800 2023-10-03T19:21:26.582 INFO:teuthology.orchestra.run.smithi045.stdout: -2329> 2023-10-03T19:19:39.432+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 3 version 97 2023-10-03T19:21:26.582 INFO:teuthology.orchestra.run.smithi045.stdout: -2328> 2023-10-03T19:19:39.432+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 15 ==== mon_get_version_reply(handle=4 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556317b13080 con 0x556317aaf800 2023-10-03T19:21:26.582 INFO:teuthology.orchestra.run.smithi045.stdout: -2327> 2023-10-03T19:19:39.432+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 4 version 97 2023-10-03T19:21:26.582 INFO:teuthology.orchestra.run.smithi045.stdout: -2326> 2023-10-03T19:19:39.436+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 16 ==== mon_get_version_reply(handle=5 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556317b13e40 con 0x556317aaf800 2023-10-03T19:21:26.582 INFO:teuthology.orchestra.run.smithi045.stdout: -2325> 2023-10-03T19:19:39.436+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 5 version 97 2023-10-03T19:21:26.582 INFO:teuthology.orchestra.run.smithi045.stdout: -2324> 2023-10-03T19:19:39.436+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 17 ==== mon_get_version_reply(handle=6 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556317b13b80 con 0x556317aaf800 2023-10-03T19:21:26.582 INFO:teuthology.orchestra.run.smithi045.stdout: -2323> 2023-10-03T19:19:39.436+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 6 version 97 2023-10-03T19:21:26.582 INFO:teuthology.orchestra.run.smithi045.stdout: -2322> 2023-10-03T19:19:39.436+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 18 ==== mon_get_version_reply(handle=7 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318a8c840 con 0x556317aaf800 2023-10-03T19:21:26.582 INFO:teuthology.orchestra.run.smithi045.stdout: -2321> 2023-10-03T19:19:39.436+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 7 version 97 2023-10-03T19:21:26.582 INFO:teuthology.orchestra.run.smithi045.stdout: -2320> 2023-10-03T19:19:39.436+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 19 ==== mon_get_version_reply(handle=8 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318a8de40 con 0x556317aaf800 2023-10-03T19:21:26.582 INFO:teuthology.orchestra.run.smithi045.stdout: -2319> 2023-10-03T19:19:39.436+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 8 version 97 2023-10-03T19:21:26.583 INFO:teuthology.orchestra.run.smithi045.stdout: -2318> 2023-10-03T19:19:39.436+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 20 ==== mon_get_version_reply(handle=9 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318ae2000 con 0x556317aaf800 2023-10-03T19:21:26.583 INFO:teuthology.orchestra.run.smithi045.stdout: -2317> 2023-10-03T19:19:39.436+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 9 version 97 2023-10-03T19:21:26.583 INFO:teuthology.orchestra.run.smithi045.stdout: -2316> 2023-10-03T19:19:39.440+0000 7fd1a7c75640 10 monclient: get_auth_request con 0x5563189cc800 auth_method 0 2023-10-03T19:21:26.583 INFO:teuthology.orchestra.run.smithi045.stdout: -2315> 2023-10-03T19:19:39.440+0000 7fd1a8c77640 10 monclient: get_auth_request con 0x5563189cd800 auth_method 0 2023-10-03T19:21:26.583 INFO:teuthology.orchestra.run.smithi045.stdout: -2314> 2023-10-03T19:19:39.440+0000 7fd1a8c77640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] conn(0x5563189cc400 0x556318a5f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:26.583 INFO:teuthology.orchestra.run.smithi045.stdout: -2313> 2023-10-03T19:19:39.440+0000 7fd1a8c77640 10 monclient: get_auth_request con 0x5563189cc400 auth_method 0 2023-10-03T19:21:26.583 INFO:teuthology.orchestra.run.smithi045.stdout: -2312> 2023-10-03T19:19:39.440+0000 7fd1a8c77640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] conn(0x5563189ccc00 0x556318ace580 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:26.583 INFO:teuthology.orchestra.run.smithi045.stdout: -2311> 2023-10-03T19:19:39.440+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 21 ==== mon_get_version_reply(handle=10 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318ae2160 con 0x556317aaf800 2023-10-03T19:21:26.583 INFO:teuthology.orchestra.run.smithi045.stdout: -2310> 2023-10-03T19:19:39.440+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 10 version 97 2023-10-03T19:21:26.583 INFO:teuthology.orchestra.run.smithi045.stdout: -2309> 2023-10-03T19:19:39.440+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 22 ==== mon_get_version_reply(handle=11 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318ae22c0 con 0x556317aaf800 2023-10-03T19:21:26.583 INFO:teuthology.orchestra.run.smithi045.stdout: -2308> 2023-10-03T19:19:39.440+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 11 version 97 2023-10-03T19:21:26.584 INFO:teuthology.orchestra.run.smithi045.stdout: -2307> 2023-10-03T19:19:39.440+0000 7fd1a8476640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.3 v2:172.21.15.45:6816/4227059688 1 ==== osd_op_reply(4 1.00000000 [create,setxattr (30),setxattr (30)] v97'1 uv1 ondisk = 0) v8 ==== 238+0+0 (crc 0 0 0) 0x556318aaeb40 con 0x556317c2d000 2023-10-03T19:21:26.584 INFO:teuthology.orchestra.run.smithi045.stdout: -2306> 2023-10-03T19:19:39.440+0000 7fd19f464640 10 MDSIOContextBase::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:26.584 INFO:teuthology.orchestra.run.smithi045.stdout: -2305> 2023-10-03T19:19:39.440+0000 7fd19f464640 10 MDSContext::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:26.584 INFO:teuthology.orchestra.run.smithi045.stdout: -2304> 2023-10-03T19:19:39.440+0000 7fd19f464640 10 mds.0.cache.ino(0x1) _stored_backtrace v 0 2023-10-03T19:21:26.584 INFO:teuthology.orchestra.run.smithi045.stdout: -2303> 2023-10-03T19:19:39.440+0000 7fd19f464640 10 mds.0.cache.ino(0x1) auth_unpin by 0x556317b3c680 on [inode 0x1 [...2,head] / auth v1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=0 0x556317b3c680] now 0 2023-10-03T19:21:26.584 INFO:teuthology.orchestra.run.smithi045.stdout: -2302> 2023-10-03T19:19:39.440+0000 7fd19f464640 10 mds.0.cache.ino(0x1) clear_dirty_parent 2023-10-03T19:21:26.584 INFO:teuthology.orchestra.run.smithi045.stdout: -2301> 2023-10-03T19:19:39.440+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 23 ==== mon_get_version_reply(handle=12 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318ae2420 con 0x556317aaf800 2023-10-03T19:21:26.584 INFO:teuthology.orchestra.run.smithi045.stdout: -2300> 2023-10-03T19:19:39.440+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 12 version 97 2023-10-03T19:21:26.584 INFO:teuthology.orchestra.run.smithi045.stdout: -2299> 2023-10-03T19:19:39.440+0000 7fd1a8c77640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] conn(0x5563189cd800 0x556318acf600 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:26.584 INFO:teuthology.orchestra.run.smithi045.stdout: -2298> 2023-10-03T19:19:39.440+0000 7fd1a8c77640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] conn(0x5563189cc400 0x556318a5f180 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:26.711 INFO:teuthology.orchestra.run.smithi045.stdout: -2297> 2023-10-03T19:19:39.444+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 24 ==== mon_get_version_reply(handle=13 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318ae2580 con 0x556317aaf800 2023-10-03T19:21:26.711 INFO:teuthology.orchestra.run.smithi045.stdout: -2296> 2023-10-03T19:19:39.444+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 13 version 97 2023-10-03T19:21:26.711 INFO:teuthology.orchestra.run.smithi045.stdout: -2295> 2023-10-03T19:19:39.444+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 25 ==== mon_get_version_reply(handle=14 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318ae26e0 con 0x556317aaf800 2023-10-03T19:21:26.711 INFO:teuthology.orchestra.run.smithi045.stdout: -2294> 2023-10-03T19:19:39.444+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 14 version 97 2023-10-03T19:21:26.711 INFO:teuthology.orchestra.run.smithi045.stdout: -2293> 2023-10-03T19:19:39.444+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 26 ==== mon_get_version_reply(handle=15 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318ae2840 con 0x556317aaf800 2023-10-03T19:21:26.711 INFO:teuthology.orchestra.run.smithi045.stdout: -2292> 2023-10-03T19:19:39.444+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 15 version 97 2023-10-03T19:21:26.711 INFO:teuthology.orchestra.run.smithi045.stdout: -2291> 2023-10-03T19:19:39.444+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 27 ==== mon_get_version_reply(handle=16 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318ae29a0 con 0x556317aaf800 2023-10-03T19:21:26.711 INFO:teuthology.orchestra.run.smithi045.stdout: -2290> 2023-10-03T19:19:39.444+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 16 version 97 2023-10-03T19:21:26.711 INFO:teuthology.orchestra.run.smithi045.stdout: -2289> 2023-10-03T19:19:39.444+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 28 ==== mon_get_version_reply(handle=17 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318ae2b00 con 0x556317aaf800 2023-10-03T19:21:26.712 INFO:teuthology.orchestra.run.smithi045.stdout: -2288> 2023-10-03T19:19:39.444+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 17 version 97 2023-10-03T19:21:26.712 INFO:teuthology.orchestra.run.smithi045.stdout: -2287> 2023-10-03T19:19:39.444+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 29 ==== mon_get_version_reply(handle=18 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318ae2c60 con 0x556317aaf800 2023-10-03T19:21:26.712 INFO:teuthology.orchestra.run.smithi045.stdout: -2286> 2023-10-03T19:19:39.444+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 18 version 97 2023-10-03T19:21:26.712 INFO:teuthology.orchestra.run.smithi045.stdout: -2285> 2023-10-03T19:19:39.444+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 30 ==== mon_get_version_reply(handle=19 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318ae2dc0 con 0x556317aaf800 2023-10-03T19:21:26.712 INFO:teuthology.orchestra.run.smithi045.stdout: -2284> 2023-10-03T19:19:39.444+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 19 version 97 2023-10-03T19:21:26.712 INFO:teuthology.orchestra.run.smithi045.stdout: -2283> 2023-10-03T19:19:39.444+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 31 ==== mon_get_version_reply(handle=20 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318ae2f20 con 0x556317aaf800 2023-10-03T19:21:26.712 INFO:teuthology.orchestra.run.smithi045.stdout: -2282> 2023-10-03T19:19:39.444+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 20 version 97 2023-10-03T19:21:26.712 INFO:teuthology.orchestra.run.smithi045.stdout: -2281> 2023-10-03T19:19:39.444+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 32 ==== mon_get_version_reply(handle=21 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318ae3080 con 0x556317aaf800 2023-10-03T19:21:26.712 INFO:teuthology.orchestra.run.smithi045.stdout: -2280> 2023-10-03T19:19:39.444+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 21 version 97 2023-10-03T19:21:26.712 INFO:teuthology.orchestra.run.smithi045.stdout: -2279> 2023-10-03T19:19:39.444+0000 7fd1a7c75640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.2 v2:172.21.15.45:6817/964866005 1 ==== osd_op_reply(29 mds0_sessionmap [omap-set-header] v97'1 uv1 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x556317c16fc0 con 0x5563189cd400 2023-10-03T19:21:26.712 INFO:teuthology.orchestra.run.smithi045.stdout: -2278> 2023-10-03T19:19:39.444+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 33 ==== mon_get_version_reply(handle=22 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318ae31e0 con 0x556317aaf800 2023-10-03T19:21:26.713 INFO:teuthology.orchestra.run.smithi045.stdout: -2277> 2023-10-03T19:19:39.444+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 22 version 97 2023-10-03T19:21:26.713 INFO:teuthology.orchestra.run.smithi045.stdout: -2276> 2023-10-03T19:19:39.444+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 34 ==== mon_get_version_reply(handle=23 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318ae3340 con 0x556317aaf800 2023-10-03T19:21:26.713 INFO:teuthology.orchestra.run.smithi045.stdout: -2275> 2023-10-03T19:19:39.444+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 23 version 97 2023-10-03T19:21:26.713 INFO:teuthology.orchestra.run.smithi045.stdout: -2274> 2023-10-03T19:19:39.444+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 35 ==== mon_get_version_reply(handle=24 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318ae34a0 con 0x556317aaf800 2023-10-03T19:21:26.713 INFO:teuthology.orchestra.run.smithi045.stdout: -2273> 2023-10-03T19:19:39.444+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 24 version 97 2023-10-03T19:21:26.713 INFO:teuthology.orchestra.run.smithi045.stdout: -2272> 2023-10-03T19:19:39.444+0000 7fd1a7c75640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.2 v2:172.21.15.45:6817/964866005 2 ==== osd_op_reply(34 200.00000003 [delete] v97'2 uv1 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x556317c16fc0 con 0x5563189cd400 2023-10-03T19:21:26.713 INFO:teuthology.orchestra.run.smithi045.stdout: -2271> 2023-10-03T19:19:39.444+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 36 ==== mon_get_version_reply(handle=25 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318ae3600 con 0x556317aaf800 2023-10-03T19:21:26.713 INFO:teuthology.orchestra.run.smithi045.stdout: -2270> 2023-10-03T19:19:39.444+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 25 version 97 2023-10-03T19:21:26.713 INFO:teuthology.orchestra.run.smithi045.stdout: -2269> 2023-10-03T19:19:39.444+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 37 ==== mon_get_version_reply(handle=26 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318ae3760 con 0x556317aaf800 2023-10-03T19:21:26.713 INFO:teuthology.orchestra.run.smithi045.stdout: -2268> 2023-10-03T19:19:39.444+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 26 version 97 2023-10-03T19:21:26.714 INFO:teuthology.orchestra.run.smithi045.stdout: -2267> 2023-10-03T19:19:39.444+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 38 ==== mon_get_version_reply(handle=27 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318ae38c0 con 0x556317aaf800 2023-10-03T19:21:26.714 INFO:teuthology.orchestra.run.smithi045.stdout: -2266> 2023-10-03T19:19:39.444+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 27 version 97 2023-10-03T19:21:26.714 INFO:teuthology.orchestra.run.smithi045.stdout: -2265> 2023-10-03T19:19:39.444+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 39 ==== mon_get_version_reply(handle=28 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318ae3a20 con 0x556317aaf800 2023-10-03T19:21:26.714 INFO:teuthology.orchestra.run.smithi045.stdout: -2264> 2023-10-03T19:19:39.444+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 28 version 97 2023-10-03T19:21:26.714 INFO:teuthology.orchestra.run.smithi045.stdout: -2263> 2023-10-03T19:19:39.444+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 40 ==== mon_get_version_reply(handle=29 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318ae3b80 con 0x556317aaf800 2023-10-03T19:21:26.714 INFO:teuthology.orchestra.run.smithi045.stdout: -2262> 2023-10-03T19:19:39.444+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 29 version 97 2023-10-03T19:21:26.714 INFO:teuthology.orchestra.run.smithi045.stdout: -2261> 2023-10-03T19:19:39.444+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 41 ==== mon_get_version_reply(handle=30 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318ae3ce0 con 0x556317aaf800 2023-10-03T19:21:26.714 INFO:teuthology.orchestra.run.smithi045.stdout: -2260> 2023-10-03T19:19:39.444+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 30 version 97 2023-10-03T19:21:26.714 INFO:teuthology.orchestra.run.smithi045.stdout: -2259> 2023-10-03T19:19:39.444+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 42 ==== mon_get_version_reply(handle=31 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318ae3e40 con 0x556317aaf800 2023-10-03T19:21:26.715 INFO:teuthology.orchestra.run.smithi045.stdout: -2258> 2023-10-03T19:19:39.444+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 31 version 97 2023-10-03T19:21:26.715 INFO:teuthology.orchestra.run.smithi045.stdout: -2257> 2023-10-03T19:19:39.444+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 43 ==== mon_get_version_reply(handle=32 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318ae6000 con 0x556317aaf800 2023-10-03T19:21:26.715 INFO:teuthology.orchestra.run.smithi045.stdout: -2256> 2023-10-03T19:19:39.444+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 32 version 97 2023-10-03T19:21:26.715 INFO:teuthology.orchestra.run.smithi045.stdout: -2255> 2023-10-03T19:19:39.444+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 44 ==== mon_get_version_reply(handle=33 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318ae6160 con 0x556317aaf800 2023-10-03T19:21:26.715 INFO:teuthology.orchestra.run.smithi045.stdout: -2254> 2023-10-03T19:19:39.444+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 33 version 97 2023-10-03T19:21:26.715 INFO:teuthology.orchestra.run.smithi045.stdout: -2253> 2023-10-03T19:19:39.444+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 45 ==== mon_get_version_reply(handle=34 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318ae62c0 con 0x556317aaf800 2023-10-03T19:21:26.715 INFO:teuthology.orchestra.run.smithi045.stdout: -2252> 2023-10-03T19:19:39.444+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 34 version 97 2023-10-03T19:21:26.715 INFO:teuthology.orchestra.run.smithi045.stdout: -2251> 2023-10-03T19:19:39.444+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 46 ==== mon_get_version_reply(handle=35 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318ae6420 con 0x556317aaf800 2023-10-03T19:21:26.715 INFO:teuthology.orchestra.run.smithi045.stdout: -2250> 2023-10-03T19:19:39.444+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 35 version 97 2023-10-03T19:21:26.715 INFO:teuthology.orchestra.run.smithi045.stdout: -2249> 2023-10-03T19:19:39.444+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 47 ==== mon_get_version_reply(handle=36 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318ae6580 con 0x556317aaf800 2023-10-03T19:21:26.715 INFO:teuthology.orchestra.run.smithi045.stdout: -2248> 2023-10-03T19:19:39.444+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 36 version 97 2023-10-03T19:21:26.716 INFO:teuthology.orchestra.run.smithi045.stdout: -2247> 2023-10-03T19:19:39.444+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 48 ==== mon_get_version_reply(handle=37 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x556318ae66e0 con 0x556317aaf800 2023-10-03T19:21:26.716 INFO:teuthology.orchestra.run.smithi045.stdout: -2246> 2023-10-03T19:19:39.444+0000 7fd1a5470640 10 monclient: handle_get_version_reply finishing 37 version 97 2023-10-03T19:21:26.716 INFO:teuthology.orchestra.run.smithi045.stdout: -2245> 2023-10-03T19:19:39.444+0000 7fd1a8476640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.1 v2:172.21.15.45:6808/1433143371 1 ==== osd_op_reply(24 609.00000000 [omap-set-header] v97'1 uv1 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x556318aaeb40 con 0x5563189cd000 2023-10-03T19:21:26.716 INFO:teuthology.orchestra.run.smithi045.stdout: -2244> 2023-10-03T19:19:39.444+0000 7fd1a8476640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.1 v2:172.21.15.45:6808/1433143371 2 ==== osd_op_reply(27 100.00000000 [omap-set-header,omap-set-vals] v97'1 uv1 ondisk = 0) v8 ==== 198+0+0 (crc 0 0 0) 0x556318aaeb40 con 0x5563189cd000 2023-10-03T19:21:26.716 INFO:teuthology.orchestra.run.smithi045.stdout: -2243> 2023-10-03T19:19:39.444+0000 7fd1a8476640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.1 v2:172.21.15.45:6808/1433143371 3 ==== osd_op_reply(25 609.00000000 [create,setxattr (62),setxattr (30)] v97'2 uv2 ondisk = 0) v8 ==== 240+0+0 (crc 0 0 0) 0x556318aaeb40 con 0x5563189cd000 2023-10-03T19:21:26.716 INFO:teuthology.orchestra.run.smithi045.stdout: -2242> 2023-10-03T19:19:39.444+0000 7fd19f464640 10 MDSIOContextBase::complete: N12_GLOBAL__N_112C_IO_SM_SaveE 2023-10-03T19:21:26.716 INFO:teuthology.orchestra.run.smithi045.stdout: -2241> 2023-10-03T19:19:39.444+0000 7fd19f464640 10 MDSContext::complete: N12_GLOBAL__N_112C_IO_SM_SaveE 2023-10-03T19:21:26.716 INFO:teuthology.orchestra.run.smithi045.stdout: -2240> 2023-10-03T19:19:39.444+0000 7fd19f464640 10 mds.0.sessionmap _save_finish v0 2023-10-03T19:21:26.716 INFO:teuthology.orchestra.run.smithi045.stdout: -2239> 2023-10-03T19:19:39.444+0000 7fd19f464640 10 MDSIOContextBase::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:26.716 INFO:teuthology.orchestra.run.smithi045.stdout: -2238> 2023-10-03T19:19:39.444+0000 7fd19f464640 10 MDSContext::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:26.716 INFO:teuthology.orchestra.run.smithi045.stdout: -2237> 2023-10-03T19:19:39.444+0000 7fd19f464640 10 mds.0.cache.dir(0x609) _committed v 1 on [dir 0x609 ~mds0/stray9/ [2,head] auth v=1 cv=1/0 ap=1+0 state=1610612769|complete|committing f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a52400] 2023-10-03T19:21:26.717 INFO:teuthology.orchestra.run.smithi045.stdout: -2236> 2023-10-03T19:19:39.444+0000 7fd19f464640 10 mds.0.cache.dir(0x609) mark_clean [dir 0x609 ~mds0/stray9/ [2,head] auth v=1 cv=1/1 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a52400] version 1 2023-10-03T19:21:26.717 INFO:teuthology.orchestra.run.smithi045.stdout: -2235> 2023-10-03T19:19:39.444+0000 7fd19f464640 10 mds.0.cache.dir(0x609) auth_unpin by 0x556318a52400 on [dir 0x609 ~mds0/stray9/ [2,head] auth v=1 cv=1/1 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x556318a52400] count now 0 2023-10-03T19:21:26.717 INFO:teuthology.orchestra.run.smithi045.stdout: -2234> 2023-10-03T19:19:39.444+0000 7fd19f464640 10 MDSIOContextBase::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:26.717 INFO:teuthology.orchestra.run.smithi045.stdout: -2233> 2023-10-03T19:19:39.444+0000 7fd19f464640 10 MDSContext::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:26.717 INFO:teuthology.orchestra.run.smithi045.stdout: -2232> 2023-10-03T19:19:39.444+0000 7fd19f464640 10 mds.0.cache.dir(0x100) _committed v 1 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/0 dir_auth=0 ap=1+10 state=1610612769|complete|committing f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10) hs=10+0,ss=0+0 dirty=10 | child=1 subtree=1 dirty=1 authpin=1 0x556317b1d600] 2023-10-03T19:21:26.717 INFO:teuthology.orchestra.run.smithi045.stdout: -2231> 2023-10-03T19:19:39.444+0000 7fd19f464640 10 mds.0.cache.dir(0x100) mark_clean [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 ap=1+10 state=1610612737|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10) hs=10+0,ss=0+0 dirty=10 | child=1 subtree=1 dirty=1 authpin=1 0x556317b1d600] version 1 2023-10-03T19:21:26.717 INFO:teuthology.orchestra.run.smithi045.stdout: -2230> 2023-10-03T19:19:39.444+0000 7fd19f464640 15 mds.0.cache.dir(0x100) dir 1 >= dn 0 now clean [dentry #0x100/stray0 [2,head] auth (dversion lock) v=0 ino=0x600 state=1610612736 | inodepin=1 dirty=1 0x55631882c500] 2023-10-03T19:21:26.717 INFO:teuthology.orchestra.run.smithi045.stdout: -2229> 2023-10-03T19:19:39.444+0000 7fd19f464640 10 mds.0.cache.den(0x100 stray0) mark_clean [dentry #0x100/stray0 [2,head] auth (dversion lock) v=0 ino=0x600 state=1610612736 | inodepin=1 dirty=1 0x55631882c500] 2023-10-03T19:21:26.717 INFO:teuthology.orchestra.run.smithi045.stdout: -2228> 2023-10-03T19:19:39.444+0000 7fd19f464640 15 mds.0.cache.dir(0x100) dir 1 >= dn 0 now clean [dentry #0x100/stray1 [2,head] auth (dversion lock) v=0 ino=0x601 state=1610612736 | inodepin=1 dirty=1 0x55631882c780] 2023-10-03T19:21:26.717 INFO:teuthology.orchestra.run.smithi045.stdout: -2227> 2023-10-03T19:19:39.444+0000 7fd19f464640 10 mds.0.cache.den(0x100 stray1) mark_clean [dentry #0x100/stray1 [2,head] auth (dversion lock) v=0 ino=0x601 state=1610612736 | inodepin=1 dirty=1 0x55631882c780] 2023-10-03T19:21:26.717 INFO:teuthology.orchestra.run.smithi045.stdout: -2226> 2023-10-03T19:19:39.444+0000 7fd19f464640 15 mds.0.cache.dir(0x100) dir 1 >= dn 0 now clean [dentry #0x100/stray2 [2,head] auth (dversion lock) v=0 ino=0x602 state=1610612736 | inodepin=1 dirty=1 0x55631882ca00] 2023-10-03T19:21:26.717 INFO:teuthology.orchestra.run.smithi045.stdout: -2225> 2023-10-03T19:19:39.444+0000 7fd19f464640 10 mds.0.cache.den(0x100 stray2) mark_clean [dentry #0x100/stray2 [2,head] auth (dversion lock) v=0 ino=0x602 state=1610612736 | inodepin=1 dirty=1 0x55631882ca00] 2023-10-03T19:21:26.718 INFO:teuthology.orchestra.run.smithi045.stdout: -2224> 2023-10-03T19:19:39.444+0000 7fd19f464640 15 mds.0.cache.dir(0x100) dir 1 >= dn 0 now clean [dentry #0x100/stray3 [2,head] auth (dversion lock) v=0 ino=0x603 state=1610612736 | inodepin=1 dirty=1 0x55631882cc80] 2023-10-03T19:21:26.720 INFO:teuthology.orchestra.run.smithi045.stdout: -2223> 2023-10-03T19:19:39.444+0000 7fd19f464640 10 mds.0.cache.den(0x100 stray3) mark_clean [dentry #0x100/stray3 [2,head] auth (dversion lock) v=0 ino=0x603 state=1610612736 | inodepin=1 dirty=1 0x55631882cc80] 2023-10-03T19:21:26.720 INFO:teuthology.orchestra.run.smithi045.stdout: -2222> 2023-10-03T19:19:39.444+0000 7fd19f464640 15 mds.0.cache.dir(0x100) dir 1 >= dn 0 now clean [dentry #0x100/stray4 [2,head] auth (dversion lock) v=0 ino=0x604 state=1610612736 | inodepin=1 dirty=1 0x55631882cf00] 2023-10-03T19:21:26.720 INFO:teuthology.orchestra.run.smithi045.stdout: -2221> 2023-10-03T19:19:39.444+0000 7fd19f464640 10 mds.0.cache.den(0x100 stray4) mark_clean [dentry #0x100/stray4 [2,head] auth (dversion lock) v=0 ino=0x604 state=1610612736 | inodepin=1 dirty=1 0x55631882cf00] 2023-10-03T19:21:26.720 INFO:teuthology.orchestra.run.smithi045.stdout: -2220> 2023-10-03T19:19:39.444+0000 7fd19f464640 15 mds.0.cache.dir(0x100) dir 1 >= dn 0 now clean [dentry #0x100/stray5 [2,head] auth (dversion lock) v=0 ino=0x605 state=1610612736 | inodepin=1 dirty=1 0x55631882d180] 2023-10-03T19:21:26.720 INFO:teuthology.orchestra.run.smithi045.stdout: -2219> 2023-10-03T19:19:39.444+0000 7fd19f464640 10 mds.0.cache.den(0x100 stray5) mark_clean [dentry #0x100/stray5 [2,head] auth (dversion lock) v=0 ino=0x605 state=1610612736 | inodepin=1 dirty=1 0x55631882d180] 2023-10-03T19:21:26.720 INFO:teuthology.orchestra.run.smithi045.stdout: -2218> 2023-10-03T19:19:39.444+0000 7fd19f464640 15 mds.0.cache.dir(0x100) dir 1 >= dn 0 now clean [dentry #0x100/stray6 [2,head] auth (dversion lock) v=0 ino=0x606 state=1610612736 | inodepin=1 dirty=1 0x55631882d400] 2023-10-03T19:21:26.720 INFO:teuthology.orchestra.run.smithi045.stdout: -2217> 2023-10-03T19:19:39.444+0000 7fd19f464640 10 mds.0.cache.den(0x100 stray6) mark_clean [dentry #0x100/stray6 [2,head] auth (dversion lock) v=0 ino=0x606 state=1610612736 | inodepin=1 dirty=1 0x55631882d400] 2023-10-03T19:21:26.721 INFO:teuthology.orchestra.run.smithi045.stdout: -2216> 2023-10-03T19:19:39.444+0000 7fd19f464640 15 mds.0.cache.dir(0x100) dir 1 >= dn 0 now clean [dentry #0x100/stray7 [2,head] auth (dversion lock) v=0 ino=0x607 state=1610612736 | inodepin=1 dirty=1 0x55631882d680] 2023-10-03T19:21:26.721 INFO:teuthology.orchestra.run.smithi045.stdout: -2215> 2023-10-03T19:19:39.444+0000 7fd19f464640 10 mds.0.cache.den(0x100 stray7) mark_clean [dentry #0x100/stray7 [2,head] auth (dversion lock) v=0 ino=0x607 state=1610612736 | inodepin=1 dirty=1 0x55631882d680] 2023-10-03T19:21:26.721 INFO:teuthology.orchestra.run.smithi045.stdout: -2214> 2023-10-03T19:19:39.444+0000 7fd19f464640 15 mds.0.cache.dir(0x100) dir 1 >= dn 0 now clean [dentry #0x100/stray8 [2,head] auth (dversion lock) v=0 ino=0x608 state=1610612736 | inodepin=1 dirty=1 0x55631882d900] 2023-10-03T19:21:26.721 INFO:teuthology.orchestra.run.smithi045.stdout: -2213> 2023-10-03T19:19:39.444+0000 7fd19f464640 10 mds.0.cache.den(0x100 stray8) mark_clean [dentry #0x100/stray8 [2,head] auth (dversion lock) v=0 ino=0x608 state=1610612736 | inodepin=1 dirty=1 0x55631882d900] 2023-10-03T19:21:26.721 INFO:teuthology.orchestra.run.smithi045.stdout: -2212> 2023-10-03T19:19:39.444+0000 7fd19f464640 15 mds.0.cache.dir(0x100) dir 1 >= dn 0 now clean [dentry #0x100/stray9 [2,head] auth (dversion lock) v=0 ino=0x609 state=1610612736 | inodepin=1 dirty=1 0x55631882db80] 2023-10-03T19:21:26.721 INFO:teuthology.orchestra.run.smithi045.stdout: -2211> 2023-10-03T19:19:39.444+0000 7fd19f464640 10 mds.0.cache.den(0x100 stray9) mark_clean [dentry #0x100/stray9 [2,head] auth (dversion lock) v=0 ino=0x609 state=1610612736 | inodepin=1 dirty=1 0x55631882db80] 2023-10-03T19:21:26.721 INFO:teuthology.orchestra.run.smithi045.stdout: -2210> 2023-10-03T19:19:39.444+0000 7fd19f464640 10 mds.0.cache.dir(0x100) auth_unpin by 0x556317b1d600 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 ap=0+10 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x556317b1d600] count now 0 2023-10-03T19:21:26.721 INFO:teuthology.orchestra.run.smithi045.stdout: -2209> 2023-10-03T19:19:39.444+0000 7fd19f464640 10 MDSIOContextBase::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:26.721 INFO:teuthology.orchestra.run.smithi045.stdout: -2208> 2023-10-03T19:19:39.444+0000 7fd1a0c67640 7 mds.0.48 mds has 2 queued contexts 2023-10-03T19:21:26.721 INFO:teuthology.orchestra.run.smithi045.stdout: -2207> 2023-10-03T19:19:39.444+0000 7fd1a0c67640 10 mds.0.48 finish 0x556318881830 2023-10-03T19:21:26.722 INFO:teuthology.orchestra.run.smithi045.stdout: -2206> 2023-10-03T19:19:39.444+0000 7fd1a0c67640 10 mds.0.48 finish 0x556318881490 2023-10-03T19:21:26.722 INFO:teuthology.orchestra.run.smithi045.stdout: -2205> 2023-10-03T19:19:39.444+0000 7fd19f464640 10 MDSContext::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:26.722 INFO:teuthology.orchestra.run.smithi045.stdout: -2204> 2023-10-03T19:19:39.444+0000 7fd19f464640 10 mds.0.cache.ino(0x609) _stored_backtrace v 0 2023-10-03T19:21:26.722 INFO:teuthology.orchestra.run.smithi045.stdout: -2203> 2023-10-03T19:19:39.444+0000 7fd19f464640 10 mds.0.cache.ino(0x609) auth_unpin by 0x556318a5e680 on [inode 0x609 [...2,head] ~mds0/stray9/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.425877+0000 1=0+1) (iversion lock) | dirfrag=0 dirtyparent=1 authpin=0 0x556318a5e680] now 0 2023-10-03T19:21:26.722 INFO:teuthology.orchestra.run.smithi045.stdout: -2202> 2023-10-03T19:19:39.444+0000 7fd19f464640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins -1 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 ap=0+9 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x556317b1d600] by 0x556318a5e680 count now 0/9 2023-10-03T19:21:26.722 INFO:teuthology.orchestra.run.smithi045.stdout: -2201> 2023-10-03T19:19:39.444+0000 7fd19f464640 10 mds.0.cache.ino(0x609) clear_dirty_parent 2023-10-03T19:21:26.722 INFO:teuthology.orchestra.run.smithi045.stdout: -2200> 2023-10-03T19:19:39.448+0000 7fd1a7c75640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.2 v2:172.21.15.45:6817/964866005 3 ==== osd_op_reply(22 608.00000000 [omap-set-header] v97'1 uv1 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x556317c16fc0 con 0x5563189cd400 2023-10-03T19:21:26.722 INFO:teuthology.orchestra.run.smithi045.stdout: -2199> 2023-10-03T19:19:39.448+0000 7fd19f464640 10 MDSIOContextBase::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:26.722 INFO:teuthology.orchestra.run.smithi045.stdout: -2198> 2023-10-03T19:19:39.448+0000 7fd19f464640 10 MDSContext::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:26.722 INFO:teuthology.orchestra.run.smithi045.stdout: -2197> 2023-10-03T19:19:39.448+0000 7fd19f464640 10 mds.0.cache.dir(0x608) _committed v 1 on [dir 0x608 ~mds0/stray8/ [2,head] auth v=1 cv=1/0 ap=1+0 state=1610612769|complete|committing f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a51f80] 2023-10-03T19:21:26.722 INFO:teuthology.orchestra.run.smithi045.stdout: -2196> 2023-10-03T19:19:39.448+0000 7fd1a7c75640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.2 v2:172.21.15.45:6817/964866005 4 ==== osd_op_reply(23 608.00000000 [create,setxattr (62),setxattr (30)] v97'2 uv2 ondisk = 0) v8 ==== 240+0+0 (crc 0 0 0) 0x556317c16fc0 con 0x5563189cd400 2023-10-03T19:21:26.723 INFO:teuthology.orchestra.run.smithi045.stdout: -2195> 2023-10-03T19:19:39.448+0000 7fd19f464640 10 mds.0.cache.dir(0x608) mark_clean [dir 0x608 ~mds0/stray8/ [2,head] auth v=1 cv=1/1 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a51f80] version 1 2023-10-03T19:21:26.723 INFO:teuthology.orchestra.run.smithi045.stdout: -2194> 2023-10-03T19:19:39.448+0000 7fd19f464640 10 mds.0.cache.dir(0x608) auth_unpin by 0x556318a51f80 on [dir 0x608 ~mds0/stray8/ [2,head] auth v=1 cv=1/1 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x556318a51f80] count now 0 2023-10-03T19:21:26.723 INFO:teuthology.orchestra.run.smithi045.stdout: -2193> 2023-10-03T19:19:39.448+0000 7fd19f464640 10 MDSIOContextBase::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:26.723 INFO:teuthology.orchestra.run.smithi045.stdout: -2192> 2023-10-03T19:19:39.448+0000 7fd1a0c67640 7 mds.0.48 mds has 1 queued contexts 2023-10-03T19:21:26.723 INFO:teuthology.orchestra.run.smithi045.stdout: -2191> 2023-10-03T19:19:39.448+0000 7fd1a0c67640 10 mds.0.48 finish 0x5563188817e0 2023-10-03T19:21:26.723 INFO:teuthology.orchestra.run.smithi045.stdout: -2190> 2023-10-03T19:19:39.448+0000 7fd1a8476640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.1 v2:172.21.15.45:6808/1433143371 4 ==== osd_op_reply(28 mds0_inotable [writefull 0~34] v97'2 uv2 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x556318aaeb40 con 0x5563189cd000 2023-10-03T19:21:26.723 INFO:teuthology.orchestra.run.smithi045.stdout: -2189> 2023-10-03T19:19:39.448+0000 7fd19f464640 10 MDSContext::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:26.723 INFO:teuthology.orchestra.run.smithi045.stdout: -2188> 2023-10-03T19:19:39.448+0000 7fd19f464640 10 mds.0.cache.ino(0x608) _stored_backtrace v 0 2023-10-03T19:21:26.723 INFO:teuthology.orchestra.run.smithi045.stdout: -2187> 2023-10-03T19:19:39.448+0000 7fd19f464640 10 mds.0.cache.ino(0x608) auth_unpin by 0x556318a5e100 on [inode 0x608 [...2,head] ~mds0/stray8/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.425747+0000 1=0+1) (iversion lock) | dirfrag=0 dirtyparent=1 authpin=0 0x556318a5e100] now 0 2023-10-03T19:21:26.723 INFO:teuthology.orchestra.run.smithi045.stdout: -2186> 2023-10-03T19:19:39.448+0000 7fd19f464640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins -1 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 ap=0+8 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x556317b1d600] by 0x556318a5e100 count now 0/8 2023-10-03T19:21:26.724 INFO:teuthology.orchestra.run.smithi045.stdout: -2185> 2023-10-03T19:19:39.448+0000 7fd19f464640 10 mds.0.cache.ino(0x608) clear_dirty_parent 2023-10-03T19:21:26.724 INFO:teuthology.orchestra.run.smithi045.stdout: -2184> 2023-10-03T19:19:39.448+0000 7fd19f464640 10 MDSIOContextBase::complete: 12C_IO_MT_Save 2023-10-03T19:21:26.724 INFO:teuthology.orchestra.run.smithi045.stdout: -2183> 2023-10-03T19:19:39.448+0000 7fd19f464640 10 MDSContext::complete: 12C_IO_MT_Save 2023-10-03T19:21:26.724 INFO:teuthology.orchestra.run.smithi045.stdout: -2182> 2023-10-03T19:19:39.448+0000 7fd19f464640 10 mds.0.inotable: save_2 v 0 2023-10-03T19:21:26.724 INFO:teuthology.orchestra.run.smithi045.stdout: -2181> 2023-10-03T19:19:39.448+0000 7fd1a8476640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.3 v2:172.21.15.45:6816/4227059688 2 ==== osd_op_reply(5 1.00000000 [omap-set-header] v97'2 uv2 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x556318aaeb40 con 0x556317c2d000 2023-10-03T19:21:26.724 INFO:teuthology.orchestra.run.smithi045.stdout: -2180> 2023-10-03T19:19:39.448+0000 7fd1a8476640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.3 v2:172.21.15.45:6816/4227059688 3 ==== osd_op_reply(26 100.00000000.inode [writefull 0~582] v97'3 uv3 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x556318aaeb40 con 0x556317c2d000 2023-10-03T19:21:26.724 INFO:teuthology.orchestra.run.smithi045.stdout: -2179> 2023-10-03T19:19:39.448+0000 7fd1a8476640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.3 v2:172.21.15.45:6816/4227059688 4 ==== osd_op_reply(35 200.00000004 [delete] v97'4 uv3 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x556318aaeb40 con 0x556317c2d000 2023-10-03T19:21:26.724 INFO:teuthology.orchestra.run.smithi045.stdout: -2178> 2023-10-03T19:19:39.448+0000 7fd19f464640 10 MDSIOContextBase::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:26.724 INFO:teuthology.orchestra.run.smithi045.stdout: -2177> 2023-10-03T19:19:39.448+0000 7fd19f464640 10 MDSContext::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:26.724 INFO:teuthology.orchestra.run.smithi045.stdout: -2176> 2023-10-03T19:19:39.448+0000 7fd19f464640 10 mds.0.cache.dir(0x1) _committed v 1 on [dir 0x1 / [2,head] auth v=1 cv=1/0 REP dir_auth=0 ap=1+0 state=1610612769|complete|committing f() n() hs=0+0,ss=0+0 | subtree=1 dirty=1 authpin=1 0x556317b1d180] 2023-10-03T19:21:26.724 INFO:teuthology.orchestra.run.smithi045.stdout: -2175> 2023-10-03T19:19:39.448+0000 7fd19f464640 10 mds.0.cache.dir(0x1) mark_clean [dir 0x1 / [2,head] auth v=1 cv=1/1 REP dir_auth=0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | subtree=1 dirty=1 authpin=1 0x556317b1d180] version 1 2023-10-03T19:21:26.725 INFO:teuthology.orchestra.run.smithi045.stdout: -2174> 2023-10-03T19:19:39.448+0000 7fd19f464640 10 mds.0.cache.dir(0x1) auth_unpin by 0x556317b1d180 on [dir 0x1 / [2,head] auth v=1 cv=1/1 REP dir_auth=0 state=1073741825|complete f() n() hs=0+0,ss=0+0 | subtree=1 dirty=0 authpin=0 0x556317b1d180] count now 0 2023-10-03T19:21:26.725 INFO:teuthology.orchestra.run.smithi045.stdout: -2173> 2023-10-03T19:19:39.448+0000 7fd19f464640 10 MDSIOContextBase::complete: 17C_IO_Inode_Stored 2023-10-03T19:21:26.725 INFO:teuthology.orchestra.run.smithi045.stdout: -2172> 2023-10-03T19:19:39.448+0000 7fd1a0c67640 7 mds.0.48 mds has 1 queued contexts 2023-10-03T19:21:26.725 INFO:teuthology.orchestra.run.smithi045.stdout: -2171> 2023-10-03T19:19:39.448+0000 7fd1a0c67640 10 mds.0.48 finish 0x556318881450 2023-10-03T19:21:26.725 INFO:teuthology.orchestra.run.smithi045.stdout: -2170> 2023-10-03T19:19:39.448+0000 7fd19f464640 10 MDSContext::complete: 17C_IO_Inode_Stored 2023-10-03T19:21:26.725 INFO:teuthology.orchestra.run.smithi045.stdout: -2169> 2023-10-03T19:19:39.448+0000 7fd19f464640 10 mds.0.cache.ino(0x100) _stored 1 on [inode 0x100 [...2,head] ~mds0/ auth v1 snaprealm=0x556317c17b00 f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 11=0+11) (iversion lock) | dirfrag=1 0x556317b3cc00] 2023-10-03T19:21:26.725 INFO:teuthology.orchestra.run.smithi045.stdout: -2168> 2023-10-03T19:19:39.448+0000 7fd19f464640 10 mds.0.cache.ino(0x100) mark_clean [inode 0x100 [...2,head] ~mds0/ auth v1 snaprealm=0x556317c17b00 f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 11=0+11) (iversion lock) | dirfrag=1 0x556317b3cc00] 2023-10-03T19:21:26.730 INFO:teuthology.orchestra.run.smithi045.stdout: -2167> 2023-10-03T19:19:39.452+0000 7fd1a7c75640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] conn(0x5563189cc800 0x556318ace000 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:26.730 INFO:teuthology.orchestra.run.smithi045.stdout: -2166> 2023-10-03T19:19:39.452+0000 7fd1a7c75640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.2 v2:172.21.15.45:6817/964866005 5 ==== osd_op_reply(37 200.00000006 [delete] v97'1 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x556317c16fc0 con 0x5563189cd400 2023-10-03T19:21:26.730 INFO:teuthology.orchestra.run.smithi045.stdout: -2165> 2023-10-03T19:19:39.468+0000 7fd1a8476640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.1 v2:172.21.15.45:6808/1433143371 5 ==== osd_op_reply(20 607.00000000 [omap-set-header] v97'1 uv1 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x556318aaeb40 con 0x5563189cd000 2023-10-03T19:21:26.730 INFO:teuthology.orchestra.run.smithi045.stdout: -2164> 2023-10-03T19:19:39.468+0000 7fd19f464640 10 MDSIOContextBase::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:26.731 INFO:teuthology.orchestra.run.smithi045.stdout: -2163> 2023-10-03T19:19:39.468+0000 7fd19f464640 10 MDSContext::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:26.731 INFO:teuthology.orchestra.run.smithi045.stdout: -2162> 2023-10-03T19:19:39.468+0000 7fd19f464640 10 mds.0.cache.dir(0x607) _committed v 1 on [dir 0x607 ~mds0/stray7/ [2,head] auth v=1 cv=1/0 ap=1+0 state=1610612769|complete|committing f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a51b00] 2023-10-03T19:21:26.731 INFO:teuthology.orchestra.run.smithi045.stdout: -2161> 2023-10-03T19:19:39.468+0000 7fd19f464640 10 mds.0.cache.dir(0x607) mark_clean [dir 0x607 ~mds0/stray7/ [2,head] auth v=1 cv=1/1 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a51b00] version 1 2023-10-03T19:21:26.731 INFO:teuthology.orchestra.run.smithi045.stdout: -2160> 2023-10-03T19:19:39.468+0000 7fd19f464640 10 mds.0.cache.dir(0x607) auth_unpin by 0x556318a51b00 on [dir 0x607 ~mds0/stray7/ [2,head] auth v=1 cv=1/1 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x556318a51b00] count now 0 2023-10-03T19:21:26.731 INFO:teuthology.orchestra.run.smithi045.stdout: -2159> 2023-10-03T19:19:39.468+0000 7fd1a0c67640 7 mds.0.48 mds has 1 queued contexts 2023-10-03T19:21:26.731 INFO:teuthology.orchestra.run.smithi045.stdout: -2158> 2023-10-03T19:19:39.468+0000 7fd1a0c67640 10 mds.0.48 finish 0x556318881790 2023-10-03T19:21:26.731 INFO:teuthology.orchestra.run.smithi045.stdout: -2157> 2023-10-03T19:19:39.468+0000 7fd1a8c77640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.7 v2:172.21.15.79:6818/3323397754 1 ==== osd_op_reply(14 604.00000000 [omap-set-header] v97'1 uv1 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x556318aaf440 con 0x5563189ccc00 2023-10-03T19:21:26.731 INFO:teuthology.orchestra.run.smithi045.stdout: -2156> 2023-10-03T19:19:39.468+0000 7fd1a8c77640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.7 v2:172.21.15.79:6818/3323397754 2 ==== osd_op_reply(15 604.00000000 [create,setxattr (62),setxattr (30)] v97'2 uv2 ondisk = 0) v8 ==== 240+0+0 (crc 0 0 0) 0x556318aaf440 con 0x5563189ccc00 2023-10-03T19:21:26.731 INFO:teuthology.orchestra.run.smithi045.stdout: -2155> 2023-10-03T19:19:39.468+0000 7fd19f464640 10 MDSIOContextBase::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:26.731 INFO:teuthology.orchestra.run.smithi045.stdout: -2154> 2023-10-03T19:19:39.468+0000 7fd19f464640 10 MDSContext::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:26.731 INFO:teuthology.orchestra.run.smithi045.stdout: -2153> 2023-10-03T19:19:39.468+0000 7fd19f464640 10 mds.0.cache.dir(0x604) _committed v 1 on [dir 0x604 ~mds0/stray4/ [2,head] auth v=1 cv=1/0 ap=1+0 state=1610612769|complete|committing f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a50d80] 2023-10-03T19:21:26.732 INFO:teuthology.orchestra.run.smithi045.stdout: -2152> 2023-10-03T19:19:39.468+0000 7fd19f464640 10 mds.0.cache.dir(0x604) mark_clean [dir 0x604 ~mds0/stray4/ [2,head] auth v=1 cv=1/1 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a50d80] version 1 2023-10-03T19:21:26.732 INFO:teuthology.orchestra.run.smithi045.stdout: -2151> 2023-10-03T19:19:39.468+0000 7fd19f464640 10 mds.0.cache.dir(0x604) auth_unpin by 0x556318a50d80 on [dir 0x604 ~mds0/stray4/ [2,head] auth v=1 cv=1/1 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x556318a50d80] count now 0 2023-10-03T19:21:26.732 INFO:teuthology.orchestra.run.smithi045.stdout: -2150> 2023-10-03T19:19:39.468+0000 7fd19f464640 10 MDSIOContextBase::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:26.732 INFO:teuthology.orchestra.run.smithi045.stdout: -2149> 2023-10-03T19:19:39.468+0000 7fd1a0c67640 7 mds.0.48 mds has 1 queued contexts 2023-10-03T19:21:26.732 INFO:teuthology.orchestra.run.smithi045.stdout: -2148> 2023-10-03T19:19:39.468+0000 7fd1a0c67640 10 mds.0.48 finish 0x556318881630 2023-10-03T19:21:26.732 INFO:teuthology.orchestra.run.smithi045.stdout: -2147> 2023-10-03T19:19:39.468+0000 7fd19f464640 10 MDSContext::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:26.732 INFO:teuthology.orchestra.run.smithi045.stdout: -2146> 2023-10-03T19:19:39.468+0000 7fd19f464640 10 mds.0.cache.ino(0x604) _stored_backtrace v 0 2023-10-03T19:21:26.732 INFO:teuthology.orchestra.run.smithi045.stdout: -2145> 2023-10-03T19:19:39.468+0000 7fd19f464640 10 mds.0.cache.ino(0x604) auth_unpin by 0x556318a5cb00 on [inode 0x604 [...2,head] ~mds0/stray4/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.425234+0000 1=0+1) (iversion lock) | dirfrag=0 dirtyparent=1 authpin=0 0x556318a5cb00] now 0 2023-10-03T19:21:26.732 INFO:teuthology.orchestra.run.smithi045.stdout: -2144> 2023-10-03T19:19:39.468+0000 7fd19f464640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins -1 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 ap=0+7 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x556317b1d600] by 0x556318a5cb00 count now 0/7 2023-10-03T19:21:26.732 INFO:teuthology.orchestra.run.smithi045.stdout: -2143> 2023-10-03T19:19:39.468+0000 7fd19f464640 10 mds.0.cache.ino(0x604) clear_dirty_parent 2023-10-03T19:21:26.732 INFO:teuthology.orchestra.run.smithi045.stdout: -2142> 2023-10-03T19:19:39.472+0000 7fd1a8c77640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.7 v2:172.21.15.79:6818/3323397754 3 ==== osd_op_reply(30 500.00000000 [writefull 0~90] v97'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x556318aaf440 con 0x5563189ccc00 2023-10-03T19:21:26.733 INFO:teuthology.orchestra.run.smithi045.stdout: -2141> 2023-10-03T19:19:39.472+0000 7fd19f464640 10 MDSIOContextBase::complete: 12C_IO_Wrapper 2023-10-03T19:21:26.733 INFO:teuthology.orchestra.run.smithi045.stdout: -2140> 2023-10-03T19:19:39.472+0000 7fd19f464640 10 MDSContext::complete: 12C_IO_Wrapper 2023-10-03T19:21:26.733 INFO:teuthology.orchestra.run.smithi045.stdout: -2139> 2023-10-03T19:19:39.472+0000 7fd1a8476640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.1 v2:172.21.15.45:6808/1433143371 6 ==== osd_op_reply(21 607.00000000 [create,setxattr (62),setxattr (30)] v97'2 uv2 ondisk = 0) v8 ==== 240+0+0 (crc 0 0 0) 0x556318aaeb40 con 0x5563189cd000 2023-10-03T19:21:26.733 INFO:teuthology.orchestra.run.smithi045.stdout: -2138> 2023-10-03T19:19:39.472+0000 7fd19f464640 10 MDSIOContextBase::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:26.733 INFO:teuthology.orchestra.run.smithi045.stdout: -2137> 2023-10-03T19:19:39.472+0000 7fd19f464640 10 MDSContext::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:26.733 INFO:teuthology.orchestra.run.smithi045.stdout: -2136> 2023-10-03T19:19:39.472+0000 7fd19f464640 10 mds.0.cache.ino(0x607) _stored_backtrace v 0 2023-10-03T19:21:26.733 INFO:teuthology.orchestra.run.smithi045.stdout: -2135> 2023-10-03T19:19:39.472+0000 7fd19f464640 10 mds.0.cache.ino(0x607) auth_unpin by 0x556318a5db80 on [inode 0x607 [...2,head] ~mds0/stray7/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.425629+0000 1=0+1) (iversion lock) | dirfrag=0 dirtyparent=1 authpin=0 0x556318a5db80] now 0 2023-10-03T19:21:26.733 INFO:teuthology.orchestra.run.smithi045.stdout: -2134> 2023-10-03T19:19:39.472+0000 7fd19f464640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins -1 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 ap=0+6 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x556317b1d600] by 0x556318a5db80 count now 0/6 2023-10-03T19:21:26.733 INFO:teuthology.orchestra.run.smithi045.stdout: -2133> 2023-10-03T19:19:39.472+0000 7fd19f464640 10 mds.0.cache.ino(0x607) clear_dirty_parent 2023-10-03T19:21:26.733 INFO:teuthology.orchestra.run.smithi045.stdout: -2132> 2023-10-03T19:19:39.480+0000 7fd1a7c75640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.4 v2:172.21.15.79:6810/2234162464 1 ==== osd_op_reply(6 600.00000000 [omap-set-header] v97'1 uv1 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x556317c16fc0 con 0x5563189cc800 2023-10-03T19:21:26.733 INFO:teuthology.orchestra.run.smithi045.stdout: -2131> 2023-10-03T19:19:39.480+0000 7fd19f464640 10 MDSIOContextBase::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:26.734 INFO:teuthology.orchestra.run.smithi045.stdout: -2130> 2023-10-03T19:19:39.480+0000 7fd19f464640 10 MDSContext::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:26.734 INFO:teuthology.orchestra.run.smithi045.stdout: -2129> 2023-10-03T19:19:39.480+0000 7fd19f464640 10 mds.0.cache.dir(0x600) _committed v 1 on [dir 0x600 ~mds0/stray0/ [2,head] auth v=1 cv=1/0 ap=1+0 state=1610612769|complete|committing f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556317b1da80] 2023-10-03T19:21:26.734 INFO:teuthology.orchestra.run.smithi045.stdout: -2128> 2023-10-03T19:19:39.480+0000 7fd19f464640 10 mds.0.cache.dir(0x600) mark_clean [dir 0x600 ~mds0/stray0/ [2,head] auth v=1 cv=1/1 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556317b1da80] version 1 2023-10-03T19:21:26.734 INFO:teuthology.orchestra.run.smithi045.stdout: -2127> 2023-10-03T19:19:39.480+0000 7fd19f464640 10 mds.0.cache.dir(0x600) auth_unpin by 0x556317b1da80 on [dir 0x600 ~mds0/stray0/ [2,head] auth v=1 cv=1/1 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x556317b1da80] count now 0 2023-10-03T19:21:26.734 INFO:teuthology.orchestra.run.smithi045.stdout: -2126> 2023-10-03T19:19:39.480+0000 7fd1a0c67640 7 mds.0.48 mds has 1 queued contexts 2023-10-03T19:21:26.734 INFO:teuthology.orchestra.run.smithi045.stdout: -2125> 2023-10-03T19:19:39.480+0000 7fd1a0c67640 10 mds.0.48 finish 0x5563188814c0 2023-10-03T19:21:26.734 INFO:teuthology.orchestra.run.smithi045.stdout: -2124> 2023-10-03T19:19:39.484+0000 7fd1a8c77640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.5 v2:172.21.15.79:6802/2879380539 1 ==== osd_op_reply(36 200.00000005 [delete] v97'1 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x556318aaf440 con 0x5563189cd800 2023-10-03T19:21:26.734 INFO:teuthology.orchestra.run.smithi045.stdout: -2123> 2023-10-03T19:19:39.484+0000 7fd1a7c75640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.4 v2:172.21.15.79:6810/2234162464 2 ==== osd_op_reply(7 600.00000000 [create,setxattr (62),setxattr (30)] v97'2 uv2 ondisk = 0) v8 ==== 240+0+0 (crc 0 0 0) 0x556317c16fc0 con 0x5563189cc800 2023-10-03T19:21:26.734 INFO:teuthology.orchestra.run.smithi045.stdout: -2122> 2023-10-03T19:19:39.484+0000 7fd1a7c75640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.4 v2:172.21.15.79:6810/2234162464 3 ==== osd_op_reply(8 601.00000000 [omap-set-header] v97'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x556317c16fc0 con 0x5563189cc800 2023-10-03T19:21:26.734 INFO:teuthology.orchestra.run.smithi045.stdout: -2121> 2023-10-03T19:19:39.484+0000 7fd1a7c75640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.4 v2:172.21.15.79:6810/2234162464 4 ==== osd_op_reply(9 601.00000000 [create,setxattr (62),setxattr (30)] v97'4 uv4 ondisk = 0) v8 ==== 240+0+0 (crc 0 0 0) 0x556317c16fc0 con 0x5563189cc800 2023-10-03T19:21:26.734 INFO:teuthology.orchestra.run.smithi045.stdout: -2120> 2023-10-03T19:19:39.484+0000 7fd1a7c75640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.4 v2:172.21.15.79:6810/2234162464 5 ==== osd_op_reply(10 602.00000000 [omap-set-header] v97'5 uv5 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x556317c16fc0 con 0x5563189cc800 2023-10-03T19:21:26.735 INFO:teuthology.orchestra.run.smithi045.stdout: -2119> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 MDSIOContextBase::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:26.735 INFO:teuthology.orchestra.run.smithi045.stdout: -2118> 2023-10-03T19:19:39.484+0000 7fd1a7c75640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.4 v2:172.21.15.79:6810/2234162464 6 ==== osd_op_reply(11 602.00000000 [create,setxattr (62),setxattr (30)] v97'6 uv6 ondisk = 0) v8 ==== 240+0+0 (crc 0 0 0) 0x556317c16fc0 con 0x5563189cc800 2023-10-03T19:21:26.735 INFO:teuthology.orchestra.run.smithi045.stdout: -2117> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 MDSContext::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:26.735 INFO:teuthology.orchestra.run.smithi045.stdout: -2116> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 mds.0.cache.ino(0x600) _stored_backtrace v 0 2023-10-03T19:21:26.735 INFO:teuthology.orchestra.run.smithi045.stdout: -2115> 2023-10-03T19:19:39.484+0000 7fd1a7c75640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.4 v2:172.21.15.79:6810/2234162464 7 ==== osd_op_reply(12 603.00000000 [omap-set-header] v97'7 uv7 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x556317c16fc0 con 0x5563189cc800 2023-10-03T19:21:26.735 INFO:teuthology.orchestra.run.smithi045.stdout: -2114> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 mds.0.cache.ino(0x600) auth_unpin by 0x556317b3d180 on [inode 0x600 [...2,head] ~mds0/stray0/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.424687+0000 1=0+1) (iversion lock) | dirfrag=0 dirtyparent=1 authpin=0 0x556317b3d180] now 0 2023-10-03T19:21:26.735 INFO:teuthology.orchestra.run.smithi045.stdout: -2113> 2023-10-03T19:19:39.484+0000 7fd19f464640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins -1 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 ap=0+5 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x556317b1d600] by 0x556317b3d180 count now 0/5 2023-10-03T19:21:26.735 INFO:teuthology.orchestra.run.smithi045.stdout: -2112> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 mds.0.cache.ino(0x600) clear_dirty_parent 2023-10-03T19:21:26.735 INFO:teuthology.orchestra.run.smithi045.stdout: -2111> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 MDSIOContextBase::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:26.735 INFO:teuthology.orchestra.run.smithi045.stdout: -2110> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 MDSContext::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:26.735 INFO:teuthology.orchestra.run.smithi045.stdout: -2109> 2023-10-03T19:19:39.484+0000 7fd1a7c75640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.4 v2:172.21.15.79:6810/2234162464 8 ==== osd_op_reply(13 603.00000000 [create,setxattr (62),setxattr (30)] v97'8 uv8 ondisk = 0) v8 ==== 240+0+0 (crc 0 0 0) 0x556317c16fc0 con 0x5563189cc800 2023-10-03T19:21:26.736 INFO:teuthology.orchestra.run.smithi045.stdout: -2108> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 mds.0.cache.dir(0x601) _committed v 1 on [dir 0x601 ~mds0/stray1/ [2,head] auth v=1 cv=1/0 ap=1+0 state=1610612769|complete|committing f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a50000] 2023-10-03T19:21:26.736 INFO:teuthology.orchestra.run.smithi045.stdout: -2107> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 mds.0.cache.dir(0x601) mark_clean [dir 0x601 ~mds0/stray1/ [2,head] auth v=1 cv=1/1 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a50000] version 1 2023-10-03T19:21:26.736 INFO:teuthology.orchestra.run.smithi045.stdout: -2106> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 mds.0.cache.dir(0x601) auth_unpin by 0x556318a50000 on [dir 0x601 ~mds0/stray1/ [2,head] auth v=1 cv=1/1 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x556318a50000] count now 0 2023-10-03T19:21:26.736 INFO:teuthology.orchestra.run.smithi045.stdout: -2105> 2023-10-03T19:19:39.484+0000 7fd1a0c67640 7 mds.0.48 mds has 1 queued contexts 2023-10-03T19:21:26.736 INFO:teuthology.orchestra.run.smithi045.stdout: -2104> 2023-10-03T19:19:39.484+0000 7fd1a0c67640 10 mds.0.48 finish 0x556318881540 2023-10-03T19:21:26.736 INFO:teuthology.orchestra.run.smithi045.stdout: -2103> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 MDSIOContextBase::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:26.736 INFO:teuthology.orchestra.run.smithi045.stdout: -2102> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 MDSContext::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:26.736 INFO:teuthology.orchestra.run.smithi045.stdout: -2101> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 mds.0.cache.ino(0x601) _stored_backtrace v 0 2023-10-03T19:21:26.736 INFO:teuthology.orchestra.run.smithi045.stdout: -2100> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 mds.0.cache.ino(0x601) auth_unpin by 0x556317b3d700 on [inode 0x601 [...2,head] ~mds0/stray1/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.424810+0000 1=0+1) (iversion lock) | dirfrag=0 dirtyparent=1 authpin=0 0x556317b3d700] now 0 2023-10-03T19:21:26.736 INFO:teuthology.orchestra.run.smithi045.stdout: -2099> 2023-10-03T19:19:39.484+0000 7fd19f464640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins -1 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 ap=0+4 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x556317b1d600] by 0x556317b3d700 count now 0/4 2023-10-03T19:21:26.736 INFO:teuthology.orchestra.run.smithi045.stdout: -2098> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 mds.0.cache.ino(0x601) clear_dirty_parent 2023-10-03T19:21:26.736 INFO:teuthology.orchestra.run.smithi045.stdout: -2097> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 MDSIOContextBase::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:26.737 INFO:teuthology.orchestra.run.smithi045.stdout: -2096> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 MDSContext::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:26.737 INFO:teuthology.orchestra.run.smithi045.stdout: -2095> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 mds.0.cache.dir(0x602) _committed v 1 on [dir 0x602 ~mds0/stray2/ [2,head] auth v=1 cv=1/0 ap=1+0 state=1610612769|complete|committing f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a50480] 2023-10-03T19:21:26.737 INFO:teuthology.orchestra.run.smithi045.stdout: -2094> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 mds.0.cache.dir(0x602) mark_clean [dir 0x602 ~mds0/stray2/ [2,head] auth v=1 cv=1/1 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a50480] version 1 2023-10-03T19:21:26.737 INFO:teuthology.orchestra.run.smithi045.stdout: -2093> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 mds.0.cache.dir(0x602) auth_unpin by 0x556318a50480 on [dir 0x602 ~mds0/stray2/ [2,head] auth v=1 cv=1/1 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x556318a50480] count now 0 2023-10-03T19:21:26.737 INFO:teuthology.orchestra.run.smithi045.stdout: -2092> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 MDSIOContextBase::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:26.737 INFO:teuthology.orchestra.run.smithi045.stdout: -2091> 2023-10-03T19:19:39.484+0000 7fd1a0c67640 7 mds.0.48 mds has 1 queued contexts 2023-10-03T19:21:26.737 INFO:teuthology.orchestra.run.smithi045.stdout: -2090> 2023-10-03T19:19:39.484+0000 7fd1a0c67640 10 mds.0.48 finish 0x556318881590 2023-10-03T19:21:26.737 INFO:teuthology.orchestra.run.smithi045.stdout: -2089> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 MDSContext::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:26.737 INFO:teuthology.orchestra.run.smithi045.stdout: -2088> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 mds.0.cache.ino(0x602) _stored_backtrace v 0 2023-10-03T19:21:26.737 INFO:teuthology.orchestra.run.smithi045.stdout: -2087> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 mds.0.cache.ino(0x602) auth_unpin by 0x556318a5c000 on [inode 0x602 [...2,head] ~mds0/stray2/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.424979+0000 1=0+1) (iversion lock) | dirfrag=0 dirtyparent=1 authpin=0 0x556318a5c000] now 0 2023-10-03T19:21:26.738 INFO:teuthology.orchestra.run.smithi045.stdout: -2086> 2023-10-03T19:19:39.484+0000 7fd19f464640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins -1 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 ap=0+3 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x556317b1d600] by 0x556318a5c000 count now 0/3 2023-10-03T19:21:26.738 INFO:teuthology.orchestra.run.smithi045.stdout: -2085> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 mds.0.cache.ino(0x602) clear_dirty_parent 2023-10-03T19:21:26.738 INFO:teuthology.orchestra.run.smithi045.stdout: -2084> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 MDSIOContextBase::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:26.738 INFO:teuthology.orchestra.run.smithi045.stdout: -2083> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 MDSContext::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:26.738 INFO:teuthology.orchestra.run.smithi045.stdout: -2082> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 mds.0.cache.dir(0x603) _committed v 1 on [dir 0x603 ~mds0/stray3/ [2,head] auth v=1 cv=1/0 ap=1+0 state=1610612769|complete|committing f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a50900] 2023-10-03T19:21:26.738 INFO:teuthology.orchestra.run.smithi045.stdout: -2081> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 mds.0.cache.dir(0x603) mark_clean [dir 0x603 ~mds0/stray3/ [2,head] auth v=1 cv=1/1 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a50900] version 1 2023-10-03T19:21:26.738 INFO:teuthology.orchestra.run.smithi045.stdout: -2080> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 mds.0.cache.dir(0x603) auth_unpin by 0x556318a50900 on [dir 0x603 ~mds0/stray3/ [2,head] auth v=1 cv=1/1 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x556318a50900] count now 0 2023-10-03T19:21:26.738 INFO:teuthology.orchestra.run.smithi045.stdout: -2079> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 MDSIOContextBase::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:26.738 INFO:teuthology.orchestra.run.smithi045.stdout: -2078> 2023-10-03T19:19:39.484+0000 7fd1a0c67640 7 mds.0.48 mds has 1 queued contexts 2023-10-03T19:21:26.738 INFO:teuthology.orchestra.run.smithi045.stdout: -2077> 2023-10-03T19:19:39.484+0000 7fd1a0c67640 10 mds.0.48 finish 0x5563188815e0 2023-10-03T19:21:26.738 INFO:teuthology.orchestra.run.smithi045.stdout: -2076> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 MDSContext::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:26.739 INFO:teuthology.orchestra.run.smithi045.stdout: -2075> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 mds.0.cache.ino(0x603) _stored_backtrace v 0 2023-10-03T19:21:26.739 INFO:teuthology.orchestra.run.smithi045.stdout: -2074> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 mds.0.cache.ino(0x603) auth_unpin by 0x556318a5c580 on [inode 0x603 [...2,head] ~mds0/stray3/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.425113+0000 1=0+1) (iversion lock) | dirfrag=0 dirtyparent=1 authpin=0 0x556318a5c580] now 0 2023-10-03T19:21:26.739 INFO:teuthology.orchestra.run.smithi045.stdout: -2073> 2023-10-03T19:19:39.484+0000 7fd19f464640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins -1 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 ap=0+2 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x556317b1d600] by 0x556318a5c580 count now 0/2 2023-10-03T19:21:26.739 INFO:teuthology.orchestra.run.smithi045.stdout: -2072> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 mds.0.cache.ino(0x603) clear_dirty_parent 2023-10-03T19:21:26.739 INFO:teuthology.orchestra.run.smithi045.stdout: -2071> 2023-10-03T19:19:39.484+0000 7fd1a7c75640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.4 v2:172.21.15.79:6810/2234162464 9 ==== osd_op_reply(16 605.00000000 [omap-set-header] v97'1 uv1 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x556317c16fc0 con 0x5563189cc800 2023-10-03T19:21:26.739 INFO:teuthology.orchestra.run.smithi045.stdout: -2070> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 MDSIOContextBase::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:26.739 INFO:teuthology.orchestra.run.smithi045.stdout: -2069> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 MDSContext::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:26.739 INFO:teuthology.orchestra.run.smithi045.stdout: -2068> 2023-10-03T19:19:39.484+0000 7fd1a7c75640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.4 v2:172.21.15.79:6810/2234162464 10 ==== osd_op_reply(17 605.00000000 [create,setxattr (62),setxattr (30)] v97'2 uv2 ondisk = 0) v8 ==== 240+0+0 (crc 0 0 0) 0x556317c16fc0 con 0x5563189cc800 2023-10-03T19:21:26.739 INFO:teuthology.orchestra.run.smithi045.stdout: -2067> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 mds.0.cache.dir(0x605) _committed v 1 on [dir 0x605 ~mds0/stray5/ [2,head] auth v=1 cv=1/0 ap=1+0 state=1610612769|complete|committing f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a51200] 2023-10-03T19:21:26.739 INFO:teuthology.orchestra.run.smithi045.stdout: -2066> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 mds.0.cache.dir(0x605) mark_clean [dir 0x605 ~mds0/stray5/ [2,head] auth v=1 cv=1/1 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a51200] version 1 2023-10-03T19:21:26.739 INFO:teuthology.orchestra.run.smithi045.stdout: -2065> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 mds.0.cache.dir(0x605) auth_unpin by 0x556318a51200 on [dir 0x605 ~mds0/stray5/ [2,head] auth v=1 cv=1/1 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x556318a51200] count now 0 2023-10-03T19:21:26.740 INFO:teuthology.orchestra.run.smithi045.stdout: -2064> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 MDSIOContextBase::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:26.740 INFO:teuthology.orchestra.run.smithi045.stdout: -2063> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 MDSContext::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:26.740 INFO:teuthology.orchestra.run.smithi045.stdout: -2062> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 mds.0.cache.ino(0x605) _stored_backtrace v 0 2023-10-03T19:21:26.740 INFO:teuthology.orchestra.run.smithi045.stdout: -2061> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 mds.0.cache.ino(0x605) auth_unpin by 0x556318a5d080 on [inode 0x605 [...2,head] ~mds0/stray5/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.425362+0000 1=0+1) (iversion lock) | dirfrag=0 dirtyparent=1 authpin=0 0x556318a5d080] now 0 2023-10-03T19:21:26.740 INFO:teuthology.orchestra.run.smithi045.stdout: -2060> 2023-10-03T19:19:39.484+0000 7fd19f464640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins -1 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 ap=0+1 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x556317b1d600] by 0x556318a5d080 count now 0/1 2023-10-03T19:21:26.740 INFO:teuthology.orchestra.run.smithi045.stdout: -2059> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 mds.0.cache.ino(0x605) clear_dirty_parent 2023-10-03T19:21:26.740 INFO:teuthology.orchestra.run.smithi045.stdout: -2058> 2023-10-03T19:19:39.484+0000 7fd1a0c67640 7 mds.0.48 mds has 1 queued contexts 2023-10-03T19:21:26.740 INFO:teuthology.orchestra.run.smithi045.stdout: -2057> 2023-10-03T19:19:39.484+0000 7fd1a0c67640 10 mds.0.48 finish 0x5563188816b0 2023-10-03T19:21:26.740 INFO:teuthology.orchestra.run.smithi045.stdout: -2056> 2023-10-03T19:19:39.484+0000 7fd1a8c77640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.7 v2:172.21.15.79:6818/3323397754 4 ==== osd_op_reply(31 mds_snaptable [writefull 0~70] v97'1 uv1 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x556318aaf440 con 0x5563189ccc00 2023-10-03T19:21:26.740 INFO:teuthology.orchestra.run.smithi045.stdout: -2055> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 MDSIOContextBase::complete: 12C_IO_MT_Save 2023-10-03T19:21:26.740 INFO:teuthology.orchestra.run.smithi045.stdout: -2054> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 MDSContext::complete: 12C_IO_MT_Save 2023-10-03T19:21:26.740 INFO:teuthology.orchestra.run.smithi045.stdout: -2053> 2023-10-03T19:19:39.484+0000 7fd19f464640 10 mds.0.snaptable: save_2 v 1 2023-10-03T19:21:26.741 INFO:teuthology.orchestra.run.smithi045.stdout: -2052> 2023-10-03T19:19:39.492+0000 7fd1a8c77640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.7 v2:172.21.15.79:6818/3323397754 5 ==== osd_op_reply(33 200.00000002 [delete] v97'1 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x556318aaf440 con 0x5563189ccc00 2023-10-03T19:21:26.741 INFO:teuthology.orchestra.run.smithi045.stdout: -2051> 2023-10-03T19:19:39.496+0000 7fd1a8c77640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.6 v2:172.21.15.79:6819/1486010128 1 ==== osd_op_reply(18 606.00000000 [omap-set-header] v97'1 uv1 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x556318aaf440 con 0x5563189cc400 2023-10-03T19:21:26.741 INFO:teuthology.orchestra.run.smithi045.stdout: -2050> 2023-10-03T19:19:39.496+0000 7fd19f464640 10 MDSIOContextBase::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:26.741 INFO:teuthology.orchestra.run.smithi045.stdout: -2049> 2023-10-03T19:19:39.496+0000 7fd19f464640 10 MDSContext::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:26.741 INFO:teuthology.orchestra.run.smithi045.stdout: -2048> 2023-10-03T19:19:39.496+0000 7fd1a8c77640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.6 v2:172.21.15.79:6819/1486010128 2 ==== osd_op_reply(19 606.00000000 [create,setxattr (62),setxattr (30)] v97'2 uv2 ondisk = 0) v8 ==== 240+0+0 (crc 0 0 0) 0x556318aaf440 con 0x5563189cc400 2023-10-03T19:21:26.741 INFO:teuthology.orchestra.run.smithi045.stdout: -2047> 2023-10-03T19:19:39.496+0000 7fd19f464640 10 mds.0.cache.dir(0x606) _committed v 1 on [dir 0x606 ~mds0/stray6/ [2,head] auth v=1 cv=1/0 ap=1+0 state=1610612769|complete|committing f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a51680] 2023-10-03T19:21:26.741 INFO:teuthology.orchestra.run.smithi045.stdout: -2046> 2023-10-03T19:19:39.496+0000 7fd19f464640 10 mds.0.cache.dir(0x606) mark_clean [dir 0x606 ~mds0/stray6/ [2,head] auth v=1 cv=1/1 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x556318a51680] version 1 2023-10-03T19:21:26.741 INFO:teuthology.orchestra.run.smithi045.stdout: -2045> 2023-10-03T19:19:39.496+0000 7fd19f464640 10 mds.0.cache.dir(0x606) auth_unpin by 0x556318a51680 on [dir 0x606 ~mds0/stray6/ [2,head] auth v=1 cv=1/1 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x556318a51680] count now 0 2023-10-03T19:21:26.741 INFO:teuthology.orchestra.run.smithi045.stdout: -2044> 2023-10-03T19:19:39.496+0000 7fd19f464640 10 MDSIOContextBase::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:26.741 INFO:teuthology.orchestra.run.smithi045.stdout: -2043> 2023-10-03T19:19:39.496+0000 7fd1a0c67640 7 mds.0.48 mds has 1 queued contexts 2023-10-03T19:21:26.741 INFO:teuthology.orchestra.run.smithi045.stdout: -2042> 2023-10-03T19:19:39.496+0000 7fd1a0c67640 10 mds.0.48 finish 0x556318881700 2023-10-03T19:21:26.742 INFO:teuthology.orchestra.run.smithi045.stdout: -2041> 2023-10-03T19:19:39.496+0000 7fd19f464640 10 MDSContext::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:26.742 INFO:teuthology.orchestra.run.smithi045.stdout: -2040> 2023-10-03T19:19:39.496+0000 7fd19f464640 10 mds.0.cache.ino(0x606) _stored_backtrace v 0 2023-10-03T19:21:26.742 INFO:teuthology.orchestra.run.smithi045.stdout: -2039> 2023-10-03T19:19:39.496+0000 7fd19f464640 10 mds.0.cache.ino(0x606) auth_unpin by 0x556318a5d600 on [inode 0x606 [...2,head] ~mds0/stray6/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:39.425504+0000 1=0+1) (iversion lock) | dirfrag=0 dirtyparent=1 authpin=0 0x556318a5d600] now 0 2023-10-03T19:21:26.742 INFO:teuthology.orchestra.run.smithi045.stdout: -2038> 2023-10-03T19:19:39.496+0000 7fd19f464640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins -1 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x556317b1d600] by 0x556318a5d600 count now 0/0 2023-10-03T19:21:26.742 INFO:teuthology.orchestra.run.smithi045.stdout: -2037> 2023-10-03T19:19:39.496+0000 7fd19f464640 10 mds.0.cache.ino(0x606) clear_dirty_parent 2023-10-03T19:21:26.742 INFO:teuthology.orchestra.run.smithi045.stdout: -2036> 2023-10-03T19:19:39.496+0000 7fd1a8c77640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.6 v2:172.21.15.79:6819/1486010128 3 ==== osd_op_reply(1 200.00000000 [writefull 0~90] v97'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x556318aaf440 con 0x5563189cc400 2023-10-03T19:21:26.742 INFO:teuthology.orchestra.run.smithi045.stdout: -2035> 2023-10-03T19:19:39.496+0000 7fd1a8c77640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.6 v2:172.21.15.79:6819/1486010128 4 ==== osd_op_reply(2 400.00000000 [writefull 0~22] v97'1 uv1 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x556318aaf440 con 0x5563189cc400 2023-10-03T19:21:26.742 INFO:teuthology.orchestra.run.smithi045.stdout: -2034> 2023-10-03T19:19:39.496+0000 7fd19f464640 10 MDSIOContextBase::complete: 12C_IO_Wrapper 2023-10-03T19:21:26.742 INFO:teuthology.orchestra.run.smithi045.stdout: -2033> 2023-10-03T19:19:39.496+0000 7fd19f464640 10 MDSContext::complete: 12C_IO_Wrapper 2023-10-03T19:21:26.742 INFO:teuthology.orchestra.run.smithi045.stdout: -2032> 2023-10-03T19:19:39.496+0000 7fd1a8c77640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.6 v2:172.21.15.79:6819/1486010128 5 ==== osd_op_reply(3 1.00000000.inode [writefull 0~582] v97'4 uv4 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x556318aaf440 con 0x5563189cc400 2023-10-03T19:21:26.742 INFO:teuthology.orchestra.run.smithi045.stdout: -2031> 2023-10-03T19:19:39.496+0000 7fd19f464640 10 MDSIOContextBase::complete: 17C_IO_Inode_Stored 2023-10-03T19:21:26.743 INFO:teuthology.orchestra.run.smithi045.stdout: -2030> 2023-10-03T19:19:39.496+0000 7fd19f464640 10 MDSContext::complete: 17C_IO_Inode_Stored 2023-10-03T19:21:26.743 INFO:teuthology.orchestra.run.smithi045.stdout: -2029> 2023-10-03T19:19:39.496+0000 7fd19f464640 10 mds.0.cache.ino(0x1) _stored 1 on [inode 0x1 [...2,head] / auth v1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:26.743 INFO:teuthology.orchestra.run.smithi045.stdout: -2028> 2023-10-03T19:19:39.496+0000 7fd19f464640 10 mds.0.cache.ino(0x1) mark_clean [inode 0x1 [...2,head] / auth v1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:26.743 INFO:teuthology.orchestra.run.smithi045.stdout: -2027> 2023-10-03T19:19:39.496+0000 7fd1a8c77640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.6 v2:172.21.15.79:6819/1486010128 6 ==== osd_op_reply(32 200.00000001 [delete] v97'5 uv4 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x556318aaf440 con 0x5563189cc400 2023-10-03T19:21:26.743 INFO:teuthology.orchestra.run.smithi045.stdout: -2026> 2023-10-03T19:19:39.496+0000 7fd19f464640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.48:38 15.14 15:2e2fa760:::200.00000001:head [write 0~892 in=892b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e97) v8 -- 0x556318901880 con 0x5563189cc400 2023-10-03T19:21:26.743 INFO:teuthology.orchestra.run.smithi045.stdout: -2025> 2023-10-03T19:19:39.500+0000 7fd1a8c77640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.6 v2:172.21.15.79:6819/1486010128 7 ==== osd_op_reply(38 200.00000001 [write 0~892] v97'6 uv6 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x556318aaf440 con 0x5563189cc400 2023-10-03T19:21:26.743 INFO:teuthology.orchestra.run.smithi045.stdout: -2024> 2023-10-03T19:19:39.500+0000 7fd19f464640 10 MDSIOContextBase::complete: 13C_MDL_Flushed 2023-10-03T19:21:26.743 INFO:teuthology.orchestra.run.smithi045.stdout: -2023> 2023-10-03T19:19:39.500+0000 7fd19f464640 10 MDSContext::complete: 13C_MDL_Flushed 2023-10-03T19:21:26.743 INFO:teuthology.orchestra.run.smithi045.stdout: -2022> 2023-10-03T19:19:39.500+0000 7fd19f464640 10 MDSContext::complete: 12C_MDS_VoidFn 2023-10-03T19:21:26.743 INFO:teuthology.orchestra.run.smithi045.stdout: -2021> 2023-10-03T19:19:39.500+0000 7fd19f464640 1 mds.0.48 creating_done 2023-10-03T19:21:26.743 INFO:teuthology.orchestra.run.smithi045.stdout: -2020> 2023-10-03T19:19:39.500+0000 7fd19f464640 3 mds.0.48 request_state up:active 2023-10-03T19:21:26.743 INFO:teuthology.orchestra.run.smithi045.stdout: -2019> 2023-10-03T19:19:39.500+0000 7fd19f464640 5 mds.beacon.a set_want_state: up:creating -> up:active 2023-10-03T19:21:26.744 INFO:teuthology.orchestra.run.smithi045.stdout: -2018> 2023-10-03T19:19:39.500+0000 7fd19f464640 5 mds.beacon.a Sending beacon up:active seq 3 2023-10-03T19:21:26.744 INFO:teuthology.orchestra.run.smithi045.stdout: -2017> 2023-10-03T19:19:39.500+0000 7fd19f464640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.744 INFO:teuthology.orchestra.run.smithi045.stdout: -2016> 2023-10-03T19:19:39.500+0000 7fd19f464640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mdsbeacon(7155/a up:active seq=3 v48) v8 -- 0x556317b7ab00 con 0x556317aaf800 2023-10-03T19:21:26.744 INFO:teuthology.orchestra.run.smithi045.stdout: -2015> 2023-10-03T19:19:39.500+0000 7fd19f464640 10 mds.0.snapclient sync 2023-10-03T19:21:26.744 INFO:teuthology.orchestra.run.smithi045.stdout: -2014> 2023-10-03T19:19:39.500+0000 7fd19f464640 10 mds.0.snapclient refresh want 1 2023-10-03T19:21:26.744 INFO:teuthology.orchestra.run.smithi045.stdout: -2013> 2023-10-03T19:19:40.016+0000 7fd1a2c6b640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgrreport(unknown.a +130-0 packed 1558) v9 -- 0x556318901500 con 0x5563189cc000 2023-10-03T19:21:26.744 INFO:teuthology.orchestra.run.smithi045.stdout: -2012> 2023-10-03T19:19:40.064+0000 7fd1a446e640 10 monclient: tick 2023-10-03T19:21:26.744 INFO:teuthology.orchestra.run.smithi045.stdout: -2011> 2023-10-03T19:19:40.064+0000 7fd1a446e640 10 monclient: _check_auth_tickets 2023-10-03T19:21:26.744 INFO:teuthology.orchestra.run.smithi045.stdout: -2010> 2023-10-03T19:19:40.064+0000 7fd1a446e640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:10.068557+0000) 2023-10-03T19:21:26.744 INFO:teuthology.orchestra.run.smithi045.stdout: -2009> 2023-10-03T19:19:40.420+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 49 ==== osd_map(98..98 src has 1..98) v4 ==== 679+0+0 (secure 0 0 0) 0x556317aee8c0 con 0x556317aaf800 2023-10-03T19:21:26.744 INFO:teuthology.orchestra.run.smithi045.stdout: -2008> 2023-10-03T19:19:40.420+0000 7fd1a5470640 7 mds.0.server operator(): full = 0 epoch = 98 2023-10-03T19:21:26.745 INFO:teuthology.orchestra.run.smithi045.stdout: -2007> 2023-10-03T19:19:40.420+0000 7fd1a5470640 10 mds.0.server apply_blocklist: killed 0 2023-10-03T19:21:26.745 INFO:teuthology.orchestra.run.smithi045.stdout: -2006> 2023-10-03T19:19:40.420+0000 7fd1a5470640 4 mds.0.48 apply_blocklist: killed 0, blocklisted sessions (0 blocklist entries, 0) 2023-10-03T19:21:26.745 INFO:teuthology.orchestra.run.smithi045.stdout: -2005> 2023-10-03T19:19:40.420+0000 7fd1a5470640 10 monclient: _renew_subs 2023-10-03T19:21:26.745 INFO:teuthology.orchestra.run.smithi045.stdout: -2004> 2023-10-03T19:19:40.420+0000 7fd1a5470640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.745 INFO:teuthology.orchestra.run.smithi045.stdout: -2003> 2023-10-03T19:19:40.420+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=99}) v3 -- 0x55631895e000 con 0x556317aaf800 2023-10-03T19:21:26.745 INFO:teuthology.orchestra.run.smithi045.stdout: -2002> 2023-10-03T19:19:40.424+0000 7fd1a1468640 2 mds.0.cache Memory usage: total 257740, rss 36668, heap 190760, baseline 190760, 0 / 13 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:26.745 INFO:teuthology.orchestra.run.smithi045.stdout: -2001> 2023-10-03T19:19:40.424+0000 7fd1a1468640 10 mds.0.cache cache not ready for trimming 2023-10-03T19:21:26.745 INFO:teuthology.orchestra.run.smithi045.stdout: -2000> 2023-10-03T19:19:40.424+0000 7fd1a1468640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:26.745 INFO:teuthology.orchestra.run.smithi045.stdout: -1999> 2023-10-03T19:19:40.436+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 50 ==== mdsmap(e 49) v2 ==== 1100+0+0 (secure 0 0 0) 0x55631895e000 con 0x556317aaf800 2023-10-03T19:21:26.868 INFO:teuthology.orchestra.run.smithi045.stdout: -1998> 2023-10-03T19:19:40.436+0000 7fd1a5470640 1 mds.a Updating MDS map to version 49 from mon.0 2023-10-03T19:21:26.868 INFO:teuthology.orchestra.run.smithi045.stdout: -1997> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 mds.a my compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-03T19:21:26.868 INFO:teuthology.orchestra.run.smithi045.stdout: -1996> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 mds.a mdsmap compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-03T19:21:26.868 INFO:teuthology.orchestra.run.smithi045.stdout: -1995> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 mds.a my gid is 7155 2023-10-03T19:21:26.868 INFO:teuthology.orchestra.run.smithi045.stdout: -1994> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 mds.a map says I am mds.0.48 state up:active 2023-10-03T19:21:26.868 INFO:teuthology.orchestra.run.smithi045.stdout: -1993> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 mds.a msgr says I am [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] 2023-10-03T19:21:26.868 INFO:teuthology.orchestra.run.smithi045.stdout: -1992> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 mds.a handle_mds_map: handling map as rank 0 2023-10-03T19:21:26.868 INFO:teuthology.orchestra.run.smithi045.stdout: -1991> 2023-10-03T19:19:40.436+0000 7fd1a5470640 1 mds.0.48 handle_mds_map i am now mds.0.48 2023-10-03T19:21:26.868 INFO:teuthology.orchestra.run.smithi045.stdout: -1990> 2023-10-03T19:19:40.436+0000 7fd1a5470640 1 mds.0.48 handle_mds_map state change up:creating --> up:active 2023-10-03T19:21:26.869 INFO:teuthology.orchestra.run.smithi045.stdout: -1989> 2023-10-03T19:19:40.436+0000 7fd1a5470640 1 mds.0.48 recovery_done -- successful recovery! 2023-10-03T19:21:26.869 INFO:teuthology.orchestra.run.smithi045.stdout: -1988> 2023-10-03T19:19:40.436+0000 7fd1a5470640 1 mds.0.48 active_start 2023-10-03T19:21:26.869 INFO:teuthology.orchestra.run.smithi045.stdout: -1987> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 mds.0.cache open_root 2023-10-03T19:21:26.869 INFO:teuthology.orchestra.run.smithi045.stdout: -1986> 2023-10-03T19:19:40.436+0000 7fd1a5470640 7 mds.0.cache adjust_subtree_auth 0,-2 -> 0,-2 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x556317b1d600] 2023-10-03T19:21:26.869 INFO:teuthology.orchestra.run.smithi045.stdout: -1985> 2023-10-03T19:19:40.436+0000 7fd1a5470640 15 mds.0.cache show_subtrees 2023-10-03T19:21:26.869 INFO:teuthology.orchestra.run.smithi045.stdout: -1984> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 mds.0.cache |__ 0 auth [dir 0x1 / [2,head] auth v=1 cv=1/1 REP dir_auth=0 state=1073741825|complete f() n() hs=0+0,ss=0+0 | subtree=1 dirty=0 authpin=0 0x556317b1d180] 2023-10-03T19:21:26.869 INFO:teuthology.orchestra.run.smithi045.stdout: -1983> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 mds.0.cache |__ 0 auth [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x556317b1d600] 2023-10-03T19:21:26.869 INFO:teuthology.orchestra.run.smithi045.stdout: -1982> 2023-10-03T19:19:40.436+0000 7fd1a5470640 7 mds.0.cache current root is [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x556317b1d600] 2023-10-03T19:21:26.869 INFO:teuthology.orchestra.run.smithi045.stdout: -1981> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 mds.0.cache.dir(0x100) setting dir_auth=0,-2 from 0,-2 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x556317b1d600] 2023-10-03T19:21:26.869 INFO:teuthology.orchestra.run.smithi045.stdout: -1980> 2023-10-03T19:19:40.436+0000 7fd1a5470640 15 mds.0.cache show_subtrees 2023-10-03T19:21:26.870 INFO:teuthology.orchestra.run.smithi045.stdout: -1979> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 mds.0.cache |__ 0 auth [dir 0x1 / [2,head] auth v=1 cv=1/1 REP dir_auth=0 state=1073741825|complete f() n() hs=0+0,ss=0+0 | subtree=1 dirty=0 authpin=0 0x556317b1d180] 2023-10-03T19:21:26.870 INFO:teuthology.orchestra.run.smithi045.stdout: -1978> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 mds.0.cache |__ 0 auth [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x556317b1d600] 2023-10-03T19:21:26.870 INFO:teuthology.orchestra.run.smithi045.stdout: -1977> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 mds.0.cache populate_mydir [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x556317b1d600] 2023-10-03T19:21:26.870 INFO:teuthology.orchestra.run.smithi045.stdout: -1976> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 mds.0.cache.dir(0x100) lookup (stray0, 'head') 2023-10-03T19:21:26.870 INFO:teuthology.orchestra.run.smithi045.stdout: -1975> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 mds.0.cache.dir(0x100) hit -> (stray0,head) 2023-10-03T19:21:26.870 INFO:teuthology.orchestra.run.smithi045.stdout: -1974> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 mds.0.cache stray num 0 is [inode 0x600 [...2,head] ~mds0/stray0/ auth v1 f() n(v0 rc2023-10-03T19:19:39.424687+0000 1=0+1) (iversion lock) | dirfrag=1 stickydirs=1 stray=1 dirtyparent=0 authpin=0 0x556317b3d180] 2023-10-03T19:21:26.870 INFO:teuthology.orchestra.run.smithi045.stdout: -1973> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 mds.0.cache.dir(0x100) lookup (stray1, 'head') 2023-10-03T19:21:26.870 INFO:teuthology.orchestra.run.smithi045.stdout: -1972> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 mds.0.cache.dir(0x100) hit -> (stray1,head) 2023-10-03T19:21:26.870 INFO:teuthology.orchestra.run.smithi045.stdout: -1971> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 mds.0.cache stray num 1 is [inode 0x601 [...2,head] ~mds0/stray1/ auth v1 f() n(v0 rc2023-10-03T19:19:39.424810+0000 1=0+1) (iversion lock) | dirfrag=1 stickydirs=1 stray=1 dirtyparent=0 authpin=0 0x556317b3d700] 2023-10-03T19:21:26.871 INFO:teuthology.orchestra.run.smithi045.stdout: -1970> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 mds.0.cache.dir(0x100) lookup (stray2, 'head') 2023-10-03T19:21:26.871 INFO:teuthology.orchestra.run.smithi045.stdout: -1969> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 mds.0.cache.dir(0x100) hit -> (stray2,head) 2023-10-03T19:21:26.871 INFO:teuthology.orchestra.run.smithi045.stdout: -1968> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 mds.0.cache stray num 2 is [inode 0x602 [...2,head] ~mds0/stray2/ auth v1 f() n(v0 rc2023-10-03T19:19:39.424979+0000 1=0+1) (iversion lock) | dirfrag=1 stickydirs=1 stray=1 dirtyparent=0 authpin=0 0x556318a5c000] 2023-10-03T19:21:26.871 INFO:teuthology.orchestra.run.smithi045.stdout: -1967> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 mds.0.cache.dir(0x100) lookup (stray3, 'head') 2023-10-03T19:21:26.871 INFO:teuthology.orchestra.run.smithi045.stdout: -1966> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 mds.0.cache.dir(0x100) hit -> (stray3,head) 2023-10-03T19:21:26.871 INFO:teuthology.orchestra.run.smithi045.stdout: -1965> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 mds.0.cache stray num 3 is [inode 0x603 [...2,head] ~mds0/stray3/ auth v1 f() n(v0 rc2023-10-03T19:19:39.425113+0000 1=0+1) (iversion lock) | dirfrag=1 stickydirs=1 stray=1 dirtyparent=0 authpin=0 0x556318a5c580] 2023-10-03T19:21:26.871 INFO:teuthology.orchestra.run.smithi045.stdout: -1964> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 mds.0.cache.dir(0x100) lookup (stray4, 'head') 2023-10-03T19:21:26.871 INFO:teuthology.orchestra.run.smithi045.stdout: -1963> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 mds.0.cache.dir(0x100) hit -> (stray4,head) 2023-10-03T19:21:26.872 INFO:teuthology.orchestra.run.smithi045.stdout: -1962> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 mds.0.cache stray num 4 is [inode 0x604 [...2,head] ~mds0/stray4/ auth v1 f() n(v0 rc2023-10-03T19:19:39.425234+0000 1=0+1) (iversion lock) | dirfrag=1 stickydirs=1 stray=1 dirtyparent=0 authpin=0 0x556318a5cb00] 2023-10-03T19:21:26.872 INFO:teuthology.orchestra.run.smithi045.stdout: -1961> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 mds.0.cache.dir(0x100) lookup (stray5, 'head') 2023-10-03T19:21:26.872 INFO:teuthology.orchestra.run.smithi045.stdout: -1960> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 mds.0.cache.dir(0x100) hit -> (stray5,head) 2023-10-03T19:21:26.872 INFO:teuthology.orchestra.run.smithi045.stdout: -1959> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 mds.0.cache stray num 5 is [inode 0x605 [...2,head] ~mds0/stray5/ auth v1 f() n(v0 rc2023-10-03T19:19:39.425362+0000 1=0+1) (iversion lock) | dirfrag=1 stickydirs=1 stray=1 dirtyparent=0 authpin=0 0x556318a5d080] 2023-10-03T19:21:26.872 INFO:teuthology.orchestra.run.smithi045.stdout: -1958> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 mds.0.cache.dir(0x100) lookup (stray6, 'head') 2023-10-03T19:21:26.872 INFO:teuthology.orchestra.run.smithi045.stdout: -1957> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 mds.0.cache.dir(0x100) hit -> (stray6,head) 2023-10-03T19:21:26.872 INFO:teuthology.orchestra.run.smithi045.stdout: -1956> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 mds.0.cache stray num 6 is [inode 0x606 [...2,head] ~mds0/stray6/ auth v1 f() n(v0 rc2023-10-03T19:19:39.425504+0000 1=0+1) (iversion lock) | dirfrag=1 stickydirs=1 stray=1 dirtyparent=0 authpin=0 0x556318a5d600] 2023-10-03T19:21:26.872 INFO:teuthology.orchestra.run.smithi045.stdout: -1955> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 mds.0.cache.dir(0x100) lookup (stray7, 'head') 2023-10-03T19:21:26.872 INFO:teuthology.orchestra.run.smithi045.stdout: -1954> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 mds.0.cache.dir(0x100) hit -> (stray7,head) 2023-10-03T19:21:26.872 INFO:teuthology.orchestra.run.smithi045.stdout: -1953> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 mds.0.cache stray num 7 is [inode 0x607 [...2,head] ~mds0/stray7/ auth v1 f() n(v0 rc2023-10-03T19:19:39.425629+0000 1=0+1) (iversion lock) | dirfrag=1 stickydirs=1 stray=1 dirtyparent=0 authpin=0 0x556318a5db80] 2023-10-03T19:21:26.873 INFO:teuthology.orchestra.run.smithi045.stdout: -1952> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 mds.0.cache.dir(0x100) lookup (stray8, 'head') 2023-10-03T19:21:26.873 INFO:teuthology.orchestra.run.smithi045.stdout: -1951> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 mds.0.cache.dir(0x100) hit -> (stray8,head) 2023-10-03T19:21:26.873 INFO:teuthology.orchestra.run.smithi045.stdout: -1950> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 mds.0.cache stray num 8 is [inode 0x608 [...2,head] ~mds0/stray8/ auth v1 f() n(v0 rc2023-10-03T19:19:39.425747+0000 1=0+1) (iversion lock) | dirfrag=1 stickydirs=1 stray=1 dirtyparent=0 authpin=0 0x556318a5e100] 2023-10-03T19:21:26.873 INFO:teuthology.orchestra.run.smithi045.stdout: -1949> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 mds.0.cache.dir(0x100) lookup (stray9, 'head') 2023-10-03T19:21:26.873 INFO:teuthology.orchestra.run.smithi045.stdout: -1948> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 mds.0.cache.dir(0x100) hit -> (stray9,head) 2023-10-03T19:21:26.873 INFO:teuthology.orchestra.run.smithi045.stdout: -1947> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 mds.0.cache stray num 9 is [inode 0x609 [...2,head] ~mds0/stray9/ auth v1 f() n(v0 rc2023-10-03T19:19:39.425877+0000 1=0+1) (iversion lock) | dirfrag=1 stickydirs=1 stray=1 dirtyparent=0 authpin=0 0x556318a5e680] 2023-10-03T19:21:26.873 INFO:teuthology.orchestra.run.smithi045.stdout: -1946> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 mds.0.cache populate_mydir done 2023-10-03T19:21:26.873 INFO:teuthology.orchestra.run.smithi045.stdout: -1945> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 mds.0.cache.strays activate 2023-10-03T19:21:26.873 INFO:teuthology.orchestra.run.smithi045.stdout: -1944> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 mds.0.cache scan_stray_dir 0x0 2023-10-03T19:21:26.873 INFO:teuthology.orchestra.run.smithi045.stdout: -1943> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 mds.0.48 active_start: initializing metrics handler 2023-10-03T19:21:26.873 INFO:teuthology.orchestra.run.smithi045.stdout: -1942> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 init: mds.metrics 2023-10-03T19:21:26.874 INFO:teuthology.orchestra.run.smithi045.stdout: -1941> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 mds.0.48 active_start: initializing metric aggregator 2023-10-03T19:21:26.874 INFO:teuthology.orchestra.run.smithi045.stdout: -1940> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 mds.metric.aggregator init 2023-10-03T19:21:26.874 INFO:teuthology.orchestra.run.smithi045.stdout: -1939> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 mds.0.cache clean_open_file_lists 2023-10-03T19:21:26.874 INFO:teuthology.orchestra.run.smithi045.stdout: -1938> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 mds.0.cache export_remaining_imported_caps 2023-10-03T19:21:26.874 INFO:teuthology.orchestra.run.smithi045.stdout: -1937> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 mds.0.cache reissue_all_caps 2023-10-03T19:21:26.874 INFO:teuthology.orchestra.run.smithi045.stdout: -1936> 2023-10-03T19:19:40.436+0000 7fd19dc61640 10 mds.metric.aggregator ping_all_active_ranks: pinging 0 active mds(s) 2023-10-03T19:21:26.874 INFO:teuthology.orchestra.run.smithi045.stdout: -1935> 2023-10-03T19:19:40.436+0000 7fd1a5470640 7 mds.0.tableserver(snaptable) finish_recovery 2023-10-03T19:21:26.874 INFO:teuthology.orchestra.run.smithi045.stdout: -1934> 2023-10-03T19:19:40.436+0000 7fd1a5470640 7 mds.0.tableserver(snaptable) _do_server_recovery 0 2023-10-03T19:21:26.874 INFO:teuthology.orchestra.run.smithi045.stdout: -1933> 2023-10-03T19:19:40.436+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] send_to--> mds [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mds_table_request(snaptable server_ready) v1 -- ?+0 0x5563188eef00 2023-10-03T19:21:26.874 INFO:teuthology.orchestra.run.smithi045.stdout: -1932> 2023-10-03T19:19:40.436+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mds_table_request(snaptable server_ready) v1 -- 0x5563188eef00 con 0x556317aafc00 2023-10-03T19:21:26.875 INFO:teuthology.orchestra.run.smithi045.stdout: -1931> 2023-10-03T19:19:40.436+0000 7fd1a5470640 4 mds.0.48 set_osd_epoch_barrier: epoch=98 2023-10-03T19:21:26.875 INFO:teuthology.orchestra.run.smithi045.stdout: -1930> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 mds.metric.aggregator notify_mdsmap 2023-10-03T19:21:26.875 INFO:teuthology.orchestra.run.smithi045.stdout: -1929> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 mds.metric.aggregator notify_mdsmap: active rank=0 (mds.a) has addr=[v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] 2023-10-03T19:21:26.875 INFO:teuthology.orchestra.run.smithi045.stdout: -1928> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 mds.metric.aggregator notify_mdsmap: active set=[{0=[v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487]}] 2023-10-03T19:21:26.875 INFO:teuthology.orchestra.run.smithi045.stdout: -1927> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 notify_mdsmap: mds.metrics 2023-10-03T19:21:26.875 INFO:teuthology.orchestra.run.smithi045.stdout: -1926> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 notify_mdsmap: mds.metrics: rank0 is mds.a 2023-10-03T19:21:26.875 INFO:teuthology.orchestra.run.smithi045.stdout: -1925> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 notify_mdsmap: mds.metrics: rank0 addr is now [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] 2023-10-03T19:21:26.875 INFO:teuthology.orchestra.run.smithi045.stdout: -1924> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 reset_seq: mds.metrics: last_updated_seq=0 2023-10-03T19:21:26.875 INFO:teuthology.orchestra.run.smithi045.stdout: -1923> 2023-10-03T19:19:40.436+0000 7fd1a5470640 20 set_next_seq: mds.metrics: current sequence number 0, setting next sequence number 0 2023-10-03T19:21:26.875 INFO:teuthology.orchestra.run.smithi045.stdout: -1922> 2023-10-03T19:19:40.436+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mds.0 v2:172.21.15.45:6834/3401546487 0 ==== mds_table_request(snaptable server_ready) v1 ==== 0+0+0 (unknown 0 0 0) 0x5563188eef00 con 0x556317aafc00 2023-10-03T19:21:26.876 INFO:teuthology.orchestra.run.smithi045.stdout: -1921> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 mds.0.tableclient(snaptable) handle_request mds_table_request(snaptable server_ready) v1 2023-10-03T19:21:26.876 INFO:teuthology.orchestra.run.smithi045.stdout: -1920> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 mds.0.snapclient refresh want 1 2023-10-03T19:21:26.877 INFO:teuthology.orchestra.run.smithi045.stdout: -1919> 2023-10-03T19:19:40.436+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] send_to--> mds [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mds_table_request(snaptable query 1 9 bytes) v1 -- ?+0 0x5563188ee180 2023-10-03T19:21:26.877 INFO:teuthology.orchestra.run.smithi045.stdout: -1918> 2023-10-03T19:19:40.436+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mds_table_request(snaptable query 1 9 bytes) v1 -- 0x5563188ee180 con 0x556317aafc00 2023-10-03T19:21:26.877 INFO:teuthology.orchestra.run.smithi045.stdout: -1917> 2023-10-03T19:19:40.436+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mds.0 v2:172.21.15.45:6834/3401546487 0 ==== mds_table_request(snaptable query 1 9 bytes) v1 ==== 0+0+0 (unknown 0 0 0) 0x5563188ee180 con 0x556317aafc00 2023-10-03T19:21:26.877 INFO:teuthology.orchestra.run.smithi045.stdout: -1916> 2023-10-03T19:19:40.436+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mds_table_request(snaptable query_reply 1 tid 1 29 bytes) v1 -- 0x5563188eef00 con 0x556317aafc00 2023-10-03T19:21:26.877 INFO:teuthology.orchestra.run.smithi045.stdout: -1915> 2023-10-03T19:19:40.436+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mds.0 v2:172.21.15.45:6834/3401546487 0 ==== mds_table_request(snaptable query_reply 1 tid 1 29 bytes) v1 ==== 0+0+0 (unknown 0 0 0) 0x5563188eef00 con 0x556317aafc00 2023-10-03T19:21:26.877 INFO:teuthology.orchestra.run.smithi045.stdout: -1914> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 mds.0.tableclient(snaptable) handle_request mds_table_request(snaptable query_reply 1 tid 1 29 bytes) v1 2023-10-03T19:21:26.877 INFO:teuthology.orchestra.run.smithi045.stdout: -1913> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 mds.0.snapclient handle_query_result mds_table_request(snaptable query_reply 1 tid 1 29 bytes) v1 2023-10-03T19:21:26.877 INFO:teuthology.orchestra.run.smithi045.stdout: -1912> 2023-10-03T19:19:40.436+0000 7fd1a5470640 7 mds.0.48 mds has 1 queued contexts 2023-10-03T19:21:26.877 INFO:teuthology.orchestra.run.smithi045.stdout: -1911> 2023-10-03T19:19:40.436+0000 7fd1a5470640 10 mds.0.48 finish 0x556317b03038 2023-10-03T19:21:26.877 INFO:teuthology.orchestra.run.smithi045.stdout: -1910> 2023-10-03T19:19:40.440+0000 7fd1a8476640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 51 ==== mdsbeacon(7155/a up:active seq=3 v49) v8 ==== 130+0+0 (secure 0 0 0) 0x556317b7ab00 con 0x556317aaf800 2023-10-03T19:21:26.878 INFO:teuthology.orchestra.run.smithi045.stdout: -1909> 2023-10-03T19:19:40.440+0000 7fd1a8476640 5 mds.beacon.a received beacon reply up:active seq 3 rtt 0.939986 2023-10-03T19:21:26.878 INFO:teuthology.orchestra.run.smithi045.stdout: -1908> 2023-10-03T19:19:40.440+0000 7fd1a346c640 20 mds.beacon.a sender thread waiting interval 3.06001s 2023-10-03T19:21:26.878 INFO:teuthology.orchestra.run.smithi045.stdout: -1907> 2023-10-03T19:19:41.064+0000 7fd1a446e640 10 monclient: tick 2023-10-03T19:21:26.878 INFO:teuthology.orchestra.run.smithi045.stdout: -1906> 2023-10-03T19:19:41.064+0000 7fd1a446e640 10 monclient: _check_auth_tickets 2023-10-03T19:21:26.878 INFO:teuthology.orchestra.run.smithi045.stdout: -1905> 2023-10-03T19:19:41.064+0000 7fd1a446e640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:11.068717+0000) 2023-10-03T19:21:26.878 INFO:teuthology.orchestra.run.smithi045.stdout: -1904> 2023-10-03T19:19:41.420+0000 7fd1a3c6d640 20 mds.0.48 get_task_status 2023-10-03T19:21:26.878 INFO:teuthology.orchestra.run.smithi045.stdout: -1903> 2023-10-03T19:19:41.420+0000 7fd1a3c6d640 20 mds.0.48 send_task_status: updating 0 status keys 2023-10-03T19:21:26.878 INFO:teuthology.orchestra.run.smithi045.stdout: -1902> 2023-10-03T19:19:41.420+0000 7fd1a3c6d640 20 mds.0.48 schedule_update_timer_task 2023-10-03T19:21:26.878 INFO:teuthology.orchestra.run.smithi045.stdout: -1901> 2023-10-03T19:19:41.424+0000 7fd1a1468640 2 mds.0.cache Memory usage: total 274132, rss 36932, heap 207144, baseline 190760, 0 / 13 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:26.878 INFO:teuthology.orchestra.run.smithi045.stdout: -1900> 2023-10-03T19:19:41.424+0000 7fd1a1468640 20 mds.0.cache upkeep thread trimming cache; last trim 1227.814208984s ago 2023-10-03T19:21:26.878 INFO:teuthology.orchestra.run.smithi045.stdout: -1899> 2023-10-03T19:19:41.424+0000 7fd1a1468640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:26.879 INFO:teuthology.orchestra.run.smithi045.stdout: -1898> 2023-10-03T19:19:41.424+0000 7fd1a1468640 7 mds.0.cache trim bytes_used=50kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:26.879 INFO:teuthology.orchestra.run.smithi045.stdout: -1897> 2023-10-03T19:19:41.424+0000 7fd1a1468640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:26.879 INFO:teuthology.orchestra.run.smithi045.stdout: -1896> 2023-10-03T19:19:41.424+0000 7fd1a1468640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:26.879 INFO:teuthology.orchestra.run.smithi045.stdout: -1895> 2023-10-03T19:19:41.424+0000 7fd1a1468640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:26.879 INFO:teuthology.orchestra.run.smithi045.stdout: -1894> 2023-10-03T19:19:41.424+0000 7fd1a1468640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:26.879 INFO:teuthology.orchestra.run.smithi045.stdout: -1893> 2023-10-03T19:19:41.424+0000 7fd1a1468640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:26.879 INFO:teuthology.orchestra.run.smithi045.stdout: -1892> 2023-10-03T19:19:41.692+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 52 ==== mdsmap(e 50) v2 ==== 1100+0+0 (secure 0 0 0) 0x55631896ba00 con 0x556317aaf800 2023-10-03T19:21:26.879 INFO:teuthology.orchestra.run.smithi045.stdout: -1891> 2023-10-03T19:19:41.692+0000 7fd1a5470640 1 mds.a Updating MDS map to version 50 from mon.0 2023-10-03T19:21:26.879 INFO:teuthology.orchestra.run.smithi045.stdout: -1890> 2023-10-03T19:19:41.692+0000 7fd1a5470640 10 mds.a my compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-03T19:21:26.879 INFO:teuthology.orchestra.run.smithi045.stdout: -1889> 2023-10-03T19:19:41.692+0000 7fd1a5470640 10 mds.a mdsmap compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-03T19:21:26.879 INFO:teuthology.orchestra.run.smithi045.stdout: -1888> 2023-10-03T19:19:41.692+0000 7fd1a5470640 10 mds.a my gid is 7155 2023-10-03T19:21:26.880 INFO:teuthology.orchestra.run.smithi045.stdout: -1887> 2023-10-03T19:19:41.692+0000 7fd1a5470640 10 mds.a map says I am mds.0.48 state up:active 2023-10-03T19:21:26.880 INFO:teuthology.orchestra.run.smithi045.stdout: -1886> 2023-10-03T19:19:41.692+0000 7fd1a5470640 10 mds.a msgr says I am [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] 2023-10-03T19:21:26.880 INFO:teuthology.orchestra.run.smithi045.stdout: -1885> 2023-10-03T19:19:41.692+0000 7fd1a5470640 10 mds.a handle_mds_map: handling map as rank 0 2023-10-03T19:21:26.880 INFO:teuthology.orchestra.run.smithi045.stdout: -1884> 2023-10-03T19:19:41.692+0000 7fd1a5470640 4 mds.0.48 set_osd_epoch_barrier: epoch=98 2023-10-03T19:21:26.880 INFO:teuthology.orchestra.run.smithi045.stdout: -1883> 2023-10-03T19:19:41.692+0000 7fd1a5470640 10 mds.metric.aggregator notify_mdsmap 2023-10-03T19:21:26.880 INFO:teuthology.orchestra.run.smithi045.stdout: -1882> 2023-10-03T19:19:41.692+0000 7fd1a5470640 10 mds.metric.aggregator notify_mdsmap: active set=[{0=[v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487]}] 2023-10-03T19:21:26.880 INFO:teuthology.orchestra.run.smithi045.stdout: -1881> 2023-10-03T19:19:41.692+0000 7fd1a5470640 10 notify_mdsmap: mds.metrics 2023-10-03T19:21:26.880 INFO:teuthology.orchestra.run.smithi045.stdout: -1880> 2023-10-03T19:19:41.692+0000 7fd1a5470640 10 notify_mdsmap: mds.metrics: rank0 is mds.a 2023-10-03T19:21:26.880 INFO:teuthology.orchestra.run.smithi045.stdout: -1879> 2023-10-03T19:19:42.064+0000 7fd1a446e640 10 monclient: tick 2023-10-03T19:21:26.880 INFO:teuthology.orchestra.run.smithi045.stdout: -1878> 2023-10-03T19:19:42.064+0000 7fd1a446e640 10 monclient: _check_auth_tickets 2023-10-03T19:21:26.880 INFO:teuthology.orchestra.run.smithi045.stdout: -1877> 2023-10-03T19:19:42.064+0000 7fd1a446e640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:12.068839+0000) 2023-10-03T19:21:26.881 INFO:teuthology.orchestra.run.smithi045.stdout: -1876> 2023-10-03T19:19:42.424+0000 7fd1a1468640 2 mds.0.cache Memory usage: total 274132, rss 36932, heap 207144, baseline 190760, 0 / 13 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:26.881 INFO:teuthology.orchestra.run.smithi045.stdout: -1875> 2023-10-03T19:19:42.424+0000 7fd1a1468640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999984682s ago 2023-10-03T19:21:26.881 INFO:teuthology.orchestra.run.smithi045.stdout: -1874> 2023-10-03T19:19:42.424+0000 7fd1a1468640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:26.881 INFO:teuthology.orchestra.run.smithi045.stdout: -1873> 2023-10-03T19:19:42.424+0000 7fd1a1468640 7 mds.0.cache trim bytes_used=50kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:26.881 INFO:teuthology.orchestra.run.smithi045.stdout: -1872> 2023-10-03T19:19:42.424+0000 7fd1a1468640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:26.881 INFO:teuthology.orchestra.run.smithi045.stdout: -1871> 2023-10-03T19:19:42.424+0000 7fd1a1468640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:26.881 INFO:teuthology.orchestra.run.smithi045.stdout: -1870> 2023-10-03T19:19:42.424+0000 7fd1a1468640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:26.881 INFO:teuthology.orchestra.run.smithi045.stdout: -1869> 2023-10-03T19:19:42.424+0000 7fd1a1468640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:26.881 INFO:teuthology.orchestra.run.smithi045.stdout: -1868> 2023-10-03T19:19:42.424+0000 7fd1a1468640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:26.881 INFO:teuthology.orchestra.run.smithi045.stdout: -1867> 2023-10-03T19:19:42.436+0000 7fd19e462640 20 update_rank0: mds.metrics 2023-10-03T19:21:26.881 INFO:teuthology.orchestra.run.smithi045.stdout: -1866> 2023-10-03T19:19:42.436+0000 7fd19e462640 20 update_rank0: mds.metrics: sending metric updates for 0 clients to rank 0 (address: [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487]) with sequence number 0, last updated sequence number 0 2023-10-03T19:21:26.882 INFO:teuthology.orchestra.run.smithi045.stdout: -1865> 2023-10-03T19:19:42.436+0000 7fd19e462640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] send_to--> mds [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mds_metrics from rank=0 carrying 0 metric updates v1 -- ?+0 0x556317b0a480 2023-10-03T19:21:26.882 INFO:teuthology.orchestra.run.smithi045.stdout: -1864> 2023-10-03T19:19:42.436+0000 7fd19e462640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mds_metrics from rank=0 carrying 0 metric updates v1 -- 0x556317b0a480 con 0x556317aafc00 2023-10-03T19:21:26.882 INFO:teuthology.orchestra.run.smithi045.stdout: -1863> 2023-10-03T19:19:42.436+0000 7fd1a4c6f640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mds.0 v2:172.21.15.45:6834/3401546487 0 ==== mds_metrics from rank=0 carrying 0 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x556317b0a480 con 0x556317aafc00 2023-10-03T19:21:26.882 INFO:teuthology.orchestra.run.smithi045.stdout: -1862> 2023-10-03T19:19:42.436+0000 7fd1a4c6f640 20 mds.metric.aggregator handle_mds_metrics: applying 0 updates for rank=0 with sequence number 0 2023-10-03T19:21:26.882 INFO:teuthology.orchestra.run.smithi045.stdout: -1861> 2023-10-03T19:19:42.436+0000 7fd1a4c6f640 10 mds.pinger pong_received: rank=0, sequence=0 2023-10-03T19:21:26.882 INFO:teuthology.orchestra.run.smithi045.stdout: -1860> 2023-10-03T19:19:42.436+0000 7fd1a4c6f640 10 mds.pinger pong_received: received pong from rank=0 to which ping was never sent (ignoring...). 2023-10-03T19:21:26.882 INFO:teuthology.orchestra.run.smithi045.stdout: -1859> 2023-10-03T19:19:43.064+0000 7fd1a446e640 10 monclient: tick 2023-10-03T19:21:26.882 INFO:teuthology.orchestra.run.smithi045.stdout: -1858> 2023-10-03T19:19:43.064+0000 7fd1a446e640 10 monclient: _check_auth_tickets 2023-10-03T19:21:26.882 INFO:teuthology.orchestra.run.smithi045.stdout: -1857> 2023-10-03T19:19:43.064+0000 7fd1a446e640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:13.068952+0000) 2023-10-03T19:21:26.882 INFO:teuthology.orchestra.run.smithi045.stdout: -1856> 2023-10-03T19:19:43.420+0000 7fd1a3c6d640 20 mds.0.48 get_task_status 2023-10-03T19:21:26.882 INFO:teuthology.orchestra.run.smithi045.stdout: -1855> 2023-10-03T19:19:43.420+0000 7fd1a3c6d640 20 mds.0.48 schedule_update_timer_task 2023-10-03T19:21:26.883 INFO:teuthology.orchestra.run.smithi045.stdout: -1854> 2023-10-03T19:19:43.424+0000 7fd1a1468640 2 mds.0.cache Memory usage: total 274132, rss 36932, heap 207144, baseline 190760, 0 / 13 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:26.883 INFO:teuthology.orchestra.run.smithi045.stdout: -1853> 2023-10-03T19:19:43.424+0000 7fd1a1468640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999984682s ago 2023-10-03T19:21:26.883 INFO:teuthology.orchestra.run.smithi045.stdout: -1852> 2023-10-03T19:19:43.424+0000 7fd1a1468640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:26.883 INFO:teuthology.orchestra.run.smithi045.stdout: -1851> 2023-10-03T19:19:43.424+0000 7fd1a1468640 7 mds.0.cache trim bytes_used=50kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:26.883 INFO:teuthology.orchestra.run.smithi045.stdout: -1850> 2023-10-03T19:19:43.424+0000 7fd1a1468640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:26.883 INFO:teuthology.orchestra.run.smithi045.stdout: -1849> 2023-10-03T19:19:43.424+0000 7fd1a1468640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:26.883 INFO:teuthology.orchestra.run.smithi045.stdout: -1848> 2023-10-03T19:19:43.424+0000 7fd1a1468640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:26.883 INFO:teuthology.orchestra.run.smithi045.stdout: -1847> 2023-10-03T19:19:43.424+0000 7fd1a1468640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:26.889 INFO:teuthology.orchestra.run.smithi045.stdout: -1846> 2023-10-03T19:19:43.424+0000 7fd1a1468640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:26.889 INFO:teuthology.orchestra.run.smithi045.stdout: -1845> 2023-10-03T19:19:43.500+0000 7fd1a346c640 5 mds.beacon.a Sending beacon up:active seq 4 2023-10-03T19:21:26.890 INFO:teuthology.orchestra.run.smithi045.stdout: -1844> 2023-10-03T19:19:43.500+0000 7fd1a346c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.890 INFO:teuthology.orchestra.run.smithi045.stdout: -1843> 2023-10-03T19:19:43.500+0000 7fd1a346c640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mdsbeacon(7155/a up:active seq=4 v50) v8 -- 0x556317b7b080 con 0x556317aaf800 2023-10-03T19:21:26.890 INFO:teuthology.orchestra.run.smithi045.stdout: -1842> 2023-10-03T19:19:43.500+0000 7fd1a346c640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:26.890 INFO:teuthology.orchestra.run.smithi045.stdout: -1841> 2023-10-03T19:19:43.500+0000 7fd1a8476640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 53 ==== mdsbeacon(7155/a up:active seq=4 v50) v8 ==== 130+0+0 (secure 0 0 0) 0x556317b7ab00 con 0x556317aaf800 2023-10-03T19:21:26.890 INFO:teuthology.orchestra.run.smithi045.stdout: -1840> 2023-10-03T19:19:43.500+0000 7fd1a8476640 5 mds.beacon.a received beacon reply up:active seq 4 rtt 0 2023-10-03T19:21:26.890 INFO:teuthology.orchestra.run.smithi045.stdout: -1839> 2023-10-03T19:19:43.500+0000 7fd1a346c640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:26.890 INFO:teuthology.orchestra.run.smithi045.stdout: -1838> 2023-10-03T19:19:44.064+0000 7fd1a446e640 10 monclient: tick 2023-10-03T19:21:26.890 INFO:teuthology.orchestra.run.smithi045.stdout: -1837> 2023-10-03T19:19:44.064+0000 7fd1a446e640 10 monclient: _check_auth_tickets 2023-10-03T19:21:26.890 INFO:teuthology.orchestra.run.smithi045.stdout: -1836> 2023-10-03T19:19:44.064+0000 7fd1a446e640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:14.069086+0000) 2023-10-03T19:21:26.890 INFO:teuthology.orchestra.run.smithi045.stdout: -1835> 2023-10-03T19:19:44.064+0000 7fd1a3c6d640 10 mds.0.log trim 1 / 128 segments, 1 / -1 events, 0 (0) expiring, 0 (0) expired 2023-10-03T19:21:26.890 INFO:teuthology.orchestra.run.smithi045.stdout: -1834> 2023-10-03T19:19:44.064+0000 7fd1a3c6d640 10 mds.0.openfiles commit log_seq 1 committing_log_seq:0 2023-10-03T19:21:26.891 INFO:teuthology.orchestra.run.smithi045.stdout: -1833> 2023-10-03T19:19:44.064+0000 7fd1a3c6d640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] conn(0x556317c2d400 0x556318ad0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:26.891 INFO:teuthology.orchestra.run.smithi045.stdout: -1832> 2023-10-03T19:19:44.064+0000 7fd1a3c6d640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.48:39 15.6 15:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e98) v8 -- 0x556318900a80 con 0x556317c2d400 2023-10-03T19:21:26.891 INFO:teuthology.orchestra.run.smithi045.stdout: -1831> 2023-10-03T19:19:44.064+0000 7fd1a3c6d640 10 mds.0.log _trim_expired_segments waiting for 1/4194304 to expire 2023-10-03T19:21:26.891 INFO:teuthology.orchestra.run.smithi045.stdout: -1830> 2023-10-03T19:19:44.064+0000 7fd1a3c6d640 10 mds.0.server find_idle_sessions. last cleared laggy state 1230.45s ago 2023-10-03T19:21:26.891 INFO:teuthology.orchestra.run.smithi045.stdout: -1829> 2023-10-03T19:19:44.064+0000 7fd1a3c6d640 10 mds.0.locker scatter_tick 2023-10-03T19:21:26.891 INFO:teuthology.orchestra.run.smithi045.stdout: -1828> 2023-10-03T19:19:44.064+0000 7fd1a3c6d640 20 mds.0.locker caps_tick 0 revoking caps 2023-10-03T19:21:26.891 INFO:teuthology.orchestra.run.smithi045.stdout: -1827> 2023-10-03T19:19:44.064+0000 7fd1a3c6d640 20 mds.0.bal handle_export_pins export_pin_queue size=0 2023-10-03T19:21:26.891 INFO:teuthology.orchestra.run.smithi045.stdout: -1826> 2023-10-03T19:19:44.064+0000 7fd1a3c6d640 15 mds.0.bal tick tick last_sample now 1230.454121s 2023-10-03T19:21:26.891 INFO:teuthology.orchestra.run.smithi045.stdout: -1825> 2023-10-03T19:19:44.064+0000 7fd1a3c6d640 15 mds.0.bal get_load mdsload<[pop IRD:[C 0.00e+00] IWR:[C 0.00e+00] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 5.25e-01] *LOAD:2.1]/[pop IRD:[C 0.00e+00] IWR:[C 0.00e+00] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 5.25e-01] *LOAD:2.1], req 0, hr 0, qlen 0, cpu 0> 2023-10-03T19:21:26.891 INFO:teuthology.orchestra.run.smithi045.stdout: -1824> 2023-10-03T19:19:44.068+0000 7fd1a8476640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] conn(0x556317c2d400 0x556318ad0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:26.891 INFO:teuthology.orchestra.run.smithi045.stdout: -1823> 2023-10-03T19:19:44.068+0000 7fd1a3c6d640 3 mds.0.bal send_heartbeat epoch 1 load mdsload<[pop IRD:[C 0.00e+00] IWR:[C 0.00e+00] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 5.25e-01] *LOAD:2.1]/[pop IRD:[C 0.00e+00] IWR:[C 0.00e+00] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 5.25e-01] *LOAD:2.1], req 0, hr 0, qlen 0, cpu 0> 2023-10-03T19:21:26.892 INFO:teuthology.orchestra.run.smithi045.stdout: -1822> 2023-10-03T19:19:44.068+0000 7fd1a3c6d640 15 mds.0.cache show_subtrees 2023-10-03T19:21:26.892 INFO:teuthology.orchestra.run.smithi045.stdout: -1821> 2023-10-03T19:19:44.068+0000 7fd1a8476640 10 monclient: get_auth_request con 0x556317c2d400 auth_method 0 2023-10-03T19:21:26.892 INFO:teuthology.orchestra.run.smithi045.stdout: -1820> 2023-10-03T19:19:44.068+0000 7fd1a3c6d640 10 mds.0.cache |__ 0 auth [dir 0x1 / [2,head] auth v=1 cv=1/1 REP dir_auth=0 state=1073741825|complete f() n() hs=0+0,ss=0+0 | subtree=1 dirty=0 authpin=0 0x556317b1d180] 2023-10-03T19:21:26.892 INFO:teuthology.orchestra.run.smithi045.stdout: -1819> 2023-10-03T19:19:44.068+0000 7fd1a3c6d640 10 mds.0.cache |__ 0 auth [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x556317b1d600] 2023-10-03T19:21:26.892 INFO:teuthology.orchestra.run.smithi045.stdout: -1818> 2023-10-03T19:19:44.068+0000 7fd1a3c6d640 10 mds.0.cache find_stale_fragment_freeze 2023-10-03T19:21:26.892 INFO:teuthology.orchestra.run.smithi045.stdout: -1817> 2023-10-03T19:19:44.068+0000 7fd1a3c6d640 10 mds.0.snap check_osd_map need_to_purge={} 2023-10-03T19:21:26.892 INFO:teuthology.orchestra.run.smithi045.stdout: -1816> 2023-10-03T19:19:44.068+0000 7fd1a3c6d640 20 mds.0.48 updating export targets, currently 0 ranks are targets 2023-10-03T19:21:26.892 INFO:teuthology.orchestra.run.smithi045.stdout: -1815> 2023-10-03T19:19:44.068+0000 7fd1a8476640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] conn(0x556317c2d400 0x556318ad0680 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:26.892 INFO:teuthology.orchestra.run.smithi045.stdout: -1814> 2023-10-03T19:19:44.068+0000 7fd1a8476640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.0 v2:172.21.15.45:6800/1057586985 1 ==== osd_op_reply(39 mds0_openfiles.0 [omap-clear,omap-set-header] v98'1 uv1 ondisk = 0) v8 ==== 202+0+0 (crc 0 0 0) 0x556318aaeb40 con 0x556317c2d400 2023-10-03T19:21:26.892 INFO:teuthology.orchestra.run.smithi045.stdout: -1813> 2023-10-03T19:19:44.068+0000 7fd19f464640 10 MDSIOContextBase::complete: 13C_IO_OFT_Save 2023-10-03T19:21:26.892 INFO:teuthology.orchestra.run.smithi045.stdout: -1812> 2023-10-03T19:19:44.068+0000 7fd19f464640 10 MDSContext::complete: 13C_IO_OFT_Save 2023-10-03T19:21:26.893 INFO:teuthology.orchestra.run.smithi045.stdout: -1811> 2023-10-03T19:19:44.068+0000 7fd19f464640 10 mds.0.openfiles _commit_finish log_seq 1 committed_log_seq 0 committing_log_seq 1 2023-10-03T19:21:26.893 INFO:teuthology.orchestra.run.smithi045.stdout: -1810> 2023-10-03T19:19:44.068+0000 7fd19f464640 10 MDSContext::complete: 15C_OFT_Committed 2023-10-03T19:21:26.893 INFO:teuthology.orchestra.run.smithi045.stdout: -1809> 2023-10-03T19:19:44.072+0000 7fd19f464640 10 mds.0.log _trim_expired_segments waiting for 1/4194304 to expire 2023-10-03T19:21:26.893 INFO:teuthology.orchestra.run.smithi045.stdout: -1808> 2023-10-03T19:19:44.428+0000 7fd1a1468640 2 mds.0.cache Memory usage: total 274132, rss 36932, heap 207144, baseline 190760, 0 / 13 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:26.893 INFO:teuthology.orchestra.run.smithi045.stdout: -1807> 2023-10-03T19:19:44.428+0000 7fd1a1468640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999984682s ago 2023-10-03T19:21:26.893 INFO:teuthology.orchestra.run.smithi045.stdout: -1806> 2023-10-03T19:19:44.428+0000 7fd1a1468640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:26.893 INFO:teuthology.orchestra.run.smithi045.stdout: -1805> 2023-10-03T19:19:44.428+0000 7fd1a1468640 7 mds.0.cache trim bytes_used=50kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:26.893 INFO:teuthology.orchestra.run.smithi045.stdout: -1804> 2023-10-03T19:19:44.428+0000 7fd1a1468640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:26.893 INFO:teuthology.orchestra.run.smithi045.stdout: -1803> 2023-10-03T19:19:44.428+0000 7fd1a1468640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:26.893 INFO:teuthology.orchestra.run.smithi045.stdout: -1802> 2023-10-03T19:19:44.428+0000 7fd1a1468640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:26.893 INFO:teuthology.orchestra.run.smithi045.stdout: -1801> 2023-10-03T19:19:44.428+0000 7fd1a1468640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:26.893 INFO:teuthology.orchestra.run.smithi045.stdout: -1800> 2023-10-03T19:19:44.428+0000 7fd1a1468640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:26.894 INFO:teuthology.orchestra.run.smithi045.stdout: -1799> 2023-10-03T19:19:44.436+0000 7fd19e462640 20 update_rank0: mds.metrics 2023-10-03T19:21:26.894 INFO:teuthology.orchestra.run.smithi045.stdout: -1798> 2023-10-03T19:19:44.436+0000 7fd19e462640 20 update_rank0: mds.metrics: sending metric updates for 0 clients to rank 0 (address: [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487]) with sequence number 0, last updated sequence number 0 2023-10-03T19:21:26.894 INFO:teuthology.orchestra.run.smithi045.stdout: -1797> 2023-10-03T19:19:44.436+0000 7fd19e462640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] send_to--> mds [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mds_metrics from rank=0 carrying 0 metric updates v1 -- ?+0 0x5563188ef200 2023-10-03T19:21:26.894 INFO:teuthology.orchestra.run.smithi045.stdout: -1796> 2023-10-03T19:19:44.436+0000 7fd19e462640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mds_metrics from rank=0 carrying 0 metric updates v1 -- 0x5563188ef200 con 0x556317aafc00 2023-10-03T19:21:26.894 INFO:teuthology.orchestra.run.smithi045.stdout: -1795> 2023-10-03T19:19:44.436+0000 7fd1a4c6f640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mds.0 v2:172.21.15.45:6834/3401546487 0 ==== mds_metrics from rank=0 carrying 0 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x5563188ef200 con 0x556317aafc00 2023-10-03T19:21:26.894 INFO:teuthology.orchestra.run.smithi045.stdout: -1794> 2023-10-03T19:19:44.436+0000 7fd1a4c6f640 20 mds.metric.aggregator handle_mds_metrics: applying 0 updates for rank=0 with sequence number 0 2023-10-03T19:21:26.894 INFO:teuthology.orchestra.run.smithi045.stdout: -1793> 2023-10-03T19:19:44.436+0000 7fd1a4c6f640 10 mds.pinger pong_received: rank=0, sequence=0 2023-10-03T19:21:26.894 INFO:teuthology.orchestra.run.smithi045.stdout: -1792> 2023-10-03T19:19:44.436+0000 7fd1a4c6f640 10 mds.pinger pong_received: received pong from rank=0 to which ping was never sent (ignoring...). 2023-10-03T19:21:26.894 INFO:teuthology.orchestra.run.smithi045.stdout: -1791> 2023-10-03T19:19:45.016+0000 7fd1a2c6b640 10 mds.pinger is_rank_lagging: rank=0 2023-10-03T19:21:26.894 INFO:teuthology.orchestra.run.smithi045.stdout: -1790> 2023-10-03T19:19:45.016+0000 7fd1a2c6b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-03T19:21:26.894 INFO:teuthology.orchestra.run.smithi045.stdout: -1789> 2023-10-03T19:19:45.016+0000 7fd1a2c6b640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgrreport(unknown.a +0-0 packed 1558 task_status=0) v9 -- 0x556318900000 con 0x5563189cc000 2023-10-03T19:21:26.895 INFO:teuthology.orchestra.run.smithi045.stdout: -1788> 2023-10-03T19:19:45.068+0000 7fd1a446e640 10 monclient: tick 2023-10-03T19:21:26.895 INFO:teuthology.orchestra.run.smithi045.stdout: -1787> 2023-10-03T19:19:45.068+0000 7fd1a446e640 10 monclient: _check_auth_tickets 2023-10-03T19:21:26.895 INFO:teuthology.orchestra.run.smithi045.stdout: -1786> 2023-10-03T19:19:45.068+0000 7fd1a446e640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:15.069257+0000) 2023-10-03T19:21:26.895 INFO:teuthology.orchestra.run.smithi045.stdout: -1785> 2023-10-03T19:19:45.420+0000 7fd1a3c6d640 20 mds.0.48 get_task_status 2023-10-03T19:21:26.895 INFO:teuthology.orchestra.run.smithi045.stdout: -1784> 2023-10-03T19:19:45.420+0000 7fd1a3c6d640 20 mds.0.48 schedule_update_timer_task 2023-10-03T19:21:26.895 INFO:teuthology.orchestra.run.smithi045.stdout: -1783> 2023-10-03T19:19:45.428+0000 7fd1a1468640 2 mds.0.cache Memory usage: total 274132, rss 36932, heap 207144, baseline 190760, 0 / 13 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:26.895 INFO:teuthology.orchestra.run.smithi045.stdout: -1782> 2023-10-03T19:19:45.428+0000 7fd1a1468640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999984741s ago 2023-10-03T19:21:26.895 INFO:teuthology.orchestra.run.smithi045.stdout: -1781> 2023-10-03T19:19:45.428+0000 7fd1a1468640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:26.895 INFO:teuthology.orchestra.run.smithi045.stdout: -1780> 2023-10-03T19:19:45.428+0000 7fd1a1468640 7 mds.0.cache trim bytes_used=50kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:26.895 INFO:teuthology.orchestra.run.smithi045.stdout: -1779> 2023-10-03T19:19:45.428+0000 7fd1a1468640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:26.895 INFO:teuthology.orchestra.run.smithi045.stdout: -1778> 2023-10-03T19:19:45.428+0000 7fd1a1468640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:26.896 INFO:teuthology.orchestra.run.smithi045.stdout: -1777> 2023-10-03T19:19:45.428+0000 7fd1a1468640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:26.896 INFO:teuthology.orchestra.run.smithi045.stdout: -1776> 2023-10-03T19:19:45.428+0000 7fd1a1468640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:26.896 INFO:teuthology.orchestra.run.smithi045.stdout: -1775> 2023-10-03T19:19:45.428+0000 7fd1a1468640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:26.896 INFO:teuthology.orchestra.run.smithi045.stdout: -1774> 2023-10-03T19:19:45.436+0000 7fd19dc61640 10 mds.metric.aggregator ping_all_active_ranks: pinging 1 active mds(s) 2023-10-03T19:21:26.896 INFO:teuthology.orchestra.run.smithi045.stdout: -1773> 2023-10-03T19:19:45.436+0000 7fd19dc61640 20 mds.metric.aggregator ping_all_active_ranks: pinging rank=0 addr=[v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] 2023-10-03T19:21:26.896 INFO:teuthology.orchestra.run.smithi045.stdout: -1772> 2023-10-03T19:19:45.436+0000 7fd19dc61640 10 mds.pinger send_ping: rank=0 2023-10-03T19:21:26.896 INFO:teuthology.orchestra.run.smithi045.stdout: -1771> 2023-10-03T19:19:45.436+0000 7fd19dc61640 20 mds.pinger send_ping: init ping pong state for rank=0 2023-10-03T19:21:26.896 INFO:teuthology.orchestra.run.smithi045.stdout: -1770> 2023-10-03T19:19:45.436+0000 7fd19dc61640 10 mds.pinger send_ping: sending ping with sequence=1 to rank=0 2023-10-03T19:21:26.896 INFO:teuthology.orchestra.run.smithi045.stdout: -1769> 2023-10-03T19:19:45.436+0000 7fd19dc61640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] send_to--> mds [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mdsping v1 -- ?+0 0x556317af5180 2023-10-03T19:21:26.896 INFO:teuthology.orchestra.run.smithi045.stdout: -1768> 2023-10-03T19:19:45.436+0000 7fd19dc61640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mdsping v1 -- 0x556317af5180 con 0x556317aafc00 2023-10-03T19:21:26.901 INFO:teuthology.orchestra.run.smithi045.stdout: -1767> 2023-10-03T19:19:45.436+0000 7fd1a4c6f640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mds.0 v2:172.21.15.45:6834/3401546487 0 ==== mdsping v1 ==== 0+0+0 (unknown 0 0 0) 0x556317af5180 con 0x556317aafc00 2023-10-03T19:21:26.901 INFO:teuthology.orchestra.run.smithi045.stdout: -1766> 2023-10-03T19:19:45.436+0000 7fd1a4c6f640 20 set_next_seq: mds.metrics: current sequence number 0, setting next sequence number 1 2023-10-03T19:21:26.901 INFO:teuthology.orchestra.run.smithi045.stdout: -1765> 2023-10-03T19:19:46.064+0000 7fd1a446e640 10 monclient: tick 2023-10-03T19:21:26.901 INFO:teuthology.orchestra.run.smithi045.stdout: -1764> 2023-10-03T19:19:46.064+0000 7fd1a446e640 10 monclient: _check_auth_tickets 2023-10-03T19:21:26.901 INFO:teuthology.orchestra.run.smithi045.stdout: -1763> 2023-10-03T19:19:46.064+0000 7fd1a446e640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:16.069422+0000) 2023-10-03T19:21:26.902 INFO:teuthology.orchestra.run.smithi045.stdout: -1762> 2023-10-03T19:19:46.428+0000 7fd1a1468640 2 mds.0.cache Memory usage: total 274132, rss 36932, heap 207144, baseline 190760, 0 / 13 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:26.902 INFO:teuthology.orchestra.run.smithi045.stdout: -1761> 2023-10-03T19:19:46.428+0000 7fd1a1468640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999984741s ago 2023-10-03T19:21:26.902 INFO:teuthology.orchestra.run.smithi045.stdout: -1760> 2023-10-03T19:19:46.428+0000 7fd1a1468640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:26.902 INFO:teuthology.orchestra.run.smithi045.stdout: -1759> 2023-10-03T19:19:46.428+0000 7fd1a1468640 7 mds.0.cache trim bytes_used=50kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:26.902 INFO:teuthology.orchestra.run.smithi045.stdout: -1758> 2023-10-03T19:19:46.428+0000 7fd1a1468640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:26.902 INFO:teuthology.orchestra.run.smithi045.stdout: -1757> 2023-10-03T19:19:46.428+0000 7fd1a1468640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:26.902 INFO:teuthology.orchestra.run.smithi045.stdout: -1756> 2023-10-03T19:19:46.428+0000 7fd1a1468640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:26.902 INFO:teuthology.orchestra.run.smithi045.stdout: -1755> 2023-10-03T19:19:46.428+0000 7fd1a1468640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:26.902 INFO:teuthology.orchestra.run.smithi045.stdout: -1754> 2023-10-03T19:19:46.428+0000 7fd1a1468640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:26.902 INFO:teuthology.orchestra.run.smithi045.stdout: -1753> 2023-10-03T19:19:46.436+0000 7fd19e462640 20 update_rank0: mds.metrics 2023-10-03T19:21:26.902 INFO:teuthology.orchestra.run.smithi045.stdout: -1752> 2023-10-03T19:19:46.436+0000 7fd19e462640 20 update_rank0: mds.metrics: sending metric updates for 0 clients to rank 0 (address: [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487]) with sequence number 1, last updated sequence number 1 2023-10-03T19:21:26.903 INFO:teuthology.orchestra.run.smithi045.stdout: -1751> 2023-10-03T19:19:46.436+0000 7fd19e462640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] send_to--> mds [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mds_metrics from rank=0 carrying 0 metric updates v1 -- ?+0 0x5563188ef380 2023-10-03T19:21:26.903 INFO:teuthology.orchestra.run.smithi045.stdout: -1750> 2023-10-03T19:19:46.436+0000 7fd19e462640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mds_metrics from rank=0 carrying 0 metric updates v1 -- 0x5563188ef380 con 0x556317aafc00 2023-10-03T19:21:26.903 INFO:teuthology.orchestra.run.smithi045.stdout: -1749> 2023-10-03T19:19:46.436+0000 7fd1a4c6f640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mds.0 v2:172.21.15.45:6834/3401546487 0 ==== mds_metrics from rank=0 carrying 0 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x5563188ef380 con 0x556317aafc00 2023-10-03T19:21:26.903 INFO:teuthology.orchestra.run.smithi045.stdout: -1748> 2023-10-03T19:19:46.436+0000 7fd1a4c6f640 20 mds.metric.aggregator handle_mds_metrics: applying 0 updates for rank=0 with sequence number 1 2023-10-03T19:21:26.903 INFO:teuthology.orchestra.run.smithi045.stdout: -1747> 2023-10-03T19:19:46.436+0000 7fd1a4c6f640 10 mds.pinger pong_received: rank=0, sequence=1 2023-10-03T19:21:26.903 INFO:teuthology.orchestra.run.smithi045.stdout: -1746> 2023-10-03T19:19:47.064+0000 7fd1a446e640 10 monclient: tick 2023-10-03T19:21:26.903 INFO:teuthology.orchestra.run.smithi045.stdout: -1745> 2023-10-03T19:19:47.064+0000 7fd1a446e640 10 monclient: _check_auth_tickets 2023-10-03T19:21:26.903 INFO:teuthology.orchestra.run.smithi045.stdout: -1744> 2023-10-03T19:19:47.064+0000 7fd1a446e640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:17.069585+0000) 2023-10-03T19:21:26.903 INFO:teuthology.orchestra.run.smithi045.stdout: -1743> 2023-10-03T19:19:47.420+0000 7fd1a3c6d640 20 mds.0.48 get_task_status 2023-10-03T19:21:26.903 INFO:teuthology.orchestra.run.smithi045.stdout: -1742> 2023-10-03T19:19:47.420+0000 7fd1a3c6d640 20 mds.0.48 schedule_update_timer_task 2023-10-03T19:21:26.904 INFO:teuthology.orchestra.run.smithi045.stdout: -1741> 2023-10-03T19:19:47.428+0000 7fd1a1468640 2 mds.0.cache Memory usage: total 274132, rss 36932, heap 207144, baseline 190760, 0 / 13 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:26.904 INFO:teuthology.orchestra.run.smithi045.stdout: -1740> 2023-10-03T19:19:47.428+0000 7fd1a1468640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999984741s ago 2023-10-03T19:21:26.904 INFO:teuthology.orchestra.run.smithi045.stdout: -1739> 2023-10-03T19:19:47.428+0000 7fd1a1468640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:26.904 INFO:teuthology.orchestra.run.smithi045.stdout: -1738> 2023-10-03T19:19:47.428+0000 7fd1a1468640 7 mds.0.cache trim bytes_used=50kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:26.904 INFO:teuthology.orchestra.run.smithi045.stdout: -1737> 2023-10-03T19:19:47.428+0000 7fd1a1468640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:26.904 INFO:teuthology.orchestra.run.smithi045.stdout: -1736> 2023-10-03T19:19:47.428+0000 7fd1a1468640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:26.904 INFO:teuthology.orchestra.run.smithi045.stdout: -1735> 2023-10-03T19:19:47.428+0000 7fd1a1468640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:26.904 INFO:teuthology.orchestra.run.smithi045.stdout: -1734> 2023-10-03T19:19:47.428+0000 7fd1a1468640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:26.904 INFO:teuthology.orchestra.run.smithi045.stdout: -1733> 2023-10-03T19:19:47.428+0000 7fd1a1468640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:26.904 INFO:teuthology.orchestra.run.smithi045.stdout: -1732> 2023-10-03T19:19:47.500+0000 7fd1a346c640 5 mds.beacon.a Sending beacon up:active seq 5 2023-10-03T19:21:26.904 INFO:teuthology.orchestra.run.smithi045.stdout: -1731> 2023-10-03T19:19:47.500+0000 7fd1a346c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:26.905 INFO:teuthology.orchestra.run.smithi045.stdout: -1730> 2023-10-03T19:19:47.500+0000 7fd1a346c640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mdsbeacon(7155/a up:active seq=5 v50) v8 -- 0x556318a658c0 con 0x556317aaf800 2023-10-03T19:21:26.905 INFO:teuthology.orchestra.run.smithi045.stdout: -1729> 2023-10-03T19:19:47.500+0000 7fd1a346c640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:26.905 INFO:teuthology.orchestra.run.smithi045.stdout: -1728> 2023-10-03T19:19:47.500+0000 7fd1a8476640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 54 ==== mdsbeacon(7155/a up:active seq=5 v50) v8 ==== 130+0+0 (secure 0 0 0) 0x556318a658c0 con 0x556317aaf800 2023-10-03T19:21:26.905 INFO:teuthology.orchestra.run.smithi045.stdout: -1727> 2023-10-03T19:19:47.500+0000 7fd1a8476640 5 mds.beacon.a received beacon reply up:active seq 5 rtt 0 2023-10-03T19:21:26.905 INFO:teuthology.orchestra.run.smithi045.stdout: -1726> 2023-10-03T19:19:47.500+0000 7fd1a346c640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:26.905 INFO:teuthology.orchestra.run.smithi045.stdout: -1725> 2023-10-03T19:19:48.064+0000 7fd1a446e640 10 monclient: tick 2023-10-03T19:21:26.905 INFO:teuthology.orchestra.run.smithi045.stdout: -1724> 2023-10-03T19:19:48.064+0000 7fd1a446e640 10 monclient: _check_auth_tickets 2023-10-03T19:21:26.905 INFO:teuthology.orchestra.run.smithi045.stdout: -1723> 2023-10-03T19:19:48.064+0000 7fd1a446e640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:18.069744+0000) 2023-10-03T19:21:26.905 INFO:teuthology.orchestra.run.smithi045.stdout: -1722> 2023-10-03T19:19:48.428+0000 7fd1a1468640 2 mds.0.cache Memory usage: total 274132, rss 36932, heap 207144, baseline 190760, 0 / 13 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:26.905 INFO:teuthology.orchestra.run.smithi045.stdout: -1721> 2023-10-03T19:19:48.428+0000 7fd1a1468640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999984860s ago 2023-10-03T19:21:26.905 INFO:teuthology.orchestra.run.smithi045.stdout: -1720> 2023-10-03T19:19:48.428+0000 7fd1a1468640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:26.906 INFO:teuthology.orchestra.run.smithi045.stdout: -1719> 2023-10-03T19:19:48.428+0000 7fd1a1468640 7 mds.0.cache trim bytes_used=50kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:26.906 INFO:teuthology.orchestra.run.smithi045.stdout: -1718> 2023-10-03T19:19:48.428+0000 7fd1a1468640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:26.906 INFO:teuthology.orchestra.run.smithi045.stdout: -1717> 2023-10-03T19:19:48.428+0000 7fd1a1468640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:26.906 INFO:teuthology.orchestra.run.smithi045.stdout: -1716> 2023-10-03T19:19:48.428+0000 7fd1a1468640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:26.906 INFO:teuthology.orchestra.run.smithi045.stdout: -1715> 2023-10-03T19:19:48.428+0000 7fd1a1468640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:26.906 INFO:teuthology.orchestra.run.smithi045.stdout: -1714> 2023-10-03T19:19:48.428+0000 7fd1a1468640 10 mds.0.cache releasing free memory 2023-10-03T19:21:26.906 INFO:teuthology.orchestra.run.smithi045.stdout: -1713> 2023-10-03T19:19:48.428+0000 7fd1a1468640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:26.906 INFO:teuthology.orchestra.run.smithi045.stdout: -1712> 2023-10-03T19:19:48.436+0000 7fd19e462640 20 update_rank0: mds.metrics 2023-10-03T19:21:26.906 INFO:teuthology.orchestra.run.smithi045.stdout: -1711> 2023-10-03T19:19:48.436+0000 7fd19e462640 20 update_rank0: mds.metrics: sending metric updates for 0 clients to rank 0 (address: [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487]) with sequence number 1, last updated sequence number 2 2023-10-03T19:21:26.906 INFO:teuthology.orchestra.run.smithi045.stdout: -1710> 2023-10-03T19:19:48.436+0000 7fd19e462640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] send_to--> mds [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mds_metrics from rank=0 carrying 0 metric updates v1 -- ?+0 0x5563188ef200 2023-10-03T19:21:26.907 INFO:teuthology.orchestra.run.smithi045.stdout: -1709> 2023-10-03T19:19:48.436+0000 7fd19e462640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mds_metrics from rank=0 carrying 0 metric updates v1 -- 0x5563188ef200 con 0x556317aafc00 2023-10-03T19:21:26.907 INFO:teuthology.orchestra.run.smithi045.stdout: -1708> 2023-10-03T19:19:48.436+0000 7fd1a4c6f640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mds.0 v2:172.21.15.45:6834/3401546487 0 ==== mds_metrics from rank=0 carrying 0 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x5563188ef200 con 0x556317aafc00 2023-10-03T19:21:26.907 INFO:teuthology.orchestra.run.smithi045.stdout: -1707> 2023-10-03T19:19:48.436+0000 7fd1a4c6f640 20 mds.metric.aggregator handle_mds_metrics: applying 0 updates for rank=0 with sequence number 1 2023-10-03T19:21:26.907 INFO:teuthology.orchestra.run.smithi045.stdout: -1706> 2023-10-03T19:19:48.436+0000 7fd1a4c6f640 10 mds.pinger pong_received: rank=0, sequence=1 2023-10-03T19:21:26.907 INFO:teuthology.orchestra.run.smithi045.stdout: -1705> 2023-10-03T19:19:48.764+0000 7fd1a8c77640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> conn(0x556318b58800 0x556318ad0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).accept 2023-10-03T19:21:26.907 INFO:teuthology.orchestra.run.smithi045.stdout: -1704> 2023-10-03T19:19:48.764+0000 7fd1a7c75640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> conn(0x556318b58800 0x556318ad0c00 unknown :-1 s=BANNER_ACCEPTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:26.907 INFO:teuthology.orchestra.run.smithi045.stdout: -1703> 2023-10-03T19:19:48.768+0000 7fd1a7c75640 10 monclient: handle_auth_request added challenge on 0x556318b58800 2023-10-03T19:21:26.907 INFO:teuthology.orchestra.run.smithi045.stdout: -1702> 2023-10-03T19:19:48.768+0000 7fd1a7c75640 10 mds.a parse_caps: parsing auth_cap_str='allow *' 2023-10-03T19:21:26.907 INFO:teuthology.orchestra.run.smithi045.stdout: -1701> 2023-10-03T19:19:48.768+0000 7fd1a7c75640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> 172.21.15.45:0/502252409 conn(0x556318b58800 0x556318ad0c00 crc :-1 s=READY pgs=4 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=client.7317 client_cookie=2076ee35be46e090 server_cookie=59a29abb9e3050e3 in_seq=0 out_seq=0 2023-10-03T19:21:26.907 INFO:teuthology.orchestra.run.smithi045.stdout: -1700> 2023-10-03T19:19:48.768+0000 7fd1a5470640 10 mds.a new session 0x556318a4b700 for client.7317 172.21.15.45:0/502252409 con 0x556318b58800 2023-10-03T19:21:26.907 INFO:teuthology.orchestra.run.smithi045.stdout: -1699> 2023-10-03T19:19:48.768+0000 7fd1a5470640 10 mds.a parse_caps: parsing auth_cap_str='allow *' 2023-10-03T19:21:26.907 INFO:teuthology.orchestra.run.smithi045.stdout: -1698> 2023-10-03T19:19:48.768+0000 7fd1a5470640 10 mds.a ms_handle_accept 172.21.15.45:0/502252409 con 0x556318b58800 session 0x556318a4b700 2023-10-03T19:21:26.908 INFO:teuthology.orchestra.run.smithi045.stdout: -1697> 2023-10-03T19:19:48.768+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7317 172.21.15.45:0/502252409 1 ==== command(tid 0: {"prefix": "get_command_descriptions"}) v1 ==== 62+0+0 (crc 0 0 0) 0x556318a8de40 con 0x556318b58800 2023-10-03T19:21:26.908 INFO:teuthology.orchestra.run.smithi045.stdout: -1696> 2023-10-03T19:19:48.768+0000 7fd1a7474640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> 172.21.15.45:0/502252409 -- command_reply(tid 0: 0 ) v1 -- 0x556318a8c9a0 con 0x556318b58800 2023-10-03T19:21:26.908 INFO:teuthology.orchestra.run.smithi045.stdout: -1695> 2023-10-03T19:19:48.768+0000 7fd1a7c75640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> 172.21.15.45:0/502252409 conn(0x556318b58800 msgr2=0x556318ad0c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 39 2023-10-03T19:21:26.908 INFO:teuthology.orchestra.run.smithi045.stdout: -1694> 2023-10-03T19:19:48.768+0000 7fd1a7c75640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> 172.21.15.45:0/502252409 conn(0x556318b58800 msgr2=0x556318ad0c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-03T19:21:26.908 INFO:teuthology.orchestra.run.smithi045.stdout: -1693> 2023-10-03T19:19:48.768+0000 7fd1a7c75640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> 172.21.15.45:0/502252409 conn(0x556318b58800 0x556318ad0c00 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T19:21:26.908 INFO:teuthology.orchestra.run.smithi045.stdout: -1692> 2023-10-03T19:19:48.768+0000 7fd1a7c75640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> 172.21.15.45:0/502252409 conn(0x556318b58800 0x556318ad0c00 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:26.908 INFO:teuthology.orchestra.run.smithi045.stdout: -1691> 2023-10-03T19:19:48.768+0000 7fd1a5470640 5 mds.a ms_handle_reset on 172.21.15.45:0/502252409 2023-10-03T19:21:26.908 INFO:teuthology.orchestra.run.smithi045.stdout: -1690> 2023-10-03T19:19:48.768+0000 7fd1a5470640 3 mds.a ms_handle_reset closing connection for session client.7317 172.21.15.45:0/502252409 2023-10-03T19:21:26.908 INFO:teuthology.orchestra.run.smithi045.stdout: -1689> 2023-10-03T19:19:48.768+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> 172.21.15.45:0/502252409 conn(0x556318b58800 msgr2=0x556318ad0c00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-10-03T19:21:26.908 INFO:teuthology.orchestra.run.smithi045.stdout: -1688> 2023-10-03T19:19:48.768+0000 7fd1a5470640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> 172.21.15.45:0/502252409 conn(0x556318b58800 0x556318ad0c00 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:26.908 INFO:teuthology.orchestra.run.smithi045.stdout: -1687> 2023-10-03T19:19:48.788+0000 7fd1a8c77640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> conn(0x556318b58c00 0x556318ad1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).accept 2023-10-03T19:21:26.909 INFO:teuthology.orchestra.run.smithi045.stdout: -1686> 2023-10-03T19:19:48.788+0000 7fd1a7c75640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> conn(0x556318b58c00 0x556318ad1180 unknown :-1 s=BANNER_ACCEPTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:26.909 INFO:teuthology.orchestra.run.smithi045.stdout: -1685> 2023-10-03T19:19:48.788+0000 7fd1a7c75640 10 monclient: handle_auth_request added challenge on 0x556318b58c00 2023-10-03T19:21:26.909 INFO:teuthology.orchestra.run.smithi045.stdout: -1684> 2023-10-03T19:19:48.788+0000 7fd1a7c75640 10 mds.a parse_caps: parsing auth_cap_str='allow *' 2023-10-03T19:21:26.909 INFO:teuthology.orchestra.run.smithi045.stdout: -1683> 2023-10-03T19:19:48.788+0000 7fd1a5470640 10 mds.a new session 0x556318a4b700 for client.7323 172.21.15.45:0/3408065269 con 0x556318b58c00 2023-10-03T19:21:26.909 INFO:teuthology.orchestra.run.smithi045.stdout: -1682> 2023-10-03T19:19:48.788+0000 7fd1a5470640 10 mds.a parse_caps: parsing auth_cap_str='allow *' 2023-10-03T19:21:26.909 INFO:teuthology.orchestra.run.smithi045.stdout: -1681> 2023-10-03T19:19:48.788+0000 7fd1a7c75640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> 172.21.15.45:0/3408065269 conn(0x556318b58c00 0x556318ad1180 crc :-1 s=READY pgs=4 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=client.7323 client_cookie=7e59d2b77ccc9964 server_cookie=c74f996bd887b881 in_seq=0 out_seq=0 2023-10-03T19:21:26.909 INFO:teuthology.orchestra.run.smithi045.stdout: -1680> 2023-10-03T19:19:48.788+0000 7fd1a5470640 10 mds.a ms_handle_accept 172.21.15.45:0/3408065269 con 0x556318b58c00 session 0x556318a4b700 2023-10-03T19:21:26.909 INFO:teuthology.orchestra.run.smithi045.stdout: -1679> 2023-10-03T19:19:48.788+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7323 172.21.15.45:0/3408065269 1 ==== command(tid 0: {"prefix": "status"}) v1 ==== 44+0+0 (crc 0 0 0) 0x556318a8c9a0 con 0x556318b58c00 2023-10-03T19:21:26.909 INFO:teuthology.orchestra.run.smithi045.stdout: -1678> 2023-10-03T19:19:48.788+0000 7fd1a7474640 1 mds.a asok_command: status {prefix=status} (starting...) 2023-10-03T19:21:26.909 INFO:teuthology.orchestra.run.smithi045.stdout: -1677> 2023-10-03T19:19:48.788+0000 7fd1a7474640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> 172.21.15.45:0/3408065269 -- command_reply(tid 0: 0 ) v1 -- 0x556318a8de40 con 0x556318b58c00 2023-10-03T19:21:26.910 INFO:teuthology.orchestra.run.smithi045.stdout: -1676> 2023-10-03T19:19:48.788+0000 7fd1a7c75640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> 172.21.15.45:0/3408065269 conn(0x556318b58c00 msgr2=0x556318ad1180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 39 2023-10-03T19:21:26.910 INFO:teuthology.orchestra.run.smithi045.stdout: -1675> 2023-10-03T19:19:48.788+0000 7fd1a7c75640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> 172.21.15.45:0/3408065269 conn(0x556318b58c00 msgr2=0x556318ad1180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-03T19:21:26.910 INFO:teuthology.orchestra.run.smithi045.stdout: -1674> 2023-10-03T19:19:48.788+0000 7fd1a7c75640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> 172.21.15.45:0/3408065269 conn(0x556318b58c00 0x556318ad1180 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T19:21:26.910 INFO:teuthology.orchestra.run.smithi045.stdout: -1673> 2023-10-03T19:19:48.788+0000 7fd1a7c75640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> 172.21.15.45:0/3408065269 conn(0x556318b58c00 0x556318ad1180 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:26.910 INFO:teuthology.orchestra.run.smithi045.stdout: -1672> 2023-10-03T19:19:48.788+0000 7fd1a5470640 5 mds.a ms_handle_reset on 172.21.15.45:0/3408065269 2023-10-03T19:21:26.910 INFO:teuthology.orchestra.run.smithi045.stdout: -1671> 2023-10-03T19:19:48.788+0000 7fd1a5470640 3 mds.a ms_handle_reset closing connection for session client.7323 172.21.15.45:0/3408065269 2023-10-03T19:21:26.910 INFO:teuthology.orchestra.run.smithi045.stdout: -1670> 2023-10-03T19:19:48.788+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> 172.21.15.45:0/3408065269 conn(0x556318b58c00 msgr2=0x556318ad1180 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-10-03T19:21:26.910 INFO:teuthology.orchestra.run.smithi045.stdout: -1669> 2023-10-03T19:19:48.788+0000 7fd1a5470640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> 172.21.15.45:0/3408065269 conn(0x556318b58c00 0x556318ad1180 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:26.910 INFO:teuthology.orchestra.run.smithi045.stdout: -1668> 2023-10-03T19:19:49.064+0000 7fd1a446e640 10 monclient: tick 2023-10-03T19:21:26.910 INFO:teuthology.orchestra.run.smithi045.stdout: -1667> 2023-10-03T19:19:49.064+0000 7fd1a446e640 10 monclient: _check_auth_tickets 2023-10-03T19:21:26.910 INFO:teuthology.orchestra.run.smithi045.stdout: -1666> 2023-10-03T19:19:49.064+0000 7fd1a446e640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:19.069849+0000) 2023-10-03T19:21:26.911 INFO:teuthology.orchestra.run.smithi045.stdout: -1665> 2023-10-03T19:19:49.064+0000 7fd1a3c6d640 10 mds.0.log trim 1 / 128 segments, 1 / -1 events, 0 (0) expiring, 0 (0) expired 2023-10-03T19:21:26.911 INFO:teuthology.orchestra.run.smithi045.stdout: -1664> 2023-10-03T19:19:49.064+0000 7fd1a3c6d640 10 mds.0.log _trim_expired_segments waiting for 1/4194304 to expire 2023-10-03T19:21:26.911 INFO:teuthology.orchestra.run.smithi045.stdout: -1663> 2023-10-03T19:19:49.064+0000 7fd1a3c6d640 10 mds.0.server find_idle_sessions. last cleared laggy state 1235.45s ago 2023-10-03T19:21:26.911 INFO:teuthology.orchestra.run.smithi045.stdout: -1662> 2023-10-03T19:19:49.064+0000 7fd1a3c6d640 10 mds.0.locker scatter_tick 2023-10-03T19:21:26.911 INFO:teuthology.orchestra.run.smithi045.stdout: -1661> 2023-10-03T19:19:49.064+0000 7fd1a3c6d640 20 mds.0.locker caps_tick 0 revoking caps 2023-10-03T19:21:26.911 INFO:teuthology.orchestra.run.smithi045.stdout: -1660> 2023-10-03T19:19:49.064+0000 7fd1a3c6d640 20 mds.0.bal handle_export_pins export_pin_queue size=0 2023-10-03T19:21:26.911 INFO:teuthology.orchestra.run.smithi045.stdout: -1659> 2023-10-03T19:19:49.064+0000 7fd1a3c6d640 15 mds.0.bal tick tick last_sample now 1235.454045s 2023-10-03T19:21:26.911 INFO:teuthology.orchestra.run.smithi045.stdout: -1658> 2023-10-03T19:19:49.064+0000 7fd1a3c6d640 15 mds.0.cache show_subtrees 2023-10-03T19:21:26.911 INFO:teuthology.orchestra.run.smithi045.stdout: -1657> 2023-10-03T19:19:49.064+0000 7fd1a3c6d640 10 mds.0.cache |__ 0 auth [dir 0x1 / [2,head] auth v=1 cv=1/1 REP dir_auth=0 state=1073741825|complete f() n() hs=0+0,ss=0+0 | subtree=1 dirty=0 authpin=0 0x556317b1d180] 2023-10-03T19:21:26.911 INFO:teuthology.orchestra.run.smithi045.stdout: -1656> 2023-10-03T19:19:49.064+0000 7fd1a3c6d640 10 mds.0.cache |__ 0 auth [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x556317b1d600] 2023-10-03T19:21:26.911 INFO:teuthology.orchestra.run.smithi045.stdout: -1655> 2023-10-03T19:19:49.064+0000 7fd1a3c6d640 10 mds.0.cache find_stale_fragment_freeze 2023-10-03T19:21:26.912 INFO:teuthology.orchestra.run.smithi045.stdout: -1654> 2023-10-03T19:19:49.064+0000 7fd1a3c6d640 10 mds.0.snap check_osd_map - version unchanged 2023-10-03T19:21:26.912 INFO:teuthology.orchestra.run.smithi045.stdout: -1653> 2023-10-03T19:19:49.064+0000 7fd1a3c6d640 20 mds.0.48 updating export targets, currently 0 ranks are targets 2023-10-03T19:21:26.912 INFO:teuthology.orchestra.run.smithi045.stdout: -1652> 2023-10-03T19:19:49.420+0000 7fd1a3c6d640 20 mds.0.48 get_task_status 2023-10-03T19:21:26.912 INFO:teuthology.orchestra.run.smithi045.stdout: -1651> 2023-10-03T19:19:49.420+0000 7fd1a3c6d640 20 mds.0.48 schedule_update_timer_task 2023-10-03T19:21:26.912 INFO:teuthology.orchestra.run.smithi045.stdout: -1650> 2023-10-03T19:19:49.432+0000 7fd1a1468640 2 mds.0.cache Memory usage: total 274132, rss 37280, heap 207144, baseline 190760, 0 / 13 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:26.912 INFO:teuthology.orchestra.run.smithi045.stdout: -1649> 2023-10-03T19:19:49.432+0000 7fd1a1468640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999984860s ago 2023-10-03T19:21:26.912 INFO:teuthology.orchestra.run.smithi045.stdout: -1648> 2023-10-03T19:19:49.432+0000 7fd1a1468640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:26.912 INFO:teuthology.orchestra.run.smithi045.stdout: -1647> 2023-10-03T19:19:49.432+0000 7fd1a1468640 7 mds.0.cache trim bytes_used=50kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:26.912 INFO:teuthology.orchestra.run.smithi045.stdout: -1646> 2023-10-03T19:19:49.432+0000 7fd1a1468640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:26.912 INFO:teuthology.orchestra.run.smithi045.stdout: -1645> 2023-10-03T19:19:49.432+0000 7fd1a1468640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:26.912 INFO:teuthology.orchestra.run.smithi045.stdout: -1644> 2023-10-03T19:19:49.432+0000 7fd1a1468640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:26.913 INFO:teuthology.orchestra.run.smithi045.stdout: -1643> 2023-10-03T19:19:49.432+0000 7fd1a1468640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:26.913 INFO:teuthology.orchestra.run.smithi045.stdout: -1642> 2023-10-03T19:19:49.432+0000 7fd1a1468640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:26.913 INFO:teuthology.orchestra.run.smithi045.stdout: -1641> 2023-10-03T19:19:50.012+0000 7fd1a8c77640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> conn(0x556318b59000 0x556318ad1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).accept 2023-10-03T19:21:26.913 INFO:teuthology.orchestra.run.smithi045.stdout: -1640> 2023-10-03T19:19:50.012+0000 7fd1a7c75640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> conn(0x556318b59000 0x556318ad1700 unknown :-1 s=BANNER_ACCEPTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:26.913 INFO:teuthology.orchestra.run.smithi045.stdout: -1639> 2023-10-03T19:19:50.012+0000 7fd1a7c75640 10 monclient: handle_auth_request added challenge on 0x556318b59000 2023-10-03T19:21:26.913 INFO:teuthology.orchestra.run.smithi045.stdout: -1638> 2023-10-03T19:19:50.012+0000 7fd1a7c75640 10 mds.a parse_caps: parsing auth_cap_str='allow' 2023-10-03T19:21:26.913 INFO:teuthology.orchestra.run.smithi045.stdout: -1637> 2023-10-03T19:19:50.012+0000 7fd1a5470640 10 mds.a new session 0x556318a4b700 for client.7335 172.21.15.146:0/990159870 con 0x556318b59000 2023-10-03T19:21:26.913 INFO:teuthology.orchestra.run.smithi045.stdout: -1636> 2023-10-03T19:19:50.012+0000 7fd1a5470640 10 mds.a parse_caps: parsing auth_cap_str='allow' 2023-10-03T19:21:26.913 INFO:teuthology.orchestra.run.smithi045.stdout: -1635> 2023-10-03T19:19:50.012+0000 7fd1a5470640 10 mds.a ms_handle_accept 172.21.15.146:0/990159870 con 0x556318b59000 session 0x556318a4b700 2023-10-03T19:21:26.913 INFO:teuthology.orchestra.run.smithi045.stdout: -1634> 2023-10-03T19:19:50.012+0000 7fd1a7c75640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> 172.21.15.146:0/990159870 conn(0x556318b59000 0x556318ad1700 crc :-1 s=READY pgs=4 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=client.7335 client_cookie=49d1eab3c1c904b4 server_cookie=6395da60f812716f in_seq=0 out_seq=0 2023-10-03T19:21:26.913 INFO:teuthology.orchestra.run.smithi045.stdout: -1633> 2023-10-03T19:19:50.012+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7335 172.21.15.146:0/990159870 1 ==== client_session(request_open) v5 ==== 349+0+0 (crc 0 0 0) 0x556317aee8c0 con 0x556318b59000 2023-10-03T19:21:26.914 INFO:teuthology.orchestra.run.smithi045.stdout: -1632> 2023-10-03T19:19:50.012+0000 7fd1a5470640 20 mds.0.48 get_session have 0x556318a4b700 client.7335 172.21.15.146:0/990159870 state closed 2023-10-03T19:21:26.914 INFO:teuthology.orchestra.run.smithi045.stdout: -1631> 2023-10-03T19:19:50.012+0000 7fd1a5470640 3 mds.0.server handle_client_session client_session(request_open) v5 from client.7335 2023-10-03T19:21:26.914 INFO:teuthology.orchestra.run.smithi045.stdout: -1630> 2023-10-03T19:19:50.012+0000 7fd1a5470640 20 mds.0.server handle_client_session CEPH_SESSION_REQUEST_OPEN metadata entries: 2023-10-03T19:21:26.914 INFO:teuthology.orchestra.run.smithi045.stdout: -1629> 2023-10-03T19:19:50.012+0000 7fd1a5470640 20 mds.0.server features: '0x00000000000fffff' 2023-10-03T19:21:26.914 INFO:teuthology.orchestra.run.smithi045.stdout: -1628> 2023-10-03T19:19:50.012+0000 7fd1a5470640 20 mds.0.server metric specification: [{metric_flags: '0x000000000000ffff'}] 2023-10-03T19:21:26.914 INFO:teuthology.orchestra.run.smithi045.stdout: -1627> 2023-10-03T19:19:50.012+0000 7fd1a5470640 20 mds.0.server ceph_sha1: 05a43c8fb3988914c879a50970f9054a098e0612 2023-10-03T19:21:26.914 INFO:teuthology.orchestra.run.smithi045.stdout: -1626> 2023-10-03T19:19:50.012+0000 7fd1a5470640 20 mds.0.server ceph_version: ceph version 18.0.0-3908-g05a43c8f (05a43c8fb3988914c879a50970f9054a098e0612) reef (dev) 2023-10-03T19:21:26.914 INFO:teuthology.orchestra.run.smithi045.stdout: -1625> 2023-10-03T19:19:50.012+0000 7fd1a5470640 20 mds.0.server entity_id: 0 2023-10-03T19:21:26.914 INFO:teuthology.orchestra.run.smithi045.stdout: -1624> 2023-10-03T19:19:50.012+0000 7fd1a5470640 20 mds.0.server hostname: smithi146 2023-10-03T19:21:26.914 INFO:teuthology.orchestra.run.smithi045.stdout: -1623> 2023-10-03T19:19:50.012+0000 7fd1a5470640 20 mds.0.server mount_point: /home/ubuntu/cephtest/mnt.0 2023-10-03T19:21:26.914 INFO:teuthology.orchestra.run.smithi045.stdout: -1622> 2023-10-03T19:19:50.012+0000 7fd1a5470640 20 mds.0.server pid: 33931 2023-10-03T19:21:26.915 INFO:teuthology.orchestra.run.smithi045.stdout: -1621> 2023-10-03T19:19:50.012+0000 7fd1a5470640 20 mds.0.server root: / 2023-10-03T19:21:26.915 INFO:teuthology.orchestra.run.smithi045.stdout: -1620> 2023-10-03T19:19:50.012+0000 7fd1a5470640 10 mds.0.sessionmap add_session s=0x556318a4b700 name=client.7335 2023-10-03T19:21:26.915 INFO:teuthology.orchestra.run.smithi045.stdout: -1619> 2023-10-03T19:19:50.012+0000 7fd1a5470640 20 mds.0.sessionmap mark_projected s=0x556318a4b700 name=client.7335 pv=0 -> 1 2023-10-03T19:21:26.915 INFO:teuthology.orchestra.run.smithi045.stdout: -1618> 2023-10-03T19:19:50.012+0000 7fd1a5470640 10 mds.0.sessionmap touch_session s=0x556318a4b700 name=client.7335 2023-10-03T19:21:26.915 INFO:teuthology.orchestra.run.smithi045.stdout: -1617> 2023-10-03T19:19:50.012+0000 7fd19ec63640 5 mds.0.log _submit_thread 4195196~420 : ESession client.7335 172.21.15.146:0/990159870 open cmapv 1 2023-10-03T19:21:26.915 INFO:teuthology.orchestra.run.smithi045.stdout: -1616> 2023-10-03T19:19:50.012+0000 7fd19ec63640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.48:40 15.14 15:2e2fa760:::200.00000001:head [write 892~440 [fadvise_dontneed] in=440b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e98) v8 -- 0x556318901180 con 0x5563189cc400 2023-10-03T19:21:26.915 INFO:teuthology.orchestra.run.smithi045.stdout: -1615> 2023-10-03T19:19:50.016+0000 7fd1a2c6b640 10 mds.pinger is_rank_lagging: rank=0 2023-10-03T19:21:26.915 INFO:teuthology.orchestra.run.smithi045.stdout: -1614> 2023-10-03T19:19:50.016+0000 7fd1a2c6b640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgrreport(unknown.a +0-0 packed 1558) v9 -- 0x556318900380 con 0x5563189cc000 2023-10-03T19:21:26.915 INFO:teuthology.orchestra.run.smithi045.stdout: -1613> 2023-10-03T19:19:50.016+0000 7fd1a8c77640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.6 v2:172.21.15.79:6819/1486010128 8 ==== osd_op_reply(40 200.00000001 [write 892~440 [fadvise_dontneed]] v98'7 uv7 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x556318aaf440 con 0x5563189cc400 2023-10-03T19:21:26.915 INFO:teuthology.orchestra.run.smithi045.stdout: -1612> 2023-10-03T19:19:50.016+0000 7fd19f464640 10 MDSIOContextBase::complete: 20C_MDS_session_finish 2023-10-03T19:21:26.915 INFO:teuthology.orchestra.run.smithi045.stdout: -1611> 2023-10-03T19:19:50.016+0000 7fd19f464640 10 MDSContext::complete: 20C_MDS_session_finish 2023-10-03T19:21:26.915 INFO:teuthology.orchestra.run.smithi045.stdout: -1610> 2023-10-03T19:19:50.016+0000 7fd19f464640 10 mds.0.server _session_logged client.7335 172.21.15.146:0/990159870 state_seq 1 open 1 inos_to_free [] inotablev 0 inos_to_purge [] 2023-10-03T19:21:26.916 INFO:teuthology.orchestra.run.smithi045.stdout: -1609> 2023-10-03T19:19:50.016+0000 7fd19f464640 20 mds.0.sessionmap mark_dirty s=0x556318a4b700 name=client.7335 v=0 2023-10-03T19:21:26.916 INFO:teuthology.orchestra.run.smithi045.stdout: -1608> 2023-10-03T19:19:50.016+0000 7fd19f464640 10 mds.0.sessionmap touch_session s=0x556318a4b700 name=client.7335 2023-10-03T19:21:26.916 INFO:teuthology.orchestra.run.smithi045.stdout: -1607> 2023-10-03T19:19:50.016+0000 7fd19f464640 10 add_session: mds.metrics: session=0x556318a4b700, client=client.7335 172.21.15.146:0/990159870 2023-10-03T19:21:26.916 INFO:teuthology.orchestra.run.smithi045.stdout: -1606> 2023-10-03T19:19:50.016+0000 7fd19f464640 20 add_session: mds.metrics: metrics=[update_type=0, metrics={cap_hit_metric={hits=0, misses=0}, read_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, write_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, metadata_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, dentry_lease={hits=0, misses=0}, opened_files_metric={opened_files=0, total_inodes=0}, pinned_icaps_metric={pinned_icaps=0, total_inodes=0}, opened_inodes_metric={opened_inodes=0, total_inodes=0}, read_io_sizes_metric={total_ops=0, total_size=0}, write_io_sizes_metric={total_ops=0, total_size=0}}] 2023-10-03T19:21:26.916 INFO:teuthology.orchestra.run.smithi045.stdout: -1605> 2023-10-03T19:19:50.016+0000 7fd19f464640 10 mds.0.48 send_message_client client.7335 172.21.15.146:0/990159870 client_session(open) v5 2023-10-03T19:21:26.916 INFO:teuthology.orchestra.run.smithi045.stdout: -1604> 2023-10-03T19:19:50.016+0000 7fd19f464640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> 172.21.15.146:0/990159870 -- client_session(open) v5 -- 0x556317aef6c0 con 0x556318b59000 2023-10-03T19:21:26.916 INFO:teuthology.orchestra.run.smithi045.stdout: -1603> 2023-10-03T19:19:50.016+0000 7fd19f464640 2 mds.0.server New client session: addr="172.21.15.146:0/990159870",elapsed=0.004467,throttled=0.000014,status="ACCEPTED",root="/" 2023-10-03T19:21:26.916 INFO:teuthology.orchestra.run.smithi045.stdout: -1602> 2023-10-03T19:19:50.020+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7335 172.21.15.146:0/990159870 2 ==== client_session(request_renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x556317aef6c0 con 0x556318b59000 2023-10-03T19:21:26.916 INFO:teuthology.orchestra.run.smithi045.stdout: -1601> 2023-10-03T19:19:50.020+0000 7fd1a5470640 20 mds.0.48 get_session have 0x556318a4b700 client.7335 172.21.15.146:0/990159870 state open 2023-10-03T19:21:26.916 INFO:teuthology.orchestra.run.smithi045.stdout: -1600> 2023-10-03T19:19:50.020+0000 7fd1a5470640 3 mds.0.server handle_client_session client_session(request_renewcaps seq 1) v1 from client.7335 2023-10-03T19:21:26.916 INFO:teuthology.orchestra.run.smithi045.stdout: -1599> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.sessionmap touch_session s=0x556318a4b700 name=client.7335 2023-10-03T19:21:26.916 INFO:teuthology.orchestra.run.smithi045.stdout: -1598> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.48 send_message_client client.7335 172.21.15.146:0/990159870 client_session(renewcaps seq 1) v5 2023-10-03T19:21:26.917 INFO:teuthology.orchestra.run.smithi045.stdout: -1597> 2023-10-03T19:19:50.020+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> 172.21.15.146:0/990159870 -- client_session(renewcaps seq 1) v5 -- 0x556317aef880 con 0x556318b59000 2023-10-03T19:21:26.917 INFO:teuthology.orchestra.run.smithi045.stdout: -1596> 2023-10-03T19:19:50.020+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7335 172.21.15.146:0/990159870 3 ==== client_request(client.7335:1 getattr pAsLsXsFs #0x1 2023-10-03T19:19:50.015300+0000 caller_uid=0, caller_gid=0{}) v6 ==== 156+0+0 (crc 0 0 0) 0x556318a2fb00 con 0x556318b59000 2023-10-03T19:21:26.917 INFO:teuthology.orchestra.run.smithi045.stdout: -1595> 2023-10-03T19:19:50.020+0000 7fd1a5470640 4 mds.0.server handle_client_request client_request(client.7335:1 getattr pAsLsXsFs #0x1 2023-10-03T19:19:50.015300+0000 caller_uid=0, caller_gid=0{}) v6 2023-10-03T19:21:26.917 INFO:teuthology.orchestra.run.smithi045.stdout: -1594> 2023-10-03T19:19:50.020+0000 7fd1a5470640 20 mds.0.48 get_session have 0x556318a4b700 client.7335 172.21.15.146:0/990159870 state open 2023-10-03T19:21:26.917 INFO:teuthology.orchestra.run.smithi045.stdout: -1593> 2023-10-03T19:19:50.020+0000 7fd1a5470640 15 mds.0.server oldest_client_tid=1 2023-10-03T19:21:26.917 INFO:teuthology.orchestra.run.smithi045.stdout: -1592> 2023-10-03T19:19:50.020+0000 7fd1a5470640 7 mds.0.cache request_start request(client.7335:1 nref=2 cr=0x556318a2fb00) 2023-10-03T19:21:26.917 INFO:teuthology.orchestra.run.smithi045.stdout: -1591> 2023-10-03T19:19:50.020+0000 7fd1a5470640 7 mds.0.server dispatch_client_request client_request(client.7335:1 getattr pAsLsXsFs #0x1 2023-10-03T19:19:50.015300+0000 caller_uid=0, caller_gid=0{}) v6 2023-10-03T19:21:26.917 INFO:teuthology.orchestra.run.smithi045.stdout: -1590> 2023-10-03T19:19:50.020+0000 7fd1a5470640 7 mds.0.cache traverse: opening base ino 0x1 snap head 2023-10-03T19:21:26.917 INFO:teuthology.orchestra.run.smithi045.stdout: -1589> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.cache path_traverse finish on snapid head 2023-10-03T19:21:26.917 INFO:teuthology.orchestra.run.smithi045.stdout: -1588> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.server rdlock_path_pin_ref request(client.7335:1 nref=3 cr=0x556318a2fb00) #0x1 2023-10-03T19:21:26.917 INFO:teuthology.orchestra.run.smithi045.stdout: -1587> 2023-10-03T19:19:50.020+0000 7fd1a5470640 7 mds.0.cache traverse: opening base ino 0x1 snap head 2023-10-03T19:21:26.917 INFO:teuthology.orchestra.run.smithi045.stdout: -1586> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.locker try_rdlock_snap_layout request(client.7335:1 nref=4 cr=0x556318a2fb00) [inode 0x1 [...2,head] / auth v1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) | request=1 dirfrag=1 dirtyparent=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:26.918 INFO:teuthology.orchestra.run.smithi045.stdout: -1585> 2023-10-03T19:19:50.020+0000 7fd1a5470640 20 mds.0.locker got rdlock on (isnap sync r=1) [inode 0x1 [...2,head] / auth v1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) | request=1 lock=1 dirfrag=1 dirtyparent=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:26.918 INFO:teuthology.orchestra.run.smithi045.stdout: -1584> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.cache path_traverse finish on snapid head 2023-10-03T19:21:26.918 INFO:teuthology.orchestra.run.smithi045.stdout: -1583> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.server ref is [inode 0x1 [...2,head] / auth v1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) | request=1 lock=1 dirfrag=1 dirtyparent=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:26.918 INFO:teuthology.orchestra.run.smithi045.stdout: -1582> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.locker acquire_locks request(client.7335:1 nref=3 cr=0x556318a2fb00) 2023-10-03T19:21:26.918 INFO:teuthology.orchestra.run.smithi045.stdout: -1581> 2023-10-03T19:19:50.020+0000 7fd1a5470640 20 mds.0.locker must rdlock (ilink sync) [inode 0x1 [...2,head] / auth v1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) | request=1 lock=1 dirfrag=1 dirtyparent=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.023 INFO:teuthology.orchestra.run.smithi045.stdout: -1580> 2023-10-03T19:19:50.020+0000 7fd1a5470640 20 mds.0.locker must rdlock (iauth sync) [inode 0x1 [...2,head] / auth v1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) | request=1 lock=1 dirfrag=1 dirtyparent=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.023 INFO:teuthology.orchestra.run.smithi045.stdout: -1579> 2023-10-03T19:19:50.020+0000 7fd1a5470640 20 mds.0.locker must rdlock (ixattr sync) [inode 0x1 [...2,head] / auth v1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) | request=1 lock=1 dirfrag=1 dirtyparent=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.023 INFO:teuthology.orchestra.run.smithi045.stdout: -1578> 2023-10-03T19:19:50.020+0000 7fd1a5470640 20 mds.0.locker must rdlock (ifile sync) [inode 0x1 [...2,head] / auth v1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) | request=1 lock=1 dirfrag=1 dirtyparent=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.023 INFO:teuthology.orchestra.run.smithi045.stdout: -1577> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.locker must authpin [inode 0x1 [...2,head] / auth v1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) | request=1 lock=1 dirfrag=1 dirtyparent=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.023 INFO:teuthology.orchestra.run.smithi045.stdout: -1576> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.locker auth_pinning [inode 0x1 [...2,head] / auth v1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) | request=1 lock=1 dirfrag=1 dirtyparent=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.023 INFO:teuthology.orchestra.run.smithi045.stdout: -1575> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) auth_pin by 0x5563189cdc00 on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) | request=1 lock=1 dirfrag=1 dirtyparent=0 authpin=1 0x556317b3c680] now 1 2023-10-03T19:21:27.023 INFO:teuthology.orchestra.run.smithi045.stdout: -1574> 2023-10-03T19:19:50.020+0000 7fd1a5470640 7 mds.0.locker rdlock_start on (ifile sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) | request=1 lock=1 dirfrag=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.023 INFO:teuthology.orchestra.run.smithi045.stdout: -1573> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.locker got rdlock on (ifile sync r=1) [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile sync r=1) (iversion lock) | request=1 lock=2 dirfrag=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.023 INFO:teuthology.orchestra.run.smithi045.stdout: -1572> 2023-10-03T19:19:50.020+0000 7fd1a5470640 7 mds.0.locker rdlock_start on (iauth sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile sync r=1) (iversion lock) | request=1 lock=2 dirfrag=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.023 INFO:teuthology.orchestra.run.smithi045.stdout: -1571> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.locker got rdlock on (iauth sync r=1) [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (isnap sync r=1) (ifile sync r=1) (iversion lock) | request=1 lock=3 dirfrag=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.024 INFO:teuthology.orchestra.run.smithi045.stdout: -1570> 2023-10-03T19:19:50.020+0000 7fd1a5470640 7 mds.0.locker rdlock_start on (ilink sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (isnap sync r=1) (ifile sync r=1) (iversion lock) | request=1 lock=3 dirfrag=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.024 INFO:teuthology.orchestra.run.smithi045.stdout: -1569> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.locker got rdlock on (ilink sync r=1) [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (ilink sync r=1) (isnap sync r=1) (ifile sync r=1) (iversion lock) | request=1 lock=4 dirfrag=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.024 INFO:teuthology.orchestra.run.smithi045.stdout: -1568> 2023-10-03T19:19:50.020+0000 7fd1a5470640 7 mds.0.locker rdlock_start on (ixattr sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (ilink sync r=1) (isnap sync r=1) (ifile sync r=1) (iversion lock) | request=1 lock=4 dirfrag=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.024 INFO:teuthology.orchestra.run.smithi045.stdout: -1567> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.locker got rdlock on (ixattr sync r=1) [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (ilink sync r=1) (isnap sync r=1) (ifile sync r=1) (ixattr sync r=1) (iversion lock) | request=1 lock=5 dirfrag=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.024 INFO:teuthology.orchestra.run.smithi045.stdout: -1566> 2023-10-03T19:19:50.020+0000 7fd1a5470640 20 Session check_access path 2023-10-03T19:21:27.024 INFO:teuthology.orchestra.run.smithi045.stdout: -1565> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.server reply to stat on client_request(client.7335:1 getattr pAsLsXsFs #0x1 2023-10-03T19:19:50.015300+0000 caller_uid=0, caller_gid=0{}) v6 2023-10-03T19:21:27.024 INFO:teuthology.orchestra.run.smithi045.stdout: -1564> 2023-10-03T19:19:50.020+0000 7fd1a5470640 20 mds.0.server respond_to_request batch head request(client.7335:1 nref=3 cr=0x556318a2fb00) 2023-10-03T19:21:27.024 INFO:teuthology.orchestra.run.smithi045.stdout: -1563> 2023-10-03T19:19:50.020+0000 7fd1a5470640 20 respond: responding to batch ops with result=0: [batch front=request(client.7335:1 nref=3 cr=0x556318a2fb00)] 2023-10-03T19:21:27.024 INFO:teuthology.orchestra.run.smithi045.stdout: -1562> 2023-10-03T19:19:50.020+0000 7fd1a5470640 7 mds.0.server reply_client_request 0 ((0) Success) client_request(client.7335:1 getattr pAsLsXsFs #0x1 2023-10-03T19:19:50.015300+0000 caller_uid=0, caller_gid=0{}) v6 2023-10-03T19:21:27.025 INFO:teuthology.orchestra.run.smithi045.stdout: -1561> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.server apply_allocated_inos 0x0 / [] / 0x0 2023-10-03T19:21:27.025 INFO:teuthology.orchestra.run.smithi045.stdout: -1560> 2023-10-03T19:19:50.020+0000 7fd1a5470640 20 mds.0.server lat 0.000375 2023-10-03T19:21:27.025 INFO:teuthology.orchestra.run.smithi045.stdout: -1559> 2023-10-03T19:19:50.020+0000 7fd1a5470640 20 mds.0.server set_trace_dist snapid head 2023-10-03T19:21:27.025 INFO:teuthology.orchestra.run.smithi045.stdout: -1558> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.cache.snaprealm(0x1 seq 1 0x556317c178c0) build_snap_set on snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:19:39.424362+0000 change_attr 0 0x556317c178c0) 2023-10-03T19:21:27.025 INFO:teuthology.orchestra.run.smithi045.stdout: -1557> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.cache.snaprealm(0x1 seq 1 0x556317c178c0) build_snap_trace my_snaps [] 2023-10-03T19:21:27.025 INFO:teuthology.orchestra.run.smithi045.stdout: -1556> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.cache.snaprealm(0x1 seq 1 0x556317c178c0) check_cache rebuilt seq 1 cached_seq 1 cached_last_created 0 cached_last_destroyed 1) 2023-10-03T19:21:27.025 INFO:teuthology.orchestra.run.smithi045.stdout: -1555> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.server set_trace_dist snaprealm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:19:39.424362+0000 change_attr 0 0x556317c178c0) len=70 2023-10-03T19:21:27.025 INFO:teuthology.orchestra.run.smithi045.stdout: -1554> 2023-10-03T19:19:50.020+0000 7fd1a5470640 20 mds.0.cache.ino(0x1) pfile 0 pauth 0 plink 0 pxattr 0 plocal 0 mtime 2023-10-03T19:19:39.424362+0000 ctime 2023-10-03T19:19:39.424362+0000 change_attr 0 valid=1 2023-10-03T19:21:27.025 INFO:teuthology.orchestra.run.smithi045.stdout: -1553> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) add_client_cap first cap, joining realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:19:39.424362+0000 change_attr 0 0x556317c178c0) 2023-10-03T19:21:27.025 INFO:teuthology.orchestra.run.smithi045.stdout: -1552> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) encode_inodestat issuing pAsLsXsFs seq 1 2023-10-03T19:21:27.026 INFO:teuthology.orchestra.run.smithi045.stdout: -1551> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) encode_inodestat caps pAsLsXsFs seq 1 mseq 0 xattrv 1 2023-10-03T19:21:27.026 INFO:teuthology.orchestra.run.smithi045.stdout: -1550> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) including xattrs version 1 2023-10-03T19:21:27.026 INFO:teuthology.orchestra.run.smithi045.stdout: -1549> 2023-10-03T19:19:50.020+0000 7fd1a5470640 20 mds.0.server set_trace_dist added snap head in [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (ilink sync r=1) (isnap sync r=1) (ifile sync r=1) (ixattr sync r=1) (iversion lock) caps={7335=pAsLsXsFs/-@1} | request=1 lock=5 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.026 INFO:teuthology.orchestra.run.smithi045.stdout: -1548> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.48 send_message_client client.7335 172.21.15.146:0/990159870 client_reply(???:1 = 0 (0) Success) v1 2023-10-03T19:21:27.026 INFO:teuthology.orchestra.run.smithi045.stdout: -1547> 2023-10-03T19:19:50.020+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> 172.21.15.146:0/990159870 -- client_reply(???:1 = 0 (0) Success) v1 -- 0x556317aef6c0 con 0x556318b59000 2023-10-03T19:21:27.026 INFO:teuthology.orchestra.run.smithi045.stdout: -1546> 2023-10-03T19:19:50.020+0000 7fd1a5470640 7 mds.0.cache request_finish request(client.7335:1 nref=3 cr=0x556318a2fb00) 2023-10-03T19:21:27.026 INFO:teuthology.orchestra.run.smithi045.stdout: -1545> 2023-10-03T19:19:50.020+0000 7fd1a5470640 15 mds.0.cache request_cleanup request(client.7335:1 nref=3 cr=0x556318a2fb00) 2023-10-03T19:21:27.026 INFO:teuthology.orchestra.run.smithi045.stdout: -1544> 2023-10-03T19:19:50.020+0000 7fd1a5470640 7 mds.0.locker rdlock_finish on (iauth sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (ilink sync r=1) (isnap sync r=1) (ifile sync r=1) (ixattr sync r=1) (iversion lock) caps={7335=pAsLsXsFs/-@1} | request=1 lock=4 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.026 INFO:teuthology.orchestra.run.smithi045.stdout: -1543> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.locker simple_eval (iauth sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (ilink sync r=1) (isnap sync r=1) (ifile sync r=1) (ixattr sync r=1) (iversion lock) caps={7335=pAsLsXsFs/-@1} | request=1 lock=4 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.026 INFO:teuthology.orchestra.run.smithi045.stdout: -1542> 2023-10-03T19:19:50.020+0000 7fd1a5470640 7 mds.0.locker rdlock_finish on (ilink sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile sync r=1) (ixattr sync r=1) (iversion lock) caps={7335=pAsLsXsFs/-@1} | request=1 lock=3 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.027 INFO:teuthology.orchestra.run.smithi045.stdout: -1541> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.locker simple_eval (ilink sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile sync r=1) (ixattr sync r=1) (iversion lock) caps={7335=pAsLsXsFs/-@1} | request=1 lock=3 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.027 INFO:teuthology.orchestra.run.smithi045.stdout: -1540> 2023-10-03T19:19:50.020+0000 7fd1a5470640 7 mds.0.locker rdlock_finish on (ifile sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ixattr sync r=1) (iversion lock) caps={7335=pAsLsXsFs/-@1} | request=1 lock=2 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.027 INFO:teuthology.orchestra.run.smithi045.stdout: -1539> 2023-10-03T19:19:50.020+0000 7fd1a5470640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ixattr sync r=1) (iversion lock) caps={7335=pAsLsXsFs/-@1} | request=1 lock=2 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.027 INFO:teuthology.orchestra.run.smithi045.stdout: -1538> 2023-10-03T19:19:50.020+0000 7fd1a5470640 7 mds.0.locker rdlock_finish on (ixattr sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pAsLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.027 INFO:teuthology.orchestra.run.smithi045.stdout: -1537> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.locker simple_eval (ixattr sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pAsLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.027 INFO:teuthology.orchestra.run.smithi045.stdout: -1536> 2023-10-03T19:19:50.020+0000 7fd1a5470640 7 mds.0.locker rdlock_finish on (isnap sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) caps={7335=pAsLsXsFs/-@1} | request=1 lock=0 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.027 INFO:teuthology.orchestra.run.smithi045.stdout: -1535> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.locker simple_eval (isnap sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) caps={7335=pAsLsXsFs/-@1} | request=1 lock=0 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.027 INFO:teuthology.orchestra.run.smithi045.stdout: -1534> 2023-10-03T19:19:50.020+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) auth_unpin by 0x5563189cdc00 on [inode 0x1 [...2,head] / auth v1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) caps={7335=pAsLsXsFs/-@1} | request=1 lock=0 dirfrag=1 caps=1 dirtyparent=0 authpin=0 0x556317b3c680] now 0 2023-10-03T19:21:27.027 INFO:teuthology.orchestra.run.smithi045.stdout: -1533> 2023-10-03T19:19:50.064+0000 7fd1a446e640 10 monclient: tick 2023-10-03T19:21:27.028 INFO:teuthology.orchestra.run.smithi045.stdout: -1532> 2023-10-03T19:19:50.064+0000 7fd1a446e640 10 monclient: _check_auth_tickets 2023-10-03T19:21:27.028 INFO:teuthology.orchestra.run.smithi045.stdout: -1531> 2023-10-03T19:19:50.064+0000 7fd1a446e640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:20.069947+0000) 2023-10-03T19:21:27.028 INFO:teuthology.orchestra.run.smithi045.stdout: -1530> 2023-10-03T19:19:50.432+0000 7fd1a1468640 2 mds.0.cache Memory usage: total 274132, rss 37280, heap 207144, baseline 190760, 1 / 13 inodes have caps, 1 caps, 0.0769231 caps per inode 2023-10-03T19:21:27.028 INFO:teuthology.orchestra.run.smithi045.stdout: -1529> 2023-10-03T19:19:50.432+0000 7fd1a1468640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999984920s ago 2023-10-03T19:21:27.028 INFO:teuthology.orchestra.run.smithi045.stdout: -1528> 2023-10-03T19:19:50.432+0000 7fd1a1468640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:27.028 INFO:teuthology.orchestra.run.smithi045.stdout: -1527> 2023-10-03T19:19:50.432+0000 7fd1a1468640 7 mds.0.cache trim bytes_used=50kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:27.028 INFO:teuthology.orchestra.run.smithi045.stdout: -1526> 2023-10-03T19:19:50.432+0000 7fd1a1468640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:27.028 INFO:teuthology.orchestra.run.smithi045.stdout: -1525> 2023-10-03T19:19:50.432+0000 7fd1a1468640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:27.028 INFO:teuthology.orchestra.run.smithi045.stdout: -1524> 2023-10-03T19:19:50.432+0000 7fd1a1468640 7 mds.0.server recall_client_state: min=100 max=1048576 total=1 flags=0xa 2023-10-03T19:21:27.028 INFO:teuthology.orchestra.run.smithi045.stdout: -1523> 2023-10-03T19:19:50.432+0000 7fd1a1468640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:27.029 INFO:teuthology.orchestra.run.smithi045.stdout: -1522> 2023-10-03T19:19:50.432+0000 7fd1a1468640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:27.029 INFO:teuthology.orchestra.run.smithi045.stdout: -1521> 2023-10-03T19:19:50.436+0000 7fd19dc61640 10 mds.metric.aggregator ping_all_active_ranks: pinging 1 active mds(s) 2023-10-03T19:21:27.029 INFO:teuthology.orchestra.run.smithi045.stdout: -1520> 2023-10-03T19:19:50.436+0000 7fd19dc61640 20 mds.metric.aggregator ping_all_active_ranks: pinging rank=0 addr=[v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] 2023-10-03T19:21:27.029 INFO:teuthology.orchestra.run.smithi045.stdout: -1519> 2023-10-03T19:19:50.436+0000 7fd19dc61640 10 mds.pinger send_ping: rank=0 2023-10-03T19:21:27.029 INFO:teuthology.orchestra.run.smithi045.stdout: -1518> 2023-10-03T19:19:50.436+0000 7fd19dc61640 10 mds.pinger send_ping: sending ping with sequence=2 to rank=0 2023-10-03T19:21:27.029 INFO:teuthology.orchestra.run.smithi045.stdout: -1517> 2023-10-03T19:19:50.436+0000 7fd19dc61640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] send_to--> mds [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mdsping v1 -- ?+0 0x556317b80a00 2023-10-03T19:21:27.029 INFO:teuthology.orchestra.run.smithi045.stdout: -1516> 2023-10-03T19:19:50.436+0000 7fd19dc61640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mdsping v1 -- 0x556317b80a00 con 0x556317aafc00 2023-10-03T19:21:27.029 INFO:teuthology.orchestra.run.smithi045.stdout: -1515> 2023-10-03T19:19:50.436+0000 7fd1a4c6f640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mds.0 v2:172.21.15.45:6834/3401546487 0 ==== mdsping v1 ==== 0+0+0 (unknown 0 0 0) 0x556317b80a00 con 0x556317aafc00 2023-10-03T19:21:27.029 INFO:teuthology.orchestra.run.smithi045.stdout: -1514> 2023-10-03T19:19:50.436+0000 7fd1a4c6f640 20 set_next_seq: mds.metrics: current sequence number 1, setting next sequence number 2 2023-10-03T19:21:27.029 INFO:teuthology.orchestra.run.smithi045.stdout: -1513> 2023-10-03T19:19:50.436+0000 7fd19e462640 20 update_rank0: mds.metrics 2023-10-03T19:21:27.029 INFO:teuthology.orchestra.run.smithi045.stdout: -1512> 2023-10-03T19:19:50.436+0000 7fd19e462640 20 update_rank0: mds.metrics: sending metric updates for 1 clients to rank 0 (address: [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487]) with sequence number 2, last updated sequence number 3 2023-10-03T19:21:27.030 INFO:teuthology.orchestra.run.smithi045.stdout: -1511> 2023-10-03T19:19:50.436+0000 7fd19e462640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] send_to--> mds [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mds_metrics from rank=0 carrying 1 metric updates v1 -- ?+0 0x556317b0a480 2023-10-03T19:21:27.030 INFO:teuthology.orchestra.run.smithi045.stdout: -1510> 2023-10-03T19:19:50.436+0000 7fd19e462640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mds_metrics from rank=0 carrying 1 metric updates v1 -- 0x556317b0a480 con 0x556317aafc00 2023-10-03T19:21:27.030 INFO:teuthology.orchestra.run.smithi045.stdout: -1509> 2023-10-03T19:19:50.436+0000 7fd1a4c6f640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mds.0 v2:172.21.15.45:6834/3401546487 0 ==== mds_metrics from rank=0 carrying 1 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x556317b0a480 con 0x556317aafc00 2023-10-03T19:21:27.030 INFO:teuthology.orchestra.run.smithi045.stdout: -1508> 2023-10-03T19:19:50.436+0000 7fd1a4c6f640 20 mds.metric.aggregator handle_mds_metrics: applying 1 updates for rank=0 with sequence number 2 2023-10-03T19:21:27.030 INFO:teuthology.orchestra.run.smithi045.stdout: -1507> 2023-10-03T19:19:50.436+0000 7fd1a4c6f640 10 mds.pinger pong_received: rank=0, sequence=2 2023-10-03T19:21:27.030 INFO:teuthology.orchestra.run.smithi045.stdout: -1506> 2023-10-03T19:19:50.436+0000 7fd1a4c6f640 20 mds.metric.aggregator refresh_metrics_for_rank: client=client.7335 172.21.15.146:0/990159870, rank=0, metrics=[update_type=0, metrics={cap_hit_metric={hits=0, misses=0}, read_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, write_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, metadata_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, dentry_lease={hits=0, misses=0}, opened_files_metric={opened_files=0, total_inodes=0}, pinned_icaps_metric={pinned_icaps=0, total_inodes=0}, opened_inodes_metric={opened_inodes=0, total_inodes=0}, read_io_sizes_metric={total_ops=0, total_size=0}, write_io_sizes_metric={total_ops=0, total_size=0}}] 2023-10-03T19:21:27.030 INFO:teuthology.orchestra.run.smithi045.stdout: -1505> 2023-10-03T19:19:50.436+0000 7fd1a4c6f640 20 mds.metric.aggregator refresh_metrics_for_rank: rank=0 has 1 connected client(s) 2023-10-03T19:21:27.030 INFO:teuthology.orchestra.run.smithi045.stdout: -1504> 2023-10-03T19:19:51.012+0000 7fd1a7c75640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7335 172.21.15.146:0/990159870 5 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000812, avg_latency: 0.000812, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x556318a8de40 con 0x556318b59000 2023-10-03T19:21:27.031 INFO:teuthology.orchestra.run.smithi045.stdout: -1503> 2023-10-03T19:19:51.012+0000 7fd1a7c75640 20 mds.0.48 get_session have 0x556318a4b700 client.7335 172.21.15.146:0/990159870 state open 2023-10-03T19:21:27.031 INFO:teuthology.orchestra.run.smithi045.stdout: -1502> 2023-10-03T19:19:51.012+0000 7fd1a7c75640 20 handle_client_metrics: mds.metrics: session=0x556318a4b700 2023-10-03T19:21:27.031 INFO:teuthology.orchestra.run.smithi045.stdout: -1501> 2023-10-03T19:19:51.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=READ_LATENCY, session=0x556318a4b700, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:27.031 INFO:teuthology.orchestra.run.smithi045.stdout: -1500> 2023-10-03T19:19:51.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=WRITE_LATENCY, session=0x556318a4b700, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:27.031 INFO:teuthology.orchestra.run.smithi045.stdout: -1499> 2023-10-03T19:19:51.012+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7335 172.21.15.146:0/990159870 4 ==== client_session(request_renewcaps seq 2) v1 ==== 28+0+0 (crc 0 0 0) 0x556317aef6c0 con 0x556318b59000 2023-10-03T19:21:27.031 INFO:teuthology.orchestra.run.smithi045.stdout: -1498> 2023-10-03T19:19:51.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=METADATA_LATENCY, session=0x556318a4b700, latency=0.000812, avg=0.000812, sq_sum=0, count=1 2023-10-03T19:21:27.031 INFO:teuthology.orchestra.run.smithi045.stdout: -1497> 2023-10-03T19:19:51.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=CAP_INFO, session=0x556318a4b700, hits=1, misses=0 2023-10-03T19:21:27.031 INFO:teuthology.orchestra.run.smithi045.stdout: -1496> 2023-10-03T19:19:51.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=DENTRY_LEASE, session=0x556318a4b700, hits=0, misses=0 2023-10-03T19:21:27.031 INFO:teuthology.orchestra.run.smithi045.stdout: -1495> 2023-10-03T19:19:51.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=OPENED_FILES, session=0x556318a4b700, opened_files=0, total_inodes=1 2023-10-03T19:21:27.031 INFO:teuthology.orchestra.run.smithi045.stdout: -1494> 2023-10-03T19:19:51.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=PINNED_ICAPS, session=0x556318a4b700, pinned_icaps=1, total_inodes=1 2023-10-03T19:21:27.031 INFO:teuthology.orchestra.run.smithi045.stdout: -1493> 2023-10-03T19:19:51.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=OPENED_INODES, session=0x556318a4b700, opened_inodes=0, total_inodes=1 2023-10-03T19:21:27.032 INFO:teuthology.orchestra.run.smithi045.stdout: -1492> 2023-10-03T19:19:51.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=READ_IO_SIZES, session=0x556318a4b700, total_ops=0, total_size=0 2023-10-03T19:21:27.032 INFO:teuthology.orchestra.run.smithi045.stdout: -1491> 2023-10-03T19:19:51.012+0000 7fd1a5470640 20 mds.0.48 get_session have 0x556318a4b700 client.7335 172.21.15.146:0/990159870 state open 2023-10-03T19:21:27.032 INFO:teuthology.orchestra.run.smithi045.stdout: -1490> 2023-10-03T19:19:51.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=WRITE_IO_SIZES, session=0x556318a4b700, total_ops=0, total_size=0 2023-10-03T19:21:27.032 INFO:teuthology.orchestra.run.smithi045.stdout: -1489> 2023-10-03T19:19:51.012+0000 7fd1a5470640 3 mds.0.server handle_client_session client_session(request_renewcaps seq 2) v1 from client.7335 2023-10-03T19:21:27.032 INFO:teuthology.orchestra.run.smithi045.stdout: -1488> 2023-10-03T19:19:51.012+0000 7fd1a5470640 10 mds.0.sessionmap touch_session s=0x556318a4b700 name=client.7335 2023-10-03T19:21:27.032 INFO:teuthology.orchestra.run.smithi045.stdout: -1487> 2023-10-03T19:19:51.012+0000 7fd1a5470640 10 mds.0.48 send_message_client client.7335 172.21.15.146:0/990159870 client_session(renewcaps seq 2) v5 2023-10-03T19:21:27.032 INFO:teuthology.orchestra.run.smithi045.stdout: -1486> 2023-10-03T19:19:51.012+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> 172.21.15.146:0/990159870 -- client_session(renewcaps seq 2) v5 -- 0x556317aefa40 con 0x556318b59000 2023-10-03T19:21:27.032 INFO:teuthology.orchestra.run.smithi045.stdout: -1485> 2023-10-03T19:19:51.068+0000 7fd1a446e640 10 monclient: tick 2023-10-03T19:21:27.032 INFO:teuthology.orchestra.run.smithi045.stdout: -1484> 2023-10-03T19:19:51.068+0000 7fd1a446e640 10 monclient: _check_auth_tickets 2023-10-03T19:21:27.032 INFO:teuthology.orchestra.run.smithi045.stdout: -1483> 2023-10-03T19:19:51.068+0000 7fd1a446e640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:21.070106+0000) 2023-10-03T19:21:27.032 INFO:teuthology.orchestra.run.smithi045.stdout: -1482> 2023-10-03T19:19:51.420+0000 7fd1a3c6d640 20 mds.0.48 get_task_status 2023-10-03T19:21:27.032 INFO:teuthology.orchestra.run.smithi045.stdout: -1481> 2023-10-03T19:19:51.420+0000 7fd1a3c6d640 20 mds.0.48 schedule_update_timer_task 2023-10-03T19:21:27.033 INFO:teuthology.orchestra.run.smithi045.stdout: -1480> 2023-10-03T19:19:51.432+0000 7fd1a1468640 2 mds.0.cache Memory usage: total 274132, rss 37280, heap 207144, baseline 190760, 1 / 13 inodes have caps, 1 caps, 0.0769231 caps per inode 2023-10-03T19:21:27.033 INFO:teuthology.orchestra.run.smithi045.stdout: -1479> 2023-10-03T19:19:51.432+0000 7fd1a1468640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999984920s ago 2023-10-03T19:21:27.033 INFO:teuthology.orchestra.run.smithi045.stdout: -1478> 2023-10-03T19:19:51.432+0000 7fd1a1468640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:27.033 INFO:teuthology.orchestra.run.smithi045.stdout: -1477> 2023-10-03T19:19:51.432+0000 7fd1a1468640 7 mds.0.cache trim bytes_used=50kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:27.033 INFO:teuthology.orchestra.run.smithi045.stdout: -1476> 2023-10-03T19:19:51.432+0000 7fd1a1468640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:27.033 INFO:teuthology.orchestra.run.smithi045.stdout: -1475> 2023-10-03T19:19:51.432+0000 7fd1a1468640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:27.033 INFO:teuthology.orchestra.run.smithi045.stdout: -1474> 2023-10-03T19:19:51.432+0000 7fd1a1468640 7 mds.0.server recall_client_state: min=100 max=1048576 total=1 flags=0xa 2023-10-03T19:21:27.033 INFO:teuthology.orchestra.run.smithi045.stdout: -1473> 2023-10-03T19:19:51.432+0000 7fd1a1468640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:27.033 INFO:teuthology.orchestra.run.smithi045.stdout: -1472> 2023-10-03T19:19:51.432+0000 7fd1a1468640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:27.033 INFO:teuthology.orchestra.run.smithi045.stdout: -1471> 2023-10-03T19:19:51.500+0000 7fd1a346c640 5 mds.beacon.a Sending beacon up:active seq 6 2023-10-03T19:21:27.034 INFO:teuthology.orchestra.run.smithi045.stdout: -1470> 2023-10-03T19:19:51.500+0000 7fd1a346c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:27.034 INFO:teuthology.orchestra.run.smithi045.stdout: -1469> 2023-10-03T19:19:51.500+0000 7fd1a346c640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mdsbeacon(7155/a up:active seq=6 v50) v8 -- 0x556318a65b80 con 0x556317aaf800 2023-10-03T19:21:27.034 INFO:teuthology.orchestra.run.smithi045.stdout: -1468> 2023-10-03T19:19:51.500+0000 7fd1a346c640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:27.034 INFO:teuthology.orchestra.run.smithi045.stdout: -1467> 2023-10-03T19:19:51.500+0000 7fd1a8476640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 55 ==== mdsbeacon(7155/a up:active seq=6 v50) v8 ==== 130+0+0 (secure 0 0 0) 0x556318a658c0 con 0x556317aaf800 2023-10-03T19:21:27.034 INFO:teuthology.orchestra.run.smithi045.stdout: -1466> 2023-10-03T19:19:51.500+0000 7fd1a8476640 5 mds.beacon.a received beacon reply up:active seq 6 rtt 0 2023-10-03T19:21:27.034 INFO:teuthology.orchestra.run.smithi045.stdout: -1465> 2023-10-03T19:19:51.500+0000 7fd1a346c640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:27.034 INFO:teuthology.orchestra.run.smithi045.stdout: -1464> 2023-10-03T19:19:51.864+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7335 172.21.15.146:0/990159870 6 ==== client_request(client.7335:2 setattr mode=041777 #0x1 2023-10-03T19:19:51.867949+0000 caller_uid=0, caller_gid=0{0,}) v6 ==== 208+0+0 (crc 0 0 0) 0x556318ac8000 con 0x556318b59000 2023-10-03T19:21:27.034 INFO:teuthology.orchestra.run.smithi045.stdout: -1463> 2023-10-03T19:19:51.864+0000 7fd1a5470640 4 mds.0.server handle_client_request client_request(client.7335:2 setattr mode=041777 #0x1 2023-10-03T19:19:51.867949+0000 caller_uid=0, caller_gid=0{0,}) v6 2023-10-03T19:21:27.034 INFO:teuthology.orchestra.run.smithi045.stdout: -1462> 2023-10-03T19:19:51.864+0000 7fd1a5470640 20 mds.0.48 get_session have 0x556318a4b700 client.7335 172.21.15.146:0/990159870 state open 2023-10-03T19:21:27.034 INFO:teuthology.orchestra.run.smithi045.stdout: -1461> 2023-10-03T19:19:51.864+0000 7fd1a5470640 15 mds.0.server oldest_client_tid=2 2023-10-03T19:21:27.034 INFO:teuthology.orchestra.run.smithi045.stdout: -1460> 2023-10-03T19:19:51.864+0000 7fd1a5470640 7 mds.0.cache request_start request(client.7335:2 nref=2 cr=0x556318ac8000) 2023-10-03T19:21:27.035 INFO:teuthology.orchestra.run.smithi045.stdout: -1459> 2023-10-03T19:19:51.864+0000 7fd1a5470640 10 mds.0.locker process_request_cap_release client.7335 pLsXsFs on [inode 0x1 [...2,head] / auth v1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) caps={7335=pAsLsXsFs/-@1} | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.035 INFO:teuthology.orchestra.run.smithi045.stdout: -1458> 2023-10-03T19:19:51.864+0000 7fd1a5470640 10 mds.0.locker wanted - -> - 2023-10-03T19:21:27.035 INFO:teuthology.orchestra.run.smithi045.stdout: -1457> 2023-10-03T19:19:51.864+0000 7fd1a5470640 10 mds.0.locker eval 3648 [inode 0x1 [...2,head] / auth v1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) caps={7335=pLsXsFs/-@1} | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.035 INFO:teuthology.orchestra.run.smithi045.stdout: -1456> 2023-10-03T19:19:51.864+0000 7fd1a5470640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile sync) on [inode 0x1 [...2,head] / auth v1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) caps={7335=pLsXsFs/-@1} | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.035 INFO:teuthology.orchestra.run.smithi045.stdout: -1455> 2023-10-03T19:19:51.864+0000 7fd1a5470640 10 mds.0.locker simple_eval (iauth sync) on [inode 0x1 [...2,head] / auth v1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) caps={7335=pLsXsFs/-@1} | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.035 INFO:teuthology.orchestra.run.smithi045.stdout: -1454> 2023-10-03T19:19:51.864+0000 7fd1a5470640 10 mds.0.locker simple_eval (ilink sync) on [inode 0x1 [...2,head] / auth v1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) caps={7335=pLsXsFs/-@1} | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.035 INFO:teuthology.orchestra.run.smithi045.stdout: -1453> 2023-10-03T19:19:51.864+0000 7fd1a5470640 10 mds.0.locker simple_eval (ixattr sync) on [inode 0x1 [...2,head] / auth v1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) caps={7335=pLsXsFs/-@1} | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.035 INFO:teuthology.orchestra.run.smithi045.stdout: -1452> 2023-10-03T19:19:51.864+0000 7fd1a5470640 10 mds.0.locker eval done 2023-10-03T19:21:27.035 INFO:teuthology.orchestra.run.smithi045.stdout: -1451> 2023-10-03T19:19:51.864+0000 7fd1a5470640 7 mds.0.server dispatch_client_request client_request(client.7335:2 setattr mode=041777 #0x1 2023-10-03T19:19:51.867949+0000 caller_uid=0, caller_gid=0{0,}) v6 2023-10-03T19:21:27.035 INFO:teuthology.orchestra.run.smithi045.stdout: -1450> 2023-10-03T19:19:51.864+0000 7fd1a5470640 10 mds.0.server rdlock_path_pin_ref request(client.7335:2 nref=2 cr=0x556318ac8000) #0x1 2023-10-03T19:21:27.036 INFO:teuthology.orchestra.run.smithi045.stdout: -1449> 2023-10-03T19:19:51.864+0000 7fd1a5470640 7 mds.0.cache traverse: opening base ino 0x1 snap head 2023-10-03T19:21:27.036 INFO:teuthology.orchestra.run.smithi045.stdout: -1448> 2023-10-03T19:19:51.864+0000 7fd1a5470640 10 mds.0.locker try_rdlock_snap_layout request(client.7335:2 nref=3 cr=0x556318ac8000) [inode 0x1 [...2,head] / auth v1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) caps={7335=pLsXsFs/-@1} | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.036 INFO:teuthology.orchestra.run.smithi045.stdout: -1447> 2023-10-03T19:19:51.864+0000 7fd1a5470640 20 mds.0.locker got rdlock on (isnap sync r=1) [inode 0x1 [...2,head] / auth v1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@1} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.036 INFO:teuthology.orchestra.run.smithi045.stdout: -1446> 2023-10-03T19:19:51.864+0000 7fd1a5470640 10 mds.0.cache path_traverse finish on snapid head 2023-10-03T19:21:27.036 INFO:teuthology.orchestra.run.smithi045.stdout: -1445> 2023-10-03T19:19:51.864+0000 7fd1a5470640 10 mds.0.server ref is [inode 0x1 [...2,head] / auth v1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@1} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.036 INFO:teuthology.orchestra.run.smithi045.stdout: -1444> 2023-10-03T19:19:51.864+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) auth_pin by 0x556318b59400 on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@1} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x556317b3c680] now 1 2023-10-03T19:21:27.036 INFO:teuthology.orchestra.run.smithi045.stdout: -1443> 2023-10-03T19:19:51.864+0000 7fd1a5470640 10 mds.0.locker acquire_locks request(client.7335:2 nref=2 cr=0x556318ac8000) 2023-10-03T19:21:27.036 INFO:teuthology.orchestra.run.smithi045.stdout: -1442> 2023-10-03T19:19:51.864+0000 7fd1a5470640 20 mds.0.locker must xlock (iauth sync) [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.036 INFO:teuthology.orchestra.run.smithi045.stdout: -1441> 2023-10-03T19:19:51.864+0000 7fd1a5470640 20 mds.0.locker must wrlock (iversion lock) [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.036 INFO:teuthology.orchestra.run.smithi045.stdout: -1440> 2023-10-03T19:19:51.864+0000 7fd1a5470640 10 mds.0.locker must authpin [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.036 INFO:teuthology.orchestra.run.smithi045.stdout: -1439> 2023-10-03T19:19:51.864+0000 7fd1a5470640 10 mds.0.locker already auth_pinned [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.037 INFO:teuthology.orchestra.run.smithi045.stdout: -1438> 2023-10-03T19:19:51.864+0000 7fd1a5470640 7 mds.0.locker xlock_start on (iauth sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.037 INFO:teuthology.orchestra.run.smithi045.stdout: -1437> 2023-10-03T19:19:51.864+0000 7fd1a5470640 7 mds.0.locker simple_lock on (iauth sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.037 INFO:teuthology.orchestra.run.smithi045.stdout: -1436> 2023-10-03T19:19:51.864+0000 7fd1a5470640 7 mds.0.locker simple_xlock on (iauth lock) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth lock) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.037 INFO:teuthology.orchestra.run.smithi045.stdout: -1435> 2023-10-03T19:19:51.864+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) auth_pin by 0x556317b3c910 on [inode 0x1 [...2,head] / auth v1 ap=2 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth lock) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x556317b3c680] now 2 2023-10-03T19:21:27.037 INFO:teuthology.orchestra.run.smithi045.stdout: -1434> 2023-10-03T19:19:51.864+0000 7fd1a5470640 10 mds.0.locker got xlock on (iauth xlock x=1 by 0x556318b59400) [inode 0x1 [...2,head] / auth v1 ap=2 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth xlock x=1 by 0x556318b59400) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@1} | request=1 lock=2 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.037 INFO:teuthology.orchestra.run.smithi045.stdout: -1433> 2023-10-03T19:19:51.864+0000 7fd1a5470640 7 mds.0.locker local_wrlock_start on (iversion lock) on [inode 0x1 [...2,head] / auth v1 ap=2 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth xlock x=1 by 0x556318b59400) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@1} | request=1 lock=2 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.037 INFO:teuthology.orchestra.run.smithi045.stdout: -1432> 2023-10-03T19:19:51.864+0000 7fd1a5470640 10 mds.0.locker got wrlock on (iversion lock w=1 last_client=7335) [inode 0x1 [...2,head] / auth v1 ap=2 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth xlock x=1 by 0x556318b59400) (isnap sync r=1) (iversion lock w=1 last_client=7335) caps={7335=pLsXsFs/-@1} | request=1 lock=3 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.037 INFO:teuthology.orchestra.run.smithi045.stdout: -1431> 2023-10-03T19:19:51.864+0000 7fd1a5470640 20 Session check_access path 2023-10-03T19:21:27.037 INFO:teuthology.orchestra.run.smithi045.stdout: -1430> 2023-10-03T19:19:51.864+0000 7fd1a5470640 15 mds.0.cache.ino(0x1) project_inode 0x1 2023-10-03T19:21:27.038 INFO:teuthology.orchestra.run.smithi045.stdout: -1429> 2023-10-03T19:19:51.864+0000 7fd1a5470640 10 mds.0.server journal_and_reply tracei 0x556317b3c680 tracedn 0 2023-10-03T19:21:27.038 INFO:teuthology.orchestra.run.smithi045.stdout: -1428> 2023-10-03T19:19:51.864+0000 7fd1a5470640 10 mds.0.locker set_xlocks_done on (iauth xlock x=1 by 0x556318b59400) [inode 0x1 [...2,head] / auth v1 pv2 ap=2 snaprealm=0x556317c178c0 f()->f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1)->n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth xlock x=1 by 0x556318b59400) (isnap sync r=1) (iversion lock w=1 last_client=7335) caps={7335=pLsXsFs/-@1} | request=1 lock=3 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.038 INFO:teuthology.orchestra.run.smithi045.stdout: -1427> 2023-10-03T19:19:51.864+0000 7fd1a5470640 10 mds.0.server early_reply 0 ((0) Success) client_request(client.7335:2 setattr mode=041777 #0x1 2023-10-03T19:19:51.867949+0000 caller_uid=0, caller_gid=0{0,}) v6 2023-10-03T19:21:27.038 INFO:teuthology.orchestra.run.smithi045.stdout: -1426> 2023-10-03T19:19:51.864+0000 7fd1a5470640 20 mds.0.server set_trace_dist snapid head 2023-10-03T19:21:27.038 INFO:teuthology.orchestra.run.smithi045.stdout: -1425> 2023-10-03T19:19:51.864+0000 7fd1a5470640 10 mds.0.server set_trace_dist snaprealm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:19:39.424362+0000 change_attr 0 0x556317c178c0) len=70 2023-10-03T19:21:27.038 INFO:teuthology.orchestra.run.smithi045.stdout: -1424> 2023-10-03T19:19:51.864+0000 7fd1a5470640 20 mds.0.cache.ino(0x1) pfile 0 pauth 1 plink 0 pxattr 0 plocal 1 mtime 2023-10-03T19:19:39.424362+0000 ctime 2023-10-03T19:19:51.867949+0000 change_attr 1 valid=1 2023-10-03T19:21:27.038 INFO:teuthology.orchestra.run.smithi045.stdout: -1423> 2023-10-03T19:19:51.864+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) encode_inodestat issuing pLsXsFs seq 2 2023-10-03T19:21:27.038 INFO:teuthology.orchestra.run.smithi045.stdout: -1422> 2023-10-03T19:19:51.864+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) encode_inodestat caps pLsXsFs seq 2 mseq 0 xattrv 0 2023-10-03T19:21:27.038 INFO:teuthology.orchestra.run.smithi045.stdout: -1421> 2023-10-03T19:19:51.864+0000 7fd1a5470640 20 mds.0.server set_trace_dist added snap head in [inode 0x1 [...2,head] / auth v1 pv2 ap=2 snaprealm=0x556317c178c0 f()->f() n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1)->n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth xlockdone x=1) (isnap sync r=1) (iversion lock w=1 last_client=7335) caps={7335=pLsXsFs/-@2} | request=1 lock=3 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.038 INFO:teuthology.orchestra.run.smithi045.stdout: -1420> 2023-10-03T19:19:51.864+0000 7fd1a5470640 10 mds.0.48 send_message_client client.7335 172.21.15.146:0/990159870 client_reply(???:2 = 0 (0) Success unsafe) v1 2023-10-03T19:21:27.039 INFO:teuthology.orchestra.run.smithi045.stdout: -1419> 2023-10-03T19:19:51.864+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> 172.21.15.146:0/990159870 -- client_reply(???:2 = 0 (0) Success unsafe) v1 -- 0x556317aef6c0 con 0x556318b59000 2023-10-03T19:21:27.039 INFO:teuthology.orchestra.run.smithi045.stdout: -1418> 2023-10-03T19:19:51.864+0000 7fd1a5470640 20 mds.0.server lat 0.000537 2023-10-03T19:21:27.039 INFO:teuthology.orchestra.run.smithi045.stdout: -1417> 2023-10-03T19:19:51.864+0000 7fd19ec63640 5 mds.0.log _submit_thread 4195636~795 : EUpdate setattr [metablob] 2023-10-03T19:21:27.039 INFO:teuthology.orchestra.run.smithi045.stdout: -1416> 2023-10-03T19:19:52.012+0000 7fd1a7c75640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7335 172.21.15.146:0/990159870 7 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.002100, avg_latency: 0.001050, sq_sum: 112619257824, count=2][client_metric_type: CAP_INFO cap_hits: 4 cap_misses: 2 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x556318a8de40 con 0x556318b59000 2023-10-03T19:21:27.039 INFO:teuthology.orchestra.run.smithi045.stdout: -1415> 2023-10-03T19:19:52.012+0000 7fd1a7c75640 20 mds.0.48 get_session have 0x556318a4b700 client.7335 172.21.15.146:0/990159870 state open 2023-10-03T19:21:27.039 INFO:teuthology.orchestra.run.smithi045.stdout: -1414> 2023-10-03T19:19:52.012+0000 7fd1a7c75640 20 handle_client_metrics: mds.metrics: session=0x556318a4b700 2023-10-03T19:21:27.039 INFO:teuthology.orchestra.run.smithi045.stdout: -1413> 2023-10-03T19:19:52.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=READ_LATENCY, session=0x556318a4b700, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:27.039 INFO:teuthology.orchestra.run.smithi045.stdout: -1412> 2023-10-03T19:19:52.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=WRITE_LATENCY, session=0x556318a4b700, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:27.039 INFO:teuthology.orchestra.run.smithi045.stdout: -1411> 2023-10-03T19:19:52.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=METADATA_LATENCY, session=0x556318a4b700, latency=0.002100, avg=0.001050, sq_sum=112619257824, count=2 2023-10-03T19:21:27.039 INFO:teuthology.orchestra.run.smithi045.stdout: -1410> 2023-10-03T19:19:52.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=CAP_INFO, session=0x556318a4b700, hits=4, misses=2 2023-10-03T19:21:27.039 INFO:teuthology.orchestra.run.smithi045.stdout: -1409> 2023-10-03T19:19:52.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=DENTRY_LEASE, session=0x556318a4b700, hits=0, misses=0 2023-10-03T19:21:27.040 INFO:teuthology.orchestra.run.smithi045.stdout: -1408> 2023-10-03T19:19:52.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=OPENED_FILES, session=0x556318a4b700, opened_files=0, total_inodes=1 2023-10-03T19:21:27.040 INFO:teuthology.orchestra.run.smithi045.stdout: -1407> 2023-10-03T19:19:52.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=PINNED_ICAPS, session=0x556318a4b700, pinned_icaps=1, total_inodes=1 2023-10-03T19:21:27.040 INFO:teuthology.orchestra.run.smithi045.stdout: -1406> 2023-10-03T19:19:52.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=OPENED_INODES, session=0x556318a4b700, opened_inodes=0, total_inodes=1 2023-10-03T19:21:27.040 INFO:teuthology.orchestra.run.smithi045.stdout: -1405> 2023-10-03T19:19:52.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=READ_IO_SIZES, session=0x556318a4b700, total_ops=0, total_size=0 2023-10-03T19:21:27.040 INFO:teuthology.orchestra.run.smithi045.stdout: -1404> 2023-10-03T19:19:52.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=WRITE_IO_SIZES, session=0x556318a4b700, total_ops=0, total_size=0 2023-10-03T19:21:27.040 INFO:teuthology.orchestra.run.smithi045.stdout: -1403> 2023-10-03T19:19:52.064+0000 7fd1a446e640 10 monclient: tick 2023-10-03T19:21:27.040 INFO:teuthology.orchestra.run.smithi045.stdout: -1402> 2023-10-03T19:19:52.064+0000 7fd1a446e640 10 monclient: _check_auth_tickets 2023-10-03T19:21:27.040 INFO:teuthology.orchestra.run.smithi045.stdout: -1401> 2023-10-03T19:19:52.064+0000 7fd1a446e640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:22.070243+0000) 2023-10-03T19:21:27.040 INFO:teuthology.orchestra.run.smithi045.stdout: -1400> 2023-10-03T19:19:52.432+0000 7fd1a1468640 2 mds.0.cache Memory usage: total 274132, rss 37544, heap 207144, baseline 190760, 1 / 13 inodes have caps, 1 caps, 0.0769231 caps per inode 2023-10-03T19:21:27.040 INFO:teuthology.orchestra.run.smithi045.stdout: -1399> 2023-10-03T19:19:52.432+0000 7fd1a1468640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999984920s ago 2023-10-03T19:21:27.041 INFO:teuthology.orchestra.run.smithi045.stdout: -1398> 2023-10-03T19:19:52.432+0000 7fd1a1468640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:27.041 INFO:teuthology.orchestra.run.smithi045.stdout: -1397> 2023-10-03T19:19:52.432+0000 7fd1a1468640 7 mds.0.cache trim bytes_used=51kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:27.041 INFO:teuthology.orchestra.run.smithi045.stdout: -1396> 2023-10-03T19:19:52.432+0000 7fd1a1468640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:27.041 INFO:teuthology.orchestra.run.smithi045.stdout: -1395> 2023-10-03T19:19:52.432+0000 7fd1a1468640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:27.041 INFO:teuthology.orchestra.run.smithi045.stdout: -1394> 2023-10-03T19:19:52.432+0000 7fd1a1468640 7 mds.0.server recall_client_state: min=100 max=1048576 total=1 flags=0xa 2023-10-03T19:21:27.041 INFO:teuthology.orchestra.run.smithi045.stdout: -1393> 2023-10-03T19:19:52.432+0000 7fd1a1468640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:27.041 INFO:teuthology.orchestra.run.smithi045.stdout: -1392> 2023-10-03T19:19:52.432+0000 7fd1a1468640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:27.041 INFO:teuthology.orchestra.run.smithi045.stdout: -1391> 2023-10-03T19:19:52.436+0000 7fd19e462640 20 update_rank0: mds.metrics 2023-10-03T19:21:27.041 INFO:teuthology.orchestra.run.smithi045.stdout: -1390> 2023-10-03T19:19:52.436+0000 7fd19e462640 20 update_rank0: mds.metrics: sending metric updates for 1 clients to rank 0 (address: [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487]) with sequence number 2, last updated sequence number 4 2023-10-03T19:21:27.042 INFO:teuthology.orchestra.run.smithi045.stdout: -1389> 2023-10-03T19:19:52.436+0000 7fd19e462640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] send_to--> mds [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mds_metrics from rank=0 carrying 1 metric updates v1 -- ?+0 0x5563188ef980 2023-10-03T19:21:27.042 INFO:teuthology.orchestra.run.smithi045.stdout: -1388> 2023-10-03T19:19:52.436+0000 7fd19e462640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mds_metrics from rank=0 carrying 1 metric updates v1 -- 0x5563188ef980 con 0x556317aafc00 2023-10-03T19:21:27.042 INFO:teuthology.orchestra.run.smithi045.stdout: -1387> 2023-10-03T19:19:52.436+0000 7fd1a4c6f640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mds.0 v2:172.21.15.45:6834/3401546487 0 ==== mds_metrics from rank=0 carrying 1 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x5563188ef980 con 0x556317aafc00 2023-10-03T19:21:27.042 INFO:teuthology.orchestra.run.smithi045.stdout: -1386> 2023-10-03T19:19:52.436+0000 7fd1a4c6f640 20 mds.metric.aggregator handle_mds_metrics: applying 1 updates for rank=0 with sequence number 2 2023-10-03T19:21:27.042 INFO:teuthology.orchestra.run.smithi045.stdout: -1385> 2023-10-03T19:19:52.436+0000 7fd1a4c6f640 10 mds.pinger pong_received: rank=0, sequence=2 2023-10-03T19:21:27.042 INFO:teuthology.orchestra.run.smithi045.stdout: -1384> 2023-10-03T19:19:52.436+0000 7fd1a4c6f640 20 mds.metric.aggregator refresh_metrics_for_rank: client=client.7335 172.21.15.146:0/990159870, rank=0, metrics=[update_type=0, metrics={cap_hit_metric={hits=4, misses=2}, read_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, write_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, metadata_latency={latency=0.002100, avg_latency=0.001050, sq_sum=112619257824, count=2}, dentry_lease={hits=0, misses=0}, opened_files_metric={opened_files=0, total_inodes=1}, pinned_icaps_metric={pinned_icaps=1, total_inodes=1}, opened_inodes_metric={opened_inodes=0, total_inodes=1}, read_io_sizes_metric={total_ops=0, total_size=0}, write_io_sizes_metric={total_ops=0, total_size=0}}] 2023-10-03T19:21:27.042 INFO:teuthology.orchestra.run.smithi045.stdout: -1383> 2023-10-03T19:19:53.012+0000 7fd1a7c75640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7335 172.21.15.146:0/990159870 8 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.002100, avg_latency: 0.001050, sq_sum: 112619257824, count=2][client_metric_type: CAP_INFO cap_hits: 4 cap_misses: 2 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x556318a8de40 con 0x556318b59000 2023-10-03T19:21:27.042 INFO:teuthology.orchestra.run.smithi045.stdout: -1382> 2023-10-03T19:19:53.012+0000 7fd1a7c75640 20 mds.0.48 get_session have 0x556318a4b700 client.7335 172.21.15.146:0/990159870 state open 2023-10-03T19:21:27.042 INFO:teuthology.orchestra.run.smithi045.stdout: -1381> 2023-10-03T19:19:53.012+0000 7fd1a7c75640 20 handle_client_metrics: mds.metrics: session=0x556318a4b700 2023-10-03T19:21:27.043 INFO:teuthology.orchestra.run.smithi045.stdout: -1380> 2023-10-03T19:19:53.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=READ_LATENCY, session=0x556318a4b700, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:27.043 INFO:teuthology.orchestra.run.smithi045.stdout: -1379> 2023-10-03T19:19:53.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=WRITE_LATENCY, session=0x556318a4b700, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:27.043 INFO:teuthology.orchestra.run.smithi045.stdout: -1378> 2023-10-03T19:19:53.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=METADATA_LATENCY, session=0x556318a4b700, latency=0.002100, avg=0.001050, sq_sum=112619257824, count=2 2023-10-03T19:21:27.043 INFO:teuthology.orchestra.run.smithi045.stdout: -1377> 2023-10-03T19:19:53.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=CAP_INFO, session=0x556318a4b700, hits=4, misses=2 2023-10-03T19:21:27.043 INFO:teuthology.orchestra.run.smithi045.stdout: -1376> 2023-10-03T19:19:53.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=DENTRY_LEASE, session=0x556318a4b700, hits=0, misses=0 2023-10-03T19:21:27.043 INFO:teuthology.orchestra.run.smithi045.stdout: -1375> 2023-10-03T19:19:53.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=OPENED_FILES, session=0x556318a4b700, opened_files=0, total_inodes=1 2023-10-03T19:21:27.043 INFO:teuthology.orchestra.run.smithi045.stdout: -1374> 2023-10-03T19:19:53.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=PINNED_ICAPS, session=0x556318a4b700, pinned_icaps=1, total_inodes=1 2023-10-03T19:21:27.043 INFO:teuthology.orchestra.run.smithi045.stdout: -1373> 2023-10-03T19:19:53.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=OPENED_INODES, session=0x556318a4b700, opened_inodes=0, total_inodes=1 2023-10-03T19:21:27.043 INFO:teuthology.orchestra.run.smithi045.stdout: -1372> 2023-10-03T19:19:53.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=READ_IO_SIZES, session=0x556318a4b700, total_ops=0, total_size=0 2023-10-03T19:21:27.043 INFO:teuthology.orchestra.run.smithi045.stdout: -1371> 2023-10-03T19:19:53.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=WRITE_IO_SIZES, session=0x556318a4b700, total_ops=0, total_size=0 2023-10-03T19:21:27.043 INFO:teuthology.orchestra.run.smithi045.stdout: -1370> 2023-10-03T19:19:53.064+0000 7fd1a446e640 10 monclient: tick 2023-10-03T19:21:27.044 INFO:teuthology.orchestra.run.smithi045.stdout: -1369> 2023-10-03T19:19:53.064+0000 7fd1a446e640 10 monclient: _check_auth_tickets 2023-10-03T19:21:27.044 INFO:teuthology.orchestra.run.smithi045.stdout: -1368> 2023-10-03T19:19:53.064+0000 7fd1a446e640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:23.070411+0000) 2023-10-03T19:21:27.044 INFO:teuthology.orchestra.run.smithi045.stdout: -1367> 2023-10-03T19:19:53.188+0000 7fd1a8c77640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> conn(0x556318b84000 0x556318b92000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).accept 2023-10-03T19:21:27.044 INFO:teuthology.orchestra.run.smithi045.stdout: -1366> 2023-10-03T19:19:53.188+0000 7fd1a8c77640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> conn(0x556318b84000 0x556318b92000 unknown :-1 s=BANNER_ACCEPTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:27.044 INFO:teuthology.orchestra.run.smithi045.stdout: -1365> 2023-10-03T19:19:53.188+0000 7fd1a8c77640 10 monclient: handle_auth_request added challenge on 0x556318b84000 2023-10-03T19:21:27.044 INFO:teuthology.orchestra.run.smithi045.stdout: -1364> 2023-10-03T19:19:53.188+0000 7fd1a8c77640 10 mds.a parse_caps: parsing auth_cap_str='allow' 2023-10-03T19:21:27.044 INFO:teuthology.orchestra.run.smithi045.stdout: -1363> 2023-10-03T19:19:53.188+0000 7fd1a8c77640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> 172.21.15.172:0/3138699255 conn(0x556318b84000 0x556318b92000 crc :-1 s=READY pgs=4 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=client.7350 client_cookie=27125b4cb00734fd server_cookie=e13deccecc17d85e in_seq=0 out_seq=0 2023-10-03T19:21:27.044 INFO:teuthology.orchestra.run.smithi045.stdout: -1362> 2023-10-03T19:19:53.188+0000 7fd1a5470640 10 mds.a new session 0x556318a78a00 for client.7350 172.21.15.172:0/3138699255 con 0x556318b84000 2023-10-03T19:21:27.044 INFO:teuthology.orchestra.run.smithi045.stdout: -1361> 2023-10-03T19:19:53.188+0000 7fd1a5470640 10 mds.a parse_caps: parsing auth_cap_str='allow' 2023-10-03T19:21:27.044 INFO:teuthology.orchestra.run.smithi045.stdout: -1360> 2023-10-03T19:19:53.188+0000 7fd1a5470640 10 mds.a ms_handle_accept 172.21.15.172:0/3138699255 con 0x556318b84000 session 0x556318a78a00 2023-10-03T19:21:27.044 INFO:teuthology.orchestra.run.smithi045.stdout: -1359> 2023-10-03T19:19:53.188+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7350 172.21.15.172:0/3138699255 1 ==== client_session(request_open) v5 ==== 349+0+0 (crc 0 0 0) 0x556317aefdc0 con 0x556318b84000 2023-10-03T19:21:27.045 INFO:teuthology.orchestra.run.smithi045.stdout: -1358> 2023-10-03T19:19:53.188+0000 7fd1a5470640 20 mds.0.48 get_session have 0x556318a78a00 client.7350 172.21.15.172:0/3138699255 state closed 2023-10-03T19:21:27.045 INFO:teuthology.orchestra.run.smithi045.stdout: -1357> 2023-10-03T19:19:53.188+0000 7fd1a5470640 3 mds.0.server handle_client_session client_session(request_open) v5 from client.7350 2023-10-03T19:21:27.045 INFO:teuthology.orchestra.run.smithi045.stdout: -1356> 2023-10-03T19:19:53.188+0000 7fd1a5470640 20 mds.0.server handle_client_session CEPH_SESSION_REQUEST_OPEN metadata entries: 2023-10-03T19:21:27.045 INFO:teuthology.orchestra.run.smithi045.stdout: -1355> 2023-10-03T19:19:53.188+0000 7fd1a5470640 20 mds.0.server features: '0x00000000000fffff' 2023-10-03T19:21:27.045 INFO:teuthology.orchestra.run.smithi045.stdout: -1354> 2023-10-03T19:19:53.188+0000 7fd1a5470640 20 mds.0.server metric specification: [{metric_flags: '0x000000000000ffff'}] 2023-10-03T19:21:27.045 INFO:teuthology.orchestra.run.smithi045.stdout: -1353> 2023-10-03T19:19:53.188+0000 7fd1a5470640 20 mds.0.server ceph_sha1: 05a43c8fb3988914c879a50970f9054a098e0612 2023-10-03T19:21:27.045 INFO:teuthology.orchestra.run.smithi045.stdout: -1352> 2023-10-03T19:19:53.188+0000 7fd1a5470640 20 mds.0.server ceph_version: ceph version 18.0.0-3908-g05a43c8f (05a43c8fb3988914c879a50970f9054a098e0612) reef (dev) 2023-10-03T19:21:27.045 INFO:teuthology.orchestra.run.smithi045.stdout: -1351> 2023-10-03T19:19:53.188+0000 7fd1a5470640 20 mds.0.server entity_id: 1 2023-10-03T19:21:27.061 INFO:teuthology.orchestra.run.smithi045.stdout: -1350> 2023-10-03T19:19:53.188+0000 7fd1a5470640 20 mds.0.server hostname: smithi172 2023-10-03T19:21:27.061 INFO:teuthology.orchestra.run.smithi045.stdout: -1349> 2023-10-03T19:19:53.188+0000 7fd1a5470640 20 mds.0.server mount_point: /home/ubuntu/cephtest/mnt.1 2023-10-03T19:21:27.061 INFO:teuthology.orchestra.run.smithi045.stdout: -1348> 2023-10-03T19:19:53.188+0000 7fd1a5470640 20 mds.0.server pid: 33416 2023-10-03T19:21:27.061 INFO:teuthology.orchestra.run.smithi045.stdout: -1347> 2023-10-03T19:19:53.188+0000 7fd1a5470640 20 mds.0.server root: / 2023-10-03T19:21:27.061 INFO:teuthology.orchestra.run.smithi045.stdout: -1346> 2023-10-03T19:19:53.188+0000 7fd1a5470640 10 mds.0.sessionmap add_session s=0x556318a78a00 name=client.7350 2023-10-03T19:21:27.061 INFO:teuthology.orchestra.run.smithi045.stdout: -1345> 2023-10-03T19:19:53.188+0000 7fd1a5470640 20 mds.0.sessionmap mark_projected s=0x556318a78a00 name=client.7350 pv=1 -> 2 2023-10-03T19:21:27.061 INFO:teuthology.orchestra.run.smithi045.stdout: -1344> 2023-10-03T19:19:53.188+0000 7fd1a5470640 10 mds.0.sessionmap touch_session s=0x556318a78a00 name=client.7350 2023-10-03T19:21:27.061 INFO:teuthology.orchestra.run.smithi045.stdout: -1343> 2023-10-03T19:19:53.188+0000 7fd19ec63640 5 mds.0.log _submit_thread 4196451~420 : ESession client.7350 172.21.15.172:0/3138699255 open cmapv 2 2023-10-03T19:21:27.061 INFO:teuthology.orchestra.run.smithi045.stdout: -1342> 2023-10-03T19:19:53.188+0000 7fd19ec63640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.48:41 15.14 15:2e2fa760:::200.00000001:head [write 1332~1255 [fadvise_dontneed] in=1255b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e98) v8 -- 0x556318900700 con 0x5563189cc400 2023-10-03T19:21:27.061 INFO:teuthology.orchestra.run.smithi045.stdout: -1341> 2023-10-03T19:19:53.192+0000 7fd1a8c77640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.6 v2:172.21.15.79:6819/1486010128 9 ==== osd_op_reply(41 200.00000001 [write 1332~1255 [fadvise_dontneed]] v98'8 uv8 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x556318aaf440 con 0x5563189cc400 2023-10-03T19:21:27.062 INFO:teuthology.orchestra.run.smithi045.stdout: -1340> 2023-10-03T19:19:53.192+0000 7fd19f464640 10 MDSIOContextBase::complete: 25C_MDS_inode_update_finish 2023-10-03T19:21:27.062 INFO:teuthology.orchestra.run.smithi045.stdout: -1339> 2023-10-03T19:19:53.192+0000 7fd19f464640 10 MDSContext::complete: 25C_MDS_inode_update_finish 2023-10-03T19:21:27.062 INFO:teuthology.orchestra.run.smithi045.stdout: -1338> 2023-10-03T19:19:53.192+0000 7fd19f464640 15 mds.0.cache.ino(0x1) pop_and_dirty_projected_inode v2 2023-10-03T19:21:27.062 INFO:teuthology.orchestra.run.smithi045.stdout: -1337> 2023-10-03T19:19:53.192+0000 7fd19f464640 10 mds.0.cache.ino(0x1) mark_dirty [inode 0x1 [...2,head] / auth v2 ap=2 snaprealm=0x556317c178c0 f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth xlockdone x=1) (isnap sync r=1) (iversion lock w=1 last_client=7335) caps={7335=pLsXsFs/-@2} | request=1 lock=3 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.062 INFO:teuthology.orchestra.run.smithi045.stdout: -1336> 2023-10-03T19:19:53.192+0000 7fd19f464640 10 mds.0.cache.ino(0x1) mark_dirty_parent 2023-10-03T19:21:27.062 INFO:teuthology.orchestra.run.smithi045.stdout: -1335> 2023-10-03T19:19:53.192+0000 7fd19f464640 7 mds.0.server reply_client_request 0 ((0) Success) client_request(client.7335:2 setattr mode=041777 #0x1 2023-10-03T19:19:51.867949+0000 caller_uid=0, caller_gid=0{0,}) v6 2023-10-03T19:21:27.062 INFO:teuthology.orchestra.run.smithi045.stdout: -1334> 2023-10-03T19:19:53.192+0000 7fd19f464640 10 mds.0.server apply_allocated_inos 0x0 / [] / 0x0 2023-10-03T19:21:27.062 INFO:teuthology.orchestra.run.smithi045.stdout: -1333> 2023-10-03T19:19:53.192+0000 7fd19f464640 7 mds.0.locker local_wrlock_finish on (iversion lock w=1 last_client=7335) on [inode 0x1 [...2,head] / auth v2 ap=2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth xlockdone x=1) (isnap sync r=1) (iversion lock w=1 last_client=7335) caps={7335=pLsXsFs/-@2} | request=1 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.062 INFO:teuthology.orchestra.run.smithi045.stdout: -1332> 2023-10-03T19:19:53.192+0000 7fd19f464640 10 mds.0.locker xlock_finish on (iauth xlockdone x=1) [inode 0x1 [...2,head] / auth v2 ap=2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth xlockdone x=1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2} | request=1 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.062 INFO:teuthology.orchestra.run.smithi045.stdout: -1331> 2023-10-03T19:19:53.192+0000 7fd19f464640 10 mds.0.locker eval_gather (iauth xlockdone) on [inode 0x1 [...2,head] / auth v2 ap=2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth xlockdone) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.062 INFO:teuthology.orchestra.run.smithi045.stdout: -1330> 2023-10-03T19:19:53.192+0000 7fd19f464640 10 mds.0.locker next state is sync issued/allows loner /s xlocker /s other /s 2023-10-03T19:21:27.063 INFO:teuthology.orchestra.run.smithi045.stdout: -1329> 2023-10-03T19:19:53.192+0000 7fd19f464640 7 mds.0.locker eval_gather finished gather on (iauth xlockdone) on [inode 0x1 [...2,head] / auth v2 ap=2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth xlockdone) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.063 INFO:teuthology.orchestra.run.smithi045.stdout: -1328> 2023-10-03T19:19:53.192+0000 7fd19f464640 10 mds.0.cache.ino(0x1) auth_unpin by 0x556317b3c910 on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] now 1 2023-10-03T19:21:27.063 INFO:teuthology.orchestra.run.smithi045.stdout: -1327> 2023-10-03T19:19:53.192+0000 7fd19f464640 10 mds.0.locker simple_eval (iauth sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.063 INFO:teuthology.orchestra.run.smithi045.stdout: -1326> 2023-10-03T19:19:53.192+0000 7fd19f464640 7 mds.0.locker get_allowed_caps allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.063 INFO:teuthology.orchestra.run.smithi045.stdout: -1325> 2023-10-03T19:19:53.192+0000 7fd19f464640 20 mds.0.locker client.7335 pending pLsXsFs allowed pAsLsXsFs wanted - 2023-10-03T19:21:27.063 INFO:teuthology.orchestra.run.smithi045.stdout: -1324> 2023-10-03T19:19:53.192+0000 7fd19f464640 10 mds.0.48 send_message_client client.7335 172.21.15.146:0/990159870 client_reply(???:2 = 0 (0) Success safe) v1 2023-10-03T19:21:27.063 INFO:teuthology.orchestra.run.smithi045.stdout: -1323> 2023-10-03T19:19:53.192+0000 7fd19f464640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> 172.21.15.146:0/990159870 -- client_reply(???:2 = 0 (0) Success safe) v1 -- 0x556317aee8c0 con 0x556318b59000 2023-10-03T19:21:27.063 INFO:teuthology.orchestra.run.smithi045.stdout: -1322> 2023-10-03T19:19:53.192+0000 7fd19f464640 7 mds.0.cache request_finish request(client.7335:2 nref=2 cr=0x556318ac8000) 2023-10-03T19:21:27.063 INFO:teuthology.orchestra.run.smithi045.stdout: -1321> 2023-10-03T19:19:53.192+0000 7fd19f464640 15 mds.0.cache request_cleanup request(client.7335:2 nref=2 cr=0x556318ac8000) 2023-10-03T19:21:27.063 INFO:teuthology.orchestra.run.smithi045.stdout: -1320> 2023-10-03T19:19:53.192+0000 7fd19f464640 7 mds.0.locker rdlock_finish on (isnap sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) caps={7335=pLsXsFs/-@2} | request=1 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.063 INFO:teuthology.orchestra.run.smithi045.stdout: -1319> 2023-10-03T19:19:53.192+0000 7fd19f464640 10 mds.0.locker simple_eval (isnap sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) caps={7335=pLsXsFs/-@2} | request=1 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.064 INFO:teuthology.orchestra.run.smithi045.stdout: -1318> 2023-10-03T19:19:53.192+0000 7fd19f464640 10 mds.0.cache.ino(0x1) auth_unpin by 0x556318b59400 on [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) caps={7335=pLsXsFs/-@2} | request=1 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] now 0 2023-10-03T19:21:27.064 INFO:teuthology.orchestra.run.smithi045.stdout: -1317> 2023-10-03T19:19:53.192+0000 7fd19f464640 10 MDSIOContextBase::complete: 20C_MDS_session_finish 2023-10-03T19:21:27.064 INFO:teuthology.orchestra.run.smithi045.stdout: -1316> 2023-10-03T19:19:53.192+0000 7fd19f464640 10 MDSContext::complete: 20C_MDS_session_finish 2023-10-03T19:21:27.064 INFO:teuthology.orchestra.run.smithi045.stdout: -1315> 2023-10-03T19:19:53.192+0000 7fd19f464640 10 mds.0.server _session_logged client.7350 172.21.15.172:0/3138699255 state_seq 1 open 2 inos_to_free [] inotablev 0 inos_to_purge [] 2023-10-03T19:21:27.064 INFO:teuthology.orchestra.run.smithi045.stdout: -1314> 2023-10-03T19:19:53.192+0000 7fd19f464640 20 mds.0.sessionmap mark_dirty s=0x556318a78a00 name=client.7350 v=1 2023-10-03T19:21:27.064 INFO:teuthology.orchestra.run.smithi045.stdout: -1313> 2023-10-03T19:19:53.192+0000 7fd19f464640 10 mds.0.sessionmap touch_session s=0x556318a78a00 name=client.7350 2023-10-03T19:21:27.064 INFO:teuthology.orchestra.run.smithi045.stdout: -1312> 2023-10-03T19:19:53.192+0000 7fd19f464640 10 add_session: mds.metrics: session=0x556318a78a00, client=client.7350 172.21.15.172:0/3138699255 2023-10-03T19:21:27.064 INFO:teuthology.orchestra.run.smithi045.stdout: -1311> 2023-10-03T19:19:53.192+0000 7fd19f464640 20 add_session: mds.metrics: metrics=[update_type=0, metrics={cap_hit_metric={hits=0, misses=0}, read_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, write_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, metadata_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, dentry_lease={hits=0, misses=0}, opened_files_metric={opened_files=0, total_inodes=0}, pinned_icaps_metric={pinned_icaps=0, total_inodes=0}, opened_inodes_metric={opened_inodes=0, total_inodes=0}, read_io_sizes_metric={total_ops=0, total_size=0}, write_io_sizes_metric={total_ops=0, total_size=0}}] 2023-10-03T19:21:27.064 INFO:teuthology.orchestra.run.smithi045.stdout: -1310> 2023-10-03T19:19:53.192+0000 7fd19f464640 10 mds.0.48 send_message_client client.7350 172.21.15.172:0/3138699255 client_session(open) v5 2023-10-03T19:21:27.064 INFO:teuthology.orchestra.run.smithi045.stdout: -1309> 2023-10-03T19:19:53.192+0000 7fd19f464640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> 172.21.15.172:0/3138699255 -- client_session(open) v5 -- 0x556317aeea80 con 0x556318b84000 2023-10-03T19:21:27.064 INFO:teuthology.orchestra.run.smithi045.stdout: -1308> 2023-10-03T19:19:53.192+0000 7fd19f464640 2 mds.0.server New client session: addr="172.21.15.172:0/3138699255",elapsed=0.004448,throttled=0.000015,status="ACCEPTED",root="/" 2023-10-03T19:21:27.065 INFO:teuthology.orchestra.run.smithi045.stdout: -1307> 2023-10-03T19:19:53.192+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7350 172.21.15.172:0/3138699255 2 ==== client_session(request_renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x556317aeea80 con 0x556318b84000 2023-10-03T19:21:27.065 INFO:teuthology.orchestra.run.smithi045.stdout: -1306> 2023-10-03T19:19:53.192+0000 7fd1a5470640 20 mds.0.48 get_session have 0x556318a78a00 client.7350 172.21.15.172:0/3138699255 state open 2023-10-03T19:21:27.065 INFO:teuthology.orchestra.run.smithi045.stdout: -1305> 2023-10-03T19:19:53.192+0000 7fd1a5470640 3 mds.0.server handle_client_session client_session(request_renewcaps seq 1) v1 from client.7350 2023-10-03T19:21:27.065 INFO:teuthology.orchestra.run.smithi045.stdout: -1304> 2023-10-03T19:19:53.192+0000 7fd1a5470640 10 mds.0.sessionmap touch_session s=0x556318a78a00 name=client.7350 2023-10-03T19:21:27.065 INFO:teuthology.orchestra.run.smithi045.stdout: -1303> 2023-10-03T19:19:53.192+0000 7fd1a5470640 10 mds.0.48 send_message_client client.7350 172.21.15.172:0/3138699255 client_session(renewcaps seq 1) v5 2023-10-03T19:21:27.065 INFO:teuthology.orchestra.run.smithi045.stdout: -1302> 2023-10-03T19:19:53.192+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> 172.21.15.172:0/3138699255 -- client_session(renewcaps seq 1) v5 -- 0x556317aef880 con 0x556318b84000 2023-10-03T19:21:27.065 INFO:teuthology.orchestra.run.smithi045.stdout: -1301> 2023-10-03T19:19:53.192+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7350 172.21.15.172:0/3138699255 3 ==== client_request(client.7350:1 getattr pAsLsXsFs #0x1 2023-10-03T19:19:53.193047+0000 caller_uid=0, caller_gid=0{}) v6 ==== 156+0+0 (crc 0 0 0) 0x556318ac8600 con 0x556318b84000 2023-10-03T19:21:27.065 INFO:teuthology.orchestra.run.smithi045.stdout: -1300> 2023-10-03T19:19:53.192+0000 7fd1a5470640 4 mds.0.server handle_client_request client_request(client.7350:1 getattr pAsLsXsFs #0x1 2023-10-03T19:19:53.193047+0000 caller_uid=0, caller_gid=0{}) v6 2023-10-03T19:21:27.065 INFO:teuthology.orchestra.run.smithi045.stdout: -1299> 2023-10-03T19:19:53.192+0000 7fd1a5470640 20 mds.0.48 get_session have 0x556318a78a00 client.7350 172.21.15.172:0/3138699255 state open 2023-10-03T19:21:27.065 INFO:teuthology.orchestra.run.smithi045.stdout: -1298> 2023-10-03T19:19:53.192+0000 7fd1a5470640 15 mds.0.server oldest_client_tid=1 2023-10-03T19:21:27.065 INFO:teuthology.orchestra.run.smithi045.stdout: -1297> 2023-10-03T19:19:53.192+0000 7fd1a5470640 7 mds.0.cache request_start request(client.7350:1 nref=2 cr=0x556318ac8600) 2023-10-03T19:21:27.066 INFO:teuthology.orchestra.run.smithi045.stdout: -1296> 2023-10-03T19:19:53.192+0000 7fd1a5470640 7 mds.0.server dispatch_client_request client_request(client.7350:1 getattr pAsLsXsFs #0x1 2023-10-03T19:19:53.193047+0000 caller_uid=0, caller_gid=0{}) v6 2023-10-03T19:21:27.066 INFO:teuthology.orchestra.run.smithi045.stdout: -1295> 2023-10-03T19:19:53.192+0000 7fd1a5470640 7 mds.0.cache traverse: opening base ino 0x1 snap head 2023-10-03T19:21:27.066 INFO:teuthology.orchestra.run.smithi045.stdout: -1294> 2023-10-03T19:19:53.192+0000 7fd1a5470640 10 mds.0.cache path_traverse finish on snapid head 2023-10-03T19:21:27.066 INFO:teuthology.orchestra.run.smithi045.stdout: -1293> 2023-10-03T19:19:53.192+0000 7fd1a5470640 10 mds.0.server rdlock_path_pin_ref request(client.7350:1 nref=3 cr=0x556318ac8600) #0x1 2023-10-03T19:21:27.066 INFO:teuthology.orchestra.run.smithi045.stdout: -1292> 2023-10-03T19:19:53.192+0000 7fd1a5470640 7 mds.0.cache traverse: opening base ino 0x1 snap head 2023-10-03T19:21:27.066 INFO:teuthology.orchestra.run.smithi045.stdout: -1291> 2023-10-03T19:19:53.192+0000 7fd1a5470640 10 mds.0.locker try_rdlock_snap_layout request(client.7350:1 nref=4 cr=0x556318ac8600) [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) caps={7335=pLsXsFs/-@2} | request=1 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.066 INFO:teuthology.orchestra.run.smithi045.stdout: -1290> 2023-10-03T19:19:53.192+0000 7fd1a5470640 20 mds.0.locker got rdlock on (isnap sync r=1) [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.066 INFO:teuthology.orchestra.run.smithi045.stdout: -1289> 2023-10-03T19:19:53.192+0000 7fd1a5470640 10 mds.0.cache path_traverse finish on snapid head 2023-10-03T19:21:27.066 INFO:teuthology.orchestra.run.smithi045.stdout: -1288> 2023-10-03T19:19:53.192+0000 7fd1a5470640 10 mds.0.server ref is [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.066 INFO:teuthology.orchestra.run.smithi045.stdout: -1287> 2023-10-03T19:19:53.192+0000 7fd1a5470640 10 mds.0.locker acquire_locks request(client.7350:1 nref=3 cr=0x556318ac8600) 2023-10-03T19:21:27.066 INFO:teuthology.orchestra.run.smithi045.stdout: -1286> 2023-10-03T19:19:53.192+0000 7fd1a5470640 20 mds.0.locker must rdlock (ilink sync) [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.067 INFO:teuthology.orchestra.run.smithi045.stdout: -1285> 2023-10-03T19:19:53.192+0000 7fd1a5470640 20 mds.0.locker must rdlock (iauth sync) [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.067 INFO:teuthology.orchestra.run.smithi045.stdout: -1284> 2023-10-03T19:19:53.192+0000 7fd1a5470640 20 mds.0.locker must rdlock (ixattr sync) [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.067 INFO:teuthology.orchestra.run.smithi045.stdout: -1283> 2023-10-03T19:19:53.192+0000 7fd1a5470640 20 mds.0.locker must rdlock (ifile sync) [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.067 INFO:teuthology.orchestra.run.smithi045.stdout: -1282> 2023-10-03T19:19:53.192+0000 7fd1a5470640 10 mds.0.locker must authpin [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.067 INFO:teuthology.orchestra.run.smithi045.stdout: -1281> 2023-10-03T19:19:53.192+0000 7fd1a5470640 10 mds.0.locker auth_pinning [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.067 INFO:teuthology.orchestra.run.smithi045.stdout: -1280> 2023-10-03T19:19:53.192+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) auth_pin by 0x556318b59800 on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] now 1 2023-10-03T19:21:27.067 INFO:teuthology.orchestra.run.smithi045.stdout: -1279> 2023-10-03T19:19:53.192+0000 7fd1a5470640 7 mds.0.locker rdlock_start on (ifile sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.067 INFO:teuthology.orchestra.run.smithi045.stdout: -1278> 2023-10-03T19:19:53.192+0000 7fd1a5470640 10 mds.0.locker got rdlock on (ifile sync r=1) [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2} | request=1 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.067 INFO:teuthology.orchestra.run.smithi045.stdout: -1277> 2023-10-03T19:19:53.192+0000 7fd1a5470640 7 mds.0.locker rdlock_start on (iauth sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2} | request=1 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.067 INFO:teuthology.orchestra.run.smithi045.stdout: -1276> 2023-10-03T19:19:53.192+0000 7fd1a5470640 10 mds.0.locker got rdlock on (iauth sync r=1) [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (isnap sync r=1) (ifile sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2} | request=1 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.068 INFO:teuthology.orchestra.run.smithi045.stdout: -1275> 2023-10-03T19:19:53.192+0000 7fd1a5470640 7 mds.0.locker rdlock_start on (ilink sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (isnap sync r=1) (ifile sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2} | request=1 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.068 INFO:teuthology.orchestra.run.smithi045.stdout: -1274> 2023-10-03T19:19:53.192+0000 7fd1a5470640 10 mds.0.locker got rdlock on (ilink sync r=1) [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (ilink sync r=1) (isnap sync r=1) (ifile sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2} | request=1 lock=4 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.068 INFO:teuthology.orchestra.run.smithi045.stdout: -1273> 2023-10-03T19:19:53.192+0000 7fd1a5470640 7 mds.0.locker rdlock_start on (ixattr sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (ilink sync r=1) (isnap sync r=1) (ifile sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2} | request=1 lock=4 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.068 INFO:teuthology.orchestra.run.smithi045.stdout: -1272> 2023-10-03T19:19:53.192+0000 7fd1a5470640 10 mds.0.locker got rdlock on (ixattr sync r=1) [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (ilink sync r=1) (isnap sync r=1) (ifile sync r=1) (ixattr sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2} | request=1 lock=5 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.068 INFO:teuthology.orchestra.run.smithi045.stdout: -1271> 2023-10-03T19:19:53.192+0000 7fd1a5470640 20 Session check_access path 2023-10-03T19:21:27.068 INFO:teuthology.orchestra.run.smithi045.stdout: -1270> 2023-10-03T19:19:53.192+0000 7fd1a5470640 10 mds.0.server reply to stat on client_request(client.7350:1 getattr pAsLsXsFs #0x1 2023-10-03T19:19:53.193047+0000 caller_uid=0, caller_gid=0{}) v6 2023-10-03T19:21:27.068 INFO:teuthology.orchestra.run.smithi045.stdout: -1269> 2023-10-03T19:19:53.192+0000 7fd1a5470640 20 mds.0.server respond_to_request batch head request(client.7350:1 nref=3 cr=0x556318ac8600) 2023-10-03T19:21:27.068 INFO:teuthology.orchestra.run.smithi045.stdout: -1268> 2023-10-03T19:19:53.192+0000 7fd1a5470640 20 respond: responding to batch ops with result=0: [batch front=request(client.7350:1 nref=3 cr=0x556318ac8600)] 2023-10-03T19:21:27.068 INFO:teuthology.orchestra.run.smithi045.stdout: -1267> 2023-10-03T19:19:53.192+0000 7fd1a5470640 7 mds.0.server reply_client_request 0 ((0) Success) client_request(client.7350:1 getattr pAsLsXsFs #0x1 2023-10-03T19:19:53.193047+0000 caller_uid=0, caller_gid=0{}) v6 2023-10-03T19:21:27.068 INFO:teuthology.orchestra.run.smithi045.stdout: -1266> 2023-10-03T19:19:53.192+0000 7fd1a5470640 10 mds.0.server apply_allocated_inos 0x0 / [] / 0x0 2023-10-03T19:21:27.068 INFO:teuthology.orchestra.run.smithi045.stdout: -1265> 2023-10-03T19:19:53.192+0000 7fd1a5470640 20 mds.0.server lat 0.000340 2023-10-03T19:21:27.069 INFO:teuthology.orchestra.run.smithi045.stdout: -1264> 2023-10-03T19:19:53.192+0000 7fd1a5470640 20 mds.0.server set_trace_dist snapid head 2023-10-03T19:21:27.069 INFO:teuthology.orchestra.run.smithi045.stdout: -1263> 2023-10-03T19:19:53.192+0000 7fd1a5470640 10 mds.0.server set_trace_dist snaprealm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:19:39.424362+0000 change_attr 0 0x556317c178c0) len=70 2023-10-03T19:21:27.069 INFO:teuthology.orchestra.run.smithi045.stdout: -1262> 2023-10-03T19:19:53.192+0000 7fd1a5470640 20 mds.0.cache.ino(0x1) pfile 0 pauth 0 plink 0 pxattr 0 plocal 0 mtime 2023-10-03T19:19:39.424362+0000 ctime 2023-10-03T19:19:51.867949+0000 change_attr 1 valid=1 2023-10-03T19:21:27.069 INFO:teuthology.orchestra.run.smithi045.stdout: -1261> 2023-10-03T19:19:53.192+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) encode_inodestat issuing pAsLsXsFs seq 1 2023-10-03T19:21:27.069 INFO:teuthology.orchestra.run.smithi045.stdout: -1260> 2023-10-03T19:19:53.192+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) encode_inodestat caps pAsLsXsFs seq 1 mseq 0 xattrv 1 2023-10-03T19:21:27.069 INFO:teuthology.orchestra.run.smithi045.stdout: -1259> 2023-10-03T19:19:53.192+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) including xattrs version 1 2023-10-03T19:21:27.069 INFO:teuthology.orchestra.run.smithi045.stdout: -1258> 2023-10-03T19:19:53.192+0000 7fd1a5470640 20 mds.0.server set_trace_dist added snap head in [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (ilink sync r=1) (isnap sync r=1) (ifile sync r=1) (ixattr sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2,7350=pAsLsXsFs/-@1} | request=1 lock=5 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.178 INFO:teuthology.orchestra.run.smithi045.stdout: -1257> 2023-10-03T19:19:53.192+0000 7fd1a5470640 10 mds.0.48 send_message_client client.7350 172.21.15.172:0/3138699255 client_reply(???:1 = 0 (0) Success) v1 2023-10-03T19:21:27.490 INFO:teuthology.orchestra.run.smithi045.stdout: -1256> 2023-10-03T19:19:53.192+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> 172.21.15.172:0/3138699255 -- client_reply(???:1 = 0 (0) Success) v1 -- 0x556317aeea80 con 0x556318b84000 2023-10-03T19:21:27.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1255> 2023-10-03T19:19:53.192+0000 7fd1a5470640 7 mds.0.cache request_finish request(client.7350:1 nref=3 cr=0x556318ac8600) 2023-10-03T19:21:27.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1254> 2023-10-03T19:19:53.192+0000 7fd1a5470640 15 mds.0.cache request_cleanup request(client.7350:1 nref=3 cr=0x556318ac8600) 2023-10-03T19:21:27.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1253> 2023-10-03T19:19:53.192+0000 7fd1a5470640 7 mds.0.locker rdlock_finish on (iauth sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (ilink sync r=1) (isnap sync r=1) (ifile sync r=1) (ixattr sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2,7350=pAsLsXsFs/-@1} | request=1 lock=4 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1252> 2023-10-03T19:19:53.192+0000 7fd1a5470640 10 mds.0.locker simple_eval (iauth sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (ilink sync r=1) (isnap sync r=1) (ifile sync r=1) (ixattr sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2,7350=pAsLsXsFs/-@1} | request=1 lock=4 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1251> 2023-10-03T19:19:53.192+0000 7fd1a5470640 7 mds.0.locker rdlock_finish on (ilink sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile sync r=1) (ixattr sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2,7350=pAsLsXsFs/-@1} | request=1 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1250> 2023-10-03T19:19:53.192+0000 7fd1a5470640 10 mds.0.locker simple_eval (ilink sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile sync r=1) (ixattr sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2,7350=pAsLsXsFs/-@1} | request=1 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1249> 2023-10-03T19:19:53.192+0000 7fd1a5470640 7 mds.0.locker rdlock_finish on (ifile sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ixattr sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2,7350=pAsLsXsFs/-@1} | request=1 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1248> 2023-10-03T19:19:53.192+0000 7fd1a5470640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ixattr sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2,7350=pAsLsXsFs/-@1} | request=1 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1247> 2023-10-03T19:19:53.192+0000 7fd1a5470640 7 mds.0.locker rdlock_finish on (ixattr sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2,7350=pAsLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1246> 2023-10-03T19:19:53.192+0000 7fd1a5470640 10 mds.0.locker simple_eval (ixattr sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2,7350=pAsLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1245> 2023-10-03T19:19:53.192+0000 7fd1a5470640 7 mds.0.locker rdlock_finish on (isnap sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) caps={7335=pLsXsFs/-@2,7350=pAsLsXsFs/-@1} | request=1 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1244> 2023-10-03T19:19:53.192+0000 7fd1a5470640 10 mds.0.locker simple_eval (isnap sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) caps={7335=pLsXsFs/-@2,7350=pAsLsXsFs/-@1} | request=1 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1243> 2023-10-03T19:19:53.192+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) auth_unpin by 0x556318b59800 on [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) caps={7335=pLsXsFs/-@2,7350=pAsLsXsFs/-@1} | request=1 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] now 0 2023-10-03T19:21:27.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1242> 2023-10-03T19:19:53.420+0000 7fd1a3c6d640 20 mds.0.48 get_task_status 2023-10-03T19:21:27.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1241> 2023-10-03T19:19:53.420+0000 7fd1a3c6d640 20 mds.0.48 schedule_update_timer_task 2023-10-03T19:21:27.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1240> 2023-10-03T19:19:53.432+0000 7fd1a1468640 2 mds.0.cache Memory usage: total 274132, rss 37544, heap 207144, baseline 190760, 1 / 13 inodes have caps, 2 caps, 0.153846 caps per inode 2023-10-03T19:21:27.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1239> 2023-10-03T19:19:53.432+0000 7fd1a1468640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999984980s ago 2023-10-03T19:21:27.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1238> 2023-10-03T19:19:53.432+0000 7fd1a1468640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:27.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1237> 2023-10-03T19:19:53.432+0000 7fd1a1468640 7 mds.0.cache trim bytes_used=51kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:27.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1236> 2023-10-03T19:19:53.432+0000 7fd1a1468640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:27.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1235> 2023-10-03T19:19:53.432+0000 7fd1a1468640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:27.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1234> 2023-10-03T19:19:53.432+0000 7fd1a1468640 7 mds.0.server recall_client_state: min=100 max=1048576 total=2 flags=0xa 2023-10-03T19:21:27.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1233> 2023-10-03T19:19:53.432+0000 7fd1a1468640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:27.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1232> 2023-10-03T19:19:53.432+0000 7fd1a1468640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:27.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1231> 2023-10-03T19:19:53.860+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7335 172.21.15.146:0/990159870 9 ==== client_request(client.7335:3 getattr pAsLsXsFs #0x1 2023-10-03T19:19:53.859650+0000 caller_uid=1000, caller_gid=1271{6,27,108,1271,10102,}) v6 ==== 196+0+0 (crc 0 0 0) 0x556318ac8300 con 0x556318b59000 2023-10-03T19:21:27.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1230> 2023-10-03T19:19:53.860+0000 7fd1a5470640 4 mds.0.server handle_client_request client_request(client.7335:3 getattr pAsLsXsFs #0x1 2023-10-03T19:19:53.859650+0000 caller_uid=1000, caller_gid=1271{6,27,108,1271,10102,}) v6 2023-10-03T19:21:27.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1229> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.48 get_session have 0x556318a4b700 client.7335 172.21.15.146:0/990159870 state open 2023-10-03T19:21:27.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1228> 2023-10-03T19:19:53.860+0000 7fd1a5470640 15 mds.0.server oldest_client_tid=3 2023-10-03T19:21:27.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1227> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.cache request_start request(client.7335:3 nref=2 cr=0x556318ac8300) 2023-10-03T19:21:27.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1226> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.server dispatch_client_request client_request(client.7335:3 getattr pAsLsXsFs #0x1 2023-10-03T19:19:53.859650+0000 caller_uid=1000, caller_gid=1271{6,27,108,1271,10102,}) v6 2023-10-03T19:21:27.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1225> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.cache traverse: opening base ino 0x1 snap head 2023-10-03T19:21:27.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1224> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.cache path_traverse finish on snapid head 2023-10-03T19:21:27.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1223> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.server rdlock_path_pin_ref request(client.7335:3 nref=3 cr=0x556318ac8300) #0x1 2023-10-03T19:21:27.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1222> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.cache traverse: opening base ino 0x1 snap head 2023-10-03T19:21:27.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1221> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker try_rdlock_snap_layout request(client.7335:3 nref=4 cr=0x556318ac8300) [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) caps={7335=pLsXsFs/-@2,7350=pAsLsXsFs/-@1} | request=1 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1220> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.locker got rdlock on (isnap sync r=1) [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2,7350=pAsLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1219> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.cache path_traverse finish on snapid head 2023-10-03T19:21:27.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1218> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.server ref is [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2,7350=pAsLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1217> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker acquire_locks request(client.7335:3 nref=3 cr=0x556318ac8300) 2023-10-03T19:21:27.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1216> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.locker must rdlock (ilink sync) [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2,7350=pAsLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1215> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.locker must rdlock (iauth sync) [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2,7350=pAsLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1214> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.locker must rdlock (ixattr sync) [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2,7350=pAsLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1213> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.locker must rdlock (ifile sync) [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2,7350=pAsLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1212> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker must authpin [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2,7350=pAsLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1211> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker auth_pinning [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2,7350=pAsLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1210> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) auth_pin by 0x556318b59c00 on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2,7350=pAsLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] now 1 2023-10-03T19:21:27.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1209> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.locker rdlock_start on (ifile sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2,7350=pAsLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1208> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker got rdlock on (ifile sync r=1) [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2,7350=pAsLsXsFs/-@1} | request=1 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1207> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.locker rdlock_start on (iauth sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2,7350=pAsLsXsFs/-@1} | request=1 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.496 INFO:teuthology.orchestra.run.smithi045.stdout: -1206> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker got rdlock on (iauth sync r=1) [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (isnap sync r=1) (ifile sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2,7350=pAsLsXsFs/-@1} | request=1 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.496 INFO:teuthology.orchestra.run.smithi045.stdout: -1205> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.locker rdlock_start on (ilink sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (isnap sync r=1) (ifile sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2,7350=pAsLsXsFs/-@1} | request=1 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.496 INFO:teuthology.orchestra.run.smithi045.stdout: -1204> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker got rdlock on (ilink sync r=1) [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (ilink sync r=1) (isnap sync r=1) (ifile sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2,7350=pAsLsXsFs/-@1} | request=1 lock=4 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.496 INFO:teuthology.orchestra.run.smithi045.stdout: -1203> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.locker rdlock_start on (ixattr sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (ilink sync r=1) (isnap sync r=1) (ifile sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2,7350=pAsLsXsFs/-@1} | request=1 lock=4 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.496 INFO:teuthology.orchestra.run.smithi045.stdout: -1202> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker got rdlock on (ixattr sync r=1) [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (ilink sync r=1) (isnap sync r=1) (ifile sync r=1) (ixattr sync r=1) (iversion lock) caps={7335=pLsXsFs/-@2,7350=pAsLsXsFs/-@1} | request=1 lock=5 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.496 INFO:teuthology.orchestra.run.smithi045.stdout: -1201> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 Session check_access path 2023-10-03T19:21:27.496 INFO:teuthology.orchestra.run.smithi045.stdout: -1200> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.server reply to stat on client_request(client.7335:3 getattr pAsLsXsFs #0x1 2023-10-03T19:19:53.859650+0000 caller_uid=1000, caller_gid=1271{6,27,108,1271,10102,}) v6 2023-10-03T19:21:27.496 INFO:teuthology.orchestra.run.smithi045.stdout: -1199> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.server respond_to_request batch head request(client.7335:3 nref=3 cr=0x556318ac8300) 2023-10-03T19:21:27.496 INFO:teuthology.orchestra.run.smithi045.stdout: -1198> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 respond: responding to batch ops with result=0: [batch front=request(client.7335:3 nref=3 cr=0x556318ac8300)] 2023-10-03T19:21:27.496 INFO:teuthology.orchestra.run.smithi045.stdout: -1197> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.server reply_client_request 0 ((0) Success) client_request(client.7335:3 getattr pAsLsXsFs #0x1 2023-10-03T19:19:53.859650+0000 caller_uid=1000, caller_gid=1271{6,27,108,1271,10102,}) v6 2023-10-03T19:21:27.496 INFO:teuthology.orchestra.run.smithi045.stdout: -1196> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.server apply_allocated_inos 0x0 / [] / 0x0 2023-10-03T19:21:27.496 INFO:teuthology.orchestra.run.smithi045.stdout: -1195> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.server lat 0.000478 2023-10-03T19:21:27.497 INFO:teuthology.orchestra.run.smithi045.stdout: -1194> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.server set_trace_dist snapid head 2023-10-03T19:21:27.497 INFO:teuthology.orchestra.run.smithi045.stdout: -1193> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.server set_trace_dist snaprealm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:19:39.424362+0000 change_attr 0 0x556317c178c0) len=70 2023-10-03T19:21:27.497 INFO:teuthology.orchestra.run.smithi045.stdout: -1192> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.cache.ino(0x1) pfile 0 pauth 0 plink 0 pxattr 0 plocal 0 mtime 2023-10-03T19:19:39.424362+0000 ctime 2023-10-03T19:19:51.867949+0000 change_attr 1 valid=1 2023-10-03T19:21:27.497 INFO:teuthology.orchestra.run.smithi045.stdout: -1191> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) encode_inodestat issuing pAsLsXsFs seq 3 2023-10-03T19:21:27.497 INFO:teuthology.orchestra.run.smithi045.stdout: -1190> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) encode_inodestat caps pAsLsXsFs seq 3 mseq 0 xattrv 1 2023-10-03T19:21:27.497 INFO:teuthology.orchestra.run.smithi045.stdout: -1189> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) including xattrs version 1 2023-10-03T19:21:27.497 INFO:teuthology.orchestra.run.smithi045.stdout: -1188> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.server set_trace_dist added snap head in [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (ilink sync r=1) (isnap sync r=1) (ifile sync r=1) (ixattr sync r=1) (iversion lock) caps={7335=pAsLsXsFs/-@3,7350=pAsLsXsFs/-@1} | request=1 lock=5 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.501 INFO:teuthology.orchestra.run.smithi045.stdout: -1187> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.48 send_message_client client.7335 172.21.15.146:0/990159870 client_reply(???:3 = 0 (0) Success) v1 2023-10-03T19:21:27.501 INFO:teuthology.orchestra.run.smithi045.stdout: -1186> 2023-10-03T19:19:53.860+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> 172.21.15.146:0/990159870 -- client_reply(???:3 = 0 (0) Success) v1 -- 0x556317aeea80 con 0x556318b59000 2023-10-03T19:21:27.501 INFO:teuthology.orchestra.run.smithi045.stdout: -1185> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.cache request_finish request(client.7335:3 nref=3 cr=0x556318ac8300) 2023-10-03T19:21:27.501 INFO:teuthology.orchestra.run.smithi045.stdout: -1184> 2023-10-03T19:19:53.860+0000 7fd1a5470640 15 mds.0.cache request_cleanup request(client.7335:3 nref=3 cr=0x556318ac8300) 2023-10-03T19:21:27.501 INFO:teuthology.orchestra.run.smithi045.stdout: -1183> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.locker rdlock_finish on (iauth sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (ilink sync r=1) (isnap sync r=1) (ifile sync r=1) (ixattr sync r=1) (iversion lock) caps={7335=pAsLsXsFs/-@3,7350=pAsLsXsFs/-@1} | request=1 lock=4 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.501 INFO:teuthology.orchestra.run.smithi045.stdout: -1182> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker simple_eval (iauth sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (ilink sync r=1) (isnap sync r=1) (ifile sync r=1) (ixattr sync r=1) (iversion lock) caps={7335=pAsLsXsFs/-@3,7350=pAsLsXsFs/-@1} | request=1 lock=4 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.502 INFO:teuthology.orchestra.run.smithi045.stdout: -1181> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.locker rdlock_finish on (ilink sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile sync r=1) (ixattr sync r=1) (iversion lock) caps={7335=pAsLsXsFs/-@3,7350=pAsLsXsFs/-@1} | request=1 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.502 INFO:teuthology.orchestra.run.smithi045.stdout: -1180> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker simple_eval (ilink sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile sync r=1) (ixattr sync r=1) (iversion lock) caps={7335=pAsLsXsFs/-@3,7350=pAsLsXsFs/-@1} | request=1 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.502 INFO:teuthology.orchestra.run.smithi045.stdout: -1179> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.locker rdlock_finish on (ifile sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ixattr sync r=1) (iversion lock) caps={7335=pAsLsXsFs/-@3,7350=pAsLsXsFs/-@1} | request=1 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.502 INFO:teuthology.orchestra.run.smithi045.stdout: -1178> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ixattr sync r=1) (iversion lock) caps={7335=pAsLsXsFs/-@3,7350=pAsLsXsFs/-@1} | request=1 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.502 INFO:teuthology.orchestra.run.smithi045.stdout: -1177> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.locker rdlock_finish on (ixattr sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pAsLsXsFs/-@3,7350=pAsLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.502 INFO:teuthology.orchestra.run.smithi045.stdout: -1176> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker simple_eval (ixattr sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pAsLsXsFs/-@3,7350=pAsLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.502 INFO:teuthology.orchestra.run.smithi045.stdout: -1175> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.locker rdlock_finish on (isnap sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) caps={7335=pAsLsXsFs/-@3,7350=pAsLsXsFs/-@1} | request=1 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.502 INFO:teuthology.orchestra.run.smithi045.stdout: -1174> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker simple_eval (isnap sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) caps={7335=pAsLsXsFs/-@3,7350=pAsLsXsFs/-@1} | request=1 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.502 INFO:teuthology.orchestra.run.smithi045.stdout: -1173> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) auth_unpin by 0x556318b59c00 on [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) caps={7335=pAsLsXsFs/-@3,7350=pAsLsXsFs/-@1} | request=1 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] now 0 2023-10-03T19:21:27.502 INFO:teuthology.orchestra.run.smithi045.stdout: -1172> 2023-10-03T19:19:53.860+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7335 172.21.15.146:0/990159870 10 ==== client_request(client.7335:4 mkdir #0x1/foo 2023-10-03T19:19:53.863091+0000 caller_uid=1000, caller_gid=1271{6,27,108,1271,10102,}) v6 ==== 243+0+0 (crc 0 0 0) 0x556318ac8900 con 0x556318b59000 2023-10-03T19:21:27.503 INFO:teuthology.orchestra.run.smithi045.stdout: -1171> 2023-10-03T19:19:53.860+0000 7fd1a5470640 4 mds.0.server handle_client_request client_request(client.7335:4 mkdir #0x1/foo 2023-10-03T19:19:53.863091+0000 caller_uid=1000, caller_gid=1271{6,27,108,1271,10102,}) v6 2023-10-03T19:21:27.503 INFO:teuthology.orchestra.run.smithi045.stdout: -1170> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.48 get_session have 0x556318a4b700 client.7335 172.21.15.146:0/990159870 state open 2023-10-03T19:21:27.503 INFO:teuthology.orchestra.run.smithi045.stdout: -1169> 2023-10-03T19:19:53.860+0000 7fd1a5470640 15 mds.0.server oldest_client_tid=4 2023-10-03T19:21:27.503 INFO:teuthology.orchestra.run.smithi045.stdout: -1168> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.cache request_start request(client.7335:4 nref=2 cr=0x556318ac8900) 2023-10-03T19:21:27.503 INFO:teuthology.orchestra.run.smithi045.stdout: -1167> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker process_request_cap_release client.7335 pAsLsXs on [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) caps={7335=pAsLsXsFs/-@3,7350=pAsLsXsFs/-@1} | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.503 INFO:teuthology.orchestra.run.smithi045.stdout: -1166> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker wanted - -> - 2023-10-03T19:21:27.503 INFO:teuthology.orchestra.run.smithi045.stdout: -1165> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker eval 3648 [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXsFs/-@1} | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.503 INFO:teuthology.orchestra.run.smithi045.stdout: -1164> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile sync) on [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXsFs/-@1} | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.504 INFO:teuthology.orchestra.run.smithi045.stdout: -1163> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker simple_eval (iauth sync) on [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXsFs/-@1} | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.504 INFO:teuthology.orchestra.run.smithi045.stdout: -1162> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker simple_eval (ilink sync) on [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXsFs/-@1} | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.504 INFO:teuthology.orchestra.run.smithi045.stdout: -1161> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker simple_eval (ixattr sync) on [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXsFs/-@1} | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.504 INFO:teuthology.orchestra.run.smithi045.stdout: -1160> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker eval done 2023-10-03T19:21:27.504 INFO:teuthology.orchestra.run.smithi045.stdout: -1159> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.server dispatch_client_request client_request(client.7335:4 mkdir #0x1/foo 2023-10-03T19:19:53.863091+0000 caller_uid=1000, caller_gid=1271{6,27,108,1271,10102,}) v6 2023-10-03T19:21:27.504 INFO:teuthology.orchestra.run.smithi045.stdout: -1158> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.server rdlock_path_xlock_dentry request(client.7335:4 nref=2 cr=0x556318ac8900) #0x1/foo 2023-10-03T19:21:27.504 INFO:teuthology.orchestra.run.smithi045.stdout: -1157> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.cache traverse: opening base ino 0x1 snap head 2023-10-03T19:21:27.504 INFO:teuthology.orchestra.run.smithi045.stdout: -1156> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker try_rdlock_snap_layout request(client.7335:4 nref=3 cr=0x556318ac8900) [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXsFs/-@1} | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.504 INFO:teuthology.orchestra.run.smithi045.stdout: -1155> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.locker got rdlock on (isnap sync r=1) [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXsFs/-@1} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.505 INFO:teuthology.orchestra.run.smithi045.stdout: -1154> 2023-10-03T19:19:53.860+0000 7fd1a5470640 12 mds.0.cache traverse: path seg depth 0 'foo' snapid head 2023-10-03T19:21:27.530 INFO:teuthology.orchestra.run.smithi045.stdout: -1153> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.cache.dir(0x1) lookup (foo, 'head') 2023-10-03T19:21:27.530 INFO:teuthology.orchestra.run.smithi045.stdout: -1152> 2023-10-03T19:19:53.860+0000 7fd1a5470640 12 mds.0.cache traverse: miss on dentry foo in [dir 0x1 / [2,head] auth v=1 cv=1/1 REP dir_auth=0 state=1073741825|complete f() n() hs=0+0,ss=0+0 | subtree=1 dirty=0 authpin=0 0x556317b1d180] 2023-10-03T19:21:27.530 INFO:teuthology.orchestra.run.smithi045.stdout: -1151> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.cache.dir(0x1) lookup_exact_snap (head, 'foo') 2023-10-03T19:21:27.530 INFO:teuthology.orchestra.run.smithi045.stdout: -1150> 2023-10-03T19:19:53.860+0000 7fd1a5470640 12 mds.0.cache.dir(0x1) add_null_dentry [dentry #0x1/foo [2,head] auth NULL (dversion lock) pv=0 v=1 ino=(nil) state=1073741824 0x556318b96000] 2023-10-03T19:21:27.530 INFO:teuthology.orchestra.run.smithi045.stdout: -1149> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.cache added null [dentry #0x1/foo [2,head] auth NULL (dversion lock) pv=0 v=1 ino=(nil) state=1073741824 0x556318b96000] 2023-10-03T19:21:27.530 INFO:teuthology.orchestra.run.smithi045.stdout: -1148> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker acquire_locks request(client.7335:4 nref=3 cr=0x556318ac8900) 2023-10-03T19:21:27.530 INFO:teuthology.orchestra.run.smithi045.stdout: -1147> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.locker must wrlock (ifile sync) [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXsFs/-@1} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.530 INFO:teuthology.orchestra.run.smithi045.stdout: -1146> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.locker must wrlock (inest sync) [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXsFs/-@1} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.530 INFO:teuthology.orchestra.run.smithi045.stdout: -1145> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.locker must rdlock (iauth sync) [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXsFs/-@1} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.530 INFO:teuthology.orchestra.run.smithi045.stdout: -1144> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.locker must xlock (dn sync) [dentry #0x1/foo [2,head] auth NULL (dversion lock) pv=0 v=1 ino=(nil) state=1073741824 0x556318b96000] 2023-10-03T19:21:27.531 INFO:teuthology.orchestra.run.smithi045.stdout: -1143> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.locker must wrlock (dversion lock) [dentry #0x1/foo [2,head] auth NULL (dversion lock) pv=0 v=1 ino=(nil) state=1073741824 0x556318b96000] 2023-10-03T19:21:27.531 INFO:teuthology.orchestra.run.smithi045.stdout: -1142> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker must authpin [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXsFs/-@1} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.531 INFO:teuthology.orchestra.run.smithi045.stdout: -1141> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker must authpin [dentry #0x1/foo [2,head] auth NULL (dversion lock) pv=0 v=1 ino=(nil) state=1073741824 0x556318b96000] 2023-10-03T19:21:27.531 INFO:teuthology.orchestra.run.smithi045.stdout: -1140> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker auth_pinning [inode 0x1 [...2,head] / auth v2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXsFs/-@1} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.531 INFO:teuthology.orchestra.run.smithi045.stdout: -1139> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) auth_pin by 0x556318b84c00 on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXsFs/-@1} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] now 1 2023-10-03T19:21:27.531 INFO:teuthology.orchestra.run.smithi045.stdout: -1138> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker auth_pinning [dentry #0x1/foo [2,head] auth NULL (dversion lock) pv=0 v=1 ino=(nil) state=1073741824 0x556318b96000] 2023-10-03T19:21:27.531 INFO:teuthology.orchestra.run.smithi045.stdout: -1137> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.cache.den(0x1 foo) auth_pin by 0x556318b84c00 on [dentry #0x1/foo [2,head] auth NULL (dversion lock) pv=0 v=1 ap=1 ino=(nil) state=1073741824 | authpin=1 0x556318b96000] now 1 2023-10-03T19:21:27.531 INFO:teuthology.orchestra.run.smithi045.stdout: -1136> 2023-10-03T19:19:53.860+0000 7fd1a5470640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins 1 on [dir 0x1 / [2,head] auth v=1 cv=1/1 REP dir_auth=0 ap=0+1 state=1073741825|complete f() n() hs=0+1,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x556317b1d180] by 0x556318b84c00 count now 0/1 2023-10-03T19:21:27.531 INFO:teuthology.orchestra.run.smithi045.stdout: -1135> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker wrlock_start (ifile sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXsFs/-@1} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.531 INFO:teuthology.orchestra.run.smithi045.stdout: -1134> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.locker scatter_mix (ifile sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXsFs/-@1} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.531 INFO:teuthology.orchestra.run.smithi045.stdout: -1133> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.locker get_allowed_caps allowed=pAsLsXsFrl, xlocker allowed=pAsLsXsFrl on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile sync->mix) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXsFs/-@1} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.532 INFO:teuthology.orchestra.run.smithi045.stdout: -1132> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.locker client.7335 pending pAsLsXs allowed pAsLsXs wanted - 2023-10-03T19:21:27.532 INFO:teuthology.orchestra.run.smithi045.stdout: -1131> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.locker get_allowed_caps allowed=pAsLsXsFrl, xlocker allowed=pAsLsXsFrl on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile sync->mix) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXsFs/-@1} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.532 INFO:teuthology.orchestra.run.smithi045.stdout: -1130> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.locker client.7350 pending pAsLsXsFs allowed pAsLsXs wanted - 2023-10-03T19:21:27.532 INFO:teuthology.orchestra.run.smithi045.stdout: -1129> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.locker sending MClientCaps to client.7350 seq 2 new pending pAsLsXs was pAsLsXsFs 2023-10-03T19:21:27.532 INFO:teuthology.orchestra.run.smithi045.stdout: -1128> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.cache.ino(0x1) encode_cap_message pfile 0 pauth 0 plink 0 pxattr 0 mtime 2023-10-03T19:19:39.424362+0000 ctime 2023-10-03T19:19:51.867949+0000 change_attr 1 2023-10-03T19:21:27.532 INFO:teuthology.orchestra.run.smithi045.stdout: -1127> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.48 send_message_client_counted client.7350 seq 1 client_caps(revoke ino 0x1 2 seq 2 caps=pAsLsXs dirty=- wanted=- follows 0 size 0/0 mtime 2023-10-03T19:19:39.424362+0000 ctime 2023-10-03T19:19:51.867949+0000 change_attr 1) v12 2023-10-03T19:21:27.532 INFO:teuthology.orchestra.run.smithi045.stdout: -1126> 2023-10-03T19:19:53.860+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> 172.21.15.172:0/3138699255 -- client_caps(revoke ino 0x1 2 seq 2 caps=pAsLsXs dirty=- wanted=- follows 0 size 0/0 mtime 2023-10-03T19:19:39.424362+0000 ctime 2023-10-03T19:19:51.867949+0000 change_attr 1) v12 -- 0x556318ad2000 con 0x556318b84000 2023-10-03T19:21:27.532 INFO:teuthology.orchestra.run.smithi045.stdout: -1125> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) auth_pin by 0x556317b3c990 on [inode 0x1 [...2,head] / auth v2 ap=2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile sync->mix) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/pAsLsXsFs/-@2} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] now 2 2023-10-03T19:21:27.533 INFO:teuthology.orchestra.run.smithi045.stdout: -1124> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.locker wrlock_start waiting on (ifile sync->mix) on [inode 0x1 [...2,head] / auth v2 ap=2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile sync->mix) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/pAsLsXsFs/-@2} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.533 INFO:teuthology.orchestra.run.smithi045.stdout: -1123> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) add_waiter tag 2000000040000000 0x5563188d8e80 !ambig 1 !frozen 1 !freezing 1 2023-10-03T19:21:27.533 INFO:teuthology.orchestra.run.smithi045.stdout: -1122> 2023-10-03T19:19:53.860+0000 7fd1a5470640 15 mds.0.cache.ino(0x1) taking waiter here 2023-10-03T19:21:27.533 INFO:teuthology.orchestra.run.smithi045.stdout: -1121> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker nudge_log (ifile sync->mix) on [inode 0x1 [...2,head] / auth v2 ap=2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile sync->mix) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/pAsLsXsFs/-@2} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.534 INFO:teuthology.orchestra.run.smithi045.stdout: -1120> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.cache traverse: failed to rdlock (dn sync) [dentry #0x1/foo [2,head] auth NULL (dversion lock) pv=0 v=1 ap=1 ino=(nil) state=1073741824 | authpin=1 0x556318b96000] 2023-10-03T19:21:27.534 INFO:teuthology.orchestra.run.smithi045.stdout: -1119> 2023-10-03T19:19:53.860+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7350 172.21.15.172:0/3138699255 4 ==== client_caps(update ino 0x1 2 seq 2 caps=pAsLsXs dirty=- wanted=- follows 0 size 0/0 ts 1/18446744073709551615 mtime 2023-10-03T19:19:39.424362+0000 ctime 2023-10-03T19:19:51.867949+0000 change_attr 2) v12 ==== 260+0+0 (crc 0 0 0) 0x556318ad2000 con 0x556318b84000 2023-10-03T19:21:27.534 INFO:teuthology.orchestra.run.smithi045.stdout: -1118> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.locker handle_client_caps on 0x1 tid 0 follows 0 op update flags 0x0 2023-10-03T19:21:27.534 INFO:teuthology.orchestra.run.smithi045.stdout: -1117> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.48 get_session have 0x556318a78a00 client.7350 172.21.15.172:0/3138699255 state open 2023-10-03T19:21:27.534 INFO:teuthology.orchestra.run.smithi045.stdout: -1116> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker head inode [inode 0x1 [...2,head] / auth v2 ap=2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile sync->mix) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/pAsLsXsFs/-@2} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.534 INFO:teuthology.orchestra.run.smithi045.stdout: -1115> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker follows 0 retains pAsLsXs dirty - on [inode 0x1 [...2,head] / auth v2 ap=2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile sync->mix) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.534 INFO:teuthology.orchestra.run.smithi045.stdout: -1114> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker _do_cap_update dirty - issued pAsLsXs wanted - on [inode 0x1 [...2,head] / auth v2 ap=2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile sync->mix) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.534 INFO:teuthology.orchestra.run.smithi045.stdout: -1113> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker eval 3648 [inode 0x1 [...2,head] / auth v2 ap=2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile sync->mix) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.534 INFO:teuthology.orchestra.run.smithi045.stdout: -1112> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker eval_gather (ifile sync->mix) on [inode 0x1 [...2,head] / auth v2 ap=2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile sync->mix) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.534 INFO:teuthology.orchestra.run.smithi045.stdout: -1111> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker next state is mix issued/allows loner /rwl xlocker /rwl other /rwl 2023-10-03T19:21:27.535 INFO:teuthology.orchestra.run.smithi045.stdout: -1110> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.locker eval_gather finished gather on (ifile sync->mix) on [inode 0x1 [...2,head] / auth v2 ap=2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile sync->mix) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.535 INFO:teuthology.orchestra.run.smithi045.stdout: -1109> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) start_scatter (ifile sync->mix) on [inode 0x1 [...2,head] / auth v2 ap=2 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile sync->mix) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=1 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.535 INFO:teuthology.orchestra.run.smithi045.stdout: -1108> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.cache.ino(0x1) * [dir 0x1 / [2,head] auth v=1 cv=1/1 REP dir_auth=0 ap=0+1 state=1073741825|complete f() n() hs=0+1,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x556317b1d180] 2023-10-03T19:21:27.535 INFO:teuthology.orchestra.run.smithi045.stdout: -1107> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) finish_scatter_update * accounted (ifile sync->mix) scatter stat unchanged at v0 2023-10-03T19:21:27.535 INFO:teuthology.orchestra.run.smithi045.stdout: -1106> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) auth_unpin by 0x556317b3c990 on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=1 authpin=1 0x556317b3c680] now 1 2023-10-03T19:21:27.535 INFO:teuthology.orchestra.run.smithi045.stdout: -1105> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile mix) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.535 INFO:teuthology.orchestra.run.smithi045.stdout: -1104> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker simple_eval (iauth sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.535 INFO:teuthology.orchestra.run.smithi045.stdout: -1103> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker simple_eval (ilink sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.535 INFO:teuthology.orchestra.run.smithi045.stdout: -1102> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker simple_eval (ixattr sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.535 INFO:teuthology.orchestra.run.smithi045.stdout: -1101> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 MDSContext::complete: 18C_MDS_RetryRequest 2023-10-03T19:21:27.535 INFO:teuthology.orchestra.run.smithi045.stdout: -1100> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.server dispatch_client_request client_request(client.7335:4 mkdir #0x1/foo 2023-10-03T19:19:53.863091+0000 caller_uid=1000, caller_gid=1271{6,27,108,1271,10102,}) v6 2023-10-03T19:21:27.536 INFO:teuthology.orchestra.run.smithi045.stdout: -1099> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.server rdlock_path_xlock_dentry request(client.7335:4 nref=2 cr=0x556318ac8900) #0x1/foo 2023-10-03T19:21:27.536 INFO:teuthology.orchestra.run.smithi045.stdout: -1098> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.cache traverse: opening base ino 0x1 snap head 2023-10-03T19:21:27.536 INFO:teuthology.orchestra.run.smithi045.stdout: -1097> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker try_rdlock_snap_layout request(client.7335:4 nref=3 cr=0x556318ac8900) [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.536 INFO:teuthology.orchestra.run.smithi045.stdout: -1096> 2023-10-03T19:19:53.860+0000 7fd1a5470640 12 mds.0.cache traverse: path seg depth 0 'foo' snapid head 2023-10-03T19:21:27.536 INFO:teuthology.orchestra.run.smithi045.stdout: -1095> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.cache.dir(0x1) lookup (foo, 'head') 2023-10-03T19:21:27.536 INFO:teuthology.orchestra.run.smithi045.stdout: -1094> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.cache.dir(0x1) hit -> (foo,head) 2023-10-03T19:21:27.536 INFO:teuthology.orchestra.run.smithi045.stdout: -1093> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker acquire_locks request(client.7335:4 nref=3 cr=0x556318ac8900) 2023-10-03T19:21:27.536 INFO:teuthology.orchestra.run.smithi045.stdout: -1092> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.locker must wrlock (ifile mix) [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.536 INFO:teuthology.orchestra.run.smithi045.stdout: -1091> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.locker must wrlock (inest sync) [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.536 INFO:teuthology.orchestra.run.smithi045.stdout: -1090> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.locker must rdlock (iauth sync) [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.536 INFO:teuthology.orchestra.run.smithi045.stdout: -1089> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.locker must xlock (dn sync) [dentry #0x1/foo [2,head] auth NULL (dversion lock) pv=0 v=1 ap=1 ino=(nil) state=1073741824 | authpin=1 0x556318b96000] 2023-10-03T19:21:27.536 INFO:teuthology.orchestra.run.smithi045.stdout: -1088> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.locker must wrlock (dversion lock) [dentry #0x1/foo [2,head] auth NULL (dversion lock) pv=0 v=1 ap=1 ino=(nil) state=1073741824 | authpin=1 0x556318b96000] 2023-10-03T19:21:27.537 INFO:teuthology.orchestra.run.smithi045.stdout: -1087> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker must authpin [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.537 INFO:teuthology.orchestra.run.smithi045.stdout: -1086> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker must authpin [dentry #0x1/foo [2,head] auth NULL (dversion lock) pv=0 v=1 ap=1 ino=(nil) state=1073741824 | authpin=1 0x556318b96000] 2023-10-03T19:21:27.537 INFO:teuthology.orchestra.run.smithi045.stdout: -1085> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker already auth_pinned [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.537 INFO:teuthology.orchestra.run.smithi045.stdout: -1084> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker already auth_pinned [dentry #0x1/foo [2,head] auth NULL (dversion lock) pv=0 v=1 ap=1 ino=(nil) state=1073741824 | authpin=1 0x556318b96000] 2023-10-03T19:21:27.537 INFO:teuthology.orchestra.run.smithi045.stdout: -1083> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker wrlock_start (ifile mix) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.537 INFO:teuthology.orchestra.run.smithi045.stdout: -1082> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker got wrlock on (ifile mix w=1) [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile mix w=1) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.537 INFO:teuthology.orchestra.run.smithi045.stdout: -1081> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker wrlock_start (inest sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile mix w=1) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.537 INFO:teuthology.orchestra.run.smithi045.stdout: -1080> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.locker scatter_mix (inest sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (ifile mix w=1) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.537 INFO:teuthology.orchestra.run.smithi045.stdout: -1079> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) start_scatter (inest sync->mix) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (inest sync->mix) (ifile mix w=1) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.537 INFO:teuthology.orchestra.run.smithi045.stdout: -1078> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.cache.ino(0x1) * [dir 0x1 / [2,head] auth v=1 cv=1/1 REP dir_auth=0 ap=0+1 state=1073741825|complete f() n() hs=0+1,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x556317b1d180] 2023-10-03T19:21:27.537 INFO:teuthology.orchestra.run.smithi045.stdout: -1077> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.cache.ino(0x1) finish_scatter_update * accounted (inest sync->mix) scatter stat unchanged at v0 2023-10-03T19:21:27.538 INFO:teuthology.orchestra.run.smithi045.stdout: -1076> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker got wrlock on (inest mix w=1) [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (inest mix w=1) (ifile mix w=1) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.538 INFO:teuthology.orchestra.run.smithi045.stdout: -1075> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.locker rdlock_start on (iauth sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (inest mix w=1) (ifile mix w=1) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.538 INFO:teuthology.orchestra.run.smithi045.stdout: -1074> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker got rdlock on (iauth sync r=1) [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (isnap sync r=1) (inest mix w=1) (ifile mix w=1) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=4 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.538 INFO:teuthology.orchestra.run.smithi045.stdout: -1073> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.locker xlock_start on (dn sync) on [dentry #0x1/foo [2,head] auth NULL (dversion lock) pv=0 v=1 ap=1 ino=(nil) state=1073741824 | authpin=1 0x556318b96000] 2023-10-03T19:21:27.538 INFO:teuthology.orchestra.run.smithi045.stdout: -1072> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.locker simple_lock on (dn sync) on [dentry #0x1/foo [2,head] auth NULL (dversion lock) pv=0 v=1 ap=1 ino=(nil) state=1073741824 | authpin=1 0x556318b96000] 2023-10-03T19:21:27.538 INFO:teuthology.orchestra.run.smithi045.stdout: -1071> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.locker simple_xlock on (dn lock) on [dentry #0x1/foo [2,head] auth NULL (dn lock) (dversion lock) pv=0 v=1 ap=1 ino=(nil) state=1073741824 | request=1 authpin=1 0x556318b96000] 2023-10-03T19:21:27.538 INFO:teuthology.orchestra.run.smithi045.stdout: -1070> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.cache.den(0x1 foo) auth_pin by 0x556318b960e8 on [dentry #0x1/foo [2,head] auth NULL (dn lock) (dversion lock) pv=0 v=1 ap=2 ino=(nil) state=1073741824 | request=1 authpin=1 0x556318b96000] now 2 2023-10-03T19:21:27.538 INFO:teuthology.orchestra.run.smithi045.stdout: -1069> 2023-10-03T19:19:53.860+0000 7fd1a5470640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins 1 on [dir 0x1 / [2,head] auth v=1 cv=1/1 REP dir_auth=0 ap=0+2 state=1073741825|complete f() n() hs=0+1,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x556317b1d180] by 0x556318b960e8 count now 0/2 2023-10-03T19:21:27.538 INFO:teuthology.orchestra.run.smithi045.stdout: -1068> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker got xlock on (dn xlock x=1 by 0x556318b84c00) [dentry #0x1/foo [2,head] auth NULL (dn xlock x=1 by 0x556318b84c00) (dversion lock) pv=0 v=1 ap=2 ino=(nil) state=1073741824 | request=1 lock=1 authpin=1 0x556318b96000] 2023-10-03T19:21:27.538 INFO:teuthology.orchestra.run.smithi045.stdout: -1067> 2023-10-03T19:19:53.860+0000 7fd1a5470640 7 mds.0.locker local_wrlock_start on (dversion lock) on [dentry #0x1/foo [2,head] auth NULL (dn xlock x=1 by 0x556318b84c00) (dversion lock) pv=0 v=1 ap=2 ino=(nil) state=1073741824 | request=1 lock=1 authpin=1 0x556318b96000] 2023-10-03T19:21:27.646 INFO:teuthology.orchestra.run.smithi045.stdout: -1066> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.locker got wrlock on (dversion lock w=1 last_client=7335) [dentry #0x1/foo [2,head] auth NULL (dn xlock x=1 by 0x556318b84c00) (dversion lock w=1 last_client=7335) pv=0 v=1 ap=2 ino=(nil) state=1073741824 | request=1 lock=2 authpin=1 0x556318b96000] 2023-10-03T19:21:27.646 INFO:teuthology.orchestra.run.smithi045.stdout: -1065> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.cache traverse: null+readable dentry at [dentry #0x1/foo [2,head] auth NULL (dn xlock x=1 by 0x556318b84c00) (dversion lock w=1 last_client=7335) pv=0 v=1 ap=2 ino=(nil) state=1073741824 | request=1 lock=2 authpin=1 0x556318b96000] 2023-10-03T19:21:27.646 INFO:teuthology.orchestra.run.smithi045.stdout: -1064> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.cache path_traverse finish on snapid head 2023-10-03T19:21:27.646 INFO:teuthology.orchestra.run.smithi045.stdout: -1063> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.cache.snaprealm(0x3 seq 1 0x556317c17d40) build_snap_set on snaprealm(0x3 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 0.000000 change_attr 0 0x556317c17d40) 2023-10-03T19:21:27.646 INFO:teuthology.orchestra.run.smithi045.stdout: -1062> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.cache.snaprealm(0x3 seq 1 0x556317c17d40) build_snap_trace my_snaps [] 2023-10-03T19:21:27.646 INFO:teuthology.orchestra.run.smithi045.stdout: -1061> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.cache.snaprealm(0x3 seq 1 0x556317c17d40) check_cache rebuilt seq 1 cached_seq 1 cached_last_created 1 cached_last_destroyed 1) 2023-10-03T19:21:27.646 INFO:teuthology.orchestra.run.smithi045.stdout: -1060> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 Session check_access path 2023-10-03T19:21:27.646 INFO:teuthology.orchestra.run.smithi045.stdout: -1059> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.server fragment [dir 0x1 / [2,head] auth v=1 cv=1/1 REP dir_auth=0 ap=0+2 state=1073741825|complete f() n() hs=0+1,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x556317b1d180] size 0 < 100000 2023-10-03T19:21:27.647 INFO:teuthology.orchestra.run.smithi045.stdout: -1058> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.inotable: project_alloc_id 0x0 to [0x10000000000~0x10000000000]/[0x10000000000~0x10000000000] 2023-10-03T19:21:27.647 INFO:teuthology.orchestra.run.smithi045.stdout: -1057> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.server prepare_new_inode alloc 0x10000000000 2023-10-03T19:21:27.647 INFO:teuthology.orchestra.run.smithi045.stdout: -1056> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.inotable: project_alloc_ids [0x10000000001~0x3e8] to [0x100000003e9~0xfffffffc17]/[0x10000000000~0x10000000000] 2023-10-03T19:21:27.647 INFO:teuthology.orchestra.run.smithi045.stdout: -1055> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.sessionmap mark_projected s=0x556318a4b700 name=client.7335 pv=2 -> 3 2023-10-03T19:21:27.647 INFO:teuthology.orchestra.run.smithi045.stdout: -1054> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.server prepare_new_inode prealloc [0x10000000001~0x3e8] 2023-10-03T19:21:27.647 INFO:teuthology.orchestra.run.smithi045.stdout: -1053> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.server dir mode 041777 new mode 040775 2023-10-03T19:21:27.647 INFO:teuthology.orchestra.run.smithi045.stdout: -1052> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.server copying fscrypt_auth len 0 2023-10-03T19:21:27.647 INFO:teuthology.orchestra.run.smithi045.stdout: -1051> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.server prepare_new_inode [inode 0x10000000000 [...2,head] #10000000000/ auth v1 f() n() (iversion lock) 0x556318acfb80] 2023-10-03T19:21:27.647 INFO:teuthology.orchestra.run.smithi045.stdout: -1050> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.cache.dir(0x1) pre_dirty 2 2023-10-03T19:21:27.647 INFO:teuthology.orchestra.run.smithi045.stdout: -1049> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.cache.den(0x1 foo) pre_dirty [dentry #0x1/foo [2,head] auth NULL (dn xlock x=1 by 0x556318b84c00) (dversion lock w=1 last_client=7335) pv=2 v=1 ap=2 ino=(nil) state=1073741824 | request=1 lock=2 authpin=1 0x556318b96000] 2023-10-03T19:21:27.647 INFO:teuthology.orchestra.run.smithi045.stdout: -1048> 2023-10-03T19:19:53.860+0000 7fd1a5470640 12 mds.0.server follows 1 2023-10-03T19:21:27.647 INFO:teuthology.orchestra.run.smithi045.stdout: -1047> 2023-10-03T19:19:53.860+0000 7fd1a5470640 15 mds.0.cache.ino(0x10000000000) maybe_export_pin update=0 [inode 0x10000000000 [...2,head] /foo/ auth v2 f() n(v0 1=0+1) (iversion lock) 0x556318acfb80] 2023-10-03T19:21:27.648 INFO:teuthology.orchestra.run.smithi045.stdout: -1046> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.cache.dir(0x10000000000) pre_dirty 1 2023-10-03T19:21:27.648 INFO:teuthology.orchestra.run.smithi045.stdout: -1045> 2023-10-03T19:19:53.860+0000 7fd1a5470640 20 mds.0.server journal_allocated_inos sessionmapv 3 inotablev 2 2023-10-03T19:21:27.648 INFO:teuthology.orchestra.run.smithi045.stdout: -1044> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.cache predirty_journal_parents do_parent_mtime linkunlink=1 primary_dn follows head [inode 0x10000000000 [...2,head] /foo/ auth v2 f() n(v0 1=0+1) (iversion lock) 0x556318acfb80] 2023-10-03T19:21:27.648 INFO:teuthology.orchestra.run.smithi045.stdout: -1043> 2023-10-03T19:19:53.860+0000 7fd1a5470640 10 mds.0.cache.dir(0x1) auth_pin by 0x556318b84c00 on [dir 0x1 / [2,head] auth v=1 cv=1/1 REP dir_auth=0 ap=1+2 state=1073741825|complete f() n() hs=0+1,ss=0+0 | child=1 subtree=1 dirty=0 authpin=1 0x556317b1d180] count now 1 2023-10-03T19:21:27.648 INFO:teuthology.orchestra.run.smithi045.stdout: -1042> 2023-10-03T19:19:53.864+0000 7fd1a5470640 10 mds.0.cache.dir(0x1) project_fnode 0x55631892da00 2023-10-03T19:21:27.648 INFO:teuthology.orchestra.run.smithi045.stdout: -1041> 2023-10-03T19:19:53.864+0000 7fd1a5470640 10 mds.0.cache.dir(0x1) pre_dirty 3 2023-10-03T19:21:27.648 INFO:teuthology.orchestra.run.smithi045.stdout: -1040> 2023-10-03T19:19:53.864+0000 7fd1a5470640 10 mds.0.cache predirty_journal_parents bumping fragstat change_attr to 1 on 0x556317b1d180 2023-10-03T19:21:27.648 INFO:teuthology.orchestra.run.smithi045.stdout: -1039> 2023-10-03T19:19:53.864+0000 7fd1a5470640 10 mds.0.cache predirty_journal_parents updating mtime on [dir 0x1 / [2,head] auth pv=3 v=1 cv=1/1 REP dir_auth=0 ap=1+2 state=1073741825|complete f()->f(v0 m2023-10-03T19:19:53.863091+0000)/f() n()->n() hs=0+1,ss=0+0 | child=1 subtree=1 dirty=0 authpin=1 0x556317b1d180] 2023-10-03T19:21:27.648 INFO:teuthology.orchestra.run.smithi045.stdout: -1038> 2023-10-03T19:19:53.864+0000 7fd1a5470640 10 mds.0.cache predirty_journal_parents updating size on [dir 0x1 / [2,head] auth pv=3 v=1 cv=1/1 REP dir_auth=0 ap=1+2 state=1073741825|complete f()->f(v0 m2023-10-03T19:19:53.863091+0000)/f() n()->n(v0 rc2023-10-03T19:19:53.863091+0000)/n() hs=0+1,ss=0+0 | child=1 subtree=1 dirty=0 authpin=1 0x556317b1d180] 2023-10-03T19:21:27.649 INFO:teuthology.orchestra.run.smithi045.stdout: -1037> 2023-10-03T19:19:53.864+0000 7fd1a5470640 10 mds.0.cache projected_rstat_inode_to_frag first 2 linkunlink 1 [inode 0x10000000000 [...2,head] /foo/ auth v2 f() n(v0 1=0+1) (iversion lock) 0x556318acfb80] 2023-10-03T19:21:27.649 INFO:teuthology.orchestra.run.smithi045.stdout: -1036> 2023-10-03T19:19:53.864+0000 7fd1a5470640 20 mds.0.cache frag head is [2,head] 2023-10-03T19:21:27.649 INFO:teuthology.orchestra.run.smithi045.stdout: -1035> 2023-10-03T19:19:53.864+0000 7fd1a5470640 20 mds.0.cache inode update is [2,head] 2023-10-03T19:21:27.649 INFO:teuthology.orchestra.run.smithi045.stdout: -1034> 2023-10-03T19:19:53.864+0000 7fd1a5470640 20 mds.0.cache floor of 2 from parent dn [dentry #0x1/foo [2,head] auth NULL (dn xlock x=1 by 0x556318b84c00) (dversion lock w=1 last_client=7335) pv=2 v=1 ap=2 ino=(nil) state=1073741824 | request=1 lock=2 authpin=1 0x556318b96000] 2023-10-03T19:21:27.649 INFO:teuthology.orchestra.run.smithi045.stdout: -1033> 2023-10-03T19:19:53.864+0000 7fd1a5470640 10 mds.0.cache.snaprealm(0x1 seq 1 0x556317c178c0) get_snaps (seq 1 cached_seq 1) 2023-10-03T19:21:27.649 INFO:teuthology.orchestra.run.smithi045.stdout: -1032> 2023-10-03T19:19:53.864+0000 7fd1a5470640 10 mds.0.cache _project_rstat_inode_to_frag [2,head] 2023-10-03T19:21:27.649 INFO:teuthology.orchestra.run.smithi045.stdout: -1031> 2023-10-03T19:19:53.864+0000 7fd1a5470640 20 mds.0.cache inode rstat n(v0 1=0+1) 2023-10-03T19:21:27.649 INFO:teuthology.orchestra.run.smithi045.stdout: -1030> 2023-10-03T19:19:53.864+0000 7fd1a5470640 20 mds.0.cache inode accounted_rstat n(v0 1=0+1) 2023-10-03T19:21:27.649 INFO:teuthology.orchestra.run.smithi045.stdout: -1029> 2023-10-03T19:19:53.864+0000 7fd1a5470640 20 mds.0.cache delta n(v0 1=0+1) 2023-10-03T19:21:27.649 INFO:teuthology.orchestra.run.smithi045.stdout: -1028> 2023-10-03T19:19:53.864+0000 7fd1a5470640 20 mds.0.cache projecting to head [2,head] n(v0 rc2023-10-03T19:19:53.863091+0000) 2023-10-03T19:21:27.649 INFO:teuthology.orchestra.run.smithi045.stdout: -1027> 2023-10-03T19:19:53.864+0000 7fd1a5470640 20 mds.0.cache project to [2,head] n(v0 rc2023-10-03T19:19:53.863091+0000) 2023-10-03T19:21:27.649 INFO:teuthology.orchestra.run.smithi045.stdout: -1026> 2023-10-03T19:19:53.864+0000 7fd1a5470640 20 mds.0.cache result [2,head] n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) [dir 0x1 / [2,head] auth pv=3 v=1 cv=1/1 REP dir_auth=0 ap=1+2 state=1073741825|complete f()->f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1)/f() n()->n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1)/n() hs=0+1,ss=0+0 | child=1 subtree=1 dirty=0 authpin=1 0x556317b1d180] 2023-10-03T19:21:27.650 INFO:teuthology.orchestra.run.smithi045.stdout: -1025> 2023-10-03T19:19:53.864+0000 7fd1a5470640 7 mds.0.locker local_wrlock_grab on (iversion lock) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (isnap sync r=1) (inest mix w=1) (ifile mix w=1) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=4 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.650 INFO:teuthology.orchestra.run.smithi045.stdout: -1024> 2023-10-03T19:19:53.864+0000 7fd1a5470640 20 mds.0.cache.ino(0x1) pre_cow_old_inode follows 1 on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (isnap sync r=1) (inest mix w=1) (ifile mix w=1) (iversion lock w=1 last_client=7335) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=5 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.650 INFO:teuthology.orchestra.run.smithi045.stdout: -1023> 2023-10-03T19:19:53.864+0000 7fd1a5470640 15 mds.0.cache.ino(0x1) project_inode 0x1 2023-10-03T19:21:27.650 INFO:teuthology.orchestra.run.smithi045.stdout: -1022> 2023-10-03T19:19:53.864+0000 7fd1a5470640 20 mds.0.cache predirty_journal_parents add_delta f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) 2023-10-03T19:21:27.650 INFO:teuthology.orchestra.run.smithi045.stdout: -1021> 2023-10-03T19:19:53.864+0000 7fd1a5470640 20 mds.0.cache predirty_journal_parents - f() 2023-10-03T19:21:27.650 INFO:teuthology.orchestra.run.smithi045.stdout: -1020> 2023-10-03T19:19:53.864+0000 7fd1a5470640 20 mds.0.cache predirty_journal_parents gives f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) on [inode 0x1 [...2,head] / auth v2 pv3 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f()->f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1)->n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (isnap sync r=1) (inest mix w=1) (ifile mix w=1) (iversion lock w=1 last_client=7335) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=5 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.650 INFO:teuthology.orchestra.run.smithi045.stdout: -1019> 2023-10-03T19:19:53.864+0000 7fd1a5470640 10 mds.0.cache predirty_journal_parents frag->inode on [dir 0x1 / [2,head] auth pv=3 v=1 cv=1/1 REP dir_auth=0 ap=1+2 state=1073741825|complete f()->f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n()->n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1)/n() hs=0+1,ss=0+0 | child=1 subtree=1 dirty=0 authpin=1 0x556317b1d180] 2023-10-03T19:21:27.650 INFO:teuthology.orchestra.run.smithi045.stdout: -1018> 2023-10-03T19:19:53.864+0000 7fd1a5470640 10 mds.0.cache project_rstat_frag_to_inode [2,head] 2023-10-03T19:21:27.650 INFO:teuthology.orchestra.run.smithi045.stdout: -1017> 2023-10-03T19:19:53.864+0000 7fd1a5470640 20 mds.0.cache frag rstat n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) 2023-10-03T19:21:27.650 INFO:teuthology.orchestra.run.smithi045.stdout: -1016> 2023-10-03T19:19:53.864+0000 7fd1a5470640 20 mds.0.cache frag accounted_rstat n() 2023-10-03T19:21:27.651 INFO:teuthology.orchestra.run.smithi045.stdout: -1015> 2023-10-03T19:19:53.864+0000 7fd1a5470640 20 mds.0.cache delta n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) 2023-10-03T19:21:27.651 INFO:teuthology.orchestra.run.smithi045.stdout: -1014> 2023-10-03T19:19:53.864+0000 7fd1a5470640 20 mds.0.cache projecting to [2,head] n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1) 2023-10-03T19:21:27.651 INFO:teuthology.orchestra.run.smithi045.stdout: -1013> 2023-10-03T19:19:53.864+0000 7fd1a5470640 20 mds.0.cache result [2,head] n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2) 2023-10-03T19:21:27.651 INFO:teuthology.orchestra.run.smithi045.stdout: -1012> 2023-10-03T19:19:53.864+0000 7fd1a5470640 20 mds.0.cache.dir(0x1) get_num_head_items() = 0; fnode.fragstat.nfiles=0 fnode.fragstat.nsubdirs=0 2023-10-03T19:21:27.651 INFO:teuthology.orchestra.run.smithi045.stdout: -1011> 2023-10-03T19:19:53.864+0000 7fd1a5470640 20 mds.0.cache.dir(0x1) total of child dentries: n() 2023-10-03T19:21:27.651 INFO:teuthology.orchestra.run.smithi045.stdout: -1010> 2023-10-03T19:19:53.864+0000 7fd1a5470640 20 mds.0.cache.dir(0x1) my rstats: n() 2023-10-03T19:21:27.651 INFO:teuthology.orchestra.run.smithi045.stdout: -1009> 2023-10-03T19:19:53.864+0000 7fd1a5470640 10 mds.0.cache.dir(0x1) check_rstats complete on 0x556317b1d180 2023-10-03T19:21:27.651 INFO:teuthology.orchestra.run.smithi045.stdout: -1008> 2023-10-03T19:19:53.864+0000 7fd1a5470640 20 mds.0.journal EMetaBlob::add_dir_context(0x556317b1d180) reached unambig auth subtree, don't need at [dir 0x1 / [2,head] auth pv=3 v=1 cv=1/1 REP dir_auth=0 ap=1+2 state=1073741825|complete f()->f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n()->n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) hs=0+1,ss=0+0 | child=1 subtree=1 dirty=0 authpin=1 0x556317b1d180] 2023-10-03T19:21:27.651 INFO:teuthology.orchestra.run.smithi045.stdout: -1007> 2023-10-03T19:19:53.864+0000 7fd1a5470640 20 mds.0.journal EMetaBlob::add_dir_context final: 2023-10-03T19:21:27.651 INFO:teuthology.orchestra.run.smithi045.stdout: -1006> 2023-10-03T19:19:53.864+0000 7fd1a5470640 7 mds.0.locker issue_new_caps for mode 3 on [inode 0x10000000000 [...2,head] /foo/ auth v2 f() n(v0 1=0+1) (iversion lock) 0x556318acfb80] 2023-10-03T19:21:27.651 INFO:teuthology.orchestra.run.smithi045.stdout: -1005> 2023-10-03T19:19:53.864+0000 7fd1a5470640 10 mds.0.cache.ino(0x10000000000) add_client_cap first cap, joining realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:19:39.424362+0000 change_attr 0 0x556317c178c0) 2023-10-03T19:21:27.652 INFO:teuthology.orchestra.run.smithi045.stdout: -1004> 2023-10-03T19:19:53.864+0000 7fd1a5470640 10 mds.0.openfiles add_inode [inode 0x10000000000 [...2,head] /foo/ auth v2 f() n(v0 1=0+1) (iversion lock) caps={7335=-/-@0} | caps=1 0x556318acfb80] 2023-10-03T19:21:27.652 INFO:teuthology.orchestra.run.smithi045.stdout: -1003> 2023-10-03T19:19:53.864+0000 7fd1a5470640 10 mds.0.locker eval 3648 [inode 0x10000000000 [...2,head] /foo/ auth v2 f() n(v0 1=0+1) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0} | caps=1 0x556318acfb80] 2023-10-03T19:21:27.652 INFO:teuthology.orchestra.run.smithi045.stdout: -1002> 2023-10-03T19:19:53.864+0000 7fd1a5470640 10 mds.0.locker eval set loner: client.-1 -> client.7335 2023-10-03T19:21:27.652 INFO:teuthology.orchestra.run.smithi045.stdout: -1001> 2023-10-03T19:19:53.864+0000 7fd1a5470640 7 mds.0.locker file_eval wanted=sxcrwb loner_wanted=sxcrwb other_wanted= filelock=(ifile sync) on [inode 0x10000000000 [...2,head] /foo/ auth v2 f() n(v0 1=0+1) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318acfb80] 2023-10-03T19:21:27.652 INFO:teuthology.orchestra.run.smithi045.stdout: -1000> 2023-10-03T19:19:53.864+0000 7fd1a5470640 7 mds.0.locker file_eval stable, bump to loner (ifile sync) on [inode 0x10000000000 [...2,head] /foo/ auth v2 f() n(v0 1=0+1) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318acfb80] 2023-10-03T19:21:27.652 INFO:teuthology.orchestra.run.smithi045.stdout: -999> 2023-10-03T19:19:53.864+0000 7fd1a5470640 7 mds.0.locker file_excl (ifile sync) on [inode 0x10000000000 [...2,head] /foo/ auth v2 f() n(v0 1=0+1) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318acfb80] 2023-10-03T19:21:27.652 INFO:teuthology.orchestra.run.smithi045.stdout: -998> 2023-10-03T19:19:53.864+0000 7fd1a5470640 10 mds.0.locker simple_eval (iauth sync) on [inode 0x10000000000 [...2,head] /foo/ auth v2 f() n(v0 1=0+1) (ifile excl) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318acfb80] 2023-10-03T19:21:27.652 INFO:teuthology.orchestra.run.smithi045.stdout: -997> 2023-10-03T19:19:53.864+0000 7fd1a5470640 7 mds.0.locker simple_eval stable, going to excl (iauth sync) on [inode 0x10000000000 [...2,head] /foo/ auth v2 f() n(v0 1=0+1) (ifile excl) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318acfb80] 2023-10-03T19:21:27.652 INFO:teuthology.orchestra.run.smithi045.stdout: -996> 2023-10-03T19:19:53.864+0000 7fd1a5470640 7 mds.0.locker simple_excl on (iauth sync) on [inode 0x10000000000 [...2,head] /foo/ auth v2 f() n(v0 1=0+1) (ifile excl) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318acfb80] 2023-10-03T19:21:27.652 INFO:teuthology.orchestra.run.smithi045.stdout: -995> 2023-10-03T19:19:53.864+0000 7fd1a5470640 10 mds.0.locker simple_eval (ilink sync) on [inode 0x10000000000 [...2,head] /foo/ auth v2 f() n(v0 1=0+1) (iauth excl) (ifile excl) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318acfb80] 2023-10-03T19:21:27.653 INFO:teuthology.orchestra.run.smithi045.stdout: -994> 2023-10-03T19:19:53.864+0000 7fd1a5470640 10 mds.0.locker simple_eval (ixattr sync) on [inode 0x10000000000 [...2,head] /foo/ auth v2 f() n(v0 1=0+1) (iauth excl) (ifile excl) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318acfb80] 2023-10-03T19:21:27.653 INFO:teuthology.orchestra.run.smithi045.stdout: -993> 2023-10-03T19:19:53.864+0000 7fd1a5470640 7 mds.0.locker simple_eval stable, going to excl (ixattr sync) on [inode 0x10000000000 [...2,head] /foo/ auth v2 f() n(v0 1=0+1) (iauth excl) (ifile excl) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318acfb80] 2023-10-03T19:21:27.653 INFO:teuthology.orchestra.run.smithi045.stdout: -992> 2023-10-03T19:19:53.864+0000 7fd1a5470640 7 mds.0.locker simple_excl on (ixattr sync) on [inode 0x10000000000 [...2,head] /foo/ auth v2 f() n(v0 1=0+1) (iauth excl) (ifile excl) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318acfb80] 2023-10-03T19:21:27.653 INFO:teuthology.orchestra.run.smithi045.stdout: -991> 2023-10-03T19:19:53.864+0000 7fd1a5470640 10 mds.0.locker scatter_eval (inest sync) on [inode 0x10000000000 [...2,head] /foo/ auth v2 f() n(v0 1=0+1) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318acfb80] 2023-10-03T19:21:27.653 INFO:teuthology.orchestra.run.smithi045.stdout: -990> 2023-10-03T19:19:53.864+0000 7fd1a5470640 7 mds.0.locker simple_lock on (inest sync) on [inode 0x10000000000 [...2,head] /foo/ auth v2 f() n(v0 1=0+1) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318acfb80] 2023-10-03T19:21:27.653 INFO:teuthology.orchestra.run.smithi045.stdout: -989> 2023-10-03T19:19:53.864+0000 7fd1a5470640 10 mds.0.locker simple_eval (iflock sync) on [inode 0x10000000000 [...2,head] /foo/ auth v2 f() n(v0 1=0+1) (iauth excl) (inest lock) (ifile excl) (ixattr excl) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318acfb80] 2023-10-03T19:21:27.653 INFO:teuthology.orchestra.run.smithi045.stdout: -988> 2023-10-03T19:19:53.864+0000 7fd1a5470640 10 mds.0.locker simple_eval (ipolicy sync) on [inode 0x10000000000 [...2,head] /foo/ auth v2 f() n(v0 1=0+1) (iauth excl) (inest lock) (ifile excl) (ixattr excl) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318acfb80] 2023-10-03T19:21:27.653 INFO:teuthology.orchestra.run.smithi045.stdout: -987> 2023-10-03T19:19:53.864+0000 7fd1a5470640 7 mds.0.locker get_allowed_caps loner client.7335 allowed=pAsxLsXsxFsxcrwb, xlocker allowed=pAsxLsXsxFsxcrwb, others allowed=pLs on [inode 0x10000000000 [...2,head] /foo/ auth v2 f() n(v0 1=0+1) (iauth excl) (inest lock) (ifile excl) (ixattr excl) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318acfb80] 2023-10-03T19:21:27.653 INFO:teuthology.orchestra.run.smithi045.stdout: -986> 2023-10-03T19:19:53.864+0000 7fd1a5470640 20 mds.0.locker client.7335 pending - allowed pAsxLsXsxFsxwb wanted pAsxXsxFsxcrwb 2023-10-03T19:21:27.653 INFO:teuthology.orchestra.run.smithi045.stdout: -985> 2023-10-03T19:19:53.864+0000 7fd1a5470640 20 mds.0.locker !revoke and new|suppressed|stale, skipping client.7335 2023-10-03T19:21:27.653 INFO:teuthology.orchestra.run.smithi045.stdout: -984> 2023-10-03T19:19:53.864+0000 7fd1a5470640 10 mds.0.locker eval done 2023-10-03T19:21:27.653 INFO:teuthology.orchestra.run.smithi045.stdout: -983> 2023-10-03T19:19:53.864+0000 7fd1a5470640 7 mds.0.locker get_allowed_caps loner client.7335 allowed=pAsxLsXsxFsxcrwb, xlocker allowed=pAsxLsXsxFsxcrwb, others allowed=pLs on [inode 0x10000000000 [...2,head] /foo/ auth v2 f() n(v0 1=0+1) (iauth excl) (inest lock) (ifile excl) (ixattr excl) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318acfb80] 2023-10-03T19:21:27.654 INFO:teuthology.orchestra.run.smithi045.stdout: -982> 2023-10-03T19:19:53.864+0000 7fd1a5470640 10 mds.0.openfiles remove_inode [inode 0x10000000000 [...2,head] /foo/ auth v2 f() n(v0 1=0+1) (iauth excl) (inest lock) (ifile excl) (ixattr excl) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318acfb80] 2023-10-03T19:21:27.654 INFO:teuthology.orchestra.run.smithi045.stdout: -981> 2023-10-03T19:19:53.864+0000 7fd1a5470640 10 mds.0.server journal_and_reply tracei 0x556318acfb80 tracedn 0x556318b96000 2023-10-03T19:21:27.654 INFO:teuthology.orchestra.run.smithi045.stdout: -980> 2023-10-03T19:19:53.864+0000 7fd1a5470640 10 mds.0.server early_reply - allocated ino, not allowed 2023-10-03T19:21:27.654 INFO:teuthology.orchestra.run.smithi045.stdout: -979> 2023-10-03T19:19:53.864+0000 7fd1a5470640 7 mds.0.locker get_allowed_caps allowed=pAsLsXsFrwl, xlocker allowed=pAsLsXsFrwl on [inode 0x1 [...2,head] / auth v2 pv3 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f()->f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1)->n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (isnap sync r=1) (inest mix w=1) (ifile mix w=1) (iversion lock w=1 last_client=7335) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=5 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.654 INFO:teuthology.orchestra.run.smithi045.stdout: -978> 2023-10-03T19:19:53.864+0000 7fd1a5470640 20 mds.0.locker client.7335 pending pAsLsXs allowed pAsLsXsFw wanted - 2023-10-03T19:21:27.654 INFO:teuthology.orchestra.run.smithi045.stdout: -977> 2023-10-03T19:19:53.864+0000 7fd1a5470640 7 mds.0.locker get_allowed_caps allowed=pAsLsXsFrwl, xlocker allowed=pAsLsXsFrwl on [inode 0x1 [...2,head] / auth v2 pv3 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f()->f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:51.867949+0000 1=0+1)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1)->n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (isnap sync r=1) (inest mix w=1) (ifile mix w=1) (iversion lock w=1 last_client=7335) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=5 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.658 INFO:teuthology.orchestra.run.smithi045.stdout: -976> 2023-10-03T19:19:53.864+0000 7fd1a5470640 20 mds.0.locker client.7350 pending pAsLsXs allowed pAsLsXsFw wanted - 2023-10-03T19:21:27.658 INFO:teuthology.orchestra.run.smithi045.stdout: -975> 2023-10-03T19:19:53.864+0000 7fd1a5470640 10 mds.0.locker eval done 2023-10-03T19:21:27.658 INFO:teuthology.orchestra.run.smithi045.stdout: -974> 2023-10-03T19:19:53.864+0000 7fd19ec63640 5 mds.0.log _submit_thread 4196891~1991 : EUpdate mkdir [metablob 0x1, 2 dirs alloc_ino=0x10000000000 prealloc_ino=[0x10000000001~0x3e8] v2] 2023-10-03T19:21:27.658 INFO:teuthology.orchestra.run.smithi045.stdout: -973> 2023-10-03T19:19:53.864+0000 7fd19ec63640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.48:42 15.14 15:2e2fa760:::200.00000001:head [write 2587~2011 [fadvise_dontneed] in=2011b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e98) v8 -- 0x556318901880 con 0x5563189cc400 2023-10-03T19:21:27.658 INFO:teuthology.orchestra.run.smithi045.stdout: -972> 2023-10-03T19:19:53.868+0000 7fd1a8c77640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.6 v2:172.21.15.79:6819/1486010128 10 ==== osd_op_reply(42 200.00000001 [write 2587~2011 [fadvise_dontneed]] v98'9 uv9 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x556318aaf440 con 0x5563189cc400 2023-10-03T19:21:27.658 INFO:teuthology.orchestra.run.smithi045.stdout: -971> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 MDSIOContextBase::complete: 18C_MDS_mknod_finish 2023-10-03T19:21:27.658 INFO:teuthology.orchestra.run.smithi045.stdout: -970> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 MDSContext::complete: 18C_MDS_mknod_finish 2023-10-03T19:21:27.658 INFO:teuthology.orchestra.run.smithi045.stdout: -969> 2023-10-03T19:19:53.868+0000 7fd19f464640 12 mds.0.cache.dir(0x1) link_primary_inode [dentry #0x1/foo [2,head] auth NULL (dn xlock x=1 by 0x556318b84c00) (dversion lock w=1 last_client=7335) pv=2 v=1 ap=2 ino=(nil) state=1073741824 | request=1 lock=2 authpin=1 0x556318b96000] [inode 0x10000000000 [...2,head] /foo/ auth v2 f() n(v0 1=0+1) (iauth excl) (inest lock) (ifile excl) (ixattr excl) (iversion lock) caps={7335=-/-@0},l=7335 | request=1 caps=1 0x556318acfb80] 2023-10-03T19:21:27.659 INFO:teuthology.orchestra.run.smithi045.stdout: -968> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 mds.0.openfiles add_dirfrag [dir 0x1 / [2,head] auth pv=3 v=1 cv=1/1 REP dir_auth=0 ap=1+2 state=1073741825|complete f()->f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n()->n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) hs=0+1,ss=0+0 | child=1 subtree=1 dirty=0 authpin=1 0x556317b1d180] 2023-10-03T19:21:27.659 INFO:teuthology.orchestra.run.smithi045.stdout: -967> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 mds.0.cache.ino(0x10000000000) move_to_realm joining realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:19:39.424362+0000 change_attr 0 0x556317c178c0), leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:19:39.424362+0000 change_attr 0 0x556317c178c0) 2023-10-03T19:21:27.659 INFO:teuthology.orchestra.run.smithi045.stdout: -966> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /foo/ auth v2 f() n(v0 1=0+1) (iauth excl) (inest lock) (ifile excl) (ixattr excl) (iversion lock) caps={7335=-/-@0},l=7335 | request=1 caps=1 0x556318acfb80] 2023-10-03T19:21:27.659 INFO:teuthology.orchestra.run.smithi045.stdout: -965> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 mds.0.cache.den(0x1 foo) mark_dirty [dentry #0x1/foo [2,head] auth (dn xlock x=1 by 0x556318b84c00) (dversion lock w=1 last_client=7335) pv=2 v=1 ap=2 ino=0x10000000000 state=1073741824 | request=1 lock=2 inodepin=1 authpin=1 0x556318b96000] 2023-10-03T19:21:27.659 INFO:teuthology.orchestra.run.smithi045.stdout: -964> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 mds.0.cache.dir(0x1) _mark_dirty (was clean) [dir 0x1 / [2,head] auth pv=3 v=1 cv=1/1 REP dir_auth=0 ap=1+2 state=1074003969|complete f()->f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n()->n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=0 authpin=1 0x556317b1d180] version 1 2023-10-03T19:21:27.659 INFO:teuthology.orchestra.run.smithi045.stdout: -963> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 mds.0.cache.ino(0x10000000000) mark_dirty_parent 2023-10-03T19:21:27.659 INFO:teuthology.orchestra.run.smithi045.stdout: -962> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (was clean) [dir 0x10000000000 /foo/ [2,head] auth v=1 cv=0/0 state=1073741953|complete|creating f() n() hs=0+0,ss=0+0 0x556318a52880] version 1 2023-10-03T19:21:27.659 INFO:teuthology.orchestra.run.smithi045.stdout: -961> 2023-10-03T19:19:53.868+0000 7fd19f464640 15 mds.0.cache.ino(0x1) pop_and_dirty_projected_inode v3 2023-10-03T19:21:27.659 INFO:teuthology.orchestra.run.smithi045.stdout: -960> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 mds.0.cache.ino(0x1) mark_dirty [inode 0x1 [...2,head] / auth v3 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (isnap sync r=1) (inest mix w=1) (ifile mix w=1) (iversion lock w=1 last_client=7335) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=5 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.659 INFO:teuthology.orchestra.run.smithi045.stdout: -959> 2023-10-03T19:19:53.868+0000 7fd19f464640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55631892da00 v3 2023-10-03T19:21:27.660 INFO:teuthology.orchestra.run.smithi045.stdout: -958> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth v=3 cv=1/1 REP dir_auth=0 ap=1+2 state=1610874881|complete f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x556317b1d180] version 3 2023-10-03T19:21:27.660 INFO:teuthology.orchestra.run.smithi045.stdout: -957> 2023-10-03T19:19:53.868+0000 7fd19f464640 7 mds.0.cache send_dentry_link [dentry #0x1/foo [2,head] auth (dn xlock x=1 by 0x556318b84c00) (dversion lock w=1 last_client=7335) v=2 ap=2 ino=0x10000000000 state=1610612736 | request=1 lock=2 inodepin=1 dirty=1 authpin=1 0x556318b96000] 2023-10-03T19:21:27.660 INFO:teuthology.orchestra.run.smithi045.stdout: -956> 2023-10-03T19:19:53.868+0000 7fd19f464640 20 mds.0.bal hit_dir 1 pop is 1, frag * size 1 [pop IRD:[C 0.00e+00] IWR:[C 1.00e+00] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 1.35e-01] *LOAD:2.5] 2023-10-03T19:21:27.660 INFO:teuthology.orchestra.run.smithi045.stdout: -955> 2023-10-03T19:19:53.868+0000 7fd19f464640 7 mds.0.server reply_client_request 0 ((0) Success) client_request(client.7335:4 mkdir #0x1/foo 2023-10-03T19:19:53.863091+0000 caller_uid=1000, caller_gid=1271{6,27,108,1271,10102,}) v6 2023-10-03T19:21:27.660 INFO:teuthology.orchestra.run.smithi045.stdout: -954> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 mds.0.server apply_allocated_inos 0x10000000000 / [0x10000000001~0x3e8] / 0x0 2023-10-03T19:21:27.660 INFO:teuthology.orchestra.run.smithi045.stdout: -953> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 mds.0.inotable: apply_alloc_id 0x10000000000 to [0x100000003e9~0xfffffffc17]/[0x10000000000~0x10000000000] 2023-10-03T19:21:27.660 INFO:teuthology.orchestra.run.smithi045.stdout: -952> 2023-10-03T19:19:53.868+0000 7fd19f464640 20 mds.0.sessionmap mark_dirty s=0x556318a4b700 name=client.7335 v=2 2023-10-03T19:21:27.660 INFO:teuthology.orchestra.run.smithi045.stdout: -951> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 mds.0.inotable: apply_alloc_ids [0x10000000001~0x3e8] to [0x100000003e9~0xfffffffc17]/[0x10000000001~0xffffffffff] 2023-10-03T19:21:27.660 INFO:teuthology.orchestra.run.smithi045.stdout: -950> 2023-10-03T19:19:53.868+0000 7fd19f464640 20 mds.0.server lat 0.007338 2023-10-03T19:21:27.660 INFO:teuthology.orchestra.run.smithi045.stdout: -949> 2023-10-03T19:19:53.868+0000 7fd19f464640 7 mds.0.locker local_wrlock_finish on (iversion lock w=1 last_client=7335) on [inode 0x1 [...2,head] / auth v3 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (isnap sync r=1) (inest mix w=1) (ifile mix w=1) (iversion lock w=1 last_client=7335) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=5 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.660 INFO:teuthology.orchestra.run.smithi045.stdout: -948> 2023-10-03T19:19:53.868+0000 7fd19f464640 7 mds.0.locker wrlock_finish on (ifile mix w=1) on [inode 0x1 [...2,head] / auth v3 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (isnap sync r=1) (inest mix w=1) (ifile mix w=1) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=4 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.661 INFO:teuthology.orchestra.run.smithi045.stdout: -947> 2023-10-03T19:19:53.868+0000 7fd19f464640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile mix) on [inode 0x1 [...2,head] / auth v3 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (isnap sync r=1) (inest mix w=1) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.661 INFO:teuthology.orchestra.run.smithi045.stdout: -946> 2023-10-03T19:19:53.868+0000 7fd19f464640 7 mds.0.locker wrlock_finish on (inest mix w=1) on [inode 0x1 [...2,head] / auth v3 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (isnap sync r=1) (inest mix w=1) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.661 INFO:teuthology.orchestra.run.smithi045.stdout: -945> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 mds.0.locker scatter_eval (inest mix) on [inode 0x1 [...2,head] / auth v3 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (isnap sync r=1) (inest mix) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.661 INFO:teuthology.orchestra.run.smithi045.stdout: -944> 2023-10-03T19:19:53.868+0000 7fd19f464640 7 mds.0.locker simple_lock on (inest mix) on [inode 0x1 [...2,head] / auth v3 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (isnap sync r=1) (inest mix) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@3,7350=pAsLsXs/-@2} | request=0 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.661 INFO:teuthology.orchestra.run.smithi045.stdout: -943> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 mds.0.locker xlock_finish on (dn xlock x=1 by 0x556318b84c00) [dentry #0x1/foo [2,head] auth (dn xlock x=1 by 0x556318b84c00) (dversion lock w=1 last_client=7335) v=2 ap=2 ino=0x10000000000 state=1610612736 | request=1 lock=2 inodepin=1 dirty=1 authpin=1 0x556318b96000] 2023-10-03T19:21:27.661 INFO:teuthology.orchestra.run.smithi045.stdout: -942> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 mds.0.locker eval_gather (dn xlock) on [dentry #0x1/foo [2,head] auth (dn xlock) (dversion lock w=1 last_client=7335) v=2 ap=2 ino=0x10000000000 state=1610612736 | request=1 lock=1 inodepin=1 dirty=1 authpin=1 0x556318b96000] 2023-10-03T19:21:27.661 INFO:teuthology.orchestra.run.smithi045.stdout: -941> 2023-10-03T19:19:53.868+0000 7fd19f464640 7 mds.0.locker eval_gather finished gather on (dn xlock) on [dentry #0x1/foo [2,head] auth (dn xlock) (dversion lock w=1 last_client=7335) v=2 ap=2 ino=0x10000000000 state=1610612736 | request=1 lock=1 inodepin=1 dirty=1 authpin=1 0x556318b96000] 2023-10-03T19:21:27.661 INFO:teuthology.orchestra.run.smithi045.stdout: -940> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 mds.0.cache.den(0x1 foo) auth_unpin by 0x556318b960e8 on [dentry #0x1/foo [2,head] auth (dversion lock w=1 last_client=7335) v=2 ap=1 ino=0x10000000000 state=1610612736 | request=1 lock=1 inodepin=1 dirty=1 authpin=1 0x556318b96000] now 1 2023-10-03T19:21:27.661 INFO:teuthology.orchestra.run.smithi045.stdout: -939> 2023-10-03T19:19:53.868+0000 7fd19f464640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth v=3 cv=1/1 REP dir_auth=0 ap=1+1 state=1610874881|complete f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x556317b1d180] by 0x556318b960e8 count now 1/1 2023-10-03T19:21:27.661 INFO:teuthology.orchestra.run.smithi045.stdout: -938> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 mds.0.locker simple_eval (dn sync) on [dentry #0x1/foo [2,head] auth (dversion lock w=1 last_client=7335) v=2 ap=1 ino=0x10000000000 state=1610612736 | request=1 lock=1 inodepin=1 dirty=1 authpin=1 0x556318b96000] 2023-10-03T19:21:27.662 INFO:teuthology.orchestra.run.smithi045.stdout: -937> 2023-10-03T19:19:53.868+0000 7fd19f464640 7 mds.0.locker local_wrlock_finish on (dversion lock w=1 last_client=7335) on [dentry #0x1/foo [2,head] auth (dversion lock w=1 last_client=7335) v=2 ap=1 ino=0x10000000000 state=1610612736 | request=1 lock=1 inodepin=1 dirty=1 authpin=1 0x556318b96000] 2023-10-03T19:21:27.662 INFO:teuthology.orchestra.run.smithi045.stdout: -936> 2023-10-03T19:19:53.868+0000 7fd19f464640 20 mds.0.server set_trace_dist snapid head 2023-10-03T19:21:27.662 INFO:teuthology.orchestra.run.smithi045.stdout: -935> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 mds.0.server set_trace_dist snaprealm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:19:39.424362+0000 change_attr 0 0x556317c178c0) len=70 2023-10-03T19:21:27.662 INFO:teuthology.orchestra.run.smithi045.stdout: -934> 2023-10-03T19:19:53.868+0000 7fd19f464640 20 mds.0.cache.ino(0x1) pfile 0 pauth 0 plink 0 pxattr 0 plocal 0 mtime 2023-10-03T19:19:53.863091+0000 ctime 2023-10-03T19:19:53.863091+0000 change_attr 2 valid=1 2023-10-03T19:21:27.662 INFO:teuthology.orchestra.run.smithi045.stdout: -933> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 mds.0.cache.ino(0x1) encode_inodestat issuing pAsLsXs seq 4 2023-10-03T19:21:27.662 INFO:teuthology.orchestra.run.smithi045.stdout: -932> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 mds.0.cache.ino(0x1) encode_inodestat caps pAsLsXs seq 4 mseq 0 xattrv 0 2023-10-03T19:21:27.662 INFO:teuthology.orchestra.run.smithi045.stdout: -931> 2023-10-03T19:19:53.868+0000 7fd19f464640 20 mds.0.server set_trace_dist added diri [inode 0x1 [...2,head] / auth v3 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (iauth sync r=1) (isnap sync r=1) (inest lock) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@4,7350=pAsLsXs/-@2} | request=0 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.662 INFO:teuthology.orchestra.run.smithi045.stdout: -930> 2023-10-03T19:19:53.868+0000 7fd19f464640 20 mds.0.server set_trace_dist added dir [dir 0x1 / [2,head] auth v=3 cv=1/1 REP dir_auth=0 ap=1+1 state=1610874881|complete f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x556317b1d180] 2023-10-03T19:21:27.662 INFO:teuthology.orchestra.run.smithi045.stdout: -929> 2023-10-03T19:19:53.868+0000 7fd19f464640 20 mds.0.cache.den(0x1 foo) add_client_lease client.7335 on (dn sync) 2023-10-03T19:21:27.662 INFO:teuthology.orchestra.run.smithi045.stdout: -928> 2023-10-03T19:19:53.868+0000 7fd19f464640 20 mds.0.locker issue_client_lease seq 2 dur 30000ms on [dentry #0x1/foo [2,head] auth (dn sync l) (dversion lock) v=2 ap=1 ino=0x10000000000 state=1610612736 | request=1 lock=0 inodepin=1 dirty=1 authpin=1 clientlease=1 0x556318b96000] 2023-10-03T19:21:27.662 INFO:teuthology.orchestra.run.smithi045.stdout: -927> 2023-10-03T19:19:53.868+0000 7fd19f464640 20 mds.0.cache.ino(0x10000000000) pfile 1 pauth 1 plink 1 pxattr 1 plocal 0 mtime 2023-10-03T19:19:53.863091+0000 ctime 2023-10-03T19:19:53.863091+0000 change_attr 0 valid=1 2023-10-03T19:21:27.663 INFO:teuthology.orchestra.run.smithi045.stdout: -926> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 mds.0.cache.ino(0x10000000000) encode_inodestat issuing pAsxLsXsxFsx seq 1 2023-10-03T19:21:27.663 INFO:teuthology.orchestra.run.smithi045.stdout: -925> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 mds.0.cache.ino(0x10000000000) encode_inodestat caps pAsxLsXsxFsx seq 1 mseq 0 xattrv 1 2023-10-03T19:21:27.663 INFO:teuthology.orchestra.run.smithi045.stdout: -924> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 mds.0.cache.ino(0x10000000000) including xattrs version 1 2023-10-03T19:21:27.663 INFO:teuthology.orchestra.run.smithi045.stdout: -923> 2023-10-03T19:19:53.868+0000 7fd19f464640 20 mds.0.server set_trace_dist added snap head in [inode 0x10000000000 [...2,head] /foo/ auth v2 DIRTYPARENT f() n(v0 1=0+1) (iauth excl) (inest lock) (ifile excl) (ixattr excl) (iversion lock) caps={7335=pAsxLsXsxFsx/-@1},l=7335 | request=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 0x556318acfb80] 2023-10-03T19:21:27.663 INFO:teuthology.orchestra.run.smithi045.stdout: -922> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 mds.0.48 send_message_client client.7335 172.21.15.146:0/990159870 client_reply(???:4 = 0 (0) Success safe) v1 2023-10-03T19:21:27.663 INFO:teuthology.orchestra.run.smithi045.stdout: -921> 2023-10-03T19:19:53.868+0000 7fd19f464640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> 172.21.15.146:0/990159870 -- client_reply(???:4 = 0 (0) Success safe) v1 -- 0x556317aefdc0 con 0x556318b59000 2023-10-03T19:21:27.663 INFO:teuthology.orchestra.run.smithi045.stdout: -920> 2023-10-03T19:19:53.868+0000 7fd19f464640 7 mds.0.cache request_finish request(client.7335:4 nref=2 cr=0x556318ac8900) 2023-10-03T19:21:27.663 INFO:teuthology.orchestra.run.smithi045.stdout: -919> 2023-10-03T19:19:53.868+0000 7fd19f464640 15 mds.0.cache request_cleanup request(client.7335:4 nref=2 cr=0x556318ac8900) 2023-10-03T19:21:27.663 INFO:teuthology.orchestra.run.smithi045.stdout: -918> 2023-10-03T19:19:53.868+0000 7fd19f464640 7 mds.0.locker rdlock_finish on (iauth sync) on [inode 0x1 [...2,head] / auth v3 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (inest lock) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@4,7350=pAsLsXs/-@2} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.663 INFO:teuthology.orchestra.run.smithi045.stdout: -917> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 mds.0.locker simple_eval (iauth sync) on [inode 0x1 [...2,head] / auth v3 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (inest lock) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@4,7350=pAsLsXs/-@2} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.663 INFO:teuthology.orchestra.run.smithi045.stdout: -916> 2023-10-03T19:19:53.868+0000 7fd19f464640 7 mds.0.locker rdlock_finish on (isnap sync) on [inode 0x1 [...2,head] / auth v3 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (inest lock) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@4,7350=pAsLsXs/-@2} | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.663 INFO:teuthology.orchestra.run.smithi045.stdout: -915> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 mds.0.locker simple_eval (isnap sync) on [inode 0x1 [...2,head] / auth v3 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (inest lock) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@4,7350=pAsLsXs/-@2} | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:27.664 INFO:teuthology.orchestra.run.smithi045.stdout: -914> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 mds.0.cache.dir(0x1) auth_unpin by 0x556318b84c00 on [dir 0x1 / [2,head] auth v=3 cv=1/1 REP dir_auth=0 ap=0+1 state=1610874881|complete f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=0 0x556317b1d180] count now 0 2023-10-03T19:21:27.664 INFO:teuthology.orchestra.run.smithi045.stdout: -913> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 mds.0.cache.den(0x1 foo) auth_unpin by 0x556318b84c00 on [dentry #0x1/foo [2,head] auth (dn sync l) (dversion lock) v=2 ino=0x10000000000 state=1610612736 | request=1 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x556318b96000] now 0 2023-10-03T19:21:27.664 INFO:teuthology.orchestra.run.smithi045.stdout: -912> 2023-10-03T19:19:53.868+0000 7fd19f464640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth v=3 cv=1/1 REP dir_auth=0 state=1610874881|complete f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=0 0x556317b1d180] by 0x556318b84c00 count now 0/0 2023-10-03T19:21:27.664 INFO:teuthology.orchestra.run.smithi045.stdout: -911> 2023-10-03T19:19:53.868+0000 7fd19f464640 10 mds.0.cache.ino(0x1) auth_unpin by 0x556318b84c00 on [inode 0x1 [...2,head] / auth v3 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (inest lock) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@4,7350=pAsLsXs/-@2} | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=0 0x556317b3c680] now 0 2023-10-03T19:21:27.664 INFO:teuthology.orchestra.run.smithi045.stdout: -910> 2023-10-03T19:19:53.872+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7335 172.21.15.146:0/990159870 11 ==== client_request(client.7335:5 mkdir #0x10000000000/bar 2023-10-03T19:19:53.873286+0000 caller_uid=1000, caller_gid=1271{6,27,108,1271,10102,}) v6 ==== 243+0+0 (crc 0 0 0) 0x556318ac8c00 con 0x556318b59000 2023-10-03T19:21:27.664 INFO:teuthology.orchestra.run.smithi045.stdout: -909> 2023-10-03T19:19:53.872+0000 7fd1a5470640 4 mds.0.server handle_client_request client_request(client.7335:5 mkdir #0x10000000000/bar 2023-10-03T19:19:53.873286+0000 caller_uid=1000, caller_gid=1271{6,27,108,1271,10102,}) v6 2023-10-03T19:21:27.664 INFO:teuthology.orchestra.run.smithi045.stdout: -908> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.48 get_session have 0x556318a4b700 client.7335 172.21.15.146:0/990159870 state open 2023-10-03T19:21:27.664 INFO:teuthology.orchestra.run.smithi045.stdout: -907> 2023-10-03T19:19:53.872+0000 7fd1a5470640 15 mds.0.server oldest_client_tid=5 2023-10-03T19:21:27.664 INFO:teuthology.orchestra.run.smithi045.stdout: -906> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.cache request_start request(client.7335:5 nref=2 cr=0x556318ac8c00) 2023-10-03T19:21:27.665 INFO:teuthology.orchestra.run.smithi045.stdout: -905> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker process_request_cap_release client.7335 pAsxLsXsxFsx on [inode 0x10000000000 [...2,head] /foo/ auth v2 DIRTYPARENT f() n(v0 1=0+1) (iauth excl) (inest lock) (ifile excl) (ixattr excl) (iversion lock) caps={7335=pAsxLsXsxFsx/-@1},l=7335 | request=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 0x556318acfb80] 2023-10-03T19:21:27.665 INFO:teuthology.orchestra.run.smithi045.stdout: -904> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker wanted - -> - 2023-10-03T19:21:27.665 INFO:teuthology.orchestra.run.smithi045.stdout: -903> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker eval 3648 [inode 0x10000000000 [...2,head] /foo/ auth v2 DIRTYPARENT f() n(v0 1=0+1) (iauth excl) (inest lock) (ifile excl) (ixattr excl) (iversion lock) caps={7335=pAsxLsXsxFsx/-@1},l=7335 | request=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 0x556318acfb80] 2023-10-03T19:21:27.665 INFO:teuthology.orchestra.run.smithi045.stdout: -902> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000000 [...2,head] /foo/ auth v2 DIRTYPARENT f() n(v0 1=0+1) (iauth excl) (inest lock) (ifile excl) (ixattr excl) (iversion lock) caps={7335=pAsxLsXsxFsx/-@1},l=7335 | request=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 0x556318acfb80] 2023-10-03T19:21:27.665 INFO:teuthology.orchestra.run.smithi045.stdout: -901> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.locker is excl 2023-10-03T19:21:27.665 INFO:teuthology.orchestra.run.smithi045.stdout: -900> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker file_eval loner_issued=sx other_issued= xlocker_issued= 2023-10-03T19:21:27.665 INFO:teuthology.orchestra.run.smithi045.stdout: -899> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker simple_eval (iauth excl) on [inode 0x10000000000 [...2,head] /foo/ auth v2 DIRTYPARENT f() n(v0 1=0+1) (iauth excl) (inest lock) (ifile excl) (ixattr excl) (iversion lock) caps={7335=pAsxLsXsxFsx/-@1},l=7335 | request=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 0x556318acfb80] 2023-10-03T19:21:27.665 INFO:teuthology.orchestra.run.smithi045.stdout: -898> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker simple_eval stable, syncing (iauth excl) on [inode 0x10000000000 [...2,head] /foo/ auth v2 DIRTYPARENT f() n(v0 1=0+1) (iauth excl) (inest lock) (ifile excl) (ixattr excl) (iversion lock) caps={7335=pAsxLsXsxFsx/-@1},l=7335 | request=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 0x556318acfb80] 2023-10-03T19:21:27.665 INFO:teuthology.orchestra.run.smithi045.stdout: -897> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker simple_sync on (iauth excl) on [inode 0x10000000000 [...2,head] /foo/ auth v2 DIRTYPARENT f() n(v0 1=0+1) (iauth excl) (inest lock) (ifile excl) (ixattr excl) (iversion lock) caps={7335=pAsxLsXsxFsx/-@1},l=7335 | request=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 0x556318acfb80] 2023-10-03T19:21:27.665 INFO:teuthology.orchestra.run.smithi045.stdout: -896> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache.ino(0x10000000000) auth_pin by 0x556318acfe10 on [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=1 DIRTYPARENT f() n(v0 1=0+1) (iauth excl->sync) (inest lock) (ifile excl) (ixattr excl) (iversion lock) caps={7335=pAsxLsXsxFsx/-@1},l=7335 | request=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556318acfb80] now 1 2023-10-03T19:21:27.666 INFO:teuthology.orchestra.run.smithi045.stdout: -895> 2023-10-03T19:19:53.872+0000 7fd1a5470640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins 1 on [dir 0x1 / [2,head] auth v=3 cv=1/1 REP dir_auth=0 ap=0+1 state=1610874881|complete f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=0 0x556317b1d180] by 0x556318acfb80 count now 0/1 2023-10-03T19:21:27.688 INFO:teuthology.orchestra.run.smithi045.stdout: -894> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker simple_eval (ilink sync) on [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=1 DIRTYPARENT f() n(v0 1=0+1) (iauth excl->sync) (inest lock) (ifile excl) (ixattr excl) (iversion lock) caps={7335=pAsxLsXsxFsx/-@1},l=7335 | request=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.688 INFO:teuthology.orchestra.run.smithi045.stdout: -893> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker simple_eval (ixattr excl) on [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=1 DIRTYPARENT f() n(v0 1=0+1) (iauth excl->sync) (inest lock) (ifile excl) (ixattr excl) (iversion lock) caps={7335=pAsxLsXsxFsx/-@1},l=7335 | request=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.688 INFO:teuthology.orchestra.run.smithi045.stdout: -892> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker simple_eval stable, syncing (ixattr excl) on [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=1 DIRTYPARENT f() n(v0 1=0+1) (iauth excl->sync) (inest lock) (ifile excl) (ixattr excl) (iversion lock) caps={7335=pAsxLsXsxFsx/-@1},l=7335 | request=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.688 INFO:teuthology.orchestra.run.smithi045.stdout: -891> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker simple_sync on (ixattr excl) on [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=1 DIRTYPARENT f() n(v0 1=0+1) (iauth excl->sync) (inest lock) (ifile excl) (ixattr excl) (iversion lock) caps={7335=pAsxLsXsxFsx/-@1},l=7335 | request=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.688 INFO:teuthology.orchestra.run.smithi045.stdout: -890> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache.ino(0x10000000000) auth_pin by 0x556318acfec0 on [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=2 DIRTYPARENT f() n(v0 1=0+1) (iauth excl->sync) (inest lock) (ifile excl) (ixattr excl->sync) (iversion lock) caps={7335=pAsxLsXsxFsx/-@1},l=7335 | request=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556318acfb80] now 2 2023-10-03T19:21:27.688 INFO:teuthology.orchestra.run.smithi045.stdout: -889> 2023-10-03T19:19:53.872+0000 7fd1a5470640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins 1 on [dir 0x1 / [2,head] auth v=3 cv=1/1 REP dir_auth=0 ap=0+2 state=1610874881|complete f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=0 0x556317b1d180] by 0x556318acfb80 count now 0/2 2023-10-03T19:21:27.689 INFO:teuthology.orchestra.run.smithi045.stdout: -888> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker get_allowed_caps loner client.7335 allowed=pAsLsXsFsxcrwb, xlocker allowed=pAsLsXsFsxcrwb, others allowed=pLs on [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=2 DIRTYPARENT f() n(v0 1=0+1) (iauth excl->sync) (inest lock) (ifile excl) (ixattr excl->sync) (iversion lock) caps={7335=pAsxLsXsxFsx/-@1},l=7335 | request=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.689 INFO:teuthology.orchestra.run.smithi045.stdout: -887> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.locker client.7335 pending pAsxLsXsxFsx allowed pAsLsXsFsxwb wanted - 2023-10-03T19:21:27.689 INFO:teuthology.orchestra.run.smithi045.stdout: -886> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker sending MClientCaps to client.7335 seq 2 new pending pAsLsXsFsx was pAsxLsXsxFsx 2023-10-03T19:21:27.689 INFO:teuthology.orchestra.run.smithi045.stdout: -885> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache.ino(0x10000000000) encode_cap_message pfile 1 pauth 0 plink 0 pxattr 0 mtime 2023-10-03T19:19:53.863091+0000 ctime 2023-10-03T19:19:53.863091+0000 change_attr 0 2023-10-03T19:21:27.689 INFO:teuthology.orchestra.run.smithi045.stdout: -884> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.48 send_message_client_counted client.7335 seq 1 client_caps(revoke ino 0x10000000000 1 seq 2 caps=pAsLsXsFsx dirty=- wanted=- follows 0 size 0/0 ts 1/18446744073709551615 mtime 2023-10-03T19:19:53.863091+0000 ctime 2023-10-03T19:19:53.863091+0000 change_attr 0) v12 2023-10-03T19:21:27.689 INFO:teuthology.orchestra.run.smithi045.stdout: -883> 2023-10-03T19:19:53.872+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> 172.21.15.146:0/990159870 -- client_caps(revoke ino 0x10000000000 1 seq 2 caps=pAsLsXsFsx dirty=- wanted=- follows 0 size 0/0 ts 1/18446744073709551615 mtime 2023-10-03T19:19:53.863091+0000 ctime 2023-10-03T19:19:53.863091+0000 change_attr 0) v12 -- 0x556318ad2380 con 0x556318b59000 2023-10-03T19:21:27.689 INFO:teuthology.orchestra.run.smithi045.stdout: -882> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker eval done 2023-10-03T19:21:27.690 INFO:teuthology.orchestra.run.smithi045.stdout: -881> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.server dispatch_client_request client_request(client.7335:5 mkdir #0x10000000000/bar 2023-10-03T19:19:53.873286+0000 caller_uid=1000, caller_gid=1271{6,27,108,1271,10102,}) v6 2023-10-03T19:21:27.690 INFO:teuthology.orchestra.run.smithi045.stdout: -880> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.server rdlock_path_xlock_dentry request(client.7335:5 nref=2 cr=0x556318ac8c00) #0x10000000000/bar 2023-10-03T19:21:27.690 INFO:teuthology.orchestra.run.smithi045.stdout: -879> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.cache traverse: opening base ino 0x10000000000 snap head 2023-10-03T19:21:27.690 INFO:teuthology.orchestra.run.smithi045.stdout: -878> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker try_rdlock_snap_layout request(client.7335:5 nref=3 cr=0x556318ac8c00) [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=2 DIRTYPARENT f() n(v0 1=0+1) (iauth excl->sync) (inest lock) (ifile excl) (ixattr excl->sync) (iversion lock) caps={7335=pAsLsXsFsx/pAsxLsXsxFsx/-@2},l=7335 | request=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.690 INFO:teuthology.orchestra.run.smithi045.stdout: -877> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.locker got rdlock on (isnap sync r=1) [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=2 DIRTYPARENT f() n(v0 1=0+1) (iauth excl->sync) (isnap sync r=1) (inest lock) (ifile excl) (ixattr excl->sync) (iversion lock) caps={7335=pAsLsXsFsx/pAsxLsXsxFsx/-@2},l=7335 | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.690 INFO:teuthology.orchestra.run.smithi045.stdout: -876> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.locker got rdlock on (isnap sync r=1) [inode 0x1 [...2,head] / auth v3 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (inest lock) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@4,7350=pAsLsXs/-@2} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.690 INFO:teuthology.orchestra.run.smithi045.stdout: -875> 2023-10-03T19:19:53.872+0000 7fd1a5470640 12 mds.0.cache traverse: path seg depth 0 'bar' snapid head 2023-10-03T19:21:27.690 INFO:teuthology.orchestra.run.smithi045.stdout: -874> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache.dir(0x10000000000) lookup (bar, 'head') 2023-10-03T19:21:27.690 INFO:teuthology.orchestra.run.smithi045.stdout: -873> 2023-10-03T19:19:53.872+0000 7fd1a5470640 12 mds.0.cache traverse: miss on dentry bar in [dir 0x10000000000 /foo/ [2,head] auth v=1 cv=0/0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 0x556318a52880] 2023-10-03T19:21:27.690 INFO:teuthology.orchestra.run.smithi045.stdout: -872> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache.dir(0x10000000000) lookup_exact_snap (head, 'bar') 2023-10-03T19:21:27.691 INFO:teuthology.orchestra.run.smithi045.stdout: -871> 2023-10-03T19:19:53.872+0000 7fd1a5470640 12 mds.0.cache.dir(0x10000000000) add_null_dentry [dentry #0x1/foo/bar [2,head] auth NULL (dversion lock) pv=0 v=1 ino=(nil) state=1073741824 0x556318b96280] 2023-10-03T19:21:27.691 INFO:teuthology.orchestra.run.smithi045.stdout: -870> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache added null [dentry #0x1/foo/bar [2,head] auth NULL (dversion lock) pv=0 v=1 ino=(nil) state=1073741824 0x556318b96280] 2023-10-03T19:21:27.691 INFO:teuthology.orchestra.run.smithi045.stdout: -869> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker acquire_locks request(client.7335:5 nref=3 cr=0x556318ac8c00) 2023-10-03T19:21:27.691 INFO:teuthology.orchestra.run.smithi045.stdout: -868> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.locker must wrlock (ifile excl) [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=2 DIRTYPARENT f() n(v0 1=0+1) (iauth excl->sync) (isnap sync r=1) (inest lock) (ifile excl) (ixattr excl->sync) (iversion lock) caps={7335=pAsLsXsFsx/pAsxLsXsxFsx/-@2},l=7335 | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.691 INFO:teuthology.orchestra.run.smithi045.stdout: -867> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.locker must wrlock (inest lock) [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=2 DIRTYPARENT f() n(v0 1=0+1) (iauth excl->sync) (isnap sync r=1) (inest lock) (ifile excl) (ixattr excl->sync) (iversion lock) caps={7335=pAsLsXsFsx/pAsxLsXsxFsx/-@2},l=7335 | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.691 INFO:teuthology.orchestra.run.smithi045.stdout: -866> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.locker must rdlock (iauth excl->sync) [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=2 DIRTYPARENT f() n(v0 1=0+1) (iauth excl->sync) (isnap sync r=1) (inest lock) (ifile excl) (ixattr excl->sync) (iversion lock) caps={7335=pAsLsXsFsx/pAsxLsXsxFsx/-@2},l=7335 | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.691 INFO:teuthology.orchestra.run.smithi045.stdout: -865> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.locker must xlock (dn sync) [dentry #0x1/foo/bar [2,head] auth NULL (dversion lock) pv=0 v=1 ino=(nil) state=1073741824 0x556318b96280] 2023-10-03T19:21:27.691 INFO:teuthology.orchestra.run.smithi045.stdout: -864> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.locker must wrlock (dversion lock) [dentry #0x1/foo/bar [2,head] auth NULL (dversion lock) pv=0 v=1 ino=(nil) state=1073741824 0x556318b96280] 2023-10-03T19:21:27.691 INFO:teuthology.orchestra.run.smithi045.stdout: -863> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker must authpin [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=2 DIRTYPARENT f() n(v0 1=0+1) (iauth excl->sync) (isnap sync r=1) (inest lock) (ifile excl) (ixattr excl->sync) (iversion lock) caps={7335=pAsLsXsFsx/pAsxLsXsxFsx/-@2},l=7335 | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.691 INFO:teuthology.orchestra.run.smithi045.stdout: -862> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker must authpin [dentry #0x1/foo/bar [2,head] auth NULL (dversion lock) pv=0 v=1 ino=(nil) state=1073741824 0x556318b96280] 2023-10-03T19:21:27.691 INFO:teuthology.orchestra.run.smithi045.stdout: -861> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker auth_pinning [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=2 DIRTYPARENT f() n(v0 1=0+1) (iauth excl->sync) (isnap sync r=1) (inest lock) (ifile excl) (ixattr excl->sync) (iversion lock) caps={7335=pAsLsXsFsx/pAsxLsXsxFsx/-@2},l=7335 | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.691 INFO:teuthology.orchestra.run.smithi045.stdout: -860> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache.ino(0x10000000000) auth_pin by 0x556318b85000 on [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=3 DIRTYPARENT f() n(v0 1=0+1) (iauth excl->sync) (isnap sync r=1) (inest lock) (ifile excl) (ixattr excl->sync) (iversion lock) caps={7335=pAsLsXsFsx/pAsxLsXsxFsx/-@2},l=7335 | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556318acfb80] now 3 2023-10-03T19:21:27.692 INFO:teuthology.orchestra.run.smithi045.stdout: -859> 2023-10-03T19:19:53.872+0000 7fd1a5470640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins 1 on [dir 0x1 / [2,head] auth v=3 cv=1/1 REP dir_auth=0 ap=0+3 state=1610874881|complete f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=0 0x556317b1d180] by 0x556318acfb80 count now 0/3 2023-10-03T19:21:27.692 INFO:teuthology.orchestra.run.smithi045.stdout: -858> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker auth_pinning [dentry #0x1/foo/bar [2,head] auth NULL (dversion lock) pv=0 v=1 ino=(nil) state=1073741824 0x556318b96280] 2023-10-03T19:21:27.692 INFO:teuthology.orchestra.run.smithi045.stdout: -857> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache.den(0x10000000000 bar) auth_pin by 0x556318b85000 on [dentry #0x1/foo/bar [2,head] auth NULL (dversion lock) pv=0 v=1 ap=1 ino=(nil) state=1073741824 | authpin=1 0x556318b96280] now 1 2023-10-03T19:21:27.692 INFO:teuthology.orchestra.run.smithi045.stdout: -856> 2023-10-03T19:19:53.872+0000 7fd1a5470640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins 1 on [dir 0x10000000000 /foo/ [2,head] auth v=1 cv=0/0 ap=0+1 state=1610612737|complete f() n() hs=0+1,ss=0+0 | child=1 dirty=1 0x556318a52880] by 0x556318b85000 count now 0/1 2023-10-03T19:21:27.692 INFO:teuthology.orchestra.run.smithi045.stdout: -855> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker wrlock_start (ifile excl) on [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=3 DIRTYPARENT f() n(v0 1=0+1) (iauth excl->sync) (isnap sync r=1) (inest lock) (ifile excl) (ixattr excl->sync) (iversion lock) caps={7335=pAsLsXsFsx/pAsxLsXsxFsx/-@2},l=7335 | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.692 INFO:teuthology.orchestra.run.smithi045.stdout: -854> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker got wrlock on (ifile excl w=1) [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=3 DIRTYPARENT f() n(v0 1=0+1) (iauth excl->sync) (isnap sync r=1) (inest lock) (ifile excl w=1) (ixattr excl->sync) (iversion lock) caps={7335=pAsLsXsFsx/pAsxLsXsxFsx/-@2},l=7335 | request=0 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.692 INFO:teuthology.orchestra.run.smithi045.stdout: -853> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker wrlock_start (inest lock) on [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=3 DIRTYPARENT f() n(v0 1=0+1) (iauth excl->sync) (isnap sync r=1) (inest lock) (ifile excl w=1) (ixattr excl->sync) (iversion lock) caps={7335=pAsLsXsFsx/pAsxLsXsxFsx/-@2},l=7335 | request=0 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.692 INFO:teuthology.orchestra.run.smithi045.stdout: -852> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker got wrlock on (inest lock w=1) [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=3 DIRTYPARENT f() n(v0 1=0+1) (iauth excl->sync) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (ixattr excl->sync) (iversion lock) caps={7335=pAsLsXsFsx/pAsxLsXsxFsx/-@2},l=7335 | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.692 INFO:teuthology.orchestra.run.smithi045.stdout: -851> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker rdlock_start on (iauth excl->sync) on [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=3 DIRTYPARENT f() n(v0 1=0+1) (iauth excl->sync) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (ixattr excl->sync) (iversion lock) caps={7335=pAsLsXsFsx/pAsxLsXsxFsx/-@2},l=7335 | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.692 INFO:teuthology.orchestra.run.smithi045.stdout: -850> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker rdlock_start waiting on (iauth excl->sync) on [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=3 DIRTYPARENT f() n(v0 1=0+1) (iauth excl->sync) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (ixattr excl->sync) (iversion lock) caps={7335=pAsLsXsFsx/pAsxLsXsxFsx/-@2},l=7335 | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.692 INFO:teuthology.orchestra.run.smithi045.stdout: -849> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache.ino(0x10000000000) add_waiter tag 2000000000040000 0x55631893f420 !ambig 1 !frozen 1 !freezing 1 2023-10-03T19:21:27.693 INFO:teuthology.orchestra.run.smithi045.stdout: -848> 2023-10-03T19:19:53.872+0000 7fd1a5470640 15 mds.0.cache.ino(0x10000000000) taking waiter here 2023-10-03T19:21:27.693 INFO:teuthology.orchestra.run.smithi045.stdout: -847> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker nudge_log (iauth excl->sync) on [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=3 DIRTYPARENT f() n(v0 1=0+1) (iauth excl->sync) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (ixattr excl->sync) (iversion lock) caps={7335=pAsLsXsFsx/pAsxLsXsxFsx/-@2},l=7335 | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=1 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.693 INFO:teuthology.orchestra.run.smithi045.stdout: -846> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache traverse: failed to rdlock (dn sync) [dentry #0x1/foo/bar [2,head] auth NULL (dversion lock) pv=0 v=1 ap=1 ino=(nil) state=1073741824 | authpin=1 0x556318b96280] 2023-10-03T19:21:27.693 INFO:teuthology.orchestra.run.smithi045.stdout: -845> 2023-10-03T19:19:53.872+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7335 172.21.15.146:0/990159870 12 ==== client_caps(update ino 0x10000000000 1 seq 2 caps=pAsLsXsFsx dirty=- wanted=AsLsXsFsx follows 0 size 0/0 ts 1/18446744073709551615 mtime 2023-10-03T19:19:53.863091+0000 ctime 2023-10-03T19:19:53.863091+0000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x556318ad2e00 con 0x556318b59000 2023-10-03T19:21:27.693 INFO:teuthology.orchestra.run.smithi045.stdout: -844> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker handle_client_caps on 0x10000000000 tid 0 follows 0 op update flags 0x0 2023-10-03T19:21:27.693 INFO:teuthology.orchestra.run.smithi045.stdout: -843> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.48 get_session have 0x556318a4b700 client.7335 172.21.15.146:0/990159870 state open 2023-10-03T19:21:27.693 INFO:teuthology.orchestra.run.smithi045.stdout: -842> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker head inode [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=3 DIRTYPARENT f() n(v0 1=0+1) (iauth excl->sync) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (ixattr excl->sync) (iversion lock) caps={7335=pAsLsXsFsx/pAsxLsXsxFsx/-@2},l=7335 | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=1 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.693 INFO:teuthology.orchestra.run.smithi045.stdout: -841> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker follows 0 retains pAsLsXsFsx dirty - on [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=3 DIRTYPARENT f() n(v0 1=0+1) (iauth excl->sync) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (ixattr excl->sync) (iversion lock) caps={7335=pAsLsXsFsx/-@2},l=7335 | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=1 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.693 INFO:teuthology.orchestra.run.smithi045.stdout: -840> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker wanted - -> AsLsXsFsx 2023-10-03T19:21:27.693 INFO:teuthology.orchestra.run.smithi045.stdout: -839> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.openfiles add_inode [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=3 DIRTYPARENT f() n(v0 1=0+1) (iauth excl->sync) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (ixattr excl->sync) (iversion lock) caps={7335=pAsLsXsFsx/-@2},l=7335 | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=1 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.693 INFO:teuthology.orchestra.run.smithi045.stdout: -838> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker _do_cap_update dirty - issued pAsLsXsFsx wanted AsLsXsFsx on [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=3 DIRTYPARENT f() n(v0 1=0+1) (iauth excl->sync) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (ixattr excl->sync) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@2},l=7335 | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=1 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.694 INFO:teuthology.orchestra.run.smithi045.stdout: -837> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker eval 3648 [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=3 DIRTYPARENT f() n(v0 1=0+1) (iauth excl->sync) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (ixattr excl->sync) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@2},l=7335 | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=1 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.694 INFO:teuthology.orchestra.run.smithi045.stdout: -836> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker file_eval wanted=sx loner_wanted=sx other_wanted= filelock=(ifile excl w=1) on [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=3 DIRTYPARENT f() n(v0 1=0+1) (iauth excl->sync) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (ixattr excl->sync) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@2},l=7335 | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=1 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.694 INFO:teuthology.orchestra.run.smithi045.stdout: -835> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.locker is excl 2023-10-03T19:21:27.694 INFO:teuthology.orchestra.run.smithi045.stdout: -834> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker file_eval loner_issued=sx other_issued= xlocker_issued= 2023-10-03T19:21:27.694 INFO:teuthology.orchestra.run.smithi045.stdout: -833> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker eval_gather (iauth excl->sync) on [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=3 DIRTYPARENT f() n(v0 1=0+1) (iauth excl->sync) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (ixattr excl->sync) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@2},l=7335 | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=1 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.694 INFO:teuthology.orchestra.run.smithi045.stdout: -832> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker next state is sync issued/allows loner s/s xlocker /s other /s 2023-10-03T19:21:27.694 INFO:teuthology.orchestra.run.smithi045.stdout: -831> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker eval_gather finished gather on (iauth excl->sync) on [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=3 DIRTYPARENT f() n(v0 1=0+1) (iauth excl->sync) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (ixattr excl->sync) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@2},l=7335 | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=1 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.694 INFO:teuthology.orchestra.run.smithi045.stdout: -830> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x556318acfe10 on [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=2 DIRTYPARENT f() n(v0 1=0+1) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (ixattr excl->sync) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@2},l=7335 | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=1 authpin=1 0x556318acfb80] now 2 2023-10-03T19:21:27.694 INFO:teuthology.orchestra.run.smithi045.stdout: -829> 2023-10-03T19:19:53.872+0000 7fd1a5470640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth v=3 cv=1/1 REP dir_auth=0 ap=0+2 state=1610874881|complete f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=0 0x556317b1d180] by 0x556318acfe10 count now 0/2 2023-10-03T19:21:27.694 INFO:teuthology.orchestra.run.smithi045.stdout: -828> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker simple_eval (iauth sync) on [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=2 DIRTYPARENT f() n(v0 1=0+1) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (ixattr excl->sync) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@2},l=7335 | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.694 INFO:teuthology.orchestra.run.smithi045.stdout: -827> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker simple_eval (ilink sync) on [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=2 DIRTYPARENT f() n(v0 1=0+1) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (ixattr excl->sync) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@2},l=7335 | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.695 INFO:teuthology.orchestra.run.smithi045.stdout: -826> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker eval_gather (ixattr excl->sync) on [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=2 DIRTYPARENT f() n(v0 1=0+1) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (ixattr excl->sync) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@2},l=7335 | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.695 INFO:teuthology.orchestra.run.smithi045.stdout: -825> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker next state is sync issued/allows loner s/s xlocker /s other /s 2023-10-03T19:21:27.695 INFO:teuthology.orchestra.run.smithi045.stdout: -824> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker eval_gather finished gather on (ixattr excl->sync) on [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=2 DIRTYPARENT f() n(v0 1=0+1) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (ixattr excl->sync) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@2},l=7335 | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.695 INFO:teuthology.orchestra.run.smithi045.stdout: -823> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x556318acfec0 on [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=1 DIRTYPARENT f() n(v0 1=0+1) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@2},l=7335 | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] now 1 2023-10-03T19:21:27.695 INFO:teuthology.orchestra.run.smithi045.stdout: -822> 2023-10-03T19:19:53.872+0000 7fd1a5470640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth v=3 cv=1/1 REP dir_auth=0 ap=0+1 state=1610874881|complete f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=0 0x556317b1d180] by 0x556318acfec0 count now 0/1 2023-10-03T19:21:27.695 INFO:teuthology.orchestra.run.smithi045.stdout: -821> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker simple_eval (ixattr sync) on [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=1 DIRTYPARENT f() n(v0 1=0+1) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@2},l=7335 | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.695 INFO:teuthology.orchestra.run.smithi045.stdout: -820> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 MDSContext::complete: 18C_MDS_RetryRequest 2023-10-03T19:21:27.695 INFO:teuthology.orchestra.run.smithi045.stdout: -819> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.server dispatch_client_request client_request(client.7335:5 mkdir #0x10000000000/bar 2023-10-03T19:19:53.873286+0000 caller_uid=1000, caller_gid=1271{6,27,108,1271,10102,}) v6 2023-10-03T19:21:27.695 INFO:teuthology.orchestra.run.smithi045.stdout: -818> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.server rdlock_path_xlock_dentry request(client.7335:5 nref=2 cr=0x556318ac8c00) #0x10000000000/bar 2023-10-03T19:21:27.695 INFO:teuthology.orchestra.run.smithi045.stdout: -817> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.cache traverse: opening base ino 0x10000000000 snap head 2023-10-03T19:21:27.695 INFO:teuthology.orchestra.run.smithi045.stdout: -816> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker try_rdlock_snap_layout request(client.7335:5 nref=3 cr=0x556318ac8c00) [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=1 DIRTYPARENT f() n(v0 1=0+1) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@2},l=7335 | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.696 INFO:teuthology.orchestra.run.smithi045.stdout: -815> 2023-10-03T19:19:53.872+0000 7fd1a5470640 12 mds.0.cache traverse: path seg depth 0 'bar' snapid head 2023-10-03T19:21:27.696 INFO:teuthology.orchestra.run.smithi045.stdout: -814> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache.dir(0x10000000000) lookup (bar, 'head') 2023-10-03T19:21:27.696 INFO:teuthology.orchestra.run.smithi045.stdout: -813> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache.dir(0x10000000000) hit -> (bar,head) 2023-10-03T19:21:27.696 INFO:teuthology.orchestra.run.smithi045.stdout: -812> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker acquire_locks request(client.7335:5 nref=3 cr=0x556318ac8c00) 2023-10-03T19:21:27.696 INFO:teuthology.orchestra.run.smithi045.stdout: -811> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.locker must wrlock (ifile excl w=1) [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=1 DIRTYPARENT f() n(v0 1=0+1) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@2},l=7335 | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.696 INFO:teuthology.orchestra.run.smithi045.stdout: -810> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.locker must wrlock (inest lock w=1) [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=1 DIRTYPARENT f() n(v0 1=0+1) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@2},l=7335 | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.696 INFO:teuthology.orchestra.run.smithi045.stdout: -809> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.locker must rdlock (iauth sync) [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=1 DIRTYPARENT f() n(v0 1=0+1) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@2},l=7335 | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.696 INFO:teuthology.orchestra.run.smithi045.stdout: -808> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.locker must xlock (dn sync) [dentry #0x1/foo/bar [2,head] auth NULL (dversion lock) pv=0 v=1 ap=1 ino=(nil) state=1073741824 | authpin=1 0x556318b96280] 2023-10-03T19:21:27.696 INFO:teuthology.orchestra.run.smithi045.stdout: -807> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.locker must wrlock (dversion lock) [dentry #0x1/foo/bar [2,head] auth NULL (dversion lock) pv=0 v=1 ap=1 ino=(nil) state=1073741824 | authpin=1 0x556318b96280] 2023-10-03T19:21:27.696 INFO:teuthology.orchestra.run.smithi045.stdout: -806> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker must authpin [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=1 DIRTYPARENT f() n(v0 1=0+1) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@2},l=7335 | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.696 INFO:teuthology.orchestra.run.smithi045.stdout: -805> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker must authpin [dentry #0x1/foo/bar [2,head] auth NULL (dversion lock) pv=0 v=1 ap=1 ino=(nil) state=1073741824 | authpin=1 0x556318b96280] 2023-10-03T19:21:27.697 INFO:teuthology.orchestra.run.smithi045.stdout: -804> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker already auth_pinned [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=1 DIRTYPARENT f() n(v0 1=0+1) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@2},l=7335 | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.697 INFO:teuthology.orchestra.run.smithi045.stdout: -803> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker already auth_pinned [dentry #0x1/foo/bar [2,head] auth NULL (dversion lock) pv=0 v=1 ap=1 ino=(nil) state=1073741824 | authpin=1 0x556318b96280] 2023-10-03T19:21:27.697 INFO:teuthology.orchestra.run.smithi045.stdout: -802> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker already wrlocked (ifile excl w=1) [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=1 DIRTYPARENT f() n(v0 1=0+1) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@2},l=7335 | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.697 INFO:teuthology.orchestra.run.smithi045.stdout: -801> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker already wrlocked (inest lock w=1) [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=1 DIRTYPARENT f() n(v0 1=0+1) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@2},l=7335 | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.697 INFO:teuthology.orchestra.run.smithi045.stdout: -800> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker rdlock_start on (iauth sync) on [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=1 DIRTYPARENT f() n(v0 1=0+1) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@2},l=7335 | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.697 INFO:teuthology.orchestra.run.smithi045.stdout: -799> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker got rdlock on (iauth sync r=1) [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=1 DIRTYPARENT f() n(v0 1=0+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@2},l=7335 | request=0 lock=4 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.697 INFO:teuthology.orchestra.run.smithi045.stdout: -798> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker xlock_start on (dn sync) on [dentry #0x1/foo/bar [2,head] auth NULL (dversion lock) pv=0 v=1 ap=1 ino=(nil) state=1073741824 | authpin=1 0x556318b96280] 2023-10-03T19:21:27.697 INFO:teuthology.orchestra.run.smithi045.stdout: -797> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker simple_lock on (dn sync) on [dentry #0x1/foo/bar [2,head] auth NULL (dversion lock) pv=0 v=1 ap=1 ino=(nil) state=1073741824 | authpin=1 0x556318b96280] 2023-10-03T19:21:27.697 INFO:teuthology.orchestra.run.smithi045.stdout: -796> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker simple_xlock on (dn lock) on [dentry #0x1/foo/bar [2,head] auth NULL (dn lock) (dversion lock) pv=0 v=1 ap=1 ino=(nil) state=1073741824 | request=1 authpin=1 0x556318b96280] 2023-10-03T19:21:27.697 INFO:teuthology.orchestra.run.smithi045.stdout: -795> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache.den(0x10000000000 bar) auth_pin by 0x556318b96368 on [dentry #0x1/foo/bar [2,head] auth NULL (dn lock) (dversion lock) pv=0 v=1 ap=2 ino=(nil) state=1073741824 | request=1 authpin=1 0x556318b96280] now 2 2023-10-03T19:21:27.697 INFO:teuthology.orchestra.run.smithi045.stdout: -794> 2023-10-03T19:19:53.872+0000 7fd1a5470640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins 1 on [dir 0x10000000000 /foo/ [2,head] auth v=1 cv=0/0 ap=0+2 state=1610612737|complete f() n() hs=0+1,ss=0+0 | child=1 dirty=1 0x556318a52880] by 0x556318b96368 count now 0/2 2023-10-03T19:21:27.698 INFO:teuthology.orchestra.run.smithi045.stdout: -793> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker got xlock on (dn xlock x=1 by 0x556318b85000) [dentry #0x1/foo/bar [2,head] auth NULL (dn xlock x=1 by 0x556318b85000) (dversion lock) pv=0 v=1 ap=2 ino=(nil) state=1073741824 | request=1 lock=1 authpin=1 0x556318b96280] 2023-10-03T19:21:27.698 INFO:teuthology.orchestra.run.smithi045.stdout: -792> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker local_wrlock_start on (dversion lock) on [dentry #0x1/foo/bar [2,head] auth NULL (dn xlock x=1 by 0x556318b85000) (dversion lock) pv=0 v=1 ap=2 ino=(nil) state=1073741824 | request=1 lock=1 authpin=1 0x556318b96280] 2023-10-03T19:21:27.698 INFO:teuthology.orchestra.run.smithi045.stdout: -791> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker got wrlock on (dversion lock w=1 last_client=7335) [dentry #0x1/foo/bar [2,head] auth NULL (dn xlock x=1 by 0x556318b85000) (dversion lock w=1 last_client=7335) pv=0 v=1 ap=2 ino=(nil) state=1073741824 | request=1 lock=2 authpin=1 0x556318b96280] 2023-10-03T19:21:27.698 INFO:teuthology.orchestra.run.smithi045.stdout: -790> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache traverse: null+readable dentry at [dentry #0x1/foo/bar [2,head] auth NULL (dn xlock x=1 by 0x556318b85000) (dversion lock w=1 last_client=7335) pv=0 v=1 ap=2 ino=(nil) state=1073741824 | request=1 lock=2 authpin=1 0x556318b96280] 2023-10-03T19:21:27.698 INFO:teuthology.orchestra.run.smithi045.stdout: -789> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache path_traverse finish on snapid head 2023-10-03T19:21:27.698 INFO:teuthology.orchestra.run.smithi045.stdout: -788> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 Session check_access path /foo 2023-10-03T19:21:27.698 INFO:teuthology.orchestra.run.smithi045.stdout: -787> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.server fragment [dir 0x10000000000 /foo/ [2,head] auth v=1 cv=0/0 ap=0+2 state=1610612737|complete f() n() hs=0+1,ss=0+0 | child=1 dirty=1 0x556318a52880] size 0 < 100000 2023-10-03T19:21:27.698 INFO:teuthology.orchestra.run.smithi045.stdout: -786> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.sessionmap mark_projected s=0x556318a4b700 name=client.7335 pv=3 -> 4 2023-10-03T19:21:27.698 INFO:teuthology.orchestra.run.smithi045.stdout: -785> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.server prepare_new_inode used_prealloc 0x10000000001 (1000 left) 2023-10-03T19:21:27.698 INFO:teuthology.orchestra.run.smithi045.stdout: -784> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.server dir mode 040775 new mode 040775 2023-10-03T19:21:27.698 INFO:teuthology.orchestra.run.smithi045.stdout: -783> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.server copying fscrypt_auth len 0 2023-10-03T19:21:27.699 INFO:teuthology.orchestra.run.smithi045.stdout: -782> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.server prepare_new_inode [inode 0x10000000001 [...2,head] #10000000001/ auth v1 f() n() (iversion lock) 0x556318ad0100] 2023-10-03T19:21:27.699 INFO:teuthology.orchestra.run.smithi045.stdout: -781> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache.dir(0x10000000000) pre_dirty 2 2023-10-03T19:21:27.699 INFO:teuthology.orchestra.run.smithi045.stdout: -780> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache.den(0x10000000000 bar) pre_dirty [dentry #0x1/foo/bar [2,head] auth NULL (dn xlock x=1 by 0x556318b85000) (dversion lock w=1 last_client=7335) pv=2 v=1 ap=2 ino=(nil) state=1073741824 | request=1 lock=2 authpin=1 0x556318b96280] 2023-10-03T19:21:27.699 INFO:teuthology.orchestra.run.smithi045.stdout: -779> 2023-10-03T19:19:53.872+0000 7fd1a5470640 12 mds.0.server follows 1 2023-10-03T19:21:27.699 INFO:teuthology.orchestra.run.smithi045.stdout: -778> 2023-10-03T19:19:53.872+0000 7fd1a5470640 15 mds.0.cache.ino(0x10000000001) maybe_export_pin update=0 [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 f() n(v0 1=0+1) (iversion lock) 0x556318ad0100] 2023-10-03T19:21:27.699 INFO:teuthology.orchestra.run.smithi045.stdout: -777> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache.dir(0x10000000001) pre_dirty 1 2023-10-03T19:21:27.699 INFO:teuthology.orchestra.run.smithi045.stdout: -776> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.server journal_allocated_inos sessionmapv 4 inotablev 2 2023-10-03T19:21:27.699 INFO:teuthology.orchestra.run.smithi045.stdout: -775> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache predirty_journal_parents do_parent_mtime linkunlink=1 primary_dn follows head [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 f() n(v0 1=0+1) (iversion lock) 0x556318ad0100] 2023-10-03T19:21:27.699 INFO:teuthology.orchestra.run.smithi045.stdout: -774> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache.dir(0x10000000000) auth_pin by 0x556318b85000 on [dir 0x10000000000 /foo/ [2,head] auth v=1 cv=0/0 ap=1+2 state=1610612737|complete f() n() hs=0+1,ss=0+0 | child=1 dirty=1 authpin=1 0x556318a52880] count now 1 2023-10-03T19:21:27.699 INFO:teuthology.orchestra.run.smithi045.stdout: -773> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache.dir(0x10000000000) project_fnode 0x55631892dc40 2023-10-03T19:21:27.699 INFO:teuthology.orchestra.run.smithi045.stdout: -772> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache.dir(0x10000000000) pre_dirty 3 2023-10-03T19:21:27.699 INFO:teuthology.orchestra.run.smithi045.stdout: -771> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache predirty_journal_parents bumping fragstat change_attr to 1 on 0x556318a52880 2023-10-03T19:21:27.800 INFO:teuthology.orchestra.run.smithi045.stdout: -770> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache predirty_journal_parents updating mtime on [dir 0x10000000000 /foo/ [2,head] auth pv=3 v=1 cv=0/0 ap=1+2 state=1610612737|complete f()->f(v0 m2023-10-03T19:19:53.873286+0000)/f() n()->n() hs=0+1,ss=0+0 | child=1 dirty=1 authpin=1 0x556318a52880] 2023-10-03T19:21:27.800 INFO:teuthology.orchestra.run.smithi045.stdout: -769> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache predirty_journal_parents updating size on [dir 0x10000000000 /foo/ [2,head] auth pv=3 v=1 cv=0/0 ap=1+2 state=1610612737|complete f()->f(v0 m2023-10-03T19:19:53.873286+0000)/f() n()->n(v0 rc2023-10-03T19:19:53.873286+0000)/n() hs=0+1,ss=0+0 | child=1 dirty=1 authpin=1 0x556318a52880] 2023-10-03T19:21:27.800 INFO:teuthology.orchestra.run.smithi045.stdout: -768> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache projected_rstat_inode_to_frag first 2 linkunlink 1 [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 f() n(v0 1=0+1) (iversion lock) 0x556318ad0100] 2023-10-03T19:21:27.800 INFO:teuthology.orchestra.run.smithi045.stdout: -767> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache frag head is [2,head] 2023-10-03T19:21:27.800 INFO:teuthology.orchestra.run.smithi045.stdout: -766> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache inode update is [2,head] 2023-10-03T19:21:27.800 INFO:teuthology.orchestra.run.smithi045.stdout: -765> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache floor of 2 from parent dn [dentry #0x1/foo/bar [2,head] auth NULL (dn xlock x=1 by 0x556318b85000) (dversion lock w=1 last_client=7335) pv=2 v=1 ap=2 ino=(nil) state=1073741824 | request=1 lock=2 authpin=1 0x556318b96280] 2023-10-03T19:21:27.801 INFO:teuthology.orchestra.run.smithi045.stdout: -764> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache.snaprealm(0x1 seq 1 0x556317c178c0) get_snaps (seq 1 cached_seq 1) 2023-10-03T19:21:27.801 INFO:teuthology.orchestra.run.smithi045.stdout: -763> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache _project_rstat_inode_to_frag [2,head] 2023-10-03T19:21:27.801 INFO:teuthology.orchestra.run.smithi045.stdout: -762> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache inode rstat n(v0 1=0+1) 2023-10-03T19:21:27.801 INFO:teuthology.orchestra.run.smithi045.stdout: -761> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache inode accounted_rstat n(v0 1=0+1) 2023-10-03T19:21:27.801 INFO:teuthology.orchestra.run.smithi045.stdout: -760> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache delta n(v0 1=0+1) 2023-10-03T19:21:27.801 INFO:teuthology.orchestra.run.smithi045.stdout: -759> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache projecting to head [2,head] n(v0 rc2023-10-03T19:19:53.873286+0000) 2023-10-03T19:21:27.801 INFO:teuthology.orchestra.run.smithi045.stdout: -758> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache project to [2,head] n(v0 rc2023-10-03T19:19:53.873286+0000) 2023-10-03T19:21:27.801 INFO:teuthology.orchestra.run.smithi045.stdout: -757> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache result [2,head] n(v0 rc2023-10-03T19:19:53.873286+0000 1=0+1) [dir 0x10000000000 /foo/ [2,head] auth pv=3 v=1 cv=0/0 ap=1+2 state=1610612737|complete f()->f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1)/f() n()->n(v0 rc2023-10-03T19:19:53.873286+0000 1=0+1)/n() hs=0+1,ss=0+0 | child=1 dirty=1 authpin=1 0x556318a52880] 2023-10-03T19:21:27.801 INFO:teuthology.orchestra.run.smithi045.stdout: -756> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker local_wrlock_grab on (iversion lock) on [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=1 DIRTYPARENT f() n(v0 1=0+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@2},l=7335 | request=0 lock=4 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.801 INFO:teuthology.orchestra.run.smithi045.stdout: -755> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache.ino(0x10000000000) pre_cow_old_inode follows 1 on [inode 0x10000000000 [...2,head] /foo/ auth v2 ap=1 DIRTYPARENT f() n(v0 1=0+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (iversion lock w=1 last_client=7335) caps={7335=pAsLsXsFsx/AsLsXsFsx@2},l=7335 | request=0 lock=5 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.802 INFO:teuthology.orchestra.run.smithi045.stdout: -754> 2023-10-03T19:19:53.872+0000 7fd1a5470640 15 mds.0.cache.ino(0x10000000000) project_inode 0x10000000000 2023-10-03T19:21:27.802 INFO:teuthology.orchestra.run.smithi045.stdout: -753> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache.dir(0x1) pre_dirty 4 2023-10-03T19:21:27.802 INFO:teuthology.orchestra.run.smithi045.stdout: -752> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache.den(0x1 foo) pre_dirty [dentry #0x1/foo [2,head] auth (dn sync l) (dversion lock) pv=4 v=2 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x556318b96000] 2023-10-03T19:21:27.802 INFO:teuthology.orchestra.run.smithi045.stdout: -751> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache.ino(0x10000000000) pre_dirty 4 (current v 2) 2023-10-03T19:21:27.802 INFO:teuthology.orchestra.run.smithi045.stdout: -750> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache predirty_journal_parents add_delta f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) 2023-10-03T19:21:27.802 INFO:teuthology.orchestra.run.smithi045.stdout: -749> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache predirty_journal_parents - f() 2023-10-03T19:21:27.802 INFO:teuthology.orchestra.run.smithi045.stdout: -748> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache predirty_journal_parents gives f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) on [inode 0x10000000000 [...2,head] /foo/ auth v2 pv4 ap=1 DIRTYPARENT f()->f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 1=0+1)->n(v0 1=0+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (iversion lock w=1 last_client=7335) caps={7335=pAsLsXsFsx/AsLsXsFsx@2},l=7335 | request=0 lock=5 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.802 INFO:teuthology.orchestra.run.smithi045.stdout: -747> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache predirty_journal_parents frag->inode on [dir 0x10000000000 /foo/ [2,head] auth pv=3 v=1 cv=0/0 ap=1+2 state=1610612737|complete f()->f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n()->n(v0 rc2023-10-03T19:19:53.873286+0000 1=0+1)/n() hs=0+1,ss=0+0 | child=1 dirty=1 authpin=1 0x556318a52880] 2023-10-03T19:21:27.802 INFO:teuthology.orchestra.run.smithi045.stdout: -746> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache project_rstat_frag_to_inode [2,head] 2023-10-03T19:21:27.802 INFO:teuthology.orchestra.run.smithi045.stdout: -745> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache frag rstat n(v0 rc2023-10-03T19:19:53.873286+0000 1=0+1) 2023-10-03T19:21:27.803 INFO:teuthology.orchestra.run.smithi045.stdout: -744> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache frag accounted_rstat n() 2023-10-03T19:21:27.803 INFO:teuthology.orchestra.run.smithi045.stdout: -743> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache delta n(v0 rc2023-10-03T19:19:53.873286+0000 1=0+1) 2023-10-03T19:21:27.803 INFO:teuthology.orchestra.run.smithi045.stdout: -742> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache projecting to [2,head] n(v0 1=0+1) 2023-10-03T19:21:27.803 INFO:teuthology.orchestra.run.smithi045.stdout: -741> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache result [2,head] n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) 2023-10-03T19:21:27.803 INFO:teuthology.orchestra.run.smithi045.stdout: -740> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache.dir(0x10000000000) get_num_head_items() = 0; fnode.fragstat.nfiles=0 fnode.fragstat.nsubdirs=0 2023-10-03T19:21:27.803 INFO:teuthology.orchestra.run.smithi045.stdout: -739> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache.dir(0x10000000000) total of child dentries: n() 2023-10-03T19:21:27.803 INFO:teuthology.orchestra.run.smithi045.stdout: -738> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache.dir(0x10000000000) my rstats: n() 2023-10-03T19:21:27.803 INFO:teuthology.orchestra.run.smithi045.stdout: -737> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache.dir(0x10000000000) check_rstats complete on 0x556318a52880 2023-10-03T19:21:27.803 INFO:teuthology.orchestra.run.smithi045.stdout: -736> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache.dir(0x1) auth_pin by 0x556318b85000 on [dir 0x1 / [2,head] auth v=3 cv=1/1 REP dir_auth=0 ap=1+1 state=1610874881|complete f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x556317b1d180] count now 1 2023-10-03T19:21:27.803 INFO:teuthology.orchestra.run.smithi045.stdout: -735> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache.dir(0x1) project_fnode 0x55631892dd60 2023-10-03T19:21:27.803 INFO:teuthology.orchestra.run.smithi045.stdout: -734> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache.dir(0x1) pre_dirty 5 2023-10-03T19:21:27.803 INFO:teuthology.orchestra.run.smithi045.stdout: -733> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache taking wrlock on (inest lock) on [inode 0x1 [...2,head] / auth v3 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (inest lock) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@4,7350=pAsLsXs/-@2} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.804 INFO:teuthology.orchestra.run.smithi045.stdout: -732> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker wrlock_force on (inest lock) on [inode 0x1 [...2,head] / auth v3 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (inest lock) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@4,7350=pAsLsXs/-@2} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.804 INFO:teuthology.orchestra.run.smithi045.stdout: -731> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache projected_rstat_inode_to_frag first 2 linkunlink 0 [inode 0x10000000000 [...2,head] /foo/ auth v2 pv4 ap=1 DIRTYPARENT f()->f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 1=0+1)->n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2)/n(v0 1=0+1) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (iversion lock w=1 last_client=7335) caps={7335=pAsLsXsFsx/AsLsXsFsx@2},l=7335 | request=0 lock=5 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.804 INFO:teuthology.orchestra.run.smithi045.stdout: -730> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache frag head is [2,head] 2023-10-03T19:21:27.804 INFO:teuthology.orchestra.run.smithi045.stdout: -729> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache inode update is [2,head] 2023-10-03T19:21:27.804 INFO:teuthology.orchestra.run.smithi045.stdout: -728> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache floor of 2 from parent dn [dentry #0x1/foo [2,head] auth (dn sync l) (dversion lock) pv=4 v=2 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x556318b96000] 2023-10-03T19:21:27.804 INFO:teuthology.orchestra.run.smithi045.stdout: -727> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache.snaprealm(0x1 seq 1 0x556317c178c0) get_snaps (seq 1 cached_seq 1) 2023-10-03T19:21:27.804 INFO:teuthology.orchestra.run.smithi045.stdout: -726> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache _project_rstat_inode_to_frag [2,head] 2023-10-03T19:21:27.804 INFO:teuthology.orchestra.run.smithi045.stdout: -725> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache inode rstat n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) 2023-10-03T19:21:27.804 INFO:teuthology.orchestra.run.smithi045.stdout: -724> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache inode accounted_rstat n(v0 1=0+1) 2023-10-03T19:21:27.804 INFO:teuthology.orchestra.run.smithi045.stdout: -723> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache delta n(v0 rc2023-10-03T19:19:53.873286+0000 1=0+1) 2023-10-03T19:21:27.804 INFO:teuthology.orchestra.run.smithi045.stdout: -722> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache projecting to head [2,head] n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) 2023-10-03T19:21:27.805 INFO:teuthology.orchestra.run.smithi045.stdout: -721> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache project to [2,head] n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) 2023-10-03T19:21:27.805 INFO:teuthology.orchestra.run.smithi045.stdout: -720> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache result [2,head] n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) [dir 0x1 / [2,head] auth pv=5 v=3 cv=1/1 REP dir_auth=0 ap=1+1 state=1610874881|complete f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1)->f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1)->n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2)/n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x556317b1d180] 2023-10-03T19:21:27.805 INFO:teuthology.orchestra.run.smithi045.stdout: -719> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache predirty_journal_parents last prop 0.00951597 < 1, stopping 2023-10-03T19:21:27.805 INFO:teuthology.orchestra.run.smithi045.stdout: -718> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache predirty_journal_parents stop. marking nestlock on [inode 0x1 [...2,head] / auth v3 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (inest lock w=1) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@4,7350=pAsLsXs/-@2} | request=0 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.805 INFO:teuthology.orchestra.run.smithi045.stdout: -717> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker mark_updated_scatterlock (inest lock w=1 dirty) - added at 2023-10-03T19:19:53.876248+0000 2023-10-03T19:21:27.805 INFO:teuthology.orchestra.run.smithi045.stdout: -716> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.journal EMetaBlob::add_dir_context(0x556317b1d180) reached unambig auth subtree, don't need at [dir 0x1 / [2,head] auth pv=5 v=3 cv=1/1 REP dir_auth=0 ap=1+1 state=1610874881|complete f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1)->f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1)->n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2)/n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x556317b1d180] 2023-10-03T19:21:27.805 INFO:teuthology.orchestra.run.smithi045.stdout: -715> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.journal EMetaBlob::add_dir_context final: 2023-10-03T19:21:27.805 INFO:teuthology.orchestra.run.smithi045.stdout: -714> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache journal_cow_dentry follows head on [dentry #0x1/foo [2,head] auth (dn sync l) (dversion lock) pv=4 v=2 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x556318b96000] 2023-10-03T19:21:27.805 INFO:teuthology.orchestra.run.smithi045.stdout: -713> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache journal_cow_dentry follows 1 < first on [inode 0x10000000000 [...2,head] /foo/ auth v2 pv4 ap=1 DIRTYPARENT f()->f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 1=0+1)->n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (iversion lock w=1 last_client=7335) caps={7335=pAsLsXsFsx/AsLsXsFsx@2},l=7335 | request=0 lock=5 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.805 INFO:teuthology.orchestra.run.smithi045.stdout: -712> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker issue_new_caps for mode 3 on [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 f() n(v0 1=0+1) (iversion lock) 0x556318ad0100] 2023-10-03T19:21:27.806 INFO:teuthology.orchestra.run.smithi045.stdout: -711> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache.ino(0x10000000001) add_client_cap first cap, joining realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:19:39.424362+0000 change_attr 0 0x556317c178c0) 2023-10-03T19:21:27.815 INFO:teuthology.orchestra.run.smithi045.stdout: -710> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.openfiles add_inode [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 f() n(v0 1=0+1) (iversion lock) caps={7335=-/-@0} | caps=1 0x556318ad0100] 2023-10-03T19:21:27.815 INFO:teuthology.orchestra.run.smithi045.stdout: -709> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker eval 3648 [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 f() n(v0 1=0+1) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0} | caps=1 0x556318ad0100] 2023-10-03T19:21:27.815 INFO:teuthology.orchestra.run.smithi045.stdout: -708> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker eval set loner: client.-1 -> client.7335 2023-10-03T19:21:27.816 INFO:teuthology.orchestra.run.smithi045.stdout: -707> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker file_eval wanted=sxcrwb loner_wanted=sxcrwb other_wanted= filelock=(ifile sync) on [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 f() n(v0 1=0+1) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318ad0100] 2023-10-03T19:21:27.816 INFO:teuthology.orchestra.run.smithi045.stdout: -706> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker file_eval stable, bump to loner (ifile sync) on [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 f() n(v0 1=0+1) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318ad0100] 2023-10-03T19:21:27.816 INFO:teuthology.orchestra.run.smithi045.stdout: -705> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker file_excl (ifile sync) on [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 f() n(v0 1=0+1) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318ad0100] 2023-10-03T19:21:27.816 INFO:teuthology.orchestra.run.smithi045.stdout: -704> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker simple_eval (iauth sync) on [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 f() n(v0 1=0+1) (ifile excl) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318ad0100] 2023-10-03T19:21:27.816 INFO:teuthology.orchestra.run.smithi045.stdout: -703> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker simple_eval stable, going to excl (iauth sync) on [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 f() n(v0 1=0+1) (ifile excl) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318ad0100] 2023-10-03T19:21:27.816 INFO:teuthology.orchestra.run.smithi045.stdout: -702> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker simple_excl on (iauth sync) on [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 f() n(v0 1=0+1) (ifile excl) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318ad0100] 2023-10-03T19:21:27.816 INFO:teuthology.orchestra.run.smithi045.stdout: -701> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker simple_eval (ilink sync) on [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 f() n(v0 1=0+1) (iauth excl) (ifile excl) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318ad0100] 2023-10-03T19:21:27.816 INFO:teuthology.orchestra.run.smithi045.stdout: -700> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker simple_eval (ixattr sync) on [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 f() n(v0 1=0+1) (iauth excl) (ifile excl) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318ad0100] 2023-10-03T19:21:27.816 INFO:teuthology.orchestra.run.smithi045.stdout: -699> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker simple_eval stable, going to excl (ixattr sync) on [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 f() n(v0 1=0+1) (iauth excl) (ifile excl) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318ad0100] 2023-10-03T19:21:27.816 INFO:teuthology.orchestra.run.smithi045.stdout: -698> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker simple_excl on (ixattr sync) on [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 f() n(v0 1=0+1) (iauth excl) (ifile excl) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318ad0100] 2023-10-03T19:21:27.816 INFO:teuthology.orchestra.run.smithi045.stdout: -697> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker scatter_eval (inest sync) on [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 f() n(v0 1=0+1) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318ad0100] 2023-10-03T19:21:27.817 INFO:teuthology.orchestra.run.smithi045.stdout: -696> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker simple_lock on (inest sync) on [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 f() n(v0 1=0+1) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318ad0100] 2023-10-03T19:21:27.817 INFO:teuthology.orchestra.run.smithi045.stdout: -695> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker simple_eval (iflock sync) on [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 f() n(v0 1=0+1) (iauth excl) (inest lock) (ifile excl) (ixattr excl) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318ad0100] 2023-10-03T19:21:27.817 INFO:teuthology.orchestra.run.smithi045.stdout: -694> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker simple_eval (ipolicy sync) on [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 f() n(v0 1=0+1) (iauth excl) (inest lock) (ifile excl) (ixattr excl) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318ad0100] 2023-10-03T19:21:27.817 INFO:teuthology.orchestra.run.smithi045.stdout: -693> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker get_allowed_caps loner client.7335 allowed=pAsxLsXsxFsxcrwb, xlocker allowed=pAsxLsXsxFsxcrwb, others allowed=pLs on [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 f() n(v0 1=0+1) (iauth excl) (inest lock) (ifile excl) (ixattr excl) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318ad0100] 2023-10-03T19:21:27.817 INFO:teuthology.orchestra.run.smithi045.stdout: -692> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.locker client.7335 pending - allowed pAsxLsXsxFsxwb wanted pAsxXsxFsxcrwb 2023-10-03T19:21:27.817 INFO:teuthology.orchestra.run.smithi045.stdout: -691> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.locker !revoke and new|suppressed|stale, skipping client.7335 2023-10-03T19:21:27.817 INFO:teuthology.orchestra.run.smithi045.stdout: -690> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker eval done 2023-10-03T19:21:27.817 INFO:teuthology.orchestra.run.smithi045.stdout: -689> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker get_allowed_caps loner client.7335 allowed=pAsxLsXsxFsxcrwb, xlocker allowed=pAsxLsXsxFsxcrwb, others allowed=pLs on [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 f() n(v0 1=0+1) (iauth excl) (inest lock) (ifile excl) (ixattr excl) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318ad0100] 2023-10-03T19:21:27.817 INFO:teuthology.orchestra.run.smithi045.stdout: -688> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.openfiles remove_inode [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 f() n(v0 1=0+1) (iauth excl) (inest lock) (ifile excl) (ixattr excl) (iversion lock) caps={7335=-/pAsxXsxFsxcrwb@0},l=7335 | caps=1 0x556318ad0100] 2023-10-03T19:21:27.817 INFO:teuthology.orchestra.run.smithi045.stdout: -687> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.server journal_and_reply tracei 0x556318ad0100 tracedn 0x556318b96280 2023-10-03T19:21:27.817 INFO:teuthology.orchestra.run.smithi045.stdout: -686> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker set_xlocks_done on (dn xlock x=1 by 0x556318b85000) [dentry #0x1/foo/bar [2,head] auth NULL (dn xlock x=1 by 0x556318b85000) (dversion lock w=1 last_client=7335) pv=2 v=1 ap=2 ino=(nil) state=1073741824 | request=1 lock=2 authpin=1 0x556318b96280] 2023-10-03T19:21:27.818 INFO:teuthology.orchestra.run.smithi045.stdout: -685> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.server early_reply 0 ((0) Success) client_request(client.7335:5 mkdir #0x10000000000/bar 2023-10-03T19:19:53.873286+0000 caller_uid=1000, caller_gid=1271{6,27,108,1271,10102,}) v6 2023-10-03T19:21:27.818 INFO:teuthology.orchestra.run.smithi045.stdout: -684> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.server set_trace_dist snapid head 2023-10-03T19:21:27.818 INFO:teuthology.orchestra.run.smithi045.stdout: -683> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.server set_trace_dist snaprealm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:19:39.424362+0000 change_attr 0 0x556317c178c0) len=70 2023-10-03T19:21:27.818 INFO:teuthology.orchestra.run.smithi045.stdout: -682> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache.ino(0x10000000000) pfile 1 pauth 1 plink 1 pxattr 1 plocal 1 mtime 2023-10-03T19:19:53.873286+0000 ctime 2023-10-03T19:19:53.873286+0000 change_attr 1 valid=1 2023-10-03T19:21:27.818 INFO:teuthology.orchestra.run.smithi045.stdout: -681> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache.ino(0x10000000000) encode_inodestat issuing pAsLsXsFsx seq 3 2023-10-03T19:21:27.818 INFO:teuthology.orchestra.run.smithi045.stdout: -680> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache.ino(0x10000000000) encode_inodestat caps pAsLsXsFsx seq 3 mseq 0 xattrv 0 2023-10-03T19:21:27.818 INFO:teuthology.orchestra.run.smithi045.stdout: -679> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.server set_trace_dist added diri [inode 0x10000000000 [...2,head] /foo/ auth v2 pv4 ap=1 DIRTYPARENT f()->f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 1=0+1)->n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) (iauth sync r=1) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (iversion lock w=1 last_client=7335) caps={7335=pAsLsXsFsx/AsLsXsFsx@3},l=7335 | request=0 lock=5 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.818 INFO:teuthology.orchestra.run.smithi045.stdout: -678> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.server set_trace_dist added dir [dir 0x10000000000 /foo/ [2,head] auth pv=3 v=1 cv=0/0 ap=1+2 state=1610612737|complete f()->f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n()->n(v0 rc2023-10-03T19:19:53.873286+0000 1=0+1) hs=0+1,ss=0+0 | child=1 dirty=1 authpin=1 0x556318a52880] 2023-10-03T19:21:27.818 INFO:teuthology.orchestra.run.smithi045.stdout: -677> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.locker issue_client_lease no/null lease on [dentry #0x1/foo/bar [2,head] auth NULL (dn xlockdone x=1) (dversion lock w=1 last_client=7335) pv=2 v=1 ap=2 ino=(nil) state=1073741824 | request=1 lock=2 authpin=1 0x556318b96280] 2023-10-03T19:21:27.818 INFO:teuthology.orchestra.run.smithi045.stdout: -676> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.cache.ino(0x10000000001) pfile 1 pauth 1 plink 1 pxattr 1 plocal 0 mtime 2023-10-03T19:19:53.873286+0000 ctime 2023-10-03T19:19:53.873286+0000 change_attr 0 valid=1 2023-10-03T19:21:27.818 INFO:teuthology.orchestra.run.smithi045.stdout: -675> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache.ino(0x10000000001) encode_inodestat issuing pAsxLsXsxFsx seq 1 2023-10-03T19:21:27.819 INFO:teuthology.orchestra.run.smithi045.stdout: -674> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache.ino(0x10000000001) encode_inodestat caps pAsxLsXsxFsx seq 1 mseq 0 xattrv 1 2023-10-03T19:21:27.819 INFO:teuthology.orchestra.run.smithi045.stdout: -673> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.cache.ino(0x10000000001) including xattrs version 1 2023-10-03T19:21:27.819 INFO:teuthology.orchestra.run.smithi045.stdout: -672> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.server set_trace_dist added snap head in [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 f() n(v0 1=0+1) (iauth excl) (inest lock) (ifile excl) (ixattr excl) (iversion lock) caps={7335=pAsxLsXsxFsx/-@1},l=7335 | request=1 caps=1 0x556318ad0100] 2023-10-03T19:21:27.819 INFO:teuthology.orchestra.run.smithi045.stdout: -671> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.48 send_message_client client.7335 172.21.15.146:0/990159870 client_reply(???:5 = 0 (0) Success unsafe) v1 2023-10-03T19:21:27.819 INFO:teuthology.orchestra.run.smithi045.stdout: -670> 2023-10-03T19:19:53.872+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> 172.21.15.146:0/990159870 -- client_reply(???:5 = 0 (0) Success unsafe) v1 -- 0x556317aefa40 con 0x556318b59000 2023-10-03T19:21:27.819 INFO:teuthology.orchestra.run.smithi045.stdout: -669> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.server lat 0.001886 2023-10-03T19:21:27.819 INFO:teuthology.orchestra.run.smithi045.stdout: -668> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker rdlock_finish on (iauth sync) on [inode 0x10000000000 [...2,head] /foo/ auth v2 pv4 ap=1 DIRTYPARENT f()->f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 1=0+1)->n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (iversion lock w=1 last_client=7335) caps={7335=pAsLsXsFsx/AsLsXsFsx@3},l=7335 | request=0 lock=4 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.819 INFO:teuthology.orchestra.run.smithi045.stdout: -667> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker simple_eval (iauth sync) on [inode 0x10000000000 [...2,head] /foo/ auth v2 pv4 ap=1 DIRTYPARENT f()->f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 1=0+1)->n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (iversion lock w=1 last_client=7335) caps={7335=pAsLsXsFsx/AsLsXsFsx@3},l=7335 | request=0 lock=4 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.819 INFO:teuthology.orchestra.run.smithi045.stdout: -666> 2023-10-03T19:19:53.872+0000 7fd19ec63640 5 mds.0.log _submit_thread 4198902~2236 : EUpdate mkdir [metablob 0x1, 3 dirs] 2023-10-03T19:21:27.819 INFO:teuthology.orchestra.run.smithi045.stdout: -665> 2023-10-03T19:19:53.872+0000 7fd1a5470640 7 mds.0.locker get_allowed_caps loner client.7335 allowed=pAsLsXsFsxcrwb, xlocker allowed=pAsLsXsFsxcrwb, others allowed=pAsLsXs on [inode 0x10000000000 [...2,head] /foo/ auth v2 pv4 ap=1 DIRTYPARENT f()->f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 1=0+1)->n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (iversion lock w=1 last_client=7335) caps={7335=pAsLsXsFsx/AsLsXsFsx@3},l=7335 | request=0 lock=4 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.819 INFO:teuthology.orchestra.run.smithi045.stdout: -664> 2023-10-03T19:19:53.872+0000 7fd1a5470640 20 mds.0.locker client.7335 pending pAsLsXsFsx allowed pAsLsXsFsxwb wanted AsLsXsFsx 2023-10-03T19:21:27.819 INFO:teuthology.orchestra.run.smithi045.stdout: -663> 2023-10-03T19:19:53.872+0000 7fd1a5470640 10 mds.0.locker eval done 2023-10-03T19:21:27.820 INFO:teuthology.orchestra.run.smithi045.stdout: -662> 2023-10-03T19:19:54.012+0000 7fd1a7c75640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7335 172.21.15.146:0/990159870 13 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.014680, avg_latency: 0.002936, sq_sum: 42001360404819, count=5][client_metric_type: CAP_INFO cap_hits: 14 cap_misses: 3 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 1 dlease_misses: 0 num_dentries: 2][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 3][client_metric_type: PINNED_ICAPS pinned_icaps: 3 total_inodes: 3][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 3][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x556318a8d340 con 0x556318b59000 2023-10-03T19:21:27.820 INFO:teuthology.orchestra.run.smithi045.stdout: -661> 2023-10-03T19:19:54.012+0000 7fd1a7c75640 20 mds.0.48 get_session have 0x556318a4b700 client.7335 172.21.15.146:0/990159870 state open 2023-10-03T19:21:27.820 INFO:teuthology.orchestra.run.smithi045.stdout: -660> 2023-10-03T19:19:54.012+0000 7fd1a7c75640 20 handle_client_metrics: mds.metrics: session=0x556318a4b700 2023-10-03T19:21:27.820 INFO:teuthology.orchestra.run.smithi045.stdout: -659> 2023-10-03T19:19:54.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=READ_LATENCY, session=0x556318a4b700, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:27.820 INFO:teuthology.orchestra.run.smithi045.stdout: -658> 2023-10-03T19:19:54.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=WRITE_LATENCY, session=0x556318a4b700, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:27.820 INFO:teuthology.orchestra.run.smithi045.stdout: -657> 2023-10-03T19:19:54.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=METADATA_LATENCY, session=0x556318a4b700, latency=0.014680, avg=0.002936, sq_sum=42001360404819, count=5 2023-10-03T19:21:27.820 INFO:teuthology.orchestra.run.smithi045.stdout: -656> 2023-10-03T19:19:54.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=CAP_INFO, session=0x556318a4b700, hits=14, misses=3 2023-10-03T19:21:27.820 INFO:teuthology.orchestra.run.smithi045.stdout: -655> 2023-10-03T19:19:54.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=DENTRY_LEASE, session=0x556318a4b700, hits=1, misses=0 2023-10-03T19:21:27.820 INFO:teuthology.orchestra.run.smithi045.stdout: -654> 2023-10-03T19:19:54.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=OPENED_FILES, session=0x556318a4b700, opened_files=0, total_inodes=3 2023-10-03T19:21:27.820 INFO:teuthology.orchestra.run.smithi045.stdout: -653> 2023-10-03T19:19:54.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=PINNED_ICAPS, session=0x556318a4b700, pinned_icaps=3, total_inodes=3 2023-10-03T19:21:27.820 INFO:teuthology.orchestra.run.smithi045.stdout: -652> 2023-10-03T19:19:54.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=OPENED_INODES, session=0x556318a4b700, opened_inodes=0, total_inodes=3 2023-10-03T19:21:27.821 INFO:teuthology.orchestra.run.smithi045.stdout: -651> 2023-10-03T19:19:54.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=READ_IO_SIZES, session=0x556318a4b700, total_ops=0, total_size=0 2023-10-03T19:21:27.821 INFO:teuthology.orchestra.run.smithi045.stdout: -650> 2023-10-03T19:19:54.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=WRITE_IO_SIZES, session=0x556318a4b700, total_ops=0, total_size=0 2023-10-03T19:21:27.821 INFO:teuthology.orchestra.run.smithi045.stdout: -649> 2023-10-03T19:19:54.064+0000 7fd1a3c6d640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.48:43 15.14 15:2e2fa760:::200.00000001:head [write 4598~2256 [fadvise_dontneed] in=2256b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e98) v8 -- 0x556318ad8700 con 0x5563189cc400 2023-10-03T19:21:27.821 INFO:teuthology.orchestra.run.smithi045.stdout: -648> 2023-10-03T19:19:54.064+0000 7fd1a3c6d640 10 mds.0.log trim 1 / 128 segments, 6 / -1 events, 0 (0) expiring, 0 (0) expired 2023-10-03T19:21:27.821 INFO:teuthology.orchestra.run.smithi045.stdout: -647> 2023-10-03T19:19:54.064+0000 7fd1a3c6d640 10 mds.0.openfiles commit log_seq 1 committing_log_seq:1 2023-10-03T19:21:27.821 INFO:teuthology.orchestra.run.smithi045.stdout: -646> 2023-10-03T19:19:54.064+0000 7fd1a3c6d640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.48:44 15.6 15:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b,omap-set-vals in=109b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e98) v8 -- 0x556318ad9c00 con 0x556317c2d400 2023-10-03T19:21:27.843 INFO:teuthology.orchestra.run.smithi045.stdout: -645> 2023-10-03T19:19:54.064+0000 7fd1a3c6d640 10 mds.0.log _trim_expired_segments waiting for 1/4194304 to expire 2023-10-03T19:21:27.843 INFO:teuthology.orchestra.run.smithi045.stdout: -644> 2023-10-03T19:19:54.064+0000 7fd1a3c6d640 10 mds.0.server find_idle_sessions. last cleared laggy state 1240.45s ago 2023-10-03T19:21:27.843 INFO:teuthology.orchestra.run.smithi045.stdout: -643> 2023-10-03T19:19:54.064+0000 7fd1a3c6d640 20 mds.0.server laggiest active session is client.7335 172.21.15.146:0/990159870 and renewed caps recently (3.05195s ago) 2023-10-03T19:21:27.843 INFO:teuthology.orchestra.run.smithi045.stdout: -642> 2023-10-03T19:19:54.064+0000 7fd1a3c6d640 10 mds.0.locker scatter_tick 2023-10-03T19:21:27.843 INFO:teuthology.orchestra.run.smithi045.stdout: -641> 2023-10-03T19:19:54.064+0000 7fd1a3c6d640 20 mds.0.locker caps_tick 0 revoking caps 2023-10-03T19:21:27.843 INFO:teuthology.orchestra.run.smithi045.stdout: -640> 2023-10-03T19:19:54.064+0000 7fd1a3c6d640 20 mds.0.bal handle_export_pins export_pin_queue size=0 2023-10-03T19:21:27.843 INFO:teuthology.orchestra.run.smithi045.stdout: -639> 2023-10-03T19:19:54.064+0000 7fd1a3c6d640 15 mds.0.bal tick tick last_sample now 1240.453970s 2023-10-03T19:21:27.843 INFO:teuthology.orchestra.run.smithi045.stdout: -638> 2023-10-03T19:19:54.064+0000 7fd1a3c6d640 15 mds.0.cache show_subtrees 2023-10-03T19:21:27.844 INFO:teuthology.orchestra.run.smithi045.stdout: -637> 2023-10-03T19:19:54.064+0000 7fd1a3c6d640 10 mds.0.cache |__ 0 auth [dir 0x1 / [2,head] auth pv=5 v=3 cv=1/1 REP dir_auth=0 ap=1+1 state=1610874881|complete f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1)->f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1)->n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2)/n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x556317b1d180] 2023-10-03T19:21:27.844 INFO:teuthology.orchestra.run.smithi045.stdout: -636> 2023-10-03T19:19:54.064+0000 7fd1a3c6d640 10 mds.0.cache |__ 0 auth [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x556317b1d600] 2023-10-03T19:21:27.844 INFO:teuthology.orchestra.run.smithi045.stdout: -635> 2023-10-03T19:19:54.064+0000 7fd1a3c6d640 10 mds.0.cache find_stale_fragment_freeze 2023-10-03T19:21:27.844 INFO:teuthology.orchestra.run.smithi045.stdout: -634> 2023-10-03T19:19:54.064+0000 7fd1a3c6d640 10 mds.0.snap check_osd_map - version unchanged 2023-10-03T19:21:27.844 INFO:teuthology.orchestra.run.smithi045.stdout: -633> 2023-10-03T19:19:54.064+0000 7fd1a3c6d640 20 mds.0.48 updating export targets, currently 0 ranks are targets 2023-10-03T19:21:27.844 INFO:teuthology.orchestra.run.smithi045.stdout: -632> 2023-10-03T19:19:54.064+0000 7fd1a446e640 10 monclient: tick 2023-10-03T19:21:27.844 INFO:teuthology.orchestra.run.smithi045.stdout: -631> 2023-10-03T19:19:54.064+0000 7fd1a446e640 10 monclient: _check_auth_tickets 2023-10-03T19:21:27.844 INFO:teuthology.orchestra.run.smithi045.stdout: -630> 2023-10-03T19:19:54.064+0000 7fd1a446e640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:24.070491+0000) 2023-10-03T19:21:27.844 INFO:teuthology.orchestra.run.smithi045.stdout: -629> 2023-10-03T19:19:54.068+0000 7fd1a8476640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.0 v2:172.21.15.45:6800/1057586985 2 ==== osd_op_reply(44 mds0_openfiles.0 [omap-set-header,omap-set-vals] v98'2 uv2 ondisk = 0) v8 ==== 202+0+0 (crc 0 0 0) 0x556318aaeb40 con 0x556317c2d400 2023-10-03T19:21:27.844 INFO:teuthology.orchestra.run.smithi045.stdout: -628> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 MDSIOContextBase::complete: 13C_IO_OFT_Save 2023-10-03T19:21:27.844 INFO:teuthology.orchestra.run.smithi045.stdout: -627> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 MDSContext::complete: 13C_IO_OFT_Save 2023-10-03T19:21:27.845 INFO:teuthology.orchestra.run.smithi045.stdout: -626> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 mds.0.openfiles _commit_finish log_seq 1 committed_log_seq 1 committing_log_seq 1 2023-10-03T19:21:27.845 INFO:teuthology.orchestra.run.smithi045.stdout: -625> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 MDSContext::complete: 15C_OFT_Committed 2023-10-03T19:21:27.845 INFO:teuthology.orchestra.run.smithi045.stdout: -624> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 mds.0.log _trim_expired_segments waiting for 1/4194304 to expire 2023-10-03T19:21:27.845 INFO:teuthology.orchestra.run.smithi045.stdout: -623> 2023-10-03T19:19:54.068+0000 7fd1a8c77640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.6 v2:172.21.15.79:6819/1486010128 11 ==== osd_op_reply(43 200.00000001 [write 4598~2256 [fadvise_dontneed]] v98'10 uv10 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x556318aaf440 con 0x5563189cc400 2023-10-03T19:21:27.845 INFO:teuthology.orchestra.run.smithi045.stdout: -622> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 MDSIOContextBase::complete: 18C_MDS_mknod_finish 2023-10-03T19:21:27.845 INFO:teuthology.orchestra.run.smithi045.stdout: -621> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 MDSContext::complete: 18C_MDS_mknod_finish 2023-10-03T19:21:27.845 INFO:teuthology.orchestra.run.smithi045.stdout: -620> 2023-10-03T19:19:54.068+0000 7fd19f464640 12 mds.0.cache.dir(0x10000000000) link_primary_inode [dentry #0x1/foo/bar [2,head] auth NULL (dn xlockdone x=1) (dversion lock w=1 last_client=7335) pv=2 v=1 ap=2 ino=(nil) state=1073741824 | request=1 lock=2 authpin=1 0x556318b96280] [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 f() n(v0 1=0+1) (iauth excl) (inest lock) (ifile excl) (ixattr excl) (iversion lock) caps={7335=pAsxLsXsxFsx/-@1},l=7335 | request=1 caps=1 0x556318ad0100] 2023-10-03T19:21:27.845 INFO:teuthology.orchestra.run.smithi045.stdout: -619> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 mds.0.openfiles add_dirfrag [dir 0x10000000000 /foo/ [2,head] auth pv=3 v=1 cv=0/0 ap=1+2 state=1610612737|complete f()->f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n()->n(v0 rc2023-10-03T19:19:53.873286+0000 1=0+1) hs=0+1,ss=0+0 | child=1 dirty=1 authpin=1 0x556318a52880] 2023-10-03T19:21:27.845 INFO:teuthology.orchestra.run.smithi045.stdout: -618> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 mds.0.cache.ino(0x10000000001) move_to_realm joining realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:19:39.424362+0000 change_attr 0 0x556317c178c0), leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:19:39.424362+0000 change_attr 0 0x556317c178c0) 2023-10-03T19:21:27.845 INFO:teuthology.orchestra.run.smithi045.stdout: -617> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 mds.0.cache.ino(0x10000000001) mark_dirty [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 f() n(v0 1=0+1) (iauth excl) (inest lock) (ifile excl) (ixattr excl) (iversion lock) caps={7335=pAsxLsXsxFsx/-@1},l=7335 | request=1 caps=1 0x556318ad0100] 2023-10-03T19:21:27.845 INFO:teuthology.orchestra.run.smithi045.stdout: -616> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 mds.0.cache.den(0x10000000000 bar) mark_dirty [dentry #0x1/foo/bar [2,head] auth (dn xlockdone x=1) (dversion lock w=1 last_client=7335) pv=2 v=1 ap=2 ino=0x10000000001 state=1073741824 | request=1 lock=2 inodepin=1 authpin=1 0x556318b96280] 2023-10-03T19:21:27.846 INFO:teuthology.orchestra.run.smithi045.stdout: -615> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /foo/ [2,head] auth pv=3 v=1 cv=0/0 ap=1+2 state=1610874881|complete f()->f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n()->n(v0 rc2023-10-03T19:19:53.873286+0000 1=0+1) hs=1+0,ss=0+0 dirty=1 | child=1 dirty=1 authpin=1 0x556318a52880] version 1 2023-10-03T19:21:27.846 INFO:teuthology.orchestra.run.smithi045.stdout: -614> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 mds.0.cache.ino(0x10000000001) mark_dirty_parent 2023-10-03T19:21:27.846 INFO:teuthology.orchestra.run.smithi045.stdout: -613> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 mds.0.cache.dir(0x10000000001) _mark_dirty (was clean) [dir 0x10000000001 /foo/bar/ [2,head] auth v=1 cv=0/0 state=1073741953|complete|creating f() n() hs=0+0,ss=0+0 0x556318a52d00] version 1 2023-10-03T19:21:27.846 INFO:teuthology.orchestra.run.smithi045.stdout: -612> 2023-10-03T19:19:54.068+0000 7fd19f464640 15 mds.0.cache.ino(0x10000000000) pop_and_dirty_projected_inode v4 2023-10-03T19:21:27.846 INFO:teuthology.orchestra.run.smithi045.stdout: -611> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 mds.0.cache.ino(0x10000000000) mark_dirty [inode 0x10000000000 [...2,head] /foo/ auth v4 ap=1 DIRTYPARENT f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (iversion lock w=1 last_client=7335) caps={7335=pAsLsXsFsx/AsLsXsFsx@3},l=7335 | request=0 lock=4 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.846 INFO:teuthology.orchestra.run.smithi045.stdout: -610> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 mds.0.cache.den(0x1 foo) mark_dirty [dentry #0x1/foo [2,head] auth (dn sync l) (dversion lock) pv=4 v=2 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x556318b96000] 2023-10-03T19:21:27.846 INFO:teuthology.orchestra.run.smithi045.stdout: -609> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth pv=5 v=3 cv=1/1 REP dir_auth=0 ap=1+1 state=1610874881|complete f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1)->f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1)->n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2)/n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x556317b1d180] version 3 2023-10-03T19:21:27.846 INFO:teuthology.orchestra.run.smithi045.stdout: -608> 2023-10-03T19:19:54.068+0000 7fd19f464640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55631892dd60 v5 2023-10-03T19:21:27.846 INFO:teuthology.orchestra.run.smithi045.stdout: -607> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth v=5 cv=1/1 REP dir_auth=0 ap=1+1 state=1610874881|complete f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2)/n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x556317b1d180] version 5 2023-10-03T19:21:27.846 INFO:teuthology.orchestra.run.smithi045.stdout: -606> 2023-10-03T19:19:54.068+0000 7fd19f464640 15 mds.0.cache.dir(0x10000000000) pop_and_dirty_projected_fnode 0x55631892dc40 v3 2023-10-03T19:21:27.847 INFO:teuthology.orchestra.run.smithi045.stdout: -605> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 mds.0.cache.dir(0x10000000000) _mark_dirty (already dirty) [dir 0x10000000000 /foo/ [2,head] auth v=3 cv=0/0 ap=1+2 state=1610874881|complete f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 1=0+1) hs=1+0,ss=0+0 dirty=1 | child=1 dirty=1 authpin=1 0x556318a52880] version 3 2023-10-03T19:21:27.847 INFO:teuthology.orchestra.run.smithi045.stdout: -604> 2023-10-03T19:19:54.068+0000 7fd19f464640 7 mds.0.cache send_dentry_link [dentry #0x1/foo/bar [2,head] auth (dn xlockdone x=1) (dversion lock w=1 last_client=7335) v=2 ap=2 ino=0x10000000001 state=1610612736 | request=1 lock=2 inodepin=1 dirty=1 authpin=1 0x556318b96280] 2023-10-03T19:21:27.847 INFO:teuthology.orchestra.run.smithi045.stdout: -603> 2023-10-03T19:19:54.068+0000 7fd19f464640 20 mds.0.bal hit_dir 1 pop is 1, frag * size 1 [pop IRD:[C 0.00e+00] IWR:[C 1.00e+00] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 0.00e+00] *LOAD:2.0] 2023-10-03T19:21:27.847 INFO:teuthology.orchestra.run.smithi045.stdout: -602> 2023-10-03T19:19:54.068+0000 7fd19f464640 7 mds.0.server reply_client_request 0 ((0) Success) client_request(client.7335:5 mkdir #0x10000000000/bar 2023-10-03T19:19:53.873286+0000 caller_uid=1000, caller_gid=1271{6,27,108,1271,10102,}) v6 2023-10-03T19:21:27.847 INFO:teuthology.orchestra.run.smithi045.stdout: -601> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 mds.0.server apply_allocated_inos 0x0 / [] / 0x10000000001 2023-10-03T19:21:27.847 INFO:teuthology.orchestra.run.smithi045.stdout: -600> 2023-10-03T19:19:54.068+0000 7fd19f464640 20 mds.0.sessionmap mark_dirty s=0x556318a4b700 name=client.7335 v=3 2023-10-03T19:21:27.847 INFO:teuthology.orchestra.run.smithi045.stdout: -599> 2023-10-03T19:19:54.068+0000 7fd19f464640 7 mds.0.locker wrlock_finish on (inest lock w=1 dirty) on [inode 0x1 [...2,head] / auth v3 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (inest lock w=1 dirty) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@4,7350=pAsLsXs/-@2} | dirtyscattered=1 request=0 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.847 INFO:teuthology.orchestra.run.smithi045.stdout: -598> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 mds.0.locker scatter_eval (inest lock dirty) on [inode 0x1 [...2,head] / auth v3 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (isnap sync r=1) (inest lock dirty) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@4,7350=pAsLsXs/-@2} | dirtyscattered=1 request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.847 INFO:teuthology.orchestra.run.smithi045.stdout: -597> 2023-10-03T19:19:54.068+0000 7fd19f464640 7 mds.0.locker local_wrlock_finish on (iversion lock w=1 last_client=7335) on [inode 0x10000000000 [...2,head] /foo/ auth v4 ap=1 DIRTYPARENT f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (iversion lock w=1 last_client=7335) caps={7335=pAsLsXsFsx/AsLsXsFsx@3},l=7335 | request=0 lock=4 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.847 INFO:teuthology.orchestra.run.smithi045.stdout: -596> 2023-10-03T19:19:54.068+0000 7fd19f464640 7 mds.0.locker wrlock_finish on (ifile excl w=1) on [inode 0x10000000000 [...2,head] /foo/ auth v4 ap=1 DIRTYPARENT f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) (isnap sync r=1) (inest lock w=1) (ifile excl w=1) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@3},l=7335 | request=0 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.847 INFO:teuthology.orchestra.run.smithi045.stdout: -595> 2023-10-03T19:19:54.068+0000 7fd19f464640 7 mds.0.locker file_eval wanted=sx loner_wanted=sx other_wanted= filelock=(ifile excl) on [inode 0x10000000000 [...2,head] /foo/ auth v4 ap=1 DIRTYPARENT f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) (isnap sync r=1) (inest lock w=1) (ifile excl) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@3},l=7335 | request=0 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.848 INFO:teuthology.orchestra.run.smithi045.stdout: -594> 2023-10-03T19:19:54.068+0000 7fd19f464640 20 mds.0.locker is excl 2023-10-03T19:21:27.848 INFO:teuthology.orchestra.run.smithi045.stdout: -593> 2023-10-03T19:19:54.068+0000 7fd19f464640 7 mds.0.locker file_eval loner_issued=sx other_issued= xlocker_issued= 2023-10-03T19:21:27.848 INFO:teuthology.orchestra.run.smithi045.stdout: -592> 2023-10-03T19:19:54.068+0000 7fd19f464640 7 mds.0.locker wrlock_finish on (inest lock w=1) on [inode 0x10000000000 [...2,head] /foo/ auth v4 ap=1 DIRTYPARENT f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) (isnap sync r=1) (inest lock w=1) (ifile excl) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@3},l=7335 | request=0 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.848 INFO:teuthology.orchestra.run.smithi045.stdout: -591> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 mds.0.locker scatter_eval (inest lock) on [inode 0x10000000000 [...2,head] /foo/ auth v4 ap=1 DIRTYPARENT f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) (isnap sync r=1) (inest lock) (ifile excl) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@3},l=7335 | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.848 INFO:teuthology.orchestra.run.smithi045.stdout: -590> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 mds.0.locker xlock_finish on (dn xlockdone x=1) [dentry #0x1/foo/bar [2,head] auth (dn xlockdone x=1) (dversion lock w=1 last_client=7335) v=2 ap=2 ino=0x10000000001 state=1610612736 | request=1 lock=2 inodepin=1 dirty=1 authpin=1 0x556318b96280] 2023-10-03T19:21:27.848 INFO:teuthology.orchestra.run.smithi045.stdout: -589> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 mds.0.locker eval_gather (dn xlockdone) on [dentry #0x1/foo/bar [2,head] auth (dn xlockdone) (dversion lock w=1 last_client=7335) v=2 ap=2 ino=0x10000000001 state=1610612736 | request=1 lock=1 inodepin=1 dirty=1 authpin=1 0x556318b96280] 2023-10-03T19:21:27.848 INFO:teuthology.orchestra.run.smithi045.stdout: -588> 2023-10-03T19:19:54.068+0000 7fd19f464640 7 mds.0.locker eval_gather finished gather on (dn xlockdone) on [dentry #0x1/foo/bar [2,head] auth (dn xlockdone) (dversion lock w=1 last_client=7335) v=2 ap=2 ino=0x10000000001 state=1610612736 | request=1 lock=1 inodepin=1 dirty=1 authpin=1 0x556318b96280] 2023-10-03T19:21:27.848 INFO:teuthology.orchestra.run.smithi045.stdout: -587> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 mds.0.cache.den(0x10000000000 bar) auth_unpin by 0x556318b96368 on [dentry #0x1/foo/bar [2,head] auth (dversion lock w=1 last_client=7335) v=2 ap=1 ino=0x10000000001 state=1610612736 | request=1 lock=1 inodepin=1 dirty=1 authpin=1 0x556318b96280] now 1 2023-10-03T19:21:27.848 INFO:teuthology.orchestra.run.smithi045.stdout: -586> 2023-10-03T19:19:54.068+0000 7fd19f464640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /foo/ [2,head] auth v=3 cv=0/0 ap=1+1 state=1610874881|complete f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 1=0+1) hs=1+0,ss=0+0 dirty=1 | child=1 dirty=1 authpin=1 0x556318a52880] by 0x556318b96368 count now 1/1 2023-10-03T19:21:27.848 INFO:teuthology.orchestra.run.smithi045.stdout: -585> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 mds.0.locker simple_eval (dn sync) on [dentry #0x1/foo/bar [2,head] auth (dversion lock w=1 last_client=7335) v=2 ap=1 ino=0x10000000001 state=1610612736 | request=1 lock=1 inodepin=1 dirty=1 authpin=1 0x556318b96280] 2023-10-03T19:21:27.848 INFO:teuthology.orchestra.run.smithi045.stdout: -584> 2023-10-03T19:19:54.068+0000 7fd19f464640 7 mds.0.locker local_wrlock_finish on (dversion lock w=1 last_client=7335) on [dentry #0x1/foo/bar [2,head] auth (dversion lock w=1 last_client=7335) v=2 ap=1 ino=0x10000000001 state=1610612736 | request=1 lock=1 inodepin=1 dirty=1 authpin=1 0x556318b96280] 2023-10-03T19:21:27.849 INFO:teuthology.orchestra.run.smithi045.stdout: -583> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 mds.0.48 send_message_client client.7335 172.21.15.146:0/990159870 client_reply(???:5 = 0 (0) Success safe) v1 2023-10-03T19:21:27.849 INFO:teuthology.orchestra.run.smithi045.stdout: -582> 2023-10-03T19:19:54.068+0000 7fd19f464640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> 172.21.15.146:0/990159870 -- client_reply(???:5 = 0 (0) Success safe) v1 -- 0x556317aefc00 con 0x556318b59000 2023-10-03T19:21:27.849 INFO:teuthology.orchestra.run.smithi045.stdout: -581> 2023-10-03T19:19:54.068+0000 7fd19f464640 7 mds.0.cache request_finish request(client.7335:5 nref=2 cr=0x556318ac8c00) 2023-10-03T19:21:27.849 INFO:teuthology.orchestra.run.smithi045.stdout: -580> 2023-10-03T19:19:54.068+0000 7fd19f464640 15 mds.0.cache request_cleanup request(client.7335:5 nref=2 cr=0x556318ac8c00) 2023-10-03T19:21:27.849 INFO:teuthology.orchestra.run.smithi045.stdout: -579> 2023-10-03T19:19:54.068+0000 7fd19f464640 7 mds.0.locker rdlock_finish on (isnap sync) on [inode 0x1 [...2,head] / auth v3 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (inest lock dirty) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@4,7350=pAsLsXs/-@2} | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.849 INFO:teuthology.orchestra.run.smithi045.stdout: -578> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 mds.0.locker simple_eval (isnap sync) on [inode 0x1 [...2,head] / auth v3 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (inest lock dirty) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@4,7350=pAsLsXs/-@2} | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.849 INFO:teuthology.orchestra.run.smithi045.stdout: -577> 2023-10-03T19:19:54.068+0000 7fd19f464640 7 mds.0.locker rdlock_finish on (isnap sync) on [inode 0x10000000000 [...2,head] /foo/ auth v4 ap=1 DIRTYPARENT f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@3},l=7335 | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.849 INFO:teuthology.orchestra.run.smithi045.stdout: -576> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 mds.0.locker simple_eval (isnap sync) on [inode 0x10000000000 [...2,head] /foo/ auth v4 ap=1 DIRTYPARENT f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@3},l=7335 | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556318acfb80] 2023-10-03T19:21:27.849 INFO:teuthology.orchestra.run.smithi045.stdout: -575> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 mds.0.cache.dir(0x10000000000) auth_unpin by 0x556318b85000 on [dir 0x10000000000 /foo/ [2,head] auth v=3 cv=0/0 ap=0+1 state=1610874881|complete f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 1=0+1) hs=1+0,ss=0+0 dirty=1 | child=1 dirty=1 authpin=0 0x556318a52880] count now 0 2023-10-03T19:21:27.849 INFO:teuthology.orchestra.run.smithi045.stdout: -574> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 mds.0.cache.den(0x10000000000 bar) auth_unpin by 0x556318b85000 on [dentry #0x1/foo/bar [2,head] auth (dversion lock) v=2 ino=0x10000000001 state=1610612736 | request=1 lock=0 inodepin=1 dirty=1 authpin=0 0x556318b96280] now 0 2023-10-03T19:21:27.849 INFO:teuthology.orchestra.run.smithi045.stdout: -573> 2023-10-03T19:19:54.068+0000 7fd19f464640 15 mds.0.cache.dir(0x10000000000) adjust_nested_auth_pins -1 on [dir 0x10000000000 /foo/ [2,head] auth v=3 cv=0/0 state=1610874881|complete f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 1=0+1) hs=1+0,ss=0+0 dirty=1 | child=1 dirty=1 authpin=0 0x556318a52880] by 0x556318b85000 count now 0/0 2023-10-03T19:21:27.951 INFO:teuthology.orchestra.run.smithi045.stdout: -572> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 mds.0.cache.dir(0x1) auth_unpin by 0x556318b85000 on [dir 0x1 / [2,head] auth v=5 cv=1/1 REP dir_auth=0 ap=0+1 state=1610874881|complete f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2)/n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=0 0x556317b1d180] count now 0 2023-10-03T19:21:27.952 INFO:teuthology.orchestra.run.smithi045.stdout: -571> 2023-10-03T19:19:54.068+0000 7fd19f464640 10 mds.0.cache.ino(0x10000000000) auth_unpin by 0x556318b85000 on [inode 0x10000000000 [...2,head] /foo/ auth v4 DIRTYPARENT f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@3},l=7335 | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=0 0x556318acfb80] now 0 2023-10-03T19:21:27.952 INFO:teuthology.orchestra.run.smithi045.stdout: -570> 2023-10-03T19:19:54.068+0000 7fd19f464640 15 mds.0.cache.dir(0x1) adjust_nested_auth_pins -1 on [dir 0x1 / [2,head] auth v=5 cv=1/1 REP dir_auth=0 state=1610874881|complete f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2)/n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=0 0x556317b1d180] by 0x556318b85000 count now 0/0 2023-10-03T19:21:27.952 INFO:teuthology.orchestra.run.smithi045.stdout: -569> 2023-10-03T19:19:54.188+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7350 172.21.15.172:0/3138699255 5 ==== client_session(request_renewcaps seq 2) v1 ==== 28+0+0 (crc 0 0 0) 0x556317aef880 con 0x556318b84000 2023-10-03T19:21:27.952 INFO:teuthology.orchestra.run.smithi045.stdout: -568> 2023-10-03T19:19:54.188+0000 7fd1a8c77640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7350 172.21.15.172:0/3138699255 6 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000746, avg_latency: 0.000746, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 4 cap_misses: 2 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x556318a8db80 con 0x556318b84000 2023-10-03T19:21:27.952 INFO:teuthology.orchestra.run.smithi045.stdout: -567> 2023-10-03T19:19:54.188+0000 7fd1a8c77640 20 mds.0.48 get_session have 0x556318a78a00 client.7350 172.21.15.172:0/3138699255 state open 2023-10-03T19:21:27.952 INFO:teuthology.orchestra.run.smithi045.stdout: -566> 2023-10-03T19:19:54.188+0000 7fd1a8c77640 20 handle_client_metrics: mds.metrics: session=0x556318a78a00 2023-10-03T19:21:27.952 INFO:teuthology.orchestra.run.smithi045.stdout: -565> 2023-10-03T19:19:54.188+0000 7fd1a5470640 20 mds.0.48 get_session have 0x556318a78a00 client.7350 172.21.15.172:0/3138699255 state open 2023-10-03T19:21:27.952 INFO:teuthology.orchestra.run.smithi045.stdout: -564> 2023-10-03T19:19:54.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=READ_LATENCY, session=0x556318a78a00, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:27.952 INFO:teuthology.orchestra.run.smithi045.stdout: -563> 2023-10-03T19:19:54.188+0000 7fd1a5470640 3 mds.0.server handle_client_session client_session(request_renewcaps seq 2) v1 from client.7350 2023-10-03T19:21:27.952 INFO:teuthology.orchestra.run.smithi045.stdout: -562> 2023-10-03T19:19:54.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=WRITE_LATENCY, session=0x556318a78a00, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:27.953 INFO:teuthology.orchestra.run.smithi045.stdout: -561> 2023-10-03T19:19:54.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=METADATA_LATENCY, session=0x556318a78a00, latency=0.000746, avg=0.000746, sq_sum=0, count=1 2023-10-03T19:21:27.953 INFO:teuthology.orchestra.run.smithi045.stdout: -560> 2023-10-03T19:19:54.188+0000 7fd1a5470640 10 mds.0.sessionmap touch_session s=0x556318a78a00 name=client.7350 2023-10-03T19:21:27.953 INFO:teuthology.orchestra.run.smithi045.stdout: -559> 2023-10-03T19:19:54.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=CAP_INFO, session=0x556318a78a00, hits=4, misses=2 2023-10-03T19:21:27.953 INFO:teuthology.orchestra.run.smithi045.stdout: -558> 2023-10-03T19:19:54.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=DENTRY_LEASE, session=0x556318a78a00, hits=0, misses=0 2023-10-03T19:21:27.953 INFO:teuthology.orchestra.run.smithi045.stdout: -557> 2023-10-03T19:19:54.188+0000 7fd1a5470640 10 mds.0.48 send_message_client client.7350 172.21.15.172:0/3138699255 client_session(renewcaps seq 2) v5 2023-10-03T19:21:27.953 INFO:teuthology.orchestra.run.smithi045.stdout: -556> 2023-10-03T19:19:54.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=OPENED_FILES, session=0x556318a78a00, opened_files=0, total_inodes=1 2023-10-03T19:21:27.953 INFO:teuthology.orchestra.run.smithi045.stdout: -555> 2023-10-03T19:19:54.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=PINNED_ICAPS, session=0x556318a78a00, pinned_icaps=1, total_inodes=1 2023-10-03T19:21:27.953 INFO:teuthology.orchestra.run.smithi045.stdout: -554> 2023-10-03T19:19:54.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=OPENED_INODES, session=0x556318a78a00, opened_inodes=0, total_inodes=1 2023-10-03T19:21:27.953 INFO:teuthology.orchestra.run.smithi045.stdout: -553> 2023-10-03T19:19:54.188+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> 172.21.15.172:0/3138699255 -- client_session(renewcaps seq 2) v5 -- 0x556317aef6c0 con 0x556318b84000 2023-10-03T19:21:27.953 INFO:teuthology.orchestra.run.smithi045.stdout: -552> 2023-10-03T19:19:54.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=READ_IO_SIZES, session=0x556318a78a00, total_ops=0, total_size=0 2023-10-03T19:21:27.953 INFO:teuthology.orchestra.run.smithi045.stdout: -551> 2023-10-03T19:19:54.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=WRITE_IO_SIZES, session=0x556318a78a00, total_ops=0, total_size=0 2023-10-03T19:21:27.954 INFO:teuthology.orchestra.run.smithi045.stdout: -550> 2023-10-03T19:19:54.432+0000 7fd1a7474640 1 mds.a asok_command: dump dir {format=json,path=/foo,prefix=dump dir} (starting...) 2023-10-03T19:21:27.954 INFO:teuthology.orchestra.run.smithi045.stdout: -549> 2023-10-03T19:19:54.432+0000 7fd1a7474640 10 mds.0.cache cache_traverse #0x1/foo 2023-10-03T19:21:27.954 INFO:teuthology.orchestra.run.smithi045.stdout: -548> 2023-10-03T19:19:54.432+0000 7fd1a7474640 20 mds.0.cache 0 foo frag * from [inode 0x1 [...2,head] / auth v3 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (inest lock dirty) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@4,7350=pAsLsXs/-@2} | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.954 INFO:teuthology.orchestra.run.smithi045.stdout: -547> 2023-10-03T19:19:54.432+0000 7fd1a7474640 20 mds.0.cache.dir(0x1) lookup (foo, 'head') 2023-10-03T19:21:27.954 INFO:teuthology.orchestra.run.smithi045.stdout: -546> 2023-10-03T19:19:54.432+0000 7fd1a7474640 20 mds.0.cache.dir(0x1) hit -> (foo,head) 2023-10-03T19:21:27.954 INFO:teuthology.orchestra.run.smithi045.stdout: -545> 2023-10-03T19:19:54.432+0000 7fd1a7474640 10 mds.0.cache got [inode 0x10000000000 [...2,head] /foo/ auth v4 DIRTYPARENT f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@3},l=7335 | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=0 0x556318acfb80] 2023-10-03T19:21:27.954 INFO:teuthology.orchestra.run.smithi045.stdout: -544> 2023-10-03T19:19:54.432+0000 7fd1a1468640 2 mds.0.cache Memory usage: total 274132, rss 38336, heap 207144, baseline 190760, 3 / 15 inodes have caps, 4 caps, 0.266667 caps per inode 2023-10-03T19:21:27.954 INFO:teuthology.orchestra.run.smithi045.stdout: -543> 2023-10-03T19:19:54.436+0000 7fd1a1468640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999984980s ago 2023-10-03T19:21:27.954 INFO:teuthology.orchestra.run.smithi045.stdout: -542> 2023-10-03T19:19:54.436+0000 7fd1a1468640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:27.954 INFO:teuthology.orchestra.run.smithi045.stdout: -541> 2023-10-03T19:19:54.436+0000 7fd1a1468640 10 mds.0.cache trim_client_leases pool 2 trimmed 0 leases, 1 left 2023-10-03T19:21:27.954 INFO:teuthology.orchestra.run.smithi045.stdout: -540> 2023-10-03T19:19:54.436+0000 7fd1a1468640 7 mds.0.cache trim bytes_used=59kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:27.955 INFO:teuthology.orchestra.run.smithi045.stdout: -539> 2023-10-03T19:19:54.436+0000 7fd1a1468640 7 mds.0.cache trim_lru trimming 0 items from LRU size=12 mid=0 pintail=0 pinned=12 2023-10-03T19:21:27.955 INFO:teuthology.orchestra.run.smithi045.stdout: -538> 2023-10-03T19:19:54.436+0000 7fd1a1468640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:27.955 INFO:teuthology.orchestra.run.smithi045.stdout: -537> 2023-10-03T19:19:54.436+0000 7fd1a1468640 7 mds.0.server recall_client_state: min=100 max=1048576 total=4 flags=0xa 2023-10-03T19:21:27.955 INFO:teuthology.orchestra.run.smithi045.stdout: -536> 2023-10-03T19:19:54.436+0000 7fd1a1468640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:27.955 INFO:teuthology.orchestra.run.smithi045.stdout: -535> 2023-10-03T19:19:54.436+0000 7fd1a1468640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:27.955 INFO:teuthology.orchestra.run.smithi045.stdout: -534> 2023-10-03T19:19:54.436+0000 7fd19e462640 20 update_rank0: mds.metrics 2023-10-03T19:21:27.955 INFO:teuthology.orchestra.run.smithi045.stdout: -533> 2023-10-03T19:19:54.436+0000 7fd19e462640 20 update_rank0: mds.metrics: sending metric updates for 2 clients to rank 0 (address: [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487]) with sequence number 2, last updated sequence number 5 2023-10-03T19:21:27.955 INFO:teuthology.orchestra.run.smithi045.stdout: -532> 2023-10-03T19:19:54.436+0000 7fd19e462640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] send_to--> mds [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mds_metrics from rank=0 carrying 2 metric updates v1 -- ?+0 0x556318bb0000 2023-10-03T19:21:27.955 INFO:teuthology.orchestra.run.smithi045.stdout: -531> 2023-10-03T19:19:54.436+0000 7fd19e462640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mds_metrics from rank=0 carrying 2 metric updates v1 -- 0x556318bb0000 con 0x556317aafc00 2023-10-03T19:21:27.955 INFO:teuthology.orchestra.run.smithi045.stdout: -530> 2023-10-03T19:19:54.436+0000 7fd1a4c6f640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mds.0 v2:172.21.15.45:6834/3401546487 0 ==== mds_metrics from rank=0 carrying 2 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x556318bb0000 con 0x556317aafc00 2023-10-03T19:21:27.955 INFO:teuthology.orchestra.run.smithi045.stdout: -529> 2023-10-03T19:19:54.436+0000 7fd1a4c6f640 20 mds.metric.aggregator handle_mds_metrics: applying 2 updates for rank=0 with sequence number 2 2023-10-03T19:21:27.955 INFO:teuthology.orchestra.run.smithi045.stdout: -528> 2023-10-03T19:19:54.436+0000 7fd1a4c6f640 10 mds.pinger pong_received: rank=0, sequence=2 2023-10-03T19:21:27.956 INFO:teuthology.orchestra.run.smithi045.stdout: -527> 2023-10-03T19:19:54.436+0000 7fd1a4c6f640 20 mds.metric.aggregator refresh_metrics_for_rank: client=client.7335 172.21.15.146:0/990159870, rank=0, metrics=[update_type=0, metrics={cap_hit_metric={hits=14, misses=3}, read_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, write_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, metadata_latency={latency=0.014680, avg_latency=0.002936, sq_sum=42001360404819, count=5}, dentry_lease={hits=1, misses=0}, opened_files_metric={opened_files=0, total_inodes=3}, pinned_icaps_metric={pinned_icaps=3, total_inodes=3}, opened_inodes_metric={opened_inodes=0, total_inodes=3}, read_io_sizes_metric={total_ops=0, total_size=0}, write_io_sizes_metric={total_ops=0, total_size=0}}] 2023-10-03T19:21:27.956 INFO:teuthology.orchestra.run.smithi045.stdout: -526> 2023-10-03T19:19:54.436+0000 7fd1a4c6f640 20 mds.metric.aggregator refresh_metrics_for_rank: client=client.7350 172.21.15.172:0/3138699255, rank=0, metrics=[update_type=0, metrics={cap_hit_metric={hits=4, misses=2}, read_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, write_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, metadata_latency={latency=0.000746, avg_latency=0.000746, sq_sum=0, count=1}, dentry_lease={hits=0, misses=0}, opened_files_metric={opened_files=0, total_inodes=1}, pinned_icaps_metric={pinned_icaps=1, total_inodes=1}, opened_inodes_metric={opened_inodes=0, total_inodes=1}, read_io_sizes_metric={total_ops=0, total_size=0}, write_io_sizes_metric={total_ops=0, total_size=0}}] 2023-10-03T19:21:27.956 INFO:teuthology.orchestra.run.smithi045.stdout: -525> 2023-10-03T19:19:54.436+0000 7fd1a4c6f640 20 mds.metric.aggregator refresh_metrics_for_rank: rank=0 has 2 connected client(s) 2023-10-03T19:21:27.956 INFO:teuthology.orchestra.run.smithi045.stdout: -524> 2023-10-03T19:19:54.972+0000 7fd1a7474640 1 mds.a asok_command: dump dir {dentry_dump=1,format=json,path=/foo,prefix=dump dir} (starting...) 2023-10-03T19:21:27.956 INFO:teuthology.orchestra.run.smithi045.stdout: -523> 2023-10-03T19:19:54.972+0000 7fd1a7474640 10 mds.0.cache cache_traverse #0x1/foo 2023-10-03T19:21:27.956 INFO:teuthology.orchestra.run.smithi045.stdout: -522> 2023-10-03T19:19:54.972+0000 7fd1a7474640 20 mds.0.cache 0 foo frag * from [inode 0x1 [...2,head] / auth v3 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (inest lock dirty) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@4,7350=pAsLsXs/-@2} | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:27.956 INFO:teuthology.orchestra.run.smithi045.stdout: -521> 2023-10-03T19:19:54.972+0000 7fd1a7474640 20 mds.0.cache.dir(0x1) lookup (foo, 'head') 2023-10-03T19:21:27.956 INFO:teuthology.orchestra.run.smithi045.stdout: -520> 2023-10-03T19:19:54.972+0000 7fd1a7474640 20 mds.0.cache.dir(0x1) hit -> (foo,head) 2023-10-03T19:21:27.956 INFO:teuthology.orchestra.run.smithi045.stdout: -519> 2023-10-03T19:19:54.972+0000 7fd1a7474640 10 mds.0.cache got [inode 0x10000000000 [...2,head] /foo/ auth v4 DIRTYPARENT f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@3},l=7335 | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=0 0x556318acfb80] 2023-10-03T19:21:27.956 INFO:teuthology.orchestra.run.smithi045.stdout: -518> 2023-10-03T19:19:55.012+0000 7fd1a7c75640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7335 172.21.15.146:0/990159870 14 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.014680, avg_latency: 0.002936, sq_sum: 42001360404819, count=5][client_metric_type: CAP_INFO cap_hits: 14 cap_misses: 3 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 1 dlease_misses: 0 num_dentries: 2][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 3][client_metric_type: PINNED_ICAPS pinned_icaps: 3 total_inodes: 3][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 3][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x556318a8d340 con 0x556318b59000 2023-10-03T19:21:27.957 INFO:teuthology.orchestra.run.smithi045.stdout: -517> 2023-10-03T19:19:55.012+0000 7fd1a7c75640 20 mds.0.48 get_session have 0x556318a4b700 client.7335 172.21.15.146:0/990159870 state open 2023-10-03T19:21:27.957 INFO:teuthology.orchestra.run.smithi045.stdout: -516> 2023-10-03T19:19:55.012+0000 7fd1a7c75640 20 handle_client_metrics: mds.metrics: session=0x556318a4b700 2023-10-03T19:21:27.957 INFO:teuthology.orchestra.run.smithi045.stdout: -515> 2023-10-03T19:19:55.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=READ_LATENCY, session=0x556318a4b700, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:27.957 INFO:teuthology.orchestra.run.smithi045.stdout: -514> 2023-10-03T19:19:55.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=WRITE_LATENCY, session=0x556318a4b700, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:27.957 INFO:teuthology.orchestra.run.smithi045.stdout: -513> 2023-10-03T19:19:55.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=METADATA_LATENCY, session=0x556318a4b700, latency=0.014680, avg=0.002936, sq_sum=42001360404819, count=5 2023-10-03T19:21:27.957 INFO:teuthology.orchestra.run.smithi045.stdout: -512> 2023-10-03T19:19:55.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=CAP_INFO, session=0x556318a4b700, hits=14, misses=3 2023-10-03T19:21:27.957 INFO:teuthology.orchestra.run.smithi045.stdout: -511> 2023-10-03T19:19:55.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=DENTRY_LEASE, session=0x556318a4b700, hits=1, misses=0 2023-10-03T19:21:27.957 INFO:teuthology.orchestra.run.smithi045.stdout: -510> 2023-10-03T19:19:55.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=OPENED_FILES, session=0x556318a4b700, opened_files=0, total_inodes=3 2023-10-03T19:21:27.957 INFO:teuthology.orchestra.run.smithi045.stdout: -509> 2023-10-03T19:19:55.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=PINNED_ICAPS, session=0x556318a4b700, pinned_icaps=3, total_inodes=3 2023-10-03T19:21:27.957 INFO:teuthology.orchestra.run.smithi045.stdout: -508> 2023-10-03T19:19:55.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=OPENED_INODES, session=0x556318a4b700, opened_inodes=0, total_inodes=3 2023-10-03T19:21:27.957 INFO:teuthology.orchestra.run.smithi045.stdout: -507> 2023-10-03T19:19:55.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=READ_IO_SIZES, session=0x556318a4b700, total_ops=0, total_size=0 2023-10-03T19:21:27.957 INFO:teuthology.orchestra.run.smithi045.stdout: -506> 2023-10-03T19:19:55.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=WRITE_IO_SIZES, session=0x556318a4b700, total_ops=0, total_size=0 2023-10-03T19:21:27.958 INFO:teuthology.orchestra.run.smithi045.stdout: -505> 2023-10-03T19:19:55.016+0000 7fd1a2c6b640 10 mds.pinger is_rank_lagging: rank=0 2023-10-03T19:21:27.958 INFO:teuthology.orchestra.run.smithi045.stdout: -504> 2023-10-03T19:19:55.016+0000 7fd1a2c6b640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgrreport(unknown.a +0-0 packed 1558) v9 -- 0x556318ad8000 con 0x5563189cc000 2023-10-03T19:21:27.958 INFO:teuthology.orchestra.run.smithi045.stdout: -503> 2023-10-03T19:19:55.068+0000 7fd1a446e640 10 monclient: tick 2023-10-03T19:21:27.958 INFO:teuthology.orchestra.run.smithi045.stdout: -502> 2023-10-03T19:19:55.068+0000 7fd1a446e640 10 monclient: _check_auth_tickets 2023-10-03T19:21:27.958 INFO:teuthology.orchestra.run.smithi045.stdout: -501> 2023-10-03T19:19:55.068+0000 7fd1a446e640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:25.070612+0000) 2023-10-03T19:21:27.973 INFO:teuthology.orchestra.run.smithi045.stdout: -500> 2023-10-03T19:19:55.188+0000 7fd1a8c77640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7350 172.21.15.172:0/3138699255 7 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000746, avg_latency: 0.000746, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 4 cap_misses: 2 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x556318a8db80 con 0x556318b84000 2023-10-03T19:21:27.974 INFO:teuthology.orchestra.run.smithi045.stdout: -499> 2023-10-03T19:19:55.188+0000 7fd1a8c77640 20 mds.0.48 get_session have 0x556318a78a00 client.7350 172.21.15.172:0/3138699255 state open 2023-10-03T19:21:27.974 INFO:teuthology.orchestra.run.smithi045.stdout: -498> 2023-10-03T19:19:55.188+0000 7fd1a8c77640 20 handle_client_metrics: mds.metrics: session=0x556318a78a00 2023-10-03T19:21:27.974 INFO:teuthology.orchestra.run.smithi045.stdout: -497> 2023-10-03T19:19:55.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=READ_LATENCY, session=0x556318a78a00, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:27.974 INFO:teuthology.orchestra.run.smithi045.stdout: -496> 2023-10-03T19:19:55.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=WRITE_LATENCY, session=0x556318a78a00, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:27.974 INFO:teuthology.orchestra.run.smithi045.stdout: -495> 2023-10-03T19:19:55.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=METADATA_LATENCY, session=0x556318a78a00, latency=0.000746, avg=0.000746, sq_sum=0, count=1 2023-10-03T19:21:27.974 INFO:teuthology.orchestra.run.smithi045.stdout: -494> 2023-10-03T19:19:55.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=CAP_INFO, session=0x556318a78a00, hits=4, misses=2 2023-10-03T19:21:27.974 INFO:teuthology.orchestra.run.smithi045.stdout: -493> 2023-10-03T19:19:55.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=DENTRY_LEASE, session=0x556318a78a00, hits=0, misses=0 2023-10-03T19:21:27.974 INFO:teuthology.orchestra.run.smithi045.stdout: -492> 2023-10-03T19:19:55.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=OPENED_FILES, session=0x556318a78a00, opened_files=0, total_inodes=1 2023-10-03T19:21:27.974 INFO:teuthology.orchestra.run.smithi045.stdout: -491> 2023-10-03T19:19:55.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=PINNED_ICAPS, session=0x556318a78a00, pinned_icaps=1, total_inodes=1 2023-10-03T19:21:27.974 INFO:teuthology.orchestra.run.smithi045.stdout: -490> 2023-10-03T19:19:55.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=OPENED_INODES, session=0x556318a78a00, opened_inodes=0, total_inodes=1 2023-10-03T19:21:27.974 INFO:teuthology.orchestra.run.smithi045.stdout: -489> 2023-10-03T19:19:55.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=READ_IO_SIZES, session=0x556318a78a00, total_ops=0, total_size=0 2023-10-03T19:21:27.975 INFO:teuthology.orchestra.run.smithi045.stdout: -488> 2023-10-03T19:19:55.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=WRITE_IO_SIZES, session=0x556318a78a00, total_ops=0, total_size=0 2023-10-03T19:21:27.975 INFO:teuthology.orchestra.run.smithi045.stdout: -487> 2023-10-03T19:19:55.420+0000 7fd1a3c6d640 20 mds.0.48 get_task_status 2023-10-03T19:21:27.975 INFO:teuthology.orchestra.run.smithi045.stdout: -486> 2023-10-03T19:19:55.420+0000 7fd1a3c6d640 20 mds.0.48 schedule_update_timer_task 2023-10-03T19:21:27.975 INFO:teuthology.orchestra.run.smithi045.stdout: -485> 2023-10-03T19:19:55.436+0000 7fd1a1468640 2 mds.0.cache Memory usage: total 274132, rss 38336, heap 207144, baseline 190760, 3 / 15 inodes have caps, 4 caps, 0.266667 caps per inode 2023-10-03T19:21:27.975 INFO:teuthology.orchestra.run.smithi045.stdout: -484> 2023-10-03T19:19:55.436+0000 7fd1a1468640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999984980s ago 2023-10-03T19:21:27.975 INFO:teuthology.orchestra.run.smithi045.stdout: -483> 2023-10-03T19:19:55.436+0000 7fd1a1468640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:27.975 INFO:teuthology.orchestra.run.smithi045.stdout: -482> 2023-10-03T19:19:55.436+0000 7fd1a1468640 10 mds.0.cache trim_client_leases pool 2 trimmed 0 leases, 1 left 2023-10-03T19:21:27.975 INFO:teuthology.orchestra.run.smithi045.stdout: -481> 2023-10-03T19:19:55.436+0000 7fd1a1468640 7 mds.0.cache trim bytes_used=59kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:27.975 INFO:teuthology.orchestra.run.smithi045.stdout: -480> 2023-10-03T19:19:55.436+0000 7fd1a1468640 7 mds.0.cache trim_lru trimming 0 items from LRU size=12 mid=0 pintail=0 pinned=12 2023-10-03T19:21:27.975 INFO:teuthology.orchestra.run.smithi045.stdout: -479> 2023-10-03T19:19:55.436+0000 7fd1a1468640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:27.975 INFO:teuthology.orchestra.run.smithi045.stdout: -478> 2023-10-03T19:19:55.436+0000 7fd1a1468640 7 mds.0.server recall_client_state: min=100 max=1048576 total=4 flags=0xa 2023-10-03T19:21:27.975 INFO:teuthology.orchestra.run.smithi045.stdout: -477> 2023-10-03T19:19:55.436+0000 7fd1a1468640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:27.976 INFO:teuthology.orchestra.run.smithi045.stdout: -476> 2023-10-03T19:19:55.436+0000 7fd1a1468640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:27.976 INFO:teuthology.orchestra.run.smithi045.stdout: -475> 2023-10-03T19:19:55.436+0000 7fd19dc61640 10 mds.metric.aggregator ping_all_active_ranks: pinging 1 active mds(s) 2023-10-03T19:21:27.976 INFO:teuthology.orchestra.run.smithi045.stdout: -474> 2023-10-03T19:19:55.436+0000 7fd19dc61640 20 mds.metric.aggregator ping_all_active_ranks: pinging rank=0 addr=[v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] 2023-10-03T19:21:27.976 INFO:teuthology.orchestra.run.smithi045.stdout: -473> 2023-10-03T19:19:55.436+0000 7fd19dc61640 10 mds.pinger send_ping: rank=0 2023-10-03T19:21:27.976 INFO:teuthology.orchestra.run.smithi045.stdout: -472> 2023-10-03T19:19:55.436+0000 7fd19dc61640 10 mds.pinger send_ping: sending ping with sequence=3 to rank=0 2023-10-03T19:21:27.976 INFO:teuthology.orchestra.run.smithi045.stdout: -471> 2023-10-03T19:19:55.436+0000 7fd19dc61640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] send_to--> mds [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mdsping v1 -- ?+0 0x556317b80640 2023-10-03T19:21:27.976 INFO:teuthology.orchestra.run.smithi045.stdout: -470> 2023-10-03T19:19:55.436+0000 7fd19dc61640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mdsping v1 -- 0x556317b80640 con 0x556317aafc00 2023-10-03T19:21:27.976 INFO:teuthology.orchestra.run.smithi045.stdout: -469> 2023-10-03T19:19:55.436+0000 7fd1a4c6f640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mds.0 v2:172.21.15.45:6834/3401546487 0 ==== mdsping v1 ==== 0+0+0 (unknown 0 0 0) 0x556317b80640 con 0x556317aafc00 2023-10-03T19:21:27.976 INFO:teuthology.orchestra.run.smithi045.stdout: -468> 2023-10-03T19:19:55.436+0000 7fd1a4c6f640 20 set_next_seq: mds.metrics: current sequence number 2, setting next sequence number 3 2023-10-03T19:21:27.976 INFO:teuthology.orchestra.run.smithi045.stdout: -467> 2023-10-03T19:19:55.500+0000 7fd1a346c640 5 mds.beacon.a Sending beacon up:active seq 7 2023-10-03T19:21:27.976 INFO:teuthology.orchestra.run.smithi045.stdout: -466> 2023-10-03T19:19:55.500+0000 7fd1a346c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:27.977 INFO:teuthology.orchestra.run.smithi045.stdout: -465> 2023-10-03T19:19:55.500+0000 7fd1a346c640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mdsbeacon(7155/a up:active seq=7 v50) v8 -- 0x556318b98000 con 0x556317aaf800 2023-10-03T19:21:27.977 INFO:teuthology.orchestra.run.smithi045.stdout: -464> 2023-10-03T19:19:55.500+0000 7fd1a346c640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:27.977 INFO:teuthology.orchestra.run.smithi045.stdout: -463> 2023-10-03T19:19:55.500+0000 7fd1a8476640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 56 ==== mdsbeacon(7155/a up:active seq=7 v50) v8 ==== 130+0+0 (secure 0 0 0) 0x556318b98000 con 0x556317aaf800 2023-10-03T19:21:27.977 INFO:teuthology.orchestra.run.smithi045.stdout: -462> 2023-10-03T19:19:55.500+0000 7fd1a8476640 5 mds.beacon.a received beacon reply up:active seq 7 rtt 0 2023-10-03T19:21:27.977 INFO:teuthology.orchestra.run.smithi045.stdout: -461> 2023-10-03T19:19:55.500+0000 7fd1a346c640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:27.977 INFO:teuthology.orchestra.run.smithi045.stdout: -460> 2023-10-03T19:19:56.012+0000 7fd1a7c75640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7335 172.21.15.146:0/990159870 15 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.014680, avg_latency: 0.002936, sq_sum: 42001360404819, count=5][client_metric_type: CAP_INFO cap_hits: 14 cap_misses: 3 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 1 dlease_misses: 0 num_dentries: 2][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 3][client_metric_type: PINNED_ICAPS pinned_icaps: 3 total_inodes: 3][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 3][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x556318a8d340 con 0x556318b59000 2023-10-03T19:21:27.977 INFO:teuthology.orchestra.run.smithi045.stdout: -459> 2023-10-03T19:19:56.012+0000 7fd1a7c75640 20 mds.0.48 get_session have 0x556318a4b700 client.7335 172.21.15.146:0/990159870 state open 2023-10-03T19:21:27.977 INFO:teuthology.orchestra.run.smithi045.stdout: -458> 2023-10-03T19:19:56.012+0000 7fd1a7c75640 20 handle_client_metrics: mds.metrics: session=0x556318a4b700 2023-10-03T19:21:27.977 INFO:teuthology.orchestra.run.smithi045.stdout: -457> 2023-10-03T19:19:56.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=READ_LATENCY, session=0x556318a4b700, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:27.977 INFO:teuthology.orchestra.run.smithi045.stdout: -456> 2023-10-03T19:19:56.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=WRITE_LATENCY, session=0x556318a4b700, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:27.977 INFO:teuthology.orchestra.run.smithi045.stdout: -455> 2023-10-03T19:19:56.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=METADATA_LATENCY, session=0x556318a4b700, latency=0.014680, avg=0.002936, sq_sum=42001360404819, count=5 2023-10-03T19:21:27.978 INFO:teuthology.orchestra.run.smithi045.stdout: -454> 2023-10-03T19:19:56.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=CAP_INFO, session=0x556318a4b700, hits=14, misses=3 2023-10-03T19:21:27.978 INFO:teuthology.orchestra.run.smithi045.stdout: -453> 2023-10-03T19:19:56.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=DENTRY_LEASE, session=0x556318a4b700, hits=1, misses=0 2023-10-03T19:21:27.978 INFO:teuthology.orchestra.run.smithi045.stdout: -452> 2023-10-03T19:19:56.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=OPENED_FILES, session=0x556318a4b700, opened_files=0, total_inodes=3 2023-10-03T19:21:27.978 INFO:teuthology.orchestra.run.smithi045.stdout: -451> 2023-10-03T19:19:56.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=PINNED_ICAPS, session=0x556318a4b700, pinned_icaps=3, total_inodes=3 2023-10-03T19:21:27.978 INFO:teuthology.orchestra.run.smithi045.stdout: -450> 2023-10-03T19:19:56.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=OPENED_INODES, session=0x556318a4b700, opened_inodes=0, total_inodes=3 2023-10-03T19:21:27.978 INFO:teuthology.orchestra.run.smithi045.stdout: -449> 2023-10-03T19:19:56.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=READ_IO_SIZES, session=0x556318a4b700, total_ops=0, total_size=0 2023-10-03T19:21:27.978 INFO:teuthology.orchestra.run.smithi045.stdout: -448> 2023-10-03T19:19:56.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=WRITE_IO_SIZES, session=0x556318a4b700, total_ops=0, total_size=0 2023-10-03T19:21:27.978 INFO:teuthology.orchestra.run.smithi045.stdout: -447> 2023-10-03T19:19:56.068+0000 7fd1a446e640 10 monclient: tick 2023-10-03T19:21:27.978 INFO:teuthology.orchestra.run.smithi045.stdout: -446> 2023-10-03T19:19:56.068+0000 7fd1a446e640 10 monclient: _check_auth_tickets 2023-10-03T19:21:27.978 INFO:teuthology.orchestra.run.smithi045.stdout: -445> 2023-10-03T19:19:56.068+0000 7fd1a446e640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:26.070700+0000) 2023-10-03T19:21:27.978 INFO:teuthology.orchestra.run.smithi045.stdout: -444> 2023-10-03T19:19:56.188+0000 7fd1a8c77640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7350 172.21.15.172:0/3138699255 8 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000746, avg_latency: 0.000746, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 4 cap_misses: 2 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x556318a8db80 con 0x556318b84000 2023-10-03T19:21:27.979 INFO:teuthology.orchestra.run.smithi045.stdout: -443> 2023-10-03T19:19:56.188+0000 7fd1a8c77640 20 mds.0.48 get_session have 0x556318a78a00 client.7350 172.21.15.172:0/3138699255 state open 2023-10-03T19:21:27.979 INFO:teuthology.orchestra.run.smithi045.stdout: -442> 2023-10-03T19:19:56.188+0000 7fd1a8c77640 20 handle_client_metrics: mds.metrics: session=0x556318a78a00 2023-10-03T19:21:27.979 INFO:teuthology.orchestra.run.smithi045.stdout: -441> 2023-10-03T19:19:56.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=READ_LATENCY, session=0x556318a78a00, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:27.979 INFO:teuthology.orchestra.run.smithi045.stdout: -440> 2023-10-03T19:19:56.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=WRITE_LATENCY, session=0x556318a78a00, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:27.979 INFO:teuthology.orchestra.run.smithi045.stdout: -439> 2023-10-03T19:19:56.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=METADATA_LATENCY, session=0x556318a78a00, latency=0.000746, avg=0.000746, sq_sum=0, count=1 2023-10-03T19:21:27.979 INFO:teuthology.orchestra.run.smithi045.stdout: -438> 2023-10-03T19:19:56.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=CAP_INFO, session=0x556318a78a00, hits=4, misses=2 2023-10-03T19:21:27.979 INFO:teuthology.orchestra.run.smithi045.stdout: -437> 2023-10-03T19:19:56.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=DENTRY_LEASE, session=0x556318a78a00, hits=0, misses=0 2023-10-03T19:21:27.979 INFO:teuthology.orchestra.run.smithi045.stdout: -436> 2023-10-03T19:19:56.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=OPENED_FILES, session=0x556318a78a00, opened_files=0, total_inodes=1 2023-10-03T19:21:27.979 INFO:teuthology.orchestra.run.smithi045.stdout: -435> 2023-10-03T19:19:56.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=PINNED_ICAPS, session=0x556318a78a00, pinned_icaps=1, total_inodes=1 2023-10-03T19:21:27.979 INFO:teuthology.orchestra.run.smithi045.stdout: -434> 2023-10-03T19:19:56.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=OPENED_INODES, session=0x556318a78a00, opened_inodes=0, total_inodes=1 2023-10-03T19:21:27.979 INFO:teuthology.orchestra.run.smithi045.stdout: -433> 2023-10-03T19:19:56.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=READ_IO_SIZES, session=0x556318a78a00, total_ops=0, total_size=0 2023-10-03T19:21:27.979 INFO:teuthology.orchestra.run.smithi045.stdout: -432> 2023-10-03T19:19:56.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=WRITE_IO_SIZES, session=0x556318a78a00, total_ops=0, total_size=0 2023-10-03T19:21:27.980 INFO:teuthology.orchestra.run.smithi045.stdout: -431> 2023-10-03T19:19:56.436+0000 7fd1a1468640 2 mds.0.cache Memory usage: total 274132, rss 38600, heap 207144, baseline 190760, 3 / 15 inodes have caps, 4 caps, 0.266667 caps per inode 2023-10-03T19:21:27.980 INFO:teuthology.orchestra.run.smithi045.stdout: -430> 2023-10-03T19:19:56.436+0000 7fd1a1468640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999985039s ago 2023-10-03T19:21:27.980 INFO:teuthology.orchestra.run.smithi045.stdout: -429> 2023-10-03T19:19:56.436+0000 7fd1a1468640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:27.980 INFO:teuthology.orchestra.run.smithi045.stdout: -428> 2023-10-03T19:19:56.436+0000 7fd1a1468640 10 mds.0.cache trim_client_leases pool 2 trimmed 0 leases, 1 left 2023-10-03T19:21:27.980 INFO:teuthology.orchestra.run.smithi045.stdout: -427> 2023-10-03T19:19:56.436+0000 7fd1a1468640 7 mds.0.cache trim bytes_used=59kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:27.980 INFO:teuthology.orchestra.run.smithi045.stdout: -426> 2023-10-03T19:19:56.436+0000 7fd1a1468640 7 mds.0.cache trim_lru trimming 0 items from LRU size=12 mid=0 pintail=0 pinned=12 2023-10-03T19:21:27.980 INFO:teuthology.orchestra.run.smithi045.stdout: -425> 2023-10-03T19:19:56.436+0000 7fd1a1468640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:27.980 INFO:teuthology.orchestra.run.smithi045.stdout: -424> 2023-10-03T19:19:56.436+0000 7fd1a1468640 7 mds.0.server recall_client_state: min=100 max=1048576 total=4 flags=0xa 2023-10-03T19:21:27.980 INFO:teuthology.orchestra.run.smithi045.stdout: -423> 2023-10-03T19:19:56.436+0000 7fd1a1468640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:27.980 INFO:teuthology.orchestra.run.smithi045.stdout: -422> 2023-10-03T19:19:56.436+0000 7fd1a1468640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:27.981 INFO:teuthology.orchestra.run.smithi045.stdout: -421> 2023-10-03T19:19:56.436+0000 7fd19e462640 20 update_rank0: mds.metrics 2023-10-03T19:21:27.981 INFO:teuthology.orchestra.run.smithi045.stdout: -420> 2023-10-03T19:19:56.436+0000 7fd19e462640 20 update_rank0: mds.metrics: sending metric updates for 2 clients to rank 0 (address: [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487]) with sequence number 3, last updated sequence number 6 2023-10-03T19:21:27.981 INFO:teuthology.orchestra.run.smithi045.stdout: -419> 2023-10-03T19:19:56.436+0000 7fd19e462640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] send_to--> mds [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mds_metrics from rank=0 carrying 2 metric updates v1 -- ?+0 0x556318bb0480 2023-10-03T19:21:27.981 INFO:teuthology.orchestra.run.smithi045.stdout: -418> 2023-10-03T19:19:56.436+0000 7fd19e462640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mds_metrics from rank=0 carrying 2 metric updates v1 -- 0x556318bb0480 con 0x556317aafc00 2023-10-03T19:21:27.981 INFO:teuthology.orchestra.run.smithi045.stdout: -417> 2023-10-03T19:19:56.436+0000 7fd1a4c6f640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mds.0 v2:172.21.15.45:6834/3401546487 0 ==== mds_metrics from rank=0 carrying 2 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x556318bb0480 con 0x556317aafc00 2023-10-03T19:21:27.981 INFO:teuthology.orchestra.run.smithi045.stdout: -416> 2023-10-03T19:19:56.436+0000 7fd1a4c6f640 20 mds.metric.aggregator handle_mds_metrics: applying 2 updates for rank=0 with sequence number 3 2023-10-03T19:21:27.981 INFO:teuthology.orchestra.run.smithi045.stdout: -415> 2023-10-03T19:19:56.436+0000 7fd1a4c6f640 10 mds.pinger pong_received: rank=0, sequence=3 2023-10-03T19:21:27.981 INFO:teuthology.orchestra.run.smithi045.stdout: -414> 2023-10-03T19:19:56.436+0000 7fd1a4c6f640 20 mds.metric.aggregator refresh_metrics_for_rank: client=client.7335 172.21.15.146:0/990159870, rank=0, metrics=[update_type=0, metrics={cap_hit_metric={hits=14, misses=3}, read_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, write_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, metadata_latency={latency=0.014680, avg_latency=0.002936, sq_sum=42001360404819, count=5}, dentry_lease={hits=1, misses=0}, opened_files_metric={opened_files=0, total_inodes=3}, pinned_icaps_metric={pinned_icaps=3, total_inodes=3}, opened_inodes_metric={opened_inodes=0, total_inodes=3}, read_io_sizes_metric={total_ops=0, total_size=0}, write_io_sizes_metric={total_ops=0, total_size=0}}] 2023-10-03T19:21:27.981 INFO:teuthology.orchestra.run.smithi045.stdout: -413> 2023-10-03T19:19:56.436+0000 7fd1a4c6f640 20 mds.metric.aggregator refresh_metrics_for_rank: client=client.7350 172.21.15.172:0/3138699255, rank=0, metrics=[update_type=0, metrics={cap_hit_metric={hits=4, misses=2}, read_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, write_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, metadata_latency={latency=0.000746, avg_latency=0.000746, sq_sum=0, count=1}, dentry_lease={hits=0, misses=0}, opened_files_metric={opened_files=0, total_inodes=1}, pinned_icaps_metric={pinned_icaps=1, total_inodes=1}, opened_inodes_metric={opened_inodes=0, total_inodes=1}, read_io_sizes_metric={total_ops=0, total_size=0}, write_io_sizes_metric={total_ops=0, total_size=0}}] 2023-10-03T19:21:27.981 INFO:teuthology.orchestra.run.smithi045.stdout: -412> 2023-10-03T19:19:57.012+0000 7fd1a7c75640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7335 172.21.15.146:0/990159870 16 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.014680, avg_latency: 0.002936, sq_sum: 42001360404819, count=5][client_metric_type: CAP_INFO cap_hits: 14 cap_misses: 3 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 1 dlease_misses: 0 num_dentries: 2][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 3][client_metric_type: PINNED_ICAPS pinned_icaps: 3 total_inodes: 3][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 3][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x556318a8d340 con 0x556318b59000 2023-10-03T19:21:27.981 INFO:teuthology.orchestra.run.smithi045.stdout: -411> 2023-10-03T19:19:57.012+0000 7fd1a7c75640 20 mds.0.48 get_session have 0x556318a4b700 client.7335 172.21.15.146:0/990159870 state open 2023-10-03T19:21:27.982 INFO:teuthology.orchestra.run.smithi045.stdout: -410> 2023-10-03T19:19:57.012+0000 7fd1a7c75640 20 handle_client_metrics: mds.metrics: session=0x556318a4b700 2023-10-03T19:21:27.982 INFO:teuthology.orchestra.run.smithi045.stdout: -409> 2023-10-03T19:19:57.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=READ_LATENCY, session=0x556318a4b700, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:27.982 INFO:teuthology.orchestra.run.smithi045.stdout: -408> 2023-10-03T19:19:57.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=WRITE_LATENCY, session=0x556318a4b700, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:27.982 INFO:teuthology.orchestra.run.smithi045.stdout: -407> 2023-10-03T19:19:57.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=METADATA_LATENCY, session=0x556318a4b700, latency=0.014680, avg=0.002936, sq_sum=42001360404819, count=5 2023-10-03T19:21:27.982 INFO:teuthology.orchestra.run.smithi045.stdout: -406> 2023-10-03T19:19:57.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=CAP_INFO, session=0x556318a4b700, hits=14, misses=3 2023-10-03T19:21:27.982 INFO:teuthology.orchestra.run.smithi045.stdout: -405> 2023-10-03T19:19:57.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=DENTRY_LEASE, session=0x556318a4b700, hits=1, misses=0 2023-10-03T19:21:27.982 INFO:teuthology.orchestra.run.smithi045.stdout: -404> 2023-10-03T19:19:57.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=OPENED_FILES, session=0x556318a4b700, opened_files=0, total_inodes=3 2023-10-03T19:21:27.982 INFO:teuthology.orchestra.run.smithi045.stdout: -403> 2023-10-03T19:19:57.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=PINNED_ICAPS, session=0x556318a4b700, pinned_icaps=3, total_inodes=3 2023-10-03T19:21:27.982 INFO:teuthology.orchestra.run.smithi045.stdout: -402> 2023-10-03T19:19:57.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=OPENED_INODES, session=0x556318a4b700, opened_inodes=0, total_inodes=3 2023-10-03T19:21:27.982 INFO:teuthology.orchestra.run.smithi045.stdout: -401> 2023-10-03T19:19:57.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=READ_IO_SIZES, session=0x556318a4b700, total_ops=0, total_size=0 2023-10-03T19:21:27.982 INFO:teuthology.orchestra.run.smithi045.stdout: -400> 2023-10-03T19:19:57.012+0000 7fd1a7c75640 20 handle_payload: mds.metrics: type=WRITE_IO_SIZES, session=0x556318a4b700, total_ops=0, total_size=0 2023-10-03T19:21:27.982 INFO:teuthology.orchestra.run.smithi045.stdout: -399> 2023-10-03T19:19:57.068+0000 7fd1a446e640 10 monclient: tick 2023-10-03T19:21:27.983 INFO:teuthology.orchestra.run.smithi045.stdout: -398> 2023-10-03T19:19:57.068+0000 7fd1a446e640 10 monclient: _check_auth_tickets 2023-10-03T19:21:27.983 INFO:teuthology.orchestra.run.smithi045.stdout: -397> 2023-10-03T19:19:57.068+0000 7fd1a446e640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:27.070757+0000) 2023-10-03T19:21:27.983 INFO:teuthology.orchestra.run.smithi045.stdout: -396> 2023-10-03T19:19:57.188+0000 7fd1a8c77640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7350 172.21.15.172:0/3138699255 9 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000746, avg_latency: 0.000746, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 4 cap_misses: 2 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x556318a8db80 con 0x556318b84000 2023-10-03T19:21:27.983 INFO:teuthology.orchestra.run.smithi045.stdout: -395> 2023-10-03T19:19:57.188+0000 7fd1a8c77640 20 mds.0.48 get_session have 0x556318a78a00 client.7350 172.21.15.172:0/3138699255 state open 2023-10-03T19:21:27.983 INFO:teuthology.orchestra.run.smithi045.stdout: -394> 2023-10-03T19:19:57.188+0000 7fd1a8c77640 20 handle_client_metrics: mds.metrics: session=0x556318a78a00 2023-10-03T19:21:27.983 INFO:teuthology.orchestra.run.smithi045.stdout: -393> 2023-10-03T19:19:57.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=READ_LATENCY, session=0x556318a78a00, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:27.983 INFO:teuthology.orchestra.run.smithi045.stdout: -392> 2023-10-03T19:19:57.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=WRITE_LATENCY, session=0x556318a78a00, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:27.983 INFO:teuthology.orchestra.run.smithi045.stdout: -391> 2023-10-03T19:19:57.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=METADATA_LATENCY, session=0x556318a78a00, latency=0.000746, avg=0.000746, sq_sum=0, count=1 2023-10-03T19:21:27.983 INFO:teuthology.orchestra.run.smithi045.stdout: -390> 2023-10-03T19:19:57.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=CAP_INFO, session=0x556318a78a00, hits=4, misses=2 2023-10-03T19:21:27.983 INFO:teuthology.orchestra.run.smithi045.stdout: -389> 2023-10-03T19:19:57.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=DENTRY_LEASE, session=0x556318a78a00, hits=0, misses=0 2023-10-03T19:21:27.984 INFO:teuthology.orchestra.run.smithi045.stdout: -388> 2023-10-03T19:19:57.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=OPENED_FILES, session=0x556318a78a00, opened_files=0, total_inodes=1 2023-10-03T19:21:27.984 INFO:teuthology.orchestra.run.smithi045.stdout: -387> 2023-10-03T19:19:57.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=PINNED_ICAPS, session=0x556318a78a00, pinned_icaps=1, total_inodes=1 2023-10-03T19:21:27.984 INFO:teuthology.orchestra.run.smithi045.stdout: -386> 2023-10-03T19:19:57.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=OPENED_INODES, session=0x556318a78a00, opened_inodes=0, total_inodes=1 2023-10-03T19:21:27.984 INFO:teuthology.orchestra.run.smithi045.stdout: -385> 2023-10-03T19:19:57.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=READ_IO_SIZES, session=0x556318a78a00, total_ops=0, total_size=0 2023-10-03T19:21:27.984 INFO:teuthology.orchestra.run.smithi045.stdout: -384> 2023-10-03T19:19:57.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=WRITE_IO_SIZES, session=0x556318a78a00, total_ops=0, total_size=0 2023-10-03T19:21:27.984 INFO:teuthology.orchestra.run.smithi045.stdout: -383> 2023-10-03T19:19:57.420+0000 7fd1a3c6d640 20 mds.0.48 get_task_status 2023-10-03T19:21:27.984 INFO:teuthology.orchestra.run.smithi045.stdout: -382> 2023-10-03T19:19:57.420+0000 7fd1a3c6d640 20 mds.0.48 schedule_update_timer_task 2023-10-03T19:21:27.984 INFO:teuthology.orchestra.run.smithi045.stdout: -381> 2023-10-03T19:19:57.436+0000 7fd1a1468640 2 mds.0.cache Memory usage: total 274132, rss 38600, heap 207144, baseline 190760, 3 / 15 inodes have caps, 4 caps, 0.266667 caps per inode 2023-10-03T19:21:27.984 INFO:teuthology.orchestra.run.smithi045.stdout: -380> 2023-10-03T19:19:57.436+0000 7fd1a1468640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999985039s ago 2023-10-03T19:21:27.984 INFO:teuthology.orchestra.run.smithi045.stdout: -379> 2023-10-03T19:19:57.436+0000 7fd1a1468640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:27.984 INFO:teuthology.orchestra.run.smithi045.stdout: -378> 2023-10-03T19:19:57.436+0000 7fd1a1468640 10 mds.0.cache trim_client_leases pool 2 trimmed 0 leases, 1 left 2023-10-03T19:21:27.984 INFO:teuthology.orchestra.run.smithi045.stdout: -377> 2023-10-03T19:19:57.436+0000 7fd1a1468640 7 mds.0.cache trim bytes_used=59kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:27.985 INFO:teuthology.orchestra.run.smithi045.stdout: -376> 2023-10-03T19:19:57.436+0000 7fd1a1468640 7 mds.0.cache trim_lru trimming 0 items from LRU size=12 mid=0 pintail=0 pinned=12 2023-10-03T19:21:27.985 INFO:teuthology.orchestra.run.smithi045.stdout: -375> 2023-10-03T19:19:57.436+0000 7fd1a1468640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:27.985 INFO:teuthology.orchestra.run.smithi045.stdout: -374> 2023-10-03T19:19:57.436+0000 7fd1a1468640 7 mds.0.server recall_client_state: min=100 max=1048576 total=4 flags=0xa 2023-10-03T19:21:27.985 INFO:teuthology.orchestra.run.smithi045.stdout: -373> 2023-10-03T19:19:57.436+0000 7fd1a1468640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:27.985 INFO:teuthology.orchestra.run.smithi045.stdout: -372> 2023-10-03T19:19:57.436+0000 7fd1a1468640 10 mds.0.cache releasing free memory 2023-10-03T19:21:27.985 INFO:teuthology.orchestra.run.smithi045.stdout: -371> 2023-10-03T19:19:57.436+0000 7fd1a1468640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:27.985 INFO:teuthology.orchestra.run.smithi045.stdout: -370> 2023-10-03T19:19:57.440+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7335 172.21.15.146:0/990159870 17 ==== client_session(request_close seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x556317aefc00 con 0x556318b59000 2023-10-03T19:21:27.985 INFO:teuthology.orchestra.run.smithi045.stdout: -369> 2023-10-03T19:19:57.440+0000 7fd1a5470640 20 mds.0.48 get_session have 0x556318a4b700 client.7335 172.21.15.146:0/990159870 state open 2023-10-03T19:21:27.985 INFO:teuthology.orchestra.run.smithi045.stdout: -368> 2023-10-03T19:19:57.440+0000 7fd1a5470640 3 mds.0.server handle_client_session client_session(request_close seq 1) v1 from client.7335 2023-10-03T19:21:27.985 INFO:teuthology.orchestra.run.smithi045.stdout: -367> 2023-10-03T19:19:57.440+0000 7fd1a5470640 10 mds.0.server journal_close_session : client.7335 172.21.15.146:0/990159870 pending_prealloc_inos [] free_prealloc_inos [0x10000000002~0x3e7] delegated_inos [] 2023-10-03T19:21:27.985 INFO:teuthology.orchestra.run.smithi045.stdout: -366> 2023-10-03T19:19:57.440+0000 7fd1a5470640 20 mds.0.sessionmap mark_projected s=0x556318a4b700 name=client.7335 pv=4 -> 5 2023-10-03T19:21:27.986 INFO:teuthology.orchestra.run.smithi045.stdout: -365> 2023-10-03T19:19:57.440+0000 7fd1a5470640 10 mds.0.inotable: project_release_ids [0x10000000002~0x3e7] to [0x100000003e9~0xfffffffc17]/[0x100000003e9~0xfffffffc17] 2023-10-03T19:21:27.986 INFO:teuthology.orchestra.run.smithi045.stdout: -364> 2023-10-03T19:19:57.440+0000 7fd19ec63640 5 mds.0.log _submit_thread 4201158~137 : ESession client.7335 172.21.15.146:0/990159870 close cmapv 5 (999 to free, v3, 0 to purge) 2023-10-03T19:21:27.986 INFO:teuthology.orchestra.run.smithi045.stdout: -363> 2023-10-03T19:19:57.440+0000 7fd19ec63640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.48:45 15.14 15:2e2fa760:::200.00000001:head [write 6854~157 [fadvise_dontneed] in=157b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e98) v8 -- 0x556318ad9180 con 0x5563189cc400 2023-10-03T19:21:27.986 INFO:teuthology.orchestra.run.smithi045.stdout: -362> 2023-10-03T19:19:57.440+0000 7fd19ec63640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.48:46 15.14 15:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed] in=90b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e98) v8 -- 0x556318bba000 con 0x5563189cc400 2023-10-03T19:21:27.986 INFO:teuthology.orchestra.run.smithi045.stdout: -361> 2023-10-03T19:19:57.444+0000 7fd1a8c77640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.6 v2:172.21.15.79:6819/1486010128 12 ==== osd_op_reply(45 200.00000001 [write 6854~157 [fadvise_dontneed]] v98'11 uv11 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x556318aaf440 con 0x5563189cc400 2023-10-03T19:21:27.986 INFO:teuthology.orchestra.run.smithi045.stdout: -360> 2023-10-03T19:19:57.444+0000 7fd19f464640 10 MDSIOContextBase::complete: 20C_MDS_session_finish 2023-10-03T19:21:27.986 INFO:teuthology.orchestra.run.smithi045.stdout: -359> 2023-10-03T19:19:57.444+0000 7fd19f464640 10 MDSContext::complete: 20C_MDS_session_finish 2023-10-03T19:21:27.986 INFO:teuthology.orchestra.run.smithi045.stdout: -358> 2023-10-03T19:19:57.444+0000 7fd19f464640 10 mds.0.server _session_logged client.7335 172.21.15.146:0/990159870 state_seq 3 close 5 inos_to_free [0x10000000002~0x3e7] inotablev 3 inos_to_purge [] 2023-10-03T19:21:27.986 INFO:teuthology.orchestra.run.smithi045.stdout: -357> 2023-10-03T19:19:57.444+0000 7fd19f464640 10 mds.0.inotable: apply_release_ids [0x10000000002~0x3e7] to [0x10000000002~0xfffffffffe]/[0x100000003e9~0xfffffffc17] 2023-10-03T19:21:27.986 INFO:teuthology.orchestra.run.smithi045.stdout: -356> 2023-10-03T19:19:57.444+0000 7fd19f464640 20 mds.0.sessionmap mark_dirty s=0x556318a4b700 name=client.7335 v=4 2023-10-03T19:21:27.986 INFO:teuthology.orchestra.run.smithi045.stdout: -355> 2023-10-03T19:19:57.444+0000 7fd19f464640 20 mds.0.server killing capability pAsxLsXsxFsx on [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 DIRTYPARENT f() n(v0 1=0+1) (iauth excl) (inest lock) (ifile excl) (ixattr excl) (iversion lock) caps={7335=pAsxLsXsxFsx/-@1},l=7335 | request=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 0x556318ad0100] 2023-10-03T19:21:27.987 INFO:teuthology.orchestra.run.smithi045.stdout: -354> 2023-10-03T19:19:57.444+0000 7fd19f464640 10 mds.0.cache.ino(0x10000000001) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:19:39.424362+0000 change_attr 0 0x556317c178c0) 2023-10-03T19:21:27.987 INFO:teuthology.orchestra.run.smithi045.stdout: -353> 2023-10-03T19:19:57.444+0000 7fd19f464640 10 mds.0.openfiles remove_dirfrag [dir 0x10000000000 /foo/ [2,head] auth v=3 cv=0/0 state=1610874881|complete f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 1=0+1) hs=1+0,ss=0+0 dirty=1 | child=1 dirty=1 authpin=0 0x556318a52880] 2023-10-03T19:21:27.987 INFO:teuthology.orchestra.run.smithi045.stdout: -352> 2023-10-03T19:19:57.444+0000 7fd19f464640 10 mds.0.locker eval 3648 [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 DIRTYPARENT f() n(v0 1=0+1) (iauth excl) (inest lock) (ifile excl) (ixattr excl) (iversion lock) | request=0 dirfrag=1 caps=0 dirtyparent=1 dirty=1 0x556318ad0100] 2023-10-03T19:21:27.987 INFO:teuthology.orchestra.run.smithi045.stdout: -351> 2023-10-03T19:19:57.444+0000 7fd19f464640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 DIRTYPARENT f() n(v0 1=0+1) (iauth excl) (inest lock) (ifile excl) (ixattr excl) (iversion lock) | request=0 dirfrag=1 caps=0 dirtyparent=1 dirty=1 0x556318ad0100] 2023-10-03T19:21:27.987 INFO:teuthology.orchestra.run.smithi045.stdout: -350> 2023-10-03T19:19:57.444+0000 7fd19f464640 20 mds.0.locker is excl 2023-10-03T19:21:27.987 INFO:teuthology.orchestra.run.smithi045.stdout: -349> 2023-10-03T19:19:57.444+0000 7fd19f464640 7 mds.0.locker file_eval loner_issued= other_issued= xlocker_issued= 2023-10-03T19:21:27.987 INFO:teuthology.orchestra.run.smithi045.stdout: -348> 2023-10-03T19:19:57.444+0000 7fd19f464640 20 mds.0.locker should lose it 2023-10-03T19:21:27.987 INFO:teuthology.orchestra.run.smithi045.stdout: -347> 2023-10-03T19:19:57.444+0000 7fd19f464640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 DIRTYPARENT f() n(v0 1=0+1) (iauth excl) (inest lock) (ifile excl) (ixattr excl) (iversion lock) | request=0 dirfrag=1 caps=0 dirtyparent=1 dirty=1 0x556318ad0100] 2023-10-03T19:21:27.987 INFO:teuthology.orchestra.run.smithi045.stdout: -346> 2023-10-03T19:19:57.444+0000 7fd19f464640 10 mds.0.locker simple_eval (iauth excl) on [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 DIRTYPARENT f() n(v0 1=0+1) (iauth excl) (inest lock) (ixattr excl) (iversion lock) | request=0 dirfrag=1 caps=0 dirtyparent=1 dirty=1 0x556318ad0100] 2023-10-03T19:21:27.987 INFO:teuthology.orchestra.run.smithi045.stdout: -345> 2023-10-03T19:19:57.444+0000 7fd19f464640 7 mds.0.locker simple_eval stable, syncing (iauth excl) on [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 DIRTYPARENT f() n(v0 1=0+1) (iauth excl) (inest lock) (ixattr excl) (iversion lock) | request=0 dirfrag=1 caps=0 dirtyparent=1 dirty=1 0x556318ad0100] 2023-10-03T19:21:27.988 INFO:teuthology.orchestra.run.smithi045.stdout: -344> 2023-10-03T19:19:57.444+0000 7fd19f464640 7 mds.0.locker simple_sync on (iauth excl) on [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 DIRTYPARENT f() n(v0 1=0+1) (iauth excl) (inest lock) (ixattr excl) (iversion lock) | request=0 dirfrag=1 caps=0 dirtyparent=1 dirty=1 0x556318ad0100] 2023-10-03T19:21:27.988 INFO:teuthology.orchestra.run.smithi045.stdout: -343> 2023-10-03T19:19:57.444+0000 7fd19f464640 10 mds.0.locker simple_eval (ilink sync) on [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 DIRTYPARENT f() n(v0 1=0+1) (inest lock) (ixattr excl) (iversion lock) | request=0 dirfrag=1 caps=0 dirtyparent=1 dirty=1 0x556318ad0100] 2023-10-03T19:21:27.988 INFO:teuthology.orchestra.run.smithi045.stdout: -342> 2023-10-03T19:19:57.444+0000 7fd19f464640 10 mds.0.locker simple_eval (ixattr excl) on [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 DIRTYPARENT f() n(v0 1=0+1) (inest lock) (ixattr excl) (iversion lock) | request=0 dirfrag=1 caps=0 dirtyparent=1 dirty=1 0x556318ad0100] 2023-10-03T19:21:27.988 INFO:teuthology.orchestra.run.smithi045.stdout: -341> 2023-10-03T19:19:57.444+0000 7fd19f464640 7 mds.0.locker simple_eval stable, syncing (ixattr excl) on [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 DIRTYPARENT f() n(v0 1=0+1) (inest lock) (ixattr excl) (iversion lock) | request=0 dirfrag=1 caps=0 dirtyparent=1 dirty=1 0x556318ad0100] 2023-10-03T19:21:27.988 INFO:teuthology.orchestra.run.smithi045.stdout: -340> 2023-10-03T19:19:57.444+0000 7fd19f464640 7 mds.0.locker simple_sync on (ixattr excl) on [inode 0x10000000001 [...2,head] /foo/bar/ auth v2 DIRTYPARENT f() n(v0 1=0+1) (inest lock) (ixattr excl) (iversion lock) | request=0 dirfrag=1 caps=0 dirtyparent=1 dirty=1 0x556318ad0100] 2023-10-03T19:21:27.988 INFO:teuthology.orchestra.run.smithi045.stdout: -339> 2023-10-03T19:19:57.444+0000 7fd19f464640 10 mds.0.locker eval done 2023-10-03T19:21:27.988 INFO:teuthology.orchestra.run.smithi045.stdout: -338> 2023-10-03T19:19:57.444+0000 7fd19f464640 20 mds.0.server killing capability pAsLsXsFsx on [inode 0x10000000000 [...2,head] /foo/ auth v4 DIRTYPARENT f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@3},l=7335 | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=0 0x556318acfb80] 2023-10-03T19:21:27.988 INFO:teuthology.orchestra.run.smithi045.stdout: -337> 2023-10-03T19:19:57.444+0000 7fd19f464640 10 mds.0.openfiles remove_inode [inode 0x10000000000 [...2,head] /foo/ auth v4 DIRTYPARENT f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={7335=pAsLsXsFsx/AsLsXsFsx@3},l=-1(7335) | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=0 0x556318acfb80] 2023-10-03T19:21:27.988 INFO:teuthology.orchestra.run.smithi045.stdout: -336> 2023-10-03T19:19:57.444+0000 7fd19f464640 10 mds.0.cache.ino(0x10000000000) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:19:39.424362+0000 change_attr 0 0x556317c178c0) 2023-10-03T19:21:27.988 INFO:teuthology.orchestra.run.smithi045.stdout: -335> 2023-10-03T19:19:57.444+0000 7fd19f464640 10 mds.0.openfiles remove_dirfrag [dir 0x1 / [2,head] auth v=5 cv=1/1 REP dir_auth=0 state=1610874881|complete f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2)/n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=0 0x556317b1d180] 2023-10-03T19:21:27.988 INFO:teuthology.orchestra.run.smithi045.stdout: -334> 2023-10-03T19:19:57.444+0000 7fd19f464640 10 mds.0.locker eval 3648 [inode 0x10000000000 [...2,head] /foo/ auth v4 DIRTYPARENT f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) | request=0 lock=0 dirfrag=1 caps=0 dirtyparent=1 dirty=1 waiter=0 authpin=0 0x556318acfb80] 2023-10-03T19:21:27.988 INFO:teuthology.orchestra.run.smithi045.stdout: -333> 2023-10-03T19:19:57.444+0000 7fd19f464640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile excl) on [inode 0x10000000000 [...2,head] /foo/ auth v4 DIRTYPARENT f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) | request=0 lock=0 dirfrag=1 caps=0 dirtyparent=1 dirty=1 waiter=0 authpin=0 0x556318acfb80] 2023-10-03T19:21:27.989 INFO:teuthology.orchestra.run.smithi045.stdout: -332> 2023-10-03T19:19:57.444+0000 7fd19f464640 20 mds.0.locker is excl 2023-10-03T19:21:27.989 INFO:teuthology.orchestra.run.smithi045.stdout: -331> 2023-10-03T19:19:57.444+0000 7fd19f464640 7 mds.0.locker file_eval loner_issued= other_issued= xlocker_issued= 2023-10-03T19:21:27.989 INFO:teuthology.orchestra.run.smithi045.stdout: -330> 2023-10-03T19:19:57.444+0000 7fd19f464640 20 mds.0.locker should lose it 2023-10-03T19:21:27.989 INFO:teuthology.orchestra.run.smithi045.stdout: -329> 2023-10-03T19:19:57.444+0000 7fd19f464640 7 mds.0.locker simple_sync on (ifile excl) on [inode 0x10000000000 [...2,head] /foo/ auth v4 DIRTYPARENT f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) | request=0 lock=0 dirfrag=1 caps=0 dirtyparent=1 dirty=1 waiter=0 authpin=0 0x556318acfb80] 2023-10-03T19:21:28.001 INFO:teuthology.orchestra.run.smithi045.stdout: -328> 2023-10-03T19:19:57.444+0000 7fd19f464640 10 mds.0.locker simple_eval (iauth sync) on [inode 0x10000000000 [...2,head] /foo/ auth v4 DIRTYPARENT f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) (inest lock) (iversion lock) | request=0 lock=0 dirfrag=1 caps=0 dirtyparent=1 dirty=1 waiter=0 authpin=0 0x556318acfb80] 2023-10-03T19:21:28.001 INFO:teuthology.orchestra.run.smithi045.stdout: -327> 2023-10-03T19:19:57.444+0000 7fd19f464640 10 mds.0.locker simple_eval (ilink sync) on [inode 0x10000000000 [...2,head] /foo/ auth v4 DIRTYPARENT f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) (inest lock) (iversion lock) | request=0 lock=0 dirfrag=1 caps=0 dirtyparent=1 dirty=1 waiter=0 authpin=0 0x556318acfb80] 2023-10-03T19:21:28.001 INFO:teuthology.orchestra.run.smithi045.stdout: -326> 2023-10-03T19:19:57.444+0000 7fd19f464640 10 mds.0.locker simple_eval (ixattr sync) on [inode 0x10000000000 [...2,head] /foo/ auth v4 DIRTYPARENT f(v0 m2023-10-03T19:19:53.873286+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) (inest lock) (iversion lock) | request=0 lock=0 dirfrag=1 caps=0 dirtyparent=1 dirty=1 waiter=0 authpin=0 0x556318acfb80] 2023-10-03T19:21:28.001 INFO:teuthology.orchestra.run.smithi045.stdout: -325> 2023-10-03T19:19:57.444+0000 7fd19f464640 10 mds.0.locker eval done 2023-10-03T19:21:28.001 INFO:teuthology.orchestra.run.smithi045.stdout: -324> 2023-10-03T19:19:57.444+0000 7fd19f464640 20 mds.0.server killing capability pAsLsXs on [inode 0x1 [...2,head] / auth v3 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (inest lock dirty) (ifile mix) (iversion lock) caps={7335=pAsLsXs/-@4,7350=pAsLsXs/-@2} | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:28.001 INFO:teuthology.orchestra.run.smithi045.stdout: -323> 2023-10-03T19:19:57.444+0000 7fd19f464640 20 mds.0.server killing client lease of [dentry #0x1/foo [2,head] auth (dn sync l) (dversion lock) v=4 ino=0x10000000000 state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x556318b96000] 2023-10-03T19:21:28.002 INFO:teuthology.orchestra.run.smithi045.stdout: -322> 2023-10-03T19:19:57.444+0000 7fd19f464640 20 mds.0.cache.den(0x1 foo) remove_client_lease client.7335 on (dn sync l) 2023-10-03T19:21:28.002 INFO:teuthology.orchestra.run.smithi045.stdout: -321> 2023-10-03T19:19:57.444+0000 7fd19f464640 10 mds.0.48 send_message_client client.7335 172.21.15.146:0/990159870 client_session(close) v5 2023-10-03T19:21:28.002 INFO:teuthology.orchestra.run.smithi045.stdout: -320> 2023-10-03T19:19:57.444+0000 7fd19f464640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> 172.21.15.146:0/990159870 -- client_session(close) v5 -- 0x556317aee8c0 con 0x556318b59000 2023-10-03T19:21:28.002 INFO:teuthology.orchestra.run.smithi045.stdout: -319> 2023-10-03T19:19:57.444+0000 7fd19f464640 10 remove_session: mds.metrics: session=0x556318a4b700, client=client.7335 172.21.15.146:0/990159870 2023-10-03T19:21:28.002 INFO:teuthology.orchestra.run.smithi045.stdout: -318> 2023-10-03T19:19:57.444+0000 7fd19f464640 10 mds.0.sessionmap remove_session s=0x556318a4b700 name=client.7335 2023-10-03T19:21:28.002 INFO:teuthology.orchestra.run.smithi045.stdout: -317> 2023-10-03T19:19:57.444+0000 7fd1a7c75640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> 172.21.15.146:0/990159870 conn(0x556318b59000 msgr2=0x556318ad1700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 39 2023-10-03T19:21:28.002 INFO:teuthology.orchestra.run.smithi045.stdout: -316> 2023-10-03T19:19:57.444+0000 7fd1a7c75640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> 172.21.15.146:0/990159870 conn(0x556318b59000 msgr2=0x556318ad1700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-03T19:21:28.002 INFO:teuthology.orchestra.run.smithi045.stdout: -315> 2023-10-03T19:19:57.444+0000 7fd1a7c75640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> 172.21.15.146:0/990159870 conn(0x556318b59000 0x556318ad1700 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T19:21:28.002 INFO:teuthology.orchestra.run.smithi045.stdout: -314> 2023-10-03T19:19:57.444+0000 7fd1a7c75640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> 172.21.15.146:0/990159870 conn(0x556318b59000 0x556318ad1700 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:28.002 INFO:teuthology.orchestra.run.smithi045.stdout: -313> 2023-10-03T19:19:57.444+0000 7fd1a8c77640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] reap_dead start 2023-10-03T19:21:28.002 INFO:teuthology.orchestra.run.smithi045.stdout: -312> 2023-10-03T19:19:57.444+0000 7fd1a5470640 5 mds.a ms_handle_reset on 172.21.15.146:0/990159870 2023-10-03T19:21:28.003 INFO:teuthology.orchestra.run.smithi045.stdout: -311> 2023-10-03T19:19:57.444+0000 7fd1a5470640 3 mds.a ms_handle_reset closing connection for session client.7335 172.21.15.146:0/990159870 2023-10-03T19:21:28.003 INFO:teuthology.orchestra.run.smithi045.stdout: -310> 2023-10-03T19:19:57.444+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> 172.21.15.146:0/990159870 conn(0x556318b59000 msgr2=0x556318ad1700 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-10-03T19:21:28.003 INFO:teuthology.orchestra.run.smithi045.stdout: -309> 2023-10-03T19:19:57.444+0000 7fd1a5470640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> 172.21.15.146:0/990159870 conn(0x556318b59000 0x556318ad1700 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:28.003 INFO:teuthology.orchestra.run.smithi045.stdout: -308> 2023-10-03T19:19:57.448+0000 7fd1a8c77640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.6 v2:172.21.15.79:6819/1486010128 13 ==== osd_op_reply(46 200.00000000 [writefull 0~90 [fadvise_dontneed]] v98'12 uv12 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x556318aaf440 con 0x5563189cc400 2023-10-03T19:21:28.003 INFO:teuthology.orchestra.run.smithi045.stdout: -307> 2023-10-03T19:19:58.068+0000 7fd1a446e640 10 monclient: tick 2023-10-03T19:21:28.003 INFO:teuthology.orchestra.run.smithi045.stdout: -306> 2023-10-03T19:19:58.068+0000 7fd1a446e640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.003 INFO:teuthology.orchestra.run.smithi045.stdout: -305> 2023-10-03T19:19:58.068+0000 7fd1a446e640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:28.070902+0000) 2023-10-03T19:21:28.003 INFO:teuthology.orchestra.run.smithi045.stdout: -304> 2023-10-03T19:19:58.188+0000 7fd1a8c77640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7350 172.21.15.172:0/3138699255 10 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000746, avg_latency: 0.000746, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 4 cap_misses: 2 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x556318a8db80 con 0x556318b84000 2023-10-03T19:21:28.003 INFO:teuthology.orchestra.run.smithi045.stdout: -303> 2023-10-03T19:19:58.188+0000 7fd1a8c77640 20 mds.0.48 get_session have 0x556318a78a00 client.7350 172.21.15.172:0/3138699255 state open 2023-10-03T19:21:28.003 INFO:teuthology.orchestra.run.smithi045.stdout: -302> 2023-10-03T19:19:58.188+0000 7fd1a8c77640 20 handle_client_metrics: mds.metrics: session=0x556318a78a00 2023-10-03T19:21:28.003 INFO:teuthology.orchestra.run.smithi045.stdout: -301> 2023-10-03T19:19:58.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=READ_LATENCY, session=0x556318a78a00, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:28.004 INFO:teuthology.orchestra.run.smithi045.stdout: -300> 2023-10-03T19:19:58.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=WRITE_LATENCY, session=0x556318a78a00, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:28.004 INFO:teuthology.orchestra.run.smithi045.stdout: -299> 2023-10-03T19:19:58.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=METADATA_LATENCY, session=0x556318a78a00, latency=0.000746, avg=0.000746, sq_sum=0, count=1 2023-10-03T19:21:28.004 INFO:teuthology.orchestra.run.smithi045.stdout: -298> 2023-10-03T19:19:58.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=CAP_INFO, session=0x556318a78a00, hits=4, misses=2 2023-10-03T19:21:28.004 INFO:teuthology.orchestra.run.smithi045.stdout: -297> 2023-10-03T19:19:58.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=DENTRY_LEASE, session=0x556318a78a00, hits=0, misses=0 2023-10-03T19:21:28.004 INFO:teuthology.orchestra.run.smithi045.stdout: -296> 2023-10-03T19:19:58.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=OPENED_FILES, session=0x556318a78a00, opened_files=0, total_inodes=1 2023-10-03T19:21:28.004 INFO:teuthology.orchestra.run.smithi045.stdout: -295> 2023-10-03T19:19:58.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=PINNED_ICAPS, session=0x556318a78a00, pinned_icaps=1, total_inodes=1 2023-10-03T19:21:28.004 INFO:teuthology.orchestra.run.smithi045.stdout: -294> 2023-10-03T19:19:58.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=OPENED_INODES, session=0x556318a78a00, opened_inodes=0, total_inodes=1 2023-10-03T19:21:28.004 INFO:teuthology.orchestra.run.smithi045.stdout: -293> 2023-10-03T19:19:58.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=READ_IO_SIZES, session=0x556318a78a00, total_ops=0, total_size=0 2023-10-03T19:21:28.004 INFO:teuthology.orchestra.run.smithi045.stdout: -292> 2023-10-03T19:19:58.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=WRITE_IO_SIZES, session=0x556318a78a00, total_ops=0, total_size=0 2023-10-03T19:21:28.004 INFO:teuthology.orchestra.run.smithi045.stdout: -291> 2023-10-03T19:19:58.436+0000 7fd19e462640 20 update_rank0: mds.metrics 2023-10-03T19:21:28.004 INFO:teuthology.orchestra.run.smithi045.stdout: -290> 2023-10-03T19:19:58.436+0000 7fd19e462640 20 update_rank0: mds.metrics: sending metric updates for 2 clients to rank 0 (address: [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487]) with sequence number 3, last updated sequence number 7 2023-10-03T19:21:28.004 INFO:teuthology.orchestra.run.smithi045.stdout: -289> 2023-10-03T19:19:58.436+0000 7fd19e462640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] send_to--> mds [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mds_metrics from rank=0 carrying 2 metric updates v1 -- ?+0 0x5563188efc80 2023-10-03T19:21:28.005 INFO:teuthology.orchestra.run.smithi045.stdout: -288> 2023-10-03T19:19:58.436+0000 7fd19e462640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mds_metrics from rank=0 carrying 2 metric updates v1 -- 0x5563188efc80 con 0x556317aafc00 2023-10-03T19:21:28.005 INFO:teuthology.orchestra.run.smithi045.stdout: -287> 2023-10-03T19:19:58.436+0000 7fd1a4c6f640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mds.0 v2:172.21.15.45:6834/3401546487 0 ==== mds_metrics from rank=0 carrying 2 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x5563188efc80 con 0x556317aafc00 2023-10-03T19:21:28.005 INFO:teuthology.orchestra.run.smithi045.stdout: -286> 2023-10-03T19:19:58.436+0000 7fd1a4c6f640 20 mds.metric.aggregator handle_mds_metrics: applying 2 updates for rank=0 with sequence number 3 2023-10-03T19:21:28.005 INFO:teuthology.orchestra.run.smithi045.stdout: -285> 2023-10-03T19:19:58.436+0000 7fd1a4c6f640 10 mds.pinger pong_received: rank=0, sequence=3 2023-10-03T19:21:28.005 INFO:teuthology.orchestra.run.smithi045.stdout: -284> 2023-10-03T19:19:58.436+0000 7fd1a4c6f640 20 mds.metric.aggregator remove_metrics_for_rank: client=client.7335 172.21.15.146:0/990159870, rank=0 2023-10-03T19:21:28.005 INFO:teuthology.orchestra.run.smithi045.stdout: -283> 2023-10-03T19:19:58.436+0000 7fd1a4c6f640 20 mds.metric.aggregator remove_metrics_for_rank: rank=0 has 1 connected client(s) 2023-10-03T19:21:28.005 INFO:teuthology.orchestra.run.smithi045.stdout: -282> 2023-10-03T19:19:58.436+0000 7fd1a4c6f640 20 mds.metric.aggregator refresh_metrics_for_rank: client=client.7350 172.21.15.172:0/3138699255, rank=0, metrics=[update_type=0, metrics={cap_hit_metric={hits=4, misses=2}, read_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, write_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, metadata_latency={latency=0.000746, avg_latency=0.000746, sq_sum=0, count=1}, dentry_lease={hits=0, misses=0}, opened_files_metric={opened_files=0, total_inodes=1}, pinned_icaps_metric={pinned_icaps=1, total_inodes=1}, opened_inodes_metric={opened_inodes=0, total_inodes=1}, read_io_sizes_metric={total_ops=0, total_size=0}, write_io_sizes_metric={total_ops=0, total_size=0}}] 2023-10-03T19:21:28.005 INFO:teuthology.orchestra.run.smithi045.stdout: -281> 2023-10-03T19:19:58.436+0000 7fd1a1468640 2 mds.0.cache Memory usage: total 274132, rss 38600, heap 207144, baseline 190760, 1 / 15 inodes have caps, 1 caps, 0.0666667 caps per inode 2023-10-03T19:21:28.005 INFO:teuthology.orchestra.run.smithi045.stdout: -280> 2023-10-03T19:19:58.436+0000 7fd1a1468640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999985039s ago 2023-10-03T19:21:28.005 INFO:teuthology.orchestra.run.smithi045.stdout: -279> 2023-10-03T19:19:58.436+0000 7fd1a1468640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:28.005 INFO:teuthology.orchestra.run.smithi045.stdout: -278> 2023-10-03T19:19:58.436+0000 7fd1a1468640 7 mds.0.cache trim bytes_used=58kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:28.006 INFO:teuthology.orchestra.run.smithi045.stdout: -277> 2023-10-03T19:19:58.436+0000 7fd1a1468640 7 mds.0.cache trim_lru trimming 0 items from LRU size=12 mid=0 pintail=0 pinned=12 2023-10-03T19:21:28.006 INFO:teuthology.orchestra.run.smithi045.stdout: -276> 2023-10-03T19:19:58.436+0000 7fd1a1468640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:28.006 INFO:teuthology.orchestra.run.smithi045.stdout: -275> 2023-10-03T19:19:58.436+0000 7fd1a1468640 7 mds.0.server recall_client_state: min=100 max=1048576 total=1 flags=0xa 2023-10-03T19:21:28.006 INFO:teuthology.orchestra.run.smithi045.stdout: -274> 2023-10-03T19:19:58.436+0000 7fd1a1468640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:28.006 INFO:teuthology.orchestra.run.smithi045.stdout: -273> 2023-10-03T19:19:58.436+0000 7fd1a1468640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:28.006 INFO:teuthology.orchestra.run.smithi045.stdout: -272> 2023-10-03T19:19:59.064+0000 7fd1a3c6d640 10 mds.0.log trim 1 / 128 segments, 7 / -1 events, 0 (0) expiring, 0 (0) expired 2023-10-03T19:21:28.006 INFO:teuthology.orchestra.run.smithi045.stdout: -271> 2023-10-03T19:19:59.064+0000 7fd1a3c6d640 10 mds.0.openfiles commit log_seq 1 committing_log_seq:1 2023-10-03T19:21:28.006 INFO:teuthology.orchestra.run.smithi045.stdout: -270> 2023-10-03T19:19:59.064+0000 7fd1a3c6d640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.48:47 15.6 15:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b,omap-rm-keys in=24b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e98) v8 -- 0x556318bbae00 con 0x556317c2d400 2023-10-03T19:21:28.006 INFO:teuthology.orchestra.run.smithi045.stdout: -269> 2023-10-03T19:19:59.064+0000 7fd1a3c6d640 10 mds.0.log _trim_expired_segments waiting for 1/4194304 to expire 2023-10-03T19:21:28.006 INFO:teuthology.orchestra.run.smithi045.stdout: -268> 2023-10-03T19:19:59.064+0000 7fd1a3c6d640 10 mds.0.server find_idle_sessions. last cleared laggy state 1245.45s ago 2023-10-03T19:21:28.006 INFO:teuthology.orchestra.run.smithi045.stdout: -267> 2023-10-03T19:19:59.064+0000 7fd1a3c6d640 20 mds.0.server laggiest active session is client.7350 172.21.15.172:0/3138699255 and renewed caps recently (4.87593s ago) 2023-10-03T19:21:28.007 INFO:teuthology.orchestra.run.smithi045.stdout: -266> 2023-10-03T19:19:59.064+0000 7fd1a3c6d640 10 mds.0.locker scatter_tick 2023-10-03T19:21:28.007 INFO:teuthology.orchestra.run.smithi045.stdout: -265> 2023-10-03T19:19:59.064+0000 7fd1a3c6d640 10 mds.0.locker scatter_nudge auth, scatter/unscattering (inest lock dirty) on [inode 0x1 [...2,head] / auth v3 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (inest lock dirty) (ifile mix) (iversion lock) caps={7350=pAsLsXs/-@2} | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:28.007 INFO:teuthology.orchestra.run.smithi045.stdout: -264> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 7 mds.0.locker simple_sync on (inest lock dirty) on [inode 0x1 [...2,head] / auth v3 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (inest lock dirty) (ifile mix) (iversion lock) caps={7350=pAsLsXs/-@2} | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:28.007 INFO:teuthology.orchestra.run.smithi045.stdout: -263> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 10 mds.0.cache.ino(0x1) auth_pin by 0x556317b3ca10 on [inode 0x1 [...2,head] / auth v3 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (inest lock->sync dirty) (ifile mix) (iversion lock) caps={7350=pAsLsXs/-@2} | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] now 1 2023-10-03T19:21:28.007 INFO:teuthology.orchestra.run.smithi045.stdout: -262> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 10 mds.0.locker scatter_writebehind 2023-10-03T19:19:53.863091+0000 on (inest lock->sync dirty) on [inode 0x1 [...2,head] / auth v3 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (inest lock->sync dirty) (ifile mix) (iversion lock) caps={7350=pAsLsXs/-@2} | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:28.007 INFO:teuthology.orchestra.run.smithi045.stdout: -261> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 20 mds.0.cache.ino(0x1) pre_cow_old_inode follows 1 on [inode 0x1 [...2,head] / auth v3 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (inest lock->sync w=1 dirty) (ifile mix) (iversion lock) caps={7350=pAsLsXs/-@2} | dirtyscattered=1 request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:28.007 INFO:teuthology.orchestra.run.smithi045.stdout: -260> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 15 mds.0.cache.ino(0x1) project_inode 0x1 2023-10-03T19:21:28.007 INFO:teuthology.orchestra.run.smithi045.stdout: -259> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 10 mds.0.cache.ino(0x1) finish_scatter_gather_update 128 on [inode 0x1 [...2,head] / auth v3 pv4 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1)->f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1)->n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (inest lock->sync w=1 dirty) (ifile mix) (iversion lock) caps={7350=pAsLsXs/-@2} | dirtyscattered=1 request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:28.007 INFO:teuthology.orchestra.run.smithi045.stdout: -258> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 20 mds.0.cache.ino(0x1) orig rstat n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2) 2023-10-03T19:21:28.007 INFO:teuthology.orchestra.run.smithi045.stdout: -257> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 20 mds.0.cache.ino(0x1) * [dir 0x1 / [2,head] auth v=5 cv=1/1 REP dir_auth=0 state=1610612737|complete f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2)/n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=0 0x556317b1d180] 2023-10-03T19:21:28.007 INFO:teuthology.orchestra.run.smithi045.stdout: -256> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 10 mds.0.cache.dir(0x1) auth_pin by 0x556318bbc000 on [dir 0x1 / [2,head] auth v=5 cv=1/1 REP dir_auth=0 ap=1+0 state=1610612737|complete f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2)/n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x556317b1d180] count now 1 2023-10-03T19:21:28.007 INFO:teuthology.orchestra.run.smithi045.stdout: -255> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 10 mds.0.cache.dir(0x1) project_fnode 0x55631892c140 2023-10-03T19:21:28.008 INFO:teuthology.orchestra.run.smithi045.stdout: -254> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 10 mds.0.cache.dir(0x1) assimilate_dirty_rstat_inodes 2023-10-03T19:21:28.008 INFO:teuthology.orchestra.run.smithi045.stdout: -253> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 10 mds.0.cache.dir(0x1) assimilate_dirty_rstat_inodes done 2023-10-03T19:21:28.008 INFO:teuthology.orchestra.run.smithi045.stdout: -252> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 20 mds.0.cache.ino(0x1) * rstat n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) 2023-10-03T19:21:28.008 INFO:teuthology.orchestra.run.smithi045.stdout: -251> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 20 mds.0.cache.ino(0x1) * accounted_rstat n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) 2023-10-03T19:21:28.008 INFO:teuthology.orchestra.run.smithi045.stdout: -250> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 20 mds.0.cache.ino(0x1) * dirty_old_rstat {} 2023-10-03T19:21:28.008 INFO:teuthology.orchestra.run.smithi045.stdout: -249> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 10 mds.0.cache project_rstat_frag_to_inode [2,head] 2023-10-03T19:21:28.008 INFO:teuthology.orchestra.run.smithi045.stdout: -248> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 20 mds.0.cache frag rstat n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) 2023-10-03T19:21:28.008 INFO:teuthology.orchestra.run.smithi045.stdout: -247> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 20 mds.0.cache frag accounted_rstat n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1) 2023-10-03T19:21:28.008 INFO:teuthology.orchestra.run.smithi045.stdout: -246> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 20 mds.0.cache delta n(v0 rc2023-10-03T19:19:53.873286+0000 1=0+1) 2023-10-03T19:21:28.008 INFO:teuthology.orchestra.run.smithi045.stdout: -245> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 20 mds.0.cache projecting to [2,head] n(v1 rc2023-10-03T19:19:53.863091+0000 2=0+2) 2023-10-03T19:21:28.008 INFO:teuthology.orchestra.run.smithi045.stdout: -244> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 20 mds.0.cache result [2,head] n(v1 rc2023-10-03T19:19:53.873286+0000 3=0+3) 2023-10-03T19:21:28.008 INFO:teuthology.orchestra.run.smithi045.stdout: -243> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 20 mds.0.cache.dir(0x1) get_num_head_items() = 1; fnode.fragstat.nfiles=0 fnode.fragstat.nsubdirs=1 2023-10-03T19:21:28.008 INFO:teuthology.orchestra.run.smithi045.stdout: -242> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 20 mds.0.cache.dir(0x1) total of child dentries: n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) 2023-10-03T19:21:28.008 INFO:teuthology.orchestra.run.smithi045.stdout: -241> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 20 mds.0.cache.dir(0x1) my rstats: n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) 2023-10-03T19:21:28.009 INFO:teuthology.orchestra.run.smithi045.stdout: -240> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 10 mds.0.cache.dir(0x1) check_rstats complete on 0x556317b1d180 2023-10-03T19:21:28.009 INFO:teuthology.orchestra.run.smithi045.stdout: -239> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 10 mds.0.cache.dir(0x1) pre_dirty 6 2023-10-03T19:21:28.009 INFO:teuthology.orchestra.run.smithi045.stdout: -238> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 20 mds.0.cache.dir(0x1) get_num_head_items() = 1; fnode.fragstat.nfiles=0 fnode.fragstat.nsubdirs=1 2023-10-03T19:21:28.009 INFO:teuthology.orchestra.run.smithi045.stdout: -237> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 20 mds.0.cache.dir(0x1) total of child dentries: n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) 2023-10-03T19:21:28.009 INFO:teuthology.orchestra.run.smithi045.stdout: -236> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 20 mds.0.cache.dir(0x1) my rstats: n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2) 2023-10-03T19:21:28.009 INFO:teuthology.orchestra.run.smithi045.stdout: -235> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 10 mds.0.cache.dir(0x1) check_rstats complete on 0x556317b1d180 2023-10-03T19:21:28.009 INFO:teuthology.orchestra.run.smithi045.stdout: -234> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 10 mds.0.cache.ino(0x1) * updated accounted_rstat n(v1 rc2023-10-03T19:19:53.873286+0000 2=0+2) on [dir 0x1 / [2,head] auth pv=6 v=5 cv=1/1 REP dir_auth=0 ap=1+0 state=1610645505|complete|assimrstat f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1)->f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2)/n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1)->n(v1 rc2023-10-03T19:19:53.873286+0000 2=0+2) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x556317b1d180] 2023-10-03T19:21:28.009 INFO:teuthology.orchestra.run.smithi045.stdout: -233> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 20 mds.0.cache.ino(0x1) final rstat n(v1 rc2023-10-03T19:19:53.873286+0000 3=0+3) 2023-10-03T19:21:28.009 INFO:teuthology.orchestra.run.smithi045.stdout: -232> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 10 mds.0.cache.ino(0x1) finish_scatter_gather_update_accounted 128 on [inode 0x1 [...2,head] / auth v3 pv4 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1)->f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1)->n(v1 rc2023-10-03T19:19:53.873286+0000 3=0+3)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (inest lock->sync w=1 flushing) (ifile mix) (iversion lock) caps={7350=pAsLsXs/-@2} | dirtyscattered=1 request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:28.097 INFO:teuthology.orchestra.run.smithi045.stdout: -231> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 10 mds.0.cache.dir(0x1) assimilate_dirty_rstat_inodes_finish 2023-10-03T19:21:28.097 INFO:teuthology.orchestra.run.smithi045.stdout: -230> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 10 mds.0.cache.ino(0x1) journaling updated frag accounted_ on [dir 0x1 / [2,head] auth pv=6 v=5 cv=1/1 REP dir_auth=0 ap=1+0 state=1610612737|complete f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1)->f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2)/n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1)->n(v1 rc2023-10-03T19:19:53.873286+0000 2=0+2) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x556317b1d180] 2023-10-03T19:21:28.098 INFO:teuthology.orchestra.run.smithi045.stdout: -229> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 10 mds.0.locker scatter_nudge auth, waiting for stable (inest lock->sync w=1 flushing) on [inode 0x1 [...2,head] / auth v3 pv4 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1)->f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1)->n(v1 rc2023-10-03T19:19:53.873286+0000 3=0+3)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (inest lock->sync w=1 flushing) (ifile mix) (iversion lock) caps={7350=pAsLsXs/-@2} | dirtyscattered=1 request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:28.098 INFO:teuthology.orchestra.run.smithi045.stdout: -228> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 20 mds.0.locker caps_tick 0 revoking caps 2023-10-03T19:21:28.098 INFO:teuthology.orchestra.run.smithi045.stdout: -227> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 20 mds.0.bal handle_export_pins export_pin_queue size=0 2023-10-03T19:21:28.098 INFO:teuthology.orchestra.run.smithi045.stdout: -226> 2023-10-03T19:19:59.068+0000 7fd19ec63640 5 mds.0.log _submit_thread 4201315~1118 : EUpdate scatter_writebehind [metablob 0x1, 1 dirs] 2023-10-03T19:21:28.098 INFO:teuthology.orchestra.run.smithi045.stdout: -225> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 15 mds.0.bal tick tick last_sample now 1245.457895s 2023-10-03T19:21:28.098 INFO:teuthology.orchestra.run.smithi045.stdout: -224> 2023-10-03T19:19:59.068+0000 7fd19ec63640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.48:48 15.14 15:2e2fa760:::200.00000001:head [write 7011~1138 [fadvise_dontneed] in=1138b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e98) v8 -- 0x556318bba380 con 0x5563189cc400 2023-10-03T19:21:28.098 INFO:teuthology.orchestra.run.smithi045.stdout: -223> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 15 mds.0.bal get_load mdsload<[pop IRD:[C 0.00e+00] IWR:[C 9.86e-01] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.56e-02] *LOAD:2.2]/[pop IRD:[C 0.00e+00] IWR:[C 9.86e-01] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.56e-02] *LOAD:2.2], req 0.399899, hr 0.818182, qlen 0, cpu 0.33325> 2023-10-03T19:21:28.098 INFO:teuthology.orchestra.run.smithi045.stdout: -222> 2023-10-03T19:19:59.068+0000 7fd1a446e640 10 monclient: tick 2023-10-03T19:21:28.098 INFO:teuthology.orchestra.run.smithi045.stdout: -221> 2023-10-03T19:19:59.068+0000 7fd1a446e640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.098 INFO:teuthology.orchestra.run.smithi045.stdout: -220> 2023-10-03T19:19:59.068+0000 7fd1a446e640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:29.071001+0000) 2023-10-03T19:21:28.099 INFO:teuthology.orchestra.run.smithi045.stdout: -219> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 3 mds.0.bal send_heartbeat epoch 2 load mdsload<[pop IRD:[C 0.00e+00] IWR:[C 9.86e-01] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.56e-02] *LOAD:2.2]/[pop IRD:[C 0.00e+00] IWR:[C 9.86e-01] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 6.56e-02] *LOAD:2.2], req 0.399899, hr 0.818182, qlen 0, cpu 0.33325> 2023-10-03T19:21:28.099 INFO:teuthology.orchestra.run.smithi045.stdout: -218> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 15 mds.0.cache show_subtrees 2023-10-03T19:21:28.099 INFO:teuthology.orchestra.run.smithi045.stdout: -217> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 10 mds.0.cache |__ 0 auth [dir 0x1 / [2,head] auth pv=6 v=5 cv=1/1 REP dir_auth=0 ap=1+0 state=1610612737|complete f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1)->f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.873286+0000 2=0+2)/n(v0 rc2023-10-03T19:19:53.863091+0000 1=0+1)->n(v1 rc2023-10-03T19:19:53.873286+0000 2=0+2) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x556317b1d180] 2023-10-03T19:21:28.099 INFO:teuthology.orchestra.run.smithi045.stdout: -216> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 10 mds.0.cache |__ 0 auth [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x556317b1d600] 2023-10-03T19:21:28.099 INFO:teuthology.orchestra.run.smithi045.stdout: -215> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 10 mds.0.cache find_stale_fragment_freeze 2023-10-03T19:21:28.099 INFO:teuthology.orchestra.run.smithi045.stdout: -214> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 10 mds.0.snap check_osd_map - version unchanged 2023-10-03T19:21:28.099 INFO:teuthology.orchestra.run.smithi045.stdout: -213> 2023-10-03T19:19:59.068+0000 7fd1a3c6d640 20 mds.0.48 updating export targets, currently 0 ranks are targets 2023-10-03T19:21:28.099 INFO:teuthology.orchestra.run.smithi045.stdout: -212> 2023-10-03T19:19:59.068+0000 7fd1a8476640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.0 v2:172.21.15.45:6800/1057586985 3 ==== osd_op_reply(47 mds0_openfiles.0 [omap-set-header,omap-rm-keys] v98'3 uv3 ondisk = 0) v8 ==== 202+0+0 (crc 0 0 0) 0x556318aaeb40 con 0x556317c2d400 2023-10-03T19:21:28.099 INFO:teuthology.orchestra.run.smithi045.stdout: -211> 2023-10-03T19:19:59.068+0000 7fd19f464640 10 MDSIOContextBase::complete: 13C_IO_OFT_Save 2023-10-03T19:21:28.099 INFO:teuthology.orchestra.run.smithi045.stdout: -210> 2023-10-03T19:19:59.068+0000 7fd19f464640 10 MDSContext::complete: 13C_IO_OFT_Save 2023-10-03T19:21:28.099 INFO:teuthology.orchestra.run.smithi045.stdout: -209> 2023-10-03T19:19:59.068+0000 7fd19f464640 10 mds.0.openfiles _commit_finish log_seq 1 committed_log_seq 1 committing_log_seq 1 2023-10-03T19:21:28.099 INFO:teuthology.orchestra.run.smithi045.stdout: -208> 2023-10-03T19:19:59.068+0000 7fd19f464640 10 MDSContext::complete: 15C_OFT_Committed 2023-10-03T19:21:28.100 INFO:teuthology.orchestra.run.smithi045.stdout: -207> 2023-10-03T19:19:59.068+0000 7fd19f464640 10 mds.0.log _trim_expired_segments waiting for 1/4194304 to expire 2023-10-03T19:21:28.100 INFO:teuthology.orchestra.run.smithi045.stdout: -206> 2023-10-03T19:19:59.068+0000 7fd1a8c77640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.6 v2:172.21.15.79:6819/1486010128 14 ==== osd_op_reply(48 200.00000001 [write 7011~1138 [fadvise_dontneed]] v98'13 uv13 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x556318aaf440 con 0x5563189cc400 2023-10-03T19:21:28.100 INFO:teuthology.orchestra.run.smithi045.stdout: -205> 2023-10-03T19:19:59.068+0000 7fd19f464640 10 MDSIOContextBase::complete: 18C_Locker_ScatterWB 2023-10-03T19:21:28.100 INFO:teuthology.orchestra.run.smithi045.stdout: -204> 2023-10-03T19:19:59.068+0000 7fd19f464640 10 MDSContext::complete: 18C_Locker_ScatterWB 2023-10-03T19:21:28.100 INFO:teuthology.orchestra.run.smithi045.stdout: -203> 2023-10-03T19:19:59.068+0000 7fd19f464640 10 mds.0.locker scatter_writebehind_finish on (inest lock->sync w=1 flushing) on [inode 0x1 [...2,head] / auth v3 pv4 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1)->f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v0 rc2023-10-03T19:19:53.863091+0000 2=0+2)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1)->n(v1 rc2023-10-03T19:19:53.873286+0000 3=0+3)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (inest lock->sync w=1 flushing) (ifile mix) (iversion lock) caps={7350=pAsLsXs/-@2} | dirtyscattered=1 request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:28.100 INFO:teuthology.orchestra.run.smithi045.stdout: -202> 2023-10-03T19:19:59.068+0000 7fd19f464640 15 mds.0.cache.ino(0x1) pop_and_dirty_projected_inode v4 2023-10-03T19:21:28.100 INFO:teuthology.orchestra.run.smithi045.stdout: -201> 2023-10-03T19:19:59.068+0000 7fd19f464640 10 mds.0.cache.ino(0x1) mark_dirty [inode 0x1 [...2,head] / auth v4 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v1 rc2023-10-03T19:19:53.873286+0000 3=0+3)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (inest lock->sync w=1 flushing) (ifile mix) (iversion lock) caps={7350=pAsLsXs/-@2} | dirtyscattered=1 request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:28.100 INFO:teuthology.orchestra.run.smithi045.stdout: -200> 2023-10-03T19:19:59.068+0000 7fd19f464640 15 mds.0.cache.dir(0x1) pop_and_dirty_projected_fnode 0x55631892c140 v6 2023-10-03T19:21:28.100 INFO:teuthology.orchestra.run.smithi045.stdout: -199> 2023-10-03T19:19:59.068+0000 7fd19f464640 10 mds.0.cache.dir(0x1) _mark_dirty (already dirty) [dir 0x1 / [2,head] auth v=6 cv=1/1 REP dir_auth=0 ap=1+0 state=1610612737|complete f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v1 rc2023-10-03T19:19:53.873286+0000 2=0+2) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=1 0x556317b1d180] version 6 2023-10-03T19:21:28.100 INFO:teuthology.orchestra.run.smithi045.stdout: -198> 2023-10-03T19:19:59.068+0000 7fd19f464640 10 mds.0.cache.ino(0x1) clear_dirty_scattered 128 on [inode 0x1 [...2,head] / auth v4 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v1 rc2023-10-03T19:19:53.873286+0000 3=0+3)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (inest lock->sync w=1 flushed) (ifile mix) (iversion lock) caps={7350=pAsLsXs/-@2} | dirtyscattered=0 request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:28.100 INFO:teuthology.orchestra.run.smithi045.stdout: -197> 2023-10-03T19:19:59.068+0000 7fd19f464640 7 mds.0.locker wrlock_finish on (inest lock->sync w=1 flushed) on [inode 0x1 [...2,head] / auth v4 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v1 rc2023-10-03T19:19:53.873286+0000 3=0+3)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (inest lock->sync w=1 flushed) (ifile mix) (iversion lock) caps={7350=pAsLsXs/-@2} | dirtyscattered=0 request=0 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:28.101 INFO:teuthology.orchestra.run.smithi045.stdout: -196> 2023-10-03T19:19:59.068+0000 7fd19f464640 10 mds.0.locker eval_gather (inest lock->sync flushed) on [inode 0x1 [...2,head] / auth v4 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v1 rc2023-10-03T19:19:53.873286+0000 3=0+3)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (inest lock->sync flushed) (ifile mix) (iversion lock) caps={7350=pAsLsXs/-@2} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:28.101 INFO:teuthology.orchestra.run.smithi045.stdout: -195> 2023-10-03T19:19:59.068+0000 7fd19f464640 7 mds.0.locker eval_gather finished gather on (inest lock->sync flushed) on [inode 0x1 [...2,head] / auth v4 ap=1 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v1 rc2023-10-03T19:19:53.873286+0000 3=0+3)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (inest lock->sync flushed) (ifile mix) (iversion lock) caps={7350=pAsLsXs/-@2} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x556317b3c680] 2023-10-03T19:21:28.101 INFO:teuthology.orchestra.run.smithi045.stdout: -194> 2023-10-03T19:19:59.068+0000 7fd19f464640 10 mds.0.cache.ino(0x1) auth_unpin by 0x556317b3ca10 on [inode 0x1 [...2,head] / auth v4 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v1 rc2023-10-03T19:19:53.873286+0000 3=0+3)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (ifile mix) (iversion lock) caps={7350=pAsLsXs/-@2} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=0 0x556317b3c680] now 0 2023-10-03T19:21:28.101 INFO:teuthology.orchestra.run.smithi045.stdout: -193> 2023-10-03T19:19:59.068+0000 7fd19f464640 10 mds.0.locker scatter_eval (inest sync) on [inode 0x1 [...2,head] / auth v4 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v1 rc2023-10-03T19:19:53.873286+0000 3=0+3)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (ifile mix) (iversion lock) caps={7350=pAsLsXs/-@2} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:28.101 INFO:teuthology.orchestra.run.smithi045.stdout: -192> 2023-10-03T19:19:59.068+0000 7fd19f464640 7 mds.0.locker simple_lock on (inest sync) on [inode 0x1 [...2,head] / auth v4 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v1 rc2023-10-03T19:19:53.873286+0000 3=0+3)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (ifile mix) (iversion lock) caps={7350=pAsLsXs/-@2} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:28.101 INFO:teuthology.orchestra.run.smithi045.stdout: -191> 2023-10-03T19:19:59.068+0000 7fd19f464640 10 mds.0.cache.dir(0x1) auth_unpin by 0x556318bbc000 on [dir 0x1 / [2,head] auth v=6 cv=1/1 REP dir_auth=0 state=1610612737|complete f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v1 rc2023-10-03T19:19:53.873286+0000 2=0+2) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=0 0x556317b1d180] count now 0 2023-10-03T19:21:28.101 INFO:teuthology.orchestra.run.smithi045.stdout: -190> 2023-10-03T19:19:59.188+0000 7fd1a8c77640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7350 172.21.15.172:0/3138699255 11 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000746, avg_latency: 0.000746, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 4 cap_misses: 2 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x556318a8db80 con 0x556318b84000 2023-10-03T19:21:28.101 INFO:teuthology.orchestra.run.smithi045.stdout: -189> 2023-10-03T19:19:59.188+0000 7fd1a8c77640 20 mds.0.48 get_session have 0x556318a78a00 client.7350 172.21.15.172:0/3138699255 state open 2023-10-03T19:21:28.101 INFO:teuthology.orchestra.run.smithi045.stdout: -188> 2023-10-03T19:19:59.188+0000 7fd1a8c77640 20 handle_client_metrics: mds.metrics: session=0x556318a78a00 2023-10-03T19:21:28.101 INFO:teuthology.orchestra.run.smithi045.stdout: -187> 2023-10-03T19:19:59.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=READ_LATENCY, session=0x556318a78a00, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:28.101 INFO:teuthology.orchestra.run.smithi045.stdout: -186> 2023-10-03T19:19:59.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=WRITE_LATENCY, session=0x556318a78a00, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:28.101 INFO:teuthology.orchestra.run.smithi045.stdout: -185> 2023-10-03T19:19:59.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=METADATA_LATENCY, session=0x556318a78a00, latency=0.000746, avg=0.000746, sq_sum=0, count=1 2023-10-03T19:21:28.102 INFO:teuthology.orchestra.run.smithi045.stdout: -184> 2023-10-03T19:19:59.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=CAP_INFO, session=0x556318a78a00, hits=4, misses=2 2023-10-03T19:21:28.102 INFO:teuthology.orchestra.run.smithi045.stdout: -183> 2023-10-03T19:19:59.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=DENTRY_LEASE, session=0x556318a78a00, hits=0, misses=0 2023-10-03T19:21:28.102 INFO:teuthology.orchestra.run.smithi045.stdout: -182> 2023-10-03T19:19:59.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=OPENED_FILES, session=0x556318a78a00, opened_files=0, total_inodes=1 2023-10-03T19:21:28.102 INFO:teuthology.orchestra.run.smithi045.stdout: -181> 2023-10-03T19:19:59.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=PINNED_ICAPS, session=0x556318a78a00, pinned_icaps=1, total_inodes=1 2023-10-03T19:21:28.102 INFO:teuthology.orchestra.run.smithi045.stdout: -180> 2023-10-03T19:19:59.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=OPENED_INODES, session=0x556318a78a00, opened_inodes=0, total_inodes=1 2023-10-03T19:21:28.102 INFO:teuthology.orchestra.run.smithi045.stdout: -179> 2023-10-03T19:19:59.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=READ_IO_SIZES, session=0x556318a78a00, total_ops=0, total_size=0 2023-10-03T19:21:28.102 INFO:teuthology.orchestra.run.smithi045.stdout: -178> 2023-10-03T19:19:59.188+0000 7fd1a8c77640 20 handle_payload: mds.metrics: type=WRITE_IO_SIZES, session=0x556318a78a00, total_ops=0, total_size=0 2023-10-03T19:21:28.102 INFO:teuthology.orchestra.run.smithi045.stdout: -177> 2023-10-03T19:19:59.420+0000 7fd1a3c6d640 20 mds.0.48 get_task_status 2023-10-03T19:21:28.102 INFO:teuthology.orchestra.run.smithi045.stdout: -176> 2023-10-03T19:19:59.420+0000 7fd1a3c6d640 20 mds.0.48 schedule_update_timer_task 2023-10-03T19:21:28.102 INFO:teuthology.orchestra.run.smithi045.stdout: -175> 2023-10-03T19:19:59.436+0000 7fd1a1468640 2 mds.0.cache Memory usage: total 274132, rss 38864, heap 207144, baseline 190760, 1 / 15 inodes have caps, 1 caps, 0.0666667 caps per inode 2023-10-03T19:21:28.103 INFO:teuthology.orchestra.run.smithi045.stdout: -174> 2023-10-03T19:19:59.436+0000 7fd1a1468640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999985099s ago 2023-10-03T19:21:28.103 INFO:teuthology.orchestra.run.smithi045.stdout: -173> 2023-10-03T19:19:59.436+0000 7fd1a1468640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:28.103 INFO:teuthology.orchestra.run.smithi045.stdout: -172> 2023-10-03T19:19:59.436+0000 7fd1a1468640 7 mds.0.cache trim bytes_used=58kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:28.103 INFO:teuthology.orchestra.run.smithi045.stdout: -171> 2023-10-03T19:19:59.436+0000 7fd1a1468640 7 mds.0.cache trim_lru trimming 0 items from LRU size=12 mid=0 pintail=0 pinned=12 2023-10-03T19:21:28.103 INFO:teuthology.orchestra.run.smithi045.stdout: -170> 2023-10-03T19:19:59.436+0000 7fd1a1468640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:28.103 INFO:teuthology.orchestra.run.smithi045.stdout: -169> 2023-10-03T19:19:59.436+0000 7fd1a1468640 7 mds.0.server recall_client_state: min=100 max=1048576 total=1 flags=0xa 2023-10-03T19:21:28.103 INFO:teuthology.orchestra.run.smithi045.stdout: -168> 2023-10-03T19:19:59.436+0000 7fd1a1468640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:28.103 INFO:teuthology.orchestra.run.smithi045.stdout: -167> 2023-10-03T19:19:59.436+0000 7fd1a1468640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:28.103 INFO:teuthology.orchestra.run.smithi045.stdout: -166> 2023-10-03T19:19:59.500+0000 7fd1a346c640 5 mds.beacon.a Sending beacon up:active seq 8 2023-10-03T19:21:28.103 INFO:teuthology.orchestra.run.smithi045.stdout: -165> 2023-10-03T19:19:59.500+0000 7fd1a346c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.103 INFO:teuthology.orchestra.run.smithi045.stdout: -164> 2023-10-03T19:19:59.500+0000 7fd1a346c640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mdsbeacon(7155/a up:active seq=8 v50) v8 -- 0x556318b99080 con 0x556317aaf800 2023-10-03T19:21:28.103 INFO:teuthology.orchestra.run.smithi045.stdout: -163> 2023-10-03T19:19:59.504+0000 7fd1a346c640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:28.103 INFO:teuthology.orchestra.run.smithi045.stdout: -162> 2023-10-03T19:19:59.504+0000 7fd1a8476640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 57 ==== mdsbeacon(7155/a up:active seq=8 v50) v8 ==== 130+0+0 (secure 0 0 0) 0x556318b98000 con 0x556317aaf800 2023-10-03T19:21:28.104 INFO:teuthology.orchestra.run.smithi045.stdout: -161> 2023-10-03T19:19:59.504+0000 7fd1a8476640 5 mds.beacon.a received beacon reply up:active seq 8 rtt 0.00399994 2023-10-03T19:21:28.104 INFO:teuthology.orchestra.run.smithi045.stdout: -160> 2023-10-03T19:19:59.504+0000 7fd1a346c640 20 mds.beacon.a sender thread waiting interval 3.996s 2023-10-03T19:21:28.104 INFO:teuthology.orchestra.run.smithi045.stdout: -159> 2023-10-03T19:19:59.844+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== client.7350 172.21.15.172:0/3138699255 12 ==== client_session(request_close seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x556317aef6c0 con 0x556318b84000 2023-10-03T19:21:28.104 INFO:teuthology.orchestra.run.smithi045.stdout: -158> 2023-10-03T19:19:59.844+0000 7fd1a5470640 20 mds.0.48 get_session have 0x556318a78a00 client.7350 172.21.15.172:0/3138699255 state open 2023-10-03T19:21:28.104 INFO:teuthology.orchestra.run.smithi045.stdout: -157> 2023-10-03T19:19:59.844+0000 7fd1a5470640 3 mds.0.server handle_client_session client_session(request_close seq 1) v1 from client.7350 2023-10-03T19:21:28.104 INFO:teuthology.orchestra.run.smithi045.stdout: -156> 2023-10-03T19:19:59.844+0000 7fd1a5470640 10 mds.0.server journal_close_session : client.7350 172.21.15.172:0/3138699255 pending_prealloc_inos [] free_prealloc_inos [] delegated_inos [] 2023-10-03T19:21:28.130 INFO:teuthology.orchestra.run.smithi045.stdout: -155> 2023-10-03T19:19:59.844+0000 7fd1a5470640 20 mds.0.sessionmap mark_projected s=0x556318a78a00 name=client.7350 pv=5 -> 6 2023-10-03T19:21:28.130 INFO:teuthology.orchestra.run.smithi045.stdout: -154> 2023-10-03T19:19:59.844+0000 7fd19ec63640 5 mds.0.log _submit_thread 4202453~121 : ESession client.7350 172.21.15.172:0/3138699255 close cmapv 6 2023-10-03T19:21:28.130 INFO:teuthology.orchestra.run.smithi045.stdout: -153> 2023-10-03T19:19:59.844+0000 7fd19ec63640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.48:49 15.14 15:2e2fa760:::200.00000001:head [write 8149~141 [fadvise_dontneed] in=141b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e98) v8 -- 0x556318bba700 con 0x5563189cc400 2023-10-03T19:21:28.130 INFO:teuthology.orchestra.run.smithi045.stdout: -152> 2023-10-03T19:19:59.848+0000 7fd1a8c77640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== osd.6 v2:172.21.15.79:6819/1486010128 15 ==== osd_op_reply(49 200.00000001 [write 8149~141 [fadvise_dontneed]] v98'14 uv14 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x556318aaf440 con 0x5563189cc400 2023-10-03T19:21:28.131 INFO:teuthology.orchestra.run.smithi045.stdout: -151> 2023-10-03T19:19:59.848+0000 7fd19f464640 10 MDSIOContextBase::complete: 20C_MDS_session_finish 2023-10-03T19:21:28.131 INFO:teuthology.orchestra.run.smithi045.stdout: -150> 2023-10-03T19:19:59.848+0000 7fd19f464640 10 MDSContext::complete: 20C_MDS_session_finish 2023-10-03T19:21:28.131 INFO:teuthology.orchestra.run.smithi045.stdout: -149> 2023-10-03T19:19:59.848+0000 7fd19f464640 10 mds.0.server _session_logged client.7350 172.21.15.172:0/3138699255 state_seq 3 close 6 inos_to_free [] inotablev 0 inos_to_purge [] 2023-10-03T19:21:28.131 INFO:teuthology.orchestra.run.smithi045.stdout: -148> 2023-10-03T19:19:59.848+0000 7fd19f464640 20 mds.0.sessionmap mark_dirty s=0x556318a78a00 name=client.7350 v=5 2023-10-03T19:21:28.131 INFO:teuthology.orchestra.run.smithi045.stdout: -147> 2023-10-03T19:19:59.848+0000 7fd19f464640 20 mds.0.server killing capability pAsLsXs on [inode 0x1 [...2,head] / auth v4 snaprealm=0x556317c178c0 DIRTYPARENT f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v1 rc2023-10-03T19:19:53.873286+0000 3=0+3)/n(v0 rc2023-10-03T19:19:39.424362+0000 1=0+1) (inest lock) (ifile mix) (iversion lock) caps={7350=pAsLsXs/-@2} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=0 0x556317b3c680] 2023-10-03T19:21:28.131 INFO:teuthology.orchestra.run.smithi045.stdout: -146> 2023-10-03T19:19:59.848+0000 7fd19f464640 10 mds.0.cache.ino(0x1) remove_client_cap last cap, leaving realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:19:39.424362+0000 change_attr 0 0x556317c178c0) 2023-10-03T19:21:28.131 INFO:teuthology.orchestra.run.smithi045.stdout: -145> 2023-10-03T19:19:59.848+0000 7fd19f464640 10 mds.0.48 send_message_client client.7350 172.21.15.172:0/3138699255 client_session(close) v5 2023-10-03T19:21:28.131 INFO:teuthology.orchestra.run.smithi045.stdout: -144> 2023-10-03T19:19:59.848+0000 7fd19f464640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> 172.21.15.172:0/3138699255 -- client_session(close) v5 -- 0x556318bc6000 con 0x556318b84000 2023-10-03T19:21:28.131 INFO:teuthology.orchestra.run.smithi045.stdout: -143> 2023-10-03T19:19:59.848+0000 7fd19f464640 10 remove_session: mds.metrics: session=0x556318a78a00, client=client.7350 172.21.15.172:0/3138699255 2023-10-03T19:21:28.131 INFO:teuthology.orchestra.run.smithi045.stdout: -142> 2023-10-03T19:19:59.848+0000 7fd19f464640 10 mds.0.sessionmap remove_session s=0x556318a78a00 name=client.7350 2023-10-03T19:21:28.131 INFO:teuthology.orchestra.run.smithi045.stdout: -141> 2023-10-03T19:19:59.848+0000 7fd1a8c77640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> 172.21.15.172:0/3138699255 conn(0x556318b84000 msgr2=0x556318b92000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 40 2023-10-03T19:21:28.132 INFO:teuthology.orchestra.run.smithi045.stdout: -140> 2023-10-03T19:19:59.848+0000 7fd1a8c77640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> 172.21.15.172:0/3138699255 conn(0x556318b84000 msgr2=0x556318b92000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-03T19:21:28.132 INFO:teuthology.orchestra.run.smithi045.stdout: -139> 2023-10-03T19:19:59.848+0000 7fd1a8c77640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> 172.21.15.172:0/3138699255 conn(0x556318b84000 0x556318b92000 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T19:21:28.132 INFO:teuthology.orchestra.run.smithi045.stdout: -138> 2023-10-03T19:19:59.848+0000 7fd1a8c77640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> 172.21.15.172:0/3138699255 conn(0x556318b84000 0x556318b92000 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:28.132 INFO:teuthology.orchestra.run.smithi045.stdout: -137> 2023-10-03T19:19:59.848+0000 7fd1a5470640 5 mds.a ms_handle_reset on 172.21.15.172:0/3138699255 2023-10-03T19:21:28.132 INFO:teuthology.orchestra.run.smithi045.stdout: -136> 2023-10-03T19:19:59.848+0000 7fd1a5470640 3 mds.a ms_handle_reset closing connection for session client.7350 172.21.15.172:0/3138699255 2023-10-03T19:21:28.132 INFO:teuthology.orchestra.run.smithi045.stdout: -135> 2023-10-03T19:19:59.848+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> 172.21.15.172:0/3138699255 conn(0x556318b84000 msgr2=0x556318b92000 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-10-03T19:21:28.132 INFO:teuthology.orchestra.run.smithi045.stdout: -134> 2023-10-03T19:19:59.848+0000 7fd1a5470640 1 --2- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] >> 172.21.15.172:0/3138699255 conn(0x556318b84000 0x556318b92000 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:28.132 INFO:teuthology.orchestra.run.smithi045.stdout: -133> 2023-10-03T19:20:00.016+0000 7fd1a2c6b640 10 mds.pinger is_rank_lagging: rank=0 2023-10-03T19:21:28.132 INFO:teuthology.orchestra.run.smithi045.stdout: -132> 2023-10-03T19:20:00.016+0000 7fd1a2c6b640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgrreport(unknown.a +0-0 packed 1558) v9 -- 0x556318ad8a80 con 0x5563189cc000 2023-10-03T19:21:28.132 INFO:teuthology.orchestra.run.smithi045.stdout: -131> 2023-10-03T19:20:00.068+0000 7fd1a446e640 10 monclient: tick 2023-10-03T19:21:28.132 INFO:teuthology.orchestra.run.smithi045.stdout: -130> 2023-10-03T19:20:00.068+0000 7fd1a446e640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.133 INFO:teuthology.orchestra.run.smithi045.stdout: -129> 2023-10-03T19:20:00.068+0000 7fd1a446e640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:30.071118+0000) 2023-10-03T19:21:28.133 INFO:teuthology.orchestra.run.smithi045.stdout: -128> 2023-10-03T19:20:00.436+0000 7fd19dc61640 10 mds.metric.aggregator ping_all_active_ranks: pinging 1 active mds(s) 2023-10-03T19:21:28.133 INFO:teuthology.orchestra.run.smithi045.stdout: -127> 2023-10-03T19:20:00.436+0000 7fd19dc61640 20 mds.metric.aggregator ping_all_active_ranks: pinging rank=0 addr=[v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] 2023-10-03T19:21:28.133 INFO:teuthology.orchestra.run.smithi045.stdout: -126> 2023-10-03T19:20:00.436+0000 7fd19dc61640 10 mds.pinger send_ping: rank=0 2023-10-03T19:21:28.133 INFO:teuthology.orchestra.run.smithi045.stdout: -125> 2023-10-03T19:20:00.436+0000 7fd19dc61640 10 mds.pinger send_ping: sending ping with sequence=4 to rank=0 2023-10-03T19:21:28.133 INFO:teuthology.orchestra.run.smithi045.stdout: -124> 2023-10-03T19:20:00.436+0000 7fd19dc61640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] send_to--> mds [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mdsping v1 -- ?+0 0x556317b803c0 2023-10-03T19:21:28.133 INFO:teuthology.orchestra.run.smithi045.stdout: -123> 2023-10-03T19:20:00.436+0000 7fd19dc61640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mdsping v1 -- 0x556317b803c0 con 0x556317aafc00 2023-10-03T19:21:28.133 INFO:teuthology.orchestra.run.smithi045.stdout: -122> 2023-10-03T19:20:00.436+0000 7fd1a4c6f640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mds.0 v2:172.21.15.45:6834/3401546487 0 ==== mdsping v1 ==== 0+0+0 (unknown 0 0 0) 0x556317b803c0 con 0x556317aafc00 2023-10-03T19:21:28.133 INFO:teuthology.orchestra.run.smithi045.stdout: -121> 2023-10-03T19:20:00.436+0000 7fd1a4c6f640 20 set_next_seq: mds.metrics: current sequence number 3, setting next sequence number 4 2023-10-03T19:21:28.133 INFO:teuthology.orchestra.run.smithi045.stdout: -120> 2023-10-03T19:20:00.436+0000 7fd19e462640 20 update_rank0: mds.metrics 2023-10-03T19:21:28.133 INFO:teuthology.orchestra.run.smithi045.stdout: -119> 2023-10-03T19:20:00.436+0000 7fd19e462640 20 update_rank0: mds.metrics: sending metric updates for 1 clients to rank 0 (address: [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487]) with sequence number 4, last updated sequence number 8 2023-10-03T19:21:28.134 INFO:teuthology.orchestra.run.smithi045.stdout: -118> 2023-10-03T19:20:00.436+0000 7fd19e462640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] send_to--> mds [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mds_metrics from rank=0 carrying 1 metric updates v1 -- ?+0 0x5563188ef380 2023-10-03T19:21:28.134 INFO:teuthology.orchestra.run.smithi045.stdout: -117> 2023-10-03T19:20:00.436+0000 7fd19e462640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mds_metrics from rank=0 carrying 1 metric updates v1 -- 0x5563188ef380 con 0x556317aafc00 2023-10-03T19:21:28.134 INFO:teuthology.orchestra.run.smithi045.stdout: -116> 2023-10-03T19:20:00.436+0000 7fd1a4c6f640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mds.0 v2:172.21.15.45:6834/3401546487 0 ==== mds_metrics from rank=0 carrying 1 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x5563188ef380 con 0x556317aafc00 2023-10-03T19:21:28.134 INFO:teuthology.orchestra.run.smithi045.stdout: -115> 2023-10-03T19:20:00.436+0000 7fd1a4c6f640 20 mds.metric.aggregator handle_mds_metrics: applying 1 updates for rank=0 with sequence number 4 2023-10-03T19:21:28.134 INFO:teuthology.orchestra.run.smithi045.stdout: -114> 2023-10-03T19:20:00.436+0000 7fd1a4c6f640 10 mds.pinger pong_received: rank=0, sequence=4 2023-10-03T19:21:28.134 INFO:teuthology.orchestra.run.smithi045.stdout: -113> 2023-10-03T19:20:00.436+0000 7fd1a4c6f640 20 mds.metric.aggregator remove_metrics_for_rank: client=client.7350 172.21.15.172:0/3138699255, rank=0 2023-10-03T19:21:28.134 INFO:teuthology.orchestra.run.smithi045.stdout: -112> 2023-10-03T19:20:00.436+0000 7fd1a4c6f640 20 mds.metric.aggregator remove_metrics_for_rank: rank=0 has 0 connected client(s) 2023-10-03T19:21:28.134 INFO:teuthology.orchestra.run.smithi045.stdout: -111> 2023-10-03T19:20:00.436+0000 7fd1a1468640 2 mds.0.cache Memory usage: total 274132, rss 38864, heap 207144, baseline 190760, 0 / 15 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:28.134 INFO:teuthology.orchestra.run.smithi045.stdout: -110> 2023-10-03T19:20:00.436+0000 7fd1a1468640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999985099s ago 2023-10-03T19:21:28.134 INFO:teuthology.orchestra.run.smithi045.stdout: -109> 2023-10-03T19:20:00.436+0000 7fd1a1468640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:28.134 INFO:teuthology.orchestra.run.smithi045.stdout: -108> 2023-10-03T19:20:00.436+0000 7fd1a1468640 7 mds.0.cache trim bytes_used=58kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:28.134 INFO:teuthology.orchestra.run.smithi045.stdout: -107> 2023-10-03T19:20:00.440+0000 7fd1a1468640 7 mds.0.cache trim_lru trimming 0 items from LRU size=12 mid=0 pintail=0 pinned=12 2023-10-03T19:21:28.135 INFO:teuthology.orchestra.run.smithi045.stdout: -106> 2023-10-03T19:20:00.440+0000 7fd1a1468640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:28.135 INFO:teuthology.orchestra.run.smithi045.stdout: -105> 2023-10-03T19:20:00.440+0000 7fd1a1468640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:28.135 INFO:teuthology.orchestra.run.smithi045.stdout: -104> 2023-10-03T19:20:00.440+0000 7fd1a1468640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:28.135 INFO:teuthology.orchestra.run.smithi045.stdout: -103> 2023-10-03T19:20:00.440+0000 7fd1a1468640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:28.135 INFO:teuthology.orchestra.run.smithi045.stdout: -102> 2023-10-03T19:20:01.068+0000 7fd1a446e640 10 monclient: tick 2023-10-03T19:21:28.135 INFO:teuthology.orchestra.run.smithi045.stdout: -101> 2023-10-03T19:20:01.068+0000 7fd1a446e640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.135 INFO:teuthology.orchestra.run.smithi045.stdout: -100> 2023-10-03T19:20:01.068+0000 7fd1a446e640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:31.071229+0000) 2023-10-03T19:21:28.135 INFO:teuthology.orchestra.run.smithi045.stdout: -99> 2023-10-03T19:20:01.420+0000 7fd1a3c6d640 20 mds.0.48 get_task_status 2023-10-03T19:21:28.135 INFO:teuthology.orchestra.run.smithi045.stdout: -98> 2023-10-03T19:20:01.420+0000 7fd1a3c6d640 20 mds.0.48 schedule_update_timer_task 2023-10-03T19:21:28.135 INFO:teuthology.orchestra.run.smithi045.stdout: -97> 2023-10-03T19:20:01.440+0000 7fd1a1468640 2 mds.0.cache Memory usage: total 274132, rss 38864, heap 207144, baseline 190760, 0 / 15 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:28.135 INFO:teuthology.orchestra.run.smithi045.stdout: -96> 2023-10-03T19:20:01.440+0000 7fd1a1468640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999985099s ago 2023-10-03T19:21:28.135 INFO:teuthology.orchestra.run.smithi045.stdout: -95> 2023-10-03T19:20:01.440+0000 7fd1a1468640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:28.136 INFO:teuthology.orchestra.run.smithi045.stdout: -94> 2023-10-03T19:20:01.440+0000 7fd1a1468640 7 mds.0.cache trim bytes_used=58kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:28.136 INFO:teuthology.orchestra.run.smithi045.stdout: -93> 2023-10-03T19:20:01.440+0000 7fd1a1468640 7 mds.0.cache trim_lru trimming 0 items from LRU size=12 mid=0 pintail=0 pinned=12 2023-10-03T19:21:28.136 INFO:teuthology.orchestra.run.smithi045.stdout: -92> 2023-10-03T19:20:01.440+0000 7fd1a1468640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:28.136 INFO:teuthology.orchestra.run.smithi045.stdout: -91> 2023-10-03T19:20:01.440+0000 7fd1a1468640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:28.136 INFO:teuthology.orchestra.run.smithi045.stdout: -90> 2023-10-03T19:20:01.440+0000 7fd1a1468640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:28.136 INFO:teuthology.orchestra.run.smithi045.stdout: -89> 2023-10-03T19:20:01.440+0000 7fd1a1468640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:28.136 INFO:teuthology.orchestra.run.smithi045.stdout: -88> 2023-10-03T19:20:02.068+0000 7fd1a446e640 10 monclient: tick 2023-10-03T19:21:28.136 INFO:teuthology.orchestra.run.smithi045.stdout: -87> 2023-10-03T19:20:02.068+0000 7fd1a446e640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.136 INFO:teuthology.orchestra.run.smithi045.stdout: -86> 2023-10-03T19:20:02.068+0000 7fd1a446e640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:32.071323+0000) 2023-10-03T19:21:28.136 INFO:teuthology.orchestra.run.smithi045.stdout: -85> 2023-10-03T19:20:02.436+0000 7fd19e462640 20 update_rank0: mds.metrics 2023-10-03T19:21:28.136 INFO:teuthology.orchestra.run.smithi045.stdout: -84> 2023-10-03T19:20:02.436+0000 7fd19e462640 20 update_rank0: mds.metrics: sending metric updates for 0 clients to rank 0 (address: [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487]) with sequence number 4, last updated sequence number 9 2023-10-03T19:21:28.136 INFO:teuthology.orchestra.run.smithi045.stdout: -83> 2023-10-03T19:20:02.436+0000 7fd19e462640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] send_to--> mds [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mds_metrics from rank=0 carrying 0 metric updates v1 -- ?+0 0x5563188ef500 2023-10-03T19:21:28.137 INFO:teuthology.orchestra.run.smithi045.stdout: -82> 2023-10-03T19:20:02.436+0000 7fd19e462640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mds_metrics from rank=0 carrying 0 metric updates v1 -- 0x5563188ef500 con 0x556317aafc00 2023-10-03T19:21:28.137 INFO:teuthology.orchestra.run.smithi045.stdout: -81> 2023-10-03T19:20:02.436+0000 7fd1a4c6f640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mds.0 v2:172.21.15.45:6834/3401546487 0 ==== mds_metrics from rank=0 carrying 0 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x5563188ef500 con 0x556317aafc00 2023-10-03T19:21:28.137 INFO:teuthology.orchestra.run.smithi045.stdout: -80> 2023-10-03T19:20:02.436+0000 7fd1a4c6f640 20 mds.metric.aggregator handle_mds_metrics: applying 0 updates for rank=0 with sequence number 4 2023-10-03T19:21:28.137 INFO:teuthology.orchestra.run.smithi045.stdout: -79> 2023-10-03T19:20:02.436+0000 7fd1a4c6f640 10 mds.pinger pong_received: rank=0, sequence=4 2023-10-03T19:21:28.137 INFO:teuthology.orchestra.run.smithi045.stdout: -78> 2023-10-03T19:20:02.440+0000 7fd1a1468640 2 mds.0.cache Memory usage: total 274132, rss 38864, heap 207144, baseline 190760, 0 / 15 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:28.137 INFO:teuthology.orchestra.run.smithi045.stdout: -77> 2023-10-03T19:20:02.440+0000 7fd1a1468640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999985158s ago 2023-10-03T19:21:28.137 INFO:teuthology.orchestra.run.smithi045.stdout: -76> 2023-10-03T19:20:02.440+0000 7fd1a1468640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:28.137 INFO:teuthology.orchestra.run.smithi045.stdout: -75> 2023-10-03T19:20:02.440+0000 7fd1a1468640 7 mds.0.cache trim bytes_used=58kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:28.137 INFO:teuthology.orchestra.run.smithi045.stdout: -74> 2023-10-03T19:20:02.440+0000 7fd1a1468640 7 mds.0.cache trim_lru trimming 0 items from LRU size=12 mid=0 pintail=0 pinned=12 2023-10-03T19:21:28.137 INFO:teuthology.orchestra.run.smithi045.stdout: -73> 2023-10-03T19:20:02.440+0000 7fd1a1468640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:28.137 INFO:teuthology.orchestra.run.smithi045.stdout: -72> 2023-10-03T19:20:02.440+0000 7fd1a1468640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:28.138 INFO:teuthology.orchestra.run.smithi045.stdout: -71> 2023-10-03T19:20:02.440+0000 7fd1a1468640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:28.138 INFO:teuthology.orchestra.run.smithi045.stdout: -70> 2023-10-03T19:20:02.440+0000 7fd1a1468640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:28.138 INFO:teuthology.orchestra.run.smithi045.stdout: -69> 2023-10-03T19:20:03.068+0000 7fd1a446e640 10 monclient: tick 2023-10-03T19:21:28.138 INFO:teuthology.orchestra.run.smithi045.stdout: -68> 2023-10-03T19:20:03.068+0000 7fd1a446e640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.138 INFO:teuthology.orchestra.run.smithi045.stdout: -67> 2023-10-03T19:20:03.068+0000 7fd1a446e640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:33.071415+0000) 2023-10-03T19:21:28.138 INFO:teuthology.orchestra.run.smithi045.stdout: -66> 2023-10-03T19:20:03.420+0000 7fd1a3c6d640 20 mds.0.48 get_task_status 2023-10-03T19:21:28.138 INFO:teuthology.orchestra.run.smithi045.stdout: -65> 2023-10-03T19:20:03.420+0000 7fd1a3c6d640 20 mds.0.48 schedule_update_timer_task 2023-10-03T19:21:28.138 INFO:teuthology.orchestra.run.smithi045.stdout: -64> 2023-10-03T19:20:03.440+0000 7fd1a1468640 2 mds.0.cache Memory usage: total 274132, rss 38864, heap 207144, baseline 190760, 0 / 15 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:28.138 INFO:teuthology.orchestra.run.smithi045.stdout: -63> 2023-10-03T19:20:03.440+0000 7fd1a1468640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999985158s ago 2023-10-03T19:21:28.138 INFO:teuthology.orchestra.run.smithi045.stdout: -62> 2023-10-03T19:20:03.440+0000 7fd1a1468640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:28.138 INFO:teuthology.orchestra.run.smithi045.stdout: -61> 2023-10-03T19:20:03.440+0000 7fd1a1468640 7 mds.0.cache trim bytes_used=58kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:28.138 INFO:teuthology.orchestra.run.smithi045.stdout: -60> 2023-10-03T19:20:03.440+0000 7fd1a1468640 7 mds.0.cache trim_lru trimming 0 items from LRU size=12 mid=0 pintail=0 pinned=12 2023-10-03T19:21:28.139 INFO:teuthology.orchestra.run.smithi045.stdout: -59> 2023-10-03T19:20:03.440+0000 7fd1a1468640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:28.139 INFO:teuthology.orchestra.run.smithi045.stdout: -58> 2023-10-03T19:20:03.440+0000 7fd1a1468640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:28.139 INFO:teuthology.orchestra.run.smithi045.stdout: -57> 2023-10-03T19:20:03.440+0000 7fd1a1468640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:28.139 INFO:teuthology.orchestra.run.smithi045.stdout: -56> 2023-10-03T19:20:03.440+0000 7fd1a1468640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:28.139 INFO:teuthology.orchestra.run.smithi045.stdout: -55> 2023-10-03T19:20:03.500+0000 7fd1a346c640 5 mds.beacon.a Sending beacon up:active seq 9 2023-10-03T19:21:28.139 INFO:teuthology.orchestra.run.smithi045.stdout: -54> 2023-10-03T19:20:03.500+0000 7fd1a346c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.139 INFO:teuthology.orchestra.run.smithi045.stdout: -53> 2023-10-03T19:20:03.500+0000 7fd1a346c640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mdsbeacon(7155/a up:active seq=9 v50) v8 -- 0x556318a65600 con 0x556317aaf800 2023-10-03T19:21:28.139 INFO:teuthology.orchestra.run.smithi045.stdout: -52> 2023-10-03T19:20:03.500+0000 7fd1a346c640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:28.139 INFO:teuthology.orchestra.run.smithi045.stdout: -51> 2023-10-03T19:20:03.500+0000 7fd1a8476640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 58 ==== mdsbeacon(7155/a up:active seq=9 v50) v8 ==== 130+0+0 (secure 0 0 0) 0x556318a65600 con 0x556317aaf800 2023-10-03T19:21:28.139 INFO:teuthology.orchestra.run.smithi045.stdout: -50> 2023-10-03T19:20:03.500+0000 7fd1a8476640 5 mds.beacon.a received beacon reply up:active seq 9 rtt 0 2023-10-03T19:21:28.139 INFO:teuthology.orchestra.run.smithi045.stdout: -49> 2023-10-03T19:20:03.500+0000 7fd1a346c640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:28.139 INFO:teuthology.orchestra.run.smithi045.stdout: -48> 2023-10-03T19:20:04.064+0000 7fd1a3c6d640 10 mds.0.log trim 1 / 128 segments, 9 / -1 events, 0 (0) expiring, 0 (0) expired 2023-10-03T19:21:28.140 INFO:teuthology.orchestra.run.smithi045.stdout: -47> 2023-10-03T19:20:04.064+0000 7fd1a3c6d640 10 mds.0.log _trim_expired_segments waiting for 1/4194304 to expire 2023-10-03T19:21:28.140 INFO:teuthology.orchestra.run.smithi045.stdout: -46> 2023-10-03T19:20:04.064+0000 7fd1a3c6d640 10 mds.0.server find_idle_sessions. last cleared laggy state 1250.45s ago 2023-10-03T19:21:28.140 INFO:teuthology.orchestra.run.smithi045.stdout: -45> 2023-10-03T19:20:04.064+0000 7fd1a3c6d640 10 mds.0.locker scatter_tick 2023-10-03T19:21:28.140 INFO:teuthology.orchestra.run.smithi045.stdout: -44> 2023-10-03T19:20:04.064+0000 7fd1a3c6d640 20 mds.0.locker caps_tick 0 revoking caps 2023-10-03T19:21:28.140 INFO:teuthology.orchestra.run.smithi045.stdout: -43> 2023-10-03T19:20:04.064+0000 7fd1a3c6d640 20 mds.0.bal handle_export_pins export_pin_queue size=0 2023-10-03T19:21:28.140 INFO:teuthology.orchestra.run.smithi045.stdout: -42> 2023-10-03T19:20:04.064+0000 7fd1a3c6d640 15 mds.0.bal tick tick last_sample now 1250.453821s 2023-10-03T19:21:28.140 INFO:teuthology.orchestra.run.smithi045.stdout: -41> 2023-10-03T19:20:04.064+0000 7fd1a3c6d640 15 mds.0.cache show_subtrees 2023-10-03T19:21:28.140 INFO:teuthology.orchestra.run.smithi045.stdout: -40> 2023-10-03T19:20:04.064+0000 7fd1a3c6d640 10 mds.0.cache |__ 0 auth [dir 0x1 / [2,head] auth v=6 cv=1/1 REP dir_auth=0 state=1610612737|complete f(v0 m2023-10-03T19:19:53.863091+0000 1=0+1) n(v1 rc2023-10-03T19:19:53.873286+0000 2=0+2) hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 dirty=1 authpin=0 0x556317b1d180] 2023-10-03T19:21:28.140 INFO:teuthology.orchestra.run.smithi045.stdout: -39> 2023-10-03T19:20:04.064+0000 7fd1a3c6d640 10 mds.0.cache |__ 0 auth [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:19:39.425877+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x556317b1d600] 2023-10-03T19:21:28.140 INFO:teuthology.orchestra.run.smithi045.stdout: -38> 2023-10-03T19:20:04.068+0000 7fd1a3c6d640 10 mds.0.cache find_stale_fragment_freeze 2023-10-03T19:21:28.140 INFO:teuthology.orchestra.run.smithi045.stdout: -37> 2023-10-03T19:20:04.068+0000 7fd1a3c6d640 10 mds.0.snap check_osd_map - version unchanged 2023-10-03T19:21:28.141 INFO:teuthology.orchestra.run.smithi045.stdout: -36> 2023-10-03T19:20:04.068+0000 7fd1a3c6d640 20 mds.0.48 updating export targets, currently 0 ranks are targets 2023-10-03T19:21:28.141 INFO:teuthology.orchestra.run.smithi045.stdout: -35> 2023-10-03T19:20:04.068+0000 7fd1a446e640 10 monclient: tick 2023-10-03T19:21:28.141 INFO:teuthology.orchestra.run.smithi045.stdout: -34> 2023-10-03T19:20:04.068+0000 7fd1a446e640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.141 INFO:teuthology.orchestra.run.smithi045.stdout: -33> 2023-10-03T19:20:04.068+0000 7fd1a446e640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:34.071518+0000) 2023-10-03T19:21:28.141 INFO:teuthology.orchestra.run.smithi045.stdout: -32> 2023-10-03T19:20:04.332+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 59 ==== osd_map(99..99 src has 1..99) v4 ==== 374+0+0 (secure 0 0 0) 0x556317aee700 con 0x556317aaf800 2023-10-03T19:21:28.141 INFO:teuthology.orchestra.run.smithi045.stdout: -31> 2023-10-03T19:20:04.332+0000 7fd1a5470640 10 mds.0.snap check_osd_map need_to_purge={} 2023-10-03T19:21:28.141 INFO:teuthology.orchestra.run.smithi045.stdout: -30> 2023-10-03T19:20:04.332+0000 7fd1a5470640 7 mds.0.server operator(): full = 0 epoch = 99 2023-10-03T19:21:28.141 INFO:teuthology.orchestra.run.smithi045.stdout: -29> 2023-10-03T19:20:04.332+0000 7fd1a5470640 10 mds.0.server apply_blocklist: killed 0 2023-10-03T19:21:28.141 INFO:teuthology.orchestra.run.smithi045.stdout: -28> 2023-10-03T19:20:04.332+0000 7fd1a5470640 4 mds.0.48 apply_blocklist: killed 0, blocklisted sessions (2 blocklist entries, 0) 2023-10-03T19:21:28.141 INFO:teuthology.orchestra.run.smithi045.stdout: -27> 2023-10-03T19:20:04.332+0000 7fd1a5470640 10 monclient: _renew_subs 2023-10-03T19:21:28.141 INFO:teuthology.orchestra.run.smithi045.stdout: -26> 2023-10-03T19:20:04.332+0000 7fd1a5470640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.141 INFO:teuthology.orchestra.run.smithi045.stdout: -25> 2023-10-03T19:20:04.332+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=100}) v3 -- 0x55631896ba00 con 0x556317aaf800 2023-10-03T19:21:28.142 INFO:teuthology.orchestra.run.smithi045.stdout: -24> 2023-10-03T19:20:04.436+0000 7fd19e462640 20 update_rank0: mds.metrics 2023-10-03T19:21:28.142 INFO:teuthology.orchestra.run.smithi045.stdout: -23> 2023-10-03T19:20:04.436+0000 7fd19e462640 20 update_rank0: mds.metrics: sending metric updates for 0 clients to rank 0 (address: [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487]) with sequence number 4, last updated sequence number 10 2023-10-03T19:21:28.142 INFO:teuthology.orchestra.run.smithi045.stdout: -22> 2023-10-03T19:20:04.436+0000 7fd19e462640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] send_to--> mds [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mds_metrics from rank=0 carrying 0 metric updates v1 -- ?+0 0x5563188efb00 2023-10-03T19:21:28.142 INFO:teuthology.orchestra.run.smithi045.stdout: -21> 2023-10-03T19:20:04.436+0000 7fd19e462640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] --> [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] -- mds_metrics from rank=0 carrying 0 metric updates v1 -- 0x5563188efb00 con 0x556317aafc00 2023-10-03T19:21:28.142 INFO:teuthology.orchestra.run.smithi045.stdout: -20> 2023-10-03T19:20:04.436+0000 7fd1a4c6f640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mds.0 v2:172.21.15.45:6834/3401546487 0 ==== mds_metrics from rank=0 carrying 0 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x5563188efb00 con 0x556317aafc00 2023-10-03T19:21:28.142 INFO:teuthology.orchestra.run.smithi045.stdout: -19> 2023-10-03T19:20:04.436+0000 7fd1a4c6f640 20 mds.metric.aggregator handle_mds_metrics: applying 0 updates for rank=0 with sequence number 4 2023-10-03T19:21:28.142 INFO:teuthology.orchestra.run.smithi045.stdout: -18> 2023-10-03T19:20:04.436+0000 7fd1a4c6f640 10 mds.pinger pong_received: rank=0, sequence=4 2023-10-03T19:21:28.142 INFO:teuthology.orchestra.run.smithi045.stdout: -17> 2023-10-03T19:20:04.440+0000 7fd1a1468640 2 mds.0.cache Memory usage: total 274132, rss 38864, heap 207144, baseline 190760, 0 / 15 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:28.142 INFO:teuthology.orchestra.run.smithi045.stdout: -16> 2023-10-03T19:20:04.440+0000 7fd1a1468640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999985158s ago 2023-10-03T19:21:28.142 INFO:teuthology.orchestra.run.smithi045.stdout: -15> 2023-10-03T19:20:04.440+0000 7fd1a1468640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:28.142 INFO:teuthology.orchestra.run.smithi045.stdout: -14> 2023-10-03T19:20:04.440+0000 7fd1a1468640 7 mds.0.cache trim bytes_used=58kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:28.143 INFO:teuthology.orchestra.run.smithi045.stdout: -13> 2023-10-03T19:20:04.440+0000 7fd1a1468640 7 mds.0.cache trim_lru trimming 0 items from LRU size=12 mid=0 pintail=0 pinned=12 2023-10-03T19:21:28.143 INFO:teuthology.orchestra.run.smithi045.stdout: -12> 2023-10-03T19:20:04.440+0000 7fd1a1468640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:28.143 INFO:teuthology.orchestra.run.smithi045.stdout: -11> 2023-10-03T19:20:04.440+0000 7fd1a1468640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:28.143 INFO:teuthology.orchestra.run.smithi045.stdout: -10> 2023-10-03T19:20:04.440+0000 7fd1a1468640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:28.143 INFO:teuthology.orchestra.run.smithi045.stdout: -9> 2023-10-03T19:20:04.440+0000 7fd1a1468640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:28.143 INFO:teuthology.orchestra.run.smithi045.stdout: -8> 2023-10-03T19:20:04.832+0000 7fd1a5470640 1 -- [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] <== mon.0 v2:172.21.15.45:3300/0 60 ==== mdsmap(e 51) v2 ==== 225+0+0 (secure 0 0 0) 0x55631896ba00 con 0x556317aaf800 2023-10-03T19:21:28.143 INFO:teuthology.orchestra.run.smithi045.stdout: -7> 2023-10-03T19:20:04.832+0000 7fd1a5470640 1 mds.a Updating MDS map to version 51 from mon.0 2023-10-03T19:21:28.143 INFO:teuthology.orchestra.run.smithi045.stdout: -6> 2023-10-03T19:20:04.832+0000 7fd1a5470640 10 mds.a my compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-03T19:21:28.143 INFO:teuthology.orchestra.run.smithi045.stdout: -5> 2023-10-03T19:20:04.832+0000 7fd1a5470640 10 mds.a mdsmap compat compat={},rocompat={},incompat={7=mds uses inline data} 2023-10-03T19:21:28.143 INFO:teuthology.orchestra.run.smithi045.stdout: -4> 2023-10-03T19:20:04.832+0000 7fd1a5470640 10 mds.a my gid is 7155 2023-10-03T19:21:28.143 INFO:teuthology.orchestra.run.smithi045.stdout: -3> 2023-10-03T19:20:04.832+0000 7fd1a5470640 10 mds.a map says I am mds.-1.-1 state null 2023-10-03T19:21:28.143 INFO:teuthology.orchestra.run.smithi045.stdout: -2> 2023-10-03T19:20:04.832+0000 7fd1a5470640 10 mds.a msgr says I am [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] 2023-10-03T19:21:28.144 INFO:teuthology.orchestra.run.smithi045.stdout: -1> 2023-10-03T19:20:04.832+0000 7fd1a5470640 1 mds.a Map removed me [mds.a{0:7155} state up:active seq 3 addr [v2:172.21.15.45:6834/3401546487,v1:172.21.15.45:6835/3401546487] compat {c=[1],r=[1],i=[7ff]}] from cluster; respawning! See cluster/monitor logs for details. 2023-10-03T19:21:28.144 INFO:teuthology.orchestra.run.smithi045.stdout: 0> 2023-10-03T19:20:04.832+0000 7fd1a5470640 1 mds.a respawn! 2023-10-03T19:21:28.144 INFO:teuthology.orchestra.run.smithi045.stdout:--- logging levels --- 2023-10-03T19:21:28.144 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 none 2023-10-03T19:21:28.144 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 lockdep 2023-10-03T19:21:28.144 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 context 2023-10-03T19:21:28.144 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 1 crush 2023-10-03T19:21:28.144 INFO:teuthology.orchestra.run.smithi045.stdout: 20/20 mds 2023-10-03T19:21:28.144 INFO:teuthology.orchestra.run.smithi045.stdout: 20/20 mds_balancer 2023-10-03T19:21:28.144 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mds_locker 2023-10-03T19:21:28.144 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mds_log 2023-10-03T19:21:28.144 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mds_log_expire 2023-10-03T19:21:28.145 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mds_migrator 2023-10-03T19:21:28.145 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 buffer 2023-10-03T19:21:28.145 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 timer 2023-10-03T19:21:28.145 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 filer 2023-10-03T19:21:28.145 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 striper 2023-10-03T19:21:28.145 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 objecter 2023-10-03T19:21:28.145 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 rados 2023-10-03T19:21:28.145 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 rbd 2023-10-03T19:21:28.145 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 rbd_mirror 2023-10-03T19:21:28.145 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 rbd_replay 2023-10-03T19:21:28.145 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 rbd_pwl 2023-10-03T19:21:28.145 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 journaler 2023-10-03T19:21:28.146 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 objectcacher 2023-10-03T19:21:28.146 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 immutable_obj_cache 2023-10-03T19:21:28.146 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 client 2023-10-03T19:21:28.146 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 osd 2023-10-03T19:21:28.146 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 optracker 2023-10-03T19:21:28.146 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 objclass 2023-10-03T19:21:28.146 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 3 filestore 2023-10-03T19:21:28.146 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 3 journal 2023-10-03T19:21:28.146 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 1 ms 2023-10-03T19:21:28.146 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mon 2023-10-03T19:21:28.146 INFO:teuthology.orchestra.run.smithi045.stdout: 0/10 monc 2023-10-03T19:21:28.146 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 paxos 2023-10-03T19:21:28.147 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 tp 2023-10-03T19:21:28.175 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 auth 2023-10-03T19:21:28.175 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 crypto 2023-10-03T19:21:28.175 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 1 finisher 2023-10-03T19:21:28.175 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 1 reserver 2023-10-03T19:21:28.175 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 heartbeatmap 2023-10-03T19:21:28.175 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 perfcounter 2023-10-03T19:21:28.175 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw 2023-10-03T19:21:28.175 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw_sync 2023-10-03T19:21:28.175 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw_datacache 2023-10-03T19:21:28.175 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw_access 2023-10-03T19:21:28.175 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw_dbstore 2023-10-03T19:21:28.175 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw_flight 2023-10-03T19:21:28.176 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 javaclient 2023-10-03T19:21:28.176 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 asok 2023-10-03T19:21:28.176 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 1 throttle 2023-10-03T19:21:28.176 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 0 refs 2023-10-03T19:21:28.176 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 compressor 2023-10-03T19:21:28.176 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 bluestore 2023-10-03T19:21:28.176 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 bluefs 2023-10-03T19:21:28.176 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 3 bdev 2023-10-03T19:21:28.176 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 kstore 2023-10-03T19:21:28.176 INFO:teuthology.orchestra.run.smithi045.stdout: 4/ 5 rocksdb 2023-10-03T19:21:28.176 INFO:teuthology.orchestra.run.smithi045.stdout: 4/ 5 leveldb 2023-10-03T19:21:28.176 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 fuse 2023-10-03T19:21:28.177 INFO:teuthology.orchestra.run.smithi045.stdout: 2/ 5 mgr 2023-10-03T19:21:28.177 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mgrc 2023-10-03T19:21:28.177 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 dpdk 2023-10-03T19:21:28.177 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 eventtrace 2023-10-03T19:21:28.177 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 prioritycache 2023-10-03T19:21:28.177 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 test 2023-10-03T19:21:28.177 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 cephfs_mirror 2023-10-03T19:21:28.177 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 cephsqlite 2023-10-03T19:21:28.177 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore 2023-10-03T19:21:28.177 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_onode 2023-10-03T19:21:28.177 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_odata 2023-10-03T19:21:28.177 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_omap 2023-10-03T19:21:28.178 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_tm 2023-10-03T19:21:28.178 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_t 2023-10-03T19:21:28.178 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_cleaner 2023-10-03T19:21:28.178 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_epm 2023-10-03T19:21:28.178 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_lba 2023-10-03T19:21:28.178 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_fixedkv_tree 2023-10-03T19:21:28.178 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_cache 2023-10-03T19:21:28.178 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_journal 2023-10-03T19:21:28.178 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_device 2023-10-03T19:21:28.178 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_backref 2023-10-03T19:21:28.178 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 alienstore 2023-10-03T19:21:28.179 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mclock 2023-10-03T19:21:28.179 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 cyanstore 2023-10-03T19:21:28.179 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 ceph_exporter 2023-10-03T19:21:28.179 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 memstore 2023-10-03T19:21:28.179 INFO:teuthology.orchestra.run.smithi045.stdout: -2/-2 (syslog threshold) 2023-10-03T19:21:28.179 INFO:teuthology.orchestra.run.smithi045.stdout: -1/-1 (stderr threshold) 2023-10-03T19:21:28.179 INFO:teuthology.orchestra.run.smithi045.stdout:--- pthread ID / name mapping for recent threads --- 2023-10-03T19:21:28.179 INFO:teuthology.orchestra.run.smithi045.stdout: 7fd19dc61640 / ms_dispatch 2023-10-03T19:21:28.179 INFO:teuthology.orchestra.run.smithi045.stdout: 7fd19e462640 / ms_dispatch 2023-10-03T19:21:28.179 INFO:teuthology.orchestra.run.smithi045.stdout: 7fd19ec63640 / md_submit 2023-10-03T19:21:28.179 INFO:teuthology.orchestra.run.smithi045.stdout: 7fd19f464640 / MR_Finisher 2023-10-03T19:21:28.179 INFO:teuthology.orchestra.run.smithi045.stdout: 7fd1a0c67640 / mds_rank_progr 2023-10-03T19:21:28.179 INFO:teuthology.orchestra.run.smithi045.stdout: 7fd1a1468640 / ms_dispatch 2023-10-03T19:21:28.180 INFO:teuthology.orchestra.run.smithi045.stdout: 7fd1a2c6b640 / safe_timer 2023-10-03T19:21:28.180 INFO:teuthology.orchestra.run.smithi045.stdout: 7fd1a346c640 / ceph-mds 2023-10-03T19:21:28.180 INFO:teuthology.orchestra.run.smithi045.stdout: 7fd1a3c6d640 / safe_timer 2023-10-03T19:21:28.180 INFO:teuthology.orchestra.run.smithi045.stdout: 7fd1a446e640 / safe_timer 2023-10-03T19:21:28.180 INFO:teuthology.orchestra.run.smithi045.stdout: 7fd1a4c6f640 / ms_local 2023-10-03T19:21:28.180 INFO:teuthology.orchestra.run.smithi045.stdout: 7fd1a5470640 / ms_dispatch 2023-10-03T19:21:28.180 INFO:teuthology.orchestra.run.smithi045.stdout: 7fd1a6472640 / io_context_pool 2023-10-03T19:21:28.180 INFO:teuthology.orchestra.run.smithi045.stdout: 7fd1a7474640 / admin_socket 2023-10-03T19:21:28.180 INFO:teuthology.orchestra.run.smithi045.stdout: 7fd1a7c75640 / msgr-worker-2 2023-10-03T19:21:28.180 INFO:teuthology.orchestra.run.smithi045.stdout: 7fd1a8476640 / msgr-worker-1 2023-10-03T19:21:28.180 INFO:teuthology.orchestra.run.smithi045.stdout: 7fd1a8c77640 / msgr-worker-0 2023-10-03T19:21:28.180 INFO:teuthology.orchestra.run.smithi045.stdout: 7fd1a9cb5ac0 / ceph-mds 2023-10-03T19:21:28.181 INFO:teuthology.orchestra.run.smithi045.stdout: max_recent 10000 2023-10-03T19:21:28.181 INFO:teuthology.orchestra.run.smithi045.stdout: max_new 1000 2023-10-03T19:21:28.181 INFO:teuthology.orchestra.run.smithi045.stdout: log_file /var/log/ceph/ceph-mds.a.log 2023-10-03T19:21:28.181 INFO:teuthology.orchestra.run.smithi045.stdout:--- end dump of recent events --- 2023-10-03T19:21:28.181 INFO:teuthology.orchestra.run.smithi045.stdout:--- begin dump of recent events --- 2023-10-03T19:21:28.181 INFO:teuthology.orchestra.run.smithi045.stdout: -2181> 2023-10-03T19:20:10.912+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command assert hook 0x55c504ad8ba0 2023-10-03T19:21:28.181 INFO:teuthology.orchestra.run.smithi045.stdout: -2180> 2023-10-03T19:20:10.912+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command abort hook 0x55c504ad8ba0 2023-10-03T19:21:28.181 INFO:teuthology.orchestra.run.smithi045.stdout: -2179> 2023-10-03T19:20:10.912+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command leak_some_memory hook 0x55c504ad8ba0 2023-10-03T19:21:28.181 INFO:teuthology.orchestra.run.smithi045.stdout: -2178> 2023-10-03T19:20:10.912+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command perfcounters_dump hook 0x55c504ad8ba0 2023-10-03T19:21:28.181 INFO:teuthology.orchestra.run.smithi045.stdout: -2177> 2023-10-03T19:20:10.912+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command 1 hook 0x55c504ad8ba0 2023-10-03T19:21:28.181 INFO:teuthology.orchestra.run.smithi045.stdout: -2176> 2023-10-03T19:20:10.912+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command perf dump hook 0x55c504ad8ba0 2023-10-03T19:21:28.181 INFO:teuthology.orchestra.run.smithi045.stdout: -2175> 2023-10-03T19:20:10.912+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command perfcounters_schema hook 0x55c504ad8ba0 2023-10-03T19:21:28.182 INFO:teuthology.orchestra.run.smithi045.stdout: -2174> 2023-10-03T19:20:10.912+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command perf histogram dump hook 0x55c504ad8ba0 2023-10-03T19:21:28.182 INFO:teuthology.orchestra.run.smithi045.stdout: -2173> 2023-10-03T19:20:10.912+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command 2 hook 0x55c504ad8ba0 2023-10-03T19:21:28.182 INFO:teuthology.orchestra.run.smithi045.stdout: -2172> 2023-10-03T19:20:10.912+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command perf schema hook 0x55c504ad8ba0 2023-10-03T19:21:28.182 INFO:teuthology.orchestra.run.smithi045.stdout: -2171> 2023-10-03T19:20:10.912+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command counter dump hook 0x55c504ad8ba0 2023-10-03T19:21:28.182 INFO:teuthology.orchestra.run.smithi045.stdout: -2170> 2023-10-03T19:20:10.912+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command counter schema hook 0x55c504ad8ba0 2023-10-03T19:21:28.182 INFO:teuthology.orchestra.run.smithi045.stdout: -2169> 2023-10-03T19:20:10.912+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command perf histogram schema hook 0x55c504ad8ba0 2023-10-03T19:21:28.182 INFO:teuthology.orchestra.run.smithi045.stdout: -2168> 2023-10-03T19:20:10.912+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command perf reset hook 0x55c504ad8ba0 2023-10-03T19:21:28.182 INFO:teuthology.orchestra.run.smithi045.stdout: -2167> 2023-10-03T19:20:10.912+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command config show hook 0x55c504ad8ba0 2023-10-03T19:21:28.182 INFO:teuthology.orchestra.run.smithi045.stdout: -2166> 2023-10-03T19:20:10.912+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command config help hook 0x55c504ad8ba0 2023-10-03T19:21:28.182 INFO:teuthology.orchestra.run.smithi045.stdout: -2165> 2023-10-03T19:20:10.912+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command config set hook 0x55c504ad8ba0 2023-10-03T19:21:28.182 INFO:teuthology.orchestra.run.smithi045.stdout: -2164> 2023-10-03T19:20:10.912+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command config unset hook 0x55c504ad8ba0 2023-10-03T19:21:28.183 INFO:teuthology.orchestra.run.smithi045.stdout: -2163> 2023-10-03T19:20:10.912+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command config get hook 0x55c504ad8ba0 2023-10-03T19:21:28.183 INFO:teuthology.orchestra.run.smithi045.stdout: -2162> 2023-10-03T19:20:10.912+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command config diff hook 0x55c504ad8ba0 2023-10-03T19:21:28.183 INFO:teuthology.orchestra.run.smithi045.stdout: -2161> 2023-10-03T19:20:10.912+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command config diff get hook 0x55c504ad8ba0 2023-10-03T19:21:28.183 INFO:teuthology.orchestra.run.smithi045.stdout: -2160> 2023-10-03T19:20:10.912+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command injectargs hook 0x55c504ad8ba0 2023-10-03T19:21:28.183 INFO:teuthology.orchestra.run.smithi045.stdout: -2159> 2023-10-03T19:20:10.912+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command log flush hook 0x55c504ad8ba0 2023-10-03T19:21:28.183 INFO:teuthology.orchestra.run.smithi045.stdout: -2158> 2023-10-03T19:20:10.912+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command log dump hook 0x55c504ad8ba0 2023-10-03T19:21:28.183 INFO:teuthology.orchestra.run.smithi045.stdout: -2157> 2023-10-03T19:20:10.912+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command log reopen hook 0x55c504ad8ba0 2023-10-03T19:21:28.183 INFO:teuthology.orchestra.run.smithi045.stdout: -2156> 2023-10-03T19:20:10.912+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command dump_mempools hook 0x55c504bc6328 2023-10-03T19:21:28.183 INFO:teuthology.orchestra.run.smithi045.stdout: -2155> 2023-10-03T19:20:10.916+0000 7f04fd56cac0 10 monclient: get_monmap_and_config 2023-10-03T19:21:28.183 INFO:teuthology.orchestra.run.smithi045.stdout: -2154> 2023-10-03T19:20:10.916+0000 7f04fd56cac0 10 monclient: build_initial_monmap 2023-10-03T19:21:28.183 INFO:teuthology.orchestra.run.smithi045.stdout: -2153> 2023-10-03T19:20:10.916+0000 7f04fd56cac0 1 build_initial for_mkfs: 0 2023-10-03T19:21:28.183 INFO:teuthology.orchestra.run.smithi045.stdout: -2152> 2023-10-03T19:20:10.916+0000 7f04fd56cac0 10 monclient: monmap: 2023-10-03T19:21:28.183 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 0 2023-10-03T19:21:28.184 INFO:teuthology.orchestra.run.smithi045.stdout:fsid 58400977-12ba-4c73-bb3e-1589b2492669 2023-10-03T19:21:28.184 INFO:teuthology.orchestra.run.smithi045.stdout:last_changed 2023-10-03T19:20:10.922199+0000 2023-10-03T19:21:28.184 INFO:teuthology.orchestra.run.smithi045.stdout:created 2023-10-03T19:20:10.922199+0000 2023-10-03T19:21:28.184 INFO:teuthology.orchestra.run.smithi045.stdout:min_mon_release 0 (unknown) 2023-10-03T19:21:28.184 INFO:teuthology.orchestra.run.smithi045.stdout:election_strategy: 1 2023-10-03T19:21:28.184 INFO:teuthology.orchestra.run.smithi045.stdout:0: v1:172.21.15.45:6789/0 mon.noname-a-legacy 2023-10-03T19:21:28.184 INFO:teuthology.orchestra.run.smithi045.stdout:1: v1:172.21.15.79:6789/0 mon.noname-b-legacy 2023-10-03T19:21:28.184 INFO:teuthology.orchestra.run.smithi045.stdout:2: [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] mon.noname-c 2023-10-03T19:21:28.184 INFO:teuthology.orchestra.run.smithi045.stdout:3: v2:172.21.15.45:3300/0 mon.noname-a 2023-10-03T19:21:28.184 INFO:teuthology.orchestra.run.smithi045.stdout:4: v2:172.21.15.79:3300/0 mon.noname-b 2023-10-03T19:21:28.184 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:21:28.184 INFO:teuthology.orchestra.run.smithi045.stdout: -2151> 2023-10-03T19:20:10.916+0000 7f04fd56cac0 5 AuthRegistry(0x55c504b23340) adding auth protocol: cephx 2023-10-03T19:21:28.185 INFO:teuthology.orchestra.run.smithi045.stdout: -2150> 2023-10-03T19:20:10.916+0000 7f04fd56cac0 5 AuthRegistry(0x55c504b23340) adding auth protocol: cephx 2023-10-03T19:21:28.185 INFO:teuthology.orchestra.run.smithi045.stdout: -2149> 2023-10-03T19:20:10.916+0000 7f04fd56cac0 5 AuthRegistry(0x55c504b23340) adding auth protocol: cephx 2023-10-03T19:21:28.185 INFO:teuthology.orchestra.run.smithi045.stdout: -2148> 2023-10-03T19:20:10.916+0000 7f04fd56cac0 5 AuthRegistry(0x55c504b23340) adding con mode: secure 2023-10-03T19:21:28.185 INFO:teuthology.orchestra.run.smithi045.stdout: -2147> 2023-10-03T19:20:10.916+0000 7f04fd56cac0 5 AuthRegistry(0x55c504b23340) adding con mode: crc 2023-10-03T19:21:28.185 INFO:teuthology.orchestra.run.smithi045.stdout: -2146> 2023-10-03T19:20:10.916+0000 7f04fd56cac0 5 AuthRegistry(0x55c504b23340) adding con mode: secure 2023-10-03T19:21:28.185 INFO:teuthology.orchestra.run.smithi045.stdout: -2145> 2023-10-03T19:20:10.916+0000 7f04fd56cac0 5 AuthRegistry(0x55c504b23340) adding con mode: crc 2023-10-03T19:21:28.185 INFO:teuthology.orchestra.run.smithi045.stdout: -2144> 2023-10-03T19:20:10.916+0000 7f04fd56cac0 5 AuthRegistry(0x55c504b23340) adding con mode: secure 2023-10-03T19:21:28.185 INFO:teuthology.orchestra.run.smithi045.stdout: -2143> 2023-10-03T19:20:10.916+0000 7f04fd56cac0 5 AuthRegistry(0x55c504b23340) adding con mode: crc 2023-10-03T19:21:28.185 INFO:teuthology.orchestra.run.smithi045.stdout: -2142> 2023-10-03T19:20:10.916+0000 7f04fd56cac0 5 AuthRegistry(0x55c504b23340) adding con mode: crc 2023-10-03T19:21:28.185 INFO:teuthology.orchestra.run.smithi045.stdout: -2141> 2023-10-03T19:20:10.916+0000 7f04fd56cac0 5 AuthRegistry(0x55c504b23340) adding con mode: secure 2023-10-03T19:21:28.185 INFO:teuthology.orchestra.run.smithi045.stdout: -2140> 2023-10-03T19:20:10.916+0000 7f04fd56cac0 5 AuthRegistry(0x55c504b23340) adding con mode: crc 2023-10-03T19:21:28.254 INFO:teuthology.orchestra.run.smithi045.stdout: -2139> 2023-10-03T19:20:10.916+0000 7f04fd56cac0 5 AuthRegistry(0x55c504b23340) adding con mode: secure 2023-10-03T19:21:28.254 INFO:teuthology.orchestra.run.smithi045.stdout: -2138> 2023-10-03T19:20:10.916+0000 7f04fd56cac0 5 AuthRegistry(0x55c504b23340) adding con mode: crc 2023-10-03T19:21:28.254 INFO:teuthology.orchestra.run.smithi045.stdout: -2137> 2023-10-03T19:20:10.916+0000 7f04fd56cac0 5 AuthRegistry(0x55c504b23340) adding con mode: secure 2023-10-03T19:21:28.255 INFO:teuthology.orchestra.run.smithi045.stdout: -2136> 2023-10-03T19:20:10.916+0000 7f04fd56cac0 2 auth: KeyRing::load: loaded key file /var/lib/ceph/mds/ceph-a/keyring 2023-10-03T19:21:28.255 INFO:teuthology.orchestra.run.smithi045.stdout: -2135> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 1 Processor -- start 2023-10-03T19:21:28.255 INFO:teuthology.orchestra.run.smithi045.stdout: -2134> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 1 -- start start 2023-10-03T19:21:28.255 INFO:teuthology.orchestra.run.smithi045.stdout: -2133> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 10 monclient: init 2023-10-03T19:21:28.255 INFO:teuthology.orchestra.run.smithi045.stdout: -2132> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 5 AuthRegistry(0x7fff4d61d4d0) adding auth protocol: cephx 2023-10-03T19:21:28.255 INFO:teuthology.orchestra.run.smithi045.stdout: -2131> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 5 AuthRegistry(0x7fff4d61d4d0) adding auth protocol: cephx 2023-10-03T19:21:28.255 INFO:teuthology.orchestra.run.smithi045.stdout: -2130> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 5 AuthRegistry(0x7fff4d61d4d0) adding auth protocol: cephx 2023-10-03T19:21:28.255 INFO:teuthology.orchestra.run.smithi045.stdout: -2129> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 5 AuthRegistry(0x7fff4d61d4d0) adding con mode: secure 2023-10-03T19:21:28.255 INFO:teuthology.orchestra.run.smithi045.stdout: -2128> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 5 AuthRegistry(0x7fff4d61d4d0) adding con mode: crc 2023-10-03T19:21:28.255 INFO:teuthology.orchestra.run.smithi045.stdout: -2127> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 5 AuthRegistry(0x7fff4d61d4d0) adding con mode: secure 2023-10-03T19:21:28.255 INFO:teuthology.orchestra.run.smithi045.stdout: -2126> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 5 AuthRegistry(0x7fff4d61d4d0) adding con mode: crc 2023-10-03T19:21:28.256 INFO:teuthology.orchestra.run.smithi045.stdout: -2125> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 5 AuthRegistry(0x7fff4d61d4d0) adding con mode: secure 2023-10-03T19:21:28.256 INFO:teuthology.orchestra.run.smithi045.stdout: -2124> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 5 AuthRegistry(0x7fff4d61d4d0) adding con mode: crc 2023-10-03T19:21:28.256 INFO:teuthology.orchestra.run.smithi045.stdout: -2123> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 5 AuthRegistry(0x7fff4d61d4d0) adding con mode: crc 2023-10-03T19:21:28.256 INFO:teuthology.orchestra.run.smithi045.stdout: -2122> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 5 AuthRegistry(0x7fff4d61d4d0) adding con mode: secure 2023-10-03T19:21:28.256 INFO:teuthology.orchestra.run.smithi045.stdout: -2121> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 5 AuthRegistry(0x7fff4d61d4d0) adding con mode: crc 2023-10-03T19:21:28.256 INFO:teuthology.orchestra.run.smithi045.stdout: -2120> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 5 AuthRegistry(0x7fff4d61d4d0) adding con mode: secure 2023-10-03T19:21:28.256 INFO:teuthology.orchestra.run.smithi045.stdout: -2119> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 5 AuthRegistry(0x7fff4d61d4d0) adding con mode: crc 2023-10-03T19:21:28.256 INFO:teuthology.orchestra.run.smithi045.stdout: -2118> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 5 AuthRegistry(0x7fff4d61d4d0) adding con mode: secure 2023-10-03T19:21:28.256 INFO:teuthology.orchestra.run.smithi045.stdout: -2117> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 2 auth: KeyRing::load: loaded key file /var/lib/ceph/mds/ceph-a/keyring 2023-10-03T19:21:28.256 INFO:teuthology.orchestra.run.smithi045.stdout: -2116> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 2 auth: KeyRing::load: loaded key file /var/lib/ceph/mds/ceph-a/keyring 2023-10-03T19:21:28.256 INFO:teuthology.orchestra.run.smithi045.stdout: -2115> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command rotate-key hook 0x7fff4d61d618 2023-10-03T19:21:28.256 INFO:teuthology.orchestra.run.smithi045.stdout: -2114> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 10 monclient: _reopen_session rank -1 2023-10-03T19:21:28.256 INFO:teuthology.orchestra.run.smithi045.stdout: -2113> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 10 monclient: _add_conns ranks=[0,4,3,2,1] 2023-10-03T19:21:28.257 INFO:teuthology.orchestra.run.smithi045.stdout: -2112> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 10 monclient(hunting): picked mon.noname-a-legacy con 0x55c504afb000 addr v1:172.21.15.45:6789/0 2023-10-03T19:21:28.257 INFO:teuthology.orchestra.run.smithi045.stdout: -2111> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 1 --2- >> v2:172.21.15.79:3300/0 conn(0x55c504afb400 0x55c504b86580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:28.257 INFO:teuthology.orchestra.run.smithi045.stdout: -2110> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 10 monclient(hunting): picked mon.noname-b con 0x55c504afb400 addr v2:172.21.15.79:3300/0 2023-10-03T19:21:28.257 INFO:teuthology.orchestra.run.smithi045.stdout: -2109> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55c504afb800 0x55c504b86b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:28.257 INFO:teuthology.orchestra.run.smithi045.stdout: -2108> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 10 monclient(hunting): picked mon.noname-a con 0x55c504afb800 addr v2:172.21.15.45:3300/0 2023-10-03T19:21:28.257 INFO:teuthology.orchestra.run.smithi045.stdout: -2107> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c504b57800 con 0x55c504afb000 2023-10-03T19:21:28.257 INFO:teuthology.orchestra.run.smithi045.stdout: -2106> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 10 monclient(hunting): start opening mon connection 2023-10-03T19:21:28.257 INFO:teuthology.orchestra.run.smithi045.stdout: -2105> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c504b41400 con 0x55c504afb800 2023-10-03T19:21:28.257 INFO:teuthology.orchestra.run.smithi045.stdout: -2104> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 10 monclient(hunting): start opening mon connection 2023-10-03T19:21:28.257 INFO:teuthology.orchestra.run.smithi045.stdout: -2103> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c504b41e00 con 0x55c504afb400 2023-10-03T19:21:28.257 INFO:teuthology.orchestra.run.smithi045.stdout: -2102> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 10 monclient(hunting): _renew_subs 2023-10-03T19:21:28.257 INFO:teuthology.orchestra.run.smithi045.stdout: -2101> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 10 monclient(hunting): authenticate will time out at 1557.312507s 2023-10-03T19:21:28.258 INFO:teuthology.orchestra.run.smithi045.stdout: -2100> 2023-10-03T19:20:10.920+0000 7f04fc52e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55c504afb800 0x55c504b86b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:28.258 INFO:teuthology.orchestra.run.smithi045.stdout: -2099> 2023-10-03T19:20:10.920+0000 7f04fbd2d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55c504afb000 0x55c505874800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43410/0 (socket says 172.21.15.45:43410) 2023-10-03T19:21:28.258 INFO:teuthology.orchestra.run.smithi045.stdout: -2098> 2023-10-03T19:20:10.920+0000 7f04fbd2d640 1 -- 172.21.15.45:0/519832885 learned_addr learned my addr 172.21.15.45:0/519832885 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:21:28.258 INFO:teuthology.orchestra.run.smithi045.stdout: -2097> 2023-10-03T19:20:10.920+0000 7f04fc52e640 10 monclient(hunting): get_auth_request con 0x55c504afb800 auth_method 0 2023-10-03T19:21:28.258 INFO:teuthology.orchestra.run.smithi045.stdout: -2096> 2023-10-03T19:20:10.920+0000 7f04fc52e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-03T19:21:28.258 INFO:teuthology.orchestra.run.smithi045.stdout: -2095> 2023-10-03T19:20:10.920+0000 7f04fc52e640 10 monclient(hunting): _init_auth method 2 2023-10-03T19:21:28.258 INFO:teuthology.orchestra.run.smithi045.stdout: -2094> 2023-10-03T19:20:10.920+0000 7f04fc52e640 10 monclient(hunting): _init_auth creating new auth 2023-10-03T19:21:28.258 INFO:teuthology.orchestra.run.smithi045.stdout: -2093> 2023-10-03T19:20:10.920+0000 7f04fc52e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-03T19:21:28.258 INFO:teuthology.orchestra.run.smithi045.stdout: -2092> 2023-10-03T19:20:10.920+0000 7f04fc52e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-03T19:21:28.258 INFO:teuthology.orchestra.run.smithi045.stdout: -2091> 2023-10-03T19:20:10.920+0000 7f04fc52e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-03T19:21:28.258 INFO:teuthology.orchestra.run.smithi045.stdout: -2090> 2023-10-03T19:20:10.920+0000 7f04fb52c640 1 --2- 172.21.15.45:0/519832885 >> v2:172.21.15.79:3300/0 conn(0x55c504afb400 0x55c504b86580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:28.259 INFO:teuthology.orchestra.run.smithi045.stdout: -2089> 2023-10-03T19:20:10.920+0000 7f04fb52c640 10 monclient(hunting): get_auth_request con 0x55c504afb400 auth_method 0 2023-10-03T19:21:28.259 INFO:teuthology.orchestra.run.smithi045.stdout: -2088> 2023-10-03T19:20:10.920+0000 7f04fb52c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-03T19:21:28.259 INFO:teuthology.orchestra.run.smithi045.stdout: -2087> 2023-10-03T19:20:10.920+0000 7f04fb52c640 10 monclient(hunting): _init_auth method 2 2023-10-03T19:21:28.259 INFO:teuthology.orchestra.run.smithi045.stdout: -2086> 2023-10-03T19:20:10.920+0000 7f04fb52c640 10 monclient(hunting): _init_auth creating new auth 2023-10-03T19:21:28.259 INFO:teuthology.orchestra.run.smithi045.stdout: -2085> 2023-10-03T19:20:10.920+0000 7f04fc52e640 10 monclient(hunting): handle_auth_done global_id 7590 payload 274 2023-10-03T19:21:28.259 INFO:teuthology.orchestra.run.smithi045.stdout: -2084> 2023-10-03T19:20:10.920+0000 7f04fc52e640 1 -- 172.21.15.45:0/519832885 >> v2:172.21.15.79:3300/0 conn(0x55c504afb400 msgr2=0x55c504b86580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:28.259 INFO:teuthology.orchestra.run.smithi045.stdout: -2083> 2023-10-03T19:20:10.920+0000 7f04fc52e640 1 --2- 172.21.15.45:0/519832885 >> v2:172.21.15.79:3300/0 conn(0x55c504afb400 0x55c504b86580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:28.259 INFO:teuthology.orchestra.run.smithi045.stdout: -2082> 2023-10-03T19:20:10.920+0000 7f04fc52e640 1 -- 172.21.15.45:0/519832885 >> v1:172.21.15.45:6789/0 conn(0x55c504afb000 legacy=0x55c505874800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:28.259 INFO:teuthology.orchestra.run.smithi045.stdout: -2081> 2023-10-03T19:20:10.920+0000 7f04fc52e640 10 monclient: _finish_hunting 0 2023-10-03T19:21:28.259 INFO:teuthology.orchestra.run.smithi045.stdout: -2080> 2023-10-03T19:20:10.920+0000 7f04fc52e640 1 monclient: found mon.noname-a 2023-10-03T19:21:28.259 INFO:teuthology.orchestra.run.smithi045.stdout: -2079> 2023-10-03T19:20:10.920+0000 7f04fc52e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.260 INFO:teuthology.orchestra.run.smithi045.stdout: -2078> 2023-10-03T19:20:10.920+0000 7f04fc52e640 1 -- 172.21.15.45:0/519832885 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c504b31520 con 0x55c504afb800 2023-10-03T19:21:28.260 INFO:teuthology.orchestra.run.smithi045.stdout: -2077> 2023-10-03T19:20:10.920+0000 7f04fad2b640 1 -- 172.21.15.45:0/519832885 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3455316685 0 0) 0x55c504b31380 con 0x55c504afb000 2023-10-03T19:21:28.260 INFO:teuthology.orchestra.run.smithi045.stdout: -2076> 2023-10-03T19:20:10.920+0000 7f04fad2b640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2023-10-03T19:21:28.260 INFO:teuthology.orchestra.run.smithi045.stdout: -2075> 2023-10-03T19:20:10.920+0000 7f04fc52e640 1 --2- 172.21.15.45:0/519832885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c504afb800 0x55c504b86b00 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x55c504bc48a0 tx=0x55c50587ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=196135c994a0046e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:28.260 INFO:teuthology.orchestra.run.smithi045.stdout: -2074> 2023-10-03T19:20:10.920+0000 7f04fad2b640 1 -- 172.21.15.45:0/519832885 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c504b5f600 con 0x55c504afb800 2023-10-03T19:21:28.260 INFO:teuthology.orchestra.run.smithi045.stdout: -2073> 2023-10-03T19:20:10.920+0000 7f04fad2b640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-03T19:21:28.260 INFO:teuthology.orchestra.run.smithi045.stdout: -2072> 2023-10-03T19:20:10.920+0000 7f04fad2b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-10-03T19:21:28.260 INFO:teuthology.orchestra.run.smithi045.stdout: -2071> 2023-10-03T19:20:10.920+0000 7f04fad2b640 10 monclient: dump: 2023-10-03T19:21:28.260 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 1 2023-10-03T19:21:28.260 INFO:teuthology.orchestra.run.smithi045.stdout:fsid 58400977-12ba-4c73-bb3e-1589b2492669 2023-10-03T19:21:28.260 INFO:teuthology.orchestra.run.smithi045.stdout:last_changed 2023-10-03T19:11:32.553177+0000 2023-10-03T19:21:28.261 INFO:teuthology.orchestra.run.smithi045.stdout:created 2023-10-03T19:11:32.553177+0000 2023-10-03T19:21:28.261 INFO:teuthology.orchestra.run.smithi045.stdout:min_mon_release 18 (reef) 2023-10-03T19:21:28.261 INFO:teuthology.orchestra.run.smithi045.stdout:election_strategy: 1 2023-10-03T19:21:28.261 INFO:teuthology.orchestra.run.smithi045.stdout:0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2023-10-03T19:21:28.261 INFO:teuthology.orchestra.run.smithi045.stdout:1: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.b 2023-10-03T19:21:28.261 INFO:teuthology.orchestra.run.smithi045.stdout:2: [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] mon.c 2023-10-03T19:21:28.261 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:21:28.261 INFO:teuthology.orchestra.run.smithi045.stdout: -2070> 2023-10-03T19:20:10.920+0000 7f04fad2b640 10 monclient: _finish_auth 0 2023-10-03T19:21:28.261 INFO:teuthology.orchestra.run.smithi045.stdout: -2069> 2023-10-03T19:20:10.920+0000 7f04fad2b640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.261 INFO:teuthology.orchestra.run.smithi045.stdout: -2068> 2023-10-03T19:20:10.920+0000 7f04fad2b640 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2023-10-03T19:19:40.925663+0000) 2023-10-03T19:21:28.261 INFO:teuthology.orchestra.run.smithi045.stdout: -2067> 2023-10-03T19:20:10.920+0000 7f04fad2b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.261 INFO:teuthology.orchestra.run.smithi045.stdout: -2066> 2023-10-03T19:20:10.920+0000 7f04fad2b640 1 -- 172.21.15.45:0/519832885 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- auth(proto 2 2 bytes epoch 0) v1 -- 0x55c504b57c80 con 0x55c504afb800 2023-10-03T19:21:28.288 INFO:teuthology.orchestra.run.smithi045.stdout: -2065> 2023-10-03T19:20:10.920+0000 7f04fad2b640 1 -- 172.21.15.45:0/519832885 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c504b57980 con 0x55c504afb800 2023-10-03T19:21:28.288 INFO:teuthology.orchestra.run.smithi045.stdout: -2064> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 5 monclient: authenticate success, global_id 7590 2023-10-03T19:21:28.288 INFO:teuthology.orchestra.run.smithi045.stdout: -2063> 2023-10-03T19:20:10.920+0000 7f04fad2b640 10 monclient: handle_config config(0 keys) v1 2023-10-03T19:21:28.289 INFO:teuthology.orchestra.run.smithi045.stdout: -2062> 2023-10-03T19:20:10.920+0000 7f04fad2b640 1 -- 172.21.15.45:0/519832885 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c504b5f1e0 con 0x55c504afb800 2023-10-03T19:21:28.289 INFO:teuthology.orchestra.run.smithi045.stdout: -2061> 2023-10-03T19:20:10.920+0000 7f04fad2b640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-03T19:21:28.289 INFO:teuthology.orchestra.run.smithi045.stdout: -2060> 2023-10-03T19:20:10.920+0000 7f04fad2b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-10-03T19:21:28.289 INFO:teuthology.orchestra.run.smithi045.stdout: -2059> 2023-10-03T19:20:10.920+0000 7f04fad2b640 10 monclient: dump: 2023-10-03T19:21:28.289 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 1 2023-10-03T19:21:28.289 INFO:teuthology.orchestra.run.smithi045.stdout:fsid 58400977-12ba-4c73-bb3e-1589b2492669 2023-10-03T19:21:28.289 INFO:teuthology.orchestra.run.smithi045.stdout:last_changed 2023-10-03T19:11:32.553177+0000 2023-10-03T19:21:28.289 INFO:teuthology.orchestra.run.smithi045.stdout:created 2023-10-03T19:11:32.553177+0000 2023-10-03T19:21:28.289 INFO:teuthology.orchestra.run.smithi045.stdout:min_mon_release 18 (reef) 2023-10-03T19:21:28.289 INFO:teuthology.orchestra.run.smithi045.stdout:election_strategy: 1 2023-10-03T19:21:28.289 INFO:teuthology.orchestra.run.smithi045.stdout:0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2023-10-03T19:21:28.289 INFO:teuthology.orchestra.run.smithi045.stdout:1: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.b 2023-10-03T19:21:28.290 INFO:teuthology.orchestra.run.smithi045.stdout:2: [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] mon.c 2023-10-03T19:21:28.290 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:21:28.290 INFO:teuthology.orchestra.run.smithi045.stdout: -2058> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 10 monclient: get_monmap_and_config success 2023-10-03T19:21:28.290 INFO:teuthology.orchestra.run.smithi045.stdout: -2057> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 4 set_mon_vals no callback set 2023-10-03T19:21:28.290 INFO:teuthology.orchestra.run.smithi045.stdout: -2056> 2023-10-03T19:20:10.920+0000 7f04fad2b640 1 -- 172.21.15.45:0/519832885 <== mon.0 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c504b31520 con 0x55c504afb800 2023-10-03T19:21:28.290 INFO:teuthology.orchestra.run.smithi045.stdout: -2055> 2023-10-03T19:20:10.920+0000 7f04fad2b640 10 monclient: _finish_auth 0 2023-10-03T19:21:28.290 INFO:teuthology.orchestra.run.smithi045.stdout: -2054> 2023-10-03T19:20:10.920+0000 7f04fad2b640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.290 INFO:teuthology.orchestra.run.smithi045.stdout: -2053> 2023-10-03T19:20:10.920+0000 7f04fad2b640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:40.925870+0000) 2023-10-03T19:21:28.290 INFO:teuthology.orchestra.run.smithi045.stdout: -2052> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 10 monclient: shutdown 2023-10-03T19:21:28.290 INFO:teuthology.orchestra.run.smithi045.stdout: -2051> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 5 asok(0x55c504b82000) unregister_commands rotate-key 2023-10-03T19:21:28.290 INFO:teuthology.orchestra.run.smithi045.stdout: -2050> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 1 -- 172.21.15.45:0/519832885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c504afb800 msgr2=0x55c504b86b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:28.291 INFO:teuthology.orchestra.run.smithi045.stdout: -2049> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 1 --2- 172.21.15.45:0/519832885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c504afb800 0x55c504b86b00 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x55c504bc48a0 tx=0x55c50587ce40 comp rx=0 tx=0).stop 2023-10-03T19:21:28.291 INFO:teuthology.orchestra.run.smithi045.stdout: -2048> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 1 -- 172.21.15.45:0/519832885 shutdown_connections 2023-10-03T19:21:28.291 INFO:teuthology.orchestra.run.smithi045.stdout: -2047> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 1 --2- 172.21.15.45:0/519832885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c504afb800 0x55c504b86b00 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:28.291 INFO:teuthology.orchestra.run.smithi045.stdout: -2046> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 1 --2- 172.21.15.45:0/519832885 >> v2:172.21.15.79:3300/0 conn(0x55c504afb400 0x55c504b86580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:28.291 INFO:teuthology.orchestra.run.smithi045.stdout: -2045> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 1 -- 172.21.15.45:0/519832885 >> 172.21.15.45:0/519832885 conn(0x55c504afac00 msgr2=0x55c505874000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:28.291 INFO:teuthology.orchestra.run.smithi045.stdout: -2044> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 1 -- 172.21.15.45:0/519832885 shutdown_connections 2023-10-03T19:21:28.291 INFO:teuthology.orchestra.run.smithi045.stdout: -2043> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 1 -- 172.21.15.45:0/519832885 wait complete. 2023-10-03T19:21:28.291 INFO:teuthology.orchestra.run.smithi045.stdout: -2042> 2023-10-03T19:20:10.920+0000 7f04fd56cac0 0 ceph version 18.0.0-3908-g05a43c8f (05a43c8fb3988914c879a50970f9054a098e0612) reef (dev), process ceph-mds, pid 54317 2023-10-03T19:21:28.291 INFO:teuthology.orchestra.run.smithi045.stdout: -2041> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 1 main not setting numa affinity 2023-10-03T19:21:28.291 INFO:teuthology.orchestra.run.smithi045.stdout: -2040> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) init /var/run/ceph/ceph-mds.a.asok 2023-10-03T19:21:28.291 INFO:teuthology.orchestra.run.smithi045.stdout: -2039> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) bind_and_listen /var/run/ceph/ceph-mds.a.asok 2023-10-03T19:21:28.291 INFO:teuthology.orchestra.run.smithi045.stdout: -2038> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command 0 hook 0x55c504b4f4b0 2023-10-03T19:21:28.292 INFO:teuthology.orchestra.run.smithi045.stdout: -2037> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command version hook 0x55c504b4f4b0 2023-10-03T19:21:28.292 INFO:teuthology.orchestra.run.smithi045.stdout: -2036> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command git_version hook 0x55c504b4f4b0 2023-10-03T19:21:28.292 INFO:teuthology.orchestra.run.smithi045.stdout: -2035> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command help hook 0x55c504ad8b20 2023-10-03T19:21:28.292 INFO:teuthology.orchestra.run.smithi045.stdout: -2034> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command get_command_descriptions hook 0x55c504ad8b30 2023-10-03T19:21:28.292 INFO:teuthology.orchestra.run.smithi045.stdout: -2033> 2023-10-03T19:20:10.924+0000 7f04fad2b640 5 asok(0x55c504b82000) entry start 2023-10-03T19:21:28.292 INFO:teuthology.orchestra.run.smithi045.stdout: -2032> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 AuthRegistry(0x55c504b23340) adding auth protocol: cephx 2023-10-03T19:21:28.292 INFO:teuthology.orchestra.run.smithi045.stdout: -2031> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 AuthRegistry(0x55c504b23340) adding auth protocol: cephx 2023-10-03T19:21:28.292 INFO:teuthology.orchestra.run.smithi045.stdout: -2030> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 AuthRegistry(0x55c504b23340) adding auth protocol: cephx 2023-10-03T19:21:28.292 INFO:teuthology.orchestra.run.smithi045.stdout: -2029> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 AuthRegistry(0x55c504b23340) adding con mode: secure 2023-10-03T19:21:28.292 INFO:teuthology.orchestra.run.smithi045.stdout: -2028> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 AuthRegistry(0x55c504b23340) adding con mode: crc 2023-10-03T19:21:28.292 INFO:teuthology.orchestra.run.smithi045.stdout: -2027> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 AuthRegistry(0x55c504b23340) adding con mode: secure 2023-10-03T19:21:28.293 INFO:teuthology.orchestra.run.smithi045.stdout: -2026> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 AuthRegistry(0x55c504b23340) adding con mode: crc 2023-10-03T19:21:28.293 INFO:teuthology.orchestra.run.smithi045.stdout: -2025> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 AuthRegistry(0x55c504b23340) adding con mode: secure 2023-10-03T19:21:28.293 INFO:teuthology.orchestra.run.smithi045.stdout: -2024> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 AuthRegistry(0x55c504b23340) adding con mode: crc 2023-10-03T19:21:28.293 INFO:teuthology.orchestra.run.smithi045.stdout: -2023> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 AuthRegistry(0x55c504b23340) adding con mode: crc 2023-10-03T19:21:28.293 INFO:teuthology.orchestra.run.smithi045.stdout: -2022> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 AuthRegistry(0x55c504b23340) adding con mode: secure 2023-10-03T19:21:28.293 INFO:teuthology.orchestra.run.smithi045.stdout: -2021> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 AuthRegistry(0x55c504b23340) adding con mode: crc 2023-10-03T19:21:28.293 INFO:teuthology.orchestra.run.smithi045.stdout: -2020> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 AuthRegistry(0x55c504b23340) adding con mode: secure 2023-10-03T19:21:28.293 INFO:teuthology.orchestra.run.smithi045.stdout: -2019> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 AuthRegistry(0x55c504b23340) adding con mode: crc 2023-10-03T19:21:28.293 INFO:teuthology.orchestra.run.smithi045.stdout: -2018> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 AuthRegistry(0x55c504b23340) adding con mode: secure 2023-10-03T19:21:28.293 INFO:teuthology.orchestra.run.smithi045.stdout: -2017> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 2 auth: KeyRing::load: loaded key file /var/lib/ceph/mds/ceph-a/keyring 2023-10-03T19:21:28.293 INFO:teuthology.orchestra.run.smithi045.stdout: -2016> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 1 -- [v2:0.0.0.0:6834/1723126563,v1:0.0.0.0:6835/1723126563] _finish_bind bind my_addrs is [v2:0.0.0.0:6834/1723126563,v1:0.0.0.0:6835/1723126563] 2023-10-03T19:21:28.293 INFO:teuthology.orchestra.run.smithi045.stdout: -2015> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 monclient: build_initial_monmap 2023-10-03T19:21:28.293 INFO:teuthology.orchestra.run.smithi045.stdout: -2014> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 1 build_initial for_mkfs: 0 2023-10-03T19:21:28.294 INFO:teuthology.orchestra.run.smithi045.stdout: -2013> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 monclient: monmap: 2023-10-03T19:21:28.294 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 0 2023-10-03T19:21:28.294 INFO:teuthology.orchestra.run.smithi045.stdout:fsid 00000000-0000-0000-0000-000000000000 2023-10-03T19:21:28.294 INFO:teuthology.orchestra.run.smithi045.stdout:last_changed 0.000000 2023-10-03T19:21:28.294 INFO:teuthology.orchestra.run.smithi045.stdout:created 0.000000 2023-10-03T19:21:28.294 INFO:teuthology.orchestra.run.smithi045.stdout:min_mon_release 0 (unknown) 2023-10-03T19:21:28.294 INFO:teuthology.orchestra.run.smithi045.stdout:election_strategy: 1 2023-10-03T19:21:28.294 INFO:teuthology.orchestra.run.smithi045.stdout:0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.noname-a 2023-10-03T19:21:28.294 INFO:teuthology.orchestra.run.smithi045.stdout:1: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.noname-b 2023-10-03T19:21:28.294 INFO:teuthology.orchestra.run.smithi045.stdout:2: [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] mon.noname-c 2023-10-03T19:21:28.294 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:21:28.294 INFO:teuthology.orchestra.run.smithi045.stdout: -2012> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 1 -- [v2:0.0.0.0:6834/1723126563,v1:0.0.0.0:6835/1723126563] start start 2023-10-03T19:21:28.295 INFO:teuthology.orchestra.run.smithi045.stdout: -2011> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 mds.a Dumping misc struct sizes: 2023-10-03T19:21:28.295 INFO:teuthology.orchestra.run.smithi045.stdout: -2010> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 mds.a 96 MDSCacheObject 2023-10-03T19:21:28.295 INFO:teuthology.orchestra.run.smithi045.stdout: -2009> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 mds.a 1328 CInode 2023-10-03T19:21:28.295 INFO:teuthology.orchestra.run.smithi045.stdout: -2008> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 mds.a 16 elist<>::item 2023-10-03T19:21:28.295 INFO:teuthology.orchestra.run.smithi045.stdout: -2007> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 mds.a 632 inode 2023-10-03T19:21:28.295 INFO:teuthology.orchestra.run.smithi045.stdout: -2006> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 mds.a 704 old_inode 2023-10-03T19:21:28.295 INFO:teuthology.orchestra.run.smithi045.stdout: -2005> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 mds.a 48 nest_info_t 2023-10-03T19:21:28.295 INFO:teuthology.orchestra.run.smithi045.stdout: -2004> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 mds.a 40 frag_info_t 2023-10-03T19:21:28.295 INFO:teuthology.orchestra.run.smithi045.stdout: -2003> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 mds.a 40 SimpleLock 2023-10-03T19:21:28.295 INFO:teuthology.orchestra.run.smithi045.stdout: -2002> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 mds.a 48 ScatterLock 2023-10-03T19:21:28.295 INFO:teuthology.orchestra.run.smithi045.stdout: -2001> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 mds.a 616 CDentry 2023-10-03T19:21:28.296 INFO:teuthology.orchestra.run.smithi045.stdout: -2000> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 mds.a 16 elist<>::item 2023-10-03T19:21:28.296 INFO:teuthology.orchestra.run.smithi045.stdout: -1999> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 mds.a 40 SimpleLock 2023-10-03T19:21:28.296 INFO:teuthology.orchestra.run.smithi045.stdout: -1998> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 mds.a 1088 CDir 2023-10-03T19:21:28.296 INFO:teuthology.orchestra.run.smithi045.stdout: -1997> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 mds.a 16 elist<>::item 2023-10-03T19:21:28.296 INFO:teuthology.orchestra.run.smithi045.stdout: -1996> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 mds.a 232 fnode_t 2023-10-03T19:21:28.296 INFO:teuthology.orchestra.run.smithi045.stdout: -1995> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 mds.a 48 nest_info_t 2023-10-03T19:21:28.296 INFO:teuthology.orchestra.run.smithi045.stdout: -1994> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 mds.a 40 frag_info_t 2023-10-03T19:21:28.296 INFO:teuthology.orchestra.run.smithi045.stdout: -1993> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 mds.a 320 Capability 2023-10-03T19:21:28.296 INFO:teuthology.orchestra.run.smithi045.stdout: -1992> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 mds.a 32 xlist<>::item 2023-10-03T19:21:28.296 INFO:teuthology.orchestra.run.smithi045.stdout: -1991> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 1 Processor -- start 2023-10-03T19:21:28.296 INFO:teuthology.orchestra.run.smithi045.stdout: -1990> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 monclient: init 2023-10-03T19:21:28.296 INFO:teuthology.orchestra.run.smithi045.stdout: -1989> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 AuthRegistry(0x7fff4d61e860) adding auth protocol: cephx 2023-10-03T19:21:28.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1988> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 AuthRegistry(0x7fff4d61e860) adding auth protocol: cephx 2023-10-03T19:21:28.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1987> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 AuthRegistry(0x7fff4d61e860) adding auth protocol: cephx 2023-10-03T19:21:28.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1986> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 AuthRegistry(0x7fff4d61e860) adding con mode: secure 2023-10-03T19:21:28.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1985> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 AuthRegistry(0x7fff4d61e860) adding con mode: crc 2023-10-03T19:21:28.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1984> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 AuthRegistry(0x7fff4d61e860) adding con mode: secure 2023-10-03T19:21:28.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1983> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 AuthRegistry(0x7fff4d61e860) adding con mode: crc 2023-10-03T19:21:28.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1982> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 AuthRegistry(0x7fff4d61e860) adding con mode: secure 2023-10-03T19:21:28.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1981> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 AuthRegistry(0x7fff4d61e860) adding con mode: crc 2023-10-03T19:21:28.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1980> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 AuthRegistry(0x7fff4d61e860) adding con mode: crc 2023-10-03T19:21:28.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1979> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 AuthRegistry(0x7fff4d61e860) adding con mode: secure 2023-10-03T19:21:28.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1978> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 AuthRegistry(0x7fff4d61e860) adding con mode: crc 2023-10-03T19:21:28.297 INFO:teuthology.orchestra.run.smithi045.stdout: -1977> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 AuthRegistry(0x7fff4d61e860) adding con mode: secure 2023-10-03T19:21:28.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1976> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 AuthRegistry(0x7fff4d61e860) adding con mode: crc 2023-10-03T19:21:28.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1975> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 AuthRegistry(0x7fff4d61e860) adding con mode: secure 2023-10-03T19:21:28.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1974> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 2 auth: KeyRing::load: loaded key file /var/lib/ceph/mds/ceph-a/keyring 2023-10-03T19:21:28.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1973> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 2 auth: KeyRing::load: loaded key file /var/lib/ceph/mds/ceph-a/keyring 2023-10-03T19:21:28.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1972> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command rotate-key hook 0x7fff4d61e9a8 2023-10-03T19:21:28.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1971> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 monclient: _reopen_session rank -1 2023-10-03T19:21:28.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1970> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 monclient: _add_conns ranks=[1,0,2] 2023-10-03T19:21:28.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1969> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 1 --2- [v2:0.0.0.0:6834/1723126563,v1:0.0.0.0:6835/1723126563] >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c504afb800 0x55c504b86580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:28.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1968> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 monclient(hunting): picked mon.noname-b con 0x55c504afb800 addr [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] 2023-10-03T19:21:28.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1967> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 1 --2- [v2:0.0.0.0:6834/1723126563,v1:0.0.0.0:6835/1723126563] >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c504afb400 0x55c504b86b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:28.298 INFO:teuthology.orchestra.run.smithi045.stdout: -1966> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 monclient(hunting): picked mon.noname-a con 0x55c504afb400 addr [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] 2023-10-03T19:21:28.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1965> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 1 --2- [v2:0.0.0.0:6834/1723126563,v1:0.0.0.0:6835/1723126563] >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c504afb000 0x55c504b87080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:28.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1964> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 monclient(hunting): picked mon.noname-c con 0x55c504afb000 addr [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] 2023-10-03T19:21:28.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1963> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 monclient(hunting): start opening mon connection 2023-10-03T19:21:28.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1962> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 1 -- [v2:0.0.0.0:6834/1723126563,v1:0.0.0.0:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c504b41e00 con 0x55c504afb400 2023-10-03T19:21:28.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1961> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 monclient(hunting): start opening mon connection 2023-10-03T19:21:28.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1960> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 1 -- [v2:0.0.0.0:6834/1723126563,v1:0.0.0.0:6835/1723126563] --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c504b41cc0 con 0x55c504afb800 2023-10-03T19:21:28.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1959> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 monclient(hunting): start opening mon connection 2023-10-03T19:21:28.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1958> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 1 -- [v2:0.0.0.0:6834/1723126563,v1:0.0.0.0:6835/1723126563] --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c504b40a00 con 0x55c504afb000 2023-10-03T19:21:28.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1957> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 monclient(hunting): _renew_subs 2023-10-03T19:21:28.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1956> 2023-10-03T19:20:10.924+0000 7f04fb52c640 1 --2- [v2:0.0.0.0:6834/1723126563,v1:0.0.0.0:6835/1723126563] >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c504afb400 0x55c504b86b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:28.299 INFO:teuthology.orchestra.run.smithi045.stdout: -1955> 2023-10-03T19:20:10.924+0000 7f04fb52c640 1 --2- [v2:0.0.0.0:6834/1723126563,v1:0.0.0.0:6835/1723126563] >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c504afb400 0x55c504b86b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58454/0 (socket says 172.21.15.45:58454) 2023-10-03T19:21:28.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1954> 2023-10-03T19:20:10.924+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] learned_addr learned my addr [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:28.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1953> 2023-10-03T19:20:10.924+0000 7f04fb52c640 10 monclient(hunting): get_auth_request con 0x55c504afb400 auth_method 0 2023-10-03T19:21:28.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1952> 2023-10-03T19:20:10.924+0000 7f04fb52c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-03T19:21:28.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1951> 2023-10-03T19:20:10.924+0000 7f04fb52c640 10 monclient(hunting): _init_auth method 2 2023-10-03T19:21:28.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1950> 2023-10-03T19:20:10.924+0000 7f04fb52c640 10 monclient(hunting): _init_auth creating new auth 2023-10-03T19:21:28.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1949> 2023-10-03T19:20:10.924+0000 7f04fbd2d640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c504afb800 0x55c504b86580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:28.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1948> 2023-10-03T19:20:10.924+0000 7f04fc52e640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c504afb000 0x55c504b87080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:28.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1947> 2023-10-03T19:20:10.924+0000 7f04fbd2d640 10 monclient(hunting): get_auth_request con 0x55c504afb800 auth_method 0 2023-10-03T19:21:28.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1946> 2023-10-03T19:20:10.924+0000 7f04fbd2d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-03T19:21:28.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1945> 2023-10-03T19:20:10.924+0000 7f04fbd2d640 10 monclient(hunting): _init_auth method 2 2023-10-03T19:21:28.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1944> 2023-10-03T19:20:10.924+0000 7f04fbd2d640 10 monclient(hunting): _init_auth creating new auth 2023-10-03T19:21:28.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1943> 2023-10-03T19:20:10.924+0000 7f04fc52e640 10 monclient(hunting): get_auth_request con 0x55c504afb000 auth_method 0 2023-10-03T19:21:28.300 INFO:teuthology.orchestra.run.smithi045.stdout: -1942> 2023-10-03T19:20:10.924+0000 7f04fc52e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-03T19:21:28.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1941> 2023-10-03T19:20:10.924+0000 7f04fc52e640 10 monclient(hunting): _init_auth method 2 2023-10-03T19:21:28.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1940> 2023-10-03T19:20:10.924+0000 7f04fc52e640 10 monclient(hunting): _init_auth creating new auth 2023-10-03T19:21:28.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1939> 2023-10-03T19:20:10.924+0000 7f04fb52c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-03T19:21:28.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1938> 2023-10-03T19:20:10.924+0000 7f04fb52c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-03T19:21:28.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1937> 2023-10-03T19:20:10.924+0000 7f04fb52c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-03T19:21:28.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1936> 2023-10-03T19:20:10.924+0000 7f04fc52e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-03T19:21:28.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1935> 2023-10-03T19:20:10.924+0000 7f04fc52e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-03T19:21:28.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1934> 2023-10-03T19:20:10.924+0000 7f04fc52e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-03T19:21:28.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1933> 2023-10-03T19:20:10.924+0000 7f04fbd2d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-03T19:21:28.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1932> 2023-10-03T19:20:10.924+0000 7f04fbd2d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-03T19:21:28.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1931> 2023-10-03T19:20:10.924+0000 7f04fbd2d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-03T19:21:28.301 INFO:teuthology.orchestra.run.smithi045.stdout: -1930> 2023-10-03T19:20:10.924+0000 7f04fb52c640 10 monclient(hunting): handle_auth_done global_id 7602 payload 1011 2023-10-03T19:21:28.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1929> 2023-10-03T19:20:10.924+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c504afb000 msgr2=0x55c504b87080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:28.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1928> 2023-10-03T19:20:10.924+0000 7f04fb52c640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55c504afb000 0x55c504b87080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:28.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1927> 2023-10-03T19:20:10.924+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c504afb800 msgr2=0x55c504b86580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:28.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1926> 2023-10-03T19:20:10.924+0000 7f04fb52c640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c504afb800 0x55c504b86580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:28.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1925> 2023-10-03T19:20:10.924+0000 7f04fb52c640 10 monclient: _finish_hunting 0 2023-10-03T19:21:28.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1924> 2023-10-03T19:20:10.924+0000 7f04fb52c640 1 monclient: found mon.noname-a 2023-10-03T19:21:28.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1923> 2023-10-03T19:20:10.924+0000 7f04fb52c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1922> 2023-10-03T19:20:10.924+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c504b316c0 con 0x55c504afb400 2023-10-03T19:21:28.302 INFO:teuthology.orchestra.run.smithi045.stdout: -1921> 2023-10-03T19:20:10.924+0000 7f04fb52c640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c504afb400 0x55c504b86b00 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x55c504b600c0 tx=0x55c50587d2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:28.303 INFO:teuthology.orchestra.run.smithi045.stdout: -1920> 2023-10-03T19:20:10.924+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c504b5f600 con 0x55c504afb400 2023-10-03T19:21:28.303 INFO:teuthology.orchestra.run.smithi045.stdout: -1919> 2023-10-03T19:20:10.924+0000 7f04f8d27640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-03T19:21:28.303 INFO:teuthology.orchestra.run.smithi045.stdout: -1918> 2023-10-03T19:20:10.924+0000 7f04f8d27640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-10-03T19:21:28.303 INFO:teuthology.orchestra.run.smithi045.stdout: -1917> 2023-10-03T19:20:10.924+0000 7f04f8d27640 10 monclient: dump: 2023-10-03T19:21:28.303 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 1 2023-10-03T19:21:28.303 INFO:teuthology.orchestra.run.smithi045.stdout:fsid 58400977-12ba-4c73-bb3e-1589b2492669 2023-10-03T19:21:28.303 INFO:teuthology.orchestra.run.smithi045.stdout:last_changed 2023-10-03T19:11:32.553177+0000 2023-10-03T19:21:28.303 INFO:teuthology.orchestra.run.smithi045.stdout:created 2023-10-03T19:11:32.553177+0000 2023-10-03T19:21:28.303 INFO:teuthology.orchestra.run.smithi045.stdout:min_mon_release 18 (reef) 2023-10-03T19:21:28.303 INFO:teuthology.orchestra.run.smithi045.stdout:election_strategy: 1 2023-10-03T19:21:28.303 INFO:teuthology.orchestra.run.smithi045.stdout:0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2023-10-03T19:21:28.303 INFO:teuthology.orchestra.run.smithi045.stdout:1: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.b 2023-10-03T19:21:28.304 INFO:teuthology.orchestra.run.smithi045.stdout:2: [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] mon.c 2023-10-03T19:21:28.304 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:21:28.304 INFO:teuthology.orchestra.run.smithi045.stdout: -1916> 2023-10-03T19:20:10.924+0000 7f04f8d27640 10 monclient: _finish_auth 0 2023-10-03T19:21:28.304 INFO:teuthology.orchestra.run.smithi045.stdout: -1915> 2023-10-03T19:20:10.924+0000 7f04f8d27640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.304 INFO:teuthology.orchestra.run.smithi045.stdout: -1914> 2023-10-03T19:20:10.924+0000 7f04f8d27640 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2023-10-03T19:19:40.929720+0000) 2023-10-03T19:21:28.304 INFO:teuthology.orchestra.run.smithi045.stdout: -1913> 2023-10-03T19:20:10.924+0000 7f04f8d27640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.304 INFO:teuthology.orchestra.run.smithi045.stdout: -1912> 2023-10-03T19:20:10.924+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- auth(proto 2 2 bytes epoch 0) v1 -- 0x55c505932000 con 0x55c504afb400 2023-10-03T19:21:28.304 INFO:teuthology.orchestra.run.smithi045.stdout: -1911> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 monclient: authenticate success, global_id 7602 2023-10-03T19:21:28.304 INFO:teuthology.orchestra.run.smithi045.stdout: -1910> 2023-10-03T19:20:10.924+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c504b57e00 con 0x55c504afb400 2023-10-03T19:21:28.304 INFO:teuthology.orchestra.run.smithi045.stdout: -1909> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 monclient: wait_auth_rotating waiting for 30 2023-10-03T19:21:28.304 INFO:teuthology.orchestra.run.smithi045.stdout: -1908> 2023-10-03T19:20:10.924+0000 7f04f8d27640 10 monclient: handle_config config(0 keys) v1 2023-10-03T19:21:28.305 INFO:teuthology.orchestra.run.smithi045.stdout: -1907> 2023-10-03T19:20:10.924+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c504b5f1e0 con 0x55c504afb400 2023-10-03T19:21:28.305 INFO:teuthology.orchestra.run.smithi045.stdout: -1906> 2023-10-03T19:20:10.924+0000 7f04f8d27640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-03T19:21:28.305 INFO:teuthology.orchestra.run.smithi045.stdout: -1905> 2023-10-03T19:20:10.924+0000 7f04f9d29640 4 set_mon_vals no callback set 2023-10-03T19:21:28.305 INFO:teuthology.orchestra.run.smithi045.stdout: -1904> 2023-10-03T19:20:10.924+0000 7f04f8d27640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-10-03T19:21:28.305 INFO:teuthology.orchestra.run.smithi045.stdout: -1903> 2023-10-03T19:20:10.924+0000 7f04f8d27640 10 monclient: dump: 2023-10-03T19:21:28.305 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 1 2023-10-03T19:21:28.305 INFO:teuthology.orchestra.run.smithi045.stdout:fsid 58400977-12ba-4c73-bb3e-1589b2492669 2023-10-03T19:21:28.305 INFO:teuthology.orchestra.run.smithi045.stdout:last_changed 2023-10-03T19:11:32.553177+0000 2023-10-03T19:21:28.305 INFO:teuthology.orchestra.run.smithi045.stdout:created 2023-10-03T19:11:32.553177+0000 2023-10-03T19:21:28.305 INFO:teuthology.orchestra.run.smithi045.stdout:min_mon_release 18 (reef) 2023-10-03T19:21:28.305 INFO:teuthology.orchestra.run.smithi045.stdout:election_strategy: 1 2023-10-03T19:21:28.305 INFO:teuthology.orchestra.run.smithi045.stdout:0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2023-10-03T19:21:28.306 INFO:teuthology.orchestra.run.smithi045.stdout:1: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.b 2023-10-03T19:21:28.306 INFO:teuthology.orchestra.run.smithi045.stdout:2: [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] mon.c 2023-10-03T19:21:28.306 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:21:28.306 INFO:teuthology.orchestra.run.smithi045.stdout: -1902> 2023-10-03T19:20:10.924+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c504b316c0 con 0x55c504afb400 2023-10-03T19:21:28.306 INFO:teuthology.orchestra.run.smithi045.stdout: -1901> 2023-10-03T19:20:10.924+0000 7f04f8d27640 10 monclient: _finish_auth 0 2023-10-03T19:21:28.306 INFO:teuthology.orchestra.run.smithi045.stdout: -1900> 2023-10-03T19:20:10.924+0000 7f04f8d27640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.306 INFO:teuthology.orchestra.run.smithi045.stdout: -1899> 2023-10-03T19:20:10.924+0000 7f04f8d27640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:40.929932+0000) 2023-10-03T19:21:28.339 INFO:teuthology.orchestra.run.smithi045.stdout: -1898> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 monclient: wait_auth_rotating done 2023-10-03T19:21:28.339 INFO:teuthology.orchestra.run.smithi045.stdout: -1897> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 monclient: _renew_subs 2023-10-03T19:21:28.339 INFO:teuthology.orchestra.run.smithi045.stdout: -1896> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.339 INFO:teuthology.orchestra.run.smithi045.stdout: -1895> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mdsmap=0+}) v3 -- 0x55c504b30d00 con 0x55c504afb400 2023-10-03T19:21:28.340 INFO:teuthology.orchestra.run.smithi045.stdout: -1894> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command status hook 0x55c5058c72a0 2023-10-03T19:21:28.340 INFO:teuthology.orchestra.run.smithi045.stdout: -1893> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command dump_ops_in_flight hook 0x55c5058c72a0 2023-10-03T19:21:28.340 INFO:teuthology.orchestra.run.smithi045.stdout: -1892> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command ops hook 0x55c5058c72a0 2023-10-03T19:21:28.340 INFO:teuthology.orchestra.run.smithi045.stdout: -1891> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command dump_blocked_ops hook 0x55c5058c72a0 2023-10-03T19:21:28.340 INFO:teuthology.orchestra.run.smithi045.stdout: -1890> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command dump_blocked_ops_count hook 0x55c5058c72a0 2023-10-03T19:21:28.340 INFO:teuthology.orchestra.run.smithi045.stdout: -1889> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command dump_historic_ops hook 0x55c5058c72a0 2023-10-03T19:21:28.340 INFO:teuthology.orchestra.run.smithi045.stdout: -1888> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command dump_historic_ops_by_duration hook 0x55c5058c72a0 2023-10-03T19:21:28.340 INFO:teuthology.orchestra.run.smithi045.stdout: -1887> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command scrub_path hook 0x55c5058c72a0 2023-10-03T19:21:28.340 INFO:teuthology.orchestra.run.smithi045.stdout: -1886> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command scrub start hook 0x55c5058c72a0 2023-10-03T19:21:28.340 INFO:teuthology.orchestra.run.smithi045.stdout: -1885> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command scrub abort hook 0x55c5058c72a0 2023-10-03T19:21:28.340 INFO:teuthology.orchestra.run.smithi045.stdout: -1884> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command scrub pause hook 0x55c5058c72a0 2023-10-03T19:21:28.341 INFO:teuthology.orchestra.run.smithi045.stdout: -1883> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command scrub resume hook 0x55c5058c72a0 2023-10-03T19:21:28.341 INFO:teuthology.orchestra.run.smithi045.stdout: -1882> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command scrub status hook 0x55c5058c72a0 2023-10-03T19:21:28.341 INFO:teuthology.orchestra.run.smithi045.stdout: -1881> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command tag path hook 0x55c5058c72a0 2023-10-03T19:21:28.341 INFO:teuthology.orchestra.run.smithi045.stdout: -1880> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command flush_path hook 0x55c5058c72a0 2023-10-03T19:21:28.341 INFO:teuthology.orchestra.run.smithi045.stdout: -1879> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command export dir hook 0x55c5058c72a0 2023-10-03T19:21:28.341 INFO:teuthology.orchestra.run.smithi045.stdout: -1878> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command dump cache hook 0x55c5058c72a0 2023-10-03T19:21:28.341 INFO:teuthology.orchestra.run.smithi045.stdout: -1877> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command cache drop hook 0x55c5058c72a0 2023-10-03T19:21:28.341 INFO:teuthology.orchestra.run.smithi045.stdout: -1876> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command cache status hook 0x55c5058c72a0 2023-10-03T19:21:28.341 INFO:teuthology.orchestra.run.smithi045.stdout: -1875> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command dump tree hook 0x55c5058c72a0 2023-10-03T19:21:28.341 INFO:teuthology.orchestra.run.smithi045.stdout: -1874> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command dump loads hook 0x55c5058c72a0 2023-10-03T19:21:28.341 INFO:teuthology.orchestra.run.smithi045.stdout: -1873> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command dump snaps hook 0x55c5058c72a0 2023-10-03T19:21:28.341 INFO:teuthology.orchestra.run.smithi045.stdout: -1872> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command session ls hook 0x55c5058c72a0 2023-10-03T19:21:28.342 INFO:teuthology.orchestra.run.smithi045.stdout: -1871> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command client ls hook 0x55c5058c72a0 2023-10-03T19:21:28.342 INFO:teuthology.orchestra.run.smithi045.stdout: -1870> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command session evict hook 0x55c5058c72a0 2023-10-03T19:21:28.342 INFO:teuthology.orchestra.run.smithi045.stdout: -1869> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command client evict hook 0x55c5058c72a0 2023-10-03T19:21:28.342 INFO:teuthology.orchestra.run.smithi045.stdout: -1868> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command session kill hook 0x55c5058c72a0 2023-10-03T19:21:28.342 INFO:teuthology.orchestra.run.smithi045.stdout: -1867> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command session ls hook 0x55c5058c72a0 2023-10-03T19:21:28.342 INFO:teuthology.orchestra.run.smithi045.stdout: -1866> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command session config hook 0x55c5058c72a0 2023-10-03T19:21:28.342 INFO:teuthology.orchestra.run.smithi045.stdout: -1865> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command client config hook 0x55c5058c72a0 2023-10-03T19:21:28.342 INFO:teuthology.orchestra.run.smithi045.stdout: -1864> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command damage ls hook 0x55c5058c72a0 2023-10-03T19:21:28.342 INFO:teuthology.orchestra.run.smithi045.stdout: -1863> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command damage rm hook 0x55c5058c72a0 2023-10-03T19:21:28.342 INFO:teuthology.orchestra.run.smithi045.stdout: -1862> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command osdmap barrier hook 0x55c5058c72a0 2023-10-03T19:21:28.342 INFO:teuthology.orchestra.run.smithi045.stdout: -1861> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command flush journal hook 0x55c5058c72a0 2023-10-03T19:21:28.342 INFO:teuthology.orchestra.run.smithi045.stdout: -1860> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command force_readonly hook 0x55c5058c72a0 2023-10-03T19:21:28.343 INFO:teuthology.orchestra.run.smithi045.stdout: -1859> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command get subtrees hook 0x55c5058c72a0 2023-10-03T19:21:28.343 INFO:teuthology.orchestra.run.smithi045.stdout: -1858> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command dirfrag split hook 0x55c5058c72a0 2023-10-03T19:21:28.343 INFO:teuthology.orchestra.run.smithi045.stdout: -1857> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command dirfrag merge hook 0x55c5058c72a0 2023-10-03T19:21:28.343 INFO:teuthology.orchestra.run.smithi045.stdout: -1856> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command dirfrag ls hook 0x55c5058c72a0 2023-10-03T19:21:28.343 INFO:teuthology.orchestra.run.smithi045.stdout: -1855> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command openfiles ls hook 0x55c5058c72a0 2023-10-03T19:21:28.343 INFO:teuthology.orchestra.run.smithi045.stdout: -1854> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command dump inode hook 0x55c5058c72a0 2023-10-03T19:21:28.343 INFO:teuthology.orchestra.run.smithi045.stdout: -1853> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command dump dir hook 0x55c5058c72a0 2023-10-03T19:21:28.343 INFO:teuthology.orchestra.run.smithi045.stdout: -1852> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command exit hook 0x55c5058c72a0 2023-10-03T19:21:28.343 INFO:teuthology.orchestra.run.smithi045.stdout: -1851> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command respawn hook 0x55c5058c72a0 2023-10-03T19:21:28.343 INFO:teuthology.orchestra.run.smithi045.stdout: -1850> 2023-10-03T19:20:10.924+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 5 ==== mdsmap(e 52) v2 ==== 225+0+0 (secure 0 0 0) 0x55c504b30d00 con 0x55c504afb400 2023-10-03T19:21:28.343 INFO:teuthology.orchestra.run.smithi045.stdout: -1849> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command heap hook 0x55c5058c72a0 2023-10-03T19:21:28.344 INFO:teuthology.orchestra.run.smithi045.stdout: -1848> 2023-10-03T19:20:10.924+0000 7f04f8d27640 1 mds.a Updating MDS map to version 52 from mon.0 2023-10-03T19:21:28.344 INFO:teuthology.orchestra.run.smithi045.stdout: -1847> 2023-10-03T19:20:10.924+0000 7f04fd56cac0 5 asok(0x55c504b82000) register_command cpu_profiler hook 0x55c5058c72a0 2023-10-03T19:21:28.344 INFO:teuthology.orchestra.run.smithi045.stdout: -1846> 2023-10-03T19:20:10.924+0000 7f04f8d27640 10 mds.a my compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-03T19:21:28.344 INFO:teuthology.orchestra.run.smithi045.stdout: -1845> 2023-10-03T19:20:10.924+0000 7f04f8d27640 10 mds.a mdsmap compat compat={},rocompat={},incompat={7=mds uses inline data} 2023-10-03T19:21:28.344 INFO:teuthology.orchestra.run.smithi045.stdout: -1844> 2023-10-03T19:20:10.924+0000 7f04f8d27640 10 mds.a my gid is 7602 2023-10-03T19:21:28.344 INFO:teuthology.orchestra.run.smithi045.stdout: -1843> 2023-10-03T19:20:10.924+0000 7f04f8d27640 10 mds.a map says I am mds.-1.-1 state null 2023-10-03T19:21:28.344 INFO:teuthology.orchestra.run.smithi045.stdout: -1842> 2023-10-03T19:20:10.924+0000 7f04f8d27640 10 mds.a msgr says I am [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] 2023-10-03T19:21:28.344 INFO:teuthology.orchestra.run.smithi045.stdout: -1841> 2023-10-03T19:20:10.924+0000 7f04f8d27640 10 mds.a handle_mds_map: handling map in rankless mode 2023-10-03T19:21:28.344 INFO:teuthology.orchestra.run.smithi045.stdout: -1840> 2023-10-03T19:20:10.924+0000 7f04f8d27640 10 mds.a not in map yet 2023-10-03T19:21:28.344 INFO:teuthology.orchestra.run.smithi045.stdout: -1839> 2023-10-03T19:20:10.924+0000 7f04f6d23640 5 mds.beacon.a Sending beacon up:boot seq 1 2023-10-03T19:21:28.344 INFO:teuthology.orchestra.run.smithi045.stdout: -1838> 2023-10-03T19:20:10.928+0000 7f04f6d23640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.344 INFO:teuthology.orchestra.run.smithi045.stdout: -1837> 2023-10-03T19:20:10.928+0000 7f04f6d23640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mdsbeacon(7602/a up:boot seq=1 v52) v8 -- 0x55c504bc7080 con 0x55c504afb400 2023-10-03T19:21:28.345 INFO:teuthology.orchestra.run.smithi045.stdout: -1836> 2023-10-03T19:20:10.928+0000 7f04f6d23640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:28.345 INFO:teuthology.orchestra.run.smithi045.stdout: -1835> 2023-10-03T19:20:11.880+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 6 ==== mdsmap(e 53) v2 ==== 746+0+0 (secure 0 0 0) 0x55c504b316c0 con 0x55c504afb400 2023-10-03T19:21:28.345 INFO:teuthology.orchestra.run.smithi045.stdout: -1834> 2023-10-03T19:20:11.880+0000 7f04f8d27640 1 mds.a Updating MDS map to version 53 from mon.0 2023-10-03T19:21:28.345 INFO:teuthology.orchestra.run.smithi045.stdout: -1833> 2023-10-03T19:20:11.880+0000 7f04f8d27640 10 mds.a my compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-03T19:21:28.345 INFO:teuthology.orchestra.run.smithi045.stdout: -1832> 2023-10-03T19:20:11.880+0000 7f04f8d27640 10 mds.a mdsmap compat compat={},rocompat={},incompat={7=mds uses inline data} 2023-10-03T19:21:28.345 INFO:teuthology.orchestra.run.smithi045.stdout: -1831> 2023-10-03T19:20:11.880+0000 7f04f8d27640 10 mds.a my gid is 7602 2023-10-03T19:21:28.345 INFO:teuthology.orchestra.run.smithi045.stdout: -1830> 2023-10-03T19:20:11.880+0000 7f04f8d27640 10 mds.a map says I am mds.-1.0 state up:standby 2023-10-03T19:21:28.345 INFO:teuthology.orchestra.run.smithi045.stdout: -1829> 2023-10-03T19:20:11.880+0000 7f04f8d27640 10 mds.a msgr says I am [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] 2023-10-03T19:21:28.345 INFO:teuthology.orchestra.run.smithi045.stdout: -1828> 2023-10-03T19:20:11.880+0000 7f04f8d27640 10 monclient: _renew_subs 2023-10-03T19:21:28.345 INFO:teuthology.orchestra.run.smithi045.stdout: -1827> 2023-10-03T19:20:11.880+0000 7f04f8d27640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.345 INFO:teuthology.orchestra.run.smithi045.stdout: -1826> 2023-10-03T19:20:11.880+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c504b30d00 con 0x55c504afb400 2023-10-03T19:21:28.346 INFO:teuthology.orchestra.run.smithi045.stdout: -1825> 2023-10-03T19:20:11.880+0000 7f04f8d27640 10 mds.a handle_mds_map: handling map in rankless mode 2023-10-03T19:21:28.346 INFO:teuthology.orchestra.run.smithi045.stdout: -1824> 2023-10-03T19:20:11.880+0000 7f04f8d27640 1 mds.a Monitors have assigned me to become a standby. 2023-10-03T19:21:28.346 INFO:teuthology.orchestra.run.smithi045.stdout: -1823> 2023-10-03T19:20:11.880+0000 7f04f8d27640 5 mds.beacon.a set_want_state: up:boot -> up:standby 2023-10-03T19:21:28.346 INFO:teuthology.orchestra.run.smithi045.stdout: -1822> 2023-10-03T19:20:11.884+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 7 ==== mdsbeacon(7602/a up:boot seq=1 v53) v8 ==== 134+0+0 (secure 0 0 0) 0x55c504bc7080 con 0x55c504afb400 2023-10-03T19:21:28.346 INFO:teuthology.orchestra.run.smithi045.stdout: -1821> 2023-10-03T19:20:11.884+0000 7f04fb52c640 5 mds.beacon.a received beacon reply up:boot seq 1 rtt 0.959986 2023-10-03T19:21:28.346 INFO:teuthology.orchestra.run.smithi045.stdout: -1820> 2023-10-03T19:20:11.884+0000 7f04f6d23640 20 mds.beacon.a sender thread waiting interval 3.04001s 2023-10-03T19:21:28.346 INFO:teuthology.orchestra.run.smithi045.stdout: -1819> 2023-10-03T19:20:11.888+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 8 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x55c504bc7080 con 0x55c504afb400 2023-10-03T19:21:28.346 INFO:teuthology.orchestra.run.smithi045.stdout: -1818> 2023-10-03T19:20:11.888+0000 7f04f8d27640 4 mgrc handle_mgr_map Got map version 5 2023-10-03T19:21:28.346 INFO:teuthology.orchestra.run.smithi045.stdout: -1817> 2023-10-03T19:20:11.888+0000 7f04f8d27640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] 2023-10-03T19:21:28.346 INFO:teuthology.orchestra.run.smithi045.stdout: -1816> 2023-10-03T19:20:11.888+0000 7f04f8d27640 4 mgrc reconnect Starting new session with [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] 2023-10-03T19:21:28.346 INFO:teuthology.orchestra.run.smithi045.stdout: -1815> 2023-10-03T19:20:11.888+0000 7f04f8d27640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x55c505a26000 0x55c504b88100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:28.346 INFO:teuthology.orchestra.run.smithi045.stdout: -1814> 2023-10-03T19:20:11.892+0000 7f04fbd2d640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x55c505a26000 0x55c504b88100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:28.347 INFO:teuthology.orchestra.run.smithi045.stdout: -1813> 2023-10-03T19:20:11.892+0000 7f04fbd2d640 10 monclient: get_auth_request con 0x55c505a26000 auth_method 0 2023-10-03T19:21:28.347 INFO:teuthology.orchestra.run.smithi045.stdout: -1812> 2023-10-03T19:20:11.892+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgropen(unknown.a) v3 -- 0x55c504c6cfc0 con 0x55c505a26000 2023-10-03T19:21:28.347 INFO:teuthology.orchestra.run.smithi045.stdout: -1811> 2023-10-03T19:20:11.892+0000 7f04fbd2d640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x55c505a26000 0x55c504b88100 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x55c504bc58c0 tx=0x55c50594a7e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:28.347 INFO:teuthology.orchestra.run.smithi045.stdout: -1810> 2023-10-03T19:20:11.892+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgrconfigure(period=5, threshold=5) v4 ==== 27+0+0 (secure 0 0 0) 0x55c504b3ac40 con 0x55c505a26000 2023-10-03T19:21:28.347 INFO:teuthology.orchestra.run.smithi045.stdout: -1809> 2023-10-03T19:20:11.892+0000 7f04f8d27640 4 mgrc handle_mgr_configure stats_period=5 2023-10-03T19:21:28.347 INFO:teuthology.orchestra.run.smithi045.stdout: -1808> 2023-10-03T19:20:11.892+0000 7f04f8d27640 4 mgrc handle_mgr_configure updated stats threshold: 5 2023-10-03T19:21:28.347 INFO:teuthology.orchestra.run.smithi045.stdout: -1807> 2023-10-03T19:20:11.892+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgrreport(unknown.a +0-0 packed 6 task_status=0) v9 -- 0x55c504b51180 con 0x55c505a26000 2023-10-03T19:21:28.432 INFO:teuthology.orchestra.run.smithi045.stdout: -1806> 2023-10-03T19:20:13.924+0000 7f04f7d25640 10 monclient: tick 2023-10-03T19:21:28.432 INFO:teuthology.orchestra.run.smithi045.stdout: -1805> 2023-10-03T19:20:13.924+0000 7f04f7d25640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.432 INFO:teuthology.orchestra.run.smithi045.stdout: -1804> 2023-10-03T19:20:13.924+0000 7f04f7d25640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:43.928792+0000) 2023-10-03T19:21:28.432 INFO:teuthology.orchestra.run.smithi045.stdout: -1803> 2023-10-03T19:20:14.924+0000 7f04f7d25640 10 monclient: tick 2023-10-03T19:21:28.432 INFO:teuthology.orchestra.run.smithi045.stdout: -1802> 2023-10-03T19:20:14.924+0000 7f04f7d25640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.432 INFO:teuthology.orchestra.run.smithi045.stdout: -1801> 2023-10-03T19:20:14.924+0000 7f04f7d25640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:44.928893+0000) 2023-10-03T19:21:28.433 INFO:teuthology.orchestra.run.smithi045.stdout: -1800> 2023-10-03T19:20:14.924+0000 7f04f6d23640 5 mds.beacon.a Sending beacon up:standby seq 2 2023-10-03T19:21:28.433 INFO:teuthology.orchestra.run.smithi045.stdout: -1799> 2023-10-03T19:20:14.924+0000 7f04f6d23640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.433 INFO:teuthology.orchestra.run.smithi045.stdout: -1798> 2023-10-03T19:20:14.924+0000 7f04f6d23640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mdsbeacon(7602/a up:standby seq=2 v53) v8 -- 0x55c504bc7340 con 0x55c504afb400 2023-10-03T19:21:28.433 INFO:teuthology.orchestra.run.smithi045.stdout: -1797> 2023-10-03T19:20:14.924+0000 7f04f6d23640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:28.433 INFO:teuthology.orchestra.run.smithi045.stdout: -1796> 2023-10-03T19:20:14.924+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 9 ==== mdsbeacon(7602/a up:standby seq=2 v53) v8 ==== 130+0+0 (secure 0 0 0) 0x55c504bc7340 con 0x55c504afb400 2023-10-03T19:21:28.433 INFO:teuthology.orchestra.run.smithi045.stdout: -1795> 2023-10-03T19:20:14.924+0000 7f04fb52c640 5 mds.beacon.a received beacon reply up:standby seq 2 rtt 0 2023-10-03T19:21:28.433 INFO:teuthology.orchestra.run.smithi045.stdout: -1794> 2023-10-03T19:20:14.924+0000 7f04f6d23640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:28.433 INFO:teuthology.orchestra.run.smithi045.stdout: -1793> 2023-10-03T19:20:15.924+0000 7f04f7d25640 10 monclient: tick 2023-10-03T19:21:28.433 INFO:teuthology.orchestra.run.smithi045.stdout: -1792> 2023-10-03T19:20:15.924+0000 7f04f7d25640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.433 INFO:teuthology.orchestra.run.smithi045.stdout: -1791> 2023-10-03T19:20:15.924+0000 7f04f7d25640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:45.929022+0000) 2023-10-03T19:21:28.433 INFO:teuthology.orchestra.run.smithi045.stdout: -1790> 2023-10-03T19:20:16.300+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 10 ==== mdsmap(e 54) v2 ==== 1100+0+0 (secure 0 0 0) 0x55c5059c3860 con 0x55c504afb400 2023-10-03T19:21:28.434 INFO:teuthology.orchestra.run.smithi045.stdout: -1789> 2023-10-03T19:20:16.300+0000 7f04f8d27640 1 mds.a Updating MDS map to version 54 from mon.0 2023-10-03T19:21:28.434 INFO:teuthology.orchestra.run.smithi045.stdout: -1788> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.a my compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-03T19:21:28.434 INFO:teuthology.orchestra.run.smithi045.stdout: -1787> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.a mdsmap compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-03T19:21:28.434 INFO:teuthology.orchestra.run.smithi045.stdout: -1786> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.a my gid is 7602 2023-10-03T19:21:28.434 INFO:teuthology.orchestra.run.smithi045.stdout: -1785> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.a map says I am mds.0.54 state up:creating 2023-10-03T19:21:28.434 INFO:teuthology.orchestra.run.smithi045.stdout: -1784> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.a msgr says I am [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] 2023-10-03T19:21:28.434 INFO:teuthology.orchestra.run.smithi045.stdout: -1783> 2023-10-03T19:20:16.300+0000 7f04f8d27640 4 mds.0.purge_queue operator(): data pool 18 not found in OSDMap 2023-10-03T19:21:28.434 INFO:teuthology.orchestra.run.smithi045.stdout: -1782> 2023-10-03T19:20:16.300+0000 7f04f8d27640 20 mds.0.0 schedule_update_timer_task 2023-10-03T19:21:28.434 INFO:teuthology.orchestra.run.smithi045.stdout: -1781> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.a handle_mds_map: initializing MDS rank 0 2023-10-03T19:21:28.434 INFO:teuthology.orchestra.run.smithi045.stdout: -1780> 2023-10-03T19:20:16.300+0000 7f04f8d27640 5 asok(0x55c504b82000) register_command objecter_requests hook 0x55c5058c7500 2023-10-03T19:21:28.434 INFO:teuthology.orchestra.run.smithi045.stdout: -1779> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 monclient: _renew_subs 2023-10-03T19:21:28.435 INFO:teuthology.orchestra.run.smithi045.stdout: -1778> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.435 INFO:teuthology.orchestra.run.smithi045.stdout: -1777> 2023-10-03T19:20:16.300+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c505991a00 con 0x55c504afb400 2023-10-03T19:21:28.435 INFO:teuthology.orchestra.run.smithi045.stdout: -1776> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 log_channel(cluster) update_config to_monitors: true to_syslog: false syslog_facility: prio: info to_graylog: false graylog_host: 127.0.0.1 graylog_port: 12201) 2023-10-03T19:21:28.435 INFO:teuthology.orchestra.run.smithi045.stdout: -1775> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.0 update_log_config log_to_monitors true 2023-10-03T19:21:28.435 INFO:teuthology.orchestra.run.smithi045.stdout: -1774> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.0 create_logger 2023-10-03T19:21:28.435 INFO:teuthology.orchestra.run.smithi045.stdout: -1773> 2023-10-03T19:20:16.300+0000 7f04f8d27640 7 mds.0.server operator(): full = 0 epoch = 0 2023-10-03T19:21:28.435 INFO:teuthology.orchestra.run.smithi045.stdout: -1772> 2023-10-03T19:20:16.300+0000 7f04f8d27640 4 mds.0.purge_queue operator(): data pool 18 not found in OSDMap 2023-10-03T19:21:28.435 INFO:teuthology.orchestra.run.smithi045.stdout: -1771> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.server apply_blocklist: killed 0 2023-10-03T19:21:28.435 INFO:teuthology.orchestra.run.smithi045.stdout: -1770> 2023-10-03T19:20:16.300+0000 7f04f8d27640 4 mds.0.0 apply_blocklist: killed 0, blocklisted sessions (0 blocklist entries, 0) 2023-10-03T19:21:28.435 INFO:teuthology.orchestra.run.smithi045.stdout: -1769> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.a handle_mds_map: handling map as rank 0 2023-10-03T19:21:28.435 INFO:teuthology.orchestra.run.smithi045.stdout: -1768> 2023-10-03T19:20:16.300+0000 7f04f8d27640 1 mds.0.54 handle_mds_map i am now mds.0.54 2023-10-03T19:21:28.435 INFO:teuthology.orchestra.run.smithi045.stdout: -1767> 2023-10-03T19:20:16.300+0000 7f04f8d27640 1 mds.0.54 handle_mds_map state change up:standby --> up:creating 2023-10-03T19:21:28.436 INFO:teuthology.orchestra.run.smithi045.stdout: -1766> 2023-10-03T19:20:16.300+0000 7f04f8d27640 5 mds.beacon.a set_want_state: up:standby -> up:creating 2023-10-03T19:21:28.436 INFO:teuthology.orchestra.run.smithi045.stdout: -1765> 2023-10-03T19:20:16.300+0000 7f04f8d27640 3 mds.0.54 boot_create 2023-10-03T19:21:28.436 INFO:teuthology.orchestra.run.smithi045.stdout: -1764> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.54 boot_create creating fresh journal 2023-10-03T19:21:28.436 INFO:teuthology.orchestra.run.smithi045.stdout: -1763> 2023-10-03T19:20:16.300+0000 7f04f8d27640 5 mds.0.log create empty log 2023-10-03T19:21:28.436 INFO:teuthology.orchestra.run.smithi045.stdout: -1762> 2023-10-03T19:20:16.300+0000 7f04f8d27640 1 mds.0.journaler.mdlog(ro) set_writeable 2023-10-03T19:21:28.436 INFO:teuthology.orchestra.run.smithi045.stdout: -1761> 2023-10-03T19:20:16.300+0000 7f04f8d27640 1 mds.0.journaler.mdlog(rw) created blank journal at inode 0x0x200, format=1 2023-10-03T19:21:28.436 INFO:teuthology.orchestra.run.smithi045.stdout: -1760> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.436 INFO:teuthology.orchestra.run.smithi045.stdout: -1759> 2023-10-03T19:20:16.300+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x55c504b5ef20 con 0x55c504afb400 2023-10-03T19:21:28.436 INFO:teuthology.orchestra.run.smithi045.stdout: -1758> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.436 INFO:teuthology.orchestra.run.smithi045.stdout: -1757> 2023-10-03T19:20:16.300+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=2) v1 -- 0x55c504b5f600 con 0x55c504afb400 2023-10-03T19:21:28.436 INFO:teuthology.orchestra.run.smithi045.stdout: -1756> 2023-10-03T19:20:16.300+0000 7f04f8d27640 7 mds.0.log _prepare_new_segment seq 1 2023-10-03T19:21:28.437 INFO:teuthology.orchestra.run.smithi045.stdout: -1755> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache advance_stray to index 1 fragmenting index -1 2023-10-03T19:21:28.437 INFO:teuthology.orchestra.run.smithi045.stdout: -1754> 2023-10-03T19:20:16.300+0000 7f04f8d27640 3 mds.0.54 boot_create creating fresh hierarchy 2023-10-03T19:21:28.437 INFO:teuthology.orchestra.run.smithi045.stdout: -1753> 2023-10-03T19:20:16.300+0000 7f04f8d27640 0 mds.0.cache creating system inode with ino:0x1 2023-10-03T19:21:28.437 INFO:teuthology.orchestra.run.smithi045.stdout: -1752> 2023-10-03T19:20:16.300+0000 7f04f251a640 10 mds.0.log _submit_thread start 2023-10-03T19:21:28.437 INFO:teuthology.orchestra.run.smithi045.stdout: -1751> 2023-10-03T19:20:16.300+0000 7f04f8d27640 7 mds.0.cache adjust_subtree_auth -1,-2 -> 0,-2 on [dir 0x1 / [2,head] auth v=0 cv=0/0 state=1073741824 f() n() hs=0+0,ss=0+0 0x55c504b68d00] 2023-10-03T19:21:28.437 INFO:teuthology.orchestra.run.smithi045.stdout: -1750> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache show_subtrees - no subtrees 2023-10-03T19:21:28.437 INFO:teuthology.orchestra.run.smithi045.stdout: -1749> 2023-10-03T19:20:16.300+0000 7f04f8d27640 7 mds.0.cache current root is [dir 0x1 / [2,head] auth v=0 cv=0/0 state=1073741824 f() n() hs=0+0,ss=0+0 | subtree=1 0x55c504b68d00] 2023-10-03T19:21:28.437 INFO:teuthology.orchestra.run.smithi045.stdout: -1748> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.dir(0x1) setting dir_auth=0,-2 from -1,-2 on [dir 0x1 / [2,head] auth v=0 cv=0/0 state=1073741824 f() n() hs=0+0,ss=0+0 | subtree=1 0x55c504b68d00] 2023-10-03T19:21:28.437 INFO:teuthology.orchestra.run.smithi045.stdout: -1747> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.dir(0x1) new subtree root, adjusting auth_pins 2023-10-03T19:21:28.437 INFO:teuthology.orchestra.run.smithi045.stdout: -1746> 2023-10-03T19:20:16.300+0000 7f04f8d27640 15 mds.0.cache show_subtrees 2023-10-03T19:21:28.437 INFO:teuthology.orchestra.run.smithi045.stdout: -1745> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache |__ 0 auth [dir 0x1 / [2,head] auth v=0 cv=0/0 dir_auth=0 state=1073741824 f() n() hs=0+0,ss=0+0 | subtree=1 0x55c504b68d00] 2023-10-03T19:21:28.437 INFO:teuthology.orchestra.run.smithi045.stdout: -1744> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.dir(0x1) pre_dirty 1 2023-10-03T19:21:28.438 INFO:teuthology.orchestra.run.smithi045.stdout: -1743> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.dir(0x1) _mark_dirty (was clean) [dir 0x1 / [2,head] auth v=1 cv=0/0 REP dir_auth=0 state=1073741825|complete f() n() hs=0+0,ss=0+0 | subtree=1 0x55c504b68d00] version 1 2023-10-03T19:21:28.438 INFO:teuthology.orchestra.run.smithi045.stdout: -1742> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.dir(0x1) commit want 0 on [dir 0x1 / [2,head] auth v=1 cv=0/0 REP dir_auth=0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | subtree=1 dirty=1 0x55c504b68d00] 2023-10-03T19:21:28.438 INFO:teuthology.orchestra.run.smithi045.stdout: -1741> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.dir(0x1) auth_pin by 0x55c504b68d00 on [dir 0x1 / [2,head] auth v=1 cv=0/0 REP dir_auth=0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | subtree=1 dirty=1 authpin=1 0x55c504b68d00] count now 1 2023-10-03T19:21:28.438 INFO:teuthology.orchestra.run.smithi045.stdout: -1740> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.dir(0x1) _commit want 1 on [dir 0x1 / [2,head] auth v=1 cv=0/0 REP dir_auth=0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | subtree=1 dirty=1 authpin=1 0x55c504b68d00] 2023-10-03T19:21:28.438 INFO:teuthology.orchestra.run.smithi045.stdout: -1739> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.dir(0x1) marking committing 2023-10-03T19:21:28.438 INFO:teuthology.orchestra.run.smithi045.stdout: -1738> 2023-10-03T19:20:16.300+0000 7f04f8d27640 20 mds.0.bal hit_dir 4 pop is 1, frag * size 0 [pop IRD:[C 0.00e+00] IWR:[C 0.00e+00] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 1.00e+00] *LOAD:4.0] 2023-10-03T19:21:28.438 INFO:teuthology.orchestra.run.smithi045.stdout: -1737> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.dir(0x1) _omap_commit 2023-10-03T19:21:28.438 INFO:teuthology.orchestra.run.smithi045.stdout: -1736> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.snaprealm(0x1 seq 1 0x55c504c6d8c0) build_snap_set on snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:20:16.305990+0000 change_attr 0 0x55c504c6d8c0) 2023-10-03T19:21:28.438 INFO:teuthology.orchestra.run.smithi045.stdout: -1735> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.snaprealm(0x1 seq 1 0x55c504c6d8c0) build_snap_trace my_snaps [] 2023-10-03T19:21:28.438 INFO:teuthology.orchestra.run.smithi045.stdout: -1734> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.snaprealm(0x1 seq 1 0x55c504c6d8c0) check_cache rebuilt seq 1 cached_seq 1 cached_last_created 0 cached_last_destroyed 0) 2023-10-03T19:21:28.438 INFO:teuthology.orchestra.run.smithi045.stdout: -1733> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.ino(0x1) store 1 2023-10-03T19:21:28.439 INFO:teuthology.orchestra.run.smithi045.stdout: -1732> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.snaprealm(0x1 seq 1 0x55c504c6d8c0) get_snaps (seq 1 cached_seq 1) 2023-10-03T19:21:28.439 INFO:teuthology.orchestra.run.smithi045.stdout: -1731> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.ino(0x1) purge_stale_snap_data 2023-10-03T19:21:28.439 INFO:teuthology.orchestra.run.smithi045.stdout: -1730> 2023-10-03T19:20:16.300+0000 7f04f8d27640 20 mds.0.cache.ino(0x1) encode_snap_blob snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:20:16.305990+0000 change_attr 0 0x55c504c6d8c0) 2023-10-03T19:21:28.439 INFO:teuthology.orchestra.run.smithi045.stdout: -1729> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.439 INFO:teuthology.orchestra.run.smithi045.stdout: -1728> 2023-10-03T19:20:16.300+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=3) v1 -- 0x55c504b5f1e0 con 0x55c504afb400 2023-10-03T19:21:28.439 INFO:teuthology.orchestra.run.smithi045.stdout: -1727> 2023-10-03T19:20:16.300+0000 7f04f2d1b640 10 mds.0.cache.dir(0x1) _omap_commit_ops 2023-10-03T19:21:28.439 INFO:teuthology.orchestra.run.smithi045.stdout: -1726> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.ino(0x1) mark_dirty_parent 2023-10-03T19:21:28.439 INFO:teuthology.orchestra.run.smithi045.stdout: -1725> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.ino(0x1) _store_backtrace on [inode 0x1 [...2,head] / auth v1 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 0x55c504b88680] 2023-10-03T19:21:28.439 INFO:teuthology.orchestra.run.smithi045.stdout: -1724> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.ino(0x1) auth_pin by 0x55c504b88680 on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x55c504b88680] now 1 2023-10-03T19:21:28.439 INFO:teuthology.orchestra.run.smithi045.stdout: -1723> 2023-10-03T19:20:16.300+0000 7f04f8d27640 20 mds.0.cache.ino(0x1) _store_backtrace: no dirtypool or no old pools 2023-10-03T19:21:28.439 INFO:teuthology.orchestra.run.smithi045.stdout: -1722> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.ino(0x1) _commit_ops 2023-10-03T19:21:28.440 INFO:teuthology.orchestra.run.smithi045.stdout: -1721> 2023-10-03T19:20:16.300+0000 7f04f2d1b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.440 INFO:teuthology.orchestra.run.smithi045.stdout: -1720> 2023-10-03T19:20:16.300+0000 7f04f2d1b640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=4) v1 -- 0x55c504b5e2c0 con 0x55c504afb400 2023-10-03T19:21:28.440 INFO:teuthology.orchestra.run.smithi045.stdout: -1719> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.440 INFO:teuthology.orchestra.run.smithi045.stdout: -1718> 2023-10-03T19:20:16.300+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=5) v1 -- 0x55c504b5e420 con 0x55c504afb400 2023-10-03T19:21:28.440 INFO:teuthology.orchestra.run.smithi045.stdout: -1717> 2023-10-03T19:20:16.300+0000 7f04f8d27640 3 mds.0.54 boot_create creating mydir hierarchy 2023-10-03T19:21:28.440 INFO:teuthology.orchestra.run.smithi045.stdout: -1716> 2023-10-03T19:20:16.300+0000 7f04f8d27640 0 mds.0.cache creating system inode with ino:0x100 2023-10-03T19:21:28.440 INFO:teuthology.orchestra.run.smithi045.stdout: -1715> 2023-10-03T19:20:16.300+0000 7f04f8d27640 7 mds.0.cache adjust_subtree_auth -1,-2 -> 0,-2 on [dir 0x100 ~mds0/ [2,head] auth v=0 cv=0/0 state=1073741824 f() n() hs=0+0,ss=0+0 0x55c504b69180] 2023-10-03T19:21:28.440 INFO:teuthology.orchestra.run.smithi045.stdout: -1714> 2023-10-03T19:20:16.300+0000 7f04f8d27640 15 mds.0.cache show_subtrees 2023-10-03T19:21:28.440 INFO:teuthology.orchestra.run.smithi045.stdout: -1713> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache |__ 0 auth [dir 0x1 / [2,head] auth v=1 cv=1/0 REP dir_auth=0 ap=1+0 state=1610612769|complete|committing f() n() hs=0+0,ss=0+0 | subtree=1 dirty=1 authpin=1 0x55c504b68d00] 2023-10-03T19:21:28.440 INFO:teuthology.orchestra.run.smithi045.stdout: -1712> 2023-10-03T19:20:16.300+0000 7f04f8d27640 7 mds.0.cache current root is [dir 0x100 ~mds0/ [2,head] auth v=0 cv=0/0 state=1073741824 f() n() hs=0+0,ss=0+0 | subtree=1 0x55c504b69180] 2023-10-03T19:21:28.466 INFO:teuthology.orchestra.run.smithi045.stdout: -1711> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.dir(0x100) setting dir_auth=0,-2 from -1,-2 on [dir 0x100 ~mds0/ [2,head] auth v=0 cv=0/0 state=1073741824 f() n() hs=0+0,ss=0+0 | subtree=1 0x55c504b69180] 2023-10-03T19:21:28.467 INFO:teuthology.orchestra.run.smithi045.stdout: -1710> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.dir(0x100) new subtree root, adjusting auth_pins 2023-10-03T19:21:28.467 INFO:teuthology.orchestra.run.smithi045.stdout: -1709> 2023-10-03T19:20:16.300+0000 7f04f8d27640 15 mds.0.cache show_subtrees 2023-10-03T19:21:28.467 INFO:teuthology.orchestra.run.smithi045.stdout: -1708> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache |__ 0 auth [dir 0x1 / [2,head] auth v=1 cv=1/0 REP dir_auth=0 ap=1+0 state=1610612769|complete|committing f() n() hs=0+0,ss=0+0 | subtree=1 dirty=1 authpin=1 0x55c504b68d00] 2023-10-03T19:21:28.467 INFO:teuthology.orchestra.run.smithi045.stdout: -1707> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache |__ 0 auth [dir 0x100 ~mds0/ [2,head] auth v=0 cv=0/0 dir_auth=0 state=1073741824 f() n() hs=0+0,ss=0+0 | subtree=1 0x55c504b69180] 2023-10-03T19:21:28.467 INFO:teuthology.orchestra.run.smithi045.stdout: -1706> 2023-10-03T19:20:16.300+0000 7f04f8d27640 0 mds.0.cache creating system inode with ino:0x600 2023-10-03T19:21:28.467 INFO:teuthology.orchestra.run.smithi045.stdout: -1705> 2023-10-03T19:20:16.300+0000 7f04f8d27640 20 mds.0.cache.dir(0x100) lookup_exact_snap (head, 'stray0') 2023-10-03T19:21:28.467 INFO:teuthology.orchestra.run.smithi045.stdout: -1704> 2023-10-03T19:20:16.300+0000 7f04f8d27640 12 mds.0.cache.dir(0x100) add_primary_dentry [dentry #0x100/stray0 [2,head] auth (dversion lock) v=0 ino=0x600 state=1073741824 0x55c505878500] 2023-10-03T19:21:28.467 INFO:teuthology.orchestra.run.smithi045.stdout: -1703> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.dir(0x600) pre_dirty 1 2023-10-03T19:21:28.467 INFO:teuthology.orchestra.run.smithi045.stdout: -1702> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.dir(0x600) _mark_dirty (was clean) [dir 0x600 ~mds0/stray0/ [2,head] auth v=1 cv=0/0 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x55c504b69600] version 1 2023-10-03T19:21:28.467 INFO:teuthology.orchestra.run.smithi045.stdout: -1701> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.dir(0x600) commit want 0 on [dir 0x600 ~mds0/stray0/ [2,head] auth v=1 cv=0/0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 0x55c504b69600] 2023-10-03T19:21:28.468 INFO:teuthology.orchestra.run.smithi045.stdout: -1700> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.dir(0x600) auth_pin by 0x55c504b69600 on [dir 0x600 ~mds0/stray0/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c504b69600] count now 1 2023-10-03T19:21:28.468 INFO:teuthology.orchestra.run.smithi045.stdout: -1699> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.dir(0x600) _commit want 1 on [dir 0x600 ~mds0/stray0/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c504b69600] 2023-10-03T19:21:28.468 INFO:teuthology.orchestra.run.smithi045.stdout: -1698> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.dir(0x600) marking committing 2023-10-03T19:21:28.468 INFO:teuthology.orchestra.run.smithi045.stdout: -1697> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.dir(0x600) _omap_commit 2023-10-03T19:21:28.468 INFO:teuthology.orchestra.run.smithi045.stdout: -1696> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.snaprealm(0x100 seq 1 0x55c504c6db00) build_snap_set on snaprealm(0x100 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 0.000000 change_attr 0 0x55c504c6db00) 2023-10-03T19:21:28.468 INFO:teuthology.orchestra.run.smithi045.stdout: -1695> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.snaprealm(0x100 seq 1 0x55c504c6db00) build_snap_trace my_snaps [] 2023-10-03T19:21:28.468 INFO:teuthology.orchestra.run.smithi045.stdout: -1694> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.snaprealm(0x100 seq 1 0x55c504c6db00) check_cache rebuilt seq 1 cached_seq 1 cached_last_created 0 cached_last_destroyed 0) 2023-10-03T19:21:28.468 INFO:teuthology.orchestra.run.smithi045.stdout: -1693> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.ino(0x600) mark_dirty_parent 2023-10-03T19:21:28.468 INFO:teuthology.orchestra.run.smithi045.stdout: -1692> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.ino(0x600) _store_backtrace on [inode 0x600 [...2,head] ~mds0/stray0/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.306261+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 0x55c504b89180] 2023-10-03T19:21:28.468 INFO:teuthology.orchestra.run.smithi045.stdout: -1691> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.ino(0x600) auth_pin by 0x55c504b89180 on [inode 0x600 [...2,head] ~mds0/stray0/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.306261+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x55c504b89180] now 1 2023-10-03T19:21:28.468 INFO:teuthology.orchestra.run.smithi045.stdout: -1690> 2023-10-03T19:20:16.300+0000 7f04f2d1b640 10 mds.0.cache.dir(0x600) _omap_commit_ops 2023-10-03T19:21:28.469 INFO:teuthology.orchestra.run.smithi045.stdout: -1689> 2023-10-03T19:20:16.300+0000 7f04f8d27640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins 1 on [dir 0x100 ~mds0/ [2,head] auth v=0 cv=0/0 dir_auth=0 ap=0+1 state=1073741824 f(v0 1=0+1)/f() n(v0 rc2023-10-03T19:20:16.306261+0000 1=0+1)/n() hs=1+0,ss=0+0 dirty=1 | child=1 subtree=1 0x55c504b69180] by 0x55c504b89180 count now 0/1 2023-10-03T19:21:28.469 INFO:teuthology.orchestra.run.smithi045.stdout: -1688> 2023-10-03T19:20:16.300+0000 7f04f8d27640 20 mds.0.cache.ino(0x600) _store_backtrace: no dirtypool or no old pools 2023-10-03T19:21:28.469 INFO:teuthology.orchestra.run.smithi045.stdout: -1687> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 mds.0.cache.ino(0x600) _commit_ops 2023-10-03T19:21:28.469 INFO:teuthology.orchestra.run.smithi045.stdout: -1686> 2023-10-03T19:20:16.300+0000 7f04f8d27640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.469 INFO:teuthology.orchestra.run.smithi045.stdout: -1685> 2023-10-03T19:20:16.300+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=6) v1 -- 0x55c504b5f600 con 0x55c504afb400 2023-10-03T19:21:28.469 INFO:teuthology.orchestra.run.smithi045.stdout: -1684> 2023-10-03T19:20:16.300+0000 7f04f8d27640 0 mds.0.cache creating system inode with ino:0x601 2023-10-03T19:21:28.469 INFO:teuthology.orchestra.run.smithi045.stdout: -1683> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.469 INFO:teuthology.orchestra.run.smithi045.stdout: -1682> 2023-10-03T19:20:16.304+0000 7f04f8d27640 20 mds.0.cache.dir(0x100) lookup_exact_snap (head, 'stray1') 2023-10-03T19:21:28.469 INFO:teuthology.orchestra.run.smithi045.stdout: -1681> 2023-10-03T19:20:16.304+0000 7f04f8d27640 12 mds.0.cache.dir(0x100) add_primary_dentry [dentry #0x100/stray1 [2,head] auth (dversion lock) v=0 ino=0x601 state=1073741824 0x55c505878780] 2023-10-03T19:21:28.469 INFO:teuthology.orchestra.run.smithi045.stdout: -1680> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=7) v1 -- 0x55c504b5e6e0 con 0x55c504afb400 2023-10-03T19:21:28.469 INFO:teuthology.orchestra.run.smithi045.stdout: -1679> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x601) pre_dirty 1 2023-10-03T19:21:28.470 INFO:teuthology.orchestra.run.smithi045.stdout: -1678> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x601) _mark_dirty (was clean) [dir 0x601 ~mds0/stray1/ [2,head] auth v=1 cv=0/0 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x55c504b69a80] version 1 2023-10-03T19:21:28.470 INFO:teuthology.orchestra.run.smithi045.stdout: -1677> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x601) commit want 0 on [dir 0x601 ~mds0/stray1/ [2,head] auth v=1 cv=0/0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 0x55c504b69a80] 2023-10-03T19:21:28.470 INFO:teuthology.orchestra.run.smithi045.stdout: -1676> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x601) auth_pin by 0x55c504b69a80 on [dir 0x601 ~mds0/stray1/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c504b69a80] count now 1 2023-10-03T19:21:28.470 INFO:teuthology.orchestra.run.smithi045.stdout: -1675> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x601) _commit want 1 on [dir 0x601 ~mds0/stray1/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c504b69a80] 2023-10-03T19:21:28.470 INFO:teuthology.orchestra.run.smithi045.stdout: -1674> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x601) marking committing 2023-10-03T19:21:28.470 INFO:teuthology.orchestra.run.smithi045.stdout: -1673> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x601) _omap_commit 2023-10-03T19:21:28.470 INFO:teuthology.orchestra.run.smithi045.stdout: -1672> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x601) mark_dirty_parent 2023-10-03T19:21:28.470 INFO:teuthology.orchestra.run.smithi045.stdout: -1671> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x601) _store_backtrace on [inode 0x601 [...2,head] ~mds0/stray1/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.306512+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 0x55c504b89700] 2023-10-03T19:21:28.470 INFO:teuthology.orchestra.run.smithi045.stdout: -1670> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x601) auth_pin by 0x55c504b89700 on [inode 0x601 [...2,head] ~mds0/stray1/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.306512+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x55c504b89700] now 1 2023-10-03T19:21:28.470 INFO:teuthology.orchestra.run.smithi045.stdout: -1669> 2023-10-03T19:20:16.304+0000 7f04f8d27640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins 1 on [dir 0x100 ~mds0/ [2,head] auth v=0 cv=0/0 dir_auth=0 ap=0+2 state=1073741824 f(v0 2=0+2)/f() n(v0 rc2023-10-03T19:20:16.306512+0000 2=0+2)/n() hs=2+0,ss=0+0 dirty=2 | child=1 subtree=1 0x55c504b69180] by 0x55c504b89700 count now 0/2 2023-10-03T19:21:28.470 INFO:teuthology.orchestra.run.smithi045.stdout: -1668> 2023-10-03T19:20:16.304+0000 7f04f8d27640 20 mds.0.cache.ino(0x601) _store_backtrace: no dirtypool or no old pools 2023-10-03T19:21:28.471 INFO:teuthology.orchestra.run.smithi045.stdout: -1667> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x601) _commit_ops 2023-10-03T19:21:28.471 INFO:teuthology.orchestra.run.smithi045.stdout: -1666> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.471 INFO:teuthology.orchestra.run.smithi045.stdout: -1665> 2023-10-03T19:20:16.304+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=8) v1 -- 0x55c504b5e2c0 con 0x55c504afb400 2023-10-03T19:21:28.471 INFO:teuthology.orchestra.run.smithi045.stdout: -1664> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 10 mds.0.cache.dir(0x601) _omap_commit_ops 2023-10-03T19:21:28.471 INFO:teuthology.orchestra.run.smithi045.stdout: -1663> 2023-10-03T19:20:16.304+0000 7f04f8d27640 0 mds.0.cache creating system inode with ino:0x602 2023-10-03T19:21:28.471 INFO:teuthology.orchestra.run.smithi045.stdout: -1662> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.471 INFO:teuthology.orchestra.run.smithi045.stdout: -1661> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=9) v1 -- 0x55c504b5e9a0 con 0x55c504afb400 2023-10-03T19:21:28.471 INFO:teuthology.orchestra.run.smithi045.stdout: -1660> 2023-10-03T19:20:16.304+0000 7f04f8d27640 20 mds.0.cache.dir(0x100) lookup_exact_snap (head, 'stray2') 2023-10-03T19:21:28.471 INFO:teuthology.orchestra.run.smithi045.stdout: -1659> 2023-10-03T19:20:16.304+0000 7f04f8d27640 12 mds.0.cache.dir(0x100) add_primary_dentry [dentry #0x100/stray2 [2,head] auth (dversion lock) v=0 ino=0x602 state=1073741824 0x55c505878a00] 2023-10-03T19:21:28.471 INFO:teuthology.orchestra.run.smithi045.stdout: -1658> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x602) pre_dirty 1 2023-10-03T19:21:28.471 INFO:teuthology.orchestra.run.smithi045.stdout: -1657> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x602) _mark_dirty (was clean) [dir 0x602 ~mds0/stray2/ [2,head] auth v=1 cv=0/0 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x55c505aa4000] version 1 2023-10-03T19:21:28.472 INFO:teuthology.orchestra.run.smithi045.stdout: -1656> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x602) commit want 0 on [dir 0x602 ~mds0/stray2/ [2,head] auth v=1 cv=0/0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 0x55c505aa4000] 2023-10-03T19:21:28.472 INFO:teuthology.orchestra.run.smithi045.stdout: -1655> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x602) auth_pin by 0x55c505aa4000 on [dir 0x602 ~mds0/stray2/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa4000] count now 1 2023-10-03T19:21:28.472 INFO:teuthology.orchestra.run.smithi045.stdout: -1654> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x602) _commit want 1 on [dir 0x602 ~mds0/stray2/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa4000] 2023-10-03T19:21:28.472 INFO:teuthology.orchestra.run.smithi045.stdout: -1653> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x602) marking committing 2023-10-03T19:21:28.472 INFO:teuthology.orchestra.run.smithi045.stdout: -1652> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x602) _omap_commit 2023-10-03T19:21:28.472 INFO:teuthology.orchestra.run.smithi045.stdout: -1651> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x602) mark_dirty_parent 2023-10-03T19:21:28.472 INFO:teuthology.orchestra.run.smithi045.stdout: -1650> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x602) _store_backtrace on [inode 0x602 [...2,head] ~mds0/stray2/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.306648+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 0x55c505aa0000] 2023-10-03T19:21:28.472 INFO:teuthology.orchestra.run.smithi045.stdout: -1649> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 10 mds.0.cache.dir(0x602) _omap_commit_ops 2023-10-03T19:21:28.472 INFO:teuthology.orchestra.run.smithi045.stdout: -1648> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x602) auth_pin by 0x55c505aa0000 on [inode 0x602 [...2,head] ~mds0/stray2/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.306648+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x55c505aa0000] now 1 2023-10-03T19:21:28.472 INFO:teuthology.orchestra.run.smithi045.stdout: -1647> 2023-10-03T19:20:16.304+0000 7f04f8d27640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins 1 on [dir 0x100 ~mds0/ [2,head] auth v=0 cv=0/0 dir_auth=0 ap=0+3 state=1073741824 f(v0 3=0+3)/f() n(v0 rc2023-10-03T19:20:16.306648+0000 3=0+3)/n() hs=3+0,ss=0+0 dirty=3 | child=1 subtree=1 0x55c504b69180] by 0x55c505aa0000 count now 0/3 2023-10-03T19:21:28.472 INFO:teuthology.orchestra.run.smithi045.stdout: -1646> 2023-10-03T19:20:16.304+0000 7f04f8d27640 20 mds.0.cache.ino(0x602) _store_backtrace: no dirtypool or no old pools 2023-10-03T19:21:28.473 INFO:teuthology.orchestra.run.smithi045.stdout: -1645> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x602) _commit_ops 2023-10-03T19:21:28.473 INFO:teuthology.orchestra.run.smithi045.stdout: -1644> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.473 INFO:teuthology.orchestra.run.smithi045.stdout: -1643> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=10) v1 -- 0x55c504b5e420 con 0x55c504afb400 2023-10-03T19:21:28.473 INFO:teuthology.orchestra.run.smithi045.stdout: -1642> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.473 INFO:teuthology.orchestra.run.smithi045.stdout: -1641> 2023-10-03T19:20:16.304+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=11) v1 -- 0x55c504b5e9a0 con 0x55c504afb400 2023-10-03T19:21:28.473 INFO:teuthology.orchestra.run.smithi045.stdout: -1640> 2023-10-03T19:20:16.304+0000 7f04f8d27640 0 mds.0.cache creating system inode with ino:0x603 2023-10-03T19:21:28.473 INFO:teuthology.orchestra.run.smithi045.stdout: -1639> 2023-10-03T19:20:16.304+0000 7f04f8d27640 20 mds.0.cache.dir(0x100) lookup_exact_snap (head, 'stray3') 2023-10-03T19:21:28.473 INFO:teuthology.orchestra.run.smithi045.stdout: -1638> 2023-10-03T19:20:16.304+0000 7f04f8d27640 12 mds.0.cache.dir(0x100) add_primary_dentry [dentry #0x100/stray3 [2,head] auth (dversion lock) v=0 ino=0x603 state=1073741824 0x55c505878c80] 2023-10-03T19:21:28.473 INFO:teuthology.orchestra.run.smithi045.stdout: -1637> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x603) pre_dirty 1 2023-10-03T19:21:28.473 INFO:teuthology.orchestra.run.smithi045.stdout: -1636> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x603) _mark_dirty (was clean) [dir 0x603 ~mds0/stray3/ [2,head] auth v=1 cv=0/0 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x55c505aa4480] version 1 2023-10-03T19:21:28.473 INFO:teuthology.orchestra.run.smithi045.stdout: -1635> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x603) commit want 0 on [dir 0x603 ~mds0/stray3/ [2,head] auth v=1 cv=0/0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 0x55c505aa4480] 2023-10-03T19:21:28.474 INFO:teuthology.orchestra.run.smithi045.stdout: -1634> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x603) auth_pin by 0x55c505aa4480 on [dir 0x603 ~mds0/stray3/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa4480] count now 1 2023-10-03T19:21:28.474 INFO:teuthology.orchestra.run.smithi045.stdout: -1633> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x603) _commit want 1 on [dir 0x603 ~mds0/stray3/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa4480] 2023-10-03T19:21:28.474 INFO:teuthology.orchestra.run.smithi045.stdout: -1632> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x603) marking committing 2023-10-03T19:21:28.474 INFO:teuthology.orchestra.run.smithi045.stdout: -1631> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x603) _omap_commit 2023-10-03T19:21:28.474 INFO:teuthology.orchestra.run.smithi045.stdout: -1630> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x603) mark_dirty_parent 2023-10-03T19:21:28.474 INFO:teuthology.orchestra.run.smithi045.stdout: -1629> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 10 mds.0.cache.dir(0x603) _omap_commit_ops 2023-10-03T19:21:28.474 INFO:teuthology.orchestra.run.smithi045.stdout: -1628> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x603) _store_backtrace on [inode 0x603 [...2,head] ~mds0/stray3/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.306751+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 0x55c505aa0580] 2023-10-03T19:21:28.474 INFO:teuthology.orchestra.run.smithi045.stdout: -1627> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x603) auth_pin by 0x55c505aa0580 on [inode 0x603 [...2,head] ~mds0/stray3/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.306751+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x55c505aa0580] now 1 2023-10-03T19:21:28.474 INFO:teuthology.orchestra.run.smithi045.stdout: -1626> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.474 INFO:teuthology.orchestra.run.smithi045.stdout: -1625> 2023-10-03T19:20:16.304+0000 7f04f8d27640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins 1 on [dir 0x100 ~mds0/ [2,head] auth v=0 cv=0/0 dir_auth=0 ap=0+4 state=1073741824 f(v0 4=0+4)/f() n(v0 rc2023-10-03T19:20:16.306751+0000 4=0+4)/n() hs=4+0,ss=0+0 dirty=4 | child=1 subtree=1 0x55c504b69180] by 0x55c505aa0580 count now 0/4 2023-10-03T19:21:28.474 INFO:teuthology.orchestra.run.smithi045.stdout: -1624> 2023-10-03T19:20:16.304+0000 7f04f8d27640 20 mds.0.cache.ino(0x603) _store_backtrace: no dirtypool or no old pools 2023-10-03T19:21:28.475 INFO:teuthology.orchestra.run.smithi045.stdout: -1623> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x603) _commit_ops 2023-10-03T19:21:28.475 INFO:teuthology.orchestra.run.smithi045.stdout: -1622> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=12) v1 -- 0x55c504b5f600 con 0x55c504afb400 2023-10-03T19:21:28.475 INFO:teuthology.orchestra.run.smithi045.stdout: -1621> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.475 INFO:teuthology.orchestra.run.smithi045.stdout: -1620> 2023-10-03T19:20:16.304+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=13) v1 -- 0x55c504b5f760 con 0x55c504afb400 2023-10-03T19:21:28.475 INFO:teuthology.orchestra.run.smithi045.stdout: -1619> 2023-10-03T19:20:16.304+0000 7f04f8d27640 0 mds.0.cache creating system inode with ino:0x604 2023-10-03T19:21:28.475 INFO:teuthology.orchestra.run.smithi045.stdout: -1618> 2023-10-03T19:20:16.304+0000 7f04f8d27640 20 mds.0.cache.dir(0x100) lookup_exact_snap (head, 'stray4') 2023-10-03T19:21:28.475 INFO:teuthology.orchestra.run.smithi045.stdout: -1617> 2023-10-03T19:20:16.304+0000 7f04f8d27640 12 mds.0.cache.dir(0x100) add_primary_dentry [dentry #0x100/stray4 [2,head] auth (dversion lock) v=0 ino=0x604 state=1073741824 0x55c505878f00] 2023-10-03T19:21:28.475 INFO:teuthology.orchestra.run.smithi045.stdout: -1616> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x604) pre_dirty 1 2023-10-03T19:21:28.475 INFO:teuthology.orchestra.run.smithi045.stdout: -1615> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x604) _mark_dirty (was clean) [dir 0x604 ~mds0/stray4/ [2,head] auth v=1 cv=0/0 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x55c505aa4900] version 1 2023-10-03T19:21:28.475 INFO:teuthology.orchestra.run.smithi045.stdout: -1614> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x604) commit want 0 on [dir 0x604 ~mds0/stray4/ [2,head] auth v=1 cv=0/0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 0x55c505aa4900] 2023-10-03T19:21:28.476 INFO:teuthology.orchestra.run.smithi045.stdout: -1613> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x604) auth_pin by 0x55c505aa4900 on [dir 0x604 ~mds0/stray4/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa4900] count now 1 2023-10-03T19:21:28.476 INFO:teuthology.orchestra.run.smithi045.stdout: -1612> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x604) _commit want 1 on [dir 0x604 ~mds0/stray4/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa4900] 2023-10-03T19:21:28.476 INFO:teuthology.orchestra.run.smithi045.stdout: -1611> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x604) marking committing 2023-10-03T19:21:28.476 INFO:teuthology.orchestra.run.smithi045.stdout: -1610> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x604) _omap_commit 2023-10-03T19:21:28.476 INFO:teuthology.orchestra.run.smithi045.stdout: -1609> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x604) mark_dirty_parent 2023-10-03T19:21:28.476 INFO:teuthology.orchestra.run.smithi045.stdout: -1608> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x604) _store_backtrace on [inode 0x604 [...2,head] ~mds0/stray4/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.306831+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 0x55c505aa0b00] 2023-10-03T19:21:28.476 INFO:teuthology.orchestra.run.smithi045.stdout: -1607> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 10 mds.0.cache.dir(0x604) _omap_commit_ops 2023-10-03T19:21:28.476 INFO:teuthology.orchestra.run.smithi045.stdout: -1606> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x604) auth_pin by 0x55c505aa0b00 on [inode 0x604 [...2,head] ~mds0/stray4/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.306831+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x55c505aa0b00] now 1 2023-10-03T19:21:28.476 INFO:teuthology.orchestra.run.smithi045.stdout: -1605> 2023-10-03T19:20:16.304+0000 7f04f8d27640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins 1 on [dir 0x100 ~mds0/ [2,head] auth v=0 cv=0/0 dir_auth=0 ap=0+5 state=1073741824 f(v0 5=0+5)/f() n(v0 rc2023-10-03T19:20:16.306831+0000 5=0+5)/n() hs=5+0,ss=0+0 dirty=5 | child=1 subtree=1 0x55c504b69180] by 0x55c505aa0b00 count now 0/5 2023-10-03T19:21:28.476 INFO:teuthology.orchestra.run.smithi045.stdout: -1604> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.476 INFO:teuthology.orchestra.run.smithi045.stdout: -1603> 2023-10-03T19:20:16.304+0000 7f04f8d27640 20 mds.0.cache.ino(0x604) _store_backtrace: no dirtypool or no old pools 2023-10-03T19:21:28.477 INFO:teuthology.orchestra.run.smithi045.stdout: -1602> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x604) _commit_ops 2023-10-03T19:21:28.477 INFO:teuthology.orchestra.run.smithi045.stdout: -1601> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=14) v1 -- 0x55c504b5e6e0 con 0x55c504afb400 2023-10-03T19:21:28.477 INFO:teuthology.orchestra.run.smithi045.stdout: -1600> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.477 INFO:teuthology.orchestra.run.smithi045.stdout: -1599> 2023-10-03T19:20:16.304+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=15) v1 -- 0x55c504b5fa20 con 0x55c504afb400 2023-10-03T19:21:28.477 INFO:teuthology.orchestra.run.smithi045.stdout: -1598> 2023-10-03T19:20:16.304+0000 7f04f8d27640 0 mds.0.cache creating system inode with ino:0x605 2023-10-03T19:21:28.477 INFO:teuthology.orchestra.run.smithi045.stdout: -1597> 2023-10-03T19:20:16.304+0000 7f04f8d27640 20 mds.0.cache.dir(0x100) lookup_exact_snap (head, 'stray5') 2023-10-03T19:21:28.477 INFO:teuthology.orchestra.run.smithi045.stdout: -1596> 2023-10-03T19:20:16.304+0000 7f04f8d27640 12 mds.0.cache.dir(0x100) add_primary_dentry [dentry #0x100/stray5 [2,head] auth (dversion lock) v=0 ino=0x605 state=1073741824 0x55c505879180] 2023-10-03T19:21:28.477 INFO:teuthology.orchestra.run.smithi045.stdout: -1595> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x605) pre_dirty 1 2023-10-03T19:21:28.477 INFO:teuthology.orchestra.run.smithi045.stdout: -1594> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x605) _mark_dirty (was clean) [dir 0x605 ~mds0/stray5/ [2,head] auth v=1 cv=0/0 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x55c505aa4d80] version 1 2023-10-03T19:21:28.477 INFO:teuthology.orchestra.run.smithi045.stdout: -1593> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x605) commit want 0 on [dir 0x605 ~mds0/stray5/ [2,head] auth v=1 cv=0/0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 0x55c505aa4d80] 2023-10-03T19:21:28.477 INFO:teuthology.orchestra.run.smithi045.stdout: -1592> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x605) auth_pin by 0x55c505aa4d80 on [dir 0x605 ~mds0/stray5/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa4d80] count now 1 2023-10-03T19:21:28.478 INFO:teuthology.orchestra.run.smithi045.stdout: -1591> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x605) _commit want 1 on [dir 0x605 ~mds0/stray5/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa4d80] 2023-10-03T19:21:28.478 INFO:teuthology.orchestra.run.smithi045.stdout: -1590> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x605) marking committing 2023-10-03T19:21:28.478 INFO:teuthology.orchestra.run.smithi045.stdout: -1589> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x605) _omap_commit 2023-10-03T19:21:28.478 INFO:teuthology.orchestra.run.smithi045.stdout: -1588> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x605) mark_dirty_parent 2023-10-03T19:21:28.478 INFO:teuthology.orchestra.run.smithi045.stdout: -1587> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x605) _store_backtrace on [inode 0x605 [...2,head] ~mds0/stray5/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.306901+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 0x55c505aa1080] 2023-10-03T19:21:28.478 INFO:teuthology.orchestra.run.smithi045.stdout: -1586> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 10 mds.0.cache.dir(0x605) _omap_commit_ops 2023-10-03T19:21:28.478 INFO:teuthology.orchestra.run.smithi045.stdout: -1585> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x605) auth_pin by 0x55c505aa1080 on [inode 0x605 [...2,head] ~mds0/stray5/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.306901+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x55c505aa1080] now 1 2023-10-03T19:21:28.478 INFO:teuthology.orchestra.run.smithi045.stdout: -1584> 2023-10-03T19:20:16.304+0000 7f04f8d27640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins 1 on [dir 0x100 ~mds0/ [2,head] auth v=0 cv=0/0 dir_auth=0 ap=0+6 state=1073741824 f(v0 6=0+6)/f() n(v0 rc2023-10-03T19:20:16.306901+0000 6=0+6)/n() hs=6+0,ss=0+0 dirty=6 | child=1 subtree=1 0x55c504b69180] by 0x55c505aa1080 count now 0/6 2023-10-03T19:21:28.478 INFO:teuthology.orchestra.run.smithi045.stdout: -1583> 2023-10-03T19:20:16.304+0000 7f04f8d27640 20 mds.0.cache.ino(0x605) _store_backtrace: no dirtypool or no old pools 2023-10-03T19:21:28.478 INFO:teuthology.orchestra.run.smithi045.stdout: -1582> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x605) _commit_ops 2023-10-03T19:21:28.478 INFO:teuthology.orchestra.run.smithi045.stdout: -1581> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.479 INFO:teuthology.orchestra.run.smithi045.stdout: -1580> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=16) v1 -- 0x55c504b5e420 con 0x55c504afb400 2023-10-03T19:21:28.479 INFO:teuthology.orchestra.run.smithi045.stdout: -1579> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.479 INFO:teuthology.orchestra.run.smithi045.stdout: -1578> 2023-10-03T19:20:16.304+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=17) v1 -- 0x55c504b5fce0 con 0x55c504afb400 2023-10-03T19:21:28.479 INFO:teuthology.orchestra.run.smithi045.stdout: -1577> 2023-10-03T19:20:16.304+0000 7f04f8d27640 0 mds.0.cache creating system inode with ino:0x606 2023-10-03T19:21:28.479 INFO:teuthology.orchestra.run.smithi045.stdout: -1576> 2023-10-03T19:20:16.304+0000 7f04f8d27640 20 mds.0.cache.dir(0x100) lookup_exact_snap (head, 'stray6') 2023-10-03T19:21:28.479 INFO:teuthology.orchestra.run.smithi045.stdout: -1575> 2023-10-03T19:20:16.304+0000 7f04f8d27640 12 mds.0.cache.dir(0x100) add_primary_dentry [dentry #0x100/stray6 [2,head] auth (dversion lock) v=0 ino=0x606 state=1073741824 0x55c505879400] 2023-10-03T19:21:28.479 INFO:teuthology.orchestra.run.smithi045.stdout: -1574> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x606) pre_dirty 1 2023-10-03T19:21:28.479 INFO:teuthology.orchestra.run.smithi045.stdout: -1573> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x606) _mark_dirty (was clean) [dir 0x606 ~mds0/stray6/ [2,head] auth v=1 cv=0/0 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x55c505aa5200] version 1 2023-10-03T19:21:28.479 INFO:teuthology.orchestra.run.smithi045.stdout: -1572> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x606) commit want 0 on [dir 0x606 ~mds0/stray6/ [2,head] auth v=1 cv=0/0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 0x55c505aa5200] 2023-10-03T19:21:28.479 INFO:teuthology.orchestra.run.smithi045.stdout: -1571> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x606) auth_pin by 0x55c505aa5200 on [dir 0x606 ~mds0/stray6/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa5200] count now 1 2023-10-03T19:21:28.479 INFO:teuthology.orchestra.run.smithi045.stdout: -1570> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x606) _commit want 1 on [dir 0x606 ~mds0/stray6/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa5200] 2023-10-03T19:21:28.480 INFO:teuthology.orchestra.run.smithi045.stdout: -1569> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x606) marking committing 2023-10-03T19:21:28.480 INFO:teuthology.orchestra.run.smithi045.stdout: -1568> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x606) _omap_commit 2023-10-03T19:21:28.480 INFO:teuthology.orchestra.run.smithi045.stdout: -1567> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x606) mark_dirty_parent 2023-10-03T19:21:28.480 INFO:teuthology.orchestra.run.smithi045.stdout: -1566> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x606) _store_backtrace on [inode 0x606 [...2,head] ~mds0/stray6/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.306978+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 0x55c505aa1600] 2023-10-03T19:21:28.480 INFO:teuthology.orchestra.run.smithi045.stdout: -1565> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 10 mds.0.cache.dir(0x606) _omap_commit_ops 2023-10-03T19:21:28.480 INFO:teuthology.orchestra.run.smithi045.stdout: -1564> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x606) auth_pin by 0x55c505aa1600 on [inode 0x606 [...2,head] ~mds0/stray6/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.306978+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x55c505aa1600] now 1 2023-10-03T19:21:28.480 INFO:teuthology.orchestra.run.smithi045.stdout: -1563> 2023-10-03T19:20:16.304+0000 7f04f8d27640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins 1 on [dir 0x100 ~mds0/ [2,head] auth v=0 cv=0/0 dir_auth=0 ap=0+7 state=1073741824 f(v0 7=0+7)/f() n(v0 rc2023-10-03T19:20:16.306978+0000 7=0+7)/n() hs=7+0,ss=0+0 dirty=7 | child=1 subtree=1 0x55c504b69180] by 0x55c505aa1600 count now 0/7 2023-10-03T19:21:28.480 INFO:teuthology.orchestra.run.smithi045.stdout: -1562> 2023-10-03T19:20:16.304+0000 7f04f8d27640 20 mds.0.cache.ino(0x606) _store_backtrace: no dirtypool or no old pools 2023-10-03T19:21:28.480 INFO:teuthology.orchestra.run.smithi045.stdout: -1561> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x606) _commit_ops 2023-10-03T19:21:28.480 INFO:teuthology.orchestra.run.smithi045.stdout: -1560> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.480 INFO:teuthology.orchestra.run.smithi045.stdout: -1559> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=18) v1 -- 0x55c504b5e9a0 con 0x55c504afb400 2023-10-03T19:21:28.480 INFO:teuthology.orchestra.run.smithi045.stdout: -1558> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.481 INFO:teuthology.orchestra.run.smithi045.stdout: -1557> 2023-10-03T19:20:16.304+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=19) v1 -- 0x55c504b5e6e0 con 0x55c504afb400 2023-10-03T19:21:28.481 INFO:teuthology.orchestra.run.smithi045.stdout: -1556> 2023-10-03T19:20:16.304+0000 7f04f8d27640 0 mds.0.cache creating system inode with ino:0x607 2023-10-03T19:21:28.481 INFO:teuthology.orchestra.run.smithi045.stdout: -1555> 2023-10-03T19:20:16.304+0000 7f04f8d27640 20 mds.0.cache.dir(0x100) lookup_exact_snap (head, 'stray7') 2023-10-03T19:21:28.481 INFO:teuthology.orchestra.run.smithi045.stdout: -1554> 2023-10-03T19:20:16.304+0000 7f04f8d27640 12 mds.0.cache.dir(0x100) add_primary_dentry [dentry #0x100/stray7 [2,head] auth (dversion lock) v=0 ino=0x607 state=1073741824 0x55c505879680] 2023-10-03T19:21:28.481 INFO:teuthology.orchestra.run.smithi045.stdout: -1553> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x607) pre_dirty 1 2023-10-03T19:21:28.481 INFO:teuthology.orchestra.run.smithi045.stdout: -1552> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x607) _mark_dirty (was clean) [dir 0x607 ~mds0/stray7/ [2,head] auth v=1 cv=0/0 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x55c505aa5680] version 1 2023-10-03T19:21:28.481 INFO:teuthology.orchestra.run.smithi045.stdout: -1551> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x607) commit want 0 on [dir 0x607 ~mds0/stray7/ [2,head] auth v=1 cv=0/0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 0x55c505aa5680] 2023-10-03T19:21:28.481 INFO:teuthology.orchestra.run.smithi045.stdout: -1550> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x607) auth_pin by 0x55c505aa5680 on [dir 0x607 ~mds0/stray7/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa5680] count now 1 2023-10-03T19:21:28.481 INFO:teuthology.orchestra.run.smithi045.stdout: -1549> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x607) _commit want 1 on [dir 0x607 ~mds0/stray7/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa5680] 2023-10-03T19:21:28.481 INFO:teuthology.orchestra.run.smithi045.stdout: -1548> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x607) marking committing 2023-10-03T19:21:28.481 INFO:teuthology.orchestra.run.smithi045.stdout: -1547> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x607) _omap_commit 2023-10-03T19:21:28.482 INFO:teuthology.orchestra.run.smithi045.stdout: -1546> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x607) mark_dirty_parent 2023-10-03T19:21:28.482 INFO:teuthology.orchestra.run.smithi045.stdout: -1545> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 10 mds.0.cache.dir(0x607) _omap_commit_ops 2023-10-03T19:21:28.482 INFO:teuthology.orchestra.run.smithi045.stdout: -1544> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x607) _store_backtrace on [inode 0x607 [...2,head] ~mds0/stray7/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.307060+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 0x55c505aa1b80] 2023-10-03T19:21:28.482 INFO:teuthology.orchestra.run.smithi045.stdout: -1543> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x607) auth_pin by 0x55c505aa1b80 on [inode 0x607 [...2,head] ~mds0/stray7/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.307060+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x55c505aa1b80] now 1 2023-10-03T19:21:28.482 INFO:teuthology.orchestra.run.smithi045.stdout: -1542> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.482 INFO:teuthology.orchestra.run.smithi045.stdout: -1541> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=20) v1 -- 0x55c504b5f600 con 0x55c504afb400 2023-10-03T19:21:28.482 INFO:teuthology.orchestra.run.smithi045.stdout: -1540> 2023-10-03T19:20:16.304+0000 7f04f8d27640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins 1 on [dir 0x100 ~mds0/ [2,head] auth v=0 cv=0/0 dir_auth=0 ap=0+8 state=1073741824 f(v0 8=0+8)/f() n(v0 rc2023-10-03T19:20:16.307060+0000 8=0+8)/n() hs=8+0,ss=0+0 dirty=8 | child=1 subtree=1 0x55c504b69180] by 0x55c505aa1b80 count now 0/8 2023-10-03T19:21:28.482 INFO:teuthology.orchestra.run.smithi045.stdout: -1539> 2023-10-03T19:20:16.304+0000 7f04f8d27640 20 mds.0.cache.ino(0x607) _store_backtrace: no dirtypool or no old pools 2023-10-03T19:21:28.482 INFO:teuthology.orchestra.run.smithi045.stdout: -1538> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x607) _commit_ops 2023-10-03T19:21:28.482 INFO:teuthology.orchestra.run.smithi045.stdout: -1537> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.482 INFO:teuthology.orchestra.run.smithi045.stdout: -1536> 2023-10-03T19:20:16.304+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=21) v1 -- 0x55c505acc000 con 0x55c504afb400 2023-10-03T19:21:28.482 INFO:teuthology.orchestra.run.smithi045.stdout: -1535> 2023-10-03T19:20:16.304+0000 7f04f8d27640 0 mds.0.cache creating system inode with ino:0x608 2023-10-03T19:21:28.483 INFO:teuthology.orchestra.run.smithi045.stdout: -1534> 2023-10-03T19:20:16.304+0000 7f04f8d27640 20 mds.0.cache.dir(0x100) lookup_exact_snap (head, 'stray8') 2023-10-03T19:21:28.483 INFO:teuthology.orchestra.run.smithi045.stdout: -1533> 2023-10-03T19:20:16.304+0000 7f04f8d27640 12 mds.0.cache.dir(0x100) add_primary_dentry [dentry #0x100/stray8 [2,head] auth (dversion lock) v=0 ino=0x608 state=1073741824 0x55c505879900] 2023-10-03T19:21:28.483 INFO:teuthology.orchestra.run.smithi045.stdout: -1532> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x608) pre_dirty 1 2023-10-03T19:21:28.483 INFO:teuthology.orchestra.run.smithi045.stdout: -1531> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x608) _mark_dirty (was clean) [dir 0x608 ~mds0/stray8/ [2,head] auth v=1 cv=0/0 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x55c505aa5b00] version 1 2023-10-03T19:21:28.483 INFO:teuthology.orchestra.run.smithi045.stdout: -1530> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x608) commit want 0 on [dir 0x608 ~mds0/stray8/ [2,head] auth v=1 cv=0/0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 0x55c505aa5b00] 2023-10-03T19:21:28.483 INFO:teuthology.orchestra.run.smithi045.stdout: -1529> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x608) auth_pin by 0x55c505aa5b00 on [dir 0x608 ~mds0/stray8/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa5b00] count now 1 2023-10-03T19:21:28.483 INFO:teuthology.orchestra.run.smithi045.stdout: -1528> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x608) _commit want 1 on [dir 0x608 ~mds0/stray8/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa5b00] 2023-10-03T19:21:28.483 INFO:teuthology.orchestra.run.smithi045.stdout: -1527> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x608) marking committing 2023-10-03T19:21:28.483 INFO:teuthology.orchestra.run.smithi045.stdout: -1526> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x608) _omap_commit 2023-10-03T19:21:28.483 INFO:teuthology.orchestra.run.smithi045.stdout: -1525> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x608) mark_dirty_parent 2023-10-03T19:21:28.483 INFO:teuthology.orchestra.run.smithi045.stdout: -1524> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x608) _store_backtrace on [inode 0x608 [...2,head] ~mds0/stray8/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.307164+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 0x55c505aa2100] 2023-10-03T19:21:28.483 INFO:teuthology.orchestra.run.smithi045.stdout: -1523> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x608) auth_pin by 0x55c505aa2100 on [inode 0x608 [...2,head] ~mds0/stray8/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.307164+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x55c505aa2100] now 1 2023-10-03T19:21:28.484 INFO:teuthology.orchestra.run.smithi045.stdout: -1522> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 10 mds.0.cache.dir(0x608) _omap_commit_ops 2023-10-03T19:21:28.484 INFO:teuthology.orchestra.run.smithi045.stdout: -1521> 2023-10-03T19:20:16.304+0000 7f04f8d27640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins 1 on [dir 0x100 ~mds0/ [2,head] auth v=0 cv=0/0 dir_auth=0 ap=0+9 state=1073741824 f(v0 9=0+9)/f() n(v0 rc2023-10-03T19:20:16.307164+0000 9=0+9)/n() hs=9+0,ss=0+0 dirty=9 | child=1 subtree=1 0x55c504b69180] by 0x55c505aa2100 count now 0/9 2023-10-03T19:21:28.484 INFO:teuthology.orchestra.run.smithi045.stdout: -1520> 2023-10-03T19:20:16.304+0000 7f04f8d27640 20 mds.0.cache.ino(0x608) _store_backtrace: no dirtypool or no old pools 2023-10-03T19:21:28.484 INFO:teuthology.orchestra.run.smithi045.stdout: -1519> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x608) _commit_ops 2023-10-03T19:21:28.484 INFO:teuthology.orchestra.run.smithi045.stdout: -1518> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.484 INFO:teuthology.orchestra.run.smithi045.stdout: -1517> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=22) v1 -- 0x55c504b5f760 con 0x55c504afb400 2023-10-03T19:21:28.484 INFO:teuthology.orchestra.run.smithi045.stdout: -1516> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.484 INFO:teuthology.orchestra.run.smithi045.stdout: -1515> 2023-10-03T19:20:16.304+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=23) v1 -- 0x55c505acc2c0 con 0x55c504afb400 2023-10-03T19:21:28.484 INFO:teuthology.orchestra.run.smithi045.stdout: -1514> 2023-10-03T19:20:16.304+0000 7f04f8d27640 0 mds.0.cache creating system inode with ino:0x609 2023-10-03T19:21:28.484 INFO:teuthology.orchestra.run.smithi045.stdout: -1513> 2023-10-03T19:20:16.304+0000 7f04f8d27640 20 mds.0.cache.dir(0x100) lookup_exact_snap (head, 'stray9') 2023-10-03T19:21:28.484 INFO:teuthology.orchestra.run.smithi045.stdout: -1512> 2023-10-03T19:20:16.304+0000 7f04f8d27640 12 mds.0.cache.dir(0x100) add_primary_dentry [dentry #0x100/stray9 [2,head] auth (dversion lock) v=0 ino=0x609 state=1073741824 0x55c505879b80] 2023-10-03T19:21:28.484 INFO:teuthology.orchestra.run.smithi045.stdout: -1511> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x609) pre_dirty 1 2023-10-03T19:21:28.485 INFO:teuthology.orchestra.run.smithi045.stdout: -1510> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x609) _mark_dirty (was clean) [dir 0x609 ~mds0/stray9/ [2,head] auth v=1 cv=0/0 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x55c505aa5f80] version 1 2023-10-03T19:21:28.485 INFO:teuthology.orchestra.run.smithi045.stdout: -1509> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x609) commit want 0 on [dir 0x609 ~mds0/stray9/ [2,head] auth v=1 cv=0/0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 0x55c505aa5f80] 2023-10-03T19:21:28.485 INFO:teuthology.orchestra.run.smithi045.stdout: -1508> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x609) auth_pin by 0x55c505aa5f80 on [dir 0x609 ~mds0/stray9/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa5f80] count now 1 2023-10-03T19:21:28.485 INFO:teuthology.orchestra.run.smithi045.stdout: -1507> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x609) _commit want 1 on [dir 0x609 ~mds0/stray9/ [2,head] auth v=1 cv=0/0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa5f80] 2023-10-03T19:21:28.485 INFO:teuthology.orchestra.run.smithi045.stdout: -1506> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x609) marking committing 2023-10-03T19:21:28.485 INFO:teuthology.orchestra.run.smithi045.stdout: -1505> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x609) _omap_commit 2023-10-03T19:21:28.485 INFO:teuthology.orchestra.run.smithi045.stdout: -1504> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x609) mark_dirty_parent 2023-10-03T19:21:28.485 INFO:teuthology.orchestra.run.smithi045.stdout: -1503> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x609) _store_backtrace on [inode 0x609 [...2,head] ~mds0/stray9/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.307241+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 0x55c505aa2680] 2023-10-03T19:21:28.485 INFO:teuthology.orchestra.run.smithi045.stdout: -1502> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x609) auth_pin by 0x55c505aa2680 on [inode 0x609 [...2,head] ~mds0/stray9/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.307241+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x55c505aa2680] now 1 2023-10-03T19:21:28.485 INFO:teuthology.orchestra.run.smithi045.stdout: -1501> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 10 mds.0.cache.dir(0x609) _omap_commit_ops 2023-10-03T19:21:28.485 INFO:teuthology.orchestra.run.smithi045.stdout: -1500> 2023-10-03T19:20:16.304+0000 7f04f8d27640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins 1 on [dir 0x100 ~mds0/ [2,head] auth v=0 cv=0/0 dir_auth=0 ap=0+10 state=1073741824 f(v0 10=0+10)/f() n(v0 rc2023-10-03T19:20:16.307241+0000 10=0+10)/n() hs=10+0,ss=0+0 dirty=10 | child=1 subtree=1 0x55c504b69180] by 0x55c505aa2680 count now 0/10 2023-10-03T19:21:28.486 INFO:teuthology.orchestra.run.smithi045.stdout: -1499> 2023-10-03T19:20:16.304+0000 7f04f8d27640 20 mds.0.cache.ino(0x609) _store_backtrace: no dirtypool or no old pools 2023-10-03T19:21:28.486 INFO:teuthology.orchestra.run.smithi045.stdout: -1498> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x609) _commit_ops 2023-10-03T19:21:28.486 INFO:teuthology.orchestra.run.smithi045.stdout: -1497> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.486 INFO:teuthology.orchestra.run.smithi045.stdout: -1496> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=24) v1 -- 0x55c504b5e420 con 0x55c504afb400 2023-10-03T19:21:28.486 INFO:teuthology.orchestra.run.smithi045.stdout: -1495> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.486 INFO:teuthology.orchestra.run.smithi045.stdout: -1494> 2023-10-03T19:20:16.304+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=25) v1 -- 0x55c505acc580 con 0x55c504afb400 2023-10-03T19:21:28.486 INFO:teuthology.orchestra.run.smithi045.stdout: -1493> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x100) pre_dirty 1 2023-10-03T19:21:28.486 INFO:teuthology.orchestra.run.smithi045.stdout: -1492> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x100) _mark_dirty (was clean) [dir 0x100 ~mds0/ [2,head] auth v=1 cv=0/0 dir_auth=0 ap=0+10 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:20:16.307241+0000 10=0+10) hs=10+0,ss=0+0 dirty=10 | child=1 subtree=1 0x55c504b69180] version 1 2023-10-03T19:21:28.486 INFO:teuthology.orchestra.run.smithi045.stdout: -1491> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x100) commit want 0 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=0/0 dir_auth=0 ap=0+10 state=1610612737|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:20:16.307241+0000 10=0+10) hs=10+0,ss=0+0 dirty=10 | child=1 subtree=1 dirty=1 0x55c504b69180] 2023-10-03T19:21:28.486 INFO:teuthology.orchestra.run.smithi045.stdout: -1490> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x100) auth_pin by 0x55c504b69180 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=0/0 dir_auth=0 ap=1+10 state=1610612737|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:20:16.307241+0000 10=0+10) hs=10+0,ss=0+0 dirty=10 | child=1 subtree=1 dirty=1 authpin=1 0x55c504b69180] count now 1 2023-10-03T19:21:28.486 INFO:teuthology.orchestra.run.smithi045.stdout: -1489> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x100) _commit want 1 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=0/0 dir_auth=0 ap=1+10 state=1610612737|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:20:16.307241+0000 10=0+10) hs=10+0,ss=0+0 dirty=10 | child=1 subtree=1 dirty=1 authpin=1 0x55c504b69180] 2023-10-03T19:21:28.487 INFO:teuthology.orchestra.run.smithi045.stdout: -1488> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x100) marking committing 2023-10-03T19:21:28.487 INFO:teuthology.orchestra.run.smithi045.stdout: -1487> 2023-10-03T19:20:16.304+0000 7f04f8d27640 20 mds.0.bal hit_dir 4 pop is 1, frag * size 10 [pop IRD:[C 0.00e+00] IWR:[C 0.00e+00] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 1.00e+00] *LOAD:4.0] 2023-10-03T19:21:28.487 INFO:teuthology.orchestra.run.smithi045.stdout: -1486> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x100) _omap_commit 2023-10-03T19:21:28.487 INFO:teuthology.orchestra.run.smithi045.stdout: -1485> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x100) set stray0 [dentry #0x100/stray0 [2,head] auth (dversion lock) v=0 ino=0x600 state=1610612736 | inodepin=1 dirty=1 0x55c505878500] 2023-10-03T19:21:28.487 INFO:teuthology.orchestra.run.smithi045.stdout: -1484> 2023-10-03T19:20:16.304+0000 7f04f8d27640 14 mds.0.cache.dir(0x100) dn 'stray0' inode [inode 0x600 [...2,head] ~mds0/stray0/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.306261+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x55c504b89180] 2023-10-03T19:21:28.487 INFO:teuthology.orchestra.run.smithi045.stdout: -1483> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x100) set stray1 [dentry #0x100/stray1 [2,head] auth (dversion lock) v=0 ino=0x601 state=1610612736 | inodepin=1 dirty=1 0x55c505878780] 2023-10-03T19:21:28.487 INFO:teuthology.orchestra.run.smithi045.stdout: -1482> 2023-10-03T19:20:16.304+0000 7f04f8d27640 14 mds.0.cache.dir(0x100) dn 'stray1' inode [inode 0x601 [...2,head] ~mds0/stray1/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.306512+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x55c504b89700] 2023-10-03T19:21:28.487 INFO:teuthology.orchestra.run.smithi045.stdout: -1481> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x100) set stray2 [dentry #0x100/stray2 [2,head] auth (dversion lock) v=0 ino=0x602 state=1610612736 | inodepin=1 dirty=1 0x55c505878a00] 2023-10-03T19:21:28.487 INFO:teuthology.orchestra.run.smithi045.stdout: -1480> 2023-10-03T19:20:16.304+0000 7f04f8d27640 14 mds.0.cache.dir(0x100) dn 'stray2' inode [inode 0x602 [...2,head] ~mds0/stray2/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.306648+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x55c505aa0000] 2023-10-03T19:21:28.487 INFO:teuthology.orchestra.run.smithi045.stdout: -1479> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x100) set stray3 [dentry #0x100/stray3 [2,head] auth (dversion lock) v=0 ino=0x603 state=1610612736 | inodepin=1 dirty=1 0x55c505878c80] 2023-10-03T19:21:28.487 INFO:teuthology.orchestra.run.smithi045.stdout: -1478> 2023-10-03T19:20:16.304+0000 7f04f8d27640 14 mds.0.cache.dir(0x100) dn 'stray3' inode [inode 0x603 [...2,head] ~mds0/stray3/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.306751+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x55c505aa0580] 2023-10-03T19:21:28.487 INFO:teuthology.orchestra.run.smithi045.stdout: -1477> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x100) set stray4 [dentry #0x100/stray4 [2,head] auth (dversion lock) v=0 ino=0x604 state=1610612736 | inodepin=1 dirty=1 0x55c505878f00] 2023-10-03T19:21:28.487 INFO:teuthology.orchestra.run.smithi045.stdout: -1476> 2023-10-03T19:20:16.304+0000 7f04f8d27640 14 mds.0.cache.dir(0x100) dn 'stray4' inode [inode 0x604 [...2,head] ~mds0/stray4/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.306831+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x55c505aa0b00] 2023-10-03T19:21:28.488 INFO:teuthology.orchestra.run.smithi045.stdout: -1475> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x100) set stray5 [dentry #0x100/stray5 [2,head] auth (dversion lock) v=0 ino=0x605 state=1610612736 | inodepin=1 dirty=1 0x55c505879180] 2023-10-03T19:21:28.488 INFO:teuthology.orchestra.run.smithi045.stdout: -1474> 2023-10-03T19:20:16.304+0000 7f04f8d27640 14 mds.0.cache.dir(0x100) dn 'stray5' inode [inode 0x605 [...2,head] ~mds0/stray5/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.306901+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x55c505aa1080] 2023-10-03T19:21:28.488 INFO:teuthology.orchestra.run.smithi045.stdout: -1473> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x100) set stray6 [dentry #0x100/stray6 [2,head] auth (dversion lock) v=0 ino=0x606 state=1610612736 | inodepin=1 dirty=1 0x55c505879400] 2023-10-03T19:21:28.488 INFO:teuthology.orchestra.run.smithi045.stdout: -1472> 2023-10-03T19:20:16.304+0000 7f04f8d27640 14 mds.0.cache.dir(0x100) dn 'stray6' inode [inode 0x606 [...2,head] ~mds0/stray6/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.306978+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x55c505aa1600] 2023-10-03T19:21:28.488 INFO:teuthology.orchestra.run.smithi045.stdout: -1471> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x100) set stray7 [dentry #0x100/stray7 [2,head] auth (dversion lock) v=0 ino=0x607 state=1610612736 | inodepin=1 dirty=1 0x55c505879680] 2023-10-03T19:21:28.488 INFO:teuthology.orchestra.run.smithi045.stdout: -1470> 2023-10-03T19:20:16.304+0000 7f04f8d27640 14 mds.0.cache.dir(0x100) dn 'stray7' inode [inode 0x607 [...2,head] ~mds0/stray7/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.307060+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x55c505aa1b80] 2023-10-03T19:21:28.488 INFO:teuthology.orchestra.run.smithi045.stdout: -1469> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x100) set stray8 [dentry #0x100/stray8 [2,head] auth (dversion lock) v=0 ino=0x608 state=1610612736 | inodepin=1 dirty=1 0x55c505879900] 2023-10-03T19:21:28.488 INFO:teuthology.orchestra.run.smithi045.stdout: -1468> 2023-10-03T19:20:16.304+0000 7f04f8d27640 14 mds.0.cache.dir(0x100) dn 'stray8' inode [inode 0x608 [...2,head] ~mds0/stray8/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.307164+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x55c505aa2100] 2023-10-03T19:21:28.488 INFO:teuthology.orchestra.run.smithi045.stdout: -1467> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x100) set stray9 [dentry #0x100/stray9 [2,head] auth (dversion lock) v=0 ino=0x609 state=1610612736 | inodepin=1 dirty=1 0x55c505879b80] 2023-10-03T19:21:28.488 INFO:teuthology.orchestra.run.smithi045.stdout: -1466> 2023-10-03T19:20:16.304+0000 7f04f8d27640 14 mds.0.cache.dir(0x100) dn 'stray9' inode [inode 0x609 [...2,head] ~mds0/stray9/ auth v1 ap=1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.307241+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x55c505aa2680] 2023-10-03T19:21:28.488 INFO:teuthology.orchestra.run.smithi045.stdout: -1465> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x100) store 1 2023-10-03T19:21:28.488 INFO:teuthology.orchestra.run.smithi045.stdout: -1464> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.snaprealm(0x100 seq 1 0x55c504c6db00) get_snaps (seq 1 cached_seq 1) 2023-10-03T19:21:28.489 INFO:teuthology.orchestra.run.smithi045.stdout: -1463> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache.ino(0x100) purge_stale_snap_data 2023-10-03T19:21:28.489 INFO:teuthology.orchestra.run.smithi045.stdout: -1462> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 10 mds.0.cache.dir(0x100) _omap_commit_ops 2023-10-03T19:21:28.489 INFO:teuthology.orchestra.run.smithi045.stdout: -1461> 2023-10-03T19:20:16.304+0000 7f04f8d27640 20 mds.0.cache.ino(0x100) encode_snap_blob snaprealm(0x100 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 0.000000 change_attr 0 0x55c504c6db00) 2023-10-03T19:21:28.489 INFO:teuthology.orchestra.run.smithi045.stdout: -1460> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.489 INFO:teuthology.orchestra.run.smithi045.stdout: -1459> 2023-10-03T19:20:16.304+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=26) v1 -- 0x55c505acc6e0 con 0x55c504afb400 2023-10-03T19:21:28.489 INFO:teuthology.orchestra.run.smithi045.stdout: -1458> 2023-10-03T19:20:16.304+0000 7f04f8d27640 3 mds.0.54 boot_create creating global snaprealm 2023-10-03T19:21:28.489 INFO:teuthology.orchestra.run.smithi045.stdout: -1457> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.54 boot_create creating fresh inotable table 2023-10-03T19:21:28.489 INFO:teuthology.orchestra.run.smithi045.stdout: -1456> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.inotable: save v 0 2023-10-03T19:21:28.489 INFO:teuthology.orchestra.run.smithi045.stdout: -1455> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.489 INFO:teuthology.orchestra.run.smithi045.stdout: -1454> 2023-10-03T19:20:16.304+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=27) v1 -- 0x55c505acc840 con 0x55c504afb400 2023-10-03T19:21:28.489 INFO:teuthology.orchestra.run.smithi045.stdout: -1453> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.sessionmap save: needv 0, v 0 2023-10-03T19:21:28.489 INFO:teuthology.orchestra.run.smithi045.stdout: -1452> 2023-10-03T19:20:16.304+0000 7f04f8d27640 20 mds.0.sessionmap updating keys: 2023-10-03T19:21:28.490 INFO:teuthology.orchestra.run.smithi045.stdout: -1451> 2023-10-03T19:20:16.304+0000 7f04f8d27640 20 mds.0.sessionmap removing keys: 2023-10-03T19:21:28.490 INFO:teuthology.orchestra.run.smithi045.stdout: -1450> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.490 INFO:teuthology.orchestra.run.smithi045.stdout: -1449> 2023-10-03T19:20:16.304+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=28) v1 -- 0x55c505acc9a0 con 0x55c504afb400 2023-10-03T19:21:28.490 INFO:teuthology.orchestra.run.smithi045.stdout: -1448> 2023-10-03T19:20:16.304+0000 7f04f8d27640 4 mds.0.purge_queue create: creating 2023-10-03T19:21:28.490 INFO:teuthology.orchestra.run.smithi045.stdout: -1447> 2023-10-03T19:20:16.304+0000 7f04f8d27640 1 mds.0.journaler.pq(ro) set_writeable 2023-10-03T19:21:28.490 INFO:teuthology.orchestra.run.smithi045.stdout: -1446> 2023-10-03T19:20:16.304+0000 7f04f8d27640 1 mds.0.journaler.pq(rw) created blank journal at inode 0x0x500, format=1 2023-10-03T19:21:28.490 INFO:teuthology.orchestra.run.smithi045.stdout: -1445> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.490 INFO:teuthology.orchestra.run.smithi045.stdout: -1444> 2023-10-03T19:20:16.304+0000 7f04f2d1b640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=29) v1 -- 0x55c504b5fce0 con 0x55c504afb400 2023-10-03T19:21:28.490 INFO:teuthology.orchestra.run.smithi045.stdout: -1443> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.490 INFO:teuthology.orchestra.run.smithi045.stdout: -1442> 2023-10-03T19:20:16.304+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=30) v1 -- 0x55c505acc000 con 0x55c504afb400 2023-10-03T19:21:28.490 INFO:teuthology.orchestra.run.smithi045.stdout: -1441> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.54 boot_create creating fresh snaptable 2023-10-03T19:21:28.490 INFO:teuthology.orchestra.run.smithi045.stdout: -1440> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.snaptable: save v 1 2023-10-03T19:21:28.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1439> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1438> 2023-10-03T19:20:16.304+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=31) v1 -- 0x55c505accb00 con 0x55c504afb400 2023-10-03T19:21:28.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1437> 2023-10-03T19:20:16.304+0000 7f04f8d27640 7 mds.0.log _journal_segment_subtree_map 2023-10-03T19:21:28.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1436> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache create_subtree_map 2 subtrees, 2 fullauth 2023-10-03T19:21:28.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1435> 2023-10-03T19:20:16.304+0000 7f04f8d27640 15 mds.0.cache show_subtrees 2023-10-03T19:21:28.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1434> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache |__ 0 auth [dir 0x1 / [2,head] auth v=1 cv=1/0 REP dir_auth=0 ap=1+0 state=1610612769|complete|committing f() n() hs=0+0,ss=0+0 | subtree=1 dirty=1 authpin=1 0x55c504b68d00] 2023-10-03T19:21:28.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1433> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 mds.0.cache |__ 0 auth [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/0 dir_auth=0 ap=1+10 state=1610612769|complete|committing f(v0 10=0+10) n(v0 rc2023-10-03T19:20:16.307241+0000 10=0+10) hs=10+0,ss=0+0 dirty=10 | child=1 subtree=1 dirty=1 authpin=1 0x55c504b69180] 2023-10-03T19:21:28.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1432> 2023-10-03T19:20:16.304+0000 7f04f8d27640 15 mds.0.cache auth subtree [dir 0x1 / [2,head] auth v=1 cv=1/0 REP dir_auth=0 ap=1+0 state=1610612769|complete|committing f() n() hs=0+0,ss=0+0 | subtree=1 dirty=1 authpin=1 0x55c504b68d00] 2023-10-03T19:21:28.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1431> 2023-10-03T19:20:16.304+0000 7f04f8d27640 15 mds.0.cache auth subtree [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/0 dir_auth=0 ap=1+10 state=1610612769|complete|committing f(v0 10=0+10) n(v0 rc2023-10-03T19:20:16.307241+0000 10=0+10) hs=10+0,ss=0+0 dirty=10 | child=1 subtree=1 dirty=1 authpin=1 0x55c504b69180] 2023-10-03T19:21:28.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1430> 2023-10-03T19:20:16.304+0000 7f04f8d27640 20 mds.0.journal EMetaBlob::add_dir_context final: 2023-10-03T19:21:28.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1429> 2023-10-03T19:20:16.304+0000 7f04f8d27640 20 mds.0.journal EMetaBlob::add_dir_context final: 2023-10-03T19:21:28.491 INFO:teuthology.orchestra.run.smithi045.stdout: -1428> 2023-10-03T19:20:16.304+0000 7f04f8d27640 15 mds.0.cache subtrees {0x1=[],0x100=[]} 2023-10-03T19:21:28.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1427> 2023-10-03T19:20:16.304+0000 7f04f8d27640 15 mds.0.cache ambiguous_subtrees 2023-10-03T19:21:28.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1426> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 notify_mdsmap: mds.metrics 2023-10-03T19:21:28.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1425> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 notify_mdsmap: mds.metrics: rank0 is unavailable 2023-10-03T19:21:28.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1424> 2023-10-03T19:20:16.304+0000 7f04f8d27640 10 reset_seq: mds.metrics: last_updated_seq=0 2023-10-03T19:21:28.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1423> 2023-10-03T19:20:16.304+0000 7f04f8d27640 20 set_next_seq: mds.metrics: current sequence number 0, setting next sequence number 0 2023-10-03T19:21:28.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1422> 2023-10-03T19:20:16.304+0000 7f04f251a640 5 mds.0.log _submit_thread 4194304~872 : ESubtreeMap 2 subtrees , 0 ambiguous [metablob 0x1, 2 dirs] 2023-10-03T19:21:28.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1421> 2023-10-03T19:20:16.304+0000 7f04f251a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1420> 2023-10-03T19:20:16.304+0000 7f04f251a640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=32) v1 -- 0x55c504b5e420 con 0x55c504afb400 2023-10-03T19:21:28.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1419> 2023-10-03T19:20:16.304+0000 7f04f251a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1418> 2023-10-03T19:20:16.304+0000 7f04f251a640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=33) v1 -- 0x55c505acc2c0 con 0x55c504afb400 2023-10-03T19:21:28.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1417> 2023-10-03T19:20:16.304+0000 7f04f251a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1416> 2023-10-03T19:20:16.304+0000 7f04f251a640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=34) v1 -- 0x55c504b5fce0 con 0x55c504afb400 2023-10-03T19:21:28.492 INFO:teuthology.orchestra.run.smithi045.stdout: -1415> 2023-10-03T19:20:16.304+0000 7f04f251a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1414> 2023-10-03T19:20:16.304+0000 7f04f251a640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=35) v1 -- 0x55c505acc580 con 0x55c504afb400 2023-10-03T19:21:28.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1413> 2023-10-03T19:20:16.304+0000 7f04f251a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1412> 2023-10-03T19:20:16.304+0000 7f04f251a640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=36) v1 -- 0x55c505acc6e0 con 0x55c504afb400 2023-10-03T19:21:28.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1411> 2023-10-03T19:20:16.304+0000 7f04f251a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1410> 2023-10-03T19:20:16.304+0000 7f04f251a640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=37) v1 -- 0x55c505acc840 con 0x55c504afb400 2023-10-03T19:21:28.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1409> 2023-10-03T19:20:16.304+0000 7f04f4d1f640 2 mds.0.cache Memory usage: total 256712, rss 35252, heap 190760, baseline 190760, 0 / 13 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:28.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1408> 2023-10-03T19:20:16.304+0000 7f04f4d1f640 10 mds.0.cache cache not ready for trimming 2023-10-03T19:21:28.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1407> 2023-10-03T19:20:16.304+0000 7f04f4d1f640 10 mds.0.cache releasing free memory 2023-10-03T19:21:28.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1406> 2023-10-03T19:20:16.304+0000 7f04f4d1f640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:28.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1405> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 11 ==== osd_map(108..108 src has 1..108) v4 ==== 6062+0+0 (secure 0 0 0) 0x55c504b3aa80 con 0x55c504afb400 2023-10-03T19:21:28.493 INFO:teuthology.orchestra.run.smithi045.stdout: -1404> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] conn(0x55c505a26c00 0x55c505aa3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:28.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1403> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.54:1 17.14 17:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c504b51880 con 0x55c505a26c00 2023-10-03T19:21:28.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1402> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] conn(0x55c505a27000 0x55c505aa3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:28.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1401> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.54:2 17.f 17:f1f69726:::400.00000000:head [writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c504b51c00 con 0x55c505a27000 2023-10-03T19:21:28.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1400> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.54:3 17.14 17:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b14000 con 0x55c505a26c00 2023-10-03T19:21:28.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1399> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] conn(0x55c505a27400 0x55c505b16000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:28.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1398> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.54:4 17.1f 17:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b14380 con 0x55c505a27400 2023-10-03T19:21:28.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1397> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.54:5 17.1f 17:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=36b,setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b14700 con 0x55c505a27400 2023-10-03T19:21:28.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1396> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.54:6 17.10 17:0d82a743:::600.00000000:head [create,setxattr parent (62) in=68b,setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b14a80 con 0x55c505a26c00 2023-10-03T19:21:28.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1395> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.54:7 17.10 17:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b14e00 con 0x55c505a26c00 2023-10-03T19:21:28.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1394> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.54:8 17.10 17:09401a81:::601.00000000:head [create,setxattr parent (62) in=68b,setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b15180 con 0x55c505a26c00 2023-10-03T19:21:28.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1393> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.54:9 17.10 17:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b15500 con 0x55c505a26c00 2023-10-03T19:21:28.494 INFO:teuthology.orchestra.run.smithi045.stdout: -1392> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.54:10 17.10 17:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b15880 con 0x55c505a26c00 2023-10-03T19:21:28.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1391> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.54:11 17.10 17:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=68b,setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b15c00 con 0x55c505a26c00 2023-10-03T19:21:28.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1390> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.54:12 17.10 17:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b1a000 con 0x55c505a26c00 2023-10-03T19:21:28.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1389> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.54:13 17.10 17:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=68b,setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b1a380 con 0x55c505a26c00 2023-10-03T19:21:28.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1388> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] conn(0x55c505a27800 0x55c505b16580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:28.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1387> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.54:14 17.15 17:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b1a700 con 0x55c505a27800 2023-10-03T19:21:28.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1386> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.54:15 17.15 17:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=68b,setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b1aa80 con 0x55c505a27800 2023-10-03T19:21:28.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1385> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] conn(0x55c505a27c00 0x55c505b16b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:28.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1384> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.54:16 17.1d 17:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b1ae00 con 0x55c505a27c00 2023-10-03T19:21:28.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1383> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.54:17 17.1d 17:b871830b:::605.00000000:head [create,setxattr parent (62) in=68b,setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b1b180 con 0x55c505a27c00 2023-10-03T19:21:28.495 INFO:teuthology.orchestra.run.smithi045.stdout: -1382> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.54:18 17.14 17:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b1b500 con 0x55c505a26c00 2023-10-03T19:21:28.496 INFO:teuthology.orchestra.run.smithi045.stdout: -1381> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.54:19 17.14 17:2f55791f:::606.00000000:head [create,setxattr parent (62) in=68b,setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b1b880 con 0x55c505a26c00 2023-10-03T19:21:28.496 INFO:teuthology.orchestra.run.smithi045.stdout: -1380> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.54:20 17.1c 17:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b1bc00 con 0x55c505a27000 2023-10-03T19:21:28.496 INFO:teuthology.orchestra.run.smithi045.stdout: -1379> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.54:21 17.1c 17:3ed09add:::607.00000000:head [create,setxattr parent (62) in=68b,setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b20000 con 0x55c505a27000 2023-10-03T19:21:28.496 INFO:teuthology.orchestra.run.smithi045.stdout: -1378> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] conn(0x55c505b22000 0x55c505b17080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:28.496 INFO:teuthology.orchestra.run.smithi045.stdout: -1377> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.54:22 17.e 17:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b20380 con 0x55c505b22000 2023-10-03T19:21:28.496 INFO:teuthology.orchestra.run.smithi045.stdout: -1376> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- osd_op(unknown.0.54:23 17.e 17:717a0223:::608.00000000:head [create,setxattr parent (62) in=68b,setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b20700 con 0x55c505b22000 2023-10-03T19:21:28.496 INFO:teuthology.orchestra.run.smithi045.stdout: -1375> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] conn(0x55c505b22400 0x55c505b17600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:28.496 INFO:teuthology.orchestra.run.smithi045.stdout: -1374> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.54:24 17.7 17:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b20a80 con 0x55c505b22400 2023-10-03T19:21:28.510 INFO:teuthology.orchestra.run.smithi045.stdout: -1373> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.54:25 17.7 17:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=68b,setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b20e00 con 0x55c505b22400 2023-10-03T19:21:28.510 INFO:teuthology.orchestra.run.smithi045.stdout: -1372> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.54:26 17.1f 17:fe07bba1:::100.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b21180 con 0x55c505a27400 2023-10-03T19:21:28.510 INFO:teuthology.orchestra.run.smithi045.stdout: -1371> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.54:27 17.13 17:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b21500 con 0x55c505a26c00 2023-10-03T19:21:28.511 INFO:teuthology.orchestra.run.smithi045.stdout: -1370> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.54:28 17.b 17:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b21880 con 0x55c505b22400 2023-10-03T19:21:28.511 INFO:teuthology.orchestra.run.smithi045.stdout: -1369> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.54:29 17.13 17:cd5a64a3:::100.00000000:head [omap-set-header in=274b,omap-set-vals in=5194b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b21c00 con 0x55c505a26c00 2023-10-03T19:21:28.511 INFO:teuthology.orchestra.run.smithi045.stdout: -1368> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- osd_op(unknown.0.54:30 17.15 17:aa448500:::500.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b3a000 con 0x55c505a27800 2023-10-03T19:21:28.511 INFO:teuthology.orchestra.run.smithi045.stdout: -1367> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- osd_op(unknown.0.54:31 17.d 17:b50e409b:::mds_snaptable:head [writefull 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b3a380 con 0x55c505a27c00 2023-10-03T19:21:28.511 INFO:teuthology.orchestra.run.smithi045.stdout: -1366> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.54:32 17.14 17:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b3a700 con 0x55c505a26c00 2023-10-03T19:21:28.511 INFO:teuthology.orchestra.run.smithi045.stdout: -1365> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] conn(0x55c505b22800 0x55c505b17b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:28.511 INFO:teuthology.orchestra.run.smithi045.stdout: -1364> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- osd_op(unknown.0.54:33 17.1b 17:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b3aa80 con 0x55c505b22800 2023-10-03T19:21:28.511 INFO:teuthology.orchestra.run.smithi045.stdout: -1363> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.54:34 17.b 17:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b3ae00 con 0x55c505b22400 2023-10-03T19:21:28.511 INFO:teuthology.orchestra.run.smithi045.stdout: -1362> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.54:35 17.1f 17:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b3b180 con 0x55c505a27400 2023-10-03T19:21:28.511 INFO:teuthology.orchestra.run.smithi045.stdout: -1361> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- osd_op(unknown.0.54:36 17.1a 17:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b3b500 con 0x55c505b22400 2023-10-03T19:21:28.511 INFO:teuthology.orchestra.run.smithi045.stdout: -1360> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- osd_op(unknown.0.54:37 17.1e 17:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b3b880 con 0x55c505a27000 2023-10-03T19:21:28.512 INFO:teuthology.orchestra.run.smithi045.stdout: -1359> 2023-10-03T19:20:16.308+0000 7f04f8d27640 7 mds.0.server operator(): full = 0 epoch = 108 2023-10-03T19:21:28.512 INFO:teuthology.orchestra.run.smithi045.stdout: -1358> 2023-10-03T19:20:16.308+0000 7f04f8d27640 10 mds.0.server apply_blocklist: killed 0 2023-10-03T19:21:28.512 INFO:teuthology.orchestra.run.smithi045.stdout: -1357> 2023-10-03T19:20:16.308+0000 7f04f8d27640 4 mds.0.54 apply_blocklist: killed 0, blocklisted sessions (0 blocklist entries, 0) 2023-10-03T19:21:28.512 INFO:teuthology.orchestra.run.smithi045.stdout: -1356> 2023-10-03T19:20:16.308+0000 7f04f8d27640 10 monclient: _renew_subs 2023-10-03T19:21:28.512 INFO:teuthology.orchestra.run.smithi045.stdout: -1355> 2023-10-03T19:20:16.308+0000 7f04f8d27640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.512 INFO:teuthology.orchestra.run.smithi045.stdout: -1354> 2023-10-03T19:20:16.308+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=109}) v3 -- 0x55c5059c3860 con 0x55c504afb400 2023-10-03T19:21:28.512 INFO:teuthology.orchestra.run.smithi045.stdout: -1353> 2023-10-03T19:20:16.308+0000 7f04fbd2d640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] conn(0x55c505a27000 0x55c505aa3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:28.512 INFO:teuthology.orchestra.run.smithi045.stdout: -1352> 2023-10-03T19:20:16.308+0000 7f04fbd2d640 10 monclient: get_auth_request con 0x55c505a27000 auth_method 0 2023-10-03T19:21:28.512 INFO:teuthology.orchestra.run.smithi045.stdout: -1351> 2023-10-03T19:20:16.308+0000 7f04fbd2d640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] conn(0x55c505a27000 0x55c505aa3700 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:28.512 INFO:teuthology.orchestra.run.smithi045.stdout: -1350> 2023-10-03T19:20:16.308+0000 7f04fbd2d640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] conn(0x55c505a27c00 0x55c505b16b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:28.512 INFO:teuthology.orchestra.run.smithi045.stdout: -1349> 2023-10-03T19:20:16.308+0000 7f04fbd2d640 10 monclient: get_auth_request con 0x55c505a27c00 auth_method 0 2023-10-03T19:21:28.512 INFO:teuthology.orchestra.run.smithi045.stdout: -1348> 2023-10-03T19:20:16.312+0000 7f04fc52e640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] conn(0x55c505a27800 0x55c505b16580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:28.513 INFO:teuthology.orchestra.run.smithi045.stdout: -1347> 2023-10-03T19:20:16.312+0000 7f04fc52e640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] conn(0x55c505b22400 0x55c505b17600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:28.513 INFO:teuthology.orchestra.run.smithi045.stdout: -1346> 2023-10-03T19:20:16.312+0000 7f04fc52e640 10 monclient: get_auth_request con 0x55c505b22400 auth_method 0 2023-10-03T19:21:28.513 INFO:teuthology.orchestra.run.smithi045.stdout: -1345> 2023-10-03T19:20:16.312+0000 7f04fc52e640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] conn(0x55c505a26c00 0x55c505aa3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:28.513 INFO:teuthology.orchestra.run.smithi045.stdout: -1344> 2023-10-03T19:20:16.312+0000 7f04fc52e640 10 monclient: get_auth_request con 0x55c505a26c00 auth_method 0 2023-10-03T19:21:28.513 INFO:teuthology.orchestra.run.smithi045.stdout: -1343> 2023-10-03T19:20:16.312+0000 7f04fbd2d640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] conn(0x55c505b22800 0x55c505b17b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:28.513 INFO:teuthology.orchestra.run.smithi045.stdout: -1342> 2023-10-03T19:20:16.312+0000 7f04fbd2d640 10 monclient: get_auth_request con 0x55c505b22800 auth_method 0 2023-10-03T19:21:28.513 INFO:teuthology.orchestra.run.smithi045.stdout: -1341> 2023-10-03T19:20:16.312+0000 7f04fb52c640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] conn(0x55c505b22000 0x55c505b17080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:28.513 INFO:teuthology.orchestra.run.smithi045.stdout: -1340> 2023-10-03T19:20:16.312+0000 7f04fb52c640 10 monclient: get_auth_request con 0x55c505b22000 auth_method 0 2023-10-03T19:21:28.513 INFO:teuthology.orchestra.run.smithi045.stdout: -1339> 2023-10-03T19:20:16.312+0000 7f04fb52c640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] conn(0x55c505a27400 0x55c505b16000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:28.513 INFO:teuthology.orchestra.run.smithi045.stdout: -1338> 2023-10-03T19:20:16.312+0000 7f04fb52c640 10 monclient: get_auth_request con 0x55c505a27400 auth_method 0 2023-10-03T19:21:28.513 INFO:teuthology.orchestra.run.smithi045.stdout: -1337> 2023-10-03T19:20:16.312+0000 7f04fbd2d640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] conn(0x55c505a27c00 0x55c505b16b00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:28.514 INFO:teuthology.orchestra.run.smithi045.stdout: -1336> 2023-10-03T19:20:16.312+0000 7f04fb52c640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] conn(0x55c505b22000 0x55c505b17080 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:28.514 INFO:teuthology.orchestra.run.smithi045.stdout: -1335> 2023-10-03T19:20:16.312+0000 7f04fc52e640 10 monclient: get_auth_request con 0x55c505a27800 auth_method 0 2023-10-03T19:21:28.514 INFO:teuthology.orchestra.run.smithi045.stdout: -1334> 2023-10-03T19:20:16.316+0000 7f04fb52c640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] conn(0x55c505a27400 0x55c505b16000 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:28.514 INFO:teuthology.orchestra.run.smithi045.stdout: -1333> 2023-10-03T19:20:16.316+0000 7f04fbd2d640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] conn(0x55c505b22800 0x55c505b17b80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:28.514 INFO:teuthology.orchestra.run.smithi045.stdout: -1332> 2023-10-03T19:20:16.316+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 12 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c504b5e420 con 0x55c504afb400 2023-10-03T19:21:28.514 INFO:teuthology.orchestra.run.smithi045.stdout: -1331> 2023-10-03T19:20:16.316+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 1 version 108 2023-10-03T19:21:28.514 INFO:teuthology.orchestra.run.smithi045.stdout: -1330> 2023-10-03T19:20:16.316+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 13 ==== mon_get_version_reply(handle=2 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505accb00 con 0x55c504afb400 2023-10-03T19:21:28.514 INFO:teuthology.orchestra.run.smithi045.stdout: -1329> 2023-10-03T19:20:16.316+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 2 version 108 2023-10-03T19:21:28.514 INFO:teuthology.orchestra.run.smithi045.stdout: -1328> 2023-10-03T19:20:16.316+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 14 ==== mon_get_version_reply(handle=3 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505acc2c0 con 0x55c504afb400 2023-10-03T19:21:28.514 INFO:teuthology.orchestra.run.smithi045.stdout: -1327> 2023-10-03T19:20:16.316+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 3 version 108 2023-10-03T19:21:28.515 INFO:teuthology.orchestra.run.smithi045.stdout: -1326> 2023-10-03T19:20:16.316+0000 7f04fc52e640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] conn(0x55c505a26c00 0x55c505aa3180 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:28.515 INFO:teuthology.orchestra.run.smithi045.stdout: -1325> 2023-10-03T19:20:16.316+0000 7f04fc52e640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] conn(0x55c505b22400 0x55c505b17600 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:28.515 INFO:teuthology.orchestra.run.smithi045.stdout: -1324> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 15 ==== mon_get_version_reply(handle=4 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505acc580 con 0x55c504afb400 2023-10-03T19:21:28.515 INFO:teuthology.orchestra.run.smithi045.stdout: -1323> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 4 version 108 2023-10-03T19:21:28.515 INFO:teuthology.orchestra.run.smithi045.stdout: -1322> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 16 ==== mon_get_version_reply(handle=5 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505acc6e0 con 0x55c504afb400 2023-10-03T19:21:28.515 INFO:teuthology.orchestra.run.smithi045.stdout: -1321> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 5 version 108 2023-10-03T19:21:28.515 INFO:teuthology.orchestra.run.smithi045.stdout: -1320> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 17 ==== mon_get_version_reply(handle=6 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505acc840 con 0x55c504afb400 2023-10-03T19:21:28.515 INFO:teuthology.orchestra.run.smithi045.stdout: -1319> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 6 version 108 2023-10-03T19:21:28.515 INFO:teuthology.orchestra.run.smithi045.stdout: -1318> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 18 ==== mon_get_version_reply(handle=7 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505acd4a0 con 0x55c504afb400 2023-10-03T19:21:28.515 INFO:teuthology.orchestra.run.smithi045.stdout: -1317> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 7 version 108 2023-10-03T19:21:28.515 INFO:teuthology.orchestra.run.smithi045.stdout: -1316> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 19 ==== mon_get_version_reply(handle=8 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505accc60 con 0x55c504afb400 2023-10-03T19:21:28.516 INFO:teuthology.orchestra.run.smithi045.stdout: -1315> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 8 version 108 2023-10-03T19:21:28.516 INFO:teuthology.orchestra.run.smithi045.stdout: -1314> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 20 ==== mon_get_version_reply(handle=9 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505acc000 con 0x55c504afb400 2023-10-03T19:21:28.516 INFO:teuthology.orchestra.run.smithi045.stdout: -1313> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 9 version 108 2023-10-03T19:21:28.516 INFO:teuthology.orchestra.run.smithi045.stdout: -1312> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 21 ==== mon_get_version_reply(handle=10 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c504b5fce0 con 0x55c504afb400 2023-10-03T19:21:28.516 INFO:teuthology.orchestra.run.smithi045.stdout: -1311> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 10 version 108 2023-10-03T19:21:28.516 INFO:teuthology.orchestra.run.smithi045.stdout: -1310> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 22 ==== mon_get_version_reply(handle=11 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c504b5f760 con 0x55c504afb400 2023-10-03T19:21:28.516 INFO:teuthology.orchestra.run.smithi045.stdout: -1309> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 11 version 108 2023-10-03T19:21:28.516 INFO:teuthology.orchestra.run.smithi045.stdout: -1308> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 23 ==== mon_get_version_reply(handle=12 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505b8a000 con 0x55c504afb400 2023-10-03T19:21:28.516 INFO:teuthology.orchestra.run.smithi045.stdout: -1307> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 12 version 108 2023-10-03T19:21:28.516 INFO:teuthology.orchestra.run.smithi045.stdout: -1306> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 24 ==== mon_get_version_reply(handle=13 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505b8a160 con 0x55c504afb400 2023-10-03T19:21:28.516 INFO:teuthology.orchestra.run.smithi045.stdout: -1305> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 13 version 108 2023-10-03T19:21:28.516 INFO:teuthology.orchestra.run.smithi045.stdout: -1304> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 25 ==== mon_get_version_reply(handle=14 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505b8a2c0 con 0x55c504afb400 2023-10-03T19:21:28.517 INFO:teuthology.orchestra.run.smithi045.stdout: -1303> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 14 version 108 2023-10-03T19:21:28.517 INFO:teuthology.orchestra.run.smithi045.stdout: -1302> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 26 ==== mon_get_version_reply(handle=15 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505b8a420 con 0x55c504afb400 2023-10-03T19:21:28.517 INFO:teuthology.orchestra.run.smithi045.stdout: -1301> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 15 version 108 2023-10-03T19:21:28.517 INFO:teuthology.orchestra.run.smithi045.stdout: -1300> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 27 ==== mon_get_version_reply(handle=16 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505b8a580 con 0x55c504afb400 2023-10-03T19:21:28.517 INFO:teuthology.orchestra.run.smithi045.stdout: -1299> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 16 version 108 2023-10-03T19:21:28.517 INFO:teuthology.orchestra.run.smithi045.stdout: -1298> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 28 ==== mon_get_version_reply(handle=17 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505b8a6e0 con 0x55c504afb400 2023-10-03T19:21:28.517 INFO:teuthology.orchestra.run.smithi045.stdout: -1297> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 17 version 108 2023-10-03T19:21:28.517 INFO:teuthology.orchestra.run.smithi045.stdout: -1296> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 29 ==== mon_get_version_reply(handle=18 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505b8a840 con 0x55c504afb400 2023-10-03T19:21:28.517 INFO:teuthology.orchestra.run.smithi045.stdout: -1295> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 18 version 108 2023-10-03T19:21:28.517 INFO:teuthology.orchestra.run.smithi045.stdout: -1294> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 30 ==== mon_get_version_reply(handle=19 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505b8a9a0 con 0x55c504afb400 2023-10-03T19:21:28.518 INFO:teuthology.orchestra.run.smithi045.stdout: -1293> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 19 version 108 2023-10-03T19:21:28.518 INFO:teuthology.orchestra.run.smithi045.stdout: -1292> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 31 ==== mon_get_version_reply(handle=20 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505b8ab00 con 0x55c504afb400 2023-10-03T19:21:28.518 INFO:teuthology.orchestra.run.smithi045.stdout: -1291> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 20 version 108 2023-10-03T19:21:28.518 INFO:teuthology.orchestra.run.smithi045.stdout: -1290> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 32 ==== mon_get_version_reply(handle=21 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505b8ac60 con 0x55c504afb400 2023-10-03T19:21:28.518 INFO:teuthology.orchestra.run.smithi045.stdout: -1289> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 21 version 108 2023-10-03T19:21:28.518 INFO:teuthology.orchestra.run.smithi045.stdout: -1288> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 33 ==== mon_get_version_reply(handle=22 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505b8adc0 con 0x55c504afb400 2023-10-03T19:21:28.518 INFO:teuthology.orchestra.run.smithi045.stdout: -1287> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 22 version 108 2023-10-03T19:21:28.518 INFO:teuthology.orchestra.run.smithi045.stdout: -1286> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 34 ==== mon_get_version_reply(handle=23 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505b8af20 con 0x55c504afb400 2023-10-03T19:21:28.518 INFO:teuthology.orchestra.run.smithi045.stdout: -1285> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 23 version 108 2023-10-03T19:21:28.518 INFO:teuthology.orchestra.run.smithi045.stdout: -1284> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 35 ==== mon_get_version_reply(handle=24 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505b8b080 con 0x55c504afb400 2023-10-03T19:21:28.518 INFO:teuthology.orchestra.run.smithi045.stdout: -1283> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 24 version 108 2023-10-03T19:21:28.519 INFO:teuthology.orchestra.run.smithi045.stdout: -1282> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 36 ==== mon_get_version_reply(handle=25 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505b8b1e0 con 0x55c504afb400 2023-10-03T19:21:28.519 INFO:teuthology.orchestra.run.smithi045.stdout: -1281> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 25 version 108 2023-10-03T19:21:28.519 INFO:teuthology.orchestra.run.smithi045.stdout: -1280> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 37 ==== mon_get_version_reply(handle=26 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505b8b340 con 0x55c504afb400 2023-10-03T19:21:28.519 INFO:teuthology.orchestra.run.smithi045.stdout: -1279> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 26 version 108 2023-10-03T19:21:28.519 INFO:teuthology.orchestra.run.smithi045.stdout: -1278> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 38 ==== mon_get_version_reply(handle=27 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505b8b4a0 con 0x55c504afb400 2023-10-03T19:21:28.519 INFO:teuthology.orchestra.run.smithi045.stdout: -1277> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 27 version 108 2023-10-03T19:21:28.519 INFO:teuthology.orchestra.run.smithi045.stdout: -1276> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 39 ==== mon_get_version_reply(handle=28 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505b8b600 con 0x55c504afb400 2023-10-03T19:21:28.519 INFO:teuthology.orchestra.run.smithi045.stdout: -1275> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 28 version 108 2023-10-03T19:21:28.519 INFO:teuthology.orchestra.run.smithi045.stdout: -1274> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 40 ==== mon_get_version_reply(handle=29 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505b8b760 con 0x55c504afb400 2023-10-03T19:21:28.519 INFO:teuthology.orchestra.run.smithi045.stdout: -1273> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 29 version 108 2023-10-03T19:21:28.519 INFO:teuthology.orchestra.run.smithi045.stdout: -1272> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 41 ==== mon_get_version_reply(handle=30 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505b8b8c0 con 0x55c504afb400 2023-10-03T19:21:28.521 INFO:teuthology.orchestra.run.smithi045.stdout: -1271> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 30 version 108 2023-10-03T19:21:28.521 INFO:teuthology.orchestra.run.smithi045.stdout: -1270> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 42 ==== mon_get_version_reply(handle=31 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505b8ba20 con 0x55c504afb400 2023-10-03T19:21:28.521 INFO:teuthology.orchestra.run.smithi045.stdout: -1269> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 31 version 108 2023-10-03T19:21:28.521 INFO:teuthology.orchestra.run.smithi045.stdout: -1268> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 43 ==== mon_get_version_reply(handle=32 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505b8bb80 con 0x55c504afb400 2023-10-03T19:21:28.521 INFO:teuthology.orchestra.run.smithi045.stdout: -1267> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 32 version 108 2023-10-03T19:21:28.521 INFO:teuthology.orchestra.run.smithi045.stdout: -1266> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 44 ==== mon_get_version_reply(handle=33 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505b8bce0 con 0x55c504afb400 2023-10-03T19:21:28.521 INFO:teuthology.orchestra.run.smithi045.stdout: -1265> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 33 version 108 2023-10-03T19:21:28.522 INFO:teuthology.orchestra.run.smithi045.stdout: -1264> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 45 ==== mon_get_version_reply(handle=34 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505b8be40 con 0x55c504afb400 2023-10-03T19:21:28.522 INFO:teuthology.orchestra.run.smithi045.stdout: -1263> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 34 version 108 2023-10-03T19:21:28.522 INFO:teuthology.orchestra.run.smithi045.stdout: -1262> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 46 ==== mon_get_version_reply(handle=35 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505b8e000 con 0x55c504afb400 2023-10-03T19:21:28.522 INFO:teuthology.orchestra.run.smithi045.stdout: -1261> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 35 version 108 2023-10-03T19:21:28.522 INFO:teuthology.orchestra.run.smithi045.stdout: -1260> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 47 ==== mon_get_version_reply(handle=36 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505b8e160 con 0x55c504afb400 2023-10-03T19:21:28.522 INFO:teuthology.orchestra.run.smithi045.stdout: -1259> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 36 version 108 2023-10-03T19:21:28.522 INFO:teuthology.orchestra.run.smithi045.stdout: -1258> 2023-10-03T19:20:16.320+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 48 ==== mon_get_version_reply(handle=37 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505b8e2c0 con 0x55c504afb400 2023-10-03T19:21:28.522 INFO:teuthology.orchestra.run.smithi045.stdout: -1257> 2023-10-03T19:20:16.320+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 37 version 108 2023-10-03T19:21:28.522 INFO:teuthology.orchestra.run.smithi045.stdout: -1256> 2023-10-03T19:20:16.320+0000 7f04fc52e640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] conn(0x55c505a27800 0x55c505b16580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:28.522 INFO:teuthology.orchestra.run.smithi045.stdout: -1255> 2023-10-03T19:20:16.324+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.2 v2:172.21.15.45:6817/964866005 1 ==== osd_op_reply(22 608.00000000 [omap-set-header] v108'1 uv1 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55c505af6b40 con 0x55c505b22000 2023-10-03T19:21:28.522 INFO:teuthology.orchestra.run.smithi045.stdout: -1254> 2023-10-03T19:20:16.324+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.2 v2:172.21.15.45:6817/964866005 2 ==== osd_op_reply(23 608.00000000 [create,setxattr (62),setxattr (30)] v108'2 uv2 ondisk = 0) v8 ==== 240+0+0 (crc 0 0 0) 0x55c505af6b40 con 0x55c505b22000 2023-10-03T19:21:28.523 INFO:teuthology.orchestra.run.smithi045.stdout: -1253> 2023-10-03T19:20:16.328+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:28.523 INFO:teuthology.orchestra.run.smithi045.stdout: -1252> 2023-10-03T19:20:16.328+0000 7f04f2d1b640 10 MDSContext::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:28.523 INFO:teuthology.orchestra.run.smithi045.stdout: -1251> 2023-10-03T19:20:16.328+0000 7f04f2d1b640 10 mds.0.cache.dir(0x608) _committed v 1 on [dir 0x608 ~mds0/stray8/ [2,head] auth v=1 cv=1/0 ap=1+0 state=1610612769|complete|committing f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa5b00] 2023-10-03T19:21:28.523 INFO:teuthology.orchestra.run.smithi045.stdout: -1250> 2023-10-03T19:20:16.328+0000 7f04f2d1b640 10 mds.0.cache.dir(0x608) mark_clean [dir 0x608 ~mds0/stray8/ [2,head] auth v=1 cv=1/1 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa5b00] version 1 2023-10-03T19:21:28.523 INFO:teuthology.orchestra.run.smithi045.stdout: -1249> 2023-10-03T19:20:16.328+0000 7f04f2d1b640 10 mds.0.cache.dir(0x608) auth_unpin by 0x55c505aa5b00 on [dir 0x608 ~mds0/stray8/ [2,head] auth v=1 cv=1/1 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x55c505aa5b00] count now 0 2023-10-03T19:21:28.523 INFO:teuthology.orchestra.run.smithi045.stdout: -1248> 2023-10-03T19:20:16.328+0000 7f04f451e640 7 mds.0.54 mds has 1 queued contexts 2023-10-03T19:21:28.523 INFO:teuthology.orchestra.run.smithi045.stdout: -1247> 2023-10-03T19:20:16.328+0000 7f04f451e640 10 mds.0.54 finish 0x55c5058c78e0 2023-10-03T19:21:28.523 INFO:teuthology.orchestra.run.smithi045.stdout: -1246> 2023-10-03T19:20:16.328+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:28.523 INFO:teuthology.orchestra.run.smithi045.stdout: -1245> 2023-10-03T19:20:16.328+0000 7f04f2d1b640 10 MDSContext::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:28.523 INFO:teuthology.orchestra.run.smithi045.stdout: -1244> 2023-10-03T19:20:16.328+0000 7f04f2d1b640 10 mds.0.cache.ino(0x608) _stored_backtrace v 0 2023-10-03T19:21:28.523 INFO:teuthology.orchestra.run.smithi045.stdout: -1243> 2023-10-03T19:20:16.328+0000 7f04f2d1b640 10 mds.0.cache.ino(0x608) auth_unpin by 0x55c505aa2100 on [inode 0x608 [...2,head] ~mds0/stray8/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.307164+0000 1=0+1) (iversion lock) | dirfrag=0 dirtyparent=1 authpin=0 0x55c505aa2100] now 0 2023-10-03T19:21:28.523 INFO:teuthology.orchestra.run.smithi045.stdout: -1242> 2023-10-03T19:20:16.328+0000 7f04f2d1b640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins -1 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/0 dir_auth=0 ap=1+9 state=1610612769|complete|committing f(v0 10=0+10) n(v0 rc2023-10-03T19:20:16.307241+0000 10=0+10) hs=10+0,ss=0+0 dirty=10 | child=1 subtree=1 dirty=1 authpin=1 0x55c504b69180] by 0x55c505aa2100 count now 1/9 2023-10-03T19:21:28.524 INFO:teuthology.orchestra.run.smithi045.stdout: -1241> 2023-10-03T19:20:16.328+0000 7f04f2d1b640 10 mds.0.cache.ino(0x608) clear_dirty_parent 2023-10-03T19:21:28.524 INFO:teuthology.orchestra.run.smithi045.stdout: -1240> 2023-10-03T19:20:16.328+0000 7f04fbd2d640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.1 v2:172.21.15.45:6808/1433143371 1 ==== osd_op_reply(37 200.00000006 [delete] v108'1 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55c504c6cfc0 con 0x55c505a27000 2023-10-03T19:21:28.524 INFO:teuthology.orchestra.run.smithi045.stdout: -1239> 2023-10-03T19:20:16.332+0000 7f04fbd2d640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.1 v2:172.21.15.45:6808/1433143371 2 ==== osd_op_reply(2 400.00000000 [writefull 0~22] v108'1 uv1 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55c504c6cfc0 con 0x55c505a27000 2023-10-03T19:21:28.524 INFO:teuthology.orchestra.run.smithi045.stdout: -1238> 2023-10-03T19:20:16.332+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.0 v2:172.21.15.45:6800/1057586985 1 ==== osd_op_reply(24 609.00000000 [omap-set-header] v108'1 uv1 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55c505af6fc0 con 0x55c505b22400 2023-10-03T19:21:28.524 INFO:teuthology.orchestra.run.smithi045.stdout: -1237> 2023-10-03T19:20:16.332+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:28.524 INFO:teuthology.orchestra.run.smithi045.stdout: -1236> 2023-10-03T19:20:16.332+0000 7f04f2d1b640 10 MDSContext::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:28.524 INFO:teuthology.orchestra.run.smithi045.stdout: -1235> 2023-10-03T19:20:16.332+0000 7f04f2d1b640 10 mds.0.cache.dir(0x609) _committed v 1 on [dir 0x609 ~mds0/stray9/ [2,head] auth v=1 cv=1/0 ap=1+0 state=1610612769|complete|committing f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa5f80] 2023-10-03T19:21:28.524 INFO:teuthology.orchestra.run.smithi045.stdout: -1234> 2023-10-03T19:20:16.332+0000 7f04f2d1b640 10 mds.0.cache.dir(0x609) mark_clean [dir 0x609 ~mds0/stray9/ [2,head] auth v=1 cv=1/1 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa5f80] version 1 2023-10-03T19:21:28.524 INFO:teuthology.orchestra.run.smithi045.stdout: -1233> 2023-10-03T19:20:16.332+0000 7f04f2d1b640 10 mds.0.cache.dir(0x609) auth_unpin by 0x55c505aa5f80 on [dir 0x609 ~mds0/stray9/ [2,head] auth v=1 cv=1/1 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x55c505aa5f80] count now 0 2023-10-03T19:21:28.524 INFO:teuthology.orchestra.run.smithi045.stdout: -1232> 2023-10-03T19:20:16.332+0000 7f04f451e640 7 mds.0.54 mds has 1 queued contexts 2023-10-03T19:21:28.524 INFO:teuthology.orchestra.run.smithi045.stdout: -1231> 2023-10-03T19:20:16.332+0000 7f04f451e640 10 mds.0.54 finish 0x55c5058c7930 2023-10-03T19:21:28.525 INFO:teuthology.orchestra.run.smithi045.stdout: -1230> 2023-10-03T19:20:16.332+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.0 v2:172.21.15.45:6800/1057586985 2 ==== osd_op_reply(36 200.00000005 [delete] v108'1 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55c505af6fc0 con 0x55c505b22400 2023-10-03T19:21:28.525 INFO:teuthology.orchestra.run.smithi045.stdout: -1229> 2023-10-03T19:20:16.332+0000 7f04fbd2d640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.4 v2:172.21.15.79:6810/2234162464 1 ==== osd_op_reply(33 200.00000002 [delete] v108'1 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55c504c6cfc0 con 0x55c505b22800 2023-10-03T19:21:28.525 INFO:teuthology.orchestra.run.smithi045.stdout: -1228> 2023-10-03T19:20:16.336+0000 7f04fbd2d640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.1 v2:172.21.15.45:6808/1433143371 3 ==== osd_op_reply(20 607.00000000 [omap-set-header] v108'1 uv1 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55c504c6cfc0 con 0x55c505a27000 2023-10-03T19:21:28.525 INFO:teuthology.orchestra.run.smithi045.stdout: -1227> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:28.525 INFO:teuthology.orchestra.run.smithi045.stdout: -1226> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 MDSContext::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:28.525 INFO:teuthology.orchestra.run.smithi045.stdout: -1225> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 mds.0.cache.dir(0x607) _committed v 1 on [dir 0x607 ~mds0/stray7/ [2,head] auth v=1 cv=1/0 ap=1+0 state=1610612769|complete|committing f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa5680] 2023-10-03T19:21:28.525 INFO:teuthology.orchestra.run.smithi045.stdout: -1224> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 mds.0.cache.dir(0x607) mark_clean [dir 0x607 ~mds0/stray7/ [2,head] auth v=1 cv=1/1 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa5680] version 1 2023-10-03T19:21:28.525 INFO:teuthology.orchestra.run.smithi045.stdout: -1223> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 mds.0.cache.dir(0x607) auth_unpin by 0x55c505aa5680 on [dir 0x607 ~mds0/stray7/ [2,head] auth v=1 cv=1/1 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x55c505aa5680] count now 0 2023-10-03T19:21:28.525 INFO:teuthology.orchestra.run.smithi045.stdout: -1222> 2023-10-03T19:20:16.336+0000 7f04f451e640 7 mds.0.54 mds has 1 queued contexts 2023-10-03T19:21:28.525 INFO:teuthology.orchestra.run.smithi045.stdout: -1221> 2023-10-03T19:20:16.336+0000 7f04f451e640 10 mds.0.54 finish 0x55c5058c7890 2023-10-03T19:21:28.525 INFO:teuthology.orchestra.run.smithi045.stdout: -1220> 2023-10-03T19:20:16.336+0000 7f04fbd2d640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.1 v2:172.21.15.45:6808/1433143371 4 ==== osd_op_reply(21 607.00000000 [create,setxattr (62),setxattr (30)] v108'2 uv2 ondisk = 0) v8 ==== 240+0+0 (crc 0 0 0) 0x55c504c6cfc0 con 0x55c505a27000 2023-10-03T19:21:28.526 INFO:teuthology.orchestra.run.smithi045.stdout: -1219> 2023-10-03T19:20:16.336+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.0 v2:172.21.15.45:6800/1057586985 3 ==== osd_op_reply(25 609.00000000 [create,setxattr (62),setxattr (30)] v108'2 uv2 ondisk = 0) v8 ==== 240+0+0 (crc 0 0 0) 0x55c505af6fc0 con 0x55c505b22400 2023-10-03T19:21:28.526 INFO:teuthology.orchestra.run.smithi045.stdout: -1218> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:28.526 INFO:teuthology.orchestra.run.smithi045.stdout: -1217> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 MDSContext::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:28.526 INFO:teuthology.orchestra.run.smithi045.stdout: -1216> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 mds.0.cache.ino(0x607) _stored_backtrace v 0 2023-10-03T19:21:28.526 INFO:teuthology.orchestra.run.smithi045.stdout: -1215> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 mds.0.cache.ino(0x607) auth_unpin by 0x55c505aa1b80 on [inode 0x607 [...2,head] ~mds0/stray7/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.307060+0000 1=0+1) (iversion lock) | dirfrag=0 dirtyparent=1 authpin=0 0x55c505aa1b80] now 0 2023-10-03T19:21:28.526 INFO:teuthology.orchestra.run.smithi045.stdout: -1214> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins -1 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/0 dir_auth=0 ap=1+8 state=1610612769|complete|committing f(v0 10=0+10) n(v0 rc2023-10-03T19:20:16.307241+0000 10=0+10) hs=10+0,ss=0+0 dirty=10 | child=1 subtree=1 dirty=1 authpin=1 0x55c504b69180] by 0x55c505aa1b80 count now 1/8 2023-10-03T19:21:28.526 INFO:teuthology.orchestra.run.smithi045.stdout: -1213> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 mds.0.cache.ino(0x607) clear_dirty_parent 2023-10-03T19:21:28.526 INFO:teuthology.orchestra.run.smithi045.stdout: -1212> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:28.526 INFO:teuthology.orchestra.run.smithi045.stdout: -1211> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 MDSContext::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:28.526 INFO:teuthology.orchestra.run.smithi045.stdout: -1210> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 mds.0.cache.ino(0x609) _stored_backtrace v 0 2023-10-03T19:21:28.602 INFO:teuthology.orchestra.run.smithi045.stdout: -1209> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 mds.0.cache.ino(0x609) auth_unpin by 0x55c505aa2680 on [inode 0x609 [...2,head] ~mds0/stray9/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.307241+0000 1=0+1) (iversion lock) | dirfrag=0 dirtyparent=1 authpin=0 0x55c505aa2680] now 0 2023-10-03T19:21:28.602 INFO:teuthology.orchestra.run.smithi045.stdout: -1208> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins -1 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/0 dir_auth=0 ap=1+7 state=1610612769|complete|committing f(v0 10=0+10) n(v0 rc2023-10-03T19:20:16.307241+0000 10=0+10) hs=10+0,ss=0+0 dirty=10 | child=1 subtree=1 dirty=1 authpin=1 0x55c504b69180] by 0x55c505aa2680 count now 1/7 2023-10-03T19:21:28.602 INFO:teuthology.orchestra.run.smithi045.stdout: -1207> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 mds.0.cache.ino(0x609) clear_dirty_parent 2023-10-03T19:21:28.602 INFO:teuthology.orchestra.run.smithi045.stdout: -1206> 2023-10-03T19:20:16.336+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.3 v2:172.21.15.45:6816/4227059688 1 ==== osd_op_reply(18 606.00000000 [omap-set-header] v108'1 uv1 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55c505af6fc0 con 0x55c505a26c00 2023-10-03T19:21:28.602 INFO:teuthology.orchestra.run.smithi045.stdout: -1205> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:28.602 INFO:teuthology.orchestra.run.smithi045.stdout: -1204> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 MDSContext::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:28.602 INFO:teuthology.orchestra.run.smithi045.stdout: -1203> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 mds.0.cache.dir(0x606) _committed v 1 on [dir 0x606 ~mds0/stray6/ [2,head] auth v=1 cv=1/0 ap=1+0 state=1610612769|complete|committing f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa5200] 2023-10-03T19:21:28.602 INFO:teuthology.orchestra.run.smithi045.stdout: -1202> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 mds.0.cache.dir(0x606) mark_clean [dir 0x606 ~mds0/stray6/ [2,head] auth v=1 cv=1/1 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa5200] version 1 2023-10-03T19:21:28.602 INFO:teuthology.orchestra.run.smithi045.stdout: -1201> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 mds.0.cache.dir(0x606) auth_unpin by 0x55c505aa5200 on [dir 0x606 ~mds0/stray6/ [2,head] auth v=1 cv=1/1 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x55c505aa5200] count now 0 2023-10-03T19:21:28.602 INFO:teuthology.orchestra.run.smithi045.stdout: -1200> 2023-10-03T19:20:16.336+0000 7f04f451e640 7 mds.0.54 mds has 1 queued contexts 2023-10-03T19:21:28.603 INFO:teuthology.orchestra.run.smithi045.stdout: -1199> 2023-10-03T19:20:16.336+0000 7f04f451e640 10 mds.0.54 finish 0x55c5058c7800 2023-10-03T19:21:28.603 INFO:teuthology.orchestra.run.smithi045.stdout: -1198> 2023-10-03T19:20:16.336+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.3 v2:172.21.15.45:6816/4227059688 2 ==== osd_op_reply(19 606.00000000 [create,setxattr (62),setxattr (30)] v108'2 uv2 ondisk = 0) v8 ==== 240+0+0 (crc 0 0 0) 0x55c505af6fc0 con 0x55c505a26c00 2023-10-03T19:21:28.603 INFO:teuthology.orchestra.run.smithi045.stdout: -1197> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:28.603 INFO:teuthology.orchestra.run.smithi045.stdout: -1196> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 MDSContext::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:28.603 INFO:teuthology.orchestra.run.smithi045.stdout: -1195> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 mds.0.cache.ino(0x606) _stored_backtrace v 0 2023-10-03T19:21:28.603 INFO:teuthology.orchestra.run.smithi045.stdout: -1194> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 mds.0.cache.ino(0x606) auth_unpin by 0x55c505aa1600 on [inode 0x606 [...2,head] ~mds0/stray6/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.306978+0000 1=0+1) (iversion lock) | dirfrag=0 dirtyparent=1 authpin=0 0x55c505aa1600] now 0 2023-10-03T19:21:28.603 INFO:teuthology.orchestra.run.smithi045.stdout: -1193> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins -1 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/0 dir_auth=0 ap=1+6 state=1610612769|complete|committing f(v0 10=0+10) n(v0 rc2023-10-03T19:20:16.307241+0000 10=0+10) hs=10+0,ss=0+0 dirty=10 | child=1 subtree=1 dirty=1 authpin=1 0x55c504b69180] by 0x55c505aa1600 count now 1/6 2023-10-03T19:21:28.603 INFO:teuthology.orchestra.run.smithi045.stdout: -1192> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 mds.0.cache.ino(0x606) clear_dirty_parent 2023-10-03T19:21:28.603 INFO:teuthology.orchestra.run.smithi045.stdout: -1191> 2023-10-03T19:20:16.336+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.3 v2:172.21.15.45:6816/4227059688 3 ==== osd_op_reply(1 200.00000000 [writefull 0~90] v108'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55c505af6fc0 con 0x55c505a26c00 2023-10-03T19:21:28.603 INFO:teuthology.orchestra.run.smithi045.stdout: -1190> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 12C_IO_Wrapper 2023-10-03T19:21:28.603 INFO:teuthology.orchestra.run.smithi045.stdout: -1189> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 MDSContext::complete: 12C_IO_Wrapper 2023-10-03T19:21:28.604 INFO:teuthology.orchestra.run.smithi045.stdout: -1188> 2023-10-03T19:20:16.336+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.3 v2:172.21.15.45:6816/4227059688 4 ==== osd_op_reply(3 1.00000000.inode [writefull 0~582] v108'4 uv4 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x55c505af6fc0 con 0x55c505a26c00 2023-10-03T19:21:28.604 INFO:teuthology.orchestra.run.smithi045.stdout: -1187> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 17C_IO_Inode_Stored 2023-10-03T19:21:28.604 INFO:teuthology.orchestra.run.smithi045.stdout: -1186> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 MDSContext::complete: 17C_IO_Inode_Stored 2023-10-03T19:21:28.604 INFO:teuthology.orchestra.run.smithi045.stdout: -1185> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 mds.0.cache.ino(0x1) _stored 1 on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.604 INFO:teuthology.orchestra.run.smithi045.stdout: -1184> 2023-10-03T19:20:16.336+0000 7f04f2d1b640 10 mds.0.cache.ino(0x1) mark_clean [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.604 INFO:teuthology.orchestra.run.smithi045.stdout: -1183> 2023-10-03T19:20:16.340+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.3 v2:172.21.15.45:6816/4227059688 5 ==== osd_op_reply(32 200.00000001 [delete] v108'5 uv4 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55c505af6fc0 con 0x55c505a26c00 2023-10-03T19:21:28.604 INFO:teuthology.orchestra.run.smithi045.stdout: -1182> 2023-10-03T19:20:16.340+0000 7f04f2d1b640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.54:38 17.14 17:2e2fa760:::200.00000001:head [write 0~892 in=892b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e108) v8 -- 0x55c505b14000 con 0x55c505a26c00 2023-10-03T19:21:28.604 INFO:teuthology.orchestra.run.smithi045.stdout: -1181> 2023-10-03T19:20:16.344+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.3 v2:172.21.15.45:6816/4227059688 6 ==== osd_op_reply(6 600.00000000 [create,setxattr (62),setxattr (30)] v108'1 uv1 ondisk = 0) v8 ==== 240+0+0 (crc 0 0 0) 0x55c505af6fc0 con 0x55c505a26c00 2023-10-03T19:21:28.604 INFO:teuthology.orchestra.run.smithi045.stdout: -1180> 2023-10-03T19:20:16.344+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:28.604 INFO:teuthology.orchestra.run.smithi045.stdout: -1179> 2023-10-03T19:20:16.344+0000 7f04f2d1b640 10 MDSContext::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:28.605 INFO:teuthology.orchestra.run.smithi045.stdout: -1178> 2023-10-03T19:20:16.344+0000 7f04f2d1b640 10 mds.0.cache.ino(0x600) _stored_backtrace v 0 2023-10-03T19:21:28.605 INFO:teuthology.orchestra.run.smithi045.stdout: -1177> 2023-10-03T19:20:16.344+0000 7f04f2d1b640 10 mds.0.cache.ino(0x600) auth_unpin by 0x55c504b89180 on [inode 0x600 [...2,head] ~mds0/stray0/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.306261+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=0 0x55c504b89180] now 0 2023-10-03T19:21:28.605 INFO:teuthology.orchestra.run.smithi045.stdout: -1176> 2023-10-03T19:20:16.344+0000 7f04f2d1b640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins -1 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/0 dir_auth=0 ap=1+5 state=1610612769|complete|committing f(v0 10=0+10) n(v0 rc2023-10-03T19:20:16.307241+0000 10=0+10) hs=10+0,ss=0+0 dirty=10 | child=1 subtree=1 dirty=1 authpin=1 0x55c504b69180] by 0x55c504b89180 count now 1/5 2023-10-03T19:21:28.605 INFO:teuthology.orchestra.run.smithi045.stdout: -1175> 2023-10-03T19:20:16.344+0000 7f04f2d1b640 10 mds.0.cache.ino(0x600) clear_dirty_parent 2023-10-03T19:21:28.605 INFO:teuthology.orchestra.run.smithi045.stdout: -1174> 2023-10-03T19:20:16.356+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.3 v2:172.21.15.45:6816/4227059688 7 ==== osd_op_reply(38 200.00000001 [write 0~892] v108'6 uv6 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55c505af6fc0 con 0x55c505a26c00 2023-10-03T19:21:28.605 INFO:teuthology.orchestra.run.smithi045.stdout: -1173> 2023-10-03T19:20:16.356+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 13C_MDL_Flushed 2023-10-03T19:21:28.605 INFO:teuthology.orchestra.run.smithi045.stdout: -1172> 2023-10-03T19:20:16.356+0000 7f04f2d1b640 10 MDSContext::complete: 13C_MDL_Flushed 2023-10-03T19:21:28.605 INFO:teuthology.orchestra.run.smithi045.stdout: -1171> 2023-10-03T19:20:16.356+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.3 v2:172.21.15.45:6816/4227059688 8 ==== osd_op_reply(7 600.00000000 [omap-set-header] v108'2 uv2 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55c505af6fc0 con 0x55c505a26c00 2023-10-03T19:21:28.605 INFO:teuthology.orchestra.run.smithi045.stdout: -1170> 2023-10-03T19:20:16.356+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:28.605 INFO:teuthology.orchestra.run.smithi045.stdout: -1169> 2023-10-03T19:20:16.356+0000 7f04f2d1b640 10 MDSContext::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:28.605 INFO:teuthology.orchestra.run.smithi045.stdout: -1168> 2023-10-03T19:20:16.356+0000 7f04f2d1b640 10 mds.0.cache.dir(0x600) _committed v 1 on [dir 0x600 ~mds0/stray0/ [2,head] auth v=1 cv=1/0 ap=1+0 state=1610612769|complete|committing f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c504b69600] 2023-10-03T19:21:28.606 INFO:teuthology.orchestra.run.smithi045.stdout: -1167> 2023-10-03T19:20:16.356+0000 7f04f2d1b640 10 mds.0.cache.dir(0x600) mark_clean [dir 0x600 ~mds0/stray0/ [2,head] auth v=1 cv=1/1 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c504b69600] version 1 2023-10-03T19:21:28.606 INFO:teuthology.orchestra.run.smithi045.stdout: -1166> 2023-10-03T19:20:16.356+0000 7f04f2d1b640 10 mds.0.cache.dir(0x600) auth_unpin by 0x55c504b69600 on [dir 0x600 ~mds0/stray0/ [2,head] auth v=1 cv=1/1 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x55c504b69600] count now 0 2023-10-03T19:21:28.606 INFO:teuthology.orchestra.run.smithi045.stdout: -1165> 2023-10-03T19:20:16.356+0000 7f04f451e640 7 mds.0.54 mds has 1 queued contexts 2023-10-03T19:21:28.606 INFO:teuthology.orchestra.run.smithi045.stdout: -1164> 2023-10-03T19:20:16.356+0000 7f04f451e640 10 mds.0.54 finish 0x55c5058c75c0 2023-10-03T19:21:28.606 INFO:teuthology.orchestra.run.smithi045.stdout: -1163> 2023-10-03T19:20:16.360+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.3 v2:172.21.15.45:6816/4227059688 9 ==== osd_op_reply(8 601.00000000 [create,setxattr (62),setxattr (30)] v108'3 uv3 ondisk = 0) v8 ==== 240+0+0 (crc 0 0 0) 0x55c505af6fc0 con 0x55c505a26c00 2023-10-03T19:21:28.606 INFO:teuthology.orchestra.run.smithi045.stdout: -1162> 2023-10-03T19:20:16.360+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:28.606 INFO:teuthology.orchestra.run.smithi045.stdout: -1161> 2023-10-03T19:20:16.360+0000 7f04f2d1b640 10 MDSContext::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:28.606 INFO:teuthology.orchestra.run.smithi045.stdout: -1160> 2023-10-03T19:20:16.360+0000 7f04f2d1b640 10 mds.0.cache.ino(0x601) _stored_backtrace v 0 2023-10-03T19:21:28.606 INFO:teuthology.orchestra.run.smithi045.stdout: -1159> 2023-10-03T19:20:16.360+0000 7f04f2d1b640 10 mds.0.cache.ino(0x601) auth_unpin by 0x55c504b89700 on [inode 0x601 [...2,head] ~mds0/stray1/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.306512+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=0 0x55c504b89700] now 0 2023-10-03T19:21:28.606 INFO:teuthology.orchestra.run.smithi045.stdout: -1158> 2023-10-03T19:20:16.360+0000 7f04f2d1b640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins -1 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/0 dir_auth=0 ap=1+4 state=1610612769|complete|committing f(v0 10=0+10) n(v0 rc2023-10-03T19:20:16.307241+0000 10=0+10) hs=10+0,ss=0+0 dirty=10 | child=1 subtree=1 dirty=1 authpin=1 0x55c504b69180] by 0x55c504b89700 count now 1/4 2023-10-03T19:21:28.606 INFO:teuthology.orchestra.run.smithi045.stdout: -1157> 2023-10-03T19:20:16.360+0000 7f04f2d1b640 10 mds.0.cache.ino(0x601) clear_dirty_parent 2023-10-03T19:21:28.607 INFO:teuthology.orchestra.run.smithi045.stdout: -1156> 2023-10-03T19:20:16.360+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.3 v2:172.21.15.45:6816/4227059688 10 ==== osd_op_reply(9 601.00000000 [omap-set-header] v108'4 uv4 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55c505af6fc0 con 0x55c505a26c00 2023-10-03T19:21:28.607 INFO:teuthology.orchestra.run.smithi045.stdout: -1155> 2023-10-03T19:20:16.360+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:28.607 INFO:teuthology.orchestra.run.smithi045.stdout: -1154> 2023-10-03T19:20:16.360+0000 7f04f2d1b640 10 MDSContext::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:28.607 INFO:teuthology.orchestra.run.smithi045.stdout: -1153> 2023-10-03T19:20:16.360+0000 7f04f2d1b640 10 mds.0.cache.dir(0x601) _committed v 1 on [dir 0x601 ~mds0/stray1/ [2,head] auth v=1 cv=1/0 ap=1+0 state=1610612769|complete|committing f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c504b69a80] 2023-10-03T19:21:28.607 INFO:teuthology.orchestra.run.smithi045.stdout: -1152> 2023-10-03T19:20:16.360+0000 7f04f2d1b640 10 mds.0.cache.dir(0x601) mark_clean [dir 0x601 ~mds0/stray1/ [2,head] auth v=1 cv=1/1 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c504b69a80] version 1 2023-10-03T19:21:28.607 INFO:teuthology.orchestra.run.smithi045.stdout: -1151> 2023-10-03T19:20:16.360+0000 7f04f2d1b640 10 mds.0.cache.dir(0x601) auth_unpin by 0x55c504b69a80 on [dir 0x601 ~mds0/stray1/ [2,head] auth v=1 cv=1/1 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x55c504b69a80] count now 0 2023-10-03T19:21:28.607 INFO:teuthology.orchestra.run.smithi045.stdout: -1150> 2023-10-03T19:20:16.360+0000 7f04f451e640 7 mds.0.54 mds has 1 queued contexts 2023-10-03T19:21:28.607 INFO:teuthology.orchestra.run.smithi045.stdout: -1149> 2023-10-03T19:20:16.360+0000 7f04f451e640 10 mds.0.54 finish 0x55c5058c7640 2023-10-03T19:21:28.607 INFO:teuthology.orchestra.run.smithi045.stdout: -1148> 2023-10-03T19:20:16.364+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.3 v2:172.21.15.45:6816/4227059688 11 ==== osd_op_reply(10 602.00000000 [omap-set-header] v108'5 uv5 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55c505af6fc0 con 0x55c505a26c00 2023-10-03T19:21:28.607 INFO:teuthology.orchestra.run.smithi045.stdout: -1147> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:28.607 INFO:teuthology.orchestra.run.smithi045.stdout: -1146> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 MDSContext::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:28.607 INFO:teuthology.orchestra.run.smithi045.stdout: -1145> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 mds.0.cache.dir(0x602) _committed v 1 on [dir 0x602 ~mds0/stray2/ [2,head] auth v=1 cv=1/0 ap=1+0 state=1610612769|complete|committing f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa4000] 2023-10-03T19:21:28.608 INFO:teuthology.orchestra.run.smithi045.stdout: -1144> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 mds.0.cache.dir(0x602) mark_clean [dir 0x602 ~mds0/stray2/ [2,head] auth v=1 cv=1/1 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa4000] version 1 2023-10-03T19:21:28.608 INFO:teuthology.orchestra.run.smithi045.stdout: -1143> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 mds.0.cache.dir(0x602) auth_unpin by 0x55c505aa4000 on [dir 0x602 ~mds0/stray2/ [2,head] auth v=1 cv=1/1 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x55c505aa4000] count now 0 2023-10-03T19:21:28.608 INFO:teuthology.orchestra.run.smithi045.stdout: -1142> 2023-10-03T19:20:16.364+0000 7f04f451e640 7 mds.0.54 mds has 1 queued contexts 2023-10-03T19:21:28.608 INFO:teuthology.orchestra.run.smithi045.stdout: -1141> 2023-10-03T19:20:16.364+0000 7f04f451e640 10 mds.0.54 finish 0x55c5058c7690 2023-10-03T19:21:28.608 INFO:teuthology.orchestra.run.smithi045.stdout: -1140> 2023-10-03T19:20:16.364+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.3 v2:172.21.15.45:6816/4227059688 12 ==== osd_op_reply(11 602.00000000 [create,setxattr (62),setxattr (30)] v108'6 uv6 ondisk = 0) v8 ==== 240+0+0 (crc 0 0 0) 0x55c505af6fc0 con 0x55c505a26c00 2023-10-03T19:21:28.608 INFO:teuthology.orchestra.run.smithi045.stdout: -1139> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:28.608 INFO:teuthology.orchestra.run.smithi045.stdout: -1138> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 MDSContext::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:28.608 INFO:teuthology.orchestra.run.smithi045.stdout: -1137> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 mds.0.cache.ino(0x602) _stored_backtrace v 0 2023-10-03T19:21:28.608 INFO:teuthology.orchestra.run.smithi045.stdout: -1136> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 mds.0.cache.ino(0x602) auth_unpin by 0x55c505aa0000 on [inode 0x602 [...2,head] ~mds0/stray2/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.306648+0000 1=0+1) (iversion lock) | dirfrag=0 dirtyparent=1 authpin=0 0x55c505aa0000] now 0 2023-10-03T19:21:28.608 INFO:teuthology.orchestra.run.smithi045.stdout: -1135> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins -1 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/0 dir_auth=0 ap=1+3 state=1610612769|complete|committing f(v0 10=0+10) n(v0 rc2023-10-03T19:20:16.307241+0000 10=0+10) hs=10+0,ss=0+0 dirty=10 | child=1 subtree=1 dirty=1 authpin=1 0x55c504b69180] by 0x55c505aa0000 count now 1/3 2023-10-03T19:21:28.608 INFO:teuthology.orchestra.run.smithi045.stdout: -1134> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 mds.0.cache.ino(0x602) clear_dirty_parent 2023-10-03T19:21:28.608 INFO:teuthology.orchestra.run.smithi045.stdout: -1133> 2023-10-03T19:20:16.364+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.3 v2:172.21.15.45:6816/4227059688 13 ==== osd_op_reply(12 603.00000000 [omap-set-header] v108'7 uv7 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55c505af6fc0 con 0x55c505a26c00 2023-10-03T19:21:28.609 INFO:teuthology.orchestra.run.smithi045.stdout: -1132> 2023-10-03T19:20:16.364+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.0 v2:172.21.15.45:6800/1057586985 4 ==== osd_op_reply(28 mds0_sessionmap [omap-set-header] v108'1 uv1 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x55c505af6fc0 con 0x55c505b22400 2023-10-03T19:21:28.609 INFO:teuthology.orchestra.run.smithi045.stdout: -1131> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:28.609 INFO:teuthology.orchestra.run.smithi045.stdout: -1130> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 MDSContext::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:28.609 INFO:teuthology.orchestra.run.smithi045.stdout: -1129> 2023-10-03T19:20:16.364+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.3 v2:172.21.15.45:6816/4227059688 14 ==== osd_op_reply(13 603.00000000 [create,setxattr (62),setxattr (30)] v108'8 uv8 ondisk = 0) v8 ==== 240+0+0 (crc 0 0 0) 0x55c505af6fc0 con 0x55c505a26c00 2023-10-03T19:21:28.609 INFO:teuthology.orchestra.run.smithi045.stdout: -1128> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 mds.0.cache.dir(0x603) _committed v 1 on [dir 0x603 ~mds0/stray3/ [2,head] auth v=1 cv=1/0 ap=1+0 state=1610612769|complete|committing f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa4480] 2023-10-03T19:21:28.609 INFO:teuthology.orchestra.run.smithi045.stdout: -1127> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 mds.0.cache.dir(0x603) mark_clean [dir 0x603 ~mds0/stray3/ [2,head] auth v=1 cv=1/1 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa4480] version 1 2023-10-03T19:21:28.609 INFO:teuthology.orchestra.run.smithi045.stdout: -1126> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 mds.0.cache.dir(0x603) auth_unpin by 0x55c505aa4480 on [dir 0x603 ~mds0/stray3/ [2,head] auth v=1 cv=1/1 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x55c505aa4480] count now 0 2023-10-03T19:21:28.609 INFO:teuthology.orchestra.run.smithi045.stdout: -1125> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 MDSIOContextBase::complete: N12_GLOBAL__N_112C_IO_SM_SaveE 2023-10-03T19:21:28.609 INFO:teuthology.orchestra.run.smithi045.stdout: -1124> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 MDSContext::complete: N12_GLOBAL__N_112C_IO_SM_SaveE 2023-10-03T19:21:28.609 INFO:teuthology.orchestra.run.smithi045.stdout: -1123> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 mds.0.sessionmap _save_finish v0 2023-10-03T19:21:28.609 INFO:teuthology.orchestra.run.smithi045.stdout: -1122> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:28.610 INFO:teuthology.orchestra.run.smithi045.stdout: -1121> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 MDSContext::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:28.610 INFO:teuthology.orchestra.run.smithi045.stdout: -1120> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 mds.0.cache.ino(0x603) _stored_backtrace v 0 2023-10-03T19:21:28.610 INFO:teuthology.orchestra.run.smithi045.stdout: -1119> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 mds.0.cache.ino(0x603) auth_unpin by 0x55c505aa0580 on [inode 0x603 [...2,head] ~mds0/stray3/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.306751+0000 1=0+1) (iversion lock) | dirfrag=0 dirtyparent=1 authpin=0 0x55c505aa0580] now 0 2023-10-03T19:21:28.610 INFO:teuthology.orchestra.run.smithi045.stdout: -1118> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins -1 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/0 dir_auth=0 ap=1+2 state=1610612769|complete|committing f(v0 10=0+10) n(v0 rc2023-10-03T19:20:16.307241+0000 10=0+10) hs=10+0,ss=0+0 dirty=10 | child=1 subtree=1 dirty=1 authpin=1 0x55c504b69180] by 0x55c505aa0580 count now 1/2 2023-10-03T19:21:28.638 INFO:teuthology.orchestra.run.smithi045.stdout: -1117> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 mds.0.cache.ino(0x603) clear_dirty_parent 2023-10-03T19:21:28.639 INFO:teuthology.orchestra.run.smithi045.stdout: -1116> 2023-10-03T19:20:16.364+0000 7f04f451e640 7 mds.0.54 mds has 1 queued contexts 2023-10-03T19:21:28.639 INFO:teuthology.orchestra.run.smithi045.stdout: -1115> 2023-10-03T19:20:16.364+0000 7f04f451e640 10 mds.0.54 finish 0x55c5058c76e0 2023-10-03T19:21:28.639 INFO:teuthology.orchestra.run.smithi045.stdout: -1114> 2023-10-03T19:20:16.364+0000 7f04fbd2d640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.7 v2:172.21.15.79:6818/3323397754 1 ==== osd_op_reply(31 mds_snaptable [writefull 0~70] v108'1 uv1 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x55c504c6cfc0 con 0x55c505a27c00 2023-10-03T19:21:28.639 INFO:teuthology.orchestra.run.smithi045.stdout: -1113> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 12C_IO_MT_Save 2023-10-03T19:21:28.639 INFO:teuthology.orchestra.run.smithi045.stdout: -1112> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 MDSContext::complete: 12C_IO_MT_Save 2023-10-03T19:21:28.639 INFO:teuthology.orchestra.run.smithi045.stdout: -1111> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 mds.0.snaptable: save_2 v 1 2023-10-03T19:21:28.639 INFO:teuthology.orchestra.run.smithi045.stdout: -1110> 2023-10-03T19:20:16.364+0000 7f04fbd2d640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.7 v2:172.21.15.79:6818/3323397754 2 ==== osd_op_reply(16 605.00000000 [omap-set-header] v108'1 uv1 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55c504c6cfc0 con 0x55c505a27c00 2023-10-03T19:21:28.639 INFO:teuthology.orchestra.run.smithi045.stdout: -1109> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:28.639 INFO:teuthology.orchestra.run.smithi045.stdout: -1108> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 MDSContext::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:28.639 INFO:teuthology.orchestra.run.smithi045.stdout: -1107> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 mds.0.cache.dir(0x605) _committed v 1 on [dir 0x605 ~mds0/stray5/ [2,head] auth v=1 cv=1/0 ap=1+0 state=1610612769|complete|committing f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa4d80] 2023-10-03T19:21:28.640 INFO:teuthology.orchestra.run.smithi045.stdout: -1106> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 mds.0.cache.dir(0x605) mark_clean [dir 0x605 ~mds0/stray5/ [2,head] auth v=1 cv=1/1 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa4d80] version 1 2023-10-03T19:21:28.640 INFO:teuthology.orchestra.run.smithi045.stdout: -1105> 2023-10-03T19:20:16.364+0000 7f04f2d1b640 10 mds.0.cache.dir(0x605) auth_unpin by 0x55c505aa4d80 on [dir 0x605 ~mds0/stray5/ [2,head] auth v=1 cv=1/1 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x55c505aa4d80] count now 0 2023-10-03T19:21:28.640 INFO:teuthology.orchestra.run.smithi045.stdout: -1104> 2023-10-03T19:20:16.364+0000 7f04f451e640 7 mds.0.54 mds has 1 queued contexts 2023-10-03T19:21:28.640 INFO:teuthology.orchestra.run.smithi045.stdout: -1103> 2023-10-03T19:20:16.364+0000 7f04f451e640 10 mds.0.54 finish 0x55c5058c77b0 2023-10-03T19:21:28.640 INFO:teuthology.orchestra.run.smithi045.stdout: -1102> 2023-10-03T19:20:16.368+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.0 v2:172.21.15.45:6800/1057586985 5 ==== osd_op_reply(34 200.00000003 [delete] v108'2 uv1 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55c505af6fc0 con 0x55c505b22400 2023-10-03T19:21:28.640 INFO:teuthology.orchestra.run.smithi045.stdout: -1101> 2023-10-03T19:20:16.372+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.3 v2:172.21.15.45:6816/4227059688 15 ==== osd_op_reply(29 100.00000000 [omap-set-header,omap-set-vals] v108'1 uv1 ondisk = 0) v8 ==== 198+0+0 (crc 0 0 0) 0x55c505af6fc0 con 0x55c505a26c00 2023-10-03T19:21:28.640 INFO:teuthology.orchestra.run.smithi045.stdout: -1100> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:28.640 INFO:teuthology.orchestra.run.smithi045.stdout: -1099> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 MDSContext::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:28.640 INFO:teuthology.orchestra.run.smithi045.stdout: -1098> 2023-10-03T19:20:16.372+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.3 v2:172.21.15.45:6816/4227059688 16 ==== osd_op_reply(27 mds0_inotable [writefull 0~34] v108'2 uv2 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x55c505af6fc0 con 0x55c505a26c00 2023-10-03T19:21:28.640 INFO:teuthology.orchestra.run.smithi045.stdout: -1097> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 mds.0.cache.dir(0x100) _committed v 1 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/0 dir_auth=0 ap=1+2 state=1610612769|complete|committing f(v0 10=0+10) n(v0 rc2023-10-03T19:20:16.307241+0000 10=0+10) hs=10+0,ss=0+0 dirty=10 | child=1 subtree=1 dirty=1 authpin=1 0x55c504b69180] 2023-10-03T19:21:28.640 INFO:teuthology.orchestra.run.smithi045.stdout: -1096> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 mds.0.cache.dir(0x100) mark_clean [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 ap=1+2 state=1610612737|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:20:16.307241+0000 10=0+10) hs=10+0,ss=0+0 dirty=10 | child=1 subtree=1 dirty=1 authpin=1 0x55c504b69180] version 1 2023-10-03T19:21:28.641 INFO:teuthology.orchestra.run.smithi045.stdout: -1095> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 15 mds.0.cache.dir(0x100) dir 1 >= dn 0 now clean [dentry #0x100/stray0 [2,head] auth (dversion lock) v=0 ino=0x600 state=1610612736 | inodepin=0 dirty=1 0x55c505878500] 2023-10-03T19:21:28.641 INFO:teuthology.orchestra.run.smithi045.stdout: -1094> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 mds.0.cache.den(0x100 stray0) mark_clean [dentry #0x100/stray0 [2,head] auth (dversion lock) v=0 ino=0x600 state=1610612736 | inodepin=0 dirty=1 0x55c505878500] 2023-10-03T19:21:28.641 INFO:teuthology.orchestra.run.smithi045.stdout: -1093> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 15 mds.0.cache.dir(0x100) dir 1 >= dn 0 now clean [dentry #0x100/stray1 [2,head] auth (dversion lock) v=0 ino=0x601 state=1610612736 | inodepin=0 dirty=1 0x55c505878780] 2023-10-03T19:21:28.641 INFO:teuthology.orchestra.run.smithi045.stdout: -1092> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 mds.0.cache.den(0x100 stray1) mark_clean [dentry #0x100/stray1 [2,head] auth (dversion lock) v=0 ino=0x601 state=1610612736 | inodepin=0 dirty=1 0x55c505878780] 2023-10-03T19:21:28.641 INFO:teuthology.orchestra.run.smithi045.stdout: -1091> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 15 mds.0.cache.dir(0x100) dir 1 >= dn 0 now clean [dentry #0x100/stray2 [2,head] auth (dversion lock) v=0 ino=0x602 state=1610612736 | inodepin=0 dirty=1 0x55c505878a00] 2023-10-03T19:21:28.641 INFO:teuthology.orchestra.run.smithi045.stdout: -1090> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 mds.0.cache.den(0x100 stray2) mark_clean [dentry #0x100/stray2 [2,head] auth (dversion lock) v=0 ino=0x602 state=1610612736 | inodepin=0 dirty=1 0x55c505878a00] 2023-10-03T19:21:28.641 INFO:teuthology.orchestra.run.smithi045.stdout: -1089> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 15 mds.0.cache.dir(0x100) dir 1 >= dn 0 now clean [dentry #0x100/stray3 [2,head] auth (dversion lock) v=0 ino=0x603 state=1610612736 | inodepin=0 dirty=1 0x55c505878c80] 2023-10-03T19:21:28.641 INFO:teuthology.orchestra.run.smithi045.stdout: -1088> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 mds.0.cache.den(0x100 stray3) mark_clean [dentry #0x100/stray3 [2,head] auth (dversion lock) v=0 ino=0x603 state=1610612736 | inodepin=0 dirty=1 0x55c505878c80] 2023-10-03T19:21:28.641 INFO:teuthology.orchestra.run.smithi045.stdout: -1087> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 15 mds.0.cache.dir(0x100) dir 1 >= dn 0 now clean [dentry #0x100/stray4 [2,head] auth (dversion lock) v=0 ino=0x604 state=1610612736 | inodepin=1 dirty=1 0x55c505878f00] 2023-10-03T19:21:28.641 INFO:teuthology.orchestra.run.smithi045.stdout: -1086> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 mds.0.cache.den(0x100 stray4) mark_clean [dentry #0x100/stray4 [2,head] auth (dversion lock) v=0 ino=0x604 state=1610612736 | inodepin=1 dirty=1 0x55c505878f00] 2023-10-03T19:21:28.641 INFO:teuthology.orchestra.run.smithi045.stdout: -1085> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 15 mds.0.cache.dir(0x100) dir 1 >= dn 0 now clean [dentry #0x100/stray5 [2,head] auth (dversion lock) v=0 ino=0x605 state=1610612736 | inodepin=1 dirty=1 0x55c505879180] 2023-10-03T19:21:28.641 INFO:teuthology.orchestra.run.smithi045.stdout: -1084> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 mds.0.cache.den(0x100 stray5) mark_clean [dentry #0x100/stray5 [2,head] auth (dversion lock) v=0 ino=0x605 state=1610612736 | inodepin=1 dirty=1 0x55c505879180] 2023-10-03T19:21:28.642 INFO:teuthology.orchestra.run.smithi045.stdout: -1083> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 15 mds.0.cache.dir(0x100) dir 1 >= dn 0 now clean [dentry #0x100/stray6 [2,head] auth (dversion lock) v=0 ino=0x606 state=1610612736 | inodepin=0 dirty=1 0x55c505879400] 2023-10-03T19:21:28.642 INFO:teuthology.orchestra.run.smithi045.stdout: -1082> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 mds.0.cache.den(0x100 stray6) mark_clean [dentry #0x100/stray6 [2,head] auth (dversion lock) v=0 ino=0x606 state=1610612736 | inodepin=0 dirty=1 0x55c505879400] 2023-10-03T19:21:28.642 INFO:teuthology.orchestra.run.smithi045.stdout: -1081> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 15 mds.0.cache.dir(0x100) dir 1 >= dn 0 now clean [dentry #0x100/stray7 [2,head] auth (dversion lock) v=0 ino=0x607 state=1610612736 | inodepin=0 dirty=1 0x55c505879680] 2023-10-03T19:21:28.642 INFO:teuthology.orchestra.run.smithi045.stdout: -1080> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 mds.0.cache.den(0x100 stray7) mark_clean [dentry #0x100/stray7 [2,head] auth (dversion lock) v=0 ino=0x607 state=1610612736 | inodepin=0 dirty=1 0x55c505879680] 2023-10-03T19:21:28.642 INFO:teuthology.orchestra.run.smithi045.stdout: -1079> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 15 mds.0.cache.dir(0x100) dir 1 >= dn 0 now clean [dentry #0x100/stray8 [2,head] auth (dversion lock) v=0 ino=0x608 state=1610612736 | inodepin=0 dirty=1 0x55c505879900] 2023-10-03T19:21:28.642 INFO:teuthology.orchestra.run.smithi045.stdout: -1078> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 mds.0.cache.den(0x100 stray8) mark_clean [dentry #0x100/stray8 [2,head] auth (dversion lock) v=0 ino=0x608 state=1610612736 | inodepin=0 dirty=1 0x55c505879900] 2023-10-03T19:21:28.642 INFO:teuthology.orchestra.run.smithi045.stdout: -1077> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 15 mds.0.cache.dir(0x100) dir 1 >= dn 0 now clean [dentry #0x100/stray9 [2,head] auth (dversion lock) v=0 ino=0x609 state=1610612736 | inodepin=0 dirty=1 0x55c505879b80] 2023-10-03T19:21:28.642 INFO:teuthology.orchestra.run.smithi045.stdout: -1076> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 mds.0.cache.den(0x100 stray9) mark_clean [dentry #0x100/stray9 [2,head] auth (dversion lock) v=0 ino=0x609 state=1610612736 | inodepin=0 dirty=1 0x55c505879b80] 2023-10-03T19:21:28.642 INFO:teuthology.orchestra.run.smithi045.stdout: -1075> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 mds.0.cache.dir(0x100) auth_unpin by 0x55c504b69180 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 ap=0+2 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:20:16.307241+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55c504b69180] count now 0 2023-10-03T19:21:28.642 INFO:teuthology.orchestra.run.smithi045.stdout: -1074> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 12C_IO_MT_Save 2023-10-03T19:21:28.643 INFO:teuthology.orchestra.run.smithi045.stdout: -1073> 2023-10-03T19:20:16.372+0000 7f04f451e640 7 mds.0.54 mds has 1 queued contexts 2023-10-03T19:21:28.643 INFO:teuthology.orchestra.run.smithi045.stdout: -1072> 2023-10-03T19:20:16.372+0000 7f04f451e640 10 mds.0.54 finish 0x55c5058c7590 2023-10-03T19:21:28.643 INFO:teuthology.orchestra.run.smithi045.stdout: -1071> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 MDSContext::complete: 12C_IO_MT_Save 2023-10-03T19:21:28.643 INFO:teuthology.orchestra.run.smithi045.stdout: -1070> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 mds.0.inotable: save_2 v 0 2023-10-03T19:21:28.643 INFO:teuthology.orchestra.run.smithi045.stdout: -1069> 2023-10-03T19:20:16.372+0000 7f04fbd2d640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.7 v2:172.21.15.79:6818/3323397754 3 ==== osd_op_reply(17 605.00000000 [create,setxattr (62),setxattr (30)] v108'2 uv2 ondisk = 0) v8 ==== 240+0+0 (crc 0 0 0) 0x55c504c6cfc0 con 0x55c505a27c00 2023-10-03T19:21:28.643 INFO:teuthology.orchestra.run.smithi045.stdout: -1068> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:28.643 INFO:teuthology.orchestra.run.smithi045.stdout: -1067> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 MDSContext::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:28.643 INFO:teuthology.orchestra.run.smithi045.stdout: -1066> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 mds.0.cache.ino(0x605) _stored_backtrace v 0 2023-10-03T19:21:28.643 INFO:teuthology.orchestra.run.smithi045.stdout: -1065> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 mds.0.cache.ino(0x605) auth_unpin by 0x55c505aa1080 on [inode 0x605 [...2,head] ~mds0/stray5/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.306901+0000 1=0+1) (iversion lock) | dirfrag=0 dirtyparent=1 authpin=0 0x55c505aa1080] now 0 2023-10-03T19:21:28.643 INFO:teuthology.orchestra.run.smithi045.stdout: -1064> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins -1 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 ap=0+1 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:20:16.307241+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55c504b69180] by 0x55c505aa1080 count now 0/1 2023-10-03T19:21:28.643 INFO:teuthology.orchestra.run.smithi045.stdout: -1063> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 mds.0.cache.ino(0x605) clear_dirty_parent 2023-10-03T19:21:28.643 INFO:teuthology.orchestra.run.smithi045.stdout: -1062> 2023-10-03T19:20:16.372+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.5 v2:172.21.15.79:6802/2879380539 1 ==== osd_op_reply(14 604.00000000 [omap-set-header] v108'1 uv1 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55c505af6fc0 con 0x55c505a27800 2023-10-03T19:21:28.644 INFO:teuthology.orchestra.run.smithi045.stdout: -1061> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:28.644 INFO:teuthology.orchestra.run.smithi045.stdout: -1060> 2023-10-03T19:20:16.372+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.5 v2:172.21.15.79:6802/2879380539 2 ==== osd_op_reply(15 604.00000000 [create,setxattr (62),setxattr (30)] v108'2 uv2 ondisk = 0) v8 ==== 240+0+0 (crc 0 0 0) 0x55c505af6fc0 con 0x55c505a27800 2023-10-03T19:21:28.644 INFO:teuthology.orchestra.run.smithi045.stdout: -1059> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 MDSContext::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:28.644 INFO:teuthology.orchestra.run.smithi045.stdout: -1058> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 mds.0.cache.dir(0x604) _committed v 1 on [dir 0x604 ~mds0/stray4/ [2,head] auth v=1 cv=1/0 ap=1+0 state=1610612769|complete|committing f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa4900] 2023-10-03T19:21:28.644 INFO:teuthology.orchestra.run.smithi045.stdout: -1057> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 mds.0.cache.dir(0x604) mark_clean [dir 0x604 ~mds0/stray4/ [2,head] auth v=1 cv=1/1 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | dirty=1 authpin=1 0x55c505aa4900] version 1 2023-10-03T19:21:28.644 INFO:teuthology.orchestra.run.smithi045.stdout: -1056> 2023-10-03T19:20:16.372+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.5 v2:172.21.15.79:6802/2879380539 3 ==== osd_op_reply(30 500.00000000 [writefull 0~90] v108'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55c505af6fc0 con 0x55c505a27800 2023-10-03T19:21:28.644 INFO:teuthology.orchestra.run.smithi045.stdout: -1055> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 mds.0.cache.dir(0x604) auth_unpin by 0x55c505aa4900 on [dir 0x604 ~mds0/stray4/ [2,head] auth v=1 cv=1/1 state=1073741825|complete f() n() hs=0+0,ss=0+0 0x55c505aa4900] count now 0 2023-10-03T19:21:28.644 INFO:teuthology.orchestra.run.smithi045.stdout: -1054> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:28.644 INFO:teuthology.orchestra.run.smithi045.stdout: -1053> 2023-10-03T19:20:16.372+0000 7f04f451e640 7 mds.0.54 mds has 1 queued contexts 2023-10-03T19:21:28.644 INFO:teuthology.orchestra.run.smithi045.stdout: -1052> 2023-10-03T19:20:16.372+0000 7f04f451e640 10 mds.0.54 finish 0x55c5058c7730 2023-10-03T19:21:28.644 INFO:teuthology.orchestra.run.smithi045.stdout: -1051> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 MDSContext::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:28.644 INFO:teuthology.orchestra.run.smithi045.stdout: -1050> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 mds.0.cache.ino(0x604) _stored_backtrace v 0 2023-10-03T19:21:28.645 INFO:teuthology.orchestra.run.smithi045.stdout: -1049> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 mds.0.cache.ino(0x604) auth_unpin by 0x55c505aa0b00 on [inode 0x604 [...2,head] ~mds0/stray4/ auth v1 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.306831+0000 1=0+1) (iversion lock) | dirfrag=0 dirtyparent=1 authpin=0 0x55c505aa0b00] now 0 2023-10-03T19:21:28.645 INFO:teuthology.orchestra.run.smithi045.stdout: -1048> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 15 mds.0.cache.dir(0x100) adjust_nested_auth_pins -1 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:20:16.307241+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55c504b69180] by 0x55c505aa0b00 count now 0/0 2023-10-03T19:21:28.645 INFO:teuthology.orchestra.run.smithi045.stdout: -1047> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 mds.0.cache.ino(0x604) clear_dirty_parent 2023-10-03T19:21:28.645 INFO:teuthology.orchestra.run.smithi045.stdout: -1046> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 12C_IO_Wrapper 2023-10-03T19:21:28.645 INFO:teuthology.orchestra.run.smithi045.stdout: -1045> 2023-10-03T19:20:16.372+0000 7f04f2d1b640 10 MDSContext::complete: 12C_IO_Wrapper 2023-10-03T19:21:28.645 INFO:teuthology.orchestra.run.smithi045.stdout: -1044> 2023-10-03T19:20:16.376+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.6 v2:172.21.15.79:6819/1486010128 1 ==== osd_op_reply(4 1.00000000 [omap-set-header] v108'1 uv1 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x55c505af6b40 con 0x55c505a27400 2023-10-03T19:21:28.645 INFO:teuthology.orchestra.run.smithi045.stdout: -1043> 2023-10-03T19:20:16.376+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:28.645 INFO:teuthology.orchestra.run.smithi045.stdout: -1042> 2023-10-03T19:20:16.376+0000 7f04f2d1b640 10 MDSContext::complete: 18C_IO_Dir_Committed 2023-10-03T19:21:28.645 INFO:teuthology.orchestra.run.smithi045.stdout: -1041> 2023-10-03T19:20:16.376+0000 7f04f2d1b640 10 mds.0.cache.dir(0x1) _committed v 1 on [dir 0x1 / [2,head] auth v=1 cv=1/0 REP dir_auth=0 ap=1+0 state=1610612769|complete|committing f() n() hs=0+0,ss=0+0 | subtree=1 dirty=1 authpin=1 0x55c504b68d00] 2023-10-03T19:21:28.645 INFO:teuthology.orchestra.run.smithi045.stdout: -1040> 2023-10-03T19:20:16.376+0000 7f04f2d1b640 10 mds.0.cache.dir(0x1) mark_clean [dir 0x1 / [2,head] auth v=1 cv=1/1 REP dir_auth=0 ap=1+0 state=1610612737|complete f() n() hs=0+0,ss=0+0 | subtree=1 dirty=1 authpin=1 0x55c504b68d00] version 1 2023-10-03T19:21:28.645 INFO:teuthology.orchestra.run.smithi045.stdout: -1039> 2023-10-03T19:20:16.376+0000 7f04f2d1b640 10 mds.0.cache.dir(0x1) auth_unpin by 0x55c504b68d00 on [dir 0x1 / [2,head] auth v=1 cv=1/1 REP dir_auth=0 state=1073741825|complete f() n() hs=0+0,ss=0+0 | subtree=1 dirty=0 authpin=0 0x55c504b68d00] count now 0 2023-10-03T19:21:28.645 INFO:teuthology.orchestra.run.smithi045.stdout: -1038> 2023-10-03T19:20:16.376+0000 7f04f451e640 7 mds.0.54 mds has 1 queued contexts 2023-10-03T19:21:28.646 INFO:teuthology.orchestra.run.smithi045.stdout: -1037> 2023-10-03T19:20:16.376+0000 7f04f451e640 10 mds.0.54 finish 0x55c5058c7550 2023-10-03T19:21:28.646 INFO:teuthology.orchestra.run.smithi045.stdout: -1036> 2023-10-03T19:20:16.376+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.6 v2:172.21.15.79:6819/1486010128 2 ==== osd_op_reply(5 1.00000000 [create,setxattr (30),setxattr (30)] v108'2 uv2 ondisk = 0) v8 ==== 238+0+0 (crc 0 0 0) 0x55c505af6b40 con 0x55c505a27400 2023-10-03T19:21:28.646 INFO:teuthology.orchestra.run.smithi045.stdout: -1035> 2023-10-03T19:20:16.376+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:28.646 INFO:teuthology.orchestra.run.smithi045.stdout: -1034> 2023-10-03T19:20:16.376+0000 7f04f2d1b640 10 MDSContext::complete: 26C_IO_Inode_StoredBacktrace 2023-10-03T19:21:28.646 INFO:teuthology.orchestra.run.smithi045.stdout: -1033> 2023-10-03T19:20:16.376+0000 7f04f2d1b640 10 mds.0.cache.ino(0x1) _stored_backtrace v 0 2023-10-03T19:21:28.646 INFO:teuthology.orchestra.run.smithi045.stdout: -1032> 2023-10-03T19:20:16.376+0000 7f04f2d1b640 10 mds.0.cache.ino(0x1) auth_unpin by 0x55c504b88680 on [inode 0x1 [...2,head] / auth v1 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iversion lock) | dirfrag=1 dirtyparent=1 authpin=0 0x55c504b88680] now 0 2023-10-03T19:21:28.646 INFO:teuthology.orchestra.run.smithi045.stdout: -1031> 2023-10-03T19:20:16.376+0000 7f04f2d1b640 10 mds.0.cache.ino(0x1) clear_dirty_parent 2023-10-03T19:21:28.646 INFO:teuthology.orchestra.run.smithi045.stdout: -1030> 2023-10-03T19:20:16.376+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.6 v2:172.21.15.79:6819/1486010128 3 ==== osd_op_reply(26 100.00000000.inode [writefull 0~582] v108'3 uv3 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x55c505af6b40 con 0x55c505a27400 2023-10-03T19:21:28.646 INFO:teuthology.orchestra.run.smithi045.stdout: -1029> 2023-10-03T19:20:16.376+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 17C_IO_Inode_Stored 2023-10-03T19:21:28.646 INFO:teuthology.orchestra.run.smithi045.stdout: -1028> 2023-10-03T19:20:16.376+0000 7f04f2d1b640 10 MDSContext::complete: 17C_IO_Inode_Stored 2023-10-03T19:21:28.646 INFO:teuthology.orchestra.run.smithi045.stdout: -1027> 2023-10-03T19:20:16.376+0000 7f04f2d1b640 10 mds.0.cache.ino(0x100) _stored 1 on [inode 0x100 [...2,head] ~mds0/ auth v1 snaprealm=0x55c504c6db00 f(v0 10=0+10) n(v0 rc2023-10-03T19:20:16.307241+0000 11=0+11) (iversion lock) | dirfrag=1 0x55c504b88c00] 2023-10-03T19:21:28.647 INFO:teuthology.orchestra.run.smithi045.stdout: -1026> 2023-10-03T19:20:16.376+0000 7f04f2d1b640 10 mds.0.cache.ino(0x100) mark_clean [inode 0x100 [...2,head] ~mds0/ auth v1 snaprealm=0x55c504c6db00 f(v0 10=0+10) n(v0 rc2023-10-03T19:20:16.307241+0000 11=0+11) (iversion lock) | dirfrag=1 0x55c504b88c00] 2023-10-03T19:21:28.647 INFO:teuthology.orchestra.run.smithi045.stdout: -1025> 2023-10-03T19:20:16.376+0000 7f04f2d1b640 10 MDSContext::complete: 12C_MDS_VoidFn 2023-10-03T19:21:28.647 INFO:teuthology.orchestra.run.smithi045.stdout: -1024> 2023-10-03T19:20:16.376+0000 7f04f2d1b640 1 mds.0.54 creating_done 2023-10-03T19:21:28.647 INFO:teuthology.orchestra.run.smithi045.stdout: -1023> 2023-10-03T19:20:16.376+0000 7f04f2d1b640 3 mds.0.54 request_state up:active 2023-10-03T19:21:28.647 INFO:teuthology.orchestra.run.smithi045.stdout: -1022> 2023-10-03T19:20:16.376+0000 7f04f2d1b640 5 mds.beacon.a set_want_state: up:creating -> up:active 2023-10-03T19:21:28.647 INFO:teuthology.orchestra.run.smithi045.stdout: -1021> 2023-10-03T19:20:16.376+0000 7f04f2d1b640 5 mds.beacon.a Sending beacon up:active seq 3 2023-10-03T19:21:28.647 INFO:teuthology.orchestra.run.smithi045.stdout: -1020> 2023-10-03T19:20:16.376+0000 7f04f2d1b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.647 INFO:teuthology.orchestra.run.smithi045.stdout: -1019> 2023-10-03T19:20:16.376+0000 7f04f2d1b640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mdsbeacon(7602/a up:active seq=3 v54) v8 -- 0x55c504bc6b00 con 0x55c504afb400 2023-10-03T19:21:28.647 INFO:teuthology.orchestra.run.smithi045.stdout: -1018> 2023-10-03T19:20:16.376+0000 7f04f2d1b640 10 mds.0.snapclient sync 2023-10-03T19:21:28.647 INFO:teuthology.orchestra.run.smithi045.stdout: -1017> 2023-10-03T19:20:16.376+0000 7f04f2d1b640 10 mds.0.snapclient refresh want 1 2023-10-03T19:21:28.647 INFO:teuthology.orchestra.run.smithi045.stdout: -1016> 2023-10-03T19:20:16.376+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.6 v2:172.21.15.79:6819/1486010128 4 ==== osd_op_reply(35 200.00000004 [delete] v108'4 uv3 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55c505af6b40 con 0x55c505a27400 2023-10-03T19:21:28.647 INFO:teuthology.orchestra.run.smithi045.stdout: -1015> 2023-10-03T19:20:16.892+0000 7f04f6522640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgrreport(unknown.a +130-0 packed 1558) v9 -- 0x55c505b15c00 con 0x55c505a26000 2023-10-03T19:21:28.648 INFO:teuthology.orchestra.run.smithi045.stdout: -1014> 2023-10-03T19:20:16.924+0000 7f04f7d25640 10 monclient: tick 2023-10-03T19:21:28.648 INFO:teuthology.orchestra.run.smithi045.stdout: -1013> 2023-10-03T19:20:16.924+0000 7f04f7d25640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.648 INFO:teuthology.orchestra.run.smithi045.stdout: -1012> 2023-10-03T19:20:16.924+0000 7f04f7d25640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:46.929166+0000) 2023-10-03T19:21:28.648 INFO:teuthology.orchestra.run.smithi045.stdout: -1011> 2023-10-03T19:20:17.304+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 49 ==== mdsmap(e 55) v2 ==== 1100+0+0 (secure 0 0 0) 0x55c5059c3860 con 0x55c504afb400 2023-10-03T19:21:28.648 INFO:teuthology.orchestra.run.smithi045.stdout: -1010> 2023-10-03T19:20:17.304+0000 7f04f8d27640 1 mds.a Updating MDS map to version 55 from mon.0 2023-10-03T19:21:28.648 INFO:teuthology.orchestra.run.smithi045.stdout: -1009> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 mds.a my compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-03T19:21:28.648 INFO:teuthology.orchestra.run.smithi045.stdout: -1008> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 mds.a mdsmap compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-03T19:21:28.648 INFO:teuthology.orchestra.run.smithi045.stdout: -1007> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 mds.a my gid is 7602 2023-10-03T19:21:28.648 INFO:teuthology.orchestra.run.smithi045.stdout: -1006> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 mds.a map says I am mds.0.54 state up:active 2023-10-03T19:21:28.648 INFO:teuthology.orchestra.run.smithi045.stdout: -1005> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 mds.a msgr says I am [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] 2023-10-03T19:21:28.648 INFO:teuthology.orchestra.run.smithi045.stdout: -1004> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 mds.a handle_mds_map: handling map as rank 0 2023-10-03T19:21:28.648 INFO:teuthology.orchestra.run.smithi045.stdout: -1003> 2023-10-03T19:20:17.304+0000 7f04f8d27640 1 mds.0.54 handle_mds_map i am now mds.0.54 2023-10-03T19:21:28.649 INFO:teuthology.orchestra.run.smithi045.stdout: -1002> 2023-10-03T19:20:17.304+0000 7f04f8d27640 1 mds.0.54 handle_mds_map state change up:creating --> up:active 2023-10-03T19:21:28.649 INFO:teuthology.orchestra.run.smithi045.stdout: -1001> 2023-10-03T19:20:17.304+0000 7f04f8d27640 1 mds.0.54 recovery_done -- successful recovery! 2023-10-03T19:21:28.649 INFO:teuthology.orchestra.run.smithi045.stdout: -1000> 2023-10-03T19:20:17.304+0000 7f04f8d27640 1 mds.0.54 active_start 2023-10-03T19:21:28.649 INFO:teuthology.orchestra.run.smithi045.stdout: -999> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 mds.0.cache open_root 2023-10-03T19:21:28.649 INFO:teuthology.orchestra.run.smithi045.stdout: -998> 2023-10-03T19:20:17.304+0000 7f04f8d27640 7 mds.0.cache adjust_subtree_auth 0,-2 -> 0,-2 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:20:16.307241+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55c504b69180] 2023-10-03T19:21:28.649 INFO:teuthology.orchestra.run.smithi045.stdout: -997> 2023-10-03T19:20:17.304+0000 7f04f8d27640 15 mds.0.cache show_subtrees 2023-10-03T19:21:28.649 INFO:teuthology.orchestra.run.smithi045.stdout: -996> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 mds.0.cache |__ 0 auth [dir 0x1 / [2,head] auth v=1 cv=1/1 REP dir_auth=0 state=1073741825|complete f() n() hs=0+0,ss=0+0 | subtree=1 dirty=0 authpin=0 0x55c504b68d00] 2023-10-03T19:21:28.649 INFO:teuthology.orchestra.run.smithi045.stdout: -995> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 mds.0.cache |__ 0 auth [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:20:16.307241+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55c504b69180] 2023-10-03T19:21:28.649 INFO:teuthology.orchestra.run.smithi045.stdout: -994> 2023-10-03T19:20:17.304+0000 7f04f8d27640 7 mds.0.cache current root is [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:20:16.307241+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55c504b69180] 2023-10-03T19:21:28.649 INFO:teuthology.orchestra.run.smithi045.stdout: -993> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 mds.0.cache.dir(0x100) setting dir_auth=0,-2 from 0,-2 on [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:20:16.307241+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55c504b69180] 2023-10-03T19:21:28.649 INFO:teuthology.orchestra.run.smithi045.stdout: -992> 2023-10-03T19:20:17.304+0000 7f04f8d27640 15 mds.0.cache show_subtrees 2023-10-03T19:21:28.650 INFO:teuthology.orchestra.run.smithi045.stdout: -991> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 mds.0.cache |__ 0 auth [dir 0x1 / [2,head] auth v=1 cv=1/1 REP dir_auth=0 state=1073741825|complete f() n() hs=0+0,ss=0+0 | subtree=1 dirty=0 authpin=0 0x55c504b68d00] 2023-10-03T19:21:28.650 INFO:teuthology.orchestra.run.smithi045.stdout: -990> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 mds.0.cache |__ 0 auth [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:20:16.307241+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55c504b69180] 2023-10-03T19:21:28.650 INFO:teuthology.orchestra.run.smithi045.stdout: -989> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 mds.0.cache populate_mydir [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:20:16.307241+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55c504b69180] 2023-10-03T19:21:28.650 INFO:teuthology.orchestra.run.smithi045.stdout: -988> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 mds.0.cache.dir(0x100) lookup (stray0, 'head') 2023-10-03T19:21:28.650 INFO:teuthology.orchestra.run.smithi045.stdout: -987> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 mds.0.cache.dir(0x100) hit -> (stray0,head) 2023-10-03T19:21:28.650 INFO:teuthology.orchestra.run.smithi045.stdout: -986> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 mds.0.cache stray num 0 is [inode 0x600 [...2,head] ~mds0/stray0/ auth v1 f() n(v0 rc2023-10-03T19:20:16.306261+0000 1=0+1) (iversion lock) | dirfrag=1 stickydirs=1 stray=1 dirtyparent=0 authpin=0 0x55c504b89180] 2023-10-03T19:21:28.650 INFO:teuthology.orchestra.run.smithi045.stdout: -985> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 mds.0.cache.dir(0x100) lookup (stray1, 'head') 2023-10-03T19:21:28.650 INFO:teuthology.orchestra.run.smithi045.stdout: -984> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 mds.0.cache.dir(0x100) hit -> (stray1,head) 2023-10-03T19:21:28.650 INFO:teuthology.orchestra.run.smithi045.stdout: -983> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 mds.0.cache stray num 1 is [inode 0x601 [...2,head] ~mds0/stray1/ auth v1 f() n(v0 rc2023-10-03T19:20:16.306512+0000 1=0+1) (iversion lock) | dirfrag=1 stickydirs=1 stray=1 dirtyparent=0 authpin=0 0x55c504b89700] 2023-10-03T19:21:28.650 INFO:teuthology.orchestra.run.smithi045.stdout: -982> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 mds.0.cache.dir(0x100) lookup (stray2, 'head') 2023-10-03T19:21:28.650 INFO:teuthology.orchestra.run.smithi045.stdout: -981> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 mds.0.cache.dir(0x100) hit -> (stray2,head) 2023-10-03T19:21:28.651 INFO:teuthology.orchestra.run.smithi045.stdout: -980> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 mds.0.cache stray num 2 is [inode 0x602 [...2,head] ~mds0/stray2/ auth v1 f() n(v0 rc2023-10-03T19:20:16.306648+0000 1=0+1) (iversion lock) | dirfrag=1 stickydirs=1 stray=1 dirtyparent=0 authpin=0 0x55c505aa0000] 2023-10-03T19:21:28.651 INFO:teuthology.orchestra.run.smithi045.stdout: -979> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 mds.0.cache.dir(0x100) lookup (stray3, 'head') 2023-10-03T19:21:28.651 INFO:teuthology.orchestra.run.smithi045.stdout: -978> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 mds.0.cache.dir(0x100) hit -> (stray3,head) 2023-10-03T19:21:28.651 INFO:teuthology.orchestra.run.smithi045.stdout: -977> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 mds.0.cache stray num 3 is [inode 0x603 [...2,head] ~mds0/stray3/ auth v1 f() n(v0 rc2023-10-03T19:20:16.306751+0000 1=0+1) (iversion lock) | dirfrag=1 stickydirs=1 stray=1 dirtyparent=0 authpin=0 0x55c505aa0580] 2023-10-03T19:21:28.651 INFO:teuthology.orchestra.run.smithi045.stdout: -976> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 mds.0.cache.dir(0x100) lookup (stray4, 'head') 2023-10-03T19:21:28.651 INFO:teuthology.orchestra.run.smithi045.stdout: -975> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 mds.0.cache.dir(0x100) hit -> (stray4,head) 2023-10-03T19:21:28.651 INFO:teuthology.orchestra.run.smithi045.stdout: -974> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 mds.0.cache stray num 4 is [inode 0x604 [...2,head] ~mds0/stray4/ auth v1 f() n(v0 rc2023-10-03T19:20:16.306831+0000 1=0+1) (iversion lock) | dirfrag=1 stickydirs=1 stray=1 dirtyparent=0 authpin=0 0x55c505aa0b00] 2023-10-03T19:21:28.651 INFO:teuthology.orchestra.run.smithi045.stdout: -973> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 mds.0.cache.dir(0x100) lookup (stray5, 'head') 2023-10-03T19:21:28.651 INFO:teuthology.orchestra.run.smithi045.stdout: -972> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 mds.0.cache.dir(0x100) hit -> (stray5,head) 2023-10-03T19:21:28.651 INFO:teuthology.orchestra.run.smithi045.stdout: -971> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 mds.0.cache stray num 5 is [inode 0x605 [...2,head] ~mds0/stray5/ auth v1 f() n(v0 rc2023-10-03T19:20:16.306901+0000 1=0+1) (iversion lock) | dirfrag=1 stickydirs=1 stray=1 dirtyparent=0 authpin=0 0x55c505aa1080] 2023-10-03T19:21:28.651 INFO:teuthology.orchestra.run.smithi045.stdout: -970> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 mds.0.cache.dir(0x100) lookup (stray6, 'head') 2023-10-03T19:21:28.651 INFO:teuthology.orchestra.run.smithi045.stdout: -969> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 mds.0.cache.dir(0x100) hit -> (stray6,head) 2023-10-03T19:21:28.652 INFO:teuthology.orchestra.run.smithi045.stdout: -968> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 mds.0.cache stray num 6 is [inode 0x606 [...2,head] ~mds0/stray6/ auth v1 f() n(v0 rc2023-10-03T19:20:16.306978+0000 1=0+1) (iversion lock) | dirfrag=1 stickydirs=1 stray=1 dirtyparent=0 authpin=0 0x55c505aa1600] 2023-10-03T19:21:28.652 INFO:teuthology.orchestra.run.smithi045.stdout: -967> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 mds.0.cache.dir(0x100) lookup (stray7, 'head') 2023-10-03T19:21:28.652 INFO:teuthology.orchestra.run.smithi045.stdout: -966> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 mds.0.cache.dir(0x100) hit -> (stray7,head) 2023-10-03T19:21:28.652 INFO:teuthology.orchestra.run.smithi045.stdout: -965> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 mds.0.cache stray num 7 is [inode 0x607 [...2,head] ~mds0/stray7/ auth v1 f() n(v0 rc2023-10-03T19:20:16.307060+0000 1=0+1) (iversion lock) | dirfrag=1 stickydirs=1 stray=1 dirtyparent=0 authpin=0 0x55c505aa1b80] 2023-10-03T19:21:28.652 INFO:teuthology.orchestra.run.smithi045.stdout: -964> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 mds.0.cache.dir(0x100) lookup (stray8, 'head') 2023-10-03T19:21:28.652 INFO:teuthology.orchestra.run.smithi045.stdout: -963> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 mds.0.cache.dir(0x100) hit -> (stray8,head) 2023-10-03T19:21:28.652 INFO:teuthology.orchestra.run.smithi045.stdout: -962> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 mds.0.cache stray num 8 is [inode 0x608 [...2,head] ~mds0/stray8/ auth v1 f() n(v0 rc2023-10-03T19:20:16.307164+0000 1=0+1) (iversion lock) | dirfrag=1 stickydirs=1 stray=1 dirtyparent=0 authpin=0 0x55c505aa2100] 2023-10-03T19:21:28.652 INFO:teuthology.orchestra.run.smithi045.stdout: -961> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 mds.0.cache.dir(0x100) lookup (stray9, 'head') 2023-10-03T19:21:28.652 INFO:teuthology.orchestra.run.smithi045.stdout: -960> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 mds.0.cache.dir(0x100) hit -> (stray9,head) 2023-10-03T19:21:28.652 INFO:teuthology.orchestra.run.smithi045.stdout: -959> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 mds.0.cache stray num 9 is [inode 0x609 [...2,head] ~mds0/stray9/ auth v1 f() n(v0 rc2023-10-03T19:20:16.307241+0000 1=0+1) (iversion lock) | dirfrag=1 stickydirs=1 stray=1 dirtyparent=0 authpin=0 0x55c505aa2680] 2023-10-03T19:21:28.652 INFO:teuthology.orchestra.run.smithi045.stdout: -958> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 mds.0.cache populate_mydir done 2023-10-03T19:21:28.652 INFO:teuthology.orchestra.run.smithi045.stdout: -957> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 mds.0.cache.strays activate 2023-10-03T19:21:28.653 INFO:teuthology.orchestra.run.smithi045.stdout: -956> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 mds.0.cache scan_stray_dir 0x0 2023-10-03T19:21:28.653 INFO:teuthology.orchestra.run.smithi045.stdout: -955> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 mds.0.54 active_start: initializing metrics handler 2023-10-03T19:21:28.653 INFO:teuthology.orchestra.run.smithi045.stdout: -954> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 init: mds.metrics 2023-10-03T19:21:28.653 INFO:teuthology.orchestra.run.smithi045.stdout: -953> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 mds.0.54 active_start: initializing metric aggregator 2023-10-03T19:21:28.653 INFO:teuthology.orchestra.run.smithi045.stdout: -952> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 mds.metric.aggregator init 2023-10-03T19:21:28.653 INFO:teuthology.orchestra.run.smithi045.stdout: -951> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 mds.0.cache clean_open_file_lists 2023-10-03T19:21:28.653 INFO:teuthology.orchestra.run.smithi045.stdout: -950> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 mds.0.cache export_remaining_imported_caps 2023-10-03T19:21:28.653 INFO:teuthology.orchestra.run.smithi045.stdout: -949> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 mds.0.cache reissue_all_caps 2023-10-03T19:21:28.653 INFO:teuthology.orchestra.run.smithi045.stdout: -948> 2023-10-03T19:20:17.304+0000 7f04f8d27640 7 mds.0.tableserver(snaptable) finish_recovery 2023-10-03T19:21:28.653 INFO:teuthology.orchestra.run.smithi045.stdout: -947> 2023-10-03T19:20:17.304+0000 7f04f8d27640 7 mds.0.tableserver(snaptable) _do_server_recovery 0 2023-10-03T19:21:28.653 INFO:teuthology.orchestra.run.smithi045.stdout: -946> 2023-10-03T19:20:17.304+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] send_to--> mds [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] -- mds_table_request(snaptable server_ready) v1 -- ?+0 0x55c505933200 2023-10-03T19:21:28.653 INFO:teuthology.orchestra.run.smithi045.stdout: -945> 2023-10-03T19:20:17.304+0000 7f04f1518640 10 mds.metric.aggregator ping_all_active_ranks: pinging 0 active mds(s) 2023-10-03T19:21:28.653 INFO:teuthology.orchestra.run.smithi045.stdout: -944> 2023-10-03T19:20:17.304+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] -- mds_table_request(snaptable server_ready) v1 -- 0x55c505933200 con 0x55c504afbc00 2023-10-03T19:21:28.654 INFO:teuthology.orchestra.run.smithi045.stdout: -943> 2023-10-03T19:20:17.304+0000 7f04f8d27640 4 mds.0.54 set_osd_epoch_barrier: epoch=108 2023-10-03T19:21:28.654 INFO:teuthology.orchestra.run.smithi045.stdout: -942> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 mds.metric.aggregator notify_mdsmap 2023-10-03T19:21:28.654 INFO:teuthology.orchestra.run.smithi045.stdout: -941> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 mds.metric.aggregator notify_mdsmap: active rank=0 (mds.a) has addr=[v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] 2023-10-03T19:21:28.654 INFO:teuthology.orchestra.run.smithi045.stdout: -940> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 mds.metric.aggregator notify_mdsmap: active set=[{0=[v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563]}] 2023-10-03T19:21:28.654 INFO:teuthology.orchestra.run.smithi045.stdout: -939> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 notify_mdsmap: mds.metrics 2023-10-03T19:21:28.654 INFO:teuthology.orchestra.run.smithi045.stdout: -938> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 notify_mdsmap: mds.metrics: rank0 is mds.a 2023-10-03T19:21:28.654 INFO:teuthology.orchestra.run.smithi045.stdout: -937> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 notify_mdsmap: mds.metrics: rank0 addr is now [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] 2023-10-03T19:21:28.654 INFO:teuthology.orchestra.run.smithi045.stdout: -936> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 reset_seq: mds.metrics: last_updated_seq=0 2023-10-03T19:21:28.654 INFO:teuthology.orchestra.run.smithi045.stdout: -935> 2023-10-03T19:20:17.304+0000 7f04f8d27640 20 set_next_seq: mds.metrics: current sequence number 0, setting next sequence number 0 2023-10-03T19:21:28.654 INFO:teuthology.orchestra.run.smithi045.stdout: -934> 2023-10-03T19:20:17.304+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mds.0 v2:172.21.15.45:6834/1723126563 0 ==== mds_table_request(snaptable server_ready) v1 ==== 0+0+0 (unknown 0 0 0) 0x55c505933200 con 0x55c504afbc00 2023-10-03T19:21:28.654 INFO:teuthology.orchestra.run.smithi045.stdout: -933> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 mds.0.tableclient(snaptable) handle_request mds_table_request(snaptable server_ready) v1 2023-10-03T19:21:28.655 INFO:teuthology.orchestra.run.smithi045.stdout: -932> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 mds.0.snapclient refresh want 1 2023-10-03T19:21:28.655 INFO:teuthology.orchestra.run.smithi045.stdout: -931> 2023-10-03T19:20:17.304+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] send_to--> mds [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] -- mds_table_request(snaptable query 1 9 bytes) v1 -- ?+0 0x55c505932300 2023-10-03T19:21:28.655 INFO:teuthology.orchestra.run.smithi045.stdout: -930> 2023-10-03T19:20:17.304+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] -- mds_table_request(snaptable query 1 9 bytes) v1 -- 0x55c505932300 con 0x55c504afbc00 2023-10-03T19:21:28.655 INFO:teuthology.orchestra.run.smithi045.stdout: -929> 2023-10-03T19:20:17.304+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mds.0 v2:172.21.15.45:6834/1723126563 0 ==== mds_table_request(snaptable query 1 9 bytes) v1 ==== 0+0+0 (unknown 0 0 0) 0x55c505932300 con 0x55c504afbc00 2023-10-03T19:21:28.655 INFO:teuthology.orchestra.run.smithi045.stdout: -928> 2023-10-03T19:20:17.304+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] -- mds_table_request(snaptable query_reply 1 tid 1 29 bytes) v1 -- 0x55c505933200 con 0x55c504afbc00 2023-10-03T19:21:28.655 INFO:teuthology.orchestra.run.smithi045.stdout: -927> 2023-10-03T19:20:17.304+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mds.0 v2:172.21.15.45:6834/1723126563 0 ==== mds_table_request(snaptable query_reply 1 tid 1 29 bytes) v1 ==== 0+0+0 (unknown 0 0 0) 0x55c505933200 con 0x55c504afbc00 2023-10-03T19:21:28.655 INFO:teuthology.orchestra.run.smithi045.stdout: -926> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 mds.0.tableclient(snaptable) handle_request mds_table_request(snaptable query_reply 1 tid 1 29 bytes) v1 2023-10-03T19:21:28.655 INFO:teuthology.orchestra.run.smithi045.stdout: -925> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 mds.0.snapclient handle_query_result mds_table_request(snaptable query_reply 1 tid 1 29 bytes) v1 2023-10-03T19:21:28.655 INFO:teuthology.orchestra.run.smithi045.stdout: -924> 2023-10-03T19:20:17.304+0000 7f04f8d27640 7 mds.0.54 mds has 1 queued contexts 2023-10-03T19:21:28.655 INFO:teuthology.orchestra.run.smithi045.stdout: -923> 2023-10-03T19:20:17.304+0000 7f04f8d27640 10 mds.0.54 finish 0x55c504b4ed98 2023-10-03T19:21:28.655 INFO:teuthology.orchestra.run.smithi045.stdout: -922> 2023-10-03T19:20:17.304+0000 7f04f4d1f640 2 mds.0.cache Memory usage: total 274128, rss 37164, heap 207144, baseline 190760, 0 / 13 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:28.655 INFO:teuthology.orchestra.run.smithi045.stdout: -921> 2023-10-03T19:20:17.304+0000 7f04f4d1f640 20 mds.0.cache upkeep thread trimming cache; last trim 1263.693603516s ago 2023-10-03T19:21:28.656 INFO:teuthology.orchestra.run.smithi045.stdout: -920> 2023-10-03T19:20:17.304+0000 7f04f4d1f640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:28.656 INFO:teuthology.orchestra.run.smithi045.stdout: -919> 2023-10-03T19:20:17.304+0000 7f04f4d1f640 7 mds.0.cache trim bytes_used=50kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:28.656 INFO:teuthology.orchestra.run.smithi045.stdout: -918> 2023-10-03T19:20:17.304+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:28.656 INFO:teuthology.orchestra.run.smithi045.stdout: -917> 2023-10-03T19:20:17.304+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:28.656 INFO:teuthology.orchestra.run.smithi045.stdout: -916> 2023-10-03T19:20:17.304+0000 7f04f4d1f640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:28.656 INFO:teuthology.orchestra.run.smithi045.stdout: -915> 2023-10-03T19:20:17.304+0000 7f04f4d1f640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:28.656 INFO:teuthology.orchestra.run.smithi045.stdout: -914> 2023-10-03T19:20:17.304+0000 7f04f4d1f640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:28.656 INFO:teuthology.orchestra.run.smithi045.stdout: -913> 2023-10-03T19:20:17.308+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 50 ==== mdsbeacon(7602/a up:active seq=3 v55) v8 ==== 130+0+0 (secure 0 0 0) 0x55c504bc7340 con 0x55c504afb400 2023-10-03T19:21:28.656 INFO:teuthology.orchestra.run.smithi045.stdout: -912> 2023-10-03T19:20:17.308+0000 7f04fb52c640 5 mds.beacon.a received beacon reply up:active seq 3 rtt 0.931986 2023-10-03T19:21:28.656 INFO:teuthology.orchestra.run.smithi045.stdout: -911> 2023-10-03T19:20:17.308+0000 7f04f6d23640 20 mds.beacon.a sender thread waiting interval 3.06801s 2023-10-03T19:21:28.656 INFO:teuthology.orchestra.run.smithi045.stdout: -910> 2023-10-03T19:20:17.312+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 51 ==== osd_map(109..109 src has 1..109) v4 ==== 679+0+0 (secure 0 0 0) 0x55c504b3a8c0 con 0x55c504afb400 2023-10-03T19:21:28.656 INFO:teuthology.orchestra.run.smithi045.stdout: -909> 2023-10-03T19:20:17.312+0000 7f04f8d27640 10 mds.0.snap check_osd_map need_to_purge={} 2023-10-03T19:21:28.657 INFO:teuthology.orchestra.run.smithi045.stdout: -908> 2023-10-03T19:20:17.312+0000 7f04f8d27640 7 mds.0.server operator(): full = 0 epoch = 109 2023-10-03T19:21:28.657 INFO:teuthology.orchestra.run.smithi045.stdout: -907> 2023-10-03T19:20:17.312+0000 7f04f8d27640 10 mds.0.server apply_blocklist: killed 0 2023-10-03T19:21:28.657 INFO:teuthology.orchestra.run.smithi045.stdout: -906> 2023-10-03T19:20:17.312+0000 7f04f8d27640 4 mds.0.54 apply_blocklist: killed 0, blocklisted sessions (0 blocklist entries, 0) 2023-10-03T19:21:28.657 INFO:teuthology.orchestra.run.smithi045.stdout: -905> 2023-10-03T19:20:17.312+0000 7f04f8d27640 10 monclient: _renew_subs 2023-10-03T19:21:28.657 INFO:teuthology.orchestra.run.smithi045.stdout: -904> 2023-10-03T19:20:17.312+0000 7f04f8d27640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.657 INFO:teuthology.orchestra.run.smithi045.stdout: -903> 2023-10-03T19:20:17.312+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=110}) v3 -- 0x55c5059c3860 con 0x55c504afb400 2023-10-03T19:21:28.657 INFO:teuthology.orchestra.run.smithi045.stdout: -902> 2023-10-03T19:20:17.924+0000 7f04f7d25640 10 monclient: tick 2023-10-03T19:21:28.657 INFO:teuthology.orchestra.run.smithi045.stdout: -901> 2023-10-03T19:20:17.924+0000 7f04f7d25640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.657 INFO:teuthology.orchestra.run.smithi045.stdout: -900> 2023-10-03T19:20:17.924+0000 7f04f7d25640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:47.929308+0000) 2023-10-03T19:21:28.657 INFO:teuthology.orchestra.run.smithi045.stdout: -899> 2023-10-03T19:20:18.304+0000 7f04f7524640 20 mds.0.54 get_task_status 2023-10-03T19:21:28.657 INFO:teuthology.orchestra.run.smithi045.stdout: -898> 2023-10-03T19:20:18.304+0000 7f04f7524640 20 mds.0.54 send_task_status: updating 0 status keys 2023-10-03T19:21:28.657 INFO:teuthology.orchestra.run.smithi045.stdout: -897> 2023-10-03T19:20:18.304+0000 7f04f7524640 20 mds.0.54 schedule_update_timer_task 2023-10-03T19:21:28.658 INFO:teuthology.orchestra.run.smithi045.stdout: -896> 2023-10-03T19:20:18.304+0000 7f04f4d1f640 2 mds.0.cache Memory usage: total 274128, rss 37164, heap 207144, baseline 190760, 0 / 13 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:28.658 INFO:teuthology.orchestra.run.smithi045.stdout: -895> 2023-10-03T19:20:18.304+0000 7f04f4d1f640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999985456s ago 2023-10-03T19:21:28.658 INFO:teuthology.orchestra.run.smithi045.stdout: -894> 2023-10-03T19:20:18.304+0000 7f04f4d1f640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:28.658 INFO:teuthology.orchestra.run.smithi045.stdout: -893> 2023-10-03T19:20:18.304+0000 7f04f4d1f640 7 mds.0.cache trim bytes_used=50kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:28.658 INFO:teuthology.orchestra.run.smithi045.stdout: -892> 2023-10-03T19:20:18.304+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:28.658 INFO:teuthology.orchestra.run.smithi045.stdout: -891> 2023-10-03T19:20:18.304+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:28.658 INFO:teuthology.orchestra.run.smithi045.stdout: -890> 2023-10-03T19:20:18.304+0000 7f04f4d1f640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:28.658 INFO:teuthology.orchestra.run.smithi045.stdout: -889> 2023-10-03T19:20:18.304+0000 7f04f4d1f640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:28.658 INFO:teuthology.orchestra.run.smithi045.stdout: -888> 2023-10-03T19:20:18.304+0000 7f04f4d1f640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:28.658 INFO:teuthology.orchestra.run.smithi045.stdout: -887> 2023-10-03T19:20:18.312+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 52 ==== mdsmap(e 57) v2 ==== 1100+0+0 (secure 0 0 0) 0x55c5059c3860 con 0x55c504afb400 2023-10-03T19:21:28.658 INFO:teuthology.orchestra.run.smithi045.stdout: -886> 2023-10-03T19:20:18.312+0000 7f04f8d27640 1 mds.a Updating MDS map to version 57 from mon.0 2023-10-03T19:21:28.659 INFO:teuthology.orchestra.run.smithi045.stdout: -885> 2023-10-03T19:20:18.312+0000 7f04f8d27640 10 mds.a my compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-03T19:21:28.659 INFO:teuthology.orchestra.run.smithi045.stdout: -884> 2023-10-03T19:20:18.312+0000 7f04f8d27640 10 mds.a mdsmap compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-03T19:21:28.659 INFO:teuthology.orchestra.run.smithi045.stdout: -883> 2023-10-03T19:20:18.312+0000 7f04f8d27640 10 mds.a my gid is 7602 2023-10-03T19:21:28.659 INFO:teuthology.orchestra.run.smithi045.stdout: -882> 2023-10-03T19:20:18.312+0000 7f04f8d27640 10 mds.a map says I am mds.0.54 state up:active 2023-10-03T19:21:28.659 INFO:teuthology.orchestra.run.smithi045.stdout: -881> 2023-10-03T19:20:18.312+0000 7f04f8d27640 10 mds.a msgr says I am [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] 2023-10-03T19:21:28.659 INFO:teuthology.orchestra.run.smithi045.stdout: -880> 2023-10-03T19:20:18.312+0000 7f04f8d27640 10 mds.a handle_mds_map: handling map as rank 0 2023-10-03T19:21:28.659 INFO:teuthology.orchestra.run.smithi045.stdout: -879> 2023-10-03T19:20:18.312+0000 7f04f8d27640 4 mds.0.54 set_osd_epoch_barrier: epoch=109 2023-10-03T19:21:28.659 INFO:teuthology.orchestra.run.smithi045.stdout: -878> 2023-10-03T19:20:18.312+0000 7f04f8d27640 10 mds.metric.aggregator notify_mdsmap 2023-10-03T19:21:28.659 INFO:teuthology.orchestra.run.smithi045.stdout: -877> 2023-10-03T19:20:18.312+0000 7f04f8d27640 10 mds.metric.aggregator notify_mdsmap: active set=[{0=[v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563]}] 2023-10-03T19:21:28.659 INFO:teuthology.orchestra.run.smithi045.stdout: -876> 2023-10-03T19:20:18.312+0000 7f04f8d27640 10 notify_mdsmap: mds.metrics 2023-10-03T19:21:28.659 INFO:teuthology.orchestra.run.smithi045.stdout: -875> 2023-10-03T19:20:18.312+0000 7f04f8d27640 10 notify_mdsmap: mds.metrics: rank0 is mds.a 2023-10-03T19:21:28.659 INFO:teuthology.orchestra.run.smithi045.stdout: -874> 2023-10-03T19:20:18.924+0000 7f04f7d25640 10 monclient: tick 2023-10-03T19:21:28.660 INFO:teuthology.orchestra.run.smithi045.stdout: -873> 2023-10-03T19:20:18.924+0000 7f04f7d25640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.660 INFO:teuthology.orchestra.run.smithi045.stdout: -872> 2023-10-03T19:20:18.924+0000 7f04f7d25640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:48.929459+0000) 2023-10-03T19:21:28.660 INFO:teuthology.orchestra.run.smithi045.stdout: -871> 2023-10-03T19:20:19.304+0000 7f04f1d19640 20 update_rank0: mds.metrics 2023-10-03T19:21:28.660 INFO:teuthology.orchestra.run.smithi045.stdout: -870> 2023-10-03T19:20:19.304+0000 7f04f1d19640 20 update_rank0: mds.metrics: sending metric updates for 0 clients to rank 0 (address: [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563]) with sequence number 0, last updated sequence number 0 2023-10-03T19:21:28.660 INFO:teuthology.orchestra.run.smithi045.stdout: -869> 2023-10-03T19:20:19.304+0000 7f04f1d19640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] send_to--> mds [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] -- mds_metrics from rank=0 carrying 0 metric updates v1 -- ?+0 0x55c505932000 2023-10-03T19:21:28.660 INFO:teuthology.orchestra.run.smithi045.stdout: -868> 2023-10-03T19:20:19.304+0000 7f04f1d19640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] -- mds_metrics from rank=0 carrying 0 metric updates v1 -- 0x55c505932000 con 0x55c504afbc00 2023-10-03T19:21:28.660 INFO:teuthology.orchestra.run.smithi045.stdout: -867> 2023-10-03T19:20:19.304+0000 7f04f8526640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mds.0 v2:172.21.15.45:6834/1723126563 0 ==== mds_metrics from rank=0 carrying 0 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x55c505932000 con 0x55c504afbc00 2023-10-03T19:21:28.660 INFO:teuthology.orchestra.run.smithi045.stdout: -866> 2023-10-03T19:20:19.304+0000 7f04f8526640 20 mds.metric.aggregator handle_mds_metrics: applying 0 updates for rank=0 with sequence number 0 2023-10-03T19:21:28.660 INFO:teuthology.orchestra.run.smithi045.stdout: -865> 2023-10-03T19:20:19.304+0000 7f04f8526640 10 mds.pinger pong_received: rank=0, sequence=0 2023-10-03T19:21:28.660 INFO:teuthology.orchestra.run.smithi045.stdout: -864> 2023-10-03T19:20:19.304+0000 7f04f8526640 10 mds.pinger pong_received: received pong from rank=0 to which ping was never sent (ignoring...). 2023-10-03T19:21:28.660 INFO:teuthology.orchestra.run.smithi045.stdout: -863> 2023-10-03T19:20:19.304+0000 7f04f4d1f640 2 mds.0.cache Memory usage: total 274128, rss 37164, heap 207144, baseline 190760, 0 / 13 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:28.660 INFO:teuthology.orchestra.run.smithi045.stdout: -862> 2023-10-03T19:20:19.304+0000 7f04f4d1f640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999985456s ago 2023-10-03T19:21:28.661 INFO:teuthology.orchestra.run.smithi045.stdout: -861> 2023-10-03T19:20:19.304+0000 7f04f4d1f640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:28.661 INFO:teuthology.orchestra.run.smithi045.stdout: -860> 2023-10-03T19:20:19.304+0000 7f04f4d1f640 7 mds.0.cache trim bytes_used=50kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:28.661 INFO:teuthology.orchestra.run.smithi045.stdout: -859> 2023-10-03T19:20:19.304+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:28.661 INFO:teuthology.orchestra.run.smithi045.stdout: -858> 2023-10-03T19:20:19.304+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:28.661 INFO:teuthology.orchestra.run.smithi045.stdout: -857> 2023-10-03T19:20:19.304+0000 7f04f4d1f640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:28.661 INFO:teuthology.orchestra.run.smithi045.stdout: -856> 2023-10-03T19:20:19.304+0000 7f04f4d1f640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:28.661 INFO:teuthology.orchestra.run.smithi045.stdout: -855> 2023-10-03T19:20:19.304+0000 7f04f4d1f640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:28.661 INFO:teuthology.orchestra.run.smithi045.stdout: -854> 2023-10-03T19:20:19.328+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 53 ==== mdsmap(e 58) v2 ==== 1100+0+0 (secure 0 0 0) 0x55c505991a00 con 0x55c504afb400 2023-10-03T19:21:28.661 INFO:teuthology.orchestra.run.smithi045.stdout: -853> 2023-10-03T19:20:19.328+0000 7f04f8d27640 1 mds.a Updating MDS map to version 58 from mon.0 2023-10-03T19:21:28.661 INFO:teuthology.orchestra.run.smithi045.stdout: -852> 2023-10-03T19:20:19.328+0000 7f04f8d27640 10 mds.a my compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-03T19:21:28.661 INFO:teuthology.orchestra.run.smithi045.stdout: -851> 2023-10-03T19:20:19.328+0000 7f04f8d27640 10 mds.a mdsmap compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-03T19:21:28.661 INFO:teuthology.orchestra.run.smithi045.stdout: -850> 2023-10-03T19:20:19.328+0000 7f04f8d27640 10 mds.a my gid is 7602 2023-10-03T19:21:28.662 INFO:teuthology.orchestra.run.smithi045.stdout: -849> 2023-10-03T19:20:19.328+0000 7f04f8d27640 10 mds.a map says I am mds.0.54 state up:active 2023-10-03T19:21:28.662 INFO:teuthology.orchestra.run.smithi045.stdout: -848> 2023-10-03T19:20:19.328+0000 7f04f8d27640 10 mds.a msgr says I am [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] 2023-10-03T19:21:28.662 INFO:teuthology.orchestra.run.smithi045.stdout: -847> 2023-10-03T19:20:19.328+0000 7f04f8d27640 10 mds.a handle_mds_map: handling map as rank 0 2023-10-03T19:21:28.662 INFO:teuthology.orchestra.run.smithi045.stdout: -846> 2023-10-03T19:20:19.328+0000 7f04f8d27640 4 mds.0.54 set_osd_epoch_barrier: epoch=109 2023-10-03T19:21:28.662 INFO:teuthology.orchestra.run.smithi045.stdout: -845> 2023-10-03T19:20:19.328+0000 7f04f8d27640 10 mds.metric.aggregator notify_mdsmap 2023-10-03T19:21:28.662 INFO:teuthology.orchestra.run.smithi045.stdout: -844> 2023-10-03T19:20:19.328+0000 7f04f8d27640 10 mds.metric.aggregator notify_mdsmap: active set=[{0=[v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563]}] 2023-10-03T19:21:28.662 INFO:teuthology.orchestra.run.smithi045.stdout: -843> 2023-10-03T19:20:19.328+0000 7f04f8d27640 10 notify_mdsmap: mds.metrics 2023-10-03T19:21:28.662 INFO:teuthology.orchestra.run.smithi045.stdout: -842> 2023-10-03T19:20:19.328+0000 7f04f8d27640 10 notify_mdsmap: mds.metrics: rank0 is mds.a 2023-10-03T19:21:28.662 INFO:teuthology.orchestra.run.smithi045.stdout: -841> 2023-10-03T19:20:19.924+0000 7f04f7d25640 10 monclient: tick 2023-10-03T19:21:28.662 INFO:teuthology.orchestra.run.smithi045.stdout: -840> 2023-10-03T19:20:19.924+0000 7f04f7d25640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.662 INFO:teuthology.orchestra.run.smithi045.stdout: -839> 2023-10-03T19:20:19.924+0000 7f04f7d25640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:49.929599+0000) 2023-10-03T19:21:28.662 INFO:teuthology.orchestra.run.smithi045.stdout: -838> 2023-10-03T19:20:20.300+0000 7f04f7524640 20 mds.0.54 get_task_status 2023-10-03T19:21:28.663 INFO:teuthology.orchestra.run.smithi045.stdout: -837> 2023-10-03T19:20:20.300+0000 7f04f7524640 20 mds.0.54 schedule_update_timer_task 2023-10-03T19:21:28.663 INFO:teuthology.orchestra.run.smithi045.stdout: -836> 2023-10-03T19:20:20.308+0000 7f04f4d1f640 2 mds.0.cache Memory usage: total 274128, rss 37164, heap 207144, baseline 190760, 0 / 13 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:28.663 INFO:teuthology.orchestra.run.smithi045.stdout: -835> 2023-10-03T19:20:20.308+0000 7f04f4d1f640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999985456s ago 2023-10-03T19:21:28.663 INFO:teuthology.orchestra.run.smithi045.stdout: -834> 2023-10-03T19:20:20.308+0000 7f04f4d1f640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:28.663 INFO:teuthology.orchestra.run.smithi045.stdout: -833> 2023-10-03T19:20:20.308+0000 7f04f4d1f640 7 mds.0.cache trim bytes_used=50kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:28.663 INFO:teuthology.orchestra.run.smithi045.stdout: -832> 2023-10-03T19:20:20.308+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:28.663 INFO:teuthology.orchestra.run.smithi045.stdout: -831> 2023-10-03T19:20:20.308+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:28.663 INFO:teuthology.orchestra.run.smithi045.stdout: -830> 2023-10-03T19:20:20.308+0000 7f04f4d1f640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:28.663 INFO:teuthology.orchestra.run.smithi045.stdout: -829> 2023-10-03T19:20:20.308+0000 7f04f4d1f640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:28.663 INFO:teuthology.orchestra.run.smithi045.stdout: -828> 2023-10-03T19:20:20.308+0000 7f04f4d1f640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:28.664 INFO:teuthology.orchestra.run.smithi045.stdout: -827> 2023-10-03T19:20:20.376+0000 7f04f6d23640 5 mds.beacon.a Sending beacon up:active seq 4 2023-10-03T19:21:28.664 INFO:teuthology.orchestra.run.smithi045.stdout: -826> 2023-10-03T19:20:20.376+0000 7f04f6d23640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.664 INFO:teuthology.orchestra.run.smithi045.stdout: -825> 2023-10-03T19:20:20.376+0000 7f04f6d23640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mdsbeacon(7602/a up:active seq=4 v58) v8 -- 0x55c504bc7600 con 0x55c504afb400 2023-10-03T19:21:28.664 INFO:teuthology.orchestra.run.smithi045.stdout: -824> 2023-10-03T19:20:20.376+0000 7f04f6d23640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:28.664 INFO:teuthology.orchestra.run.smithi045.stdout: -823> 2023-10-03T19:20:20.376+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 54 ==== mdsbeacon(7602/a up:active seq=4 v58) v8 ==== 130+0+0 (secure 0 0 0) 0x55c504bc7600 con 0x55c504afb400 2023-10-03T19:21:28.664 INFO:teuthology.orchestra.run.smithi045.stdout: -822> 2023-10-03T19:20:20.376+0000 7f04fb52c640 5 mds.beacon.a received beacon reply up:active seq 4 rtt 0 2023-10-03T19:21:28.664 INFO:teuthology.orchestra.run.smithi045.stdout: -821> 2023-10-03T19:20:20.376+0000 7f04f6d23640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:28.665 INFO:teuthology.orchestra.run.smithi045.stdout: -820> 2023-10-03T19:20:20.924+0000 7f04f7d25640 10 monclient: tick 2023-10-03T19:21:28.665 INFO:teuthology.orchestra.run.smithi045.stdout: -819> 2023-10-03T19:20:20.924+0000 7f04f7d25640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.665 INFO:teuthology.orchestra.run.smithi045.stdout: -818> 2023-10-03T19:20:20.924+0000 7f04f7d25640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:50.929680+0000) 2023-10-03T19:21:28.665 INFO:teuthology.orchestra.run.smithi045.stdout: -817> 2023-10-03T19:20:20.924+0000 7f04f7524640 10 mds.0.log trim 1 / 128 segments, 1 / -1 events, 0 (0) expiring, 0 (0) expired 2023-10-03T19:21:28.665 INFO:teuthology.orchestra.run.smithi045.stdout: -816> 2023-10-03T19:20:20.924+0000 7f04f7524640 10 mds.0.openfiles commit log_seq 1 committing_log_seq:0 2023-10-03T19:21:28.665 INFO:teuthology.orchestra.run.smithi045.stdout: -815> 2023-10-03T19:20:20.924+0000 7f04f7524640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- osd_op(unknown.0.54:39 17.6 17:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e109) v8 -- 0x55c505b15880 con 0x55c505a27400 2023-10-03T19:21:28.665 INFO:teuthology.orchestra.run.smithi045.stdout: -814> 2023-10-03T19:20:20.928+0000 7f04f7524640 10 mds.0.log _trim_expired_segments waiting for 1/4194304 to expire 2023-10-03T19:21:28.665 INFO:teuthology.orchestra.run.smithi045.stdout: -813> 2023-10-03T19:20:20.928+0000 7f04f7524640 10 mds.0.server find_idle_sessions. last cleared laggy state 1267.32s ago 2023-10-03T19:21:28.665 INFO:teuthology.orchestra.run.smithi045.stdout: -812> 2023-10-03T19:20:20.928+0000 7f04f7524640 10 mds.0.locker scatter_tick 2023-10-03T19:21:28.665 INFO:teuthology.orchestra.run.smithi045.stdout: -811> 2023-10-03T19:20:20.928+0000 7f04f7524640 20 mds.0.locker caps_tick 0 revoking caps 2023-10-03T19:21:28.665 INFO:teuthology.orchestra.run.smithi045.stdout: -810> 2023-10-03T19:20:20.928+0000 7f04f7524640 20 mds.0.bal handle_export_pins export_pin_queue size=0 2023-10-03T19:21:28.666 INFO:teuthology.orchestra.run.smithi045.stdout: -809> 2023-10-03T19:20:20.928+0000 7f04f7524640 15 mds.0.bal tick tick last_sample now 1267.317573s 2023-10-03T19:21:28.666 INFO:teuthology.orchestra.run.smithi045.stdout: -808> 2023-10-03T19:20:20.928+0000 7f04f7524640 15 mds.0.bal get_load mdsload<[pop IRD:[C 0.00e+00] IWR:[C 0.00e+00] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 5.26e-01] *LOAD:2.1]/[pop IRD:[C 0.00e+00] IWR:[C 0.00e+00] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 5.26e-01] *LOAD:2.1], req 0, hr 0, qlen 0, cpu 0> 2023-10-03T19:21:28.666 INFO:teuthology.orchestra.run.smithi045.stdout: -807> 2023-10-03T19:20:20.928+0000 7f04f7524640 3 mds.0.bal send_heartbeat epoch 1 load mdsload<[pop IRD:[C 0.00e+00] IWR:[C 0.00e+00] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 5.26e-01] *LOAD:2.1]/[pop IRD:[C 0.00e+00] IWR:[C 0.00e+00] RDR:[C 0.00e+00] FET:[C 0.00e+00] STR:[C 5.26e-01] *LOAD:2.1], req 0, hr 0, qlen 0, cpu 0> 2023-10-03T19:21:28.666 INFO:teuthology.orchestra.run.smithi045.stdout: -806> 2023-10-03T19:20:20.928+0000 7f04f7524640 15 mds.0.cache show_subtrees 2023-10-03T19:21:28.666 INFO:teuthology.orchestra.run.smithi045.stdout: -805> 2023-10-03T19:20:20.928+0000 7f04f7524640 10 mds.0.cache |__ 0 auth [dir 0x1 / [2,head] auth v=1 cv=1/1 REP dir_auth=0 state=1073741825|complete f() n() hs=0+0,ss=0+0 | subtree=1 dirty=0 authpin=0 0x55c504b68d00] 2023-10-03T19:21:28.666 INFO:teuthology.orchestra.run.smithi045.stdout: -804> 2023-10-03T19:20:20.928+0000 7f04f7524640 10 mds.0.cache |__ 0 auth [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:20:16.307241+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55c504b69180] 2023-10-03T19:21:28.666 INFO:teuthology.orchestra.run.smithi045.stdout: -803> 2023-10-03T19:20:20.928+0000 7f04f7524640 10 mds.0.cache find_stale_fragment_freeze 2023-10-03T19:21:28.666 INFO:teuthology.orchestra.run.smithi045.stdout: -802> 2023-10-03T19:20:20.928+0000 7f04f7524640 10 mds.0.snap check_osd_map - version unchanged 2023-10-03T19:21:28.666 INFO:teuthology.orchestra.run.smithi045.stdout: -801> 2023-10-03T19:20:20.928+0000 7f04f7524640 20 mds.0.54 updating export targets, currently 0 ranks are targets 2023-10-03T19:21:28.666 INFO:teuthology.orchestra.run.smithi045.stdout: -800> 2023-10-03T19:20:20.928+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.6 v2:172.21.15.79:6819/1486010128 5 ==== osd_op_reply(39 mds0_openfiles.0 [omap-clear,omap-set-header] v109'1 uv1 ondisk = 0) v8 ==== 202+0+0 (crc 0 0 0) 0x55c505af6b40 con 0x55c505a27400 2023-10-03T19:21:28.666 INFO:teuthology.orchestra.run.smithi045.stdout: -799> 2023-10-03T19:20:20.928+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 13C_IO_OFT_Save 2023-10-03T19:21:28.666 INFO:teuthology.orchestra.run.smithi045.stdout: -798> 2023-10-03T19:20:20.928+0000 7f04f2d1b640 10 MDSContext::complete: 13C_IO_OFT_Save 2023-10-03T19:21:28.667 INFO:teuthology.orchestra.run.smithi045.stdout: -797> 2023-10-03T19:20:20.928+0000 7f04f2d1b640 10 mds.0.openfiles _commit_finish log_seq 1 committed_log_seq 0 committing_log_seq 1 2023-10-03T19:21:28.667 INFO:teuthology.orchestra.run.smithi045.stdout: -796> 2023-10-03T19:20:20.928+0000 7f04f2d1b640 10 MDSContext::complete: 15C_OFT_Committed 2023-10-03T19:21:28.667 INFO:teuthology.orchestra.run.smithi045.stdout: -795> 2023-10-03T19:20:20.928+0000 7f04f2d1b640 10 mds.0.log _trim_expired_segments waiting for 1/4194304 to expire 2023-10-03T19:21:28.667 INFO:teuthology.orchestra.run.smithi045.stdout: -794> 2023-10-03T19:20:21.304+0000 7f04f1d19640 20 update_rank0: mds.metrics 2023-10-03T19:21:28.667 INFO:teuthology.orchestra.run.smithi045.stdout: -793> 2023-10-03T19:20:21.304+0000 7f04f1d19640 20 update_rank0: mds.metrics: sending metric updates for 0 clients to rank 0 (address: [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563]) with sequence number 0, last updated sequence number 0 2023-10-03T19:21:28.667 INFO:teuthology.orchestra.run.smithi045.stdout: -792> 2023-10-03T19:20:21.304+0000 7f04f1d19640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] send_to--> mds [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] -- mds_metrics from rank=0 carrying 0 metric updates v1 -- ?+0 0x55c505933380 2023-10-03T19:21:28.667 INFO:teuthology.orchestra.run.smithi045.stdout: -791> 2023-10-03T19:20:21.304+0000 7f04f1d19640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] -- mds_metrics from rank=0 carrying 0 metric updates v1 -- 0x55c505933380 con 0x55c504afbc00 2023-10-03T19:21:28.667 INFO:teuthology.orchestra.run.smithi045.stdout: -790> 2023-10-03T19:20:21.304+0000 7f04f8526640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mds.0 v2:172.21.15.45:6834/1723126563 0 ==== mds_metrics from rank=0 carrying 0 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x55c505933380 con 0x55c504afbc00 2023-10-03T19:21:28.667 INFO:teuthology.orchestra.run.smithi045.stdout: -789> 2023-10-03T19:20:21.304+0000 7f04f8526640 20 mds.metric.aggregator handle_mds_metrics: applying 0 updates for rank=0 with sequence number 0 2023-10-03T19:21:28.667 INFO:teuthology.orchestra.run.smithi045.stdout: -788> 2023-10-03T19:20:21.304+0000 7f04f8526640 10 mds.pinger pong_received: rank=0, sequence=0 2023-10-03T19:21:28.667 INFO:teuthology.orchestra.run.smithi045.stdout: -787> 2023-10-03T19:20:21.304+0000 7f04f8526640 10 mds.pinger pong_received: received pong from rank=0 to which ping was never sent (ignoring...). 2023-10-03T19:21:28.668 INFO:teuthology.orchestra.run.smithi045.stdout: -786> 2023-10-03T19:20:21.308+0000 7f04f4d1f640 2 mds.0.cache Memory usage: total 274128, rss 37164, heap 207144, baseline 190760, 0 / 13 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:28.668 INFO:teuthology.orchestra.run.smithi045.stdout: -785> 2023-10-03T19:20:21.308+0000 7f04f4d1f640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999985516s ago 2023-10-03T19:21:28.668 INFO:teuthology.orchestra.run.smithi045.stdout: -784> 2023-10-03T19:20:21.308+0000 7f04f4d1f640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:28.668 INFO:teuthology.orchestra.run.smithi045.stdout: -783> 2023-10-03T19:20:21.308+0000 7f04f4d1f640 7 mds.0.cache trim bytes_used=50kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:28.668 INFO:teuthology.orchestra.run.smithi045.stdout: -782> 2023-10-03T19:20:21.308+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:28.668 INFO:teuthology.orchestra.run.smithi045.stdout: -781> 2023-10-03T19:20:21.308+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:28.668 INFO:teuthology.orchestra.run.smithi045.stdout: -780> 2023-10-03T19:20:21.308+0000 7f04f4d1f640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:28.668 INFO:teuthology.orchestra.run.smithi045.stdout: -779> 2023-10-03T19:20:21.308+0000 7f04f4d1f640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:28.668 INFO:teuthology.orchestra.run.smithi045.stdout: -778> 2023-10-03T19:20:21.308+0000 7f04f4d1f640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:28.668 INFO:teuthology.orchestra.run.smithi045.stdout: -777> 2023-10-03T19:20:21.896+0000 7f04f6522640 10 mds.pinger is_rank_lagging: rank=0 2023-10-03T19:21:28.668 INFO:teuthology.orchestra.run.smithi045.stdout: -776> 2023-10-03T19:20:21.896+0000 7f04f6522640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-03T19:21:28.668 INFO:teuthology.orchestra.run.smithi045.stdout: -775> 2023-10-03T19:20:21.896+0000 7f04f6522640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgrreport(unknown.a +0-0 packed 1558 task_status=0) v9 -- 0x55c505b15180 con 0x55c505a26000 2023-10-03T19:21:28.669 INFO:teuthology.orchestra.run.smithi045.stdout: -774> 2023-10-03T19:20:21.924+0000 7f04f7d25640 10 monclient: tick 2023-10-03T19:21:28.669 INFO:teuthology.orchestra.run.smithi045.stdout: -773> 2023-10-03T19:20:21.924+0000 7f04f7d25640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.669 INFO:teuthology.orchestra.run.smithi045.stdout: -772> 2023-10-03T19:20:21.924+0000 7f04f7d25640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:51.929819+0000) 2023-10-03T19:21:28.669 INFO:teuthology.orchestra.run.smithi045.stdout: -771> 2023-10-03T19:20:22.304+0000 7f04f7524640 20 mds.0.54 get_task_status 2023-10-03T19:21:28.669 INFO:teuthology.orchestra.run.smithi045.stdout: -770> 2023-10-03T19:20:22.304+0000 7f04f7524640 20 mds.0.54 schedule_update_timer_task 2023-10-03T19:21:28.669 INFO:teuthology.orchestra.run.smithi045.stdout: -769> 2023-10-03T19:20:22.304+0000 7f04f1518640 10 mds.metric.aggregator ping_all_active_ranks: pinging 1 active mds(s) 2023-10-03T19:21:28.669 INFO:teuthology.orchestra.run.smithi045.stdout: -768> 2023-10-03T19:20:22.304+0000 7f04f1518640 20 mds.metric.aggregator ping_all_active_ranks: pinging rank=0 addr=[v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] 2023-10-03T19:21:28.669 INFO:teuthology.orchestra.run.smithi045.stdout: -767> 2023-10-03T19:20:22.304+0000 7f04f1518640 10 mds.pinger send_ping: rank=0 2023-10-03T19:21:28.669 INFO:teuthology.orchestra.run.smithi045.stdout: -766> 2023-10-03T19:20:22.304+0000 7f04f1518640 20 mds.pinger send_ping: init ping pong state for rank=0 2023-10-03T19:21:28.669 INFO:teuthology.orchestra.run.smithi045.stdout: -765> 2023-10-03T19:20:22.304+0000 7f04f1518640 10 mds.pinger send_ping: sending ping with sequence=1 to rank=0 2023-10-03T19:21:28.669 INFO:teuthology.orchestra.run.smithi045.stdout: -764> 2023-10-03T19:20:22.304+0000 7f04f1518640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] send_to--> mds [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] -- mdsping v1 -- ?+0 0x55c504b41040 2023-10-03T19:21:28.669 INFO:teuthology.orchestra.run.smithi045.stdout: -763> 2023-10-03T19:20:22.304+0000 7f04f1518640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] -- mdsping v1 -- 0x55c504b41040 con 0x55c504afbc00 2023-10-03T19:21:28.670 INFO:teuthology.orchestra.run.smithi045.stdout: -762> 2023-10-03T19:20:22.304+0000 7f04f8526640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mds.0 v2:172.21.15.45:6834/1723126563 0 ==== mdsping v1 ==== 0+0+0 (unknown 0 0 0) 0x55c504b41040 con 0x55c504afbc00 2023-10-03T19:21:28.670 INFO:teuthology.orchestra.run.smithi045.stdout: -761> 2023-10-03T19:20:22.304+0000 7f04f8526640 20 set_next_seq: mds.metrics: current sequence number 0, setting next sequence number 1 2023-10-03T19:21:28.670 INFO:teuthology.orchestra.run.smithi045.stdout: -760> 2023-10-03T19:20:22.308+0000 7f04f4d1f640 2 mds.0.cache Memory usage: total 274128, rss 37164, heap 207144, baseline 190760, 0 / 13 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:28.670 INFO:teuthology.orchestra.run.smithi045.stdout: -759> 2023-10-03T19:20:22.308+0000 7f04f4d1f640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999985516s ago 2023-10-03T19:21:28.670 INFO:teuthology.orchestra.run.smithi045.stdout: -758> 2023-10-03T19:20:22.308+0000 7f04f4d1f640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:28.670 INFO:teuthology.orchestra.run.smithi045.stdout: -757> 2023-10-03T19:20:22.308+0000 7f04f4d1f640 7 mds.0.cache trim bytes_used=50kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:28.670 INFO:teuthology.orchestra.run.smithi045.stdout: -756> 2023-10-03T19:20:22.308+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:28.670 INFO:teuthology.orchestra.run.smithi045.stdout: -755> 2023-10-03T19:20:22.308+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:28.670 INFO:teuthology.orchestra.run.smithi045.stdout: -754> 2023-10-03T19:20:22.308+0000 7f04f4d1f640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:28.670 INFO:teuthology.orchestra.run.smithi045.stdout: -753> 2023-10-03T19:20:22.308+0000 7f04f4d1f640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:28.670 INFO:teuthology.orchestra.run.smithi045.stdout: -752> 2023-10-03T19:20:22.308+0000 7f04f4d1f640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:28.671 INFO:teuthology.orchestra.run.smithi045.stdout: -751> 2023-10-03T19:20:22.924+0000 7f04f7d25640 10 monclient: tick 2023-10-03T19:21:28.671 INFO:teuthology.orchestra.run.smithi045.stdout: -750> 2023-10-03T19:20:22.924+0000 7f04f7d25640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.671 INFO:teuthology.orchestra.run.smithi045.stdout: -749> 2023-10-03T19:20:22.924+0000 7f04f7d25640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:52.929965+0000) 2023-10-03T19:21:28.671 INFO:teuthology.orchestra.run.smithi045.stdout: -748> 2023-10-03T19:20:23.308+0000 7f04f1d19640 20 update_rank0: mds.metrics 2023-10-03T19:21:28.671 INFO:teuthology.orchestra.run.smithi045.stdout: -747> 2023-10-03T19:20:23.308+0000 7f04f1d19640 20 update_rank0: mds.metrics: sending metric updates for 0 clients to rank 0 (address: [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563]) with sequence number 1, last updated sequence number 1 2023-10-03T19:21:28.671 INFO:teuthology.orchestra.run.smithi045.stdout: -746> 2023-10-03T19:20:23.308+0000 7f04f1d19640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] send_to--> mds [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] -- mds_metrics from rank=0 carrying 0 metric updates v1 -- ?+0 0x55c505933500 2023-10-03T19:21:28.671 INFO:teuthology.orchestra.run.smithi045.stdout: -745> 2023-10-03T19:20:23.308+0000 7f04f1d19640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] -- mds_metrics from rank=0 carrying 0 metric updates v1 -- 0x55c505933500 con 0x55c504afbc00 2023-10-03T19:21:28.671 INFO:teuthology.orchestra.run.smithi045.stdout: -744> 2023-10-03T19:20:23.308+0000 7f04f8526640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mds.0 v2:172.21.15.45:6834/1723126563 0 ==== mds_metrics from rank=0 carrying 0 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x55c505933500 con 0x55c504afbc00 2023-10-03T19:21:28.671 INFO:teuthology.orchestra.run.smithi045.stdout: -743> 2023-10-03T19:20:23.308+0000 7f04f8526640 20 mds.metric.aggregator handle_mds_metrics: applying 0 updates for rank=0 with sequence number 1 2023-10-03T19:21:28.671 INFO:teuthology.orchestra.run.smithi045.stdout: -742> 2023-10-03T19:20:23.308+0000 7f04f8526640 10 mds.pinger pong_received: rank=0, sequence=1 2023-10-03T19:21:28.671 INFO:teuthology.orchestra.run.smithi045.stdout: -741> 2023-10-03T19:20:23.308+0000 7f04f4d1f640 2 mds.0.cache Memory usage: total 274128, rss 37164, heap 207144, baseline 190760, 0 / 13 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:28.671 INFO:teuthology.orchestra.run.smithi045.stdout: -740> 2023-10-03T19:20:23.308+0000 7f04f4d1f640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999985516s ago 2023-10-03T19:21:28.672 INFO:teuthology.orchestra.run.smithi045.stdout: -739> 2023-10-03T19:20:23.308+0000 7f04f4d1f640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:28.672 INFO:teuthology.orchestra.run.smithi045.stdout: -738> 2023-10-03T19:20:23.308+0000 7f04f4d1f640 7 mds.0.cache trim bytes_used=50kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:28.672 INFO:teuthology.orchestra.run.smithi045.stdout: -737> 2023-10-03T19:20:23.308+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:28.672 INFO:teuthology.orchestra.run.smithi045.stdout: -736> 2023-10-03T19:20:23.308+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:28.672 INFO:teuthology.orchestra.run.smithi045.stdout: -735> 2023-10-03T19:20:23.308+0000 7f04f4d1f640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:28.672 INFO:teuthology.orchestra.run.smithi045.stdout: -734> 2023-10-03T19:20:23.308+0000 7f04f4d1f640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:28.672 INFO:teuthology.orchestra.run.smithi045.stdout: -733> 2023-10-03T19:20:23.308+0000 7f04f4d1f640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:28.672 INFO:teuthology.orchestra.run.smithi045.stdout: -732> 2023-10-03T19:20:23.924+0000 7f04f7d25640 10 monclient: tick 2023-10-03T19:21:28.672 INFO:teuthology.orchestra.run.smithi045.stdout: -731> 2023-10-03T19:20:23.924+0000 7f04f7d25640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.672 INFO:teuthology.orchestra.run.smithi045.stdout: -730> 2023-10-03T19:20:23.924+0000 7f04f7d25640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:53.930122+0000) 2023-10-03T19:21:28.672 INFO:teuthology.orchestra.run.smithi045.stdout: -729> 2023-10-03T19:20:24.304+0000 7f04f7524640 20 mds.0.54 get_task_status 2023-10-03T19:21:28.673 INFO:teuthology.orchestra.run.smithi045.stdout: -728> 2023-10-03T19:20:24.304+0000 7f04f7524640 20 mds.0.54 schedule_update_timer_task 2023-10-03T19:21:28.673 INFO:teuthology.orchestra.run.smithi045.stdout: -727> 2023-10-03T19:20:24.312+0000 7f04f4d1f640 2 mds.0.cache Memory usage: total 274128, rss 37164, heap 207144, baseline 190760, 0 / 13 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:28.673 INFO:teuthology.orchestra.run.smithi045.stdout: -726> 2023-10-03T19:20:24.312+0000 7f04f4d1f640 20 mds.0.cache upkeep thread trimming cache; last trim 1.003985524s ago 2023-10-03T19:21:28.673 INFO:teuthology.orchestra.run.smithi045.stdout: -725> 2023-10-03T19:20:24.312+0000 7f04f4d1f640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:28.673 INFO:teuthology.orchestra.run.smithi045.stdout: -724> 2023-10-03T19:20:24.312+0000 7f04f4d1f640 7 mds.0.cache trim bytes_used=50kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:28.673 INFO:teuthology.orchestra.run.smithi045.stdout: -723> 2023-10-03T19:20:24.312+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:28.673 INFO:teuthology.orchestra.run.smithi045.stdout: -722> 2023-10-03T19:20:24.312+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:28.673 INFO:teuthology.orchestra.run.smithi045.stdout: -721> 2023-10-03T19:20:24.312+0000 7f04f4d1f640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:28.673 INFO:teuthology.orchestra.run.smithi045.stdout: -720> 2023-10-03T19:20:24.312+0000 7f04f4d1f640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:28.673 INFO:teuthology.orchestra.run.smithi045.stdout: -719> 2023-10-03T19:20:24.312+0000 7f04f4d1f640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:28.673 INFO:teuthology.orchestra.run.smithi045.stdout: -718> 2023-10-03T19:20:24.376+0000 7f04f6d23640 5 mds.beacon.a Sending beacon up:active seq 5 2023-10-03T19:21:28.673 INFO:teuthology.orchestra.run.smithi045.stdout: -717> 2023-10-03T19:20:24.376+0000 7f04f6d23640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.674 INFO:teuthology.orchestra.run.smithi045.stdout: -716> 2023-10-03T19:20:24.376+0000 7f04f6d23640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mdsbeacon(7602/a up:active seq=5 v58) v8 -- 0x55c505bbc000 con 0x55c504afb400 2023-10-03T19:21:28.674 INFO:teuthology.orchestra.run.smithi045.stdout: -715> 2023-10-03T19:20:24.376+0000 7f04f6d23640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:28.674 INFO:teuthology.orchestra.run.smithi045.stdout: -714> 2023-10-03T19:20:24.376+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 55 ==== mdsbeacon(7602/a up:active seq=5 v58) v8 ==== 130+0+0 (secure 0 0 0) 0x55c505bbc000 con 0x55c504afb400 2023-10-03T19:21:28.674 INFO:teuthology.orchestra.run.smithi045.stdout: -713> 2023-10-03T19:20:24.376+0000 7f04fb52c640 5 mds.beacon.a received beacon reply up:active seq 5 rtt 0 2023-10-03T19:21:28.674 INFO:teuthology.orchestra.run.smithi045.stdout: -712> 2023-10-03T19:20:24.376+0000 7f04f6d23640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:28.674 INFO:teuthology.orchestra.run.smithi045.stdout: -711> 2023-10-03T19:20:24.924+0000 7f04f7d25640 10 monclient: tick 2023-10-03T19:21:28.674 INFO:teuthology.orchestra.run.smithi045.stdout: -710> 2023-10-03T19:20:24.924+0000 7f04f7d25640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.674 INFO:teuthology.orchestra.run.smithi045.stdout: -709> 2023-10-03T19:20:24.924+0000 7f04f7d25640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:54.930264+0000) 2023-10-03T19:21:28.674 INFO:teuthology.orchestra.run.smithi045.stdout: -708> 2023-10-03T19:20:25.304+0000 7f04f1d19640 20 update_rank0: mds.metrics 2023-10-03T19:21:28.674 INFO:teuthology.orchestra.run.smithi045.stdout: -707> 2023-10-03T19:20:25.304+0000 7f04f1d19640 20 update_rank0: mds.metrics: sending metric updates for 0 clients to rank 0 (address: [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563]) with sequence number 1, last updated sequence number 2 2023-10-03T19:21:28.674 INFO:teuthology.orchestra.run.smithi045.stdout: -706> 2023-10-03T19:20:25.304+0000 7f04f1d19640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] send_to--> mds [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] -- mds_metrics from rank=0 carrying 0 metric updates v1 -- ?+0 0x55c505932000 2023-10-03T19:21:28.674 INFO:teuthology.orchestra.run.smithi045.stdout: -705> 2023-10-03T19:20:25.304+0000 7f04f1d19640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] -- mds_metrics from rank=0 carrying 0 metric updates v1 -- 0x55c505932000 con 0x55c504afbc00 2023-10-03T19:21:28.675 INFO:teuthology.orchestra.run.smithi045.stdout: -704> 2023-10-03T19:20:25.304+0000 7f04f8526640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mds.0 v2:172.21.15.45:6834/1723126563 0 ==== mds_metrics from rank=0 carrying 0 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x55c505932000 con 0x55c504afbc00 2023-10-03T19:21:28.675 INFO:teuthology.orchestra.run.smithi045.stdout: -703> 2023-10-03T19:20:25.304+0000 7f04f8526640 20 mds.metric.aggregator handle_mds_metrics: applying 0 updates for rank=0 with sequence number 1 2023-10-03T19:21:28.675 INFO:teuthology.orchestra.run.smithi045.stdout: -702> 2023-10-03T19:20:25.304+0000 7f04f8526640 10 mds.pinger pong_received: rank=0, sequence=1 2023-10-03T19:21:28.675 INFO:teuthology.orchestra.run.smithi045.stdout: -701> 2023-10-03T19:20:25.312+0000 7f04f4d1f640 2 mds.0.cache Memory usage: total 274128, rss 37428, heap 207144, baseline 190760, 0 / 13 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:28.675 INFO:teuthology.orchestra.run.smithi045.stdout: -700> 2023-10-03T19:20:25.312+0000 7f04f4d1f640 20 mds.0.cache upkeep thread trimming cache; last trim 0.995985687s ago 2023-10-03T19:21:28.675 INFO:teuthology.orchestra.run.smithi045.stdout: -699> 2023-10-03T19:20:25.312+0000 7f04f4d1f640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:28.675 INFO:teuthology.orchestra.run.smithi045.stdout: -698> 2023-10-03T19:20:25.312+0000 7f04f4d1f640 7 mds.0.cache trim bytes_used=50kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:28.675 INFO:teuthology.orchestra.run.smithi045.stdout: -697> 2023-10-03T19:20:25.312+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:28.675 INFO:teuthology.orchestra.run.smithi045.stdout: -696> 2023-10-03T19:20:25.312+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:28.675 INFO:teuthology.orchestra.run.smithi045.stdout: -695> 2023-10-03T19:20:25.312+0000 7f04f4d1f640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:28.675 INFO:teuthology.orchestra.run.smithi045.stdout: -694> 2023-10-03T19:20:25.312+0000 7f04f4d1f640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:28.675 INFO:teuthology.orchestra.run.smithi045.stdout: -693> 2023-10-03T19:20:25.312+0000 7f04f4d1f640 10 mds.0.cache releasing free memory 2023-10-03T19:21:28.675 INFO:teuthology.orchestra.run.smithi045.stdout: -692> 2023-10-03T19:20:25.312+0000 7f04f4d1f640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:28.676 INFO:teuthology.orchestra.run.smithi045.stdout: -691> 2023-10-03T19:20:25.923+0000 7f04f7d25640 10 monclient: tick 2023-10-03T19:21:28.676 INFO:teuthology.orchestra.run.smithi045.stdout: -690> 2023-10-03T19:20:25.923+0000 7f04f7d25640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.676 INFO:teuthology.orchestra.run.smithi045.stdout: -689> 2023-10-03T19:20:25.923+0000 7f04f7d25640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:55.930393+0000) 2023-10-03T19:21:28.676 INFO:teuthology.orchestra.run.smithi045.stdout: -688> 2023-10-03T19:20:25.927+0000 7f04f7524640 10 mds.0.log trim 1 / 128 segments, 1 / -1 events, 0 (0) expiring, 0 (0) expired 2023-10-03T19:21:28.676 INFO:teuthology.orchestra.run.smithi045.stdout: -687> 2023-10-03T19:20:25.927+0000 7f04f7524640 10 mds.0.log _trim_expired_segments waiting for 1/4194304 to expire 2023-10-03T19:21:28.676 INFO:teuthology.orchestra.run.smithi045.stdout: -686> 2023-10-03T19:20:25.927+0000 7f04f7524640 10 mds.0.server find_idle_sessions. last cleared laggy state 1272.32s ago 2023-10-03T19:21:28.676 INFO:teuthology.orchestra.run.smithi045.stdout: -685> 2023-10-03T19:20:25.927+0000 7f04f7524640 10 mds.0.locker scatter_tick 2023-10-03T19:21:28.676 INFO:teuthology.orchestra.run.smithi045.stdout: -684> 2023-10-03T19:20:25.927+0000 7f04f7524640 20 mds.0.locker caps_tick 0 revoking caps 2023-10-03T19:21:28.676 INFO:teuthology.orchestra.run.smithi045.stdout: -683> 2023-10-03T19:20:25.927+0000 7f04f7524640 20 mds.0.bal handle_export_pins export_pin_queue size=0 2023-10-03T19:21:28.676 INFO:teuthology.orchestra.run.smithi045.stdout: -682> 2023-10-03T19:20:25.927+0000 7f04f7524640 15 mds.0.bal tick tick last_sample now 1272.317501s 2023-10-03T19:21:28.681 INFO:teuthology.orchestra.run.smithi045.stdout: -681> 2023-10-03T19:20:25.927+0000 7f04f7524640 15 mds.0.cache show_subtrees 2023-10-03T19:21:28.682 INFO:teuthology.orchestra.run.smithi045.stdout: -680> 2023-10-03T19:20:25.927+0000 7f04f7524640 10 mds.0.cache |__ 0 auth [dir 0x1 / [2,head] auth v=1 cv=1/1 REP dir_auth=0 state=1073741825|complete f() n() hs=0+0,ss=0+0 | subtree=1 dirty=0 authpin=0 0x55c504b68d00] 2023-10-03T19:21:28.682 INFO:teuthology.orchestra.run.smithi045.stdout: -679> 2023-10-03T19:20:25.927+0000 7f04f7524640 10 mds.0.cache |__ 0 auth [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:20:16.307241+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55c504b69180] 2023-10-03T19:21:28.682 INFO:teuthology.orchestra.run.smithi045.stdout: -678> 2023-10-03T19:20:25.927+0000 7f04f7524640 10 mds.0.cache find_stale_fragment_freeze 2023-10-03T19:21:28.682 INFO:teuthology.orchestra.run.smithi045.stdout: -677> 2023-10-03T19:20:25.927+0000 7f04f7524640 10 mds.0.snap check_osd_map - version unchanged 2023-10-03T19:21:28.682 INFO:teuthology.orchestra.run.smithi045.stdout: -676> 2023-10-03T19:20:25.927+0000 7f04f7524640 20 mds.0.54 updating export targets, currently 0 ranks are targets 2023-10-03T19:21:28.682 INFO:teuthology.orchestra.run.smithi045.stdout: -675> 2023-10-03T19:20:26.299+0000 7f04f7524640 20 mds.0.54 get_task_status 2023-10-03T19:21:28.682 INFO:teuthology.orchestra.run.smithi045.stdout: -674> 2023-10-03T19:20:26.299+0000 7f04f7524640 20 mds.0.54 schedule_update_timer_task 2023-10-03T19:21:28.682 INFO:teuthology.orchestra.run.smithi045.stdout: -673> 2023-10-03T19:20:26.311+0000 7f04f4d1f640 2 mds.0.cache Memory usage: total 274128, rss 37440, heap 207144, baseline 190760, 0 / 13 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:28.682 INFO:teuthology.orchestra.run.smithi045.stdout: -672> 2023-10-03T19:20:26.311+0000 7f04f4d1f640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999985576s ago 2023-10-03T19:21:28.682 INFO:teuthology.orchestra.run.smithi045.stdout: -671> 2023-10-03T19:20:26.311+0000 7f04f4d1f640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:28.683 INFO:teuthology.orchestra.run.smithi045.stdout: -670> 2023-10-03T19:20:26.311+0000 7f04f4d1f640 7 mds.0.cache trim bytes_used=50kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:28.683 INFO:teuthology.orchestra.run.smithi045.stdout: -669> 2023-10-03T19:20:26.311+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:28.683 INFO:teuthology.orchestra.run.smithi045.stdout: -668> 2023-10-03T19:20:26.311+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:28.683 INFO:teuthology.orchestra.run.smithi045.stdout: -667> 2023-10-03T19:20:26.311+0000 7f04f4d1f640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:28.683 INFO:teuthology.orchestra.run.smithi045.stdout: -666> 2023-10-03T19:20:26.311+0000 7f04f4d1f640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:28.683 INFO:teuthology.orchestra.run.smithi045.stdout: -665> 2023-10-03T19:20:26.311+0000 7f04f4d1f640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:28.683 INFO:teuthology.orchestra.run.smithi045.stdout: -664> 2023-10-03T19:20:26.403+0000 7f04fc52e640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> conn(0x55c505886800 0x55c505b18680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).accept 2023-10-03T19:21:28.683 INFO:teuthology.orchestra.run.smithi045.stdout: -663> 2023-10-03T19:20:26.403+0000 7f04fb52c640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> conn(0x55c505886800 0x55c505b18680 unknown :-1 s=BANNER_ACCEPTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:28.683 INFO:teuthology.orchestra.run.smithi045.stdout: -662> 2023-10-03T19:20:26.403+0000 7f04fb52c640 10 monclient: handle_auth_request added challenge on 0x55c505886800 2023-10-03T19:21:28.683 INFO:teuthology.orchestra.run.smithi045.stdout: -661> 2023-10-03T19:20:26.403+0000 7f04fb52c640 10 mds.a parse_caps: parsing auth_cap_str='allow *' 2023-10-03T19:21:28.683 INFO:teuthology.orchestra.run.smithi045.stdout: -660> 2023-10-03T19:20:26.403+0000 7f04fb52c640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> 172.21.15.45:0/1308607674 conn(0x55c505886800 0x55c505b18680 crc :-1 s=READY pgs=4 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=client.7770 client_cookie=d24b9e767bf5d9f4 server_cookie=4c7fae54f31f38a3 in_seq=0 out_seq=0 2023-10-03T19:21:28.683 INFO:teuthology.orchestra.run.smithi045.stdout: -659> 2023-10-03T19:20:26.403+0000 7f04f8d27640 10 mds.a new session 0x55c504b1ad00 for client.7770 172.21.15.45:0/1308607674 con 0x55c505886800 2023-10-03T19:21:28.683 INFO:teuthology.orchestra.run.smithi045.stdout: -658> 2023-10-03T19:20:26.403+0000 7f04f8d27640 10 mds.a parse_caps: parsing auth_cap_str='allow *' 2023-10-03T19:21:28.684 INFO:teuthology.orchestra.run.smithi045.stdout: -657> 2023-10-03T19:20:26.403+0000 7f04f8d27640 10 mds.a ms_handle_accept 172.21.15.45:0/1308607674 con 0x55c505886800 session 0x55c504b1ad00 2023-10-03T19:21:28.684 INFO:teuthology.orchestra.run.smithi045.stdout: -656> 2023-10-03T19:20:26.403+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== client.7770 172.21.15.45:0/1308607674 1 ==== command(tid 0: {"prefix": "get_command_descriptions"}) v1 ==== 62+0+0 (crc 0 0 0) 0x55c505b8e420 con 0x55c505886800 2023-10-03T19:21:28.684 INFO:teuthology.orchestra.run.smithi045.stdout: -655> 2023-10-03T19:20:26.403+0000 7f04fad2b640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> 172.21.15.45:0/1308607674 -- command_reply(tid 0: 0 ) v1 -- 0x55c505b8b8c0 con 0x55c505886800 2023-10-03T19:21:28.684 INFO:teuthology.orchestra.run.smithi045.stdout: -654> 2023-10-03T19:20:26.403+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> 172.21.15.45:0/1308607674 conn(0x55c505886800 msgr2=0x55c505b18680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 39 2023-10-03T19:21:28.684 INFO:teuthology.orchestra.run.smithi045.stdout: -653> 2023-10-03T19:20:26.403+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> 172.21.15.45:0/1308607674 conn(0x55c505886800 msgr2=0x55c505b18680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-03T19:21:28.684 INFO:teuthology.orchestra.run.smithi045.stdout: -652> 2023-10-03T19:20:26.403+0000 7f04fb52c640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> 172.21.15.45:0/1308607674 conn(0x55c505886800 0x55c505b18680 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T19:21:28.684 INFO:teuthology.orchestra.run.smithi045.stdout: -651> 2023-10-03T19:20:26.403+0000 7f04fb52c640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> 172.21.15.45:0/1308607674 conn(0x55c505886800 0x55c505b18680 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:28.684 INFO:teuthology.orchestra.run.smithi045.stdout: -650> 2023-10-03T19:20:26.403+0000 7f04f8d27640 5 mds.a ms_handle_reset on 172.21.15.45:0/1308607674 2023-10-03T19:21:28.684 INFO:teuthology.orchestra.run.smithi045.stdout: -649> 2023-10-03T19:20:26.403+0000 7f04f8d27640 3 mds.a ms_handle_reset closing connection for session client.7770 172.21.15.45:0/1308607674 2023-10-03T19:21:28.684 INFO:teuthology.orchestra.run.smithi045.stdout: -648> 2023-10-03T19:20:26.403+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> 172.21.15.45:0/1308607674 conn(0x55c505886800 msgr2=0x55c505b18680 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-10-03T19:21:28.684 INFO:teuthology.orchestra.run.smithi045.stdout: -647> 2023-10-03T19:20:26.403+0000 7f04f8d27640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> 172.21.15.45:0/1308607674 conn(0x55c505886800 0x55c505b18680 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:28.684 INFO:teuthology.orchestra.run.smithi045.stdout: -646> 2023-10-03T19:20:26.423+0000 7f04fc52e640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> conn(0x55c505887000 0x55c505b18c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).accept 2023-10-03T19:21:28.685 INFO:teuthology.orchestra.run.smithi045.stdout: -645> 2023-10-03T19:20:26.423+0000 7f04fb52c640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> conn(0x55c505887000 0x55c505b18c00 unknown :-1 s=BANNER_ACCEPTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:28.685 INFO:teuthology.orchestra.run.smithi045.stdout: -644> 2023-10-03T19:20:26.423+0000 7f04fb52c640 10 monclient: handle_auth_request added challenge on 0x55c505887000 2023-10-03T19:21:28.685 INFO:teuthology.orchestra.run.smithi045.stdout: -643> 2023-10-03T19:20:26.423+0000 7f04fb52c640 10 mds.a parse_caps: parsing auth_cap_str='allow *' 2023-10-03T19:21:28.685 INFO:teuthology.orchestra.run.smithi045.stdout: -642> 2023-10-03T19:20:26.423+0000 7f04fb52c640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> 172.21.15.45:0/179994653 conn(0x55c505887000 0x55c505b18c00 crc :-1 s=READY pgs=4 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=client.7776 client_cookie=a6f7fe7e2aecc2e1 server_cookie=db5bc4525e0068d8 in_seq=0 out_seq=0 2023-10-03T19:21:28.685 INFO:teuthology.orchestra.run.smithi045.stdout: -641> 2023-10-03T19:20:26.423+0000 7f04f8d27640 10 mds.a new session 0x55c504b1ad00 for client.7776 172.21.15.45:0/179994653 con 0x55c505887000 2023-10-03T19:21:28.685 INFO:teuthology.orchestra.run.smithi045.stdout: -640> 2023-10-03T19:20:26.423+0000 7f04f8d27640 10 mds.a parse_caps: parsing auth_cap_str='allow *' 2023-10-03T19:21:28.685 INFO:teuthology.orchestra.run.smithi045.stdout: -639> 2023-10-03T19:20:26.423+0000 7f04f8d27640 10 mds.a ms_handle_accept 172.21.15.45:0/179994653 con 0x55c505887000 session 0x55c504b1ad00 2023-10-03T19:21:28.685 INFO:teuthology.orchestra.run.smithi045.stdout: -638> 2023-10-03T19:20:26.423+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== client.7776 172.21.15.45:0/179994653 1 ==== command(tid 0: {"prefix": "status"}) v1 ==== 44+0+0 (crc 0 0 0) 0x55c505b8b8c0 con 0x55c505887000 2023-10-03T19:21:28.685 INFO:teuthology.orchestra.run.smithi045.stdout: -637> 2023-10-03T19:20:26.423+0000 7f04fad2b640 1 mds.a asok_command: status {prefix=status} (starting...) 2023-10-03T19:21:28.685 INFO:teuthology.orchestra.run.smithi045.stdout: -636> 2023-10-03T19:20:26.423+0000 7f04fad2b640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> 172.21.15.45:0/179994653 -- command_reply(tid 0: 0 ) v1 -- 0x55c505b8e420 con 0x55c505887000 2023-10-03T19:21:28.685 INFO:teuthology.orchestra.run.smithi045.stdout: -635> 2023-10-03T19:20:26.427+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> 172.21.15.45:0/179994653 conn(0x55c505887000 msgr2=0x55c505b18c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 39 2023-10-03T19:21:28.685 INFO:teuthology.orchestra.run.smithi045.stdout: -634> 2023-10-03T19:20:26.427+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> 172.21.15.45:0/179994653 conn(0x55c505887000 msgr2=0x55c505b18c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-03T19:21:28.686 INFO:teuthology.orchestra.run.smithi045.stdout: -633> 2023-10-03T19:20:26.427+0000 7f04fb52c640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> 172.21.15.45:0/179994653 conn(0x55c505887000 0x55c505b18c00 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T19:21:28.686 INFO:teuthology.orchestra.run.smithi045.stdout: -632> 2023-10-03T19:20:26.427+0000 7f04fb52c640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> 172.21.15.45:0/179994653 conn(0x55c505887000 0x55c505b18c00 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:28.686 INFO:teuthology.orchestra.run.smithi045.stdout: -631> 2023-10-03T19:20:26.427+0000 7f04f8d27640 5 mds.a ms_handle_reset on 172.21.15.45:0/179994653 2023-10-03T19:21:28.686 INFO:teuthology.orchestra.run.smithi045.stdout: -630> 2023-10-03T19:20:26.427+0000 7f04f8d27640 3 mds.a ms_handle_reset closing connection for session client.7776 172.21.15.45:0/179994653 2023-10-03T19:21:28.686 INFO:teuthology.orchestra.run.smithi045.stdout: -629> 2023-10-03T19:20:26.427+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> 172.21.15.45:0/179994653 conn(0x55c505887000 msgr2=0x55c505b18c00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-10-03T19:21:28.686 INFO:teuthology.orchestra.run.smithi045.stdout: -628> 2023-10-03T19:20:26.427+0000 7f04f8d27640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> 172.21.15.45:0/179994653 conn(0x55c505887000 0x55c505b18c00 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:28.686 INFO:teuthology.orchestra.run.smithi045.stdout: -627> 2023-10-03T19:20:26.895+0000 7f04f6522640 10 mds.pinger is_rank_lagging: rank=0 2023-10-03T19:21:28.686 INFO:teuthology.orchestra.run.smithi045.stdout: -626> 2023-10-03T19:20:26.895+0000 7f04f6522640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgrreport(unknown.a +0-0 packed 1558) v9 -- 0x55c505b15500 con 0x55c505a26000 2023-10-03T19:21:28.686 INFO:teuthology.orchestra.run.smithi045.stdout: -625> 2023-10-03T19:20:26.927+0000 7f04f7d25640 10 monclient: tick 2023-10-03T19:21:28.686 INFO:teuthology.orchestra.run.smithi045.stdout: -624> 2023-10-03T19:20:26.927+0000 7f04f7d25640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.686 INFO:teuthology.orchestra.run.smithi045.stdout: -623> 2023-10-03T19:20:26.927+0000 7f04f7d25640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:56.930552+0000) 2023-10-03T19:21:28.687 INFO:teuthology.orchestra.run.smithi045.stdout: -622> 2023-10-03T19:20:27.303+0000 7f04f1518640 10 mds.metric.aggregator ping_all_active_ranks: pinging 1 active mds(s) 2023-10-03T19:21:28.687 INFO:teuthology.orchestra.run.smithi045.stdout: -621> 2023-10-03T19:20:27.303+0000 7f04f1518640 20 mds.metric.aggregator ping_all_active_ranks: pinging rank=0 addr=[v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] 2023-10-03T19:21:28.687 INFO:teuthology.orchestra.run.smithi045.stdout: -620> 2023-10-03T19:20:27.303+0000 7f04f1518640 10 mds.pinger send_ping: rank=0 2023-10-03T19:21:28.687 INFO:teuthology.orchestra.run.smithi045.stdout: -619> 2023-10-03T19:20:27.303+0000 7f04f1518640 10 mds.pinger send_ping: sending ping with sequence=2 to rank=0 2023-10-03T19:21:28.687 INFO:teuthology.orchestra.run.smithi045.stdout: -618> 2023-10-03T19:20:27.303+0000 7f04f1518640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] send_to--> mds [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] -- mdsping v1 -- ?+0 0x55c504bcc640 2023-10-03T19:21:28.687 INFO:teuthology.orchestra.run.smithi045.stdout: -617> 2023-10-03T19:20:27.303+0000 7f04f1518640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] -- mdsping v1 -- 0x55c504bcc640 con 0x55c504afbc00 2023-10-03T19:21:28.687 INFO:teuthology.orchestra.run.smithi045.stdout: -616> 2023-10-03T19:20:27.303+0000 7f04f8526640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mds.0 v2:172.21.15.45:6834/1723126563 0 ==== mdsping v1 ==== 0+0+0 (unknown 0 0 0) 0x55c504bcc640 con 0x55c504afbc00 2023-10-03T19:21:28.687 INFO:teuthology.orchestra.run.smithi045.stdout: -615> 2023-10-03T19:20:27.303+0000 7f04f8526640 20 set_next_seq: mds.metrics: current sequence number 1, setting next sequence number 2 2023-10-03T19:21:28.687 INFO:teuthology.orchestra.run.smithi045.stdout: -614> 2023-10-03T19:20:27.303+0000 7f04f1d19640 20 update_rank0: mds.metrics 2023-10-03T19:21:28.687 INFO:teuthology.orchestra.run.smithi045.stdout: -613> 2023-10-03T19:20:27.303+0000 7f04f1d19640 20 update_rank0: mds.metrics: sending metric updates for 0 clients to rank 0 (address: [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563]) with sequence number 2, last updated sequence number 3 2023-10-03T19:21:28.687 INFO:teuthology.orchestra.run.smithi045.stdout: -612> 2023-10-03T19:20:27.303+0000 7f04f1d19640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] send_to--> mds [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] -- mds_metrics from rank=0 carrying 0 metric updates v1 -- ?+0 0x55c505933380 2023-10-03T19:21:28.688 INFO:teuthology.orchestra.run.smithi045.stdout: -611> 2023-10-03T19:20:27.303+0000 7f04f1d19640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] -- mds_metrics from rank=0 carrying 0 metric updates v1 -- 0x55c505933380 con 0x55c504afbc00 2023-10-03T19:21:28.688 INFO:teuthology.orchestra.run.smithi045.stdout: -610> 2023-10-03T19:20:27.303+0000 7f04f8526640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mds.0 v2:172.21.15.45:6834/1723126563 0 ==== mds_metrics from rank=0 carrying 0 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x55c505933380 con 0x55c504afbc00 2023-10-03T19:21:28.688 INFO:teuthology.orchestra.run.smithi045.stdout: -609> 2023-10-03T19:20:27.303+0000 7f04f8526640 20 mds.metric.aggregator handle_mds_metrics: applying 0 updates for rank=0 with sequence number 2 2023-10-03T19:21:28.688 INFO:teuthology.orchestra.run.smithi045.stdout: -608> 2023-10-03T19:20:27.303+0000 7f04f8526640 10 mds.pinger pong_received: rank=0, sequence=2 2023-10-03T19:21:28.688 INFO:teuthology.orchestra.run.smithi045.stdout: -607> 2023-10-03T19:20:27.315+0000 7f04f4d1f640 2 mds.0.cache Memory usage: total 274128, rss 37440, heap 207144, baseline 190760, 0 / 13 inodes have caps, 0 caps, 0 caps per inode 2023-10-03T19:21:28.688 INFO:teuthology.orchestra.run.smithi045.stdout: -606> 2023-10-03T19:20:27.315+0000 7f04f4d1f640 20 mds.0.cache upkeep thread trimming cache; last trim 1.003985643s ago 2023-10-03T19:21:28.688 INFO:teuthology.orchestra.run.smithi045.stdout: -605> 2023-10-03T19:20:27.315+0000 7f04f4d1f640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:28.688 INFO:teuthology.orchestra.run.smithi045.stdout: -604> 2023-10-03T19:20:27.315+0000 7f04f4d1f640 7 mds.0.cache trim bytes_used=50kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:28.688 INFO:teuthology.orchestra.run.smithi045.stdout: -603> 2023-10-03T19:20:27.315+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:28.688 INFO:teuthology.orchestra.run.smithi045.stdout: -602> 2023-10-03T19:20:27.315+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:28.688 INFO:teuthology.orchestra.run.smithi045.stdout: -601> 2023-10-03T19:20:27.315+0000 7f04f4d1f640 7 mds.0.server recall_client_state: min=100 max=1048576 total=0 flags=0xa 2023-10-03T19:21:28.688 INFO:teuthology.orchestra.run.smithi045.stdout: -600> 2023-10-03T19:20:27.315+0000 7f04f4d1f640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:28.688 INFO:teuthology.orchestra.run.smithi045.stdout: -599> 2023-10-03T19:20:27.315+0000 7f04f4d1f640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:28.689 INFO:teuthology.orchestra.run.smithi045.stdout: -598> 2023-10-03T19:20:27.451+0000 7f04fc52e640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> conn(0x55c505887400 0x55c505b19180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).accept 2023-10-03T19:21:28.689 INFO:teuthology.orchestra.run.smithi045.stdout: -597> 2023-10-03T19:20:27.451+0000 7f04fb52c640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> conn(0x55c505887400 0x55c505b19180 unknown :-1 s=BANNER_ACCEPTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:28.689 INFO:teuthology.orchestra.run.smithi045.stdout: -596> 2023-10-03T19:20:27.451+0000 7f04fb52c640 10 monclient: handle_auth_request added challenge on 0x55c505887400 2023-10-03T19:21:28.689 INFO:teuthology.orchestra.run.smithi045.stdout: -595> 2023-10-03T19:20:27.451+0000 7f04fb52c640 10 mds.a parse_caps: parsing auth_cap_str='allow' 2023-10-03T19:21:28.689 INFO:teuthology.orchestra.run.smithi045.stdout: -594> 2023-10-03T19:20:27.451+0000 7f04fb52c640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> 172.21.15.146:0/2294298422 conn(0x55c505887400 0x55c505b19180 crc :-1 s=READY pgs=4 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=client.6826 client_cookie=f4b3ce8ebeb27b1 server_cookie=290050d703761081 in_seq=0 out_seq=0 2023-10-03T19:21:28.689 INFO:teuthology.orchestra.run.smithi045.stdout: -593> 2023-10-03T19:20:27.451+0000 7f04f8d27640 10 mds.a new session 0x55c504b1ad00 for client.6826 172.21.15.146:0/2294298422 con 0x55c505887400 2023-10-03T19:21:28.689 INFO:teuthology.orchestra.run.smithi045.stdout: -592> 2023-10-03T19:20:27.451+0000 7f04f8d27640 10 mds.a parse_caps: parsing auth_cap_str='allow' 2023-10-03T19:21:28.689 INFO:teuthology.orchestra.run.smithi045.stdout: -591> 2023-10-03T19:20:27.451+0000 7f04f8d27640 10 mds.a ms_handle_accept 172.21.15.146:0/2294298422 con 0x55c505887400 session 0x55c504b1ad00 2023-10-03T19:21:28.689 INFO:teuthology.orchestra.run.smithi045.stdout: -590> 2023-10-03T19:20:27.451+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== client.6826 172.21.15.146:0/2294298422 1 ==== client_session(request_open) v5 ==== 349+0+0 (crc 0 0 0) 0x55c504b3aa80 con 0x55c505887400 2023-10-03T19:21:28.689 INFO:teuthology.orchestra.run.smithi045.stdout: -589> 2023-10-03T19:20:27.451+0000 7f04f8d27640 20 mds.0.54 get_session have 0x55c504b1ad00 client.6826 172.21.15.146:0/2294298422 state closed 2023-10-03T19:21:28.689 INFO:teuthology.orchestra.run.smithi045.stdout: -588> 2023-10-03T19:20:27.451+0000 7f04f8d27640 3 mds.0.server handle_client_session client_session(request_open) v5 from client.6826 2023-10-03T19:21:28.689 INFO:teuthology.orchestra.run.smithi045.stdout: -587> 2023-10-03T19:20:27.451+0000 7f04f8d27640 20 mds.0.server handle_client_session CEPH_SESSION_REQUEST_OPEN metadata entries: 2023-10-03T19:21:28.690 INFO:teuthology.orchestra.run.smithi045.stdout: -586> 2023-10-03T19:20:27.451+0000 7f04f8d27640 20 mds.0.server features: '0x00000000000fffff' 2023-10-03T19:21:28.690 INFO:teuthology.orchestra.run.smithi045.stdout: -585> 2023-10-03T19:20:27.451+0000 7f04f8d27640 20 mds.0.server metric specification: [{metric_flags: '0x000000000000ffff'}] 2023-10-03T19:21:28.690 INFO:teuthology.orchestra.run.smithi045.stdout: -584> 2023-10-03T19:20:27.451+0000 7f04f8d27640 20 mds.0.server ceph_sha1: 05a43c8fb3988914c879a50970f9054a098e0612 2023-10-03T19:21:28.690 INFO:teuthology.orchestra.run.smithi045.stdout: -583> 2023-10-03T19:20:27.451+0000 7f04f8d27640 20 mds.0.server ceph_version: ceph version 18.0.0-3908-g05a43c8f (05a43c8fb3988914c879a50970f9054a098e0612) reef (dev) 2023-10-03T19:21:28.690 INFO:teuthology.orchestra.run.smithi045.stdout: -582> 2023-10-03T19:20:27.451+0000 7f04f8d27640 20 mds.0.server entity_id: 0 2023-10-03T19:21:28.690 INFO:teuthology.orchestra.run.smithi045.stdout: -581> 2023-10-03T19:20:27.451+0000 7f04f8d27640 20 mds.0.server hostname: smithi146 2023-10-03T19:21:28.690 INFO:teuthology.orchestra.run.smithi045.stdout: -580> 2023-10-03T19:20:27.451+0000 7f04f8d27640 20 mds.0.server mount_point: /home/ubuntu/cephtest/mnt.0 2023-10-03T19:21:28.690 INFO:teuthology.orchestra.run.smithi045.stdout: -579> 2023-10-03T19:20:27.451+0000 7f04f8d27640 20 mds.0.server pid: 34037 2023-10-03T19:21:28.690 INFO:teuthology.orchestra.run.smithi045.stdout: -578> 2023-10-03T19:20:27.451+0000 7f04f8d27640 20 mds.0.server root: / 2023-10-03T19:21:28.690 INFO:teuthology.orchestra.run.smithi045.stdout: -577> 2023-10-03T19:20:27.451+0000 7f04f8d27640 10 mds.0.sessionmap add_session s=0x55c504b1ad00 name=client.6826 2023-10-03T19:21:28.690 INFO:teuthology.orchestra.run.smithi045.stdout: -576> 2023-10-03T19:20:27.451+0000 7f04f8d27640 20 mds.0.sessionmap mark_projected s=0x55c504b1ad00 name=client.6826 pv=0 -> 1 2023-10-03T19:21:28.691 INFO:teuthology.orchestra.run.smithi045.stdout: -575> 2023-10-03T19:20:27.451+0000 7f04f8d27640 10 mds.0.sessionmap touch_session s=0x55c504b1ad00 name=client.6826 2023-10-03T19:21:28.691 INFO:teuthology.orchestra.run.smithi045.stdout: -574> 2023-10-03T19:20:27.451+0000 7f04f251a640 5 mds.0.log _submit_thread 4195196~420 : ESession client.6826 172.21.15.146:0/2294298422 open cmapv 1 2023-10-03T19:21:28.691 INFO:teuthology.orchestra.run.smithi045.stdout: -573> 2023-10-03T19:20:27.451+0000 7f04f251a640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.54:40 17.14 17:2e2fa760:::200.00000001:head [write 892~440 [fadvise_dontneed] in=440b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e109) v8 -- 0x55c505b14e00 con 0x55c505a26c00 2023-10-03T19:21:28.691 INFO:teuthology.orchestra.run.smithi045.stdout: -572> 2023-10-03T19:20:27.455+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.3 v2:172.21.15.45:6816/4227059688 17 ==== osd_op_reply(40 200.00000001 [write 892~440 [fadvise_dontneed]] v109'7 uv7 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55c505af6fc0 con 0x55c505a26c00 2023-10-03T19:21:28.691 INFO:teuthology.orchestra.run.smithi045.stdout: -571> 2023-10-03T19:20:27.455+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 20C_MDS_session_finish 2023-10-03T19:21:28.691 INFO:teuthology.orchestra.run.smithi045.stdout: -570> 2023-10-03T19:20:27.455+0000 7f04f2d1b640 10 MDSContext::complete: 20C_MDS_session_finish 2023-10-03T19:21:28.691 INFO:teuthology.orchestra.run.smithi045.stdout: -569> 2023-10-03T19:20:27.455+0000 7f04f2d1b640 10 mds.0.server _session_logged client.6826 172.21.15.146:0/2294298422 state_seq 1 open 1 inos_to_free [] inotablev 0 inos_to_purge [] 2023-10-03T19:21:28.691 INFO:teuthology.orchestra.run.smithi045.stdout: -568> 2023-10-03T19:20:27.455+0000 7f04f2d1b640 20 mds.0.sessionmap mark_dirty s=0x55c504b1ad00 name=client.6826 v=0 2023-10-03T19:21:28.691 INFO:teuthology.orchestra.run.smithi045.stdout: -567> 2023-10-03T19:20:27.455+0000 7f04f2d1b640 10 mds.0.sessionmap touch_session s=0x55c504b1ad00 name=client.6826 2023-10-03T19:21:28.691 INFO:teuthology.orchestra.run.smithi045.stdout: -566> 2023-10-03T19:20:27.455+0000 7f04f2d1b640 10 add_session: mds.metrics: session=0x55c504b1ad00, client=client.6826 172.21.15.146:0/2294298422 2023-10-03T19:21:28.691 INFO:teuthology.orchestra.run.smithi045.stdout: -565> 2023-10-03T19:20:27.455+0000 7f04f2d1b640 20 add_session: mds.metrics: metrics=[update_type=0, metrics={cap_hit_metric={hits=0, misses=0}, read_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, write_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, metadata_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, dentry_lease={hits=0, misses=0}, opened_files_metric={opened_files=0, total_inodes=0}, pinned_icaps_metric={pinned_icaps=0, total_inodes=0}, opened_inodes_metric={opened_inodes=0, total_inodes=0}, read_io_sizes_metric={total_ops=0, total_size=0}, write_io_sizes_metric={total_ops=0, total_size=0}}] 2023-10-03T19:21:28.691 INFO:teuthology.orchestra.run.smithi045.stdout: -564> 2023-10-03T19:20:27.455+0000 7f04f2d1b640 10 mds.0.54 send_message_client client.6826 172.21.15.146:0/2294298422 client_session(open) v5 2023-10-03T19:21:28.692 INFO:teuthology.orchestra.run.smithi045.stdout: -563> 2023-10-03T19:20:27.455+0000 7f04f2d1b640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> 172.21.15.146:0/2294298422 -- client_session(open) v5 -- 0x55c504b3b880 con 0x55c505887400 2023-10-03T19:21:28.692 INFO:teuthology.orchestra.run.smithi045.stdout: -562> 2023-10-03T19:20:27.455+0000 7f04f2d1b640 2 mds.0.server New client session: addr="172.21.15.146:0/2294298422",elapsed=0.004317,throttled=0.000013,status="ACCEPTED",root="/" 2023-10-03T19:21:28.692 INFO:teuthology.orchestra.run.smithi045.stdout: -561> 2023-10-03T19:20:27.455+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== client.6826 172.21.15.146:0/2294298422 2 ==== client_session(request_renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x55c504b3b880 con 0x55c505887400 2023-10-03T19:21:28.692 INFO:teuthology.orchestra.run.smithi045.stdout: -560> 2023-10-03T19:20:27.455+0000 7f04f8d27640 20 mds.0.54 get_session have 0x55c504b1ad00 client.6826 172.21.15.146:0/2294298422 state open 2023-10-03T19:21:28.692 INFO:teuthology.orchestra.run.smithi045.stdout: -559> 2023-10-03T19:20:27.455+0000 7f04f8d27640 3 mds.0.server handle_client_session client_session(request_renewcaps seq 1) v1 from client.6826 2023-10-03T19:21:28.692 INFO:teuthology.orchestra.run.smithi045.stdout: -558> 2023-10-03T19:20:27.455+0000 7f04f8d27640 10 mds.0.sessionmap touch_session s=0x55c504b1ad00 name=client.6826 2023-10-03T19:21:28.692 INFO:teuthology.orchestra.run.smithi045.stdout: -557> 2023-10-03T19:20:27.455+0000 7f04f8d27640 10 mds.0.54 send_message_client client.6826 172.21.15.146:0/2294298422 client_session(renewcaps seq 1) v5 2023-10-03T19:21:28.692 INFO:teuthology.orchestra.run.smithi045.stdout: -556> 2023-10-03T19:20:27.455+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> 172.21.15.146:0/2294298422 -- client_session(renewcaps seq 1) v5 -- 0x55c504b3ba40 con 0x55c505887400 2023-10-03T19:21:28.692 INFO:teuthology.orchestra.run.smithi045.stdout: -555> 2023-10-03T19:20:27.455+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== client.6826 172.21.15.146:0/2294298422 3 ==== client_request(client.6826:1 getattr pAsLsXsFs #0x1 2023-10-03T19:20:27.454565+0000 caller_uid=0, caller_gid=0{}) v6 ==== 156+0+0 (crc 0 0 0) 0x55c505a6fb00 con 0x55c505887400 2023-10-03T19:21:28.692 INFO:teuthology.orchestra.run.smithi045.stdout: -554> 2023-10-03T19:20:27.455+0000 7f04f8d27640 4 mds.0.server handle_client_request client_request(client.6826:1 getattr pAsLsXsFs #0x1 2023-10-03T19:20:27.454565+0000 caller_uid=0, caller_gid=0{}) v6 2023-10-03T19:21:28.692 INFO:teuthology.orchestra.run.smithi045.stdout: -553> 2023-10-03T19:20:27.455+0000 7f04f8d27640 20 mds.0.54 get_session have 0x55c504b1ad00 client.6826 172.21.15.146:0/2294298422 state open 2023-10-03T19:21:28.693 INFO:teuthology.orchestra.run.smithi045.stdout: -552> 2023-10-03T19:20:27.455+0000 7f04f8d27640 15 mds.0.server oldest_client_tid=1 2023-10-03T19:21:28.693 INFO:teuthology.orchestra.run.smithi045.stdout: -551> 2023-10-03T19:20:27.455+0000 7f04f8d27640 7 mds.0.cache request_start request(client.6826:1 nref=2 cr=0x55c505a6fb00) 2023-10-03T19:21:28.693 INFO:teuthology.orchestra.run.smithi045.stdout: -550> 2023-10-03T19:20:27.455+0000 7f04f8d27640 7 mds.0.server dispatch_client_request client_request(client.6826:1 getattr pAsLsXsFs #0x1 2023-10-03T19:20:27.454565+0000 caller_uid=0, caller_gid=0{}) v6 2023-10-03T19:21:28.693 INFO:teuthology.orchestra.run.smithi045.stdout: -549> 2023-10-03T19:20:27.455+0000 7f04f8d27640 7 mds.0.cache traverse: opening base ino 0x1 snap head 2023-10-03T19:21:28.693 INFO:teuthology.orchestra.run.smithi045.stdout: -548> 2023-10-03T19:20:27.455+0000 7f04f8d27640 10 mds.0.cache path_traverse finish on snapid head 2023-10-03T19:21:28.693 INFO:teuthology.orchestra.run.smithi045.stdout: -547> 2023-10-03T19:20:27.455+0000 7f04f8d27640 10 mds.0.server rdlock_path_pin_ref request(client.6826:1 nref=3 cr=0x55c505a6fb00) #0x1 2023-10-03T19:21:28.693 INFO:teuthology.orchestra.run.smithi045.stdout: -546> 2023-10-03T19:20:27.455+0000 7f04f8d27640 7 mds.0.cache traverse: opening base ino 0x1 snap head 2023-10-03T19:21:28.693 INFO:teuthology.orchestra.run.smithi045.stdout: -545> 2023-10-03T19:20:27.455+0000 7f04f8d27640 10 mds.0.locker try_rdlock_snap_layout request(client.6826:1 nref=4 cr=0x55c505a6fb00) [inode 0x1 [...2,head] / auth v1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iversion lock) | request=1 dirfrag=1 dirtyparent=0 authpin=0 0x55c504b88680] 2023-10-03T19:21:28.693 INFO:teuthology.orchestra.run.smithi045.stdout: -544> 2023-10-03T19:20:27.455+0000 7f04f8d27640 20 mds.0.locker got rdlock on (isnap sync r=1) [inode 0x1 [...2,head] / auth v1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) | request=1 lock=1 dirfrag=1 dirtyparent=0 authpin=0 0x55c504b88680] 2023-10-03T19:21:28.693 INFO:teuthology.orchestra.run.smithi045.stdout: -543> 2023-10-03T19:20:27.455+0000 7f04f8d27640 10 mds.0.cache path_traverse finish on snapid head 2023-10-03T19:21:28.693 INFO:teuthology.orchestra.run.smithi045.stdout: -542> 2023-10-03T19:20:27.455+0000 7f04f8d27640 10 mds.0.server ref is [inode 0x1 [...2,head] / auth v1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) | request=1 lock=1 dirfrag=1 dirtyparent=0 authpin=0 0x55c504b88680] 2023-10-03T19:21:28.693 INFO:teuthology.orchestra.run.smithi045.stdout: -541> 2023-10-03T19:20:27.455+0000 7f04f8d27640 10 mds.0.locker acquire_locks request(client.6826:1 nref=3 cr=0x55c505a6fb00) 2023-10-03T19:21:28.693 INFO:teuthology.orchestra.run.smithi045.stdout: -540> 2023-10-03T19:20:27.455+0000 7f04f8d27640 20 mds.0.locker must rdlock (ilink sync) [inode 0x1 [...2,head] / auth v1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) | request=1 lock=1 dirfrag=1 dirtyparent=0 authpin=0 0x55c504b88680] 2023-10-03T19:21:28.694 INFO:teuthology.orchestra.run.smithi045.stdout: -539> 2023-10-03T19:20:27.455+0000 7f04f8d27640 20 mds.0.locker must rdlock (iauth sync) [inode 0x1 [...2,head] / auth v1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) | request=1 lock=1 dirfrag=1 dirtyparent=0 authpin=0 0x55c504b88680] 2023-10-03T19:21:28.694 INFO:teuthology.orchestra.run.smithi045.stdout: -538> 2023-10-03T19:20:27.455+0000 7f04f8d27640 20 mds.0.locker must rdlock (ixattr sync) [inode 0x1 [...2,head] / auth v1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) | request=1 lock=1 dirfrag=1 dirtyparent=0 authpin=0 0x55c504b88680] 2023-10-03T19:21:28.694 INFO:teuthology.orchestra.run.smithi045.stdout: -537> 2023-10-03T19:20:27.455+0000 7f04f8d27640 20 mds.0.locker must rdlock (ifile sync) [inode 0x1 [...2,head] / auth v1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) | request=1 lock=1 dirfrag=1 dirtyparent=0 authpin=0 0x55c504b88680] 2023-10-03T19:21:28.694 INFO:teuthology.orchestra.run.smithi045.stdout: -536> 2023-10-03T19:20:27.455+0000 7f04f8d27640 10 mds.0.locker must authpin [inode 0x1 [...2,head] / auth v1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) | request=1 lock=1 dirfrag=1 dirtyparent=0 authpin=0 0x55c504b88680] 2023-10-03T19:21:28.694 INFO:teuthology.orchestra.run.smithi045.stdout: -535> 2023-10-03T19:20:27.455+0000 7f04f8d27640 10 mds.0.locker auth_pinning [inode 0x1 [...2,head] / auth v1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) | request=1 lock=1 dirfrag=1 dirtyparent=0 authpin=0 0x55c504b88680] 2023-10-03T19:21:28.694 INFO:teuthology.orchestra.run.smithi045.stdout: -534> 2023-10-03T19:20:27.455+0000 7f04f8d27640 10 mds.0.cache.ino(0x1) auth_pin by 0x55c505b22c00 on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) | request=1 lock=1 dirfrag=1 dirtyparent=0 authpin=1 0x55c504b88680] now 1 2023-10-03T19:21:28.694 INFO:teuthology.orchestra.run.smithi045.stdout: -533> 2023-10-03T19:20:27.455+0000 7f04f8d27640 7 mds.0.locker rdlock_start on (ifile sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) | request=1 lock=1 dirfrag=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.694 INFO:teuthology.orchestra.run.smithi045.stdout: -532> 2023-10-03T19:20:27.455+0000 7f04f8d27640 10 mds.0.locker got rdlock on (ifile sync r=1) [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (ifile sync r=1) (iversion lock) | request=1 lock=2 dirfrag=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.694 INFO:teuthology.orchestra.run.smithi045.stdout: -531> 2023-10-03T19:20:27.455+0000 7f04f8d27640 7 mds.0.locker rdlock_start on (iauth sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (ifile sync r=1) (iversion lock) | request=1 lock=2 dirfrag=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.694 INFO:teuthology.orchestra.run.smithi045.stdout: -530> 2023-10-03T19:20:27.455+0000 7f04f8d27640 10 mds.0.locker got rdlock on (iauth sync r=1) [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iauth sync r=1) (isnap sync r=1) (ifile sync r=1) (iversion lock) | request=1 lock=3 dirfrag=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.694 INFO:teuthology.orchestra.run.smithi045.stdout: -529> 2023-10-03T19:20:27.455+0000 7f04f8d27640 7 mds.0.locker rdlock_start on (ilink sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iauth sync r=1) (isnap sync r=1) (ifile sync r=1) (iversion lock) | request=1 lock=3 dirfrag=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.764 INFO:teuthology.orchestra.run.smithi045.stdout: -528> 2023-10-03T19:20:27.455+0000 7f04f8d27640 10 mds.0.locker got rdlock on (ilink sync r=1) [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iauth sync r=1) (ilink sync r=1) (isnap sync r=1) (ifile sync r=1) (iversion lock) | request=1 lock=4 dirfrag=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.764 INFO:teuthology.orchestra.run.smithi045.stdout: -527> 2023-10-03T19:20:27.455+0000 7f04f8d27640 7 mds.0.locker rdlock_start on (ixattr sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iauth sync r=1) (ilink sync r=1) (isnap sync r=1) (ifile sync r=1) (iversion lock) | request=1 lock=4 dirfrag=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.764 INFO:teuthology.orchestra.run.smithi045.stdout: -526> 2023-10-03T19:20:27.455+0000 7f04f8d27640 10 mds.0.locker got rdlock on (ixattr sync r=1) [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iauth sync r=1) (ilink sync r=1) (isnap sync r=1) (ifile sync r=1) (ixattr sync r=1) (iversion lock) | request=1 lock=5 dirfrag=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.764 INFO:teuthology.orchestra.run.smithi045.stdout: -525> 2023-10-03T19:20:27.455+0000 7f04f8d27640 20 Session check_access path 2023-10-03T19:21:28.764 INFO:teuthology.orchestra.run.smithi045.stdout: -524> 2023-10-03T19:20:27.455+0000 7f04f8d27640 10 mds.0.server reply to stat on client_request(client.6826:1 getattr pAsLsXsFs #0x1 2023-10-03T19:20:27.454565+0000 caller_uid=0, caller_gid=0{}) v6 2023-10-03T19:21:28.764 INFO:teuthology.orchestra.run.smithi045.stdout: -523> 2023-10-03T19:20:27.455+0000 7f04f8d27640 20 mds.0.server respond_to_request batch head request(client.6826:1 nref=3 cr=0x55c505a6fb00) 2023-10-03T19:21:28.764 INFO:teuthology.orchestra.run.smithi045.stdout: -522> 2023-10-03T19:20:27.455+0000 7f04f8d27640 20 respond: responding to batch ops with result=0: [batch front=request(client.6826:1 nref=3 cr=0x55c505a6fb00)] 2023-10-03T19:21:28.765 INFO:teuthology.orchestra.run.smithi045.stdout: -521> 2023-10-03T19:20:27.455+0000 7f04f8d27640 7 mds.0.server reply_client_request 0 ((0) Success) client_request(client.6826:1 getattr pAsLsXsFs #0x1 2023-10-03T19:20:27.454565+0000 caller_uid=0, caller_gid=0{}) v6 2023-10-03T19:21:28.765 INFO:teuthology.orchestra.run.smithi045.stdout: -520> 2023-10-03T19:20:27.455+0000 7f04f8d27640 10 mds.0.server apply_allocated_inos 0x0 / [] / 0x0 2023-10-03T19:21:28.765 INFO:teuthology.orchestra.run.smithi045.stdout: -519> 2023-10-03T19:20:27.455+0000 7f04f8d27640 20 mds.0.server lat 0.000534 2023-10-03T19:21:28.765 INFO:teuthology.orchestra.run.smithi045.stdout: -518> 2023-10-03T19:20:27.455+0000 7f04f8d27640 20 mds.0.server set_trace_dist snapid head 2023-10-03T19:21:28.765 INFO:teuthology.orchestra.run.smithi045.stdout: -517> 2023-10-03T19:20:27.455+0000 7f04f8d27640 10 mds.0.cache.snaprealm(0x1 seq 1 0x55c504c6d8c0) build_snap_set on snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:20:16.305990+0000 change_attr 0 0x55c504c6d8c0) 2023-10-03T19:21:28.765 INFO:teuthology.orchestra.run.smithi045.stdout: -516> 2023-10-03T19:20:27.455+0000 7f04f8d27640 10 mds.0.cache.snaprealm(0x1 seq 1 0x55c504c6d8c0) build_snap_trace my_snaps [] 2023-10-03T19:21:28.765 INFO:teuthology.orchestra.run.smithi045.stdout: -515> 2023-10-03T19:20:27.455+0000 7f04f8d27640 10 mds.0.cache.snaprealm(0x1 seq 1 0x55c504c6d8c0) check_cache rebuilt seq 1 cached_seq 1 cached_last_created 0 cached_last_destroyed 1) 2023-10-03T19:21:28.765 INFO:teuthology.orchestra.run.smithi045.stdout: -514> 2023-10-03T19:20:27.455+0000 7f04f8d27640 10 mds.0.server set_trace_dist snaprealm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:20:16.305990+0000 change_attr 0 0x55c504c6d8c0) len=70 2023-10-03T19:21:28.765 INFO:teuthology.orchestra.run.smithi045.stdout: -513> 2023-10-03T19:20:27.455+0000 7f04f8d27640 20 mds.0.cache.ino(0x1) pfile 0 pauth 0 plink 0 pxattr 0 plocal 0 mtime 2023-10-03T19:20:16.305990+0000 ctime 2023-10-03T19:20:16.305990+0000 change_attr 0 valid=1 2023-10-03T19:21:28.765 INFO:teuthology.orchestra.run.smithi045.stdout: -512> 2023-10-03T19:20:27.455+0000 7f04f8d27640 10 mds.0.cache.ino(0x1) add_client_cap first cap, joining realm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:20:16.305990+0000 change_attr 0 0x55c504c6d8c0) 2023-10-03T19:21:28.765 INFO:teuthology.orchestra.run.smithi045.stdout: -511> 2023-10-03T19:20:27.455+0000 7f04f8d27640 10 mds.0.cache.ino(0x1) encode_inodestat issuing pAsLsXsFs seq 1 2023-10-03T19:21:28.766 INFO:teuthology.orchestra.run.smithi045.stdout: -510> 2023-10-03T19:20:27.455+0000 7f04f8d27640 10 mds.0.cache.ino(0x1) encode_inodestat caps pAsLsXsFs seq 1 mseq 0 xattrv 1 2023-10-03T19:21:28.766 INFO:teuthology.orchestra.run.smithi045.stdout: -509> 2023-10-03T19:20:27.455+0000 7f04f8d27640 10 mds.0.cache.ino(0x1) including xattrs version 1 2023-10-03T19:21:28.766 INFO:teuthology.orchestra.run.smithi045.stdout: -508> 2023-10-03T19:20:27.455+0000 7f04f8d27640 20 mds.0.server set_trace_dist added snap head in [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iauth sync r=1) (ilink sync r=1) (isnap sync r=1) (ifile sync r=1) (ixattr sync r=1) (iversion lock) caps={6826=pAsLsXsFs/-@1} | request=1 lock=5 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.766 INFO:teuthology.orchestra.run.smithi045.stdout: -507> 2023-10-03T19:20:27.455+0000 7f04f8d27640 10 mds.0.54 send_message_client client.6826 172.21.15.146:0/2294298422 client_reply(???:1 = 0 (0) Success) v1 2023-10-03T19:21:28.766 INFO:teuthology.orchestra.run.smithi045.stdout: -506> 2023-10-03T19:20:27.455+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> 172.21.15.146:0/2294298422 -- client_reply(???:1 = 0 (0) Success) v1 -- 0x55c504b3b880 con 0x55c505887400 2023-10-03T19:21:28.766 INFO:teuthology.orchestra.run.smithi045.stdout: -505> 2023-10-03T19:20:27.455+0000 7f04f8d27640 7 mds.0.cache request_finish request(client.6826:1 nref=3 cr=0x55c505a6fb00) 2023-10-03T19:21:28.766 INFO:teuthology.orchestra.run.smithi045.stdout: -504> 2023-10-03T19:20:27.455+0000 7f04f8d27640 15 mds.0.cache request_cleanup request(client.6826:1 nref=3 cr=0x55c505a6fb00) 2023-10-03T19:21:28.766 INFO:teuthology.orchestra.run.smithi045.stdout: -503> 2023-10-03T19:20:27.455+0000 7f04f8d27640 7 mds.0.locker rdlock_finish on (iauth sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (ilink sync r=1) (isnap sync r=1) (ifile sync r=1) (ixattr sync r=1) (iversion lock) caps={6826=pAsLsXsFs/-@1} | request=1 lock=4 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.766 INFO:teuthology.orchestra.run.smithi045.stdout: -502> 2023-10-03T19:20:27.455+0000 7f04f8d27640 10 mds.0.locker simple_eval (iauth sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (ilink sync r=1) (isnap sync r=1) (ifile sync r=1) (ixattr sync r=1) (iversion lock) caps={6826=pAsLsXsFs/-@1} | request=1 lock=4 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.766 INFO:teuthology.orchestra.run.smithi045.stdout: -501> 2023-10-03T19:20:27.455+0000 7f04f8d27640 7 mds.0.locker rdlock_finish on (ilink sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (ifile sync r=1) (ixattr sync r=1) (iversion lock) caps={6826=pAsLsXsFs/-@1} | request=1 lock=3 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.766 INFO:teuthology.orchestra.run.smithi045.stdout: -500> 2023-10-03T19:20:27.459+0000 7f04f8d27640 10 mds.0.locker simple_eval (ilink sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (ifile sync r=1) (ixattr sync r=1) (iversion lock) caps={6826=pAsLsXsFs/-@1} | request=1 lock=3 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.767 INFO:teuthology.orchestra.run.smithi045.stdout: -499> 2023-10-03T19:20:27.459+0000 7f04f8d27640 7 mds.0.locker rdlock_finish on (ifile sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (ixattr sync r=1) (iversion lock) caps={6826=pAsLsXsFs/-@1} | request=1 lock=2 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.767 INFO:teuthology.orchestra.run.smithi045.stdout: -498> 2023-10-03T19:20:27.459+0000 7f04f8d27640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (ixattr sync r=1) (iversion lock) caps={6826=pAsLsXsFs/-@1} | request=1 lock=2 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.767 INFO:teuthology.orchestra.run.smithi045.stdout: -497> 2023-10-03T19:20:27.459+0000 7f04f8d27640 7 mds.0.locker rdlock_finish on (ixattr sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={6826=pAsLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.767 INFO:teuthology.orchestra.run.smithi045.stdout: -496> 2023-10-03T19:20:27.459+0000 7f04f8d27640 10 mds.0.locker simple_eval (ixattr sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={6826=pAsLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.767 INFO:teuthology.orchestra.run.smithi045.stdout: -495> 2023-10-03T19:20:27.459+0000 7f04f8d27640 7 mds.0.locker rdlock_finish on (isnap sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iversion lock) caps={6826=pAsLsXsFs/-@1} | request=1 lock=0 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.767 INFO:teuthology.orchestra.run.smithi045.stdout: -494> 2023-10-03T19:20:27.459+0000 7f04f8d27640 10 mds.0.locker simple_eval (isnap sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iversion lock) caps={6826=pAsLsXsFs/-@1} | request=1 lock=0 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.767 INFO:teuthology.orchestra.run.smithi045.stdout: -493> 2023-10-03T19:20:27.459+0000 7f04f8d27640 10 mds.0.cache.ino(0x1) auth_unpin by 0x55c505b22c00 on [inode 0x1 [...2,head] / auth v1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iversion lock) caps={6826=pAsLsXsFs/-@1} | request=1 lock=0 dirfrag=1 caps=1 dirtyparent=0 authpin=0 0x55c504b88680] now 0 2023-10-03T19:21:28.767 INFO:teuthology.orchestra.run.smithi045.stdout: -492> 2023-10-03T19:20:27.927+0000 7f04f7d25640 10 monclient: tick 2023-10-03T19:21:28.767 INFO:teuthology.orchestra.run.smithi045.stdout: -491> 2023-10-03T19:20:27.927+0000 7f04f7d25640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.767 INFO:teuthology.orchestra.run.smithi045.stdout: -490> 2023-10-03T19:20:27.927+0000 7f04f7d25640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:57.930654+0000) 2023-10-03T19:21:28.767 INFO:teuthology.orchestra.run.smithi045.stdout: -489> 2023-10-03T19:20:28.303+0000 7f04f7524640 20 mds.0.54 get_task_status 2023-10-03T19:21:28.768 INFO:teuthology.orchestra.run.smithi045.stdout: -488> 2023-10-03T19:20:28.303+0000 7f04f7524640 20 mds.0.54 schedule_update_timer_task 2023-10-03T19:21:28.768 INFO:teuthology.orchestra.run.smithi045.stdout: -487> 2023-10-03T19:20:28.315+0000 7f04f4d1f640 2 mds.0.cache Memory usage: total 274128, rss 37440, heap 207144, baseline 190760, 1 / 13 inodes have caps, 1 caps, 0.0769231 caps per inode 2023-10-03T19:21:28.768 INFO:teuthology.orchestra.run.smithi045.stdout: -486> 2023-10-03T19:20:28.315+0000 7f04f4d1f640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999985635s ago 2023-10-03T19:21:28.768 INFO:teuthology.orchestra.run.smithi045.stdout: -485> 2023-10-03T19:20:28.315+0000 7f04f4d1f640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:28.768 INFO:teuthology.orchestra.run.smithi045.stdout: -484> 2023-10-03T19:20:28.315+0000 7f04f4d1f640 7 mds.0.cache trim bytes_used=50kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:28.768 INFO:teuthology.orchestra.run.smithi045.stdout: -483> 2023-10-03T19:20:28.315+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:28.768 INFO:teuthology.orchestra.run.smithi045.stdout: -482> 2023-10-03T19:20:28.315+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:28.768 INFO:teuthology.orchestra.run.smithi045.stdout: -481> 2023-10-03T19:20:28.315+0000 7f04f4d1f640 7 mds.0.server recall_client_state: min=100 max=1048576 total=1 flags=0xa 2023-10-03T19:21:28.768 INFO:teuthology.orchestra.run.smithi045.stdout: -480> 2023-10-03T19:20:28.315+0000 7f04f4d1f640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:28.768 INFO:teuthology.orchestra.run.smithi045.stdout: -479> 2023-10-03T19:20:28.315+0000 7f04f4d1f640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:28.768 INFO:teuthology.orchestra.run.smithi045.stdout: -478> 2023-10-03T19:20:28.375+0000 7f04f6d23640 5 mds.beacon.a Sending beacon up:active seq 6 2023-10-03T19:21:28.768 INFO:teuthology.orchestra.run.smithi045.stdout: -477> 2023-10-03T19:20:28.375+0000 7f04f6d23640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.769 INFO:teuthology.orchestra.run.smithi045.stdout: -476> 2023-10-03T19:20:28.375+0000 7f04f6d23640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mdsbeacon(7602/a up:active seq=6 v58) v8 -- 0x55c505bbc2c0 con 0x55c504afb400 2023-10-03T19:21:28.769 INFO:teuthology.orchestra.run.smithi045.stdout: -475> 2023-10-03T19:20:28.375+0000 7f04f6d23640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:28.769 INFO:teuthology.orchestra.run.smithi045.stdout: -474> 2023-10-03T19:20:28.375+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 56 ==== mdsbeacon(7602/a up:active seq=6 v58) v8 ==== 130+0+0 (secure 0 0 0) 0x55c505bbc2c0 con 0x55c504afb400 2023-10-03T19:21:28.769 INFO:teuthology.orchestra.run.smithi045.stdout: -473> 2023-10-03T19:20:28.375+0000 7f04fb52c640 5 mds.beacon.a received beacon reply up:active seq 6 rtt 0 2023-10-03T19:21:28.796 INFO:teuthology.orchestra.run.smithi045.stdout: -472> 2023-10-03T19:20:28.375+0000 7f04f6d23640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:28.797 INFO:teuthology.orchestra.run.smithi045.stdout: -471> 2023-10-03T19:20:28.451+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== client.6826 172.21.15.146:0/2294298422 5 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.001466, avg_latency: 0.001466, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55c505b8e420 con 0x55c505887400 2023-10-03T19:21:28.797 INFO:teuthology.orchestra.run.smithi045.stdout: -470> 2023-10-03T19:20:28.451+0000 7f04fb52c640 20 mds.0.54 get_session have 0x55c504b1ad00 client.6826 172.21.15.146:0/2294298422 state open 2023-10-03T19:21:28.797 INFO:teuthology.orchestra.run.smithi045.stdout: -469> 2023-10-03T19:20:28.451+0000 7f04fb52c640 20 handle_client_metrics: mds.metrics: session=0x55c504b1ad00 2023-10-03T19:21:28.797 INFO:teuthology.orchestra.run.smithi045.stdout: -468> 2023-10-03T19:20:28.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=READ_LATENCY, session=0x55c504b1ad00, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:28.797 INFO:teuthology.orchestra.run.smithi045.stdout: -467> 2023-10-03T19:20:28.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=WRITE_LATENCY, session=0x55c504b1ad00, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:28.797 INFO:teuthology.orchestra.run.smithi045.stdout: -466> 2023-10-03T19:20:28.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=METADATA_LATENCY, session=0x55c504b1ad00, latency=0.001466, avg=0.001466, sq_sum=0, count=1 2023-10-03T19:21:28.797 INFO:teuthology.orchestra.run.smithi045.stdout: -465> 2023-10-03T19:20:28.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=CAP_INFO, session=0x55c504b1ad00, hits=1, misses=0 2023-10-03T19:21:28.797 INFO:teuthology.orchestra.run.smithi045.stdout: -464> 2023-10-03T19:20:28.451+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== client.6826 172.21.15.146:0/2294298422 4 ==== client_session(request_renewcaps seq 2) v1 ==== 28+0+0 (crc 0 0 0) 0x55c504b3b880 con 0x55c505887400 2023-10-03T19:21:28.797 INFO:teuthology.orchestra.run.smithi045.stdout: -463> 2023-10-03T19:20:28.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=DENTRY_LEASE, session=0x55c504b1ad00, hits=0, misses=0 2023-10-03T19:21:28.797 INFO:teuthology.orchestra.run.smithi045.stdout: -462> 2023-10-03T19:20:28.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=OPENED_FILES, session=0x55c504b1ad00, opened_files=0, total_inodes=1 2023-10-03T19:21:28.797 INFO:teuthology.orchestra.run.smithi045.stdout: -461> 2023-10-03T19:20:28.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=PINNED_ICAPS, session=0x55c504b1ad00, pinned_icaps=1, total_inodes=1 2023-10-03T19:21:28.798 INFO:teuthology.orchestra.run.smithi045.stdout: -460> 2023-10-03T19:20:28.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=OPENED_INODES, session=0x55c504b1ad00, opened_inodes=0, total_inodes=1 2023-10-03T19:21:28.798 INFO:teuthology.orchestra.run.smithi045.stdout: -459> 2023-10-03T19:20:28.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=READ_IO_SIZES, session=0x55c504b1ad00, total_ops=0, total_size=0 2023-10-03T19:21:28.798 INFO:teuthology.orchestra.run.smithi045.stdout: -458> 2023-10-03T19:20:28.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=WRITE_IO_SIZES, session=0x55c504b1ad00, total_ops=0, total_size=0 2023-10-03T19:21:28.798 INFO:teuthology.orchestra.run.smithi045.stdout: -457> 2023-10-03T19:20:28.451+0000 7f04f8d27640 20 mds.0.54 get_session have 0x55c504b1ad00 client.6826 172.21.15.146:0/2294298422 state open 2023-10-03T19:21:28.798 INFO:teuthology.orchestra.run.smithi045.stdout: -456> 2023-10-03T19:20:28.451+0000 7f04f8d27640 3 mds.0.server handle_client_session client_session(request_renewcaps seq 2) v1 from client.6826 2023-10-03T19:21:28.798 INFO:teuthology.orchestra.run.smithi045.stdout: -455> 2023-10-03T19:20:28.451+0000 7f04f8d27640 10 mds.0.sessionmap touch_session s=0x55c504b1ad00 name=client.6826 2023-10-03T19:21:28.798 INFO:teuthology.orchestra.run.smithi045.stdout: -454> 2023-10-03T19:20:28.451+0000 7f04f8d27640 10 mds.0.54 send_message_client client.6826 172.21.15.146:0/2294298422 client_session(renewcaps seq 2) v5 2023-10-03T19:21:28.798 INFO:teuthology.orchestra.run.smithi045.stdout: -453> 2023-10-03T19:20:28.451+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> 172.21.15.146:0/2294298422 -- client_session(renewcaps seq 2) v5 -- 0x55c504b3bc00 con 0x55c505887400 2023-10-03T19:21:28.798 INFO:teuthology.orchestra.run.smithi045.stdout: -452> 2023-10-03T19:20:28.927+0000 7f04f7d25640 10 monclient: tick 2023-10-03T19:21:28.798 INFO:teuthology.orchestra.run.smithi045.stdout: -451> 2023-10-03T19:20:28.927+0000 7f04f7d25640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.798 INFO:teuthology.orchestra.run.smithi045.stdout: -450> 2023-10-03T19:20:28.927+0000 7f04f7d25640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:58.930826+0000) 2023-10-03T19:21:28.798 INFO:teuthology.orchestra.run.smithi045.stdout: -449> 2023-10-03T19:20:29.207+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== client.6826 172.21.15.146:0/2294298422 6 ==== client_request(client.6826:2 setattr mode=041777 #0x1 2023-10-03T19:20:29.210806+0000 caller_uid=0, caller_gid=0{0,}) v6 ==== 208+0+0 (crc 0 0 0) 0x55c505b2a000 con 0x55c505887400 2023-10-03T19:21:28.799 INFO:teuthology.orchestra.run.smithi045.stdout: -448> 2023-10-03T19:20:29.207+0000 7f04f8d27640 4 mds.0.server handle_client_request client_request(client.6826:2 setattr mode=041777 #0x1 2023-10-03T19:20:29.210806+0000 caller_uid=0, caller_gid=0{0,}) v6 2023-10-03T19:21:28.799 INFO:teuthology.orchestra.run.smithi045.stdout: -447> 2023-10-03T19:20:29.207+0000 7f04f8d27640 20 mds.0.54 get_session have 0x55c504b1ad00 client.6826 172.21.15.146:0/2294298422 state open 2023-10-03T19:21:28.799 INFO:teuthology.orchestra.run.smithi045.stdout: -446> 2023-10-03T19:20:29.207+0000 7f04f8d27640 15 mds.0.server oldest_client_tid=2 2023-10-03T19:21:28.799 INFO:teuthology.orchestra.run.smithi045.stdout: -445> 2023-10-03T19:20:29.207+0000 7f04f8d27640 7 mds.0.cache request_start request(client.6826:2 nref=2 cr=0x55c505b2a000) 2023-10-03T19:21:28.799 INFO:teuthology.orchestra.run.smithi045.stdout: -444> 2023-10-03T19:20:29.207+0000 7f04f8d27640 10 mds.0.locker process_request_cap_release client.6826 pLsXsFs on [inode 0x1 [...2,head] / auth v1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iversion lock) caps={6826=pAsLsXsFs/-@1} | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 authpin=0 0x55c504b88680] 2023-10-03T19:21:28.799 INFO:teuthology.orchestra.run.smithi045.stdout: -443> 2023-10-03T19:20:29.207+0000 7f04f8d27640 10 mds.0.locker wanted - -> - 2023-10-03T19:21:28.799 INFO:teuthology.orchestra.run.smithi045.stdout: -442> 2023-10-03T19:20:29.207+0000 7f04f8d27640 10 mds.0.locker eval 3648 [inode 0x1 [...2,head] / auth v1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iversion lock) caps={6826=pLsXsFs/-@1} | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 authpin=0 0x55c504b88680] 2023-10-03T19:21:28.799 INFO:teuthology.orchestra.run.smithi045.stdout: -441> 2023-10-03T19:20:29.207+0000 7f04f8d27640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile sync) on [inode 0x1 [...2,head] / auth v1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iversion lock) caps={6826=pLsXsFs/-@1} | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 authpin=0 0x55c504b88680] 2023-10-03T19:21:28.799 INFO:teuthology.orchestra.run.smithi045.stdout: -440> 2023-10-03T19:20:29.207+0000 7f04f8d27640 10 mds.0.locker simple_eval (iauth sync) on [inode 0x1 [...2,head] / auth v1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iversion lock) caps={6826=pLsXsFs/-@1} | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 authpin=0 0x55c504b88680] 2023-10-03T19:21:28.799 INFO:teuthology.orchestra.run.smithi045.stdout: -439> 2023-10-03T19:20:29.207+0000 7f04f8d27640 10 mds.0.locker simple_eval (ilink sync) on [inode 0x1 [...2,head] / auth v1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iversion lock) caps={6826=pLsXsFs/-@1} | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 authpin=0 0x55c504b88680] 2023-10-03T19:21:28.799 INFO:teuthology.orchestra.run.smithi045.stdout: -438> 2023-10-03T19:20:29.207+0000 7f04f8d27640 10 mds.0.locker simple_eval (ixattr sync) on [inode 0x1 [...2,head] / auth v1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iversion lock) caps={6826=pLsXsFs/-@1} | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 authpin=0 0x55c504b88680] 2023-10-03T19:21:28.800 INFO:teuthology.orchestra.run.smithi045.stdout: -437> 2023-10-03T19:20:29.207+0000 7f04f8d27640 10 mds.0.locker eval done 2023-10-03T19:21:28.800 INFO:teuthology.orchestra.run.smithi045.stdout: -436> 2023-10-03T19:20:29.207+0000 7f04f8d27640 7 mds.0.server dispatch_client_request client_request(client.6826:2 setattr mode=041777 #0x1 2023-10-03T19:20:29.210806+0000 caller_uid=0, caller_gid=0{0,}) v6 2023-10-03T19:21:28.800 INFO:teuthology.orchestra.run.smithi045.stdout: -435> 2023-10-03T19:20:29.207+0000 7f04f8d27640 10 mds.0.server rdlock_path_pin_ref request(client.6826:2 nref=2 cr=0x55c505b2a000) #0x1 2023-10-03T19:21:28.800 INFO:teuthology.orchestra.run.smithi045.stdout: -434> 2023-10-03T19:20:29.207+0000 7f04f8d27640 7 mds.0.cache traverse: opening base ino 0x1 snap head 2023-10-03T19:21:28.800 INFO:teuthology.orchestra.run.smithi045.stdout: -433> 2023-10-03T19:20:29.207+0000 7f04f8d27640 10 mds.0.locker try_rdlock_snap_layout request(client.6826:2 nref=3 cr=0x55c505b2a000) [inode 0x1 [...2,head] / auth v1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iversion lock) caps={6826=pLsXsFs/-@1} | request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 authpin=0 0x55c504b88680] 2023-10-03T19:21:28.800 INFO:teuthology.orchestra.run.smithi045.stdout: -432> 2023-10-03T19:20:29.207+0000 7f04f8d27640 20 mds.0.locker got rdlock on (isnap sync r=1) [inode 0x1 [...2,head] / auth v1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@1} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=0 authpin=0 0x55c504b88680] 2023-10-03T19:21:28.800 INFO:teuthology.orchestra.run.smithi045.stdout: -431> 2023-10-03T19:20:29.207+0000 7f04f8d27640 10 mds.0.cache path_traverse finish on snapid head 2023-10-03T19:21:28.800 INFO:teuthology.orchestra.run.smithi045.stdout: -430> 2023-10-03T19:20:29.207+0000 7f04f8d27640 10 mds.0.server ref is [inode 0x1 [...2,head] / auth v1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@1} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=0 authpin=0 0x55c504b88680] 2023-10-03T19:21:28.800 INFO:teuthology.orchestra.run.smithi045.stdout: -429> 2023-10-03T19:20:29.207+0000 7f04f8d27640 10 mds.0.cache.ino(0x1) auth_pin by 0x55c505b23000 on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@1} | request=0 lock=1 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x55c504b88680] now 1 2023-10-03T19:21:28.800 INFO:teuthology.orchestra.run.smithi045.stdout: -428> 2023-10-03T19:20:29.207+0000 7f04f8d27640 10 mds.0.locker acquire_locks request(client.6826:2 nref=2 cr=0x55c505b2a000) 2023-10-03T19:21:28.800 INFO:teuthology.orchestra.run.smithi045.stdout: -427> 2023-10-03T19:20:29.207+0000 7f04f8d27640 20 mds.0.locker must xlock (iauth sync) [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.801 INFO:teuthology.orchestra.run.smithi045.stdout: -426> 2023-10-03T19:20:29.207+0000 7f04f8d27640 20 mds.0.locker must wrlock (iversion lock) [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.801 INFO:teuthology.orchestra.run.smithi045.stdout: -425> 2023-10-03T19:20:29.207+0000 7f04f8d27640 10 mds.0.locker must authpin [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.801 INFO:teuthology.orchestra.run.smithi045.stdout: -424> 2023-10-03T19:20:29.207+0000 7f04f8d27640 10 mds.0.locker already auth_pinned [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.801 INFO:teuthology.orchestra.run.smithi045.stdout: -423> 2023-10-03T19:20:29.207+0000 7f04f8d27640 7 mds.0.locker xlock_start on (iauth sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.801 INFO:teuthology.orchestra.run.smithi045.stdout: -422> 2023-10-03T19:20:29.207+0000 7f04f8d27640 7 mds.0.locker simple_lock on (iauth sync) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.801 INFO:teuthology.orchestra.run.smithi045.stdout: -421> 2023-10-03T19:20:29.207+0000 7f04f8d27640 7 mds.0.locker simple_xlock on (iauth lock) on [inode 0x1 [...2,head] / auth v1 ap=1 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iauth lock) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.801 INFO:teuthology.orchestra.run.smithi045.stdout: -420> 2023-10-03T19:20:29.207+0000 7f04f8d27640 10 mds.0.cache.ino(0x1) auth_pin by 0x55c504b88910 on [inode 0x1 [...2,head] / auth v1 ap=2 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iauth lock) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x55c504b88680] now 2 2023-10-03T19:21:28.801 INFO:teuthology.orchestra.run.smithi045.stdout: -419> 2023-10-03T19:20:29.207+0000 7f04f8d27640 10 mds.0.locker got xlock on (iauth xlock x=1 by 0x55c505b23000) [inode 0x1 [...2,head] / auth v1 ap=2 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iauth xlock x=1 by 0x55c505b23000) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@1} | request=1 lock=2 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.801 INFO:teuthology.orchestra.run.smithi045.stdout: -418> 2023-10-03T19:20:29.207+0000 7f04f8d27640 7 mds.0.locker local_wrlock_start on (iversion lock) on [inode 0x1 [...2,head] / auth v1 ap=2 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iauth xlock x=1 by 0x55c505b23000) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@1} | request=1 lock=2 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.801 INFO:teuthology.orchestra.run.smithi045.stdout: -417> 2023-10-03T19:20:29.207+0000 7f04f8d27640 10 mds.0.locker got wrlock on (iversion lock w=1 last_client=6826) [inode 0x1 [...2,head] / auth v1 ap=2 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iauth xlock x=1 by 0x55c505b23000) (isnap sync r=1) (iversion lock w=1 last_client=6826) caps={6826=pLsXsFs/-@1} | request=1 lock=3 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.801 INFO:teuthology.orchestra.run.smithi045.stdout: -416> 2023-10-03T19:20:29.207+0000 7f04f8d27640 20 Session check_access path 2023-10-03T19:21:28.802 INFO:teuthology.orchestra.run.smithi045.stdout: -415> 2023-10-03T19:20:29.207+0000 7f04f8d27640 15 mds.0.cache.ino(0x1) project_inode 0x1 2023-10-03T19:21:28.802 INFO:teuthology.orchestra.run.smithi045.stdout: -414> 2023-10-03T19:20:29.207+0000 7f04f8d27640 10 mds.0.server journal_and_reply tracei 0x55c504b88680 tracedn 0 2023-10-03T19:21:28.802 INFO:teuthology.orchestra.run.smithi045.stdout: -413> 2023-10-03T19:20:29.207+0000 7f04f8d27640 10 mds.0.locker set_xlocks_done on (iauth xlock x=1 by 0x55c505b23000) [inode 0x1 [...2,head] / auth v1 pv2 ap=2 snaprealm=0x55c504c6d8c0 f()->f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1)->n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iauth xlock x=1 by 0x55c505b23000) (isnap sync r=1) (iversion lock w=1 last_client=6826) caps={6826=pLsXsFs/-@1} | request=1 lock=3 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.802 INFO:teuthology.orchestra.run.smithi045.stdout: -412> 2023-10-03T19:20:29.207+0000 7f04f8d27640 10 mds.0.server early_reply 0 ((0) Success) client_request(client.6826:2 setattr mode=041777 #0x1 2023-10-03T19:20:29.210806+0000 caller_uid=0, caller_gid=0{0,}) v6 2023-10-03T19:21:28.802 INFO:teuthology.orchestra.run.smithi045.stdout: -411> 2023-10-03T19:20:29.207+0000 7f04f8d27640 20 mds.0.server set_trace_dist snapid head 2023-10-03T19:21:28.802 INFO:teuthology.orchestra.run.smithi045.stdout: -410> 2023-10-03T19:20:29.207+0000 7f04f8d27640 10 mds.0.server set_trace_dist snaprealm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:20:16.305990+0000 change_attr 0 0x55c504c6d8c0) len=70 2023-10-03T19:21:28.802 INFO:teuthology.orchestra.run.smithi045.stdout: -409> 2023-10-03T19:20:29.207+0000 7f04f8d27640 20 mds.0.cache.ino(0x1) pfile 0 pauth 1 plink 0 pxattr 0 plocal 1 mtime 2023-10-03T19:20:16.305990+0000 ctime 2023-10-03T19:20:29.210806+0000 change_attr 1 valid=1 2023-10-03T19:21:28.802 INFO:teuthology.orchestra.run.smithi045.stdout: -408> 2023-10-03T19:20:29.207+0000 7f04f8d27640 10 mds.0.cache.ino(0x1) encode_inodestat issuing pLsXsFs seq 2 2023-10-03T19:21:28.802 INFO:teuthology.orchestra.run.smithi045.stdout: -407> 2023-10-03T19:20:29.207+0000 7f04f8d27640 10 mds.0.cache.ino(0x1) encode_inodestat caps pLsXsFs seq 2 mseq 0 xattrv 0 2023-10-03T19:21:28.802 INFO:teuthology.orchestra.run.smithi045.stdout: -406> 2023-10-03T19:20:29.207+0000 7f04f8d27640 20 mds.0.server set_trace_dist added snap head in [inode 0x1 [...2,head] / auth v1 pv2 ap=2 snaprealm=0x55c504c6d8c0 f()->f() n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1)->n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iauth xlockdone x=1) (isnap sync r=1) (iversion lock w=1 last_client=6826) caps={6826=pLsXsFs/-@2} | request=1 lock=3 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.802 INFO:teuthology.orchestra.run.smithi045.stdout: -405> 2023-10-03T19:20:29.207+0000 7f04f8d27640 10 mds.0.54 send_message_client client.6826 172.21.15.146:0/2294298422 client_reply(???:2 = 0 (0) Success unsafe) v1 2023-10-03T19:21:28.803 INFO:teuthology.orchestra.run.smithi045.stdout: -404> 2023-10-03T19:20:29.207+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> 172.21.15.146:0/2294298422 -- client_reply(???:2 = 0 (0) Success unsafe) v1 -- 0x55c504b3b880 con 0x55c505887400 2023-10-03T19:21:28.803 INFO:teuthology.orchestra.run.smithi045.stdout: -403> 2023-10-03T19:20:29.207+0000 7f04f8d27640 20 mds.0.server lat 0.000576 2023-10-03T19:21:28.803 INFO:teuthology.orchestra.run.smithi045.stdout: -402> 2023-10-03T19:20:29.207+0000 7f04f251a640 5 mds.0.log _submit_thread 4195636~795 : EUpdate setattr [metablob] 2023-10-03T19:21:28.803 INFO:teuthology.orchestra.run.smithi045.stdout: -401> 2023-10-03T19:20:29.303+0000 7f04f1d19640 20 update_rank0: mds.metrics 2023-10-03T19:21:28.803 INFO:teuthology.orchestra.run.smithi045.stdout: -400> 2023-10-03T19:20:29.303+0000 7f04f1d19640 20 update_rank0: mds.metrics: sending metric updates for 1 clients to rank 0 (address: [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563]) with sequence number 2, last updated sequence number 4 2023-10-03T19:21:28.803 INFO:teuthology.orchestra.run.smithi045.stdout: -399> 2023-10-03T19:20:29.303+0000 7f04f1d19640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] send_to--> mds [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] -- mds_metrics from rank=0 carrying 1 metric updates v1 -- ?+0 0x55c505932000 2023-10-03T19:21:28.803 INFO:teuthology.orchestra.run.smithi045.stdout: -398> 2023-10-03T19:20:29.303+0000 7f04f1d19640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] -- mds_metrics from rank=0 carrying 1 metric updates v1 -- 0x55c505932000 con 0x55c504afbc00 2023-10-03T19:21:28.803 INFO:teuthology.orchestra.run.smithi045.stdout: -397> 2023-10-03T19:20:29.303+0000 7f04f8526640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mds.0 v2:172.21.15.45:6834/1723126563 0 ==== mds_metrics from rank=0 carrying 1 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x55c505932000 con 0x55c504afbc00 2023-10-03T19:21:28.803 INFO:teuthology.orchestra.run.smithi045.stdout: -396> 2023-10-03T19:20:29.303+0000 7f04f8526640 20 mds.metric.aggregator handle_mds_metrics: applying 1 updates for rank=0 with sequence number 2 2023-10-03T19:21:28.803 INFO:teuthology.orchestra.run.smithi045.stdout: -395> 2023-10-03T19:20:29.303+0000 7f04f8526640 10 mds.pinger pong_received: rank=0, sequence=2 2023-10-03T19:21:28.803 INFO:teuthology.orchestra.run.smithi045.stdout: -394> 2023-10-03T19:20:29.303+0000 7f04f8526640 20 mds.metric.aggregator refresh_metrics_for_rank: client=client.6826 172.21.15.146:0/2294298422, rank=0, metrics=[update_type=0, metrics={cap_hit_metric={hits=1, misses=0}, read_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, write_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, metadata_latency={latency=0.001466, avg_latency=0.001466, sq_sum=0, count=1}, dentry_lease={hits=0, misses=0}, opened_files_metric={opened_files=0, total_inodes=1}, pinned_icaps_metric={pinned_icaps=1, total_inodes=1}, opened_inodes_metric={opened_inodes=0, total_inodes=1}, read_io_sizes_metric={total_ops=0, total_size=0}, write_io_sizes_metric={total_ops=0, total_size=0}}] 2023-10-03T19:21:28.804 INFO:teuthology.orchestra.run.smithi045.stdout: -393> 2023-10-03T19:20:29.303+0000 7f04f8526640 20 mds.metric.aggregator refresh_metrics_for_rank: rank=0 has 1 connected client(s) 2023-10-03T19:21:28.804 INFO:teuthology.orchestra.run.smithi045.stdout: -392> 2023-10-03T19:20:29.315+0000 7f04f4d1f640 2 mds.0.cache Memory usage: total 274128, rss 37704, heap 207144, baseline 190760, 1 / 13 inodes have caps, 1 caps, 0.0769231 caps per inode 2023-10-03T19:21:28.804 INFO:teuthology.orchestra.run.smithi045.stdout: -391> 2023-10-03T19:20:29.315+0000 7f04f4d1f640 20 mds.0.cache upkeep thread trimming cache; last trim 0.995985746s ago 2023-10-03T19:21:28.804 INFO:teuthology.orchestra.run.smithi045.stdout: -390> 2023-10-03T19:20:29.315+0000 7f04f4d1f640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:28.804 INFO:teuthology.orchestra.run.smithi045.stdout: -389> 2023-10-03T19:20:29.315+0000 7f04f4d1f640 7 mds.0.cache trim bytes_used=51kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:28.804 INFO:teuthology.orchestra.run.smithi045.stdout: -388> 2023-10-03T19:20:29.315+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:28.804 INFO:teuthology.orchestra.run.smithi045.stdout: -387> 2023-10-03T19:20:29.315+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:28.804 INFO:teuthology.orchestra.run.smithi045.stdout: -386> 2023-10-03T19:20:29.315+0000 7f04f4d1f640 7 mds.0.server recall_client_state: min=100 max=1048576 total=1 flags=0xa 2023-10-03T19:21:28.804 INFO:teuthology.orchestra.run.smithi045.stdout: -385> 2023-10-03T19:20:29.315+0000 7f04f4d1f640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:28.804 INFO:teuthology.orchestra.run.smithi045.stdout: -384> 2023-10-03T19:20:29.315+0000 7f04f4d1f640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:28.804 INFO:teuthology.orchestra.run.smithi045.stdout: -383> 2023-10-03T19:20:29.451+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== client.6826 172.21.15.146:0/2294298422 7 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.002844, avg_latency: 0.001422, sq_sum: 3993766564, count=2][client_metric_type: CAP_INFO cap_hits: 4 cap_misses: 2 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55c505b8e420 con 0x55c505887400 2023-10-03T19:21:28.804 INFO:teuthology.orchestra.run.smithi045.stdout: -382> 2023-10-03T19:20:29.451+0000 7f04fb52c640 20 mds.0.54 get_session have 0x55c504b1ad00 client.6826 172.21.15.146:0/2294298422 state open 2023-10-03T19:21:28.805 INFO:teuthology.orchestra.run.smithi045.stdout: -381> 2023-10-03T19:20:29.451+0000 7f04fb52c640 20 handle_client_metrics: mds.metrics: session=0x55c504b1ad00 2023-10-03T19:21:28.805 INFO:teuthology.orchestra.run.smithi045.stdout: -380> 2023-10-03T19:20:29.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=READ_LATENCY, session=0x55c504b1ad00, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:28.805 INFO:teuthology.orchestra.run.smithi045.stdout: -379> 2023-10-03T19:20:29.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=WRITE_LATENCY, session=0x55c504b1ad00, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:28.805 INFO:teuthology.orchestra.run.smithi045.stdout: -378> 2023-10-03T19:20:29.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=METADATA_LATENCY, session=0x55c504b1ad00, latency=0.002844, avg=0.001422, sq_sum=3993766564, count=2 2023-10-03T19:21:28.805 INFO:teuthology.orchestra.run.smithi045.stdout: -377> 2023-10-03T19:20:29.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=CAP_INFO, session=0x55c504b1ad00, hits=4, misses=2 2023-10-03T19:21:28.805 INFO:teuthology.orchestra.run.smithi045.stdout: -376> 2023-10-03T19:20:29.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=DENTRY_LEASE, session=0x55c504b1ad00, hits=0, misses=0 2023-10-03T19:21:28.805 INFO:teuthology.orchestra.run.smithi045.stdout: -375> 2023-10-03T19:20:29.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=OPENED_FILES, session=0x55c504b1ad00, opened_files=0, total_inodes=1 2023-10-03T19:21:28.805 INFO:teuthology.orchestra.run.smithi045.stdout: -374> 2023-10-03T19:20:29.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=PINNED_ICAPS, session=0x55c504b1ad00, pinned_icaps=1, total_inodes=1 2023-10-03T19:21:28.805 INFO:teuthology.orchestra.run.smithi045.stdout: -373> 2023-10-03T19:20:29.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=OPENED_INODES, session=0x55c504b1ad00, opened_inodes=0, total_inodes=1 2023-10-03T19:21:28.805 INFO:teuthology.orchestra.run.smithi045.stdout: -372> 2023-10-03T19:20:29.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=READ_IO_SIZES, session=0x55c504b1ad00, total_ops=0, total_size=0 2023-10-03T19:21:28.805 INFO:teuthology.orchestra.run.smithi045.stdout: -371> 2023-10-03T19:20:29.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=WRITE_IO_SIZES, session=0x55c504b1ad00, total_ops=0, total_size=0 2023-10-03T19:21:28.806 INFO:teuthology.orchestra.run.smithi045.stdout: -370> 2023-10-03T19:20:29.927+0000 7f04f7d25640 10 monclient: tick 2023-10-03T19:21:28.806 INFO:teuthology.orchestra.run.smithi045.stdout: -369> 2023-10-03T19:20:29.927+0000 7f04f7d25640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.806 INFO:teuthology.orchestra.run.smithi045.stdout: -368> 2023-10-03T19:20:29.927+0000 7f04f7d25640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:19:59.930972+0000) 2023-10-03T19:21:28.806 INFO:teuthology.orchestra.run.smithi045.stdout: -367> 2023-10-03T19:20:30.243+0000 7f04fc52e640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> conn(0x55c505b32000 0x55c505b19700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).accept 2023-10-03T19:21:28.806 INFO:teuthology.orchestra.run.smithi045.stdout: -366> 2023-10-03T19:20:30.243+0000 7f04fc52e640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> conn(0x55c505b32000 0x55c505b19700 unknown :-1 s=BANNER_ACCEPTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:28.806 INFO:teuthology.orchestra.run.smithi045.stdout: -365> 2023-10-03T19:20:30.243+0000 7f04fc52e640 10 monclient: handle_auth_request added challenge on 0x55c505b32000 2023-10-03T19:21:28.806 INFO:teuthology.orchestra.run.smithi045.stdout: -364> 2023-10-03T19:20:30.243+0000 7f04fc52e640 10 mds.a parse_caps: parsing auth_cap_str='allow' 2023-10-03T19:21:28.806 INFO:teuthology.orchestra.run.smithi045.stdout: -363> 2023-10-03T19:20:30.247+0000 7f04f8d27640 10 mds.a new session 0x55c505abf200 for client.7803 172.21.15.172:0/707580424 con 0x55c505b32000 2023-10-03T19:21:28.806 INFO:teuthology.orchestra.run.smithi045.stdout: -362> 2023-10-03T19:20:30.247+0000 7f04f8d27640 10 mds.a parse_caps: parsing auth_cap_str='allow' 2023-10-03T19:21:28.806 INFO:teuthology.orchestra.run.smithi045.stdout: -361> 2023-10-03T19:20:30.247+0000 7f04f8d27640 10 mds.a ms_handle_accept 172.21.15.172:0/707580424 con 0x55c505b32000 session 0x55c505abf200 2023-10-03T19:21:28.806 INFO:teuthology.orchestra.run.smithi045.stdout: -360> 2023-10-03T19:20:30.247+0000 7f04fc52e640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> 172.21.15.172:0/707580424 conn(0x55c505b32000 0x55c505b19700 crc :-1 s=READY pgs=4 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=client.7803 client_cookie=5d4c91b226b1db66 server_cookie=bc0aa97e4fd38824 in_seq=0 out_seq=0 2023-10-03T19:21:28.807 INFO:teuthology.orchestra.run.smithi045.stdout: -359> 2023-10-03T19:20:30.247+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== client.7803 172.21.15.172:0/707580424 1 ==== client_session(request_open) v5 ==== 349+0+0 (crc 0 0 0) 0x55c504b3a8c0 con 0x55c505b32000 2023-10-03T19:21:28.807 INFO:teuthology.orchestra.run.smithi045.stdout: -358> 2023-10-03T19:20:30.247+0000 7f04f8d27640 20 mds.0.54 get_session have 0x55c505abf200 client.7803 172.21.15.172:0/707580424 state closed 2023-10-03T19:21:28.807 INFO:teuthology.orchestra.run.smithi045.stdout: -357> 2023-10-03T19:20:30.247+0000 7f04f8d27640 3 mds.0.server handle_client_session client_session(request_open) v5 from client.7803 2023-10-03T19:21:28.807 INFO:teuthology.orchestra.run.smithi045.stdout: -356> 2023-10-03T19:20:30.247+0000 7f04f8d27640 20 mds.0.server handle_client_session CEPH_SESSION_REQUEST_OPEN metadata entries: 2023-10-03T19:21:28.807 INFO:teuthology.orchestra.run.smithi045.stdout: -355> 2023-10-03T19:20:30.247+0000 7f04f8d27640 20 mds.0.server features: '0x00000000000fffff' 2023-10-03T19:21:28.807 INFO:teuthology.orchestra.run.smithi045.stdout: -354> 2023-10-03T19:20:30.247+0000 7f04f8d27640 20 mds.0.server metric specification: [{metric_flags: '0x000000000000ffff'}] 2023-10-03T19:21:28.807 INFO:teuthology.orchestra.run.smithi045.stdout: -353> 2023-10-03T19:20:30.247+0000 7f04f8d27640 20 mds.0.server ceph_sha1: 05a43c8fb3988914c879a50970f9054a098e0612 2023-10-03T19:21:28.807 INFO:teuthology.orchestra.run.smithi045.stdout: -352> 2023-10-03T19:20:30.247+0000 7f04f8d27640 20 mds.0.server ceph_version: ceph version 18.0.0-3908-g05a43c8f (05a43c8fb3988914c879a50970f9054a098e0612) reef (dev) 2023-10-03T19:21:28.807 INFO:teuthology.orchestra.run.smithi045.stdout: -351> 2023-10-03T19:20:30.247+0000 7f04f8d27640 20 mds.0.server entity_id: 1 2023-10-03T19:21:28.807 INFO:teuthology.orchestra.run.smithi045.stdout: -350> 2023-10-03T19:20:30.247+0000 7f04f8d27640 20 mds.0.server hostname: smithi172 2023-10-03T19:21:28.807 INFO:teuthology.orchestra.run.smithi045.stdout: -349> 2023-10-03T19:20:30.247+0000 7f04f8d27640 20 mds.0.server mount_point: /home/ubuntu/cephtest/mnt.1 2023-10-03T19:21:28.807 INFO:teuthology.orchestra.run.smithi045.stdout: -348> 2023-10-03T19:20:30.247+0000 7f04f8d27640 20 mds.0.server pid: 33514 2023-10-03T19:21:28.808 INFO:teuthology.orchestra.run.smithi045.stdout: -347> 2023-10-03T19:20:30.247+0000 7f04f8d27640 20 mds.0.server root: / 2023-10-03T19:21:28.808 INFO:teuthology.orchestra.run.smithi045.stdout: -346> 2023-10-03T19:20:30.247+0000 7f04f8d27640 10 mds.0.sessionmap add_session s=0x55c505abf200 name=client.7803 2023-10-03T19:21:28.808 INFO:teuthology.orchestra.run.smithi045.stdout: -345> 2023-10-03T19:20:30.247+0000 7f04f8d27640 20 mds.0.sessionmap mark_projected s=0x55c505abf200 name=client.7803 pv=1 -> 2 2023-10-03T19:21:28.808 INFO:teuthology.orchestra.run.smithi045.stdout: -344> 2023-10-03T19:20:30.247+0000 7f04f8d27640 10 mds.0.sessionmap touch_session s=0x55c505abf200 name=client.7803 2023-10-03T19:21:28.808 INFO:teuthology.orchestra.run.smithi045.stdout: -343> 2023-10-03T19:20:30.247+0000 7f04f251a640 5 mds.0.log _submit_thread 4196451~420 : ESession client.7803 172.21.15.172:0/707580424 open cmapv 2 2023-10-03T19:21:28.808 INFO:teuthology.orchestra.run.smithi045.stdout: -342> 2023-10-03T19:20:30.247+0000 7f04f251a640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.54:41 17.14 17:2e2fa760:::200.00000001:head [write 1332~1255 [fadvise_dontneed] in=1255b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e109) v8 -- 0x55c505b20a80 con 0x55c505a26c00 2023-10-03T19:21:28.808 INFO:teuthology.orchestra.run.smithi045.stdout: -341> 2023-10-03T19:20:30.247+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.3 v2:172.21.15.45:6816/4227059688 18 ==== osd_op_reply(41 200.00000001 [write 1332~1255 [fadvise_dontneed]] v109'8 uv8 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55c505af6fc0 con 0x55c505a26c00 2023-10-03T19:21:28.808 INFO:teuthology.orchestra.run.smithi045.stdout: -340> 2023-10-03T19:20:30.247+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 25C_MDS_inode_update_finish 2023-10-03T19:21:28.808 INFO:teuthology.orchestra.run.smithi045.stdout: -339> 2023-10-03T19:20:30.247+0000 7f04f2d1b640 10 MDSContext::complete: 25C_MDS_inode_update_finish 2023-10-03T19:21:28.808 INFO:teuthology.orchestra.run.smithi045.stdout: -338> 2023-10-03T19:20:30.247+0000 7f04f2d1b640 15 mds.0.cache.ino(0x1) pop_and_dirty_projected_inode v2 2023-10-03T19:21:28.808 INFO:teuthology.orchestra.run.smithi045.stdout: -337> 2023-10-03T19:20:30.247+0000 7f04f2d1b640 10 mds.0.cache.ino(0x1) mark_dirty [inode 0x1 [...2,head] / auth v2 ap=2 snaprealm=0x55c504c6d8c0 f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iauth xlockdone x=1) (isnap sync r=1) (iversion lock w=1 last_client=6826) caps={6826=pLsXsFs/-@2} | request=1 lock=3 dirfrag=1 caps=1 dirtyparent=0 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.808 INFO:teuthology.orchestra.run.smithi045.stdout: -336> 2023-10-03T19:20:30.247+0000 7f04f2d1b640 10 mds.0.cache.ino(0x1) mark_dirty_parent 2023-10-03T19:21:28.809 INFO:teuthology.orchestra.run.smithi045.stdout: -335> 2023-10-03T19:20:30.247+0000 7f04f2d1b640 7 mds.0.server reply_client_request 0 ((0) Success) client_request(client.6826:2 setattr mode=041777 #0x1 2023-10-03T19:20:29.210806+0000 caller_uid=0, caller_gid=0{0,}) v6 2023-10-03T19:21:28.809 INFO:teuthology.orchestra.run.smithi045.stdout: -334> 2023-10-03T19:20:30.247+0000 7f04f2d1b640 10 mds.0.server apply_allocated_inos 0x0 / [] / 0x0 2023-10-03T19:21:28.809 INFO:teuthology.orchestra.run.smithi045.stdout: -333> 2023-10-03T19:20:30.247+0000 7f04f2d1b640 7 mds.0.locker local_wrlock_finish on (iversion lock w=1 last_client=6826) on [inode 0x1 [...2,head] / auth v2 ap=2 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iauth xlockdone x=1) (isnap sync r=1) (iversion lock w=1 last_client=6826) caps={6826=pLsXsFs/-@2} | request=1 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.809 INFO:teuthology.orchestra.run.smithi045.stdout: -332> 2023-10-03T19:20:30.247+0000 7f04f2d1b640 10 mds.0.locker xlock_finish on (iauth xlockdone x=1) [inode 0x1 [...2,head] / auth v2 ap=2 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iauth xlockdone x=1) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2} | request=1 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.809 INFO:teuthology.orchestra.run.smithi045.stdout: -331> 2023-10-03T19:20:30.247+0000 7f04f2d1b640 10 mds.0.locker eval_gather (iauth xlockdone) on [inode 0x1 [...2,head] / auth v2 ap=2 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iauth xlockdone) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.809 INFO:teuthology.orchestra.run.smithi045.stdout: -330> 2023-10-03T19:20:30.247+0000 7f04f2d1b640 10 mds.0.locker next state is sync issued/allows loner /s xlocker /s other /s 2023-10-03T19:21:28.809 INFO:teuthology.orchestra.run.smithi045.stdout: -329> 2023-10-03T19:20:30.247+0000 7f04f2d1b640 7 mds.0.locker eval_gather finished gather on (iauth xlockdone) on [inode 0x1 [...2,head] / auth v2 ap=2 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iauth xlockdone) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.809 INFO:teuthology.orchestra.run.smithi045.stdout: -328> 2023-10-03T19:20:30.251+0000 7f04f2d1b640 10 mds.0.cache.ino(0x1) auth_unpin by 0x55c504b88910 on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55c504b88680] now 1 2023-10-03T19:21:28.809 INFO:teuthology.orchestra.run.smithi045.stdout: -327> 2023-10-03T19:20:30.251+0000 7f04f2d1b640 10 mds.0.locker simple_eval (iauth sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.809 INFO:teuthology.orchestra.run.smithi045.stdout: -326> 2023-10-03T19:20:30.251+0000 7f04f2d1b640 7 mds.0.locker get_allowed_caps allowed=pAsLsXsFscrl, xlocker allowed=pAsLsXsFscrl on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.809 INFO:teuthology.orchestra.run.smithi045.stdout: -325> 2023-10-03T19:20:30.251+0000 7f04f2d1b640 20 mds.0.locker client.6826 pending pLsXsFs allowed pAsLsXsFs wanted - 2023-10-03T19:21:28.810 INFO:teuthology.orchestra.run.smithi045.stdout: -324> 2023-10-03T19:20:30.251+0000 7f04f2d1b640 10 mds.0.54 send_message_client client.6826 172.21.15.146:0/2294298422 client_reply(???:2 = 0 (0) Success safe) v1 2023-10-03T19:21:28.810 INFO:teuthology.orchestra.run.smithi045.stdout: -323> 2023-10-03T19:20:30.251+0000 7f04f2d1b640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> 172.21.15.146:0/2294298422 -- client_reply(???:2 = 0 (0) Success safe) v1 -- 0x55c504b3aa80 con 0x55c505887400 2023-10-03T19:21:28.810 INFO:teuthology.orchestra.run.smithi045.stdout: -322> 2023-10-03T19:20:30.251+0000 7f04f2d1b640 7 mds.0.cache request_finish request(client.6826:2 nref=2 cr=0x55c505b2a000) 2023-10-03T19:21:28.810 INFO:teuthology.orchestra.run.smithi045.stdout: -321> 2023-10-03T19:20:30.251+0000 7f04f2d1b640 15 mds.0.cache request_cleanup request(client.6826:2 nref=2 cr=0x55c505b2a000) 2023-10-03T19:21:28.810 INFO:teuthology.orchestra.run.smithi045.stdout: -320> 2023-10-03T19:20:30.251+0000 7f04f2d1b640 7 mds.0.locker rdlock_finish on (isnap sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iversion lock) caps={6826=pLsXsFs/-@2} | request=1 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.810 INFO:teuthology.orchestra.run.smithi045.stdout: -319> 2023-10-03T19:20:30.251+0000 7f04f2d1b640 10 mds.0.locker simple_eval (isnap sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iversion lock) caps={6826=pLsXsFs/-@2} | request=1 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.810 INFO:teuthology.orchestra.run.smithi045.stdout: -318> 2023-10-03T19:20:30.251+0000 7f04f2d1b640 10 mds.0.cache.ino(0x1) auth_unpin by 0x55c505b23000 on [inode 0x1 [...2,head] / auth v2 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iversion lock) caps={6826=pLsXsFs/-@2} | request=1 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x55c504b88680] now 0 2023-10-03T19:21:28.810 INFO:teuthology.orchestra.run.smithi045.stdout: -317> 2023-10-03T19:20:30.251+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 20C_MDS_session_finish 2023-10-03T19:21:28.810 INFO:teuthology.orchestra.run.smithi045.stdout: -316> 2023-10-03T19:20:30.251+0000 7f04f2d1b640 10 MDSContext::complete: 20C_MDS_session_finish 2023-10-03T19:21:28.810 INFO:teuthology.orchestra.run.smithi045.stdout: -315> 2023-10-03T19:20:30.251+0000 7f04f2d1b640 10 mds.0.server _session_logged client.7803 172.21.15.172:0/707580424 state_seq 1 open 2 inos_to_free [] inotablev 0 inos_to_purge [] 2023-10-03T19:21:28.810 INFO:teuthology.orchestra.run.smithi045.stdout: -314> 2023-10-03T19:20:30.251+0000 7f04f2d1b640 20 mds.0.sessionmap mark_dirty s=0x55c505abf200 name=client.7803 v=1 2023-10-03T19:21:28.811 INFO:teuthology.orchestra.run.smithi045.stdout: -313> 2023-10-03T19:20:30.251+0000 7f04f2d1b640 10 mds.0.sessionmap touch_session s=0x55c505abf200 name=client.7803 2023-10-03T19:21:28.811 INFO:teuthology.orchestra.run.smithi045.stdout: -312> 2023-10-03T19:20:30.251+0000 7f04f2d1b640 10 add_session: mds.metrics: session=0x55c505abf200, client=client.7803 172.21.15.172:0/707580424 2023-10-03T19:21:28.811 INFO:teuthology.orchestra.run.smithi045.stdout: -311> 2023-10-03T19:20:30.251+0000 7f04f2d1b640 20 add_session: mds.metrics: metrics=[update_type=0, metrics={cap_hit_metric={hits=0, misses=0}, read_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, write_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, metadata_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, dentry_lease={hits=0, misses=0}, opened_files_metric={opened_files=0, total_inodes=0}, pinned_icaps_metric={pinned_icaps=0, total_inodes=0}, opened_inodes_metric={opened_inodes=0, total_inodes=0}, read_io_sizes_metric={total_ops=0, total_size=0}, write_io_sizes_metric={total_ops=0, total_size=0}}] 2023-10-03T19:21:28.811 INFO:teuthology.orchestra.run.smithi045.stdout: -310> 2023-10-03T19:20:30.251+0000 7f04f2d1b640 10 mds.0.54 send_message_client client.7803 172.21.15.172:0/707580424 client_session(open) v5 2023-10-03T19:21:28.811 INFO:teuthology.orchestra.run.smithi045.stdout: -309> 2023-10-03T19:20:30.251+0000 7f04f2d1b640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> 172.21.15.172:0/707580424 -- client_session(open) v5 -- 0x55c504b3a700 con 0x55c505b32000 2023-10-03T19:21:28.811 INFO:teuthology.orchestra.run.smithi045.stdout: -308> 2023-10-03T19:20:30.251+0000 7f04f2d1b640 2 mds.0.server New client session: addr="172.21.15.172:0/707580424",elapsed=0.004118,throttled=0.000016,status="ACCEPTED",root="/" 2023-10-03T19:21:28.811 INFO:teuthology.orchestra.run.smithi045.stdout: -307> 2023-10-03T19:20:30.251+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== client.7803 172.21.15.172:0/707580424 2 ==== client_session(request_renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x55c504b3a700 con 0x55c505b32000 2023-10-03T19:21:28.811 INFO:teuthology.orchestra.run.smithi045.stdout: -306> 2023-10-03T19:20:30.251+0000 7f04f8d27640 20 mds.0.54 get_session have 0x55c505abf200 client.7803 172.21.15.172:0/707580424 state open 2023-10-03T19:21:28.811 INFO:teuthology.orchestra.run.smithi045.stdout: -305> 2023-10-03T19:20:30.251+0000 7f04f8d27640 3 mds.0.server handle_client_session client_session(request_renewcaps seq 1) v1 from client.7803 2023-10-03T19:21:28.811 INFO:teuthology.orchestra.run.smithi045.stdout: -304> 2023-10-03T19:20:30.251+0000 7f04f8d27640 10 mds.0.sessionmap touch_session s=0x55c505abf200 name=client.7803 2023-10-03T19:21:28.811 INFO:teuthology.orchestra.run.smithi045.stdout: -303> 2023-10-03T19:20:30.251+0000 7f04f8d27640 10 mds.0.54 send_message_client client.7803 172.21.15.172:0/707580424 client_session(renewcaps seq 1) v5 2023-10-03T19:21:28.811 INFO:teuthology.orchestra.run.smithi045.stdout: -302> 2023-10-03T19:20:30.251+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> 172.21.15.172:0/707580424 -- client_session(renewcaps seq 1) v5 -- 0x55c504b3bc00 con 0x55c505b32000 2023-10-03T19:21:28.812 INFO:teuthology.orchestra.run.smithi045.stdout: -301> 2023-10-03T19:20:30.251+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== client.7803 172.21.15.172:0/707580424 3 ==== client_request(client.7803:1 getattr pAsLsXsFs #0x1 2023-10-03T19:20:30.252496+0000 caller_uid=0, caller_gid=0{}) v6 ==== 156+0+0 (crc 0 0 0) 0x55c505b2a600 con 0x55c505b32000 2023-10-03T19:21:28.812 INFO:teuthology.orchestra.run.smithi045.stdout: -300> 2023-10-03T19:20:30.251+0000 7f04f8d27640 4 mds.0.server handle_client_request client_request(client.7803:1 getattr pAsLsXsFs #0x1 2023-10-03T19:20:30.252496+0000 caller_uid=0, caller_gid=0{}) v6 2023-10-03T19:21:28.812 INFO:teuthology.orchestra.run.smithi045.stdout: -299> 2023-10-03T19:20:30.251+0000 7f04f8d27640 20 mds.0.54 get_session have 0x55c505abf200 client.7803 172.21.15.172:0/707580424 state open 2023-10-03T19:21:28.812 INFO:teuthology.orchestra.run.smithi045.stdout: -298> 2023-10-03T19:20:30.251+0000 7f04f8d27640 15 mds.0.server oldest_client_tid=1 2023-10-03T19:21:28.812 INFO:teuthology.orchestra.run.smithi045.stdout: -297> 2023-10-03T19:20:30.251+0000 7f04f8d27640 7 mds.0.cache request_start request(client.7803:1 nref=2 cr=0x55c505b2a600) 2023-10-03T19:21:28.812 INFO:teuthology.orchestra.run.smithi045.stdout: -296> 2023-10-03T19:20:30.251+0000 7f04f8d27640 7 mds.0.server dispatch_client_request client_request(client.7803:1 getattr pAsLsXsFs #0x1 2023-10-03T19:20:30.252496+0000 caller_uid=0, caller_gid=0{}) v6 2023-10-03T19:21:28.812 INFO:teuthology.orchestra.run.smithi045.stdout: -295> 2023-10-03T19:20:30.251+0000 7f04f8d27640 7 mds.0.cache traverse: opening base ino 0x1 snap head 2023-10-03T19:21:28.812 INFO:teuthology.orchestra.run.smithi045.stdout: -294> 2023-10-03T19:20:30.251+0000 7f04f8d27640 10 mds.0.cache path_traverse finish on snapid head 2023-10-03T19:21:28.812 INFO:teuthology.orchestra.run.smithi045.stdout: -293> 2023-10-03T19:20:30.251+0000 7f04f8d27640 10 mds.0.server rdlock_path_pin_ref request(client.7803:1 nref=3 cr=0x55c505b2a600) #0x1 2023-10-03T19:21:28.812 INFO:teuthology.orchestra.run.smithi045.stdout: -292> 2023-10-03T19:20:30.251+0000 7f04f8d27640 7 mds.0.cache traverse: opening base ino 0x1 snap head 2023-10-03T19:21:28.812 INFO:teuthology.orchestra.run.smithi045.stdout: -291> 2023-10-03T19:20:30.251+0000 7f04f8d27640 10 mds.0.locker try_rdlock_snap_layout request(client.7803:1 nref=4 cr=0x55c505b2a600) [inode 0x1 [...2,head] / auth v2 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iversion lock) caps={6826=pLsXsFs/-@2} | request=1 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x55c504b88680] 2023-10-03T19:21:28.812 INFO:teuthology.orchestra.run.smithi045.stdout: -290> 2023-10-03T19:20:30.251+0000 7f04f8d27640 20 mds.0.locker got rdlock on (isnap sync r=1) [inode 0x1 [...2,head] / auth v2 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x55c504b88680] 2023-10-03T19:21:28.813 INFO:teuthology.orchestra.run.smithi045.stdout: -289> 2023-10-03T19:20:30.251+0000 7f04f8d27640 10 mds.0.cache path_traverse finish on snapid head 2023-10-03T19:21:28.813 INFO:teuthology.orchestra.run.smithi045.stdout: -288> 2023-10-03T19:20:30.251+0000 7f04f8d27640 10 mds.0.server ref is [inode 0x1 [...2,head] / auth v2 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x55c504b88680] 2023-10-03T19:21:28.813 INFO:teuthology.orchestra.run.smithi045.stdout: -287> 2023-10-03T19:20:30.251+0000 7f04f8d27640 10 mds.0.locker acquire_locks request(client.7803:1 nref=3 cr=0x55c505b2a600) 2023-10-03T19:21:28.813 INFO:teuthology.orchestra.run.smithi045.stdout: -286> 2023-10-03T19:20:30.251+0000 7f04f8d27640 20 mds.0.locker must rdlock (ilink sync) [inode 0x1 [...2,head] / auth v2 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x55c504b88680] 2023-10-03T19:21:28.813 INFO:teuthology.orchestra.run.smithi045.stdout: -285> 2023-10-03T19:20:30.251+0000 7f04f8d27640 20 mds.0.locker must rdlock (iauth sync) [inode 0x1 [...2,head] / auth v2 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x55c504b88680] 2023-10-03T19:21:28.813 INFO:teuthology.orchestra.run.smithi045.stdout: -284> 2023-10-03T19:20:30.251+0000 7f04f8d27640 20 mds.0.locker must rdlock (ixattr sync) [inode 0x1 [...2,head] / auth v2 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x55c504b88680] 2023-10-03T19:21:28.813 INFO:teuthology.orchestra.run.smithi045.stdout: -283> 2023-10-03T19:20:30.251+0000 7f04f8d27640 20 mds.0.locker must rdlock (ifile sync) [inode 0x1 [...2,head] / auth v2 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x55c504b88680] 2023-10-03T19:21:28.813 INFO:teuthology.orchestra.run.smithi045.stdout: -282> 2023-10-03T19:20:30.251+0000 7f04f8d27640 10 mds.0.locker must authpin [inode 0x1 [...2,head] / auth v2 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x55c504b88680] 2023-10-03T19:21:28.813 INFO:teuthology.orchestra.run.smithi045.stdout: -281> 2023-10-03T19:20:30.251+0000 7f04f8d27640 10 mds.0.locker auth_pinning [inode 0x1 [...2,head] / auth v2 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x55c504b88680] 2023-10-03T19:21:28.813 INFO:teuthology.orchestra.run.smithi045.stdout: -280> 2023-10-03T19:20:30.251+0000 7f04f8d27640 10 mds.0.cache.ino(0x1) auth_pin by 0x55c505b23400 on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55c504b88680] now 1 2023-10-03T19:21:28.813 INFO:teuthology.orchestra.run.smithi045.stdout: -279> 2023-10-03T19:20:30.251+0000 7f04f8d27640 7 mds.0.locker rdlock_start on (ifile sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.814 INFO:teuthology.orchestra.run.smithi045.stdout: -278> 2023-10-03T19:20:30.251+0000 7f04f8d27640 10 mds.0.locker got rdlock on (ifile sync r=1) [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (ifile sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2} | request=1 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.814 INFO:teuthology.orchestra.run.smithi045.stdout: -277> 2023-10-03T19:20:30.251+0000 7f04f8d27640 7 mds.0.locker rdlock_start on (iauth sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (ifile sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2} | request=1 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.814 INFO:teuthology.orchestra.run.smithi045.stdout: -276> 2023-10-03T19:20:30.251+0000 7f04f8d27640 10 mds.0.locker got rdlock on (iauth sync r=1) [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iauth sync r=1) (isnap sync r=1) (ifile sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2} | request=1 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.814 INFO:teuthology.orchestra.run.smithi045.stdout: -275> 2023-10-03T19:20:30.251+0000 7f04f8d27640 7 mds.0.locker rdlock_start on (ilink sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iauth sync r=1) (isnap sync r=1) (ifile sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2} | request=1 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.814 INFO:teuthology.orchestra.run.smithi045.stdout: -274> 2023-10-03T19:20:30.251+0000 7f04f8d27640 10 mds.0.locker got rdlock on (ilink sync r=1) [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iauth sync r=1) (ilink sync r=1) (isnap sync r=1) (ifile sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2} | request=1 lock=4 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.814 INFO:teuthology.orchestra.run.smithi045.stdout: -273> 2023-10-03T19:20:30.251+0000 7f04f8d27640 7 mds.0.locker rdlock_start on (ixattr sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iauth sync r=1) (ilink sync r=1) (isnap sync r=1) (ifile sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2} | request=1 lock=4 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.814 INFO:teuthology.orchestra.run.smithi045.stdout: -272> 2023-10-03T19:20:30.251+0000 7f04f8d27640 10 mds.0.locker got rdlock on (ixattr sync r=1) [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iauth sync r=1) (ilink sync r=1) (isnap sync r=1) (ifile sync r=1) (ixattr sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2} | request=1 lock=5 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.814 INFO:teuthology.orchestra.run.smithi045.stdout: -271> 2023-10-03T19:20:30.251+0000 7f04f8d27640 20 Session check_access path 2023-10-03T19:21:28.814 INFO:teuthology.orchestra.run.smithi045.stdout: -270> 2023-10-03T19:20:30.251+0000 7f04f8d27640 10 mds.0.server reply to stat on client_request(client.7803:1 getattr pAsLsXsFs #0x1 2023-10-03T19:20:30.252496+0000 caller_uid=0, caller_gid=0{}) v6 2023-10-03T19:21:28.814 INFO:teuthology.orchestra.run.smithi045.stdout: -269> 2023-10-03T19:20:30.251+0000 7f04f8d27640 20 mds.0.server respond_to_request batch head request(client.7803:1 nref=3 cr=0x55c505b2a600) 2023-10-03T19:21:28.814 INFO:teuthology.orchestra.run.smithi045.stdout: -268> 2023-10-03T19:20:30.251+0000 7f04f8d27640 20 respond: responding to batch ops with result=0: [batch front=request(client.7803:1 nref=3 cr=0x55c505b2a600)] 2023-10-03T19:21:28.815 INFO:teuthology.orchestra.run.smithi045.stdout: -267> 2023-10-03T19:20:30.251+0000 7f04f8d27640 7 mds.0.server reply_client_request 0 ((0) Success) client_request(client.7803:1 getattr pAsLsXsFs #0x1 2023-10-03T19:20:30.252496+0000 caller_uid=0, caller_gid=0{}) v6 2023-10-03T19:21:28.815 INFO:teuthology.orchestra.run.smithi045.stdout: -266> 2023-10-03T19:20:30.251+0000 7f04f8d27640 10 mds.0.server apply_allocated_inos 0x0 / [] / 0x0 2023-10-03T19:21:28.815 INFO:teuthology.orchestra.run.smithi045.stdout: -265> 2023-10-03T19:20:30.251+0000 7f04f8d27640 20 mds.0.server lat 0.000376 2023-10-03T19:21:28.815 INFO:teuthology.orchestra.run.smithi045.stdout: -264> 2023-10-03T19:20:30.251+0000 7f04f8d27640 20 mds.0.server set_trace_dist snapid head 2023-10-03T19:21:28.815 INFO:teuthology.orchestra.run.smithi045.stdout: -263> 2023-10-03T19:20:30.251+0000 7f04f8d27640 10 mds.0.server set_trace_dist snaprealm snaprealm(0x1 seq 1 lc 0 cr 0 cps 1 snaps={} last_modified 2023-10-03T19:20:16.305990+0000 change_attr 0 0x55c504c6d8c0) len=70 2023-10-03T19:21:28.815 INFO:teuthology.orchestra.run.smithi045.stdout: -262> 2023-10-03T19:20:30.251+0000 7f04f8d27640 20 mds.0.cache.ino(0x1) pfile 0 pauth 0 plink 0 pxattr 0 plocal 0 mtime 2023-10-03T19:20:16.305990+0000 ctime 2023-10-03T19:20:29.210806+0000 change_attr 1 valid=1 2023-10-03T19:21:28.815 INFO:teuthology.orchestra.run.smithi045.stdout: -261> 2023-10-03T19:20:30.251+0000 7f04f8d27640 10 mds.0.cache.ino(0x1) encode_inodestat issuing pAsLsXsFs seq 1 2023-10-03T19:21:28.815 INFO:teuthology.orchestra.run.smithi045.stdout: -260> 2023-10-03T19:20:30.251+0000 7f04f8d27640 10 mds.0.cache.ino(0x1) encode_inodestat caps pAsLsXsFs seq 1 mseq 0 xattrv 1 2023-10-03T19:21:28.815 INFO:teuthology.orchestra.run.smithi045.stdout: -259> 2023-10-03T19:20:30.251+0000 7f04f8d27640 10 mds.0.cache.ino(0x1) including xattrs version 1 2023-10-03T19:21:28.815 INFO:teuthology.orchestra.run.smithi045.stdout: -258> 2023-10-03T19:20:30.251+0000 7f04f8d27640 20 mds.0.server set_trace_dist added snap head in [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iauth sync r=1) (ilink sync r=1) (isnap sync r=1) (ifile sync r=1) (ixattr sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2,7803=pAsLsXsFs/-@1} | request=1 lock=5 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.815 INFO:teuthology.orchestra.run.smithi045.stdout: -257> 2023-10-03T19:20:30.251+0000 7f04f8d27640 10 mds.0.54 send_message_client client.7803 172.21.15.172:0/707580424 client_reply(???:1 = 0 (0) Success) v1 2023-10-03T19:21:28.815 INFO:teuthology.orchestra.run.smithi045.stdout: -256> 2023-10-03T19:20:30.251+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> 172.21.15.172:0/707580424 -- client_reply(???:1 = 0 (0) Success) v1 -- 0x55c504b3a700 con 0x55c505b32000 2023-10-03T19:21:28.816 INFO:teuthology.orchestra.run.smithi045.stdout: -255> 2023-10-03T19:20:30.251+0000 7f04f8d27640 7 mds.0.cache request_finish request(client.7803:1 nref=3 cr=0x55c505b2a600) 2023-10-03T19:21:28.816 INFO:teuthology.orchestra.run.smithi045.stdout: -254> 2023-10-03T19:20:30.251+0000 7f04f8d27640 15 mds.0.cache request_cleanup request(client.7803:1 nref=3 cr=0x55c505b2a600) 2023-10-03T19:21:28.816 INFO:teuthology.orchestra.run.smithi045.stdout: -253> 2023-10-03T19:20:30.251+0000 7f04f8d27640 7 mds.0.locker rdlock_finish on (iauth sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (ilink sync r=1) (isnap sync r=1) (ifile sync r=1) (ixattr sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2,7803=pAsLsXsFs/-@1} | request=1 lock=4 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.816 INFO:teuthology.orchestra.run.smithi045.stdout: -252> 2023-10-03T19:20:30.251+0000 7f04f8d27640 10 mds.0.locker simple_eval (iauth sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (ilink sync r=1) (isnap sync r=1) (ifile sync r=1) (ixattr sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2,7803=pAsLsXsFs/-@1} | request=1 lock=4 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.816 INFO:teuthology.orchestra.run.smithi045.stdout: -251> 2023-10-03T19:20:30.251+0000 7f04f8d27640 7 mds.0.locker rdlock_finish on (ilink sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (ifile sync r=1) (ixattr sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2,7803=pAsLsXsFs/-@1} | request=1 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.816 INFO:teuthology.orchestra.run.smithi045.stdout: -250> 2023-10-03T19:20:30.251+0000 7f04f8d27640 10 mds.0.locker simple_eval (ilink sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (ifile sync r=1) (ixattr sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2,7803=pAsLsXsFs/-@1} | request=1 lock=3 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.816 INFO:teuthology.orchestra.run.smithi045.stdout: -249> 2023-10-03T19:20:30.251+0000 7f04f8d27640 7 mds.0.locker rdlock_finish on (ifile sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (ixattr sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2,7803=pAsLsXsFs/-@1} | request=1 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.837 INFO:teuthology.orchestra.run.smithi045.stdout: -248> 2023-10-03T19:20:30.251+0000 7f04f8d27640 7 mds.0.locker file_eval wanted= loner_wanted= other_wanted= filelock=(ifile sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (ixattr sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2,7803=pAsLsXsFs/-@1} | request=1 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.837 INFO:teuthology.orchestra.run.smithi045.stdout: -247> 2023-10-03T19:20:30.251+0000 7f04f8d27640 7 mds.0.locker rdlock_finish on (ixattr sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2,7803=pAsLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.837 INFO:teuthology.orchestra.run.smithi045.stdout: -246> 2023-10-03T19:20:30.251+0000 7f04f8d27640 10 mds.0.locker simple_eval (ixattr sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (isnap sync r=1) (iversion lock) caps={6826=pLsXsFs/-@2,7803=pAsLsXsFs/-@1} | request=1 lock=1 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.837 INFO:teuthology.orchestra.run.smithi045.stdout: -245> 2023-10-03T19:20:30.251+0000 7f04f8d27640 7 mds.0.locker rdlock_finish on (isnap sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iversion lock) caps={6826=pLsXsFs/-@2,7803=pAsLsXsFs/-@1} | request=1 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.837 INFO:teuthology.orchestra.run.smithi045.stdout: -244> 2023-10-03T19:20:30.251+0000 7f04f8d27640 10 mds.0.locker simple_eval (isnap sync) on [inode 0x1 [...2,head] / auth v2 ap=1 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iversion lock) caps={6826=pLsXsFs/-@2,7803=pAsLsXsFs/-@1} | request=1 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=1 0x55c504b88680] 2023-10-03T19:21:28.838 INFO:teuthology.orchestra.run.smithi045.stdout: -243> 2023-10-03T19:20:30.251+0000 7f04f8d27640 10 mds.0.cache.ino(0x1) auth_unpin by 0x55c505b23400 on [inode 0x1 [...2,head] / auth v2 snaprealm=0x55c504c6d8c0 DIRTYPARENT f() n(v0 rc2023-10-03T19:20:29.210806+0000 1=0+1)/n(v0 rc2023-10-03T19:20:16.305990+0000 1=0+1) (iversion lock) caps={6826=pLsXsFs/-@2,7803=pAsLsXsFs/-@1} | request=1 lock=0 dirfrag=1 caps=1 dirtyparent=1 dirty=1 authpin=0 0x55c504b88680] now 0 2023-10-03T19:21:28.838 INFO:teuthology.orchestra.run.smithi045.stdout: -242> 2023-10-03T19:20:30.303+0000 7f04f7524640 20 mds.0.54 get_task_status 2023-10-03T19:21:28.838 INFO:teuthology.orchestra.run.smithi045.stdout: -241> 2023-10-03T19:20:30.303+0000 7f04f7524640 20 mds.0.54 schedule_update_timer_task 2023-10-03T19:21:28.838 INFO:teuthology.orchestra.run.smithi045.stdout: -240> 2023-10-03T19:20:30.315+0000 7f04f4d1f640 2 mds.0.cache Memory usage: total 274128, rss 37704, heap 207144, baseline 190760, 1 / 13 inodes have caps, 2 caps, 0.153846 caps per inode 2023-10-03T19:21:28.838 INFO:teuthology.orchestra.run.smithi045.stdout: -239> 2023-10-03T19:20:30.315+0000 7f04f4d1f640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999985754s ago 2023-10-03T19:21:28.838 INFO:teuthology.orchestra.run.smithi045.stdout: -238> 2023-10-03T19:20:30.315+0000 7f04f4d1f640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:28.838 INFO:teuthology.orchestra.run.smithi045.stdout: -237> 2023-10-03T19:20:30.315+0000 7f04f4d1f640 7 mds.0.cache trim bytes_used=51kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:28.838 INFO:teuthology.orchestra.run.smithi045.stdout: -236> 2023-10-03T19:20:30.315+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:28.838 INFO:teuthology.orchestra.run.smithi045.stdout: -235> 2023-10-03T19:20:30.315+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:28.838 INFO:teuthology.orchestra.run.smithi045.stdout: -234> 2023-10-03T19:20:30.315+0000 7f04f4d1f640 7 mds.0.server recall_client_state: min=100 max=1048576 total=2 flags=0xa 2023-10-03T19:21:28.838 INFO:teuthology.orchestra.run.smithi045.stdout: -233> 2023-10-03T19:20:30.315+0000 7f04f4d1f640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:28.838 INFO:teuthology.orchestra.run.smithi045.stdout: -232> 2023-10-03T19:20:30.315+0000 7f04f4d1f640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:28.839 INFO:teuthology.orchestra.run.smithi045.stdout: -231> 2023-10-03T19:20:30.451+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== client.6826 172.21.15.146:0/2294298422 8 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.002844, avg_latency: 0.001422, sq_sum: 3993766564, count=2][client_metric_type: CAP_INFO cap_hits: 4 cap_misses: 2 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55c505b8e420 con 0x55c505887400 2023-10-03T19:21:28.839 INFO:teuthology.orchestra.run.smithi045.stdout: -230> 2023-10-03T19:20:30.451+0000 7f04fb52c640 20 mds.0.54 get_session have 0x55c504b1ad00 client.6826 172.21.15.146:0/2294298422 state open 2023-10-03T19:21:28.839 INFO:teuthology.orchestra.run.smithi045.stdout: -229> 2023-10-03T19:20:30.451+0000 7f04fb52c640 20 handle_client_metrics: mds.metrics: session=0x55c504b1ad00 2023-10-03T19:21:28.839 INFO:teuthology.orchestra.run.smithi045.stdout: -228> 2023-10-03T19:20:30.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=READ_LATENCY, session=0x55c504b1ad00, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:28.839 INFO:teuthology.orchestra.run.smithi045.stdout: -227> 2023-10-03T19:20:30.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=WRITE_LATENCY, session=0x55c504b1ad00, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:28.839 INFO:teuthology.orchestra.run.smithi045.stdout: -226> 2023-10-03T19:20:30.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=METADATA_LATENCY, session=0x55c504b1ad00, latency=0.002844, avg=0.001422, sq_sum=3993766564, count=2 2023-10-03T19:21:28.839 INFO:teuthology.orchestra.run.smithi045.stdout: -225> 2023-10-03T19:20:30.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=CAP_INFO, session=0x55c504b1ad00, hits=4, misses=2 2023-10-03T19:21:28.839 INFO:teuthology.orchestra.run.smithi045.stdout: -224> 2023-10-03T19:20:30.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=DENTRY_LEASE, session=0x55c504b1ad00, hits=0, misses=0 2023-10-03T19:21:28.839 INFO:teuthology.orchestra.run.smithi045.stdout: -223> 2023-10-03T19:20:30.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=OPENED_FILES, session=0x55c504b1ad00, opened_files=0, total_inodes=1 2023-10-03T19:21:28.839 INFO:teuthology.orchestra.run.smithi045.stdout: -222> 2023-10-03T19:20:30.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=PINNED_ICAPS, session=0x55c504b1ad00, pinned_icaps=1, total_inodes=1 2023-10-03T19:21:28.839 INFO:teuthology.orchestra.run.smithi045.stdout: -221> 2023-10-03T19:20:30.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=OPENED_INODES, session=0x55c504b1ad00, opened_inodes=0, total_inodes=1 2023-10-03T19:21:28.840 INFO:teuthology.orchestra.run.smithi045.stdout: -220> 2023-10-03T19:20:30.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=READ_IO_SIZES, session=0x55c504b1ad00, total_ops=0, total_size=0 2023-10-03T19:21:28.840 INFO:teuthology.orchestra.run.smithi045.stdout: -219> 2023-10-03T19:20:30.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=WRITE_IO_SIZES, session=0x55c504b1ad00, total_ops=0, total_size=0 2023-10-03T19:21:28.840 INFO:teuthology.orchestra.run.smithi045.stdout: -218> 2023-10-03T19:20:30.927+0000 7f04f7524640 10 mds.0.log trim 1 / 128 segments, 4 / -1 events, 0 (0) expiring, 0 (0) expired 2023-10-03T19:21:28.840 INFO:teuthology.orchestra.run.smithi045.stdout: -217> 2023-10-03T19:20:30.927+0000 7f04f7524640 10 mds.0.log _trim_expired_segments waiting for 1/4194304 to expire 2023-10-03T19:21:28.840 INFO:teuthology.orchestra.run.smithi045.stdout: -216> 2023-10-03T19:20:30.927+0000 7f04f7524640 10 mds.0.server find_idle_sessions. last cleared laggy state 1277.32s ago 2023-10-03T19:21:28.840 INFO:teuthology.orchestra.run.smithi045.stdout: -215> 2023-10-03T19:20:30.927+0000 7f04f7524640 20 mds.0.server laggiest active session is client.6826 172.21.15.146:0/2294298422 and renewed caps recently (2.47596s ago) 2023-10-03T19:21:28.840 INFO:teuthology.orchestra.run.smithi045.stdout: -214> 2023-10-03T19:20:30.927+0000 7f04f7524640 10 mds.0.locker scatter_tick 2023-10-03T19:21:28.840 INFO:teuthology.orchestra.run.smithi045.stdout: -213> 2023-10-03T19:20:30.927+0000 7f04f7524640 20 mds.0.locker caps_tick 0 revoking caps 2023-10-03T19:21:28.840 INFO:teuthology.orchestra.run.smithi045.stdout: -212> 2023-10-03T19:20:30.927+0000 7f04f7524640 20 mds.0.bal handle_export_pins export_pin_queue size=0 2023-10-03T19:21:28.840 INFO:teuthology.orchestra.run.smithi045.stdout: -211> 2023-10-03T19:20:30.927+0000 7f04f7524640 15 mds.0.bal tick tick last_sample now 1277.317430s 2023-10-03T19:21:28.840 INFO:teuthology.orchestra.run.smithi045.stdout: -210> 2023-10-03T19:20:30.927+0000 7f04f7524640 15 mds.0.cache show_subtrees 2023-10-03T19:21:28.841 INFO:teuthology.orchestra.run.smithi045.stdout: -209> 2023-10-03T19:20:30.927+0000 7f04f7524640 10 mds.0.cache |__ 0 auth [dir 0x1 / [2,head] auth v=1 cv=1/1 REP dir_auth=0 state=1073741825|complete f() n() hs=0+0,ss=0+0 | subtree=1 dirty=0 authpin=0 0x55c504b68d00] 2023-10-03T19:21:28.841 INFO:teuthology.orchestra.run.smithi045.stdout: -208> 2023-10-03T19:20:30.927+0000 7f04f7524640 10 mds.0.cache |__ 0 auth [dir 0x100 ~mds0/ [2,head] auth v=1 cv=1/1 dir_auth=0 state=1073741825|complete f(v0 10=0+10) n(v0 rc2023-10-03T19:20:16.307241+0000 10=0+10) hs=10+0,ss=0+0 | child=1 subtree=1 dirty=0 authpin=0 0x55c504b69180] 2023-10-03T19:21:28.841 INFO:teuthology.orchestra.run.smithi045.stdout: -207> 2023-10-03T19:20:30.927+0000 7f04f7524640 10 mds.0.cache find_stale_fragment_freeze 2023-10-03T19:21:28.841 INFO:teuthology.orchestra.run.smithi045.stdout: -206> 2023-10-03T19:20:30.927+0000 7f04f7524640 10 mds.0.snap check_osd_map - version unchanged 2023-10-03T19:21:28.841 INFO:teuthology.orchestra.run.smithi045.stdout: -205> 2023-10-03T19:20:30.927+0000 7f04f7524640 20 mds.0.54 updating export targets, currently 0 ranks are targets 2023-10-03T19:21:28.841 INFO:teuthology.orchestra.run.smithi045.stdout: -204> 2023-10-03T19:20:30.927+0000 7f04f7d25640 10 monclient: tick 2023-10-03T19:21:28.841 INFO:teuthology.orchestra.run.smithi045.stdout: -203> 2023-10-03T19:20:30.927+0000 7f04f7d25640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.841 INFO:teuthology.orchestra.run.smithi045.stdout: -202> 2023-10-03T19:20:30.927+0000 7f04f7d25640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:20:00.931069+0000) 2023-10-03T19:21:28.841 INFO:teuthology.orchestra.run.smithi045.stdout: -201> 2023-10-03T19:20:31.243+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== client.7803 172.21.15.172:0/707580424 5 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000723, avg_latency: 0.000723, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55c505b8b760 con 0x55c505b32000 2023-10-03T19:21:28.841 INFO:teuthology.orchestra.run.smithi045.stdout: -200> 2023-10-03T19:20:31.243+0000 7f04fc52e640 20 mds.0.54 get_session have 0x55c505abf200 client.7803 172.21.15.172:0/707580424 state open 2023-10-03T19:21:28.841 INFO:teuthology.orchestra.run.smithi045.stdout: -199> 2023-10-03T19:20:31.243+0000 7f04fc52e640 20 handle_client_metrics: mds.metrics: session=0x55c505abf200 2023-10-03T19:21:28.842 INFO:teuthology.orchestra.run.smithi045.stdout: -198> 2023-10-03T19:20:31.243+0000 7f04fc52e640 20 handle_payload: mds.metrics: type=READ_LATENCY, session=0x55c505abf200, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:28.842 INFO:teuthology.orchestra.run.smithi045.stdout: -197> 2023-10-03T19:20:31.243+0000 7f04fc52e640 20 handle_payload: mds.metrics: type=WRITE_LATENCY, session=0x55c505abf200, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:28.842 INFO:teuthology.orchestra.run.smithi045.stdout: -196> 2023-10-03T19:20:31.243+0000 7f04fc52e640 20 handle_payload: mds.metrics: type=METADATA_LATENCY, session=0x55c505abf200, latency=0.000723, avg=0.000723, sq_sum=0, count=1 2023-10-03T19:21:28.842 INFO:teuthology.orchestra.run.smithi045.stdout: -195> 2023-10-03T19:20:31.243+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== client.7803 172.21.15.172:0/707580424 4 ==== client_session(request_renewcaps seq 2) v1 ==== 28+0+0 (crc 0 0 0) 0x55c504b3bc00 con 0x55c505b32000 2023-10-03T19:21:28.842 INFO:teuthology.orchestra.run.smithi045.stdout: -194> 2023-10-03T19:20:31.243+0000 7f04fc52e640 20 handle_payload: mds.metrics: type=CAP_INFO, session=0x55c505abf200, hits=1, misses=0 2023-10-03T19:21:28.842 INFO:teuthology.orchestra.run.smithi045.stdout: -193> 2023-10-03T19:20:31.243+0000 7f04fc52e640 20 handle_payload: mds.metrics: type=DENTRY_LEASE, session=0x55c505abf200, hits=0, misses=0 2023-10-03T19:21:28.842 INFO:teuthology.orchestra.run.smithi045.stdout: -192> 2023-10-03T19:20:31.243+0000 7f04fc52e640 20 handle_payload: mds.metrics: type=OPENED_FILES, session=0x55c505abf200, opened_files=0, total_inodes=1 2023-10-03T19:21:28.842 INFO:teuthology.orchestra.run.smithi045.stdout: -191> 2023-10-03T19:20:31.243+0000 7f04fc52e640 20 handle_payload: mds.metrics: type=PINNED_ICAPS, session=0x55c505abf200, pinned_icaps=1, total_inodes=1 2023-10-03T19:21:28.842 INFO:teuthology.orchestra.run.smithi045.stdout: -190> 2023-10-03T19:20:31.243+0000 7f04fc52e640 20 handle_payload: mds.metrics: type=OPENED_INODES, session=0x55c505abf200, opened_inodes=0, total_inodes=1 2023-10-03T19:21:28.842 INFO:teuthology.orchestra.run.smithi045.stdout: -189> 2023-10-03T19:20:31.243+0000 7f04f8d27640 20 mds.0.54 get_session have 0x55c505abf200 client.7803 172.21.15.172:0/707580424 state open 2023-10-03T19:21:28.842 INFO:teuthology.orchestra.run.smithi045.stdout: -188> 2023-10-03T19:20:31.243+0000 7f04fc52e640 20 handle_payload: mds.metrics: type=READ_IO_SIZES, session=0x55c505abf200, total_ops=0, total_size=0 2023-10-03T19:21:28.843 INFO:teuthology.orchestra.run.smithi045.stdout: -187> 2023-10-03T19:20:31.243+0000 7f04f8d27640 3 mds.0.server handle_client_session client_session(request_renewcaps seq 2) v1 from client.7803 2023-10-03T19:21:28.843 INFO:teuthology.orchestra.run.smithi045.stdout: -186> 2023-10-03T19:20:31.243+0000 7f04fc52e640 20 handle_payload: mds.metrics: type=WRITE_IO_SIZES, session=0x55c505abf200, total_ops=0, total_size=0 2023-10-03T19:21:28.843 INFO:teuthology.orchestra.run.smithi045.stdout: -185> 2023-10-03T19:20:31.243+0000 7f04f8d27640 10 mds.0.sessionmap touch_session s=0x55c505abf200 name=client.7803 2023-10-03T19:21:28.843 INFO:teuthology.orchestra.run.smithi045.stdout: -184> 2023-10-03T19:20:31.243+0000 7f04f8d27640 10 mds.0.54 send_message_client client.7803 172.21.15.172:0/707580424 client_session(renewcaps seq 2) v5 2023-10-03T19:21:28.843 INFO:teuthology.orchestra.run.smithi045.stdout: -183> 2023-10-03T19:20:31.243+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> 172.21.15.172:0/707580424 -- client_session(renewcaps seq 2) v5 -- 0x55c504b3a700 con 0x55c505b32000 2023-10-03T19:21:28.843 INFO:teuthology.orchestra.run.smithi045.stdout: -182> 2023-10-03T19:20:31.307+0000 7f04f1d19640 20 update_rank0: mds.metrics 2023-10-03T19:21:28.843 INFO:teuthology.orchestra.run.smithi045.stdout: -181> 2023-10-03T19:20:31.307+0000 7f04f1d19640 20 update_rank0: mds.metrics: sending metric updates for 2 clients to rank 0 (address: [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563]) with sequence number 2, last updated sequence number 5 2023-10-03T19:21:28.843 INFO:teuthology.orchestra.run.smithi045.stdout: -180> 2023-10-03T19:20:31.307+0000 7f04f1d19640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] send_to--> mds [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] -- mds_metrics from rank=0 carrying 2 metric updates v1 -- ?+0 0x55c505933980 2023-10-03T19:21:28.843 INFO:teuthology.orchestra.run.smithi045.stdout: -179> 2023-10-03T19:20:31.307+0000 7f04f1d19640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] -- mds_metrics from rank=0 carrying 2 metric updates v1 -- 0x55c505933980 con 0x55c504afbc00 2023-10-03T19:21:28.843 INFO:teuthology.orchestra.run.smithi045.stdout: -178> 2023-10-03T19:20:31.307+0000 7f04f8526640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mds.0 v2:172.21.15.45:6834/1723126563 0 ==== mds_metrics from rank=0 carrying 2 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x55c505933980 con 0x55c504afbc00 2023-10-03T19:21:28.843 INFO:teuthology.orchestra.run.smithi045.stdout: -177> 2023-10-03T19:20:31.307+0000 7f04f8526640 20 mds.metric.aggregator handle_mds_metrics: applying 2 updates for rank=0 with sequence number 2 2023-10-03T19:21:28.844 INFO:teuthology.orchestra.run.smithi045.stdout: -176> 2023-10-03T19:20:31.307+0000 7f04f8526640 10 mds.pinger pong_received: rank=0, sequence=2 2023-10-03T19:21:28.844 INFO:teuthology.orchestra.run.smithi045.stdout: -175> 2023-10-03T19:20:31.307+0000 7f04f8526640 20 mds.metric.aggregator refresh_metrics_for_rank: client=client.6826 172.21.15.146:0/2294298422, rank=0, metrics=[update_type=0, metrics={cap_hit_metric={hits=4, misses=2}, read_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, write_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, metadata_latency={latency=0.002844, avg_latency=0.001422, sq_sum=3993766564, count=2}, dentry_lease={hits=0, misses=0}, opened_files_metric={opened_files=0, total_inodes=1}, pinned_icaps_metric={pinned_icaps=1, total_inodes=1}, opened_inodes_metric={opened_inodes=0, total_inodes=1}, read_io_sizes_metric={total_ops=0, total_size=0}, write_io_sizes_metric={total_ops=0, total_size=0}}] 2023-10-03T19:21:28.844 INFO:teuthology.orchestra.run.smithi045.stdout: -174> 2023-10-03T19:20:31.307+0000 7f04f8526640 20 mds.metric.aggregator refresh_metrics_for_rank: client=client.7803 172.21.15.172:0/707580424, rank=0, metrics=[update_type=0, metrics={cap_hit_metric={hits=1, misses=0}, read_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, write_latency={latency=0.000000, avg_latency=0.000000, sq_sum=0, count=0}, metadata_latency={latency=0.000723, avg_latency=0.000723, sq_sum=0, count=1}, dentry_lease={hits=0, misses=0}, opened_files_metric={opened_files=0, total_inodes=1}, pinned_icaps_metric={pinned_icaps=1, total_inodes=1}, opened_inodes_metric={opened_inodes=0, total_inodes=1}, read_io_sizes_metric={total_ops=0, total_size=0}, write_io_sizes_metric={total_ops=0, total_size=0}}] 2023-10-03T19:21:28.844 INFO:teuthology.orchestra.run.smithi045.stdout: -173> 2023-10-03T19:20:31.307+0000 7f04f8526640 20 mds.metric.aggregator refresh_metrics_for_rank: rank=0 has 2 connected client(s) 2023-10-03T19:21:28.844 INFO:teuthology.orchestra.run.smithi045.stdout: -172> 2023-10-03T19:20:31.315+0000 7f04f4d1f640 2 mds.0.cache Memory usage: total 274128, rss 37968, heap 207144, baseline 190760, 1 / 13 inodes have caps, 2 caps, 0.153846 caps per inode 2023-10-03T19:21:28.844 INFO:teuthology.orchestra.run.smithi045.stdout: -171> 2023-10-03T19:20:31.315+0000 7f04f4d1f640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999985754s ago 2023-10-03T19:21:28.844 INFO:teuthology.orchestra.run.smithi045.stdout: -170> 2023-10-03T19:20:31.315+0000 7f04f4d1f640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:28.844 INFO:teuthology.orchestra.run.smithi045.stdout: -169> 2023-10-03T19:20:31.315+0000 7f04f4d1f640 7 mds.0.cache trim bytes_used=51kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:28.844 INFO:teuthology.orchestra.run.smithi045.stdout: -168> 2023-10-03T19:20:31.315+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:28.844 INFO:teuthology.orchestra.run.smithi045.stdout: -167> 2023-10-03T19:20:31.315+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:28.844 INFO:teuthology.orchestra.run.smithi045.stdout: -166> 2023-10-03T19:20:31.315+0000 7f04f4d1f640 7 mds.0.server recall_client_state: min=100 max=1048576 total=2 flags=0xa 2023-10-03T19:21:28.845 INFO:teuthology.orchestra.run.smithi045.stdout: -165> 2023-10-03T19:20:31.315+0000 7f04f4d1f640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:28.845 INFO:teuthology.orchestra.run.smithi045.stdout: -164> 2023-10-03T19:20:31.315+0000 7f04f4d1f640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:28.845 INFO:teuthology.orchestra.run.smithi045.stdout: -163> 2023-10-03T19:20:31.455+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== client.6826 172.21.15.146:0/2294298422 9 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.002844, avg_latency: 0.001422, sq_sum: 3993766564, count=2][client_metric_type: CAP_INFO cap_hits: 4 cap_misses: 2 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55c505b8e420 con 0x55c505887400 2023-10-03T19:21:28.845 INFO:teuthology.orchestra.run.smithi045.stdout: -162> 2023-10-03T19:20:31.455+0000 7f04fb52c640 20 mds.0.54 get_session have 0x55c504b1ad00 client.6826 172.21.15.146:0/2294298422 state open 2023-10-03T19:21:28.845 INFO:teuthology.orchestra.run.smithi045.stdout: -161> 2023-10-03T19:20:31.455+0000 7f04fb52c640 20 handle_client_metrics: mds.metrics: session=0x55c504b1ad00 2023-10-03T19:21:28.845 INFO:teuthology.orchestra.run.smithi045.stdout: -160> 2023-10-03T19:20:31.455+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=READ_LATENCY, session=0x55c504b1ad00, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:28.845 INFO:teuthology.orchestra.run.smithi045.stdout: -159> 2023-10-03T19:20:31.455+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=WRITE_LATENCY, session=0x55c504b1ad00, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:28.845 INFO:teuthology.orchestra.run.smithi045.stdout: -158> 2023-10-03T19:20:31.455+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=METADATA_LATENCY, session=0x55c504b1ad00, latency=0.002844, avg=0.001422, sq_sum=3993766564, count=2 2023-10-03T19:21:28.845 INFO:teuthology.orchestra.run.smithi045.stdout: -157> 2023-10-03T19:20:31.455+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=CAP_INFO, session=0x55c504b1ad00, hits=4, misses=2 2023-10-03T19:21:28.845 INFO:teuthology.orchestra.run.smithi045.stdout: -156> 2023-10-03T19:20:31.455+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=DENTRY_LEASE, session=0x55c504b1ad00, hits=0, misses=0 2023-10-03T19:21:28.845 INFO:teuthology.orchestra.run.smithi045.stdout: -155> 2023-10-03T19:20:31.455+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=OPENED_FILES, session=0x55c504b1ad00, opened_files=0, total_inodes=1 2023-10-03T19:21:28.846 INFO:teuthology.orchestra.run.smithi045.stdout: -154> 2023-10-03T19:20:31.455+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=PINNED_ICAPS, session=0x55c504b1ad00, pinned_icaps=1, total_inodes=1 2023-10-03T19:21:28.846 INFO:teuthology.orchestra.run.smithi045.stdout: -153> 2023-10-03T19:20:31.455+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=OPENED_INODES, session=0x55c504b1ad00, opened_inodes=0, total_inodes=1 2023-10-03T19:21:28.846 INFO:teuthology.orchestra.run.smithi045.stdout: -152> 2023-10-03T19:20:31.455+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=READ_IO_SIZES, session=0x55c504b1ad00, total_ops=0, total_size=0 2023-10-03T19:21:28.846 INFO:teuthology.orchestra.run.smithi045.stdout: -151> 2023-10-03T19:20:31.455+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=WRITE_IO_SIZES, session=0x55c504b1ad00, total_ops=0, total_size=0 2023-10-03T19:21:28.846 INFO:teuthology.orchestra.run.smithi045.stdout: -150> 2023-10-03T19:20:31.895+0000 7f04f6522640 10 mds.pinger is_rank_lagging: rank=0 2023-10-03T19:21:28.846 INFO:teuthology.orchestra.run.smithi045.stdout: -149> 2023-10-03T19:20:31.895+0000 7f04f6522640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgrreport(unknown.a +0-0 packed 1558) v9 -- 0x55c504b51880 con 0x55c505a26000 2023-10-03T19:21:28.846 INFO:teuthology.orchestra.run.smithi045.stdout: -148> 2023-10-03T19:20:31.927+0000 7f04f7d25640 10 monclient: tick 2023-10-03T19:21:28.846 INFO:teuthology.orchestra.run.smithi045.stdout: -147> 2023-10-03T19:20:31.927+0000 7f04f7d25640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.846 INFO:teuthology.orchestra.run.smithi045.stdout: -146> 2023-10-03T19:20:31.927+0000 7f04f7d25640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:20:01.931222+0000) 2023-10-03T19:21:28.846 INFO:teuthology.orchestra.run.smithi045.stdout: -145> 2023-10-03T19:20:32.243+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== client.7803 172.21.15.172:0/707580424 6 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000723, avg_latency: 0.000723, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 4 cap_misses: 2 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55c505b8b760 con 0x55c505b32000 2023-10-03T19:21:28.846 INFO:teuthology.orchestra.run.smithi045.stdout: -144> 2023-10-03T19:20:32.243+0000 7f04fc52e640 20 mds.0.54 get_session have 0x55c505abf200 client.7803 172.21.15.172:0/707580424 state open 2023-10-03T19:21:28.847 INFO:teuthology.orchestra.run.smithi045.stdout: -143> 2023-10-03T19:20:32.243+0000 7f04fc52e640 20 handle_client_metrics: mds.metrics: session=0x55c505abf200 2023-10-03T19:21:28.847 INFO:teuthology.orchestra.run.smithi045.stdout: -142> 2023-10-03T19:20:32.243+0000 7f04fc52e640 20 handle_payload: mds.metrics: type=READ_LATENCY, session=0x55c505abf200, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:28.847 INFO:teuthology.orchestra.run.smithi045.stdout: -141> 2023-10-03T19:20:32.243+0000 7f04fc52e640 20 handle_payload: mds.metrics: type=WRITE_LATENCY, session=0x55c505abf200, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:28.847 INFO:teuthology.orchestra.run.smithi045.stdout: -140> 2023-10-03T19:20:32.243+0000 7f04fc52e640 20 handle_payload: mds.metrics: type=METADATA_LATENCY, session=0x55c505abf200, latency=0.000723, avg=0.000723, sq_sum=0, count=1 2023-10-03T19:21:28.847 INFO:teuthology.orchestra.run.smithi045.stdout: -139> 2023-10-03T19:20:32.243+0000 7f04fc52e640 20 handle_payload: mds.metrics: type=CAP_INFO, session=0x55c505abf200, hits=4, misses=2 2023-10-03T19:21:28.847 INFO:teuthology.orchestra.run.smithi045.stdout: -138> 2023-10-03T19:20:32.243+0000 7f04fc52e640 20 handle_payload: mds.metrics: type=DENTRY_LEASE, session=0x55c505abf200, hits=0, misses=0 2023-10-03T19:21:28.847 INFO:teuthology.orchestra.run.smithi045.stdout: -137> 2023-10-03T19:20:32.243+0000 7f04fc52e640 20 handle_payload: mds.metrics: type=OPENED_FILES, session=0x55c505abf200, opened_files=0, total_inodes=1 2023-10-03T19:21:28.847 INFO:teuthology.orchestra.run.smithi045.stdout: -136> 2023-10-03T19:20:32.243+0000 7f04fc52e640 20 handle_payload: mds.metrics: type=PINNED_ICAPS, session=0x55c505abf200, pinned_icaps=1, total_inodes=1 2023-10-03T19:21:28.847 INFO:teuthology.orchestra.run.smithi045.stdout: -135> 2023-10-03T19:20:32.243+0000 7f04fc52e640 20 handle_payload: mds.metrics: type=OPENED_INODES, session=0x55c505abf200, opened_inodes=0, total_inodes=1 2023-10-03T19:21:28.847 INFO:teuthology.orchestra.run.smithi045.stdout: -134> 2023-10-03T19:20:32.243+0000 7f04fc52e640 20 handle_payload: mds.metrics: type=READ_IO_SIZES, session=0x55c505abf200, total_ops=0, total_size=0 2023-10-03T19:21:28.847 INFO:teuthology.orchestra.run.smithi045.stdout: -133> 2023-10-03T19:20:32.243+0000 7f04fc52e640 20 handle_payload: mds.metrics: type=WRITE_IO_SIZES, session=0x55c505abf200, total_ops=0, total_size=0 2023-10-03T19:21:28.848 INFO:teuthology.orchestra.run.smithi045.stdout: -132> 2023-10-03T19:20:32.303+0000 7f04f7524640 20 mds.0.54 get_task_status 2023-10-03T19:21:28.848 INFO:teuthology.orchestra.run.smithi045.stdout: -131> 2023-10-03T19:20:32.303+0000 7f04f7524640 20 mds.0.54 schedule_update_timer_task 2023-10-03T19:21:28.848 INFO:teuthology.orchestra.run.smithi045.stdout: -130> 2023-10-03T19:20:32.303+0000 7f04f1518640 10 mds.metric.aggregator ping_all_active_ranks: pinging 1 active mds(s) 2023-10-03T19:21:28.848 INFO:teuthology.orchestra.run.smithi045.stdout: -129> 2023-10-03T19:20:32.303+0000 7f04f1518640 20 mds.metric.aggregator ping_all_active_ranks: pinging rank=0 addr=[v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] 2023-10-03T19:21:28.848 INFO:teuthology.orchestra.run.smithi045.stdout: -128> 2023-10-03T19:20:32.303+0000 7f04f1518640 10 mds.pinger send_ping: rank=0 2023-10-03T19:21:28.848 INFO:teuthology.orchestra.run.smithi045.stdout: -127> 2023-10-03T19:20:32.303+0000 7f04f1518640 10 mds.pinger send_ping: sending ping with sequence=3 to rank=0 2023-10-03T19:21:28.848 INFO:teuthology.orchestra.run.smithi045.stdout: -126> 2023-10-03T19:20:32.303+0000 7f04f1518640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] send_to--> mds [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] -- mdsping v1 -- ?+0 0x55c504bcc500 2023-10-03T19:21:28.916 INFO:teuthology.orchestra.run.smithi045.stdout: -125> 2023-10-03T19:20:32.303+0000 7f04f1518640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] -- mdsping v1 -- 0x55c504bcc500 con 0x55c504afbc00 2023-10-03T19:21:28.917 INFO:teuthology.orchestra.run.smithi045.stdout: -124> 2023-10-03T19:20:32.303+0000 7f04f8526640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mds.0 v2:172.21.15.45:6834/1723126563 0 ==== mdsping v1 ==== 0+0+0 (unknown 0 0 0) 0x55c504bcc500 con 0x55c504afbc00 2023-10-03T19:21:28.917 INFO:teuthology.orchestra.run.smithi045.stdout: -123> 2023-10-03T19:20:32.303+0000 7f04f8526640 20 set_next_seq: mds.metrics: current sequence number 2, setting next sequence number 3 2023-10-03T19:21:28.917 INFO:teuthology.orchestra.run.smithi045.stdout: -122> 2023-10-03T19:20:32.315+0000 7f04f4d1f640 2 mds.0.cache Memory usage: total 274128, rss 37968, heap 207144, baseline 190760, 1 / 13 inodes have caps, 2 caps, 0.153846 caps per inode 2023-10-03T19:21:28.917 INFO:teuthology.orchestra.run.smithi045.stdout: -121> 2023-10-03T19:20:32.315+0000 7f04f4d1f640 20 mds.0.cache upkeep thread trimming cache; last trim 0.999985754s ago 2023-10-03T19:21:28.917 INFO:teuthology.orchestra.run.smithi045.stdout: -120> 2023-10-03T19:20:32.315+0000 7f04f4d1f640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:28.917 INFO:teuthology.orchestra.run.smithi045.stdout: -119> 2023-10-03T19:20:32.315+0000 7f04f4d1f640 7 mds.0.cache trim bytes_used=51kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:28.917 INFO:teuthology.orchestra.run.smithi045.stdout: -118> 2023-10-03T19:20:32.315+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:28.917 INFO:teuthology.orchestra.run.smithi045.stdout: -117> 2023-10-03T19:20:32.315+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:28.917 INFO:teuthology.orchestra.run.smithi045.stdout: -116> 2023-10-03T19:20:32.315+0000 7f04f4d1f640 7 mds.0.server recall_client_state: min=100 max=1048576 total=2 flags=0xa 2023-10-03T19:21:28.917 INFO:teuthology.orchestra.run.smithi045.stdout: -115> 2023-10-03T19:20:32.315+0000 7f04f4d1f640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:28.918 INFO:teuthology.orchestra.run.smithi045.stdout: -114> 2023-10-03T19:20:32.315+0000 7f04f4d1f640 20 mds.0.cache upkeep thread waiting interval 1.000000000s 2023-10-03T19:21:28.918 INFO:teuthology.orchestra.run.smithi045.stdout: -113> 2023-10-03T19:20:32.375+0000 7f04f6d23640 5 mds.beacon.a Sending beacon up:active seq 7 2023-10-03T19:21:28.918 INFO:teuthology.orchestra.run.smithi045.stdout: -112> 2023-10-03T19:20:32.375+0000 7f04f6d23640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.918 INFO:teuthology.orchestra.run.smithi045.stdout: -111> 2023-10-03T19:20:32.375+0000 7f04f6d23640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mdsbeacon(7602/a up:active seq=7 v58) v8 -- 0x55c505bbc580 con 0x55c504afb400 2023-10-03T19:21:28.918 INFO:teuthology.orchestra.run.smithi045.stdout: -110> 2023-10-03T19:20:32.375+0000 7f04f6d23640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:28.918 INFO:teuthology.orchestra.run.smithi045.stdout: -109> 2023-10-03T19:20:32.375+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 57 ==== mdsbeacon(7602/a up:active seq=7 v58) v8 ==== 130+0+0 (secure 0 0 0) 0x55c504bc7600 con 0x55c504afb400 2023-10-03T19:21:28.918 INFO:teuthology.orchestra.run.smithi045.stdout: -108> 2023-10-03T19:20:32.375+0000 7f04fb52c640 5 mds.beacon.a received beacon reply up:active seq 7 rtt 0 2023-10-03T19:21:28.918 INFO:teuthology.orchestra.run.smithi045.stdout: -107> 2023-10-03T19:20:32.375+0000 7f04f6d23640 20 mds.beacon.a sender thread waiting interval 4s 2023-10-03T19:21:28.918 INFO:teuthology.orchestra.run.smithi045.stdout: -106> 2023-10-03T19:20:32.451+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== client.6826 172.21.15.146:0/2294298422 10 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.002844, avg_latency: 0.001422, sq_sum: 3993766564, count=2][client_metric_type: CAP_INFO cap_hits: 4 cap_misses: 2 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55c505b8e420 con 0x55c505887400 2023-10-03T19:21:28.918 INFO:teuthology.orchestra.run.smithi045.stdout: -105> 2023-10-03T19:20:32.451+0000 7f04fb52c640 20 mds.0.54 get_session have 0x55c504b1ad00 client.6826 172.21.15.146:0/2294298422 state open 2023-10-03T19:21:28.918 INFO:teuthology.orchestra.run.smithi045.stdout: -104> 2023-10-03T19:20:32.451+0000 7f04fb52c640 20 handle_client_metrics: mds.metrics: session=0x55c504b1ad00 2023-10-03T19:21:28.919 INFO:teuthology.orchestra.run.smithi045.stdout: -103> 2023-10-03T19:20:32.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=READ_LATENCY, session=0x55c504b1ad00, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:28.919 INFO:teuthology.orchestra.run.smithi045.stdout: -102> 2023-10-03T19:20:32.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=WRITE_LATENCY, session=0x55c504b1ad00, latency=0.000000, avg=0.000000, sq_sum=0, count=0 2023-10-03T19:21:28.919 INFO:teuthology.orchestra.run.smithi045.stdout: -101> 2023-10-03T19:20:32.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=METADATA_LATENCY, session=0x55c504b1ad00, latency=0.002844, avg=0.001422, sq_sum=3993766564, count=2 2023-10-03T19:21:28.919 INFO:teuthology.orchestra.run.smithi045.stdout: -100> 2023-10-03T19:20:32.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=CAP_INFO, session=0x55c504b1ad00, hits=4, misses=2 2023-10-03T19:21:28.919 INFO:teuthology.orchestra.run.smithi045.stdout: -99> 2023-10-03T19:20:32.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=DENTRY_LEASE, session=0x55c504b1ad00, hits=0, misses=0 2023-10-03T19:21:28.919 INFO:teuthology.orchestra.run.smithi045.stdout: -98> 2023-10-03T19:20:32.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=OPENED_FILES, session=0x55c504b1ad00, opened_files=0, total_inodes=1 2023-10-03T19:21:28.919 INFO:teuthology.orchestra.run.smithi045.stdout: -97> 2023-10-03T19:20:32.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=PINNED_ICAPS, session=0x55c504b1ad00, pinned_icaps=1, total_inodes=1 2023-10-03T19:21:28.919 INFO:teuthology.orchestra.run.smithi045.stdout: -96> 2023-10-03T19:20:32.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=OPENED_INODES, session=0x55c504b1ad00, opened_inodes=0, total_inodes=1 2023-10-03T19:21:28.919 INFO:teuthology.orchestra.run.smithi045.stdout: -95> 2023-10-03T19:20:32.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=READ_IO_SIZES, session=0x55c504b1ad00, total_ops=0, total_size=0 2023-10-03T19:21:28.919 INFO:teuthology.orchestra.run.smithi045.stdout: -94> 2023-10-03T19:20:32.451+0000 7f04fb52c640 20 handle_payload: mds.metrics: type=WRITE_IO_SIZES, session=0x55c504b1ad00, total_ops=0, total_size=0 2023-10-03T19:21:28.919 INFO:teuthology.orchestra.run.smithi045.stdout: -93> 2023-10-03T19:20:32.463+0000 7f04fad2b640 1 do_command 'config set' '{format=json,prefix=config set,val=[1/10],var=debug_mds}' 2023-10-03T19:21:28.920 INFO:teuthology.orchestra.run.smithi045.stdout: -92> 2023-10-03T19:20:32.463+0000 7f04fad2b640 1 do_command 'config set' '{format=json,prefix=config set,val=[1/10],var=debug_mds}' result is 0 bytes 2023-10-03T19:21:28.920 INFO:teuthology.orchestra.run.smithi045.stdout: -91> 2023-10-03T19:20:32.923+0000 7f04fad2b640 1 do_command 'config set' '{format=json,prefix=config set,val=[1],var=mds_extraordinary_events_dump_interval}' 2023-10-03T19:21:28.920 INFO:teuthology.orchestra.run.smithi045.stdout: -90> 2023-10-03T19:20:32.923+0000 7f04fad2b640 0 mds.0.54 handle_conf_change Enabling in-memory log dump... 2023-10-03T19:21:28.920 INFO:teuthology.orchestra.run.smithi045.stdout: -89> 2023-10-03T19:20:32.923+0000 7f04fad2b640 1 do_command 'config set' '{format=json,prefix=config set,val=[1],var=mds_extraordinary_events_dump_interval}' result is 0 bytes 2023-10-03T19:21:28.920 INFO:teuthology.orchestra.run.smithi045.stdout: -88> 2023-10-03T19:20:32.923+0000 7f04f2d1b640 10 mds.0.54 flushing conf change to components: mds_extraordinary_events_dump_interval 2023-10-03T19:21:28.920 INFO:teuthology.orchestra.run.smithi045.stdout: -87> 2023-10-03T19:20:32.927+0000 7f04f7d25640 10 monclient: tick 2023-10-03T19:21:28.920 INFO:teuthology.orchestra.run.smithi045.stdout: -86> 2023-10-03T19:20:32.927+0000 7f04f7d25640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.920 INFO:teuthology.orchestra.run.smithi045.stdout: -85> 2023-10-03T19:20:32.927+0000 7f04f7d25640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:20:02.931336+0000) 2023-10-03T19:21:28.920 INFO:teuthology.orchestra.run.smithi045.stdout: -84> 2023-10-03T19:20:33.243+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== client.7803 172.21.15.172:0/707580424 7 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000723, avg_latency: 0.000723, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 4 cap_misses: 2 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55c505b8b760 con 0x55c505b32000 2023-10-03T19:21:28.920 INFO:teuthology.orchestra.run.smithi045.stdout: -83> 2023-10-03T19:20:33.307+0000 7f04f1d19640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] send_to--> mds [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] -- mds_metrics from rank=0 carrying 2 metric updates v1 -- ?+0 0x55c505b38180 2023-10-03T19:21:28.920 INFO:teuthology.orchestra.run.smithi045.stdout: -82> 2023-10-03T19:20:33.307+0000 7f04f1d19640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] -- mds_metrics from rank=0 carrying 2 metric updates v1 -- 0x55c505b38180 con 0x55c504afbc00 2023-10-03T19:21:28.920 INFO:teuthology.orchestra.run.smithi045.stdout: -81> 2023-10-03T19:20:33.307+0000 7f04f8526640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mds.0 v2:172.21.15.45:6834/1723126563 0 ==== mds_metrics from rank=0 carrying 2 metric updates v1 ==== 0+0+0 (unknown 0 0 0) 0x55c505b38180 con 0x55c504afbc00 2023-10-03T19:21:28.921 INFO:teuthology.orchestra.run.smithi045.stdout: -80> 2023-10-03T19:20:33.307+0000 7f04f8526640 10 mds.pinger pong_received: rank=0, sequence=3 2023-10-03T19:21:28.921 INFO:teuthology.orchestra.run.smithi045.stdout: -79> 2023-10-03T19:20:33.315+0000 7f04f4d1f640 2 mds.0.cache Memory usage: total 274128, rss 37968, heap 207144, baseline 190760, 1 / 13 inodes have caps, 2 caps, 0.153846 caps per inode 2023-10-03T19:21:28.921 INFO:teuthology.orchestra.run.smithi045.stdout: -78> 2023-10-03T19:20:33.315+0000 7f04f4d1f640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:28.921 INFO:teuthology.orchestra.run.smithi045.stdout: -77> 2023-10-03T19:20:33.315+0000 7f04f4d1f640 7 mds.0.cache trim bytes_used=51kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:28.921 INFO:teuthology.orchestra.run.smithi045.stdout: -76> 2023-10-03T19:20:33.315+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:28.921 INFO:teuthology.orchestra.run.smithi045.stdout: -75> 2023-10-03T19:20:33.315+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:28.921 INFO:teuthology.orchestra.run.smithi045.stdout: -74> 2023-10-03T19:20:33.315+0000 7f04f4d1f640 7 mds.0.server recall_client_state: min=100 max=1048576 total=2 flags=0xa 2023-10-03T19:21:28.921 INFO:teuthology.orchestra.run.smithi045.stdout: -73> 2023-10-03T19:20:33.315+0000 7f04f4d1f640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:28.921 INFO:teuthology.orchestra.run.smithi045.stdout: -72> 2023-10-03T19:20:33.451+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== client.6826 172.21.15.146:0/2294298422 11 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.002844, avg_latency: 0.001422, sq_sum: 3993766564, count=2][client_metric_type: CAP_INFO cap_hits: 4 cap_misses: 2 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55c505b8e420 con 0x55c505887400 2023-10-03T19:21:28.921 INFO:teuthology.orchestra.run.smithi045.stdout: -71> 2023-10-03T19:20:33.927+0000 7f04f7d25640 10 monclient: tick 2023-10-03T19:21:28.921 INFO:teuthology.orchestra.run.smithi045.stdout: -70> 2023-10-03T19:20:33.927+0000 7f04f7d25640 10 monclient: _check_auth_tickets 2023-10-03T19:21:28.922 INFO:teuthology.orchestra.run.smithi045.stdout: -69> 2023-10-03T19:20:33.927+0000 7f04f7d25640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2023-10-03T19:20:03.931420+0000) 2023-10-03T19:21:28.922 INFO:teuthology.orchestra.run.smithi045.stdout: -68> 2023-10-03T19:20:34.235+0000 7f04fad2b640 1 mds.a asok_command: session evict {filters=[6826],format=json,prefix=session evict} (starting...) 2023-10-03T19:21:28.922 INFO:teuthology.orchestra.run.smithi045.stdout: -67> 2023-10-03T19:20:34.235+0000 7f04fad2b640 1 mds.0.54 Evicting (and blocklisting) client session 6826 (172.21.15.146:0/2294298422) 2023-10-03T19:21:28.922 INFO:teuthology.orchestra.run.smithi045.stdout: -66> 2023-10-03T19:20:34.235+0000 7f04fad2b640 0 log_channel(cluster) log [INF] : Evicting (and blocklisting) client session 6826 (172.21.15.146:0/2294298422) 2023-10-03T19:21:28.922 INFO:teuthology.orchestra.run.smithi045.stdout: -65> 2023-10-03T19:20:34.235+0000 7f04fad2b640 4 mds.0.54 Preparing blocklist command... (wait=0) 2023-10-03T19:21:28.922 INFO:teuthology.orchestra.run.smithi045.stdout: -64> 2023-10-03T19:20:34.235+0000 7f04fad2b640 4 mds.0.54 Sending mon blocklist command: {"prefix":"osd blocklist", "blocklistop":"add","addr":"172.21.15.146:0/2294298422"} 2023-10-03T19:21:28.922 INFO:teuthology.orchestra.run.smithi045.stdout: -63> 2023-10-03T19:20:34.235+0000 7f04fad2b640 10 start_mon_command cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"172.21.15.146:0/2294298422"}] 2023-10-03T19:21:28.922 INFO:teuthology.orchestra.run.smithi045.stdout: -62> 2023-10-03T19:20:34.235+0000 7f04fad2b640 10 monclient: _send_command 1 [{"prefix":"osd blocklist", "blocklistop":"add","addr":"172.21.15.146:0/2294298422"}] 2023-10-03T19:21:28.922 INFO:teuthology.orchestra.run.smithi045.stdout: -61> 2023-10-03T19:20:34.235+0000 7f04fad2b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.922 INFO:teuthology.orchestra.run.smithi045.stdout: -60> 2023-10-03T19:20:34.235+0000 7f04fad2b640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix":"osd blocklist", "blocklistop":"add","addr":"172.21.15.146:0/2294298422"} v 0) v1 -- 0x55c505933380 con 0x55c504afb400 2023-10-03T19:21:28.922 INFO:teuthology.orchestra.run.smithi045.stdout: -59> 2023-10-03T19:20:34.243+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== client.7803 172.21.15.172:0/707580424 8 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000723, avg_latency: 0.000723, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 4 cap_misses: 2 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55c505b8b760 con 0x55c505b32000 2023-10-03T19:21:28.923 INFO:teuthology.orchestra.run.smithi045.stdout: -58> 2023-10-03T19:20:34.319+0000 7f04f4d1f640 2 mds.0.cache Memory usage: total 274128, rss 37968, heap 207144, baseline 190760, 1 / 13 inodes have caps, 2 caps, 0.153846 caps per inode 2023-10-03T19:21:28.923 INFO:teuthology.orchestra.run.smithi045.stdout: -57> 2023-10-03T19:20:34.319+0000 7f04f4d1f640 10 mds.0.cache trim_client_leases 2023-10-03T19:21:28.923 INFO:teuthology.orchestra.run.smithi045.stdout: -56> 2023-10-03T19:20:34.319+0000 7f04f4d1f640 7 mds.0.cache trim bytes_used=51kB limit=4GB reservation=0.05% count=0 2023-10-03T19:21:28.923 INFO:teuthology.orchestra.run.smithi045.stdout: -55> 2023-10-03T19:20:34.319+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimming 0 items from LRU size=10 mid=0 pintail=0 pinned=10 2023-10-03T19:21:28.923 INFO:teuthology.orchestra.run.smithi045.stdout: -54> 2023-10-03T19:20:34.319+0000 7f04f4d1f640 7 mds.0.cache trim_lru trimmed 0 items 2023-10-03T19:21:28.923 INFO:teuthology.orchestra.run.smithi045.stdout: -53> 2023-10-03T19:20:34.319+0000 7f04f4d1f640 7 mds.0.server recall_client_state: min=100 max=1048576 total=2 flags=0xa 2023-10-03T19:21:28.923 INFO:teuthology.orchestra.run.smithi045.stdout: -52> 2023-10-03T19:20:34.319+0000 7f04f4d1f640 7 mds.0.server recalled 0 client caps. 2023-10-03T19:21:28.923 INFO:teuthology.orchestra.run.smithi045.stdout: -51> 2023-10-03T19:20:34.319+0000 7f04f4d1f640 10 mds.0.cache releasing free memory 2023-10-03T19:21:28.923 INFO:teuthology.orchestra.run.smithi045.stdout: -50> 2023-10-03T19:20:34.451+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== client.6826 172.21.15.146:0/2294298422 12 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.002844, avg_latency: 0.001422, sq_sum: 3993766564, count=2][client_metric_type: CAP_INFO cap_hits: 4 cap_misses: 2 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55c505b8e420 con 0x55c505887400 2023-10-03T19:21:28.923 INFO:teuthology.orchestra.run.smithi045.stdout: -49> 2023-10-03T19:20:34.763+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 58 ==== osd_map(110..110 src has 1..110) v4 ==== 331+0+0 (secure 0 0 0) 0x55c505bbc000 con 0x55c504afb400 2023-10-03T19:21:28.924 INFO:teuthology.orchestra.run.smithi045.stdout: -48> 2023-10-03T19:20:34.763+0000 7f04f8d27640 10 mds.0.snap check_osd_map need_to_purge={} 2023-10-03T19:21:28.924 INFO:teuthology.orchestra.run.smithi045.stdout: -47> 2023-10-03T19:20:34.763+0000 7f04f8d27640 7 mds.0.server operator(): full = 0 epoch = 110 2023-10-03T19:21:28.924 INFO:teuthology.orchestra.run.smithi045.stdout: -46> 2023-10-03T19:20:34.763+0000 7f04f8d27640 10 mds.0.server kill_session 0x55c504b1ad00 2023-10-03T19:21:28.924 INFO:teuthology.orchestra.run.smithi045.stdout: -45> 2023-10-03T19:20:34.763+0000 7f04f8d27640 10 mds.0.server journal_close_session : client.6826 172.21.15.146:0/2294298422 pending_prealloc_inos [] free_prealloc_inos [] delegated_inos [] 2023-10-03T19:21:28.924 INFO:teuthology.orchestra.run.smithi045.stdout: -44> 2023-10-03T19:20:34.763+0000 7f04f8d27640 10 mds.0.server apply_blocklist: killed 1 2023-10-03T19:21:28.924 INFO:teuthology.orchestra.run.smithi045.stdout: -43> 2023-10-03T19:20:34.763+0000 7f04f8d27640 4 mds.0.54 apply_blocklist: killed 1, blocklisted sessions (1 blocklist entries, 2) 2023-10-03T19:21:28.924 INFO:teuthology.orchestra.run.smithi045.stdout: -42> 2023-10-03T19:20:34.763+0000 7f04f8d27640 4 mds.0.54 set_osd_epoch_barrier: epoch=110 2023-10-03T19:21:28.924 INFO:teuthology.orchestra.run.smithi045.stdout: -41> 2023-10-03T19:20:34.763+0000 7f04f8d27640 10 monclient: _renew_subs 2023-10-03T19:21:28.924 INFO:teuthology.orchestra.run.smithi045.stdout: -40> 2023-10-03T19:20:34.763+0000 7f04f8d27640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.924 INFO:teuthology.orchestra.run.smithi045.stdout: -39> 2023-10-03T19:20:34.763+0000 7f04f251a640 5 mds.0.log _submit_thread 4196891~121 : ESession client.6826 172.21.15.146:0/2294298422 close cmapv 3 2023-10-03T19:21:28.924 INFO:teuthology.orchestra.run.smithi045.stdout: -38> 2023-10-03T19:20:34.763+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=111}) v3 -- 0x55c505991a00 con 0x55c504afb400 2023-10-03T19:21:28.924 INFO:teuthology.orchestra.run.smithi045.stdout: -37> 2023-10-03T19:20:34.763+0000 7f04f251a640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.54:42 17.14 17:2e2fa760:::200.00000001:head [write 2587~141 [fadvise_dontneed] in=141b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e110) v8 -- 0x55c505b14380 con 0x55c505a26c00 2023-10-03T19:21:28.925 INFO:teuthology.orchestra.run.smithi045.stdout: -36> 2023-10-03T19:20:34.763+0000 7f04f251a640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- osd_op(unknown.0.54:43 17.14 17:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed] in=90b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e110) v8 -- 0x55c505b1b880 con 0x55c505a26c00 2023-10-03T19:21:28.925 INFO:teuthology.orchestra.run.smithi045.stdout: -35> 2023-10-03T19:20:34.771+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 59 ==== mon_command_ack([{"prefix":"osd blocklist", "blocklistop":"add","addr":"172.21.15.146:0/2294298422"}]=0 blocklisting 172.21.15.146:0/2294298422 until 2023-10-03T20:20:34.239894+0000 (3600 sec) v110) v1 ==== 205+0+0 (secure 0 0 0) 0x55c505991a00 con 0x55c504afb400 2023-10-03T19:21:28.925 INFO:teuthology.orchestra.run.smithi045.stdout: -34> 2023-10-03T19:20:34.771+0000 7f04f8d27640 10 monclient: handle_mon_command_ack 1 [{"prefix":"osd blocklist", "blocklistop":"add","addr":"172.21.15.146:0/2294298422"}] 2023-10-03T19:21:28.925 INFO:teuthology.orchestra.run.smithi045.stdout: -33> 2023-10-03T19:20:34.771+0000 7f04f8d27640 10 monclient: _finish_command 1 = system:0 blocklisting 172.21.15.146:0/2294298422 until 2023-10-03T20:20:34.239894+0000 (3600 sec) 2023-10-03T19:21:28.925 INFO:teuthology.orchestra.run.smithi045.stdout: -32> 2023-10-03T19:20:34.771+0000 7f04f9d29640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.45:3300/0 2023-10-03T19:21:28.925 INFO:teuthology.orchestra.run.smithi045.stdout: -31> 2023-10-03T19:20:34.771+0000 7f04f9d29640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=38) v1 -- 0x55c505b8bb80 con 0x55c504afb400 2023-10-03T19:21:28.925 INFO:teuthology.orchestra.run.smithi045.stdout: -30> 2023-10-03T19:20:34.771+0000 7f04f8d27640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== mon.0 v2:172.21.15.45:3300/0 60 ==== mon_get_version_reply(handle=38 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x55c505b8bb80 con 0x55c504afb400 2023-10-03T19:21:28.925 INFO:teuthology.orchestra.run.smithi045.stdout: -29> 2023-10-03T19:20:34.771+0000 7f04f8d27640 10 monclient: handle_get_version_reply finishing 38 version 110 2023-10-03T19:21:28.925 INFO:teuthology.orchestra.run.smithi045.stdout: -28> 2023-10-03T19:20:34.771+0000 7f04f2d1b640 4 mds.0.54 set_osd_epoch_barrier: epoch=110 2023-10-03T19:21:28.925 INFO:teuthology.orchestra.run.smithi045.stdout: -27> 2023-10-03T19:20:34.771+0000 7f04f2d1b640 10 mds.0.server kill_session importing or already closing/killing 0x55c504b1ad00 2023-10-03T19:21:28.925 INFO:teuthology.orchestra.run.smithi045.stdout: -26> 2023-10-03T19:20:34.779+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.3 v2:172.21.15.45:6816/4227059688 19 ==== osd_op_reply(42 200.00000001 [write 2587~141 [fadvise_dontneed]] v110'9 uv9 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55c505af6fc0 con 0x55c505a26c00 2023-10-03T19:21:28.926 INFO:teuthology.orchestra.run.smithi045.stdout: -25> 2023-10-03T19:20:34.779+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 20C_MDS_session_finish 2023-10-03T19:21:28.926 INFO:teuthology.orchestra.run.smithi045.stdout: -24> 2023-10-03T19:20:34.779+0000 7f04f2d1b640 10 MDSContext::complete: 20C_MDS_session_finish 2023-10-03T19:21:28.926 INFO:teuthology.orchestra.run.smithi045.stdout: -23> 2023-10-03T19:20:34.779+0000 7f04f2d1b640 10 mds.0.server _session_logged client.6826 172.21.15.146:0/2294298422 state_seq 3 close 3 inos_to_free [] inotablev 0 inos_to_purge [] 2023-10-03T19:21:28.926 INFO:teuthology.orchestra.run.smithi045.stdout: -22> 2023-10-03T19:20:34.779+0000 7f04f2d1b640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> 172.21.15.146:0/2294298422 conn(0x55c505887400 msgr2=0x55c505b19180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:28.926 INFO:teuthology.orchestra.run.smithi045.stdout: -21> 2023-10-03T19:20:34.779+0000 7f04f2d1b640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> 172.21.15.146:0/2294298422 conn(0x55c505887400 0x55c505b19180 crc :-1 s=READY pgs=4 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:28.926 INFO:teuthology.orchestra.run.smithi045.stdout: -20> 2023-10-03T19:20:34.779+0000 7f04f2d1b640 10 remove_session: mds.metrics: session=0x55c504b1ad00, client=client.6826 172.21.15.146:0/2294298422 2023-10-03T19:21:28.926 INFO:teuthology.orchestra.run.smithi045.stdout: -19> 2023-10-03T19:20:34.779+0000 7f04f2d1b640 10 mds.0.sessionmap remove_session s=0x55c504b1ad00 name=client.6826 2023-10-03T19:21:28.926 INFO:teuthology.orchestra.run.smithi045.stdout: -18> 2023-10-03T19:20:34.779+0000 7f04f2d1b640 10 MDSIOContextBase::complete: 12C_IO_Wrapper 2023-10-03T19:21:28.926 INFO:teuthology.orchestra.run.smithi045.stdout: -17> 2023-10-03T19:20:34.779+0000 7f04f2d1b640 10 MDSContext::complete: 12C_IO_Wrapper 2023-10-03T19:21:28.926 INFO:teuthology.orchestra.run.smithi045.stdout: -16> 2023-10-03T19:20:34.779+0000 7f04f2d1b640 10 MDSContext::complete: 25MDSInternalContextWrapper 2023-10-03T19:21:28.926 INFO:teuthology.orchestra.run.smithi045.stdout: -15> 2023-10-03T19:20:34.779+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] reap_dead start 2023-10-03T19:21:28.927 INFO:teuthology.orchestra.run.smithi045.stdout: -14> 2023-10-03T19:20:34.779+0000 7f04fc52e640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] <== osd.3 v2:172.21.15.45:6816/4227059688 20 ==== osd_op_reply(43 200.00000000 [writefull 0~90 [fadvise_dontneed]] v110'10 uv10 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55c505af6fc0 con 0x55c505a26c00 2023-10-03T19:21:28.927 INFO:teuthology.orchestra.run.smithi045.stdout: -13> 2023-10-03T19:20:34.779+0000 7f04fc52e640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> conn(0x55c504afb000 0x55c504b87080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).accept 2023-10-03T19:21:28.927 INFO:teuthology.orchestra.run.smithi045.stdout: -12> 2023-10-03T19:20:34.783+0000 7f04fb52c640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> conn(0x55c504afb000 0x55c504b87080 unknown :-1 s=BANNER_ACCEPTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:28.927 INFO:teuthology.orchestra.run.smithi045.stdout: -11> 2023-10-03T19:20:34.783+0000 7f04fb52c640 10 monclient: handle_auth_request added challenge on 0x55c504afb000 2023-10-03T19:21:28.927 INFO:teuthology.orchestra.run.smithi045.stdout: -10> 2023-10-03T19:20:34.783+0000 7f04fb52c640 10 mds.a parse_caps: parsing auth_cap_str='allow' 2023-10-03T19:21:28.927 INFO:teuthology.orchestra.run.smithi045.stdout: -9> 2023-10-03T19:20:34.783+0000 7f04fb52c640 0 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> 172.21.15.146:0/2294298422 conn(0x55c504afb000 0x55c504b87080 crc :-1 s=SESSION_ACCEPTING pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_reconnect no existing connection exists, reseting client 2023-10-03T19:21:28.927 INFO:teuthology.orchestra.run.smithi045.stdout: -8> 2023-10-03T19:20:34.783+0000 7f04fb52c640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> 172.21.15.146:0/2294298422 conn(0x55c504afb000 0x55c504b87080 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=client.6826 client_cookie=39742297094602f server_cookie=20f8b98aced826a7 in_seq=0 out_seq=0 2023-10-03T19:21:28.927 INFO:teuthology.orchestra.run.smithi045.stdout: -7> 2023-10-03T19:20:34.783+0000 7f04f8d27640 10 mds.a new session 0x55c505ae9200 for client.6826 172.21.15.146:0/2294298422 con 0x55c504afb000 2023-10-03T19:21:28.927 INFO:teuthology.orchestra.run.smithi045.stdout: -6> 2023-10-03T19:20:34.783+0000 7f04f8d27640 10 mds.a parse_caps: parsing auth_cap_str='allow' 2023-10-03T19:21:28.927 INFO:teuthology.orchestra.run.smithi045.stdout: -5> 2023-10-03T19:20:34.783+0000 7f04f8d27640 10 mds.a ms_handle_accept 172.21.15.146:0/2294298422 con 0x55c504afb000 session 0x55c505ae9200 2023-10-03T19:21:28.927 INFO:teuthology.orchestra.run.smithi045.stdout: -4> 2023-10-03T19:20:34.787+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> 172.21.15.146:0/2294298422 conn(0x55c504afb000 msgr2=0x55c504b87080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 39 2023-10-03T19:21:28.928 INFO:teuthology.orchestra.run.smithi045.stdout: -3> 2023-10-03T19:20:34.787+0000 7f04fb52c640 1 -- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> 172.21.15.146:0/2294298422 conn(0x55c504afb000 msgr2=0x55c504b87080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T19:21:28.928 INFO:teuthology.orchestra.run.smithi045.stdout: -2> 2023-10-03T19:20:34.787+0000 7f04fb52c640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> 172.21.15.146:0/2294298422 conn(0x55c504afb000 0x55c504b87080 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T19:21:28.928 INFO:teuthology.orchestra.run.smithi045.stdout: -1> 2023-10-03T19:20:34.787+0000 7f04fb52c640 1 --2- [v2:172.21.15.45:6834/1723126563,v1:172.21.15.45:6835/1723126563] >> 172.21.15.146:0/2294298422 conn(0x55c504afb000 0x55c504b87080 unknown :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault with nothing to send, going to standby 2023-10-03T19:21:28.928 INFO:teuthology.orchestra.run.smithi045.stdout: 0> 2023-10-03T19:20:34.923+0000 7f04f7524640 0 mds.0.54 inmemory_logger client_eviction_dump 1, missed_beacon_ack_dump 0, missed_internal_heartbeat_dump 0 2023-10-03T19:21:28.928 INFO:teuthology.orchestra.run.smithi045.stdout:--- logging levels --- 2023-10-03T19:21:28.928 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 none 2023-10-03T19:21:28.928 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 lockdep 2023-10-03T19:21:28.928 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 context 2023-10-03T19:21:28.928 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 1 crush 2023-10-03T19:21:28.928 INFO:teuthology.orchestra.run.smithi045.stdout: 1/10 mds 2023-10-03T19:21:28.928 INFO:teuthology.orchestra.run.smithi045.stdout: 20/20 mds_balancer 2023-10-03T19:21:28.928 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mds_locker 2023-10-03T19:21:28.929 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mds_log 2023-10-03T19:21:28.929 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mds_log_expire 2023-10-03T19:21:28.929 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mds_migrator 2023-10-03T19:21:28.929 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 buffer 2023-10-03T19:21:28.929 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 timer 2023-10-03T19:21:28.929 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 filer 2023-10-03T19:21:28.929 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 striper 2023-10-03T19:21:28.929 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 1 objecter 2023-10-03T19:21:28.929 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 rados 2023-10-03T19:21:28.929 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 rbd 2023-10-03T19:21:28.929 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 rbd_mirror 2023-10-03T19:21:28.929 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 rbd_replay 2023-10-03T19:21:28.930 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 rbd_pwl 2023-10-03T19:21:28.930 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 journaler 2023-10-03T19:21:28.930 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 objectcacher 2023-10-03T19:21:28.930 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 immutable_obj_cache 2023-10-03T19:21:28.930 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 client 2023-10-03T19:21:28.930 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 osd 2023-10-03T19:21:28.930 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 optracker 2023-10-03T19:21:28.930 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 objclass 2023-10-03T19:21:28.930 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 3 filestore 2023-10-03T19:21:28.930 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 3 journal 2023-10-03T19:21:28.930 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 1 ms 2023-10-03T19:21:28.931 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mon 2023-10-03T19:21:28.931 INFO:teuthology.orchestra.run.smithi045.stdout: 0/10 monc 2023-10-03T19:21:28.931 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 paxos 2023-10-03T19:21:28.931 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 tp 2023-10-03T19:21:28.931 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 auth 2023-10-03T19:21:28.931 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 crypto 2023-10-03T19:21:28.931 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 1 finisher 2023-10-03T19:21:28.931 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 1 reserver 2023-10-03T19:21:28.931 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 heartbeatmap 2023-10-03T19:21:28.931 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 perfcounter 2023-10-03T19:21:28.950 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw 2023-10-03T19:21:28.951 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw_sync 2023-10-03T19:21:28.951 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw_datacache 2023-10-03T19:21:28.951 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw_access 2023-10-03T19:21:28.951 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw_dbstore 2023-10-03T19:21:28.951 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 rgw_flight 2023-10-03T19:21:28.951 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 javaclient 2023-10-03T19:21:28.951 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 asok 2023-10-03T19:21:28.951 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 1 throttle 2023-10-03T19:21:28.951 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 0 refs 2023-10-03T19:21:28.951 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 compressor 2023-10-03T19:21:28.952 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 bluestore 2023-10-03T19:21:28.952 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 bluefs 2023-10-03T19:21:28.952 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 3 bdev 2023-10-03T19:21:28.952 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 kstore 2023-10-03T19:21:28.952 INFO:teuthology.orchestra.run.smithi045.stdout: 4/ 5 rocksdb 2023-10-03T19:21:28.952 INFO:teuthology.orchestra.run.smithi045.stdout: 4/ 5 leveldb 2023-10-03T19:21:28.952 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 fuse 2023-10-03T19:21:28.952 INFO:teuthology.orchestra.run.smithi045.stdout: 2/ 5 mgr 2023-10-03T19:21:28.952 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mgrc 2023-10-03T19:21:28.952 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 dpdk 2023-10-03T19:21:28.952 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 eventtrace 2023-10-03T19:21:28.952 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 prioritycache 2023-10-03T19:21:28.953 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 test 2023-10-03T19:21:28.953 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 cephfs_mirror 2023-10-03T19:21:28.953 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 cephsqlite 2023-10-03T19:21:28.953 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore 2023-10-03T19:21:28.953 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_onode 2023-10-03T19:21:28.953 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_odata 2023-10-03T19:21:28.953 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_omap 2023-10-03T19:21:28.953 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_tm 2023-10-03T19:21:28.953 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_t 2023-10-03T19:21:28.953 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_cleaner 2023-10-03T19:21:28.953 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_epm 2023-10-03T19:21:28.953 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_lba 2023-10-03T19:21:28.954 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_fixedkv_tree 2023-10-03T19:21:28.954 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_cache 2023-10-03T19:21:28.954 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_journal 2023-10-03T19:21:28.954 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_device 2023-10-03T19:21:28.954 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 seastore_backref 2023-10-03T19:21:28.954 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 alienstore 2023-10-03T19:21:28.954 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 mclock 2023-10-03T19:21:28.954 INFO:teuthology.orchestra.run.smithi045.stdout: 0/ 5 cyanstore 2023-10-03T19:21:28.954 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 ceph_exporter 2023-10-03T19:21:28.954 INFO:teuthology.orchestra.run.smithi045.stdout: 1/ 5 memstore 2023-10-03T19:21:28.954 INFO:teuthology.orchestra.run.smithi045.stdout: -2/-2 (syslog threshold) 2023-10-03T19:21:28.954 INFO:teuthology.orchestra.run.smithi045.stdout: -1/-1 (stderr threshold) 2023-10-03T19:21:28.955 INFO:teuthology.orchestra.run.smithi045.stdout:--- pthread ID / name mapping for recent threads --- 2023-10-03T19:21:28.955 INFO:teuthology.orchestra.run.smithi045.stdout: 7f04f1518640 / ms_dispatch 2023-10-03T19:21:28.955 INFO:teuthology.orchestra.run.smithi045.stdout: 7f04f1d19640 / ms_dispatch 2023-10-03T19:21:28.955 INFO:teuthology.orchestra.run.smithi045.stdout: 7f04f251a640 / md_submit 2023-10-03T19:21:28.955 INFO:teuthology.orchestra.run.smithi045.stdout: 7f04f2d1b640 / MR_Finisher 2023-10-03T19:21:28.955 INFO:teuthology.orchestra.run.smithi045.stdout: 7f04f451e640 / mds_rank_progr 2023-10-03T19:21:28.955 INFO:teuthology.orchestra.run.smithi045.stdout: 7f04f4d1f640 / ms_dispatch 2023-10-03T19:21:28.955 INFO:teuthology.orchestra.run.smithi045.stdout: 7f04f6522640 / safe_timer 2023-10-03T19:21:28.955 INFO:teuthology.orchestra.run.smithi045.stdout: 7f04f6d23640 / ceph-mds 2023-10-03T19:21:28.955 INFO:teuthology.orchestra.run.smithi045.stdout: 7f04f7524640 / safe_timer 2023-10-03T19:21:28.955 INFO:teuthology.orchestra.run.smithi045.stdout: 7f04f7d25640 / safe_timer 2023-10-03T19:21:28.955 INFO:teuthology.orchestra.run.smithi045.stdout: 7f04f8526640 / ms_local 2023-10-03T19:21:28.956 INFO:teuthology.orchestra.run.smithi045.stdout: 7f04f8d27640 / ms_dispatch 2023-10-03T19:21:28.956 INFO:teuthology.orchestra.run.smithi045.stdout: 7f04f9d29640 / io_context_pool 2023-10-03T19:21:28.956 INFO:teuthology.orchestra.run.smithi045.stdout: 7f04fad2b640 / admin_socket 2023-10-03T19:21:28.956 INFO:teuthology.orchestra.run.smithi045.stdout: 7f04fb52c640 / msgr-worker-2 2023-10-03T19:21:28.956 INFO:teuthology.orchestra.run.smithi045.stdout: 7f04fbd2d640 / msgr-worker-1 2023-10-03T19:21:28.956 INFO:teuthology.orchestra.run.smithi045.stdout: 7f04fc52e640 / msgr-worker-0 2023-10-03T19:21:28.956 INFO:teuthology.orchestra.run.smithi045.stdout: 7f04fd56cac0 / ceph-mds 2023-10-03T19:21:28.956 INFO:teuthology.orchestra.run.smithi045.stdout: max_recent 10000 2023-10-03T19:21:28.956 INFO:teuthology.orchestra.run.smithi045.stdout: max_new 1000 2023-10-03T19:21:28.956 INFO:teuthology.orchestra.run.smithi045.stdout: log_file /var/log/ceph/ceph-mds.a.log 2023-10-03T19:21:28.956 INFO:teuthology.orchestra.run.smithi045.stdout:--- end dump of recent events --- 2023-10-03T19:21:29.003 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:21:29.051 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:21:29.094 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-03T19:21:29.168 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-03T19:21:29.169 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:21:29.169 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:21:29.175 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336540k,nr_inodes=4084135,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16206 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-10-03T19:21:29.175 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-03T19:21:29.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:21:29.175 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-03T19:21:29.221 INFO:teuthology.orchestra.run.smithi146.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-03T19:21:29.222 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T19:21:29.222 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-03T19:21:29.222 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:21:29.228 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:21:29.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.363+0000 7f28d4122640 1 Processor -- start 2023-10-03T19:21:29.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.363+0000 7f28d4122640 1 -- start start 2023-10-03T19:21:29.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.363+0000 7f28d4122640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28cc071380 0x7f28cc0bc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:29.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.363+0000 7f28d4122640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f28cc0bcb80 0x7f28cc152850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:29.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.363+0000 7f28d4122640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28cc152d90 con 0x7f28cc071750 2023-10-03T19:21:29.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.363+0000 7f28d4122640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28cc14f860 con 0x7f28cc0bcb80 2023-10-03T19:21:29.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.363+0000 7f28d4122640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc0bd220 con 0x7f28cc071380 2023-10-03T19:21:29.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.363+0000 7f28d16bd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f28cc0bcb80 0x7f28cc152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:29.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.363+0000 7f28d16bd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f28cc0bcb80 0x7f28cc152850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57778/0 (socket says 172.21.15.45:57778) 2023-10-03T19:21:29.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.363+0000 7f28d16bd640 1 -- 172.21.15.45:0/1099148184 learned_addr learned my addr 172.21.15.45:0/1099148184 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:29.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.363+0000 7f28d16bd640 1 -- 172.21.15.45:0/1099148184 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28cc071380 msgr2=0x7f28cc0bc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:29.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.363+0000 7f28d1ebe640 1 --2- 172.21.15.45:0/1099148184 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28cc071380 0x7f28cc0bc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:29.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.363+0000 7f28d16bd640 1 --2- 172.21.15.45:0/1099148184 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28cc071380 0x7f28cc0bc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:29.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.363+0000 7f28d16bd640 1 -- 172.21.15.45:0/1099148184 >> v1:172.21.15.45:6789/0 conn(0x7f28cc071750 legacy=0x7f28cc14b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:29.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.363+0000 7f28d16bd640 1 -- 172.21.15.45:0/1099148184 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28cc071cf0 con 0x7f28cc0bcb80 2023-10-03T19:21:29.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.363+0000 7f28d0ebc640 1 -- 172.21.15.45:0/1099148184 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828542506 0 0) 0x7f28cc152d90 con 0x7f28cc071750 2023-10-03T19:21:29.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.363+0000 7f28d1ebe640 1 --2- 172.21.15.45:0/1099148184 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28cc071380 0x7f28cc0bc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:21:29.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.367+0000 7f28d16bd640 1 --2- 172.21.15.45:0/1099148184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28cc0bcb80 0x7f28cc152850 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f28c8009870 tx=0x7f28c801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61783edab4eda6e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:29.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.367+0000 7f28d0ebc640 1 -- 172.21.15.45:0/1099148184 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c80ad640 con 0x7f28cc0bcb80 2023-10-03T19:21:29.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.367+0000 7f28d0ebc640 1 -- 172.21.15.45:0/1099148184 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c80ad7a0 con 0x7f28cc0bcb80 2023-10-03T19:21:29.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.367+0000 7f28d0ebc640 1 -- 172.21.15.45:0/1099148184 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c80adb30 con 0x7f28cc0bcb80 2023-10-03T19:21:29.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.367+0000 7f28d4122640 1 -- 172.21.15.45:0/1099148184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28cc0bcb80 msgr2=0x7f28cc152850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:29.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.367+0000 7f28d4122640 1 --2- 172.21.15.45:0/1099148184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28cc0bcb80 0x7f28cc152850 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f28c8009870 tx=0x7f28c801c540 comp rx=0 tx=0).stop 2023-10-03T19:21:29.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.367+0000 7f28d4122640 1 -- 172.21.15.45:0/1099148184 shutdown_connections 2023-10-03T19:21:29.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.367+0000 7f28d4122640 1 --2- 172.21.15.45:0/1099148184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28cc0bcb80 0x7f28cc152850 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:29.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.367+0000 7f28d4122640 1 --2- 172.21.15.45:0/1099148184 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28cc071380 0x7f28cc0bc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:29.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.367+0000 7f28d4122640 1 -- 172.21.15.45:0/1099148184 >> 172.21.15.45:0/1099148184 conn(0x7f28cc06bce0 msgr2=0x7f28cc06c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:29.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.367+0000 7f28d4122640 1 -- 172.21.15.45:0/1099148184 shutdown_connections 2023-10-03T19:21:29.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.367+0000 7f28d4122640 1 -- 172.21.15.45:0/1099148184 wait complete. 2023-10-03T19:21:29.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.367+0000 7f28d4122640 1 Processor -- start 2023-10-03T19:21:29.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.367+0000 7f28d4122640 1 -- start start 2023-10-03T19:21:29.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.367+0000 7f28d4122640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28cc071380 0x7f28cc14fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:29.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.367+0000 7f28d4122640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28cc071750 0x7f28cc143980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:29.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.367+0000 7f28d4122640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28cc0bcb80 0x7f28cc151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:29.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.367+0000 7f28d4122640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc0c2240 con 0x7f28cc0bcb80 2023-10-03T19:21:29.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.367+0000 7f28d4122640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc14cbd0 con 0x7f28cc071750 2023-10-03T19:21:29.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.367+0000 7f28d4122640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc13b5e0 con 0x7f28cc071380 2023-10-03T19:21:29.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.367+0000 7f28d26bf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28cc0bcb80 0x7f28cc151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:29.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.371+0000 7f28d26bf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28cc0bcb80 0x7f28cc151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57784/0 (socket says 172.21.15.45:57784) 2023-10-03T19:21:29.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.371+0000 7f28d26bf640 1 -- 172.21.15.45:0/2432951135 learned_addr learned my addr 172.21.15.45:0/2432951135 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:29.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.371+0000 7f28d1ebe640 1 --2- 172.21.15.45:0/2432951135 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28cc071380 0x7f28cc14fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:29.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.371+0000 7f28d16bd640 1 --2- 172.21.15.45:0/2432951135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28cc071750 0x7f28cc143980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:29.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.371+0000 7f28d26bf640 1 -- 172.21.15.45:0/2432951135 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28cc071380 msgr2=0x7f28cc14fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:29.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.371+0000 7f28d26bf640 1 --2- 172.21.15.45:0/2432951135 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28cc071380 0x7f28cc14fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:29.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.371+0000 7f28d26bf640 1 -- 172.21.15.45:0/2432951135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28cc071750 msgr2=0x7f28cc143980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:29.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.371+0000 7f28d26bf640 1 --2- 172.21.15.45:0/2432951135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28cc071750 0x7f28cc143980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:29.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.371+0000 7f28d26bf640 1 -- 172.21.15.45:0/2432951135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c80094d0 con 0x7f28cc0bcb80 2023-10-03T19:21:29.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.371+0000 7f28d16bd640 1 --2- 172.21.15.45:0/2432951135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28cc071750 0x7f28cc143980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:21:29.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.371+0000 7f28d26bf640 1 --2- 172.21.15.45:0/2432951135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28cc0bcb80 0x7f28cc151470 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f28c4001570 tx=0x7f28c400cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:29.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.371+0000 7f28be7fc640 1 -- 172.21.15.45:0/2432951135 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4003db0 con 0x7f28cc0bcb80 2023-10-03T19:21:29.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.371+0000 7f28be7fc640 1 -- 172.21.15.45:0/2432951135 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c4005070 con 0x7f28cc0bcb80 2023-10-03T19:21:29.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.371+0000 7f28d4122640 1 -- 172.21.15.45:0/2432951135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28cc0a1d80 con 0x7f28cc0bcb80 2023-10-03T19:21:29.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.371+0000 7f28be7fc640 1 -- 172.21.15.45:0/2432951135 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4005420 con 0x7f28cc0bcb80 2023-10-03T19:21:29.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.371+0000 7f28d4122640 1 -- 172.21.15.45:0/2432951135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28cc0a1bf0 con 0x7f28cc0bcb80 2023-10-03T19:21:29.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.371+0000 7f28d4122640 1 -- 172.21.15.45:0/2432951135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28cc14c0b0 con 0x7f28cc0bcb80 2023-10-03T19:21:29.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.371+0000 7f28be7fc640 1 -- 172.21.15.45:0/2432951135 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f28c4005580 con 0x7f28cc0bcb80 2023-10-03T19:21:29.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.371+0000 7f28be7fc640 1 --2- 172.21.15.45:0/2432951135 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f28b0066280 0x7f28b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:29.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.371+0000 7f28be7fc640 1 -- 172.21.15.45:0/2432951135 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f28c4083580 con 0x7f28cc0bcb80 2023-10-03T19:21:29.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.371+0000 7f28d1ebe640 1 --2- 172.21.15.45:0/2432951135 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f28b0066280 0x7f28b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:29.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.375+0000 7f28d1ebe640 1 --2- 172.21.15.45:0/2432951135 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f28b0066280 0x7f28b0068730 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f28c000a9a0 tx=0x7f28c0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:29.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.375+0000 7f28be7fc640 1 -- 172.21.15.45:0/2432951135 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f28c4050a60 con 0x7f28cc0bcb80 2023-10-03T19:21:29.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.531+0000 7f28d4122640 1 -- 172.21.15.45:0/2432951135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28cc04ded0 con 0x7f28cc0bcb80 2023-10-03T19:21:29.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.531+0000 7f28be7fc640 1 -- 172.21.15.45:0/2432951135 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+18375 (secure 0 0 0) 0x7f28c4054080 con 0x7f28cc0bcb80 2023-10-03T19:21:29.537 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:21:29.537 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":110,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:20:34.764210+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:20:13.940428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-10-03T19:20:15.290748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:0/2294298422":"2023-10-03T20:20:34.239894+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:21:29.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.535+0000 7f28d4122640 1 -- 172.21.15.45:0/2432951135 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f28b0066280 msgr2=0x7f28b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:29.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.535+0000 7f28d4122640 1 --2- 172.21.15.45:0/2432951135 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f28b0066280 0x7f28b0068730 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f28c000a9a0 tx=0x7f28c0008040 comp rx=0 tx=0).stop 2023-10-03T19:21:29.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.535+0000 7f28d4122640 1 -- 172.21.15.45:0/2432951135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28cc0bcb80 msgr2=0x7f28cc151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:29.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.535+0000 7f28d4122640 1 --2- 172.21.15.45:0/2432951135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28cc0bcb80 0x7f28cc151470 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f28c4001570 tx=0x7f28c400cd20 comp rx=0 tx=0).stop 2023-10-03T19:21:29.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.535+0000 7f28d4122640 1 -- 172.21.15.45:0/2432951135 shutdown_connections 2023-10-03T19:21:29.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.535+0000 7f28d4122640 1 --2- 172.21.15.45:0/2432951135 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f28b0066280 0x7f28b0068730 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:29.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.535+0000 7f28d4122640 1 --2- 172.21.15.45:0/2432951135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28cc0bcb80 0x7f28cc151470 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:29.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.535+0000 7f28d4122640 1 --2- 172.21.15.45:0/2432951135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28cc071750 0x7f28cc143980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:29.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.535+0000 7f28d4122640 1 --2- 172.21.15.45:0/2432951135 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28cc071380 0x7f28cc14fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:29.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.535+0000 7f28d4122640 1 -- 172.21.15.45:0/2432951135 >> 172.21.15.45:0/2432951135 conn(0x7f28cc06bce0 msgr2=0x7f28cc0bea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:29.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.535+0000 7f28d4122640 1 -- 172.21.15.45:0/2432951135 shutdown_connections 2023-10-03T19:21:29.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.535+0000 7f28d4122640 1 -- 172.21.15.45:0/2432951135 wait complete. 2023-10-03T19:21:29.556 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T19:20:13.940428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T19:20:15.290748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:21:29.557 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:21:29.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.679+0000 7f4ebdc60640 1 Processor -- start 2023-10-03T19:21:29.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.679+0000 7f4ebdc60640 1 -- start start 2023-10-03T19:21:29.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.679+0000 7f4ebdc60640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4eb80712c0 0x7f4eb80bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:29.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.679+0000 7f4ebdc60640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4eb806d560 0x7f4eb80bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:29.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.679+0000 7f4ebdc60640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eb806c2d0 con 0x7f4eb806c760 2023-10-03T19:21:29.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.679+0000 7f4ebdc60640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eb8150610 con 0x7f4eb80712c0 2023-10-03T19:21:29.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.679+0000 7f4ebdc60640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb81508b0 con 0x7f4eb806d560 2023-10-03T19:21:29.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.679+0000 7f4eb77fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4eb80712c0 0x7f4eb80bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:29.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.679+0000 7f4eaffff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4eb806d560 0x7f4eb80bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:29.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.679+0000 7f4eaffff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4eb806d560 0x7f4eb80bd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:38792/0 (socket says 172.21.15.45:38792) 2023-10-03T19:21:29.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.679+0000 7f4eb7fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4eb806c760 0x7f4eb80a53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:36758/0 (socket says 172.21.15.45:36758) 2023-10-03T19:21:29.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.679+0000 7f4eaffff640 1 -- 172.21.15.45:0/1366909231 learned_addr learned my addr 172.21.15.45:0/1366909231 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:29.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.679+0000 7f4eb77fe640 1 -- 172.21.15.45:0/1366909231 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4eb806d560 msgr2=0x7f4eb80bd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:29.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.679+0000 7f4eb77fe640 1 --2- 172.21.15.45:0/1366909231 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4eb806d560 0x7f4eb80bd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:29.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.679+0000 7f4eb77fe640 1 -- 172.21.15.45:0/1366909231 >> v1:172.21.15.79:6789/0 conn(0x7f4eb806c760 legacy=0x7f4eb80a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:29.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.679+0000 7f4eb77fe640 1 -- 172.21.15.45:0/1366909231 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb806d2e0 con 0x7f4eb80712c0 2023-10-03T19:21:29.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.679+0000 7f4eaffff640 1 --2- 172.21.15.45:0/1366909231 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4eb806d560 0x7f4eb80bd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:21:29.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.683+0000 7f4eb77fe640 1 --2- 172.21.15.45:0/1366909231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4eb80712c0 0x7f4eb80bcbc0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80097c0 tx=0x7f4ea801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5d9fd0cfd848aaa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:29.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.683+0000 7f4eb6ffd640 1 -- 172.21.15.45:0/1366909231 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea80ac620 con 0x7f4eb80712c0 2023-10-03T19:21:29.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.683+0000 7f4eb6ffd640 1 -- 172.21.15.45:0/1366909231 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea80ac780 con 0x7f4eb80712c0 2023-10-03T19:21:29.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.683+0000 7f4eb6ffd640 1 -- 172.21.15.45:0/1366909231 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea80acb10 con 0x7f4eb80712c0 2023-10-03T19:21:29.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.683+0000 7f4ebdc60640 1 -- 172.21.15.45:0/1366909231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4eb80712c0 msgr2=0x7f4eb80bcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:29.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.683+0000 7f4ebdc60640 1 --2- 172.21.15.45:0/1366909231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4eb80712c0 0x7f4eb80bcbc0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80097c0 tx=0x7f4ea801c480 comp rx=0 tx=0).stop 2023-10-03T19:21:29.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.683+0000 7f4ebdc60640 1 -- 172.21.15.45:0/1366909231 shutdown_connections 2023-10-03T19:21:29.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.683+0000 7f4ebdc60640 1 --2- 172.21.15.45:0/1366909231 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4eb806d560 0x7f4eb80bd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:29.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.683+0000 7f4ebdc60640 1 --2- 172.21.15.45:0/1366909231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4eb80712c0 0x7f4eb80bcbc0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:29.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.683+0000 7f4ebdc60640 1 -- 172.21.15.45:0/1366909231 >> 172.21.15.45:0/1366909231 conn(0x7f4eb80a20d0 msgr2=0x7f4eb80a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:29.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.683+0000 7f4ebdc60640 1 -- 172.21.15.45:0/1366909231 shutdown_connections 2023-10-03T19:21:29.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.683+0000 7f4ebdc60640 1 -- 172.21.15.45:0/1366909231 wait complete. 2023-10-03T19:21:29.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.683+0000 7f4ebdc60640 1 Processor -- start 2023-10-03T19:21:29.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.683+0000 7f4ebdc60640 1 -- start start 2023-10-03T19:21:29.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.683+0000 7f4ebdc60640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4eb806c760 0x7f4eb81484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:29.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.683+0000 7f4ebdc60640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eb806d560 0x7f4eb814f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:29.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.683+0000 7f4ebdc60640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4eb80712c0 0x7f4eb81e8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:29.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.683+0000 7f4ebdc60640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb814cc80 con 0x7f4eb806d560 2023-10-03T19:21:29.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.683+0000 7f4ebdc60640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb813f8a0 con 0x7f4eb80712c0 2023-10-03T19:21:29.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.683+0000 7f4ebdc60640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb80ba0a0 con 0x7f4eb806c760 2023-10-03T19:21:29.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.683+0000 7f4eaffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eb806d560 0x7f4eb814f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:29.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.683+0000 7f4eaffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eb806d560 0x7f4eb814f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57796/0 (socket says 172.21.15.45:57796) 2023-10-03T19:21:29.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.683+0000 7f4eaffff640 1 -- 172.21.15.45:0/2840359790 learned_addr learned my addr 172.21.15.45:0/2840359790 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:29.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.683+0000 7f4eb7fff640 1 --2- 172.21.15.45:0/2840359790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4eb80712c0 0x7f4eb81e8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:29.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.683+0000 7f4eb77fe640 1 --2- 172.21.15.45:0/2840359790 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4eb806c760 0x7f4eb81484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:29.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.687+0000 7f4eaffff640 1 -- 172.21.15.45:0/2840359790 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4eb806c760 msgr2=0x7f4eb81484a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:29.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.687+0000 7f4eaffff640 1 --2- 172.21.15.45:0/2840359790 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4eb806c760 0x7f4eb81484a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:29.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.687+0000 7f4eaffff640 1 -- 172.21.15.45:0/2840359790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4eb80712c0 msgr2=0x7f4eb81e8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:29.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.687+0000 7f4eaffff640 1 --2- 172.21.15.45:0/2840359790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4eb80712c0 0x7f4eb81e8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:29.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.687+0000 7f4eaffff640 1 -- 172.21.15.45:0/2840359790 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea00094d0 con 0x7f4eb806d560 2023-10-03T19:21:29.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.687+0000 7f4eb77fe640 1 --2- 172.21.15.45:0/2840359790 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4eb806c760 0x7f4eb81484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:21:29.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.687+0000 7f4eaffff640 1 --2- 172.21.15.45:0/2840359790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eb806d560 0x7f4eb814f1d0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000e9d0 tx=0x7f4ea000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:29.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.687+0000 7f4eb4ff9640 1 -- 172.21.15.45:0/2840359790 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea000ca00 con 0x7f4eb806d560 2023-10-03T19:21:29.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.687+0000 7f4ebdc60640 1 -- 172.21.15.45:0/2840359790 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea8009420 con 0x7f4eb806d560 2023-10-03T19:21:29.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.687+0000 7f4eb4ff9640 1 -- 172.21.15.45:0/2840359790 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea000cb60 con 0x7f4eb806d560 2023-10-03T19:21:29.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.687+0000 7f4eb4ff9640 1 -- 172.21.15.45:0/2840359790 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea0013470 con 0x7f4eb806d560 2023-10-03T19:21:29.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.687+0000 7f4ebdc60640 1 -- 172.21.15.45:0/2840359790 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb80a6070 con 0x7f4eb806d560 2023-10-03T19:21:29.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.687+0000 7f4ebdc60640 1 -- 172.21.15.45:0/2840359790 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb80a5ee0 con 0x7f4eb806d560 2023-10-03T19:21:29.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.687+0000 7f4eb4ff9640 1 -- 172.21.15.45:0/2840359790 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4ea00135d0 con 0x7f4eb806d560 2023-10-03T19:21:29.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.687+0000 7f4eb4ff9640 1 --2- 172.21.15.45:0/2840359790 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4e98066280 0x7f4e98068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:29.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.687+0000 7f4eb4ff9640 1 -- 172.21.15.45:0/2840359790 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f4ea0084280 con 0x7f4eb806d560 2023-10-03T19:21:29.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.687+0000 7f4eb77fe640 1 --2- 172.21.15.45:0/2840359790 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4e98066280 0x7f4e98068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:29.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.687+0000 7f4eb77fe640 1 --2- 172.21.15.45:0/2840359790 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4e98066280 0x7f4e98068730 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80ae000 tx=0x7f4ea8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:29.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.691+0000 7f4eb4ff9640 1 -- 172.21.15.45:0/2840359790 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4ea0051810 con 0x7f4eb806d560 2023-10-03T19:21:29.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.843+0000 7f4ebdc60640 1 -- 172.21.15.45:0/2840359790 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4eb81596f0 con 0x7f4eb806d560 2023-10-03T19:21:29.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.843+0000 7f4eb4ff9640 1 -- 172.21.15.45:0/2840359790 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4ea0054e30 con 0x7f4eb806d560 2023-10-03T19:21:29.848 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:21:29.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.847+0000 7f4ebdc60640 1 -- 172.21.15.45:0/2840359790 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4e98066280 msgr2=0x7f4e98068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:29.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.847+0000 7f4ebdc60640 1 --2- 172.21.15.45:0/2840359790 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4e98066280 0x7f4e98068730 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80ae000 tx=0x7f4ea8008040 comp rx=0 tx=0).stop 2023-10-03T19:21:29.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.847+0000 7f4ebdc60640 1 -- 172.21.15.45:0/2840359790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eb806d560 msgr2=0x7f4eb814f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:29.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.847+0000 7f4ebdc60640 1 --2- 172.21.15.45:0/2840359790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eb806d560 0x7f4eb814f1d0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000e9d0 tx=0x7f4ea000ee90 comp rx=0 tx=0).stop 2023-10-03T19:21:29.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.847+0000 7f4ebdc60640 1 -- 172.21.15.45:0/2840359790 shutdown_connections 2023-10-03T19:21:29.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.847+0000 7f4ebdc60640 1 --2- 172.21.15.45:0/2840359790 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4e98066280 0x7f4e98068730 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:29.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.847+0000 7f4ebdc60640 1 --2- 172.21.15.45:0/2840359790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4eb80712c0 0x7f4eb81e8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:29.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.847+0000 7f4ebdc60640 1 --2- 172.21.15.45:0/2840359790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eb806d560 0x7f4eb814f1d0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:29.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.847+0000 7f4ebdc60640 1 --2- 172.21.15.45:0/2840359790 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4eb806c760 0x7f4eb81484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:29.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.847+0000 7f4ebdc60640 1 -- 172.21.15.45:0/2840359790 >> 172.21.15.45:0/2840359790 conn(0x7f4eb80a20d0 msgr2=0x7f4eb80bec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:29.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.847+0000 7f4ebdc60640 1 -- 172.21.15.45:0/2840359790 shutdown_connections 2023-10-03T19:21:29.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.847+0000 7f4ebdc60640 1 -- 172.21.15.45:0/2840359790 wait complete. 2023-10-03T19:21:29.867 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:21:29.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.995+0000 7f4c238a5640 1 Processor -- start 2023-10-03T19:21:29.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.995+0000 7f4c238a5640 1 -- start start 2023-10-03T19:21:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.995+0000 7f4c238a5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4c1c0c19b0 0x7f4c1c0bd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.995+0000 7f4c238a5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4c1c14fa20 0x7f4c1c14fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.995+0000 7f4c238a5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c1c0c14c0 con 0x7f4c1c0c07f0 2023-10-03T19:21:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.995+0000 7f4c238a5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1c0be420 con 0x7f4c1c0c19b0 2023-10-03T19:21:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.995+0000 7f4c238a5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1c0a1f80 con 0x7f4c1c14fa20 2023-10-03T19:21:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.995+0000 7f4c20e40640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4c1c0c19b0 0x7f4c1c0bd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.995+0000 7f4c20e40640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4c1c0c19b0 0x7f4c1c0bd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57802/0 (socket says 172.21.15.45:57802) 2023-10-03T19:21:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.995+0000 7f4c20e40640 1 -- 172.21.15.45:0/1588421121 learned_addr learned my addr 172.21.15.45:0/1588421121 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.995+0000 7f4c21e42640 1 --2- 172.21.15.45:0/1588421121 >> v2:172.21.15.79:3300/0 conn(0x7f4c1c14fa20 0x7f4c1c14fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:30.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.995+0000 7f4c20e40640 1 -- 172.21.15.45:0/1588421121 >> v2:172.21.15.79:3300/0 conn(0x7f4c1c14fa20 msgr2=0x7f4c1c14fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:30.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.995+0000 7f4c20e40640 1 --2- 172.21.15.45:0/1588421121 >> v2:172.21.15.79:3300/0 conn(0x7f4c1c14fa20 0x7f4c1c14fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.995+0000 7f4c20e40640 1 -- 172.21.15.45:0/1588421121 >> v1:172.21.15.79:6789/0 conn(0x7f4c1c0c07f0 legacy=0x7f4c1c14bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:30.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.995+0000 7f4c20e40640 1 -- 172.21.15.45:0/1588421121 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c0bd070 con 0x7f4c1c0c19b0 2023-10-03T19:21:30.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.995+0000 7f4c20e40640 1 --2- 172.21.15.45:0/1588421121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c1c0c19b0 0x7f4c1c0bd640 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c009870 tx=0x7f4c0c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c12b95f52472b35 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:30.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.999+0000 7f4c13fff640 1 -- 172.21.15.45:0/1588421121 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c0ab600 con 0x7f4c1c0c19b0 2023-10-03T19:21:30.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.999+0000 7f4c13fff640 1 -- 172.21.15.45:0/1588421121 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0c0ab760 con 0x7f4c1c0c19b0 2023-10-03T19:21:30.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.999+0000 7f4c13fff640 1 -- 172.21.15.45:0/1588421121 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c0abaf0 con 0x7f4c1c0c19b0 2023-10-03T19:21:30.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.999+0000 7f4c238a5640 1 -- 172.21.15.45:0/1588421121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c1c0c19b0 msgr2=0x7f4c1c0bd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:30.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.999+0000 7f4c238a5640 1 --2- 172.21.15.45:0/1588421121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c1c0c19b0 0x7f4c1c0bd640 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c009870 tx=0x7f4c0c01c400 comp rx=0 tx=0).stop 2023-10-03T19:21:30.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.999+0000 7f4c238a5640 1 -- 172.21.15.45:0/1588421121 shutdown_connections 2023-10-03T19:21:30.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.999+0000 7f4c238a5640 1 --2- 172.21.15.45:0/1588421121 >> v2:172.21.15.79:3300/0 conn(0x7f4c1c14fa20 0x7f4c1c14fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.999+0000 7f4c238a5640 1 --2- 172.21.15.45:0/1588421121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c1c0c19b0 0x7f4c1c0bd640 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.999+0000 7f4c238a5640 1 -- 172.21.15.45:0/1588421121 >> 172.21.15.45:0/1588421121 conn(0x7f4c1c0a4260 msgr2=0x7f4c1c0a4660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:30.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.999+0000 7f4c238a5640 1 -- 172.21.15.45:0/1588421121 shutdown_connections 2023-10-03T19:21:30.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.999+0000 7f4c238a5640 1 -- 172.21.15.45:0/1588421121 wait complete. 2023-10-03T19:21:30.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.999+0000 7f4c238a5640 1 Processor -- start 2023-10-03T19:21:30.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.999+0000 7f4c238a5640 1 -- start start 2023-10-03T19:21:30.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.999+0000 7f4c238a5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c1c0c07f0 0x7f4c1c1e7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:30.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.999+0000 7f4c238a5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c1c0c19b0 0x7f4c1c0a6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:30.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.999+0000 7f4c238a5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c1c14fa20 0x7f4c1c06e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:30.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.999+0000 7f4c238a5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c14b5b0 con 0x7f4c1c14fa20 2023-10-03T19:21:30.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.999+0000 7f4c238a5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0b76b0 con 0x7f4c1c0c19b0 2023-10-03T19:21:30.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.999+0000 7f4c238a5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c1460f0 con 0x7f4c1c0c07f0 2023-10-03T19:21:30.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.999+0000 7f4c21e42640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c1c14fa20 0x7f4c1c06e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:30.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.999+0000 7f4c21e42640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c1c14fa20 0x7f4c1c06e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57810/0 (socket says 172.21.15.45:57810) 2023-10-03T19:21:30.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.999+0000 7f4c21e42640 1 -- 172.21.15.45:0/293290967 learned_addr learned my addr 172.21.15.45:0/293290967 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:30.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.999+0000 7f4c21641640 1 --2- 172.21.15.45:0/293290967 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c1c0c07f0 0x7f4c1c1e7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:30.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.999+0000 7f4c20e40640 1 --2- 172.21.15.45:0/293290967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c1c0c19b0 0x7f4c1c0a6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:30.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.999+0000 7f4c21e42640 1 -- 172.21.15.45:0/293290967 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c1c0c07f0 msgr2=0x7f4c1c1e7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:30.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.999+0000 7f4c21e42640 1 --2- 172.21.15.45:0/293290967 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c1c0c07f0 0x7f4c1c1e7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.999+0000 7f4c21e42640 1 -- 172.21.15.45:0/293290967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c1c0c19b0 msgr2=0x7f4c1c0a6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:30.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.999+0000 7f4c21e42640 1 --2- 172.21.15.45:0/293290967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c1c0c19b0 0x7f4c1c0a6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.999+0000 7f4c21e42640 1 -- 172.21.15.45:0/293290967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0c0094d0 con 0x7f4c1c14fa20 2023-10-03T19:21:30.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:29.999+0000 7f4c21e42640 1 --2- 172.21.15.45:0/293290967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c1c14fa20 0x7f4c1c06e590 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f4c1400cda0 tx=0x7f4c1400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:30.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.003+0000 7f4c11ffb640 1 -- 172.21.15.45:0/293290967 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c14003ba0 con 0x7f4c1c14fa20 2023-10-03T19:21:30.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.003+0000 7f4c11ffb640 1 -- 172.21.15.45:0/293290967 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c14003d00 con 0x7f4c1c14fa20 2023-10-03T19:21:30.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.003+0000 7f4c11ffb640 1 -- 172.21.15.45:0/293290967 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c14004240 con 0x7f4c1c14fa20 2023-10-03T19:21:30.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.003+0000 7f4c238a5640 1 -- 172.21.15.45:0/293290967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c1c0c0d50 con 0x7f4c1c14fa20 2023-10-03T19:21:30.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.003+0000 7f4c238a5640 1 -- 172.21.15.45:0/293290967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c1c0c0bc0 con 0x7f4c1c14fa20 2023-10-03T19:21:30.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.003+0000 7f4c238a5640 1 -- 172.21.15.45:0/293290967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1c14c1c0 con 0x7f4c1c14fa20 2023-10-03T19:21:30.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.003+0000 7f4c11ffb640 1 -- 172.21.15.45:0/293290967 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4c140043a0 con 0x7f4c1c14fa20 2023-10-03T19:21:30.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.003+0000 7f4c11ffb640 1 --2- 172.21.15.45:0/293290967 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4c000662b0 0x7f4c00068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:30.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.003+0000 7f4c11ffb640 1 -- 172.21.15.45:0/293290967 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f4c14012070 con 0x7f4c1c14fa20 2023-10-03T19:21:30.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.003+0000 7f4c21641640 1 --2- 172.21.15.45:0/293290967 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4c000662b0 0x7f4c00068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:30.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.003+0000 7f4c21641640 1 --2- 172.21.15.45:0/293290967 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4c000662b0 0x7f4c00068760 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f4c180098e0 tx=0x7f4c18009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:30.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.007+0000 7f4c11ffb640 1 -- 172.21.15.45:0/293290967 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4c14051b50 con 0x7f4c1c14fa20 2023-10-03T19:21:30.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.163+0000 7f4c238a5640 1 -- 172.21.15.45:0/293290967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4c1c04de80 con 0x7f4c1c14fa20 2023-10-03T19:21:30.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.163+0000 7f4c11ffb640 1 -- 172.21.15.45:0/293290967 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v110) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4c14055170 con 0x7f4c1c14fa20 2023-10-03T19:21:30.167 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:21:30.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.163+0000 7f4c238a5640 1 -- 172.21.15.45:0/293290967 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4c000662b0 msgr2=0x7f4c00068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:30.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.163+0000 7f4c238a5640 1 --2- 172.21.15.45:0/293290967 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4c000662b0 0x7f4c00068760 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f4c180098e0 tx=0x7f4c18009060 comp rx=0 tx=0).stop 2023-10-03T19:21:30.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.163+0000 7f4c238a5640 1 -- 172.21.15.45:0/293290967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c1c14fa20 msgr2=0x7f4c1c06e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:30.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.163+0000 7f4c238a5640 1 --2- 172.21.15.45:0/293290967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c1c14fa20 0x7f4c1c06e590 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f4c1400cda0 tx=0x7f4c1400a660 comp rx=0 tx=0).stop 2023-10-03T19:21:30.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.163+0000 7f4c238a5640 1 -- 172.21.15.45:0/293290967 shutdown_connections 2023-10-03T19:21:30.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.163+0000 7f4c238a5640 1 --2- 172.21.15.45:0/293290967 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4c000662b0 0x7f4c00068760 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.163+0000 7f4c238a5640 1 --2- 172.21.15.45:0/293290967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c1c14fa20 0x7f4c1c06e590 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.163+0000 7f4c238a5640 1 --2- 172.21.15.45:0/293290967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c1c0c19b0 0x7f4c1c0a6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.163+0000 7f4c238a5640 1 --2- 172.21.15.45:0/293290967 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4c1c0c07f0 0x7f4c1c1e7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.163+0000 7f4c238a5640 1 -- 172.21.15.45:0/293290967 >> 172.21.15.45:0/293290967 conn(0x7f4c1c0a4260 msgr2=0x7f4c1c0a4630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:30.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.163+0000 7f4c238a5640 1 -- 172.21.15.45:0/293290967 shutdown_connections 2023-10-03T19:21:30.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.163+0000 7f4c238a5640 1 -- 172.21.15.45:0/293290967 wait complete. 2023-10-03T19:21:30.186 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T19:21:30.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.311+0000 7f6af861b640 1 Processor -- start 2023-10-03T19:21:30.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.311+0000 7f6af861b640 1 -- start start 2023-10-03T19:21:30.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.315+0000 7f6af861b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6af006f880 0x7f6af00a5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:30.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.315+0000 7f6af861b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6af014f080 con 0x7f6af014ba30 2023-10-03T19:21:30.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.315+0000 7f6af861b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6af0070e90 con 0x7f6af014f510 2023-10-03T19:21:30.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.315+0000 7f6af861b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af006f3e0 con 0x7f6af006f880 2023-10-03T19:21:30.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.315+0000 7f6af6bb8640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6af014ba30 0x7f6af0155bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37522/0 (socket says 172.21.15.45:37522) 2023-10-03T19:21:30.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.315+0000 7f6af6bb8640 1 -- 172.21.15.45:0/2873935688 learned_addr learned my addr 172.21.15.45:0/2873935688 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:21:30.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.315+0000 7f6af63b7640 1 --2- 172.21.15.45:0/2873935688 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6af006f880 0x7f6af00a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:30.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.315+0000 7f6af53b5640 1 -- 172.21.15.45:0/2873935688 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291155467 0 0) 0x7f6af014f080 con 0x7f6af014ba30 2023-10-03T19:21:30.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.315+0000 7f6af53b5640 1 -- 172.21.15.45:0/2873935688 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6adc003530 con 0x7f6af014ba30 2023-10-03T19:21:30.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.315+0000 7f6af53b5640 1 -- 172.21.15.45:0/2873935688 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 341840208 0 0) 0x7f6adc003530 con 0x7f6af014ba30 2023-10-03T19:21:30.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.315+0000 7f6af53b5640 1 -- 172.21.15.45:0/2873935688 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6af006f880 msgr2=0x7f6af00a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:30.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.315+0000 7f6af53b5640 1 --2- 172.21.15.45:0/2873935688 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6af006f880 0x7f6af00a5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.315+0000 7f6af53b5640 1 -- 172.21.15.45:0/2873935688 >> v1:172.21.15.79:6789/0 conn(0x7f6af014f510 legacy=0x7f6af014b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:30.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.315+0000 7f6af53b5640 1 -- 172.21.15.45:0/2873935688 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af014ea30 con 0x7f6af014ba30 2023-10-03T19:21:30.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.315+0000 7f6af53b5640 1 -- 172.21.15.45:0/2873935688 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f6ae8001a00 con 0x7f6af014ba30 2023-10-03T19:21:30.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.315+0000 7f6af53b5640 1 -- 172.21.15.45:0/2873935688 >> v1:172.21.15.45:6789/0 conn(0x7f6af014ba30 legacy=0x7f6af0155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:30.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.315+0000 7f6af53b5640 1 --2- 172.21.15.45:0/2873935688 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6af006f880 0x7f6adc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:30.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.315+0000 7f6af53b5640 1 --2- 172.21.15.45:0/2873935688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6adc003ef0 0x7f6adc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:30.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.315+0000 7f6af53b5640 1 --2- 172.21.15.45:0/2873935688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6adc004d10 0x7f6adc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:30.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.315+0000 7f6af53b5640 1 -- 172.21.15.45:0/2873935688 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af006f3e0 con 0x7f6adc004d10 2023-10-03T19:21:30.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.315+0000 7f6af53b5640 1 -- 172.21.15.45:0/2873935688 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc00b9c0 con 0x7f6adc003ef0 2023-10-03T19:21:30.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.315+0000 7f6af53b5640 1 -- 172.21.15.45:0/2873935688 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc00dd90 con 0x7f6af006f880 2023-10-03T19:21:30.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.315+0000 7f6af6bb8640 1 --2- 172.21.15.45:0/2873935688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6adc004d10 0x7f6adc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:30.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.315+0000 7f6af63b7640 1 --2- 172.21.15.45:0/2873935688 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6af006f880 0x7f6adc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:30.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.315+0000 7f6af5bb6640 1 --2- 172.21.15.45:0/2873935688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6adc003ef0 0x7f6adc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:30.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.315+0000 7f6af6bb8640 1 -- 172.21.15.45:0/2873935688 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6af006f880 msgr2=0x7f6adc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:30.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.315+0000 7f6af6bb8640 1 --2- 172.21.15.45:0/2873935688 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6af006f880 0x7f6adc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.315+0000 7f6af6bb8640 1 -- 172.21.15.45:0/2873935688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6adc003ef0 msgr2=0x7f6adc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:30.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.315+0000 7f6af6bb8640 1 --2- 172.21.15.45:0/2873935688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6adc003ef0 0x7f6adc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.315+0000 7f6af6bb8640 1 -- 172.21.15.45:0/2873935688 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc003530 con 0x7f6adc004d10 2023-10-03T19:21:30.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.319+0000 7f6af6bb8640 1 --2- 172.21.15.45:0/2873935688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6adc004d10 0x7f6adc005180 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f6ae800a840 tx=0x7f6ae801fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d890eed7c4210112 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:30.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.319+0000 7f6af53b5640 1 -- 172.21.15.45:0/2873935688 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae80aa6b0 con 0x7f6adc004d10 2023-10-03T19:21:30.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.319+0000 7f6af53b5640 1 -- 172.21.15.45:0/2873935688 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae80aa810 con 0x7f6adc004d10 2023-10-03T19:21:30.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.319+0000 7f6af53b5640 1 -- 172.21.15.45:0/2873935688 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae80aac00 con 0x7f6adc004d10 2023-10-03T19:21:30.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.319+0000 7f6af861b640 1 -- 172.21.15.45:0/2873935688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6adc004d10 msgr2=0x7f6adc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:30.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.319+0000 7f6af861b640 1 --2- 172.21.15.45:0/2873935688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6adc004d10 0x7f6adc005180 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f6ae800a840 tx=0x7f6ae801fa80 comp rx=0 tx=0).stop 2023-10-03T19:21:30.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.319+0000 7f6af6bb8640 1 -- 172.21.15.45:0/2873935688 reap_dead start 2023-10-03T19:21:30.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.319+0000 7f6af861b640 1 -- 172.21.15.45:0/2873935688 shutdown_connections 2023-10-03T19:21:30.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.319+0000 7f6af861b640 1 -- 172.21.15.45:0/2873935688 >> 172.21.15.45:0/2873935688 conn(0x7f6af00a20d0 msgr2=0x7f6af00a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:30.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.319+0000 7f6af861b640 1 -- 172.21.15.45:0/2873935688 shutdown_connections 2023-10-03T19:21:30.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.319+0000 7f6af861b640 1 -- 172.21.15.45:0/2873935688 wait complete. 2023-10-03T19:21:30.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.319+0000 7f6af861b640 1 Processor -- start 2023-10-03T19:21:30.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.319+0000 7f6af861b640 1 -- start start 2023-10-03T19:21:30.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.319+0000 7f6af861b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6adc004d10 0x7f6af00b99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:30.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.319+0000 7f6af861b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6af00bea00 0x7f6af0144690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:30.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.319+0000 7f6af861b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6af0144bd0 0x7f6af01e6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:30.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.319+0000 7f6af861b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af0145580 con 0x7f6af00bea00 2023-10-03T19:21:30.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.319+0000 7f6af861b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af00b9ef0 con 0x7f6adc004d10 2023-10-03T19:21:30.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.319+0000 7f6af861b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af0145040 con 0x7f6af0144bd0 2023-10-03T19:21:30.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.319+0000 7f6af5bb6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6af00bea00 0x7f6af0144690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:30.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.319+0000 7f6af5bb6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6af00bea00 0x7f6af0144690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57840/0 (socket says 172.21.15.45:57840) 2023-10-03T19:21:30.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.319+0000 7f6af5bb6640 1 -- 172.21.15.45:0/2438601426 learned_addr learned my addr 172.21.15.45:0/2438601426 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:30.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.319+0000 7f6af63b7640 1 --2- 172.21.15.45:0/2438601426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6adc004d10 0x7f6af00b99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:30.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.319+0000 7f6af6bb8640 1 --2- 172.21.15.45:0/2438601426 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6af0144bd0 0x7f6af01e6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:30.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.319+0000 7f6af5bb6640 1 -- 172.21.15.45:0/2438601426 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6af0144bd0 msgr2=0x7f6af01e6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:30.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.319+0000 7f6af5bb6640 1 --2- 172.21.15.45:0/2438601426 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6af0144bd0 0x7f6af01e6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.319+0000 7f6af5bb6640 1 -- 172.21.15.45:0/2438601426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6adc004d10 msgr2=0x7f6af00b99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:30.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.319+0000 7f6af5bb6640 1 --2- 172.21.15.45:0/2438601426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6adc004d10 0x7f6af00b99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.319+0000 7f6af5bb6640 1 -- 172.21.15.45:0/2438601426 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af006f070 con 0x7f6af00bea00 2023-10-03T19:21:30.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.323+0000 7f6af5bb6640 1 --2- 172.21.15.45:0/2438601426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6af00bea00 0x7f6af0144690 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000f750 tx=0x7f6ae000fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:30.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.323+0000 7f6ae6ffd640 1 -- 172.21.15.45:0/2438601426 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae000fe60 con 0x7f6af00bea00 2023-10-03T19:21:30.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.323+0000 7f6ae6ffd640 1 -- 172.21.15.45:0/2438601426 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae00052e0 con 0x7f6af00bea00 2023-10-03T19:21:30.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.323+0000 7f6af861b640 1 -- 172.21.15.45:0/2438601426 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6af014ed10 con 0x7f6af00bea00 2023-10-03T19:21:30.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.323+0000 7f6ae6ffd640 1 -- 172.21.15.45:0/2438601426 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae000d970 con 0x7f6af00bea00 2023-10-03T19:21:30.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.323+0000 7f6af861b640 1 -- 172.21.15.45:0/2438601426 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6af006fc50 con 0x7f6af00bea00 2023-10-03T19:21:30.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.323+0000 7f6af861b640 1 -- 172.21.15.45:0/2438601426 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6af01466d0 con 0x7f6af00bea00 2023-10-03T19:21:30.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.323+0000 7f6ae6ffd640 1 -- 172.21.15.45:0/2438601426 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6ae000dad0 con 0x7f6af00bea00 2023-10-03T19:21:30.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.323+0000 7f6ae6ffd640 1 --2- 172.21.15.45:0/2438601426 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6ad4066280 0x7f6ad4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:30.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.323+0000 7f6ae6ffd640 1 -- 172.21.15.45:0/2438601426 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f6ae0083de0 con 0x7f6af00bea00 2023-10-03T19:21:30.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.323+0000 7f6af63b7640 1 --2- 172.21.15.45:0/2438601426 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6ad4066280 0x7f6ad4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:30.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.323+0000 7f6af63b7640 1 --2- 172.21.15.45:0/2438601426 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6ad4066280 0x7f6ad4068730 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f6aec009b20 tx=0x7f6aec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:30.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.327+0000 7f6ae6ffd640 1 -- 172.21.15.45:0/2438601426 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6af01466d0 con 0x7f6af00bea00 2023-10-03T19:21:30.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.479+0000 7f6af861b640 1 -- 172.21.15.45:0/2438601426 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6af01466d0 con 0x7f6af00bea00 2023-10-03T19:21:30.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.479+0000 7f6ae6ffd640 1 -- 172.21.15.45:0/2438601426 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v110) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6af01466d0 con 0x7f6af00bea00 2023-10-03T19:21:30.483 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-03T19:21:30.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.483+0000 7f6af861b640 1 -- 172.21.15.45:0/2438601426 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6ad4066280 msgr2=0x7f6ad4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:30.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.483+0000 7f6af861b640 1 --2- 172.21.15.45:0/2438601426 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6ad4066280 0x7f6ad4068730 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f6aec009b20 tx=0x7f6aec008040 comp rx=0 tx=0).stop 2023-10-03T19:21:30.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.483+0000 7f6af861b640 1 -- 172.21.15.45:0/2438601426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6af00bea00 msgr2=0x7f6af0144690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:30.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.483+0000 7f6af861b640 1 --2- 172.21.15.45:0/2438601426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6af00bea00 0x7f6af0144690 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000f750 tx=0x7f6ae000fc10 comp rx=0 tx=0).stop 2023-10-03T19:21:30.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.483+0000 7f6af861b640 1 -- 172.21.15.45:0/2438601426 shutdown_connections 2023-10-03T19:21:30.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.483+0000 7f6af861b640 1 --2- 172.21.15.45:0/2438601426 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6ad4066280 0x7f6ad4068730 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.483+0000 7f6af861b640 1 --2- 172.21.15.45:0/2438601426 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6af0144bd0 0x7f6af01e6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.483+0000 7f6af861b640 1 --2- 172.21.15.45:0/2438601426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6af00bea00 0x7f6af0144690 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.483+0000 7f6af861b640 1 --2- 172.21.15.45:0/2438601426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6adc004d10 0x7f6af00b99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.483+0000 7f6af861b640 1 -- 172.21.15.45:0/2438601426 >> 172.21.15.45:0/2438601426 conn(0x7f6af00a20d0 msgr2=0x7f6af00bd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:30.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.483+0000 7f6af861b640 1 -- 172.21.15.45:0/2438601426 shutdown_connections 2023-10-03T19:21:30.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.483+0000 7f6af861b640 1 -- 172.21.15.45:0/2438601426 wait complete. 2023-10-03T19:21:30.501 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T19:21:30.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.623+0000 7f645456e640 1 Processor -- start 2023-10-03T19:21:30.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.623+0000 7f645456e640 1 -- start start 2023-10-03T19:21:30.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.623+0000 7f645456e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f644c0712c0 0x7f644c0bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:30.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.623+0000 7f645456e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f644c06d560 0x7f644c0bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:30.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.623+0000 7f645456e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f644c06c2d0 con 0x7f644c06c760 2023-10-03T19:21:30.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.623+0000 7f645456e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f644c150610 con 0x7f644c06d560 2023-10-03T19:21:30.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.623+0000 7f645456e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644c1508b0 con 0x7f644c0712c0 2023-10-03T19:21:30.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.623+0000 7f645230a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f644c0712c0 0x7f644c0bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:30.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.623+0000 7f6451b09640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f644c06d560 0x7f644c0bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:30.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.623+0000 7f645230a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f644c0712c0 0x7f644c0bcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:38860/0 (socket says 172.21.15.45:38860) 2023-10-03T19:21:30.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.623+0000 7f645230a640 1 -- 172.21.15.45:0/1402617084 learned_addr learned my addr 172.21.15.45:0/1402617084 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:30.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.623+0000 7f645230a640 1 -- 172.21.15.45:0/1402617084 >> v2:172.21.15.79:3300/0 conn(0x7f644c06d560 msgr2=0x7f644c0bd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:30.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.623+0000 7f645230a640 1 --2- 172.21.15.45:0/1402617084 >> v2:172.21.15.79:3300/0 conn(0x7f644c06d560 0x7f644c0bd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.623+0000 7f645230a640 1 -- 172.21.15.45:0/1402617084 >> v1:172.21.15.79:6789/0 conn(0x7f644c06c760 legacy=0x7f644c0a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:30.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.623+0000 7f645230a640 1 -- 172.21.15.45:0/1402617084 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644c06d2e0 con 0x7f644c0712c0 2023-10-03T19:21:30.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.623+0000 7f6451b09640 1 --2- 172.21.15.45:0/1402617084 >> v2:172.21.15.79:3300/0 conn(0x7f644c06d560 0x7f644c0bd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:21:30.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.627+0000 7f645230a640 1 --2- 172.21.15.45:0/1402617084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f644c0712c0 0x7f644c0bcbc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f643c009870 tx=0x7f643c01c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5f066dc7c244f3c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:30.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.627+0000 7f6451308640 1 -- 172.21.15.45:0/1402617084 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c0ab680 con 0x7f644c0712c0 2023-10-03T19:21:30.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.627+0000 7f6451308640 1 -- 172.21.15.45:0/1402617084 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643c0ab7e0 con 0x7f644c0712c0 2023-10-03T19:21:30.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.627+0000 7f6451308640 1 -- 172.21.15.45:0/1402617084 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c0abb70 con 0x7f644c0712c0 2023-10-03T19:21:30.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.627+0000 7f645456e640 1 -- 172.21.15.45:0/1402617084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f644c0712c0 msgr2=0x7f644c0bcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:30.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.627+0000 7f645456e640 1 --2- 172.21.15.45:0/1402617084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f644c0712c0 0x7f644c0bcbc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f643c009870 tx=0x7f643c01c540 comp rx=0 tx=0).stop 2023-10-03T19:21:30.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.627+0000 7f645456e640 1 -- 172.21.15.45:0/1402617084 shutdown_connections 2023-10-03T19:21:30.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.627+0000 7f645456e640 1 --2- 172.21.15.45:0/1402617084 >> v2:172.21.15.79:3300/0 conn(0x7f644c06d560 0x7f644c0bd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.627+0000 7f645456e640 1 --2- 172.21.15.45:0/1402617084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f644c0712c0 0x7f644c0bcbc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.627+0000 7f645456e640 1 -- 172.21.15.45:0/1402617084 >> 172.21.15.45:0/1402617084 conn(0x7f644c0a20d0 msgr2=0x7f644c0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:30.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.627+0000 7f645456e640 1 -- 172.21.15.45:0/1402617084 shutdown_connections 2023-10-03T19:21:30.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.627+0000 7f645456e640 1 -- 172.21.15.45:0/1402617084 wait complete. 2023-10-03T19:21:30.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.627+0000 7f645456e640 1 Processor -- start 2023-10-03T19:21:30.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.627+0000 7f645456e640 1 -- start start 2023-10-03T19:21:30.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.627+0000 7f645456e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f644c06c760 0x7f644c0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:30.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.627+0000 7f645456e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f644c06d560 0x7f644c14f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:30.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.627+0000 7f645456e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f644c0712c0 0x7f644c1416d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:30.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.627+0000 7f645456e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644c070660 con 0x7f644c06d560 2023-10-03T19:21:30.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.627+0000 7f645456e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644c070210 con 0x7f644c0712c0 2023-10-03T19:21:30.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.627+0000 7f645456e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644c070e40 con 0x7f644c06c760 2023-10-03T19:21:30.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.627+0000 7f6451b09640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f644c06d560 0x7f644c14f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:30.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.627+0000 7f6451b09640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f644c06d560 0x7f644c14f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57844/0 (socket says 172.21.15.45:57844) 2023-10-03T19:21:30.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.627+0000 7f6451b09640 1 -- 172.21.15.45:0/725845506 learned_addr learned my addr 172.21.15.45:0/725845506 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:30.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.627+0000 7f645230a640 1 --2- 172.21.15.45:0/725845506 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f644c06c760 0x7f644c0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:30.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.627+0000 7f6452b0b640 1 --2- 172.21.15.45:0/725845506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f644c0712c0 0x7f644c1416d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:30.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.631+0000 7f6451b09640 1 -- 172.21.15.45:0/725845506 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f644c06c760 msgr2=0x7f644c0707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:30.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.631+0000 7f6451b09640 1 --2- 172.21.15.45:0/725845506 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f644c06c760 0x7f644c0707d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.631+0000 7f6451b09640 1 -- 172.21.15.45:0/725845506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f644c0712c0 msgr2=0x7f644c1416d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:30.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.631+0000 7f6451b09640 1 --2- 172.21.15.45:0/725845506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f644c0712c0 0x7f644c1416d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.631+0000 7f6451b09640 1 -- 172.21.15.45:0/725845506 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6448009420 con 0x7f644c06d560 2023-10-03T19:21:30.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.631+0000 7f6452b0b640 1 --2- 172.21.15.45:0/725845506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f644c0712c0 0x7f644c1416d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:21:30.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.631+0000 7f6451b09640 1 --2- 172.21.15.45:0/725845506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f644c06d560 0x7f644c14f1b0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f644800ebe0 tx=0x7f644800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:30.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.631+0000 7f6442ffd640 1 -- 172.21.15.45:0/725845506 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644800eee0 con 0x7f644c06d560 2023-10-03T19:21:30.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.631+0000 7f6442ffd640 1 -- 172.21.15.45:0/725845506 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644800cbd0 con 0x7f644c06d560 2023-10-03T19:21:30.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.631+0000 7f645456e640 1 -- 172.21.15.45:0/725845506 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f643c0094d0 con 0x7f644c06d560 2023-10-03T19:21:30.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.631+0000 7f6442ffd640 1 -- 172.21.15.45:0/725845506 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6448013470 con 0x7f644c06d560 2023-10-03T19:21:30.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.631+0000 7f645456e640 1 -- 172.21.15.45:0/725845506 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f644c0a6070 con 0x7f644c06d560 2023-10-03T19:21:30.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.631+0000 7f645456e640 1 -- 172.21.15.45:0/725845506 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f644c0a5ee0 con 0x7f644c06d560 2023-10-03T19:21:30.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.631+0000 7f6442ffd640 1 -- 172.21.15.45:0/725845506 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f64480135d0 con 0x7f644c06d560 2023-10-03T19:21:30.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.631+0000 7f6442ffd640 1 --2- 172.21.15.45:0/725845506 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6430066280 0x7f6430068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:30.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.631+0000 7f6442ffd640 1 -- 172.21.15.45:0/725845506 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f64480846c0 con 0x7f644c06d560 2023-10-03T19:21:30.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.631+0000 7f645230a640 1 --2- 172.21.15.45:0/725845506 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6430066280 0x7f6430068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:30.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.631+0000 7f645230a640 1 --2- 172.21.15.45:0/725845506 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6430066280 0x7f6430068730 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f643c0af000 tx=0x7f643c0b6040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:30.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.635+0000 7f6442ffd640 1 -- 172.21.15.45:0/725845506 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6448051d30 con 0x7f644c06d560 2023-10-03T19:21:30.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.787+0000 7f645456e640 1 -- 172.21.15.45:0/725845506 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f644c0704b0 con 0x7f644c06d560 2023-10-03T19:21:30.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.791+0000 7f6442ffd640 1 -- 172.21.15.45:0/725845506 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v110) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6448055350 con 0x7f644c06d560 2023-10-03T19:21:30.794 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-03T19:21:30.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.791+0000 7f645456e640 1 -- 172.21.15.45:0/725845506 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6430066280 msgr2=0x7f6430068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:30.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.791+0000 7f645456e640 1 --2- 172.21.15.45:0/725845506 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6430066280 0x7f6430068730 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f643c0af000 tx=0x7f643c0b6040 comp rx=0 tx=0).stop 2023-10-03T19:21:30.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.791+0000 7f645456e640 1 -- 172.21.15.45:0/725845506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f644c06d560 msgr2=0x7f644c14f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:30.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.791+0000 7f645456e640 1 --2- 172.21.15.45:0/725845506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f644c06d560 0x7f644c14f1b0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f644800ebe0 tx=0x7f644800c520 comp rx=0 tx=0).stop 2023-10-03T19:21:30.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.791+0000 7f645456e640 1 -- 172.21.15.45:0/725845506 shutdown_connections 2023-10-03T19:21:30.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.791+0000 7f645456e640 1 --2- 172.21.15.45:0/725845506 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6430066280 0x7f6430068730 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.791+0000 7f645456e640 1 --2- 172.21.15.45:0/725845506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f644c0712c0 0x7f644c1416d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.791+0000 7f645456e640 1 --2- 172.21.15.45:0/725845506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f644c06d560 0x7f644c14f1b0 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.791+0000 7f645456e640 1 --2- 172.21.15.45:0/725845506 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f644c06c760 0x7f644c0707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.791+0000 7f645456e640 1 -- 172.21.15.45:0/725845506 >> 172.21.15.45:0/725845506 conn(0x7f644c0a20d0 msgr2=0x7f644c14d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:30.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.791+0000 7f645456e640 1 -- 172.21.15.45:0/725845506 shutdown_connections 2023-10-03T19:21:30.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.791+0000 7f645456e640 1 -- 172.21.15.45:0/725845506 wait complete. 2023-10-03T19:21:30.813 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-03T19:21:30.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.931+0000 7fbd78c8c640 1 Processor -- start 2023-10-03T19:21:30.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.931+0000 7fbd78c8c640 1 -- start start 2023-10-03T19:21:30.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.931+0000 7fbd78c8c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd740c5530 0x7fbd740a9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:30.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.931+0000 7fbd78c8c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbd740bf200 0x7fbd740a9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:30.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.931+0000 7fbd78c8c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd7414f120 con 0x7fbd740c5160 2023-10-03T19:21:30.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.931+0000 7fbd78c8c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd7414f650 con 0x7fbd740bf200 2023-10-03T19:21:30.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.931+0000 7fbd78c8c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd740aa430 con 0x7fbd740c5530 2023-10-03T19:21:30.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.931+0000 7fbd71d9b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd740c5530 0x7fbd740a9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:30.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.931+0000 7fbd71d9b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd740c5530 0x7fbd740a9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:38880/0 (socket says 172.21.15.45:38880) 2023-10-03T19:21:30.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.931+0000 7fbd71d9b640 1 -- 172.21.15.45:0/3529809413 learned_addr learned my addr 172.21.15.45:0/3529809413 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:30.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.931+0000 7fbd7259c640 1 --1- 172.21.15.45:0/3529809413 >> v1:172.21.15.79:6789/0 conn(0x7fbd740c5160 0x7fbd74069ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:36786/0 (socket says 172.21.15.45:36786) 2023-10-03T19:21:30.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.931+0000 7fbd72d9d640 1 --2- 172.21.15.45:0/3529809413 >> v2:172.21.15.79:3300/0 conn(0x7fbd740bf200 0x7fbd740a9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:30.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.931+0000 7fbd7159a640 1 -- 172.21.15.45:0/3529809413 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707058097 0 0) 0x7fbd7414f120 con 0x7fbd740c5160 2023-10-03T19:21:30.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.931+0000 7fbd7159a640 1 -- 172.21.15.45:0/3529809413 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd5c003530 con 0x7fbd740c5160 2023-10-03T19:21:30.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.931+0000 7fbd71d9b640 1 -- 172.21.15.45:0/3529809413 >> v2:172.21.15.79:3300/0 conn(0x7fbd740bf200 msgr2=0x7fbd740a9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:30.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.931+0000 7fbd71d9b640 1 --2- 172.21.15.45:0/3529809413 >> v2:172.21.15.79:3300/0 conn(0x7fbd740bf200 0x7fbd740a9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.931+0000 7fbd71d9b640 1 -- 172.21.15.45:0/3529809413 >> v1:172.21.15.79:6789/0 conn(0x7fbd740c5160 legacy=0x7fbd74069ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:30.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.935+0000 7fbd71d9b640 1 -- 172.21.15.45:0/3529809413 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7414f370 con 0x7fbd740c5530 2023-10-03T19:21:30.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.935+0000 7fbd72d9d640 1 --2- 172.21.15.45:0/3529809413 >> v2:172.21.15.79:3300/0 conn(0x7fbd740bf200 0x7fbd740a9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:21:30.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.935+0000 7fbd71d9b640 1 --2- 172.21.15.45:0/3529809413 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd740c5530 0x7fbd740a9850 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbd68009870 tx=0x7fbd6801c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c820e094ac850bc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:30.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.935+0000 7fbd7159a640 1 -- 172.21.15.45:0/3529809413 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7406b7a0 con 0x7fbd740c5530 2023-10-03T19:21:30.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.935+0000 7fbd7159a640 1 -- 172.21.15.45:0/3529809413 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd680ac620 con 0x7fbd740c5530 2023-10-03T19:21:30.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.935+0000 7fbd7159a640 1 -- 172.21.15.45:0/3529809413 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd680ac990 con 0x7fbd740c5530 2023-10-03T19:21:30.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.935+0000 7fbd78c8c640 1 -- 172.21.15.45:0/3529809413 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd740c5530 msgr2=0x7fbd740a9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:30.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.935+0000 7fbd78c8c640 1 --2- 172.21.15.45:0/3529809413 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd740c5530 0x7fbd740a9850 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbd68009870 tx=0x7fbd6801c4b0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.935+0000 7fbd78c8c640 1 -- 172.21.15.45:0/3529809413 shutdown_connections 2023-10-03T19:21:30.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.935+0000 7fbd78c8c640 1 --2- 172.21.15.45:0/3529809413 >> v2:172.21.15.79:3300/0 conn(0x7fbd740bf200 0x7fbd740a9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.935+0000 7fbd78c8c640 1 --2- 172.21.15.45:0/3529809413 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd740c5530 0x7fbd740a9850 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.935+0000 7fbd78c8c640 1 -- 172.21.15.45:0/3529809413 >> 172.21.15.45:0/3529809413 conn(0x7fbd740a7080 msgr2=0x7fbd740c4880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:30.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.935+0000 7fbd78c8c640 1 -- 172.21.15.45:0/3529809413 shutdown_connections 2023-10-03T19:21:30.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.935+0000 7fbd78c8c640 1 -- 172.21.15.45:0/3529809413 wait complete. 2023-10-03T19:21:30.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.939+0000 7fbd78c8c640 1 Processor -- start 2023-10-03T19:21:30.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.939+0000 7fbd78c8c640 1 -- start start 2023-10-03T19:21:30.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.939+0000 7fbd78c8c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd740bf200 0x7fbd740bd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:30.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.939+0000 7fbd78c8c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd740c5160 0x7fbd740a8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:30.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.939+0000 7fbd78c8c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd740ba100 0x7fbd740a89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:30.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.939+0000 7fbd78c8c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd740be160 con 0x7fbd740bf200 2023-10-03T19:21:30.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.939+0000 7fbd78c8c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd740bdbe0 con 0x7fbd740c5160 2023-10-03T19:21:30.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.939+0000 7fbd78c8c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd740a8ee0 con 0x7fbd740ba100 2023-10-03T19:21:30.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.939+0000 7fbd7259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd740bf200 0x7fbd740bd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:30.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.939+0000 7fbd7259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd740bf200 0x7fbd740bd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57848/0 (socket says 172.21.15.45:57848) 2023-10-03T19:21:30.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.939+0000 7fbd7259c640 1 -- 172.21.15.45:0/1042104170 learned_addr learned my addr 172.21.15.45:0/1042104170 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:30.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.939+0000 7fbd72d9d640 1 --2- 172.21.15.45:0/1042104170 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd740ba100 0x7fbd740a89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:30.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.939+0000 7fbd71d9b640 1 --2- 172.21.15.45:0/1042104170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd740c5160 0x7fbd740a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:30.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.939+0000 7fbd7259c640 1 -- 172.21.15.45:0/1042104170 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd740ba100 msgr2=0x7fbd740a89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:30.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.939+0000 7fbd7259c640 1 --2- 172.21.15.45:0/1042104170 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd740ba100 0x7fbd740a89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.939+0000 7fbd7259c640 1 -- 172.21.15.45:0/1042104170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd740c5160 msgr2=0x7fbd740a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:30.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.939+0000 7fbd7259c640 1 --2- 172.21.15.45:0/1042104170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd740c5160 0x7fbd740a8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:30.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.939+0000 7fbd7259c640 1 -- 172.21.15.45:0/1042104170 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6c009a70 con 0x7fbd740bf200 2023-10-03T19:21:30.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.939+0000 7fbd7259c640 1 --2- 172.21.15.45:0/1042104170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd740bf200 0x7fbd740bd560 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fbd6400c430 tx=0x7fbd6400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:30.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.939+0000 7fbd62ffd640 1 -- 172.21.15.45:0/1042104170 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd640074e0 con 0x7fbd740bf200 2023-10-03T19:21:30.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.939+0000 7fbd62ffd640 1 -- 172.21.15.45:0/1042104170 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd64007660 con 0x7fbd740bf200 2023-10-03T19:21:30.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.939+0000 7fbd78c8c640 1 -- 172.21.15.45:0/1042104170 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd680094d0 con 0x7fbd740bf200 2023-10-03T19:21:30.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.939+0000 7fbd62ffd640 1 -- 172.21.15.45:0/1042104170 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd64004a30 con 0x7fbd740bf200 2023-10-03T19:21:30.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.939+0000 7fbd78c8c640 1 -- 172.21.15.45:0/1042104170 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd740c4640 con 0x7fbd740bf200 2023-10-03T19:21:30.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.939+0000 7fbd78c8c640 1 -- 172.21.15.45:0/1042104170 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd740c44b0 con 0x7fbd740bf200 2023-10-03T19:21:30.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.939+0000 7fbd62ffd640 1 -- 172.21.15.45:0/1042104170 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbd64004b90 con 0x7fbd740bf200 2023-10-03T19:21:30.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.943+0000 7fbd62ffd640 1 --2- 172.21.15.45:0/1042104170 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbd54066280 0x7fbd54068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:30.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.943+0000 7fbd62ffd640 1 -- 172.21.15.45:0/1042104170 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fbd64083850 con 0x7fbd740bf200 2023-10-03T19:21:30.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.943+0000 7fbd71d9b640 1 --2- 172.21.15.45:0/1042104170 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbd54066280 0x7fbd54068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:30.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.943+0000 7fbd71d9b640 1 --2- 172.21.15.45:0/1042104170 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbd54066280 0x7fbd54068730 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fbd680ae000 tx=0x7fbd68009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:30.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:30.947+0000 7fbd62ffd640 1 -- 172.21.15.45:0/1042104170 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbd64050ca0 con 0x7fbd740bf200 2023-10-03T19:21:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.107+0000 7fbd78c8c640 1 -- 172.21.15.45:0/1042104170 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbd740bfcb0 con 0x7fbd740bf200 2023-10-03T19:21:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.107+0000 7fbd62ffd640 1 -- 172.21.15.45:0/1042104170 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v110) v1 ==== 80+0+59 (secure 0 0 0) 0x7fbd640542c0 con 0x7fbd740bf200 2023-10-03T19:21:31.111 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.146:0/2294298422 2023-10-03T20:20:34.239894+0000 2023-10-03T19:21:31.111 INFO:teuthology.orchestra.run.smithi045.stderr:listed 1 entries 2023-10-03T19:21:31.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.107+0000 7fbd78c8c640 1 -- 172.21.15.45:0/1042104170 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbd54066280 msgr2=0x7fbd54068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:31.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.107+0000 7fbd78c8c640 1 --2- 172.21.15.45:0/1042104170 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbd54066280 0x7fbd54068730 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fbd680ae000 tx=0x7fbd68009040 comp rx=0 tx=0).stop 2023-10-03T19:21:31.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.107+0000 7fbd78c8c640 1 -- 172.21.15.45:0/1042104170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd740bf200 msgr2=0x7fbd740bd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:31.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.107+0000 7fbd78c8c640 1 --2- 172.21.15.45:0/1042104170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd740bf200 0x7fbd740bd560 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fbd6400c430 tx=0x7fbd6400c8f0 comp rx=0 tx=0).stop 2023-10-03T19:21:31.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.107+0000 7fbd78c8c640 1 -- 172.21.15.45:0/1042104170 shutdown_connections 2023-10-03T19:21:31.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.107+0000 7fbd78c8c640 1 --2- 172.21.15.45:0/1042104170 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fbd54066280 0x7fbd54068730 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:31.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.107+0000 7fbd78c8c640 1 --2- 172.21.15.45:0/1042104170 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbd740ba100 0x7fbd740a89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:31.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.107+0000 7fbd78c8c640 1 --2- 172.21.15.45:0/1042104170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd740c5160 0x7fbd740a8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:31.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.107+0000 7fbd78c8c640 1 --2- 172.21.15.45:0/1042104170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd740bf200 0x7fbd740bd560 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:31.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.107+0000 7fbd78c8c640 1 -- 172.21.15.45:0/1042104170 >> 172.21.15.45:0/1042104170 conn(0x7fbd740a7080 msgr2=0x7fbd740c4860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:31.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.107+0000 7fbd78c8c640 1 -- 172.21.15.45:0/1042104170 shutdown_connections 2023-10-03T19:21:31.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.107+0000 7fbd78c8c640 1 -- 172.21.15.45:0/1042104170 wait complete. 2023-10-03T19:21:31.128 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi172.front.sepia.ceph.com... 2023-10-03T19:21:31.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:21:31.128 DEBUG:teuthology.orchestra.run.smithi172:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-03T19:21:31.141 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi172.stderr:ceph-fuse[33514]: fuse finished with error 0 and tester_r 0 2023-10-03T19:21:31.142 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2023-10-03T19:21:31.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:21:31.142 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-03T19:21:31.306 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:21:31.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.427+0000 7f78210dd640 1 Processor -- start 2023-10-03T19:21:31.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.427+0000 7f78210dd640 1 -- start start 2023-10-03T19:21:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f78210dd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f781c06f170 0x7f781c150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f78210dd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f781c0bc8b0 0x7f781c14ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f78210dd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f781c06cac0 con 0x7f781c06d170 2023-10-03T19:21:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f78210dd640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f781c0720d0 con 0x7f781c0bc8b0 2023-10-03T19:21:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f78210dd640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781c0a5ab0 con 0x7f781c06f170 2023-10-03T19:21:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f781b59e640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f781c06d170 0x7f781c14cfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37524/0 (socket says 172.21.15.45:37524) 2023-10-03T19:21:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f781b59e640 1 -- 172.21.15.45:0/2456510939 learned_addr learned my addr 172.21.15.45:0/2456510939 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:21:31.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f781ad9d640 1 --2- 172.21.15.45:0/2456510939 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f781c06f170 0x7f781c150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:31.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f7819d9b640 1 -- 172.21.15.45:0/2456510939 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038761711 0 0) 0x7f7814001120 con 0x7f781c06d170 2023-10-03T19:21:31.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f781a59c640 1 --2- 172.21.15.45:0/2456510939 >> v2:172.21.15.79:3300/0 conn(0x7f781c0bc8b0 0x7f781c14ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:31.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f7819d9b640 1 -- 172.21.15.45:0/2456510939 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7808003530 con 0x7f781c06d170 2023-10-03T19:21:31.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f7819d9b640 1 -- 172.21.15.45:0/2456510939 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4151380524 0 0) 0x7f7808003530 con 0x7f781c06d170 2023-10-03T19:21:31.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f7819d9b640 1 -- 172.21.15.45:0/2456510939 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f781c06f170 msgr2=0x7f781c150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:31.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f7819d9b640 1 --2- 172.21.15.45:0/2456510939 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f781c06f170 0x7f781c150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:31.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f7819d9b640 1 -- 172.21.15.45:0/2456510939 >> v2:172.21.15.79:3300/0 conn(0x7f781c0bc8b0 msgr2=0x7f781c14ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:31.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f7819d9b640 1 --2- 172.21.15.45:0/2456510939 >> v2:172.21.15.79:3300/0 conn(0x7f781c0bc8b0 0x7f781c14ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:31.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f7819d9b640 1 -- 172.21.15.45:0/2456510939 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c06cd00 con 0x7f781c06d170 2023-10-03T19:21:31.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f7819d9b640 1 -- 172.21.15.45:0/2456510939 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f7814001810 con 0x7f781c06d170 2023-10-03T19:21:31.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f7819d9b640 1 -- 172.21.15.45:0/2456510939 >> v1:172.21.15.45:6789/0 conn(0x7f781c06d170 legacy=0x7f781c14cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:31.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f7819d9b640 1 --2- 172.21.15.45:0/2456510939 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f781c06f170 0x7f7808003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:31.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f7819d9b640 1 --2- 172.21.15.45:0/2456510939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7808003f00 0x7f78080047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:31.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f7819d9b640 1 --2- 172.21.15.45:0/2456510939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7808004d10 0x7f7808005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:31.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f7819d9b640 1 -- 172.21.15.45:0/2456510939 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781c0720d0 con 0x7f7808004d10 2023-10-03T19:21:31.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f7819d9b640 1 -- 172.21.15.45:0/2456510939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781c0a5ab0 con 0x7f7808003f00 2023-10-03T19:21:31.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f7819d9b640 1 -- 172.21.15.45:0/2456510939 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780800b9c0 con 0x7f781c06f170 2023-10-03T19:21:31.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f781b59e640 1 --2- 172.21.15.45:0/2456510939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7808004d10 0x7f7808005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:31.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f781ad9d640 1 --2- 172.21.15.45:0/2456510939 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f781c06f170 0x7f7808003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:31.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f781a59c640 1 --2- 172.21.15.45:0/2456510939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7808003f00 0x7f78080047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:31.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f781b59e640 1 -- 172.21.15.45:0/2456510939 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f781c06f170 msgr2=0x7f7808003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:31.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f781b59e640 1 --2- 172.21.15.45:0/2456510939 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f781c06f170 0x7f7808003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:31.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f781b59e640 1 -- 172.21.15.45:0/2456510939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7808003f00 msgr2=0x7f78080047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:31.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f781b59e640 1 --2- 172.21.15.45:0/2456510939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7808003f00 0x7f78080047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:31.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.431+0000 7f781b59e640 1 -- 172.21.15.45:0/2456510939 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7808003530 con 0x7f7808004d10 2023-10-03T19:21:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f781b59e640 1 --2- 172.21.15.45:0/2456510939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7808004d10 0x7f7808005180 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f781400c210 tx=0x7f781401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0da41902eca3ca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f7819d9b640 1 -- 172.21.15.45:0/2456510939 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78140a5940 con 0x7f7808004d10 2023-10-03T19:21:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f7819d9b640 1 -- 172.21.15.45:0/2456510939 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78140a5aa0 con 0x7f7808004d10 2023-10-03T19:21:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f7819d9b640 1 -- 172.21.15.45:0/2456510939 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78140a5e50 con 0x7f7808004d10 2023-10-03T19:21:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f78210dd640 1 -- 172.21.15.45:0/2456510939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7808004d10 msgr2=0x7f7808005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f78210dd640 1 --2- 172.21.15.45:0/2456510939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7808004d10 0x7f7808005180 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f781400c210 tx=0x7f781401cc40 comp rx=0 tx=0).stop 2023-10-03T19:21:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f781b59e640 1 -- 172.21.15.45:0/2456510939 reap_dead start 2023-10-03T19:21:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f78210dd640 1 -- 172.21.15.45:0/2456510939 shutdown_connections 2023-10-03T19:21:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f78210dd640 1 -- 172.21.15.45:0/2456510939 >> 172.21.15.45:0/2456510939 conn(0x7f781c0bcf50 msgr2=0x7f781c0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f78210dd640 1 -- 172.21.15.45:0/2456510939 shutdown_connections 2023-10-03T19:21:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f78210dd640 1 -- 172.21.15.45:0/2456510939 wait complete. 2023-10-03T19:21:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f78210dd640 1 Processor -- start 2023-10-03T19:21:31.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f78210dd640 1 -- start start 2023-10-03T19:21:31.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f78210dd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7808004d10 0x7f781c1d7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:31.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f78210dd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f781c1e5550 0x7f781c1e4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:31.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f78210dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f781c1d5ac0 0x7f781c140230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:31.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f78210dd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781c141870 con 0x7f781c1d5ac0 2023-10-03T19:21:31.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f78210dd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781c143d80 con 0x7f7808004d10 2023-10-03T19:21:31.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f78210dd640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781c1e5980 con 0x7f781c1e5550 2023-10-03T19:21:31.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f781b59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f781c1d5ac0 0x7f781c140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:31.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f781b59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f781c1d5ac0 0x7f781c140230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57852/0 (socket says 172.21.15.45:57852) 2023-10-03T19:21:31.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f781b59e640 1 -- 172.21.15.45:0/59072921 learned_addr learned my addr 172.21.15.45:0/59072921 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:31.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f781a59c640 1 --2- 172.21.15.45:0/59072921 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f781c1e5550 0x7f781c1e4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:31.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f781ad9d640 1 --2- 172.21.15.45:0/59072921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7808004d10 0x7f781c1d7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:31.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f781b59e640 1 -- 172.21.15.45:0/59072921 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f781c1e5550 msgr2=0x7f781c1e4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:31.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f781b59e640 1 --2- 172.21.15.45:0/59072921 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f781c1e5550 0x7f781c1e4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:31.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f781b59e640 1 -- 172.21.15.45:0/59072921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7808004d10 msgr2=0x7f781c1d7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:31.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f781b59e640 1 --2- 172.21.15.45:0/59072921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7808004d10 0x7f781c1d7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:31.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f781b59e640 1 -- 172.21.15.45:0/59072921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c14c4a0 con 0x7f781c1d5ac0 2023-10-03T19:21:31.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f781a59c640 1 --2- 172.21.15.45:0/59072921 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f781c1e5550 0x7f781c1e4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:21:31.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f781b59e640 1 --2- 172.21.15.45:0/59072921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f781c1d5ac0 0x7f781c140230 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f78140ab040 tx=0x7f7808005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:31.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f78137fe640 1 -- 172.21.15.45:0/59072921 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7814000e90 con 0x7f781c1d5ac0 2023-10-03T19:21:31.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f78137fe640 1 -- 172.21.15.45:0/59072921 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78140b3070 con 0x7f781c1d5ac0 2023-10-03T19:21:31.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f78137fe640 1 -- 172.21.15.45:0/59072921 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7814007530 con 0x7f781c1d5ac0 2023-10-03T19:21:31.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f78210dd640 1 -- 172.21.15.45:0/59072921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f781c14fae0 con 0x7f781c1d5ac0 2023-10-03T19:21:31.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.435+0000 7f78210dd640 1 -- 172.21.15.45:0/59072921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f781c06f540 con 0x7f781c1d5ac0 2023-10-03T19:21:31.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.439+0000 7f78210dd640 1 -- 172.21.15.45:0/59072921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f781c06d660 con 0x7f781c1d5ac0 2023-10-03T19:21:31.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.439+0000 7f78137fe640 1 -- 172.21.15.45:0/59072921 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7814007690 con 0x7f781c1d5ac0 2023-10-03T19:21:31.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.439+0000 7f78137fe640 1 --2- 172.21.15.45:0/59072921 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f77fc0662b0 0x7f77fc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:31.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.439+0000 7f78137fe640 1 -- 172.21.15.45:0/59072921 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f78140b5070 con 0x7f781c1d5ac0 2023-10-03T19:21:31.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.439+0000 7f781ad9d640 1 --2- 172.21.15.45:0/59072921 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f77fc0662b0 0x7f77fc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:31.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.439+0000 7f781ad9d640 1 --2- 172.21.15.45:0/59072921 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f77fc0662b0 0x7f77fc068760 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f780c009a30 tx=0x7f780c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:31.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.443+0000 7f78137fe640 1 -- 172.21.15.45:0/59072921 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f78140eb190 con 0x7f781c1d5ac0 2023-10-03T19:21:31.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.627+0000 7f78210dd640 1 -- 172.21.15.45:0/59072921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f781c06cac0 con 0x7f781c1d5ac0 2023-10-03T19:21:31.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.631+0000 7f78137fe640 1 -- 172.21.15.45:0/59072921 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+3916 (secure 0 0 0) 0x7f781c06cac0 con 0x7f781c1d5ac0 2023-10-03T19:21:31.634 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:21:31.634 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":58,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3566869652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3566869652},{"type":"v1","addr":"172.21.15.79:6835","nonce":3566869652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":7587,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2339652261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2339652261},{"type":"v1","addr":"172.21.15.45:6833","nonce":2339652261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:20:16.301166+0000","modified":"2023-10-03T19:20:19.318778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7602":{"gid":7602,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1723126563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1723126563},{"type":"v1","addr":"172.21.15.45:6835","nonce":1723126563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-10-03T19:21:31.634 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 58 2023-10-03T19:21:31.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.631+0000 7f78210dd640 1 -- 172.21.15.45:0/59072921 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f77fc0662b0 msgr2=0x7f77fc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:31.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.631+0000 7f78210dd640 1 --2- 172.21.15.45:0/59072921 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f77fc0662b0 0x7f77fc068760 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f780c009a30 tx=0x7f780c008040 comp rx=0 tx=0).stop 2023-10-03T19:21:31.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.631+0000 7f78210dd640 1 -- 172.21.15.45:0/59072921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f781c1d5ac0 msgr2=0x7f781c140230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:31.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.631+0000 7f78210dd640 1 --2- 172.21.15.45:0/59072921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f781c1d5ac0 0x7f781c140230 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f78140ab040 tx=0x7f7808005800 comp rx=0 tx=0).stop 2023-10-03T19:21:31.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.631+0000 7f78210dd640 1 -- 172.21.15.45:0/59072921 shutdown_connections 2023-10-03T19:21:31.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.631+0000 7f78210dd640 1 --2- 172.21.15.45:0/59072921 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f77fc0662b0 0x7f77fc068760 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:31.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.631+0000 7f78210dd640 1 --2- 172.21.15.45:0/59072921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f781c1d5ac0 0x7f781c140230 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:31.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.631+0000 7f78210dd640 1 --2- 172.21.15.45:0/59072921 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f781c1e5550 0x7f781c1e4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:31.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.631+0000 7f78210dd640 1 --2- 172.21.15.45:0/59072921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7808004d10 0x7f781c1d7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:31.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.631+0000 7f78210dd640 1 -- 172.21.15.45:0/59072921 >> 172.21.15.45:0/59072921 conn(0x7f781c0bcf50 msgr2=0x7f781c0bad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:31.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.631+0000 7f78210dd640 1 -- 172.21.15.45:0/59072921 shutdown_connections 2023-10-03T19:21:31.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.631+0000 7f78210dd640 1 -- 172.21.15.45:0/59072921 wait complete. 2023-10-03T19:21:31.652 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:21:31.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.771+0000 7f01253a1640 1 Processor -- start 2023-10-03T19:21:31.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.771+0000 7f01253a1640 1 -- start start 2023-10-03T19:21:31.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f01253a1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f012006f170 0x7f0120150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:31.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f01253a1640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f012006cac0 con 0x7f01200bc8b0 2023-10-03T19:21:31.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f01253a1640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01200720d0 con 0x7f012006d170 2023-10-03T19:21:31.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f01253a1640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01200a5ab0 con 0x7f012006f170 2023-10-03T19:21:31.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f011e7fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f01200bc8b0 0x7f012014ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37532/0 (socket says 172.21.15.45:37532) 2023-10-03T19:21:31.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f011e7fc640 1 -- 172.21.15.45:0/3204445350 learned_addr learned my addr 172.21.15.45:0/3204445350 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:21:31.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f011effd640 1 --2- 172.21.15.45:0/3204445350 >> v2:172.21.15.79:3300/0 conn(0x7f012006f170 0x7f0120150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:31.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f011dffb640 1 -- 172.21.15.45:0/3204445350 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1674798660 0 0) 0x7f0108001120 con 0x7f01200bc8b0 2023-10-03T19:21:31.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f011dffb640 1 -- 172.21.15.45:0/3204445350 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f010c007940 con 0x7f01200bc8b0 2023-10-03T19:21:31.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f011dffb640 1 -- 172.21.15.45:0/3204445350 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2307161625 0 0) 0x7f010c007940 con 0x7f01200bc8b0 2023-10-03T19:21:31.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f011dffb640 1 -- 172.21.15.45:0/3204445350 >> v2:172.21.15.79:3300/0 conn(0x7f012006f170 msgr2=0x7f0120150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:31.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f011dffb640 1 --2- 172.21.15.45:0/3204445350 >> v2:172.21.15.79:3300/0 conn(0x7f012006f170 0x7f0120150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:31.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f011dffb640 1 -- 172.21.15.45:0/3204445350 >> v1:172.21.15.79:6789/0 conn(0x7f012006d170 legacy=0x7f0120156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:31.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f011dffb640 1 -- 172.21.15.45:0/3204445350 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012006cd00 con 0x7f01200bc8b0 2023-10-03T19:21:31.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f011dffb640 1 -- 172.21.15.45:0/3204445350 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f0108001810 con 0x7f01200bc8b0 2023-10-03T19:21:31.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f011dffb640 1 -- 172.21.15.45:0/3204445350 >> v1:172.21.15.45:6789/0 conn(0x7f01200bc8b0 legacy=0x7f012014ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:31.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f011dffb640 1 --2- 172.21.15.45:0/3204445350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f010c007d90 0x7f010c0081a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:31.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f011dffb640 1 --2- 172.21.15.45:0/3204445350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f010c008be0 0x7f010c009050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:31.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f011dffb640 1 --2- 172.21.15.45:0/3204445350 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f010c009590 0x7f010c00fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:31.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f011dffb640 1 -- 172.21.15.45:0/3204445350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01200a5ab0 con 0x7f010c007d90 2023-10-03T19:21:31.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f011dffb640 1 -- 172.21.15.45:0/3204445350 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010c0103f0 con 0x7f010c008be0 2023-10-03T19:21:31.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f011dffb640 1 -- 172.21.15.45:0/3204445350 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010c0105b0 con 0x7f010c009590 2023-10-03T19:21:31.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f011effd640 1 --2- 172.21.15.45:0/3204445350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f010c007d90 0x7f010c0081a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:31.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f011e7fc640 1 --2- 172.21.15.45:0/3204445350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f010c008be0 0x7f010c009050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:31.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f011f7fe640 1 --2- 172.21.15.45:0/3204445350 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f010c009590 0x7f010c00fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:31.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f011effd640 1 -- 172.21.15.45:0/3204445350 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f010c009590 msgr2=0x7f010c00fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:31.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f011effd640 1 --2- 172.21.15.45:0/3204445350 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f010c009590 0x7f010c00fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:31.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f011effd640 1 -- 172.21.15.45:0/3204445350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f010c008be0 msgr2=0x7f010c009050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:31.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f011effd640 1 --2- 172.21.15.45:0/3204445350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f010c008be0 0x7f010c009050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:31.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f011effd640 1 -- 172.21.15.45:0/3204445350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010c007940 con 0x7f010c007d90 2023-10-03T19:21:31.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f011f7fe640 1 -- 172.21.15.45:0/3204445350 reap_dead start 2023-10-03T19:21:31.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f011e7fc640 1 --2- 172.21.15.45:0/3204445350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f010c008be0 0x7f010c009050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:21:31.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.775+0000 7f011effd640 1 --2- 172.21.15.45:0/3204445350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f010c007d90 0x7f010c0081a0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f0110009ae0 tx=0x7f011001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5da9b108e8d9fb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:31.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f011dffb640 1 -- 172.21.15.45:0/3204445350 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01100a5530 con 0x7f010c007d90 2023-10-03T19:21:31.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f011dffb640 1 -- 172.21.15.45:0/3204445350 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01100a5690 con 0x7f010c007d90 2023-10-03T19:21:31.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f011dffb640 1 -- 172.21.15.45:0/3204445350 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01100a5a40 con 0x7f010c007d90 2023-10-03T19:21:31.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f01253a1640 1 -- 172.21.15.45:0/3204445350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f010c007d90 msgr2=0x7f010c0081a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:31.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f01253a1640 1 --2- 172.21.15.45:0/3204445350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f010c007d90 0x7f010c0081a0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f0110009ae0 tx=0x7f011001ca50 comp rx=0 tx=0).stop 2023-10-03T19:21:31.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f01253a1640 1 -- 172.21.15.45:0/3204445350 shutdown_connections 2023-10-03T19:21:31.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f01253a1640 1 --2- 172.21.15.45:0/3204445350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f010c007d90 0x7f010c0081a0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:31.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f01253a1640 1 -- 172.21.15.45:0/3204445350 >> 172.21.15.45:0/3204445350 conn(0x7f01200bcf50 msgr2=0x7f01200bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:31.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f01253a1640 1 -- 172.21.15.45:0/3204445350 shutdown_connections 2023-10-03T19:21:31.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f01253a1640 1 -- 172.21.15.45:0/3204445350 wait complete. 2023-10-03T19:21:31.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f01253a1640 1 Processor -- start 2023-10-03T19:21:31.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f01253a1640 1 -- start start 2023-10-03T19:21:31.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f01253a1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f010c007d90 0x7f0120147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:31.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f01253a1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01201475a0 0x7f0120145520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:31.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f01253a1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0120145a60 0x7f01201e07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:31.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f01253a1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01201481b0 con 0x7f01201475a0 2023-10-03T19:21:31.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f01253a1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01201479f0 con 0x7f0120145a60 2023-10-03T19:21:31.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f01253a1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01201dfde0 con 0x7f010c007d90 2023-10-03T19:21:31.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f011e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01201475a0 0x7f0120145520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:31.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f011e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01201475a0 0x7f0120145520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57870/0 (socket says 172.21.15.45:57870) 2023-10-03T19:21:31.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f011e7fc640 1 -- 172.21.15.45:0/162912736 learned_addr learned my addr 172.21.15.45:0/162912736 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:31.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f011effd640 1 --2- 172.21.15.45:0/162912736 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f010c007d90 0x7f0120147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:31.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f011f7fe640 1 --2- 172.21.15.45:0/162912736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0120145a60 0x7f01201e07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:31.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f011e7fc640 1 -- 172.21.15.45:0/162912736 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f010c007d90 msgr2=0x7f0120147060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:31.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f011e7fc640 1 --2- 172.21.15.45:0/162912736 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f010c007d90 0x7f0120147060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:31.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f011e7fc640 1 -- 172.21.15.45:0/162912736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0120145a60 msgr2=0x7f01201e07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:31.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f011e7fc640 1 --2- 172.21.15.45:0/162912736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0120145a60 0x7f01201e07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:31.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f011e7fc640 1 -- 172.21.15.45:0/162912736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012014c4a0 con 0x7f01201475a0 2023-10-03T19:21:31.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f011f7fe640 1 --2- 172.21.15.45:0/162912736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0120145a60 0x7f01201e07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:21:31.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f011e7fc640 1 --2- 172.21.15.45:0/162912736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01201475a0 0x7f0120145520 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f0108010910 tx=0x7f0108010a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:31.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f01177fe640 1 -- 172.21.15.45:0/162912736 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0108012730 con 0x7f01201475a0 2023-10-03T19:21:31.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f01177fe640 1 -- 172.21.15.45:0/162912736 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0108012890 con 0x7f01201475a0 2023-10-03T19:21:31.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f01253a1640 1 -- 172.21.15.45:0/162912736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f012014fae0 con 0x7f01201475a0 2023-10-03T19:21:31.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f01177fe640 1 -- 172.21.15.45:0/162912736 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0108012c20 con 0x7f01201475a0 2023-10-03T19:21:31.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.779+0000 7f01253a1640 1 -- 172.21.15.45:0/162912736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f012006f540 con 0x7f01201475a0 2023-10-03T19:21:31.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.783+0000 7f01253a1640 1 -- 172.21.15.45:0/162912736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f012006d660 con 0x7f01201475a0 2023-10-03T19:21:31.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.783+0000 7f01177fe640 1 -- 172.21.15.45:0/162912736 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f01080143a0 con 0x7f01201475a0 2023-10-03T19:21:31.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.783+0000 7f01177fe640 1 --2- 172.21.15.45:0/162912736 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f01000662b0 0x7f0100068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:31.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.783+0000 7f01177fe640 1 -- 172.21.15.45:0/162912736 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f0108085f20 con 0x7f01201475a0 2023-10-03T19:21:31.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.783+0000 7f011effd640 1 --2- 172.21.15.45:0/162912736 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f01000662b0 0x7f0100068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:31.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.783+0000 7f011effd640 1 --2- 172.21.15.45:0/162912736 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f01000662b0 0x7f0100068760 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f01100af000 tx=0x7f01100046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:31.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.787+0000 7f01177fe640 1 -- 172.21.15.45:0/162912736 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0108056f40 con 0x7f01201475a0 2023-10-03T19:21:31.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.939+0000 7f01253a1640 1 -- 172.21.15.45:0/162912736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01201482f0 con 0x7f01201475a0 2023-10-03T19:21:31.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.939+0000 7f01177fe640 1 -- 172.21.15.45:0/162912736 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+18375 (secure 0 0 0) 0x7f01201482f0 con 0x7f01201475a0 2023-10-03T19:21:31.945 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:21:31.945 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":110,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:20:34.764210+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:20:13.940428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-10-03T19:20:15.290748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:0/2294298422":"2023-10-03T20:20:34.239894+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:21:31.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.943+0000 7f01253a1640 1 -- 172.21.15.45:0/162912736 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f01000662b0 msgr2=0x7f0100068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:31.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.943+0000 7f01253a1640 1 --2- 172.21.15.45:0/162912736 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f01000662b0 0x7f0100068760 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f01100af000 tx=0x7f01100046d0 comp rx=0 tx=0).stop 2023-10-03T19:21:31.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.943+0000 7f01253a1640 1 -- 172.21.15.45:0/162912736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01201475a0 msgr2=0x7f0120145520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:31.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.943+0000 7f01253a1640 1 --2- 172.21.15.45:0/162912736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01201475a0 0x7f0120145520 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f0108010910 tx=0x7f0108010a00 comp rx=0 tx=0).stop 2023-10-03T19:21:31.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.943+0000 7f01253a1640 1 -- 172.21.15.45:0/162912736 shutdown_connections 2023-10-03T19:21:31.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.943+0000 7f01253a1640 1 --2- 172.21.15.45:0/162912736 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f01000662b0 0x7f0100068760 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:31.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.943+0000 7f01253a1640 1 --2- 172.21.15.45:0/162912736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0120145a60 0x7f01201e07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:31.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.943+0000 7f01253a1640 1 --2- 172.21.15.45:0/162912736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01201475a0 0x7f0120145520 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:31.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.943+0000 7f01253a1640 1 --2- 172.21.15.45:0/162912736 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f010c007d90 0x7f0120147060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:31.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.943+0000 7f01253a1640 1 -- 172.21.15.45:0/162912736 >> 172.21.15.45:0/162912736 conn(0x7f01200bcf50 msgr2=0x7f01200bf470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:31.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.943+0000 7f01253a1640 1 -- 172.21.15.45:0/162912736 shutdown_connections 2023-10-03T19:21:31.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:31.943+0000 7f01253a1640 1 -- 172.21.15.45:0/162912736 wait complete. 2023-10-03T19:21:31.963 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T19:12:20.520129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T19:12:21.799120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T19:20:13.940428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T19:20:15.290748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T19:21:31.964 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T19:21:32.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.087+0000 7f239df06640 1 Processor -- start 2023-10-03T19:21:32.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.087+0000 7f239df06640 1 -- start start 2023-10-03T19:21:32.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.087+0000 7f239df06640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f23980c07b0 0x7f23980c0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:32.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.087+0000 7f239df06640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f23980c1770 0x7f23980bb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:32.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.087+0000 7f239df06640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23980bc360 con 0x7f23980bbed0 2023-10-03T19:21:32.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.087+0000 7f239df06640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23980c1ed0 con 0x7f23980c07b0 2023-10-03T19:21:32.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.087+0000 7f239df06640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23980c11b0 con 0x7f23980c1770 2023-10-03T19:21:32.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.087+0000 7f23977fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f23980c07b0 0x7f23980c0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:32.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.087+0000 7f23977fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f23980c07b0 0x7f23980c0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57878/0 (socket says 172.21.15.45:57878) 2023-10-03T19:21:32.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.087+0000 7f2397fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f23980bbed0 0x7f239814b760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37546/0 (socket says 172.21.15.45:37546) 2023-10-03T19:21:32.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.087+0000 7f23977fe640 1 -- 172.21.15.45:0/4013395693 learned_addr learned my addr 172.21.15.45:0/4013395693 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:32.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.087+0000 7f2396ffd640 1 --2- 172.21.15.45:0/4013395693 >> v2:172.21.15.79:3300/0 conn(0x7f23980c1770 0x7f23980bb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:32.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.087+0000 7f23977fe640 1 -- 172.21.15.45:0/4013395693 >> v2:172.21.15.79:3300/0 conn(0x7f23980c1770 msgr2=0x7f23980bb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:32.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.087+0000 7f23977fe640 1 --2- 172.21.15.45:0/4013395693 >> v2:172.21.15.79:3300/0 conn(0x7f23980c1770 0x7f23980bb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:32.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.087+0000 7f23977fe640 1 -- 172.21.15.45:0/4013395693 >> v1:172.21.15.45:6789/0 conn(0x7f23980bbed0 legacy=0x7f239814b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:32.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.087+0000 7f23967fc640 1 -- 172.21.15.45:0/4013395693 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2036657759 0 0) 0x7f23980bc360 con 0x7f23980bbed0 2023-10-03T19:21:32.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.087+0000 7f23977fe640 1 -- 172.21.15.45:0/4013395693 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23981525e0 con 0x7f23980c07b0 2023-10-03T19:21:32.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.091+0000 7f23977fe640 1 --2- 172.21.15.45:0/4013395693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23980c07b0 0x7f23980c0b80 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f23980bd710 tx=0x7f238801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed033018248bf430 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:32.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.091+0000 7f23967fc640 1 -- 172.21.15.45:0/4013395693 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23880a89f0 con 0x7f23980c07b0 2023-10-03T19:21:32.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.091+0000 7f23967fc640 1 -- 172.21.15.45:0/4013395693 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23880a8b50 con 0x7f23980c07b0 2023-10-03T19:21:32.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.091+0000 7f23967fc640 1 -- 172.21.15.45:0/4013395693 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23880b0440 con 0x7f23980c07b0 2023-10-03T19:21:32.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.091+0000 7f239df06640 1 -- 172.21.15.45:0/4013395693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23980c07b0 msgr2=0x7f23980c0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:32.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.091+0000 7f239df06640 1 --2- 172.21.15.45:0/4013395693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23980c07b0 0x7f23980c0b80 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f23980bd710 tx=0x7f238801ecf0 comp rx=0 tx=0).stop 2023-10-03T19:21:32.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.091+0000 7f239df06640 1 -- 172.21.15.45:0/4013395693 shutdown_connections 2023-10-03T19:21:32.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.091+0000 7f239df06640 1 --2- 172.21.15.45:0/4013395693 >> v2:172.21.15.79:3300/0 conn(0x7f23980c1770 0x7f23980bb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:32.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.091+0000 7f239df06640 1 --2- 172.21.15.45:0/4013395693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23980c07b0 0x7f23980c0b80 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:32.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.091+0000 7f239df06640 1 -- 172.21.15.45:0/4013395693 >> 172.21.15.45:0/4013395693 conn(0x7f23980a4260 msgr2=0x7f23980a4660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:32.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.091+0000 7f239df06640 1 -- 172.21.15.45:0/4013395693 shutdown_connections 2023-10-03T19:21:32.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.091+0000 7f239df06640 1 -- 172.21.15.45:0/4013395693 wait complete. 2023-10-03T19:21:32.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.091+0000 7f239df06640 1 Processor -- start 2023-10-03T19:21:32.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.091+0000 7f239df06640 1 -- start start 2023-10-03T19:21:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.091+0000 7f239df06640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23980bbed0 0x7f23981e3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.091+0000 7f239df06640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23980c07b0 0x7f23980a5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.091+0000 7f239df06640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23980c1770 0x7f23981e6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.091+0000 7f239df06640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23980a3330 con 0x7f23980c1770 2023-10-03T19:21:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.091+0000 7f239df06640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23980a37c0 con 0x7f23980c07b0 2023-10-03T19:21:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.091+0000 7f239df06640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23981e4390 con 0x7f23980bbed0 2023-10-03T19:21:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.091+0000 7f2397fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23980c1770 0x7f23981e6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:32.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.095+0000 7f2397fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23980c1770 0x7f23981e6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57884/0 (socket says 172.21.15.45:57884) 2023-10-03T19:21:32.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.095+0000 7f2397fff640 1 -- 172.21.15.45:0/941902855 learned_addr learned my addr 172.21.15.45:0/941902855 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:32.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.095+0000 7f23977fe640 1 --2- 172.21.15.45:0/941902855 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23980bbed0 0x7f23981e3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:32.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.095+0000 7f2396ffd640 1 --2- 172.21.15.45:0/941902855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23980c07b0 0x7f23980a5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:32.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.095+0000 7f2397fff640 1 -- 172.21.15.45:0/941902855 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23980bbed0 msgr2=0x7f23981e3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:32.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.095+0000 7f2397fff640 1 --2- 172.21.15.45:0/941902855 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23980bbed0 0x7f23981e3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:32.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.095+0000 7f2397fff640 1 -- 172.21.15.45:0/941902855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23980c07b0 msgr2=0x7f23980a5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:32.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.095+0000 7f2397fff640 1 --2- 172.21.15.45:0/941902855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23980c07b0 0x7f23980a5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:32.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.095+0000 7f2397fff640 1 -- 172.21.15.45:0/941902855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23880094d0 con 0x7f23980c1770 2023-10-03T19:21:32.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.095+0000 7f2397fff640 1 --2- 172.21.15.45:0/941902855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23980c1770 0x7f23981e6e70 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f239000c7a0 tx=0x7f239000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:32.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.095+0000 7f237ffff640 1 -- 172.21.15.45:0/941902855 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239000a640 con 0x7f23980c1770 2023-10-03T19:21:32.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.095+0000 7f237ffff640 1 -- 172.21.15.45:0/941902855 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f239000a7a0 con 0x7f23980c1770 2023-10-03T19:21:32.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.095+0000 7f239df06640 1 -- 172.21.15.45:0/941902855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f239814e540 con 0x7f23980c1770 2023-10-03T19:21:32.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.095+0000 7f237ffff640 1 -- 172.21.15.45:0/941902855 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239000abd0 con 0x7f23980c1770 2023-10-03T19:21:32.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.095+0000 7f239df06640 1 -- 172.21.15.45:0/941902855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23981528c0 con 0x7f23980c1770 2023-10-03T19:21:32.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.095+0000 7f239df06640 1 -- 172.21.15.45:0/941902855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f239814be70 con 0x7f23980c1770 2023-10-03T19:21:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.095+0000 7f237ffff640 1 -- 172.21.15.45:0/941902855 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f239000ad30 con 0x7f23980c1770 2023-10-03T19:21:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.095+0000 7f237ffff640 1 --2- 172.21.15.45:0/941902855 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2384066280 0x7f2384068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.095+0000 7f237ffff640 1 -- 172.21.15.45:0/941902855 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f23900832b0 con 0x7f23980c1770 2023-10-03T19:21:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.095+0000 7f23977fe640 1 --2- 172.21.15.45:0/941902855 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2384066280 0x7f2384068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.095+0000 7f23977fe640 1 --2- 172.21.15.45:0/941902855 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2384066280 0x7f2384068730 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f23880b2000 tx=0x7f23880aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:32.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.099+0000 7f237ffff640 1 -- 172.21.15.45:0/941902855 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2390050700 con 0x7f23980c1770 2023-10-03T19:21:32.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.255+0000 7f239df06640 1 -- 172.21.15.45:0/941902855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f23980bfe20 con 0x7f23980c1770 2023-10-03T19:21:32.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.255+0000 7f237ffff640 1 -- 172.21.15.45:0/941902855 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2390053d20 con 0x7f23980c1770 2023-10-03T19:21:32.260 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-10-03T19:21:32.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.259+0000 7f239df06640 1 -- 172.21.15.45:0/941902855 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2384066280 msgr2=0x7f2384068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:32.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.259+0000 7f239df06640 1 --2- 172.21.15.45:0/941902855 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2384066280 0x7f2384068730 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f23880b2000 tx=0x7f23880aa070 comp rx=0 tx=0).stop 2023-10-03T19:21:32.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.259+0000 7f239df06640 1 -- 172.21.15.45:0/941902855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23980c1770 msgr2=0x7f23981e6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:32.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.259+0000 7f239df06640 1 --2- 172.21.15.45:0/941902855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23980c1770 0x7f23981e6e70 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f239000c7a0 tx=0x7f239000cc60 comp rx=0 tx=0).stop 2023-10-03T19:21:32.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.259+0000 7f239df06640 1 -- 172.21.15.45:0/941902855 shutdown_connections 2023-10-03T19:21:32.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.259+0000 7f239df06640 1 --2- 172.21.15.45:0/941902855 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2384066280 0x7f2384068730 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:32.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.259+0000 7f239df06640 1 --2- 172.21.15.45:0/941902855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23980c1770 0x7f23981e6e70 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:32.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.259+0000 7f239df06640 1 --2- 172.21.15.45:0/941902855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23980c07b0 0x7f23980a5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:32.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.259+0000 7f239df06640 1 --2- 172.21.15.45:0/941902855 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23980bbed0 0x7f23981e3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:32.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.259+0000 7f239df06640 1 -- 172.21.15.45:0/941902855 >> 172.21.15.45:0/941902855 conn(0x7f23980a4260 msgr2=0x7f2398151d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:32.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.259+0000 7f239df06640 1 -- 172.21.15.45:0/941902855 shutdown_connections 2023-10-03T19:21:32.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.259+0000 7f239df06640 1 -- 172.21.15.45:0/941902855 wait complete. 2023-10-03T19:21:32.280 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T19:21:32.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.399+0000 7f1d93db0640 1 Processor -- start 2023-10-03T19:21:32.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.399+0000 7f1d93db0640 1 -- start start 2023-10-03T19:21:32.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.399+0000 7f1d93db0640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1d8c0bf1f0 0x7f1d8c0a9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:32.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.399+0000 7f1d93db0640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1d8c0c2770 0x7f1d8c0a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:32.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.399+0000 7f1d93db0640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8c06ac70 con 0x7f1d8c0c14e0 2023-10-03T19:21:32.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.399+0000 7f1d93db0640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d8c06aae0 con 0x7f1d8c0bf1f0 2023-10-03T19:21:32.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.399+0000 7f1d93db0640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d8c0c3000 con 0x7f1d8c0c2770 2023-10-03T19:21:32.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.399+0000 7f1d91b4c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1d8c0c14e0 0x7f1d8c0c0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37556/0 (socket says 172.21.15.45:37556) 2023-10-03T19:21:32.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.399+0000 7f1d91b4c640 1 -- 172.21.15.45:0/3521721608 learned_addr learned my addr 172.21.15.45:0/3521721608 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:21:32.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.399+0000 7f1d9134b640 1 --2- 172.21.15.45:0/3521721608 >> v2:172.21.15.45:3300/0 conn(0x7f1d8c0bf1f0 0x7f1d8c0a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:32.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.399+0000 7f1d9234d640 1 --2- 172.21.15.45:0/3521721608 >> v2:172.21.15.79:3300/0 conn(0x7f1d8c0c2770 0x7f1d8c0a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:32.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.399+0000 7f1d9134b640 1 -- 172.21.15.45:0/3521721608 >> v2:172.21.15.79:3300/0 conn(0x7f1d8c0c2770 msgr2=0x7f1d8c0a9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:32.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.399+0000 7f1d9134b640 1 --2- 172.21.15.45:0/3521721608 >> v2:172.21.15.79:3300/0 conn(0x7f1d8c0c2770 0x7f1d8c0a9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:32.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.399+0000 7f1d9134b640 1 -- 172.21.15.45:0/3521721608 >> v1:172.21.15.45:6789/0 conn(0x7f1d8c0c14e0 legacy=0x7f1d8c0c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:32.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.399+0000 7f1d9134b640 1 -- 172.21.15.45:0/3521721608 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8c0aa5f0 con 0x7f1d8c0bf1f0 2023-10-03T19:21:32.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.399+0000 7f1d90b4a640 1 -- 172.21.15.45:0/3521721608 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4145845312 0 0) 0x7f1d8c06ac70 con 0x7f1d8c0c14e0 2023-10-03T19:21:32.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.399+0000 7f1d9134b640 1 --2- 172.21.15.45:0/3521721608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d8c0bf1f0 0x7f1d8c0a9860 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c0c5910 tx=0x7f1d7c01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98fd4019d13cea5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:32.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.399+0000 7f1d90b4a640 1 -- 172.21.15.45:0/3521721608 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c0a8950 con 0x7f1d8c0bf1f0 2023-10-03T19:21:32.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.399+0000 7f1d90b4a640 1 -- 172.21.15.45:0/3521721608 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7c0a8ab0 con 0x7f1d8c0bf1f0 2023-10-03T19:21:32.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.399+0000 7f1d90b4a640 1 -- 172.21.15.45:0/3521721608 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c0a8e40 con 0x7f1d8c0bf1f0 2023-10-03T19:21:32.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d93db0640 1 -- 172.21.15.45:0/3521721608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d8c0bf1f0 msgr2=0x7f1d8c0a9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:32.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d93db0640 1 --2- 172.21.15.45:0/3521721608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d8c0bf1f0 0x7f1d8c0a9860 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c0c5910 tx=0x7f1d7c01ec50 comp rx=0 tx=0).stop 2023-10-03T19:21:32.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d93db0640 1 -- 172.21.15.45:0/3521721608 shutdown_connections 2023-10-03T19:21:32.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d93db0640 1 --2- 172.21.15.45:0/3521721608 >> v2:172.21.15.79:3300/0 conn(0x7f1d8c0c2770 0x7f1d8c0a9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:32.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d93db0640 1 --2- 172.21.15.45:0/3521721608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d8c0bf1f0 0x7f1d8c0a9860 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:32.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d93db0640 1 -- 172.21.15.45:0/3521721608 >> 172.21.15.45:0/3521721608 conn(0x7f1d8c0a6440 msgr2=0x7f1d8c0a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:32.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d93db0640 1 -- 172.21.15.45:0/3521721608 shutdown_connections 2023-10-03T19:21:32.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d93db0640 1 -- 172.21.15.45:0/3521721608 wait complete. 2023-10-03T19:21:32.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d93db0640 1 Processor -- start 2023-10-03T19:21:32.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d93db0640 1 -- start start 2023-10-03T19:21:32.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d93db0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d8c0bf1f0 0x7f1d8c0bd730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:32.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d93db0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d8c0c14e0 0x7f1d8c09aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:32.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d93db0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d8c0c2770 0x7f1d8c14b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:32.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d93db0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c09e0b0 con 0x7f1d8c0c2770 2023-10-03T19:21:32.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d93db0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c09d430 con 0x7f1d8c0bf1f0 2023-10-03T19:21:32.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d93db0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c09d920 con 0x7f1d8c0c14e0 2023-10-03T19:21:32.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d9234d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d8c0c2770 0x7f1d8c14b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:32.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d9234d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d8c0c2770 0x7f1d8c14b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57904/0 (socket says 172.21.15.45:57904) 2023-10-03T19:21:32.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d9234d640 1 -- 172.21.15.45:0/4209004982 learned_addr learned my addr 172.21.15.45:0/4209004982 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:32.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d9134b640 1 --2- 172.21.15.45:0/4209004982 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d8c0c14e0 0x7f1d8c09aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:32.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d91b4c640 1 --2- 172.21.15.45:0/4209004982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d8c0bf1f0 0x7f1d8c0bd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:32.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d9234d640 1 -- 172.21.15.45:0/4209004982 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d8c0c14e0 msgr2=0x7f1d8c09aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:32.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d9234d640 1 --2- 172.21.15.45:0/4209004982 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d8c0c14e0 0x7f1d8c09aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:32.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d9234d640 1 -- 172.21.15.45:0/4209004982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d8c0bf1f0 msgr2=0x7f1d8c0bd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:32.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d9234d640 1 --2- 172.21.15.45:0/4209004982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d8c0bf1f0 0x7f1d8c0bd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:32.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d9234d640 1 -- 172.21.15.45:0/4209004982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c009420 con 0x7f1d8c0c2770 2023-10-03T19:21:32.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d9234d640 1 --2- 172.21.15.45:0/4209004982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d8c0c2770 0x7f1d8c14b250 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f1d84007d80 tx=0x7f1d8400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:32.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d827fc640 1 -- 172.21.15.45:0/4209004982 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d84014420 con 0x7f1d8c0c2770 2023-10-03T19:21:32.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d827fc640 1 -- 172.21.15.45:0/4209004982 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d84014580 con 0x7f1d8c0c2770 2023-10-03T19:21:32.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d93db0640 1 -- 172.21.15.45:0/4209004982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d8c14f530 con 0x7f1d8c0c2770 2023-10-03T19:21:32.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d827fc640 1 -- 172.21.15.45:0/4209004982 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d84014930 con 0x7f1d8c0c2770 2023-10-03T19:21:32.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.403+0000 7f1d93db0640 1 -- 172.21.15.45:0/4209004982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d8c14f250 con 0x7f1d8c0c2770 2023-10-03T19:21:32.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.407+0000 7f1d93db0640 1 -- 172.21.15.45:0/4209004982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d8c06b0e0 con 0x7f1d8c0c2770 2023-10-03T19:21:32.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.407+0000 7f1d827fc640 1 -- 172.21.15.45:0/4209004982 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1d84014a90 con 0x7f1d8c0c2770 2023-10-03T19:21:32.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.407+0000 7f1d827fc640 1 --2- 172.21.15.45:0/4209004982 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1d700662b0 0x7f1d70068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:32.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.407+0000 7f1d827fc640 1 -- 172.21.15.45:0/4209004982 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f1d840846f0 con 0x7f1d8c0c2770 2023-10-03T19:21:32.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.407+0000 7f1d91b4c640 1 --2- 172.21.15.45:0/4209004982 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1d700662b0 0x7f1d70068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:32.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.407+0000 7f1d91b4c640 1 --2- 172.21.15.45:0/4209004982 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1d700662b0 0x7f1d70068760 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1d88000f70 tx=0x7f1d88007b60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:32.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.411+0000 7f1d827fc640 1 -- 172.21.15.45:0/4209004982 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1d84055530 con 0x7f1d8c0c2770 2023-10-03T19:21:32.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.563+0000 7f1d93db0640 1 -- 172.21.15.45:0/4209004982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1d8c04de80 con 0x7f1d8c0c2770 2023-10-03T19:21:32.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.567+0000 7f1d827fc640 1 -- 172.21.15.45:0/4209004982 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v110) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1d840550c0 con 0x7f1d8c0c2770 2023-10-03T19:21:32.633 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-10-03T19:21:32.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.567+0000 7f1d93db0640 1 -- 172.21.15.45:0/4209004982 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1d700662b0 msgr2=0x7f1d70068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:32.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.567+0000 7f1d93db0640 1 --2- 172.21.15.45:0/4209004982 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1d700662b0 0x7f1d70068760 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1d88000f70 tx=0x7f1d88007b60 comp rx=0 tx=0).stop 2023-10-03T19:21:32.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.567+0000 7f1d93db0640 1 -- 172.21.15.45:0/4209004982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d8c0c2770 msgr2=0x7f1d8c14b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.567+0000 7f1d93db0640 1 --2- 172.21.15.45:0/4209004982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d8c0c2770 0x7f1d8c14b250 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f1d84007d80 tx=0x7f1d8400e4b0 comp rx=0 tx=0).stop 2023-10-03T19:21:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.567+0000 7f1d93db0640 1 -- 172.21.15.45:0/4209004982 shutdown_connections 2023-10-03T19:21:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.567+0000 7f1d93db0640 1 --2- 172.21.15.45:0/4209004982 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1d700662b0 0x7f1d70068760 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.567+0000 7f1d93db0640 1 --2- 172.21.15.45:0/4209004982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d8c0c2770 0x7f1d8c14b250 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.567+0000 7f1d93db0640 1 --2- 172.21.15.45:0/4209004982 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d8c0c14e0 0x7f1d8c09aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.567+0000 7f1d93db0640 1 --2- 172.21.15.45:0/4209004982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d8c0bf1f0 0x7f1d8c0bd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.567+0000 7f1d93db0640 1 -- 172.21.15.45:0/4209004982 >> 172.21.15.45:0/4209004982 conn(0x7f1d8c0a6440 msgr2=0x7f1d8c14cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.567+0000 7f1d93db0640 1 -- 172.21.15.45:0/4209004982 shutdown_connections 2023-10-03T19:21:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.567+0000 7f1d93db0640 1 -- 172.21.15.45:0/4209004982 wait complete. 2023-10-03T19:21:32.636 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T19:21:32.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.759+0000 7fe311c72640 1 Processor -- start 2023-10-03T19:21:32.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.759+0000 7fe311c72640 1 -- start start 2023-10-03T19:21:32.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.759+0000 7fe311c72640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe30c06c410 0x7fe30c0bc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:32.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.759+0000 7fe311c72640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe30c0bc860 0x7fe30c147d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:32.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.759+0000 7fe311c72640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe30c06f650 con 0x7fe30c06cc20 2023-10-03T19:21:32.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.759+0000 7fe311c72640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe30c0bd5d0 con 0x7fe30c0bc860 2023-10-03T19:21:32.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.759+0000 7fe311c72640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c06f3b0 con 0x7fe30c06c410 2023-10-03T19:21:32.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.759+0000 7fe30b7fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe30c06c410 0x7fe30c0bc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:32.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.759+0000 7fe30affd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe30c0bc860 0x7fe30c147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:32.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.759+0000 7fe30b7fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe30c06c410 0x7fe30c0bc320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:38952/0 (socket says 172.21.15.45:38952) 2023-10-03T19:21:32.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.759+0000 7fe30b7fe640 1 -- 172.21.15.45:0/2829521143 learned_addr learned my addr 172.21.15.45:0/2829521143 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:32.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.759+0000 7fe30affd640 1 -- 172.21.15.45:0/2829521143 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe30c06c410 msgr2=0x7fe30c0bc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:32.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.759+0000 7fe30affd640 1 --2- 172.21.15.45:0/2829521143 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe30c06c410 0x7fe30c0bc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:32.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.759+0000 7fe30affd640 1 -- 172.21.15.45:0/2829521143 >> v1:172.21.15.79:6789/0 conn(0x7fe30c06cc20 legacy=0x7fe30c0bcec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:32.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.759+0000 7fe30affd640 1 -- 172.21.15.45:0/2829521143 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30c14b680 con 0x7fe30c0bc860 2023-10-03T19:21:32.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.763+0000 7fe30affd640 1 --2- 172.21.15.45:0/2829521143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe30c0bc860 0x7fe30c147d10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe3000097c0 tx=0x7fe30001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12b00e387e2b5aa7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:32.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.763+0000 7fe30a7fc640 1 -- 172.21.15.45:0/2829521143 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3000ab670 con 0x7fe30c0bc860 2023-10-03T19:21:32.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.763+0000 7fe30a7fc640 1 -- 172.21.15.45:0/2829521143 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3000ab7d0 con 0x7fe30c0bc860 2023-10-03T19:21:32.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.763+0000 7fe30a7fc640 1 -- 172.21.15.45:0/2829521143 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3000abb60 con 0x7fe30c0bc860 2023-10-03T19:21:32.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.763+0000 7fe311c72640 1 -- 172.21.15.45:0/2829521143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe30c0bc860 msgr2=0x7fe30c147d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:32.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.763+0000 7fe311c72640 1 --2- 172.21.15.45:0/2829521143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe30c0bc860 0x7fe30c147d10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe3000097c0 tx=0x7fe30001c450 comp rx=0 tx=0).stop 2023-10-03T19:21:32.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.763+0000 7fe311c72640 1 -- 172.21.15.45:0/2829521143 shutdown_connections 2023-10-03T19:21:32.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.763+0000 7fe311c72640 1 --2- 172.21.15.45:0/2829521143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe30c0bc860 0x7fe30c147d10 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:32.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.763+0000 7fe311c72640 1 --2- 172.21.15.45:0/2829521143 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe30c06c410 0x7fe30c0bc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:32.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.763+0000 7fe311c72640 1 -- 172.21.15.45:0/2829521143 >> 172.21.15.45:0/2829521143 conn(0x7fe30c0a20d0 msgr2=0x7fe30c0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:32.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.763+0000 7fe311c72640 1 -- 172.21.15.45:0/2829521143 shutdown_connections 2023-10-03T19:21:32.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.763+0000 7fe311c72640 1 -- 172.21.15.45:0/2829521143 wait complete. 2023-10-03T19:21:32.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.763+0000 7fe311c72640 1 Processor -- start 2023-10-03T19:21:32.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.763+0000 7fe311c72640 1 -- start start 2023-10-03T19:21:32.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.763+0000 7fe311c72640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe30c06c410 0x7fe30c0a44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:32.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.763+0000 7fe311c72640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe30c06cc20 0x7fe30c140200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:32.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.763+0000 7fe311c72640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe30c0bc860 0x7fe30c140740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:32.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.763+0000 7fe311c72640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c0a5320 con 0x7fe30c0bc860 2023-10-03T19:21:32.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.763+0000 7fe311c72640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c145000 con 0x7fe30c06cc20 2023-10-03T19:21:32.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.763+0000 7fe311c72640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c0a4a20 con 0x7fe30c06c410 2023-10-03T19:21:32.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.763+0000 7fe30bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe30c0bc860 0x7fe30c140740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:32.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.763+0000 7fe30bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe30c0bc860 0x7fe30c140740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57908/0 (socket says 172.21.15.45:57908) 2023-10-03T19:21:32.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.763+0000 7fe30bfff640 1 -- 172.21.15.45:0/1390190118 learned_addr learned my addr 172.21.15.45:0/1390190118 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:32.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.763+0000 7fe30b7fe640 1 --2- 172.21.15.45:0/1390190118 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe30c06c410 0x7fe30c0a44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:32.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.767+0000 7fe30affd640 1 --2- 172.21.15.45:0/1390190118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe30c06cc20 0x7fe30c140200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:32.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.767+0000 7fe30bfff640 1 -- 172.21.15.45:0/1390190118 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe30c06c410 msgr2=0x7fe30c0a44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:32.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.767+0000 7fe30bfff640 1 --2- 172.21.15.45:0/1390190118 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe30c06c410 0x7fe30c0a44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:32.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.767+0000 7fe30bfff640 1 -- 172.21.15.45:0/1390190118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe30c06cc20 msgr2=0x7fe30c140200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:32.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.767+0000 7fe30bfff640 1 --2- 172.21.15.45:0/1390190118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe30c06cc20 0x7fe30c140200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:32.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.767+0000 7fe30bfff640 1 -- 172.21.15.45:0/1390190118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe300009420 con 0x7fe30c0bc860 2023-10-03T19:21:32.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.767+0000 7fe30bfff640 1 --2- 172.21.15.45:0/1390190118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe30c0bc860 0x7fe30c140740 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fe30400c7a0 tx=0x7fe30400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:32.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.767+0000 7fe2f3fff640 1 -- 172.21.15.45:0/1390190118 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe304003b80 con 0x7fe30c0bc860 2023-10-03T19:21:32.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.767+0000 7fe2f3fff640 1 -- 172.21.15.45:0/1390190118 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe304003ce0 con 0x7fe30c0bc860 2023-10-03T19:21:32.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.767+0000 7fe311c72640 1 -- 172.21.15.45:0/1390190118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30c0ba850 con 0x7fe30c0bc860 2023-10-03T19:21:32.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.767+0000 7fe2f3fff640 1 -- 172.21.15.45:0/1390190118 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30400aa30 con 0x7fe30c0bc860 2023-10-03T19:21:32.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.767+0000 7fe311c72640 1 -- 172.21.15.45:0/1390190118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe30c0ba6c0 con 0x7fe30c0bc860 2023-10-03T19:21:32.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.767+0000 7fe311c72640 1 -- 172.21.15.45:0/1390190118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe30c148250 con 0x7fe30c0bc860 2023-10-03T19:21:32.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.767+0000 7fe2f3fff640 1 -- 172.21.15.45:0/1390190118 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe30400ab90 con 0x7fe30c0bc860 2023-10-03T19:21:32.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.767+0000 7fe2f3fff640 1 --2- 172.21.15.45:0/1390190118 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe2f8066280 0x7fe2f8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:32.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.767+0000 7fe2f3fff640 1 -- 172.21.15.45:0/1390190118 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fe304083a50 con 0x7fe30c0bc860 2023-10-03T19:21:32.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.767+0000 7fe30b7fe640 1 --2- 172.21.15.45:0/1390190118 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe2f8066280 0x7fe2f8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:32.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.767+0000 7fe30b7fe640 1 --2- 172.21.15.45:0/1390190118 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe2f8066280 0x7fe2f8068730 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc009b50 tx=0x7fe2fc009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:32.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.771+0000 7fe2f3fff640 1 -- 172.21.15.45:0/1390190118 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe304050f50 con 0x7fe30c0bc860 2023-10-03T19:21:32.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.923+0000 7fe311c72640 1 -- 172.21.15.45:0/1390190118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe30c145170 con 0x7fe30c0bc860 2023-10-03T19:21:32.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.923+0000 7fe2f3fff640 1 -- 172.21.15.45:0/1390190118 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v110) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe304054570 con 0x7fe30c0bc860 2023-10-03T19:21:32.929 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-10-03T19:21:32.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.927+0000 7fe311c72640 1 -- 172.21.15.45:0/1390190118 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe2f8066280 msgr2=0x7fe2f8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:32.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.927+0000 7fe311c72640 1 --2- 172.21.15.45:0/1390190118 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe2f8066280 0x7fe2f8068730 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc009b50 tx=0x7fe2fc009240 comp rx=0 tx=0).stop 2023-10-03T19:21:32.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.927+0000 7fe311c72640 1 -- 172.21.15.45:0/1390190118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe30c0bc860 msgr2=0x7fe30c140740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:32.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.927+0000 7fe311c72640 1 --2- 172.21.15.45:0/1390190118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe30c0bc860 0x7fe30c140740 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fe30400c7a0 tx=0x7fe30400cc60 comp rx=0 tx=0).stop 2023-10-03T19:21:32.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.927+0000 7fe311c72640 1 -- 172.21.15.45:0/1390190118 shutdown_connections 2023-10-03T19:21:32.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.927+0000 7fe311c72640 1 --2- 172.21.15.45:0/1390190118 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fe2f8066280 0x7fe2f8068730 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:32.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.927+0000 7fe311c72640 1 --2- 172.21.15.45:0/1390190118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe30c0bc860 0x7fe30c140740 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:32.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.927+0000 7fe311c72640 1 --2- 172.21.15.45:0/1390190118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe30c06cc20 0x7fe30c140200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:32.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.927+0000 7fe311c72640 1 --2- 172.21.15.45:0/1390190118 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe30c06c410 0x7fe30c0a44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:32.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.927+0000 7fe311c72640 1 -- 172.21.15.45:0/1390190118 >> 172.21.15.45:0/1390190118 conn(0x7fe30c0a20d0 msgr2=0x7fe30c141540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:32.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.927+0000 7fe311c72640 1 -- 172.21.15.45:0/1390190118 shutdown_connections 2023-10-03T19:21:32.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:32.927+0000 7fe311c72640 1 -- 172.21.15.45:0/1390190118 wait complete. 2023-10-03T19:21:32.948 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T19:21:33.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.063+0000 7f3a7ffff640 1 Processor -- start 2023-10-03T19:21:33.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.063+0000 7f3a7ffff640 1 -- start start 2023-10-03T19:21:33.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.063+0000 7f3a7ffff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a80070360 0x7f3a80156c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:33.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.063+0000 7f3a7ffff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a8006ff90 con 0x7f3a800708b0 2023-10-03T19:21:33.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.063+0000 7f3a7ffff640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a8014bfe0 con 0x7f3a800a6de0 2023-10-03T19:21:33.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.063+0000 7f3a7ffff640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a80071a10 con 0x7f3a80070360 2023-10-03T19:21:33.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.063+0000 7f3a767fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3a800708b0 0x7f3a80069ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37568/0 (socket says 172.21.15.45:37568) 2023-10-03T19:21:33.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.063+0000 7f3a767fc640 1 -- 172.21.15.45:0/1791654270 learned_addr learned my addr 172.21.15.45:0/1791654270 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:21:33.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.063+0000 7f3a7f7fe640 1 --2- 172.21.15.45:0/1791654270 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a80070360 0x7f3a80156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:33.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.063+0000 7f3a7e7fc640 1 -- 172.21.15.45:0/1791654270 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1706015409 0 0) 0x7f3a8006ff90 con 0x7f3a800708b0 2023-10-03T19:21:33.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.063+0000 7f3a7e7fc640 1 -- 172.21.15.45:0/1791654270 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a6c003530 con 0x7f3a800708b0 2023-10-03T19:21:33.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7e7fc640 1 -- 172.21.15.45:0/1791654270 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1413852829 0 0) 0x7f3a6c003530 con 0x7f3a800708b0 2023-10-03T19:21:33.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7e7fc640 1 -- 172.21.15.45:0/1791654270 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a80070360 msgr2=0x7f3a80156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:33.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7e7fc640 1 --2- 172.21.15.45:0/1791654270 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a80070360 0x7f3a80156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:33.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7e7fc640 1 -- 172.21.15.45:0/1791654270 >> v1:172.21.15.79:6789/0 conn(0x7f3a800a6de0 legacy=0x7f3a800bd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:33.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7e7fc640 1 -- 172.21.15.45:0/1791654270 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a800bd810 con 0x7f3a800708b0 2023-10-03T19:21:33.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7e7fc640 1 -- 172.21.15.45:0/1791654270 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f3a68001680 con 0x7f3a800708b0 2023-10-03T19:21:33.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7e7fc640 1 -- 172.21.15.45:0/1791654270 >> v1:172.21.15.45:6789/0 conn(0x7f3a800708b0 legacy=0x7f3a80069ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:33.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7e7fc640 1 --2- 172.21.15.45:0/1791654270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a6c003a20 0x7f3a6c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:33.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7e7fc640 1 --2- 172.21.15.45:0/1791654270 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a80070360 0x7f3a6c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:33.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7e7fc640 1 --2- 172.21.15.45:0/1791654270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a6c004d10 0x7f3a6c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:33.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7e7fc640 1 -- 172.21.15.45:0/1791654270 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c00bb20 con 0x7f3a6c004d10 2023-10-03T19:21:33.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7e7fc640 1 -- 172.21.15.45:0/1791654270 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c00bc60 con 0x7f3a6c003a20 2023-10-03T19:21:33.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7e7fc640 1 -- 172.21.15.45:0/1791654270 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c00be20 con 0x7f3a80070360 2023-10-03T19:21:33.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7f7fe640 1 --2- 172.21.15.45:0/1791654270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a6c004d10 0x7f3a6c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:33.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7effd640 1 --2- 172.21.15.45:0/1791654270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a6c003a20 0x7f3a6c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:33.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a767fc640 1 --2- 172.21.15.45:0/1791654270 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a80070360 0x7f3a6c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:33.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7f7fe640 1 -- 172.21.15.45:0/1791654270 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a80070360 msgr2=0x7f3a6c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:33.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7f7fe640 1 --2- 172.21.15.45:0/1791654270 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a80070360 0x7f3a6c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:33.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7f7fe640 1 -- 172.21.15.45:0/1791654270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a6c003a20 msgr2=0x7f3a6c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:33.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7f7fe640 1 --2- 172.21.15.45:0/1791654270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a6c003a20 0x7f3a6c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:33.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7f7fe640 1 -- 172.21.15.45:0/1791654270 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a6c003530 con 0x7f3a6c004d10 2023-10-03T19:21:33.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7f7fe640 1 --2- 172.21.15.45:0/1791654270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a6c004d10 0x7f3a6c005180 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f3a78009fc0 tx=0x7f3a7801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae10cbd6e961848 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:33.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7e7fc640 1 -- 172.21.15.45:0/1791654270 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a780a5b60 con 0x7f3a6c004d10 2023-10-03T19:21:33.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7e7fc640 1 -- 172.21.15.45:0/1791654270 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7800f040 con 0x7f3a6c004d10 2023-10-03T19:21:33.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7e7fc640 1 -- 172.21.15.45:0/1791654270 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a780ad440 con 0x7f3a6c004d10 2023-10-03T19:21:33.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7ffff640 1 -- 172.21.15.45:0/1791654270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a6c004d10 msgr2=0x7f3a6c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:33.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7ffff640 1 --2- 172.21.15.45:0/1791654270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a6c004d10 0x7f3a6c005180 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f3a78009fc0 tx=0x7f3a7801cc60 comp rx=0 tx=0).stop 2023-10-03T19:21:33.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7f7fe640 1 -- 172.21.15.45:0/1791654270 reap_dead start 2023-10-03T19:21:33.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7ffff640 1 -- 172.21.15.45:0/1791654270 shutdown_connections 2023-10-03T19:21:33.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7ffff640 1 -- 172.21.15.45:0/1791654270 >> 172.21.15.45:0/1791654270 conn(0x7f3a800bdda0 msgr2=0x7f3a800be1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:33.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7ffff640 1 -- 172.21.15.45:0/1791654270 shutdown_connections 2023-10-03T19:21:33.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.067+0000 7f3a7ffff640 1 -- 172.21.15.45:0/1791654270 wait complete. 2023-10-03T19:21:33.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.071+0000 7f3a7ffff640 1 Processor -- start 2023-10-03T19:21:33.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.071+0000 7f3a7ffff640 1 -- start start 2023-10-03T19:21:33.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.071+0000 7f3a7ffff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a800baa50 0x7f3a800bae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:33.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.071+0000 7f3a7ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a8014b300 0x7f3a800b8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:33.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.071+0000 7f3a7ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a800b8c40 0x7f3a80143dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:33.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.071+0000 7f3a7ffff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a800bb360 con 0x7f3a800b8c40 2023-10-03T19:21:33.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.071+0000 7f3a7ffff640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a80144e60 con 0x7f3a8014b300 2023-10-03T19:21:33.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.071+0000 7f3a7ffff640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a800bb5f0 con 0x7f3a800baa50 2023-10-03T19:21:33.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.071+0000 7f3a7f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a800b8c40 0x7f3a80143dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:33.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.071+0000 7f3a7f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a800b8c40 0x7f3a80143dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57926/0 (socket says 172.21.15.45:57926) 2023-10-03T19:21:33.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.071+0000 7f3a7f7fe640 1 -- 172.21.15.45:0/884387724 learned_addr learned my addr 172.21.15.45:0/884387724 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:33.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.071+0000 7f3a7effd640 1 --2- 172.21.15.45:0/884387724 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a800baa50 0x7f3a800bae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:33.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.071+0000 7f3a767fc640 1 --2- 172.21.15.45:0/884387724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a8014b300 0x7f3a800b8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:33.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.071+0000 7f3a7f7fe640 1 -- 172.21.15.45:0/884387724 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a800baa50 msgr2=0x7f3a800bae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:33.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.071+0000 7f3a7f7fe640 1 --2- 172.21.15.45:0/884387724 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a800baa50 0x7f3a800bae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:33.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.071+0000 7f3a7f7fe640 1 -- 172.21.15.45:0/884387724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a8014b300 msgr2=0x7f3a800b8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:33.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.071+0000 7f3a7f7fe640 1 --2- 172.21.15.45:0/884387724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a8014b300 0x7f3a800b8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:33.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.071+0000 7f3a7f7fe640 1 -- 172.21.15.45:0/884387724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8006b1f0 con 0x7f3a800b8c40 2023-10-03T19:21:33.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.071+0000 7f3a7f7fe640 1 --2- 172.21.15.45:0/884387724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a800b8c40 0x7f3a80143dc0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f3a78002240 tx=0x7f3a78009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:33.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.071+0000 7f3a77fff640 1 -- 172.21.15.45:0/884387724 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a780039a0 con 0x7f3a800b8c40 2023-10-03T19:21:33.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.071+0000 7f3a77fff640 1 -- 172.21.15.45:0/884387724 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a78003b00 con 0x7f3a800b8c40 2023-10-03T19:21:33.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.071+0000 7f3a7ffff640 1 -- 172.21.15.45:0/884387724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a800a71b0 con 0x7f3a800b8c40 2023-10-03T19:21:33.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.071+0000 7f3a77fff640 1 -- 172.21.15.45:0/884387724 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a78003e70 con 0x7f3a800b8c40 2023-10-03T19:21:33.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.071+0000 7f3a7ffff640 1 -- 172.21.15.45:0/884387724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a800bc640 con 0x7f3a800b8c40 2023-10-03T19:21:33.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.071+0000 7f3a7ffff640 1 -- 172.21.15.45:0/884387724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a800bd300 con 0x7f3a800b8c40 2023-10-03T19:21:33.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.071+0000 7f3a77fff640 1 -- 172.21.15.45:0/884387724 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3a780b4040 con 0x7f3a800b8c40 2023-10-03T19:21:33.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.075+0000 7f3a77fff640 1 --2- 172.21.15.45:0/884387724 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3a60066280 0x7f3a60068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:33.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.075+0000 7f3a77fff640 1 -- 172.21.15.45:0/884387724 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f3a780a5e40 con 0x7f3a800b8c40 2023-10-03T19:21:33.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.075+0000 7f3a7effd640 1 --2- 172.21.15.45:0/884387724 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3a60066280 0x7f3a60068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:33.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.075+0000 7f3a7effd640 1 --2- 172.21.15.45:0/884387724 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3a60066280 0x7f3a60068730 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f3a70000c10 tx=0x7f3a70009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:33.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.079+0000 7f3a77fff640 1 -- 172.21.15.45:0/884387724 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3a780eb200 con 0x7f3a800b8c40 2023-10-03T19:21:33.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.227+0000 7f3a7ffff640 1 -- 172.21.15.45:0/884387724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3a80073b10 con 0x7f3a800b8c40 2023-10-03T19:21:33.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.227+0000 7f3a77fff640 1 -- 172.21.15.45:0/884387724 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v110) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3a780b20a0 con 0x7f3a800b8c40 2023-10-03T19:21:33.232 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-10-03T19:21:33.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.231+0000 7f3a7ffff640 1 -- 172.21.15.45:0/884387724 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3a60066280 msgr2=0x7f3a60068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:33.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.231+0000 7f3a7ffff640 1 --2- 172.21.15.45:0/884387724 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3a60066280 0x7f3a60068730 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f3a70000c10 tx=0x7f3a70009040 comp rx=0 tx=0).stop 2023-10-03T19:21:33.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.231+0000 7f3a7ffff640 1 -- 172.21.15.45:0/884387724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a800b8c40 msgr2=0x7f3a80143dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:33.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.231+0000 7f3a7ffff640 1 --2- 172.21.15.45:0/884387724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a800b8c40 0x7f3a80143dc0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f3a78002240 tx=0x7f3a78009750 comp rx=0 tx=0).stop 2023-10-03T19:21:33.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.231+0000 7f3a7ffff640 1 -- 172.21.15.45:0/884387724 shutdown_connections 2023-10-03T19:21:33.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.231+0000 7f3a7ffff640 1 --2- 172.21.15.45:0/884387724 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f3a60066280 0x7f3a60068730 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:33.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.231+0000 7f3a7ffff640 1 --2- 172.21.15.45:0/884387724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a800b8c40 0x7f3a80143dc0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:33.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.231+0000 7f3a7ffff640 1 --2- 172.21.15.45:0/884387724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a8014b300 0x7f3a800b8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:33.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.231+0000 7f3a7ffff640 1 --2- 172.21.15.45:0/884387724 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a800baa50 0x7f3a800bae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:33.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.231+0000 7f3a7ffff640 1 -- 172.21.15.45:0/884387724 >> 172.21.15.45:0/884387724 conn(0x7f3a800bdda0 msgr2=0x7f3a800a61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:33.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.231+0000 7f3a7ffff640 1 -- 172.21.15.45:0/884387724 shutdown_connections 2023-10-03T19:21:33.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.231+0000 7f3a7ffff640 1 -- 172.21.15.45:0/884387724 wait complete. 2023-10-03T19:21:33.250 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:21:33.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.355+0000 7fde54823640 1 Processor -- start 2023-10-03T19:21:33.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.355+0000 7fde54823640 1 -- start start 2023-10-03T19:21:33.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.359+0000 7fde54823640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde500bf370 0x7fde50149760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:33.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.359+0000 7fde54823640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fde5014d310 0x7fde50149ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:33.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.359+0000 7fde54823640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5014c770 con 0x7fde500a7100 2023-10-03T19:21:33.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.359+0000 7fde54823640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde50150c00 con 0x7fde5014d310 2023-10-03T19:21:33.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.359+0000 7fde54823640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde500bebc0 con 0x7fde500bf370 2023-10-03T19:21:33.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.359+0000 7fde4ed9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fde5014d310 0x7fde50149ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:33.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.359+0000 7fde4ed9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fde5014d310 0x7fde50149ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57928/0 (socket says 172.21.15.45:57928) 2023-10-03T19:21:33.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.359+0000 7fde4ed9d640 1 -- 172.21.15.45:0/3254203517 learned_addr learned my addr 172.21.15.45:0/3254203517 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:33.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.359+0000 7fde4e59c640 1 --2- 172.21.15.45:0/3254203517 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde500bf370 0x7fde50149760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:33.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.359+0000 7fde4ed9d640 1 -- 172.21.15.45:0/3254203517 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde500bf370 msgr2=0x7fde50149760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:33.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.359+0000 7fde4ed9d640 1 --2- 172.21.15.45:0/3254203517 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde500bf370 0x7fde50149760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:33.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.359+0000 7fde4ed9d640 1 -- 172.21.15.45:0/3254203517 >> v1:172.21.15.79:6789/0 conn(0x7fde500a7100 legacy=0x7fde5014cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:33.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.359+0000 7fde4ed9d640 1 -- 172.21.15.45:0/3254203517 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5006efe0 con 0x7fde5014d310 2023-10-03T19:21:33.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.359+0000 7fde4ed9d640 1 --2- 172.21.15.45:0/3254203517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde5014d310 0x7fde50149ca0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fde48009e50 tx=0x7fde4801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2a8b46dd93f4e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:33.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.359+0000 7fde4d59a640 1 -- 172.21.15.45:0/3254203517 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde480a5860 con 0x7fde5014d310 2023-10-03T19:21:33.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.359+0000 7fde4d59a640 1 -- 172.21.15.45:0/3254203517 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde480a59c0 con 0x7fde5014d310 2023-10-03T19:21:33.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.359+0000 7fde4d59a640 1 -- 172.21.15.45:0/3254203517 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde480a5d50 con 0x7fde5014d310 2023-10-03T19:21:33.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.359+0000 7fde54823640 1 -- 172.21.15.45:0/3254203517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde5014d310 msgr2=0x7fde50149ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:33.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.359+0000 7fde54823640 1 --2- 172.21.15.45:0/3254203517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde5014d310 0x7fde50149ca0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fde48009e50 tx=0x7fde4801c980 comp rx=0 tx=0).stop 2023-10-03T19:21:33.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.359+0000 7fde54823640 1 -- 172.21.15.45:0/3254203517 shutdown_connections 2023-10-03T19:21:33.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.359+0000 7fde54823640 1 --2- 172.21.15.45:0/3254203517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde5014d310 0x7fde50149ca0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:33.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.359+0000 7fde54823640 1 --2- 172.21.15.45:0/3254203517 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde500bf370 0x7fde50149760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:33.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.359+0000 7fde54823640 1 -- 172.21.15.45:0/3254203517 >> 172.21.15.45:0/3254203517 conn(0x7fde5006bce0 msgr2=0x7fde5006c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:33.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.359+0000 7fde54823640 1 -- 172.21.15.45:0/3254203517 shutdown_connections 2023-10-03T19:21:33.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.359+0000 7fde54823640 1 -- 172.21.15.45:0/3254203517 wait complete. 2023-10-03T19:21:33.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.363+0000 7fde54823640 1 Processor -- start 2023-10-03T19:21:33.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.363+0000 7fde54823640 1 -- start start 2023-10-03T19:21:33.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.363+0000 7fde54823640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde500a7100 0x7fde500c1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:33.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.363+0000 7fde54823640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde500bf370 0x7fde50141970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:33.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.363+0000 7fde54823640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde5014d310 0x7fde501494d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:33.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.363+0000 7fde54823640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde50143950 con 0x7fde5014d310 2023-10-03T19:21:33.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.363+0000 7fde54823640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5014f3c0 con 0x7fde500bf370 2023-10-03T19:21:33.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.363+0000 7fde54823640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde50142d40 con 0x7fde500a7100 2023-10-03T19:21:33.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.363+0000 7fde4ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde5014d310 0x7fde501494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:33.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.363+0000 7fde4ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde5014d310 0x7fde501494d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57944/0 (socket says 172.21.15.45:57944) 2023-10-03T19:21:33.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.363+0000 7fde4ed9d640 1 -- 172.21.15.45:0/1372965209 learned_addr learned my addr 172.21.15.45:0/1372965209 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:33.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.363+0000 7fde4e59c640 1 --2- 172.21.15.45:0/1372965209 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde500a7100 0x7fde500c1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:33.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.363+0000 7fde4dd9b640 1 --2- 172.21.15.45:0/1372965209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde500bf370 0x7fde50141970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:33.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.363+0000 7fde4ed9d640 1 -- 172.21.15.45:0/1372965209 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde500a7100 msgr2=0x7fde500c1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:33.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.363+0000 7fde4ed9d640 1 --2- 172.21.15.45:0/1372965209 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde500a7100 0x7fde500c1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:33.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.363+0000 7fde4ed9d640 1 -- 172.21.15.45:0/1372965209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde500bf370 msgr2=0x7fde50141970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:33.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.363+0000 7fde4ed9d640 1 --2- 172.21.15.45:0/1372965209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde500bf370 0x7fde50141970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:33.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.363+0000 7fde4ed9d640 1 -- 172.21.15.45:0/1372965209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde48009b30 con 0x7fde5014d310 2023-10-03T19:21:33.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.363+0000 7fde4e59c640 1 --2- 172.21.15.45:0/1372965209 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde500a7100 0x7fde500c1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:21:33.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.363+0000 7fde4dd9b640 1 --2- 172.21.15.45:0/1372965209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde500bf370 0x7fde50141970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:21:33.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.363+0000 7fde4ed9d640 1 --2- 172.21.15.45:0/1372965209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde5014d310 0x7fde501494d0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fde4801a5b0 tx=0x7fde48019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:33.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.363+0000 7fde3effd640 1 -- 172.21.15.45:0/1372965209 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde480b8670 con 0x7fde5014d310 2023-10-03T19:21:33.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.363+0000 7fde3effd640 1 -- 172.21.15.45:0/1372965209 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde480b87d0 con 0x7fde5014d310 2023-10-03T19:21:33.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.363+0000 7fde54823640 1 -- 172.21.15.45:0/1372965209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde500bca70 con 0x7fde5014d310 2023-10-03T19:21:33.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.363+0000 7fde3effd640 1 -- 172.21.15.45:0/1372965209 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde480b8b60 con 0x7fde5014d310 2023-10-03T19:21:33.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.363+0000 7fde54823640 1 -- 172.21.15.45:0/1372965209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde500bc8e0 con 0x7fde5014d310 2023-10-03T19:21:33.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.363+0000 7fde54823640 1 -- 172.21.15.45:0/1372965209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde50150400 con 0x7fde5014d310 2023-10-03T19:21:33.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.363+0000 7fde3effd640 1 -- 172.21.15.45:0/1372965209 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fde480b8cc0 con 0x7fde5014d310 2023-10-03T19:21:33.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.367+0000 7fde3effd640 1 --2- 172.21.15.45:0/1372965209 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fde300662b0 0x7fde30068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:33.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.367+0000 7fde3effd640 1 -- 172.21.15.45:0/1372965209 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fde4811f3c0 con 0x7fde5014d310 2023-10-03T19:21:33.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.367+0000 7fde4e59c640 1 --2- 172.21.15.45:0/1372965209 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fde300662b0 0x7fde30068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:33.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.367+0000 7fde4e59c640 1 --2- 172.21.15.45:0/1372965209 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fde300662b0 0x7fde30068760 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fde40009840 tx=0x7fde40008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:33.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.371+0000 7fde3effd640 1 -- 172.21.15.45:0/1372965209 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fde480ec9c0 con 0x7fde5014d310 2023-10-03T19:21:33.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.551+0000 7fde54823640 1 -- 172.21.15.45:0/1372965209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde5014f500 con 0x7fde5014d310 2023-10-03T19:21:33.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.551+0000 7fde3effd640 1 -- 172.21.15.45:0/1372965209 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+3916 (secure 0 0 0) 0x7fde5014f500 con 0x7fde5014d310 2023-10-03T19:21:33.557 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:21:33.557 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":58,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3566869652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3566869652},{"type":"v1","addr":"172.21.15.79:6835","nonce":3566869652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":7587,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2339652261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2339652261},{"type":"v1","addr":"172.21.15.45:6833","nonce":2339652261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:20:16.301166+0000","modified":"2023-10-03T19:20:19.318778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7602":{"gid":7602,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1723126563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1723126563},{"type":"v1","addr":"172.21.15.45:6835","nonce":1723126563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-10-03T19:21:33.558 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 58 2023-10-03T19:21:33.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.555+0000 7fde54823640 1 -- 172.21.15.45:0/1372965209 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fde300662b0 msgr2=0x7fde30068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:33.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.555+0000 7fde54823640 1 --2- 172.21.15.45:0/1372965209 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fde300662b0 0x7fde30068760 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fde40009840 tx=0x7fde40008040 comp rx=0 tx=0).stop 2023-10-03T19:21:33.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.555+0000 7fde54823640 1 -- 172.21.15.45:0/1372965209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde5014d310 msgr2=0x7fde501494d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:33.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.555+0000 7fde54823640 1 --2- 172.21.15.45:0/1372965209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde5014d310 0x7fde501494d0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fde4801a5b0 tx=0x7fde48019720 comp rx=0 tx=0).stop 2023-10-03T19:21:33.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.555+0000 7fde54823640 1 -- 172.21.15.45:0/1372965209 shutdown_connections 2023-10-03T19:21:33.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.555+0000 7fde54823640 1 --2- 172.21.15.45:0/1372965209 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fde300662b0 0x7fde30068760 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:33.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.555+0000 7fde54823640 1 --2- 172.21.15.45:0/1372965209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde5014d310 0x7fde501494d0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:33.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.555+0000 7fde54823640 1 --2- 172.21.15.45:0/1372965209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde500bf370 0x7fde50141970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:33.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.555+0000 7fde54823640 1 --2- 172.21.15.45:0/1372965209 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde500a7100 0x7fde500c1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:33.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.555+0000 7fde54823640 1 -- 172.21.15.45:0/1372965209 >> 172.21.15.45:0/1372965209 conn(0x7fde5006bce0 msgr2=0x7fde500a66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:33.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.555+0000 7fde54823640 1 -- 172.21.15.45:0/1372965209 shutdown_connections 2023-10-03T19:21:33.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.555+0000 7fde54823640 1 -- 172.21.15.45:0/1372965209 wait complete. 2023-10-03T19:21:33.575 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:21:33.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.691+0000 7f0825f91640 1 Processor -- start 2023-10-03T19:21:33.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.691+0000 7f0825f91640 1 -- start start 2023-10-03T19:21:33.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.691+0000 7f0825f91640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0820148b90 0x7f08200bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:33.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.691+0000 7f0825f91640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08200bcb60 0x7f082006c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:33.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.691+0000 7f0825f91640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f082014b610 con 0x7f08200bc4a0 2023-10-03T19:21:33.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.691+0000 7f0825f91640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08200a3670 con 0x7f0820148b90 2023-10-03T19:21:33.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.691+0000 7f0825f91640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f082014b370 con 0x7f08200bcb60 2023-10-03T19:21:33.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.691+0000 7f081f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0820148b90 0x7f08200bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:33.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.691+0000 7f081f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0820148b90 0x7f08200bbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57954/0 (socket says 172.21.15.45:57954) 2023-10-03T19:21:33.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.691+0000 7f081f7fe640 1 -- 172.21.15.45:0/1260131169 learned_addr learned my addr 172.21.15.45:0/1260131169 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:33.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.691+0000 7f081ffff640 1 --1- 172.21.15.45:0/1260131169 >> v1:172.21.15.45:6789/0 conn(0x7f08200bc4a0 0x7f082006c7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37584/0 (socket says 172.21.15.45:37584) 2023-10-03T19:21:33.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.691+0000 7f081effd640 1 --2- 172.21.15.45:0/1260131169 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08200bcb60 0x7f082006c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:33.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.691+0000 7f081f7fe640 1 -- 172.21.15.45:0/1260131169 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08200bcb60 msgr2=0x7f082006c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:33.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.691+0000 7f081f7fe640 1 --2- 172.21.15.45:0/1260131169 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08200bcb60 0x7f082006c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:33.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.691+0000 7f081f7fe640 1 -- 172.21.15.45:0/1260131169 >> v1:172.21.15.45:6789/0 conn(0x7f08200bc4a0 legacy=0x7f082006c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:33.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.691+0000 7f081f7fe640 1 -- 172.21.15.45:0/1260131169 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08200a5580 con 0x7f0820148b90 2023-10-03T19:21:33.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.691+0000 7f081effd640 1 --2- 172.21.15.45:0/1260131169 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08200bcb60 0x7f082006c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:21:33.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.695+0000 7f081f7fe640 1 --2- 172.21.15.45:0/1260131169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0820148b90 0x7f08200bbf60 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f081000bb10 tx=0x7f0810021400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=522ac2b121fe350b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:33.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.695+0000 7f081e7fc640 1 -- 172.21.15.45:0/1260131169 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08100b1600 con 0x7f0820148b90 2023-10-03T19:21:33.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.695+0000 7f081e7fc640 1 -- 172.21.15.45:0/1260131169 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08100ad050 con 0x7f0820148b90 2023-10-03T19:21:33.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.695+0000 7f081e7fc640 1 -- 172.21.15.45:0/1260131169 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08100b1980 con 0x7f0820148b90 2023-10-03T19:21:33.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.695+0000 7f0825f91640 1 -- 172.21.15.45:0/1260131169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0820148b90 msgr2=0x7f08200bbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:33.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.695+0000 7f0825f91640 1 --2- 172.21.15.45:0/1260131169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0820148b90 0x7f08200bbf60 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f081000bb10 tx=0x7f0810021400 comp rx=0 tx=0).stop 2023-10-03T19:21:33.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.695+0000 7f0825f91640 1 -- 172.21.15.45:0/1260131169 shutdown_connections 2023-10-03T19:21:33.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.695+0000 7f0825f91640 1 --2- 172.21.15.45:0/1260131169 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08200bcb60 0x7f082006c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:33.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.695+0000 7f0825f91640 1 --2- 172.21.15.45:0/1260131169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0820148b90 0x7f08200bbf60 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:33.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.695+0000 7f0825f91640 1 -- 172.21.15.45:0/1260131169 >> 172.21.15.45:0/1260131169 conn(0x7f08200bcf50 msgr2=0x7f08200bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:33.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.695+0000 7f0825f91640 1 -- 172.21.15.45:0/1260131169 shutdown_connections 2023-10-03T19:21:33.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.695+0000 7f0825f91640 1 -- 172.21.15.45:0/1260131169 wait complete. 2023-10-03T19:21:33.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.695+0000 7f0825f91640 1 Processor -- start 2023-10-03T19:21:33.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.695+0000 7f0825f91640 1 -- start start 2023-10-03T19:21:33.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.699+0000 7f0825f91640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08200bc4a0 0x7f0820070e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:33.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.699+0000 7f0825f91640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08200bcb60 0x7f0820144980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:33.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.699+0000 7f0825f91640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0820148b90 0x7f0820144ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:33.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.699+0000 7f0825f91640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0820145400 con 0x7f08200bc4a0 2023-10-03T19:21:33.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.699+0000 7f0825f91640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08201e3c60 con 0x7f0820148b90 2023-10-03T19:21:33.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.699+0000 7f0825f91640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08201e4190 con 0x7f08200bcb60 2023-10-03T19:21:33.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.699+0000 7f081f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08200bc4a0 0x7f0820070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:33.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.699+0000 7f081f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08200bc4a0 0x7f0820070e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57966/0 (socket says 172.21.15.45:57966) 2023-10-03T19:21:33.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.699+0000 7f081f7fe640 1 -- 172.21.15.45:0/2586952323 learned_addr learned my addr 172.21.15.45:0/2586952323 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:33.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.699+0000 7f081f7fe640 1 -- 172.21.15.45:0/2586952323 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08200bcb60 msgr2=0x7f0820144980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:33.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.699+0000 7f081f7fe640 1 --2- 172.21.15.45:0/2586952323 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08200bcb60 0x7f0820144980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:33.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.699+0000 7f081f7fe640 1 -- 172.21.15.45:0/2586952323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0820148b90 msgr2=0x7f0820144ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:33.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.699+0000 7f081f7fe640 1 --2- 172.21.15.45:0/2586952323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0820148b90 0x7f0820144ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:33.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.699+0000 7f081f7fe640 1 -- 172.21.15.45:0/2586952323 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081000b770 con 0x7f08200bc4a0 2023-10-03T19:21:33.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.699+0000 7f081f7fe640 1 --2- 172.21.15.45:0/2586952323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08200bc4a0 0x7f0820070e00 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f081001fab0 tx=0x7f081001fc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:33.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.699+0000 7f0817fff640 1 -- 172.21.15.45:0/2586952323 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08100b9880 con 0x7f08200bc4a0 2023-10-03T19:21:33.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.699+0000 7f0817fff640 1 -- 172.21.15.45:0/2586952323 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08100b9a00 con 0x7f08200bc4a0 2023-10-03T19:21:33.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.699+0000 7f0825f91640 1 -- 172.21.15.45:0/2586952323 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f082006cee0 con 0x7f08200bc4a0 2023-10-03T19:21:33.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.699+0000 7f0817fff640 1 -- 172.21.15.45:0/2586952323 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08100b9db0 con 0x7f08200bc4a0 2023-10-03T19:21:33.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.699+0000 7f0825f91640 1 -- 172.21.15.45:0/2586952323 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08200a5820 con 0x7f08200bc4a0 2023-10-03T19:21:33.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.699+0000 7f0825f91640 1 -- 172.21.15.45:0/2586952323 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0820148f60 con 0x7f08200bc4a0 2023-10-03T19:21:33.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.699+0000 7f0817fff640 1 -- 172.21.15.45:0/2586952323 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f08100c5460 con 0x7f08200bc4a0 2023-10-03T19:21:33.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.699+0000 7f0817fff640 1 --2- 172.21.15.45:0/2586952323 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0800066280 0x7f0800068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:33.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.699+0000 7f0817fff640 1 -- 172.21.15.45:0/2586952323 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f08101226b0 con 0x7f08200bc4a0 2023-10-03T19:21:33.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.699+0000 7f081effd640 1 --2- 172.21.15.45:0/2586952323 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0800066280 0x7f0800068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:33.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.703+0000 7f081effd640 1 --2- 172.21.15.45:0/2586952323 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0800066280 0x7f0800068730 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f08200bd590 tx=0x7f0808008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:33.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.703+0000 7f0817fff640 1 -- 172.21.15.45:0/2586952323 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f08100efaf0 con 0x7f08200bc4a0 2023-10-03T19:21:33.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.859+0000 7f0825f91640 1 -- 172.21.15.45:0/2586952323 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f082004de80 con 0x7f08200bc4a0 2023-10-03T19:21:33.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.863+0000 7f0817fff640 1 -- 172.21.15.45:0/2586952323 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+18375 (secure 0 0 0) 0x7f08100f3110 con 0x7f08200bc4a0 2023-10-03T19:21:33.866 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:21:33.866 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":110,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:20:34.764210+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:20:13.940428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-10-03T19:20:15.290748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:0/2294298422":"2023-10-03T20:20:34.239894+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:21:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.863+0000 7f0825f91640 1 -- 172.21.15.45:0/2586952323 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0800066280 msgr2=0x7f0800068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.863+0000 7f0825f91640 1 --2- 172.21.15.45:0/2586952323 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0800066280 0x7f0800068730 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f08200bd590 tx=0x7f0808008040 comp rx=0 tx=0).stop 2023-10-03T19:21:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.863+0000 7f0825f91640 1 -- 172.21.15.45:0/2586952323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08200bc4a0 msgr2=0x7f0820070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.863+0000 7f0825f91640 1 --2- 172.21.15.45:0/2586952323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08200bc4a0 0x7f0820070e00 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f081001fab0 tx=0x7f081001fc40 comp rx=0 tx=0).stop 2023-10-03T19:21:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.863+0000 7f0825f91640 1 -- 172.21.15.45:0/2586952323 shutdown_connections 2023-10-03T19:21:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.863+0000 7f0825f91640 1 --2- 172.21.15.45:0/2586952323 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0800066280 0x7f0800068730 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.863+0000 7f0825f91640 1 --2- 172.21.15.45:0/2586952323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0820148b90 0x7f0820144ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.863+0000 7f0825f91640 1 --2- 172.21.15.45:0/2586952323 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f08200bcb60 0x7f0820144980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.863+0000 7f0825f91640 1 --2- 172.21.15.45:0/2586952323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08200bc4a0 0x7f0820070e00 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.863+0000 7f0825f91640 1 -- 172.21.15.45:0/2586952323 >> 172.21.15.45:0/2586952323 conn(0x7f08200bcf50 msgr2=0x7f08200b98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.863+0000 7f0825f91640 1 -- 172.21.15.45:0/2586952323 shutdown_connections 2023-10-03T19:21:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:33.863+0000 7f0825f91640 1 -- 172.21.15.45:0/2586952323 wait complete. 2023-10-03T19:21:33.885 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-03T19:21:33.885 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:21:34.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.007+0000 7f4991e89640 1 Processor -- start 2023-10-03T19:21:34.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.007+0000 7f4991e89640 1 -- start start 2023-10-03T19:21:34.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f4991e89640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f498c158250 0x7f498c15a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:34.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f4991e89640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f498c0c0020 con 0x7f498c151fb0 2023-10-03T19:21:34.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f4991e89640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f498c0c0300 con 0x7f498c1517a0 2023-10-03T19:21:34.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f4991e89640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f498c070350 con 0x7f498c158250 2023-10-03T19:21:34.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498affd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f498c151fb0 0x7f498c152410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37588/0 (socket says 172.21.15.45:37588) 2023-10-03T19:21:34.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498affd640 1 -- 172.21.15.45:0/1529772737 learned_addr learned my addr 172.21.15.45:0/1529772737 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:21:34.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498bfff640 1 --2- 172.21.15.45:0/1529772737 >> v2:172.21.15.79:3300/0 conn(0x7f498c158250 0x7f498c15a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:34.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498a7fc640 1 -- 172.21.15.45:0/1529772737 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682421033 0 0) 0x7f498c0c0020 con 0x7f498c151fb0 2023-10-03T19:21:34.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498a7fc640 1 -- 172.21.15.45:0/1529772737 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4974003530 con 0x7f498c151fb0 2023-10-03T19:21:34.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498a7fc640 1 -- 172.21.15.45:0/1529772737 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1660610567 0 0) 0x7f4974003530 con 0x7f498c151fb0 2023-10-03T19:21:34.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498a7fc640 1 -- 172.21.15.45:0/1529772737 >> v2:172.21.15.79:3300/0 conn(0x7f498c158250 msgr2=0x7f498c15a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:34.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498a7fc640 1 --2- 172.21.15.45:0/1529772737 >> v2:172.21.15.79:3300/0 conn(0x7f498c158250 0x7f498c15a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:34.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498a7fc640 1 -- 172.21.15.45:0/1529772737 >> v1:172.21.15.79:6789/0 conn(0x7f498c1517a0 legacy=0x7f498c06aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:34.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498a7fc640 1 -- 172.21.15.45:0/1529772737 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498c0bd2d0 con 0x7f498c151fb0 2023-10-03T19:21:34.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498a7fc640 1 -- 172.21.15.45:0/1529772737 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f4980001680 con 0x7f498c151fb0 2023-10-03T19:21:34.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498a7fc640 1 -- 172.21.15.45:0/1529772737 >> v1:172.21.15.45:6789/0 conn(0x7f498c151fb0 legacy=0x7f498c152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:34.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498a7fc640 1 --2- 172.21.15.45:0/1529772737 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4974003980 0x7f4974003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:34.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498a7fc640 1 --2- 172.21.15.45:0/1529772737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49740047d0 0x7f4974004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:34.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498a7fc640 1 --2- 172.21.15.45:0/1529772737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4974005180 0x7f497400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:34.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498a7fc640 1 -- 172.21.15.45:0/1529772737 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498c070350 con 0x7f49740047d0 2023-10-03T19:21:34.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498a7fc640 1 -- 172.21.15.45:0/1529772737 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497400c000 con 0x7f4974005180 2023-10-03T19:21:34.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498a7fc640 1 -- 172.21.15.45:0/1529772737 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497400c1c0 con 0x7f4974003980 2023-10-03T19:21:34.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498affd640 1 --2- 172.21.15.45:0/1529772737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49740047d0 0x7f4974004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:34.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498bfff640 1 --2- 172.21.15.45:0/1529772737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4974005180 0x7f497400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:34.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498b7fe640 1 --2- 172.21.15.45:0/1529772737 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4974003980 0x7f4974003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:34.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498affd640 1 -- 172.21.15.45:0/1529772737 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4974003980 msgr2=0x7f4974003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:34.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498affd640 1 --2- 172.21.15.45:0/1529772737 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4974003980 0x7f4974003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:34.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498affd640 1 -- 172.21.15.45:0/1529772737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4974005180 msgr2=0x7f497400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:34.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498affd640 1 --2- 172.21.15.45:0/1529772737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4974005180 0x7f497400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:34.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498affd640 1 -- 172.21.15.45:0/1529772737 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4974003530 con 0x7f49740047d0 2023-10-03T19:21:34.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498bfff640 1 -- 172.21.15.45:0/1529772737 reap_dead start 2023-10-03T19:21:34.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498affd640 1 --2- 172.21.15.45:0/1529772737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49740047d0 0x7f4974004c40 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f498000c1c0 tx=0x7f498001f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0195b796127660a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:34.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498a7fc640 1 -- 172.21.15.45:0/1529772737 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49800a8e70 con 0x7f49740047d0 2023-10-03T19:21:34.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498a7fc640 1 -- 172.21.15.45:0/1529772737 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49800058e0 con 0x7f49740047d0 2023-10-03T19:21:34.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.011+0000 7f498a7fc640 1 -- 172.21.15.45:0/1529772737 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4980005d10 con 0x7f49740047d0 2023-10-03T19:21:34.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f4991e89640 1 -- 172.21.15.45:0/1529772737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49740047d0 msgr2=0x7f4974004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:34.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f4991e89640 1 --2- 172.21.15.45:0/1529772737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49740047d0 0x7f4974004c40 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f498000c1c0 tx=0x7f498001f350 comp rx=0 tx=0).stop 2023-10-03T19:21:34.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f4991e89640 1 -- 172.21.15.45:0/1529772737 shutdown_connections 2023-10-03T19:21:34.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f4991e89640 1 --2- 172.21.15.45:0/1529772737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49740047d0 0x7f4974004c40 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:34.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f4991e89640 1 -- 172.21.15.45:0/1529772737 >> 172.21.15.45:0/1529772737 conn(0x7f498c0c2280 msgr2=0x7f498c0be070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:34.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f4991e89640 1 -- 172.21.15.45:0/1529772737 shutdown_connections 2023-10-03T19:21:34.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f4991e89640 1 -- 172.21.15.45:0/1529772737 wait complete. 2023-10-03T19:21:34.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f4991e89640 1 Processor -- start 2023-10-03T19:21:34.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f4991e89640 1 -- start start 2023-10-03T19:21:34.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f4991e89640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49740047d0 0x7f498c06c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:34.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f4991e89640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f498c0a24d0 0x7f498c0a2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:34.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f4991e89640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f498c14d9a0 0x7f498c0a6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:34.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f4991e89640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498c06df60 con 0x7f49740047d0 2023-10-03T19:21:34.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f4991e89640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498c148520 con 0x7f498c14d9a0 2023-10-03T19:21:34.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f4991e89640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f498c14ef00 con 0x7f498c0a24d0 2023-10-03T19:21:34.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f498b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49740047d0 0x7f498c06c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:34.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f498b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49740047d0 0x7f498c06c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57976/0 (socket says 172.21.15.45:57976) 2023-10-03T19:21:34.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f498b7fe640 1 -- 172.21.15.45:0/1104674798 learned_addr learned my addr 172.21.15.45:0/1104674798 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:34.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f498bfff640 1 --2- 172.21.15.45:0/1104674798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f498c14d9a0 0x7f498c0a6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:34.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f498affd640 1 --2- 172.21.15.45:0/1104674798 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f498c0a24d0 0x7f498c0a2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:34.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f498b7fe640 1 -- 172.21.15.45:0/1104674798 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f498c0a24d0 msgr2=0x7f498c0a2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:34.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f498b7fe640 1 --2- 172.21.15.45:0/1104674798 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f498c0a24d0 0x7f498c0a2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:34.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f498b7fe640 1 -- 172.21.15.45:0/1104674798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f498c14d9a0 msgr2=0x7f498c0a6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:34.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f498b7fe640 1 --2- 172.21.15.45:0/1104674798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f498c14d9a0 0x7f498c0a6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:34.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f498b7fe640 1 -- 172.21.15.45:0/1104674798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498c0bcf60 con 0x7f49740047d0 2023-10-03T19:21:34.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f498affd640 1 --2- 172.21.15.45:0/1104674798 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f498c0a24d0 0x7f498c0a2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:21:34.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f498b7fe640 1 --2- 172.21.15.45:0/1104674798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49740047d0 0x7f498c06c940 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f497c00d4c0 tx=0x7f497c00d980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:34.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f4973fff640 1 -- 172.21.15.45:0/1104674798 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c005480 con 0x7f49740047d0 2023-10-03T19:21:34.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f4973fff640 1 -- 172.21.15.45:0/1104674798 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497c003620 con 0x7f49740047d0 2023-10-03T19:21:34.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f4991e89640 1 -- 172.21.15.45:0/1104674798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f498c0bc330 con 0x7f49740047d0 2023-10-03T19:21:34.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f4973fff640 1 -- 172.21.15.45:0/1104674798 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c0039f0 con 0x7f49740047d0 2023-10-03T19:21:34.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.015+0000 7f4991e89640 1 -- 172.21.15.45:0/1104674798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f498c151b70 con 0x7f49740047d0 2023-10-03T19:21:34.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.019+0000 7f4991e89640 1 -- 172.21.15.45:0/1104674798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f498c0bd850 con 0x7f49740047d0 2023-10-03T19:21:34.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.019+0000 7f4973fff640 1 -- 172.21.15.45:0/1104674798 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f497c003b50 con 0x7f49740047d0 2023-10-03T19:21:34.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.019+0000 7f4973fff640 1 --2- 172.21.15.45:0/1104674798 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4978066280 0x7f4978068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:34.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.019+0000 7f4973fff640 1 -- 172.21.15.45:0/1104674798 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f497c083d40 con 0x7f49740047d0 2023-10-03T19:21:34.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.019+0000 7f498affd640 1 --2- 172.21.15.45:0/1104674798 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4978066280 0x7f4978068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:34.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.019+0000 7f498affd640 1 --2- 172.21.15.45:0/1104674798 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4978066280 0x7f4978068730 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f49800ae000 tx=0x7f49800aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:34.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.023+0000 7f4973fff640 1 -- 172.21.15.45:0/1104674798 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f497c051070 con 0x7f49740047d0 2023-10-03T19:21:34.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.211+0000 7f4991e89640 1 -- 172.21.15.45:0/1104674798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f498c04de80 con 0x7f49740047d0 2023-10-03T19:21:34.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.215+0000 7f4973fff640 1 -- 172.21.15.45:0/1104674798 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+3916 (secure 0 0 0) 0x7f497c052fa0 con 0x7f49740047d0 2023-10-03T19:21:34.218 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:21:34.218 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":58,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3566869652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3566869652},{"type":"v1","addr":"172.21.15.79:6835","nonce":3566869652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":7587,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2339652261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2339652261},{"type":"v1","addr":"172.21.15.45:6833","nonce":2339652261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:20:16.301166+0000","modified":"2023-10-03T19:20:19.318778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7602":{"gid":7602,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1723126563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1723126563},{"type":"v1","addr":"172.21.15.45:6835","nonce":1723126563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-10-03T19:21:34.219 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 58 2023-10-03T19:21:34.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.215+0000 7f4991e89640 1 -- 172.21.15.45:0/1104674798 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4978066280 msgr2=0x7f4978068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:34.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.215+0000 7f4991e89640 1 --2- 172.21.15.45:0/1104674798 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4978066280 0x7f4978068730 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f49800ae000 tx=0x7f49800aa070 comp rx=0 tx=0).stop 2023-10-03T19:21:34.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.215+0000 7f4991e89640 1 -- 172.21.15.45:0/1104674798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49740047d0 msgr2=0x7f498c06c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:34.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.215+0000 7f4991e89640 1 --2- 172.21.15.45:0/1104674798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49740047d0 0x7f498c06c940 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f497c00d4c0 tx=0x7f497c00d980 comp rx=0 tx=0).stop 2023-10-03T19:21:34.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.215+0000 7f4991e89640 1 -- 172.21.15.45:0/1104674798 shutdown_connections 2023-10-03T19:21:34.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.215+0000 7f4991e89640 1 --2- 172.21.15.45:0/1104674798 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f4978066280 0x7f4978068730 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:34.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.215+0000 7f4991e89640 1 --2- 172.21.15.45:0/1104674798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f498c14d9a0 0x7f498c0a6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:34.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.215+0000 7f4991e89640 1 --2- 172.21.15.45:0/1104674798 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f498c0a24d0 0x7f498c0a2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:34.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.215+0000 7f4991e89640 1 --2- 172.21.15.45:0/1104674798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49740047d0 0x7f498c06c940 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:34.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.215+0000 7f4991e89640 1 -- 172.21.15.45:0/1104674798 >> 172.21.15.45:0/1104674798 conn(0x7f498c0c2280 msgr2=0x7f498c1523b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:34.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.215+0000 7f4991e89640 1 -- 172.21.15.45:0/1104674798 shutdown_connections 2023-10-03T19:21:34.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.215+0000 7f4991e89640 1 -- 172.21.15.45:0/1104674798 wait complete. 2023-10-03T19:21:34.236 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:21:34.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.343+0000 7fd32eafb640 1 Processor -- start 2023-10-03T19:21:34.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd32eafb640 1 -- start start 2023-10-03T19:21:34.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd32eafb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd328148360 0x7fd3280703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:34.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd32eafb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd32814ae50 con 0x7fd32814e1a0 2023-10-03T19:21:34.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd32eafb640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd32806c6e0 con 0x7fd32806cfe0 2023-10-03T19:21:34.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd32eafb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32806cc60 con 0x7fd328148360 2023-10-03T19:21:34.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd327fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd32814e1a0 0x7fd3280bdf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37596/0 (socket says 172.21.15.45:37596) 2023-10-03T19:21:34.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd327fff640 1 -- 172.21.15.45:0/939629451 learned_addr learned my addr 172.21.15.45:0/939629451 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:21:34.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd32c897640 1 --2- 172.21.15.45:0/939629451 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd328148360 0x7fd3280703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:34.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd3277fe640 1 -- 172.21.15.45:0/939629451 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882479619 0 0) 0x7fd32814ae50 con 0x7fd32814e1a0 2023-10-03T19:21:34.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd3277fe640 1 -- 172.21.15.45:0/939629451 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd318003530 con 0x7fd32814e1a0 2023-10-03T19:21:34.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd3277fe640 1 -- 172.21.15.45:0/939629451 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 79146172 0 0) 0x7fd318003530 con 0x7fd32814e1a0 2023-10-03T19:21:34.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd3277fe640 1 -- 172.21.15.45:0/939629451 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd328148360 msgr2=0x7fd3280703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:34.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd3277fe640 1 --2- 172.21.15.45:0/939629451 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd328148360 0x7fd3280703a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:34.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd3277fe640 1 -- 172.21.15.45:0/939629451 >> v1:172.21.15.79:6789/0 conn(0x7fd32806cfe0 legacy=0x7fd32814b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:34.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd3277fe640 1 -- 172.21.15.45:0/939629451 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32806c980 con 0x7fd32814e1a0 2023-10-03T19:21:34.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd3277fe640 1 -- 172.21.15.45:0/939629451 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fd314001680 con 0x7fd32814e1a0 2023-10-03T19:21:34.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd3277fe640 1 -- 172.21.15.45:0/939629451 >> v1:172.21.15.45:6789/0 conn(0x7fd32814e1a0 legacy=0x7fd3280bdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:34.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd3277fe640 1 --2- 172.21.15.45:0/939629451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3180039b0 0x7fd318003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:34.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd3277fe640 1 --2- 172.21.15.45:0/939629451 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd328148360 0x7fd3180047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:34.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd3277fe640 1 --2- 172.21.15.45:0/939629451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd318004d10 0x7fd318005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:34.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd3277fe640 1 -- 172.21.15.45:0/939629451 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32806cc60 con 0x7fd3180039b0 2023-10-03T19:21:34.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd3277fe640 1 -- 172.21.15.45:0/939629451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31800baa0 con 0x7fd318004d10 2023-10-03T19:21:34.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd3277fe640 1 -- 172.21.15.45:0/939629451 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd31800de70 con 0x7fd328148360 2023-10-03T19:21:34.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd32c897640 1 --2- 172.21.15.45:0/939629451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3180039b0 0x7fd318003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:34.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd32d098640 1 --2- 172.21.15.45:0/939629451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd318004d10 0x7fd318005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:34.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd327fff640 1 --2- 172.21.15.45:0/939629451 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd328148360 0x7fd3180047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:34.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd32c897640 1 -- 172.21.15.45:0/939629451 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd328148360 msgr2=0x7fd3180047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:34.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd32c897640 1 --2- 172.21.15.45:0/939629451 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd328148360 0x7fd3180047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:34.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd32c897640 1 -- 172.21.15.45:0/939629451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd318004d10 msgr2=0x7fd318005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:34.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd32c897640 1 --2- 172.21.15.45:0/939629451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd318004d10 0x7fd318005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:34.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.347+0000 7fd32c897640 1 -- 172.21.15.45:0/939629451 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd318003530 con 0x7fd3180039b0 2023-10-03T19:21:34.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd32c897640 1 --2- 172.21.15.45:0/939629451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3180039b0 0x7fd318003dc0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fd31c00aa60 tx=0x7fd31c01cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b9d9170fd33e4c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:34.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd3277fe640 1 -- 172.21.15.45:0/939629451 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c0a59b0 con 0x7fd3180039b0 2023-10-03T19:21:34.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd3277fe640 1 -- 172.21.15.45:0/939629451 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31c0a5b10 con 0x7fd3180039b0 2023-10-03T19:21:34.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd3277fe640 1 -- 172.21.15.45:0/939629451 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c0ad440 con 0x7fd3180039b0 2023-10-03T19:21:34.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd32eafb640 1 -- 172.21.15.45:0/939629451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3180039b0 msgr2=0x7fd318003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:34.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd32eafb640 1 --2- 172.21.15.45:0/939629451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3180039b0 0x7fd318003dc0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fd31c00aa60 tx=0x7fd31c01cc10 comp rx=0 tx=0).stop 2023-10-03T19:21:34.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd32d098640 1 -- 172.21.15.45:0/939629451 reap_dead start 2023-10-03T19:21:34.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd32eafb640 1 -- 172.21.15.45:0/939629451 shutdown_connections 2023-10-03T19:21:34.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd32eafb640 1 -- 172.21.15.45:0/939629451 >> 172.21.15.45:0/939629451 conn(0x7fd3280c1a10 msgr2=0x7fd3280bd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:34.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd32eafb640 1 -- 172.21.15.45:0/939629451 shutdown_connections 2023-10-03T19:21:34.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd32eafb640 1 -- 172.21.15.45:0/939629451 wait complete. 2023-10-03T19:21:34.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd32eafb640 1 Processor -- start 2023-10-03T19:21:34.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd32eafb640 1 -- start start 2023-10-03T19:21:34.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd32eafb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3180039b0 0x7fd328152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:34.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd32eafb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd328151510 0x7fd3281e2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:34.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd32eafb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd328151a60 0x7fd3281e2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:34.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd32eafb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3281e32c0 con 0x7fd328151a60 2023-10-03T19:21:34.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd32eafb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd328152750 con 0x7fd3180039b0 2023-10-03T19:21:34.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd32eafb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3281e6aa0 con 0x7fd328151510 2023-10-03T19:21:34.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd32d098640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd328151a60 0x7fd3281e2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:34.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd32d098640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd328151a60 0x7fd3281e2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57990/0 (socket says 172.21.15.45:57990) 2023-10-03T19:21:34.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd32d098640 1 -- 172.21.15.45:0/3196148614 learned_addr learned my addr 172.21.15.45:0/3196148614 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:34.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd32c897640 1 --2- 172.21.15.45:0/3196148614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3180039b0 0x7fd328152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:34.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd327fff640 1 --2- 172.21.15.45:0/3196148614 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd328151510 0x7fd3281e2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:34.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd32d098640 1 -- 172.21.15.45:0/3196148614 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd328151510 msgr2=0x7fd3281e2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:34.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd32d098640 1 --2- 172.21.15.45:0/3196148614 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd328151510 0x7fd3281e2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:34.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd32d098640 1 -- 172.21.15.45:0/3196148614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3180039b0 msgr2=0x7fd328152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:34.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd32d098640 1 --2- 172.21.15.45:0/3196148614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3180039b0 0x7fd328152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:34.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd32d098640 1 -- 172.21.15.45:0/3196148614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32814b9f0 con 0x7fd328151a60 2023-10-03T19:21:34.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd327fff640 1 --2- 172.21.15.45:0/3196148614 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd328151510 0x7fd3281e2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:21:34.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd32d098640 1 --2- 172.21.15.45:0/3196148614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd328151a60 0x7fd3281e2d80 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fd32806ba20 tx=0x7fd32000e840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:34.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd3257fa640 1 -- 172.21.15.45:0/3196148614 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32000ed60 con 0x7fd328151a60 2023-10-03T19:21:34.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd3257fa640 1 -- 172.21.15.45:0/3196148614 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32000eec0 con 0x7fd328151a60 2023-10-03T19:21:34.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd3257fa640 1 -- 172.21.15.45:0/3196148614 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd320003bc0 con 0x7fd328151a60 2023-10-03T19:21:34.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd32eafb640 1 -- 172.21.15.45:0/3196148614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd328156540 con 0x7fd328151a60 2023-10-03T19:21:34.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.351+0000 7fd32eafb640 1 -- 172.21.15.45:0/3196148614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3281e6790 con 0x7fd328151a60 2023-10-03T19:21:34.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.355+0000 7fd32eafb640 1 -- 172.21.15.45:0/3196148614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd32814bb80 con 0x7fd328151a60 2023-10-03T19:21:34.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.355+0000 7fd3257fa640 1 -- 172.21.15.45:0/3196148614 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd320003d20 con 0x7fd328151a60 2023-10-03T19:21:34.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.355+0000 7fd3257fa640 1 --2- 172.21.15.45:0/3196148614 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd30c066280 0x7fd30c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:34.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.355+0000 7fd3257fa640 1 -- 172.21.15.45:0/3196148614 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fd320082eb0 con 0x7fd328151a60 2023-10-03T19:21:34.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.355+0000 7fd32c897640 1 --2- 172.21.15.45:0/3196148614 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd30c066280 0x7fd30c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:34.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.355+0000 7fd32c897640 1 --2- 172.21.15.45:0/3196148614 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd30c066280 0x7fd30c068730 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd31c0af000 tx=0x7fd31c0046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:34.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.359+0000 7fd3257fa640 1 -- 172.21.15.45:0/3196148614 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd32814bb80 con 0x7fd328151a60 2023-10-03T19:21:34.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.543+0000 7fd32eafb640 1 -- 172.21.15.45:0/3196148614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd32814bb80 con 0x7fd328151a60 2023-10-03T19:21:34.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.547+0000 7fd3257fa640 1 -- 172.21.15.45:0/3196148614 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+3916 (secure 0 0 0) 0x7fd32814bb80 con 0x7fd328151a60 2023-10-03T19:21:34.550 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:21:34.550 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":58,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3566869652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3566869652},{"type":"v1","addr":"172.21.15.79:6835","nonce":3566869652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":7587,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2339652261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2339652261},{"type":"v1","addr":"172.21.15.45:6833","nonce":2339652261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T19:20:16.301166+0000","modified":"2023-10-03T19:20:19.318778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7602":{"gid":7602,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1723126563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1723126563},{"type":"v1","addr":"172.21.15.45:6835","nonce":1723126563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-10-03T19:21:34.550 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 58 2023-10-03T19:21:34.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.547+0000 7fd32eafb640 1 -- 172.21.15.45:0/3196148614 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd30c066280 msgr2=0x7fd30c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:34.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.547+0000 7fd32eafb640 1 --2- 172.21.15.45:0/3196148614 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd30c066280 0x7fd30c068730 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd31c0af000 tx=0x7fd31c0046d0 comp rx=0 tx=0).stop 2023-10-03T19:21:34.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.547+0000 7fd32eafb640 1 -- 172.21.15.45:0/3196148614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd328151a60 msgr2=0x7fd3281e2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:34.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.547+0000 7fd32eafb640 1 --2- 172.21.15.45:0/3196148614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd328151a60 0x7fd3281e2d80 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fd32806ba20 tx=0x7fd32000e840 comp rx=0 tx=0).stop 2023-10-03T19:21:34.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.547+0000 7fd32eafb640 1 -- 172.21.15.45:0/3196148614 shutdown_connections 2023-10-03T19:21:34.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.547+0000 7fd32eafb640 1 --2- 172.21.15.45:0/3196148614 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd30c066280 0x7fd30c068730 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:34.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.547+0000 7fd32eafb640 1 --2- 172.21.15.45:0/3196148614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd328151a60 0x7fd3281e2d80 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:34.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.547+0000 7fd32eafb640 1 --2- 172.21.15.45:0/3196148614 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd328151510 0x7fd3281e2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:34.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.547+0000 7fd32eafb640 1 --2- 172.21.15.45:0/3196148614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3180039b0 0x7fd328152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:34.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.547+0000 7fd32eafb640 1 -- 172.21.15.45:0/3196148614 >> 172.21.15.45:0/3196148614 conn(0x7fd3280c1a10 msgr2=0x7fd3281557f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:34.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.547+0000 7fd32eafb640 1 -- 172.21.15.45:0/3196148614 shutdown_connections 2023-10-03T19:21:34.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.547+0000 7fd32eafb640 1 -- 172.21.15.45:0/3196148614 wait complete. 2023-10-03T19:21:34.569 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:21:34.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.687+0000 7ff6467e0640 1 Processor -- start 2023-10-03T19:21:34.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.687+0000 7ff6467e0640 1 -- start start 2023-10-03T19:21:34.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.691+0000 7ff6467e0640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff640070ce0 0x7ff6400beca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:34.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.691+0000 7ff6467e0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6400bb1a0 0x7ff64006f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:34.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.691+0000 7ff6467e0640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff64014d050 con 0x7ff6400710b0 2023-10-03T19:21:34.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.691+0000 7ff6467e0640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6400b6c50 con 0x7ff640070ce0 2023-10-03T19:21:34.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.691+0000 7ff6467e0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff64014d330 con 0x7ff6400bb1a0 2023-10-03T19:21:34.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.691+0000 7ff63ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff640070ce0 0x7ff6400beca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:34.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.691+0000 7ff63ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff640070ce0 0x7ff6400beca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39316/0 (socket says 172.21.15.45:39316) 2023-10-03T19:21:34.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.691+0000 7ff63ffff640 1 -- 172.21.15.45:0/2012599290 learned_addr learned my addr 172.21.15.45:0/2012599290 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:34.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.691+0000 7ff63f7fe640 1 --2- 172.21.15.45:0/2012599290 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6400bb1a0 0x7ff64006f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:34.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.691+0000 7ff63ffff640 1 -- 172.21.15.45:0/2012599290 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6400bb1a0 msgr2=0x7ff64006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:34.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.691+0000 7ff63ffff640 1 --2- 172.21.15.45:0/2012599290 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6400bb1a0 0x7ff64006f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:34.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.691+0000 7ff63ffff640 1 -- 172.21.15.45:0/2012599290 >> v1:172.21.15.79:6789/0 conn(0x7ff6400710b0 legacy=0x7ff6401495f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:34.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.691+0000 7ff63ffff640 1 -- 172.21.15.45:0/2012599290 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff640071650 con 0x7ff640070ce0 2023-10-03T19:21:34.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.691+0000 7ff63ffff640 1 --2- 172.21.15.45:0/2012599290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff640070ce0 0x7ff6400beca0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7ff630009870 tx=0x7ff63001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b08ab29a021c22 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:34.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.691+0000 7ff63effd640 1 -- 172.21.15.45:0/2012599290 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6300a89b0 con 0x7ff640070ce0 2023-10-03T19:21:34.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.691+0000 7ff63effd640 1 -- 172.21.15.45:0/2012599290 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6300a8b10 con 0x7ff640070ce0 2023-10-03T19:21:34.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.691+0000 7ff63effd640 1 -- 172.21.15.45:0/2012599290 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6300a8ea0 con 0x7ff640070ce0 2023-10-03T19:21:34.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff6467e0640 1 -- 172.21.15.45:0/2012599290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff640070ce0 msgr2=0x7ff6400beca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:34.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff6467e0640 1 --2- 172.21.15.45:0/2012599290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff640070ce0 0x7ff6400beca0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7ff630009870 tx=0x7ff63001ecf0 comp rx=0 tx=0).stop 2023-10-03T19:21:34.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff6467e0640 1 -- 172.21.15.45:0/2012599290 shutdown_connections 2023-10-03T19:21:34.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff6467e0640 1 --2- 172.21.15.45:0/2012599290 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6400bb1a0 0x7ff64006f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:34.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff6467e0640 1 --2- 172.21.15.45:0/2012599290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff640070ce0 0x7ff6400beca0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:34.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff6467e0640 1 -- 172.21.15.45:0/2012599290 >> 172.21.15.45:0/2012599290 conn(0x7ff6400bd880 msgr2=0x7ff6400bdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:34.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff6467e0640 1 -- 172.21.15.45:0/2012599290 shutdown_connections 2023-10-03T19:21:34.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff6467e0640 1 -- 172.21.15.45:0/2012599290 wait complete. 2023-10-03T19:21:34.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff6467e0640 1 Processor -- start 2023-10-03T19:21:34.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff6467e0640 1 -- start start 2023-10-03T19:21:34.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff6467e0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff640070ce0 0x7ff6401d4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:34.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff6467e0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6400710b0 0x7ff640141170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:34.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff6467e0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6400bb1a0 0x7ff6401e6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:34.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff6467e0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6401d5fd0 con 0x7ff6400bb1a0 2023-10-03T19:21:34.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff6467e0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6401d8180 con 0x7ff6400710b0 2023-10-03T19:21:34.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff6467e0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6401d6a60 con 0x7ff640070ce0 2023-10-03T19:21:34.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff644d7d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6400bb1a0 0x7ff6401e6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:34.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff644d7d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6400bb1a0 0x7ff6401e6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39322/0 (socket says 172.21.15.45:39322) 2023-10-03T19:21:34.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff644d7d640 1 -- 172.21.15.45:0/888826084 learned_addr learned my addr 172.21.15.45:0/888826084 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:34.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff63ffff640 1 --2- 172.21.15.45:0/888826084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff640070ce0 0x7ff6401d4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:34.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff644d7d640 1 -- 172.21.15.45:0/888826084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff640070ce0 msgr2=0x7ff6401d4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:34.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff644d7d640 1 --2- 172.21.15.45:0/888826084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff640070ce0 0x7ff6401d4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:34.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff63f7fe640 1 --2- 172.21.15.45:0/888826084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6400710b0 0x7ff640141170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:34.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff644d7d640 1 -- 172.21.15.45:0/888826084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6400710b0 msgr2=0x7ff640141170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:34.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff644d7d640 1 --2- 172.21.15.45:0/888826084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6400710b0 0x7ff640141170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:34.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff644d7d640 1 -- 172.21.15.45:0/888826084 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6300094d0 con 0x7ff6400bb1a0 2023-10-03T19:21:34.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff644d7d640 1 --2- 172.21.15.45:0/888826084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6400bb1a0 0x7ff6401e6cd0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7ff63800c780 tx=0x7ff63800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:34.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff63cff9640 1 -- 172.21.15.45:0/888826084 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff638004b70 con 0x7ff6400bb1a0 2023-10-03T19:21:34.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff63cff9640 1 -- 172.21.15.45:0/888826084 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63800ce90 con 0x7ff6400bb1a0 2023-10-03T19:21:34.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff6467e0640 1 -- 172.21.15.45:0/888826084 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6400b6370 con 0x7ff6400bb1a0 2023-10-03T19:21:34.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff63cff9640 1 -- 172.21.15.45:0/888826084 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63800a850 con 0x7ff6400bb1a0 2023-10-03T19:21:34.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff6467e0640 1 -- 172.21.15.45:0/888826084 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64006fe50 con 0x7ff6400bb1a0 2023-10-03T19:21:34.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.695+0000 7ff6467e0640 1 -- 172.21.15.45:0/888826084 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6401d6110 con 0x7ff6400bb1a0 2023-10-03T19:21:34.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.699+0000 7ff63cff9640 1 -- 172.21.15.45:0/888826084 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff63800a9b0 con 0x7ff6400bb1a0 2023-10-03T19:21:34.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.699+0000 7ff63cff9640 1 --2- 172.21.15.45:0/888826084 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff62c066280 0x7ff62c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:34.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.699+0000 7ff63cff9640 1 -- 172.21.15.45:0/888826084 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6105+0+0 (secure 0 0 0) 0x7ff638083eb0 con 0x7ff6400bb1a0 2023-10-03T19:21:34.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.699+0000 7ff63ffff640 1 --2- 172.21.15.45:0/888826084 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff62c066280 0x7ff62c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:34.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.699+0000 7ff63ffff640 1 --2- 172.21.15.45:0/888826084 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff62c066280 0x7ff62c068730 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff6300b2000 tx=0x7ff6300aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:34.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.703+0000 7ff63cff9640 1 -- 172.21.15.45:0/888826084 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff6401d6110 con 0x7ff6400bb1a0 2023-10-03T19:21:34.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.851+0000 7ff6467e0640 1 -- 172.21.15.45:0/888826084 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6401d6110 con 0x7ff6400bb1a0 2023-10-03T19:21:34.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.855+0000 7ff63cff9640 1 -- 172.21.15.45:0/888826084 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+18375 (secure 0 0 0) 0x7ff6401d6110 con 0x7ff6400bb1a0 2023-10-03T19:21:34.858 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:21:34.858 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":110,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:20:34.764210+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-10-03T19:20:13.940428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-10-03T19:20:15.290748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:0/2294298422":"2023-10-03T20:20:34.239894+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:21:34.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.855+0000 7ff6467e0640 1 -- 172.21.15.45:0/888826084 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff62c066280 msgr2=0x7ff62c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:34.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.855+0000 7ff6467e0640 1 --2- 172.21.15.45:0/888826084 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff62c066280 0x7ff62c068730 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff6300b2000 tx=0x7ff6300aa070 comp rx=0 tx=0).stop 2023-10-03T19:21:34.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.855+0000 7ff6467e0640 1 -- 172.21.15.45:0/888826084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6400bb1a0 msgr2=0x7ff6401e6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:34.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.855+0000 7ff6467e0640 1 --2- 172.21.15.45:0/888826084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6400bb1a0 0x7ff6401e6cd0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7ff63800c780 tx=0x7ff63800cc40 comp rx=0 tx=0).stop 2023-10-03T19:21:34.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.855+0000 7ff6467e0640 1 -- 172.21.15.45:0/888826084 shutdown_connections 2023-10-03T19:21:34.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.855+0000 7ff6467e0640 1 --2- 172.21.15.45:0/888826084 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7ff62c066280 0x7ff62c068730 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:34.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.855+0000 7ff6467e0640 1 --2- 172.21.15.45:0/888826084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6400bb1a0 0x7ff6401e6cd0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:34.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.855+0000 7ff6467e0640 1 --2- 172.21.15.45:0/888826084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6400710b0 0x7ff640141170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:34.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.855+0000 7ff6467e0640 1 --2- 172.21.15.45:0/888826084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff640070ce0 0x7ff6401d4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:34.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.855+0000 7ff6467e0640 1 -- 172.21.15.45:0/888826084 >> 172.21.15.45:0/888826084 conn(0x7ff6400bd880 msgr2=0x7ff6400bdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:34.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.855+0000 7ff6467e0640 1 -- 172.21.15.45:0/888826084 shutdown_connections 2023-10-03T19:21:34.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.855+0000 7ff6467e0640 1 -- 172.21.15.45:0/888826084 wait complete. 2023-10-03T19:21:34.875 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-03T19:21:34.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.995+0000 7f6af0ea7640 1 Processor -- start 2023-10-03T19:21:34.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.995+0000 7f6af0ea7640 1 -- start start 2023-10-03T19:21:35.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.995+0000 7f6af0ea7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6aec14f240 0x7f6aec1528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:35.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.995+0000 7f6af0ea7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6aec0bb1d0 0x7f6aec0c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:35.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.995+0000 7f6af0ea7640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aec06b2d0 con 0x7f6aec0c2790 2023-10-03T19:21:35.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.995+0000 7f6af0ea7640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aec06b640 con 0x7f6aec14f240 2023-10-03T19:21:35.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.995+0000 7f6af0ea7640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec0a3c60 con 0x7f6aec0bb1d0 2023-10-03T19:21:35.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.995+0000 7f6ae9d9b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6aec0c2790 0x7f6aec0c0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41242/0 (socket says 172.21.15.45:41242) 2023-10-03T19:21:35.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.995+0000 7f6ae9d9b640 1 -- 172.21.15.45:0/534184837 learned_addr learned my addr 172.21.15.45:0/534184837 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:21:35.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.995+0000 7f6aead9d640 1 --2- 172.21.15.45:0/534184837 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6aec0bb1d0 0x7f6aec0c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:35.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.995+0000 7f6aea59c640 1 --2- 172.21.15.45:0/534184837 >> v2:172.21.15.79:3300/0 conn(0x7f6aec14f240 0x7f6aec1528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:35.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.995+0000 7f6ae959a640 1 -- 172.21.15.45:0/534184837 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1542148971 0 0) 0x7f6aec06b2d0 con 0x7f6aec0c2790 2023-10-03T19:21:35.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.995+0000 7f6ae959a640 1 -- 172.21.15.45:0/534184837 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6acc003530 con 0x7f6aec0c2790 2023-10-03T19:21:35.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.995+0000 7f6ae959a640 1 -- 172.21.15.45:0/534184837 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 478042655 0 0) 0x7f6acc003530 con 0x7f6aec0c2790 2023-10-03T19:21:35.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.995+0000 7f6aea59c640 1 -- 172.21.15.45:0/534184837 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6aec0bb1d0 msgr2=0x7f6aec0c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:35.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.995+0000 7f6aea59c640 1 --2- 172.21.15.45:0/534184837 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6aec0bb1d0 0x7f6aec0c12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:35.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.995+0000 7f6aea59c640 1 -- 172.21.15.45:0/534184837 >> v1:172.21.15.45:6789/0 conn(0x7f6aec0c2790 legacy=0x7f6aec0c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:35.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.995+0000 7f6aea59c640 1 -- 172.21.15.45:0/534184837 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aec14e740 con 0x7f6aec14f240 2023-10-03T19:21:35.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.999+0000 7f6aea59c640 1 --2- 172.21.15.45:0/534184837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aec14f240 0x7f6aec1528d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6adc0097a0 tx=0x7f6adc01eb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1584f38dc11068c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:35.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.999+0000 7f6ae959a640 1 -- 172.21.15.45:0/534184837 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4001a50 con 0x7f6aec14f240 2023-10-03T19:21:35.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.999+0000 7f6ae959a640 1 -- 172.21.15.45:0/534184837 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6adc0a85b0 con 0x7f6aec14f240 2023-10-03T19:21:35.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.999+0000 7f6ae959a640 1 -- 172.21.15.45:0/534184837 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc0a8920 con 0x7f6aec14f240 2023-10-03T19:21:35.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.999+0000 7f6af0ea7640 1 -- 172.21.15.45:0/534184837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aec14f240 msgr2=0x7f6aec1528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:35.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.999+0000 7f6af0ea7640 1 --2- 172.21.15.45:0/534184837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aec14f240 0x7f6aec1528d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6adc0097a0 tx=0x7f6adc01eb70 comp rx=0 tx=0).stop 2023-10-03T19:21:35.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.999+0000 7f6af0ea7640 1 -- 172.21.15.45:0/534184837 shutdown_connections 2023-10-03T19:21:35.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.999+0000 7f6af0ea7640 1 --2- 172.21.15.45:0/534184837 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6aec0bb1d0 0x7f6aec0c12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:35.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.999+0000 7f6af0ea7640 1 --2- 172.21.15.45:0/534184837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aec14f240 0x7f6aec1528d0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:35.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.999+0000 7f6af0ea7640 1 -- 172.21.15.45:0/534184837 >> 172.21.15.45:0/534184837 conn(0x7f6aec0a64a0 msgr2=0x7f6aec0a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:35.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.999+0000 7f6af0ea7640 1 -- 172.21.15.45:0/534184837 shutdown_connections 2023-10-03T19:21:35.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.999+0000 7f6af0ea7640 1 -- 172.21.15.45:0/534184837 wait complete. 2023-10-03T19:21:35.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.999+0000 7f6af0ea7640 1 Processor -- start 2023-10-03T19:21:35.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.999+0000 7f6af0ea7640 1 -- start start 2023-10-03T19:21:35.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.999+0000 7f6af0ea7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aec0bb1d0 0x7f6aec149260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:35.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.999+0000 7f6af0ea7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6aec0c2790 0x7f6aec1e3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:35.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.999+0000 7f6af0ea7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6aec14f240 0x7f6aec1e44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:35.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.999+0000 7f6af0ea7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec0c3a70 con 0x7f6aec14f240 2023-10-03T19:21:35.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.999+0000 7f6af0ea7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec1497a0 con 0x7f6aec0bb1d0 2023-10-03T19:21:35.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:34.999+0000 7f6af0ea7640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec148d70 con 0x7f6aec0c2790 2023-10-03T19:21:35.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.003+0000 7f6aead9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6aec14f240 0x7f6aec1e44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:35.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.003+0000 7f6aead9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6aec14f240 0x7f6aec1e44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39334/0 (socket says 172.21.15.45:39334) 2023-10-03T19:21:35.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.003+0000 7f6aead9d640 1 -- 172.21.15.45:0/155989793 learned_addr learned my addr 172.21.15.45:0/155989793 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:35.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.003+0000 7f6aea59c640 1 --2- 172.21.15.45:0/155989793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aec0bb1d0 0x7f6aec149260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:35.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.003+0000 7f6ae9d9b640 1 --2- 172.21.15.45:0/155989793 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6aec0c2790 0x7f6aec1e3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:35.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.003+0000 7f6aead9d640 1 -- 172.21.15.45:0/155989793 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6aec0c2790 msgr2=0x7f6aec1e3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:35.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.003+0000 7f6aead9d640 1 --2- 172.21.15.45:0/155989793 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6aec0c2790 0x7f6aec1e3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:35.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.003+0000 7f6aead9d640 1 -- 172.21.15.45:0/155989793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aec0bb1d0 msgr2=0x7f6aec149260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:35.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.003+0000 7f6aead9d640 1 --2- 172.21.15.45:0/155989793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aec0bb1d0 0x7f6aec149260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:35.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.003+0000 7f6aead9d640 1 -- 172.21.15.45:0/155989793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc0093b0 con 0x7f6aec14f240 2023-10-03T19:21:35.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.003+0000 7f6aea59c640 1 --2- 172.21.15.45:0/155989793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aec0bb1d0 0x7f6aec149260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:21:35.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.003+0000 7f6aead9d640 1 --2- 172.21.15.45:0/155989793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6aec14f240 0x7f6aec1e44a0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f6ae400e930 tx=0x7f6ae400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:35.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.003+0000 7f6ae2ffd640 1 -- 172.21.15.45:0/155989793 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae40096b0 con 0x7f6aec14f240 2023-10-03T19:21:35.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.003+0000 7f6ae2ffd640 1 -- 172.21.15.45:0/155989793 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae400c9a0 con 0x7f6aec14f240 2023-10-03T19:21:35.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.003+0000 7f6af0ea7640 1 -- 172.21.15.45:0/155989793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aec14f610 con 0x7f6aec14f240 2023-10-03T19:21:35.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.003+0000 7f6ae2ffd640 1 -- 172.21.15.45:0/155989793 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae400cd30 con 0x7f6aec14f240 2023-10-03T19:21:35.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.003+0000 7f6af0ea7640 1 -- 172.21.15.45:0/155989793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aec0a3f40 con 0x7f6aec14f240 2023-10-03T19:21:35.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.003+0000 7f6af0ea7640 1 -- 172.21.15.45:0/155989793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aec0bf360 con 0x7f6aec14f240 2023-10-03T19:21:35.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.003+0000 7f6ae2ffd640 1 -- 172.21.15.45:0/155989793 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6ae4013470 con 0x7f6aec14f240 2023-10-03T19:21:35.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.003+0000 7f6ae2ffd640 1 --2- 172.21.15.45:0/155989793 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6ad00662b0 0x7f6ad0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:35.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.003+0000 7f6ae2ffd640 1 -- 172.21.15.45:0/155989793 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f6ae4083e30 con 0x7f6aec14f240 2023-10-03T19:21:35.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.003+0000 7f6aea59c640 1 --2- 172.21.15.45:0/155989793 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6ad00662b0 0x7f6ad0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:35.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.003+0000 7f6aea59c640 1 --2- 172.21.15.45:0/155989793 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6ad00662b0 0x7f6ad0068760 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6adc0b2000 tx=0x7f6adc0aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:35.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.007+0000 7f6ae2ffd640 1 -- 172.21.15.45:0/155989793 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6ae40513d0 con 0x7f6aec14f240 2023-10-03T19:21:35.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.187+0000 7f6af0ea7640 1 -- 172.21.15.45:0/155989793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6aec0c2eb0 con 0x7f6aec14f240 2023-10-03T19:21:35.978 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-10-03T19:21:35.975+0000 7f00b6fb3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-03T19:21:35.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.991+0000 7f6ae2ffd640 1 -- 172.21.15.45:0/155989793 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v59) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6aec0c2eb0 con 0x7f6aec14f240 2023-10-03T19:21:35.994 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-03T19:21:35.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.991+0000 7f6af0ea7640 1 -- 172.21.15.45:0/155989793 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6ad00662b0 msgr2=0x7f6ad0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:35.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.991+0000 7f6af0ea7640 1 --2- 172.21.15.45:0/155989793 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6ad00662b0 0x7f6ad0068760 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6adc0b2000 tx=0x7f6adc0aa070 comp rx=0 tx=0).stop 2023-10-03T19:21:35.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.991+0000 7f6af0ea7640 1 -- 172.21.15.45:0/155989793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6aec14f240 msgr2=0x7f6aec1e44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:35.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.991+0000 7f6af0ea7640 1 --2- 172.21.15.45:0/155989793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6aec14f240 0x7f6aec1e44a0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f6ae400e930 tx=0x7f6ae400edf0 comp rx=0 tx=0).stop 2023-10-03T19:21:35.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.991+0000 7f6af0ea7640 1 -- 172.21.15.45:0/155989793 shutdown_connections 2023-10-03T19:21:35.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.991+0000 7f6af0ea7640 1 --2- 172.21.15.45:0/155989793 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6ad00662b0 0x7f6ad0068760 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:35.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.991+0000 7f6af0ea7640 1 --2- 172.21.15.45:0/155989793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6aec14f240 0x7f6aec1e44a0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:35.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.991+0000 7f6af0ea7640 1 --2- 172.21.15.45:0/155989793 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6aec0c2790 0x7f6aec1e3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:35.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.991+0000 7f6af0ea7640 1 --2- 172.21.15.45:0/155989793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aec0bb1d0 0x7f6aec149260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:35.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.991+0000 7f6af0ea7640 1 -- 172.21.15.45:0/155989793 >> 172.21.15.45:0/155989793 conn(0x7f6aec0a64a0 msgr2=0x7f6aec0a43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:35.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.991+0000 7f6af0ea7640 1 -- 172.21.15.45:0/155989793 shutdown_connections 2023-10-03T19:21:35.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:35.991+0000 7f6af0ea7640 1 -- 172.21.15.45:0/155989793 wait complete. 2023-10-03T19:21:35.998 INFO:tasks.ceph.mds.a.smithi045.stderr: -1944> 2023-10-03T19:20:21.896+0000 7f04f6522640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-03T19:21:36.018 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-03T19:21:36.031 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-10-03T19:21:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.135+0000 7eff1f331640 1 Processor -- start 2023-10-03T19:21:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.135+0000 7eff1f331640 1 -- start start 2023-10-03T19:21:36.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.135+0000 7eff1f331640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7eff180bf1f0 0x7eff180a9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:36.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.135+0000 7eff1f331640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff180c2770 0x7eff180a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:36.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.135+0000 7eff1f331640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1806ac70 con 0x7eff180c14e0 2023-10-03T19:21:36.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.135+0000 7eff1f331640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1806aae0 con 0x7eff180bf1f0 2023-10-03T19:21:36.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.135+0000 7eff1f331640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff180c3000 con 0x7eff180c2770 2023-10-03T19:21:36.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.135+0000 7eff1d0cd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7eff180c14e0 0x7eff180c0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41260/0 (socket says 172.21.15.45:41260) 2023-10-03T19:21:36.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.135+0000 7eff1d0cd640 1 -- 172.21.15.45:0/1935442303 learned_addr learned my addr 172.21.15.45:0/1935442303 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:21:36.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.139+0000 7eff1c8cc640 1 --2- 172.21.15.45:0/1935442303 >> v2:172.21.15.79:3300/0 conn(0x7eff180bf1f0 0x7eff180a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:36.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.139+0000 7eff1d8ce640 1 --2- 172.21.15.45:0/1935442303 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff180c2770 0x7eff180a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:36.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.139+0000 7eff0ffff640 1 -- 172.21.15.45:0/1935442303 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4118933328 0 0) 0x7eff1806ac70 con 0x7eff180c14e0 2023-10-03T19:21:36.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.139+0000 7eff0ffff640 1 -- 172.21.15.45:0/1935442303 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff04003530 con 0x7eff180c14e0 2023-10-03T19:21:36.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.139+0000 7eff0ffff640 1 -- 172.21.15.45:0/1935442303 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2164413943 0 0) 0x7eff04003530 con 0x7eff180c14e0 2023-10-03T19:21:36.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.139+0000 7eff1d8ce640 1 -- 172.21.15.45:0/1935442303 >> v2:172.21.15.79:3300/0 conn(0x7eff180bf1f0 msgr2=0x7eff180a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:36.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.139+0000 7eff1d8ce640 1 --2- 172.21.15.45:0/1935442303 >> v2:172.21.15.79:3300/0 conn(0x7eff180bf1f0 0x7eff180a9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:36.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.139+0000 7eff1d8ce640 1 -- 172.21.15.45:0/1935442303 >> v1:172.21.15.45:6789/0 conn(0x7eff180c14e0 legacy=0x7eff180c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:36.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.139+0000 7eff1d8ce640 1 -- 172.21.15.45:0/1935442303 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff180aa5f0 con 0x7eff180c2770 2023-10-03T19:21:36.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.139+0000 7eff1c8cc640 1 --2- 172.21.15.45:0/1935442303 >> v2:172.21.15.79:3300/0 conn(0x7eff180bf1f0 0x7eff180a9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:21:36.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.139+0000 7eff1d8ce640 1 --2- 172.21.15.45:0/1935442303 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff180c2770 0x7eff180a9da0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7eff10009d90 tx=0x7eff1001f060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd52223c6145793 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:36.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.139+0000 7eff0ffff640 1 -- 172.21.15.45:0/1935442303 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff14001680 con 0x7eff180c2770 2023-10-03T19:21:36.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.139+0000 7eff0ffff640 1 -- 172.21.15.45:0/1935442303 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff100a8bb0 con 0x7eff180c2770 2023-10-03T19:21:36.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.139+0000 7eff0ffff640 1 -- 172.21.15.45:0/1935442303 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff100b0440 con 0x7eff180c2770 2023-10-03T19:21:36.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.139+0000 7eff1f331640 1 -- 172.21.15.45:0/1935442303 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff180c2770 msgr2=0x7eff180a9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:36.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.139+0000 7eff1f331640 1 --2- 172.21.15.45:0/1935442303 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff180c2770 0x7eff180a9da0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7eff10009d90 tx=0x7eff1001f060 comp rx=0 tx=0).stop 2023-10-03T19:21:36.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.139+0000 7eff1f331640 1 -- 172.21.15.45:0/1935442303 shutdown_connections 2023-10-03T19:21:36.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.139+0000 7eff1f331640 1 --2- 172.21.15.45:0/1935442303 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff180c2770 0x7eff180a9da0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:36.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.139+0000 7eff1f331640 1 --2- 172.21.15.45:0/1935442303 >> v2:172.21.15.79:3300/0 conn(0x7eff180bf1f0 0x7eff180a9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:36.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.143+0000 7eff1f331640 1 -- 172.21.15.45:0/1935442303 >> 172.21.15.45:0/1935442303 conn(0x7eff180a6440 msgr2=0x7eff180a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:36.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.143+0000 7eff1f331640 1 -- 172.21.15.45:0/1935442303 shutdown_connections 2023-10-03T19:21:36.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.143+0000 7eff1f331640 1 -- 172.21.15.45:0/1935442303 wait complete. 2023-10-03T19:21:36.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.143+0000 7eff1f331640 1 Processor -- start 2023-10-03T19:21:36.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.143+0000 7eff1f331640 1 -- start start 2023-10-03T19:21:36.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.143+0000 7eff1f331640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff180bf1f0 0x7eff181e3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:36.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.143+0000 7eff1f331640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff180c14e0 0x7eff180bd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:36.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.143+0000 7eff1f331640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff180c2770 0x7eff18149610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:36.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.143+0000 7eff1f331640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1814a710 con 0x7eff180bf1f0 2023-10-03T19:21:36.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.143+0000 7eff1f331640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff181e3a60 con 0x7eff180c2770 2023-10-03T19:21:36.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.143+0000 7eff1f331640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1814a260 con 0x7eff180c14e0 2023-10-03T19:21:36.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.143+0000 7eff1d0cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff180bf1f0 0x7eff181e3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:36.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.143+0000 7eff1d0cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff180bf1f0 0x7eff181e3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39362/0 (socket says 172.21.15.45:39362) 2023-10-03T19:21:36.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.143+0000 7eff1d0cd640 1 -- 172.21.15.45:0/1596338706 learned_addr learned my addr 172.21.15.45:0/1596338706 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:36.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.143+0000 7eff1c8cc640 1 --2- 172.21.15.45:0/1596338706 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff180c14e0 0x7eff180bd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:36.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.143+0000 7eff1d8ce640 1 --2- 172.21.15.45:0/1596338706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff180c2770 0x7eff18149610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:36.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.143+0000 7eff1d0cd640 1 -- 172.21.15.45:0/1596338706 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff180c14e0 msgr2=0x7eff180bd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:36.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.143+0000 7eff1d0cd640 1 --2- 172.21.15.45:0/1596338706 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff180c14e0 0x7eff180bd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:36.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.143+0000 7eff1d0cd640 1 -- 172.21.15.45:0/1596338706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff180c2770 msgr2=0x7eff18149610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:36.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.143+0000 7eff1d0cd640 1 --2- 172.21.15.45:0/1596338706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff180c2770 0x7eff18149610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:36.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.143+0000 7eff1d0cd640 1 -- 172.21.15.45:0/1596338706 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff08009420 con 0x7eff180bf1f0 2023-10-03T19:21:36.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.143+0000 7eff1d0cd640 1 --2- 172.21.15.45:0/1596338706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff180bf1f0 0x7eff181e3520 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7eff1400c7b0 tx=0x7eff1400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:36.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.143+0000 7eff0dffb640 1 -- 172.21.15.45:0/1596338706 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff14005cf0 con 0x7eff180bf1f0 2023-10-03T19:21:36.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.143+0000 7eff0dffb640 1 -- 172.21.15.45:0/1596338706 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff14005e50 con 0x7eff180bf1f0 2023-10-03T19:21:36.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.143+0000 7eff1f331640 1 -- 172.21.15.45:0/1596338706 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff10009a70 con 0x7eff180bf1f0 2023-10-03T19:21:36.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.143+0000 7eff0dffb640 1 -- 172.21.15.45:0/1596338706 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff140072b0 con 0x7eff180bf1f0 2023-10-03T19:21:36.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.143+0000 7eff1f331640 1 -- 172.21.15.45:0/1596338706 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1814f530 con 0x7eff180bf1f0 2023-10-03T19:21:36.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.143+0000 7eff1f331640 1 -- 172.21.15.45:0/1596338706 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1814f250 con 0x7eff180bf1f0 2023-10-03T19:21:36.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.147+0000 7eff0dffb640 1 -- 172.21.15.45:0/1596338706 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7eff14007410 con 0x7eff180bf1f0 2023-10-03T19:21:36.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.147+0000 7eff0dffb640 1 --2- 172.21.15.45:0/1596338706 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efefc0662b0 0x7efefc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:36.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.147+0000 7eff0dffb640 1 -- 172.21.15.45:0/1596338706 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6191+0+0 (secure 0 0 0) 0x7eff14083bf0 con 0x7eff180bf1f0 2023-10-03T19:21:36.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.147+0000 7eff1c8cc640 1 --2- 172.21.15.45:0/1596338706 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efefc0662b0 0x7efefc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:36.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.147+0000 7eff1c8cc640 1 --2- 172.21.15.45:0/1596338706 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efefc0662b0 0x7efefc068760 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7eff180c52b0 tx=0x7eff08008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:36.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.151+0000 7eff0dffb640 1 -- 172.21.15.45:0/1596338706 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7eff14050f60 con 0x7eff180bf1f0 2023-10-03T19:21:36.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.339+0000 7eff1f331640 1 -- 172.21.15.45:0/1596338706 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7eff1806b0e0 con 0x7eff180bf1f0 2023-10-03T19:21:36.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.995+0000 7eff0dffb640 1 -- 172.21.15.45:0/1596338706 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v60) v1 ==== 104+0+0 (secure 0 0 0) 0x7eff1400ce60 con 0x7eff180bf1f0 2023-10-03T19:21:37.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.995+0000 7eff1f331640 1 -- 172.21.15.45:0/1596338706 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efefc0662b0 msgr2=0x7efefc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:37.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.995+0000 7eff1f331640 1 --2- 172.21.15.45:0/1596338706 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efefc0662b0 0x7efefc068760 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7eff180c52b0 tx=0x7eff08008040 comp rx=0 tx=0).stop 2023-10-03T19:21:37.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.995+0000 7eff1f331640 1 -- 172.21.15.45:0/1596338706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff180bf1f0 msgr2=0x7eff181e3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:37.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.995+0000 7eff1f331640 1 --2- 172.21.15.45:0/1596338706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff180bf1f0 0x7eff181e3520 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7eff1400c7b0 tx=0x7eff1400cc70 comp rx=0 tx=0).stop 2023-10-03T19:21:37.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.995+0000 7eff1f331640 1 -- 172.21.15.45:0/1596338706 shutdown_connections 2023-10-03T19:21:37.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.995+0000 7eff1f331640 1 --2- 172.21.15.45:0/1596338706 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efefc0662b0 0x7efefc068760 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:37.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.995+0000 7eff1f331640 1 --2- 172.21.15.45:0/1596338706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff180c2770 0x7eff18149610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:37.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.995+0000 7eff1f331640 1 --2- 172.21.15.45:0/1596338706 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff180c14e0 0x7eff180bd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:37.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.995+0000 7eff1f331640 1 --2- 172.21.15.45:0/1596338706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff180bf1f0 0x7eff181e3520 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:37.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.995+0000 7eff1f331640 1 -- 172.21.15.45:0/1596338706 >> 172.21.15.45:0/1596338706 conn(0x7eff180a6440 msgr2=0x7eff180a9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:37.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.995+0000 7eff1f331640 1 -- 172.21.15.45:0/1596338706 shutdown_connections 2023-10-03T19:21:37.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:36.995+0000 7eff1f331640 1 -- 172.21.15.45:0/1596338706 wait complete. 2023-10-03T19:21:37.020 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-03T19:21:37.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.195+0000 7fed9d2d8640 1 Processor -- start 2023-10-03T19:21:37.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.195+0000 7fed9d2d8640 1 -- start start 2023-10-03T19:21:37.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.195+0000 7fed9d2d8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fed98071280 0x7fed981497e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:37.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.195+0000 7fed9d2d8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed980a82e0 con 0x7fed980a7ab0 2023-10-03T19:21:37.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.195+0000 7fed9d2d8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed980a85e0 con 0x7fed9814d050 2023-10-03T19:21:37.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.195+0000 7fed9d2d8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed980a8000 con 0x7fed98071280 2023-10-03T19:21:37.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.195+0000 7fed96ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fed98071280 0x7fed981497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:37.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.199+0000 7fed967fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fed980a7ab0 0x7fed9814c940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41276/0 (socket says 172.21.15.45:41276) 2023-10-03T19:21:37.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.199+0000 7fed967fc640 1 -- 172.21.15.45:0/2689770822 learned_addr learned my addr 172.21.15.45:0/2689770822 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:21:37.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.199+0000 7fed96ffd640 1 -- 172.21.15.45:0/2689770822 >> v1:172.21.15.79:6789/0 conn(0x7fed9814d050 legacy=0x7fed98156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:37.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.199+0000 7fed96ffd640 1 -- 172.21.15.45:0/2689770822 >> v1:172.21.15.45:6789/0 conn(0x7fed980a7ab0 legacy=0x7fed9814c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:37.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.199+0000 7fed96ffd640 1 -- 172.21.15.45:0/2689770822 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed980a4d50 con 0x7fed98071280 2023-10-03T19:21:37.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.199+0000 7fed96ffd640 1 --2- 172.21.15.45:0/2689770822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed98071280 0x7fed981497e0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fed800097c0 tx=0x7fed8001ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599b1e56475e6b04 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:37.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.199+0000 7fed95ffb640 1 -- 172.21.15.45:0/2689770822 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed800a8930 con 0x7fed98071280 2023-10-03T19:21:37.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.199+0000 7fed95ffb640 1 -- 172.21.15.45:0/2689770822 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed800a8a90 con 0x7fed98071280 2023-10-03T19:21:37.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.199+0000 7fed95ffb640 1 -- 172.21.15.45:0/2689770822 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed800a8e20 con 0x7fed98071280 2023-10-03T19:21:37.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.199+0000 7fed9d2d8640 1 -- 172.21.15.45:0/2689770822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed98071280 msgr2=0x7fed981497e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:37.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.199+0000 7fed9d2d8640 1 --2- 172.21.15.45:0/2689770822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed98071280 0x7fed981497e0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fed800097c0 tx=0x7fed8001ec30 comp rx=0 tx=0).stop 2023-10-03T19:21:37.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.199+0000 7fed9d2d8640 1 -- 172.21.15.45:0/2689770822 shutdown_connections 2023-10-03T19:21:37.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.199+0000 7fed9d2d8640 1 --2- 172.21.15.45:0/2689770822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed98071280 0x7fed981497e0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:37.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.199+0000 7fed9d2d8640 1 -- 172.21.15.45:0/2689770822 >> 172.21.15.45:0/2689770822 conn(0x7fed980c25f0 msgr2=0x7fed980c29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:37.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.199+0000 7fed9d2d8640 1 -- 172.21.15.45:0/2689770822 shutdown_connections 2023-10-03T19:21:37.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.199+0000 7fed9d2d8640 1 -- 172.21.15.45:0/2689770822 wait complete. 2023-10-03T19:21:37.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.203+0000 7fed9d2d8640 1 Processor -- start 2023-10-03T19:21:37.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.203+0000 7fed9d2d8640 1 -- start start 2023-10-03T19:21:37.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.203+0000 7fed9d2d8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed98071280 0x7fed980bd480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:37.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.203+0000 7fed9d2d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed980a7ab0 0x7fed980c1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:37.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.203+0000 7fed9d2d8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed9814d050 0x7fed981e1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:37.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.203+0000 7fed9d2d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed981e1500 con 0x7fed980a7ab0 2023-10-03T19:21:37.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.203+0000 7fed9d2d8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed981e1a80 con 0x7fed9814d050 2023-10-03T19:21:37.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.203+0000 7fed9d2d8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed980a7890 con 0x7fed98071280 2023-10-03T19:21:37.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.203+0000 7fed967fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed980a7ab0 0x7fed980c1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:37.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.203+0000 7fed967fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed980a7ab0 0x7fed980c1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39380/0 (socket says 172.21.15.45:39380) 2023-10-03T19:21:37.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.203+0000 7fed967fc640 1 -- 172.21.15.45:0/3543473081 learned_addr learned my addr 172.21.15.45:0/3543473081 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:37.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.203+0000 7fed96ffd640 1 --2- 172.21.15.45:0/3543473081 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed98071280 0x7fed980bd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:37.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.203+0000 7fed977fe640 1 --2- 172.21.15.45:0/3543473081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed9814d050 0x7fed981e1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:37.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.203+0000 7fed967fc640 1 -- 172.21.15.45:0/3543473081 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed98071280 msgr2=0x7fed980bd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:37.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.203+0000 7fed967fc640 1 --2- 172.21.15.45:0/3543473081 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed98071280 0x7fed980bd480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:37.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.203+0000 7fed967fc640 1 -- 172.21.15.45:0/3543473081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed9814d050 msgr2=0x7fed981e1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:37.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.203+0000 7fed967fc640 1 --2- 172.21.15.45:0/3543473081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed9814d050 0x7fed981e1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:37.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.203+0000 7fed967fc640 1 -- 172.21.15.45:0/3543473081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed80009420 con 0x7fed980a7ab0 2023-10-03T19:21:37.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.203+0000 7fed967fc640 1 --2- 172.21.15.45:0/3543473081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed980a7ab0 0x7fed980c1360 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fed8800c530 tx=0x7fed8800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:37.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.203+0000 7fed8f7fe640 1 -- 172.21.15.45:0/3543473081 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed88005cf0 con 0x7fed980a7ab0 2023-10-03T19:21:37.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.203+0000 7fed8f7fe640 1 -- 172.21.15.45:0/3543473081 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed88005e50 con 0x7fed980a7ab0 2023-10-03T19:21:37.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.203+0000 7fed8f7fe640 1 -- 172.21.15.45:0/3543473081 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed88007270 con 0x7fed980a7ab0 2023-10-03T19:21:37.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.203+0000 7fed9d2d8640 1 -- 172.21.15.45:0/3543473081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed980b7490 con 0x7fed980a7ab0 2023-10-03T19:21:37.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.203+0000 7fed9d2d8640 1 -- 172.21.15.45:0/3543473081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed980a5030 con 0x7fed980a7ab0 2023-10-03T19:21:37.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.203+0000 7fed9d2d8640 1 -- 172.21.15.45:0/3543473081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed9814c3b0 con 0x7fed980a7ab0 2023-10-03T19:21:37.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.207+0000 7fed8f7fe640 1 -- 172.21.15.45:0/3543473081 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fed880073d0 con 0x7fed980a7ab0 2023-10-03T19:21:37.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.207+0000 7fed8f7fe640 1 --2- 172.21.15.45:0/3543473081 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fed78066280 0x7fed78068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:37.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.207+0000 7fed8f7fe640 1 -- 172.21.15.45:0/3543473081 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6191+0+0 (secure 0 0 0) 0x7fed88083280 con 0x7fed980a7ab0 2023-10-03T19:21:37.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.207+0000 7fed96ffd640 1 --2- 172.21.15.45:0/3543473081 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fed78066280 0x7fed78068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:37.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.207+0000 7fed96ffd640 1 --2- 172.21.15.45:0/3543473081 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fed78066280 0x7fed78068730 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fed800b2000 tx=0x7fed800aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:37.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.211+0000 7fed8f7fe640 1 -- 172.21.15.45:0/3543473081 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fed88050690 con 0x7fed980a7ab0 2023-10-03T19:21:37.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:37.363+0000 7fed9d2d8640 1 -- 172.21.15.45:0/3543473081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fed980b7e90 con 0x7fed980a7ab0 2023-10-03T19:21:38.069 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-10-03T19:21:38.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.063+0000 7fed8f7fe640 1 -- 172.21.15.45:0/3543473081 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v112) v1 ==== 181+0+0 (secure 0 0 0) 0x7fed88053cb0 con 0x7fed980a7ab0 2023-10-03T19:21:38.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.067+0000 7fed9d2d8640 1 -- 172.21.15.45:0/3543473081 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fed78066280 msgr2=0x7fed78068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:38.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.067+0000 7fed9d2d8640 1 --2- 172.21.15.45:0/3543473081 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fed78066280 0x7fed78068730 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fed800b2000 tx=0x7fed800aa070 comp rx=0 tx=0).stop 2023-10-03T19:21:38.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.067+0000 7fed9d2d8640 1 -- 172.21.15.45:0/3543473081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed980a7ab0 msgr2=0x7fed980c1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.067+0000 7fed9d2d8640 1 --2- 172.21.15.45:0/3543473081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed980a7ab0 0x7fed980c1360 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fed8800c530 tx=0x7fed8800c9f0 comp rx=0 tx=0).stop 2023-10-03T19:21:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.067+0000 7fed9d2d8640 1 -- 172.21.15.45:0/3543473081 shutdown_connections 2023-10-03T19:21:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.067+0000 7fed9d2d8640 1 --2- 172.21.15.45:0/3543473081 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fed78066280 0x7fed78068730 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.067+0000 7fed9d2d8640 1 --2- 172.21.15.45:0/3543473081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed9814d050 0x7fed981e1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.067+0000 7fed9d2d8640 1 --2- 172.21.15.45:0/3543473081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed980a7ab0 0x7fed980c1360 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.067+0000 7fed9d2d8640 1 --2- 172.21.15.45:0/3543473081 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fed98071280 0x7fed980bd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.067+0000 7fed9d2d8640 1 -- 172.21.15.45:0/3543473081 >> 172.21.15.45:0/3543473081 conn(0x7fed980c25f0 msgr2=0x7fed9814c940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.067+0000 7fed9d2d8640 1 -- 172.21.15.45:0/3543473081 shutdown_connections 2023-10-03T19:21:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.067+0000 7fed9d2d8640 1 -- 172.21.15.45:0/3543473081 wait complete. 2023-10-03T19:21:38.093 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-03T19:21:38.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.215+0000 7fc32848c640 1 Processor -- start 2023-10-03T19:21:38.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.215+0000 7fc32848c640 1 -- start start 2023-10-03T19:21:38.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.215+0000 7fc32848c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc3200712c0 0x7fc3200bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:38.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.215+0000 7fc32848c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc32006c2d0 con 0x7fc32006d560 2023-10-03T19:21:38.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.215+0000 7fc32848c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc320150610 con 0x7fc32006c760 2023-10-03T19:21:38.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.215+0000 7fc32848c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3201508b0 con 0x7fc3200712c0 2023-10-03T19:21:38.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.215+0000 7fc325a27640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc32006d560 0x7fc3200a53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41282/0 (socket says 172.21.15.45:41282) 2023-10-03T19:21:38.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.215+0000 7fc325a27640 1 -- 172.21.15.45:0/3452477403 learned_addr learned my addr 172.21.15.45:0/3452477403 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:21:38.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.215+0000 7fc326228640 1 --2- 172.21.15.45:0/3452477403 >> v2:172.21.15.45:3300/0 conn(0x7fc3200712c0 0x7fc3200bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:38.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.215+0000 7fc325226640 1 -- 172.21.15.45:0/3452477403 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4155016987 0 0) 0x7fc32006c2d0 con 0x7fc32006d560 2023-10-03T19:21:38.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.215+0000 7fc325226640 1 -- 172.21.15.45:0/3452477403 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc30c003530 con 0x7fc32006d560 2023-10-03T19:21:38.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.215+0000 7fc326228640 1 -- 172.21.15.45:0/3452477403 >> v1:172.21.15.79:6789/0 conn(0x7fc32006c760 legacy=0x7fc3200a5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:38.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.215+0000 7fc326228640 1 -- 172.21.15.45:0/3452477403 >> v1:172.21.15.45:6789/0 conn(0x7fc32006d560 legacy=0x7fc3200a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:38.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.215+0000 7fc326228640 1 -- 172.21.15.45:0/3452477403 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32006d2e0 con 0x7fc3200712c0 2023-10-03T19:21:38.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.219+0000 7fc326228640 1 --2- 172.21.15.45:0/3452477403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3200712c0 0x7fc3200bcbc0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0097c0 tx=0x7fc31c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69e676f90b8183d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:38.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.219+0000 7fc325226640 1 -- 172.21.15.45:0/3452477403 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c0ab600 con 0x7fc3200712c0 2023-10-03T19:21:38.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.219+0000 7fc325226640 1 -- 172.21.15.45:0/3452477403 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31c0a7050 con 0x7fc3200712c0 2023-10-03T19:21:38.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.219+0000 7fc325226640 1 -- 172.21.15.45:0/3452477403 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c0ab980 con 0x7fc3200712c0 2023-10-03T19:21:38.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.219+0000 7fc32848c640 1 -- 172.21.15.45:0/3452477403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3200712c0 msgr2=0x7fc3200bcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:38.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.219+0000 7fc32848c640 1 --2- 172.21.15.45:0/3452477403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3200712c0 0x7fc3200bcbc0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0097c0 tx=0x7fc31c01c480 comp rx=0 tx=0).stop 2023-10-03T19:21:38.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.219+0000 7fc32848c640 1 -- 172.21.15.45:0/3452477403 shutdown_connections 2023-10-03T19:21:38.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.219+0000 7fc32848c640 1 --2- 172.21.15.45:0/3452477403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3200712c0 0x7fc3200bcbc0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:38.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.219+0000 7fc32848c640 1 -- 172.21.15.45:0/3452477403 >> 172.21.15.45:0/3452477403 conn(0x7fc3200a20d0 msgr2=0x7fc3200a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:38.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.219+0000 7fc32848c640 1 -- 172.21.15.45:0/3452477403 shutdown_connections 2023-10-03T19:21:38.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.219+0000 7fc32848c640 1 -- 172.21.15.45:0/3452477403 wait complete. 2023-10-03T19:21:38.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.223+0000 7fc32848c640 1 Processor -- start 2023-10-03T19:21:38.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.223+0000 7fc32848c640 1 -- start start 2023-10-03T19:21:38.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.223+0000 7fc32848c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc32006c760 0x7fc3201e7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:38.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.223+0000 7fc32848c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc32006d560 0x7fc320143d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:38.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.223+0000 7fc32848c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3200712c0 0x7fc320134370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:38.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.223+0000 7fc32848c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc320141580 con 0x7fc32006d560 2023-10-03T19:21:38.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.223+0000 7fc32848c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc320144250 con 0x7fc3200712c0 2023-10-03T19:21:38.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.223+0000 7fc32848c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3201410c0 con 0x7fc32006c760 2023-10-03T19:21:38.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.223+0000 7fc325a27640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc32006d560 0x7fc320143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:38.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.223+0000 7fc325a27640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc32006d560 0x7fc320143d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39386/0 (socket says 172.21.15.45:39386) 2023-10-03T19:21:38.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.223+0000 7fc325a27640 1 -- 172.21.15.45:0/2476538342 learned_addr learned my addr 172.21.15.45:0/2476538342 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:38.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.223+0000 7fc326228640 1 --2- 172.21.15.45:0/2476538342 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc32006c760 0x7fc3201e7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:38.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.223+0000 7fc326a29640 1 --2- 172.21.15.45:0/2476538342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3200712c0 0x7fc320134370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:38.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.223+0000 7fc325a27640 1 -- 172.21.15.45:0/2476538342 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc32006c760 msgr2=0x7fc3201e7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:38.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.223+0000 7fc325a27640 1 --2- 172.21.15.45:0/2476538342 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc32006c760 0x7fc3201e7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:38.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.223+0000 7fc325a27640 1 -- 172.21.15.45:0/2476538342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3200712c0 msgr2=0x7fc320134370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:38.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.223+0000 7fc325a27640 1 --2- 172.21.15.45:0/2476538342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3200712c0 0x7fc320134370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:38.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.223+0000 7fc325a27640 1 -- 172.21.15.45:0/2476538342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31c009420 con 0x7fc32006d560 2023-10-03T19:21:38.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.223+0000 7fc326a29640 1 --2- 172.21.15.45:0/2476538342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3200712c0 0x7fc320134370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:21:38.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.223+0000 7fc325a27640 1 --2- 172.21.15.45:0/2476538342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc32006d560 0x7fc320143d10 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fc31000c420 tx=0x7fc31000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:38.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.223+0000 7fc316ffd640 1 -- 172.21.15.45:0/2476538342 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc310005cf0 con 0x7fc32006d560 2023-10-03T19:21:38.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.223+0000 7fc316ffd640 1 -- 172.21.15.45:0/2476538342 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc310005e50 con 0x7fc32006d560 2023-10-03T19:21:38.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.223+0000 7fc32848c640 1 -- 172.21.15.45:0/2476538342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc32015a890 con 0x7fc32006d560 2023-10-03T19:21:38.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.223+0000 7fc316ffd640 1 -- 172.21.15.45:0/2476538342 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3100072d0 con 0x7fc32006d560 2023-10-03T19:21:38.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.223+0000 7fc32848c640 1 -- 172.21.15.45:0/2476538342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc32015a700 con 0x7fc32006d560 2023-10-03T19:21:38.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.223+0000 7fc32848c640 1 -- 172.21.15.45:0/2476538342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc32015aa20 con 0x7fc32006d560 2023-10-03T19:21:38.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.223+0000 7fc316ffd640 1 -- 172.21.15.45:0/2476538342 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc310007430 con 0x7fc32006d560 2023-10-03T19:21:38.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.223+0000 7fc316ffd640 1 --2- 172.21.15.45:0/2476538342 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc304066280 0x7fc304068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:38.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.223+0000 7fc316ffd640 1 -- 172.21.15.45:0/2476538342 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5753+0+0 (secure 0 0 0) 0x7fc310083090 con 0x7fc32006d560 2023-10-03T19:21:38.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.227+0000 7fc326228640 1 --2- 172.21.15.45:0/2476538342 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc304066280 0x7fc304068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:38.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.227+0000 7fc326228640 1 --2- 172.21.15.45:0/2476538342 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc304066280 0x7fc304068730 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0ad000 tx=0x7fc31c0a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:38.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.231+0000 7fc316ffd640 1 -- 172.21.15.45:0/2476538342 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc310050780 con 0x7fc32006d560 2023-10-03T19:21:38.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:38.383+0000 7fc32848c640 1 -- 172.21.15.45:0/2476538342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc32004de80 con 0x7fc32006d560 2023-10-03T19:21:39.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.066+0000 7fc316ffd640 1 -- 172.21.15.45:0/2476538342 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v113) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc310053da0 con 0x7fc32006d560 2023-10-03T19:21:39.073 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-10-03T19:21:39.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.070+0000 7fc32848c640 1 -- 172.21.15.45:0/2476538342 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc304066280 msgr2=0x7fc304068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:39.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.070+0000 7fc32848c640 1 --2- 172.21.15.45:0/2476538342 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc304066280 0x7fc304068730 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0ad000 tx=0x7fc31c0a6000 comp rx=0 tx=0).stop 2023-10-03T19:21:39.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.070+0000 7fc32848c640 1 -- 172.21.15.45:0/2476538342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc32006d560 msgr2=0x7fc320143d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:39.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.070+0000 7fc32848c640 1 --2- 172.21.15.45:0/2476538342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc32006d560 0x7fc320143d10 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fc31000c420 tx=0x7fc31000c8e0 comp rx=0 tx=0).stop 2023-10-03T19:21:39.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.070+0000 7fc32848c640 1 -- 172.21.15.45:0/2476538342 shutdown_connections 2023-10-03T19:21:39.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.070+0000 7fc32848c640 1 --2- 172.21.15.45:0/2476538342 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc304066280 0x7fc304068730 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:39.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.070+0000 7fc32848c640 1 --2- 172.21.15.45:0/2476538342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3200712c0 0x7fc320134370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:39.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.070+0000 7fc32848c640 1 --2- 172.21.15.45:0/2476538342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc32006d560 0x7fc320143d10 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:39.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.070+0000 7fc32848c640 1 --2- 172.21.15.45:0/2476538342 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc32006c760 0x7fc3201e7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:39.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.070+0000 7fc32848c640 1 -- 172.21.15.45:0/2476538342 >> 172.21.15.45:0/2476538342 conn(0x7fc3200a20d0 msgr2=0x7fc3200be010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:39.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.070+0000 7fc32848c640 1 -- 172.21.15.45:0/2476538342 shutdown_connections 2023-10-03T19:21:39.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.070+0000 7fc32848c640 1 -- 172.21.15.45:0/2476538342 wait complete. 2023-10-03T19:21:39.102 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-03T19:21:39.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.222+0000 7f2fd9745640 1 Processor -- start 2023-10-03T19:21:39.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.222+0000 7f2fd9745640 1 -- start start 2023-10-03T19:21:39.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.222+0000 7f2fd9745640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2fd406d560 0x7f2fd40a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:39.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.222+0000 7f2fd9745640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2fd406c760 0x7f2fd40a5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:39.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.226+0000 7f2fd9745640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd406c2d0 con 0x7f2fd40712c0 2023-10-03T19:21:39.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.226+0000 7f2fd9745640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd4150610 con 0x7f2fd406d560 2023-10-03T19:21:39.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.226+0000 7f2fd9745640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd41508b0 con 0x7f2fd406c760 2023-10-03T19:21:39.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.226+0000 7f2fd2ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2fd40712c0 0x7f2fd40bcbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41288/0 (socket says 172.21.15.45:41288) 2023-10-03T19:21:39.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.226+0000 7f2fd2ffd640 1 -- 172.21.15.45:0/1560843005 learned_addr learned my addr 172.21.15.45:0/1560843005 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:21:39.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.226+0000 7f2fd27fc640 1 --2- 172.21.15.45:0/1560843005 >> v2:172.21.15.45:3300/0 conn(0x7f2fd406d560 0x7f2fd40a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:39.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.226+0000 7f2fd1ffb640 1 -- 172.21.15.45:0/1560843005 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4154350589 0 0) 0x7f2fd406c2d0 con 0x7f2fd40712c0 2023-10-03T19:21:39.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.226+0000 7f2fd37fe640 1 --2- 172.21.15.45:0/1560843005 >> v2:172.21.15.79:3300/0 conn(0x7f2fd406c760 0x7f2fd40a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:39.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.226+0000 7f2fd1ffb640 1 -- 172.21.15.45:0/1560843005 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fc0003530 con 0x7f2fd40712c0 2023-10-03T19:21:39.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.226+0000 7f2fd27fc640 1 -- 172.21.15.45:0/1560843005 >> v2:172.21.15.79:3300/0 conn(0x7f2fd406c760 msgr2=0x7f2fd40a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:39.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.226+0000 7f2fd27fc640 1 --2- 172.21.15.45:0/1560843005 >> v2:172.21.15.79:3300/0 conn(0x7f2fd406c760 0x7f2fd40a5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:39.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.226+0000 7f2fd27fc640 1 -- 172.21.15.45:0/1560843005 >> v1:172.21.15.45:6789/0 conn(0x7f2fd40712c0 legacy=0x7f2fd40bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:39.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.226+0000 7f2fd27fc640 1 -- 172.21.15.45:0/1560843005 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd406d2e0 con 0x7f2fd406d560 2023-10-03T19:21:39.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.226+0000 7f2fd27fc640 1 --2- 172.21.15.45:0/1560843005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fd406d560 0x7f2fd40a53c0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40c14e0 tx=0x7f2fbc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e78f321b3631bed server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:39.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.226+0000 7f2fd1ffb640 1 -- 172.21.15.45:0/1560843005 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc0ac600 con 0x7f2fd406d560 2023-10-03T19:21:39.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.226+0000 7f2fd1ffb640 1 -- 172.21.15.45:0/1560843005 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fbc0a8050 con 0x7f2fd406d560 2023-10-03T19:21:39.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.226+0000 7f2fd1ffb640 1 -- 172.21.15.45:0/1560843005 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc0ac980 con 0x7f2fd406d560 2023-10-03T19:21:39.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fd9745640 1 -- 172.21.15.45:0/1560843005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fd406d560 msgr2=0x7f2fd40a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:39.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fd9745640 1 --2- 172.21.15.45:0/1560843005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fd406d560 0x7f2fd40a53c0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40c14e0 tx=0x7f2fbc01c460 comp rx=0 tx=0).stop 2023-10-03T19:21:39.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fd9745640 1 -- 172.21.15.45:0/1560843005 shutdown_connections 2023-10-03T19:21:39.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fd9745640 1 --2- 172.21.15.45:0/1560843005 >> v2:172.21.15.79:3300/0 conn(0x7f2fd406c760 0x7f2fd40a5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:39.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fd9745640 1 --2- 172.21.15.45:0/1560843005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fd406d560 0x7f2fd40a53c0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:39.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fd9745640 1 -- 172.21.15.45:0/1560843005 >> 172.21.15.45:0/1560843005 conn(0x7f2fd40a20d0 msgr2=0x7f2fd40a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:39.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fd9745640 1 -- 172.21.15.45:0/1560843005 shutdown_connections 2023-10-03T19:21:39.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fd9745640 1 -- 172.21.15.45:0/1560843005 wait complete. 2023-10-03T19:21:39.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fd9745640 1 Processor -- start 2023-10-03T19:21:39.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fd9745640 1 -- start start 2023-10-03T19:21:39.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fd9745640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fd406c760 0x7f2fd414e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:39.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fd9745640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fd406d560 0x7f2fd4144470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:39.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fd9745640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fd40712c0 0x7f2fd41e6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:39.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fd9745640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd414eed0 con 0x7f2fd406d560 2023-10-03T19:21:39.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fd9745640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd41eb380 con 0x7f2fd406c760 2023-10-03T19:21:39.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fd9745640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd41ea5c0 con 0x7f2fd40712c0 2023-10-03T19:21:39.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fd27fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fd406d560 0x7f2fd4144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:39.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fd27fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fd406d560 0x7f2fd4144470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39396/0 (socket says 172.21.15.45:39396) 2023-10-03T19:21:39.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fd27fc640 1 -- 172.21.15.45:0/168766377 learned_addr learned my addr 172.21.15.45:0/168766377 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:39.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fd2ffd640 1 --2- 172.21.15.45:0/168766377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fd406c760 0x7f2fd414e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:39.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fd37fe640 1 --2- 172.21.15.45:0/168766377 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fd40712c0 0x7f2fd41e6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:39.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fd27fc640 1 -- 172.21.15.45:0/168766377 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fd40712c0 msgr2=0x7f2fd41e6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:39.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fd27fc640 1 --2- 172.21.15.45:0/168766377 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fd40712c0 0x7f2fd41e6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:39.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fd27fc640 1 -- 172.21.15.45:0/168766377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fd406c760 msgr2=0x7f2fd414e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:39.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fd27fc640 1 --2- 172.21.15.45:0/168766377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fd406c760 0x7f2fd414e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:39.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fd27fc640 1 -- 172.21.15.45:0/168766377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc009420 con 0x7f2fd406d560 2023-10-03T19:21:39.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fd2ffd640 1 --2- 172.21.15.45:0/168766377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fd406c760 0x7f2fd414e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:21:39.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fd27fc640 1 --2- 172.21.15.45:0/168766377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fd406d560 0x7f2fd4144470 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc01a090 tx=0x7f2fbc01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:39.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fcb7fe640 1 -- 172.21.15.45:0/168766377 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc0b7450 con 0x7f2fd406d560 2023-10-03T19:21:39.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fcb7fe640 1 -- 172.21.15.45:0/168766377 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fbc0b75d0 con 0x7f2fd406d560 2023-10-03T19:21:39.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fcb7fe640 1 -- 172.21.15.45:0/168766377 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc0b7980 con 0x7f2fd406d560 2023-10-03T19:21:39.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fd9745640 1 -- 172.21.15.45:0/168766377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd40bd460 con 0x7f2fd406d560 2023-10-03T19:21:39.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.230+0000 7f2fd9745640 1 -- 172.21.15.45:0/168766377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd40bd2d0 con 0x7f2fd406d560 2023-10-03T19:21:39.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.234+0000 7f2fd9745640 1 -- 172.21.15.45:0/168766377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd41596f0 con 0x7f2fd406d560 2023-10-03T19:21:39.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.234+0000 7f2fcb7fe640 1 -- 172.21.15.45:0/168766377 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2fbc0b3070 con 0x7f2fd406d560 2023-10-03T19:21:39.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.234+0000 7f2fcb7fe640 1 --2- 172.21.15.45:0/168766377 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2fb4066280 0x7f2fb4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:39.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.234+0000 7f2fcb7fe640 1 -- 172.21.15.45:0/168766377 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f2fbc11d9b0 con 0x7f2fd406d560 2023-10-03T19:21:39.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.234+0000 7f2fd2ffd640 1 --2- 172.21.15.45:0/168766377 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2fb4066280 0x7f2fb4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:39.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.234+0000 7f2fd2ffd640 1 --2- 172.21.15.45:0/168766377 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2fb4066280 0x7f2fb4068730 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40011f0 tx=0x7f2fc4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:39.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.238+0000 7f2fcb7fe640 1 -- 172.21.15.45:0/168766377 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2fbc0eb190 con 0x7f2fd406d560 2023-10-03T19:21:39.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.398+0000 7f2fd9745640 1 -- 172.21.15.45:0/168766377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f2fd40bca30 con 0x7f2fd406d560 2023-10-03T19:21:39.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.406+0000 7f2fcb7fe640 1 -- 172.21.15.45:0/168766377 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2fbc0b10a0 con 0x7f2fd406d560 2023-10-03T19:21:39.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.406+0000 7f2fd9745640 1 -- 172.21.15.45:0/168766377 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2fb4066280 msgr2=0x7f2fb4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:39.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.406+0000 7f2fd9745640 1 --2- 172.21.15.45:0/168766377 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2fb4066280 0x7f2fb4068730 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40011f0 tx=0x7f2fc4009040 comp rx=0 tx=0).stop 2023-10-03T19:21:39.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.406+0000 7f2fd9745640 1 -- 172.21.15.45:0/168766377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fd406d560 msgr2=0x7f2fd4144470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:39.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.406+0000 7f2fd9745640 1 --2- 172.21.15.45:0/168766377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fd406d560 0x7f2fd4144470 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc01a090 tx=0x7f2fbc01aca0 comp rx=0 tx=0).stop 2023-10-03T19:21:39.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.410+0000 7f2fd9745640 1 -- 172.21.15.45:0/168766377 shutdown_connections 2023-10-03T19:21:39.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.410+0000 7f2fd9745640 1 --2- 172.21.15.45:0/168766377 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f2fb4066280 0x7f2fb4068730 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:39.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.410+0000 7f2fd9745640 1 --2- 172.21.15.45:0/168766377 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fd40712c0 0x7f2fd41e6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:39.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.410+0000 7f2fd9745640 1 --2- 172.21.15.45:0/168766377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fd406d560 0x7f2fd4144470 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:39.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.410+0000 7f2fd9745640 1 --2- 172.21.15.45:0/168766377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fd406c760 0x7f2fd414e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:39.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.410+0000 7f2fd9745640 1 -- 172.21.15.45:0/168766377 >> 172.21.15.45:0/168766377 conn(0x7f2fd40a20d0 msgr2=0x7f2fd4148b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:39.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.410+0000 7f2fd9745640 1 -- 172.21.15.45:0/168766377 shutdown_connections 2023-10-03T19:21:39.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.410+0000 7f2fd9745640 1 -- 172.21.15.45:0/168766377 wait complete. 2023-10-03T19:21:39.431 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inmemory_log_on_client_eviction' 2023-10-03T19:21:39.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.546+0000 7fd569404640 1 Processor -- start 2023-10-03T19:21:39.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.546+0000 7fd569404640 1 -- start start 2023-10-03T19:21:39.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.546+0000 7fd569404640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd564148b90 0x7fd5640bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:39.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.546+0000 7fd569404640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd5640bcb60 0x7fd56406c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:39.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.546+0000 7fd569404640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd56414b610 con 0x7fd5640bc4a0 2023-10-03T19:21:39.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.546+0000 7fd569404640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5640a3670 con 0x7fd564148b90 2023-10-03T19:21:39.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.546+0000 7fd569404640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56414b370 con 0x7fd5640bcb60 2023-10-03T19:21:39.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.546+0000 7fd55a7fc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd5640bcb60 0x7fd56406c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:39.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.546+0000 7fd562ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd564148b90 0x7fd5640bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:39.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.546+0000 7fd55a7fc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd5640bcb60 0x7fd56406c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:39114/0 (socket says 172.21.15.45:39114) 2023-10-03T19:21:39.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.546+0000 7fd55a7fc640 1 -- 172.21.15.45:0/2511243764 learned_addr learned my addr 172.21.15.45:0/2511243764 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:39.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.546+0000 7fd562ffd640 1 -- 172.21.15.45:0/2511243764 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd5640bcb60 msgr2=0x7fd56406c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:39.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.546+0000 7fd562ffd640 1 --2- 172.21.15.45:0/2511243764 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd5640bcb60 0x7fd56406c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:39.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.546+0000 7fd562ffd640 1 -- 172.21.15.45:0/2511243764 >> v1:172.21.15.79:6789/0 conn(0x7fd5640bc4a0 legacy=0x7fd56406c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:39.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.546+0000 7fd562ffd640 1 -- 172.21.15.45:0/2511243764 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5640a5580 con 0x7fd564148b90 2023-10-03T19:21:39.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.550+0000 7fd562ffd640 1 --2- 172.21.15.45:0/2511243764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd564148b90 0x7fd5640bbf60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd5540097c0 tx=0x7fd55401ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=924ef7eeb3b5180f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:39.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.550+0000 7fd5627fc640 1 -- 172.21.15.45:0/2511243764 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5540a8970 con 0x7fd564148b90 2023-10-03T19:21:39.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.550+0000 7fd5627fc640 1 -- 172.21.15.45:0/2511243764 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5540a8ad0 con 0x7fd564148b90 2023-10-03T19:21:39.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.550+0000 7fd5627fc640 1 -- 172.21.15.45:0/2511243764 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5540a8e60 con 0x7fd564148b90 2023-10-03T19:21:39.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.550+0000 7fd569404640 1 -- 172.21.15.45:0/2511243764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd564148b90 msgr2=0x7fd5640bbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:39.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.550+0000 7fd569404640 1 --2- 172.21.15.45:0/2511243764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd564148b90 0x7fd5640bbf60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd5540097c0 tx=0x7fd55401ec70 comp rx=0 tx=0).stop 2023-10-03T19:21:39.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.550+0000 7fd569404640 1 -- 172.21.15.45:0/2511243764 shutdown_connections 2023-10-03T19:21:39.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.550+0000 7fd569404640 1 --2- 172.21.15.45:0/2511243764 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd5640bcb60 0x7fd56406c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:39.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.550+0000 7fd569404640 1 --2- 172.21.15.45:0/2511243764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd564148b90 0x7fd5640bbf60 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:39.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.550+0000 7fd569404640 1 -- 172.21.15.45:0/2511243764 >> 172.21.15.45:0/2511243764 conn(0x7fd5640bcf50 msgr2=0x7fd5640bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:39.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.550+0000 7fd569404640 1 -- 172.21.15.45:0/2511243764 shutdown_connections 2023-10-03T19:21:39.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.550+0000 7fd569404640 1 -- 172.21.15.45:0/2511243764 wait complete. 2023-10-03T19:21:39.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.550+0000 7fd569404640 1 Processor -- start 2023-10-03T19:21:39.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.550+0000 7fd569404640 1 -- start start 2023-10-03T19:21:39.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.554+0000 7fd569404640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5640bc4a0 0x7fd56414c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:39.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.554+0000 7fd569404640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd5640bcb60 0x7fd564142860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:39.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.554+0000 7fd569404640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd564148b90 0x7fd564142da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:39.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.554+0000 7fd569404640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56414e630 con 0x7fd5640bc4a0 2023-10-03T19:21:39.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.554+0000 7fd569404640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5641432e0 con 0x7fd564148b90 2023-10-03T19:21:39.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.554+0000 7fd569404640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5640b9f40 con 0x7fd5640bcb60 2023-10-03T19:21:39.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.554+0000 7fd562ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5640bc4a0 0x7fd56414c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:39.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.554+0000 7fd562ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5640bc4a0 0x7fd56414c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39402/0 (socket says 172.21.15.45:39402) 2023-10-03T19:21:39.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.554+0000 7fd562ffd640 1 -- 172.21.15.45:0/3975925877 learned_addr learned my addr 172.21.15.45:0/3975925877 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:39.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.554+0000 7fd55a7fc640 1 --2- 172.21.15.45:0/3975925877 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd5640bcb60 0x7fd564142860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:39.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.554+0000 7fd5637fe640 1 --2- 172.21.15.45:0/3975925877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd564148b90 0x7fd564142da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:39.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.554+0000 7fd562ffd640 1 -- 172.21.15.45:0/3975925877 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd5640bcb60 msgr2=0x7fd564142860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:39.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.554+0000 7fd562ffd640 1 --2- 172.21.15.45:0/3975925877 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd5640bcb60 0x7fd564142860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:39.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.554+0000 7fd562ffd640 1 -- 172.21.15.45:0/3975925877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd564148b90 msgr2=0x7fd564142da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:39.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.554+0000 7fd562ffd640 1 --2- 172.21.15.45:0/3975925877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd564148b90 0x7fd564142da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:39.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.554+0000 7fd562ffd640 1 -- 172.21.15.45:0/3975925877 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd554009420 con 0x7fd5640bc4a0 2023-10-03T19:21:39.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.554+0000 7fd5637fe640 1 --2- 172.21.15.45:0/3975925877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd564148b90 0x7fd564142da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:21:39.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.554+0000 7fd562ffd640 1 --2- 172.21.15.45:0/3975925877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5640bc4a0 0x7fd56414c790 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fd5540b3040 tx=0x7fd55401ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:39.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.554+0000 7fd55bfff640 1 -- 172.21.15.45:0/3975925877 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5540b9630 con 0x7fd5640bc4a0 2023-10-03T19:21:39.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.554+0000 7fd55bfff640 1 -- 172.21.15.45:0/3975925877 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5540b97b0 con 0x7fd5640bc4a0 2023-10-03T19:21:39.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.554+0000 7fd569404640 1 -- 172.21.15.45:0/3975925877 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd56406cee0 con 0x7fd5640bc4a0 2023-10-03T19:21:39.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.554+0000 7fd55bfff640 1 -- 172.21.15.45:0/3975925877 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5540b9b60 con 0x7fd5640bc4a0 2023-10-03T19:21:39.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.554+0000 7fd569404640 1 -- 172.21.15.45:0/3975925877 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5640a5820 con 0x7fd5640bc4a0 2023-10-03T19:21:39.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.554+0000 7fd569404640 1 -- 172.21.15.45:0/3975925877 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd564148f60 con 0x7fd5640bc4a0 2023-10-03T19:21:39.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.554+0000 7fd55bfff640 1 -- 172.21.15.45:0/3975925877 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd5540b7040 con 0x7fd5640bc4a0 2023-10-03T19:21:39.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.554+0000 7fd55bfff640 1 --2- 172.21.15.45:0/3975925877 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd5440662b0 0x7fd544068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:39.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.554+0000 7fd55bfff640 1 -- 172.21.15.45:0/3975925877 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fd554121960 con 0x7fd5640bc4a0 2023-10-03T19:21:39.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.554+0000 7fd55a7fc640 1 --2- 172.21.15.45:0/3975925877 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd5440662b0 0x7fd544068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:39.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.558+0000 7fd55a7fc640 1 --2- 172.21.15.45:0/3975925877 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd5440662b0 0x7fd544068760 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd5641e1370 tx=0x7fd54c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:39.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.558+0000 7fd55bfff640 1 -- 172.21.15.45:0/3975925877 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd5540ef150 con 0x7fd5640bc4a0 2023-10-03T19:21:39.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:39.782+0000 7fd569404640 1 -- 172.21.15.45:0/3975925877 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inmemory_log_on_client_eviction"]} v 0) v1 -- 0x7fd56404de80 con 0x7fd5640bc4a0 2023-10-03T19:21:40.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.082+0000 7fd55bfff640 1 -- 172.21.15.45:0/3975925877 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inmemory_log_on_client_eviction"]}]=0 v419) v1 ==== 152+0+0 (secure 0 0 0) 0x7fd5540f2770 con 0x7fd5640bc4a0 2023-10-03T19:21:40.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.086+0000 7fd569404640 1 -- 172.21.15.45:0/3975925877 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd5440662b0 msgr2=0x7fd544068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:40.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.086+0000 7fd569404640 1 --2- 172.21.15.45:0/3975925877 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd5440662b0 0x7fd544068760 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd5641e1370 tx=0x7fd54c008040 comp rx=0 tx=0).stop 2023-10-03T19:21:40.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.086+0000 7fd569404640 1 -- 172.21.15.45:0/3975925877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5640bc4a0 msgr2=0x7fd56414c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:40.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.086+0000 7fd569404640 1 --2- 172.21.15.45:0/3975925877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5640bc4a0 0x7fd56414c790 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fd5540b3040 tx=0x7fd55401ba10 comp rx=0 tx=0).stop 2023-10-03T19:21:40.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.086+0000 7fd569404640 1 -- 172.21.15.45:0/3975925877 shutdown_connections 2023-10-03T19:21:40.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.086+0000 7fd569404640 1 --2- 172.21.15.45:0/3975925877 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fd5440662b0 0x7fd544068760 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:40.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.086+0000 7fd569404640 1 --2- 172.21.15.45:0/3975925877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd564148b90 0x7fd564142da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:40.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.086+0000 7fd569404640 1 --2- 172.21.15.45:0/3975925877 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd5640bcb60 0x7fd564142860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:40.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.086+0000 7fd569404640 1 --2- 172.21.15.45:0/3975925877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5640bc4a0 0x7fd56414c790 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:40.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.086+0000 7fd569404640 1 -- 172.21.15.45:0/3975925877 >> 172.21.15.45:0/3975925877 conn(0x7fd5640bcf50 msgr2=0x7fd5640bb860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:40.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.086+0000 7fd569404640 1 -- 172.21.15.45:0/3975925877 shutdown_connections 2023-10-03T19:21:40.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.086+0000 7fd569404640 1 -- 172.21.15.45:0/3975925877 wait complete. 2023-10-03T19:21:40.112 INFO:tasks.cephfs_test_runner:That the in-memory logs are dumped during a client eviction event. ... FAIL 2023-10-03T19:21:40.113 INFO:tasks.cephfs_test_runner: 2023-10-03T19:21:40.113 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-03T19:21:40.113 INFO:tasks.cephfs_test_runner:FAIL: test_dump_inmemory_log_on_client_eviction (tasks.cephfs.test_misc.TestMisc) 2023-10-03T19:21:40.113 INFO:tasks.cephfs_test_runner:That the in-memory logs are dumped during a client eviction event. 2023-10-03T19:21:40.113 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-03T19:21:40.113 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-03T19:21:40.113 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_05a43c8fb3988914c879a50970f9054a098e0612/qa/tasks/cephfs/test_misc.py", line 419, in test_dump_inmemory_log_on_client_eviction 2023-10-03T19:21:40.113 INFO:tasks.cephfs_test_runner: self.assertTrue(False, "Failed to dump in-memory logs during client eviction") 2023-10-03T19:21:40.113 INFO:tasks.cephfs_test_runner:AssertionError: False is not true : Failed to dump in-memory logs during client eviction 2023-10-03T19:21:40.113 INFO:tasks.cephfs_test_runner: 2023-10-03T19:21:40.113 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-03T19:21:40.114 INFO:tasks.cephfs_test_runner:Ran 7 tests in 522.826s 2023-10-03T19:21:40.114 INFO:tasks.cephfs_test_runner: 2023-10-03T19:21:40.114 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2023-10-03T19:21:40.114 INFO:tasks.cephfs_test_runner: 2023-10-03T19:21:40.114 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-03T19:21:40.114 INFO:tasks.cephfs_test_runner:FAIL: test_dump_inmemory_log_on_client_eviction (tasks.cephfs.test_misc.TestMisc) 2023-10-03T19:21:40.114 INFO:tasks.cephfs_test_runner:That the in-memory logs are dumped during a client eviction event. 2023-10-03T19:21:40.114 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-03T19:21:40.114 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-03T19:21:40.114 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_05a43c8fb3988914c879a50970f9054a098e0612/qa/tasks/cephfs/test_misc.py", line 419, in test_dump_inmemory_log_on_client_eviction 2023-10-03T19:21:40.114 INFO:tasks.cephfs_test_runner: self.assertTrue(False, "Failed to dump in-memory logs during client eviction") 2023-10-03T19:21:40.114 INFO:tasks.cephfs_test_runner:AssertionError: False is not true : Failed to dump in-memory logs during client eviction 2023-10-03T19:21:40.115 INFO:tasks.cephfs_test_runner: 2023-10-03T19:21:40.115 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_05a43c8fb3988914c879a50970f9054a098e0612/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_dump_inmemory_log_on_client_eviction (tasks.cephfs.test_misc.TestMisc) 2023-10-03T19:21:40.177 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=8028949eec294109855b96721f3cef6e Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_05a43c8fb3988914c879a50970f9054a098e0612/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_dump_inmemory_log_on_client_eviction (tasks.cephfs.test_misc.TestMisc) 2023-10-03T19:21:40.178 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-03T19:21:40.187 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-03T19:21:40.213 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-03T19:21:40.213 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T19:21:40.213 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:21:40.228 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336540k,nr_inodes=4084135,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16206 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-10-03T19:21:40.228 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-03T19:21:40.228 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T19:21:40.235 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336540k,nr_inodes=4084135,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=22607 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-10-03T19:21:40.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:21:40.236 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2023-10-03T19:21:40.284 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-03T19:21:40.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:21:40.284 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-03T19:21:40.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:21:40.339 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link delete ceph-brx 2023-10-03T19:21:40.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:21:40.509 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-10-03T19:21:40.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-03T19:21:40.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:21:40.515 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T19:21:40.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T19:21:40.570 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2023-10-03T19:21:40.766 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-03T19:21:40.775 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-03T19:21:40.776 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:21:40.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.906+0000 7efe474ec640 1 Processor -- start 2023-10-03T19:21:40.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.906+0000 7efe474ec640 1 -- start start 2023-10-03T19:21:40.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.906+0000 7efe474ec640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efe4006f170 0x7efe40150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:40.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.906+0000 7efe474ec640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe4006d170 0x7efe4014d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:40.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.906+0000 7efe474ec640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe4006cac0 con 0x7efe400bc8b0 2023-10-03T19:21:40.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.906+0000 7efe474ec640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe400720d0 con 0x7efe4006f170 2023-10-03T19:21:40.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.906+0000 7efe474ec640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe400a5ab0 con 0x7efe4006d170 2023-10-03T19:21:40.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.906+0000 7efe45288640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efe4006f170 0x7efe40150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:40.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.906+0000 7efe45a89640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe4006d170 0x7efe4014d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:40.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.906+0000 7efe45a89640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe4006d170 0x7efe4014d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:39130/0 (socket says 172.21.15.45:39130) 2023-10-03T19:21:40.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.906+0000 7efe45a89640 1 -- 172.21.15.45:0/743560255 learned_addr learned my addr 172.21.15.45:0/743560255 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:40.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.906+0000 7efe45a89640 1 -- 172.21.15.45:0/743560255 >> v2:172.21.15.79:3300/0 conn(0x7efe4006f170 msgr2=0x7efe40150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:40.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.906+0000 7efe45a89640 1 --2- 172.21.15.45:0/743560255 >> v2:172.21.15.79:3300/0 conn(0x7efe4006f170 0x7efe40150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:40.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.906+0000 7efe45a89640 1 -- 172.21.15.45:0/743560255 >> v1:172.21.15.79:6789/0 conn(0x7efe400bc8b0 legacy=0x7efe4014ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:40.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.906+0000 7efe45a89640 1 -- 172.21.15.45:0/743560255 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe4006cd00 con 0x7efe4006d170 2023-10-03T19:21:40.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.906+0000 7efe45288640 1 --2- 172.21.15.45:0/743560255 >> v2:172.21.15.79:3300/0 conn(0x7efe4006f170 0x7efe40150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:21:40.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.910+0000 7efe45a89640 1 --2- 172.21.15.45:0/743560255 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe4006d170 0x7efe4014d180 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efe38009e50 tx=0x7efe3801c9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=300d267c1e7f486e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:40.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.910+0000 7efe37fff640 1 -- 172.21.15.45:0/743560255 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe380a57f0 con 0x7efe4006d170 2023-10-03T19:21:40.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.910+0000 7efe37fff640 1 -- 172.21.15.45:0/743560255 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe380a5950 con 0x7efe4006d170 2023-10-03T19:21:40.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.910+0000 7efe37fff640 1 -- 172.21.15.45:0/743560255 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe380a5ce0 con 0x7efe4006d170 2023-10-03T19:21:40.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.910+0000 7efe474ec640 1 -- 172.21.15.45:0/743560255 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe4006d170 msgr2=0x7efe4014d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:40.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.910+0000 7efe474ec640 1 --2- 172.21.15.45:0/743560255 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe4006d170 0x7efe4014d180 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efe38009e50 tx=0x7efe3801c9d0 comp rx=0 tx=0).stop 2023-10-03T19:21:40.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.910+0000 7efe474ec640 1 -- 172.21.15.45:0/743560255 shutdown_connections 2023-10-03T19:21:40.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.910+0000 7efe474ec640 1 --2- 172.21.15.45:0/743560255 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe4006d170 0x7efe4014d180 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:40.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.910+0000 7efe474ec640 1 --2- 172.21.15.45:0/743560255 >> v2:172.21.15.79:3300/0 conn(0x7efe4006f170 0x7efe40150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:40.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.910+0000 7efe474ec640 1 -- 172.21.15.45:0/743560255 >> 172.21.15.45:0/743560255 conn(0x7efe400bcf50 msgr2=0x7efe400bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:40.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.910+0000 7efe474ec640 1 -- 172.21.15.45:0/743560255 shutdown_connections 2023-10-03T19:21:40.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.914+0000 7efe474ec640 1 -- 172.21.15.45:0/743560255 wait complete. 2023-10-03T19:21:40.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.914+0000 7efe474ec640 1 Processor -- start 2023-10-03T19:21:40.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.914+0000 7efe474ec640 1 -- start start 2023-10-03T19:21:40.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.914+0000 7efe474ec640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe4006d170 0x7efe40145d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:40.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.914+0000 7efe474ec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe4006f170 0x7efe40143260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:40.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.914+0000 7efe474ec640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe400bc8b0 0x7efe401437a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:40.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.914+0000 7efe474ec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe400c0430 con 0x7efe4006f170 2023-10-03T19:21:40.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.914+0000 7efe474ec640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe401e76f0 con 0x7efe4006d170 2023-10-03T19:21:40.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.914+0000 7efe474ec640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe401e7990 con 0x7efe400bc8b0 2023-10-03T19:21:40.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.914+0000 7efe44a87640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe4006f170 0x7efe40143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:40.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.914+0000 7efe44a87640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe4006f170 0x7efe40143260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39406/0 (socket says 172.21.15.45:39406) 2023-10-03T19:21:40.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.914+0000 7efe44a87640 1 -- 172.21.15.45:0/3209721080 learned_addr learned my addr 172.21.15.45:0/3209721080 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:40.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.914+0000 7efe45a89640 1 --2- 172.21.15.45:0/3209721080 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe400bc8b0 0x7efe401437a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:40.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.914+0000 7efe45288640 1 --2- 172.21.15.45:0/3209721080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe4006d170 0x7efe40145d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:40.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.914+0000 7efe44a87640 1 -- 172.21.15.45:0/3209721080 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe400bc8b0 msgr2=0x7efe401437a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:40.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.914+0000 7efe44a87640 1 --2- 172.21.15.45:0/3209721080 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe400bc8b0 0x7efe401437a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:40.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.914+0000 7efe44a87640 1 -- 172.21.15.45:0/3209721080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe4006d170 msgr2=0x7efe40145d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:40.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.914+0000 7efe44a87640 1 --2- 172.21.15.45:0/3209721080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe4006d170 0x7efe40145d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:40.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.914+0000 7efe44a87640 1 -- 172.21.15.45:0/3209721080 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3c009420 con 0x7efe4006f170 2023-10-03T19:21:40.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.914+0000 7efe45a89640 1 --2- 172.21.15.45:0/3209721080 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe400bc8b0 0x7efe401437a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:21:40.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.914+0000 7efe44a87640 1 --2- 172.21.15.45:0/3209721080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe4006f170 0x7efe40143260 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7efe3000c500 tx=0x7efe3000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:40.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.914+0000 7efe35ffb640 1 -- 172.21.15.45:0/3209721080 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe30005220 con 0x7efe4006f170 2023-10-03T19:21:40.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.914+0000 7efe35ffb640 1 -- 172.21.15.45:0/3209721080 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe30005380 con 0x7efe4006f170 2023-10-03T19:21:40.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.914+0000 7efe35ffb640 1 -- 172.21.15.45:0/3209721080 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe30007270 con 0x7efe4006f170 2023-10-03T19:21:40.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.914+0000 7efe474ec640 1 -- 172.21.15.45:0/3209721080 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe38009b30 con 0x7efe4006f170 2023-10-03T19:21:40.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.914+0000 7efe474ec640 1 -- 172.21.15.45:0/3209721080 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe4006f6d0 con 0x7efe4006f170 2023-10-03T19:21:40.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.918+0000 7efe474ec640 1 -- 172.21.15.45:0/3209721080 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe4006f540 con 0x7efe4006f170 2023-10-03T19:21:40.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.918+0000 7efe35ffb640 1 -- 172.21.15.45:0/3209721080 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efe300073d0 con 0x7efe4006f170 2023-10-03T19:21:40.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.918+0000 7efe35ffb640 1 --2- 172.21.15.45:0/3209721080 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efe24066280 0x7efe24068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:40.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.918+0000 7efe35ffb640 1 -- 172.21.15.45:0/3209721080 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5339+0+0 (secure 0 0 0) 0x7efe30083140 con 0x7efe4006f170 2023-10-03T19:21:40.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.918+0000 7efe45288640 1 --2- 172.21.15.45:0/3209721080 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efe24066280 0x7efe24068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:40.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.918+0000 7efe45288640 1 --2- 172.21.15.45:0/3209721080 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efe24066280 0x7efe24068730 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7efe3c009be0 tx=0x7efe3c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:40.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:40.922+0000 7efe35ffb640 1 -- 172.21.15.45:0/3209721080 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7efe30050950 con 0x7efe4006f170 2023-10-03T19:21:41.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.066+0000 7efe474ec640 1 -- 172.21.15.45:0/3209721080 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efe4006d660 con 0x7efe24066280 2023-10-03T19:21:41.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.078+0000 7efe35ffb640 1 -- 172.21.15.45:0/3209721080 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71590 (secure 0 0 0) 0x7efe4006d660 con 0x7efe24066280 2023-10-03T19:21:41.081 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:21:41.082 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:21:41.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.078+0000 7efe474ec640 1 -- 172.21.15.45:0/3209721080 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efe24066280 msgr2=0x7efe24068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:41.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.078+0000 7efe474ec640 1 --2- 172.21.15.45:0/3209721080 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efe24066280 0x7efe24068730 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7efe3c009be0 tx=0x7efe3c008040 comp rx=0 tx=0).stop 2023-10-03T19:21:41.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.078+0000 7efe474ec640 1 -- 172.21.15.45:0/3209721080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe4006f170 msgr2=0x7efe40143260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:41.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.078+0000 7efe474ec640 1 --2- 172.21.15.45:0/3209721080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe4006f170 0x7efe40143260 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7efe3000c500 tx=0x7efe3000c9c0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.078+0000 7efe474ec640 1 -- 172.21.15.45:0/3209721080 shutdown_connections 2023-10-03T19:21:41.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.078+0000 7efe474ec640 1 --2- 172.21.15.45:0/3209721080 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7efe24066280 0x7efe24068730 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.078+0000 7efe474ec640 1 --2- 172.21.15.45:0/3209721080 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe400bc8b0 0x7efe401437a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.078+0000 7efe474ec640 1 --2- 172.21.15.45:0/3209721080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe4006f170 0x7efe40143260 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.078+0000 7efe474ec640 1 --2- 172.21.15.45:0/3209721080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe4006d170 0x7efe40145d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.078+0000 7efe474ec640 1 -- 172.21.15.45:0/3209721080 >> 172.21.15.45:0/3209721080 conn(0x7efe400bcf50 msgr2=0x7efe40147590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:41.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.078+0000 7efe474ec640 1 -- 172.21.15.45:0/3209721080 shutdown_connections 2023-10-03T19:21:41.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.078+0000 7efe474ec640 1 -- 172.21.15.45:0/3209721080 wait complete. 2023-10-03T19:21:41.098 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":388,"stamp":"2023-10-03T19:21:40.645386+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252380,"kb_used_data":10908,"kb_used_omap":0,"kb_used_meta":241408,"kb_avail":754722340,"statfs":{"total":773094113280,"available":772835676160,"internally_reserved":0,"allocated":11169792,"data_stored":6246257,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":247201792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4339,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002192"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":339,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-03T19:21:35.870818+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:21:35.870818+0000","last_peered":"2023-10-03T19:21:35.870818+0000","last_clean":"2023-10-03T19:21:35.870818+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:21:35.870818+0000","last_undegraded":"2023-10-03T19:21:35.870818+0000","last_fullsized":"2023-10-03T19:21:35.870818+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:57:44.882187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":191,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-03T19:21:39.084076+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:21:39.084076+0000","last_peered":"2023-10-03T19:21:39.084076+0000","last_clean":"2023-10-03T19:21:39.084076+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:21:39.084076+0000","last_undegraded":"2023-10-03T19:21:39.084076+0000","last_fullsized":"2023-10-03T19:21:39.084076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:49:53.311099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":187,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-03T19:21:35.870713+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:21:35.870713+0000","last_peered":"2023-10-03T19:21:35.870713+0000","last_clean":"2023-10-03T19:21:35.870713+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:21:35.870713+0000","last_undegraded":"2023-10-03T19:21:35.870713+0000","last_fullsized":"2023-10-03T19:21:35.870713+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:17:50.168683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":183,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-03T19:21:35.743334+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:21:35.743334+0000","last_peered":"2023-10-03T19:21:35.743334+0000","last_clean":"2023-10-03T19:21:35.743334+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:21:35.743334+0000","last_undegraded":"2023-10-03T19:21:35.743334+0000","last_fullsized":"2023-10-03T19:21:35.743334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:09:23.536316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":191,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-03T19:21:39.078681+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:21:39.078681+0000","last_peered":"2023-10-03T19:21:39.078681+0000","last_clean":"2023-10-03T19:21:39.078681+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:21:39.078681+0000","last_undegraded":"2023-10-03T19:21:39.078681+0000","last_fullsized":"2023-10-03T19:21:39.078681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:38:18.672508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":179,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-03T19:21:35.881689+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:21:35.881689+0000","last_peered":"2023-10-03T19:21:35.881689+0000","last_clean":"2023-10-03T19:21:35.881689+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:21:35.881689+0000","last_undegraded":"2023-10-03T19:21:35.881689+0000","last_fullsized":"2023-10-03T19:21:35.881689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:14:35.658909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":187,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-03T19:21:35.871631+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:21:35.871631+0000","last_peered":"2023-10-03T19:21:35.871631+0000","last_clean":"2023-10-03T19:21:35.871631+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:21:35.871631+0000","last_undegraded":"2023-10-03T19:21:35.871631+0000","last_fullsized":"2023-10-03T19:21:35.871631+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:57:29.734281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":179,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-03T19:21:35.881876+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:21:35.881876+0000","last_peered":"2023-10-03T19:21:35.881876+0000","last_clean":"2023-10-03T19:21:35.881876+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:21:35.881876+0000","last_undegraded":"2023-10-03T19:21:35.881876+0000","last_fullsized":"2023-10-03T19:21:35.881876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:45:46.049403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":181,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-03T19:21:35.500531+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:21:35.500531+0000","last_peered":"2023-10-03T19:21:35.500531+0000","last_clean":"2023-10-03T19:21:35.500531+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:21:35.500531+0000","last_undegraded":"2023-10-03T19:21:35.500531+0000","last_fullsized":"2023-10-03T19:21:35.500531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:06:03.191632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509554,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34196,"kb_used_data":1420,"kb_used_omap":0,"kb_used_meta":32768,"kb_avail":94337644,"statfs":{"total":96636764160,"available":96601747456,"internally_reserved":0,"allocated":1454080,"data_stored":1222906,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":33554432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.86399999999999999,"15min":0.92100000000000004},"min":{"1min":0.47199999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":4.0469999999999997},"last":0.879},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.86899999999999999,"15min":0.82799999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.45000000000000001},"max":{"1min":1.2230000000000001,"5min":1.2310000000000001,"15min":1.3420000000000001},"last":1.091}]},{"osd":1,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.89600000000000002,"15min":0.97999999999999998},"min":{"1min":0.61399999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.298,"5min":2.298,"15min":3.8239999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89500000000000002,"15min":0.873},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.236,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.92300000000000004}]},{"osd":2,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.94399999999999995,"15min":0.89800000000000002},"min":{"1min":0.60999999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":4.4779999999999998,"5min":4.4779999999999998,"15min":6.0449999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.95299999999999996,"15min":1.008},"min":{"1min":0.57399999999999995,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.673,"5min":2.673,"15min":3.98},"last":1.1220000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":0.99299999999999999,"15min":0.96599999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.51100000000000001},"max":{"1min":4.3650000000000002,"5min":4.3650000000000002,"15min":6.125},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.98199999999999998,"15min":1.0740000000000001},"min":{"1min":0.64300000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.593,"5min":1.593,"15min":3.9140000000000001},"last":1.2629999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.91500000000000004,"15min":1.077},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.4769999999999999,"5min":2.4769999999999999,"15min":5.1130000000000004},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.518,"5min":1.0760000000000001,"15min":1.05},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":12.196999999999999,"5min":12.196999999999999,"15min":12.196999999999999},"last":1.0569999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.008,"15min":1.1799999999999999},"min":{"1min":0.64200000000000002,"5min":0.63700000000000001,"15min":0.51300000000000001},"max":{"1min":2.581,"5min":2.581,"15min":5.1859999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.014,"15min":1.105},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":2.0609999999999999},"last":1.02}]},{"osd":6,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0700000000000001,"15min":1.091},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.226,"5min":1.119,"15min":1.169},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":4.5570000000000004,"5min":4.5570000000000004,"15min":6.1580000000000004},"last":1.345}]}]},{"osd":6,"up_from":15,"seq":64424509554,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":30208,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":1372160,"data_stored":631180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30932992},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.85299999999999998,"15min":0.83099999999999996},"min":{"1min":0.53500000000000003,"5min":0.45400000000000001,"15min":0.44600000000000001},"max":{"1min":1.2130000000000001,"5min":1.3340000000000001,"15min":1.504},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.88300000000000001,"15min":0.88500000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.44600000000000001},"max":{"1min":1.2430000000000001,"5min":1.423,"15min":1.839},"last":0.67800000000000005}]},{"osd":1,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.84699999999999998,"15min":0.84299999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0269999999999999,"5min":1.27,"15min":2.0150000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.877,"15min":0.88},"min":{"1min":0.52800000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.359,"5min":1.448,"15min":1.448},"last":0.98799999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.93999999999999995,"15min":0.89400000000000002},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.51900000000000002},"max":{"1min":1.1830000000000001,"5min":1.528,"15min":1.528},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.871,"5min":0.91800000000000004,"15min":0.92100000000000004},"min":{"1min":0.73299999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.99099999999999999,"5min":1.369,"15min":1.546},"last":0.92200000000000004}]},{"osd":3,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96199999999999997,"15min":0.97699999999999998},"min":{"1min":0.59999999999999998,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.171,"5min":1.377,"15min":1.6990000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.91300000000000003,"15min":0.91000000000000003},"min":{"1min":0.74399999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":2.121},"last":0.88100000000000001}]},{"osd":4,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.92300000000000004,"15min":0.99199999999999999},"min":{"1min":0.77800000000000002,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1850000000000001,"5min":1.339,"15min":1.95},"last":1.1950000000000001},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.0029999999999999,"15min":1.0589999999999999},"min":{"1min":0.77600000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2589999999999999,"5min":1.504,"15min":1.7709999999999999},"last":1.0529999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.90500000000000003,"15min":0.98399999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.26,"5min":1.3200000000000001,"15min":2.2570000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0660000000000001,"15min":1.1000000000000001},"min":{"1min":0.747,"5min":0.70699999999999996,"15min":0.68100000000000005},"max":{"1min":1.296,"5min":1.524,"15min":2.0619999999999998},"last":1.1120000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.075,"15min":1.105},"min":{"1min":0.84299999999999997,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.3320000000000001,"5min":1.639,"15min":2.0049999999999999},"last":1.165},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0449999999999999,"15min":1.079},"min":{"1min":0.86299999999999999,"5min":0.67600000000000005,"15min":0.61899999999999999},"max":{"1min":1.3360000000000001,"5min":1.4350000000000001,"15min":2.4249999999999998},"last":1.1379999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509555,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42640,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":41280,"kb_avail":94329200,"statfs":{"total":96636764160,"available":96593100800,"internally_reserved":0,"allocated":1384448,"data_stored":635303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":42270720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":1.1000000000000001,"15min":0.90100000000000002},"min":{"1min":0.70399999999999996,"5min":0.58699999999999997,"15min":0.50600000000000001},"max":{"1min":1.1799999999999999,"5min":17.686,"15min":17.686},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.88900000000000001,"5min":1.028,"15min":0.89500000000000002},"min":{"1min":0.67800000000000005,"5min":0.52500000000000002,"15min":0.49299999999999999},"max":{"1min":1.1459999999999999,"5min":16.925999999999998,"15min":16.925999999999998},"last":0.89300000000000002}]},{"osd":1,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.079,"15min":0.97899999999999998},"min":{"1min":0.621,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.3160000000000001,"5min":16.640999999999998,"15min":16.640999999999998},"last":1.018},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.1060000000000001,"15min":0.94899999999999995},"min":{"1min":0.78800000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.274,"5min":17.59,"15min":17.59},"last":0.96199999999999997}]},{"osd":2,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.004,"15min":0.94999999999999996},"min":{"1min":0.69299999999999995,"5min":0.63500000000000001,"15min":0.53200000000000003},"max":{"1min":1.3360000000000001,"5min":8.5630000000000006,"15min":8.5630000000000006},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.159,"15min":1.0189999999999999},"min":{"1min":0.69899999999999995,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.375,"5min":17.734000000000002,"15min":17.734000000000002},"last":1.0429999999999999}]},{"osd":3,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":1.101,"15min":0.95499999999999996},"min":{"1min":0.76200000000000001,"5min":0.54500000000000004,"15min":0.53900000000000003},"max":{"1min":1.258,"5min":16.98,"15min":16.98},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1910000000000001,"15min":1.1040000000000001},"min":{"1min":0.83799999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.238,"5min":16.434000000000001,"15min":16.434000000000001},"last":0.80800000000000005}]},{"osd":5,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.143,"15min":1.071},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4990000000000001,"5min":17.782,"15min":17.782},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0029999999999999,"15min":1.004},"min":{"1min":0.72499999999999998,"5min":0.65700000000000003,"15min":0.60899999999999999},"max":{"1min":1.24,"5min":1.708,"15min":1.708},"last":0.99099999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.4550000000000001,"15min":1.2569999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.47,"5min":36.106000000000002,"15min":36.106000000000002},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.119,"5min":1.2909999999999999,"15min":1.206},"min":{"1min":0.65500000000000003,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.575,"5min":17.646999999999998,"15min":17.646999999999998},"last":1.0920000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.2709999999999999,"15min":1.141},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.429,"5min":17.042000000000002,"15min":17.042000000000002},"last":1.123},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.347,"15min":1.258},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.6020000000000001,"5min":16.32,"15min":16.32},"last":1.1120000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509555,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33024,"kb_used_data":1336,"kb_used_omap":0,"kb_used_meta":31680,"kb_avail":94338816,"statfs":{"total":96636764160,"available":96602947584,"internally_reserved":0,"allocated":1368064,"data_stored":630598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":32440320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.79100000000000004,"15min":0.622},"min":{"1min":0.41399999999999998,"5min":0.32200000000000001,"15min":0.247},"max":{"1min":1.0149999999999999,"5min":13.629,"15min":13.629},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":1.202,"15min":0.81899999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.28999999999999998},"max":{"1min":1.1699999999999999,"5min":40.439,"15min":40.439},"last":0.77000000000000002}]},{"osd":1,"last update":"Tue Oct 3 19:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.88500000000000001,"15min":0.71799999999999997},"min":{"1min":0.35899999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.97999999999999998,"5min":14.074,"15min":14.074},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.76600000000000001,"15min":0.65600000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.26400000000000001},"max":{"1min":1.002,"5min":7.0060000000000002,"15min":7.0060000000000002},"last":0.72799999999999998}]},{"osd":3,"last update":"Tue Oct 3 19:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.88300000000000001,"15min":0.71799999999999997},"min":{"1min":0.40999999999999998,"5min":0.28899999999999998,"15min":0.224},"max":{"1min":1.0600000000000001,"5min":13.423999999999999,"15min":13.423999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.84599999999999997,"5min":1.044,"15min":0.83999999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.36399999999999999},"max":{"1min":1.111,"5min":18.568999999999999,"15min":18.568999999999999},"last":0.57399999999999995}]},{"osd":4,"last update":"Tue Oct 3 19:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.95499999999999996,"15min":0.88700000000000001},"min":{"1min":0.55500000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.361,"5min":1.718,"15min":1.718},"last":1.05},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.333,"15min":1.0600000000000001},"min":{"1min":0.60899999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.3959999999999999,"5min":28.667999999999999,"15min":28.667999999999999},"last":0.90900000000000003}]},{"osd":5,"last update":"Tue Oct 3 19:20:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.052,"15min":0.93300000000000005},"min":{"1min":0.60799999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.53,"5min":5.4459999999999997,"15min":5.4459999999999997},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.22,"15min":1.042},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.52700000000000002},"max":{"1min":1.5509999999999999,"5min":14.007,"15min":14.007},"last":0.98999999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":1.087,"15min":0.97499999999999998},"min":{"1min":0.64800000000000002,"5min":0.60099999999999998,"15min":0.49099999999999999},"max":{"1min":1.3919999999999999,"5min":10.679,"15min":10.679},"last":1.278},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.0940000000000001,"15min":1.014},"min":{"1min":0.66900000000000004,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.6399999999999999,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.1919999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:20:40 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.325,"15min":1.1200000000000001},"min":{"1min":0.64200000000000002,"5min":0.63100000000000001,"15min":0.56100000000000005},"max":{"1min":1.6120000000000001,"5min":18.623000000000001,"15min":18.623000000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.04,"5min":1.0780000000000001,"15min":1.0029999999999999},"min":{"1min":0.68200000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.381,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":1.212}]}]},{"osd":1,"up_from":15,"seq":64424509554,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31048,"kb_used_data":1344,"kb_used_omap":0,"kb_used_meta":29696,"kb_avail":94340792,"statfs":{"total":96636764160,"available":96604971008,"internally_reserved":0,"allocated":1376256,"data_stored":631784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30408704},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57599999999999996,"15min":0.56000000000000005},"min":{"1min":0.34799999999999998,"5min":0.27200000000000002,"15min":0.26900000000000002},"max":{"1min":0.79000000000000004,"5min":0.96899999999999997,"15min":1.0169999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70099999999999996,"15min":0.58499999999999996},"min":{"1min":0.371,"5min":0.27200000000000002,"15min":0.22900000000000001},"max":{"1min":1.01,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.66700000000000004}]},{"osd":2,"last update":"Tue Oct 3 19:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68100000000000005,"15min":0.59899999999999998},"min":{"1min":0.43099999999999999,"5min":0.30599999999999999,"15min":0.26200000000000001},"max":{"1min":0.92600000000000005,"5min":1.506,"15min":1.506},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79800000000000004,"15min":0.71699999999999997},"min":{"1min":0.48799999999999999,"5min":0.33000000000000002,"15min":0.312},"max":{"1min":1.0640000000000001,"5min":1.365,"15min":1.365},"last":1.2350000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.76800000000000002,"15min":0.68600000000000005},"min":{"1min":0.49199999999999999,"5min":0.31,"15min":0.31},"max":{"1min":1.071,"5min":1.329,"15min":1.329},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.75900000000000001,"15min":0.65000000000000002},"min":{"1min":0.504,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.2090000000000001,"5min":1.232,"15min":1.27},"last":0.91100000000000003}]},{"osd":4,"last update":"Tue Oct 3 19:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.89500000000000002,"15min":0.83599999999999997},"min":{"1min":0.67900000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2629999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.97499999999999998,"15min":0.92200000000000004},"min":{"1min":0.66600000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2430000000000001,"5min":1.728,"15min":1.728},"last":1.413}]},{"osd":5,"last update":"Tue Oct 3 19:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96999999999999997,"15min":0.90400000000000003},"min":{"1min":0.72899999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.2410000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.282},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.97299999999999998,"15min":0.89700000000000002},"min":{"1min":0.70599999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.218,"5min":1.3959999999999999,"15min":1.6080000000000001},"last":1.323}]},{"osd":6,"last update":"Tue Oct 3 19:20:42 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.024,"15min":0.96399999999999997},"min":{"1min":0.71899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.512,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0329999999999999,"15min":0.94599999999999995},"min":{"1min":0.73599999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2569999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.1879999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:20:42 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.054,"15min":0.98499999999999999},"min":{"1min":0.69299999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.343,"5min":1.673,"15min":1.673},"last":1.46},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.036,"15min":0.95399999999999996},"min":{"1min":0.751,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4279999999999999,"5min":1.5880000000000001,"15min":1.649},"last":1.137}]}]},{"osd":3,"up_from":14,"seq":60129542258,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25748,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":24384,"kb_avail":94346092,"statfs":{"total":96636764160,"available":96610398208,"internally_reserved":0,"allocated":1388544,"data_stored":635337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24969216},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61699999999999999,"15min":0.59299999999999997},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":1.0549999999999999,"5min":1.2090000000000001,"15min":1.212},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.69699999999999995,"15min":0.66500000000000004},"min":{"1min":0.33700000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.98499999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.83199999999999996}]},{"osd":1,"last update":"Tue Oct 3 19:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.68899999999999995,"15min":0.65100000000000002},"min":{"1min":0.29699999999999999,"5min":0.28599999999999998,"15min":0.27000000000000002},"max":{"1min":0.90600000000000003,"5min":1.238,"15min":1.238},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.75900000000000001,"15min":0.69999999999999996},"min":{"1min":0.40300000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.204,"5min":1.2210000000000001,"15min":1.222},"last":0.66900000000000004}]},{"osd":2,"last update":"Tue Oct 3 19:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.73999999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.2290000000000001,"5min":1.23,"15min":1.23},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72299999999999998,"15min":0.66600000000000004},"min":{"1min":0.316,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.1060000000000001,"5min":1.671,"15min":1.671},"last":0.73499999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.90800000000000003,"15min":0.91400000000000003},"min":{"1min":0.58699999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.272,"5min":1.3169999999999999,"15min":1.496},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.99299999999999999,"15min":0.95699999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3140000000000001,"5min":1.538,"15min":1.546},"last":1.1479999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.90400000000000003,"15min":0.89100000000000001},"min":{"1min":0.50600000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3480000000000001,"5min":1.581,"15min":1.581},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.012,"15min":1.004},"min":{"1min":0.60699999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.498},"last":1.1970000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.94299999999999995,"15min":0.93200000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2889999999999999,"5min":1.347,"15min":1.347},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0389999999999999,"15min":1.0109999999999999},"min":{"1min":0.56399999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.351,"5min":1.4970000000000001,"15min":1.5629999999999999},"last":1.254}]},{"osd":7,"last update":"Tue Oct 3 19:20:37 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.0820000000000001,"15min":1.034},"min":{"1min":0.72099999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.681,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.226},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.044,"15min":1.0309999999999999},"min":{"1min":0.625,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.294,"5min":1.659,"15min":1.708},"last":1.0669999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574962,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23380,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94348460,"statfs":{"total":96636764160,"available":96612823040,"internally_reserved":0,"allocated":1388544,"data_stored":638161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.86199999999999999,"15min":0.84299999999999997},"min":{"1min":0.51700000000000002,"5min":0.45100000000000001,"15min":0.437},"max":{"1min":1.2789999999999999,"5min":1.452,"15min":1.452},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.90100000000000002,"15min":0.87},"min":{"1min":0.72199999999999998,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1279999999999999,"5min":1.26,"15min":1.5940000000000001},"last":0.80600000000000005}]},{"osd":1,"last update":"Tue Oct 3 19:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.86799999999999999,"15min":0.84899999999999998},"min":{"1min":0.53200000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.151,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.89200000000000002,"15min":0.91700000000000004},"min":{"1min":0.65100000000000002,"5min":0.59799999999999998,"15min":0.57099999999999995},"max":{"1min":1.109,"5min":1.23,"15min":1.514},"last":0.71499999999999997}]},{"osd":2,"last update":"Tue Oct 3 19:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.89700000000000002,"15min":0.90100000000000002},"min":{"1min":0.65100000000000002,"5min":0.55400000000000005,"15min":0.55100000000000005},"max":{"1min":1.2350000000000001,"5min":1.351,"15min":1.3700000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.92900000000000005,"15min":0.90900000000000003},"min":{"1min":0.67000000000000004,"5min":0.57099999999999995,"15min":0.53300000000000003},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.68100000000000005}]},{"osd":3,"last update":"Tue Oct 3 19:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.92000000000000004,"15min":0.92600000000000005},"min":{"1min":0.63700000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.196,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.01,"15min":1.024},"min":{"1min":0.86199999999999999,"5min":0.65900000000000003,"15min":0.61199999999999999},"max":{"1min":1.2929999999999999,"5min":1.508,"15min":1.6659999999999999},"last":0.999}]},{"osd":4,"last update":"Tue Oct 3 19:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.97799999999999998,"15min":0.97399999999999998},"min":{"1min":0.69999999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1919999999999999,"5min":1.4530000000000001,"15min":1.5149999999999999},"last":1.095},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.95699999999999996,"15min":1.0069999999999999},"min":{"1min":0.70699999999999996,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.7709999999999999},"last":0.75900000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.99399999999999999,"15min":1.0189999999999999},"min":{"1min":0.75600000000000001,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.238,"5min":1.546,"15min":1.546},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.081,"15min":1.1200000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.3460000000000001,"5min":1.4159999999999999,"15min":1.823},"last":1.048}]},{"osd":7,"last update":"Tue Oct 3 19:20:39 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.05,"15min":1.0680000000000001},"min":{"1min":0.82699999999999996,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.302,"5min":1.4610000000000001,"15min":1.5680000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.101,"5min":1.1140000000000001,"15min":1.139},"min":{"1min":0.96299999999999997,"5min":0.76000000000000001,"15min":0.71799999999999997},"max":{"1min":1.3779999999999999,"5min":1.4179999999999999,"15min":1.9099999999999999},"last":0.95999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574963,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30788,"kb_used_data":1404,"kb_used_omap":0,"kb_used_meta":29376,"kb_avail":94341052,"statfs":{"total":96636764160,"available":96605237248,"internally_reserved":0,"allocated":1437696,"data_stored":1220988,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":30081024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67600000000000005,"15min":0.624},"min":{"1min":0.27300000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.0569999999999999,"5min":5.7480000000000002,"15min":5.7480000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.78400000000000003,"15min":0.747},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":1.018,"5min":6.274,"15min":6.274},"last":0.88700000000000001}]},{"osd":2,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.80000000000000004,"15min":0.749},"min":{"1min":0.40500000000000003,"5min":0.36499999999999999,"15min":0.35399999999999998},"max":{"1min":0.998,"5min":6.1609999999999996,"15min":6.1609999999999996},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.71699999999999997,"15min":0.70699999999999996},"min":{"1min":0.32300000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.7170000000000001},"last":0.54100000000000004}]},{"osd":3,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.85299999999999998,"15min":0.78900000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.36799999999999999},"max":{"1min":1.135,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.78800000000000003,"15min":0.751},"min":{"1min":0.38700000000000001,"5min":0.376,"15min":0.30299999999999999},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.84199999999999997}]},{"osd":4,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.997,"15min":0.94299999999999995},"min":{"1min":0.57499999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.345,"5min":8.1159999999999997,"15min":8.1159999999999997},"last":1.262},{"interface":"front","average":{"1min":1.028,"5min":1.0620000000000001,"15min":1.0429999999999999},"min":{"1min":0.68000000000000005,"5min":0.57299999999999995,"15min":0.504},"max":{"1min":1.4259999999999999,"5min":6.2320000000000002,"15min":6.2320000000000002},"last":1.4259999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.2270000000000001,"15min":1.113},"min":{"1min":0.77000000000000002,"5min":0.59399999999999997,"15min":0.46899999999999997},"max":{"1min":1.298,"5min":17.420000000000002,"15min":17.420000000000002},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.1950000000000001,"15min":1.0589999999999999},"min":{"1min":0.621,"5min":0.59499999999999997,"15min":0.54300000000000004},"max":{"1min":1.296,"5min":17.643000000000001,"15min":17.643000000000001},"last":1.1639999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0700000000000001,"15min":1.044},"min":{"1min":0.66600000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3540000000000001,"5min":5.7220000000000004,"15min":5.7220000000000004},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.109,"5min":1.0569999999999999,"15min":1.0249999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.534,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.349}]},{"osd":7,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.147,"15min":1.0840000000000001},"min":{"1min":0.77500000000000002,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.5740000000000001,"5min":5.7800000000000002,"15min":5.7800000000000002},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.0800000000000001,"15min":1.073},"min":{"1min":0.63700000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.6259999999999999,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.4650000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:21:41.101 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:21:41.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.206+0000 7f6be176f640 1 Processor -- start 2023-10-03T19:21:41.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6be176f640 1 -- start start 2023-10-03T19:21:41.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6be176f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6bdc151fb0 0x7f6bdc1523e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:41.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6be176f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bdc0c0020 con 0x7f6bdc152920 2023-10-03T19:21:41.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6be176f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bdc0c0300 con 0x7f6bdc1517a0 2023-10-03T19:21:41.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6be176f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc070350 con 0x7f6bdc151fb0 2023-10-03T19:21:41.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6bdb7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6bdc152920 0x7f6bdc159250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41298/0 (socket says 172.21.15.45:41298) 2023-10-03T19:21:41.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6bdb7fe640 1 -- 172.21.15.45:0/86411828 learned_addr learned my addr 172.21.15.45:0/86411828 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:21:41.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6bda7fc640 1 --2- 172.21.15.45:0/86411828 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6bdc151fb0 0x7f6bdc1523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:41.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6bd9ffb640 1 -- 172.21.15.45:0/86411828 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244772626 0 0) 0x7f6bdc0c0020 con 0x7f6bdc152920 2023-10-03T19:21:41.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6bd9ffb640 1 -- 172.21.15.45:0/86411828 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bc4003530 con 0x7f6bdc152920 2023-10-03T19:21:41.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6bd9ffb640 1 -- 172.21.15.45:0/86411828 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4023024278 0 0) 0x7f6bc4003530 con 0x7f6bdc152920 2023-10-03T19:21:41.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6bd9ffb640 1 -- 172.21.15.45:0/86411828 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6bdc151fb0 msgr2=0x7f6bdc1523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:41.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6bd9ffb640 1 --2- 172.21.15.45:0/86411828 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6bdc151fb0 0x7f6bdc1523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6bd9ffb640 1 -- 172.21.15.45:0/86411828 >> v1:172.21.15.79:6789/0 conn(0x7f6bdc1517a0 legacy=0x7f6bdc06aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:41.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6bd9ffb640 1 -- 172.21.15.45:0/86411828 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bdc0bd2d0 con 0x7f6bdc152920 2023-10-03T19:21:41.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6bd9ffb640 1 -- 172.21.15.45:0/86411828 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f6bd4001680 con 0x7f6bdc152920 2023-10-03T19:21:41.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6bd9ffb640 1 -- 172.21.15.45:0/86411828 >> v1:172.21.15.45:6789/0 conn(0x7f6bdc152920 legacy=0x7f6bdc159250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:41.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6bd9ffb640 1 --2- 172.21.15.45:0/86411828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bc40039b0 0x7f6bc4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:41.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6bd9ffb640 1 --2- 172.21.15.45:0/86411828 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6bdc151fb0 0x7f6bc40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:41.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6bd9ffb640 1 --2- 172.21.15.45:0/86411828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bc4004d10 0x7f6bc4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:41.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6bd9ffb640 1 -- 172.21.15.45:0/86411828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc070350 con 0x7f6bc40039b0 2023-10-03T19:21:41.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6bd9ffb640 1 -- 172.21.15.45:0/86411828 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc400ba40 con 0x7f6bc4004d10 2023-10-03T19:21:41.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6bd9ffb640 1 -- 172.21.15.45:0/86411828 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc400bc00 con 0x7f6bdc151fb0 2023-10-03T19:21:41.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6bdaffd640 1 --2- 172.21.15.45:0/86411828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bc40039b0 0x7f6bc4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:41.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6bda7fc640 1 --2- 172.21.15.45:0/86411828 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6bdc151fb0 0x7f6bc40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:41.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6bdb7fe640 1 --2- 172.21.15.45:0/86411828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bc4004d10 0x7f6bc4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:41.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6bdaffd640 1 -- 172.21.15.45:0/86411828 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6bdc151fb0 msgr2=0x7f6bc40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:41.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6bdaffd640 1 --2- 172.21.15.45:0/86411828 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6bdc151fb0 0x7f6bc40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6bdaffd640 1 -- 172.21.15.45:0/86411828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bc4004d10 msgr2=0x7f6bc4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:41.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6bdaffd640 1 --2- 172.21.15.45:0/86411828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bc4004d10 0x7f6bc4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6bdaffd640 1 -- 172.21.15.45:0/86411828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc4003530 con 0x7f6bc40039b0 2023-10-03T19:21:41.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.210+0000 7f6bdb7fe640 1 --2- 172.21.15.45:0/86411828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bc4004d10 0x7f6bc4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:21:41.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.214+0000 7f6bdaffd640 1 --2- 172.21.15.45:0/86411828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bc40039b0 0x7f6bc4003dc0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc001e70 tx=0x7f6bcc01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234ff4521f233d39 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:41.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.214+0000 7f6bd9ffb640 1 -- 172.21.15.45:0/86411828 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc003b80 con 0x7f6bc40039b0 2023-10-03T19:21:41.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.214+0000 7f6bd9ffb640 1 -- 172.21.15.45:0/86411828 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bcc003ce0 con 0x7f6bc40039b0 2023-10-03T19:21:41.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.214+0000 7f6bd9ffb640 1 -- 172.21.15.45:0/86411828 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc0052c0 con 0x7f6bc40039b0 2023-10-03T19:21:41.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.214+0000 7f6be176f640 1 -- 172.21.15.45:0/86411828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bc40039b0 msgr2=0x7f6bc4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:41.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.214+0000 7f6be176f640 1 --2- 172.21.15.45:0/86411828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bc40039b0 0x7f6bc4003dc0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc001e70 tx=0x7f6bcc01c760 comp rx=0 tx=0).stop 2023-10-03T19:21:41.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.214+0000 7f6bdb7fe640 1 -- 172.21.15.45:0/86411828 reap_dead start 2023-10-03T19:21:41.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.214+0000 7f6be176f640 1 -- 172.21.15.45:0/86411828 shutdown_connections 2023-10-03T19:21:41.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.214+0000 7f6be176f640 1 -- 172.21.15.45:0/86411828 >> 172.21.15.45:0/86411828 conn(0x7f6bdc0c2280 msgr2=0x7f6bdc0be070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:41.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.214+0000 7f6be176f640 1 -- 172.21.15.45:0/86411828 shutdown_connections 2023-10-03T19:21:41.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.214+0000 7f6be176f640 1 -- 172.21.15.45:0/86411828 wait complete. 2023-10-03T19:21:41.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.214+0000 7f6be176f640 1 Processor -- start 2023-10-03T19:21:41.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.214+0000 7f6be176f640 1 -- start start 2023-10-03T19:21:41.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.214+0000 7f6be176f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6bc40039b0 0x7f6bdc06da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:41.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.214+0000 7f6be176f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bdc1501e0 0x7f6bdc1483b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:41.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.214+0000 7f6be176f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bdc06df50 0x7f6bdc147500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:41.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.214+0000 7f6be176f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc06c580 con 0x7f6bdc06df50 2023-10-03T19:21:41.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.214+0000 7f6be176f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc06c7d0 con 0x7f6bdc1501e0 2023-10-03T19:21:41.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.214+0000 7f6be176f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc06cab0 con 0x7f6bc40039b0 2023-10-03T19:21:41.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.214+0000 7f6bdb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bdc06df50 0x7f6bdc147500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:41.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.214+0000 7f6bdb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bdc06df50 0x7f6bdc147500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39428/0 (socket says 172.21.15.45:39428) 2023-10-03T19:21:41.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.214+0000 7f6bdb7fe640 1 -- 172.21.15.45:0/3347770854 learned_addr learned my addr 172.21.15.45:0/3347770854 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:41.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.214+0000 7f6bdaffd640 1 --2- 172.21.15.45:0/3347770854 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6bc40039b0 0x7f6bdc06da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:41.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.214+0000 7f6bda7fc640 1 --2- 172.21.15.45:0/3347770854 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bdc1501e0 0x7f6bdc1483b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:41.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.214+0000 7f6bdb7fe640 1 -- 172.21.15.45:0/3347770854 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6bc40039b0 msgr2=0x7f6bdc06da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:41.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.214+0000 7f6bdb7fe640 1 --2- 172.21.15.45:0/3347770854 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6bc40039b0 0x7f6bdc06da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.214+0000 7f6bdb7fe640 1 -- 172.21.15.45:0/3347770854 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bdc1501e0 msgr2=0x7f6bdc1483b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:41.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.214+0000 7f6bdb7fe640 1 --2- 172.21.15.45:0/3347770854 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bdc1501e0 0x7f6bdc1483b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.214+0000 7f6bdb7fe640 1 -- 172.21.15.45:0/3347770854 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bdc0bcf60 con 0x7f6bdc06df50 2023-10-03T19:21:41.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.214+0000 7f6bdb7fe640 1 --2- 172.21.15.45:0/3347770854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bdc06df50 0x7f6bdc147500 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4001210 tx=0x7f6bd400d830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:41.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.218+0000 7f6bc37fe640 1 -- 172.21.15.45:0/3347770854 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd4007030 con 0x7f6bdc06df50 2023-10-03T19:21:41.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.218+0000 7f6bc37fe640 1 -- 172.21.15.45:0/3347770854 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd40071d0 con 0x7f6bdc06df50 2023-10-03T19:21:41.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.218+0000 7f6be176f640 1 -- 172.21.15.45:0/3347770854 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bdc152790 con 0x7f6bdc06df50 2023-10-03T19:21:41.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.218+0000 7f6bc37fe640 1 -- 172.21.15.45:0/3347770854 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd4007580 con 0x7f6bdc06df50 2023-10-03T19:21:41.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.218+0000 7f6be176f640 1 -- 172.21.15.45:0/3347770854 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bdc151b70 con 0x7f6bdc06df50 2023-10-03T19:21:41.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.218+0000 7f6be176f640 1 -- 172.21.15.45:0/3347770854 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bdc0bd850 con 0x7f6bdc06df50 2023-10-03T19:21:41.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.218+0000 7f6bc37fe640 1 -- 172.21.15.45:0/3347770854 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6bd40047f0 con 0x7f6bdc06df50 2023-10-03T19:21:41.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.218+0000 7f6bc37fe640 1 --2- 172.21.15.45:0/3347770854 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6bc80662b0 0x7f6bc8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:41.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.218+0000 7f6bc37fe640 1 -- 172.21.15.45:0/3347770854 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f6bd4082aa0 con 0x7f6bdc06df50 2023-10-03T19:21:41.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.218+0000 7f6bdaffd640 1 --2- 172.21.15.45:0/3347770854 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6bc80662b0 0x7f6bc8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:41.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.218+0000 7f6bdaffd640 1 --2- 172.21.15.45:0/3347770854 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6bc80662b0 0x7f6bc8068760 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc005000 tx=0x7f6bcc001520 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:41.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.222+0000 7f6bc37fe640 1 -- 172.21.15.45:0/3347770854 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6bd4050150 con 0x7f6bdc06df50 2023-10-03T19:21:41.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.370+0000 7f6be176f640 1 -- 172.21.15.45:0/3347770854 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6bdc06cfd0 con 0x7f6bc80662b0 2023-10-03T19:21:41.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.378+0000 7f6bc37fe640 1 -- 172.21.15.45:0/3347770854 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71590 (secure 0 0 0) 0x7f6bdc06cfd0 con 0x7f6bc80662b0 2023-10-03T19:21:41.384 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:21:41.385 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:21:41.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.382+0000 7f6be176f640 1 -- 172.21.15.45:0/3347770854 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6bc80662b0 msgr2=0x7f6bc8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:41.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.382+0000 7f6be176f640 1 --2- 172.21.15.45:0/3347770854 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6bc80662b0 0x7f6bc8068760 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc005000 tx=0x7f6bcc001520 comp rx=0 tx=0).stop 2023-10-03T19:21:41.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.382+0000 7f6be176f640 1 -- 172.21.15.45:0/3347770854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bdc06df50 msgr2=0x7f6bdc147500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:41.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.382+0000 7f6be176f640 1 --2- 172.21.15.45:0/3347770854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bdc06df50 0x7f6bdc147500 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4001210 tx=0x7f6bd400d830 comp rx=0 tx=0).stop 2023-10-03T19:21:41.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.382+0000 7f6be176f640 1 -- 172.21.15.45:0/3347770854 shutdown_connections 2023-10-03T19:21:41.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.382+0000 7f6be176f640 1 --2- 172.21.15.45:0/3347770854 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f6bc80662b0 0x7f6bc8068760 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.382+0000 7f6be176f640 1 --2- 172.21.15.45:0/3347770854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bdc06df50 0x7f6bdc147500 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.382+0000 7f6be176f640 1 --2- 172.21.15.45:0/3347770854 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bdc1501e0 0x7f6bdc1483b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.382+0000 7f6be176f640 1 --2- 172.21.15.45:0/3347770854 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6bc40039b0 0x7f6bdc06da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.382+0000 7f6be176f640 1 -- 172.21.15.45:0/3347770854 >> 172.21.15.45:0/3347770854 conn(0x7f6bdc0c2280 msgr2=0x7f6bdc0c07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:41.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.382+0000 7f6be176f640 1 -- 172.21.15.45:0/3347770854 shutdown_connections 2023-10-03T19:21:41.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.382+0000 7f6be176f640 1 -- 172.21.15.45:0/3347770854 wait complete. 2023-10-03T19:21:41.403 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":388,"stamp":"2023-10-03T19:21:40.645386+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252380,"kb_used_data":10908,"kb_used_omap":0,"kb_used_meta":241408,"kb_avail":754722340,"statfs":{"total":773094113280,"available":772835676160,"internally_reserved":0,"allocated":11169792,"data_stored":6246257,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":247201792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4339,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002192"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":339,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-03T19:21:35.870818+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:21:35.870818+0000","last_peered":"2023-10-03T19:21:35.870818+0000","last_clean":"2023-10-03T19:21:35.870818+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:21:35.870818+0000","last_undegraded":"2023-10-03T19:21:35.870818+0000","last_fullsized":"2023-10-03T19:21:35.870818+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:57:44.882187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":191,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-03T19:21:39.084076+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:21:39.084076+0000","last_peered":"2023-10-03T19:21:39.084076+0000","last_clean":"2023-10-03T19:21:39.084076+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:21:39.084076+0000","last_undegraded":"2023-10-03T19:21:39.084076+0000","last_fullsized":"2023-10-03T19:21:39.084076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:49:53.311099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":187,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-03T19:21:35.870713+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:21:35.870713+0000","last_peered":"2023-10-03T19:21:35.870713+0000","last_clean":"2023-10-03T19:21:35.870713+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:21:35.870713+0000","last_undegraded":"2023-10-03T19:21:35.870713+0000","last_fullsized":"2023-10-03T19:21:35.870713+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:17:50.168683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":183,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-03T19:21:35.743334+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:21:35.743334+0000","last_peered":"2023-10-03T19:21:35.743334+0000","last_clean":"2023-10-03T19:21:35.743334+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:21:35.743334+0000","last_undegraded":"2023-10-03T19:21:35.743334+0000","last_fullsized":"2023-10-03T19:21:35.743334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:09:23.536316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":191,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-03T19:21:39.078681+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:21:39.078681+0000","last_peered":"2023-10-03T19:21:39.078681+0000","last_clean":"2023-10-03T19:21:39.078681+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:21:39.078681+0000","last_undegraded":"2023-10-03T19:21:39.078681+0000","last_fullsized":"2023-10-03T19:21:39.078681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:38:18.672508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":179,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-03T19:21:35.881689+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:21:35.881689+0000","last_peered":"2023-10-03T19:21:35.881689+0000","last_clean":"2023-10-03T19:21:35.881689+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:21:35.881689+0000","last_undegraded":"2023-10-03T19:21:35.881689+0000","last_fullsized":"2023-10-03T19:21:35.881689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:14:35.658909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":187,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-03T19:21:35.871631+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:21:35.871631+0000","last_peered":"2023-10-03T19:21:35.871631+0000","last_clean":"2023-10-03T19:21:35.871631+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:21:35.871631+0000","last_undegraded":"2023-10-03T19:21:35.871631+0000","last_fullsized":"2023-10-03T19:21:35.871631+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:57:29.734281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":179,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-03T19:21:35.881876+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:21:35.881876+0000","last_peered":"2023-10-03T19:21:35.881876+0000","last_clean":"2023-10-03T19:21:35.881876+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:21:35.881876+0000","last_undegraded":"2023-10-03T19:21:35.881876+0000","last_fullsized":"2023-10-03T19:21:35.881876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:45:46.049403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":181,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-03T19:21:35.500531+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:21:35.500531+0000","last_peered":"2023-10-03T19:21:35.500531+0000","last_clean":"2023-10-03T19:21:35.500531+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:21:35.500531+0000","last_undegraded":"2023-10-03T19:21:35.500531+0000","last_fullsized":"2023-10-03T19:21:35.500531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:06:03.191632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509554,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34196,"kb_used_data":1420,"kb_used_omap":0,"kb_used_meta":32768,"kb_avail":94337644,"statfs":{"total":96636764160,"available":96601747456,"internally_reserved":0,"allocated":1454080,"data_stored":1222906,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":33554432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.86399999999999999,"15min":0.92100000000000004},"min":{"1min":0.47199999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":4.0469999999999997},"last":0.879},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.86899999999999999,"15min":0.82799999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.45000000000000001},"max":{"1min":1.2230000000000001,"5min":1.2310000000000001,"15min":1.3420000000000001},"last":1.091}]},{"osd":1,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.89600000000000002,"15min":0.97999999999999998},"min":{"1min":0.61399999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.298,"5min":2.298,"15min":3.8239999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89500000000000002,"15min":0.873},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.236,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.92300000000000004}]},{"osd":2,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.94399999999999995,"15min":0.89800000000000002},"min":{"1min":0.60999999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":4.4779999999999998,"5min":4.4779999999999998,"15min":6.0449999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.95299999999999996,"15min":1.008},"min":{"1min":0.57399999999999995,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.673,"5min":2.673,"15min":3.98},"last":1.1220000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":0.99299999999999999,"15min":0.96599999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.51100000000000001},"max":{"1min":4.3650000000000002,"5min":4.3650000000000002,"15min":6.125},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.98199999999999998,"15min":1.0740000000000001},"min":{"1min":0.64300000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.593,"5min":1.593,"15min":3.9140000000000001},"last":1.2629999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.91500000000000004,"15min":1.077},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.4769999999999999,"5min":2.4769999999999999,"15min":5.1130000000000004},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.518,"5min":1.0760000000000001,"15min":1.05},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":12.196999999999999,"5min":12.196999999999999,"15min":12.196999999999999},"last":1.0569999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.008,"15min":1.1799999999999999},"min":{"1min":0.64200000000000002,"5min":0.63700000000000001,"15min":0.51300000000000001},"max":{"1min":2.581,"5min":2.581,"15min":5.1859999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.014,"15min":1.105},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":2.0609999999999999},"last":1.02}]},{"osd":6,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0700000000000001,"15min":1.091},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.226,"5min":1.119,"15min":1.169},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":4.5570000000000004,"5min":4.5570000000000004,"15min":6.1580000000000004},"last":1.345}]}]},{"osd":6,"up_from":15,"seq":64424509554,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":30208,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":1372160,"data_stored":631180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30932992},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.85299999999999998,"15min":0.83099999999999996},"min":{"1min":0.53500000000000003,"5min":0.45400000000000001,"15min":0.44600000000000001},"max":{"1min":1.2130000000000001,"5min":1.3340000000000001,"15min":1.504},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.88300000000000001,"15min":0.88500000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.44600000000000001},"max":{"1min":1.2430000000000001,"5min":1.423,"15min":1.839},"last":0.67800000000000005}]},{"osd":1,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.84699999999999998,"15min":0.84299999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0269999999999999,"5min":1.27,"15min":2.0150000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.877,"15min":0.88},"min":{"1min":0.52800000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.359,"5min":1.448,"15min":1.448},"last":0.98799999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.93999999999999995,"15min":0.89400000000000002},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.51900000000000002},"max":{"1min":1.1830000000000001,"5min":1.528,"15min":1.528},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.871,"5min":0.91800000000000004,"15min":0.92100000000000004},"min":{"1min":0.73299999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.99099999999999999,"5min":1.369,"15min":1.546},"last":0.92200000000000004}]},{"osd":3,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96199999999999997,"15min":0.97699999999999998},"min":{"1min":0.59999999999999998,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.171,"5min":1.377,"15min":1.6990000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.91300000000000003,"15min":0.91000000000000003},"min":{"1min":0.74399999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":2.121},"last":0.88100000000000001}]},{"osd":4,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.92300000000000004,"15min":0.99199999999999999},"min":{"1min":0.77800000000000002,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1850000000000001,"5min":1.339,"15min":1.95},"last":1.1950000000000001},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.0029999999999999,"15min":1.0589999999999999},"min":{"1min":0.77600000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2589999999999999,"5min":1.504,"15min":1.7709999999999999},"last":1.0529999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.90500000000000003,"15min":0.98399999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.26,"5min":1.3200000000000001,"15min":2.2570000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0660000000000001,"15min":1.1000000000000001},"min":{"1min":0.747,"5min":0.70699999999999996,"15min":0.68100000000000005},"max":{"1min":1.296,"5min":1.524,"15min":2.0619999999999998},"last":1.1120000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.075,"15min":1.105},"min":{"1min":0.84299999999999997,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.3320000000000001,"5min":1.639,"15min":2.0049999999999999},"last":1.165},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0449999999999999,"15min":1.079},"min":{"1min":0.86299999999999999,"5min":0.67600000000000005,"15min":0.61899999999999999},"max":{"1min":1.3360000000000001,"5min":1.4350000000000001,"15min":2.4249999999999998},"last":1.1379999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509555,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42640,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":41280,"kb_avail":94329200,"statfs":{"total":96636764160,"available":96593100800,"internally_reserved":0,"allocated":1384448,"data_stored":635303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":42270720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":1.1000000000000001,"15min":0.90100000000000002},"min":{"1min":0.70399999999999996,"5min":0.58699999999999997,"15min":0.50600000000000001},"max":{"1min":1.1799999999999999,"5min":17.686,"15min":17.686},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.88900000000000001,"5min":1.028,"15min":0.89500000000000002},"min":{"1min":0.67800000000000005,"5min":0.52500000000000002,"15min":0.49299999999999999},"max":{"1min":1.1459999999999999,"5min":16.925999999999998,"15min":16.925999999999998},"last":0.89300000000000002}]},{"osd":1,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.079,"15min":0.97899999999999998},"min":{"1min":0.621,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.3160000000000001,"5min":16.640999999999998,"15min":16.640999999999998},"last":1.018},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.1060000000000001,"15min":0.94899999999999995},"min":{"1min":0.78800000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.274,"5min":17.59,"15min":17.59},"last":0.96199999999999997}]},{"osd":2,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.004,"15min":0.94999999999999996},"min":{"1min":0.69299999999999995,"5min":0.63500000000000001,"15min":0.53200000000000003},"max":{"1min":1.3360000000000001,"5min":8.5630000000000006,"15min":8.5630000000000006},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.159,"15min":1.0189999999999999},"min":{"1min":0.69899999999999995,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.375,"5min":17.734000000000002,"15min":17.734000000000002},"last":1.0429999999999999}]},{"osd":3,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":1.101,"15min":0.95499999999999996},"min":{"1min":0.76200000000000001,"5min":0.54500000000000004,"15min":0.53900000000000003},"max":{"1min":1.258,"5min":16.98,"15min":16.98},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1910000000000001,"15min":1.1040000000000001},"min":{"1min":0.83799999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.238,"5min":16.434000000000001,"15min":16.434000000000001},"last":0.80800000000000005}]},{"osd":5,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.143,"15min":1.071},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4990000000000001,"5min":17.782,"15min":17.782},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0029999999999999,"15min":1.004},"min":{"1min":0.72499999999999998,"5min":0.65700000000000003,"15min":0.60899999999999999},"max":{"1min":1.24,"5min":1.708,"15min":1.708},"last":0.99099999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.4550000000000001,"15min":1.2569999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.47,"5min":36.106000000000002,"15min":36.106000000000002},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.119,"5min":1.2909999999999999,"15min":1.206},"min":{"1min":0.65500000000000003,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.575,"5min":17.646999999999998,"15min":17.646999999999998},"last":1.0920000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.2709999999999999,"15min":1.141},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.429,"5min":17.042000000000002,"15min":17.042000000000002},"last":1.123},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.347,"15min":1.258},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.6020000000000001,"5min":16.32,"15min":16.32},"last":1.1120000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509555,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33024,"kb_used_data":1336,"kb_used_omap":0,"kb_used_meta":31680,"kb_avail":94338816,"statfs":{"total":96636764160,"available":96602947584,"internally_reserved":0,"allocated":1368064,"data_stored":630598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":32440320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.79100000000000004,"15min":0.622},"min":{"1min":0.41399999999999998,"5min":0.32200000000000001,"15min":0.247},"max":{"1min":1.0149999999999999,"5min":13.629,"15min":13.629},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":1.202,"15min":0.81899999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.28999999999999998},"max":{"1min":1.1699999999999999,"5min":40.439,"15min":40.439},"last":0.77000000000000002}]},{"osd":1,"last update":"Tue Oct 3 19:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.88500000000000001,"15min":0.71799999999999997},"min":{"1min":0.35899999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.97999999999999998,"5min":14.074,"15min":14.074},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.76600000000000001,"15min":0.65600000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.26400000000000001},"max":{"1min":1.002,"5min":7.0060000000000002,"15min":7.0060000000000002},"last":0.72799999999999998}]},{"osd":3,"last update":"Tue Oct 3 19:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.88300000000000001,"15min":0.71799999999999997},"min":{"1min":0.40999999999999998,"5min":0.28899999999999998,"15min":0.224},"max":{"1min":1.0600000000000001,"5min":13.423999999999999,"15min":13.423999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.84599999999999997,"5min":1.044,"15min":0.83999999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.36399999999999999},"max":{"1min":1.111,"5min":18.568999999999999,"15min":18.568999999999999},"last":0.57399999999999995}]},{"osd":4,"last update":"Tue Oct 3 19:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.95499999999999996,"15min":0.88700000000000001},"min":{"1min":0.55500000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.361,"5min":1.718,"15min":1.718},"last":1.05},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.333,"15min":1.0600000000000001},"min":{"1min":0.60899999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.3959999999999999,"5min":28.667999999999999,"15min":28.667999999999999},"last":0.90900000000000003}]},{"osd":5,"last update":"Tue Oct 3 19:20:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.052,"15min":0.93300000000000005},"min":{"1min":0.60799999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.53,"5min":5.4459999999999997,"15min":5.4459999999999997},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.22,"15min":1.042},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.52700000000000002},"max":{"1min":1.5509999999999999,"5min":14.007,"15min":14.007},"last":0.98999999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":1.087,"15min":0.97499999999999998},"min":{"1min":0.64800000000000002,"5min":0.60099999999999998,"15min":0.49099999999999999},"max":{"1min":1.3919999999999999,"5min":10.679,"15min":10.679},"last":1.278},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.0940000000000001,"15min":1.014},"min":{"1min":0.66900000000000004,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.6399999999999999,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.1919999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:20:40 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.325,"15min":1.1200000000000001},"min":{"1min":0.64200000000000002,"5min":0.63100000000000001,"15min":0.56100000000000005},"max":{"1min":1.6120000000000001,"5min":18.623000000000001,"15min":18.623000000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.04,"5min":1.0780000000000001,"15min":1.0029999999999999},"min":{"1min":0.68200000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.381,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":1.212}]}]},{"osd":1,"up_from":15,"seq":64424509554,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31048,"kb_used_data":1344,"kb_used_omap":0,"kb_used_meta":29696,"kb_avail":94340792,"statfs":{"total":96636764160,"available":96604971008,"internally_reserved":0,"allocated":1376256,"data_stored":631784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30408704},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57599999999999996,"15min":0.56000000000000005},"min":{"1min":0.34799999999999998,"5min":0.27200000000000002,"15min":0.26900000000000002},"max":{"1min":0.79000000000000004,"5min":0.96899999999999997,"15min":1.0169999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70099999999999996,"15min":0.58499999999999996},"min":{"1min":0.371,"5min":0.27200000000000002,"15min":0.22900000000000001},"max":{"1min":1.01,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.66700000000000004}]},{"osd":2,"last update":"Tue Oct 3 19:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68100000000000005,"15min":0.59899999999999998},"min":{"1min":0.43099999999999999,"5min":0.30599999999999999,"15min":0.26200000000000001},"max":{"1min":0.92600000000000005,"5min":1.506,"15min":1.506},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79800000000000004,"15min":0.71699999999999997},"min":{"1min":0.48799999999999999,"5min":0.33000000000000002,"15min":0.312},"max":{"1min":1.0640000000000001,"5min":1.365,"15min":1.365},"last":1.2350000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.76800000000000002,"15min":0.68600000000000005},"min":{"1min":0.49199999999999999,"5min":0.31,"15min":0.31},"max":{"1min":1.071,"5min":1.329,"15min":1.329},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.75900000000000001,"15min":0.65000000000000002},"min":{"1min":0.504,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.2090000000000001,"5min":1.232,"15min":1.27},"last":0.91100000000000003}]},{"osd":4,"last update":"Tue Oct 3 19:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.89500000000000002,"15min":0.83599999999999997},"min":{"1min":0.67900000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2629999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.97499999999999998,"15min":0.92200000000000004},"min":{"1min":0.66600000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2430000000000001,"5min":1.728,"15min":1.728},"last":1.413}]},{"osd":5,"last update":"Tue Oct 3 19:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96999999999999997,"15min":0.90400000000000003},"min":{"1min":0.72899999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.2410000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.282},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.97299999999999998,"15min":0.89700000000000002},"min":{"1min":0.70599999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.218,"5min":1.3959999999999999,"15min":1.6080000000000001},"last":1.323}]},{"osd":6,"last update":"Tue Oct 3 19:20:42 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.024,"15min":0.96399999999999997},"min":{"1min":0.71899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.512,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0329999999999999,"15min":0.94599999999999995},"min":{"1min":0.73599999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2569999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.1879999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:20:42 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.054,"15min":0.98499999999999999},"min":{"1min":0.69299999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.343,"5min":1.673,"15min":1.673},"last":1.46},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.036,"15min":0.95399999999999996},"min":{"1min":0.751,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4279999999999999,"5min":1.5880000000000001,"15min":1.649},"last":1.137}]}]},{"osd":3,"up_from":14,"seq":60129542258,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25748,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":24384,"kb_avail":94346092,"statfs":{"total":96636764160,"available":96610398208,"internally_reserved":0,"allocated":1388544,"data_stored":635337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24969216},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61699999999999999,"15min":0.59299999999999997},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":1.0549999999999999,"5min":1.2090000000000001,"15min":1.212},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.69699999999999995,"15min":0.66500000000000004},"min":{"1min":0.33700000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.98499999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.83199999999999996}]},{"osd":1,"last update":"Tue Oct 3 19:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.68899999999999995,"15min":0.65100000000000002},"min":{"1min":0.29699999999999999,"5min":0.28599999999999998,"15min":0.27000000000000002},"max":{"1min":0.90600000000000003,"5min":1.238,"15min":1.238},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.75900000000000001,"15min":0.69999999999999996},"min":{"1min":0.40300000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.204,"5min":1.2210000000000001,"15min":1.222},"last":0.66900000000000004}]},{"osd":2,"last update":"Tue Oct 3 19:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.73999999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.2290000000000001,"5min":1.23,"15min":1.23},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72299999999999998,"15min":0.66600000000000004},"min":{"1min":0.316,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.1060000000000001,"5min":1.671,"15min":1.671},"last":0.73499999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.90800000000000003,"15min":0.91400000000000003},"min":{"1min":0.58699999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.272,"5min":1.3169999999999999,"15min":1.496},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.99299999999999999,"15min":0.95699999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3140000000000001,"5min":1.538,"15min":1.546},"last":1.1479999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.90400000000000003,"15min":0.89100000000000001},"min":{"1min":0.50600000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3480000000000001,"5min":1.581,"15min":1.581},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.012,"15min":1.004},"min":{"1min":0.60699999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.498},"last":1.1970000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.94299999999999995,"15min":0.93200000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2889999999999999,"5min":1.347,"15min":1.347},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0389999999999999,"15min":1.0109999999999999},"min":{"1min":0.56399999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.351,"5min":1.4970000000000001,"15min":1.5629999999999999},"last":1.254}]},{"osd":7,"last update":"Tue Oct 3 19:20:37 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.0820000000000001,"15min":1.034},"min":{"1min":0.72099999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.681,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.226},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.044,"15min":1.0309999999999999},"min":{"1min":0.625,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.294,"5min":1.659,"15min":1.708},"last":1.0669999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574962,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23380,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94348460,"statfs":{"total":96636764160,"available":96612823040,"internally_reserved":0,"allocated":1388544,"data_stored":638161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.86199999999999999,"15min":0.84299999999999997},"min":{"1min":0.51700000000000002,"5min":0.45100000000000001,"15min":0.437},"max":{"1min":1.2789999999999999,"5min":1.452,"15min":1.452},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.90100000000000002,"15min":0.87},"min":{"1min":0.72199999999999998,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1279999999999999,"5min":1.26,"15min":1.5940000000000001},"last":0.80600000000000005}]},{"osd":1,"last update":"Tue Oct 3 19:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.86799999999999999,"15min":0.84899999999999998},"min":{"1min":0.53200000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.151,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.89200000000000002,"15min":0.91700000000000004},"min":{"1min":0.65100000000000002,"5min":0.59799999999999998,"15min":0.57099999999999995},"max":{"1min":1.109,"5min":1.23,"15min":1.514},"last":0.71499999999999997}]},{"osd":2,"last update":"Tue Oct 3 19:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.89700000000000002,"15min":0.90100000000000002},"min":{"1min":0.65100000000000002,"5min":0.55400000000000005,"15min":0.55100000000000005},"max":{"1min":1.2350000000000001,"5min":1.351,"15min":1.3700000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.92900000000000005,"15min":0.90900000000000003},"min":{"1min":0.67000000000000004,"5min":0.57099999999999995,"15min":0.53300000000000003},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.68100000000000005}]},{"osd":3,"last update":"Tue Oct 3 19:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.92000000000000004,"15min":0.92600000000000005},"min":{"1min":0.63700000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.196,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.01,"15min":1.024},"min":{"1min":0.86199999999999999,"5min":0.65900000000000003,"15min":0.61199999999999999},"max":{"1min":1.2929999999999999,"5min":1.508,"15min":1.6659999999999999},"last":0.999}]},{"osd":4,"last update":"Tue Oct 3 19:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.97799999999999998,"15min":0.97399999999999998},"min":{"1min":0.69999999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1919999999999999,"5min":1.4530000000000001,"15min":1.5149999999999999},"last":1.095},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.95699999999999996,"15min":1.0069999999999999},"min":{"1min":0.70699999999999996,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.7709999999999999},"last":0.75900000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.99399999999999999,"15min":1.0189999999999999},"min":{"1min":0.75600000000000001,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.238,"5min":1.546,"15min":1.546},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.081,"15min":1.1200000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.3460000000000001,"5min":1.4159999999999999,"15min":1.823},"last":1.048}]},{"osd":7,"last update":"Tue Oct 3 19:20:39 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.05,"15min":1.0680000000000001},"min":{"1min":0.82699999999999996,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.302,"5min":1.4610000000000001,"15min":1.5680000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.101,"5min":1.1140000000000001,"15min":1.139},"min":{"1min":0.96299999999999997,"5min":0.76000000000000001,"15min":0.71799999999999997},"max":{"1min":1.3779999999999999,"5min":1.4179999999999999,"15min":1.9099999999999999},"last":0.95999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574963,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30788,"kb_used_data":1404,"kb_used_omap":0,"kb_used_meta":29376,"kb_avail":94341052,"statfs":{"total":96636764160,"available":96605237248,"internally_reserved":0,"allocated":1437696,"data_stored":1220988,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":30081024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67600000000000005,"15min":0.624},"min":{"1min":0.27300000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.0569999999999999,"5min":5.7480000000000002,"15min":5.7480000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.78400000000000003,"15min":0.747},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":1.018,"5min":6.274,"15min":6.274},"last":0.88700000000000001}]},{"osd":2,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.80000000000000004,"15min":0.749},"min":{"1min":0.40500000000000003,"5min":0.36499999999999999,"15min":0.35399999999999998},"max":{"1min":0.998,"5min":6.1609999999999996,"15min":6.1609999999999996},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.71699999999999997,"15min":0.70699999999999996},"min":{"1min":0.32300000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.7170000000000001},"last":0.54100000000000004}]},{"osd":3,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.85299999999999998,"15min":0.78900000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.36799999999999999},"max":{"1min":1.135,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.78800000000000003,"15min":0.751},"min":{"1min":0.38700000000000001,"5min":0.376,"15min":0.30299999999999999},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.84199999999999997}]},{"osd":4,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.997,"15min":0.94299999999999995},"min":{"1min":0.57499999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.345,"5min":8.1159999999999997,"15min":8.1159999999999997},"last":1.262},{"interface":"front","average":{"1min":1.028,"5min":1.0620000000000001,"15min":1.0429999999999999},"min":{"1min":0.68000000000000005,"5min":0.57299999999999995,"15min":0.504},"max":{"1min":1.4259999999999999,"5min":6.2320000000000002,"15min":6.2320000000000002},"last":1.4259999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.2270000000000001,"15min":1.113},"min":{"1min":0.77000000000000002,"5min":0.59399999999999997,"15min":0.46899999999999997},"max":{"1min":1.298,"5min":17.420000000000002,"15min":17.420000000000002},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.1950000000000001,"15min":1.0589999999999999},"min":{"1min":0.621,"5min":0.59499999999999997,"15min":0.54300000000000004},"max":{"1min":1.296,"5min":17.643000000000001,"15min":17.643000000000001},"last":1.1639999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0700000000000001,"15min":1.044},"min":{"1min":0.66600000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3540000000000001,"5min":5.7220000000000004,"15min":5.7220000000000004},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.109,"5min":1.0569999999999999,"15min":1.0249999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.534,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.349}]},{"osd":7,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.147,"15min":1.0840000000000001},"min":{"1min":0.77500000000000002,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.5740000000000001,"5min":5.7800000000000002,"15min":5.7800000000000002},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.0800000000000001,"15min":1.073},"min":{"1min":0.63700000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.6259999999999999,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.4650000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:21:41.405 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-03T19:21:41.405 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:21:41.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.518+0000 7f1c36191640 1 Processor -- start 2023-10-03T19:21:41.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.518+0000 7f1c36191640 1 -- start start 2023-10-03T19:21:41.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.518+0000 7f1c36191640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1c3006f170 0x7f1c30150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:41.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.518+0000 7f1c36191640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c300bc8b0 0x7f1c3014ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:41.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.518+0000 7f1c36191640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c3006cac0 con 0x7f1c3006d170 2023-10-03T19:21:41.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.518+0000 7f1c36191640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c300720d0 con 0x7f1c3006f170 2023-10-03T19:21:41.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.518+0000 7f1c36191640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c300a5ab0 con 0x7f1c300bc8b0 2023-10-03T19:21:41.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.518+0000 7f1c2effd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c300bc8b0 0x7f1c3014ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:41.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.518+0000 7f1c2effd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c300bc8b0 0x7f1c3014ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:39172/0 (socket says 172.21.15.45:39172) 2023-10-03T19:21:41.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.518+0000 7f1c2effd640 1 -- 172.21.15.45:0/2939919725 learned_addr learned my addr 172.21.15.45:0/2939919725 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:41.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.518+0000 7f1c2f7fe640 1 --2- 172.21.15.45:0/2939919725 >> v2:172.21.15.79:3300/0 conn(0x7f1c3006f170 0x7f1c30150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:41.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.518+0000 7f1c2effd640 1 -- 172.21.15.45:0/2939919725 >> v2:172.21.15.79:3300/0 conn(0x7f1c3006f170 msgr2=0x7f1c30150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:41.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.518+0000 7f1c2effd640 1 --2- 172.21.15.45:0/2939919725 >> v2:172.21.15.79:3300/0 conn(0x7f1c3006f170 0x7f1c30150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.518+0000 7f1c2effd640 1 -- 172.21.15.45:0/2939919725 >> v1:172.21.15.79:6789/0 conn(0x7f1c3006d170 legacy=0x7f1c3014cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:41.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.518+0000 7f1c2effd640 1 -- 172.21.15.45:0/2939919725 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3006cd00 con 0x7f1c300bc8b0 2023-10-03T19:21:41.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.522+0000 7f1c2effd640 1 --2- 172.21.15.45:0/2939919725 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c300bc8b0 0x7f1c3014ca70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1c24009870 tx=0x7f1c2401ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd22dc45a2ce9f7f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:41.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.522+0000 7f1c2e7fc640 1 -- 172.21.15.45:0/2939919725 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c240a8a30 con 0x7f1c300bc8b0 2023-10-03T19:21:41.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.522+0000 7f1c2e7fc640 1 -- 172.21.15.45:0/2939919725 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c240a8b90 con 0x7f1c300bc8b0 2023-10-03T19:21:41.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.522+0000 7f1c2e7fc640 1 -- 172.21.15.45:0/2939919725 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c240b0440 con 0x7f1c300bc8b0 2023-10-03T19:21:41.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.522+0000 7f1c36191640 1 -- 172.21.15.45:0/2939919725 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c300bc8b0 msgr2=0x7f1c3014ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:41.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.522+0000 7f1c36191640 1 --2- 172.21.15.45:0/2939919725 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c300bc8b0 0x7f1c3014ca70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1c24009870 tx=0x7f1c2401ed30 comp rx=0 tx=0).stop 2023-10-03T19:21:41.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.522+0000 7f1c36191640 1 -- 172.21.15.45:0/2939919725 shutdown_connections 2023-10-03T19:21:41.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.522+0000 7f1c36191640 1 --2- 172.21.15.45:0/2939919725 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c300bc8b0 0x7f1c3014ca70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.522+0000 7f1c36191640 1 --2- 172.21.15.45:0/2939919725 >> v2:172.21.15.79:3300/0 conn(0x7f1c3006f170 0x7f1c30150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.522+0000 7f1c36191640 1 -- 172.21.15.45:0/2939919725 >> 172.21.15.45:0/2939919725 conn(0x7f1c300bcf50 msgr2=0x7f1c300bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:41.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.522+0000 7f1c36191640 1 -- 172.21.15.45:0/2939919725 shutdown_connections 2023-10-03T19:21:41.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.522+0000 7f1c36191640 1 -- 172.21.15.45:0/2939919725 wait complete. 2023-10-03T19:21:41.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.526+0000 7f1c36191640 1 Processor -- start 2023-10-03T19:21:41.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.526+0000 7f1c36191640 1 -- start start 2023-10-03T19:21:41.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.526+0000 7f1c36191640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c3006d170 0x7f1c300a2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:41.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.526+0000 7f1c36191640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c3006f170 0x7f1c300baf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:41.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.526+0000 7f1c36191640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c300bc8b0 0x7f1c301e14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:41.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.526+0000 7f1c36191640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c301471f0 con 0x7f1c3006f170 2023-10-03T19:21:41.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.526+0000 7f1c36191640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c301e54f0 con 0x7f1c300bc8b0 2023-10-03T19:21:41.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.526+0000 7f1c36191640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c30145ca0 con 0x7f1c3006d170 2023-10-03T19:21:41.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.526+0000 7f1c2effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c3006f170 0x7f1c300baf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:41.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.526+0000 7f1c2effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c3006f170 0x7f1c300baf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39442/0 (socket says 172.21.15.45:39442) 2023-10-03T19:21:41.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.526+0000 7f1c2effd640 1 -- 172.21.15.45:0/1652150476 learned_addr learned my addr 172.21.15.45:0/1652150476 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:41.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.526+0000 7f1c2f7fe640 1 --2- 172.21.15.45:0/1652150476 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c3006d170 0x7f1c300a2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:41.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.526+0000 7f1c2ffff640 1 --2- 172.21.15.45:0/1652150476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c300bc8b0 0x7f1c301e14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:41.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.526+0000 7f1c2effd640 1 -- 172.21.15.45:0/1652150476 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c3006d170 msgr2=0x7f1c300a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:41.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.526+0000 7f1c2effd640 1 --2- 172.21.15.45:0/1652150476 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c3006d170 0x7f1c300a2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.526+0000 7f1c2effd640 1 -- 172.21.15.45:0/1652150476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c300bc8b0 msgr2=0x7f1c301e14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:41.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.526+0000 7f1c2effd640 1 --2- 172.21.15.45:0/1652150476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c300bc8b0 0x7f1c301e14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.526+0000 7f1c2effd640 1 -- 172.21.15.45:0/1652150476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c240094d0 con 0x7f1c3006f170 2023-10-03T19:21:41.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.526+0000 7f1c2ffff640 1 --2- 172.21.15.45:0/1652150476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c300bc8b0 0x7f1c301e14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:21:41.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.526+0000 7f1c2effd640 1 --2- 172.21.15.45:0/1652150476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c3006f170 0x7f1c300baf20 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f1c240b3040 tx=0x7f1c2401bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:41.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.526+0000 7f1c17fff640 1 -- 172.21.15.45:0/1652150476 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c240b0dd0 con 0x7f1c3006f170 2023-10-03T19:21:41.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.526+0000 7f1c17fff640 1 -- 172.21.15.45:0/1652150476 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c240bb460 con 0x7f1c3006f170 2023-10-03T19:21:41.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.526+0000 7f1c36191640 1 -- 172.21.15.45:0/1652150476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c3014c4a0 con 0x7f1c3006f170 2023-10-03T19:21:41.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.526+0000 7f1c17fff640 1 -- 172.21.15.45:0/1652150476 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c240bb810 con 0x7f1c3006f170 2023-10-03T19:21:41.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.526+0000 7f1c36191640 1 -- 172.21.15.45:0/1652150476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c3014fae0 con 0x7f1c3006f170 2023-10-03T19:21:41.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.526+0000 7f1c36191640 1 -- 172.21.15.45:0/1652150476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c3006f540 con 0x7f1c3006f170 2023-10-03T19:21:41.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.530+0000 7f1c17fff640 1 -- 172.21.15.45:0/1652150476 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1c240b83f0 con 0x7f1c3006f170 2023-10-03T19:21:41.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.530+0000 7f1c17fff640 1 --2- 172.21.15.45:0/1652150476 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1c1c066280 0x7f1c1c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:41.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.530+0000 7f1c17fff640 1 -- 172.21.15.45:0/1652150476 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f1c241217c0 con 0x7f1c3006f170 2023-10-03T19:21:41.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.530+0000 7f1c2f7fe640 1 --2- 172.21.15.45:0/1652150476 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1c1c066280 0x7f1c1c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:41.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.530+0000 7f1c2f7fe640 1 --2- 172.21.15.45:0/1652150476 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1c1c066280 0x7f1c1c068730 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1c20009af0 tx=0x7f1c20008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:41.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.534+0000 7f1c17fff640 1 -- 172.21.15.45:0/1652150476 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1c240eee60 con 0x7f1c3006f170 2023-10-03T19:21:41.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.682+0000 7f1c36191640 1 -- 172.21.15.45:0/1652150476 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1c3004de80 con 0x7f1c1c066280 2023-10-03T19:21:41.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.690+0000 7f1c17fff640 1 -- 172.21.15.45:0/1652150476 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71590 (secure 0 0 0) 0x7f1c3004de80 con 0x7f1c1c066280 2023-10-03T19:21:41.694 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:21:41.695 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:21:41.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.690+0000 7f1c36191640 1 -- 172.21.15.45:0/1652150476 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1c1c066280 msgr2=0x7f1c1c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:41.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.690+0000 7f1c36191640 1 --2- 172.21.15.45:0/1652150476 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1c1c066280 0x7f1c1c068730 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1c20009af0 tx=0x7f1c20008040 comp rx=0 tx=0).stop 2023-10-03T19:21:41.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.690+0000 7f1c36191640 1 -- 172.21.15.45:0/1652150476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c3006f170 msgr2=0x7f1c300baf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:41.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.690+0000 7f1c36191640 1 --2- 172.21.15.45:0/1652150476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c3006f170 0x7f1c300baf20 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f1c240b3040 tx=0x7f1c2401bad0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.690+0000 7f1c36191640 1 -- 172.21.15.45:0/1652150476 shutdown_connections 2023-10-03T19:21:41.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.690+0000 7f1c36191640 1 --2- 172.21.15.45:0/1652150476 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f1c1c066280 0x7f1c1c068730 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.690+0000 7f1c36191640 1 --2- 172.21.15.45:0/1652150476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c300bc8b0 0x7f1c301e14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.690+0000 7f1c36191640 1 --2- 172.21.15.45:0/1652150476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c3006f170 0x7f1c300baf20 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.690+0000 7f1c36191640 1 --2- 172.21.15.45:0/1652150476 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c3006d170 0x7f1c300a2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.690+0000 7f1c36191640 1 -- 172.21.15.45:0/1652150476 >> 172.21.15.45:0/1652150476 conn(0x7f1c300bcf50 msgr2=0x7f1c300c03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:41.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.690+0000 7f1c36191640 1 -- 172.21.15.45:0/1652150476 shutdown_connections 2023-10-03T19:21:41.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.690+0000 7f1c36191640 1 -- 172.21.15.45:0/1652150476 wait complete. 2023-10-03T19:21:41.712 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":388,"stamp":"2023-10-03T19:21:40.645386+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252380,"kb_used_data":10908,"kb_used_omap":0,"kb_used_meta":241408,"kb_avail":754722340,"statfs":{"total":773094113280,"available":772835676160,"internally_reserved":0,"allocated":11169792,"data_stored":6246257,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":247201792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4339,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002192"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":339,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-03T19:21:35.870818+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:21:35.870818+0000","last_peered":"2023-10-03T19:21:35.870818+0000","last_clean":"2023-10-03T19:21:35.870818+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:21:35.870818+0000","last_undegraded":"2023-10-03T19:21:35.870818+0000","last_fullsized":"2023-10-03T19:21:35.870818+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T19:57:44.882187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":191,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-03T19:21:39.084076+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:21:39.084076+0000","last_peered":"2023-10-03T19:21:39.084076+0000","last_clean":"2023-10-03T19:21:39.084076+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:21:39.084076+0000","last_undegraded":"2023-10-03T19:21:39.084076+0000","last_fullsized":"2023-10-03T19:21:39.084076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:49:53.311099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":187,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-03T19:21:35.870713+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:21:35.870713+0000","last_peered":"2023-10-03T19:21:35.870713+0000","last_clean":"2023-10-03T19:21:35.870713+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:21:35.870713+0000","last_undegraded":"2023-10-03T19:21:35.870713+0000","last_fullsized":"2023-10-03T19:21:35.870713+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:17:50.168683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":183,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-03T19:21:35.743334+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:21:35.743334+0000","last_peered":"2023-10-03T19:21:35.743334+0000","last_clean":"2023-10-03T19:21:35.743334+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:21:35.743334+0000","last_undegraded":"2023-10-03T19:21:35.743334+0000","last_fullsized":"2023-10-03T19:21:35.743334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:09:23.536316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":191,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-03T19:21:39.078681+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:21:39.078681+0000","last_peered":"2023-10-03T19:21:39.078681+0000","last_clean":"2023-10-03T19:21:39.078681+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:21:39.078681+0000","last_undegraded":"2023-10-03T19:21:39.078681+0000","last_fullsized":"2023-10-03T19:21:39.078681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:38:18.672508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":179,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-03T19:21:35.881689+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:21:35.881689+0000","last_peered":"2023-10-03T19:21:35.881689+0000","last_clean":"2023-10-03T19:21:35.881689+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:21:35.881689+0000","last_undegraded":"2023-10-03T19:21:35.881689+0000","last_fullsized":"2023-10-03T19:21:35.881689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:14:35.658909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":187,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-03T19:21:35.871631+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:21:35.871631+0000","last_peered":"2023-10-03T19:21:35.871631+0000","last_clean":"2023-10-03T19:21:35.871631+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:21:35.871631+0000","last_undegraded":"2023-10-03T19:21:35.871631+0000","last_fullsized":"2023-10-03T19:21:35.871631+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:57:29.734281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":179,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-03T19:21:35.881876+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:21:35.881876+0000","last_peered":"2023-10-03T19:21:35.881876+0000","last_clean":"2023-10-03T19:21:35.881876+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:21:35.881876+0000","last_undegraded":"2023-10-03T19:21:35.881876+0000","last_fullsized":"2023-10-03T19:21:35.881876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:45:46.049403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":181,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-03T19:21:35.500531+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:21:35.500531+0000","last_peered":"2023-10-03T19:21:35.500531+0000","last_clean":"2023-10-03T19:21:35.500531+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:21:35.500531+0000","last_undegraded":"2023-10-03T19:21:35.500531+0000","last_fullsized":"2023-10-03T19:21:35.500531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:06:03.191632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509554,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34196,"kb_used_data":1420,"kb_used_omap":0,"kb_used_meta":32768,"kb_avail":94337644,"statfs":{"total":96636764160,"available":96601747456,"internally_reserved":0,"allocated":1454080,"data_stored":1222906,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":33554432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.86399999999999999,"15min":0.92100000000000004},"min":{"1min":0.47199999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":4.0469999999999997},"last":0.879},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.86899999999999999,"15min":0.82799999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.45000000000000001},"max":{"1min":1.2230000000000001,"5min":1.2310000000000001,"15min":1.3420000000000001},"last":1.091}]},{"osd":1,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.89600000000000002,"15min":0.97999999999999998},"min":{"1min":0.61399999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.298,"5min":2.298,"15min":3.8239999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89500000000000002,"15min":0.873},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.236,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.92300000000000004}]},{"osd":2,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.94399999999999995,"15min":0.89800000000000002},"min":{"1min":0.60999999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":4.4779999999999998,"5min":4.4779999999999998,"15min":6.0449999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.95299999999999996,"15min":1.008},"min":{"1min":0.57399999999999995,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.673,"5min":2.673,"15min":3.98},"last":1.1220000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":0.99299999999999999,"15min":0.96599999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.51100000000000001},"max":{"1min":4.3650000000000002,"5min":4.3650000000000002,"15min":6.125},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.98199999999999998,"15min":1.0740000000000001},"min":{"1min":0.64300000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.593,"5min":1.593,"15min":3.9140000000000001},"last":1.2629999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.91500000000000004,"15min":1.077},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.4769999999999999,"5min":2.4769999999999999,"15min":5.1130000000000004},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.518,"5min":1.0760000000000001,"15min":1.05},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":12.196999999999999,"5min":12.196999999999999,"15min":12.196999999999999},"last":1.0569999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.008,"15min":1.1799999999999999},"min":{"1min":0.64200000000000002,"5min":0.63700000000000001,"15min":0.51300000000000001},"max":{"1min":2.581,"5min":2.581,"15min":5.1859999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.014,"15min":1.105},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":2.0609999999999999},"last":1.02}]},{"osd":6,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0700000000000001,"15min":1.091},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.226,"5min":1.119,"15min":1.169},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":4.5570000000000004,"5min":4.5570000000000004,"15min":6.1580000000000004},"last":1.345}]}]},{"osd":6,"up_from":15,"seq":64424509554,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":30208,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":1372160,"data_stored":631180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30932992},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.85299999999999998,"15min":0.83099999999999996},"min":{"1min":0.53500000000000003,"5min":0.45400000000000001,"15min":0.44600000000000001},"max":{"1min":1.2130000000000001,"5min":1.3340000000000001,"15min":1.504},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.88300000000000001,"15min":0.88500000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.44600000000000001},"max":{"1min":1.2430000000000001,"5min":1.423,"15min":1.839},"last":0.67800000000000005}]},{"osd":1,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.84699999999999998,"15min":0.84299999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0269999999999999,"5min":1.27,"15min":2.0150000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.877,"15min":0.88},"min":{"1min":0.52800000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.359,"5min":1.448,"15min":1.448},"last":0.98799999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.93999999999999995,"15min":0.89400000000000002},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.51900000000000002},"max":{"1min":1.1830000000000001,"5min":1.528,"15min":1.528},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.871,"5min":0.91800000000000004,"15min":0.92100000000000004},"min":{"1min":0.73299999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.99099999999999999,"5min":1.369,"15min":1.546},"last":0.92200000000000004}]},{"osd":3,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96199999999999997,"15min":0.97699999999999998},"min":{"1min":0.59999999999999998,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.171,"5min":1.377,"15min":1.6990000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.91300000000000003,"15min":0.91000000000000003},"min":{"1min":0.74399999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":2.121},"last":0.88100000000000001}]},{"osd":4,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.92300000000000004,"15min":0.99199999999999999},"min":{"1min":0.77800000000000002,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1850000000000001,"5min":1.339,"15min":1.95},"last":1.1950000000000001},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.0029999999999999,"15min":1.0589999999999999},"min":{"1min":0.77600000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2589999999999999,"5min":1.504,"15min":1.7709999999999999},"last":1.0529999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.90500000000000003,"15min":0.98399999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.26,"5min":1.3200000000000001,"15min":2.2570000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0660000000000001,"15min":1.1000000000000001},"min":{"1min":0.747,"5min":0.70699999999999996,"15min":0.68100000000000005},"max":{"1min":1.296,"5min":1.524,"15min":2.0619999999999998},"last":1.1120000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.075,"15min":1.105},"min":{"1min":0.84299999999999997,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.3320000000000001,"5min":1.639,"15min":2.0049999999999999},"last":1.165},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0449999999999999,"15min":1.079},"min":{"1min":0.86299999999999999,"5min":0.67600000000000005,"15min":0.61899999999999999},"max":{"1min":1.3360000000000001,"5min":1.4350000000000001,"15min":2.4249999999999998},"last":1.1379999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509555,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42640,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":41280,"kb_avail":94329200,"statfs":{"total":96636764160,"available":96593100800,"internally_reserved":0,"allocated":1384448,"data_stored":635303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":42270720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":1.1000000000000001,"15min":0.90100000000000002},"min":{"1min":0.70399999999999996,"5min":0.58699999999999997,"15min":0.50600000000000001},"max":{"1min":1.1799999999999999,"5min":17.686,"15min":17.686},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.88900000000000001,"5min":1.028,"15min":0.89500000000000002},"min":{"1min":0.67800000000000005,"5min":0.52500000000000002,"15min":0.49299999999999999},"max":{"1min":1.1459999999999999,"5min":16.925999999999998,"15min":16.925999999999998},"last":0.89300000000000002}]},{"osd":1,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.079,"15min":0.97899999999999998},"min":{"1min":0.621,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.3160000000000001,"5min":16.640999999999998,"15min":16.640999999999998},"last":1.018},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.1060000000000001,"15min":0.94899999999999995},"min":{"1min":0.78800000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.274,"5min":17.59,"15min":17.59},"last":0.96199999999999997}]},{"osd":2,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.004,"15min":0.94999999999999996},"min":{"1min":0.69299999999999995,"5min":0.63500000000000001,"15min":0.53200000000000003},"max":{"1min":1.3360000000000001,"5min":8.5630000000000006,"15min":8.5630000000000006},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.159,"15min":1.0189999999999999},"min":{"1min":0.69899999999999995,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.375,"5min":17.734000000000002,"15min":17.734000000000002},"last":1.0429999999999999}]},{"osd":3,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":1.101,"15min":0.95499999999999996},"min":{"1min":0.76200000000000001,"5min":0.54500000000000004,"15min":0.53900000000000003},"max":{"1min":1.258,"5min":16.98,"15min":16.98},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1910000000000001,"15min":1.1040000000000001},"min":{"1min":0.83799999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.238,"5min":16.434000000000001,"15min":16.434000000000001},"last":0.80800000000000005}]},{"osd":5,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.143,"15min":1.071},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4990000000000001,"5min":17.782,"15min":17.782},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0029999999999999,"15min":1.004},"min":{"1min":0.72499999999999998,"5min":0.65700000000000003,"15min":0.60899999999999999},"max":{"1min":1.24,"5min":1.708,"15min":1.708},"last":0.99099999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.4550000000000001,"15min":1.2569999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.47,"5min":36.106000000000002,"15min":36.106000000000002},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.119,"5min":1.2909999999999999,"15min":1.206},"min":{"1min":0.65500000000000003,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.575,"5min":17.646999999999998,"15min":17.646999999999998},"last":1.0920000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.2709999999999999,"15min":1.141},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.429,"5min":17.042000000000002,"15min":17.042000000000002},"last":1.123},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.347,"15min":1.258},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.6020000000000001,"5min":16.32,"15min":16.32},"last":1.1120000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509555,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33024,"kb_used_data":1336,"kb_used_omap":0,"kb_used_meta":31680,"kb_avail":94338816,"statfs":{"total":96636764160,"available":96602947584,"internally_reserved":0,"allocated":1368064,"data_stored":630598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":32440320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.79100000000000004,"15min":0.622},"min":{"1min":0.41399999999999998,"5min":0.32200000000000001,"15min":0.247},"max":{"1min":1.0149999999999999,"5min":13.629,"15min":13.629},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":1.202,"15min":0.81899999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.28999999999999998},"max":{"1min":1.1699999999999999,"5min":40.439,"15min":40.439},"last":0.77000000000000002}]},{"osd":1,"last update":"Tue Oct 3 19:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.88500000000000001,"15min":0.71799999999999997},"min":{"1min":0.35899999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.97999999999999998,"5min":14.074,"15min":14.074},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.76600000000000001,"15min":0.65600000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.26400000000000001},"max":{"1min":1.002,"5min":7.0060000000000002,"15min":7.0060000000000002},"last":0.72799999999999998}]},{"osd":3,"last update":"Tue Oct 3 19:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.88300000000000001,"15min":0.71799999999999997},"min":{"1min":0.40999999999999998,"5min":0.28899999999999998,"15min":0.224},"max":{"1min":1.0600000000000001,"5min":13.423999999999999,"15min":13.423999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.84599999999999997,"5min":1.044,"15min":0.83999999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.36399999999999999},"max":{"1min":1.111,"5min":18.568999999999999,"15min":18.568999999999999},"last":0.57399999999999995}]},{"osd":4,"last update":"Tue Oct 3 19:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.95499999999999996,"15min":0.88700000000000001},"min":{"1min":0.55500000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.361,"5min":1.718,"15min":1.718},"last":1.05},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.333,"15min":1.0600000000000001},"min":{"1min":0.60899999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.3959999999999999,"5min":28.667999999999999,"15min":28.667999999999999},"last":0.90900000000000003}]},{"osd":5,"last update":"Tue Oct 3 19:20:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.052,"15min":0.93300000000000005},"min":{"1min":0.60799999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.53,"5min":5.4459999999999997,"15min":5.4459999999999997},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.22,"15min":1.042},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.52700000000000002},"max":{"1min":1.5509999999999999,"5min":14.007,"15min":14.007},"last":0.98999999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":1.087,"15min":0.97499999999999998},"min":{"1min":0.64800000000000002,"5min":0.60099999999999998,"15min":0.49099999999999999},"max":{"1min":1.3919999999999999,"5min":10.679,"15min":10.679},"last":1.278},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.0940000000000001,"15min":1.014},"min":{"1min":0.66900000000000004,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.6399999999999999,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.1919999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:20:40 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.325,"15min":1.1200000000000001},"min":{"1min":0.64200000000000002,"5min":0.63100000000000001,"15min":0.56100000000000005},"max":{"1min":1.6120000000000001,"5min":18.623000000000001,"15min":18.623000000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.04,"5min":1.0780000000000001,"15min":1.0029999999999999},"min":{"1min":0.68200000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.381,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":1.212}]}]},{"osd":1,"up_from":15,"seq":64424509554,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31048,"kb_used_data":1344,"kb_used_omap":0,"kb_used_meta":29696,"kb_avail":94340792,"statfs":{"total":96636764160,"available":96604971008,"internally_reserved":0,"allocated":1376256,"data_stored":631784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30408704},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57599999999999996,"15min":0.56000000000000005},"min":{"1min":0.34799999999999998,"5min":0.27200000000000002,"15min":0.26900000000000002},"max":{"1min":0.79000000000000004,"5min":0.96899999999999997,"15min":1.0169999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70099999999999996,"15min":0.58499999999999996},"min":{"1min":0.371,"5min":0.27200000000000002,"15min":0.22900000000000001},"max":{"1min":1.01,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.66700000000000004}]},{"osd":2,"last update":"Tue Oct 3 19:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68100000000000005,"15min":0.59899999999999998},"min":{"1min":0.43099999999999999,"5min":0.30599999999999999,"15min":0.26200000000000001},"max":{"1min":0.92600000000000005,"5min":1.506,"15min":1.506},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79800000000000004,"15min":0.71699999999999997},"min":{"1min":0.48799999999999999,"5min":0.33000000000000002,"15min":0.312},"max":{"1min":1.0640000000000001,"5min":1.365,"15min":1.365},"last":1.2350000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.76800000000000002,"15min":0.68600000000000005},"min":{"1min":0.49199999999999999,"5min":0.31,"15min":0.31},"max":{"1min":1.071,"5min":1.329,"15min":1.329},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.75900000000000001,"15min":0.65000000000000002},"min":{"1min":0.504,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.2090000000000001,"5min":1.232,"15min":1.27},"last":0.91100000000000003}]},{"osd":4,"last update":"Tue Oct 3 19:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.89500000000000002,"15min":0.83599999999999997},"min":{"1min":0.67900000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2629999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.97499999999999998,"15min":0.92200000000000004},"min":{"1min":0.66600000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2430000000000001,"5min":1.728,"15min":1.728},"last":1.413}]},{"osd":5,"last update":"Tue Oct 3 19:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96999999999999997,"15min":0.90400000000000003},"min":{"1min":0.72899999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.2410000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.282},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.97299999999999998,"15min":0.89700000000000002},"min":{"1min":0.70599999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.218,"5min":1.3959999999999999,"15min":1.6080000000000001},"last":1.323}]},{"osd":6,"last update":"Tue Oct 3 19:20:42 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.024,"15min":0.96399999999999997},"min":{"1min":0.71899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.512,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0329999999999999,"15min":0.94599999999999995},"min":{"1min":0.73599999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2569999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.1879999999999999}]},{"osd":7,"last update":"Tue Oct 3 19:20:42 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.054,"15min":0.98499999999999999},"min":{"1min":0.69299999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.343,"5min":1.673,"15min":1.673},"last":1.46},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.036,"15min":0.95399999999999996},"min":{"1min":0.751,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4279999999999999,"5min":1.5880000000000001,"15min":1.649},"last":1.137}]}]},{"osd":3,"up_from":14,"seq":60129542258,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25748,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":24384,"kb_avail":94346092,"statfs":{"total":96636764160,"available":96610398208,"internally_reserved":0,"allocated":1388544,"data_stored":635337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24969216},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61699999999999999,"15min":0.59299999999999997},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":1.0549999999999999,"5min":1.2090000000000001,"15min":1.212},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.69699999999999995,"15min":0.66500000000000004},"min":{"1min":0.33700000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.98499999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.83199999999999996}]},{"osd":1,"last update":"Tue Oct 3 19:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.68899999999999995,"15min":0.65100000000000002},"min":{"1min":0.29699999999999999,"5min":0.28599999999999998,"15min":0.27000000000000002},"max":{"1min":0.90600000000000003,"5min":1.238,"15min":1.238},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.75900000000000001,"15min":0.69999999999999996},"min":{"1min":0.40300000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.204,"5min":1.2210000000000001,"15min":1.222},"last":0.66900000000000004}]},{"osd":2,"last update":"Tue Oct 3 19:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.73999999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.2290000000000001,"5min":1.23,"15min":1.23},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72299999999999998,"15min":0.66600000000000004},"min":{"1min":0.316,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.1060000000000001,"5min":1.671,"15min":1.671},"last":0.73499999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.90800000000000003,"15min":0.91400000000000003},"min":{"1min":0.58699999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.272,"5min":1.3169999999999999,"15min":1.496},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.99299999999999999,"15min":0.95699999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3140000000000001,"5min":1.538,"15min":1.546},"last":1.1479999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.90400000000000003,"15min":0.89100000000000001},"min":{"1min":0.50600000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3480000000000001,"5min":1.581,"15min":1.581},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.012,"15min":1.004},"min":{"1min":0.60699999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.498},"last":1.1970000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.94299999999999995,"15min":0.93200000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2889999999999999,"5min":1.347,"15min":1.347},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0389999999999999,"15min":1.0109999999999999},"min":{"1min":0.56399999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.351,"5min":1.4970000000000001,"15min":1.5629999999999999},"last":1.254}]},{"osd":7,"last update":"Tue Oct 3 19:20:37 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.0820000000000001,"15min":1.034},"min":{"1min":0.72099999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.681,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.226},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.044,"15min":1.0309999999999999},"min":{"1min":0.625,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.294,"5min":1.659,"15min":1.708},"last":1.0669999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574962,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23380,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94348460,"statfs":{"total":96636764160,"available":96612823040,"internally_reserved":0,"allocated":1388544,"data_stored":638161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.86199999999999999,"15min":0.84299999999999997},"min":{"1min":0.51700000000000002,"5min":0.45100000000000001,"15min":0.437},"max":{"1min":1.2789999999999999,"5min":1.452,"15min":1.452},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.90100000000000002,"15min":0.87},"min":{"1min":0.72199999999999998,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1279999999999999,"5min":1.26,"15min":1.5940000000000001},"last":0.80600000000000005}]},{"osd":1,"last update":"Tue Oct 3 19:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.86799999999999999,"15min":0.84899999999999998},"min":{"1min":0.53200000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.151,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.89200000000000002,"15min":0.91700000000000004},"min":{"1min":0.65100000000000002,"5min":0.59799999999999998,"15min":0.57099999999999995},"max":{"1min":1.109,"5min":1.23,"15min":1.514},"last":0.71499999999999997}]},{"osd":2,"last update":"Tue Oct 3 19:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.89700000000000002,"15min":0.90100000000000002},"min":{"1min":0.65100000000000002,"5min":0.55400000000000005,"15min":0.55100000000000005},"max":{"1min":1.2350000000000001,"5min":1.351,"15min":1.3700000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.92900000000000005,"15min":0.90900000000000003},"min":{"1min":0.67000000000000004,"5min":0.57099999999999995,"15min":0.53300000000000003},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.68100000000000005}]},{"osd":3,"last update":"Tue Oct 3 19:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.92000000000000004,"15min":0.92600000000000005},"min":{"1min":0.63700000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.196,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.01,"15min":1.024},"min":{"1min":0.86199999999999999,"5min":0.65900000000000003,"15min":0.61199999999999999},"max":{"1min":1.2929999999999999,"5min":1.508,"15min":1.6659999999999999},"last":0.999}]},{"osd":4,"last update":"Tue Oct 3 19:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.97799999999999998,"15min":0.97399999999999998},"min":{"1min":0.69999999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1919999999999999,"5min":1.4530000000000001,"15min":1.5149999999999999},"last":1.095},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.95699999999999996,"15min":1.0069999999999999},"min":{"1min":0.70699999999999996,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.7709999999999999},"last":0.75900000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.99399999999999999,"15min":1.0189999999999999},"min":{"1min":0.75600000000000001,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.238,"5min":1.546,"15min":1.546},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.081,"15min":1.1200000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.3460000000000001,"5min":1.4159999999999999,"15min":1.823},"last":1.048}]},{"osd":7,"last update":"Tue Oct 3 19:20:39 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.05,"15min":1.0680000000000001},"min":{"1min":0.82699999999999996,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.302,"5min":1.4610000000000001,"15min":1.5680000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.101,"5min":1.1140000000000001,"15min":1.139},"min":{"1min":0.96299999999999997,"5min":0.76000000000000001,"15min":0.71799999999999997},"max":{"1min":1.3779999999999999,"5min":1.4179999999999999,"15min":1.9099999999999999},"last":0.95999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574963,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30788,"kb_used_data":1404,"kb_used_omap":0,"kb_used_meta":29376,"kb_avail":94341052,"statfs":{"total":96636764160,"available":96605237248,"internally_reserved":0,"allocated":1437696,"data_stored":1220988,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":30081024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67600000000000005,"15min":0.624},"min":{"1min":0.27300000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.0569999999999999,"5min":5.7480000000000002,"15min":5.7480000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.78400000000000003,"15min":0.747},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":1.018,"5min":6.274,"15min":6.274},"last":0.88700000000000001}]},{"osd":2,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.80000000000000004,"15min":0.749},"min":{"1min":0.40500000000000003,"5min":0.36499999999999999,"15min":0.35399999999999998},"max":{"1min":0.998,"5min":6.1609999999999996,"15min":6.1609999999999996},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.71699999999999997,"15min":0.70699999999999996},"min":{"1min":0.32300000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.7170000000000001},"last":0.54100000000000004}]},{"osd":3,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.85299999999999998,"15min":0.78900000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.36799999999999999},"max":{"1min":1.135,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.78800000000000003,"15min":0.751},"min":{"1min":0.38700000000000001,"5min":0.376,"15min":0.30299999999999999},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.84199999999999997}]},{"osd":4,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.997,"15min":0.94299999999999995},"min":{"1min":0.57499999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.345,"5min":8.1159999999999997,"15min":8.1159999999999997},"last":1.262},{"interface":"front","average":{"1min":1.028,"5min":1.0620000000000001,"15min":1.0429999999999999},"min":{"1min":0.68000000000000005,"5min":0.57299999999999995,"15min":0.504},"max":{"1min":1.4259999999999999,"5min":6.2320000000000002,"15min":6.2320000000000002},"last":1.4259999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.2270000000000001,"15min":1.113},"min":{"1min":0.77000000000000002,"5min":0.59399999999999997,"15min":0.46899999999999997},"max":{"1min":1.298,"5min":17.420000000000002,"15min":17.420000000000002},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.1950000000000001,"15min":1.0589999999999999},"min":{"1min":0.621,"5min":0.59499999999999997,"15min":0.54300000000000004},"max":{"1min":1.296,"5min":17.643000000000001,"15min":17.643000000000001},"last":1.1639999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0700000000000001,"15min":1.044},"min":{"1min":0.66600000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3540000000000001,"5min":5.7220000000000004,"15min":5.7220000000000004},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.109,"5min":1.0569999999999999,"15min":1.0249999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.534,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.349}]},{"osd":7,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.147,"15min":1.0840000000000001},"min":{"1min":0.77500000000000002,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.5740000000000001,"5min":5.7800000000000002,"15min":5.7800000000000002},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.0800000000000001,"15min":1.073},"min":{"1min":0.63700000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.6259999999999999,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.4650000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:21:41.715 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T19:21:41.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.818+0000 7f527861f640 1 Processor -- start 2023-10-03T19:21:41.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.818+0000 7f527861f640 1 -- start start 2023-10-03T19:21:41.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f527861f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f52700bf370 0x7f5270149760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:41.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f527861f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f527014c770 con 0x7f527014d310 2023-10-03T19:21:41.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f527861f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f527006efe0 con 0x7f52700a7100 2023-10-03T19:21:41.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f527861f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52700bebc0 con 0x7f52700bf370 2023-10-03T19:21:41.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f5276bbc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f527014d310 0x7f527014fbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41310/0 (socket says 172.21.15.45:41310) 2023-10-03T19:21:41.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f5276bbc640 1 -- 172.21.15.45:0/328727901 learned_addr learned my addr 172.21.15.45:0/328727901 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:21:41.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f52763bb640 1 --2- 172.21.15.45:0/328727901 >> v2:172.21.15.79:3300/0 conn(0x7f52700bf370 0x7f5270149760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:41.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f52753b9640 1 -- 172.21.15.45:0/328727901 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4145994659 0 0) 0x7f527014c770 con 0x7f527014d310 2023-10-03T19:21:41.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f52753b9640 1 -- 172.21.15.45:0/328727901 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f525c003530 con 0x7f527014d310 2023-10-03T19:21:41.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f52753b9640 1 -- 172.21.15.45:0/328727901 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3197228146 0 0) 0x7f525c003530 con 0x7f527014d310 2023-10-03T19:21:41.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f52753b9640 1 -- 172.21.15.45:0/328727901 >> v2:172.21.15.79:3300/0 conn(0x7f52700bf370 msgr2=0x7f5270149760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:41.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f52753b9640 1 --2- 172.21.15.45:0/328727901 >> v2:172.21.15.79:3300/0 conn(0x7f52700bf370 0x7f5270149760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f52753b9640 1 -- 172.21.15.45:0/328727901 >> v1:172.21.15.79:6789/0 conn(0x7f52700a7100 legacy=0x7f527014cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:41.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f52753b9640 1 -- 172.21.15.45:0/328727901 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527006f2c0 con 0x7f527014d310 2023-10-03T19:21:41.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f52753b9640 1 -- 172.21.15.45:0/328727901 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f5268001a00 con 0x7f527014d310 2023-10-03T19:21:41.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f52753b9640 1 -- 172.21.15.45:0/328727901 >> v1:172.21.15.45:6789/0 conn(0x7f527014d310 legacy=0x7f527014fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:41.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f52753b9640 1 --2- 172.21.15.45:0/328727901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f525c003980 0x7f525c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:41.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f52753b9640 1 --2- 172.21.15.45:0/328727901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f525c0047d0 0x7f525c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:41.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f52753b9640 1 --2- 172.21.15.45:0/328727901 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f525c005180 0x7f525c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:41.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f52753b9640 1 -- 172.21.15.45:0/328727901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52700bebc0 con 0x7f525c003980 2023-10-03T19:21:41.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f52753b9640 1 -- 172.21.15.45:0/328727901 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525c00c090 con 0x7f525c0047d0 2023-10-03T19:21:41.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f52753b9640 1 -- 172.21.15.45:0/328727901 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f525c00c250 con 0x7f525c005180 2023-10-03T19:21:41.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f52763bb640 1 --2- 172.21.15.45:0/328727901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f525c003980 0x7f525c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:41.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f5275bba640 1 --2- 172.21.15.45:0/328727901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f525c0047d0 0x7f525c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:41.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f5276bbc640 1 --2- 172.21.15.45:0/328727901 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f525c005180 0x7f525c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:41.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f52763bb640 1 -- 172.21.15.45:0/328727901 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f525c005180 msgr2=0x7f525c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:41.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f52763bb640 1 --2- 172.21.15.45:0/328727901 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f525c005180 0x7f525c00b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f52763bb640 1 -- 172.21.15.45:0/328727901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f525c0047d0 msgr2=0x7f525c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:41.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f52763bb640 1 --2- 172.21.15.45:0/328727901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f525c0047d0 0x7f525c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f52763bb640 1 -- 172.21.15.45:0/328727901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525c003530 con 0x7f525c003980 2023-10-03T19:21:41.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f5275bba640 1 --2- 172.21.15.45:0/328727901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f525c0047d0 0x7f525c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:21:41.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f5276bbc640 1 -- 172.21.15.45:0/328727901 reap_dead start 2023-10-03T19:21:41.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.822+0000 7f52763bb640 1 --2- 172.21.15.45:0/328727901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f525c003980 0x7f525c003d90 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f526c009ae0 tx=0x7f526c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb17aff9141b0dc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:41.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f52753b9640 1 -- 172.21.15.45:0/328727901 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c0a5640 con 0x7f525c003980 2023-10-03T19:21:41.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f52753b9640 1 -- 172.21.15.45:0/328727901 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526c0a57a0 con 0x7f525c003980 2023-10-03T19:21:41.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f52753b9640 1 -- 172.21.15.45:0/328727901 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c0a5b50 con 0x7f525c003980 2023-10-03T19:21:41.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f527861f640 1 -- 172.21.15.45:0/328727901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f525c003980 msgr2=0x7f525c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:41.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f527861f640 1 --2- 172.21.15.45:0/328727901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f525c003980 0x7f525c003d90 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f526c009ae0 tx=0x7f526c01ca50 comp rx=0 tx=0).stop 2023-10-03T19:21:41.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f527861f640 1 -- 172.21.15.45:0/328727901 shutdown_connections 2023-10-03T19:21:41.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f527861f640 1 --2- 172.21.15.45:0/328727901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f525c003980 0x7f525c003d90 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f527861f640 1 -- 172.21.15.45:0/328727901 >> 172.21.15.45:0/328727901 conn(0x7f527006bce0 msgr2=0x7f527006c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:41.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f527861f640 1 -- 172.21.15.45:0/328727901 shutdown_connections 2023-10-03T19:21:41.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f527861f640 1 -- 172.21.15.45:0/328727901 wait complete. 2023-10-03T19:21:41.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f527861f640 1 Processor -- start 2023-10-03T19:21:41.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f527861f640 1 -- start start 2023-10-03T19:21:41.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f527861f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f525c003980 0x7f5270071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:41.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f527861f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52700a3c10 0x7f52700bbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:41.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f527861f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52701501f0 0x7f527014ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:41.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f527861f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5270150690 con 0x7f52701501f0 2023-10-03T19:21:41.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f527861f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52701e8bf0 con 0x7f52700a3c10 2023-10-03T19:21:41.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f527861f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52700718c0 con 0x7f525c003980 2023-10-03T19:21:41.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f5276bbc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52701501f0 0x7f527014ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:41.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f5276bbc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52701501f0 0x7f527014ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39466/0 (socket says 172.21.15.45:39466) 2023-10-03T19:21:41.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f5276bbc640 1 -- 172.21.15.45:0/4180507285 learned_addr learned my addr 172.21.15.45:0/4180507285 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:41.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f5275bba640 1 --2- 172.21.15.45:0/4180507285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52700a3c10 0x7f52700bbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:41.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f52763bb640 1 --2- 172.21.15.45:0/4180507285 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f525c003980 0x7f5270071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:41.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f5276bbc640 1 -- 172.21.15.45:0/4180507285 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f525c003980 msgr2=0x7f5270071380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:41.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f5276bbc640 1 --2- 172.21.15.45:0/4180507285 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f525c003980 0x7f5270071380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f5276bbc640 1 -- 172.21.15.45:0/4180507285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52700a3c10 msgr2=0x7f52700bbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:41.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f5276bbc640 1 --2- 172.21.15.45:0/4180507285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52700a3c10 0x7f52700bbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f5276bbc640 1 -- 172.21.15.45:0/4180507285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527014d180 con 0x7f52701501f0 2023-10-03T19:21:41.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f52763bb640 1 --2- 172.21.15.45:0/4180507285 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f525c003980 0x7f5270071380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:21:41.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f5276bbc640 1 --2- 172.21.15.45:0/4180507285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52701501f0 0x7f527014ea80 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f5270072180 tx=0x7f526800dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:41.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f5266ffd640 1 -- 172.21.15.45:0/4180507285 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5268007070 con 0x7f52701501f0 2023-10-03T19:21:41.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f5266ffd640 1 -- 172.21.15.45:0/4180507285 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52680071d0 con 0x7f52701501f0 2023-10-03T19:21:41.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f5266ffd640 1 -- 172.21.15.45:0/4180507285 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5268007560 con 0x7f52701501f0 2023-10-03T19:21:41.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f527861f640 1 -- 172.21.15.45:0/4180507285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f527014cff0 con 0x7f52701501f0 2023-10-03T19:21:41.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f527861f640 1 -- 172.21.15.45:0/4180507285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5270149f70 con 0x7f52701501f0 2023-10-03T19:21:41.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.826+0000 7f527861f640 1 -- 172.21.15.45:0/4180507285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5270150a70 con 0x7f52701501f0 2023-10-03T19:21:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.830+0000 7f5266ffd640 1 -- 172.21.15.45:0/4180507285 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f52680076c0 con 0x7f52701501f0 2023-10-03T19:21:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.830+0000 7f5266ffd640 1 --2- 172.21.15.45:0/4180507285 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5254066280 0x7f5254068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.830+0000 7f5266ffd640 1 -- 172.21.15.45:0/4180507285 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f52680837a0 con 0x7f52701501f0 2023-10-03T19:21:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.830+0000 7f52763bb640 1 --2- 172.21.15.45:0/4180507285 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5254066280 0x7f5254068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.830+0000 7f52763bb640 1 --2- 172.21.15.45:0/4180507285 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5254066280 0x7f5254068730 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f526c0af000 tx=0x7f526c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:41.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.834+0000 7f5266ffd640 1 -- 172.21.15.45:0/4180507285 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5268050e50 con 0x7f52701501f0 2023-10-03T19:21:41.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.982+0000 7f527861f640 1 -- 172.21.15.45:0/4180507285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f527004de80 con 0x7f52701501f0 2023-10-03T19:21:41.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.982+0000 7f5266ffd640 1 -- 172.21.15.45:0/4180507285 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+14793 (secure 0 0 0) 0x7f5268054470 con 0x7f52701501f0 2023-10-03T19:21:41.988 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:21:41.989 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":113,"fsid":"58400977-12ba-4c73-bb3e-1589b2492669","created":"2023-10-03T19:12:05.789296+0000","modified":"2023-10-03T19:21:39.061791+0000","last_up_change":"2023-10-03T19:12:21.282052+0000","last_in_change":"2023-10-03T19:12:12.312314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T19:12:20.520129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T19:12:21.799120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"251cca13-96ba-4a59-826d-4ebae88f1c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6801","nonce":1057586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6803","nonce":1057586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6807","nonce":1057586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1057586985},{"type":"v1","addr":"172.21.15.45:6805","nonce":1057586985}]},"public_addr":"172.21.15.45:6801/1057586985","cluster_addr":"172.21.15.45:6803/1057586985","heartbeat_back_addr":"172.21.15.45:6807/1057586985","heartbeat_front_addr":"172.21.15.45:6805/1057586985","state":["exists","up"]},{"osd":1,"uuid":"7deff3ba-4fe0-4822-8c0e-d827ce3833a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6809","nonce":1433143371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6811","nonce":1433143371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6815","nonce":1433143371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1433143371},{"type":"v1","addr":"172.21.15.45:6813","nonce":1433143371}]},"public_addr":"172.21.15.45:6809/1433143371","cluster_addr":"172.21.15.45:6811/1433143371","heartbeat_back_addr":"172.21.15.45:6815/1433143371","heartbeat_front_addr":"172.21.15.45:6813/1433143371","state":["exists","up"]},{"osd":2,"uuid":"64b35ec1-08ee-4b28-b46a-31fb941e9675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6819","nonce":964866005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6823","nonce":964866005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6831","nonce":964866005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":964866005},{"type":"v1","addr":"172.21.15.45:6827","nonce":964866005}]},"public_addr":"172.21.15.45:6819/964866005","cluster_addr":"172.21.15.45:6823/964866005","heartbeat_back_addr":"172.21.15.45:6831/964866005","heartbeat_front_addr":"172.21.15.45:6827/964866005","state":["exists","up"]},{"osd":3,"uuid":"b885244f-5cb0-4665-8e0b-16b3736435d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6818","nonce":4227059688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6822","nonce":4227059688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6830","nonce":4227059688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":4227059688},{"type":"v1","addr":"172.21.15.45:6826","nonce":4227059688}]},"public_addr":"172.21.15.45:6818/4227059688","cluster_addr":"172.21.15.45:6822/4227059688","heartbeat_back_addr":"172.21.15.45:6830/4227059688","heartbeat_front_addr":"172.21.15.45:6826/4227059688","state":["exists","up"]},{"osd":4,"uuid":"ddc7c37f-e0a7-4090-ae54-fd4f3e56639d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6811","nonce":2234162464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6813","nonce":2234162464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6817","nonce":2234162464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2234162464},{"type":"v1","addr":"172.21.15.79:6815","nonce":2234162464}]},"public_addr":"172.21.15.79:6811/2234162464","cluster_addr":"172.21.15.79:6813/2234162464","heartbeat_back_addr":"172.21.15.79:6817/2234162464","heartbeat_front_addr":"172.21.15.79:6815/2234162464","state":["exists","up"]},{"osd":5,"uuid":"3c142493-107c-4e0d-a4a9-1e3ded1a0a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6803","nonce":2879380539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6805","nonce":2879380539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6809","nonce":2879380539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2879380539},{"type":"v1","addr":"172.21.15.79:6807","nonce":2879380539}]},"public_addr":"172.21.15.79:6803/2879380539","cluster_addr":"172.21.15.79:6805/2879380539","heartbeat_back_addr":"172.21.15.79:6809/2879380539","heartbeat_front_addr":"172.21.15.79:6807/2879380539","state":["exists","up"]},{"osd":6,"uuid":"53f89851-266d-4aeb-ac6b-69138ee8d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6819","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6820","nonce":1486010128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6824","nonce":1486010128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6831","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6833","nonce":1486010128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1486010128},{"type":"v1","addr":"172.21.15.79:6829","nonce":1486010128}]},"public_addr":"172.21.15.79:6820/1486010128","cluster_addr":"172.21.15.79:6824/1486010128","heartbeat_back_addr":"172.21.15.79:6833/1486010128","heartbeat_front_addr":"172.21.15.79:6829/1486010128","state":["exists","up"]},{"osd":7,"uuid":"844de236-0d5c-4260-8ba9-09e341aca232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6821","nonce":3323397754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6823","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6825","nonce":3323397754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6832","nonce":3323397754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6827","nonce":3323397754},{"type":"v1","addr":"172.21.15.79:6828","nonce":3323397754}]},"public_addr":"172.21.15.79:6821/3323397754","cluster_addr":"172.21.15.79:6825/3323397754","heartbeat_back_addr":"172.21.15.79:6832/3323397754","heartbeat_front_addr":"172.21.15.79:6828/3323397754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.193256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.259052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.408149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.383905+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.345363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.137261+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.338017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T19:12:18.513713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6835/1723126563":"2023-10-04T19:21:35.191821+0000","172.21.15.45:6834/1723126563":"2023-10-04T19:21:35.191821+0000","172.21.15.146:0/2294298422":"2023-10-03T20:20:34.239894+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T19:21:41.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.986+0000 7f527861f640 1 -- 172.21.15.45:0/4180507285 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5254066280 msgr2=0x7f5254068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:41.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.986+0000 7f527861f640 1 --2- 172.21.15.45:0/4180507285 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5254066280 0x7f5254068730 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f526c0af000 tx=0x7f526c008040 comp rx=0 tx=0).stop 2023-10-03T19:21:41.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.986+0000 7f527861f640 1 -- 172.21.15.45:0/4180507285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52701501f0 msgr2=0x7f527014ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:41.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.986+0000 7f527861f640 1 --2- 172.21.15.45:0/4180507285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52701501f0 0x7f527014ea80 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f5270072180 tx=0x7f526800dd70 comp rx=0 tx=0).stop 2023-10-03T19:21:41.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.986+0000 7f527861f640 1 -- 172.21.15.45:0/4180507285 shutdown_connections 2023-10-03T19:21:41.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.986+0000 7f527861f640 1 --2- 172.21.15.45:0/4180507285 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5254066280 0x7f5254068730 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.986+0000 7f527861f640 1 --2- 172.21.15.45:0/4180507285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52701501f0 0x7f527014ea80 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.986+0000 7f527861f640 1 --2- 172.21.15.45:0/4180507285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52700a3c10 0x7f52700bbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.986+0000 7f527861f640 1 --2- 172.21.15.45:0/4180507285 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f525c003980 0x7f5270071380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:41.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.986+0000 7f527861f640 1 -- 172.21.15.45:0/4180507285 >> 172.21.15.45:0/4180507285 conn(0x7f527006bce0 msgr2=0x7f527014be20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:41.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.986+0000 7f527861f640 1 -- 172.21.15.45:0/4180507285 shutdown_connections 2023-10-03T19:21:41.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:41.986+0000 7f527861f640 1 -- 172.21.15.45:0/4180507285 wait complete. 2023-10-03T19:21:43.006 INFO:tasks.ceph:Scrubbing osd.0 2023-10-03T19:21:43.007 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-03T19:21:43.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.146+0000 7f48f587b640 1 Processor -- start 2023-10-03T19:21:43.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.146+0000 7f48f587b640 1 -- start start 2023-10-03T19:21:43.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.146+0000 7f48f587b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f48f01487b0 0x7f48f0152480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.146+0000 7f48f587b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48f006a280 0x7f48f0065690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.146+0000 7f48f587b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f48f0065bd0 0x7f48f014e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.146+0000 7f48f587b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f00c09e0 con 0x7f48f0065bd0 2023-10-03T19:21:43.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.146+0000 7f48f587b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f01529c0 con 0x7f48f01487b0 2023-10-03T19:21:43.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.146+0000 7f48f587b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f006a950 con 0x7f48f006a280 2023-10-03T19:21:43.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.146+0000 7f48ef7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f48f0065bd0 0x7f48f014e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.146+0000 7f48ef7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f48f0065bd0 0x7f48f014e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39472/0 (socket says 172.21.15.45:39472) 2023-10-03T19:21:43.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.146+0000 7f48ef7fe640 1 -- 172.21.15.45:0/798602401 learned_addr learned my addr 172.21.15.45:0/798602401 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:43.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.146+0000 7f48eeffd640 1 --2- 172.21.15.45:0/798602401 >> v2:172.21.15.79:3300/0 conn(0x7f48f01487b0 0x7f48f0152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.146+0000 7f48ee7fc640 1 --2- 172.21.15.45:0/798602401 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48f006a280 0x7f48f0065690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.146+0000 7f48ef7fe640 1 -- 172.21.15.45:0/798602401 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48f006a280 msgr2=0x7f48f0065690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:43.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.146+0000 7f48ef7fe640 1 --2- 172.21.15.45:0/798602401 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48f006a280 0x7f48f0065690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.146+0000 7f48ef7fe640 1 -- 172.21.15.45:0/798602401 >> v2:172.21.15.79:3300/0 conn(0x7f48f01487b0 msgr2=0x7f48f0152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:43.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.146+0000 7f48ef7fe640 1 --2- 172.21.15.45:0/798602401 >> v2:172.21.15.79:3300/0 conn(0x7f48f01487b0 0x7f48f0152480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.146+0000 7f48ef7fe640 1 -- 172.21.15.45:0/798602401 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f006ac30 con 0x7f48f0065bd0 2023-10-03T19:21:43.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48ef7fe640 1 --2- 172.21.15.45:0/798602401 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f0065bd0 0x7f48f014e5f0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f48f006a250 tx=0x7f48e801f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3835cb7fc91d29 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:43.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48edffb640 1 -- 172.21.15.45:0/798602401 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e80af400 con 0x7f48f0065bd0 2023-10-03T19:21:43.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48edffb640 1 -- 172.21.15.45:0/798602401 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e80ab050 con 0x7f48f0065bd0 2023-10-03T19:21:43.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48edffb640 1 -- 172.21.15.45:0/798602401 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e80af780 con 0x7f48f0065bd0 2023-10-03T19:21:43.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48f587b640 1 -- 172.21.15.45:0/798602401 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f0065bd0 msgr2=0x7f48f014e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:43.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48f587b640 1 --2- 172.21.15.45:0/798602401 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f0065bd0 0x7f48f014e5f0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f48f006a250 tx=0x7f48e801f1c0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48f587b640 1 -- 172.21.15.45:0/798602401 shutdown_connections 2023-10-03T19:21:43.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48f587b640 1 --2- 172.21.15.45:0/798602401 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f0065bd0 0x7f48f014e5f0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48f587b640 1 --2- 172.21.15.45:0/798602401 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48f006a280 0x7f48f0065690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48f587b640 1 --2- 172.21.15.45:0/798602401 >> v2:172.21.15.79:3300/0 conn(0x7f48f01487b0 0x7f48f0152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48f587b640 1 -- 172.21.15.45:0/798602401 >> 172.21.15.45:0/798602401 conn(0x7f48f00c14f0 msgr2=0x7f48f00c18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:43.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48f587b640 1 -- 172.21.15.45:0/798602401 shutdown_connections 2023-10-03T19:21:43.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48f587b640 1 -- 172.21.15.45:0/798602401 wait complete. 2023-10-03T19:21:43.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48f587b640 1 Processor -- start 2023-10-03T19:21:43.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48f587b640 1 -- start start 2023-10-03T19:21:43.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48f587b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f0065bd0 0x7f48f006de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48f587b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48f006a280 0x7f48f0146c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48f587b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48f01487b0 0x7f48f0147170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48f587b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f01e0f50 con 0x7f48f0065bd0 2023-10-03T19:21:43.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48f587b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f0151850 con 0x7f48f01487b0 2023-10-03T19:21:43.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48f587b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f006e3a0 con 0x7f48f006a280 2023-10-03T19:21:43.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48eeffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f0065bd0 0x7f48f006de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48eeffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f0065bd0 0x7f48f006de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39480/0 (socket says 172.21.15.45:39480) 2023-10-03T19:21:43.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48eeffd640 1 -- 172.21.15.45:0/4203224454 learned_addr learned my addr 172.21.15.45:0/4203224454 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48ee7fc640 1 --2- 172.21.15.45:0/4203224454 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48f006a280 0x7f48f0146c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48ef7fe640 1 --2- 172.21.15.45:0/4203224454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48f01487b0 0x7f48f0147170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48eeffd640 1 -- 172.21.15.45:0/4203224454 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48f006a280 msgr2=0x7f48f0146c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48eeffd640 1 --2- 172.21.15.45:0/4203224454 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48f006a280 0x7f48f0146c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48eeffd640 1 -- 172.21.15.45:0/4203224454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48f01487b0 msgr2=0x7f48f0147170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48eeffd640 1 --2- 172.21.15.45:0/4203224454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48f01487b0 0x7f48f0147170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.150+0000 7f48eeffd640 1 -- 172.21.15.45:0/4203224454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e8009b30 con 0x7f48f0065bd0 2023-10-03T19:21:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.154+0000 7f48eeffd640 1 --2- 172.21.15.45:0/4203224454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f0065bd0 0x7f48f006de60 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f48e000d5f0 tx=0x7f48e000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:43.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.154+0000 7f48d7fff640 1 -- 172.21.15.45:0/4203224454 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e00125f0 con 0x7f48f0065bd0 2023-10-03T19:21:43.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.154+0000 7f48d7fff640 1 -- 172.21.15.45:0/4203224454 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e0012750 con 0x7f48f0065bd0 2023-10-03T19:21:43.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.154+0000 7f48f587b640 1 -- 172.21.15.45:0/4203224454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f006a000 con 0x7f48f0065bd0 2023-10-03T19:21:43.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.154+0000 7f48d7fff640 1 -- 172.21.15.45:0/4203224454 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e0012ae0 con 0x7f48f0065bd0 2023-10-03T19:21:43.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.154+0000 7f48f587b640 1 -- 172.21.15.45:0/4203224454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f006af10 con 0x7f48f0065bd0 2023-10-03T19:21:43.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.154+0000 7f48f587b640 1 -- 172.21.15.45:0/4203224454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f48f014eb30 con 0x7f48f0065bd0 2023-10-03T19:21:43.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.154+0000 7f48d7fff640 1 -- 172.21.15.45:0/4203224454 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f48e0012c40 con 0x7f48f0065bd0 2023-10-03T19:21:43.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.154+0000 7f48d7fff640 1 --2- 172.21.15.45:0/4203224454 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f48dc066280 0x7f48dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.154+0000 7f48d7fff640 1 -- 172.21.15.45:0/4203224454 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f48e0083f40 con 0x7f48f0065bd0 2023-10-03T19:21:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.154+0000 7f48d7fff640 1 --2- 172.21.15.45:0/4203224454 >> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] conn(0x7f48dc06c740 0x7f48dc06eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.154+0000 7f48d7fff640 1 -- 172.21.15.45:0/4203224454 --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f48dc06f200 con 0x7f48dc06c740 2023-10-03T19:21:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.154+0000 7f48d7fff640 1 -- 172.21.15.45:0/4203224454 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7f48e0086600 con 0x7f48f0065bd0 2023-10-03T19:21:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.154+0000 7f48ee7fc640 1 --2- 172.21.15.45:0/4203224454 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f48dc066280 0x7f48dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.154+0000 7f48ef7fe640 1 --2- 172.21.15.45:0/4203224454 >> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] conn(0x7f48dc06c740 0x7f48dc06eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.154+0000 7f48ef7fe640 1 --2- 172.21.15.45:0/4203224454 >> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] conn(0x7f48dc06c740 0x7f48dc06eb50 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.154+0000 7f48ee7fc640 1 --2- 172.21.15.45:0/4203224454 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f48dc066280 0x7f48dc068730 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f48f00a6640 tx=0x7f48e4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:43.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.154+0000 7f48d7fff640 1 -- 172.21.15.45:0/4203224454 <== osd.0 v2:172.21.15.45:6800/1057586985 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f48dc06f200 con 0x7f48dc06c740 2023-10-03T19:21:43.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.170+0000 7f48f587b640 1 -- 172.21.15.45:0/4203224454 --> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f48f004de80 con 0x7f48dc06c740 2023-10-03T19:21:43.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.170+0000 7f48d7fff640 1 -- 172.21.15.45:0/4203224454 <== osd.0 v2:172.21.15.45:6800/1057586985 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f48f004de80 con 0x7f48dc06c740 2023-10-03T19:21:43.174 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-03T19:21:43.174 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-03T19:21:43.174 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-03T19:21:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.170+0000 7f48f587b640 1 -- 172.21.15.45:0/4203224454 >> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] conn(0x7f48dc06c740 msgr2=0x7f48dc06eb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.170+0000 7f48f587b640 1 --2- 172.21.15.45:0/4203224454 >> [v2:172.21.15.45:6800/1057586985,v1:172.21.15.45:6801/1057586985] conn(0x7f48dc06c740 0x7f48dc06eb50 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.170+0000 7f48f587b640 1 -- 172.21.15.45:0/4203224454 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f48dc066280 msgr2=0x7f48dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.170+0000 7f48f587b640 1 --2- 172.21.15.45:0/4203224454 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f48dc066280 0x7f48dc068730 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f48f00a6640 tx=0x7f48e4008040 comp rx=0 tx=0).stop 2023-10-03T19:21:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.170+0000 7f48f587b640 1 -- 172.21.15.45:0/4203224454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f0065bd0 msgr2=0x7f48f006de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.170+0000 7f48f587b640 1 --2- 172.21.15.45:0/4203224454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f0065bd0 0x7f48f006de60 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f48e000d5f0 tx=0x7f48e000dab0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.170+0000 7f48ef7fe640 1 -- 172.21.15.45:0/4203224454 reap_dead start 2023-10-03T19:21:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.170+0000 7f48f587b640 1 -- 172.21.15.45:0/4203224454 shutdown_connections 2023-10-03T19:21:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.170+0000 7f48f587b640 1 -- 172.21.15.45:0/4203224454 >> 172.21.15.45:0/4203224454 conn(0x7f48f00c14f0 msgr2=0x7f48f00bce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:43.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.170+0000 7f48f587b640 1 -- 172.21.15.45:0/4203224454 shutdown_connections 2023-10-03T19:21:43.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.170+0000 7f48f587b640 1 -- 172.21.15.45:0/4203224454 wait complete. 2023-10-03T19:21:43.190 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-03T19:21:43.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.298+0000 7f5e91079640 1 Processor -- start 2023-10-03T19:21:43.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.298+0000 7f5e91079640 1 -- start start 2023-10-03T19:21:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.298+0000 7f5e91079640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5e8c06d5b0 0x7f5e8c06a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.298+0000 7f5e91079640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e8c150800 0x7f5e8c0a5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.298+0000 7f5e91079640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5e8c0bdb50 0x7f5e8c14bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.298+0000 7f5e91079640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e8c0a6870 con 0x7f5e8c06d5b0 2023-10-03T19:21:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.298+0000 7f5e91079640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e8c0a5930 con 0x7f5e8c0bdb50 2023-10-03T19:21:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.298+0000 7f5e91079640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c0a6310 con 0x7f5e8c150800 2023-10-03T19:21:43.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.298+0000 7f5e8ad9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5e8c06d5b0 0x7f5e8c06a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.298+0000 7f5e8ad9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5e8c06d5b0 0x7f5e8c06a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39482/0 (socket says 172.21.15.45:39482) 2023-10-03T19:21:43.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.298+0000 7f5e8ad9d640 1 -- 172.21.15.45:0/633259372 learned_addr learned my addr 172.21.15.45:0/633259372 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:43.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.298+0000 7f5e8a59c640 1 --2- 172.21.15.45:0/633259372 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e8c150800 0x7f5e8c0a5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.298+0000 7f5e8b59e640 1 --2- 172.21.15.45:0/633259372 >> v2:172.21.15.79:3300/0 conn(0x7f5e8c0bdb50 0x7f5e8c14bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.298+0000 7f5e8ad9d640 1 -- 172.21.15.45:0/633259372 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e8c150800 msgr2=0x7f5e8c0a5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:43.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.298+0000 7f5e8ad9d640 1 --2- 172.21.15.45:0/633259372 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e8c150800 0x7f5e8c0a5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.298+0000 7f5e8ad9d640 1 -- 172.21.15.45:0/633259372 >> v2:172.21.15.79:3300/0 conn(0x7f5e8c0bdb50 msgr2=0x7f5e8c14bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:43.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.298+0000 7f5e8ad9d640 1 --2- 172.21.15.45:0/633259372 >> v2:172.21.15.79:3300/0 conn(0x7f5e8c0bdb50 0x7f5e8c14bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.298+0000 7f5e8ad9d640 1 -- 172.21.15.45:0/633259372 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8c06dde0 con 0x7f5e8c06d5b0 2023-10-03T19:21:43.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e8ad9d640 1 --2- 172.21.15.45:0/633259372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e8c06d5b0 0x7f5e8c06a370 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c06fda0 tx=0x7f5e8401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e27e588a1fdd530 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:43.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e89d9b640 1 -- 172.21.15.45:0/633259372 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e840af400 con 0x7f5e8c06d5b0 2023-10-03T19:21:43.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e89d9b640 1 -- 172.21.15.45:0/633259372 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e840ab050 con 0x7f5e8c06d5b0 2023-10-03T19:21:43.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e89d9b640 1 -- 172.21.15.45:0/633259372 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e840af780 con 0x7f5e8c06d5b0 2023-10-03T19:21:43.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e91079640 1 -- 172.21.15.45:0/633259372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e8c06d5b0 msgr2=0x7f5e8c06a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:43.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e91079640 1 --2- 172.21.15.45:0/633259372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e8c06d5b0 0x7f5e8c06a370 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c06fda0 tx=0x7f5e8401f1c0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e91079640 1 -- 172.21.15.45:0/633259372 shutdown_connections 2023-10-03T19:21:43.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e91079640 1 --2- 172.21.15.45:0/633259372 >> v2:172.21.15.79:3300/0 conn(0x7f5e8c0bdb50 0x7f5e8c14bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e91079640 1 --2- 172.21.15.45:0/633259372 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e8c150800 0x7f5e8c0a5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e91079640 1 --2- 172.21.15.45:0/633259372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e8c06d5b0 0x7f5e8c06a370 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e91079640 1 -- 172.21.15.45:0/633259372 >> 172.21.15.45:0/633259372 conn(0x7f5e8c0c1600 msgr2=0x7f5e8c0c1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:43.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e91079640 1 -- 172.21.15.45:0/633259372 shutdown_connections 2023-10-03T19:21:43.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e91079640 1 -- 172.21.15.45:0/633259372 wait complete. 2023-10-03T19:21:43.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e91079640 1 Processor -- start 2023-10-03T19:21:43.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e91079640 1 -- start start 2023-10-03T19:21:43.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e91079640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e8c06d5b0 0x7f5e8c14ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e91079640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e8c0bdb50 0x7f5e8c13b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e91079640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e8c150800 0x7f5e8c1e1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e91079640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c146d10 con 0x7f5e8c06d5b0 2023-10-03T19:21:43.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e91079640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c0bb810 con 0x7f5e8c0bdb50 2023-10-03T19:21:43.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e91079640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c0b9520 con 0x7f5e8c150800 2023-10-03T19:21:43.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e8ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e8c06d5b0 0x7f5e8c14ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e8ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e8c06d5b0 0x7f5e8c14ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39496/0 (socket says 172.21.15.45:39496) 2023-10-03T19:21:43.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e8ad9d640 1 -- 172.21.15.45:0/1402388324 learned_addr learned my addr 172.21.15.45:0/1402388324 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:43.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e8b59e640 1 --2- 172.21.15.45:0/1402388324 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e8c150800 0x7f5e8c1e1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e8a59c640 1 --2- 172.21.15.45:0/1402388324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e8c0bdb50 0x7f5e8c13b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e8ad9d640 1 -- 172.21.15.45:0/1402388324 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e8c150800 msgr2=0x7f5e8c1e1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:43.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e8ad9d640 1 --2- 172.21.15.45:0/1402388324 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e8c150800 0x7f5e8c1e1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e8ad9d640 1 -- 172.21.15.45:0/1402388324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e8c0bdb50 msgr2=0x7f5e8c13b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:43.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e8ad9d640 1 --2- 172.21.15.45:0/1402388324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e8c0bdb50 0x7f5e8c13b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e8ad9d640 1 -- 172.21.15.45:0/1402388324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e84009b30 con 0x7f5e8c06d5b0 2023-10-03T19:21:43.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e8b59e640 1 --2- 172.21.15.45:0/1402388324 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e8c150800 0x7f5e8c1e1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:21:43.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e8ad9d640 1 --2- 172.21.15.45:0/1402388324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e8c06d5b0 0x7f5e8c14ec10 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f5e840b2040 tx=0x7f5e8401bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:43.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e837fe640 1 -- 172.21.15.45:0/1402388324 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e840afe60 con 0x7f5e8c06d5b0 2023-10-03T19:21:43.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e837fe640 1 -- 172.21.15.45:0/1402388324 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e84009510 con 0x7f5e8c06d5b0 2023-10-03T19:21:43.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.302+0000 7f5e91079640 1 -- 172.21.15.45:0/1402388324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e8c06e0c0 con 0x7f5e8c06d5b0 2023-10-03T19:21:43.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.306+0000 7f5e837fe640 1 -- 172.21.15.45:0/1402388324 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e840ba680 con 0x7f5e8c06d5b0 2023-10-03T19:21:43.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.306+0000 7f5e91079640 1 -- 172.21.15.45:0/1402388324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e8c0a55c0 con 0x7f5e8c06d5b0 2023-10-03T19:21:43.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.306+0000 7f5e91079640 1 -- 172.21.15.45:0/1402388324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e8c069ad0 con 0x7f5e8c06d5b0 2023-10-03T19:21:43.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.306+0000 7f5e837fe640 1 -- 172.21.15.45:0/1402388324 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5e840b6040 con 0x7f5e8c06d5b0 2023-10-03T19:21:43.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.306+0000 7f5e837fe640 1 --2- 172.21.15.45:0/1402388324 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5e6c066280 0x7f5e6c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.306+0000 7f5e837fe640 1 -- 172.21.15.45:0/1402388324 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f5e84122860 con 0x7f5e8c06d5b0 2023-10-03T19:21:43.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.306+0000 7f5e8a59c640 1 --2- 172.21.15.45:0/1402388324 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5e6c066280 0x7f5e6c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.306+0000 7f5e8a59c640 1 --2- 172.21.15.45:0/1402388324 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5e6c066280 0x7f5e6c068730 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c14d170 tx=0x7f5e74008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:43.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.310+0000 7f5e837fe640 1 -- 172.21.15.45:0/1402388324 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5e840f0270 con 0x7f5e8c06d5b0 2023-10-03T19:21:43.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.466+0000 7f5e91079640 1 -- 172.21.15.45:0/1402388324 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e8c146ae0 con 0x7f5e6c066280 2023-10-03T19:21:43.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.466+0000 7f5e837fe640 1 -- 172.21.15.45:0/1402388324 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5e8c146ae0 con 0x7f5e6c066280 2023-10-03T19:21:43.470 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 0 to deep-scrub 2023-10-03T19:21:43.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.466+0000 7f5e91079640 1 -- 172.21.15.45:0/1402388324 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5e6c066280 msgr2=0x7f5e6c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:43.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.466+0000 7f5e91079640 1 --2- 172.21.15.45:0/1402388324 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5e6c066280 0x7f5e6c068730 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c14d170 tx=0x7f5e74008040 comp rx=0 tx=0).stop 2023-10-03T19:21:43.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.466+0000 7f5e91079640 1 -- 172.21.15.45:0/1402388324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e8c06d5b0 msgr2=0x7f5e8c14ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:43.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.466+0000 7f5e91079640 1 --2- 172.21.15.45:0/1402388324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e8c06d5b0 0x7f5e8c14ec10 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f5e840b2040 tx=0x7f5e8401bf60 comp rx=0 tx=0).stop 2023-10-03T19:21:43.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.466+0000 7f5e91079640 1 -- 172.21.15.45:0/1402388324 shutdown_connections 2023-10-03T19:21:43.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.466+0000 7f5e91079640 1 --2- 172.21.15.45:0/1402388324 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f5e6c066280 0x7f5e6c068730 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.466+0000 7f5e91079640 1 --2- 172.21.15.45:0/1402388324 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e8c150800 0x7f5e8c1e1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.466+0000 7f5e91079640 1 --2- 172.21.15.45:0/1402388324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e8c0bdb50 0x7f5e8c13b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.466+0000 7f5e91079640 1 --2- 172.21.15.45:0/1402388324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e8c06d5b0 0x7f5e8c14ec10 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.466+0000 7f5e91079640 1 -- 172.21.15.45:0/1402388324 >> 172.21.15.45:0/1402388324 conn(0x7f5e8c0c1600 msgr2=0x7f5e8c0bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:43.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.466+0000 7f5e91079640 1 -- 172.21.15.45:0/1402388324 shutdown_connections 2023-10-03T19:21:43.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.466+0000 7f5e91079640 1 -- 172.21.15.45:0/1402388324 wait complete. 2023-10-03T19:21:43.489 INFO:tasks.ceph:Scrubbing osd.1 2023-10-03T19:21:43.489 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-03T19:21:43.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.610+0000 7fae41017640 1 Processor -- start 2023-10-03T19:21:43.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.610+0000 7fae41017640 1 -- start start 2023-10-03T19:21:43.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae41017640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae3c0712c0 0x7fae3c0bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae41017640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fae3c06d560 0x7fae3c0bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae41017640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3c06c2d0 con 0x7fae3c06c760 2023-10-03T19:21:43.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae41017640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae3c150610 con 0x7fae3c06d560 2023-10-03T19:21:43.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae41017640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c1508b0 con 0x7fae3c0712c0 2023-10-03T19:21:43.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae3b59e640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fae3c06c760 0x7fae3c0a53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41322/0 (socket says 172.21.15.45:41322) 2023-10-03T19:21:43.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae3b59e640 1 -- 172.21.15.45:0/3156866593 learned_addr learned my addr 172.21.15.45:0/3156866593 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:21:43.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae3a59c640 1 --2- 172.21.15.45:0/3156866593 >> v2:172.21.15.79:3300/0 conn(0x7fae3c06d560 0x7fae3c0bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae3ad9d640 1 --2- 172.21.15.45:0/3156866593 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae3c0712c0 0x7fae3c0bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae39d9b640 1 -- 172.21.15.45:0/3156866593 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160511219 0 0) 0x7fae3c06c2d0 con 0x7fae3c06c760 2023-10-03T19:21:43.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae39d9b640 1 -- 172.21.15.45:0/3156866593 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae28003530 con 0x7fae3c06c760 2023-10-03T19:21:43.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae39d9b640 1 -- 172.21.15.45:0/3156866593 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1537921943 0 0) 0x7fae28003530 con 0x7fae3c06c760 2023-10-03T19:21:43.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae39d9b640 1 -- 172.21.15.45:0/3156866593 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae3c0712c0 msgr2=0x7fae3c0bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:43.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae39d9b640 1 --2- 172.21.15.45:0/3156866593 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae3c0712c0 0x7fae3c0bcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae39d9b640 1 -- 172.21.15.45:0/3156866593 >> v2:172.21.15.79:3300/0 conn(0x7fae3c06d560 msgr2=0x7fae3c0bd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:43.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae39d9b640 1 --2- 172.21.15.45:0/3156866593 >> v2:172.21.15.79:3300/0 conn(0x7fae3c06d560 0x7fae3c0bd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae39d9b640 1 -- 172.21.15.45:0/3156866593 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3c06d2e0 con 0x7fae3c06c760 2023-10-03T19:21:43.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae39d9b640 1 -- 172.21.15.45:0/3156866593 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fae34001a00 con 0x7fae3c06c760 2023-10-03T19:21:43.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae3a59c640 1 --2- 172.21.15.45:0/3156866593 >> v2:172.21.15.79:3300/0 conn(0x7fae3c06d560 0x7fae3c0bd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T19:21:43.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae39d9b640 1 -- 172.21.15.45:0/3156866593 >> v1:172.21.15.45:6789/0 conn(0x7fae3c06c760 legacy=0x7fae3c0a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:43.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae39d9b640 1 --2- 172.21.15.45:0/3156866593 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae3c0712c0 0x7fae28003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae39d9b640 1 --2- 172.21.15.45:0/3156866593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae28003f00 0x7fae280047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae39d9b640 1 --2- 172.21.15.45:0/3156866593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae28004d10 0x7fae28005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae39d9b640 1 -- 172.21.15.45:0/3156866593 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c150610 con 0x7fae28004d10 2023-10-03T19:21:43.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae39d9b640 1 -- 172.21.15.45:0/3156866593 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c1508b0 con 0x7fae28003f00 2023-10-03T19:21:43.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae39d9b640 1 -- 172.21.15.45:0/3156866593 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2800b990 con 0x7fae3c0712c0 2023-10-03T19:21:43.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae3b59e640 1 --2- 172.21.15.45:0/3156866593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae28004d10 0x7fae28005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae3ad9d640 1 --2- 172.21.15.45:0/3156866593 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae3c0712c0 0x7fae28003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae3a59c640 1 --2- 172.21.15.45:0/3156866593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae28003f00 0x7fae280047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae3b59e640 1 -- 172.21.15.45:0/3156866593 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae3c0712c0 msgr2=0x7fae28003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:43.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae3b59e640 1 --2- 172.21.15.45:0/3156866593 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae3c0712c0 0x7fae28003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae3b59e640 1 -- 172.21.15.45:0/3156866593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae28003f00 msgr2=0x7fae280047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:43.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae3b59e640 1 --2- 172.21.15.45:0/3156866593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae28003f00 0x7fae280047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae3b59e640 1 -- 172.21.15.45:0/3156866593 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae28003530 con 0x7fae28004d10 2023-10-03T19:21:43.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.614+0000 7fae3a59c640 1 --2- 172.21.15.45:0/3156866593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae28003f00 0x7fae280047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:21:43.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae3b59e640 1 --2- 172.21.15.45:0/3156866593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae28004d10 0x7fae28005180 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fae3c06cbc0 tx=0x7fae3401d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3bf40163330226 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:43.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae39d9b640 1 -- 172.21.15.45:0/3156866593 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae340ad630 con 0x7fae28004d10 2023-10-03T19:21:43.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae39d9b640 1 -- 172.21.15.45:0/3156866593 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae340a8070 con 0x7fae28004d10 2023-10-03T19:21:43.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae39d9b640 1 -- 172.21.15.45:0/3156866593 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae340ad9d0 con 0x7fae28004d10 2023-10-03T19:21:43.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae41017640 1 -- 172.21.15.45:0/3156866593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae28004d10 msgr2=0x7fae28005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:43.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae41017640 1 --2- 172.21.15.45:0/3156866593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae28004d10 0x7fae28005180 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fae3c06cbc0 tx=0x7fae3401d3a0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae3b59e640 1 -- 172.21.15.45:0/3156866593 reap_dead start 2023-10-03T19:21:43.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae41017640 1 -- 172.21.15.45:0/3156866593 shutdown_connections 2023-10-03T19:21:43.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae41017640 1 -- 172.21.15.45:0/3156866593 >> 172.21.15.45:0/3156866593 conn(0x7fae3c0a20d0 msgr2=0x7fae3c0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:43.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae41017640 1 -- 172.21.15.45:0/3156866593 shutdown_connections 2023-10-03T19:21:43.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae41017640 1 -- 172.21.15.45:0/3156866593 wait complete. 2023-10-03T19:21:43.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae41017640 1 Processor -- start 2023-10-03T19:21:43.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae41017640 1 -- start start 2023-10-03T19:21:43.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae41017640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae28004d10 0x7fae3c14ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae41017640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae3c0a1cd0 0x7fae3c1457a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae41017640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae3c145ce0 0x7fae3c1e4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae41017640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c0b73b0 con 0x7fae28004d10 2023-10-03T19:21:43.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae41017640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c0b7700 con 0x7fae3c0a1cd0 2023-10-03T19:21:43.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae41017640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c146150 con 0x7fae3c145ce0 2023-10-03T19:21:43.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae3ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae28004d10 0x7fae3c14ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae3ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae28004d10 0x7fae3c14ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39512/0 (socket says 172.21.15.45:39512) 2023-10-03T19:21:43.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae3ad9d640 1 -- 172.21.15.45:0/1233618983 learned_addr learned my addr 172.21.15.45:0/1233618983 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:43.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae3b59e640 1 --2- 172.21.15.45:0/1233618983 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae3c145ce0 0x7fae3c1e4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae3a59c640 1 --2- 172.21.15.45:0/1233618983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae3c0a1cd0 0x7fae3c1457a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae3ad9d640 1 -- 172.21.15.45:0/1233618983 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae3c145ce0 msgr2=0x7fae3c1e4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:43.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae3ad9d640 1 --2- 172.21.15.45:0/1233618983 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae3c145ce0 0x7fae3c1e4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae3ad9d640 1 -- 172.21.15.45:0/1233618983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae3c0a1cd0 msgr2=0x7fae3c1457a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:43.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae3ad9d640 1 --2- 172.21.15.45:0/1233618983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae3c0a1cd0 0x7fae3c1457a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae3ad9d640 1 -- 172.21.15.45:0/1233618983 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3c071690 con 0x7fae28004d10 2023-10-03T19:21:43.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae3a59c640 1 --2- 172.21.15.45:0/1233618983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae3c0a1cd0 0x7fae3c1457a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:21:43.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae3b59e640 1 --2- 172.21.15.45:0/1233618983 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fae3c145ce0 0x7fae3c1e4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:21:43.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.618+0000 7fae3ad9d640 1 --2- 172.21.15.45:0/1233618983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae28004d10 0x7fae3c14ccb0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fae2c011640 tx=0x7fae2c011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:43.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.622+0000 7fae337fe640 1 -- 172.21.15.45:0/1233618983 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c00f920 con 0x7fae28004d10 2023-10-03T19:21:43.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.622+0000 7fae337fe640 1 -- 172.21.15.45:0/1233618983 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2c00fa80 con 0x7fae28004d10 2023-10-03T19:21:43.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.622+0000 7fae337fe640 1 -- 172.21.15.45:0/1233618983 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c00fdf0 con 0x7fae28004d10 2023-10-03T19:21:43.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.622+0000 7fae41017640 1 -- 172.21.15.45:0/1233618983 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae3c06cf40 con 0x7fae28004d10 2023-10-03T19:21:43.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.622+0000 7fae41017640 1 -- 172.21.15.45:0/1233618983 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3c071820 con 0x7fae28004d10 2023-10-03T19:21:43.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.622+0000 7fae41017640 1 -- 172.21.15.45:0/1233618983 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fae3c04de80 con 0x7fae28004d10 2023-10-03T19:21:43.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.622+0000 7fae337fe640 1 -- 172.21.15.45:0/1233618983 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fae2c015460 con 0x7fae28004d10 2023-10-03T19:21:43.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.622+0000 7fae337fe640 1 --2- 172.21.15.45:0/1233618983 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fae1c0662b0 0x7fae1c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.622+0000 7fae337fe640 1 -- 172.21.15.45:0/1233618983 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fae2c0844b0 con 0x7fae28004d10 2023-10-03T19:21:43.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.622+0000 7fae337fe640 1 --2- 172.21.15.45:0/1233618983 >> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] conn(0x7fae1c06c770 0x7fae1c06eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.622+0000 7fae337fe640 1 -- 172.21.15.45:0/1233618983 --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fae1c06f230 con 0x7fae1c06c770 2023-10-03T19:21:43.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.622+0000 7fae337fe640 1 -- 172.21.15.45:0/1233618983 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae2c084820 con 0x7fae28004d10 2023-10-03T19:21:43.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.622+0000 7fae3a59c640 1 --2- 172.21.15.45:0/1233618983 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fae1c0662b0 0x7fae1c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.622+0000 7fae3b59e640 1 --2- 172.21.15.45:0/1233618983 >> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] conn(0x7fae1c06c770 0x7fae1c06eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.622+0000 7fae3b59e640 1 --2- 172.21.15.45:0/1233618983 >> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] conn(0x7fae1c06c770 0x7fae1c06eb80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:43.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.622+0000 7fae3a59c640 1 --2- 172.21.15.45:0/1233618983 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fae1c0662b0 0x7fae1c068760 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0be570 tx=0x7fae24008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:43.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.622+0000 7fae337fe640 1 -- 172.21.15.45:0/1233618983 <== osd.1 v2:172.21.15.45:6808/1433143371 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fae1c06f230 con 0x7fae1c06c770 2023-10-03T19:21:43.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.638+0000 7fae41017640 1 -- 172.21.15.45:0/1233618983 --> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fae3c0bac90 con 0x7fae1c06c770 2023-10-03T19:21:43.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.638+0000 7fae337fe640 1 -- 172.21.15.45:0/1233618983 <== osd.1 v2:172.21.15.45:6808/1433143371 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fae3c0bac90 con 0x7fae1c06c770 2023-10-03T19:21:43.642 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-03T19:21:43.642 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-03T19:21:43.643 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-03T19:21:43.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.638+0000 7fae41017640 1 -- 172.21.15.45:0/1233618983 >> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] conn(0x7fae1c06c770 msgr2=0x7fae1c06eb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:43.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.638+0000 7fae41017640 1 --2- 172.21.15.45:0/1233618983 >> [v2:172.21.15.45:6808/1433143371,v1:172.21.15.45:6809/1433143371] conn(0x7fae1c06c770 0x7fae1c06eb80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.638+0000 7fae41017640 1 -- 172.21.15.45:0/1233618983 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fae1c0662b0 msgr2=0x7fae1c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:43.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.638+0000 7fae41017640 1 --2- 172.21.15.45:0/1233618983 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fae1c0662b0 0x7fae1c068760 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0be570 tx=0x7fae24008040 comp rx=0 tx=0).stop 2023-10-03T19:21:43.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.638+0000 7fae41017640 1 -- 172.21.15.45:0/1233618983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae28004d10 msgr2=0x7fae3c14ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:43.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.638+0000 7fae41017640 1 --2- 172.21.15.45:0/1233618983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae28004d10 0x7fae3c14ccb0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fae2c011640 tx=0x7fae2c011b00 comp rx=0 tx=0).stop 2023-10-03T19:21:43.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.638+0000 7fae3b59e640 1 -- 172.21.15.45:0/1233618983 reap_dead start 2023-10-03T19:21:43.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.638+0000 7fae41017640 1 -- 172.21.15.45:0/1233618983 shutdown_connections 2023-10-03T19:21:43.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.638+0000 7fae41017640 1 -- 172.21.15.45:0/1233618983 >> 172.21.15.45:0/1233618983 conn(0x7fae3c0a20d0 msgr2=0x7fae3c149980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:43.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.638+0000 7fae41017640 1 -- 172.21.15.45:0/1233618983 shutdown_connections 2023-10-03T19:21:43.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.638+0000 7fae41017640 1 -- 172.21.15.45:0/1233618983 wait complete. 2023-10-03T19:21:43.658 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-03T19:21:43.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.770+0000 7fbaafdbd640 1 Processor -- start 2023-10-03T19:21:43.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.770+0000 7fbaafdbd640 1 -- start start 2023-10-03T19:21:43.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.770+0000 7fbaafdbd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbaa806f170 0x7fbaa8150190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.770+0000 7fbaafdbd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbaa80bc8b0 0x7fbaa814ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.770+0000 7fbaafdbd640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa806cac0 con 0x7fbaa806d170 2023-10-03T19:21:43.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.770+0000 7fbaafdbd640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa80720d0 con 0x7fbaa806f170 2023-10-03T19:21:43.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.770+0000 7fbaafdbd640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa80a5ab0 con 0x7fbaa80bc8b0 2023-10-03T19:21:43.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.770+0000 7fbaad358640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbaa80bc8b0 0x7fbaa814ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.770+0000 7fbaad358640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbaa80bc8b0 0x7fbaa814ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.45:39244/0 (socket says 172.21.15.45:39244) 2023-10-03T19:21:43.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.770+0000 7fbaad358640 1 -- 172.21.15.45:0/290458753 learned_addr learned my addr 172.21.15.45:0/290458753 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:43.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.770+0000 7fbaadb59640 1 --2- 172.21.15.45:0/290458753 >> v2:172.21.15.79:3300/0 conn(0x7fbaa806f170 0x7fbaa8150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.774+0000 7fbaadb59640 1 -- 172.21.15.45:0/290458753 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbaa80bc8b0 msgr2=0x7fbaa814ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:43.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.774+0000 7fbaadb59640 1 --2- 172.21.15.45:0/290458753 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbaa80bc8b0 0x7fbaa814ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.774+0000 7fbaadb59640 1 -- 172.21.15.45:0/290458753 >> v1:172.21.15.79:6789/0 conn(0x7fbaa806d170 legacy=0x7fbaa814cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:43.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.774+0000 7fbaadb59640 1 -- 172.21.15.45:0/290458753 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa806cd00 con 0x7fbaa806f170 2023-10-03T19:21:43.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.774+0000 7fbaadb59640 1 --2- 172.21.15.45:0/290458753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa806f170 0x7fbaa8150190 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fba980097c0 tx=0x7fba9801ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f79d3ef30aae5b5e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:43.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.774+0000 7fbaacb57640 1 -- 172.21.15.45:0/290458753 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba980a8970 con 0x7fbaa806f170 2023-10-03T19:21:43.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.774+0000 7fbaacb57640 1 -- 172.21.15.45:0/290458753 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba980a8ad0 con 0x7fbaa806f170 2023-10-03T19:21:43.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.774+0000 7fbaacb57640 1 -- 172.21.15.45:0/290458753 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba980a8e60 con 0x7fbaa806f170 2023-10-03T19:21:43.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.774+0000 7fbaafdbd640 1 -- 172.21.15.45:0/290458753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa806f170 msgr2=0x7fbaa8150190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:43.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.774+0000 7fbaafdbd640 1 --2- 172.21.15.45:0/290458753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa806f170 0x7fbaa8150190 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fba980097c0 tx=0x7fba9801ec70 comp rx=0 tx=0).stop 2023-10-03T19:21:43.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.778+0000 7fbaafdbd640 1 -- 172.21.15.45:0/290458753 shutdown_connections 2023-10-03T19:21:43.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.778+0000 7fbaafdbd640 1 --2- 172.21.15.45:0/290458753 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbaa80bc8b0 0x7fbaa814ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.778+0000 7fbaafdbd640 1 --2- 172.21.15.45:0/290458753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa806f170 0x7fbaa8150190 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.778+0000 7fbaafdbd640 1 -- 172.21.15.45:0/290458753 >> 172.21.15.45:0/290458753 conn(0x7fbaa80bcf50 msgr2=0x7fbaa80bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:43.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.778+0000 7fbaafdbd640 1 -- 172.21.15.45:0/290458753 shutdown_connections 2023-10-03T19:21:43.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.778+0000 7fbaafdbd640 1 -- 172.21.15.45:0/290458753 wait complete. 2023-10-03T19:21:43.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.778+0000 7fbaafdbd640 1 Processor -- start 2023-10-03T19:21:43.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.778+0000 7fbaafdbd640 1 -- start start 2023-10-03T19:21:43.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.778+0000 7fbaafdbd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbaa806d170 0x7fbaa80c0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.778+0000 7fbaafdbd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa806f170 0x7fbaa8142730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.778+0000 7fbaafdbd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbaa80bc8b0 0x7fbaa81e4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.778+0000 7fbaafdbd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa80c0b60 con 0x7fbaa806d170 2023-10-03T19:21:43.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.778+0000 7fbaafdbd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa8146280 con 0x7fbaa806f170 2023-10-03T19:21:43.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.778+0000 7fbaafdbd640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa81490d0 con 0x7fbaa80bc8b0 2023-10-03T19:21:43.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.778+0000 7fbaadb59640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbaa806d170 0x7fbaa80c0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.778+0000 7fbaadb59640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbaa806d170 0x7fbaa80c0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39526/0 (socket says 172.21.15.45:39526) 2023-10-03T19:21:43.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.778+0000 7fbaadb59640 1 -- 172.21.15.45:0/4057299389 learned_addr learned my addr 172.21.15.45:0/4057299389 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:43.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.778+0000 7fbaad358640 1 --2- 172.21.15.45:0/4057299389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa806f170 0x7fbaa8142730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.778+0000 7fbaae35a640 1 --2- 172.21.15.45:0/4057299389 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbaa80bc8b0 0x7fbaa81e4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.778+0000 7fbaadb59640 1 -- 172.21.15.45:0/4057299389 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbaa80bc8b0 msgr2=0x7fbaa81e4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:43.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.778+0000 7fbaadb59640 1 --2- 172.21.15.45:0/4057299389 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbaa80bc8b0 0x7fbaa81e4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.778+0000 7fbaadb59640 1 -- 172.21.15.45:0/4057299389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa806f170 msgr2=0x7fbaa8142730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:43.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.778+0000 7fbaadb59640 1 --2- 172.21.15.45:0/4057299389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa806f170 0x7fbaa8142730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.778+0000 7fbaadb59640 1 -- 172.21.15.45:0/4057299389 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba98009420 con 0x7fbaa806d170 2023-10-03T19:21:43.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.778+0000 7fbaadb59640 1 --2- 172.21.15.45:0/4057299389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbaa806d170 0x7fbaa80c0620 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fba9801d320 tx=0x7fba9801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:43.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.778+0000 7fba9e7fc640 1 -- 172.21.15.45:0/4057299389 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba980bf070 con 0x7fbaa806d170 2023-10-03T19:21:43.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.778+0000 7fba9e7fc640 1 -- 172.21.15.45:0/4057299389 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba980b1c00 con 0x7fbaa806d170 2023-10-03T19:21:43.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.778+0000 7fbaafdbd640 1 -- 172.21.15.45:0/4057299389 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa814c4a0 con 0x7fbaa806d170 2023-10-03T19:21:43.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.778+0000 7fba9e7fc640 1 -- 172.21.15.45:0/4057299389 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba980b9410 con 0x7fbaa806d170 2023-10-03T19:21:43.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.778+0000 7fbaafdbd640 1 -- 172.21.15.45:0/4057299389 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa814fae0 con 0x7fbaa806d170 2023-10-03T19:21:43.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.782+0000 7fbaafdbd640 1 -- 172.21.15.45:0/4057299389 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa806f540 con 0x7fbaa806d170 2023-10-03T19:21:43.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.782+0000 7fba9e7fc640 1 -- 172.21.15.45:0/4057299389 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fba980b7040 con 0x7fbaa806d170 2023-10-03T19:21:43.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.782+0000 7fba9e7fc640 1 --2- 172.21.15.45:0/4057299389 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fba8c066280 0x7fba8c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:43.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.782+0000 7fba9e7fc640 1 -- 172.21.15.45:0/4057299389 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fba98121630 con 0x7fbaa806d170 2023-10-03T19:21:43.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.782+0000 7fbaad358640 1 --2- 172.21.15.45:0/4057299389 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fba8c066280 0x7fba8c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:43.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.782+0000 7fbaad358640 1 --2- 172.21.15.45:0/4057299389 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fba8c066280 0x7fba8c068730 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fbaa80c0e00 tx=0x7fbaa4009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:43.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.786+0000 7fba9e7fc640 1 -- 172.21.15.45:0/4057299389 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fba980eee60 con 0x7fbaa806d170 2023-10-03T19:21:43.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.938+0000 7fbaafdbd640 1 -- 172.21.15.45:0/4057299389 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fbaa806d660 con 0x7fba8c066280 2023-10-03T19:21:43.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.938+0000 7fba9e7fc640 1 -- 172.21.15.45:0/4057299389 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbaa806d660 con 0x7fba8c066280 2023-10-03T19:21:43.945 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 1 to deep-scrub 2023-10-03T19:21:43.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.942+0000 7fbaafdbd640 1 -- 172.21.15.45:0/4057299389 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fba8c066280 msgr2=0x7fba8c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:43.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.942+0000 7fbaafdbd640 1 --2- 172.21.15.45:0/4057299389 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fba8c066280 0x7fba8c068730 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fbaa80c0e00 tx=0x7fbaa4009240 comp rx=0 tx=0).stop 2023-10-03T19:21:43.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.942+0000 7fbaafdbd640 1 -- 172.21.15.45:0/4057299389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbaa806d170 msgr2=0x7fbaa80c0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:43.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.942+0000 7fbaafdbd640 1 --2- 172.21.15.45:0/4057299389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbaa806d170 0x7fbaa80c0620 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fba9801d320 tx=0x7fba9801ba10 comp rx=0 tx=0).stop 2023-10-03T19:21:43.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.942+0000 7fbaafdbd640 1 -- 172.21.15.45:0/4057299389 shutdown_connections 2023-10-03T19:21:43.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.942+0000 7fbaafdbd640 1 --2- 172.21.15.45:0/4057299389 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fba8c066280 0x7fba8c068730 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.942+0000 7fbaafdbd640 1 --2- 172.21.15.45:0/4057299389 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbaa80bc8b0 0x7fbaa81e4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.942+0000 7fbaafdbd640 1 --2- 172.21.15.45:0/4057299389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa806f170 0x7fbaa8142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.942+0000 7fbaafdbd640 1 --2- 172.21.15.45:0/4057299389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbaa806d170 0x7fbaa80c0620 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:43.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.942+0000 7fbaafdbd640 1 -- 172.21.15.45:0/4057299389 >> 172.21.15.45:0/4057299389 conn(0x7fbaa80bcf50 msgr2=0x7fbaa80bc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:43.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.942+0000 7fbaafdbd640 1 -- 172.21.15.45:0/4057299389 shutdown_connections 2023-10-03T19:21:43.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:43.942+0000 7fbaafdbd640 1 -- 172.21.15.45:0/4057299389 wait complete. 2023-10-03T19:21:43.962 INFO:tasks.ceph:Scrubbing osd.2 2023-10-03T19:21:43.965 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-03T19:21:44.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.086+0000 7f59354e8640 1 Processor -- start 2023-10-03T19:21:44.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.086+0000 7f59354e8640 1 -- start start 2023-10-03T19:21:44.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.086+0000 7f59354e8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5930149a90 0x7f59300bd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:44.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.086+0000 7f59354e8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f593014c2a0 0x7f593014c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:44.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.086+0000 7f59354e8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59300bb960 con 0x7f59300c1100 2023-10-03T19:21:44.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.086+0000 7f59354e8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59300c0d50 con 0x7f593014c2a0 2023-10-03T19:21:44.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.086+0000 7f59354e8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59300c0a70 con 0x7f5930149a90 2023-10-03T19:21:44.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.086+0000 7f592f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f593014c2a0 0x7f593014c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:44.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.086+0000 7f592f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f593014c2a0 0x7f593014c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39538/0 (socket says 172.21.15.45:39538) 2023-10-03T19:21:44.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.086+0000 7f592f7fe640 1 -- 172.21.15.45:0/1256407853 learned_addr learned my addr 172.21.15.45:0/1256407853 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:44.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.086+0000 7f592effd640 1 --2- 172.21.15.45:0/1256407853 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5930149a90 0x7f59300bd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:44.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.086+0000 7f592f7fe640 1 -- 172.21.15.45:0/1256407853 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5930149a90 msgr2=0x7f59300bd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:44.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.086+0000 7f592f7fe640 1 --2- 172.21.15.45:0/1256407853 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5930149a90 0x7f59300bd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.086+0000 7f592f7fe640 1 -- 172.21.15.45:0/1256407853 >> v1:172.21.15.79:6789/0 conn(0x7f59300c1100 legacy=0x7f593006aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:44.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.086+0000 7f592f7fe640 1 -- 172.21.15.45:0/1256407853 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59300c0170 con 0x7f593014c2a0 2023-10-03T19:21:44.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f592f7fe640 1 --2- 172.21.15.45:0/1256407853 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f593014c2a0 0x7f593014c740 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f5928009e50 tx=0x7f592801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed9bc6256594a75 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:44.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f592dffb640 1 -- 172.21.15.45:0/1256407853 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59280a5870 con 0x7f593014c2a0 2023-10-03T19:21:44.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f592dffb640 1 -- 172.21.15.45:0/1256407853 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59280a59d0 con 0x7f593014c2a0 2023-10-03T19:21:44.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f592dffb640 1 -- 172.21.15.45:0/1256407853 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59280a5d60 con 0x7f593014c2a0 2023-10-03T19:21:44.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f59354e8640 1 -- 172.21.15.45:0/1256407853 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f593014c2a0 msgr2=0x7f593014c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:44.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f59354e8640 1 --2- 172.21.15.45:0/1256407853 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f593014c2a0 0x7f593014c740 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f5928009e50 tx=0x7f592801c9e0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f59354e8640 1 -- 172.21.15.45:0/1256407853 shutdown_connections 2023-10-03T19:21:44.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f59354e8640 1 --2- 172.21.15.45:0/1256407853 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f593014c2a0 0x7f593014c740 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f59354e8640 1 --2- 172.21.15.45:0/1256407853 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5930149a90 0x7f59300bd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f59354e8640 1 -- 172.21.15.45:0/1256407853 >> 172.21.15.45:0/1256407853 conn(0x7f59300bdfb0 msgr2=0x7f59300be3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:44.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f59354e8640 1 -- 172.21.15.45:0/1256407853 shutdown_connections 2023-10-03T19:21:44.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f59354e8640 1 -- 172.21.15.45:0/1256407853 wait complete. 2023-10-03T19:21:44.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f59354e8640 1 Processor -- start 2023-10-03T19:21:44.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f59354e8640 1 -- start start 2023-10-03T19:21:44.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f59354e8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59300c1100 0x7f593014b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:44.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f59354e8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5930149a90 0x7f59301458f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:44.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f59354e8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f593014c2a0 0x7f59301e6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:44.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f59354e8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593014db40 con 0x7f593014c2a0 2023-10-03T19:21:44.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f59354e8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59301ea740 con 0x7f5930149a90 2023-10-03T19:21:44.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f59354e8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59301eac70 con 0x7f59300c1100 2023-10-03T19:21:44.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f592f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f593014c2a0 0x7f59301e6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:44.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f592f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f593014c2a0 0x7f59301e6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39552/0 (socket says 172.21.15.45:39552) 2023-10-03T19:21:44.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f592f7fe640 1 -- 172.21.15.45:0/135773155 learned_addr learned my addr 172.21.15.45:0/135773155 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:44.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f592effd640 1 --2- 172.21.15.45:0/135773155 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59300c1100 0x7f593014b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:44.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f592f7fe640 1 -- 172.21.15.45:0/135773155 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59300c1100 msgr2=0x7f593014b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:44.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f592f7fe640 1 --2- 172.21.15.45:0/135773155 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f59300c1100 0x7f593014b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f592f7fe640 1 -- 172.21.15.45:0/135773155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5930149a90 msgr2=0x7f59301458f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:44.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f592f7fe640 1 --2- 172.21.15.45:0/135773155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5930149a90 0x7f59301458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f592f7fe640 1 -- 172.21.15.45:0/135773155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5928009b30 con 0x7f593014c2a0 2023-10-03T19:21:44.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f592f7fe640 1 --2- 172.21.15.45:0/135773155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f593014c2a0 0x7f59301e6eb0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f59280af040 tx=0x7f5928019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:44.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f59177fe640 1 -- 172.21.15.45:0/135773155 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59280b6640 con 0x7f593014c2a0 2023-10-03T19:21:44.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f59177fe640 1 -- 172.21.15.45:0/135773155 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59280b67c0 con 0x7f593014c2a0 2023-10-03T19:21:44.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f59354e8640 1 -- 172.21.15.45:0/135773155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59301506d0 con 0x7f593014c2a0 2023-10-03T19:21:44.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f59177fe640 1 -- 172.21.15.45:0/135773155 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59280b6b70 con 0x7f593014c2a0 2023-10-03T19:21:44.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.090+0000 7f59354e8640 1 -- 172.21.15.45:0/135773155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593014cc80 con 0x7f593014c2a0 2023-10-03T19:21:44.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.094+0000 7f59354e8640 1 -- 172.21.15.45:0/135773155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5930159440 con 0x7f593014c2a0 2023-10-03T19:21:44.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.094+0000 7f59177fe640 1 -- 172.21.15.45:0/135773155 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f59280b6cd0 con 0x7f593014c2a0 2023-10-03T19:21:44.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.094+0000 7f59177fe640 1 --2- 172.21.15.45:0/135773155 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f591c0662b0 0x7f591c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:44.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.094+0000 7f59177fe640 1 -- 172.21.15.45:0/135773155 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f592811ea30 con 0x7f593014c2a0 2023-10-03T19:21:44.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.094+0000 7f59177fe640 1 --2- 172.21.15.45:0/135773155 >> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] conn(0x7f591c06c770 0x7f591c06eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:44.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.094+0000 7f59177fe640 1 -- 172.21.15.45:0/135773155 --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f591c06f230 con 0x7f591c06c770 2023-10-03T19:21:44.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.094+0000 7f59177fe640 1 -- 172.21.15.45:0/135773155 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59281232c0 con 0x7f593014c2a0 2023-10-03T19:21:44.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.094+0000 7f592e7fc640 1 --2- 172.21.15.45:0/135773155 >> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] conn(0x7f591c06c770 0x7f591c06eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:44.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.094+0000 7f592effd640 1 --2- 172.21.15.45:0/135773155 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f591c0662b0 0x7f591c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:44.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.094+0000 7f592e7fc640 1 --2- 172.21.15.45:0/135773155 >> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] conn(0x7f591c06c770 0x7f591c06eb80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:44.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.094+0000 7f592effd640 1 --2- 172.21.15.45:0/135773155 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f591c0662b0 0x7f591c068760 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f5920009a30 tx=0x7f5920008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:44.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.094+0000 7f59177fe640 1 -- 172.21.15.45:0/135773155 <== osd.2 v2:172.21.15.45:6817/964866005 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f591c06f230 con 0x7f591c06c770 2023-10-03T19:21:44.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.106+0000 7f59354e8640 1 -- 172.21.15.45:0/135773155 --> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f593014d1e0 con 0x7f591c06c770 2023-10-03T19:21:44.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.110+0000 7f59177fe640 1 -- 172.21.15.45:0/135773155 <== osd.2 v2:172.21.15.45:6817/964866005 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f593014d1e0 con 0x7f591c06c770 2023-10-03T19:21:44.113 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-03T19:21:44.114 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-03T19:21:44.114 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-03T19:21:44.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.110+0000 7f59354e8640 1 -- 172.21.15.45:0/135773155 >> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] conn(0x7f591c06c770 msgr2=0x7f591c06eb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:44.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.110+0000 7f59354e8640 1 --2- 172.21.15.45:0/135773155 >> [v2:172.21.15.45:6817/964866005,v1:172.21.15.45:6819/964866005] conn(0x7f591c06c770 0x7f591c06eb80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.110+0000 7f59354e8640 1 -- 172.21.15.45:0/135773155 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f591c0662b0 msgr2=0x7f591c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:44.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.110+0000 7f59354e8640 1 --2- 172.21.15.45:0/135773155 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f591c0662b0 0x7f591c068760 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f5920009a30 tx=0x7f5920008040 comp rx=0 tx=0).stop 2023-10-03T19:21:44.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.110+0000 7f59354e8640 1 -- 172.21.15.45:0/135773155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f593014c2a0 msgr2=0x7f59301e6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:44.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.110+0000 7f59354e8640 1 --2- 172.21.15.45:0/135773155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f593014c2a0 0x7f59301e6eb0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f59280af040 tx=0x7f5928019780 comp rx=0 tx=0).stop 2023-10-03T19:21:44.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.110+0000 7f592f7fe640 1 -- 172.21.15.45:0/135773155 reap_dead start 2023-10-03T19:21:44.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.110+0000 7f59354e8640 1 -- 172.21.15.45:0/135773155 shutdown_connections 2023-10-03T19:21:44.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.110+0000 7f59354e8640 1 -- 172.21.15.45:0/135773155 >> 172.21.15.45:0/135773155 conn(0x7f59300bdfb0 msgr2=0x7f5930069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:44.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.110+0000 7f59354e8640 1 -- 172.21.15.45:0/135773155 shutdown_connections 2023-10-03T19:21:44.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.110+0000 7f59354e8640 1 -- 172.21.15.45:0/135773155 wait complete. 2023-10-03T19:21:44.129 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-03T19:21:44.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.234+0000 7f8e4088a640 1 Processor -- start 2023-10-03T19:21:44.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.234+0000 7f8e4088a640 1 -- start start 2023-10-03T19:21:44.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.234+0000 7f8e4088a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8e3c0b98f0 0x7f8e3c0b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:44.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.234+0000 7f8e4088a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8e3c0bc810 0x7f8e3c06c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:44.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.234+0000 7f8e4088a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e3c0ba550 con 0x7f8e3c0a2e20 2023-10-03T19:21:44.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.234+0000 7f8e4088a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e3c1526d0 con 0x7f8e3c0bc810 2023-10-03T19:21:44.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.234+0000 7f8e4088a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e3c1529b0 con 0x7f8e3c0b98f0 2023-10-03T19:21:44.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.234+0000 7f8e33fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8e3c0bc810 0x7f8e3c06c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:44.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.234+0000 7f8e33fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8e3c0bc810 0x7f8e3c06c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39568/0 (socket says 172.21.15.45:39568) 2023-10-03T19:21:44.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.234+0000 7f8e33fff640 1 -- 172.21.15.45:0/240217073 learned_addr learned my addr 172.21.15.45:0/240217073 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:44.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.234+0000 7f8e3a59c640 1 --2- 172.21.15.45:0/240217073 >> v2:172.21.15.79:3300/0 conn(0x7f8e3c0b98f0 0x7f8e3c0b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:44.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.234+0000 7f8e33fff640 1 -- 172.21.15.45:0/240217073 >> v2:172.21.15.79:3300/0 conn(0x7f8e3c0b98f0 msgr2=0x7f8e3c0b9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:44.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.234+0000 7f8e33fff640 1 --2- 172.21.15.45:0/240217073 >> v2:172.21.15.79:3300/0 conn(0x7f8e3c0b98f0 0x7f8e3c0b9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.234+0000 7f8e33fff640 1 -- 172.21.15.45:0/240217073 >> v1:172.21.15.79:6789/0 conn(0x7f8e3c0a2e20 legacy=0x7f8e3c06c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:44.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.234+0000 7f8e33fff640 1 -- 172.21.15.45:0/240217073 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c06cee0 con 0x7f8e3c0bc810 2023-10-03T19:21:44.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.234+0000 7f8e3a59c640 1 --2- 172.21.15.45:0/240217073 >> v2:172.21.15.79:3300/0 conn(0x7f8e3c0b98f0 0x7f8e3c0b9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:21:44.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.238+0000 7f8e33fff640 1 --2- 172.21.15.45:0/240217073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e3c0bc810 0x7f8e3c06c290 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c0bad20 tx=0x7f8e2401ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7074d5494aebff58 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:44.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.238+0000 7f8e39d9b640 1 -- 172.21.15.45:0/240217073 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e240a89b0 con 0x7f8e3c0bc810 2023-10-03T19:21:44.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.238+0000 7f8e39d9b640 1 -- 172.21.15.45:0/240217073 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e240a8b10 con 0x7f8e3c0bc810 2023-10-03T19:21:44.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.238+0000 7f8e39d9b640 1 -- 172.21.15.45:0/240217073 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e240a8ea0 con 0x7f8e3c0bc810 2023-10-03T19:21:44.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.238+0000 7f8e4088a640 1 -- 172.21.15.45:0/240217073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e3c0bc810 msgr2=0x7f8e3c06c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:44.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.238+0000 7f8e4088a640 1 --2- 172.21.15.45:0/240217073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e3c0bc810 0x7f8e3c06c290 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c0bad20 tx=0x7f8e2401ecb0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.238+0000 7f8e4088a640 1 -- 172.21.15.45:0/240217073 shutdown_connections 2023-10-03T19:21:44.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.238+0000 7f8e4088a640 1 --2- 172.21.15.45:0/240217073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e3c0bc810 0x7f8e3c06c290 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.238+0000 7f8e4088a640 1 --2- 172.21.15.45:0/240217073 >> v2:172.21.15.79:3300/0 conn(0x7f8e3c0b98f0 0x7f8e3c0b9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.238+0000 7f8e4088a640 1 -- 172.21.15.45:0/240217073 >> 172.21.15.45:0/240217073 conn(0x7f8e3c0bcf50 msgr2=0x7f8e3c0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:44.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.238+0000 7f8e4088a640 1 -- 172.21.15.45:0/240217073 shutdown_connections 2023-10-03T19:21:44.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.238+0000 7f8e4088a640 1 -- 172.21.15.45:0/240217073 wait complete. 2023-10-03T19:21:44.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.238+0000 7f8e4088a640 1 Processor -- start 2023-10-03T19:21:44.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.238+0000 7f8e4088a640 1 -- start start 2023-10-03T19:21:44.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.238+0000 7f8e4088a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e3c0a2e20 0x7f8e3c14aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:44.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.238+0000 7f8e4088a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e3c0b98f0 0x7f8e3c0be040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:44.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.238+0000 7f8e4088a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e3c0bc810 0x7f8e3c0be580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:44.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.238+0000 7f8e4088a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c0c0160 con 0x7f8e3c0b98f0 2023-10-03T19:21:44.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.238+0000 7f8e4088a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c14af70 con 0x7f8e3c0bc810 2023-10-03T19:21:44.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.238+0000 7f8e4088a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c1513f0 con 0x7f8e3c0a2e20 2023-10-03T19:21:44.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.238+0000 7f8e33fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e3c0b98f0 0x7f8e3c0be040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:44.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.238+0000 7f8e33fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e3c0b98f0 0x7f8e3c0be040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39576/0 (socket says 172.21.15.45:39576) 2023-10-03T19:21:44.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.238+0000 7f8e33fff640 1 -- 172.21.15.45:0/659880674 learned_addr learned my addr 172.21.15.45:0/659880674 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:44.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.242+0000 7f8e33fff640 1 -- 172.21.15.45:0/659880674 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e3c0a2e20 msgr2=0x7f8e3c14aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:44.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.242+0000 7f8e33fff640 1 --2- 172.21.15.45:0/659880674 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e3c0a2e20 0x7f8e3c14aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.242+0000 7f8e33fff640 1 -- 172.21.15.45:0/659880674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e3c0bc810 msgr2=0x7f8e3c0be580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:44.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.242+0000 7f8e33fff640 1 --2- 172.21.15.45:0/659880674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e3c0bc810 0x7f8e3c0be580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.242+0000 7f8e33fff640 1 -- 172.21.15.45:0/659880674 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e240094d0 con 0x7f8e3c0b98f0 2023-10-03T19:21:44.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.242+0000 7f8e33fff640 1 --2- 172.21.15.45:0/659880674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e3c0b98f0 0x7f8e3c0be040 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f8e2401c8e0 tx=0x7f8e2401ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:44.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.242+0000 7f8e32ffd640 1 -- 172.21.15.45:0/659880674 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e240ba600 con 0x7f8e3c0b98f0 2023-10-03T19:21:44.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.242+0000 7f8e32ffd640 1 -- 172.21.15.45:0/659880674 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e240ba780 con 0x7f8e3c0b98f0 2023-10-03T19:21:44.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.242+0000 7f8e4088a640 1 -- 172.21.15.45:0/659880674 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e3c0ba950 con 0x7f8e3c0b98f0 2023-10-03T19:21:44.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.242+0000 7f8e32ffd640 1 -- 172.21.15.45:0/659880674 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e240bab30 con 0x7f8e3c0b98f0 2023-10-03T19:21:44.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.242+0000 7f8e4088a640 1 -- 172.21.15.45:0/659880674 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e3c0ba200 con 0x7f8e3c0b98f0 2023-10-03T19:21:44.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.242+0000 7f8e4088a640 1 -- 172.21.15.45:0/659880674 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e3c0baae0 con 0x7f8e3c0b98f0 2023-10-03T19:21:44.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.242+0000 7f8e32ffd640 1 -- 172.21.15.45:0/659880674 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8e240bac90 con 0x7f8e3c0b98f0 2023-10-03T19:21:44.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.242+0000 7f8e32ffd640 1 --2- 172.21.15.45:0/659880674 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8e20066280 0x7f8e20068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:44.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.242+0000 7f8e32ffd640 1 -- 172.21.15.45:0/659880674 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f8e241221d0 con 0x7f8e3c0b98f0 2023-10-03T19:21:44.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.242+0000 7f8e3a59c640 1 --2- 172.21.15.45:0/659880674 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8e20066280 0x7f8e20068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:44.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.242+0000 7f8e3a59c640 1 --2- 172.21.15.45:0/659880674 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8e20066280 0x7f8e20068730 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00a8d0 tx=0x7f8e2c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:44.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.246+0000 7f8e32ffd640 1 -- 172.21.15.45:0/659880674 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8e240ef880 con 0x7f8e3c0b98f0 2023-10-03T19:21:44.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.398+0000 7f8e4088a640 1 -- 172.21.15.45:0/659880674 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e3c0baae0 con 0x7f8e20066280 2023-10-03T19:21:44.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.402+0000 7f8e32ffd640 1 -- 172.21.15.45:0/659880674 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8e3c0baae0 con 0x7f8e20066280 2023-10-03T19:21:44.405 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 2 to deep-scrub 2023-10-03T19:21:44.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.402+0000 7f8e4088a640 1 -- 172.21.15.45:0/659880674 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8e20066280 msgr2=0x7f8e20068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:44.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.402+0000 7f8e4088a640 1 --2- 172.21.15.45:0/659880674 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8e20066280 0x7f8e20068730 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00a8d0 tx=0x7f8e2c008040 comp rx=0 tx=0).stop 2023-10-03T19:21:44.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.402+0000 7f8e4088a640 1 -- 172.21.15.45:0/659880674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e3c0b98f0 msgr2=0x7f8e3c0be040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:44.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.402+0000 7f8e4088a640 1 --2- 172.21.15.45:0/659880674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e3c0b98f0 0x7f8e3c0be040 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f8e2401c8e0 tx=0x7f8e2401ba50 comp rx=0 tx=0).stop 2023-10-03T19:21:44.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.402+0000 7f8e4088a640 1 -- 172.21.15.45:0/659880674 shutdown_connections 2023-10-03T19:21:44.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.402+0000 7f8e4088a640 1 --2- 172.21.15.45:0/659880674 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8e20066280 0x7f8e20068730 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.402+0000 7f8e4088a640 1 --2- 172.21.15.45:0/659880674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e3c0bc810 0x7f8e3c0be580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.402+0000 7f8e4088a640 1 --2- 172.21.15.45:0/659880674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e3c0b98f0 0x7f8e3c0be040 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.402+0000 7f8e4088a640 1 --2- 172.21.15.45:0/659880674 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e3c0a2e20 0x7f8e3c14aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.402+0000 7f8e4088a640 1 -- 172.21.15.45:0/659880674 >> 172.21.15.45:0/659880674 conn(0x7f8e3c0bcf50 msgr2=0x7f8e3c0c03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:44.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.402+0000 7f8e4088a640 1 -- 172.21.15.45:0/659880674 shutdown_connections 2023-10-03T19:21:44.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.402+0000 7f8e4088a640 1 -- 172.21.15.45:0/659880674 wait complete. 2023-10-03T19:21:44.424 INFO:tasks.ceph:Scrubbing osd.3 2023-10-03T19:21:44.424 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-03T19:21:44.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.554+0000 7fb34afe8640 1 Processor -- start 2023-10-03T19:21:44.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.554+0000 7fb34afe8640 1 -- start start 2023-10-03T19:21:44.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.554+0000 7fb34afe8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb34414c270 0x7fb3440c0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:44.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.554+0000 7fb34afe8640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb3440c0940 0x7fb34414fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:44.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.554+0000 7fb34afe8640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3440bc280 con 0x7fb3440658f0 2023-10-03T19:21:44.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.554+0000 7fb34afe8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3440bd0a0 con 0x7fb34414c270 2023-10-03T19:21:44.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.554+0000 7fb34afe8640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3440bf4f0 con 0x7fb3440c0940 2023-10-03T19:21:44.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.554+0000 7fb343fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb34414c270 0x7fb3440c0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:44.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.554+0000 7fb343fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb34414c270 0x7fb3440c0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39584/0 (socket says 172.21.15.45:39584) 2023-10-03T19:21:44.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.554+0000 7fb343fff640 1 -- 172.21.15.45:0/2017021849 learned_addr learned my addr 172.21.15.45:0/2017021849 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:44.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.554+0000 7fb349585640 1 --2- 172.21.15.45:0/2017021849 >> v2:172.21.15.79:3300/0 conn(0x7fb3440c0940 0x7fb34414fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:44.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.554+0000 7fb343fff640 1 -- 172.21.15.45:0/2017021849 >> v2:172.21.15.79:3300/0 conn(0x7fb3440c0940 msgr2=0x7fb34414fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:44.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.554+0000 7fb343fff640 1 --2- 172.21.15.45:0/2017021849 >> v2:172.21.15.79:3300/0 conn(0x7fb3440c0940 0x7fb34414fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.554+0000 7fb343fff640 1 -- 172.21.15.45:0/2017021849 >> v1:172.21.15.79:6789/0 conn(0x7fb3440658f0 legacy=0x7fb34414bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:44.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.554+0000 7fb343fff640 1 -- 172.21.15.45:0/2017021849 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3440bfaa0 con 0x7fb34414c270 2023-10-03T19:21:44.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.558+0000 7fb343fff640 1 --2- 172.21.15.45:0/2017021849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb34414c270 0x7fb3440c0f90 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fb34406b1f0 tx=0x7fb32c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6228f00d56bf1e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:44.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.558+0000 7fb3437fe640 1 -- 172.21.15.45:0/2017021849 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3441508a0 con 0x7fb34414c270 2023-10-03T19:21:44.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.558+0000 7fb3437fe640 1 -- 172.21.15.45:0/2017021849 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32c0aa5f0 con 0x7fb34414c270 2023-10-03T19:21:44.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.558+0000 7fb3437fe640 1 -- 172.21.15.45:0/2017021849 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c0aa980 con 0x7fb34414c270 2023-10-03T19:21:44.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.558+0000 7fb34afe8640 1 -- 172.21.15.45:0/2017021849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb34414c270 msgr2=0x7fb3440c0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:44.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.558+0000 7fb34afe8640 1 --2- 172.21.15.45:0/2017021849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb34414c270 0x7fb3440c0f90 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fb34406b1f0 tx=0x7fb32c01c490 comp rx=0 tx=0).stop 2023-10-03T19:21:44.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.558+0000 7fb34afe8640 1 -- 172.21.15.45:0/2017021849 shutdown_connections 2023-10-03T19:21:44.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.558+0000 7fb34afe8640 1 --2- 172.21.15.45:0/2017021849 >> v2:172.21.15.79:3300/0 conn(0x7fb3440c0940 0x7fb34414fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.558+0000 7fb34afe8640 1 --2- 172.21.15.45:0/2017021849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb34414c270 0x7fb3440c0f90 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.558+0000 7fb34afe8640 1 -- 172.21.15.45:0/2017021849 >> 172.21.15.45:0/2017021849 conn(0x7fb3440c14f0 msgr2=0x7fb3440c18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:44.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.558+0000 7fb34afe8640 1 -- 172.21.15.45:0/2017021849 shutdown_connections 2023-10-03T19:21:44.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.558+0000 7fb34afe8640 1 -- 172.21.15.45:0/2017021849 wait complete. 2023-10-03T19:21:44.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.562+0000 7fb34afe8640 1 Processor -- start 2023-10-03T19:21:44.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.562+0000 7fb34afe8640 1 -- start start 2023-10-03T19:21:44.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.562+0000 7fb34afe8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3440658f0 0x7fb344145b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:44.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.562+0000 7fb34afe8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3440c0940 0x7fb34406de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:44.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.562+0000 7fb34afe8640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb344142bf0 0x7fb344143070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:44.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.562+0000 7fb34afe8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3441e83b0 con 0x7fb3440c0940 2023-10-03T19:21:44.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.562+0000 7fb34afe8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34406e350 con 0x7fb3440658f0 2023-10-03T19:21:44.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.562+0000 7fb34afe8640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3440a2970 con 0x7fb344142bf0 2023-10-03T19:21:44.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.562+0000 7fb343fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3440c0940 0x7fb34406de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:44.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.562+0000 7fb343fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3440c0940 0x7fb34406de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39598/0 (socket says 172.21.15.45:39598) 2023-10-03T19:21:44.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.562+0000 7fb343fff640 1 -- 172.21.15.45:0/4217750584 learned_addr learned my addr 172.21.15.45:0/4217750584 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:44.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.562+0000 7fb349585640 1 --2- 172.21.15.45:0/4217750584 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb344142bf0 0x7fb344143070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:44.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.562+0000 7fb343fff640 1 -- 172.21.15.45:0/4217750584 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb344142bf0 msgr2=0x7fb344143070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:44.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.562+0000 7fb348d84640 1 --2- 172.21.15.45:0/4217750584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3440658f0 0x7fb344145b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:44.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.562+0000 7fb343fff640 1 --2- 172.21.15.45:0/4217750584 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb344142bf0 0x7fb344143070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.562+0000 7fb343fff640 1 -- 172.21.15.45:0/4217750584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3440658f0 msgr2=0x7fb344145b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:44.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.562+0000 7fb343fff640 1 --2- 172.21.15.45:0/4217750584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3440658f0 0x7fb344145b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.562+0000 7fb343fff640 1 -- 172.21.15.45:0/4217750584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32c0094d0 con 0x7fb3440c0940 2023-10-03T19:21:44.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.562+0000 7fb343fff640 1 --2- 172.21.15.45:0/4217750584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3440c0940 0x7fb34406de10 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fb32c0ac040 tx=0x7fb32c01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:44.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.562+0000 7fb3417fa640 1 -- 172.21.15.45:0/4217750584 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c0b3600 con 0x7fb3440c0940 2023-10-03T19:21:44.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.562+0000 7fb3417fa640 1 -- 172.21.15.45:0/4217750584 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32c0b3760 con 0x7fb3440c0940 2023-10-03T19:21:44.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.562+0000 7fb34afe8640 1 -- 172.21.15.45:0/4217750584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb344065e50 con 0x7fb3440c0940 2023-10-03T19:21:44.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.562+0000 7fb3417fa640 1 -- 172.21.15.45:0/4217750584 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c0b3af0 con 0x7fb3440c0940 2023-10-03T19:21:44.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.562+0000 7fb34afe8640 1 -- 172.21.15.45:0/4217750584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb344065cc0 con 0x7fb3440c0940 2023-10-03T19:21:44.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.562+0000 7fb34afe8640 1 -- 172.21.15.45:0/4217750584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb3441e8210 con 0x7fb3440c0940 2023-10-03T19:21:44.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.566+0000 7fb3417fa640 1 -- 172.21.15.45:0/4217750584 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb32c0b3c50 con 0x7fb3440c0940 2023-10-03T19:21:44.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.566+0000 7fb3417fa640 1 --2- 172.21.15.45:0/4217750584 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb324066280 0x7fb324068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:44.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.566+0000 7fb3417fa640 1 -- 172.21.15.45:0/4217750584 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fb32c0a7070 con 0x7fb3440c0940 2023-10-03T19:21:44.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.566+0000 7fb3417fa640 1 --2- 172.21.15.45:0/4217750584 >> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] conn(0x7fb32406c740 0x7fb32406eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:44.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.566+0000 7fb3417fa640 1 -- 172.21.15.45:0/4217750584 --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb32406f200 con 0x7fb32406c740 2023-10-03T19:21:44.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.566+0000 7fb3417fa640 1 -- 172.21.15.45:0/4217750584 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb32c11e700 con 0x7fb3440c0940 2023-10-03T19:21:44.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.566+0000 7fb349585640 1 --2- 172.21.15.45:0/4217750584 >> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] conn(0x7fb32406c740 0x7fb32406eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:44.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.566+0000 7fb348d84640 1 --2- 172.21.15.45:0/4217750584 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb324066280 0x7fb324068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:44.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.566+0000 7fb349585640 1 --2- 172.21.15.45:0/4217750584 >> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] conn(0x7fb32406c740 0x7fb32406eb50 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:44.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.566+0000 7fb348d84640 1 --2- 172.21.15.45:0/4217750584 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb324066280 0x7fb324068730 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fb33c007bf0 tx=0x7fb33c007240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:44.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.566+0000 7fb3417fa640 1 -- 172.21.15.45:0/4217750584 <== osd.3 v2:172.21.15.45:6816/4227059688 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb32406f200 con 0x7fb32406c740 2023-10-03T19:21:44.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.578+0000 7fb34afe8640 1 -- 172.21.15.45:0/4217750584 --> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb344158e90 con 0x7fb32406c740 2023-10-03T19:21:44.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.578+0000 7fb3417fa640 1 -- 172.21.15.45:0/4217750584 <== osd.3 v2:172.21.15.45:6816/4227059688 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb344158e90 con 0x7fb32406c740 2023-10-03T19:21:44.584 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-03T19:21:44.585 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-03T19:21:44.585 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-03T19:21:44.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.578+0000 7fb34afe8640 1 -- 172.21.15.45:0/4217750584 >> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] conn(0x7fb32406c740 msgr2=0x7fb32406eb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:44.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.578+0000 7fb34afe8640 1 --2- 172.21.15.45:0/4217750584 >> [v2:172.21.15.45:6816/4227059688,v1:172.21.15.45:6818/4227059688] conn(0x7fb32406c740 0x7fb32406eb50 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.578+0000 7fb34afe8640 1 -- 172.21.15.45:0/4217750584 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb324066280 msgr2=0x7fb324068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:44.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.578+0000 7fb34afe8640 1 --2- 172.21.15.45:0/4217750584 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb324066280 0x7fb324068730 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fb33c007bf0 tx=0x7fb33c007240 comp rx=0 tx=0).stop 2023-10-03T19:21:44.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.578+0000 7fb34afe8640 1 -- 172.21.15.45:0/4217750584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3440c0940 msgr2=0x7fb34406de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:44.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.578+0000 7fb34afe8640 1 --2- 172.21.15.45:0/4217750584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3440c0940 0x7fb34406de10 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fb32c0ac040 tx=0x7fb32c01acd0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.578+0000 7fb349585640 1 -- 172.21.15.45:0/4217750584 reap_dead start 2023-10-03T19:21:44.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.578+0000 7fb34afe8640 1 -- 172.21.15.45:0/4217750584 shutdown_connections 2023-10-03T19:21:44.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.578+0000 7fb34afe8640 1 -- 172.21.15.45:0/4217750584 >> 172.21.15.45:0/4217750584 conn(0x7fb3440c14f0 msgr2=0x7fb344069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:44.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.578+0000 7fb34afe8640 1 -- 172.21.15.45:0/4217750584 shutdown_connections 2023-10-03T19:21:44.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.578+0000 7fb34afe8640 1 -- 172.21.15.45:0/4217750584 wait complete. 2023-10-03T19:21:44.601 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-03T19:21:44.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b8bb66640 1 Processor -- start 2023-10-03T19:21:44.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b8bb66640 1 -- start start 2023-10-03T19:21:44.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b8bb66640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b840bd000 0x7f7b840bf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:44.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b8bb66640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b8406e660 con 0x7f7b840bf5d0 2023-10-03T19:21:44.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b8bb66640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b840a4c20 con 0x7f7b8414ba80 2023-10-03T19:21:44.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b8bb66640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b840a4f70 con 0x7f7b840bd000 2023-10-03T19:21:44.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b8a103640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7b840bf5d0 0x7f7b84158eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44504/0 (socket says 172.21.15.45:44504) 2023-10-03T19:21:44.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b8a103640 1 -- 172.21.15.45:0/2299979749 learned_addr learned my addr 172.21.15.45:0/2299979749 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:21:44.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b89101640 1 --2- 172.21.15.45:0/2299979749 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b840bd000 0x7f7b840bf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:44.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b88900640 1 -- 172.21.15.45:0/2299979749 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2373052991 0 0) 0x7f7b8406e660 con 0x7f7b840bf5d0 2023-10-03T19:21:44.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b88900640 1 -- 172.21.15.45:0/2299979749 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b70003530 con 0x7f7b840bf5d0 2023-10-03T19:21:44.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b88900640 1 -- 172.21.15.45:0/2299979749 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3809869522 0 0) 0x7f7b70003530 con 0x7f7b840bf5d0 2023-10-03T19:21:44.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b88900640 1 -- 172.21.15.45:0/2299979749 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b840bd000 msgr2=0x7f7b840bf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:44.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b88900640 1 --2- 172.21.15.45:0/2299979749 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b840bd000 0x7f7b840bf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b88900640 1 -- 172.21.15.45:0/2299979749 >> v1:172.21.15.79:6789/0 conn(0x7f7b8414ba80 legacy=0x7f7b840be850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:44.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b88900640 1 -- 172.21.15.45:0/2299979749 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8406ec10 con 0x7f7b840bf5d0 2023-10-03T19:21:44.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b88900640 1 -- 172.21.15.45:0/2299979749 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f7b7c001a00 con 0x7f7b840bf5d0 2023-10-03T19:21:44.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b88900640 1 -- 172.21.15.45:0/2299979749 >> v1:172.21.15.45:6789/0 conn(0x7f7b840bf5d0 legacy=0x7f7b84158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:44.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b88900640 1 --2- 172.21.15.45:0/2299979749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b700039b0 0x7f7b70003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b88900640 1 --2- 172.21.15.45:0/2299979749 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b840bd000 0x7f7b700047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b88900640 1 --2- 172.21.15.45:0/2299979749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b70004d10 0x7f7b70005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b88900640 1 -- 172.21.15.45:0/2299979749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b840a4f70 con 0x7f7b700039b0 2023-10-03T19:21:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b88900640 1 -- 172.21.15.45:0/2299979749 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7000ba40 con 0x7f7b70004d10 2023-10-03T19:21:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b88900640 1 -- 172.21.15.45:0/2299979749 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7000bbd0 con 0x7f7b840bd000 2023-10-03T19:21:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b89902640 1 --2- 172.21.15.45:0/2299979749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b700039b0 0x7f7b70003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b89101640 1 --2- 172.21.15.45:0/2299979749 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b840bd000 0x7f7b700047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:44.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b8a103640 1 --2- 172.21.15.45:0/2299979749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b70004d10 0x7f7b70005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:44.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b89902640 1 -- 172.21.15.45:0/2299979749 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b840bd000 msgr2=0x7f7b700047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:44.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b89902640 1 --2- 172.21.15.45:0/2299979749 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b840bd000 0x7f7b700047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b89902640 1 -- 172.21.15.45:0/2299979749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b70004d10 msgr2=0x7f7b70005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:44.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b89902640 1 --2- 172.21.15.45:0/2299979749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b70004d10 0x7f7b70005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.718+0000 7f7b89902640 1 -- 172.21.15.45:0/2299979749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b70003530 con 0x7f7b700039b0 2023-10-03T19:21:44.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.722+0000 7f7b89902640 1 --2- 172.21.15.45:0/2299979749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b700039b0 0x7f7b70003dc0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f7b80001780 tx=0x7f7b8001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f375f637c0a9bb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:44.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.722+0000 7f7b88900640 1 -- 172.21.15.45:0/2299979749 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b800052d0 con 0x7f7b700039b0 2023-10-03T19:21:44.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.722+0000 7f7b88900640 1 -- 172.21.15.45:0/2299979749 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b800a7050 con 0x7f7b700039b0 2023-10-03T19:21:44.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.722+0000 7f7b88900640 1 -- 172.21.15.45:0/2299979749 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b80003600 con 0x7f7b700039b0 2023-10-03T19:21:44.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.722+0000 7f7b8bb66640 1 -- 172.21.15.45:0/2299979749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b700039b0 msgr2=0x7f7b70003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:44.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.722+0000 7f7b8bb66640 1 --2- 172.21.15.45:0/2299979749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b700039b0 0x7f7b70003dc0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f7b80001780 tx=0x7f7b8001c3a0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.722+0000 7f7b8a103640 1 -- 172.21.15.45:0/2299979749 reap_dead start 2023-10-03T19:21:44.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.722+0000 7f7b8bb66640 1 -- 172.21.15.45:0/2299979749 shutdown_connections 2023-10-03T19:21:44.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.722+0000 7f7b8bb66640 1 -- 172.21.15.45:0/2299979749 >> 172.21.15.45:0/2299979749 conn(0x7f7b8406d990 msgr2=0x7f7b8406bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:44.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.722+0000 7f7b8bb66640 1 -- 172.21.15.45:0/2299979749 shutdown_connections 2023-10-03T19:21:44.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.722+0000 7f7b8bb66640 1 -- 172.21.15.45:0/2299979749 wait complete. 2023-10-03T19:21:44.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.726+0000 7f7b8bb66640 1 Processor -- start 2023-10-03T19:21:44.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.726+0000 7f7b8bb66640 1 -- start start 2023-10-03T19:21:44.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.726+0000 7f7b8bb66640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b700039b0 0x7f7b84154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:44.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.726+0000 7f7b8bb66640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b841494b0 0x7f7b841498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:44.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.726+0000 7f7b8bb66640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b8414a6d0 0x7f7b8414ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:44.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.726+0000 7f7b8bb66640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b841eab70 con 0x7f7b841494b0 2023-10-03T19:21:44.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.726+0000 7f7b8bb66640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b841ea840 con 0x7f7b8414a6d0 2023-10-03T19:21:44.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.726+0000 7f7b8bb66640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b84159f80 con 0x7f7b700039b0 2023-10-03T19:21:44.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.726+0000 7f7b89101640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b841494b0 0x7f7b841498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:44.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.726+0000 7f7b89101640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b841494b0 0x7f7b841498a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49928/0 (socket says 172.21.15.45:49928) 2023-10-03T19:21:44.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.726+0000 7f7b89101640 1 -- 172.21.15.45:0/2186955881 learned_addr learned my addr 172.21.15.45:0/2186955881 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:44.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.726+0000 7f7b89902640 1 --2- 172.21.15.45:0/2186955881 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b700039b0 0x7f7b84154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:44.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.726+0000 7f7b8a103640 1 --2- 172.21.15.45:0/2186955881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b8414a6d0 0x7f7b8414ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:44.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.726+0000 7f7b89101640 1 -- 172.21.15.45:0/2186955881 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b700039b0 msgr2=0x7f7b84154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:44.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.726+0000 7f7b89101640 1 --2- 172.21.15.45:0/2186955881 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b700039b0 0x7f7b84154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.726+0000 7f7b89101640 1 -- 172.21.15.45:0/2186955881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b8414a6d0 msgr2=0x7f7b8414ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:44.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.726+0000 7f7b89101640 1 --2- 172.21.15.45:0/2186955881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b8414a6d0 0x7f7b8414ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.726+0000 7f7b89101640 1 -- 172.21.15.45:0/2186955881 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8406f590 con 0x7f7b841494b0 2023-10-03T19:21:44.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.726+0000 7f7b8a103640 1 --2- 172.21.15.45:0/2186955881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b8414a6d0 0x7f7b8414ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:21:44.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.726+0000 7f7b89101640 1 --2- 172.21.15.45:0/2186955881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b841494b0 0x7f7b841498a0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f7b74010820 tx=0x7f7b74010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:44.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.726+0000 7f7b7a7fc640 1 -- 172.21.15.45:0/2186955881 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b740095d0 con 0x7f7b841494b0 2023-10-03T19:21:44.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.726+0000 7f7b7a7fc640 1 -- 172.21.15.45:0/2186955881 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7400eb60 con 0x7f7b841494b0 2023-10-03T19:21:44.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.726+0000 7f7b8bb66640 1 -- 172.21.15.45:0/2186955881 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b8406e2b0 con 0x7f7b841494b0 2023-10-03T19:21:44.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.726+0000 7f7b7a7fc640 1 -- 172.21.15.45:0/2186955881 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7401c400 con 0x7f7b841494b0 2023-10-03T19:21:44.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.726+0000 7f7b8bb66640 1 -- 172.21.15.45:0/2186955881 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b8406f720 con 0x7f7b841494b0 2023-10-03T19:21:44.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.726+0000 7f7b8bb66640 1 -- 172.21.15.45:0/2186955881 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b841eace0 con 0x7f7b841494b0 2023-10-03T19:21:44.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.726+0000 7f7b7a7fc640 1 -- 172.21.15.45:0/2186955881 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7b7401c560 con 0x7f7b841494b0 2023-10-03T19:21:44.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.730+0000 7f7b7a7fc640 1 --2- 172.21.15.45:0/2186955881 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7b68066280 0x7f7b68068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:44.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.730+0000 7f7b7a7fc640 1 -- 172.21.15.45:0/2186955881 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f7b74083f20 con 0x7f7b841494b0 2023-10-03T19:21:44.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.730+0000 7f7b89902640 1 --2- 172.21.15.45:0/2186955881 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7b68066280 0x7f7b68068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:44.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.730+0000 7f7b89902640 1 --2- 172.21.15.45:0/2186955881 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7b68066280 0x7f7b68068730 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f7b80001750 tx=0x7f7b800011a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:44.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.734+0000 7f7b7a7fc640 1 -- 172.21.15.45:0/2186955881 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7b74051720 con 0x7f7b841494b0 2023-10-03T19:21:44.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.886+0000 7f7b8bb66640 1 -- 172.21.15.45:0/2186955881 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b8404de80 con 0x7f7b68066280 2023-10-03T19:21:44.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.886+0000 7f7b7a7fc640 1 -- 172.21.15.45:0/2186955881 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7b8404de80 con 0x7f7b68066280 2023-10-03T19:21:44.892 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 3 to deep-scrub 2023-10-03T19:21:44.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.890+0000 7f7b8bb66640 1 -- 172.21.15.45:0/2186955881 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7b68066280 msgr2=0x7f7b68068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:44.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.890+0000 7f7b8bb66640 1 --2- 172.21.15.45:0/2186955881 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7b68066280 0x7f7b68068730 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f7b80001750 tx=0x7f7b800011a0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.890+0000 7f7b8bb66640 1 -- 172.21.15.45:0/2186955881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b841494b0 msgr2=0x7f7b841498a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:44.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.890+0000 7f7b8bb66640 1 --2- 172.21.15.45:0/2186955881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b841494b0 0x7f7b841498a0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f7b74010820 tx=0x7f7b74010ce0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.890+0000 7f7b8bb66640 1 -- 172.21.15.45:0/2186955881 shutdown_connections 2023-10-03T19:21:44.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.890+0000 7f7b8bb66640 1 --2- 172.21.15.45:0/2186955881 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7b68066280 0x7f7b68068730 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.890+0000 7f7b8bb66640 1 --2- 172.21.15.45:0/2186955881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b8414a6d0 0x7f7b8414ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.890+0000 7f7b8bb66640 1 --2- 172.21.15.45:0/2186955881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b841494b0 0x7f7b841498a0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.890+0000 7f7b8bb66640 1 --2- 172.21.15.45:0/2186955881 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7b700039b0 0x7f7b84154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:44.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.890+0000 7f7b8bb66640 1 -- 172.21.15.45:0/2186955881 >> 172.21.15.45:0/2186955881 conn(0x7f7b8406d990 msgr2=0x7f7b840c2680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:44.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.890+0000 7f7b8bb66640 1 -- 172.21.15.45:0/2186955881 shutdown_connections 2023-10-03T19:21:44.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:44.890+0000 7f7b8bb66640 1 -- 172.21.15.45:0/2186955881 wait complete. 2023-10-03T19:21:44.911 INFO:tasks.ceph:Scrubbing osd.4 2023-10-03T19:21:44.912 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-03T19:21:45.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.042+0000 7fb054928640 1 Processor -- start 2023-10-03T19:21:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.042+0000 7fb054928640 1 -- start start 2023-10-03T19:21:45.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.042+0000 7fb054928640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0500c14e0 0x7fb0500c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:45.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.042+0000 7fb054928640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb0500c2770 0x7fb0500a9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:45.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.042+0000 7fb054928640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb05006ac70 con 0x7fb0500bf1f0 2023-10-03T19:21:45.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.042+0000 7fb054928640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb05006aae0 con 0x7fb0500c2770 2023-10-03T19:21:45.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.042+0000 7fb054928640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0500c3000 con 0x7fb0500c14e0 2023-10-03T19:21:45.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.042+0000 7fb04ed9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb0500c2770 0x7fb0500a9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:45.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.042+0000 7fb04ed9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb0500c2770 0x7fb0500a9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49932/0 (socket says 172.21.15.45:49932) 2023-10-03T19:21:45.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.042+0000 7fb04ed9d640 1 -- 172.21.15.45:0/2169998632 learned_addr learned my addr 172.21.15.45:0/2169998632 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:45.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.042+0000 7fb04e59c640 1 --2- 172.21.15.45:0/2169998632 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0500c14e0 0x7fb0500c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:45.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.042+0000 7fb04ed9d640 1 -- 172.21.15.45:0/2169998632 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0500c14e0 msgr2=0x7fb0500c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:45.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.042+0000 7fb04ed9d640 1 --2- 172.21.15.45:0/2169998632 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0500c14e0 0x7fb0500c0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.042+0000 7fb04ed9d640 1 -- 172.21.15.45:0/2169998632 >> v1:172.21.15.79:6789/0 conn(0x7fb0500bf1f0 legacy=0x7fb0500a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:45.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.042+0000 7fb04ed9d640 1 -- 172.21.15.45:0/2169998632 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0500aa5f0 con 0x7fb0500c2770 2023-10-03T19:21:45.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.046+0000 7fb04ed9d640 1 --2- 172.21.15.45:0/2169998632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0500c2770 0x7fb0500a9f70 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fb040009870 tx=0x7fb04001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f359af7fbcbf06c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:45.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.046+0000 7fb04d59a640 1 -- 172.21.15.45:0/2169998632 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0400a89b0 con 0x7fb0500c2770 2023-10-03T19:21:45.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.046+0000 7fb04d59a640 1 -- 172.21.15.45:0/2169998632 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0400a8b10 con 0x7fb0500c2770 2023-10-03T19:21:45.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.046+0000 7fb04d59a640 1 -- 172.21.15.45:0/2169998632 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0400a8ea0 con 0x7fb0500c2770 2023-10-03T19:21:45.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.046+0000 7fb054928640 1 -- 172.21.15.45:0/2169998632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0500c2770 msgr2=0x7fb0500a9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:45.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.046+0000 7fb054928640 1 --2- 172.21.15.45:0/2169998632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0500c2770 0x7fb0500a9f70 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fb040009870 tx=0x7fb04001ecf0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.046+0000 7fb054928640 1 -- 172.21.15.45:0/2169998632 shutdown_connections 2023-10-03T19:21:45.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.046+0000 7fb054928640 1 --2- 172.21.15.45:0/2169998632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0500c2770 0x7fb0500a9f70 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.046+0000 7fb054928640 1 --2- 172.21.15.45:0/2169998632 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0500c14e0 0x7fb0500c0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.046+0000 7fb054928640 1 -- 172.21.15.45:0/2169998632 >> 172.21.15.45:0/2169998632 conn(0x7fb0500a6440 msgr2=0x7fb0500a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:45.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.046+0000 7fb054928640 1 -- 172.21.15.45:0/2169998632 shutdown_connections 2023-10-03T19:21:45.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.046+0000 7fb054928640 1 -- 172.21.15.45:0/2169998632 wait complete. 2023-10-03T19:21:45.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.046+0000 7fb054928640 1 Processor -- start 2023-10-03T19:21:45.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.046+0000 7fb054928640 1 -- start start 2023-10-03T19:21:45.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.046+0000 7fb054928640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0500bf1f0 0x7fb0501e3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:45.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.046+0000 7fb054928640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0500c14e0 0x7fb0500bdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:45.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.046+0000 7fb054928640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0500c2770 0x7fb0501e67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:45.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.046+0000 7fb054928640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0501d4ac0 con 0x7fb0500bf1f0 2023-10-03T19:21:45.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.046+0000 7fb054928640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0500bb380 con 0x7fb0500c2770 2023-10-03T19:21:45.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.046+0000 7fb054928640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0500be2b0 con 0x7fb0500c14e0 2023-10-03T19:21:45.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.050+0000 7fb04e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0500bf1f0 0x7fb0501e3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:45.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.050+0000 7fb04e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0500bf1f0 0x7fb0501e3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49944/0 (socket says 172.21.15.45:49944) 2023-10-03T19:21:45.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.050+0000 7fb04e59c640 1 -- 172.21.15.45:0/345876967 learned_addr learned my addr 172.21.15.45:0/345876967 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:45.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.050+0000 7fb04dd9b640 1 --2- 172.21.15.45:0/345876967 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0500c14e0 0x7fb0500bdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:45.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.050+0000 7fb04ed9d640 1 --2- 172.21.15.45:0/345876967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0500c2770 0x7fb0501e67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:45.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.050+0000 7fb04e59c640 1 -- 172.21.15.45:0/345876967 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0500c14e0 msgr2=0x7fb0500bdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:45.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.050+0000 7fb04e59c640 1 --2- 172.21.15.45:0/345876967 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0500c14e0 0x7fb0500bdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.050+0000 7fb04e59c640 1 -- 172.21.15.45:0/345876967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0500c2770 msgr2=0x7fb0501e67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:45.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.050+0000 7fb04e59c640 1 --2- 172.21.15.45:0/345876967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0500c2770 0x7fb0501e67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.050+0000 7fb04e59c640 1 -- 172.21.15.45:0/345876967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0400094d0 con 0x7fb0500bf1f0 2023-10-03T19:21:45.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.050+0000 7fb04dd9b640 1 --2- 172.21.15.45:0/345876967 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0500c14e0 0x7fb0500bdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:21:45.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.050+0000 7fb04ed9d640 1 --2- 172.21.15.45:0/345876967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0500c2770 0x7fb0501e67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:21:45.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.050+0000 7fb04e59c640 1 --2- 172.21.15.45:0/345876967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0500bf1f0 0x7fb0501e3e00 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fb048007f20 tx=0x7fb04800e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:45.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.050+0000 7fb046ffd640 1 -- 172.21.15.45:0/345876967 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb048014620 con 0x7fb0500bf1f0 2023-10-03T19:21:45.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.050+0000 7fb046ffd640 1 -- 172.21.15.45:0/345876967 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb048014780 con 0x7fb0500bf1f0 2023-10-03T19:21:45.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.050+0000 7fb046ffd640 1 -- 172.21.15.45:0/345876967 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb048014b30 con 0x7fb0500bf1f0 2023-10-03T19:21:45.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.050+0000 7fb054928640 1 -- 172.21.15.45:0/345876967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb05014f530 con 0x7fb0500bf1f0 2023-10-03T19:21:45.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.050+0000 7fb054928640 1 -- 172.21.15.45:0/345876967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb05014f250 con 0x7fb0500bf1f0 2023-10-03T19:21:45.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.050+0000 7fb054928640 1 -- 172.21.15.45:0/345876967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb05006b100 con 0x7fb0500bf1f0 2023-10-03T19:21:45.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.050+0000 7fb046ffd640 1 -- 172.21.15.45:0/345876967 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb048014c90 con 0x7fb0500bf1f0 2023-10-03T19:21:45.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.050+0000 7fb046ffd640 1 --2- 172.21.15.45:0/345876967 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb030066280 0x7fb030068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:45.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.050+0000 7fb046ffd640 1 -- 172.21.15.45:0/345876967 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fb048084fc0 con 0x7fb0500bf1f0 2023-10-03T19:21:45.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.050+0000 7fb046ffd640 1 --2- 172.21.15.45:0/345876967 >> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] conn(0x7fb03006c740 0x7fb03006eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:45.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.050+0000 7fb046ffd640 1 -- 172.21.15.45:0/345876967 --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb03006f200 con 0x7fb03006c740 2023-10-03T19:21:45.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.050+0000 7fb046ffd640 1 -- 172.21.15.45:0/345876967 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb048085330 con 0x7fb0500bf1f0 2023-10-03T19:21:45.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.050+0000 7fb04dd9b640 1 --2- 172.21.15.45:0/345876967 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb030066280 0x7fb030068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:45.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.050+0000 7fb04ed9d640 1 --2- 172.21.15.45:0/345876967 >> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] conn(0x7fb03006c740 0x7fb03006eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:45.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.054+0000 7fb04dd9b640 1 --2- 172.21.15.45:0/345876967 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb030066280 0x7fb030068730 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb05014e0f0 tx=0x7fb038009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:45.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.054+0000 7fb04ed9d640 1 --2- 172.21.15.45:0/345876967 >> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] conn(0x7fb03006c740 0x7fb03006eb50 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:45.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.054+0000 7fb046ffd640 1 -- 172.21.15.45:0/345876967 <== osd.4 v2:172.21.15.79:6810/2234162464 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb03006f200 con 0x7fb03006c740 2023-10-03T19:21:45.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.066+0000 7fb054928640 1 -- 172.21.15.45:0/345876967 --> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb0500bb5f0 con 0x7fb03006c740 2023-10-03T19:21:45.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.066+0000 7fb046ffd640 1 -- 172.21.15.45:0/345876967 <== osd.4 v2:172.21.15.79:6810/2234162464 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb0500bb5f0 con 0x7fb03006c740 2023-10-03T19:21:45.073 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-03T19:21:45.073 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-03T19:21:45.073 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-03T19:21:45.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.066+0000 7fb054928640 1 -- 172.21.15.45:0/345876967 >> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] conn(0x7fb03006c740 msgr2=0x7fb03006eb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:45.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.066+0000 7fb054928640 1 --2- 172.21.15.45:0/345876967 >> [v2:172.21.15.79:6810/2234162464,v1:172.21.15.79:6811/2234162464] conn(0x7fb03006c740 0x7fb03006eb50 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.066+0000 7fb054928640 1 -- 172.21.15.45:0/345876967 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb030066280 msgr2=0x7fb030068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:45.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.066+0000 7fb054928640 1 --2- 172.21.15.45:0/345876967 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb030066280 0x7fb030068730 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb05014e0f0 tx=0x7fb038009040 comp rx=0 tx=0).stop 2023-10-03T19:21:45.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.066+0000 7fb054928640 1 -- 172.21.15.45:0/345876967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0500bf1f0 msgr2=0x7fb0501e3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:45.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.066+0000 7fb054928640 1 --2- 172.21.15.45:0/345876967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0500bf1f0 0x7fb0501e3e00 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fb048007f20 tx=0x7fb04800e570 comp rx=0 tx=0).stop 2023-10-03T19:21:45.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.066+0000 7fb04ed9d640 1 -- 172.21.15.45:0/345876967 reap_dead start 2023-10-03T19:21:45.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.066+0000 7fb054928640 1 -- 172.21.15.45:0/345876967 shutdown_connections 2023-10-03T19:21:45.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.066+0000 7fb054928640 1 -- 172.21.15.45:0/345876967 >> 172.21.15.45:0/345876967 conn(0x7fb0500a6440 msgr2=0x7fb0500a5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:45.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.070+0000 7fb054928640 1 -- 172.21.15.45:0/345876967 shutdown_connections 2023-10-03T19:21:45.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.070+0000 7fb054928640 1 -- 172.21.15.45:0/345876967 wait complete. 2023-10-03T19:21:45.090 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-03T19:21:45.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.206+0000 7f0d00d87640 1 Processor -- start 2023-10-03T19:21:45.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.206+0000 7f0d00d87640 1 -- start start 2023-10-03T19:21:45.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.206+0000 7f0d00d87640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0cfc14be50 0x7f0cfc06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:45.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.206+0000 7f0d00d87640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0cfc0c07d0 0x7f0cfc1504e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:45.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.206+0000 7f0d00d87640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cfc06ebe0 con 0x7f0cfc06ee60 2023-10-03T19:21:45.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.206+0000 7f0d00d87640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cfc150a20 con 0x7f0cfc0c07d0 2023-10-03T19:21:45.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.206+0000 7f0d00d87640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cfc06e8e0 con 0x7f0cfc14be50 2023-10-03T19:21:45.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.206+0000 7f0cf9d9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0cfc0c07d0 0x7f0cfc1504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:45.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.206+0000 7f0cfad9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0cfc06ee60 0x7f0cfc0c2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44506/0 (socket says 172.21.15.45:44506) 2023-10-03T19:21:45.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.206+0000 7f0cfad9d640 1 -- 172.21.15.45:0/1138398534 learned_addr learned my addr 172.21.15.45:0/1138398534 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:21:45.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.206+0000 7f0cfa59c640 1 --2- 172.21.15.45:0/1138398534 >> v2:172.21.15.79:3300/0 conn(0x7f0cfc14be50 0x7f0cfc06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:45.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.206+0000 7f0cf9d9b640 1 -- 172.21.15.45:0/1138398534 >> v2:172.21.15.79:3300/0 conn(0x7f0cfc14be50 msgr2=0x7f0cfc06f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:45.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.206+0000 7f0cf9d9b640 1 --2- 172.21.15.45:0/1138398534 >> v2:172.21.15.79:3300/0 conn(0x7f0cfc14be50 0x7f0cfc06f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.206+0000 7f0cf9d9b640 1 -- 172.21.15.45:0/1138398534 >> v1:172.21.15.45:6789/0 conn(0x7f0cfc06ee60 legacy=0x7f0cfc0c2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:45.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.206+0000 7f0cf9d9b640 1 -- 172.21.15.45:0/1138398534 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cfc06ddd0 con 0x7f0cfc0c07d0 2023-10-03T19:21:45.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.206+0000 7f0cf959a640 1 -- 172.21.15.45:0/1138398534 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1320337582 0 0) 0x7f0cfc06ebe0 con 0x7f0cfc06ee60 2023-10-03T19:21:45.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.206+0000 7f0cfa59c640 1 --2- 172.21.15.45:0/1138398534 >> v2:172.21.15.79:3300/0 conn(0x7f0cfc14be50 0x7f0cfc06f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:21:45.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0cf9d9b640 1 --2- 172.21.15.45:0/1138398534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cfc0c07d0 0x7f0cfc1504e0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc0666a0 tx=0x7f0cf001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=910e769c54e2bf2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:45.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0cf959a640 1 -- 172.21.15.45:0/1138398534 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf00a8050 con 0x7f0cfc0c07d0 2023-10-03T19:21:45.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0cf959a640 1 -- 172.21.15.45:0/1138398534 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf00ac5f0 con 0x7f0cfc0c07d0 2023-10-03T19:21:45.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0cf959a640 1 -- 172.21.15.45:0/1138398534 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf00ac980 con 0x7f0cfc0c07d0 2023-10-03T19:21:45.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0d00d87640 1 -- 172.21.15.45:0/1138398534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cfc0c07d0 msgr2=0x7f0cfc1504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:45.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0d00d87640 1 --2- 172.21.15.45:0/1138398534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cfc0c07d0 0x7f0cfc1504e0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc0666a0 tx=0x7f0cf001c370 comp rx=0 tx=0).stop 2023-10-03T19:21:45.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0d00d87640 1 -- 172.21.15.45:0/1138398534 shutdown_connections 2023-10-03T19:21:45.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0d00d87640 1 --2- 172.21.15.45:0/1138398534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cfc0c07d0 0x7f0cfc1504e0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0d00d87640 1 --2- 172.21.15.45:0/1138398534 >> v2:172.21.15.79:3300/0 conn(0x7f0cfc14be50 0x7f0cfc06f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0d00d87640 1 -- 172.21.15.45:0/1138398534 >> 172.21.15.45:0/1138398534 conn(0x7f0cfc0a4400 msgr2=0x7f0cfc0a47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:45.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0d00d87640 1 -- 172.21.15.45:0/1138398534 shutdown_connections 2023-10-03T19:21:45.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0d00d87640 1 -- 172.21.15.45:0/1138398534 wait complete. 2023-10-03T19:21:45.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0d00d87640 1 Processor -- start 2023-10-03T19:21:45.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0d00d87640 1 -- start start 2023-10-03T19:21:45.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0d00d87640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cfc06ee60 0x7f0cfc152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:45.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0d00d87640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cfc0c07d0 0x7f0cfc152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:45.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0d00d87640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0cfc14be50 0x7f0cfc1e7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:45.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0d00d87640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc1546a0 con 0x7f0cfc0c07d0 2023-10-03T19:21:45.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0d00d87640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc1e8120 con 0x7f0cfc06ee60 2023-10-03T19:21:45.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0d00d87640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc150e70 con 0x7f0cfc14be50 2023-10-03T19:21:45.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0cf9d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cfc0c07d0 0x7f0cfc152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:45.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0cf9d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cfc0c07d0 0x7f0cfc152e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49962/0 (socket says 172.21.15.45:49962) 2023-10-03T19:21:45.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0cf9d9b640 1 -- 172.21.15.45:0/3822920829 learned_addr learned my addr 172.21.15.45:0/3822920829 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:45.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0cfa59c640 1 --2- 172.21.15.45:0/3822920829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cfc06ee60 0x7f0cfc152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:45.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0cfad9d640 1 --2- 172.21.15.45:0/3822920829 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0cfc14be50 0x7f0cfc1e7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:45.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0cf9d9b640 1 -- 172.21.15.45:0/3822920829 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0cfc14be50 msgr2=0x7f0cfc1e7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:45.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0cf9d9b640 1 --2- 172.21.15.45:0/3822920829 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0cfc14be50 0x7f0cfc1e7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0cf9d9b640 1 -- 172.21.15.45:0/3822920829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cfc06ee60 msgr2=0x7f0cfc152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:45.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0cf9d9b640 1 --2- 172.21.15.45:0/3822920829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cfc06ee60 0x7f0cfc152040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0cf9d9b640 1 -- 172.21.15.45:0/3822920829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf0009420 con 0x7f0cfc0c07d0 2023-10-03T19:21:45.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0cfa59c640 1 --2- 172.21.15.45:0/3822920829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cfc06ee60 0x7f0cfc152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:21:45.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0cfad9d640 1 --2- 172.21.15.45:0/3822920829 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0cfc14be50 0x7f0cfc1e7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:21:45.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0cf9d9b640 1 --2- 172.21.15.45:0/3822920829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cfc0c07d0 0x7f0cfc152e80 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f0cf001aa80 tx=0x7f0cf0019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:45.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.210+0000 7f0ceaffd640 1 -- 172.21.15.45:0/3822920829 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf00a8040 con 0x7f0cfc0c07d0 2023-10-03T19:21:45.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.214+0000 7f0ceaffd640 1 -- 172.21.15.45:0/3822920829 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf00b45c0 con 0x7f0cfc0c07d0 2023-10-03T19:21:45.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.214+0000 7f0d00d87640 1 -- 172.21.15.45:0/3822920829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cfc0c0ec0 con 0x7f0cfc0c07d0 2023-10-03T19:21:45.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.214+0000 7f0ceaffd640 1 -- 172.21.15.45:0/3822920829 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf00b4970 con 0x7f0cfc0c07d0 2023-10-03T19:21:45.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.214+0000 7f0d00d87640 1 -- 172.21.15.45:0/3822920829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cfc0a1bf0 con 0x7f0cfc0c07d0 2023-10-03T19:21:45.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.214+0000 7f0d00d87640 1 -- 172.21.15.45:0/3822920829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cfc0c1050 con 0x7f0cfc0c07d0 2023-10-03T19:21:45.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.214+0000 7f0ceaffd640 1 -- 172.21.15.45:0/3822920829 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0cf00b4ad0 con 0x7f0cfc0c07d0 2023-10-03T19:21:45.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.214+0000 7f0ceaffd640 1 --2- 172.21.15.45:0/3822920829 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0cdc066280 0x7f0cdc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:45.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.214+0000 7f0ceaffd640 1 -- 172.21.15.45:0/3822920829 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f0cf011e7d0 con 0x7f0cfc0c07d0 2023-10-03T19:21:45.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.214+0000 7f0cfa59c640 1 --2- 172.21.15.45:0/3822920829 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0cdc066280 0x7f0cdc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:45.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.214+0000 7f0cfa59c640 1 --2- 172.21.15.45:0/3822920829 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0cdc066280 0x7f0cdc068730 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f0cec0097a0 tx=0x7f0cec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:45.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.218+0000 7f0ceaffd640 1 -- 172.21.15.45:0/3822920829 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0cf00ec120 con 0x7f0cfc0c07d0 2023-10-03T19:21:45.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.370+0000 7f0d00d87640 1 -- 172.21.15.45:0/3822920829 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f0cfc0c1050 con 0x7f0cdc066280 2023-10-03T19:21:45.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.374+0000 7f0ceaffd640 1 -- 172.21.15.45:0/3822920829 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0cfc0c1050 con 0x7f0cdc066280 2023-10-03T19:21:45.378 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 4 to deep-scrub 2023-10-03T19:21:45.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.374+0000 7f0d00d87640 1 -- 172.21.15.45:0/3822920829 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0cdc066280 msgr2=0x7f0cdc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:45.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.374+0000 7f0d00d87640 1 --2- 172.21.15.45:0/3822920829 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0cdc066280 0x7f0cdc068730 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f0cec0097a0 tx=0x7f0cec008040 comp rx=0 tx=0).stop 2023-10-03T19:21:45.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.374+0000 7f0d00d87640 1 -- 172.21.15.45:0/3822920829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cfc0c07d0 msgr2=0x7f0cfc152e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:45.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.374+0000 7f0d00d87640 1 --2- 172.21.15.45:0/3822920829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cfc0c07d0 0x7f0cfc152e80 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f0cf001aa80 tx=0x7f0cf0019170 comp rx=0 tx=0).stop 2023-10-03T19:21:45.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.374+0000 7f0d00d87640 1 -- 172.21.15.45:0/3822920829 shutdown_connections 2023-10-03T19:21:45.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.374+0000 7f0d00d87640 1 --2- 172.21.15.45:0/3822920829 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f0cdc066280 0x7f0cdc068730 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.374+0000 7f0d00d87640 1 --2- 172.21.15.45:0/3822920829 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0cfc14be50 0x7f0cfc1e7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.374+0000 7f0d00d87640 1 --2- 172.21.15.45:0/3822920829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cfc0c07d0 0x7f0cfc152e80 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.374+0000 7f0d00d87640 1 --2- 172.21.15.45:0/3822920829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cfc06ee60 0x7f0cfc152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.374+0000 7f0d00d87640 1 -- 172.21.15.45:0/3822920829 >> 172.21.15.45:0/3822920829 conn(0x7f0cfc0a4400 msgr2=0x7f0cfc1502e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:45.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.374+0000 7f0d00d87640 1 -- 172.21.15.45:0/3822920829 shutdown_connections 2023-10-03T19:21:45.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.374+0000 7f0d00d87640 1 -- 172.21.15.45:0/3822920829 wait complete. 2023-10-03T19:21:45.398 INFO:tasks.ceph:Scrubbing osd.5 2023-10-03T19:21:45.399 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-03T19:21:45.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.518+0000 7f847b9f2640 1 Processor -- start 2023-10-03T19:21:45.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.518+0000 7f847b9f2640 1 -- start start 2023-10-03T19:21:45.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.518+0000 7f847b9f2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f84741487b0 0x7f8474152480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:45.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.518+0000 7f847b9f2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f847414e5f0 0x7f847414ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:45.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.518+0000 7f847b9f2640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84741529c0 con 0x7f847406a280 2023-10-03T19:21:45.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.518+0000 7f847b9f2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84740c09e0 con 0x7f847414e5f0 2023-10-03T19:21:45.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.518+0000 7f847b9f2640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f847406a950 con 0x7f84741487b0 2023-10-03T19:21:45.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.518+0000 7f8479f8f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f847414e5f0 0x7f847414ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:45.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.518+0000 7f8479f8f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f847414e5f0 0x7f847414ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49974/0 (socket says 172.21.15.45:49974) 2023-10-03T19:21:45.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.518+0000 7f8479f8f640 1 -- 172.21.15.45:0/1115999037 learned_addr learned my addr 172.21.15.45:0/1115999037 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:45.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.518+0000 7f847978e640 1 --2- 172.21.15.45:0/1115999037 >> v2:172.21.15.79:3300/0 conn(0x7f84741487b0 0x7f8474152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:45.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.518+0000 7f8479f8f640 1 -- 172.21.15.45:0/1115999037 >> v2:172.21.15.79:3300/0 conn(0x7f84741487b0 msgr2=0x7f8474152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:45.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.518+0000 7f8479f8f640 1 --2- 172.21.15.45:0/1115999037 >> v2:172.21.15.79:3300/0 conn(0x7f84741487b0 0x7f8474152480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.518+0000 7f8479f8f640 1 -- 172.21.15.45:0/1115999037 >> v1:172.21.15.79:6789/0 conn(0x7f847406a280 legacy=0x7f8474065690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:45.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.518+0000 7f8479f8f640 1 -- 172.21.15.45:0/1115999037 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f847406ac30 con 0x7f847414e5f0 2023-10-03T19:21:45.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.522+0000 7f8479f8f640 1 --2- 172.21.15.45:0/1115999037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f847414e5f0 0x7f847414ea50 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f847406c1e0 tx=0x7f846401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36065e52e01c77b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:45.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.522+0000 7f846bfff640 1 -- 172.21.15.45:0/1115999037 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84640a8990 con 0x7f847414e5f0 2023-10-03T19:21:45.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.522+0000 7f846bfff640 1 -- 172.21.15.45:0/1115999037 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84640a8af0 con 0x7f847414e5f0 2023-10-03T19:21:45.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.522+0000 7f846bfff640 1 -- 172.21.15.45:0/1115999037 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84640a8e80 con 0x7f847414e5f0 2023-10-03T19:21:45.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.522+0000 7f847b9f2640 1 -- 172.21.15.45:0/1115999037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f847414e5f0 msgr2=0x7f847414ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:45.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.522+0000 7f847b9f2640 1 --2- 172.21.15.45:0/1115999037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f847414e5f0 0x7f847414ea50 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f847406c1e0 tx=0x7f846401ec90 comp rx=0 tx=0).stop 2023-10-03T19:21:45.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.522+0000 7f847b9f2640 1 -- 172.21.15.45:0/1115999037 shutdown_connections 2023-10-03T19:21:45.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.522+0000 7f847b9f2640 1 --2- 172.21.15.45:0/1115999037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f847414e5f0 0x7f847414ea50 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.522+0000 7f847b9f2640 1 --2- 172.21.15.45:0/1115999037 >> v2:172.21.15.79:3300/0 conn(0x7f84741487b0 0x7f8474152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.522+0000 7f847b9f2640 1 -- 172.21.15.45:0/1115999037 >> 172.21.15.45:0/1115999037 conn(0x7f84740c14f0 msgr2=0x7f84740c18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:45.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.522+0000 7f847b9f2640 1 -- 172.21.15.45:0/1115999037 shutdown_connections 2023-10-03T19:21:45.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.522+0000 7f847b9f2640 1 -- 172.21.15.45:0/1115999037 wait complete. 2023-10-03T19:21:45.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.522+0000 7f847b9f2640 1 Processor -- start 2023-10-03T19:21:45.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.522+0000 7f847b9f2640 1 -- start start 2023-10-03T19:21:45.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.522+0000 7f847b9f2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f847406a280 0x7f84740a6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:45.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.522+0000 7f847b9f2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84741487b0 0x7f847414bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:45.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.522+0000 7f847b9f2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f847414e5f0 0x7f84740714c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:45.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.522+0000 7f847b9f2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8474148f10 con 0x7f847414e5f0 2023-10-03T19:21:45.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.522+0000 7f847b9f2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84740a48b0 con 0x7f84741487b0 2023-10-03T19:21:45.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.522+0000 7f847b9f2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8474071a00 con 0x7f847406a280 2023-10-03T19:21:45.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.522+0000 7f8479f8f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f847414e5f0 0x7f84740714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:45.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.522+0000 7f8479f8f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f847414e5f0 0x7f84740714c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49990/0 (socket says 172.21.15.45:49990) 2023-10-03T19:21:45.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.522+0000 7f8479f8f640 1 -- 172.21.15.45:0/2884623094 learned_addr learned my addr 172.21.15.45:0/2884623094 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:45.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.522+0000 7f847978e640 1 --2- 172.21.15.45:0/2884623094 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f847406a280 0x7f84740a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:45.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.522+0000 7f8478f8d640 1 --2- 172.21.15.45:0/2884623094 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84741487b0 0x7f847414bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:45.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.526+0000 7f8479f8f640 1 -- 172.21.15.45:0/2884623094 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f847406a280 msgr2=0x7f84740a6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:45.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.526+0000 7f8479f8f640 1 --2- 172.21.15.45:0/2884623094 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f847406a280 0x7f84740a6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.526+0000 7f8479f8f640 1 -- 172.21.15.45:0/2884623094 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84741487b0 msgr2=0x7f847414bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:45.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.526+0000 7f8479f8f640 1 --2- 172.21.15.45:0/2884623094 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84741487b0 0x7f847414bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.526+0000 7f8479f8f640 1 -- 172.21.15.45:0/2884623094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84640094d0 con 0x7f847414e5f0 2023-10-03T19:21:45.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.526+0000 7f8479f8f640 1 --2- 172.21.15.45:0/2884623094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f847414e5f0 0x7f84740714c0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f846401c8c0 tx=0x7f846401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:45.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.526+0000 7f8469ffb640 1 -- 172.21.15.45:0/2884623094 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84640ba600 con 0x7f847414e5f0 2023-10-03T19:21:45.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.526+0000 7f8469ffb640 1 -- 172.21.15.45:0/2884623094 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84640ba760 con 0x7f847414e5f0 2023-10-03T19:21:45.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.526+0000 7f847b9f2640 1 -- 172.21.15.45:0/2884623094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f847406a000 con 0x7f847414e5f0 2023-10-03T19:21:45.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.526+0000 7f8469ffb640 1 -- 172.21.15.45:0/2884623094 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84640baad0 con 0x7f847414e5f0 2023-10-03T19:21:45.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.526+0000 7f847b9f2640 1 -- 172.21.15.45:0/2884623094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f847406af10 con 0x7f847414e5f0 2023-10-03T19:21:45.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.526+0000 7f847b9f2640 1 -- 172.21.15.45:0/2884623094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8474065da0 con 0x7f847414e5f0 2023-10-03T19:21:45.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.526+0000 7f8469ffb640 1 -- 172.21.15.45:0/2884623094 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f84640bac30 con 0x7f847414e5f0 2023-10-03T19:21:45.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.526+0000 7f8469ffb640 1 --2- 172.21.15.45:0/2884623094 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8460066280 0x7f8460068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:45.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.526+0000 7f8469ffb640 1 -- 172.21.15.45:0/2884623094 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f8464122060 con 0x7f847414e5f0 2023-10-03T19:21:45.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.526+0000 7f8469ffb640 1 --2- 172.21.15.45:0/2884623094 >> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] conn(0x7f846006c740 0x7f846006eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:45.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.526+0000 7f8469ffb640 1 -- 172.21.15.45:0/2884623094 --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f846006f200 con 0x7f846006c740 2023-10-03T19:21:45.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.526+0000 7f8469ffb640 1 -- 172.21.15.45:0/2884623094 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8464124720 con 0x7f847414e5f0 2023-10-03T19:21:45.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.526+0000 7f847978e640 1 --2- 172.21.15.45:0/2884623094 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8460066280 0x7f8460068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:45.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.526+0000 7f8478f8d640 1 --2- 172.21.15.45:0/2884623094 >> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] conn(0x7f846006c740 0x7f846006eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:45.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.526+0000 7f847978e640 1 --2- 172.21.15.45:0/2884623094 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8460066280 0x7f8460068730 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f846c003fd0 tx=0x7f846c0039a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:45.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.526+0000 7f8478f8d640 1 --2- 172.21.15.45:0/2884623094 >> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] conn(0x7f846006c740 0x7f846006eb50 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:45.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.530+0000 7f8469ffb640 1 -- 172.21.15.45:0/2884623094 <== osd.5 v2:172.21.15.79:6802/2879380539 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f846006f200 con 0x7f846006c740 2023-10-03T19:21:45.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.542+0000 7f847b9f2640 1 -- 172.21.15.45:0/2884623094 --> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f847404de80 con 0x7f846006c740 2023-10-03T19:21:45.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.542+0000 7f8469ffb640 1 -- 172.21.15.45:0/2884623094 <== osd.5 v2:172.21.15.79:6802/2879380539 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f847404de80 con 0x7f846006c740 2023-10-03T19:21:45.548 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-03T19:21:45.549 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-03T19:21:45.549 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-03T19:21:45.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.542+0000 7f847b9f2640 1 -- 172.21.15.45:0/2884623094 >> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] conn(0x7f846006c740 msgr2=0x7f846006eb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:45.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.542+0000 7f847b9f2640 1 --2- 172.21.15.45:0/2884623094 >> [v2:172.21.15.79:6802/2879380539,v1:172.21.15.79:6803/2879380539] conn(0x7f846006c740 0x7f846006eb50 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.542+0000 7f847b9f2640 1 -- 172.21.15.45:0/2884623094 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8460066280 msgr2=0x7f8460068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:45.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.542+0000 7f847b9f2640 1 --2- 172.21.15.45:0/2884623094 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8460066280 0x7f8460068730 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f846c003fd0 tx=0x7f846c0039a0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.542+0000 7f847b9f2640 1 -- 172.21.15.45:0/2884623094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f847414e5f0 msgr2=0x7f84740714c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:45.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.542+0000 7f847b9f2640 1 --2- 172.21.15.45:0/2884623094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f847414e5f0 0x7f84740714c0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f846401c8c0 tx=0x7f846401ba30 comp rx=0 tx=0).stop 2023-10-03T19:21:45.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.542+0000 7f8479f8f640 1 -- 172.21.15.45:0/2884623094 reap_dead start 2023-10-03T19:21:45.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.542+0000 7f847b9f2640 1 -- 172.21.15.45:0/2884623094 shutdown_connections 2023-10-03T19:21:45.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.542+0000 7f847b9f2640 1 -- 172.21.15.45:0/2884623094 >> 172.21.15.45:0/2884623094 conn(0x7f84740c14f0 msgr2=0x7f847414dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:45.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.542+0000 7f847b9f2640 1 -- 172.21.15.45:0/2884623094 shutdown_connections 2023-10-03T19:21:45.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.542+0000 7f847b9f2640 1 -- 172.21.15.45:0/2884623094 wait complete. 2023-10-03T19:21:45.565 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-03T19:21:45.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.678+0000 7f629940c640 1 Processor -- start 2023-10-03T19:21:45.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.678+0000 7f629940c640 1 -- start start 2023-10-03T19:21:45.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.678+0000 7f629940c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f62940bc900 0x7f6294151d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:45.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.678+0000 7f629940c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62940c0fd0 con 0x7f629414bb80 2023-10-03T19:21:45.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.678+0000 7f629940c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f629414bf50 con 0x7f62940bcfb0 2023-10-03T19:21:45.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.678+0000 7f629940c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62940bce20 con 0x7f62940bc900 2023-10-03T19:21:45.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.678+0000 7f6292ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f629414bb80 0x7f62940be700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44520/0 (socket says 172.21.15.45:44520) 2023-10-03T19:21:45.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.678+0000 7f6292ffd640 1 -- 172.21.15.45:0/3865936830 learned_addr learned my addr 172.21.15.45:0/3865936830 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:21:45.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.678+0000 7f62927fc640 1 --2- 172.21.15.45:0/3865936830 >> v2:172.21.15.79:3300/0 conn(0x7f62940bc900 0x7f6294151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:45.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.678+0000 7f6291ffb640 1 -- 172.21.15.45:0/3865936830 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682112068 0 0) 0x7f62940c0fd0 con 0x7f629414bb80 2023-10-03T19:21:45.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.678+0000 7f6291ffb640 1 -- 172.21.15.45:0/3865936830 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f627c003530 con 0x7f629414bb80 2023-10-03T19:21:45.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.678+0000 7f6291ffb640 1 -- 172.21.15.45:0/3865936830 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1816259398 0 0) 0x7f627c003530 con 0x7f629414bb80 2023-10-03T19:21:45.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.678+0000 7f6291ffb640 1 -- 172.21.15.45:0/3865936830 >> v2:172.21.15.79:3300/0 conn(0x7f62940bc900 msgr2=0x7f6294151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:45.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.678+0000 7f6291ffb640 1 --2- 172.21.15.45:0/3865936830 >> v2:172.21.15.79:3300/0 conn(0x7f62940bc900 0x7f6294151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.678+0000 7f6291ffb640 1 -- 172.21.15.45:0/3865936830 >> v1:172.21.15.79:6789/0 conn(0x7f62940bcfb0 legacy=0x7f6294152290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:45.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.678+0000 7f6291ffb640 1 -- 172.21.15.45:0/3865936830 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62940c0980 con 0x7f629414bb80 2023-10-03T19:21:45.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.678+0000 7f6291ffb640 1 -- 172.21.15.45:0/3865936830 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f6284001a00 con 0x7f629414bb80 2023-10-03T19:21:45.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.678+0000 7f6291ffb640 1 -- 172.21.15.45:0/3865936830 >> v1:172.21.15.45:6789/0 conn(0x7f629414bb80 legacy=0x7f62940be700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:45.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.678+0000 7f6291ffb640 1 --2- 172.21.15.45:0/3865936830 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f627c003980 0x7f627c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:45.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.678+0000 7f6291ffb640 1 --2- 172.21.15.45:0/3865936830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f627c0047d0 0x7f627c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:45.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.678+0000 7f6291ffb640 1 --2- 172.21.15.45:0/3865936830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f627c005180 0x7f627c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:45.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.678+0000 7f6291ffb640 1 -- 172.21.15.45:0/3865936830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62940bce20 con 0x7f627c0047d0 2023-10-03T19:21:45.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.678+0000 7f6291ffb640 1 -- 172.21.15.45:0/3865936830 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c00bfe0 con 0x7f627c005180 2023-10-03T19:21:45.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.678+0000 7f6291ffb640 1 -- 172.21.15.45:0/3865936830 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627c00c1a0 con 0x7f627c003980 2023-10-03T19:21:45.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.678+0000 7f62927fc640 1 --2- 172.21.15.45:0/3865936830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f627c0047d0 0x7f627c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:45.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.678+0000 7f62937fe640 1 --2- 172.21.15.45:0/3865936830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f627c005180 0x7f627c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:45.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.678+0000 7f6292ffd640 1 --2- 172.21.15.45:0/3865936830 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f627c003980 0x7f627c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:45.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.682+0000 7f62927fc640 1 -- 172.21.15.45:0/3865936830 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f627c003980 msgr2=0x7f627c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:45.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.682+0000 7f62927fc640 1 --2- 172.21.15.45:0/3865936830 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f627c003980 0x7f627c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.682+0000 7f62927fc640 1 -- 172.21.15.45:0/3865936830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f627c005180 msgr2=0x7f627c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:45.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.682+0000 7f62927fc640 1 --2- 172.21.15.45:0/3865936830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f627c005180 0x7f627c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.682+0000 7f62927fc640 1 -- 172.21.15.45:0/3865936830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627c003530 con 0x7f627c0047d0 2023-10-03T19:21:45.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.682+0000 7f6292ffd640 1 --2- 172.21.15.45:0/3865936830 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f627c003980 0x7f627c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:21:45.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.682+0000 7f62937fe640 1 --2- 172.21.15.45:0/3865936830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f627c005180 0x7f627c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:21:45.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.682+0000 7f62937fe640 1 -- 172.21.15.45:0/3865936830 reap_dead start 2023-10-03T19:21:45.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.682+0000 7f62927fc640 1 --2- 172.21.15.45:0/3865936830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f627c0047d0 0x7f627c004c40 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f6288009ae0 tx=0x7f628801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=535ca23c7fcd3718 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:45.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.682+0000 7f6291ffb640 1 -- 172.21.15.45:0/3865936830 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62880a5640 con 0x7f627c0047d0 2023-10-03T19:21:45.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.682+0000 7f6291ffb640 1 -- 172.21.15.45:0/3865936830 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62880a57a0 con 0x7f627c0047d0 2023-10-03T19:21:45.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.682+0000 7f6291ffb640 1 -- 172.21.15.45:0/3865936830 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62880a5b50 con 0x7f627c0047d0 2023-10-03T19:21:45.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.682+0000 7f629940c640 1 -- 172.21.15.45:0/3865936830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f627c0047d0 msgr2=0x7f627c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:45.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.682+0000 7f629940c640 1 --2- 172.21.15.45:0/3865936830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f627c0047d0 0x7f627c004c40 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f6288009ae0 tx=0x7f628801ca50 comp rx=0 tx=0).stop 2023-10-03T19:21:45.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.682+0000 7f629940c640 1 -- 172.21.15.45:0/3865936830 shutdown_connections 2023-10-03T19:21:45.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.682+0000 7f629940c640 1 --2- 172.21.15.45:0/3865936830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f627c0047d0 0x7f627c004c40 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.682+0000 7f629940c640 1 -- 172.21.15.45:0/3865936830 >> 172.21.15.45:0/3865936830 conn(0x7f62940c2200 msgr2=0x7f62940bdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:45.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.682+0000 7f629940c640 1 -- 172.21.15.45:0/3865936830 shutdown_connections 2023-10-03T19:21:45.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.682+0000 7f629940c640 1 -- 172.21.15.45:0/3865936830 wait complete. 2023-10-03T19:21:45.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.686+0000 7f629940c640 1 Processor -- start 2023-10-03T19:21:45.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.686+0000 7f629940c640 1 -- start start 2023-10-03T19:21:45.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.686+0000 7f629940c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f627c0047d0 0x7f6294071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:45.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.686+0000 7f629940c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f629406d8f0 0x7f62940baab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:45.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.686+0000 7f629940c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62940a5cd0 0x7f62940baff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:45.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.686+0000 7f629940c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629406e2a0 con 0x7f62940a5cd0 2023-10-03T19:21:45.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.686+0000 7f629940c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62940716c0 con 0x7f627c0047d0 2023-10-03T19:21:45.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.686+0000 7f629940c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629406cd30 con 0x7f629406d8f0 2023-10-03T19:21:45.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.686+0000 7f62937fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62940a5cd0 0x7f62940baff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:45.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.686+0000 7f62937fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62940a5cd0 0x7f62940baff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50018/0 (socket says 172.21.15.45:50018) 2023-10-03T19:21:45.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.686+0000 7f62937fe640 1 -- 172.21.15.45:0/1564566699 learned_addr learned my addr 172.21.15.45:0/1564566699 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:45.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.686+0000 7f62927fc640 1 --2- 172.21.15.45:0/1564566699 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f629406d8f0 0x7f62940baab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:45.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.686+0000 7f6292ffd640 1 --2- 172.21.15.45:0/1564566699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f627c0047d0 0x7f6294071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:45.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.686+0000 7f62937fe640 1 -- 172.21.15.45:0/1564566699 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f629406d8f0 msgr2=0x7f62940baab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:45.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.686+0000 7f62937fe640 1 --2- 172.21.15.45:0/1564566699 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f629406d8f0 0x7f62940baab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.686+0000 7f62937fe640 1 -- 172.21.15.45:0/1564566699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f627c0047d0 msgr2=0x7f6294071180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:45.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.686+0000 7f62937fe640 1 --2- 172.21.15.45:0/1564566699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f627c0047d0 0x7f6294071180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.686+0000 7f62937fe640 1 -- 172.21.15.45:0/1564566699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62940c03f0 con 0x7f62940a5cd0 2023-10-03T19:21:45.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.686+0000 7f62937fe640 1 --2- 172.21.15.45:0/1564566699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62940a5cd0 0x7f62940baff0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f629406ac10 tx=0x7f628c00e450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:45.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.686+0000 7f627b7fe640 1 -- 172.21.15.45:0/1564566699 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c0052e0 con 0x7f62940a5cd0 2023-10-03T19:21:45.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.686+0000 7f627b7fe640 1 -- 172.21.15.45:0/1564566699 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628c005440 con 0x7f62940a5cd0 2023-10-03T19:21:45.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.686+0000 7f629940c640 1 -- 172.21.15.45:0/1564566699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62940c0c60 con 0x7f62940a5cd0 2023-10-03T19:21:45.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.686+0000 7f627b7fe640 1 -- 172.21.15.45:0/1564566699 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c00e9a0 con 0x7f62940a5cd0 2023-10-03T19:21:45.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.686+0000 7f629940c640 1 -- 172.21.15.45:0/1564566699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62940c0580 con 0x7f62940a5cd0 2023-10-03T19:21:45.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.690+0000 7f629940c640 1 -- 172.21.15.45:0/1564566699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f629406e450 con 0x7f62940a5cd0 2023-10-03T19:21:45.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.690+0000 7f627b7fe640 1 -- 172.21.15.45:0/1564566699 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f628c00eb00 con 0x7f62940a5cd0 2023-10-03T19:21:45.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.690+0000 7f627b7fe640 1 --2- 172.21.15.45:0/1564566699 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f62800662b0 0x7f6280068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:45.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.690+0000 7f627b7fe640 1 -- 172.21.15.45:0/1564566699 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f628c082970 con 0x7f62940a5cd0 2023-10-03T19:21:45.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.690+0000 7f6292ffd640 1 --2- 172.21.15.45:0/1564566699 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f62800662b0 0x7f6280068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:45.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.690+0000 7f6292ffd640 1 --2- 172.21.15.45:0/1564566699 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f62800662b0 0x7f6280068760 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f6284002020 tx=0x7f6284009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:45.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.694+0000 7f627b7fe640 1 -- 172.21.15.45:0/1564566699 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f628c053b50 con 0x7f62940a5cd0 2023-10-03T19:21:45.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.846+0000 7f629940c640 1 -- 172.21.15.45:0/1564566699 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f629404de80 con 0x7f62800662b0 2023-10-03T19:21:45.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.850+0000 7f627b7fe640 1 -- 172.21.15.45:0/1564566699 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f629404de80 con 0x7f62800662b0 2023-10-03T19:21:45.853 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 5 to deep-scrub 2023-10-03T19:21:45.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.850+0000 7f629940c640 1 -- 172.21.15.45:0/1564566699 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f62800662b0 msgr2=0x7f6280068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:45.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.850+0000 7f629940c640 1 --2- 172.21.15.45:0/1564566699 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f62800662b0 0x7f6280068760 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f6284002020 tx=0x7f6284009040 comp rx=0 tx=0).stop 2023-10-03T19:21:45.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.850+0000 7f629940c640 1 -- 172.21.15.45:0/1564566699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62940a5cd0 msgr2=0x7f62940baff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:45.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.850+0000 7f629940c640 1 --2- 172.21.15.45:0/1564566699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62940a5cd0 0x7f62940baff0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f629406ac10 tx=0x7f628c00e450 comp rx=0 tx=0).stop 2023-10-03T19:21:45.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.850+0000 7f629940c640 1 -- 172.21.15.45:0/1564566699 shutdown_connections 2023-10-03T19:21:45.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.850+0000 7f629940c640 1 --2- 172.21.15.45:0/1564566699 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f62800662b0 0x7f6280068760 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.850+0000 7f629940c640 1 --2- 172.21.15.45:0/1564566699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62940a5cd0 0x7f62940baff0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.850+0000 7f629940c640 1 --2- 172.21.15.45:0/1564566699 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f629406d8f0 0x7f62940baab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.850+0000 7f629940c640 1 --2- 172.21.15.45:0/1564566699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f627c0047d0 0x7f6294071180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:45.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.850+0000 7f629940c640 1 -- 172.21.15.45:0/1564566699 >> 172.21.15.45:0/1564566699 conn(0x7f62940c2200 msgr2=0x7f6294067830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:45.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.850+0000 7f629940c640 1 -- 172.21.15.45:0/1564566699 shutdown_connections 2023-10-03T19:21:45.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.850+0000 7f629940c640 1 -- 172.21.15.45:0/1564566699 wait complete. 2023-10-03T19:21:45.873 INFO:tasks.ceph:Scrubbing osd.6 2023-10-03T19:21:45.873 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-03T19:21:45.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.990+0000 7f8cc4c21640 1 Processor -- start 2023-10-03T19:21:45.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.990+0000 7f8cc4c21640 1 -- start start 2023-10-03T19:21:45.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.990+0000 7f8cc4c21640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8cc006d630 0x7f8cc014e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:45.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.990+0000 7f8cc4c21640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc00bcf80 con 0x7f8cc006c1b0 2023-10-03T19:21:45.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.990+0000 7f8cc4c21640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc00bd260 con 0x7f8cc0148540 2023-10-03T19:21:45.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.990+0000 7f8cc4c21640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc0152b50 con 0x7f8cc006d630 2023-10-03T19:21:45.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.990+0000 7f8cbed9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8cc006c1b0 0x7f8cc014eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44532/0 (socket says 172.21.15.45:44532) 2023-10-03T19:21:45.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.990+0000 7f8cbed9d640 1 -- 172.21.15.45:0/3096201848 learned_addr learned my addr 172.21.15.45:0/3096201848 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:21:45.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.990+0000 7f8cbdd9b640 1 --2- 172.21.15.45:0/3096201848 >> v2:172.21.15.79:3300/0 conn(0x7f8cc006d630 0x7f8cc014e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:45.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.990+0000 7f8cbd59a640 1 -- 172.21.15.45:0/3096201848 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1782989604 0 0) 0x7f8cc00bcf80 con 0x7f8cc006c1b0 2023-10-03T19:21:45.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.990+0000 7f8cbd59a640 1 -- 172.21.15.45:0/3096201848 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cac003530 con 0x7f8cc006c1b0 2023-10-03T19:21:45.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cbd59a640 1 -- 172.21.15.45:0/3096201848 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2002490468 0 0) 0x7f8cac003530 con 0x7f8cc006c1b0 2023-10-03T19:21:45.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cbd59a640 1 -- 172.21.15.45:0/3096201848 >> v2:172.21.15.79:3300/0 conn(0x7f8cc006d630 msgr2=0x7f8cc014e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:46.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cbd59a640 1 --2- 172.21.15.45:0/3096201848 >> v2:172.21.15.79:3300/0 conn(0x7f8cc006d630 0x7f8cc014e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cbd59a640 1 -- 172.21.15.45:0/3096201848 >> v1:172.21.15.79:6789/0 conn(0x7f8cc0148540 legacy=0x7f8cc00bb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cbd59a640 1 -- 172.21.15.45:0/3096201848 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc00bd540 con 0x7f8cc006c1b0 2023-10-03T19:21:46.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cbd59a640 1 -- 172.21.15.45:0/3096201848 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f8cb8001a00 con 0x7f8cc006c1b0 2023-10-03T19:21:46.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cbd59a640 1 -- 172.21.15.45:0/3096201848 >> v1:172.21.15.45:6789/0 conn(0x7f8cc006c1b0 legacy=0x7f8cc014eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cbd59a640 1 --2- 172.21.15.45:0/3096201848 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8cac003980 0x7f8cac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cbd59a640 1 --2- 172.21.15.45:0/3096201848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cac0047d0 0x7f8cac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cbd59a640 1 --2- 172.21.15.45:0/3096201848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cac005180 0x7f8cac00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cbd59a640 1 -- 172.21.15.45:0/3096201848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc0152b50 con 0x7f8cac005180 2023-10-03T19:21:46.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cbd59a640 1 -- 172.21.15.45:0/3096201848 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac00c000 con 0x7f8cac0047d0 2023-10-03T19:21:46.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cbd59a640 1 -- 172.21.15.45:0/3096201848 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac00c1c0 con 0x7f8cac003980 2023-10-03T19:21:46.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cbed9d640 1 --2- 172.21.15.45:0/3096201848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cac005180 0x7f8cac00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cbe59c640 1 --2- 172.21.15.45:0/3096201848 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8cac003980 0x7f8cac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cbdd9b640 1 --2- 172.21.15.45:0/3096201848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cac0047d0 0x7f8cac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cbed9d640 1 -- 172.21.15.45:0/3096201848 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8cac003980 msgr2=0x7f8cac003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:46.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cbed9d640 1 --2- 172.21.15.45:0/3096201848 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8cac003980 0x7f8cac003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cbed9d640 1 -- 172.21.15.45:0/3096201848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cac0047d0 msgr2=0x7f8cac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:46.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cbed9d640 1 --2- 172.21.15.45:0/3096201848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cac0047d0 0x7f8cac004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cbed9d640 1 -- 172.21.15.45:0/3096201848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac003530 con 0x7f8cac005180 2023-10-03T19:21:46.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cbed9d640 1 -- 172.21.15.45:0/3096201848 reap_dead start 2023-10-03T19:21:46.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cbed9d640 1 --2- 172.21.15.45:0/3096201848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cac005180 0x7f8cac00b990 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f8cb800a800 tx=0x7f8cb801d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c6951b13b64098 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:46.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cbd59a640 1 -- 172.21.15.45:0/3096201848 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb80072d0 con 0x7f8cac005180 2023-10-03T19:21:46.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cbd59a640 1 -- 172.21.15.45:0/3096201848 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb80a8070 con 0x7f8cac005180 2023-10-03T19:21:46.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cbd59a640 1 -- 172.21.15.45:0/3096201848 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8007670 con 0x7f8cac005180 2023-10-03T19:21:46.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cc4c21640 1 -- 172.21.15.45:0/3096201848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cac005180 msgr2=0x7f8cac00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cc4c21640 1 --2- 172.21.15.45:0/3096201848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cac005180 0x7f8cac00b990 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f8cb800a800 tx=0x7f8cb801d300 comp rx=0 tx=0).stop 2023-10-03T19:21:46.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cc4c21640 1 -- 172.21.15.45:0/3096201848 shutdown_connections 2023-10-03T19:21:46.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cc4c21640 1 --2- 172.21.15.45:0/3096201848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cac005180 0x7f8cac00b990 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cc4c21640 1 -- 172.21.15.45:0/3096201848 >> 172.21.15.45:0/3096201848 conn(0x7f8cc00a20d0 msgr2=0x7f8cc00a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:46.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cc4c21640 1 -- 172.21.15.45:0/3096201848 shutdown_connections 2023-10-03T19:21:46.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.994+0000 7f8cc4c21640 1 -- 172.21.15.45:0/3096201848 wait complete. 2023-10-03T19:21:46.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.998+0000 7f8cc4c21640 1 Processor -- start 2023-10-03T19:21:46.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.998+0000 7f8cc4c21640 1 -- start start 2023-10-03T19:21:46.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.998+0000 7f8cc4c21640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cac005180 0x7f8cc014fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.998+0000 7f8cc4c21640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8cc014da40 0x7f8cc0151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.998+0000 7f8cc4c21640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cc014b2b0 0x7f8cc0151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.998+0000 7f8cc4c21640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc0152490 con 0x7f8cac005180 2023-10-03T19:21:46.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.998+0000 7f8cc4c21640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc0070010 con 0x7f8cc014b2b0 2023-10-03T19:21:46.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.998+0000 7f8cc4c21640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc0150090 con 0x7f8cc014da40 2023-10-03T19:21:46.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.998+0000 7f8cbe59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cac005180 0x7f8cc014fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.998+0000 7f8cbe59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cac005180 0x7f8cc014fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50038/0 (socket says 172.21.15.45:50038) 2023-10-03T19:21:46.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.998+0000 7f8cbe59c640 1 -- 172.21.15.45:0/3494468614 learned_addr learned my addr 172.21.15.45:0/3494468614 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:46.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.998+0000 7f8cbed9d640 1 --2- 172.21.15.45:0/3494468614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cc014b2b0 0x7f8cc0151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.998+0000 7f8cbdd9b640 1 --2- 172.21.15.45:0/3494468614 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8cc014da40 0x7f8cc0151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.998+0000 7f8cbe59c640 1 -- 172.21.15.45:0/3494468614 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8cc014da40 msgr2=0x7f8cc0151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.998+0000 7f8cbe59c640 1 --2- 172.21.15.45:0/3494468614 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8cc014da40 0x7f8cc0151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.998+0000 7f8cbe59c640 1 -- 172.21.15.45:0/3494468614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cc014b2b0 msgr2=0x7f8cc0151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.998+0000 7f8cbe59c640 1 --2- 172.21.15.45:0/3494468614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cc014b2b0 0x7f8cc0151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.998+0000 7f8cbe59c640 1 -- 172.21.15.45:0/3494468614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc00bdc10 con 0x7f8cac005180 2023-10-03T19:21:46.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.998+0000 7f8cbe59c640 1 --2- 172.21.15.45:0/3494468614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cac005180 0x7f8cc014fb50 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f8ca800e4b0 tx=0x7f8ca800e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:46.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.998+0000 7f8cb6ffd640 1 -- 172.21.15.45:0/3494468614 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca80052e0 con 0x7f8cac005180 2023-10-03T19:21:46.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.998+0000 7f8cb6ffd640 1 -- 172.21.15.45:0/3494468614 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca8005440 con 0x7f8cac005180 2023-10-03T19:21:46.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.998+0000 7f8cc4c21640 1 -- 172.21.15.45:0/3494468614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc0148910 con 0x7f8cac005180 2023-10-03T19:21:46.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.998+0000 7f8cb6ffd640 1 -- 172.21.15.45:0/3494468614 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8003840 con 0x7f8cac005180 2023-10-03T19:21:46.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.998+0000 7f8cc4c21640 1 -- 172.21.15.45:0/3494468614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc00bdda0 con 0x7f8cac005180 2023-10-03T19:21:46.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:45.998+0000 7f8cc4c21640 1 -- 172.21.15.45:0/3494468614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8cc004de80 con 0x7f8cac005180 2023-10-03T19:21:46.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.002+0000 7f8cb6ffd640 1 -- 172.21.15.45:0/3494468614 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8ca80039a0 con 0x7f8cac005180 2023-10-03T19:21:46.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.002+0000 7f8cb6ffd640 1 --2- 172.21.15.45:0/3494468614 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8ca00662b0 0x7f8ca0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.002+0000 7f8cb6ffd640 1 -- 172.21.15.45:0/3494468614 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f8ca80842e0 con 0x7f8cac005180 2023-10-03T19:21:46.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.002+0000 7f8cb6ffd640 1 --2- 172.21.15.45:0/3494468614 >> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] conn(0x7f8ca006c770 0x7f8ca006eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.002+0000 7f8cb6ffd640 1 -- 172.21.15.45:0/3494468614 --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8ca006f230 con 0x7f8ca006c770 2023-10-03T19:21:46.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.002+0000 7f8cb6ffd640 1 -- 172.21.15.45:0/3494468614 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ca8084650 con 0x7f8cac005180 2023-10-03T19:21:46.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.002+0000 7f8cbdd9b640 1 --2- 172.21.15.45:0/3494468614 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8ca00662b0 0x7f8ca0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.002+0000 7f8cbed9d640 1 --2- 172.21.15.45:0/3494468614 >> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] conn(0x7f8ca006c770 0x7f8ca006eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.002+0000 7f8cbdd9b640 1 --2- 172.21.15.45:0/3494468614 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8ca00662b0 0x7f8ca0068760 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00bb1a0 tx=0x7f8cb0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:46.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.002+0000 7f8cbed9d640 1 --2- 172.21.15.45:0/3494468614 >> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] conn(0x7f8ca006c770 0x7f8ca006eb80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:46.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.006+0000 7f8cb6ffd640 1 -- 172.21.15.45:0/3494468614 <== osd.6 v2:172.21.15.79:6819/1486010128 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8ca006f230 con 0x7f8ca006c770 2023-10-03T19:21:46.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.018+0000 7f8cc4c21640 1 -- 172.21.15.45:0/3494468614 --> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8cc00bd9f0 con 0x7f8ca006c770 2023-10-03T19:21:46.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.018+0000 7f8cb6ffd640 1 -- 172.21.15.45:0/3494468614 <== osd.6 v2:172.21.15.79:6819/1486010128 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8cc00bd9f0 con 0x7f8ca006c770 2023-10-03T19:21:46.023 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-03T19:21:46.024 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-03T19:21:46.024 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-03T19:21:46.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.018+0000 7f8cc4c21640 1 -- 172.21.15.45:0/3494468614 >> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] conn(0x7f8ca006c770 msgr2=0x7f8ca006eb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.018+0000 7f8cc4c21640 1 --2- 172.21.15.45:0/3494468614 >> [v2:172.21.15.79:6819/1486010128,v1:172.21.15.79:6820/1486010128] conn(0x7f8ca006c770 0x7f8ca006eb80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.018+0000 7f8cc4c21640 1 -- 172.21.15.45:0/3494468614 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8ca00662b0 msgr2=0x7f8ca0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.018+0000 7f8cc4c21640 1 --2- 172.21.15.45:0/3494468614 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f8ca00662b0 0x7f8ca0068760 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00bb1a0 tx=0x7f8cb0008040 comp rx=0 tx=0).stop 2023-10-03T19:21:46.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.018+0000 7f8cc4c21640 1 -- 172.21.15.45:0/3494468614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cac005180 msgr2=0x7f8cc014fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.018+0000 7f8cc4c21640 1 --2- 172.21.15.45:0/3494468614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cac005180 0x7f8cc014fb50 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f8ca800e4b0 tx=0x7f8ca800e970 comp rx=0 tx=0).stop 2023-10-03T19:21:46.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.018+0000 7f8cbed9d640 1 -- 172.21.15.45:0/3494468614 reap_dead start 2023-10-03T19:21:46.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.018+0000 7f8cc4c21640 1 -- 172.21.15.45:0/3494468614 shutdown_connections 2023-10-03T19:21:46.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.018+0000 7f8cc4c21640 1 -- 172.21.15.45:0/3494468614 >> 172.21.15.45:0/3494468614 conn(0x7f8cc00a20d0 msgr2=0x7f8cc00bb780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:46.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.018+0000 7f8cc4c21640 1 -- 172.21.15.45:0/3494468614 shutdown_connections 2023-10-03T19:21:46.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.018+0000 7f8cc4c21640 1 -- 172.21.15.45:0/3494468614 wait complete. 2023-10-03T19:21:46.040 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-03T19:21:46.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.150+0000 7fc34528f640 1 Processor -- start 2023-10-03T19:21:46.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.150+0000 7fc34528f640 1 -- start start 2023-10-03T19:21:46.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.150+0000 7fc34528f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3400bc8b0 0x7fc34014ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.150+0000 7fc34528f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc34006d170 0x7fc34014cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.150+0000 7fc34528f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc34006cac0 con 0x7fc34006f170 2023-10-03T19:21:46.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.150+0000 7fc34528f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc34014d4f0 con 0x7fc34006d170 2023-10-03T19:21:46.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.150+0000 7fc34528f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3400720d0 con 0x7fc3400bc8b0 2023-10-03T19:21:46.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.150+0000 7fc33f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc34006d170 0x7fc34014cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.150+0000 7fc33f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc34006d170 0x7fc34014cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50044/0 (socket says 172.21.15.45:50044) 2023-10-03T19:21:46.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.150+0000 7fc33f7fe640 1 -- 172.21.15.45:0/3275838228 learned_addr learned my addr 172.21.15.45:0/3275838228 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:46.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.150+0000 7fc33e7fc640 1 --2- 172.21.15.45:0/3275838228 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3400bc8b0 0x7fc34014ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.150+0000 7fc33f7fe640 1 -- 172.21.15.45:0/3275838228 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3400bc8b0 msgr2=0x7fc34014ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:46.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.150+0000 7fc33f7fe640 1 --2- 172.21.15.45:0/3275838228 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3400bc8b0 0x7fc34014ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.150+0000 7fc33f7fe640 1 -- 172.21.15.45:0/3275838228 >> v1:172.21.15.79:6789/0 conn(0x7fc34006f170 legacy=0x7fc340150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.150+0000 7fc33f7fe640 1 -- 172.21.15.45:0/3275838228 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3400a5ab0 con 0x7fc34006d170 2023-10-03T19:21:46.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.154+0000 7fc33f7fe640 1 --2- 172.21.15.45:0/3275838228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc34006d170 0x7fc34014cfb0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fc338009e50 tx=0x7fc33801f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6bd1ba3d7d2562a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:46.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.154+0000 7fc33dffb640 1 -- 172.21.15.45:0/3275838228 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3380af400 con 0x7fc34006d170 2023-10-03T19:21:46.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.154+0000 7fc33dffb640 1 -- 172.21.15.45:0/3275838228 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3380ab050 con 0x7fc34006d170 2023-10-03T19:21:46.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.154+0000 7fc33dffb640 1 -- 172.21.15.45:0/3275838228 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3380af780 con 0x7fc34006d170 2023-10-03T19:21:46.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.154+0000 7fc34528f640 1 -- 172.21.15.45:0/3275838228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc34006d170 msgr2=0x7fc34014cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.154+0000 7fc34528f640 1 --2- 172.21.15.45:0/3275838228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc34006d170 0x7fc34014cfb0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fc338009e50 tx=0x7fc33801f1f0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.154+0000 7fc34528f640 1 -- 172.21.15.45:0/3275838228 shutdown_connections 2023-10-03T19:21:46.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.154+0000 7fc34528f640 1 --2- 172.21.15.45:0/3275838228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc34006d170 0x7fc34014cfb0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.154+0000 7fc34528f640 1 --2- 172.21.15.45:0/3275838228 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3400bc8b0 0x7fc34014ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.154+0000 7fc34528f640 1 -- 172.21.15.45:0/3275838228 >> 172.21.15.45:0/3275838228 conn(0x7fc3400bcf50 msgr2=0x7fc3400bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:46.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.154+0000 7fc34528f640 1 -- 172.21.15.45:0/3275838228 shutdown_connections 2023-10-03T19:21:46.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.154+0000 7fc34528f640 1 -- 172.21.15.45:0/3275838228 wait complete. 2023-10-03T19:21:46.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.158+0000 7fc34528f640 1 Processor -- start 2023-10-03T19:21:46.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.158+0000 7fc34528f640 1 -- start start 2023-10-03T19:21:46.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.158+0000 7fc34528f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc34006d170 0x7fc34014a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.158+0000 7fc34528f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc34006f170 0x7fc340145530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.158+0000 7fc34528f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3400bc8b0 0x7fc340145a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.158+0000 7fc34528f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3401467d0 con 0x7fc34006f170 2023-10-03T19:21:46.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.158+0000 7fc34528f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3401477d0 con 0x7fc3400bc8b0 2023-10-03T19:21:46.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.158+0000 7fc34528f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc340143930 con 0x7fc34006d170 2023-10-03T19:21:46.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.158+0000 7fc33e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc34006f170 0x7fc340145530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.158+0000 7fc33e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc34006f170 0x7fc340145530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50048/0 (socket says 172.21.15.45:50048) 2023-10-03T19:21:46.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.158+0000 7fc33e7fc640 1 -- 172.21.15.45:0/843245726 learned_addr learned my addr 172.21.15.45:0/843245726 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:46.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.158+0000 7fc33f7fe640 1 --2- 172.21.15.45:0/843245726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3400bc8b0 0x7fc340145a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.158+0000 7fc33effd640 1 --2- 172.21.15.45:0/843245726 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc34006d170 0x7fc34014a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.158+0000 7fc33e7fc640 1 -- 172.21.15.45:0/843245726 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc34006d170 msgr2=0x7fc34014a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.158+0000 7fc33e7fc640 1 --2- 172.21.15.45:0/843245726 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc34006d170 0x7fc34014a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.158+0000 7fc33e7fc640 1 -- 172.21.15.45:0/843245726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3400bc8b0 msgr2=0x7fc340145a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.158+0000 7fc33e7fc640 1 --2- 172.21.15.45:0/843245726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3400bc8b0 0x7fc340145a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.158+0000 7fc33e7fc640 1 -- 172.21.15.45:0/843245726 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc338009b30 con 0x7fc34006f170 2023-10-03T19:21:46.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.158+0000 7fc33effd640 1 --2- 172.21.15.45:0/843245726 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc34006d170 0x7fc34014a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:21:46.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.158+0000 7fc33e7fc640 1 --2- 172.21.15.45:0/843245726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc34006f170 0x7fc340145530 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fc33400d800 tx=0x7fc33400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:46.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.158+0000 7fc3277fe640 1 -- 172.21.15.45:0/843245726 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33400b6c0 con 0x7fc34006f170 2023-10-03T19:21:46.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.158+0000 7fc3277fe640 1 -- 172.21.15.45:0/843245726 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33400b820 con 0x7fc34006f170 2023-10-03T19:21:46.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.158+0000 7fc3277fe640 1 -- 172.21.15.45:0/843245726 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33400bb90 con 0x7fc34006f170 2023-10-03T19:21:46.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.158+0000 7fc34528f640 1 -- 172.21.15.45:0/843245726 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc34014fae0 con 0x7fc34006f170 2023-10-03T19:21:46.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.158+0000 7fc34528f640 1 -- 172.21.15.45:0/843245726 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc34006cd00 con 0x7fc34006f170 2023-10-03T19:21:46.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.158+0000 7fc34528f640 1 -- 172.21.15.45:0/843245726 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc34014c4a0 con 0x7fc34006f170 2023-10-03T19:21:46.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.158+0000 7fc3277fe640 1 -- 172.21.15.45:0/843245726 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc33400bcf0 con 0x7fc34006f170 2023-10-03T19:21:46.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.158+0000 7fc3277fe640 1 --2- 172.21.15.45:0/843245726 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc32c0662b0 0x7fc32c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.162+0000 7fc3277fe640 1 -- 172.21.15.45:0/843245726 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fc334083f20 con 0x7fc34006f170 2023-10-03T19:21:46.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.162+0000 7fc33effd640 1 --2- 172.21.15.45:0/843245726 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc32c0662b0 0x7fc32c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.162+0000 7fc33effd640 1 --2- 172.21.15.45:0/843245726 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc32c0662b0 0x7fc32c068760 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fc330000f70 tx=0x7fc330009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:46.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.166+0000 7fc3277fe640 1 -- 172.21.15.45:0/843245726 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc334051660 con 0x7fc34006f170 2023-10-03T19:21:46.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.318+0000 7fc34528f640 1 -- 172.21.15.45:0/843245726 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fc34006d660 con 0x7fc32c0662b0 2023-10-03T19:21:46.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.318+0000 7fc3277fe640 1 -- 172.21.15.45:0/843245726 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc34006d660 con 0x7fc32c0662b0 2023-10-03T19:21:46.323 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 6 to deep-scrub 2023-10-03T19:21:46.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.318+0000 7fc34528f640 1 -- 172.21.15.45:0/843245726 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc32c0662b0 msgr2=0x7fc32c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.318+0000 7fc34528f640 1 --2- 172.21.15.45:0/843245726 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc32c0662b0 0x7fc32c068760 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fc330000f70 tx=0x7fc330009040 comp rx=0 tx=0).stop 2023-10-03T19:21:46.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.318+0000 7fc34528f640 1 -- 172.21.15.45:0/843245726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc34006f170 msgr2=0x7fc340145530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.318+0000 7fc34528f640 1 --2- 172.21.15.45:0/843245726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc34006f170 0x7fc340145530 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fc33400d800 tx=0x7fc33400dcc0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.318+0000 7fc34528f640 1 -- 172.21.15.45:0/843245726 shutdown_connections 2023-10-03T19:21:46.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.318+0000 7fc34528f640 1 --2- 172.21.15.45:0/843245726 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fc32c0662b0 0x7fc32c068760 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.318+0000 7fc34528f640 1 --2- 172.21.15.45:0/843245726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3400bc8b0 0x7fc340145a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.318+0000 7fc34528f640 1 --2- 172.21.15.45:0/843245726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc34006f170 0x7fc340145530 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.318+0000 7fc34528f640 1 --2- 172.21.15.45:0/843245726 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc34006d170 0x7fc34014a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.318+0000 7fc34528f640 1 -- 172.21.15.45:0/843245726 >> 172.21.15.45:0/843245726 conn(0x7fc3400bcf50 msgr2=0x7fc3400b98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:46.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.318+0000 7fc34528f640 1 -- 172.21.15.45:0/843245726 shutdown_connections 2023-10-03T19:21:46.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.318+0000 7fc34528f640 1 -- 172.21.15.45:0/843245726 wait complete. 2023-10-03T19:21:46.342 INFO:tasks.ceph:Scrubbing osd.7 2023-10-03T19:21:46.342 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-03T19:21:46.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.470+0000 7f98f016a640 1 Processor -- start 2023-10-03T19:21:46.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.470+0000 7f98f016a640 1 -- start start 2023-10-03T19:21:46.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.474+0000 7f98f016a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98e80bf1f0 0x7f98e80a9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.474+0000 7f98f016a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f98e80c2770 0x7f98e80a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.474+0000 7f98f016a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e806ac70 con 0x7f98e80c14e0 2023-10-03T19:21:46.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.474+0000 7f98f016a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e806aae0 con 0x7f98e80c2770 2023-10-03T19:21:46.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.474+0000 7f98f016a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e80c3000 con 0x7f98e80bf1f0 2023-10-03T19:21:46.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.474+0000 7f98ee707640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f98e80c2770 0x7f98e80a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.474+0000 7f98ed705640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98e80bf1f0 0x7f98e80a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.474+0000 7f98edf06640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f98e80c14e0 0x7f98e80c0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:52730/0 (socket says 172.21.15.45:52730) 2023-10-03T19:21:46.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.474+0000 7f98edf06640 1 -- 172.21.15.45:0/193311030 learned_addr learned my addr 172.21.15.45:0/193311030 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:21:46.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.474+0000 7f98ee707640 1 -- 172.21.15.45:0/193311030 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98e80bf1f0 msgr2=0x7f98e80a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:46.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.474+0000 7f98ee707640 1 --2- 172.21.15.45:0/193311030 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98e80bf1f0 0x7f98e80a9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.474+0000 7f98ee707640 1 -- 172.21.15.45:0/193311030 >> v1:172.21.15.79:6789/0 conn(0x7f98e80c14e0 legacy=0x7f98e80c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.474+0000 7f98ee707640 1 -- 172.21.15.45:0/193311030 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e80aa5f0 con 0x7f98e80c2770 2023-10-03T19:21:46.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.474+0000 7f98ee707640 1 --2- 172.21.15.45:0/193311030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98e80c2770 0x7f98e80a9da0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f98e00097c0 tx=0x7f98e001ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=211bfa55e330c279 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:46.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.474+0000 7f98ecf04640 1 -- 172.21.15.45:0/193311030 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e00a8970 con 0x7f98e80c2770 2023-10-03T19:21:46.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.474+0000 7f98ecf04640 1 -- 172.21.15.45:0/193311030 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e00a8ad0 con 0x7f98e80c2770 2023-10-03T19:21:46.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.474+0000 7f98ecf04640 1 -- 172.21.15.45:0/193311030 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e00a8e60 con 0x7f98e80c2770 2023-10-03T19:21:46.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.478+0000 7f98f016a640 1 -- 172.21.15.45:0/193311030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98e80c2770 msgr2=0x7f98e80a9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.478+0000 7f98f016a640 1 --2- 172.21.15.45:0/193311030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98e80c2770 0x7f98e80a9da0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f98e00097c0 tx=0x7f98e001ec70 comp rx=0 tx=0).stop 2023-10-03T19:21:46.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.478+0000 7f98f016a640 1 -- 172.21.15.45:0/193311030 shutdown_connections 2023-10-03T19:21:46.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.478+0000 7f98f016a640 1 --2- 172.21.15.45:0/193311030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98e80c2770 0x7f98e80a9da0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.478+0000 7f98f016a640 1 --2- 172.21.15.45:0/193311030 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98e80bf1f0 0x7f98e80a9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.478+0000 7f98f016a640 1 -- 172.21.15.45:0/193311030 >> 172.21.15.45:0/193311030 conn(0x7f98e80a6440 msgr2=0x7f98e80a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:46.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.478+0000 7f98f016a640 1 -- 172.21.15.45:0/193311030 shutdown_connections 2023-10-03T19:21:46.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.478+0000 7f98f016a640 1 -- 172.21.15.45:0/193311030 wait complete. 2023-10-03T19:21:46.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.478+0000 7f98f016a640 1 Processor -- start 2023-10-03T19:21:46.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.478+0000 7f98f016a640 1 -- start start 2023-10-03T19:21:46.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.478+0000 7f98f016a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98e80bf1f0 0x7f98e80ba7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.478+0000 7f98f016a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98e80c14e0 0x7f98e80a3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.478+0000 7f98f016a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98e80c2770 0x7f98e80a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.478+0000 7f98f016a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e809a4a0 con 0x7f98e80c14e0 2023-10-03T19:21:46.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.478+0000 7f98f016a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e81e3670 con 0x7f98e80bf1f0 2023-10-03T19:21:46.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.478+0000 7f98f016a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e80bb940 con 0x7f98e80c2770 2023-10-03T19:21:46.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.478+0000 7f98ed705640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98e80c14e0 0x7f98e80a3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.478+0000 7f98ed705640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98e80c14e0 0x7f98e80a3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50056/0 (socket says 172.21.15.45:50056) 2023-10-03T19:21:46.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.478+0000 7f98ed705640 1 -- 172.21.15.45:0/1183157221 learned_addr learned my addr 172.21.15.45:0/1183157221 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:46.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.478+0000 7f98ee707640 1 --2- 172.21.15.45:0/1183157221 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98e80c2770 0x7f98e80a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.478+0000 7f98edf06640 1 --2- 172.21.15.45:0/1183157221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98e80bf1f0 0x7f98e80ba7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.478+0000 7f98ed705640 1 -- 172.21.15.45:0/1183157221 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98e80c2770 msgr2=0x7f98e80a37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.478+0000 7f98ed705640 1 --2- 172.21.15.45:0/1183157221 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f98e80c2770 0x7f98e80a37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.478+0000 7f98ed705640 1 -- 172.21.15.45:0/1183157221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98e80bf1f0 msgr2=0x7f98e80ba7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.478+0000 7f98ed705640 1 --2- 172.21.15.45:0/1183157221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98e80bf1f0 0x7f98e80ba7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.478+0000 7f98ed705640 1 -- 172.21.15.45:0/1183157221 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e0009420 con 0x7f98e80c14e0 2023-10-03T19:21:46.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.478+0000 7f98ed705640 1 --2- 172.21.15.45:0/1183157221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98e80c14e0 0x7f98e80a3270 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f98e400efc0 tx=0x7f98e400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:46.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.478+0000 7f98da7fc640 1 -- 172.21.15.45:0/1183157221 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4009be0 con 0x7f98e80c14e0 2023-10-03T19:21:46.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.482+0000 7f98da7fc640 1 -- 172.21.15.45:0/1183157221 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e400f040 con 0x7f98e80c14e0 2023-10-03T19:21:46.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.482+0000 7f98da7fc640 1 -- 172.21.15.45:0/1183157221 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4014680 con 0x7f98e80c14e0 2023-10-03T19:21:46.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.482+0000 7f98f016a640 1 -- 172.21.15.45:0/1183157221 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e814f530 con 0x7f98e80c14e0 2023-10-03T19:21:46.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.482+0000 7f98f016a640 1 -- 172.21.15.45:0/1183157221 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e814f250 con 0x7f98e80c14e0 2023-10-03T19:21:46.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.482+0000 7f98f016a640 1 -- 172.21.15.45:0/1183157221 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f98e806b100 con 0x7f98e80c14e0 2023-10-03T19:21:46.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.482+0000 7f98da7fc640 1 -- 172.21.15.45:0/1183157221 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f98e40147e0 con 0x7f98e80c14e0 2023-10-03T19:21:46.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.482+0000 7f98da7fc640 1 --2- 172.21.15.45:0/1183157221 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f98cc066280 0x7f98cc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.482+0000 7f98da7fc640 1 -- 172.21.15.45:0/1183157221 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f98e4085200 con 0x7f98e80c14e0 2023-10-03T19:21:46.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.482+0000 7f98da7fc640 1 --2- 172.21.15.45:0/1183157221 >> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] conn(0x7f98cc06c740 0x7f98cc06eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.482+0000 7f98da7fc640 1 -- 172.21.15.45:0/1183157221 --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f98cc06f200 con 0x7f98cc06c740 2023-10-03T19:21:46.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.482+0000 7f98da7fc640 1 -- 172.21.15.45:0/1183157221 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98e4085650 con 0x7f98e80c14e0 2023-10-03T19:21:46.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.482+0000 7f98edf06640 1 --2- 172.21.15.45:0/1183157221 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f98cc066280 0x7f98cc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.482+0000 7f98ee707640 1 --2- 172.21.15.45:0/1183157221 >> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] conn(0x7f98cc06c740 0x7f98cc06eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.482+0000 7f98edf06640 1 --2- 172.21.15.45:0/1183157221 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f98cc066280 0x7f98cc068730 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f98dc005890 tx=0x7f98dc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:46.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.482+0000 7f98ee707640 1 --2- 172.21.15.45:0/1183157221 >> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] conn(0x7f98cc06c740 0x7f98cc06eb50 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:46.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.486+0000 7f98da7fc640 1 -- 172.21.15.45:0/1183157221 <== osd.7 v2:172.21.15.79:6818/3323397754 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f98cc06f200 con 0x7f98cc06c740 2023-10-03T19:21:46.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.498+0000 7f98f016a640 1 -- 172.21.15.45:0/1183157221 --> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f98e81e12d0 con 0x7f98cc06c740 2023-10-03T19:21:46.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.498+0000 7f98da7fc640 1 -- 172.21.15.45:0/1183157221 <== osd.7 v2:172.21.15.79:6818/3323397754 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f98e81e12d0 con 0x7f98cc06c740 2023-10-03T19:21:46.504 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-10-03T19:21:46.504 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-03T19:21:46.504 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-10-03T19:21:46.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.498+0000 7f98f016a640 1 -- 172.21.15.45:0/1183157221 >> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] conn(0x7f98cc06c740 msgr2=0x7f98cc06eb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.498+0000 7f98f016a640 1 --2- 172.21.15.45:0/1183157221 >> [v2:172.21.15.79:6818/3323397754,v1:172.21.15.79:6821/3323397754] conn(0x7f98cc06c740 0x7f98cc06eb50 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.498+0000 7f98f016a640 1 -- 172.21.15.45:0/1183157221 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f98cc066280 msgr2=0x7f98cc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.498+0000 7f98f016a640 1 --2- 172.21.15.45:0/1183157221 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f98cc066280 0x7f98cc068730 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f98dc005890 tx=0x7f98dc009040 comp rx=0 tx=0).stop 2023-10-03T19:21:46.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.498+0000 7f98f016a640 1 -- 172.21.15.45:0/1183157221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98e80c14e0 msgr2=0x7f98e80a3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.498+0000 7f98f016a640 1 --2- 172.21.15.45:0/1183157221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98e80c14e0 0x7f98e80a3270 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f98e400efc0 tx=0x7f98e400c490 comp rx=0 tx=0).stop 2023-10-03T19:21:46.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.498+0000 7f98ee707640 1 -- 172.21.15.45:0/1183157221 reap_dead start 2023-10-03T19:21:46.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.498+0000 7f98f016a640 1 -- 172.21.15.45:0/1183157221 shutdown_connections 2023-10-03T19:21:46.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.498+0000 7f98f016a640 1 -- 172.21.15.45:0/1183157221 >> 172.21.15.45:0/1183157221 conn(0x7f98e80a6440 msgr2=0x7f98e80c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:46.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.498+0000 7f98f016a640 1 -- 172.21.15.45:0/1183157221 shutdown_connections 2023-10-03T19:21:46.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.498+0000 7f98f016a640 1 -- 172.21.15.45:0/1183157221 wait complete. 2023-10-03T19:21:46.521 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-03T19:21:46.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f254706f640 1 Processor -- start 2023-10-03T19:21:46.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f254706f640 1 -- start start 2023-10-03T19:21:46.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f254706f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f25400a71d0 0x7f254006a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f254706f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2540070d60 con 0x7f25400bce80 2023-10-03T19:21:46.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f254706f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2540070880 con 0x7f25400bc550 2023-10-03T19:21:46.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f254706f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25400bc3a0 con 0x7f25400a71d0 2023-10-03T19:21:46.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f253ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f25400bce80 0x7f254014b4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44544/0 (socket says 172.21.15.45:44544) 2023-10-03T19:21:46.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f253ffff640 1 -- 172.21.15.45:0/270281342 learned_addr learned my addr 172.21.15.45:0/270281342 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:21:46.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f2544e0b640 1 --2- 172.21.15.45:0/270281342 >> v2:172.21.15.79:3300/0 conn(0x7f25400a71d0 0x7f254006a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f253f7fe640 1 -- 172.21.15.45:0/270281342 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1671502616 0 0) 0x7f2540070d60 con 0x7f25400bce80 2023-10-03T19:21:46.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f253f7fe640 1 -- 172.21.15.45:0/270281342 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2528005740 con 0x7f25400bce80 2023-10-03T19:21:46.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f253f7fe640 1 -- 172.21.15.45:0/270281342 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2676045488 0 0) 0x7f2528005740 con 0x7f25400bce80 2023-10-03T19:21:46.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f253f7fe640 1 -- 172.21.15.45:0/270281342 >> v2:172.21.15.79:3300/0 conn(0x7f25400a71d0 msgr2=0x7f254006a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:46.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f253f7fe640 1 --2- 172.21.15.45:0/270281342 >> v2:172.21.15.79:3300/0 conn(0x7f25400a71d0 0x7f254006a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f253f7fe640 1 -- 172.21.15.45:0/270281342 >> v1:172.21.15.79:6789/0 conn(0x7f25400bc550 legacy=0x7f254014bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f253f7fe640 1 -- 172.21.15.45:0/270281342 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2540071900 con 0x7f25400bce80 2023-10-03T19:21:46.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f253f7fe640 1 -- 172.21.15.45:0/270281342 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f2534001680 con 0x7f25400bce80 2023-10-03T19:21:46.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f253f7fe640 1 -- 172.21.15.45:0/270281342 >> v1:172.21.15.45:6789/0 conn(0x7f25400bce80 legacy=0x7f254014b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f253f7fe640 1 --2- 172.21.15.45:0/270281342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2528005b90 0x7f2528005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f253f7fe640 1 --2- 172.21.15.45:0/270281342 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f25280069e0 0x7f2528006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f253f7fe640 1 --2- 172.21.15.45:0/270281342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2528007390 0x7f252800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f253f7fe640 1 -- 172.21.15.45:0/270281342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25400bc3a0 con 0x7f2528007390 2023-10-03T19:21:46.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f253f7fe640 1 -- 172.21.15.45:0/270281342 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252800e1f0 con 0x7f2528005b90 2023-10-03T19:21:46.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f253f7fe640 1 -- 172.21.15.45:0/270281342 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f252800e3b0 con 0x7f25280069e0 2023-10-03T19:21:46.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f254560c640 1 --2- 172.21.15.45:0/270281342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2528007390 0x7f252800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f2544e0b640 1 --2- 172.21.15.45:0/270281342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2528005b90 0x7f2528005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f253ffff640 1 --2- 172.21.15.45:0/270281342 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f25280069e0 0x7f2528006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f254560c640 1 -- 172.21.15.45:0/270281342 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f25280069e0 msgr2=0x7f2528006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:46.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f254560c640 1 --2- 172.21.15.45:0/270281342 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f25280069e0 0x7f2528006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f254560c640 1 -- 172.21.15.45:0/270281342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2528005b90 msgr2=0x7f2528005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:46.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f254560c640 1 --2- 172.21.15.45:0/270281342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2528005b90 0x7f2528005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.634+0000 7f254560c640 1 -- 172.21.15.45:0/270281342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2528005740 con 0x7f2528007390 2023-10-03T19:21:46.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.638+0000 7f254560c640 1 -- 172.21.15.45:0/270281342 reap_dead start 2023-10-03T19:21:46.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.638+0000 7f254560c640 1 --2- 172.21.15.45:0/270281342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2528007390 0x7f252800dba0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f2538001e70 tx=0x7f253801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abded7f536ef894e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:46.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.638+0000 7f253f7fe640 1 -- 172.21.15.45:0/270281342 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2538003b80 con 0x7f2528007390 2023-10-03T19:21:46.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.638+0000 7f253f7fe640 1 -- 172.21.15.45:0/270281342 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2538003d20 con 0x7f2528007390 2023-10-03T19:21:46.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.638+0000 7f253f7fe640 1 -- 172.21.15.45:0/270281342 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2538005260 con 0x7f2528007390 2023-10-03T19:21:46.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.638+0000 7f254706f640 1 -- 172.21.15.45:0/270281342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2528007390 msgr2=0x7f252800dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.638+0000 7f254706f640 1 --2- 172.21.15.45:0/270281342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2528007390 0x7f252800dba0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f2538001e70 tx=0x7f253801c760 comp rx=0 tx=0).stop 2023-10-03T19:21:46.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.638+0000 7f254706f640 1 -- 172.21.15.45:0/270281342 shutdown_connections 2023-10-03T19:21:46.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.638+0000 7f254706f640 1 --2- 172.21.15.45:0/270281342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2528007390 0x7f252800dba0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.638+0000 7f254706f640 1 -- 172.21.15.45:0/270281342 >> 172.21.15.45:0/270281342 conn(0x7f25400bed00 msgr2=0x7f254006d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:46.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.638+0000 7f254706f640 1 -- 172.21.15.45:0/270281342 shutdown_connections 2023-10-03T19:21:46.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.638+0000 7f254706f640 1 -- 172.21.15.45:0/270281342 wait complete. 2023-10-03T19:21:46.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.638+0000 7f254706f640 1 Processor -- start 2023-10-03T19:21:46.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.638+0000 7f254706f640 1 -- start start 2023-10-03T19:21:46.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.642+0000 7f254706f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2528007390 0x7f254006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.642+0000 7f254706f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f254014c830 0x7f25400a2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.642+0000 7f254706f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25400a6990 0x7f25401e6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.642+0000 7f254706f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25401e33e0 con 0x7f2528007390 2023-10-03T19:21:46.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.642+0000 7f254706f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25401457b0 con 0x7f25400a6990 2023-10-03T19:21:46.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.642+0000 7f254706f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2540145e90 con 0x7f254014c830 2023-10-03T19:21:46.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.642+0000 7f2544e0b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2528007390 0x7f254006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.642+0000 7f2544e0b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2528007390 0x7f254006d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50064/0 (socket says 172.21.15.45:50064) 2023-10-03T19:21:46.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.642+0000 7f2544e0b640 1 -- 172.21.15.45:0/2514995705 learned_addr learned my addr 172.21.15.45:0/2514995705 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:46.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.642+0000 7f253ffff640 1 --2- 172.21.15.45:0/2514995705 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f254014c830 0x7f25400a2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.642+0000 7f254560c640 1 --2- 172.21.15.45:0/2514995705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25400a6990 0x7f25401e6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.642+0000 7f2544e0b640 1 -- 172.21.15.45:0/2514995705 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f254014c830 msgr2=0x7f25400a2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.642+0000 7f2544e0b640 1 --2- 172.21.15.45:0/2514995705 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f254014c830 0x7f25400a2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.642+0000 7f2544e0b640 1 -- 172.21.15.45:0/2514995705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25400a6990 msgr2=0x7f25401e6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.642+0000 7f2544e0b640 1 --2- 172.21.15.45:0/2514995705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25400a6990 0x7f25401e6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.642+0000 7f2544e0b640 1 -- 172.21.15.45:0/2514995705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25400a75a0 con 0x7f2528007390 2023-10-03T19:21:46.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.642+0000 7f253ffff640 1 --2- 172.21.15.45:0/2514995705 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f254014c830 0x7f25400a2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:21:46.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.642+0000 7f2544e0b640 1 --2- 172.21.15.45:0/2514995705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2528007390 0x7f254006d5d0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f2530011590 tx=0x7f2530011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:46.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.642+0000 7f253d7fa640 1 -- 172.21.15.45:0/2514995705 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2530015930 con 0x7f2528007390 2023-10-03T19:21:46.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.642+0000 7f253d7fa640 1 -- 172.21.15.45:0/2514995705 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2530015a90 con 0x7f2528007390 2023-10-03T19:21:46.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.642+0000 7f254706f640 1 -- 172.21.15.45:0/2514995705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2540071be0 con 0x7f2528007390 2023-10-03T19:21:46.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.642+0000 7f253d7fa640 1 -- 172.21.15.45:0/2514995705 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2530015e20 con 0x7f2528007390 2023-10-03T19:21:46.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.642+0000 7f254706f640 1 -- 172.21.15.45:0/2514995705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25400bc000 con 0x7f2528007390 2023-10-03T19:21:46.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.642+0000 7f254706f640 1 -- 172.21.15.45:0/2514995705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25401e6a80 con 0x7f2528007390 2023-10-03T19:21:46.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.642+0000 7f253d7fa640 1 -- 172.21.15.45:0/2514995705 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f253000f460 con 0x7f2528007390 2023-10-03T19:21:46.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.642+0000 7f253d7fa640 1 --2- 172.21.15.45:0/2514995705 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f252c066280 0x7f252c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.642+0000 7f253d7fa640 1 -- 172.21.15.45:0/2514995705 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f2530084230 con 0x7f2528007390 2023-10-03T19:21:46.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.642+0000 7f253ffff640 1 --2- 172.21.15.45:0/2514995705 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f252c066280 0x7f252c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.646+0000 7f253ffff640 1 --2- 172.21.15.45:0/2514995705 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f252c066280 0x7f252c068730 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2534001210 tx=0x7f2534000f80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:46.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.646+0000 7f253d7fa640 1 -- 172.21.15.45:0/2514995705 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2530055410 con 0x7f2528007390 2023-10-03T19:21:46.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.802+0000 7f254706f640 1 -- 172.21.15.45:0/2514995705 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f254004de80 con 0x7f252c066280 2023-10-03T19:21:46.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.802+0000 7f253d7fa640 1 -- 172.21.15.45:0/2514995705 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f254004de80 con 0x7f252c066280 2023-10-03T19:21:46.808 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 7 to deep-scrub 2023-10-03T19:21:46.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.806+0000 7f254706f640 1 -- 172.21.15.45:0/2514995705 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f252c066280 msgr2=0x7f252c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.806+0000 7f254706f640 1 --2- 172.21.15.45:0/2514995705 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f252c066280 0x7f252c068730 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2534001210 tx=0x7f2534000f80 comp rx=0 tx=0).stop 2023-10-03T19:21:46.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.806+0000 7f254706f640 1 -- 172.21.15.45:0/2514995705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2528007390 msgr2=0x7f254006d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.806+0000 7f254706f640 1 --2- 172.21.15.45:0/2514995705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2528007390 0x7f254006d5d0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f2530011590 tx=0x7f2530011a50 comp rx=0 tx=0).stop 2023-10-03T19:21:46.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.806+0000 7f254706f640 1 -- 172.21.15.45:0/2514995705 shutdown_connections 2023-10-03T19:21:46.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.806+0000 7f254706f640 1 --2- 172.21.15.45:0/2514995705 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f252c066280 0x7f252c068730 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.806+0000 7f254706f640 1 --2- 172.21.15.45:0/2514995705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25400a6990 0x7f25401e6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.806+0000 7f254706f640 1 --2- 172.21.15.45:0/2514995705 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f254014c830 0x7f25400a2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.806+0000 7f254706f640 1 --2- 172.21.15.45:0/2514995705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2528007390 0x7f254006d5d0 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.806+0000 7f254706f640 1 -- 172.21.15.45:0/2514995705 >> 172.21.15.45:0/2514995705 conn(0x7f25400bed00 msgr2=0x7f25400c0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:46.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.806+0000 7f254706f640 1 -- 172.21.15.45:0/2514995705 shutdown_connections 2023-10-03T19:21:46.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.806+0000 7f254706f640 1 -- 172.21.15.45:0/2514995705 wait complete. 2023-10-03T19:21:46.825 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:21:46.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.946+0000 7fab59078640 1 Processor -- start 2023-10-03T19:21:46.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.946+0000 7fab59078640 1 -- start start 2023-10-03T19:21:46.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.946+0000 7fab59078640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fab540bff30 0x7fab540bc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.946+0000 7fab59078640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fab540bd130 0x7fab540bf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.946+0000 7fab59078640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab540bc0b0 con 0x7fab540bcb20 2023-10-03T19:21:46.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.946+0000 7fab59078640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab540bf870 con 0x7fab540bff30 2023-10-03T19:21:46.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.946+0000 7fab59078640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab540bb740 con 0x7fab540bd130 2023-10-03T19:21:46.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.946+0000 7fab52d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fab540bff30 0x7fab540bc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.946+0000 7fab5359e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fab540bd130 0x7fab540bf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.946+0000 7fab52d9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fab540bff30 0x7fab540bc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.45:48276/0 (socket says 172.21.15.45:48276) 2023-10-03T19:21:46.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.946+0000 7fab52d9d640 1 -- 172.21.15.45:0/4219774920 learned_addr learned my addr 172.21.15.45:0/4219774920 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:46.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.946+0000 7fab4bfff640 1 --1- 172.21.15.45:0/4219774920 >> v1:172.21.15.79:6789/0 conn(0x7fab540bcb20 0x7fab540bec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.45:52742/0 (socket says 172.21.15.45:52742) 2023-10-03T19:21:46.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.946+0000 7fab52d9d640 1 -- 172.21.15.45:0/4219774920 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fab540bd130 msgr2=0x7fab540bf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:21:46.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.946+0000 7fab52d9d640 1 --2- 172.21.15.45:0/4219774920 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fab540bd130 0x7fab540bf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.946+0000 7fab52d9d640 1 -- 172.21.15.45:0/4219774920 >> v1:172.21.15.79:6789/0 conn(0x7fab540bcb20 legacy=0x7fab540bec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.946+0000 7fab52d9d640 1 -- 172.21.15.45:0/4219774920 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab540bba20 con 0x7fab540bff30 2023-10-03T19:21:46.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.950+0000 7fab52d9d640 1 --2- 172.21.15.45:0/4219774920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab540bff30 0x7fab540bc5e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fab44009870 tx=0x7fab4401c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2711303096a16ae4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:46.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.950+0000 7fab5259c640 1 -- 172.21.15.45:0/4219774920 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab440a95f0 con 0x7fab540bff30 2023-10-03T19:21:46.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.950+0000 7fab5259c640 1 -- 172.21.15.45:0/4219774920 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab440a9750 con 0x7fab540bff30 2023-10-03T19:21:46.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.950+0000 7fab5259c640 1 -- 172.21.15.45:0/4219774920 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab440a9ae0 con 0x7fab540bff30 2023-10-03T19:21:46.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.950+0000 7fab59078640 1 -- 172.21.15.45:0/4219774920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab540bff30 msgr2=0x7fab540bc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.950+0000 7fab59078640 1 --2- 172.21.15.45:0/4219774920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab540bff30 0x7fab540bc5e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fab44009870 tx=0x7fab4401c510 comp rx=0 tx=0).stop 2023-10-03T19:21:46.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.950+0000 7fab59078640 1 -- 172.21.15.45:0/4219774920 shutdown_connections 2023-10-03T19:21:46.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.950+0000 7fab59078640 1 --2- 172.21.15.45:0/4219774920 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fab540bd130 0x7fab540bf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.950+0000 7fab59078640 1 --2- 172.21.15.45:0/4219774920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab540bff30 0x7fab540bc5e0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.950+0000 7fab59078640 1 -- 172.21.15.45:0/4219774920 >> 172.21.15.45:0/4219774920 conn(0x7fab540c0d20 msgr2=0x7fab540c1120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:46.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.950+0000 7fab59078640 1 -- 172.21.15.45:0/4219774920 shutdown_connections 2023-10-03T19:21:46.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.950+0000 7fab59078640 1 -- 172.21.15.45:0/4219774920 wait complete. 2023-10-03T19:21:46.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.950+0000 7fab59078640 1 Processor -- start 2023-10-03T19:21:46.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.950+0000 7fab59078640 1 -- start start 2023-10-03T19:21:46.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.954+0000 7fab59078640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab540bcb20 0x7fab54142cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.954+0000 7fab59078640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fab540bd130 0x7fab54140ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.954+0000 7fab59078640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab540bff30 0x7fab54141020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.954+0000 7fab59078640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab54141560 con 0x7fab540bcb20 2023-10-03T19:21:46.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.954+0000 7fab59078640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab54143210 con 0x7fab540bff30 2023-10-03T19:21:46.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.954+0000 7fab59078640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab54143a70 con 0x7fab540bd130 2023-10-03T19:21:46.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.954+0000 7fab52d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab540bcb20 0x7fab54142cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.954+0000 7fab52d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab540bcb20 0x7fab54142cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50080/0 (socket says 172.21.15.45:50080) 2023-10-03T19:21:46.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.954+0000 7fab52d9d640 1 -- 172.21.15.45:0/1563117505 learned_addr learned my addr 172.21.15.45:0/1563117505 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:21:46.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.954+0000 7fab4bfff640 1 --2- 172.21.15.45:0/1563117505 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fab540bd130 0x7fab54140ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.954+0000 7fab5359e640 1 --2- 172.21.15.45:0/1563117505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab540bff30 0x7fab54141020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.954+0000 7fab52d9d640 1 -- 172.21.15.45:0/1563117505 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fab540bd130 msgr2=0x7fab54140ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.954+0000 7fab52d9d640 1 --2- 172.21.15.45:0/1563117505 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fab540bd130 0x7fab54140ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.954+0000 7fab52d9d640 1 -- 172.21.15.45:0/1563117505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab540bff30 msgr2=0x7fab54141020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:46.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.954+0000 7fab52d9d640 1 --2- 172.21.15.45:0/1563117505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab540bff30 0x7fab54141020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:46.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.954+0000 7fab52d9d640 1 -- 172.21.15.45:0/1563117505 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab440094d0 con 0x7fab540bcb20 2023-10-03T19:21:46.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.954+0000 7fab4bfff640 1 --2- 172.21.15.45:0/1563117505 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fab540bd130 0x7fab54140ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:21:46.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.954+0000 7fab5359e640 1 --2- 172.21.15.45:0/1563117505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab540bff30 0x7fab54141020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T19:21:46.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.954+0000 7fab52d9d640 1 --2- 172.21.15.45:0/1563117505 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab540bcb20 0x7fab54142cd0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fab440ab040 tx=0x7fab4401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:46.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.954+0000 7fab4b7fe640 1 -- 172.21.15.45:0/1563117505 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab440b1800 con 0x7fab540bcb20 2023-10-03T19:21:46.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.954+0000 7fab4b7fe640 1 -- 172.21.15.45:0/1563117505 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab440b1960 con 0x7fab540bcb20 2023-10-03T19:21:46.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.954+0000 7fab4b7fe640 1 -- 172.21.15.45:0/1563117505 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab440b1d10 con 0x7fab540bcb20 2023-10-03T19:21:46.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.954+0000 7fab59078640 1 -- 172.21.15.45:0/1563117505 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab54159580 con 0x7fab540bcb20 2023-10-03T19:21:46.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.954+0000 7fab59078640 1 -- 172.21.15.45:0/1563117505 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab540bbd40 con 0x7fab540bcb20 2023-10-03T19:21:46.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.954+0000 7fab59078640 1 -- 172.21.15.45:0/1563117505 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab54159710 con 0x7fab540bcb20 2023-10-03T19:21:46.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.954+0000 7fab4b7fe640 1 -- 172.21.15.45:0/1563117505 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fab440bc450 con 0x7fab540bcb20 2023-10-03T19:21:46.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.954+0000 7fab4b7fe640 1 --2- 172.21.15.45:0/1563117505 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fab340662b0 0x7fab34068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:21:46.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.954+0000 7fab4b7fe640 1 -- 172.21.15.45:0/1563117505 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fab4411e370 con 0x7fab540bcb20 2023-10-03T19:21:46.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.954+0000 7fab4bfff640 1 --2- 172.21.15.45:0/1563117505 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fab340662b0 0x7fab34068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:21:46.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.958+0000 7fab4bfff640 1 --2- 172.21.15.45:0/1563117505 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fab340662b0 0x7fab34068760 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fab540bfe30 tx=0x7fab3c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:21:46.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:46.962+0000 7fab4b7fe640 1 -- 172.21.15.45:0/1563117505 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fab440ebac0 con 0x7fab540bcb20 2023-10-03T19:21:47.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:47.110+0000 7fab59078640 1 -- 172.21.15.45:0/1563117505 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fab541438d0 con 0x7fab340662b0 2023-10-03T19:21:47.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:47.118+0000 7fab4b7fe640 1 -- 172.21.15.45:0/1563117505 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71558 (secure 0 0 0) 0x7fab541438d0 con 0x7fab340662b0 2023-10-03T19:21:47.125 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:21:47.125 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:21:47.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:47.122+0000 7fab59078640 1 -- 172.21.15.45:0/1563117505 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fab340662b0 msgr2=0x7fab34068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:47.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:47.122+0000 7fab59078640 1 --2- 172.21.15.45:0/1563117505 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fab340662b0 0x7fab34068760 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fab540bfe30 tx=0x7fab3c009040 comp rx=0 tx=0).stop 2023-10-03T19:21:47.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:47.122+0000 7fab59078640 1 -- 172.21.15.45:0/1563117505 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab540bcb20 msgr2=0x7fab54142cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:21:47.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:47.122+0000 7fab59078640 1 --2- 172.21.15.45:0/1563117505 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab540bcb20 0x7fab54142cd0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fab440ab040 tx=0x7fab4401ad50 comp rx=0 tx=0).stop 2023-10-03T19:21:47.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:47.122+0000 7fab59078640 1 -- 172.21.15.45:0/1563117505 shutdown_connections 2023-10-03T19:21:47.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:47.122+0000 7fab59078640 1 --2- 172.21.15.45:0/1563117505 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fab340662b0 0x7fab34068760 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:47.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:47.122+0000 7fab59078640 1 --2- 172.21.15.45:0/1563117505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab540bff30 0x7fab54141020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:47.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:47.122+0000 7fab59078640 1 --2- 172.21.15.45:0/1563117505 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fab540bd130 0x7fab54140ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:47.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:47.122+0000 7fab59078640 1 --2- 172.21.15.45:0/1563117505 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab540bcb20 0x7fab54142cd0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:21:47.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:47.122+0000 7fab59078640 1 -- 172.21.15.45:0/1563117505 >> 172.21.15.45:0/1563117505 conn(0x7fab540c0d20 msgr2=0x7fab5414a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:21:47.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:47.122+0000 7fab59078640 1 -- 172.21.15.45:0/1563117505 shutdown_connections 2023-10-03T19:21:47.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:21:47.122+0000 7fab59078640 1 -- 172.21.15.45:0/1563117505 wait complete. 2023-10-03T19:21:47.143 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":391,"stamp":"2023-10-03T19:21:46.647117+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":59,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":236756,"kb_used_data":11092,"kb_used_omap":0,"kb_used_meta":225600,"kb_avail":754737964,"statfs":{"total":773094113280,"available":772851675136,"internally_reserved":0,"allocated":11358208,"data_stored":6330220,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":231014400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.574679"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":343,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-03T19:21:40.044825+0000","last_change":"2023-10-03T19:12:22.328905+0000","last_active":"2023-10-03T19:21:40.044825+0000","last_peered":"2023-10-03T19:21:40.044825+0000","last_clean":"2023-10-03T19:21:40.044825+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:21:40.044825+0000","last_undegraded":"2023-10-03T19:21:40.044825+0000","last_fullsized":"2023-10-03T19:21:40.044825+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:21.282052+0000","last_clean_scrub_stamp":"2023-10-03T19:12:21.282052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T22:10:59.199179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":191,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-03T19:21:39.084076+0000","last_change":"2023-10-03T19:12:23.343178+0000","last_active":"2023-10-03T19:21:39.084076+0000","last_peered":"2023-10-03T19:21:39.084076+0000","last_clean":"2023-10-03T19:21:39.084076+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:21:39.084076+0000","last_undegraded":"2023-10-03T19:21:39.084076+0000","last_fullsized":"2023-10-03T19:21:39.084076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:49:53.311099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":191,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-03T19:21:40.044780+0000","last_change":"2023-10-03T19:12:23.344164+0000","last_active":"2023-10-03T19:21:40.044780+0000","last_peered":"2023-10-03T19:21:40.044780+0000","last_clean":"2023-10-03T19:21:40.044780+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:21:40.044780+0000","last_undegraded":"2023-10-03T19:21:40.044780+0000","last_fullsized":"2023-10-03T19:21:40.044780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:50:29.480346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":187,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-03T19:21:39.069891+0000","last_change":"2023-10-03T19:12:23.343348+0000","last_active":"2023-10-03T19:21:39.069891+0000","last_peered":"2023-10-03T19:21:39.069891+0000","last_clean":"2023-10-03T19:21:39.069891+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:21:39.069891+0000","last_undegraded":"2023-10-03T19:21:39.069891+0000","last_fullsized":"2023-10-03T19:21:39.069891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:06:39.968637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":191,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-03T19:21:39.078681+0000","last_change":"2023-10-03T19:12:23.343631+0000","last_active":"2023-10-03T19:21:39.078681+0000","last_peered":"2023-10-03T19:21:39.078681+0000","last_clean":"2023-10-03T19:21:39.078681+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:21:39.078681+0000","last_undegraded":"2023-10-03T19:21:39.078681+0000","last_fullsized":"2023-10-03T19:21:39.078681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:38:18.672508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":183,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-03T19:21:39.388947+0000","last_change":"2023-10-03T19:12:23.833888+0000","last_active":"2023-10-03T19:21:39.388947+0000","last_peered":"2023-10-03T19:21:39.388947+0000","last_clean":"2023-10-03T19:21:39.388947+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:21:39.388947+0000","last_undegraded":"2023-10-03T19:21:39.388947+0000","last_fullsized":"2023-10-03T19:21:39.388947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:24:15.277446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":191,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-03T19:21:40.050907+0000","last_change":"2023-10-03T19:12:23.834626+0000","last_active":"2023-10-03T19:21:40.050907+0000","last_peered":"2023-10-03T19:21:40.050907+0000","last_clean":"2023-10-03T19:21:40.050907+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:21:40.050907+0000","last_undegraded":"2023-10-03T19:21:40.050907+0000","last_fullsized":"2023-10-03T19:21:40.050907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:12:24.431303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":183,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-03T19:21:39.388323+0000","last_change":"2023-10-03T19:12:23.346869+0000","last_active":"2023-10-03T19:21:39.388323+0000","last_peered":"2023-10-03T19:21:39.388323+0000","last_clean":"2023-10-03T19:21:39.388323+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:21:39.388323+0000","last_undegraded":"2023-10-03T19:21:39.388323+0000","last_fullsized":"2023-10-03T19:21:39.388323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T01:38:47.041436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":185,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-03T19:21:40.049918+0000","last_change":"2023-10-03T19:12:23.341381+0000","last_active":"2023-10-03T19:21:40.049918+0000","last_peered":"2023-10-03T19:21:40.049918+0000","last_clean":"2023-10-03T19:21:40.049918+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:21:40.049918+0000","last_undegraded":"2023-10-03T19:21:40.049918+0000","last_fullsized":"2023-10-03T19:21:40.049918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:12:22.305121+0000","last_clean_scrub_stamp":"2023-10-03T19:12:22.305121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:09:15.406362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509555,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34340,"kb_used_data":1436,"kb_used_omap":0,"kb_used_meta":32896,"kb_avail":94337500,"statfs":{"total":96636764160,"available":96601600000,"internally_reserved":0,"allocated":1470464,"data_stored":1234490,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":33685504},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.88300000000000001,"15min":0.91800000000000004},"min":{"1min":0.65300000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.155,"5min":2.1080000000000001,"15min":4.0469999999999997},"last":1.1319999999999999},{"interface":"front","average":{"1min":0.87,"5min":0.85399999999999998,"15min":0.83399999999999996},"min":{"1min":0.53000000000000003,"5min":0.52200000000000002,"15min":0.45000000000000001},"max":{"1min":1.149,"5min":1.2230000000000001,"15min":1.3420000000000001},"last":0.53000000000000003}]},{"osd":1,"last update":"Tue Oct 3 19:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.90100000000000002,"15min":0.97099999999999997},"min":{"1min":0.57299999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.323,"5min":2.298,"15min":3.8239999999999998},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.877},"min":{"1min":0.61599999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.1839999999999999,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.68300000000000005}]},{"osd":2,"last update":"Tue Oct 3 19:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.93100000000000005,"15min":0.90100000000000002},"min":{"1min":0.54300000000000004,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1859999999999999,"5min":4.4779999999999998,"15min":6.0449999999999999},"last":0.875},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.94199999999999995,"15min":1.0009999999999999},"min":{"1min":0.68899999999999995,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1839999999999999,"5min":2.673,"15min":3.98},"last":1.1839999999999999}]},{"osd":3,"last update":"Tue Oct 3 19:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.97799999999999998,"15min":0.96399999999999997},"min":{"1min":0.61199999999999999,"5min":0.54200000000000004,"15min":0.51100000000000001},"max":{"1min":1.1220000000000001,"5min":4.3650000000000002,"15min":6.125},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.97099999999999997,"15min":1.0629999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.371,"5min":1.593,"15min":3.9140000000000001},"last":0.95899999999999996}]},{"osd":4,"last update":"Tue Oct 3 19:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.90900000000000003,"15min":1.056},"min":{"1min":0.621,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1579999999999999,"5min":2.4769999999999999,"15min":5.1130000000000004},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.081,"15min":1.0449999999999999},"min":{"1min":0.70399999999999996,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1699999999999999,"5min":12.196999999999999,"15min":12.196999999999999},"last":0.70399999999999996}]},{"osd":5,"last update":"Tue Oct 3 19:21:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.004,"15min":1.1579999999999999},"min":{"1min":0.68600000000000005,"5min":0.63700000000000001,"15min":0.51300000000000001},"max":{"1min":1.2909999999999999,"5min":2.581,"15min":5.1859999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.024,"15min":1.095},"min":{"1min":0.77500000000000002,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.2230000000000001,"5min":1.6719999999999999,"15min":2.0609999999999999},"last":0.91800000000000004}]},{"osd":6,"last update":"Tue Oct 3 19:21:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.071,"15min":1.089},"min":{"1min":0.78100000000000003,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2410000000000001,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.1180000000000001,"15min":1.1619999999999999},"min":{"1min":0.69199999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.345,"5min":4.5570000000000004,"15min":6.1580000000000004},"last":1.0509999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509555,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":30272,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":1400832,"data_stored":642958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30998528},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.85299999999999998,"15min":0.83099999999999996},"min":{"1min":0.53500000000000003,"5min":0.45400000000000001,"15min":0.44600000000000001},"max":{"1min":1.2130000000000001,"5min":1.3340000000000001,"15min":1.504},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.88300000000000001,"15min":0.88500000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.44600000000000001},"max":{"1min":1.2430000000000001,"5min":1.423,"15min":1.839},"last":0.67800000000000005}]},{"osd":1,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.84699999999999998,"15min":0.84299999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0269999999999999,"5min":1.27,"15min":2.0150000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.877,"15min":0.88},"min":{"1min":0.52800000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.359,"5min":1.448,"15min":1.448},"last":0.98799999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.93999999999999995,"15min":0.89400000000000002},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.51900000000000002},"max":{"1min":1.1830000000000001,"5min":1.528,"15min":1.528},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.871,"5min":0.91800000000000004,"15min":0.92100000000000004},"min":{"1min":0.73299999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.99099999999999999,"5min":1.369,"15min":1.546},"last":0.92200000000000004}]},{"osd":3,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96199999999999997,"15min":0.97699999999999998},"min":{"1min":0.59999999999999998,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.171,"5min":1.377,"15min":1.6990000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.91300000000000003,"15min":0.91000000000000003},"min":{"1min":0.74399999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":2.121},"last":0.88100000000000001}]},{"osd":4,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.92300000000000004,"15min":0.99199999999999999},"min":{"1min":0.77800000000000002,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1850000000000001,"5min":1.339,"15min":1.95},"last":1.1950000000000001},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.0029999999999999,"15min":1.0589999999999999},"min":{"1min":0.77600000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2589999999999999,"5min":1.504,"15min":1.7709999999999999},"last":1.0529999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.90500000000000003,"15min":0.98399999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.26,"5min":1.3200000000000001,"15min":2.2570000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0660000000000001,"15min":1.1000000000000001},"min":{"1min":0.747,"5min":0.70699999999999996,"15min":0.68100000000000005},"max":{"1min":1.296,"5min":1.524,"15min":2.0619999999999998},"last":1.1120000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:20:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.075,"15min":1.105},"min":{"1min":0.84299999999999997,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.3320000000000001,"5min":1.639,"15min":2.0049999999999999},"last":1.165},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0449999999999999,"15min":1.079},"min":{"1min":0.86299999999999999,"5min":0.67600000000000005,"15min":0.61899999999999999},"max":{"1min":1.3360000000000001,"5min":1.4350000000000001,"15min":2.4249999999999998},"last":1.1379999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509556,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26340,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":24960,"kb_avail":94345500,"statfs":{"total":96636764160,"available":96609792000,"internally_reserved":0,"allocated":1404928,"data_stored":644122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25559040},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":1.1000000000000001,"15min":0.90100000000000002},"min":{"1min":0.70399999999999996,"5min":0.58699999999999997,"15min":0.50600000000000001},"max":{"1min":1.1799999999999999,"5min":17.686,"15min":17.686},"last":1.1599999999999999},{"interface":"front","average":{"1min":0.88900000000000001,"5min":1.028,"15min":0.89500000000000002},"min":{"1min":0.67800000000000005,"5min":0.52500000000000002,"15min":0.49299999999999999},"max":{"1min":1.1459999999999999,"5min":16.925999999999998,"15min":16.925999999999998},"last":0.90400000000000003}]},{"osd":1,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.079,"15min":0.97899999999999998},"min":{"1min":0.621,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.3160000000000001,"5min":16.640999999999998,"15min":16.640999999999998},"last":1.1259999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.1060000000000001,"15min":0.94899999999999995},"min":{"1min":0.78800000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.274,"5min":17.59,"15min":17.59},"last":0.76800000000000002}]},{"osd":2,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.004,"15min":0.94999999999999996},"min":{"1min":0.69299999999999995,"5min":0.63500000000000001,"15min":0.53200000000000003},"max":{"1min":1.3360000000000001,"5min":8.5630000000000006,"15min":8.5630000000000006},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.159,"15min":1.0189999999999999},"min":{"1min":0.69899999999999995,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.375,"5min":17.734000000000002,"15min":17.734000000000002},"last":1.04}]},{"osd":3,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":1.101,"15min":0.95499999999999996},"min":{"1min":0.76200000000000001,"5min":0.54500000000000004,"15min":0.53900000000000003},"max":{"1min":1.258,"5min":16.98,"15min":16.98},"last":1.091},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1910000000000001,"15min":1.1040000000000001},"min":{"1min":0.83799999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.238,"5min":16.434000000000001,"15min":16.434000000000001},"last":0.98899999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.143,"15min":1.071},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4990000000000001,"5min":17.782,"15min":17.782},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0029999999999999,"15min":1.004},"min":{"1min":0.72499999999999998,"5min":0.65700000000000003,"15min":0.60899999999999999},"max":{"1min":1.24,"5min":1.708,"15min":1.708},"last":1.2909999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.4550000000000001,"15min":1.2569999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.47,"5min":36.106000000000002,"15min":36.106000000000002},"last":1.218},{"interface":"front","average":{"1min":1.119,"5min":1.2909999999999999,"15min":1.206},"min":{"1min":0.65500000000000003,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.575,"5min":17.646999999999998,"15min":17.646999999999998},"last":1.327}]},{"osd":7,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.2709999999999999,"15min":1.141},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.429,"5min":17.042000000000002,"15min":17.042000000000002},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.347,"15min":1.258},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.6020000000000001,"5min":16.32,"15min":16.32},"last":1.5469999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509556,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33120,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":31744,"kb_avail":94338720,"statfs":{"total":96636764160,"available":96602849280,"internally_reserved":0,"allocated":1400832,"data_stored":642958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":32505856},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.79100000000000004,"15min":0.622},"min":{"1min":0.41399999999999998,"5min":0.32200000000000001,"15min":0.247},"max":{"1min":1.0149999999999999,"5min":13.629,"15min":13.629},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":1.202,"15min":0.81899999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.28999999999999998},"max":{"1min":1.1699999999999999,"5min":40.439,"15min":40.439},"last":0.79700000000000004}]},{"osd":1,"last update":"Tue Oct 3 19:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.88500000000000001,"15min":0.71799999999999997},"min":{"1min":0.35899999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.97999999999999998,"5min":14.074,"15min":14.074},"last":1.137},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.76600000000000001,"15min":0.65600000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.26400000000000001},"max":{"1min":1.002,"5min":7.0060000000000002,"15min":7.0060000000000002},"last":0.69599999999999995}]},{"osd":3,"last update":"Tue Oct 3 19:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.88300000000000001,"15min":0.71799999999999997},"min":{"1min":0.40999999999999998,"5min":0.28899999999999998,"15min":0.224},"max":{"1min":1.0600000000000001,"5min":13.423999999999999,"15min":13.423999999999999},"last":0.748},{"interface":"front","average":{"1min":0.84599999999999997,"5min":1.044,"15min":0.83999999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.36399999999999999},"max":{"1min":1.111,"5min":18.568999999999999,"15min":18.568999999999999},"last":0.998}]},{"osd":4,"last update":"Tue Oct 3 19:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.95499999999999996,"15min":0.88700000000000001},"min":{"1min":0.55500000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.361,"5min":1.718,"15min":1.718},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.333,"15min":1.0600000000000001},"min":{"1min":0.60899999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.3959999999999999,"5min":28.667999999999999,"15min":28.667999999999999},"last":1.256}]},{"osd":5,"last update":"Tue Oct 3 19:20:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.052,"15min":0.93300000000000005},"min":{"1min":0.60799999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.53,"5min":5.4459999999999997,"15min":5.4459999999999997},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.22,"15min":1.042},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.52700000000000002},"max":{"1min":1.5509999999999999,"5min":14.007,"15min":14.007},"last":1.3420000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":1.087,"15min":0.97499999999999998},"min":{"1min":0.64800000000000002,"5min":0.60099999999999998,"15min":0.49099999999999999},"max":{"1min":1.3919999999999999,"5min":10.679,"15min":10.679},"last":1.042},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.0940000000000001,"15min":1.014},"min":{"1min":0.66900000000000004,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.6399999999999999,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.302}]},{"osd":7,"last update":"Tue Oct 3 19:20:40 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.325,"15min":1.1200000000000001},"min":{"1min":0.64200000000000002,"5min":0.63100000000000001,"15min":0.56100000000000005},"max":{"1min":1.6120000000000001,"5min":18.623000000000001,"15min":18.623000000000001},"last":1.454},{"interface":"front","average":{"1min":1.04,"5min":1.0780000000000001,"15min":1.0029999999999999},"min":{"1min":0.68200000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.381,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":1.3939999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509555,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31140,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":29760,"kb_avail":94340700,"statfs":{"total":96636764160,"available":96604876800,"internally_reserved":0,"allocated":1404928,"data_stored":644122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30474240},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57599999999999996,"15min":0.56000000000000005},"min":{"1min":0.34799999999999998,"5min":0.27200000000000002,"15min":0.26900000000000002},"max":{"1min":0.79000000000000004,"5min":0.96899999999999997,"15min":1.0169999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70099999999999996,"15min":0.58499999999999996},"min":{"1min":0.371,"5min":0.27200000000000002,"15min":0.22900000000000001},"max":{"1min":1.01,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.73899999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68100000000000005,"15min":0.59899999999999998},"min":{"1min":0.43099999999999999,"5min":0.30599999999999999,"15min":0.26200000000000001},"max":{"1min":0.92600000000000005,"5min":1.506,"15min":1.506},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79800000000000004,"15min":0.71699999999999997},"min":{"1min":0.48799999999999999,"5min":0.33000000000000002,"15min":0.312},"max":{"1min":1.0640000000000001,"5min":1.365,"15min":1.365},"last":0.91800000000000004}]},{"osd":3,"last update":"Tue Oct 3 19:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.76800000000000002,"15min":0.68600000000000005},"min":{"1min":0.49199999999999999,"5min":0.31,"15min":0.31},"max":{"1min":1.071,"5min":1.329,"15min":1.329},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.75900000000000001,"15min":0.65000000000000002},"min":{"1min":0.504,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.2090000000000001,"5min":1.232,"15min":1.27},"last":0.57999999999999996}]},{"osd":4,"last update":"Tue Oct 3 19:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.89500000000000002,"15min":0.83599999999999997},"min":{"1min":0.67900000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2629999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.036},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.97499999999999998,"15min":0.92200000000000004},"min":{"1min":0.66600000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2430000000000001,"5min":1.728,"15min":1.728},"last":1.0840000000000001}]},{"osd":5,"last update":"Tue Oct 3 19:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96999999999999997,"15min":0.90400000000000003},"min":{"1min":0.72899999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.2410000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.97299999999999998,"15min":0.89700000000000002},"min":{"1min":0.70599999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.218,"5min":1.3959999999999999,"15min":1.6080000000000001},"last":0.84199999999999997}]},{"osd":6,"last update":"Tue Oct 3 19:20:42 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.024,"15min":0.96399999999999997},"min":{"1min":0.71899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.512,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0329999999999999,"15min":0.94599999999999995},"min":{"1min":0.73599999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2569999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.877}]},{"osd":7,"last update":"Tue Oct 3 19:20:42 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.054,"15min":0.98499999999999999},"min":{"1min":0.69299999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.343,"5min":1.673,"15min":1.673},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.036,"15min":0.95399999999999996},"min":{"1min":0.751,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4279999999999999,"5min":1.5880000000000001,"15min":1.649},"last":1.1100000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25828,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":24448,"kb_avail":94346012,"statfs":{"total":96636764160,"available":96610316288,"internally_reserved":0,"allocated":1404928,"data_stored":644122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25034752},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:21:39 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.63800000000000001,"15min":0.60599999999999998},"min":{"1min":0.56100000000000005,"5min":0.221,"15min":0.221},"max":{"1min":1.0169999999999999,"5min":1.1779999999999999,"15min":1.212},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69799999999999995,"15min":0.67100000000000004},"min":{"1min":0.55700000000000005,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.0680000000000001,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.41099999999999998}]},{"osd":1,"last update":"Tue Oct 3 19:21:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.68300000000000005,"15min":0.66200000000000003},"min":{"1min":0.55400000000000005,"5min":0.28599999999999998,"15min":0.27000000000000002},"max":{"1min":1.139,"5min":1.238,"15min":1.238},"last":0.375},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.76100000000000001,"15min":0.71299999999999997},"min":{"1min":0.53800000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.1679999999999999,"5min":1.204,"15min":1.222},"last":0.441}]},{"osd":2,"last update":"Tue Oct 3 19:21:39 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.79200000000000004,"15min":0.751},"min":{"1min":0.54000000000000004,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0840000000000001,"5min":1.23,"15min":1.23},"last":0.502},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.72999999999999998,"15min":0.68000000000000005},"min":{"1min":0.626,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.127,"5min":1.671,"15min":1.671},"last":0.42299999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:21:39 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.74299999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.488,"5min":1.488,"15min":1.496},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.099,"5min":1.01,"15min":0.96899999999999997},"min":{"1min":0.89300000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.58599999999999997}]},{"osd":5,"last update":"Tue Oct 3 19:21:39 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.90900000000000003,"15min":0.89700000000000002},"min":{"1min":0.77500000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1910000000000001,"5min":1.581,"15min":1.581},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0189999999999999,"15min":1.0109999999999999},"min":{"1min":0.73999999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3779999999999999,"5min":1.4399999999999999,"15min":1.498},"last":0.76000000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:21:39 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":0.96599999999999997,"15min":0.94399999999999995},"min":{"1min":0.86499999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2629999999999999,"5min":1.347,"15min":1.347},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.056,"15min":1.022},"min":{"1min":0.78900000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.69899999999999995}]},{"osd":7,"last update":"Tue Oct 3 19:21:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.095,"15min":1.0449999999999999},"min":{"1min":0.82099999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.728,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.042,"15min":1.0369999999999999},"min":{"1min":0.85899999999999999,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.3200000000000001,"5min":1.659,"15min":1.708},"last":0.68200000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574963,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23460,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":22080,"kb_avail":94348380,"statfs":{"total":96636764160,"available":96612741120,"internally_reserved":0,"allocated":1404928,"data_stored":644122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22609920},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.86199999999999999,"15min":0.84299999999999997},"min":{"1min":0.51700000000000002,"5min":0.45100000000000001,"15min":0.437},"max":{"1min":1.2789999999999999,"5min":1.452,"15min":1.452},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.90100000000000002,"15min":0.87},"min":{"1min":0.72199999999999998,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1279999999999999,"5min":1.26,"15min":1.5940000000000001},"last":1.1259999999999999}]},{"osd":1,"last update":"Tue Oct 3 19:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.86899999999999999,"15min":0.84899999999999998},"min":{"1min":0.57599999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.0469999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.89800000000000002,"15min":0.91500000000000004},"min":{"1min":0.70099999999999996,"5min":0.63100000000000001,"15min":0.57099999999999995},"max":{"1min":1.212,"5min":1.23,"15min":1.514},"last":1.1579999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.91600000000000004,"15min":0.90500000000000003},"min":{"1min":0.72299999999999998,"5min":0.55400000000000005,"15min":0.55100000000000005},"max":{"1min":1.3280000000000001,"5min":1.351,"15min":1.3700000000000001},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.93100000000000005,"15min":0.91000000000000003},"min":{"1min":0.68100000000000005,"5min":0.57099999999999995,"15min":0.53300000000000003},"max":{"1min":1.1599999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.65700000000000003}]},{"osd":3,"last update":"Tue Oct 3 19:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.92000000000000004,"15min":0.92600000000000005},"min":{"1min":0.63700000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.196,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.01,"15min":1.024},"min":{"1min":0.86199999999999999,"5min":0.65900000000000003,"15min":0.61199999999999999},"max":{"1min":1.2929999999999999,"5min":1.508,"15min":1.6659999999999999},"last":0.93799999999999994}]},{"osd":4,"last update":"Tue Oct 3 19:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.97799999999999998,"15min":0.97099999999999997},"min":{"1min":0.627,"5min":0.627,"15min":0.47199999999999998},"max":{"1min":1.1870000000000001,"5min":1.4530000000000001,"15min":1.5149999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.95199999999999996,"15min":0.999},"min":{"1min":0.68100000000000005,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2190000000000001,"5min":1.319,"15min":1.7709999999999999},"last":0.76000000000000001}]},{"osd":6,"last update":"Tue Oct 3 19:21:40 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0069999999999999,"15min":1.016},"min":{"1min":0.67800000000000005,"5min":0.64600000000000002,"15min":0.53600000000000003},"max":{"1min":1.421,"5min":1.546,"15min":1.546},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.075,"5min":1.0800000000000001,"15min":1.115},"min":{"1min":0.72099999999999997,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.2569999999999999,"5min":1.4159999999999999,"15min":1.823},"last":1.1970000000000001}]},{"osd":7,"last update":"Tue Oct 3 19:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.04,"15min":1.0620000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.66400000000000003},"max":{"1min":1.4379999999999999,"5min":1.4610000000000001,"15min":1.5680000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1180000000000001,"15min":1.139},"min":{"1min":0.95999999999999996,"5min":0.76000000000000001,"15min":0.71799999999999997},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.9099999999999999},"last":1.012}]}]},{"osd":0,"up_from":13,"seq":55834574964,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30880,"kb_used_data":1432,"kb_used_omap":0,"kb_used_meta":29440,"kb_avail":94340960,"statfs":{"total":96636764160,"available":96605143040,"internally_reserved":0,"allocated":1466368,"data_stored":1233326,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":30146560},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67600000000000005,"15min":0.624},"min":{"1min":0.27300000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.0569999999999999,"5min":5.7480000000000002,"15min":5.7480000000000002},"last":0.312},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.78400000000000003,"15min":0.747},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":1.018,"5min":6.274,"15min":6.274},"last":0.40799999999999997}]},{"osd":2,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.80000000000000004,"15min":0.749},"min":{"1min":0.40500000000000003,"5min":0.36499999999999999,"15min":0.35399999999999998},"max":{"1min":0.998,"5min":6.1609999999999996,"15min":6.1609999999999996},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.71699999999999997,"15min":0.70699999999999996},"min":{"1min":0.32300000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.7170000000000001},"last":0.38300000000000001}]},{"osd":3,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.85299999999999998,"15min":0.78900000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.36799999999999999},"max":{"1min":1.135,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.439},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.78800000000000003,"15min":0.751},"min":{"1min":0.38700000000000001,"5min":0.376,"15min":0.30299999999999999},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.42999999999999999}]},{"osd":4,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.997,"15min":0.94299999999999995},"min":{"1min":0.57499999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.345,"5min":8.1159999999999997,"15min":8.1159999999999997},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.028,"5min":1.0620000000000001,"15min":1.0429999999999999},"min":{"1min":0.68000000000000005,"5min":0.57299999999999995,"15min":0.504},"max":{"1min":1.4259999999999999,"5min":6.2320000000000002,"15min":6.2320000000000002},"last":0.68899999999999995}]},{"osd":5,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.2270000000000001,"15min":1.113},"min":{"1min":0.77000000000000002,"5min":0.59399999999999997,"15min":0.46899999999999997},"max":{"1min":1.298,"5min":17.420000000000002,"15min":17.420000000000002},"last":0.65800000000000003},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.1950000000000001,"15min":1.0589999999999999},"min":{"1min":0.621,"5min":0.59499999999999997,"15min":0.54300000000000004},"max":{"1min":1.296,"5min":17.643000000000001,"15min":17.643000000000001},"last":0.77100000000000002}]},{"osd":6,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0700000000000001,"15min":1.044},"min":{"1min":0.66600000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3540000000000001,"5min":5.7220000000000004,"15min":5.7220000000000004},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.109,"5min":1.0569999999999999,"15min":1.0249999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.534,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.78200000000000003}]},{"osd":7,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.147,"15min":1.0840000000000001},"min":{"1min":0.77500000000000002,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.5740000000000001,"5min":5.7800000000000002,"15min":5.7800000000000002},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.147,"5min":1.0800000000000001,"15min":1.073},"min":{"1min":0.63700000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.6259999999999999,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.64500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:21:47.147 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-03T19:12:21.282052+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=3, tm_hour=19, tm_min=12, tm_sec=21, tm_wday=1, tm_yday=276, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=3, tm_hour=19, tm_min=21, tm_sec=41, tm_wday=1, tm_yday=276, tm_isdst=0) 2023-10-03T19:21:47.147 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-03T19:12:22.305121+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=3, tm_hour=19, tm_min=12, tm_sec=22, tm_wday=1, tm_yday=276, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=3, tm_hour=19, tm_min=21, tm_sec=41, tm_wday=1, tm_yday=276, tm_isdst=0) 2023-10-03T19:21:47.148 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-03T19:12:22.305121+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=3, tm_hour=19, tm_min=12, tm_sec=22, tm_wday=1, tm_yday=276, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=3, tm_hour=19, tm_min=21, tm_sec=41, tm_wday=1, tm_yday=276, tm_isdst=0) 2023-10-03T19:21:47.148 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-03T19:12:22.305121+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=3, tm_hour=19, tm_min=12, tm_sec=22, tm_wday=1, tm_yday=276, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=3, tm_hour=19, tm_min=21, tm_sec=41, tm_wday=1, tm_yday=276, tm_isdst=0) 2023-10-03T19:21:47.148 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-03T19:12:22.305121+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=3, tm_hour=19, tm_min=12, tm_sec=22, tm_wday=1, tm_yday=276, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=3, tm_hour=19, tm_min=21, tm_sec=41, tm_wday=1, tm_yday=276, tm_isdst=0) 2023-10-03T19:21:47.148 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-03T19:12:22.305121+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=3, tm_hour=19, tm_min=12, tm_sec=22, tm_wday=1, tm_yday=276, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=3, tm_hour=19, tm_min=21, tm_sec=41, tm_wday=1, tm_yday=276, tm_isdst=0) 2023-10-03T19:21:47.148 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-03T19:12:22.305121+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=3, tm_hour=19, tm_min=12, tm_sec=22, tm_wday=1, tm_yday=276, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=3, tm_hour=19, tm_min=21, tm_sec=41, tm_wday=1, tm_yday=276, tm_isdst=0) 2023-10-03T19:21:47.148 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-03T19:12:22.305121+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=3, tm_hour=19, tm_min=12, tm_sec=22, tm_wday=1, tm_yday=276, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=3, tm_hour=19, tm_min=21, tm_sec=41, tm_wday=1, tm_yday=276, tm_isdst=0) 2023-10-03T19:21:47.149 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-03T19:12:22.305121+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=3, tm_hour=19, tm_min=12, tm_sec=22, tm_wday=1, tm_yday=276, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=3, tm_hour=19, tm_min=21, tm_sec=41, tm_wday=1, tm_yday=276, tm_isdst=0) 2023-10-03T19:21:47.149 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-03T19:21:58.959 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:21:58.962 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:21:58.965 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:21:58.968 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:22:07.150 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T19:22:07.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.278+0000 7f7a9a81e640 1 Processor -- start 2023-10-03T19:22:07.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.278+0000 7f7a9a81e640 1 -- start start 2023-10-03T19:22:07.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a9a81e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a9406d170 0x7f7a9414d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:22:07.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a9a81e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a9406cac0 con 0x7f7a9406f170 2023-10-03T19:22:07.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a9a81e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a940720d0 con 0x7f7a940bc8b0 2023-10-03T19:22:07.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a9a81e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a940a5ab0 con 0x7f7a9406d170 2023-10-03T19:22:07.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a93fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7a9406f170 0x7f7a94150190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51430/0 (socket says 172.21.15.45:51430) 2023-10-03T19:22:07.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a93fff640 1 -- 172.21.15.45:0/3619125683 learned_addr learned my addr 172.21.15.45:0/3619125683 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:22:07.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a98dbb640 1 --2- 172.21.15.45:0/3619125683 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a9406d170 0x7f7a9414d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:22:07.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a92ffd640 1 -- 172.21.15.45:0/3619125683 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2201285803 0 0) 0x7f7a84001120 con 0x7f7a9406f170 2023-10-03T19:22:07.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a92ffd640 1 -- 172.21.15.45:0/3619125683 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a7c003530 con 0x7f7a9406f170 2023-10-03T19:22:07.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a92ffd640 1 -- 172.21.15.45:0/3619125683 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3351040912 0 0) 0x7f7a7c003530 con 0x7f7a9406f170 2023-10-03T19:22:07.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a92ffd640 1 -- 172.21.15.45:0/3619125683 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a9406d170 msgr2=0x7f7a9414d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:22:07.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a92ffd640 1 --2- 172.21.15.45:0/3619125683 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a9406d170 0x7f7a9414d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:22:07.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a92ffd640 1 -- 172.21.15.45:0/3619125683 >> v1:172.21.15.79:6789/0 conn(0x7f7a940bc8b0 legacy=0x7f7a9414ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:22:07.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a92ffd640 1 -- 172.21.15.45:0/3619125683 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a9406cd00 con 0x7f7a9406f170 2023-10-03T19:22:07.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a92ffd640 1 -- 172.21.15.45:0/3619125683 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7f7a84001810 con 0x7f7a9406f170 2023-10-03T19:22:07.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a92ffd640 1 -- 172.21.15.45:0/3619125683 >> v1:172.21.15.45:6789/0 conn(0x7f7a9406f170 legacy=0x7f7a94150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:22:07.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a92ffd640 1 --2- 172.21.15.45:0/3619125683 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a9406d170 0x7f7a7c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:22:07.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a92ffd640 1 --2- 172.21.15.45:0/3619125683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a7c003f30 0x7f7a7c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:22:07.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a92ffd640 1 --2- 172.21.15.45:0/3619125683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a7c004d10 0x7f7a7c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:22:07.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a92ffd640 1 -- 172.21.15.45:0/3619125683 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a940a5ab0 con 0x7f7a7c004d10 2023-10-03T19:22:07.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a92ffd640 1 -- 172.21.15.45:0/3619125683 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c00bb00 con 0x7f7a7c003f30 2023-10-03T19:22:07.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a92ffd640 1 -- 172.21.15.45:0/3619125683 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c00bcc0 con 0x7f7a9406d170 2023-10-03T19:22:07.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a98dbb640 1 --2- 172.21.15.45:0/3619125683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a7c004d10 0x7f7a7c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:22:07.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a937fe640 1 --2- 172.21.15.45:0/3619125683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a7c003f30 0x7f7a7c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:22:07.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a93fff640 1 --2- 172.21.15.45:0/3619125683 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a9406d170 0x7f7a7c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:22:07.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a98dbb640 1 -- 172.21.15.45:0/3619125683 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a9406d170 msgr2=0x7f7a7c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:22:07.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a98dbb640 1 --2- 172.21.15.45:0/3619125683 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a9406d170 0x7f7a7c0039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:22:07.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a98dbb640 1 -- 172.21.15.45:0/3619125683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a7c003f30 msgr2=0x7f7a7c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:22:07.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a98dbb640 1 --2- 172.21.15.45:0/3619125683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a7c003f30 0x7f7a7c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:22:07.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a98dbb640 1 -- 172.21.15.45:0/3619125683 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7c003530 con 0x7f7a7c004d10 2023-10-03T19:22:07.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.282+0000 7f7a937fe640 1 --2- 172.21.15.45:0/3619125683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a7c003f30 0x7f7a7c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:22:07.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a98dbb640 1 --2- 172.21.15.45:0/3619125683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a7c004d10 0x7f7a7c005180 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c009f90 tx=0x7f7a8c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92aeb8b24f071d1a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:22:07.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a92ffd640 1 -- 172.21.15.45:0/3619125683 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c0a5c30 con 0x7f7a7c004d10 2023-10-03T19:22:07.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a92ffd640 1 -- 172.21.15.45:0/3619125683 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8c00f040 con 0x7f7a7c004d10 2023-10-03T19:22:07.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a92ffd640 1 -- 172.21.15.45:0/3619125683 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c0ad440 con 0x7f7a7c004d10 2023-10-03T19:22:07.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a9a81e640 1 -- 172.21.15.45:0/3619125683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a7c004d10 msgr2=0x7f7a7c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:22:07.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a9a81e640 1 --2- 172.21.15.45:0/3619125683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a7c004d10 0x7f7a7c005180 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c009f90 tx=0x7f7a8c01cc20 comp rx=0 tx=0).stop 2023-10-03T19:22:07.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a98dbb640 1 -- 172.21.15.45:0/3619125683 reap_dead start 2023-10-03T19:22:07.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a9a81e640 1 -- 172.21.15.45:0/3619125683 shutdown_connections 2023-10-03T19:22:07.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a9a81e640 1 -- 172.21.15.45:0/3619125683 >> 172.21.15.45:0/3619125683 conn(0x7f7a940bcf50 msgr2=0x7f7a940bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:22:07.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a9a81e640 1 -- 172.21.15.45:0/3619125683 shutdown_connections 2023-10-03T19:22:07.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a9a81e640 1 -- 172.21.15.45:0/3619125683 wait complete. 2023-10-03T19:22:07.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a9a81e640 1 Processor -- start 2023-10-03T19:22:07.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a9a81e640 1 -- start start 2023-10-03T19:22:07.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a9a81e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a7c004d10 0x7f7a941d7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:22:07.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a9a81e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a941d7140 0x7f7a941d8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:22:07.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a9a81e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a940bed10 0x7f7a941e5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:22:07.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a9a81e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a941420a0 con 0x7f7a940bed10 2023-10-03T19:22:07.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a9a81e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a941e2710 con 0x7f7a7c004d10 2023-10-03T19:22:07.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a9a81e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a940bf1d0 con 0x7f7a941d7140 2023-10-03T19:22:07.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a98dbb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a940bed10 0x7f7a941e5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:22:07.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a98dbb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a940bed10 0x7f7a941e5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53246/0 (socket says 172.21.15.45:53246) 2023-10-03T19:22:07.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a98dbb640 1 -- 172.21.15.45:0/978986576 learned_addr learned my addr 172.21.15.45:0/978986576 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:22:07.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a93fff640 1 --2- 172.21.15.45:0/978986576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a7c004d10 0x7f7a941d7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:22:07.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a937fe640 1 --2- 172.21.15.45:0/978986576 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a941d7140 0x7f7a941d8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:22:07.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a98dbb640 1 -- 172.21.15.45:0/978986576 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a941d7140 msgr2=0x7f7a941d8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:22:07.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a98dbb640 1 --2- 172.21.15.45:0/978986576 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a941d7140 0x7f7a941d8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:22:07.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a98dbb640 1 -- 172.21.15.45:0/978986576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a7c004d10 msgr2=0x7f7a941d7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:22:07.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a98dbb640 1 --2- 172.21.15.45:0/978986576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a7c004d10 0x7f7a941d7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:22:07.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a98dbb640 1 -- 172.21.15.45:0/978986576 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a9414c4a0 con 0x7f7a940bed10 2023-10-03T19:22:07.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a93fff640 1 --2- 172.21.15.45:0/978986576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a7c004d10 0x7f7a941d7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:22:07.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.286+0000 7f7a98dbb640 1 --2- 172.21.15.45:0/978986576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a940bed10 0x7f7a941e5680 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c009f90 tx=0x7f7a8c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:22:07.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.290+0000 7f7a90ff9640 1 -- 172.21.15.45:0/978986576 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c0039a0 con 0x7f7a940bed10 2023-10-03T19:22:07.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.290+0000 7f7a90ff9640 1 -- 172.21.15.45:0/978986576 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8c003b00 con 0x7f7a940bed10 2023-10-03T19:22:07.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.290+0000 7f7a9a81e640 1 -- 172.21.15.45:0/978986576 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a9414fae0 con 0x7f7a940bed10 2023-10-03T19:22:07.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.290+0000 7f7a90ff9640 1 -- 172.21.15.45:0/978986576 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c0ae950 con 0x7f7a940bed10 2023-10-03T19:22:07.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.290+0000 7f7a9a81e640 1 -- 172.21.15.45:0/978986576 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a9406f540 con 0x7f7a940bed10 2023-10-03T19:22:07.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.290+0000 7f7a9a81e640 1 -- 172.21.15.45:0/978986576 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a9406d660 con 0x7f7a940bed10 2023-10-03T19:22:07.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.290+0000 7f7a90ff9640 1 -- 172.21.15.45:0/978986576 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7a8c0b4040 con 0x7f7a940bed10 2023-10-03T19:22:07.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.290+0000 7f7a90ff9640 1 --2- 172.21.15.45:0/978986576 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7a80066280 0x7f7a80068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:22:07.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.290+0000 7f7a90ff9640 1 -- 172.21.15.45:0/978986576 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f7a8c11d890 con 0x7f7a940bed10 2023-10-03T19:22:07.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.290+0000 7f7a93fff640 1 --2- 172.21.15.45:0/978986576 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7a80066280 0x7f7a80068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:22:07.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.290+0000 7f7a93fff640 1 --2- 172.21.15.45:0/978986576 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7a80066280 0x7f7a80068730 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7a84001280 tx=0x7f7a84009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:22:07.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.294+0000 7f7a90ff9640 1 -- 172.21.15.45:0/978986576 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7a8c0eb200 con 0x7f7a940bed10 2023-10-03T19:22:07.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.446+0000 7f7a9a81e640 1 -- 172.21.15.45:0/978986576 --> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7a941421e0 con 0x7f7a80066280 2023-10-03T19:22:07.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.458+0000 7f7a90ff9640 1 -- 172.21.15.45:0/978986576 <== mgr.4106 v2:172.21.15.79:6800/1497032475 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71401 (secure 0 0 0) 0x7f7a941421e0 con 0x7f7a80066280 2023-10-03T19:22:07.459 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:22:07.460 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-10-03T19:22:07.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.458+0000 7f7a9a81e640 1 -- 172.21.15.45:0/978986576 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7a80066280 msgr2=0x7f7a80068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:22:07.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.458+0000 7f7a9a81e640 1 --2- 172.21.15.45:0/978986576 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7a80066280 0x7f7a80068730 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7a84001280 tx=0x7f7a84009040 comp rx=0 tx=0).stop 2023-10-03T19:22:07.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.458+0000 7f7a9a81e640 1 -- 172.21.15.45:0/978986576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a940bed10 msgr2=0x7f7a941e5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:22:07.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.458+0000 7f7a9a81e640 1 --2- 172.21.15.45:0/978986576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a940bed10 0x7f7a941e5680 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c009f90 tx=0x7f7a8c009750 comp rx=0 tx=0).stop 2023-10-03T19:22:07.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.458+0000 7f7a9a81e640 1 -- 172.21.15.45:0/978986576 shutdown_connections 2023-10-03T19:22:07.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.458+0000 7f7a9a81e640 1 --2- 172.21.15.45:0/978986576 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f7a80066280 0x7f7a80068730 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:22:07.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.458+0000 7f7a9a81e640 1 --2- 172.21.15.45:0/978986576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a940bed10 0x7f7a941e5680 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:22:07.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.458+0000 7f7a9a81e640 1 --2- 172.21.15.45:0/978986576 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a941d7140 0x7f7a941d8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:22:07.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.458+0000 7f7a9a81e640 1 --2- 172.21.15.45:0/978986576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a7c004d10 0x7f7a941d7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:22:07.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.458+0000 7f7a9a81e640 1 -- 172.21.15.45:0/978986576 >> 172.21.15.45:0/978986576 conn(0x7f7a940bcf50 msgr2=0x7f7a9414e710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:22:07.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.458+0000 7f7a9a81e640 1 -- 172.21.15.45:0/978986576 shutdown_connections 2023-10-03T19:22:07.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.458+0000 7f7a9a81e640 1 -- 172.21.15.45:0/978986576 wait complete. 2023-10-03T19:22:07.477 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":401,"stamp":"2023-10-03T19:22:06.652807+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":236820,"kb_used_data":11092,"kb_used_omap":0,"kb_used_meta":225664,"kb_avail":754737900,"statfs":{"total":773094113280,"available":772851609600,"internally_reserved":0,"allocated":11358208,"data_stored":6330220,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":231079936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003307"},"pg_stats":[{"pgid":"1.0","version":"113'119","reported_seq":355,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-03T19:21:54.788586+0000","last_change":"2023-10-03T19:21:54.788717+0000","last_active":"2023-10-03T19:21:54.788586+0000","last_peered":"2023-10-03T19:21:54.788586+0000","last_clean":"2023-10-03T19:21:54.788586+0000","last_became_active":"2023-10-03T19:12:22.327596+0000","last_became_peered":"2023-10-03T19:12:22.327596+0000","last_unstale":"2023-10-03T19:21:54.788586+0000","last_undegraded":"2023-10-03T19:21:54.788586+0000","last_fullsized":"2023-10-03T19:21:54.788586+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'119","last_scrub_stamp":"2023-10-03T19:21:54.788343+0000","last_deep_scrub":"113'119","last_deep_scrub_stamp":"2023-10-03T19:21:54.788343+0000","last_clean_scrub_stamp":"2023-10-03T19:21:54.788343+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T02:34:31.106408+0000","scrub_duration":2.9768006429999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":200,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-03T19:21:53.194319+0000","last_change":"2023-10-03T19:21:53.194480+0000","last_active":"2023-10-03T19:21:53.194319+0000","last_peered":"2023-10-03T19:21:53.194319+0000","last_clean":"2023-10-03T19:21:53.194319+0000","last_became_active":"2023-10-03T19:12:23.342839+0000","last_became_peered":"2023-10-03T19:12:23.342839+0000","last_unstale":"2023-10-03T19:21:53.194319+0000","last_undegraded":"2023-10-03T19:21:53.194319+0000","last_fullsized":"2023-10-03T19:21:53.194319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:21:53.193974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:21:53.193974+0000","last_clean_scrub_stamp":"2023-10-03T19:21:53.193974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:53:05.319449+0000","scrub_duration":2.2285850539999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":200,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-03T19:22:02.132256+0000","last_change":"2023-10-03T19:22:02.132416+0000","last_active":"2023-10-03T19:22:02.132256+0000","last_peered":"2023-10-03T19:22:02.132256+0000","last_clean":"2023-10-03T19:22:02.132256+0000","last_became_active":"2023-10-03T19:12:23.343320+0000","last_became_peered":"2023-10-03T19:12:23.343320+0000","last_unstale":"2023-10-03T19:22:02.132256+0000","last_undegraded":"2023-10-03T19:22:02.132256+0000","last_fullsized":"2023-10-03T19:22:02.132256+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:22:02.131912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:22:02.131912+0000","last_clean_scrub_stamp":"2023-10-03T19:22:02.131912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:58:00.600975+0000","scrub_duration":2.232576812,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-03T19:21:46.970346+0000","last_change":"2023-10-03T19:21:46.970412+0000","last_active":"2023-10-03T19:21:46.970346+0000","last_peered":"2023-10-03T19:21:46.970346+0000","last_clean":"2023-10-03T19:21:46.970346+0000","last_became_active":"2023-10-03T19:12:23.342884+0000","last_became_peered":"2023-10-03T19:12:23.342884+0000","last_unstale":"2023-10-03T19:21:46.970346+0000","last_undegraded":"2023-10-03T19:21:46.970346+0000","last_fullsized":"2023-10-03T19:21:46.970346+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:21:46.970185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:21:46.970185+0000","last_clean_scrub_stamp":"2023-10-03T19:21:46.970185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T04:44:30.771112+0000","scrub_duration":2.2325661889999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":201,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-03T19:21:56.221874+0000","last_change":"2023-10-03T19:21:56.221975+0000","last_active":"2023-10-03T19:21:56.221874+0000","last_peered":"2023-10-03T19:21:56.221874+0000","last_clean":"2023-10-03T19:21:56.221874+0000","last_became_active":"2023-10-03T19:12:23.342613+0000","last_became_peered":"2023-10-03T19:12:23.342613+0000","last_unstale":"2023-10-03T19:21:56.221874+0000","last_undegraded":"2023-10-03T19:21:56.221874+0000","last_fullsized":"2023-10-03T19:21:56.221874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:21:56.221638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:21:56.221638+0000","last_clean_scrub_stamp":"2023-10-03T19:21:56.221638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T20:18:21.616373+0000","scrub_duration":2.2285551799999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":193,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-03T19:21:47.464652+0000","last_change":"2023-10-03T19:21:47.464745+0000","last_active":"2023-10-03T19:21:47.464652+0000","last_peered":"2023-10-03T19:21:47.464652+0000","last_clean":"2023-10-03T19:21:47.464652+0000","last_became_active":"2023-10-03T19:12:23.833577+0000","last_became_peered":"2023-10-03T19:12:23.833577+0000","last_unstale":"2023-10-03T19:21:47.464652+0000","last_undegraded":"2023-10-03T19:21:47.464652+0000","last_fullsized":"2023-10-03T19:21:47.464652+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:21:47.464389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:21:47.464389+0000","last_clean_scrub_stamp":"2023-10-03T19:21:47.464389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2023-10-04T21:14:26.516808+0000","scrub_duration":2.2323881879999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":200,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-03T19:21:57.065853+0000","last_change":"2023-10-03T19:21:57.066009+0000","last_active":"2023-10-03T19:21:57.065853+0000","last_peered":"2023-10-03T19:21:57.065853+0000","last_clean":"2023-10-03T19:21:57.065853+0000","last_became_active":"2023-10-03T19:12:23.834235+0000","last_became_peered":"2023-10-03T19:12:23.834235+0000","last_unstale":"2023-10-03T19:21:57.065853+0000","last_undegraded":"2023-10-03T19:21:57.065853+0000","last_fullsized":"2023-10-03T19:21:57.065853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:21:57.065583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:21:57.065583+0000","last_clean_scrub_stamp":"2023-10-03T19:21:57.065583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T03:46:57.047517+0000","scrub_duration":2.2325761480000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":193,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-03T19:21:52.593323+0000","last_change":"2023-10-03T19:21:52.593434+0000","last_active":"2023-10-03T19:21:52.593323+0000","last_peered":"2023-10-03T19:21:52.593323+0000","last_clean":"2023-10-03T19:21:52.593323+0000","last_became_active":"2023-10-03T19:12:23.346356+0000","last_became_peered":"2023-10-03T19:12:23.346356+0000","last_unstale":"2023-10-03T19:21:52.593323+0000","last_undegraded":"2023-10-03T19:21:52.593323+0000","last_fullsized":"2023-10-03T19:21:52.593323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:21:52.593070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:21:52.593070+0000","last_clean_scrub_stamp":"2023-10-03T19:21:52.593070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T00:12:57.333673+0000","scrub_duration":2.232310434,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":194,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-03T19:21:49.348045+0000","last_change":"2023-10-03T19:21:49.348154+0000","last_active":"2023-10-03T19:21:49.348045+0000","last_peered":"2023-10-03T19:21:49.348045+0000","last_clean":"2023-10-03T19:21:49.348045+0000","last_became_active":"2023-10-03T19:12:23.341078+0000","last_became_peered":"2023-10-03T19:12:23.341078+0000","last_unstale":"2023-10-03T19:21:49.348045+0000","last_undegraded":"2023-10-03T19:21:49.348045+0000","last_fullsized":"2023-10-03T19:21:49.348045+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T19:21:49.347769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T19:21:49.347769+0000","last_clean_scrub_stamp":"2023-10-03T19:21:49.347769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2023-10-05T07:03:24.261870+0000","scrub_duration":2.232152412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66750,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509559,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34340,"kb_used_data":1436,"kb_used_omap":0,"kb_used_meta":32896,"kb_avail":94337500,"statfs":{"total":96636764160,"available":96601600000,"internally_reserved":0,"allocated":1470464,"data_stored":1234490,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":33685504},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.88300000000000001,"15min":0.91800000000000004},"min":{"1min":0.65300000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.155,"5min":2.1080000000000001,"15min":4.0469999999999997},"last":1.069},{"interface":"front","average":{"1min":0.87,"5min":0.85399999999999998,"15min":0.83399999999999996},"min":{"1min":0.53000000000000003,"5min":0.52200000000000002,"15min":0.45000000000000001},"max":{"1min":1.149,"5min":1.2230000000000001,"15min":1.3420000000000001},"last":1.0409999999999999}]},{"osd":1,"last update":"Tue Oct 3 19:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.90100000000000002,"15min":0.97099999999999997},"min":{"1min":0.57299999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.323,"5min":2.298,"15min":3.8239999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.877},"min":{"1min":0.61599999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.1839999999999999,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.202}]},{"osd":2,"last update":"Tue Oct 3 19:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.93100000000000005,"15min":0.90100000000000002},"min":{"1min":0.54300000000000004,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1859999999999999,"5min":4.4779999999999998,"15min":6.0449999999999999},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.94199999999999995,"15min":1.0009999999999999},"min":{"1min":0.68899999999999995,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1839999999999999,"5min":2.673,"15min":3.98},"last":0.77800000000000002}]},{"osd":3,"last update":"Tue Oct 3 19:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.97799999999999998,"15min":0.96399999999999997},"min":{"1min":0.61199999999999999,"5min":0.54200000000000004,"15min":0.51100000000000001},"max":{"1min":1.1220000000000001,"5min":4.3650000000000002,"15min":6.125},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.97099999999999997,"15min":1.0629999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.371,"5min":1.593,"15min":3.9140000000000001},"last":0.999}]},{"osd":4,"last update":"Tue Oct 3 19:21:41 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.90900000000000003,"15min":1.056},"min":{"1min":0.621,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1579999999999999,"5min":2.4769999999999999,"15min":5.1130000000000004},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.081,"15min":1.0449999999999999},"min":{"1min":0.70399999999999996,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1699999999999999,"5min":12.196999999999999,"15min":12.196999999999999},"last":0.95099999999999996}]},{"osd":5,"last update":"Tue Oct 3 19:21:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.004,"15min":1.1579999999999999},"min":{"1min":0.68600000000000005,"5min":0.63700000000000001,"15min":0.51300000000000001},"max":{"1min":1.2909999999999999,"5min":2.581,"15min":5.1859999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.024,"15min":1.095},"min":{"1min":0.77500000000000002,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.2230000000000001,"5min":1.6719999999999999,"15min":2.0609999999999999},"last":0.90800000000000003}]},{"osd":6,"last update":"Tue Oct 3 19:21:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.071,"15min":1.089},"min":{"1min":0.78100000000000003,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2410000000000001,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.135},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.1180000000000001,"15min":1.1619999999999999},"min":{"1min":0.69199999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.345,"5min":4.5570000000000004,"15min":6.1580000000000004},"last":1.1779999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509559,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":30272,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":1400832,"data_stored":642958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30998528},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.83399999999999996},"min":{"1min":0.60699999999999998,"5min":0.45400000000000001,"15min":0.44600000000000001},"max":{"1min":1.2749999999999999,"5min":1.3340000000000001,"15min":1.504},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.873,"15min":0.88300000000000001},"min":{"1min":0.53100000000000003,"5min":0.49199999999999999,"15min":0.44600000000000001},"max":{"1min":1.2290000000000001,"5min":1.423,"15min":1.839},"last":1.046}]},{"osd":1,"last update":"Tue Oct 3 19:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.57399999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.03,"5min":1.27,"15min":2.0150000000000001},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.876,"15min":0.88},"min":{"1min":0.61499999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2070000000000001,"5min":1.448,"15min":1.448},"last":1.077}]},{"osd":2,"last update":"Tue Oct 3 19:21:43 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":0.95299999999999996,"15min":0.90800000000000003},"min":{"1min":0.69799999999999995,"5min":0.56699999999999995,"15min":0.51900000000000002},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.90500000000000003,"15min":0.91800000000000004},"min":{"1min":0.68899999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.24,"5min":1.369,"15min":1.546},"last":0.82699999999999996}]},{"osd":3,"last update":"Tue Oct 3 19:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.96399999999999997,"15min":0.97299999999999998},"min":{"1min":0.60599999999999998,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1779999999999999,"5min":1.377,"15min":1.6990000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":1,"5min":0.92000000000000004,"15min":0.91600000000000004},"min":{"1min":0.67100000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2529999999999999,"5min":1.3200000000000001,"15min":2.121},"last":0.752}]},{"osd":4,"last update":"Tue Oct 3 19:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.92900000000000005,"15min":0.98499999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.919,"5min":1.919,"15min":1.95},"last":0.876},{"interface":"front","average":{"1min":0.997,"5min":1.0009999999999999,"15min":1.0509999999999999},"min":{"1min":0.629,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.21,"5min":1.504,"15min":1.7709999999999999},"last":0.67500000000000004}]},{"osd":5,"last update":"Tue Oct 3 19:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.92300000000000004,"15min":0.97899999999999998},"min":{"1min":0.66400000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2170000000000001,"5min":1.3200000000000001,"15min":2.2570000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.101,"5min":1.0700000000000001,"15min":1.097},"min":{"1min":0.83899999999999997,"5min":0.70699999999999996,"15min":0.68100000000000005},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":2.0619999999999998},"last":0.93999999999999995}]},{"osd":7,"last update":"Tue Oct 3 19:21:43 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0780000000000001,"15min":1.1020000000000001},"min":{"1min":0.90300000000000002,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.2490000000000001,"5min":1.639,"15min":2.0049999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0489999999999999,"15min":1.077},"min":{"1min":0.874,"5min":0.67600000000000005,"15min":0.61899999999999999},"max":{"1min":1.3500000000000001,"5min":1.4079999999999999,"15min":2.4249999999999998},"last":0.81200000000000006}]}]},{"osd":4,"up_from":15,"seq":64424509560,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26340,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":24960,"kb_avail":94345500,"statfs":{"total":96636764160,"available":96609792000,"internally_reserved":0,"allocated":1404928,"data_stored":644122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25559040},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":1.1000000000000001,"15min":0.90100000000000002},"min":{"1min":0.70399999999999996,"5min":0.58699999999999997,"15min":0.50600000000000001},"max":{"1min":1.1799999999999999,"5min":17.686,"15min":17.686},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.88900000000000001,"5min":1.028,"15min":0.89500000000000002},"min":{"1min":0.67800000000000005,"5min":0.52500000000000002,"15min":0.49299999999999999},"max":{"1min":1.1459999999999999,"5min":16.925999999999998,"15min":16.925999999999998},"last":0.80300000000000005}]},{"osd":1,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.079,"15min":0.97899999999999998},"min":{"1min":0.621,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.3160000000000001,"5min":16.640999999999998,"15min":16.640999999999998},"last":1.173},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.1060000000000001,"15min":0.94899999999999995},"min":{"1min":0.78800000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.274,"5min":17.59,"15min":17.59},"last":0.85399999999999998}]},{"osd":2,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.004,"15min":0.94999999999999996},"min":{"1min":0.69299999999999995,"5min":0.63500000000000001,"15min":0.53200000000000003},"max":{"1min":1.3360000000000001,"5min":8.5630000000000006,"15min":8.5630000000000006},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.159,"15min":1.0189999999999999},"min":{"1min":0.69899999999999995,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.375,"5min":17.734000000000002,"15min":17.734000000000002},"last":1.0669999999999999}]},{"osd":3,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":1.101,"15min":0.95499999999999996},"min":{"1min":0.76200000000000001,"5min":0.54500000000000004,"15min":0.53900000000000003},"max":{"1min":1.258,"5min":16.98,"15min":16.98},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1910000000000001,"15min":1.1040000000000001},"min":{"1min":0.83799999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.238,"5min":16.434000000000001,"15min":16.434000000000001},"last":1.0900000000000001}]},{"osd":5,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.143,"15min":1.071},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4990000000000001,"5min":17.782,"15min":17.782},"last":1.014},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0029999999999999,"15min":1.004},"min":{"1min":0.72499999999999998,"5min":0.65700000000000003,"15min":0.60899999999999999},"max":{"1min":1.24,"5min":1.708,"15min":1.708},"last":0.624}]},{"osd":6,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.4550000000000001,"15min":1.2569999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.47,"5min":36.106000000000002,"15min":36.106000000000002},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.119,"5min":1.2909999999999999,"15min":1.206},"min":{"1min":0.65500000000000003,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.575,"5min":17.646999999999998,"15min":17.646999999999998},"last":0.70799999999999996}]},{"osd":7,"last update":"Tue Oct 3 19:21:31 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.2709999999999999,"15min":1.141},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.429,"5min":17.042000000000002,"15min":17.042000000000002},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.347,"15min":1.258},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.6020000000000001,"5min":16.32,"15min":16.32},"last":1.2509999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509560,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33120,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":31744,"kb_avail":94338720,"statfs":{"total":96636764160,"available":96602849280,"internally_reserved":0,"allocated":1400832,"data_stored":642958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":32505856},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.78100000000000003,"15min":0.63100000000000001},"min":{"1min":0.45000000000000001,"5min":0.32200000000000001,"15min":0.247},"max":{"1min":0.93700000000000006,"5min":13.629,"15min":13.629},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":1.2090000000000001,"15min":0.83399999999999996},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.161,"5min":40.439,"15min":40.439},"last":0.68000000000000005}]},{"osd":1,"last update":"Tue Oct 3 19:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.89700000000000002,"15min":0.73499999999999999},"min":{"1min":0.45700000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.216,"5min":14.074,"15min":14.074},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.66600000000000004},"min":{"1min":0.42999999999999999,"5min":0.32400000000000001,"15min":0.26400000000000001},"max":{"1min":0.96799999999999997,"5min":7.0060000000000002,"15min":7.0060000000000002},"last":0.55200000000000005}]},{"osd":3,"last update":"Tue Oct 3 19:21:42 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.89600000000000002,"15min":0.73599999999999999},"min":{"1min":0.41099999999999998,"5min":0.28899999999999998,"15min":0.224},"max":{"1min":1.3080000000000001,"5min":13.423999999999999,"15min":13.423999999999999},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.90000000000000002,"5min":1.0449999999999999,"15min":0.85299999999999998},"min":{"1min":0.38800000000000001,"5min":0.38300000000000001,"15min":0.36399999999999999},"max":{"1min":1.202,"5min":18.568999999999999,"15min":18.568999999999999},"last":0.93999999999999995}]},{"osd":4,"last update":"Tue Oct 3 19:21:42 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.95199999999999996,"15min":0.89900000000000002},"min":{"1min":0.496,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.238,"5min":1.5109999999999999,"15min":1.718},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.345,"15min":1.0740000000000001},"min":{"1min":0.66600000000000004,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.325,"5min":28.667999999999999,"15min":28.667999999999999},"last":1.252}]},{"osd":5,"last update":"Tue Oct 3 19:21:42 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.042,"15min":0.94399999999999995},"min":{"1min":0.61699999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.3220000000000001,"5min":5.4459999999999997,"15min":5.4459999999999997},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.228,"15min":1.056},"min":{"1min":0.53400000000000003,"5min":0.53200000000000003,"15min":0.52700000000000002},"max":{"1min":1.3600000000000001,"5min":14.007,"15min":14.007},"last":1.1679999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:21:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0860000000000001,"15min":0.98399999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.49099999999999999},"max":{"1min":1.3120000000000001,"5min":10.679,"15min":10.679},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.1000000000000001,"15min":1.0289999999999999},"min":{"1min":0.81399999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.407,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.208}]},{"osd":7,"last update":"Tue Oct 3 19:21:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.3300000000000001,"15min":1.1339999999999999},"min":{"1min":0.63600000000000001,"5min":0.63100000000000001,"15min":0.56100000000000005},"max":{"1min":1.4690000000000001,"5min":18.623000000000001,"15min":18.623000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.079,"15min":1.0149999999999999},"min":{"1min":0.80000000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4410000000000001,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":1.014}]}]},{"osd":1,"up_from":15,"seq":64424509559,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31204,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":29824,"kb_avail":94340636,"statfs":{"total":96636764160,"available":96604811264,"internally_reserved":0,"allocated":1404928,"data_stored":644122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30539776},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:21:45 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.61099999999999999,"15min":0.57499999999999996},"min":{"1min":0.29799999999999999,"5min":0.27200000000000002,"15min":0.26900000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.0169999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.70099999999999996,"15min":0.59999999999999998},"min":{"1min":0.40100000000000002,"5min":0.27200000000000002,"15min":0.22900000000000001},"max":{"1min":1.123,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.93899999999999995}]},{"osd":2,"last update":"Tue Oct 3 19:21:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.67400000000000004,"15min":0.61099999999999999},"min":{"1min":0.42899999999999999,"5min":0.30599999999999999,"15min":0.26200000000000001},"max":{"1min":0.93200000000000005,"5min":1.2569999999999999,"15min":1.506},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.80400000000000005,"15min":0.73199999999999998},"min":{"1min":0.41699999999999998,"5min":0.33000000000000002,"15min":0.312},"max":{"1min":1.2350000000000001,"5min":1.252,"15min":1.365},"last":1.0189999999999999}]},{"osd":3,"last update":"Tue Oct 3 19:21:45 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.77900000000000003,"15min":0.70199999999999996},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":1.2589999999999999,"5min":1.329,"15min":1.329},"last":1.141},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73699999999999999,"15min":0.66000000000000003},"min":{"1min":0.36099999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.95899999999999996,"5min":1.232,"15min":1.27},"last":0.81399999999999995}]},{"osd":4,"last update":"Tue Oct 3 19:21:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.89800000000000002,"15min":0.84599999999999997},"min":{"1min":0.63600000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1020000000000001,"5min":1.292,"15min":1.6619999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.0600000000000001,"5min":0.99299999999999999,"15min":0.93400000000000005},"min":{"1min":0.61199999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.413,"5min":1.728,"15min":1.728},"last":1.5740000000000001}]},{"osd":5,"last update":"Tue Oct 3 19:21:45 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":0.97499999999999998,"15min":0.91600000000000004},"min":{"1min":0.627,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.2989999999999999,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.0329999999999999,"5min":0.98299999999999998,"15min":0.91000000000000003},"min":{"1min":0.76100000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.323,"5min":1.323,"15min":1.6080000000000001},"last":1.179}]},{"osd":6,"last update":"Tue Oct 3 19:21:45 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.044,"15min":0.97799999999999998},"min":{"1min":0.66600000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4870000000000001,"5min":1.518,"15min":1.6659999999999999},"last":1.637},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.022,"15min":0.95599999999999996},"min":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3129999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.222}]},{"osd":7,"last update":"Tue Oct 3 19:21:45 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.056,"15min":0.997},"min":{"1min":0.77200000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.46,"5min":1.673,"15min":1.673},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0389999999999999,"15min":0.96699999999999997},"min":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.288,"5min":1.4430000000000001,"15min":1.649},"last":1.276}]}]},{"osd":3,"up_from":14,"seq":60129542264,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25828,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":24448,"kb_avail":94346012,"statfs":{"total":96636764160,"available":96610316288,"internally_reserved":0,"allocated":1404928,"data_stored":644122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25034752},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:21:39 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.63800000000000001,"15min":0.60599999999999998},"min":{"1min":0.56100000000000005,"5min":0.221,"15min":0.221},"max":{"1min":1.0169999999999999,"5min":1.1779999999999999,"15min":1.212},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69799999999999995,"15min":0.67100000000000004},"min":{"1min":0.55700000000000005,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.0680000000000001,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.88500000000000001}]},{"osd":1,"last update":"Tue Oct 3 19:21:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.68300000000000005,"15min":0.66200000000000003},"min":{"1min":0.55400000000000005,"5min":0.28599999999999998,"15min":0.27000000000000002},"max":{"1min":1.139,"5min":1.238,"15min":1.238},"last":0.745},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.76100000000000001,"15min":0.71299999999999997},"min":{"1min":0.53800000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.1679999999999999,"5min":1.204,"15min":1.222},"last":0.70499999999999996}]},{"osd":2,"last update":"Tue Oct 3 19:21:39 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.79200000000000004,"15min":0.751},"min":{"1min":0.54000000000000004,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0840000000000001,"5min":1.23,"15min":1.23},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.72999999999999998,"15min":0.68000000000000005},"min":{"1min":0.626,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.127,"5min":1.671,"15min":1.671},"last":0.64900000000000002}]},{"osd":4,"last update":"Tue Oct 3 19:21:39 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.74299999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.488,"5min":1.488,"15min":1.496},"last":1.087},{"interface":"front","average":{"1min":1.099,"5min":1.01,"15min":0.96899999999999997},"min":{"1min":0.89300000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.0089999999999999}]},{"osd":5,"last update":"Tue Oct 3 19:21:39 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.90900000000000003,"15min":0.89700000000000002},"min":{"1min":0.77500000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1910000000000001,"5min":1.581,"15min":1.581},"last":1.036},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0189999999999999,"15min":1.0109999999999999},"min":{"1min":0.73999999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3779999999999999,"5min":1.4399999999999999,"15min":1.498},"last":0.97299999999999998}]},{"osd":6,"last update":"Tue Oct 3 19:21:39 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":0.96599999999999997,"15min":0.94399999999999995},"min":{"1min":0.86499999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2629999999999999,"5min":1.347,"15min":1.347},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.056,"15min":1.022},"min":{"1min":0.78900000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.82999999999999996}]},{"osd":7,"last update":"Tue Oct 3 19:21:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.095,"15min":1.0449999999999999},"min":{"1min":0.82099999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.728,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.042,"15min":1.0369999999999999},"min":{"1min":0.85899999999999999,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.3200000000000001,"5min":1.659,"15min":1.708},"last":1.1160000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574967,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23460,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":22080,"kb_avail":94348380,"statfs":{"total":96636764160,"available":96612741120,"internally_reserved":0,"allocated":1404928,"data_stored":644122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22609920},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 19:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.86199999999999999,"15min":0.84299999999999997},"min":{"1min":0.51700000000000002,"5min":0.45100000000000001,"15min":0.437},"max":{"1min":1.2789999999999999,"5min":1.452,"15min":1.452},"last":0.88},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.90100000000000002,"15min":0.87},"min":{"1min":0.72199999999999998,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1279999999999999,"5min":1.26,"15min":1.5940000000000001},"last":1.0189999999999999}]},{"osd":1,"last update":"Tue Oct 3 19:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.86899999999999999,"15min":0.84899999999999998},"min":{"1min":0.57599999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.0469999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.89800000000000002,"15min":0.91500000000000004},"min":{"1min":0.70099999999999996,"5min":0.63100000000000001,"15min":0.57099999999999995},"max":{"1min":1.212,"5min":1.23,"15min":1.514},"last":0.99199999999999999}]},{"osd":2,"last update":"Tue Oct 3 19:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.91600000000000004,"15min":0.90500000000000003},"min":{"1min":0.72299999999999998,"5min":0.55400000000000005,"15min":0.55100000000000005},"max":{"1min":1.3280000000000001,"5min":1.351,"15min":1.3700000000000001},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.93100000000000005,"15min":0.91000000000000003},"min":{"1min":0.68100000000000005,"5min":0.57099999999999995,"15min":0.53300000000000003},"max":{"1min":1.1599999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.74199999999999999}]},{"osd":3,"last update":"Tue Oct 3 19:21:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.92000000000000004,"15min":0.92600000000000005},"min":{"1min":0.63700000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.196,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.01,"15min":1.024},"min":{"1min":0.86199999999999999,"5min":0.65900000000000003,"15min":0.61199999999999999},"max":{"1min":1.2929999999999999,"5min":1.508,"15min":1.6659999999999999},"last":1.206}]},{"osd":4,"last update":"Tue Oct 3 19:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.97799999999999998,"15min":0.97099999999999997},"min":{"1min":0.627,"5min":0.627,"15min":0.47199999999999998},"max":{"1min":1.1870000000000001,"5min":1.4530000000000001,"15min":1.5149999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.95199999999999996,"15min":0.999},"min":{"1min":0.68100000000000005,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2190000000000001,"5min":1.319,"15min":1.7709999999999999},"last":0.96499999999999997}]},{"osd":6,"last update":"Tue Oct 3 19:21:40 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0069999999999999,"15min":1.016},"min":{"1min":0.67800000000000005,"5min":0.64600000000000002,"15min":0.53600000000000003},"max":{"1min":1.421,"5min":1.546,"15min":1.546},"last":1.093},{"interface":"front","average":{"1min":1.075,"5min":1.0800000000000001,"15min":1.115},"min":{"1min":0.72099999999999997,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.2569999999999999,"5min":1.4159999999999999,"15min":1.823},"last":0.93799999999999994}]},{"osd":7,"last update":"Tue Oct 3 19:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.04,"15min":1.0620000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.66400000000000003},"max":{"1min":1.4379999999999999,"5min":1.4610000000000001,"15min":1.5680000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1180000000000001,"15min":1.139},"min":{"1min":0.95999999999999996,"5min":0.76000000000000001,"15min":0.71799999999999997},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.9099999999999999},"last":1.1559999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574968,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30880,"kb_used_data":1432,"kb_used_omap":0,"kb_used_meta":29440,"kb_avail":94340960,"statfs":{"total":96636764160,"available":96605143040,"internally_reserved":0,"allocated":1466368,"data_stored":1233326,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":30146560},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67600000000000005,"15min":0.624},"min":{"1min":0.27300000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.0569999999999999,"5min":5.7480000000000002,"15min":5.7480000000000002},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.78400000000000003,"15min":0.747},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":1.018,"5min":6.274,"15min":6.274},"last":0.81899999999999995}]},{"osd":2,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.80000000000000004,"15min":0.749},"min":{"1min":0.40500000000000003,"5min":0.36499999999999999,"15min":0.35399999999999998},"max":{"1min":0.998,"5min":6.1609999999999996,"15min":6.1609999999999996},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.71699999999999997,"15min":0.70699999999999996},"min":{"1min":0.32300000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.7170000000000001},"last":1.0289999999999999}]},{"osd":3,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.85299999999999998,"15min":0.78900000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.36799999999999999},"max":{"1min":1.135,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.78800000000000003,"15min":0.751},"min":{"1min":0.38700000000000001,"5min":0.376,"15min":0.30299999999999999},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.90500000000000003}]},{"osd":4,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.997,"15min":0.94299999999999995},"min":{"1min":0.57499999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.345,"5min":8.1159999999999997,"15min":8.1159999999999997},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.028,"5min":1.0620000000000001,"15min":1.0429999999999999},"min":{"1min":0.68000000000000005,"5min":0.57299999999999995,"15min":0.504},"max":{"1min":1.4259999999999999,"5min":6.2320000000000002,"15min":6.2320000000000002},"last":1.107}]},{"osd":5,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.2270000000000001,"15min":1.113},"min":{"1min":0.77000000000000002,"5min":0.59399999999999997,"15min":0.46899999999999997},"max":{"1min":1.298,"5min":17.420000000000002,"15min":17.420000000000002},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.1950000000000001,"15min":1.0589999999999999},"min":{"1min":0.621,"5min":0.59499999999999997,"15min":0.54300000000000004},"max":{"1min":1.296,"5min":17.643000000000001,"15min":17.643000000000001},"last":1.2809999999999999}]},{"osd":6,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0700000000000001,"15min":1.044},"min":{"1min":0.66600000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3540000000000001,"5min":5.7220000000000004,"15min":5.7220000000000004},"last":1.123},{"interface":"front","average":{"1min":1.109,"5min":1.0569999999999999,"15min":1.0249999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.534,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.073}]},{"osd":7,"last update":"Tue Oct 3 19:21:37 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.147,"15min":1.0840000000000001},"min":{"1min":0.77500000000000002,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.5740000000000001,"5min":5.7800000000000002,"15min":5.7800000000000002},"last":1.21},{"interface":"front","average":{"1min":1.147,"5min":1.0800000000000001,"15min":1.073},"min":{"1min":0.63700000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.6259999999999999,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.1479999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33375,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T19:22:07.480 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-03T19:22:07.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb552954640 1 Processor -- start 2023-10-03T19:22:07.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb552954640 1 -- start start 2023-10-03T19:22:07.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb552954640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb54c0712c0 0x7fb54c0bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:22:07.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb552954640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb54c06c760 0x7fb54c0bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:22:07.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb552954640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb54c06c2d0 con 0x7fb54c06d560 2023-10-03T19:22:07.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb552954640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54c150610 con 0x7fb54c06c760 2023-10-03T19:22:07.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb552954640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c1508b0 con 0x7fb54c0712c0 2023-10-03T19:22:07.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb54b7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb54c06d560 0x7fb54c0a53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51436/0 (socket says 172.21.15.45:51436) 2023-10-03T19:22:07.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb54b7fe640 1 -- 172.21.15.45:0/850221388 learned_addr learned my addr 172.21.15.45:0/850221388 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-10-03T19:22:07.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb54bfff640 1 --2- 172.21.15.45:0/850221388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb54c0712c0 0x7fb54c0bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:22:07.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb550ef1640 1 --2- 172.21.15.45:0/850221388 >> v2:172.21.15.79:3300/0 conn(0x7fb54c06c760 0x7fb54c0bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:22:07.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb54affd640 1 -- 172.21.15.45:0/850221388 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2395618390 0 0) 0x7fb54c06c2d0 con 0x7fb54c06d560 2023-10-03T19:22:07.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb54affd640 1 -- 172.21.15.45:0/850221388 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb534003530 con 0x7fb54c06d560 2023-10-03T19:22:07.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb54affd640 1 -- 172.21.15.45:0/850221388 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1665481609 0 0) 0x7fb534003530 con 0x7fb54c06d560 2023-10-03T19:22:07.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb54affd640 1 -- 172.21.15.45:0/850221388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb54c0712c0 msgr2=0x7fb54c0bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:22:07.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb54affd640 1 --2- 172.21.15.45:0/850221388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb54c0712c0 0x7fb54c0bcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:22:07.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb54affd640 1 -- 172.21.15.45:0/850221388 >> v2:172.21.15.79:3300/0 conn(0x7fb54c06c760 msgr2=0x7fb54c0bd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:22:07.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb54affd640 1 --2- 172.21.15.45:0/850221388 >> v2:172.21.15.79:3300/0 conn(0x7fb54c06c760 0x7fb54c0bd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:22:07.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb54affd640 1 -- 172.21.15.45:0/850221388 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54c06d2e0 con 0x7fb54c06d560 2023-10-03T19:22:07.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb54affd640 1 -- 172.21.15.45:0/850221388 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3183898558 0 0) 0x7fb540001680 con 0x7fb54c06d560 2023-10-03T19:22:07.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb54affd640 1 -- 172.21.15.45:0/850221388 >> v1:172.21.15.45:6789/0 conn(0x7fb54c06d560 legacy=0x7fb54c0a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:22:07.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb54affd640 1 --2- 172.21.15.45:0/850221388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb54c0712c0 0x7fb534003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:22:07.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb54affd640 1 --2- 172.21.15.45:0/850221388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb534003f00 0x7fb5340047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:22:07.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb54affd640 1 --2- 172.21.15.45:0/850221388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb534004d10 0x7fb534005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:22:07.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb54affd640 1 -- 172.21.15.45:0/850221388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c150610 con 0x7fb534004d10 2023-10-03T19:22:07.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb54affd640 1 -- 172.21.15.45:0/850221388 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c1508b0 con 0x7fb534003f00 2023-10-03T19:22:07.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb54affd640 1 -- 172.21.15.45:0/850221388 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb53400b990 con 0x7fb54c0712c0 2023-10-03T19:22:07.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb550ef1640 1 --2- 172.21.15.45:0/850221388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb534004d10 0x7fb534005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:22:07.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb54bfff640 1 --2- 172.21.15.45:0/850221388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb54c0712c0 0x7fb534003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:22:07.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb54b7fe640 1 --2- 172.21.15.45:0/850221388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb534003f00 0x7fb5340047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:22:07.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb550ef1640 1 -- 172.21.15.45:0/850221388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb54c0712c0 msgr2=0x7fb534003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:22:07.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb550ef1640 1 --2- 172.21.15.45:0/850221388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb54c0712c0 0x7fb534003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:22:07.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb550ef1640 1 -- 172.21.15.45:0/850221388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb534003f00 msgr2=0x7fb5340047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:22:07.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb550ef1640 1 --2- 172.21.15.45:0/850221388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb534003f00 0x7fb5340047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:22:07.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb550ef1640 1 -- 172.21.15.45:0/850221388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb534003530 con 0x7fb534004d10 2023-10-03T19:22:07.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.602+0000 7fb54bfff640 1 --2- 172.21.15.45:0/850221388 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb54c0712c0 0x7fb534003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T19:22:07.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.606+0000 7fb550ef1640 1 --2- 172.21.15.45:0/850221388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb534004d10 0x7fb534005180 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fb544009ab0 tx=0x7fb54401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5292495b39d4623f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:22:07.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.606+0000 7fb54affd640 1 -- 172.21.15.45:0/850221388 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5440a5660 con 0x7fb534004d10 2023-10-03T19:22:07.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.606+0000 7fb54affd640 1 -- 172.21.15.45:0/850221388 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5440a57c0 con 0x7fb534004d10 2023-10-03T19:22:07.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.606+0000 7fb54affd640 1 -- 172.21.15.45:0/850221388 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5440a5b70 con 0x7fb534004d10 2023-10-03T19:22:07.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.606+0000 7fb552954640 1 -- 172.21.15.45:0/850221388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb534004d10 msgr2=0x7fb534005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:22:07.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.606+0000 7fb552954640 1 --2- 172.21.15.45:0/850221388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb534004d10 0x7fb534005180 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fb544009ab0 tx=0x7fb54401ca70 comp rx=0 tx=0).stop 2023-10-03T19:22:07.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.606+0000 7fb550ef1640 1 -- 172.21.15.45:0/850221388 reap_dead start 2023-10-03T19:22:07.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.606+0000 7fb552954640 1 -- 172.21.15.45:0/850221388 shutdown_connections 2023-10-03T19:22:07.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.606+0000 7fb552954640 1 -- 172.21.15.45:0/850221388 >> 172.21.15.45:0/850221388 conn(0x7fb54c0a20d0 msgr2=0x7fb54c0a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:22:07.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.606+0000 7fb552954640 1 -- 172.21.15.45:0/850221388 shutdown_connections 2023-10-03T19:22:07.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.606+0000 7fb552954640 1 -- 172.21.15.45:0/850221388 wait complete. 2023-10-03T19:22:07.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.606+0000 7fb552954640 1 Processor -- start 2023-10-03T19:22:07.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.606+0000 7fb552954640 1 -- start start 2023-10-03T19:22:07.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.610+0000 7fb552954640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb54c14f010 0x7fb54c14b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:22:07.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.610+0000 7fb552954640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb54c06fb90 0x7fb54c13e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:22:07.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.610+0000 7fb552954640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb54c13eb70 0x7fb54c1e3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:22:07.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.610+0000 7fb552954640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c14d330 con 0x7fb54c06fb90 2023-10-03T19:22:07.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.610+0000 7fb552954640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c0a1f30 con 0x7fb54c13eb70 2023-10-03T19:22:07.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.610+0000 7fb552954640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c14d050 con 0x7fb54c14f010 2023-10-03T19:22:07.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.610+0000 7fb54b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb54c06fb90 0x7fb54c13e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:22:07.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.610+0000 7fb54b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb54c06fb90 0x7fb54c13e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53276/0 (socket says 172.21.15.45:53276) 2023-10-03T19:22:07.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.610+0000 7fb54b7fe640 1 -- 172.21.15.45:0/2803835641 learned_addr learned my addr 172.21.15.45:0/2803835641 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:22:07.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.610+0000 7fb54bfff640 1 --2- 172.21.15.45:0/2803835641 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb54c14f010 0x7fb54c14b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:22:07.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.610+0000 7fb54b7fe640 1 -- 172.21.15.45:0/2803835641 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb54c14f010 msgr2=0x7fb54c14b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:22:07.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.610+0000 7fb54b7fe640 1 --2- 172.21.15.45:0/2803835641 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb54c14f010 0x7fb54c14b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:22:07.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.610+0000 7fb54b7fe640 1 -- 172.21.15.45:0/2803835641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb54c13eb70 msgr2=0x7fb54c1e3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:22:07.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.610+0000 7fb54b7fe640 1 --2- 172.21.15.45:0/2803835641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb54c13eb70 0x7fb54c1e3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:22:07.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.610+0000 7fb54b7fe640 1 -- 172.21.15.45:0/2803835641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54c071690 con 0x7fb54c06fb90 2023-10-03T19:22:07.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.610+0000 7fb54b7fe640 1 --2- 172.21.15.45:0/2803835641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb54c06fb90 0x7fb54c13e630 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fb540000fc0 tx=0x7fb540004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:22:07.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.610+0000 7fb548ff9640 1 -- 172.21.15.45:0/2803835641 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54000f8e0 con 0x7fb54c06fb90 2023-10-03T19:22:07.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.610+0000 7fb548ff9640 1 -- 172.21.15.45:0/2803835641 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54000fa60 con 0x7fb54c06fb90 2023-10-03T19:22:07.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.610+0000 7fb552954640 1 -- 172.21.15.45:0/2803835641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54c06cf40 con 0x7fb54c06fb90 2023-10-03T19:22:07.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.610+0000 7fb548ff9640 1 -- 172.21.15.45:0/2803835641 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54000fe10 con 0x7fb54c06fb90 2023-10-03T19:22:07.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.610+0000 7fb552954640 1 -- 172.21.15.45:0/2803835641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54c071820 con 0x7fb54c06fb90 2023-10-03T19:22:07.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.610+0000 7fb552954640 1 -- 172.21.15.45:0/2803835641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb54c04de80 con 0x7fb54c06fb90 2023-10-03T19:22:07.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.610+0000 7fb548ff9640 1 -- 172.21.15.45:0/2803835641 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb54001d460 con 0x7fb54c06fb90 2023-10-03T19:22:07.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.610+0000 7fb548ff9640 1 --2- 172.21.15.45:0/2803835641 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb538066280 0x7fb538068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:22:07.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.610+0000 7fb548ff9640 1 -- 172.21.15.45:0/2803835641 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fb540083ae0 con 0x7fb54c06fb90 2023-10-03T19:22:07.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.610+0000 7fb54bfff640 1 --2- 172.21.15.45:0/2803835641 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb538066280 0x7fb538068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:22:07.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.614+0000 7fb54bfff640 1 --2- 172.21.15.45:0/2803835641 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb538066280 0x7fb538068730 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb53c007520 tx=0x7fb53c00b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:22:07.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.614+0000 7fb548ff9640 1 -- 172.21.15.45:0/2803835641 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb540051380 con 0x7fb54c06fb90 2023-10-03T19:22:07.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.770+0000 7fb552954640 1 -- 172.21.15.45:0/2803835641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fb54c1e3790 con 0x7fb54c06fb90 2023-10-03T19:22:07.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.778+0000 7fb548ff9640 1 -- 172.21.15.45:0/2803835641 <== mon.0 v2:172.21.15.45:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb540051380 con 0x7fb54c06fb90 2023-10-03T19:22:07.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.778+0000 7fb548ff9640 1 -- 172.21.15.45:0/2803835641 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v24)=0 v24) v1 ==== 123+0+0 (secure 0 0 0) 0x7fb5400549a0 con 0x7fb54c06fb90 2023-10-03T19:22:07.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.782+0000 7fb552954640 1 -- 172.21.15.45:0/2803835641 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb538066280 msgr2=0x7fb538068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:22:07.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.782+0000 7fb552954640 1 --2- 172.21.15.45:0/2803835641 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb538066280 0x7fb538068730 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb53c007520 tx=0x7fb53c00b040 comp rx=0 tx=0).stop 2023-10-03T19:22:07.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.782+0000 7fb552954640 1 -- 172.21.15.45:0/2803835641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb54c06fb90 msgr2=0x7fb54c13e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:22:07.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.782+0000 7fb552954640 1 --2- 172.21.15.45:0/2803835641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb54c06fb90 0x7fb54c13e630 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fb540000fc0 tx=0x7fb540004f90 comp rx=0 tx=0).stop 2023-10-03T19:22:07.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.782+0000 7fb552954640 1 -- 172.21.15.45:0/2803835641 shutdown_connections 2023-10-03T19:22:07.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.782+0000 7fb552954640 1 --2- 172.21.15.45:0/2803835641 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7fb538066280 0x7fb538068730 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:22:07.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.782+0000 7fb552954640 1 --2- 172.21.15.45:0/2803835641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb54c13eb70 0x7fb54c1e3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:22:07.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.782+0000 7fb552954640 1 --2- 172.21.15.45:0/2803835641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb54c06fb90 0x7fb54c13e630 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:22:07.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.782+0000 7fb552954640 1 --2- 172.21.15.45:0/2803835641 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb54c14f010 0x7fb54c14b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:22:07.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.782+0000 7fb552954640 1 -- 172.21.15.45:0/2803835641 >> 172.21.15.45:0/2803835641 conn(0x7fb54c0a20d0 msgr2=0x7fb54c148460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:22:07.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.782+0000 7fb552954640 1 -- 172.21.15.45:0/2803835641 shutdown_connections 2023-10-03T19:22:07.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.782+0000 7fb552954640 1 -- 172.21.15.45:0/2803835641 wait complete. 2023-10-03T19:22:07.804 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-03T19:22:07.804 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T19:22:07.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.922+0000 7f331dfb4640 1 Processor -- start 2023-10-03T19:22:07.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.922+0000 7f331dfb4640 1 -- start start 2023-10-03T19:22:07.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.922+0000 7f331dfb4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33180c5160 0x7f3318069ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:22:07.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.922+0000 7f331dfb4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f33180c5530 0x7f33180a9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:22:07.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.922+0000 7f331dfb4640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f331814f120 con 0x7f33180bf200 2023-10-03T19:22:07.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.922+0000 7f331dfb4640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f331814f650 con 0x7f33180c5530 2023-10-03T19:22:07.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.922+0000 7f331dfb4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33180aa430 con 0x7f33180c5160 2023-10-03T19:22:07.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.922+0000 7f330effd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f33180c5530 0x7f33180a9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:22:07.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.922+0000 7f330effd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f33180c5530 0x7f33180a9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53292/0 (socket says 172.21.15.45:53292) 2023-10-03T19:22:07.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.922+0000 7f3317fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f33180bf200 0x7f33180c3ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51442/0 (socket says 172.21.15.45:51442) 2023-10-03T19:22:07.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.922+0000 7f330effd640 1 -- 172.21.15.45:0/955048525 learned_addr learned my addr 172.21.15.45:0/955048525 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:22:07.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.922+0000 7f33177fe640 1 --2- 172.21.15.45:0/955048525 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33180c5160 0x7f3318069ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:22:07.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.922+0000 7f330effd640 1 -- 172.21.15.45:0/955048525 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33180c5160 msgr2=0x7f3318069ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T19:22:07.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.922+0000 7f330effd640 1 --2- 172.21.15.45:0/955048525 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33180c5160 0x7f3318069ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:22:07.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.922+0000 7f330effd640 1 -- 172.21.15.45:0/955048525 >> v1:172.21.15.45:6789/0 conn(0x7f33180bf200 legacy=0x7f33180c3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:22:07.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.922+0000 7f330effd640 1 -- 172.21.15.45:0/955048525 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f331814f370 con 0x7f33180c5530 2023-10-03T19:22:07.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.926+0000 7f330effd640 1 --2- 172.21.15.45:0/955048525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33180c5530 0x7f33180a9850 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f3300009870 tx=0x7f330001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37769147b4ca2b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:22:07.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.926+0000 7f3316ffd640 1 -- 172.21.15.45:0/955048525 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33000ab600 con 0x7f33180c5530 2023-10-03T19:22:07.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.926+0000 7f3316ffd640 1 -- 172.21.15.45:0/955048525 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f33000a7050 con 0x7f33180c5530 2023-10-03T19:22:07.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.926+0000 7f3316ffd640 1 -- 172.21.15.45:0/955048525 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33000ab9a0 con 0x7f33180c5530 2023-10-03T19:22:07.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.926+0000 7f331dfb4640 1 -- 172.21.15.45:0/955048525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33180c5530 msgr2=0x7f33180a9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:22:07.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.926+0000 7f331dfb4640 1 --2- 172.21.15.45:0/955048525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33180c5530 0x7f33180a9850 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f3300009870 tx=0x7f330001c4b0 comp rx=0 tx=0).stop 2023-10-03T19:22:07.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.926+0000 7f331dfb4640 1 -- 172.21.15.45:0/955048525 shutdown_connections 2023-10-03T19:22:07.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.926+0000 7f331dfb4640 1 --2- 172.21.15.45:0/955048525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33180c5530 0x7f33180a9850 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:22:07.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.926+0000 7f331dfb4640 1 --2- 172.21.15.45:0/955048525 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33180c5160 0x7f3318069ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:22:07.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.926+0000 7f331dfb4640 1 -- 172.21.15.45:0/955048525 >> 172.21.15.45:0/955048525 conn(0x7f33180a7080 msgr2=0x7f33180c4880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:22:07.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.926+0000 7f331dfb4640 1 -- 172.21.15.45:0/955048525 shutdown_connections 2023-10-03T19:22:07.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.926+0000 7f331dfb4640 1 -- 172.21.15.45:0/955048525 wait complete. 2023-10-03T19:22:07.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.926+0000 7f331dfb4640 1 Processor -- start 2023-10-03T19:22:07.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.926+0000 7f331dfb4640 1 -- start start 2023-10-03T19:22:07.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.926+0000 7f331dfb4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33180bf200 0x7f33181534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:22:07.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.926+0000 7f331dfb4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33180c5160 0x7f33180bdd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:22:07.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.926+0000 7f331dfb4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33181519a0 0x7f33181ea2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:22:07.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.926+0000 7f331dfb4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3318153a10 con 0x7f33180bf200 2023-10-03T19:22:07.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.926+0000 7f331dfb4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3318153040 con 0x7f33181519a0 2023-10-03T19:22:07.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.926+0000 7f331dfb4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33180be2c0 con 0x7f33180c5160 2023-10-03T19:22:07.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.926+0000 7f33177fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33180bf200 0x7f33181534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:22:07.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.926+0000 7f33177fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33180bf200 0x7f33181534d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53300/0 (socket says 172.21.15.45:53300) 2023-10-03T19:22:07.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.926+0000 7f33177fe640 1 -- 172.21.15.45:0/1479424958 learned_addr learned my addr 172.21.15.45:0/1479424958 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-10-03T19:22:07.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.930+0000 7f33177fe640 1 -- 172.21.15.45:0/1479424958 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33180c5160 msgr2=0x7f33180bdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:22:07.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.930+0000 7f33177fe640 1 --2- 172.21.15.45:0/1479424958 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33180c5160 0x7f33180bdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:22:07.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.930+0000 7f33177fe640 1 -- 172.21.15.45:0/1479424958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33181519a0 msgr2=0x7f33181ea2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:22:07.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.930+0000 7f33177fe640 1 --2- 172.21.15.45:0/1479424958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33181519a0 0x7f33181ea2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:22:07.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.930+0000 7f33177fe640 1 -- 172.21.15.45:0/1479424958 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33000094d0 con 0x7f33180bf200 2023-10-03T19:22:07.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.930+0000 7f33177fe640 1 --2- 172.21.15.45:0/1479424958 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33180bf200 0x7f33181534d0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f330800d860 tx=0x7f330800dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:22:07.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.930+0000 7f3314ff9640 1 -- 172.21.15.45:0/1479424958 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330800de50 con 0x7f33180bf200 2023-10-03T19:22:07.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.930+0000 7f3314ff9640 1 -- 172.21.15.45:0/1479424958 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f330800b870 con 0x7f33180bf200 2023-10-03T19:22:07.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.930+0000 7f3314ff9640 1 -- 172.21.15.45:0/1479424958 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330800bc00 con 0x7f33180bf200 2023-10-03T19:22:07.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.930+0000 7f331dfb4640 1 -- 172.21.15.45:0/1479424958 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f331806a1a0 con 0x7f33180bf200 2023-10-03T19:22:07.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.930+0000 7f331dfb4640 1 -- 172.21.15.45:0/1479424958 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f331806a010 con 0x7f33180bf200 2023-10-03T19:22:07.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.930+0000 7f331dfb4640 1 -- 172.21.15.45:0/1479424958 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f331806a330 con 0x7f33180bf200 2023-10-03T19:22:07.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.930+0000 7f3314ff9640 1 -- 172.21.15.45:0/1479424958 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f330800bd60 con 0x7f33180bf200 2023-10-03T19:22:07.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.930+0000 7f3314ff9640 1 --2- 172.21.15.45:0/1479424958 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f32f80662b0 0x7f32f8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T19:22:07.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.930+0000 7f3314ff9640 1 -- 172.21.15.45:0/1479424958 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f3308084110 con 0x7f33180bf200 2023-10-03T19:22:07.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.930+0000 7f330effd640 1 --2- 172.21.15.45:0/1479424958 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f32f80662b0 0x7f32f8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T19:22:07.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.930+0000 7f330effd640 1 --2- 172.21.15.45:0/1479424958 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f32f80662b0 0x7f32f8068760 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f33000ad000 tx=0x7f3300004740 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T19:22:07.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:07.934+0000 7f3314ff9640 1 -- 172.21.15.45:0/1479424958 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f33080516a0 con 0x7f33180bf200 2023-10-03T19:22:08.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:08.122+0000 7f331dfb4640 1 -- 172.21.15.45:0/1479424958 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33180bfcb0 con 0x7f33180bf200 2023-10-03T19:22:08.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:08.126+0000 7f3314ff9640 1 -- 172.21.15.45:0/1479424958 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+2769 (secure 0 0 0) 0x7f33080535d0 con 0x7f33180bf200 2023-10-03T19:22:08.130 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-10-03T19:22:08.130 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":60,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3566869652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3566869652},{"type":"v1","addr":"172.21.15.79:6835","nonce":3566869652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":7587,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2339652261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2339652261},{"type":"v1","addr":"172.21.15.45:6833","nonce":2339652261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":7989,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/935224326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":935224326},{"type":"v1","addr":"172.21.15.45:6835","nonce":935224326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[]} 2023-10-03T19:22:08.131 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 60 2023-10-03T19:22:08.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:08.126+0000 7f331dfb4640 1 -- 172.21.15.45:0/1479424958 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f32f80662b0 msgr2=0x7f32f8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:22:08.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:08.126+0000 7f331dfb4640 1 --2- 172.21.15.45:0/1479424958 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f32f80662b0 0x7f32f8068760 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f33000ad000 tx=0x7f3300004740 comp rx=0 tx=0).stop 2023-10-03T19:22:08.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:08.126+0000 7f331dfb4640 1 -- 172.21.15.45:0/1479424958 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33180bf200 msgr2=0x7f33181534d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T19:22:08.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:08.126+0000 7f331dfb4640 1 --2- 172.21.15.45:0/1479424958 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33180bf200 0x7f33181534d0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f330800d860 tx=0x7f330800dd20 comp rx=0 tx=0).stop 2023-10-03T19:22:08.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:08.126+0000 7f331dfb4640 1 -- 172.21.15.45:0/1479424958 shutdown_connections 2023-10-03T19:22:08.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:08.126+0000 7f331dfb4640 1 --2- 172.21.15.45:0/1479424958 >> [v2:172.21.15.79:6800/1497032475,v1:172.21.15.79:6801/1497032475] conn(0x7f32f80662b0 0x7f32f8068760 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:22:08.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:08.126+0000 7f331dfb4640 1 --2- 172.21.15.45:0/1479424958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33181519a0 0x7f33181ea2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:22:08.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:08.126+0000 7f331dfb4640 1 --2- 172.21.15.45:0/1479424958 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33180c5160 0x7f33180bdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:22:08.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:08.126+0000 7f331dfb4640 1 --2- 172.21.15.45:0/1479424958 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33180bf200 0x7f33181534d0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T19:22:08.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:08.126+0000 7f331dfb4640 1 -- 172.21.15.45:0/1479424958 >> 172.21.15.45:0/1479424958 conn(0x7f33180a7080 msgr2=0x7f33180c4880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T19:22:08.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:08.126+0000 7f331dfb4640 1 -- 172.21.15.45:0/1479424958 shutdown_connections 2023-10-03T19:22:08.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-10-03T19:22:08.126+0000 7f331dfb4640 1 -- 172.21.15.45:0/1479424958 wait complete. 2023-10-03T19:22:08.149 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-03T19:22:08.149 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-03T19:22:08.150 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-03T19:22:08.150 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:22:08.161 INFO:tasks.ceph.mds.a:Stopped 2023-10-03T19:22:08.161 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-03T19:22:08.161 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:22:08.216 INFO:tasks.ceph.mds.c:Stopped 2023-10-03T19:22:08.217 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-03T19:22:08.217 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:22:08.235 INFO:tasks.ceph.mds.b:Stopped 2023-10-03T19:22:08.235 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-03T19:22:08.236 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-03T19:22:08.236 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:22:08.309 INFO:tasks.ceph.osd.0:Stopped 2023-10-03T19:22:08.309 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-03T19:22:08.310 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:22:08.394 INFO:tasks.ceph.osd.1:Stopped 2023-10-03T19:22:08.394 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-03T19:22:08.395 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:22:08.492 INFO:tasks.ceph.osd.2:Stopped 2023-10-03T19:22:08.492 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-03T19:22:08.492 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:22:08.580 INFO:tasks.ceph.osd.3:Stopped 2023-10-03T19:22:08.580 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-03T19:22:08.580 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:22:08.680 INFO:tasks.ceph.osd.4:Stopped 2023-10-03T19:22:08.680 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-03T19:22:08.680 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:22:08.766 INFO:tasks.ceph.osd.5:Stopped 2023-10-03T19:22:08.767 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-03T19:22:08.767 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:22:08.861 INFO:tasks.ceph.osd.6:Stopped 2023-10-03T19:22:08.861 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-03T19:22:08.861 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:22:08.959 INFO:tasks.ceph.osd.7:Stopped 2023-10-03T19:22:08.959 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-03T19:22:08.959 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-03T19:22:08.959 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:22:08.987 INFO:tasks.ceph.mgr.y:Stopped 2023-10-03T19:22:08.988 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-03T19:22:08.988 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:22:09.016 INFO:tasks.ceph.mgr.x:Stopped 2023-10-03T19:22:09.016 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-03T19:22:09.016 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-03T19:22:09.016 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:22:09.048 INFO:tasks.ceph.mon.a:Stopped 2023-10-03T19:22:09.049 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-03T19:22:09.049 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:22:09.071 INFO:tasks.ceph.mon.b:Stopped 2023-10-03T19:22:09.071 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-03T19:22:09.071 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T19:22:09.135 INFO:tasks.ceph.mon.c:Stopped 2023-10-03T19:22:09.136 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-03T19:22:09.136 DEBUG:teuthology.orchestra.run.smithi045:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'evicting unresponsive client' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'has not responded to cap revoke by MDS for over' | egrep -v MDS_CLIENT_LATE_RELEASE | egrep -v 'responding to mclientcaps' | egrep -v RECENT_CRASH | head -n 1 2023-10-03T19:22:09.155 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi045.front.sepia.ceph.com 2023-10-03T19:22:09.155 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-03T19:22:09.605 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi045.front.sepia.ceph.com 2023-10-03T19:22:09.605 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-03T19:22:09.790 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi045.front.sepia.ceph.com 2023-10-03T19:22:09.790 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-03T19:22:09.925 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi045.front.sepia.ceph.com 2023-10-03T19:22:09.925 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-03T19:22:10.042 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi079.front.sepia.ceph.com 2023-10-03T19:22:10.042 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-03T19:22:10.209 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi079.front.sepia.ceph.com 2023-10-03T19:22:10.209 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-03T19:22:10.364 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi079.front.sepia.ceph.com 2023-10-03T19:22:10.364 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-03T19:22:10.514 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi079.front.sepia.ceph.com 2023-10-03T19:22:10.515 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-03T19:22:10.632 INFO:tasks.ceph:Archiving mon data... 2023-10-03T19:22:10.633 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409792/data/mon.a.tgz 2023-10-03T19:22:10.633 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2023-10-03T19:22:10.640 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.olHVGRg39y 2023-10-03T19:22:10.640 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.olHVGRg39y 2023-10-03T19:22:10.775 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0666 /tmp/tmp.olHVGRg39y 2023-10-03T19:22:10.837 DEBUG:teuthology.orchestra.remote:smithi045:/tmp/tmp.olHVGRg39y is 364KB 2023-10-03T19:22:10.899 DEBUG:teuthology.orchestra.run.smithi045:> rm -fr /tmp/tmp.olHVGRg39y 2023-10-03T19:22:10.905 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409792/data/mon.b.tgz 2023-10-03T19:22:10.905 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2023-10-03T19:22:10.911 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.PnV2LgcdjD 2023-10-03T19:22:10.911 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.PnV2LgcdjD 2023-10-03T19:22:11.043 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.PnV2LgcdjD 2023-10-03T19:22:11.110 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.PnV2LgcdjD is 370KB 2023-10-03T19:22:11.127 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.PnV2LgcdjD 2023-10-03T19:22:11.132 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409792/data/mon.c.tgz 2023-10-03T19:22:11.132 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2023-10-03T19:22:11.182 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.kyFKp2TIhP 2023-10-03T19:22:11.182 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.kyFKp2TIhP 2023-10-03T19:22:11.313 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.kyFKp2TIhP 2023-10-03T19:22:11.373 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.kyFKp2TIhP is 370KB 2023-10-03T19:22:11.431 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.kyFKp2TIhP 2023-10-03T19:22:11.436 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-03T19:22:11.436 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-03T19:22:11.438 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-03T19:22:11.479 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-03T19:22:11.481 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-03T19:22:11.495 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-03T19:22:11.496 DEBUG:teuthology.orchestra.run.smithi045:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-03T19:22:11.498 DEBUG:teuthology.orchestra.run.smithi079:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-03T19:22:11.521 INFO:teuthology.orchestra.run.smithi045.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-03T19:22:11.535 DEBUG:teuthology.orchestra.run.smithi146:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-03T19:22:11.537 DEBUG:teuthology.orchestra.run.smithi172:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-03T19:22:11.558 INFO:teuthology.orchestra.run.smithi079.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-03T19:22:11.559 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-03T19:22:11.645 INFO:teuthology.orchestra.run.smithi172.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-03T19:22:11.649 INFO:tasks.ceph:Archiving crash dumps... 2023-10-03T19:22:11.651 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/crash to /home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409792/remote/smithi045/crash 2023-10-03T19:22:11.652 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-03T19:22:11.667 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/crash to /home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409792/remote/smithi079/crash 2023-10-03T19:22:11.668 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-03T19:22:11.680 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/crash to /home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409792/remote/smithi146/crash 2023-10-03T19:22:11.681 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-03T19:22:11.695 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/crash to /home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409792/remote/smithi172/crash 2023-10-03T19:22:11.696 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-03T19:22:11.708 INFO:tasks.ceph:Shutting down logrotate 2023-10-03T19:22:11.708 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:22:11.714 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:22:11.727 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:22:11.742 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-03T19:22:11.799 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-03T19:22:11.813 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-03T19:22:11.825 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-03T19:22:11.838 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-03T19:22:11.850 INFO:tasks.ceph:Compressing logs... 2023-10-03T19:22:11.850 DEBUG:teuthology.orchestra.run.smithi045:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-03T19:22:11.859 DEBUG:teuthology.orchestra.run.smithi079:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-03T19:22:11.871 DEBUG:teuthology.orchestra.run.smithi146:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-03T19:22:11.882 DEBUG:teuthology.orchestra.run.smithi172:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-03T19:22:29.962 INFO:tasks.ceph:Archiving logs... 2023-10-03T19:22:29.963 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/log/ceph to /home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409792/remote/smithi045/log 2023-10-03T19:22:29.964 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-03T19:22:32.064 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/log/ceph to /home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409792/remote/smithi079/log 2023-10-03T19:22:32.065 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-03T19:22:33.162 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/log/ceph to /home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409792/remote/smithi146/log 2023-10-03T19:22:33.164 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-03T19:22:33.397 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409792/remote/smithi172/log 2023-10-03T19:22:33.398 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-03T19:22:33.417 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-03T19:22:33.426 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-03T19:22:33.427 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-03T19:22:33.429 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-03T19:22:33.432 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-03T19:22:33.434 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-03T19:22:33.574 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-03T19:22:33.584 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-03T19:22:33.584 DEBUG:teuthology.orchestra.run.smithi045:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-03T19:22:33.587 DEBUG:teuthology.orchestra.run.smithi079:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-03T19:22:33.589 DEBUG:teuthology.orchestra.run.smithi146:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-03T19:22:33.592 DEBUG:teuthology.orchestra.run.smithi172:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-03T19:22:33.599 INFO:teuthology.orchestra.run.smithi079.stdout: remote refid st t when poll reach delay offset jitter 2023-10-03T19:22:33.599 INFO:teuthology.orchestra.run.smithi079.stdout:============================================================================== 2023-10-03T19:22:33.600 INFO:teuthology.orchestra.run.smithi079.stdout:*hv01.front.sepi 44.4.53.2 2 u 48 64 377 0.111 -1.768 3.542 2023-10-03T19:22:33.600 INFO:teuthology.orchestra.run.smithi079.stdout:+hv02.front.sepi 63.231.80.2 3 u 37 64 377 0.083 -7.658 2.054 2023-10-03T19:22:33.600 INFO:teuthology.orchestra.run.smithi079.stdout:+hv03.front.sepi 74.6.168.72 3 u 46 64 377 0.098 -1.411 3.815 2023-10-03T19:22:33.600 INFO:teuthology.orchestra.run.smithi079.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2023-10-03T19:22:33.601 INFO:teuthology.orchestra.run.smithi045.stdout: remote refid st t when poll reach delay offset jitter 2023-10-03T19:22:33.602 INFO:teuthology.orchestra.run.smithi045.stdout:============================================================================== 2023-10-03T19:22:33.602 INFO:teuthology.orchestra.run.smithi045.stdout:*hv01.front.sepi 44.4.53.2 2 u 46 64 377 0.079 -1.425 0.896 2023-10-03T19:22:33.602 INFO:teuthology.orchestra.run.smithi045.stdout:+hv02.front.sepi 63.231.80.2 3 u 41 64 377 0.115 -4.114 0.937 2023-10-03T19:22:33.602 INFO:teuthology.orchestra.run.smithi045.stdout:+hv03.front.sepi 74.6.168.72 3 u 43 64 377 0.088 -1.337 1.037 2023-10-03T19:22:33.602 INFO:teuthology.orchestra.run.smithi045.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2023-10-03T19:22:33.603 INFO:teuthology.orchestra.run.smithi146.stdout: remote refid st t when poll reach delay offset jitter 2023-10-03T19:22:33.604 INFO:teuthology.orchestra.run.smithi146.stdout:============================================================================== 2023-10-03T19:22:33.604 INFO:teuthology.orchestra.run.smithi146.stdout:*hv01.front.sepi 44.4.53.2 2 u 47 64 377 0.094 -0.029 0.418 2023-10-03T19:22:33.604 INFO:teuthology.orchestra.run.smithi146.stdout:+hv02.front.sepi 63.231.80.2 3 u 52 64 377 0.067 -2.644 0.448 2023-10-03T19:22:33.604 INFO:teuthology.orchestra.run.smithi146.stdout:+hv03.front.sepi 74.6.168.72 3 u 42 64 377 0.084 +0.677 0.828 2023-10-03T19:22:33.604 INFO:teuthology.orchestra.run.smithi146.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2023-10-03T19:22:33.605 INFO:teuthology.orchestra.run.smithi172.stdout: remote refid st t when poll reach delay offset jitter 2023-10-03T19:22:33.605 INFO:teuthology.orchestra.run.smithi172.stdout:============================================================================== 2023-10-03T19:22:33.605 INFO:teuthology.orchestra.run.smithi172.stdout:*hv01.front.sepi 44.4.53.2 2 u 41 64 377 0.072 +0.912 4.198 2023-10-03T19:22:33.605 INFO:teuthology.orchestra.run.smithi172.stdout:+hv02.front.sepi 63.231.80.2 3 u 48 64 377 0.113 -4.483 2.375 2023-10-03T19:22:33.605 INFO:teuthology.orchestra.run.smithi172.stdout:+hv03.front.sepi 74.6.168.72 3 u 41 64 377 0.113 +1.263 4.452 2023-10-03T19:22:33.605 INFO:teuthology.orchestra.run.smithi172.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2023-10-03T19:22:33.606 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-03T19:22:33.657 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-03T19:22:33.657 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-03T19:22:33.670 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-03T19:22:33.678 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-03T19:22:33.687 INFO:teuthology.task.internal:Duration was 1330.486555 seconds 2023-10-03T19:22:33.687 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-03T19:22:33.696 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-03T19:22:33.696 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-03T19:22:33.699 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-03T19:22:33.701 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-03T19:22:33.704 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-03T19:22:33.791 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-03T19:22:33.791 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi045.front.sepia.ceph.com 2023-10-03T19:22:33.791 DEBUG:teuthology.orchestra.run.smithi045:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-03T19:22:33.802 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi079.front.sepia.ceph.com 2023-10-03T19:22:33.802 DEBUG:teuthology.orchestra.run.smithi079:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-03T19:22:33.811 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi146.front.sepia.ceph.com 2023-10-03T19:22:33.812 DEBUG:teuthology.orchestra.run.smithi146:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-03T19:22:33.821 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi172.front.sepia.ceph.com 2023-10-03T19:22:33.821 DEBUG:teuthology.orchestra.run.smithi172:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-03T19:22:33.832 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-03T19:22:33.832 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-03T19:22:33.846 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-03T19:22:33.858 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-03T19:22:33.865 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-03T19:22:33.895 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-03T19:22:33.895 DEBUG:teuthology.orchestra.run.smithi045:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-03T19:22:33.914 DEBUG:teuthology.orchestra.run.smithi079:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-03T19:22:33.922 DEBUG:teuthology.orchestra.run.smithi146:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-03T19:22:33.929 DEBUG:teuthology.orchestra.run.smithi172:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-03T19:22:33.990 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-03T19:22:34.000 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-03T19:22:34.000 DEBUG:teuthology.orchestra.run.smithi045:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-03T19:22:34.013 DEBUG:teuthology.orchestra.run.smithi079:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-03T19:22:34.027 DEBUG:teuthology.orchestra.run.smithi146:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-03T19:22:34.039 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-03T19:22:34.052 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-03T19:22:34.062 DEBUG:teuthology.orchestra.run.smithi045:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-03T19:22:34.064 DEBUG:teuthology.orchestra.run.smithi079:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-03T19:22:34.071 DEBUG:teuthology.orchestra.run.smithi146:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-03T19:22:34.075 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = core 2023-10-03T19:22:34.079 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = core 2023-10-03T19:22:34.082 DEBUG:teuthology.orchestra.run.smithi172:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-03T19:22:34.090 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = core 2023-10-03T19:22:34.104 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = core 2023-10-03T19:22:34.116 DEBUG:teuthology.orchestra.run.smithi045:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-03T19:22:34.144 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T19:22:34.145 DEBUG:teuthology.orchestra.run.smithi079:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-03T19:22:34.153 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T19:22:34.154 DEBUG:teuthology.orchestra.run.smithi146:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-03T19:22:34.158 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T19:22:34.159 DEBUG:teuthology.orchestra.run.smithi172:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-03T19:22:34.163 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T19:22:34.163 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-03T19:22:34.174 INFO:teuthology.task.internal:Transferring archived files... 2023-10-03T19:22:34.175 DEBUG:teuthology.misc:Transferring archived files from smithi045:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409792/remote/smithi045 2023-10-03T19:22:34.175 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-03T19:22:34.208 DEBUG:teuthology.misc:Transferring archived files from smithi079:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409792/remote/smithi079 2023-10-03T19:22:34.208 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-03T19:22:34.229 DEBUG:teuthology.misc:Transferring archived files from smithi146:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409792/remote/smithi146 2023-10-03T19:22:34.229 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-03T19:22:34.248 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409792/remote/smithi172 2023-10-03T19:22:34.248 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-03T19:22:34.267 INFO:teuthology.task.internal:Removing archive directory... 2023-10-03T19:22:34.267 DEBUG:teuthology.orchestra.run.smithi045:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-03T19:22:34.269 DEBUG:teuthology.orchestra.run.smithi079:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-03T19:22:34.275 DEBUG:teuthology.orchestra.run.smithi146:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-03T19:22:34.290 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-03T19:22:34.319 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-03T19:22:34.331 INFO:teuthology.task.internal:Not uploading archives. 2023-10-03T19:22:34.331 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-03T19:22:34.340 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-03T19:22:34.340 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-03T19:22:34.343 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-03T19:22:34.345 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-03T19:22:34.346 INFO:teuthology.orchestra.run.smithi045.stdout: 655472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 3 19:22 /home/ubuntu/cephtest 2023-10-03T19:22:34.348 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-03T19:22:34.349 INFO:teuthology.orchestra.run.smithi079.stdout: 658631 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 3 19:22 /home/ubuntu/cephtest 2023-10-03T19:22:34.351 INFO:teuthology.orchestra.run.smithi146.stdout: 655470 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 3 19:22 /home/ubuntu/cephtest 2023-10-03T19:22:34.367 INFO:teuthology.orchestra.run.smithi172.stdout: 655472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 3 19:22 /home/ubuntu/cephtest 2023-10-03T19:22:34.368 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-03T19:22:34.379 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-03T19:22:34.398 INFO:teuthology.nuke:Checking targets against current locks 2023-10-03T19:22:34.424 DEBUG:teuthology.nuke:shortname: smithi045 2023-10-03T19:22:34.424 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-03T19:22:34.446 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409792', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 18:51:06.337130', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBJfsaj1djbOti81Dmn5qO0pfO5rYcvniGIAtp+MIUvkVmtGd9VXAp06DIE/qyqJOyjh5SZa6UesWBZxgky+s4U='} 2023-10-03T19:22:34.451 DEBUG:teuthology.nuke:shortname: smithi079 2023-10-03T19:22:34.452 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-03T19:22:34.474 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409792', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 18:51:06.338221', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKgpdiDVkYYXQbbURBwT9Rp8YDcnmAh2JRm/q5erIc+gDdvR4Mxzhp1KpKacw1JRbdCOH6jNalhbDy1hqwVjlcg='} 2023-10-03T19:22:34.478 DEBUG:teuthology.nuke:shortname: smithi146 2023-10-03T19:22:34.478 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-03T19:22:34.489 INFO:teuthology.orchestra.console.smithi045:Power off 2023-10-03T19:22:34.490 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-03T19:22:34.501 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409792', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 18:51:06.334219', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBMtZSn5l68ULSewvnabptb3DKz9uudJEq10NeUGv4Rt65sNrEqRevCUYjra9dz+LkBRhymwHaIunBYfmm5hk4c='} 2023-10-03T19:22:34.504 DEBUG:teuthology.nuke:shortname: smithi172 2023-10-03T19:22:34.504 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-03T19:22:34.516 DEBUG:teuthology.orchestra.console.smithi045:power off output: Chassis Power Control: Down/Off 2023-10-03T19:22:34.517 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T19:22:34.533 INFO:teuthology.orchestra.console.smithi079:Power off 2023-10-03T19:22:34.533 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-03T19:22:34.544 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409792', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 18:51:06.336036', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBARCcmEfPgLbLeMB5pthXEkrZT5nqdfdF5Ubx6PDhdBG6RidO06YCSAxrRhSCHTNcaw7nUa1ndiM3aIPmuwM5og='} 2023-10-03T19:22:34.549 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-10-03T19:22:34.554 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off 2023-10-03T19:22:34.554 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T19:22:34.579 INFO:teuthology.orchestra.console.smithi146:Power off 2023-10-03T19:22:34.579 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-03T19:22:34.592 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-10-03T19:22:34.601 DEBUG:teuthology.orchestra.console.smithi146:power off output: Chassis Power Control: Down/Off 2023-10-03T19:22:34.602 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T19:22:34.620 INFO:teuthology.orchestra.console.smithi172:Power off 2023-10-03T19:22:34.621 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-03T19:22:34.629 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-10-03T19:22:34.643 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2023-10-03T19:22:34.643 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T19:22:34.663 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-10-03T19:22:38.550 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T19:22:38.593 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T19:22:38.630 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T19:22:38.662 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-10-03T19:22:38.664 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T19:22:38.704 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-10-03T19:22:38.741 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-10-03T19:22:38.775 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-10-03T19:22:42.665 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T19:22:42.705 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T19:22:42.742 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T19:22:42.775 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2023-10-03T19:22:42.776 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T19:22:42.816 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-10-03T19:22:42.851 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-10-03T19:22:42.877 INFO:teuthology.orchestra.console.smithi045:Power off completed 2023-10-03T19:22:42.886 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-10-03T19:22:42.918 INFO:teuthology.orchestra.console.smithi079:Power off completed 2023-10-03T19:22:42.987 INFO:teuthology.orchestra.console.smithi172:Power off completed 2023-10-03T19:22:46.854 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T19:22:46.966 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-10-03T19:22:47.067 INFO:teuthology.orchestra.console.smithi146:Power off completed 2023-10-03T19:22:47.171 INFO:teuthology.run:Summary data: description: fs:multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cephfs_misc_tests} duration: 1330.4865546226501 failure_reason: 'Test failure: test_dump_inmemory_log_on_client_eviction (tasks.cephfs.test_misc.TestMisc)' flavor: default owner: scheduled_choffman@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=8028949eec294109855b96721f3cef6e status: fail success: false 2023-10-03T19:22:47.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T19:22:47.242 INFO:teuthology.run:FAIL